2020-05-18T21:05:07.686 INFO:root:teuthology version: 1.0.0-f81437e 2020-05-18T21:05:07.689 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/strays.yaml} --owner scheduled_pdonnell@teuthology --block --lock --verbose --name pdonnell-2020-05-18_20:49:47-fs-wip-pdonnell-testing-20200516.030215-distro-basic-smithi --archive /home/teuthworker/archive/pdonnell-2020-05-18_20:49:47-fs-wip-pdonnell-testing-20200516.030215-distro-basic-smithi/5067927 -- /tmp/teuthology-worker.zqfmqlqn.tmp 2020-05-18T21:05:07.728 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-05-18T21:05:07.806 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2020-05-18_20:49:47-fs-wip-pdonnell-testing-20200516.030215-distro-basic-smithi/5067927 branch: wip-pdonnell-testing-20200516.030215 description: fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/strays.yaml} email: pdonnell@redhat.com first_in_suite: false job_id: '5067927' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2020-05-18_20:49:47-fs-wip-pdonnell-testing-20200516.030215-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-pdonnell-testing-20200516.030215 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 543315c934420269aa12ef2f9dec2c9eadb4fa6f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 543315c934420269aa12ef2f9dec2c9eadb4fa6f thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20200516.030215 sha1: 543315c934420269aa12ef2f9dec2c9eadb4fa6f owner: scheduled_pdonnell@teuthology priority: 75 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.1 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - client.2 - client.3 sha1: 543315c934420269aa12ef2f9dec2c9eadb4fa6f sleep_before_teardown: 0 suite: fs suite_branch: wip-pdonnell-testing-20200516.030215 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200516.030215/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 543315c934420269aa12ef2f9dec2c9eadb4fa6f tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_strays teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.5985 2020-05-18T21:05:07.806 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200516.030215/qa; will attempt to use it 2020-05-18T21:05:07.807 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200516.030215/qa/tasks 2020-05-18T21:05:07.807 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-05-18T21:05:07.810 INFO:teuthology.task.internal:Checking packages... 2020-05-18T21:05:07.843 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '543315c934420269aa12ef2f9dec2c9eadb4fa6f' 2020-05-18T21:05:07.844 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-05-18T21:05:07.846 INFO:teuthology.packaging:ref: None 2020-05-18T21:05:07.846 INFO:teuthology.packaging:tag: None 2020-05-18T21:05:07.846 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20200516.030215 2020-05-18T21:05:07.847 INFO:teuthology.packaging:sha1: 543315c934420269aa12ef2f9dec2c9eadb4fa6f 2020-05-18T21:05:07.847 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-pdonnell-testing-20200516.030215 2020-05-18T21:05:08.101 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-1640-g543315c9344-1focal 2020-05-18T21:05:08.102 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-05-18T21:05:08.115 INFO:teuthology.task.internal:no buildpackages task found 2020-05-18T21:05:08.116 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-05-18T21:05:08.132 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-05-18T21:05:08.133 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-05-18T21:05:08.183 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:05:18.200 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:05:28.217 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:05:38.243 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:05:48.263 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:05:58.281 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:06:08.301 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:06:18.319 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:06:28.331 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:06:38.350 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:06:48.370 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:06:58.389 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:07:08.409 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:07:18.429 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:07:28.451 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:07:38.473 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:07:48.498 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:07:58.532 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:08:08.552 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:08:18.580 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:08:28.601 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:08:38.622 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:08:48.641 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-05-18T21:08:58.664 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-05-18T21:09:08.930 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-05-18T21:09:18.950 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-05-18T21:09:28.968 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-05-18T21:09:38.988 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-05-18T21:09:49.008 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-05-18T21:09:59.022 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-05-18T21:10:09.040 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-05-18T21:10:19.055 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-05-18T21:10:29.074 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-05-18T21:10:39.092 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-05-18T21:10:49.114 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:10:59.132 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-05-18T21:11:09.153 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_pdonnell@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/pdonnell-2020-05-18_20:49:47-fs-wip-pdonnell-testing-20200516.030215-distro-basic-smithi/5067927'} 2020-05-18T21:11:09.181 DEBUG:teuthology.lock.ops:locked ubuntu@smithi063.front.sepia.ceph.com, ubuntu@smithi155.front.sepia.ceph.com 2020-05-18T21:11:09.253 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdd6ec38b70>, signals=[15]) 2020-05-18T21:11:09.488 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of ubuntu 20.04 2020-05-18T21:11:09.494 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of ubuntu 20.04 2020-05-18T21:11:09.920 INFO:teuthology.orchestra.console:Power off smithi155 2020-05-18T21:11:09.922 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-05-18T21:11:09.949 INFO:teuthology.orchestra.console:Power off smithi063 2020-05-18T21:11:09.950 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-05-18T21:11:09.963 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-05-18T21:11:09.980 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-05-18T21:11:10.096 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2020-05-18T21:11:10.108 INFO:teuthology.orchestra.console:Power off for smithi063 completed 2020-05-18T21:11:10.198 INFO:teuthology.orchestra.console:Power on smithi155 2020-05-18T21:11:10.199 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-05-18T21:11:10.213 INFO:teuthology.orchestra.console:Power on smithi063 2020-05-18T21:11:10.214 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-05-18T21:11:10.229 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-05-18T21:11:10.244 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-05-18T21:11:14.259 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-05-18T21:11:14.272 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-05-18T21:11:18.378 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-05-18T21:11:18.399 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-05-18T21:11:18.601 INFO:teuthology.orchestra.console:Power on for smithi155 completed 2020-05-18T21:11:18.615 INFO:teuthology.orchestra.console:Power on for smithi063 completed 2020-05-18T21:11:18.702 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2020-05-18T21:11:18.718 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish 2020-05-18T21:14:35.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:14:35.675 ERROR:teuthology.orchestra.connection:Error connecting to smithi155.front.sepia.ceph.com Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/connection.py", line 108, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 446, in connect passphrase, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 764, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 740, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 1580, in auth_publickey return self.auth_handler.wait_for_response(my_event) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/auth_handler.py", line 250, in wait_for_response raise e paramiko.ssh_exception.AuthenticationException: Authentication failed. 2020-05-18T21:14:50.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:15:01.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:15:10.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:15:15.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:15:19.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:15:24.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:15:28.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:15:33.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:15:37.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:15:42.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:15:46.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:15:51.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:16:23.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:16:28.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:16:29.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:16:34.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:16:35.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:16:40.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:16:44.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:16:44.963 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-05-18T21:16:44.965 INFO:teuthology.orchestra.run.smithi155:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-05-18T21:16:45.614 INFO:teuthology.provision.fog.smithi155:Node is ready 2020-05-18T21:16:45.614 INFO:teuthology.orchestra.run.smithi155:> hostname 2020-05-18T21:16:45.621 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com 2020-05-18T21:16:45.621 INFO:teuthology.orchestra.run.smithi155:> grep smithi155.front.sepia.ceph.com /etc/hosts 2020-05-18T21:16:45.628 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155 2020-05-18T21:16:45.629 INFO:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2020-05-18T21:16:45.864 INFO:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hosts 2020-05-18T21:16:45.883 INFO:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/172.21.15.155/172.21.15.155/g' /etc/hosts 2020-05-18T21:16:45.896 INFO:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hostname 2020-05-18T21:16:45.911 INFO:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2020-05-18T21:16:45.925 INFO:teuthology.provision.fog.smithi155:Deploy complete! 2020-05-18T21:16:45.926 DEBUG:teuthology.parallel:result is None 2020-05-18T21:16:46.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:16:53.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:16:54.023 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-05-18T21:16:54.024 INFO:teuthology.orchestra.run.smithi063:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-05-18T21:16:54.700 INFO:teuthology.provision.fog.smithi063:Node is ready 2020-05-18T21:16:54.700 INFO:teuthology.orchestra.run.smithi063:> hostname 2020-05-18T21:16:54.707 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063.front.sepia.ceph.com 2020-05-18T21:16:54.707 INFO:teuthology.orchestra.run.smithi063:> grep smithi063.front.sepia.ceph.com /etc/hosts 2020-05-18T21:16:54.713 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63 smithi063.front.sepia.ceph.com smithi063 2020-05-18T21:16:54.713 INFO:teuthology.orchestra.run.smithi063:> sudo hostname smithi063 2020-05-18T21:16:54.882 INFO:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hosts 2020-05-18T21:16:54.898 INFO:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/172.21.15.63/172.21.15.63/g' /etc/hosts 2020-05-18T21:16:54.911 INFO:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hostname 2020-05-18T21:16:54.931 INFO:teuthology.orchestra.run.smithi063:> sudo hostname smithi063 2020-05-18T21:16:54.945 INFO:teuthology.provision.fog.smithi063:Deploy complete! 2020-05-18T21:16:54.945 DEBUG:teuthology.parallel:result is None 2020-05-18T21:16:55.103 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com 2020-05-18T21:16:55.104 INFO:teuthology.lock.ops:New key found. Updating... 2020-05-18T21:16:55.125 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com 2020-05-18T21:16:55.126 INFO:teuthology.lock.ops:New key found. Updating... 2020-05-18T21:16:55.146 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server 2020-05-18T21:16:55.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-05-18T21:16:55.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:16:55.190 INFO:teuthology.orchestra.run.smithi063:> true 2020-05-18T21:16:55.313 INFO:teuthology.orchestra.run.smithi063:> uname -m 2020-05-18T21:16:55.319 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2020-05-18T21:16:55.321 INFO:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2020-05-18T21:16:55.366 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Ubuntu" 2020-05-18T21:16:55.366 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="20.04 LTS (Focal Fossa)" 2020-05-18T21:16:55.366 INFO:teuthology.orchestra.run.smithi063.stdout:ID=ubuntu 2020-05-18T21:16:55.367 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE=debian 2020-05-18T21:16:55.367 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Ubuntu 20.04 LTS" 2020-05-18T21:16:55.367 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="20.04" 2020-05-18T21:16:55.367 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.ubuntu.com/" 2020-05-18T21:16:55.367 INFO:teuthology.orchestra.run.smithi063.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-05-18T21:16:55.368 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-05-18T21:16:55.368 INFO:teuthology.orchestra.run.smithi063.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-05-18T21:16:55.368 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_CODENAME=focal 2020-05-18T21:16:55.368 INFO:teuthology.orchestra.run.smithi063.stdout:UBUNTU_CODENAME=focal 2020-05-18T21:16:55.370 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2020-05-18T21:16:55.396 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server 2020-05-18T21:16:55.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-05-18T21:16:55.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:16:55.447 INFO:teuthology.orchestra.run.smithi155:> true 2020-05-18T21:16:55.571 INFO:teuthology.orchestra.run.smithi155:> uname -m 2020-05-18T21:16:55.577 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2020-05-18T21:16:55.577 INFO:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2020-05-18T21:16:55.584 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Ubuntu" 2020-05-18T21:16:55.584 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="20.04 LTS (Focal Fossa)" 2020-05-18T21:16:55.584 INFO:teuthology.orchestra.run.smithi155.stdout:ID=ubuntu 2020-05-18T21:16:55.584 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE=debian 2020-05-18T21:16:55.584 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Ubuntu 20.04 LTS" 2020-05-18T21:16:55.585 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="20.04" 2020-05-18T21:16:55.585 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.ubuntu.com/" 2020-05-18T21:16:55.585 INFO:teuthology.orchestra.run.smithi155.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-05-18T21:16:55.585 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-05-18T21:16:55.585 INFO:teuthology.orchestra.run.smithi155.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-05-18T21:16:55.586 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_CODENAME=focal 2020-05-18T21:16:55.586 INFO:teuthology.orchestra.run.smithi155.stdout:UBUNTU_CODENAME=focal 2020-05-18T21:16:55.586 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2020-05-18T21:16:55.617 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-05-18T21:16:55.646 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi063.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxqmzptgvEdXWQY8G2DFAgm16TtkxwhPDt2qHDnVsX4lf+mDNscy6Acc49d2xovPCFQBqp2WNgyWqUtzpvt2UpV6XH9m7LcwLZWiszL+A8i5fd+FHDZTO5W8oJICeJ/nuHo6ZHGNqTnvkjgqERAtoNcRtz+7x0wEu0+LpYjZL5Ita7e/v5qWT9aZvfIAd7SJ80tzANWwb0EfCW86AXHSEjZ8BfJQvWipnuAW+g9e1/ADNoXxgxckz+7zakpi0x19RAElqb59aKZhLyqO1uys6SwF5iJhox7x4uf/c0UaoED02YX2XNzw+PXjarPhtF0rmCJiCyYJ8sa+6ylQul8qOoJ2SrCifmdGcI1Zxe3zwrRFwlK83mV5ar6h5fsDEBe8vVtKw/93HsSsB5H4PvtKB6LYX1bikcIkHNgOm8GdsK++cY/kyD1AvXv3D+3f5nPivyDiwv6arjAnj39hpN3oI19cD0c3OEQv/eSMWH3sHwmgjwsd3Zbog+idkCUw+tCh0= smithi155.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt5pWAfKKbngKLYWcg7A+vI9BfwvEiBMQk0LIs1b2c14uPYLXFZ9/g5NDEzZD6pdHuNf4+XmeH2uoRJ8MzYvChRcTrKOmFMFJi2eUEpGAVDGqlsq9thUThbWy5xBjLOtQaB9LfKCFgzLQSqmr+mf5WHrNsmdyQHseV6NV+ki58U4ZTFK42BmivnTrc97wTp6tXdMXennNXagGuVB6zpYGIGiAFW593n1eEYC0C70pdVYQe5jez8viZ3hv9MgmPCURLDdgC7OtOjMBip/KvCwjc1Uvy2ZJwEaTajGRMk0Meg/Rs55qphpW3pQxixOaeyEz6QFIddR3WYFAJEChI7UBpsZSPpEbesYc/kco6y6lG0bAH28n+EGbrBjSyj+YyRVhLLmuir6LulfWS4VGxcy+Zi8PCheO2HGGz9MEWWL2AgKbkaRBvGiVPyAz84+xBk+linS2WPJOQS8ZwiBuna3qfxU9pSxwZp9By0H4ztP4EGY7hVT64nILDHPRnrzRq+Ws= 2020-05-18T21:16:55.647 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-05-18T21:16:55.698 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-05-18T21:16:55.703 INFO:teuthology.task.internal:Saving configuration 2020-05-18T21:16:55.720 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-05-18T21:16:55.730 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-05-18T21:16:55.745 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-05-18 21:11:09.161471', 'description': '/home/teuthworker/archive/pdonnell-2020-05-18_20:49:47-fs-wip-pdonnell-testing-20200516.030215-distro-basic-smithi/5067927', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOxKHXAmIkmewkTTqXBZCLYruitaWggMkAB1m0LlCDq8', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi063.front.sepia.ceph.com'} 2020-05-18T21:16:55.758 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-05-18 21:11:09.161492', 'description': '/home/teuthworker/archive/pdonnell-2020-05-18_20:49:47-fs-wip-pdonnell-testing-20200516.030215-distro-basic-smithi/5067927', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEcjHw3ecE5P4jiuNXYNjDaW6LhXPQJPEU5Ubx17+nPC', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi155.front.sepia.ceph.com'} 2020-05-18T21:16:55.758 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-05-18T21:16:55.769 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.1'] 2020-05-18T21:16:55.769 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.2', 'client.3'] 2020-05-18T21:16:55.770 INFO:teuthology.run_tasks:Running task console_log... 2020-05-18T21:16:55.833 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdd6ed328c8>, signals=[15]) 2020-05-18T21:16:55.834 INFO:teuthology.run_tasks:Running task internal.connect... 2020-05-18T21:16:55.844 INFO:teuthology.task.internal:Opening connections... 2020-05-18T21:16:55.844 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2020-05-18T21:16:55.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:16:55.901 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2020-05-18T21:16:55.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:16:55.954 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-05-18T21:16:55.965 INFO:teuthology.orchestra.run.smithi063:> uname -m 2020-05-18T21:16:55.978 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2020-05-18T21:16:55.979 INFO:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2020-05-18T21:16:56.026 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Ubuntu" 2020-05-18T21:16:56.027 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="20.04 LTS (Focal Fossa)" 2020-05-18T21:16:56.027 INFO:teuthology.orchestra.run.smithi063.stdout:ID=ubuntu 2020-05-18T21:16:56.027 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE=debian 2020-05-18T21:16:56.027 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Ubuntu 20.04 LTS" 2020-05-18T21:16:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="20.04" 2020-05-18T21:16:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.ubuntu.com/" 2020-05-18T21:16:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-05-18T21:16:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-05-18T21:16:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-05-18T21:16:56.029 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_CODENAME=focal 2020-05-18T21:16:56.029 INFO:teuthology.orchestra.run.smithi063.stdout:UBUNTU_CODENAME=focal 2020-05-18T21:16:56.029 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2020-05-18T21:16:56.055 INFO:teuthology.orchestra.run.smithi155:> uname -m 2020-05-18T21:16:56.061 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2020-05-18T21:16:56.062 INFO:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2020-05-18T21:16:56.111 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Ubuntu" 2020-05-18T21:16:56.111 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="20.04 LTS (Focal Fossa)" 2020-05-18T21:16:56.112 INFO:teuthology.orchestra.run.smithi155.stdout:ID=ubuntu 2020-05-18T21:16:56.112 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE=debian 2020-05-18T21:16:56.112 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Ubuntu 20.04 LTS" 2020-05-18T21:16:56.112 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="20.04" 2020-05-18T21:16:56.112 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.ubuntu.com/" 2020-05-18T21:16:56.113 INFO:teuthology.orchestra.run.smithi155.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-05-18T21:16:56.113 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-05-18T21:16:56.113 INFO:teuthology.orchestra.run.smithi155.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-05-18T21:16:56.113 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_CODENAME=focal 2020-05-18T21:16:56.114 INFO:teuthology.orchestra.run.smithi155.stdout:UBUNTU_CODENAME=focal 2020-05-18T21:16:56.114 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2020-05-18T21:16:56.140 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-05-18T21:16:56.172 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-05-18T21:16:56.181 INFO:teuthology.task.internal:Checking for old test directory... 2020-05-18T21:16:56.182 INFO:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2020-05-18T21:16:56.185 INFO:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2020-05-18T21:16:56.191 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-05-18T21:16:56.201 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-05-18T21:16:56.201 INFO:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2020-05-18T21:16:56.231 INFO:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2020-05-18T21:16:56.251 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-05-18T21:16:56.294 INFO:teuthology.run_tasks:Running task kernel... 2020-05-18T21:16:56.315 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'mds.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mds.b': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}, 'client.3': {'kdb': True, 'sha1': 'distro'}} 2020-05-18T21:16:56.316 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-05-18T21:16:56.317 INFO:teuthology.orchestra.run.smithi063:> uname -r 2020-05-18T21:16:56.324 INFO:teuthology.orchestra.run.smithi063.stdout:5.4.0-26-generic 2020-05-18T21:16:56.325 INFO:teuthology.task.kernel:Running kernel on smithi063: 5.4.0-26-generic 2020-05-18T21:16:56.325 INFO:teuthology.orchestra.run.smithi063:> sudo apt-get clean 2020-05-18T21:16:56.654 INFO:teuthology.orchestra.run.smithi063:> sudo apt-get update 2020-05-18T21:16:56.862 INFO:teuthology.orchestra.run.smithi063.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [107 kB] 2020-05-18T21:16:56.963 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2020-05-18T21:16:57.044 INFO:teuthology.orchestra.run.smithi063.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [107 kB] 2020-05-18T21:16:57.161 INFO:teuthology.orchestra.run.smithi063.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [61.2 kB] 2020-05-18T21:16:57.199 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [23.4 kB] 2020-05-18T21:16:57.201 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [23.0 kB] 2020-05-18T21:16:57.204 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [1,592 B] 2020-05-18T21:16:57.204 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [4,180 B] 2020-05-18T21:16:57.205 INFO:teuthology.orchestra.run.smithi063.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [1,360 B] 2020-05-18T21:16:57.205 INFO:teuthology.orchestra.run.smithi063.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [27.5 kB] 2020-05-18T21:16:57.208 INFO:teuthology.orchestra.run.smithi063.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [8,428 B] 2020-05-18T21:16:57.209 INFO:teuthology.orchestra.run.smithi063.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [12.1 kB] 2020-05-18T21:16:57.210 INFO:teuthology.orchestra.run.smithi063.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [784 B] 2020-05-18T21:16:57.211 INFO:teuthology.orchestra.run.smithi063.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [1,172 B] 2020-05-18T21:16:57.221 INFO:teuthology.orchestra.run.smithi063.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [540 B] 2020-05-18T21:16:57.378 INFO:teuthology.orchestra.run.smithi063.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-backports InRelease [98.3 kB] 2020-05-18T21:16:57.520 INFO:teuthology.orchestra.run.smithi063.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [48.5 kB] 2020-05-18T21:16:57.624 INFO:teuthology.orchestra.run.smithi063.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [101 kB] 2020-05-18T21:16:57.668 INFO:teuthology.orchestra.run.smithi063.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [36.9 kB] 2020-05-18T21:16:57.683 INFO:teuthology.orchestra.run.smithi063.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [2,312 B] 2020-05-18T21:16:57.684 INFO:teuthology.orchestra.run.smithi063.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [4,180 B] 2020-05-18T21:16:57.686 INFO:teuthology.orchestra.run.smithi063.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [1,360 B] 2020-05-18T21:16:57.687 INFO:teuthology.orchestra.run.smithi063.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [48.6 kB] 2020-05-18T21:16:57.708 INFO:teuthology.orchestra.run.smithi063.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [22.1 kB] 2020-05-18T21:16:57.718 INFO:teuthology.orchestra.run.smithi063.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [20.4 kB] 2020-05-18T21:16:57.726 INFO:teuthology.orchestra.run.smithi063.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [1,380 B] 2020-05-18T21:16:57.727 INFO:teuthology.orchestra.run.smithi063.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [1,172 B] 2020-05-18T21:16:57.749 INFO:teuthology.orchestra.run.smithi063.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [540 B] 2020-05-18T21:16:57.830 INFO:teuthology.orchestra.run.smithi063.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [1,956 B] 2020-05-18T21:16:57.831 INFO:teuthology.orchestra.run.smithi063.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [2,792 B] 2020-05-18T21:16:57.831 INFO:teuthology.orchestra.run.smithi063.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [1,280 B] 2020-05-18T21:16:57.832 INFO:teuthology.orchestra.run.smithi063.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [188 B] 2020-05-18T21:16:59.970 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 772 kB in 1s (733 kB/s) 2020-05-18T21:17:01.792 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2020-05-18T21:17:01.813 INFO:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-05-18T21:17:01.881 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2020-05-18T21:17:02.034 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2020-05-18T21:17:02.035 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2020-05-18T21:17:02.119 INFO:teuthology.orchestra.run.smithi063.stderr:E: Unable to locate package linux-image-current-generic 2020-05-18T21:17:02.120 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-05-18T21:17:02.121 INFO:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-05-18T21:17:02.187 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2020-05-18T21:17:02.327 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2020-05-18T21:17:02.328 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2020-05-18T21:17:02.494 INFO:teuthology.orchestra.run.smithi063.stdout:The following additional packages will be installed: 2020-05-18T21:17:02.494 INFO:teuthology.orchestra.run.smithi063.stdout: linux-generic linux-headers-5.4.0-29 linux-headers-5.4.0-29-generic 2020-05-18T21:17:02.494 INFO:teuthology.orchestra.run.smithi063.stdout: linux-headers-generic linux-image-5.4.0-29-generic 2020-05-18T21:17:02.494 INFO:teuthology.orchestra.run.smithi063.stdout: linux-modules-5.4.0-29-generic linux-modules-extra-5.4.0-29-generic 2020-05-18T21:17:02.495 INFO:teuthology.orchestra.run.smithi063.stdout:Suggested packages: 2020-05-18T21:17:02.495 INFO:teuthology.orchestra.run.smithi063.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2020-05-18T21:17:02.496 INFO:teuthology.orchestra.run.smithi063.stdout:Recommended packages: 2020-05-18T21:17:02.496 INFO:teuthology.orchestra.run.smithi063.stdout: thermald 2020-05-18T21:17:02.526 INFO:teuthology.orchestra.run.smithi063.stdout:The following NEW packages will be installed: 2020-05-18T21:17:02.526 INFO:teuthology.orchestra.run.smithi063.stdout: linux-headers-5.4.0-29 linux-headers-5.4.0-29-generic 2020-05-18T21:17:02.526 INFO:teuthology.orchestra.run.smithi063.stdout: linux-image-5.4.0-29-generic linux-modules-5.4.0-29-generic 2020-05-18T21:17:02.527 INFO:teuthology.orchestra.run.smithi063.stdout: linux-modules-extra-5.4.0-29-generic 2020-05-18T21:17:02.527 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be upgraded: 2020-05-18T21:17:02.528 INFO:teuthology.orchestra.run.smithi063.stdout: linux-generic linux-headers-generic linux-image-generic 2020-05-18T21:17:02.956 INFO:teuthology.orchestra.run.smithi063.stdout:3 upgraded, 5 newly installed, 0 to remove and 50 not upgraded. 2020-05-18T21:17:02.956 INFO:teuthology.orchestra.run.smithi063.stdout:Need to get 73.9 MB of archives. 2020-05-18T21:17:02.957 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 359 MB of additional disk space will be used. 2020-05-18T21:17:02.957 INFO:teuthology.orchestra.run.smithi063.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-29-generic amd64 5.4.0-29.33 [14.3 MB] 2020-05-18T21:17:04.050 INFO:teuthology.orchestra.run.smithi063.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-29-generic amd64 5.4.0-29.33 [8,871 kB] 2020-05-18T21:17:04.348 INFO:teuthology.orchestra.run.smithi063.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-29-generic amd64 5.4.0-29.33 [38.6 MB] 2020-05-18T21:17:05.623 INFO:teuthology.orchestra.run.smithi063.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.29.34 [1,900 B] 2020-05-18T21:17:05.624 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.29.34 [2,712 B] 2020-05-18T21:17:05.624 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-29 all 5.4.0-29.33 [10.9 MB] 2020-05-18T21:17:05.951 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-29-generic amd64 5.4.0-29.33 [1,214 kB] 2020-05-18T21:17:05.965 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.29.34 [2,592 B] 2020-05-18T21:17:06.462 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 73.9 MB in 3s (21.5 MB/s) 2020-05-18T21:17:06.642 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-modules-5.4.0-29-generic. 2020-05-18T21:17:08.443 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 113167 files and directories currently installed.) 2020-05-18T21:17:08.447 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../0-linux-modules-5.4.0-29-generic_5.4.0-29.33_amd64.deb ... 2020-05-18T21:17:08.637 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-modules-5.4.0-29-generic (5.4.0-29.33) ... 2020-05-18T21:17:10.578 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-image-5.4.0-29-generic. 2020-05-18T21:17:10.592 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../1-linux-image-5.4.0-29-generic_5.4.0-29.33_amd64.deb ... 2020-05-18T21:17:10.688 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-image-5.4.0-29-generic (5.4.0-29.33) ... 2020-05-18T21:17:11.684 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-29-generic. 2020-05-18T21:17:11.695 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-29-generic_5.4.0-29.33_amd64.deb ... 2020-05-18T21:17:11.739 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-modules-extra-5.4.0-29-generic (5.4.0-29.33) ... 2020-05-18T21:17:16.286 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../3-linux-generic_5.4.0.29.34_amd64.deb ... 2020-05-18T21:17:16.421 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-generic (5.4.0.29.34) over (5.4.0.26.32) ... 2020-05-18T21:17:16.763 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.29.34_amd64.deb ... 2020-05-18T21:17:16.883 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-image-generic (5.4.0.29.34) over (5.4.0.26.32) ... 2020-05-18T21:17:17.186 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-headers-5.4.0-29. 2020-05-18T21:17:17.200 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../5-linux-headers-5.4.0-29_5.4.0-29.33_all.deb ... 2020-05-18T21:17:17.244 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-headers-5.4.0-29 (5.4.0-29.33) ... 2020-05-18T21:17:23.665 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-headers-5.4.0-29-generic. 2020-05-18T21:17:23.686 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../6-linux-headers-5.4.0-29-generic_5.4.0-29.33_amd64.deb ... 2020-05-18T21:17:23.714 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-headers-5.4.0-29-generic (5.4.0-29.33) ... 2020-05-18T21:17:26.607 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.29.34_amd64.deb ... 2020-05-18T21:17:26.775 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-headers-generic (5.4.0.29.34) over (5.4.0.26.32) ... 2020-05-18T21:17:27.070 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-modules-5.4.0-29-generic (5.4.0-29.33) ... 2020-05-18T21:17:28.229 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-image-5.4.0-29-generic (5.4.0-29.33) ... 2020-05-18T21:17:29.324 INFO:teuthology.orchestra.run.smithi063.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.4.0-29-generic 2020-05-18T21:17:29.325 INFO:teuthology.orchestra.run.smithi063.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.4.0-29-generic 2020-05-18T21:17:29.464 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-headers-5.4.0-29 (5.4.0-29.33) ... 2020-05-18T21:17:29.591 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-modules-extra-5.4.0-29-generic (5.4.0-29.33) ... 2020-05-18T21:17:30.734 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-image-generic (5.4.0.29.34) ... 2020-05-18T21:17:30.860 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-headers-5.4.0-29-generic (5.4.0-29.33) ... 2020-05-18T21:17:30.986 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-headers-generic (5.4.0.29.34) ... 2020-05-18T21:17:31.128 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-generic (5.4.0.29.34) ... 2020-05-18T21:17:31.247 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for linux-image-5.4.0-29-generic (5.4.0-29.33) ... 2020-05-18T21:17:31.431 INFO:teuthology.orchestra.run.smithi063.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-05-18T21:17:31.432 INFO:teuthology.orchestra.run.smithi063.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-29-generic 2020-05-18T21:17:53.536 INFO:teuthology.orchestra.run.smithi063.stdout:/etc/kernel/postinst.d/zz-update-grub: 2020-05-18T21:17:53.537 INFO:teuthology.orchestra.run.smithi063.stdout:Sourcing file `/etc/default/grub' 2020-05-18T21:17:53.557 INFO:teuthology.orchestra.run.smithi063.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2020-05-18T21:17:53.585 INFO:teuthology.orchestra.run.smithi063.stdout:Generating grub configuration file ... 2020-05-18T21:17:53.930 INFO:teuthology.orchestra.run.smithi063.stdout:Found linux image: /boot/vmlinuz-5.4.0-29-generic 2020-05-18T21:17:53.966 INFO:teuthology.orchestra.run.smithi063.stdout:Found initrd image: /boot/initrd.img-5.4.0-29-generic 2020-05-18T21:17:54.392 INFO:teuthology.orchestra.run.smithi063.stdout:Found linux image: /boot/vmlinuz-5.4.0-26-generic 2020-05-18T21:17:54.403 INFO:teuthology.orchestra.run.smithi063.stdout:Found initrd image: /boot/initrd.img-5.4.0-26-generic 2020-05-18T21:17:57.089 INFO:teuthology.orchestra.run.smithi063.stdout:done 2020-05-18T21:17:57.433 INFO:teuthology.orchestra.run.smithi063:> dpkg -s linux-image-generic 2020-05-18T21:17:57.463 INFO:teuthology.orchestra.run.smithi063.stdout:Package: linux-image-generic 2020-05-18T21:17:57.464 INFO:teuthology.orchestra.run.smithi063.stdout:Status: install ok installed 2020-05-18T21:17:57.464 INFO:teuthology.orchestra.run.smithi063.stdout:Priority: optional 2020-05-18T21:17:57.464 INFO:teuthology.orchestra.run.smithi063.stdout:Section: kernel 2020-05-18T21:17:57.464 INFO:teuthology.orchestra.run.smithi063.stdout:Installed-Size: 17 2020-05-18T21:17:57.465 INFO:teuthology.orchestra.run.smithi063.stdout:Maintainer: Ubuntu Kernel Team 2020-05-18T21:17:57.465 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: amd64 2020-05-18T21:17:57.465 INFO:teuthology.orchestra.run.smithi063.stdout:Source: linux-meta 2020-05-18T21:17:57.465 INFO:teuthology.orchestra.run.smithi063.stdout:Version: 5.4.0.29.34 2020-05-18T21:17:57.465 INFO:teuthology.orchestra.run.smithi063.stdout:Provides: virtualbox-guest-modules (= 6.1.6-dfsg-1), wireguard-modules (= 1.0.20200413-1), zfs-modules (= 0.8.3-1ubuntu12) 2020-05-18T21:17:57.465 INFO:teuthology.orchestra.run.smithi063.stdout:Depends: linux-image-5.4.0-29-generic, linux-modules-extra-5.4.0-29-generic, linux-firmware, intel-microcode, amd64-microcode 2020-05-18T21:17:57.466 INFO:teuthology.orchestra.run.smithi063.stdout:Recommends: thermald 2020-05-18T21:17:57.466 INFO:teuthology.orchestra.run.smithi063.stdout:Description: Generic Linux kernel image 2020-05-18T21:17:57.466 INFO:teuthology.orchestra.run.smithi063.stdout: This package will always depend on the latest generic kernel image 2020-05-18T21:17:57.466 INFO:teuthology.orchestra.run.smithi063.stdout: available. 2020-05-18T21:17:57.467 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-26-generic Expected: 5.4.0-29-generic 2020-05-18T21:17:57.467 INFO:teuthology.orchestra.run.smithi155:> uname -r 2020-05-18T21:17:57.474 INFO:teuthology.orchestra.run.smithi155.stdout:5.4.0-26-generic 2020-05-18T21:17:57.475 INFO:teuthology.task.kernel:Running kernel on smithi155: 5.4.0-26-generic 2020-05-18T21:17:57.475 INFO:teuthology.orchestra.run.smithi155:> sudo apt-get clean 2020-05-18T21:17:57.592 INFO:teuthology.orchestra.run.smithi155:> sudo apt-get update 2020-05-18T21:17:57.768 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [107 kB] 2020-05-18T21:17:57.885 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2020-05-18T21:17:57.967 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [107 kB] 2020-05-18T21:17:58.063 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [23.4 kB] 2020-05-18T21:17:58.104 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [61.2 kB] 2020-05-18T21:17:58.111 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [23.0 kB] 2020-05-18T21:17:58.114 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [1,592 B] 2020-05-18T21:17:58.114 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [4,180 B] 2020-05-18T21:17:58.115 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [1,360 B] 2020-05-18T21:17:58.115 INFO:teuthology.orchestra.run.smithi155.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [27.5 kB] 2020-05-18T21:17:58.118 INFO:teuthology.orchestra.run.smithi155.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [8,428 B] 2020-05-18T21:17:58.119 INFO:teuthology.orchestra.run.smithi155.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [12.1 kB] 2020-05-18T21:17:58.121 INFO:teuthology.orchestra.run.smithi155.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [784 B] 2020-05-18T21:17:58.122 INFO:teuthology.orchestra.run.smithi155.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [1,172 B] 2020-05-18T21:17:58.131 INFO:teuthology.orchestra.run.smithi155.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [540 B] 2020-05-18T21:17:58.301 INFO:teuthology.orchestra.run.smithi155.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-backports InRelease [98.3 kB] 2020-05-18T21:17:58.446 INFO:teuthology.orchestra.run.smithi155.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [48.5 kB] 2020-05-18T21:17:58.550 INFO:teuthology.orchestra.run.smithi155.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [101 kB] 2020-05-18T21:17:58.595 INFO:teuthology.orchestra.run.smithi155.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [36.9 kB] 2020-05-18T21:17:58.610 INFO:teuthology.orchestra.run.smithi155.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [2,312 B] 2020-05-18T21:17:58.611 INFO:teuthology.orchestra.run.smithi155.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [4,180 B] 2020-05-18T21:17:58.613 INFO:teuthology.orchestra.run.smithi155.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [1,360 B] 2020-05-18T21:17:58.614 INFO:teuthology.orchestra.run.smithi155.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [22.1 kB] 2020-05-18T21:17:58.624 INFO:teuthology.orchestra.run.smithi155.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [48.6 kB] 2020-05-18T21:17:58.645 INFO:teuthology.orchestra.run.smithi155.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [20.4 kB] 2020-05-18T21:17:58.654 INFO:teuthology.orchestra.run.smithi155.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [1,380 B] 2020-05-18T21:17:58.655 INFO:teuthology.orchestra.run.smithi155.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [1,172 B] 2020-05-18T21:17:58.676 INFO:teuthology.orchestra.run.smithi155.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [540 B] 2020-05-18T21:17:58.757 INFO:teuthology.orchestra.run.smithi155.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [1,956 B] 2020-05-18T21:17:58.757 INFO:teuthology.orchestra.run.smithi155.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [2,792 B] 2020-05-18T21:17:58.758 INFO:teuthology.orchestra.run.smithi155.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [1,280 B] 2020-05-18T21:17:58.758 INFO:teuthology.orchestra.run.smithi155.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [188 B] 2020-05-18T21:18:00.249 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 772 kB in 1s (723 kB/s) 2020-05-18T21:18:01.238 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2020-05-18T21:18:01.259 INFO:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-05-18T21:18:01.325 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2020-05-18T21:18:01.446 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2020-05-18T21:18:01.447 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2020-05-18T21:18:01.511 INFO:teuthology.orchestra.run.smithi155.stderr:E: Unable to locate package linux-image-current-generic 2020-05-18T21:18:01.512 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-05-18T21:18:01.513 INFO:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-05-18T21:18:01.577 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2020-05-18T21:18:01.709 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2020-05-18T21:18:01.710 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2020-05-18T21:18:01.843 INFO:teuthology.orchestra.run.smithi155.stdout:The following additional packages will be installed: 2020-05-18T21:18:01.844 INFO:teuthology.orchestra.run.smithi155.stdout: linux-generic linux-headers-5.4.0-29 linux-headers-5.4.0-29-generic 2020-05-18T21:18:01.844 INFO:teuthology.orchestra.run.smithi155.stdout: linux-headers-generic linux-image-5.4.0-29-generic 2020-05-18T21:18:01.844 INFO:teuthology.orchestra.run.smithi155.stdout: linux-modules-5.4.0-29-generic linux-modules-extra-5.4.0-29-generic 2020-05-18T21:18:01.845 INFO:teuthology.orchestra.run.smithi155.stdout:Suggested packages: 2020-05-18T21:18:01.845 INFO:teuthology.orchestra.run.smithi155.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2020-05-18T21:18:01.845 INFO:teuthology.orchestra.run.smithi155.stdout:Recommended packages: 2020-05-18T21:18:01.846 INFO:teuthology.orchestra.run.smithi155.stdout: thermald 2020-05-18T21:18:01.875 INFO:teuthology.orchestra.run.smithi155.stdout:The following NEW packages will be installed: 2020-05-18T21:18:01.876 INFO:teuthology.orchestra.run.smithi155.stdout: linux-headers-5.4.0-29 linux-headers-5.4.0-29-generic 2020-05-18T21:18:01.876 INFO:teuthology.orchestra.run.smithi155.stdout: linux-image-5.4.0-29-generic linux-modules-5.4.0-29-generic 2020-05-18T21:18:01.877 INFO:teuthology.orchestra.run.smithi155.stdout: linux-modules-extra-5.4.0-29-generic 2020-05-18T21:18:01.877 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages will be upgraded: 2020-05-18T21:18:01.878 INFO:teuthology.orchestra.run.smithi155.stdout: linux-generic linux-headers-generic linux-image-generic 2020-05-18T21:18:02.055 INFO:teuthology.orchestra.run.smithi155.stdout:3 upgraded, 5 newly installed, 0 to remove and 50 not upgraded. 2020-05-18T21:18:02.055 INFO:teuthology.orchestra.run.smithi155.stdout:Need to get 73.9 MB of archives. 2020-05-18T21:18:02.055 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 359 MB of additional disk space will be used. 2020-05-18T21:18:02.055 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-29-generic amd64 5.4.0-29.33 [14.3 MB] 2020-05-18T21:18:03.175 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-29-generic amd64 5.4.0-29.33 [8,871 kB] 2020-05-18T21:18:03.369 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-29-generic amd64 5.4.0-29.33 [38.6 MB] 2020-05-18T21:18:04.591 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.29.34 [1,900 B] 2020-05-18T21:18:04.661 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.29.34 [2,712 B] 2020-05-18T21:18:04.661 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-29 all 5.4.0-29.33 [10.9 MB] 2020-05-18T21:18:05.032 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-29-generic amd64 5.4.0-29.33 [1,214 kB] 2020-05-18T21:18:05.077 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.29.34 [2,592 B] 2020-05-18T21:18:05.559 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 73.9 MB in 3s (23.1 MB/s) 2020-05-18T21:18:05.753 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-modules-5.4.0-29-generic. 2020-05-18T21:18:07.566 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 113167 files and directories currently installed.) 2020-05-18T21:18:07.571 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../0-linux-modules-5.4.0-29-generic_5.4.0-29.33_amd64.deb ... 2020-05-18T21:18:07.682 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-modules-5.4.0-29-generic (5.4.0-29.33) ... 2020-05-18T21:18:09.549 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-image-5.4.0-29-generic. 2020-05-18T21:18:09.564 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../1-linux-image-5.4.0-29-generic_5.4.0-29.33_amd64.deb ... 2020-05-18T21:18:09.661 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-image-5.4.0-29-generic (5.4.0-29.33) ... 2020-05-18T21:18:10.660 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-29-generic. 2020-05-18T21:18:10.681 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-29-generic_5.4.0-29.33_amd64.deb ... 2020-05-18T21:18:10.718 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-modules-extra-5.4.0-29-generic (5.4.0-29.33) ... 2020-05-18T21:18:15.415 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../3-linux-generic_5.4.0.29.34_amd64.deb ... 2020-05-18T21:18:15.555 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-generic (5.4.0.29.34) over (5.4.0.26.32) ... 2020-05-18T21:18:15.907 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.29.34_amd64.deb ... 2020-05-18T21:18:16.034 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-image-generic (5.4.0.29.34) over (5.4.0.26.32) ... 2020-05-18T21:18:16.379 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-headers-5.4.0-29. 2020-05-18T21:18:16.396 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../5-linux-headers-5.4.0-29_5.4.0-29.33_all.deb ... 2020-05-18T21:18:16.437 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-headers-5.4.0-29 (5.4.0-29.33) ... 2020-05-18T21:18:21.939 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-headers-5.4.0-29-generic. 2020-05-18T21:18:21.963 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../6-linux-headers-5.4.0-29-generic_5.4.0-29.33_amd64.deb ... 2020-05-18T21:18:22.005 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-headers-5.4.0-29-generic (5.4.0-29.33) ... 2020-05-18T21:18:24.574 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.29.34_amd64.deb ... 2020-05-18T21:18:24.735 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-headers-generic (5.4.0.29.34) over (5.4.0.26.32) ... 2020-05-18T21:18:25.113 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-modules-5.4.0-29-generic (5.4.0-29.33) ... 2020-05-18T21:18:26.223 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-image-5.4.0-29-generic (5.4.0-29.33) ... 2020-05-18T21:18:27.274 INFO:teuthology.orchestra.run.smithi155.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.4.0-29-generic 2020-05-18T21:18:27.275 INFO:teuthology.orchestra.run.smithi155.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.4.0-29-generic 2020-05-18T21:18:27.416 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-headers-5.4.0-29 (5.4.0-29.33) ... 2020-05-18T21:18:27.567 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-modules-extra-5.4.0-29-generic (5.4.0-29.33) ... 2020-05-18T21:18:28.660 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-image-generic (5.4.0.29.34) ... 2020-05-18T21:18:28.761 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-headers-5.4.0-29-generic (5.4.0-29.33) ... 2020-05-18T21:18:28.887 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-headers-generic (5.4.0.29.34) ... 2020-05-18T21:18:29.047 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-generic (5.4.0.29.34) ... 2020-05-18T21:18:29.173 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for linux-image-5.4.0-29-generic (5.4.0-29.33) ... 2020-05-18T21:18:29.363 INFO:teuthology.orchestra.run.smithi155.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-05-18T21:18:29.364 INFO:teuthology.orchestra.run.smithi155.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-29-generic 2020-05-18T21:18:50.689 INFO:teuthology.orchestra.run.smithi155.stdout:/etc/kernel/postinst.d/zz-update-grub: 2020-05-18T21:18:50.689 INFO:teuthology.orchestra.run.smithi155.stdout:Sourcing file `/etc/default/grub' 2020-05-18T21:18:50.711 INFO:teuthology.orchestra.run.smithi155.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2020-05-18T21:18:50.733 INFO:teuthology.orchestra.run.smithi155.stdout:Generating grub configuration file ... 2020-05-18T21:18:51.099 INFO:teuthology.orchestra.run.smithi155.stdout:Found linux image: /boot/vmlinuz-5.4.0-29-generic 2020-05-18T21:18:51.132 INFO:teuthology.orchestra.run.smithi155.stdout:Found initrd image: /boot/initrd.img-5.4.0-29-generic 2020-05-18T21:18:51.502 INFO:teuthology.orchestra.run.smithi155.stdout:Found linux image: /boot/vmlinuz-5.4.0-26-generic 2020-05-18T21:18:51.513 INFO:teuthology.orchestra.run.smithi155.stdout:Found initrd image: /boot/initrd.img-5.4.0-26-generic 2020-05-18T21:18:54.158 INFO:teuthology.orchestra.run.smithi155.stdout:done 2020-05-18T21:18:54.467 INFO:teuthology.orchestra.run.smithi155:> dpkg -s linux-image-generic 2020-05-18T21:18:54.496 INFO:teuthology.orchestra.run.smithi155.stdout:Package: linux-image-generic 2020-05-18T21:18:54.497 INFO:teuthology.orchestra.run.smithi155.stdout:Status: install ok installed 2020-05-18T21:18:54.497 INFO:teuthology.orchestra.run.smithi155.stdout:Priority: optional 2020-05-18T21:18:54.497 INFO:teuthology.orchestra.run.smithi155.stdout:Section: kernel 2020-05-18T21:18:54.497 INFO:teuthology.orchestra.run.smithi155.stdout:Installed-Size: 17 2020-05-18T21:18:54.498 INFO:teuthology.orchestra.run.smithi155.stdout:Maintainer: Ubuntu Kernel Team 2020-05-18T21:18:54.498 INFO:teuthology.orchestra.run.smithi155.stdout:Architecture: amd64 2020-05-18T21:18:54.498 INFO:teuthology.orchestra.run.smithi155.stdout:Source: linux-meta 2020-05-18T21:18:54.498 INFO:teuthology.orchestra.run.smithi155.stdout:Version: 5.4.0.29.34 2020-05-18T21:18:54.498 INFO:teuthology.orchestra.run.smithi155.stdout:Provides: virtualbox-guest-modules (= 6.1.6-dfsg-1), wireguard-modules (= 1.0.20200413-1), zfs-modules (= 0.8.3-1ubuntu12) 2020-05-18T21:18:54.499 INFO:teuthology.orchestra.run.smithi155.stdout:Depends: linux-image-5.4.0-29-generic, linux-modules-extra-5.4.0-29-generic, linux-firmware, intel-microcode, amd64-microcode 2020-05-18T21:18:54.499 INFO:teuthology.orchestra.run.smithi155.stdout:Recommends: thermald 2020-05-18T21:18:54.499 INFO:teuthology.orchestra.run.smithi155.stdout:Description: Generic Linux kernel image 2020-05-18T21:18:54.499 INFO:teuthology.orchestra.run.smithi155.stdout: This package will always depend on the latest generic kernel image 2020-05-18T21:18:54.499 INFO:teuthology.orchestra.run.smithi155.stdout: available. 2020-05-18T21:18:54.500 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-26-generic Expected: 5.4.0-29-generic 2020-05-18T21:18:54.501 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2020-05-18T21:18:54.501 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-05-18T21:18:54.501 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-05-18T21:18:54.502 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2020-05-18T21:18:54.502 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi063.front.sepia.ceph.com, path=None, version=distro) 2020-05-18T21:18:54.502 INFO:teuthology.orchestra.run.smithi063:> sudo apt-get clean 2020-05-18T21:18:54.592 INFO:teuthology.orchestra.run.smithi063:> sudo apt-get update 2020-05-18T21:18:54.874 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2020-05-18T21:18:54.874 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2020-05-18T21:18:54.944 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2020-05-18T21:18:55.023 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2020-05-18T21:18:56.219 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2020-05-18T21:18:56.240 INFO:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-05-18T21:18:56.306 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2020-05-18T21:18:56.443 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2020-05-18T21:18:56.445 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2020-05-18T21:18:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:E: Unable to locate package linux-image-current-generic 2020-05-18T21:18:56.524 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-05-18T21:18:56.525 INFO:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-05-18T21:18:56.594 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2020-05-18T21:18:56.732 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2020-05-18T21:18:56.733 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2020-05-18T21:18:56.887 INFO:teuthology.orchestra.run.smithi063.stdout:linux-image-generic is already the newest version (5.4.0.29.34). 2020-05-18T21:18:56.888 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 0 to remove and 50 not upgraded. 2020-05-18T21:18:56.889 INFO:teuthology.orchestra.run.smithi063:> dpkg -s linux-image-generic 2020-05-18T21:18:56.927 INFO:teuthology.orchestra.run.smithi063.stdout:Package: linux-image-generic 2020-05-18T21:18:56.928 INFO:teuthology.orchestra.run.smithi063.stdout:Status: install ok installed 2020-05-18T21:18:56.928 INFO:teuthology.orchestra.run.smithi063.stdout:Priority: optional 2020-05-18T21:18:56.928 INFO:teuthology.orchestra.run.smithi063.stdout:Section: kernel 2020-05-18T21:18:56.929 INFO:teuthology.orchestra.run.smithi063.stdout:Installed-Size: 17 2020-05-18T21:18:56.929 INFO:teuthology.orchestra.run.smithi063.stdout:Maintainer: Ubuntu Kernel Team 2020-05-18T21:18:56.929 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: amd64 2020-05-18T21:18:56.930 INFO:teuthology.orchestra.run.smithi063.stdout:Source: linux-meta 2020-05-18T21:18:56.930 INFO:teuthology.orchestra.run.smithi063.stdout:Version: 5.4.0.29.34 2020-05-18T21:18:56.930 INFO:teuthology.orchestra.run.smithi063.stdout:Provides: virtualbox-guest-modules (= 6.1.6-dfsg-1), wireguard-modules (= 1.0.20200413-1), zfs-modules (= 0.8.3-1ubuntu12) 2020-05-18T21:18:56.931 INFO:teuthology.orchestra.run.smithi063.stdout:Depends: linux-image-5.4.0-29-generic, linux-modules-extra-5.4.0-29-generic, linux-firmware, intel-microcode, amd64-microcode 2020-05-18T21:18:56.931 INFO:teuthology.orchestra.run.smithi063.stdout:Recommends: thermald 2020-05-18T21:18:56.931 INFO:teuthology.orchestra.run.smithi063.stdout:Description: Generic Linux kernel image 2020-05-18T21:18:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: This package will always depend on the latest generic kernel image 2020-05-18T21:18:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: available. 2020-05-18T21:18:56.933 INFO:teuthology.orchestra.run.smithi063:> mktemp 2020-05-18T21:18:56.948 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.6E2aQxGVBh 2020-05-18T21:18:56.948 INFO:teuthology.orchestra.run.smithi063:> sudo cp /boot/grub/grub.cfg /tmp/tmp.6E2aQxGVBh 2020-05-18T21:18:57.007 INFO:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.6E2aQxGVBh 2020-05-18T21:18:57.082 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.6E2aQxGVBh is 8KB 2020-05-18T21:18:57.096 INFO:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.6E2aQxGVBh 2020-05-18T21:18:57.110 INFO:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2020-05-18T21:18:57.171 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'cat > /etc/grub.d/01_ceph_kernel' && sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-05-18T21:18:57.215 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-29-generic 2020-05-18T21:18:57.216 INFO:teuthology.orchestra.run.smithi063:> sudo update-grub 2020-05-18T21:18:58.250 INFO:teuthology.orchestra.run.smithi063.stderr:Sourcing file `/etc/default/grub' 2020-05-18T21:18:58.254 INFO:teuthology.orchestra.run.smithi063.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2020-05-18T21:18:58.281 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2020-05-18T21:18:58.636 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-5.4.0-29-generic 2020-05-18T21:18:58.648 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-5.4.0-29-generic 2020-05-18T21:18:59.043 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-5.4.0-26-generic 2020-05-18T21:18:59.055 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-5.4.0-26-generic 2020-05-18T21:19:00.673 INFO:teuthology.orchestra.run.smithi063.stderr:done 2020-05-18T21:19:00.674 INFO:teuthology.orchestra.run.smithi063:> sudo shutdown -r now 2020-05-18T21:19:00.677 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2020-05-18T21:19:00.677 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi155.front.sepia.ceph.com, path=None, version=distro) 2020-05-18T21:19:00.678 INFO:teuthology.orchestra.run.smithi155:> sudo apt-get clean 2020-05-18T21:19:00.757 INFO:teuthology.orchestra.run.smithi155:> sudo apt-get update 2020-05-18T21:19:00.924 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2020-05-18T21:19:01.035 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2020-05-18T21:19:01.117 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2020-05-18T21:19:01.198 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2020-05-18T21:19:02.266 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2020-05-18T21:19:02.287 INFO:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-05-18T21:19:02.356 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2020-05-18T21:19:02.476 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2020-05-18T21:19:02.477 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2020-05-18T21:19:02.541 INFO:teuthology.orchestra.run.smithi155.stderr:E: Unable to locate package linux-image-current-generic 2020-05-18T21:19:02.543 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-05-18T21:19:02.544 INFO:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-05-18T21:19:02.605 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2020-05-18T21:19:02.737 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2020-05-18T21:19:02.738 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2020-05-18T21:19:02.885 INFO:teuthology.orchestra.run.smithi155.stdout:linux-image-generic is already the newest version (5.4.0.29.34). 2020-05-18T21:19:02.886 INFO:teuthology.orchestra.run.smithi155.stdout:0 upgraded, 0 newly installed, 0 to remove and 50 not upgraded. 2020-05-18T21:19:02.887 INFO:teuthology.orchestra.run.smithi155:> dpkg -s linux-image-generic 2020-05-18T21:19:02.912 INFO:teuthology.orchestra.run.smithi155.stdout:Package: linux-image-generic 2020-05-18T21:19:02.912 INFO:teuthology.orchestra.run.smithi155.stdout:Status: install ok installed 2020-05-18T21:19:02.913 INFO:teuthology.orchestra.run.smithi155.stdout:Priority: optional 2020-05-18T21:19:02.913 INFO:teuthology.orchestra.run.smithi155.stdout:Section: kernel 2020-05-18T21:19:02.913 INFO:teuthology.orchestra.run.smithi155.stdout:Installed-Size: 17 2020-05-18T21:19:02.913 INFO:teuthology.orchestra.run.smithi155.stdout:Maintainer: Ubuntu Kernel Team 2020-05-18T21:19:02.913 INFO:teuthology.orchestra.run.smithi155.stdout:Architecture: amd64 2020-05-18T21:19:02.914 INFO:teuthology.orchestra.run.smithi155.stdout:Source: linux-meta 2020-05-18T21:19:02.914 INFO:teuthology.orchestra.run.smithi155.stdout:Version: 5.4.0.29.34 2020-05-18T21:19:02.914 INFO:teuthology.orchestra.run.smithi155.stdout:Provides: virtualbox-guest-modules (= 6.1.6-dfsg-1), wireguard-modules (= 1.0.20200413-1), zfs-modules (= 0.8.3-1ubuntu12) 2020-05-18T21:19:02.914 INFO:teuthology.orchestra.run.smithi155.stdout:Depends: linux-image-5.4.0-29-generic, linux-modules-extra-5.4.0-29-generic, linux-firmware, intel-microcode, amd64-microcode 2020-05-18T21:19:02.914 INFO:teuthology.orchestra.run.smithi155.stdout:Recommends: thermald 2020-05-18T21:19:02.915 INFO:teuthology.orchestra.run.smithi155.stdout:Description: Generic Linux kernel image 2020-05-18T21:19:02.915 INFO:teuthology.orchestra.run.smithi155.stdout: This package will always depend on the latest generic kernel image 2020-05-18T21:19:02.915 INFO:teuthology.orchestra.run.smithi155.stdout: available. 2020-05-18T21:19:02.915 INFO:teuthology.orchestra.run.smithi155:> mktemp 2020-05-18T21:19:02.922 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.uSI1rVno55 2020-05-18T21:19:02.922 INFO:teuthology.orchestra.run.smithi155:> sudo cp /boot/grub/grub.cfg /tmp/tmp.uSI1rVno55 2020-05-18T21:19:02.939 INFO:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.uSI1rVno55 2020-05-18T21:19:03.015 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.uSI1rVno55 is 8KB 2020-05-18T21:19:03.028 INFO:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.uSI1rVno55 2020-05-18T21:19:03.035 INFO:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2020-05-18T21:19:03.094 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'cat > /etc/grub.d/01_ceph_kernel' && sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-05-18T21:19:03.136 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-29-generic 2020-05-18T21:19:03.137 INFO:teuthology.orchestra.run.smithi155:> sudo update-grub 2020-05-18T21:19:04.371 INFO:teuthology.orchestra.run.smithi155.stderr:Sourcing file `/etc/default/grub' 2020-05-18T21:19:04.378 INFO:teuthology.orchestra.run.smithi155.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2020-05-18T21:19:04.398 INFO:teuthology.orchestra.run.smithi155.stderr:Generating grub configuration file ... 2020-05-18T21:19:04.670 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.4.0-29-generic 2020-05-18T21:19:04.682 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.4.0-29-generic 2020-05-18T21:19:05.032 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.4.0-26-generic 2020-05-18T21:19:05.044 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.4.0-26-generic 2020-05-18T21:19:06.662 INFO:teuthology.orchestra.run.smithi155.stderr:done 2020-05-18T21:19:06.663 INFO:teuthology.orchestra.run.smithi155:> sudo shutdown -r now 2020-05-18T21:19:07.554 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-05-18T21:19:36.666 INFO:teuthology.misc:Re-opening connections... 2020-05-18T21:19:36.668 INFO:teuthology.misc:trying to connect to ubuntu@smithi063.front.sepia.ceph.com 2020-05-18T21:19:36.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-05-18T21:19:36.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:19:55.102 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2020-05-18T21:19:55.103 INFO:teuthology.misc:trying to connect to ubuntu@smithi155.front.sepia.ceph.com 2020-05-18T21:19:55.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-05-18T21:19:55.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:20:13.534 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2020-05-18T21:20:13.535 DEBUG:teuthology.misc:waited 36.86769962310791 2020-05-18T21:20:14.537 INFO:teuthology.misc:trying to connect to ubuntu@smithi063.front.sepia.ceph.com 2020-05-18T21:20:14.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-05-18T21:20:14.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:20:46.193 INFO:teuthology.orchestra.run.smithi063:> true 2020-05-18T21:20:46.836 DEBUG:teuthology.misc:waited 70.1680736541748 2020-05-18T21:20:47.836 INFO:teuthology.misc:trying to connect to ubuntu@smithi155.front.sepia.ceph.com 2020-05-18T21:20:47.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-05-18T21:20:47.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:20:48.675 INFO:teuthology.orchestra.run.smithi155:> true 2020-05-18T21:20:49.734 DEBUG:teuthology.misc:waited 73.0666995048523 2020-05-18T21:20:50.736 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2020-05-18T21:20:50.736 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-29-generic"... 2020-05-18T21:20:50.737 INFO:teuthology.orchestra.run.smithi063:> uname -r 2020-05-18T21:20:50.744 INFO:teuthology.orchestra.run.smithi063.stdout:5.4.0-29-generic 2020-05-18T21:20:50.744 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-29-generic vs 5.4.0-29-generic 2020-05-18T21:20:50.745 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-05-18T21:20:50.745 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2020-05-18T21:20:50.745 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-29-generic"... 2020-05-18T21:20:50.746 INFO:teuthology.orchestra.run.smithi155:> uname -r 2020-05-18T21:20:50.752 INFO:teuthology.orchestra.run.smithi155.stdout:5.4.0-29-generic 2020-05-18T21:20:50.753 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-29-generic vs 5.4.0-29-generic 2020-05-18T21:20:50.753 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-05-18T21:20:51.754 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-05-18T21:20:51.755 INFO:teuthology.orchestra.run.smithi063:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-05-18T21:20:51.922 INFO:teuthology.orchestra.run.smithi063.stdout:ttyS1 2020-05-18T21:20:51.941 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-05-18T21:20:51.942 INFO:teuthology.orchestra.run.smithi155:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-05-18T21:20:52.042 INFO:teuthology.orchestra.run.smithi155.stdout:ttyS1 2020-05-18T21:20:52.068 INFO:teuthology.run_tasks:Running task internal.base... 2020-05-18T21:20:52.084 INFO:teuthology.task.internal:Creating test directory... 2020-05-18T21:20:52.085 INFO:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-05-18T21:20:52.087 INFO:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-05-18T21:20:52.095 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-05-18T21:20:52.135 INFO:teuthology.run_tasks:Running task internal.archive... 2020-05-18T21:20:52.155 INFO:teuthology.task.internal:Creating archive directory... 2020-05-18T21:20:52.155 INFO:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-05-18T21:20:52.158 INFO:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-05-18T21:20:52.184 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-05-18T21:20:52.198 INFO:teuthology.task.internal:Enabling coredump saving... 2020-05-18T21:20:52.198 INFO:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-05-18T21:20:52.229 INFO:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-05-18T21:20:52.250 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-05-18T21:20:52.254 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-05-18T21:20:52.257 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-05-18T21:20:52.265 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-05-18T21:20:52.267 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-05-18T21:20:52.277 INFO:teuthology.task.internal:Configuring sudo... 2020-05-18T21:20:52.278 INFO:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-05-18T21:20:52.281 INFO:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-05-18T21:20:52.326 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-05-18T21:20:52.346 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-05-18T21:20:52.347 INFO:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-05-18T21:20:52.359 INFO:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-05-18T21:20:52.371 INFO:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-05-18T21:20:52.410 INFO:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-05-18T21:20:52.416 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-05-18T21:20:52.427 INFO:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-05-18T21:20:52.434 INFO:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-05-18T21:20:52.441 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-05-18T21:20:52.488 INFO:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2020-05-18T21:20:52.490 INFO:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2020-05-18T21:20:52.568 INFO:teuthology.run_tasks:Running task internal.timer... 2020-05-18T21:20:52.588 INFO:teuthology.task.internal:Starting timer... 2020-05-18T21:20:52.588 INFO:teuthology.run_tasks:Running task kernel... 2020-05-18T21:20:52.598 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'mds.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mds.b': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}, 'client.3': {'kdb': True, 'sha1': 'distro'}} 2020-05-18T21:20:52.599 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-05-18T21:20:52.599 INFO:teuthology.orchestra.run.smithi063:> uname -r 2020-05-18T21:20:52.605 INFO:teuthology.orchestra.run.smithi063.stdout:5.4.0-29-generic 2020-05-18T21:20:52.606 INFO:teuthology.task.kernel:Running kernel on smithi063: 5.4.0-29-generic 2020-05-18T21:20:52.606 INFO:teuthology.orchestra.run.smithi063:> sudo apt-get clean 2020-05-18T21:20:52.805 INFO:teuthology.orchestra.run.smithi063:> sudo apt-get update 2020-05-18T21:20:53.129 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2020-05-18T21:20:53.222 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2020-05-18T21:20:53.303 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2020-05-18T21:20:53.395 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2020-05-18T21:20:57.554 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2020-05-18T21:20:57.575 INFO:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-05-18T21:20:57.652 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2020-05-18T21:20:57.810 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2020-05-18T21:20:57.822 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2020-05-18T21:20:57.904 INFO:teuthology.orchestra.run.smithi063.stderr:E: Unable to locate package linux-image-current-generic 2020-05-18T21:20:57.906 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-05-18T21:20:57.906 INFO:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-05-18T21:20:57.975 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2020-05-18T21:20:58.112 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2020-05-18T21:20:58.113 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2020-05-18T21:20:58.268 INFO:teuthology.orchestra.run.smithi063.stdout:linux-image-generic is already the newest version (5.4.0.29.34). 2020-05-18T21:20:58.269 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 0 to remove and 50 not upgraded. 2020-05-18T21:20:58.270 INFO:teuthology.orchestra.run.smithi063:> dpkg -s linux-image-generic 2020-05-18T21:20:58.312 INFO:teuthology.orchestra.run.smithi063.stdout:Package: linux-image-generic 2020-05-18T21:20:58.312 INFO:teuthology.orchestra.run.smithi063.stdout:Status: install ok installed 2020-05-18T21:20:58.313 INFO:teuthology.orchestra.run.smithi063.stdout:Priority: optional 2020-05-18T21:20:58.313 INFO:teuthology.orchestra.run.smithi063.stdout:Section: kernel 2020-05-18T21:20:58.313 INFO:teuthology.orchestra.run.smithi063.stdout:Installed-Size: 17 2020-05-18T21:20:58.313 INFO:teuthology.orchestra.run.smithi063.stdout:Maintainer: Ubuntu Kernel Team 2020-05-18T21:20:58.313 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: amd64 2020-05-18T21:20:58.314 INFO:teuthology.orchestra.run.smithi063.stdout:Source: linux-meta 2020-05-18T21:20:58.314 INFO:teuthology.orchestra.run.smithi063.stdout:Version: 5.4.0.29.34 2020-05-18T21:20:58.314 INFO:teuthology.orchestra.run.smithi063.stdout:Provides: virtualbox-guest-modules (= 6.1.6-dfsg-1), wireguard-modules (= 1.0.20200413-1), zfs-modules (= 0.8.3-1ubuntu12) 2020-05-18T21:20:58.314 INFO:teuthology.orchestra.run.smithi063.stdout:Depends: linux-image-5.4.0-29-generic, linux-modules-extra-5.4.0-29-generic, linux-firmware, intel-microcode, amd64-microcode 2020-05-18T21:20:58.314 INFO:teuthology.orchestra.run.smithi063.stdout:Recommends: thermald 2020-05-18T21:20:58.315 INFO:teuthology.orchestra.run.smithi063.stdout:Description: Generic Linux kernel image 2020-05-18T21:20:58.315 INFO:teuthology.orchestra.run.smithi063.stdout: This package will always depend on the latest generic kernel image 2020-05-18T21:20:58.315 INFO:teuthology.orchestra.run.smithi063.stdout: available. 2020-05-18T21:20:58.315 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-05-18T21:20:58.316 INFO:teuthology.orchestra.run.smithi155:> uname -r 2020-05-18T21:20:58.329 INFO:teuthology.orchestra.run.smithi155.stdout:5.4.0-29-generic 2020-05-18T21:20:58.329 INFO:teuthology.task.kernel:Running kernel on smithi155: 5.4.0-29-generic 2020-05-18T21:20:58.329 INFO:teuthology.orchestra.run.smithi155:> sudo apt-get clean 2020-05-18T21:20:58.497 INFO:teuthology.orchestra.run.smithi155:> sudo apt-get update 2020-05-18T21:20:58.717 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2020-05-18T21:20:58.825 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2020-05-18T21:20:58.907 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2020-05-18T21:20:58.987 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2020-05-18T21:21:00.683 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2020-05-18T21:21:00.702 INFO:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-05-18T21:21:00.860 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2020-05-18T21:21:01.007 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2020-05-18T21:21:01.009 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2020-05-18T21:21:01.083 INFO:teuthology.orchestra.run.smithi155.stderr:E: Unable to locate package linux-image-current-generic 2020-05-18T21:21:01.084 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-05-18T21:21:01.085 INFO:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-05-18T21:21:01.148 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2020-05-18T21:21:01.281 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2020-05-18T21:21:01.281 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2020-05-18T21:21:01.431 INFO:teuthology.orchestra.run.smithi155.stdout:linux-image-generic is already the newest version (5.4.0.29.34). 2020-05-18T21:21:01.432 INFO:teuthology.orchestra.run.smithi155.stdout:0 upgraded, 0 newly installed, 0 to remove and 50 not upgraded. 2020-05-18T21:21:01.433 INFO:teuthology.orchestra.run.smithi155:> dpkg -s linux-image-generic 2020-05-18T21:21:01.470 INFO:teuthology.orchestra.run.smithi155.stdout:Package: linux-image-generic 2020-05-18T21:21:01.470 INFO:teuthology.orchestra.run.smithi155.stdout:Status: install ok installed 2020-05-18T21:21:01.470 INFO:teuthology.orchestra.run.smithi155.stdout:Priority: optional 2020-05-18T21:21:01.471 INFO:teuthology.orchestra.run.smithi155.stdout:Section: kernel 2020-05-18T21:21:01.471 INFO:teuthology.orchestra.run.smithi155.stdout:Installed-Size: 17 2020-05-18T21:21:01.471 INFO:teuthology.orchestra.run.smithi155.stdout:Maintainer: Ubuntu Kernel Team 2020-05-18T21:21:01.471 INFO:teuthology.orchestra.run.smithi155.stdout:Architecture: amd64 2020-05-18T21:21:01.471 INFO:teuthology.orchestra.run.smithi155.stdout:Source: linux-meta 2020-05-18T21:21:01.472 INFO:teuthology.orchestra.run.smithi155.stdout:Version: 5.4.0.29.34 2020-05-18T21:21:01.472 INFO:teuthology.orchestra.run.smithi155.stdout:Provides: virtualbox-guest-modules (= 6.1.6-dfsg-1), wireguard-modules (= 1.0.20200413-1), zfs-modules (= 0.8.3-1ubuntu12) 2020-05-18T21:21:01.472 INFO:teuthology.orchestra.run.smithi155.stdout:Depends: linux-image-5.4.0-29-generic, linux-modules-extra-5.4.0-29-generic, linux-firmware, intel-microcode, amd64-microcode 2020-05-18T21:21:01.472 INFO:teuthology.orchestra.run.smithi155.stdout:Recommends: thermald 2020-05-18T21:21:01.472 INFO:teuthology.orchestra.run.smithi155.stdout:Description: Generic Linux kernel image 2020-05-18T21:21:01.473 INFO:teuthology.orchestra.run.smithi155.stdout: This package will always depend on the latest generic kernel image 2020-05-18T21:21:01.473 INFO:teuthology.orchestra.run.smithi155.stdout: available. 2020-05-18T21:21:01.473 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-05-18T21:21:01.473 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-05-18T21:21:01.474 INFO:teuthology.orchestra.run.smithi063:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-05-18T21:21:01.497 INFO:teuthology.orchestra.run.smithi063.stdout:ttyS1 2020-05-18T21:21:01.593 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-05-18T21:21:01.594 INFO:teuthology.orchestra.run.smithi155:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-05-18T21:21:01.610 INFO:teuthology.orchestra.run.smithi155.stdout:ttyS1 2020-05-18T21:21:01.732 INFO:teuthology.run_tasks:Running task pcp... 2020-05-18T21:21:02.021 INFO:teuthology.run_tasks:Running task selinux... 2020-05-18T21:21:02.032 DEBUG:teuthology.task.selinux:Excluding smithi063: OS 'ubuntu' does not support SELinux 2020-05-18T21:21:02.033 DEBUG:teuthology.task.selinux:Excluding smithi155: OS 'ubuntu' does not support SELinux 2020-05-18T21:21:02.033 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-05-18T21:21:02.034 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2020-05-18T21:21:02.034 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-05-18T21:21:02.034 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-05-18T21:21:02.054 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-05-18T21:21:02.055 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-05-18T21:21:02.074 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-05-18T21:21:02.077 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi063.front.sepia.ceph.com,smithi155.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-05-18T21:21:02.446 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-05-18T21:21:03.395 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-05-18T21:21:05.770 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-05-18T21:21:05.791 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:05 +0000 (0:00:00.071) 0:00:00.071 ************ 2020-05-18T21:21:05.805 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:05 +0000 (0:00:00.014) 0:00:00.085 ************ 2020-05-18T21:21:07.992 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-05-18T21:21:07.993 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] 2020-05-18T21:21:08.084 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:08 +0000 (0:00:02.279) 0:00:02.364 ************ 2020-05-18T21:21:08.104 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] 2020-05-18T21:21:08.179 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:08 +0000 (0:00:00.094) 0:00:02.458 ************ 2020-05-18T21:21:08.468 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-05-18T21:21:08.470 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-05-18T21:21:08.530 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:08 +0000 (0:00:00.351) 0:00:02.810 ************ 2020-05-18T21:21:08.569 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:08 +0000 (0:00:00.039) 0:00:02.849 ************ 2020-05-18T21:21:09.033 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-05-18T21:21:09.035 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} ok: [smithi155.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-05-18T21:21:09.077 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:09 +0000 (0:00:00.507) 0:00:03.357 ************ 2020-05-18T21:21:09.127 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:09 +0000 (0:00:00.049) 0:00:03.407 ************ 2020-05-18T21:21:09.139 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:09.193 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:09 +0000 (0:00:00.065) 0:00:03.473 ************ 2020-05-18T21:21:09.202 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:09.240 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:09 +0000 (0:00:00.047) 0:00:03.520 ************ 2020-05-18T21:21:09.611 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-05-18T21:21:09.613 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-05-18T21:21:09.653 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:09 +0000 (0:00:00.413) 0:00:03.933 ************ 2020-05-18T21:21:09.662 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-05-18T21:21:09.700 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:09 +0000 (0:00:00.046) 0:00:03.980 ************ 2020-05-18T21:21:10.573 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-05-18T21:21:10.575 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2020-05-18T21:21:10.608 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:10 +0000 (0:00:00.908) 0:00:04.888 ************ 2020-05-18T21:21:10.671 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:10 +0000 (0:00:00.062) 0:00:04.951 ************ 2020-05-18T21:21:11.069 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-05-18T21:21:11.070 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-05-18T21:21:11.072 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-05-18T21:21:11.113 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-05-18T21:21:11.115 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-05-18T21:21:11.221 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-05-18T21:21:11.226 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-05-18T21:21:11.369 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:11 +0000 (0:00:00.698) 0:00:05.649 ************ 2020-05-18T21:21:11.407 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:11 +0000 (0:00:00.037) 0:00:05.686 ************ 2020-05-18T21:21:12.417 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi155.front.sepia.ceph.com] 2020-05-18T21:21:12.540 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] 2020-05-18T21:21:12.607 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-05-18T21:21:12.607 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:12 +0000 (0:00:01.200) 0:00:06.887 ************ 2020-05-18T21:21:12.657 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:12 +0000 (0:00:00.049) 0:00:06.937 ************ 2020-05-18T21:21:13.158 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-05-18T21:21:13.160 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.169781", "end": "2020-05-18 21:21:13.136523", "rc": 0, "start": "2020-05-18 21:21:12.966742", "stderr": "", "stderr_lines": [], "stdout": "c86c547126377d9eb959f02d0ec399c86a476654", "stdout_lines": ["c86c547126377d9eb959f02d0ec399c86a476654"]} 2020-05-18T21:21:13.198 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:13 +0000 (0:00:00.540) 0:00:07.478 ************ 2020-05-18T21:21:13.218 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.173345", "end": "2020-05-18 21:21:13.165295", "rc": 0, "start": "2020-05-18 21:21:12.991950", "stderr": "", "stderr_lines": [], "stdout": "c86c547126377d9eb959f02d0ec399c86a476654", "stdout_lines": ["c86c547126377d9eb959f02d0ec399c86a476654"]} 2020-05-18T21:21:13.270 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:13 +0000 (0:00:00.071) 0:00:07.549 ************ 2020-05-18T21:21:13.355 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-05-18T21:21:13.357 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013090", "end": "2020-05-18 21:21:13.595054", "failed_when_result": false, "rc": 0, "start": "2020-05-18 21:21:13.581964", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} 2020-05-18T21:21:13.410 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:13 +0000 (0:00:00.140) 0:00:07.689 ************ 2020-05-18T21:21:13.447 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.023988", "end": "2020-05-18 21:21:13.716647", "failed_when_result": false, "rc": 0, "start": "2020-05-18 21:21:13.692659", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} 2020-05-18T21:21:13.481 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:13 +0000 (0:00:00.071) 0:00:07.761 ************ 2020-05-18T21:21:13.491 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-05-18T21:21:13.493 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:13.534 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:13 +0000 (0:00:00.053) 0:00:07.814 ************ 2020-05-18T21:21:13.541 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:13.578 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:13 +0000 (0:00:00.043) 0:00:07.857 ************ 2020-05-18T21:21:13.584 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-05-18T21:21:13.585 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:13.620 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:13 +0000 (0:00:00.043) 0:00:07.900 ************ 2020-05-18T21:21:13.627 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:13.663 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:13 +0000 (0:00:00.043) 0:00:07.943 ************ 2020-05-18T21:21:13.670 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-05-18T21:21:13.672 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:13.711 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:13 +0000 (0:00:00.042) 0:00:07.986 ************ 2020-05-18T21:21:13.713 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:13.751 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:13 +0000 (0:00:00.044) 0:00:08.031 ************ 2020-05-18T21:21:13.758 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-05-18T21:21:13.760 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:13.795 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:13 +0000 (0:00:00.044) 0:00:08.075 ************ 2020-05-18T21:21:13.802 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:13.840 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:13 +0000 (0:00:00.045) 0:00:08.120 ************ 2020-05-18T21:21:13.850 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:13.889 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:13 +0000 (0:00:00.049) 0:00:08.169 ************ 2020-05-18T21:21:13.899 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:13.939 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:13 +0000 (0:00:00.048) 0:00:08.218 ************ 2020-05-18T21:21:14.068 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* ok: [smithi063.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-05-18T21:21:14.111 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:14 +0000 (0:00:00.172) 0:00:08.390 ************ 2020-05-18T21:21:14.120 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-05-18T21:21:14.161 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:14 +0000 (0:00:00.050) 0:00:08.441 ************ 2020-05-18T21:21:14.319 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-05-18T21:21:14.322 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-05-18T21:21:14.351 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-05-18T21:21:14.467 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-05-18T21:21:14.501 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-05-18T21:21:14.622 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-05-18T21:21:14.639 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-05-18T21:21:14.764 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-05-18T21:21:14.787 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-05-18T21:21:14.907 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-05-18T21:21:14.939 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-05-18T21:21:15.058 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-05-18T21:21:15.071 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-05-18T21:21:15.221 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-05-18T21:21:15.223 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-05-18T21:21:15.362 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-05-18T21:21:15.373 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-05-18T21:21:15.489 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-05-18T21:21:15.521 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-05-18T21:21:15.628 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-05-18T21:21:15.670 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-05-18T21:21:15.767 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-05-18T21:21:15.821 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-05-18T21:21:15.919 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'aemerson', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-05-18T21:21:15.962 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'aemerson', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-05-18T21:21:16.056 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-05-18T21:21:16.129 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-05-18T21:21:16.194 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-05-18T21:21:16.268 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-05-18T21:21:16.344 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-05-18T21:21:16.407 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-05-18T21:21:16.479 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-05-18T21:21:16.562 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-05-18T21:21:16.617 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-05-18T21:21:16.703 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-05-18T21:21:16.749 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-05-18T21:21:16.841 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-05-18T21:21:16.888 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-05-18T21:21:16.972 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-05-18T21:21:17.037 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-05-18T21:21:17.131 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-05-18T21:21:17.178 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-05-18T21:21:17.283 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-05-18T21:21:17.333 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-05-18T21:21:17.428 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-05-18T21:21:17.471 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-05-18T21:21:17.591 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-05-18T21:21:17.613 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-05-18T21:21:17.753 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-05-18T21:21:17.788 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-05-18T21:21:17.890 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-05-18T21:21:17.933 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-05-18T21:21:18.043 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-05-18T21:21:18.070 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-05-18T21:21:18.204 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-05-18T21:21:18.215 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-05-18T21:21:18.346 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-05-18T21:21:18.347 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-05-18T21:21:18.480 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-05-18T21:21:18.492 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-05-18T21:21:18.611 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-05-18T21:21:18.674 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-05-18T21:21:18.739 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-05-18T21:21:18.803 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-05-18T21:21:18.888 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-05-18T21:21:18.942 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-05-18T21:21:19.026 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-05-18T21:21:19.092 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-05-18T21:21:19.160 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-05-18T21:21:19.252 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-05-18T21:21:19.316 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-05-18T21:21:19.318 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:19.407 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-05-18T21:21:19.470 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-05-18T21:21:19.547 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-05-18T21:21:19.611 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-05-18T21:21:19.704 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-05-18T21:21:19.771 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-05-18T21:21:19.851 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-05-18T21:21:19.917 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-05-18T21:21:19.998 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-05-18T21:21:20.054 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-05-18T21:21:20.149 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-05-18T21:21:20.181 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-05-18T21:21:20.287 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-05-18T21:21:20.329 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-05-18T21:21:20.431 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-05-18T21:21:20.473 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-05-18T21:21:20.593 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-05-18T21:21:20.626 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-05-18T21:21:20.741 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-05-18T21:21:20.763 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-05-18T21:21:20.881 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-05-18T21:21:20.904 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-05-18T21:21:21.046 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-05-18T21:21:21.048 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-05-18T21:21:21.185 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-05-18T21:21:21.200 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-05-18T21:21:21.322 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-05-18T21:21:21.335 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-05-18T21:21:21.464 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-05-18T21:21:21.475 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-05-18T21:21:21.612 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-05-18T21:21:21.627 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-05-18T21:21:21.756 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-05-18T21:21:21.801 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-05-18T21:21:21.906 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-05-18T21:21:21.949 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-05-18T21:21:22.049 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-05-18T21:21:22.125 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-05-18T21:21:22.183 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-05-18T21:21:22.298 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-05-18T21:21:22.320 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-05-18T21:21:22.457 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-05-18T21:21:22.458 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-05-18T21:21:22.591 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-05-18T21:21:22.649 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-05-18T21:21:22.727 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-05-18T21:21:22.800 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-05-18T21:21:22.879 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-05-18T21:21:22.974 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-05-18T21:21:23.006 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-05-18T21:21:23.127 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-05-18T21:21:23.161 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-05-18T21:21:23.268 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-05-18T21:21:23.289 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-05-18T21:21:23.415 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-05-18T21:21:23.427 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-05-18T21:21:23.551 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-05-18T21:21:23.573 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-05-18T21:21:23.707 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-05-18T21:21:23.842 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-05-18T21:21:23.855 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-05-18T21:21:23.977 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-05-18T21:21:23.989 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-05-18T21:21:24.122 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-05-18T21:21:24.124 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-05-18T21:21:24.262 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-05-18T21:21:24.274 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-05-18T21:21:24.413 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-05-18T21:21:24.424 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-05-18T21:21:24.540 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-05-18T21:21:24.573 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-05-18T21:21:24.705 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-05-18T21:21:24.847 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-05-18T21:21:24.859 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-05-18T21:21:24.999 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-05-18T21:21:25.011 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-05-18T21:21:25.134 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-05-18T21:21:25.146 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-05-18T21:21:25.292 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-05-18T21:21:25.318 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-05-18T21:21:25.436 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-05-18T21:21:25.458 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-05-18T21:21:25.582 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-05-18T21:21:25.593 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-05-18T21:21:25.733 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-05-18T21:21:25.745 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-05-18T21:21:25.900 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-05-18T21:21:25.961 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-05-18T21:21:26.075 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-05-18T21:21:26.139 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-05-18T21:21:26.234 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-05-18T21:21:26.288 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-05-18T21:21:26.372 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-05-18T21:21:26.435 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-05-18T21:21:26.509 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-05-18T21:21:26.575 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-05-18T21:21:26.673 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-05-18T21:21:26.730 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-05-18T21:21:26.835 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-05-18T21:21:26.863 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-05-18T21:21:26.979 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-05-18T21:21:27.014 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-05-18T21:21:27.131 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-05-18T21:21:27.180 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-05-18T21:21:27.291 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-05-18T21:21:27.333 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-05-18T21:21:27.416 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-05-18T21:21:27.502 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-05-18T21:21:27.558 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-05-18T21:21:27.642 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-05-18T21:21:27.695 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-05-18T21:21:27.778 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-05-18T21:21:27.848 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-05-18T21:21:27.917 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-05-18T21:21:27.990 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-05-18T21:21:28.053 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-05-18T21:21:28.132 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-05-18T21:21:28.195 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-05-18T21:21:28.270 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-05-18T21:21:28.335 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-05-18T21:21:28.413 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-05-18T21:21:28.476 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-05-18T21:21:28.549 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-05-18T21:21:28.625 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-05-18T21:21:28.688 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-05-18T21:21:28.762 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-05-18T21:21:28.816 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-05-18T21:21:28.912 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-05-18T21:21:28.965 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-05-18T21:21:29.044 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-05-18T21:21:29.092 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-05-18T21:21:29.196 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-05-18T21:21:29.247 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-05-18T21:21:29.325 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-05-18T21:21:29.411 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-05-18T21:21:29.537 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-05-18T21:21:29.589 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-05-18T21:21:29.711 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-05-18T21:21:29.776 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d\nxiubli@lxbceph0 s0gvBwazopcgx4LPu0pQiA 1b2012fe8c6ea0a54dfd0e7a6fb1a19982b934cf6d84a64d21aa16dbe8510db3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d\nxiubli@lxbceph0 s0gvBwazopcgx4LPu0pQiA 1b2012fe8c6ea0a54dfd0e7a6fb1a19982b934cf6d84a64d21aa16dbe8510db3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-05-18T21:21:29.885 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-05-18T21:21:29.938 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-05-18T21:21:30.047 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-05-18T21:21:30.113 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-05-18T21:21:30.194 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-05-18T21:21:30.277 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-05-18T21:21:30.334 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-05-18T21:21:30.424 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2020-05-18T21:21:30.489 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d\nxiubli@lxbceph0 s0gvBwazopcgx4LPu0pQiA 1b2012fe8c6ea0a54dfd0e7a6fb1a19982b934cf6d84a64d21aa16dbe8510db3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d\nxiubli@lxbceph0 s0gvBwazopcgx4LPu0pQiA 1b2012fe8c6ea0a54dfd0e7a6fb1a19982b934cf6d84a64d21aa16dbe8510db3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-05-18T21:21:30.572 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-05-18T21:21:30.629 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-05-18T21:21:30.719 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-05-18T21:21:30.784 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-05-18T21:21:30.875 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2020-05-18T21:21:30.919 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-05-18T21:21:31.061 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2020-05-18T21:21:31.219 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-05-18T21:21:31.357 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-05-18T21:21:31.473 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-05-18T21:21:31.519 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2020-05-18T21:21:32.001 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-05-18T21:21:32.122 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:32 +0000 (0:00:17.960) 0:00:26.402 ************ 2020-05-18T21:21:32.149 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-05-18T21:21:32.190 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:32 +0000 (0:00:00.062) 0:00:26.465 ************ 2020-05-18T21:21:32.192 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-05-18T21:21:32.192 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-05-18T21:21:32.258 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-05-18T21:21:32.262 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 2020-05-18T21:21:32.264 INFO:teuthology.task.ansible.out: 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAx 2020-05-18T21:21:32.265 INFO:teuthology.task.ansible.out:j+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8ea 2020-05-18T21:21:32.267 INFO:teuthology.task.ansible.out:c8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f261 2020-05-18T21:21:32.269 INFO:teuthology.task.ansible.out:02d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomai 2020-05-18T21:21:32.270 INFO:teuthology.task.ansible.out:wang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redha 2020-05-18T21:21:32.272 INFO:teuthology.task.ansible.out:t.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMiv 2020-05-18T21:21:32.274 INFO:teuthology.task.ansible.out:DNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad 2020-05-18T21:21:32.274 INFO:teuthology.task.ansible.out:7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "beng 2020-05-18T21:21:32.282 INFO:teuthology.task.ansible.out:land@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name" 2020-05-18T21:21:32.283 INFO:teuthology.task.ansible.out:: "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643 2020-05-18T21:21:32.285 INFO:teuthology.task.ansible.out:eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d\nxiubli@lxbceph0 s0gvBwazopcgx4LPu0pQiA 1b2012fe8c6ea0a54dfd0e7a6fb1a19982b934cf6d84a64d21aa16dbe8510db3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb 2020-05-18T21:21:32.287 INFO:teuthology.task.ansible.out:801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}]}, "changed": false} 2020-05-18T21:21:32.314 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:32 +0000 (0:00:00.129) 0:00:26.594 ************ 2020-05-18T21:21:32.598 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ changed: [smithi063.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-05-18T21:21:32.746 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:32 +0000 (0:00:00.431) 0:00:27.026 ************ 2020-05-18T21:21:32.785 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-05-18T21:21:32.819 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:32 +0000 (0:00:00.073) 0:00:27.099 ************ 2020-05-18T21:21:32.880 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-05-18T21:21:32.885 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 2020-05-18T21:21:32.887 INFO:teuthology.task.ansible.out: 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAx 2020-05-18T21:21:32.889 INFO:teuthology.task.ansible.out:j+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8ea 2020-05-18T21:21:32.891 INFO:teuthology.task.ansible.out:c8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f261 2020-05-18T21:21:32.893 INFO:teuthology.task.ansible.out:02d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomai 2020-05-18T21:21:32.899 INFO:teuthology.task.ansible.out:wang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redha 2020-05-18T21:21:32.901 INFO:teuthology.task.ansible.out:t.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMiv 2020-05-18T21:21:32.904 INFO:teuthology.task.ansible.out:DNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "beng 2020-05-18T21:21:32.906 INFO:teuthology.task.ansible.out:land@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name" 2020-05-18T21:21:32.908 INFO:teuthology.task.ansible.out:: "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643 2020-05-18T21:21:32.909 INFO:teuthology.task.ansible.out:eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d\nxiubli@lxbceph0 s0gvBwazopcgx4LPu0pQiA 1b2012fe8c6ea0a54dfd0e7a6fb1a19982b934cf6d84a64d21aa16dbe8510db3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb 2020-05-18T21:21:32.911 INFO:teuthology.task.ansible.out:801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}]}, "changed": false} 2020-05-18T21:21:32.965 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:32 +0000 (0:00:00.145) 0:00:27.245 ************ 2020-05-18T21:21:33.256 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:33.258 INFO:teuthology.task.ansible.out:TASK [users : Clone the keys repo] ********************************************* ok: [smithi155.front.sepia.ceph.com -> localhost] => {"after": "c86c547126377d9eb959f02d0ec399c86a476654", "attempts": 1, "before": "c86c547126377d9eb959f02d0ec399c86a476654", "changed": false, "remote_url_changed": false} 2020-05-18T21:21:33.305 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:33 +0000 (0:00:00.339) 0:00:27.585 ************ 2020-05-18T21:21:33.549 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-05-18T21:21:33.550 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-05-18T21:21:33.675 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-05-18T21:21:33.817 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-05-18T21:21:33.819 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com -> localhost] => {"after": "c86c547126377d9eb959f02d0ec399c86a476654", "attempts": 1, "before": "c86c547126377d9eb959f02d0ec399c86a476654", "changed": false, "remote_url_changed": false} 2020-05-18T21:21:33.874 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:33 +0000 (0:00:00.568) 0:00:28.153 ************ 2020-05-18T21:21:34.091 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-05-18T21:21:34.092 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-05-18T21:21:34.102 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-05-18T21:21:34.250 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-05-18T21:21:34.259 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2020-05-18T21:21:34.261 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2020-05-18T21:21:34.402 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-05-18T21:21:34.413 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-05-18T21:21:34.543 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2020-05-18T21:21:34.546 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2020-05-18T21:21:34.575 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2020-05-18T21:21:34.584 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-05-18T21:21:34.724 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-05-18T21:21:34.726 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-05-18T21:21:34.861 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2020-05-18T21:21:34.883 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2020-05-18T21:21:34.884 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-05-18T21:21:35.020 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-05-18T21:21:35.022 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-05-18T21:21:35.032 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:35.159 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2020-05-18T21:21:35.160 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2020-05-18T21:21:35.162 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-05-18T21:21:35.174 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'aemerson', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:35.182 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:35.193 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:35.293 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-05-18T21:21:35.321 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:35.335 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-05-18T21:21:35.455 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2020-05-18T21:21:35.458 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-05-18T21:21:35.466 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2020-05-18T21:21:35.468 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'aemerson', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgc 2020-05-18T21:21:35.469 INFO:teuthology.task.ansible.out:G90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:35.478 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:35.510 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:35.606 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-05-18T21:21:35.688 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-05-18T21:21:35.741 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-05-18T21:21:35.856 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2020-05-18T21:21:35.858 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-05-18T21:21:35.878 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2020-05-18T21:21:36.000 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-05-18T21:21:36.002 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-05-18T21:21:36.149 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658 2020-05-18T21:21:36.151 INFO:teuthology.task.ansible.out:\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-05-18T21:21:36.294 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2020-05-18T21:21:36.337 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-05-18T21:21:36.467 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-05-18T21:21:36.468 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2020-05-18T21:21:36.470 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-05-18T21:21:36.578 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-05-18T21:21:36.625 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2020-05-18T21:21:36.627 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-05-18T21:21:36.709 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-05-18T21:21:36.768 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-05-18T21:21:36.853 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2020-05-18T21:21:36.855 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-05-18T21:21:36.927 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-05-18T21:21:36.981 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2020-05-18T21:21:36.983 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-05-18T21:21:37.065 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2020-05-18T21:21:37.067 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-05-18T21:21:37.119 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-05-18T21:21:37.197 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-05-18T21:21:37.274 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-05-18T21:21:37.326 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-05-18T21:21:37.424 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2020-05-18T21:21:37.436 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-05-18T21:21:37.466 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-05-18T21:21:37.551 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-05-18T21:21:37.614 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-05-18T21:21:37.698 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-05-18T21:21:37.758 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-05-18T21:21:37.826 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-05-18T21:21:37.907 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2020-05-18T21:21:37.909 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-05-18T21:21:37.986 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-05-18T21:21:38.038 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-05-18T21:21:38.125 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-05-18T21:21:38.167 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-05-18T21:21:38.272 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2020-05-18T21:21:38.273 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-05-18T21:21:38.303 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-05-18T21:21:38.407 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-05-18T21:21:38.441 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-05-18T21:21:38.560 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-05-18T21:21:38.562 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-05-18T21:21:38.688 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-05-18T21:21:38.731 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-05-18T21:21:38.834 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-05-18T21:21:38.878 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-05-18T21:21:38.974 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-05-18T21:21:39.006 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-05-18T21:21:39.117 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-05-18T21:21:39.147 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-05-18T21:21:39.256 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-05-18T21:21:39.278 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2020-05-18T21:21:39.280 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-05-18T21:21:39.392 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-05-18T21:21:39.445 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2020-05-18T21:21:39.447 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-05-18T21:21:39.541 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-05-18T21:21:39.606 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-05-18T21:21:39.663 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2020-05-18T21:21:39.665 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-05-18T21:21:39.758 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-05-18T21:21:39.812 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2020-05-18T21:21:39.814 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-05-18T21:21:39.896 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-05-18T21:21:39.959 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-05-18T21:21:40.023 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2020-05-18T21:21:40.025 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-05-18T21:21:40.090 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-05-18T21:21:40.178 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2020-05-18T21:21:40.180 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2020-05-18T21:21:40.182 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-05-18T21:21:40.237 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-05-18T21:21:40.309 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-05-18T21:21:40.372 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2020-05-18T21:21:40.374 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-05-18T21:21:40.445 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-05-18T21:21:40.508 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2020-05-18T21:21:40.509 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2020-05-18T21:21:40.511 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-05-18T21:21:40.592 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-05-18T21:21:40.664 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-05-18T21:21:40.747 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-05-18T21:21:40.810 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-05-18T21:21:40.884 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-05-18T21:21:40.957 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-05-18T21:21:41.026 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2020-05-18T21:21:41.039 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-05-18T21:21:41.116 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-05-18T21:21:41.158 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-05-18T21:21:41.280 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-05-18T21:21:41.312 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-05-18T21:21:41.420 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2020-05-18T21:21:41.422 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-05-18T21:21:41.462 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2020-05-18T21:21:41.464 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2020-05-18T21:21:41.571 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-05-18T21:21:41.603 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-05-18T21:21:41.731 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-05-18T21:21:41.753 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-05-18T21:21:41.864 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2020-05-18T21:21:41.866 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2020-05-18T21:21:41.922 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2020-05-18T21:21:41.924 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-05-18T21:21:42.029 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-05-18T21:21:42.062 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-05-18T21:21:42.162 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-05-18T21:21:42.257 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-05-18T21:21:42.310 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2020-05-18T21:21:42.312 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-05-18T21:21:42.419 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-05-18T21:21:42.463 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-05-18T21:21:42.563 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-05-18T21:21:42.636 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-05-18T21:21:42.702 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-05-18T21:21:42.787 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-05-18T21:21:42.860 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-05-18T21:21:42.930 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-05-18T21:21:42.997 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-05-18T21:21:43.093 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-05-18T21:21:43.142 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-05-18T21:21:43.232 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-05-18T21:21:43.294 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-05-18T21:21:43.379 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-05-18T21:21:43.443 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-05-18T21:21:43.530 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-05-18T21:21:43.590 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-05-18T21:21:43.678 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-05-18T21:21:43.740 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-05-18T21:21:43.830 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-05-18T21:21:43.899 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-05-18T21:21:43.976 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-05-18T21:21:44.028 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-05-18T21:21:44.122 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-05-18T21:21:44.164 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-05-18T21:21:44.277 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-05-18T21:21:44.321 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-05-18T21:21:44.419 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-05-18T21:21:44.466 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-05-18T21:21:44.566 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-05-18T21:21:44.604 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-05-18T21:21:44.696 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-05-18T21:21:44.769 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-05-18T21:21:44.833 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-05-18T21:21:44.916 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-05-18T21:21:44.980 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-05-18T21:21:45.061 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-05-18T21:21:45.138 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-05-18T21:21:45.208 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-05-18T21:21:45.284 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-05-18T21:21:45.358 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-05-18T21:21:45.411 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-05-18T21:21:45.501 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-05-18T21:21:45.565 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-05-18T21:21:45.649 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-05-18T21:21:45.702 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-05-18T21:21:45.802 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2020-05-18T21:21:45.803 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-05-18T21:21:45.834 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-05-18T21:21:45.937 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2020-05-18T21:21:45.940 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-05-18T21:21:45.993 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-05-18T21:21:46.076 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-05-18T21:21:46.132 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2020-05-18T21:21:46.134 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-05-18T21:21:46.240 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-05-18T21:21:46.281 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2020-05-18T21:21:46.283 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-05-18T21:21:46.405 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-05-18T21:21:46.419 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-05-18T21:21:46.535 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-05-18T21:21:46.568 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-05-18T21:21:46.699 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-05-18T21:21:46.701 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-05-18T21:21:46.835 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-05-18T21:21:46.875 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-05-18T21:21:46.979 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-05-18T21:21:47.012 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-05-18T21:21:47.146 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-05-18T21:21:47.161 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-05-18T21:21:47.279 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-05-18T21:21:47.306 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-05-18T21:21:47.425 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-05-18T21:21:47.436 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-05-18T21:21:47.561 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-05-18T21:21:47.596 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-05-18T21:21:47.702 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-05-18T21:21:47.752 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-05-18T21:21:47.845 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-05-18T21:21:47.898 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-05-18T21:21:47.982 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-05-18T21:21:48.035 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-05-18T21:21:48.113 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2020-05-18T21:21:48.115 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-05-18T21:21:48.180 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-05-18T21:21:48.243 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-05-18T21:21:48.328 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-05-18T21:21:48.390 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-05-18T21:21:48.471 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2020-05-18T21:21:48.474 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-05-18T21:21:48.525 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-05-18T21:21:48.608 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-05-18T21:21:48.682 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-05-18T21:21:48.760 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-05-18T21:21:48.813 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d\nxiubli@lxbceph0 s0gvBwazopcgx4LPu0pQiA 1b2012fe8c6ea0a54dfd0e7a6fb1a19982b934cf6d84a64d21aa16dbe8510db3\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d\nxiubli@lxbceph0 s0gvBwazopcgx4LPu0pQiA 1b2012fe8c6ea0a54dfd0e7a6fb1a19982b934cf6d84a64d21aa16dbe8510db3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzVa77kg0qGGE3IpMZgSYJ+UwQiDEOg3Lji470V/sQ/R7g6/v7FZpaYqGn1wG3XeUp2gGACxNKLQfGV9EGU66NvfQYqn9A8dXRpTpZuGWN8EcKK98YrSAq0s0WzeiEzVT86RHzVHIqL6/Zn4B1p9sIeY9Hb+bfKOdtYkRBDoFELtiMRzHPFaiIJFnXl+EhH8wceYqXVNNvCuOUBMnOiDYLDtujvYdPt+ff7rvXuOzbwcAKoINFM1C4FtoUEYriKlsxJ2rr7AblfDm/WIrCZcqRBU4JcudtvZOtHhvN4uL6WgzuzuhIQFyePAeIHFUn6AiwKC/MApq7z1Qj+N3pN/Nz xiubli@fedora1\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkS3qZAsTQMObkUS9QBEpYlL7A3/4ypeRiVQil7UXrZkXVhYd8RAlvSBomOHtslz6OMuvm1GtP53apQQbLb2ziJXlogua/2ju17iyBP8KfyGUzx45S3XF6GaSi3C4gyviQ0hLhgg0HSaO92qw7lbjf731hXYBWXDwkXz/6wbYecykKHTM2xeIhTqCSDIx+fdrHmYW8tXp5ZIGxmCXgLhyNLaMXlNrsGHvLixrnUb3abJebdi+diQxWn4fx2Q+WwoAnY1uwawyeFJzmLEs3qjFWmuYSKcDJ94gHHedXyDhZN1mZOs0a0E319jtXG88/SQrX3+/OypS92Hr0FF6PQwhT root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-05-18T21:21:48.896 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-05-18T21:21:48.949 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-05-18T21:21:49.035 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-05-18T21:21:49.082 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-05-18T21:21:49.168 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d\nxiubli@lxbceph0 s0gvBwazopcgx4LPu0pQiA 1b2012fe8c6ea0a54dfd0e7a6fb1a19982b934cf6d84a64d21aa16dbe8510db3\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d\nxiubli@lxbceph0 s0gvBwazopcgx4LPu0pQiA 1b2012fe8c6ea0a54dfd0e7a6fb1a19982b934cf6d84a64d21aa16dbe8510db3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzVa77kg0qGGE3IpMZgSYJ+UwQiDEOg3Lji470V/sQ/R7g6/v7FZpaYqGn1wG3XeUp2gGACxNKLQfGV9EGU66NvfQYqn9A8dXRpTpZuGWN8EcKK98YrSAq0s0WzeiEzVT86RHzVHIqL6/Zn4B1p9sIeY9Hb+bfKOdtYkRBDoFELtiMRzHPFaiIJFnXl+EhH8wceYqXVNNvCuOUBMnOiDYLDtujvYdPt+ff7rvXuOzbwcAKoINFM1C4FtoUEYriKlsxJ2rr7AblfDm/WIrCZcqRBU4JcudtvZOtHhvN4uL6WgzuzuhIQFyePAeIHFUn6AiwKC/MApq7z1Qj+N3pN/Nz xiubli@fedora1\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkS3qZAsTQMObkUS9QBEpYlL7A3/4ypeRiVQil7UXrZkXVhYd8RAlvSBomOHtslz6OMuvm1GtP53apQQbLb2ziJXlogua/2ju17iyBP8KfyGUzx45S3XF6GaSi3C4gyviQ0hLhgg0HSaO92qw7lbjf731hXYBWXDwkXz/6wbYecykKHTM2xeIhTqCSDIx+fdrHmYW8tXp5ZIGxmCXgLhyNLaMXlNrsGHvLixrnUb3abJebdi+diQxWn4fx2Q+WwoAnY1uwawyeFJzmLEs3qjFWmuYSKcDJ94gHHedXyDhZN1mZOs0a0E319jtXG88/SQrX3+/OypS92Hr0FF6PQwhT root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-05-18T21:21:49.227 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-05-18T21:21:49.303 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-05-18T21:21:49.370 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2020-05-18T21:21:49.466 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-05-18T21:21:49.549 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDpzfLLhjb6WlU3D0D26KAzcSgy9FkG1jnU2X6PqvyGuxyqrfDfLRc6d9A/clStS6GmyKfmevMLFr0Qn17FbPguZJ98Cnx4WwTyRyDSY6M4aoHdhKJgX6zGF7EJxCgb4gJdzlVO8uWD9k1ULV5ShS6z24rkjmxtX8Q/nkDa7w6XThLXQHPXmEJZ7ZsURaMwU+A5K0Mun/RO9W1TRKBzqspvb8D8q/o5R1T4Y6nSgMI8c3fbiuikaMogbPFTzjp154VNBD08kqTpi6JFgWUbhp6Cgpi9NJprsaPLvf1hOBnPvMENy+hkLE7TKnOqFPW6NglbB7igLOlLdqZgNfalX+XSkklZgqrJX/8/eXgGAKE4AvPDerAbBd2X9H2I5P84o5Rs8cDw2vmV5zPPT0SOJP+Ge8eXanekbVxbNI3UrrEEj/o3vQz2/ng1EpknlySpy8FIEDKF1qZ/M9Gku0RcquEZTYsUlGkxl1RYh6VhSp2W6QSeAl4B8CUedv4zQ0Cqr18= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2020-05-18T21:21:49.592 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-05-18T21:21:49.686 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2020-05-18T21:21:49.728 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2020-05-18T21:21:49.833 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2020-05-18T21:21:49.864 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDpzfLLhjb6WlU3D0D26KAzcSgy9FkG1jnU2X6PqvyGuxyqrfDfLRc6d9A/clStS6GmyKfmevMLFr0Qn17FbPguZJ98Cnx4WwTyRyDSY6M4aoHdhKJgX6zGF7EJxCgb4gJdzlVO8uWD9k1ULV5ShS6z24rkjmxtX8Q/nkDa7w6XThLXQHPXmEJZ7ZsURaMwU+A5K0Mun/RO9W1TRKBzqspvb8D8q/o5R1T4Y6nSgMI8c3fbiuikaMogbPFTzjp154VNBD08kqTpi6JFgWUbhp6Cgpi9NJprsaPLvf1hOBnPvMENy+hkLE7TKnOqFPW6NglbB7igLOlLdqZgNfalX+XSkklZgqrJX/8/eXgGAKE4AvPDerAbBd2X9H2I5P84o5Rs8cDw2vmV5zPPT0SOJP+Ge8eXanekbVxbNI3UrrEEj/o3vQz2/ng1EpknlySpy8FIEDKF1qZ/M9Gku0RcquEZTYsUlGkxl1RYh6VhSp2W6QSeAl4B8CUedv4zQ0Cqr18= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2020-05-18T21:21:49.965 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2020-05-18T21:21:50.011 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2020-05-18T21:21:50.110 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2020-05-18T21:21:50.166 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2020-05-18T21:21:50.211 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:50 +0000 (0:00:16.337) 0:00:44.491 ************ 2020-05-18T21:21:50.279 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-05-18T21:21:50.281 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.282 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi063.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawa 2020-05-18T21:21:50.283 INFO:teuthology.task.ansible.out:l000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.294 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.306 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.317 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.329 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.340 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.414 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-05-18T21:21:50.416 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2020-05-18T21:21:50.525 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:50 +0000 (0:00:00.313) 0:00:44.805 ************ 2020-05-18T21:21:50.534 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-05-18T21:21:50.536 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-05-18T21:21:50.536 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e 2020-05-18T21:21:50.538 INFO:teuthology.task.ansible.out:1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.571 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.590 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.593 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.615 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.617 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.630 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.643 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'aemerson', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2020-05-18T21:21:50.645 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.795 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-05-18T21:21:50.797 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-05-18T21:21:50.808 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.918 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-05-18T21:21:50.929 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.941 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.953 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.977 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.988 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:50.999 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.001 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'aemerson', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c13585 2020-05-18T21:21:51.003 INFO:teuthology.task.ansible.out:3937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.011 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.022 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.024 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.055 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.066 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.082 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxiche 2020-05-18T21:21:51.083 INFO:teuthology.task.ansible.out:n", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.092 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.094 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.103 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.112 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.119 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.121 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:51.131 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.132 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:51.142 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.144 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:51.145 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.156 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.158 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-05-18T21:21:51.158 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:51.160 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.171 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.190 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.194 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.211 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.216 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.227 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.229 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.239 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.250 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.252 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.265 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.273 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.274 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-05-18T21:21:51.276 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.287 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.299 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.301 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.302 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.314 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.329 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.331 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.340 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.342 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.354 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.356 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.356 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.358 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.370 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.371 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.381 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.383 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.393 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.395 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 495228 2020-05-18T21:21:51.397 INFO:teuthology.task.ansible.out:99bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.407 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.407 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.408 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.408 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.419 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.430 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.432 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.442 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.444 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.461 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.466 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.474 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.475 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.476 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.477 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.500 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.502 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.513 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.515 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.546 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.548 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.558 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.559 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.570 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.572 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.588 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.590 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.604 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.615 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.618 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.627 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.629 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.649 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.651 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.652 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.652 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.653 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.664 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.668 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.677 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.679 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.693 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.694 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.704 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.706 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.716 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.718 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.727 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.729 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.738 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.740 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d\nxiubli@lxbceph0 s0gvBwazopcgx4LPu0pQiA 1b2012fe8c6ea0a54dfd0e7a6fb1a19982b934cf6d84a64d21aa16dbe8510db3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d\nxiubli@lxbceph0 s0gvBwazopcgx4LPu0pQiA 1b2012fe8c6ea0a54dfd0e7a6fb1a19982b934cf6d84a64d21aa16dbe8510db3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.751 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.753 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.762 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.764 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.774 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.776 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.785 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.787 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.800 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.809 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.811 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.826 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.843 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.845 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.903 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:51 +0000 (0:00:01.378) 0:00:46.183 ************ 2020-05-18T21:21:51.912 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.914 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.914 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "chang 2020-05-18T21:21:51.916 INFO:teuthology.task.ansible.out:ed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.928 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.938 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.941 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.974 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:51 +0000 (0:00:00.070) 0:00:46.254 ************ 2020-05-18T21:21:51.981 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.984 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:51.995 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.007 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.011 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.019 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.021 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.031 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.042 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.054 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.065 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.076 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.078 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.089 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.104 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.106 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.117 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.128 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d\nxiubli@lxbceph0 s0gvBwazopcgx4LPu0pQiA 1b2012fe8c6ea0a54dfd0e7a6fb1a19982b934cf6d84a64d21aa16dbe8510db3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d\nxiubli@lxbceph0 s0gvBwazopcgx4LPu0pQiA 1b2012fe8c6ea0a54dfd0e7a6fb1a19982b934cf6d84a64d21aa16dbe8510db3\n"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.139 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.141 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi155.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-05-18T21:21:52.151 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-05-18T21:21:52.152 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.162 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.163 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.175 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.196 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.200 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.203 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.271 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:52 +0000 (0:00:00.296) 0:00:46.550 ************ 2020-05-18T21:21:52.279 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-05-18T21:21:52.281 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-05-18T21:21:52.303 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-05-18T21:21:52.305 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:52.355 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:52 +0000 (0:00:00.084) 0:00:46.635 ************ 2020-05-18T21:21:52.429 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-05-18T21:21:52.431 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-05-18T21:21:52.534 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-05-18T21:21:52.572 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-05-18T21:21:52.677 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-05-18T21:21:52.699 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-05-18T21:21:52.823 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-05-18T21:21:52.859 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-05-18T21:21:52.993 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-05-18T21:21:53.018 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-05-18T21:21:53.150 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2020-05-18T21:21:53.161 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-05-18T21:21:53.316 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} ok: [smithi155.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-05-18T21:21:53.448 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-05-18T21:21:53.459 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-05-18T21:21:53.605 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2020-05-18T21:21:53.619 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-05-18T21:21:53.756 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-05-18T21:21:53.771 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-05-18T21:21:53.927 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-05-18T21:21:53.930 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-05-18T21:21:54.081 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-05-18T21:21:54.083 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-05-18T21:21:54.233 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-05-18T21:21:54.251 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-05-18T21:21:54.390 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-05-18T21:21:54.403 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-05-18T21:21:54.527 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-05-18T21:21:54.549 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-05-18T21:21:54.674 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-05-18T21:21:54.676 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:54.707 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-05-18T21:21:54.781 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-05-18T21:21:54.783 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:54.845 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-05-18T21:21:54.847 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:54.925 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-05-18T21:21:54.927 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:54.980 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-05-18T21:21:54.981 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:55.069 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-05-18T21:21:55.071 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:55.106 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-05-18T21:21:55.108 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:55.193 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-05-18T21:21:55.195 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:55.240 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-05-18T21:21:55.242 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:55.331 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-05-18T21:21:55.333 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:55.385 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-05-18T21:21:55.387 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:55.450 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-05-18T21:21:55.451 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:55.527 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-05-18T21:21:55.529 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:55.571 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-05-18T21:21:55.572 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:55.661 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-05-18T21:21:55.703 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-05-18T21:21:55.797 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-05-18T21:21:55.829 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-05-18T21:21:55.933 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-05-18T21:21:55.935 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:55.980 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-05-18T21:21:55.983 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:56.076 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-05-18T21:21:56.078 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:56.098 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-05-18T21:21:56.100 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:56.205 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-05-18T21:21:56.227 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-05-18T21:21:56.229 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:56.345 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-05-18T21:21:56.366 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-05-18T21:21:56.368 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:56.476 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-05-18T21:21:56.503 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-05-18T21:21:56.620 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-05-18T21:21:56.621 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:56.635 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-05-18T21:21:56.749 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-05-18T21:21:56.751 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:56.784 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-05-18T21:21:56.792 INFO:teuthology.task.ansible.out: 2020-05-18T21:21:56.884 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-05-18T21:21:56.917 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-05-18T21:21:57.025 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-05-18T21:21:57.059 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-05-18T21:21:57.164 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-05-18T21:21:57.197 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-05-18T21:21:57.294 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-05-18T21:21:57.350 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-05-18T21:21:57.438 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-05-18T21:21:57.480 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-05-18T21:21:57.588 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-05-18T21:21:57.620 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-05-18T21:21:57.732 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-05-18T21:21:57.764 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-05-18T21:21:57.863 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-05-18T21:21:57.884 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-05-18T21:21:58.009 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-05-18T21:21:58.011 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-05-18T21:21:58.095 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:58 +0000 (0:00:05.739) 0:00:52.375 ************ 2020-05-18T21:21:58.136 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-05-18T21:21:58.272 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-05-18T21:21:58.420 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-05-18T21:21:58.556 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-05-18T21:21:58.611 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:58 +0000 (0:00:00.516) 0:00:52.891 ************ 2020-05-18T21:21:58.699 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-05-18T21:21:58.701 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => {"changed": true, "checksum": "be49dc3debef3900f7f5b6bdc921fc8b79dea0d7", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "def3daffe56c9db157a75c68cb6f3184", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1589836918.129169-131954970136448/source", "state": "file", "uid": 0} 2020-05-18T21:21:58.745 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:58 +0000 (0:00:00.133) 0:00:53.025 ************ 2020-05-18T21:21:58.793 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-05-18T21:21:58.795 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => { "msg": "Host smithi155.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2020-05-18T21:21:58.835 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:58 +0000 (0:00:00.090) 0:00:53.115 ************ 2020-05-18T21:21:58.886 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-05-18T21:21:58.893 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-05-18T21:21:58.938 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:58 +0000 (0:00:00.103) 0:00:53.218 ************ 2020-05-18T21:21:58.968 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-05-18T21:21:58.970 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:59.018 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.076) 0:00:53.294 ************ 2020-05-18T21:21:59.042 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-05-18T21:21:59.047 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => {"changed": true, "checksum": "be49dc3debef3900f7f5b6bdc921fc8b79dea0d7", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "def3daffe56c9db157a75c68cb6f3184", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1589836918.6417081-90469716284583/source", "state": "file", "uid": 0} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:59.092 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.077) 0:00:53.372 ************ 2020-05-18T21:21:59.132 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.040) 0:00:53.412 ************ 2020-05-18T21:21:59.140 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-05-18T21:21:59.142 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => { "msg": "Host smithi063.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2020-05-18T21:21:59.184 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.052) 0:00:53.464 ************ 2020-05-18T21:21:59.192 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-05-18T21:21:59.194 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:59.233 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.048) 0:00:53.513 ************ 2020-05-18T21:21:59.243 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-05-18T21:21:59.245 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-05-18T21:21:59.286 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.053) 0:00:53.566 ************ 2020-05-18T21:21:59.296 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-05-18T21:21:59.298 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:59.333 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.046) 0:00:53.612 ************ 2020-05-18T21:21:59.340 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-05-18T21:21:59.342 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:59.382 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.049) 0:00:53.662 ************ 2020-05-18T21:21:59.389 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:59.428 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.046) 0:00:53.708 ************ 2020-05-18T21:21:59.435 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-05-18T21:21:59.437 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:59.473 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.045) 0:00:53.753 ************ 2020-05-18T21:21:59.484 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-05-18T21:21:59.485 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:59.523 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.049) 0:00:53.802 ************ 2020-05-18T21:21:59.529 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:59.567 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.045) 0:00:53.847 ************ 2020-05-18T21:21:59.575 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-05-18T21:21:59.577 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:59.614 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.046) 0:00:53.894 ************ 2020-05-18T21:21:59.622 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-05-18T21:21:59.623 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:59.661 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.047) 0:00:53.941 ************ 2020-05-18T21:21:59.670 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-05-18T21:21:59.672 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:59.706 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.044) 0:00:53.986 ************ 2020-05-18T21:21:59.713 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-05-18T21:21:59.715 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:59.750 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.044) 0:00:54.030 ************ 2020-05-18T21:21:59.757 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-05-18T21:21:59.759 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-05-18T21:21:59.769 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-05-18T21:21:59.804 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.053) 0:00:54.083 ************ 2020-05-18T21:21:59.810 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-05-18T21:21:59.812 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:59.849 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.044) 0:00:54.128 ************ 2020-05-18T21:21:59.856 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:59.894 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.044) 0:00:54.173 ************ 2020-05-18T21:21:59.901 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-05-18T21:21:59.903 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:59.940 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.046) 0:00:54.220 ************ 2020-05-18T21:21:59.947 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-05-18T21:21:59.948 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:21:59.994 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:21:59 +0000 (0:00:00.053) 0:00:54.274 ************ 2020-05-18T21:22:00.003 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-05-18T21:22:00.005 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:00.054 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:00 +0000 (0:00:00.059) 0:00:54.333 ************ 2020-05-18T21:22:00.061 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-05-18T21:22:00.063 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-05-18T21:22:00.108 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:00 +0000 (0:00:00.054) 0:00:54.388 ************ 2020-05-18T21:22:00.114 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-05-18T21:22:00.116 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi063.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-05-18T21:22:00.153 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:00 +0000 (0:00:00.044) 0:00:54.433 ************ 2020-05-18T21:22:00.161 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-05-18T21:22:00.163 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:00.198 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:00 +0000 (0:00:00.045) 0:00:54.478 ************ 2020-05-18T21:22:00.205 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-05-18T21:22:00.207 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:00.253 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:00 +0000 (0:00:00.054) 0:00:54.532 ************ 2020-05-18T21:22:00.260 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-05-18T21:22:00.262 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-05-18T21:22:00.309 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:00 +0000 (0:00:00.056) 0:00:54.589 ************ 2020-05-18T21:22:00.525 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 18 May 2020 21:22:00 +0000 (0:00:00.045) 0:00:54.635 ************ TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 18 May 2020 21:22:00 +0000 (0:00:00.045) 0:00:54.680 ************ TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi063.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} Monday 18 May 2020 21:22:00 +0000 (0:00:00.046) 0:00:54.727 ************ TASK [common : List CDN releases available to system] ************************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 18 May 2020 21:22:00 +0000 (0:00:00.045) 0:00:54.773 ************ TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:00.544 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:00 +0000 (0:00:00.051) 0:00:54.824 ************ 2020-05-18T21:22:00.554 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:00.590 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:00 +0000 (0:00:00.045) 0:00:54.869 ************ 2020-05-18T21:22:00.597 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-05-18T21:22:00.598 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-05-18T21:22:00.636 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:00 +0000 (0:00:00.046) 0:00:54.916 ************ 2020-05-18T21:22:00.645 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-05-18T21:22:00.647 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:00.684 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:00 +0000 (0:00:00.048) 0:00:54.964 ************ 2020-05-18T21:22:00.691 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-05-18T21:22:00.693 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:00.738 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:00 +0000 (0:00:00.054) 0:00:55.018 ************ 2020-05-18T21:22:00.748 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-05-18T21:22:00.750 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-05-18T21:22:00.793 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:00 +0000 (0:00:00.054) 0:00:55.072 ************ 2020-05-18T21:22:00.802 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-05-18T21:22:00.804 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:00.842 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:00 +0000 (0:00:00.049) 0:00:55.122 ************ 2020-05-18T21:22:00.851 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-05-18T21:22:00.853 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:00.892 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:00 +0000 (0:00:00.049) 0:00:55.171 ************ 2020-05-18T21:22:00.900 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-05-18T21:22:00.902 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:00.940 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:00 +0000 (0:00:00.048) 0:00:55.220 ************ 2020-05-18T21:22:00.951 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-05-18T21:22:00.953 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:00.993 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:00 +0000 (0:00:00.053) 0:00:55.273 ************ 2020-05-18T21:22:01.002 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-05-18T21:22:01.011 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:01.050 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:01 +0000 (0:00:00.056) 0:00:55.330 ************ 2020-05-18T21:22:01.058 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-05-18T21:22:01.060 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:01.096 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:01 +0000 (0:00:00.045) 0:00:55.376 ************ 2020-05-18T21:22:01.103 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-05-18T21:22:01.105 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-05-18T21:22:01.144 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:01 +0000 (0:00:00.048) 0:00:55.424 ************ 2020-05-18T21:22:01.153 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-05-18T21:22:01.155 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:01.191 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:01 +0000 (0:00:00.046) 0:00:55.471 ************ 2020-05-18T21:22:01.199 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-05-18T21:22:01.200 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:01.244 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:01 +0000 (0:00:00.053) 0:00:55.524 ************ 2020-05-18T21:22:01.257 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:01.295 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:01 +0000 (0:00:00.050) 0:00:55.575 ************ 2020-05-18T21:22:01.303 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-05-18T21:22:01.305 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:01.344 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:01 +0000 (0:00:00.048) 0:00:55.623 ************ 2020-05-18T21:22:01.353 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-05-18T21:22:01.355 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:01.402 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:01 +0000 (0:00:00.056) 0:00:55.679 ************ 2020-05-18T21:22:01.408 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-05-18T21:22:01.410 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:01.458 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:01 +0000 (0:00:00.058) 0:00:55.738 ************ 2020-05-18T21:22:01.468 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-05-18T21:22:01.470 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-05-18T21:22:01.519 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:01 +0000 (0:00:00.056) 0:00:55.795 ************ 2020-05-18T21:22:01.527 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-05-18T21:22:01.528 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:01.565 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:01 +0000 (0:00:00.049) 0:00:55.844 ************ 2020-05-18T21:22:01.573 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-05-18T21:22:01.575 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:01.612 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:01 +0000 (0:00:00.047) 0:00:55.892 ************ 2020-05-18T21:22:01.621 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-05-18T21:22:01.622 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:01.660 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:01 +0000 (0:00:00.047) 0:00:55.939 ************ 2020-05-18T21:22:01.667 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-05-18T21:22:01.668 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:01.706 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:01 +0000 (0:00:00.046) 0:00:55.985 ************ 2020-05-18T21:22:01.713 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:01.757 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:01 +0000 (0:00:00.051) 0:00:56.037 ************ 2020-05-18T21:22:01.765 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-05-18T21:22:01.767 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:01.805 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:01 +0000 (0:00:00.047) 0:00:56.084 ************ 2020-05-18T21:22:01.811 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-05-18T21:22:01.813 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-05-18T21:22:01.850 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:01 +0000 (0:00:00.045) 0:00:56.130 ************ 2020-05-18T21:22:01.870 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:01.906 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:01 +0000 (0:00:00.055) 0:00:56.186 ************ 2020-05-18T21:22:01.918 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:01.956 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:01 +0000 (0:00:00.049) 0:00:56.236 ************ 2020-05-18T21:22:01.966 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi155.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2020-05-18T21:22:01.967 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-05-18T21:22:02.014 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:02 +0000 (0:00:00.056) 0:00:56.293 ************ 2020-05-18T21:22:02.021 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-05-18T21:22:02.022 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:02.061 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:02 +0000 (0:00:00.048) 0:00:56.341 ************ 2020-05-18T21:22:02.075 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:02.110 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:02 +0000 (0:00:00.049) 0:00:56.390 ************ 2020-05-18T21:22:02.118 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-05-18T21:22:02.119 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:02.162 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:02 +0000 (0:00:00.050) 0:00:56.441 ************ 2020-05-18T21:22:02.211 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-05-18T21:22:02.213 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:02.223 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:02.285 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:02 +0000 (0:00:00.123) 0:00:56.564 ************ 2020-05-18T21:22:02.293 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-05-18T21:22:02.295 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.012776", "end": "2020-05-18 21:22:02.554083", "rc": 0, "start": "2020-05-18 21:22:02.541307", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-05-18T21:22:02.337 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:02 +0000 (0:00:00.052) 0:00:56.617 ************ 2020-05-18T21:22:02.345 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-05-18T21:22:02.347 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-05-18T21:22:02.383 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:02 +0000 (0:00:00.045) 0:00:56.663 ************ 2020-05-18T21:22:02.391 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-05-18T21:22:02.393 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:02.429 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:02 +0000 (0:00:00.045) 0:00:56.709 ************ 2020-05-18T21:22:02.437 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-05-18T21:22:02.440 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:02.476 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:02 +0000 (0:00:00.047) 0:00:56.756 ************ 2020-05-18T21:22:02.484 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-05-18T21:22:02.486 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:02.533 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:02 +0000 (0:00:00.056) 0:00:56.812 ************ 2020-05-18T21:22:02.565 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-05-18T21:22:02.567 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:02.607 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:02 +0000 (0:00:00.074) 0:00:56.887 ************ 2020-05-18T21:22:02.635 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-05-18T21:22:02.637 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.004927", "end": "2020-05-18 21:22:02.877598", "rc": 0, "start": "2020-05-18 21:22:02.872671", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [common : Set the timezone] *********************************************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:02.677 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:02 +0000 (0:00:00.070) 0:00:56.957 ************ 2020-05-18T21:22:02.714 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:02 +0000 (0:00:00.036) 0:00:56.994 ************ 2020-05-18T21:22:02.724 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-05-18T21:22:02.726 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:02.785 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:02 +0000 (0:00:00.070) 0:00:57.064 ************ 2020-05-18T21:22:02.794 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-05-18T21:22:02.796 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:02.837 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:02 +0000 (0:00:00.051) 0:00:57.116 ************ 2020-05-18T21:22:02.843 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-05-18T21:22:02.845 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:02.880 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:02 +0000 (0:00:00.044) 0:00:57.160 ************ 2020-05-18T21:22:02.888 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-05-18T21:22:02.890 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:02.926 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:02 +0000 (0:00:00.045) 0:00:57.206 ************ 2020-05-18T21:22:02.933 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-05-18T21:22:02.935 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:02.977 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:02 +0000 (0:00:00.051) 0:00:57.257 ************ 2020-05-18T21:22:02.985 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-05-18T21:22:02.987 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:03.024 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:03 +0000 (0:00:00.045) 0:00:57.303 ************ 2020-05-18T21:22:03.034 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:03.069 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:03 +0000 (0:00:00.046) 0:00:57.349 ************ 2020-05-18T21:22:03.108 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-05-18T21:22:03.110 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:03.156 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:03 +0000 (0:00:00.087) 0:00:57.436 ************ 2020-05-18T21:22:03.200 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-05-18T21:22:03.202 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:03.237 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:03 +0000 (0:00:00.080) 0:00:57.517 ************ 2020-05-18T21:22:03.244 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-05-18T21:22:03.246 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.059690", "end": "2020-05-18 21:22:03.500471", "rc": 0, "start": "2020-05-18 21:22:03.440781", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:22:03.294 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:03 +0000 (0:00:00.056) 0:00:57.573 ************ 2020-05-18T21:22:03.306 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:03.341 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:03 +0000 (0:00:00.047) 0:00:57.621 ************ 2020-05-18T21:22:03.358 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:03.390 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:03 +0000 (0:00:00.048) 0:00:57.670 ************ 2020-05-18T21:22:03.595 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ [WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi155.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.020783", "end": "2020-05-18 21:22:03.861714", "rc": 0, "start": "2020-05-18 21:22:03.840931", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:22:03.631 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:03 +0000 (0:00:00.240) 0:00:57.910 ************ 2020-05-18T21:22:04.270 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi063.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.777205", "end": "2020-05-18 21:22:04.500424", "rc": 0, "start": "2020-05-18 21:22:03.723219", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:22:04.308 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:04 +0000 (0:00:00.677) 0:00:58.588 ************ 2020-05-18T21:22:04.373 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:04.409 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:04 +0000 (0:00:00.101) 0:00:58.689 ************ 2020-05-18T21:22:04.573 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-05-18T21:22:04.576 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.020006", "end": "2020-05-18 21:22:04.815809", "rc": 0, "start": "2020-05-18 21:22:04.795803", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:22:04.616 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:04 +0000 (0:00:00.206) 0:00:58.896 ************ 2020-05-18T21:22:06.168 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-05-18T21:22:06.170 INFO:teuthology.task.ansible.out: [WARNING]: Could not find aptitude. Using apt-get instead ok: [smithi155.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1589836678, "cache_updated": false, "changed": false} 2020-05-18T21:22:06.210 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:06 +0000 (0:00:01.594) 0:01:00.490 ************ 2020-05-18T21:22:06.804 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-05-18T21:22:06.807 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"cache_update_time": 1589836678, "cache_updated": false, "changed": false} 2020-05-18T21:22:06.861 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:06 +0000 (0:00:00.650) 0:01:01.140 ************ 2020-05-18T21:22:06.869 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-05-18T21:22:06.873 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1589836617, "cache_updated": false, "changed": false} 2020-05-18T21:22:06.936 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:06 +0000 (0:00:00.073) 0:01:01.214 ************ 2020-05-18T21:22:06.946 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:06.983 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:06 +0000 (0:00:00.048) 0:01:01.263 ************ 2020-05-18T21:22:07.374 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-05-18T21:22:07.376 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-05-18T21:22:07.440 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:07 +0000 (0:00:00.456) 0:01:01.720 ************ 2020-05-18T21:22:07.593 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-05-18T21:22:07.595 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"cache_update_time": 1589836617, "cache_updated": false, "changed": false} 2020-05-18T21:22:07.664 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:07 +0000 (0:00:00.223) 0:01:01.944 ************ 2020-05-18T21:22:07.699 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-05-18T21:22:07.701 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:07.743 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:07 +0000 (0:00:00.078) 0:01:02.022 ************ 2020-05-18T21:22:08.040 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-05-18T21:22:08.042 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"cache_update_time": 1589836678, "cache_updated": false, "changed": false} 2020-05-18T21:22:08.102 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:08 +0000 (0:00:00.358) 0:01:02.381 ************ 2020-05-18T21:22:08.151 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-05-18T21:22:08.153 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-05-18T21:22:08.213 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:08 +0000 (0:00:00.111) 0:01:02.493 ************ 2020-05-18T21:22:08.501 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-05-18T21:22:08.503 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-05-18T21:22:08.851 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-05-18T21:22:08.854 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi063.front.sepia.ceph.com] => {"cache_update_time": 1589836617, "cache_updated": false, "changed": false} 2020-05-18T21:22:08.892 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:08 +0000 (0:00:00.678) 0:01:03.172 ************ 2020-05-18T21:22:09.197 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi155.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-05-18T21:22:09.234 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:09 +0000 (0:00:00.341) 0:01:03.514 ************ 2020-05-18T21:22:09.306 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-05-18T21:22:09.369 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-05-18T21:22:09.372 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-05-18T21:22:09.404 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:09 +0000 (0:00:00.170) 0:01:03.684 ************ 2020-05-18T21:22:09.667 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-05-18T21:22:09.669 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-05-18T21:22:09.773 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-05-18T21:22:09.775 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-05-18T21:22:10.014 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi063.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-05-18T21:22:10.065 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:10 +0000 (0:00:00.660) 0:01:04.344 ************ 2020-05-18T21:22:10.117 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi155.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-05-18T21:22:10.211 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-05-18T21:22:10.212 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-05-18T21:22:10.256 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:10 +0000 (0:00:00.191) 0:01:04.536 ************ 2020-05-18T21:22:10.447 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-05-18T21:22:10.449 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-05-18T21:22:10.494 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:10 +0000 (0:00:00.238) 0:01:04.774 ************ 2020-05-18T21:22:10.543 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** ok: [smithi155.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-05-18T21:22:10.588 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:10 +0000 (0:00:00.093) 0:01:04.868 ************ 2020-05-18T21:22:10.609 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-05-18T21:22:10.611 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-05-18T21:22:10.621 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-05-18T21:22:10.623 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:10.657 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:10 +0000 (0:00:00.068) 0:01:04.936 ************ 2020-05-18T21:22:10.713 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-05-18T21:22:10.715 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-05-18T21:22:10.758 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:10 +0000 (0:00:00.101) 0:01:05.038 ************ 2020-05-18T21:22:10.805 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi155.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-05-18T21:22:10.807 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-05-18T21:22:10.809 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-05-18T21:22:10.819 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-05-18T21:22:10.856 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:10 +0000 (0:00:00.098) 0:01:05.136 ************ 2020-05-18T21:22:10.896 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-05-18T21:22:10.898 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:10.933 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:10 +0000 (0:00:00.076) 0:01:05.212 ************ 2020-05-18T21:22:10.951 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-05-18T21:22:10.952 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-05-18T21:22:11.289 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-05-18T21:22:11.338 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:11 +0000 (0:00:00.405) 0:01:05.618 ************ 2020-05-18T21:22:11.404 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** ok: [smithi063.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-05-18T21:22:11.440 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:11 +0000 (0:00:00.101) 0:01:05.720 ************ 2020-05-18T21:22:11.478 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-05-18T21:22:11.480 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:11.517 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:11 +0000 (0:00:00.077) 0:01:05.797 ************ 2020-05-18T21:22:11.578 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** ok: [smithi155.front.sepia.ceph.com] => {"cache_update_time": 1589836678, "cache_updated": false, "changed": false} TASK [common : Check for epel] ************************************************* skipping: [smithi063.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-05-18T21:22:11.613 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:11 +0000 (0:00:00.096) 0:01:05.893 ************ 2020-05-18T21:22:11.648 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:11 +0000 (0:00:00.034) 0:01:05.928 ************ 2020-05-18T21:22:11.666 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-05-18T21:22:11.668 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-05-18T21:22:11.678 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-05-18T21:22:11.688 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-05-18T21:22:11.703 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-05-18T21:22:11.756 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:11 +0000 (0:00:00.107) 0:01:06.036 ************ 2020-05-18T21:22:11.802 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-05-18T21:22:11.804 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:11.839 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:11 +0000 (0:00:00.083) 0:01:06.119 ************ 2020-05-18T21:22:12.025 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-05-18T21:22:12.027 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-05-18T21:22:12.077 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:12 +0000 (0:00:00.237) 0:01:06.357 ************ 2020-05-18T21:22:12.433 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-05-18T21:22:12.499 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:12 +0000 (0:00:00.421) 0:01:06.779 ************ 2020-05-18T21:22:12.516 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-05-18T21:22:12.518 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"cache_update_time": 1589836617, "cache_updated": false, "changed": false} 2020-05-18T21:22:12.564 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:12 +0000 (0:00:00.064) 0:01:06.844 ************ 2020-05-18T21:22:12.666 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi155.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2020-05-18T21:22:12.768 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2020-05-18T21:22:12.832 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:12 +0000 (0:00:00.264) 0:01:07.108 ************ 2020-05-18T21:22:12.890 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:12.932 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:12 +0000 (0:00:00.103) 0:01:07.212 ************ 2020-05-18T21:22:12.978 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-05-18T21:22:12.980 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} TASK [common : Check firewalld status] ***************************************** skipping: [smithi155.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-05-18T21:22:13.025 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:13 +0000 (0:00:00.092) 0:01:07.305 ************ 2020-05-18T21:22:13.061 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:13 +0000 (0:00:00.035) 0:01:07.341 ************ 2020-05-18T21:22:13.111 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-05-18T21:22:13.113 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:13.154 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:13 +0000 (0:00:00.087) 0:01:07.428 ************ 2020-05-18T21:22:13.380 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-05-18T21:22:13.383 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-05-18T21:22:13.423 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:13 +0000 (0:00:00.274) 0:01:07.703 ************ 2020-05-18T21:22:13.579 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-05-18T21:22:13.581 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "checksum": "9c3d1d79583cf76a6d81bb2ec150bc4af5ca3c5c", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1166, "state": "file", "uid": 0} TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi063.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2020-05-18T21:22:13.635 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:13 +0000 (0:00:00.211) 0:01:07.914 ************ 2020-05-18T21:22:13.706 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2020-05-18T21:22:13.770 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:13 +0000 (0:00:00.135) 0:01:08.050 ************ 2020-05-18T21:22:13.799 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-05-18T21:22:13.801 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:13.876 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:13 +0000 (0:00:00.105) 0:01:08.155 ************ 2020-05-18T21:22:13.926 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-05-18T21:22:13.928 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-05-18T21:22:13.961 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:13 +0000 (0:00:00.085) 0:01:08.241 ************ 2020-05-18T21:22:13.997 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:14.049 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:14 +0000 (0:00:00.087) 0:01:08.329 ************ 2020-05-18T21:22:14.455 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-05-18T21:22:14.457 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "checksum": "9c3d1d79583cf76a6d81bb2ec150bc4af5ca3c5c", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1166, "state": "file", "uid": 0} 2020-05-18T21:22:14.537 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:14 +0000 (0:00:00.487) 0:01:08.816 ************ 2020-05-18T21:22:14.561 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-05-18T21:22:14.563 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-05-18 21:20:47 UTC", "ActiveEnterTimestampMonotonic": "16005391", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount systemd-tmpfiles-setup.service systemd-journald.socket time-sync.target remote-fs.target -.mount system.slice basic.target sysinit.target nss-lookup.target network.target local-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-05-18 21:20:47 UTC", "AssertTimestampMonotonic": "15993294", "Before": "multi-user.target shutdown.target getty@tty1.service xdm.service plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-05-18 21:20:47 UTC", "Co 2020-05-18T21:22:14.565 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "15993293", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1090", "ExecMainStartTimestamp": "Mon 2020-05-18 21:20:47 UTC", "ExecMainStartTimestampMonotonic": "16005221", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2020-05-18 21:20:47 UTC] ; stop_time=[n/a] ; pid=1090 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2020-05-18 21:20:47 UTC] ; stop_time=[n/a] ; pid=1090 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", 2020-05-18T21:22:14.566 INFO:teuthology.task.ansible.out:"GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-05-18 21:20:47 UTC", "InactiveExitTimestampMonotonic": "16005391", "InvocationID": "64b255db13684be1901051cb4a1559c1", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127783", "LimitNPROCSoft": "127783", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127783", "LimitSIGPENDINGSoft": "127783", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1090", "MemoryAccounting": "yes", "MemoryCurrent": "872448", "Memo 2020-05-18T21:22:14.568 INFO:teuthology.task.ansible.out:ryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-05-18 21:20:47 UTC", "StateChangeTimestampMonotonic": "16005391", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": " 2020-05-18T21:22:14.570 INFO:teuthology.task.ansible.out:no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38335", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-05-18T21:22:14.603 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:14 +0000 (0:00:00.066) 0:01:08.883 ************ 2020-05-18T21:22:14.660 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-05-18T21:22:14.662 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:14.722 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:14 +0000 (0:00:00.112) 0:01:08.995 ************ 2020-05-18T21:22:14.757 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-05-18T21:22:14.759 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:14.820 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:14 +0000 (0:00:00.104) 0:01:09.100 ************ 2020-05-18T21:22:14.835 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-05-18T21:22:14.837 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-05-18 21:20:44 UTC", "ActiveEnterTimestampMonotonic": "16222988", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service system.slice local-fs.target systemd-journald.socket basic.target -.mount remote-fs.target nss-lookup.target sysinit.target network.target time-sync.target var-run.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-05-18 21:20:44 UTC", "AssertTimestampMonotonic": "16214518", "Before": "multi-user.target getty@tty1.service xdm.service plymouth-quit.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-05-18 21:20:44 UTC", "Co 2020-05-18T21:22:14.839 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "16214517", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1104", "ExecMainStartTimestamp": "Mon 2020-05-18 21:20:44 UTC", "ExecMainStartTimestampMonotonic": "16222677", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2020-05-18 21:20:44 UTC] ; stop_time=[n/a] ; pid=1104 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2020-05-18 21:20:44 UTC] ; stop_time=[n/a] ; pid=1104 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", 2020-05-18T21:22:14.843 INFO:teuthology.task.ansible.out:"GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-05-18 21:20:44 UTC", "InactiveExitTimestampMonotonic": "16222988", "InvocationID": "ca8bf225a591424dae2676dad6376a84", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127783", "LimitNPROCSoft": "127783", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127783", "LimitSIGPENDINGSoft": "127783", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1104", "MemoryAccounting": "yes", "MemoryCurrent": "868352", "Memo 2020-05-18T21:22:14.850 INFO:teuthology.task.ansible.out:ryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-05-18 21:20:44 UTC", "StateChangeTimestampMonotonic": "16222988", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": " 2020-05-18T21:22:14.852 INFO:teuthology.task.ansible.out:no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38335", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-05-18T21:22:14.885 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:14 +0000 (0:00:00.064) 0:01:09.165 ************ 2020-05-18T21:22:14.895 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-05-18T21:22:14.897 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:14.935 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:14 +0000 (0:00:00.049) 0:01:09.214 ************ 2020-05-18T21:22:14.945 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-05-18T21:22:14.957 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:14.994 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:14 +0000 (0:00:00.059) 0:01:09.274 ************ 2020-05-18T21:22:15.004 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:15.043 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:15 +0000 (0:00:00.049) 0:01:09.323 ************ 2020-05-18T21:22:15.059 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:15.098 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:15 +0000 (0:00:00.055) 0:01:09.378 ************ 2020-05-18T21:22:15.109 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-05-18T21:22:15.110 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:15.152 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:15 +0000 (0:00:00.054) 0:01:09.432 ************ 2020-05-18T21:22:15.162 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-05-18T21:22:15.164 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:15.203 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:15 +0000 (0:00:00.050) 0:01:09.483 ************ 2020-05-18T21:22:15.213 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-05-18T21:22:15.215 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:15.256 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:15 +0000 (0:00:00.051) 0:01:09.534 ************ 2020-05-18T21:22:15.263 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-05-18T21:22:15.264 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:15.305 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:15 +0000 (0:00:00.050) 0:01:09.585 ************ 2020-05-18T21:22:15.314 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-05-18T21:22:15.316 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:15.357 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:15 +0000 (0:00:00.050) 0:01:09.635 ************ 2020-05-18T21:22:15.365 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-05-18T21:22:15.367 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:15.414 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:15 +0000 (0:00:00.050) 0:01:09.686 ************ 2020-05-18T21:22:15.417 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-05-18T21:22:15.419 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:15.460 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:15 +0000 (0:00:00.054) 0:01:09.740 ************ 2020-05-18T21:22:15.469 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-05-18T21:22:15.471 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:15.512 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:15 +0000 (0:00:00.051) 0:01:09.791 ************ 2020-05-18T21:22:15.530 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:15.567 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:15 +0000 (0:00:00.054) 0:01:09.846 ************ 2020-05-18T21:22:15.576 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-05-18T21:22:15.578 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:15.620 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:15 +0000 (0:00:00.053) 0:01:09.899 ************ 2020-05-18T21:22:15.633 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:15.714 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:15 +0000 (0:00:00.094) 0:01:09.994 ************ 2020-05-18T21:22:15.725 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:15.767 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:15 +0000 (0:00:00.053) 0:01:10.047 ************ 2020-05-18T21:22:15.778 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-05-18T21:22:15.780 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-05-18T21:22:15.820 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:15 +0000 (0:00:00.052) 0:01:10.100 ************ 2020-05-18T21:22:15.828 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-05-18T21:22:15.830 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:15.870 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:15 +0000 (0:00:00.049) 0:01:10.150 ************ 2020-05-18T21:22:15.878 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-05-18T21:22:15.880 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-05-18T21:22:15.930 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:15 +0000 (0:00:00.056) 0:01:10.206 ************ 2020-05-18T21:22:15.935 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-05-18T21:22:15.937 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:15.976 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:15 +0000 (0:00:00.048) 0:01:10.255 ************ 2020-05-18T21:22:15.984 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-05-18T21:22:15.986 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2020-05-18T21:22:16.025 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:16 +0000 (0:00:00.049) 0:01:10.305 ************ 2020-05-18T21:22:16.032 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-05-18T21:22:16.035 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-05-18T21:22:16.083 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:16 +0000 (0:00:00.057) 0:01:10.362 ************ 2020-05-18T21:22:16.093 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-05-18T21:22:16.095 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-05-18T21:22:16.141 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:16 +0000 (0:00:00.058) 0:01:10.421 ************ 2020-05-18T21:22:16.151 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi063.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-05-18T21:22:16.192 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:16 +0000 (0:00:00.050) 0:01:10.472 ************ 2020-05-18T21:22:16.254 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi063.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2020-05-18T21:22:16.309 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:16 +0000 (0:00:00.116) 0:01:10.588 ************ 2020-05-18T21:22:16.317 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-05-18T21:22:16.319 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-05-18T21:22:16.386 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:16 +0000 (0:00:00.076) 0:01:10.665 ************ 2020-05-18T21:22:16.394 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-05-18T21:22:16.396 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-05-18T21:22:16.433 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:16 +0000 (0:00:00.047) 0:01:10.713 ************ 2020-05-18T21:22:16.574 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-05-18T21:22:16.576 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "name": "ubuntu", "state": "present", "system": false} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-05-18T21:22:16.614 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:16 +0000 (0:00:00.177) 0:01:10.890 ************ 2020-05-18T21:22:16.648 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:16 +0000 (0:00:00.037) 0:01:10.928 ************ 2020-05-18T21:22:16.704 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:16.739 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:16 +0000 (0:00:00.090) 0:01:11.019 ************ 2020-05-18T21:22:16.773 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "name": "ubuntu", "state": "present", "system": false} 2020-05-18T21:22:16.832 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:16 +0000 (0:00:00.092) 0:01:11.111 ************ 2020-05-18T21:22:16.841 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-05-18T21:22:16.842 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:16.885 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:16 +0000 (0:00:00.053) 0:01:11.165 ************ 2020-05-18T21:22:16.902 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:16.941 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:16 +0000 (0:00:00.055) 0:01:11.220 ************ 2020-05-18T21:22:16.999 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:17.037 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:17 +0000 (0:00:00.096) 0:01:11.317 ************ 2020-05-18T21:22:17.087 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-05-18T21:22:17.089 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-05-18T21:22:17.131 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:17 +0000 (0:00:00.094) 0:01:11.411 ************ 2020-05-18T21:22:17.240 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-05-18T21:22:17.301 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:17 +0000 (0:00:00.169) 0:01:11.581 ************ 2020-05-18T21:22:17.663 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-05-18T21:22:17.699 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:17 +0000 (0:00:00.398) 0:01:11.979 ************ 2020-05-18T21:22:17.738 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-05-18T21:22:17.740 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi155"}, "changed": false} 2020-05-18T21:22:17.778 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:17 +0000 (0:00:00.079) 0:01:12.058 ************ 2020-05-18T21:22:17.843 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-05-18T21:22:17.846 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-05-18T21:22:17.891 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:17 +0000 (0:00:00.111) 0:01:12.170 ************ 2020-05-18T21:22:17.943 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi063.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi063"}, "changed": false} 2020-05-18T21:22:17.998 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:17 +0000 (0:00:00.108) 0:01:12.278 ************ 2020-05-18T21:22:18.994 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-05-18T21:22:18.996 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi155.front.sepia.ceph.com", "ansible_hostname": "smithi155", "ansible_nodename": "smithi155"}, "changed": true, "name": "smithi155"} changed: [smithi063.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi063.front.sepia.ceph.com", "ansible_hostname": "smithi063", "ansible_nodename": "smithi063"}, "changed": true, "name": "smithi063"} 2020-05-18T21:22:19.042 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:19 +0000 (0:00:01.044) 0:01:13.322 ************ 2020-05-18T21:22:19.084 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:19 +0000 (0:00:00.040) 0:01:13.362 ************ 2020-05-18T21:22:19.420 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-05-18T21:22:19.422 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-05-18T21:22:19.457 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:19 +0000 (0:00:00.373) 0:01:13.736 ************ 2020-05-18T21:22:19.530 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-05-18T21:22:19.577 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:19 +0000 (0:00:00.119) 0:01:13.856 ************ 2020-05-18T21:22:19.846 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-05-18T21:22:19.888 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:19 +0000 (0:00:00.310) 0:01:14.167 ************ 2020-05-18T21:22:19.988 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-05-18T21:22:20.028 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:20 +0000 (0:00:00.140) 0:01:14.308 ************ 2020-05-18T21:22:20.452 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-05-18T21:22:20.454 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-05-18T21:22:20.494 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:20 +0000 (0:00:00.466) 0:01:14.774 ************ 2020-05-18T21:22:20.527 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-05-18T21:22:20.528 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:20.579 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:20 +0000 (0:00:00.084) 0:01:14.859 ************ 2020-05-18T21:22:20.609 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-05-18T21:22:20.612 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-05-18T21:22:20.652 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:20 +0000 (0:00:00.072) 0:01:14.932 ************ 2020-05-18T21:22:20.660 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-05-18T21:22:20.662 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:20.723 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:20 +0000 (0:00:00.071) 0:01:15.003 ************ 2020-05-18T21:22:20.731 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-05-18T21:22:20.732 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:20.770 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:20 +0000 (0:00:00.046) 0:01:15.050 ************ 2020-05-18T21:22:20.787 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-05-18T21:22:20.789 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:20.826 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:20 +0000 (0:00:00.055) 0:01:15.105 ************ 2020-05-18T21:22:20.835 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-05-18T21:22:20.837 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:20.875 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:20 +0000 (0:00:00.050) 0:01:15.155 ************ 2020-05-18T21:22:20.884 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-05-18T21:22:20.890 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:20.926 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:20 +0000 (0:00:00.050) 0:01:15.206 ************ 2020-05-18T21:22:20.934 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-05-18T21:22:20.936 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:20.973 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:20 +0000 (0:00:00.047) 0:01:15.253 ************ 2020-05-18T21:22:20.981 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-05-18T21:22:20.983 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:21.025 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:21 +0000 (0:00:00.051) 0:01:15.305 ************ 2020-05-18T21:22:21.033 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-05-18T21:22:21.035 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:21.074 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:21 +0000 (0:00:00.047) 0:01:15.352 ************ 2020-05-18T21:22:21.081 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-05-18T21:22:21.083 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:21.127 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:21 +0000 (0:00:00.054) 0:01:15.407 ************ 2020-05-18T21:22:21.135 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-05-18T21:22:21.137 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:21.176 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:21 +0000 (0:00:00.048) 0:01:15.456 ************ 2020-05-18T21:22:21.193 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-05-18T21:22:21.195 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:21.245 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:21 +0000 (0:00:00.065) 0:01:15.521 ************ 2020-05-18T21:22:21.250 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-05-18T21:22:21.252 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:21.297 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:21 +0000 (0:00:00.055) 0:01:15.577 ************ 2020-05-18T21:22:21.304 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-05-18T21:22:21.306 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:21.342 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:21 +0000 (0:00:00.045) 0:01:15.622 ************ 2020-05-18T21:22:21.350 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-05-18T21:22:21.351 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:21.398 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:21 +0000 (0:00:00.056) 0:01:15.678 ************ 2020-05-18T21:22:21.406 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-05-18T21:22:21.459 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:21 +0000 (0:00:00.061) 0:01:15.739 ************ 2020-05-18T21:22:21.467 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-05-18T21:22:21.469 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:21.505 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:21 +0000 (0:00:00.045) 0:01:15.784 ************ 2020-05-18T21:22:21.512 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-05-18T21:22:21.549 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:21 +0000 (0:00:00.044) 0:01:15.829 ************ 2020-05-18T21:22:21.558 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-05-18T21:22:21.596 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:21 +0000 (0:00:00.047) 0:01:15.876 ************ 2020-05-18T21:22:21.610 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-05-18T21:22:21.650 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:21 +0000 (0:00:00.054) 0:01:15.930 ************ 2020-05-18T21:22:21.659 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-05-18T21:22:21.699 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:21 +0000 (0:00:00.048) 0:01:15.979 ************ 2020-05-18T21:22:21.707 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-05-18T21:22:21.709 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:21.746 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:21 +0000 (0:00:00.046) 0:01:16.026 ************ 2020-05-18T21:22:21.757 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-05-18T21:22:21.804 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:21 +0000 (0:00:00.057) 0:01:16.084 ************ 2020-05-18T21:22:21.828 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi063.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-05-18T21:22:21.840 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-05-18T21:22:21.842 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:21.876 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:21 +0000 (0:00:00.071) 0:01:16.156 ************ 2020-05-18T21:22:21.914 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:21 +0000 (0:00:00.037) 0:01:16.193 ************ 2020-05-18T21:22:21.920 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-05-18T21:22:21.922 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:21.959 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:21 +0000 (0:00:00.046) 0:01:16.239 ************ 2020-05-18T21:22:21.978 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-05-18T21:22:21.980 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-05-18T21:22:22.035 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:22 +0000 (0:00:00.075) 0:01:16.315 ************ 2020-05-18T21:22:22.043 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-05-18T21:22:22.045 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:22.092 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:22 +0000 (0:00:00.057) 0:01:16.372 ************ 2020-05-18T21:22:22.100 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-05-18T21:22:22.102 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:22.150 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:22 +0000 (0:00:00.051) 0:01:16.424 ************ 2020-05-18T21:22:22.152 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-05-18T21:22:22.153 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:22.192 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:22 +0000 (0:00:00.047) 0:01:16.471 ************ 2020-05-18T21:22:22.201 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-05-18T21:22:22.203 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:22.241 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:22 +0000 (0:00:00.049) 0:01:16.521 ************ 2020-05-18T21:22:22.249 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-05-18T21:22:22.251 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:22.288 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:22 +0000 (0:00:00.046) 0:01:16.568 ************ 2020-05-18T21:22:22.296 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-05-18T21:22:22.298 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:22.336 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:22 +0000 (0:00:00.046) 0:01:16.615 ************ 2020-05-18T21:22:22.343 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-05-18T21:22:22.345 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:22.387 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:22 +0000 (0:00:00.051) 0:01:16.667 ************ 2020-05-18T21:22:22.394 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-05-18T21:22:22.396 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:22.437 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:22 +0000 (0:00:00.049) 0:01:16.716 ************ 2020-05-18T21:22:22.444 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-05-18T21:22:22.446 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:22.486 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:22 +0000 (0:00:00.049) 0:01:16.766 ************ 2020-05-18T21:22:22.494 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-05-18T21:22:22.496 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:22.532 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:22 +0000 (0:00:00.045) 0:01:16.812 ************ 2020-05-18T21:22:22.541 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-05-18T21:22:22.542 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:22.585 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:22 +0000 (0:00:00.053) 0:01:16.865 ************ 2020-05-18T21:22:22.597 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-05-18T21:22:22.599 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:22.650 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:22 +0000 (0:00:00.064) 0:01:16.929 ************ 2020-05-18T21:22:22.662 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-05-18T21:22:22.664 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:22.703 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:22 +0000 (0:00:00.053) 0:01:16.983 ************ 2020-05-18T21:22:22.713 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-05-18T21:22:22.715 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:22.752 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:22 +0000 (0:00:00.048) 0:01:17.031 ************ 2020-05-18T21:22:22.761 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-05-18T21:22:22.763 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:22.809 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:22 +0000 (0:00:00.057) 0:01:17.089 ************ 2020-05-18T21:22:22.818 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-05-18T21:22:22.820 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:22.865 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:22 +0000 (0:00:00.056) 0:01:17.145 ************ 2020-05-18T21:22:22.874 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-05-18T21:22:22.876 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:22.916 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:22 +0000 (0:00:00.050) 0:01:17.195 ************ 2020-05-18T21:22:22.924 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:22.966 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:22 +0000 (0:00:00.050) 0:01:17.246 ************ 2020-05-18T21:22:22.978 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:23.024 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:23 +0000 (0:00:00.057) 0:01:17.304 ************ 2020-05-18T21:22:23.031 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-05-18T21:22:23.033 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:23.091 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:23 +0000 (0:00:00.066) 0:01:17.371 ************ 2020-05-18T21:22:23.099 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-05-18T21:22:23.102 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:23.145 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:23 +0000 (0:00:00.053) 0:01:17.424 ************ 2020-05-18T21:22:23.157 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-05-18T21:22:23.159 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:23.206 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:23 +0000 (0:00:00.061) 0:01:17.486 ************ 2020-05-18T21:22:23.218 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:23.260 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:23 +0000 (0:00:00.053) 0:01:17.540 ************ 2020-05-18T21:22:23.270 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-05-18T21:22:23.272 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:23.316 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:23 +0000 (0:00:00.056) 0:01:17.596 ************ 2020-05-18T21:22:23.331 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:23.364 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:23 +0000 (0:00:00.047) 0:01:17.643 ************ 2020-05-18T21:22:23.373 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-05-18T21:22:23.375 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:23.412 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:23 +0000 (0:00:00.048) 0:01:17.692 ************ 2020-05-18T21:22:23.420 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-05-18T21:22:23.422 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:23.468 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:23 +0000 (0:00:00.055) 0:01:17.748 ************ 2020-05-18T21:22:23.477 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-05-18T21:22:23.479 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:23.528 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:23 +0000 (0:00:00.060) 0:01:17.808 ************ 2020-05-18T21:22:23.569 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-05-18T21:22:23.571 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:23.610 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:23 +0000 (0:00:00.081) 0:01:17.889 ************ 2020-05-18T21:22:23.628 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-05-18T21:22:23.630 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005279", "end": "2020-05-18 21:22:23.865670", "rc": 0, "start": "2020-05-18 21:22:23.860391", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:22:23.678 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:23 +0000 (0:00:00.068) 0:01:17.958 ************ 2020-05-18T21:22:23.717 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-05-18T21:22:23.752 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:23 +0000 (0:00:00.074) 0:01:18.032 ************ 2020-05-18T21:22:23.772 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-05-18T21:22:23.774 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005478", "end": "2020-05-18 21:22:24.053733", "rc": 0, "start": "2020-05-18 21:22:24.048255", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:22:23.828 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:23 +0000 (0:00:00.075) 0:01:18.108 ************ 2020-05-18T21:22:23.872 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-05-18T21:22:23.919 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:23 +0000 (0:00:00.089) 0:01:18.198 ************ 2020-05-18T21:22:24.157 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-05-18T21:22:24.159 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-05-18T21:22:24.196 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:24 +0000 (0:00:00.278) 0:01:18.476 ************ 2020-05-18T21:22:24.226 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-05-18T21:22:24.228 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:24.288 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:24 +0000 (0:00:00.090) 0:01:18.567 ************ 2020-05-18T21:22:24.297 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-05-18T21:22:24.299 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-05-18T21:22:24.337 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:24 +0000 (0:00:00.049) 0:01:18.617 ************ 2020-05-18T21:22:24.378 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-05-18T21:22:24.380 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:24.413 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:24 +0000 (0:00:00.075) 0:01:18.693 ************ 2020-05-18T21:22:25.827 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-05-18T21:22:25.829 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-05-18T21:22:25.859 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-05-18T21:22:26.890 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-05-18T21:22:26.928 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:26 +0000 (0:00:02.515) 0:01:21.208 ************ 2020-05-18T21:22:26.930 INFO:teuthology.task.ansible.out: 2020-05-18T21:22:26.962 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-05-18T21:22:26.964 INFO:teuthology.task.ansible.out: 2020-05-18T21:22:27.008 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:27 +0000 (0:00:00.079) 0:01:21.287 ************ 2020-05-18T21:22:27.569 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-05-18T21:22:27.572 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"cache_update_time": 1589836678, "cache_updated": false, "changed": false} 2020-05-18T21:22:27.623 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:27 +0000 (0:00:00.615) 0:01:21.902 ************ 2020-05-18T21:22:27.644 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"cache_update_time": 1589836617, "cache_updated": false, "changed": false} 2020-05-18T21:22:27.691 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:27 +0000 (0:00:00.068) 0:01:21.971 ************ 2020-05-18T21:22:27.710 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-05-18T21:22:27.760 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:27 +0000 (0:00:00.068) 0:01:22.039 ************ 2020-05-18T21:22:27.816 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:27 +0000 (0:00:00.056) 0:01:22.095 ************ 2020-05-18T21:22:27.957 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** [WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi155.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.030101", "end": "2020-05-18 21:22:28.226204", "rc": 0, "start": "2020-05-18 21:22:28.196103", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:22:27.992 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:27 +0000 (0:00:00.176) 0:01:22.272 ************ 2020-05-18T21:22:28.004 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.034027", "end": "2020-05-18 21:22:28.240936", "rc": 0, "start": "2020-05-18 21:22:28.206909", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:22:28.054 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:28 +0000 (0:00:00.061) 0:01:22.333 ************ 2020-05-18T21:22:29.929 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-05-18T21:22:29.931 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"cache_update_time": 1589836678, "cache_updated": false, "changed": false} 2020-05-18T21:22:29.967 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:29 +0000 (0:00:01.913) 0:01:24.247 ************ 2020-05-18T21:22:30.049 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"cache_update_time": 1589836617, "cache_updated": false, "changed": false} 2020-05-18T21:22:30.088 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:30 +0000 (0:00:00.121) 0:01:24.368 ************ 2020-05-18T21:22:41.926 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-05-18T21:22:41.929 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms\n libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1\n libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools\n ovmf qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 48 not upgraded.\nAfter this operation, 62.8 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 149536 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6) ...\r\nRemoving librbd1 (15.2.1-0ubuntu1) ...\r\nRemoving librados2 (15.2.1-0ubuntu1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for l 2020-05-18T21:22:41.931 INFO:teuthology.task.ansible.out:ibc-bin (2.31-0ubuntu9) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms", " libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1", " libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools", " ovmf qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 48 not upgraded.", "After this operation, 62.8 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 149536 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6) ...", "Removing qemu-system-common (1:4.2-3ubuntu6) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6) ...", "Removing librbd1 (15.2.1-0ubuntu1) ...", "Removing librados2 (15.2.1-0ubuntu1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9) ..."]} 2020-05-18T21:22:41.974 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:41 +0000 (0:00:11.885) 0:01:36.253 ************ 2020-05-18T21:22:42.336 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms\n libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1\n libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools\n ovmf qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 48 not upgraded.\nAfter this operation, 62.8 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 149536 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6) ...\r\nRemoving librbd1 (15.2.1-0ubuntu1) ...\r\nRemoving librados2 (15.2.1-0ubuntu1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for l 2020-05-18T21:22:42.338 INFO:teuthology.task.ansible.out:ibc-bin (2.31-0ubuntu9) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms", " libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1", " libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools", " ovmf qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 48 not upgraded.", "After this operation, 62.8 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 149536 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6) ...", "Removing qemu-system-common (1:4.2-3ubuntu6) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6) ...", "Removing librbd1 (15.2.1-0ubuntu1) ...", "Removing librados2 (15.2.1-0ubuntu1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9) ..."]} 2020-05-18T21:22:42.378 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:42 +0000 (0:00:00.403) 0:01:36.657 ************ 2020-05-18T21:22:54.192 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-05-18T21:22:54.194 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => {"cache_update_time": 1589836617, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms\n libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1\n libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools\n ovmf qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apt-utils libapt-pkg6.0\nSuggested packages:\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apt apt-utils libapt-pkg6.0\n3 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.\nNeed to get 2336 kB of archives.\nAfter this operation, 6144 B disk space will be freed.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.2ubuntu0.1 [832 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.2ubuntu0.1 [1290 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.2ubuntu0.1 [214 kB]\nFetched 2336 kB in 1s (2676 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database .. 2020-05-18T21:22:54.196 INFO:teuthology.task.ansible.out:. 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 149464 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg6.0_2.0.2ubuntu0.1_amd64.deb ...\r\nUnpacking libapt-pkg6.0:amd64 (2.0.2ubuntu0.1) over (2.0.2) ...\r\nSetting up libapt-pkg6.0:amd64 (2.0.2ubuntu0.1) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 149464 files and directories currently installed.)\r\nPreparing to unpack .../apt_2.0.2ubuntu0.1_amd64.deb ...\r\nUnpacking apt (2.0.2ubuntu0.1) over (2.0.2) ...\r\nSetting up apt (2.0.2ubuntu0.1) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 149464 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_2.0.2ubuntu0.1_amd64.deb ...\r\nUnpacking apt-utils (2.0.2ubuntu0.1) over (2.0.2) ...\r\nSetting up apt-utils (2.0.2ubuntu0.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\ 2020-05-18T21:22:54.198 INFO:teuthology.task.ansible.out:r\nProcessing triggers for libc-bin (2.31-0ubuntu9) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms", " libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1", " libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools", " ovmf qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apt-utils libapt-pkg6.0", "Suggested packages:", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apt apt-utils libapt-pkg6.0", "3 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.", "Need to get 2336 kB of archives.", "After this operation, 6144 B disk space will be freed.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.2ubuntu0.1 [832 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.2ubuntu0.1 [1290 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.2ubuntu0.1 [214 kB]", "Fetched 2336 kB in 1s (2676 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 149464 files and directories currently installed.)", "Prep 2020-05-18T21:22:54.200 INFO:teuthology.task.ansible.out:aring to unpack .../libapt-pkg6.0_2.0.2ubuntu0.1_amd64.deb ...", "Unpacking libapt-pkg6.0:amd64 (2.0.2ubuntu0.1) over (2.0.2) ...", "Setting up libapt-pkg6.0:amd64 (2.0.2ubuntu0.1) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 149464 files and directories currently installed.)", "Preparing to unpack .../apt_2.0.2ubuntu0.1_amd64.deb ...", "Unpacking apt (2.0.2ubuntu0.1) over (2.0.2) ...", "Setting up apt (2.0.2ubuntu0.1) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 149464 files and directories currently installed.)", "Preparing to unpack .../apt-utils_2.0.2ubuntu0.1_amd64.deb ...", "Unpacking apt-utils (2.0.2ubuntu0.1) over (2.0.2) ...", "Setting up apt-utils (2.0.2ubuntu0.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9) ..."]} 2020-05-18T21:22:54.200 INFO:teuthology.task.ansible.out: 2020-05-18T21:22:54.261 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:54 +0000 (0:00:11.883) 0:01:48.541 ************ 2020-05-18T21:22:54.309 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-05-18T21:22:54.310 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:54.352 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:54 +0000 (0:00:00.090) 0:01:48.631 ************ 2020-05-18T21:22:54.429 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-05-18T21:22:54.431 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => {"cache_update_time": 1589836678, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms\n libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1\n libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools\n ovmf qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apt-utils libapt-pkg6.0\nSuggested packages:\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apt apt-utils libapt-pkg6.0\n3 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.\nNeed to get 2336 kB of archives.\nAfter this operation, 6144 B disk space will be freed.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.2ubuntu0.1 [832 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.2ubuntu0.1 [1290 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.2ubuntu0.1 [214 kB]\nFetched 2336 kB in 1s (2652 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database .. 2020-05-18T21:22:54.433 INFO:teuthology.task.ansible.out:. 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 149464 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg6.0_2.0.2ubuntu0.1_amd64.deb ...\r\nUnpacking libapt-pkg6.0:amd64 (2.0.2ubuntu0.1) over (2.0.2) ...\r\nSetting up libapt-pkg6.0:amd64 (2.0.2ubuntu0.1) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 149464 files and directories currently installed.)\r\nPreparing to unpack .../apt_2.0.2ubuntu0.1_amd64.deb ...\r\nUnpacking apt (2.0.2ubuntu0.1) over (2.0.2) ...\r\nSetting up apt (2.0.2ubuntu0.1) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 149464 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_2.0.2ubuntu0.1_amd64.deb ...\r\nUnpacking apt-utils (2.0.2ubuntu0.1) over (2.0.2) ...\r\nSetting up apt-utils (2.0.2ubuntu0.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\ 2020-05-18T21:22:54.437 INFO:teuthology.task.ansible.out:r\nProcessing triggers for libc-bin (2.31-0ubuntu9) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms", " libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1", " libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools", " ovmf qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apt-utils libapt-pkg6.0", "Suggested packages:", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apt apt-utils libapt-pkg6.0", "3 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.", "Need to get 2336 kB of archives.", "After this operation, 6144 B disk space will be freed.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.2ubuntu0.1 [832 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.2ubuntu0.1 [1290 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.2ubuntu0.1 [214 kB]", "Fetched 2336 kB in 1s (2652 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 149464 files and directories currently installed.)", "Prep 2020-05-18T21:22:54.440 INFO:teuthology.task.ansible.out:aring to unpack .../libapt-pkg6.0_2.0.2ubuntu0.1_amd64.deb ...", "Unpacking libapt-pkg6.0:amd64 (2.0.2ubuntu0.1) over (2.0.2) ...", "Setting up libapt-pkg6.0:amd64 (2.0.2ubuntu0.1) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 149464 files and directories currently installed.)", "Preparing to unpack .../apt_2.0.2ubuntu0.1_amd64.deb ...", "Unpacking apt (2.0.2ubuntu0.1) over (2.0.2) ...", "Setting up apt (2.0.2ubuntu0.1) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 149464 files and directories currently installed.)", "Preparing to unpack .../apt-utils_2.0.2ubuntu0.1_amd64.deb ...", "Unpacking apt-utils (2.0.2ubuntu0.1) over (2.0.2) ...", "Setting up apt-utils (2.0.2ubuntu0.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9) ..."]} 2020-05-18T21:22:54.477 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:54 +0000 (0:00:00.125) 0:01:48.757 ************ 2020-05-18T21:22:54.521 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-05-18T21:22:54.523 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:22:54.558 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:22:54 +0000 (0:00:00.080) 0:01:48.838 ************ 2020-05-18T21:23:04.037 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-05-18T21:23:04.038 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => {"cache_update_time": 1589836617, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 45 not upgraded.\nNeed to get 13.7 MB of archives.\nAfter this operation, 62.8 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.1-0ubuntu2 [3236 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.1-0ubuntu2 [1611 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6 [56.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6 [1054 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6 [6741 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal/main amd64 qemu-utils amd64 1:4.2-3ubuntu6 [965 kB]\nFetched 13.7 MB in 1s (11.5 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database 2020-05-18T21:23:04.040 INFO:teuthology.task.ansible.out: ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 149464 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.1-0ubuntu2_amd64.deb ...\r\nUnpacking librados2 (15.2.1-0ubuntu2) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.1-0ubuntu2_amd64.deb ...\r\nUnpacking librbd1 (15.2.1-0ubuntu2) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6) ...\r\nSetting up librados2 (15.2.1-0ubuntu2) ...\r\nSetting up librbd1 (15.2.1-0ubuntu2) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qe 2020-05-18T21:23:04.043 INFO:teuthology.task.ansible.out:mu-system-common qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 45 not upgraded.", "Need to get 13.7 MB of archives.", "After this operation, 62.8 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.1-0ubuntu2 [3236 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.1-0ubuntu2 [1611 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6 [56.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6 [1054 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6 [6741 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 qemu-utils amd64 1:4.2-3ubuntu6 [965 kB]", "Fetched 13.7 MB in 1s (11.5 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 149464 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.1-0ubuntu2_amd64.deb ...", "Unpacking librados2 (15.2.1-0ubuntu2) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1- 2020-05-18T21:23:04.045 INFO:teuthology.task.ansible.out:librbd1_15.2.1-0ubuntu2_amd64.deb ...", "Unpacking librbd1 (15.2.1-0ubuntu2) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6) ...", "Setting up librados2 (15.2.1-0ubuntu2) ...", "Setting up librbd1 (15.2.1-0ubuntu2) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6) ...", "Setting up qemu-utils (1:4.2-3ubuntu6) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9) ..."]} 2020-05-18T21:23:04.095 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:04 +0000 (0:00:09.535) 0:01:58.373 ************ 2020-05-18T21:23:04.150 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => {"cache_update_time": 1589836678, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 45 not upgraded.\nNeed to get 13.7 MB of archives.\nAfter this operation, 62.8 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.1-0ubuntu2 [3236 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.1-0ubuntu2 [1611 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6 [56.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6 [1054 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6 [6741 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal/main amd64 qemu-utils amd64 1:4.2-3ubuntu6 [965 kB]\nFetched 13.7 MB in 1s (11.1 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database 2020-05-18T21:23:04.152 INFO:teuthology.task.ansible.out: ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 149464 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.1-0ubuntu2_amd64.deb ...\r\nUnpacking librados2 (15.2.1-0ubuntu2) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.1-0ubuntu2_amd64.deb ...\r\nUnpacking librbd1 (15.2.1-0ubuntu2) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6) ...\r\nSetting up librados2 (15.2.1-0ubuntu2) ...\r\nSetting up librbd1 (15.2.1-0ubuntu2) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qe 2020-05-18T21:23:04.154 INFO:teuthology.task.ansible.out:mu-system-common qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 45 not upgraded.", "Need to get 13.7 MB of archives.", "After this operation, 62.8 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.1-0ubuntu2 [3236 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.1-0ubuntu2 [1611 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6 [56.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6 [1054 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6 [6741 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 qemu-utils amd64 1:4.2-3ubuntu6 [965 kB]", "Fetched 13.7 MB in 1s (11.1 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 149464 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.1-0ubuntu2_amd64.deb ...", "Unpacking librados2 (15.2.1-0ubuntu2) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1- 2020-05-18T21:23:04.156 INFO:teuthology.task.ansible.out:librbd1_15.2.1-0ubuntu2_amd64.deb ...", "Unpacking librbd1 (15.2.1-0ubuntu2) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6) ...", "Setting up librados2 (15.2.1-0ubuntu2) ...", "Setting up librbd1 (15.2.1-0ubuntu2) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6) ...", "Setting up qemu-utils (1:4.2-3ubuntu6) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9) ..."]} 2020-05-18T21:23:04.190 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:04 +0000 (0:00:00.096) 0:01:58.470 ************ 2020-05-18T21:23:04.723 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-05-18T21:23:04.724 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"cache_update_time": 1589836617, "cache_updated": false, "changed": false} 2020-05-18T21:23:04.766 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:04 +0000 (0:00:00.576) 0:01:59.046 ************ 2020-05-18T21:23:04.808 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"cache_update_time": 1589836678, "cache_updated": false, "changed": false} 2020-05-18T21:23:04.853 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:04 +0000 (0:00:00.086) 0:01:59.133 ************ 2020-05-18T21:23:04.938 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-05-18T21:23:04.940 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-05-18T21:23:04.979 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:04 +0000 (0:00:00.125) 0:01:59.259 ************ 2020-05-18T21:23:05.000 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-05-18T21:23:05.038 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:05 +0000 (0:00:00.059) 0:01:59.318 ************ 2020-05-18T21:23:05.047 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-05-18T21:23:05.048 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:05.090 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:05 +0000 (0:00:00.052) 0:01:59.370 ************ 2020-05-18T21:23:05.099 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:05.136 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:05 +0000 (0:00:00.045) 0:01:59.416 ************ 2020-05-18T21:23:05.233 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-05-18T21:23:05.235 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-05-18T21:23:05.275 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:05 +0000 (0:00:00.136) 0:01:59.553 ************ 2020-05-18T21:23:05.293 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-05-18T21:23:05.332 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:05 +0000 (0:00:00.059) 0:01:59.612 ************ 2020-05-18T21:23:05.661 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-05-18T21:23:05.663 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-05-18T21:23:05.711 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:05 +0000 (0:00:00.379) 0:01:59.991 ************ 2020-05-18T21:23:05.734 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-05-18T21:23:05.775 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:05 +0000 (0:00:00.063) 0:02:00.055 ************ 2020-05-18T21:23:05.891 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-05-18T21:23:05.893 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1214, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-05-18T21:23:05.945 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:05 +0000 (0:00:00.169) 0:02:00.224 ************ 2020-05-18T21:23:05.981 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1214, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-05-18T21:23:06.026 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:06 +0000 (0:00:00.081) 0:02:00.306 ************ 2020-05-18T21:23:06.094 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-05-18T21:23:06.096 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-05-18T21:23:06.137 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:06 +0000 (0:00:00.110) 0:02:00.416 ************ 2020-05-18T21:23:06.186 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-05-18T21:23:06.223 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:06 +0000 (0:00:00.085) 0:02:00.502 ************ 2020-05-18T21:23:06.412 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-05-18T21:23:06.413 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2020-05-18 21:20:45 UTC", "ActiveEnterTimestampMonotonic": "17213591", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target system.slice network.target nss-lookup.target -.mount systemd-journald.socket sysinit.target systemd-tmpfiles-setup.service basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-05-18 21:20:44 UTC", "AssertTimestampMonotonic": "16163531", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-05-18 21:20:44 UTC", "ConditionTimestampMonotonic": "16163530", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup" 2020-05-18T21:23:06.415 INFO:teuthology.task.ansible.out:: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1163", "ExecMainStartTimestamp": "Mon 2020-05-18 21:20:45 UTC", "ExecMainStartTimestampMonotonic": "17213552", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "1844674407370 2020-05-18T21:23:06.417 INFO:teuthology.task.ansible.out:9551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-05-18 21:20:44 UTC", "InactiveExitTimestampMonotonic": "16166535", "InvocationID": "7dfcc93d870649fd97715a5dd51ab568", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127783", "LimitNPROCSoft": "127783", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127783", "LimitSIGPENDINGSoft": "127783", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1163", "MemoryAccounting": "yes", "MemoryCurrent": "10477568", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPol 2020-05-18T21:23:06.419 INFO:teuthology.task.ansible.out:icy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-05-18 21:20:45 UTC", "StateChangeTimestampMonotonic": "17213591", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38335", "TimeoutAbortUSec" 2020-05-18T21:23:06.420 INFO:teuthology.task.ansible.out:: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-05-18T21:23:06.451 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:06 +0000 (0:00:00.228) 0:02:00.731 ************ 2020-05-18T21:23:06.480 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-05-18T21:23:06.482 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:06.518 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:06 +0000 (0:00:00.065) 0:02:00.797 ************ 2020-05-18T21:23:06.527 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-05-18T21:23:06.530 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2020-05-18 21:20:48 UTC", "ActiveEnterTimestampMonotonic": "16905085", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice systemd-journald.socket basic.target network.target remote-fs.target -.mount nss-lookup.target sysinit.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-05-18 21:20:47 UTC", "AssertTimestampMonotonic": "15980018", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-05-18 21:20:47 UTC", "ConditionTimestampMonotonic": "15980018", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup" 2020-05-18T21:23:06.532 INFO:teuthology.task.ansible.out:: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1147", "ExecMainStartTimestamp": "Mon 2020-05-18 21:20:48 UTC", "ExecMainStartTimestampMonotonic": "16905023", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "1844674407370 2020-05-18T21:23:06.534 INFO:teuthology.task.ansible.out:9551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-05-18 21:20:47 UTC", "InactiveExitTimestampMonotonic": "15981256", "InvocationID": "683262cf28d349789591d33752f5b62c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127783", "LimitNPROCSoft": "127783", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127783", "LimitSIGPENDINGSoft": "127783", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1147", "MemoryAccounting": "yes", "MemoryCurrent": "10792960", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPol 2020-05-18T21:23:06.542 INFO:teuthology.task.ansible.out:icy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-05-18 21:20:48 UTC", "StateChangeTimestampMonotonic": "16905085", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38335", "TimeoutAbortUSec" 2020-05-18T21:23:06.543 INFO:teuthology.task.ansible.out:: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]" 2020-05-18T21:23:06.544 INFO:teuthology.task.ansible.out:, "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-05-18T21:23:06.546 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-05-18T21:23:06.547 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:06.582 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:06 +0000 (0:00:00.064) 0:02:00.861 ************ 2020-05-18T21:23:06.619 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:06 +0000 (0:00:00.037) 0:02:00.899 ************ 2020-05-18T21:23:06.628 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-05-18T21:23:06.630 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:06.668 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:06 +0000 (0:00:00.048) 0:02:00.948 ************ 2020-05-18T21:23:06.677 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:06.714 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:06 +0000 (0:00:00.046) 0:02:00.994 ************ 2020-05-18T21:23:06.723 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-05-18T21:23:06.725 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:06.762 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:06 +0000 (0:00:00.047) 0:02:01.042 ************ 2020-05-18T21:23:06.771 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-05-18T21:23:06.773 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:06.809 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:06 +0000 (0:00:00.047) 0:02:01.089 ************ 2020-05-18T21:23:06.817 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-05-18T21:23:06.820 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:06.863 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:06 +0000 (0:00:00.054) 0:02:01.143 ************ 2020-05-18T21:23:06.872 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-05-18T21:23:06.874 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:06.913 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:06 +0000 (0:00:00.049) 0:02:01.192 ************ 2020-05-18T21:23:06.921 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-05-18T21:23:06.923 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:06.961 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:06 +0000 (0:00:00.048) 0:02:01.241 ************ 2020-05-18T21:23:06.969 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-05-18T21:23:06.971 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.017 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.056) 0:02:01.297 ************ 2020-05-18T21:23:07.028 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-05-18T21:23:07.029 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.068 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.050) 0:02:01.347 ************ 2020-05-18T21:23:07.077 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.120 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.052) 0:02:01.400 ************ 2020-05-18T21:23:07.127 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-05-18T21:23:07.129 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.170 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.050) 0:02:01.450 ************ 2020-05-18T21:23:07.181 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-05-18T21:23:07.182 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.229 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.058) 0:02:01.509 ************ 2020-05-18T21:23:07.236 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-05-18T21:23:07.238 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.274 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.044) 0:02:01.554 ************ 2020-05-18T21:23:07.281 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-05-18T21:23:07.282 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.318 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.044) 0:02:01.598 ************ 2020-05-18T21:23:07.325 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-05-18T21:23:07.327 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.364 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.046) 0:02:01.644 ************ 2020-05-18T21:23:07.374 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-05-18T21:23:07.376 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.412 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.047) 0:02:01.692 ************ 2020-05-18T21:23:07.419 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-05-18T21:23:07.421 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.466 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.054) 0:02:01.746 ************ 2020-05-18T21:23:07.474 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-05-18T21:23:07.475 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.513 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.045) 0:02:01.792 ************ 2020-05-18T21:23:07.520 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.560 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.047) 0:02:01.840 ************ 2020-05-18T21:23:07.570 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-05-18T21:23:07.571 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.626 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.065) 0:02:01.906 ************ 2020-05-18T21:23:07.633 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.671 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.044) 0:02:01.950 ************ 2020-05-18T21:23:07.679 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-05-18T21:23:07.680 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.724 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.052) 0:02:02.003 ************ 2020-05-18T21:23:07.735 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.768 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.045) 0:02:02.048 ************ 2020-05-18T21:23:07.777 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-05-18T21:23:07.778 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.814 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.045) 0:02:02.094 ************ 2020-05-18T21:23:07.823 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-05-18T21:23:07.825 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.865 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.048) 0:02:02.142 ************ 2020-05-18T21:23:07.871 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-05-18T21:23:07.873 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.910 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.046) 0:02:02.189 ************ 2020-05-18T21:23:07.921 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-05-18T21:23:07.923 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:07.959 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:07 +0000 (0:00:00.049) 0:02:02.239 ************ 2020-05-18T21:23:07.966 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-05-18T21:23:07.968 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.003 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.043) 0:02:02.282 ************ 2020-05-18T21:23:08.009 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-05-18T21:23:08.015 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.046 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.043) 0:02:02.326 ************ 2020-05-18T21:23:08.054 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-05-18T21:23:08.056 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.091 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.044) 0:02:02.371 ************ 2020-05-18T21:23:08.099 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-05-18T21:23:08.101 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.138 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.046) 0:02:02.417 ************ 2020-05-18T21:23:08.146 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.181 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.044) 0:02:02.461 ************ 2020-05-18T21:23:08.188 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-05-18T21:23:08.190 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.225 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.043) 0:02:02.505 ************ 2020-05-18T21:23:08.232 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-05-18T21:23:08.234 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.269 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.044) 0:02:02.549 ************ 2020-05-18T21:23:08.276 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-05-18T21:23:08.278 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.314 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.044) 0:02:02.593 ************ 2020-05-18T21:23:08.325 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-05-18T21:23:08.327 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.362 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.048) 0:02:02.642 ************ 2020-05-18T21:23:08.369 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-05-18T21:23:08.371 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.406 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.044) 0:02:02.686 ************ 2020-05-18T21:23:08.414 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-05-18T21:23:08.415 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.451 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.045) 0:02:02.731 ************ 2020-05-18T21:23:08.460 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-05-18T21:23:08.462 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.499 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.047) 0:02:02.779 ************ 2020-05-18T21:23:08.510 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.548 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.049) 0:02:02.828 ************ 2020-05-18T21:23:08.555 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-05-18T21:23:08.557 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.597 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.049) 0:02:02.877 ************ 2020-05-18T21:23:08.606 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.656 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.058) 0:02:02.935 ************ 2020-05-18T21:23:08.665 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-05-18T21:23:08.667 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.710 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.054) 0:02:02.990 ************ 2020-05-18T21:23:08.719 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-05-18T21:23:08.720 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.767 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.056) 0:02:03.047 ************ 2020-05-18T21:23:08.775 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-05-18T21:23:08.776 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.832 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.065) 0:02:03.112 ************ 2020-05-18T21:23:08.843 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-05-18T21:23:08.845 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.884 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.051) 0:02:03.163 ************ 2020-05-18T21:23:08.892 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-05-18T21:23:08.894 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.931 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.047) 0:02:03.211 ************ 2020-05-18T21:23:08.939 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-05-18T21:23:08.942 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:08.977 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:08 +0000 (0:00:00.045) 0:02:03.257 ************ 2020-05-18T21:23:09.005 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-05-18T21:23:09.007 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:09.042 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:09 +0000 (0:00:00.064) 0:02:03.322 ************ 2020-05-18T21:23:09.091 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-05-18T21:23:09.093 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-05-18T21:23:09.128 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:09 +0000 (0:00:00.085) 0:02:03.407 ************ 2020-05-18T21:23:09.136 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-05-18T21:23:09.138 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:09.174 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:09 +0000 (0:00:00.046) 0:02:03.454 ************ 2020-05-18T21:23:09.329 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-05-18T21:23:09.330 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-05-18T21:23:09.375 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:09 +0000 (0:00:00.200) 0:02:03.654 ************ 2020-05-18T21:23:09.508 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-05-18T21:23:09.510 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-05-18T21:23:09.558 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:09 +0000 (0:00:00.183) 0:02:03.838 ************ 2020-05-18T21:23:09.589 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-05-18T21:23:09.590 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:09.635 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:09 +0000 (0:00:00.077) 0:02:03.915 ************ 2020-05-18T21:23:09.775 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-05-18T21:23:09.812 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:09 +0000 (0:00:00.176) 0:02:04.092 ************ 2020-05-18T21:23:09.854 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-05-18T21:23:09.855 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:09.895 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:09 +0000 (0:00:00.082) 0:02:04.175 ************ 2020-05-18T21:23:10.005 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-05-18T21:23:10.006 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-05-18T21:23:10.044 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:10 +0000 (0:00:00.149) 0:02:04.324 ************ 2020-05-18T21:23:10.281 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-05-18T21:23:10.322 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:10 +0000 (0:00:00.277) 0:02:04.602 ************ 2020-05-18T21:23:10.446 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-05-18T21:23:10.447 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-05-18T21:23:10.449 INFO:teuthology.task.ansible.out: 2020-05-18T21:23:10.502 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:10 +0000 (0:00:00.180) 0:02:04.782 ************ 2020-05-18T21:23:10.700 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-05-18T21:23:10.752 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:10 +0000 (0:00:00.250) 0:02:05.032 ************ 2020-05-18T21:23:10.896 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-05-18T21:23:10.898 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-05-18T21:23:10.947 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:10 +0000 (0:00:00.194) 0:02:05.227 ************ 2020-05-18T21:23:11.106 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-05-18T21:23:11.108 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-05-18T21:23:11.147 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:11 +0000 (0:00:00.199) 0:02:05.427 ************ 2020-05-18T21:23:11.159 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-05-18T21:23:11.161 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-05-18T21:23:11.207 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:11 +0000 (0:00:00.059) 0:02:05.486 ************ 2020-05-18T21:23:11.217 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-05-18T21:23:11.219 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.263 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:11 +0000 (0:00:00.056) 0:02:05.543 ************ 2020-05-18T21:23:11.303 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-05-18T21:23:11.305 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.347 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:11 +0000 (0:00:00.083) 0:02:05.627 ************ 2020-05-18T21:23:11.358 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-05-18T21:23:11.360 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-05-18T21:23:11.406 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:11 +0000 (0:00:00.058) 0:02:05.686 ************ 2020-05-18T21:23:11.413 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-05-18T21:23:11.416 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.452 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:11 +0000 (0:00:00.045) 0:02:05.731 ************ 2020-05-18T21:23:11.459 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-05-18T21:23:11.461 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.504 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:11 +0000 (0:00:00.052) 0:02:05.784 ************ 2020-05-18T21:23:11.512 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-05-18T21:23:11.514 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.550 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:11 +0000 (0:00:00.046) 0:02:05.830 ************ 2020-05-18T21:23:11.557 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-05-18T21:23:11.559 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.595 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:11 +0000 (0:00:00.045) 0:02:05.875 ************ 2020-05-18T21:23:11.603 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-05-18T21:23:11.605 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.641 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:11 +0000 (0:00:00.045) 0:02:05.921 ************ 2020-05-18T21:23:11.649 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-05-18T21:23:11.651 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.689 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:11 +0000 (0:00:00.047) 0:02:05.969 ************ 2020-05-18T21:23:11.696 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-05-18T21:23:11.698 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-05-18T21:23:11.735 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:11 +0000 (0:00:00.046) 0:02:06.015 ************ 2020-05-18T21:23:11.743 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-05-18T21:23:11.745 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.782 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:11 +0000 (0:00:00.046) 0:02:06.062 ************ 2020-05-18T21:23:11.800 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-05-18T21:23:11.802 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.803 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.825 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.827 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi063.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.863 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:11 +0000 (0:00:00.079) 0:02:06.142 ************ 2020-05-18T21:23:11.870 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-05-18T21:23:11.871 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.872 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.872 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.873 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.873 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.885 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.896 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:11.899 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-05-18T21:23:11.901 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-05-18T21:23:11.942 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:11 +0000 (0:00:00.079) 0:02:06.221 ************ 2020-05-18T21:23:11.975 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:11 +0000 (0:00:00.033) 0:02:06.255 ************ 2020-05-18T21:23:12.023 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-05-18T21:23:12.025 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.035 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.047 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.048 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.058 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.070 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.082 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-05-18T21:23:12.094 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.095 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.106 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.108 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.120 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.122 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.134 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.135 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.202 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:12 +0000 (0:00:00.226) 0:02:06.481 ************ 2020-05-18T21:23:12.209 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-05-18T21:23:12.211 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003794", "end": "2020-05-18 21:23:12.176297", "rc": 0, "start": "2020-05-18 21:23:12.172503", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-05-18T21:23:12.263 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:12 +0000 (0:00:00.061) 0:02:06.543 ************ 2020-05-18T21:23:12.301 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-05-18T21:23:12.302 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.344 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:12 +0000 (0:00:00.080) 0:02:06.624 ************ 2020-05-18T21:23:12.381 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-05-18T21:23:12.383 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.424 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:12 +0000 (0:00:00.079) 0:02:06.703 ************ 2020-05-18T21:23:12.454 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-05-18T21:23:12.456 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004339", "end": "2020-05-18 21:23:12.420034", "rc": 0, "start": "2020-05-18 21:23:12.415695", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-05-18T21:23:12.456 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.494 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:12 +0000 (0:00:00.070) 0:02:06.774 ************ 2020-05-18T21:23:12.536 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:12 +0000 (0:00:00.041) 0:02:06.815 ************ 2020-05-18T21:23:12.596 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-05-18T21:23:12.598 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.643 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:12 +0000 (0:00:00.107) 0:02:06.922 ************ 2020-05-18T21:23:12.681 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-05-18T21:23:12.683 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.717 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:12 +0000 (0:00:00.074) 0:02:06.997 ************ 2020-05-18T21:23:12.747 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-05-18T21:23:12.749 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:12.795 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:12 +0000 (0:00:00.077) 0:02:07.075 ************ 2020-05-18T21:23:13.111 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-05-18T21:23:13.113 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"cache_update_time": 1589836617, "cache_updated": false, "changed": false} 2020-05-18T21:23:13.154 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:13 +0000 (0:00:00.358) 0:02:07.434 ************ 2020-05-18T21:23:13.185 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-05-18T21:23:13.186 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:13.240 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:13 +0000 (0:00:00.086) 0:02:07.520 ************ 2020-05-18T21:23:13.291 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-05-18T21:23:13.293 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item={'block_used': 13938083, 'uuid': 'e74b88d4-7bc9-445a-bab7-598d7476c420', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226157025, 'size_available': 926339174400, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 163945, 'block_size': 4096, 'inode_available': 60891031}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226157025, "block_size": 4096, "block_total": 240095108, "block_used": 13938083, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60891031, "inode_total": 61054976, "inode_used": 163945, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926339174400, "size_total": 983429562368, "uuid": "e74b88d4-7bc9-445a-bab7-598d7476c420"}} 2020-05-18T21:23:13.363 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:13 +0000 (0:00:00.123) 0:02:07.643 ************ 2020-05-18T21:23:13.429 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-05-18T21:23:13.431 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"cache_update_time": 1589836678, "cache_updated": false, "changed": false} 2020-05-18T21:23:13.470 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:13 +0000 (0:00:00.106) 0:02:07.750 ************ 2020-05-18T21:23:13.500 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-05-18T21:23:13.502 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:13.559 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:13 +0000 (0:00:00.088) 0:02:07.839 ************ 2020-05-18T21:23:13.568 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-05-18T21:23:13.571 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009357", "end": "2020-05-18 21:23:13.758671", "rc": 0, "start": "2020-05-18 21:23:13.749314", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:13.608 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:13 +0000 (0:00:00.049) 0:02:07.888 ************ 2020-05-18T21:23:13.619 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-05-18T21:23:13.620 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item={'block_used': 13938098, 'uuid': 'e74b88d4-7bc9-445a-bab7-598d7476c420', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226157010, 'size_available': 926339112960, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 163945, 'block_size': 4096, 'inode_available': 60891031}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226157010, "block_size": 4096, "block_total": 240095108, "block_used": 13938098, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60891031, "inode_total": 61054976, "inode_used": 163945, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926339112960, "size_total": 983429562368, "uuid": "e74b88d4-7bc9-445a-bab7-598d7476c420"}} 2020-05-18T21:23:13.661 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:13 +0000 (0:00:00.052) 0:02:07.941 ************ 2020-05-18T21:23:13.670 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi063.front.sepia.ceph.com] => (item={'block_used': 13938083, 'uuid': 'e74b88d4-7bc9-445a-bab7-598d7476c420', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226157025, 'size_available': 926339174400, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 163945, 'block_size': 4096, 'inode_available': 60891031}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226157025, "block_size": 4096, "block_total": 240095108, "block_used": 13938083, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60891031, "inode_total": 61054976, "inode_used": 163945, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926339174400, "size_total": 983429562368, "uuid": "e74b88d4-7bc9-445a-bab7-598d7476c420"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:13.715 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:13 +0000 (0:00:00.054) 0:02:07.995 ************ 2020-05-18T21:23:13.750 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-05-18T21:23:13.787 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:13 +0000 (0:00:00.072) 0:02:08.067 ************ 2020-05-18T21:23:13.806 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-05-18T21:23:13.808 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.007007", "end": "2020-05-18 21:23:14.086598", "rc": 0, "start": "2020-05-18 21:23:14.079591", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:13.854 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:13 +0000 (0:00:00.061) 0:02:08.129 ************ 2020-05-18T21:23:13.858 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-05-18T21:23:13.860 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:13.913 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-05-18T21:23:13.915 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'block_used': 13938098, 'uuid': 'e74b88d4-7bc9-445a-bab7-598d7476c420', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226157010, 'size_available': 926339112960, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 163945, 'block_size': 4096, 'inode_available': 60891031}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226157010, "block_size": 4096, "block_total": 240095108, "block_used": 13938098, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60891031, "inode_total": 61054976, "inode_used": 163945, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926339112960, "size_total": 983429562368, "uuid": "e74b88d4-7bc9-445a-bab7-598d7476c420"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:13.964 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:13 +0000 (0:00:00.115) 0:02:08.244 ************ 2020-05-18T21:23:14.003 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-05-18T21:23:14.043 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:14 +0000 (0:00:00.078) 0:02:08.323 ************ 2020-05-18T21:23:14.099 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-05-18T21:23:14.102 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:15.584 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2XpsXUSdBkcoKQv4hpZmDhGFfeO050nCYvYc'], 'uuids': ['09905c56-09d5-4a3d-b0a6-4e25b379a596']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.578002", "end": "2020-05-18 21:23:15.801128", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2XpsXUSdBkcoKQv4hpZmDhGFfeO050nCYvYc"], "labels": [], "masters": [], "uuids": ["09905c56-09d5-4a3d-b0a6-4e25b379a596"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:14.223126", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi063.front 2020-05-18T21:23:15.595 INFO:teuthology.task.ansible.out:.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:15.598 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:15.973 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiM2F2aLNeV460KDBZ8LeUPGGabkFHdQdT9'], 'uuids': ['426223cb-49c2-48c7-ab7b-447b80b4e668']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.738951", "end": "2020-05-18 21:23:16.244473", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiM2F2aLNeV460KDBZ8LeUPGGabkFHdQdT9"], "labels": [], "masters": [], "uuids": ["426223cb-49c2-48c7-ab7b-447b80b4e668"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:14.505522", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-05-18T21:23:15.986 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:16.859 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2Xps0slr5yHa1WJL3jsN0ks32QgVuLx0knyQ'], 'uuids': ['ced194ef-40b0-48f3-92ad-210297904c6b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.133495", "end": "2020-05-18 21:23:17.093025", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2Xps0slr5yHa1WJL3jsN0ks32QgVuLx0knyQ"], "labels": [], "masters": [], "uuids": ["ced194ef-40b0-48f3-92ad-210297904c6b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:15.959530", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-05-18T21:23:16.881 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W2X1', 'wwn-0x5000c50087b8ff21'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'e74b88d4-7bc9-445a-bab7-598d7476c420', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W2X1-part1', 'wwn-0x5000c50087b8ff21-part1'], 'uuids': ['e74b88d4-7bc9-445a-bab7-598d7476c420']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50087b8ff21', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4W2X1', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W2X1", "wwn-0x5000c50087b8ff21"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W2X1-part1", "wwn-0x5000c50087b8ff21-part1"], "labels": [], "masters": [], "uuids": ["e74b88d4-7bc9-445a-bab7-598d7476c420"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "e74b88d4-7bc9-445a-bab7-598d7476c420"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W2X1", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087b8ff21"}}, 2020-05-18T21:23:16.882 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-05-18T21:23:17.290 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiMBE0A1o8T8poSRyiATk4vYeFKinNmw8MV'], 'uuids': ['03b5d6f7-1733-47e3-8546-1a8a63c13677']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.168674", "end": "2020-05-18 21:23:17.561094", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiMBE0A1o8T8poSRyiATk4vYeFKinNmw8MV"], "labels": [], "masters": [], "uuids": ["03b5d6f7-1733-47e3-8546-1a8a63c13677"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:16.392420", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-05-18T21:23:17.309 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNRW', 'wwn-0x5000c5009294102d'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'e74b88d4-7bc9-445a-bab7-598d7476c420', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNRW-part1', 'wwn-0x5000c5009294102d-part1'], 'uuids': ['e74b88d4-7bc9-445a-bab7-598d7476c420']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009294102d', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XNRW', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNRW", "wwn-0x5000c5009294102d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNRW-part1", "wwn-0x5000c5009294102d-part1"], "labels": [], "masters": [], "uuids": ["e74b88d4-7bc9-445a-bab7-598d7476c420"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "e74b88d4-7bc9-445a-bab7-598d7476c420"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XNRW", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009294102d"}}, 2020-05-18T21:23:17.311 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-05-18T21:23:18.171 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-xgWDyD-hwaS-HggG-2mO9-03bo-s23H-LT35pv', 'nvme-INTEL_SSDPEDMD400G4_CVFT5344005B400BGN', 'nvme-nvme.8086-43564654353334343030354234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.155925", "end": "2020-05-18 21:23:18.395371", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-xgWDyD-hwaS-HggG-2mO9-03bo-s23H-LT35pv", "nvme-INTEL_SSDPEDMD400G4_CVFT5344005B400BGN", "nvme-nvme.8086-43564654353334343030354234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:17.239446", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2020-05-18T21:23:18.174 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-05-18T21:23:18.184 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:18.195 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:18.613 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-Pt26E9-3P63-sDZJ-1Ej7-0X74-lHjD-zYfAwx', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300GW400BGN', 'nvme-nvme.8086-43564654363233333030475734303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.182913", "end": "2020-05-18 21:23:18.885057", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Pt26E9-3P63-sDZJ-1Ej7-0X74-lHjD-zYfAwx", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GW400BGN", "nvme-nvme.8086-43564654363233333030475734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:17.702144", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2020-05-18T21:23:18.615 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-05-18T21:23:18.624 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:18.646 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:19.473 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2XpsIFEGryDAkqAynyIL5IIzkMPlCknKetBZ'], 'uuids': ['092d4e76-01a9-44dc-b91f-57cf275e2d21']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.142189", "end": "2020-05-18 21:23:19.701257", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2XpsIFEGryDAkqAynyIL5IIzkMPlCknKetBZ"], "labels": [], "masters": [], "uuids": ["092d4e76-01a9-44dc-b91f-57cf275e2d21"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:18.559068", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-05-18T21:23:19.485 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:19.507 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:19.946 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiMr2B9ErYiVdwJagONjmOmem6rmlp0An4Q'], 'uuids': ['50d7de73-a92d-42ea-ba47-da65d1a8b945']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.168113", "end": "2020-05-18 21:23:20.222062", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiMr2B9ErYiVdwJagONjmOmem6rmlp0An4Q"], "labels": [], "masters": [], "uuids": ["50d7de73-a92d-42ea-ba47-da65d1a8b945"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:19.053949", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-05-18T21:23:19.958 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:19.969 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:20.781 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2XpsoKjzvVII3P2ectxMLfHcMlmEupToB0jZ'], 'uuids': ['7f04fba0-4d6f-44ab-962a-178e9f7449a3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.127328", "end": "2020-05-18 21:23:21.009872", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2XpsoKjzvVII3P2ectxMLfHcMlmEupToB0jZ"], "labels": [], "masters": [], "uuids": ["7f04fba0-4d6f-44ab-962a-178e9f7449a3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:19.882544", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-05-18T21:23:20.794 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:21.263 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiMEqMAodYx9SQRwnI1YBsvXdDH1ect3txJ'], 'uuids': ['2b63c1a2-a007-46fa-bdf6-7a520d746a7b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.171065", "end": "2020-05-18 21:23:21.538408", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiMEqMAodYx9SQRwnI1YBsvXdDH1ect3txJ"], "labels": [], "masters": [], "uuids": ["2b63c1a2-a007-46fa-bdf6-7a520d746a7b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:20.367343", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-05-18T21:23:21.275 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:22.077 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2XpsxdpIXmHJGMDliGJiLmujTwrdmKu9Pxbj'], 'uuids': ['eebe8fba-69f8-4669-8cfe-08d4f1d9f6a2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.147488", "end": "2020-05-18 21:23:22.310072", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2XpsxdpIXmHJGMDliGJiLmujTwrdmKu9Pxbj"], "labels": [], "masters": [], "uuids": ["eebe8fba-69f8-4669-8cfe-08d4f1d9f6a2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:21.162584", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-05-18T21:23:22.124 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:22 +0000 (0:00:08.081) 0:02:16.404 ************ 2020-05-18T21:23:22.184 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-05-18T21:23:22.186 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:22.487 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2XpsXUSdBkcoKQv4hpZmDhGFfeO050nCYvYc'], 'uuids': ['09905c56-09d5-4a3d-b0a6-4e25b379a596']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.169708", "end": "2020-05-18 21:23:22.716183", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2XpsXUSdBkcoKQv4hpZmDhGFfeO050nCYvYc"], "labels": [], "masters": [], "uuids": ["09905c56-09d5-4a3d-b0a6-4e25b379a596"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:22.546475", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156735 s, 736 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156735 s, 736 MB/s"], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:22.500 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:22.501 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:22.568 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-05-18T21:23:22.570 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiMhikaLUgWzMbWppxK1PvPYvexFOyItCdH'], 'uuids': ['f50ca8f5-e4f0-441a-8166-54ef4ced3dcb']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.161976", "end": "2020-05-18 21:23:22.838709", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiMhikaLUgWzMbWppxK1PvPYvexFOyItCdH"], "labels": [], "masters": [], "uuids": ["f50ca8f5-e4f0-441a-8166-54ef4ced3dcb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:21.676733", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-05-18T21:23:22.623 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:22 +0000 (0:00:00.498) 0:02:16.903 ************ 2020-05-18T21:23:22.671 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-05-18T21:23:22.673 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:22.796 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2Xps0slr5yHa1WJL3jsN0ks32QgVuLx0knyQ'], 'uuids': ['ced194ef-40b0-48f3-92ad-210297904c6b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.166502", "end": "2020-05-18 21:23:23.034951", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2Xps0slr5yHa1WJL3jsN0ks32QgVuLx0knyQ"], "labels": [], "masters": [], "uuids": ["ced194ef-40b0-48f3-92ad-210297904c6b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:22.868449", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.163287 s, 706 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.163287 s, 706 MB/s"], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:22.812 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W2X1', 'wwn-0x5000c50087b8ff21'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'e74b88d4-7bc9-445a-bab7-598d7476c420', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W2X1-part1', 'wwn-0x5000c50087b8ff21-part1'], 'uuids': ['e74b88d4-7bc9-445a-bab7-598d7476c420']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50087b8ff21', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4W2X1', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W2X1", "wwn-0x5000c50087b8ff21"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W2X1-part1", "wwn-0x5000c50087b8ff21-part1"], "labels": [], "masters": [], "uuids": ["e74b88d4-7bc9-445a-bab7-598d7476c420"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "e74b88d4-7bc9-445a-bab7-598d7476c420"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W2X1", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087b8ff21"}}, 2020-05-18T21:23:22.819 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-05-18T21:23:23.000 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiM2F2aLNeV460KDBZ8LeUPGGabkFHdQdT9'], 'uuids': ['426223cb-49c2-48c7-ab7b-447b80b4e668']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.183151", "end": "2020-05-18 21:23:23.261554", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiM2F2aLNeV460KDBZ8LeUPGGabkFHdQdT9"], "labels": [], "masters": [], "uuids": ["426223cb-49c2-48c7-ab7b-447b80b4e668"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:23.078403", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.155741 s, 741 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.155741 s, 741 MB/s"], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:23.002 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-xgWDyD-hwaS-HggG-2mO9-03bo-s23H-LT35pv', 'nvme-INTEL_SSDPEDMD400G4_CVFT5344005B400BGN', 'nvme-nvme.8086-43564654353334343030354234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.060192", "end": "2020-05-18 21:23:23.234685", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-xgWDyD-hwaS-HggG-2mO9-03bo-s23H-LT35pv", "nvme-INTEL_SSDPEDMD400G4_CVFT5344005B400BGN", "nvme-nvme.8086-43564654353334343030354234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:23.174493", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0552596 s, 2.1 GB/s", "std 2020-05-18T21:23:23.004 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0552596 s, 2.1 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:23.024 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:23.025 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:23.036 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:23.313 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiMBE0A1o8T8poSRyiATk4vYeFKinNmw8MV'], 'uuids': ['03b5d6f7-1733-47e3-8546-1a8a63c13677']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.164191", "end": "2020-05-18 21:23:23.588565", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiMBE0A1o8T8poSRyiATk4vYeFKinNmw8MV"], "labels": [], "masters": [], "uuids": ["03b5d6f7-1733-47e3-8546-1a8a63c13677"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:23.424374", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159171 s, 725 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159171 s, 725 MB/s"], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:23.325 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNRW', 'wwn-0x5000c5009294102d'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'e74b88d4-7bc9-445a-bab7-598d7476c420', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNRW-part1', 'wwn-0x5000c5009294102d-part1'], 'uuids': ['e74b88d4-7bc9-445a-bab7-598d7476c420']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009294102d', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XNRW', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNRW", "wwn-0x5000c5009294102d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNRW-part1", "wwn-0x5000c5009294102d-part1"], "labels": [], "masters": [], "uuids": ["e74b88d4-7bc9-445a-bab7-598d7476c420"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "e74b88d4-7bc9-445a-bab7-598d7476c420"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XNRW", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009294102d"}}, 2020-05-18T21:23:23.327 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-05-18T21:23:23.327 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2XpsIFEGryDAkqAynyIL5IIzkMPlCknKetBZ'], 'uuids': ['092d4e76-01a9-44dc-b91f-57cf275e2d21']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.158575", "end": "2020-05-18 21:23:23.560896", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2XpsIFEGryDAkqAynyIL5IIzkMPlCknKetBZ"], "labels": [], "masters": [], "uuids": ["092d4e76-01a9-44dc-b91f-57cf275e2d21"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:23.402321", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153702 s, 750 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153702 s, 750 MB/s"], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:23.352 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:23.353 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:23.522 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-Pt26E9-3P63-sDZJ-1Ej7-0X74-lHjD-zYfAwx', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300GW400BGN', 'nvme-nvme.8086-43564654363233333030475734303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.059194", "end": "2020-05-18 21:23:23.793360", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Pt26E9-3P63-sDZJ-1Ej7-0X74-lHjD-zYfAwx", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GW400BGN", "nvme-nvme.8086-43564654363233333030475734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:23.734166", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0542628 s, 2.1 GB/s", "std 2020-05-18T21:23:23.523 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0542628 s, 2.1 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:23.535 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:23.650 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2XpsoKjzvVII3P2ectxMLfHcMlmEupToB0jZ'], 'uuids': ['7f04fba0-4d6f-44ab-962a-178e9f7449a3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.162939", "end": "2020-05-18 21:23:23.883588", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2XpsoKjzvVII3P2ectxMLfHcMlmEupToB0jZ"], "labels": [], "masters": [], "uuids": ["7f04fba0-4d6f-44ab-962a-178e9f7449a3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:23.720649", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.158069 s, 730 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.158069 s, 730 MB/s"], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:23.651 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:23.823 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiMr2B9ErYiVdwJagONjmOmem6rmlp0An4Q'], 'uuids': ['50d7de73-a92d-42ea-ba47-da65d1a8b945']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.157192", "end": "2020-05-18 21:23:24.101935", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiMr2B9ErYiVdwJagONjmOmem6rmlp0An4Q"], "labels": [], "masters": [], "uuids": ["50d7de73-a92d-42ea-ba47-da65d1a8b945"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:23.944743", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153166 s, 753 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153166 s, 753 MB/s"], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:23.835 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:23.846 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:23.951 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2XpsxdpIXmHJGMDliGJiLmujTwrdmKu9Pxbj'], 'uuids': ['eebe8fba-69f8-4669-8cfe-08d4f1d9f6a2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.161750", "end": "2020-05-18 21:23:24.180458", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-45N09ZstdvjdGiT28ZbvBZ9SUZkw2XpsxdpIXmHJGMDliGJiLmujTwrdmKu9Pxbj"], "labels": [], "masters": [], "uuids": ["eebe8fba-69f8-4669-8cfe-08d4f1d9f6a2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:24.018708", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156904 s, 735 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156904 s, 735 MB/s"], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:24.000 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:23 +0000 (0:00:01.377) 0:02:18.280 ************ 2020-05-18T21:23:24.147 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiMEqMAodYx9SQRwnI1YBsvXdDH1ect3txJ'], 'uuids': ['2b63c1a2-a007-46fa-bdf6-7a520d746a7b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.170067", "end": "2020-05-18 21:23:24.425722", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiMEqMAodYx9SQRwnI1YBsvXdDH1ect3txJ"], "labels": [], "masters": [], "uuids": ["2b63c1a2-a007-46fa-bdf6-7a520d746a7b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:24.255655", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.165192 s, 698 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.165192 s, 698 MB/s"], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:24.159 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:24.381 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-05-18T21:23:24.383 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.222695", "end": "2020-05-18 21:23:24.611527", "rc": 0, "start": "2020-05-18 21:23:24.388832", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:24.422 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:24 +0000 (0:00:00.417) 0:02:18.698 ************ 2020-05-18T21:23:24.479 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-05-18T21:23:24.480 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiMhikaLUgWzMbWppxK1PvPYvexFOyItCdH'], 'uuids': ['f50ca8f5-e4f0-441a-8166-54ef4ced3dcb']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.162893", "end": "2020-05-18 21:23:24.747346", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Kjh7NsJ3zL3TbjWPfQ6BQ7bs2OAdPeiMhikaLUgWzMbWppxK1PvPYvexFOyItCdH"], "labels": [], "masters": [], "uuids": ["f50ca8f5-e4f0-441a-8166-54ef4ced3dcb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-05-18 21:23:24.584453", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157889 s, 731 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157889 s, 731 MB/s"], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:24.532 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:24 +0000 (0:00:00.113) 0:02:18.812 ************ 2020-05-18T21:23:24.655 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi063.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.069891", "end": "2020-05-18 21:23:24.888243", "rc": 0, "start": "2020-05-18 21:23:24.818352", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:24.693 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:24 +0000 (0:00:00.161) 0:02:18.973 ************ 2020-05-18T21:23:24.732 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-05-18T21:23:24.773 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:24 +0000 (0:00:00.078) 0:02:19.052 ************ 2020-05-18T21:23:24.821 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-05-18T21:23:24.823 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:24.872 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:24 +0000 (0:00:00.099) 0:02:19.152 ************ 2020-05-18T21:23:24.881 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-05-18T21:23:24.883 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.141704", "end": "2020-05-18 21:23:25.105190", "rc": 0, "start": "2020-05-18 21:23:24.963486", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:24.921 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:24 +0000 (0:00:00.048) 0:02:19.200 ************ 2020-05-18T21:23:24.928 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-05-18T21:23:24.930 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:24.969 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:24 +0000 (0:00:00.048) 0:02:19.249 ************ 2020-05-18T21:23:24.997 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-05-18T21:23:24.999 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:25.043 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:25 +0000 (0:00:00.073) 0:02:19.323 ************ 2020-05-18T21:23:25.082 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-05-18T21:23:25.084 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:25.120 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:25 +0000 (0:00:00.077) 0:02:19.400 ************ 2020-05-18T21:23:25.159 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-05-18T21:23:25.162 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.096020", "end": "2020-05-18 21:23:25.441774", "rc": 0, "start": "2020-05-18 21:23:25.345754", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:25.200 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:25 +0000 (0:00:00.079) 0:02:19.480 ************ 2020-05-18T21:23:25.239 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-05-18T21:23:25.280 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:25 +0000 (0:00:00.079) 0:02:19.560 ************ 2020-05-18T21:23:25.288 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-05-18T21:23:25.290 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-05-18T21:23:25.329 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:25 +0000 (0:00:00.049) 0:02:19.609 ************ 2020-05-18T21:23:25.342 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:25.380 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:25 +0000 (0:00:00.051) 0:02:19.660 ************ 2020-05-18T21:23:25.387 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-05-18T21:23:25.391 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'block_used': 13938083, 'uuid': 'e74b88d4-7bc9-445a-bab7-598d7476c420', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226157025, 'size_available': 926339174400, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 163945, 'block_size': 4096, 'inode_available': 60891031}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226157025, "block_size": 4096, "block_total": 240095108, "block_used": 13938083, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60891031, "inode_total": 61054976, "inode_used": 163945, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926339174400, "size_total": 983429562368, "uuid": "e74b88d4-7bc9-445a-bab7-598d7476c420"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:25.427 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:25 +0000 (0:00:00.046) 0:02:19.707 ************ 2020-05-18T21:23:25.436 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-05-18T21:23:25.437 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:25.473 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:25 +0000 (0:00:00.046) 0:02:19.753 ************ 2020-05-18T21:23:25.482 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:25.521 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:25 +0000 (0:00:00.047) 0:02:19.801 ************ 2020-05-18T21:23:25.532 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-05-18T21:23:25.533 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:25.574 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:25 +0000 (0:00:00.052) 0:02:19.853 ************ 2020-05-18T21:23:25.584 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:25.623 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:25 +0000 (0:00:00.049) 0:02:19.903 ************ 2020-05-18T21:23:25.631 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-05-18T21:23:25.633 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:25.670 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:25 +0000 (0:00:00.047) 0:02:19.950 ************ 2020-05-18T21:23:25.685 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-05-18T21:23:25.686 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:25.743 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:25 +0000 (0:00:00.073) 0:02:20.023 ************ 2020-05-18T21:23:25.785 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-05-18T21:23:25.786 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:25.824 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:25 +0000 (0:00:00.080) 0:02:20.103 ************ 2020-05-18T21:23:25.830 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-05-18T21:23:25.832 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-05-18T21:23:25.869 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:25 +0000 (0:00:00.046) 0:02:20.149 ************ 2020-05-18T21:23:25.877 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-05-18T21:23:25.879 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:25.925 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:25 +0000 (0:00:00.055) 0:02:20.205 ************ 2020-05-18T21:23:25.932 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-05-18T21:23:25.934 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'block_used': 13938098, 'uuid': 'e74b88d4-7bc9-445a-bab7-598d7476c420', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226157010, 'size_available': 926339112960, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 163945, 'block_size': 4096, 'inode_available': 60891031}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226157010, "block_size": 4096, "block_total": 240095108, "block_used": 13938098, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60891031, "inode_total": 61054976, "inode_used": 163945, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926339112960, "size_total": 983429562368, "uuid": "e74b88d4-7bc9-445a-bab7-598d7476c420"}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:25.972 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:25 +0000 (0:00:00.047) 0:02:20.252 ************ 2020-05-18T21:23:25.979 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-05-18T21:23:25.981 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:26.018 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:26 +0000 (0:00:00.046) 0:02:20.298 ************ 2020-05-18T21:23:26.028 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-05-18T21:23:26.030 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:26.069 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:26 +0000 (0:00:00.050) 0:02:20.349 ************ 2020-05-18T21:23:26.118 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-05-18T21:23:26.120 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:26.161 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:26 +0000 (0:00:00.091) 0:02:20.441 ************ 2020-05-18T21:23:26.212 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-05-18T21:23:26.213 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:26.255 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:26 +0000 (0:00:00.093) 0:02:20.535 ************ 2020-05-18T21:23:26.944 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 18 May 2020 21:23:26 +0000 (0:00:00.074) 0:02:20.609 ************ TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 18 May 2020 21:23:26 +0000 (0:00:00.076) 0:02:20.686 ************ TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 18 May 2020 21:23:26 +0000 (0:00:00.065) 0:02:20.751 ************ 2020-05-18T21:23:26.954 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-05-18T21:23:26.956 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-05-18T21:23:26.993 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:26 +0000 (0:00:00.522) 0:02:21.273 ************ 2020-05-18T21:23:27.059 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-05-18T21:23:27.106 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:27 +0000 (0:00:00.112) 0:02:21.386 ************ 2020-05-18T21:23:27.740 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-05-18T21:23:27.741 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-05-18T21:23:27.763 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-05-18T21:23:28.158 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-05-18T21:23:28.161 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-05-18T21:23:28.535 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-05-18T21:23:28.546 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-05-18T21:23:28.919 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-05-18T21:23:28.961 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-05-18T21:23:29.339 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-05-18T21:23:29.343 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-05-18T21:23:29.384 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:29 +0000 (0:00:02.277) 0:02:23.664 ************ 2020-05-18T21:23:29.423 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:29 +0000 (0:00:00.039) 0:02:23.703 ************ 2020-05-18T21:23:29.527 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-05-18T21:23:29.527 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-05-18T21:23:29.571 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:29 +0000 (0:00:00.147) 0:02:23.851 ************ 2020-05-18T21:23:29.581 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-05-18T21:23:29.621 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:29 +0000 (0:00:00.049) 0:02:23.900 ************ 2020-05-18T21:23:29.726 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-05-18T21:23:29.728 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-05-18T21:23:29.797 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-05-18T21:23:29.849 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-05-18T21:23:29.923 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-05-18T21:23:29.997 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-05-18T21:23:30.050 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-05-18T21:23:30.125 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-05-18T21:23:30.136 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:30.198 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:30 +0000 (0:00:00.577) 0:02:24.478 ************ 2020-05-18T21:23:30.229 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-05-18T21:23:30.229 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:30.271 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:30 +0000 (0:00:00.072) 0:02:24.551 ************ 2020-05-18T21:23:30.352 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-05-18T21:23:30.354 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-05-18T21:23:30.407 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:30 +0000 (0:00:00.135) 0:02:24.686 ************ 2020-05-18T21:23:30.417 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-05-18T21:23:30.458 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:30 +0000 (0:00:00.051) 0:02:24.738 ************ 2020-05-18T21:23:30.466 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-05-18T21:23:30.467 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-05-18T21:23:30.510 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:30 +0000 (0:00:00.051) 0:02:24.790 ************ 2020-05-18T21:23:30.519 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-05-18T21:23:30.555 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:30 +0000 (0:00:00.045) 0:02:24.835 ************ 2020-05-18T21:23:31.056 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-05-18T21:23:31.058 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => {"changed": true} 2020-05-18T21:23:31.095 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:31 +0000 (0:00:00.539) 0:02:25.375 ************ 2020-05-18T21:23:31.103 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => {"changed": true} 2020-05-18T21:23:31.140 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:31 +0000 (0:00:00.045) 0:02:25.420 ************ 2020-05-18T21:23:31.618 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-05-18T21:23:31.620 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} changed: [smithi155.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-05-18T21:23:31.656 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:31 +0000 (0:00:00.515) 0:02:25.935 ************ 2020-05-18T21:23:31.692 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:31 +0000 (0:00:00.035) 0:02:25.971 ************ 2020-05-18T21:23:31.824 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-05-18T21:23:31.826 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-05-18T21:23:31.862 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:31 +0000 (0:00:00.170) 0:02:26.142 ************ 2020-05-18T21:23:31.871 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-05-18T21:23:31.908 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:31 +0000 (0:00:00.046) 0:02:26.188 ************ 2020-05-18T21:23:32.026 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-05-18T21:23:32.064 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:32 +0000 (0:00:00.155) 0:02:26.343 ************ 2020-05-18T21:23:32.083 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-05-18T21:23:32.120 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:32 +0000 (0:00:00.056) 0:02:26.400 ************ 2020-05-18T21:23:32.447 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-05-18T21:23:32.449 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1214, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-05-18T21:23:32.489 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:32 +0000 (0:00:00.368) 0:02:26.769 ************ 2020-05-18T21:23:32.507 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1214, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-05-18T21:23:32.544 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:32 +0000 (0:00:00.055) 0:02:26.824 ************ 2020-05-18T21:23:32.825 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-05-18T21:23:32.828 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-05-18T21:23:32.864 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:32 +0000 (0:00:00.319) 0:02:27.143 ************ 2020-05-18T21:23:32.913 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-05-18T21:23:32.950 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:32 +0000 (0:00:00.086) 0:02:27.230 ************ 2020-05-18T21:23:33.495 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-05-18T21:23:33.496 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"cache_update_time": 1589836617, "cache_updated": false, "changed": false} 2020-05-18T21:23:33.533 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:33 +0000 (0:00:00.582) 0:02:27.812 ************ 2020-05-18T21:23:33.593 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"cache_update_time": 1589836678, "cache_updated": false, "changed": false} 2020-05-18T21:23:33.655 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:33 +0000 (0:00:00.122) 0:02:27.935 ************ 2020-05-18T21:23:33.828 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-05-18T21:23:33.830 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.142180", "end": "2020-05-18 21:23:34.063832", "rc": 0, "start": "2020-05-18 21:23:33.921652", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2020-05-18T21:23:33.865 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:33 +0000 (0:00:00.209) 0:02:28.145 ************ 2020-05-18T21:23:33.904 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-05-18T21:23:33.906 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:33.939 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:33 +0000 (0:00:00.074) 0:02:28.219 ************ 2020-05-18T21:23:33.947 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-05-18T21:23:33.948 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.130560", "end": "2020-05-18 21:23:34.216852", "rc": 0, "start": "2020-05-18 21:23:34.086292", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2020-05-18T21:23:33.985 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:33 +0000 (0:00:00.045) 0:02:28.265 ************ 2020-05-18T21:23:33.993 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-05-18T21:23:33.995 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:34.032 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:34 +0000 (0:00:00.046) 0:02:28.311 ************ 2020-05-18T21:23:34.038 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-05-18T21:23:34.040 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:34.086 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:34 +0000 (0:00:00.051) 0:02:28.363 ************ 2020-05-18T21:23:34.120 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-05-18T21:23:34.122 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:34.155 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:34 +0000 (0:00:00.072) 0:02:28.435 ************ 2020-05-18T21:23:34.687 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-05-18T21:23:34.689 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"cache_update_time": 1589836617, "cache_updated": false, "changed": false} 2020-05-18T21:23:34.726 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:34 +0000 (0:00:00.571) 0:02:29.006 ************ 2020-05-18T21:23:34.765 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-05-18T21:23:34.767 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:34.803 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:34 +0000 (0:00:00.076) 0:02:29.083 ************ 2020-05-18T21:23:34.812 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-05-18T21:23:34.814 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"cache_update_time": 1589836678, "cache_updated": false, "changed": false} 2020-05-18T21:23:34.877 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:34 +0000 (0:00:00.073) 0:02:29.157 ************ 2020-05-18T21:23:34.920 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:34.954 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:34 +0000 (0:00:00.076) 0:02:29.234 ************ 2020-05-18T21:23:35.191 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-05-18T21:23:35.193 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-05-18T21:23:35.260 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:35 +0000 (0:00:00.306) 0:02:29.540 ************ 2020-05-18T21:23:35.295 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-05-18T21:23:35.297 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:35.345 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:35 +0000 (0:00:00.084) 0:02:29.624 ************ 2020-05-18T21:23:35.355 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-05-18T21:23:35.357 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-05-18T21:23:35.410 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:35 +0000 (0:00:00.065) 0:02:29.690 ************ 2020-05-18T21:23:35.439 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-05-18T21:23:35.441 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:35.503 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:35 +0000 (0:00:00.092) 0:02:29.782 ************ 2020-05-18T21:23:35.575 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-05-18T21:23:35.578 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-05-18 21:20:42 UTC", "ActiveEnterTimestampMonotonic": "14708413", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target systemd-journald.socket system.slice basic.target systemd-tmpfiles-setup.service sysinit.target -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-05-18 21:20:42 UTC", "AssertTimestampMonotonic": "14560009", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-05-18 21:20:42 UTC", "ConditionTimestampMonotonic": "14560008", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2020-05-18T21:23:35.580 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "945", "ExecMainStartTimestamp": "Mon 2020-05-18 21:20:42 UTC", "ExecMainStartTimestampMonotonic": "14708400", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-05-18 21:20:42 UTC", "InactiveExitTimestampMonotonic": "14561443", "InvocationID": "c11dc3d74e554b93a03720b4591d513e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2020-05-18T21:23:35.582 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127783", "LimitNPROCSoft": "127783", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127783", "LimitSIGPENDINGSoft": "127783", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "945", "MemoryAccounting": "yes", "MemoryCurrent": "3805184", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "Requi 2020-05-18T21:23:35.584 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-05-18 21:20:42 UTC", "StateChangeTimestampMonotonic": "14708413", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38335", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-05-18T21:23:35.616 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:35 +0000 (0:00:00.113) 0:02:29.896 ************ 2020-05-18T21:23:35.644 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-05-18T21:23:35.647 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-05-18T21:23:35.681 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:35 +0000 (0:00:00.064) 0:02:29.961 ************ 2020-05-18T21:23:35.716 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-05-18T21:23:35.717 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-05-18 21:20:46 UTC", "ActiveEnterTimestampMonotonic": "14773255", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target basic.target -.mount systemd-journald.socket sysinit.target systemd-tmpfiles-setup.service system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-05-18 21:20:45 UTC", "AssertTimestampMonotonic": "14566963", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-05-18 21:20:45 UTC", "ConditionTimestampMonotonic": "14566961", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2020-05-18T21:23:35.719 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "940", "ExecMainStartTimestamp": "Mon 2020-05-18 21:20:46 UTC", "ExecMainStartTimestampMonotonic": "14773242", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-05-18 21:20:45 UTC", "InactiveExitTimestampMonotonic": "14567991", "InvocationID": "d446a9132aab4d648f4e95d2d9e5fe57", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2020-05-18T21:23:35.721 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127783", "LimitNPROCSoft": "127783", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127783", "LimitSIGPENDINGSoft": "127783", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "940", "MemoryAccounting": "yes", "MemoryCurrent": "3428352", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "Requi 2020-05-18T21:23:35.722 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-05-18 21:20:46 UTC", "StateChangeTimestampMonotonic": "14773255", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38335", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-05-18T21:23:35.760 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:35 +0000 (0:00:00.078) 0:02:30.039 ************ 2020-05-18T21:23:35.769 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-05-18T21:23:35.771 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-05-18T21:23:35.820 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:35 +0000 (0:00:00.060) 0:02:30.100 ************ 2020-05-18T21:23:35.828 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-05-18T21:23:35.830 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-05-18T21:23:35.878 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:35 +0000 (0:00:00.048) 0:02:30.149 ************ 2020-05-18T21:23:35.879 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:35.924 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:35 +0000 (0:00:00.054) 0:02:30.203 ************ 2020-05-18T21:23:35.932 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-05-18T21:23:35.934 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-05-18T21:23:35.971 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:35 +0000 (0:00:00.047) 0:02:30.251 ************ 2020-05-18T21:23:36.000 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:36.036 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:36 +0000 (0:00:00.064) 0:02:30.315 ************ 2020-05-18T21:23:37.008 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-05-18T21:23:37.010 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"cache_update_time": 1589836617, "cache_updated": false, "changed": false} 2020-05-18T21:23:37.045 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:37 +0000 (0:00:01.009) 0:02:31.325 ************ 2020-05-18T21:23:37.085 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-05-18T21:23:37.087 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:37.141 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:37 +0000 (0:00:00.095) 0:02:31.421 ************ 2020-05-18T21:23:37.258 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi155.front.sepia.ceph.com] => {"cache_update_time": 1589836678, "cache_updated": false, "changed": false} 2020-05-18T21:23:37.293 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:37 +0000 (0:00:00.151) 0:02:31.572 ************ 2020-05-18T21:23:37.329 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-05-18T21:23:37.330 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:37.364 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:37 +0000 (0:00:00.071) 0:02:31.644 ************ 2020-05-18T21:23:37.372 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-05-18T21:23:37.374 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-05-18T21:23:37.412 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:37 +0000 (0:00:00.047) 0:02:31.692 ************ 2020-05-18T21:23:37.554 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-05-18T21:23:37.590 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:37 +0000 (0:00:00.178) 0:02:31.870 ************ 2020-05-18T21:23:37.911 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-05-18T21:23:37.912 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-05-18T21:23:37.948 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:37 +0000 (0:00:00.357) 0:02:32.228 ************ 2020-05-18T21:23:38.080 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-05-18T21:23:38.116 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:38 +0000 (0:00:00.167) 0:02:32.396 ************ 2020-05-18T21:23:40.569 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-05-18T21:23:40.571 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2020-05-18T21:23:40.606 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:40 +0000 (0:00:02.489) 0:02:34.886 ************ 2020-05-18T21:23:40.614 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2020-05-18T21:23:40.651 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:40 +0000 (0:00:00.044) 0:02:34.931 ************ 2020-05-18T21:23:41.104 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-05-18T21:23:41.106 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false} 2020-05-18T21:23:41.141 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:41 +0000 (0:00:00.490) 0:02:35.421 ************ 2020-05-18T21:23:41.150 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false} 2020-05-18T21:23:41.196 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:41 +0000 (0:00:00.054) 0:02:35.476 ************ 2020-05-18T21:23:41.204 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-05-18T21:23:41.206 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-05-18T21:23:41.242 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:41 +0000 (0:00:00.046) 0:02:35.522 ************ 2020-05-18T21:23:41.251 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-05-18T21:23:41.290 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:41 +0000 (0:00:00.047) 0:02:35.570 ************ 2020-05-18T21:23:41.443 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-05-18T21:23:41.445 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1589836594.6683898, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1589836593.2083898, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 87101, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1589836593.2083898, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "867956063", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-05-18T21:23:41.483 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:41 +0000 (0:00:00.192) 0:02:35.762 ************ 2020-05-18T21:23:41.503 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1589836605.0163622, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1589836603.5203621, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 87101, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1589836603.5203621, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "867956063", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-05-18T21:23:41.540 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:41 +0000 (0:00:00.057) 0:02:35.820 ************ 2020-05-18T21:23:41.972 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-05-18T21:23:41.974 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"changed": false, "msg": ""} ok: [smithi155.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-05-18T21:23:42.010 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:42 +0000 (0:00:00.469) 0:02:36.290 ************ 2020-05-18T21:23:42.065 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:42 +0000 (0:00:00.055) 0:02:36.345 ************ 2020-05-18T21:23:42.074 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-05-18T21:23:42.076 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-05-18T21:23:42.113 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:42 +0000 (0:00:00.047) 0:02:36.392 ************ 2020-05-18T21:23:42.122 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-05-18T21:23:42.159 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:42 +0000 (0:00:00.046) 0:02:36.439 ************ 2020-05-18T21:23:42.166 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-05-18T21:23:42.168 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:42.211 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:42 +0000 (0:00:00.051) 0:02:36.491 ************ 2020-05-18T21:23:42.220 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:42.259 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:42 +0000 (0:00:00.048) 0:02:36.539 ************ 2020-05-18T21:23:42.401 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-05-18T21:23:42.403 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-05-18T21:23:42.444 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:42 +0000 (0:00:00.184) 0:02:36.724 ************ 2020-05-18T21:23:42.463 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-05-18T21:23:42.504 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:42 +0000 (0:00:00.060) 0:02:36.784 ************ 2020-05-18T21:23:42.659 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-05-18T21:23:42.661 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-05-18T21:23:42.696 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:42 +0000 (0:00:00.192) 0:02:36.976 ************ 2020-05-18T21:23:42.707 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-05-18T21:23:42.744 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:42 +0000 (0:00:00.048) 0:02:37.024 ************ 2020-05-18T21:23:42.751 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-05-18T21:23:42.753 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:42.789 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:42 +0000 (0:00:00.044) 0:02:37.069 ************ 2020-05-18T21:23:42.797 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:42.834 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:42 +0000 (0:00:00.044) 0:02:37.114 ************ 2020-05-18T21:23:42.846 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi063.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi063.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:42.855 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:42.856 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:42.893 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:42 +0000 (0:00:00.059) 0:02:37.173 ************ 2020-05-18T21:23:42.900 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:42.902 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:42.902 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-05-18T21:23:42.940 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:42 +0000 (0:00:00.046) 0:02:37.220 ************ 2020-05-18T21:23:42.948 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-05-18T21:23:42.949 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:42.951 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:42.952 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:42.952 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:42.952 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:42.992 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:42 +0000 (0:00:00.052) 0:02:37.272 ************ 2020-05-18T21:23:43.003 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.004 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.005 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi155.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.016 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.056 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:43 +0000 (0:00:00.063) 0:02:37.336 ************ 2020-05-18T21:23:43.064 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-05-18T21:23:43.066 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.110 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:43 +0000 (0:00:00.053) 0:02:37.390 ************ 2020-05-18T21:23:43.119 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.158 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:43 +0000 (0:00:00.048) 0:02:37.438 ************ 2020-05-18T21:23:43.166 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-05-18T21:23:43.175 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.206 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:43 +0000 (0:00:00.047) 0:02:37.485 ************ 2020-05-18T21:23:43.214 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.251 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:43 +0000 (0:00:00.045) 0:02:37.531 ************ 2020-05-18T21:23:43.259 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-05-18T21:23:43.261 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.299 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:43 +0000 (0:00:00.047) 0:02:37.578 ************ 2020-05-18T21:23:43.307 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.345 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:43 +0000 (0:00:00.046) 0:02:37.625 ************ 2020-05-18T21:23:43.352 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-05-18T21:23:43.354 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.390 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:43 +0000 (0:00:00.044) 0:02:37.670 ************ 2020-05-18T21:23:43.398 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.434 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:43 +0000 (0:00:00.044) 0:02:37.714 ************ 2020-05-18T21:23:43.443 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-05-18T21:23:43.445 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.493 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:43 +0000 (0:00:00.058) 0:02:37.773 ************ 2020-05-18T21:23:43.501 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.540 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:43 +0000 (0:00:00.046) 0:02:37.820 ************ 2020-05-18T21:23:43.547 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-05-18T21:23:43.548 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.586 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:43 +0000 (0:00:00.046) 0:02:37.866 ************ 2020-05-18T21:23:43.594 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.638 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:43 +0000 (0:00:00.052) 0:02:37.918 ************ 2020-05-18T21:23:43.646 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.686 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:43 +0000 (0:00:00.047) 0:02:37.966 ************ 2020-05-18T21:23:43.694 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.734 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:43 +0000 (0:00:00.047) 0:02:38.014 ************ 2020-05-18T21:23:43.741 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-05-18T21:23:43.743 INFO:teuthology.task.ansible.out:skipping: [smithi063.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.779 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:43 +0000 (0:00:00.045) 0:02:38.059 ************ 2020-05-18T21:23:43.786 INFO:teuthology.task.ansible.out:skipping: [smithi155.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-05-18T21:23:43.824 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:43 +0000 (0:00:00.045) 0:02:38.104 ************ 2020-05-18T21:23:44.009 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-05-18T21:23:44.011 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011245", "end": "2020-05-18 21:23:44.226469", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-05-18 21:23:44.215224", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:44.066 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010991", "end": "2020-05-18 21:23:44.329106", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-05-18 21:23:44.318115", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:44.200 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006258", "end": "2020-05-18 21:23:44.427967", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-05-18 21:23:44.421709", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:44.274 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006176", "end": "2020-05-18 21:23:44.551850", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-05-18 21:23:44.545674", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:44.389 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005565", "end": "2020-05-18 21:23:44.601065", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-05-18 21:23:44.595500", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:44.459 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005592", "end": "2020-05-18 21:23:44.728432", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-05-18 21:23:44.722840", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:44.617 INFO:teuthology.task.ansible.out:ok: [smithi063.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.038536", "end": "2020-05-18 21:23:44.841866", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-05-18 21:23:44.803330", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:44.683 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:44 +0000 (0:00:00.858) 0:02:38.963 ************ 2020-05-18T21:23:44.704 INFO:teuthology.task.ansible.out:ok: [smithi155.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.025039", "end": "2020-05-18 21:23:44.928211", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-05-18 21:23:44.903172", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-05-18T21:23:44.743 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:44 +0000 (0:00:00.060) 0:02:39.023 ************ 2020-05-18T21:23:44.751 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-05-18T21:23:44.788 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:44 +0000 (0:00:00.045) 0:02:39.068 ************ 2020-05-18T21:23:44.835 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:44 +0000 (0:00:00.046) 0:02:39.115 ************ 2020-05-18T21:23:44.981 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-05-18T21:23:44.983 INFO:teuthology.task.ansible.out:changed: [smithi063.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-05-18T21:23:45.033 INFO:teuthology.task.ansible.out:changed: [smithi155.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-05-18T21:23:45.158 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-05-18T21:23:45.160 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** 2020-05-18T21:23:45.162 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-05-18T21:23:45.163 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2020-05-18T21:23:45.163 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi063.front.sepia.ceph.com : ok=114 changed=29 unreachable=0 failed=0 skipped=170 rescued=0 ignored=0 smithi155.front.sepia.ceph.com : ok=114 changed=29 unreachable=0 failed=0 skipped=170 rescued=0 ignored=0 2020-05-18T21:23:45.163 INFO:teuthology.task.ansible.out:Monday 18 May 2020 21:23:45 +0000 (0:00:00.328) 0:02:39.443 ************ =============================================================================== 2020-05-18T21:23:45.164 INFO:teuthology.task.ansible.out:users : Create all admin users with sudo access. ----------------------- 17.96s users : Update authorized_keys using the keys repo --------------------- 16.34s testnode : Ensure packages are not present. ---------------------------- 11.89s testnode : Upgrade packages -------------------------------------------- 11.88s testnode : Install packages --------------------------------------------- 9.54s 2020-05-18T21:23:45.164 INFO:teuthology.task.ansible.out:testnode : Zap all non-root disks --------------------------------------- 8.08s users : Remove revoked users -------------------------------------------- 5.74s testnode : Install apt keys --------------------------------------------- 2.52s testnode : Install packages via pip ------------------------------------- 2.49s Gathering Facts --------------------------------------------------------- 2.28s testnode : Create logical volume(s) ------------------------------------- 2.28s testnode : Update apt cache. -------------------------------------------- 1.91s common : Update apt cache ----------------------------------------------- 1.59s users : Update authorized_keys for each user with literal keys ---------- 1.38s 2020-05-18T21:23:45.165 INFO:teuthology.task.ansible.out:testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.38s Gathering Facts --------------------------------------------------------- 1.20s testnode : Set the system's hostname ------------------------------- 2020-05-18T21:23:45.166 INFO:teuthology.task.ansible.out:----- 1.04s testnode : Install python-pip on apt based systems. --------------------- 1.01s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.91s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.86s 2020-05-18T21:23:45.527 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi063.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com')] 2020-05-18T21:23:45.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-05-18T21:23:45.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:23:45.576 INFO:teuthology.orchestra.run.smithi063:> true 2020-05-18T21:23:45.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-05-18T21:23:45.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-05-18T21:23:45.738 INFO:teuthology.orchestra.run.smithi155:> true 2020-05-18T21:23:45.857 INFO:teuthology.run_tasks:Running task clock... 2020-05-18T21:23:45.871 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-05-18T21:23:45.872 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-05-18T21:23:45.874 INFO:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-05-18T21:23:45.913 INFO:teuthology.orchestra.run.smithi063.stdout:18 May 21:23:46 ntpd[8260]: ntpd 4.2.8p12@1.3728-o (1): Starting 2020-05-18T21:23:45.913 INFO:teuthology.orchestra.run.smithi063.stdout:18 May 21:23:46 ntpd[8260]: Command line: ntpd -gq 2020-05-18T21:23:45.915 INFO:teuthology.orchestra.run.smithi063.stdout:18 May 21:23:46 ntpd[8260]: proto: precision = 0.082 usec (-23) 2020-05-18T21:23:45.915 INFO:teuthology.orchestra.run.smithi063.stdout:18 May 21:23:46 ntpd[8260]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-05-18T21:23:45.916 INFO:teuthology.orchestra.run.smithi063.stdout:18 May 21:23:46 ntpd[8260]: restrict ::: KOD does nothing without LIMITED. 2020-05-18T21:23:45.916 INFO:teuthology.orchestra.run.smithi063.stdout:18 May 21:23:46 ntpd[8260]: Listen and drop on 0 v6wildcard [::]:123 2020-05-18T21:23:45.916 INFO:teuthology.orchestra.run.smithi063.stdout:18 May 21:23:46 ntpd[8260]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-05-18T21:23:45.916 INFO:teuthology.orchestra.run.smithi063.stdout:18 May 21:23:46 ntpd[8260]: Listen normally on 2 lo 127.0.0.1:123 2020-05-18T21:23:45.917 INFO:teuthology.orchestra.run.smithi063.stdout:18 May 21:23:46 ntpd[8260]: Listen normally on 3 enp3s0f1 172.21.15.63:123 2020-05-18T21:23:45.917 INFO:teuthology.orchestra.run.smithi063.stdout:18 May 21:23:46 ntpd[8260]: Listen normally on 4 lo [::1]:123 2020-05-18T21:23:45.917 INFO:teuthology.orchestra.run.smithi063.stdout:18 May 21:23:46 ntpd[8260]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feb6:f8d7%5]:123 2020-05-18T21:23:45.917 INFO:teuthology.orchestra.run.smithi063.stdout:18 May 21:23:46 ntpd[8260]: Listening on routing socket on fd #22 for interface updates 2020-05-18T21:23:45.917 INFO:teuthology.orchestra.run.smithi063.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-05-18T21:23:45.918 INFO:teuthology.orchestra.run.smithi063.stderr:restrict ::: KOD does nothing without LIMITED. 2020-05-18T21:23:46.915 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:47 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:46.915 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:47 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:46.915 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:47 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:46.916 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:47 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:46.916 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:47 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:46.916 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:47 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:46.917 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:47 ntpd[8260]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:46.917 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:47 ntpd[8260]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:46.917 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:47 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:46.918 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:47 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:46.918 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:47 ntpd[8260]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:46.918 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:47 ntpd[8260]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:48.915 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:49 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:48.916 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:49 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:48.916 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:49 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:48.916 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:49 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:48.917 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:49 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:48.917 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:49 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:48.918 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:49 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:48.918 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:49 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:48.918 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:49 ntpd[8260]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:48.919 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:49 ntpd[8260]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:48.919 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:49 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:48.919 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:49 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:48.920 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:49 ntpd[8260]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:48.920 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:49 ntpd[8260]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:48.920 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:49 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:48.921 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:49 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:48.921 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:49 ntpd[8260]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:48.921 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:49 ntpd[8260]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:49.913 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:50 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:49.914 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:50 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:49.914 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:50 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:49.914 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:50 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:49.914 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:50 ntpd[8260]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:49.915 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:50 ntpd[8260]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:50.914 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:51 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:50.915 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:51 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:50.915 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:51 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:50.915 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:51 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:50.915 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:51 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:50.916 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:51 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:50.916 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:51 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:50.916 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:51 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:50.916 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:51 ntpd[8260]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:50.916 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:51 ntpd[8260]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:50.916 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:51 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:50.917 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:51 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:50.917 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:51 ntpd[8260]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:50.917 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:51 ntpd[8260]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:50.917 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:51 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:50.917 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:51 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:50.918 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:51 ntpd[8260]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:50.918 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:51 ntpd[8260]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:51.913 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:52 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:51.913 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:52 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:51.914 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:52 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:51.914 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:52 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:51.914 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:52 ntpd[8260]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:51.914 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:52 ntpd[8260]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:52.914 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:53 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:52.914 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:53 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:52.914 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:53 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:52.915 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:53 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:52.915 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:53 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:52.915 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:53 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:52.915 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:53 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:52.915 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:53 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:52.916 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:53 ntpd[8260]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:52.916 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:53 ntpd[8260]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:52.916 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:53 ntpd[8260]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:52.916 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:53 ntpd[8260]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:52.916 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:53 ntpd[8260]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:52.917 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:53 ntpd[8260]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:52.917 INFO:teuthology.orchestra.run.smithi063.stderr:18 May 21:23:52 ntpd[8260]: can't open /var/log/ntpstats/loopstats.20200518: Permission denied 2020-05-18T21:23:52.917 INFO:teuthology.orchestra.run.smithi063.stdout:18 May 21:23:52 ntpd[8260]: ntpd: time set -0.266301 s 2020-05-18T21:23:52.917 INFO:teuthology.orchestra.run.smithi063.stdout:ntpd: time set -0.266301s 2020-05-18T21:23:52.986 INFO:teuthology.orchestra.run.smithi063.stdout: remote refid st t when poll reach delay offset jitter 2020-05-18T21:23:52.986 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================== 2020-05-18T21:23:52.986 INFO:teuthology.orchestra.run.smithi063.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-05-18T21:23:52.987 INFO:teuthology.orchestra.run.smithi063.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-05-18T21:23:52.987 INFO:teuthology.orchestra.run.smithi063.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-05-18T21:23:52.987 INFO:teuthology.orchestra.run.smithi063.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-05-18T21:23:52.988 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-05-18T21:23:52.988 INFO:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-05-18T21:23:53.024 INFO:teuthology.orchestra.run.smithi155.stdout:18 May 21:23:53 ntpd[8208]: ntpd 4.2.8p12@1.3728-o (1): Starting 2020-05-18T21:23:53.024 INFO:teuthology.orchestra.run.smithi155.stdout:18 May 21:23:53 ntpd[8208]: Command line: ntpd -gq 2020-05-18T21:23:53.025 INFO:teuthology.orchestra.run.smithi155.stdout:18 May 21:23:53 ntpd[8208]: proto: precision = 0.085 usec (-23) 2020-05-18T21:23:53.026 INFO:teuthology.orchestra.run.smithi155.stdout:18 May 21:23:53 ntpd[8208]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-05-18T21:23:53.026 INFO:teuthology.orchestra.run.smithi155.stdout:18 May 21:23:53 ntpd[8208]: restrict ::: KOD does nothing without LIMITED. 2020-05-18T21:23:53.026 INFO:teuthology.orchestra.run.smithi155.stdout:18 May 21:23:53 ntpd[8208]: Listen and drop on 0 v6wildcard [::]:123 2020-05-18T21:23:53.026 INFO:teuthology.orchestra.run.smithi155.stdout:18 May 21:23:53 ntpd[8208]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-05-18T21:23:53.027 INFO:teuthology.orchestra.run.smithi155.stdout:18 May 21:23:53 ntpd[8208]: Listen normally on 2 lo 127.0.0.1:123 2020-05-18T21:23:53.027 INFO:teuthology.orchestra.run.smithi155.stdout:18 May 21:23:53 ntpd[8208]: Listen normally on 3 enp3s0f1 172.21.15.155:123 2020-05-18T21:23:53.027 INFO:teuthology.orchestra.run.smithi155.stdout:18 May 21:23:53 ntpd[8208]: Listen normally on 4 lo [::1]:123 2020-05-18T21:23:53.027 INFO:teuthology.orchestra.run.smithi155.stdout:18 May 21:23:53 ntpd[8208]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6ded%5]:123 2020-05-18T21:23:53.027 INFO:teuthology.orchestra.run.smithi155.stdout:18 May 21:23:53 ntpd[8208]: Listening on routing socket on fd #22 for interface updates 2020-05-18T21:23:53.028 INFO:teuthology.orchestra.run.smithi155.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-05-18T21:23:53.028 INFO:teuthology.orchestra.run.smithi155.stderr:restrict ::: KOD does nothing without LIMITED. 2020-05-18T21:23:54.024 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:54 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:54.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:54 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:54.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:54 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:54.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:54 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:54.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:54 ntpd[8208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:54.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:54 ntpd[8208]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:55.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:55 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:55.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:55 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:55.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:55 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:55.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:55 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:55.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:55 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:55.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:55 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:55.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:55 ntpd[8208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:55.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:55 ntpd[8208]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:55.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:55 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:55.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:55 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:55.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:55 ntpd[8208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:55.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:55 ntpd[8208]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:56.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:56 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:56.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:56 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:56.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:56 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:56.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:56 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:56.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:56 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:56.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:56 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:56.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:56 ntpd[8208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:56.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:56 ntpd[8208]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:56.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:56 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:56.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:56 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:56.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:56 ntpd[8208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:56.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:56 ntpd[8208]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:57.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:57 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:57.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:57 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:57.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:57 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:57.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:57 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:57.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:57 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:57.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:57 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:57.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:57 ntpd[8208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:57.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:57 ntpd[8208]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:57.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:57 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:57.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:57 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:57.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:57 ntpd[8208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:57.028 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:57 ntpd[8208]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:58.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:58 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:58.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:58 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:58.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:58 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:58.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:58 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:58.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:58 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:58.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:58 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:58.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:58 ntpd[8208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:58.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:58 ntpd[8208]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:58.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:58 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:58.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:58 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:58.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:58 ntpd[8208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:58.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:58 ntpd[8208]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:59.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:59 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:59.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:59 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:59.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:59 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:59.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:59 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:59.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:59 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:59.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:59 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:59.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:59 ntpd[8208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:59.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:59 ntpd[8208]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:23:59.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:59 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:23:59.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:59 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:23:59.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:59 ntpd[8208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:23:59.027 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:23:59 ntpd[8208]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:24:00.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:24:00 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:24:00.025 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:24:00 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:24:00.026 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:24:00 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:24:00.031 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:24:00 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:24:00.031 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:24:00 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:24:00.032 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:24:00 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:24:00.032 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:24:00 ntpd[8208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:24:00.032 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:24:00 ntpd[8208]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:24:00.032 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:24:00 ntpd[8208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-05-18T21:24:00.032 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:24:00 ntpd[8208]: can't open /var/log/ntpstats/rawstats.20200518: Permission denied 2020-05-18T21:24:00.033 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:24:00 ntpd[8208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-05-18T21:24:00.033 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:24:00 ntpd[8208]: can't open /var/log/ntpstats/peerstats.20200518: Permission denied 2020-05-18T21:24:00.033 INFO:teuthology.orchestra.run.smithi155.stderr:18 May 21:24:00 ntpd[8208]: can't open /var/log/ntpstats/loopstats.20200518: Permission denied 2020-05-18T21:24:00.033 INFO:teuthology.orchestra.run.smithi155.stdout:18 May 21:24:00 ntpd[8208]: ntpd: time set -0.309060 s 2020-05-18T21:24:00.033 INFO:teuthology.orchestra.run.smithi155.stdout:ntpd: time set -0.309060s 2020-05-18T21:24:00.103 INFO:teuthology.orchestra.run.smithi155.stdout: remote refid st t when poll reach delay offset jitter 2020-05-18T21:24:00.103 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================== 2020-05-18T21:24:00.104 INFO:teuthology.orchestra.run.smithi155.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-05-18T21:24:00.104 INFO:teuthology.orchestra.run.smithi155.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-05-18T21:24:00.104 INFO:teuthology.orchestra.run.smithi155.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-05-18T21:24:00.104 INFO:teuthology.orchestra.run.smithi155.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-05-18T21:24:00.106 INFO:teuthology.run_tasks:Running task install... 2020-05-18T21:24:00.114 DEBUG:teuthology.task.install:project ceph 2020-05-18T21:24:00.115 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '543315c934420269aa12ef2f9dec2c9eadb4fa6f'}} 2020-05-18T21:24:00.116 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '543315c934420269aa12ef2f9dec2c9eadb4fa6f'} 2020-05-18T21:24:00.116 INFO:teuthology.task.install:Using flavor: basic 2020-05-18T21:24:00.123 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-05-18T21:24:00.123 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-05-18T21:24:00.124 INFO:teuthology.orchestra.run.smithi063:> sudo lsb_release -is 2020-05-18T21:24:00.174 INFO:teuthology.orchestra.run.smithi063.stdout:Ubuntu 2020-05-18T21:24:00.179 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-05-18T21:24:00.180 INFO:teuthology.orchestra.run.smithi155:> sudo lsb_release -is 2020-05-18T21:24:00.181 INFO:teuthology.orchestra.run.smithi063:> sudo apt-key list | grep Ceph 2020-05-18T21:24:00.232 INFO:teuthology.orchestra.run.smithi155.stdout:Ubuntu 2020-05-18T21:24:00.237 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-05-18T21:24:00.237 INFO:teuthology.orchestra.run.smithi155:> sudo apt-key list | grep Ceph 2020-05-18T21:24:00.280 INFO:teuthology.orchestra.run.smithi063.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-05-18T21:24:00.335 INFO:teuthology.orchestra.run.smithi155.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-05-18T21:24:00.346 INFO:teuthology.orchestra.run.smithi063.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-05-18T21:24:00.346 INFO:teuthology.orchestra.run.smithi063.stdout:uid [ unknown] Ceph.com (release key) 2020-05-18T21:24:00.347 INFO:teuthology.orchestra.run.smithi063:> sudo lsb_release -is 2020-05-18T21:24:00.396 INFO:teuthology.orchestra.run.smithi063.stdout:Ubuntu 2020-05-18T21:24:00.401 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-05-18T21:24:00.402 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2020-05-18T21:24:00.402 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2020-05-18T21:24:00.403 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=543315c934420269aa12ef2f9dec2c9eadb4fa6f 2020-05-18T21:24:00.475 INFO:teuthology.orchestra.run.smithi155.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-05-18T21:24:00.476 INFO:teuthology.orchestra.run.smithi155.stdout:uid [ unknown] Ceph.com (release key) 2020-05-18T21:24:00.476 INFO:teuthology.orchestra.run.smithi155:> sudo lsb_release -is 2020-05-18T21:24:00.524 INFO:teuthology.orchestra.run.smithi155.stdout:Ubuntu 2020-05-18T21:24:00.530 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-05-18T21:24:00.530 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2020-05-18T21:24:00.530 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2020-05-18T21:24:00.531 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=543315c934420269aa12ef2f9dec2c9eadb4fa6f 2020-05-18T21:24:00.660 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default/ 2020-05-18T21:24:00.661 INFO:teuthology.task.install.deb:Package version is 16.0.0-1640-g543315c9344-1focal 2020-05-18T21:24:00.766 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default/ 2020-05-18T21:24:00.767 INFO:teuthology.task.install.deb:Package version is 16.0.0-1640-g543315c9344-1focal 2020-05-18T21:24:01.067 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2020-05-18T21:24:01.116 INFO:teuthology.orchestra.run.smithi063:> sudo apt-get update 2020-05-18T21:24:01.175 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2020-05-18T21:24:01.224 INFO:teuthology.orchestra.run.smithi155:> sudo apt-get update 2020-05-18T21:24:01.374 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2020-05-18T21:24:01.393 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2020-05-18T21:24:01.401 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2020-05-18T21:24:01.462 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2020-05-18T21:24:01.484 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2020-05-18T21:24:01.543 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2020-05-18T21:24:01.565 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2020-05-18T21:24:01.638 INFO:teuthology.orchestra.run.smithi063.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal InRelease 2020-05-18T21:24:01.646 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2020-05-18T21:24:01.734 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal Release [7,671 B] 2020-05-18T21:24:01.743 INFO:teuthology.orchestra.run.smithi155.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal InRelease 2020-05-18T21:24:01.833 INFO:teuthology.orchestra.run.smithi063.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal Release.gpg 2020-05-18T21:24:01.839 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal Release [7,671 B] 2020-05-18T21:24:01.928 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main i386 Packages [3,069 B] 2020-05-18T21:24:01.936 INFO:teuthology.orchestra.run.smithi155.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal Release.gpg 2020-05-18T21:24:02.020 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main i386 Packages [3,069 B] 2020-05-18T21:24:02.023 INFO:teuthology.orchestra.run.smithi063.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2020-05-18T21:24:02.114 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2020-05-18T21:24:02.123 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 26.6 kB in 1s (31.7 kB/s) 2020-05-18T21:24:02.217 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 26.6 kB in 1s (32.3 kB/s) 2020-05-18T21:24:02.772 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2020-05-18T21:24:02.793 INFO:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.0.0-1640-g543315c9344-1focal cephadm=16.0.0-1640-g543315c9344-1focal ceph-mds=16.0.0-1640-g543315c9344-1focal ceph-mgr=16.0.0-1640-g543315c9344-1focal ceph-common=16.0.0-1640-g543315c9344-1focal ceph-fuse=16.0.0-1640-g543315c9344-1focal ceph-test=16.0.0-1640-g543315c9344-1focal radosgw=16.0.0-1640-g543315c9344-1focal python3-rados=16.0.0-1640-g543315c9344-1focal python3-rgw=16.0.0-1640-g543315c9344-1focal python3-cephfs=16.0.0-1640-g543315c9344-1focal python3-rbd=16.0.0-1640-g543315c9344-1focal libcephfs2=16.0.0-1640-g543315c9344-1focal libcephfs-dev=16.0.0-1640-g543315c9344-1focal librados2=16.0.0-1640-g543315c9344-1focal librbd1=16.0.0-1640-g543315c9344-1focal rbd-fuse=16.0.0-1640-g543315c9344-1focal python3-cephfs=16.0.0-1640-g543315c9344-1focal cephfs-shell=16.0.0-1640-g543315c9344-1focal 2020-05-18T21:24:02.832 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2020-05-18T21:24:02.852 INFO:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.0.0-1640-g543315c9344-1focal cephadm=16.0.0-1640-g543315c9344-1focal ceph-mds=16.0.0-1640-g543315c9344-1focal ceph-mgr=16.0.0-1640-g543315c9344-1focal ceph-common=16.0.0-1640-g543315c9344-1focal ceph-fuse=16.0.0-1640-g543315c9344-1focal ceph-test=16.0.0-1640-g543315c9344-1focal radosgw=16.0.0-1640-g543315c9344-1focal python3-rados=16.0.0-1640-g543315c9344-1focal python3-rgw=16.0.0-1640-g543315c9344-1focal python3-cephfs=16.0.0-1640-g543315c9344-1focal python3-rbd=16.0.0-1640-g543315c9344-1focal libcephfs2=16.0.0-1640-g543315c9344-1focal libcephfs-dev=16.0.0-1640-g543315c9344-1focal librados2=16.0.0-1640-g543315c9344-1focal librbd1=16.0.0-1640-g543315c9344-1focal rbd-fuse=16.0.0-1640-g543315c9344-1focal python3-cephfs=16.0.0-1640-g543315c9344-1focal cephfs-shell=16.0.0-1640-g543315c9344-1focal 2020-05-18T21:24:02.888 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2020-05-18T21:24:02.941 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2020-05-18T21:24:03.017 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2020-05-18T21:24:03.018 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2020-05-18T21:24:03.074 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2020-05-18T21:24:03.075 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2020-05-18T21:24:03.153 INFO:teuthology.orchestra.run.smithi063.stdout:The following package was automatically installed and is no longer required: 2020-05-18T21:24:03.155 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-iostreams1.71.0 2020-05-18T21:24:03.155 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove it. 2020-05-18T21:24:03.155 INFO:teuthology.orchestra.run.smithi063.stdout:The following additional packages will be installed: 2020-05-18T21:24:03.155 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-05-18T21:24:03.155 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-05-18T21:24:03.156 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore 2020-05-18T21:24:03.156 INFO:teuthology.orchestra.run.smithi063.stdout: liblbfgsb0 libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 2020-05-18T21:24:03.156 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1 librdkafka1 librgw2 python-pastedeploy-tpl 2020-05-18T21:24:03.156 INFO:teuthology.orchestra.run.smithi063.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-bs4 2020-05-18T21:24:03.156 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2020-05-18T21:24:03.157 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-decorator 2020-05-18T21:24:03.157 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth python3-html5lib python3-joblib python3-json-pointer 2020-05-18T21:24:03.157 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch python3-kubernetes python3-logutils python3-lxml 2020-05-18T21:24:03.157 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako python3-markupsafe python3-openssl python3-packaging 2020-05-18T21:24:03.157 INFO:teuthology.orchestra.run.smithi063.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2020-05-18T21:24:03.158 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2020-05-18T21:24:03.158 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2020-05-18T21:24:03.159 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2020-05-18T21:24:03.159 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy python3-simplegeneric python3-singledispatch python3-sklearn 2020-05-18T21:24:03.159 INFO:teuthology.orchestra.run.smithi063.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2020-05-18T21:24:03.159 INFO:teuthology.orchestra.run.smithi063.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2020-05-18T21:24:03.159 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2020-05-18T21:24:03.160 INFO:teuthology.orchestra.run.smithi063.stdout:Suggested packages: 2020-05-18T21:24:03.160 INFO:teuthology.orchestra.run.smithi063.stdout: python3-influxdb python-attr-doc python3-genshi python3-lxml-dbg 2020-05-18T21:24:03.160 INFO:teuthology.orchestra.run.smithi063.stdout: python-lxml-doc python3-beaker python-mako-doc python-openssl-doc 2020-05-18T21:24:03.161 INFO:teuthology.orchestra.run.smithi063.stdout: python3-openssl-dbg httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2020-05-18T21:24:03.161 INFO:teuthology.orchestra.run.smithi063.stdout: libjs-mochikit python-pecan-doc python-psutil-doc subversion 2020-05-18T21:24:03.161 INFO:teuthology.orchestra.run.smithi063.stdout: python-pyinotify-doc python-scipy-doc python3-dap python-sklearn-doc 2020-05-18T21:24:03.161 INFO:teuthology.orchestra.run.smithi063.stdout: ipython3 python-waitress-doc python-webob-doc python-webtest-doc 2020-05-18T21:24:03.161 INFO:teuthology.orchestra.run.smithi063.stdout: python-werkzeug-doc python3-termcolor python3-watchdog 2020-05-18T21:24:03.162 INFO:teuthology.orchestra.run.smithi063.stdout:Recommended packages: 2020-05-18T21:24:03.162 INFO:teuthology.orchestra.run.smithi063.stdout: btrfs-tools 2020-05-18T21:24:03.203 INFO:teuthology.orchestra.run.smithi155.stdout:The following package was automatically installed and is no longer required: 2020-05-18T21:24:03.205 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.71.0 2020-05-18T21:24:03.205 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove it. 2020-05-18T21:24:03.206 INFO:teuthology.orchestra.run.smithi155.stdout:The following additional packages will be installed: 2020-05-18T21:24:03.206 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-05-18T21:24:03.206 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-05-18T21:24:03.206 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore 2020-05-18T21:24:03.206 INFO:teuthology.orchestra.run.smithi155.stdout: liblbfgsb0 libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 2020-05-18T21:24:03.207 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 librdkafka1 librgw2 python-pastedeploy-tpl 2020-05-18T21:24:03.207 INFO:teuthology.orchestra.run.smithi155.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-bs4 2020-05-18T21:24:03.207 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2020-05-18T21:24:03.207 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-decorator 2020-05-18T21:24:03.207 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth python3-html5lib python3-joblib python3-json-pointer 2020-05-18T21:24:03.208 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch python3-kubernetes python3-logutils python3-lxml 2020-05-18T21:24:03.208 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako python3-markupsafe python3-openssl python3-packaging 2020-05-18T21:24:03.208 INFO:teuthology.orchestra.run.smithi155.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2020-05-18T21:24:03.208 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2020-05-18T21:24:03.208 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2020-05-18T21:24:03.208 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2020-05-18T21:24:03.209 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy python3-simplegeneric python3-singledispatch python3-sklearn 2020-05-18T21:24:03.209 INFO:teuthology.orchestra.run.smithi155.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2020-05-18T21:24:03.209 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2020-05-18T21:24:03.209 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2020-05-18T21:24:03.210 INFO:teuthology.orchestra.run.smithi155.stdout:Suggested packages: 2020-05-18T21:24:03.210 INFO:teuthology.orchestra.run.smithi155.stdout: python3-influxdb python-attr-doc python3-genshi python3-lxml-dbg 2020-05-18T21:24:03.210 INFO:teuthology.orchestra.run.smithi155.stdout: python-lxml-doc python3-beaker python-mako-doc python-openssl-doc 2020-05-18T21:24:03.210 INFO:teuthology.orchestra.run.smithi155.stdout: python3-openssl-dbg httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2020-05-18T21:24:03.211 INFO:teuthology.orchestra.run.smithi155.stdout: libjs-mochikit python-pecan-doc python-psutil-doc subversion 2020-05-18T21:24:03.211 INFO:teuthology.orchestra.run.smithi155.stdout: python-pyinotify-doc python-scipy-doc python3-dap python-sklearn-doc 2020-05-18T21:24:03.211 INFO:teuthology.orchestra.run.smithi155.stdout: ipython3 python-waitress-doc python-webob-doc python-webtest-doc 2020-05-18T21:24:03.211 INFO:teuthology.orchestra.run.smithi155.stdout: python-werkzeug-doc python3-termcolor python3-watchdog 2020-05-18T21:24:03.211 INFO:teuthology.orchestra.run.smithi155.stdout:Recommended packages: 2020-05-18T21:24:03.212 INFO:teuthology.orchestra.run.smithi155.stdout: btrfs-tools 2020-05-18T21:24:03.252 INFO:teuthology.orchestra.run.smithi063.stdout:The following NEW packages will be installed: 2020-05-18T21:24:03.252 INFO:teuthology.orchestra.run.smithi063.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2020-05-18T21:24:03.252 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-05-18T21:24:03.252 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-05-18T21:24:03.253 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq 2020-05-18T21:24:03.254 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2020-05-18T21:24:03.255 INFO:teuthology.orchestra.run.smithi063.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2020-05-18T21:24:03.255 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka1 librgw2 python-pastedeploy-tpl python3-atomicwrites python3-attr 2020-05-18T21:24:03.255 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt python3-bs4 python3-cachetools python3-ceph-argparse 2020-05-18T21:24:03.255 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2020-05-18T21:24:03.256 INFO:teuthology.orchestra.run.smithi063.stdout: python3-colorama python3-decorator python3-google-auth python3-html5lib 2020-05-18T21:24:03.256 INFO:teuthology.orchestra.run.smithi063.stdout: python3-joblib python3-json-pointer python3-jsonpatch python3-kubernetes 2020-05-18T21:24:03.256 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2020-05-18T21:24:03.256 INFO:teuthology.orchestra.run.smithi063.stdout: python3-openssl python3-packaging python3-paste python3-pastedeploy 2020-05-18T21:24:03.257 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pastescript python3-pecan python3-pluggy python3-prettytable 2020-05-18T21:24:03.257 INFO:teuthology.orchestra.run.smithi063.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2020-05-18T21:24:03.257 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyinotify python3-pyperclip python3-pytest python3-rados python3-rbd 2020-05-18T21:24:03.258 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2020-05-18T21:24:03.258 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa python3-scipy python3-simplegeneric python3-singledispatch 2020-05-18T21:24:03.258 INFO:teuthology.orchestra.run.smithi063.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2020-05-18T21:24:03.258 INFO:teuthology.orchestra.run.smithi063.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2020-05-18T21:24:03.258 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket python3-webtest python3-werkzeug radosgw rbd-fuse socat 2020-05-18T21:24:03.259 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet 2020-05-18T21:24:03.259 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be upgraded: 2020-05-18T21:24:03.259 INFO:teuthology.orchestra.run.smithi063.stdout: librados2 librbd1 2020-05-18T21:24:03.300 INFO:teuthology.orchestra.run.smithi155.stdout:The following NEW packages will be installed: 2020-05-18T21:24:03.301 INFO:teuthology.orchestra.run.smithi155.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2020-05-18T21:24:03.301 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-05-18T21:24:03.301 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-05-18T21:24:03.302 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq 2020-05-18T21:24:03.302 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2020-05-18T21:24:03.302 INFO:teuthology.orchestra.run.smithi155.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2020-05-18T21:24:03.303 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka1 librgw2 python-pastedeploy-tpl python3-atomicwrites python3-attr 2020-05-18T21:24:03.303 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt python3-bs4 python3-cachetools python3-ceph-argparse 2020-05-18T21:24:03.303 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2020-05-18T21:24:03.304 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama python3-decorator python3-google-auth python3-html5lib 2020-05-18T21:24:03.304 INFO:teuthology.orchestra.run.smithi155.stdout: python3-joblib python3-json-pointer python3-jsonpatch python3-kubernetes 2020-05-18T21:24:03.305 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2020-05-18T21:24:03.305 INFO:teuthology.orchestra.run.smithi155.stdout: python3-openssl python3-packaging python3-paste python3-pastedeploy 2020-05-18T21:24:03.305 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pastescript python3-pecan python3-pluggy python3-prettytable 2020-05-18T21:24:03.306 INFO:teuthology.orchestra.run.smithi155.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2020-05-18T21:24:03.306 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyinotify python3-pyperclip python3-pytest python3-rados python3-rbd 2020-05-18T21:24:03.306 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2020-05-18T21:24:03.306 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa python3-scipy python3-simplegeneric python3-singledispatch 2020-05-18T21:24:03.307 INFO:teuthology.orchestra.run.smithi155.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2020-05-18T21:24:03.307 INFO:teuthology.orchestra.run.smithi155.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2020-05-18T21:24:03.307 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket python3-webtest python3-werkzeug radosgw rbd-fuse socat 2020-05-18T21:24:03.307 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet 2020-05-18T21:24:03.307 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages will be upgraded: 2020-05-18T21:24:03.308 INFO:teuthology.orchestra.run.smithi155.stdout: librados2 librbd1 2020-05-18T21:24:03.443 INFO:teuthology.orchestra.run.smithi063.stdout:2 upgraded, 96 newly installed, 0 to remove and 45 not upgraded. 2020-05-18T21:24:03.444 INFO:teuthology.orchestra.run.smithi063.stdout:Need to get 152 MB of archives. 2020-05-18T21:24:03.444 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 692 MB of additional disk space will be used. 2020-05-18T21:24:03.444 INFO:teuthology.orchestra.run.smithi063.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2020-05-18T21:24:03.491 INFO:teuthology.orchestra.run.smithi155.stdout:2 upgraded, 96 newly installed, 0 to remove and 45 not upgraded. 2020-05-18T21:24:03.491 INFO:teuthology.orchestra.run.smithi155.stdout:Need to get 152 MB of archives. 2020-05-18T21:24:03.492 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 692 MB of additional disk space will be used. 2020-05-18T21:24:03.492 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2020-05-18T21:24:03.561 INFO:teuthology.orchestra.run.smithi063.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2020-05-18T21:24:03.604 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2020-05-18T21:24:03.613 INFO:teuthology.orchestra.run.smithi063.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2020-05-18T21:24:03.651 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2020-05-18T21:24:03.729 INFO:teuthology.orchestra.run.smithi063.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 16.0.0-1640-g543315c9344-1focal [1,678 kB] 2020-05-18T21:24:03.742 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2020-05-18T21:24:03.774 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 16.0.0-1640-g543315c9344-1focal [1,678 kB] 2020-05-18T21:24:03.778 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2020-05-18T21:24:03.869 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2020-05-18T21:24:03.878 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2020-05-18T21:24:03.892 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2020-05-18T21:24:03.904 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2020-05-18T21:24:03.914 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2020-05-18T21:24:03.927 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2020-05-18T21:24:03.993 INFO:teuthology.orchestra.run.smithi063.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2020-05-18T21:24:04.018 INFO:teuthology.orchestra.run.smithi063.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2020-05-18T21:24:04.024 INFO:teuthology.orchestra.run.smithi063.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2020-05-18T21:24:04.029 INFO:teuthology.orchestra.run.smithi063.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2020-05-18T21:24:04.030 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2020-05-18T21:24:04.032 INFO:teuthology.orchestra.run.smithi063.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2020-05-18T21:24:04.049 INFO:teuthology.orchestra.run.smithi063.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2020-05-18T21:24:04.050 INFO:teuthology.orchestra.run.smithi155.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2020-05-18T21:24:04.050 INFO:teuthology.orchestra.run.smithi063.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2020-05-18T21:24:04.051 INFO:teuthology.orchestra.run.smithi063.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2020-05-18T21:24:04.055 INFO:teuthology.orchestra.run.smithi155.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2020-05-18T21:24:04.057 INFO:teuthology.orchestra.run.smithi063.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2020-05-18T21:24:04.060 INFO:teuthology.orchestra.run.smithi155.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2020-05-18T21:24:04.064 INFO:teuthology.orchestra.run.smithi155.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2020-05-18T21:24:04.081 INFO:teuthology.orchestra.run.smithi155.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2020-05-18T21:24:04.083 INFO:teuthology.orchestra.run.smithi155.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2020-05-18T21:24:04.084 INFO:teuthology.orchestra.run.smithi155.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2020-05-18T21:24:04.090 INFO:teuthology.orchestra.run.smithi155.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2020-05-18T21:24:04.116 INFO:teuthology.orchestra.run.smithi063.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2020-05-18T21:24:04.117 INFO:teuthology.orchestra.run.smithi063.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2020-05-18T21:24:04.118 INFO:teuthology.orchestra.run.smithi063.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2020-05-18T21:24:04.119 INFO:teuthology.orchestra.run.smithi063.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2020-05-18T21:24:04.148 INFO:teuthology.orchestra.run.smithi155.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2020-05-18T21:24:04.149 INFO:teuthology.orchestra.run.smithi155.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2020-05-18T21:24:04.152 INFO:teuthology.orchestra.run.smithi155.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2020-05-18T21:24:04.154 INFO:teuthology.orchestra.run.smithi155.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2020-05-18T21:24:04.158 INFO:teuthology.orchestra.run.smithi155.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2020-05-18T21:24:04.194 INFO:teuthology.orchestra.run.smithi063.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2020-05-18T21:24:04.197 INFO:teuthology.orchestra.run.smithi063.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2020-05-18T21:24:04.198 INFO:teuthology.orchestra.run.smithi063.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2020-05-18T21:24:04.219 INFO:teuthology.orchestra.run.smithi063.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2020-05-18T21:24:04.219 INFO:teuthology.orchestra.run.smithi063.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2020-05-18T21:24:04.220 INFO:teuthology.orchestra.run.smithi063.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2020-05-18T21:24:04.228 INFO:teuthology.orchestra.run.smithi155.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2020-05-18T21:24:04.229 INFO:teuthology.orchestra.run.smithi155.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2020-05-18T21:24:04.249 INFO:teuthology.orchestra.run.smithi155.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2020-05-18T21:24:04.250 INFO:teuthology.orchestra.run.smithi155.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2020-05-18T21:24:04.250 INFO:teuthology.orchestra.run.smithi155.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2020-05-18T21:24:04.275 INFO:teuthology.orchestra.run.smithi063.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2020-05-18T21:24:04.278 INFO:teuthology.orchestra.run.smithi063.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2020-05-18T21:24:04.287 INFO:teuthology.orchestra.run.smithi063.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2020-05-18T21:24:04.288 INFO:teuthology.orchestra.run.smithi063.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-underscore all 1.9.1~dfsg-1 [98.6 kB] 2020-05-18T21:24:04.309 INFO:teuthology.orchestra.run.smithi155.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2020-05-18T21:24:04.313 INFO:teuthology.orchestra.run.smithi155.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2020-05-18T21:24:04.321 INFO:teuthology.orchestra.run.smithi155.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2020-05-18T21:24:04.322 INFO:teuthology.orchestra.run.smithi155.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-underscore all 1.9.1~dfsg-1 [98.6 kB] 2020-05-18T21:24:04.326 INFO:teuthology.orchestra.run.smithi155.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2020-05-18T21:24:04.356 INFO:teuthology.orchestra.run.smithi063.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2020-05-18T21:24:04.360 INFO:teuthology.orchestra.run.smithi063.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2020-05-18T21:24:04.364 INFO:teuthology.orchestra.run.smithi063.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2020-05-18T21:24:04.365 INFO:teuthology.orchestra.run.smithi063.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2020-05-18T21:24:04.366 INFO:teuthology.orchestra.run.smithi063.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2020-05-18T21:24:04.390 INFO:teuthology.orchestra.run.smithi155.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2020-05-18T21:24:04.394 INFO:teuthology.orchestra.run.smithi155.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2020-05-18T21:24:04.395 INFO:teuthology.orchestra.run.smithi155.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2020-05-18T21:24:04.396 INFO:teuthology.orchestra.run.smithi155.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2020-05-18T21:24:04.445 INFO:teuthology.orchestra.run.smithi155.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 16.0.0-1640-g543315c9344-1focal [3,229 kB] 2020-05-18T21:24:04.623 INFO:teuthology.orchestra.run.smithi063.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 16.0.0-1640-g543315c9344-1focal [3,229 kB] 2020-05-18T21:24:04.719 INFO:teuthology.orchestra.run.smithi063.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2020-05-18T21:24:04.750 INFO:teuthology.orchestra.run.smithi155.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2020-05-18T21:24:04.777 INFO:teuthology.orchestra.run.smithi063.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2020-05-18T21:24:04.795 INFO:teuthology.orchestra.run.smithi063.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2020-05-18T21:24:04.806 INFO:teuthology.orchestra.run.smithi155.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2020-05-18T21:24:04.826 INFO:teuthology.orchestra.run.smithi155.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2020-05-18T21:24:04.843 INFO:teuthology.orchestra.run.smithi063.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2020-05-18T21:24:04.844 INFO:teuthology.orchestra.run.smithi063.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2020-05-18T21:24:04.844 INFO:teuthology.orchestra.run.smithi063.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2020-05-18T21:24:04.845 INFO:teuthology.orchestra.run.smithi063.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2020-05-18T21:24:04.845 INFO:teuthology.orchestra.run.smithi063.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2020-05-18T21:24:04.845 INFO:teuthology.orchestra.run.smithi063.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2020-05-18T21:24:04.846 INFO:teuthology.orchestra.run.smithi063.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2020-05-18T21:24:04.877 INFO:teuthology.orchestra.run.smithi155.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2020-05-18T21:24:04.878 INFO:teuthology.orchestra.run.smithi155.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2020-05-18T21:24:04.879 INFO:teuthology.orchestra.run.smithi155.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2020-05-18T21:24:04.880 INFO:teuthology.orchestra.run.smithi155.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2020-05-18T21:24:04.882 INFO:teuthology.orchestra.run.smithi063.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2020-05-18T21:24:04.882 INFO:teuthology.orchestra.run.smithi155.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2020-05-18T21:24:04.882 INFO:teuthology.orchestra.run.smithi155.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2020-05-18T21:24:04.883 INFO:teuthology.orchestra.run.smithi155.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2020-05-18T21:24:04.886 INFO:teuthology.orchestra.run.smithi063.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-json-pointer all 2.0-0ubuntu1 [8,320 B] 2020-05-18T21:24:04.906 INFO:teuthology.orchestra.run.smithi155.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 16.0.0-1640-g543315c9344-1focal [460 kB] 2020-05-18T21:24:04.913 INFO:teuthology.orchestra.run.smithi155.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2020-05-18T21:24:04.916 INFO:teuthology.orchestra.run.smithi155.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-json-pointer all 2.0-0ubuntu1 [8,320 B] 2020-05-18T21:24:04.960 INFO:teuthology.orchestra.run.smithi155.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 16.0.0-1640-g543315c9344-1focal [367 kB] 2020-05-18T21:24:04.962 INFO:teuthology.orchestra.run.smithi063.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jsonpatch all 1.23-3 [12.0 kB] 2020-05-18T21:24:04.962 INFO:teuthology.orchestra.run.smithi063.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2020-05-18T21:24:04.966 INFO:teuthology.orchestra.run.smithi063.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjq1 amd64 1.6-1 [121 kB] 2020-05-18T21:24:04.968 INFO:teuthology.orchestra.run.smithi063.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 jq amd64 1.6-1 [50.2 kB] 2020-05-18T21:24:04.970 INFO:teuthology.orchestra.run.smithi063.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2020-05-18T21:24:04.976 INFO:teuthology.orchestra.run.smithi063.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2020-05-18T21:24:04.980 INFO:teuthology.orchestra.run.smithi063.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2020-05-18T21:24:04.980 INFO:teuthology.orchestra.run.smithi063.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2020-05-18T21:24:04.994 INFO:teuthology.orchestra.run.smithi155.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jsonpatch all 1.23-3 [12.0 kB] 2020-05-18T21:24:04.994 INFO:teuthology.orchestra.run.smithi155.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2020-05-18T21:24:04.997 INFO:teuthology.orchestra.run.smithi155.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjq1 amd64 1.6-1 [121 kB] 2020-05-18T21:24:05.000 INFO:teuthology.orchestra.run.smithi155.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 jq amd64 1.6-1 [50.2 kB] 2020-05-18T21:24:05.001 INFO:teuthology.orchestra.run.smithi155.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2020-05-18T21:24:05.008 INFO:teuthology.orchestra.run.smithi155.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2020-05-18T21:24:05.009 INFO:teuthology.orchestra.run.smithi155.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2020-05-18T21:24:05.009 INFO:teuthology.orchestra.run.smithi155.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2020-05-18T21:24:05.012 INFO:teuthology.orchestra.run.smithi155.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 16.0.0-1640-g543315c9344-1focal [20.6 kB] 2020-05-18T21:24:05.013 INFO:teuthology.orchestra.run.smithi155.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 16.0.0-1640-g543315c9344-1focal [153 kB] 2020-05-18T21:24:05.043 INFO:teuthology.orchestra.run.smithi063.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2020-05-18T21:24:05.044 INFO:teuthology.orchestra.run.smithi063.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2020-05-18T21:24:05.059 INFO:teuthology.orchestra.run.smithi155.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 16.0.0-1640-g543315c9344-1focal [24.2 kB] 2020-05-18T21:24:05.060 INFO:teuthology.orchestra.run.smithi155.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 16.0.0-1640-g543315c9344-1focal [345 kB] 2020-05-18T21:24:05.061 INFO:teuthology.orchestra.run.smithi063.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2020-05-18T21:24:05.063 INFO:teuthology.orchestra.run.smithi063.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-lxml amd64 4.5.0-1 [1,381 kB] 2020-05-18T21:24:05.071 INFO:teuthology.orchestra.run.smithi155.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 16.0.0-1640-g543315c9344-1focal [3,122 kB] 2020-05-18T21:24:05.074 INFO:teuthology.orchestra.run.smithi155.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2020-05-18T21:24:05.075 INFO:teuthology.orchestra.run.smithi155.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2020-05-18T21:24:05.077 INFO:teuthology.orchestra.run.smithi063.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2020-05-18T21:24:05.078 INFO:teuthology.orchestra.run.smithi063.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2020-05-18T21:24:05.078 INFO:teuthology.orchestra.run.smithi063.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2020-05-18T21:24:05.079 INFO:teuthology.orchestra.run.smithi063.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2020-05-18T21:24:05.080 INFO:teuthology.orchestra.run.smithi063.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2020-05-18T21:24:05.090 INFO:teuthology.orchestra.run.smithi155.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2020-05-18T21:24:05.092 INFO:teuthology.orchestra.run.smithi155.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-lxml amd64 4.5.0-1 [1,381 kB] 2020-05-18T21:24:05.109 INFO:teuthology.orchestra.run.smithi155.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2020-05-18T21:24:05.109 INFO:teuthology.orchestra.run.smithi155.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2020-05-18T21:24:05.110 INFO:teuthology.orchestra.run.smithi155.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2020-05-18T21:24:05.110 INFO:teuthology.orchestra.run.smithi155.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2020-05-18T21:24:05.110 INFO:teuthology.orchestra.run.smithi155.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2020-05-18T21:24:05.142 INFO:teuthology.orchestra.run.smithi063.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2020-05-18T21:24:05.155 INFO:teuthology.orchestra.run.smithi155.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2020-05-18T21:24:05.205 INFO:teuthology.orchestra.run.smithi063.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2020-05-18T21:24:05.236 INFO:teuthology.orchestra.run.smithi155.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2020-05-18T21:24:05.305 INFO:teuthology.orchestra.run.smithi155.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 16.0.0-1640-g543315c9344-1focal [115 kB] 2020-05-18T21:24:05.328 INFO:teuthology.orchestra.run.smithi155.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 16.0.0-1640-g543315c9344-1focal [355 kB] 2020-05-18T21:24:05.340 INFO:teuthology.orchestra.run.smithi155.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 16.0.0-1640-g543315c9344-1focal [20.0 MB] 2020-05-18T21:24:05.414 INFO:teuthology.orchestra.run.smithi063.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 16.0.0-1640-g543315c9344-1focal [460 kB] 2020-05-18T21:24:05.485 INFO:teuthology.orchestra.run.smithi063.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 16.0.0-1640-g543315c9344-1focal [367 kB] 2020-05-18T21:24:05.524 INFO:teuthology.orchestra.run.smithi063.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 16.0.0-1640-g543315c9344-1focal [20.6 kB] 2020-05-18T21:24:05.554 INFO:teuthology.orchestra.run.smithi063.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 16.0.0-1640-g543315c9344-1focal [153 kB] 2020-05-18T21:24:05.558 INFO:teuthology.orchestra.run.smithi063.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 16.0.0-1640-g543315c9344-1focal [24.2 kB] 2020-05-18T21:24:05.559 INFO:teuthology.orchestra.run.smithi063.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 16.0.0-1640-g543315c9344-1focal [345 kB] 2020-05-18T21:24:05.627 INFO:teuthology.orchestra.run.smithi063.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 16.0.0-1640-g543315c9344-1focal [3,122 kB] 2020-05-18T21:24:06.058 INFO:teuthology.orchestra.run.smithi063.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 16.0.0-1640-g543315c9344-1focal [115 kB] 2020-05-18T21:24:06.090 INFO:teuthology.orchestra.run.smithi063.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 16.0.0-1640-g543315c9344-1focal [355 kB] 2020-05-18T21:24:06.128 INFO:teuthology.orchestra.run.smithi063.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 16.0.0-1640-g543315c9344-1focal [20.0 MB] 2020-05-18T21:24:06.743 INFO:teuthology.orchestra.run.smithi155.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 16.0.0-1640-g543315c9344-1focal [5,367 kB] 2020-05-18T21:24:07.031 INFO:teuthology.orchestra.run.smithi155.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 16.0.0-1640-g543315c9344-1focal [140 kB] 2020-05-18T21:24:07.034 INFO:teuthology.orchestra.run.smithi155.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 16.0.0-1640-g543315c9344-1focal [1,373 kB] 2020-05-18T21:24:07.117 INFO:teuthology.orchestra.run.smithi155.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 16.0.0-1640-g543315c9344-1focal [6,199 kB] 2020-05-18T21:24:07.496 INFO:teuthology.orchestra.run.smithi155.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 16.0.0-1640-g543315c9344-1focal [24.0 MB] 2020-05-18T21:24:08.508 INFO:teuthology.orchestra.run.smithi063.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 16.0.0-1640-g543315c9344-1focal [5,367 kB] 2020-05-18T21:24:08.989 INFO:teuthology.orchestra.run.smithi155.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 16.0.0-1640-g543315c9344-1focal [3,808 B] 2020-05-18T21:24:08.990 INFO:teuthology.orchestra.run.smithi155.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 16.0.0-1640-g543315c9344-1focal [533 kB] 2020-05-18T21:24:09.000 INFO:teuthology.orchestra.run.smithi155.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 16.0.0-1640-g543315c9344-1focal [1,998 kB] 2020-05-18T21:24:09.011 INFO:teuthology.orchestra.run.smithi063.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 16.0.0-1640-g543315c9344-1focal [140 kB] 2020-05-18T21:24:09.024 INFO:teuthology.orchestra.run.smithi063.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 16.0.0-1640-g543315c9344-1focal [1,373 kB] 2020-05-18T21:24:09.098 INFO:teuthology.orchestra.run.smithi155.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 16.0.0-1640-g543315c9344-1focal [41.0 kB] 2020-05-18T21:24:09.099 INFO:teuthology.orchestra.run.smithi155.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 16.0.0-1640-g543315c9344-1focal [37.3 kB] 2020-05-18T21:24:09.100 INFO:teuthology.orchestra.run.smithi155.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 16.0.0-1640-g543315c9344-1focal [3,189 kB] 2020-05-18T21:24:09.168 INFO:teuthology.orchestra.run.smithi063.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 16.0.0-1640-g543315c9344-1focal [6,199 kB] 2020-05-18T21:24:09.309 INFO:teuthology.orchestra.run.smithi155.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 16.0.0-1640-g543315c9344-1focal [34.2 kB] 2020-05-18T21:24:09.310 INFO:teuthology.orchestra.run.smithi155.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 16.0.0-1640-g543315c9344-1focal [7,894 kB] 2020-05-18T21:24:09.750 INFO:teuthology.orchestra.run.smithi155.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 16.0.0-1640-g543315c9344-1focal [3,924 B] 2020-05-18T21:24:09.751 INFO:teuthology.orchestra.run.smithi155.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-rook all 16.0.0-1640-g543315c9344-1focal [22.3 kB] 2020-05-18T21:24:09.751 INFO:teuthology.orchestra.run.smithi155.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 16.0.0-1640-g543315c9344-1focal [40.0 MB] 2020-05-18T21:24:09.785 INFO:teuthology.orchestra.run.smithi063.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 16.0.0-1640-g543315c9344-1focal [24.0 MB] 2020-05-18T21:24:12.212 INFO:teuthology.orchestra.run.smithi155.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 16.0.0-1640-g543315c9344-1focal [15.7 kB] 2020-05-18T21:24:12.213 INFO:teuthology.orchestra.run.smithi155.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 16.0.0-1640-g543315c9344-1focal [17.9 kB] 2020-05-18T21:24:12.214 INFO:teuthology.orchestra.run.smithi155.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 16.0.0-1640-g543315c9344-1focal [9,601 kB] 2020-05-18T21:24:12.295 INFO:teuthology.orchestra.run.smithi063.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 16.0.0-1640-g543315c9344-1focal [3,808 B] 2020-05-18T21:24:12.295 INFO:teuthology.orchestra.run.smithi063.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 16.0.0-1640-g543315c9344-1focal [533 kB] 2020-05-18T21:24:12.306 INFO:teuthology.orchestra.run.smithi063.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 16.0.0-1640-g543315c9344-1focal [1,998 kB] 2020-05-18T21:24:12.448 INFO:teuthology.orchestra.run.smithi063.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 16.0.0-1640-g543315c9344-1focal [41.0 kB] 2020-05-18T21:24:12.449 INFO:teuthology.orchestra.run.smithi063.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 16.0.0-1640-g543315c9344-1focal [37.3 kB] 2020-05-18T21:24:12.475 INFO:teuthology.orchestra.run.smithi063.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 16.0.0-1640-g543315c9344-1focal [3,189 kB] 2020-05-18T21:24:12.681 INFO:teuthology.orchestra.run.smithi155.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 16.0.0-1640-g543315c9344-1focal [59.7 kB] 2020-05-18T21:24:12.768 INFO:teuthology.orchestra.run.smithi063.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 16.0.0-1640-g543315c9344-1focal [34.2 kB] 2020-05-18T21:24:12.769 INFO:teuthology.orchestra.run.smithi063.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 16.0.0-1640-g543315c9344-1focal [7,894 kB] 2020-05-18T21:24:13.299 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 152 MB in 9s (16.2 MB/s) 2020-05-18T21:24:13.438 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyperclip. 2020-05-18T21:24:13.497 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 149536 files and directories currently installed.) 2020-05-18T21:24:13.502 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../00-python3-pyperclip_1.7.0-1_all.deb ... 2020-05-18T21:24:13.547 INFO:teuthology.orchestra.run.smithi063.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 16.0.0-1640-g543315c9344-1focal [3,924 B] 2020-05-18T21:24:13.548 INFO:teuthology.orchestra.run.smithi063.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-rook all 16.0.0-1640-g543315c9344-1focal [22.3 kB] 2020-05-18T21:24:13.548 INFO:teuthology.orchestra.run.smithi063.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 16.0.0-1640-g543315c9344-1focal [40.0 MB] 2020-05-18T21:24:13.551 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2020-05-18T21:24:13.871 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-wcwidth. 2020-05-18T21:24:13.889 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../01-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2020-05-18T21:24:13.929 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2020-05-18T21:24:14.190 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cmd2. 2020-05-18T21:24:14.210 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../02-python3-cmd2_0.8.5-2.1_all.deb ... 2020-05-18T21:24:14.249 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2020-05-18T21:24:14.618 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-05-18T21:24:14.640 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../03-liblttng-ust0_2.11.0-1_amd64.deb ... 2020-05-18T21:24:14.718 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2020-05-18T21:24:15.063 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../04-librbd1_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:15.189 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librbd1 (16.0.0-1640-g543315c9344-1focal) over (15.2.1-0ubuntu2) ... 2020-05-18T21:24:15.688 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../05-librados2_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:15.784 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librados2 (16.0.0-1640-g543315c9344-1focal) over (15.2.1-0ubuntu2) ... 2020-05-18T21:24:16.447 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libcephfs2. 2020-05-18T21:24:16.463 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../06-libcephfs2_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:16.496 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libcephfs2 (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:16.749 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rados. 2020-05-18T21:24:16.766 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../07-python3-rados_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:16.807 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rados (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:17.186 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-05-18T21:24:17.201 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../08-python3-ceph-argparse_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:24:17.243 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-ceph-argparse (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:17.293 INFO:teuthology.orchestra.run.smithi063.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 16.0.0-1640-g543315c9344-1focal [15.7 kB] 2020-05-18T21:24:17.294 INFO:teuthology.orchestra.run.smithi063.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 16.0.0-1640-g543315c9344-1focal [17.9 kB] 2020-05-18T21:24:17.294 INFO:teuthology.orchestra.run.smithi063.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 16.0.0-1640-g543315c9344-1focal [9,601 kB] 2020-05-18T21:24:17.546 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cephfs. 2020-05-18T21:24:17.562 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../09-python3-cephfs_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:17.604 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cephfs (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:17.932 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-ceph-common. 2020-05-18T21:24:17.936 INFO:teuthology.orchestra.run.smithi063.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200516.030215/543315c934420269aa12ef2f9dec2c9eadb4fa6f/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 16.0.0-1640-g543315c9344-1focal [59.7 kB] 2020-05-18T21:24:17.952 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../10-python3-ceph-common_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:24:17.981 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-ceph-common (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:18.310 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-prettytable. 2020-05-18T21:24:18.328 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../11-python3-prettytable_0.7.2-5_all.deb ... 2020-05-18T21:24:18.368 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2020-05-18T21:24:18.571 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 152 MB in 15s (10.3 MB/s) 2020-05-18T21:24:18.671 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rbd. 2020-05-18T21:24:18.689 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../12-python3-rbd_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:18.711 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyperclip. 2020-05-18T21:24:18.728 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rbd (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:18.773 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 149536 files and directories currently installed.) 2020-05-18T21:24:18.778 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../00-python3-pyperclip_1.7.0-1_all.deb ... 2020-05-18T21:24:18.817 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2020-05-18T21:24:19.053 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-wcwidth. 2020-05-18T21:24:19.065 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-05-18T21:24:19.072 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../01-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2020-05-18T21:24:19.083 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../13-librabbitmq4_0.10.0-1_amd64.deb ... 2020-05-18T21:24:19.111 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2020-05-18T21:24:19.123 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2020-05-18T21:24:19.439 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cmd2. 2020-05-18T21:24:19.460 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../02-python3-cmd2_0.8.5-2.1_all.deb ... 2020-05-18T21:24:19.460 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librdkafka1:amd64. 2020-05-18T21:24:19.478 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../14-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2020-05-18T21:24:19.497 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2020-05-18T21:24:19.518 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2020-05-18T21:24:19.851 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-05-18T21:24:19.867 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../03-liblttng-ust0_2.11.0-1_amd64.deb ... 2020-05-18T21:24:19.887 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librgw2. 2020-05-18T21:24:19.905 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../15-librgw2_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:19.945 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librgw2 (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:19.951 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2020-05-18T21:24:20.256 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../04-librbd1_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:20.355 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librbd1 (16.0.0-1640-g543315c9344-1focal) over (15.2.1-0ubuntu2) ... 2020-05-18T21:24:20.531 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rgw. 2020-05-18T21:24:20.547 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../16-python3-rgw_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:20.589 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rgw (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:20.850 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libleveldb1d:amd64. 2020-05-18T21:24:20.869 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../17-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2020-05-18T21:24:20.900 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2020-05-18T21:24:20.910 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../05-librados2_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:21.034 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librados2 (16.0.0-1640-g543315c9344-1focal) over (15.2.1-0ubuntu2) ... 2020-05-18T21:24:21.270 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liboath0. 2020-05-18T21:24:21.286 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../18-liboath0_2.6.1-1.3_amd64.deb ... 2020-05-18T21:24:21.328 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2020-05-18T21:24:21.630 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libradosstriper1. 2020-05-18T21:24:21.646 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libcephfs2. 2020-05-18T21:24:21.651 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../19-libradosstriper1_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:21.666 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../06-libcephfs2_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:21.688 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libradosstriper1 (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:21.704 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libcephfs2 (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:22.074 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rados. 2020-05-18T21:24:22.093 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../07-python3-rados_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:22.100 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-common. 2020-05-18T21:24:22.117 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../20-ceph-common_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:22.131 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rados (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:22.150 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-common (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:22.818 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-05-18T21:24:22.838 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../08-python3-ceph-argparse_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:24:22.868 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-ceph-argparse (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:23.171 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cephfs. 2020-05-18T21:24:23.188 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../09-python3-cephfs_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:23.229 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cephfs (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:23.565 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-ceph-common. 2020-05-18T21:24:23.582 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../10-python3-ceph-common_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:24:23.623 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-ceph-common (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:23.985 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-prettytable. 2020-05-18T21:24:24.002 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../11-python3-prettytable_0.7.2-5_all.deb ... 2020-05-18T21:24:24.043 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2020-05-18T21:24:24.254 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rbd. 2020-05-18T21:24:24.273 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../12-python3-rbd_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:24.312 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rbd (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:24.355 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-base. 2020-05-18T21:24:24.376 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../21-ceph-base_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:24.446 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-base (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:24.707 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-05-18T21:24:24.724 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../13-librabbitmq4_0.10.0-1_amd64.deb ... 2020-05-18T21:24:24.765 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2020-05-18T21:24:25.102 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librdkafka1:amd64. 2020-05-18T21:24:25.118 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../14-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2020-05-18T21:24:25.160 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2020-05-18T21:24:25.385 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-openssl. 2020-05-18T21:24:25.404 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../22-python3-openssl_19.0.0-1build1_all.deb ... 2020-05-18T21:24:25.435 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2020-05-18T21:24:25.471 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librgw2. 2020-05-18T21:24:25.492 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../15-librgw2_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:25.521 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librgw2 (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:25.696 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2020-05-18T21:24:25.716 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../23-ceph-mgr-modules-core_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:24:25.754 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-modules-core (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:26.065 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rgw. 2020-05-18T21:24:26.083 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../16-python3-rgw_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:26.123 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rgw (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:26.142 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-bcrypt. 2020-05-18T21:24:26.160 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../24-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2020-05-18T21:24:26.200 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2020-05-18T21:24:26.418 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libleveldb1d:amd64. 2020-05-18T21:24:26.435 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../17-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2020-05-18T21:24:26.468 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2020-05-18T21:24:26.503 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cherrypy3. 2020-05-18T21:24:26.523 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../25-python3-cherrypy3_8.9.1-6_all.deb ... 2020-05-18T21:24:26.561 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2020-05-18T21:24:26.854 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liboath0. 2020-05-18T21:24:26.873 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../18-liboath0_2.6.1-1.3_amd64.deb ... 2020-05-18T21:24:26.912 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2020-05-18T21:24:26.972 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-logutils. 2020-05-18T21:24:26.989 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../26-python3-logutils_0.3.3-7_all.deb ... 2020-05-18T21:24:27.039 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-logutils (0.3.3-7) ... 2020-05-18T21:24:27.215 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libradosstriper1. 2020-05-18T21:24:27.236 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../19-libradosstriper1_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:27.273 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libradosstriper1 (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:27.342 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-markupsafe. 2020-05-18T21:24:27.363 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../27-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2020-05-18T21:24:27.400 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2020-05-18T21:24:27.660 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-common. 2020-05-18T21:24:27.678 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../20-ceph-common_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:27.703 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-mako. 2020-05-18T21:24:27.710 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-common (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:27.721 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../28-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2020-05-18T21:24:27.761 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2020-05-18T21:24:28.131 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-simplegeneric. 2020-05-18T21:24:28.149 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../29-python3-simplegeneric_0.8.1-3_all.deb ... 2020-05-18T21:24:28.225 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2020-05-18T21:24:28.834 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-singledispatch. 2020-05-18T21:24:28.855 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../30-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2020-05-18T21:24:28.900 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2020-05-18T21:24:29.195 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-webob. 2020-05-18T21:24:29.215 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../31-python3-webob_1%3a1.8.5-2_all.deb ... 2020-05-18T21:24:29.253 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2020-05-18T21:24:29.598 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-soupsieve. 2020-05-18T21:24:29.614 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../32-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2020-05-18T21:24:29.656 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2020-05-18T21:24:29.782 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-base. 2020-05-18T21:24:29.803 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../21-ceph-base_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:29.851 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-base (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:29.959 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-bs4. 2020-05-18T21:24:29.977 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../33-python3-bs4_4.8.2-1_all.deb ... 2020-05-18T21:24:30.017 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2020-05-18T21:24:30.395 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-waitress. 2020-05-18T21:24:30.413 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../34-python3-waitress_1.4.1-1_all.deb ... 2020-05-18T21:24:30.456 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-waitress (1.4.1-1) ... 2020-05-18T21:24:30.720 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-openssl. 2020-05-18T21:24:30.740 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../22-python3-openssl_19.0.0-1build1_all.deb ... 2020-05-18T21:24:30.778 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2020-05-18T21:24:30.806 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-tempita. 2020-05-18T21:24:30.822 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../35-python3-tempita_0.5.2-6_all.deb ... 2020-05-18T21:24:30.864 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-tempita (0.5.2-6) ... 2020-05-18T21:24:31.056 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2020-05-18T21:24:31.074 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../23-ceph-mgr-modules-core_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:24:31.123 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-modules-core (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:31.192 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-paste. 2020-05-18T21:24:31.212 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../36-python3-paste_3.4.0+dfsg1-1_all.deb ... 2020-05-18T21:24:31.250 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2020-05-18T21:24:31.502 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-bcrypt. 2020-05-18T21:24:31.530 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../24-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2020-05-18T21:24:31.561 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2020-05-18T21:24:31.588 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-05-18T21:24:31.608 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../37-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2020-05-18T21:24:31.645 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2020-05-18T21:24:31.855 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cherrypy3. 2020-05-18T21:24:31.873 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../25-python3-cherrypy3_8.9.1-6_all.deb ... 2020-05-18T21:24:31.913 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2020-05-18T21:24:31.965 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pastedeploy. 2020-05-18T21:24:31.982 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../38-python3-pastedeploy_2.1.0-1_all.deb ... 2020-05-18T21:24:32.023 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2020-05-18T21:24:32.258 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-logutils. 2020-05-18T21:24:32.277 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../26-python3-logutils_0.3.3-7_all.deb ... 2020-05-18T21:24:32.317 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-logutils (0.3.3-7) ... 2020-05-18T21:24:32.386 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-webtest. 2020-05-18T21:24:32.407 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../39-python3-webtest_2.0.32-2_all.deb ... 2020-05-18T21:24:32.444 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-webtest (2.0.32-2) ... 2020-05-18T21:24:32.620 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-markupsafe. 2020-05-18T21:24:32.640 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../27-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2020-05-18T21:24:32.678 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2020-05-18T21:24:32.739 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pecan. 2020-05-18T21:24:32.759 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../40-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2020-05-18T21:24:32.814 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2020-05-18T21:24:33.143 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-werkzeug. 2020-05-18T21:24:33.166 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../41-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2020-05-18T21:24:33.201 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2020-05-18T21:24:33.490 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-mako. 2020-05-18T21:24:33.509 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../28-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2020-05-18T21:24:33.548 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2020-05-18T21:24:33.935 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-simplegeneric. 2020-05-18T21:24:33.956 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../29-python3-simplegeneric_0.8.1-3_all.deb ... 2020-05-18T21:24:33.993 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2020-05-18T21:24:34.172 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr. 2020-05-18T21:24:34.190 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../42-ceph-mgr_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:34.230 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:34.321 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-singledispatch. 2020-05-18T21:24:34.340 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../30-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2020-05-18T21:24:34.379 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2020-05-18T21:24:34.682 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-webob. 2020-05-18T21:24:34.699 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../31-python3-webob_1%3a1.8.5-2_all.deb ... 2020-05-18T21:24:34.707 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mon. 2020-05-18T21:24:34.727 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../43-ceph-mon_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:34.740 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2020-05-18T21:24:34.767 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mon (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:35.052 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-soupsieve. 2020-05-18T21:24:35.072 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../32-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2020-05-18T21:24:35.110 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2020-05-18T21:24:35.438 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-bs4. 2020-05-18T21:24:35.454 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../33-python3-bs4_4.8.2-1_all.deb ... 2020-05-18T21:24:35.529 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2020-05-18T21:24:35.769 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-osd. 2020-05-18T21:24:35.786 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../44-ceph-osd_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:35.827 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-osd (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:35.899 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-waitress. 2020-05-18T21:24:35.917 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../34-python3-waitress_1.4.1-1_all.deb ... 2020-05-18T21:24:35.960 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-waitress (1.4.1-1) ... 2020-05-18T21:24:36.302 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-tempita. 2020-05-18T21:24:36.321 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../35-python3-tempita_0.5.2-6_all.deb ... 2020-05-18T21:24:36.360 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-tempita (0.5.2-6) ... 2020-05-18T21:24:36.663 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-paste. 2020-05-18T21:24:36.681 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../36-python3-paste_3.4.0+dfsg1-1_all.deb ... 2020-05-18T21:24:36.721 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2020-05-18T21:24:37.075 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-05-18T21:24:37.095 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../37-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2020-05-18T21:24:37.133 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2020-05-18T21:24:37.445 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pastedeploy. 2020-05-18T21:24:37.462 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../38-python3-pastedeploy_2.1.0-1_all.deb ... 2020-05-18T21:24:37.503 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2020-05-18T21:24:37.806 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-webtest. 2020-05-18T21:24:37.823 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../39-python3-webtest_2.0.32-2_all.deb ... 2020-05-18T21:24:37.864 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-webtest (2.0.32-2) ... 2020-05-18T21:24:38.174 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph. 2020-05-18T21:24:38.175 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pecan. 2020-05-18T21:24:38.192 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../40-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2020-05-18T21:24:38.192 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../45-ceph_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:38.232 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:38.233 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2020-05-18T21:24:38.551 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-fuse. 2020-05-18T21:24:38.569 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../46-ceph-fuse_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:38.605 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-werkzeug. 2020-05-18T21:24:38.618 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-fuse (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:38.624 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../41-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2020-05-18T21:24:38.663 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2020-05-18T21:24:39.042 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr. 2020-05-18T21:24:39.046 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mds. 2020-05-18T21:24:39.059 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../42-ceph-mgr_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:39.066 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../47-ceph-mds_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:39.100 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:39.104 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mds (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:39.590 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephadm. 2020-05-18T21:24:39.611 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../48-cephadm_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:39.640 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephadm (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:39.687 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mon. 2020-05-18T21:24:39.705 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../43-ceph-mon_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:39.745 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mon (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:39.976 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2020-05-18T21:24:39.993 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../49-ceph-mgr-cephadm_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:24:40.034 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-cephadm (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:40.363 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-repoze.lru. 2020-05-18T21:24:40.381 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../50-python3-repoze.lru_0.7-2_all.deb ... 2020-05-18T21:24:40.437 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2020-05-18T21:24:40.690 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libjs-underscore. 2020-05-18T21:24:40.708 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../51-libjs-underscore_1.9.1~dfsg-1_all.deb ... 2020-05-18T21:24:40.748 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1) ... 2020-05-18T21:24:40.865 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-osd. 2020-05-18T21:24:40.882 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../44-ceph-osd_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:40.923 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-osd (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:41.034 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libjs-sphinxdoc. 2020-05-18T21:24:41.052 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../52-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2020-05-18T21:24:41.092 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2020-05-18T21:24:41.479 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-routes. 2020-05-18T21:24:41.496 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../53-python3-routes_2.4.1-2_all.deb ... 2020-05-18T21:24:41.537 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-routes (2.4.1-2) ... 2020-05-18T21:24:41.882 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-05-18T21:24:41.898 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../54-ceph-mgr-dashboard_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:24:41.940 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-dashboard (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:42.930 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2020-05-18T21:24:42.947 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-cloud_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:24:42.988 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-diskprediction-cloud (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:43.220 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph. 2020-05-18T21:24:43.239 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../45-ceph_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:43.274 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-decorator. 2020-05-18T21:24:43.278 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:43.295 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../56-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2020-05-18T21:24:43.332 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2020-05-18T21:24:43.515 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-fuse. 2020-05-18T21:24:43.535 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../46-ceph-fuse_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:43.564 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-fuse (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:43.627 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2020-05-18T21:24:43.651 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../57-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2020-05-18T21:24:43.685 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2020-05-18T21:24:43.943 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mds. 2020-05-18T21:24:43.960 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../47-ceph-mds_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:44.001 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mds (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:44.029 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-scipy. 2020-05-18T21:24:44.048 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../58-python3-scipy_1.3.3-3build1_amd64.deb ... 2020-05-18T21:24:44.146 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2020-05-18T21:24:44.521 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package cephadm. 2020-05-18T21:24:44.540 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../48-cephadm_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:44.579 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking cephadm (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:44.824 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2020-05-18T21:24:44.841 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../49-ceph-mgr-cephadm_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:24:44.874 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-cephadm (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:45.212 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-repoze.lru. 2020-05-18T21:24:45.228 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../50-python3-repoze.lru_0.7-2_all.deb ... 2020-05-18T21:24:45.277 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2020-05-18T21:24:45.422 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-sklearn-lib. 2020-05-18T21:24:45.438 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../59-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2020-05-18T21:24:45.474 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2020-05-18T21:24:45.563 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libjs-underscore. 2020-05-18T21:24:45.582 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../51-libjs-underscore_1.9.1~dfsg-1_all.deb ... 2020-05-18T21:24:45.621 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1) ... 2020-05-18T21:24:45.899 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libjs-sphinxdoc. 2020-05-18T21:24:45.917 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../52-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2020-05-18T21:24:45.957 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2020-05-18T21:24:46.008 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-joblib. 2020-05-18T21:24:46.025 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../60-python3-joblib_0.14.0-3_all.deb ... 2020-05-18T21:24:46.066 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-joblib (0.14.0-3) ... 2020-05-18T21:24:46.286 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-routes. 2020-05-18T21:24:46.305 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../53-python3-routes_2.4.1-2_all.deb ... 2020-05-18T21:24:46.344 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-routes (2.4.1-2) ... 2020-05-18T21:24:46.436 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-sklearn. 2020-05-18T21:24:46.454 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../61-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2020-05-18T21:24:46.486 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2020-05-18T21:24:46.681 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-05-18T21:24:46.701 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../54-ceph-mgr-dashboard_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:24:46.739 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-dashboard (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:47.169 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-05-18T21:24:47.186 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../62-ceph-mgr-diskprediction-local_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:24:47.227 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-diskprediction-local (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:47.680 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2020-05-18T21:24:47.698 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-cloud_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:24:47.738 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-diskprediction-cloud (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:48.066 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-decorator. 2020-05-18T21:24:48.083 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../56-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2020-05-18T21:24:48.125 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2020-05-18T21:24:48.305 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cachetools. 2020-05-18T21:24:48.324 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../63-python3-cachetools_4.0.0-1_all.deb ... 2020-05-18T21:24:48.355 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2020-05-18T21:24:48.461 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2020-05-18T21:24:48.480 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../57-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2020-05-18T21:24:48.519 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2020-05-18T21:24:48.649 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyasn1. 2020-05-18T21:24:48.666 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../64-python3-pyasn1_0.4.2-3build1_all.deb ... 2020-05-18T21:24:48.707 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2020-05-18T21:24:48.873 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-scipy. 2020-05-18T21:24:48.891 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../58-python3-scipy_1.3.3-3build1_amd64.deb ... 2020-05-18T21:24:48.931 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2020-05-18T21:24:49.069 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyasn1-modules. 2020-05-18T21:24:49.086 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../65-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2020-05-18T21:24:49.127 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2020-05-18T21:24:49.438 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rsa. 2020-05-18T21:24:49.457 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../66-python3-rsa_4.0-3_all.deb ... 2020-05-18T21:24:49.496 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rsa (4.0-3) ... 2020-05-18T21:24:49.833 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-google-auth. 2020-05-18T21:24:49.851 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../67-python3-google-auth_1.5.1-2_all.deb ... 2020-05-18T21:24:49.891 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2020-05-18T21:24:50.187 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-requests-oauthlib. 2020-05-18T21:24:50.205 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../68-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2020-05-18T21:24:50.236 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2020-05-18T21:24:50.240 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-sklearn-lib. 2020-05-18T21:24:50.258 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../59-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2020-05-18T21:24:50.323 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2020-05-18T21:24:50.531 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-websocket. 2020-05-18T21:24:50.548 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../69-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2020-05-18T21:24:50.589 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2020-05-18T21:24:50.860 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-joblib. 2020-05-18T21:24:50.878 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../60-python3-joblib_0.14.0-3_all.deb ... 2020-05-18T21:24:50.900 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-kubernetes. 2020-05-18T21:24:50.919 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../70-python3-kubernetes_7.0.0~a1-2_all.deb ... 2020-05-18T21:24:50.919 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-joblib (0.14.0-3) ... 2020-05-18T21:24:50.958 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2020-05-18T21:24:51.306 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-sklearn. 2020-05-18T21:24:51.323 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../61-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2020-05-18T21:24:51.363 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2020-05-18T21:24:51.547 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-05-18T21:24:51.568 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../71-ceph-mgr-k8sevents_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:24:51.604 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-k8sevents (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:51.907 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-json-pointer. 2020-05-18T21:24:51.928 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../72-python3-json-pointer_2.0-0ubuntu1_all.deb ... 2020-05-18T21:24:51.965 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-json-pointer (2.0-0ubuntu1) ... 2020-05-18T21:24:52.089 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-05-18T21:24:52.106 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../62-ceph-mgr-diskprediction-local_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:24:52.147 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-diskprediction-local (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:52.318 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jsonpatch. 2020-05-18T21:24:52.335 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../73-python3-jsonpatch_1.23-3_all.deb ... 2020-05-18T21:24:52.376 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jsonpatch (1.23-3) ... 2020-05-18T21:24:52.621 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-05-18T21:24:52.640 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../74-ceph-mgr-rook_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:24:52.670 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-rook (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:53.015 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libonig5:amd64. 2020-05-18T21:24:53.033 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../75-libonig5_6.9.4-1_amd64.deb ... 2020-05-18T21:24:53.073 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2020-05-18T21:24:53.276 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cachetools. 2020-05-18T21:24:53.296 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../63-python3-cachetools_4.0.0-1_all.deb ... 2020-05-18T21:24:53.333 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2020-05-18T21:24:53.426 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libjq1:amd64. 2020-05-18T21:24:53.443 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../76-libjq1_1.6-1_amd64.deb ... 2020-05-18T21:24:53.484 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libjq1:amd64 (1.6-1) ... 2020-05-18T21:24:53.639 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyasn1. 2020-05-18T21:24:53.660 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../64-python3-pyasn1_0.4.2-3build1_all.deb ... 2020-05-18T21:24:53.697 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2020-05-18T21:24:53.787 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package jq. 2020-05-18T21:24:53.805 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../77-jq_1.6-1_amd64.deb ... 2020-05-18T21:24:53.845 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking jq (1.6-1) ... 2020-05-18T21:24:54.106 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package socat. 2020-05-18T21:24:54.125 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../78-socat_1.7.3.3-2_amd64.deb ... 2020-05-18T21:24:54.164 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking socat (1.7.3.3-2) ... 2020-05-18T21:24:54.434 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyasn1-modules. 2020-05-18T21:24:54.455 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../65-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2020-05-18T21:24:54.476 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package xmlstarlet. 2020-05-18T21:24:54.492 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2020-05-18T21:24:54.493 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../79-xmlstarlet_1.6.1-2build1_amd64.deb ... 2020-05-18T21:24:54.534 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2020-05-18T21:24:54.854 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rsa. 2020-05-18T21:24:54.873 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../66-python3-rsa_4.0-3_all.deb ... 2020-05-18T21:24:54.888 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-test. 2020-05-18T21:24:54.906 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../80-ceph-test_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:54.912 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rsa (4.0-3) ... 2020-05-18T21:24:54.946 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-test (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:55.220 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-google-auth. 2020-05-18T21:24:55.233 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../67-python3-google-auth_1.5.1-2_all.deb ... 2020-05-18T21:24:55.273 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2020-05-18T21:24:55.601 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-requests-oauthlib. 2020-05-18T21:24:55.618 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../68-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2020-05-18T21:24:55.659 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2020-05-18T21:24:55.971 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-websocket. 2020-05-18T21:24:55.988 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../69-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2020-05-18T21:24:56.029 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2020-05-18T21:24:56.365 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-kubernetes. 2020-05-18T21:24:56.383 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../70-python3-kubernetes_7.0.0~a1-2_all.deb ... 2020-05-18T21:24:56.423 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2020-05-18T21:24:57.011 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-05-18T21:24:57.030 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../71-ceph-mgr-k8sevents_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:24:57.069 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-k8sevents (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:57.414 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-json-pointer. 2020-05-18T21:24:57.433 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../72-python3-json-pointer_2.0-0ubuntu1_all.deb ... 2020-05-18T21:24:57.480 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-json-pointer (2.0-0ubuntu1) ... 2020-05-18T21:24:57.850 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jsonpatch. 2020-05-18T21:24:57.867 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../73-python3-jsonpatch_1.23-3_all.deb ... 2020-05-18T21:24:57.908 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jsonpatch (1.23-3) ... 2020-05-18T21:24:58.211 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-05-18T21:24:58.230 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../74-ceph-mgr-rook_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:24:58.269 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-rook (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:58.492 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-colorama. 2020-05-18T21:24:58.509 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../81-python3-colorama_0.4.3-1build1_all.deb ... 2020-05-18T21:24:58.550 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2020-05-18T21:24:58.589 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libonig5:amd64. 2020-05-18T21:24:58.608 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../75-libonig5_6.9.4-1_amd64.deb ... 2020-05-18T21:24:58.647 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2020-05-18T21:24:58.837 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephfs-shell. 2020-05-18T21:24:58.856 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../82-cephfs-shell_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:24:58.899 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephfs-shell (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:59.033 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libjq1:amd64. 2020-05-18T21:24:59.052 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../76-libjq1_1.6-1_amd64.deb ... 2020-05-18T21:24:59.106 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libcephfs-dev. 2020-05-18T21:24:59.120 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libjq1:amd64 (1.6-1) ... 2020-05-18T21:24:59.124 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../83-libcephfs-dev_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:24:59.155 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libcephfs-dev (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:24:59.377 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package jq. 2020-05-18T21:24:59.394 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../77-jq_1.6-1_amd64.deb ... 2020-05-18T21:24:59.435 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking jq (1.6-1) ... 2020-05-18T21:24:59.567 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-atomicwrites. 2020-05-18T21:24:59.584 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../84-python3-atomicwrites_1.1.5-2build1_all.deb ... 2020-05-18T21:24:59.663 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package socat. 2020-05-18T21:24:59.681 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../78-socat_1.7.3.3-2_amd64.deb ... 2020-05-18T21:24:59.712 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking socat (1.7.3.3-2) ... 2020-05-18T21:24:59.908 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2020-05-18T21:25:00.016 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package xmlstarlet. 2020-05-18T21:25:00.034 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../79-xmlstarlet_1.6.1-2build1_amd64.deb ... 2020-05-18T21:25:00.127 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2020-05-18T21:25:00.203 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-attr. 2020-05-18T21:25:00.223 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../85-python3-attr_19.3.0-2_all.deb ... 2020-05-18T21:25:00.260 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-attr (19.3.0-2) ... 2020-05-18T21:25:00.378 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-test. 2020-05-18T21:25:00.395 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../80-ceph-test_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:25:00.427 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-test (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:00.663 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-webencodings. 2020-05-18T21:25:00.681 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../86-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2020-05-18T21:25:00.730 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2020-05-18T21:25:01.032 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-html5lib. 2020-05-18T21:25:01.049 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../87-python3-html5lib_1.0.1-2_all.deb ... 2020-05-18T21:25:01.090 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2020-05-18T21:25:01.469 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-lxml:amd64. 2020-05-18T21:25:01.488 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../88-python3-lxml_4.5.0-1_amd64.deb ... 2020-05-18T21:25:01.527 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-lxml:amd64 (4.5.0-1) ... 2020-05-18T21:25:01.955 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-packaging. 2020-05-18T21:25:01.973 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../89-python3-packaging_20.3-1_all.deb ... 2020-05-18T21:25:02.013 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-packaging (20.3-1) ... 2020-05-18T21:25:02.333 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pastescript. 2020-05-18T21:25:02.352 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../90-python3-pastescript_2.0.2-4_all.deb ... 2020-05-18T21:25:02.391 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2020-05-18T21:25:02.711 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pluggy. 2020-05-18T21:25:02.728 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../91-python3-pluggy_0.13.0-2_all.deb ... 2020-05-18T21:25:02.769 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2020-05-18T21:25:03.089 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-psutil. 2020-05-18T21:25:03.106 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../92-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2020-05-18T21:25:03.147 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2020-05-18T21:25:03.454 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-py. 2020-05-18T21:25:03.469 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../93-python3-py_1.8.1-1_all.deb ... 2020-05-18T21:25:03.499 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-py (1.8.1-1) ... 2020-05-18T21:25:03.861 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyinotify. 2020-05-18T21:25:03.878 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../94-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2020-05-18T21:25:03.919 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2020-05-18T21:25:04.175 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-colorama. 2020-05-18T21:25:04.192 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../81-python3-colorama_0.4.3-1build1_all.deb ... 2020-05-18T21:25:04.232 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2020-05-18T21:25:04.238 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pytest. 2020-05-18T21:25:04.257 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../95-python3-pytest_4.6.9-1_all.deb ... 2020-05-18T21:25:04.296 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pytest (4.6.9-1) ... 2020-05-18T21:25:04.444 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package cephfs-shell. 2020-05-18T21:25:04.464 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../82-cephfs-shell_16.0.0-1640-g543315c9344-1focal_all.deb ... 2020-05-18T21:25:04.493 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking cephfs-shell (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:04.746 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libcephfs-dev. 2020-05-18T21:25:04.765 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../83-libcephfs-dev_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:25:04.792 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package radosgw. 2020-05-18T21:25:04.804 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libcephfs-dev (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:04.812 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../96-radosgw_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:25:04.850 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking radosgw (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:05.141 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-atomicwrites. 2020-05-18T21:25:05.158 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../84-python3-atomicwrites_1.1.5-2build1_all.deb ... 2020-05-18T21:25:05.199 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2020-05-18T21:25:05.476 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-attr. 2020-05-18T21:25:05.494 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../85-python3-attr_19.3.0-2_all.deb ... 2020-05-18T21:25:05.534 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-attr (19.3.0-2) ... 2020-05-18T21:25:05.845 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package rbd-fuse. 2020-05-18T21:25:05.846 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-webencodings. 2020-05-18T21:25:05.862 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../97-rbd-fuse_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:25:05.863 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../86-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2020-05-18T21:25:05.903 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking rbd-fuse (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:05.904 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2020-05-18T21:25:06.182 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-attr (19.3.0-2) ... 2020-05-18T21:25:06.206 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-html5lib. 2020-05-18T21:25:06.225 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../87-python3-html5lib_1.0.1-2_all.deb ... 2020-05-18T21:25:06.264 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2020-05-18T21:25:06.533 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2020-05-18T21:25:06.626 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-lxml:amd64. 2020-05-18T21:25:06.646 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../88-python3-lxml_4.5.0-1_amd64.deb ... 2020-05-18T21:25:06.659 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2020-05-18T21:25:06.684 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-lxml:amd64 (4.5.0-1) ... 2020-05-18T21:25:06.785 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephadm (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:07.146 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-packaging. 2020-05-18T21:25:07.163 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../89-python3-packaging_20.3-1_all.deb ... 2020-05-18T21:25:07.203 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-packaging (20.3-1) ... 2020-05-18T21:25:07.426 INFO:teuthology.orchestra.run.smithi155.stdout:Adding system user cephadm....done 2020-05-18T21:25:07.507 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pastescript. 2020-05-18T21:25:07.525 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../90-python3-pastescript_2.0.2-4_all.deb ... 2020-05-18T21:25:07.565 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2020-05-18T21:25:07.574 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-waitress (1.4.1-1) ... 2020-05-18T21:25:07.967 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-repoze.lru (0.7-2) ... 2020-05-18T21:25:07.977 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pluggy. 2020-05-18T21:25:07.994 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../91-python3-pluggy_0.13.0-2_all.deb ... 2020-05-18T21:25:08.034 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2020-05-18T21:25:08.268 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liboath0 (2.6.1-1.3) ... 2020-05-18T21:25:08.346 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-psutil. 2020-05-18T21:25:08.365 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../92-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2020-05-18T21:25:08.404 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2020-05-18T21:25:08.419 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-py (1.8.1-1) ... 2020-05-18T21:25:08.749 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-py. 2020-05-18T21:25:08.754 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-joblib (0.14.0-3) ... 2020-05-18T21:25:08.766 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../93-python3-py_1.8.1-1_all.deb ... 2020-05-18T21:25:08.807 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-py (1.8.1-1) ... 2020-05-18T21:25:09.127 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyinotify. 2020-05-18T21:25:09.148 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../94-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2020-05-18T21:25:09.164 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cachetools (4.0.0-1) ... 2020-05-18T21:25:09.185 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2020-05-18T21:25:09.465 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2020-05-18T21:25:09.521 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pytest. 2020-05-18T21:25:09.538 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../95-python3-pytest_4.6.9-1_all.deb ... 2020-05-18T21:25:09.579 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pytest (4.6.9-1) ... 2020-05-18T21:25:09.758 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2020-05-18T21:25:09.983 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package radosgw. 2020-05-18T21:25:10.001 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../96-radosgw_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:25:10.033 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking radosgw (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:10.067 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2020-05-18T21:25:10.360 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2020-05-18T21:25:10.678 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-ceph-argparse (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:10.970 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2020-05-18T21:25:11.095 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package rbd-fuse. 2020-05-18T21:25:11.096 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2020-05-18T21:25:11.112 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../97-rbd-fuse_16.0.0-1640-g543315c9344-1focal_amd64.deb ... 2020-05-18T21:25:11.152 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking rbd-fuse (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:11.397 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2020-05-18T21:25:11.450 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-attr (19.3.0-2) ... 2020-05-18T21:25:11.673 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2020-05-18T21:25:11.748 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2020-05-18T21:25:11.849 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2020-05-18T21:25:11.958 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2020-05-18T21:25:11.958 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up cephadm (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:12.351 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2020-05-18T21:25:12.652 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2020-05-18T21:25:12.703 INFO:teuthology.orchestra.run.smithi063.stdout:Adding system user cephadm....done 2020-05-18T21:25:12.873 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-waitress (1.4.1-1) ... 2020-05-18T21:25:12.920 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-tempita (0.5.2-6) ... 2020-05-18T21:25:13.207 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-repoze.lru (0.7-2) ... 2020-05-18T21:25:13.221 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-packaging (20.3-1) ... 2020-05-18T21:25:13.492 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liboath0 (2.6.1-1.3) ... 2020-05-18T21:25:13.505 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2020-05-18T21:25:13.609 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-py (1.8.1-1) ... 2020-05-18T21:25:13.631 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2020-05-18T21:25:13.932 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2020-05-18T21:25:13.952 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-joblib (0.14.0-3) ... 2020-05-18T21:25:14.333 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2020-05-18T21:25:14.370 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cachetools (4.0.0-1) ... 2020-05-18T21:25:14.643 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2020-05-18T21:25:14.671 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2020-05-18T21:25:14.973 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2020-05-18T21:25:15.036 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up socat (1.7.3.3-2) ... 2020-05-18T21:25:15.145 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-ceph-common (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:15.257 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2020-05-18T21:25:15.460 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-html5lib (1.0.1-2) ... 2020-05-18T21:25:15.550 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2020-05-18T21:25:15.806 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2020-05-18T21:25:15.826 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-ceph-argparse (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:15.932 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2020-05-18T21:25:16.058 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pluggy (0.13.0-2) ... 2020-05-18T21:25:16.118 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2020-05-18T21:25:16.244 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2020-05-18T21:25:16.351 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-json-pointer (2.0-0ubuntu1) ... 2020-05-18T21:25:16.529 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2020-05-18T21:25:16.635 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-lxml:amd64 (4.5.0-1) ... 2020-05-18T21:25:16.822 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2020-05-18T21:25:16.928 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2020-05-18T21:25:17.123 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2020-05-18T21:25:17.221 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2020-05-18T21:25:17.482 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2020-05-18T21:25:17.489 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-logutils (0.3.3-7) ... 2020-05-18T21:25:17.750 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2020-05-18T21:25:17.773 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-modules-core (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:17.899 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2020-05-18T21:25:18.035 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-tempita (0.5.2-6) ... 2020-05-18T21:25:18.050 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2020-05-18T21:25:18.319 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-packaging (20.3-1) ... 2020-05-18T21:25:18.340 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-prettytable (0.7.2-5) ... 2020-05-18T21:25:18.620 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2020-05-18T21:25:18.646 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2020-05-18T21:25:18.746 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2020-05-18T21:25:18.922 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2020-05-18T21:25:19.030 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2020-05-18T21:25:19.219 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-05-18T21:25:19.432 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2020-05-18T21:25:19.457 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2020-05-18T21:25:19.600 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2020-05-18T21:25:19.741 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2020-05-18T21:25:19.893 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2020-05-18T21:25:20.093 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up socat (1.7.3.3-2) ... 2020-05-18T21:25:20.218 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-ceph-common (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:20.328 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2020-05-18T21:25:20.528 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-html5lib (1.0.1-2) ... 2020-05-18T21:25:20.662 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libjs-underscore (1.9.1~dfsg-1) ... 2020-05-18T21:25:20.780 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2020-05-18T21:25:20.871 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2020-05-18T21:25:20.906 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-webob (1:1.8.5-2) ... 2020-05-18T21:25:20.998 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2020-05-18T21:25:21.124 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pluggy (0.13.0-2) ... 2020-05-18T21:25:21.216 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librados2 (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:21.366 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2020-05-18T21:25:21.433 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-json-pointer (2.0-0ubuntu1) ... 2020-05-18T21:25:21.700 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-lxml:amd64 (4.5.0-1) ... 2020-05-18T21:25:22.001 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2020-05-18T21:25:22.336 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2020-05-18T21:25:22.629 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-logutils (0.3.3-7) ... 2020-05-18T21:25:22.847 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librgw2 (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:22.955 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-modules-core (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:23.006 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libjq1:amd64 (1.6-1) ... 2020-05-18T21:25:23.081 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2020-05-18T21:25:23.132 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pytest (4.6.9-1) ... 2020-05-18T21:25:23.207 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2020-05-18T21:25:23.509 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-prettytable (0.7.2-5) ... 2020-05-18T21:25:23.509 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jsonpatch (1.23-3) ... 2020-05-18T21:25:23.598 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/jsonpatch-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2020-05-18T21:25:23.801 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2020-05-18T21:25:23.843 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2020-05-18T21:25:24.102 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2020-05-18T21:25:24.136 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-bs4 (4.8.2-1) ... 2020-05-18T21:25:24.428 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-05-18T21:25:24.462 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libcephfs2 (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:24.590 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libradosstriper1 (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:24.714 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2020-05-18T21:25:25.029 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2020-05-18T21:25:25.048 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2020-05-18T21:25:25.156 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2020-05-18T21:25:25.448 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2020-05-18T21:25:25.775 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2020-05-18T21:25:26.070 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librbd1 (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:26.126 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libjs-underscore (1.9.1~dfsg-1) ... 2020-05-18T21:25:26.179 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2020-05-18T21:25:26.243 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2020-05-18T21:25:26.339 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up jq (1.6-1) ... 2020-05-18T21:25:26.345 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-webob (1:1.8.5-2) ... 2020-05-18T21:25:26.465 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rsa (4.0-3) ... 2020-05-18T21:25:26.662 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librados2 (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:26.766 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-webtest (2.0.32-2) ... 2020-05-18T21:25:26.779 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2020-05-18T21:25:27.107 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-fuse (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:27.322 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-05-18T21:25:27.323 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-05-18T21:25:27.801 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libcephfs-dev (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:27.944 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pastescript (2.0.2-4) ... 2020-05-18T21:25:28.237 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2020-05-18T21:25:28.302 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librgw2 (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:28.402 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libjq1:amd64 (1.6-1) ... 2020-05-18T21:25:28.503 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pytest (4.6.9-1) ... 2020-05-18T21:25:28.572 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rados (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:28.698 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rbd (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:28.849 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up rbd-fuse (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:28.888 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jsonpatch (1.23-3) ... 2020-05-18T21:25:28.975 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-routes (2.4.1-2) ... 2020-05-18T21:25:28.987 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/bin/jsonpatch-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2020-05-18T21:25:29.223 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2020-05-18T21:25:29.276 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-google-auth (1.5.1-2) ... 2020-05-18T21:25:29.524 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-bs4 (4.8.2-1) ... 2020-05-18T21:25:29.602 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rgw (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:29.737 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cephfs (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:29.868 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libcephfs2 (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:29.971 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/lib/python3/dist-packages/ceph_volume_client.py:358: SyntaxWarning: "is not" with a literal. Did you mean "!="? 2020-05-18T21:25:29.972 INFO:teuthology.orchestra.run.smithi155.stdout: group_id = group_id if group_id is not 'None' else None 2020-05-18T21:25:29.972 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/lib/python3/dist-packages/ceph_volume_client.py:381: SyntaxWarning: "is" with a literal. Did you mean "=="? 2020-05-18T21:25:29.972 INFO:teuthology.orchestra.run.smithi155.stdout: readonly = True if access_level is 'r' else False 2020-05-18T21:25:29.973 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/lib/python3/dist-packages/ceph_volume_client.py:1102: SyntaxWarning: "is" with a literal. Did you mean "=="? 2020-05-18T21:25:29.973 INFO:teuthology.orchestra.run.smithi155.stdout: unwanted_access_level = 'r' if want_access_level is 'rw' else 'rw' 2020-05-18T21:25:29.993 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libradosstriper1 (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:30.030 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephfs-shell (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:30.127 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2020-05-18T21:25:30.155 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2020-05-18T21:25:30.453 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2020-05-18T21:25:31.075 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-common (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:31.517 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librbd1 (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:31.643 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2020-05-18T21:25:31.752 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up jq (1.6-1) ... 2020-05-18T21:25:31.763 INFO:teuthology.orchestra.run.smithi155.stdout:Adding group ceph....done 2020-05-18T21:25:31.853 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rsa (4.0-3) ... 2020-05-18T21:25:32.129 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-webtest (2.0.32-2) ... 2020-05-18T21:25:32.164 INFO:teuthology.orchestra.run.smithi155.stdout:Adding system user ceph....done 2020-05-18T21:25:32.340 INFO:teuthology.orchestra.run.smithi155.stdout:Setting system user ceph properties....done 2020-05-18T21:25:32.439 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-fuse (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:32.504 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-05-18T21:25:32.664 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-05-18T21:25:32.664 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-05-18T21:25:32.842 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-05-18T21:25:33.140 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libcephfs-dev (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:33.241 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pastescript (2.0.2-4) ... 2020-05-18T21:25:33.311 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-test (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:33.437 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up radosgw (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:33.542 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2020-05-18T21:25:33.704 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-05-18T21:25:33.704 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-05-18T21:25:33.919 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rados (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:34.045 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rbd (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:34.171 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up rbd-fuse (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:34.297 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-routes (2.4.1-2) ... 2020-05-18T21:25:34.406 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-base (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:34.590 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-google-auth (1.5.1-2) ... 2020-05-18T21:25:34.738 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-05-18T21:25:34.900 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rgw (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:35.000 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cephfs (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:35.224 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mds (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:35.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/lib/python3/dist-packages/ceph_volume_client.py:358: SyntaxWarning: "is not" with a literal. Did you mean "!="? 2020-05-18T21:25:35.235 INFO:teuthology.orchestra.run.smithi063.stdout: group_id = group_id if group_id is not 'None' else None 2020-05-18T21:25:35.235 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/lib/python3/dist-packages/ceph_volume_client.py:381: SyntaxWarning: "is" with a literal. Did you mean "=="? 2020-05-18T21:25:35.235 INFO:teuthology.orchestra.run.smithi063.stdout: readonly = True if access_level is 'r' else False 2020-05-18T21:25:35.236 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/lib/python3/dist-packages/ceph_volume_client.py:1102: SyntaxWarning: "is" with a literal. Did you mean "=="? 2020-05-18T21:25:35.236 INFO:teuthology.orchestra.run.smithi063.stdout: unwanted_access_level = 'r' if want_access_level is 'rw' else 'rw' 2020-05-18T21:25:35.302 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up cephfs-shell (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:35.427 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2020-05-18T21:25:35.445 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-05-18T21:25:35.445 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-05-18T21:25:35.917 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:36.143 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-05-18T21:25:36.144 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-05-18T21:25:36.381 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-common (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:36.635 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-diskprediction-cloud (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:36.786 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-rook (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:36.929 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-osd (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:36.976 INFO:teuthology.orchestra.run.smithi063.stdout:Adding group ceph....done 2020-05-18T21:25:37.432 INFO:teuthology.orchestra.run.smithi063.stdout:Adding system user ceph....done 2020-05-18T21:25:37.518 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-05-18T21:25:37.519 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-05-18T21:25:37.612 INFO:teuthology.orchestra.run.smithi063.stdout:Setting system user ceph properties....done 2020-05-18T21:25:37.789 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-05-18T21:25:37.990 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-k8sevents (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:38.120 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-05-18T21:25:38.121 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-diskprediction-local (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:38.258 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mon (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:38.482 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-05-18T21:25:38.482 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-05-18T21:25:38.599 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-test (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:38.725 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up radosgw (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:38.951 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-cephadm (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:39.000 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-05-18T21:25:39.001 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-05-18T21:25:39.110 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:39.236 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-dashboard (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:39.388 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for systemd (245.4-4ubuntu3) ... 2020-05-18T21:25:39.697 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for man-db (2.9.1-1) ... 2020-05-18T21:25:39.702 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-base (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:40.042 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-05-18T21:25:40.512 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mds (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:40.746 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-05-18T21:25:40.747 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-05-18T21:25:41.108 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for libc-bin (2.31-0ubuntu9) ... 2020-05-18T21:25:41.239 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:41.494 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-05-18T21:25:41.495 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-05-18T21:25:41.536 INFO:teuthology.orchestra.run.smithi155.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-05-18T21:25:41.539 INFO:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2020-05-18T21:25:41.609 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2020-05-18T21:25:41.742 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2020-05-18T21:25:41.743 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2020-05-18T21:25:41.869 INFO:teuthology.orchestra.run.smithi155.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2020-05-18T21:25:41.870 INFO:teuthology.orchestra.run.smithi155.stdout:libtool-bin is already the newest version (2.4.6-14). 2020-05-18T21:25:41.870 INFO:teuthology.orchestra.run.smithi155.stdout:network-manager is already the newest version (1.22.10-1ubuntu1). 2020-05-18T21:25:41.870 INFO:teuthology.orchestra.run.smithi155.stdout:network-manager set to manually installed. 2020-05-18T21:25:41.870 INFO:teuthology.orchestra.run.smithi155.stdout:util-linux is already the newest version (2.34-0.1ubuntu9). 2020-05-18T21:25:41.871 INFO:teuthology.orchestra.run.smithi155.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9). 2020-05-18T21:25:41.871 INFO:teuthology.orchestra.run.smithi155.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2020-05-18T21:25:41.871 INFO:teuthology.orchestra.run.smithi155.stdout:The following package was automatically installed and is no longer required: 2020-05-18T21:25:41.872 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.71.0 2020-05-18T21:25:41.872 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove it. 2020-05-18T21:25:41.872 INFO:teuthology.orchestra.run.smithi155.stdout:The following additional packages will be installed: 2020-05-18T21:25:41.872 INFO:teuthology.orchestra.run.smithi155.stdout: libfl-dev libfl2 liblzo2-2 2020-05-18T21:25:41.872 INFO:teuthology.orchestra.run.smithi155.stdout:Suggested packages: 2020-05-18T21:25:41.873 INFO:teuthology.orchestra.run.smithi155.stdout: bison-doc flex-doc indent-doc libssl-doc 2020-05-18T21:25:41.892 INFO:teuthology.orchestra.run.smithi155.stdout:The following NEW packages will be installed: 2020-05-18T21:25:41.892 INFO:teuthology.orchestra.run.smithi155.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2020-05-18T21:25:41.893 INFO:teuthology.orchestra.run.smithi155.stdout: libssl-dev 2020-05-18T21:25:41.948 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-diskprediction-cloud (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:42.076 INFO:teuthology.orchestra.run.smithi155.stdout:0 upgraded, 10 newly installed, 0 to remove and 45 not upgraded. 2020-05-18T21:25:42.076 INFO:teuthology.orchestra.run.smithi155.stdout:Need to get 2,912 kB of archives. 2020-05-18T21:25:42.077 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 12.4 MB of additional disk space will be used. 2020-05-18T21:25:42.077 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2020-05-18T21:25:42.091 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-rook (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:42.234 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-osd (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:42.551 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2020-05-18T21:25:42.687 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2020-05-18T21:25:42.693 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2020-05-18T21:25:42.711 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2020-05-18T21:25:42.719 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2020-05-18T21:25:42.719 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2020-05-18T21:25:42.725 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2020-05-18T21:25:42.726 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2020-05-18T21:25:42.726 INFO:teuthology.orchestra.run.smithi155.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2 [1,582 kB] 2020-05-18T21:25:42.799 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-05-18T21:25:42.799 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-05-18T21:25:43.195 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 2,912 kB in 1s (3,144 kB/s) 2020-05-18T21:25:43.262 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-k8sevents (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:43.339 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package flex. 2020-05-18T21:25:43.403 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 156462 files and directories currently installed.) 2020-05-18T21:25:43.408 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2020-05-18T21:25:43.411 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-diskprediction-local (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:43.445 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking flex (2.6.4-6.2) ... 2020-05-18T21:25:43.554 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mon (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:43.783 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-05-18T21:25:43.783 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-05-18T21:25:43.950 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package bison. 2020-05-18T21:25:43.968 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2020-05-18T21:25:44.012 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2020-05-18T21:25:44.255 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-cephadm (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:44.390 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:44.420 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblzo2-2:amd64. 2020-05-18T21:25:44.441 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2020-05-18T21:25:44.490 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-dashboard (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:25:44.520 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2020-05-18T21:25:44.618 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for systemd (245.4-4ubuntu3) ... 2020-05-18T21:25:44.907 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package dump. 2020-05-18T21:25:44.924 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2020-05-18T21:25:44.926 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for man-db (2.9.1-1) ... 2020-05-18T21:25:44.965 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking dump (0.4b46-6) ... 2020-05-18T21:25:45.243 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package indent. 2020-05-18T21:25:45.261 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2020-05-18T21:25:45.301 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking indent (2.2.12-1) ... 2020-05-18T21:25:45.579 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libaio-dev:amd64. 2020-05-18T21:25:45.598 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2020-05-18T21:25:45.637 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2020-05-18T21:25:45.915 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libelf-dev:amd64. 2020-05-18T21:25:45.934 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2020-05-18T21:25:45.982 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2020-05-18T21:25:46.354 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for libc-bin (2.31-0ubuntu9) ... 2020-05-18T21:25:46.485 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libfl2:amd64. 2020-05-18T21:25:46.504 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2020-05-18T21:25:46.543 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2020-05-18T21:25:46.754 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-05-18T21:25:46.757 INFO:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2020-05-18T21:25:46.806 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libfl-dev:amd64. 2020-05-18T21:25:46.822 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2020-05-18T21:25:46.824 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2020-05-18T21:25:46.863 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2020-05-18T21:25:46.959 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2020-05-18T21:25:46.960 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2020-05-18T21:25:47.094 INFO:teuthology.orchestra.run.smithi063.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2020-05-18T21:25:47.095 INFO:teuthology.orchestra.run.smithi063.stdout:libtool-bin is already the newest version (2.4.6-14). 2020-05-18T21:25:47.095 INFO:teuthology.orchestra.run.smithi063.stdout:network-manager is already the newest version (1.22.10-1ubuntu1). 2020-05-18T21:25:47.095 INFO:teuthology.orchestra.run.smithi063.stdout:network-manager set to manually installed. 2020-05-18T21:25:47.096 INFO:teuthology.orchestra.run.smithi063.stdout:util-linux is already the newest version (2.34-0.1ubuntu9). 2020-05-18T21:25:47.096 INFO:teuthology.orchestra.run.smithi063.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9). 2020-05-18T21:25:47.096 INFO:teuthology.orchestra.run.smithi063.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2020-05-18T21:25:47.096 INFO:teuthology.orchestra.run.smithi063.stdout:The following package was automatically installed and is no longer required: 2020-05-18T21:25:47.096 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-iostreams1.71.0 2020-05-18T21:25:47.097 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove it. 2020-05-18T21:25:47.097 INFO:teuthology.orchestra.run.smithi063.stdout:The following additional packages will be installed: 2020-05-18T21:25:47.097 INFO:teuthology.orchestra.run.smithi063.stdout: libfl-dev libfl2 liblzo2-2 2020-05-18T21:25:47.098 INFO:teuthology.orchestra.run.smithi063.stdout:Suggested packages: 2020-05-18T21:25:47.098 INFO:teuthology.orchestra.run.smithi063.stdout: bison-doc flex-doc indent-doc libssl-doc 2020-05-18T21:25:47.118 INFO:teuthology.orchestra.run.smithi063.stdout:The following NEW packages will be installed: 2020-05-18T21:25:47.118 INFO:teuthology.orchestra.run.smithi063.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2020-05-18T21:25:47.119 INFO:teuthology.orchestra.run.smithi063.stdout: libssl-dev 2020-05-18T21:25:47.132 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libssl-dev:amd64. 2020-05-18T21:25:47.149 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2_amd64.deb ... 2020-05-18T21:25:47.190 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2) ... 2020-05-18T21:25:47.299 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 10 newly installed, 0 to remove and 45 not upgraded. 2020-05-18T21:25:47.299 INFO:teuthology.orchestra.run.smithi063.stdout:Need to get 2,912 kB of archives. 2020-05-18T21:25:47.300 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 12.4 MB of additional disk space will be used. 2020-05-18T21:25:47.300 INFO:teuthology.orchestra.run.smithi063.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2020-05-18T21:25:47.653 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up flex (2.6.4-6.2) ... 2020-05-18T21:25:47.768 INFO:teuthology.orchestra.run.smithi063.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2020-05-18T21:25:47.778 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2020-05-18T21:25:47.904 INFO:teuthology.orchestra.run.smithi063.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2020-05-18T21:25:47.910 INFO:teuthology.orchestra.run.smithi063.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2020-05-18T21:25:47.928 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2020-05-18T21:25:47.929 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2020-05-18T21:25:47.935 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2020-05-18T21:25:47.936 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2020-05-18T21:25:47.941 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2020-05-18T21:25:47.947 INFO:teuthology.orchestra.run.smithi063.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2020-05-18T21:25:47.948 INFO:teuthology.orchestra.run.smithi063.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2 [1,582 kB] 2020-05-18T21:25:48.055 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2) ... 2020-05-18T21:25:48.181 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2020-05-18T21:25:48.307 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2020-05-18T21:25:48.416 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up dump (0.4b46-6) ... 2020-05-18T21:25:48.427 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 2,912 kB in 1s (3,176 kB/s) 2020-05-18T21:25:48.495 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2020-05-18T21:25:48.559 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2020-05-18T21:25:48.560 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package flex. 2020-05-18T21:25:48.626 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 156462 files and directories currently installed.) 2020-05-18T21:25:48.631 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2020-05-18T21:25:48.632 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2020-05-18T21:25:48.665 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking flex (2.6.4-6.2) ... 2020-05-18T21:25:48.727 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up indent (2.2.12-1) ... 2020-05-18T21:25:48.854 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2020-05-18T21:25:48.980 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for libc-bin (2.31-0ubuntu9) ... 2020-05-18T21:25:49.140 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for man-db (2.9.1-1) ... 2020-05-18T21:25:49.175 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package bison. 2020-05-18T21:25:49.187 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2020-05-18T21:25:49.241 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2020-05-18T21:25:49.642 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liblzo2-2:amd64. 2020-05-18T21:25:49.663 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2020-05-18T21:25:49.743 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2020-05-18T21:25:50.090 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package dump. 2020-05-18T21:25:50.105 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2020-05-18T21:25:50.145 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking dump (0.4b46-6) ... 2020-05-18T21:25:50.516 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package indent. 2020-05-18T21:25:50.534 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2020-05-18T21:25:50.574 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking indent (2.2.12-1) ... 2020-05-18T21:25:50.827 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libaio-dev:amd64. 2020-05-18T21:25:50.848 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2020-05-18T21:25:50.885 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2020-05-18T21:25:51.155 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libelf-dev:amd64. 2020-05-18T21:25:51.173 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2020-05-18T21:25:51.213 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2020-05-18T21:25:51.401 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2020-05-18T21:25:51.566 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libfl2:amd64. 2020-05-18T21:25:51.588 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2020-05-18T21:25:51.641 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2020-05-18T21:25:51.860 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libfl-dev:amd64. 2020-05-18T21:25:51.878 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2020-05-18T21:25:51.910 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2020-05-18T21:25:52.038 INFO:teuthology.orchestra.run.smithi155.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-05-18T21:25:52.039 DEBUG:teuthology.parallel:result is None 2020-05-18T21:25:52.155 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libssl-dev:amd64. 2020-05-18T21:25:52.172 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2_amd64.deb ... 2020-05-18T21:25:52.212 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2) ... 2020-05-18T21:25:52.683 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up flex (2.6.4-6.2) ... 2020-05-18T21:25:52.816 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2020-05-18T21:25:52.935 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2020-05-18T21:25:53.060 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2) ... 2020-05-18T21:25:53.186 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2020-05-18T21:25:53.329 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2020-05-18T21:25:53.455 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up dump (0.4b46-6) ... 2020-05-18T21:25:53.551 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2020-05-18T21:25:53.640 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2020-05-18T21:25:53.739 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2020-05-18T21:25:53.809 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up indent (2.2.12-1) ... 2020-05-18T21:25:53.934 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2020-05-18T21:25:54.061 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for libc-bin (2.31-0ubuntu9) ... 2020-05-18T21:25:54.204 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for man-db (2.9.1-1) ... 2020-05-18T21:25:56.599 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2020-05-18T21:25:57.293 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-05-18T21:25:57.295 DEBUG:teuthology.parallel:result is None 2020-05-18T21:25:57.296 INFO:teuthology.orchestra.run.smithi063:> sudo lsb_release -is 2020-05-18T21:25:57.342 INFO:teuthology.orchestra.run.smithi063.stdout:Ubuntu 2020-05-18T21:25:57.347 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-05-18T21:25:57.348 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=543315c934420269aa12ef2f9dec2c9eadb4fa6f 2020-05-18T21:25:57.614 INFO:teuthology.orchestra.run.smithi063:> dpkg-query -W -f '${Version}' ceph 2020-05-18T21:25:57.648 INFO:teuthology.orchestra.run.smithi063.stdout:16.0.0-1640-g543315c9344-1focal 2020-05-18T21:25:57.649 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-1640-g543315c9344-1focal 2020-05-18T21:25:57.649 INFO:teuthology.task.install:The correct ceph version 16.0.0-1640-g543315c9344-1focal is installed. 2020-05-18T21:25:57.650 INFO:teuthology.orchestra.run.smithi155:> sudo lsb_release -is 2020-05-18T21:25:57.711 INFO:teuthology.orchestra.run.smithi155.stdout:Ubuntu 2020-05-18T21:25:57.716 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-05-18T21:25:57.717 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=543315c934420269aa12ef2f9dec2c9eadb4fa6f 2020-05-18T21:25:57.972 INFO:teuthology.orchestra.run.smithi155:> dpkg-query -W -f '${Version}' ceph 2020-05-18T21:25:57.998 INFO:teuthology.orchestra.run.smithi155.stdout:16.0.0-1640-g543315c9344-1focal 2020-05-18T21:25:57.999 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-1640-g543315c9344-1focal 2020-05-18T21:25:57.999 INFO:teuthology.task.install:The correct ceph version 16.0.0-1640-g543315c9344-1focal is installed. 2020-05-18T21:25:58.000 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-05-18T21:25:58.000 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-05-18T21:25:58.019 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-05-18T21:25:58.037 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-05-18T21:25:58.038 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-05-18T21:25:58.064 INFO:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-05-18T21:25:58.125 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-05-18T21:25:58.144 INFO:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-05-18T21:25:58.160 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-05-18T21:25:58.161 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-05-18T21:25:58.179 INFO:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-05-18T21:25:58.237 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-05-18T21:25:58.255 INFO:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-05-18T21:25:58.265 INFO:teuthology.run_tasks:Running task ceph... 2020-05-18T21:25:58.401 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-05-18T21:25:58.402 INFO:teuthology.orchestra.run.smithi063:> sudo chmod 777 /var/log/ceph 2020-05-18T21:25:58.405 INFO:teuthology.orchestra.run.smithi155:> sudo chmod 777 /var/log/ceph 2020-05-18T21:25:58.422 INFO:tasks.ceph:Disabling ceph logrotate... 2020-05-18T21:25:58.422 INFO:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/logrotate.d/ceph 2020-05-18T21:25:58.462 INFO:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/logrotate.d/ceph 2020-05-18T21:25:58.479 INFO:tasks.ceph:Creating extra log directories... 2020-05-18T21:25:58.479 INFO:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-05-18T21:25:58.482 INFO:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-05-18T21:25:58.533 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-05-18T21:25:58.534 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-05-18T21:25:58.534 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-05-18T21:25:58.535 INFO:teuthology.orchestra.run.smithi063:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-05-18T21:25:58.583 INFO:teuthology.orchestra.run.smithi063:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-05-18T21:25:58.624 INFO:teuthology.orchestra.run.smithi155:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-05-18T21:25:58.632 INFO:teuthology.orchestra.run.smithi155:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-05-18T21:25:58.715 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-05-18T21:25:58.715 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': ''}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2020-05-18T21:25:58.716 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2020-05-18_20:49:47-fs-wip-pdonnell-testing-20200516.030215-distro-basic-smithi/5067927', 'branch': 'wip-pdonnell-testing-20200516.030215', 'description': 'fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/strays.yaml}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '5067927', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2020-05-18_20:49:47-fs-wip-pdonnell-testing-20200516.030215-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20200516.030215'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': ''}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '543315c934420269aa12ef2f9dec2c9eadb4fa6f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': '543315c934420269aa12ef2f9dec2c9eadb4fa6f'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20200516.030215', 'sha1': '543315c934420269aa12ef2f9dec2c9eadb4fa6f'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.1'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.2', 'client.3']], 'sha1': '543315c934420269aa12ef2f9dec2c9eadb4fa6f', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20200516.030215', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200516.030215/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': '543315c934420269aa12ef2f9dec2c9eadb4fa6f', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '543315c934420269aa12ef2f9dec2c9eadb4fa6f'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_strays']}}], 'teuthology_branch': 'master', 'tube': 'smithi', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.5985', 'targets': {'smithi063.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxqmzptgvEdXWQY8G2DFAgm16TtkxwhPDt2qHDnVsX4lf+mDNscy6Acc49d2xovPCFQBqp2WNgyWqUtzpvt2UpV6XH9m7LcwLZWiszL+A8i5fd+FHDZTO5W8oJICeJ/nuHo6ZHGNqTnvkjgqERAtoNcRtz+7x0wEu0+LpYjZL5Ita7e/v5qWT9aZvfIAd7SJ80tzANWwb0EfCW86AXHSEjZ8BfJQvWipnuAW+g9e1/ADNoXxgxckz+7zakpi0x19RAElqb59aKZhLyqO1uys6SwF5iJhox7x4uf/c0UaoED02YX2XNzw+PXjarPhtF0rmCJiCyYJ8sa+6ylQul8qOoJ2SrCifmdGcI1Zxe3zwrRFwlK83mV5ar6h5fsDEBe8vVtKw/93HsSsB5H4PvtKB6LYX1bikcIkHNgOm8GdsK++cY/kyD1AvXv3D+3f5nPivyDiwv6arjAnj39hpN3oI19cD0c3OEQv/eSMWH3sHwmgjwsd3Zbog+idkCUw+tCh0=', 'smithi155.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt5pWAfKKbngKLYWcg7A+vI9BfwvEiBMQk0LIs1b2c14uPYLXFZ9/g5NDEzZD6pdHuNf4+XmeH2uoRJ8MzYvChRcTrKOmFMFJi2eUEpGAVDGqlsq9thUThbWy5xBjLOtQaB9LfKCFgzLQSqmr+mf5WHrNsmdyQHseV6NV+ki58U4ZTFK42BmivnTrc97wTp6tXdMXennNXagGuVB6zpYGIGiAFW593n1eEYC0C70pdVYQe5jez8viZ3hv9MgmPCURLDdgC7OtOjMBip/KvCwjc1Uvy2ZJwEaTajGRMk0Meg/Rs55qphpW3pQxixOaeyEz6QFIddR3WYFAJEChI7UBpsZSPpEbesYc/kco6y6lG0bAH28n+EGbrBjSyj+YyRVhLLmuir6LulfWS4VGxcy+Zi8PCheO2HGGz9MEWWL2AgKbkaRBvGiVPyAz84+xBk+linS2WPJOQS8ZwiBuna3qfxU9pSxwZp9By0H4ztP4EGY7hVT64nILDHPRnrzRq+Ws='}} 2020-05-18T21:25:58.717 INFO:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-05-18T21:25:58.720 INFO:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-05-18T21:25:58.727 INFO:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/run/ceph 2020-05-18T21:25:58.771 INFO:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/run/ceph 2020-05-18T21:25:58.802 DEBUG:teuthology.orchestra.remote:smithi063:/scratch_devs is 72B 2020-05-18T21:25:58.815 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-05-18T21:25:58.816 INFO:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-05-18T21:25:58.823 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-05-18T21:25:58.823 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-05-18T21:25:58.824 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 346 Links: 1 2020-05-18T21:25:58.824 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-05-18T21:25:58.824 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2020-05-18 21:23:27.959998095 +0000 2020-05-18T21:25:58.824 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2020-05-18 21:23:27.955998095 +0000 2020-05-18T21:25:58.824 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2020-05-18 21:23:27.955998095 +0000 2020-05-18T21:25:58.825 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2020-05-18T21:25:58.830 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2020-05-18T21:25:58.831 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2020-05-18T21:25:58.831 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000402181 s, 1.3 MB/s 2020-05-18T21:25:58.836 INFO:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-05-18T21:25:58.887 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-05-18T21:25:58.887 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-05-18T21:25:58.888 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 352 Links: 1 2020-05-18T21:25:58.888 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-05-18T21:25:58.888 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2020-05-18 21:23:28.535998089 +0000 2020-05-18T21:25:58.888 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2020-05-18 21:23:28.351998091 +0000 2020-05-18T21:25:58.888 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2020-05-18 21:23:28.351998091 +0000 2020-05-18T21:25:58.889 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2020-05-18T21:25:58.898 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2020-05-18T21:25:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2020-05-18T21:25:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000401113 s, 1.3 MB/s 2020-05-18T21:25:58.903 INFO:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-05-18T21:25:58.911 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-05-18T21:25:58.911 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-05-18T21:25:58.912 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 361 Links: 1 2020-05-18T21:25:58.912 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-05-18T21:25:58.912 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2020-05-18 21:23:28.915998085 +0000 2020-05-18T21:25:58.912 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2020-05-18 21:23:28.767998086 +0000 2020-05-18T21:25:58.912 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2020-05-18 21:23:28.767998086 +0000 2020-05-18T21:25:58.913 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2020-05-18T21:25:58.918 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2020-05-18T21:25:58.919 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2020-05-18T21:25:58.919 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000392721 s, 1.3 MB/s 2020-05-18T21:25:58.923 INFO:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-05-18T21:25:58.930 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-05-18T21:25:58.931 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-05-18T21:25:58.931 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 367 Links: 1 2020-05-18T21:25:58.931 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-05-18T21:25:58.931 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2020-05-18 21:23:29.343998080 +0000 2020-05-18T21:25:58.932 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2020-05-18 21:23:29.175998082 +0000 2020-05-18T21:25:58.932 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2020-05-18 21:23:29.175998082 +0000 2020-05-18T21:25:58.932 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2020-05-18T21:25:58.938 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2020-05-18T21:25:58.939 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2020-05-18T21:25:58.939 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000413527 s, 1.2 MB/s 2020-05-18T21:25:58.943 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-05-18T21:25:58.956 DEBUG:teuthology.orchestra.remote:smithi155:/scratch_devs is 72B 2020-05-18T21:25:58.972 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-05-18T21:25:58.973 INFO:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-05-18T21:25:58.981 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-05-18T21:25:58.982 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-05-18T21:25:58.982 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 349 Links: 1 2020-05-18T21:25:58.982 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-05-18T21:25:58.982 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2020-05-18 21:23:28.182281392 +0000 2020-05-18T21:25:58.983 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2020-05-18 21:23:28.006281394 +0000 2020-05-18T21:25:58.983 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2020-05-18 21:23:28.006281394 +0000 2020-05-18T21:25:58.983 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2020-05-18T21:25:58.988 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2020-05-18T21:25:58.989 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2020-05-18T21:25:58.989 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000401524 s, 1.3 MB/s 2020-05-18T21:25:58.998 INFO:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-05-18T21:25:59.046 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-05-18T21:25:59.047 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-05-18T21:25:59.047 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 357 Links: 1 2020-05-18T21:25:59.047 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-05-18T21:25:59.048 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2020-05-18 21:23:28.418281390 +0000 2020-05-18T21:25:59.048 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2020-05-18 21:23:28.414281390 +0000 2020-05-18T21:25:59.048 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2020-05-18 21:23:28.414281390 +0000 2020-05-18T21:25:59.048 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2020-05-18T21:25:59.056 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2020-05-18T21:25:59.056 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2020-05-18T21:25:59.057 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000402501 s, 1.3 MB/s 2020-05-18T21:25:59.061 INFO:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-05-18T21:25:59.069 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-05-18T21:25:59.070 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-05-18T21:25:59.070 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 361 Links: 1 2020-05-18T21:25:59.071 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-05-18T21:25:59.071 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2020-05-18 21:23:28.962281384 +0000 2020-05-18T21:25:59.071 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2020-05-18 21:23:28.806281385 +0000 2020-05-18T21:25:59.072 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2020-05-18 21:23:28.806281385 +0000 2020-05-18T21:25:59.072 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2020-05-18T21:25:59.078 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2020-05-18T21:25:59.078 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2020-05-18T21:25:59.079 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000396893 s, 1.3 MB/s 2020-05-18T21:25:59.083 INFO:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-05-18T21:25:59.091 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-05-18T21:25:59.091 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-05-18T21:25:59.091 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 370 Links: 1 2020-05-18T21:25:59.092 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-05-18T21:25:59.092 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2020-05-18 21:23:29.182281381 +0000 2020-05-18T21:25:59.092 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2020-05-18 21:23:29.178281381 +0000 2020-05-18T21:25:59.093 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2020-05-18 21:23:29.178281381 +0000 2020-05-18T21:25:59.093 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2020-05-18T21:25:59.100 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2020-05-18T21:25:59.100 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2020-05-18T21:25:59.100 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000403372 s, 1.3 MB/s 2020-05-18T21:25:59.104 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-05-18T21:25:59.105 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-05-18T21:25:59.105 INFO:tasks.ceph:Generating config... 2020-05-18T21:25:59.108 INFO:tasks.ceph:[client] client mount timeout = 600 2020-05-18T21:25:59.108 INFO:tasks.ceph:[client] debug client = 20 2020-05-18T21:25:59.109 INFO:tasks.ceph:[client] debug ms = 1 2020-05-18T21:25:59.110 INFO:tasks.ceph:[client] pid file = 2020-05-18T21:25:59.110 INFO:tasks.ceph:[mds] debug mds = 20 2020-05-18T21:25:59.111 INFO:tasks.ceph:[mds] debug ms = 1 2020-05-18T21:25:59.111 INFO:tasks.ceph:[mds] mds bal frag = True 2020-05-18T21:25:59.112 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-05-18T21:25:59.112 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-05-18T21:25:59.112 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-05-18T21:25:59.113 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-05-18T21:25:59.113 INFO:tasks.ceph:[mds] mds debug frag = True 2020-05-18T21:25:59.114 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-05-18T21:25:59.115 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-05-18T21:25:59.115 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-05-18T21:25:59.115 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-05-18T21:25:59.116 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-05-18T21:25:59.116 INFO:tasks.ceph:[mgr] debug ms = 1 2020-05-18T21:25:59.117 INFO:tasks.ceph:[mon] debug mon = 20 2020-05-18T21:25:59.117 INFO:tasks.ceph:[mon] debug ms = 1 2020-05-18T21:25:59.118 INFO:tasks.ceph:[mon] debug paxos = 20 2020-05-18T21:25:59.118 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-05-18T21:25:59.119 INFO:tasks.ceph:[osd] bdev async discard = True 2020-05-18T21:25:59.119 INFO:tasks.ceph:[osd] bdev enable discard = True 2020-05-18T21:25:59.120 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2020-05-18T21:25:59.120 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-05-18T21:25:59.121 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-05-18T21:25:59.121 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-05-18T21:25:59.121 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-05-18T21:25:59.122 INFO:tasks.ceph:[osd] debug filestore = 20 2020-05-18T21:25:59.122 INFO:tasks.ceph:[osd] debug journal = 20 2020-05-18T21:25:59.123 INFO:tasks.ceph:[osd] debug ms = 20 2020-05-18T21:25:59.124 INFO:tasks.ceph:[osd] debug osd = 25 2020-05-18T21:25:59.124 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-05-18T21:25:59.124 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-05-18T21:25:59.125 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-05-18T21:25:59.125 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-05-18T21:25:59.126 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-05-18T21:25:59.126 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-05-18T21:25:59.127 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-05-18T21:25:59.127 INFO:tasks.ceph:Setting up mon.a... 2020-05-18T21:25:59.129 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-05-18T21:25:59.181 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.keyring 2020-05-18T21:25:59.183 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-05-18T21:25:59.217 INFO:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-05-18T21:25:59.231 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.63'), ('mon.b', '172.21.15.155'), ('mon.c', '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]')] 2020-05-18T21:25:59.231 INFO:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.63 --add b 172.21.15.155 --addv c '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2020-05-18T21:25:59.266 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-05-18T21:25:59.267 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: generated fsid 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:25:59.267 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 0 2020-05-18T21:25:59.267 INFO:teuthology.orchestra.run.smithi063.stdout:fsid 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:25:59.267 INFO:teuthology.orchestra.run.smithi063.stdout:last_changed 2020-05-18T21:25:59.265727+0000 2020-05-18T21:25:59.268 INFO:teuthology.orchestra.run.smithi063.stdout:created 2020-05-18T21:25:59.265727+0000 2020-05-18T21:25:59.268 INFO:teuthology.orchestra.run.smithi063.stdout:min_mon_release 0 (unknown) 2020-05-18T21:25:59.268 INFO:teuthology.orchestra.run.smithi063.stdout:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2020-05-18T21:25:59.268 INFO:teuthology.orchestra.run.smithi063.stdout:1: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2020-05-18T21:25:59.268 INFO:teuthology.orchestra.run.smithi063.stdout:2: [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] mon.c 2020-05-18T21:25:59.269 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-05-18T21:25:59.270 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 463d54c2-4027-4807-bf42-f25cd6c63d51... 2020-05-18T21:25:59.271 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:25:59.275 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:25:59.303 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2020-05-18T21:25:59.303 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2020-05-18T21:25:59.304 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:25:59.304 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2020-05-18T21:25:59.304 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.304 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2020-05-18T21:25:59.304 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.304 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2020-05-18T21:25:59.305 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.305 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2020-05-18T21:25:59.305 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2020-05-18T21:25:59.305 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.305 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2020-05-18T21:25:59.306 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2020-05-18T21:25:59.306 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.306 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:25:59.306 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2020-05-18T21:25:59.313 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.313 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:25:59.314 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:25:59.314 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.314 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2020-05-18T21:25:59.314 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.314 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2020-05-18T21:25:59.315 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2020-05-18T21:25:59.315 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:25:59.315 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:25:59.315 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2020-05-18T21:25:59.315 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:25:59.315 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2020-05-18T21:25:59.316 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:25:59.316 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:25:59.316 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2020-05-18T21:25:59.316 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.316 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:25:59.317 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.317 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2020-05-18T21:25:59.317 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.317 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2020-05-18T21:25:59.317 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.318 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2020-05-18T21:25:59.318 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2020-05-18T21:25:59.318 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:25:59.318 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:25:59.318 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.318 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2020-05-18T21:25:59.319 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2020-05-18T21:25:59.319 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.319 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2020-05-18T21:25:59.319 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2020-05-18T21:25:59.319 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.320 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2020-05-18T21:25:59.320 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2020-05-18T21:25:59.320 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.320 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2020-05-18T21:25:59.320 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2020-05-18T21:25:59.321 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2020-05-18T21:25:59.321 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.321 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2020-05-18T21:25:59.321 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2020-05-18T21:25:59.321 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.322 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:25:59.322 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.322 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2020-05-18T21:25:59.322 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.322 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2020-05-18T21:25:59.322 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.323 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:25:59.323 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2020-05-18T21:25:59.323 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.324 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2020-05-18T21:25:59.324 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2020-05-18T21:25:59.324 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2020-05-18T21:25:59.324 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2020-05-18T21:25:59.324 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2020-05-18T21:25:59.325 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2020-05-18T21:25:59.325 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2020-05-18T21:25:59.325 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2020-05-18T21:25:59.325 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2020-05-18T21:25:59.325 INFO:teuthology.orchestra.run.smithi063.stdout: debug filestore = 20 2020-05-18T21:25:59.325 INFO:teuthology.orchestra.run.smithi063.stdout: debug journal = 20 2020-05-18T21:25:59.326 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 20 2020-05-18T21:25:59.326 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 25 2020-05-18T21:25:59.326 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2020-05-18T21:25:59.326 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:25:59.326 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2020-05-18T21:25:59.327 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:25:59.327 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:25:59.327 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2020-05-18T21:25:59.327 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:25:59.327 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.328 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2020-05-18T21:25:59.328 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:25:59.328 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2020-05-18T21:25:59.328 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:25:59.329 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:25:59.329 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:25:59.329 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:25:59.329 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2020-05-18T21:25:59.330 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.330 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2020-05-18T21:25:59.330 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:25:59.330 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:25:59.331 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2020-05-18T21:25:59.331 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:25:59.331 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2020-05-18T21:25:59.331 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2020-05-18T21:25:59.331 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:25:59.331 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2020-05-18T21:25:59.332 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2020-05-18T21:25:59.332 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:25:59.332 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2020-05-18T21:25:59.332 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:25:59.332 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2020-05-18T21:25:59.333 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2020-05-18T21:25:59.333 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2020-05-18T21:25:59.333 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2020-05-18T21:25:59.334 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:25:59.334 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:25:59.334 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2020-05-18T21:25:59.334 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2020-05-18T21:25:59.334 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:25:59.335 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2020-05-18T21:25:59.335 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2020-05-18T21:25:59.335 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2020-05-18T21:25:59.335 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2020-05-18T21:25:59.335 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2020-05-18T21:25:59.336 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2020-05-18T21:25:59.336 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2020-05-18T21:25:59.336 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2020-05-18T21:25:59.336 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:25:59.336 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal frag = True 2020-05-18T21:25:59.336 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal fragment size max = 10000 2020-05-18T21:25:59.337 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal merge size = 5 2020-05-18T21:25:59.337 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split bits = 3 2020-05-18T21:25:59.337 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split size = 100 2020-05-18T21:25:59.337 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2020-05-18T21:25:59.337 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2020-05-18T21:25:59.338 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2020-05-18T21:25:59.338 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2020-05-18T21:25:59.338 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:25:59.339 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2020-05-18T21:25:59.340 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2020-05-18T21:25:59.340 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:25:59.340 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2020-05-18T21:25:59.340 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.340 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2020-05-18T21:25:59.341 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.341 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2020-05-18T21:25:59.341 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.341 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2020-05-18T21:25:59.342 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2020-05-18T21:25:59.342 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.342 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2020-05-18T21:25:59.343 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2020-05-18T21:25:59.343 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.343 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:25:59.343 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2020-05-18T21:25:59.344 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.344 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:25:59.344 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:25:59.344 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.345 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2020-05-18T21:25:59.345 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.345 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2020-05-18T21:25:59.345 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2020-05-18T21:25:59.345 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:25:59.346 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:25:59.346 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2020-05-18T21:25:59.346 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:25:59.346 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2020-05-18T21:25:59.346 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:25:59.347 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:25:59.347 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2020-05-18T21:25:59.347 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.347 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:25:59.347 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.347 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2020-05-18T21:25:59.348 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.348 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2020-05-18T21:25:59.348 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.348 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2020-05-18T21:25:59.348 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2020-05-18T21:25:59.349 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:25:59.349 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:25:59.349 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.349 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2020-05-18T21:25:59.349 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2020-05-18T21:25:59.350 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.350 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2020-05-18T21:25:59.350 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2020-05-18T21:25:59.350 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.350 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2020-05-18T21:25:59.350 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2020-05-18T21:25:59.351 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.351 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2020-05-18T21:25:59.351 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2020-05-18T21:25:59.351 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2020-05-18T21:25:59.351 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.352 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2020-05-18T21:25:59.352 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2020-05-18T21:25:59.352 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.353 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:25:59.353 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.353 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2020-05-18T21:25:59.353 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.353 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2020-05-18T21:25:59.354 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.354 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:25:59.354 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2020-05-18T21:25:59.355 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.355 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2020-05-18T21:25:59.355 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2020-05-18T21:25:59.355 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2020-05-18T21:25:59.355 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2020-05-18T21:25:59.356 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2020-05-18T21:25:59.356 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2020-05-18T21:25:59.356 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2020-05-18T21:25:59.356 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2020-05-18T21:25:59.356 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2020-05-18T21:25:59.356 INFO:teuthology.orchestra.run.smithi155.stdout: debug filestore = 20 2020-05-18T21:25:59.357 INFO:teuthology.orchestra.run.smithi155.stdout: debug journal = 20 2020-05-18T21:25:59.357 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 20 2020-05-18T21:25:59.357 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 25 2020-05-18T21:25:59.357 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2020-05-18T21:25:59.357 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:25:59.358 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2020-05-18T21:25:59.358 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:25:59.358 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:25:59.358 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2020-05-18T21:25:59.358 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:25:59.359 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.359 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2020-05-18T21:25:59.359 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:25:59.359 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2020-05-18T21:25:59.359 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:25:59.360 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:25:59.360 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:25:59.360 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:25:59.360 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2020-05-18T21:25:59.360 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.360 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2020-05-18T21:25:59.361 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:25:59.361 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:25:59.361 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2020-05-18T21:25:59.361 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:25:59.361 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2020-05-18T21:25:59.362 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2020-05-18T21:25:59.362 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:25:59.362 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2020-05-18T21:25:59.362 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2020-05-18T21:25:59.362 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:25:59.362 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2020-05-18T21:25:59.363 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:25:59.363 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2020-05-18T21:25:59.363 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2020-05-18T21:25:59.363 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2020-05-18T21:25:59.363 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2020-05-18T21:25:59.364 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:25:59.364 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:25:59.364 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2020-05-18T21:25:59.364 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2020-05-18T21:25:59.365 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:25:59.365 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2020-05-18T21:25:59.365 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2020-05-18T21:25:59.365 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2020-05-18T21:25:59.365 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2020-05-18T21:25:59.366 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2020-05-18T21:25:59.366 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2020-05-18T21:25:59.366 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2020-05-18T21:25:59.366 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2020-05-18T21:25:59.366 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:25:59.366 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal frag = True 2020-05-18T21:25:59.367 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2020-05-18T21:25:59.367 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2020-05-18T21:25:59.367 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2020-05-18T21:25:59.367 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2020-05-18T21:25:59.367 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2020-05-18T21:25:59.368 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2020-05-18T21:25:59.368 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2020-05-18T21:25:59.368 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2020-05-18T21:25:59.368 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:25:59.368 INFO:tasks.ceph:Creating admin key on mon.a... 2020-05-18T21:25:59.369 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-05-18T21:25:59.425 INFO:tasks.ceph:Copying monmap to all nodes... 2020-05-18T21:25:59.436 DEBUG:teuthology.orchestra.remote:smithi063:/etc/ceph/ceph.keyring is 206B 2020-05-18T21:25:59.473 DEBUG:teuthology.orchestra.remote:smithi063:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-05-18T21:25:59.489 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi063.front.sepia.ceph.com 2020-05-18T21:25:59.489 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-05-18T21:25:59.515 INFO:teuthology.orchestra.run.smithi063:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-05-18T21:25:59.563 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi155.front.sepia.ceph.com 2020-05-18T21:25:59.563 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-05-18T21:25:59.592 INFO:teuthology.orchestra.run.smithi155:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-05-18T21:25:59.598 INFO:tasks.ceph:Setting up mon nodes... 2020-05-18T21:25:59.599 INFO:tasks.ceph:Setting up mgr nodes... 2020-05-18T21:25:59.599 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-05-18T21:25:59.643 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-05-18T21:25:59.646 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-05-18T21:25:59.714 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-05-18T21:25:59.717 INFO:tasks.ceph:Setting up mds nodes... 2020-05-18T21:25:59.717 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-05-18T21:25:59.767 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-05-18T21:25:59.770 INFO:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-05-18T21:25:59.783 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-05-18T21:25:59.826 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-05-18T21:25:59.829 INFO:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-05-18T21:25:59.885 INFO:tasks.ceph_client:Setting up client nodes... 2020-05-18T21:25:59.886 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-05-18T21:25:59.920 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-05-18T21:25:59.934 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2020-05-18T21:26:00.014 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.client.1.keyring 2020-05-18T21:26:00.028 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2020-05-18T21:26:00.064 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.2.keyring 2020-05-18T21:26:00.077 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2020-05-18T21:26:00.105 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.3.keyring 2020-05-18T21:26:00.116 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-05-18T21:26:00.117 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-05-18T21:26:00.117 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-05-18T21:26:00.135 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-05-18T21:26:00.135 INFO:tasks.ceph:role: osd.0 2020-05-18T21:26:00.135 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com 2020-05-18T21:26:00.136 INFO:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-05-18T21:26:00.669 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-05-18T21:26:00.669 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2020-05-18T21:26:00.669 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-05-18T21:26:00.670 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 2020-05-18T21:26:00.670 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-05-18T21:26:00.670 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2020-05-18T21:26:00.670 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-05-18T21:26:00.670 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-05-18T21:26:00.670 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-05-18T21:26:00.671 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-05-18T21:26:00.672 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2020-05-18T21:26:00.672 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2020-05-18T21:26:00.777 INFO:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-05-18T21:26:00.790 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: /sbin/restorecon: command not found 2020-05-18T21:26:00.790 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:26:00.791 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-05-18T21:26:00.805 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-05-18T21:26:00.805 INFO:tasks.ceph:role: osd.1 2020-05-18T21:26:00.805 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com 2020-05-18T21:26:00.806 INFO:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-05-18T21:26:01.331 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-05-18T21:26:01.331 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2020-05-18T21:26:01.331 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-05-18T21:26:01.332 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 2020-05-18T21:26:01.332 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-05-18T21:26:01.332 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2020-05-18T21:26:01.332 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-05-18T21:26:01.333 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-05-18T21:26:01.333 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-05-18T21:26:01.333 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-05-18T21:26:01.334 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2020-05-18T21:26:01.334 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2020-05-18T21:26:01.370 INFO:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-05-18T21:26:01.383 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: /sbin/restorecon: command not found 2020-05-18T21:26:01.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:26:01.384 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-05-18T21:26:01.444 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-05-18T21:26:01.445 INFO:tasks.ceph:role: osd.2 2020-05-18T21:26:01.445 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com 2020-05-18T21:26:01.446 INFO:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-05-18T21:26:01.924 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-05-18T21:26:01.924 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2020-05-18T21:26:01.925 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-05-18T21:26:01.925 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 2020-05-18T21:26:01.925 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-05-18T21:26:01.925 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2020-05-18T21:26:01.926 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-05-18T21:26:01.926 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-05-18T21:26:01.926 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-05-18T21:26:01.926 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-05-18T21:26:01.927 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2020-05-18T21:26:01.928 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2020-05-18T21:26:01.977 INFO:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-05-18T21:26:01.988 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: /sbin/restorecon: command not found 2020-05-18T21:26:01.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:26:01.989 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-05-18T21:26:02.003 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-05-18T21:26:02.004 INFO:tasks.ceph:role: osd.3 2020-05-18T21:26:02.005 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com 2020-05-18T21:26:02.005 INFO:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-05-18T21:26:02.523 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-05-18T21:26:02.524 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2020-05-18T21:26:02.524 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-05-18T21:26:02.525 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 2020-05-18T21:26:02.525 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-05-18T21:26:02.525 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2020-05-18T21:26:02.526 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-05-18T21:26:02.526 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-05-18T21:26:02.526 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-05-18T21:26:02.527 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-05-18T21:26:02.528 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2020-05-18T21:26:02.529 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2020-05-18T21:26:02.583 INFO:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-05-18T21:26:02.593 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: /sbin/restorecon: command not found 2020-05-18T21:26:02.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:26:02.595 INFO:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-05-18T21:26:02.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:02.651+0000 7f653ed21dc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-05-18T21:26:02.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:02.651+0000 7f653ed21dc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-05-18T21:26:02.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:02.651+0000 7f653ed21dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-05-18T21:26:02.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:02.651+0000 7f653ed21dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-05-18T21:26:02.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:02.651+0000 7f653ed21dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-05-18T21:26:02.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:02.655+0000 7f653ed21dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-05-18T21:26:05.112 INFO:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-05-18T21:26:05.128 INFO:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-05-18T21:26:05.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:05.159+0000 7f01da18cdc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-05-18T21:26:05.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:05.159+0000 7f01da18cdc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-05-18T21:26:05.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:05.159+0000 7f01da18cdc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-05-18T21:26:05.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:05.159+0000 7f01da18cdc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-05-18T21:26:05.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:05.159+0000 7f01da18cdc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-05-18T21:26:05.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:05.163+0000 7f01da18cdc0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-05-18T21:26:07.644 INFO:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-05-18T21:26:07.660 INFO:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-05-18T21:26:07.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:07.739+0000 7f77bcc5bdc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-05-18T21:26:07.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:07.739+0000 7f77bcc5bdc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-05-18T21:26:07.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:07.739+0000 7f77bcc5bdc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-05-18T21:26:07.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:07.739+0000 7f77bcc5bdc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-05-18T21:26:07.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:07.739+0000 7f77bcc5bdc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-05-18T21:26:07.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:07.743+0000 7f77bcc5bdc0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-05-18T21:26:10.211 INFO:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-05-18T21:26:10.228 INFO:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-05-18T21:26:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:10.259+0000 7efee63d2dc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-05-18T21:26:10.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:10.259+0000 7efee63d2dc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-05-18T21:26:10.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:10.259+0000 7efee63d2dc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-05-18T21:26:10.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:10.259+0000 7efee63d2dc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-05-18T21:26:10.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:10.259+0000 7efee63d2dc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-05-18T21:26:10.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:10.263+0000 7efee63d2dc0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-05-18T21:26:12.727 INFO:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-05-18T21:26:12.785 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-05-18T21:26:12.802 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-05-18T21:26:12.803 INFO:tasks.ceph:role: osd.4 2020-05-18T21:26:12.803 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com 2020-05-18T21:26:12.803 INFO:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-05-18T21:26:13.363 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-05-18T21:26:13.364 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2020-05-18T21:26:13.364 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-05-18T21:26:13.364 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 2020-05-18T21:26:13.364 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-05-18T21:26:13.365 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2020-05-18T21:26:13.365 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-05-18T21:26:13.365 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-05-18T21:26:13.365 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-05-18T21:26:13.365 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-05-18T21:26:13.366 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2020-05-18T21:26:13.367 INFO:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2020-05-18T21:26:13.445 INFO:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-05-18T21:26:13.456 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2020-05-18T21:26:13.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:26:13.458 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-05-18T21:26:13.514 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-05-18T21:26:13.516 INFO:tasks.ceph:role: osd.5 2020-05-18T21:26:13.516 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com 2020-05-18T21:26:13.516 INFO:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-05-18T21:26:14.035 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-05-18T21:26:14.035 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2020-05-18T21:26:14.036 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-05-18T21:26:14.036 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 2020-05-18T21:26:14.036 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-05-18T21:26:14.036 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2020-05-18T21:26:14.037 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-05-18T21:26:14.037 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-05-18T21:26:14.037 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-05-18T21:26:14.037 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-05-18T21:26:14.038 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2020-05-18T21:26:14.039 INFO:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2020-05-18T21:26:14.083 INFO:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-05-18T21:26:14.139 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2020-05-18T21:26:14.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:26:14.140 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-05-18T21:26:14.151 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-05-18T21:26:14.152 INFO:tasks.ceph:role: osd.6 2020-05-18T21:26:14.152 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com 2020-05-18T21:26:14.152 INFO:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-05-18T21:26:14.620 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-05-18T21:26:14.620 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2020-05-18T21:26:14.620 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-05-18T21:26:14.621 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 2020-05-18T21:26:14.621 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-05-18T21:26:14.621 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2020-05-18T21:26:14.621 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-05-18T21:26:14.621 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-05-18T21:26:14.622 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-05-18T21:26:14.622 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-05-18T21:26:14.623 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2020-05-18T21:26:14.623 INFO:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2020-05-18T21:26:14.684 INFO:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-05-18T21:26:14.696 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2020-05-18T21:26:14.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:26:14.697 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-05-18T21:26:14.708 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-05-18T21:26:14.708 INFO:tasks.ceph:role: osd.7 2020-05-18T21:26:14.709 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com 2020-05-18T21:26:14.709 INFO:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-05-18T21:26:15.209 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-05-18T21:26:15.209 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2020-05-18T21:26:15.209 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-05-18T21:26:15.210 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 2020-05-18T21:26:15.210 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-05-18T21:26:15.210 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2020-05-18T21:26:15.210 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-05-18T21:26:15.210 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-05-18T21:26:15.211 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-05-18T21:26:15.211 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-05-18T21:26:15.212 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2020-05-18T21:26:15.212 INFO:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2020-05-18T21:26:15.286 INFO:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-05-18T21:26:15.299 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2020-05-18T21:26:15.300 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:26:15.301 INFO:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-05-18T21:26:15.377 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:15.369+0000 7f03b2ae6dc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-05-18T21:26:15.377 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:15.373+0000 7f03b2ae6dc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-05-18T21:26:15.377 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:15.373+0000 7f03b2ae6dc0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-05-18T21:26:15.378 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:15.373+0000 7f03b2ae6dc0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-05-18T21:26:15.378 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:15.373+0000 7f03b2ae6dc0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-05-18T21:26:15.379 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:15.377+0000 7f03b2ae6dc0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-05-18T21:26:17.842 INFO:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-05-18T21:26:17.857 INFO:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-05-18T21:26:17.897 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:17.893+0000 7f5dea7e7dc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-05-18T21:26:17.897 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:17.893+0000 7f5dea7e7dc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-05-18T21:26:17.898 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:17.893+0000 7f5dea7e7dc0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-05-18T21:26:17.898 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:17.893+0000 7f5dea7e7dc0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-05-18T21:26:17.898 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:17.893+0000 7f5dea7e7dc0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-05-18T21:26:17.899 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:17.893+0000 7f5dea7e7dc0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-05-18T21:26:20.353 INFO:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-05-18T21:26:20.370 INFO:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-05-18T21:26:20.454 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:20.449+0000 7f755089bdc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-05-18T21:26:20.455 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:20.449+0000 7f755089bdc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-05-18T21:26:20.455 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:20.449+0000 7f755089bdc0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-05-18T21:26:20.455 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:20.449+0000 7f755089bdc0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-05-18T21:26:20.455 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:20.449+0000 7f755089bdc0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-05-18T21:26:20.456 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:20.449+0000 7f755089bdc0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-05-18T21:26:22.893 INFO:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-05-18T21:26:22.909 INFO:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-05-18T21:26:22.947 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:22.945+0000 7fc4a916adc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-05-18T21:26:22.948 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:22.945+0000 7fc4a916adc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-05-18T21:26:22.949 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:22.945+0000 7fc4a916adc0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-05-18T21:26:22.949 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:22.945+0000 7fc4a916adc0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-05-18T21:26:22.949 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:22.945+0000 7fc4a916adc0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-05-18T21:26:22.949 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:22.945+0000 7fc4a916adc0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-05-18T21:26:25.397 INFO:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-05-18T21:26:25.414 INFO:tasks.ceph:Reading keys from all nodes... 2020-05-18T21:26:25.415 INFO:teuthology.orchestra.run.smithi063:> mktemp 2020-05-18T21:26:25.422 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.8RIxQIvHna 2020-05-18T21:26:25.422 INFO:teuthology.orchestra.run.smithi063:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.8RIxQIvHna 2020-05-18T21:26:25.481 INFO:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.8RIxQIvHna 2020-05-18T21:26:25.504 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.8RIxQIvHna is 56B 2020-05-18T21:26:25.517 INFO:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.8RIxQIvHna 2020-05-18T21:26:25.523 INFO:teuthology.orchestra.run.smithi063:> mktemp 2020-05-18T21:26:25.570 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.cYfGGeWBNy 2020-05-18T21:26:25.571 INFO:teuthology.orchestra.run.smithi063:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.cYfGGeWBNy 2020-05-18T21:26:25.584 INFO:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.cYfGGeWBNy 2020-05-18T21:26:25.606 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.cYfGGeWBNy is 56B 2020-05-18T21:26:25.619 INFO:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.cYfGGeWBNy 2020-05-18T21:26:25.625 INFO:teuthology.orchestra.run.smithi063:> mktemp 2020-05-18T21:26:25.674 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.L3OGU1NDKn 2020-05-18T21:26:25.674 INFO:teuthology.orchestra.run.smithi063:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.L3OGU1NDKn 2020-05-18T21:26:25.689 INFO:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.L3OGU1NDKn 2020-05-18T21:26:25.715 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.L3OGU1NDKn is 56B 2020-05-18T21:26:25.728 INFO:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.L3OGU1NDKn 2020-05-18T21:26:25.734 INFO:teuthology.orchestra.run.smithi063:> mktemp 2020-05-18T21:26:25.786 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.GnNSMEfldQ 2020-05-18T21:26:25.794 INFO:teuthology.orchestra.run.smithi063:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.GnNSMEfldQ 2020-05-18T21:26:25.811 INFO:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.GnNSMEfldQ 2020-05-18T21:26:25.879 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.GnNSMEfldQ is 56B 2020-05-18T21:26:25.892 INFO:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.GnNSMEfldQ 2020-05-18T21:26:25.900 INFO:teuthology.orchestra.run.smithi063:> mktemp 2020-05-18T21:26:25.946 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.1jtBX76fS0 2020-05-18T21:26:25.947 INFO:teuthology.orchestra.run.smithi063:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.1jtBX76fS0 2020-05-18T21:26:25.962 INFO:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.1jtBX76fS0 2020-05-18T21:26:25.987 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.1jtBX76fS0 is 56B 2020-05-18T21:26:26.004 INFO:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.1jtBX76fS0 2020-05-18T21:26:26.011 INFO:teuthology.orchestra.run.smithi063:> mktemp 2020-05-18T21:26:26.058 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.tsvpdfb9kE 2020-05-18T21:26:26.059 INFO:teuthology.orchestra.run.smithi063:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.tsvpdfb9kE 2020-05-18T21:26:26.074 INFO:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.tsvpdfb9kE 2020-05-18T21:26:26.097 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.tsvpdfb9kE is 56B 2020-05-18T21:26:26.112 INFO:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.tsvpdfb9kE 2020-05-18T21:26:26.118 INFO:teuthology.orchestra.run.smithi155:> mktemp 2020-05-18T21:26:26.125 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.hGSJm9GZ5A 2020-05-18T21:26:26.126 INFO:teuthology.orchestra.run.smithi155:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.hGSJm9GZ5A 2020-05-18T21:26:26.183 INFO:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.hGSJm9GZ5A 2020-05-18T21:26:26.211 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.hGSJm9GZ5A is 56B 2020-05-18T21:26:26.226 INFO:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.hGSJm9GZ5A 2020-05-18T21:26:26.232 INFO:teuthology.orchestra.run.smithi155:> mktemp 2020-05-18T21:26:26.280 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.NgXoLqYwb1 2020-05-18T21:26:26.281 INFO:teuthology.orchestra.run.smithi155:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.NgXoLqYwb1 2020-05-18T21:26:26.296 INFO:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.NgXoLqYwb1 2020-05-18T21:26:26.323 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.NgXoLqYwb1 is 56B 2020-05-18T21:26:26.335 INFO:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.NgXoLqYwb1 2020-05-18T21:26:26.340 INFO:teuthology.orchestra.run.smithi155:> mktemp 2020-05-18T21:26:26.388 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.hheubLMk7E 2020-05-18T21:26:26.389 INFO:teuthology.orchestra.run.smithi155:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.hheubLMk7E 2020-05-18T21:26:26.408 INFO:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.hheubLMk7E 2020-05-18T21:26:26.473 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.hheubLMk7E is 56B 2020-05-18T21:26:26.486 INFO:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.hheubLMk7E 2020-05-18T21:26:26.492 INFO:teuthology.orchestra.run.smithi155:> mktemp 2020-05-18T21:26:26.497 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.xu62vNsv1q 2020-05-18T21:26:26.497 INFO:teuthology.orchestra.run.smithi155:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.xu62vNsv1q 2020-05-18T21:26:26.512 INFO:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.xu62vNsv1q 2020-05-18T21:26:26.579 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.xu62vNsv1q is 56B 2020-05-18T21:26:26.592 INFO:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.xu62vNsv1q 2020-05-18T21:26:26.598 INFO:teuthology.orchestra.run.smithi155:> mktemp 2020-05-18T21:26:26.644 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.6OGqgJ2mbc 2020-05-18T21:26:26.645 INFO:teuthology.orchestra.run.smithi155:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.6OGqgJ2mbc 2020-05-18T21:26:26.661 INFO:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.6OGqgJ2mbc 2020-05-18T21:26:26.682 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.6OGqgJ2mbc is 56B 2020-05-18T21:26:26.693 INFO:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.6OGqgJ2mbc 2020-05-18T21:26:26.699 INFO:teuthology.orchestra.run.smithi155:> mktemp 2020-05-18T21:26:26.754 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.wKLEA5PRUi 2020-05-18T21:26:26.754 INFO:teuthology.orchestra.run.smithi155:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.wKLEA5PRUi 2020-05-18T21:26:26.770 INFO:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.wKLEA5PRUi 2020-05-18T21:26:26.833 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.wKLEA5PRUi is 56B 2020-05-18T21:26:26.846 INFO:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.wKLEA5PRUi 2020-05-18T21:26:26.864 DEBUG:teuthology.orchestra.remote:smithi063:/etc/ceph/ceph.client.0.keyring is 59B 2020-05-18T21:26:26.889 DEBUG:teuthology.orchestra.remote:smithi063:/etc/ceph/ceph.client.1.keyring is 59B 2020-05-18T21:26:26.913 DEBUG:teuthology.orchestra.remote:smithi155:/etc/ceph/ceph.client.2.keyring is 59B 2020-05-18T21:26:26.937 DEBUG:teuthology.orchestra.remote:smithi155:/etc/ceph/ceph.client.3.keyring is 59B 2020-05-18T21:26:26.950 INFO:tasks.ceph:Adding keys to all mons... 2020-05-18T21:26:26.950 INFO:teuthology.orchestra.run.smithi063:> sudo tee -a /etc/ceph/ceph.keyring 2020-05-18T21:26:26.953 INFO:teuthology.orchestra.run.smithi155:> sudo tee -a /etc/ceph/ceph.keyring 2020-05-18T21:26:26.968 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.y] 2020-05-18T21:26:26.969 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBn/cJeF/BNJhAAi/vrldC6qoWJWnSHpE3ung== 2020-05-18T21:26:26.969 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2020-05-18T21:26:26.969 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBn/cJekJyyLRAAfB5XJCsXTAmZdkFOaQrokg== 2020-05-18T21:26:26.969 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.0] 2020-05-18T21:26:26.970 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBq/cJeIn7mJhAArx+YEdVbsfXXNOLWdaAgWw== 2020-05-18T21:26:26.970 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.1] 2020-05-18T21:26:26.970 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBt/cJelHywCRAAFyQ3sPEE0RTSy4tKfsDfyw== 2020-05-18T21:26:26.970 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.2] 2020-05-18T21:26:26.970 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBv/cJecexDLBAAxhlFq20MBkKvDjuM1yi8XQ== 2020-05-18T21:26:26.971 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.3] 2020-05-18T21:26:26.971 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBy/cJe9IqwDxAAMg1In7bIITDcOZljzzTpDQ== 2020-05-18T21:26:26.971 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.x] 2020-05-18T21:26:26.971 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBn/cJemmqEKhAAe5ySRz8Id0ug4matQwL0uw== 2020-05-18T21:26:26.971 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2020-05-18T21:26:26.971 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBn/cJeSVE8MRAAEEytuzLtcQMC+1uQ/yh8eA== 2020-05-18T21:26:26.972 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.4] 2020-05-18T21:26:26.972 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQB3/cJeLXgxFhAA/kMVV5hCRny2uXKvvbu8Og== 2020-05-18T21:26:26.972 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.5] 2020-05-18T21:26:26.972 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQB5/cJeucpsNRAAjGh+6yUC8Fji9PE4COi/Eg== 2020-05-18T21:26:26.972 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.6] 2020-05-18T21:26:26.973 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQB8/cJelSPpGhAAXobGqH9qaW1VZfEpH8bUbQ== 2020-05-18T21:26:26.973 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.7] 2020-05-18T21:26:26.973 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQB+/cJeUIl5OBAAPd8H8ohOWZw9ubO7uCB6zg== 2020-05-18T21:26:26.973 INFO:teuthology.orchestra.run.smithi155.stdout:[client.0] 2020-05-18T21:26:26.973 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBn/cJeap3RNhAAi2vKpsKtzSL1Uuqm8pWYJQ== 2020-05-18T21:26:26.973 INFO:teuthology.orchestra.run.smithi155.stdout:[client.1] 2020-05-18T21:26:26.974 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBo/cJeekrQABAA5TmzWOt24C6hgZw/WTj5dw== 2020-05-18T21:26:26.974 INFO:teuthology.orchestra.run.smithi155.stdout:[client.2] 2020-05-18T21:26:26.974 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBo/cJehSnFAxAAXUZwqNTXqAApEB3nXs4u6g== 2020-05-18T21:26:26.974 INFO:teuthology.orchestra.run.smithi155.stdout:[client.3] 2020-05-18T21:26:26.974 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBo/cJe2HdDBhAA07y5pn/bKKa9TBbZFvIh9g== 2020-05-18T21:26:26.996 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.y] 2020-05-18T21:26:26.997 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBn/cJeF/BNJhAAi/vrldC6qoWJWnSHpE3ung== 2020-05-18T21:26:26.997 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2020-05-18T21:26:26.997 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBn/cJekJyyLRAAfB5XJCsXTAmZdkFOaQrokg== 2020-05-18T21:26:26.997 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.0] 2020-05-18T21:26:26.997 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBq/cJeIn7mJhAArx+YEdVbsfXXNOLWdaAgWw== 2020-05-18T21:26:26.998 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.1] 2020-05-18T21:26:26.998 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBt/cJelHywCRAAFyQ3sPEE0RTSy4tKfsDfyw== 2020-05-18T21:26:26.998 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.2] 2020-05-18T21:26:26.998 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBv/cJecexDLBAAxhlFq20MBkKvDjuM1yi8XQ== 2020-05-18T21:26:26.998 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.3] 2020-05-18T21:26:26.999 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBy/cJe9IqwDxAAMg1In7bIITDcOZljzzTpDQ== 2020-05-18T21:26:26.999 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.x] 2020-05-18T21:26:26.999 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBn/cJemmqEKhAAe5ySRz8Id0ug4matQwL0uw== 2020-05-18T21:26:26.999 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2020-05-18T21:26:27.000 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBn/cJeSVE8MRAAEEytuzLtcQMC+1uQ/yh8eA== 2020-05-18T21:26:27.000 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.4] 2020-05-18T21:26:27.000 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQB3/cJeLXgxFhAA/kMVV5hCRny2uXKvvbu8Og== 2020-05-18T21:26:27.001 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.5] 2020-05-18T21:26:27.001 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQB5/cJeucpsNRAAjGh+6yUC8Fji9PE4COi/Eg== 2020-05-18T21:26:27.001 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.6] 2020-05-18T21:26:27.002 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQB8/cJelSPpGhAAXobGqH9qaW1VZfEpH8bUbQ== 2020-05-18T21:26:27.002 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.7] 2020-05-18T21:26:27.002 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQB+/cJeUIl5OBAAPd8H8ohOWZw9ubO7uCB6zg== 2020-05-18T21:26:27.003 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2020-05-18T21:26:27.003 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBn/cJeap3RNhAAi2vKpsKtzSL1Uuqm8pWYJQ== 2020-05-18T21:26:27.003 INFO:teuthology.orchestra.run.smithi063.stdout:[client.1] 2020-05-18T21:26:27.004 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBo/cJeekrQABAA5TmzWOt24C6hgZw/WTj5dw== 2020-05-18T21:26:27.004 INFO:teuthology.orchestra.run.smithi063.stdout:[client.2] 2020-05-18T21:26:27.004 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBo/cJehSnFAxAAXUZwqNTXqAApEB3nXs4u6g== 2020-05-18T21:26:27.005 INFO:teuthology.orchestra.run.smithi063.stdout:[client.3] 2020-05-18T21:26:27.005 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBo/cJe2HdDBhAA07y5pn/bKKa9TBbZFvIh9g== 2020-05-18T21:26:27.007 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-05-18T21:26:27.010 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-05-18T21:26:27.063 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-05-18T21:26:27.098 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-05-18T21:26:27.146 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-05-18T21:26:27.150 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-05-18T21:26:27.193 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-05-18T21:26:27.234 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-05-18T21:26:27.279 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-05-18T21:26:27.283 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-05-18T21:26:27.338 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-05-18T21:26:27.370 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-05-18T21:26:27.413 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-05-18T21:26:27.416 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-05-18T21:26:27.458 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-05-18T21:26:27.494 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-05-18T21:26:27.538 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-05-18T21:26:27.541 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-05-18T21:26:27.622 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-05-18T21:26:27.635 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-05-18T21:26:27.678 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-05-18T21:26:27.722 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-05-18T21:26:27.767 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-05-18T21:26:27.769 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-05-18T21:26:27.852 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-05-18T21:26:27.854 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-05-18T21:26:27.899 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-05-18T21:26:27.902 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-05-18T21:26:27.944 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-05-18T21:26:27.947 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-05-18T21:26:28.030 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-05-18T21:26:28.033 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-05-18T21:26:28.077 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-05-18T21:26:28.078 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-05-18T21:26:28.092 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-05-18T21:26:28.145 INFO:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-05-18T21:26:28.160 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-05-18T21:26:28.177 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-05-18T21:26:28.248 INFO:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-05-18T21:26:28.263 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-05-18T21:26:28.274 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-05-18T21:26:28.391 INFO:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-05-18T21:26:28.407 INFO:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-05-18T21:26:28.409 INFO:teuthology.orchestra.run.smithi155:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-05-18T21:26:28.416 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-05-18T21:26:28.416 INFO:tasks.ceph.mon.a:Restarting daemon 2020-05-18T21:26:28.417 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-05-18T21:26:28.462 INFO:tasks.ceph.mon.a:Started 2020-05-18T21:26:28.462 INFO:tasks.ceph.mon.b:Restarting daemon 2020-05-18T21:26:28.463 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-05-18T21:26:28.466 INFO:tasks.ceph.mon.b:Started 2020-05-18T21:26:28.466 INFO:tasks.ceph.mon.c:Restarting daemon 2020-05-18T21:26:28.466 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-05-18T21:26:28.469 INFO:tasks.ceph.mon.c:Started 2020-05-18T21:26:28.469 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-05-18T21:26:28.469 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-05-18T21:26:28.470 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-05-18T21:26:28.472 INFO:tasks.ceph.mgr.y:Started 2020-05-18T21:26:28.472 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-05-18T21:26:28.473 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-05-18T21:26:28.475 INFO:tasks.ceph.mgr.x:Started 2020-05-18T21:26:28.475 INFO:tasks.ceph:Setting crush tunables to default 2020-05-18T21:26:28.476 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd crush tunables default 2020-05-18T21:26:28.718 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:26:28.732 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:26:28.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.567+0000 7f810d27f700 1 Processor -- start 2020-05-18T21:26:28.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.567+0000 7f810d27f700 1 -- start start 2020-05-18T21:26:28.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.567+0000 7f810d27f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81040efe70 0x7f81040f0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:28.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.567+0000 7f810d27f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81040472c0 con 0x7f81040fa0d0 2020-05-18T21:26:28.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.567+0000 7f810d27f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81040f6260 con 0x7f81040f6700 2020-05-18T21:26:28.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.567+0000 7f810d27f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81040f5f90 con 0x7f81040efe70 2020-05-18T21:26:28.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.567+0000 7f810ca7e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f81040fa0d0 0x7f810404b2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54158/0 (socket says 172.21.15.63:54158) 2020-05-18T21:26:28.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.567+0000 7f810ca7e700 1 -- 172.21.15.63:0/2669610436 learned_addr learned my addr 172.21.15.63:0/2669610436 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:28.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.567+0000 7f810ece2700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81040efe70 0x7f81040f0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:28.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.571+0000 7f810ece2700 1 -- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81040efe70 msgr2=0x7f81040f0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-05-18T21:26:28.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.571+0000 7f810ece2700 1 -- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81040efe70 msgr2=0x7f81040f0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-05-18T21:26:28.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.571+0000 7f810ece2700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81040efe70 0x7f81040f0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-05-18T21:26:28.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.571+0000 7f810ece2700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81040efe70 0x7f81040f0250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-05-18T21:26:28.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.775+0000 7f810ece2700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81040efe70 0x7f81040f0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:28.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.775+0000 7f810ece2700 1 -- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81040efe70 msgr2=0x7f81040f0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-05-18T21:26:28.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.775+0000 7f810ece2700 1 -- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81040efe70 msgr2=0x7f81040f0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-05-18T21:26:28.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.775+0000 7f810ece2700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81040efe70 0x7f81040f0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-05-18T21:26:28.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.775+0000 7f810ece2700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81040efe70 0x7f81040f0250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-05-18T21:26:28.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.819+0000 7f80fffff700 1 -- 172.21.15.63:0/2669610436 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949587057 0 0) 0x7f81040f6260 con 0x7f81040f6700 2020-05-18T21:26:28.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.819+0000 7f80fffff700 1 -- 172.21.15.63:0/2669610436 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80f4003270 con 0x7f81040f6700 2020-05-18T21:26:28.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.819+0000 7f80fffff700 1 -- 172.21.15.63:0/2669610436 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086729479 0 0) 0x7f81040472c0 con 0x7f81040fa0d0 2020-05-18T21:26:28.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.819+0000 7f80fffff700 1 -- 172.21.15.63:0/2669610436 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81040f6260 con 0x7f81040fa0d0 2020-05-18T21:26:28.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.819+0000 7f80fffff700 1 -- 172.21.15.63:0/2669610436 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3791608825 0 0) 0x7f81040f6260 con 0x7f81040fa0d0 2020-05-18T21:26:28.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f80fffff700 1 -- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81040efe70 msgr2=0x7f81040f0250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-05-18T21:26:28.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f80fffff700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81040efe70 0x7f81040f0250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:28.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f80fffff700 1 -- 172.21.15.63:0/2669610436 >> v1:172.21.15.155:6789/0 conn(0x7f81040f6700 legacy=0x7f81040403f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:28.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f80fffff700 1 -- 172.21.15.63:0/2669610436 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810404ba00 con 0x7f81040fa0d0 2020-05-18T21:26:28.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f80fffff700 1 -- 172.21.15.63:0/2669610436 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f80f8001710 con 0x7f81040fa0d0 2020-05-18T21:26:28.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f80fffff700 1 -- 172.21.15.63:0/2669610436 >> v1:172.21.15.63:6789/0 conn(0x7f81040fa0d0 legacy=0x7f810404b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:28.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f80fffff700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81040efe70 0x7f80f4003920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:28.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f80fffff700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80f4003d80 0x7f80f4004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:28.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f80fffff700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80f4004970 0x7f80f4004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:28.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f80fffff700 1 -- 172.21.15.63:0/2669610436 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81040f5f90 con 0x7f80f4004970 2020-05-18T21:26:28.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f80fffff700 1 -- 172.21.15.63:0/2669610436 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f4005250 con 0x7f80f4003d80 2020-05-18T21:26:28.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f80fffff700 1 -- 172.21.15.63:0/2669610436 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f404f770 con 0x7f81040efe70 2020-05-18T21:26:28.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810da80700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80f4004970 0x7f80f4004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:28.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810ece2700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81040efe70 0x7f80f4003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:28.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810ca7e700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80f4003d80 0x7f80f4004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:28.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810da80700 1 -- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81040efe70 msgr2=0x7f80f4003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:28.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810da80700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81040efe70 0x7f80f4003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:28.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810da80700 1 -- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80f4003d80 msgr2=0x7f80f4004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:28.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810da80700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80f4003d80 0x7f80f4004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:28.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810da80700 1 -- 172.21.15.63:0/2669610436 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81040f6260 con 0x7f80f4004970 2020-05-18T21:26:28.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810da80700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80f4004970 0x7f80f4004df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f81000021f0 tx=0x7f8100000b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:28.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810da80700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80f4004970 0x7f80f4004df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f81000021f0 tx=0x7f8100000b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:28.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810da80700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80f4004970 0x7f80f4004df0 secure :-1 s=READY pgs=6 cs=0 l=1 rx=0x7f81000021f0 tx=0x7f8100000b90).ready entity=mon.0 client_cookie=8422b6a3f5814c3 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:28.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810da80700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80f4004970 0x7f80f4004df0 secure :-1 s=THROTTLE_DONE pgs=6 cs=0 l=1 rx=0x7f81000021f0 tx=0x7f8100000b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:28.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f80fffff700 1 -- 172.21.15.63:0/2669610436 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8100002d10 con 0x7f80f4004970 2020-05-18T21:26:28.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810da80700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80f4004970 0x7f80f4004df0 secure :-1 s=THROTTLE_DONE pgs=6 cs=0 l=1 rx=0x7f81000021f0 tx=0x7f8100000b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:28.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810da80700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80f4004970 0x7f80f4004df0 secure :-1 s=THROTTLE_DONE pgs=6 cs=0 l=1 rx=0x7f81000021f0 tx=0x7f8100000b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:28.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f80fffff700 1 -- 172.21.15.63:0/2669610436 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8100010850 con 0x7f80f4004970 2020-05-18T21:26:28.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f80fffff700 1 -- 172.21.15.63:0/2669610436 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8100010c30 con 0x7f80f4004970 2020-05-18T21:26:28.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810d27f700 1 -- 172.21.15.63:0/2669610436 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80f4004970 msgr2=0x7f80f4004df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:28.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810d27f700 1 --2- 172.21.15.63:0/2669610436 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80f4004970 0x7f80f4004df0 secure :-1 s=READY pgs=6 cs=0 l=1 rx=0x7f81000021f0 tx=0x7f8100000b90).stop 2020-05-18T21:26:28.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810da80700 1 -- 172.21.15.63:0/2669610436 reap_dead start 2020-05-18T21:26:28.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810d27f700 1 -- 172.21.15.63:0/2669610436 shutdown_connections 2020-05-18T21:26:28.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810d27f700 1 -- 172.21.15.63:0/2669610436 >> 172.21.15.63:0/2669610436 conn(0x7f8104029d90 msgr2=0x7f810404abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:28.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810d27f700 1 -- 172.21.15.63:0/2669610436 shutdown_connections 2020-05-18T21:26:28.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.823+0000 7f810d27f700 1 -- 172.21.15.63:0/2669610436 wait complete. 2020-05-18T21:26:28.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.827+0000 7f810d27f700 1 Processor -- start 2020-05-18T21:26:28.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.827+0000 7f810d27f700 1 -- start start 2020-05-18T21:26:28.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.831+0000 7f810d27f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f810402e240 0x7f810402a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:28.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.831+0000 7f810d27f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f81040301c0 0x7f8104030650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:28.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.831+0000 7f810d27f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81040de500 con 0x7f81040058d0 2020-05-18T21:26:28.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.831+0000 7f810d27f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81040de730 con 0x7f81040301c0 2020-05-18T21:26:28.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.831+0000 7f810d27f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81040de9d0 con 0x7f810402e240 2020-05-18T21:26:28.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.831+0000 7f810ece2700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f81040058d0 0x7f81040dee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54178/0 (socket says 172.21.15.63:54178) 2020-05-18T21:26:28.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.831+0000 7f810ece2700 1 -- 172.21.15.63:0/252957441 learned_addr learned my addr 172.21.15.63:0/252957441 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:28.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.831+0000 7f810da80700 1 --2- 172.21.15.63:0/252957441 >> v2:172.21.15.155:3300/0 conn(0x7f81040301c0 0x7f8104030650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:28.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.831+0000 7f810ca7e700 1 --2- 172.21.15.63:0/252957441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f810402e240 0x7f810402a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:28.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.831+0000 7f810da80700 1 -- 172.21.15.63:0/252957441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f810402e240 msgr2=0x7f810402a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:28.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.831+0000 7f810da80700 1 --2- 172.21.15.63:0/252957441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f810402e240 0x7f810402a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:28.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.831+0000 7f810da80700 1 -- 172.21.15.63:0/252957441 >> v1:172.21.15.63:6789/0 conn(0x7f81040058d0 legacy=0x7f81040dee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:28.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.831+0000 7f810da80700 1 -- 172.21.15.63:0/252957441 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8104005cb0 con 0x7f81040301c0 2020-05-18T21:26:28.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.831+0000 7f810ca7e700 1 --2- 172.21.15.63:0/252957441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f810402e240 0x7f810402a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:26:28.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.831+0000 7f810da80700 1 --2- 172.21.15.63:0/252957441 >> v2:172.21.15.155:3300/0 conn(0x7f81040301c0 0x7f8104030650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f810400c5c0 tx=0x7f8100000b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:28.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.831+0000 7f810da80700 1 --2- 172.21.15.63:0/252957441 >> v2:172.21.15.155:3300/0 conn(0x7f81040301c0 0x7f8104030650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f810400c5c0 tx=0x7f8100000b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:28.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.831+0000 7f810da80700 1 --2- 172.21.15.63:0/252957441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81040301c0 0x7f8104030650 secure :-1 s=READY pgs=6 cs=0 l=1 rx=0x7f810400c5c0 tx=0x7f8100000b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:28.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.835+0000 7f810da80700 1 --2- 172.21.15.63:0/252957441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81040301c0 0x7f8104030650 secure :-1 s=THROTTLE_DONE pgs=6 cs=0 l=1 rx=0x7f810400c5c0 tx=0x7f8100000b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:28.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.835+0000 7f810da80700 1 --2- 172.21.15.63:0/252957441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81040301c0 0x7f8104030650 secure :-1 s=THROTTLE_DONE pgs=6 cs=0 l=1 rx=0x7f810400c5c0 tx=0x7f8100000b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:28.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.835+0000 7f810da80700 1 --2- 172.21.15.63:0/252957441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81040301c0 0x7f8104030650 secure :-1 s=THROTTLE_DONE pgs=6 cs=0 l=1 rx=0x7f810400c5c0 tx=0x7f8100000b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:28.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.835+0000 7f80fdffb700 1 -- 172.21.15.63:0/252957441 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81000110d0 con 0x7f81040301c0 2020-05-18T21:26:28.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.835+0000 7f80fdffb700 1 -- 172.21.15.63:0/252957441 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8100011230 con 0x7f81040301c0 2020-05-18T21:26:28.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.835+0000 7f810d27f700 1 -- 172.21.15.63:0/252957441 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8104043220 con 0x7f81040301c0 2020-05-18T21:26:28.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.835+0000 7f80fdffb700 1 -- 172.21.15.63:0/252957441 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8100011590 con 0x7f81040301c0 2020-05-18T21:26:28.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.835+0000 7f810d27f700 1 -- 172.21.15.63:0/252957441 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8104043670 con 0x7f81040301c0 2020-05-18T21:26:28.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.835+0000 7f810da80700 1 --2- 172.21.15.63:0/252957441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81040301c0 0x7f8104030650 secure :-1 s=THROTTLE_DONE pgs=6 cs=0 l=1 rx=0x7f810400c5c0 tx=0x7f8100000b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:28.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.835+0000 7f80fdffb700 1 -- 172.21.15.63:0/252957441 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7f8100010c50 con 0x7f81040301c0 2020-05-18T21:26:28.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.835+0000 7f810da80700 1 --2- 172.21.15.63:0/252957441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81040301c0 0x7f8104030650 secure :-1 s=THROTTLE_DONE pgs=6 cs=0 l=1 rx=0x7f810400c5c0 tx=0x7f8100000b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:28.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.835+0000 7f80fdffb700 1 -- 172.21.15.63:0/252957441 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f810000ab50 con 0x7f81040301c0 2020-05-18T21:26:28.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.835+0000 7f810d27f700 1 -- 172.21.15.63:0/252957441 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8104004cf0 con 0x7f81040301c0 2020-05-18T21:26:28.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.839+0000 7f810da80700 1 --2- 172.21.15.63:0/252957441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81040301c0 0x7f8104030650 secure :-1 s=THROTTLE_DONE pgs=6 cs=0 l=1 rx=0x7f810400c5c0 tx=0x7f8100000b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:28.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.839+0000 7f80fdffb700 1 -- 172.21.15.63:0/252957441 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67708 (secure 0 0 0) 0x7f810000ad60 con 0x7f81040301c0 2020-05-18T21:26:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.903+0000 7f810d27f700 1 -- 172.21.15.63:0/252957441 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f81040deb40 con 0x7f81040301c0 2020-05-18T21:26:28.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.915+0000 7f810da80700 1 --2- 172.21.15.63:0/252957441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81040301c0 0x7f8104030650 secure :-1 s=THROTTLE_DONE pgs=6 cs=0 l=1 rx=0x7f810400c5c0 tx=0x7f8100000b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:28.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.915+0000 7f80fdffb700 1 -- 172.21.15.63:0/252957441 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f810000b280 con 0x7f81040301c0 2020-05-18T21:26:28.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.919+0000 7f810d27f700 1 -- 172.21.15.63:0/252957441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81040301c0 msgr2=0x7f8104030650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:28.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.919+0000 7f810d27f700 1 --2- 172.21.15.63:0/252957441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81040301c0 0x7f8104030650 secure :-1 s=READY pgs=6 cs=0 l=1 rx=0x7f810400c5c0 tx=0x7f8100000b90).stop 2020-05-18T21:26:28.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.919+0000 7f810d27f700 1 -- 172.21.15.63:0/252957441 shutdown_connections 2020-05-18T21:26:28.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.919+0000 7f810d27f700 1 --2- 172.21.15.63:0/252957441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81040301c0 0x7f8104030650 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:28.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.919+0000 7f810d27f700 1 --2- 172.21.15.63:0/252957441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f810402e240 0x7f810402a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:28.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.919+0000 7f810d27f700 1 -- 172.21.15.63:0/252957441 >> 172.21.15.63:0/252957441 conn(0x7f8104029d90 msgr2=0x7f81040f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:28.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.919+0000 7f810d27f700 1 -- 172.21.15.63:0/252957441 shutdown_connections 2020-05-18T21:26:28.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:28.919+0000 7f810d27f700 1 -- 172.21.15.63:0/252957441 wait complete. 2020-05-18T21:26:28.925 INFO:teuthology.orchestra.run.smithi063.stderr:adjusted tunables profile to default 2020-05-18T21:26:28.935 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-05-18T21:26:28.936 INFO:teuthology.orchestra.run.smithi063:> mktemp 2020-05-18T21:26:28.983 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.RHztoaReRI 2020-05-18T21:26:28.984 INFO:teuthology.orchestra.run.smithi063:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.RHztoaReRI 2020-05-18T21:26:28.999 INFO:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.RHztoaReRI 2020-05-18T21:26:29.072 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.RHztoaReRI is 37B 2020-05-18T21:26:29.088 INFO:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.RHztoaReRI 2020-05-18T21:26:29.095 INFO:teuthology.orchestra.run.smithi063:> mktemp 2020-05-18T21:26:29.148 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.ju5ZHKLzM5 2020-05-18T21:26:29.148 INFO:teuthology.orchestra.run.smithi063:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.ju5ZHKLzM5 2020-05-18T21:26:29.203 INFO:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.ju5ZHKLzM5 2020-05-18T21:26:29.223 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.ju5ZHKLzM5 is 37B 2020-05-18T21:26:29.237 INFO:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.ju5ZHKLzM5 2020-05-18T21:26:29.245 INFO:teuthology.orchestra.run.smithi063:> mktemp 2020-05-18T21:26:29.299 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.LDldK8h5YU 2020-05-18T21:26:29.300 INFO:teuthology.orchestra.run.smithi063:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.LDldK8h5YU 2020-05-18T21:26:29.315 INFO:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.LDldK8h5YU 2020-05-18T21:26:29.384 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.LDldK8h5YU is 37B 2020-05-18T21:26:29.399 INFO:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.LDldK8h5YU 2020-05-18T21:26:29.407 INFO:teuthology.orchestra.run.smithi063:> mktemp 2020-05-18T21:26:29.469 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.wNdkNsSSXN 2020-05-18T21:26:29.470 INFO:teuthology.orchestra.run.smithi063:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.wNdkNsSSXN 2020-05-18T21:26:29.485 INFO:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.wNdkNsSSXN 2020-05-18T21:26:29.552 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.wNdkNsSSXN is 37B 2020-05-18T21:26:29.567 INFO:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.wNdkNsSSXN 2020-05-18T21:26:29.575 INFO:teuthology.orchestra.run.smithi155:> mktemp 2020-05-18T21:26:29.583 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.0OO4ZmSnJN 2020-05-18T21:26:29.583 INFO:teuthology.orchestra.run.smithi155:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.0OO4ZmSnJN 2020-05-18T21:26:29.601 INFO:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.0OO4ZmSnJN 2020-05-18T21:26:29.666 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.0OO4ZmSnJN is 37B 2020-05-18T21:26:29.680 INFO:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.0OO4ZmSnJN 2020-05-18T21:26:29.685 INFO:teuthology.orchestra.run.smithi155:> mktemp 2020-05-18T21:26:29.732 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.FrYhejuOmh 2020-05-18T21:26:29.733 INFO:teuthology.orchestra.run.smithi155:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.FrYhejuOmh 2020-05-18T21:26:29.749 INFO:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.FrYhejuOmh 2020-05-18T21:26:29.814 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.FrYhejuOmh is 37B 2020-05-18T21:26:29.828 INFO:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.FrYhejuOmh 2020-05-18T21:26:29.833 INFO:teuthology.orchestra.run.smithi155:> mktemp 2020-05-18T21:26:29.838 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.711jOSAsOl 2020-05-18T21:26:29.838 INFO:teuthology.orchestra.run.smithi155:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.711jOSAsOl 2020-05-18T21:26:29.896 INFO:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.711jOSAsOl 2020-05-18T21:26:29.915 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.711jOSAsOl is 37B 2020-05-18T21:26:29.928 INFO:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.711jOSAsOl 2020-05-18T21:26:29.934 INFO:teuthology.orchestra.run.smithi155:> mktemp 2020-05-18T21:26:29.980 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.1jVo2JUfUA 2020-05-18T21:26:29.981 INFO:teuthology.orchestra.run.smithi155:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.1jVo2JUfUA 2020-05-18T21:26:30.001 INFO:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.1jVo2JUfUA 2020-05-18T21:26:30.063 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.1jVo2JUfUA is 37B 2020-05-18T21:26:30.085 INFO:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.1jVo2JUfUA 2020-05-18T21:26:30.091 INFO:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new c6ae0fbf-604c-4e8d-b1b8-6038821420e3 0 2020-05-18T21:26:30.248 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f1817fff700 1 Processor -- start 2020-05-18T21:26:30.249 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f1817fff700 1 -- start start 2020-05-18T21:26:30.249 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f1817fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f180c0f0010 0x7f180c041630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:30.249 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f1817fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f180c0f9560 0x7f180c04b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:30.250 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f1817fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180c005650 con 0x7f180c0f99f0 2020-05-18T21:26:30.250 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f1817fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180c041a90 con 0x7f180c0f9560 2020-05-18T21:26:30.250 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f1817fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180c046fe0 con 0x7f180c0f0010 2020-05-18T21:26:30.250 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f181dd3d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f180c0f0010 0x7f180c041630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:30.251 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f181dd3d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f180c0f0010 0x7f180c041630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59132/0 (socket says 172.21.15.155:59132) 2020-05-18T21:26:30.251 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f181dd3d700 1 -- 172.21.15.155:0/1001957635 learned_addr learned my addr 172.21.15.155:0/1001957635 (peer_addr_for_me v2:172.21.15.155:0/0) 2020-05-18T21:26:30.251 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f18177fe700 1 --2- 172.21.15.155:0/1001957635 >> v2:172.21.15.63:3300/0 conn(0x7f180c0f9560 0x7f180c04b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:30.251 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f181dd3d700 1 -- 172.21.15.155:0/1001957635 >> v2:172.21.15.63:3300/0 conn(0x7f180c0f9560 msgr2=0x7f180c04b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:30.252 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f181dd3d700 1 --2- 172.21.15.155:0/1001957635 >> v2:172.21.15.63:3300/0 conn(0x7f180c0f9560 0x7f180c04b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:30.252 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f181dd3d700 1 -- 172.21.15.155:0/1001957635 >> v1:172.21.15.63:6789/0 conn(0x7f180c0f99f0 legacy=0x7f180c005a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.252 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f181dd3d700 1 -- 172.21.15.155:0/1001957635 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c047280 con 0x7f180c0f0010 2020-05-18T21:26:30.252 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f181dd3d700 1 --2- 172.21.15.155:0/1001957635 >> v2:172.21.15.155:3300/0 conn(0x7f180c0f0010 0x7f180c041630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1810000c10 tx=0x7f1810007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.253 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f181dd3d700 1 --2- 172.21.15.155:0/1001957635 >> v2:172.21.15.155:3300/0 conn(0x7f180c0f0010 0x7f180c041630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1810000c10 tx=0x7f1810007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.253 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f181dd3d700 1 --2- 172.21.15.155:0/1001957635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c0f0010 0x7f180c041630 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7f1810000c10 tx=0x7f1810007e70).ready entity=mon.1 client_cookie=74a93f3a5448f652 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:30.253 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f181dd3d700 1 --2- 172.21.15.155:0/1001957635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c0f0010 0x7f180c041630 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f1810000c10 tx=0x7f1810007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.253 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f181dd3d700 1 --2- 172.21.15.155:0/1001957635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c0f0010 0x7f180c041630 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f1810000c10 tx=0x7f1810007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.254 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f1816ffd700 1 -- 172.21.15.155:0/1001957635 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1810007180 con 0x7f180c0f0010 2020-05-18T21:26:30.254 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f181dd3d700 1 --2- 172.21.15.155:0/1001957635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c0f0010 0x7f180c041630 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f1810000c10 tx=0x7f1810007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.254 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f1816ffd700 1 -- 172.21.15.155:0/1001957635 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18100072e0 con 0x7f180c0f0010 2020-05-18T21:26:30.254 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f1816ffd700 1 -- 172.21.15.155:0/1001957635 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18100076c0 con 0x7f180c0f0010 2020-05-18T21:26:30.255 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f1817fff700 1 -- 172.21.15.155:0/1001957635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c0f0010 msgr2=0x7f180c041630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.255 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.241+0000 7f1817fff700 1 --2- 172.21.15.155:0/1001957635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c0f0010 0x7f180c041630 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7f1810000c10 tx=0x7f1810007e70).stop 2020-05-18T21:26:30.255 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.245+0000 7f1817fff700 1 -- 172.21.15.155:0/1001957635 shutdown_connections 2020-05-18T21:26:30.255 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.245+0000 7f1817fff700 1 --2- 172.21.15.155:0/1001957635 >> v2:172.21.15.63:3300/0 conn(0x7f180c0f9560 0x7f180c04b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:30.255 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.245+0000 7f1817fff700 1 --2- 172.21.15.155:0/1001957635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c0f0010 0x7f180c041630 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:30.256 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.245+0000 7f1817fff700 1 -- 172.21.15.155:0/1001957635 >> 172.21.15.155:0/1001957635 conn(0x7f180c029d90 msgr2=0x7f180c04abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:30.256 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.245+0000 7f1817fff700 1 -- 172.21.15.155:0/1001957635 shutdown_connections 2020-05-18T21:26:30.256 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.245+0000 7f1817fff700 1 -- 172.21.15.155:0/1001957635 wait complete. 2020-05-18T21:26:30.259 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.245+0000 7f1817fff700 1 Processor -- start 2020-05-18T21:26:30.259 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.245+0000 7f1817fff700 1 -- start start 2020-05-18T21:26:30.259 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.245+0000 7f1817fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f180c0f0010 0x7f180c042490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:30.260 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.245+0000 7f1817fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180c0f38f0 con 0x7f180c0f9560 2020-05-18T21:26:30.260 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.245+0000 7f1817fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180c043be0 con 0x7f180c0f99f0 2020-05-18T21:26:30.260 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.245+0000 7f1817fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180c043e80 con 0x7f180c0f0010 2020-05-18T21:26:30.260 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.245+0000 7f181dd3d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f180c0f0010 0x7f180c042490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:30.261 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.245+0000 7f181cadb700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f180c0f99f0 0x7f180c0ba150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:56438/0 (socket says 172.21.15.155:56438) 2020-05-18T21:26:30.261 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.245+0000 7f181dd3d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f180c0f0010 0x7f180c042490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59138/0 (socket says 172.21.15.155:59138) 2020-05-18T21:26:30.261 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.245+0000 7f181cadb700 1 -- 172.21.15.155:0/1856162856 learned_addr learned my addr 172.21.15.155:0/1856162856 (peer_addr_for_me v1:172.21.15.155:0/0) 2020-05-18T21:26:30.261 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f1814ff9700 1 -- 172.21.15.155:0/1856162856 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341495948 0 0) 0x7f180c043be0 con 0x7f180c0f99f0 2020-05-18T21:26:30.262 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f1814ff9700 1 -- 172.21.15.155:0/1856162856 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f8003270 con 0x7f180c0f99f0 2020-05-18T21:26:30.262 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f181dd3d700 1 -- 172.21.15.155:0/1856162856 >> v1:172.21.15.155:6789/0 conn(0x7f180c0f99f0 legacy=0x7f180c0ba150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.262 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f181dd3d700 1 -- 172.21.15.155:0/1856162856 >> v1:172.21.15.63:6789/0 conn(0x7f180c0f9560 legacy=0x7f180c0ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.262 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f1814ff9700 1 -- 172.21.15.155:0/1856162856 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556576314 0 0) 0x7f180c0f38f0 con 0x7f180c0f9560 2020-05-18T21:26:30.263 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f181dd3d700 1 -- 172.21.15.155:0/1856162856 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c044120 con 0x7f180c0f0010 2020-05-18T21:26:30.263 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f181dd3d700 1 --2- 172.21.15.155:0/1856162856 >> v2:172.21.15.155:3300/0 conn(0x7f180c0f0010 0x7f180c042490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1810000c10 tx=0x7f1810007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.263 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f181dd3d700 1 --2- 172.21.15.155:0/1856162856 >> v2:172.21.15.155:3300/0 conn(0x7f180c0f0010 0x7f180c042490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1810000c10 tx=0x7f1810007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.263 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f181dd3d700 1 --2- 172.21.15.155:0/1856162856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c0f0010 0x7f180c042490 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7f1810000c10 tx=0x7f1810007e70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:30.263 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f181dd3d700 1 --2- 172.21.15.155:0/1856162856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c0f0010 0x7f180c042490 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f1810000c10 tx=0x7f1810007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.264 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f1814ff9700 1 -- 172.21.15.155:0/1856162856 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f181000f6a0 con 0x7f180c0f0010 2020-05-18T21:26:30.264 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f181dd3d700 1 --2- 172.21.15.155:0/1856162856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c0f0010 0x7f180c042490 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f1810000c10 tx=0x7f1810007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.264 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f181dd3d700 1 --2- 172.21.15.155:0/1856162856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c0f0010 0x7f180c042490 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f1810000c10 tx=0x7f1810007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.264 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f1814ff9700 1 -- 172.21.15.155:0/1856162856 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181000f800 con 0x7f180c0f0010 2020-05-18T21:26:30.265 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f1814ff9700 1 -- 172.21.15.155:0/1856162856 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f181000fb60 con 0x7f180c0f0010 2020-05-18T21:26:30.265 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f1817fff700 1 -- 172.21.15.155:0/1856162856 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180c0443c0 con 0x7f180c0f0010 2020-05-18T21:26:30.265 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f1817fff700 1 -- 172.21.15.155:0/1856162856 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180c02b6f0 con 0x7f180c0f0010 2020-05-18T21:26:30.265 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f181dd3d700 1 --2- 172.21.15.155:0/1856162856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c0f0010 0x7f180c042490 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f1810000c10 tx=0x7f1810007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.265 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f1814ff9700 1 -- 172.21.15.155:0/1856162856 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7f1810015810 con 0x7f180c0f0010 2020-05-18T21:26:30.266 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f181dd3d700 1 --2- 172.21.15.155:0/1856162856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c0f0010 0x7f180c042490 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f1810000c10 tx=0x7f1810007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.266 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f1814ff9700 1 -- 172.21.15.155:0/1856162856 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f1810014900 con 0x7f180c0f0010 2020-05-18T21:26:30.266 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.249+0000 7f1817fff700 1 -- 172.21.15.155:0/1856162856 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180c02b9a0 con 0x7f180c0f0010 2020-05-18T21:26:30.266 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.253+0000 7f181dd3d700 1 --2- 172.21.15.155:0/1856162856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c0f0010 0x7f180c042490 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f1810000c10 tx=0x7f1810007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.267 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.253+0000 7f1814ff9700 1 -- 172.21.15.155:0/1856162856 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67708 (secure 0 0 0) 0x7f1810014080 con 0x7f180c0f0010 2020-05-18T21:26:30.326 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.321+0000 7f1817fff700 1 -- 172.21.15.155:0/1856162856 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c6ae0fbf-604c-4e8d-b1b8-6038821420e3", "id": 0} v 0) v1 -- 0x7f180c004cf0 con 0x7f180c0f0010 2020-05-18T21:26:30.336 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.333+0000 7f181dd3d700 1 --2- 172.21.15.155:0/1856162856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c0f0010 0x7f180c042490 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f1810000c10 tx=0x7f1810007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.336 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.333+0000 7f1814ff9700 1 -- 172.21.15.155:0/1856162856 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c6ae0fbf-604c-4e8d-b1b8-6038821420e3", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1810015d60 con 0x7f180c0f0010 2020-05-18T21:26:30.337 INFO:teuthology.orchestra.run.smithi155.stdout:0 2020-05-18T21:26:30.338 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.333+0000 7f1817fff700 1 -- 172.21.15.155:0/1856162856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c0f0010 msgr2=0x7f180c042490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.338 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.333+0000 7f1817fff700 1 --2- 172.21.15.155:0/1856162856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c0f0010 0x7f180c042490 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7f1810000c10 tx=0x7f1810007e70).stop 2020-05-18T21:26:30.338 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.333+0000 7f1817fff700 1 -- 172.21.15.155:0/1856162856 shutdown_connections 2020-05-18T21:26:30.339 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.333+0000 7f1817fff700 1 --2- 172.21.15.155:0/1856162856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c0f0010 0x7f180c042490 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:30.339 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.333+0000 7f1817fff700 1 -- 172.21.15.155:0/1856162856 >> 172.21.15.155:0/1856162856 conn(0x7f180c029d90 msgr2=0x7f180c02a290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:30.339 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.333+0000 7f1817fff700 1 -- 172.21.15.155:0/1856162856 shutdown_connections 2020-05-18T21:26:30.339 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.333+0000 7f1817fff700 1 -- 172.21.15.155:0/1856162856 wait complete. 2020-05-18T21:26:30.348 INFO:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6 1 2020-05-18T21:26:30.457 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb2195d7700 1 Processor -- start 2020-05-18T21:26:30.457 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb2195d7700 1 -- start start 2020-05-18T21:26:30.458 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb2195d7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb2140b99a0 0x7fb2140252d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:30.458 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb2195d7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb21409f450 0x7fb2140b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:30.458 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb2195d7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21409d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:30.458 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb2195d7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2140b58d0 con 0x7fb21409f450 2020-05-18T21:26:30.458 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb2195d7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2140b6f80 con 0x7fb2140b99a0 2020-05-18T21:26:30.459 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb2195d7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2140b6280 con 0x7fb2140b6b40 2020-05-18T21:26:30.459 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb21a839700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21409d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:30.459 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb21a839700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21409d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:56174/0 (socket says 172.21.15.155:56174) 2020-05-18T21:26:30.459 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb21a839700 1 -- 172.21.15.155:0/2072769348 learned_addr learned my addr 172.21.15.155:0/2072769348 (peer_addr_for_me v2:172.21.15.155:0/0) 2020-05-18T21:26:30.459 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb218dd6700 1 --2- 172.21.15.155:0/2072769348 >> v2:172.21.15.155:3300/0 conn(0x7fb2140b99a0 0x7fb2140252d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:30.460 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb213fff700 1 --2- 172.21.15.155:0/2072769348 >> v2:172.21.15.63:3300/0 conn(0x7fb21409f450 0x7fb2140b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:30.460 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb21a839700 1 -- 172.21.15.155:0/2072769348 >> v2:172.21.15.155:3300/0 conn(0x7fb2140b99a0 msgr2=0x7fb2140252d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:30.460 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb21a839700 1 --2- 172.21.15.155:0/2072769348 >> v2:172.21.15.155:3300/0 conn(0x7fb2140b99a0 0x7fb2140252d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:30.460 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb21a839700 1 -- 172.21.15.155:0/2072769348 >> v2:172.21.15.63:3300/0 conn(0x7fb21409f450 msgr2=0x7fb2140b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:30.460 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb21a839700 1 --2- 172.21.15.155:0/2072769348 >> v2:172.21.15.63:3300/0 conn(0x7fb21409f450 0x7fb2140b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:30.461 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb21a839700 1 -- 172.21.15.155:0/2072769348 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2140b5630 con 0x7fb2140b6b40 2020-05-18T21:26:30.461 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb213fff700 1 --2- 172.21.15.155:0/2072769348 >> v2:172.21.15.63:3300/0 conn(0x7fb21409f450 0x7fb2140b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:26:30.461 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb21a839700 1 --2- 172.21.15.155:0/2072769348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21409d7a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb204002f70 tx=0x7fb204007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.461 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb21a839700 1 --2- 172.21.15.155:0/2072769348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21409d7a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb204002f70 tx=0x7fb204007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.461 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb21a839700 1 --2- 172.21.15.155:0/2072769348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21409d7a0 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7fb204002f70 tx=0x7fb204007a80).ready entity=mon.2 client_cookie=757566fd07a53e9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:30.462 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb21a839700 1 --2- 172.21.15.155:0/2072769348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21409d7a0 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7fb204002f70 tx=0x7fb204007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.462 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb21a839700 1 --2- 172.21.15.155:0/2072769348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21409d7a0 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7fb204002f70 tx=0x7fb204007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.462 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb21a839700 1 --2- 172.21.15.155:0/2072769348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21409d7a0 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7fb204002f70 tx=0x7fb204007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.462 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb2137fe700 1 -- 172.21.15.155:0/2072769348 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2040116b0 con 0x7fb2140b6b40 2020-05-18T21:26:30.462 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb2137fe700 1 -- 172.21.15.155:0/2072769348 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb204011810 con 0x7fb2140b6b40 2020-05-18T21:26:30.463 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.449+0000 7fb2137fe700 1 -- 172.21.15.155:0/2072769348 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb204011c30 con 0x7fb2140b6b40 2020-05-18T21:26:30.463 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb2195d7700 1 -- 172.21.15.155:0/2072769348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 msgr2=0x7fb21409d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.463 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb2195d7700 1 --2- 172.21.15.155:0/2072769348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21409d7a0 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7fb204002f70 tx=0x7fb204007a80).stop 2020-05-18T21:26:30.463 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb2195d7700 1 -- 172.21.15.155:0/2072769348 shutdown_connections 2020-05-18T21:26:30.463 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb2195d7700 1 --2- 172.21.15.155:0/2072769348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21409d7a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:30.464 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb2195d7700 1 --2- 172.21.15.155:0/2072769348 >> v2:172.21.15.63:3300/0 conn(0x7fb21409f450 0x7fb2140b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:30.464 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb2195d7700 1 --2- 172.21.15.155:0/2072769348 >> v2:172.21.15.155:3300/0 conn(0x7fb2140b99a0 0x7fb2140252d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:30.464 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb2195d7700 1 -- 172.21.15.155:0/2072769348 >> 172.21.15.155:0/2072769348 conn(0x7fb21405acd0 msgr2=0x7fb21405b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:30.464 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb2195d7700 1 -- 172.21.15.155:0/2072769348 shutdown_connections 2020-05-18T21:26:30.464 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb2195d7700 1 -- 172.21.15.155:0/2072769348 wait complete. 2020-05-18T21:26:30.467 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb2195d7700 1 Processor -- start 2020-05-18T21:26:30.468 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb2195d7700 1 -- start start 2020-05-18T21:26:30.468 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb2195d7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb21409f450 0x7fb214066260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:30.468 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb2195d7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21413f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:30.468 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb2195d7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb2140b99a0 0x7fb2140639a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:30.468 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb2195d7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2141400c0 con 0x7fb2140b99a0 2020-05-18T21:26:30.469 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb2195d7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb214063e00 con 0x7fb21409f450 2020-05-18T21:26:30.469 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb2195d7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21413f6e0 con 0x7fb2140b6b40 2020-05-18T21:26:30.469 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb213fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21413f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:30.469 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb213fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21413f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:56178/0 (socket says 172.21.15.155:56178) 2020-05-18T21:26:30.470 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb213fff700 1 -- 172.21.15.155:0/3120410652 learned_addr learned my addr 172.21.15.155:0/3120410652 (peer_addr_for_me v2:172.21.15.155:0/0) 2020-05-18T21:26:30.470 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.453+0000 7fb218dd6700 1 --2- 172.21.15.155:0/3120410652 >> v2:172.21.15.155:3300/0 conn(0x7fb21409f450 0x7fb214066260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:30.470 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb21a839700 1 --2- 172.21.15.155:0/3120410652 >> v2:172.21.15.63:3300/0 conn(0x7fb2140b99a0 0x7fb2140639a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:30.471 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb213fff700 1 -- 172.21.15.155:0/3120410652 >> v2:172.21.15.155:3300/0 conn(0x7fb21409f450 msgr2=0x7fb214066260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.471 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb213fff700 1 --2- 172.21.15.155:0/3120410652 >> v2:172.21.15.155:3300/0 conn(0x7fb21409f450 0x7fb214066260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:30.471 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb213fff700 1 -- 172.21.15.155:0/3120410652 >> v2:172.21.15.63:3300/0 conn(0x7fb2140b99a0 msgr2=0x7fb2140639a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.471 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb213fff700 1 --2- 172.21.15.155:0/3120410652 >> v2:172.21.15.63:3300/0 conn(0x7fb2140b99a0 0x7fb2140639a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:30.471 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb213fff700 1 -- 172.21.15.155:0/3120410652 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21413f980 con 0x7fb2140b6b40 2020-05-18T21:26:30.472 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb21a839700 1 --2- 172.21.15.155:0/3120410652 >> v2:172.21.15.63:3300/0 conn(0x7fb2140b99a0 0x7fb2140639a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:26:30.472 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb213fff700 1 --2- 172.21.15.155:0/3120410652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21413f0b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb1fc007ce0 tx=0x7fb1fc010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.472 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb213fff700 1 --2- 172.21.15.155:0/3120410652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21413f0b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb1fc007ce0 tx=0x7fb1fc010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.472 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb213fff700 1 --2- 172.21.15.155:0/3120410652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21413f0b0 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7fb1fc007ce0 tx=0x7fb1fc010fd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:30.472 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb213fff700 1 --2- 172.21.15.155:0/3120410652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21413f0b0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fb1fc007ce0 tx=0x7fb1fc010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.473 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb213fff700 1 --2- 172.21.15.155:0/3120410652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21413f0b0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fb1fc007ce0 tx=0x7fb1fc010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.473 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb213fff700 1 --2- 172.21.15.155:0/3120410652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21413f0b0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fb1fc007ce0 tx=0x7fb1fc010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.473 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb2117fa700 1 -- 172.21.15.155:0/3120410652 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1fc005e60 con 0x7fb2140b6b40 2020-05-18T21:26:30.473 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb2117fa700 1 -- 172.21.15.155:0/3120410652 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1fc0129e0 con 0x7fb2140b6b40 2020-05-18T21:26:30.473 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb2195d7700 1 -- 172.21.15.155:0/3120410652 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21413fc20 con 0x7fb2140b6b40 2020-05-18T21:26:30.474 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb2117fa700 1 -- 172.21.15.155:0/3120410652 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1fc012d40 con 0x7fb2140b6b40 2020-05-18T21:26:30.474 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb2195d7700 1 -- 172.21.15.155:0/3120410652 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2141328f0 con 0x7fb2140b6b40 2020-05-18T21:26:30.474 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb213fff700 1 --2- 172.21.15.155:0/3120410652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21413f0b0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fb1fc007ce0 tx=0x7fb1fc010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.474 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb2117fa700 1 -- 172.21.15.155:0/3120410652 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7fb1fc0076a0 con 0x7fb2140b6b40 2020-05-18T21:26:30.474 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb213fff700 1 --2- 172.21.15.155:0/3120410652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21413f0b0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fb1fc007ce0 tx=0x7fb1fc010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.475 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb2117fa700 1 -- 172.21.15.155:0/3120410652 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7fb1fc00ed70 con 0x7fb2140b6b40 2020-05-18T21:26:30.475 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.457+0000 7fb2195d7700 1 -- 172.21.15.155:0/3120410652 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ec003380 con 0x7fb2140b6b40 2020-05-18T21:26:30.475 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.461+0000 7fb213fff700 1 --2- 172.21.15.155:0/3120410652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21413f0b0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fb1fc007ce0 tx=0x7fb1fc010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.475 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.461+0000 7fb2117fa700 1 -- 172.21.15.155:0/3120410652 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67708 (secure 0 0 0) 0x7fb1fc007930 con 0x7fb2140b6b40 2020-05-18T21:26:30.568 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.529+0000 7fb2195d7700 1 -- 172.21.15.155:0/3120410652 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6", "id": 1} v 0) v1 -- 0x7fb1ec002260 con 0x7fb2140b6b40 2020-05-18T21:26:30.569 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.537+0000 7fb213fff700 1 --2- 172.21.15.155:0/3120410652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21413f0b0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fb1fc007ce0 tx=0x7fb1fc010fd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.569 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.537+0000 7fb2117fa700 1 -- 172.21.15.155:0/3120410652 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb1fc00e6b0 con 0x7fb2140b6b40 2020-05-18T21:26:30.569 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.537+0000 7fb2195d7700 1 -- 172.21.15.155:0/3120410652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 msgr2=0x7fb21413f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.569 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.537+0000 7fb2195d7700 1 --2- 172.21.15.155:0/3120410652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21413f0b0 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7fb1fc007ce0 tx=0x7fb1fc010fd0).stop 2020-05-18T21:26:30.570 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.537+0000 7fb2195d7700 1 -- 172.21.15.155:0/3120410652 shutdown_connections 2020-05-18T21:26:30.570 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.537+0000 7fb2195d7700 1 --2- 172.21.15.155:0/3120410652 >> v2:172.21.15.63:3300/0 conn(0x7fb2140b99a0 0x7fb2140639a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:30.570 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.537+0000 7fb2195d7700 1 --2- 172.21.15.155:0/3120410652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2140b6b40 0x7fb21413f0b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:30.570 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.537+0000 7fb2195d7700 1 --2- 172.21.15.155:0/3120410652 >> v2:172.21.15.155:3300/0 conn(0x7fb21409f450 0x7fb214066260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:30.570 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.537+0000 7fb2195d7700 1 -- 172.21.15.155:0/3120410652 >> 172.21.15.155:0/3120410652 conn(0x7fb21405acd0 msgr2=0x7fb21405b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:30.571 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.537+0000 7fb2195d7700 1 -- 172.21.15.155:0/3120410652 shutdown_connections 2020-05-18T21:26:30.571 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.537+0000 7fb2195d7700 1 -- 172.21.15.155:0/3120410652 wait complete. 2020-05-18T21:26:30.571 INFO:teuthology.orchestra.run.smithi155.stdout:1 2020-05-18T21:26:30.571 INFO:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new ec8d9fa9-dae9-45f6-b286-735ab3801c27 2 2020-05-18T21:26:30.680 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd0977e700 1 Processor -- start 2020-05-18T21:26:30.680 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd0977e700 1 -- start start 2020-05-18T21:26:30.680 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd0977e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbd040b8470 0x7fbd040b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:30.681 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd0977e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd04064ea0 con 0x7fbd040b75b0 2020-05-18T21:26:30.681 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd0977e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd04065140 con 0x7fbd04152530 2020-05-18T21:26:30.681 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd0977e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd040653e0 con 0x7fbd040b8470 2020-05-18T21:26:30.681 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd03fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fbd04152530 0x7fbd04062200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:56456/0 (socket says 172.21.15.155:56456) 2020-05-18T21:26:30.682 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd03fff700 1 -- 172.21.15.155:0/3524245160 learned_addr learned my addr 172.21.15.155:0/3524245160 (peer_addr_for_me v1:172.21.15.155:0/0) 2020-05-18T21:26:30.682 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd037fe700 1 --2- 172.21.15.155:0/3524245160 >> v2:172.21.15.63:3300/0 conn(0x7fbd040b8470 0x7fbd040b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:30.682 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd027fc700 1 -- 172.21.15.155:0/3524245160 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538273792 0 0) 0x7fbd04065140 con 0x7fbd04152530 2020-05-18T21:26:30.682 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd027fc700 1 -- 172.21.15.155:0/3524245160 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcf0003270 con 0x7fbd04152530 2020-05-18T21:26:30.682 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd027fc700 1 -- 172.21.15.155:0/3524245160 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3066551625 0 0) 0x7fbcf0003270 con 0x7fbd04152530 2020-05-18T21:26:30.683 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd027fc700 1 -- 172.21.15.155:0/3524245160 >> v2:172.21.15.63:3300/0 conn(0x7fbd040b8470 msgr2=0x7fbd040b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:30.683 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd027fc700 1 --2- 172.21.15.155:0/3524245160 >> v2:172.21.15.63:3300/0 conn(0x7fbd040b8470 0x7fbd040b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:30.683 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd027fc700 1 -- 172.21.15.155:0/3524245160 >> v1:172.21.15.63:6789/0 conn(0x7fbd040b75b0 legacy=0x7fbd04151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.683 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd027fc700 1 -- 172.21.15.155:0/3524245160 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd040b8850 con 0x7fbd04152530 2020-05-18T21:26:30.683 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd027fc700 1 -- 172.21.15.155:0/3524245160 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fbcfc001a90 con 0x7fbd04152530 2020-05-18T21:26:30.684 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd027fc700 1 -- 172.21.15.155:0/3524245160 >> v1:172.21.15.155:6789/0 conn(0x7fbd04152530 legacy=0x7fbd04062200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.684 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd027fc700 1 --2- 172.21.15.155:0/3524245160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcf0003760 0x7fbcf0003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:30.684 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd027fc700 1 --2- 172.21.15.155:0/3524245160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcf0004510 0x7fbcf0004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:30.684 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd027fc700 1 --2- 172.21.15.155:0/3524245160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcf0004df0 0x7fbcf000b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:30.684 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd027fc700 1 -- 172.21.15.155:0/3524245160 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd040653e0 con 0x7fbcf0004df0 2020-05-18T21:26:30.685 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd027fc700 1 -- 172.21.15.155:0/3524245160 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf0004200 con 0x7fbcf0003760 2020-05-18T21:26:30.685 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd037fe700 1 --2- 172.21.15.155:0/3524245160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcf0003760 0x7fbcf0003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:30.685 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd027fc700 1 -- 172.21.15.155:0/3524245160 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf004fbd0 con 0x7fbcf0004510 2020-05-18T21:26:30.685 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd02ffd700 1 --2- 172.21.15.155:0/3524245160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcf0004510 0x7fbcf0004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:30.685 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.669+0000 7fbd03fff700 1 --2- 172.21.15.155:0/3524245160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcf0004df0 0x7fbcf000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:30.686 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd02ffd700 1 -- 172.21.15.155:0/3524245160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcf0003760 msgr2=0x7fbcf0003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:30.686 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd02ffd700 1 --2- 172.21.15.155:0/3524245160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcf0003760 0x7fbcf0003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:30.686 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd02ffd700 1 -- 172.21.15.155:0/3524245160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcf0004df0 msgr2=0x7fbcf000b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:30.686 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd02ffd700 1 --2- 172.21.15.155:0/3524245160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcf0004df0 0x7fbcf000b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:30.686 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd03fff700 1 -- 172.21.15.155:0/3524245160 reap_dead start 2020-05-18T21:26:30.687 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd02ffd700 1 -- 172.21.15.155:0/3524245160 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf0003270 con 0x7fbcf0004510 2020-05-18T21:26:30.687 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd02ffd700 1 --2- 172.21.15.155:0/3524245160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcf0004510 0x7fbcf0004990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbcf00054e0 tx=0x7fbcec001080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.687 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd02ffd700 1 --2- 172.21.15.155:0/3524245160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcf0004510 0x7fbcf0004990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbcf00054e0 tx=0x7fbcec001080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.687 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd02ffd700 1 --2- 172.21.15.155:0/3524245160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcf0004510 0x7fbcf0004990 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7fbcf00054e0 tx=0x7fbcec001080).ready entity=mon.2 client_cookie=1fa79a656a74f3f6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:30.687 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd02ffd700 1 --2- 172.21.15.155:0/3524245160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcf0004510 0x7fbcf0004990 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fbcf00054e0 tx=0x7fbcec001080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.688 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd027fc700 1 -- 172.21.15.155:0/3524245160 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcec003560 con 0x7fbcf0004510 2020-05-18T21:26:30.688 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd02ffd700 1 --2- 172.21.15.155:0/3524245160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcf0004510 0x7fbcf0004990 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fbcf00054e0 tx=0x7fbcec001080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.688 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd02ffd700 1 --2- 172.21.15.155:0/3524245160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcf0004510 0x7fbcf0004990 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fbcf00054e0 tx=0x7fbcec001080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.688 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd027fc700 1 -- 172.21.15.155:0/3524245160 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec0036c0 con 0x7fbcf0004510 2020-05-18T21:26:30.688 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd027fc700 1 -- 172.21.15.155:0/3524245160 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcec003aa0 con 0x7fbcf0004510 2020-05-18T21:26:30.689 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd0977e700 1 -- 172.21.15.155:0/3524245160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcf0004510 msgr2=0x7fbcf0004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.697 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd0977e700 1 --2- 172.21.15.155:0/3524245160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcf0004510 0x7fbcf0004990 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7fbcf00054e0 tx=0x7fbcec001080).stop 2020-05-18T21:26:30.698 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd0977e700 1 -- 172.21.15.155:0/3524245160 shutdown_connections 2020-05-18T21:26:30.698 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd0977e700 1 --2- 172.21.15.155:0/3524245160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcf0004510 0x7fbcf0004990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:30.698 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd0977e700 1 -- 172.21.15.155:0/3524245160 >> 172.21.15.155:0/3524245160 conn(0x7fbd04065d50 msgr2=0x7fbd04066130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:30.699 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd0977e700 1 -- 172.21.15.155:0/3524245160 shutdown_connections 2020-05-18T21:26:30.699 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd0977e700 1 -- 172.21.15.155:0/3524245160 wait complete. 2020-05-18T21:26:30.699 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd0977e700 1 Processor -- start 2020-05-18T21:26:30.699 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd0977e700 1 -- start start 2020-05-18T21:26:30.699 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd0977e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbd04130d50 0x7fbd040afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:30.700 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd0977e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd040b42b0 con 0x7fbd041308a0 2020-05-18T21:26:30.700 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd0977e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd040b4550 con 0x7fbcf0004510 2020-05-18T21:26:30.700 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.673+0000 7fbd0977e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd040b47f0 con 0x7fbd04130d50 2020-05-18T21:26:30.700 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.677+0000 7fbd037fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fbcf0004510 0x7fbd04130190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:56464/0 (socket says 172.21.15.155:56464) 2020-05-18T21:26:30.700 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.677+0000 7fbd037fe700 1 -- 172.21.15.155:0/653753915 learned_addr learned my addr 172.21.15.155:0/653753915 (peer_addr_for_me v1:172.21.15.155:0/0) 2020-05-18T21:26:30.700 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.677+0000 7fbd03fff700 1 --2- 172.21.15.155:0/653753915 >> v2:172.21.15.155:3300/0 conn(0x7fbd04130d50 0x7fbd040afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:30.701 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.677+0000 7fbd03fff700 1 -- 172.21.15.155:0/653753915 >> v1:172.21.15.155:6789/0 conn(0x7fbcf0004510 legacy=0x7fbd04130190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.701 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.677+0000 7fbd03fff700 1 -- 172.21.15.155:0/653753915 >> v1:172.21.15.63:6789/0 conn(0x7fbd041308a0 legacy=0x7fbd04121f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.701 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.677+0000 7fbd03fff700 1 -- 172.21.15.155:0/653753915 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd040b0e70 con 0x7fbd04130d50 2020-05-18T21:26:30.701 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.677+0000 7fbd03fff700 1 --2- 172.21.15.155:0/653753915 >> v2:172.21.15.155:3300/0 conn(0x7fbd04130d50 0x7fbd040afb60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd04134330 tx=0x7fbd040b89e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.701 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.677+0000 7fbd03fff700 1 --2- 172.21.15.155:0/653753915 >> v2:172.21.15.155:3300/0 conn(0x7fbd04130d50 0x7fbd040afb60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd04134330 tx=0x7fbd040b89e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.702 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.677+0000 7fbd03fff700 1 --2- 172.21.15.155:0/653753915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd04130d50 0x7fbd040afb60 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7fbd04134330 tx=0x7fbd040b89e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:30.702 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.677+0000 7fbd03fff700 1 --2- 172.21.15.155:0/653753915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd04130d50 0x7fbd040afb60 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fbd04134330 tx=0x7fbd040b89e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.702 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.677+0000 7fbd03fff700 1 --2- 172.21.15.155:0/653753915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd04130d50 0x7fbd040afb60 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fbd04134330 tx=0x7fbd040b89e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.702 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.677+0000 7fbd03fff700 1 --2- 172.21.15.155:0/653753915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd04130d50 0x7fbd040afb60 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fbd04134330 tx=0x7fbd040b89e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.704 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.681+0000 7fbcfbfff700 1 -- 172.21.15.155:0/653753915 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcfc011710 con 0x7fbd04130d50 2020-05-18T21:26:30.704 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.681+0000 7fbcfbfff700 1 -- 172.21.15.155:0/653753915 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcfc011870 con 0x7fbd04130d50 2020-05-18T21:26:30.704 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.681+0000 7fbd0977e700 1 -- 172.21.15.155:0/653753915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd040adc10 con 0x7fbd04130d50 2020-05-18T21:26:30.705 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.681+0000 7fbcfbfff700 1 -- 172.21.15.155:0/653753915 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcfc011bd0 con 0x7fbd04130d50 2020-05-18T21:26:30.705 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.681+0000 7fbd0977e700 1 -- 172.21.15.155:0/653753915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd04122830 con 0x7fbd04130d50 2020-05-18T21:26:30.705 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.681+0000 7fbd03fff700 1 --2- 172.21.15.155:0/653753915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd04130d50 0x7fbd040afb60 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fbd04134330 tx=0x7fbd040b89e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.705 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.681+0000 7fbd03fff700 1 --2- 172.21.15.155:0/653753915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd04130d50 0x7fbd040afb60 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fbd04134330 tx=0x7fbd040b89e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.706 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.681+0000 7fbcfbfff700 1 -- 172.21.15.155:0/653753915 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7fbcfc0088f0 con 0x7fbd04130d50 2020-05-18T21:26:30.706 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.681+0000 7fbcfbfff700 1 -- 172.21.15.155:0/653753915 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7fbcfc00e420 con 0x7fbd04130d50 2020-05-18T21:26:30.706 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.681+0000 7fbd0977e700 1 -- 172.21.15.155:0/653753915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd040569e0 con 0x7fbd04130d50 2020-05-18T21:26:30.706 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.685+0000 7fbd03fff700 1 --2- 172.21.15.155:0/653753915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd04130d50 0x7fbd040afb60 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fbd04134330 tx=0x7fbd040b89e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.706 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.685+0000 7fbcfbfff700 1 -- 172.21.15.155:0/653753915 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67708 (secure 0 0 0) 0x7fbcfc008d10 con 0x7fbd04130d50 2020-05-18T21:26:30.755 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.753+0000 7fbd0977e700 1 -- 172.21.15.155:0/653753915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ec8d9fa9-dae9-45f6-b286-735ab3801c27", "id": 2} v 0) v1 -- 0x7fbd040b4930 con 0x7fbd04130d50 2020-05-18T21:26:30.765 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.761+0000 7fbd03fff700 1 --2- 172.21.15.155:0/653753915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd04130d50 0x7fbd040afb60 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fbd04134330 tx=0x7fbd040b89e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.765 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.761+0000 7fbcfbfff700 1 -- 172.21.15.155:0/653753915 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ec8d9fa9-dae9-45f6-b286-735ab3801c27", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbcfc00e680 con 0x7fbd04130d50 2020-05-18T21:26:30.766 INFO:teuthology.orchestra.run.smithi155.stdout:2 2020-05-18T21:26:30.767 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.761+0000 7fbd0977e700 1 -- 172.21.15.155:0/653753915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd04130d50 msgr2=0x7fbd040afb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.767 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.761+0000 7fbd0977e700 1 --2- 172.21.15.155:0/653753915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd04130d50 0x7fbd040afb60 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7fbd04134330 tx=0x7fbd040b89e0).stop 2020-05-18T21:26:30.767 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.761+0000 7fbd0977e700 1 -- 172.21.15.155:0/653753915 shutdown_connections 2020-05-18T21:26:30.767 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.765+0000 7fbd0977e700 1 --2- 172.21.15.155:0/653753915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd04130d50 0x7fbd040afb60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:30.768 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.765+0000 7fbd0977e700 1 -- 172.21.15.155:0/653753915 >> 172.21.15.155:0/653753915 conn(0x7fbd04065d50 msgr2=0x7fbd04064490 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:30.768 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.765+0000 7fbd0977e700 1 -- 172.21.15.155:0/653753915 shutdown_connections 2020-05-18T21:26:30.768 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.765+0000 7fbd0977e700 1 -- 172.21.15.155:0/653753915 wait complete. 2020-05-18T21:26:30.778 INFO:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 1030fedf-adad-4e79-b839-59385d4d7d2a 3 2020-05-18T21:26:30.886 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.877+0000 7fe7bcf0b700 1 Processor -- start 2020-05-18T21:26:30.886 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.877+0000 7fe7bcf0b700 1 -- start start 2020-05-18T21:26:30.887 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.877+0000 7fe7bcf0b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe7b80b8c30 0x7fe7b81566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:30.887 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.877+0000 7fe7bcf0b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe7b8157260 0x7fe7b815c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:30.887 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.877+0000 7fe7bcf0b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b8065a70 con 0x7fe7b80ad070 2020-05-18T21:26:30.887 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.877+0000 7fe7bcf0b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b80801d0 con 0x7fe7b8157260 2020-05-18T21:26:30.887 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.877+0000 7fe7bcf0b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b80b5ae0 con 0x7fe7b80b8c30 2020-05-18T21:26:30.888 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.877+0000 7fe7b6d9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe7b80b8c30 0x7fe7b81566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:30.888 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.877+0000 7fe7b6d9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe7b80b8c30 0x7fe7b81566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59174/0 (socket says 172.21.15.155:59174) 2020-05-18T21:26:30.888 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.877+0000 7fe7b6d9d700 1 -- 172.21.15.155:0/4048846397 learned_addr learned my addr 172.21.15.155:0/4048846397 (peer_addr_for_me v2:172.21.15.155:0/0) 2020-05-18T21:26:30.888 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.877+0000 7fe7b759e700 1 --2- 172.21.15.155:0/4048846397 >> v2:172.21.15.63:3300/0 conn(0x7fe7b8157260 0x7fe7b815c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:30.888 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.877+0000 7fe7b6d9d700 1 -- 172.21.15.155:0/4048846397 >> v2:172.21.15.63:3300/0 conn(0x7fe7b8157260 msgr2=0x7fe7b815c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:30.889 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.877+0000 7fe7b6d9d700 1 --2- 172.21.15.155:0/4048846397 >> v2:172.21.15.63:3300/0 conn(0x7fe7b8157260 0x7fe7b815c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:30.889 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.877+0000 7fe7b6d9d700 1 -- 172.21.15.155:0/4048846397 >> v1:172.21.15.63:6789/0 conn(0x7fe7b80ad070 legacy=0x7fe7b8156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.889 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.877+0000 7fe7b6d9d700 1 -- 172.21.15.155:0/4048846397 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b80b9010 con 0x7fe7b80b8c30 2020-05-18T21:26:30.889 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.877+0000 7fe7b6d9d700 1 --2- 172.21.15.155:0/4048846397 >> v2:172.21.15.155:3300/0 conn(0x7fe7b80b8c30 0x7fe7b81566f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe7a8002f70 tx=0x7fe7a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.890 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.877+0000 7fe7b6d9d700 1 --2- 172.21.15.155:0/4048846397 >> v2:172.21.15.155:3300/0 conn(0x7fe7b80b8c30 0x7fe7b81566f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe7a8002f70 tx=0x7fe7a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.896 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.877+0000 7fe7b6d9d700 1 --2- 172.21.15.155:0/4048846397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b80b8c30 0x7fe7b81566f0 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7fe7a8002f70 tx=0x7fe7a8007a80).ready entity=mon.1 client_cookie=84c02ba335e359d4 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:30.896 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7b6d9d700 1 --2- 172.21.15.155:0/4048846397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b80b8c30 0x7fe7b81566f0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fe7a8002f70 tx=0x7fe7a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.896 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7b6d9d700 1 --2- 172.21.15.155:0/4048846397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b80b8c30 0x7fe7b81566f0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fe7a8002f70 tx=0x7fe7a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.896 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7b5d9b700 1 -- 172.21.15.155:0/4048846397 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7a80116b0 con 0x7fe7b80b8c30 2020-05-18T21:26:30.896 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7b6d9d700 1 --2- 172.21.15.155:0/4048846397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b80b8c30 0x7fe7b81566f0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fe7a8002f70 tx=0x7fe7a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.897 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7b5d9b700 1 -- 172.21.15.155:0/4048846397 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a8011810 con 0x7fe7b80b8c30 2020-05-18T21:26:30.897 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7b5d9b700 1 -- 172.21.15.155:0/4048846397 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7a8011c30 con 0x7fe7b80b8c30 2020-05-18T21:26:30.897 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7bcf0b700 1 -- 172.21.15.155:0/4048846397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b80b8c30 msgr2=0x7fe7b81566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.897 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7bcf0b700 1 --2- 172.21.15.155:0/4048846397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b80b8c30 0x7fe7b81566f0 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7fe7a8002f70 tx=0x7fe7a8007a80).stop 2020-05-18T21:26:30.898 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7bcf0b700 1 -- 172.21.15.155:0/4048846397 shutdown_connections 2020-05-18T21:26:30.898 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7bcf0b700 1 --2- 172.21.15.155:0/4048846397 >> v2:172.21.15.63:3300/0 conn(0x7fe7b8157260 0x7fe7b815c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:30.898 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7bcf0b700 1 --2- 172.21.15.155:0/4048846397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b80b8c30 0x7fe7b81566f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:30.898 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7bcf0b700 1 -- 172.21.15.155:0/4048846397 >> 172.21.15.155:0/4048846397 conn(0x7fe7b806a640 msgr2=0x7fe7b80b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:30.898 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7bcf0b700 1 -- 172.21.15.155:0/4048846397 shutdown_connections 2020-05-18T21:26:30.899 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7bcf0b700 1 -- 172.21.15.155:0/4048846397 wait complete. 2020-05-18T21:26:30.899 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7bcf0b700 1 Processor -- start 2020-05-18T21:26:30.899 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7bcf0b700 1 -- start start 2020-05-18T21:26:30.902 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7bcf0b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe7b80ad070 0x7fe7b8063820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:30.902 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7bcf0b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe7b8157260 0x7fe7b807f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:30.902 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7bcf0b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b807ff00 con 0x7fe7b80b8c30 2020-05-18T21:26:30.903 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7bcf0b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b8132330 con 0x7fe7b80ad070 2020-05-18T21:26:30.903 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.881+0000 7fe7bcf0b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b8065080 con 0x7fe7b8157260 2020-05-18T21:26:30.903 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7b759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe7b8157260 0x7fe7b807f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:30.903 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7b759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe7b8157260 0x7fe7b807f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59184/0 (socket says 172.21.15.155:59184) 2020-05-18T21:26:30.903 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7b759e700 1 -- 172.21.15.155:0/2220814121 learned_addr learned my addr 172.21.15.155:0/2220814121 (peer_addr_for_me v2:172.21.15.155:0/0) 2020-05-18T21:26:30.904 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7b6d9d700 1 --2- 172.21.15.155:0/2220814121 >> v2:172.21.15.63:3300/0 conn(0x7fe7b80ad070 0x7fe7b8063820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:30.904 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7b759e700 1 -- 172.21.15.155:0/2220814121 >> v2:172.21.15.63:3300/0 conn(0x7fe7b80ad070 msgr2=0x7fe7b8063820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.904 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7b759e700 1 --2- 172.21.15.155:0/2220814121 >> v2:172.21.15.63:3300/0 conn(0x7fe7b80ad070 0x7fe7b8063820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:30.904 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7b759e700 1 -- 172.21.15.155:0/2220814121 >> v1:172.21.15.63:6789/0 conn(0x7fe7b80b8c30 legacy=0x7fe7b8133cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.904 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7b759e700 1 -- 172.21.15.155:0/2220814121 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b8065320 con 0x7fe7b8157260 2020-05-18T21:26:30.905 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7b6d9d700 1 --2- 172.21.15.155:0/2220814121 >> v2:172.21.15.63:3300/0 conn(0x7fe7b80ad070 0x7fe7b8063820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:26:30.905 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7b759e700 1 --2- 172.21.15.155:0/2220814121 >> v2:172.21.15.155:3300/0 conn(0x7fe7b8157260 0x7fe7b807f6d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe7b00032f0 tx=0x7fe7b0013260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.905 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7b759e700 1 --2- 172.21.15.155:0/2220814121 >> v2:172.21.15.155:3300/0 conn(0x7fe7b8157260 0x7fe7b807f6d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe7b00032f0 tx=0x7fe7b0013260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.905 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7b759e700 1 --2- 172.21.15.155:0/2220814121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b8157260 0x7fe7b807f6d0 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7fe7b00032f0 tx=0x7fe7b0013260).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:30.905 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7b759e700 1 --2- 172.21.15.155:0/2220814121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b8157260 0x7fe7b807f6d0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7fe7b00032f0 tx=0x7fe7b0013260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.906 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7b759e700 1 --2- 172.21.15.155:0/2220814121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b8157260 0x7fe7b807f6d0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7fe7b00032f0 tx=0x7fe7b0013260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.906 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7af7fe700 1 -- 172.21.15.155:0/2220814121 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7b0014af0 con 0x7fe7b8157260 2020-05-18T21:26:30.906 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7b759e700 1 --2- 172.21.15.155:0/2220814121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b8157260 0x7fe7b807f6d0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7fe7b00032f0 tx=0x7fe7b0013260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.906 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7af7fe700 1 -- 172.21.15.155:0/2220814121 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b0014c50 con 0x7fe7b8157260 2020-05-18T21:26:30.907 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7af7fe700 1 -- 172.21.15.155:0/2220814121 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7b0007180 con 0x7fe7b8157260 2020-05-18T21:26:30.907 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7bcf0b700 1 -- 172.21.15.155:0/2220814121 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b80617f0 con 0x7fe7b8157260 2020-05-18T21:26:30.907 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7bcf0b700 1 -- 172.21.15.155:0/2220814121 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b80608c0 con 0x7fe7b8157260 2020-05-18T21:26:30.907 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7b759e700 1 --2- 172.21.15.155:0/2220814121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b8157260 0x7fe7b807f6d0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7fe7b00032f0 tx=0x7fe7b0013260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.908 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7b759e700 1 --2- 172.21.15.155:0/2220814121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b8157260 0x7fe7b807f6d0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7fe7b00032f0 tx=0x7fe7b0013260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.908 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7af7fe700 1 -- 172.21.15.155:0/2220814121 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7fe7b000c1a0 con 0x7fe7b8157260 2020-05-18T21:26:30.908 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7af7fe700 1 -- 172.21.15.155:0/2220814121 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7fe7b000cd90 con 0x7fe7b8157260 2020-05-18T21:26:30.908 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.885+0000 7fe7bcf0b700 1 -- 172.21.15.155:0/2220814121 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b80605b0 con 0x7fe7b8157260 2020-05-18T21:26:30.909 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.889+0000 7fe7b759e700 1 --2- 172.21.15.155:0/2220814121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b8157260 0x7fe7b807f6d0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7fe7b00032f0 tx=0x7fe7b0013260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.909 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.889+0000 7fe7af7fe700 1 -- 172.21.15.155:0/2220814121 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67708 (secure 0 0 0) 0x7fe7b00078f0 con 0x7fe7b8157260 2020-05-18T21:26:30.959 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.957+0000 7fe7bcf0b700 1 -- 172.21.15.155:0/2220814121 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1030fedf-adad-4e79-b839-59385d4d7d2a", "id": 3} v 0) v1 -- 0x7fe7b80569e0 con 0x7fe7b8157260 2020-05-18T21:26:30.969 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.965+0000 7fe7b759e700 1 --2- 172.21.15.155:0/2220814121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b8157260 0x7fe7b807f6d0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7fe7b00032f0 tx=0x7fe7b0013260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:30.970 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.965+0000 7fe7af7fe700 1 -- 172.21.15.155:0/2220814121 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1030fedf-adad-4e79-b839-59385d4d7d2a", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe7b000c740 con 0x7fe7b8157260 2020-05-18T21:26:30.970 INFO:teuthology.orchestra.run.smithi155.stdout:3 2020-05-18T21:26:30.971 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.965+0000 7fe7bcf0b700 1 -- 172.21.15.155:0/2220814121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b8157260 msgr2=0x7fe7b807f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:30.971 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.965+0000 7fe7bcf0b700 1 --2- 172.21.15.155:0/2220814121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b8157260 0x7fe7b807f6d0 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7fe7b00032f0 tx=0x7fe7b0013260).stop 2020-05-18T21:26:30.972 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.965+0000 7fe7bcf0b700 1 -- 172.21.15.155:0/2220814121 shutdown_connections 2020-05-18T21:26:30.972 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.965+0000 7fe7bcf0b700 1 --2- 172.21.15.155:0/2220814121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b8157260 0x7fe7b807f6d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:30.972 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.965+0000 7fe7bcf0b700 1 --2- 172.21.15.155:0/2220814121 >> v2:172.21.15.63:3300/0 conn(0x7fe7b80ad070 0x7fe7b8063820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:30.972 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.965+0000 7fe7bcf0b700 1 -- 172.21.15.155:0/2220814121 >> 172.21.15.155:0/2220814121 conn(0x7fe7b806a640 msgr2=0x7fe7b80b7700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:30.972 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.969+0000 7fe7bcf0b700 1 -- 172.21.15.155:0/2220814121 shutdown_connections 2020-05-18T21:26:30.972 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:30.969+0000 7fe7bcf0b700 1 -- 172.21.15.155:0/2220814121 wait complete. 2020-05-18T21:26:30.983 INFO:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 8ad15a9b-97b4-4002-b1d4-7292e09b4ef6 4 2020-05-18T21:26:31.082 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.073+0000 7fdde01c5700 1 Processor -- start 2020-05-18T21:26:31.083 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdde01c5700 1 -- start start 2020-05-18T21:26:31.083 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdde01c5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fddd80b8c30 0x7fddd81566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:31.083 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdde01c5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fddd80ad070 0x7fddd8156b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:31.083 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdde01c5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd8065a70 con 0x7fddd8156fb0 2020-05-18T21:26:31.084 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdde01c5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd80801d0 con 0x7fddd80b8c30 2020-05-18T21:26:31.084 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdde01c5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd80b5ae0 con 0x7fddd80ad070 2020-05-18T21:26:31.084 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fddddf61700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fddd80ad070 0x7fddd8156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:31.084 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdddef63700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fddd8156fb0 0x7fddd815b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:56486/0 (socket says 172.21.15.155:56486) 2020-05-18T21:26:31.084 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fddddf61700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fddd80ad070 0x7fddd8156b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59188/0 (socket says 172.21.15.155:59188) 2020-05-18T21:26:31.085 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdddef63700 1 -- 172.21.15.155:0/3180431941 learned_addr learned my addr 172.21.15.155:0/3180431941 (peer_addr_for_me v1:172.21.15.155:0/0) 2020-05-18T21:26:31.085 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fddde762700 1 --2- 172.21.15.155:0/3180431941 >> v2:172.21.15.63:3300/0 conn(0x7fddd80b8c30 0x7fddd81566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:31.085 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fddddf61700 1 -- 172.21.15.155:0/3180431941 >> v2:172.21.15.63:3300/0 conn(0x7fddd80b8c30 msgr2=0x7fddd81566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:31.085 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fddddf61700 1 --2- 172.21.15.155:0/3180431941 >> v2:172.21.15.63:3300/0 conn(0x7fddd80b8c30 0x7fddd81566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:31.086 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fddddf61700 1 -- 172.21.15.155:0/3180431941 >> v1:172.21.15.155:6789/0 conn(0x7fddd8156fb0 legacy=0x7fddd815b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.087 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdddd760700 1 -- 172.21.15.155:0/3180431941 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262609014 0 0) 0x7fddd8065a70 con 0x7fddd8156fb0 2020-05-18T21:26:31.087 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fddddf61700 1 -- 172.21.15.155:0/3180431941 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd80b9010 con 0x7fddd80ad070 2020-05-18T21:26:31.087 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fddddf61700 1 --2- 172.21.15.155:0/3180431941 >> v2:172.21.15.155:3300/0 conn(0x7fddd80ad070 0x7fddd8156b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fddc8002f70 tx=0x7fddc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.088 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fddddf61700 1 --2- 172.21.15.155:0/3180431941 >> v2:172.21.15.155:3300/0 conn(0x7fddd80ad070 0x7fddd8156b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fddc8002f70 tx=0x7fddc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.088 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fddddf61700 1 --2- 172.21.15.155:0/3180431941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddd80ad070 0x7fddd8156b50 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7fddc8002f70 tx=0x7fddc8007a80).ready entity=mon.1 client_cookie=eb63808f75905b91 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:31.088 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fddddf61700 1 --2- 172.21.15.155:0/3180431941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddd80ad070 0x7fddd8156b50 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fddc8002f70 tx=0x7fddc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.089 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdddd760700 1 -- 172.21.15.155:0/3180431941 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc8008e50 con 0x7fddd80ad070 2020-05-18T21:26:31.089 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fddddf61700 1 --2- 172.21.15.155:0/3180431941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddd80ad070 0x7fddd8156b50 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fddc8002f70 tx=0x7fddc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.089 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdddd760700 1 -- 172.21.15.155:0/3180431941 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc80115f0 con 0x7fddd80ad070 2020-05-18T21:26:31.089 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fddddf61700 1 --2- 172.21.15.155:0/3180431941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddd80ad070 0x7fddd8156b50 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fddc8002f70 tx=0x7fddc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.090 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdddd760700 1 -- 172.21.15.155:0/3180431941 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc80119d0 con 0x7fddd80ad070 2020-05-18T21:26:31.090 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdde01c5700 1 -- 172.21.15.155:0/3180431941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddd80ad070 msgr2=0x7fddd8156b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.090 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdde01c5700 1 --2- 172.21.15.155:0/3180431941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddd80ad070 0x7fddd8156b50 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7fddc8002f70 tx=0x7fddc8007a80).stop 2020-05-18T21:26:31.090 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdde01c5700 1 -- 172.21.15.155:0/3180431941 shutdown_connections 2020-05-18T21:26:31.090 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdde01c5700 1 --2- 172.21.15.155:0/3180431941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddd80ad070 0x7fddd8156b50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:31.091 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdde01c5700 1 --2- 172.21.15.155:0/3180431941 >> v2:172.21.15.63:3300/0 conn(0x7fddd80b8c30 0x7fddd81566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:31.091 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdde01c5700 1 -- 172.21.15.155:0/3180431941 >> 172.21.15.155:0/3180431941 conn(0x7fddd806a640 msgr2=0x7fddd80b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:31.091 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdde01c5700 1 -- 172.21.15.155:0/3180431941 shutdown_connections 2020-05-18T21:26:31.091 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.077+0000 7fdde01c5700 1 -- 172.21.15.155:0/3180431941 wait complete. 2020-05-18T21:26:31.094 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.081+0000 7fdde01c5700 1 Processor -- start 2020-05-18T21:26:31.094 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.081+0000 7fdde01c5700 1 -- start start 2020-05-18T21:26:31.095 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.081+0000 7fdde01c5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd80b8c30 0x7fddd8123750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:31.095 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.081+0000 7fdde01c5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd8073ab0 con 0x7fddd8156fb0 2020-05-18T21:26:31.095 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.081+0000 7fdde01c5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd8073d50 con 0x7fddd80ad070 2020-05-18T21:26:31.095 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.081+0000 7fdde01c5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd8075250 con 0x7fddd80b8c30 2020-05-18T21:26:31.096 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.081+0000 7fddde762700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fddd80ad070 0x7fddd80726e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:56488/0 (socket says 172.21.15.155:56488) 2020-05-18T21:26:31.096 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.081+0000 7fddde762700 1 -- 172.21.15.155:0/2549108982 learned_addr learned my addr 172.21.15.155:0/2549108982 (peer_addr_for_me v1:172.21.15.155:0/0) 2020-05-18T21:26:31.096 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.081+0000 7fddddf61700 1 --2- 172.21.15.155:0/2549108982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd80b8c30 0x7fddd8123750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:31.096 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.081+0000 7fddceffd700 1 -- 172.21.15.155:0/2549108982 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 133059366 0 0) 0x7fddd8073d50 con 0x7fddd80ad070 2020-05-18T21:26:31.097 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.081+0000 7fddceffd700 1 -- 172.21.15.155:0/2549108982 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddc0003270 con 0x7fddd80ad070 2020-05-18T21:26:31.097 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.081+0000 7fddddf61700 1 -- 172.21.15.155:0/2549108982 >> v1:172.21.15.155:6789/0 conn(0x7fddd80ad070 legacy=0x7fddd80726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.097 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.081+0000 7fddddf61700 1 -- 172.21.15.155:0/2549108982 >> v1:172.21.15.63:6789/0 conn(0x7fddd8156fb0 legacy=0x7fddd80756f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.097 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.081+0000 7fddddf61700 1 -- 172.21.15.155:0/2549108982 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd8072df0 con 0x7fddd80b8c30 2020-05-18T21:26:31.097 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.081+0000 7fddddf61700 1 --2- 172.21.15.155:0/2549108982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd80b8c30 0x7fddd8123750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fddc8002f70 tx=0x7fddc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.098 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.081+0000 7fddddf61700 1 --2- 172.21.15.155:0/2549108982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd80b8c30 0x7fddd8123750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fddc8002f70 tx=0x7fddc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.098 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.081+0000 7fddddf61700 1 --2- 172.21.15.155:0/2549108982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd80b8c30 0x7fddd8123750 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fddc8002f70 tx=0x7fddc8007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:31.098 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.081+0000 7fddddf61700 1 --2- 172.21.15.155:0/2549108982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd80b8c30 0x7fddd8123750 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fddc8002f70 tx=0x7fddc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.098 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.081+0000 7fddceffd700 1 -- 172.21.15.155:0/2549108982 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc800f860 con 0x7fddd80b8c30 2020-05-18T21:26:31.099 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.085+0000 7fddddf61700 1 --2- 172.21.15.155:0/2549108982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd80b8c30 0x7fddd8123750 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fddc8002f70 tx=0x7fddc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.099 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.085+0000 7fdde01c5700 1 -- 172.21.15.155:0/2549108982 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd8073410 con 0x7fddd80b8c30 2020-05-18T21:26:31.099 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.085+0000 7fddceffd700 1 -- 172.21.15.155:0/2549108982 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc8007360 con 0x7fddd80b8c30 2020-05-18T21:26:31.099 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.085+0000 7fddddf61700 1 --2- 172.21.15.155:0/2549108982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd80b8c30 0x7fddd8123750 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fddc8002f70 tx=0x7fddc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.099 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.085+0000 7fddceffd700 1 -- 172.21.15.155:0/2549108982 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc8005700 con 0x7fddd80b8c30 2020-05-18T21:26:31.100 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.085+0000 7fdde01c5700 1 -- 172.21.15.155:0/2549108982 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd8071b70 con 0x7fddd80b8c30 2020-05-18T21:26:31.100 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.085+0000 7fddddf61700 1 --2- 172.21.15.155:0/2549108982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd80b8c30 0x7fddd8123750 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fddc8002f70 tx=0x7fddc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.100 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.085+0000 7fddceffd700 1 -- 172.21.15.155:0/2549108982 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7fddc800d450 con 0x7fddd80b8c30 2020-05-18T21:26:31.100 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.085+0000 7fddddf61700 1 --2- 172.21.15.155:0/2549108982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd80b8c30 0x7fddd8123750 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fddc8002f70 tx=0x7fddc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.101 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.085+0000 7fddceffd700 1 -- 172.21.15.155:0/2549108982 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7fddc8005e00 con 0x7fddd80b8c30 2020-05-18T21:26:31.101 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.085+0000 7fdde01c5700 1 -- 172.21.15.155:0/2549108982 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd80569e0 con 0x7fddd80b8c30 2020-05-18T21:26:31.101 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.085+0000 7fddddf61700 1 --2- 172.21.15.155:0/2549108982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd80b8c30 0x7fddd8123750 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fddc8002f70 tx=0x7fddc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.101 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.085+0000 7fddceffd700 1 -- 172.21.15.155:0/2549108982 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67708 (secure 0 0 0) 0x7fddc800d910 con 0x7fddd80b8c30 2020-05-18T21:26:31.155 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.153+0000 7fdde01c5700 1 -- 172.21.15.155:0/2549108982 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8ad15a9b-97b4-4002-b1d4-7292e09b4ef6", "id": 4} v 0) v1 -- 0x7fddd8073890 con 0x7fddd80b8c30 2020-05-18T21:26:31.165 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.161+0000 7fddddf61700 1 --2- 172.21.15.155:0/2549108982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd80b8c30 0x7fddd8123750 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fddc8002f70 tx=0x7fddc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.166 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.161+0000 7fddceffd700 1 -- 172.21.15.155:0/2549108982 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8ad15a9b-97b4-4002-b1d4-7292e09b4ef6", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fddc800dab0 con 0x7fddd80b8c30 2020-05-18T21:26:31.166 INFO:teuthology.orchestra.run.smithi155.stdout:4 2020-05-18T21:26:31.167 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.165+0000 7fdde01c5700 1 -- 172.21.15.155:0/2549108982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd80b8c30 msgr2=0x7fddd8123750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.167 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.165+0000 7fdde01c5700 1 --2- 172.21.15.155:0/2549108982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd80b8c30 0x7fddd8123750 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fddc8002f70 tx=0x7fddc8007a80).stop 2020-05-18T21:26:31.168 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.165+0000 7fdde01c5700 1 -- 172.21.15.155:0/2549108982 shutdown_connections 2020-05-18T21:26:31.168 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.165+0000 7fdde01c5700 1 --2- 172.21.15.155:0/2549108982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd80b8c30 0x7fddd8123750 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:31.168 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.165+0000 7fdde01c5700 1 -- 172.21.15.155:0/2549108982 >> 172.21.15.155:0/2549108982 conn(0x7fddd806a640 msgr2=0x7fddd80b60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:31.168 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.165+0000 7fdde01c5700 1 -- 172.21.15.155:0/2549108982 shutdown_connections 2020-05-18T21:26:31.168 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.165+0000 7fdde01c5700 1 -- 172.21.15.155:0/2549108982 wait complete. 2020-05-18T21:26:31.178 INFO:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 0dce88f8-b984-43e1-95e2-4132171102d2 5 2020-05-18T21:26:31.291 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.277+0000 7f8808e20700 1 Processor -- start 2020-05-18T21:26:31.292 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.277+0000 7f8808e20700 1 -- start start 2020-05-18T21:26:31.292 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8808e20700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f88040252d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:31.292 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8808e20700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88040b6280 con 0x7f880409d7a0 2020-05-18T21:26:31.292 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8808e20700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88040b5630 con 0x7f880409f450 2020-05-18T21:26:31.293 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8808e20700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88040b58d0 con 0x7f88040b99a0 2020-05-18T21:26:31.293 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8803fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f88040252d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:31.293 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8803fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f88040252d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:56224/0 (socket says 172.21.15.155:56224) 2020-05-18T21:26:31.293 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8803fff700 1 -- 172.21.15.155:0/4060081103 learned_addr learned my addr 172.21.15.155:0/4060081103 (peer_addr_for_me v2:172.21.15.155:0/0) 2020-05-18T21:26:31.294 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f88037fe700 1 --1- 172.21.15.155:0/4060081103 >> v1:172.21.15.155:6789/0 conn(0x7f880409f450 0x7f88040b66e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:56496/0 (socket says 172.21.15.155:56496) 2020-05-18T21:26:31.294 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8802ffd700 1 -- 172.21.15.155:0/4060081103 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975193054 0 0) 0x7f88040b5630 con 0x7f880409f450 2020-05-18T21:26:31.294 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8802ffd700 1 -- 172.21.15.155:0/4060081103 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87f0003270 con 0x7f880409f450 2020-05-18T21:26:31.294 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8803fff700 1 -- 172.21.15.155:0/4060081103 >> v1:172.21.15.155:6789/0 conn(0x7f880409f450 legacy=0x7f88040b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.295 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8803fff700 1 -- 172.21.15.155:0/4060081103 >> v1:172.21.15.63:6789/0 conn(0x7f880409d7a0 legacy=0x7f8804065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.295 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8803fff700 1 -- 172.21.15.155:0/4060081103 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88040b9d80 con 0x7f88040b99a0 2020-05-18T21:26:31.295 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8803fff700 1 --2- 172.21.15.155:0/4060081103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f88040252d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f87fc0032f0 tx=0x7f87fc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.295 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8803fff700 1 --2- 172.21.15.155:0/4060081103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f88040252d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f87fc0032f0 tx=0x7f87fc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.296 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8803fff700 1 --2- 172.21.15.155:0/4060081103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f88040252d0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7f87fc0032f0 tx=0x7f87fc008ca0).ready entity=mon.2 client_cookie=214b765c3d61f00b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:31.296 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8803fff700 1 --2- 172.21.15.155:0/4060081103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f88040252d0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f87fc0032f0 tx=0x7f87fc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.296 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8803fff700 1 --2- 172.21.15.155:0/4060081103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f88040252d0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f87fc0032f0 tx=0x7f87fc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.296 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8802ffd700 1 -- 172.21.15.155:0/4060081103 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87fc011d50 con 0x7f88040b99a0 2020-05-18T21:26:31.296 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8803fff700 1 --2- 172.21.15.155:0/4060081103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f88040252d0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f87fc0032f0 tx=0x7f87fc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.297 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8802ffd700 1 -- 172.21.15.155:0/4060081103 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc00a180 con 0x7f88040b99a0 2020-05-18T21:26:31.297 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8802ffd700 1 -- 172.21.15.155:0/4060081103 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87fc00a560 con 0x7f88040b99a0 2020-05-18T21:26:31.298 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8808e20700 1 -- 172.21.15.155:0/4060081103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 msgr2=0x7f88040252d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.298 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8808e20700 1 --2- 172.21.15.155:0/4060081103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f88040252d0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7f87fc0032f0 tx=0x7f87fc008ca0).stop 2020-05-18T21:26:31.298 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8808e20700 1 -- 172.21.15.155:0/4060081103 shutdown_connections 2020-05-18T21:26:31.298 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8808e20700 1 --2- 172.21.15.155:0/4060081103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f88040252d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:31.298 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8808e20700 1 -- 172.21.15.155:0/4060081103 >> 172.21.15.155:0/4060081103 conn(0x7f880405acd0 msgr2=0x7f880405b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:31.299 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8808e20700 1 -- 172.21.15.155:0/4060081103 shutdown_connections 2020-05-18T21:26:31.299 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.281+0000 7f8808e20700 1 -- 172.21.15.155:0/4060081103 wait complete. 2020-05-18T21:26:31.299 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f8808e20700 1 Processor -- start 2020-05-18T21:26:31.299 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f8808e20700 1 -- start start 2020-05-18T21:26:31.299 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f8808e20700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f880409d7a0 0x7f8804062f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:31.300 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f8808e20700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f8804065390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:31.300 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f8808e20700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8804062530 con 0x7f880409f450 2020-05-18T21:26:31.300 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f8808e20700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88040627d0 con 0x7f880409d7a0 2020-05-18T21:26:31.300 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f8808e20700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8804062a70 con 0x7f88040b99a0 2020-05-18T21:26:31.300 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f88037fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f880409f450 0x7f8804064c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:56500/0 (socket says 172.21.15.155:56500) 2020-05-18T21:26:31.301 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f88037fe700 1 -- 172.21.15.155:0/2035513000 learned_addr learned my addr 172.21.15.155:0/2035513000 (peer_addr_for_me v1:172.21.15.155:0/0) 2020-05-18T21:26:31.301 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f880a082700 1 --2- 172.21.15.155:0/2035513000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f8804065390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:31.301 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f8803fff700 1 --2- 172.21.15.155:0/2035513000 >> v2:172.21.15.63:3300/0 conn(0x7f880409d7a0 0x7f8804062f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:31.301 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f8800ff9700 1 -- 172.21.15.155:0/2035513000 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566215061 0 0) 0x7f8804062530 con 0x7f880409f450 2020-05-18T21:26:31.301 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f8800ff9700 1 -- 172.21.15.155:0/2035513000 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87e8003270 con 0x7f880409f450 2020-05-18T21:26:31.302 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f880a082700 1 -- 172.21.15.155:0/2035513000 >> v2:172.21.15.63:3300/0 conn(0x7f880409d7a0 msgr2=0x7f8804062f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.302 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f880a082700 1 --2- 172.21.15.155:0/2035513000 >> v2:172.21.15.63:3300/0 conn(0x7f880409d7a0 0x7f8804062f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:31.302 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f880a082700 1 -- 172.21.15.155:0/2035513000 >> v1:172.21.15.155:6789/0 conn(0x7f880409f450 legacy=0x7f8804064c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.302 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f880a082700 1 -- 172.21.15.155:0/2035513000 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8804066010 con 0x7f88040b99a0 2020-05-18T21:26:31.302 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f880a082700 1 --2- 172.21.15.155:0/2035513000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f8804065390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8804024c50 tx=0x7f87f4010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.303 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f880a082700 1 --2- 172.21.15.155:0/2035513000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f8804065390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8804024c50 tx=0x7f87f4010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.303 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f880a082700 1 --2- 172.21.15.155:0/2035513000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f8804065390 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f8804024c50 tx=0x7f87f4010860).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:31.303 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f880a082700 1 --2- 172.21.15.155:0/2035513000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f8804065390 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f8804024c50 tx=0x7f87f4010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.303 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f880a082700 1 --2- 172.21.15.155:0/2035513000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f8804065390 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f8804024c50 tx=0x7f87f4010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.303 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f880a082700 1 --2- 172.21.15.155:0/2035513000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f8804065390 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f8804024c50 tx=0x7f87f4010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.304 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f8800ff9700 1 -- 172.21.15.155:0/2035513000 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87f4006c00 con 0x7f88040b99a0 2020-05-18T21:26:31.304 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f8800ff9700 1 -- 172.21.15.155:0/2035513000 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f4006da0 con 0x7f88040b99a0 2020-05-18T21:26:31.304 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f8808e20700 1 -- 172.21.15.155:0/2035513000 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880414a1d0 con 0x7f88040b99a0 2020-05-18T21:26:31.304 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f8800ff9700 1 -- 172.21.15.155:0/2035513000 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87f4010fd0 con 0x7f88040b99a0 2020-05-18T21:26:31.304 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f8808e20700 1 -- 172.21.15.155:0/2035513000 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880414a680 con 0x7f88040b99a0 2020-05-18T21:26:31.304 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f880a082700 1 --2- 172.21.15.155:0/2035513000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f8804065390 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f8804024c50 tx=0x7f87f4010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.305 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f880a082700 1 --2- 172.21.15.155:0/2035513000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f8804065390 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f8804024c50 tx=0x7f87f4010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.305 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f8800ff9700 1 -- 172.21.15.155:0/2035513000 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7f87f4011630 con 0x7f88040b99a0 2020-05-18T21:26:31.305 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.285+0000 7f8800ff9700 1 -- 172.21.15.155:0/2035513000 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f87f400b560 con 0x7f88040b99a0 2020-05-18T21:26:31.306 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.293+0000 7f8808e20700 1 -- 172.21.15.155:0/2035513000 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88040569e0 con 0x7f88040b99a0 2020-05-18T21:26:31.306 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.293+0000 7f880a082700 1 --2- 172.21.15.155:0/2035513000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f8804065390 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f8804024c50 tx=0x7f87f4010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.306 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.293+0000 7f8800ff9700 1 -- 172.21.15.155:0/2035513000 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67708 (secure 0 0 0) 0x7f87f4011af0 con 0x7f88040b99a0 2020-05-18T21:26:31.366 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.361+0000 7f8808e20700 1 -- 172.21.15.155:0/2035513000 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0dce88f8-b984-43e1-95e2-4132171102d2", "id": 5} v 0) v1 -- 0x7f88040259b0 con 0x7f88040b99a0 2020-05-18T21:26:31.374 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.369+0000 7f880a082700 1 --2- 172.21.15.155:0/2035513000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f8804065390 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f8804024c50 tx=0x7f87f4010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.374 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.369+0000 7f8800ff9700 1 -- 172.21.15.155:0/2035513000 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0dce88f8-b984-43e1-95e2-4132171102d2", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f87f4011c90 con 0x7f88040b99a0 2020-05-18T21:26:31.374 INFO:teuthology.orchestra.run.smithi155.stdout:5 2020-05-18T21:26:31.375 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.373+0000 7f8808e20700 1 -- 172.21.15.155:0/2035513000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 msgr2=0x7f8804065390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.375 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.373+0000 7f8808e20700 1 --2- 172.21.15.155:0/2035513000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f8804065390 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f8804024c50 tx=0x7f87f4010860).stop 2020-05-18T21:26:31.376 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.373+0000 7f8808e20700 1 -- 172.21.15.155:0/2035513000 shutdown_connections 2020-05-18T21:26:31.376 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.373+0000 7f8808e20700 1 --2- 172.21.15.155:0/2035513000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88040b99a0 0x7f8804065390 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:31.376 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.373+0000 7f8808e20700 1 --2- 172.21.15.155:0/2035513000 >> v2:172.21.15.63:3300/0 conn(0x7f880409d7a0 0x7f8804062f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:31.377 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.373+0000 7f8808e20700 1 -- 172.21.15.155:0/2035513000 >> 172.21.15.155:0/2035513000 conn(0x7f880405acd0 msgr2=0x7f880405b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:31.377 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.373+0000 7f8808e20700 1 -- 172.21.15.155:0/2035513000 shutdown_connections 2020-05-18T21:26:31.377 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.373+0000 7f8808e20700 1 -- 172.21.15.155:0/2035513000 wait complete. 2020-05-18T21:26:31.387 INFO:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new e1bc92f8-3692-4483-b0fb-905c94fa1469 6 2020-05-18T21:26:31.491 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac74b4b700 1 Processor -- start 2020-05-18T21:26:31.491 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac74b4b700 1 -- start start 2020-05-18T21:26:31.491 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac74b4b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fac700b99a0 0x7fac700252d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:31.492 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac74b4b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac700b6280 con 0x7fac7009f450 2020-05-18T21:26:31.492 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac74b4b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac700b5630 con 0x7fac7009d7a0 2020-05-18T21:26:31.492 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac74b4b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac700b58d0 con 0x7fac700b99a0 2020-05-18T21:26:31.492 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac6ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fac700b99a0 0x7fac700252d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:31.492 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac75dad700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fac7009d7a0 0x7fac70065ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:56510/0 (socket says 172.21.15.155:56510) 2020-05-18T21:26:31.493 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac75dad700 1 -- 172.21.15.155:0/2687874268 learned_addr learned my addr 172.21.15.155:0/2687874268 (peer_addr_for_me v1:172.21.15.155:0/0) 2020-05-18T21:26:31.493 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac6ffff700 1 -- 172.21.15.155:0/2687874268 >> v1:172.21.15.155:6789/0 conn(0x7fac7009d7a0 legacy=0x7fac70065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.493 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac6ffff700 1 -- 172.21.15.155:0/2687874268 >> v1:172.21.15.63:6789/0 conn(0x7fac7009f450 legacy=0x7fac700b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.493 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac6f7fe700 1 -- 172.21.15.155:0/2687874268 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870609770 0 0) 0x7fac700b5630 con 0x7fac7009d7a0 2020-05-18T21:26:31.493 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac6ffff700 1 -- 172.21.15.155:0/2687874268 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac700b9d80 con 0x7fac700b99a0 2020-05-18T21:26:31.493 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac6ffff700 1 --2- 172.21.15.155:0/2687874268 >> v2:172.21.15.155:3300/0 conn(0x7fac700b99a0 0x7fac700252d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fac58002f70 tx=0x7fac58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.494 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac6ffff700 1 --2- 172.21.15.155:0/2687874268 >> v2:172.21.15.155:3300/0 conn(0x7fac700b99a0 0x7fac700252d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fac58002f70 tx=0x7fac58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.494 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac6ffff700 1 --2- 172.21.15.155:0/2687874268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac700b99a0 0x7fac700252d0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fac58002f70 tx=0x7fac58007a80).ready entity=mon.1 client_cookie=ae913de348aa0e84 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:31.494 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac6ffff700 1 --2- 172.21.15.155:0/2687874268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac700b99a0 0x7fac700252d0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fac58002f70 tx=0x7fac58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.494 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac6f7fe700 1 -- 172.21.15.155:0/2687874268 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac58008e80 con 0x7fac700b99a0 2020-05-18T21:26:31.495 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac6ffff700 1 --2- 172.21.15.155:0/2687874268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac700b99a0 0x7fac700252d0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fac58002f70 tx=0x7fac58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.495 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac6ffff700 1 --2- 172.21.15.155:0/2687874268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac700b99a0 0x7fac700252d0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fac58002f70 tx=0x7fac58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.495 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac6f7fe700 1 -- 172.21.15.155:0/2687874268 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac580116a0 con 0x7fac700b99a0 2020-05-18T21:26:31.496 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac6f7fe700 1 -- 172.21.15.155:0/2687874268 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac58011ac0 con 0x7fac700b99a0 2020-05-18T21:26:31.496 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac74b4b700 1 -- 172.21.15.155:0/2687874268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac700b99a0 msgr2=0x7fac700252d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.496 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac74b4b700 1 --2- 172.21.15.155:0/2687874268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac700b99a0 0x7fac700252d0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fac58002f70 tx=0x7fac58007a80).stop 2020-05-18T21:26:31.496 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac74b4b700 1 -- 172.21.15.155:0/2687874268 shutdown_connections 2020-05-18T21:26:31.496 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac74b4b700 1 --2- 172.21.15.155:0/2687874268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac700b99a0 0x7fac700252d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:31.497 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac74b4b700 1 -- 172.21.15.155:0/2687874268 >> 172.21.15.155:0/2687874268 conn(0x7fac7005acd0 msgr2=0x7fac7005b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:31.497 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac74b4b700 1 -- 172.21.15.155:0/2687874268 shutdown_connections 2020-05-18T21:26:31.497 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.485+0000 7fac74b4b700 1 -- 172.21.15.155:0/2687874268 wait complete. 2020-05-18T21:26:31.497 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac74b4b700 1 Processor -- start 2020-05-18T21:26:31.497 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac74b4b700 1 -- start start 2020-05-18T21:26:31.501 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac74b4b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac7009d7a0 0x7fac70063500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:31.501 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac74b4b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fac7009f450 0x7fac7013c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:31.501 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac74b4b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fac700b99a0 0x7fac70064e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:31.501 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac74b4b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac70061f20 con 0x7fac7009f450 2020-05-18T21:26:31.502 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac74b4b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac700621c0 con 0x7fac700b99a0 2020-05-18T21:26:31.502 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac74b4b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac70062460 con 0x7fac7009d7a0 2020-05-18T21:26:31.502 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac7009d7a0 0x7fac70063500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:31.503 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac7009d7a0 0x7fac70063500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:56242/0 (socket says 172.21.15.155:56242) 2020-05-18T21:26:31.503 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6ffff700 1 -- 172.21.15.155:0/3775807017 learned_addr learned my addr 172.21.15.155:0/3775807017 (peer_addr_for_me v2:172.21.15.155:0/0) 2020-05-18T21:26:31.503 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac75dad700 1 --2- 172.21.15.155:0/3775807017 >> v2:172.21.15.155:3300/0 conn(0x7fac700b99a0 0x7fac70064e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:31.503 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac67fff700 1 --2- 172.21.15.155:0/3775807017 >> v2:172.21.15.63:3300/0 conn(0x7fac7009f450 0x7fac7013c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:31.503 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6ffff700 1 -- 172.21.15.155:0/3775807017 >> v2:172.21.15.155:3300/0 conn(0x7fac700b99a0 msgr2=0x7fac70064e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.504 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6ffff700 1 --2- 172.21.15.155:0/3775807017 >> v2:172.21.15.155:3300/0 conn(0x7fac700b99a0 0x7fac70064e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:31.504 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6ffff700 1 -- 172.21.15.155:0/3775807017 >> v2:172.21.15.63:3300/0 conn(0x7fac7009f450 msgr2=0x7fac7013c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.504 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6ffff700 1 --2- 172.21.15.155:0/3775807017 >> v2:172.21.15.63:3300/0 conn(0x7fac7009f450 0x7fac7013c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:31.504 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6ffff700 1 -- 172.21.15.155:0/3775807017 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac70062900 con 0x7fac7009d7a0 2020-05-18T21:26:31.504 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6ffff700 1 --2- 172.21.15.155:0/3775807017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac7009d7a0 0x7fac70063500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac58002f70 tx=0x7fac58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.505 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6ffff700 1 --2- 172.21.15.155:0/3775807017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac7009d7a0 0x7fac70063500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac58002f70 tx=0x7fac58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.505 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6ffff700 1 --2- 172.21.15.155:0/3775807017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac7009d7a0 0x7fac70063500 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7fac58002f70 tx=0x7fac58007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:31.505 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6ffff700 1 --2- 172.21.15.155:0/3775807017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac7009d7a0 0x7fac70063500 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fac58002f70 tx=0x7fac58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.505 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6ffff700 1 --2- 172.21.15.155:0/3775807017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac7009d7a0 0x7fac70063500 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fac58002f70 tx=0x7fac58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.505 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6ffff700 1 --2- 172.21.15.155:0/3775807017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac7009d7a0 0x7fac70063500 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fac58002f70 tx=0x7fac58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.506 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6d7fa700 1 -- 172.21.15.155:0/3775807017 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac58007360 con 0x7fac7009d7a0 2020-05-18T21:26:31.506 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6d7fa700 1 -- 172.21.15.155:0/3775807017 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac580074c0 con 0x7fac7009d7a0 2020-05-18T21:26:31.506 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6d7fa700 1 -- 172.21.15.155:0/3775807017 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac580058f0 con 0x7fac7009d7a0 2020-05-18T21:26:31.507 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac74b4b700 1 -- 172.21.15.155:0/3775807017 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac701432b0 con 0x7fac7009d7a0 2020-05-18T21:26:31.507 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac74b4b700 1 -- 172.21.15.155:0/3775807017 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac70061c20 con 0x7fac7009d7a0 2020-05-18T21:26:31.507 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6ffff700 1 --2- 172.21.15.155:0/3775807017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac7009d7a0 0x7fac70063500 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fac58002f70 tx=0x7fac58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.507 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6d7fa700 1 -- 172.21.15.155:0/3775807017 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7fac5800d6d0 con 0x7fac7009d7a0 2020-05-18T21:26:31.507 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6ffff700 1 --2- 172.21.15.155:0/3775807017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac7009d7a0 0x7fac70063500 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fac58002f70 tx=0x7fac58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.508 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac6d7fa700 1 -- 172.21.15.155:0/3775807017 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7fac58005de0 con 0x7fac7009d7a0 2020-05-18T21:26:31.508 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.489+0000 7fac74b4b700 1 -- 172.21.15.155:0/3775807017 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac70062af0 con 0x7fac7009d7a0 2020-05-18T21:26:31.508 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.493+0000 7fac6ffff700 1 --2- 172.21.15.155:0/3775807017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac7009d7a0 0x7fac70063500 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fac58002f70 tx=0x7fac58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.508 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.493+0000 7fac6d7fa700 1 -- 172.21.15.155:0/3775807017 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67708 (secure 0 0 0) 0x7fac5800db40 con 0x7fac7009d7a0 2020-05-18T21:26:31.566 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.561+0000 7fac74b4b700 1 -- 172.21.15.155:0/3775807017 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e1bc92f8-3692-4483-b0fb-905c94fa1469", "id": 6} v 0) v1 -- 0x7fac700655b0 con 0x7fac7009d7a0 2020-05-18T21:26:31.573 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.569+0000 7fac6ffff700 1 --2- 172.21.15.155:0/3775807017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac7009d7a0 0x7fac70063500 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fac58002f70 tx=0x7fac58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.573 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.569+0000 7fac6d7fa700 1 -- 172.21.15.155:0/3775807017 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e1bc92f8-3692-4483-b0fb-905c94fa1469", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fac5800dce0 con 0x7fac7009d7a0 2020-05-18T21:26:31.574 INFO:teuthology.orchestra.run.smithi155.stdout:6 2020-05-18T21:26:31.575 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.569+0000 7fac74b4b700 1 -- 172.21.15.155:0/3775807017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac7009d7a0 msgr2=0x7fac70063500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.575 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.569+0000 7fac74b4b700 1 --2- 172.21.15.155:0/3775807017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac7009d7a0 0x7fac70063500 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7fac58002f70 tx=0x7fac58007a80).stop 2020-05-18T21:26:31.575 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.573+0000 7fac74b4b700 1 -- 172.21.15.155:0/3775807017 shutdown_connections 2020-05-18T21:26:31.575 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.573+0000 7fac74b4b700 1 --2- 172.21.15.155:0/3775807017 >> v2:172.21.15.155:3300/0 conn(0x7fac700b99a0 0x7fac70064e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:31.576 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.573+0000 7fac74b4b700 1 --2- 172.21.15.155:0/3775807017 >> v2:172.21.15.63:3300/0 conn(0x7fac7009f450 0x7fac7013c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:31.576 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.573+0000 7fac74b4b700 1 --2- 172.21.15.155:0/3775807017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac7009d7a0 0x7fac70063500 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:31.576 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.573+0000 7fac74b4b700 1 -- 172.21.15.155:0/3775807017 >> 172.21.15.155:0/3775807017 conn(0x7fac7005acd0 msgr2=0x7fac7007fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:31.576 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.573+0000 7fac74b4b700 1 -- 172.21.15.155:0/3775807017 shutdown_connections 2020-05-18T21:26:31.576 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.573+0000 7fac74b4b700 1 -- 172.21.15.155:0/3775807017 wait complete. 2020-05-18T21:26:31.586 INFO:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new b76e000c-a078-48c4-9e1e-34d286a9992c 7 2020-05-18T21:26:31.696 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.681+0000 7f50fb591700 1 Processor -- start 2020-05-18T21:26:31.696 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.681+0000 7f50fb591700 1 -- start start 2020-05-18T21:26:31.696 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50fb591700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f50f40b8c30 0x7f50f41566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:31.697 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50fb591700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f4065a70 con 0x7f50f40ad070 2020-05-18T21:26:31.697 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50fb591700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f40b9010 con 0x7f50f4157260 2020-05-18T21:26:31.697 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50fb591700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f40801d0 con 0x7f50f40b8c30 2020-05-18T21:26:31.697 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50fa32f700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f50f4157260 0x7f50f415c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:56522/0 (socket says 172.21.15.155:56522) 2020-05-18T21:26:31.698 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50fa32f700 1 -- 172.21.15.155:0/3059393490 learned_addr learned my addr 172.21.15.155:0/3059393490 (peer_addr_for_me v1:172.21.15.155:0/0) 2020-05-18T21:26:31.698 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f9b2e700 1 --2- 172.21.15.155:0/3059393490 >> v2:172.21.15.63:3300/0 conn(0x7f50f40b8c30 0x7f50f41566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:31.698 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f8b2c700 1 -- 172.21.15.155:0/3059393490 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417069871 0 0) 0x7f50f40b9010 con 0x7f50f4157260 2020-05-18T21:26:31.698 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f8b2c700 1 -- 172.21.15.155:0/3059393490 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50dc003270 con 0x7f50f4157260 2020-05-18T21:26:31.698 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f8b2c700 1 -- 172.21.15.155:0/3059393490 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2346672457 0 0) 0x7f50dc003270 con 0x7f50f4157260 2020-05-18T21:26:31.699 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f8b2c700 1 -- 172.21.15.155:0/3059393490 >> v2:172.21.15.63:3300/0 conn(0x7f50f40b8c30 msgr2=0x7f50f41566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:31.699 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f8b2c700 1 --2- 172.21.15.155:0/3059393490 >> v2:172.21.15.63:3300/0 conn(0x7f50f40b8c30 0x7f50f41566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:31.699 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f8b2c700 1 -- 172.21.15.155:0/3059393490 >> v1:172.21.15.63:6789/0 conn(0x7f50f40ad070 legacy=0x7f50f4156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.700 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f8b2c700 1 -- 172.21.15.155:0/3059393490 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f405bf00 con 0x7f50f4157260 2020-05-18T21:26:31.700 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f8b2c700 1 -- 172.21.15.155:0/3059393490 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f50e4001710 con 0x7f50f4157260 2020-05-18T21:26:31.700 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f8b2c700 1 -- 172.21.15.155:0/3059393490 >> v1:172.21.15.155:6789/0 conn(0x7f50f4157260 legacy=0x7f50f415c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.700 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f8b2c700 1 --2- 172.21.15.155:0/3059393490 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50dc003760 0x7f50dc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:31.700 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f8b2c700 1 --2- 172.21.15.155:0/3059393490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50dc004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:31.701 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f8b2c700 1 --2- 172.21.15.155:0/3059393490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50dc004aa0 0x7f50dc004f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:31.701 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f8b2c700 1 -- 172.21.15.155:0/3059393490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40801d0 con 0x7f50dc004aa0 2020-05-18T21:26:31.701 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f8b2c700 1 -- 172.21.15.155:0/3059393490 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc04f880 con 0x7f50dc004060 2020-05-18T21:26:31.701 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f8b2c700 1 -- 172.21.15.155:0/3059393490 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc04fa40 con 0x7f50dc003760 2020-05-18T21:26:31.702 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f932d700 1 --2- 172.21.15.155:0/3059393490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50dc004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:31.702 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f9b2e700 1 --2- 172.21.15.155:0/3059393490 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50dc003760 0x7f50dc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:31.702 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50fa32f700 1 --2- 172.21.15.155:0/3059393490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50dc004aa0 0x7f50dc004f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:31.702 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f932d700 1 -- 172.21.15.155:0/3059393490 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50dc003760 msgr2=0x7f50dc003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:31.702 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f932d700 1 --2- 172.21.15.155:0/3059393490 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50dc003760 0x7f50dc003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:31.703 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f932d700 1 -- 172.21.15.155:0/3059393490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50dc004aa0 msgr2=0x7f50dc004f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:31.703 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f932d700 1 --2- 172.21.15.155:0/3059393490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50dc004aa0 0x7f50dc004f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:31.703 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f932d700 1 -- 172.21.15.155:0/3059393490 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc003270 con 0x7f50dc004060 2020-05-18T21:26:31.703 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50fa32f700 1 -- 172.21.15.155:0/3059393490 reap_dead start 2020-05-18T21:26:31.704 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f932d700 1 --2- 172.21.15.155:0/3059393490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50dc004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f50e8001020 tx=0x7f50e8001190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.704 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f932d700 1 --2- 172.21.15.155:0/3059393490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50dc004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f50e8001020 tx=0x7f50e8001190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.704 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f932d700 1 --2- 172.21.15.155:0/3059393490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50dc004530 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f50e8001020 tx=0x7f50e8001190).ready entity=mon.1 client_cookie=12919ff962f53f52 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:31.705 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f932d700 1 --2- 172.21.15.155:0/3059393490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50dc004530 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f50e8001020 tx=0x7f50e8001190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.705 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f932d700 1 --2- 172.21.15.155:0/3059393490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50dc004530 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f50e8001020 tx=0x7f50e8001190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.705 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f8b2c700 1 -- 172.21.15.155:0/3059393490 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50e8003560 con 0x7f50dc004060 2020-05-18T21:26:31.705 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f932d700 1 --2- 172.21.15.155:0/3059393490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50dc004530 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f50e8001020 tx=0x7f50e8001190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.705 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f8b2c700 1 -- 172.21.15.155:0/3059393490 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e80036c0 con 0x7f50dc004060 2020-05-18T21:26:31.706 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50f8b2c700 1 -- 172.21.15.155:0/3059393490 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50e8003a20 con 0x7f50dc004060 2020-05-18T21:26:31.706 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50fb591700 1 -- 172.21.15.155:0/3059393490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 msgr2=0x7f50dc004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.706 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50fb591700 1 --2- 172.21.15.155:0/3059393490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50dc004530 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f50e8001020 tx=0x7f50e8001190).stop 2020-05-18T21:26:31.706 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50fb591700 1 -- 172.21.15.155:0/3059393490 shutdown_connections 2020-05-18T21:26:31.706 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50fb591700 1 --2- 172.21.15.155:0/3059393490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50dc004530 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:31.707 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50fb591700 1 -- 172.21.15.155:0/3059393490 >> 172.21.15.155:0/3059393490 conn(0x7f50f406a640 msgr2=0x7f50f40b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:31.707 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50fb591700 1 -- 172.21.15.155:0/3059393490 shutdown_connections 2020-05-18T21:26:31.707 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.685+0000 7f50fb591700 1 -- 172.21.15.155:0/3059393490 wait complete. 2020-05-18T21:26:31.707 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50fb591700 1 Processor -- start 2020-05-18T21:26:31.707 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50fb591700 1 -- start start 2020-05-18T21:26:31.707 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50fb591700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f50dc004060 0x7f50f407c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:31.708 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50fb591700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50f406f8c0 0x7f50f406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:31.708 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50fb591700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f407d3d0 con 0x7f50f4145160 2020-05-18T21:26:31.708 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50fb591700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f407d670 con 0x7f50dc004060 2020-05-18T21:26:31.708 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50fb591700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f407d0f0 con 0x7f50f406f8c0 2020-05-18T21:26:31.708 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f932d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50f406f8c0 0x7f50f406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:31.709 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f932d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50f406f8c0 0x7f50f406fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:56260/0 (socket says 172.21.15.155:56260) 2020-05-18T21:26:31.709 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f932d700 1 -- 172.21.15.155:0/2478974938 learned_addr learned my addr 172.21.15.155:0/2478974938 (peer_addr_for_me v2:172.21.15.155:0/0) 2020-05-18T21:26:31.709 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f9b2e700 1 --2- 172.21.15.155:0/2478974938 >> v2:172.21.15.155:3300/0 conn(0x7f50dc004060 0x7f50f407c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:31.709 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f9b2e700 1 -- 172.21.15.155:0/2478974938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50f406f8c0 msgr2=0x7f50f406fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.709 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f9b2e700 1 --2- 172.21.15.155:0/2478974938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50f406f8c0 0x7f50f406fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:31.710 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f9b2e700 1 -- 172.21.15.155:0/2478974938 >> v1:172.21.15.155:6789/0 conn(0x7f50f4145160 legacy=0x7f50f41455b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.710 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f9b2e700 1 -- 172.21.15.155:0/2478974938 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f4070180 con 0x7f50dc004060 2020-05-18T21:26:31.710 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f932d700 1 --2- 172.21.15.155:0/2478974938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50f406f8c0 0x7f50f406fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:26:31.710 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f9b2e700 1 --2- 172.21.15.155:0/2478974938 >> v2:172.21.15.155:3300/0 conn(0x7f50dc004060 0x7f50f407c250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f50ec0032f0 tx=0x7f50ec010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.710 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f9b2e700 1 --2- 172.21.15.155:0/2478974938 >> v2:172.21.15.155:3300/0 conn(0x7f50dc004060 0x7f50f407c250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f50ec0032f0 tx=0x7f50ec010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.710 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f9b2e700 1 --2- 172.21.15.155:0/2478974938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50f407c250 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f50ec0032f0 tx=0x7f50ec010f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:31.711 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f9b2e700 1 --2- 172.21.15.155:0/2478974938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50f407c250 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f50ec0032f0 tx=0x7f50ec010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.711 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f9b2e700 1 --2- 172.21.15.155:0/2478974938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50f407c250 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f50ec0032f0 tx=0x7f50ec010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.711 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f9b2e700 1 --2- 172.21.15.155:0/2478974938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50f407c250 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f50ec0032f0 tx=0x7f50ec010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.711 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f27fc700 1 -- 172.21.15.155:0/2478974938 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50ec005e60 con 0x7f50dc004060 2020-05-18T21:26:31.711 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f27fc700 1 -- 172.21.15.155:0/2478974938 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec011940 con 0x7f50dc004060 2020-05-18T21:26:31.712 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50fb591700 1 -- 172.21.15.155:0/2478974938 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f4145cc0 con 0x7f50dc004060 2020-05-18T21:26:31.712 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f27fc700 1 -- 172.21.15.155:0/2478974938 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50ec011ca0 con 0x7f50dc004060 2020-05-18T21:26:31.712 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50fb591700 1 -- 172.21.15.155:0/2478974938 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f407dcb0 con 0x7f50dc004060 2020-05-18T21:26:31.715 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f9b2e700 1 --2- 172.21.15.155:0/2478974938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50f407c250 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f50ec0032f0 tx=0x7f50ec010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.715 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f27fc700 1 -- 172.21.15.155:0/2478974938 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7f50ec008c40 con 0x7f50dc004060 2020-05-18T21:26:31.715 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f9b2e700 1 --2- 172.21.15.155:0/2478974938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50f407c250 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f50ec0032f0 tx=0x7f50ec010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.716 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.689+0000 7f50f27fc700 1 -- 172.21.15.155:0/2478974938 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f50ec011e00 con 0x7f50dc004060 2020-05-18T21:26:31.716 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.693+0000 7f50fb591700 1 -- 172.21.15.155:0/2478974938 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f40703d0 con 0x7f50dc004060 2020-05-18T21:26:31.716 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.697+0000 7f50f9b2e700 1 --2- 172.21.15.155:0/2478974938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50f407c250 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f50ec0032f0 tx=0x7f50ec010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.717 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.697+0000 7f50f27fc700 1 -- 172.21.15.155:0/2478974938 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67708 (secure 0 0 0) 0x7f50ec007750 con 0x7f50dc004060 2020-05-18T21:26:31.766 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.761+0000 7f50fb591700 1 -- 172.21.15.155:0/2478974938 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b76e000c-a078-48c4-9e1e-34d286a9992c", "id": 7} v 0) v1 -- 0x7f50f40569e0 con 0x7f50dc004060 2020-05-18T21:26:31.773 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.769+0000 7f50f9b2e700 1 --2- 172.21.15.155:0/2478974938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50f407c250 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f50ec0032f0 tx=0x7f50ec010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:31.774 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.769+0000 7f50f27fc700 1 -- 172.21.15.155:0/2478974938 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b76e000c-a078-48c4-9e1e-34d286a9992c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f50ec0078f0 con 0x7f50dc004060 2020-05-18T21:26:31.774 INFO:teuthology.orchestra.run.smithi155.stdout:7 2020-05-18T21:26:31.775 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.769+0000 7f50fb591700 1 -- 172.21.15.155:0/2478974938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 msgr2=0x7f50f407c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:31.775 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.769+0000 7f50fb591700 1 --2- 172.21.15.155:0/2478974938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50f407c250 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f50ec0032f0 tx=0x7f50ec010f60).stop 2020-05-18T21:26:31.775 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.769+0000 7f50fb591700 1 -- 172.21.15.155:0/2478974938 shutdown_connections 2020-05-18T21:26:31.775 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.769+0000 7f50fb591700 1 --2- 172.21.15.155:0/2478974938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50f406f8c0 0x7f50f406fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:31.776 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.769+0000 7f50fb591700 1 --2- 172.21.15.155:0/2478974938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50dc004060 0x7f50f407c250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:31.776 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.773+0000 7f50fb591700 1 -- 172.21.15.155:0/2478974938 >> 172.21.15.155:0/2478974938 conn(0x7f50f406a640 msgr2=0x7f50f40b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:31.776 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.773+0000 7f50fb591700 1 -- 172.21.15.155:0/2478974938 shutdown_connections 2020-05-18T21:26:31.776 INFO:teuthology.orchestra.run.smithi155.stderr:2020-05-18T21:26:31.773+0000 7f50fb591700 1 -- 172.21.15.155:0/2478974938 wait complete. 2020-05-18T21:26:31.784 INFO:tasks.ceph.osd.0:Restarting daemon 2020-05-18T21:26:31.785 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-05-18T21:26:31.787 INFO:tasks.ceph.osd.0:Started 2020-05-18T21:26:31.788 INFO:tasks.ceph.osd.1:Restarting daemon 2020-05-18T21:26:31.788 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-05-18T21:26:31.790 INFO:tasks.ceph.osd.1:Started 2020-05-18T21:26:31.792 INFO:tasks.ceph.osd.2:Restarting daemon 2020-05-18T21:26:31.792 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-05-18T21:26:31.794 INFO:tasks.ceph.osd.2:Started 2020-05-18T21:26:31.795 INFO:tasks.ceph.osd.3:Restarting daemon 2020-05-18T21:26:31.795 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-05-18T21:26:31.798 INFO:tasks.ceph.osd.3:Started 2020-05-18T21:26:31.799 INFO:tasks.ceph.osd.4:Restarting daemon 2020-05-18T21:26:31.799 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-05-18T21:26:31.801 INFO:tasks.ceph.osd.4:Started 2020-05-18T21:26:31.802 INFO:tasks.ceph.osd.5:Restarting daemon 2020-05-18T21:26:31.802 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-05-18T21:26:31.804 INFO:tasks.ceph.osd.5:Started 2020-05-18T21:26:31.805 INFO:tasks.ceph.osd.6:Restarting daemon 2020-05-18T21:26:31.806 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-05-18T21:26:31.808 INFO:tasks.ceph.osd.6:Started 2020-05-18T21:26:31.809 INFO:tasks.ceph.osd.7:Restarting daemon 2020-05-18T21:26:31.809 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-05-18T21:26:31.817 INFO:tasks.ceph.osd.7:Started 2020-05-18T21:26:31.818 INFO:tasks.ceph:Waiting for OSDs to come up 2020-05-18T21:26:32.142 INFO:tasks.ceph.osd.0.smithi063.stderr:2020-05-18T21:26:32.139+0000 7ff53c97bdc0 -1 Falling back to public interface 2020-05-18T21:26:32.394 INFO:tasks.ceph.osd.1.smithi063.stderr:2020-05-18T21:26:32.391+0000 7f6780897dc0 -1 Falling back to public interface 2020-05-18T21:26:32.399 INFO:tasks.ceph.osd.3.smithi063.stderr:2020-05-18T21:26:32.395+0000 7f599b7dddc0 -1 Falling back to public interface 2020-05-18T21:26:32.407 INFO:tasks.ceph.osd.2.smithi063.stderr:2020-05-18T21:26:32.403+0000 7f5154912dc0 -1 Falling back to public interface 2020-05-18T21:26:32.416 INFO:tasks.ceph.osd.4.smithi155.stderr:2020-05-18T21:26:32.413+0000 7fe8740cbdc0 -1 Falling back to public interface 2020-05-18T21:26:32.428 INFO:tasks.ceph.osd.5.smithi155.stderr:2020-05-18T21:26:32.425+0000 7f35645bedc0 -1 Falling back to public interface 2020-05-18T21:26:32.432 INFO:tasks.ceph.osd.6.smithi155.stderr:2020-05-18T21:26:32.429+0000 7f28edc2fdc0 -1 Falling back to public interface 2020-05-18T21:26:32.436 INFO:tasks.ceph.osd.7.smithi155.stderr:2020-05-18T21:26:32.433+0000 7f976b613dc0 -1 Falling back to public interface 2020-05-18T21:26:32.624 INFO:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-05-18T21:26:32.724 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee1207700 1 Processor -- start 2020-05-18T21:26:32.724 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee1207700 1 -- start start 2020-05-18T21:26:32.724 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee1207700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6edc156ec0 0x7f6edc09ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:32.725 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee1207700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6edc07ff10 0x7f6edc0b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:32.725 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee1207700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6edc0b3de0 con 0x7f6edc024ab0 2020-05-18T21:26:32.725 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee1207700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6edc09f4a0 con 0x7f6edc156ec0 2020-05-18T21:26:32.725 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee1207700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6edc025270 con 0x7f6edc07ff10 2020-05-18T21:26:32.725 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6edbfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6edc156ec0 0x7f6edc09ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:32.726 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6edbfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6edc156ec0 0x7f6edc09ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52034/0 (socket says 172.21.15.63:52034) 2020-05-18T21:26:32.726 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6edbfff700 1 -- 172.21.15.63:0/36534492 learned_addr learned my addr 172.21.15.63:0/36534492 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:32.726 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee0a06700 1 --1- 172.21.15.63:0/36534492 >> v1:172.21.15.63:6789/0 conn(0x7f6edc024ab0 0x7f6edc1567b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54220/0 (socket says 172.21.15.63:54220) 2020-05-18T21:26:32.726 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee2469700 1 --2- 172.21.15.63:0/36534492 >> v2:172.21.15.155:3300/0 conn(0x7f6edc07ff10 0x7f6edc0b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:32.726 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee2469700 1 -- 172.21.15.63:0/36534492 >> v2:172.21.15.63:3300/0 conn(0x7f6edc156ec0 msgr2=0x7f6edc09ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:32.727 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee2469700 1 --2- 172.21.15.63:0/36534492 >> v2:172.21.15.63:3300/0 conn(0x7f6edc156ec0 0x7f6edc09ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:32.727 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee2469700 1 -- 172.21.15.63:0/36534492 >> v1:172.21.15.63:6789/0 conn(0x7f6edc024ab0 legacy=0x7f6edc1567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:32.727 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee2469700 1 -- 172.21.15.63:0/36534492 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc024e90 con 0x7f6edc07ff10 2020-05-18T21:26:32.727 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee2469700 1 --2- 172.21.15.63:0/36534492 >> v2:172.21.15.155:3300/0 conn(0x7f6edc07ff10 0x7f6edc0b4a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ed40032f0 tx=0x7f6ed4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:32.727 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee2469700 1 --2- 172.21.15.63:0/36534492 >> v2:172.21.15.155:3300/0 conn(0x7f6edc07ff10 0x7f6edc0b4a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ed40032f0 tx=0x7f6ed4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:32.728 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee2469700 1 --2- 172.21.15.63:0/36534492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6edc07ff10 0x7f6edc0b4a20 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f6ed40032f0 tx=0x7f6ed4007e00).ready entity=mon.1 client_cookie=465d00e7ee5a49d6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:32.728 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee2469700 1 --2- 172.21.15.63:0/36534492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6edc07ff10 0x7f6edc0b4a20 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f6ed40032f0 tx=0x7f6ed4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:32.728 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee2469700 1 --2- 172.21.15.63:0/36534492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6edc07ff10 0x7f6edc0b4a20 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f6ed40032f0 tx=0x7f6ed4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:32.728 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6edb7fe700 1 -- 172.21.15.63:0/36534492 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ed4011e60 con 0x7f6edc07ff10 2020-05-18T21:26:32.728 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee2469700 1 --2- 172.21.15.63:0/36534492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6edc07ff10 0x7f6edc0b4a20 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f6ed40032f0 tx=0x7f6ed4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:32.729 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6edb7fe700 1 -- 172.21.15.63:0/36534492 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed400a180 con 0x7f6edc07ff10 2020-05-18T21:26:32.729 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6edb7fe700 1 -- 172.21.15.63:0/36534492 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ed400a560 con 0x7f6edc07ff10 2020-05-18T21:26:32.729 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee1207700 1 -- 172.21.15.63:0/36534492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6edc07ff10 msgr2=0x7f6edc0b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:32.729 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.715+0000 7f6ee1207700 1 --2- 172.21.15.63:0/36534492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6edc07ff10 0x7f6edc0b4a20 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f6ed40032f0 tx=0x7f6ed4007e00).stop 2020-05-18T21:26:32.729 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.719+0000 7f6ee1207700 1 -- 172.21.15.63:0/36534492 shutdown_connections 2020-05-18T21:26:32.730 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.719+0000 7f6ee1207700 1 --2- 172.21.15.63:0/36534492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6edc07ff10 0x7f6edc0b4a20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:32.730 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.719+0000 7f6ee1207700 1 --2- 172.21.15.63:0/36534492 >> v2:172.21.15.63:3300/0 conn(0x7f6edc156ec0 0x7f6edc09ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:32.730 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.719+0000 7f6ee1207700 1 -- 172.21.15.63:0/36534492 >> 172.21.15.63:0/36534492 conn(0x7f6edc069b70 msgr2=0x7f6edc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:32.730 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.719+0000 7f6ee1207700 1 -- 172.21.15.63:0/36534492 shutdown_connections 2020-05-18T21:26:32.730 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.719+0000 7f6ee1207700 1 -- 172.21.15.63:0/36534492 wait complete. 2020-05-18T21:26:32.730 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.719+0000 7f6ee1207700 1 Processor -- start 2020-05-18T21:26:32.731 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.719+0000 7f6ee1207700 1 -- start start 2020-05-18T21:26:32.733 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ee1207700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6edc024ab0 0x7f6edc0b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:32.733 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ee1207700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6edc0b20b0 con 0x7f6edc0b1c10 2020-05-18T21:26:32.734 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ee1207700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6edc0b2350 con 0x7f6edc07ff10 2020-05-18T21:26:32.734 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ee1207700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6edc093950 con 0x7f6edc024ab0 2020-05-18T21:26:32.734 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ee0a06700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6edc024ab0 0x7f6edc0b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:32.734 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6edbfff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f6edc07ff10 0x7f6edc0af070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:52544/0 (socket says 172.21.15.63:52544) 2020-05-18T21:26:32.735 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6edbfff700 1 -- 172.21.15.63:0/43845941 learned_addr learned my addr 172.21.15.63:0/43845941 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:32.735 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ee0a06700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6edc024ab0 0x7f6edc0b00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52038/0 (socket says 172.21.15.63:52038) 2020-05-18T21:26:32.735 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ed97fa700 1 -- 172.21.15.63:0/43845941 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965678784 0 0) 0x7f6edc0b2350 con 0x7f6edc07ff10 2020-05-18T21:26:32.735 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ed97fa700 1 -- 172.21.15.63:0/43845941 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ebc003270 con 0x7f6edc07ff10 2020-05-18T21:26:32.735 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ee0a06700 1 -- 172.21.15.63:0/43845941 >> v1:172.21.15.155:6789/0 conn(0x7f6edc07ff10 legacy=0x7f6edc0af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:32.736 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ee0a06700 1 -- 172.21.15.63:0/43845941 >> v1:172.21.15.63:6789/0 conn(0x7f6edc0b1c10 legacy=0x7f6edc093df0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-05-18T21:26:32.736 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ee0a06700 1 -- 172.21.15.63:0/43845941 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc065860 con 0x7f6edc024ab0 2020-05-18T21:26:32.736 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ee0a06700 1 --2- 172.21.15.63:0/43845941 >> v2:172.21.15.63:3300/0 conn(0x7f6edc024ab0 0x7f6edc0b00b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6edc0b2620 tx=0x7f6ed00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:32.737 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ee0a06700 1 --2- 172.21.15.63:0/43845941 >> v2:172.21.15.63:3300/0 conn(0x7f6edc024ab0 0x7f6edc0b00b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6edc0b2620 tx=0x7f6ed00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:32.738 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ee0a06700 1 --2- 172.21.15.63:0/43845941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6edc024ab0 0x7f6edc0b00b0 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f6edc0b2620 tx=0x7f6ed00108b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:32.738 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ee0a06700 1 --2- 172.21.15.63:0/43845941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6edc024ab0 0x7f6edc0b00b0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f6edc0b2620 tx=0x7f6ed00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:32.738 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ee0a06700 1 --2- 172.21.15.63:0/43845941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6edc024ab0 0x7f6edc0b00b0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f6edc0b2620 tx=0x7f6ed00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:32.738 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ee0a06700 1 --2- 172.21.15.63:0/43845941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6edc024ab0 0x7f6edc0b00b0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f6edc0b2620 tx=0x7f6ed00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:32.739 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ed97fa700 1 -- 172.21.15.63:0/43845941 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ed00115b0 con 0x7f6edc024ab0 2020-05-18T21:26:32.739 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ed97fa700 1 -- 172.21.15.63:0/43845941 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed0011710 con 0x7f6edc024ab0 2020-05-18T21:26:32.739 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ee1207700 1 -- 172.21.15.63:0/43845941 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6edc065ad0 con 0x7f6edc024ab0 2020-05-18T21:26:32.739 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ed97fa700 1 -- 172.21.15.63:0/43845941 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ed0011af0 con 0x7f6edc024ab0 2020-05-18T21:26:32.739 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ee1207700 1 -- 172.21.15.63:0/43845941 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6edc094720 con 0x7f6edc024ab0 2020-05-18T21:26:32.740 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ee0a06700 1 --2- 172.21.15.63:0/43845941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6edc024ab0 0x7f6edc0b00b0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f6edc0b2620 tx=0x7f6ed00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:32.740 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ed97fa700 1 -- 172.21.15.63:0/43845941 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7f6ed0011c50 con 0x7f6edc024ab0 2020-05-18T21:26:32.740 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ee0a06700 1 --2- 172.21.15.63:0/43845941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6edc024ab0 0x7f6edc0b00b0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f6edc0b2620 tx=0x7f6ed00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:32.740 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.723+0000 7f6ed97fa700 1 -- 172.21.15.63:0/43845941 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f6ed00067d0 con 0x7f6edc024ab0 2020-05-18T21:26:32.740 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.727+0000 7f6ee1207700 1 -- 172.21.15.63:0/43845941 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6edc0569e0 con 0x7f6edc024ab0 2020-05-18T21:26:32.741 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.731+0000 7f6ee0a06700 1 --2- 172.21.15.63:0/43845941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6edc024ab0 0x7f6edc0b00b0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f6edc0b2620 tx=0x7f6ed00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:32.741 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.735+0000 7f6ed97fa700 1 -- 172.21.15.63:0/43845941 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67708 (secure 0 0 0) 0x7f6ed000be50 con 0x7f6edc024ab0 2020-05-18T21:26:32.814 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.811+0000 7f6ee1207700 1 -- 172.21.15.63:0/43845941 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6edc05c940 con 0x7f6edc024ab0 2020-05-18T21:26:32.815 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.811+0000 7f6ee0a06700 1 --2- 172.21.15.63:0/43845941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6edc024ab0 0x7f6edc0b00b0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f6edc0b2620 tx=0x7f6ed00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:32.815 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.811+0000 7f6ed97fa700 1 -- 172.21.15.63:0/43845941 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6852 (secure 0 0 0) 0x7f6ed000b6e0 con 0x7f6edc024ab0 2020-05-18T21:26:32.816 INFO:teuthology.misc.health.smithi063.stdout: 2020-05-18T21:26:32.816 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":10,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:26:31.767611+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:26:32.817 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.811+0000 7f6ee1207700 1 -- 172.21.15.63:0/43845941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6edc024ab0 msgr2=0x7f6edc0b00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:32.817 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.811+0000 7f6ee1207700 1 --2- 172.21.15.63:0/43845941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6edc024ab0 0x7f6edc0b00b0 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f6edc0b2620 tx=0x7f6ed00108b0).stop 2020-05-18T21:26:32.817 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.811+0000 7f6ee1207700 1 -- 172.21.15.63:0/43845941 shutdown_connections 2020-05-18T21:26:32.817 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.811+0000 7f6ee1207700 1 --2- 172.21.15.63:0/43845941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6edc024ab0 0x7f6edc0b00b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:32.817 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.811+0000 7f6ee1207700 1 -- 172.21.15.63:0/43845941 >> 172.21.15.63:0/43845941 conn(0x7f6edc069b70 msgr2=0x7f6edc156580 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:32.818 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.811+0000 7f6ee1207700 1 -- 172.21.15.63:0/43845941 shutdown_connections 2020-05-18T21:26:32.818 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:32.811+0000 7f6ee1207700 1 -- 172.21.15.63:0/43845941 wait complete. 2020-05-18T21:26:32.828 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-05-18T21:26:33.321 INFO:tasks.ceph.osd.0.smithi063.stderr:2020-05-18T21:26:33.319+0000 7ff53c97bdc0 -1 osd.0 0 log_to_monitors {default=true} 2020-05-18T21:26:33.356 INFO:tasks.ceph.osd.5.smithi155.stderr:2020-05-18T21:26:33.353+0000 7f35645bedc0 -1 osd.5 0 log_to_monitors {default=true} 2020-05-18T21:26:33.555 INFO:tasks.ceph.osd.4.smithi155.stderr:2020-05-18T21:26:33.553+0000 7fe8740cbdc0 -1 osd.4 0 log_to_monitors {default=true} 2020-05-18T21:26:33.594 INFO:tasks.ceph.osd.1.smithi063.stderr:2020-05-18T21:26:33.591+0000 7f6780897dc0 -1 osd.1 0 log_to_monitors {default=true} 2020-05-18T21:26:33.596 INFO:tasks.ceph.osd.3.smithi063.stderr:2020-05-18T21:26:33.591+0000 7f599b7dddc0 -1 osd.3 0 log_to_monitors {default=true} 2020-05-18T21:26:33.612 INFO:tasks.ceph.osd.6.smithi155.stderr:2020-05-18T21:26:33.609+0000 7f28edc2fdc0 -1 osd.6 0 log_to_monitors {default=true} 2020-05-18T21:26:33.612 INFO:tasks.ceph.osd.2.smithi063.stderr:2020-05-18T21:26:33.611+0000 7f5154912dc0 -1 osd.2 0 log_to_monitors {default=true} 2020-05-18T21:26:33.647 INFO:tasks.ceph.osd.7.smithi155.stderr:2020-05-18T21:26:33.645+0000 7f976b613dc0 -1 osd.7 0 log_to_monitors {default=true} 2020-05-18T21:26:35.049 INFO:tasks.ceph.osd.4.smithi155.stderr:2020-05-18T21:26:35.045+0000 7fe86610b700 -1 osd.4 0 waiting for initial osdmap 2020-05-18T21:26:35.051 INFO:tasks.ceph.osd.6.smithi155.stderr:2020-05-18T21:26:35.049+0000 7f28dfc6f700 -1 osd.6 0 waiting for initial osdmap 2020-05-18T21:26:35.052 INFO:tasks.ceph.osd.1.smithi063.stderr:2020-05-18T21:26:35.047+0000 7f67728d7700 -1 osd.1 0 waiting for initial osdmap 2020-05-18T21:26:35.052 INFO:tasks.ceph.osd.0.smithi063.stderr:2020-05-18T21:26:35.047+0000 7ff52e9bb700 -1 osd.0 0 waiting for initial osdmap 2020-05-18T21:26:35.053 INFO:tasks.ceph.osd.3.smithi063.stderr:2020-05-18T21:26:35.051+0000 7f598d81d700 -1 osd.3 0 waiting for initial osdmap 2020-05-18T21:26:35.053 INFO:tasks.ceph.osd.2.smithi063.stderr:2020-05-18T21:26:35.047+0000 7f5146952700 -1 osd.2 0 waiting for initial osdmap 2020-05-18T21:26:35.054 INFO:tasks.ceph.osd.5.smithi155.stderr:2020-05-18T21:26:35.045+0000 7f35565fe700 -1 osd.5 0 waiting for initial osdmap 2020-05-18T21:26:35.054 INFO:tasks.ceph.osd.7.smithi155.stderr:2020-05-18T21:26:35.049+0000 7f975d653700 -1 osd.7 0 waiting for initial osdmap 2020-05-18T21:26:39.635 INFO:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-05-18T21:26:39.735 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce9ed5700 1 Processor -- start 2020-05-18T21:26:39.736 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce9ed5700 1 -- start start 2020-05-18T21:26:39.736 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce9ed5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1ce40614c0 0x7f1ce4156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:39.736 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce9ed5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce40b6fb0 con 0x7f1ce40b3620 2020-05-18T21:26:39.736 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce9ed5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce41561e0 con 0x7f1ce4062020 2020-05-18T21:26:39.736 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce9ed5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce4156480 con 0x7f1ce40614c0 2020-05-18T21:26:39.737 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1ce40614c0 0x7f1ce4156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:39.737 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce8c73700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1ce40b3620 0x7f1ce40b68a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54448/0 (socket says 172.21.15.63:54448) 2020-05-18T21:26:39.737 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1ce40614c0 0x7f1ce4156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52258/0 (socket says 172.21.15.63:52258) 2020-05-18T21:26:39.737 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce8c73700 1 -- 172.21.15.63:0/4181137347 learned_addr learned my addr 172.21.15.63:0/4181137347 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:39.738 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce3fff700 1 -- 172.21.15.63:0/4181137347 >> v1:172.21.15.155:6789/0 conn(0x7f1ce4062020 legacy=0x7f1ce40b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:39.738 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce3fff700 1 -- 172.21.15.63:0/4181137347 >> v1:172.21.15.63:6789/0 conn(0x7f1ce40b3620 legacy=0x7f1ce40b68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:39.738 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce2ffd700 1 -- 172.21.15.63:0/4181137347 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086349078 0 0) 0x7f1ce40b6fb0 con 0x7f1ce40b3620 2020-05-18T21:26:39.738 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce3fff700 1 -- 172.21.15.63:0/4181137347 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce4156720 con 0x7f1ce40614c0 2020-05-18T21:26:39.738 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce3fff700 1 --2- 172.21.15.63:0/4181137347 >> v2:172.21.15.63:3300/0 conn(0x7f1ce40614c0 0x7f1ce4156bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1cdc0032f0 tx=0x7f1cdc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.739 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce3fff700 1 --2- 172.21.15.63:0/4181137347 >> v2:172.21.15.63:3300/0 conn(0x7f1ce40614c0 0x7f1ce4156bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1cdc0032f0 tx=0x7f1cdc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.739 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce3fff700 1 --2- 172.21.15.63:0/4181137347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ce40614c0 0x7f1ce4156bc0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f1cdc0032f0 tx=0x7f1cdc007e00).ready entity=mon.0 client_cookie=edebff2209c9ec03 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:39.739 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce3fff700 1 --2- 172.21.15.63:0/4181137347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ce40614c0 0x7f1ce4156bc0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f1cdc0032f0 tx=0x7f1cdc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.739 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce2ffd700 1 -- 172.21.15.63:0/4181137347 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cdc00a180 con 0x7f1ce40614c0 2020-05-18T21:26:39.739 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce3fff700 1 --2- 172.21.15.63:0/4181137347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ce40614c0 0x7f1ce4156bc0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f1cdc0032f0 tx=0x7f1cdc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.740 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce3fff700 1 --2- 172.21.15.63:0/4181137347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ce40614c0 0x7f1ce4156bc0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f1cdc0032f0 tx=0x7f1cdc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.740 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce2ffd700 1 -- 172.21.15.63:0/4181137347 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc00a2e0 con 0x7f1ce40614c0 2020-05-18T21:26:39.740 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce2ffd700 1 -- 172.21.15.63:0/4181137347 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cdc00a700 con 0x7f1ce40614c0 2020-05-18T21:26:39.740 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce9ed5700 1 -- 172.21.15.63:0/4181137347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ce40614c0 msgr2=0x7f1ce4156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:39.741 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.727+0000 7f1ce9ed5700 1 --2- 172.21.15.63:0/4181137347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ce40614c0 0x7f1ce4156bc0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f1cdc0032f0 tx=0x7f1cdc007e00).stop 2020-05-18T21:26:39.741 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.731+0000 7f1ce9ed5700 1 -- 172.21.15.63:0/4181137347 shutdown_connections 2020-05-18T21:26:39.741 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.731+0000 7f1ce9ed5700 1 --2- 172.21.15.63:0/4181137347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ce40614c0 0x7f1ce4156bc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:39.741 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.731+0000 7f1ce9ed5700 1 -- 172.21.15.63:0/4181137347 >> 172.21.15.63:0/4181137347 conn(0x7f1ce40b8290 msgr2=0x7f1ce40b86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:39.741 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.731+0000 7f1ce9ed5700 1 -- 172.21.15.63:0/4181137347 shutdown_connections 2020-05-18T21:26:39.742 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.731+0000 7f1ce9ed5700 1 -- 172.21.15.63:0/4181137347 wait complete. 2020-05-18T21:26:39.742 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.731+0000 7f1ce9ed5700 1 Processor -- start 2020-05-18T21:26:39.742 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.731+0000 7f1ce9ed5700 1 -- start start 2020-05-18T21:26:39.747 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce9ed5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1ce40614c0 0x7f1ce40b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:39.747 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce9ed5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce415d6b0 con 0x7f1ce40b3620 2020-05-18T21:26:39.747 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce9ed5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce415d950 con 0x7f1ce4062020 2020-05-18T21:26:39.747 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce9ed5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce4138c00 con 0x7f1ce40614c0 2020-05-18T21:26:39.748 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce8c73700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1ce40b3620 0x7f1ce40b0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54454/0 (socket says 172.21.15.63:54454) 2020-05-18T21:26:39.748 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce8c73700 1 -- 172.21.15.63:0/2430814673 learned_addr learned my addr 172.21.15.63:0/2430814673 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:39.748 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce3fff700 1 --2- 172.21.15.63:0/2430814673 >> v2:172.21.15.155:3300/0 conn(0x7f1ce40614c0 0x7f1ce40b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:39.748 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce0ff9700 1 -- 172.21.15.63:0/2430814673 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517868133 0 0) 0x7f1ce415d6b0 con 0x7f1ce40b3620 2020-05-18T21:26:39.749 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce0ff9700 1 -- 172.21.15.63:0/2430814673 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cc8003270 con 0x7f1ce40b3620 2020-05-18T21:26:39.749 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce0ff9700 1 -- 172.21.15.63:0/2430814673 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4122477765 0 0) 0x7f1cc8003270 con 0x7f1ce40b3620 2020-05-18T21:26:39.749 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce0ff9700 1 -- 172.21.15.63:0/2430814673 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1ce415d6b0 con 0x7f1ce40b3620 2020-05-18T21:26:39.749 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce0ff9700 1 -- 172.21.15.63:0/2430814673 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f1cd40018a0 con 0x7f1ce40b3620 2020-05-18T21:26:39.750 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce0ff9700 1 -- 172.21.15.63:0/2430814673 >> v2:172.21.15.155:3300/0 conn(0x7f1ce40614c0 msgr2=0x7f1ce40b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:39.750 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce0ff9700 1 --2- 172.21.15.63:0/2430814673 >> v2:172.21.15.155:3300/0 conn(0x7f1ce40614c0 0x7f1ce40b1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:39.750 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce0ff9700 1 -- 172.21.15.63:0/2430814673 >> v1:172.21.15.155:6789/0 conn(0x7f1ce4062020 legacy=0x7f1ce40afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:39.750 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce0ff9700 1 -- 172.21.15.63:0/2430814673 >> v1:172.21.15.63:6789/0 conn(0x7f1ce40b3620 legacy=0x7f1ce40b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:39.750 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce0ff9700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cc8003830 0x7f1cc8003c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:39.751 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce0ff9700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cc8004510 0x7f1cc8004950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:39.751 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce0ff9700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc8004db0 0x7f1cc800b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:39.751 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce0ff9700 1 -- 172.21.15.63:0/2430814673 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce4138c00 con 0x7f1cc8004db0 2020-05-18T21:26:39.751 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce0ff9700 1 -- 172.21.15.63:0/2430814673 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc8005320 con 0x7f1cc8003830 2020-05-18T21:26:39.752 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce0ff9700 1 -- 172.21.15.63:0/2430814673 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc800bbc0 con 0x7f1cc8004510 2020-05-18T21:26:39.752 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce8c73700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc8004db0 0x7f1cc800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:39.753 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce3fff700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cc8003830 0x7f1cc8003c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:39.753 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce37fe700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cc8004510 0x7f1cc8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:39.753 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce8c73700 1 -- 172.21.15.63:0/2430814673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cc8004510 msgr2=0x7f1cc8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:39.753 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce8c73700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cc8004510 0x7f1cc8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:39.753 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce8c73700 1 -- 172.21.15.63:0/2430814673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cc8003830 msgr2=0x7f1cc8003c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:39.754 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce8c73700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cc8003830 0x7f1cc8003c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:39.754 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce8c73700 1 -- 172.21.15.63:0/2430814673 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce41390a0 con 0x7f1cc8004db0 2020-05-18T21:26:39.754 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce9ed5700 1 -- 172.21.15.63:0/2430814673 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce40ad3f0 con 0x7f1cc8004db0 2020-05-18T21:26:39.754 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce8c73700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc8004db0 0x7f1cc800b760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1cc80054e0 tx=0x7f1cd40113d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.755 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce9ed5700 1 -- 172.21.15.63:0/2430814673 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce40b1000 con 0x7f1cc8004db0 2020-05-18T21:26:39.755 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce8c73700 1 -- 172.21.15.63:0/2430814673 reap_dead start 2020-05-18T21:26:39.755 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce8c73700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc8004db0 0x7f1cc800b760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1cc80054e0 tx=0x7f1cd40113d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.755 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce8c73700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc8004db0 0x7f1cc800b760 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f1cc80054e0 tx=0x7f1cd40113d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:39.755 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce8c73700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc8004db0 0x7f1cc800b760 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f1cc80054e0 tx=0x7f1cd40113d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.756 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce8c73700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc8004db0 0x7f1cc800b760 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f1cc80054e0 tx=0x7f1cd40113d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.756 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce0ff9700 1 -- 172.21.15.63:0/2430814673 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cd400ee20 con 0x7f1cc8004db0 2020-05-18T21:26:39.756 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce8c73700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc8004db0 0x7f1cc800b760 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f1cc80054e0 tx=0x7f1cd40113d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.756 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce0ff9700 1 -- 172.21.15.63:0/2430814673 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd4011dd0 con 0x7f1cc8004db0 2020-05-18T21:26:39.756 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce0ff9700 1 -- 172.21.15.63:0/2430814673 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cd40103b0 con 0x7f1cc8004db0 2020-05-18T21:26:39.757 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce9ed5700 1 -- 172.21.15.63:0/2430814673 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cbc003380 con 0x7f1cc8004db0 2020-05-18T21:26:39.757 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.735+0000 7f1ce8c73700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc8004db0 0x7f1cc800b760 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f1cc80054e0 tx=0x7f1cd40113d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.757 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.739+0000 7f1ce0ff9700 1 -- 172.21.15.63:0/2430814673 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1cd4010510 con 0x7f1cc8004db0 2020-05-18T21:26:39.757 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.739+0000 7f1ce8c73700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc8004db0 0x7f1cc800b760 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f1cc80054e0 tx=0x7f1cd40113d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.757 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.739+0000 7f1ce0ff9700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cc8053960 0x7f1cc8055e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:39.758 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.739+0000 7f1ce0ff9700 1 -- 172.21.15.63:0/2430814673 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f1cd4063c80 con 0x7f1cc8004db0 2020-05-18T21:26:39.758 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.739+0000 7f1ce3fff700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cc8053960 0x7f1cc8055e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:39.758 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.739+0000 7f1ce3fff700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cc8053960 0x7f1cc8055e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1cdc0032f0 tx=0x7f1cdc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.758 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.739+0000 7f1ce3fff700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cc8053960 0x7f1cc8055e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1cdc0032f0 tx=0x7f1cdc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.759 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.739+0000 7f1ce3fff700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cc8053960 0x7f1cc8055e20 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f1cdc0032f0 tx=0x7f1cdc007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:39.759 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.743+0000 7f1ce8c73700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc8004db0 0x7f1cc800b760 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f1cc80054e0 tx=0x7f1cd40113d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.759 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.743+0000 7f1ce0ff9700 1 -- 172.21.15.63:0/2430814673 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f1cd403e010 con 0x7f1cc8004db0 2020-05-18T21:26:39.863 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.859+0000 7f1ce9ed5700 1 -- 172.21.15.63:0/2430814673 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cbc002210 con 0x7f1cc8004db0 2020-05-18T21:26:39.865 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.863+0000 7f1ce8c73700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc8004db0 0x7f1cc800b760 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f1cc80054e0 tx=0x7f1cd40113d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.865 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.863+0000 7f1ce0ff9700 1 -- 172.21.15.63:0/2430814673 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11856 (secure 0 0 0) 0x7f1cd4041630 con 0x7f1cc8004db0 2020-05-18T21:26:39.865 INFO:teuthology.misc.health.smithi063.stdout: 2020-05-18T21:26:39.865 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":15,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:26:38.107307+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:26:39.867 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.863+0000 7f1ce9ed5700 1 -- 172.21.15.63:0/2430814673 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cc8053960 msgr2=0x7f1cc8055e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:39.867 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.863+0000 7f1ce9ed5700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cc8053960 0x7f1cc8055e20 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f1cdc0032f0 tx=0x7f1cdc007e00).stop 2020-05-18T21:26:39.867 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.863+0000 7f1ce9ed5700 1 -- 172.21.15.63:0/2430814673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc8004db0 msgr2=0x7f1cc800b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:39.868 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.863+0000 7f1ce9ed5700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc8004db0 0x7f1cc800b760 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f1cc80054e0 tx=0x7f1cd40113d0).stop 2020-05-18T21:26:39.868 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.863+0000 7f1ce9ed5700 1 -- 172.21.15.63:0/2430814673 shutdown_connections 2020-05-18T21:26:39.868 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.863+0000 7f1ce9ed5700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cc8053960 0x7f1cc8055e20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:39.868 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.863+0000 7f1ce9ed5700 1 --2- 172.21.15.63:0/2430814673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc8004db0 0x7f1cc800b760 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:39.869 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.863+0000 7f1ce9ed5700 1 -- 172.21.15.63:0/2430814673 >> 172.21.15.63:0/2430814673 conn(0x7f1ce40b8290 msgr2=0x7f1ce40b4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:39.869 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.863+0000 7f1ce9ed5700 1 -- 172.21.15.63:0/2430814673 shutdown_connections 2020-05-18T21:26:39.869 INFO:teuthology.misc.health.smithi063.stderr:2020-05-18T21:26:39.863+0000 7f1ce9ed5700 1 -- 172.21.15.63:0/2430814673 wait complete. 2020-05-18T21:26:39.878 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-05-18T21:26:39.879 INFO:tasks.ceph:Creating RBD pool 2020-05-18T21:26:39.879 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd pool create rbd 8 2020-05-18T21:26:39.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4177fff700 1 Processor -- start 2020-05-18T21:26:39.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4177fff700 1 -- start start 2020-05-18T21:26:39.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4177fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f41780b5cb0 0x7f41780b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:39.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4177fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4178151bc0 0x7f4178152030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:39.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4177fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4178025500 con 0x7f41780b6410 2020-05-18T21:26:39.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4177fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4178064ee0 con 0x7f41780b5cb0 2020-05-18T21:26:39.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4177fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41780b67f0 con 0x7f4178151bc0 2020-05-18T21:26:39.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f41777fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f41780b6410 0x7f4178061af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54470/0 (socket says 172.21.15.63:54470) 2020-05-18T21:26:39.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f41777fe700 1 -- 172.21.15.63:0/3604598537 learned_addr learned my addr 172.21.15.63:0/3604598537 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:39.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f417da1f700 1 --2- 172.21.15.63:0/3604598537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4178151bc0 0x7f4178152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:39.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f416ffff700 1 --2- 172.21.15.63:0/3604598537 >> v2:172.21.15.155:3300/0 conn(0x7f41780b5cb0 0x7f41780b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:39.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4176ffd700 1 -- 172.21.15.63:0/3604598537 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885171523 0 0) 0x7f4178025500 con 0x7f41780b6410 2020-05-18T21:26:39.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4176ffd700 1 -- 172.21.15.63:0/3604598537 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4164003270 con 0x7f41780b6410 2020-05-18T21:26:39.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f416ffff700 1 -- 172.21.15.63:0/3604598537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4178151bc0 msgr2=0x7f4178152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:39.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f416ffff700 1 --2- 172.21.15.63:0/3604598537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4178151bc0 0x7f4178152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:39.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f416ffff700 1 -- 172.21.15.63:0/3604598537 >> v1:172.21.15.63:6789/0 conn(0x7f41780b6410 legacy=0x7f4178061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:39.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4176ffd700 1 -- 172.21.15.63:0/3604598537 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 590891273 0 0) 0x7f4164003270 con 0x7f41780b6410 2020-05-18T21:26:39.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f416ffff700 1 -- 172.21.15.63:0/3604598537 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4178025180 con 0x7f41780b5cb0 2020-05-18T21:26:39.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f416ffff700 1 --2- 172.21.15.63:0/3604598537 >> v2:172.21.15.155:3300/0 conn(0x7f41780b5cb0 0x7f41780b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f41680018b0 tx=0x7f4160007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f416ffff700 1 --2- 172.21.15.63:0/3604598537 >> v2:172.21.15.155:3300/0 conn(0x7f41780b5cb0 0x7f41780b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f41680018b0 tx=0x7f4160007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f416ffff700 1 --2- 172.21.15.63:0/3604598537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41780b5cb0 0x7f41780b6cd0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f41680018b0 tx=0x7f4160007a80).ready entity=mon.1 client_cookie=f17bfb5bbf7a866f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:39.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f416ffff700 1 --2- 172.21.15.63:0/3604598537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41780b5cb0 0x7f41780b6cd0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f41680018b0 tx=0x7f4160007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4176ffd700 1 -- 172.21.15.63:0/3604598537 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4168001710 con 0x7f41780b5cb0 2020-05-18T21:26:39.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f416ffff700 1 --2- 172.21.15.63:0/3604598537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41780b5cb0 0x7f41780b6cd0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f41680018b0 tx=0x7f4160007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f416ffff700 1 --2- 172.21.15.63:0/3604598537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41780b5cb0 0x7f41780b6cd0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f41680018b0 tx=0x7f4160007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:39.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4176ffd700 1 -- 172.21.15.63:0/3604598537 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4160008e40 con 0x7f41780b5cb0 2020-05-18T21:26:39.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4176ffd700 1 -- 172.21.15.63:0/3604598537 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4160011440 con 0x7f41780b5cb0 2020-05-18T21:26:39.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4177fff700 1 -- 172.21.15.63:0/3604598537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41780b5cb0 msgr2=0x7f41780b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:39.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4177fff700 1 --2- 172.21.15.63:0/3604598537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41780b5cb0 0x7f41780b6cd0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f41680018b0 tx=0x7f4160007a80).stop 2020-05-18T21:26:39.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4177fff700 1 -- 172.21.15.63:0/3604598537 shutdown_connections 2020-05-18T21:26:39.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4177fff700 1 --2- 172.21.15.63:0/3604598537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4178151bc0 0x7f4178152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:40.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4177fff700 1 --2- 172.21.15.63:0/3604598537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41780b5cb0 0x7f41780b6cd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:40.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4177fff700 1 -- 172.21.15.63:0/3604598537 >> 172.21.15.63:0/3604598537 conn(0x7f4178069b70 msgr2=0x7f4178069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:40.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4177fff700 1 -- 172.21.15.63:0/3604598537 shutdown_connections 2020-05-18T21:26:40.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.987+0000 7f4177fff700 1 -- 172.21.15.63:0/3604598537 wait complete. 2020-05-18T21:26:40.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.991+0000 7f4177fff700 1 Processor -- start 2020-05-18T21:26:40.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.991+0000 7f4177fff700 1 -- start start 2020-05-18T21:26:40.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f4177fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f41780b5cb0 0x7f41781142b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:40.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f4177fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4178151bc0 0x7f4178112680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:40.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f4177fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41780b19e0 con 0x7f41780b6410 2020-05-18T21:26:40.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f4177fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41780b1c80 con 0x7f4178151bc0 2020-05-18T21:26:40.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f4177fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4178115730 con 0x7f41780b5cb0 2020-05-18T21:26:40.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f417da1f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4178151bc0 0x7f4178112680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:40.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f417da1f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4178151bc0 0x7f4178112680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52288/0 (socket says 172.21.15.63:52288) 2020-05-18T21:26:40.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f417da1f700 1 -- 172.21.15.63:0/858990176 learned_addr learned my addr 172.21.15.63:0/858990176 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:40.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f41777fe700 1 --2- 172.21.15.63:0/858990176 >> v2:172.21.15.155:3300/0 conn(0x7f41780b5cb0 0x7f41781142b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:40.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f417da1f700 1 -- 172.21.15.63:0/858990176 >> v2:172.21.15.155:3300/0 conn(0x7f41780b5cb0 msgr2=0x7f41781142b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:40.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f417da1f700 1 --2- 172.21.15.63:0/858990176 >> v2:172.21.15.155:3300/0 conn(0x7f41780b5cb0 0x7f41781142b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:40.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f417da1f700 1 -- 172.21.15.63:0/858990176 >> v1:172.21.15.63:6789/0 conn(0x7f41780b6410 legacy=0x7f4178114f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:40.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f417da1f700 1 -- 172.21.15.63:0/858990176 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4178114710 con 0x7f4178151bc0 2020-05-18T21:26:40.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f4174ff9700 1 -- 172.21.15.63:0/858990176 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918836155 0 0) 0x7f41780b19e0 con 0x7f41780b6410 2020-05-18T21:26:40.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f41777fe700 1 --2- 172.21.15.63:0/858990176 >> v2:172.21.15.155:3300/0 conn(0x7f41780b5cb0 0x7f41781142b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:26:40.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f417da1f700 1 --2- 172.21.15.63:0/858990176 >> v2:172.21.15.63:3300/0 conn(0x7f4178151bc0 0x7f4178112680 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41700032f0 tx=0x7f4170011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:40.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f417da1f700 1 --2- 172.21.15.63:0/858990176 >> v2:172.21.15.63:3300/0 conn(0x7f4178151bc0 0x7f4178112680 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41700032f0 tx=0x7f4170011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:40.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f417da1f700 1 --2- 172.21.15.63:0/858990176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4178151bc0 0x7f4178112680 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f41700032f0 tx=0x7f4170011090).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:40.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f417da1f700 1 --2- 172.21.15.63:0/858990176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4178151bc0 0x7f4178112680 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f41700032f0 tx=0x7f4170011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:40.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f417da1f700 1 --2- 172.21.15.63:0/858990176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4178151bc0 0x7f4178112680 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f41700032f0 tx=0x7f4170011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:40.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f417da1f700 1 --2- 172.21.15.63:0/858990176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4178151bc0 0x7f4178112680 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f41700032f0 tx=0x7f4170011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:40.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f4174ff9700 1 -- 172.21.15.63:0/858990176 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4170012920 con 0x7f4178151bc0 2020-05-18T21:26:40.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f4174ff9700 1 -- 172.21.15.63:0/858990176 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4170012a80 con 0x7f4178151bc0 2020-05-18T21:26:40.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f4177fff700 1 -- 172.21.15.63:0/858990176 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4178112ae0 con 0x7f4178151bc0 2020-05-18T21:26:40.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f4174ff9700 1 -- 172.21.15.63:0/858990176 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4170012de0 con 0x7f4178151bc0 2020-05-18T21:26:40.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f4177fff700 1 -- 172.21.15.63:0/858990176 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41781505d0 con 0x7f4178151bc0 2020-05-18T21:26:40.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f417da1f700 1 --2- 172.21.15.63:0/858990176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4178151bc0 0x7f4178112680 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f41700032f0 tx=0x7f4170011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:40.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f4177fff700 1 -- 172.21.15.63:0/858990176 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41780569e0 con 0x7f4178151bc0 2020-05-18T21:26:40.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f4174ff9700 1 -- 172.21.15.63:0/858990176 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4170007180 con 0x7f4178151bc0 2020-05-18T21:26:40.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f417da1f700 1 --2- 172.21.15.63:0/858990176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4178151bc0 0x7f4178112680 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f41700032f0 tx=0x7f4170011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:40.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f4174ff9700 1 --2- 172.21.15.63:0/858990176 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f415c04f9d0 0x7f415c051e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:40.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f4174ff9700 1 -- 172.21.15.63:0/858990176 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f4170064120 con 0x7f4178151bc0 2020-05-18T21:26:40.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f41777fe700 1 --2- 172.21.15.63:0/858990176 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f415c04f9d0 0x7f415c051e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:40.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.995+0000 7f41777fe700 1 --2- 172.21.15.63:0/858990176 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f415c04f9d0 0x7f415c051e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4168001970 tx=0x7f4168001420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:40.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.999+0000 7f41777fe700 1 --2- 172.21.15.63:0/858990176 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f415c04f9d0 0x7f415c051e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4168001970 tx=0x7f4168001420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:40.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.999+0000 7f41777fe700 1 --2- 172.21.15.63:0/858990176 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f415c04f9d0 0x7f415c051e90 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f4168001970 tx=0x7f4168001420).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:40.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.999+0000 7f417da1f700 1 --2- 172.21.15.63:0/858990176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4178151bc0 0x7f4178112680 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f41700032f0 tx=0x7f4170011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:40.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:39.999+0000 7f4174ff9700 1 -- 172.21.15.63:0/858990176 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f417003e4b0 con 0x7f4178151bc0 2020-05-18T21:26:40.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:40.119+0000 7f4177fff700 1 -- 172.21.15.63:0/858990176 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f41780b1dc0 con 0x7f4178151bc0 2020-05-18T21:26:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:40.995+0000 7f417da1f700 1 --2- 172.21.15.63:0/858990176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4178151bc0 0x7f4178112680 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f41700032f0 tx=0x7f4170011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.127+0000 7f417da1f700 1 --2- 172.21.15.63:0/858990176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4178151bc0 0x7f4178112680 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f41700032f0 tx=0x7f4170011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:41.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.127+0000 7f4174ff9700 1 -- 172.21.15.63:0/858990176 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f4170041ad0 con 0x7f4178151bc0 2020-05-18T21:26:41.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.131+0000 7f4177fff700 1 -- 172.21.15.63:0/858990176 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f415c04f9d0 msgr2=0x7f415c051e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:41.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.131+0000 7f4177fff700 1 --2- 172.21.15.63:0/858990176 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f415c04f9d0 0x7f415c051e90 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f4168001970 tx=0x7f4168001420).stop 2020-05-18T21:26:41.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.131+0000 7f4177fff700 1 -- 172.21.15.63:0/858990176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4178151bc0 msgr2=0x7f4178112680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:41.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.131+0000 7f4177fff700 1 --2- 172.21.15.63:0/858990176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4178151bc0 0x7f4178112680 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f41700032f0 tx=0x7f4170011090).stop 2020-05-18T21:26:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.131+0000 7f4177fff700 1 -- 172.21.15.63:0/858990176 shutdown_connections 2020-05-18T21:26:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.131+0000 7f4177fff700 1 --2- 172.21.15.63:0/858990176 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f415c04f9d0 0x7f415c051e90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.131+0000 7f4177fff700 1 --2- 172.21.15.63:0/858990176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4178151bc0 0x7f4178112680 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.131+0000 7f4177fff700 1 --2- 172.21.15.63:0/858990176 >> v2:172.21.15.155:3300/0 conn(0x7f41780b5cb0 0x7f41781142b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:41.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.131+0000 7f4177fff700 1 -- 172.21.15.63:0/858990176 >> 172.21.15.63:0/858990176 conn(0x7f4178069b70 msgr2=0x7f41780b86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:41.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.131+0000 7f4177fff700 1 -- 172.21.15.63:0/858990176 shutdown_connections 2020-05-18T21:26:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.135+0000 7f4177fff700 1 -- 172.21.15.63:0/858990176 wait complete. 2020-05-18T21:26:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'rbd' created 2020-05-18T21:26:41.152 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-05-18T21:26:41.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.251+0000 7f24337e6700 1 Processor -- start 2020-05-18T21:26:41.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.251+0000 7f24337e6700 1 -- start start 2020-05-18T21:26:41.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f24337e6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f242c0b8d90 0x7f242c0adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:41.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f24337e6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f242c0b4110 0x7f242c0b4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:41.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f24337e6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242c07fca0 con 0x7f242c0b8480 2020-05-18T21:26:41.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f24337e6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f242c0b8860 con 0x7f242c0b8d90 2020-05-18T21:26:41.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f24337e6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242c080280 con 0x7f242c0b4110 2020-05-18T21:26:41.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f2431d83700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f242c0b8480 0x7f242c0b36b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54480/0 (socket says 172.21.15.63:54480) 2020-05-18T21:26:41.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f2431d83700 1 -- 172.21.15.63:0/1119178863 learned_addr learned my addr 172.21.15.63:0/1119178863 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:41.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f2431582700 1 --2- 172.21.15.63:0/1119178863 >> v2:172.21.15.63:3300/0 conn(0x7f242c0b8d90 0x7f242c0adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:41.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f2432584700 1 --2- 172.21.15.63:0/1119178863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f242c0b4110 0x7f242c0b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:41.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f2430d81700 1 -- 172.21.15.63:0/1119178863 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8563251 0 0) 0x7f242c07fca0 con 0x7f242c0b8480 2020-05-18T21:26:41.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f2430d81700 1 -- 172.21.15.63:0/1119178863 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2414003270 con 0x7f242c0b8480 2020-05-18T21:26:41.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f2431582700 1 -- 172.21.15.63:0/1119178863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f242c0b4110 msgr2=0x7f242c0b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:41.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f2431582700 1 --2- 172.21.15.63:0/1119178863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f242c0b4110 0x7f242c0b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:41.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f2431582700 1 -- 172.21.15.63:0/1119178863 >> v1:172.21.15.63:6789/0 conn(0x7f242c0b8480 legacy=0x7f242c0b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:41.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f2431582700 1 -- 172.21.15.63:0/1119178863 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c0b49a0 con 0x7f242c0b8d90 2020-05-18T21:26:41.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f2431582700 1 --2- 172.21.15.63:0/1119178863 >> v2:172.21.15.63:3300/0 conn(0x7f242c0b8d90 0x7f242c0adfb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2420002f70 tx=0x7f2420007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:41.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f2431582700 1 --2- 172.21.15.63:0/1119178863 >> v2:172.21.15.63:3300/0 conn(0x7f242c0b8d90 0x7f242c0adfb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2420002f70 tx=0x7f2420007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:41.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f2431582700 1 --2- 172.21.15.63:0/1119178863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f242c0b8d90 0x7f242c0adfb0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f2420002f70 tx=0x7f2420007a80).ready entity=mon.0 client_cookie=44117045997f5102 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:41.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f2431582700 1 --2- 172.21.15.63:0/1119178863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f242c0b8d90 0x7f242c0adfb0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f2420002f70 tx=0x7f2420007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:41.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f2431582700 1 --2- 172.21.15.63:0/1119178863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f242c0b8d90 0x7f242c0adfb0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f2420002f70 tx=0x7f2420007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:41.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f2430d81700 1 -- 172.21.15.63:0/1119178863 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2420008e80 con 0x7f242c0b8d90 2020-05-18T21:26:41.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f2431582700 1 --2- 172.21.15.63:0/1119178863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f242c0b8d90 0x7f242c0adfb0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f2420002f70 tx=0x7f2420007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:41.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f2430d81700 1 -- 172.21.15.63:0/1119178863 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2420011540 con 0x7f242c0b8d90 2020-05-18T21:26:41.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f2430d81700 1 -- 172.21.15.63:0/1119178863 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2420011960 con 0x7f242c0b8d90 2020-05-18T21:26:41.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f24337e6700 1 -- 172.21.15.63:0/1119178863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f242c0b8d90 msgr2=0x7f242c0adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:41.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f24337e6700 1 --2- 172.21.15.63:0/1119178863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f242c0b8d90 0x7f242c0adfb0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f2420002f70 tx=0x7f2420007a80).stop 2020-05-18T21:26:41.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f24337e6700 1 -- 172.21.15.63:0/1119178863 shutdown_connections 2020-05-18T21:26:41.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f24337e6700 1 --2- 172.21.15.63:0/1119178863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f242c0b4110 0x7f242c0b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:41.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f24337e6700 1 --2- 172.21.15.63:0/1119178863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f242c0b8d90 0x7f242c0adfb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:41.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f24337e6700 1 -- 172.21.15.63:0/1119178863 >> 172.21.15.63:0/1119178863 conn(0x7f242c05f100 msgr2=0x7f242c05f510 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:41.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f24337e6700 1 -- 172.21.15.63:0/1119178863 shutdown_connections 2020-05-18T21:26:41.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.255+0000 7f24337e6700 1 -- 172.21.15.63:0/1119178863 wait complete. 2020-05-18T21:26:41.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f24337e6700 1 Processor -- start 2020-05-18T21:26:41.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f24337e6700 1 -- start start 2020-05-18T21:26:41.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f24337e6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f242c0b8d90 0x7f242c063ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:41.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f24337e6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242c073c30 con 0x7f242c0b8480 2020-05-18T21:26:41.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f24337e6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242c073e90 con 0x7f242c0b4110 2020-05-18T21:26:41.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f24337e6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f242c074130 con 0x7f242c0b8d90 2020-05-18T21:26:41.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f2432584700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f242c0b8d90 0x7f242c063ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:41.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f2431582700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f242c0b8480 0x7f242c062020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54488/0 (socket says 172.21.15.63:54488) 2020-05-18T21:26:41.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f2431582700 1 -- 172.21.15.63:0/41004164 learned_addr learned my addr 172.21.15.63:0/41004164 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:41.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f2432584700 1 -- 172.21.15.63:0/41004164 >> v1:172.21.15.155:6789/0 conn(0x7f242c0b4110 legacy=0x7f242c0745d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:41.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f242a7fc700 1 -- 172.21.15.63:0/41004164 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299134281 0 0) 0x7f242c073c30 con 0x7f242c0b8480 2020-05-18T21:26:41.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f2432584700 1 -- 172.21.15.63:0/41004164 >> v1:172.21.15.63:6789/0 conn(0x7f242c0b8480 legacy=0x7f242c062020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:41.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f2432584700 1 -- 172.21.15.63:0/41004164 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c074ce0 con 0x7f242c0b8d90 2020-05-18T21:26:41.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f2432584700 1 --2- 172.21.15.63:0/41004164 >> v2:172.21.15.63:3300/0 conn(0x7f242c0b8d90 0x7f242c063ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2424002f70 tx=0x7f2424010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:41.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f2432584700 1 --2- 172.21.15.63:0/41004164 >> v2:172.21.15.63:3300/0 conn(0x7f242c0b8d90 0x7f242c063ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2424002f70 tx=0x7f2424010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:41.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f2432584700 1 --2- 172.21.15.63:0/41004164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f242c0b8d90 0x7f242c063ea0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f2424002f70 tx=0x7f2424010c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:41.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f2432584700 1 --2- 172.21.15.63:0/41004164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f242c0b8d90 0x7f242c063ea0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f2424002f70 tx=0x7f2424010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:41.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f242a7fc700 1 -- 172.21.15.63:0/41004164 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2424007550 con 0x7f242c0b8d90 2020-05-18T21:26:41.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f2432584700 1 --2- 172.21.15.63:0/41004164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f242c0b8d90 0x7f242c063ea0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f2424002f70 tx=0x7f2424010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:41.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f2432584700 1 --2- 172.21.15.63:0/41004164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f242c0b8d90 0x7f242c063ea0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f2424002f70 tx=0x7f2424010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:41.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f242a7fc700 1 -- 172.21.15.63:0/41004164 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2424005700 con 0x7f242c0b8d90 2020-05-18T21:26:41.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f24337e6700 1 -- 172.21.15.63:0/41004164 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f242c062730 con 0x7f242c0b8d90 2020-05-18T21:26:41.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f242a7fc700 1 -- 172.21.15.63:0/41004164 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2424005aa0 con 0x7f242c0b8d90 2020-05-18T21:26:41.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.259+0000 7f24337e6700 1 -- 172.21.15.63:0/41004164 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f242c061510 con 0x7f242c0b8d90 2020-05-18T21:26:41.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.263+0000 7f2432584700 1 --2- 172.21.15.63:0/41004164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f242c0b8d90 0x7f242c063ea0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f2424002f70 tx=0x7f2424010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:41.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.263+0000 7f24337e6700 1 -- 172.21.15.63:0/41004164 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f242c0aecc0 con 0x7f242c0b8d90 2020-05-18T21:26:41.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.263+0000 7f242a7fc700 1 -- 172.21.15.63:0/41004164 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2424005ca0 con 0x7f242c0b8d90 2020-05-18T21:26:41.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.263+0000 7f2432584700 1 --2- 172.21.15.63:0/41004164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f242c0b8d90 0x7f242c063ea0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f2424002f70 tx=0x7f2424010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:41.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.263+0000 7f242a7fc700 1 --2- 172.21.15.63:0/41004164 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f240c04f7e0 0x7f240c051ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:41.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.263+0000 7f242a7fc700 1 -- 172.21.15.63:0/41004164 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f2424063fe0 con 0x7f242c0b8d90 2020-05-18T21:26:41.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.263+0000 7f2431d83700 1 --2- 172.21.15.63:0/41004164 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f240c04f7e0 0x7f240c051ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:41.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.263+0000 7f2431d83700 1 --2- 172.21.15.63:0/41004164 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f240c04f7e0 0x7f240c051ca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f242c0b7980 tx=0x7f241c001830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:41.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.263+0000 7f2431d83700 1 --2- 172.21.15.63:0/41004164 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f240c04f7e0 0x7f240c051ca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f242c0b7980 tx=0x7f241c001830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:41.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.263+0000 7f2431d83700 1 --2- 172.21.15.63:0/41004164 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f240c04f7e0 0x7f240c051ca0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f242c0b7980 tx=0x7f241c001830).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:41.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.267+0000 7f2432584700 1 --2- 172.21.15.63:0/41004164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f242c0b8d90 0x7f242c063ea0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f2424002f70 tx=0x7f2424010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:41.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.267+0000 7f242a7fc700 1 -- 172.21.15.63:0/41004164 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f242403e370 con 0x7f242c0b8d90 2020-05-18T21:26:41.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:41.387+0000 7f24337e6700 1 -- 172.21.15.63:0/41004164 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f242c0b6ad0 con 0x7f242c0b8d90 2020-05-18T21:26:42.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.139+0000 7f2432584700 1 --2- 172.21.15.63:0/41004164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f242c0b8d90 0x7f242c063ea0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f2424002f70 tx=0x7f2424010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.139+0000 7f242a7fc700 1 -- 172.21.15.63:0/41004164 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2424041990 con 0x7f242c0b8d90 2020-05-18T21:26:42.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.143+0000 7f24337e6700 1 -- 172.21.15.63:0/41004164 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f240c04f7e0 msgr2=0x7f240c051ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.143+0000 7f24337e6700 1 --2- 172.21.15.63:0/41004164 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f240c04f7e0 0x7f240c051ca0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f242c0b7980 tx=0x7f241c001830).stop 2020-05-18T21:26:42.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.143+0000 7f24337e6700 1 -- 172.21.15.63:0/41004164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f242c0b8d90 msgr2=0x7f242c063ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.143+0000 7f24337e6700 1 --2- 172.21.15.63:0/41004164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f242c0b8d90 0x7f242c063ea0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f2424002f70 tx=0x7f2424010c30).stop 2020-05-18T21:26:42.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.143+0000 7f24337e6700 1 -- 172.21.15.63:0/41004164 shutdown_connections 2020-05-18T21:26:42.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.143+0000 7f24337e6700 1 --2- 172.21.15.63:0/41004164 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f240c04f7e0 0x7f240c051ca0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:42.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.143+0000 7f24337e6700 1 --2- 172.21.15.63:0/41004164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f242c0b8d90 0x7f242c063ea0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:42.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.143+0000 7f24337e6700 1 -- 172.21.15.63:0/41004164 >> 172.21.15.63:0/41004164 conn(0x7f242c05f100 msgr2=0x7f242c0b7210 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:42.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.143+0000 7f24337e6700 1 -- 172.21.15.63:0/41004164 shutdown_connections 2020-05-18T21:26:42.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.143+0000 7f24337e6700 1 -- 172.21.15.63:0/41004164 wait complete. 2020-05-18T21:26:42.150 INFO:teuthology.orchestra.run.smithi063.stderr:enabled application 'rbd' on pool 'rbd' 2020-05-18T21:26:42.162 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-05-18T21:26:42.162 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:26:42.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f108aba6700 1 Processor -- start 2020-05-18T21:26:42.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f108aba6700 1 -- start start 2020-05-18T21:26:42.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f108aba6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1084098fb0 0x7f108409d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:42.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f108aba6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108409bd20 0x7f1084145d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:42.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f108aba6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108409c1c0 con 0x7f1084065520 2020-05-18T21:26:42.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f108aba6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f108409c460 con 0x7f1084098fb0 2020-05-18T21:26:42.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f108aba6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108409c700 con 0x7f108409bd20 2020-05-18T21:26:42.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f1089ba4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1084098fb0 0x7f108409d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:42.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f1089ba4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1084098fb0 0x7f108409d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52306/0 (socket says 172.21.15.63:52306) 2020-05-18T21:26:42.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f1089ba4700 1 -- 172.21.15.63:0/3272820586 learned_addr learned my addr 172.21.15.63:0/3272820586 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:42.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f10893a3700 1 --2- 172.21.15.63:0/3272820586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108409bd20 0x7f1084145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:42.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f1089ba4700 1 -- 172.21.15.63:0/3272820586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108409bd20 msgr2=0x7f1084145d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:42.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f1089ba4700 1 --2- 172.21.15.63:0/3272820586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108409bd20 0x7f1084145d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:42.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f1089ba4700 1 -- 172.21.15.63:0/3272820586 >> v1:172.21.15.155:6789/0 conn(0x7f1084065520 legacy=0x7f10840b8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f1089ba4700 1 -- 172.21.15.63:0/3272820586 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1084146170 con 0x7f1084098fb0 2020-05-18T21:26:42.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f10893a3700 1 --2- 172.21.15.63:0/3272820586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108409bd20 0x7f1084145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:26:42.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f1089ba4700 1 --2- 172.21.15.63:0/3272820586 >> v2:172.21.15.63:3300/0 conn(0x7f1084098fb0 0x7f108409d910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1080002f70 tx=0x7f1080007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f1089ba4700 1 --2- 172.21.15.63:0/3272820586 >> v2:172.21.15.63:3300/0 conn(0x7f1084098fb0 0x7f108409d910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1080002f70 tx=0x7f1080007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f1089ba4700 1 --2- 172.21.15.63:0/3272820586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1084098fb0 0x7f108409d910 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f1080002f70 tx=0x7f1080007a80).ready entity=mon.0 client_cookie=5fb4f007c122e315 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:42.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f1089ba4700 1 --2- 172.21.15.63:0/3272820586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1084098fb0 0x7f108409d910 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f1080002f70 tx=0x7f1080007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f1089ba4700 1 --2- 172.21.15.63:0/3272820586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1084098fb0 0x7f108409d910 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f1080002f70 tx=0x7f1080007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f1088ba2700 1 -- 172.21.15.63:0/3272820586 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1080011760 con 0x7f1084098fb0 2020-05-18T21:26:42.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f1089ba4700 1 --2- 172.21.15.63:0/3272820586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1084098fb0 0x7f108409d910 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f1080002f70 tx=0x7f1080007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f1088ba2700 1 -- 172.21.15.63:0/3272820586 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10800118c0 con 0x7f1084098fb0 2020-05-18T21:26:42.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f1088ba2700 1 -- 172.21.15.63:0/3272820586 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1080011ce0 con 0x7f1084098fb0 2020-05-18T21:26:42.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f108aba6700 1 -- 172.21.15.63:0/3272820586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1084098fb0 msgr2=0x7f108409d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f108aba6700 1 --2- 172.21.15.63:0/3272820586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1084098fb0 0x7f108409d910 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f1080002f70 tx=0x7f1080007a80).stop 2020-05-18T21:26:42.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f108aba6700 1 -- 172.21.15.63:0/3272820586 shutdown_connections 2020-05-18T21:26:42.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f108aba6700 1 --2- 172.21.15.63:0/3272820586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108409bd20 0x7f1084145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:42.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f108aba6700 1 --2- 172.21.15.63:0/3272820586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1084098fb0 0x7f108409d910 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:42.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f108aba6700 1 -- 172.21.15.63:0/3272820586 >> 172.21.15.63:0/3272820586 conn(0x7f108405f630 msgr2=0x7f108405a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:42.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f108aba6700 1 -- 172.21.15.63:0/3272820586 shutdown_connections 2020-05-18T21:26:42.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.259+0000 7f108aba6700 1 -- 172.21.15.63:0/3272820586 wait complete. 2020-05-18T21:26:42.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f108aba6700 1 Processor -- start 2020-05-18T21:26:42.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f108aba6700 1 -- start start 2020-05-18T21:26:42.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f108aba6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1084098fb0 0x7f108414bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:42.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f108aba6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f108409bd20 0x7f1084099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:42.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f108aba6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108414c120 con 0x7f1084065520 2020-05-18T21:26:42.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f108aba6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f108409a300 con 0x7f108409bd20 2020-05-18T21:26:42.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f108aba6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1084157cf0 con 0x7f1084098fb0 2020-05-18T21:26:42.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f108a3a5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f108409bd20 0x7f1084099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:42.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f108a3a5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f108409bd20 0x7f1084099ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52316/0 (socket says 172.21.15.63:52316) 2020-05-18T21:26:42.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f108a3a5700 1 -- 172.21.15.63:0/1182393939 learned_addr learned my addr 172.21.15.63:0/1182393939 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:42.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f10893a3700 1 --2- 172.21.15.63:0/1182393939 >> v2:172.21.15.155:3300/0 conn(0x7f1084098fb0 0x7f108414bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:42.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f108a3a5700 1 -- 172.21.15.63:0/1182393939 >> v2:172.21.15.155:3300/0 conn(0x7f1084098fb0 msgr2=0x7f108414bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f108a3a5700 1 --2- 172.21.15.63:0/1182393939 >> v2:172.21.15.155:3300/0 conn(0x7f1084098fb0 0x7f108414bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:42.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f108a3a5700 1 -- 172.21.15.63:0/1182393939 >> v1:172.21.15.155:6789/0 conn(0x7f1084065520 legacy=0x7f1084141780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f108a3a5700 1 -- 172.21.15.63:0/1182393939 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10840b6bd0 con 0x7f108409bd20 2020-05-18T21:26:42.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f10893a3700 1 --2- 172.21.15.63:0/1182393939 >> v2:172.21.15.155:3300/0 conn(0x7f1084098fb0 0x7f108414bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:26:42.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f108a3a5700 1 --2- 172.21.15.63:0/1182393939 >> v2:172.21.15.63:3300/0 conn(0x7f108409bd20 0x7f1084099ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1084060de0 tx=0x7f107c00c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f108a3a5700 1 --2- 172.21.15.63:0/1182393939 >> v2:172.21.15.63:3300/0 conn(0x7f108409bd20 0x7f1084099ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1084060de0 tx=0x7f107c00c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f108a3a5700 1 --2- 172.21.15.63:0/1182393939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108409bd20 0x7f1084099ea0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f1084060de0 tx=0x7f107c00c850).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:42.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f108a3a5700 1 --2- 172.21.15.63:0/1182393939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108409bd20 0x7f1084099ea0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f1084060de0 tx=0x7f107c00c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.263+0000 7f1072ffd700 1 -- 172.21.15.63:0/1182393939 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f107c0101e0 con 0x7f108409bd20 2020-05-18T21:26:42.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.267+0000 7f108a3a5700 1 --2- 172.21.15.63:0/1182393939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108409bd20 0x7f1084099ea0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f1084060de0 tx=0x7f107c00c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.267+0000 7f108a3a5700 1 --2- 172.21.15.63:0/1182393939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108409bd20 0x7f1084099ea0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f1084060de0 tx=0x7f107c00c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.267+0000 7f1072ffd700 1 -- 172.21.15.63:0/1182393939 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107c010340 con 0x7f108409bd20 2020-05-18T21:26:42.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.267+0000 7f108aba6700 1 -- 172.21.15.63:0/1182393939 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1084141e90 con 0x7f108409bd20 2020-05-18T21:26:42.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.267+0000 7f1072ffd700 1 -- 172.21.15.63:0/1182393939 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f107c010760 con 0x7f108409bd20 2020-05-18T21:26:42.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.267+0000 7f108aba6700 1 -- 172.21.15.63:0/1182393939 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10840b8570 con 0x7f108409bd20 2020-05-18T21:26:42.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.267+0000 7f108a3a5700 1 --2- 172.21.15.63:0/1182393939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108409bd20 0x7f1084099ea0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f1084060de0 tx=0x7f107c00c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.267+0000 7f108aba6700 1 -- 172.21.15.63:0/1182393939 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1084157e60 con 0x7f108409bd20 2020-05-18T21:26:42.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.267+0000 7f1072ffd700 1 -- 172.21.15.63:0/1182393939 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f107c0068a0 con 0x7f108409bd20 2020-05-18T21:26:42.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.267+0000 7f108a3a5700 1 --2- 172.21.15.63:0/1182393939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108409bd20 0x7f1084099ea0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f1084060de0 tx=0x7f107c00c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.267+0000 7f1072ffd700 1 --2- 172.21.15.63:0/1182393939 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f106404fa20 0x7f1064051ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:42.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.267+0000 7f1072ffd700 1 -- 172.21.15.63:0/1182393939 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f107c063d40 con 0x7f108409bd20 2020-05-18T21:26:42.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.267+0000 7f1089ba4700 1 --2- 172.21.15.63:0/1182393939 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f106404fa20 0x7f1064051ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:42.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.267+0000 7f1089ba4700 1 --2- 172.21.15.63:0/1182393939 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f106404fa20 0x7f1064051ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f10840b6f50 tx=0x7f1080007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.267+0000 7f1089ba4700 1 --2- 172.21.15.63:0/1182393939 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f106404fa20 0x7f1064051ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f10840b6f50 tx=0x7f1080007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.267+0000 7f1089ba4700 1 --2- 172.21.15.63:0/1182393939 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f106404fa20 0x7f1064051ee0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f10840b6f50 tx=0x7f1080007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:42.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.275+0000 7f108a3a5700 1 --2- 172.21.15.63:0/1182393939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108409bd20 0x7f1084099ea0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f1084060de0 tx=0x7f107c00c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.275+0000 7f1072ffd700 1 -- 172.21.15.63:0/1182393939 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f1084157e60 con 0x7f108409bd20 2020-05-18T21:26:42.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.391+0000 7f108aba6700 1 -- 172.21.15.63:0/1182393939 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1084157e60 con 0x7f108409bd20 2020-05-18T21:26:42.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.391+0000 7f108a3a5700 1 --2- 172.21.15.63:0/1182393939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108409bd20 0x7f1084099ea0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f1084060de0 tx=0x7f107c00c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.391+0000 7f1072ffd700 1 -- 172.21.15.63:0/1182393939 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13242 (secure 0 0 0) 0x7f1084157e60 con 0x7f108409bd20 2020-05-18T21:26:42.396 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:26:42.396 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:26:42.129805+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:26:42.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.395+0000 7f108aba6700 1 -- 172.21.15.63:0/1182393939 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f106404fa20 msgr2=0x7f1064051ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.395+0000 7f108aba6700 1 --2- 172.21.15.63:0/1182393939 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f106404fa20 0x7f1064051ee0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f10840b6f50 tx=0x7f1080007a80).stop 2020-05-18T21:26:42.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.395+0000 7f108aba6700 1 -- 172.21.15.63:0/1182393939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108409bd20 msgr2=0x7f1084099ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.395+0000 7f108aba6700 1 --2- 172.21.15.63:0/1182393939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108409bd20 0x7f1084099ea0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f1084060de0 tx=0x7f107c00c850).stop 2020-05-18T21:26:42.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.395+0000 7f108aba6700 1 -- 172.21.15.63:0/1182393939 shutdown_connections 2020-05-18T21:26:42.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.395+0000 7f108aba6700 1 --2- 172.21.15.63:0/1182393939 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f106404fa20 0x7f1064051ee0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:42.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.395+0000 7f108aba6700 1 --2- 172.21.15.63:0/1182393939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108409bd20 0x7f1084099ea0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:42.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.395+0000 7f108aba6700 1 --2- 172.21.15.63:0/1182393939 >> v2:172.21.15.155:3300/0 conn(0x7f1084098fb0 0x7f108414bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:42.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.395+0000 7f108aba6700 1 -- 172.21.15.63:0/1182393939 >> 172.21.15.63:0/1182393939 conn(0x7f108405f630 msgr2=0x7f10840b5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:42.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.395+0000 7f108aba6700 1 -- 172.21.15.63:0/1182393939 shutdown_connections 2020-05-18T21:26:42.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.395+0000 7f108aba6700 1 -- 172.21.15.63:0/1182393939 wait complete. 2020-05-18T21:26:42.409 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-05-18T21:26:42.410 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:26:42.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.515+0000 7f4213373700 1 Processor -- start 2020-05-18T21:26:42.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.515+0000 7f4213373700 1 -- start start 2020-05-18T21:26:42.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f4213373700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f420c066e80 0x7f420c142330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:42.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f4213373700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c0b4900 con 0x7f420c0b6190 2020-05-18T21:26:42.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f4213373700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c098c80 con 0x7f420c142790 2020-05-18T21:26:42.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f4213373700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420c0b4b30 con 0x7f420c066e80 2020-05-18T21:26:42.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f421110f700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f420c0b6190 0x7f420c0b4fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54508/0 (socket says 172.21.15.63:54508) 2020-05-18T21:26:42.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f421110f700 1 -- 172.21.15.63:0/1723201560 learned_addr learned my addr 172.21.15.63:0/1723201560 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:42.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f421090e700 1 --2- 172.21.15.63:0/1723201560 >> v2:172.21.15.63:3300/0 conn(0x7f420c066e80 0x7f420c142330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:42.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f41fbfff700 1 -- 172.21.15.63:0/1723201560 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562179191 0 0) 0x7f420c0b4900 con 0x7f420c0b6190 2020-05-18T21:26:42.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f41fbfff700 1 -- 172.21.15.63:0/1723201560 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41f4003270 con 0x7f420c0b6190 2020-05-18T21:26:42.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f421090e700 1 -- 172.21.15.63:0/1723201560 >> v1:172.21.15.155:6789/0 conn(0x7f420c142790 legacy=0x7f420c05ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f421090e700 1 -- 172.21.15.63:0/1723201560 >> v1:172.21.15.63:6789/0 conn(0x7f420c0b6190 legacy=0x7f420c0b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f421090e700 1 -- 172.21.15.63:0/1723201560 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c142c20 con 0x7f420c066e80 2020-05-18T21:26:42.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f421090e700 1 --2- 172.21.15.63:0/1723201560 >> v2:172.21.15.63:3300/0 conn(0x7f420c066e80 0x7f420c142330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f41fc002f70 tx=0x7f41fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f421090e700 1 --2- 172.21.15.63:0/1723201560 >> v2:172.21.15.63:3300/0 conn(0x7f420c066e80 0x7f420c142330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f41fc002f70 tx=0x7f41fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f421090e700 1 --2- 172.21.15.63:0/1723201560 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c066e80 0x7f420c142330 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f41fc002f70 tx=0x7f41fc007a80).ready entity=mon.0 client_cookie=6212ffb9125b4352 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:42.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f421090e700 1 --2- 172.21.15.63:0/1723201560 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c066e80 0x7f420c142330 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f41fc002f70 tx=0x7f41fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f41fbfff700 1 -- 172.21.15.63:0/1723201560 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41fc008e80 con 0x7f420c066e80 2020-05-18T21:26:42.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f421090e700 1 --2- 172.21.15.63:0/1723201560 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c066e80 0x7f420c142330 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f41fc002f70 tx=0x7f41fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f421090e700 1 --2- 172.21.15.63:0/1723201560 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c066e80 0x7f420c142330 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f41fc002f70 tx=0x7f41fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f41fbfff700 1 -- 172.21.15.63:0/1723201560 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41fc0115f0 con 0x7f420c066e80 2020-05-18T21:26:42.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f41fbfff700 1 -- 172.21.15.63:0/1723201560 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41fc0119d0 con 0x7f420c066e80 2020-05-18T21:26:42.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f4213373700 1 -- 172.21.15.63:0/1723201560 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c066e80 msgr2=0x7f420c142330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f4213373700 1 --2- 172.21.15.63:0/1723201560 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c066e80 0x7f420c142330 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f41fc002f70 tx=0x7f41fc007a80).stop 2020-05-18T21:26:42.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f4213373700 1 -- 172.21.15.63:0/1723201560 shutdown_connections 2020-05-18T21:26:42.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f4213373700 1 --2- 172.21.15.63:0/1723201560 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c066e80 0x7f420c142330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:42.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f4213373700 1 -- 172.21.15.63:0/1723201560 >> 172.21.15.63:0/1723201560 conn(0x7f420c0b9720 msgr2=0x7f420c0b5740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:42.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f4213373700 1 -- 172.21.15.63:0/1723201560 shutdown_connections 2020-05-18T21:26:42.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.519+0000 7f4213373700 1 -- 172.21.15.63:0/1723201560 wait complete. 2020-05-18T21:26:42.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.523+0000 7f4213373700 1 Processor -- start 2020-05-18T21:26:42.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.523+0000 7f4213373700 1 -- start start 2020-05-18T21:26:42.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.523+0000 7f4213373700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f420c066e80 0x7f420c152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:42.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.523+0000 7f4213373700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f420c0b6190 0x7f420c09a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:42.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.523+0000 7f4213373700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c14f750 con 0x7f420c142790 2020-05-18T21:26:42.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.523+0000 7f4213373700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420c14f9f0 con 0x7f420c0b6190 2020-05-18T21:26:42.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.523+0000 7f4213373700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420c14fc90 con 0x7f420c066e80 2020-05-18T21:26:42.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f421090e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f420c0b6190 0x7f420c09a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:42.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f421110f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f420c066e80 0x7f420c152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:42.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f421090e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f420c0b6190 0x7f420c09a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52328/0 (socket says 172.21.15.63:52328) 2020-05-18T21:26:42.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f421090e700 1 -- 172.21.15.63:0/639666639 learned_addr learned my addr 172.21.15.63:0/639666639 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:42.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f421090e700 1 -- 172.21.15.63:0/639666639 >> v2:172.21.15.155:3300/0 conn(0x7f420c066e80 msgr2=0x7f420c152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f421090e700 1 --2- 172.21.15.63:0/639666639 >> v2:172.21.15.155:3300/0 conn(0x7f420c066e80 0x7f420c152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:42.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f421090e700 1 -- 172.21.15.63:0/639666639 >> v1:172.21.15.155:6789/0 conn(0x7f420c142790 legacy=0x7f420c14ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f421090e700 1 -- 172.21.15.63:0/639666639 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c09cd30 con 0x7f420c0b6190 2020-05-18T21:26:42.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f421090e700 1 --2- 172.21.15.63:0/639666639 >> v2:172.21.15.63:3300/0 conn(0x7f420c0b6190 0x7f420c09a530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41fc002f70 tx=0x7f41fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f421090e700 1 --2- 172.21.15.63:0/639666639 >> v2:172.21.15.63:3300/0 conn(0x7f420c0b6190 0x7f420c09a530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41fc002f70 tx=0x7f41fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f421090e700 1 --2- 172.21.15.63:0/639666639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0b6190 0x7f420c09a530 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f41fc002f70 tx=0x7f41fc007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:42.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f421090e700 1 --2- 172.21.15.63:0/639666639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0b6190 0x7f420c09a530 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f41fc002f70 tx=0x7f41fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f421090e700 1 --2- 172.21.15.63:0/639666639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0b6190 0x7f420c09a530 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f41fc002f70 tx=0x7f41fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f421090e700 1 --2- 172.21.15.63:0/639666639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0b6190 0x7f420c09a530 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f41fc002f70 tx=0x7f41fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f41fa7fc700 1 -- 172.21.15.63:0/639666639 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41fc008740 con 0x7f420c0b6190 2020-05-18T21:26:42.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f41fa7fc700 1 -- 172.21.15.63:0/639666639 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41fc007360 con 0x7f420c0b6190 2020-05-18T21:26:42.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f4213373700 1 -- 172.21.15.63:0/639666639 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420c09cf80 con 0x7f420c0b6190 2020-05-18T21:26:42.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f41fa7fc700 1 -- 172.21.15.63:0/639666639 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41fc007590 con 0x7f420c0b6190 2020-05-18T21:26:42.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f4213373700 1 -- 172.21.15.63:0/639666639 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c09abb0 con 0x7f420c0b6190 2020-05-18T21:26:42.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f421090e700 1 --2- 172.21.15.63:0/639666639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0b6190 0x7f420c09a530 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f41fc002f70 tx=0x7f41fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f4213373700 1 -- 172.21.15.63:0/639666639 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420c0569e0 con 0x7f420c0b6190 2020-05-18T21:26:42.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f41fa7fc700 1 -- 172.21.15.63:0/639666639 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f41fc0058f0 con 0x7f420c0b6190 2020-05-18T21:26:42.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f421090e700 1 --2- 172.21.15.63:0/639666639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0b6190 0x7f420c09a530 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f41fc002f70 tx=0x7f41fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f41fa7fc700 1 --2- 172.21.15.63:0/639666639 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41ec04fa80 0x7f41ec051f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:42.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.527+0000 7f41fa7fc700 1 -- 172.21.15.63:0/639666639 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f41fc064500 con 0x7f420c0b6190 2020-05-18T21:26:42.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.531+0000 7f421110f700 1 --2- 172.21.15.63:0/639666639 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41ec04fa80 0x7f41ec051f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:42.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.531+0000 7f421110f700 1 --2- 172.21.15.63:0/639666639 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41ec04fa80 0x7f41ec051f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4208001110 tx=0x7f4208001d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.531+0000 7f421110f700 1 --2- 172.21.15.63:0/639666639 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41ec04fa80 0x7f41ec051f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4208001110 tx=0x7f4208001d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.531+0000 7f421110f700 1 --2- 172.21.15.63:0/639666639 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41ec04fa80 0x7f41ec051f40 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f4208001110 tx=0x7f4208001d80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:42.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.535+0000 7f421090e700 1 --2- 172.21.15.63:0/639666639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0b6190 0x7f420c09a530 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f41fc002f70 tx=0x7f41fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.535+0000 7f41fa7fc700 1 -- 172.21.15.63:0/639666639 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f41fc03e950 con 0x7f420c0b6190 2020-05-18T21:26:42.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.651+0000 7f4213373700 1 -- 172.21.15.63:0/639666639 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f420c0008d0 con 0x7f420c0b6190 2020-05-18T21:26:42.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.651+0000 7f421090e700 1 --2- 172.21.15.63:0/639666639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0b6190 0x7f420c09a530 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f41fc002f70 tx=0x7f41fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.651+0000 7f41fa7fc700 1 -- 172.21.15.63:0/639666639 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f41fc041f70 con 0x7f420c0b6190 2020-05-18T21:26:42.655 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:26:42.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.651+0000 7f4213373700 1 -- 172.21.15.63:0/639666639 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41ec04fa80 msgr2=0x7f41ec051f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.651+0000 7f4213373700 1 --2- 172.21.15.63:0/639666639 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41ec04fa80 0x7f41ec051f40 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f4208001110 tx=0x7f4208001d80).stop 2020-05-18T21:26:42.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.651+0000 7f4213373700 1 -- 172.21.15.63:0/639666639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0b6190 msgr2=0x7f420c09a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.651+0000 7f4213373700 1 --2- 172.21.15.63:0/639666639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0b6190 0x7f420c09a530 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f41fc002f70 tx=0x7f41fc007a80).stop 2020-05-18T21:26:42.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.651+0000 7f4213373700 1 -- 172.21.15.63:0/639666639 shutdown_connections 2020-05-18T21:26:42.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.651+0000 7f4213373700 1 --2- 172.21.15.63:0/639666639 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41ec04fa80 0x7f41ec051f40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:42.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.651+0000 7f4213373700 1 --2- 172.21.15.63:0/639666639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0b6190 0x7f420c09a530 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:42.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.651+0000 7f4213373700 1 --2- 172.21.15.63:0/639666639 >> v2:172.21.15.155:3300/0 conn(0x7f420c066e80 0x7f420c152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:42.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.651+0000 7f4213373700 1 -- 172.21.15.63:0/639666639 >> 172.21.15.63:0/639666639 conn(0x7f420c0b9720 msgr2=0x7f420c05c280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:42.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.651+0000 7f4213373700 1 -- 172.21.15.63:0/639666639 shutdown_connections 2020-05-18T21:26:42.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.651+0000 7f4213373700 1 -- 172.21.15.63:0/639666639 wait complete. 2020-05-18T21:26:42.667 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:26:42.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.771+0000 7fd89ffff700 1 Processor -- start 2020-05-18T21:26:42.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.771+0000 7fd89ffff700 1 -- start start 2020-05-18T21:26:42.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.771+0000 7fd89ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd8a00b54f0 0x7fd8a00adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:42.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.771+0000 7fd89ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd8a00b0260 0x7fd8a00b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:42.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.771+0000 7fd89ffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a00adf60 con 0x7fd8a0143a70 2020-05-18T21:26:42.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.771+0000 7fd89ffff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a00b4db0 con 0x7fd8a00b0260 2020-05-18T21:26:42.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.771+0000 7fd89ffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a00b5050 con 0x7fd8a00b54f0 2020-05-18T21:26:42.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.771+0000 7fd89f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd8a00b0260 0x7fd8a00b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:42.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.771+0000 7fd89f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd8a00b0260 0x7fd8a00b0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52336/0 (socket says 172.21.15.63:52336) 2020-05-18T21:26:42.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.771+0000 7fd89f7fe700 1 -- 172.21.15.63:0/2917011157 learned_addr learned my addr 172.21.15.63:0/2917011157 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:42.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.771+0000 7fd89effd700 1 --1- 172.21.15.63:0/2917011157 >> v1:172.21.15.63:6789/0 conn(0x7fd8a0143a70 0x7fd8a00ad3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54522/0 (socket says 172.21.15.63:54522) 2020-05-18T21:26:42.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.771+0000 7fd89e7fc700 1 --2- 172.21.15.63:0/2917011157 >> v2:172.21.15.155:3300/0 conn(0x7fd8a00b54f0 0x7fd8a00adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:42.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.771+0000 7fd89f7fe700 1 -- 172.21.15.63:0/2917011157 >> v2:172.21.15.155:3300/0 conn(0x7fd8a00b54f0 msgr2=0x7fd8a00adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:42.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.771+0000 7fd89f7fe700 1 --2- 172.21.15.63:0/2917011157 >> v2:172.21.15.155:3300/0 conn(0x7fd8a00b54f0 0x7fd8a00adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:42.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89f7fe700 1 -- 172.21.15.63:0/2917011157 >> v1:172.21.15.63:6789/0 conn(0x7fd8a0143a70 legacy=0x7fd8a00ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89f7fe700 1 -- 172.21.15.63:0/2917011157 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a00ae400 con 0x7fd8a00b0260 2020-05-18T21:26:42.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89f7fe700 1 --2- 172.21.15.63:0/2917011157 >> v2:172.21.15.63:3300/0 conn(0x7fd8a00b0260 0x7fd8a00b0b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd8980032f0 tx=0x7fd898007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89f7fe700 1 --2- 172.21.15.63:0/2917011157 >> v2:172.21.15.63:3300/0 conn(0x7fd8a00b0260 0x7fd8a00b0b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd8980032f0 tx=0x7fd898007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89f7fe700 1 --2- 172.21.15.63:0/2917011157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a00b0260 0x7fd8a00b0b50 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7fd8980032f0 tx=0x7fd898007e00).ready entity=mon.0 client_cookie=6e73ba9e25f48536 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:42.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89f7fe700 1 --2- 172.21.15.63:0/2917011157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a00b0260 0x7fd8a00b0b50 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fd8980032f0 tx=0x7fd898007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89dffb700 1 -- 172.21.15.63:0/2917011157 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd898011dc0 con 0x7fd8a00b0260 2020-05-18T21:26:42.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89f7fe700 1 --2- 172.21.15.63:0/2917011157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a00b0260 0x7fd8a00b0b50 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fd8980032f0 tx=0x7fd898007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89f7fe700 1 --2- 172.21.15.63:0/2917011157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a00b0260 0x7fd8a00b0b50 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fd8980032f0 tx=0x7fd898007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89dffb700 1 -- 172.21.15.63:0/2917011157 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89800a180 con 0x7fd8a00b0260 2020-05-18T21:26:42.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89dffb700 1 -- 172.21.15.63:0/2917011157 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd89800a5a0 con 0x7fd8a00b0260 2020-05-18T21:26:42.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89ffff700 1 -- 172.21.15.63:0/2917011157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a00b0260 msgr2=0x7fd8a00b0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89ffff700 1 --2- 172.21.15.63:0/2917011157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a00b0260 0x7fd8a00b0b50 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7fd8980032f0 tx=0x7fd898007e00).stop 2020-05-18T21:26:42.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89ffff700 1 -- 172.21.15.63:0/2917011157 shutdown_connections 2020-05-18T21:26:42.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89ffff700 1 --2- 172.21.15.63:0/2917011157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a00b0260 0x7fd8a00b0b50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:42.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89ffff700 1 --2- 172.21.15.63:0/2917011157 >> v2:172.21.15.155:3300/0 conn(0x7fd8a00b54f0 0x7fd8a00adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:42.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89ffff700 1 -- 172.21.15.63:0/2917011157 >> 172.21.15.63:0/2917011157 conn(0x7fd8a005fb90 msgr2=0x7fd8a0069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:42.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89ffff700 1 -- 172.21.15.63:0/2917011157 shutdown_connections 2020-05-18T21:26:42.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89ffff700 1 -- 172.21.15.63:0/2917011157 wait complete. 2020-05-18T21:26:42.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89ffff700 1 Processor -- start 2020-05-18T21:26:42.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89ffff700 1 -- start start 2020-05-18T21:26:42.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8a00b0260 0x7fd8a0061a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:42.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.775+0000 7fd89ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd8a0143a70 0x7fd8a0141b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:42.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89ffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a0141fb0 con 0x7fd8a00b54f0 2020-05-18T21:26:42.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89ffff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a0066130 con 0x7fd8a0143a70 2020-05-18T21:26:42.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89ffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a0065750 con 0x7fd8a00b0260 2020-05-18T21:26:42.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89e7fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd8a00b54f0 0x7fd8a0130bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54530/0 (socket says 172.21.15.63:54530) 2020-05-18T21:26:42.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89e7fc700 1 -- 172.21.15.63:0/3479526986 learned_addr learned my addr 172.21.15.63:0/3479526986 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:42.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89f7fe700 1 --2- 172.21.15.63:0/3479526986 >> v2:172.21.15.63:3300/0 conn(0x7fd8a0143a70 0x7fd8a0141b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:42.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89effd700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8a00b0260 0x7fd8a0061a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:42.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd897fff700 1 -- 172.21.15.63:0/3479526986 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372197001 0 0) 0x7fd8a0141fb0 con 0x7fd8a00b54f0 2020-05-18T21:26:42.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd897fff700 1 -- 172.21.15.63:0/3479526986 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd884002fe0 con 0x7fd8a00b54f0 2020-05-18T21:26:42.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd897fff700 1 -- 172.21.15.63:0/3479526986 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 962095269 0 0) 0x7fd884002fe0 con 0x7fd8a00b54f0 2020-05-18T21:26:42.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89f7fe700 1 -- 172.21.15.63:0/3479526986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8a00b0260 msgr2=0x7fd8a0061a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89f7fe700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8a00b0260 0x7fd8a0061a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:42.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89f7fe700 1 -- 172.21.15.63:0/3479526986 >> v1:172.21.15.63:6789/0 conn(0x7fd8a00b54f0 legacy=0x7fd8a0130bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89f7fe700 1 -- 172.21.15.63:0/3479526986 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a00659f0 con 0x7fd8a0143a70 2020-05-18T21:26:42.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89f7fe700 1 --2- 172.21.15.63:0/3479526986 >> v2:172.21.15.63:3300/0 conn(0x7fd8a0143a70 0x7fd8a0141b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd888008540 tx=0x7fd898007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89f7fe700 1 --2- 172.21.15.63:0/3479526986 >> v2:172.21.15.63:3300/0 conn(0x7fd8a0143a70 0x7fd8a0141b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd888008540 tx=0x7fd898007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89f7fe700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0143a70 0x7fd8a0141b50 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7fd888008540 tx=0x7fd898007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:42.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89f7fe700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0143a70 0x7fd8a0141b50 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fd888008540 tx=0x7fd898007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd897fff700 1 -- 172.21.15.63:0/3479526986 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8880083a0 con 0x7fd8a0143a70 2020-05-18T21:26:42.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89f7fe700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0143a70 0x7fd8a0141b50 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fd888008540 tx=0x7fd898007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89f7fe700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0143a70 0x7fd8a0141b50 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fd888008540 tx=0x7fd898007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd897fff700 1 -- 172.21.15.63:0/3479526986 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89800a660 con 0x7fd8a0143a70 2020-05-18T21:26:42.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd897fff700 1 -- 172.21.15.63:0/3479526986 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd898011ea0 con 0x7fd8a0143a70 2020-05-18T21:26:42.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89ffff700 1 -- 172.21.15.63:0/3479526986 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a0065c90 con 0x7fd8a0143a70 2020-05-18T21:26:42.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89ffff700 1 -- 172.21.15.63:0/3479526986 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a0065040 con 0x7fd8a0143a70 2020-05-18T21:26:42.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89f7fe700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0143a70 0x7fd8a0141b50 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fd888008540 tx=0x7fd898007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89ffff700 1 -- 172.21.15.63:0/3479526986 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a00569e0 con 0x7fd8a0143a70 2020-05-18T21:26:42.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd897fff700 1 -- 172.21.15.63:0/3479526986 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd898005c70 con 0x7fd8a0143a70 2020-05-18T21:26:42.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd89f7fe700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0143a70 0x7fd8a0141b50 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fd888008540 tx=0x7fd898007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd897fff700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd88404fd40 0x7fd884052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:42.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.779+0000 7fd897fff700 1 -- 172.21.15.63:0/3479526986 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd8980642f0 con 0x7fd8a0143a70 2020-05-18T21:26:42.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.783+0000 7fd89effd700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd88404fd40 0x7fd884052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:42.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.783+0000 7fd89effd700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd88404fd40 0x7fd884052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd8a00668b0 tx=0x7fd890001e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.783+0000 7fd89effd700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd88404fd40 0x7fd884052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd8a00668b0 tx=0x7fd890001e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.783+0000 7fd89effd700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd88404fd40 0x7fd884052200 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fd8a00668b0 tx=0x7fd890001e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:42.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.787+0000 7fd89f7fe700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0143a70 0x7fd8a0141b50 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fd888008540 tx=0x7fd898007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.787+0000 7fd897fff700 1 -- 172.21.15.63:0/3479526986 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd89803e7a0 con 0x7fd8a0143a70 2020-05-18T21:26:42.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.903+0000 7fd89ffff700 1 -- 172.21.15.63:0/3479526986 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd8a0066690 con 0x7fd8a0143a70 2020-05-18T21:26:42.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.903+0000 7fd89f7fe700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0143a70 0x7fd8a0141b50 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fd888008540 tx=0x7fd898007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:42.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.903+0000 7fd897fff700 1 -- 172.21.15.63:0/3479526986 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd89800ae60 con 0x7fd8a0143a70 2020-05-18T21:26:42.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.907+0000 7fd89ffff700 1 -- 172.21.15.63:0/3479526986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd88404fd40 msgr2=0x7fd884052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.907+0000 7fd89ffff700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd88404fd40 0x7fd884052200 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fd8a00668b0 tx=0x7fd890001e00).stop 2020-05-18T21:26:42.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.907+0000 7fd89ffff700 1 -- 172.21.15.63:0/3479526986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0143a70 msgr2=0x7fd8a0141b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:42.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.907+0000 7fd89ffff700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0143a70 0x7fd8a0141b50 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7fd888008540 tx=0x7fd898007e00).stop 2020-05-18T21:26:42.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.907+0000 7fd89ffff700 1 -- 172.21.15.63:0/3479526986 shutdown_connections 2020-05-18T21:26:42.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.907+0000 7fd89ffff700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd88404fd40 0x7fd884052200 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:42.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.907+0000 7fd89ffff700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0143a70 0x7fd8a0141b50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:42.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.907+0000 7fd89ffff700 1 --2- 172.21.15.63:0/3479526986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8a00b0260 0x7fd8a0061a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:42.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.907+0000 7fd89ffff700 1 -- 172.21.15.63:0/3479526986 >> 172.21.15.63:0/3479526986 conn(0x7fd8a005fb90 msgr2=0x7fd8a00af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:42.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.907+0000 7fd89ffff700 1 -- 172.21.15.63:0/3479526986 shutdown_connections 2020-05-18T21:26:42.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:42.907+0000 7fd89ffff700 1 -- 172.21.15.63:0/3479526986 wait complete. 2020-05-18T21:26:42.912 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:26:42.920 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-05-18T21:26:43.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.019+0000 7f1f5759e700 1 Processor -- start 2020-05-18T21:26:43.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.019+0000 7f1f5759e700 1 -- start start 2020-05-18T21:26:43.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.019+0000 7f1f5759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1f58064fd0 0x7f1f5814d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:43.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.019+0000 7f1f5759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5814a330 con 0x7f1f580b4760 2020-05-18T21:26:43.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.019+0000 7f1f5759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5814a5d0 con 0x7f1f5805f110 2020-05-18T21:26:43.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.019+0000 7f1f5759e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5814a140 con 0x7f1f58064fd0 2020-05-18T21:26:43.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.019+0000 7f1f56d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1f58064fd0 0x7f1f5814d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:43.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.019+0000 7f1f55d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1f580b4760 0x7f1f580648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54536/0 (socket says 172.21.15.63:54536) 2020-05-18T21:26:43.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.019+0000 7f1f55d9b700 1 -- 172.21.15.63:0/637979273 learned_addr learned my addr 172.21.15.63:0/637979273 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:43.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.019+0000 7f1f5559a700 1 -- 172.21.15.63:0/637979273 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700618399 0 0) 0x7f1f5814a330 con 0x7f1f580b4760 2020-05-18T21:26:43.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.019+0000 7f1f5559a700 1 -- 172.21.15.63:0/637979273 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f38003270 con 0x7f1f580b4760 2020-05-18T21:26:43.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.019+0000 7f1f5559a700 1 -- 172.21.15.63:0/637979273 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522618016 0 0) 0x7f1f5814a5d0 con 0x7f1f5805f110 2020-05-18T21:26:43.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.019+0000 7f1f5559a700 1 -- 172.21.15.63:0/637979273 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f5814a330 con 0x7f1f5805f110 2020-05-18T21:26:43.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.019+0000 7f1f56d9d700 1 -- 172.21.15.63:0/637979273 >> v1:172.21.15.155:6789/0 conn(0x7f1f5805f110 legacy=0x7f1f5814aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:43.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.019+0000 7f1f56d9d700 1 -- 172.21.15.63:0/637979273 >> v1:172.21.15.63:6789/0 conn(0x7f1f580b4760 legacy=0x7f1f580648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:43.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.019+0000 7f1f56d9d700 1 -- 172.21.15.63:0/637979273 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f58063430 con 0x7f1f58064fd0 2020-05-18T21:26:43.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.023+0000 7f1f56d9d700 1 --2- 172.21.15.63:0/637979273 >> v2:172.21.15.63:3300/0 conn(0x7f1f58064fd0 0x7f1f5814d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1f50002f70 tx=0x7f1f50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.023+0000 7f1f56d9d700 1 --2- 172.21.15.63:0/637979273 >> v2:172.21.15.63:3300/0 conn(0x7f1f58064fd0 0x7f1f5814d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1f50002f70 tx=0x7f1f50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.023+0000 7f1f56d9d700 1 --2- 172.21.15.63:0/637979273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f58064fd0 0x7f1f5814d710 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f1f50002f70 tx=0x7f1f50007a80).ready entity=mon.0 client_cookie=f2fd758170690751 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:43.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.023+0000 7f1f56d9d700 1 --2- 172.21.15.63:0/637979273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f58064fd0 0x7f1f5814d710 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f1f50002f70 tx=0x7f1f50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.023+0000 7f1f5559a700 1 -- 172.21.15.63:0/637979273 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f50008e80 con 0x7f1f58064fd0 2020-05-18T21:26:43.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.023+0000 7f1f56d9d700 1 --2- 172.21.15.63:0/637979273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f58064fd0 0x7f1f5814d710 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f1f50002f70 tx=0x7f1f50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.023+0000 7f1f56d9d700 1 --2- 172.21.15.63:0/637979273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f58064fd0 0x7f1f5814d710 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f1f50002f70 tx=0x7f1f50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.023+0000 7f1f5559a700 1 -- 172.21.15.63:0/637979273 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f50011540 con 0x7f1f58064fd0 2020-05-18T21:26:43.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.023+0000 7f1f5559a700 1 -- 172.21.15.63:0/637979273 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f50011920 con 0x7f1f58064fd0 2020-05-18T21:26:43.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.023+0000 7f1f5759e700 1 -- 172.21.15.63:0/637979273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f58064fd0 msgr2=0x7f1f5814d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:43.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.023+0000 7f1f5759e700 1 --2- 172.21.15.63:0/637979273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f58064fd0 0x7f1f5814d710 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f1f50002f70 tx=0x7f1f50007a80).stop 2020-05-18T21:26:43.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.023+0000 7f1f5759e700 1 -- 172.21.15.63:0/637979273 shutdown_connections 2020-05-18T21:26:43.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.023+0000 7f1f5759e700 1 --2- 172.21.15.63:0/637979273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f58064fd0 0x7f1f5814d710 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:43.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.023+0000 7f1f5759e700 1 -- 172.21.15.63:0/637979273 >> 172.21.15.63:0/637979273 conn(0x7f1f58069fc0 msgr2=0x7f1f5806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:43.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.023+0000 7f1f5759e700 1 -- 172.21.15.63:0/637979273 shutdown_connections 2020-05-18T21:26:43.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.023+0000 7f1f5759e700 1 -- 172.21.15.63:0/637979273 wait complete. 2020-05-18T21:26:43.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.023+0000 7f1f5759e700 1 Processor -- start 2020-05-18T21:26:43.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.023+0000 7f1f5759e700 1 -- start start 2020-05-18T21:26:43.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f5759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1f58064fd0 0x7f1f580b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:43.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f5759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f580b4760 0x7f1f5814b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:43.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f5759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f58147ad0 con 0x7f1f5805f110 2020-05-18T21:26:43.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f5659c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1f5805f110 0x7f1f5813eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54542/0 (socket says 172.21.15.63:54542) 2020-05-18T21:26:43.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f5659c700 1 -- 172.21.15.63:0/3377701539 learned_addr learned my addr 172.21.15.63:0/3377701539 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:43.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f5759e700 1 -- 172.21.15.63:0/3377701539 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f58147830 con 0x7f1f58064fd0 2020-05-18T21:26:43.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f5759e700 1 -- 172.21.15.63:0/3377701539 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f58146930 con 0x7f1f580b4760 2020-05-18T21:26:43.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f55d9b700 1 --2- 172.21.15.63:0/3377701539 >> v2:172.21.15.155:3300/0 conn(0x7f1f58064fd0 0x7f1f580b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:43.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f56d9d700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f580b4760 0x7f1f5814b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:43.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f4f7fe700 1 -- 172.21.15.63:0/3377701539 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736088759 0 0) 0x7f1f58147ad0 con 0x7f1f5805f110 2020-05-18T21:26:43.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f4f7fe700 1 -- 172.21.15.63:0/3377701539 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f3c002fe0 con 0x7f1f5805f110 2020-05-18T21:26:43.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f56d9d700 1 -- 172.21.15.63:0/3377701539 >> v2:172.21.15.155:3300/0 conn(0x7f1f58064fd0 msgr2=0x7f1f580b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:43.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f56d9d700 1 --2- 172.21.15.63:0/3377701539 >> v2:172.21.15.155:3300/0 conn(0x7f1f58064fd0 0x7f1f580b6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:43.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f56d9d700 1 -- 172.21.15.63:0/3377701539 >> v1:172.21.15.63:6789/0 conn(0x7f1f5805f110 legacy=0x7f1f5813eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:43.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f4f7fe700 1 -- 172.21.15.63:0/3377701539 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1902407715 0 0) 0x7f1f3c002fe0 con 0x7f1f5805f110 2020-05-18T21:26:43.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f56d9d700 1 -- 172.21.15.63:0/3377701539 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f58146dd0 con 0x7f1f580b4760 2020-05-18T21:26:43.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f55d9b700 1 --2- 172.21.15.63:0/3377701539 >> v2:172.21.15.155:3300/0 conn(0x7f1f58064fd0 0x7f1f580b6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:26:43.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f56d9d700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f580b4760 0x7f1f5814b420 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f48001b60 tx=0x7f1f50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f56d9d700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f580b4760 0x7f1f5814b420 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f48001b60 tx=0x7f1f50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f56d9d700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f580b4760 0x7f1f5814b420 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f1f48001b60 tx=0x7f1f50007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:43.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f56d9d700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f580b4760 0x7f1f5814b420 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f1f48001b60 tx=0x7f1f50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f4f7fe700 1 -- 172.21.15.63:0/3377701539 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f480019c0 con 0x7f1f580b4760 2020-05-18T21:26:43.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f56d9d700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f580b4760 0x7f1f5814b420 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f1f48001b60 tx=0x7f1f50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f4f7fe700 1 -- 172.21.15.63:0/3377701539 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f50011b00 con 0x7f1f580b4760 2020-05-18T21:26:43.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f56d9d700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f580b4760 0x7f1f5814b420 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f1f48001b60 tx=0x7f1f50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f4f7fe700 1 -- 172.21.15.63:0/3377701539 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f50011e60 con 0x7f1f580b4760 2020-05-18T21:26:43.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.027+0000 7f1f5759e700 1 -- 172.21.15.63:0/3377701539 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5813f200 con 0x7f1f580b4760 2020-05-18T21:26:43.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.031+0000 7f1f5759e700 1 -- 172.21.15.63:0/3377701539 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5814c280 con 0x7f1f580b4760 2020-05-18T21:26:43.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.031+0000 7f1f56d9d700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f580b4760 0x7f1f5814b420 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f1f48001b60 tx=0x7f1f50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.031+0000 7f1f5759e700 1 -- 172.21.15.63:0/3377701539 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f580569e0 con 0x7f1f580b4760 2020-05-18T21:26:43.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.031+0000 7f1f4f7fe700 1 -- 172.21.15.63:0/3377701539 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1f50005700 con 0x7f1f580b4760 2020-05-18T21:26:43.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.031+0000 7f1f56d9d700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f580b4760 0x7f1f5814b420 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f1f48001b60 tx=0x7f1f50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.031+0000 7f1f4f7fe700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f3c04fd30 0x7f1f3c0521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:43.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.031+0000 7f1f4f7fe700 1 -- 172.21.15.63:0/3377701539 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1f50063c30 con 0x7f1f580b4760 2020-05-18T21:26:43.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.031+0000 7f1f5659c700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f3c04fd30 0x7f1f3c0521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:43.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.031+0000 7f1f5659c700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f3c04fd30 0x7f1f3c0521f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f48001ba0 tx=0x7f1f480095f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.035+0000 7f1f5659c700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f3c04fd30 0x7f1f3c0521f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f48001ba0 tx=0x7f1f480095f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.035+0000 7f1f5659c700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f3c04fd30 0x7f1f3c0521f0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f1f48001ba0 tx=0x7f1f480095f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:43.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.043+0000 7f1f56d9d700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f580b4760 0x7f1f5814b420 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f1f48001b60 tx=0x7f1f50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.043+0000 7f1f4f7fe700 1 -- 172.21.15.63:0/3377701539 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f1f5003e0e0 con 0x7f1f580b4760 2020-05-18T21:26:43.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.163+0000 7f1f5759e700 1 -- 172.21.15.63:0/3377701539 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1f580625f0 con 0x7f1f580b4760 2020-05-18T21:26:43.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.163+0000 7f1f56d9d700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f580b4760 0x7f1f5814b420 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f1f48001b60 tx=0x7f1f50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.163+0000 7f1f4f7fe700 1 -- 172.21.15.63:0/3377701539 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7f1f50041700 con 0x7f1f580b4760 2020-05-18T21:26:43.167 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:26:43.167 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:26:43.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:26:43.167 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2020-05-18T21:26:43.167 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "device_health_metrics" 2020-05-18T21:26:43.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:26:43.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:26:43.168 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 2, 2020-05-18T21:26:43.168 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "rbd" 2020-05-18T21:26:43.168 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:26:43.169 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:26:43.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.163+0000 7f1f5759e700 1 -- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f3c04fd30 msgr2=0x7f1f3c0521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:43.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.163+0000 7f1f5759e700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f3c04fd30 0x7f1f3c0521f0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f1f48001ba0 tx=0x7f1f480095f0).stop 2020-05-18T21:26:43.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.163+0000 7f1f5759e700 1 -- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f580b4760 msgr2=0x7f1f5814b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:43.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.163+0000 7f1f5759e700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f580b4760 0x7f1f5814b420 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f1f48001b60 tx=0x7f1f50007a80).stop 2020-05-18T21:26:43.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.163+0000 7f1f5759e700 1 -- 172.21.15.63:0/3377701539 shutdown_connections 2020-05-18T21:26:43.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.163+0000 7f1f5759e700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f3c04fd30 0x7f1f3c0521f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:43.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.163+0000 7f1f5759e700 1 --2- 172.21.15.63:0/3377701539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f580b4760 0x7f1f5814b420 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:43.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.163+0000 7f1f5759e700 1 --2- 172.21.15.63:0/3377701539 >> v2:172.21.15.155:3300/0 conn(0x7f1f58064fd0 0x7f1f580b6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:43.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.163+0000 7f1f5759e700 1 -- 172.21.15.63:0/3377701539 >> 172.21.15.63:0/3377701539 conn(0x7f1f58069fc0 msgr2=0x7f1f580b4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:43.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.163+0000 7f1f5759e700 1 -- 172.21.15.63:0/3377701539 shutdown_connections 2020-05-18T21:26:43.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.163+0000 7f1f5759e700 1 -- 172.21.15.63:0/3377701539 wait complete. 2020-05-18T21:26:43.179 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-05-18T21:26:43.179 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-05-18T21:26:43.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78e3f1700 1 Processor -- start 2020-05-18T21:26:43.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78e3f1700 1 -- start start 2020-05-18T21:26:43.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78e3f1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa7880b4f40 0x7fa788061180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:43.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78e3f1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa7880b2eb0 0x7fa7880b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:43.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78e3f1700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78806a7d0 con 0x7fa78806a2c0 2020-05-18T21:26:43.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78e3f1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7880b2a10 con 0x7fa7880b4f40 2020-05-18T21:26:43.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78e3f1700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7880b5320 con 0x7fa7880b2eb0 2020-05-18T21:26:43.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78d3ef700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa7880b4f40 0x7fa788061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:43.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78cbee700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa78806a2c0 0x7fa788132360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54550/0 (socket says 172.21.15.63:54550) 2020-05-18T21:26:43.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78cbee700 1 -- 172.21.15.63:0/1005200885 learned_addr learned my addr 172.21.15.63:0/1005200885 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:43.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78dbf0700 1 --2- 172.21.15.63:0/1005200885 >> v2:172.21.15.155:3300/0 conn(0x7fa7880b2eb0 0x7fa7880b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:43.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa77ffff700 1 -- 172.21.15.63:0/1005200885 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193410712 0 0) 0x7fa78806a7d0 con 0x7fa78806a2c0 2020-05-18T21:26:43.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa77ffff700 1 -- 172.21.15.63:0/1005200885 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa76c003270 con 0x7fa78806a2c0 2020-05-18T21:26:43.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78d3ef700 1 -- 172.21.15.63:0/1005200885 >> v2:172.21.15.155:3300/0 conn(0x7fa7880b2eb0 msgr2=0x7fa7880b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:43.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78d3ef700 1 --2- 172.21.15.63:0/1005200885 >> v2:172.21.15.155:3300/0 conn(0x7fa7880b2eb0 0x7fa7880b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:43.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa77ffff700 1 -- 172.21.15.63:0/1005200885 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 764341476 0 0) 0x7fa76c003270 con 0x7fa78806a2c0 2020-05-18T21:26:43.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78d3ef700 1 -- 172.21.15.63:0/1005200885 >> v1:172.21.15.63:6789/0 conn(0x7fa78806a2c0 legacy=0x7fa788132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:43.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78d3ef700 1 -- 172.21.15.63:0/1005200885 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7881337f0 con 0x7fa7880b4f40 2020-05-18T21:26:43.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78d3ef700 1 --2- 172.21.15.63:0/1005200885 >> v2:172.21.15.63:3300/0 conn(0x7fa7880b4f40 0x7fa788061180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa7780018b0 tx=0x7fa784007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78d3ef700 1 --2- 172.21.15.63:0/1005200885 >> v2:172.21.15.63:3300/0 conn(0x7fa7880b4f40 0x7fa788061180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa7780018b0 tx=0x7fa784007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78d3ef700 1 --2- 172.21.15.63:0/1005200885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7880b4f40 0x7fa788061180 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7fa7780018b0 tx=0x7fa784007a80).ready entity=mon.0 client_cookie=85608e017696254a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:43.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78d3ef700 1 --2- 172.21.15.63:0/1005200885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7880b4f40 0x7fa788061180 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fa7780018b0 tx=0x7fa784007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78d3ef700 1 --2- 172.21.15.63:0/1005200885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7880b4f40 0x7fa788061180 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fa7780018b0 tx=0x7fa784007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa77ffff700 1 -- 172.21.15.63:0/1005200885 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa778001710 con 0x7fa7880b4f40 2020-05-18T21:26:43.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78d3ef700 1 --2- 172.21.15.63:0/1005200885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7880b4f40 0x7fa788061180 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fa7780018b0 tx=0x7fa784007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa77ffff700 1 -- 172.21.15.63:0/1005200885 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa784008b80 con 0x7fa7880b4f40 2020-05-18T21:26:43.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78e3f1700 1 -- 172.21.15.63:0/1005200885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7880b4f40 msgr2=0x7fa788061180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:43.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa77ffff700 1 -- 172.21.15.63:0/1005200885 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7840113d0 con 0x7fa7880b4f40 2020-05-18T21:26:43.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78e3f1700 1 --2- 172.21.15.63:0/1005200885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7880b4f40 0x7fa788061180 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7fa7780018b0 tx=0x7fa784007a80).stop 2020-05-18T21:26:43.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78e3f1700 1 -- 172.21.15.63:0/1005200885 shutdown_connections 2020-05-18T21:26:43.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78e3f1700 1 --2- 172.21.15.63:0/1005200885 >> v2:172.21.15.155:3300/0 conn(0x7fa7880b2eb0 0x7fa7880b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:43.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78e3f1700 1 --2- 172.21.15.63:0/1005200885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7880b4f40 0x7fa788061180 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:43.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78e3f1700 1 -- 172.21.15.63:0/1005200885 >> 172.21.15.63:0/1005200885 conn(0x7fa78805fbd0 msgr2=0x7fa788069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:43.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78e3f1700 1 -- 172.21.15.63:0/1005200885 shutdown_connections 2020-05-18T21:26:43.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.283+0000 7fa78e3f1700 1 -- 172.21.15.63:0/1005200885 wait complete. 2020-05-18T21:26:43.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78e3f1700 1 Processor -- start 2020-05-18T21:26:43.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78e3f1700 1 -- start start 2020-05-18T21:26:43.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78e3f1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7880b2eb0 0x7fa78815ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:43.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78e3f1700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78815b090 con 0x7fa78806a2c0 2020-05-18T21:26:43.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78e3f1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7880ad170 con 0x7fa7880b4f40 2020-05-18T21:26:43.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78e3f1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7880acea0 con 0x7fa7880b2eb0 2020-05-18T21:26:43.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78d3ef700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa78806a2c0 0x7fa7880647b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54556/0 (socket says 172.21.15.63:54556) 2020-05-18T21:26:43.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78d3ef700 1 -- 172.21.15.63:0/102060483 learned_addr learned my addr 172.21.15.63:0/102060483 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:43.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78cbee700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7880b2eb0 0x7fa78815ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:43.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519560816 0 0) 0x7fa78815b090 con 0x7fa78806a2c0 2020-05-18T21:26:43.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa770002fe0 con 0x7fa78806a2c0 2020-05-18T21:26:43.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462689643 0 0) 0x7fa7880ad170 con 0x7fa7880b4f40 2020-05-18T21:26:43.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa78815b090 con 0x7fa7880b4f40 2020-05-18T21:26:43.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4025531837 0 0) 0x7fa770002fe0 con 0x7fa78806a2c0 2020-05-18T21:26:43.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa7880ad170 con 0x7fa78806a2c0 2020-05-18T21:26:43.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fa7840113d0 con 0x7fa78806a2c0 2020-05-18T21:26:43.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7880b2eb0 msgr2=0x7fa78815ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:43.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa77e7fc700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7880b2eb0 0x7fa78815ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:43.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 >> v1:172.21.15.155:6789/0 conn(0x7fa7880b4f40 legacy=0x7fa788064ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:43.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 >> v1:172.21.15.63:6789/0 conn(0x7fa78806a2c0 legacy=0x7fa7880647b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:43.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa77e7fc700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa770004bf0 0x7fa770004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:43.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa77e7fc700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa770003b30 0x7fa770003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:43.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa77e7fc700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa770004410 0x7fa770005730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:43.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7880acea0 con 0x7fa770004410 2020-05-18T21:26:43.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7700048f0 con 0x7fa770003b30 2020-05-18T21:26:43.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa770005b90 con 0x7fa770004bf0 2020-05-18T21:26:43.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78dbf0700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa770004410 0x7fa770005730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:43.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78cbee700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa770003b30 0x7fa770003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:43.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78d3ef700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa770004bf0 0x7fa770004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:43.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78dbf0700 1 -- 172.21.15.63:0/102060483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa770004bf0 msgr2=0x7fa770004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:43.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78dbf0700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa770004bf0 0x7fa770004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:43.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78dbf0700 1 -- 172.21.15.63:0/102060483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa770003b30 msgr2=0x7fa770003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:43.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78dbf0700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa770003b30 0x7fa770003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:43.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78dbf0700 1 -- 172.21.15.63:0/102060483 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7880655d0 con 0x7fa770004410 2020-05-18T21:26:43.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78e3f1700 1 -- 172.21.15.63:0/102060483 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7880ad410 con 0x7fa770004410 2020-05-18T21:26:43.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78cbee700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa770003b30 0x7fa770003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:26:43.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78e3f1700 1 -- 172.21.15.63:0/102060483 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7880afb40 con 0x7fa770004410 2020-05-18T21:26:43.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78dbf0700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa770004410 0x7fa770005730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa780007ce0 tx=0x7fa780011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78dbf0700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa770004410 0x7fa770005730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa780007ce0 tx=0x7fa780011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78dbf0700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa770004410 0x7fa770005730 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7fa780007ce0 tx=0x7fa780011100).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:43.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78dbf0700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa770004410 0x7fa770005730 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fa780007ce0 tx=0x7fa780011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa780005a80 con 0x7fa770004410 2020-05-18T21:26:43.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.287+0000 7fa78dbf0700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa770004410 0x7fa770005730 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fa780007ce0 tx=0x7fa780011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.291+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa780005be0 con 0x7fa770004410 2020-05-18T21:26:43.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.291+0000 7fa78dbf0700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa770004410 0x7fa770005730 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fa780007ce0 tx=0x7fa780011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.291+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa780010180 con 0x7fa770004410 2020-05-18T21:26:43.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.291+0000 7fa78e3f1700 1 -- 172.21.15.63:0/102060483 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7880acfe0 con 0x7fa770004410 2020-05-18T21:26:43.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.291+0000 7fa78dbf0700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa770004410 0x7fa770005730 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fa780007ce0 tx=0x7fa780011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.291+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa7800102e0 con 0x7fa770004410 2020-05-18T21:26:43.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.291+0000 7fa78dbf0700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa770004410 0x7fa770005730 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fa780007ce0 tx=0x7fa780011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.291+0000 7fa77e7fc700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa770058250 0x7fa77005a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:43.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.291+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa780063b90 con 0x7fa770004410 2020-05-18T21:26:43.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.291+0000 7fa78d3ef700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa770058250 0x7fa77005a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:43.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.291+0000 7fa78d3ef700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa770058250 0x7fa77005a710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa784007c50 tx=0x7fa784007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.291+0000 7fa78d3ef700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa770058250 0x7fa77005a710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa784007c50 tx=0x7fa784007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.291+0000 7fa78d3ef700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa770058250 0x7fa77005a710 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7fa784007c50 tx=0x7fa784007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:43.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.299+0000 7fa78dbf0700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa770004410 0x7fa770005730 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fa780007ce0 tx=0x7fa780011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:43.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.299+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa78003df80 con 0x7fa770004410 2020-05-18T21:26:43.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:43.415+0000 7fa78e3f1700 1 -- 172.21.15.63:0/102060483 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fa7880569e0 con 0x7fa770004410 2020-05-18T21:26:44.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.155+0000 7fa78dbf0700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa770004410 0x7fa770005730 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fa780007ce0 tx=0x7fa780011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:44.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.155+0000 7fa77e7fc700 1 -- 172.21.15.63:0/102060483 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v19) v1 ==== 133+0+0 (secure 0 0 0) 0x7fa7800415a0 con 0x7fa770004410 2020-05-18T21:26:44.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.159+0000 7fa78e3f1700 1 -- 172.21.15.63:0/102060483 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa770058250 msgr2=0x7fa77005a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:44.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.159+0000 7fa78e3f1700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa770058250 0x7fa77005a710 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7fa784007c50 tx=0x7fa784007a80).stop 2020-05-18T21:26:44.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.159+0000 7fa78e3f1700 1 -- 172.21.15.63:0/102060483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa770004410 msgr2=0x7fa770005730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:44.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.159+0000 7fa78e3f1700 1 --2- 172.21.15.63:0/102060483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa770004410 0x7fa770005730 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7fa780007ce0 tx=0x7fa780011100).stop 2020-05-18T21:26:44.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.159+0000 7fa78dbf0700 1 -- 172.21.15.63:0/102060483 reap_dead start 2020-05-18T21:26:44.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.159+0000 7fa78dbf0700 1 -- 172.21.15.63:0/102060483 reap_dead start 2020-05-18T21:26:44.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.159+0000 7fa78e3f1700 1 -- 172.21.15.63:0/102060483 shutdown_connections 2020-05-18T21:26:44.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.159+0000 7fa78e3f1700 1 -- 172.21.15.63:0/102060483 >> 172.21.15.63:0/102060483 conn(0x7fa78805fbd0 msgr2=0x7fa788132b10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:44.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.159+0000 7fa78e3f1700 1 -- 172.21.15.63:0/102060483 shutdown_connections 2020-05-18T21:26:44.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.159+0000 7fa78e3f1700 1 -- 172.21.15.63:0/102060483 wait complete. 2020-05-18T21:26:44.170 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2020-05-18T21:26:44.178 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-05-18T21:26:44.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.287+0000 7f0ca33d2700 1 Processor -- start 2020-05-18T21:26:44.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.287+0000 7f0ca33d2700 1 -- start start 2020-05-18T21:26:44.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca33d2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0c9c062820 0x7f0c9c149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:44.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca33d2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c9c146310 0x7f0c9c146780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:44.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca33d2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9c05ef70 con 0x7f0c9c061b90 2020-05-18T21:26:44.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca33d2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9c05f210 con 0x7f0c9c062820 2020-05-18T21:26:44.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca33d2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c05f4b0 con 0x7f0c9c146310 2020-05-18T21:26:44.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca116e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0c9c062820 0x7f0c9c149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:44.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca116e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0c9c062820 0x7f0c9c149fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52382/0 (socket says 172.21.15.63:52382) 2020-05-18T21:26:44.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca116e700 1 -- 172.21.15.63:0/1831085482 learned_addr learned my addr 172.21.15.63:0/1831085482 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:44.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca196f700 1 --2- 172.21.15.63:0/1831085482 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c9c146310 0x7f0c9c146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:44.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca116e700 1 -- 172.21.15.63:0/1831085482 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c9c146310 msgr2=0x7f0c9c146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:44.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca116e700 1 --2- 172.21.15.63:0/1831085482 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c9c146310 0x7f0c9c146780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:44.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca116e700 1 -- 172.21.15.63:0/1831085482 >> v1:172.21.15.155:6789/0 conn(0x7f0c9c061b90 legacy=0x7f0c9c0b9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:44.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca116e700 1 -- 172.21.15.63:0/1831085482 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c14a440 con 0x7f0c9c062820 2020-05-18T21:26:44.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0c8bfff700 1 -- 172.21.15.63:0/1831085482 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248245278 0 0) 0x7f0c9c05ef70 con 0x7f0c9c061b90 2020-05-18T21:26:44.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca116e700 1 --2- 172.21.15.63:0/1831085482 >> v2:172.21.15.63:3300/0 conn(0x7f0c9c062820 0x7f0c9c149fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0c98002f70 tx=0x7f0c98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:44.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca116e700 1 --2- 172.21.15.63:0/1831085482 >> v2:172.21.15.63:3300/0 conn(0x7f0c9c062820 0x7f0c9c149fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0c98002f70 tx=0x7f0c98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:44.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca116e700 1 --2- 172.21.15.63:0/1831085482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c9c062820 0x7f0c9c149fe0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f0c98002f70 tx=0x7f0c98007a80).ready entity=mon.0 client_cookie=c581a4af6ec2c450 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:44.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca116e700 1 --2- 172.21.15.63:0/1831085482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c9c062820 0x7f0c9c149fe0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f0c98002f70 tx=0x7f0c98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:44.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca116e700 1 --2- 172.21.15.63:0/1831085482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c9c062820 0x7f0c9c149fe0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f0c98002f70 tx=0x7f0c98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:44.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0c8bfff700 1 -- 172.21.15.63:0/1831085482 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c980116b0 con 0x7f0c9c062820 2020-05-18T21:26:44.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca116e700 1 --2- 172.21.15.63:0/1831085482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c9c062820 0x7f0c9c149fe0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f0c98002f70 tx=0x7f0c98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:44.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0c8bfff700 1 -- 172.21.15.63:0/1831085482 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c98011810 con 0x7f0c9c062820 2020-05-18T21:26:44.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0c8bfff700 1 -- 172.21.15.63:0/1831085482 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c98011bf0 con 0x7f0c9c062820 2020-05-18T21:26:44.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca33d2700 1 -- 172.21.15.63:0/1831085482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c9c062820 msgr2=0x7f0c9c149fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:44.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca33d2700 1 --2- 172.21.15.63:0/1831085482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c9c062820 0x7f0c9c149fe0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f0c98002f70 tx=0x7f0c98007a80).stop 2020-05-18T21:26:44.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca33d2700 1 -- 172.21.15.63:0/1831085482 shutdown_connections 2020-05-18T21:26:44.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca33d2700 1 --2- 172.21.15.63:0/1831085482 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c9c146310 0x7f0c9c146780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:44.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca33d2700 1 --2- 172.21.15.63:0/1831085482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c9c062820 0x7f0c9c149fe0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:44.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca33d2700 1 -- 172.21.15.63:0/1831085482 >> 172.21.15.63:0/1831085482 conn(0x7f0c9c05b290 msgr2=0x7f0c9c0b96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:44.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca33d2700 1 -- 172.21.15.63:0/1831085482 shutdown_connections 2020-05-18T21:26:44.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.291+0000 7f0ca33d2700 1 -- 172.21.15.63:0/1831085482 wait complete. 2020-05-18T21:26:44.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0ca33d2700 1 Processor -- start 2020-05-18T21:26:44.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0ca33d2700 1 -- start start 2020-05-18T21:26:44.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0ca33d2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0c9c061b90 0x7f0c9c13f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:44.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0ca33d2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c9c146310 0x7f0c9c13abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:44.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0ca33d2700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9c13f690 con 0x7f0c9c062820 2020-05-18T21:26:44.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0ca33d2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9c0b6910 con 0x7f0c9c061b90 2020-05-18T21:26:44.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0ca33d2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c0b6b10 con 0x7f0c9c146310 2020-05-18T21:26:44.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0ca116e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0c9c061b90 0x7f0c9c13f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:44.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0ca096d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0c9c062820 0x7f0c9c0b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54576/0 (socket says 172.21.15.63:54576) 2020-05-18T21:26:44.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0ca096d700 1 -- 172.21.15.63:0/604729620 learned_addr learned my addr 172.21.15.63:0/604729620 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:44.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0ca196f700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c9c146310 0x7f0c9c13abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:44.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0c8a7fc700 1 -- 172.21.15.63:0/604729620 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043203484 0 0) 0x7f0c9c13f690 con 0x7f0c9c062820 2020-05-18T21:26:44.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0c8a7fc700 1 -- 172.21.15.63:0/604729620 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c7c002fe0 con 0x7f0c9c062820 2020-05-18T21:26:44.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0ca116e700 1 -- 172.21.15.63:0/604729620 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c9c146310 msgr2=0x7f0c9c13abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:44.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0ca116e700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c9c146310 0x7f0c9c13abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:44.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0ca116e700 1 -- 172.21.15.63:0/604729620 >> v1:172.21.15.63:6789/0 conn(0x7f0c9c062820 legacy=0x7f0c9c0b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:44.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0ca116e700 1 -- 172.21.15.63:0/604729620 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c0b6db0 con 0x7f0c9c061b90 2020-05-18T21:26:44.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0ca116e700 1 --2- 172.21.15.63:0/604729620 >> v2:172.21.15.63:3300/0 conn(0x7f0c9c061b90 0x7f0c9c13f230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0c98002f70 tx=0x7f0c98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:44.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0ca116e700 1 --2- 172.21.15.63:0/604729620 >> v2:172.21.15.63:3300/0 conn(0x7f0c9c061b90 0x7f0c9c13f230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0c98002f70 tx=0x7f0c98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:44.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.295+0000 7f0ca116e700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c9c061b90 0x7f0c9c13f230 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f0c98002f70 tx=0x7f0c98007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:44.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.299+0000 7f0ca116e700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c9c061b90 0x7f0c9c13f230 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f0c98002f70 tx=0x7f0c98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:44.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.299+0000 7f0c8a7fc700 1 -- 172.21.15.63:0/604729620 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c98011e60 con 0x7f0c9c061b90 2020-05-18T21:26:44.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.299+0000 7f0ca116e700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c9c061b90 0x7f0c9c13f230 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f0c98002f70 tx=0x7f0c98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:44.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.299+0000 7f0ca116e700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c9c061b90 0x7f0c9c13f230 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f0c98002f70 tx=0x7f0c98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:44.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.299+0000 7f0c8a7fc700 1 -- 172.21.15.63:0/604729620 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9800f940 con 0x7f0c9c061b90 2020-05-18T21:26:44.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.299+0000 7f0ca33d2700 1 -- 172.21.15.63:0/604729620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9c0b7050 con 0x7f0c9c061b90 2020-05-18T21:26:44.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.299+0000 7f0c8a7fc700 1 -- 172.21.15.63:0/604729620 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c98011c40 con 0x7f0c9c061b90 2020-05-18T21:26:44.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.299+0000 7f0ca33d2700 1 -- 172.21.15.63:0/604729620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9c13b040 con 0x7f0c9c061b90 2020-05-18T21:26:44.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.299+0000 7f0ca116e700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c9c061b90 0x7f0c9c13f230 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f0c98002f70 tx=0x7f0c98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:44.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.299+0000 7f0ca33d2700 1 -- 172.21.15.63:0/604729620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9c0569e0 con 0x7f0c9c061b90 2020-05-18T21:26:44.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.299+0000 7f0c8a7fc700 1 -- 172.21.15.63:0/604729620 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0c98005700 con 0x7f0c9c061b90 2020-05-18T21:26:44.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.299+0000 7f0ca116e700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c9c061b90 0x7f0c9c13f230 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f0c98002f70 tx=0x7f0c98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:44.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.299+0000 7f0c8a7fc700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0c7c04fdd0 0x7f0c7c052290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:44.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.299+0000 7f0c8a7fc700 1 -- 172.21.15.63:0/604729620 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f0c980641c0 con 0x7f0c9c061b90 2020-05-18T21:26:44.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.299+0000 7f0ca096d700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0c7c04fdd0 0x7f0c7c052290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:44.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.299+0000 7f0ca096d700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0c7c04fdd0 0x7f0c7c052290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0c8c001150 tx=0x7f0c8c0018a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:44.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.299+0000 7f0ca096d700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0c7c04fdd0 0x7f0c7c052290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0c8c001150 tx=0x7f0c8c0018a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:44.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.299+0000 7f0ca096d700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0c7c04fdd0 0x7f0c7c052290 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f0c8c001150 tx=0x7f0c8c0018a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:44.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.303+0000 7f0ca116e700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c9c061b90 0x7f0c9c13f230 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f0c98002f70 tx=0x7f0c98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:44.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.307+0000 7f0c8a7fc700 1 -- 172.21.15.63:0/604729620 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f0c9803e5b0 con 0x7f0c9c061b90 2020-05-18T21:26:44.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:44.427+0000 7f0ca33d2700 1 -- 172.21.15.63:0/604729620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f0c9c0b2e00 con 0x7f0c9c061b90 2020-05-18T21:26:45.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.175+0000 7f0ca116e700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c9c061b90 0x7f0c9c13f230 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f0c98002f70 tx=0x7f0c98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.179+0000 7f0c8a7fc700 1 -- 172.21.15.63:0/604729620 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v20) v1 ==== 125+0+0 (secure 0 0 0) 0x7f0c98041bd0 con 0x7f0c9c061b90 2020-05-18T21:26:45.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.187+0000 7f0ca33d2700 1 -- 172.21.15.63:0/604729620 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0c7c04fdd0 msgr2=0x7f0c7c052290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.187+0000 7f0ca33d2700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0c7c04fdd0 0x7f0c7c052290 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f0c8c001150 tx=0x7f0c8c0018a0).stop 2020-05-18T21:26:45.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.187+0000 7f0ca33d2700 1 -- 172.21.15.63:0/604729620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c9c061b90 msgr2=0x7f0c9c13f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.187+0000 7f0ca33d2700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c9c061b90 0x7f0c9c13f230 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f0c98002f70 tx=0x7f0c98007a80).stop 2020-05-18T21:26:45.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.191+0000 7f0ca33d2700 1 -- 172.21.15.63:0/604729620 shutdown_connections 2020-05-18T21:26:45.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.191+0000 7f0ca33d2700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0c7c04fdd0 0x7f0c7c052290 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:45.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.191+0000 7f0ca33d2700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c9c146310 0x7f0c9c13abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:45.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.191+0000 7f0ca33d2700 1 --2- 172.21.15.63:0/604729620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c9c061b90 0x7f0c9c13f230 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:45.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.191+0000 7f0ca33d2700 1 -- 172.21.15.63:0/604729620 >> 172.21.15.63:0/604729620 conn(0x7f0c9c05b290 msgr2=0x7f0c9c05c220 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:45.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.191+0000 7f0ca33d2700 1 -- 172.21.15.63:0/604729620 shutdown_connections 2020-05-18T21:26:45.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.191+0000 7f0ca33d2700 1 -- 172.21.15.63:0/604729620 wait complete. 2020-05-18T21:26:45.195 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2020-05-18T21:26:45.206 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-05-18T21:26:45.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.311+0000 7f710b4a4700 1 Processor -- start 2020-05-18T21:26:45.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.311+0000 7f710b4a4700 1 -- start start 2020-05-18T21:26:45.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.311+0000 7f710b4a4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f71040986f0 0x7f7104142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:45.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.311+0000 7f710b4a4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f71041462c0 0x7f7104146700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:45.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.311+0000 7f710b4a4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71040b4b90 con 0x7f7104143820 2020-05-18T21:26:45.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.311+0000 7f710b4a4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71040b4980 con 0x7f71041462c0 2020-05-18T21:26:45.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.311+0000 7f710b4a4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71040b4e30 con 0x7f71040986f0 2020-05-18T21:26:45.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710aca3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f71041462c0 0x7f7104146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:45.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710aca3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f71041462c0 0x7f7104146700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52396/0 (socket says 172.21.15.63:52396) 2020-05-18T21:26:45.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710aca3700 1 -- 172.21.15.63:0/3624942681 learned_addr learned my addr 172.21.15.63:0/3624942681 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:45.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f7109ca1700 1 --2- 172.21.15.63:0/3624942681 >> v2:172.21.15.155:3300/0 conn(0x7f71040986f0 0x7f7104142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:45.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710aca3700 1 -- 172.21.15.63:0/3624942681 >> v2:172.21.15.155:3300/0 conn(0x7f71040986f0 msgr2=0x7f7104142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:45.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710aca3700 1 --2- 172.21.15.63:0/3624942681 >> v2:172.21.15.155:3300/0 conn(0x7f71040986f0 0x7f7104142ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:45.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710aca3700 1 -- 172.21.15.63:0/3624942681 >> v1:172.21.15.155:6789/0 conn(0x7f7104143820 legacy=0x7f71040b9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710aca3700 1 -- 172.21.15.63:0/3624942681 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71040b50d0 con 0x7f71041462c0 2020-05-18T21:26:45.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710aca3700 1 --2- 172.21.15.63:0/3624942681 >> v2:172.21.15.63:3300/0 conn(0x7f71041462c0 0x7f7104146700 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f70fc0032f0 tx=0x7f70fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710aca3700 1 --2- 172.21.15.63:0/3624942681 >> v2:172.21.15.63:3300/0 conn(0x7f71041462c0 0x7f7104146700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f70fc0032f0 tx=0x7f70fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710aca3700 1 --2- 172.21.15.63:0/3624942681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71041462c0 0x7f7104146700 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f70fc0032f0 tx=0x7f70fc007e00).ready entity=mon.0 client_cookie=889152cb5762274e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:45.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710aca3700 1 --2- 172.21.15.63:0/3624942681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71041462c0 0x7f7104146700 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f70fc0032f0 tx=0x7f70fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710aca3700 1 --2- 172.21.15.63:0/3624942681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71041462c0 0x7f7104146700 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f70fc0032f0 tx=0x7f70fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f71094a0700 1 -- 172.21.15.63:0/3624942681 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70fc011d10 con 0x7f71041462c0 2020-05-18T21:26:45.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710aca3700 1 --2- 172.21.15.63:0/3624942681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71041462c0 0x7f7104146700 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f70fc0032f0 tx=0x7f70fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f71094a0700 1 -- 172.21.15.63:0/3624942681 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc011e70 con 0x7f71041462c0 2020-05-18T21:26:45.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f71094a0700 1 -- 172.21.15.63:0/3624942681 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70fc00a370 con 0x7f71041462c0 2020-05-18T21:26:45.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710b4a4700 1 -- 172.21.15.63:0/3624942681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71041462c0 msgr2=0x7f7104146700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710b4a4700 1 --2- 172.21.15.63:0/3624942681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71041462c0 0x7f7104146700 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f70fc0032f0 tx=0x7f70fc007e00).stop 2020-05-18T21:26:45.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710b4a4700 1 -- 172.21.15.63:0/3624942681 shutdown_connections 2020-05-18T21:26:45.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710b4a4700 1 --2- 172.21.15.63:0/3624942681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71041462c0 0x7f7104146700 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:45.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710b4a4700 1 --2- 172.21.15.63:0/3624942681 >> v2:172.21.15.155:3300/0 conn(0x7f71040986f0 0x7f7104142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:45.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710b4a4700 1 -- 172.21.15.63:0/3624942681 >> 172.21.15.63:0/3624942681 conn(0x7f710406a640 msgr2=0x7f71040b8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:45.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710b4a4700 1 -- 172.21.15.63:0/3624942681 shutdown_connections 2020-05-18T21:26:45.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.315+0000 7f710b4a4700 1 -- 172.21.15.63:0/3624942681 wait complete. 2020-05-18T21:26:45.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.319+0000 7f710b4a4700 1 Processor -- start 2020-05-18T21:26:45.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.319+0000 7f710b4a4700 1 -- start start 2020-05-18T21:26:45.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.319+0000 7f710b4a4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7104143820 0x7f7104154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:45.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.319+0000 7f710b4a4700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710409e550 con 0x7f71040986f0 2020-05-18T21:26:45.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.319+0000 7f710b4a4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71041551f0 con 0x7f71041462c0 2020-05-18T21:26:45.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.319+0000 7f710b4a4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7104155bd0 con 0x7f7104143820 2020-05-18T21:26:45.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.319+0000 7f710a4a2700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f71040986f0 0x7f710413d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54590/0 (socket says 172.21.15.63:54590) 2020-05-18T21:26:45.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.319+0000 7f710a4a2700 1 -- 172.21.15.63:0/2305093026 learned_addr learned my addr 172.21.15.63:0/2305093026 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:45.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.319+0000 7f7109ca1700 1 --2- 172.21.15.63:0/2305093026 >> v2:172.21.15.63:3300/0 conn(0x7f7104143820 0x7f7104154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:45.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.319+0000 7f7109ca1700 1 -- 172.21.15.63:0/2305093026 >> v1:172.21.15.155:6789/0 conn(0x7f71041462c0 legacy=0x7f71040b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.319+0000 7f7109ca1700 1 -- 172.21.15.63:0/2305093026 >> v1:172.21.15.63:6789/0 conn(0x7f71040986f0 legacy=0x7f710413d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.319+0000 7f70f77fe700 1 -- 172.21.15.63:0/2305093026 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400519468 0 0) 0x7f710409e550 con 0x7f71040986f0 2020-05-18T21:26:45.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.319+0000 7f7109ca1700 1 -- 172.21.15.63:0/2305093026 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7104155490 con 0x7f7104143820 2020-05-18T21:26:45.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.323+0000 7f7109ca1700 1 --2- 172.21.15.63:0/2305093026 >> v2:172.21.15.63:3300/0 conn(0x7f7104143820 0x7f7104154c70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7104151730 tx=0x7f70f8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.323+0000 7f7109ca1700 1 --2- 172.21.15.63:0/2305093026 >> v2:172.21.15.63:3300/0 conn(0x7f7104143820 0x7f7104154c70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7104151730 tx=0x7f70f8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.323+0000 7f7109ca1700 1 --2- 172.21.15.63:0/2305093026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7104143820 0x7f7104154c70 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f7104151730 tx=0x7f70f8010cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:45.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.323+0000 7f7109ca1700 1 --2- 172.21.15.63:0/2305093026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7104143820 0x7f7104154c70 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f7104151730 tx=0x7f70f8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.323+0000 7f70f77fe700 1 -- 172.21.15.63:0/2305093026 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f8007550 con 0x7f7104143820 2020-05-18T21:26:45.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.323+0000 7f7109ca1700 1 --2- 172.21.15.63:0/2305093026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7104143820 0x7f7104154c70 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f7104151730 tx=0x7f70f8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.323+0000 7f7109ca1700 1 --2- 172.21.15.63:0/2305093026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7104143820 0x7f7104154c70 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f7104151730 tx=0x7f70f8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.323+0000 7f70f77fe700 1 -- 172.21.15.63:0/2305093026 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f8012740 con 0x7f7104143820 2020-05-18T21:26:45.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.323+0000 7f710b4a4700 1 -- 172.21.15.63:0/2305093026 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7104155730 con 0x7f7104143820 2020-05-18T21:26:45.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.323+0000 7f70f77fe700 1 -- 172.21.15.63:0/2305093026 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f8012ae0 con 0x7f7104143820 2020-05-18T21:26:45.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.323+0000 7f710b4a4700 1 -- 172.21.15.63:0/2305093026 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71040b1b90 con 0x7f7104143820 2020-05-18T21:26:45.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.323+0000 7f7109ca1700 1 --2- 172.21.15.63:0/2305093026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7104143820 0x7f7104154c70 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f7104151730 tx=0x7f70f8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.323+0000 7f710b4a4700 1 -- 172.21.15.63:0/2305093026 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71040569e0 con 0x7f7104143820 2020-05-18T21:26:45.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.323+0000 7f70f77fe700 1 -- 172.21.15.63:0/2305093026 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f70f8012d50 con 0x7f7104143820 2020-05-18T21:26:45.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.323+0000 7f7109ca1700 1 --2- 172.21.15.63:0/2305093026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7104143820 0x7f7104154c70 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f7104151730 tx=0x7f70f8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.323+0000 7f70f77fe700 1 --2- 172.21.15.63:0/2305093026 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f70e404f8f0 0x7f70e4051db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:45.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.327+0000 7f70f77fe700 1 -- 172.21.15.63:0/2305093026 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f70f80641c0 con 0x7f7104143820 2020-05-18T21:26:45.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.327+0000 7f710a4a2700 1 --2- 172.21.15.63:0/2305093026 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f70e404f8f0 0x7f70e4051db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:45.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.327+0000 7f710a4a2700 1 --2- 172.21.15.63:0/2305093026 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f70e404f8f0 0x7f70e4051db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f71000012a0 tx=0x7f7100001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.327+0000 7f710a4a2700 1 --2- 172.21.15.63:0/2305093026 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f70e404f8f0 0x7f70e4051db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f71000012a0 tx=0x7f7100001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.327+0000 7f710a4a2700 1 --2- 172.21.15.63:0/2305093026 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f70e404f8f0 0x7f70e4051db0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f71000012a0 tx=0x7f7100001820).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:45.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.331+0000 7f7109ca1700 1 --2- 172.21.15.63:0/2305093026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7104143820 0x7f7104154c70 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f7104151730 tx=0x7f70f8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.331+0000 7f70f77fe700 1 -- 172.21.15.63:0/2305093026 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f70f803e4f0 con 0x7f7104143820 2020-05-18T21:26:45.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.487+0000 7f710b4a4700 1 -- 172.21.15.63:0/2305093026 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f7104066470 con 0x7f7104143820 2020-05-18T21:26:45.492 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:26:45.491+0000 7fdb43127700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:26:45.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.495+0000 7f7109ca1700 1 --2- 172.21.15.63:0/2305093026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7104143820 0x7f7104154c70 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f7104151730 tx=0x7f70f8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.495+0000 7f70f77fe700 1 -- 172.21.15.63:0/2305093026 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v2) v1 ==== 187+0+0 (secure 0 0 0) 0x7f70f8041b10 con 0x7f7104143820 2020-05-18T21:26:45.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.499+0000 7f710b4a4700 1 -- 172.21.15.63:0/2305093026 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f70e404f8f0 msgr2=0x7f70e4051db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.499+0000 7f710b4a4700 1 --2- 172.21.15.63:0/2305093026 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f70e404f8f0 0x7f70e4051db0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f71000012a0 tx=0x7f7100001820).stop 2020-05-18T21:26:45.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.499+0000 7f710b4a4700 1 -- 172.21.15.63:0/2305093026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7104143820 msgr2=0x7f7104154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.499+0000 7f710b4a4700 1 --2- 172.21.15.63:0/2305093026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7104143820 0x7f7104154c70 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f7104151730 tx=0x7f70f8010cc0).stop 2020-05-18T21:26:45.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.499+0000 7f710b4a4700 1 -- 172.21.15.63:0/2305093026 shutdown_connections 2020-05-18T21:26:45.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.503+0000 7f710b4a4700 1 --2- 172.21.15.63:0/2305093026 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f70e404f8f0 0x7f70e4051db0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:45.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.503+0000 7f710b4a4700 1 --2- 172.21.15.63:0/2305093026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7104143820 0x7f7104154c70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:45.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.503+0000 7f710b4a4700 1 -- 172.21.15.63:0/2305093026 >> 172.21.15.63:0/2305093026 conn(0x7f710406a640 msgr2=0x7f7104099450 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:45.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.503+0000 7f710b4a4700 1 -- 172.21.15.63:0/2305093026 shutdown_connections 2020-05-18T21:26:45.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.503+0000 7f710b4a4700 1 -- 172.21.15.63:0/2305093026 wait complete. 2020-05-18T21:26:45.507 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 3 and data pool 4 2020-05-18T21:26:45.516 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:26:45.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.611+0000 7f3345ebc700 1 Processor -- start 2020-05-18T21:26:45.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.611+0000 7f3345ebc700 1 -- start start 2020-05-18T21:26:45.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.611+0000 7f3345ebc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3340146be0 0x7f334006a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:45.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.611+0000 7f3345ebc700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33400b8160 con 0x7f3340145e60 2020-05-18T21:26:45.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.611+0000 7f3345ebc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33401462f0 con 0x7f33400b7cc0 2020-05-18T21:26:45.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.611+0000 7f3345ebc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3340061c00 con 0x7f3340146be0 2020-05-18T21:26:45.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.611+0000 7f333ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3340145e60 0x7f3340149670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54602/0 (socket says 172.21.15.63:54602) 2020-05-18T21:26:45.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.611+0000 7f333ffff700 1 -- 172.21.15.63:0/2363158588 learned_addr learned my addr 172.21.15.63:0/2363158588 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:45.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.611+0000 7f333f7fe700 1 --2- 172.21.15.63:0/2363158588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3340146be0 0x7f334006a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:45.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 -- 172.21.15.63:0/2363158588 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508243256 0 0) 0x7f33400b8160 con 0x7f3340145e60 2020-05-18T21:26:45.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 -- 172.21.15.63:0/2363158588 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3320003270 con 0x7f3340145e60 2020-05-18T21:26:45.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 -- 172.21.15.63:0/2363158588 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116050212 0 0) 0x7f33401462f0 con 0x7f33400b7cc0 2020-05-18T21:26:45.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 -- 172.21.15.63:0/2363158588 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33400b8160 con 0x7f33400b7cc0 2020-05-18T21:26:45.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 -- 172.21.15.63:0/2363158588 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1134212202 0 0) 0x7f3320003270 con 0x7f3340145e60 2020-05-18T21:26:45.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 -- 172.21.15.63:0/2363158588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3340146be0 msgr2=0x7f334006a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:45.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 --2- 172.21.15.63:0/2363158588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3340146be0 0x7f334006a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:45.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 -- 172.21.15.63:0/2363158588 >> v1:172.21.15.155:6789/0 conn(0x7f33400b7cc0 legacy=0x7f33400b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 -- 172.21.15.63:0/2363158588 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3340061ea0 con 0x7f3340145e60 2020-05-18T21:26:45.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 -- 172.21.15.63:0/2363158588 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f3338001a90 con 0x7f3340145e60 2020-05-18T21:26:45.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333f7fe700 1 --2- 172.21.15.63:0/2363158588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3340146be0 0x7f334006a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:26:45.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 -- 172.21.15.63:0/2363158588 >> v1:172.21.15.63:6789/0 conn(0x7f3340145e60 legacy=0x7f3340149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 --2- 172.21.15.63:0/2363158588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3340146be0 0x7f3320003920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:45.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 --2- 172.21.15.63:0/2363158588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3320003dd0 0x7f3320004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:45.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 --2- 172.21.15.63:0/2363158588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3320004970 0x7f3320004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:45.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 -- 172.21.15.63:0/2363158588 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3340061c00 con 0x7f3320004970 2020-05-18T21:26:45.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 -- 172.21.15.63:0/2363158588 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33200052b0 con 0x7f3320003dd0 2020-05-18T21:26:45.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 -- 172.21.15.63:0/2363158588 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332000b760 con 0x7f3340146be0 2020-05-18T21:26:45.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333f7fe700 1 --2- 172.21.15.63:0/2363158588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3340146be0 0x7f3320003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:45.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f3336ffd700 1 --2- 172.21.15.63:0/2363158588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3320003dd0 0x7f3320004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:45.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333ffff700 1 --2- 172.21.15.63:0/2363158588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3320004970 0x7f3320004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:45.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333f7fe700 1 -- 172.21.15.63:0/2363158588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3320003dd0 msgr2=0x7f3320004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:45.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333f7fe700 1 --2- 172.21.15.63:0/2363158588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3320003dd0 0x7f3320004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:45.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333f7fe700 1 -- 172.21.15.63:0/2363158588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3320004970 msgr2=0x7f3320004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:45.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333f7fe700 1 --2- 172.21.15.63:0/2363158588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3320004970 0x7f3320004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:45.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333f7fe700 1 -- 172.21.15.63:0/2363158588 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3320003270 con 0x7f3340146be0 2020-05-18T21:26:45.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333f7fe700 1 --2- 172.21.15.63:0/2363158588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3340146be0 0x7f3320003920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3330002f70 tx=0x7f333000bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333f7fe700 1 --2- 172.21.15.63:0/2363158588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3340146be0 0x7f3320003920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3330002f70 tx=0x7f333000bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333f7fe700 1 --2- 172.21.15.63:0/2363158588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3340146be0 0x7f3320003920 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f3330002f70 tx=0x7f333000bf80).ready entity=mon.2 client_cookie=fe6da0bb24f43fd1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:45.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333f7fe700 1 --2- 172.21.15.63:0/2363158588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3340146be0 0x7f3320003920 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f3330002f70 tx=0x7f333000bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 -- 172.21.15.63:0/2363158588 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3330010c80 con 0x7f3340146be0 2020-05-18T21:26:45.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333f7fe700 1 --2- 172.21.15.63:0/2363158588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3340146be0 0x7f3320003920 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f3330002f70 tx=0x7f333000bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333f7fe700 1 --2- 172.21.15.63:0/2363158588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3340146be0 0x7f3320003920 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f3330002f70 tx=0x7f333000bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 -- 172.21.15.63:0/2363158588 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3330010de0 con 0x7f3340146be0 2020-05-18T21:26:45.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333effd700 1 -- 172.21.15.63:0/2363158588 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f333000c680 con 0x7f3340146be0 2020-05-18T21:26:45.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f3345ebc700 1 -- 172.21.15.63:0/2363158588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3340146be0 msgr2=0x7f3320003920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f3345ebc700 1 --2- 172.21.15.63:0/2363158588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3340146be0 0x7f3320003920 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f3330002f70 tx=0x7f333000bf80).stop 2020-05-18T21:26:45.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f333ffff700 1 -- 172.21.15.63:0/2363158588 reap_dead start 2020-05-18T21:26:45.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f3345ebc700 1 -- 172.21.15.63:0/2363158588 shutdown_connections 2020-05-18T21:26:45.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f3345ebc700 1 -- 172.21.15.63:0/2363158588 >> 172.21.15.63:0/2363158588 conn(0x7f334005b240 msgr2=0x7f3340069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:45.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f3345ebc700 1 -- 172.21.15.63:0/2363158588 shutdown_connections 2020-05-18T21:26:45.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.615+0000 7f3345ebc700 1 -- 172.21.15.63:0/2363158588 wait complete. 2020-05-18T21:26:45.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f3345ebc700 1 Processor -- start 2020-05-18T21:26:45.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f3345ebc700 1 -- start start 2020-05-18T21:26:45.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f3345ebc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f334009d2f0 0x7f334009d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:45.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f3345ebc700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f334009e370 con 0x7f33400b1fe0 2020-05-18T21:26:45.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f3345ebc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3340090740 con 0x7f3340090060 2020-05-18T21:26:45.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f3345ebc700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33400b1850 con 0x7f334009d2f0 2020-05-18T21:26:45.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f333ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f334009d2f0 0x7f334009d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:45.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f333ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f334009d2f0 0x7f334009d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52426/0 (socket says 172.21.15.63:52426) 2020-05-18T21:26:45.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f3336ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f33400b1fe0 0x7f334009cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54612/0 (socket says 172.21.15.63:54612) 2020-05-18T21:26:45.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f333ffff700 1 -- 172.21.15.63:0/1686841180 learned_addr learned my addr 172.21.15.63:0/1686841180 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:45.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f333d7fa700 1 -- 172.21.15.63:0/1686841180 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046871423 0 0) 0x7f3340090740 con 0x7f3340090060 2020-05-18T21:26:45.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f333d7fa700 1 -- 172.21.15.63:0/1686841180 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3324002fe0 con 0x7f3340090060 2020-05-18T21:26:45.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f333d7fa700 1 -- 172.21.15.63:0/1686841180 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856816665 0 0) 0x7f334009e370 con 0x7f33400b1fe0 2020-05-18T21:26:45.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f333d7fa700 1 -- 172.21.15.63:0/1686841180 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3340090740 con 0x7f33400b1fe0 2020-05-18T21:26:45.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f333ffff700 1 -- 172.21.15.63:0/1686841180 >> v1:172.21.15.155:6789/0 conn(0x7f3340090060 legacy=0x7f334013af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f333ffff700 1 -- 172.21.15.63:0/1686841180 >> v1:172.21.15.63:6789/0 conn(0x7f33400b1fe0 legacy=0x7f334009cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f333ffff700 1 -- 172.21.15.63:0/1686841180 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33400909e0 con 0x7f334009d2f0 2020-05-18T21:26:45.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f333ffff700 1 --2- 172.21.15.63:0/1686841180 >> v2:172.21.15.63:3300/0 conn(0x7f334009d2f0 0x7f334009d720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f33280011d0 tx=0x7f3340061040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f333ffff700 1 --2- 172.21.15.63:0/1686841180 >> v2:172.21.15.63:3300/0 conn(0x7f334009d2f0 0x7f334009d720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f33280011d0 tx=0x7f3340061040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f333ffff700 1 --2- 172.21.15.63:0/1686841180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334009d2f0 0x7f334009d720 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f33280011d0 tx=0x7f3340061040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:45.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f333ffff700 1 --2- 172.21.15.63:0/1686841180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334009d2f0 0x7f334009d720 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f33280011d0 tx=0x7f3340061040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f333ffff700 1 --2- 172.21.15.63:0/1686841180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334009d2f0 0x7f334009d720 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f33280011d0 tx=0x7f3340061040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f333d7fa700 1 -- 172.21.15.63:0/1686841180 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33380117f0 con 0x7f334009d2f0 2020-05-18T21:26:45.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f333ffff700 1 --2- 172.21.15.63:0/1686841180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334009d2f0 0x7f334009d720 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f33280011d0 tx=0x7f3340061040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f333d7fa700 1 -- 172.21.15.63:0/1686841180 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3338011950 con 0x7f334009d2f0 2020-05-18T21:26:45.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f3345ebc700 1 -- 172.21.15.63:0/1686841180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3340090440 con 0x7f334009d2f0 2020-05-18T21:26:45.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f333d7fa700 1 -- 172.21.15.63:0/1686841180 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3338011cb0 con 0x7f334009d2f0 2020-05-18T21:26:45.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.619+0000 7f3345ebc700 1 -- 172.21.15.63:0/1686841180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f334013b620 con 0x7f334009d2f0 2020-05-18T21:26:45.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.623+0000 7f333ffff700 1 --2- 172.21.15.63:0/1686841180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334009d2f0 0x7f334009d720 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f33280011d0 tx=0x7f3340061040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.623+0000 7f3345ebc700 1 -- 172.21.15.63:0/1686841180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3340090b70 con 0x7f334009d2f0 2020-05-18T21:26:45.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.623+0000 7f333d7fa700 1 -- 172.21.15.63:0/1686841180 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3338004970 con 0x7f334009d2f0 2020-05-18T21:26:45.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.623+0000 7f333ffff700 1 --2- 172.21.15.63:0/1686841180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334009d2f0 0x7f334009d720 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f33280011d0 tx=0x7f3340061040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.623+0000 7f333d7fa700 1 --2- 172.21.15.63:0/1686841180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f332404fe30 0x7f33240522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:45.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.623+0000 7f333d7fa700 1 -- 172.21.15.63:0/1686841180 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3338063560 con 0x7f334009d2f0 2020-05-18T21:26:45.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.623+0000 7f333f7fe700 1 --2- 172.21.15.63:0/1686841180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f332404fe30 0x7f33240522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:45.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.623+0000 7f333f7fe700 1 --2- 172.21.15.63:0/1686841180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f332404fe30 0x7f33240522f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f334009eaa0 tx=0x7f333000bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.623+0000 7f333f7fe700 1 --2- 172.21.15.63:0/1686841180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f332404fe30 0x7f33240522f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f334009eaa0 tx=0x7f333000bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.623+0000 7f333f7fe700 1 --2- 172.21.15.63:0/1686841180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f332404fe30 0x7f33240522f0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f334009eaa0 tx=0x7f333000bf80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:45.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.627+0000 7f333ffff700 1 --2- 172.21.15.63:0/1686841180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334009d2f0 0x7f334009d720 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f33280011d0 tx=0x7f3340061040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.627+0000 7f333d7fa700 1 -- 172.21.15.63:0/1686841180 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f333803d8f0 con 0x7f334009d2f0 2020-05-18T21:26:45.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.747+0000 7f3345ebc700 1 -- 172.21.15.63:0/1686841180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33400569e0 con 0x7f334009d2f0 2020-05-18T21:26:45.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.747+0000 7f333ffff700 1 --2- 172.21.15.63:0/1686841180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334009d2f0 0x7f334009d720 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f33280011d0 tx=0x7f3340061040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.747+0000 7f333d7fa700 1 -- 172.21.15.63:0/1686841180 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16102 (secure 0 0 0) 0x7f3338040f10 con 0x7f334009d2f0 2020-05-18T21:26:45.752 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:26:45.752 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":21,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:26:45.491378+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:26:43.453504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-05-18T21:26:44.456531+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:26:45.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.751+0000 7f3345ebc700 1 -- 172.21.15.63:0/1686841180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f332404fe30 msgr2=0x7f33240522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.751+0000 7f3345ebc700 1 --2- 172.21.15.63:0/1686841180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f332404fe30 0x7f33240522f0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f334009eaa0 tx=0x7f333000bf80).stop 2020-05-18T21:26:45.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.751+0000 7f3345ebc700 1 -- 172.21.15.63:0/1686841180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334009d2f0 msgr2=0x7f334009d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.751+0000 7f3345ebc700 1 --2- 172.21.15.63:0/1686841180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334009d2f0 0x7f334009d720 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f33280011d0 tx=0x7f3340061040).stop 2020-05-18T21:26:45.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.751+0000 7f3345ebc700 1 -- 172.21.15.63:0/1686841180 shutdown_connections 2020-05-18T21:26:45.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.751+0000 7f3345ebc700 1 --2- 172.21.15.63:0/1686841180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f332404fe30 0x7f33240522f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:45.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.751+0000 7f3345ebc700 1 --2- 172.21.15.63:0/1686841180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334009d2f0 0x7f334009d720 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:45.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.751+0000 7f3345ebc700 1 -- 172.21.15.63:0/1686841180 >> 172.21.15.63:0/1686841180 conn(0x7f334005b240 msgr2=0x7f3340148bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:45.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.751+0000 7f3345ebc700 1 -- 172.21.15.63:0/1686841180 shutdown_connections 2020-05-18T21:26:45.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.751+0000 7f3345ebc700 1 -- 172.21.15.63:0/1686841180 wait complete. 2020-05-18T21:26:45.764 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:26:45.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.855+0000 7ff42af22700 1 Processor -- start 2020-05-18T21:26:45.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.855+0000 7ff42af22700 1 -- start start 2020-05-18T21:26:45.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.855+0000 7ff42af22700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff42412efd0 0x7ff42412f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:45.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.855+0000 7ff42af22700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4240af6e0 con 0x7ff4240bbcd0 2020-05-18T21:26:45.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.855+0000 7ff42af22700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4240af980 con 0x7ff4240bb5e0 2020-05-18T21:26:45.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.855+0000 7ff42af22700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4240b0530 con 0x7ff42412efd0 2020-05-18T21:26:45.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.855+0000 7ff4294bf700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff42412efd0 0x7ff42412f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.855+0000 7ff423fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff4240bbcd0 0x7ff4240afe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54618/0 (socket says 172.21.15.63:54618) 2020-05-18T21:26:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.855+0000 7ff423fff700 1 -- 172.21.15.63:0/3068955515 learned_addr learned my addr 172.21.15.63:0/3068955515 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4237fe700 1 -- 172.21.15.63:0/3068955515 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052852974 0 0) 0x7ff4240af6e0 con 0x7ff4240bbcd0 2020-05-18T21:26:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4237fe700 1 -- 172.21.15.63:0/3068955515 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff410003270 con 0x7ff4240bbcd0 2020-05-18T21:26:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4237fe700 1 -- 172.21.15.63:0/3068955515 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2505993254 0 0) 0x7ff410003270 con 0x7ff4240bbcd0 2020-05-18T21:26:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4237fe700 1 -- 172.21.15.63:0/3068955515 >> v2:172.21.15.63:3300/0 conn(0x7ff42412efd0 msgr2=0x7ff42412f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4237fe700 1 --2- 172.21.15.63:0/3068955515 >> v2:172.21.15.63:3300/0 conn(0x7ff42412efd0 0x7ff42412f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4237fe700 1 -- 172.21.15.63:0/3068955515 >> v1:172.21.15.155:6789/0 conn(0x7ff4240bb5e0 legacy=0x7ff4240acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4237fe700 1 -- 172.21.15.63:0/3068955515 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4240bb9c0 con 0x7ff4240bbcd0 2020-05-18T21:26:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4237fe700 1 -- 172.21.15.63:0/3068955515 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7ff418001710 con 0x7ff4240bbcd0 2020-05-18T21:26:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4237fe700 1 -- 172.21.15.63:0/3068955515 >> v1:172.21.15.63:6789/0 conn(0x7ff4240bbcd0 legacy=0x7ff4240afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4237fe700 1 --2- 172.21.15.63:0/3068955515 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff410003760 0x7ff410003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4237fe700 1 --2- 172.21.15.63:0/3068955515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff410004060 0x7ff410004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4237fe700 1 --2- 172.21.15.63:0/3068955515 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff410004aa0 0x7ff410004f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4237fe700 1 -- 172.21.15.63:0/3068955515 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4240b0530 con 0x7ff410004060 2020-05-18T21:26:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4237fe700 1 -- 172.21.15.63:0/3068955515 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41000b870 con 0x7ff410003760 2020-05-18T21:26:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4237fe700 1 -- 172.21.15.63:0/3068955515 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41000ba30 con 0x7ff410004aa0 2020-05-18T21:26:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff423fff700 1 --2- 172.21.15.63:0/3068955515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff410004060 0x7ff410004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff428cbe700 1 --2- 172.21.15.63:0/3068955515 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff410003760 0x7ff410003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:45.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4294bf700 1 --2- 172.21.15.63:0/3068955515 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff410004aa0 0x7ff410004f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:45.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff423fff700 1 -- 172.21.15.63:0/3068955515 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff410004aa0 msgr2=0x7ff410004f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:45.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff423fff700 1 --2- 172.21.15.63:0/3068955515 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff410004aa0 0x7ff410004f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:45.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff423fff700 1 -- 172.21.15.63:0/3068955515 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff410003760 msgr2=0x7ff410003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff423fff700 1 --2- 172.21.15.63:0/3068955515 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff410003760 0x7ff410003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff423fff700 1 -- 172.21.15.63:0/3068955515 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff410003270 con 0x7ff410004060 2020-05-18T21:26:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4294bf700 1 -- 172.21.15.63:0/3068955515 reap_dead start 2020-05-18T21:26:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff428cbe700 1 --2- 172.21.15.63:0/3068955515 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff410003760 0x7ff410003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:26:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff423fff700 1 --2- 172.21.15.63:0/3068955515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff410004060 0x7ff410004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff418001420 tx=0x7ff4240bbb50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff423fff700 1 --2- 172.21.15.63:0/3068955515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff410004060 0x7ff410004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff418001420 tx=0x7ff4240bbb50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff423fff700 1 --2- 172.21.15.63:0/3068955515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff410004060 0x7ff410004530 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7ff418001420 tx=0x7ff4240bbb50).ready entity=mon.0 client_cookie=7d20990bd9bf2a10 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff423fff700 1 --2- 172.21.15.63:0/3068955515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff410004060 0x7ff410004530 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7ff418001420 tx=0x7ff4240bbb50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4237fe700 1 -- 172.21.15.63:0/3068955515 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff41800ce20 con 0x7ff410004060 2020-05-18T21:26:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff423fff700 1 --2- 172.21.15.63:0/3068955515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff410004060 0x7ff410004530 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7ff418001420 tx=0x7ff4240bbb50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4237fe700 1 -- 172.21.15.63:0/3068955515 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41800e370 con 0x7ff410004060 2020-05-18T21:26:45.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff423fff700 1 --2- 172.21.15.63:0/3068955515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff410004060 0x7ff410004530 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7ff418001420 tx=0x7ff4240bbb50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff4237fe700 1 -- 172.21.15.63:0/3068955515 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff41800e710 con 0x7ff410004060 2020-05-18T21:26:45.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff42af22700 1 -- 172.21.15.63:0/3068955515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff410004060 msgr2=0x7ff410004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff42af22700 1 --2- 172.21.15.63:0/3068955515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff410004060 0x7ff410004530 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7ff418001420 tx=0x7ff4240bbb50).stop 2020-05-18T21:26:45.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff42af22700 1 -- 172.21.15.63:0/3068955515 shutdown_connections 2020-05-18T21:26:45.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff42af22700 1 --2- 172.21.15.63:0/3068955515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff410004060 0x7ff410004530 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:45.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff42af22700 1 -- 172.21.15.63:0/3068955515 >> 172.21.15.63:0/3068955515 conn(0x7ff424069b70 msgr2=0x7ff424069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:45.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff42af22700 1 -- 172.21.15.63:0/3068955515 shutdown_connections 2020-05-18T21:26:45.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.859+0000 7ff42af22700 1 -- 172.21.15.63:0/3068955515 wait complete. 2020-05-18T21:26:45.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff42af22700 1 Processor -- start 2020-05-18T21:26:45.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff42af22700 1 -- start start 2020-05-18T21:26:45.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff42af22700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff410004060 0x7ff4240b86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:45.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff42af22700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff4240b5940 0x7ff4240b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:45.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff42af22700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4240b5d60 con 0x7ff4240b4d10 2020-05-18T21:26:45.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff42af22700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4240b51a0 con 0x7ff4240b5940 2020-05-18T21:26:45.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff42af22700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42412db10 con 0x7ff410004060 2020-05-18T21:26:45.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff423fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff4240b4d10 0x7ff4241564f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54632/0 (socket says 172.21.15.63:54632) 2020-05-18T21:26:45.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff4294bf700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff4240b5940 0x7ff4240b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:45.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff423fff700 1 -- 172.21.15.63:0/3011073986 learned_addr learned my addr 172.21.15.63:0/3011073986 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:45.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff428cbe700 1 --2- 172.21.15.63:0/3011073986 >> v2:172.21.15.155:3300/0 conn(0x7ff410004060 0x7ff4240b86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:45.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff421ffb700 1 -- 172.21.15.63:0/3011073986 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629550456 0 0) 0x7ff4240b5d60 con 0x7ff4240b4d10 2020-05-18T21:26:45.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff421ffb700 1 -- 172.21.15.63:0/3011073986 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff404002fe0 con 0x7ff4240b4d10 2020-05-18T21:26:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff421ffb700 1 -- 172.21.15.63:0/3011073986 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3780577642 0 0) 0x7ff404002fe0 con 0x7ff4240b4d10 2020-05-18T21:26:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff428cbe700 1 -- 172.21.15.63:0/3011073986 >> v2:172.21.15.63:3300/0 conn(0x7ff4240b5940 msgr2=0x7ff4240b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff428cbe700 1 --2- 172.21.15.63:0/3011073986 >> v2:172.21.15.63:3300/0 conn(0x7ff4240b5940 0x7ff4240b1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff428cbe700 1 -- 172.21.15.63:0/3011073986 >> v1:172.21.15.63:6789/0 conn(0x7ff4240b4d10 legacy=0x7ff4241564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff428cbe700 1 -- 172.21.15.63:0/3011073986 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4240b7f50 con 0x7ff410004060 2020-05-18T21:26:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff428cbe700 1 --2- 172.21.15.63:0/3011073986 >> v2:172.21.15.155:3300/0 conn(0x7ff410004060 0x7ff4240b86c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff41800ba00 tx=0x7ff41400c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff428cbe700 1 --2- 172.21.15.63:0/3011073986 >> v2:172.21.15.155:3300/0 conn(0x7ff410004060 0x7ff4240b86c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff41800ba00 tx=0x7ff41400c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff428cbe700 1 --2- 172.21.15.63:0/3011073986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff410004060 0x7ff4240b86c0 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7ff41800ba00 tx=0x7ff41400c520).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:45.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff428cbe700 1 --2- 172.21.15.63:0/3011073986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff410004060 0x7ff4240b86c0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7ff41800ba00 tx=0x7ff41400c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff421ffb700 1 -- 172.21.15.63:0/3011073986 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff418000ed0 con 0x7ff410004060 2020-05-18T21:26:45.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff428cbe700 1 --2- 172.21.15.63:0/3011073986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff410004060 0x7ff4240b86c0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7ff41800ba00 tx=0x7ff41400c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff42af22700 1 -- 172.21.15.63:0/3011073986 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4240b81f0 con 0x7ff410004060 2020-05-18T21:26:45.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff421ffb700 1 -- 172.21.15.63:0/3011073986 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41400ca70 con 0x7ff410004060 2020-05-18T21:26:45.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff428cbe700 1 --2- 172.21.15.63:0/3011073986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff410004060 0x7ff4240b86c0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7ff41800ba00 tx=0x7ff41400c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff421ffb700 1 -- 172.21.15.63:0/3011073986 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff41400cdd0 con 0x7ff410004060 2020-05-18T21:26:45.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.863+0000 7ff42af22700 1 -- 172.21.15.63:0/3011073986 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4240b1a60 con 0x7ff410004060 2020-05-18T21:26:45.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.867+0000 7ff428cbe700 1 --2- 172.21.15.63:0/3011073986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff410004060 0x7ff4240b86c0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7ff41800ba00 tx=0x7ff41400c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.867+0000 7ff42af22700 1 -- 172.21.15.63:0/3011073986 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4240b7d90 con 0x7ff410004060 2020-05-18T21:26:45.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.867+0000 7ff421ffb700 1 -- 172.21.15.63:0/3011073986 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff414006520 con 0x7ff410004060 2020-05-18T21:26:45.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.867+0000 7ff428cbe700 1 --2- 172.21.15.63:0/3011073986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff410004060 0x7ff4240b86c0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7ff41800ba00 tx=0x7ff41400c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.867+0000 7ff421ffb700 1 --2- 172.21.15.63:0/3011073986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff40404fca0 0x7ff404052160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:45.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.867+0000 7ff421ffb700 1 -- 172.21.15.63:0/3011073986 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff414063380 con 0x7ff410004060 2020-05-18T21:26:45.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.867+0000 7ff423fff700 1 --2- 172.21.15.63:0/3011073986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff40404fca0 0x7ff404052160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:45.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.867+0000 7ff423fff700 1 --2- 172.21.15.63:0/3011073986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff40404fca0 0x7ff404052160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4180014a0 tx=0x7ff4240bbb50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.867+0000 7ff423fff700 1 --2- 172.21.15.63:0/3011073986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff40404fca0 0x7ff404052160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4180014a0 tx=0x7ff4240bbb50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.867+0000 7ff423fff700 1 --2- 172.21.15.63:0/3011073986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff40404fca0 0x7ff404052160 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7ff4180014a0 tx=0x7ff4240bbb50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:45.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.875+0000 7ff428cbe700 1 --2- 172.21.15.63:0/3011073986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff410004060 0x7ff4240b86c0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7ff41800ba00 tx=0x7ff41400c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.875+0000 7ff421ffb700 1 -- 172.21.15.63:0/3011073986 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff41403d6b0 con 0x7ff410004060 2020-05-18T21:26:45.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.991+0000 7ff42af22700 1 -- 172.21.15.63:0/3011073986 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4240b5ef0 con 0x7ff410004060 2020-05-18T21:26:45.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.995+0000 7ff428cbe700 1 --2- 172.21.15.63:0/3011073986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff410004060 0x7ff4240b86c0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7ff41800ba00 tx=0x7ff41400c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:45.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.995+0000 7ff421ffb700 1 -- 172.21.15.63:0/3011073986 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16102 (secure 0 0 0) 0x7ff414040cd0 con 0x7ff410004060 2020-05-18T21:26:45.998 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:26:45.999 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":21,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:26:45.491378+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:26:43.453504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-05-18T21:26:44.456531+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:26:46.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.999+0000 7ff42af22700 1 -- 172.21.15.63:0/3011073986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff40404fca0 msgr2=0x7ff404052160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:46.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.999+0000 7ff42af22700 1 --2- 172.21.15.63:0/3011073986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff40404fca0 0x7ff404052160 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7ff4180014a0 tx=0x7ff4240bbb50).stop 2020-05-18T21:26:46.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.999+0000 7ff42af22700 1 -- 172.21.15.63:0/3011073986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff410004060 msgr2=0x7ff4240b86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:46.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.999+0000 7ff42af22700 1 --2- 172.21.15.63:0/3011073986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff410004060 0x7ff4240b86c0 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7ff41800ba00 tx=0x7ff41400c520).stop 2020-05-18T21:26:46.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.999+0000 7ff42af22700 1 -- 172.21.15.63:0/3011073986 shutdown_connections 2020-05-18T21:26:46.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.999+0000 7ff42af22700 1 --2- 172.21.15.63:0/3011073986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff40404fca0 0x7ff404052160 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:46.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.999+0000 7ff42af22700 1 --2- 172.21.15.63:0/3011073986 >> v2:172.21.15.63:3300/0 conn(0x7ff4240b5940 0x7ff4240b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:46.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.999+0000 7ff42af22700 1 --2- 172.21.15.63:0/3011073986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff410004060 0x7ff4240b86c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:46.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.999+0000 7ff42af22700 1 -- 172.21.15.63:0/3011073986 >> 172.21.15.63:0/3011073986 conn(0x7ff424069b70 msgr2=0x7ff42412e200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:46.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.999+0000 7ff42af22700 1 -- 172.21.15.63:0/3011073986 shutdown_connections 2020-05-18T21:26:46.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:45.999+0000 7ff42af22700 1 -- 172.21.15.63:0/3011073986 wait complete. 2020-05-18T21:26:46.014 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-05-18T21:26:46.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.123+0000 7efff3fff700 1 Processor -- start 2020-05-18T21:26:46.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.123+0000 7efff3fff700 1 -- start start 2020-05-18T21:26:46.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.123+0000 7efff3fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efff40bc8d0 0x7efff4060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:46.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.123+0000 7efff3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efff4143630 0x7efff412e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:46.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.123+0000 7efff3fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff4146420 con 0x7efff4145e30 2020-05-18T21:26:46.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.123+0000 7efff3fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff4146e00 con 0x7efff4143630 2020-05-18T21:26:46.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.123+0000 7efff3fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff41466c0 con 0x7efff40bc8d0 2020-05-18T21:26:46.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.123+0000 7efff37fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efff4143630 0x7efff412e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:46.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.123+0000 7efff2ffd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efff40bc8d0 0x7efff4060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:46.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.123+0000 7efff37fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efff4143630 0x7efff412e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:39068/0 (socket says 172.21.15.63:39068) 2020-05-18T21:26:46.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.123+0000 7efff27fc700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7efff4145e30 0x7efff4142f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:52956/0 (socket says 172.21.15.63:52956) 2020-05-18T21:26:46.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.123+0000 7efff37fe700 1 -- 172.21.15.63:0/1109420428 learned_addr learned my addr 172.21.15.63:0/1109420428 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:46.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff37fe700 1 -- 172.21.15.63:0/1109420428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efff40bc8d0 msgr2=0x7efff4060b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:46.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff1ffb700 1 -- 172.21.15.63:0/1109420428 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163425885 0 0) 0x7efff4146420 con 0x7efff4145e30 2020-05-18T21:26:46.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff37fe700 1 --2- 172.21.15.63:0/1109420428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efff40bc8d0 0x7efff4060b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:46.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff37fe700 1 -- 172.21.15.63:0/1109420428 >> v1:172.21.15.155:6789/0 conn(0x7efff4145e30 legacy=0x7efff4142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:46.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff37fe700 1 -- 172.21.15.63:0/1109420428 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff4146960 con 0x7efff4143630 2020-05-18T21:26:46.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff2ffd700 1 --2- 172.21.15.63:0/1109420428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efff40bc8d0 0x7efff4060b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:26:46.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff37fe700 1 --2- 172.21.15.63:0/1109420428 >> v2:172.21.15.155:3300/0 conn(0x7efff4143630 0x7efff412e770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7effec0032f0 tx=0x7effec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:46.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff37fe700 1 --2- 172.21.15.63:0/1109420428 >> v2:172.21.15.155:3300/0 conn(0x7efff4143630 0x7efff412e770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7effec0032f0 tx=0x7effec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:46.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff37fe700 1 --2- 172.21.15.63:0/1109420428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efff4143630 0x7efff412e770 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7effec0032f0 tx=0x7effec007e00).ready entity=mon.1 client_cookie=63042034bbadda7c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:46.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff37fe700 1 --2- 172.21.15.63:0/1109420428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efff4143630 0x7efff412e770 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7effec0032f0 tx=0x7effec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:46.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff1ffb700 1 -- 172.21.15.63:0/1109420428 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effec011d10 con 0x7efff4143630 2020-05-18T21:26:46.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff37fe700 1 --2- 172.21.15.63:0/1109420428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efff4143630 0x7efff412e770 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7effec0032f0 tx=0x7effec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:46.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff1ffb700 1 -- 172.21.15.63:0/1109420428 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec011e70 con 0x7efff4143630 2020-05-18T21:26:46.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff37fe700 1 --2- 172.21.15.63:0/1109420428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efff4143630 0x7efff412e770 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7effec0032f0 tx=0x7effec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:46.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff1ffb700 1 -- 172.21.15.63:0/1109420428 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effec00a370 con 0x7efff4143630 2020-05-18T21:26:46.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff3fff700 1 -- 172.21.15.63:0/1109420428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efff4143630 msgr2=0x7efff412e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:46.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff3fff700 1 --2- 172.21.15.63:0/1109420428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efff4143630 0x7efff412e770 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7effec0032f0 tx=0x7effec007e00).stop 2020-05-18T21:26:46.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff3fff700 1 -- 172.21.15.63:0/1109420428 shutdown_connections 2020-05-18T21:26:46.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff3fff700 1 --2- 172.21.15.63:0/1109420428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efff4143630 0x7efff412e770 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:46.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff3fff700 1 --2- 172.21.15.63:0/1109420428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efff40bc8d0 0x7efff4060b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:46.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff3fff700 1 -- 172.21.15.63:0/1109420428 >> 172.21.15.63:0/1109420428 conn(0x7efff405f3b0 msgr2=0x7efff405f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:46.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff3fff700 1 -- 172.21.15.63:0/1109420428 shutdown_connections 2020-05-18T21:26:46.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff3fff700 1 -- 172.21.15.63:0/1109420428 wait complete. 2020-05-18T21:26:46.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff3fff700 1 Processor -- start 2020-05-18T21:26:46.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.127+0000 7efff3fff700 1 -- start start 2020-05-18T21:26:46.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff3fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efff40bc8d0 0x7efff4153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:46.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efff4145e30 0x7efff40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:46.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff3fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff41534b0 con 0x7efff4143630 2020-05-18T21:26:46.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff3fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff40af1d0 con 0x7efff4145e30 2020-05-18T21:26:46.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff3fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff40ae870 con 0x7efff40bc8d0 2020-05-18T21:26:46.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff27fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efff4143630 0x7efff40aeac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54646/0 (socket says 172.21.15.63:54646) 2020-05-18T21:26:46.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff27fc700 1 -- 172.21.15.63:0/1464316919 learned_addr learned my addr 172.21.15.63:0/1464316919 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:46.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff2ffd700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efff40bc8d0 0x7efff4153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:46.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff37fe700 1 --2- 172.21.15.63:0/1464316919 >> v2:172.21.15.155:3300/0 conn(0x7efff4145e30 0x7efff40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:46.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7effebfff700 1 -- 172.21.15.63:0/1464316919 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567467137 0 0) 0x7effe40012f0 con 0x7efff4143630 2020-05-18T21:26:46.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7effebfff700 1 -- 172.21.15.63:0/1464316919 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effd8002fe0 con 0x7efff4143630 2020-05-18T21:26:46.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7effebfff700 1 -- 172.21.15.63:0/1464316919 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2474458823 0 0) 0x7effd8002fe0 con 0x7efff4143630 2020-05-18T21:26:46.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7effebfff700 1 -- 172.21.15.63:0/1464316919 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7effe40012f0 con 0x7efff4143630 2020-05-18T21:26:46.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7effebfff700 1 -- 172.21.15.63:0/1464316919 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7effe4001b80 con 0x7efff4143630 2020-05-18T21:26:46.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7effebfff700 1 -- 172.21.15.63:0/1464316919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efff40bc8d0 msgr2=0x7efff4153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:46.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7effebfff700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efff40bc8d0 0x7efff4153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:46.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7effebfff700 1 -- 172.21.15.63:0/1464316919 >> v2:172.21.15.155:3300/0 conn(0x7efff4145e30 msgr2=0x7efff40ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:46.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7effebfff700 1 --2- 172.21.15.63:0/1464316919 >> v2:172.21.15.155:3300/0 conn(0x7efff4145e30 0x7efff40ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:46.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7effebfff700 1 -- 172.21.15.63:0/1464316919 >> v1:172.21.15.63:6789/0 conn(0x7efff4143630 legacy=0x7efff40aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:46.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7effebfff700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effd8004a80 0x7effd8004e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:46.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7effebfff700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efff40bc8d0 0x7effd80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:46.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7effebfff700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd8003e00 0x7effd8004280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:46.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7effebfff700 1 -- 172.21.15.63:0/1464316919 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff40af1d0 con 0x7effd8003e00 2020-05-18T21:26:46.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7effebfff700 1 -- 172.21.15.63:0/1464316919 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff40ae870 con 0x7effd8004a80 2020-05-18T21:26:46.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7effebfff700 1 -- 172.21.15.63:0/1464316919 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd8005390 con 0x7efff40bc8d0 2020-05-18T21:26:46.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff37fe700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd8003e00 0x7effd8004280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:46.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff2ffd700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effd8004a80 0x7effd8004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:46.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff27fc700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efff40bc8d0 0x7effd80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:46.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff37fe700 1 -- 172.21.15.63:0/1464316919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efff40bc8d0 msgr2=0x7effd80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:46.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff37fe700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efff40bc8d0 0x7effd80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:46.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff37fe700 1 -- 172.21.15.63:0/1464316919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effd8004a80 msgr2=0x7effd8004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:46.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff37fe700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effd8004a80 0x7effd8004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff37fe700 1 -- 172.21.15.63:0/1464316919 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff41478e0 con 0x7effd8003e00 2020-05-18T21:26:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff3fff700 1 -- 172.21.15.63:0/1464316919 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff4147b80 con 0x7effd8003e00 2020-05-18T21:26:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff37fe700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd8003e00 0x7effd8004280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7effec0032f0 tx=0x7effec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff37fe700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd8003e00 0x7effd8004280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7effec0032f0 tx=0x7effec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff3fff700 1 -- 172.21.15.63:0/1464316919 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff4153050 con 0x7effd8003e00 2020-05-18T21:26:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff37fe700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd8003e00 0x7effd8004280 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7effec0032f0 tx=0x7effec007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff37fe700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd8003e00 0x7effd8004280 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7effec0032f0 tx=0x7effec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7effebfff700 1 -- 172.21.15.63:0/1464316919 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effec005a80 con 0x7effd8003e00 2020-05-18T21:26:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff37fe700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd8003e00 0x7effd8004280 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7effec0032f0 tx=0x7effec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7effebfff700 1 -- 172.21.15.63:0/1464316919 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec005be0 con 0x7effd8003e00 2020-05-18T21:26:46.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff37fe700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd8003e00 0x7effd8004280 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7effec0032f0 tx=0x7effec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:46.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7effebfff700 1 -- 172.21.15.63:0/1464316919 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effec007170 con 0x7effd8003e00 2020-05-18T21:26:46.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.131+0000 7efff37fe700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd8003e00 0x7effd8004280 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7effec0032f0 tx=0x7effec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:46.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.135+0000 7efff3fff700 1 -- 172.21.15.63:0/1464316919 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effcc003380 con 0x7effd8003e00 2020-05-18T21:26:46.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.135+0000 7effebfff700 1 -- 172.21.15.63:0/1464316919 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7effec0072d0 con 0x7effd8003e00 2020-05-18T21:26:46.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.135+0000 7efff37fe700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd8003e00 0x7effd8004280 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7effec0032f0 tx=0x7effec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:46.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.135+0000 7effebfff700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7effd8057ae0 0x7effd8059fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:46.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.135+0000 7effebfff700 1 -- 172.21.15.63:0/1464316919 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6073+0+0 (secure 0 0 0) 0x7effec064730 con 0x7effd8003e00 2020-05-18T21:26:46.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.135+0000 7efff2ffd700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7effd8057ae0 0x7effd8059fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:46.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.135+0000 7efff2ffd700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7effd8057ae0 0x7effd8059fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7effdc002f70 tx=0x7effdc002f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:46.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.135+0000 7efff2ffd700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7effd8057ae0 0x7effd8059fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7effdc002f70 tx=0x7effdc002f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:46.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.135+0000 7efff2ffd700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7effd8057ae0 0x7effd8059fa0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7effdc002f70 tx=0x7effdc002f10).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:46.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.139+0000 7efff37fe700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd8003e00 0x7effd8004280 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7effec0032f0 tx=0x7effec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:46.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.139+0000 7effebfff700 1 -- 172.21.15.63:0/1464316919 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7effec03eb20 con 0x7effd8003e00 2020-05-18T21:26:46.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:46.287+0000 7efff3fff700 1 -- 172.21.15.63:0/1464316919 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7effcc002260 con 0x7effd8003e00 2020-05-18T21:26:47.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.131+0000 7efff37fe700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd8003e00 0x7effd8004280 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7effec0032f0 tx=0x7effec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.187+0000 7efff37fe700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd8003e00 0x7effd8004280 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7effec0032f0 tx=0x7effec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.187+0000 7effebfff700 1 -- 172.21.15.63:0/1464316919 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7effec042140 con 0x7effd8003e00 2020-05-18T21:26:47.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.191+0000 7efff3fff700 1 -- 172.21.15.63:0/1464316919 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7effd8057ae0 msgr2=0x7effd8059fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:47.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.191+0000 7efff3fff700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7effd8057ae0 0x7effd8059fa0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7effdc002f70 tx=0x7effdc002f10).stop 2020-05-18T21:26:47.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.191+0000 7efff3fff700 1 -- 172.21.15.63:0/1464316919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd8003e00 msgr2=0x7effd8004280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:47.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.191+0000 7efff3fff700 1 --2- 172.21.15.63:0/1464316919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd8003e00 0x7effd8004280 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7effec0032f0 tx=0x7effec007e00).stop 2020-05-18T21:26:47.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.191+0000 7efff37fe700 1 -- 172.21.15.63:0/1464316919 reap_dead start 2020-05-18T21:26:47.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.191+0000 7efff37fe700 1 -- 172.21.15.63:0/1464316919 reap_dead start 2020-05-18T21:26:47.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.191+0000 7efff3fff700 1 -- 172.21.15.63:0/1464316919 shutdown_connections 2020-05-18T21:26:47.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.191+0000 7efff3fff700 1 -- 172.21.15.63:0/1464316919 >> 172.21.15.63:0/1464316919 conn(0x7efff405f3b0 msgr2=0x7efff40ba650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:47.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.191+0000 7efff3fff700 1 -- 172.21.15.63:0/1464316919 shutdown_connections 2020-05-18T21:26:47.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.191+0000 7efff3fff700 1 -- 172.21.15.63:0/1464316919 wait complete. 2020-05-18T21:26:47.211 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:26:47.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f654ffff700 1 Processor -- start 2020-05-18T21:26:47.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f654ffff700 1 -- start start 2020-05-18T21:26:47.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f654ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f65500b71e0 0x7f6550144520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:47.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f654ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6550147110 0x7f655012cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:47.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f654ffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6550144080 con 0x7f6550063370 2020-05-18T21:26:47.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f654ffff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6550143b10 con 0x7f6550147110 2020-05-18T21:26:47.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f654ffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65500b75c0 con 0x7f65500b71e0 2020-05-18T21:26:47.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f65467fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6550147110 0x7f655012cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:47.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f65467fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6550147110 0x7f655012cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52472/0 (socket says 172.21.15.63:52472) 2020-05-18T21:26:47.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f65467fc700 1 -- 172.21.15.63:0/1352224855 learned_addr learned my addr 172.21.15.63:0/1352224855 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:47.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f654effd700 1 --2- 172.21.15.63:0/1352224855 >> v2:172.21.15.155:3300/0 conn(0x7f65500b71e0 0x7f6550144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:47.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f65467fc700 1 -- 172.21.15.63:0/1352224855 >> v2:172.21.15.155:3300/0 conn(0x7f65500b71e0 msgr2=0x7f6550144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:47.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f65467fc700 1 --2- 172.21.15.63:0/1352224855 >> v2:172.21.15.155:3300/0 conn(0x7f65500b71e0 0x7f6550144520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:47.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f65467fc700 1 -- 172.21.15.63:0/1352224855 >> v1:172.21.15.155:6789/0 conn(0x7f6550063370 legacy=0x7f65500649b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:47.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f65467fc700 1 -- 172.21.15.63:0/1352224855 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6550144980 con 0x7f6550147110 2020-05-18T21:26:47.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f65467fc700 1 --2- 172.21.15.63:0/1352224855 >> v2:172.21.15.63:3300/0 conn(0x7f6550147110 0x7f655012cb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6538002f70 tx=0x7f6538007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f65467fc700 1 --2- 172.21.15.63:0/1352224855 >> v2:172.21.15.63:3300/0 conn(0x7f6550147110 0x7f655012cb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6538002f70 tx=0x7f6538007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f65467fc700 1 --2- 172.21.15.63:0/1352224855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6550147110 0x7f655012cb10 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f6538002f70 tx=0x7f6538007a80).ready entity=mon.0 client_cookie=d759b82ba9312e1b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:47.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f65467fc700 1 --2- 172.21.15.63:0/1352224855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6550147110 0x7f655012cb10 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f6538002f70 tx=0x7f6538007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f654e7fc700 1 -- 172.21.15.63:0/1352224855 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65380116b0 con 0x7f6550147110 2020-05-18T21:26:47.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f65467fc700 1 --2- 172.21.15.63:0/1352224855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6550147110 0x7f655012cb10 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f6538002f70 tx=0x7f6538007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f65467fc700 1 --2- 172.21.15.63:0/1352224855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6550147110 0x7f655012cb10 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f6538002f70 tx=0x7f6538007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f654e7fc700 1 -- 172.21.15.63:0/1352224855 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6538011810 con 0x7f6550147110 2020-05-18T21:26:47.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f654e7fc700 1 -- 172.21.15.63:0/1352224855 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6538011c30 con 0x7f6550147110 2020-05-18T21:26:47.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f654ffff700 1 -- 172.21.15.63:0/1352224855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6550147110 msgr2=0x7f655012cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:47.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f654ffff700 1 --2- 172.21.15.63:0/1352224855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6550147110 0x7f655012cb10 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f6538002f70 tx=0x7f6538007a80).stop 2020-05-18T21:26:47.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f654ffff700 1 -- 172.21.15.63:0/1352224855 shutdown_connections 2020-05-18T21:26:47.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f654ffff700 1 --2- 172.21.15.63:0/1352224855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6550147110 0x7f655012cb10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:47.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.319+0000 7f654ffff700 1 --2- 172.21.15.63:0/1352224855 >> v2:172.21.15.155:3300/0 conn(0x7f65500b71e0 0x7f6550144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:47.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.323+0000 7f654ffff700 1 -- 172.21.15.63:0/1352224855 >> 172.21.15.63:0/1352224855 conn(0x7f655005eee0 msgr2=0x7f655005f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:47.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.323+0000 7f654ffff700 1 -- 172.21.15.63:0/1352224855 shutdown_connections 2020-05-18T21:26:47.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.323+0000 7f654ffff700 1 -- 172.21.15.63:0/1352224855 wait complete. 2020-05-18T21:26:47.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.323+0000 7f654ffff700 1 Processor -- start 2020-05-18T21:26:47.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.323+0000 7f654ffff700 1 -- start start 2020-05-18T21:26:47.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.323+0000 7f654ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6550063370 0x7f6550060f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:47.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.323+0000 7f654ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6550147110 0x7f6550128f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:47.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.323+0000 7f654ffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65501293a0 con 0x7f65500b71e0 2020-05-18T21:26:47.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.323+0000 7f654ffff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6550062030 con 0x7f6550147110 2020-05-18T21:26:47.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.323+0000 7f654ffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65500622d0 con 0x7f6550063370 2020-05-18T21:26:47.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.323+0000 7f654effd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6550063370 0x7f6550060f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:47.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.323+0000 7f654f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6550147110 0x7f6550128f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:47.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.323+0000 7f65467fc700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f65500b71e0 0x7f65500b8370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:52982/0 (socket says 172.21.15.63:52982) 2020-05-18T21:26:47.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.323+0000 7f65467fc700 1 -- 172.21.15.63:0/3621417364 learned_addr learned my addr 172.21.15.63:0/3621417364 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:47.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654cff9700 1 -- 172.21.15.63:0/3621417364 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644843267 0 0) 0x7f65501293a0 con 0x7f65500b71e0 2020-05-18T21:26:47.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654cff9700 1 -- 172.21.15.63:0/3621417364 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6534002fe0 con 0x7f65500b71e0 2020-05-18T21:26:47.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654f7fe700 1 -- 172.21.15.63:0/3621417364 >> v2:172.21.15.155:3300/0 conn(0x7f6550063370 msgr2=0x7f6550060f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:47.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654f7fe700 1 --2- 172.21.15.63:0/3621417364 >> v2:172.21.15.155:3300/0 conn(0x7f6550063370 0x7f6550060f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:47.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654f7fe700 1 -- 172.21.15.63:0/3621417364 >> v1:172.21.15.155:6789/0 conn(0x7f65500b71e0 legacy=0x7f65500b8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:47.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654f7fe700 1 -- 172.21.15.63:0/3621417364 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65500b0980 con 0x7f6550147110 2020-05-18T21:26:47.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654f7fe700 1 --2- 172.21.15.63:0/3621417364 >> v2:172.21.15.63:3300/0 conn(0x7f6550147110 0x7f6550128f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f65500b4b40 tx=0x7f6548010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654f7fe700 1 --2- 172.21.15.63:0/3621417364 >> v2:172.21.15.63:3300/0 conn(0x7f6550147110 0x7f6550128f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f65500b4b40 tx=0x7f6548010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654f7fe700 1 --2- 172.21.15.63:0/3621417364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6550147110 0x7f6550128f40 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f65500b4b40 tx=0x7f6548010be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:47.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654f7fe700 1 --2- 172.21.15.63:0/3621417364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6550147110 0x7f6550128f40 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f65500b4b40 tx=0x7f6548010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654f7fe700 1 --2- 172.21.15.63:0/3621417364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6550147110 0x7f6550128f40 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f65500b4b40 tx=0x7f6548010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654cff9700 1 -- 172.21.15.63:0/3621417364 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6548002280 con 0x7f6550147110 2020-05-18T21:26:47.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654f7fe700 1 --2- 172.21.15.63:0/3621417364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6550147110 0x7f6550128f40 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f65500b4b40 tx=0x7f6548010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654cff9700 1 -- 172.21.15.63:0/3621417364 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65480023e0 con 0x7f6550147110 2020-05-18T21:26:47.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654ffff700 1 -- 172.21.15.63:0/3621417364 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65500618b0 con 0x7f6550147110 2020-05-18T21:26:47.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654cff9700 1 -- 172.21.15.63:0/3621417364 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6548002800 con 0x7f6550147110 2020-05-18T21:26:47.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654ffff700 1 -- 172.21.15.63:0/3621417364 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6550061de0 con 0x7f6550147110 2020-05-18T21:26:47.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654f7fe700 1 --2- 172.21.15.63:0/3621417364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6550147110 0x7f6550128f40 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f65500b4b40 tx=0x7f6548010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654ffff700 1 -- 172.21.15.63:0/3621417364 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65500569e0 con 0x7f6550147110 2020-05-18T21:26:47.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654cff9700 1 -- 172.21.15.63:0/3621417364 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6548002a70 con 0x7f6550147110 2020-05-18T21:26:47.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654f7fe700 1 --2- 172.21.15.63:0/3621417364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6550147110 0x7f6550128f40 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f65500b4b40 tx=0x7f6548010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.327+0000 7f654cff9700 1 --2- 172.21.15.63:0/3621417364 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f653404fd90 0x7f6534052250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:47.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.331+0000 7f654cff9700 1 -- 172.21.15.63:0/3621417364 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6548064090 con 0x7f6550147110 2020-05-18T21:26:47.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.331+0000 7f654effd700 1 --2- 172.21.15.63:0/3621417364 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f653404fd90 0x7f6534052250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:47.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.331+0000 7f654effd700 1 --2- 172.21.15.63:0/3621417364 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f653404fd90 0x7f6534052250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6540002f70 tx=0x7f6550066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.331+0000 7f654effd700 1 --2- 172.21.15.63:0/3621417364 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f653404fd90 0x7f6534052250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6540002f70 tx=0x7f6550066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.331+0000 7f654effd700 1 --2- 172.21.15.63:0/3621417364 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f653404fd90 0x7f6534052250 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f6540002f70 tx=0x7f6550066620).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:47.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.335+0000 7f654f7fe700 1 --2- 172.21.15.63:0/3621417364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6550147110 0x7f6550128f40 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f65500b4b40 tx=0x7f6548010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.335+0000 7f654cff9700 1 -- 172.21.15.63:0/3621417364 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f654803e3c0 con 0x7f6550147110 2020-05-18T21:26:47.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.491+0000 7f654ffff700 1 -- 172.21.15.63:0/3621417364 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6550127a50 con 0x7f6550147110 2020-05-18T21:26:47.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.491+0000 7f654f7fe700 1 --2- 172.21.15.63:0/3621417364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6550147110 0x7f6550128f40 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f65500b4b40 tx=0x7f6548010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.491+0000 7f654cff9700 1 -- 172.21.15.63:0/3621417364 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1420 (secure 0 0 0) 0x7f65480419e0 con 0x7f6550147110 2020-05-18T21:26:47.495 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:26:47.495 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:26:45.491730+0000","modified":"2020-05-18T21:26:47.178838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-05-18T21:26:47.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.491+0000 7f654ffff700 1 -- 172.21.15.63:0/3621417364 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f653404fd90 msgr2=0x7f6534052250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:47.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.491+0000 7f654ffff700 1 --2- 172.21.15.63:0/3621417364 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f653404fd90 0x7f6534052250 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f6540002f70 tx=0x7f6550066620).stop 2020-05-18T21:26:47.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.491+0000 7f654ffff700 1 -- 172.21.15.63:0/3621417364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6550147110 msgr2=0x7f6550128f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:47.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.491+0000 7f654ffff700 1 --2- 172.21.15.63:0/3621417364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6550147110 0x7f6550128f40 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f65500b4b40 tx=0x7f6548010be0).stop 2020-05-18T21:26:47.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.491+0000 7f654ffff700 1 -- 172.21.15.63:0/3621417364 shutdown_connections 2020-05-18T21:26:47.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.491+0000 7f654ffff700 1 --2- 172.21.15.63:0/3621417364 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f653404fd90 0x7f6534052250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:47.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.491+0000 7f654ffff700 1 --2- 172.21.15.63:0/3621417364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6550147110 0x7f6550128f40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:47.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.491+0000 7f654ffff700 1 --2- 172.21.15.63:0/3621417364 >> v2:172.21.15.155:3300/0 conn(0x7f6550063370 0x7f6550060f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:47.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.491+0000 7f654ffff700 1 -- 172.21.15.63:0/3621417364 >> 172.21.15.63:0/3621417364 conn(0x7f655005eee0 msgr2=0x7f6550145990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:47.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.491+0000 7f654ffff700 1 -- 172.21.15.63:0/3621417364 shutdown_connections 2020-05-18T21:26:47.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.495+0000 7f654ffff700 1 -- 172.21.15.63:0/3621417364 wait complete. 2020-05-18T21:26:47.499 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 3 2020-05-18T21:26:47.507 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:26:47.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.595+0000 7f83fa2c3700 1 Processor -- start 2020-05-18T21:26:47.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.595+0000 7f83fa2c3700 1 -- start start 2020-05-18T21:26:47.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.595+0000 7f83fa2c3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f83f405f110 0x7f83f40b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:47.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.595+0000 7f83fa2c3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f414aa70 0x7f83f40648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:47.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.595+0000 7f83fa2c3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f414a330 con 0x7f83f4064d20 2020-05-18T21:26:47.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.595+0000 7f83fa2c3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f414a140 con 0x7f83f405f110 2020-05-18T21:26:47.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.595+0000 7f83fa2c3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f414a5d0 con 0x7f83f414aa70 2020-05-18T21:26:47.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83f8ac0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f414aa70 0x7f83f40648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:47.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83f8ac0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f414aa70 0x7f83f40648c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:43186/0 (socket says 172.21.15.63:43186) 2020-05-18T21:26:47.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83f8ac0700 1 -- 172.21.15.63:0/253487140 learned_addr learned my addr 172.21.15.63:0/253487140 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:47.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83f92c1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f83f405f110 0x7f83f40b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:47.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83f8ac0700 1 -- 172.21.15.63:0/253487140 >> v2:172.21.15.155:3300/0 conn(0x7f83f405f110 msgr2=0x7f83f40b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:47.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83f8ac0700 1 --2- 172.21.15.63:0/253487140 >> v2:172.21.15.155:3300/0 conn(0x7f83f405f110 0x7f83f40b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:47.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83f8ac0700 1 -- 172.21.15.63:0/253487140 >> v1:172.21.15.155:6789/0 conn(0x7f83f4064d20 legacy=0x7f83f414d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:47.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83f8ac0700 1 -- 172.21.15.63:0/253487140 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4063430 con 0x7f83f414aa70 2020-05-18T21:26:47.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83f92c1700 1 --2- 172.21.15.63:0/253487140 >> v2:172.21.15.155:3300/0 conn(0x7f83f405f110 0x7f83f40b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:26:47.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83f8ac0700 1 --2- 172.21.15.63:0/253487140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f414aa70 0x7f83f40648c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f83f4063c70 tx=0x7f83f0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83f8ac0700 1 --2- 172.21.15.63:0/253487140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f414aa70 0x7f83f40648c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f83f4063c70 tx=0x7f83f0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83f8ac0700 1 --2- 172.21.15.63:0/253487140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f414aa70 0x7f83f40648c0 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f83f4063c70 tx=0x7f83f0008ca0).ready entity=mon.2 client_cookie=f9fbf7bd329f67d6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:47.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83f8ac0700 1 --2- 172.21.15.63:0/253487140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f414aa70 0x7f83f40648c0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f83f4063c70 tx=0x7f83f0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83ebfff700 1 -- 172.21.15.63:0/253487140 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83f0011d10 con 0x7f83f414aa70 2020-05-18T21:26:47.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83f8ac0700 1 --2- 172.21.15.63:0/253487140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f414aa70 0x7f83f40648c0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f83f4063c70 tx=0x7f83f0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83ebfff700 1 -- 172.21.15.63:0/253487140 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f0011e70 con 0x7f83f414aa70 2020-05-18T21:26:47.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83f8ac0700 1 --2- 172.21.15.63:0/253487140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f414aa70 0x7f83f40648c0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f83f4063c70 tx=0x7f83f0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83ebfff700 1 -- 172.21.15.63:0/253487140 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83f000a370 con 0x7f83f414aa70 2020-05-18T21:26:47.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83fa2c3700 1 -- 172.21.15.63:0/253487140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f414aa70 msgr2=0x7f83f40648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:47.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83fa2c3700 1 --2- 172.21.15.63:0/253487140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f414aa70 0x7f83f40648c0 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f83f4063c70 tx=0x7f83f0008ca0).stop 2020-05-18T21:26:47.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83fa2c3700 1 -- 172.21.15.63:0/253487140 shutdown_connections 2020-05-18T21:26:47.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83fa2c3700 1 --2- 172.21.15.63:0/253487140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f414aa70 0x7f83f40648c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:47.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83fa2c3700 1 --2- 172.21.15.63:0/253487140 >> v2:172.21.15.155:3300/0 conn(0x7f83f405f110 0x7f83f40b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:47.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83fa2c3700 1 -- 172.21.15.63:0/253487140 >> 172.21.15.63:0/253487140 conn(0x7f83f4069fc0 msgr2=0x7f83f406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:47.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83fa2c3700 1 -- 172.21.15.63:0/253487140 shutdown_connections 2020-05-18T21:26:47.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.599+0000 7f83fa2c3700 1 -- 172.21.15.63:0/253487140 wait complete. 2020-05-18T21:26:47.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.603+0000 7f83fa2c3700 1 Processor -- start 2020-05-18T21:26:47.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.603+0000 7f83fa2c3700 1 -- start start 2020-05-18T21:26:47.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.603+0000 7f83fa2c3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f4064d20 0x7f83f41474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:47.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.603+0000 7f83fa2c3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f83f414aa70 0x7f83f414c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:47.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.603+0000 7f83fa2c3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f414c750 con 0x7f83f405f110 2020-05-18T21:26:47.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.603+0000 7f83fa2c3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f4145290 con 0x7f83f414aa70 2020-05-18T21:26:47.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.603+0000 7f83fa2c3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f4145530 con 0x7f83f4064d20 2020-05-18T21:26:47.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.603+0000 7f83f92c1700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f83f405f110 0x7f83f4140d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54678/0 (socket says 172.21.15.63:54678) 2020-05-18T21:26:47.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.603+0000 7f83f92c1700 1 -- 172.21.15.63:0/722396705 learned_addr learned my addr 172.21.15.63:0/722396705 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:47.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.603+0000 7f83f9ac2700 1 --2- 172.21.15.63:0/722396705 >> v2:172.21.15.63:3300/0 conn(0x7f83f414aa70 0x7f83f414c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:47.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.603+0000 7f83f8ac0700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f4064d20 0x7f83f41474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:47.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.603+0000 7f83ea7fc700 1 -- 172.21.15.63:0/722396705 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518704712 0 0) 0x7f83f414c750 con 0x7f83f405f110 2020-05-18T21:26:47.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.603+0000 7f83ea7fc700 1 -- 172.21.15.63:0/722396705 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83d4002fe0 con 0x7f83f405f110 2020-05-18T21:26:47.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83f8ac0700 1 -- 172.21.15.63:0/722396705 >> v2:172.21.15.63:3300/0 conn(0x7f83f414aa70 msgr2=0x7f83f414c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:47.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83f8ac0700 1 --2- 172.21.15.63:0/722396705 >> v2:172.21.15.63:3300/0 conn(0x7f83f414aa70 0x7f83f414c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:47.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83f8ac0700 1 -- 172.21.15.63:0/722396705 >> v1:172.21.15.63:6789/0 conn(0x7f83f405f110 legacy=0x7f83f4140d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:47.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83f8ac0700 1 -- 172.21.15.63:0/722396705 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f40ac580 con 0x7f83f4064d20 2020-05-18T21:26:47.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83f9ac2700 1 --2- 172.21.15.63:0/722396705 >> v2:172.21.15.63:3300/0 conn(0x7f83f414aa70 0x7f83f414c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:26:47.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83f8ac0700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f4064d20 0x7f83f41474c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f83f4063c70 tx=0x7f83f40635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83f8ac0700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f4064d20 0x7f83f41474c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f83f4063c70 tx=0x7f83f40635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83f8ac0700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f4064d20 0x7f83f41474c0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f83f4063c70 tx=0x7f83f40635c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:47.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83f8ac0700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f4064d20 0x7f83f41474c0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f83f4063c70 tx=0x7f83f40635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83ea7fc700 1 -- 172.21.15.63:0/722396705 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83f0005a80 con 0x7f83f4064d20 2020-05-18T21:26:47.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83f8ac0700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f4064d20 0x7f83f41474c0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f83f4063c70 tx=0x7f83f40635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83f8ac0700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f4064d20 0x7f83f41474c0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f83f4063c70 tx=0x7f83f40635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83ea7fc700 1 -- 172.21.15.63:0/722396705 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f0005be0 con 0x7f83f4064d20 2020-05-18T21:26:47.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83fa2c3700 1 -- 172.21.15.63:0/722396705 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f41414a0 con 0x7f83f4064d20 2020-05-18T21:26:47.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83ea7fc700 1 -- 172.21.15.63:0/722396705 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83f0007170 con 0x7f83f4064d20 2020-05-18T21:26:47.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83fa2c3700 1 -- 172.21.15.63:0/722396705 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f4144f90 con 0x7f83f4064d20 2020-05-18T21:26:47.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83fa2c3700 1 -- 172.21.15.63:0/722396705 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f40569e0 con 0x7f83f4064d20 2020-05-18T21:26:47.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83f8ac0700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f4064d20 0x7f83f41474c0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f83f4063c70 tx=0x7f83f40635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83ea7fc700 1 -- 172.21.15.63:0/722396705 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f83f00073e0 con 0x7f83f4064d20 2020-05-18T21:26:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83f8ac0700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f4064d20 0x7f83f41474c0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f83f4063c70 tx=0x7f83f40635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.607+0000 7f83ea7fc700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f83d404fd90 0x7f83d4052250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.611+0000 7f83ea7fc700 1 -- 172.21.15.63:0/722396705 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f83f0064690 con 0x7f83f4064d20 2020-05-18T21:26:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.611+0000 7f83f92c1700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f83d404fd90 0x7f83d4052250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.611+0000 7f83f92c1700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f83d404fd90 0x7f83d4052250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f83e4002f70 tx=0x7f83e40093f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.611+0000 7f83f92c1700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f83d404fd90 0x7f83d4052250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f83e4002f70 tx=0x7f83e40093f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.611+0000 7f83f92c1700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f83d404fd90 0x7f83d4052250 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f83e4002f70 tx=0x7f83e40093f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:47.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.615+0000 7f83f8ac0700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f4064d20 0x7f83f41474c0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f83f4063c70 tx=0x7f83f40635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.615+0000 7f83ea7fc700 1 -- 172.21.15.63:0/722396705 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f83f003eaa0 con 0x7f83f4064d20 2020-05-18T21:26:47.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.735+0000 7f83fa2c3700 1 -- 172.21.15.63:0/722396705 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83f40625f0 con 0x7f83f4064d20 2020-05-18T21:26:47.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.735+0000 7f83f8ac0700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f4064d20 0x7f83f41474c0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f83f4063c70 tx=0x7f83f40635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.735+0000 7f83ea7fc700 1 -- 172.21.15.63:0/722396705 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f83f00420c0 con 0x7f83f4064d20 2020-05-18T21:26:47.741 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:26:47.741 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":23,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:26:47.498250+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:26:43.453504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-05-18T21:26:44.456531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:26:47.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.739+0000 7f83fa2c3700 1 -- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f83d404fd90 msgr2=0x7f83d4052250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:47.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.739+0000 7f83fa2c3700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f83d404fd90 0x7f83d4052250 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f83e4002f70 tx=0x7f83e40093f0).stop 2020-05-18T21:26:47.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.739+0000 7f83fa2c3700 1 -- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f4064d20 msgr2=0x7f83f41474c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:47.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.739+0000 7f83fa2c3700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f4064d20 0x7f83f41474c0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f83f4063c70 tx=0x7f83f40635c0).stop 2020-05-18T21:26:47.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.739+0000 7f83fa2c3700 1 -- 172.21.15.63:0/722396705 shutdown_connections 2020-05-18T21:26:47.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.739+0000 7f83fa2c3700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f83d404fd90 0x7f83d4052250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:47.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.739+0000 7f83fa2c3700 1 --2- 172.21.15.63:0/722396705 >> v2:172.21.15.63:3300/0 conn(0x7f83f414aa70 0x7f83f414c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:47.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.739+0000 7f83fa2c3700 1 --2- 172.21.15.63:0/722396705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83f4064d20 0x7f83f41474c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:47.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.739+0000 7f83fa2c3700 1 -- 172.21.15.63:0/722396705 >> 172.21.15.63:0/722396705 conn(0x7f83f4069fc0 msgr2=0x7f83f40b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:47.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.739+0000 7f83fa2c3700 1 -- 172.21.15.63:0/722396705 shutdown_connections 2020-05-18T21:26:47.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.739+0000 7f83fa2c3700 1 -- 172.21.15.63:0/722396705 wait complete. 2020-05-18T21:26:47.753 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-05-18T21:26:47.753 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:26:47.754 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:26:47.757 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:26:47.757 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:26:47.758 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:26:47.765 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:26:47.766 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:26:47.766 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-05-18T21:26:47.824 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:26:47.841 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:26:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1ff4e7700 1 Processor -- start 2020-05-18T21:26:47.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1ff4e7700 1 -- start start 2020-05-18T21:26:47.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1ff4e7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa1f8145df0 0x7fa1f8142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:47.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1ff4e7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa1f81432f0 0x7fa1f8060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:47.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1ff4e7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f80b7020 con 0x7fa1f80b93f0 2020-05-18T21:26:47.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1ff4e7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f80b72c0 con 0x7fa1f81432f0 2020-05-18T21:26:47.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1ff4e7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f80b7560 con 0x7fa1f8145df0 2020-05-18T21:26:47.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1fece6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa1f81432f0 0x7fa1f8060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:47.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1fe4e5700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa1f80b93f0 0x7fa1f80b7ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54698/0 (socket says 172.21.15.63:54698) 2020-05-18T21:26:47.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1fece6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa1f81432f0 0x7fa1f8060430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52512/0 (socket says 172.21.15.63:52512) 2020-05-18T21:26:47.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1fe4e5700 1 -- 172.21.15.63:0/3403186991 learned_addr learned my addr 172.21.15.63:0/3403186991 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:47.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1fdce4700 1 --2- 172.21.15.63:0/3403186991 >> v2:172.21.15.155:3300/0 conn(0x7fa1f8145df0 0x7fa1f8142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:47.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1fece6700 1 -- 172.21.15.63:0/3403186991 >> v2:172.21.15.155:3300/0 conn(0x7fa1f8145df0 msgr2=0x7fa1f8142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:47.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1fece6700 1 --2- 172.21.15.63:0/3403186991 >> v2:172.21.15.155:3300/0 conn(0x7fa1f8145df0 0x7fa1f8142e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:47.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1fece6700 1 -- 172.21.15.63:0/3403186991 >> v1:172.21.15.63:6789/0 conn(0x7fa1f80b93f0 legacy=0x7fa1f80b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:47.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1fece6700 1 -- 172.21.15.63:0/3403186991 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f80b7800 con 0x7fa1f81432f0 2020-05-18T21:26:47.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1fd4e3700 1 -- 172.21.15.63:0/3403186991 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4235913804 0 0) 0x7fa1f80b7020 con 0x7fa1f80b93f0 2020-05-18T21:26:47.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1fece6700 1 --2- 172.21.15.63:0/3403186991 >> v2:172.21.15.63:3300/0 conn(0x7fa1f81432f0 0x7fa1f8060430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa1f00032f0 tx=0x7fa1f0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1fece6700 1 --2- 172.21.15.63:0/3403186991 >> v2:172.21.15.63:3300/0 conn(0x7fa1f81432f0 0x7fa1f8060430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa1f00032f0 tx=0x7fa1f0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.859+0000 7fa1fece6700 1 --2- 172.21.15.63:0/3403186991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1f81432f0 0x7fa1f8060430 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7fa1f00032f0 tx=0x7fa1f0007e00).ready entity=mon.0 client_cookie=882d49ab09cc23a8 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:47.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.863+0000 7fa1fece6700 1 --2- 172.21.15.63:0/3403186991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1f81432f0 0x7fa1f8060430 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fa1f00032f0 tx=0x7fa1f0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.863+0000 7fa1fd4e3700 1 -- 172.21.15.63:0/3403186991 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1f0011e60 con 0x7fa1f81432f0 2020-05-18T21:26:47.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.863+0000 7fa1fece6700 1 --2- 172.21.15.63:0/3403186991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1f81432f0 0x7fa1f8060430 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fa1f00032f0 tx=0x7fa1f0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.863+0000 7fa1fece6700 1 --2- 172.21.15.63:0/3403186991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1f81432f0 0x7fa1f8060430 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fa1f00032f0 tx=0x7fa1f0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.863+0000 7fa1fd4e3700 1 -- 172.21.15.63:0/3403186991 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f000a180 con 0x7fa1f81432f0 2020-05-18T21:26:47.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.863+0000 7fa1fd4e3700 1 -- 172.21.15.63:0/3403186991 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1f000a520 con 0x7fa1f81432f0 2020-05-18T21:26:47.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.863+0000 7fa1ff4e7700 1 -- 172.21.15.63:0/3403186991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1f81432f0 msgr2=0x7fa1f8060430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:47.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.863+0000 7fa1ff4e7700 1 --2- 172.21.15.63:0/3403186991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1f81432f0 0x7fa1f8060430 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7fa1f00032f0 tx=0x7fa1f0007e00).stop 2020-05-18T21:26:47.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.863+0000 7fa1ff4e7700 1 -- 172.21.15.63:0/3403186991 shutdown_connections 2020-05-18T21:26:47.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.863+0000 7fa1ff4e7700 1 --2- 172.21.15.63:0/3403186991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1f81432f0 0x7fa1f8060430 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:47.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.863+0000 7fa1ff4e7700 1 --2- 172.21.15.63:0/3403186991 >> v2:172.21.15.155:3300/0 conn(0x7fa1f8145df0 0x7fa1f8142e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:47.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.863+0000 7fa1ff4e7700 1 -- 172.21.15.63:0/3403186991 >> 172.21.15.63:0/3403186991 conn(0x7fa1f8069b70 msgr2=0x7fa1f8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:47.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.863+0000 7fa1ff4e7700 1 -- 172.21.15.63:0/3403186991 shutdown_connections 2020-05-18T21:26:47.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.863+0000 7fa1ff4e7700 1 -- 172.21.15.63:0/3403186991 wait complete. 2020-05-18T21:26:47.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.863+0000 7fa1ff4e7700 1 Processor -- start 2020-05-18T21:26:47.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.863+0000 7fa1ff4e7700 1 -- start start 2020-05-18T21:26:47.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1ff4e7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa1f81432f0 0x7fa1f80bce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:47.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1ff4e7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa1f8145df0 0x7fa1f80ba580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:47.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1ff4e7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f80af700 con 0x7fa1f80b93f0 2020-05-18T21:26:47.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1ff4e7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f80bd290 con 0x7fa1f81432f0 2020-05-18T21:26:47.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1ff4e7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f80adf20 con 0x7fa1f8145df0 2020-05-18T21:26:47.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1fe4e5700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa1f80b93f0 0x7fa1f80ad6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54704/0 (socket says 172.21.15.63:54704) 2020-05-18T21:26:47.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1fe4e5700 1 -- 172.21.15.63:0/1130796870 learned_addr learned my addr 172.21.15.63:0/1130796870 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:47.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1fdce4700 1 --2- 172.21.15.63:0/1130796870 >> v2:172.21.15.63:3300/0 conn(0x7fa1f81432f0 0x7fa1f80bce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:47.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1fece6700 1 --2- 172.21.15.63:0/1130796870 >> v2:172.21.15.155:3300/0 conn(0x7fa1f8145df0 0x7fa1f80ba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:47.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1fdce4700 1 -- 172.21.15.63:0/1130796870 >> v2:172.21.15.155:3300/0 conn(0x7fa1f8145df0 msgr2=0x7fa1f80ba580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:47.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1fdce4700 1 --2- 172.21.15.63:0/1130796870 >> v2:172.21.15.155:3300/0 conn(0x7fa1f8145df0 0x7fa1f80ba580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:47.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1fdce4700 1 -- 172.21.15.63:0/1130796870 >> v1:172.21.15.63:6789/0 conn(0x7fa1f80b93f0 legacy=0x7fa1f80ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:47.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1e77fe700 1 -- 172.21.15.63:0/1130796870 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95009149 0 0) 0x7fa1f80af700 con 0x7fa1f80b93f0 2020-05-18T21:26:47.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1fdce4700 1 -- 172.21.15.63:0/1130796870 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f80ae1c0 con 0x7fa1f81432f0 2020-05-18T21:26:47.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1fdce4700 1 --2- 172.21.15.63:0/1130796870 >> v2:172.21.15.63:3300/0 conn(0x7fa1f81432f0 0x7fa1f80bce30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa1e8002f70 tx=0x7fa1e8010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1fdce4700 1 --2- 172.21.15.63:0/1130796870 >> v2:172.21.15.63:3300/0 conn(0x7fa1f81432f0 0x7fa1f80bce30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa1e8002f70 tx=0x7fa1e8010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1fdce4700 1 --2- 172.21.15.63:0/1130796870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1f81432f0 0x7fa1f80bce30 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fa1e8002f70 tx=0x7fa1e8010bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:47.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1fdce4700 1 --2- 172.21.15.63:0/1130796870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1f81432f0 0x7fa1f80bce30 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fa1e8002f70 tx=0x7fa1e8010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1e77fe700 1 -- 172.21.15.63:0/1130796870 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1e8007550 con 0x7fa1f81432f0 2020-05-18T21:26:47.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1fdce4700 1 --2- 172.21.15.63:0/1130796870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1f81432f0 0x7fa1f80bce30 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fa1e8002f70 tx=0x7fa1e8010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1fdce4700 1 --2- 172.21.15.63:0/1130796870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1f81432f0 0x7fa1f80bce30 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fa1e8002f70 tx=0x7fa1e8010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1e77fe700 1 -- 172.21.15.63:0/1130796870 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e8005700 con 0x7fa1f81432f0 2020-05-18T21:26:47.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1e77fe700 1 -- 172.21.15.63:0/1130796870 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1e8005a60 con 0x7fa1f81432f0 2020-05-18T21:26:47.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1ff4e7700 1 -- 172.21.15.63:0/1130796870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f80ba9e0 con 0x7fa1f81432f0 2020-05-18T21:26:47.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1ff4e7700 1 -- 172.21.15.63:0/1130796870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f80ad300 con 0x7fa1f81432f0 2020-05-18T21:26:47.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1fdce4700 1 --2- 172.21.15.63:0/1130796870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1f81432f0 0x7fa1f80bce30 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fa1e8002f70 tx=0x7fa1e8010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1ff4e7700 1 -- 172.21.15.63:0/1130796870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f80569e0 con 0x7fa1f81432f0 2020-05-18T21:26:47.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1e77fe700 1 -- 172.21.15.63:0/1130796870 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa1e8005c60 con 0x7fa1f81432f0 2020-05-18T21:26:47.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.867+0000 7fa1fdce4700 1 --2- 172.21.15.63:0/1130796870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1f81432f0 0x7fa1f80bce30 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fa1e8002f70 tx=0x7fa1e8010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.871+0000 7fa1e77fe700 1 --2- 172.21.15.63:0/1130796870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa1d804f860 0x7fa1d8051d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:47.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.871+0000 7fa1e77fe700 1 -- 172.21.15.63:0/1130796870 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa1e8063e30 con 0x7fa1f81432f0 2020-05-18T21:26:47.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.871+0000 7fa1fe4e5700 1 --2- 172.21.15.63:0/1130796870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa1d804f860 0x7fa1d8051d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:47.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.871+0000 7fa1fe4e5700 1 --2- 172.21.15.63:0/1130796870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa1d804f860 0x7fa1d8051d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa1f40012a0 tx=0x7fa1f4001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.871+0000 7fa1fe4e5700 1 --2- 172.21.15.63:0/1130796870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa1d804f860 0x7fa1d8051d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa1f40012a0 tx=0x7fa1f4001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.871+0000 7fa1fe4e5700 1 --2- 172.21.15.63:0/1130796870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa1d804f860 0x7fa1d8051d20 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fa1f40012a0 tx=0x7fa1f4001760).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:47.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.879+0000 7fa1fdce4700 1 --2- 172.21.15.63:0/1130796870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1f81432f0 0x7fa1f80bce30 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fa1e8002f70 tx=0x7fa1e8010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.879+0000 7fa1e77fe700 1 -- 172.21.15.63:0/1130796870 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa1e803e1c0 con 0x7fa1f81432f0 2020-05-18T21:26:47.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.991+0000 7fa1ff4e7700 1 -- 172.21.15.63:0/1130796870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1f8061c40 con 0x7fa1f81432f0 2020-05-18T21:26:47.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.995+0000 7fa1fdce4700 1 --2- 172.21.15.63:0/1130796870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1f81432f0 0x7fa1f80bce30 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fa1e8002f70 tx=0x7fa1e8010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:47.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.995+0000 7fa1e77fe700 1 -- 172.21.15.63:0/1130796870 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fa1e80417e0 con 0x7fa1f81432f0 2020-05-18T21:26:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:26:47.999 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":23,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:26:47.498250+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:26:43.453504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-05-18T21:26:44.456531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:26:48.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.995+0000 7fa1ff4e7700 1 -- 172.21.15.63:0/1130796870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa1d804f860 msgr2=0x7fa1d8051d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.995+0000 7fa1ff4e7700 1 --2- 172.21.15.63:0/1130796870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa1d804f860 0x7fa1d8051d20 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fa1f40012a0 tx=0x7fa1f4001760).stop 2020-05-18T21:26:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.995+0000 7fa1ff4e7700 1 -- 172.21.15.63:0/1130796870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1f81432f0 msgr2=0x7fa1f80bce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.995+0000 7fa1ff4e7700 1 --2- 172.21.15.63:0/1130796870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1f81432f0 0x7fa1f80bce30 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fa1e8002f70 tx=0x7fa1e8010bd0).stop 2020-05-18T21:26:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.995+0000 7fa1ff4e7700 1 -- 172.21.15.63:0/1130796870 shutdown_connections 2020-05-18T21:26:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.995+0000 7fa1ff4e7700 1 --2- 172.21.15.63:0/1130796870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa1d804f860 0x7fa1d8051d20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.995+0000 7fa1ff4e7700 1 --2- 172.21.15.63:0/1130796870 >> v2:172.21.15.155:3300/0 conn(0x7fa1f8145df0 0x7fa1f80ba580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.995+0000 7fa1ff4e7700 1 --2- 172.21.15.63:0/1130796870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1f81432f0 0x7fa1f80bce30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.995+0000 7fa1ff4e7700 1 -- 172.21.15.63:0/1130796870 >> 172.21.15.63:0/1130796870 conn(0x7fa1f8069b70 msgr2=0x7fa1f8060310 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:48.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.995+0000 7fa1ff4e7700 1 -- 172.21.15.63:0/1130796870 shutdown_connections 2020-05-18T21:26:48.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:47.995+0000 7fa1ff4e7700 1 -- 172.21.15.63:0/1130796870 wait complete. 2020-05-18T21:26:48.011 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:26:43.453504+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:26:44.456531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:26:48.012 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:26:48.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.115+0000 7fa12080a700 1 Processor -- start 2020-05-18T21:26:48.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.115+0000 7fa12080a700 1 -- start start 2020-05-18T21:26:48.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.115+0000 7fa12080a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c06a490 0x7fa11c0653f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:48.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.115+0000 7fa12080a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11c065a50 con 0x7fa11c0b4f60 2020-05-18T21:26:48.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.115+0000 7fa12080a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11c0606d0 con 0x7fa11c060e10 2020-05-18T21:26:48.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.115+0000 7fa12080a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c065850 con 0x7fa11c06a490 2020-05-18T21:26:48.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.115+0000 7fa11ad9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa11c0b4f60 0x7fa11c129880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54712/0 (socket says 172.21.15.63:54712) 2020-05-18T21:26:48.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.115+0000 7fa11ad9d700 1 -- 172.21.15.63:0/2447698656 learned_addr learned my addr 172.21.15.63:0/2447698656 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:48.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.115+0000 7fa11a59c700 1 --2- 172.21.15.63:0/2447698656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c06a490 0x7fa11c0653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:48.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.115+0000 7fa119d9b700 1 -- 172.21.15.63:0/2447698656 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638476134 0 0) 0x7fa11c065a50 con 0x7fa11c0b4f60 2020-05-18T21:26:48.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.115+0000 7fa119d9b700 1 -- 172.21.15.63:0/2447698656 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0fc003270 con 0x7fa11c0b4f60 2020-05-18T21:26:48.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.115+0000 7fa119d9b700 1 -- 172.21.15.63:0/2447698656 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056939399 0 0) 0x7fa11c0606d0 con 0x7fa11c060e10 2020-05-18T21:26:48.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.115+0000 7fa119d9b700 1 -- 172.21.15.63:0/2447698656 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa11c065a50 con 0x7fa11c060e10 2020-05-18T21:26:48.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.115+0000 7fa11a59c700 1 -- 172.21.15.63:0/2447698656 >> v1:172.21.15.155:6789/0 conn(0x7fa11c060e10 legacy=0x7fa11c061260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.115+0000 7fa11a59c700 1 -- 172.21.15.63:0/2447698656 >> v1:172.21.15.63:6789/0 conn(0x7fa11c0b4f60 legacy=0x7fa11c129880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.115+0000 7fa119d9b700 1 -- 172.21.15.63:0/2447698656 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2370377512 0 0) 0x7fa0fc003270 con 0x7fa11c0b4f60 2020-05-18T21:26:48.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.119+0000 7fa11a59c700 1 -- 172.21.15.63:0/2447698656 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c060970 con 0x7fa11c06a490 2020-05-18T21:26:48.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.119+0000 7fa11a59c700 1 --2- 172.21.15.63:0/2447698656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c06a490 0x7fa11c0653f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa10c001490 tx=0x7fa104008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.119+0000 7fa11a59c700 1 --2- 172.21.15.63:0/2447698656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c06a490 0x7fa11c0653f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa10c001490 tx=0x7fa104008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.119+0000 7fa11a59c700 1 --2- 172.21.15.63:0/2447698656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c06a490 0x7fa11c0653f0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7fa10c001490 tx=0x7fa104008920).ready entity=mon.2 client_cookie=4568934a139abf2f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:48.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.119+0000 7fa11a59c700 1 --2- 172.21.15.63:0/2447698656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c06a490 0x7fa11c0653f0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fa10c001490 tx=0x7fa104008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.119+0000 7fa119d9b700 1 -- 172.21.15.63:0/2447698656 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa10c001a90 con 0x7fa11c06a490 2020-05-18T21:26:48.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.119+0000 7fa11a59c700 1 --2- 172.21.15.63:0/2447698656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c06a490 0x7fa11c0653f0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fa10c001490 tx=0x7fa104008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.119+0000 7fa119d9b700 1 -- 172.21.15.63:0/2447698656 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa104008e80 con 0x7fa11c06a490 2020-05-18T21:26:48.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.119+0000 7fa11a59c700 1 --2- 172.21.15.63:0/2447698656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c06a490 0x7fa11c0653f0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fa10c001490 tx=0x7fa104008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.119+0000 7fa119d9b700 1 -- 172.21.15.63:0/2447698656 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa104011440 con 0x7fa11c06a490 2020-05-18T21:26:48.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.119+0000 7fa12080a700 1 -- 172.21.15.63:0/2447698656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c06a490 msgr2=0x7fa11c0653f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.119+0000 7fa12080a700 1 --2- 172.21.15.63:0/2447698656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c06a490 0x7fa11c0653f0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7fa10c001490 tx=0x7fa104008920).stop 2020-05-18T21:26:48.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.119+0000 7fa12080a700 1 -- 172.21.15.63:0/2447698656 shutdown_connections 2020-05-18T21:26:48.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.119+0000 7fa12080a700 1 --2- 172.21.15.63:0/2447698656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c06a490 0x7fa11c0653f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:48.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.119+0000 7fa12080a700 1 -- 172.21.15.63:0/2447698656 >> 172.21.15.63:0/2447698656 conn(0x7fa11c05fbd0 msgr2=0x7fa11c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:48.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.119+0000 7fa12080a700 1 -- 172.21.15.63:0/2447698656 shutdown_connections 2020-05-18T21:26:48.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.119+0000 7fa12080a700 1 -- 172.21.15.63:0/2447698656 wait complete. 2020-05-18T21:26:48.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.119+0000 7fa12080a700 1 Processor -- start 2020-05-18T21:26:48.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.119+0000 7fa12080a700 1 -- start start 2020-05-18T21:26:48.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa12080a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa11c0b4f60 0x7fa11c144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:48.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa12080a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11c144ba0 con 0x7fa11c060e10 2020-05-18T21:26:48.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa12080a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11c146cc0 con 0x7fa11c06a490 2020-05-18T21:26:48.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa12080a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa11c12b5e0 con 0x7fa11c0b4f60 2020-05-18T21:26:48.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa11b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa11c0b4f60 0x7fa11c144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:48.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa11ad9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa11c060e10 0x7fa11c1513d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54720/0 (socket says 172.21.15.63:54720) 2020-05-18T21:26:48.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa11ad9d700 1 -- 172.21.15.63:0/778984069 learned_addr learned my addr 172.21.15.63:0/778984069 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:48.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa113fff700 1 -- 172.21.15.63:0/778984069 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415634799 0 0) 0x7fa11c146cc0 con 0x7fa11c06a490 2020-05-18T21:26:48.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa11b59e700 1 -- 172.21.15.63:0/778984069 >> v1:172.21.15.155:6789/0 conn(0x7fa11c06a490 legacy=0x7fa11c126850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa11b59e700 1 -- 172.21.15.63:0/778984069 >> v1:172.21.15.63:6789/0 conn(0x7fa11c060e10 legacy=0x7fa11c1513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa11b59e700 1 -- 172.21.15.63:0/778984069 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c12b020 con 0x7fa11c0b4f60 2020-05-18T21:26:48.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa11b59e700 1 --2- 172.21.15.63:0/778984069 >> v2:172.21.15.63:3300/0 conn(0x7fa11c0b4f60 0x7fa11c144740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa10c0014d0 tx=0x7fa1140109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa11b59e700 1 --2- 172.21.15.63:0/778984069 >> v2:172.21.15.63:3300/0 conn(0x7fa11c0b4f60 0x7fa11c144740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa10c0014d0 tx=0x7fa1140109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa11b59e700 1 --2- 172.21.15.63:0/778984069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa11c0b4f60 0x7fa11c144740 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7fa10c0014d0 tx=0x7fa1140109d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:48.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa11b59e700 1 --2- 172.21.15.63:0/778984069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa11c0b4f60 0x7fa11c144740 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fa10c0014d0 tx=0x7fa1140109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa11b59e700 1 --2- 172.21.15.63:0/778984069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa11c0b4f60 0x7fa11c144740 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fa10c0014d0 tx=0x7fa1140109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa113fff700 1 -- 172.21.15.63:0/778984069 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa11400cc40 con 0x7fa11c0b4f60 2020-05-18T21:26:48.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa11b59e700 1 --2- 172.21.15.63:0/778984069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa11c0b4f60 0x7fa11c144740 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fa10c0014d0 tx=0x7fa1140109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa113fff700 1 -- 172.21.15.63:0/778984069 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11400cda0 con 0x7fa11c0b4f60 2020-05-18T21:26:48.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa12080a700 1 -- 172.21.15.63:0/778984069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa11c146900 con 0x7fa11c0b4f60 2020-05-18T21:26:48.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa113fff700 1 -- 172.21.15.63:0/778984069 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa11400e370 con 0x7fa11c0b4f60 2020-05-18T21:26:48.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa12080a700 1 -- 172.21.15.63:0/778984069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa11c127180 con 0x7fa11c0b4f60 2020-05-18T21:26:48.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa12080a700 1 -- 172.21.15.63:0/778984069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11c12b7b0 con 0x7fa11c0b4f60 2020-05-18T21:26:48.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa11b59e700 1 --2- 172.21.15.63:0/778984069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa11c0b4f60 0x7fa11c144740 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fa10c0014d0 tx=0x7fa1140109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa113fff700 1 -- 172.21.15.63:0/778984069 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa11400e5f0 con 0x7fa11c0b4f60 2020-05-18T21:26:48.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.123+0000 7fa11b59e700 1 --2- 172.21.15.63:0/778984069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa11c0b4f60 0x7fa11c144740 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fa10c0014d0 tx=0x7fa1140109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.127+0000 7fa113fff700 1 --2- 172.21.15.63:0/778984069 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa10004f890 0x7fa100051d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:48.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.127+0000 7fa113fff700 1 -- 172.21.15.63:0/778984069 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa1140638f0 con 0x7fa11c0b4f60 2020-05-18T21:26:48.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.127+0000 7fa11ad9d700 1 --2- 172.21.15.63:0/778984069 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa10004f890 0x7fa100051d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:48.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.127+0000 7fa11ad9d700 1 --2- 172.21.15.63:0/778984069 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa10004f890 0x7fa100051d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa10c0012d0 tx=0x7fa10c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.127+0000 7fa11ad9d700 1 --2- 172.21.15.63:0/778984069 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa10004f890 0x7fa100051d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa10c0012d0 tx=0x7fa10c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.127+0000 7fa11ad9d700 1 --2- 172.21.15.63:0/778984069 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa10004f890 0x7fa100051d50 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fa10c0012d0 tx=0x7fa10c001e40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:48.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.127+0000 7fa11b59e700 1 --2- 172.21.15.63:0/778984069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa11c0b4f60 0x7fa11c144740 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fa10c0014d0 tx=0x7fa1140109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.127+0000 7fa113fff700 1 -- 172.21.15.63:0/778984069 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa11403dc80 con 0x7fa11c0b4f60 2020-05-18T21:26:48.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.243+0000 7fa12080a700 1 -- 172.21.15.63:0/778984069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa11c146ec0 con 0x7fa11c0b4f60 2020-05-18T21:26:48.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.243+0000 7fa11b59e700 1 --2- 172.21.15.63:0/778984069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa11c0b4f60 0x7fa11c144740 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fa10c0014d0 tx=0x7fa1140109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.243+0000 7fa113fff700 1 -- 172.21.15.63:0/778984069 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa1140412a0 con 0x7fa11c0b4f60 2020-05-18T21:26:48.248 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:26:48.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.243+0000 7fa12080a700 1 -- 172.21.15.63:0/778984069 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa10004f890 msgr2=0x7fa100051d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.243+0000 7fa12080a700 1 --2- 172.21.15.63:0/778984069 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa10004f890 0x7fa100051d50 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fa10c0012d0 tx=0x7fa10c001e40).stop 2020-05-18T21:26:48.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.243+0000 7fa12080a700 1 -- 172.21.15.63:0/778984069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa11c0b4f60 msgr2=0x7fa11c144740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.243+0000 7fa12080a700 1 --2- 172.21.15.63:0/778984069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa11c0b4f60 0x7fa11c144740 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7fa10c0014d0 tx=0x7fa1140109d0).stop 2020-05-18T21:26:48.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.243+0000 7fa12080a700 1 -- 172.21.15.63:0/778984069 shutdown_connections 2020-05-18T21:26:48.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.243+0000 7fa12080a700 1 --2- 172.21.15.63:0/778984069 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa10004f890 0x7fa100051d50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:48.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.247+0000 7fa12080a700 1 --2- 172.21.15.63:0/778984069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa11c0b4f60 0x7fa11c144740 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:48.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.247+0000 7fa12080a700 1 -- 172.21.15.63:0/778984069 >> 172.21.15.63:0/778984069 conn(0x7fa11c05fbd0 msgr2=0x7fa11c061260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:48.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.247+0000 7fa12080a700 1 -- 172.21.15.63:0/778984069 shutdown_connections 2020-05-18T21:26:48.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.247+0000 7fa12080a700 1 -- 172.21.15.63:0/778984069 wait complete. 2020-05-18T21:26:48.260 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:26:48.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.367+0000 7fa684a28700 1 Processor -- start 2020-05-18T21:26:48.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.367+0000 7fa684a28700 1 -- start start 2020-05-18T21:26:48.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa684a28700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6801442c0 0x7fa680144750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:48.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa684a28700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68009e090 con 0x7fa68009dc30 2020-05-18T21:26:48.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa684a28700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6800b0820 con 0x7fa680069eb0 2020-05-18T21:26:48.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa684a28700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800b0ac0 con 0x7fa6801442c0 2020-05-18T21:26:48.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67659c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa68009dc30 0x7fa680065ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54728/0 (socket says 172.21.15.63:54728) 2020-05-18T21:26:48.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67659c700 1 -- 172.21.15.63:0/773144770 learned_addr learned my addr 172.21.15.63:0/773144770 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:48.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67f59e700 1 --2- 172.21.15.63:0/773144770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6801442c0 0x7fa680144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:48.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67e59c700 1 -- 172.21.15.63:0/773144770 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295577277 0 0) 0x7fa68009e090 con 0x7fa68009dc30 2020-05-18T21:26:48.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67e59c700 1 -- 172.21.15.63:0/773144770 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa664003270 con 0x7fa68009dc30 2020-05-18T21:26:48.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67e59c700 1 -- 172.21.15.63:0/773144770 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199061071 0 0) 0x7fa6800b0820 con 0x7fa680069eb0 2020-05-18T21:26:48.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67e59c700 1 -- 172.21.15.63:0/773144770 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa68009e090 con 0x7fa680069eb0 2020-05-18T21:26:48.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67f59e700 1 -- 172.21.15.63:0/773144770 >> v1:172.21.15.155:6789/0 conn(0x7fa680069eb0 legacy=0x7fa680147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67e59c700 1 -- 172.21.15.63:0/773144770 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4001629049 0 0) 0x7fa664003270 con 0x7fa68009dc30 2020-05-18T21:26:48.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67f59e700 1 -- 172.21.15.63:0/773144770 >> v1:172.21.15.63:6789/0 conn(0x7fa68009dc30 legacy=0x7fa680065ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67f59e700 1 -- 172.21.15.63:0/773144770 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68006a290 con 0x7fa6801442c0 2020-05-18T21:26:48.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67f59e700 1 --2- 172.21.15.63:0/773144770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6801442c0 0x7fa680144750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa668001110 tx=0x7fa678008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67f59e700 1 --2- 172.21.15.63:0/773144770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6801442c0 0x7fa680144750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa668001110 tx=0x7fa678008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67f59e700 1 --2- 172.21.15.63:0/773144770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6801442c0 0x7fa680144750 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7fa668001110 tx=0x7fa678008ca0).ready entity=mon.2 client_cookie=ced05d1367df46c4 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:48.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67f59e700 1 --2- 172.21.15.63:0/773144770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6801442c0 0x7fa680144750 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7fa668001110 tx=0x7fa678008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67e59c700 1 -- 172.21.15.63:0/773144770 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa668001730 con 0x7fa6801442c0 2020-05-18T21:26:48.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67f59e700 1 --2- 172.21.15.63:0/773144770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6801442c0 0x7fa680144750 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7fa668001110 tx=0x7fa678008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67e59c700 1 -- 172.21.15.63:0/773144770 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa678011ac0 con 0x7fa6801442c0 2020-05-18T21:26:48.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67f59e700 1 --2- 172.21.15.63:0/773144770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6801442c0 0x7fa680144750 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7fa668001110 tx=0x7fa678008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa67e59c700 1 -- 172.21.15.63:0/773144770 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa678011e20 con 0x7fa6801442c0 2020-05-18T21:26:48.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa684a28700 1 -- 172.21.15.63:0/773144770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6801442c0 msgr2=0x7fa680144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa684a28700 1 --2- 172.21.15.63:0/773144770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6801442c0 0x7fa680144750 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7fa668001110 tx=0x7fa678008ca0).stop 2020-05-18T21:26:48.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa684a28700 1 -- 172.21.15.63:0/773144770 shutdown_connections 2020-05-18T21:26:48.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa684a28700 1 --2- 172.21.15.63:0/773144770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6801442c0 0x7fa680144750 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:48.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa684a28700 1 -- 172.21.15.63:0/773144770 >> 172.21.15.63:0/773144770 conn(0x7fa68005b290 msgr2=0x7fa6800b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:48.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa684a28700 1 -- 172.21.15.63:0/773144770 shutdown_connections 2020-05-18T21:26:48.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.371+0000 7fa684a28700 1 -- 172.21.15.63:0/773144770 wait complete. 2020-05-18T21:26:48.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.375+0000 7fa684a28700 1 Processor -- start 2020-05-18T21:26:48.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.375+0000 7fa684a28700 1 -- start start 2020-05-18T21:26:48.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.375+0000 7fa684a28700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa680069eb0 0x7fa6800b9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:48.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.375+0000 7fa684a28700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6801442c0 0x7fa6801553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:48.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.375+0000 7fa684a28700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6800b75d0 con 0x7fa68009dc30 2020-05-18T21:26:48.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.375+0000 7fa684a28700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6800b8420 con 0x7fa680069eb0 2020-05-18T21:26:48.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.375+0000 7fa684a28700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa680155830 con 0x7fa6801442c0 2020-05-18T21:26:48.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.375+0000 7fa67659c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa68009dc30 0x7fa6800b7d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54734/0 (socket says 172.21.15.63:54734) 2020-05-18T21:26:48.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.375+0000 7fa67659c700 1 -- 172.21.15.63:0/3758134194 learned_addr learned my addr 172.21.15.63:0/3758134194 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:48.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.375+0000 7fa67ed9d700 1 --2- 172.21.15.63:0/3758134194 >> v2:172.21.15.155:3300/0 conn(0x7fa680069eb0 0x7fa6800b9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:48.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.375+0000 7fa67f59e700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6801442c0 0x7fa6801553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:48.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.375+0000 7fa67cd99700 1 -- 172.21.15.63:0/3758134194 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683969105 0 0) 0x7fa6800b75d0 con 0x7fa68009dc30 2020-05-18T21:26:48.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.375+0000 7fa67cd99700 1 -- 172.21.15.63:0/3758134194 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa658002fe0 con 0x7fa68009dc30 2020-05-18T21:26:48.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.375+0000 7fa67ed9d700 1 -- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6801442c0 msgr2=0x7fa6801553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.375+0000 7fa67ed9d700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6801442c0 0x7fa6801553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:48.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.375+0000 7fa67ed9d700 1 -- 172.21.15.63:0/3758134194 >> v1:172.21.15.63:6789/0 conn(0x7fa68009dc30 legacy=0x7fa6800b7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.375+0000 7fa67ed9d700 1 -- 172.21.15.63:0/3758134194 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6800b7870 con 0x7fa680069eb0 2020-05-18T21:26:48.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.375+0000 7fa67ed9d700 1 --2- 172.21.15.63:0/3758134194 >> v2:172.21.15.155:3300/0 conn(0x7fa680069eb0 0x7fa6800b9610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa670001110 tx=0x7fa6700108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa67ed9d700 1 --2- 172.21.15.63:0/3758134194 >> v2:172.21.15.155:3300/0 conn(0x7fa680069eb0 0x7fa6800b9610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa670001110 tx=0x7fa6700108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa67ed9d700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa680069eb0 0x7fa6800b9610 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7fa670001110 tx=0x7fa6700108e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:48.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa67ed9d700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa680069eb0 0x7fa6800b9610 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fa670001110 tx=0x7fa6700108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa67cd99700 1 -- 172.21.15.63:0/3758134194 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa670006c00 con 0x7fa680069eb0 2020-05-18T21:26:48.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa67ed9d700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa680069eb0 0x7fa6800b9610 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fa670001110 tx=0x7fa6700108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa67ed9d700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa680069eb0 0x7fa6800b9610 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fa670001110 tx=0x7fa6700108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa67cd99700 1 -- 172.21.15.63:0/3758134194 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa670006da0 con 0x7fa680069eb0 2020-05-18T21:26:48.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa67cd99700 1 -- 172.21.15.63:0/3758134194 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa670008370 con 0x7fa680069eb0 2020-05-18T21:26:48.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa684a28700 1 -- 172.21.15.63:0/3758134194 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6801459a0 con 0x7fa680069eb0 2020-05-18T21:26:48.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa684a28700 1 -- 172.21.15.63:0/3758134194 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa680151ab0 con 0x7fa680069eb0 2020-05-18T21:26:48.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa67ed9d700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa680069eb0 0x7fa6800b9610 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fa670001110 tx=0x7fa6700108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa67ed9d700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa680069eb0 0x7fa6800b9610 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fa670001110 tx=0x7fa6700108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa67cd99700 1 -- 172.21.15.63:0/3758134194 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa6700085e0 con 0x7fa680069eb0 2020-05-18T21:26:48.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa684a28700 1 -- 172.21.15.63:0/3758134194 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6800569e0 con 0x7fa680069eb0 2020-05-18T21:26:48.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa67cd99700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa65804fd90 0x7fa658052250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:48.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa67cd99700 1 -- 172.21.15.63:0/3758134194 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa670063cb0 con 0x7fa680069eb0 2020-05-18T21:26:48.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa67659c700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa65804fd90 0x7fa658052250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:48.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa67659c700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa65804fd90 0x7fa658052250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa6680010b0 tx=0x7fa668001ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa67659c700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa65804fd90 0x7fa658052250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa6680010b0 tx=0x7fa668001ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.379+0000 7fa67659c700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa65804fd90 0x7fa658052250 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7fa6680010b0 tx=0x7fa668001ae0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:48.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.387+0000 7fa67ed9d700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa680069eb0 0x7fa6800b9610 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fa670001110 tx=0x7fa6700108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.387+0000 7fa67cd99700 1 -- 172.21.15.63:0/3758134194 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa67003e060 con 0x7fa680069eb0 2020-05-18T21:26:48.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.503+0000 7fa684a28700 1 -- 172.21.15.63:0/3758134194 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa6801419e0 con 0x7fa680069eb0 2020-05-18T21:26:48.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.503+0000 7fa67ed9d700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa680069eb0 0x7fa6800b9610 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fa670001110 tx=0x7fa6700108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.503+0000 7fa67cd99700 1 -- 172.21.15.63:0/3758134194 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa670041680 con 0x7fa680069eb0 2020-05-18T21:26:48.509 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:26:48.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.507+0000 7fa684a28700 1 -- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa65804fd90 msgr2=0x7fa658052250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.507+0000 7fa684a28700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa65804fd90 0x7fa658052250 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7fa6680010b0 tx=0x7fa668001ae0).stop 2020-05-18T21:26:48.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.507+0000 7fa684a28700 1 -- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa680069eb0 msgr2=0x7fa6800b9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.507+0000 7fa684a28700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa680069eb0 0x7fa6800b9610 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7fa670001110 tx=0x7fa6700108e0).stop 2020-05-18T21:26:48.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.507+0000 7fa684a28700 1 -- 172.21.15.63:0/3758134194 shutdown_connections 2020-05-18T21:26:48.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.507+0000 7fa684a28700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa65804fd90 0x7fa658052250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:48.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.507+0000 7fa684a28700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6801442c0 0x7fa6801553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:48.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.507+0000 7fa684a28700 1 --2- 172.21.15.63:0/3758134194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa680069eb0 0x7fa6800b9610 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:48.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.507+0000 7fa684a28700 1 -- 172.21.15.63:0/3758134194 >> 172.21.15.63:0/3758134194 conn(0x7fa68005b290 msgr2=0x7fa680147430 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:48.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.507+0000 7fa684a28700 1 -- 172.21.15.63:0/3758134194 shutdown_connections 2020-05-18T21:26:48.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.507+0000 7fa684a28700 1 -- 172.21.15.63:0/3758134194 wait complete. 2020-05-18T21:26:48.530 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:26:48.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.623+0000 7f4095451700 1 Processor -- start 2020-05-18T21:26:48.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.623+0000 7f4095451700 1 -- start start 2020-05-18T21:26:48.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f4095451700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4090147d30 0x7f4090069b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:48.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f4095451700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4090069fd0 0x7f40900640a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:48.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f4095451700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4090144d70 con 0x7f4090147950 2020-05-18T21:26:48.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f4095451700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4090143f20 con 0x7f4090069fd0 2020-05-18T21:26:48.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f4095451700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40901441c0 con 0x7f4090147d30 2020-05-18T21:26:48.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f408effd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4090147950 0x7f4090144660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54752/0 (socket says 172.21.15.63:54752) 2020-05-18T21:26:48.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f408effd700 1 -- 172.21.15.63:0/2238533507 learned_addr learned my addr 172.21.15.63:0/2238533507 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:48.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f408f7fe700 1 --2- 172.21.15.63:0/2238533507 >> v2:172.21.15.63:3300/0 conn(0x7f4090069fd0 0x7f40900640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:48.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f408e7fc700 1 --2- 172.21.15.63:0/2238533507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4090147d30 0x7f4090069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:48.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f408dffb700 1 -- 172.21.15.63:0/2238533507 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546496523 0 0) 0x7f4090144d70 con 0x7f4090147950 2020-05-18T21:26:48.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f408dffb700 1 -- 172.21.15.63:0/2238533507 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4074003270 con 0x7f4090147950 2020-05-18T21:26:48.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f408f7fe700 1 -- 172.21.15.63:0/2238533507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4090147d30 msgr2=0x7f4090069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:48.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f408f7fe700 1 --2- 172.21.15.63:0/2238533507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4090147d30 0x7f4090069b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:48.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f408f7fe700 1 -- 172.21.15.63:0/2238533507 >> v1:172.21.15.63:6789/0 conn(0x7f4090147950 legacy=0x7f4090144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f408f7fe700 1 -- 172.21.15.63:0/2238533507 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40901481e0 con 0x7f4090069fd0 2020-05-18T21:26:48.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f408f7fe700 1 --2- 172.21.15.63:0/2238533507 >> v2:172.21.15.63:3300/0 conn(0x7f4090069fd0 0x7f40900640a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f40880032f0 tx=0x7f4088007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f408f7fe700 1 --2- 172.21.15.63:0/2238533507 >> v2:172.21.15.63:3300/0 conn(0x7f4090069fd0 0x7f40900640a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f40880032f0 tx=0x7f4088007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f408f7fe700 1 --2- 172.21.15.63:0/2238533507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4090069fd0 0x7f40900640a0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f40880032f0 tx=0x7f4088007e00).ready entity=mon.0 client_cookie=fbb754d093694bc0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:48.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f408f7fe700 1 --2- 172.21.15.63:0/2238533507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4090069fd0 0x7f40900640a0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f40880032f0 tx=0x7f4088007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f408f7fe700 1 --2- 172.21.15.63:0/2238533507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4090069fd0 0x7f40900640a0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f40880032f0 tx=0x7f4088007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f408f7fe700 1 --2- 172.21.15.63:0/2238533507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4090069fd0 0x7f40900640a0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f40880032f0 tx=0x7f4088007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f408dffb700 1 -- 172.21.15.63:0/2238533507 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4088011e60 con 0x7f4090069fd0 2020-05-18T21:26:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f408dffb700 1 -- 172.21.15.63:0/2238533507 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408800a180 con 0x7f4090069fd0 2020-05-18T21:26:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f408dffb700 1 -- 172.21.15.63:0/2238533507 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f408800a560 con 0x7f4090069fd0 2020-05-18T21:26:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f4095451700 1 -- 172.21.15.63:0/2238533507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4090069fd0 msgr2=0x7f40900640a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f4095451700 1 --2- 172.21.15.63:0/2238533507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4090069fd0 0x7f40900640a0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f40880032f0 tx=0x7f4088007e00).stop 2020-05-18T21:26:48.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f4095451700 1 -- 172.21.15.63:0/2238533507 shutdown_connections 2020-05-18T21:26:48.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f4095451700 1 --2- 172.21.15.63:0/2238533507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4090069fd0 0x7f40900640a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:48.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f4095451700 1 --2- 172.21.15.63:0/2238533507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4090147d30 0x7f4090069b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:48.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f4095451700 1 -- 172.21.15.63:0/2238533507 >> 172.21.15.63:0/2238533507 conn(0x7f409005a7c0 msgr2=0x7f409005abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:48.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f4095451700 1 -- 172.21.15.63:0/2238533507 shutdown_connections 2020-05-18T21:26:48.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.627+0000 7f4095451700 1 -- 172.21.15.63:0/2238533507 wait complete. 2020-05-18T21:26:48.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f4095451700 1 Processor -- start 2020-05-18T21:26:48.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f4095451700 1 -- start start 2020-05-18T21:26:48.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f4095451700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4090147950 0x7f4090142de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:48.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f4095451700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4090142180 con 0x7f4090069fd0 2020-05-18T21:26:48.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f4095451700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4090140250 con 0x7f4090147d30 2020-05-18T21:26:48.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f4095451700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4090140060 con 0x7f4090147950 2020-05-18T21:26:48.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f408effd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4090069fd0 0x7f4090145560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54758/0 (socket says 172.21.15.63:54758) 2020-05-18T21:26:48.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f408effd700 1 -- 172.21.15.63:0/2770043513 learned_addr learned my addr 172.21.15.63:0/2770043513 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:48.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f408e7fc700 1 --2- 172.21.15.63:0/2770043513 >> v2:172.21.15.155:3300/0 conn(0x7f4090147950 0x7f4090142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:48.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f407ffff700 1 -- 172.21.15.63:0/2770043513 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179412930 0 0) 0x7f4090142180 con 0x7f4090069fd0 2020-05-18T21:26:48.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f407ffff700 1 -- 172.21.15.63:0/2770043513 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f406c002fe0 con 0x7f4090069fd0 2020-05-18T21:26:48.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f407ffff700 1 -- 172.21.15.63:0/2770043513 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2775842043 0 0) 0x7f406c002fe0 con 0x7f4090069fd0 2020-05-18T21:26:48.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f407ffff700 1 -- 172.21.15.63:0/2770043513 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4090142180 con 0x7f4090069fd0 2020-05-18T21:26:48.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f407ffff700 1 -- 172.21.15.63:0/2770043513 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f40800018c0 con 0x7f4090069fd0 2020-05-18T21:26:48.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f407ffff700 1 -- 172.21.15.63:0/2770043513 >> v2:172.21.15.155:3300/0 conn(0x7f4090147950 msgr2=0x7f4090142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f407ffff700 1 --2- 172.21.15.63:0/2770043513 >> v2:172.21.15.155:3300/0 conn(0x7f4090147950 0x7f4090142de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:48.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f407ffff700 1 -- 172.21.15.63:0/2770043513 >> v1:172.21.15.155:6789/0 conn(0x7f4090147d30 legacy=0x7f4090139ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f407ffff700 1 -- 172.21.15.63:0/2770043513 >> v1:172.21.15.63:6789/0 conn(0x7f4090069fd0 legacy=0x7f4090145560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f407ffff700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f406c004a80 0x7f406c004e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f407ffff700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f406c0039a0 0x7f406c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f407ffff700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f406c004280 0x7f406c00b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f407ffff700 1 -- 172.21.15.63:0/2770043513 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c004700 con 0x7f406c004a80 2020-05-18T21:26:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f407ffff700 1 -- 172.21.15.63:0/2770043513 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c004870 con 0x7f406c0039a0 2020-05-18T21:26:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f407ffff700 1 -- 172.21.15.63:0/2770043513 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c00bbf0 con 0x7f406c004280 2020-05-18T21:26:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f408effd700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f406c004a80 0x7f406c004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f408e7fc700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f406c0039a0 0x7f406c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f408f7fe700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f406c004280 0x7f406c00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:48.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f408effd700 1 -- 172.21.15.63:0/2770043513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f406c004280 msgr2=0x7f406c00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f408effd700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f406c004280 0x7f406c00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:48.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f408effd700 1 -- 172.21.15.63:0/2770043513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f406c0039a0 msgr2=0x7f406c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f408effd700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f406c0039a0 0x7f406c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:48.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f408f7fe700 1 -- 172.21.15.63:0/2770043513 reap_dead start 2020-05-18T21:26:48.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f408effd700 1 -- 172.21.15.63:0/2770043513 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4090141e00 con 0x7f406c004a80 2020-05-18T21:26:48.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f4095451700 1 -- 172.21.15.63:0/2770043513 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4090142880 con 0x7f406c004a80 2020-05-18T21:26:48.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f4095451700 1 -- 172.21.15.63:0/2770043513 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4090142f80 con 0x7f406c004a80 2020-05-18T21:26:48.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.631+0000 7f408effd700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f406c004a80 0x7f406c004e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4080005580 tx=0x7f406c0056b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.635+0000 7f408effd700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f406c004a80 0x7f406c004e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4080005580 tx=0x7f406c0056b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.635+0000 7f408effd700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f406c004a80 0x7f406c004e60 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f4080005580 tx=0x7f406c0056b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.635+0000 7f408effd700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f406c004a80 0x7f406c004e60 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f4080005580 tx=0x7f406c0056b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.635+0000 7f408effd700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f406c004a80 0x7f406c004e60 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f4080005580 tx=0x7f406c0056b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.635+0000 7f407ffff700 1 -- 172.21.15.63:0/2770043513 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f408000ee80 con 0x7f406c004a80 2020-05-18T21:26:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.635+0000 7f408effd700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f406c004a80 0x7f406c004e60 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f4080005580 tx=0x7f406c0056b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.635+0000 7f407ffff700 1 -- 172.21.15.63:0/2770043513 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4080011d30 con 0x7f406c004a80 2020-05-18T21:26:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.635+0000 7f407ffff700 1 -- 172.21.15.63:0/2770043513 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4080005810 con 0x7f406c004a80 2020-05-18T21:26:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.635+0000 7f4095451700 1 -- 172.21.15.63:0/2770043513 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4070003380 con 0x7f406c004a80 2020-05-18T21:26:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.635+0000 7f408effd700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f406c004a80 0x7f406c004e60 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f4080005580 tx=0x7f406c0056b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.635+0000 7f408effd700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f406c004a80 0x7f406c004e60 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f4080005580 tx=0x7f406c0056b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.635+0000 7f407ffff700 1 -- 172.21.15.63:0/2770043513 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4080005970 con 0x7f406c004a80 2020-05-18T21:26:48.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.635+0000 7f407ffff700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f406c053a30 0x7f406c055ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:48.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.635+0000 7f407ffff700 1 -- 172.21.15.63:0/2770043513 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4080063fa0 con 0x7f406c004a80 2020-05-18T21:26:48.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.635+0000 7f408e7fc700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f406c053a30 0x7f406c055ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:48.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.635+0000 7f408e7fc700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f406c053a30 0x7f406c055ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4084002f70 tx=0x7f4084006730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.635+0000 7f408e7fc700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f406c053a30 0x7f406c055ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4084002f70 tx=0x7f4084006730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.635+0000 7f408e7fc700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f406c053a30 0x7f406c055ef0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f4084002f70 tx=0x7f4084006730).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:48.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.639+0000 7f408effd700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f406c004a80 0x7f406c004e60 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f4080005580 tx=0x7f406c0056b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.639+0000 7f407ffff700 1 -- 172.21.15.63:0/2770043513 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f408003e330 con 0x7f406c004a80 2020-05-18T21:26:48.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.755+0000 7f4095451700 1 -- 172.21.15.63:0/2770043513 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4070002240 con 0x7f406c004a80 2020-05-18T21:26:48.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.755+0000 7f408effd700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f406c004a80 0x7f406c004e60 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f4080005580 tx=0x7f406c0056b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.755+0000 7f407ffff700 1 -- 172.21.15.63:0/2770043513 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4080041950 con 0x7f406c004a80 2020-05-18T21:26:48.758 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:26:48.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.755+0000 7f4095451700 1 -- 172.21.15.63:0/2770043513 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f406c053a30 msgr2=0x7f406c055ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.755+0000 7f4095451700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f406c053a30 0x7f406c055ef0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f4084002f70 tx=0x7f4084006730).stop 2020-05-18T21:26:48.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.755+0000 7f4095451700 1 -- 172.21.15.63:0/2770043513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f406c004a80 msgr2=0x7f406c004e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.755+0000 7f4095451700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f406c004a80 0x7f406c004e60 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f4080005580 tx=0x7f406c0056b0).stop 2020-05-18T21:26:48.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.755+0000 7f4095451700 1 -- 172.21.15.63:0/2770043513 shutdown_connections 2020-05-18T21:26:48.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.755+0000 7f4095451700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f406c053a30 0x7f406c055ef0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:48.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.755+0000 7f4095451700 1 --2- 172.21.15.63:0/2770043513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f406c004a80 0x7f406c004e60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:48.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.755+0000 7f4095451700 1 -- 172.21.15.63:0/2770043513 >> 172.21.15.63:0/2770043513 conn(0x7f409005a7c0 msgr2=0x7f4090143810 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:48.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.755+0000 7f4095451700 1 -- 172.21.15.63:0/2770043513 shutdown_connections 2020-05-18T21:26:48.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.755+0000 7f4095451700 1 -- 172.21.15.63:0/2770043513 wait complete. 2020-05-18T21:26:48.771 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:26:48.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.879+0000 7f020bfff700 1 Processor -- start 2020-05-18T21:26:48.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.879+0000 7f020bfff700 1 -- start start 2020-05-18T21:26:48.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.879+0000 7f020bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f020c05f410 0x7f020c09ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:48.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.879+0000 7f020bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f020c149d70 0x7f020c146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:48.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.879+0000 7f020bfff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c146380 con 0x7f020c13fa50 2020-05-18T21:26:48.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.879+0000 7f020bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020c1461a0 con 0x7f020c05f410 2020-05-18T21:26:48.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.879+0000 7f020bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020c14a1e0 con 0x7f020c149d70 2020-05-18T21:26:48.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.879+0000 7f020b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f020c13fa50 0x7f020c0b5ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54776/0 (socket says 172.21.15.63:54776) 2020-05-18T21:26:48.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.879+0000 7f020b7fe700 1 -- 172.21.15.63:0/1430773985 learned_addr learned my addr 172.21.15.63:0/1430773985 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:48.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.879+0000 7f020affd700 1 --2- 172.21.15.63:0/1430773985 >> v2:172.21.15.63:3300/0 conn(0x7f020c05f410 0x7f020c09ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:48.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.879+0000 7f020a7fc700 1 --2- 172.21.15.63:0/1430773985 >> v2:172.21.15.155:3300/0 conn(0x7f020c149d70 0x7f020c146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:48.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.879+0000 7f0209ffb700 1 -- 172.21.15.63:0/1430773985 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503811025 0 0) 0x7f020c146380 con 0x7f020c13fa50 2020-05-18T21:26:48.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.879+0000 7f0209ffb700 1 -- 172.21.15.63:0/1430773985 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01f0003270 con 0x7f020c13fa50 2020-05-18T21:26:48.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020a7fc700 1 -- 172.21.15.63:0/1430773985 >> v2:172.21.15.63:3300/0 conn(0x7f020c05f410 msgr2=0x7f020c09ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:48.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020a7fc700 1 --2- 172.21.15.63:0/1430773985 >> v2:172.21.15.63:3300/0 conn(0x7f020c05f410 0x7f020c09ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:48.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020a7fc700 1 -- 172.21.15.63:0/1430773985 >> v1:172.21.15.63:6789/0 conn(0x7f020c13fa50 legacy=0x7f020c0b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020a7fc700 1 -- 172.21.15.63:0/1430773985 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c05f7f0 con 0x7f020c149d70 2020-05-18T21:26:48.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020affd700 1 --2- 172.21.15.63:0/1430773985 >> v2:172.21.15.63:3300/0 conn(0x7f020c05f410 0x7f020c09ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:26:48.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020a7fc700 1 --2- 172.21.15.63:0/1430773985 >> v2:172.21.15.155:3300/0 conn(0x7f020c149d70 0x7f020c146820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f01fc002f70 tx=0x7f01fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020a7fc700 1 --2- 172.21.15.63:0/1430773985 >> v2:172.21.15.155:3300/0 conn(0x7f020c149d70 0x7f020c146820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f01fc002f70 tx=0x7f01fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020a7fc700 1 --2- 172.21.15.63:0/1430773985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f020c149d70 0x7f020c146820 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f01fc002f70 tx=0x7f01fc007a80).ready entity=mon.1 client_cookie=1510d86b359de8d6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:48.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020a7fc700 1 --2- 172.21.15.63:0/1430773985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f020c149d70 0x7f020c146820 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f01fc002f70 tx=0x7f01fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f0209ffb700 1 -- 172.21.15.63:0/1430773985 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01fc011540 con 0x7f020c149d70 2020-05-18T21:26:48.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020a7fc700 1 --2- 172.21.15.63:0/1430773985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f020c149d70 0x7f020c146820 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f01fc002f70 tx=0x7f01fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020a7fc700 1 --2- 172.21.15.63:0/1430773985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f020c149d70 0x7f020c146820 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f01fc002f70 tx=0x7f01fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f0209ffb700 1 -- 172.21.15.63:0/1430773985 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc0116a0 con 0x7f020c149d70 2020-05-18T21:26:48.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f0209ffb700 1 -- 172.21.15.63:0/1430773985 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01fc011ac0 con 0x7f020c149d70 2020-05-18T21:26:48.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020bfff700 1 -- 172.21.15.63:0/1430773985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f020c149d70 msgr2=0x7f020c146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020bfff700 1 --2- 172.21.15.63:0/1430773985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f020c149d70 0x7f020c146820 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f01fc002f70 tx=0x7f01fc007a80).stop 2020-05-18T21:26:48.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020bfff700 1 -- 172.21.15.63:0/1430773985 shutdown_connections 2020-05-18T21:26:48.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020bfff700 1 --2- 172.21.15.63:0/1430773985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f020c149d70 0x7f020c146820 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:48.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020bfff700 1 --2- 172.21.15.63:0/1430773985 >> v2:172.21.15.63:3300/0 conn(0x7f020c05f410 0x7f020c09ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:48.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020bfff700 1 -- 172.21.15.63:0/1430773985 >> 172.21.15.63:0/1430773985 conn(0x7f020c06a600 msgr2=0x7f020c0b6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:48.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020bfff700 1 -- 172.21.15.63:0/1430773985 shutdown_connections 2020-05-18T21:26:48.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020bfff700 1 -- 172.21.15.63:0/1430773985 wait complete. 2020-05-18T21:26:48.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020bfff700 1 Processor -- start 2020-05-18T21:26:48.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.883+0000 7f020bfff700 1 -- start start 2020-05-18T21:26:48.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f020bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c13fa50 0x7f020c060820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:48.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f020bfff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c060e80 con 0x7f020c05f410 2020-05-18T21:26:48.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f020bfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c061120 con 0x7f020c149d70 2020-05-18T21:26:48.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f020bfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c0613c0 con 0x7f020c13fa50 2020-05-18T21:26:48.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f020affd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f020c05f410 0x7f020c09eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54778/0 (socket says 172.21.15.63:54778) 2020-05-18T21:26:48.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f020affd700 1 -- 172.21.15.63:0/2986214979 learned_addr learned my addr 172.21.15.63:0/2986214979 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:48.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f020a7fc700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c13fa50 0x7f020c060820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:48.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f01fbfff700 1 -- 172.21.15.63:0/2986214979 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050366131 0 0) 0x7f020c060e80 con 0x7f020c05f410 2020-05-18T21:26:48.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f01fbfff700 1 -- 172.21.15.63:0/2986214979 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01e8002fe0 con 0x7f020c05f410 2020-05-18T21:26:48.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f01fbfff700 1 -- 172.21.15.63:0/2986214979 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450340036 0 0) 0x7f020c061120 con 0x7f020c149d70 2020-05-18T21:26:48.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f01fbfff700 1 -- 172.21.15.63:0/2986214979 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f020c060e80 con 0x7f020c149d70 2020-05-18T21:26:48.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f020a7fc700 1 -- 172.21.15.63:0/2986214979 >> v1:172.21.15.155:6789/0 conn(0x7f020c149d70 legacy=0x7f020c152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f020a7fc700 1 -- 172.21.15.63:0/2986214979 >> v1:172.21.15.63:6789/0 conn(0x7f020c05f410 legacy=0x7f020c09eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:48.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f020a7fc700 1 -- 172.21.15.63:0/2986214979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c0638d0 con 0x7f020c13fa50 2020-05-18T21:26:48.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f020a7fc700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c13fa50 0x7f020c060820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f01fc002f70 tx=0x7f01fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f020a7fc700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c13fa50 0x7f020c060820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f01fc002f70 tx=0x7f01fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f020a7fc700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c13fa50 0x7f020c060820 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f01fc002f70 tx=0x7f01fc007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:48.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f020a7fc700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c13fa50 0x7f020c060820 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f01fc002f70 tx=0x7f01fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f01fbfff700 1 -- 172.21.15.63:0/2986214979 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01fc011910 con 0x7f020c13fa50 2020-05-18T21:26:48.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f020a7fc700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c13fa50 0x7f020c060820 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f01fc002f70 tx=0x7f01fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f020bfff700 1 -- 172.21.15.63:0/2986214979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020c152c80 con 0x7f020c13fa50 2020-05-18T21:26:48.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f01fbfff700 1 -- 172.21.15.63:0/2986214979 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc011a70 con 0x7f020c13fa50 2020-05-18T21:26:48.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f020a7fc700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c13fa50 0x7f020c060820 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f01fc002f70 tx=0x7f01fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f01fbfff700 1 -- 172.21.15.63:0/2986214979 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01fc007360 con 0x7f020c13fa50 2020-05-18T21:26:48.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f020bfff700 1 -- 172.21.15.63:0/2986214979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020c0647f0 con 0x7f020c13fa50 2020-05-18T21:26:48.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.887+0000 7f020bfff700 1 -- 172.21.15.63:0/2986214979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020c061500 con 0x7f020c13fa50 2020-05-18T21:26:48.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.891+0000 7f020a7fc700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c13fa50 0x7f020c060820 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f01fc002f70 tx=0x7f01fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.891+0000 7f01fbfff700 1 -- 172.21.15.63:0/2986214979 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f01fc0080e0 con 0x7f020c13fa50 2020-05-18T21:26:48.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.891+0000 7f020a7fc700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c13fa50 0x7f020c060820 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f01fc002f70 tx=0x7f01fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.891+0000 7f01fbfff700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f01e804fe80 0x7f01e8052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:48.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.891+0000 7f01fbfff700 1 -- 172.21.15.63:0/2986214979 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f01fc0640d0 con 0x7f020c13fa50 2020-05-18T21:26:48.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.891+0000 7f020affd700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f01e804fe80 0x7f01e8052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:48.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.891+0000 7f020affd700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f01e804fe80 0x7f01e8052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0200002f70 tx=0x7f02000093f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.891+0000 7f020affd700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f01e804fe80 0x7f01e8052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0200002f70 tx=0x7f02000093f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.891+0000 7f020affd700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f01e804fe80 0x7f01e8052340 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f0200002f70 tx=0x7f02000093f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:48.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.899+0000 7f020a7fc700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c13fa50 0x7f020c060820 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f01fc002f70 tx=0x7f01fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:48.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:48.899+0000 7f01fbfff700 1 -- 172.21.15.63:0/2986214979 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f01fc03e580 con 0x7f020c13fa50 2020-05-18T21:26:49.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.015+0000 7f020bfff700 1 -- 172.21.15.63:0/2986214979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f020c0569e0 con 0x7f020c13fa50 2020-05-18T21:26:49.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.019+0000 7f020a7fc700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c13fa50 0x7f020c060820 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f01fc002f70 tx=0x7f01fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.019+0000 7f01fbfff700 1 -- 172.21.15.63:0/2986214979 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f01fc041ba0 con 0x7f020c13fa50 2020-05-18T21:26:49.021 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:26:49.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.019+0000 7f020bfff700 1 -- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f01e804fe80 msgr2=0x7f01e8052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.019+0000 7f020bfff700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f01e804fe80 0x7f01e8052340 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f0200002f70 tx=0x7f02000093f0).stop 2020-05-18T21:26:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.019+0000 7f020bfff700 1 -- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c13fa50 msgr2=0x7f020c060820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.019+0000 7f020bfff700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c13fa50 0x7f020c060820 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f01fc002f70 tx=0x7f01fc007a80).stop 2020-05-18T21:26:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.019+0000 7f020bfff700 1 -- 172.21.15.63:0/2986214979 shutdown_connections 2020-05-18T21:26:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.019+0000 7f020bfff700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f01e804fe80 0x7f01e8052340 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:49.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.019+0000 7f020bfff700 1 --2- 172.21.15.63:0/2986214979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c13fa50 0x7f020c060820 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:49.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.019+0000 7f020bfff700 1 -- 172.21.15.63:0/2986214979 >> 172.21.15.63:0/2986214979 conn(0x7f020c06a600 msgr2=0x7f020c0ba410 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:49.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.019+0000 7f020bfff700 1 -- 172.21.15.63:0/2986214979 shutdown_connections 2020-05-18T21:26:49.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.019+0000 7f020bfff700 1 -- 172.21.15.63:0/2986214979 wait complete. 2020-05-18T21:26:49.033 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-05-18T21:26:49.034 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-05-18T21:26:49.034 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-05-18T21:26:49.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.127+0000 7fc1efd1d700 1 Processor -- start 2020-05-18T21:26:49.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.127+0000 7fc1efd1d700 1 -- start start 2020-05-18T21:26:49.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1efd1d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1e813de20 0x7fc1e80b6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:49.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1efd1d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc1e8144810 0x7fc1e806a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:49.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1efd1d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e8069b70 con 0x7fc1e80b4f60 2020-05-18T21:26:49.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1efd1d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e8069e10 con 0x7fc1e8144810 2020-05-18T21:26:49.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1efd1d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e806a0b0 con 0x7fc1e813de20 2020-05-18T21:26:49.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1ed2b8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc1e8144810 0x7fc1e806a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:49.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1edab9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1e813de20 0x7fc1e80b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:49.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1ed2b8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc1e8144810 0x7fc1e806a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:39214/0 (socket says 172.21.15.63:39214) 2020-05-18T21:26:49.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1ed2b8700 1 -- 172.21.15.63:0/1992950707 learned_addr learned my addr 172.21.15.63:0/1992950707 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:49.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1ed2b8700 1 -- 172.21.15.63:0/1992950707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1e813de20 msgr2=0x7fc1e80b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:49.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1ed2b8700 1 --2- 172.21.15.63:0/1992950707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1e813de20 0x7fc1e80b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:49.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1ed2b8700 1 -- 172.21.15.63:0/1992950707 >> v1:172.21.15.155:6789/0 conn(0x7fc1e80b4f60 legacy=0x7fc1e8062a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1ed2b8700 1 -- 172.21.15.63:0/1992950707 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e8144c50 con 0x7fc1e8144810 2020-05-18T21:26:49.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1edab9700 1 --2- 172.21.15.63:0/1992950707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1e813de20 0x7fc1e80b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:26:49.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1ed2b8700 1 --2- 172.21.15.63:0/1992950707 >> v2:172.21.15.155:3300/0 conn(0x7fc1e8144810 0x7fc1e806a550 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc1d8002f70 tx=0x7fc1d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1ed2b8700 1 --2- 172.21.15.63:0/1992950707 >> v2:172.21.15.155:3300/0 conn(0x7fc1e8144810 0x7fc1e806a550 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc1d8002f70 tx=0x7fc1d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1ed2b8700 1 --2- 172.21.15.63:0/1992950707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8144810 0x7fc1e806a550 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fc1d8002f70 tx=0x7fc1d8007a80).ready entity=mon.1 client_cookie=5b5155a804591ed4 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:49.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1ed2b8700 1 --2- 172.21.15.63:0/1992950707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8144810 0x7fc1e806a550 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fc1d8002f70 tx=0x7fc1d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1ed2b8700 1 --2- 172.21.15.63:0/1992950707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8144810 0x7fc1e806a550 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fc1d8002f70 tx=0x7fc1d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1ecab7700 1 -- 172.21.15.63:0/1992950707 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1d80116b0 con 0x7fc1e8144810 2020-05-18T21:26:49.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1ed2b8700 1 --2- 172.21.15.63:0/1992950707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8144810 0x7fc1e806a550 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fc1d8002f70 tx=0x7fc1d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1ecab7700 1 -- 172.21.15.63:0/1992950707 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d8011810 con 0x7fc1e8144810 2020-05-18T21:26:49.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1ecab7700 1 -- 172.21.15.63:0/1992950707 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1d8011c30 con 0x7fc1e8144810 2020-05-18T21:26:49.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1efd1d700 1 -- 172.21.15.63:0/1992950707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8144810 msgr2=0x7fc1e806a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.131+0000 7fc1efd1d700 1 --2- 172.21.15.63:0/1992950707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8144810 0x7fc1e806a550 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fc1d8002f70 tx=0x7fc1d8007a80).stop 2020-05-18T21:26:49.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.135+0000 7fc1efd1d700 1 -- 172.21.15.63:0/1992950707 shutdown_connections 2020-05-18T21:26:49.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.135+0000 7fc1efd1d700 1 --2- 172.21.15.63:0/1992950707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8144810 0x7fc1e806a550 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:49.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.135+0000 7fc1efd1d700 1 --2- 172.21.15.63:0/1992950707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1e813de20 0x7fc1e80b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:49.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.135+0000 7fc1efd1d700 1 -- 172.21.15.63:0/1992950707 >> 172.21.15.63:0/1992950707 conn(0x7fc1e80ba5c0 msgr2=0x7fc1e80ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:49.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.135+0000 7fc1efd1d700 1 -- 172.21.15.63:0/1992950707 shutdown_connections 2020-05-18T21:26:49.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.135+0000 7fc1efd1d700 1 -- 172.21.15.63:0/1992950707 wait complete. 2020-05-18T21:26:49.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.135+0000 7fc1efd1d700 1 Processor -- start 2020-05-18T21:26:49.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.135+0000 7fc1efd1d700 1 -- start start 2020-05-18T21:26:49.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.135+0000 7fc1efd1d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc1e813de20 0x7fc1e8154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:49.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.135+0000 7fc1efd1d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e8140040 con 0x7fc1e8144810 2020-05-18T21:26:49.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.135+0000 7fc1efd1d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e81402e0 con 0x7fc1e80b4f60 2020-05-18T21:26:49.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.135+0000 7fc1efd1d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e812e7f0 con 0x7fc1e813de20 2020-05-18T21:26:49.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.135+0000 7fc1ed2b8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc1e813de20 0x7fc1e8154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:49.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.135+0000 7fc1ed2b8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc1e813de20 0x7fc1e8154c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52606/0 (socket says 172.21.15.63:52606) 2020-05-18T21:26:49.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.135+0000 7fc1ed2b8700 1 -- 172.21.15.63:0/1128504893 learned_addr learned my addr 172.21.15.63:0/1128504893 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:49.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.135+0000 7fc1ee2ba700 1 --1- 172.21.15.63:0/1128504893 >> v1:172.21.15.63:6789/0 conn(0x7fc1e8144810 0x7fc1e813cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54796/0 (socket says 172.21.15.63:54796) 2020-05-18T21:26:49.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1ed2b8700 1 -- 172.21.15.63:0/1128504893 >> v1:172.21.15.155:6789/0 conn(0x7fc1e80b4f60 legacy=0x7fc1e8140a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1ed2b8700 1 -- 172.21.15.63:0/1128504893 >> v1:172.21.15.63:6789/0 conn(0x7fc1e8144810 legacy=0x7fc1e813cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1d6ffd700 1 -- 172.21.15.63:0/1128504893 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3666686975 0 0) 0x7fc1e81402e0 con 0x7fc1e80b4f60 2020-05-18T21:26:49.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1ed2b8700 1 -- 172.21.15.63:0/1128504893 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e8140580 con 0x7fc1e813de20 2020-05-18T21:26:49.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1ed2b8700 1 --2- 172.21.15.63:0/1128504893 >> v2:172.21.15.63:3300/0 conn(0x7fc1e813de20 0x7fc1e8154c60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc1e0001250 tx=0x7fc1d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1ed2b8700 1 --2- 172.21.15.63:0/1128504893 >> v2:172.21.15.63:3300/0 conn(0x7fc1e813de20 0x7fc1e8154c60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc1e0001250 tx=0x7fc1d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1ed2b8700 1 --2- 172.21.15.63:0/1128504893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1e813de20 0x7fc1e8154c60 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7fc1e0001250 tx=0x7fc1d8007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:49.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1ed2b8700 1 --2- 172.21.15.63:0/1128504893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1e813de20 0x7fc1e8154c60 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fc1e0001250 tx=0x7fc1d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1d6ffd700 1 -- 172.21.15.63:0/1128504893 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1d8007170 con 0x7fc1e813de20 2020-05-18T21:26:49.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1ed2b8700 1 --2- 172.21.15.63:0/1128504893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1e813de20 0x7fc1e8154c60 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fc1e0001250 tx=0x7fc1d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1ed2b8700 1 --2- 172.21.15.63:0/1128504893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1e813de20 0x7fc1e8154c60 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fc1e0001250 tx=0x7fc1d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1d6ffd700 1 -- 172.21.15.63:0/1128504893 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d80072d0 con 0x7fc1e813de20 2020-05-18T21:26:49.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1d6ffd700 1 -- 172.21.15.63:0/1128504893 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1d8005700 con 0x7fc1e813de20 2020-05-18T21:26:49.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1efd1d700 1 -- 172.21.15.63:0/1128504893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e8141130 con 0x7fc1e813de20 2020-05-18T21:26:49.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1efd1d700 1 -- 172.21.15.63:0/1128504893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e813fa10 con 0x7fc1e813de20 2020-05-18T21:26:49.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1efd1d700 1 -- 172.21.15.63:0/1128504893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e8140710 con 0x7fc1e813de20 2020-05-18T21:26:49.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1ed2b8700 1 --2- 172.21.15.63:0/1128504893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1e813de20 0x7fc1e8154c60 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fc1e0001250 tx=0x7fc1d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1d6ffd700 1 -- 172.21.15.63:0/1128504893 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc1d8005900 con 0x7fc1e813de20 2020-05-18T21:26:49.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1ed2b8700 1 --2- 172.21.15.63:0/1128504893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1e813de20 0x7fc1e8154c60 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fc1e0001250 tx=0x7fc1d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.139+0000 7fc1d6ffd700 1 --2- 172.21.15.63:0/1128504893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1c804f830 0x7fc1c8051cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:49.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.143+0000 7fc1d6ffd700 1 -- 172.21.15.63:0/1128504893 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc1d8064290 con 0x7fc1e813de20 2020-05-18T21:26:49.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.143+0000 7fc1edab9700 1 --2- 172.21.15.63:0/1128504893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1c804f830 0x7fc1c8051cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:49.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.143+0000 7fc1edab9700 1 --2- 172.21.15.63:0/1128504893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1c804f830 0x7fc1c8051cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc1e4002f30 tx=0x7fc1e400cb60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.143+0000 7fc1edab9700 1 --2- 172.21.15.63:0/1128504893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1c804f830 0x7fc1c8051cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc1e4002f30 tx=0x7fc1e400cb60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.143+0000 7fc1edab9700 1 --2- 172.21.15.63:0/1128504893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1c804f830 0x7fc1c8051cf0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fc1e4002f30 tx=0x7fc1e400cb60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:49.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.147+0000 7fc1ed2b8700 1 --2- 172.21.15.63:0/1128504893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1e813de20 0x7fc1e8154c60 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fc1e0001250 tx=0x7fc1d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.147+0000 7fc1d6ffd700 1 -- 172.21.15.63:0/1128504893 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc1d803e740 con 0x7fc1e813de20 2020-05-18T21:26:49.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.287+0000 7fc1efd1d700 1 -- 172.21.15.63:0/1128504893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc1e80569e0 con 0x7fc1e813de20 2020-05-18T21:26:49.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.291+0000 7fc1ed2b8700 1 --2- 172.21.15.63:0/1128504893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1e813de20 0x7fc1e8154c60 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fc1e0001250 tx=0x7fc1d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.291+0000 7fc1d6ffd700 1 -- 172.21.15.63:0/1128504893 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+123725 (secure 0 0 0) 0x7fc1d8041d60 con 0x7fc1e813de20 2020-05-18T21:26:49.297 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:26:49.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.291+0000 7fc1efd1d700 1 -- 172.21.15.63:0/1128504893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1c804f830 msgr2=0x7fc1c8051cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.291+0000 7fc1efd1d700 1 --2- 172.21.15.63:0/1128504893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1c804f830 0x7fc1c8051cf0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fc1e4002f30 tx=0x7fc1e400cb60).stop 2020-05-18T21:26:49.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.291+0000 7fc1efd1d700 1 -- 172.21.15.63:0/1128504893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1e813de20 msgr2=0x7fc1e8154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.291+0000 7fc1efd1d700 1 --2- 172.21.15.63:0/1128504893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1e813de20 0x7fc1e8154c60 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7fc1e0001250 tx=0x7fc1d8007a80).stop 2020-05-18T21:26:49.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.291+0000 7fc1efd1d700 1 -- 172.21.15.63:0/1128504893 shutdown_connections 2020-05-18T21:26:49.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.291+0000 7fc1efd1d700 1 --2- 172.21.15.63:0/1128504893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1c804f830 0x7fc1c8051cf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:49.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.291+0000 7fc1efd1d700 1 --2- 172.21.15.63:0/1128504893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1e813de20 0x7fc1e8154c60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:49.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.291+0000 7fc1efd1d700 1 -- 172.21.15.63:0/1128504893 >> 172.21.15.63:0/1128504893 conn(0x7fc1e80ba5c0 msgr2=0x7fc1e806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:49.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.291+0000 7fc1efd1d700 1 -- 172.21.15.63:0/1128504893 shutdown_connections 2020-05-18T21:26:49.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.291+0000 7fc1efd1d700 1 -- 172.21.15.63:0/1128504893 wait complete. 2020-05-18T21:26:49.307 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":4,"active_gid":4110,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":12649},{"type":"v1","addr":"172.21.15.155:6833","nonce":12649}]},"active_addr":"172.21.15.155:6833/12649","active_change":"2020-05-18T21:26:33.011548+0000","active_mgr_features":4540138292837744639,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138292837744639,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":2670325755}]},{"addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":415810877}]},{"addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":491475365}]}]}} 2020-05-18T21:26:49.312 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-05-18T21:26:49.313 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-05-18T21:26:49.313 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:26:49.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.411+0000 7fe58f2cd700 1 Processor -- start 2020-05-18T21:26:49.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.411+0000 7fe58f2cd700 1 -- start start 2020-05-18T21:26:49.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.411+0000 7fe58f2cd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe588145df0 0x7fe588142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:49.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.411+0000 7fe58f2cd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5880b7020 con 0x7fe5880b93f0 2020-05-18T21:26:49.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.411+0000 7fe58f2cd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5880b72c0 con 0x7fe5881432f0 2020-05-18T21:26:49.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.411+0000 7fe58f2cd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5880b7560 con 0x7fe588145df0 2020-05-18T21:26:49.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.411+0000 7fe58daca700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe588145df0 0x7fe588142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:49.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.411+0000 7fe58e2cb700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe5880b93f0 0x7fe5880b7ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54800/0 (socket says 172.21.15.63:54800) 2020-05-18T21:26:49.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58e2cb700 1 -- 172.21.15.63:0/690570900 learned_addr learned my addr 172.21.15.63:0/690570900 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:49.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58daca700 1 -- 172.21.15.63:0/690570900 >> v1:172.21.15.155:6789/0 conn(0x7fe5881432f0 legacy=0x7fe588060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58daca700 1 -- 172.21.15.63:0/690570900 >> v1:172.21.15.63:6789/0 conn(0x7fe5880b93f0 legacy=0x7fe5880b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58d2c9700 1 -- 172.21.15.63:0/690570900 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733713082 0 0) 0x7fe5880b7020 con 0x7fe5880b93f0 2020-05-18T21:26:49.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58daca700 1 -- 172.21.15.63:0/690570900 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5880b7800 con 0x7fe588145df0 2020-05-18T21:26:49.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58daca700 1 --2- 172.21.15.63:0/690570900 >> v2:172.21.15.63:3300/0 conn(0x7fe588145df0 0x7fe588142e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe578002f70 tx=0x7fe578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58daca700 1 --2- 172.21.15.63:0/690570900 >> v2:172.21.15.63:3300/0 conn(0x7fe588145df0 0x7fe588142e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe578002f70 tx=0x7fe578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58daca700 1 --2- 172.21.15.63:0/690570900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe588145df0 0x7fe588142e90 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7fe578002f70 tx=0x7fe578007a80).ready entity=mon.0 client_cookie=1d3d050aad3875d3 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:49.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58daca700 1 --2- 172.21.15.63:0/690570900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe588145df0 0x7fe588142e90 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fe578002f70 tx=0x7fe578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58d2c9700 1 -- 172.21.15.63:0/690570900 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe578008e80 con 0x7fe588145df0 2020-05-18T21:26:49.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58daca700 1 --2- 172.21.15.63:0/690570900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe588145df0 0x7fe588142e90 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fe578002f70 tx=0x7fe578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58d2c9700 1 -- 172.21.15.63:0/690570900 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5780116a0 con 0x7fe588145df0 2020-05-18T21:26:49.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58daca700 1 --2- 172.21.15.63:0/690570900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe588145df0 0x7fe588142e90 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fe578002f70 tx=0x7fe578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58d2c9700 1 -- 172.21.15.63:0/690570900 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe578011ac0 con 0x7fe588145df0 2020-05-18T21:26:49.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58f2cd700 1 -- 172.21.15.63:0/690570900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe588145df0 msgr2=0x7fe588142e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58f2cd700 1 --2- 172.21.15.63:0/690570900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe588145df0 0x7fe588142e90 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7fe578002f70 tx=0x7fe578007a80).stop 2020-05-18T21:26:49.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58f2cd700 1 -- 172.21.15.63:0/690570900 shutdown_connections 2020-05-18T21:26:49.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58f2cd700 1 --2- 172.21.15.63:0/690570900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe588145df0 0x7fe588142e90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:49.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58f2cd700 1 -- 172.21.15.63:0/690570900 >> 172.21.15.63:0/690570900 conn(0x7fe588069b70 msgr2=0x7fe588069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:49.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58f2cd700 1 -- 172.21.15.63:0/690570900 shutdown_connections 2020-05-18T21:26:49.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58f2cd700 1 -- 172.21.15.63:0/690570900 wait complete. 2020-05-18T21:26:49.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58f2cd700 1 Processor -- start 2020-05-18T21:26:49.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.415+0000 7fe58f2cd700 1 -- start start 2020-05-18T21:26:49.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58f2cd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe5881432f0 0x7fe58813d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:49.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58f2cd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58813d200 con 0x7fe5880b93f0 2020-05-18T21:26:49.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58f2cd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58813d4a0 con 0x7fe588145df0 2020-05-18T21:26:49.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58f2cd700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe58813dda0 con 0x7fe5881432f0 2020-05-18T21:26:49.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58e2cb700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe5880b93f0 0x7fe588136190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54808/0 (socket says 172.21.15.63:54808) 2020-05-18T21:26:49.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58e2cb700 1 -- 172.21.15.63:0/1212685947 learned_addr learned my addr 172.21.15.63:0/1212685947 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:49.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58daca700 1 --2- 172.21.15.63:0/1212685947 >> v2:172.21.15.155:3300/0 conn(0x7fe5881432f0 0x7fe58813d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:49.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe5777fe700 1 -- 172.21.15.63:0/1212685947 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055193945 0 0) 0x7fe58813d200 con 0x7fe5880b93f0 2020-05-18T21:26:49.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe5777fe700 1 -- 172.21.15.63:0/1212685947 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe568002fe0 con 0x7fe5880b93f0 2020-05-18T21:26:49.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58daca700 1 -- 172.21.15.63:0/1212685947 >> v1:172.21.15.155:6789/0 conn(0x7fe588145df0 legacy=0x7fe5880ba580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58daca700 1 -- 172.21.15.63:0/1212685947 >> v1:172.21.15.63:6789/0 conn(0x7fe5880b93f0 legacy=0x7fe588136190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58daca700 1 -- 172.21.15.63:0/1212685947 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58813cf10 con 0x7fe5881432f0 2020-05-18T21:26:49.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58daca700 1 --2- 172.21.15.63:0/1212685947 >> v2:172.21.15.155:3300/0 conn(0x7fe5881432f0 0x7fe58813d940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe578002f70 tx=0x7fe578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58daca700 1 --2- 172.21.15.63:0/1212685947 >> v2:172.21.15.155:3300/0 conn(0x7fe5881432f0 0x7fe58813d940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe578002f70 tx=0x7fe578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58daca700 1 --2- 172.21.15.63:0/1212685947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5881432f0 0x7fe58813d940 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fe578002f70 tx=0x7fe578007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:49.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58daca700 1 --2- 172.21.15.63:0/1212685947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5881432f0 0x7fe58813d940 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fe578002f70 tx=0x7fe578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe5777fe700 1 -- 172.21.15.63:0/1212685947 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe578007360 con 0x7fe5881432f0 2020-05-18T21:26:49.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58daca700 1 --2- 172.21.15.63:0/1212685947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5881432f0 0x7fe58813d940 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fe578002f70 tx=0x7fe578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58daca700 1 --2- 172.21.15.63:0/1212685947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5881432f0 0x7fe58813d940 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fe578002f70 tx=0x7fe578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe5777fe700 1 -- 172.21.15.63:0/1212685947 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5780074c0 con 0x7fe5881432f0 2020-05-18T21:26:49.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58f2cd700 1 -- 172.21.15.63:0/1212685947 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe588141ae0 con 0x7fe5881432f0 2020-05-18T21:26:49.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe5777fe700 1 -- 172.21.15.63:0/1212685947 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe578007630 con 0x7fe5881432f0 2020-05-18T21:26:49.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58f2cd700 1 -- 172.21.15.63:0/1212685947 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5880bac90 con 0x7fe5881432f0 2020-05-18T21:26:49.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58f2cd700 1 -- 172.21.15.63:0/1212685947 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5880bb2b0 con 0x7fe5881432f0 2020-05-18T21:26:49.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.419+0000 7fe58daca700 1 --2- 172.21.15.63:0/1212685947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5881432f0 0x7fe58813d940 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fe578002f70 tx=0x7fe578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.423+0000 7fe58daca700 1 --2- 172.21.15.63:0/1212685947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5881432f0 0x7fe58813d940 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fe578002f70 tx=0x7fe578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.423+0000 7fe5777fe700 1 -- 172.21.15.63:0/1212685947 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe578005940 con 0x7fe5881432f0 2020-05-18T21:26:49.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.423+0000 7fe5777fe700 1 --2- 172.21.15.63:0/1212685947 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe56804fce0 0x7fe5680521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:49.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.423+0000 7fe5777fe700 1 -- 172.21.15.63:0/1212685947 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe578064610 con 0x7fe5881432f0 2020-05-18T21:26:49.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.423+0000 7fe58e2cb700 1 --2- 172.21.15.63:0/1212685947 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe56804fce0 0x7fe5680521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:49.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.423+0000 7fe58e2cb700 1 --2- 172.21.15.63:0/1212685947 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe56804fce0 0x7fe5680521a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe584001030 tx=0x7fe584001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.423+0000 7fe58e2cb700 1 --2- 172.21.15.63:0/1212685947 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe56804fce0 0x7fe5680521a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe584001030 tx=0x7fe584001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.423+0000 7fe58e2cb700 1 --2- 172.21.15.63:0/1212685947 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe56804fce0 0x7fe5680521a0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fe584001030 tx=0x7fe584001720).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:49.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.431+0000 7fe58daca700 1 --2- 172.21.15.63:0/1212685947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5881432f0 0x7fe58813d940 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fe578002f70 tx=0x7fe578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.431+0000 7fe5777fe700 1 -- 172.21.15.63:0/1212685947 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe57803ea20 con 0x7fe5881432f0 2020-05-18T21:26:49.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.551+0000 7fe58f2cd700 1 -- 172.21.15.63:0/1212685947 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe58813d630 con 0x7fe5881432f0 2020-05-18T21:26:49.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.551+0000 7fe58daca700 1 --2- 172.21.15.63:0/1212685947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5881432f0 0x7fe58813d940 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fe578002f70 tx=0x7fe578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.551+0000 7fe5777fe700 1 -- 172.21.15.63:0/1212685947 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fe578042040 con 0x7fe5881432f0 2020-05-18T21:26:49.555 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:26:49.556 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":23,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:26:47.498250+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:26:43.453504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-05-18T21:26:44.456531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:26:49.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.555+0000 7fe58f2cd700 1 -- 172.21.15.63:0/1212685947 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe56804fce0 msgr2=0x7fe5680521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.555+0000 7fe58f2cd700 1 --2- 172.21.15.63:0/1212685947 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe56804fce0 0x7fe5680521a0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fe584001030 tx=0x7fe584001720).stop 2020-05-18T21:26:49.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.555+0000 7fe58f2cd700 1 -- 172.21.15.63:0/1212685947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5881432f0 msgr2=0x7fe58813d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.555+0000 7fe58f2cd700 1 --2- 172.21.15.63:0/1212685947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5881432f0 0x7fe58813d940 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fe578002f70 tx=0x7fe578007a80).stop 2020-05-18T21:26:49.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.555+0000 7fe58f2cd700 1 -- 172.21.15.63:0/1212685947 shutdown_connections 2020-05-18T21:26:49.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.555+0000 7fe58f2cd700 1 --2- 172.21.15.63:0/1212685947 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe56804fce0 0x7fe5680521a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:49.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.555+0000 7fe58f2cd700 1 --2- 172.21.15.63:0/1212685947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5881432f0 0x7fe58813d940 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:49.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.555+0000 7fe58f2cd700 1 -- 172.21.15.63:0/1212685947 >> 172.21.15.63:0/1212685947 conn(0x7fe588069b70 msgr2=0x7fe5880b9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:49.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.555+0000 7fe58f2cd700 1 -- 172.21.15.63:0/1212685947 shutdown_connections 2020-05-18T21:26:49.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.555+0000 7fe58f2cd700 1 -- 172.21.15.63:0/1212685947 wait complete. 2020-05-18T21:26:49.572 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-05-18T21:26:49.572 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:26:49.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.667+0000 7f75d0855700 1 Processor -- start 2020-05-18T21:26:49.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.667+0000 7f75d0855700 1 -- start start 2020-05-18T21:26:49.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.667+0000 7f75d0855700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 0x7f75cc0ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:49.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.667+0000 7f75d0855700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f75cc1435e0 0x7f75cc143a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:49.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.667+0000 7f75d0855700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc0ac4d0 con 0x7f75cc0b5c40 2020-05-18T21:26:49.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.667+0000 7f75d0855700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc0ac700 con 0x7f75cc1435e0 2020-05-18T21:26:49.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.667+0000 7f75d0855700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0ac9a0 con 0x7f75cc143200 2020-05-18T21:26:49.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.667+0000 7f75cad9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f75cc0b5c40 0x7f75cc061af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54818/0 (socket says 172.21.15.63:54818) 2020-05-18T21:26:49.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.667+0000 7f75cad9d700 1 -- 172.21.15.63:0/449714051 learned_addr learned my addr 172.21.15.63:0/449714051 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:49.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.667+0000 7f75c9d9b700 1 --2- 172.21.15.63:0/449714051 >> v2:172.21.15.155:3300/0 conn(0x7f75cc1435e0 0x7f75cc143a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:49.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.667+0000 7f75ca59c700 1 --2- 172.21.15.63:0/449714051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 0x7f75cc0ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:49.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.667+0000 7f75c959a700 1 -- 172.21.15.63:0/449714051 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855454892 0 0) 0x7f75cc0ac4d0 con 0x7f75cc0b5c40 2020-05-18T21:26:49.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.667+0000 7f75c959a700 1 -- 172.21.15.63:0/449714051 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75b0003270 con 0x7f75cc0b5c40 2020-05-18T21:26:49.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.667+0000 7f75c9d9b700 1 -- 172.21.15.63:0/449714051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 msgr2=0x7f75cc0ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:49.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.667+0000 7f75c9d9b700 1 --2- 172.21.15.63:0/449714051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 0x7f75cc0ad0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:49.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.667+0000 7f75c9d9b700 1 -- 172.21.15.63:0/449714051 >> v1:172.21.15.63:6789/0 conn(0x7f75cc0b5c40 legacy=0x7f75cc061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.667+0000 7f75c9d9b700 1 -- 172.21.15.63:0/449714051 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc0acc40 con 0x7f75cc1435e0 2020-05-18T21:26:49.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.671+0000 7f75c9d9b700 1 --2- 172.21.15.63:0/449714051 >> v2:172.21.15.155:3300/0 conn(0x7f75cc1435e0 0x7f75cc143a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f75c0002f70 tx=0x7f75c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.671+0000 7f75c9d9b700 1 --2- 172.21.15.63:0/449714051 >> v2:172.21.15.155:3300/0 conn(0x7f75cc1435e0 0x7f75cc143a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f75c0002f70 tx=0x7f75c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.671+0000 7f75c9d9b700 1 --2- 172.21.15.63:0/449714051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75cc1435e0 0x7f75cc143a20 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f75c0002f70 tx=0x7f75c0007a80).ready entity=mon.1 client_cookie=a543cd02f7848294 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:49.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.671+0000 7f75c9d9b700 1 --2- 172.21.15.63:0/449714051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75cc1435e0 0x7f75cc143a20 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f75c0002f70 tx=0x7f75c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.671+0000 7f75c959a700 1 -- 172.21.15.63:0/449714051 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75c0008e80 con 0x7f75cc1435e0 2020-05-18T21:26:49.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.671+0000 7f75c9d9b700 1 --2- 172.21.15.63:0/449714051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75cc1435e0 0x7f75cc143a20 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f75c0002f70 tx=0x7f75c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.671+0000 7f75c9d9b700 1 --2- 172.21.15.63:0/449714051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75cc1435e0 0x7f75cc143a20 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f75c0002f70 tx=0x7f75c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.671+0000 7f75c959a700 1 -- 172.21.15.63:0/449714051 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c0013750 con 0x7f75cc1435e0 2020-05-18T21:26:49.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.671+0000 7f75c959a700 1 -- 172.21.15.63:0/449714051 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75c0013b30 con 0x7f75cc1435e0 2020-05-18T21:26:49.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.671+0000 7f75d0855700 1 -- 172.21.15.63:0/449714051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75cc1435e0 msgr2=0x7f75cc143a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.671+0000 7f75d0855700 1 --2- 172.21.15.63:0/449714051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75cc1435e0 0x7f75cc143a20 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f75c0002f70 tx=0x7f75c0007a80).stop 2020-05-18T21:26:49.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.671+0000 7f75d0855700 1 -- 172.21.15.63:0/449714051 shutdown_connections 2020-05-18T21:26:49.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.671+0000 7f75d0855700 1 --2- 172.21.15.63:0/449714051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75cc1435e0 0x7f75cc143a20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:49.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.671+0000 7f75d0855700 1 --2- 172.21.15.63:0/449714051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 0x7f75cc0ad0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:49.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.671+0000 7f75d0855700 1 -- 172.21.15.63:0/449714051 >> 172.21.15.63:0/449714051 conn(0x7f75cc066d00 msgr2=0x7f75cc0b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:49.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.671+0000 7f75d0855700 1 -- 172.21.15.63:0/449714051 shutdown_connections 2020-05-18T21:26:49.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.671+0000 7f75d0855700 1 -- 172.21.15.63:0/449714051 wait complete. 2020-05-18T21:26:49.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.671+0000 7f75d0855700 1 Processor -- start 2020-05-18T21:26:49.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.671+0000 7f75d0855700 1 -- start start 2020-05-18T21:26:49.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75d0855700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 0x7f75cc0b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:49.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75d0855700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc13c910 con 0x7f75cc1435e0 2020-05-18T21:26:49.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75d0855700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc13cbb0 con 0x7f75cc0b5c40 2020-05-18T21:26:49.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75d0855700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc1574f0 con 0x7f75cc143200 2020-05-18T21:26:49.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75cad9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f75cc1435e0 0x7f75cc0b4bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54824/0 (socket says 172.21.15.63:54824) 2020-05-18T21:26:49.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75cad9d700 1 -- 172.21.15.63:0/3963042309 learned_addr learned my addr 172.21.15.63:0/3963042309 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:49.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75c9d9b700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 0x7f75cc0b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:49.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75bb7fe700 1 -- 172.21.15.63:0/3963042309 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846935692 0 0) 0x7f75cc13c910 con 0x7f75cc1435e0 2020-05-18T21:26:49.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75bb7fe700 1 -- 172.21.15.63:0/3963042309 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75a8002fe0 con 0x7f75cc1435e0 2020-05-18T21:26:49.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75bb7fe700 1 -- 172.21.15.63:0/3963042309 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775213453 0 0) 0x7f75cc13cbb0 con 0x7f75cc0b5c40 2020-05-18T21:26:49.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75bb7fe700 1 -- 172.21.15.63:0/3963042309 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75cc13c910 con 0x7f75cc0b5c40 2020-05-18T21:26:49.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75c9d9b700 1 -- 172.21.15.63:0/3963042309 >> v1:172.21.15.155:6789/0 conn(0x7f75cc0b5c40 legacy=0x7f75cc0b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75c9d9b700 1 -- 172.21.15.63:0/3963042309 >> v1:172.21.15.63:6789/0 conn(0x7f75cc1435e0 legacy=0x7f75cc0b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75c9d9b700 1 -- 172.21.15.63:0/3963042309 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc157630 con 0x7f75cc143200 2020-05-18T21:26:49.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75c9d9b700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 0x7f75cc0b4470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75cc1533f0 tx=0x7f75c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75c9d9b700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 0x7f75cc0b4470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75cc1533f0 tx=0x7f75c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75c9d9b700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 0x7f75cc0b4470 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f75cc1533f0 tx=0x7f75c0007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:49.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75c9d9b700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 0x7f75cc0b4470 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f75cc1533f0 tx=0x7f75c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75bb7fe700 1 -- 172.21.15.63:0/3963042309 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75c0013bd0 con 0x7f75cc143200 2020-05-18T21:26:49.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75c9d9b700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 0x7f75cc0b4470 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f75cc1533f0 tx=0x7f75c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75c9d9b700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 0x7f75cc0b4470 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f75cc1533f0 tx=0x7f75c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75bb7fe700 1 -- 172.21.15.63:0/3963042309 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c000fb20 con 0x7f75cc143200 2020-05-18T21:26:49.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75bb7fe700 1 -- 172.21.15.63:0/3963042309 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75c000fe80 con 0x7f75cc143200 2020-05-18T21:26:49.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75d0855700 1 -- 172.21.15.63:0/3963042309 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75cc13fea0 con 0x7f75cc143200 2020-05-18T21:26:49.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75d0855700 1 -- 172.21.15.63:0/3963042309 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75cc0b34a0 con 0x7f75cc143200 2020-05-18T21:26:49.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75c9d9b700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 0x7f75cc0b4470 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f75cc1533f0 tx=0x7f75c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.675+0000 7f75d0855700 1 -- 172.21.15.63:0/3963042309 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75cc0569e0 con 0x7f75cc143200 2020-05-18T21:26:49.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.679+0000 7f75bb7fe700 1 -- 172.21.15.63:0/3963042309 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f75c0007190 con 0x7f75cc143200 2020-05-18T21:26:49.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.679+0000 7f75c9d9b700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 0x7f75cc0b4470 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f75cc1533f0 tx=0x7f75c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.679+0000 7f75bb7fe700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f75a804fee0 0x7f75a80523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:49.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.679+0000 7f75bb7fe700 1 -- 172.21.15.63:0/3963042309 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f75c0063ce0 con 0x7f75cc143200 2020-05-18T21:26:49.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.679+0000 7f75ca59c700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f75a804fee0 0x7f75a80523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:49.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.679+0000 7f75ca59c700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f75a804fee0 0x7f75a80523a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75bc002f30 tx=0x7f75bc0090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.679+0000 7f75ca59c700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f75a804fee0 0x7f75a80523a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75bc002f30 tx=0x7f75bc0090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.679+0000 7f75ca59c700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f75a804fee0 0x7f75a80523a0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f75bc002f30 tx=0x7f75bc0090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:49.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.687+0000 7f75c9d9b700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 0x7f75cc0b4470 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f75cc1533f0 tx=0x7f75c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.687+0000 7f75bb7fe700 1 -- 172.21.15.63:0/3963042309 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f75c003e130 con 0x7f75cc143200 2020-05-18T21:26:49.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.807+0000 7f75d0855700 1 -- 172.21.15.63:0/3963042309 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75cc0b9c30 con 0x7f75cc143200 2020-05-18T21:26:49.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.811+0000 7f75c9d9b700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 0x7f75cc0b4470 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f75cc1533f0 tx=0x7f75c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.811+0000 7f75bb7fe700 1 -- 172.21.15.63:0/3963042309 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f75c0041750 con 0x7f75cc143200 2020-05-18T21:26:49.813 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:26:49.813 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":23,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:26:47.498250+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:26:43.453504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-05-18T21:26:44.456531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:26:49.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.811+0000 7f75d0855700 1 -- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f75a804fee0 msgr2=0x7f75a80523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.811+0000 7f75d0855700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f75a804fee0 0x7f75a80523a0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f75bc002f30 tx=0x7f75bc0090f0).stop 2020-05-18T21:26:49.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.811+0000 7f75d0855700 1 -- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 msgr2=0x7f75cc0b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.811+0000 7f75d0855700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 0x7f75cc0b4470 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f75cc1533f0 tx=0x7f75c0007a80).stop 2020-05-18T21:26:49.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.811+0000 7f75d0855700 1 -- 172.21.15.63:0/3963042309 shutdown_connections 2020-05-18T21:26:49.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.811+0000 7f75d0855700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f75a804fee0 0x7f75a80523a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:49.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.811+0000 7f75d0855700 1 --2- 172.21.15.63:0/3963042309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75cc143200 0x7f75cc0b4470 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:49.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.811+0000 7f75d0855700 1 -- 172.21.15.63:0/3963042309 >> 172.21.15.63:0/3963042309 conn(0x7f75cc066d00 msgr2=0x7f75cc06a150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:49.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.811+0000 7f75d0855700 1 -- 172.21.15.63:0/3963042309 shutdown_connections 2020-05-18T21:26:49.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.811+0000 7f75d0855700 1 -- 172.21.15.63:0/3963042309 wait complete. 2020-05-18T21:26:49.826 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-05-18T21:26:49.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5b542700 1 Processor -- start 2020-05-18T21:26:49.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5b542700 1 -- start start 2020-05-18T21:26:49.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5b542700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3c540b2310 0x7f3c5414e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:49.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5b542700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3c54065a10 0x7f3c5414a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:49.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5b542700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c5414ae20 0x7f3c540b89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:49.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5b542700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c540b4bd0 con 0x7f3c540b2310 2020-05-18T21:26:49.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5b542700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5414e660 con 0x7f3c54065a10 2020-05-18T21:26:49.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5b542700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5414a280 con 0x7f3c5414ae20 2020-05-18T21:26:49.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5a540700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3c540b2310 0x7f3c5414e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:49.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5a540700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3c540b2310 0x7f3c5414e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52642/0 (socket says 172.21.15.63:52642) 2020-05-18T21:26:49.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5a540700 1 -- 172.21.15.63:0/1961304048 learned_addr learned my addr 172.21.15.63:0/1961304048 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:49.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c59d3f700 1 --2- 172.21.15.63:0/1961304048 >> v2:172.21.15.155:3300/0 conn(0x7f3c54065a10 0x7f3c5414a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:49.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5ad41700 1 --2- 172.21.15.63:0/1961304048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c5414ae20 0x7f3c540b89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:49.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5a540700 1 -- 172.21.15.63:0/1961304048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c5414ae20 msgr2=0x7f3c540b89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:49.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5a540700 1 --2- 172.21.15.63:0/1961304048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c5414ae20 0x7f3c540b89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:49.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5a540700 1 -- 172.21.15.63:0/1961304048 >> v2:172.21.15.155:3300/0 conn(0x7f3c54065a10 msgr2=0x7f3c5414a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:49.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5a540700 1 --2- 172.21.15.63:0/1961304048 >> v2:172.21.15.155:3300/0 conn(0x7f3c54065a10 0x7f3c5414a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:49.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5a540700 1 -- 172.21.15.63:0/1961304048 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5414a520 con 0x7f3c540b2310 2020-05-18T21:26:49.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5ad41700 1 --2- 172.21.15.63:0/1961304048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c5414ae20 0x7f3c540b89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:26:49.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5a540700 1 --2- 172.21.15.63:0/1961304048 >> v2:172.21.15.63:3300/0 conn(0x7f3c540b2310 0x7f3c5414e0e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3c48002f70 tx=0x7f3c5405e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5a540700 1 --2- 172.21.15.63:0/1961304048 >> v2:172.21.15.63:3300/0 conn(0x7f3c540b2310 0x7f3c5414e0e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3c48002f70 tx=0x7f3c5405e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5a540700 1 --2- 172.21.15.63:0/1961304048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c540b2310 0x7f3c5414e0e0 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f3c48002f70 tx=0x7f3c5405e150).ready entity=mon.0 client_cookie=900d963a97cfbbb7 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:49.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5a540700 1 --2- 172.21.15.63:0/1961304048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c540b2310 0x7f3c5414e0e0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f3c48002f70 tx=0x7f3c5405e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5a540700 1 --2- 172.21.15.63:0/1961304048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c540b2310 0x7f3c5414e0e0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f3c48002f70 tx=0x7f3c5405e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5953e700 1 -- 172.21.15.63:0/1961304048 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c48011760 con 0x7f3c540b2310 2020-05-18T21:26:49.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5953e700 1 -- 172.21.15.63:0/1961304048 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c480118c0 con 0x7f3c540b2310 2020-05-18T21:26:49.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5a540700 1 --2- 172.21.15.63:0/1961304048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c540b2310 0x7f3c5414e0e0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f3c48002f70 tx=0x7f3c5405e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5953e700 1 -- 172.21.15.63:0/1961304048 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c48011ce0 con 0x7f3c540b2310 2020-05-18T21:26:49.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5b542700 1 -- 172.21.15.63:0/1961304048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c540b2310 msgr2=0x7f3c5414e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.923+0000 7f3c5b542700 1 --2- 172.21.15.63:0/1961304048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c540b2310 0x7f3c5414e0e0 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f3c48002f70 tx=0x7f3c5405e150).stop 2020-05-18T21:26:49.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c5b542700 1 -- 172.21.15.63:0/1961304048 shutdown_connections 2020-05-18T21:26:49.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c5b542700 1 --2- 172.21.15.63:0/1961304048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c5414ae20 0x7f3c540b89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:49.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c5b542700 1 --2- 172.21.15.63:0/1961304048 >> v2:172.21.15.155:3300/0 conn(0x7f3c54065a10 0x7f3c5414a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:49.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c5b542700 1 --2- 172.21.15.63:0/1961304048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c540b2310 0x7f3c5414e0e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:49.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c5b542700 1 -- 172.21.15.63:0/1961304048 >> 172.21.15.63:0/1961304048 conn(0x7f3c5405fb50 msgr2=0x7f3c540b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:49.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c5b542700 1 -- 172.21.15.63:0/1961304048 shutdown_connections 2020-05-18T21:26:49.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c5b542700 1 -- 172.21.15.63:0/1961304048 wait complete. 2020-05-18T21:26:49.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c5b542700 1 Processor -- start 2020-05-18T21:26:49.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c5b542700 1 -- start start 2020-05-18T21:26:49.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c5b542700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3c540b2310 0x7f3c540afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:49.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c5b542700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c540af2c0 con 0x7f3c5414ae20 2020-05-18T21:26:49.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c5b542700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c540b00c0 con 0x7f3c54065a10 2020-05-18T21:26:49.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c5b542700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c540af520 con 0x7f3c540b2310 2020-05-18T21:26:49.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c5ad41700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3c5414ae20 0x7f3c5414c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54838/0 (socket says 172.21.15.63:54838) 2020-05-18T21:26:49.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c5ad41700 1 -- 172.21.15.63:0/2819066344 learned_addr learned my addr 172.21.15.63:0/2819066344 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:49.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c59d3f700 1 --2- 172.21.15.63:0/2819066344 >> v2:172.21.15.155:3300/0 conn(0x7f3c540b2310 0x7f3c540afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:49.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c537fe700 1 -- 172.21.15.63:0/2819066344 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327343827 0 0) 0x7f3c540af2c0 con 0x7f3c5414ae20 2020-05-18T21:26:49.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c537fe700 1 -- 172.21.15.63:0/2819066344 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c34002fe0 con 0x7f3c5414ae20 2020-05-18T21:26:49.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c537fe700 1 -- 172.21.15.63:0/2819066344 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354940189 0 0) 0x7f3c540b00c0 con 0x7f3c54065a10 2020-05-18T21:26:49.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c537fe700 1 -- 172.21.15.63:0/2819066344 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c540af2c0 con 0x7f3c54065a10 2020-05-18T21:26:49.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c59d3f700 1 -- 172.21.15.63:0/2819066344 >> v1:172.21.15.155:6789/0 conn(0x7f3c54065a10 legacy=0x7f3c54137450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c59d3f700 1 -- 172.21.15.63:0/2819066344 >> v1:172.21.15.63:6789/0 conn(0x7f3c5414ae20 legacy=0x7f3c5414c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c59d3f700 1 -- 172.21.15.63:0/2819066344 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c540af7c0 con 0x7f3c540b2310 2020-05-18T21:26:49.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.927+0000 7f3c59d3f700 1 --2- 172.21.15.63:0/2819066344 >> v2:172.21.15.155:3300/0 conn(0x7f3c540b2310 0x7f3c540afc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3c440032f0 tx=0x7f3c44010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c59d3f700 1 --2- 172.21.15.63:0/2819066344 >> v2:172.21.15.155:3300/0 conn(0x7f3c540b2310 0x7f3c540afc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3c440032f0 tx=0x7f3c44010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c59d3f700 1 --2- 172.21.15.63:0/2819066344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c540b2310 0x7f3c540afc60 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f3c440032f0 tx=0x7f3c44010f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:49.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c59d3f700 1 --2- 172.21.15.63:0/2819066344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c540b2310 0x7f3c540afc60 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f3c440032f0 tx=0x7f3c44010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c537fe700 1 -- 172.21.15.63:0/2819066344 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c44007560 con 0x7f3c540b2310 2020-05-18T21:26:49.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c59d3f700 1 --2- 172.21.15.63:0/2819066344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c540b2310 0x7f3c540afc60 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f3c440032f0 tx=0x7f3c44010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c537fe700 1 -- 172.21.15.63:0/2819066344 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c440076c0 con 0x7f3c540b2310 2020-05-18T21:26:49.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c59d3f700 1 --2- 172.21.15.63:0/2819066344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c540b2310 0x7f3c540afc60 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f3c440032f0 tx=0x7f3c44010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c5b542700 1 -- 172.21.15.63:0/2819066344 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5414c9d0 con 0x7f3c540b2310 2020-05-18T21:26:49.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c537fe700 1 -- 172.21.15.63:0/2819066344 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c4400e650 con 0x7f3c540b2310 2020-05-18T21:26:49.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c5b542700 1 -- 172.21.15.63:0/2819066344 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c54137d80 con 0x7f3c540b2310 2020-05-18T21:26:49.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c5b542700 1 -- 172.21.15.63:0/2819066344 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c540af9c0 con 0x7f3c540b2310 2020-05-18T21:26:49.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c59d3f700 1 --2- 172.21.15.63:0/2819066344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c540b2310 0x7f3c540afc60 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f3c440032f0 tx=0x7f3c44010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c537fe700 1 -- 172.21.15.63:0/2819066344 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3c440101a0 con 0x7f3c540b2310 2020-05-18T21:26:49.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c59d3f700 1 --2- 172.21.15.63:0/2819066344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c540b2310 0x7f3c540afc60 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f3c440032f0 tx=0x7f3c44010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c59d3f700 1 --2- 172.21.15.63:0/2819066344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c540b2310 0x7f3c540afc60 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f3c440032f0 tx=0x7f3c44010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c537fe700 1 --2- 172.21.15.63:0/2819066344 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3c3404fe80 0x7f3c34052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:49.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c537fe700 1 -- 172.21.15.63:0/2819066344 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3c440090b0 con 0x7f3c540b2310 2020-05-18T21:26:49.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c537fe700 1 --2- 172.21.15.63:0/2819066344 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f3c340568d0 0x7f3c34058cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:49.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c537fe700 1 -- 172.21.15.63:0/2819066344 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c340592b0 con 0x7f3c340568d0 2020-05-18T21:26:49.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c537fe700 1 -- 172.21.15.63:0/2819066344 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c44063f90 con 0x7f3c540b2310 2020-05-18T21:26:49.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c5a540700 1 --2- 172.21.15.63:0/2819066344 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3c3404fe80 0x7f3c34052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:49.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.931+0000 7f3c5ad41700 1 --2- 172.21.15.63:0/2819066344 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f3c340568d0 0x7f3c34058cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:49.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.935+0000 7f3c5a540700 1 --2- 172.21.15.63:0/2819066344 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3c3404fe80 0x7f3c34052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3c48007f10 tx=0x7f3c5405e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.935+0000 7f3c5a540700 1 --2- 172.21.15.63:0/2819066344 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3c3404fe80 0x7f3c34052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3c48007f10 tx=0x7f3c5405e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:49.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.935+0000 7f3c5a540700 1 --2- 172.21.15.63:0/2819066344 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3c3404fe80 0x7f3c34052340 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f3c48007f10 tx=0x7f3c5405e150).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:49.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.935+0000 7f3c5ad41700 1 --2- 172.21.15.63:0/2819066344 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f3c340568d0 0x7f3c34058cf0 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:49.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.935+0000 7f3c537fe700 1 -- 172.21.15.63:0/2819066344 <== osd.0 v2:172.21.15.63:6800/12803 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23263 (crc 0 0 0) 0x7f3c340592b0 con 0x7f3c340568d0 2020-05-18T21:26:49.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.951+0000 7f3c5b542700 1 -- 172.21.15.63:0/2819066344 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3c54137d80 con 0x7f3c340568d0 2020-05-18T21:26:49.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.951+0000 7f3c537fe700 1 -- 172.21.15.63:0/2819066344 <== osd.0 v2:172.21.15.63:6800/12803 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3c54137d80 con 0x7f3c340568d0 2020-05-18T21:26:49.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.951+0000 7f3c5b542700 1 -- 172.21.15.63:0/2819066344 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f3c340568d0 msgr2=0x7f3c34058cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.951+0000 7f3c5b542700 1 --2- 172.21.15.63:0/2819066344 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f3c340568d0 0x7f3c34058cf0 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:49.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.951+0000 7f3c5b542700 1 -- 172.21.15.63:0/2819066344 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3c3404fe80 msgr2=0x7f3c34052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.951+0000 7f3c5b542700 1 --2- 172.21.15.63:0/2819066344 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3c3404fe80 0x7f3c34052340 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f3c48007f10 tx=0x7f3c5405e150).stop 2020-05-18T21:26:49.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.951+0000 7f3c5b542700 1 -- 172.21.15.63:0/2819066344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c540b2310 msgr2=0x7f3c540afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:49.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.951+0000 7f3c5b542700 1 --2- 172.21.15.63:0/2819066344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c540b2310 0x7f3c540afc60 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f3c440032f0 tx=0x7f3c44010f70).stop 2020-05-18T21:26:49.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.951+0000 7f3c5ad41700 1 -- 172.21.15.63:0/2819066344 reap_dead start 2020-05-18T21:26:49.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.951+0000 7f3c5b542700 1 -- 172.21.15.63:0/2819066344 shutdown_connections 2020-05-18T21:26:49.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.951+0000 7f3c5b542700 1 --2- 172.21.15.63:0/2819066344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c540b2310 0x7f3c540afc60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:49.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.951+0000 7f3c5b542700 1 -- 172.21.15.63:0/2819066344 >> 172.21.15.63:0/2819066344 conn(0x7f3c5405fb50 msgr2=0x7f3c541497f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:49.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.951+0000 7f3c5b542700 1 -- 172.21.15.63:0/2819066344 shutdown_connections 2020-05-18T21:26:49.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:49.951+0000 7f3c5b542700 1 -- 172.21.15.63:0/2819066344 wait complete. 2020-05-18T21:26:49.967 INFO:teuthology.orchestra.run.smithi063.stdout:55834574852 2020-05-18T21:26:49.967 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-05-18T21:26:50.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.067+0000 7eff87d70700 1 Processor -- start 2020-05-18T21:26:50.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.067+0000 7eff87d70700 1 -- start start 2020-05-18T21:26:50.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff87d70700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff800ba8c0 0x7eff800b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:50.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff87d70700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7eff800b45e0 0x7eff801448e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:50.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff87d70700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7eff801410a0 0x7eff80141510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:50.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff87d70700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff80141970 con 0x7eff801410a0 2020-05-18T21:26:50.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff87d70700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff800b27b0 con 0x7eff800b45e0 2020-05-18T21:26:50.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff87d70700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff801441a0 con 0x7eff800ba8c0 2020-05-18T21:26:50.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff8630d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7eff801410a0 0x7eff80141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff8630d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7eff801410a0 0x7eff80141510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52660/0 (socket says 172.21.15.63:52660) 2020-05-18T21:26:50.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff8530b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7eff800b45e0 0x7eff801448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff8630d700 1 -- 172.21.15.63:0/1552323264 learned_addr learned my addr 172.21.15.63:0/1552323264 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:50.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff85b0c700 1 --2- 172.21.15.63:0/1552323264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff800ba8c0 0x7eff800b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff8630d700 1 -- 172.21.15.63:0/1552323264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff800ba8c0 msgr2=0x7eff800b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:50.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff8630d700 1 --2- 172.21.15.63:0/1552323264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff800ba8c0 0x7eff800b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:50.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff8630d700 1 -- 172.21.15.63:0/1552323264 >> v2:172.21.15.155:3300/0 conn(0x7eff800b45e0 msgr2=0x7eff801448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:50.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff8630d700 1 --2- 172.21.15.63:0/1552323264 >> v2:172.21.15.155:3300/0 conn(0x7eff800b45e0 0x7eff801448e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:50.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff8630d700 1 -- 172.21.15.63:0/1552323264 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff80144440 con 0x7eff801410a0 2020-05-18T21:26:50.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff8530b700 1 --2- 172.21.15.63:0/1552323264 >> v2:172.21.15.155:3300/0 conn(0x7eff800b45e0 0x7eff801448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:26:50.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff8630d700 1 --2- 172.21.15.63:0/1552323264 >> v2:172.21.15.63:3300/0 conn(0x7eff801410a0 0x7eff80141510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7eff780032f0 tx=0x7eff78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff8630d700 1 --2- 172.21.15.63:0/1552323264 >> v2:172.21.15.63:3300/0 conn(0x7eff801410a0 0x7eff80141510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7eff780032f0 tx=0x7eff78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff8630d700 1 --2- 172.21.15.63:0/1552323264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff801410a0 0x7eff80141510 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7eff780032f0 tx=0x7eff78007e00).ready entity=mon.0 client_cookie=e78e6b59501d5261 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff8630d700 1 --2- 172.21.15.63:0/1552323264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff801410a0 0x7eff80141510 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7eff780032f0 tx=0x7eff78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff8630d700 1 --2- 172.21.15.63:0/1552323264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff801410a0 0x7eff80141510 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7eff780032f0 tx=0x7eff78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff84b0a700 1 -- 172.21.15.63:0/1552323264 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff78011c60 con 0x7eff801410a0 2020-05-18T21:26:50.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff8630d700 1 --2- 172.21.15.63:0/1552323264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff801410a0 0x7eff80141510 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7eff780032f0 tx=0x7eff78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff84b0a700 1 -- 172.21.15.63:0/1552323264 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff78011dc0 con 0x7eff801410a0 2020-05-18T21:26:50.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff84b0a700 1 -- 172.21.15.63:0/1552323264 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff7800a370 con 0x7eff801410a0 2020-05-18T21:26:50.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff87d70700 1 -- 172.21.15.63:0/1552323264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff801410a0 msgr2=0x7eff80141510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff87d70700 1 --2- 172.21.15.63:0/1552323264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff801410a0 0x7eff80141510 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7eff780032f0 tx=0x7eff78007e00).stop 2020-05-18T21:26:50.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff87d70700 1 -- 172.21.15.63:0/1552323264 shutdown_connections 2020-05-18T21:26:50.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff87d70700 1 --2- 172.21.15.63:0/1552323264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff801410a0 0x7eff80141510 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff87d70700 1 --2- 172.21.15.63:0/1552323264 >> v2:172.21.15.155:3300/0 conn(0x7eff800b45e0 0x7eff801448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:50.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff87d70700 1 --2- 172.21.15.63:0/1552323264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff800ba8c0 0x7eff800b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:50.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff87d70700 1 -- 172.21.15.63:0/1552323264 >> 172.21.15.63:0/1552323264 conn(0x7eff8005f410 msgr2=0x7eff8005f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:50.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff87d70700 1 -- 172.21.15.63:0/1552323264 shutdown_connections 2020-05-18T21:26:50.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.071+0000 7eff87d70700 1 -- 172.21.15.63:0/1552323264 wait complete. 2020-05-18T21:26:50.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff87d70700 1 Processor -- start 2020-05-18T21:26:50.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff87d70700 1 -- start start 2020-05-18T21:26:50.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff87d70700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7eff800b45e0 0x7eff80064e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff87d70700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7eff801410a0 0x7eff801449c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff87d70700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff80155120 con 0x7eff800ba8c0 2020-05-18T21:26:50.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff87d70700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff800652b0 con 0x7eff801410a0 2020-05-18T21:26:50.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff87d70700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff80155390 con 0x7eff800b45e0 2020-05-18T21:26:50.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff8630d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7eff801410a0 0x7eff801449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff85b0c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7eff800b45e0 0x7eff80064e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff85b0c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7eff800b45e0 0x7eff80064e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:39278/0 (socket says 172.21.15.63:39278) 2020-05-18T21:26:50.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff8530b700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7eff800ba8c0 0x7eff80154a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:53168/0 (socket says 172.21.15.63:53168) 2020-05-18T21:26:50.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff8630d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7eff801410a0 0x7eff801449c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52666/0 (socket says 172.21.15.63:52666) 2020-05-18T21:26:50.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff85b0c700 1 -- 172.21.15.63:0/3295002238 learned_addr learned my addr 172.21.15.63:0/3295002238 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:50.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff85b0c700 1 -- 172.21.15.63:0/3295002238 >> v2:172.21.15.63:3300/0 conn(0x7eff801410a0 msgr2=0x7eff801449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff85b0c700 1 --2- 172.21.15.63:0/3295002238 >> v2:172.21.15.63:3300/0 conn(0x7eff801410a0 0x7eff801449c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff85b0c700 1 -- 172.21.15.63:0/3295002238 >> v1:172.21.15.155:6789/0 conn(0x7eff800ba8c0 legacy=0x7eff80154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff85b0c700 1 -- 172.21.15.63:0/3295002238 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff80155630 con 0x7eff800b45e0 2020-05-18T21:26:50.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff8630d700 1 --2- 172.21.15.63:0/3295002238 >> v2:172.21.15.63:3300/0 conn(0x7eff801410a0 0x7eff801449c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:26:50.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff85b0c700 1 --2- 172.21.15.63:0/3295002238 >> v2:172.21.15.155:3300/0 conn(0x7eff800b45e0 0x7eff80064e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7eff74007760 tx=0x7eff7c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff85b0c700 1 --2- 172.21.15.63:0/3295002238 >> v2:172.21.15.155:3300/0 conn(0x7eff800b45e0 0x7eff80064e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7eff74007760 tx=0x7eff7c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff85b0c700 1 --2- 172.21.15.63:0/3295002238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff800b45e0 0x7eff80064e50 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7eff74007760 tx=0x7eff7c010ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff85b0c700 1 --2- 172.21.15.63:0/3295002238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff800b45e0 0x7eff80064e50 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7eff74007760 tx=0x7eff7c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff72ffd700 1 -- 172.21.15.63:0/3295002238 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff7c007560 con 0x7eff800b45e0 2020-05-18T21:26:50.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff85b0c700 1 --2- 172.21.15.63:0/3295002238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff800b45e0 0x7eff80064e50 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7eff74007760 tx=0x7eff7c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff85b0c700 1 --2- 172.21.15.63:0/3295002238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff800b45e0 0x7eff80064e50 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7eff74007760 tx=0x7eff7c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff72ffd700 1 -- 172.21.15.63:0/3295002238 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c005a00 con 0x7eff800b45e0 2020-05-18T21:26:50.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff87d70700 1 -- 172.21.15.63:0/3295002238 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff801483e0 con 0x7eff800b45e0 2020-05-18T21:26:50.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff72ffd700 1 -- 172.21.15.63:0/3295002238 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff7c005da0 con 0x7eff800b45e0 2020-05-18T21:26:50.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.075+0000 7eff87d70700 1 -- 172.21.15.63:0/3295002238 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff80145040 con 0x7eff800b45e0 2020-05-18T21:26:50.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.079+0000 7eff87d70700 1 -- 172.21.15.63:0/3295002238 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7eff80155830 con 0x7eff800b45e0 2020-05-18T21:26:50.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.079+0000 7eff85b0c700 1 --2- 172.21.15.63:0/3295002238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff800b45e0 0x7eff80064e50 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7eff74007760 tx=0x7eff7c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.079+0000 7eff72ffd700 1 -- 172.21.15.63:0/3295002238 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7eff7c0089b0 con 0x7eff800b45e0 2020-05-18T21:26:50.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.079+0000 7eff85b0c700 1 --2- 172.21.15.63:0/3295002238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff800b45e0 0x7eff80064e50 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7eff74007760 tx=0x7eff7c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.079+0000 7eff85b0c700 1 --2- 172.21.15.63:0/3295002238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff800b45e0 0x7eff80064e50 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7eff74007760 tx=0x7eff7c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.079+0000 7eff72ffd700 1 --2- 172.21.15.63:0/3295002238 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff6004fa30 0x7eff60051ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.079+0000 7eff72ffd700 1 -- 172.21.15.63:0/3295002238 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7eff7c063be0 con 0x7eff800b45e0 2020-05-18T21:26:50.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.079+0000 7eff8530b700 1 --2- 172.21.15.63:0/3295002238 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff6004fa30 0x7eff60051ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.079+0000 7eff72ffd700 1 --2- 172.21.15.63:0/3295002238 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7eff60056610 0x7eff60058a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.079+0000 7eff72ffd700 1 -- 172.21.15.63:0/3295002238 --> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7eff60058ff0 con 0x7eff60056610 2020-05-18T21:26:50.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.079+0000 7eff72ffd700 1 -- 172.21.15.63:0/3295002238 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff7c064f80 con 0x7eff800b45e0 2020-05-18T21:26:50.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.079+0000 7eff8630d700 1 --2- 172.21.15.63:0/3295002238 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7eff60056610 0x7eff60058a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.079+0000 7eff8530b700 1 --2- 172.21.15.63:0/3295002238 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff6004fa30 0x7eff60051ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7eff74002f30 tx=0x7eff740093b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.079+0000 7eff8530b700 1 --2- 172.21.15.63:0/3295002238 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff6004fa30 0x7eff60051ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7eff74002f30 tx=0x7eff740093b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.079+0000 7eff8530b700 1 --2- 172.21.15.63:0/3295002238 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff6004fa30 0x7eff60051ef0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7eff74002f30 tx=0x7eff740093b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.079+0000 7eff8630d700 1 --2- 172.21.15.63:0/3295002238 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7eff60056610 0x7eff60058a30 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.083+0000 7eff72ffd700 1 -- 172.21.15.63:0/3295002238 <== osd.1 v2:172.21.15.63:6808/12804 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23263 (crc 0 0 0) 0x7eff60058ff0 con 0x7eff60056610 2020-05-18T21:26:50.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.099+0000 7eff87d70700 1 -- 172.21.15.63:0/3295002238 --> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7eff80143030 con 0x7eff60056610 2020-05-18T21:26:50.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.103+0000 7eff72ffd700 1 -- 172.21.15.63:0/3295002238 <== osd.1 v2:172.21.15.63:6808/12804 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7eff80143030 con 0x7eff60056610 2020-05-18T21:26:50.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.103+0000 7eff87d70700 1 -- 172.21.15.63:0/3295002238 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7eff60056610 msgr2=0x7eff60058a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.103+0000 7eff87d70700 1 --2- 172.21.15.63:0/3295002238 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7eff60056610 0x7eff60058a30 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.103+0000 7eff87d70700 1 -- 172.21.15.63:0/3295002238 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff6004fa30 msgr2=0x7eff60051ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.103+0000 7eff87d70700 1 --2- 172.21.15.63:0/3295002238 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff6004fa30 0x7eff60051ef0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7eff74002f30 tx=0x7eff740093b0).stop 2020-05-18T21:26:50.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.103+0000 7eff87d70700 1 -- 172.21.15.63:0/3295002238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff800b45e0 msgr2=0x7eff80064e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.103+0000 7eff87d70700 1 --2- 172.21.15.63:0/3295002238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff800b45e0 0x7eff80064e50 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7eff74007760 tx=0x7eff7c010ca0).stop 2020-05-18T21:26:50.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.103+0000 7eff8630d700 1 -- 172.21.15.63:0/3295002238 reap_dead start 2020-05-18T21:26:50.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.103+0000 7eff87d70700 1 -- 172.21.15.63:0/3295002238 shutdown_connections 2020-05-18T21:26:50.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.103+0000 7eff87d70700 1 --2- 172.21.15.63:0/3295002238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff800b45e0 0x7eff80064e50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.103+0000 7eff87d70700 1 -- 172.21.15.63:0/3295002238 >> 172.21.15.63:0/3295002238 conn(0x7eff8005f410 msgr2=0x7eff800b7810 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:50.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.103+0000 7eff87d70700 1 -- 172.21.15.63:0/3295002238 shutdown_connections 2020-05-18T21:26:50.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.103+0000 7eff87d70700 1 -- 172.21.15.63:0/3295002238 wait complete. 2020-05-18T21:26:50.120 INFO:teuthology.orchestra.run.smithi063.stdout:55834574852 2020-05-18T21:26:50.120 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-05-18T21:26:50.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f23a635d700 1 Processor -- start 2020-05-18T21:26:50.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f23a635d700 1 -- start start 2020-05-18T21:26:50.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f23a635d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f23a0066260 0x7f23a0062850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:50.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f23a635d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23a0142e50 0x7f23a01432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:50.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f23a635d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a01467f0 con 0x7f23a00ba170 2020-05-18T21:26:50.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f23a635d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a0146a90 con 0x7f23a0066260 2020-05-18T21:26:50.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f23a635d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a0146d30 con 0x7f23a0142e50 2020-05-18T21:26:50.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f239f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f23a0066260 0x7f23a0062850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f239f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f23a0066260 0x7f23a0062850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52676/0 (socket says 172.21.15.63:52676) 2020-05-18T21:26:50.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f239f7fe700 1 -- 172.21.15.63:0/1423201282 learned_addr learned my addr 172.21.15.63:0/1423201282 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f23a48fa700 1 --2- 172.21.15.63:0/1423201282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23a0142e50 0x7f23a01432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f239f7fe700 1 -- 172.21.15.63:0/1423201282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23a0142e50 msgr2=0x7f23a01432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f239f7fe700 1 --2- 172.21.15.63:0/1423201282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23a0142e50 0x7f23a01432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f239effd700 1 -- 172.21.15.63:0/1423201282 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593467910 0 0) 0x7f23a01467f0 con 0x7f23a00ba170 2020-05-18T21:26:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f239f7fe700 1 -- 172.21.15.63:0/1423201282 >> v1:172.21.15.155:6789/0 conn(0x7f23a00ba170 legacy=0x7f23a013cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f239f7fe700 1 -- 172.21.15.63:0/1423201282 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a00ba550 con 0x7f23a0066260 2020-05-18T21:26:50.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f239f7fe700 1 --2- 172.21.15.63:0/1423201282 >> v2:172.21.15.63:3300/0 conn(0x7f23a0066260 0x7f23a0062850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2394002f70 tx=0x7f2394007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f239f7fe700 1 --2- 172.21.15.63:0/1423201282 >> v2:172.21.15.63:3300/0 conn(0x7f23a0066260 0x7f23a0062850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2394002f70 tx=0x7f2394007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f239f7fe700 1 --2- 172.21.15.63:0/1423201282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23a0066260 0x7f23a0062850 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f2394002f70 tx=0x7f2394007a80).ready entity=mon.0 client_cookie=14df67d95ab8a86f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f239f7fe700 1 --2- 172.21.15.63:0/1423201282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23a0066260 0x7f23a0062850 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f2394002f70 tx=0x7f2394007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f239f7fe700 1 --2- 172.21.15.63:0/1423201282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23a0066260 0x7f23a0062850 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f2394002f70 tx=0x7f2394007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f239effd700 1 -- 172.21.15.63:0/1423201282 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23940116b0 con 0x7f23a0066260 2020-05-18T21:26:50.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f239f7fe700 1 --2- 172.21.15.63:0/1423201282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23a0066260 0x7f23a0062850 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f2394002f70 tx=0x7f2394007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f239effd700 1 -- 172.21.15.63:0/1423201282 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2394011810 con 0x7f23a0066260 2020-05-18T21:26:50.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f239effd700 1 -- 172.21.15.63:0/1423201282 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2394011bf0 con 0x7f23a0066260 2020-05-18T21:26:50.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f23a635d700 1 -- 172.21.15.63:0/1423201282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23a0066260 msgr2=0x7f23a0062850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f23a635d700 1 --2- 172.21.15.63:0/1423201282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23a0066260 0x7f23a0062850 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f2394002f70 tx=0x7f2394007a80).stop 2020-05-18T21:26:50.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f23a635d700 1 -- 172.21.15.63:0/1423201282 shutdown_connections 2020-05-18T21:26:50.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f23a635d700 1 --2- 172.21.15.63:0/1423201282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23a0142e50 0x7f23a01432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:50.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f23a635d700 1 --2- 172.21.15.63:0/1423201282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23a0066260 0x7f23a0062850 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.211+0000 7f23a635d700 1 -- 172.21.15.63:0/1423201282 >> 172.21.15.63:0/1423201282 conn(0x7f23a005b170 msgr2=0x7f23a00b9720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:50.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.215+0000 7f23a635d700 1 -- 172.21.15.63:0/1423201282 shutdown_connections 2020-05-18T21:26:50.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.215+0000 7f23a635d700 1 -- 172.21.15.63:0/1423201282 wait complete. 2020-05-18T21:26:50.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.215+0000 7f23a635d700 1 Processor -- start 2020-05-18T21:26:50.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.215+0000 7f23a635d700 1 -- start start 2020-05-18T21:26:50.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.215+0000 7f23a635d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f23a0066260 0x7f23a013d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.215+0000 7f23a635d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a013ddf0 con 0x7f23a00ba170 2020-05-18T21:26:50.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.215+0000 7f23a635d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a013e090 con 0x7f23a0142e50 2020-05-18T21:26:50.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.215+0000 7f23a635d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a01404a0 con 0x7f23a0066260 2020-05-18T21:26:50.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f239f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f23a00ba170 0x7f23a00b8ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54868/0 (socket says 172.21.15.63:54868) 2020-05-18T21:26:50.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f239f7fe700 1 -- 172.21.15.63:0/1455867481 learned_addr learned my addr 172.21.15.63:0/1455867481 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:50.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f239ffff700 1 --2- 172.21.15.63:0/1455867481 >> v2:172.21.15.155:3300/0 conn(0x7f23a0066260 0x7f23a013d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f239d7fa700 1 -- 172.21.15.63:0/1455867481 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314793161 0 0) 0x7f23a013ddf0 con 0x7f23a00ba170 2020-05-18T21:26:50.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f239d7fa700 1 -- 172.21.15.63:0/1455867481 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2380002fe0 con 0x7f23a00ba170 2020-05-18T21:26:50.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f239d7fa700 1 -- 172.21.15.63:0/1455867481 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551503677 0 0) 0x7f23a013e090 con 0x7f23a0142e50 2020-05-18T21:26:50.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f239d7fa700 1 -- 172.21.15.63:0/1455867481 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23a013ddf0 con 0x7f23a0142e50 2020-05-18T21:26:50.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f239ffff700 1 -- 172.21.15.63:0/1455867481 >> v1:172.21.15.155:6789/0 conn(0x7f23a0142e50 legacy=0x7f23a013b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f239ffff700 1 -- 172.21.15.63:0/1455867481 >> v1:172.21.15.63:6789/0 conn(0x7f23a00ba170 legacy=0x7f23a00b8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f239ffff700 1 -- 172.21.15.63:0/1455867481 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a00b91d0 con 0x7f23a0066260 2020-05-18T21:26:50.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f239ffff700 1 --2- 172.21.15.63:0/1455867481 >> v2:172.21.15.155:3300/0 conn(0x7f23a0066260 0x7f23a013d870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2398001250 tx=0x7f2398010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f239ffff700 1 --2- 172.21.15.63:0/1455867481 >> v2:172.21.15.155:3300/0 conn(0x7f23a0066260 0x7f23a013d870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2398001250 tx=0x7f2398010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f239ffff700 1 --2- 172.21.15.63:0/1455867481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a0066260 0x7f23a013d870 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f2398001250 tx=0x7f2398010cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f239ffff700 1 --2- 172.21.15.63:0/1455867481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a0066260 0x7f23a013d870 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f2398001250 tx=0x7f2398010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f239d7fa700 1 -- 172.21.15.63:0/1455867481 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23980122a0 con 0x7f23a0066260 2020-05-18T21:26:50.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f239ffff700 1 --2- 172.21.15.63:0/1455867481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a0066260 0x7f23a013d870 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f2398001250 tx=0x7f2398010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f239ffff700 1 --2- 172.21.15.63:0/1455867481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a0066260 0x7f23a013d870 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f2398001250 tx=0x7f2398010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f239d7fa700 1 -- 172.21.15.63:0/1455867481 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2398012400 con 0x7f23a0066260 2020-05-18T21:26:50.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f239d7fa700 1 -- 172.21.15.63:0/1455867481 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23980127e0 con 0x7f23a0066260 2020-05-18T21:26:50.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f23a635d700 1 -- 172.21.15.63:0/1455867481 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a01432c0 con 0x7f23a0066260 2020-05-18T21:26:50.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f23a635d700 1 -- 172.21.15.63:0/1455867481 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a0134450 con 0x7f23a0066260 2020-05-18T21:26:50.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.219+0000 7f23a635d700 1 -- 172.21.15.63:0/1455867481 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f23a00569e0 con 0x7f23a0066260 2020-05-18T21:26:50.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.223+0000 7f239ffff700 1 --2- 172.21.15.63:0/1455867481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a0066260 0x7f23a013d870 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f2398001250 tx=0x7f2398010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.223+0000 7f239d7fa700 1 -- 172.21.15.63:0/1455867481 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2398012a50 con 0x7f23a0066260 2020-05-18T21:26:50.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.223+0000 7f239ffff700 1 --2- 172.21.15.63:0/1455867481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a0066260 0x7f23a013d870 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f2398001250 tx=0x7f2398010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.223+0000 7f239ffff700 1 --2- 172.21.15.63:0/1455867481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a0066260 0x7f23a013d870 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f2398001250 tx=0x7f2398010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.223+0000 7f239d7fa700 1 --2- 172.21.15.63:0/1455867481 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f238004fed0 0x7f2380052390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.223+0000 7f239d7fa700 1 -- 172.21.15.63:0/1455867481 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2398064660 con 0x7f23a0066260 2020-05-18T21:26:50.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.223+0000 7f239d7fa700 1 --2- 172.21.15.63:0/1455867481 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f2380056920 0x7f2380058d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.223+0000 7f239f7fe700 1 --2- 172.21.15.63:0/1455867481 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f238004fed0 0x7f2380052390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.223+0000 7f239d7fa700 1 -- 172.21.15.63:0/1455867481 --> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2380059300 con 0x7f2380056920 2020-05-18T21:26:50.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.223+0000 7f239d7fa700 1 -- 172.21.15.63:0/1455867481 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23980649c0 con 0x7f23a0066260 2020-05-18T21:26:50.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.223+0000 7f23a48fa700 1 --2- 172.21.15.63:0/1455867481 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f2380056920 0x7f2380058d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.223+0000 7f239f7fe700 1 --2- 172.21.15.63:0/1455867481 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f238004fed0 0x7f2380052390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2394008920 tx=0x7f2394007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.223+0000 7f239f7fe700 1 --2- 172.21.15.63:0/1455867481 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f238004fed0 0x7f2380052390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2394008920 tx=0x7f2394007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.223+0000 7f239f7fe700 1 --2- 172.21.15.63:0/1455867481 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f238004fed0 0x7f2380052390 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f2394008920 tx=0x7f2394007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.223+0000 7f23a48fa700 1 --2- 172.21.15.63:0/1455867481 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f2380056920 0x7f2380058d40 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.223+0000 7f239d7fa700 1 -- 172.21.15.63:0/1455867481 <== osd.2 v2:172.21.15.63:6822/12806 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23263 (crc 0 0 0) 0x7f2380059300 con 0x7f2380056920 2020-05-18T21:26:50.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.239+0000 7f23a635d700 1 -- 172.21.15.63:0/1455867481 --> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f23a01461b0 con 0x7f2380056920 2020-05-18T21:26:50.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.243+0000 7f239d7fa700 1 -- 172.21.15.63:0/1455867481 <== osd.2 v2:172.21.15.63:6822/12806 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f23a01461b0 con 0x7f2380056920 2020-05-18T21:26:50.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.243+0000 7f23a635d700 1 -- 172.21.15.63:0/1455867481 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f2380056920 msgr2=0x7f2380058d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.243+0000 7f23a635d700 1 --2- 172.21.15.63:0/1455867481 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f2380056920 0x7f2380058d40 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.243+0000 7f23a635d700 1 -- 172.21.15.63:0/1455867481 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f238004fed0 msgr2=0x7f2380052390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.243+0000 7f23a635d700 1 --2- 172.21.15.63:0/1455867481 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f238004fed0 0x7f2380052390 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f2394008920 tx=0x7f2394007a80).stop 2020-05-18T21:26:50.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.243+0000 7f23a635d700 1 -- 172.21.15.63:0/1455867481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a0066260 msgr2=0x7f23a013d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.243+0000 7f23a635d700 1 --2- 172.21.15.63:0/1455867481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a0066260 0x7f23a013d870 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f2398001250 tx=0x7f2398010cb0).stop 2020-05-18T21:26:50.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.243+0000 7f23a48fa700 1 -- 172.21.15.63:0/1455867481 reap_dead start 2020-05-18T21:26:50.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.243+0000 7f23a635d700 1 -- 172.21.15.63:0/1455867481 shutdown_connections 2020-05-18T21:26:50.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.243+0000 7f23a635d700 1 --2- 172.21.15.63:0/1455867481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a0066260 0x7f23a013d870 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.243+0000 7f23a635d700 1 -- 172.21.15.63:0/1455867481 >> 172.21.15.63:0/1455867481 conn(0x7f23a005b170 msgr2=0x7f23a00b4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:50.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.243+0000 7f23a635d700 1 -- 172.21.15.63:0/1455867481 shutdown_connections 2020-05-18T21:26:50.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.243+0000 7f23a635d700 1 -- 172.21.15.63:0/1455867481 wait complete. 2020-05-18T21:26:50.256 INFO:teuthology.orchestra.run.smithi063.stdout:55834574852 2020-05-18T21:26:50.256 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-05-18T21:26:50.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.359+0000 7f5a3723e700 1 Processor -- start 2020-05-18T21:26:50.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.359+0000 7f5a3723e700 1 -- start start 2020-05-18T21:26:50.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.359+0000 7f5a3723e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a30141dc0 0x7f5a30060ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:50.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.359+0000 7f5a3723e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a3014b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:50.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.359+0000 7f5a3723e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3009c140 con 0x7f5a3009c340 2020-05-18T21:26:50.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.359+0000 7f5a3723e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3009c780 con 0x7f5a30141dc0 2020-05-18T21:26:50.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.359+0000 7f5a3723e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3009e640 con 0x7f5a300b4410 2020-05-18T21:26:50.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.359+0000 7f5a36a3d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a3014b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.359+0000 7f5a35a3b700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f5a3009c340 0x7f5a3005ebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:53192/0 (socket says 172.21.15.63:53192) 2020-05-18T21:26:50.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.359+0000 7f5a3623c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a30141dc0 0x7f5a30060ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.359+0000 7f5a35a3b700 1 -- 172.21.15.63:0/2799426814 learned_addr learned my addr 172.21.15.63:0/2799426814 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:50.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a3523a700 1 -- 172.21.15.63:0/2799426814 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062360176 0 0) 0x7f5a3009c140 con 0x7f5a3009c340 2020-05-18T21:26:50.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a3523a700 1 -- 172.21.15.63:0/2799426814 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a18003270 con 0x7f5a3009c340 2020-05-18T21:26:50.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a36a3d700 1 -- 172.21.15.63:0/2799426814 >> v2:172.21.15.155:3300/0 conn(0x7f5a30141dc0 msgr2=0x7f5a30060ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:50.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a36a3d700 1 --2- 172.21.15.63:0/2799426814 >> v2:172.21.15.155:3300/0 conn(0x7f5a30141dc0 0x7f5a30060ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:50.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a36a3d700 1 -- 172.21.15.63:0/2799426814 >> v1:172.21.15.155:6789/0 conn(0x7f5a3009c340 legacy=0x7f5a3005ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a36a3d700 1 -- 172.21.15.63:0/2799426814 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3009e8e0 con 0x7f5a300b4410 2020-05-18T21:26:50.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a36a3d700 1 --2- 172.21.15.63:0/2799426814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a3014b7a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5a280032f0 tx=0x7f5a28007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a36a3d700 1 --2- 172.21.15.63:0/2799426814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a3014b7a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5a280032f0 tx=0x7f5a28007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a36a3d700 1 --2- 172.21.15.63:0/2799426814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a3014b7a0 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f5a280032f0 tx=0x7f5a28007e00).ready entity=mon.2 client_cookie=614d3ab7a5608b98 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a36a3d700 1 --2- 172.21.15.63:0/2799426814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a3014b7a0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f5a280032f0 tx=0x7f5a28007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a3523a700 1 -- 172.21.15.63:0/2799426814 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a28011db0 con 0x7f5a300b4410 2020-05-18T21:26:50.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a36a3d700 1 --2- 172.21.15.63:0/2799426814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a3014b7a0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f5a280032f0 tx=0x7f5a28007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a3523a700 1 -- 172.21.15.63:0/2799426814 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2800a180 con 0x7f5a300b4410 2020-05-18T21:26:50.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a36a3d700 1 --2- 172.21.15.63:0/2799426814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a3014b7a0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f5a280032f0 tx=0x7f5a28007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a3523a700 1 -- 172.21.15.63:0/2799426814 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a2800a5a0 con 0x7f5a300b4410 2020-05-18T21:26:50.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a3723e700 1 -- 172.21.15.63:0/2799426814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 msgr2=0x7f5a3014b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a3723e700 1 --2- 172.21.15.63:0/2799426814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a3014b7a0 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f5a280032f0 tx=0x7f5a28007e00).stop 2020-05-18T21:26:50.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a3723e700 1 -- 172.21.15.63:0/2799426814 shutdown_connections 2020-05-18T21:26:50.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a3723e700 1 --2- 172.21.15.63:0/2799426814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a3014b7a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a3723e700 1 --2- 172.21.15.63:0/2799426814 >> v2:172.21.15.155:3300/0 conn(0x7f5a30141dc0 0x7f5a30060ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:50.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a3723e700 1 -- 172.21.15.63:0/2799426814 >> 172.21.15.63:0/2799426814 conn(0x7f5a300b9630 msgr2=0x7f5a300b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:50.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a3723e700 1 -- 172.21.15.63:0/2799426814 shutdown_connections 2020-05-18T21:26:50.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a3723e700 1 -- 172.21.15.63:0/2799426814 wait complete. 2020-05-18T21:26:50.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a3723e700 1 Processor -- start 2020-05-18T21:26:50.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.363+0000 7f5a3723e700 1 -- start start 2020-05-18T21:26:50.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a3723e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a3009c340 0x7f5a30139af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a3723e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a30061530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a3723e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a30061990 con 0x7f5a30141dc0 2020-05-18T21:26:50.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a3723e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a301348a0 con 0x7f5a3009c340 2020-05-18T21:26:50.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a3723e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a30138010 con 0x7f5a300b4410 2020-05-18T21:26:50.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a36a3d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5a30141dc0 0x7f5a30156860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54886/0 (socket says 172.21.15.63:54886) 2020-05-18T21:26:50.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a36a3d700 1 -- 172.21.15.63:0/424841274 learned_addr learned my addr 172.21.15.63:0/424841274 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:50.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a35a3b700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a30061530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a3623c700 1 --2- 172.21.15.63:0/424841274 >> v2:172.21.15.155:3300/0 conn(0x7f5a3009c340 0x7f5a30139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a1f7fe700 1 -- 172.21.15.63:0/424841274 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481159887 0 0) 0x7f5a30061990 con 0x7f5a30141dc0 2020-05-18T21:26:50.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a1f7fe700 1 -- 172.21.15.63:0/424841274 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a10002fe0 con 0x7f5a30141dc0 2020-05-18T21:26:50.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a35a3b700 1 -- 172.21.15.63:0/424841274 >> v2:172.21.15.155:3300/0 conn(0x7f5a3009c340 msgr2=0x7f5a30139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a35a3b700 1 --2- 172.21.15.63:0/424841274 >> v2:172.21.15.155:3300/0 conn(0x7f5a3009c340 0x7f5a30139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a35a3b700 1 -- 172.21.15.63:0/424841274 >> v1:172.21.15.63:6789/0 conn(0x7f5a30141dc0 legacy=0x7f5a30156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a35a3b700 1 -- 172.21.15.63:0/424841274 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a301382b0 con 0x7f5a300b4410 2020-05-18T21:26:50.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a3623c700 1 --2- 172.21.15.63:0/424841274 >> v2:172.21.15.155:3300/0 conn(0x7f5a3009c340 0x7f5a30139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:26:50.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a35a3b700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a30061530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a20001110 tx=0x7f5a200108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a35a3b700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a30061530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a20001110 tx=0x7f5a200108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a35a3b700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a30061530 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f5a20001110 tx=0x7f5a200108f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a35a3b700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a30061530 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f5a20001110 tx=0x7f5a200108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a1f7fe700 1 -- 172.21.15.63:0/424841274 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a20005c10 con 0x7f5a300b4410 2020-05-18T21:26:50.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a35a3b700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a30061530 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f5a20001110 tx=0x7f5a200108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a35a3b700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a30061530 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f5a20001110 tx=0x7f5a200108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a1f7fe700 1 -- 172.21.15.63:0/424841274 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a20005d70 con 0x7f5a300b4410 2020-05-18T21:26:50.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a3723e700 1 -- 172.21.15.63:0/424841274 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a30138550 con 0x7f5a300b4410 2020-05-18T21:26:50.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a1f7fe700 1 -- 172.21.15.63:0/424841274 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a200062c0 con 0x7f5a300b4410 2020-05-18T21:26:50.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a3723e700 1 -- 172.21.15.63:0/424841274 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a30144800 con 0x7f5a300b4410 2020-05-18T21:26:50.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a3723e700 1 -- 172.21.15.63:0/424841274 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5a30143210 con 0x7f5a300b4410 2020-05-18T21:26:50.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.367+0000 7f5a35a3b700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a30061530 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f5a20001110 tx=0x7f5a200108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.371+0000 7f5a1f7fe700 1 -- 172.21.15.63:0/424841274 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5a20006530 con 0x7f5a300b4410 2020-05-18T21:26:50.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.371+0000 7f5a35a3b700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a30061530 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f5a20001110 tx=0x7f5a200108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.371+0000 7f5a35a3b700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a30061530 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f5a20001110 tx=0x7f5a200108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.371+0000 7f5a1f7fe700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a1004fd90 0x7f5a10052250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.371+0000 7f5a1f7fe700 1 -- 172.21.15.63:0/424841274 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5a200090c0 con 0x7f5a300b4410 2020-05-18T21:26:50.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.371+0000 7f5a3623c700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a1004fd90 0x7f5a10052250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.371+0000 7f5a1f7fe700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7f5a10056900 0x7f5a10058d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.371+0000 7f5a1f7fe700 1 -- 172.21.15.63:0/424841274 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5a100592e0 con 0x7f5a10056900 2020-05-18T21:26:50.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.371+0000 7f5a1f7fe700 1 -- 172.21.15.63:0/424841274 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a20063e70 con 0x7f5a300b4410 2020-05-18T21:26:50.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.371+0000 7f5a36a3d700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7f5a10056900 0x7f5a10058d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.371+0000 7f5a3623c700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a1004fd90 0x7f5a10052250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a2c002f70 tx=0x7f5a2c007c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.371+0000 7f5a3623c700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a1004fd90 0x7f5a10052250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a2c002f70 tx=0x7f5a2c007c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.371+0000 7f5a3623c700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a1004fd90 0x7f5a10052250 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f5a2c002f70 tx=0x7f5a2c007c90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.371+0000 7f5a36a3d700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7f5a10056900 0x7f5a10058d20 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.371+0000 7f5a1f7fe700 1 -- 172.21.15.63:0/424841274 <== osd.3 v2:172.21.15.63:6814/12805 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23263 (crc 0 0 0) 0x7f5a100592e0 con 0x7f5a10056900 2020-05-18T21:26:50.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.395+0000 7f5a3723e700 1 -- 172.21.15.63:0/424841274 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5a300b2530 con 0x7f5a10056900 2020-05-18T21:26:50.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.395+0000 7f5a1f7fe700 1 -- 172.21.15.63:0/424841274 <== osd.3 v2:172.21.15.63:6814/12805 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5a300b2530 con 0x7f5a10056900 2020-05-18T21:26:50.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.395+0000 7f5a3723e700 1 -- 172.21.15.63:0/424841274 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7f5a10056900 msgr2=0x7f5a10058d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.395+0000 7f5a3723e700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7f5a10056900 0x7f5a10058d20 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.395+0000 7f5a3723e700 1 -- 172.21.15.63:0/424841274 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a1004fd90 msgr2=0x7f5a10052250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.395+0000 7f5a3723e700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a1004fd90 0x7f5a10052250 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f5a2c002f70 tx=0x7f5a2c007c90).stop 2020-05-18T21:26:50.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.395+0000 7f5a3723e700 1 -- 172.21.15.63:0/424841274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 msgr2=0x7f5a30061530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.395+0000 7f5a3723e700 1 --2- 172.21.15.63:0/424841274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b4410 0x7f5a30061530 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f5a20001110 tx=0x7f5a200108f0).stop 2020-05-18T21:26:50.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.395+0000 7f5a36a3d700 1 -- 172.21.15.63:0/424841274 reap_dead start 2020-05-18T21:26:50.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.395+0000 7f5a3723e700 1 -- 172.21.15.63:0/424841274 shutdown_connections 2020-05-18T21:26:50.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.395+0000 7f5a3723e700 1 -- 172.21.15.63:0/424841274 >> 172.21.15.63:0/424841274 conn(0x7f5a300b9630 msgr2=0x7f5a3005eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:50.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.395+0000 7f5a3723e700 1 -- 172.21.15.63:0/424841274 shutdown_connections 2020-05-18T21:26:50.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.395+0000 7f5a3723e700 1 -- 172.21.15.63:0/424841274 wait complete. 2020-05-18T21:26:50.408 INFO:teuthology.orchestra.run.smithi063.stdout:55834574852 2020-05-18T21:26:50.409 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-05-18T21:26:50.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.507+0000 7fe430038700 1 Processor -- start 2020-05-18T21:26:50.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.507+0000 7fe430038700 1 -- start start 2020-05-18T21:26:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.507+0000 7fe430038700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe42813c7e0 0x7fe4280af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.507+0000 7fe430038700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe4280b8ff0 0x7fe4281424c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.507+0000 7fe430038700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe428065ee0 con 0x7fe42805f860 2020-05-18T21:26:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.507+0000 7fe430038700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4280ad3f0 con 0x7fe4280b8ff0 2020-05-18T21:26:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.507+0000 7fe430038700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42805fc40 con 0x7fe42813c7e0 2020-05-18T21:26:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.507+0000 7fe42e5d5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe4280b8ff0 0x7fe4281424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.507+0000 7fe42e5d5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe4280b8ff0 0x7fe4281424c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52708/0 (socket says 172.21.15.63:52708) 2020-05-18T21:26:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.507+0000 7fe42e5d5700 1 -- 172.21.15.63:0/374419664 learned_addr learned my addr 172.21.15.63:0/374419664 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:50.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe42d5d3700 1 --2- 172.21.15.63:0/374419664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe42813c7e0 0x7fe4280af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe42e5d5700 1 -- 172.21.15.63:0/374419664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe42813c7e0 msgr2=0x7fe4280af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:50.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe42e5d5700 1 --2- 172.21.15.63:0/374419664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe42813c7e0 0x7fe4280af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:50.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe42e5d5700 1 -- 172.21.15.63:0/374419664 >> v1:172.21.15.155:6789/0 conn(0x7fe42805f860 legacy=0x7fe42813c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe42e5d5700 1 -- 172.21.15.63:0/374419664 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4280ad690 con 0x7fe4280b8ff0 2020-05-18T21:26:50.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe42e5d5700 1 --2- 172.21.15.63:0/374419664 >> v2:172.21.15.63:3300/0 conn(0x7fe4280b8ff0 0x7fe4281424c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe4200032f0 tx=0x7fe420007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe42e5d5700 1 --2- 172.21.15.63:0/374419664 >> v2:172.21.15.63:3300/0 conn(0x7fe4280b8ff0 0x7fe4281424c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe4200032f0 tx=0x7fe420007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe42e5d5700 1 --2- 172.21.15.63:0/374419664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4280b8ff0 0x7fe4281424c0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7fe4200032f0 tx=0x7fe420007e00).ready entity=mon.0 client_cookie=b692a069ce7c6bc server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe42e5d5700 1 --2- 172.21.15.63:0/374419664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4280b8ff0 0x7fe4281424c0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fe4200032f0 tx=0x7fe420007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe42cdd2700 1 -- 172.21.15.63:0/374419664 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe420011dc0 con 0x7fe4280b8ff0 2020-05-18T21:26:50.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe42e5d5700 1 --2- 172.21.15.63:0/374419664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4280b8ff0 0x7fe4281424c0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fe4200032f0 tx=0x7fe420007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe42cdd2700 1 -- 172.21.15.63:0/374419664 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42000a180 con 0x7fe4280b8ff0 2020-05-18T21:26:50.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe42e5d5700 1 --2- 172.21.15.63:0/374419664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4280b8ff0 0x7fe4281424c0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fe4200032f0 tx=0x7fe420007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe42cdd2700 1 -- 172.21.15.63:0/374419664 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe42000a5a0 con 0x7fe4280b8ff0 2020-05-18T21:26:50.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe430038700 1 -- 172.21.15.63:0/374419664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4280b8ff0 msgr2=0x7fe4281424c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe430038700 1 --2- 172.21.15.63:0/374419664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4280b8ff0 0x7fe4281424c0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7fe4200032f0 tx=0x7fe420007e00).stop 2020-05-18T21:26:50.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe430038700 1 -- 172.21.15.63:0/374419664 shutdown_connections 2020-05-18T21:26:50.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe430038700 1 --2- 172.21.15.63:0/374419664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4280b8ff0 0x7fe4281424c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe430038700 1 --2- 172.21.15.63:0/374419664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe42813c7e0 0x7fe4280af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:50.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe430038700 1 -- 172.21.15.63:0/374419664 >> 172.21.15.63:0/374419664 conn(0x7fe4280b83f0 msgr2=0x7fe4280b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:50.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe430038700 1 -- 172.21.15.63:0/374419664 shutdown_connections 2020-05-18T21:26:50.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.511+0000 7fe430038700 1 -- 172.21.15.63:0/374419664 wait complete. 2020-05-18T21:26:50.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.515+0000 7fe430038700 1 Processor -- start 2020-05-18T21:26:50.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.515+0000 7fe430038700 1 -- start start 2020-05-18T21:26:50.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.515+0000 7fe430038700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe42813c7e0 0x7fe428061620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.515+0000 7fe430038700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42813aa50 con 0x7fe42805f860 2020-05-18T21:26:50.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.515+0000 7fe430038700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe428061d30 con 0x7fe4280b8ff0 2020-05-18T21:26:50.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.515+0000 7fe430038700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe428151a90 con 0x7fe42813c7e0 2020-05-18T21:26:50.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.515+0000 7fe42ddd4700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe42805f860 0x7fe428060360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54898/0 (socket says 172.21.15.63:54898) 2020-05-18T21:26:50.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.515+0000 7fe42ddd4700 1 -- 172.21.15.63:0/160738023 learned_addr learned my addr 172.21.15.63:0/160738023 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:50.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.515+0000 7fe42e5d5700 1 --2- 172.21.15.63:0/160738023 >> v2:172.21.15.63:3300/0 conn(0x7fe42813c7e0 0x7fe428061620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.515+0000 7fe41affd700 1 -- 172.21.15.63:0/160738023 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422932548 0 0) 0x7fe42813aa50 con 0x7fe42805f860 2020-05-18T21:26:50.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.515+0000 7fe41affd700 1 -- 172.21.15.63:0/160738023 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe408002fe0 con 0x7fe42805f860 2020-05-18T21:26:50.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.515+0000 7fe41affd700 1 -- 172.21.15.63:0/160738023 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999350558 0 0) 0x7fe428061d30 con 0x7fe4280b8ff0 2020-05-18T21:26:50.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.515+0000 7fe42e5d5700 1 -- 172.21.15.63:0/160738023 >> v1:172.21.15.155:6789/0 conn(0x7fe4280b8ff0 legacy=0x7fe428063080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.515+0000 7fe42e5d5700 1 -- 172.21.15.63:0/160738023 >> v1:172.21.15.63:6789/0 conn(0x7fe42805f860 legacy=0x7fe428060360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.515+0000 7fe42e5d5700 1 -- 172.21.15.63:0/160738023 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe428151d30 con 0x7fe42813c7e0 2020-05-18T21:26:50.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.515+0000 7fe42e5d5700 1 --2- 172.21.15.63:0/160738023 >> v2:172.21.15.63:3300/0 conn(0x7fe42813c7e0 0x7fe428061620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe41c001b10 tx=0x7fe420007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.515+0000 7fe42e5d5700 1 --2- 172.21.15.63:0/160738023 >> v2:172.21.15.63:3300/0 conn(0x7fe42813c7e0 0x7fe428061620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe41c001b10 tx=0x7fe420007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe42e5d5700 1 --2- 172.21.15.63:0/160738023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe42813c7e0 0x7fe428061620 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7fe41c001b10 tx=0x7fe420007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe42e5d5700 1 --2- 172.21.15.63:0/160738023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe42813c7e0 0x7fe428061620 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fe41c001b10 tx=0x7fe420007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe41affd700 1 -- 172.21.15.63:0/160738023 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe41c001970 con 0x7fe42813c7e0 2020-05-18T21:26:50.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe42e5d5700 1 --2- 172.21.15.63:0/160738023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe42813c7e0 0x7fe428061620 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fe41c001b10 tx=0x7fe420007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe41affd700 1 -- 172.21.15.63:0/160738023 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe420011e80 con 0x7fe42813c7e0 2020-05-18T21:26:50.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe430038700 1 -- 172.21.15.63:0/160738023 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe428151fd0 con 0x7fe42813c7e0 2020-05-18T21:26:50.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe42e5d5700 1 --2- 172.21.15.63:0/160738023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe42813c7e0 0x7fe428061620 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fe41c001b10 tx=0x7fe420007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe41affd700 1 -- 172.21.15.63:0/160738023 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe420005a80 con 0x7fe42813c7e0 2020-05-18T21:26:50.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe430038700 1 -- 172.21.15.63:0/160738023 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe428142da0 con 0x7fe42813c7e0 2020-05-18T21:26:50.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe430038700 1 -- 172.21.15.63:0/160738023 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe4281521d0 con 0x7fe42813c7e0 2020-05-18T21:26:50.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe42e5d5700 1 --2- 172.21.15.63:0/160738023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe42813c7e0 0x7fe428061620 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fe41c001b10 tx=0x7fe420007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe41affd700 1 -- 172.21.15.63:0/160738023 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe420005d40 con 0x7fe42813c7e0 2020-05-18T21:26:50.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe42e5d5700 1 --2- 172.21.15.63:0/160738023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe42813c7e0 0x7fe428061620 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fe41c001b10 tx=0x7fe420007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe42e5d5700 1 --2- 172.21.15.63:0/160738023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe42813c7e0 0x7fe428061620 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fe41c001b10 tx=0x7fe420007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe41affd700 1 --2- 172.21.15.63:0/160738023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe40804fc90 0x7fe408052150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe41affd700 1 -- 172.21.15.63:0/160738023 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe420064440 con 0x7fe42813c7e0 2020-05-18T21:26:50.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe41affd700 1 --2- 172.21.15.63:0/160738023 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x7fe4080566e0 0x7fe408058b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe41affd700 1 -- 172.21.15.63:0/160738023 --> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe4080590c0 con 0x7fe4080566e0 2020-05-18T21:26:50.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe41affd700 1 -- 172.21.15.63:0/160738023 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe420064830 con 0x7fe42813c7e0 2020-05-18T21:26:50.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.519+0000 7fe42ddd4700 1 --2- 172.21.15.63:0/160738023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe40804fc90 0x7fe408052150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.523+0000 7fe42d5d3700 1 --2- 172.21.15.63:0/160738023 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x7fe4080566e0 0x7fe408058b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.523+0000 7fe42ddd4700 1 --2- 172.21.15.63:0/160738023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe40804fc90 0x7fe408052150 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe41c001210 tx=0x7fe41c009590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.523+0000 7fe42ddd4700 1 --2- 172.21.15.63:0/160738023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe40804fc90 0x7fe408052150 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe41c001210 tx=0x7fe41c009590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.523+0000 7fe42ddd4700 1 --2- 172.21.15.63:0/160738023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe40804fc90 0x7fe408052150 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fe41c001210 tx=0x7fe41c009590).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.523+0000 7fe42d5d3700 1 --2- 172.21.15.63:0/160738023 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x7fe4080566e0 0x7fe408058b00 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.523+0000 7fe41affd700 1 -- 172.21.15.63:0/160738023 <== osd.4 v2:172.21.15.155:6800/13023 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23263 (crc 0 0 0) 0x7fe4080590c0 con 0x7fe4080566e0 2020-05-18T21:26:50.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.543+0000 7fe430038700 1 -- 172.21.15.63:0/160738023 --> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe428151840 con 0x7fe4080566e0 2020-05-18T21:26:50.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.543+0000 7fe41affd700 1 -- 172.21.15.63:0/160738023 <== osd.4 v2:172.21.15.155:6800/13023 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe428151840 con 0x7fe4080566e0 2020-05-18T21:26:50.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.547+0000 7fe430038700 1 -- 172.21.15.63:0/160738023 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x7fe4080566e0 msgr2=0x7fe408058b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.547+0000 7fe430038700 1 --2- 172.21.15.63:0/160738023 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x7fe4080566e0 0x7fe408058b00 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.547+0000 7fe430038700 1 -- 172.21.15.63:0/160738023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe40804fc90 msgr2=0x7fe408052150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.547+0000 7fe430038700 1 --2- 172.21.15.63:0/160738023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe40804fc90 0x7fe408052150 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fe41c001210 tx=0x7fe41c009590).stop 2020-05-18T21:26:50.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.547+0000 7fe430038700 1 -- 172.21.15.63:0/160738023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe42813c7e0 msgr2=0x7fe428061620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.547+0000 7fe430038700 1 --2- 172.21.15.63:0/160738023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe42813c7e0 0x7fe428061620 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7fe41c001b10 tx=0x7fe420007e00).stop 2020-05-18T21:26:50.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.547+0000 7fe42e5d5700 1 -- 172.21.15.63:0/160738023 reap_dead start 2020-05-18T21:26:50.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.547+0000 7fe430038700 1 -- 172.21.15.63:0/160738023 shutdown_connections 2020-05-18T21:26:50.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.547+0000 7fe430038700 1 --2- 172.21.15.63:0/160738023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe42813c7e0 0x7fe428061620 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.547+0000 7fe430038700 1 -- 172.21.15.63:0/160738023 >> 172.21.15.63:0/160738023 conn(0x7fe4280b83f0 msgr2=0x7fe4280b6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:50.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.547+0000 7fe430038700 1 -- 172.21.15.63:0/160738023 shutdown_connections 2020-05-18T21:26:50.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.547+0000 7fe430038700 1 -- 172.21.15.63:0/160738023 wait complete. 2020-05-18T21:26:50.564 INFO:teuthology.orchestra.run.smithi063.stdout:55834574853 2020-05-18T21:26:50.565 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-05-18T21:26:50.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.675+0000 7ff06e764700 1 Processor -- start 2020-05-18T21:26:50.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.675+0000 7ff06e764700 1 -- start start 2020-05-18T21:26:50.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06e764700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff06809e620 0x7ff068099c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:50.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06e764700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff0680b5e30 0x7ff0680b6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:50.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06e764700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06809b9d0 con 0x7ff06809b530 2020-05-18T21:26:50.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06e764700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff068145ea0 con 0x7ff06809e620 2020-05-18T21:26:50.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06e764700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff068099880 con 0x7ff0680b5e30 2020-05-18T21:26:50.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff067fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff06809e620 0x7ff068099c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff05ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff06809b530 0x7ff068099170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54910/0 (socket says 172.21.15.63:54910) 2020-05-18T21:26:50.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff05ffff700 1 -- 172.21.15.63:0/4105613841 learned_addr learned my addr 172.21.15.63:0/4105613841 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:50.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06cd01700 1 --2- 172.21.15.63:0/4105613841 >> v2:172.21.15.155:3300/0 conn(0x7ff0680b5e30 0x7ff0680b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff0677fe700 1 -- 172.21.15.63:0/4105613841 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249085557 0 0) 0x7ff06809b9d0 con 0x7ff06809b530 2020-05-18T21:26:50.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff0677fe700 1 -- 172.21.15.63:0/4105613841 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff048003270 con 0x7ff06809b530 2020-05-18T21:26:50.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06cd01700 1 -- 172.21.15.63:0/4105613841 >> v2:172.21.15.63:3300/0 conn(0x7ff06809e620 msgr2=0x7ff068099c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:50.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06cd01700 1 --2- 172.21.15.63:0/4105613841 >> v2:172.21.15.63:3300/0 conn(0x7ff06809e620 0x7ff068099c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:50.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06cd01700 1 -- 172.21.15.63:0/4105613841 >> v1:172.21.15.63:6789/0 conn(0x7ff06809b530 legacy=0x7ff068099170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06cd01700 1 -- 172.21.15.63:0/4105613841 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff068098a30 con 0x7ff0680b5e30 2020-05-18T21:26:50.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff067fff700 1 --2- 172.21.15.63:0/4105613841 >> v2:172.21.15.63:3300/0 conn(0x7ff06809e620 0x7ff068099c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:26:50.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06cd01700 1 --2- 172.21.15.63:0/4105613841 >> v2:172.21.15.155:3300/0 conn(0x7ff0680b5e30 0x7ff0680b6230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff0600032f0 tx=0x7ff060007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06cd01700 1 --2- 172.21.15.63:0/4105613841 >> v2:172.21.15.155:3300/0 conn(0x7ff0680b5e30 0x7ff0680b6230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff0600032f0 tx=0x7ff060007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06cd01700 1 --2- 172.21.15.63:0/4105613841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0680b5e30 0x7ff0680b6230 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7ff0600032f0 tx=0x7ff060007e00).ready entity=mon.1 client_cookie=c7d626c1d9bf95e7 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06cd01700 1 --2- 172.21.15.63:0/4105613841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0680b5e30 0x7ff0680b6230 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7ff0600032f0 tx=0x7ff060007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06cd01700 1 --2- 172.21.15.63:0/4105613841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0680b5e30 0x7ff0680b6230 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7ff0600032f0 tx=0x7ff060007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff0677fe700 1 -- 172.21.15.63:0/4105613841 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff060011db0 con 0x7ff0680b5e30 2020-05-18T21:26:50.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06cd01700 1 --2- 172.21.15.63:0/4105613841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0680b5e30 0x7ff0680b6230 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7ff0600032f0 tx=0x7ff060007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff0677fe700 1 -- 172.21.15.63:0/4105613841 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06000a180 con 0x7ff0680b5e30 2020-05-18T21:26:50.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff0677fe700 1 -- 172.21.15.63:0/4105613841 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff06000a560 con 0x7ff0680b5e30 2020-05-18T21:26:50.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06e764700 1 -- 172.21.15.63:0/4105613841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0680b5e30 msgr2=0x7ff0680b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06e764700 1 --2- 172.21.15.63:0/4105613841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0680b5e30 0x7ff0680b6230 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7ff0600032f0 tx=0x7ff060007e00).stop 2020-05-18T21:26:50.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06e764700 1 -- 172.21.15.63:0/4105613841 shutdown_connections 2020-05-18T21:26:50.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06e764700 1 --2- 172.21.15.63:0/4105613841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0680b5e30 0x7ff0680b6230 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06e764700 1 --2- 172.21.15.63:0/4105613841 >> v2:172.21.15.63:3300/0 conn(0x7ff06809e620 0x7ff068099c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:50.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06e764700 1 -- 172.21.15.63:0/4105613841 >> 172.21.15.63:0/4105613841 conn(0x7ff0680b9750 msgr2=0x7ff0680b5720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:50.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06e764700 1 -- 172.21.15.63:0/4105613841 shutdown_connections 2020-05-18T21:26:50.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.679+0000 7ff06e764700 1 -- 172.21.15.63:0/4105613841 wait complete. 2020-05-18T21:26:50.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.683+0000 7ff06e764700 1 Processor -- start 2020-05-18T21:26:50.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.683+0000 7ff06e764700 1 -- start start 2020-05-18T21:26:50.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff06e764700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff06809e620 0x7ff068141d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff06e764700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff0680b5e30 0x7ff068147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff06e764700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0681486a0 con 0x7ff06809b530 2020-05-18T21:26:50.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff06e764700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0681488d0 con 0x7ff06809e620 2020-05-18T21:26:50.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff06e764700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff068148b70 con 0x7ff0680b5e30 2020-05-18T21:26:50.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff067fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff06809b530 0x7ff0681415f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54914/0 (socket says 172.21.15.63:54914) 2020-05-18T21:26:50.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff05ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff06809e620 0x7ff068141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff067fff700 1 -- 172.21.15.63:0/2249505801 learned_addr learned my addr 172.21.15.63:0/2249505801 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:50.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff06cd01700 1 --2- 172.21.15.63:0/2249505801 >> v2:172.21.15.155:3300/0 conn(0x7ff0680b5e30 0x7ff068147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff065ffb700 1 -- 172.21.15.63:0/2249505801 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558366758 0 0) 0x7ff0681486a0 con 0x7ff06809b530 2020-05-18T21:26:50.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff065ffb700 1 -- 172.21.15.63:0/2249505801 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff04c002fe0 con 0x7ff06809b530 2020-05-18T21:26:50.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff05ffff700 1 -- 172.21.15.63:0/2249505801 >> v2:172.21.15.155:3300/0 conn(0x7ff0680b5e30 msgr2=0x7ff068147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff05ffff700 1 --2- 172.21.15.63:0/2249505801 >> v2:172.21.15.155:3300/0 conn(0x7ff0680b5e30 0x7ff068147f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff05ffff700 1 -- 172.21.15.63:0/2249505801 >> v1:172.21.15.63:6789/0 conn(0x7ff06809b530 legacy=0x7ff0681415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff05ffff700 1 -- 172.21.15.63:0/2249505801 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0680aed10 con 0x7ff06809e620 2020-05-18T21:26:50.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff05ffff700 1 --2- 172.21.15.63:0/2249505801 >> v2:172.21.15.63:3300/0 conn(0x7ff06809e620 0x7ff068141d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff050001110 tx=0x7ff050010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff05ffff700 1 --2- 172.21.15.63:0/2249505801 >> v2:172.21.15.63:3300/0 conn(0x7ff06809e620 0x7ff068141d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff050001110 tx=0x7ff050010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff05ffff700 1 --2- 172.21.15.63:0/2249505801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06809e620 0x7ff068141d00 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7ff050001110 tx=0x7ff050010930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff05ffff700 1 --2- 172.21.15.63:0/2249505801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06809e620 0x7ff068141d00 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7ff050001110 tx=0x7ff050010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff065ffb700 1 -- 172.21.15.63:0/2249505801 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff050005d00 con 0x7ff06809e620 2020-05-18T21:26:50.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff05ffff700 1 --2- 172.21.15.63:0/2249505801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06809e620 0x7ff068141d00 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7ff050001110 tx=0x7ff050010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff05ffff700 1 --2- 172.21.15.63:0/2249505801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06809e620 0x7ff068141d00 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7ff050001110 tx=0x7ff050010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff065ffb700 1 -- 172.21.15.63:0/2249505801 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff050005e60 con 0x7ff06809e620 2020-05-18T21:26:50.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff065ffb700 1 -- 172.21.15.63:0/2249505801 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0500062c0 con 0x7ff06809e620 2020-05-18T21:26:50.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff06e764700 1 -- 172.21.15.63:0/2249505801 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0680aef00 con 0x7ff06809e620 2020-05-18T21:26:50.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff06e764700 1 -- 172.21.15.63:0/2249505801 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff068145330 con 0x7ff06809e620 2020-05-18T21:26:50.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff05ffff700 1 --2- 172.21.15.63:0/2249505801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06809e620 0x7ff068141d00 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7ff050001110 tx=0x7ff050010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff06e764700 1 -- 172.21.15.63:0/2249505801 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff0680569e0 con 0x7ff06809e620 2020-05-18T21:26:50.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.687+0000 7ff065ffb700 1 -- 172.21.15.63:0/2249505801 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff050006530 con 0x7ff06809e620 2020-05-18T21:26:50.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.691+0000 7ff05ffff700 1 --2- 172.21.15.63:0/2249505801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06809e620 0x7ff068141d00 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7ff050001110 tx=0x7ff050010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.691+0000 7ff05ffff700 1 --2- 172.21.15.63:0/2249505801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06809e620 0x7ff068141d00 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7ff050001110 tx=0x7ff050010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.691+0000 7ff065ffb700 1 --2- 172.21.15.63:0/2249505801 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff04c04fd90 0x7ff04c052250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.691+0000 7ff065ffb700 1 -- 172.21.15.63:0/2249505801 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff0500090c0 con 0x7ff06809e620 2020-05-18T21:26:50.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.691+0000 7ff065ffb700 1 --2- 172.21.15.63:0/2249505801 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7ff04c056870 0x7ff04c058c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.691+0000 7ff065ffb700 1 -- 172.21.15.63:0/2249505801 --> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff04c059250 con 0x7ff04c056870 2020-05-18T21:26:50.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.691+0000 7ff067fff700 1 --2- 172.21.15.63:0/2249505801 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff04c04fd90 0x7ff04c052250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.691+0000 7ff065ffb700 1 -- 172.21.15.63:0/2249505801 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff050064f50 con 0x7ff06809e620 2020-05-18T21:26:50.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.691+0000 7ff06cd01700 1 --2- 172.21.15.63:0/2249505801 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7ff04c056870 0x7ff04c058c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.691+0000 7ff067fff700 1 --2- 172.21.15.63:0/2249505801 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff04c04fd90 0x7ff04c052250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff058002f70 tx=0x7ff0580093f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.691+0000 7ff067fff700 1 --2- 172.21.15.63:0/2249505801 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff04c04fd90 0x7ff04c052250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff058002f70 tx=0x7ff0580093f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.691+0000 7ff067fff700 1 --2- 172.21.15.63:0/2249505801 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff04c04fd90 0x7ff04c052250 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7ff058002f70 tx=0x7ff0580093f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.691+0000 7ff06cd01700 1 --2- 172.21.15.63:0/2249505801 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7ff04c056870 0x7ff04c058c90 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.695+0000 7ff065ffb700 1 -- 172.21.15.63:0/2249505801 <== osd.5 v2:172.21.15.155:6808/13024 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23263 (crc 0 0 0) 0x7ff04c059250 con 0x7ff04c056870 2020-05-18T21:26:50.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.711+0000 7ff06e764700 1 -- 172.21.15.63:0/2249505801 --> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff0680b7b90 con 0x7ff04c056870 2020-05-18T21:26:50.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.711+0000 7ff065ffb700 1 -- 172.21.15.63:0/2249505801 <== osd.5 v2:172.21.15.155:6808/13024 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff0680b7b90 con 0x7ff04c056870 2020-05-18T21:26:50.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.715+0000 7ff06e764700 1 -- 172.21.15.63:0/2249505801 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7ff04c056870 msgr2=0x7ff04c058c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.715+0000 7ff06e764700 1 --2- 172.21.15.63:0/2249505801 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7ff04c056870 0x7ff04c058c90 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.715+0000 7ff06e764700 1 -- 172.21.15.63:0/2249505801 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff04c04fd90 msgr2=0x7ff04c052250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.715+0000 7ff06e764700 1 --2- 172.21.15.63:0/2249505801 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff04c04fd90 0x7ff04c052250 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7ff058002f70 tx=0x7ff0580093f0).stop 2020-05-18T21:26:50.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.715+0000 7ff06e764700 1 -- 172.21.15.63:0/2249505801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06809e620 msgr2=0x7ff068141d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.715+0000 7ff06e764700 1 --2- 172.21.15.63:0/2249505801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06809e620 0x7ff068141d00 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7ff050001110 tx=0x7ff050010930).stop 2020-05-18T21:26:50.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.715+0000 7ff06cd01700 1 -- 172.21.15.63:0/2249505801 reap_dead start 2020-05-18T21:26:50.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.715+0000 7ff06e764700 1 -- 172.21.15.63:0/2249505801 shutdown_connections 2020-05-18T21:26:50.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.715+0000 7ff06e764700 1 --2- 172.21.15.63:0/2249505801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06809e620 0x7ff068141d00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.715+0000 7ff06e764700 1 -- 172.21.15.63:0/2249505801 >> 172.21.15.63:0/2249505801 conn(0x7ff0680b9750 msgr2=0x7ff06806a660 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:50.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.715+0000 7ff06e764700 1 -- 172.21.15.63:0/2249505801 shutdown_connections 2020-05-18T21:26:50.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.715+0000 7ff06e764700 1 -- 172.21.15.63:0/2249505801 wait complete. 2020-05-18T21:26:50.728 INFO:teuthology.orchestra.run.smithi063.stdout:55834574852 2020-05-18T21:26:50.729 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-05-18T21:26:50.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7ebd654700 1 Processor -- start 2020-05-18T21:26:50.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7ebd654700 1 -- start start 2020-05-18T21:26:50.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7ebd654700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7eb81456e0 0x7f7eb809b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:50.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7ebd654700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb805f590 con 0x7f7eb8060b60 2020-05-18T21:26:50.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7ebd654700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb805f800 con 0x7f7eb814d2d0 2020-05-18T21:26:50.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7ebd654700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb80b26c0 con 0x7f7eb81456e0 2020-05-18T21:26:50.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7eaffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7eb8060b60 0x7f7eb80b1fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54924/0 (socket says 172.21.15.63:54924) 2020-05-18T21:26:50.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7eaffff700 1 -- 172.21.15.63:0/550168451 learned_addr learned my addr 172.21.15.63:0/550168451 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:50.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7eb7fff700 1 --2- 172.21.15.63:0/550168451 >> v2:172.21.15.155:3300/0 conn(0x7f7eb81456e0 0x7f7eb809b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7eb77fe700 1 -- 172.21.15.63:0/550168451 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599063130 0 0) 0x7f7eb805f590 con 0x7f7eb8060b60 2020-05-18T21:26:50.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7eb77fe700 1 -- 172.21.15.63:0/550168451 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e98003270 con 0x7f7eb8060b60 2020-05-18T21:26:50.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7eb7fff700 1 -- 172.21.15.63:0/550168451 >> v1:172.21.15.155:6789/0 conn(0x7f7eb814d2d0 legacy=0x7f7eb814f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7eb7fff700 1 -- 172.21.15.63:0/550168451 >> v1:172.21.15.63:6789/0 conn(0x7f7eb8060b60 legacy=0x7f7eb80b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7eb7fff700 1 -- 172.21.15.63:0/550168451 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb8145ac0 con 0x7f7eb81456e0 2020-05-18T21:26:50.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7eb7fff700 1 --2- 172.21.15.63:0/550168451 >> v2:172.21.15.155:3300/0 conn(0x7f7eb81456e0 0x7f7eb809b4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7ea8002f70 tx=0x7f7ea8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7eb7fff700 1 --2- 172.21.15.63:0/550168451 >> v2:172.21.15.155:3300/0 conn(0x7f7eb81456e0 0x7f7eb809b4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7ea8002f70 tx=0x7f7ea8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7eb7fff700 1 --2- 172.21.15.63:0/550168451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb81456e0 0x7f7eb809b4d0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f7ea8002f70 tx=0x7f7ea8007a80).ready entity=mon.1 client_cookie=3854f464419ecfa2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7eb7fff700 1 --2- 172.21.15.63:0/550168451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb81456e0 0x7f7eb809b4d0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f7ea8002f70 tx=0x7f7ea8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7eb77fe700 1 -- 172.21.15.63:0/550168451 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ea8008e80 con 0x7f7eb81456e0 2020-05-18T21:26:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7eb7fff700 1 --2- 172.21.15.63:0/550168451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb81456e0 0x7f7eb809b4d0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f7ea8002f70 tx=0x7f7ea8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7eb7fff700 1 --2- 172.21.15.63:0/550168451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb81456e0 0x7f7eb809b4d0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f7ea8002f70 tx=0x7f7ea8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7eb77fe700 1 -- 172.21.15.63:0/550168451 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea80115f0 con 0x7f7eb81456e0 2020-05-18T21:26:50.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7eb77fe700 1 -- 172.21.15.63:0/550168451 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ea80119d0 con 0x7f7eb81456e0 2020-05-18T21:26:50.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7ebd654700 1 -- 172.21.15.63:0/550168451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb81456e0 msgr2=0x7f7eb809b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.839+0000 7f7ebd654700 1 --2- 172.21.15.63:0/550168451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb81456e0 0x7f7eb809b4d0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f7ea8002f70 tx=0x7f7ea8007a80).stop 2020-05-18T21:26:50.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.843+0000 7f7ebd654700 1 -- 172.21.15.63:0/550168451 shutdown_connections 2020-05-18T21:26:50.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.843+0000 7f7ebd654700 1 --2- 172.21.15.63:0/550168451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb81456e0 0x7f7eb809b4d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.843+0000 7f7ebd654700 1 -- 172.21.15.63:0/550168451 >> 172.21.15.63:0/550168451 conn(0x7f7eb80b9630 msgr2=0x7f7eb80b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:50.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.843+0000 7f7ebd654700 1 -- 172.21.15.63:0/550168451 shutdown_connections 2020-05-18T21:26:50.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.843+0000 7f7ebd654700 1 -- 172.21.15.63:0/550168451 wait complete. 2020-05-18T21:26:50.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.843+0000 7f7ebd654700 1 Processor -- start 2020-05-18T21:26:50.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.843+0000 7f7ebd654700 1 -- start start 2020-05-18T21:26:50.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.843+0000 7f7ebd654700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7eb8060b60 0x7f7eb80642b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.843+0000 7f7ebd654700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb8064710 con 0x7f7eb814d2d0 2020-05-18T21:26:50.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.843+0000 7f7ebd654700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb8061de0 con 0x7f7eb81456e0 2020-05-18T21:26:50.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.843+0000 7f7ebd654700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb809d820 con 0x7f7eb8060b60 2020-05-18T21:26:50.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.843+0000 7f7ebce53700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7eb814d2d0 0x7f7eb80616d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54934/0 (socket says 172.21.15.63:54934) 2020-05-18T21:26:50.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.843+0000 7f7ebce53700 1 -- 172.21.15.63:0/2412363150 learned_addr learned my addr 172.21.15.63:0/2412363150 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:50.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.843+0000 7f7eb7fff700 1 --2- 172.21.15.63:0/2412363150 >> v2:172.21.15.155:3300/0 conn(0x7f7eb8060b60 0x7f7eb80642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.843+0000 7f7eb5ffb700 1 -- 172.21.15.63:0/2412363150 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521898850 0 0) 0x7f7eb8064710 con 0x7f7eb814d2d0 2020-05-18T21:26:50.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.843+0000 7f7eb5ffb700 1 -- 172.21.15.63:0/2412363150 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e9c002fe0 con 0x7f7eb814d2d0 2020-05-18T21:26:50.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.843+0000 7f7eb7fff700 1 -- 172.21.15.63:0/2412363150 >> v1:172.21.15.155:6789/0 conn(0x7f7eb81456e0 legacy=0x7f7eb8060fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.843+0000 7f7eb7fff700 1 -- 172.21.15.63:0/2412363150 >> v1:172.21.15.63:6789/0 conn(0x7f7eb814d2d0 legacy=0x7f7eb80616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.843+0000 7f7eb7fff700 1 -- 172.21.15.63:0/2412363150 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb8062590 con 0x7f7eb8060b60 2020-05-18T21:26:50.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eb7fff700 1 --2- 172.21.15.63:0/2412363150 >> v2:172.21.15.155:3300/0 conn(0x7f7eb8060b60 0x7f7eb80642b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7eb813b450 tx=0x7f7ea8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eb7fff700 1 --2- 172.21.15.63:0/2412363150 >> v2:172.21.15.155:3300/0 conn(0x7f7eb8060b60 0x7f7eb80642b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7eb813b450 tx=0x7f7ea8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eb7fff700 1 --2- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb8060b60 0x7f7eb80642b0 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f7eb813b450 tx=0x7f7ea8007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eb7fff700 1 --2- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb8060b60 0x7f7eb80642b0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f7eb813b450 tx=0x7f7ea8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eb5ffb700 1 -- 172.21.15.63:0/2412363150 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ea8007170 con 0x7f7eb8060b60 2020-05-18T21:26:50.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eb7fff700 1 --2- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb8060b60 0x7f7eb80642b0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f7eb813b450 tx=0x7f7ea8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eb5ffb700 1 -- 172.21.15.63:0/2412363150 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea80072d0 con 0x7f7eb8060b60 2020-05-18T21:26:50.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eb7fff700 1 --2- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb8060b60 0x7f7eb80642b0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f7eb813b450 tx=0x7f7ea8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7ebd654700 1 -- 172.21.15.63:0/2412363150 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb813fb50 con 0x7f7eb8060b60 2020-05-18T21:26:50.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eb5ffb700 1 -- 172.21.15.63:0/2412363150 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ea8007630 con 0x7f7eb8060b60 2020-05-18T21:26:50.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7ebd654700 1 -- 172.21.15.63:0/2412363150 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb813f6f0 con 0x7f7eb8060b60 2020-05-18T21:26:50.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eb7fff700 1 --2- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb8060b60 0x7f7eb80642b0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f7eb813b450 tx=0x7f7ea8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7ebd654700 1 -- 172.21.15.63:0/2412363150 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7eb813f970 con 0x7f7eb8060b60 2020-05-18T21:26:50.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eb5ffb700 1 -- 172.21.15.63:0/2412363150 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7ea8005700 con 0x7f7eb8060b60 2020-05-18T21:26:50.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eb7fff700 1 --2- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb8060b60 0x7f7eb80642b0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f7eb813b450 tx=0x7f7ea8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eb7fff700 1 --2- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb8060b60 0x7f7eb80642b0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f7eb813b450 tx=0x7f7ea8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eb5ffb700 1 --2- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7e9c04fcc0 0x7f7e9c052180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eb5ffb700 1 -- 172.21.15.63:0/2412363150 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7ea8064380 con 0x7f7eb8060b60 2020-05-18T21:26:50.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eb5ffb700 1 --2- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f7e9c056630 0x7f7e9c058a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:50.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eb5ffb700 1 -- 172.21.15.63:0/2412363150 --> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e9c059010 con 0x7f7e9c056630 2020-05-18T21:26:50.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eb5ffb700 1 -- 172.21.15.63:0/2412363150 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ea8064770 con 0x7f7eb8060b60 2020-05-18T21:26:50.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eaffff700 1 --2- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7e9c04fcc0 0x7f7e9c052180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7ebce53700 1 --2- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f7e9c056630 0x7f7e9c058a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eaffff700 1 --2- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7e9c04fcc0 0x7f7e9c052180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7eb809ba00 tx=0x7f7ea0001550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eaffff700 1 --2- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7e9c04fcc0 0x7f7e9c052180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7eb809ba00 tx=0x7f7ea0001550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7eaffff700 1 --2- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7e9c04fcc0 0x7f7e9c052180 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f7eb809ba00 tx=0x7f7ea0001550).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.847+0000 7f7ebce53700 1 --2- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f7e9c056630 0x7f7e9c058a50 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:50.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.851+0000 7f7eb5ffb700 1 -- 172.21.15.63:0/2412363150 <== osd.6 v2:172.21.15.155:6815/13025 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23263 (crc 0 0 0) 0x7f7e9c059010 con 0x7f7e9c056630 2020-05-18T21:26:50.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.867+0000 7f7ebd654700 1 -- 172.21.15.63:0/2412363150 --> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7eb809d660 con 0x7f7e9c056630 2020-05-18T21:26:50.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.867+0000 7f7eb5ffb700 1 -- 172.21.15.63:0/2412363150 <== osd.6 v2:172.21.15.155:6815/13025 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7eb809d660 con 0x7f7e9c056630 2020-05-18T21:26:50.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.871+0000 7f7ebd654700 1 -- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f7e9c056630 msgr2=0x7f7e9c058a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.871+0000 7f7ebd654700 1 --2- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f7e9c056630 0x7f7e9c058a50 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.871+0000 7f7ebd654700 1 -- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7e9c04fcc0 msgr2=0x7f7e9c052180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.871+0000 7f7ebd654700 1 --2- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7e9c04fcc0 0x7f7e9c052180 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f7eb809ba00 tx=0x7f7ea0001550).stop 2020-05-18T21:26:50.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.871+0000 7f7ebd654700 1 -- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb8060b60 msgr2=0x7f7eb80642b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.871+0000 7f7ebd654700 1 --2- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb8060b60 0x7f7eb80642b0 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f7eb813b450 tx=0x7f7ea8007a80).stop 2020-05-18T21:26:50.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.871+0000 7f7ebce53700 1 -- 172.21.15.63:0/2412363150 reap_dead start 2020-05-18T21:26:50.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.871+0000 7f7ebd654700 1 -- 172.21.15.63:0/2412363150 shutdown_connections 2020-05-18T21:26:50.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.871+0000 7f7ebd654700 1 --2- 172.21.15.63:0/2412363150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb8060b60 0x7f7eb80642b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:50.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.871+0000 7f7ebd654700 1 -- 172.21.15.63:0/2412363150 >> 172.21.15.63:0/2412363150 conn(0x7f7eb80b9630 msgr2=0x7f7eb80b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:50.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.871+0000 7f7ebd654700 1 -- 172.21.15.63:0/2412363150 shutdown_connections 2020-05-18T21:26:50.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.871+0000 7f7ebd654700 1 -- 172.21.15.63:0/2412363150 wait complete. 2020-05-18T21:26:50.884 INFO:teuthology.orchestra.run.smithi063.stdout:55834574853 2020-05-18T21:26:50.885 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-05-18T21:26:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ee662700 1 Processor -- start 2020-05-18T21:26:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ee662700 1 -- start start 2020-05-18T21:26:50.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ee662700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b93f0 0x7ff8e812f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:50.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ee662700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e812eca0 con 0x7ff8e80b7e30 2020-05-18T21:26:50.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ee662700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e812ef40 con 0x7ff8e80b79f0 2020-05-18T21:26:50.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ee662700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80b97d0 con 0x7ff8e80b93f0 2020-05-18T21:26:50.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ede61700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff8e80b7e30 0x7ff8e80604d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54942/0 (socket says 172.21.15.63:54942) 2020-05-18T21:26:50.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ede61700 1 -- 172.21.15.63:0/357971023 learned_addr learned my addr 172.21.15.63:0/357971023 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:50.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ed660700 1 --2- 172.21.15.63:0/357971023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b93f0 0x7ff8e812f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:50.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8dbfff700 1 -- 172.21.15.63:0/357971023 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337431012 0 0) 0x7ff8e812eca0 con 0x7ff8e80b7e30 2020-05-18T21:26:50.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8dbfff700 1 -- 172.21.15.63:0/357971023 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8cc003270 con 0x7ff8e80b7e30 2020-05-18T21:26:50.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8dbfff700 1 -- 172.21.15.63:0/357971023 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289725801 0 0) 0x7ff8e812ef40 con 0x7ff8e80b79f0 2020-05-18T21:26:50.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8dbfff700 1 -- 172.21.15.63:0/357971023 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8e812eca0 con 0x7ff8e80b79f0 2020-05-18T21:26:50.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8dbfff700 1 -- 172.21.15.63:0/357971023 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4064659408 0 0) 0x7ff8cc003270 con 0x7ff8e80b7e30 2020-05-18T21:26:50.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ed660700 1 -- 172.21.15.63:0/357971023 >> v1:172.21.15.155:6789/0 conn(0x7ff8e80b79f0 legacy=0x7ff8e812e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ed660700 1 -- 172.21.15.63:0/357971023 >> v1:172.21.15.63:6789/0 conn(0x7ff8e80b7e30 legacy=0x7ff8e80604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:50.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ed660700 1 -- 172.21.15.63:0/357971023 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e80b8700 con 0x7ff8e80b93f0 2020-05-18T21:26:50.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ed660700 1 --2- 172.21.15.63:0/357971023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b93f0 0x7ff8e812f3e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff8e0001110 tx=0x7ff8dc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ed660700 1 --2- 172.21.15.63:0/357971023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b93f0 0x7ff8e812f3e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff8e0001110 tx=0x7ff8dc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:50.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ed660700 1 --2- 172.21.15.63:0/357971023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b93f0 0x7ff8e812f3e0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7ff8e0001110 tx=0x7ff8dc008ca0).ready entity=mon.2 client_cookie=a415ab7f850886db server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:51.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ed660700 1 --2- 172.21.15.63:0/357971023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b93f0 0x7ff8e812f3e0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7ff8e0001110 tx=0x7ff8dc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8dbfff700 1 -- 172.21.15.63:0/357971023 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e0001710 con 0x7ff8e80b93f0 2020-05-18T21:26:51.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ed660700 1 --2- 172.21.15.63:0/357971023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b93f0 0x7ff8e812f3e0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7ff8e0001110 tx=0x7ff8dc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ed660700 1 --2- 172.21.15.63:0/357971023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b93f0 0x7ff8e812f3e0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7ff8e0001110 tx=0x7ff8dc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8dbfff700 1 -- 172.21.15.63:0/357971023 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8dc011ac0 con 0x7ff8e80b93f0 2020-05-18T21:26:51.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8dbfff700 1 -- 172.21.15.63:0/357971023 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8dc011e60 con 0x7ff8e80b93f0 2020-05-18T21:26:51.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ee662700 1 -- 172.21.15.63:0/357971023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b93f0 msgr2=0x7ff8e812f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.991+0000 7ff8ee662700 1 --2- 172.21.15.63:0/357971023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b93f0 0x7ff8e812f3e0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7ff8e0001110 tx=0x7ff8dc008ca0).stop 2020-05-18T21:26:51.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.995+0000 7ff8ee662700 1 -- 172.21.15.63:0/357971023 shutdown_connections 2020-05-18T21:26:51.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.995+0000 7ff8ee662700 1 --2- 172.21.15.63:0/357971023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b93f0 0x7ff8e812f3e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.995+0000 7ff8ee662700 1 -- 172.21.15.63:0/357971023 >> 172.21.15.63:0/357971023 conn(0x7ff8e8069b70 msgr2=0x7ff8e8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:51.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.995+0000 7ff8ee662700 1 -- 172.21.15.63:0/357971023 shutdown_connections 2020-05-18T21:26:51.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.995+0000 7ff8ee662700 1 -- 172.21.15.63:0/357971023 wait complete. 2020-05-18T21:26:51.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.995+0000 7ff8ee662700 1 Processor -- start 2020-05-18T21:26:51.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.995+0000 7ff8ee662700 1 -- start start 2020-05-18T21:26:51.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.995+0000 7ff8ee662700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b7e30 0x7ff8e80b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:51.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.995+0000 7ff8ee662700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e80afed0 con 0x7ff8e80b79f0 2020-05-18T21:26:51.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.995+0000 7ff8ee662700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e80b0170 con 0x7ff8e80b93f0 2020-05-18T21:26:51.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.995+0000 7ff8ee662700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80b0d10 con 0x7ff8e80b7e30 2020-05-18T21:26:51.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.995+0000 7ff8ed660700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff8e80b79f0 0x7ff8e80b5830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54946/0 (socket says 172.21.15.63:54946) 2020-05-18T21:26:51.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.995+0000 7ff8ed660700 1 -- 172.21.15.63:0/2300693735 learned_addr learned my addr 172.21.15.63:0/2300693735 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:51.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.995+0000 7ff8ece5f700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b7e30 0x7ff8e80b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.995+0000 7ff8da7fc700 1 -- 172.21.15.63:0/2300693735 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772647943 0 0) 0x7ff8e80afed0 con 0x7ff8e80b79f0 2020-05-18T21:26:51.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.995+0000 7ff8da7fc700 1 -- 172.21.15.63:0/2300693735 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8d0002fe0 con 0x7ff8e80b79f0 2020-05-18T21:26:51.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8da7fc700 1 -- 172.21.15.63:0/2300693735 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133654851 0 0) 0x7ff8e80b0170 con 0x7ff8e80b93f0 2020-05-18T21:26:51.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8da7fc700 1 -- 172.21.15.63:0/2300693735 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8e80afed0 con 0x7ff8e80b93f0 2020-05-18T21:26:51.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8da7fc700 1 -- 172.21.15.63:0/2300693735 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3791221488 0 0) 0x7ff8d0002fe0 con 0x7ff8e80b79f0 2020-05-18T21:26:51.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8da7fc700 1 -- 172.21.15.63:0/2300693735 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff8e80b0170 con 0x7ff8e80b79f0 2020-05-18T21:26:51.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8da7fc700 1 -- 172.21.15.63:0/2300693735 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7ff8dc008a20 con 0x7ff8e80b79f0 2020-05-18T21:26:51.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8ece5f700 1 -- 172.21.15.63:0/2300693735 >> v1:172.21.15.155:6789/0 conn(0x7ff8e80b93f0 legacy=0x7ff8e80ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8ece5f700 1 -- 172.21.15.63:0/2300693735 >> v1:172.21.15.63:6789/0 conn(0x7ff8e80b79f0 legacy=0x7ff8e80b5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8ece5f700 1 -- 172.21.15.63:0/2300693735 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e80b0410 con 0x7ff8e80b7e30 2020-05-18T21:26:51.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8ece5f700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b7e30 0x7ff8e80b08b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff8e4001110 tx=0x7ff8e4010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8ece5f700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b7e30 0x7ff8e80b08b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff8e4001110 tx=0x7ff8e4010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8ece5f700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b7e30 0x7ff8e80b08b0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7ff8e4001110 tx=0x7ff8e4010920).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:51.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8ece5f700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b7e30 0x7ff8e80b08b0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7ff8e4001110 tx=0x7ff8e4010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8da7fc700 1 -- 172.21.15.63:0/2300693735 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e400cb40 con 0x7ff8e80b7e30 2020-05-18T21:26:51.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8ece5f700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b7e30 0x7ff8e80b08b0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7ff8e4001110 tx=0x7ff8e4010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8ee662700 1 -- 172.21.15.63:0/2300693735 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e80b5fa0 con 0x7ff8e80b7e30 2020-05-18T21:26:51.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8da7fc700 1 -- 172.21.15.63:0/2300693735 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e4011e90 con 0x7ff8e80b7e30 2020-05-18T21:26:51.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8ece5f700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b7e30 0x7ff8e80b08b0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7ff8e4001110 tx=0x7ff8e4010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8da7fc700 1 -- 172.21.15.63:0/2300693735 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e400ce90 con 0x7ff8e80b7e30 2020-05-18T21:26:51.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8ee662700 1 -- 172.21.15.63:0/2300693735 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e80afb60 con 0x7ff8e80b7e30 2020-05-18T21:26:51.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8ee662700 1 -- 172.21.15.63:0/2300693735 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff8e80b0610 con 0x7ff8e80b7e30 2020-05-18T21:26:51.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8ece5f700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b7e30 0x7ff8e80b08b0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7ff8e4001110 tx=0x7ff8e4010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8da7fc700 1 -- 172.21.15.63:0/2300693735 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff8e4006520 con 0x7ff8e80b7e30 2020-05-18T21:26:51.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:50.999+0000 7ff8ece5f700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b7e30 0x7ff8e80b08b0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7ff8e4001110 tx=0x7ff8e4010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.003+0000 7ff8ece5f700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b7e30 0x7ff8e80b08b0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7ff8e4001110 tx=0x7ff8e4010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.003+0000 7ff8da7fc700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8d0050150 0x7ff8d0052610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:51.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.003+0000 7ff8da7fc700 1 -- 172.21.15.63:0/2300693735 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff8e4063670 con 0x7ff8e80b7e30 2020-05-18T21:26:51.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.003+0000 7ff8da7fc700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7ff8d0056ac0 0x7ff8d0058ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:51.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.003+0000 7ff8da7fc700 1 -- 172.21.15.63:0/2300693735 --> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8d00594a0 con 0x7ff8d0056ac0 2020-05-18T21:26:51.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.003+0000 7ff8da7fc700 1 -- 172.21.15.63:0/2300693735 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8e40639d0 con 0x7ff8e80b7e30 2020-05-18T21:26:51.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.003+0000 7ff8ed660700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8d0050150 0x7ff8d0052610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.003+0000 7ff8ede61700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7ff8d0056ac0 0x7ff8d0058ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.003+0000 7ff8ed660700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8d0050150 0x7ff8d0052610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff8e80ae950 tx=0x7ff8e80b8890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.003+0000 7ff8ed660700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8d0050150 0x7ff8d0052610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff8e80ae950 tx=0x7ff8e80b8890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.003+0000 7ff8ed660700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8d0050150 0x7ff8d0052610 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7ff8e80ae950 tx=0x7ff8e80b8890).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:51.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.003+0000 7ff8ede61700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7ff8d0056ac0 0x7ff8d0058ee0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:51.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.007+0000 7ff8da7fc700 1 -- 172.21.15.63:0/2300693735 <== osd.7 v2:172.21.15.155:6823/13026 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23263 (crc 0 0 0) 0x7ff8d00594a0 con 0x7ff8d0056ac0 2020-05-18T21:26:51.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.023+0000 7ff8ee662700 1 -- 172.21.15.63:0/2300693735 --> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff8e80569e0 con 0x7ff8d0056ac0 2020-05-18T21:26:51.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.027+0000 7ff8da7fc700 1 -- 172.21.15.63:0/2300693735 <== osd.7 v2:172.21.15.155:6823/13026 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff8e80569e0 con 0x7ff8d0056ac0 2020-05-18T21:26:51.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.027+0000 7ff8ee662700 1 -- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7ff8d0056ac0 msgr2=0x7ff8d0058ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.027+0000 7ff8ee662700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7ff8d0056ac0 0x7ff8d0058ee0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.027+0000 7ff8ee662700 1 -- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8d0050150 msgr2=0x7ff8d0052610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.027+0000 7ff8ee662700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8d0050150 0x7ff8d0052610 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7ff8e80ae950 tx=0x7ff8e80b8890).stop 2020-05-18T21:26:51.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.027+0000 7ff8ee662700 1 -- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b7e30 msgr2=0x7ff8e80b08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.027+0000 7ff8ee662700 1 --2- 172.21.15.63:0/2300693735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e80b7e30 0x7ff8e80b08b0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7ff8e4001110 tx=0x7ff8e4010920).stop 2020-05-18T21:26:51.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.027+0000 7ff8ede61700 1 -- 172.21.15.63:0/2300693735 reap_dead start 2020-05-18T21:26:51.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.027+0000 7ff8ee662700 1 -- 172.21.15.63:0/2300693735 shutdown_connections 2020-05-18T21:26:51.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.027+0000 7ff8ee662700 1 -- 172.21.15.63:0/2300693735 >> 172.21.15.63:0/2300693735 conn(0x7ff8e8069b70 msgr2=0x7ff8e80b7020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:51.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.027+0000 7ff8ee662700 1 -- 172.21.15.63:0/2300693735 shutdown_connections 2020-05-18T21:26:51.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.027+0000 7ff8ee662700 1 -- 172.21.15.63:0/2300693735 wait complete. 2020-05-18T21:26:51.042 INFO:teuthology.orchestra.run.smithi063.stdout:55834574852 2020-05-18T21:26:51.043 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-05-18T21:26:51.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.151+0000 7fc2883e7700 1 Processor -- start 2020-05-18T21:26:51.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.151+0000 7fc2883e7700 1 -- start start 2020-05-18T21:26:51.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.151+0000 7fc2883e7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 0x7fc2800b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:51.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.151+0000 7fc2883e7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc280061be0 0x7fc280062020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:51.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.151+0000 7fc2883e7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc280064860 0x7fc280064d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:51.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.151+0000 7fc2883e7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc280065ec0 con 0x7fc280064860 2020-05-18T21:26:51.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.151+0000 7fc2883e7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc280066160 con 0x7fc280061be0 2020-05-18T21:26:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.151+0000 7fc2883e7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc280064120 con 0x7fc2800b50b0 2020-05-18T21:26:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc286984700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc280064860 0x7fc280064d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc286984700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc280064860 0x7fc280064d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52772/0 (socket says 172.21.15.63:52772) 2020-05-18T21:26:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc285982700 1 --2- 172.21.15.63:0/2502084826 >> v2:172.21.15.155:3300/0 conn(0x7fc280061be0 0x7fc280062020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc286984700 1 -- 172.21.15.63:0/2502084826 learned_addr learned my addr 172.21.15.63:0/2502084826 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:51.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc286183700 1 --2- 172.21.15.63:0/2502084826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 0x7fc2800b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc286984700 1 -- 172.21.15.63:0/2502084826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 msgr2=0x7fc2800b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:51.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc286984700 1 --2- 172.21.15.63:0/2502084826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 0x7fc2800b8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:51.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc286984700 1 -- 172.21.15.63:0/2502084826 >> v2:172.21.15.155:3300/0 conn(0x7fc280061be0 msgr2=0x7fc280062020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:51.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc286984700 1 --2- 172.21.15.63:0/2502084826 >> v2:172.21.15.155:3300/0 conn(0x7fc280061be0 0x7fc280062020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:51.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc286984700 1 -- 172.21.15.63:0/2502084826 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2800643c0 con 0x7fc280064860 2020-05-18T21:26:51.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc286984700 1 --2- 172.21.15.63:0/2502084826 >> v2:172.21.15.63:3300/0 conn(0x7fc280064860 0x7fc280064d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc2780032f0 tx=0x7fc278007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc286984700 1 --2- 172.21.15.63:0/2502084826 >> v2:172.21.15.63:3300/0 conn(0x7fc280064860 0x7fc280064d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc2780032f0 tx=0x7fc278007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc286984700 1 --2- 172.21.15.63:0/2502084826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc280064860 0x7fc280064d10 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fc2780032f0 tx=0x7fc278007e00).ready entity=mon.0 client_cookie=360dfe914950c54e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:51.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc286984700 1 --2- 172.21.15.63:0/2502084826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc280064860 0x7fc280064d10 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fc2780032f0 tx=0x7fc278007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc286984700 1 --2- 172.21.15.63:0/2502084826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc280064860 0x7fc280064d10 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fc2780032f0 tx=0x7fc278007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc285181700 1 -- 172.21.15.63:0/2502084826 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc278011c60 con 0x7fc280064860 2020-05-18T21:26:51.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc286984700 1 --2- 172.21.15.63:0/2502084826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc280064860 0x7fc280064d10 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fc2780032f0 tx=0x7fc278007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc285181700 1 -- 172.21.15.63:0/2502084826 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc278011dc0 con 0x7fc280064860 2020-05-18T21:26:51.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc285181700 1 -- 172.21.15.63:0/2502084826 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc27800a370 con 0x7fc280064860 2020-05-18T21:26:51.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc2883e7700 1 -- 172.21.15.63:0/2502084826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc280064860 msgr2=0x7fc280064d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc2883e7700 1 --2- 172.21.15.63:0/2502084826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc280064860 0x7fc280064d10 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fc2780032f0 tx=0x7fc278007e00).stop 2020-05-18T21:26:51.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc2883e7700 1 -- 172.21.15.63:0/2502084826 shutdown_connections 2020-05-18T21:26:51.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc2883e7700 1 --2- 172.21.15.63:0/2502084826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc280064860 0x7fc280064d10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc2883e7700 1 --2- 172.21.15.63:0/2502084826 >> v2:172.21.15.155:3300/0 conn(0x7fc280061be0 0x7fc280062020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:51.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc2883e7700 1 --2- 172.21.15.63:0/2502084826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 0x7fc2800b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:51.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc2883e7700 1 -- 172.21.15.63:0/2502084826 >> 172.21.15.63:0/2502084826 conn(0x7fc2800b83b0 msgr2=0x7fc2800b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:51.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc2883e7700 1 -- 172.21.15.63:0/2502084826 shutdown_connections 2020-05-18T21:26:51.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.155+0000 7fc2883e7700 1 -- 172.21.15.63:0/2502084826 wait complete. 2020-05-18T21:26:51.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.159+0000 7fc2883e7700 1 Processor -- start 2020-05-18T21:26:51.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.159+0000 7fc2883e7700 1 -- start start 2020-05-18T21:26:51.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.159+0000 7fc2883e7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc280061be0 0x7fc28015b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:51.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.159+0000 7fc2883e7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 0x7fc28015b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:51.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.159+0000 7fc2883e7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc280147e90 con 0x7fc280064860 2020-05-18T21:26:51.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.159+0000 7fc2883e7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc280148130 con 0x7fc280061be0 2020-05-18T21:26:51.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.159+0000 7fc2883e7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2801483d0 con 0x7fc2800b50b0 2020-05-18T21:26:51.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc285982700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc280064860 0x7fc280146f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54964/0 (socket says 172.21.15.63:54964) 2020-05-18T21:26:51.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc285982700 1 -- 172.21.15.63:0/3956132358 learned_addr learned my addr 172.21.15.63:0/3956132358 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:51.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc286984700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 0x7fc28015b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc286183700 1 --2- 172.21.15.63:0/3956132358 >> v2:172.21.15.155:3300/0 conn(0x7fc280061be0 0x7fc28015b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc26f7fe700 1 -- 172.21.15.63:0/3956132358 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4211797203 0 0) 0x7fc280147e90 con 0x7fc280064860 2020-05-18T21:26:51.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc26f7fe700 1 -- 172.21.15.63:0/3956132358 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc260002fe0 con 0x7fc280064860 2020-05-18T21:26:51.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc286984700 1 -- 172.21.15.63:0/3956132358 >> v2:172.21.15.155:3300/0 conn(0x7fc280061be0 msgr2=0x7fc28015b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc286984700 1 --2- 172.21.15.63:0/3956132358 >> v2:172.21.15.155:3300/0 conn(0x7fc280061be0 0x7fc28015b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc286984700 1 -- 172.21.15.63:0/3956132358 >> v1:172.21.15.63:6789/0 conn(0x7fc280064860 legacy=0x7fc280146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc286984700 1 -- 172.21.15.63:0/3956132358 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28015bb30 con 0x7fc2800b50b0 2020-05-18T21:26:51.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc286984700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 0x7fc28015b6d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc280149d30 tx=0x7fc278007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc286984700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 0x7fc28015b6d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc280149d30 tx=0x7fc278007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc286984700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 0x7fc28015b6d0 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7fc280149d30 tx=0x7fc278007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:51.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc286984700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 0x7fc28015b6d0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fc280149d30 tx=0x7fc278007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc26f7fe700 1 -- 172.21.15.63:0/3956132358 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc278005c70 con 0x7fc2800b50b0 2020-05-18T21:26:51.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc286984700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 0x7fc28015b6d0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fc280149d30 tx=0x7fc278007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc26f7fe700 1 -- 172.21.15.63:0/3956132358 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc278005dd0 con 0x7fc2800b50b0 2020-05-18T21:26:51.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc286984700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 0x7fc28015b6d0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fc280149d30 tx=0x7fc278007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc2883e7700 1 -- 172.21.15.63:0/3956132358 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28014c6d0 con 0x7fc2800b50b0 2020-05-18T21:26:51.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc26f7fe700 1 -- 172.21.15.63:0/3956132358 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2780112c0 con 0x7fc2800b50b0 2020-05-18T21:26:51.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc2883e7700 1 -- 172.21.15.63:0/3956132358 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc280147830 con 0x7fc2800b50b0 2020-05-18T21:26:51.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc286984700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 0x7fc28015b6d0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fc280149d30 tx=0x7fc278007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc2883e7700 1 -- 172.21.15.63:0/3956132358 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc280147ce0 con 0x7fc2800b50b0 2020-05-18T21:26:51.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc26f7fe700 1 -- 172.21.15.63:0/3956132358 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc278010620 con 0x7fc2800b50b0 2020-05-18T21:26:51.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.163+0000 7fc286984700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 0x7fc28015b6d0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fc280149d30 tx=0x7fc278007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.167+0000 7fc26f7fe700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc26004fce0 0x7fc2600521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:51.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.167+0000 7fc26f7fe700 1 -- 172.21.15.63:0/3956132358 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc278064270 con 0x7fc2800b50b0 2020-05-18T21:26:51.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.167+0000 7fc286183700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc26004fce0 0x7fc2600521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.167+0000 7fc286183700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc26004fce0 0x7fc2600521a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc27c002f70 tx=0x7fc28005b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.167+0000 7fc286183700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc26004fce0 0x7fc2600521a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc27c002f70 tx=0x7fc28005b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.167+0000 7fc286183700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc26004fce0 0x7fc2600521a0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7fc27c002f70 tx=0x7fc28005b560).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:51.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.175+0000 7fc286984700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 0x7fc28015b6d0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fc280149d30 tx=0x7fc278007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.175+0000 7fc26f7fe700 1 -- 172.21.15.63:0/3956132358 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc27803e600 con 0x7fc2800b50b0 2020-05-18T21:26:51.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.295+0000 7fc2883e7700 1 -- 172.21.15.63:0/3956132358 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc2800569e0 con 0x7fc2800b50b0 2020-05-18T21:26:51.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.299+0000 7fc286984700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 0x7fc28015b6d0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fc280149d30 tx=0x7fc278007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.299+0000 7fc26f7fe700 1 -- 172.21.15.63:0/3956132358 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc278041c20 con 0x7fc2800b50b0 2020-05-18T21:26:51.301 INFO:teuthology.orchestra.run.smithi063.stdout:55834574852 2020-05-18T21:26:51.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.299+0000 7fc2883e7700 1 -- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc26004fce0 msgr2=0x7fc2600521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.299+0000 7fc2883e7700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc26004fce0 0x7fc2600521a0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7fc27c002f70 tx=0x7fc28005b560).stop 2020-05-18T21:26:51.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.299+0000 7fc2883e7700 1 -- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 msgr2=0x7fc28015b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.299+0000 7fc2883e7700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 0x7fc28015b6d0 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7fc280149d30 tx=0x7fc278007e00).stop 2020-05-18T21:26:51.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.299+0000 7fc2883e7700 1 -- 172.21.15.63:0/3956132358 shutdown_connections 2020-05-18T21:26:51.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.299+0000 7fc2883e7700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc26004fce0 0x7fc2600521a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.299+0000 7fc2883e7700 1 --2- 172.21.15.63:0/3956132358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2800b50b0 0x7fc28015b6d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.299+0000 7fc2883e7700 1 --2- 172.21.15.63:0/3956132358 >> v2:172.21.15.155:3300/0 conn(0x7fc280061be0 0x7fc28015b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.299+0000 7fc2883e7700 1 -- 172.21.15.63:0/3956132358 >> 172.21.15.63:0/3956132358 conn(0x7fc2800b83b0 msgr2=0x7fc280146690 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:51.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.299+0000 7fc2883e7700 1 -- 172.21.15.63:0/3956132358 shutdown_connections 2020-05-18T21:26:51.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.299+0000 7fc2883e7700 1 -- 172.21.15.63:0/3956132358 wait complete. 2020-05-18T21:26:51.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2020-05-18T21:26:51.314 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-05-18T21:26:51.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.415+0000 7fc56c48f700 1 Processor -- start 2020-05-18T21:26:51.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.415+0000 7fc56c48f700 1 -- start start 2020-05-18T21:26:51.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56c48f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc5640b7bf0 0x7fc564145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:51.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56c48f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc564143810 con 0x7fc5640b6d70 2020-05-18T21:26:51.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56c48f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5640b7210 con 0x7fc564143430 2020-05-18T21:26:51.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56c48f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5640b74b0 con 0x7fc5640b7bf0 2020-05-18T21:26:51.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc569a2a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc5640b6d70 0x7fc5640b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54972/0 (socket says 172.21.15.63:54972) 2020-05-18T21:26:51.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc569a2a700 1 -- 172.21.15.63:0/3411502389 learned_addr learned my addr 172.21.15.63:0/3411502389 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:51.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56aa2c700 1 --2- 172.21.15.63:0/3411502389 >> v2:172.21.15.155:3300/0 conn(0x7fc5640b7bf0 0x7fc564145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc569229700 1 -- 172.21.15.63:0/3411502389 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387607173 0 0) 0x7fc564143810 con 0x7fc5640b6d70 2020-05-18T21:26:51.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc569229700 1 -- 172.21.15.63:0/3411502389 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc54c003270 con 0x7fc5640b6d70 2020-05-18T21:26:51.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc569229700 1 -- 172.21.15.63:0/3411502389 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538835889 0 0) 0x7fc5640b7210 con 0x7fc564143430 2020-05-18T21:26:51.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc569229700 1 -- 172.21.15.63:0/3411502389 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc564143810 con 0x7fc564143430 2020-05-18T21:26:51.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc569229700 1 -- 172.21.15.63:0/3411502389 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 158136962 0 0) 0x7fc54c003270 con 0x7fc5640b6d70 2020-05-18T21:26:51.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56aa2c700 1 -- 172.21.15.63:0/3411502389 >> v1:172.21.15.155:6789/0 conn(0x7fc564143430 legacy=0x7fc5640b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56aa2c700 1 -- 172.21.15.63:0/3411502389 >> v1:172.21.15.63:6789/0 conn(0x7fc5640b6d70 legacy=0x7fc5640b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56aa2c700 1 -- 172.21.15.63:0/3411502389 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5640b7750 con 0x7fc5640b7bf0 2020-05-18T21:26:51.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56aa2c700 1 --2- 172.21.15.63:0/3411502389 >> v2:172.21.15.155:3300/0 conn(0x7fc5640b7bf0 0x7fc564145dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc554001290 tx=0x7fc55c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56aa2c700 1 --2- 172.21.15.63:0/3411502389 >> v2:172.21.15.155:3300/0 conn(0x7fc5640b7bf0 0x7fc564145dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc554001290 tx=0x7fc55c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56aa2c700 1 --2- 172.21.15.63:0/3411502389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5640b7bf0 0x7fc564145dd0 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fc554001290 tx=0x7fc55c007e00).ready entity=mon.1 client_cookie=c636337c0806b1a6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:51.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56aa2c700 1 --2- 172.21.15.63:0/3411502389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5640b7bf0 0x7fc564145dd0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fc554001290 tx=0x7fc55c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc569229700 1 -- 172.21.15.63:0/3411502389 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc554001890 con 0x7fc5640b7bf0 2020-05-18T21:26:51.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56aa2c700 1 --2- 172.21.15.63:0/3411502389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5640b7bf0 0x7fc564145dd0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fc554001290 tx=0x7fc55c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc569229700 1 -- 172.21.15.63:0/3411502389 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55c011ac0 con 0x7fc5640b7bf0 2020-05-18T21:26:51.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56aa2c700 1 --2- 172.21.15.63:0/3411502389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5640b7bf0 0x7fc564145dd0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fc554001290 tx=0x7fc55c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc569229700 1 -- 172.21.15.63:0/3411502389 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc55c011e20 con 0x7fc5640b7bf0 2020-05-18T21:26:51.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56c48f700 1 -- 172.21.15.63:0/3411502389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5640b7bf0 msgr2=0x7fc564145dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56c48f700 1 --2- 172.21.15.63:0/3411502389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5640b7bf0 0x7fc564145dd0 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fc554001290 tx=0x7fc55c007e00).stop 2020-05-18T21:26:51.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56c48f700 1 -- 172.21.15.63:0/3411502389 shutdown_connections 2020-05-18T21:26:51.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56c48f700 1 --2- 172.21.15.63:0/3411502389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5640b7bf0 0x7fc564145dd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56c48f700 1 -- 172.21.15.63:0/3411502389 >> 172.21.15.63:0/3411502389 conn(0x7fc564069b70 msgr2=0x7fc564069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:51.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56c48f700 1 -- 172.21.15.63:0/3411502389 shutdown_connections 2020-05-18T21:26:51.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.419+0000 7fc56c48f700 1 -- 172.21.15.63:0/3411502389 wait complete. 2020-05-18T21:26:51.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc56c48f700 1 Processor -- start 2020-05-18T21:26:51.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc56c48f700 1 -- start start 2020-05-18T21:26:51.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc56c48f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5640b6d70 0x7fc564148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:51.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc56c48f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc5640b7bf0 0x7fc564141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:51.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc56c48f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc564143430 0x7fc564149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:51.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc56c48f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc564141df0 con 0x7fc5640b7bf0 2020-05-18T21:26:51.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc56c48f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56414a170 con 0x7fc564143430 2020-05-18T21:26:51.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc56c48f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640ac570 con 0x7fc5640b6d70 2020-05-18T21:26:51.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc569a2a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc5640b7bf0 0x7fc564141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc569a2a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc5640b7bf0 0x7fc564141990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52790/0 (socket says 172.21.15.63:52790) 2020-05-18T21:26:51.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc569a2a700 1 -- 172.21.15.63:0/3168377510 learned_addr learned my addr 172.21.15.63:0/3168377510 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:51.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc56a22b700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5640b6d70 0x7fc564148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc56aa2c700 1 --2- 172.21.15.63:0/3168377510 >> v2:172.21.15.155:3300/0 conn(0x7fc564143430 0x7fc564149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc569a2a700 1 -- 172.21.15.63:0/3168377510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5640b6d70 msgr2=0x7fc564148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc569a2a700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5640b6d70 0x7fc564148180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc569a2a700 1 -- 172.21.15.63:0/3168377510 >> v2:172.21.15.155:3300/0 conn(0x7fc564143430 msgr2=0x7fc564149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc569a2a700 1 --2- 172.21.15.63:0/3168377510 >> v2:172.21.15.155:3300/0 conn(0x7fc564143430 0x7fc564149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc569a2a700 1 -- 172.21.15.63:0/3168377510 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5640ac810 con 0x7fc5640b7bf0 2020-05-18T21:26:51.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc56a22b700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5640b6d70 0x7fc564148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:26:51.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc569a2a700 1 --2- 172.21.15.63:0/3168377510 >> v2:172.21.15.63:3300/0 conn(0x7fc5640b7bf0 0x7fc564141990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc554001160 tx=0x7fc56405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc569a2a700 1 --2- 172.21.15.63:0/3168377510 >> v2:172.21.15.63:3300/0 conn(0x7fc5640b7bf0 0x7fc564141990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc554001160 tx=0x7fc56405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc569a2a700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5640b7bf0 0x7fc564141990 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7fc554001160 tx=0x7fc56405ab60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:51.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc569a2a700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5640b7bf0 0x7fc564141990 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7fc554001160 tx=0x7fc56405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc569a2a700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5640b7bf0 0x7fc564141990 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7fc554001160 tx=0x7fc56405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc5537fe700 1 -- 172.21.15.63:0/3168377510 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc55400cb40 con 0x7fc5640b7bf0 2020-05-18T21:26:51.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc569a2a700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5640b7bf0 0x7fc564141990 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7fc554001160 tx=0x7fc56405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc5537fe700 1 -- 172.21.15.63:0/3168377510 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55400cca0 con 0x7fc5640b7bf0 2020-05-18T21:26:51.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc56c48f700 1 -- 172.21.15.63:0/3168377510 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5640acab0 con 0x7fc5640b7bf0 2020-05-18T21:26:51.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc5537fe700 1 -- 172.21.15.63:0/3168377510 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc55400ce50 con 0x7fc5640b7bf0 2020-05-18T21:26:51.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.423+0000 7fc56c48f700 1 -- 172.21.15.63:0/3168377510 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5641537a0 con 0x7fc5640b7bf0 2020-05-18T21:26:51.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.427+0000 7fc56c48f700 1 -- 172.21.15.63:0/3168377510 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5640569e0 con 0x7fc5640b7bf0 2020-05-18T21:26:51.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.427+0000 7fc569a2a700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5640b7bf0 0x7fc564141990 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7fc554001160 tx=0x7fc56405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.427+0000 7fc5537fe700 1 -- 172.21.15.63:0/3168377510 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc554012640 con 0x7fc5640b7bf0 2020-05-18T21:26:51.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.427+0000 7fc569a2a700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5640b7bf0 0x7fc564141990 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7fc554001160 tx=0x7fc56405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.427+0000 7fc5537fe700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54404fa60 0x7fc544051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:51.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.427+0000 7fc5537fe700 1 -- 172.21.15.63:0/3168377510 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc5540100c0 con 0x7fc5640b7bf0 2020-05-18T21:26:51.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.427+0000 7fc56a22b700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54404fa60 0x7fc544051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.427+0000 7fc56a22b700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54404fa60 0x7fc544051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc560001110 tx=0x7fc560003880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.427+0000 7fc56a22b700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54404fa60 0x7fc544051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc560001110 tx=0x7fc560003880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.427+0000 7fc56a22b700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54404fa60 0x7fc544051f20 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7fc560001110 tx=0x7fc560003880).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:51.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.435+0000 7fc569a2a700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5640b7bf0 0x7fc564141990 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7fc554001160 tx=0x7fc56405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.435+0000 7fc5537fe700 1 -- 172.21.15.63:0/3168377510 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc55403e1c0 con 0x7fc5640b7bf0 2020-05-18T21:26:51.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.551+0000 7fc56c48f700 1 -- 172.21.15.63:0/3168377510 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc5640678d0 con 0x7fc5640b7bf0 2020-05-18T21:26:51.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.551+0000 7fc569a2a700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5640b7bf0 0x7fc564141990 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7fc554001160 tx=0x7fc56405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.551+0000 7fc5537fe700 1 -- 172.21.15.63:0/3168377510 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc5540417e0 con 0x7fc5640b7bf0 2020-05-18T21:26:51.557 INFO:teuthology.orchestra.run.smithi063.stdout:55834574852 2020-05-18T21:26:51.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.555+0000 7fc56c48f700 1 -- 172.21.15.63:0/3168377510 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54404fa60 msgr2=0x7fc544051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.555+0000 7fc56c48f700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54404fa60 0x7fc544051f20 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7fc560001110 tx=0x7fc560003880).stop 2020-05-18T21:26:51.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.555+0000 7fc56c48f700 1 -- 172.21.15.63:0/3168377510 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5640b7bf0 msgr2=0x7fc564141990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.555+0000 7fc56c48f700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5640b7bf0 0x7fc564141990 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7fc554001160 tx=0x7fc56405ab60).stop 2020-05-18T21:26:51.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.555+0000 7fc56c48f700 1 -- 172.21.15.63:0/3168377510 shutdown_connections 2020-05-18T21:26:51.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.555+0000 7fc56c48f700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54404fa60 0x7fc544051f20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.555+0000 7fc56c48f700 1 --2- 172.21.15.63:0/3168377510 >> v2:172.21.15.155:3300/0 conn(0x7fc564143430 0x7fc564149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.555+0000 7fc56c48f700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5640b7bf0 0x7fc564141990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.555+0000 7fc56c48f700 1 --2- 172.21.15.63:0/3168377510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5640b6d70 0x7fc564148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.555+0000 7fc56c48f700 1 -- 172.21.15.63:0/3168377510 >> 172.21.15.63:0/3168377510 conn(0x7fc564069b70 msgr2=0x7fc5640bc750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:51.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.555+0000 7fc56c48f700 1 -- 172.21.15.63:0/3168377510 shutdown_connections 2020-05-18T21:26:51.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.555+0000 7fc56c48f700 1 -- 172.21.15.63:0/3168377510 wait complete. 2020-05-18T21:26:51.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2020-05-18T21:26:51.568 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-05-18T21:26:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.671+0000 7fc957fff700 1 Processor -- start 2020-05-18T21:26:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.671+0000 7fc957fff700 1 -- start start 2020-05-18T21:26:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.671+0000 7fc957fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc95805bcf0 0x7fc95805f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.671+0000 7fc957fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc95805f4b0 0x7fc95809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.671+0000 7fc957fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc958064fa0 con 0x7fc958143720 2020-05-18T21:26:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.671+0000 7fc957fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc958062b10 con 0x7fc95805bcf0 2020-05-18T21:26:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.671+0000 7fc957fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc958065240 con 0x7fc95805f4b0 2020-05-18T21:26:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.671+0000 7fc94ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc95805bcf0 0x7fc95805f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.671+0000 7fc94ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc95805bcf0 0x7fc95805f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52800/0 (socket says 172.21.15.63:52800) 2020-05-18T21:26:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.671+0000 7fc94ffff700 1 -- 172.21.15.63:0/2338574059 learned_addr learned my addr 172.21.15.63:0/2338574059 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.671+0000 7fc9577fe700 1 --2- 172.21.15.63:0/2338574059 >> v2:172.21.15.155:3300/0 conn(0x7fc95805f4b0 0x7fc95809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc94ffff700 1 -- 172.21.15.63:0/2338574059 >> v2:172.21.15.155:3300/0 conn(0x7fc95805f4b0 msgr2=0x7fc95809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc94ffff700 1 --2- 172.21.15.63:0/2338574059 >> v2:172.21.15.155:3300/0 conn(0x7fc95805f4b0 0x7fc95809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc94ffff700 1 -- 172.21.15.63:0/2338574059 >> v1:172.21.15.155:6789/0 conn(0x7fc958143720 legacy=0x7fc958065d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc94ffff700 1 -- 172.21.15.63:0/2338574059 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9580658c0 con 0x7fc95805bcf0 2020-05-18T21:26:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc94ffff700 1 --2- 172.21.15.63:0/2338574059 >> v2:172.21.15.63:3300/0 conn(0x7fc95805bcf0 0x7fc95805f050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc940002f70 tx=0x7fc940007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc94ffff700 1 --2- 172.21.15.63:0/2338574059 >> v2:172.21.15.63:3300/0 conn(0x7fc95805bcf0 0x7fc95805f050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc940002f70 tx=0x7fc940007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc94ffff700 1 --2- 172.21.15.63:0/2338574059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc95805bcf0 0x7fc95805f050 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7fc940002f70 tx=0x7fc940007a80).ready entity=mon.0 client_cookie=26b51c0a5db3e3e4 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc94ffff700 1 --2- 172.21.15.63:0/2338574059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc95805bcf0 0x7fc95805f050 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fc940002f70 tx=0x7fc940007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc94ffff700 1 --2- 172.21.15.63:0/2338574059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc95805bcf0 0x7fc95805f050 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fc940002f70 tx=0x7fc940007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc9567fc700 1 -- 172.21.15.63:0/2338574059 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9400116b0 con 0x7fc95805bcf0 2020-05-18T21:26:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc94ffff700 1 --2- 172.21.15.63:0/2338574059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc95805bcf0 0x7fc95805f050 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fc940002f70 tx=0x7fc940007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc9567fc700 1 -- 172.21.15.63:0/2338574059 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc940011810 con 0x7fc95805bcf0 2020-05-18T21:26:51.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc9567fc700 1 -- 172.21.15.63:0/2338574059 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc940011c30 con 0x7fc95805bcf0 2020-05-18T21:26:51.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc957fff700 1 -- 172.21.15.63:0/2338574059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc95805bcf0 msgr2=0x7fc95805f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc957fff700 1 --2- 172.21.15.63:0/2338574059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc95805bcf0 0x7fc95805f050 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7fc940002f70 tx=0x7fc940007a80).stop 2020-05-18T21:26:51.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc957fff700 1 -- 172.21.15.63:0/2338574059 shutdown_connections 2020-05-18T21:26:51.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc957fff700 1 --2- 172.21.15.63:0/2338574059 >> v2:172.21.15.155:3300/0 conn(0x7fc95805f4b0 0x7fc95809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:51.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc957fff700 1 --2- 172.21.15.63:0/2338574059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc95805bcf0 0x7fc95805f050 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc957fff700 1 -- 172.21.15.63:0/2338574059 >> 172.21.15.63:0/2338574059 conn(0x7fc95806a600 msgr2=0x7fc9580b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:51.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc957fff700 1 -- 172.21.15.63:0/2338574059 shutdown_connections 2020-05-18T21:26:51.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.675+0000 7fc957fff700 1 -- 172.21.15.63:0/2338574059 wait complete. 2020-05-18T21:26:51.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc957fff700 1 Processor -- start 2020-05-18T21:26:51.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc957fff700 1 -- start start 2020-05-18T21:26:51.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc957fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc95805f4b0 0x7fc9580afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:51.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc957fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc958143720 0x7fc9580b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:51.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc957fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc958139050 con 0x7fc95805bcf0 2020-05-18T21:26:51.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc957fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc958139280 con 0x7fc95805f4b0 2020-05-18T21:26:51.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc957fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc958139520 con 0x7fc958143720 2020-05-18T21:26:51.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc956ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc95805bcf0 0x7fc958136200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54990/0 (socket says 172.21.15.63:54990) 2020-05-18T21:26:51.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc956ffd700 1 -- 172.21.15.63:0/82472809 learned_addr learned my addr 172.21.15.63:0/82472809 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:51.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc94ffff700 1 --2- 172.21.15.63:0/82472809 >> v2:172.21.15.155:3300/0 conn(0x7fc95805f4b0 0x7fc9580afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc9577fe700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc958143720 0x7fc9580b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc954ff9700 1 -- 172.21.15.63:0/82472809 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041160990 0 0) 0x7fc958139050 con 0x7fc95805bcf0 2020-05-18T21:26:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc954ff9700 1 -- 172.21.15.63:0/82472809 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc930002fe0 con 0x7fc95805bcf0 2020-05-18T21:26:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc94ffff700 1 -- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc958143720 msgr2=0x7fc9580b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc94ffff700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc958143720 0x7fc9580b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc954ff9700 1 -- 172.21.15.63:0/82472809 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 908664297 0 0) 0x7fc930002fe0 con 0x7fc95805bcf0 2020-05-18T21:26:51.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc94ffff700 1 -- 172.21.15.63:0/82472809 >> v1:172.21.15.63:6789/0 conn(0x7fc95805bcf0 legacy=0x7fc958136200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc94ffff700 1 -- 172.21.15.63:0/82472809 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95813a240 con 0x7fc95805f4b0 2020-05-18T21:26:51.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc94ffff700 1 --2- 172.21.15.63:0/82472809 >> v2:172.21.15.155:3300/0 conn(0x7fc95805f4b0 0x7fc9580afbc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc948001b10 tx=0x7fc940007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc94ffff700 1 --2- 172.21.15.63:0/82472809 >> v2:172.21.15.155:3300/0 conn(0x7fc95805f4b0 0x7fc9580afbc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc948001b10 tx=0x7fc940007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc94ffff700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc95805f4b0 0x7fc9580afbc0 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7fc948001b10 tx=0x7fc940007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc94ffff700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc95805f4b0 0x7fc9580afbc0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fc948001b10 tx=0x7fc940007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc954ff9700 1 -- 172.21.15.63:0/82472809 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc948001970 con 0x7fc95805f4b0 2020-05-18T21:26:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc957fff700 1 -- 172.21.15.63:0/82472809 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc958136910 con 0x7fc95805f4b0 2020-05-18T21:26:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc94ffff700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc95805f4b0 0x7fc9580afbc0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fc948001b10 tx=0x7fc940007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.679+0000 7fc954ff9700 1 -- 172.21.15.63:0/82472809 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc940011b00 con 0x7fc95805f4b0 2020-05-18T21:26:51.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.683+0000 7fc94ffff700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc95805f4b0 0x7fc9580afbc0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fc948001b10 tx=0x7fc940007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.683+0000 7fc957fff700 1 -- 172.21.15.63:0/82472809 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9580b06a0 con 0x7fc95805f4b0 2020-05-18T21:26:51.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.683+0000 7fc954ff9700 1 -- 172.21.15.63:0/82472809 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc940011ea0 con 0x7fc95805f4b0 2020-05-18T21:26:51.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.683+0000 7fc94ffff700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc95805f4b0 0x7fc9580afbc0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fc948001b10 tx=0x7fc940007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.683+0000 7fc957fff700 1 -- 172.21.15.63:0/82472809 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9580569e0 con 0x7fc95805f4b0 2020-05-18T21:26:51.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.683+0000 7fc94ffff700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc95805f4b0 0x7fc9580afbc0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fc948001b10 tx=0x7fc940007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.683+0000 7fc954ff9700 1 -- 172.21.15.63:0/82472809 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc940007360 con 0x7fc95805f4b0 2020-05-18T21:26:51.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.683+0000 7fc954ff9700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc93004fcf0 0x7fc9300521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:51.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.683+0000 7fc954ff9700 1 -- 172.21.15.63:0/82472809 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc940063cf0 con 0x7fc95805f4b0 2020-05-18T21:26:51.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.683+0000 7fc956ffd700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc93004fcf0 0x7fc9300521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.683+0000 7fc956ffd700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc93004fcf0 0x7fc9300521b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc948001210 tx=0x7fc948009590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.683+0000 7fc956ffd700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc93004fcf0 0x7fc9300521b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc948001210 tx=0x7fc948009590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.683+0000 7fc956ffd700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc93004fcf0 0x7fc9300521b0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7fc948001210 tx=0x7fc948009590).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:51.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.691+0000 7fc94ffff700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc95805f4b0 0x7fc9580afbc0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fc948001b10 tx=0x7fc940007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.691+0000 7fc954ff9700 1 -- 172.21.15.63:0/82472809 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc94003e160 con 0x7fc95805f4b0 2020-05-18T21:26:51.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.807+0000 7fc957fff700 1 -- 172.21.15.63:0/82472809 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc958139660 con 0x7fc95805f4b0 2020-05-18T21:26:51.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.807+0000 7fc94ffff700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc95805f4b0 0x7fc9580afbc0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fc948001b10 tx=0x7fc940007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.807+0000 7fc954ff9700 1 -- 172.21.15.63:0/82472809 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc940041780 con 0x7fc95805f4b0 2020-05-18T21:26:51.811 INFO:teuthology.orchestra.run.smithi063.stdout:55834574852 2020-05-18T21:26:51.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.811+0000 7fc957fff700 1 -- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc93004fcf0 msgr2=0x7fc9300521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.811+0000 7fc957fff700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc93004fcf0 0x7fc9300521b0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7fc948001210 tx=0x7fc948009590).stop 2020-05-18T21:26:51.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.811+0000 7fc957fff700 1 -- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc95805f4b0 msgr2=0x7fc9580afbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.811+0000 7fc957fff700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc95805f4b0 0x7fc9580afbc0 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7fc948001b10 tx=0x7fc940007a80).stop 2020-05-18T21:26:51.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.811+0000 7fc957fff700 1 -- 172.21.15.63:0/82472809 shutdown_connections 2020-05-18T21:26:51.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.811+0000 7fc957fff700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc93004fcf0 0x7fc9300521b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.811+0000 7fc957fff700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc958143720 0x7fc9580b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.811+0000 7fc957fff700 1 --2- 172.21.15.63:0/82472809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc95805f4b0 0x7fc9580afbc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.811+0000 7fc957fff700 1 -- 172.21.15.63:0/82472809 >> 172.21.15.63:0/82472809 conn(0x7fc95806a600 msgr2=0x7fc9580ba3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:51.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.811+0000 7fc957fff700 1 -- 172.21.15.63:0/82472809 shutdown_connections 2020-05-18T21:26:51.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.811+0000 7fc957fff700 1 -- 172.21.15.63:0/82472809 wait complete. 2020-05-18T21:26:51.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2020-05-18T21:26:51.829 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-05-18T21:26:51.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.927+0000 7fb8fb59e700 1 Processor -- start 2020-05-18T21:26:51.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.927+0000 7fb8fb59e700 1 -- start start 2020-05-18T21:26:51.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fb59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb8fc13dd60 0x7fb8fc147150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:51.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fb59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8fc05c080 con 0x7fb8fc1475b0 2020-05-18T21:26:51.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fb59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8fc0607e0 con 0x7fb8fc060c40 2020-05-18T21:26:51.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fb59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8fc0ad730 con 0x7fb8fc13dd60 2020-05-18T21:26:51.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f9d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb8fc1475b0 0x7fb8fc0b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54998/0 (socket says 172.21.15.63:54998) 2020-05-18T21:26:51.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f9d9b700 1 -- 172.21.15.63:0/2382836368 learned_addr learned my addr 172.21.15.63:0/2382836368 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:51.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/2382836368 >> v2:172.21.15.155:3300/0 conn(0x7fb8fc13dd60 0x7fb8fc147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 -- 172.21.15.63:0/2382836368 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392596462 0 0) 0x7fb8fc05c080 con 0x7fb8fc1475b0 2020-05-18T21:26:51.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 -- 172.21.15.63:0/2382836368 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8dc003270 con 0x7fb8fc1475b0 2020-05-18T21:26:51.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 -- 172.21.15.63:0/2382836368 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023106697 0 0) 0x7fb8fc0607e0 con 0x7fb8fc060c40 2020-05-18T21:26:51.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 -- 172.21.15.63:0/2382836368 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8fc05c080 con 0x7fb8fc060c40 2020-05-18T21:26:51.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 -- 172.21.15.63:0/2382836368 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4066868630 0 0) 0x7fb8dc003270 con 0x7fb8fc1475b0 2020-05-18T21:26:51.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 -- 172.21.15.63:0/2382836368 >> v2:172.21.15.155:3300/0 conn(0x7fb8fc13dd60 msgr2=0x7fb8fc147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:51.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 --2- 172.21.15.63:0/2382836368 >> v2:172.21.15.155:3300/0 conn(0x7fb8fc13dd60 0x7fb8fc147150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:51.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 -- 172.21.15.63:0/2382836368 >> v1:172.21.15.155:6789/0 conn(0x7fb8fc060c40 legacy=0x7fb8fc0610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 -- 172.21.15.63:0/2382836368 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8fc0ad490 con 0x7fb8fc1475b0 2020-05-18T21:26:51.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 -- 172.21.15.63:0/2382836368 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fb8e4001710 con 0x7fb8fc1475b0 2020-05-18T21:26:51.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 -- 172.21.15.63:0/2382836368 >> v1:172.21.15.63:6789/0 conn(0x7fb8fc1475b0 legacy=0x7fb8fc0b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 --2- 172.21.15.63:0/2382836368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8dc0038f0 0x7fb8dc003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:51.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 --2- 172.21.15.63:0/2382836368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8dc004510 0x7fb8dc004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:51.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 --2- 172.21.15.63:0/2382836368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8dc004df0 0x7fb8dc00b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:51.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 -- 172.21.15.63:0/2382836368 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc0ad730 con 0x7fb8dc004df0 2020-05-18T21:26:51.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 -- 172.21.15.63:0/2382836368 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc0053e0 con 0x7fb8dc0038f0 2020-05-18T21:26:51.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 -- 172.21.15.63:0/2382836368 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc00bc40 con 0x7fb8dc004510 2020-05-18T21:26:51.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/2382836368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8dc0038f0 0x7fb8dc003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f9d9b700 1 --2- 172.21.15.63:0/2382836368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8dc004510 0x7fb8dc004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fad9d700 1 --2- 172.21.15.63:0/2382836368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8dc004df0 0x7fb8dc00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fa59c700 1 -- 172.21.15.63:0/2382836368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8dc004510 msgr2=0x7fb8dc004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:51.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/2382836368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8dc004510 0x7fb8dc004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:51.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fa59c700 1 -- 172.21.15.63:0/2382836368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8dc004df0 msgr2=0x7fb8dc00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:51.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/2382836368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8dc004df0 0x7fb8dc00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:51.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fad9d700 1 -- 172.21.15.63:0/2382836368 reap_dead start 2020-05-18T21:26:51.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fa59c700 1 -- 172.21.15.63:0/2382836368 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc003270 con 0x7fb8dc0038f0 2020-05-18T21:26:51.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/2382836368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8dc0038f0 0x7fb8dc003cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb8ec002f70 tx=0x7fb8ec010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/2382836368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8dc0038f0 0x7fb8dc003cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb8ec002f70 tx=0x7fb8ec010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/2382836368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8dc0038f0 0x7fb8dc003cf0 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7fb8ec002f70 tx=0x7fb8ec010060).ready entity=mon.1 client_cookie=78fc480b11cc3886 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:51.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/2382836368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8dc0038f0 0x7fb8dc003cf0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fb8ec002f70 tx=0x7fb8ec010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 -- 172.21.15.63:0/2382836368 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ec008d70 con 0x7fb8dc0038f0 2020-05-18T21:26:51.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/2382836368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8dc0038f0 0x7fb8dc003cf0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fb8ec002f70 tx=0x7fb8ec010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/2382836368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8dc0038f0 0x7fb8dc003cf0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fb8ec002f70 tx=0x7fb8ec010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 -- 172.21.15.63:0/2382836368 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec010910 con 0x7fb8dc0038f0 2020-05-18T21:26:51.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8f959a700 1 -- 172.21.15.63:0/2382836368 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ec010c70 con 0x7fb8dc0038f0 2020-05-18T21:26:51.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fb59e700 1 -- 172.21.15.63:0/2382836368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8dc0038f0 msgr2=0x7fb8dc003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.931+0000 7fb8fb59e700 1 --2- 172.21.15.63:0/2382836368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8dc0038f0 0x7fb8dc003cf0 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7fb8ec002f70 tx=0x7fb8ec010060).stop 2020-05-18T21:26:51.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.935+0000 7fb8fb59e700 1 -- 172.21.15.63:0/2382836368 shutdown_connections 2020-05-18T21:26:51.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.935+0000 7fb8fb59e700 1 --2- 172.21.15.63:0/2382836368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8dc0038f0 0x7fb8dc003cf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.935+0000 7fb8fb59e700 1 -- 172.21.15.63:0/2382836368 >> 172.21.15.63:0/2382836368 conn(0x7fb8fc09da60 msgr2=0x7fb8fc09de70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:51.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.935+0000 7fb8fb59e700 1 -- 172.21.15.63:0/2382836368 shutdown_connections 2020-05-18T21:26:51.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.935+0000 7fb8fb59e700 1 -- 172.21.15.63:0/2382836368 wait complete. 2020-05-18T21:26:51.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.935+0000 7fb8fb59e700 1 Processor -- start 2020-05-18T21:26:51.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.935+0000 7fb8fb59e700 1 -- start start 2020-05-18T21:26:51.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.935+0000 7fb8fb59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb8dc0038f0 0x7fb8fc1402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:51.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.935+0000 7fb8fb59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb8fc142fb0 0x7fb8fc154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:51.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.935+0000 7fb8fb59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8fc143440 con 0x7fb8fc13fec0 2020-05-18T21:26:51.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.935+0000 7fb8fb59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8fc0ae550 con 0x7fb8dc0038f0 2020-05-18T21:26:51.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.935+0000 7fb8fb59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8fc1547b0 con 0x7fb8fc142fb0 2020-05-18T21:26:51.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.935+0000 7fb8fa59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb8dc0038f0 0x7fb8fc1402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.935+0000 7fb8f9d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb8fc13fec0 0x7fb8fc0b06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55012/0 (socket says 172.21.15.63:55012) 2020-05-18T21:26:51.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.935+0000 7fb8f9d9b700 1 -- 172.21.15.63:0/625874471 learned_addr learned my addr 172.21.15.63:0/625874471 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:51.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.935+0000 7fb8fad9d700 1 --2- 172.21.15.63:0/625874471 >> v2:172.21.15.155:3300/0 conn(0x7fb8fc142fb0 0x7fb8fc154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8fa59c700 1 -- 172.21.15.63:0/625874471 >> v2:172.21.15.155:3300/0 conn(0x7fb8fc142fb0 msgr2=0x7fb8fc154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8f37fe700 1 -- 172.21.15.63:0/625874471 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836720706 0 0) 0x7fb8fc143440 con 0x7fb8fc13fec0 2020-05-18T21:26:51.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/625874471 >> v2:172.21.15.155:3300/0 conn(0x7fb8fc142fb0 0x7fb8fc154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:51.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8fa59c700 1 -- 172.21.15.63:0/625874471 >> v1:172.21.15.63:6789/0 conn(0x7fb8fc13fec0 legacy=0x7fb8fc0b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:51.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8fa59c700 1 -- 172.21.15.63:0/625874471 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8fc0b0e00 con 0x7fb8dc0038f0 2020-05-18T21:26:51.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/625874471 >> v2:172.21.15.63:3300/0 conn(0x7fb8dc0038f0 0x7fb8fc1402e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb8ec002f70 tx=0x7fb8ec010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/625874471 >> v2:172.21.15.63:3300/0 conn(0x7fb8dc0038f0 0x7fb8fc1402e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb8ec002f70 tx=0x7fb8ec010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/625874471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8dc0038f0 0x7fb8fc1402e0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7fb8ec002f70 tx=0x7fb8ec010060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:51.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/625874471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8dc0038f0 0x7fb8fc1402e0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7fb8ec002f70 tx=0x7fb8ec010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/625874471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8dc0038f0 0x7fb8fc1402e0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7fb8ec002f70 tx=0x7fb8ec010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8f37fe700 1 -- 172.21.15.63:0/625874471 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ec0058f0 con 0x7fb8dc0038f0 2020-05-18T21:26:51.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/625874471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8dc0038f0 0x7fb8fc1402e0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7fb8ec002f70 tx=0x7fb8ec010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8f37fe700 1 -- 172.21.15.63:0/625874471 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec005a50 con 0x7fb8dc0038f0 2020-05-18T21:26:51.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8fb59e700 1 -- 172.21.15.63:0/625874471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8fc1550b0 con 0x7fb8dc0038f0 2020-05-18T21:26:51.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8f37fe700 1 -- 172.21.15.63:0/625874471 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ec005df0 con 0x7fb8dc0038f0 2020-05-18T21:26:51.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8fb59e700 1 -- 172.21.15.63:0/625874471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8fc155530 con 0x7fb8dc0038f0 2020-05-18T21:26:51.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/625874471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8dc0038f0 0x7fb8fc1402e0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7fb8ec002f70 tx=0x7fb8ec010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8fb59e700 1 -- 172.21.15.63:0/625874471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8fc0569e0 con 0x7fb8dc0038f0 2020-05-18T21:26:51.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8f37fe700 1 -- 172.21.15.63:0/625874471 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb8ec014240 con 0x7fb8dc0038f0 2020-05-18T21:26:51.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/625874471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8dc0038f0 0x7fb8fc1402e0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7fb8ec002f70 tx=0x7fb8ec010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8f37fe700 1 --2- 172.21.15.63:0/625874471 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb8e004f940 0x7fb8e0051e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:51.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8f37fe700 1 -- 172.21.15.63:0/625874471 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb8ec063ea0 con 0x7fb8dc0038f0 2020-05-18T21:26:51.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.939+0000 7fb8f9d9b700 1 --2- 172.21.15.63:0/625874471 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb8e004f940 0x7fb8e0051e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:51.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.943+0000 7fb8f9d9b700 1 --2- 172.21.15.63:0/625874471 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb8e004f940 0x7fb8e0051e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb8e400e990 tx=0x7fb8fc06aa30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.943+0000 7fb8f9d9b700 1 --2- 172.21.15.63:0/625874471 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb8e004f940 0x7fb8e0051e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb8e400e990 tx=0x7fb8fc06aa30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.943+0000 7fb8f9d9b700 1 --2- 172.21.15.63:0/625874471 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb8e004f940 0x7fb8e0051e00 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7fb8e400e990 tx=0x7fb8fc06aa30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:51.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.947+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/625874471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8dc0038f0 0x7fb8fc1402e0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7fb8ec002f70 tx=0x7fb8ec010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:51.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:51.947+0000 7fb8f37fe700 1 -- 172.21.15.63:0/625874471 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb8ec03e2f0 con 0x7fb8dc0038f0 2020-05-18T21:26:52.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.059+0000 7fb8fb59e700 1 -- 172.21.15.63:0/625874471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb8fc0ae690 con 0x7fb8dc0038f0 2020-05-18T21:26:52.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.059+0000 7fb8fa59c700 1 --2- 172.21.15.63:0/625874471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8dc0038f0 0x7fb8fc1402e0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7fb8ec002f70 tx=0x7fb8ec010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.059+0000 7fb8f37fe700 1 -- 172.21.15.63:0/625874471 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb8ec041910 con 0x7fb8dc0038f0 2020-05-18T21:26:52.065 INFO:teuthology.orchestra.run.smithi063.stdout:55834574852 2020-05-18T21:26:52.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.063+0000 7fb8fb59e700 1 -- 172.21.15.63:0/625874471 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb8e004f940 msgr2=0x7fb8e0051e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.063+0000 7fb8fb59e700 1 --2- 172.21.15.63:0/625874471 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb8e004f940 0x7fb8e0051e00 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7fb8e400e990 tx=0x7fb8fc06aa30).stop 2020-05-18T21:26:52.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.063+0000 7fb8fb59e700 1 -- 172.21.15.63:0/625874471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8dc0038f0 msgr2=0x7fb8fc1402e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.063+0000 7fb8fb59e700 1 --2- 172.21.15.63:0/625874471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8dc0038f0 0x7fb8fc1402e0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7fb8ec002f70 tx=0x7fb8ec010060).stop 2020-05-18T21:26:52.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.063+0000 7fb8fb59e700 1 -- 172.21.15.63:0/625874471 shutdown_connections 2020-05-18T21:26:52.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.063+0000 7fb8fb59e700 1 --2- 172.21.15.63:0/625874471 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb8e004f940 0x7fb8e0051e00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.063+0000 7fb8fb59e700 1 --2- 172.21.15.63:0/625874471 >> v2:172.21.15.155:3300/0 conn(0x7fb8fc142fb0 0x7fb8fc154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.063+0000 7fb8fb59e700 1 --2- 172.21.15.63:0/625874471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8dc0038f0 0x7fb8fc1402e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.063+0000 7fb8fb59e700 1 -- 172.21.15.63:0/625874471 >> 172.21.15.63:0/625874471 conn(0x7fb8fc09da60 msgr2=0x7fb8fc064de0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:52.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.063+0000 7fb8fb59e700 1 -- 172.21.15.63:0/625874471 shutdown_connections 2020-05-18T21:26:52.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.063+0000 7fb8fb59e700 1 -- 172.21.15.63:0/625874471 wait complete. 2020-05-18T21:26:52.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.3 2020-05-18T21:26:52.077 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-05-18T21:26:52.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa601fc1700 1 Processor -- start 2020-05-18T21:26:52.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa601fc1700 1 -- start start 2020-05-18T21:26:52.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa601fc1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa5fc0b9fe0 0x7fa5fc09ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa601fc1700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5fc146f90 con 0x7fa5fc146b50 2020-05-18T21:26:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa601fc1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5fc142f00 con 0x7fa5fc1421e0 2020-05-18T21:26:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa601fc1700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5fc1431a0 con 0x7fa5fc0b9fe0 2020-05-18T21:26:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa5fbfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa5fc146b50 0x7fa5fc143640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55018/0 (socket says 172.21.15.63:55018) 2020-05-18T21:26:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa5fbfff700 1 -- 172.21.15.63:0/1797820677 learned_addr learned my addr 172.21.15.63:0/1797820677 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa600fbf700 1 --2- 172.21.15.63:0/1797820677 >> v2:172.21.15.155:3300/0 conn(0x7fa5fc0b9fe0 0x7fa5fc09ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa5fb7fe700 1 -- 172.21.15.63:0/1797820677 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997892828 0 0) 0x7fa5fc146f90 con 0x7fa5fc146b50 2020-05-18T21:26:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa5fb7fe700 1 -- 172.21.15.63:0/1797820677 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5e8003270 con 0x7fa5fc146b50 2020-05-18T21:26:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa600fbf700 1 -- 172.21.15.63:0/1797820677 >> v1:172.21.15.155:6789/0 conn(0x7fa5fc1421e0 legacy=0x7fa5fc142670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa600fbf700 1 -- 172.21.15.63:0/1797820677 >> v1:172.21.15.63:6789/0 conn(0x7fa5fc146b50 legacy=0x7fa5fc143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa5fb7fe700 1 -- 172.21.15.63:0/1797820677 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2028937116 0 0) 0x7fa5e8003270 con 0x7fa5fc146b50 2020-05-18T21:26:52.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa600fbf700 1 -- 172.21.15.63:0/1797820677 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc0ba3c0 con 0x7fa5fc0b9fe0 2020-05-18T21:26:52.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa600fbf700 1 --2- 172.21.15.63:0/1797820677 >> v2:172.21.15.155:3300/0 conn(0x7fa5fc0b9fe0 0x7fa5fc09ee70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa5f4001c30 tx=0x7fa5fc067480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa600fbf700 1 --2- 172.21.15.63:0/1797820677 >> v2:172.21.15.155:3300/0 conn(0x7fa5fc0b9fe0 0x7fa5fc09ee70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa5f4001c30 tx=0x7fa5fc067480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa600fbf700 1 --2- 172.21.15.63:0/1797820677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5fc0b9fe0 0x7fa5fc09ee70 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7fa5f4001c30 tx=0x7fa5fc067480).ready entity=mon.1 client_cookie=d07ab0c00becbdd6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:52.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa600fbf700 1 --2- 172.21.15.63:0/1797820677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5fc0b9fe0 0x7fa5fc09ee70 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7fa5f4001c30 tx=0x7fa5fc067480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa5fb7fe700 1 -- 172.21.15.63:0/1797820677 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f4001a90 con 0x7fa5fc0b9fe0 2020-05-18T21:26:52.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa600fbf700 1 --2- 172.21.15.63:0/1797820677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5fc0b9fe0 0x7fa5fc09ee70 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7fa5f4001c30 tx=0x7fa5fc067480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa600fbf700 1 --2- 172.21.15.63:0/1797820677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5fc0b9fe0 0x7fa5fc09ee70 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7fa5f4001c30 tx=0x7fa5fc067480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa5fb7fe700 1 -- 172.21.15.63:0/1797820677 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f0008e40 con 0x7fa5fc0b9fe0 2020-05-18T21:26:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa5fb7fe700 1 -- 172.21.15.63:0/1797820677 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f00114f0 con 0x7fa5fc0b9fe0 2020-05-18T21:26:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa601fc1700 1 -- 172.21.15.63:0/1797820677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5fc0b9fe0 msgr2=0x7fa5fc09ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.183+0000 7fa601fc1700 1 --2- 172.21.15.63:0/1797820677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5fc0b9fe0 0x7fa5fc09ee70 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7fa5f4001c30 tx=0x7fa5fc067480).stop 2020-05-18T21:26:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa601fc1700 1 -- 172.21.15.63:0/1797820677 shutdown_connections 2020-05-18T21:26:52.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa601fc1700 1 --2- 172.21.15.63:0/1797820677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5fc0b9fe0 0x7fa5fc09ee70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa601fc1700 1 -- 172.21.15.63:0/1797820677 >> 172.21.15.63:0/1797820677 conn(0x7fa5fc05b290 msgr2=0x7fa5fc0b9590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:52.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa601fc1700 1 -- 172.21.15.63:0/1797820677 shutdown_connections 2020-05-18T21:26:52.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa601fc1700 1 -- 172.21.15.63:0/1797820677 wait complete. 2020-05-18T21:26:52.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa601fc1700 1 Processor -- start 2020-05-18T21:26:52.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa601fc1700 1 -- start start 2020-05-18T21:26:52.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa601fc1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5fc1421e0 0x7fa5fc1534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:52.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa601fc1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa5fc146b50 0x7fa5fc134200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:52.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa601fc1700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5fc0afac0 con 0x7fa5fc0b9fe0 2020-05-18T21:26:52.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa601fc1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5fc135210 con 0x7fa5fc146b50 2020-05-18T21:26:52.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa601fc1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc1347a0 con 0x7fa5fc1421e0 2020-05-18T21:26:52.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa600fbf700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa5fc0b9fe0 0x7fa5fc153b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55024/0 (socket says 172.21.15.63:55024) 2020-05-18T21:26:52.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa600fbf700 1 -- 172.21.15.63:0/724613684 learned_addr learned my addr 172.21.15.63:0/724613684 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:52.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa6017c0700 1 --2- 172.21.15.63:0/724613684 >> v2:172.21.15.63:3300/0 conn(0x7fa5fc146b50 0x7fa5fc134200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa5fbfff700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5fc1421e0 0x7fa5fc1534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa5f9ffb700 1 -- 172.21.15.63:0/724613684 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318394404 0 0) 0x7fa5fc0afac0 con 0x7fa5fc0b9fe0 2020-05-18T21:26:52.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa5f9ffb700 1 -- 172.21.15.63:0/724613684 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5dc002fe0 con 0x7fa5fc0b9fe0 2020-05-18T21:26:52.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa6017c0700 1 -- 172.21.15.63:0/724613684 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5fc1421e0 msgr2=0x7fa5fc1534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa6017c0700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5fc1421e0 0x7fa5fc1534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa6017c0700 1 -- 172.21.15.63:0/724613684 >> v1:172.21.15.63:6789/0 conn(0x7fa5fc0b9fe0 legacy=0x7fa5fc153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa6017c0700 1 -- 172.21.15.63:0/724613684 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc134a40 con 0x7fa5fc146b50 2020-05-18T21:26:52.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa6017c0700 1 --2- 172.21.15.63:0/724613684 >> v2:172.21.15.63:3300/0 conn(0x7fa5fc146b50 0x7fa5fc134200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa5fc09cd00 tx=0x7fa5ec010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa6017c0700 1 --2- 172.21.15.63:0/724613684 >> v2:172.21.15.63:3300/0 conn(0x7fa5fc146b50 0x7fa5fc134200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa5fc09cd00 tx=0x7fa5ec010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa6017c0700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5fc146b50 0x7fa5fc134200 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7fa5fc09cd00 tx=0x7fa5ec010860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:52.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa6017c0700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5fc146b50 0x7fa5fc134200 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fa5fc09cd00 tx=0x7fa5ec010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa5f9ffb700 1 -- 172.21.15.63:0/724613684 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5ec006c00 con 0x7fa5fc146b50 2020-05-18T21:26:52.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa6017c0700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5fc146b50 0x7fa5fc134200 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fa5fc09cd00 tx=0x7fa5ec010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa6017c0700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5fc146b50 0x7fa5fc134200 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fa5fc09cd00 tx=0x7fa5ec010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa5f9ffb700 1 -- 172.21.15.63:0/724613684 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ec006d60 con 0x7fa5fc146b50 2020-05-18T21:26:52.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa601fc1700 1 -- 172.21.15.63:0/724613684 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5fc134ce0 con 0x7fa5fc146b50 2020-05-18T21:26:52.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa5f9ffb700 1 -- 172.21.15.63:0/724613684 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5ec010fd0 con 0x7fa5fc146b50 2020-05-18T21:26:52.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.187+0000 7fa601fc1700 1 -- 172.21.15.63:0/724613684 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5fc05f8b0 con 0x7fa5fc146b50 2020-05-18T21:26:52.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.191+0000 7fa6017c0700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5fc146b50 0x7fa5fc134200 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fa5fc09cd00 tx=0x7fa5ec010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.191+0000 7fa601fc1700 1 -- 172.21.15.63:0/724613684 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5fc0569e0 con 0x7fa5fc146b50 2020-05-18T21:26:52.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.191+0000 7fa5f9ffb700 1 -- 172.21.15.63:0/724613684 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa5ec011240 con 0x7fa5fc146b50 2020-05-18T21:26:52.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.191+0000 7fa6017c0700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5fc146b50 0x7fa5fc134200 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fa5fc09cd00 tx=0x7fa5ec010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.191+0000 7fa5f9ffb700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa5dc04fd50 0x7fa5dc052210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:52.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.191+0000 7fa5f9ffb700 1 -- 172.21.15.63:0/724613684 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa5ec063ae0 con 0x7fa5fc146b50 2020-05-18T21:26:52.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.191+0000 7fa600fbf700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa5dc04fd50 0x7fa5dc052210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.191+0000 7fa600fbf700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa5dc04fd50 0x7fa5dc052210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa5f0000bc0 tx=0x7fa5fc067480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.191+0000 7fa600fbf700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa5dc04fd50 0x7fa5dc052210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa5f0000bc0 tx=0x7fa5fc067480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.191+0000 7fa600fbf700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa5dc04fd50 0x7fa5dc052210 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7fa5f0000bc0 tx=0x7fa5fc067480).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:52.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.195+0000 7fa6017c0700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5fc146b50 0x7fa5fc134200 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fa5fc09cd00 tx=0x7fa5ec010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.195+0000 7fa5f9ffb700 1 -- 172.21.15.63:0/724613684 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa5ec03de10 con 0x7fa5fc146b50 2020-05-18T21:26:52.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.311+0000 7fa601fc1700 1 -- 172.21.15.63:0/724613684 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa5fc0008d0 con 0x7fa5fc146b50 2020-05-18T21:26:52.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.311+0000 7fa6017c0700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5fc146b50 0x7fa5fc134200 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fa5fc09cd00 tx=0x7fa5ec010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.311+0000 7fa5f9ffb700 1 -- 172.21.15.63:0/724613684 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5ec041430 con 0x7fa5fc146b50 2020-05-18T21:26:52.315 INFO:teuthology.orchestra.run.smithi063.stdout:55834574853 2020-05-18T21:26:52.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.311+0000 7fa601fc1700 1 -- 172.21.15.63:0/724613684 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa5dc04fd50 msgr2=0x7fa5dc052210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.311+0000 7fa601fc1700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa5dc04fd50 0x7fa5dc052210 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7fa5f0000bc0 tx=0x7fa5fc067480).stop 2020-05-18T21:26:52.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.311+0000 7fa601fc1700 1 -- 172.21.15.63:0/724613684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5fc146b50 msgr2=0x7fa5fc134200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.311+0000 7fa601fc1700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5fc146b50 0x7fa5fc134200 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7fa5fc09cd00 tx=0x7fa5ec010860).stop 2020-05-18T21:26:52.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.311+0000 7fa601fc1700 1 -- 172.21.15.63:0/724613684 shutdown_connections 2020-05-18T21:26:52.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.311+0000 7fa601fc1700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa5dc04fd50 0x7fa5dc052210 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.315+0000 7fa601fc1700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5fc146b50 0x7fa5fc134200 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.315+0000 7fa601fc1700 1 --2- 172.21.15.63:0/724613684 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5fc1421e0 0x7fa5fc1534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.315+0000 7fa601fc1700 1 -- 172.21.15.63:0/724613684 >> 172.21.15.63:0/724613684 conn(0x7fa5fc05b290 msgr2=0x7fa5fc09c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:52.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.315+0000 7fa601fc1700 1 -- 172.21.15.63:0/724613684 shutdown_connections 2020-05-18T21:26:52.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.315+0000 7fa601fc1700 1 -- 172.21.15.63:0/724613684 wait complete. 2020-05-18T21:26:52.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2020-05-18T21:26:52.327 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-05-18T21:26:52.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.431+0000 7f02eda30700 1 Processor -- start 2020-05-18T21:26:52.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.431+0000 7f02eda30700 1 -- start start 2020-05-18T21:26:52.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eda30700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f02e812b0f0 0x7f02e80b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:52.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eda30700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e8142bd0 con 0x7f02e8146a30 2020-05-18T21:26:52.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eda30700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e8142e70 con 0x7f02e812bbe0 2020-05-18T21:26:52.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eda30700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e8143110 con 0x7f02e812b0f0 2020-05-18T21:26:52.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02e7fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f02e8146a30 0x7f02e812b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55036/0 (socket says 172.21.15.63:55036) 2020-05-18T21:26:52.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02e7fff700 1 -- 172.21.15.63:0/895926671 learned_addr learned my addr 172.21.15.63:0/895926671 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:52.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eca2e700 1 --2- 172.21.15.63:0/895926671 >> v2:172.21.15.155:3300/0 conn(0x7f02e812b0f0 0x7f02e80b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02e77fe700 1 -- 172.21.15.63:0/895926671 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376156389 0 0) 0x7f02e8142bd0 con 0x7f02e8146a30 2020-05-18T21:26:52.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02e77fe700 1 -- 172.21.15.63:0/895926671 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02cc003270 con 0x7f02e8146a30 2020-05-18T21:26:52.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02e77fe700 1 -- 172.21.15.63:0/895926671 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149499384 0 0) 0x7f02e8142e70 con 0x7f02e812bbe0 2020-05-18T21:26:52.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02e77fe700 1 -- 172.21.15.63:0/895926671 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02e8142bd0 con 0x7f02e812bbe0 2020-05-18T21:26:52.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eca2e700 1 -- 172.21.15.63:0/895926671 >> v1:172.21.15.155:6789/0 conn(0x7f02e812bbe0 legacy=0x7f02e8064ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eca2e700 1 -- 172.21.15.63:0/895926671 >> v1:172.21.15.63:6789/0 conn(0x7f02e8146a30 legacy=0x7f02e812b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eca2e700 1 -- 172.21.15.63:0/895926671 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e8146e70 con 0x7f02e812b0f0 2020-05-18T21:26:52.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eca2e700 1 --2- 172.21.15.63:0/895926671 >> v2:172.21.15.155:3300/0 conn(0x7f02e812b0f0 0x7f02e80b5420 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f02dc002f70 tx=0x7f02dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eca2e700 1 --2- 172.21.15.63:0/895926671 >> v2:172.21.15.155:3300/0 conn(0x7f02e812b0f0 0x7f02e80b5420 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f02dc002f70 tx=0x7f02dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eca2e700 1 --2- 172.21.15.63:0/895926671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02e812b0f0 0x7f02e80b5420 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f02dc002f70 tx=0x7f02dc007a80).ready entity=mon.1 client_cookie=b83355fe03da9f8e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:52.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eca2e700 1 --2- 172.21.15.63:0/895926671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02e812b0f0 0x7f02e80b5420 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f02dc002f70 tx=0x7f02dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02e77fe700 1 -- 172.21.15.63:0/895926671 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02dc008e80 con 0x7f02e812b0f0 2020-05-18T21:26:52.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eca2e700 1 --2- 172.21.15.63:0/895926671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02e812b0f0 0x7f02e80b5420 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f02dc002f70 tx=0x7f02dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02e77fe700 1 -- 172.21.15.63:0/895926671 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02dc011540 con 0x7f02e812b0f0 2020-05-18T21:26:52.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eca2e700 1 --2- 172.21.15.63:0/895926671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02e812b0f0 0x7f02e80b5420 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f02dc002f70 tx=0x7f02dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02e77fe700 1 -- 172.21.15.63:0/895926671 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02dc011920 con 0x7f02e812b0f0 2020-05-18T21:26:52.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eda30700 1 -- 172.21.15.63:0/895926671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02e812b0f0 msgr2=0x7f02e80b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eda30700 1 --2- 172.21.15.63:0/895926671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02e812b0f0 0x7f02e80b5420 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f02dc002f70 tx=0x7f02dc007a80).stop 2020-05-18T21:26:52.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eda30700 1 -- 172.21.15.63:0/895926671 shutdown_connections 2020-05-18T21:26:52.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eda30700 1 --2- 172.21.15.63:0/895926671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02e812b0f0 0x7f02e80b5420 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eda30700 1 -- 172.21.15.63:0/895926671 >> 172.21.15.63:0/895926671 conn(0x7f02e809da60 msgr2=0x7f02e809de70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:52.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eda30700 1 -- 172.21.15.63:0/895926671 shutdown_connections 2020-05-18T21:26:52.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.435+0000 7f02eda30700 1 -- 172.21.15.63:0/895926671 wait complete. 2020-05-18T21:26:52.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eda30700 1 Processor -- start 2020-05-18T21:26:52.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eda30700 1 -- start start 2020-05-18T21:26:52.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eda30700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f02e812bbe0 0x7f02e81434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:52.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eda30700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e8146a30 0x7f02e8144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:52.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eda30700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e80b2030 con 0x7f02e812b0f0 2020-05-18T21:26:52.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eda30700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e80b22d0 con 0x7f02e812bbe0 2020-05-18T21:26:52.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eda30700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80b2570 con 0x7f02e8146a30 2020-05-18T21:26:52.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eca2e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f02e812b0f0 0x7f02e80607b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55038/0 (socket says 172.21.15.63:55038) 2020-05-18T21:26:52.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eca2e700 1 -- 172.21.15.63:0/2418178098 learned_addr learned my addr 172.21.15.63:0/2418178098 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:52.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e7fff700 1 --2- 172.21.15.63:0/2418178098 >> v2:172.21.15.155:3300/0 conn(0x7f02e812bbe0 0x7f02e81434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02ed22f700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e8146a30 0x7f02e8144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e5ffb700 1 -- 172.21.15.63:0/2418178098 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876402159 0 0) 0x7f02e80b2030 con 0x7f02e812b0f0 2020-05-18T21:26:52.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e5ffb700 1 -- 172.21.15.63:0/2418178098 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02d0002fe0 con 0x7f02e812b0f0 2020-05-18T21:26:52.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e5ffb700 1 -- 172.21.15.63:0/2418178098 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 921902688 0 0) 0x7f02d0002fe0 con 0x7f02e812b0f0 2020-05-18T21:26:52.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e5ffb700 1 -- 172.21.15.63:0/2418178098 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f02e80b2030 con 0x7f02e812b0f0 2020-05-18T21:26:52.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e5ffb700 1 -- 172.21.15.63:0/2418178098 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f02dc008e80 con 0x7f02e812b0f0 2020-05-18T21:26:52.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e5ffb700 1 -- 172.21.15.63:0/2418178098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e8146a30 msgr2=0x7f02e8144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e5ffb700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e8146a30 0x7f02e8144b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e5ffb700 1 -- 172.21.15.63:0/2418178098 >> v2:172.21.15.155:3300/0 conn(0x7f02e812bbe0 msgr2=0x7f02e81434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e5ffb700 1 --2- 172.21.15.63:0/2418178098 >> v2:172.21.15.155:3300/0 conn(0x7f02e812bbe0 0x7f02e81434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e5ffb700 1 -- 172.21.15.63:0/2418178098 >> v1:172.21.15.63:6789/0 conn(0x7f02e812b0f0 legacy=0x7f02e80607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e5ffb700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02d0004a80 0x7f02d0004e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:52.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e5ffb700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e8146a30 0x7f02d00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:52.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e5ffb700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02d0003e00 0x7f02d0004280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:52.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e5ffb700 1 -- 172.21.15.63:0/2418178098 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80b22d0 con 0x7f02d0004a80 2020-05-18T21:26:52.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e5ffb700 1 -- 172.21.15.63:0/2418178098 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80b2570 con 0x7f02d0003e00 2020-05-18T21:26:52.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e5ffb700 1 -- 172.21.15.63:0/2418178098 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d00053f0 con 0x7f02e8146a30 2020-05-18T21:26:52.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eca2e700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02d0004a80 0x7f02d0004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e7fff700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e8146a30 0x7f02d00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02ed22f700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02d0003e00 0x7f02d0004280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eca2e700 1 -- 172.21.15.63:0/2418178098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e8146a30 msgr2=0x7f02d00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eca2e700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e8146a30 0x7f02d00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eca2e700 1 -- 172.21.15.63:0/2418178098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02d0003e00 msgr2=0x7f02d0004280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eca2e700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02d0003e00 0x7f02d0004280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eca2e700 1 -- 172.21.15.63:0/2418178098 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e8060ec0 con 0x7f02d0004a80 2020-05-18T21:26:52.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eda30700 1 -- 172.21.15.63:0/2418178098 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e8144b90 con 0x7f02d0004a80 2020-05-18T21:26:52.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e7fff700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e8146a30 0x7f02d00039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:26:52.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eda30700 1 -- 172.21.15.63:0/2418178098 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e8129dc0 con 0x7f02d0004a80 2020-05-18T21:26:52.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eca2e700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02d0004a80 0x7f02d0004e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f02dc007f10 tx=0x7f02dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eca2e700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02d0004a80 0x7f02d0004e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f02dc007f10 tx=0x7f02dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eca2e700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02d0004a80 0x7f02d0004e80 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f02dc007f10 tx=0x7f02dc007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:52.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eca2e700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02d0004a80 0x7f02d0004e80 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f02dc007f10 tx=0x7f02dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e5ffb700 1 -- 172.21.15.63:0/2418178098 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02dc0119a0 con 0x7f02d0004a80 2020-05-18T21:26:52.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eca2e700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02d0004a80 0x7f02d0004e80 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f02dc007f10 tx=0x7f02dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02eca2e700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02d0004a80 0x7f02d0004e80 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f02dc007f10 tx=0x7f02dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e5ffb700 1 -- 172.21.15.63:0/2418178098 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02dc0078e0 con 0x7f02d0004a80 2020-05-18T21:26:52.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.439+0000 7f02e5ffb700 1 -- 172.21.15.63:0/2418178098 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02dc00f860 con 0x7f02d0004a80 2020-05-18T21:26:52.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.443+0000 7f02eca2e700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02d0004a80 0x7f02d0004e80 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f02dc007f10 tx=0x7f02dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.443+0000 7f02eda30700 1 -- 172.21.15.63:0/2418178098 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c4003380 con 0x7f02d0004a80 2020-05-18T21:26:52.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.443+0000 7f02e5ffb700 1 -- 172.21.15.63:0/2418178098 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f02dc007170 con 0x7f02d0004a80 2020-05-18T21:26:52.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.443+0000 7f02eca2e700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02d0004a80 0x7f02d0004e80 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f02dc007f10 tx=0x7f02dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.443+0000 7f02e5ffb700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f02d0057b50 0x7f02d005a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:52.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.443+0000 7f02e5ffb700 1 -- 172.21.15.63:0/2418178098 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f02dc064e30 con 0x7f02d0004a80 2020-05-18T21:26:52.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.443+0000 7f02e7fff700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f02d0057b50 0x7f02d005a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.443+0000 7f02e7fff700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f02d0057b50 0x7f02d005a010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f02d4001110 tx=0x7f02d4001b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.443+0000 7f02e7fff700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f02d0057b50 0x7f02d005a010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f02d4001110 tx=0x7f02d4001b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.443+0000 7f02e7fff700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f02d0057b50 0x7f02d005a010 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f02d4001110 tx=0x7f02d4001b90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:52.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.451+0000 7f02eca2e700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02d0004a80 0x7f02d0004e80 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f02dc007f10 tx=0x7f02dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.451+0000 7f02e5ffb700 1 -- 172.21.15.63:0/2418178098 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f02dc03f2e0 con 0x7f02d0004a80 2020-05-18T21:26:52.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.567+0000 7f02eda30700 1 -- 172.21.15.63:0/2418178098 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f02c4002210 con 0x7f02d0004a80 2020-05-18T21:26:52.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.567+0000 7f02eca2e700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02d0004a80 0x7f02d0004e80 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f02dc007f10 tx=0x7f02dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.567+0000 7f02e5ffb700 1 -- 172.21.15.63:0/2418178098 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f02dc042900 con 0x7f02d0004a80 2020-05-18T21:26:52.570 INFO:teuthology.orchestra.run.smithi063.stdout:55834574852 2020-05-18T21:26:52.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.567+0000 7f02eda30700 1 -- 172.21.15.63:0/2418178098 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f02d0057b50 msgr2=0x7f02d005a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.567+0000 7f02eda30700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f02d0057b50 0x7f02d005a010 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f02d4001110 tx=0x7f02d4001b90).stop 2020-05-18T21:26:52.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.567+0000 7f02eda30700 1 -- 172.21.15.63:0/2418178098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02d0004a80 msgr2=0x7f02d0004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.567+0000 7f02ed22f700 1 -- 172.21.15.63:0/2418178098 reap_dead start 2020-05-18T21:26:52.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.567+0000 7f02eda30700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02d0004a80 0x7f02d0004e80 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f02dc007f10 tx=0x7f02dc007a80).stop 2020-05-18T21:26:52.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.567+0000 7f02eda30700 1 -- 172.21.15.63:0/2418178098 shutdown_connections 2020-05-18T21:26:52.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.567+0000 7f02eda30700 1 --2- 172.21.15.63:0/2418178098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02d0004a80 0x7f02d0004e80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.567+0000 7f02eda30700 1 -- 172.21.15.63:0/2418178098 >> 172.21.15.63:0/2418178098 conn(0x7f02e809da60 msgr2=0x7f02e805f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:52.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.567+0000 7f02eda30700 1 -- 172.21.15.63:0/2418178098 shutdown_connections 2020-05-18T21:26:52.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.567+0000 7f02eda30700 1 -- 172.21.15.63:0/2418178098 wait complete. 2020-05-18T21:26:52.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.5 2020-05-18T21:26:52.588 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-05-18T21:26:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4bfff700 1 Processor -- start 2020-05-18T21:26:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4bfff700 1 -- start start 2020-05-18T21:26:52.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1c4c05bdc0 0x7f1c4c061a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:52.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c4c14dcf0 0x7f1c4c14e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:52.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4bfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c4c14d890 con 0x7f1c4c0b5620 2020-05-18T21:26:52.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4c0607e0 con 0x7f1c4c14dcf0 2020-05-18T21:26:52.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4c0657c0 con 0x7f1c4c05bdc0 2020-05-18T21:26:52.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c4c14dcf0 0x7f1c4c14e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c4c14dcf0 0x7f1c4c14e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52868/0 (socket says 172.21.15.63:52868) 2020-05-18T21:26:52.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4b7fe700 1 -- 172.21.15.63:0/2461742116 learned_addr learned my addr 172.21.15.63:0/2461742116 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:52.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4a7fc700 1 --2- 172.21.15.63:0/2461742116 >> v2:172.21.15.155:3300/0 conn(0x7f1c4c05bdc0 0x7f1c4c061a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4b7fe700 1 -- 172.21.15.63:0/2461742116 >> v2:172.21.15.155:3300/0 conn(0x7f1c4c05bdc0 msgr2=0x7f1c4c061a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:52.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4b7fe700 1 --2- 172.21.15.63:0/2461742116 >> v2:172.21.15.155:3300/0 conn(0x7f1c4c05bdc0 0x7f1c4c061a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:52.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4b7fe700 1 -- 172.21.15.63:0/2461742116 >> v1:172.21.15.155:6789/0 conn(0x7f1c4c0b5620 legacy=0x7f1c4c0650b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4b7fe700 1 -- 172.21.15.63:0/2461742116 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c061e60 con 0x7f1c4c14dcf0 2020-05-18T21:26:52.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4b7fe700 1 --2- 172.21.15.63:0/2461742116 >> v2:172.21.15.63:3300/0 conn(0x7f1c4c14dcf0 0x7f1c4c14e180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1c4c063c30 tx=0x7f1c44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4b7fe700 1 --2- 172.21.15.63:0/2461742116 >> v2:172.21.15.63:3300/0 conn(0x7f1c4c14dcf0 0x7f1c4c14e180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1c4c063c30 tx=0x7f1c44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4b7fe700 1 --2- 172.21.15.63:0/2461742116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c4c14dcf0 0x7f1c4c14e180 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f1c4c063c30 tx=0x7f1c44007a80).ready entity=mon.0 client_cookie=cbe4c6a781cc848d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:52.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4b7fe700 1 --2- 172.21.15.63:0/2461742116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c4c14dcf0 0x7f1c4c14e180 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f1c4c063c30 tx=0x7f1c44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c49ffb700 1 -- 172.21.15.63:0/2461742116 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c44011670 con 0x7f1c4c14dcf0 2020-05-18T21:26:52.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4b7fe700 1 --2- 172.21.15.63:0/2461742116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c4c14dcf0 0x7f1c4c14e180 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f1c4c063c30 tx=0x7f1c44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4b7fe700 1 --2- 172.21.15.63:0/2461742116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c4c14dcf0 0x7f1c4c14e180 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f1c4c063c30 tx=0x7f1c44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c49ffb700 1 -- 172.21.15.63:0/2461742116 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c440117d0 con 0x7f1c4c14dcf0 2020-05-18T21:26:52.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c49ffb700 1 -- 172.21.15.63:0/2461742116 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c44011bf0 con 0x7f1c4c14dcf0 2020-05-18T21:26:52.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4bfff700 1 -- 172.21.15.63:0/2461742116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c4c14dcf0 msgr2=0x7f1c4c14e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4bfff700 1 --2- 172.21.15.63:0/2461742116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c4c14dcf0 0x7f1c4c14e180 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f1c4c063c30 tx=0x7f1c44007a80).stop 2020-05-18T21:26:52.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4bfff700 1 -- 172.21.15.63:0/2461742116 shutdown_connections 2020-05-18T21:26:52.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4bfff700 1 --2- 172.21.15.63:0/2461742116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c4c14dcf0 0x7f1c4c14e180 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.691+0000 7f1c4bfff700 1 --2- 172.21.15.63:0/2461742116 >> v2:172.21.15.155:3300/0 conn(0x7f1c4c05bdc0 0x7f1c4c061a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:52.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4bfff700 1 -- 172.21.15.63:0/2461742116 >> 172.21.15.63:0/2461742116 conn(0x7f1c4c09da60 msgr2=0x7f1c4c09de70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:52.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4bfff700 1 -- 172.21.15.63:0/2461742116 shutdown_connections 2020-05-18T21:26:52.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4bfff700 1 -- 172.21.15.63:0/2461742116 wait complete. 2020-05-18T21:26:52.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4bfff700 1 Processor -- start 2020-05-18T21:26:52.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4bfff700 1 -- start start 2020-05-18T21:26:52.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c4c05bdc0 0x7f1c4c0aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:52.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c4c14dcf0 0x7f1c4c0ad730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:52.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4bfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c4c0b8180 con 0x7f1c4c0b5620 2020-05-18T21:26:52.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4c0b8420 con 0x7f1c4c05bdc0 2020-05-18T21:26:52.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4bfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c146390 con 0x7f1c4c14dcf0 2020-05-18T21:26:52.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c4c05bdc0 0x7f1c4c0aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4b7fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c4c14dcf0 0x7f1c4c0ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4a7fc700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f1c4c0b5620 0x7f1c4c145c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:53376/0 (socket says 172.21.15.63:53376) 2020-05-18T21:26:52.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c4c05bdc0 0x7f1c4c0aeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52870/0 (socket says 172.21.15.63:52870) 2020-05-18T21:26:52.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4a7fc700 1 -- 172.21.15.63:0/451083703 learned_addr learned my addr 172.21.15.63:0/451083703 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:52.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4affd700 1 -- 172.21.15.63:0/451083703 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c4c14dcf0 msgr2=0x7f1c4c0ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4affd700 1 --2- 172.21.15.63:0/451083703 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c4c14dcf0 0x7f1c4c0ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c43fff700 1 -- 172.21.15.63:0/451083703 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576203325 0 0) 0x7f1c4c0b8180 con 0x7f1c4c0b5620 2020-05-18T21:26:52.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4affd700 1 -- 172.21.15.63:0/451083703 >> v1:172.21.15.155:6789/0 conn(0x7f1c4c0b5620 legacy=0x7f1c4c145c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4affd700 1 -- 172.21.15.63:0/451083703 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c0b19f0 con 0x7f1c4c05bdc0 2020-05-18T21:26:52.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4affd700 1 --2- 172.21.15.63:0/451083703 >> v2:172.21.15.63:3300/0 conn(0x7f1c4c05bdc0 0x7f1c4c0aeb00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c4c05ea80 tx=0x7f1c340108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4affd700 1 --2- 172.21.15.63:0/451083703 >> v2:172.21.15.63:3300/0 conn(0x7f1c4c05bdc0 0x7f1c4c0aeb00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c4c05ea80 tx=0x7f1c340108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.695+0000 7f1c4affd700 1 --2- 172.21.15.63:0/451083703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c4c05bdc0 0x7f1c4c0aeb00 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f1c4c05ea80 tx=0x7f1c340108c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:52.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.699+0000 7f1c4affd700 1 --2- 172.21.15.63:0/451083703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c4c05bdc0 0x7f1c4c0aeb00 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f1c4c05ea80 tx=0x7f1c340108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.699+0000 7f1c43fff700 1 -- 172.21.15.63:0/451083703 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c34006c00 con 0x7f1c4c05bdc0 2020-05-18T21:26:52.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.699+0000 7f1c4affd700 1 --2- 172.21.15.63:0/451083703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c4c05bdc0 0x7f1c4c0aeb00 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f1c4c05ea80 tx=0x7f1c340108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.699+0000 7f1c4bfff700 1 -- 172.21.15.63:0/451083703 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4c0adb90 con 0x7f1c4c05bdc0 2020-05-18T21:26:52.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.699+0000 7f1c43fff700 1 -- 172.21.15.63:0/451083703 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c34006da0 con 0x7f1c4c05bdc0 2020-05-18T21:26:52.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.699+0000 7f1c4affd700 1 --2- 172.21.15.63:0/451083703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c4c05bdc0 0x7f1c4c0aeb00 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f1c4c05ea80 tx=0x7f1c340108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.699+0000 7f1c4bfff700 1 -- 172.21.15.63:0/451083703 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4c0ae040 con 0x7f1c4c05bdc0 2020-05-18T21:26:52.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.699+0000 7f1c43fff700 1 -- 172.21.15.63:0/451083703 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c340093c0 con 0x7f1c4c05bdc0 2020-05-18T21:26:52.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.699+0000 7f1c4affd700 1 --2- 172.21.15.63:0/451083703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c4c05bdc0 0x7f1c4c0aeb00 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f1c4c05ea80 tx=0x7f1c340108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.699+0000 7f1c43fff700 1 -- 172.21.15.63:0/451083703 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1c34009520 con 0x7f1c4c05bdc0 2020-05-18T21:26:52.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.699+0000 7f1c4affd700 1 --2- 172.21.15.63:0/451083703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c4c05bdc0 0x7f1c4c0aeb00 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f1c4c05ea80 tx=0x7f1c340108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.699+0000 7f1c4bfff700 1 -- 172.21.15.63:0/451083703 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c4c0ae350 con 0x7f1c4c05bdc0 2020-05-18T21:26:52.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.699+0000 7f1c43fff700 1 --2- 172.21.15.63:0/451083703 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c3004f890 0x7f1c30051d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:52.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.699+0000 7f1c43fff700 1 -- 172.21.15.63:0/451083703 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1c34063ac0 con 0x7f1c4c05bdc0 2020-05-18T21:26:52.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.699+0000 7f1c4a7fc700 1 --2- 172.21.15.63:0/451083703 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c3004f890 0x7f1c30051d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.699+0000 7f1c4a7fc700 1 --2- 172.21.15.63:0/451083703 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c3004f890 0x7f1c30051d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c3c008360 tx=0x7f1c3c009470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.699+0000 7f1c4a7fc700 1 --2- 172.21.15.63:0/451083703 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c3004f890 0x7f1c30051d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c3c008360 tx=0x7f1c3c009470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.699+0000 7f1c4a7fc700 1 --2- 172.21.15.63:0/451083703 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c3004f890 0x7f1c30051d50 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f1c3c008360 tx=0x7f1c3c009470).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:52.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.707+0000 7f1c4affd700 1 --2- 172.21.15.63:0/451083703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c4c05bdc0 0x7f1c4c0aeb00 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f1c4c05ea80 tx=0x7f1c340108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.707+0000 7f1c43fff700 1 -- 172.21.15.63:0/451083703 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f1c3403de50 con 0x7f1c4c05bdc0 2020-05-18T21:26:52.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.823+0000 7f1c4bfff700 1 -- 172.21.15.63:0/451083703 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1c4c0569e0 con 0x7f1c4c05bdc0 2020-05-18T21:26:52.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.823+0000 7f1c4affd700 1 --2- 172.21.15.63:0/451083703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c4c05bdc0 0x7f1c4c0aeb00 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f1c4c05ea80 tx=0x7f1c340108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.823+0000 7f1c43fff700 1 -- 172.21.15.63:0/451083703 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c34041470 con 0x7f1c4c05bdc0 2020-05-18T21:26:52.827 INFO:teuthology.orchestra.run.smithi063.stdout:55834574853 2020-05-18T21:26:52.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.823+0000 7f1c4bfff700 1 -- 172.21.15.63:0/451083703 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c3004f890 msgr2=0x7f1c30051d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.823+0000 7f1c4bfff700 1 --2- 172.21.15.63:0/451083703 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c3004f890 0x7f1c30051d50 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f1c3c008360 tx=0x7f1c3c009470).stop 2020-05-18T21:26:52.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.823+0000 7f1c4bfff700 1 -- 172.21.15.63:0/451083703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c4c05bdc0 msgr2=0x7f1c4c0aeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.823+0000 7f1c4bfff700 1 --2- 172.21.15.63:0/451083703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c4c05bdc0 0x7f1c4c0aeb00 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f1c4c05ea80 tx=0x7f1c340108c0).stop 2020-05-18T21:26:52.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.827+0000 7f1c4bfff700 1 -- 172.21.15.63:0/451083703 shutdown_connections 2020-05-18T21:26:52.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.827+0000 7f1c4bfff700 1 --2- 172.21.15.63:0/451083703 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c3004f890 0x7f1c30051d50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.827+0000 7f1c4bfff700 1 --2- 172.21.15.63:0/451083703 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c4c14dcf0 0x7f1c4c0ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.827+0000 7f1c4bfff700 1 --2- 172.21.15.63:0/451083703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c4c05bdc0 0x7f1c4c0aeb00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.827+0000 7f1c4bfff700 1 -- 172.21.15.63:0/451083703 >> 172.21.15.63:0/451083703 conn(0x7f1c4c09da60 msgr2=0x7f1c4c0616a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:52.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.827+0000 7f1c4bfff700 1 -- 172.21.15.63:0/451083703 shutdown_connections 2020-05-18T21:26:52.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.827+0000 7f1c4bfff700 1 -- 172.21.15.63:0/451083703 wait complete. 2020-05-18T21:26:52.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2020-05-18T21:26:52.840 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-05-18T21:26:52.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.943+0000 7f9c3b59e700 1 Processor -- start 2020-05-18T21:26:52.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.943+0000 7f9c3b59e700 1 -- start start 2020-05-18T21:26:52.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.943+0000 7f9c3b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c3c062800 0x7f9c3c0b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:52.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.943+0000 7f9c3b59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3c143a80 con 0x7f9c3c05bc50 2020-05-18T21:26:52.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.943+0000 7f9c3b59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3c062f40 con 0x7f9c3c1436a0 2020-05-18T21:26:52.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.943+0000 7f9c3b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c062ca0 con 0x7f9c3c062800 2020-05-18T21:26:52.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.943+0000 7f9c3ad9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9c3c05bc50 0x7f9c3c14d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55070/0 (socket says 172.21.15.63:55070) 2020-05-18T21:26:52.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.943+0000 7f9c3ad9d700 1 -- 172.21.15.63:0/4162652587 learned_addr learned my addr 172.21.15.63:0/4162652587 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:52.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c39d9b700 1 --2- 172.21.15.63:0/4162652587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c3c062800 0x7f9c3c0b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3959a700 1 -- 172.21.15.63:0/4162652587 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135050086 0 0) 0x7f9c3c143a80 con 0x7f9c3c05bc50 2020-05-18T21:26:52.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3959a700 1 -- 172.21.15.63:0/4162652587 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c1c003270 con 0x7f9c3c05bc50 2020-05-18T21:26:52.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3959a700 1 -- 172.21.15.63:0/4162652587 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1354186221 0 0) 0x7f9c1c003270 con 0x7f9c3c05bc50 2020-05-18T21:26:52.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3959a700 1 -- 172.21.15.63:0/4162652587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c3c062800 msgr2=0x7f9c3c0b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:52.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3959a700 1 --2- 172.21.15.63:0/4162652587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c3c062800 0x7f9c3c0b73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:52.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3959a700 1 -- 172.21.15.63:0/4162652587 >> v1:172.21.15.155:6789/0 conn(0x7f9c3c1436a0 legacy=0x7f9c3c05f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3959a700 1 -- 172.21.15.63:0/4162652587 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c0b5f10 con 0x7f9c3c05bc50 2020-05-18T21:26:52.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3959a700 1 -- 172.21.15.63:0/4162652587 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f9c34001a90 con 0x7f9c3c05bc50 2020-05-18T21:26:52.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3959a700 1 -- 172.21.15.63:0/4162652587 >> v1:172.21.15.63:6789/0 conn(0x7f9c3c05bc50 legacy=0x7f9c3c14d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3959a700 1 --2- 172.21.15.63:0/4162652587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c1c003790 0x7f9c1c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:52.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3959a700 1 --2- 172.21.15.63:0/4162652587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c3c062800 0x7f9c1c004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:52.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3959a700 1 --2- 172.21.15.63:0/4162652587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c1c004580 0x7f9c1c004a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:52.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3959a700 1 -- 172.21.15.63:0/4162652587 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c062ca0 con 0x7f9c1c003790 2020-05-18T21:26:52.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3959a700 1 -- 172.21.15.63:0/4162652587 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c004f80 con 0x7f9c1c004580 2020-05-18T21:26:52.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3959a700 1 -- 172.21.15.63:0/4162652587 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c005140 con 0x7f9c3c062800 2020-05-18T21:26:52.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/4162652587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c1c003790 0x7f9c1c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3ad9d700 1 --2- 172.21.15.63:0/4162652587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c1c004580 0x7f9c1c004a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c39d9b700 1 --2- 172.21.15.63:0/4162652587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c3c062800 0x7f9c1c004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3a59c700 1 -- 172.21.15.63:0/4162652587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c3c062800 msgr2=0x7f9c1c004060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:52.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/4162652587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c3c062800 0x7f9c1c004060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:52.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3a59c700 1 -- 172.21.15.63:0/4162652587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c1c004580 msgr2=0x7f9c1c004a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:52.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/4162652587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c1c004580 0x7f9c1c004a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:52.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3a59c700 1 -- 172.21.15.63:0/4162652587 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1c003270 con 0x7f9c1c003790 2020-05-18T21:26:52.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3ad9d700 1 --2- 172.21.15.63:0/4162652587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c1c004580 0x7f9c1c004a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:26:52.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/4162652587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c1c003790 0x7f9c1c003b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9c2c001020 tx=0x7f9c2c00fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/4162652587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c1c003790 0x7f9c1c003b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9c2c001020 tx=0x7f9c2c00fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/4162652587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c1c003790 0x7f9c1c003b70 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f9c2c001020 tx=0x7f9c2c00fe20).ready entity=mon.0 client_cookie=9a0bb37584396a05 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:52.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/4162652587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c1c003790 0x7f9c1c003b70 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f9c2c001020 tx=0x7f9c2c00fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/4162652587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c1c003790 0x7f9c1c003b70 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f9c2c001020 tx=0x7f9c2c00fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3959a700 1 -- 172.21.15.63:0/4162652587 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c2c003560 con 0x7f9c1c003790 2020-05-18T21:26:52.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/4162652587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c1c003790 0x7f9c1c003b70 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f9c2c001020 tx=0x7f9c2c00fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3959a700 1 -- 172.21.15.63:0/4162652587 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c0036c0 con 0x7f9c1c003790 2020-05-18T21:26:52.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3959a700 1 -- 172.21.15.63:0/4162652587 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c2c003aa0 con 0x7f9c1c003790 2020-05-18T21:26:52.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3b59e700 1 -- 172.21.15.63:0/4162652587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c1c003790 msgr2=0x7f9c1c003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3b59e700 1 --2- 172.21.15.63:0/4162652587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c1c003790 0x7f9c1c003b70 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f9c2c001020 tx=0x7f9c2c00fe20).stop 2020-05-18T21:26:52.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3ad9d700 1 -- 172.21.15.63:0/4162652587 reap_dead start 2020-05-18T21:26:52.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3b59e700 1 -- 172.21.15.63:0/4162652587 shutdown_connections 2020-05-18T21:26:52.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3b59e700 1 -- 172.21.15.63:0/4162652587 >> 172.21.15.63:0/4162652587 conn(0x7f9c3c06a640 msgr2=0x7f9c3c05f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:52.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3b59e700 1 -- 172.21.15.63:0/4162652587 shutdown_connections 2020-05-18T21:26:52.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.947+0000 7f9c3b59e700 1 -- 172.21.15.63:0/4162652587 wait complete. 2020-05-18T21:26:52.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3b59e700 1 Processor -- start 2020-05-18T21:26:52.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3b59e700 1 -- start start 2020-05-18T21:26:52.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c3c0b3c10 0x7f9c3c153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:52.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c3c136680 0x7f9c3c136ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:52.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3b59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c3c060310 0x7f9c3c0607c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:52.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3b59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c3c136f40 con 0x7f9c3c0b3c10 2020-05-18T21:26:52.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3b59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c3c1568e0 con 0x7f9c3c060310 2020-05-18T21:26:52.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c156b80 con 0x7f9c3c136680 2020-05-18T21:26:52.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c3c0b3c10 0x7f9c3c153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c3c0b3c10 0x7f9c3c153ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52890/0 (socket says 172.21.15.63:52890) 2020-05-18T21:26:52.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3a59c700 1 -- 172.21.15.63:0/2499031658 learned_addr learned my addr 172.21.15.63:0/2499031658 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:52.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3ad9d700 1 --2- 172.21.15.63:0/2499031658 >> v2:172.21.15.155:3300/0 conn(0x7f9c3c060310 0x7f9c3c0607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c39d9b700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c3c136680 0x7f9c3c136ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3a59c700 1 -- 172.21.15.63:0/2499031658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c3c136680 msgr2=0x7f9c3c136ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c3c136680 0x7f9c3c136ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3a59c700 1 -- 172.21.15.63:0/2499031658 >> v2:172.21.15.155:3300/0 conn(0x7f9c3c060310 msgr2=0x7f9c3c0607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:52.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/2499031658 >> v2:172.21.15.155:3300/0 conn(0x7f9c3c060310 0x7f9c3c0607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:52.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3a59c700 1 -- 172.21.15.63:0/2499031658 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c156e20 con 0x7f9c3c0b3c10 2020-05-18T21:26:52.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3ad9d700 1 --2- 172.21.15.63:0/2499031658 >> v2:172.21.15.155:3300/0 conn(0x7f9c3c060310 0x7f9c3c0607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:26:52.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/2499031658 >> v2:172.21.15.63:3300/0 conn(0x7f9c3c0b3c10 0x7f9c3c153ae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c3c1571a0 tx=0x7f9c2c00fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/2499031658 >> v2:172.21.15.63:3300/0 conn(0x7f9c3c0b3c10 0x7f9c3c153ae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c3c1571a0 tx=0x7f9c2c00fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c3c0b3c10 0x7f9c3c153ae0 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f9c3c1571a0 tx=0x7f9c2c00fe20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:52.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c3c0b3c10 0x7f9c3c153ae0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f9c3c1571a0 tx=0x7f9c2c00fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c3c0b3c10 0x7f9c3c153ae0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f9c3c1571a0 tx=0x7f9c2c00fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c337fe700 1 -- 172.21.15.63:0/2499031658 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c2c008370 con 0x7f9c3c0b3c10 2020-05-18T21:26:52.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c3c0b3c10 0x7f9c3c153ae0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f9c3c1571a0 tx=0x7f9c2c00fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c337fe700 1 -- 172.21.15.63:0/2499031658 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c008bb0 con 0x7f9c3c0b3c10 2020-05-18T21:26:52.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3b59e700 1 -- 172.21.15.63:0/2499031658 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3c0b3ff0 con 0x7f9c3c0b3c10 2020-05-18T21:26:52.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c337fe700 1 -- 172.21.15.63:0/2499031658 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c2c006520 con 0x7f9c3c0b3c10 2020-05-18T21:26:52.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3b59e700 1 -- 172.21.15.63:0/2499031658 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3c062080 con 0x7f9c3c0b3c10 2020-05-18T21:26:52.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c3c0b3c10 0x7f9c3c153ae0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f9c3c1571a0 tx=0x7f9c2c00fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.951+0000 7f9c3b59e700 1 -- 172.21.15.63:0/2499031658 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3c156fb0 con 0x7f9c3c0b3c10 2020-05-18T21:26:52.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.955+0000 7f9c337fe700 1 -- 172.21.15.63:0/2499031658 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9c2c006680 con 0x7f9c3c0b3c10 2020-05-18T21:26:52.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.955+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c3c0b3c10 0x7f9c3c153ae0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f9c3c1571a0 tx=0x7f9c2c00fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.955+0000 7f9c337fe700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c2004f9c0 0x7f9c20051e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:52.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.955+0000 7f9c337fe700 1 -- 172.21.15.63:0/2499031658 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9c2c064070 con 0x7f9c3c0b3c10 2020-05-18T21:26:52.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.955+0000 7f9c39d9b700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c2004f9c0 0x7f9c20051e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:52.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.955+0000 7f9c39d9b700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c2004f9c0 0x7f9c20051e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c24002f70 tx=0x7f9c2400ca80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.955+0000 7f9c39d9b700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c2004f9c0 0x7f9c20051e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c24002f70 tx=0x7f9c2400ca80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.955+0000 7f9c39d9b700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c2004f9c0 0x7f9c20051e80 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f9c24002f70 tx=0x7f9c2400ca80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:52.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.959+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c3c0b3c10 0x7f9c3c153ae0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f9c3c1571a0 tx=0x7f9c2c00fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:52.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:52.959+0000 7f9c337fe700 1 -- 172.21.15.63:0/2499031658 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9c2c03e4c0 con 0x7f9c3c0b3c10 2020-05-18T21:26:53.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:53.075+0000 7f9c3b59e700 1 -- 172.21.15.63:0/2499031658 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9c3c0569e0 con 0x7f9c3c0b3c10 2020-05-18T21:26:53.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:53.075+0000 7f9c3a59c700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c3c0b3c10 0x7f9c3c153ae0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f9c3c1571a0 tx=0x7f9c2c00fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:53.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:53.075+0000 7f9c337fe700 1 -- 172.21.15.63:0/2499031658 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c2c041ae0 con 0x7f9c3c0b3c10 2020-05-18T21:26:53.078 INFO:teuthology.orchestra.run.smithi063.stdout:55834574851 2020-05-18T21:26:53.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:53.075+0000 7f9c3b59e700 1 -- 172.21.15.63:0/2499031658 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c2004f9c0 msgr2=0x7f9c20051e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:53.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:53.075+0000 7f9c3b59e700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c2004f9c0 0x7f9c20051e80 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f9c24002f70 tx=0x7f9c2400ca80).stop 2020-05-18T21:26:53.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:53.075+0000 7f9c3b59e700 1 -- 172.21.15.63:0/2499031658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c3c0b3c10 msgr2=0x7f9c3c153ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:53.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:53.075+0000 7f9c3b59e700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c3c0b3c10 0x7f9c3c153ae0 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f9c3c1571a0 tx=0x7f9c2c00fe20).stop 2020-05-18T21:26:53.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:53.075+0000 7f9c3b59e700 1 -- 172.21.15.63:0/2499031658 shutdown_connections 2020-05-18T21:26:53.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:53.075+0000 7f9c3b59e700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c2004f9c0 0x7f9c20051e80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:53.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:53.075+0000 7f9c3b59e700 1 --2- 172.21.15.63:0/2499031658 >> v2:172.21.15.155:3300/0 conn(0x7f9c3c060310 0x7f9c3c0607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:53.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:53.079+0000 7f9c3b59e700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c3c136680 0x7f9c3c136ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:53.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:53.079+0000 7f9c3b59e700 1 --2- 172.21.15.63:0/2499031658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c3c0b3c10 0x7f9c3c153ae0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:53.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:53.079+0000 7f9c3b59e700 1 -- 172.21.15.63:0/2499031658 >> 172.21.15.63:0/2499031658 conn(0x7f9c3c06a640 msgr2=0x7f9c3c05f930 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:53.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:53.079+0000 7f9c3b59e700 1 -- 172.21.15.63:0/2499031658 shutdown_connections 2020-05-18T21:26:53.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:53.079+0000 7f9c3b59e700 1 -- 172.21.15.63:0/2499031658 wait complete. 2020-05-18T21:26:53.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.7 2020-05-18T21:26:54.098 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-05-18T21:26:54.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf7cccd700 1 Processor -- start 2020-05-18T21:26:54.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf7cccd700 1 -- start start 2020-05-18T21:26:54.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf7cccd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf780b9200 0x7faf78145e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:54.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf7cccd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf78142dd0 0x7faf78143250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:54.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf7cccd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf780b5d80 con 0x7faf78149340 2020-05-18T21:26:54.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf7cccd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf780b6020 con 0x7faf78142dd0 2020-05-18T21:26:54.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf7cccd700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf780b62c0 con 0x7faf780b9200 2020-05-18T21:26:54.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf76ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf78142dd0 0x7faf78143250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:54.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf76ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf78142dd0 0x7faf78143250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52900/0 (socket says 172.21.15.63:52900) 2020-05-18T21:26:54.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf76ffd700 1 -- 172.21.15.63:0/443761209 learned_addr learned my addr 172.21.15.63:0/443761209 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:54.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf777fe700 1 --2- 172.21.15.63:0/443761209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf780b9200 0x7faf78145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:54.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf767fc700 1 -- 172.21.15.63:0/443761209 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038479382 0 0) 0x7faf780b5d80 con 0x7faf78149340 2020-05-18T21:26:54.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf76ffd700 1 -- 172.21.15.63:0/443761209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf780b9200 msgr2=0x7faf78145e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:54.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf76ffd700 1 --2- 172.21.15.63:0/443761209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf780b9200 0x7faf78145e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:54.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf76ffd700 1 -- 172.21.15.63:0/443761209 >> v1:172.21.15.155:6789/0 conn(0x7faf78149340 legacy=0x7faf781497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf76ffd700 1 -- 172.21.15.63:0/443761209 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf781436b0 con 0x7faf78142dd0 2020-05-18T21:26:54.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf76ffd700 1 --2- 172.21.15.63:0/443761209 >> v2:172.21.15.63:3300/0 conn(0x7faf78142dd0 0x7faf78143250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faf68002f70 tx=0x7faf68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf76ffd700 1 --2- 172.21.15.63:0/443761209 >> v2:172.21.15.63:3300/0 conn(0x7faf78142dd0 0x7faf78143250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faf68002f70 tx=0x7faf68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf76ffd700 1 --2- 172.21.15.63:0/443761209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf78142dd0 0x7faf78143250 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7faf68002f70 tx=0x7faf68007a80).ready entity=mon.0 client_cookie=821d6ef72c4cc968 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:54.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf76ffd700 1 --2- 172.21.15.63:0/443761209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf78142dd0 0x7faf78143250 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7faf68002f70 tx=0x7faf68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf767fc700 1 -- 172.21.15.63:0/443761209 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf680116b0 con 0x7faf78142dd0 2020-05-18T21:26:54.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf76ffd700 1 --2- 172.21.15.63:0/443761209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf78142dd0 0x7faf78143250 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7faf68002f70 tx=0x7faf68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf767fc700 1 -- 172.21.15.63:0/443761209 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf68011810 con 0x7faf78142dd0 2020-05-18T21:26:54.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf76ffd700 1 --2- 172.21.15.63:0/443761209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf78142dd0 0x7faf78143250 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7faf68002f70 tx=0x7faf68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf7cccd700 1 -- 172.21.15.63:0/443761209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf78142dd0 msgr2=0x7faf78143250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf767fc700 1 -- 172.21.15.63:0/443761209 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf68011bf0 con 0x7faf78142dd0 2020-05-18T21:26:54.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.211+0000 7faf7cccd700 1 --2- 172.21.15.63:0/443761209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf78142dd0 0x7faf78143250 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7faf68002f70 tx=0x7faf68007a80).stop 2020-05-18T21:26:54.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.215+0000 7faf7cccd700 1 -- 172.21.15.63:0/443761209 shutdown_connections 2020-05-18T21:26:54.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.215+0000 7faf7cccd700 1 --2- 172.21.15.63:0/443761209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf78142dd0 0x7faf78143250 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:54.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.215+0000 7faf7cccd700 1 --2- 172.21.15.63:0/443761209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf780b9200 0x7faf78145e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:54.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.215+0000 7faf7cccd700 1 -- 172.21.15.63:0/443761209 >> 172.21.15.63:0/443761209 conn(0x7faf78069b70 msgr2=0x7faf78069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:54.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.215+0000 7faf7cccd700 1 -- 172.21.15.63:0/443761209 shutdown_connections 2020-05-18T21:26:54.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.215+0000 7faf7cccd700 1 -- 172.21.15.63:0/443761209 wait complete. 2020-05-18T21:26:54.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.215+0000 7faf7cccd700 1 Processor -- start 2020-05-18T21:26:54.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.215+0000 7faf7cccd700 1 -- start start 2020-05-18T21:26:54.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.215+0000 7faf7cccd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf780b9200 0x7faf78153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:54.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.215+0000 7faf7cccd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf78142dd0 0x7faf781462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:54.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.215+0000 7faf7cccd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf78153250 con 0x7faf78149340 2020-05-18T21:26:54.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.215+0000 7faf7cccd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf781534f0 con 0x7faf78142dd0 2020-05-18T21:26:54.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.215+0000 7faf7cccd700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf78153790 con 0x7faf780b9200 2020-05-18T21:26:54.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.215+0000 7faf76ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf78142dd0 0x7faf781462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:54.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.215+0000 7faf76ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf78142dd0 0x7faf781462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52904/0 (socket says 172.21.15.63:52904) 2020-05-18T21:26:54.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.215+0000 7faf76ffd700 1 -- 172.21.15.63:0/3180924279 learned_addr learned my addr 172.21.15.63:0/3180924279 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:54.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.215+0000 7faf777fe700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf780b9200 0x7faf78153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:54.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf76ffd700 1 -- 172.21.15.63:0/3180924279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf780b9200 msgr2=0x7faf78153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf76ffd700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf780b9200 0x7faf78153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:54.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf76ffd700 1 -- 172.21.15.63:0/3180924279 >> v1:172.21.15.63:6789/0 conn(0x7faf78149340 legacy=0x7faf781571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf76ffd700 1 -- 172.21.15.63:0/3180924279 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf78153a30 con 0x7faf78142dd0 2020-05-18T21:26:54.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf76ffd700 1 --2- 172.21.15.63:0/3180924279 >> v2:172.21.15.63:3300/0 conn(0x7faf78142dd0 0x7faf781462c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf68002f70 tx=0x7faf68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf76ffd700 1 --2- 172.21.15.63:0/3180924279 >> v2:172.21.15.63:3300/0 conn(0x7faf78142dd0 0x7faf781462c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf68002f70 tx=0x7faf68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf76ffd700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf78142dd0 0x7faf781462c0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7faf68002f70 tx=0x7faf68007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:54.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf76ffd700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf78142dd0 0x7faf781462c0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7faf68002f70 tx=0x7faf68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf76ffd700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf78142dd0 0x7faf781462c0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7faf68002f70 tx=0x7faf68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf76ffd700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf78142dd0 0x7faf781462c0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7faf68002f70 tx=0x7faf68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf74ff9700 1 -- 172.21.15.63:0/3180924279 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf68007360 con 0x7faf78142dd0 2020-05-18T21:26:54.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf74ff9700 1 -- 172.21.15.63:0/3180924279 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf680074c0 con 0x7faf78142dd0 2020-05-18T21:26:54.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf7cccd700 1 -- 172.21.15.63:0/3180924279 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf78146720 con 0x7faf78142dd0 2020-05-18T21:26:54.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf74ff9700 1 -- 172.21.15.63:0/3180924279 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf680058f0 con 0x7faf78142dd0 2020-05-18T21:26:54.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf7cccd700 1 -- 172.21.15.63:0/3180924279 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf780bacb0 con 0x7faf78142dd0 2020-05-18T21:26:54.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf76ffd700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf78142dd0 0x7faf781462c0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7faf68002f70 tx=0x7faf68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf7cccd700 1 -- 172.21.15.63:0/3180924279 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf780569e0 con 0x7faf78142dd0 2020-05-18T21:26:54.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf74ff9700 1 -- 172.21.15.63:0/3180924279 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7faf68005b60 con 0x7faf78142dd0 2020-05-18T21:26:54.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf76ffd700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf78142dd0 0x7faf781462c0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7faf68002f70 tx=0x7faf68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf74ff9700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf5004f9c0 0x7faf50051e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:54.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf74ff9700 1 -- 172.21.15.63:0/3180924279 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faf68064410 con 0x7faf78142dd0 2020-05-18T21:26:54.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.219+0000 7faf777fe700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf5004f9c0 0x7faf50051e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:54.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.223+0000 7faf777fe700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf5004f9c0 0x7faf50051e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf60002f70 tx=0x7faf6000d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.223+0000 7faf777fe700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf5004f9c0 0x7faf50051e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf60002f70 tx=0x7faf6000d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.223+0000 7faf777fe700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf5004f9c0 0x7faf50051e80 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7faf60002f70 tx=0x7faf6000d8f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:54.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.227+0000 7faf76ffd700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf78142dd0 0x7faf781462c0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7faf68002f70 tx=0x7faf68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.227+0000 7faf74ff9700 1 -- 172.21.15.63:0/3180924279 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7faf6803e8c0 con 0x7faf78142dd0 2020-05-18T21:26:54.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.347+0000 7faf7cccd700 1 -- 172.21.15.63:0/3180924279 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7faf780b3540 con 0x7faf78142dd0 2020-05-18T21:26:54.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.347+0000 7faf76ffd700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf78142dd0 0x7faf781462c0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7faf68002f70 tx=0x7faf68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.347+0000 7faf74ff9700 1 -- 172.21.15.63:0/3180924279 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf68041ee0 con 0x7faf78142dd0 2020-05-18T21:26:54.351 INFO:teuthology.orchestra.run.smithi063.stdout:55834574853 2020-05-18T21:26:54.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.351+0000 7faf7cccd700 1 -- 172.21.15.63:0/3180924279 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf5004f9c0 msgr2=0x7faf50051e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.351+0000 7faf7cccd700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf5004f9c0 0x7faf50051e80 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7faf60002f70 tx=0x7faf6000d8f0).stop 2020-05-18T21:26:54.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.351+0000 7faf7cccd700 1 -- 172.21.15.63:0/3180924279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf78142dd0 msgr2=0x7faf781462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.351+0000 7faf7cccd700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf78142dd0 0x7faf781462c0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7faf68002f70 tx=0x7faf68007a80).stop 2020-05-18T21:26:54.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.351+0000 7faf7cccd700 1 -- 172.21.15.63:0/3180924279 shutdown_connections 2020-05-18T21:26:54.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.351+0000 7faf7cccd700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf5004f9c0 0x7faf50051e80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:54.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.351+0000 7faf7cccd700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf78142dd0 0x7faf781462c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:54.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.351+0000 7faf7cccd700 1 --2- 172.21.15.63:0/3180924279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf780b9200 0x7faf78153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:54.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.351+0000 7faf7cccd700 1 -- 172.21.15.63:0/3180924279 >> 172.21.15.63:0/3180924279 conn(0x7faf78069b70 msgr2=0x7faf781421d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:54.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.351+0000 7faf7cccd700 1 -- 172.21.15.63:0/3180924279 shutdown_connections 2020-05-18T21:26:54.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.351+0000 7faf7cccd700 1 -- 172.21.15.63:0/3180924279 wait complete. 2020-05-18T21:26:54.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.7 2020-05-18T21:26:54.364 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-05-18T21:26:54.364 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-05-18T21:26:54.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.463+0000 7f69d3fff700 1 Processor -- start 2020-05-18T21:26:54.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.463+0000 7f69d3fff700 1 -- start start 2020-05-18T21:26:54.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.463+0000 7f69d3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f69d4064fd0 0x7f69d414d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:54.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.463+0000 7f69d3fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d414a330 con 0x7f69d405f110 2020-05-18T21:26:54.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.463+0000 7f69d3fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d414a5d0 con 0x7f69d40b4760 2020-05-18T21:26:54.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.463+0000 7f69d3fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d414a140 con 0x7f69d4064fd0 2020-05-18T21:26:54.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.463+0000 7f69d37fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f69d4064fd0 0x7f69d414d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:54.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.463+0000 7f69d2ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f69d405f110 0x7f69d414aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55102/0 (socket says 172.21.15.63:55102) 2020-05-18T21:26:54.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.463+0000 7f69d2ffd700 1 -- 172.21.15.63:0/236242174 learned_addr learned my addr 172.21.15.63:0/236242174 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:54.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.463+0000 7f69d37fe700 1 -- 172.21.15.63:0/236242174 >> v1:172.21.15.155:6789/0 conn(0x7f69d40b4760 legacy=0x7f69d40648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.463+0000 7f69d1ffb700 1 -- 172.21.15.63:0/236242174 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686220979 0 0) 0x7f69d414a5d0 con 0x7f69d40b4760 2020-05-18T21:26:54.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.463+0000 7f69d37fe700 1 -- 172.21.15.63:0/236242174 >> v1:172.21.15.63:6789/0 conn(0x7f69d405f110 legacy=0x7f69d414aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.463+0000 7f69d37fe700 1 -- 172.21.15.63:0/236242174 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d4063430 con 0x7f69d4064fd0 2020-05-18T21:26:54.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.463+0000 7f69d37fe700 1 --2- 172.21.15.63:0/236242174 >> v2:172.21.15.63:3300/0 conn(0x7f69d4064fd0 0x7f69d414d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f69c4001110 tx=0x7f69cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.463+0000 7f69d37fe700 1 --2- 172.21.15.63:0/236242174 >> v2:172.21.15.63:3300/0 conn(0x7f69d4064fd0 0x7f69d414d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f69c4001110 tx=0x7f69cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.463+0000 7f69d37fe700 1 --2- 172.21.15.63:0/236242174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69d4064fd0 0x7f69d414d710 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f69c4001110 tx=0x7f69cc007e00).ready entity=mon.0 client_cookie=9217dbfaf07968f4 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:54.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.467+0000 7f69d37fe700 1 --2- 172.21.15.63:0/236242174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69d4064fd0 0x7f69d414d710 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f69c4001110 tx=0x7f69cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.467+0000 7f69d37fe700 1 --2- 172.21.15.63:0/236242174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69d4064fd0 0x7f69d414d710 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f69c4001110 tx=0x7f69cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.467+0000 7f69d1ffb700 1 -- 172.21.15.63:0/236242174 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69cc010da0 con 0x7f69d4064fd0 2020-05-18T21:26:54.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.467+0000 7f69d37fe700 1 --2- 172.21.15.63:0/236242174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69d4064fd0 0x7f69d414d710 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f69c4001110 tx=0x7f69cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.467+0000 7f69d1ffb700 1 -- 172.21.15.63:0/236242174 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc0110d0 con 0x7f69d4064fd0 2020-05-18T21:26:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.467+0000 7f69d3fff700 1 -- 172.21.15.63:0/236242174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69d4064fd0 msgr2=0x7f69d414d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.467+0000 7f69d3fff700 1 --2- 172.21.15.63:0/236242174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69d4064fd0 0x7f69d414d710 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f69c4001110 tx=0x7f69cc007e00).stop 2020-05-18T21:26:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.467+0000 7f69d1ffb700 1 -- 172.21.15.63:0/236242174 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69cc011470 con 0x7f69d4064fd0 2020-05-18T21:26:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.467+0000 7f69d3fff700 1 -- 172.21.15.63:0/236242174 shutdown_connections 2020-05-18T21:26:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.467+0000 7f69d3fff700 1 --2- 172.21.15.63:0/236242174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69d4064fd0 0x7f69d414d710 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:54.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.467+0000 7f69d3fff700 1 -- 172.21.15.63:0/236242174 >> 172.21.15.63:0/236242174 conn(0x7f69d4069fc0 msgr2=0x7f69d406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:54.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.467+0000 7f69d3fff700 1 -- 172.21.15.63:0/236242174 shutdown_connections 2020-05-18T21:26:54.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.467+0000 7f69d3fff700 1 -- 172.21.15.63:0/236242174 wait complete. 2020-05-18T21:26:54.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.467+0000 7f69d3fff700 1 Processor -- start 2020-05-18T21:26:54.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.467+0000 7f69d3fff700 1 -- start start 2020-05-18T21:26:54.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f69d405f110 0x7f69d4142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:54.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d3fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d41460b0 con 0x7f69d40b4760 2020-05-18T21:26:54.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d2ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f69d405f110 0x7f69d4142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:54.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d3fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d4147db0 con 0x7f69d4064fd0 2020-05-18T21:26:54.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d2ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f69d405f110 0x7f69d4142f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52918/0 (socket says 172.21.15.63:52918) 2020-05-18T21:26:54.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d2ffd700 1 -- 172.21.15.63:0/3055548379 learned_addr learned my addr 172.21.15.63:0/3055548379 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:54.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d3fff700 1 -- 172.21.15.63:0/3055548379 --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d41433a0 con 0x7f69d405f110 2020-05-18T21:26:54.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d2ffd700 1 -- 172.21.15.63:0/3055548379 >> v1:172.21.15.155:6789/0 conn(0x7f69d4064fd0 legacy=0x7f69d4145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d2ffd700 1 -- 172.21.15.63:0/3055548379 >> v1:172.21.15.63:6789/0 conn(0x7f69d40b4760 legacy=0x7f69d41467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d2ffd700 1 -- 172.21.15.63:0/3055548379 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d4145e10 con 0x7f69d405f110 2020-05-18T21:26:54.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69cbfff700 1 -- 172.21.15.63:0/3055548379 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602399547 0 0) 0x7f69d41460b0 con 0x7f69d40b4760 2020-05-18T21:26:54.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d2ffd700 1 --2- 172.21.15.63:0/3055548379 >> v2:172.21.15.63:3300/0 conn(0x7f69d405f110 0x7f69d4142f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f69c40011d0 tx=0x7f69c400c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d2ffd700 1 --2- 172.21.15.63:0/3055548379 >> v2:172.21.15.63:3300/0 conn(0x7f69d405f110 0x7f69d4142f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f69c40011d0 tx=0x7f69c400c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d2ffd700 1 --2- 172.21.15.63:0/3055548379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69d405f110 0x7f69d4142f40 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f69c40011d0 tx=0x7f69c400c600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:54.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d2ffd700 1 --2- 172.21.15.63:0/3055548379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69d405f110 0x7f69d4142f40 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f69c40011d0 tx=0x7f69c400c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69cbfff700 1 -- 172.21.15.63:0/3055548379 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69c400c990 con 0x7f69d405f110 2020-05-18T21:26:54.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d2ffd700 1 --2- 172.21.15.63:0/3055548379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69d405f110 0x7f69d4142f40 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f69c40011d0 tx=0x7f69c400c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d2ffd700 1 --2- 172.21.15.63:0/3055548379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69d405f110 0x7f69d4142f40 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f69c40011d0 tx=0x7f69c400c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69cbfff700 1 -- 172.21.15.63:0/3055548379 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c400caf0 con 0x7f69d405f110 2020-05-18T21:26:54.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d3fff700 1 -- 172.21.15.63:0/3055548379 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d4146350 con 0x7f69d405f110 2020-05-18T21:26:54.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69cbfff700 1 -- 172.21.15.63:0/3055548379 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69c4012270 con 0x7f69d405f110 2020-05-18T21:26:54.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d3fff700 1 -- 172.21.15.63:0/3055548379 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d4147340 con 0x7f69d405f110 2020-05-18T21:26:54.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d2ffd700 1 --2- 172.21.15.63:0/3055548379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69d405f110 0x7f69d4142f40 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f69c40011d0 tx=0x7f69c400c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.471+0000 7f69d3fff700 1 -- 172.21.15.63:0/3055548379 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d40569e0 con 0x7f69d405f110 2020-05-18T21:26:54.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.475+0000 7f69cbfff700 1 -- 172.21.15.63:0/3055548379 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f69c40055c0 con 0x7f69d405f110 2020-05-18T21:26:54.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.475+0000 7f69d2ffd700 1 --2- 172.21.15.63:0/3055548379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69d405f110 0x7f69d4142f40 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f69c40011d0 tx=0x7f69c400c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.475+0000 7f69cbfff700 1 --2- 172.21.15.63:0/3055548379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f69b804f880 0x7f69b8051d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:54.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.475+0000 7f69cbfff700 1 -- 172.21.15.63:0/3055548379 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f69c40100c0 con 0x7f69d405f110 2020-05-18T21:26:54.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.475+0000 7f69d27fc700 1 --2- 172.21.15.63:0/3055548379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f69b804f880 0x7f69b8051d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:54.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.475+0000 7f69d27fc700 1 --2- 172.21.15.63:0/3055548379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f69b804f880 0x7f69b8051d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f69d4149a50 tx=0x7f69bc002690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.475+0000 7f69d27fc700 1 --2- 172.21.15.63:0/3055548379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f69b804f880 0x7f69b8051d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f69d4149a50 tx=0x7f69bc002690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.475+0000 7f69d27fc700 1 --2- 172.21.15.63:0/3055548379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f69b804f880 0x7f69b8051d40 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f69d4149a50 tx=0x7f69bc002690).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:54.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.479+0000 7f69d2ffd700 1 --2- 172.21.15.63:0/3055548379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69d405f110 0x7f69d4142f40 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f69c40011d0 tx=0x7f69c400c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.479+0000 7f69cbfff700 1 -- 172.21.15.63:0/3055548379 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f69c403e0a0 con 0x7f69d405f110 2020-05-18T21:26:54.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.595+0000 7f69d3fff700 1 -- 172.21.15.63:0/3055548379 --> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f69d40b8d00 con 0x7f69b804f880 2020-05-18T21:26:54.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.603+0000 7f69d27fc700 1 --2- 172.21.15.63:0/3055548379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f69b804f880 0x7f69b8051d40 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f69d4149a50 tx=0x7f69bc002690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.603+0000 7f69cbfff700 1 -- 172.21.15.63:0/3055548379 <== mgr.4110 v2:172.21.15.155:6832/12649 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82269 (secure 0 0 0) 0x7f69d40b8d00 con 0x7f69b804f880 2020-05-18T21:26:54.608 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:26:54.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.603+0000 7f69d3fff700 1 -- 172.21.15.63:0/3055548379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f69b804f880 msgr2=0x7f69b8051d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.603+0000 7f69d3fff700 1 --2- 172.21.15.63:0/3055548379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f69b804f880 0x7f69b8051d40 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f69d4149a50 tx=0x7f69bc002690).stop 2020-05-18T21:26:54.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.603+0000 7f69d3fff700 1 -- 172.21.15.63:0/3055548379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69d405f110 msgr2=0x7f69d4142f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.603+0000 7f69d3fff700 1 --2- 172.21.15.63:0/3055548379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69d405f110 0x7f69d4142f40 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f69c40011d0 tx=0x7f69c400c600).stop 2020-05-18T21:26:54.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.603+0000 7f69d3fff700 1 -- 172.21.15.63:0/3055548379 shutdown_connections 2020-05-18T21:26:54.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.603+0000 7f69d3fff700 1 --2- 172.21.15.63:0/3055548379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f69b804f880 0x7f69b8051d40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:54.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.603+0000 7f69d3fff700 1 --2- 172.21.15.63:0/3055548379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69d405f110 0x7f69d4142f40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:54.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.603+0000 7f69d3fff700 1 -- 172.21.15.63:0/3055548379 >> 172.21.15.63:0/3055548379 conn(0x7f69d4069fc0 msgr2=0x7f69d4143910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:54.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.603+0000 7f69d3fff700 1 -- 172.21.15.63:0/3055548379 shutdown_connections 2020-05-18T21:26:54.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.603+0000 7f69d3fff700 1 -- 172.21.15.63:0/3055548379 wait complete. 2020-05-18T21:26:54.611 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2020-05-18T21:26:54.620 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2020-05-18T21:26:53.028768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390624,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584096,"statfs":{"total":773094113280,"available":764502114304,"internally_reserved":8589934592,"allocated":1998848,"data_stored":742636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.532537"},"pg_stats":[{"pgid":"4.5","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.560350+0000","last_change":"2020-05-18T21:26:46.559601+0000","last_active":"2020-05-18T21:26:46.560350+0000","last_peered":"2020-05-18T21:26:46.560350+0000","last_clean":"2020-05-18T21:26:46.560350+0000","last_became_active":"2020-05-18T21:26:46.558566+0000","last_became_peered":"2020-05-18T21:26:46.558566+0000","last_unstale":"2020-05-18T21:26:46.560350+0000","last_undegraded":"2020-05-18T21:26:46.560350+0000","last_fullsized":"2020-05-18T21:26:46.560350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_clean_scrub_stamp":"2020-05-18T21:26:45.165382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:47.427662+0000","last_change":"2020-05-18T21:26:37.226650+0000","last_active":"2020-05-18T21:26:47.427662+0000","last_peered":"2020-05-18T21:26:47.427662+0000","last_clean":"2020-05-18T21:26:47.427662+0000","last_became_active":"2020-05-18T21:26:37.224618+0000","last_became_peered":"2020-05-18T21:26:37.224618+0000","last_unstale":"2020-05-18T21:26:47.427662+0000","last_undegraded":"2020-05-18T21:26:47.427662+0000","last_fullsized":"2020-05-18T21:26:47.427662+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:34.017197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:34.017197+0000","last_clean_scrub_stamp":"2020-05-18T21:26:34.017197+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:47.426585+0000","last_change":"2020-05-18T21:26:42.152047+0000","last_active":"2020-05-18T21:26:47.426585+0000","last_peered":"2020-05-18T21:26:47.426585+0000","last_clean":"2020-05-18T21:26:47.426585+0000","last_became_active":"2020-05-18T21:26:42.151473+0000","last_became_peered":"2020-05-18T21:26:42.151473+0000","last_unstale":"2020-05-18T21:26:47.426585+0000","last_undegraded":"2020-05-18T21:26:47.426585+0000","last_fullsized":"2020-05-18T21:26:47.426585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'1","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-05-18T21:26:47.511547+0000","last_change":"2020-05-18T21:26:45.189432+0000","last_active":"2020-05-18T21:26:47.511547+0000","last_peered":"2020-05-18T21:26:47.511547+0000","last_clean":"2020-05-18T21:26:47.511547+0000","last_became_active":"2020-05-18T21:26:45.188777+0000","last_became_peered":"2020-05-18T21:26:45.188777+0000","last_unstale":"2020-05-18T21:26:47.511547+0000","last_undegraded":"2020-05-18T21:26:47.511547+0000","last_fullsized":"2020-05-18T21:26:47.511547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_clean_scrub_stamp":"2020-05-18T21:26:44.148357+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:47.424632+0000","last_change":"2020-05-18T21:26:45.505601+0000","last_active":"2020-05-18T21:26:47.424632+0000","last_peered":"2020-05-18T21:26:47.424632+0000","last_clean":"2020-05-18T21:26:47.424632+0000","last_became_active":"2020-05-18T21:26:45.505076+0000","last_became_peered":"2020-05-18T21:26:45.505076+0000","last_unstale":"2020-05-18T21:26:47.424632+0000","last_undegraded":"2020-05-18T21:26:47.424632+0000","last_fullsized":"2020-05-18T21:26:47.424632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_clean_scrub_stamp":"2020-05-18T21:26:45.165382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:47.427654+0000","last_change":"2020-05-18T21:26:42.150248+0000","last_active":"2020-05-18T21:26:47.427654+0000","last_peered":"2020-05-18T21:26:47.427654+0000","last_clean":"2020-05-18T21:26:47.427654+0000","last_became_active":"2020-05-18T21:26:42.149888+0000","last_became_peered":"2020-05-18T21:26:42.149888+0000","last_unstale":"2020-05-18T21:26:47.427654+0000","last_undegraded":"2020-05-18T21:26:47.427654+0000","last_fullsized":"2020-05-18T21:26:47.427654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:47.424423+0000","last_change":"2020-05-18T21:26:45.188949+0000","last_active":"2020-05-18T21:26:47.424423+0000","last_peered":"2020-05-18T21:26:47.424423+0000","last_clean":"2020-05-18T21:26:47.424423+0000","last_became_active":"2020-05-18T21:26:45.188398+0000","last_became_peered":"2020-05-18T21:26:45.188398+0000","last_unstale":"2020-05-18T21:26:47.424423+0000","last_undegraded":"2020-05-18T21:26:47.424423+0000","last_fullsized":"2020-05-18T21:26:47.424423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_clean_scrub_stamp":"2020-05-18T21:26:44.148357+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.503494+0000","last_change":"2020-05-18T21:26:46.299180+0000","last_active":"2020-05-18T21:26:46.503494+0000","last_peered":"2020-05-18T21:26:46.503494+0000","last_clean":"2020-05-18T21:26:46.503494+0000","last_became_active":"2020-05-18T21:26:46.298821+0000","last_became_peered":"2020-05-18T21:26:46.298821+0000","last_unstale":"2020-05-18T21:26:46.503494+0000","last_undegraded":"2020-05-18T21:26:46.503494+0000","last_fullsized":"2020-05-18T21:26:46.503494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_clean_scrub_stamp":"2020-05-18T21:26:45.165382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.502185+0000","last_change":"2020-05-18T21:26:42.226096+0000","last_active":"2020-05-18T21:26:46.502185+0000","last_peered":"2020-05-18T21:26:46.502185+0000","last_clean":"2020-05-18T21:26:46.502185+0000","last_became_active":"2020-05-18T21:26:42.225154+0000","last_became_peered":"2020-05-18T21:26:42.225154+0000","last_unstale":"2020-05-18T21:26:46.502185+0000","last_undegraded":"2020-05-18T21:26:46.502185+0000","last_fullsized":"2020-05-18T21:26:46.502185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'8","reported_seq":"19","reported_epoch":"23","state":"active+clean","last_fresh":"2020-05-18T21:26:48.539805+0000","last_change":"2020-05-18T21:26:45.190890+0000","last_active":"2020-05-18T21:26:48.539805+0000","last_peered":"2020-05-18T21:26:48.539805+0000","last_clean":"2020-05-18T21:26:48.539805+0000","last_became_active":"2020-05-18T21:26:45.190410+0000","last_became_peered":"2020-05-18T21:26:45.190410+0000","last_unstale":"2020-05-18T21:26:48.539805+0000","last_undegraded":"2020-05-18T21:26:48.539805+0000","last_fullsized":"2020-05-18T21:26:48.539805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_clean_scrub_stamp":"2020-05-18T21:26:44.148357+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.502916+0000","last_change":"2020-05-18T21:26:45.764346+0000","last_active":"2020-05-18T21:26:46.502916+0000","last_peered":"2020-05-18T21:26:46.502916+0000","last_clean":"2020-05-18T21:26:46.502916+0000","last_became_active":"2020-05-18T21:26:45.763181+0000","last_became_peered":"2020-05-18T21:26:45.763181+0000","last_unstale":"2020-05-18T21:26:46.502916+0000","last_undegraded":"2020-05-18T21:26:46.502916+0000","last_fullsized":"2020-05-18T21:26:46.502916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_clean_scrub_stamp":"2020-05-18T21:26:45.165382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:47.426738+0000","last_change":"2020-05-18T21:26:42.153477+0000","last_active":"2020-05-18T21:26:47.426738+0000","last_peered":"2020-05-18T21:26:47.426738+0000","last_clean":"2020-05-18T21:26:47.426738+0000","last_became_active":"2020-05-18T21:26:42.153056+0000","last_became_peered":"2020-05-18T21:26:42.153056+0000","last_unstale":"2020-05-18T21:26:47.426738+0000","last_undegraded":"2020-05-18T21:26:47.426738+0000","last_fullsized":"2020-05-18T21:26:47.426738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'5","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2020-05-18T21:26:48.533746+0000","last_change":"2020-05-18T21:26:45.194860+0000","last_active":"2020-05-18T21:26:48.533746+0000","last_peered":"2020-05-18T21:26:48.533746+0000","last_clean":"2020-05-18T21:26:48.533746+0000","last_became_active":"2020-05-18T21:26:45.194455+0000","last_became_peered":"2020-05-18T21:26:45.194455+0000","last_unstale":"2020-05-18T21:26:48.533746+0000","last_undegraded":"2020-05-18T21:26:48.533746+0000","last_fullsized":"2020-05-18T21:26:48.533746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_clean_scrub_stamp":"2020-05-18T21:26:44.148357+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.502735+0000","last_change":"2020-05-18T21:26:46.300521+0000","last_active":"2020-05-18T21:26:46.502735+0000","last_peered":"2020-05-18T21:26:46.502735+0000","last_clean":"2020-05-18T21:26:46.502735+0000","last_became_active":"2020-05-18T21:26:46.299430+0000","last_became_peered":"2020-05-18T21:26:46.299430+0000","last_unstale":"2020-05-18T21:26:46.502735+0000","last_undegraded":"2020-05-18T21:26:46.502735+0000","last_fullsized":"2020-05-18T21:26:46.502735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_clean_scrub_stamp":"2020-05-18T21:26:45.165382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'6","reported_seq":"17","reported_epoch":"23","state":"active+clean","last_fresh":"2020-05-18T21:26:48.535911+0000","last_change":"2020-05-18T21:26:45.191929+0000","last_active":"2020-05-18T21:26:48.535911+0000","last_peered":"2020-05-18T21:26:48.535911+0000","last_clean":"2020-05-18T21:26:48.535911+0000","last_became_active":"2020-05-18T21:26:45.191525+0000","last_became_peered":"2020-05-18T21:26:45.191525+0000","last_unstale":"2020-05-18T21:26:48.535911+0000","last_undegraded":"2020-05-18T21:26:48.535911+0000","last_fullsized":"2020-05-18T21:26:48.535911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_clean_scrub_stamp":"2020-05-18T21:26:44.148357+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.503186+0000","last_change":"2020-05-18T21:26:42.155086+0000","last_active":"2020-05-18T21:26:46.503186+0000","last_peered":"2020-05-18T21:26:46.503186+0000","last_clean":"2020-05-18T21:26:46.503186+0000","last_became_active":"2020-05-18T21:26:42.154622+0000","last_became_peered":"2020-05-18T21:26:42.154622+0000","last_unstale":"2020-05-18T21:26:46.503186+0000","last_undegraded":"2020-05-18T21:26:46.503186+0000","last_fullsized":"2020-05-18T21:26:46.503186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:47.424605+0000","last_change":"2020-05-18T21:26:46.300864+0000","last_active":"2020-05-18T21:26:47.424605+0000","last_peered":"2020-05-18T21:26:47.424605+0000","last_clean":"2020-05-18T21:26:47.424605+0000","last_became_active":"2020-05-18T21:26:46.300009+0000","last_became_peered":"2020-05-18T21:26:46.300009+0000","last_unstale":"2020-05-18T21:26:47.424605+0000","last_undegraded":"2020-05-18T21:26:47.424605+0000","last_fullsized":"2020-05-18T21:26:47.424605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_clean_scrub_stamp":"2020-05-18T21:26:45.165382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"23'8","reported_seq":"19","reported_epoch":"23","state":"active+clean","last_fresh":"2020-05-18T21:26:48.540446+0000","last_change":"2020-05-18T21:26:45.191059+0000","last_active":"2020-05-18T21:26:48.540446+0000","last_peered":"2020-05-18T21:26:48.540446+0000","last_clean":"2020-05-18T21:26:48.540446+0000","last_became_active":"2020-05-18T21:26:45.190641+0000","last_became_peered":"2020-05-18T21:26:45.190641+0000","last_unstale":"2020-05-18T21:26:48.540446+0000","last_undegraded":"2020-05-18T21:26:48.540446+0000","last_fullsized":"2020-05-18T21:26:48.540446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_clean_scrub_stamp":"2020-05-18T21:26:44.148357+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:47.427719+0000","last_change":"2020-05-18T21:26:42.155047+0000","last_active":"2020-05-18T21:26:47.427719+0000","last_peered":"2020-05-18T21:26:47.427719+0000","last_clean":"2020-05-18T21:26:47.427719+0000","last_became_active":"2020-05-18T21:26:42.154722+0000","last_became_peered":"2020-05-18T21:26:42.154722+0000","last_unstale":"2020-05-18T21:26:47.427719+0000","last_undegraded":"2020-05-18T21:26:47.427719+0000","last_fullsized":"2020-05-18T21:26:47.427719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.501285+0000","last_change":"2020-05-18T21:26:45.504979+0000","last_active":"2020-05-18T21:26:46.501285+0000","last_peered":"2020-05-18T21:26:46.501285+0000","last_clean":"2020-05-18T21:26:46.501285+0000","last_became_active":"2020-05-18T21:26:45.504589+0000","last_became_peered":"2020-05-18T21:26:45.504589+0000","last_unstale":"2020-05-18T21:26:46.501285+0000","last_undegraded":"2020-05-18T21:26:46.501285+0000","last_fullsized":"2020-05-18T21:26:46.501285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_clean_scrub_stamp":"2020-05-18T21:26:45.165382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'7","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2020-05-18T21:26:48.536660+0000","last_change":"2020-05-18T21:26:45.188457+0000","last_active":"2020-05-18T21:26:48.536660+0000","last_peered":"2020-05-18T21:26:48.536660+0000","last_clean":"2020-05-18T21:26:48.536660+0000","last_became_active":"2020-05-18T21:26:45.187856+0000","last_became_peered":"2020-05-18T21:26:45.187856+0000","last_unstale":"2020-05-18T21:26:48.536660+0000","last_undegraded":"2020-05-18T21:26:48.536660+0000","last_fullsized":"2020-05-18T21:26:48.536660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_clean_scrub_stamp":"2020-05-18T21:26:44.148357+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.503361+0000","last_change":"2020-05-18T21:26:42.151175+0000","last_active":"2020-05-18T21:26:46.503361+0000","last_peered":"2020-05-18T21:26:46.503361+0000","last_clean":"2020-05-18T21:26:46.503361+0000","last_became_active":"2020-05-18T21:26:42.150762+0000","last_became_peered":"2020-05-18T21:26:42.150762+0000","last_unstale":"2020-05-18T21:26:46.503361+0000","last_undegraded":"2020-05-18T21:26:46.503361+0000","last_fullsized":"2020-05-18T21:26:46.503361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.555708+0000","last_change":"2020-05-18T21:26:46.301274+0000","last_active":"2020-05-18T21:26:46.555708+0000","last_peered":"2020-05-18T21:26:46.555708+0000","last_clean":"2020-05-18T21:26:46.555708+0000","last_became_active":"2020-05-18T21:26:46.299909+0000","last_became_peered":"2020-05-18T21:26:46.299909+0000","last_unstale":"2020-05-18T21:26:46.555708+0000","last_undegraded":"2020-05-18T21:26:46.555708+0000","last_fullsized":"2020-05-18T21:26:46.555708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_clean_scrub_stamp":"2020-05-18T21:26:45.165382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"23'3","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-05-18T21:26:48.530894+0000","last_change":"2020-05-18T21:26:45.189668+0000","last_active":"2020-05-18T21:26:48.530894+0000","last_peered":"2020-05-18T21:26:48.530894+0000","last_clean":"2020-05-18T21:26:48.530894+0000","last_became_active":"2020-05-18T21:26:45.189290+0000","last_became_peered":"2020-05-18T21:26:45.189290+0000","last_unstale":"2020-05-18T21:26:48.530894+0000","last_undegraded":"2020-05-18T21:26:48.530894+0000","last_fullsized":"2020-05-18T21:26:48.530894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_clean_scrub_stamp":"2020-05-18T21:26:44.148357+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.507703+0000","last_change":"2020-05-18T21:26:42.153239+0000","last_active":"2020-05-18T21:26:46.507703+0000","last_peered":"2020-05-18T21:26:46.507703+0000","last_clean":"2020-05-18T21:26:46.507703+0000","last_became_active":"2020-05-18T21:26:42.152721+0000","last_became_peered":"2020-05-18T21:26:42.152721+0000","last_unstale":"2020-05-18T21:26:46.507703+0000","last_undegraded":"2020-05-18T21:26:46.507703+0000","last_fullsized":"2020-05-18T21:26:46.507703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":92824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.944}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8440000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1110000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.016}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2519999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8330000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9089999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":92258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4930000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2090000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8979999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9530000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.992}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6070000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8340000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":92418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5149999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9049999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1789999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.27}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":92292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.423}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1360000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.008}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.633}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4969999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":92984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2109999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.907}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5270000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3170000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.927}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0529999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":93784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.323}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1760000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.706}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9380000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0089999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":93784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6180000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5820000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2040000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2730000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7919999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":92292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8360000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.165}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9279999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4820000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.214}]}]}]}} 2020-05-18T21:26:54.622 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-05-18T21:26:54.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.719+0000 7f022330c700 1 Processor -- start 2020-05-18T21:26:54.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.719+0000 7f022330c700 1 -- start start 2020-05-18T21:26:54.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f022330c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0615e0 0x7f021c14e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:54.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f022330c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c14d960 con 0x7f021c0b2860 2020-05-18T21:26:54.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f022330c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c14db90 con 0x7f021c060b90 2020-05-18T21:26:54.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f022330c700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c066210 con 0x7f021c0615e0 2020-05-18T21:26:54.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f02208a7700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f021c0b2860 0x7f021c14a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55114/0 (socket says 172.21.15.63:55114) 2020-05-18T21:26:54.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f02208a7700 1 -- 172.21.15.63:0/197586281 learned_addr learned my addr 172.21.15.63:0/197586281 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:54.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f02218a9700 1 --2- 172.21.15.63:0/197586281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0615e0 0x7f021c14e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:54.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f0213fff700 1 -- 172.21.15.63:0/197586281 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2394158907 0 0) 0x7f021c14d960 con 0x7f021c0b2860 2020-05-18T21:26:54.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f0213fff700 1 -- 172.21.15.63:0/197586281 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0200003270 con 0x7f021c0b2860 2020-05-18T21:26:54.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f0213fff700 1 -- 172.21.15.63:0/197586281 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1659461792 0 0) 0x7f0200003270 con 0x7f021c0b2860 2020-05-18T21:26:54.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f0213fff700 1 -- 172.21.15.63:0/197586281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0615e0 msgr2=0x7f021c14e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:54.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f0213fff700 1 --2- 172.21.15.63:0/197586281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0615e0 0x7f021c14e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:54.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f0213fff700 1 -- 172.21.15.63:0/197586281 >> v1:172.21.15.155:6789/0 conn(0x7f021c060b90 legacy=0x7f021c144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f0213fff700 1 -- 172.21.15.63:0/197586281 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c14de30 con 0x7f021c0b2860 2020-05-18T21:26:54.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f0213fff700 1 -- 172.21.15.63:0/197586281 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f0218001710 con 0x7f021c0b2860 2020-05-18T21:26:54.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f0213fff700 1 -- 172.21.15.63:0/197586281 >> v1:172.21.15.63:6789/0 conn(0x7f021c0b2860 legacy=0x7f021c14a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f0213fff700 1 --2- 172.21.15.63:0/197586281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0615e0 0x7f0200003790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:54.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f0213fff700 1 --2- 172.21.15.63:0/197586281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0200003c40 0x7f0200004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:54.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f0213fff700 1 --2- 172.21.15.63:0/197586281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0200004970 0x7f0200004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:54.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f0213fff700 1 -- 172.21.15.63:0/197586281 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c066210 con 0x7f0200003c40 2020-05-18T21:26:54.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f0213fff700 1 -- 172.21.15.63:0/197586281 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02000053a0 con 0x7f0200004970 2020-05-18T21:26:54.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f0213fff700 1 -- 172.21.15.63:0/197586281 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0200004230 con 0x7f021c0615e0 2020-05-18T21:26:54.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f02208a7700 1 --2- 172.21.15.63:0/197586281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0200003c40 0x7f0200004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:54.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f02210a8700 1 --2- 172.21.15.63:0/197586281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0615e0 0x7f0200003790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:54.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f02218a9700 1 --2- 172.21.15.63:0/197586281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0200004970 0x7f0200004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:54.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f02208a7700 1 -- 172.21.15.63:0/197586281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0615e0 msgr2=0x7f0200003790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:54.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f02208a7700 1 --2- 172.21.15.63:0/197586281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0615e0 0x7f0200003790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:54.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f02208a7700 1 -- 172.21.15.63:0/197586281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0200004970 msgr2=0x7f0200004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:54.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f02208a7700 1 --2- 172.21.15.63:0/197586281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0200004970 0x7f0200004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:54.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f02208a7700 1 -- 172.21.15.63:0/197586281 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0200003270 con 0x7f0200003c40 2020-05-18T21:26:54.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f02208a7700 1 --2- 172.21.15.63:0/197586281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0200003c40 0x7f0200004510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0218001420 tx=0x7f021c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f02208a7700 1 --2- 172.21.15.63:0/197586281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0200003c40 0x7f0200004510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0218001420 tx=0x7f021c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f02208a7700 1 --2- 172.21.15.63:0/197586281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0200003c40 0x7f0200004510 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f0218001420 tx=0x7f021c05fa60).ready entity=mon.0 client_cookie=ec02a23591c80830 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:54.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f02208a7700 1 --2- 172.21.15.63:0/197586281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0200003c40 0x7f0200004510 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f0218001420 tx=0x7f021c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f0213fff700 1 -- 172.21.15.63:0/197586281 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f021800ee90 con 0x7f0200003c40 2020-05-18T21:26:54.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f02208a7700 1 --2- 172.21.15.63:0/197586281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0200003c40 0x7f0200004510 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f0218001420 tx=0x7f021c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f02208a7700 1 --2- 172.21.15.63:0/197586281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0200003c40 0x7f0200004510 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f0218001420 tx=0x7f021c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f0213fff700 1 -- 172.21.15.63:0/197586281 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0218010cf0 con 0x7f0200003c40 2020-05-18T21:26:54.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f0213fff700 1 -- 172.21.15.63:0/197586281 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0218010e60 con 0x7f0200003c40 2020-05-18T21:26:54.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f022330c700 1 -- 172.21.15.63:0/197586281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0200003c40 msgr2=0x7f0200004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f022330c700 1 --2- 172.21.15.63:0/197586281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0200003c40 0x7f0200004510 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f0218001420 tx=0x7f021c05fa60).stop 2020-05-18T21:26:54.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.723+0000 7f02218a9700 1 -- 172.21.15.63:0/197586281 reap_dead start 2020-05-18T21:26:54.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.727+0000 7f022330c700 1 -- 172.21.15.63:0/197586281 shutdown_connections 2020-05-18T21:26:54.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.727+0000 7f022330c700 1 -- 172.21.15.63:0/197586281 >> 172.21.15.63:0/197586281 conn(0x7f021c0b83d0 msgr2=0x7f021c0b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:54.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.727+0000 7f022330c700 1 -- 172.21.15.63:0/197586281 shutdown_connections 2020-05-18T21:26:54.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.727+0000 7f022330c700 1 -- 172.21.15.63:0/197586281 wait complete. 2020-05-18T21:26:54.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.727+0000 7f022330c700 1 Processor -- start 2020-05-18T21:26:54.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.727+0000 7f022330c700 1 -- start start 2020-05-18T21:26:54.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.727+0000 7f022330c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0aecf0 0x7f021c146510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:54.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.727+0000 7f022330c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f021c146970 0x7f021c14be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:54.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.727+0000 7f022330c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c0ad8f0 con 0x7f021c0b7700 2020-05-18T21:26:54.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.727+0000 7f022330c700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c14b4a0 con 0x7f021c146970 2020-05-18T21:26:54.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.727+0000 7f022330c700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c14b740 con 0x7f021c0aecf0 2020-05-18T21:26:54.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.727+0000 7f02210a8700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f021c0b7700 0x7f021c0b0060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55126/0 (socket says 172.21.15.63:55126) 2020-05-18T21:26:54.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.727+0000 7f02210a8700 1 -- 172.21.15.63:0/4209648099 learned_addr learned my addr 172.21.15.63:0/4209648099 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:54.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.727+0000 7f02218a9700 1 --2- 172.21.15.63:0/4209648099 >> v2:172.21.15.155:3300/0 conn(0x7f021c146970 0x7f021c14be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:54.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.727+0000 7f02208a7700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0aecf0 0x7f021c146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:54.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.727+0000 7f02127fc700 1 -- 172.21.15.63:0/4209648099 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87501647 0 0) 0x7f021c0ad8f0 con 0x7f021c0b7700 2020-05-18T21:26:54.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.727+0000 7f02127fc700 1 -- 172.21.15.63:0/4209648099 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0204002fe0 con 0x7f021c0b7700 2020-05-18T21:26:54.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.727+0000 7f02127fc700 1 -- 172.21.15.63:0/4209648099 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 59979070 0 0) 0x7f0204002fe0 con 0x7f021c0b7700 2020-05-18T21:26:54.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.727+0000 7f02208a7700 1 -- 172.21.15.63:0/4209648099 >> v2:172.21.15.155:3300/0 conn(0x7f021c146970 msgr2=0x7f021c14be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.731+0000 7f02208a7700 1 --2- 172.21.15.63:0/4209648099 >> v2:172.21.15.155:3300/0 conn(0x7f021c146970 0x7f021c14be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.731+0000 7f02208a7700 1 -- 172.21.15.63:0/4209648099 >> v1:172.21.15.63:6789/0 conn(0x7f021c0b7700 legacy=0x7f021c0b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.731+0000 7f02208a7700 1 -- 172.21.15.63:0/4209648099 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c14b9e0 con 0x7f021c0aecf0 2020-05-18T21:26:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.731+0000 7f02218a9700 1 --2- 172.21.15.63:0/4209648099 >> v2:172.21.15.155:3300/0 conn(0x7f021c146970 0x7f021c14be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:26:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.731+0000 7f02208a7700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0aecf0 0x7f021c146510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f020c002260 tx=0x7f021c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.731+0000 7f02208a7700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0aecf0 0x7f021c146510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f020c002260 tx=0x7f021c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.731+0000 7f02208a7700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0aecf0 0x7f021c146510 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f020c002260 tx=0x7f021c05fa60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.731+0000 7f02208a7700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0aecf0 0x7f021c146510 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f020c002260 tx=0x7f021c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.731+0000 7f02127fc700 1 -- 172.21.15.63:0/4209648099 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f020c0020c0 con 0x7f021c0aecf0 2020-05-18T21:26:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.731+0000 7f02208a7700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0aecf0 0x7f021c146510 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f020c002260 tx=0x7f021c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.731+0000 7f02208a7700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0aecf0 0x7f021c146510 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f020c002260 tx=0x7f021c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.731+0000 7f02127fc700 1 -- 172.21.15.63:0/4209648099 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02180103e0 con 0x7f021c0aecf0 2020-05-18T21:26:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.731+0000 7f02127fc700 1 -- 172.21.15.63:0/4209648099 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0218010740 con 0x7f021c0aecf0 2020-05-18T21:26:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.731+0000 7f022330c700 1 -- 172.21.15.63:0/4209648099 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c0b7ae0 con 0x7f021c0aecf0 2020-05-18T21:26:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.731+0000 7f022330c700 1 -- 172.21.15.63:0/4209648099 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c0afc80 con 0x7f021c0aecf0 2020-05-18T21:26:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.731+0000 7f02208a7700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0aecf0 0x7f021c146510 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f020c002260 tx=0x7f021c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.731+0000 7f022330c700 1 -- 172.21.15.63:0/4209648099 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021c0569e0 con 0x7f021c0aecf0 2020-05-18T21:26:54.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.735+0000 7f02127fc700 1 -- 172.21.15.63:0/4209648099 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f02180011d0 con 0x7f021c0aecf0 2020-05-18T21:26:54.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.735+0000 7f02208a7700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0aecf0 0x7f021c146510 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f020c002260 tx=0x7f021c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.735+0000 7f02127fc700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f020404fe10 0x7f02040522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:54.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.735+0000 7f02127fc700 1 -- 172.21.15.63:0/4209648099 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f02180637c0 con 0x7f021c0aecf0 2020-05-18T21:26:54.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.735+0000 7f02210a8700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f020404fe10 0x7f02040522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:54.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.735+0000 7f02210a8700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f020404fe10 0x7f02040522d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f020c0018f0 tx=0x7f020c003360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.735+0000 7f02210a8700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f020404fe10 0x7f02040522d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f020c0018f0 tx=0x7f020c003360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.735+0000 7f02210a8700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f020404fe10 0x7f02040522d0 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f020c0018f0 tx=0x7f020c003360).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:54.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.743+0000 7f02208a7700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0aecf0 0x7f021c146510 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f020c002260 tx=0x7f021c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.743+0000 7f02127fc700 1 -- 172.21.15.63:0/4209648099 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f021803dc10 con 0x7f021c0aecf0 2020-05-18T21:26:54.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.855+0000 7f022330c700 1 -- 172.21.15.63:0/4209648099 --> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f021c14b320 con 0x7f020404fe10 2020-05-18T21:26:54.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.863+0000 7f02210a8700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f020404fe10 0x7f02040522d0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f020c0018f0 tx=0x7f020c003360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.863+0000 7f02127fc700 1 -- 172.21.15.63:0/4209648099 <== mgr.4110 v2:172.21.15.155:6832/12649 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82269 (secure 0 0 0) 0x7f020c00d330 con 0x7f020404fe10 2020-05-18T21:26:54.868 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:26:54.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.863+0000 7f022330c700 1 -- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f020404fe10 msgr2=0x7f02040522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.863+0000 7f022330c700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f020404fe10 0x7f02040522d0 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f020c0018f0 tx=0x7f020c003360).stop 2020-05-18T21:26:54.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.863+0000 7f022330c700 1 -- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0aecf0 msgr2=0x7f021c146510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.863+0000 7f022330c700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0aecf0 0x7f021c146510 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f020c002260 tx=0x7f021c05fa60).stop 2020-05-18T21:26:54.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.863+0000 7f022330c700 1 -- 172.21.15.63:0/4209648099 shutdown_connections 2020-05-18T21:26:54.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.863+0000 7f022330c700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f020404fe10 0x7f02040522d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:54.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.863+0000 7f022330c700 1 --2- 172.21.15.63:0/4209648099 >> v2:172.21.15.155:3300/0 conn(0x7f021c146970 0x7f021c14be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:54.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.863+0000 7f022330c700 1 --2- 172.21.15.63:0/4209648099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f021c0aecf0 0x7f021c146510 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:54.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.863+0000 7f022330c700 1 -- 172.21.15.63:0/4209648099 >> 172.21.15.63:0/4209648099 conn(0x7f021c0b83d0 msgr2=0x7f021c1496e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:54.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.863+0000 7f022330c700 1 -- 172.21.15.63:0/4209648099 shutdown_connections 2020-05-18T21:26:54.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.867+0000 7f022330c700 1 -- 172.21.15.63:0/4209648099 wait complete. 2020-05-18T21:26:54.871 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2020-05-18T21:26:54.880 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2020-05-18T21:26:53.028768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390624,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584096,"statfs":{"total":773094113280,"available":764502114304,"internally_reserved":8589934592,"allocated":1998848,"data_stored":742636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.532537"},"pg_stats":[{"pgid":"4.5","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.560350+0000","last_change":"2020-05-18T21:26:46.559601+0000","last_active":"2020-05-18T21:26:46.560350+0000","last_peered":"2020-05-18T21:26:46.560350+0000","last_clean":"2020-05-18T21:26:46.560350+0000","last_became_active":"2020-05-18T21:26:46.558566+0000","last_became_peered":"2020-05-18T21:26:46.558566+0000","last_unstale":"2020-05-18T21:26:46.560350+0000","last_undegraded":"2020-05-18T21:26:46.560350+0000","last_fullsized":"2020-05-18T21:26:46.560350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_clean_scrub_stamp":"2020-05-18T21:26:45.165382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:47.427662+0000","last_change":"2020-05-18T21:26:37.226650+0000","last_active":"2020-05-18T21:26:47.427662+0000","last_peered":"2020-05-18T21:26:47.427662+0000","last_clean":"2020-05-18T21:26:47.427662+0000","last_became_active":"2020-05-18T21:26:37.224618+0000","last_became_peered":"2020-05-18T21:26:37.224618+0000","last_unstale":"2020-05-18T21:26:47.427662+0000","last_undegraded":"2020-05-18T21:26:47.427662+0000","last_fullsized":"2020-05-18T21:26:47.427662+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:34.017197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:34.017197+0000","last_clean_scrub_stamp":"2020-05-18T21:26:34.017197+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:47.426585+0000","last_change":"2020-05-18T21:26:42.152047+0000","last_active":"2020-05-18T21:26:47.426585+0000","last_peered":"2020-05-18T21:26:47.426585+0000","last_clean":"2020-05-18T21:26:47.426585+0000","last_became_active":"2020-05-18T21:26:42.151473+0000","last_became_peered":"2020-05-18T21:26:42.151473+0000","last_unstale":"2020-05-18T21:26:47.426585+0000","last_undegraded":"2020-05-18T21:26:47.426585+0000","last_fullsized":"2020-05-18T21:26:47.426585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'1","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-05-18T21:26:47.511547+0000","last_change":"2020-05-18T21:26:45.189432+0000","last_active":"2020-05-18T21:26:47.511547+0000","last_peered":"2020-05-18T21:26:47.511547+0000","last_clean":"2020-05-18T21:26:47.511547+0000","last_became_active":"2020-05-18T21:26:45.188777+0000","last_became_peered":"2020-05-18T21:26:45.188777+0000","last_unstale":"2020-05-18T21:26:47.511547+0000","last_undegraded":"2020-05-18T21:26:47.511547+0000","last_fullsized":"2020-05-18T21:26:47.511547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_clean_scrub_stamp":"2020-05-18T21:26:44.148357+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:47.424632+0000","last_change":"2020-05-18T21:26:45.505601+0000","last_active":"2020-05-18T21:26:47.424632+0000","last_peered":"2020-05-18T21:26:47.424632+0000","last_clean":"2020-05-18T21:26:47.424632+0000","last_became_active":"2020-05-18T21:26:45.505076+0000","last_became_peered":"2020-05-18T21:26:45.505076+0000","last_unstale":"2020-05-18T21:26:47.424632+0000","last_undegraded":"2020-05-18T21:26:47.424632+0000","last_fullsized":"2020-05-18T21:26:47.424632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_clean_scrub_stamp":"2020-05-18T21:26:45.165382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:47.427654+0000","last_change":"2020-05-18T21:26:42.150248+0000","last_active":"2020-05-18T21:26:47.427654+0000","last_peered":"2020-05-18T21:26:47.427654+0000","last_clean":"2020-05-18T21:26:47.427654+0000","last_became_active":"2020-05-18T21:26:42.149888+0000","last_became_peered":"2020-05-18T21:26:42.149888+0000","last_unstale":"2020-05-18T21:26:47.427654+0000","last_undegraded":"2020-05-18T21:26:47.427654+0000","last_fullsized":"2020-05-18T21:26:47.427654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:47.424423+0000","last_change":"2020-05-18T21:26:45.188949+0000","last_active":"2020-05-18T21:26:47.424423+0000","last_peered":"2020-05-18T21:26:47.424423+0000","last_clean":"2020-05-18T21:26:47.424423+0000","last_became_active":"2020-05-18T21:26:45.188398+0000","last_became_peered":"2020-05-18T21:26:45.188398+0000","last_unstale":"2020-05-18T21:26:47.424423+0000","last_undegraded":"2020-05-18T21:26:47.424423+0000","last_fullsized":"2020-05-18T21:26:47.424423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_clean_scrub_stamp":"2020-05-18T21:26:44.148357+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.503494+0000","last_change":"2020-05-18T21:26:46.299180+0000","last_active":"2020-05-18T21:26:46.503494+0000","last_peered":"2020-05-18T21:26:46.503494+0000","last_clean":"2020-05-18T21:26:46.503494+0000","last_became_active":"2020-05-18T21:26:46.298821+0000","last_became_peered":"2020-05-18T21:26:46.298821+0000","last_unstale":"2020-05-18T21:26:46.503494+0000","last_undegraded":"2020-05-18T21:26:46.503494+0000","last_fullsized":"2020-05-18T21:26:46.503494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_clean_scrub_stamp":"2020-05-18T21:26:45.165382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.502185+0000","last_change":"2020-05-18T21:26:42.226096+0000","last_active":"2020-05-18T21:26:46.502185+0000","last_peered":"2020-05-18T21:26:46.502185+0000","last_clean":"2020-05-18T21:26:46.502185+0000","last_became_active":"2020-05-18T21:26:42.225154+0000","last_became_peered":"2020-05-18T21:26:42.225154+0000","last_unstale":"2020-05-18T21:26:46.502185+0000","last_undegraded":"2020-05-18T21:26:46.502185+0000","last_fullsized":"2020-05-18T21:26:46.502185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'8","reported_seq":"19","reported_epoch":"23","state":"active+clean","last_fresh":"2020-05-18T21:26:48.539805+0000","last_change":"2020-05-18T21:26:45.190890+0000","last_active":"2020-05-18T21:26:48.539805+0000","last_peered":"2020-05-18T21:26:48.539805+0000","last_clean":"2020-05-18T21:26:48.539805+0000","last_became_active":"2020-05-18T21:26:45.190410+0000","last_became_peered":"2020-05-18T21:26:45.190410+0000","last_unstale":"2020-05-18T21:26:48.539805+0000","last_undegraded":"2020-05-18T21:26:48.539805+0000","last_fullsized":"2020-05-18T21:26:48.539805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_clean_scrub_stamp":"2020-05-18T21:26:44.148357+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.502916+0000","last_change":"2020-05-18T21:26:45.764346+0000","last_active":"2020-05-18T21:26:46.502916+0000","last_peered":"2020-05-18T21:26:46.502916+0000","last_clean":"2020-05-18T21:26:46.502916+0000","last_became_active":"2020-05-18T21:26:45.763181+0000","last_became_peered":"2020-05-18T21:26:45.763181+0000","last_unstale":"2020-05-18T21:26:46.502916+0000","last_undegraded":"2020-05-18T21:26:46.502916+0000","last_fullsized":"2020-05-18T21:26:46.502916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_clean_scrub_stamp":"2020-05-18T21:26:45.165382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:47.426738+0000","last_change":"2020-05-18T21:26:42.153477+0000","last_active":"2020-05-18T21:26:47.426738+0000","last_peered":"2020-05-18T21:26:47.426738+0000","last_clean":"2020-05-18T21:26:47.426738+0000","last_became_active":"2020-05-18T21:26:42.153056+0000","last_became_peered":"2020-05-18T21:26:42.153056+0000","last_unstale":"2020-05-18T21:26:47.426738+0000","last_undegraded":"2020-05-18T21:26:47.426738+0000","last_fullsized":"2020-05-18T21:26:47.426738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'5","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2020-05-18T21:26:48.533746+0000","last_change":"2020-05-18T21:26:45.194860+0000","last_active":"2020-05-18T21:26:48.533746+0000","last_peered":"2020-05-18T21:26:48.533746+0000","last_clean":"2020-05-18T21:26:48.533746+0000","last_became_active":"2020-05-18T21:26:45.194455+0000","last_became_peered":"2020-05-18T21:26:45.194455+0000","last_unstale":"2020-05-18T21:26:48.533746+0000","last_undegraded":"2020-05-18T21:26:48.533746+0000","last_fullsized":"2020-05-18T21:26:48.533746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_clean_scrub_stamp":"2020-05-18T21:26:44.148357+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.502735+0000","last_change":"2020-05-18T21:26:46.300521+0000","last_active":"2020-05-18T21:26:46.502735+0000","last_peered":"2020-05-18T21:26:46.502735+0000","last_clean":"2020-05-18T21:26:46.502735+0000","last_became_active":"2020-05-18T21:26:46.299430+0000","last_became_peered":"2020-05-18T21:26:46.299430+0000","last_unstale":"2020-05-18T21:26:46.502735+0000","last_undegraded":"2020-05-18T21:26:46.502735+0000","last_fullsized":"2020-05-18T21:26:46.502735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_clean_scrub_stamp":"2020-05-18T21:26:45.165382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'6","reported_seq":"17","reported_epoch":"23","state":"active+clean","last_fresh":"2020-05-18T21:26:48.535911+0000","last_change":"2020-05-18T21:26:45.191929+0000","last_active":"2020-05-18T21:26:48.535911+0000","last_peered":"2020-05-18T21:26:48.535911+0000","last_clean":"2020-05-18T21:26:48.535911+0000","last_became_active":"2020-05-18T21:26:45.191525+0000","last_became_peered":"2020-05-18T21:26:45.191525+0000","last_unstale":"2020-05-18T21:26:48.535911+0000","last_undegraded":"2020-05-18T21:26:48.535911+0000","last_fullsized":"2020-05-18T21:26:48.535911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_clean_scrub_stamp":"2020-05-18T21:26:44.148357+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.503186+0000","last_change":"2020-05-18T21:26:42.155086+0000","last_active":"2020-05-18T21:26:46.503186+0000","last_peered":"2020-05-18T21:26:46.503186+0000","last_clean":"2020-05-18T21:26:46.503186+0000","last_became_active":"2020-05-18T21:26:42.154622+0000","last_became_peered":"2020-05-18T21:26:42.154622+0000","last_unstale":"2020-05-18T21:26:46.503186+0000","last_undegraded":"2020-05-18T21:26:46.503186+0000","last_fullsized":"2020-05-18T21:26:46.503186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:47.424605+0000","last_change":"2020-05-18T21:26:46.300864+0000","last_active":"2020-05-18T21:26:47.424605+0000","last_peered":"2020-05-18T21:26:47.424605+0000","last_clean":"2020-05-18T21:26:47.424605+0000","last_became_active":"2020-05-18T21:26:46.300009+0000","last_became_peered":"2020-05-18T21:26:46.300009+0000","last_unstale":"2020-05-18T21:26:47.424605+0000","last_undegraded":"2020-05-18T21:26:47.424605+0000","last_fullsized":"2020-05-18T21:26:47.424605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_clean_scrub_stamp":"2020-05-18T21:26:45.165382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"23'8","reported_seq":"19","reported_epoch":"23","state":"active+clean","last_fresh":"2020-05-18T21:26:48.540446+0000","last_change":"2020-05-18T21:26:45.191059+0000","last_active":"2020-05-18T21:26:48.540446+0000","last_peered":"2020-05-18T21:26:48.540446+0000","last_clean":"2020-05-18T21:26:48.540446+0000","last_became_active":"2020-05-18T21:26:45.190641+0000","last_became_peered":"2020-05-18T21:26:45.190641+0000","last_unstale":"2020-05-18T21:26:48.540446+0000","last_undegraded":"2020-05-18T21:26:48.540446+0000","last_fullsized":"2020-05-18T21:26:48.540446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_clean_scrub_stamp":"2020-05-18T21:26:44.148357+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:47.427719+0000","last_change":"2020-05-18T21:26:42.155047+0000","last_active":"2020-05-18T21:26:47.427719+0000","last_peered":"2020-05-18T21:26:47.427719+0000","last_clean":"2020-05-18T21:26:47.427719+0000","last_became_active":"2020-05-18T21:26:42.154722+0000","last_became_peered":"2020-05-18T21:26:42.154722+0000","last_unstale":"2020-05-18T21:26:47.427719+0000","last_undegraded":"2020-05-18T21:26:47.427719+0000","last_fullsized":"2020-05-18T21:26:47.427719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.501285+0000","last_change":"2020-05-18T21:26:45.504979+0000","last_active":"2020-05-18T21:26:46.501285+0000","last_peered":"2020-05-18T21:26:46.501285+0000","last_clean":"2020-05-18T21:26:46.501285+0000","last_became_active":"2020-05-18T21:26:45.504589+0000","last_became_peered":"2020-05-18T21:26:45.504589+0000","last_unstale":"2020-05-18T21:26:46.501285+0000","last_undegraded":"2020-05-18T21:26:46.501285+0000","last_fullsized":"2020-05-18T21:26:46.501285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_clean_scrub_stamp":"2020-05-18T21:26:45.165382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'7","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2020-05-18T21:26:48.536660+0000","last_change":"2020-05-18T21:26:45.188457+0000","last_active":"2020-05-18T21:26:48.536660+0000","last_peered":"2020-05-18T21:26:48.536660+0000","last_clean":"2020-05-18T21:26:48.536660+0000","last_became_active":"2020-05-18T21:26:45.187856+0000","last_became_peered":"2020-05-18T21:26:45.187856+0000","last_unstale":"2020-05-18T21:26:48.536660+0000","last_undegraded":"2020-05-18T21:26:48.536660+0000","last_fullsized":"2020-05-18T21:26:48.536660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_clean_scrub_stamp":"2020-05-18T21:26:44.148357+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.503361+0000","last_change":"2020-05-18T21:26:42.151175+0000","last_active":"2020-05-18T21:26:46.503361+0000","last_peered":"2020-05-18T21:26:46.503361+0000","last_clean":"2020-05-18T21:26:46.503361+0000","last_became_active":"2020-05-18T21:26:42.150762+0000","last_became_peered":"2020-05-18T21:26:42.150762+0000","last_unstale":"2020-05-18T21:26:46.503361+0000","last_undegraded":"2020-05-18T21:26:46.503361+0000","last_fullsized":"2020-05-18T21:26:46.503361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.555708+0000","last_change":"2020-05-18T21:26:46.301274+0000","last_active":"2020-05-18T21:26:46.555708+0000","last_peered":"2020-05-18T21:26:46.555708+0000","last_clean":"2020-05-18T21:26:46.555708+0000","last_became_active":"2020-05-18T21:26:46.299909+0000","last_became_peered":"2020-05-18T21:26:46.299909+0000","last_unstale":"2020-05-18T21:26:46.555708+0000","last_undegraded":"2020-05-18T21:26:46.555708+0000","last_fullsized":"2020-05-18T21:26:46.555708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:45.165382+0000","last_clean_scrub_stamp":"2020-05-18T21:26:45.165382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"23'3","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-05-18T21:26:48.530894+0000","last_change":"2020-05-18T21:26:45.189668+0000","last_active":"2020-05-18T21:26:48.530894+0000","last_peered":"2020-05-18T21:26:48.530894+0000","last_clean":"2020-05-18T21:26:48.530894+0000","last_became_active":"2020-05-18T21:26:45.189290+0000","last_became_peered":"2020-05-18T21:26:45.189290+0000","last_unstale":"2020-05-18T21:26:48.530894+0000","last_undegraded":"2020-05-18T21:26:48.530894+0000","last_fullsized":"2020-05-18T21:26:48.530894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:44.148357+0000","last_clean_scrub_stamp":"2020-05-18T21:26:44.148357+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2020-05-18T21:26:46.507703+0000","last_change":"2020-05-18T21:26:42.153239+0000","last_active":"2020-05-18T21:26:46.507703+0000","last_peered":"2020-05-18T21:26:46.507703+0000","last_clean":"2020-05-18T21:26:46.507703+0000","last_became_active":"2020-05-18T21:26:42.152721+0000","last_became_peered":"2020-05-18T21:26:42.152721+0000","last_unstale":"2020-05-18T21:26:46.507703+0000","last_undegraded":"2020-05-18T21:26:46.507703+0000","last_fullsized":"2020-05-18T21:26:46.507703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":92824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.944}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8440000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1110000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.016}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2519999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8330000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9089999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":92258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4930000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2090000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8979999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9530000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.992}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6070000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8340000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":92418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5149999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9049999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1789999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.27}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":92292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.423}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1360000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.008}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.633}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4969999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":92984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2109999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.907}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5270000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3170000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.927}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0529999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":93784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.323}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1760000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.706}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9380000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0089999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":93784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6180000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5820000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2040000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2730000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7919999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":92292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8360000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.165}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9279999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4820000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.214}]}]}]}} 2020-05-18T21:26:54.883 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-05-18T21:26:54.883 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-05-18T21:26:54.883 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-05-18T21:26:54.884 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-05-18T21:26:54.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.983+0000 7f55a1057700 1 Processor -- start 2020-05-18T21:26:54.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.983+0000 7f55a1057700 1 -- start start 2020-05-18T21:26:54.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f55a1057700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f559c069eb0 0x7f559c0625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:54.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f55a1057700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f559c065780 0x7f559c065bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:54.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f55a1057700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f559c12bc70 0x7f559c12c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:54.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f55a1057700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559c062a00 con 0x7f559c065780 2020-05-18T21:26:54.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f55a1057700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559c12c560 con 0x7f559c069eb0 2020-05-18T21:26:54.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f55a1057700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c1496d0 con 0x7f559c12bc70 2020-05-18T21:26:54.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f5593fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f559c065780 0x7f559c065bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:54.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f5593fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f559c065780 0x7f559c065bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52946/0 (socket says 172.21.15.63:52946) 2020-05-18T21:26:54.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f5593fff700 1 -- 172.21.15.63:0/3702426572 learned_addr learned my addr 172.21.15.63:0/3702426572 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:54.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f55a0856700 1 --2- 172.21.15.63:0/3702426572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f559c12bc70 0x7f559c12c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:54.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f559bfff700 1 --2- 172.21.15.63:0/3702426572 >> v2:172.21.15.155:3300/0 conn(0x7f559c069eb0 0x7f559c0625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:54.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f5593fff700 1 -- 172.21.15.63:0/3702426572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f559c12bc70 msgr2=0x7f559c12c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:54.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f5593fff700 1 --2- 172.21.15.63:0/3702426572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f559c12bc70 0x7f559c12c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:54.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f5593fff700 1 -- 172.21.15.63:0/3702426572 >> v2:172.21.15.155:3300/0 conn(0x7f559c069eb0 msgr2=0x7f559c0625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:54.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f5593fff700 1 --2- 172.21.15.63:0/3702426572 >> v2:172.21.15.155:3300/0 conn(0x7f559c069eb0 0x7f559c0625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:54.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f5593fff700 1 -- 172.21.15.63:0/3702426572 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c0b6d20 con 0x7f559c065780 2020-05-18T21:26:54.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f559bfff700 1 --2- 172.21.15.63:0/3702426572 >> v2:172.21.15.155:3300/0 conn(0x7f559c069eb0 0x7f559c0625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:26:54.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f5593fff700 1 --2- 172.21.15.63:0/3702426572 >> v2:172.21.15.63:3300/0 conn(0x7f559c065780 0x7f559c065bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5584002f70 tx=0x7f5584007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f5593fff700 1 --2- 172.21.15.63:0/3702426572 >> v2:172.21.15.63:3300/0 conn(0x7f559c065780 0x7f559c065bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5584002f70 tx=0x7f5584007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f5593fff700 1 --2- 172.21.15.63:0/3702426572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f559c065780 0x7f559c065bc0 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f5584002f70 tx=0x7f5584007a80).ready entity=mon.0 client_cookie=a581474ffedf4415 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:54.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f5593fff700 1 --2- 172.21.15.63:0/3702426572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f559c065780 0x7f559c065bc0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f5584002f70 tx=0x7f5584007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f5593fff700 1 --2- 172.21.15.63:0/3702426572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f559c065780 0x7f559c065bc0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f5584002f70 tx=0x7f5584007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f5593fff700 1 --2- 172.21.15.63:0/3702426572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f559c065780 0x7f559c065bc0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f5584002f70 tx=0x7f5584007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:54.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f559b7fe700 1 -- 172.21.15.63:0/3702426572 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5584011760 con 0x7f559c065780 2020-05-18T21:26:54.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f559b7fe700 1 -- 172.21.15.63:0/3702426572 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55840118c0 con 0x7f559c065780 2020-05-18T21:26:54.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f55a1057700 1 -- 172.21.15.63:0/3702426572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f559c065780 msgr2=0x7f559c065bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:54.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f55a1057700 1 --2- 172.21.15.63:0/3702426572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f559c065780 0x7f559c065bc0 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f5584002f70 tx=0x7f5584007a80).stop 2020-05-18T21:26:54.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f559b7fe700 1 -- 172.21.15.63:0/3702426572 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5584011ce0 con 0x7f559c065780 2020-05-18T21:26:55.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f55a1057700 1 -- 172.21.15.63:0/3702426572 shutdown_connections 2020-05-18T21:26:55.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f55a1057700 1 --2- 172.21.15.63:0/3702426572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f559c12bc70 0x7f559c12c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:55.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f55a1057700 1 --2- 172.21.15.63:0/3702426572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f559c065780 0x7f559c065bc0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f55a1057700 1 --2- 172.21.15.63:0/3702426572 >> v2:172.21.15.155:3300/0 conn(0x7f559c069eb0 0x7f559c0625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f55a1057700 1 -- 172.21.15.63:0/3702426572 >> 172.21.15.63:0/3702426572 conn(0x7f559c05a7c0 msgr2=0x7f559c05aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f55a1057700 1 -- 172.21.15.63:0/3702426572 shutdown_connections 2020-05-18T21:26:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.987+0000 7f55a1057700 1 -- 172.21.15.63:0/3702426572 wait complete. 2020-05-18T21:26:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f55a1057700 1 Processor -- start 2020-05-18T21:26:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f55a1057700 1 -- start start 2020-05-18T21:26:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f55a1057700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f559c065780 0x7f559c12f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f55a1057700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f559c069eb0 0x7f559c148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f55a1057700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f559c1492d0 con 0x7f559c12bc70 2020-05-18T21:26:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f55a1057700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559c1578f0 con 0x7f559c065780 2020-05-18T21:26:55.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f55a1057700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c157b90 con 0x7f559c069eb0 2020-05-18T21:26:55.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f55a0856700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f559c12bc70 0x7f559c157080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55144/0 (socket says 172.21.15.63:55144) 2020-05-18T21:26:55.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f55a0856700 1 -- 172.21.15.63:0/705022626 learned_addr learned my addr 172.21.15.63:0/705022626 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:55.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f559bfff700 1 --2- 172.21.15.63:0/705022626 >> v2:172.21.15.155:3300/0 conn(0x7f559c065780 0x7f559c12f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:55.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f5593fff700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f559c069eb0 0x7f559c148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:55.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f5599ffb700 1 -- 172.21.15.63:0/705022626 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1800516089 0 0) 0x7f559c1492d0 con 0x7f559c12bc70 2020-05-18T21:26:55.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f5599ffb700 1 -- 172.21.15.63:0/705022626 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5580002fe0 con 0x7f559c12bc70 2020-05-18T21:26:55.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f559bfff700 1 -- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f559c069eb0 msgr2=0x7f559c148e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f559bfff700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f559c069eb0 0x7f559c148e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f559bfff700 1 -- 172.21.15.63:0/705022626 >> v1:172.21.15.63:6789/0 conn(0x7f559c12bc70 legacy=0x7f559c157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f559bfff700 1 -- 172.21.15.63:0/705022626 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c147700 con 0x7f559c065780 2020-05-18T21:26:55.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f5593fff700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f559c069eb0 0x7f559c148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:26:55.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f559bfff700 1 --2- 172.21.15.63:0/705022626 >> v2:172.21.15.155:3300/0 conn(0x7f559c065780 0x7f559c12f320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f559c148a70 tx=0x7f558c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f559bfff700 1 --2- 172.21.15.63:0/705022626 >> v2:172.21.15.155:3300/0 conn(0x7f559c065780 0x7f559c12f320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f559c148a70 tx=0x7f558c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f559bfff700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f559c065780 0x7f559c12f320 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f559c148a70 tx=0x7f558c010a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:55.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f559bfff700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f559c065780 0x7f559c12f320 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f559c148a70 tx=0x7f558c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f5599ffb700 1 -- 172.21.15.63:0/705022626 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f558c0091c0 con 0x7f559c065780 2020-05-18T21:26:55.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f559bfff700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f559c065780 0x7f559c12f320 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f559c148a70 tx=0x7f558c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f5599ffb700 1 -- 172.21.15.63:0/705022626 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558c009320 con 0x7f559c065780 2020-05-18T21:26:55.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f559bfff700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f559c065780 0x7f559c12f320 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f559c148a70 tx=0x7f558c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f5599ffb700 1 -- 172.21.15.63:0/705022626 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f558c009700 con 0x7f559c065780 2020-05-18T21:26:55.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f55a1057700 1 -- 172.21.15.63:0/705022626 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559c12e7c0 con 0x7f559c065780 2020-05-18T21:26:55.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.991+0000 7f55a1057700 1 -- 172.21.15.63:0/705022626 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559c1453a0 con 0x7f559c065780 2020-05-18T21:26:55.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.995+0000 7f55a1057700 1 -- 172.21.15.63:0/705022626 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559c145a40 con 0x7f559c065780 2020-05-18T21:26:55.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.995+0000 7f559bfff700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f559c065780 0x7f559c12f320 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f559c148a70 tx=0x7f558c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.995+0000 7f5599ffb700 1 -- 172.21.15.63:0/705022626 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f558c007190 con 0x7f559c065780 2020-05-18T21:26:55.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.995+0000 7f559bfff700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f559c065780 0x7f559c12f320 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f559c148a70 tx=0x7f558c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.995+0000 7f5599ffb700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f558004fd40 0x7f5580052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:55.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.995+0000 7f5599ffb700 1 -- 172.21.15.63:0/705022626 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f558c063620 con 0x7f559c065780 2020-05-18T21:26:55.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.995+0000 7f5593fff700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f558004fd40 0x7f5580052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:55.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.995+0000 7f5593fff700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f558004fd40 0x7f5580052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5584002f70 tx=0x7f5584007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.995+0000 7f5593fff700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f558004fd40 0x7f5580052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5584002f70 tx=0x7f5584007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:54.995+0000 7f5593fff700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f558004fd40 0x7f5580052200 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f5584002f70 tx=0x7f5584007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:55.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.003+0000 7f559bfff700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f559c065780 0x7f559c12f320 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f559c148a70 tx=0x7f558c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.003+0000 7f5599ffb700 1 -- 172.21.15.63:0/705022626 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f558c03da10 con 0x7f559c065780 2020-05-18T21:26:55.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.159+0000 7f55a1057700 1 -- 172.21.15.63:0/705022626 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f559c12ead0 con 0x7f559c065780 2020-05-18T21:26:55.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.163+0000 7f559bfff700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f559c065780 0x7f559c12f320 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f559c148a70 tx=0x7f558c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.163+0000 7f5599ffb700 1 -- 172.21.15.63:0/705022626 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f558c041030 con 0x7f559c065780 2020-05-18T21:26:55.165 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:26:55.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.163+0000 7f55a1057700 1 -- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f558004fd40 msgr2=0x7f5580052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.163+0000 7f55a1057700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f558004fd40 0x7f5580052200 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f5584002f70 tx=0x7f5584007a80).stop 2020-05-18T21:26:55.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.163+0000 7f55a1057700 1 -- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f559c065780 msgr2=0x7f559c12f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.163+0000 7f55a1057700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f559c065780 0x7f559c12f320 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f559c148a70 tx=0x7f558c010a70).stop 2020-05-18T21:26:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.163+0000 7f55a1057700 1 -- 172.21.15.63:0/705022626 shutdown_connections 2020-05-18T21:26:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.163+0000 7f55a1057700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f558004fd40 0x7f5580052200 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.163+0000 7f55a1057700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f559c069eb0 0x7f559c148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.163+0000 7f55a1057700 1 --2- 172.21.15.63:0/705022626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f559c065780 0x7f559c12f320 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.163+0000 7f55a1057700 1 -- 172.21.15.63:0/705022626 >> 172.21.15.63:0/705022626 conn(0x7f559c05a7c0 msgr2=0x7f559c05c280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:55.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.163+0000 7f55a1057700 1 -- 172.21.15.63:0/705022626 shutdown_connections 2020-05-18T21:26:55.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.163+0000 7f55a1057700 1 -- 172.21.15.63:0/705022626 wait complete. 2020-05-18T21:26:55.177 INFO:teuthology.orchestra.run.smithi063.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-05-18T21:26:55.178 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-05-18T21:26:55.178 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:26:55.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.275+0000 7ff96acc9700 1 Processor -- start 2020-05-18T21:26:55.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.275+0000 7ff96acc9700 1 -- start start 2020-05-18T21:26:55.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.275+0000 7ff96acc9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff964063ce0 0x7ff964147140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:55.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.275+0000 7ff96acc9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff9640ad180 0x7ff9640ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:55.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.275+0000 7ff96acc9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9641476c0 con 0x7ff9641435d0 2020-05-18T21:26:55.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.275+0000 7ff96acc9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff964148130 con 0x7ff964063ce0 2020-05-18T21:26:55.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.275+0000 7ff96acc9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff964147960 con 0x7ff9640ad180 2020-05-18T21:26:55.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.275+0000 7ff9694c6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff964063ce0 0x7ff964147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:55.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.275+0000 7ff9694c6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff964063ce0 0x7ff964147140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52962/0 (socket says 172.21.15.63:52962) 2020-05-18T21:26:55.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.275+0000 7ff9694c6700 1 -- 172.21.15.63:0/3323296121 learned_addr learned my addr 172.21.15.63:0/3323296121 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:55.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.275+0000 7ff96a4c8700 1 --2- 172.21.15.63:0/3323296121 >> v2:172.21.15.155:3300/0 conn(0x7ff9640ad180 0x7ff9640ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:55.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff9694c6700 1 -- 172.21.15.63:0/3323296121 >> v2:172.21.15.155:3300/0 conn(0x7ff9640ad180 msgr2=0x7ff9640ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:55.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff9694c6700 1 --2- 172.21.15.63:0/3323296121 >> v2:172.21.15.155:3300/0 conn(0x7ff9640ad180 0x7ff9640ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:55.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff9694c6700 1 -- 172.21.15.63:0/3323296121 >> v1:172.21.15.155:6789/0 conn(0x7ff9641435d0 legacy=0x7ff96405edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff9694c6700 1 -- 172.21.15.63:0/3323296121 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff964147c00 con 0x7ff964063ce0 2020-05-18T21:26:55.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff9694c6700 1 --2- 172.21.15.63:0/3323296121 >> v2:172.21.15.63:3300/0 conn(0x7ff964063ce0 0x7ff964147140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff954002f70 tx=0x7ff954007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff9694c6700 1 --2- 172.21.15.63:0/3323296121 >> v2:172.21.15.63:3300/0 conn(0x7ff964063ce0 0x7ff964147140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff954002f70 tx=0x7ff954007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff9694c6700 1 --2- 172.21.15.63:0/3323296121 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff964063ce0 0x7ff964147140 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7ff954002f70 tx=0x7ff954007a80).ready entity=mon.0 client_cookie=9673a9cf2d56aa5a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:55.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff9694c6700 1 --2- 172.21.15.63:0/3323296121 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff964063ce0 0x7ff964147140 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7ff954002f70 tx=0x7ff954007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff968cc5700 1 -- 172.21.15.63:0/3323296121 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9540116b0 con 0x7ff964063ce0 2020-05-18T21:26:55.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff9694c6700 1 --2- 172.21.15.63:0/3323296121 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff964063ce0 0x7ff964147140 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7ff954002f70 tx=0x7ff954007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff968cc5700 1 -- 172.21.15.63:0/3323296121 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff954011810 con 0x7ff964063ce0 2020-05-18T21:26:55.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff96acc9700 1 -- 172.21.15.63:0/3323296121 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff964063ce0 msgr2=0x7ff964147140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff9694c6700 1 --2- 172.21.15.63:0/3323296121 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff964063ce0 0x7ff964147140 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7ff954002f70 tx=0x7ff954007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff968cc5700 1 -- 172.21.15.63:0/3323296121 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff954011c30 con 0x7ff964063ce0 2020-05-18T21:26:55.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff96acc9700 1 --2- 172.21.15.63:0/3323296121 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff964063ce0 0x7ff964147140 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7ff954002f70 tx=0x7ff954007a80).stop 2020-05-18T21:26:55.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff96acc9700 1 -- 172.21.15.63:0/3323296121 shutdown_connections 2020-05-18T21:26:55.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff96acc9700 1 --2- 172.21.15.63:0/3323296121 >> v2:172.21.15.155:3300/0 conn(0x7ff9640ad180 0x7ff9640ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:55.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff96acc9700 1 --2- 172.21.15.63:0/3323296121 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff964063ce0 0x7ff964147140 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff96acc9700 1 -- 172.21.15.63:0/3323296121 >> 172.21.15.63:0/3323296121 conn(0x7ff964069fc0 msgr2=0x7ff96406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:55.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff96acc9700 1 -- 172.21.15.63:0/3323296121 shutdown_connections 2020-05-18T21:26:55.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff96acc9700 1 -- 172.21.15.63:0/3323296121 wait complete. 2020-05-18T21:26:55.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff96acc9700 1 Processor -- start 2020-05-18T21:26:55.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.279+0000 7ff96acc9700 1 -- start start 2020-05-18T21:26:55.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff96acc9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff9640ad180 0x7ff964061fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:55.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff96acc9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9641435d0 0x7ff96413aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:55.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff96acc9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9641576d0 con 0x7ff964063ce0 2020-05-18T21:26:55.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff96acc9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9640b1bf0 con 0x7ff9640ad180 2020-05-18T21:26:55.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff96acc9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff964062f70 con 0x7ff9641435d0 2020-05-18T21:26:55.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff9694c6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff9640ad180 0x7ff964061fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:55.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff9694c6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff9640ad180 0x7ff964061fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52968/0 (socket says 172.21.15.63:52968) 2020-05-18T21:26:55.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff969cc7700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7ff964063ce0 0x7ff964156e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:53470/0 (socket says 172.21.15.63:53470) 2020-05-18T21:26:55.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff9694c6700 1 -- 172.21.15.63:0/2079777527 learned_addr learned my addr 172.21.15.63:0/2079777527 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:55.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff96a4c8700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9641435d0 0x7ff96413aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:55.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff952ffd700 1 -- 172.21.15.63:0/2079777527 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391831964 0 0) 0x7ff9641576d0 con 0x7ff964063ce0 2020-05-18T21:26:55.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff952ffd700 1 -- 172.21.15.63:0/2079777527 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff944002fe0 con 0x7ff964063ce0 2020-05-18T21:26:55.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff9694c6700 1 -- 172.21.15.63:0/2079777527 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9641435d0 msgr2=0x7ff96413aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff9694c6700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9641435d0 0x7ff96413aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff9694c6700 1 -- 172.21.15.63:0/2079777527 >> v1:172.21.15.155:6789/0 conn(0x7ff964063ce0 legacy=0x7ff964156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff9694c6700 1 -- 172.21.15.63:0/2079777527 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff964063210 con 0x7ff9640ad180 2020-05-18T21:26:55.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff9694c6700 1 --2- 172.21.15.63:0/2079777527 >> v2:172.21.15.63:3300/0 conn(0x7ff9640ad180 0x7ff964061fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff954002f70 tx=0x7ff954007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff9694c6700 1 --2- 172.21.15.63:0/2079777527 >> v2:172.21.15.63:3300/0 conn(0x7ff9640ad180 0x7ff964061fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff954002f70 tx=0x7ff954007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff9694c6700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9640ad180 0x7ff964061fe0 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7ff954002f70 tx=0x7ff954007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:55.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff9694c6700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9640ad180 0x7ff964061fe0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7ff954002f70 tx=0x7ff954007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff9694c6700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9640ad180 0x7ff964061fe0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7ff954002f70 tx=0x7ff954007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff952ffd700 1 -- 172.21.15.63:0/2079777527 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff954007170 con 0x7ff9640ad180 2020-05-18T21:26:55.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff9694c6700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9640ad180 0x7ff964061fe0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7ff954002f70 tx=0x7ff954007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff952ffd700 1 -- 172.21.15.63:0/2079777527 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9540072d0 con 0x7ff9640ad180 2020-05-18T21:26:55.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff96acc9700 1 -- 172.21.15.63:0/2079777527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9640b2480 con 0x7ff9640ad180 2020-05-18T21:26:55.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff952ffd700 1 -- 172.21.15.63:0/2079777527 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff954005700 con 0x7ff9640ad180 2020-05-18T21:26:55.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff96acc9700 1 -- 172.21.15.63:0/2079777527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff964063850 con 0x7ff9640ad180 2020-05-18T21:26:55.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.283+0000 7ff9694c6700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9640ad180 0x7ff964061fe0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7ff954002f70 tx=0x7ff954007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.287+0000 7ff96acc9700 1 -- 172.21.15.63:0/2079777527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9640569e0 con 0x7ff9640ad180 2020-05-18T21:26:55.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.287+0000 7ff952ffd700 1 -- 172.21.15.63:0/2079777527 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff954005970 con 0x7ff9640ad180 2020-05-18T21:26:55.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.287+0000 7ff9694c6700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9640ad180 0x7ff964061fe0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7ff954002f70 tx=0x7ff954007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.287+0000 7ff952ffd700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff94404fd80 0x7ff944052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:55.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.287+0000 7ff952ffd700 1 -- 172.21.15.63:0/2079777527 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff9540643b0 con 0x7ff9640ad180 2020-05-18T21:26:55.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.287+0000 7ff969cc7700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff94404fd80 0x7ff944052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:55.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.287+0000 7ff969cc7700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff94404fd80 0x7ff944052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff960000ed0 tx=0x7ff960001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.287+0000 7ff969cc7700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff94404fd80 0x7ff944052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff960000ed0 tx=0x7ff960001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.287+0000 7ff969cc7700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff94404fd80 0x7ff944052240 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7ff960000ed0 tx=0x7ff960001760).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:55.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.291+0000 7ff9694c6700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9640ad180 0x7ff964061fe0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7ff954002f70 tx=0x7ff954007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.291+0000 7ff952ffd700 1 -- 172.21.15.63:0/2079777527 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff95403e860 con 0x7ff9640ad180 2020-05-18T21:26:55.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.411+0000 7ff96acc9700 1 -- 172.21.15.63:0/2079777527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff964060790 con 0x7ff9640ad180 2020-05-18T21:26:55.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.411+0000 7ff9694c6700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9640ad180 0x7ff964061fe0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7ff954002f70 tx=0x7ff954007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.411+0000 7ff952ffd700 1 -- 172.21.15.63:0/2079777527 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16089 (secure 0 0 0) 0x7ff954041e80 con 0x7ff9640ad180 2020-05-18T21:26:55.416 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:26:55.417 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":23,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:26:47.498250+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:26:43.453504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-05-18T21:26:44.456531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:26:55.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.415+0000 7ff96acc9700 1 -- 172.21.15.63:0/2079777527 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff94404fd80 msgr2=0x7ff944052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.415+0000 7ff96acc9700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff94404fd80 0x7ff944052240 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7ff960000ed0 tx=0x7ff960001760).stop 2020-05-18T21:26:55.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.415+0000 7ff96acc9700 1 -- 172.21.15.63:0/2079777527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9640ad180 msgr2=0x7ff964061fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.415+0000 7ff96acc9700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9640ad180 0x7ff964061fe0 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7ff954002f70 tx=0x7ff954007a80).stop 2020-05-18T21:26:55.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.415+0000 7ff96acc9700 1 -- 172.21.15.63:0/2079777527 shutdown_connections 2020-05-18T21:26:55.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.415+0000 7ff96acc9700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff94404fd80 0x7ff944052240 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.415+0000 7ff96acc9700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9641435d0 0x7ff96413aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.415+0000 7ff96acc9700 1 --2- 172.21.15.63:0/2079777527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9640ad180 0x7ff964061fe0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.415+0000 7ff96acc9700 1 -- 172.21.15.63:0/2079777527 >> 172.21.15.63:0/2079777527 conn(0x7ff964069fc0 msgr2=0x7ff964064db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:55.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.415+0000 7ff96acc9700 1 -- 172.21.15.63:0/2079777527 shutdown_connections 2020-05-18T21:26:55.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.415+0000 7ff96acc9700 1 -- 172.21.15.63:0/2079777527 wait complete. 2020-05-18T21:26:55.429 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:26:43.453504+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:26:44.456531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:26:55.431 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:26:55.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.543+0000 7f929e070700 1 Processor -- start 2020-05-18T21:26:55.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.543+0000 7f929e070700 1 -- start start 2020-05-18T21:26:55.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f929e070700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9298143430 0x7f9298145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:55.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f929e070700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f92980b6d70 0x7f92980b9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:55.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f929e070700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9298143810 con 0x7f92980b7bf0 2020-05-18T21:26:55.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f929e070700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92980b7210 con 0x7f92980b6d70 2020-05-18T21:26:55.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f929e070700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92980b74b0 con 0x7f9298143430 2020-05-18T21:26:55.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f9296ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f92980b6d70 0x7f92980b9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:55.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f9296ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f92980b6d70 0x7f92980b9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52978/0 (socket says 172.21.15.63:52978) 2020-05-18T21:26:55.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f9296ffd700 1 -- 172.21.15.63:0/895236060 learned_addr learned my addr 172.21.15.63:0/895236060 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:55.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f92977fe700 1 --2- 172.21.15.63:0/895236060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9298143430 0x7f9298145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:55.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f92977fe700 1 -- 172.21.15.63:0/895236060 >> v2:172.21.15.63:3300/0 conn(0x7f92980b6d70 msgr2=0x7f92980b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:55.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f92977fe700 1 --2- 172.21.15.63:0/895236060 >> v2:172.21.15.63:3300/0 conn(0x7f92980b6d70 0x7f92980b9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:55.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f92977fe700 1 -- 172.21.15.63:0/895236060 >> v1:172.21.15.155:6789/0 conn(0x7f92980b7bf0 legacy=0x7f92981493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f92967fc700 1 -- 172.21.15.63:0/895236060 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3196485527 0 0) 0x7f9298143810 con 0x7f92980b7bf0 2020-05-18T21:26:55.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f92977fe700 1 -- 172.21.15.63:0/895236060 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92980b7750 con 0x7f9298143430 2020-05-18T21:26:55.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f9296ffd700 1 --2- 172.21.15.63:0/895236060 >> v2:172.21.15.63:3300/0 conn(0x7f92980b6d70 0x7f92980b9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:26:55.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f92977fe700 1 --2- 172.21.15.63:0/895236060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9298143430 0x7f9298145dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9288002f70 tx=0x7f9288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f92977fe700 1 --2- 172.21.15.63:0/895236060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9298143430 0x7f9298145dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9288002f70 tx=0x7f9288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f92977fe700 1 --2- 172.21.15.63:0/895236060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9298143430 0x7f9298145dd0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f9288002f70 tx=0x7f9288007a80).ready entity=mon.2 client_cookie=701942a5d469f137 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:55.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f92977fe700 1 --2- 172.21.15.63:0/895236060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9298143430 0x7f9298145dd0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f9288002f70 tx=0x7f9288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f92967fc700 1 -- 172.21.15.63:0/895236060 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9288008e80 con 0x7f9298143430 2020-05-18T21:26:55.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f92977fe700 1 --2- 172.21.15.63:0/895236060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9298143430 0x7f9298145dd0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f9288002f70 tx=0x7f9288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f92977fe700 1 --2- 172.21.15.63:0/895236060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9298143430 0x7f9298145dd0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f9288002f70 tx=0x7f9288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f92967fc700 1 -- 172.21.15.63:0/895236060 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92880115f0 con 0x7f9298143430 2020-05-18T21:26:55.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f92967fc700 1 -- 172.21.15.63:0/895236060 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92880119d0 con 0x7f9298143430 2020-05-18T21:26:55.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f929e070700 1 -- 172.21.15.63:0/895236060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9298143430 msgr2=0x7f9298145dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f929e070700 1 --2- 172.21.15.63:0/895236060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9298143430 0x7f9298145dd0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f9288002f70 tx=0x7f9288007a80).stop 2020-05-18T21:26:55.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f929e070700 1 -- 172.21.15.63:0/895236060 shutdown_connections 2020-05-18T21:26:55.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f929e070700 1 --2- 172.21.15.63:0/895236060 >> v2:172.21.15.63:3300/0 conn(0x7f92980b6d70 0x7f92980b9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:55.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f929e070700 1 --2- 172.21.15.63:0/895236060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9298143430 0x7f9298145dd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f929e070700 1 -- 172.21.15.63:0/895236060 >> 172.21.15.63:0/895236060 conn(0x7f9298069b70 msgr2=0x7f9298069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:55.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f929e070700 1 -- 172.21.15.63:0/895236060 shutdown_connections 2020-05-18T21:26:55.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.547+0000 7f929e070700 1 -- 172.21.15.63:0/895236060 wait complete. 2020-05-18T21:26:55.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f929e070700 1 Processor -- start 2020-05-18T21:26:55.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f929e070700 1 -- start start 2020-05-18T21:26:55.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f929e070700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f92980b6d70 0x7f9298153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:55.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f929e070700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f92980b7bf0 0x7f9298143c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:55.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f929e070700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9298153290 con 0x7f9298143430 2020-05-18T21:26:55.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f929e070700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9298153530 con 0x7f92980b6d70 2020-05-18T21:26:55.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f929e070700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92981537d0 con 0x7f92980b7bf0 2020-05-18T21:26:55.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f92977fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f92980b6d70 0x7f9298153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:55.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f92977fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f92980b6d70 0x7f9298153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52980/0 (socket says 172.21.15.63:52980) 2020-05-18T21:26:55.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f92977fe700 1 -- 172.21.15.63:0/2149328075 learned_addr learned my addr 172.21.15.63:0/2149328075 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:55.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f9296ffd700 1 --2- 172.21.15.63:0/2149328075 >> v2:172.21.15.155:3300/0 conn(0x7f92980b7bf0 0x7f9298143c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:55.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f92977fe700 1 -- 172.21.15.63:0/2149328075 >> v2:172.21.15.155:3300/0 conn(0x7f92980b7bf0 msgr2=0x7f9298143c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f92977fe700 1 --2- 172.21.15.63:0/2149328075 >> v2:172.21.15.155:3300/0 conn(0x7f92980b7bf0 0x7f9298143c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f92977fe700 1 -- 172.21.15.63:0/2149328075 >> v1:172.21.15.155:6789/0 conn(0x7f9298143430 legacy=0x7f92980b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f92977fe700 1 -- 172.21.15.63:0/2149328075 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92980b1fd0 con 0x7f92980b6d70 2020-05-18T21:26:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f92977fe700 1 --2- 172.21.15.63:0/2149328075 >> v2:172.21.15.63:3300/0 conn(0x7f92980b6d70 0x7f9298153c70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9288002f70 tx=0x7f9288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f92977fe700 1 --2- 172.21.15.63:0/2149328075 >> v2:172.21.15.63:3300/0 conn(0x7f92980b6d70 0x7f9298153c70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9288002f70 tx=0x7f9288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f92977fe700 1 --2- 172.21.15.63:0/2149328075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92980b6d70 0x7f9298153c70 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7f9288002f70 tx=0x7f9288007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:55.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f92977fe700 1 --2- 172.21.15.63:0/2149328075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92980b6d70 0x7f9298153c70 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f9288002f70 tx=0x7f9288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f92977fe700 1 --2- 172.21.15.63:0/2149328075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92980b6d70 0x7f9298153c70 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f9288002f70 tx=0x7f9288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f9294ff9700 1 -- 172.21.15.63:0/2149328075 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f928800f860 con 0x7f92980b6d70 2020-05-18T21:26:55.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f92977fe700 1 --2- 172.21.15.63:0/2149328075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92980b6d70 0x7f9298153c70 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f9288002f70 tx=0x7f9288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f9294ff9700 1 -- 172.21.15.63:0/2149328075 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9288011a20 con 0x7f92980b6d70 2020-05-18T21:26:55.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f9294ff9700 1 -- 172.21.15.63:0/2149328075 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9288007550 con 0x7f92980b6d70 2020-05-18T21:26:55.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f929e070700 1 -- 172.21.15.63:0/2149328075 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92981540d0 con 0x7f92980b6d70 2020-05-18T21:26:55.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.551+0000 7f929e070700 1 -- 172.21.15.63:0/2149328075 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92980b2c80 con 0x7f92980b6d70 2020-05-18T21:26:55.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.555+0000 7f92977fe700 1 --2- 172.21.15.63:0/2149328075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92980b6d70 0x7f9298153c70 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f9288002f70 tx=0x7f9288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.555+0000 7f929e070700 1 -- 172.21.15.63:0/2149328075 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92981443f0 con 0x7f92980b6d70 2020-05-18T21:26:55.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.555+0000 7f9294ff9700 1 -- 172.21.15.63:0/2149328075 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9288005700 con 0x7f92980b6d70 2020-05-18T21:26:55.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.555+0000 7f92977fe700 1 --2- 172.21.15.63:0/2149328075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92980b6d70 0x7f9298153c70 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f9288002f70 tx=0x7f9288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.555+0000 7f9294ff9700 1 --2- 172.21.15.63:0/2149328075 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f927c04fa20 0x7f927c051ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:55.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.555+0000 7f9294ff9700 1 -- 172.21.15.63:0/2149328075 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9288064040 con 0x7f92980b6d70 2020-05-18T21:26:55.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.555+0000 7f9296ffd700 1 --2- 172.21.15.63:0/2149328075 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f927c04fa20 0x7f927c051ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:55.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.555+0000 7f9296ffd700 1 --2- 172.21.15.63:0/2149328075 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f927c04fa20 0x7f927c051ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9280002f70 tx=0x7f9280008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.555+0000 7f9296ffd700 1 --2- 172.21.15.63:0/2149328075 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f927c04fa20 0x7f927c051ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9280002f70 tx=0x7f9280008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.555+0000 7f9296ffd700 1 --2- 172.21.15.63:0/2149328075 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f927c04fa20 0x7f927c051ee0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f9280002f70 tx=0x7f9280008020).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:55.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.559+0000 7f92977fe700 1 --2- 172.21.15.63:0/2149328075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92980b6d70 0x7f9298153c70 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f9288002f70 tx=0x7f9288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.563+0000 7f9294ff9700 1 -- 172.21.15.63:0/2149328075 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f928803e4f0 con 0x7f92980b6d70 2020-05-18T21:26:55.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.679+0000 7f929e070700 1 -- 172.21.15.63:0/2149328075 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f92980569e0 con 0x7f92980b6d70 2020-05-18T21:26:55.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.683+0000 7f92977fe700 1 --2- 172.21.15.63:0/2149328075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92980b6d70 0x7f9298153c70 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f9288002f70 tx=0x7f9288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.683+0000 7f9294ff9700 1 -- 172.21.15.63:0/2149328075 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9288041b10 con 0x7f92980b6d70 2020-05-18T21:26:55.685 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:26:55.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.683+0000 7f929e070700 1 -- 172.21.15.63:0/2149328075 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f927c04fa20 msgr2=0x7f927c051ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.683+0000 7f929e070700 1 --2- 172.21.15.63:0/2149328075 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f927c04fa20 0x7f927c051ee0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f9280002f70 tx=0x7f9280008020).stop 2020-05-18T21:26:55.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.683+0000 7f929e070700 1 -- 172.21.15.63:0/2149328075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92980b6d70 msgr2=0x7f9298153c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.683+0000 7f929e070700 1 --2- 172.21.15.63:0/2149328075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92980b6d70 0x7f9298153c70 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7f9288002f70 tx=0x7f9288007a80).stop 2020-05-18T21:26:55.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.683+0000 7f929e070700 1 -- 172.21.15.63:0/2149328075 shutdown_connections 2020-05-18T21:26:55.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.683+0000 7f929e070700 1 --2- 172.21.15.63:0/2149328075 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f927c04fa20 0x7f927c051ee0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.683+0000 7f929e070700 1 --2- 172.21.15.63:0/2149328075 >> v2:172.21.15.155:3300/0 conn(0x7f92980b7bf0 0x7f9298143c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.683+0000 7f929e070700 1 --2- 172.21.15.63:0/2149328075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92980b6d70 0x7f9298153c70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.683+0000 7f929e070700 1 -- 172.21.15.63:0/2149328075 >> 172.21.15.63:0/2149328075 conn(0x7f9298069b70 msgr2=0x7f92980bbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:55.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.683+0000 7f929e070700 1 -- 172.21.15.63:0/2149328075 shutdown_connections 2020-05-18T21:26:55.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.683+0000 7f929e070700 1 -- 172.21.15.63:0/2149328075 wait complete. 2020-05-18T21:26:55.703 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:26:55.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3ddc46700 1 Processor -- start 2020-05-18T21:26:55.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3ddc46700 1 -- start start 2020-05-18T21:26:55.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3ddc46700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb3d80b8630 0x7fb3d80b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:55.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3ddc46700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb3d80b42b0 0x7fb3d80b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:55.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3ddc46700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d80b4ba0 con 0x7fb3d80b9500 2020-05-18T21:26:55.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3ddc46700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d8060890 con 0x7fb3d80b42b0 2020-05-18T21:26:55.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3ddc46700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d8060b30 con 0x7fb3d80b8630 2020-05-18T21:26:55.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3d77fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb3d80b9500 0x7fb3d8061270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55176/0 (socket says 172.21.15.63:55176) 2020-05-18T21:26:55.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3d77fe700 1 -- 172.21.15.63:0/2780310867 learned_addr learned my addr 172.21.15.63:0/2780310867 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:55.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2780310867 >> v2:172.21.15.63:3300/0 conn(0x7fb3d80b42b0 0x7fb3d80b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:55.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3ceffd700 1 --2- 172.21.15.63:0/2780310867 >> v2:172.21.15.155:3300/0 conn(0x7fb3d80b8630 0x7fb3d80b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:55.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3d6ffd700 1 -- 172.21.15.63:0/2780310867 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041950002 0 0) 0x7fb3d80b4ba0 con 0x7fb3d80b9500 2020-05-18T21:26:55.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3d6ffd700 1 -- 172.21.15.63:0/2780310867 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3b8003270 con 0x7fb3d80b9500 2020-05-18T21:26:55.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3d7fff700 1 -- 172.21.15.63:0/2780310867 >> v2:172.21.15.155:3300/0 conn(0x7fb3d80b8630 msgr2=0x7fb3d80b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:55.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2780310867 >> v2:172.21.15.155:3300/0 conn(0x7fb3d80b8630 0x7fb3d80b6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:55.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3d7fff700 1 -- 172.21.15.63:0/2780310867 >> v1:172.21.15.63:6789/0 conn(0x7fb3d80b9500 legacy=0x7fb3d8061270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3d7fff700 1 -- 172.21.15.63:0/2780310867 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d8060dd0 con 0x7fb3d80b42b0 2020-05-18T21:26:55.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3ceffd700 1 --2- 172.21.15.63:0/2780310867 >> v2:172.21.15.155:3300/0 conn(0x7fb3d80b8630 0x7fb3d80b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:26:55.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2780310867 >> v2:172.21.15.63:3300/0 conn(0x7fb3d80b42b0 0x7fb3d80b4740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb3d80b8000 tx=0x7fb3d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2780310867 >> v2:172.21.15.63:3300/0 conn(0x7fb3d80b42b0 0x7fb3d80b4740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb3d80b8000 tx=0x7fb3d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2780310867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d80b42b0 0x7fb3d80b4740 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7fb3d80b8000 tx=0x7fb3d0007e00).ready entity=mon.0 client_cookie=5bff4af8bb2a7bf1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:55.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2780310867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d80b42b0 0x7fb3d80b4740 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fb3d80b8000 tx=0x7fb3d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3d6ffd700 1 -- 172.21.15.63:0/2780310867 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3d0011e20 con 0x7fb3d80b42b0 2020-05-18T21:26:55.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2780310867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d80b42b0 0x7fb3d80b4740 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fb3d80b8000 tx=0x7fb3d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2780310867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d80b42b0 0x7fb3d80b4740 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fb3d80b8000 tx=0x7fb3d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3d6ffd700 1 -- 172.21.15.63:0/2780310867 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d000a180 con 0x7fb3d80b42b0 2020-05-18T21:26:55.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.807+0000 7fb3d6ffd700 1 -- 172.21.15.63:0/2780310867 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3d000a5a0 con 0x7fb3d80b42b0 2020-05-18T21:26:55.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3ddc46700 1 -- 172.21.15.63:0/2780310867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d80b42b0 msgr2=0x7fb3d80b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3ddc46700 1 --2- 172.21.15.63:0/2780310867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d80b42b0 0x7fb3d80b4740 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7fb3d80b8000 tx=0x7fb3d0007e00).stop 2020-05-18T21:26:55.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3ddc46700 1 -- 172.21.15.63:0/2780310867 shutdown_connections 2020-05-18T21:26:55.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3ddc46700 1 --2- 172.21.15.63:0/2780310867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d80b42b0 0x7fb3d80b4740 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3ddc46700 1 --2- 172.21.15.63:0/2780310867 >> v2:172.21.15.155:3300/0 conn(0x7fb3d80b8630 0x7fb3d80b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:55.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3ddc46700 1 -- 172.21.15.63:0/2780310867 >> 172.21.15.63:0/2780310867 conn(0x7fb3d8069b70 msgr2=0x7fb3d8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:55.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3ddc46700 1 -- 172.21.15.63:0/2780310867 shutdown_connections 2020-05-18T21:26:55.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3ddc46700 1 -- 172.21.15.63:0/2780310867 wait complete. 2020-05-18T21:26:55.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3ddc46700 1 Processor -- start 2020-05-18T21:26:55.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3ddc46700 1 -- start start 2020-05-18T21:26:55.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3ddc46700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3d80b42b0 0x7fb3d80b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:55.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3ddc46700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb3d80b8630 0x7fb3d80af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:55.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3ddc46700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb3d80b9500 0x7fb3d8156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:55.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3ddc46700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d80b27b0 con 0x7fb3d80b9500 2020-05-18T21:26:55.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3ddc46700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d80b3560 con 0x7fb3d80b8630 2020-05-18T21:26:55.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3ddc46700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d8157320 con 0x7fb3d80b42b0 2020-05-18T21:26:55.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3d7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb3d80b9500 0x7fb3d8156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:55.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3d7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb3d80b9500 0x7fb3d8156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52998/0 (socket says 172.21.15.63:52998) 2020-05-18T21:26:55.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3d7fff700 1 -- 172.21.15.63:0/2421947830 learned_addr learned my addr 172.21.15.63:0/2421947830 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:55.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3ceffd700 1 --2- 172.21.15.63:0/2421947830 >> v2:172.21.15.155:3300/0 conn(0x7fb3d80b8630 0x7fb3d80af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:55.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3d77fe700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3d80b42b0 0x7fb3d80b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:55.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3d7fff700 1 -- 172.21.15.63:0/2421947830 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3d80b42b0 msgr2=0x7fb3d80b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3d80b42b0 0x7fb3d80b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3d7fff700 1 -- 172.21.15.63:0/2421947830 >> v2:172.21.15.155:3300/0 conn(0x7fb3d80b8630 msgr2=0x7fb3d80af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2421947830 >> v2:172.21.15.155:3300/0 conn(0x7fb3d80b8630 0x7fb3d80af710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.811+0000 7fb3d7fff700 1 -- 172.21.15.63:0/2421947830 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d80b2990 con 0x7fb3d80b9500 2020-05-18T21:26:55.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3d77fe700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3d80b42b0 0x7fb3d80b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:26:55.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2421947830 >> v2:172.21.15.63:3300/0 conn(0x7fb3d80b9500 0x7fb3d8156960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb3d80b8000 tx=0x7fb3d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2421947830 >> v2:172.21.15.63:3300/0 conn(0x7fb3d80b9500 0x7fb3d8156960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb3d80b8000 tx=0x7fb3d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d80b9500 0x7fb3d8156960 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7fb3d80b8000 tx=0x7fb3d0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:55.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d80b9500 0x7fb3d8156960 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7fb3d80b8000 tx=0x7fb3d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d80b9500 0x7fb3d8156960 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7fb3d80b8000 tx=0x7fb3d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d80b9500 0x7fb3d8156960 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7fb3d80b8000 tx=0x7fb3d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3d57fa700 1 -- 172.21.15.63:0/2421947830 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3d0005c70 con 0x7fb3d80b9500 2020-05-18T21:26:55.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3d57fa700 1 -- 172.21.15.63:0/2421947830 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d0005dd0 con 0x7fb3d80b9500 2020-05-18T21:26:55.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3ddc46700 1 -- 172.21.15.63:0/2421947830 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d80afb70 con 0x7fb3d80b9500 2020-05-18T21:26:55.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3d57fa700 1 -- 172.21.15.63:0/2421947830 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3d00112c0 con 0x7fb3d80b9500 2020-05-18T21:26:55.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3ddc46700 1 -- 172.21.15.63:0/2421947830 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d80b23f0 con 0x7fb3d80b9500 2020-05-18T21:26:55.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d80b9500 0x7fb3d8156960 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7fb3d80b8000 tx=0x7fb3d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3d57fa700 1 -- 172.21.15.63:0/2421947830 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb3d0011420 con 0x7fb3d80b9500 2020-05-18T21:26:55.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d80b9500 0x7fb3d8156960 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7fb3d80b8000 tx=0x7fb3d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3ddc46700 1 -- 172.21.15.63:0/2421947830 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d80569e0 con 0x7fb3d80b9500 2020-05-18T21:26:55.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3d57fa700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb3bc04fac0 0x7fb3bc051f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:55.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3d57fa700 1 -- 172.21.15.63:0/2421947830 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb3d0064690 con 0x7fb3d80b9500 2020-05-18T21:26:55.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3d77fe700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb3bc04fac0 0x7fb3bc051f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:55.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3d77fe700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb3bc04fac0 0x7fb3bc051f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb3c8001110 tx=0x7fb3c8001770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3d77fe700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb3bc04fac0 0x7fb3bc051f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb3c8001110 tx=0x7fb3c8001770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.815+0000 7fb3d77fe700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb3bc04fac0 0x7fb3bc051f80 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7fb3c8001110 tx=0x7fb3c8001770).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:55.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.823+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d80b9500 0x7fb3d8156960 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7fb3d80b8000 tx=0x7fb3d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.823+0000 7fb3d57fa700 1 -- 172.21.15.63:0/2421947830 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb3d003ea80 con 0x7fb3d80b9500 2020-05-18T21:26:55.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.931+0000 7fb3ddc46700 1 -- 172.21.15.63:0/2421947830 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb3d8157100 con 0x7fb3d80b9500 2020-05-18T21:26:55.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.935+0000 7fb3d7fff700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d80b9500 0x7fb3d8156960 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7fb3d80b8000 tx=0x7fb3d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:55.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.935+0000 7fb3d57fa700 1 -- 172.21.15.63:0/2421947830 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb3d00420a0 con 0x7fb3d80b9500 2020-05-18T21:26:55.937 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:26:55.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.935+0000 7fb3ddc46700 1 -- 172.21.15.63:0/2421947830 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb3bc04fac0 msgr2=0x7fb3bc051f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.935+0000 7fb3ddc46700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb3bc04fac0 0x7fb3bc051f80 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7fb3c8001110 tx=0x7fb3c8001770).stop 2020-05-18T21:26:55.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.935+0000 7fb3ddc46700 1 -- 172.21.15.63:0/2421947830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d80b9500 msgr2=0x7fb3d8156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:55.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.935+0000 7fb3ddc46700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d80b9500 0x7fb3d8156960 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7fb3d80b8000 tx=0x7fb3d0007e00).stop 2020-05-18T21:26:55.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.935+0000 7fb3ddc46700 1 -- 172.21.15.63:0/2421947830 shutdown_connections 2020-05-18T21:26:55.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.935+0000 7fb3ddc46700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb3bc04fac0 0x7fb3bc051f80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.935+0000 7fb3ddc46700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d80b9500 0x7fb3d8156960 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.935+0000 7fb3ddc46700 1 --2- 172.21.15.63:0/2421947830 >> v2:172.21.15.155:3300/0 conn(0x7fb3d80b8630 0x7fb3d80af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.935+0000 7fb3ddc46700 1 --2- 172.21.15.63:0/2421947830 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3d80b42b0 0x7fb3d80b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:55.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.935+0000 7fb3ddc46700 1 -- 172.21.15.63:0/2421947830 >> 172.21.15.63:0/2421947830 conn(0x7fb3d8069b70 msgr2=0x7fb3d80b5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:55.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.935+0000 7fb3ddc46700 1 -- 172.21.15.63:0/2421947830 shutdown_connections 2020-05-18T21:26:55.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:55.935+0000 7fb3ddc46700 1 -- 172.21.15.63:0/2421947830 wait complete. 2020-05-18T21:26:55.949 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:26:56.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.051+0000 7f006b59e700 1 Processor -- start 2020-05-18T21:26:56.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.051+0000 7f006b59e700 1 -- start start 2020-05-18T21:26:56.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.051+0000 7f006b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f006c0b62a0 0x7f006c0b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:56.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.051+0000 7f006b59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f006c09f4c0 0x7f006c146c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:56.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.051+0000 7f006b59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006c146580 con 0x7f006c1470b0 2020-05-18T21:26:56.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.051+0000 7f006b59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006c062300 con 0x7f006c0b62a0 2020-05-18T21:26:56.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.051+0000 7f006b59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006c1467b0 con 0x7f006c09f4c0 2020-05-18T21:26:56.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.051+0000 7f006a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f006c0b62a0 0x7f006c0b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:56.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.051+0000 7f006ad9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f006c1470b0 0x7f006c12bd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55194/0 (socket says 172.21.15.63:55194) 2020-05-18T21:26:56.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.051+0000 7f006ad9d700 1 -- 172.21.15.63:0/1503276630 learned_addr learned my addr 172.21.15.63:0/1503276630 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:56.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.051+0000 7f0069d9b700 1 --2- 172.21.15.63:0/1503276630 >> v2:172.21.15.155:3300/0 conn(0x7f006c09f4c0 0x7f006c146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:56.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.051+0000 7f006959a700 1 -- 172.21.15.63:0/1503276630 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690181456 0 0) 0x7f006c146580 con 0x7f006c1470b0 2020-05-18T21:26:56.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.051+0000 7f006959a700 1 -- 172.21.15.63:0/1503276630 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0050003270 con 0x7f006c1470b0 2020-05-18T21:26:56.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.051+0000 7f006a59c700 1 -- 172.21.15.63:0/1503276630 >> v2:172.21.15.155:3300/0 conn(0x7f006c09f4c0 msgr2=0x7f006c146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:56.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.051+0000 7f006a59c700 1 --2- 172.21.15.63:0/1503276630 >> v2:172.21.15.155:3300/0 conn(0x7f006c09f4c0 0x7f006c146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:56.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.051+0000 7f006a59c700 1 -- 172.21.15.63:0/1503276630 >> v1:172.21.15.63:6789/0 conn(0x7f006c1470b0 legacy=0x7f006c12bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.051+0000 7f006a59c700 1 -- 172.21.15.63:0/1503276630 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c0b6680 con 0x7f006c0b62a0 2020-05-18T21:26:56.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.051+0000 7f0069d9b700 1 --2- 172.21.15.63:0/1503276630 >> v2:172.21.15.155:3300/0 conn(0x7f006c09f4c0 0x7f006c146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:26:56.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.055+0000 7f006a59c700 1 --2- 172.21.15.63:0/1503276630 >> v2:172.21.15.63:3300/0 conn(0x7f006c0b62a0 0x7f006c0b5a60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f006c0b5010 tx=0x7f005c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.055+0000 7f006a59c700 1 --2- 172.21.15.63:0/1503276630 >> v2:172.21.15.63:3300/0 conn(0x7f006c0b62a0 0x7f006c0b5a60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f006c0b5010 tx=0x7f005c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.055+0000 7f006a59c700 1 --2- 172.21.15.63:0/1503276630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f006c0b62a0 0x7f006c0b5a60 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f006c0b5010 tx=0x7f005c007a80).ready entity=mon.0 client_cookie=50d9910bb41e295a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:56.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.055+0000 7f006a59c700 1 --2- 172.21.15.63:0/1503276630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f006c0b62a0 0x7f006c0b5a60 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f006c0b5010 tx=0x7f005c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.055+0000 7f006959a700 1 -- 172.21.15.63:0/1503276630 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f005c008e80 con 0x7f006c0b62a0 2020-05-18T21:26:56.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.055+0000 7f006a59c700 1 --2- 172.21.15.63:0/1503276630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f006c0b62a0 0x7f006c0b5a60 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f006c0b5010 tx=0x7f005c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.055+0000 7f006959a700 1 -- 172.21.15.63:0/1503276630 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c011500 con 0x7f006c0b62a0 2020-05-18T21:26:56.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.055+0000 7f006a59c700 1 --2- 172.21.15.63:0/1503276630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f006c0b62a0 0x7f006c0b5a60 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f006c0b5010 tx=0x7f005c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.055+0000 7f006959a700 1 -- 172.21.15.63:0/1503276630 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f005c011920 con 0x7f006c0b62a0 2020-05-18T21:26:56.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.055+0000 7f006b59e700 1 -- 172.21.15.63:0/1503276630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f006c0b62a0 msgr2=0x7f006c0b5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.055+0000 7f006b59e700 1 --2- 172.21.15.63:0/1503276630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f006c0b62a0 0x7f006c0b5a60 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f006c0b5010 tx=0x7f005c007a80).stop 2020-05-18T21:26:56.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.055+0000 7f006b59e700 1 -- 172.21.15.63:0/1503276630 shutdown_connections 2020-05-18T21:26:56.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.055+0000 7f006b59e700 1 --2- 172.21.15.63:0/1503276630 >> v2:172.21.15.155:3300/0 conn(0x7f006c09f4c0 0x7f006c146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:56.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.055+0000 7f006b59e700 1 --2- 172.21.15.63:0/1503276630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f006c0b62a0 0x7f006c0b5a60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:56.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.055+0000 7f006b59e700 1 -- 172.21.15.63:0/1503276630 >> 172.21.15.63:0/1503276630 conn(0x7f006c05a7c0 msgr2=0x7f006c05aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:56.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.055+0000 7f006b59e700 1 -- 172.21.15.63:0/1503276630 shutdown_connections 2020-05-18T21:26:56.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.055+0000 7f006b59e700 1 -- 172.21.15.63:0/1503276630 wait complete. 2020-05-18T21:26:56.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006b59e700 1 Processor -- start 2020-05-18T21:26:56.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006b59e700 1 -- start start 2020-05-18T21:26:56.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f006c0b62a0 0x7f006c154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:56.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f006c1470b0 0x7f006c0af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:56.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006b59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006c151e30 con 0x7f006c09f4c0 2020-05-18T21:26:56.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006b59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006c1520d0 con 0x7f006c1470b0 2020-05-18T21:26:56.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006a59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f006c09f4c0 0x7f006c1431e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55196/0 (socket says 172.21.15.63:55196) 2020-05-18T21:26:56.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006a59c700 1 -- 172.21.15.63:0/356141258 learned_addr learned my addr 172.21.15.63:0/356141258 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:56.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006b59e700 1 -- 172.21.15.63:0/356141258 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006c152370 con 0x7f006c0b62a0 2020-05-18T21:26:56.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006ad9d700 1 --2- 172.21.15.63:0/356141258 >> v2:172.21.15.63:3300/0 conn(0x7f006c1470b0 0x7f006c0af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:56.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f0069d9b700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f006c0b62a0 0x7f006c154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:56.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f005b7fe700 1 -- 172.21.15.63:0/356141258 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277522340 0 0) 0x7f006c151e30 con 0x7f006c09f4c0 2020-05-18T21:26:56.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f005b7fe700 1 -- 172.21.15.63:0/356141258 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0048002fe0 con 0x7f006c09f4c0 2020-05-18T21:26:56.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006ad9d700 1 -- 172.21.15.63:0/356141258 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f006c0b62a0 msgr2=0x7f006c154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f005b7fe700 1 -- 172.21.15.63:0/356141258 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1491800876 0 0) 0x7f0048002fe0 con 0x7f006c09f4c0 2020-05-18T21:26:56.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006ad9d700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f006c0b62a0 0x7f006c154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:56.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006ad9d700 1 -- 172.21.15.63:0/356141258 >> v1:172.21.15.63:6789/0 conn(0x7f006c09f4c0 legacy=0x7f006c1431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006ad9d700 1 -- 172.21.15.63:0/356141258 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c1438f0 con 0x7f006c1470b0 2020-05-18T21:26:56.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006ad9d700 1 --2- 172.21.15.63:0/356141258 >> v2:172.21.15.63:3300/0 conn(0x7f006c1470b0 0x7f006c0af900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f005c007ae0 tx=0x7f0064010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006ad9d700 1 --2- 172.21.15.63:0/356141258 >> v2:172.21.15.63:3300/0 conn(0x7f006c1470b0 0x7f006c0af900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f005c007ae0 tx=0x7f0064010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006ad9d700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f006c1470b0 0x7f006c0af900 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7f005c007ae0 tx=0x7f0064010890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:56.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006ad9d700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f006c1470b0 0x7f006c0af900 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f005c007ae0 tx=0x7f0064010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006ad9d700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f006c1470b0 0x7f006c0af900 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f005c007ae0 tx=0x7f0064010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f005b7fe700 1 -- 172.21.15.63:0/356141258 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f005c008e80 con 0x7f006c1470b0 2020-05-18T21:26:56.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006ad9d700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f006c1470b0 0x7f006c0af900 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f005c007ae0 tx=0x7f0064010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f005b7fe700 1 -- 172.21.15.63:0/356141258 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0064005b10 con 0x7f006c1470b0 2020-05-18T21:26:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f006b59e700 1 -- 172.21.15.63:0/356141258 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006c143ba0 con 0x7f006c1470b0 2020-05-18T21:26:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.059+0000 7f005b7fe700 1 -- 172.21.15.63:0/356141258 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00640060d0 con 0x7f006c1470b0 2020-05-18T21:26:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.063+0000 7f006b59e700 1 -- 172.21.15.63:0/356141258 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f006c0b9ba0 con 0x7f006c1470b0 2020-05-18T21:26:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.063+0000 7f006ad9d700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f006c1470b0 0x7f006c0af900 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f005c007ae0 tx=0x7f0064010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.063+0000 7f006b59e700 1 -- 172.21.15.63:0/356141258 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f006c0569e0 con 0x7f006c1470b0 2020-05-18T21:26:56.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.063+0000 7f005b7fe700 1 -- 172.21.15.63:0/356141258 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f006400a360 con 0x7f006c1470b0 2020-05-18T21:26:56.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.063+0000 7f006ad9d700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f006c1470b0 0x7f006c0af900 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f005c007ae0 tx=0x7f0064010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.063+0000 7f005b7fe700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f004804fd30 0x7f00480521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:56.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.063+0000 7f005b7fe700 1 -- 172.21.15.63:0/356141258 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f00640090c0 con 0x7f006c1470b0 2020-05-18T21:26:56.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.063+0000 7f006a59c700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f004804fd30 0x7f00480521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:56.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.063+0000 7f006a59c700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f004804fd30 0x7f00480521f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f005c007b20 tx=0x7f005c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.063+0000 7f006a59c700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f004804fd30 0x7f00480521f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f005c007b20 tx=0x7f005c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.063+0000 7f006a59c700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f004804fd30 0x7f00480521f0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f005c007b20 tx=0x7f005c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:56.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.071+0000 7f006ad9d700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f006c1470b0 0x7f006c0af900 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f005c007ae0 tx=0x7f0064010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.071+0000 7f005b7fe700 1 -- 172.21.15.63:0/356141258 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f006403da60 con 0x7f006c1470b0 2020-05-18T21:26:56.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.191+0000 7f006b59e700 1 -- 172.21.15.63:0/356141258 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f006c05b7d0 con 0x7f006c1470b0 2020-05-18T21:26:56.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.191+0000 7f006ad9d700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f006c1470b0 0x7f006c0af900 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f005c007ae0 tx=0x7f0064010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.191+0000 7f005b7fe700 1 -- 172.21.15.63:0/356141258 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f0064041080 con 0x7f006c1470b0 2020-05-18T21:26:56.195 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:26:56.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.195+0000 7f006b59e700 1 -- 172.21.15.63:0/356141258 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f004804fd30 msgr2=0x7f00480521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.195+0000 7f006b59e700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f004804fd30 0x7f00480521f0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f005c007b20 tx=0x7f005c007a80).stop 2020-05-18T21:26:56.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.195+0000 7f006b59e700 1 -- 172.21.15.63:0/356141258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f006c1470b0 msgr2=0x7f006c0af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.195+0000 7f006b59e700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f006c1470b0 0x7f006c0af900 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7f005c007ae0 tx=0x7f0064010890).stop 2020-05-18T21:26:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.195+0000 7f006b59e700 1 -- 172.21.15.63:0/356141258 shutdown_connections 2020-05-18T21:26:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.195+0000 7f006b59e700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f004804fd30 0x7f00480521f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.195+0000 7f006b59e700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f006c1470b0 0x7f006c0af900 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.195+0000 7f006b59e700 1 --2- 172.21.15.63:0/356141258 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f006c0b62a0 0x7f006c154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:56.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.195+0000 7f006b59e700 1 -- 172.21.15.63:0/356141258 >> 172.21.15.63:0/356141258 conn(0x7f006c05a7c0 msgr2=0x7f006c12adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:56.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.195+0000 7f006b59e700 1 -- 172.21.15.63:0/356141258 shutdown_connections 2020-05-18T21:26:56.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.195+0000 7f006b59e700 1 -- 172.21.15.63:0/356141258 wait complete. 2020-05-18T21:26:56.210 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:26:56.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd661282700 1 Processor -- start 2020-05-18T21:26:56.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd661282700 1 -- start start 2020-05-18T21:26:56.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd661282700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd65c0b68d0 0x7fd65c1469b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:56.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd661282700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65c145fd0 con 0x7fd65c149d40 2020-05-18T21:26:56.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd661282700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65c146270 con 0x7fd65c0b99d0 2020-05-18T21:26:56.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd661282700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd65c146510 con 0x7fd65c0b68d0 2020-05-18T21:26:56.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd65bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd65c0b68d0 0x7fd65c1469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:56.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd660a81700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd65c149d40 0x7fd65c060430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55208/0 (socket says 172.21.15.63:55208) 2020-05-18T21:26:56.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd660a81700 1 -- 172.21.15.63:0/1845432163 learned_addr learned my addr 172.21.15.63:0/1845432163 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:56.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd65bfff700 1 -- 172.21.15.63:0/1845432163 >> v1:172.21.15.155:6789/0 conn(0x7fd65c0b99d0 legacy=0x7fd65c0b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd65bfff700 1 -- 172.21.15.63:0/1845432163 >> v1:172.21.15.63:6789/0 conn(0x7fd65c149d40 legacy=0x7fd65c060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd65bfff700 1 -- 172.21.15.63:0/1845432163 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c14a1f0 con 0x7fd65c0b68d0 2020-05-18T21:26:56.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd65affd700 1 -- 172.21.15.63:0/1845432163 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291141272 0 0) 0x7fd65c145fd0 con 0x7fd65c149d40 2020-05-18T21:26:56.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd65bfff700 1 --2- 172.21.15.63:0/1845432163 >> v2:172.21.15.63:3300/0 conn(0x7fd65c0b68d0 0x7fd65c1469b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd64c002f70 tx=0x7fd64c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd65bfff700 1 --2- 172.21.15.63:0/1845432163 >> v2:172.21.15.63:3300/0 conn(0x7fd65c0b68d0 0x7fd65c1469b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd64c002f70 tx=0x7fd64c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd65bfff700 1 --2- 172.21.15.63:0/1845432163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd65c0b68d0 0x7fd65c1469b0 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7fd64c002f70 tx=0x7fd64c007a80).ready entity=mon.0 client_cookie=5a6d25e7fdf7244 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:56.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd65bfff700 1 --2- 172.21.15.63:0/1845432163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd65c0b68d0 0x7fd65c1469b0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fd64c002f70 tx=0x7fd64c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd65affd700 1 -- 172.21.15.63:0/1845432163 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd64c008e80 con 0x7fd65c0b68d0 2020-05-18T21:26:56.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd65bfff700 1 --2- 172.21.15.63:0/1845432163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd65c0b68d0 0x7fd65c1469b0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fd64c002f70 tx=0x7fd64c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd65bfff700 1 --2- 172.21.15.63:0/1845432163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd65c0b68d0 0x7fd65c1469b0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fd64c002f70 tx=0x7fd64c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd65affd700 1 -- 172.21.15.63:0/1845432163 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64c0116a0 con 0x7fd65c0b68d0 2020-05-18T21:26:56.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd65affd700 1 -- 172.21.15.63:0/1845432163 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd64c011ac0 con 0x7fd65c0b68d0 2020-05-18T21:26:56.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd661282700 1 -- 172.21.15.63:0/1845432163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd65c0b68d0 msgr2=0x7fd65c1469b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd661282700 1 --2- 172.21.15.63:0/1845432163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd65c0b68d0 0x7fd65c1469b0 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7fd64c002f70 tx=0x7fd64c007a80).stop 2020-05-18T21:26:56.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd661282700 1 -- 172.21.15.63:0/1845432163 shutdown_connections 2020-05-18T21:26:56.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd661282700 1 --2- 172.21.15.63:0/1845432163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd65c0b68d0 0x7fd65c1469b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:56.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd661282700 1 -- 172.21.15.63:0/1845432163 >> 172.21.15.63:0/1845432163 conn(0x7fd65c069b70 msgr2=0x7fd65c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:56.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd661282700 1 -- 172.21.15.63:0/1845432163 shutdown_connections 2020-05-18T21:26:56.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.315+0000 7fd661282700 1 -- 172.21.15.63:0/1845432163 wait complete. 2020-05-18T21:26:56.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.319+0000 7fd661282700 1 Processor -- start 2020-05-18T21:26:56.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.319+0000 7fd661282700 1 -- start start 2020-05-18T21:26:56.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.319+0000 7fd661282700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd65c0b68d0 0x7fd65c144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:56.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.319+0000 7fd661282700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd65c149d40 0x7fd65c156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:56.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.319+0000 7fd661282700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65c1447f0 con 0x7fd65c0b99d0 2020-05-18T21:26:56.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.319+0000 7fd661282700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd65c13ba60 con 0x7fd65c0b68d0 2020-05-18T21:26:56.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.319+0000 7fd661282700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c142860 con 0x7fd65c149d40 2020-05-18T21:26:56.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.319+0000 7fd65bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd65c0b68d0 0x7fd65c144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:56.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.319+0000 7fd65bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd65c0b68d0 0x7fd65c144ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53022/0 (socket says 172.21.15.63:53022) 2020-05-18T21:26:56.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.319+0000 7fd65bfff700 1 -- 172.21.15.63:0/3283269905 learned_addr learned my addr 172.21.15.63:0/3283269905 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:56.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.319+0000 7fd660a81700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd65c149d40 0x7fd65c156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:56.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.319+0000 7fd6597fa700 1 -- 172.21.15.63:0/3283269905 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723388462 0 0) 0x7fd65c1447f0 con 0x7fd65c0b99d0 2020-05-18T21:26:56.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd6597fa700 1 -- 172.21.15.63:0/3283269905 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd640002fe0 con 0x7fd65c0b99d0 2020-05-18T21:26:56.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd65bfff700 1 -- 172.21.15.63:0/3283269905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd65c149d40 msgr2=0x7fd65c156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd65bfff700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd65c149d40 0x7fd65c156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:56.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd65bfff700 1 -- 172.21.15.63:0/3283269905 >> v1:172.21.15.155:6789/0 conn(0x7fd65c0b99d0 legacy=0x7fd65c156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd65bfff700 1 -- 172.21.15.63:0/3283269905 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c144a20 con 0x7fd65c0b68d0 2020-05-18T21:26:56.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd65bfff700 1 --2- 172.21.15.63:0/3283269905 >> v2:172.21.15.63:3300/0 conn(0x7fd65c0b68d0 0x7fd65c144ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd64c002f70 tx=0x7fd64c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd65bfff700 1 --2- 172.21.15.63:0/3283269905 >> v2:172.21.15.63:3300/0 conn(0x7fd65c0b68d0 0x7fd65c144ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd64c002f70 tx=0x7fd64c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd65bfff700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd65c0b68d0 0x7fd65c144ec0 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7fd64c002f70 tx=0x7fd64c007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:56.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd65bfff700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd65c0b68d0 0x7fd65c144ec0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7fd64c002f70 tx=0x7fd64c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd65bfff700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd65c0b68d0 0x7fd65c144ec0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7fd64c002f70 tx=0x7fd64c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd6597fa700 1 -- 172.21.15.63:0/3283269905 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd64c007170 con 0x7fd65c0b68d0 2020-05-18T21:26:56.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd65bfff700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd65c0b68d0 0x7fd65c144ec0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7fd64c002f70 tx=0x7fd64c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd6597fa700 1 -- 172.21.15.63:0/3283269905 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64c0072d0 con 0x7fd65c0b68d0 2020-05-18T21:26:56.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd661282700 1 -- 172.21.15.63:0/3283269905 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65c149590 con 0x7fd65c0b68d0 2020-05-18T21:26:56.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd6597fa700 1 -- 172.21.15.63:0/3283269905 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd64c005700 con 0x7fd65c0b68d0 2020-05-18T21:26:56.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd661282700 1 -- 172.21.15.63:0/3283269905 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65c144590 con 0x7fd65c0b68d0 2020-05-18T21:26:56.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd65bfff700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd65c0b68d0 0x7fd65c144ec0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7fd64c002f70 tx=0x7fd64c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd661282700 1 -- 172.21.15.63:0/3283269905 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65c0569e0 con 0x7fd65c0b68d0 2020-05-18T21:26:56.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd6597fa700 1 -- 172.21.15.63:0/3283269905 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd64c005970 con 0x7fd65c0b68d0 2020-05-18T21:26:56.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd65bfff700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd65c0b68d0 0x7fd65c144ec0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7fd64c002f70 tx=0x7fd64c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd6597fa700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd64004fdb0 0x7fd640052270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:56.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.323+0000 7fd6597fa700 1 -- 172.21.15.63:0/3283269905 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd64c064500 con 0x7fd65c0b68d0 2020-05-18T21:26:56.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.327+0000 7fd65b7fe700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd64004fdb0 0x7fd640052270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:56.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.327+0000 7fd65b7fe700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd64004fdb0 0x7fd640052270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd644001040 tx=0x7fd6440026e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.327+0000 7fd65b7fe700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd64004fdb0 0x7fd640052270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd644001040 tx=0x7fd6440026e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.327+0000 7fd65b7fe700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd64004fdb0 0x7fd640052270 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7fd644001040 tx=0x7fd6440026e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:56.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.331+0000 7fd65bfff700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd65c0b68d0 0x7fd65c144ec0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7fd64c002f70 tx=0x7fd64c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.331+0000 7fd6597fa700 1 -- 172.21.15.63:0/3283269905 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd64c03e8f0 con 0x7fd65c0b68d0 2020-05-18T21:26:56.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.443+0000 7fd661282700 1 -- 172.21.15.63:0/3283269905 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd65c0008d0 con 0x7fd65c0b68d0 2020-05-18T21:26:56.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.443+0000 7fd65bfff700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd65c0b68d0 0x7fd65c144ec0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7fd64c002f70 tx=0x7fd64c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.443+0000 7fd6597fa700 1 -- 172.21.15.63:0/3283269905 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd64c041f10 con 0x7fd65c0b68d0 2020-05-18T21:26:56.448 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:26:56.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.447+0000 7fd661282700 1 -- 172.21.15.63:0/3283269905 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd64004fdb0 msgr2=0x7fd640052270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.447+0000 7fd661282700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd64004fdb0 0x7fd640052270 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7fd644001040 tx=0x7fd6440026e0).stop 2020-05-18T21:26:56.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.447+0000 7fd661282700 1 -- 172.21.15.63:0/3283269905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd65c0b68d0 msgr2=0x7fd65c144ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.447+0000 7fd661282700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd65c0b68d0 0x7fd65c144ec0 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7fd64c002f70 tx=0x7fd64c007a80).stop 2020-05-18T21:26:56.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.447+0000 7fd661282700 1 -- 172.21.15.63:0/3283269905 shutdown_connections 2020-05-18T21:26:56.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.447+0000 7fd661282700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd64004fdb0 0x7fd640052270 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:56.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.447+0000 7fd661282700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd65c149d40 0x7fd65c156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:56.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.447+0000 7fd661282700 1 --2- 172.21.15.63:0/3283269905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd65c0b68d0 0x7fd65c144ec0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:56.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.447+0000 7fd661282700 1 -- 172.21.15.63:0/3283269905 >> 172.21.15.63:0/3283269905 conn(0x7fd65c069b70 msgr2=0x7fd65c1455b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:56.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.447+0000 7fd661282700 1 -- 172.21.15.63:0/3283269905 shutdown_connections 2020-05-18T21:26:56.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.447+0000 7fd661282700 1 -- 172.21.15.63:0/3283269905 wait complete. 2020-05-18T21:26:56.460 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:26:56.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.559+0000 7f2a1d3ee700 1 Processor -- start 2020-05-18T21:26:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.559+0000 7f2a1d3ee700 1 -- start start 2020-05-18T21:26:56.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.559+0000 7f2a1d3ee700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2a180b2940 0x7f2a18146460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:56.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.559+0000 7f2a1d3ee700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a180b8650 con 0x7f2a180b81b0 2020-05-18T21:26:56.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.559+0000 7f2a1d3ee700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a180b88f0 con 0x7f2a1805f110 2020-05-18T21:26:56.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.559+0000 7f2a1d3ee700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a180b8b90 con 0x7f2a180b2940 2020-05-18T21:26:56.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.559+0000 7f2a177fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2a180b81b0 0x7f2a18145d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55218/0 (socket says 172.21.15.63:55218) 2020-05-18T21:26:56.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.559+0000 7f2a1cbed700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2a180b2940 0x7f2a18146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:56.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.559+0000 7f2a177fe700 1 -- 172.21.15.63:0/1228977890 learned_addr learned my addr 172.21.15.63:0/1228977890 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:56.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.559+0000 7f2a1cbed700 1 -- 172.21.15.63:0/1228977890 >> v1:172.21.15.155:6789/0 conn(0x7f2a1805f110 legacy=0x7f2a1812ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.559+0000 7f2a1cbed700 1 -- 172.21.15.63:0/1228977890 >> v1:172.21.15.63:6789/0 conn(0x7f2a180b81b0 legacy=0x7f2a18145d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.559+0000 7f2a1cbed700 1 -- 172.21.15.63:0/1228977890 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a180b9030 con 0x7f2a180b2940 2020-05-18T21:26:56.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.559+0000 7f2a1cbed700 1 --2- 172.21.15.63:0/1228977890 >> v2:172.21.15.63:3300/0 conn(0x7f2a180b2940 0x7f2a18146460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2a100032f0 tx=0x7f2a10007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.559+0000 7f2a1cbed700 1 --2- 172.21.15.63:0/1228977890 >> v2:172.21.15.63:3300/0 conn(0x7f2a180b2940 0x7f2a18146460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2a100032f0 tx=0x7f2a10007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.559+0000 7f2a1cbed700 1 --2- 172.21.15.63:0/1228977890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a180b2940 0x7f2a18146460 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f2a100032f0 tx=0x7f2a10007e00).ready entity=mon.0 client_cookie=7023fa7c5395d8c3 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:56.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.559+0000 7f2a1cbed700 1 --2- 172.21.15.63:0/1228977890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a180b2940 0x7f2a18146460 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f2a100032f0 tx=0x7f2a10007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.563+0000 7f2a16ffd700 1 -- 172.21.15.63:0/1228977890 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a1000a180 con 0x7f2a180b2940 2020-05-18T21:26:56.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.563+0000 7f2a1cbed700 1 --2- 172.21.15.63:0/1228977890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a180b2940 0x7f2a18146460 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f2a100032f0 tx=0x7f2a10007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.563+0000 7f2a16ffd700 1 -- 172.21.15.63:0/1228977890 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1000a2e0 con 0x7f2a180b2940 2020-05-18T21:26:56.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.563+0000 7f2a1cbed700 1 --2- 172.21.15.63:0/1228977890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a180b2940 0x7f2a18146460 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f2a100032f0 tx=0x7f2a10007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.563+0000 7f2a1d3ee700 1 -- 172.21.15.63:0/1228977890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a180b2940 msgr2=0x7f2a18146460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.563+0000 7f2a16ffd700 1 -- 172.21.15.63:0/1228977890 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a1000a700 con 0x7f2a180b2940 2020-05-18T21:26:56.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.563+0000 7f2a1d3ee700 1 --2- 172.21.15.63:0/1228977890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a180b2940 0x7f2a18146460 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f2a100032f0 tx=0x7f2a10007e00).stop 2020-05-18T21:26:56.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.563+0000 7f2a1d3ee700 1 -- 172.21.15.63:0/1228977890 shutdown_connections 2020-05-18T21:26:56.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.563+0000 7f2a1d3ee700 1 --2- 172.21.15.63:0/1228977890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a180b2940 0x7f2a18146460 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:56.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.563+0000 7f2a1d3ee700 1 -- 172.21.15.63:0/1228977890 >> 172.21.15.63:0/1228977890 conn(0x7f2a18069fc0 msgr2=0x7f2a1806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:56.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.563+0000 7f2a1d3ee700 1 -- 172.21.15.63:0/1228977890 shutdown_connections 2020-05-18T21:26:56.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.563+0000 7f2a1d3ee700 1 -- 172.21.15.63:0/1228977890 wait complete. 2020-05-18T21:26:56.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.563+0000 7f2a1d3ee700 1 Processor -- start 2020-05-18T21:26:56.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.563+0000 7f2a1d3ee700 1 -- start start 2020-05-18T21:26:56.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.563+0000 7f2a1d3ee700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2a180b2940 0x7f2a1812ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:56.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.563+0000 7f2a1d3ee700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2a180b81b0 0x7f2a18064090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:56.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.563+0000 7f2a1d3ee700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a18061590 con 0x7f2a1805f110 2020-05-18T21:26:56.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.563+0000 7f2a1d3ee700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a180613b0 con 0x7f2a180b81b0 2020-05-18T21:26:56.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.563+0000 7f2a1d3ee700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a18061830 con 0x7f2a180b2940 2020-05-18T21:26:56.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a1cbed700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2a180b81b0 0x7f2a18064090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:56.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a1cbed700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2a180b81b0 0x7f2a18064090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53040/0 (socket says 172.21.15.63:53040) 2020-05-18T21:26:56.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a1cbed700 1 -- 172.21.15.63:0/595295653 learned_addr learned my addr 172.21.15.63:0/595295653 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:56.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a17fff700 1 --1- 172.21.15.63:0/595295653 >> v1:172.21.15.155:6789/0 conn(0x7f2a1805f110 0x7f2a18061cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:53540/0 (socket says 172.21.15.63:53540) 2020-05-18T21:26:56.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a177fe700 1 --2- 172.21.15.63:0/595295653 >> v2:172.21.15.155:3300/0 conn(0x7f2a180b2940 0x7f2a1812ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:56.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a1cbed700 1 -- 172.21.15.63:0/595295653 >> v2:172.21.15.155:3300/0 conn(0x7f2a180b2940 msgr2=0x7f2a1812ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a1cbed700 1 --2- 172.21.15.63:0/595295653 >> v2:172.21.15.155:3300/0 conn(0x7f2a180b2940 0x7f2a1812ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:56.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a1cbed700 1 -- 172.21.15.63:0/595295653 >> v1:172.21.15.155:6789/0 conn(0x7f2a1805f110 legacy=0x7f2a18061cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a1cbed700 1 -- 172.21.15.63:0/595295653 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a180644f0 con 0x7f2a180b81b0 2020-05-18T21:26:56.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a1cbed700 1 --2- 172.21.15.63:0/595295653 >> v2:172.21.15.63:3300/0 conn(0x7f2a180b81b0 0x7f2a18064090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2a100032f0 tx=0x7f2a10007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a1cbed700 1 --2- 172.21.15.63:0/595295653 >> v2:172.21.15.63:3300/0 conn(0x7f2a180b81b0 0x7f2a18064090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2a100032f0 tx=0x7f2a10007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a1cbed700 1 --2- 172.21.15.63:0/595295653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a180b81b0 0x7f2a18064090 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f2a100032f0 tx=0x7f2a10007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:56.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a1cbed700 1 --2- 172.21.15.63:0/595295653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a180b81b0 0x7f2a18064090 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f2a100032f0 tx=0x7f2a10007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a1cbed700 1 --2- 172.21.15.63:0/595295653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a180b81b0 0x7f2a18064090 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f2a100032f0 tx=0x7f2a10007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a1cbed700 1 --2- 172.21.15.63:0/595295653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a180b81b0 0x7f2a18064090 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f2a100032f0 tx=0x7f2a10007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a157fa700 1 -- 172.21.15.63:0/595295653 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a10005c70 con 0x7f2a180b81b0 2020-05-18T21:26:56.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a157fa700 1 -- 172.21.15.63:0/595295653 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a10005dd0 con 0x7f2a180b81b0 2020-05-18T21:26:56.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a1d3ee700 1 -- 172.21.15.63:0/595295653 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a181575e0 con 0x7f2a180b81b0 2020-05-18T21:26:56.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a157fa700 1 -- 172.21.15.63:0/595295653 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a1000f7a0 con 0x7f2a180b81b0 2020-05-18T21:26:56.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a1d3ee700 1 -- 172.21.15.63:0/595295653 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a18156da0 con 0x7f2a180b81b0 2020-05-18T21:26:56.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a1cbed700 1 --2- 172.21.15.63:0/595295653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a180b81b0 0x7f2a18064090 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f2a100032f0 tx=0x7f2a10007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a1d3ee700 1 -- 172.21.15.63:0/595295653 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a180569e0 con 0x7f2a180b81b0 2020-05-18T21:26:56.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a157fa700 1 -- 172.21.15.63:0/595295653 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2a1000f900 con 0x7f2a180b81b0 2020-05-18T21:26:56.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a1cbed700 1 --2- 172.21.15.63:0/595295653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a180b81b0 0x7f2a18064090 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f2a100032f0 tx=0x7f2a10007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.567+0000 7f2a157fa700 1 --2- 172.21.15.63:0/595295653 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29f804fae0 0x7f29f8051fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:56.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.571+0000 7f2a157fa700 1 -- 172.21.15.63:0/595295653 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2a10064da0 con 0x7f2a180b81b0 2020-05-18T21:26:56.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.571+0000 7f2a17fff700 1 --2- 172.21.15.63:0/595295653 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29f804fae0 0x7f29f8051fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:56.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.571+0000 7f2a17fff700 1 --2- 172.21.15.63:0/595295653 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29f804fae0 0x7f29f8051fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2a18062550 tx=0x7f2a0c001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.571+0000 7f2a17fff700 1 --2- 172.21.15.63:0/595295653 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29f804fae0 0x7f29f8051fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2a18062550 tx=0x7f2a0c001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.571+0000 7f2a17fff700 1 --2- 172.21.15.63:0/595295653 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29f804fae0 0x7f29f8051fa0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f2a18062550 tx=0x7f2a0c001590).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:56.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.575+0000 7f2a1cbed700 1 --2- 172.21.15.63:0/595295653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a180b81b0 0x7f2a18064090 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f2a100032f0 tx=0x7f2a10007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.575+0000 7f2a157fa700 1 -- 172.21.15.63:0/595295653 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2a1003f250 con 0x7f2a180b81b0 2020-05-18T21:26:56.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.723+0000 7f2a1d3ee700 1 -- 172.21.15.63:0/595295653 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a180619a0 con 0x7f2a180b81b0 2020-05-18T21:26:56.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.723+0000 7f2a1cbed700 1 --2- 172.21.15.63:0/595295653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a180b81b0 0x7f2a18064090 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f2a100032f0 tx=0x7f2a10007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:56.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.727+0000 7f2a157fa700 1 -- 172.21.15.63:0/595295653 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2137 (secure 0 0 0) 0x7f2a10042870 con 0x7f2a180b81b0 2020-05-18T21:26:56.729 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:26:56.729 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4404,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2550679674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2550679674},{"type":"v1","addr":"172.21.15.155:6835","nonce":2550679674}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":7}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:26:45.491730+0000","modified":"2020-05-18T21:26:49.514812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4369},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4369":{"gid":4369,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.63:6833/2283817704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2283817704},{"type":"v1","addr":"172.21.15.63:6833","nonce":2283817704}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-05-18T21:26:56.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.727+0000 7f2a1d3ee700 1 -- 172.21.15.63:0/595295653 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29f804fae0 msgr2=0x7f29f8051fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.727+0000 7f2a1d3ee700 1 --2- 172.21.15.63:0/595295653 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29f804fae0 0x7f29f8051fa0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f2a18062550 tx=0x7f2a0c001590).stop 2020-05-18T21:26:56.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.727+0000 7f2a1d3ee700 1 -- 172.21.15.63:0/595295653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a180b81b0 msgr2=0x7f2a18064090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:56.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.727+0000 7f2a1d3ee700 1 --2- 172.21.15.63:0/595295653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a180b81b0 0x7f2a18064090 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f2a100032f0 tx=0x7f2a10007e00).stop 2020-05-18T21:26:56.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.727+0000 7f2a1d3ee700 1 -- 172.21.15.63:0/595295653 shutdown_connections 2020-05-18T21:26:56.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.727+0000 7f2a1d3ee700 1 --2- 172.21.15.63:0/595295653 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29f804fae0 0x7f29f8051fa0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:56.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.727+0000 7f2a1d3ee700 1 --2- 172.21.15.63:0/595295653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a180b81b0 0x7f2a18064090 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:56.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.727+0000 7f2a1d3ee700 1 --2- 172.21.15.63:0/595295653 >> v2:172.21.15.155:3300/0 conn(0x7f2a180b2940 0x7f2a1812ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:56.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.727+0000 7f2a1d3ee700 1 -- 172.21.15.63:0/595295653 >> 172.21.15.63:0/595295653 conn(0x7f2a18069fc0 msgr2=0x7f2a1812e890 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:56.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.727+0000 7f2a1d3ee700 1 -- 172.21.15.63:0/595295653 shutdown_connections 2020-05-18T21:26:56.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:56.727+0000 7f2a1d3ee700 1 -- 172.21.15.63:0/595295653 wait complete. 2020-05-18T21:26:56.733 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 7 2020-05-18T21:26:56.944 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:26:45.491730+0000', 'modified': '2020-05-18T21:26:49.514812+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4369}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4369': {'gid': 4369, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.63:6833/2283817704', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 2283817704}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 2283817704}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:26:56.944 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:26:56.945 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:26:57.052 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:26:57.052 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:26:57.052 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:26:57.053 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4369, 2020-05-18T21:26:57.053 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:26:57.053 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:26:57.053 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 8.5304087800000001, 2020-05-18T21:26:57.053 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 6, 2020-05-18T21:26:57.054 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 23, 2020-05-18T21:26:57.054 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 23, 2020-05-18T21:26:57.054 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 9.2248902909999995 2020-05-18T21:26:57.054 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:26:57.060 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 4369, "want_state": "up:active", "state": "up:active", "rank_uptime": 8.5304087800000001, "mdsmap_epoch": 6, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "uptime": 9.2248902909999995 } 2020-05-18T21:26:57.061 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-05-18T21:26:57.088 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-05-18T21:26:57.089 INFO:tasks.ceph_fuse:config is None 2020-05-18T21:26:57.089 INFO:tasks.ceph_fuse:new config is {'client.0': None, 'client.1': None, 'client.2': None, 'client.3': None} 2020-05-18T21:26:57.090 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-05-18T21:26:57.090 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:26:57.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.195+0000 7f83bfe4d700 1 Processor -- start 2020-05-18T21:26:57.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.195+0000 7f83bfe4d700 1 -- start start 2020-05-18T21:26:57.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bfe4d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f83b8060b90 0x7f83b8145f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:57.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bfe4d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b8146e60 con 0x7f83b8061670 2020-05-18T21:26:57.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bfe4d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b8146480 con 0x7f83b8149e80 2020-05-18T21:26:57.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bfe4d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b8146720 con 0x7f83b8060b90 2020-05-18T21:26:57.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bd3e8700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f83b8061670 0x7f83b8149770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55232/0 (socket says 172.21.15.63:55232) 2020-05-18T21:26:57.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bd3e8700 1 -- 172.21.15.63:0/3758768763 learned_addr learned my addr 172.21.15.63:0/3758768763 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:57.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bdbe9700 1 --2- 172.21.15.63:0/3758768763 >> v2:172.21.15.155:3300/0 conn(0x7f83b8060b90 0x7f83b8145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bcbe7700 1 -- 172.21.15.63:0/3758768763 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 76064685 0 0) 0x7f83b8146e60 con 0x7f83b8061670 2020-05-18T21:26:57.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bcbe7700 1 -- 172.21.15.63:0/3758768763 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83a0003270 con 0x7f83b8061670 2020-05-18T21:26:57.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bcbe7700 1 -- 172.21.15.63:0/3758768763 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608950542 0 0) 0x7f83b8146480 con 0x7f83b8149e80 2020-05-18T21:26:57.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bcbe7700 1 -- 172.21.15.63:0/3758768763 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83b8146e60 con 0x7f83b8149e80 2020-05-18T21:26:57.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bdbe9700 1 -- 172.21.15.63:0/3758768763 >> v1:172.21.15.155:6789/0 conn(0x7f83b8149e80 legacy=0x7f83b80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bdbe9700 1 -- 172.21.15.63:0/3758768763 >> v1:172.21.15.63:6789/0 conn(0x7f83b8061670 legacy=0x7f83b8149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bdbe9700 1 -- 172.21.15.63:0/3758768763 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b81469c0 con 0x7f83b8060b90 2020-05-18T21:26:57.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bdbe9700 1 --2- 172.21.15.63:0/3758768763 >> v2:172.21.15.155:3300/0 conn(0x7f83b8060b90 0x7f83b8145f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f83a8002f70 tx=0x7f83a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bdbe9700 1 --2- 172.21.15.63:0/3758768763 >> v2:172.21.15.155:3300/0 conn(0x7f83b8060b90 0x7f83b8145f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f83a8002f70 tx=0x7f83a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bdbe9700 1 --2- 172.21.15.63:0/3758768763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83b8060b90 0x7f83b8145f40 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f83a8002f70 tx=0x7f83a8007a80).ready entity=mon.1 client_cookie=9e245de252917f6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:57.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bdbe9700 1 --2- 172.21.15.63:0/3758768763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83b8060b90 0x7f83b8145f40 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f83a8002f70 tx=0x7f83a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bcbe7700 1 -- 172.21.15.63:0/3758768763 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83a8008e80 con 0x7f83b8060b90 2020-05-18T21:26:57.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bdbe9700 1 --2- 172.21.15.63:0/3758768763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83b8060b90 0x7f83b8145f40 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f83a8002f70 tx=0x7f83a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bdbe9700 1 --2- 172.21.15.63:0/3758768763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83b8060b90 0x7f83b8145f40 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f83a8002f70 tx=0x7f83a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bcbe7700 1 -- 172.21.15.63:0/3758768763 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a8011540 con 0x7f83b8060b90 2020-05-18T21:26:57.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bcbe7700 1 -- 172.21.15.63:0/3758768763 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83a8011920 con 0x7f83b8060b90 2020-05-18T21:26:57.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bfe4d700 1 -- 172.21.15.63:0/3758768763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83b8060b90 msgr2=0x7f83b8145f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bfe4d700 1 --2- 172.21.15.63:0/3758768763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83b8060b90 0x7f83b8145f40 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f83a8002f70 tx=0x7f83a8007a80).stop 2020-05-18T21:26:57.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bfe4d700 1 -- 172.21.15.63:0/3758768763 shutdown_connections 2020-05-18T21:26:57.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bfe4d700 1 --2- 172.21.15.63:0/3758768763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83b8060b90 0x7f83b8145f40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:57.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bfe4d700 1 -- 172.21.15.63:0/3758768763 >> 172.21.15.63:0/3758768763 conn(0x7f83b80b83d0 msgr2=0x7f83b80b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:57.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bfe4d700 1 -- 172.21.15.63:0/3758768763 shutdown_connections 2020-05-18T21:26:57.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.199+0000 7f83bfe4d700 1 -- 172.21.15.63:0/3758768763 wait complete. 2020-05-18T21:26:57.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.203+0000 7f83bfe4d700 1 Processor -- start 2020-05-18T21:26:57.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.203+0000 7f83bfe4d700 1 -- start start 2020-05-18T21:26:57.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.203+0000 7f83bfe4d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f83b8060b90 0x7f83b8153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:57.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.203+0000 7f83bfe4d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83b8149e80 0x7f83b80624d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:57.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.203+0000 7f83bfe4d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b8154180 con 0x7f83b8061670 2020-05-18T21:26:57.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.203+0000 7f83bfe4d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b8066240 con 0x7f83b8060b90 2020-05-18T21:26:57.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.203+0000 7f83bfe4d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b81537a0 con 0x7f83b8149e80 2020-05-18T21:26:57.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.203+0000 7f83bdbe9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f83b8060b90 0x7f83b8153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.203+0000 7f83bdbe9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f83b8060b90 0x7f83b8153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53050/0 (socket says 172.21.15.63:53050) 2020-05-18T21:26:57.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.203+0000 7f83bdbe9700 1 -- 172.21.15.63:0/2025416515 learned_addr learned my addr 172.21.15.63:0/2025416515 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:57.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.203+0000 7f83be3ea700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83b8149e80 0x7f83b80624d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.203+0000 7f83bdbe9700 1 -- 172.21.15.63:0/2025416515 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83b8149e80 msgr2=0x7f83b80624d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.203+0000 7f83bdbe9700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83b8149e80 0x7f83b80624d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:57.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.203+0000 7f83bdbe9700 1 -- 172.21.15.63:0/2025416515 >> v1:172.21.15.155:6789/0 conn(0x7f83b8061670 legacy=0x7f83b8144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.203+0000 7f83bdbe9700 1 -- 172.21.15.63:0/2025416515 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b8153a40 con 0x7f83b8060b90 2020-05-18T21:26:57.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.207+0000 7f83bdbe9700 1 --2- 172.21.15.63:0/2025416515 >> v2:172.21.15.63:3300/0 conn(0x7f83b8060b90 0x7f83b8153260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f83a8002f70 tx=0x7f83a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.207+0000 7f83bdbe9700 1 --2- 172.21.15.63:0/2025416515 >> v2:172.21.15.63:3300/0 conn(0x7f83b8060b90 0x7f83b8153260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f83a8002f70 tx=0x7f83a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.207+0000 7f83bdbe9700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83b8060b90 0x7f83b8153260 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f83a8002f70 tx=0x7f83a8007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:57.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.207+0000 7f83bdbe9700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83b8060b90 0x7f83b8153260 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f83a8002f70 tx=0x7f83a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.207+0000 7f83bdbe9700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83b8060b90 0x7f83b8153260 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f83a8002f70 tx=0x7f83a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.207+0000 7f83a6ffd700 1 -- 172.21.15.63:0/2025416515 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83a8007360 con 0x7f83b8060b90 2020-05-18T21:26:57.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.207+0000 7f83bdbe9700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83b8060b90 0x7f83b8153260 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f83a8002f70 tx=0x7f83a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.207+0000 7f83a6ffd700 1 -- 172.21.15.63:0/2025416515 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a80074c0 con 0x7f83b8060b90 2020-05-18T21:26:57.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.207+0000 7f83bfe4d700 1 -- 172.21.15.63:0/2025416515 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b8153ce0 con 0x7f83b8060b90 2020-05-18T21:26:57.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.207+0000 7f83a6ffd700 1 -- 172.21.15.63:0/2025416515 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83a80058f0 con 0x7f83b8060b90 2020-05-18T21:26:57.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.207+0000 7f83bfe4d700 1 -- 172.21.15.63:0/2025416515 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b8156e60 con 0x7f83b8060b90 2020-05-18T21:26:57.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.207+0000 7f83bdbe9700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83b8060b90 0x7f83b8153260 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f83a8002f70 tx=0x7f83a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.207+0000 7f83bfe4d700 1 -- 172.21.15.63:0/2025416515 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b80569e0 con 0x7f83b8060b90 2020-05-18T21:26:57.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.207+0000 7f83a6ffd700 1 -- 172.21.15.63:0/2025416515 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f83a8005b60 con 0x7f83b8060b90 2020-05-18T21:26:57.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.207+0000 7f83bdbe9700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83b8060b90 0x7f83b8153260 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f83a8002f70 tx=0x7f83a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.211+0000 7f83a6ffd700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f839804f9e0 0x7f8398051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:57.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.211+0000 7f83a6ffd700 1 -- 172.21.15.63:0/2025416515 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f83a8064790 con 0x7f83b8060b90 2020-05-18T21:26:57.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.211+0000 7f83bd3e8700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f839804f9e0 0x7f8398051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.211+0000 7f83bd3e8700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f839804f9e0 0x7f8398051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f83b8145950 tx=0x7f83b40018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.211+0000 7f83bd3e8700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f839804f9e0 0x7f8398051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f83b8145950 tx=0x7f83b40018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.211+0000 7f83bd3e8700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f839804f9e0 0x7f8398051ea0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f83b8145950 tx=0x7f83b40018d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:57.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.215+0000 7f83bdbe9700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83b8060b90 0x7f83b8153260 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f83a8002f70 tx=0x7f83a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.215+0000 7f83a6ffd700 1 -- 172.21.15.63:0/2025416515 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f83a803eb80 con 0x7f83b8060b90 2020-05-18T21:26:57.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.331+0000 7f83bfe4d700 1 -- 172.21.15.63:0/2025416515 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83b80008d0 con 0x7f83b8060b90 2020-05-18T21:26:57.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.335+0000 7f83bdbe9700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83b8060b90 0x7f83b8153260 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f83a8002f70 tx=0x7f83a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.335+0000 7f83a6ffd700 1 -- 172.21.15.63:0/2025416515 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f83a80421a0 con 0x7f83b8060b90 2020-05-18T21:26:57.339 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:26:57.339 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":23,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:26:47.498250+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:26:43.453504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-05-18T21:26:44.456531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:26:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.335+0000 7f83bfe4d700 1 -- 172.21.15.63:0/2025416515 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f839804f9e0 msgr2=0x7f8398051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.335+0000 7f83bfe4d700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f839804f9e0 0x7f8398051ea0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f83b8145950 tx=0x7f83b40018d0).stop 2020-05-18T21:26:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.335+0000 7f83bfe4d700 1 -- 172.21.15.63:0/2025416515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83b8060b90 msgr2=0x7f83b8153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.335+0000 7f83bfe4d700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83b8060b90 0x7f83b8153260 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f83a8002f70 tx=0x7f83a8007a80).stop 2020-05-18T21:26:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.335+0000 7f83bfe4d700 1 -- 172.21.15.63:0/2025416515 shutdown_connections 2020-05-18T21:26:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.335+0000 7f83bfe4d700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f839804f9e0 0x7f8398051ea0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:57.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.335+0000 7f83bfe4d700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83b8149e80 0x7f83b80624d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:57.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.335+0000 7f83bfe4d700 1 --2- 172.21.15.63:0/2025416515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83b8060b90 0x7f83b8153260 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:57.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.335+0000 7f83bfe4d700 1 -- 172.21.15.63:0/2025416515 >> 172.21.15.63:0/2025416515 conn(0x7f83b80b83d0 msgr2=0x7f83b80b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:57.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.335+0000 7f83bfe4d700 1 -- 172.21.15.63:0/2025416515 shutdown_connections 2020-05-18T21:26:57.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.335+0000 7f83bfe4d700 1 -- 172.21.15.63:0/2025416515 wait complete. 2020-05-18T21:26:57.351 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:26:43.453504+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:26:44.456531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:26:57.352 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:26:57.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.459+0000 7f2262e75700 1 Processor -- start 2020-05-18T21:26:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2262e75700 1 -- start start 2020-05-18T21:26:57.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2262e75700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f225c0b4f40 0x7f225c061180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:57.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2262e75700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225c06a7d0 con 0x7f225c0b2eb0 2020-05-18T21:26:57.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2262e75700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225c0b2a10 con 0x7f225c06a2c0 2020-05-18T21:26:57.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2262e75700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225c0b5320 con 0x7f225c0b4f40 2020-05-18T21:26:57.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2262674700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f225c0b2eb0 0x7f225c0b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55250/0 (socket says 172.21.15.63:55250) 2020-05-18T21:26:57.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2262674700 1 -- 172.21.15.63:0/1843843765 learned_addr learned my addr 172.21.15.63:0/1843843765 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:57.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2261e73700 1 --2- 172.21.15.63:0/1843843765 >> v2:172.21.15.155:3300/0 conn(0x7f225c0b4f40 0x7f225c061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2260e71700 1 -- 172.21.15.63:0/1843843765 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442747787 0 0) 0x7f225c06a7d0 con 0x7f225c0b2eb0 2020-05-18T21:26:57.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2260e71700 1 -- 172.21.15.63:0/1843843765 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2248003270 con 0x7f225c0b2eb0 2020-05-18T21:26:57.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2260e71700 1 -- 172.21.15.63:0/1843843765 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2803768150 0 0) 0x7f2248003270 con 0x7f225c0b2eb0 2020-05-18T21:26:57.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2260e71700 1 -- 172.21.15.63:0/1843843765 >> v2:172.21.15.155:3300/0 conn(0x7f225c0b4f40 msgr2=0x7f225c061180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:57.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2260e71700 1 --2- 172.21.15.63:0/1843843765 >> v2:172.21.15.155:3300/0 conn(0x7f225c0b4f40 0x7f225c061180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:57.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2260e71700 1 -- 172.21.15.63:0/1843843765 >> v1:172.21.15.155:6789/0 conn(0x7f225c06a2c0 legacy=0x7f225c132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2260e71700 1 -- 172.21.15.63:0/1843843765 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c1337f0 con 0x7f225c0b2eb0 2020-05-18T21:26:57.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2260e71700 1 -- 172.21.15.63:0/1843843765 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f224c001a90 con 0x7f225c0b2eb0 2020-05-18T21:26:57.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2260e71700 1 -- 172.21.15.63:0/1843843765 >> v1:172.21.15.63:6789/0 conn(0x7f225c0b2eb0 legacy=0x7f225c0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2260e71700 1 --2- 172.21.15.63:0/1843843765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f2248003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:57.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2260e71700 1 --2- 172.21.15.63:0/1843843765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2248004510 0x7f2248004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:57.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2260e71700 1 --2- 172.21.15.63:0/1843843765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2248004df0 0x7f224800b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:57.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2260e71700 1 -- 172.21.15.63:0/1843843765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c0b5320 con 0x7f2248003760 2020-05-18T21:26:57.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2260e71700 1 -- 172.21.15.63:0/1843843765 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2248004200 con 0x7f2248004df0 2020-05-18T21:26:57.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2260e71700 1 -- 172.21.15.63:0/1843843765 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224800bbc0 con 0x7f2248004510 2020-05-18T21:26:57.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2261e73700 1 --2- 172.21.15.63:0/1843843765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f2248003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2262674700 1 --2- 172.21.15.63:0/1843843765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2248004df0 0x7f224800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2261672700 1 --2- 172.21.15.63:0/1843843765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2248004510 0x7f2248004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2261e73700 1 -- 172.21.15.63:0/1843843765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2248004510 msgr2=0x7f2248004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:57.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2261e73700 1 --2- 172.21.15.63:0/1843843765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2248004510 0x7f2248004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:57.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2261e73700 1 -- 172.21.15.63:0/1843843765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2248004df0 msgr2=0x7f224800b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:57.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2261e73700 1 --2- 172.21.15.63:0/1843843765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2248004df0 0x7f224800b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:57.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2262674700 1 -- 172.21.15.63:0/1843843765 reap_dead start 2020-05-18T21:26:57.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2261e73700 1 -- 172.21.15.63:0/1843843765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2248003270 con 0x7f2248003760 2020-05-18T21:26:57.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2261e73700 1 --2- 172.21.15.63:0/1843843765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f2248003b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2254002f70 tx=0x7f2254010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2261e73700 1 --2- 172.21.15.63:0/1843843765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f2248003b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2254002f70 tx=0x7f2254010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2261e73700 1 --2- 172.21.15.63:0/1843843765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f2248003b80 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f2254002f70 tx=0x7f2254010060).ready entity=mon.0 client_cookie=264ab3514b5af2fd server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:57.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2261e73700 1 --2- 172.21.15.63:0/1843843765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f2248003b80 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2254002f70 tx=0x7f2254010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2260e71700 1 -- 172.21.15.63:0/1843843765 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2254008d70 con 0x7f2248003760 2020-05-18T21:26:57.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2261e73700 1 --2- 172.21.15.63:0/1843843765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f2248003b80 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2254002f70 tx=0x7f2254010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2260e71700 1 -- 172.21.15.63:0/1843843765 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2254010910 con 0x7f2248003760 2020-05-18T21:26:57.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2261e73700 1 --2- 172.21.15.63:0/1843843765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f2248003b80 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2254002f70 tx=0x7f2254010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2262e75700 1 -- 172.21.15.63:0/1843843765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 msgr2=0x7f2248003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2262e75700 1 --2- 172.21.15.63:0/1843843765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f2248003b80 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f2254002f70 tx=0x7f2254010060).stop 2020-05-18T21:26:57.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.463+0000 7f2260e71700 1 -- 172.21.15.63:0/1843843765 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2254010c70 con 0x7f2248003760 2020-05-18T21:26:57.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.467+0000 7f2262e75700 1 -- 172.21.15.63:0/1843843765 shutdown_connections 2020-05-18T21:26:57.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.467+0000 7f2262e75700 1 --2- 172.21.15.63:0/1843843765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f2248003b80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:57.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.467+0000 7f2262e75700 1 -- 172.21.15.63:0/1843843765 >> 172.21.15.63:0/1843843765 conn(0x7f225c05fbd0 msgr2=0x7f225c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:57.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.467+0000 7f2262e75700 1 -- 172.21.15.63:0/1843843765 shutdown_connections 2020-05-18T21:26:57.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.467+0000 7f2262e75700 1 -- 172.21.15.63:0/1843843765 wait complete. 2020-05-18T21:26:57.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.467+0000 7f2262e75700 1 Processor -- start 2020-05-18T21:26:57.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.467+0000 7f2262e75700 1 -- start start 2020-05-18T21:26:57.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2262e75700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2248003760 0x7f225c0ad570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:57.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2262e75700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225c065b90 con 0x7f225c0ad9d0 2020-05-18T21:26:57.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2262e75700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225c157200 con 0x7f225c15ad40 2020-05-18T21:26:57.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2262e75700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225c065980 con 0x7f2248003760 2020-05-18T21:26:57.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2261e73700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2248003760 0x7f225c0ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2261672700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f225c0ad9d0 0x7f225c0b71a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55260/0 (socket says 172.21.15.63:55260) 2020-05-18T21:26:57.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2261672700 1 -- 172.21.15.63:0/363638327 learned_addr learned my addr 172.21.15.63:0/363638327 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:57.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f225affd700 1 -- 172.21.15.63:0/363638327 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52867870 0 0) 0x7f225c065b90 con 0x7f225c0ad9d0 2020-05-18T21:26:57.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f225affd700 1 -- 172.21.15.63:0/363638327 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f223c002fe0 con 0x7f225c0ad9d0 2020-05-18T21:26:57.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f225affd700 1 -- 172.21.15.63:0/363638327 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799897743 0 0) 0x7f225c157200 con 0x7f225c15ad40 2020-05-18T21:26:57.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f225affd700 1 -- 172.21.15.63:0/363638327 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f225c065b90 con 0x7f225c15ad40 2020-05-18T21:26:57.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2261e73700 1 -- 172.21.15.63:0/363638327 >> v1:172.21.15.155:6789/0 conn(0x7f225c15ad40 legacy=0x7f225c157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2261e73700 1 -- 172.21.15.63:0/363638327 >> v1:172.21.15.63:6789/0 conn(0x7f225c0ad9d0 legacy=0x7f225c0b71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2261e73700 1 -- 172.21.15.63:0/363638327 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c0b78b0 con 0x7f2248003760 2020-05-18T21:26:57.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2261e73700 1 --2- 172.21.15.63:0/363638327 >> v2:172.21.15.63:3300/0 conn(0x7f2248003760 0x7f225c0ad570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2254002f70 tx=0x7f2254010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2261e73700 1 --2- 172.21.15.63:0/363638327 >> v2:172.21.15.63:3300/0 conn(0x7f2248003760 0x7f225c0ad570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2254002f70 tx=0x7f2254010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2261e73700 1 --2- 172.21.15.63:0/363638327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f225c0ad570 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f2254002f70 tx=0x7f2254010060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:57.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2261e73700 1 --2- 172.21.15.63:0/363638327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f225c0ad570 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f2254002f70 tx=0x7f2254010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2261e73700 1 --2- 172.21.15.63:0/363638327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f225c0ad570 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f2254002f70 tx=0x7f2254010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f225affd700 1 -- 172.21.15.63:0/363638327 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2254005700 con 0x7f2248003760 2020-05-18T21:26:57.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2261e73700 1 --2- 172.21.15.63:0/363638327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f225c0ad570 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f2254002f70 tx=0x7f2254010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f225affd700 1 -- 172.21.15.63:0/363638327 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2254005860 con 0x7f2248003760 2020-05-18T21:26:57.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2262e75700 1 -- 172.21.15.63:0/363638327 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225c065570 con 0x7f2248003760 2020-05-18T21:26:57.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f225affd700 1 -- 172.21.15.63:0/363638327 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2254005bc0 con 0x7f2248003760 2020-05-18T21:26:57.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2262e75700 1 -- 172.21.15.63:0/363638327 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225c157e20 con 0x7f2248003760 2020-05-18T21:26:57.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2261e73700 1 --2- 172.21.15.63:0/363638327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f225c0ad570 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f2254002f70 tx=0x7f2254010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f225affd700 1 -- 172.21.15.63:0/363638327 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2254005d20 con 0x7f2248003760 2020-05-18T21:26:57.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2261e73700 1 --2- 172.21.15.63:0/363638327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f225c0ad570 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f2254002f70 tx=0x7f2254010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f2262e75700 1 -- 172.21.15.63:0/363638327 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225c065d20 con 0x7f2248003760 2020-05-18T21:26:57.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f225affd700 1 --2- 172.21.15.63:0/363638327 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f223c04fed0 0x7f223c052390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:57.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.471+0000 7f225affd700 1 -- 172.21.15.63:0/363638327 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2254063d50 con 0x7f2248003760 2020-05-18T21:26:57.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.475+0000 7f2261672700 1 --2- 172.21.15.63:0/363638327 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f223c04fed0 0x7f223c052390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.475+0000 7f2261672700 1 --2- 172.21.15.63:0/363638327 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f223c04fed0 0x7f223c052390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f22500015f0 tx=0x7f2250003930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.475+0000 7f2261672700 1 --2- 172.21.15.63:0/363638327 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f223c04fed0 0x7f223c052390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f22500015f0 tx=0x7f2250003930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.475+0000 7f2261672700 1 --2- 172.21.15.63:0/363638327 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f223c04fed0 0x7f223c052390 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f22500015f0 tx=0x7f2250003930).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:57.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.479+0000 7f2261e73700 1 --2- 172.21.15.63:0/363638327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f225c0ad570 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f2254002f70 tx=0x7f2254010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.479+0000 7f225affd700 1 -- 172.21.15.63:0/363638327 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2254041e60 con 0x7f2248003760 2020-05-18T21:26:57.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.595+0000 7f2262e75700 1 -- 172.21.15.63:0/363638327 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f225c065700 con 0x7f2248003760 2020-05-18T21:26:57.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.595+0000 7f2261e73700 1 --2- 172.21.15.63:0/363638327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f225c0ad570 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f2254002f70 tx=0x7f2254010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.595+0000 7f225affd700 1 -- 172.21.15.63:0/363638327 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f225403e200 con 0x7f2248003760 2020-05-18T21:26:57.598 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:26:57.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.595+0000 7f2262e75700 1 -- 172.21.15.63:0/363638327 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f223c04fed0 msgr2=0x7f223c052390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.595+0000 7f2262e75700 1 --2- 172.21.15.63:0/363638327 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f223c04fed0 0x7f223c052390 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f22500015f0 tx=0x7f2250003930).stop 2020-05-18T21:26:57.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.595+0000 7f2262e75700 1 -- 172.21.15.63:0/363638327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 msgr2=0x7f225c0ad570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.595+0000 7f2262e75700 1 --2- 172.21.15.63:0/363638327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f225c0ad570 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f2254002f70 tx=0x7f2254010060).stop 2020-05-18T21:26:57.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.595+0000 7f2262e75700 1 -- 172.21.15.63:0/363638327 shutdown_connections 2020-05-18T21:26:57.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.595+0000 7f2262e75700 1 --2- 172.21.15.63:0/363638327 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f223c04fed0 0x7f223c052390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:57.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.595+0000 7f2262e75700 1 --2- 172.21.15.63:0/363638327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2248003760 0x7f225c0ad570 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:57.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.595+0000 7f2262e75700 1 -- 172.21.15.63:0/363638327 >> 172.21.15.63:0/363638327 conn(0x7f225c05fbd0 msgr2=0x7f225c0b60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:57.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.595+0000 7f2262e75700 1 -- 172.21.15.63:0/363638327 shutdown_connections 2020-05-18T21:26:57.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.595+0000 7f2262e75700 1 -- 172.21.15.63:0/363638327 wait complete. 2020-05-18T21:26:57.610 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:26:57.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.715+0000 7f5156fc4700 1 Processor -- start 2020-05-18T21:26:57.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.715+0000 7f5156fc4700 1 -- start start 2020-05-18T21:26:57.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f5156fc4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f51500616f0 0x7f5150145990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:57.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f5156fc4700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5150061c70 con 0x7f515009ff50 2020-05-18T21:26:57.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f5156fc4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5150061f10 con 0x7f515005f410 2020-05-18T21:26:57.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f5156fc4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51500621b0 con 0x7f51500616f0 2020-05-18T21:26:57.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f51557c1700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f515009ff50 0x7f51500b5bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55268/0 (socket says 172.21.15.63:55268) 2020-05-18T21:26:57.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f51557c1700 1 -- 172.21.15.63:0/2070078711 learned_addr learned my addr 172.21.15.63:0/2070078711 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:57.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f51567c3700 1 --2- 172.21.15.63:0/2070078711 >> v2:172.21.15.155:3300/0 conn(0x7f51500616f0 0x7f5150145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f5154fc0700 1 -- 172.21.15.63:0/2070078711 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460966800 0 0) 0x7f5150061c70 con 0x7f515009ff50 2020-05-18T21:26:57.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f5154fc0700 1 -- 172.21.15.63:0/2070078711 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5138003270 con 0x7f515009ff50 2020-05-18T21:26:57.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f51567c3700 1 -- 172.21.15.63:0/2070078711 >> v1:172.21.15.155:6789/0 conn(0x7f515005f410 legacy=0x7f5150145280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f51567c3700 1 -- 172.21.15.63:0/2070078711 >> v1:172.21.15.63:6789/0 conn(0x7f515009ff50 legacy=0x7f51500b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f51567c3700 1 -- 172.21.15.63:0/2070078711 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515014a200 con 0x7f51500616f0 2020-05-18T21:26:57.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f51567c3700 1 --2- 172.21.15.63:0/2070078711 >> v2:172.21.15.155:3300/0 conn(0x7f51500616f0 0x7f5150145990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f51480032f0 tx=0x7f5148007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f51567c3700 1 --2- 172.21.15.63:0/2070078711 >> v2:172.21.15.155:3300/0 conn(0x7f51500616f0 0x7f5150145990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f51480032f0 tx=0x7f5148007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f51567c3700 1 --2- 172.21.15.63:0/2070078711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51500616f0 0x7f5150145990 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f51480032f0 tx=0x7f5148007e00).ready entity=mon.1 client_cookie=3ed8888178727db2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:57.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f51567c3700 1 --2- 172.21.15.63:0/2070078711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51500616f0 0x7f5150145990 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f51480032f0 tx=0x7f5148007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f5154fc0700 1 -- 172.21.15.63:0/2070078711 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5148011e60 con 0x7f51500616f0 2020-05-18T21:26:57.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f51567c3700 1 --2- 172.21.15.63:0/2070078711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51500616f0 0x7f5150145990 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f51480032f0 tx=0x7f5148007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f51567c3700 1 --2- 172.21.15.63:0/2070078711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51500616f0 0x7f5150145990 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f51480032f0 tx=0x7f5148007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f5154fc0700 1 -- 172.21.15.63:0/2070078711 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514800a180 con 0x7f51500616f0 2020-05-18T21:26:57.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f5154fc0700 1 -- 172.21.15.63:0/2070078711 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f514800a520 con 0x7f51500616f0 2020-05-18T21:26:57.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f5156fc4700 1 -- 172.21.15.63:0/2070078711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51500616f0 msgr2=0x7f5150145990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f5156fc4700 1 --2- 172.21.15.63:0/2070078711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51500616f0 0x7f5150145990 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f51480032f0 tx=0x7f5148007e00).stop 2020-05-18T21:26:57.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f5156fc4700 1 -- 172.21.15.63:0/2070078711 shutdown_connections 2020-05-18T21:26:57.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f5156fc4700 1 --2- 172.21.15.63:0/2070078711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51500616f0 0x7f5150145990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:57.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f5156fc4700 1 -- 172.21.15.63:0/2070078711 >> 172.21.15.63:0/2070078711 conn(0x7f515006a600 msgr2=0x7f51500b6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:57.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f5156fc4700 1 -- 172.21.15.63:0/2070078711 shutdown_connections 2020-05-18T21:26:57.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.719+0000 7f5156fc4700 1 -- 172.21.15.63:0/2070078711 wait complete. 2020-05-18T21:26:57.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f5156fc4700 1 Processor -- start 2020-05-18T21:26:57.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f5156fc4700 1 -- start start 2020-05-18T21:26:57.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f5156fc4700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f515005f410 0x7f51501473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:57.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f5156fc4700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5150147970 con 0x7f515009ff50 2020-05-18T21:26:57.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f5156fc4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5150147c10 con 0x7f51500616f0 2020-05-18T21:26:57.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f5156fc4700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5150147eb0 con 0x7f515005f410 2020-05-18T21:26:57.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f51567c3700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f515009ff50 0x7f515015c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55276/0 (socket says 172.21.15.63:55276) 2020-05-18T21:26:57.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f51567c3700 1 -- 172.21.15.63:0/452056995 learned_addr learned my addr 172.21.15.63:0/452056995 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:57.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f5155fc2700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f515005f410 0x7f51501473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762810538 0 0) 0x7f5150147970 con 0x7f515009ff50 2020-05-18T21:26:57.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5130002fe0 con 0x7f515009ff50 2020-05-18T21:26:57.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479377955 0 0) 0x7f5150147c10 con 0x7f51500616f0 2020-05-18T21:26:57.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5150147970 con 0x7f51500616f0 2020-05-18T21:26:57.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2872831813 0 0) 0x7f5130002fe0 con 0x7f515009ff50 2020-05-18T21:26:57.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5150147c10 con 0x7f515009ff50 2020-05-18T21:26:57.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f5148008a20 con 0x7f515009ff50 2020-05-18T21:26:57.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f515005f410 msgr2=0x7f51501473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f513effd700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f515005f410 0x7f51501473f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:57.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 >> v1:172.21.15.155:6789/0 conn(0x7f51500616f0 legacy=0x7f51501538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 >> v1:172.21.15.63:6789/0 conn(0x7f515009ff50 legacy=0x7f515015c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f513effd700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5130004bf0 0x7f5130004fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:57.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f513effd700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130003b30 0x7f5130003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:57.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f513effd700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5130004410 0x7f513000b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:57.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5150147eb0 con 0x7f5130003b30 2020-05-18T21:26:57.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51300048f0 con 0x7f5130004bf0 2020-05-18T21:26:57.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513000bbc0 con 0x7f5130004410 2020-05-18T21:26:57.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f5155fc2700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f515005f410 0x7f51501473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:26:57.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f51557c1700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130003b30 0x7f5130003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f51567c3700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5130004410 0x7f513000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.723+0000 7f5155fc2700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5130004bf0 0x7f5130004fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f51557c1700 1 -- 172.21.15.63:0/452056995 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5130004410 msgr2=0x7f513000b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f51557c1700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5130004410 0x7f513000b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:57.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f51557c1700 1 -- 172.21.15.63:0/452056995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5130004bf0 msgr2=0x7f5130004fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f51557c1700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5130004bf0 0x7f5130004fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:57.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f51557c1700 1 -- 172.21.15.63:0/452056995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5150148350 con 0x7f5130003b30 2020-05-18T21:26:57.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f5156fc4700 1 -- 172.21.15.63:0/452056995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51501473f0 con 0x7f5130003b30 2020-05-18T21:26:57.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f5156fc4700 1 -- 172.21.15.63:0/452056995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5150153fd0 con 0x7f5130003b30 2020-05-18T21:26:57.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f51557c1700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130003b30 0x7f5130003fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5130004b00 tx=0x7f514000c630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f51557c1700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130003b30 0x7f5130003fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5130004b00 tx=0x7f514000c630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f51557c1700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130003b30 0x7f5130003fb0 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f5130004b00 tx=0x7f514000c630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:57.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f51557c1700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130003b30 0x7f5130003fb0 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f5130004b00 tx=0x7f514000c630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5140010570 con 0x7f5130003b30 2020-05-18T21:26:57.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f51557c1700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130003b30 0x7f5130003fb0 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f5130004b00 tx=0x7f514000c630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f51557c1700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130003b30 0x7f5130003fb0 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f5130004b00 tx=0x7f514000c630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514000c690 con 0x7f5130003b30 2020-05-18T21:26:57.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f514000ca70 con 0x7f5130003b30 2020-05-18T21:26:57.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f51557c1700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130003b30 0x7f5130003fb0 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f5130004b00 tx=0x7f514000c630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f5156fc4700 1 -- 172.21.15.63:0/452056995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512c003380 con 0x7f5130003b30 2020-05-18T21:26:57.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f514000cbd0 con 0x7f5130003b30 2020-05-18T21:26:57.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.727+0000 7f51557c1700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130003b30 0x7f5130003fb0 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f5130004b00 tx=0x7f514000c630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.731+0000 7f513effd700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5130058290 0x7f513005a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:57.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.731+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5140063670 con 0x7f5130003b30 2020-05-18T21:26:57.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.731+0000 7f5155fc2700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5130058290 0x7f513005a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.731+0000 7f5155fc2700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5130058290 0x7f513005a750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51500b49f0 tx=0x7f514c00c9e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.731+0000 7f5155fc2700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5130058290 0x7f513005a750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51500b49f0 tx=0x7f514c00c9e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.731+0000 7f5155fc2700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5130058290 0x7f513005a750 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f51500b49f0 tx=0x7f514c00c9e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:57.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.735+0000 7f51557c1700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130003b30 0x7f5130003fb0 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f5130004b00 tx=0x7f514000c630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.735+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f5140041490 con 0x7f5130003b30 2020-05-18T21:26:57.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.847+0000 7f5156fc4700 1 -- 172.21.15.63:0/452056995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f512c002240 con 0x7f5130003b30 2020-05-18T21:26:57.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.847+0000 7f51557c1700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130003b30 0x7f5130003fb0 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f5130004b00 tx=0x7f514000c630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.847+0000 7f513effd700 1 -- 172.21.15.63:0/452056995 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5140041080 con 0x7f5130003b30 2020-05-18T21:26:57.852 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:26:57.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.851+0000 7f5156fc4700 1 -- 172.21.15.63:0/452056995 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5130058290 msgr2=0x7f513005a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.851+0000 7f5156fc4700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5130058290 0x7f513005a750 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f51500b49f0 tx=0x7f514c00c9e0).stop 2020-05-18T21:26:57.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.851+0000 7f5156fc4700 1 -- 172.21.15.63:0/452056995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130003b30 msgr2=0x7f5130003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.851+0000 7f5156fc4700 1 --2- 172.21.15.63:0/452056995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130003b30 0x7f5130003fb0 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f5130004b00 tx=0x7f514000c630).stop 2020-05-18T21:26:57.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.851+0000 7f51567c3700 1 -- 172.21.15.63:0/452056995 reap_dead start 2020-05-18T21:26:57.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.851+0000 7f51567c3700 1 -- 172.21.15.63:0/452056995 reap_dead start 2020-05-18T21:26:57.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.851+0000 7f5156fc4700 1 -- 172.21.15.63:0/452056995 shutdown_connections 2020-05-18T21:26:57.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.851+0000 7f5156fc4700 1 -- 172.21.15.63:0/452056995 >> 172.21.15.63:0/452056995 conn(0x7f515006a600 msgr2=0x7f51500bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:57.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.851+0000 7f5156fc4700 1 -- 172.21.15.63:0/452056995 shutdown_connections 2020-05-18T21:26:57.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.851+0000 7f5156fc4700 1 -- 172.21.15.63:0/452056995 wait complete. 2020-05-18T21:26:57.864 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:26:57.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.967+0000 7f8c0759e700 1 Processor -- start 2020-05-18T21:26:57.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.967+0000 7f8c0759e700 1 -- start start 2020-05-18T21:26:57.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.967+0000 7f8c0759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b4f40 0x7f8c08061180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:57.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.967+0000 7f8c0759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8c080b2eb0 0x7f8c080b3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.967+0000 7f8c0759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0806a7d0 con 0x7f8c0806a2c0 2020-05-18T21:26:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.967+0000 7f8c0759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c080b2a10 con 0x7f8c080b2eb0 2020-05-18T21:26:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.967+0000 7f8c0759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c080b5320 con 0x7f8c080b4f40 2020-05-18T21:26:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c06d9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8c080b2eb0 0x7f8c080b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0659c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b4f40 0x7f8c08061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c05d9b700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f8c0806a2c0 0x7f8c08132360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:53602/0 (socket says 172.21.15.63:53602) 2020-05-18T21:26:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c05d9b700 1 -- 172.21.15.63:0/3351100099 learned_addr learned my addr 172.21.15.63:0/3351100099 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:57.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0659c700 1 -- 172.21.15.63:0/3351100099 >> v2:172.21.15.155:3300/0 conn(0x7f8c080b2eb0 msgr2=0x7f8c080b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:57.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0659c700 1 --2- 172.21.15.63:0/3351100099 >> v2:172.21.15.155:3300/0 conn(0x7f8c080b2eb0 0x7f8c080b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:57.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0659c700 1 -- 172.21.15.63:0/3351100099 >> v1:172.21.15.155:6789/0 conn(0x7f8c0806a2c0 legacy=0x7f8c08132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0559a700 1 -- 172.21.15.63:0/3351100099 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283030400 0 0) 0x7f8c0806a7d0 con 0x7f8c0806a2c0 2020-05-18T21:26:57.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0659c700 1 -- 172.21.15.63:0/3351100099 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c081337f0 con 0x7f8c080b4f40 2020-05-18T21:26:57.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c06d9d700 1 --2- 172.21.15.63:0/3351100099 >> v2:172.21.15.155:3300/0 conn(0x7f8c080b2eb0 0x7f8c080b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:26:57.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0659c700 1 --2- 172.21.15.63:0/3351100099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b4f40 0x7f8c08061180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8bf8002f70 tx=0x7f8bf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0659c700 1 --2- 172.21.15.63:0/3351100099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b4f40 0x7f8c08061180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8bf8002f70 tx=0x7f8bf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0659c700 1 --2- 172.21.15.63:0/3351100099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b4f40 0x7f8c08061180 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f8bf8002f70 tx=0x7f8bf8007a80).ready entity=mon.2 client_cookie=25796a34f6727c0f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:57.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0659c700 1 --2- 172.21.15.63:0/3351100099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b4f40 0x7f8c08061180 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f8bf8002f70 tx=0x7f8bf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0559a700 1 -- 172.21.15.63:0/3351100099 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bf8008e80 con 0x7f8c080b4f40 2020-05-18T21:26:57.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0659c700 1 --2- 172.21.15.63:0/3351100099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b4f40 0x7f8c08061180 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f8bf8002f70 tx=0x7f8bf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0559a700 1 -- 172.21.15.63:0/3351100099 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf80115f0 con 0x7f8c080b4f40 2020-05-18T21:26:57.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0659c700 1 --2- 172.21.15.63:0/3351100099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b4f40 0x7f8c08061180 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f8bf8002f70 tx=0x7f8bf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0759e700 1 -- 172.21.15.63:0/3351100099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b4f40 msgr2=0x7f8c08061180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0559a700 1 -- 172.21.15.63:0/3351100099 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bf80119d0 con 0x7f8c080b4f40 2020-05-18T21:26:57.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0759e700 1 --2- 172.21.15.63:0/3351100099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b4f40 0x7f8c08061180 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f8bf8002f70 tx=0x7f8bf8007a80).stop 2020-05-18T21:26:57.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0759e700 1 -- 172.21.15.63:0/3351100099 shutdown_connections 2020-05-18T21:26:57.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0759e700 1 --2- 172.21.15.63:0/3351100099 >> v2:172.21.15.155:3300/0 conn(0x7f8c080b2eb0 0x7f8c080b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:57.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0759e700 1 --2- 172.21.15.63:0/3351100099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b4f40 0x7f8c08061180 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:57.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0759e700 1 -- 172.21.15.63:0/3351100099 >> 172.21.15.63:0/3351100099 conn(0x7f8c0805fbd0 msgr2=0x7f8c08069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:57.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0759e700 1 -- 172.21.15.63:0/3351100099 shutdown_connections 2020-05-18T21:26:57.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0759e700 1 -- 172.21.15.63:0/3351100099 wait complete. 2020-05-18T21:26:57.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0759e700 1 Processor -- start 2020-05-18T21:26:57.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0759e700 1 -- start start 2020-05-18T21:26:57.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.971+0000 7f8c0759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b2eb0 0x7f8c080b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:57.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c0759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0811a0f0 con 0x7f8c0806a2c0 2020-05-18T21:26:57.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c0759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0811a390 con 0x7f8c080b4f40 2020-05-18T21:26:57.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c0759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0811a630 con 0x7f8c080b2eb0 2020-05-18T21:26:57.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c0659c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8c0806a2c0 0x7f8c0814d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55292/0 (socket says 172.21.15.63:55292) 2020-05-18T21:26:57.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c0659c700 1 -- 172.21.15.63:0/3604815256 learned_addr learned my addr 172.21.15.63:0/3604815256 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:26:57.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c05d9b700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b2eb0 0x7f8c080b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8bff7fe700 1 -- 172.21.15.63:0/3604815256 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021879642 0 0) 0x7f8c0811a0f0 con 0x7f8c0806a2c0 2020-05-18T21:26:57.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8bff7fe700 1 -- 172.21.15.63:0/3604815256 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bec002fe0 con 0x7f8c0806a2c0 2020-05-18T21:26:57.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8bff7fe700 1 -- 172.21.15.63:0/3604815256 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46826905 0 0) 0x7f8c0811a390 con 0x7f8c080b4f40 2020-05-18T21:26:57.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8bff7fe700 1 -- 172.21.15.63:0/3604815256 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c0811a0f0 con 0x7f8c080b4f40 2020-05-18T21:26:57.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c05d9b700 1 -- 172.21.15.63:0/3604815256 >> v1:172.21.15.155:6789/0 conn(0x7f8c080b4f40 legacy=0x7f8c0812f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c05d9b700 1 -- 172.21.15.63:0/3604815256 >> v1:172.21.15.63:6789/0 conn(0x7f8c0806a2c0 legacy=0x7f8c0814d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:57.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c05d9b700 1 -- 172.21.15.63:0/3604815256 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0812f880 con 0x7f8c080b2eb0 2020-05-18T21:26:57.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c05d9b700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b2eb0 0x7f8c080b0cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8bf0000bc0 tx=0x7f8bf0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c05d9b700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b2eb0 0x7f8c080b0cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8bf0000bc0 tx=0x7f8bf0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c05d9b700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b2eb0 0x7f8c080b0cb0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f8bf0000bc0 tx=0x7f8bf0010940).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:57.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c05d9b700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b2eb0 0x7f8c080b0cb0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f8bf0000bc0 tx=0x7f8bf0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8bff7fe700 1 -- 172.21.15.63:0/3604815256 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bf0005ce0 con 0x7f8c080b2eb0 2020-05-18T21:26:57.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c05d9b700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b2eb0 0x7f8c080b0cb0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f8bf0000bc0 tx=0x7f8bf0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c0759e700 1 -- 172.21.15.63:0/3604815256 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c081199e0 con 0x7f8c080b2eb0 2020-05-18T21:26:57.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8bff7fe700 1 -- 172.21.15.63:0/3604815256 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf0005e40 con 0x7f8c080b2eb0 2020-05-18T21:26:57.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c05d9b700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b2eb0 0x7f8c080b0cb0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f8bf0000bc0 tx=0x7f8bf0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8bff7fe700 1 -- 172.21.15.63:0/3604815256 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bf00062c0 con 0x7f8c080b2eb0 2020-05-18T21:26:57.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c0759e700 1 -- 172.21.15.63:0/3604815256 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c08119e90 con 0x7f8c080b2eb0 2020-05-18T21:26:57.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c05d9b700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b2eb0 0x7f8c080b0cb0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f8bf0000bc0 tx=0x7f8bf0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c0759e700 1 -- 172.21.15.63:0/3604815256 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c080569e0 con 0x7f8c080b2eb0 2020-05-18T21:26:57.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8bff7fe700 1 -- 172.21.15.63:0/3604815256 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8bf0006500 con 0x7f8c080b2eb0 2020-05-18T21:26:57.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.975+0000 7f8c05d9b700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b2eb0 0x7f8c080b0cb0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f8bf0000bc0 tx=0x7f8bf0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.979+0000 7f8bff7fe700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8bec04fe60 0x7f8bec052320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:57.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.979+0000 7f8bff7fe700 1 -- 172.21.15.63:0/3604815256 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8bf00090c0 con 0x7f8c080b2eb0 2020-05-18T21:26:57.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.979+0000 7f8c0659c700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8bec04fe60 0x7f8bec052320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:57.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.979+0000 7f8c0659c700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8bec04fe60 0x7f8bec052320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8bf8008950 tx=0x7f8bf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.979+0000 7f8c0659c700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8bec04fe60 0x7f8bec052320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8bf8008950 tx=0x7f8bf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.979+0000 7f8c0659c700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8bec04fe60 0x7f8bec052320 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f8bf8008950 tx=0x7f8bf8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:57.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.987+0000 7f8c05d9b700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b2eb0 0x7f8c080b0cb0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f8bf0000bc0 tx=0x7f8bf0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:57.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:57.987+0000 7f8bff7fe700 1 -- 172.21.15.63:0/3604815256 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f8bf003e010 con 0x7f8c080b2eb0 2020-05-18T21:26:58.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.103+0000 7f8c0759e700 1 -- 172.21.15.63:0/3604815256 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c080b45c0 con 0x7f8c080b2eb0 2020-05-18T21:26:58.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.107+0000 7f8c05d9b700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b2eb0 0x7f8c080b0cb0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f8bf0000bc0 tx=0x7f8bf0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.107+0000 7f8bff7fe700 1 -- 172.21.15.63:0/3604815256 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8bf0041630 con 0x7f8c080b2eb0 2020-05-18T21:26:58.109 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:26:58.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.107+0000 7f8c0759e700 1 -- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8bec04fe60 msgr2=0x7f8bec052320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:58.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.107+0000 7f8c0759e700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8bec04fe60 0x7f8bec052320 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f8bf8008950 tx=0x7f8bf8007a80).stop 2020-05-18T21:26:58.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.107+0000 7f8c0759e700 1 -- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b2eb0 msgr2=0x7f8c080b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:58.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.107+0000 7f8c0759e700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b2eb0 0x7f8c080b0cb0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f8bf0000bc0 tx=0x7f8bf0010940).stop 2020-05-18T21:26:58.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.107+0000 7f8c0759e700 1 -- 172.21.15.63:0/3604815256 shutdown_connections 2020-05-18T21:26:58.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.107+0000 7f8c0759e700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8bec04fe60 0x7f8bec052320 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:58.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.107+0000 7f8c0759e700 1 --2- 172.21.15.63:0/3604815256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b2eb0 0x7f8c080b0cb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:58.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.107+0000 7f8c0759e700 1 -- 172.21.15.63:0/3604815256 >> 172.21.15.63:0/3604815256 conn(0x7f8c0805fbd0 msgr2=0x7f8c08132bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:58.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.107+0000 7f8c0759e700 1 -- 172.21.15.63:0/3604815256 shutdown_connections 2020-05-18T21:26:58.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.107+0000 7f8c0759e700 1 -- 172.21.15.63:0/3604815256 wait complete. 2020-05-18T21:26:58.121 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:26:58.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.227+0000 7ff54e001700 1 Processor -- start 2020-05-18T21:26:58.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.227+0000 7ff54e001700 1 -- start start 2020-05-18T21:26:58.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54e001700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff54805ef00 0x7ff5480b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:58.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54e001700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff54809db40 0x7ff54809df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:58.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54e001700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5480616d0 con 0x7ff548061260 2020-05-18T21:26:58.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54e001700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5480af9b0 con 0x7ff54805ef00 2020-05-18T21:26:58.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54e001700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5480b4f40 con 0x7ff54809db40 2020-05-18T21:26:58.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54cfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff54805ef00 0x7ff5480b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:58.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54cfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff54805ef00 0x7ff5480b55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53112/0 (socket says 172.21.15.63:53112) 2020-05-18T21:26:58.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54cfff700 1 -- 172.21.15.63:0/1287043092 learned_addr learned my addr 172.21.15.63:0/1287043092 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:58.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54d800700 1 --2- 172.21.15.63:0/1287043092 >> v2:172.21.15.155:3300/0 conn(0x7ff54809db40 0x7ff54809df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:58.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54cfff700 1 -- 172.21.15.63:0/1287043092 >> v2:172.21.15.155:3300/0 conn(0x7ff54809db40 msgr2=0x7ff54809df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:58.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54cfff700 1 --2- 172.21.15.63:0/1287043092 >> v2:172.21.15.155:3300/0 conn(0x7ff54809db40 0x7ff54809df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:58.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54cfff700 1 -- 172.21.15.63:0/1287043092 >> v1:172.21.15.155:6789/0 conn(0x7ff548061260 legacy=0x7ff5480b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:58.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff5477fe700 1 -- 172.21.15.63:0/1287043092 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841319679 0 0) 0x7ff5480616d0 con 0x7ff548061260 2020-05-18T21:26:58.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54cfff700 1 -- 172.21.15.63:0/1287043092 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5480b51e0 con 0x7ff54805ef00 2020-05-18T21:26:58.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54cfff700 1 --2- 172.21.15.63:0/1287043092 >> v2:172.21.15.63:3300/0 conn(0x7ff54805ef00 0x7ff5480b55b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff538002f70 tx=0x7ff538007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54cfff700 1 --2- 172.21.15.63:0/1287043092 >> v2:172.21.15.63:3300/0 conn(0x7ff54805ef00 0x7ff5480b55b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff538002f70 tx=0x7ff538007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54cfff700 1 --2- 172.21.15.63:0/1287043092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff54805ef00 0x7ff5480b55b0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7ff538002f70 tx=0x7ff538007a80).ready entity=mon.0 client_cookie=e58d449d24f5e9fb server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:58.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54cfff700 1 --2- 172.21.15.63:0/1287043092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff54805ef00 0x7ff5480b55b0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7ff538002f70 tx=0x7ff538007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff5477fe700 1 -- 172.21.15.63:0/1287043092 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5380116b0 con 0x7ff54805ef00 2020-05-18T21:26:58.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54cfff700 1 --2- 172.21.15.63:0/1287043092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff54805ef00 0x7ff5480b55b0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7ff538002f70 tx=0x7ff538007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54cfff700 1 --2- 172.21.15.63:0/1287043092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff54805ef00 0x7ff5480b55b0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7ff538002f70 tx=0x7ff538007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff5477fe700 1 -- 172.21.15.63:0/1287043092 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff538011810 con 0x7ff54805ef00 2020-05-18T21:26:58.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff5477fe700 1 -- 172.21.15.63:0/1287043092 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff538011bf0 con 0x7ff54805ef00 2020-05-18T21:26:58.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54e001700 1 -- 172.21.15.63:0/1287043092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff54805ef00 msgr2=0x7ff5480b55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:58.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54e001700 1 --2- 172.21.15.63:0/1287043092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff54805ef00 0x7ff5480b55b0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7ff538002f70 tx=0x7ff538007a80).stop 2020-05-18T21:26:58.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54e001700 1 -- 172.21.15.63:0/1287043092 shutdown_connections 2020-05-18T21:26:58.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54e001700 1 --2- 172.21.15.63:0/1287043092 >> v2:172.21.15.155:3300/0 conn(0x7ff54809db40 0x7ff54809df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:58.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54e001700 1 --2- 172.21.15.63:0/1287043092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff54805ef00 0x7ff5480b55b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:58.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54e001700 1 -- 172.21.15.63:0/1287043092 >> 172.21.15.63:0/1287043092 conn(0x7ff54805b290 msgr2=0x7ff5480b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:58.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54e001700 1 -- 172.21.15.63:0/1287043092 shutdown_connections 2020-05-18T21:26:58.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.231+0000 7ff54e001700 1 -- 172.21.15.63:0/1287043092 wait complete. 2020-05-18T21:26:58.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54e001700 1 Processor -- start 2020-05-18T21:26:58.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54e001700 1 -- start start 2020-05-18T21:26:58.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54e001700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff548061260 0x7ff548118e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:58.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54e001700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff54809db40 0x7ff548069eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:58.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54e001700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff54806a310 con 0x7ff54805ef00 2020-05-18T21:26:58.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54e001700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5481184a0 con 0x7ff54809db40 2020-05-18T21:26:58.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54e001700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff548118740 con 0x7ff548061260 2020-05-18T21:26:58.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54d800700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff54809db40 0x7ff548069eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:58.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54d800700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff54809db40 0x7ff548069eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53122/0 (socket says 172.21.15.63:53122) 2020-05-18T21:26:58.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54d800700 1 -- 172.21.15.63:0/3647159857 learned_addr learned my addr 172.21.15.63:0/3647159857 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:58.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff547fff700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff548061260 0x7ff548118e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:58.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54d800700 1 -- 172.21.15.63:0/3647159857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff548061260 msgr2=0x7ff548118e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:58.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54d800700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff548061260 0x7ff548118e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:58.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54d800700 1 -- 172.21.15.63:0/3647159857 >> v1:172.21.15.155:6789/0 conn(0x7ff54805ef00 legacy=0x7ff548063330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:58.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54d800700 1 -- 172.21.15.63:0/3647159857 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5481189e0 con 0x7ff54809db40 2020-05-18T21:26:58.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54d800700 1 --2- 172.21.15.63:0/3647159857 >> v2:172.21.15.63:3300/0 conn(0x7ff54809db40 0x7ff548069eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff5400032f0 tx=0x7ff540011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54d800700 1 --2- 172.21.15.63:0/3647159857 >> v2:172.21.15.63:3300/0 conn(0x7ff54809db40 0x7ff548069eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff5400032f0 tx=0x7ff540011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54d800700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff54809db40 0x7ff548069eb0 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7ff5400032f0 tx=0x7ff540011020).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:58.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54d800700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff54809db40 0x7ff548069eb0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff5400032f0 tx=0x7ff540011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54d800700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff54809db40 0x7ff548069eb0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff5400032f0 tx=0x7ff540011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff545ffb700 1 -- 172.21.15.63:0/3647159857 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff540012ae0 con 0x7ff54809db40 2020-05-18T21:26:58.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54d800700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff54809db40 0x7ff548069eb0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff5400032f0 tx=0x7ff540011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff545ffb700 1 -- 172.21.15.63:0/3647159857 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff540012c40 con 0x7ff54809db40 2020-05-18T21:26:58.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54e001700 1 -- 172.21.15.63:0/3647159857 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff548118190 con 0x7ff54809db40 2020-05-18T21:26:58.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff545ffb700 1 -- 172.21.15.63:0/3647159857 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff540012e30 con 0x7ff54809db40 2020-05-18T21:26:58.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.235+0000 7ff54e001700 1 -- 172.21.15.63:0/3647159857 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff548140e70 con 0x7ff54809db40 2020-05-18T21:26:58.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.239+0000 7ff54e001700 1 -- 172.21.15.63:0/3647159857 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff548118be0 con 0x7ff54809db40 2020-05-18T21:26:58.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.239+0000 7ff54d800700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff54809db40 0x7ff548069eb0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff5400032f0 tx=0x7ff540011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.239+0000 7ff545ffb700 1 -- 172.21.15.63:0/3647159857 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff540005c70 con 0x7ff54809db40 2020-05-18T21:26:58.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.239+0000 7ff54d800700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff54809db40 0x7ff548069eb0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff5400032f0 tx=0x7ff540011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.239+0000 7ff545ffb700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff52804f9f0 0x7ff528051eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:58.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.239+0000 7ff545ffb700 1 -- 172.21.15.63:0/3647159857 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff540063d00 con 0x7ff54809db40 2020-05-18T21:26:58.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.239+0000 7ff54cfff700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff52804f9f0 0x7ff528051eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:58.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.239+0000 7ff54cfff700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff52804f9f0 0x7ff528051eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff5480b7f00 tx=0x7ff538007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.239+0000 7ff54cfff700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff52804f9f0 0x7ff528051eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff5480b7f00 tx=0x7ff538007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.239+0000 7ff54cfff700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff52804f9f0 0x7ff528051eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7ff5480b7f00 tx=0x7ff538007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:58.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.243+0000 7ff54d800700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff54809db40 0x7ff548069eb0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff5400032f0 tx=0x7ff540011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.243+0000 7ff545ffb700 1 -- 172.21.15.63:0/3647159857 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff548118be0 con 0x7ff54809db40 2020-05-18T21:26:58.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.359+0000 7ff54e001700 1 -- 172.21.15.63:0/3647159857 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff548118be0 con 0x7ff54809db40 2020-05-18T21:26:58.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.359+0000 7ff54d800700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff54809db40 0x7ff548069eb0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff5400032f0 tx=0x7ff540011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.359+0000 7ff545ffb700 1 -- 172.21.15.63:0/3647159857 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff548118be0 con 0x7ff54809db40 2020-05-18T21:26:58.363 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:26:58.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.359+0000 7ff54e001700 1 -- 172.21.15.63:0/3647159857 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff52804f9f0 msgr2=0x7ff528051eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:58.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.359+0000 7ff54e001700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff52804f9f0 0x7ff528051eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7ff5480b7f00 tx=0x7ff538007a80).stop 2020-05-18T21:26:58.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.359+0000 7ff54e001700 1 -- 172.21.15.63:0/3647159857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff54809db40 msgr2=0x7ff548069eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:58.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.359+0000 7ff54e001700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff54809db40 0x7ff548069eb0 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7ff5400032f0 tx=0x7ff540011020).stop 2020-05-18T21:26:58.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.359+0000 7ff54e001700 1 -- 172.21.15.63:0/3647159857 shutdown_connections 2020-05-18T21:26:58.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.359+0000 7ff54e001700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff52804f9f0 0x7ff528051eb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:58.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.359+0000 7ff54e001700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff54809db40 0x7ff548069eb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:58.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.359+0000 7ff54e001700 1 --2- 172.21.15.63:0/3647159857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff548061260 0x7ff548118e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:58.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.359+0000 7ff54e001700 1 -- 172.21.15.63:0/3647159857 >> 172.21.15.63:0/3647159857 conn(0x7ff54805b290 msgr2=0x7ff5480b5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:58.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.359+0000 7ff54e001700 1 -- 172.21.15.63:0/3647159857 shutdown_connections 2020-05-18T21:26:58.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.359+0000 7ff54e001700 1 -- 172.21.15.63:0/3647159857 wait complete. 2020-05-18T21:26:58.375 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:26:58.375 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:26:58.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.475+0000 7f428bfd3700 1 Processor -- start 2020-05-18T21:26:58.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428bfd3700 1 -- start start 2020-05-18T21:26:58.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428bfd3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f42840b4f60 0x7f4284149f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:58.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428bfd3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4284146110 0x7f4284146590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:26:58.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428bfd3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42840637b0 con 0x7f42840b5c00 2020-05-18T21:26:58.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428bfd3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4284063a50 con 0x7f42840b4f60 2020-05-18T21:26:58.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428bfd3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42840bb4a0 con 0x7f4284146110 2020-05-18T21:26:58.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428956e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f42840b4f60 0x7f4284149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:58.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428956e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f42840b4f60 0x7f4284149f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53126/0 (socket says 172.21.15.63:53126) 2020-05-18T21:26:58.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428956e700 1 -- 172.21.15.63:0/1719851410 learned_addr learned my addr 172.21.15.63:0/1719851410 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:58.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428a570700 1 --2- 172.21.15.63:0/1719851410 >> v2:172.21.15.155:3300/0 conn(0x7f4284146110 0x7f4284146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:58.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428956e700 1 -- 172.21.15.63:0/1719851410 >> v2:172.21.15.155:3300/0 conn(0x7f4284146110 msgr2=0x7f4284146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:26:58.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428956e700 1 --2- 172.21.15.63:0/1719851410 >> v2:172.21.15.155:3300/0 conn(0x7f4284146110 0x7f4284146590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:58.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428956e700 1 -- 172.21.15.63:0/1719851410 >> v1:172.21.15.63:6789/0 conn(0x7f42840b5c00 legacy=0x7f42840b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:58.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428956e700 1 -- 172.21.15.63:0/1719851410 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4284063200 con 0x7f42840b4f60 2020-05-18T21:26:58.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f4288d6d700 1 -- 172.21.15.63:0/1719851410 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11016922 0 0) 0x7f42840637b0 con 0x7f42840b5c00 2020-05-18T21:26:58.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428956e700 1 --2- 172.21.15.63:0/1719851410 >> v2:172.21.15.63:3300/0 conn(0x7f42840b4f60 0x7f4284149f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4274002f70 tx=0x7f4274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428956e700 1 --2- 172.21.15.63:0/1719851410 >> v2:172.21.15.63:3300/0 conn(0x7f42840b4f60 0x7f4284149f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4274002f70 tx=0x7f4274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428956e700 1 --2- 172.21.15.63:0/1719851410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42840b4f60 0x7f4284149f60 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f4274002f70 tx=0x7f4274007a80).ready entity=mon.0 client_cookie=90b97f32c1b83dbd server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:58.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428956e700 1 --2- 172.21.15.63:0/1719851410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42840b4f60 0x7f4284149f60 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f4274002f70 tx=0x7f4274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428956e700 1 --2- 172.21.15.63:0/1719851410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42840b4f60 0x7f4284149f60 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f4274002f70 tx=0x7f4274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f4288d6d700 1 -- 172.21.15.63:0/1719851410 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42740116b0 con 0x7f42840b4f60 2020-05-18T21:26:58.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428956e700 1 --2- 172.21.15.63:0/1719851410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42840b4f60 0x7f4284149f60 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f4274002f70 tx=0x7f4274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f4288d6d700 1 -- 172.21.15.63:0/1719851410 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4274011810 con 0x7f42840b4f60 2020-05-18T21:26:58.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f4288d6d700 1 -- 172.21.15.63:0/1719851410 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4274011bf0 con 0x7f42840b4f60 2020-05-18T21:26:58.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428bfd3700 1 -- 172.21.15.63:0/1719851410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42840b4f60 msgr2=0x7f4284149f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:58.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428bfd3700 1 --2- 172.21.15.63:0/1719851410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42840b4f60 0x7f4284149f60 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f4274002f70 tx=0x7f4274007a80).stop 2020-05-18T21:26:58.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428bfd3700 1 -- 172.21.15.63:0/1719851410 shutdown_connections 2020-05-18T21:26:58.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428bfd3700 1 --2- 172.21.15.63:0/1719851410 >> v2:172.21.15.155:3300/0 conn(0x7f4284146110 0x7f4284146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:26:58.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428bfd3700 1 --2- 172.21.15.63:0/1719851410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42840b4f60 0x7f4284149f60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:58.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428bfd3700 1 -- 172.21.15.63:0/1719851410 >> 172.21.15.63:0/1719851410 conn(0x7f42840ba5c0 msgr2=0x7f42840ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:58.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428bfd3700 1 -- 172.21.15.63:0/1719851410 shutdown_connections 2020-05-18T21:26:58.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.479+0000 7f428bfd3700 1 -- 172.21.15.63:0/1719851410 wait complete. 2020-05-18T21:26:58.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f428bfd3700 1 Processor -- start 2020-05-18T21:26:58.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f428bfd3700 1 -- start start 2020-05-18T21:26:58.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f428bfd3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f42840b4f60 0x7f428413f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:58.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f428bfd3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42840b5c00 0x7f4284065450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:58.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f428bfd3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42840658b0 con 0x7f4284146110 2020-05-18T21:26:58.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f428bfd3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4284065af0 con 0x7f42840b4f60 2020-05-18T21:26:58.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f428bfd3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4284065d90 con 0x7f42840b5c00 2020-05-18T21:26:58.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f4289d6f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f42840b4f60 0x7f428413f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:58.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f4289d6f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f42840b4f60 0x7f428413f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53132/0 (socket says 172.21.15.63:53132) 2020-05-18T21:26:58.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f4289d6f700 1 -- 172.21.15.63:0/4118471663 learned_addr learned my addr 172.21.15.63:0/4118471663 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:26:58.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f428956e700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42840b5c00 0x7f4284065450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:58.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f4289d6f700 1 -- 172.21.15.63:0/4118471663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42840b5c00 msgr2=0x7f4284065450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:58.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f4289d6f700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42840b5c00 0x7f4284065450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:58.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f4289d6f700 1 -- 172.21.15.63:0/4118471663 >> v1:172.21.15.155:6789/0 conn(0x7f4284146110 legacy=0x7f428413dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:58.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f4289d6f700 1 -- 172.21.15.63:0/4118471663 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4284140dd0 con 0x7f42840b4f60 2020-05-18T21:26:58.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f4289d6f700 1 --2- 172.21.15.63:0/4118471663 >> v2:172.21.15.63:3300/0 conn(0x7f42840b4f60 0x7f428413f190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4280000bc0 tx=0x7f42800109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f4289d6f700 1 --2- 172.21.15.63:0/4118471663 >> v2:172.21.15.63:3300/0 conn(0x7f42840b4f60 0x7f428413f190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4280000bc0 tx=0x7f42800109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f4289d6f700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42840b4f60 0x7f428413f190 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7f4280000bc0 tx=0x7f42800109a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:58.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f4289d6f700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42840b4f60 0x7f428413f190 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f4280000bc0 tx=0x7f42800109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f4289d6f700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42840b4f60 0x7f428413f190 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f4280000bc0 tx=0x7f42800109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f4272ffd700 1 -- 172.21.15.63:0/4118471663 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f428000cc60 con 0x7f42840b4f60 2020-05-18T21:26:58.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f4289d6f700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42840b4f60 0x7f428413f190 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f4280000bc0 tx=0x7f42800109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f4272ffd700 1 -- 172.21.15.63:0/4118471663 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428000cdc0 con 0x7f42840b4f60 2020-05-18T21:26:58.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.483+0000 7f428bfd3700 1 -- 172.21.15.63:0/4118471663 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428413e480 con 0x7f42840b4f60 2020-05-18T21:26:58.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.487+0000 7f4272ffd700 1 -- 172.21.15.63:0/4118471663 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4280012230 con 0x7f42840b4f60 2020-05-18T21:26:58.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.487+0000 7f428bfd3700 1 -- 172.21.15.63:0/4118471663 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4284147bf0 con 0x7f42840b4f60 2020-05-18T21:26:58.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.487+0000 7f4289d6f700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42840b4f60 0x7f428413f190 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f4280000bc0 tx=0x7f42800109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.487+0000 7f428bfd3700 1 -- 172.21.15.63:0/4118471663 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4284147f00 con 0x7f42840b4f60 2020-05-18T21:26:58.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.487+0000 7f4272ffd700 1 -- 172.21.15.63:0/4118471663 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4280006520 con 0x7f42840b4f60 2020-05-18T21:26:58.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.487+0000 7f4289d6f700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42840b4f60 0x7f428413f190 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f4280000bc0 tx=0x7f42800109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.487+0000 7f4272ffd700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f426404f8f0 0x7f4264051db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:26:58.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.487+0000 7f4272ffd700 1 -- 172.21.15.63:0/4118471663 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f42800638b0 con 0x7f42840b4f60 2020-05-18T21:26:58.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.487+0000 7f428956e700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f426404f8f0 0x7f4264051db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:26:58.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.487+0000 7f428956e700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f426404f8f0 0x7f4264051db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4274002f70 tx=0x7f4274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.487+0000 7f428956e700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f426404f8f0 0x7f4264051db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4274002f70 tx=0x7f4274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.491+0000 7f428956e700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f426404f8f0 0x7f4264051db0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f4274002f70 tx=0x7f4274007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:26:58.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.495+0000 7f4289d6f700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42840b4f60 0x7f428413f190 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f4280000bc0 tx=0x7f42800109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.495+0000 7f4272ffd700 1 -- 172.21.15.63:0/4118471663 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f428003dbe0 con 0x7f42840b4f60 2020-05-18T21:26:58.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.647+0000 7f428bfd3700 1 -- 172.21.15.63:0/4118471663 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42840569e0 con 0x7f42840b4f60 2020-05-18T21:26:58.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.651+0000 7f4289d6f700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42840b4f60 0x7f428413f190 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f4280000bc0 tx=0x7f42800109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:26:58.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.651+0000 7f4272ffd700 1 -- 172.21.15.63:0/4118471663 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2137 (secure 0 0 0) 0x7f4280041200 con 0x7f42840b4f60 2020-05-18T21:26:58.653 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:26:58.653 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4404,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2550679674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2550679674},{"type":"v1","addr":"172.21.15.155:6835","nonce":2550679674}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":7}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:26:45.491730+0000","modified":"2020-05-18T21:26:49.514812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4369},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4369":{"gid":4369,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.63:6833/2283817704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2283817704},{"type":"v1","addr":"172.21.15.63:6833","nonce":2283817704}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-05-18T21:26:58.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.651+0000 7f428bfd3700 1 -- 172.21.15.63:0/4118471663 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f426404f8f0 msgr2=0x7f4264051db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:58.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.651+0000 7f428bfd3700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f426404f8f0 0x7f4264051db0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f4274002f70 tx=0x7f4274007a80).stop 2020-05-18T21:26:58.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.651+0000 7f428bfd3700 1 -- 172.21.15.63:0/4118471663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42840b4f60 msgr2=0x7f428413f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:26:58.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.651+0000 7f428bfd3700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42840b4f60 0x7f428413f190 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7f4280000bc0 tx=0x7f42800109a0).stop 2020-05-18T21:26:58.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.651+0000 7f428bfd3700 1 -- 172.21.15.63:0/4118471663 shutdown_connections 2020-05-18T21:26:58.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.651+0000 7f428bfd3700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f426404f8f0 0x7f4264051db0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:58.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.651+0000 7f428bfd3700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42840b5c00 0x7f4284065450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:58.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.651+0000 7f428bfd3700 1 --2- 172.21.15.63:0/4118471663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42840b4f60 0x7f428413f190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:26:58.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.651+0000 7f428bfd3700 1 -- 172.21.15.63:0/4118471663 >> 172.21.15.63:0/4118471663 conn(0x7f42840ba5c0 msgr2=0x7f42840ba9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:26:58.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.651+0000 7f428bfd3700 1 -- 172.21.15.63:0/4118471663 shutdown_connections 2020-05-18T21:26:58.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:26:58.651+0000 7f428bfd3700 1 -- 172.21.15.63:0/4118471663 wait complete. 2020-05-18T21:26:58.657 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 7 2020-05-18T21:26:58.812 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:26:58.815 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:26:58.867 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:26:45.491730+0000', 'modified': '2020-05-18T21:26:49.514812+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4369}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4369': {'gid': 4369, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.63:6833/2283817704', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 2283817704}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 2283817704}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:26:58.867 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:26:58.868 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:26:58.974 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:26:58.975 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:26:58.975 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:26:58.975 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4369, 2020-05-18T21:26:58.975 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:26:58.976 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:26:58.976 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 10.453502891999999, 2020-05-18T21:26:58.976 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 6, 2020-05-18T21:26:58.976 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 23, 2020-05-18T21:26:58.977 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 23, 2020-05-18T21:26:58.977 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 11.147974049 2020-05-18T21:26:58.977 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:26:58.983 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 4369, "want_state": "up:active", "state": "up:active", "rank_uptime": 10.453502891999999, "mdsmap_epoch": 6, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "uptime": 11.147974049 } 2020-05-18T21:26:58.984 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:26:58.984 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:26:58.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:58.985 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:26:58.993 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:26:58.993 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:26:58.994 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:26:58.994 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:26:58.994 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:26:58.995 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:26:58.995 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:26:58.995 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:26:58.995 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:26:58.995 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:26:58.996 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:26:58.996 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:26:58.996 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:26:58.996 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:26:58.996 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:26:58.997 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42824sec preferred_lft 42824sec 2020-05-18T21:26:58.997 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:26:58.997 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:26:58.998 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:26:58.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:58.999 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:26:59.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:59.101 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:26:59.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:59.118 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:26:59.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:59.180 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:26:59.192 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:26:59.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:59.194 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:26:59.218 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:26:59.218 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:26:59.218 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:26:59.219 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:26:59.219 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:26:59.219 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:26:59.219 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:26:59.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:59.220 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:26:59.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:59.316 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:26:59.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:59.335 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:26:59.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:59.403 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:26:59.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:59.409 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:26:59.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:59.417 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:26:59.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:59.438 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-05-18T21:26:59.499 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-05-18T21:26:59.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:59.500 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-05-18T21:26:59.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:59.540 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:26:59.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:59.559 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-05-18T21:26:59.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:59.624 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-05-18T21:26:59.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:59.646 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-05-18T21:26:59.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:59.728 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 up' 2020-05-18T21:26:59.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:26:59.793 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.0 master ceph-brx' 2020-05-18T21:26:59.818 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-05-18T21:26:59.819 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-05-18T21:26:59.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:26:59.820 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:26:59.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:26:59.880 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:26:59.939 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:26:59.940 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:26:59.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:26:59.941 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:26:59.948 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:26:59.949 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:26:59.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:26:59.995 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:27:00.056 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:27:00.056 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:27:00.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:00.057 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:27:00.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2020-05-18T21:27:00.083+0000 7fb9ae4bd080 -1 init, newargv = 0x564fb3d7c530 newargc=9 2020-05-18T21:27:00.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[15093]: starting ceph client 2020-05-18T21:27:00.096 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[15093]: starting fuse 2020-05-18T21:27:01.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:01.166 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:27:01.182 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:27:01.183 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:27:01.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:01.184 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:27:01.230 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:27:01.230 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:27:01.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:01.231 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:27:01.231 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:27:01.232 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:27:01.232 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:27:01.232 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:27:01.233 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:27:01.233 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:27:01.233 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:27:01.234 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:27:01.234 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:27:01.234 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:27:01.235 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:27:01.235 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:27:01.236 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:27:01.236 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:27:01.236 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:27:01.237 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:27:01.237 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:27:01.237 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:27:01.238 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:27:01.238 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:27:01.238 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:27:01.239 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:27:01.287 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.15093.asok 2020-05-18T21:27:01.292 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15093.asok 2020-05-18T21:27:01.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:01.293 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15093.asok status 2020-05-18T21:27:01.382 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:27:01.383 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:27:01.383 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:27:01.383 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:27:01.383 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:27:01.384 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:27:01.384 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:27:01.384 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "15093", 2020-05-18T21:27:01.384 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:27:01.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:01.385 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:27:01.385 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:27:01.385 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4376, 2020-05-18T21:27:01.385 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:27:01.385 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:27:01.386 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:27:01.386 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 4376 2020-05-18T21:27:01.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:01.387 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:27:01.387 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:01.387 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:27:01.387 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2770431997 2020-05-18T21:27:01.388 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:01.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:01.388 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:27:01.388 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:01.389 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:27:01.389 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2770431997 2020-05-18T21:27:01.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:01.389 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.4376 192.168.0.1:0/2770431997", 2020-05-18T21:27:01.389 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/2770431997", 2020-05-18T21:27:01.390 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:27:01.390 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 6, 2020-05-18T21:27:01.390 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 23, 2020-05-18T21:27:01.390 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:27:01.390 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:27:01.390 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:27:01.392 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:27:01.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.491+0000 7f161d0fc700 1 Processor -- start 2020-05-18T21:27:01.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161d0fc700 1 -- start start 2020-05-18T21:27:01.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161d0fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f16180bbcd0 0x7f16180afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:01.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161d0fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16180b0280 0x7f161812efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:01.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161d0fc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16180af980 con 0x7f16180bb5e0 2020-05-18T21:27:01.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161d0fc700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16180af7a0 con 0x7f16180bbcd0 2020-05-18T21:27:01.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161d0fc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16180bb9c0 con 0x7f16180b0280 2020-05-18T21:27:01.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161659c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f16180bbcd0 0x7f16180afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:01.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16180b0280 0x7f161812efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:01.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161659c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f16180bbcd0 0x7f16180afe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:39772/0 (socket says 172.21.15.63:39772) 2020-05-18T21:27:01.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16180b0280 0x7f161812efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:43860/0 (socket says 172.21.15.63:43860) 2020-05-18T21:27:01.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161659c700 1 -- 172.21.15.63:0/2449587109 learned_addr learned my addr 172.21.15.63:0/2449587109 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:01.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f1616d9d700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f16180bb5e0 0x7f16180acee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:53658/0 (socket says 172.21.15.63:53658) 2020-05-18T21:27:01.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161759e700 1 -- 172.21.15.63:0/2449587109 >> v2:172.21.15.155:3300/0 conn(0x7f16180bbcd0 msgr2=0x7f16180afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:01.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161759e700 1 --2- 172.21.15.63:0/2449587109 >> v2:172.21.15.155:3300/0 conn(0x7f16180bbcd0 0x7f16180afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:01.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161759e700 1 -- 172.21.15.63:0/2449587109 >> v1:172.21.15.155:6789/0 conn(0x7f16180bb5e0 legacy=0x7f16180acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:01.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161759e700 1 -- 172.21.15.63:0/2449587109 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16180af3d0 con 0x7f16180b0280 2020-05-18T21:27:01.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161659c700 1 --2- 172.21.15.63:0/2449587109 >> v2:172.21.15.155:3300/0 conn(0x7f16180bbcd0 0x7f16180afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:01.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161759e700 1 --2- 172.21.15.63:0/2449587109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16180b0280 0x7f161812efd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f16100032f0 tx=0x7f1610007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161759e700 1 --2- 172.21.15.63:0/2449587109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16180b0280 0x7f161812efd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f16100032f0 tx=0x7f1610007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161759e700 1 --2- 172.21.15.63:0/2449587109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16180b0280 0x7f161812efd0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f16100032f0 tx=0x7f1610007e00).ready entity=mon.2 client_cookie=8e837048f4762dd4 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161759e700 1 --2- 172.21.15.63:0/2449587109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16180b0280 0x7f161812efd0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f16100032f0 tx=0x7f1610007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f1615d9b700 1 -- 172.21.15.63:0/2449587109 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1610011e60 con 0x7f16180b0280 2020-05-18T21:27:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161759e700 1 --2- 172.21.15.63:0/2449587109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16180b0280 0x7f161812efd0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f16100032f0 tx=0x7f1610007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161759e700 1 --2- 172.21.15.63:0/2449587109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16180b0280 0x7f161812efd0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f16100032f0 tx=0x7f1610007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f1615d9b700 1 -- 172.21.15.63:0/2449587109 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161000a180 con 0x7f16180b0280 2020-05-18T21:27:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f1615d9b700 1 -- 172.21.15.63:0/2449587109 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f161000a560 con 0x7f16180b0280 2020-05-18T21:27:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161d0fc700 1 -- 172.21.15.63:0/2449587109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16180b0280 msgr2=0x7f161812efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.495+0000 7f161d0fc700 1 --2- 172.21.15.63:0/2449587109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16180b0280 0x7f161812efd0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f16100032f0 tx=0x7f1610007e00).stop 2020-05-18T21:27:01.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.499+0000 7f161d0fc700 1 -- 172.21.15.63:0/2449587109 shutdown_connections 2020-05-18T21:27:01.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.499+0000 7f161d0fc700 1 --2- 172.21.15.63:0/2449587109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16180b0280 0x7f161812efd0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:01.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.499+0000 7f161d0fc700 1 --2- 172.21.15.63:0/2449587109 >> v2:172.21.15.155:3300/0 conn(0x7f16180bbcd0 0x7f16180afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:01.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.499+0000 7f161d0fc700 1 -- 172.21.15.63:0/2449587109 >> 172.21.15.63:0/2449587109 conn(0x7f1618069b70 msgr2=0x7f1618069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:01.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.499+0000 7f161d0fc700 1 -- 172.21.15.63:0/2449587109 shutdown_connections 2020-05-18T21:27:01.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.499+0000 7f161d0fc700 1 -- 172.21.15.63:0/2449587109 wait complete. 2020-05-18T21:27:01.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.499+0000 7f161d0fc700 1 Processor -- start 2020-05-18T21:27:01.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.499+0000 7f161d0fc700 1 -- start start 2020-05-18T21:27:01.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f161d0fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f16180b0280 0x7f1618124ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:01.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f161d0fc700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1618131e40 con 0x7f16180bb5e0 2020-05-18T21:27:01.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f161d0fc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1618131460 con 0x7f16180bbcd0 2020-05-18T21:27:01.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f161d0fc700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1618131700 con 0x7f16180b0280 2020-05-18T21:27:01.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f161659c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f16180bb5e0 0x7f16180b36e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55350/0 (socket says 172.21.15.63:55350) 2020-05-18T21:27:01.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f161659c700 1 -- 172.21.15.63:0/3068939752 learned_addr learned my addr 172.21.15.63:0/3068939752 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:01.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f1616d9d700 1 --2- 172.21.15.63:0/3068939752 >> v2:172.21.15.155:3300/0 conn(0x7f16180b0280 0x7f1618124ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:01.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f1607fff700 1 -- 172.21.15.63:0/3068939752 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510875662 0 0) 0x7f1618131e40 con 0x7f16180bb5e0 2020-05-18T21:27:01.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f1607fff700 1 -- 172.21.15.63:0/3068939752 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15f4002fe0 con 0x7f16180bb5e0 2020-05-18T21:27:01.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f1607fff700 1 -- 172.21.15.63:0/3068939752 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805744321 0 0) 0x7f1618131460 con 0x7f16180bbcd0 2020-05-18T21:27:01.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f1607fff700 1 -- 172.21.15.63:0/3068939752 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1618131e40 con 0x7f16180bbcd0 2020-05-18T21:27:01.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f1616d9d700 1 -- 172.21.15.63:0/3068939752 >> v1:172.21.15.155:6789/0 conn(0x7f16180bbcd0 legacy=0x7f16180b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:01.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f1616d9d700 1 -- 172.21.15.63:0/3068939752 >> v1:172.21.15.63:6789/0 conn(0x7f16180bb5e0 legacy=0x7f16180b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:01.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f1607fff700 1 -- 172.21.15.63:0/3068939752 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4139598714 0 0) 0x7f15f4002fe0 con 0x7f16180bb5e0 2020-05-18T21:27:01.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f1616d9d700 1 -- 172.21.15.63:0/3068939752 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16181319a0 con 0x7f16180b0280 2020-05-18T21:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f1616d9d700 1 --2- 172.21.15.63:0/3068939752 >> v2:172.21.15.155:3300/0 conn(0x7f16180b0280 0x7f1618124ca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f160c0026a0 tx=0x7f16080108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f1616d9d700 1 --2- 172.21.15.63:0/3068939752 >> v2:172.21.15.155:3300/0 conn(0x7f16180b0280 0x7f1618124ca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f160c0026a0 tx=0x7f16080108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f1616d9d700 1 --2- 172.21.15.63:0/3068939752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16180b0280 0x7f1618124ca0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f160c0026a0 tx=0x7f16080108b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f1616d9d700 1 --2- 172.21.15.63:0/3068939752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16180b0280 0x7f1618124ca0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f160c0026a0 tx=0x7f16080108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f1616d9d700 1 --2- 172.21.15.63:0/3068939752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16180b0280 0x7f1618124ca0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f160c0026a0 tx=0x7f16080108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f1616d9d700 1 --2- 172.21.15.63:0/3068939752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16180b0280 0x7f1618124ca0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f160c0026a0 tx=0x7f16080108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f1607fff700 1 -- 172.21.15.63:0/3068939752 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f160c002500 con 0x7f16180b0280 2020-05-18T21:27:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f1607fff700 1 -- 172.21.15.63:0/3068939752 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1608011210 con 0x7f16180b0280 2020-05-18T21:27:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f1607fff700 1 -- 172.21.15.63:0/3068939752 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1608011630 con 0x7f16180b0280 2020-05-18T21:27:01.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f161d0fc700 1 -- 172.21.15.63:0/3068939752 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16180b3df0 con 0x7f16180b0280 2020-05-18T21:27:01.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.503+0000 7f161d0fc700 1 -- 172.21.15.63:0/3068939752 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1618130ce0 con 0x7f16180b0280 2020-05-18T21:27:01.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.507+0000 7f1616d9d700 1 --2- 172.21.15.63:0/3068939752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16180b0280 0x7f1618124ca0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f160c0026a0 tx=0x7f16080108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.507+0000 7f161d0fc700 1 -- 172.21.15.63:0/3068939752 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1618131b30 con 0x7f16180b0280 2020-05-18T21:27:01.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.507+0000 7f1607fff700 1 -- 172.21.15.63:0/3068939752 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1608011790 con 0x7f16180b0280 2020-05-18T21:27:01.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.507+0000 7f1616d9d700 1 --2- 172.21.15.63:0/3068939752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16180b0280 0x7f1618124ca0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f160c0026a0 tx=0x7f16080108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.507+0000 7f1607fff700 1 --2- 172.21.15.63:0/3068939752 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f15f404fed0 0x7f15f4052390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:01.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.507+0000 7f1607fff700 1 -- 172.21.15.63:0/3068939752 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1608063990 con 0x7f16180b0280 2020-05-18T21:27:01.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.507+0000 7f161659c700 1 --2- 172.21.15.63:0/3068939752 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f15f404fed0 0x7f15f4052390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:01.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.507+0000 7f161659c700 1 --2- 172.21.15.63:0/3068939752 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f15f404fed0 0x7f15f4052390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f160c0030b0 tx=0x7f160c002840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.511+0000 7f161659c700 1 --2- 172.21.15.63:0/3068939752 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f15f404fed0 0x7f15f4052390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f160c0030b0 tx=0x7f160c002840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.511+0000 7f161659c700 1 --2- 172.21.15.63:0/3068939752 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f15f404fed0 0x7f15f4052390 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f160c0030b0 tx=0x7f160c002840).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:01.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.519+0000 7f1616d9d700 1 --2- 172.21.15.63:0/3068939752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16180b0280 0x7f1618124ca0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f160c0026a0 tx=0x7f16080108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.519+0000 7f1607fff700 1 -- 172.21.15.63:0/3068939752 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f160803dcc0 con 0x7f16180b0280 2020-05-18T21:27:01.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.635+0000 7f161d0fc700 1 -- 172.21.15.63:0/3068939752 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16180569e0 con 0x7f16180b0280 2020-05-18T21:27:01.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.635+0000 7f1616d9d700 1 --2- 172.21.15.63:0/3068939752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16180b0280 0x7f1618124ca0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f160c0026a0 tx=0x7f16080108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.635+0000 7f1607fff700 1 -- 172.21.15.63:0/3068939752 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f16080412e0 con 0x7f16180b0280 2020-05-18T21:27:01.641 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:01.641 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":23,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:26:47.498250+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:26:43.453504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-05-18T21:26:44.456531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:27:01.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.639+0000 7f161d0fc700 1 -- 172.21.15.63:0/3068939752 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f15f404fed0 msgr2=0x7f15f4052390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.639+0000 7f161d0fc700 1 --2- 172.21.15.63:0/3068939752 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f15f404fed0 0x7f15f4052390 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f160c0030b0 tx=0x7f160c002840).stop 2020-05-18T21:27:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.639+0000 7f161d0fc700 1 -- 172.21.15.63:0/3068939752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16180b0280 msgr2=0x7f1618124ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.639+0000 7f161d0fc700 1 --2- 172.21.15.63:0/3068939752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16180b0280 0x7f1618124ca0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f160c0026a0 tx=0x7f16080108b0).stop 2020-05-18T21:27:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.639+0000 7f161d0fc700 1 -- 172.21.15.63:0/3068939752 shutdown_connections 2020-05-18T21:27:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.639+0000 7f161d0fc700 1 --2- 172.21.15.63:0/3068939752 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f15f404fed0 0x7f15f4052390 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.639+0000 7f161d0fc700 1 --2- 172.21.15.63:0/3068939752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16180b0280 0x7f1618124ca0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.639+0000 7f161d0fc700 1 -- 172.21.15.63:0/3068939752 >> 172.21.15.63:0/3068939752 conn(0x7f1618069b70 msgr2=0x7f1618148ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.639+0000 7f161d0fc700 1 -- 172.21.15.63:0/3068939752 shutdown_connections 2020-05-18T21:27:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.639+0000 7f161d0fc700 1 -- 172.21.15.63:0/3068939752 wait complete. 2020-05-18T21:27:01.660 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:26:43.453504+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:26:44.456531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:27:01.661 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:27:01.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.763+0000 7fbe0eeb2700 1 Processor -- start 2020-05-18T21:27:01.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.763+0000 7fbe0eeb2700 1 -- start start 2020-05-18T21:27:01.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0eeb2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbe080bc8d0 0x7fbe08060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:01.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0eeb2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbe08145e30 0x7fbe08142f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:01.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0eeb2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbe08143380 0x7fbe0812e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:01.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0eeb2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe08146e00 con 0x7fbe080bc8d0 2020-05-18T21:27:01.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0eeb2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe08146420 con 0x7fbe08145e30 2020-05-18T21:27:01.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0eeb2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe081466c0 con 0x7fbe08143380 2020-05-18T21:27:01.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0deb0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbe080bc8d0 0x7fbe08060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:01.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0deb0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbe080bc8d0 0x7fbe08060b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53170/0 (socket says 172.21.15.63:53170) 2020-05-18T21:27:01.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0deb0700 1 -- 172.21.15.63:0/3676616357 learned_addr learned my addr 172.21.15.63:0/3676616357 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:01.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0d6af700 1 --2- 172.21.15.63:0/3676616357 >> v2:172.21.15.155:3300/0 conn(0x7fbe08145e30 0x7fbe08142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:01.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0e6b1700 1 --2- 172.21.15.63:0/3676616357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbe08143380 0x7fbe0812e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:01.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0deb0700 1 -- 172.21.15.63:0/3676616357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbe08143380 msgr2=0x7fbe0812e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:01.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0deb0700 1 --2- 172.21.15.63:0/3676616357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbe08143380 0x7fbe0812e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:01.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0deb0700 1 -- 172.21.15.63:0/3676616357 >> v2:172.21.15.155:3300/0 conn(0x7fbe08145e30 msgr2=0x7fbe08142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:01.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0deb0700 1 --2- 172.21.15.63:0/3676616357 >> v2:172.21.15.155:3300/0 conn(0x7fbe08145e30 0x7fbe08142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:01.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0deb0700 1 -- 172.21.15.63:0/3676616357 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe08146960 con 0x7fbe080bc8d0 2020-05-18T21:27:01.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0deb0700 1 --2- 172.21.15.63:0/3676616357 >> v2:172.21.15.63:3300/0 conn(0x7fbe080bc8d0 0x7fbe08060b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbdf8002f70 tx=0x7fbdf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0deb0700 1 --2- 172.21.15.63:0/3676616357 >> v2:172.21.15.63:3300/0 conn(0x7fbe080bc8d0 0x7fbe08060b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbdf8002f70 tx=0x7fbdf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0deb0700 1 --2- 172.21.15.63:0/3676616357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe080bc8d0 0x7fbe08060b00 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7fbdf8002f70 tx=0x7fbdf8007a80).ready entity=mon.0 client_cookie=1d04af9ec9398061 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:01.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0deb0700 1 --2- 172.21.15.63:0/3676616357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe080bc8d0 0x7fbe08060b00 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fbdf8002f70 tx=0x7fbdf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0ceae700 1 -- 172.21.15.63:0/3676616357 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf8011600 con 0x7fbe080bc8d0 2020-05-18T21:27:01.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0deb0700 1 --2- 172.21.15.63:0/3676616357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe080bc8d0 0x7fbe08060b00 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fbdf8002f70 tx=0x7fbdf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0deb0700 1 --2- 172.21.15.63:0/3676616357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe080bc8d0 0x7fbe08060b00 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fbdf8002f70 tx=0x7fbdf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0ceae700 1 -- 172.21.15.63:0/3676616357 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf8011760 con 0x7fbe080bc8d0 2020-05-18T21:27:01.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0ceae700 1 -- 172.21.15.63:0/3676616357 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf8011b80 con 0x7fbe080bc8d0 2020-05-18T21:27:01.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0eeb2700 1 -- 172.21.15.63:0/3676616357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe080bc8d0 msgr2=0x7fbe08060b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:01.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0eeb2700 1 --2- 172.21.15.63:0/3676616357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe080bc8d0 0x7fbe08060b00 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7fbdf8002f70 tx=0x7fbdf8007a80).stop 2020-05-18T21:27:01.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0eeb2700 1 -- 172.21.15.63:0/3676616357 shutdown_connections 2020-05-18T21:27:01.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0eeb2700 1 --2- 172.21.15.63:0/3676616357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbe08143380 0x7fbe0812e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:01.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0eeb2700 1 --2- 172.21.15.63:0/3676616357 >> v2:172.21.15.155:3300/0 conn(0x7fbe08145e30 0x7fbe08142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:01.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0eeb2700 1 --2- 172.21.15.63:0/3676616357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe080bc8d0 0x7fbe08060b00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:01.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0eeb2700 1 -- 172.21.15.63:0/3676616357 >> 172.21.15.63:0/3676616357 conn(0x7fbe0805f3b0 msgr2=0x7fbe0805f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:01.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0eeb2700 1 -- 172.21.15.63:0/3676616357 shutdown_connections 2020-05-18T21:27:01.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.767+0000 7fbe0eeb2700 1 -- 172.21.15.63:0/3676616357 wait complete. 2020-05-18T21:27:01.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0eeb2700 1 Processor -- start 2020-05-18T21:27:01.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0eeb2700 1 -- start start 2020-05-18T21:27:01.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0eeb2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbe080bc8d0 0x7fbe08148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:01.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0eeb2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbe08143380 0x7fbe08156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:01.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0eeb2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe08157270 con 0x7fbe08145e30 2020-05-18T21:27:01.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0eeb2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe080acfc0 con 0x7fbe08143380 2020-05-18T21:27:01.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0eeb2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe080ad260 con 0x7fbe080bc8d0 2020-05-18T21:27:01.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0d6af700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbe08143380 0x7fbe08156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:01.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0d6af700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbe08143380 0x7fbe08156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53176/0 (socket says 172.21.15.63:53176) 2020-05-18T21:27:01.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0d6af700 1 -- 172.21.15.63:0/40819179 learned_addr learned my addr 172.21.15.63:0/40819179 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:01.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0deb0700 1 --2- 172.21.15.63:0/40819179 >> v2:172.21.15.155:3300/0 conn(0x7fbe080bc8d0 0x7fbe08148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:01.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0d6af700 1 -- 172.21.15.63:0/40819179 >> v2:172.21.15.155:3300/0 conn(0x7fbe080bc8d0 msgr2=0x7fbe08148e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:01.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0d6af700 1 --2- 172.21.15.63:0/40819179 >> v2:172.21.15.155:3300/0 conn(0x7fbe080bc8d0 0x7fbe08148e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:01.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0d6af700 1 -- 172.21.15.63:0/40819179 >> v1:172.21.15.155:6789/0 conn(0x7fbe08145e30 legacy=0x7fbe080ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:01.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0d6af700 1 -- 172.21.15.63:0/40819179 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe080ad500 con 0x7fbe08143380 2020-05-18T21:27:01.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0d6af700 1 --2- 172.21.15.63:0/40819179 >> v2:172.21.15.63:3300/0 conn(0x7fbe08143380 0x7fbe08156e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbe040030b0 tx=0x7fbe08061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0d6af700 1 --2- 172.21.15.63:0/40819179 >> v2:172.21.15.63:3300/0 conn(0x7fbe08143380 0x7fbe08156e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbe040030b0 tx=0x7fbe08061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0d6af700 1 --2- 172.21.15.63:0/40819179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe08143380 0x7fbe08156e10 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7fbe040030b0 tx=0x7fbe08061d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:01.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0d6af700 1 --2- 172.21.15.63:0/40819179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe08143380 0x7fbe08156e10 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fbe040030b0 tx=0x7fbe08061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0d6af700 1 --2- 172.21.15.63:0/40819179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe08143380 0x7fbe08156e10 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fbe040030b0 tx=0x7fbe08061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbdf6ffd700 1 -- 172.21.15.63:0/40819179 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe04007180 con 0x7fbe08143380 2020-05-18T21:27:01.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.771+0000 7fbe0d6af700 1 --2- 172.21.15.63:0/40819179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe08143380 0x7fbe08156e10 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fbe040030b0 tx=0x7fbe08061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.775+0000 7fbdf6ffd700 1 -- 172.21.15.63:0/40819179 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe040072e0 con 0x7fbe08143380 2020-05-18T21:27:01.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.775+0000 7fbe0eeb2700 1 -- 172.21.15.63:0/40819179 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe080ae0b0 con 0x7fbe08143380 2020-05-18T21:27:01.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.775+0000 7fbdf6ffd700 1 -- 172.21.15.63:0/40819179 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe04012320 con 0x7fbe08143380 2020-05-18T21:27:01.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.775+0000 7fbe0eeb2700 1 -- 172.21.15.63:0/40819179 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe081418e0 con 0x7fbe08143380 2020-05-18T21:27:01.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.775+0000 7fbe0d6af700 1 --2- 172.21.15.63:0/40819179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe08143380 0x7fbe08156e10 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fbe040030b0 tx=0x7fbe08061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.775+0000 7fbe0eeb2700 1 -- 172.21.15.63:0/40819179 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe080569e0 con 0x7fbe08143380 2020-05-18T21:27:01.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.775+0000 7fbdf6ffd700 1 -- 172.21.15.63:0/40819179 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fbe04010190 con 0x7fbe08143380 2020-05-18T21:27:01.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.775+0000 7fbe0d6af700 1 --2- 172.21.15.63:0/40819179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe08143380 0x7fbe08156e10 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fbe040030b0 tx=0x7fbe08061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.775+0000 7fbdf6ffd700 1 --2- 172.21.15.63:0/40819179 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbde804fa60 0x7fbde8051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:01.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.775+0000 7fbdf6ffd700 1 -- 172.21.15.63:0/40819179 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbe04063f70 con 0x7fbe08143380 2020-05-18T21:27:01.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.775+0000 7fbe0deb0700 1 --2- 172.21.15.63:0/40819179 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbde804fa60 0x7fbde8051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:01.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.775+0000 7fbe0deb0700 1 --2- 172.21.15.63:0/40819179 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbde804fa60 0x7fbde8051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbdf8002f70 tx=0x7fbdf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.775+0000 7fbe0deb0700 1 --2- 172.21.15.63:0/40819179 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbde804fa60 0x7fbde8051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbdf8002f70 tx=0x7fbdf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.775+0000 7fbe0deb0700 1 --2- 172.21.15.63:0/40819179 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbde804fa60 0x7fbde8051f20 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fbdf8002f70 tx=0x7fbdf8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:01.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.783+0000 7fbe0d6af700 1 --2- 172.21.15.63:0/40819179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe08143380 0x7fbe08156e10 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fbe040030b0 tx=0x7fbe08061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.783+0000 7fbdf6ffd700 1 -- 172.21.15.63:0/40819179 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fbe0403e2a0 con 0x7fbe08143380 2020-05-18T21:27:01.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.899+0000 7fbe0eeb2700 1 -- 172.21.15.63:0/40819179 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbe080008d0 con 0x7fbe08143380 2020-05-18T21:27:01.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.899+0000 7fbe0d6af700 1 --2- 172.21.15.63:0/40819179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe08143380 0x7fbe08156e10 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fbe040030b0 tx=0x7fbe08061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:01.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.899+0000 7fbdf6ffd700 1 -- 172.21.15.63:0/40819179 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbe040418c0 con 0x7fbe08143380 2020-05-18T21:27:01.904 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:27:01.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.903+0000 7fbe0eeb2700 1 -- 172.21.15.63:0/40819179 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbde804fa60 msgr2=0x7fbde8051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:01.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.903+0000 7fbe0eeb2700 1 --2- 172.21.15.63:0/40819179 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbde804fa60 0x7fbde8051f20 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fbdf8002f70 tx=0x7fbdf8007a80).stop 2020-05-18T21:27:01.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.903+0000 7fbe0eeb2700 1 -- 172.21.15.63:0/40819179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe08143380 msgr2=0x7fbe08156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:01.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.903+0000 7fbe0eeb2700 1 --2- 172.21.15.63:0/40819179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe08143380 0x7fbe08156e10 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7fbe040030b0 tx=0x7fbe08061d60).stop 2020-05-18T21:27:01.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.903+0000 7fbe0eeb2700 1 -- 172.21.15.63:0/40819179 shutdown_connections 2020-05-18T21:27:01.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.903+0000 7fbe0eeb2700 1 --2- 172.21.15.63:0/40819179 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbde804fa60 0x7fbde8051f20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:01.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.903+0000 7fbe0eeb2700 1 --2- 172.21.15.63:0/40819179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe08143380 0x7fbe08156e10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:01.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.903+0000 7fbe0eeb2700 1 --2- 172.21.15.63:0/40819179 >> v2:172.21.15.155:3300/0 conn(0x7fbe080bc8d0 0x7fbe08148e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:01.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.903+0000 7fbe0eeb2700 1 -- 172.21.15.63:0/40819179 >> 172.21.15.63:0/40819179 conn(0x7fbe0805f3b0 msgr2=0x7fbe080b6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:01.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.903+0000 7fbe0eeb2700 1 -- 172.21.15.63:0/40819179 shutdown_connections 2020-05-18T21:27:01.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:01.903+0000 7fbe0eeb2700 1 -- 172.21.15.63:0/40819179 wait complete. 2020-05-18T21:27:01.915 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:27:02.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.035+0000 7f85fca94700 1 Processor -- start 2020-05-18T21:27:02.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.035+0000 7f85fca94700 1 -- start start 2020-05-18T21:27:02.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.035+0000 7f85fca94700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85f80b6d90 0x7f85f812ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:02.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.035+0000 7f85fca94700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f8060890 con 0x7f85f80b9500 2020-05-18T21:27:02.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.035+0000 7f85fca94700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f8060b30 con 0x7f85f80b8630 2020-05-18T21:27:02.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.035+0000 7f85fca94700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f8060dd0 con 0x7f85f80b6d90 2020-05-18T21:27:02.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.035+0000 7f85f6d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85f80b6d90 0x7f85f812ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:02.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.035+0000 7f85f659c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f85f80b9500 0x7f85f8061270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55370/0 (socket says 172.21.15.63:55370) 2020-05-18T21:27:02.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.035+0000 7f85f6d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85f80b6d90 0x7f85f812ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53186/0 (socket says 172.21.15.63:53186) 2020-05-18T21:27:02.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.035+0000 7f85f659c700 1 -- 172.21.15.63:0/2990003097 learned_addr learned my addr 172.21.15.63:0/2990003097 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:02.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85f559a700 1 -- 172.21.15.63:0/2990003097 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516915556 0 0) 0x7f85f8060b30 con 0x7f85f80b8630 2020-05-18T21:27:02.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85f559a700 1 -- 172.21.15.63:0/2990003097 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85d8003270 con 0x7f85f80b8630 2020-05-18T21:27:02.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85f6d9d700 1 -- 172.21.15.63:0/2990003097 >> v1:172.21.15.155:6789/0 conn(0x7f85f80b8630 legacy=0x7f85f80b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85f559a700 1 -- 172.21.15.63:0/2990003097 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120381131 0 0) 0x7f85f8060890 con 0x7f85f80b9500 2020-05-18T21:27:02.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85f6d9d700 1 -- 172.21.15.63:0/2990003097 >> v1:172.21.15.63:6789/0 conn(0x7f85f80b9500 legacy=0x7f85f8061270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85f6d9d700 1 -- 172.21.15.63:0/2990003097 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f80b98e0 con 0x7f85f80b6d90 2020-05-18T21:27:02.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85f6d9d700 1 --2- 172.21.15.63:0/2990003097 >> v2:172.21.15.63:3300/0 conn(0x7f85f80b6d90 0x7f85f812ed60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f85f80b8000 tx=0x7f85f0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85f6d9d700 1 --2- 172.21.15.63:0/2990003097 >> v2:172.21.15.63:3300/0 conn(0x7f85f80b6d90 0x7f85f812ed60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f85f80b8000 tx=0x7f85f0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85f6d9d700 1 --2- 172.21.15.63:0/2990003097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85f80b6d90 0x7f85f812ed60 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f85f80b8000 tx=0x7f85f0008ca0).ready entity=mon.0 client_cookie=984dd5c5dae68501 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:02.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85f6d9d700 1 --2- 172.21.15.63:0/2990003097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85f80b6d90 0x7f85f812ed60 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f85f80b8000 tx=0x7f85f0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85f559a700 1 -- 172.21.15.63:0/2990003097 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85f0011e60 con 0x7f85f80b6d90 2020-05-18T21:27:02.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85f6d9d700 1 --2- 172.21.15.63:0/2990003097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85f80b6d90 0x7f85f812ed60 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f85f80b8000 tx=0x7f85f0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85f559a700 1 -- 172.21.15.63:0/2990003097 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f000a180 con 0x7f85f80b6d90 2020-05-18T21:27:02.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85f6d9d700 1 --2- 172.21.15.63:0/2990003097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85f80b6d90 0x7f85f812ed60 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f85f80b8000 tx=0x7f85f0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85f559a700 1 -- 172.21.15.63:0/2990003097 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85f000a4e0 con 0x7f85f80b6d90 2020-05-18T21:27:02.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85fca94700 1 -- 172.21.15.63:0/2990003097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85f80b6d90 msgr2=0x7f85f812ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85fca94700 1 --2- 172.21.15.63:0/2990003097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85f80b6d90 0x7f85f812ed60 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f85f80b8000 tx=0x7f85f0008ca0).stop 2020-05-18T21:27:02.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85fca94700 1 -- 172.21.15.63:0/2990003097 shutdown_connections 2020-05-18T21:27:02.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85fca94700 1 --2- 172.21.15.63:0/2990003097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85f80b6d90 0x7f85f812ed60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:02.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85fca94700 1 -- 172.21.15.63:0/2990003097 >> 172.21.15.63:0/2990003097 conn(0x7f85f8069b70 msgr2=0x7f85f8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:02.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85fca94700 1 -- 172.21.15.63:0/2990003097 shutdown_connections 2020-05-18T21:27:02.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.039+0000 7f85fca94700 1 -- 172.21.15.63:0/2990003097 wait complete. 2020-05-18T21:27:02.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85fca94700 1 Processor -- start 2020-05-18T21:27:02.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85fca94700 1 -- start start 2020-05-18T21:27:02.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85fca94700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f80b6d90 0x7f85f80b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:02.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85fca94700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85f80b8630 0x7f85f812f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:02.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85fca94700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f8131c20 con 0x7f85f80b9500 2020-05-18T21:27:02.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85fca94700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f8131ec0 con 0x7f85f80b8630 2020-05-18T21:27:02.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85fca94700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80b3480 con 0x7f85f80b6d90 2020-05-18T21:27:02.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85f6d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f85f80b9500 0x7f85f812cb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55380/0 (socket says 172.21.15.63:55380) 2020-05-18T21:27:02.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85f6d9d700 1 -- 172.21.15.63:0/3162858361 learned_addr learned my addr 172.21.15.63:0/3162858361 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:02.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85f5d9b700 1 --2- 172.21.15.63:0/3162858361 >> v2:172.21.15.63:3300/0 conn(0x7f85f80b8630 0x7f85f812f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:02.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85f659c700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f80b6d90 0x7f85f80b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:02.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85f5d9b700 1 -- 172.21.15.63:0/3162858361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f80b6d90 msgr2=0x7f85f80b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85f5d9b700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f80b6d90 0x7f85f80b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:02.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85f5d9b700 1 -- 172.21.15.63:0/3162858361 >> v1:172.21.15.63:6789/0 conn(0x7f85f80b9500 legacy=0x7f85f812cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85f5d9b700 1 -- 172.21.15.63:0/3162858361 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f812d220 con 0x7f85f80b8630 2020-05-18T21:27:02.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85ef7fe700 1 -- 172.21.15.63:0/3162858361 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560728655 0 0) 0x7f85f8131c20 con 0x7f85f80b9500 2020-05-18T21:27:02.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85f5d9b700 1 --2- 172.21.15.63:0/3162858361 >> v2:172.21.15.63:3300/0 conn(0x7f85f80b8630 0x7f85f812f530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f85e8001110 tx=0x7f85e8002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85f5d9b700 1 --2- 172.21.15.63:0/3162858361 >> v2:172.21.15.63:3300/0 conn(0x7f85f80b8630 0x7f85f812f530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f85e8001110 tx=0x7f85e8002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85f5d9b700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85f80b8630 0x7f85f812f530 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f85e8001110 tx=0x7f85e8002eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:02.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85f5d9b700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85f80b8630 0x7f85f812f530 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f85e8001110 tx=0x7f85e8002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85f5d9b700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85f80b8630 0x7f85f812f530 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f85e8001110 tx=0x7f85e8002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85ef7fe700 1 -- 172.21.15.63:0/3162858361 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85e800cc30 con 0x7f85f80b8630 2020-05-18T21:27:02.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85f5d9b700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85f80b8630 0x7f85f812f530 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f85e8001110 tx=0x7f85e8002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85ef7fe700 1 -- 172.21.15.63:0/3162858361 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e800cd90 con 0x7f85f80b8630 2020-05-18T21:27:02.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85fca94700 1 -- 172.21.15.63:0/3162858361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f812f990 con 0x7f85f80b8630 2020-05-18T21:27:02.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85ef7fe700 1 -- 172.21.15.63:0/3162858361 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85e800e370 con 0x7f85f80b8630 2020-05-18T21:27:02.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.043+0000 7f85fca94700 1 -- 172.21.15.63:0/3162858361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f80b2430 con 0x7f85f80b8630 2020-05-18T21:27:02.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.047+0000 7f85f5d9b700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85f80b8630 0x7f85f812f530 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f85e8001110 tx=0x7f85e8002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.047+0000 7f85fca94700 1 -- 172.21.15.63:0/3162858361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f80569e0 con 0x7f85f80b8630 2020-05-18T21:27:02.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.047+0000 7f85ef7fe700 1 -- 172.21.15.63:0/3162858361 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f85e800e5e0 con 0x7f85f80b8630 2020-05-18T21:27:02.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.047+0000 7f85f5d9b700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85f80b8630 0x7f85f812f530 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f85e8001110 tx=0x7f85e8002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.047+0000 7f85ef7fe700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85dc04f8e0 0x7f85dc051da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:02.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.047+0000 7f85ef7fe700 1 -- 172.21.15.63:0/3162858361 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f85e8063860 con 0x7f85f80b8630 2020-05-18T21:27:02.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.047+0000 7f85f659c700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85dc04f8e0 0x7f85dc051da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:02.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.047+0000 7f85f659c700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85dc04f8e0 0x7f85dc051da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f85e0000bc0 tx=0x7f85e0001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.047+0000 7f85f659c700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85dc04f8e0 0x7f85dc051da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f85e0000bc0 tx=0x7f85e0001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.047+0000 7f85f659c700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85dc04f8e0 0x7f85dc051da0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f85e0000bc0 tx=0x7f85e0001840).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:02.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.055+0000 7f85f5d9b700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85f80b8630 0x7f85f812f530 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f85e8001110 tx=0x7f85e8002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.055+0000 7f85ef7fe700 1 -- 172.21.15.63:0/3162858361 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f85e803dc50 con 0x7f85f80b8630 2020-05-18T21:27:02.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.167+0000 7f85fca94700 1 -- 172.21.15.63:0/3162858361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f85f8132000 con 0x7f85f80b8630 2020-05-18T21:27:02.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.171+0000 7f85f5d9b700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85f80b8630 0x7f85f812f530 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f85e8001110 tx=0x7f85e8002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.171+0000 7f85ef7fe700 1 -- 172.21.15.63:0/3162858361 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f85e8041270 con 0x7f85f80b8630 2020-05-18T21:27:02.173 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.171+0000 7f85fca94700 1 -- 172.21.15.63:0/3162858361 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85dc04f8e0 msgr2=0x7f85dc051da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.171+0000 7f85fca94700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85dc04f8e0 0x7f85dc051da0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f85e0000bc0 tx=0x7f85e0001840).stop 2020-05-18T21:27:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.171+0000 7f85fca94700 1 -- 172.21.15.63:0/3162858361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85f80b8630 msgr2=0x7f85f812f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.171+0000 7f85fca94700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85f80b8630 0x7f85f812f530 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f85e8001110 tx=0x7f85e8002eb0).stop 2020-05-18T21:27:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.171+0000 7f85fca94700 1 -- 172.21.15.63:0/3162858361 shutdown_connections 2020-05-18T21:27:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.171+0000 7f85fca94700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85dc04f8e0 0x7f85dc051da0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.171+0000 7f85fca94700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85f80b8630 0x7f85f812f530 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.171+0000 7f85fca94700 1 --2- 172.21.15.63:0/3162858361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f80b6d90 0x7f85f80b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.171+0000 7f85fca94700 1 -- 172.21.15.63:0/3162858361 >> 172.21.15.63:0/3162858361 conn(0x7f85f8069b70 msgr2=0x7f85f80b7270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:02.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.171+0000 7f85fca94700 1 -- 172.21.15.63:0/3162858361 shutdown_connections 2020-05-18T21:27:02.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.171+0000 7f85fca94700 1 -- 172.21.15.63:0/3162858361 wait complete. 2020-05-18T21:27:02.185 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:27:02.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca909b9700 1 Processor -- start 2020-05-18T21:27:02.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca909b9700 1 -- start start 2020-05-18T21:27:02.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca909b9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca8c0b4f60 0x7fca8c06a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:02.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca909b9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fca8c060e10 0x7fca8c061210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:02.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca909b9700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8c065a50 con 0x7fca8c0653f0 2020-05-18T21:27:02.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca909b9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8c065860 con 0x7fca8c060e10 2020-05-18T21:27:02.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca909b9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8c0606d0 con 0x7fca8c0b4f60 2020-05-18T21:27:02.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca8bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fca8c060e10 0x7fca8c061210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:02.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca8bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fca8c060e10 0x7fca8c061210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53196/0 (socket says 172.21.15.63:53196) 2020-05-18T21:27:02.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca83fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fca8c0653f0 0x7fca8c129880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55384/0 (socket says 172.21.15.63:55384) 2020-05-18T21:27:02.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca8bfff700 1 -- 172.21.15.63:0/2009929279 learned_addr learned my addr 172.21.15.63:0/2009929279 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:02.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca8b7fe700 1 --2- 172.21.15.63:0/2009929279 >> v2:172.21.15.155:3300/0 conn(0x7fca8c0b4f60 0x7fca8c06a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:02.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca8bfff700 1 -- 172.21.15.63:0/2009929279 >> v2:172.21.15.155:3300/0 conn(0x7fca8c0b4f60 msgr2=0x7fca8c06a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:02.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca8bfff700 1 --2- 172.21.15.63:0/2009929279 >> v2:172.21.15.155:3300/0 conn(0x7fca8c0b4f60 0x7fca8c06a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:02.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca8bfff700 1 -- 172.21.15.63:0/2009929279 >> v1:172.21.15.63:6789/0 conn(0x7fca8c0653f0 legacy=0x7fca8c129880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca8bfff700 1 -- 172.21.15.63:0/2009929279 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c060970 con 0x7fca8c060e10 2020-05-18T21:27:02.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca8affd700 1 -- 172.21.15.63:0/2009929279 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006291428 0 0) 0x7fca8c065a50 con 0x7fca8c0653f0 2020-05-18T21:27:02.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca8b7fe700 1 --2- 172.21.15.63:0/2009929279 >> v2:172.21.15.155:3300/0 conn(0x7fca8c0b4f60 0x7fca8c06a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:27:02.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca8bfff700 1 --2- 172.21.15.63:0/2009929279 >> v2:172.21.15.63:3300/0 conn(0x7fca8c060e10 0x7fca8c061210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fca840032f0 tx=0x7fca84007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca8bfff700 1 --2- 172.21.15.63:0/2009929279 >> v2:172.21.15.63:3300/0 conn(0x7fca8c060e10 0x7fca8c061210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fca840032f0 tx=0x7fca84007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca8bfff700 1 --2- 172.21.15.63:0/2009929279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca8c060e10 0x7fca8c061210 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7fca840032f0 tx=0x7fca84007e00).ready entity=mon.0 client_cookie=f264b7dc1b36845d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca8bfff700 1 --2- 172.21.15.63:0/2009929279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca8c060e10 0x7fca8c061210 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fca840032f0 tx=0x7fca84007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca8affd700 1 -- 172.21.15.63:0/2009929279 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca84011dc0 con 0x7fca8c060e10 2020-05-18T21:27:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca8bfff700 1 --2- 172.21.15.63:0/2009929279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca8c060e10 0x7fca8c061210 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fca840032f0 tx=0x7fca84007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca8bfff700 1 --2- 172.21.15.63:0/2009929279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca8c060e10 0x7fca8c061210 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fca840032f0 tx=0x7fca84007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca8affd700 1 -- 172.21.15.63:0/2009929279 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8400a180 con 0x7fca8c060e10 2020-05-18T21:27:02.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca8affd700 1 -- 172.21.15.63:0/2009929279 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca8400a560 con 0x7fca8c060e10 2020-05-18T21:27:02.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca909b9700 1 -- 172.21.15.63:0/2009929279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca8c060e10 msgr2=0x7fca8c061210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.291+0000 7fca909b9700 1 --2- 172.21.15.63:0/2009929279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca8c060e10 0x7fca8c061210 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7fca840032f0 tx=0x7fca84007e00).stop 2020-05-18T21:27:02.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca909b9700 1 -- 172.21.15.63:0/2009929279 shutdown_connections 2020-05-18T21:27:02.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca909b9700 1 --2- 172.21.15.63:0/2009929279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca8c060e10 0x7fca8c061210 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:02.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca909b9700 1 --2- 172.21.15.63:0/2009929279 >> v2:172.21.15.155:3300/0 conn(0x7fca8c0b4f60 0x7fca8c06a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:02.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca909b9700 1 -- 172.21.15.63:0/2009929279 >> 172.21.15.63:0/2009929279 conn(0x7fca8c05fbd0 msgr2=0x7fca8c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:02.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca909b9700 1 -- 172.21.15.63:0/2009929279 shutdown_connections 2020-05-18T21:27:02.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca909b9700 1 -- 172.21.15.63:0/2009929279 wait complete. 2020-05-18T21:27:02.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca909b9700 1 Processor -- start 2020-05-18T21:27:02.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca909b9700 1 -- start start 2020-05-18T21:27:02.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca909b9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca8c0b4f60 0x7fca8c146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:02.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca909b9700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8c0b6d40 con 0x7fca8c060e10 2020-05-18T21:27:02.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca909b9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8c145970 con 0x7fca8c0653f0 2020-05-18T21:27:02.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca909b9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8c145c10 con 0x7fca8c0b4f60 2020-05-18T21:27:02.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca8bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca8c0b4f60 0x7fca8c146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:02.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca8b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fca8c060e10 0x7fca8c0b8860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55390/0 (socket says 172.21.15.63:55390) 2020-05-18T21:27:02.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca83fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fca8c0653f0 0x7fca8c126710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:53704/0 (socket says 172.21.15.63:53704) 2020-05-18T21:27:02.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca8b7fe700 1 -- 172.21.15.63:0/1915496603 learned_addr learned my addr 172.21.15.63:0/1915496603 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:02.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca897fa700 1 -- 172.21.15.63:0/1915496603 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324066833 0 0) 0x7fca7c002010 con 0x7fca8c060e10 2020-05-18T21:27:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca897fa700 1 -- 172.21.15.63:0/1915496603 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca64002fe0 con 0x7fca8c060e10 2020-05-18T21:27:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca8bfff700 1 -- 172.21.15.63:0/1915496603 >> v1:172.21.15.155:6789/0 conn(0x7fca8c0653f0 legacy=0x7fca8c126710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca8bfff700 1 -- 172.21.15.63:0/1915496603 >> v1:172.21.15.63:6789/0 conn(0x7fca8c060e10 legacy=0x7fca8c0b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca8bfff700 1 -- 172.21.15.63:0/1915496603 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c0b8f70 con 0x7fca8c0b4f60 2020-05-18T21:27:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca8bfff700 1 --2- 172.21.15.63:0/1915496603 >> v2:172.21.15.155:3300/0 conn(0x7fca8c0b4f60 0x7fca8c146280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca840032f0 tx=0x7fca84007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca8bfff700 1 --2- 172.21.15.63:0/1915496603 >> v2:172.21.15.155:3300/0 conn(0x7fca8c0b4f60 0x7fca8c146280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca840032f0 tx=0x7fca84007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca8bfff700 1 --2- 172.21.15.63:0/1915496603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca8c0b4f60 0x7fca8c146280 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7fca840032f0 tx=0x7fca84007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca8bfff700 1 --2- 172.21.15.63:0/1915496603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca8c0b4f60 0x7fca8c146280 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7fca840032f0 tx=0x7fca84007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca897fa700 1 -- 172.21.15.63:0/1915496603 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca84005c70 con 0x7fca8c0b4f60 2020-05-18T21:27:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca8bfff700 1 --2- 172.21.15.63:0/1915496603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca8c0b4f60 0x7fca8c146280 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7fca840032f0 tx=0x7fca84007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca8bfff700 1 --2- 172.21.15.63:0/1915496603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca8c0b4f60 0x7fca8c146280 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7fca840032f0 tx=0x7fca84007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca897fa700 1 -- 172.21.15.63:0/1915496603 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca84005dd0 con 0x7fca8c0b4f60 2020-05-18T21:27:02.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca897fa700 1 -- 172.21.15.63:0/1915496603 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca840112c0 con 0x7fca8c0b4f60 2020-05-18T21:27:02.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca909b9700 1 -- 172.21.15.63:0/1915496603 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8c1455f0 con 0x7fca8c0b4f60 2020-05-18T21:27:02.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.295+0000 7fca909b9700 1 -- 172.21.15.63:0/1915496603 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8c0b66c0 con 0x7fca8c0b4f60 2020-05-18T21:27:02.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.299+0000 7fca8bfff700 1 --2- 172.21.15.63:0/1915496603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca8c0b4f60 0x7fca8c146280 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7fca840032f0 tx=0x7fca84007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.299+0000 7fca909b9700 1 -- 172.21.15.63:0/1915496603 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca8c0569e0 con 0x7fca8c0b4f60 2020-05-18T21:27:02.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.299+0000 7fca897fa700 1 -- 172.21.15.63:0/1915496603 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fca84011530 con 0x7fca8c0b4f60 2020-05-18T21:27:02.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.299+0000 7fca8bfff700 1 --2- 172.21.15.63:0/1915496603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca8c0b4f60 0x7fca8c146280 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7fca840032f0 tx=0x7fca84007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.299+0000 7fca897fa700 1 --2- 172.21.15.63:0/1915496603 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca6404fd40 0x7fca64052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:02.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.299+0000 7fca897fa700 1 -- 172.21.15.63:0/1915496603 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fca84064430 con 0x7fca8c0b4f60 2020-05-18T21:27:02.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.299+0000 7fca8b7fe700 1 --2- 172.21.15.63:0/1915496603 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca6404fd40 0x7fca64052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:02.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.299+0000 7fca8b7fe700 1 --2- 172.21.15.63:0/1915496603 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca6404fd40 0x7fca64052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca7c002f70 tx=0x7fca7c002680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.299+0000 7fca8b7fe700 1 --2- 172.21.15.63:0/1915496603 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca6404fd40 0x7fca64052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca7c002f70 tx=0x7fca7c002680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.299+0000 7fca8b7fe700 1 --2- 172.21.15.63:0/1915496603 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca6404fd40 0x7fca64052200 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fca7c002f70 tx=0x7fca7c002680).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:02.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.307+0000 7fca8bfff700 1 --2- 172.21.15.63:0/1915496603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca8c0b4f60 0x7fca8c146280 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7fca840032f0 tx=0x7fca84007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.307+0000 7fca897fa700 1 -- 172.21.15.63:0/1915496603 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fca8403e880 con 0x7fca8c0b4f60 2020-05-18T21:27:02.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.423+0000 7fca909b9700 1 -- 172.21.15.63:0/1915496603 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca8c145780 con 0x7fca8c0b4f60 2020-05-18T21:27:02.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.427+0000 7fca8bfff700 1 --2- 172.21.15.63:0/1915496603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca8c0b4f60 0x7fca8c146280 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7fca840032f0 tx=0x7fca84007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.427+0000 7fca897fa700 1 -- 172.21.15.63:0/1915496603 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7fca84041ea0 con 0x7fca8c0b4f60 2020-05-18T21:27:02.429 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:02.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.427+0000 7fca909b9700 1 -- 172.21.15.63:0/1915496603 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca6404fd40 msgr2=0x7fca64052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.427+0000 7fca909b9700 1 --2- 172.21.15.63:0/1915496603 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca6404fd40 0x7fca64052200 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fca7c002f70 tx=0x7fca7c002680).stop 2020-05-18T21:27:02.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.427+0000 7fca909b9700 1 -- 172.21.15.63:0/1915496603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca8c0b4f60 msgr2=0x7fca8c146280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.427+0000 7fca909b9700 1 --2- 172.21.15.63:0/1915496603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca8c0b4f60 0x7fca8c146280 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7fca840032f0 tx=0x7fca84007e00).stop 2020-05-18T21:27:02.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.427+0000 7fca909b9700 1 -- 172.21.15.63:0/1915496603 shutdown_connections 2020-05-18T21:27:02.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.427+0000 7fca909b9700 1 --2- 172.21.15.63:0/1915496603 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca6404fd40 0x7fca64052200 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:02.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.427+0000 7fca909b9700 1 --2- 172.21.15.63:0/1915496603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca8c0b4f60 0x7fca8c146280 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:02.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.427+0000 7fca909b9700 1 -- 172.21.15.63:0/1915496603 >> 172.21.15.63:0/1915496603 conn(0x7fca8c05fbd0 msgr2=0x7fca8c05c260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:02.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.427+0000 7fca909b9700 1 -- 172.21.15.63:0/1915496603 shutdown_connections 2020-05-18T21:27:02.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.427+0000 7fca909b9700 1 -- 172.21.15.63:0/1915496603 wait complete. 2020-05-18T21:27:02.442 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:27:02.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.547+0000 7fb940875700 1 Processor -- start 2020-05-18T21:27:02.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.547+0000 7fb940875700 1 -- start start 2020-05-18T21:27:02.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.547+0000 7fb940875700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb93c0b9360 0x7fb93c146a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:02.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.547+0000 7fb940875700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9e10 0x7fb93c146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:02.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.547+0000 7fb940875700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93c0ba2b0 con 0x7fb93c147430 2020-05-18T21:27:02.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.547+0000 7fb940875700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93c0b0650 con 0x7fb93c0b9360 2020-05-18T21:27:02.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.547+0000 7fb940875700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c0b08f0 con 0x7fb93c0b9e10 2020-05-18T21:27:02.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.547+0000 7fb93a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb93c0b9360 0x7fb93c146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:02.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.547+0000 7fb93a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb93c0b9360 0x7fb93c146a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53208/0 (socket says 172.21.15.63:53208) 2020-05-18T21:27:02.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.547+0000 7fb93a59c700 1 -- 172.21.15.63:0/2336027303 learned_addr learned my addr 172.21.15.63:0/2336027303 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:02.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.547+0000 7fb939d9b700 1 --2- 172.21.15.63:0/2336027303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9e10 0x7fb93c146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:02.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb93a59c700 1 -- 172.21.15.63:0/2336027303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9e10 msgr2=0x7fb93c146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:02.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb93a59c700 1 --2- 172.21.15.63:0/2336027303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9e10 0x7fb93c146fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:02.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb93a59c700 1 -- 172.21.15.63:0/2336027303 >> v1:172.21.15.155:6789/0 conn(0x7fb93c147430 legacy=0x7fb93c12ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb93a59c700 1 -- 172.21.15.63:0/2336027303 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c0b9740 con 0x7fb93c0b9360 2020-05-18T21:27:02.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb93a59c700 1 --2- 172.21.15.63:0/2336027303 >> v2:172.21.15.63:3300/0 conn(0x7fb93c0b9360 0x7fb93c146a40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb924002f70 tx=0x7fb924007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb93a59c700 1 --2- 172.21.15.63:0/2336027303 >> v2:172.21.15.63:3300/0 conn(0x7fb93c0b9360 0x7fb93c146a40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb924002f70 tx=0x7fb924007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb93a59c700 1 --2- 172.21.15.63:0/2336027303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb93c0b9360 0x7fb93c146a40 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7fb924002f70 tx=0x7fb924007a80).ready entity=mon.0 client_cookie=1058d56a2ee6134 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:02.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb93a59c700 1 --2- 172.21.15.63:0/2336027303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb93c0b9360 0x7fb93c146a40 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7fb924002f70 tx=0x7fb924007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb93a59c700 1 --2- 172.21.15.63:0/2336027303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb93c0b9360 0x7fb93c146a40 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7fb924002f70 tx=0x7fb924007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb93959a700 1 -- 172.21.15.63:0/2336027303 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9240116b0 con 0x7fb93c0b9360 2020-05-18T21:27:02.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb93a59c700 1 --2- 172.21.15.63:0/2336027303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb93c0b9360 0x7fb93c146a40 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7fb924002f70 tx=0x7fb924007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb93959a700 1 -- 172.21.15.63:0/2336027303 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb924011810 con 0x7fb93c0b9360 2020-05-18T21:27:02.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb93959a700 1 -- 172.21.15.63:0/2336027303 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb924011c30 con 0x7fb93c0b9360 2020-05-18T21:27:02.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb940875700 1 -- 172.21.15.63:0/2336027303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb93c0b9360 msgr2=0x7fb93c146a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb940875700 1 --2- 172.21.15.63:0/2336027303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb93c0b9360 0x7fb93c146a40 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7fb924002f70 tx=0x7fb924007a80).stop 2020-05-18T21:27:02.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb940875700 1 -- 172.21.15.63:0/2336027303 shutdown_connections 2020-05-18T21:27:02.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb940875700 1 --2- 172.21.15.63:0/2336027303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9e10 0x7fb93c146fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:02.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb940875700 1 --2- 172.21.15.63:0/2336027303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb93c0b9360 0x7fb93c146a40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:02.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb940875700 1 -- 172.21.15.63:0/2336027303 >> 172.21.15.63:0/2336027303 conn(0x7fb93c05f510 msgr2=0x7fb93c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:02.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb940875700 1 -- 172.21.15.63:0/2336027303 shutdown_connections 2020-05-18T21:27:02.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb940875700 1 -- 172.21.15.63:0/2336027303 wait complete. 2020-05-18T21:27:02.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.551+0000 7fb940875700 1 Processor -- start 2020-05-18T21:27:02.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb940875700 1 -- start start 2020-05-18T21:27:02.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb940875700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9360 0x7fb93c1572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:02.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb940875700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb93c0b9e10 0x7fb93c12d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:02.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb940875700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93c153910 con 0x7fb93c147430 2020-05-18T21:27:02.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb940875700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93c153700 con 0x7fb93c0b9e10 2020-05-18T21:27:02.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb940875700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c153bb0 con 0x7fb93c0b9360 2020-05-18T21:27:02.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb93a59c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9360 0x7fb93c1572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:02.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb939d9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb93c0b9e10 0x7fb93c12d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:02.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb93a59c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9360 0x7fb93c1572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:43916/0 (socket says 172.21.15.63:43916) 2020-05-18T21:27:02.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb93a59c700 1 -- 172.21.15.63:0/1969861468 learned_addr learned my addr 172.21.15.63:0/1969861468 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:02.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb93a59c700 1 -- 172.21.15.63:0/1969861468 >> v2:172.21.15.155:3300/0 conn(0x7fb93c0b9e10 msgr2=0x7fb93c12d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb93a59c700 1 --2- 172.21.15.63:0/1969861468 >> v2:172.21.15.155:3300/0 conn(0x7fb93c0b9e10 0x7fb93c12d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:02.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb93a59c700 1 -- 172.21.15.63:0/1969861468 >> v1:172.21.15.155:6789/0 conn(0x7fb93c147430 legacy=0x7fb93c1459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb93a59c700 1 -- 172.21.15.63:0/1969861468 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c157750 con 0x7fb93c0b9360 2020-05-18T21:27:02.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb93a59c700 1 --2- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9360 0x7fb93c1572f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb924002f70 tx=0x7fb924007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb93a59c700 1 --2- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9360 0x7fb93c1572f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb924002f70 tx=0x7fb924007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb93a59c700 1 --2- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9360 0x7fb93c1572f0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7fb924002f70 tx=0x7fb924007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:02.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb93a59c700 1 --2- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9360 0x7fb93c1572f0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fb924002f70 tx=0x7fb924007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb9337fe700 1 -- 172.21.15.63:0/1969861468 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb924011ea0 con 0x7fb93c0b9360 2020-05-18T21:27:02.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb93a59c700 1 --2- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9360 0x7fb93c1572f0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fb924002f70 tx=0x7fb924007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb93a59c700 1 --2- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9360 0x7fb93c1572f0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fb924002f70 tx=0x7fb924007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb9337fe700 1 -- 172.21.15.63:0/1969861468 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb924007360 con 0x7fb93c0b9360 2020-05-18T21:27:02.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb9337fe700 1 -- 172.21.15.63:0/1969861468 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb924011cf0 con 0x7fb93c0b9360 2020-05-18T21:27:02.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb940875700 1 -- 172.21.15.63:0/1969861468 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93c0b4970 con 0x7fb93c0b9360 2020-05-18T21:27:02.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.555+0000 7fb940875700 1 -- 172.21.15.63:0/1969861468 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93c154050 con 0x7fb93c0b9360 2020-05-18T21:27:02.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.559+0000 7fb93a59c700 1 --2- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9360 0x7fb93c1572f0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fb924002f70 tx=0x7fb924007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.559+0000 7fb940875700 1 -- 172.21.15.63:0/1969861468 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93c0569e0 con 0x7fb93c0b9360 2020-05-18T21:27:02.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.559+0000 7fb9337fe700 1 -- 172.21.15.63:0/1969861468 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb924005700 con 0x7fb93c0b9360 2020-05-18T21:27:02.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.559+0000 7fb93a59c700 1 --2- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9360 0x7fb93c1572f0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fb924002f70 tx=0x7fb924007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.559+0000 7fb9337fe700 1 --2- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb92004fa60 0x7fb920051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:02.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.559+0000 7fb9337fe700 1 -- 172.21.15.63:0/1969861468 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb924064340 con 0x7fb93c0b9360 2020-05-18T21:27:02.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.559+0000 7fb939d9b700 1 --2- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb92004fa60 0x7fb920051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:02.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.559+0000 7fb939d9b700 1 --2- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb92004fa60 0x7fb920051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb92c002f70 tx=0x7fb92c002f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.559+0000 7fb939d9b700 1 --2- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb92004fa60 0x7fb920051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb92c002f70 tx=0x7fb92c002f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.559+0000 7fb939d9b700 1 --2- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb92004fa60 0x7fb920051f20 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fb92c002f70 tx=0x7fb92c002f10).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:02.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.567+0000 7fb93a59c700 1 --2- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9360 0x7fb93c1572f0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fb924002f70 tx=0x7fb924007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.567+0000 7fb9337fe700 1 -- 172.21.15.63:0/1969861468 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb92403e790 con 0x7fb93c0b9360 2020-05-18T21:27:02.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.687+0000 7fb940875700 1 -- 172.21.15.63:0/1969861468 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb93c0008d0 con 0x7fb93c0b9360 2020-05-18T21:27:02.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.687+0000 7fb93a59c700 1 --2- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9360 0x7fb93c1572f0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fb924002f70 tx=0x7fb924007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.687+0000 7fb9337fe700 1 -- 172.21.15.63:0/1969861468 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb924041db0 con 0x7fb93c0b9360 2020-05-18T21:27:02.690 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:02.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.687+0000 7fb940875700 1 -- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb92004fa60 msgr2=0x7fb920051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.687+0000 7fb940875700 1 --2- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb92004fa60 0x7fb920051f20 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fb92c002f70 tx=0x7fb92c002f10).stop 2020-05-18T21:27:02.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.687+0000 7fb940875700 1 -- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9360 msgr2=0x7fb93c1572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.687+0000 7fb940875700 1 --2- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9360 0x7fb93c1572f0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7fb924002f70 tx=0x7fb924007a80).stop 2020-05-18T21:27:02.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.691+0000 7fb940875700 1 -- 172.21.15.63:0/1969861468 shutdown_connections 2020-05-18T21:27:02.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.691+0000 7fb940875700 1 --2- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb92004fa60 0x7fb920051f20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:02.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.691+0000 7fb940875700 1 --2- 172.21.15.63:0/1969861468 >> v2:172.21.15.155:3300/0 conn(0x7fb93c0b9e10 0x7fb93c12d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:02.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.691+0000 7fb940875700 1 --2- 172.21.15.63:0/1969861468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb93c0b9360 0x7fb93c1572f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:02.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.691+0000 7fb940875700 1 -- 172.21.15.63:0/1969861468 >> 172.21.15.63:0/1969861468 conn(0x7fb93c05f510 msgr2=0x7fb93c0ae830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:02.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.691+0000 7fb940875700 1 -- 172.21.15.63:0/1969861468 shutdown_connections 2020-05-18T21:27:02.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.691+0000 7fb940875700 1 -- 172.21.15.63:0/1969861468 wait complete. 2020-05-18T21:27:02.706 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:27:02.707 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:27:02.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.803+0000 7fc3b316c700 1 Processor -- start 2020-05-18T21:27:02.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.803+0000 7fc3b316c700 1 -- start start 2020-05-18T21:27:02.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.803+0000 7fc3b316c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc3ac13cae0 0x7fc3ac060fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:02.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.803+0000 7fc3b316c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3ac1429e0 0x7fc3ac069b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:02.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.803+0000 7fc3b316c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc3ac069fd0 0x7fc3ac145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:02.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.803+0000 7fc3b316c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ac13cec0 con 0x7fc3ac13cae0 2020-05-18T21:27:02.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.803+0000 7fc3b316c700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ac061f20 con 0x7fc3ac069fd0 2020-05-18T21:27:02.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.803+0000 7fc3b316c700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac061540 con 0x7fc3ac1429e0 2020-05-18T21:27:02.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.803+0000 7fc3b216a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc3ac13cae0 0x7fc3ac060fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:02.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.803+0000 7fc3b216a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc3ac13cae0 0x7fc3ac060fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53224/0 (socket says 172.21.15.63:53224) 2020-05-18T21:27:02.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.803+0000 7fc3b216a700 1 -- 172.21.15.63:0/3202045777 learned_addr learned my addr 172.21.15.63:0/3202045777 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:02.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.803+0000 7fc3b1969700 1 --2- 172.21.15.63:0/3202045777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3ac1429e0 0x7fc3ac069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:02.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.803+0000 7fc3b296b700 1 --2- 172.21.15.63:0/3202045777 >> v2:172.21.15.155:3300/0 conn(0x7fc3ac069fd0 0x7fc3ac145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:02.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b216a700 1 -- 172.21.15.63:0/3202045777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3ac1429e0 msgr2=0x7fc3ac069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:02.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b216a700 1 --2- 172.21.15.63:0/3202045777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3ac1429e0 0x7fc3ac069b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:02.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b216a700 1 -- 172.21.15.63:0/3202045777 >> v2:172.21.15.155:3300/0 conn(0x7fc3ac069fd0 msgr2=0x7fc3ac145ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:02.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b216a700 1 --2- 172.21.15.63:0/3202045777 >> v2:172.21.15.155:3300/0 conn(0x7fc3ac069fd0 0x7fc3ac145ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:02.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b216a700 1 -- 172.21.15.63:0/3202045777 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac0617e0 con 0x7fc3ac13cae0 2020-05-18T21:27:02.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b216a700 1 --2- 172.21.15.63:0/3202045777 >> v2:172.21.15.63:3300/0 conn(0x7fc3ac13cae0 0x7fc3ac060fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc39c002f70 tx=0x7fc39c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b216a700 1 --2- 172.21.15.63:0/3202045777 >> v2:172.21.15.63:3300/0 conn(0x7fc3ac13cae0 0x7fc3ac060fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc39c002f70 tx=0x7fc39c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b216a700 1 --2- 172.21.15.63:0/3202045777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ac13cae0 0x7fc3ac060fc0 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7fc39c002f70 tx=0x7fc39c007a80).ready entity=mon.0 client_cookie=ead4b3c6b9805b2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:02.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b216a700 1 --2- 172.21.15.63:0/3202045777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ac13cae0 0x7fc3ac060fc0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7fc39c002f70 tx=0x7fc39c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b216a700 1 --2- 172.21.15.63:0/3202045777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ac13cae0 0x7fc3ac060fc0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7fc39c002f70 tx=0x7fc39c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b1168700 1 -- 172.21.15.63:0/3202045777 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc39c011600 con 0x7fc3ac13cae0 2020-05-18T21:27:02.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b1168700 1 -- 172.21.15.63:0/3202045777 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c011760 con 0x7fc3ac13cae0 2020-05-18T21:27:02.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b216a700 1 --2- 172.21.15.63:0/3202045777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ac13cae0 0x7fc3ac060fc0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7fc39c002f70 tx=0x7fc39c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b316c700 1 -- 172.21.15.63:0/3202045777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ac13cae0 msgr2=0x7fc3ac060fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b1168700 1 -- 172.21.15.63:0/3202045777 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc39c011b80 con 0x7fc3ac13cae0 2020-05-18T21:27:02.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b316c700 1 --2- 172.21.15.63:0/3202045777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ac13cae0 0x7fc3ac060fc0 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7fc39c002f70 tx=0x7fc39c007a80).stop 2020-05-18T21:27:02.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b316c700 1 -- 172.21.15.63:0/3202045777 shutdown_connections 2020-05-18T21:27:02.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b316c700 1 --2- 172.21.15.63:0/3202045777 >> v2:172.21.15.155:3300/0 conn(0x7fc3ac069fd0 0x7fc3ac145ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:02.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b316c700 1 --2- 172.21.15.63:0/3202045777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3ac1429e0 0x7fc3ac069b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:02.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b316c700 1 --2- 172.21.15.63:0/3202045777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ac13cae0 0x7fc3ac060fc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:02.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b316c700 1 -- 172.21.15.63:0/3202045777 >> 172.21.15.63:0/3202045777 conn(0x7fc3ac05a7c0 msgr2=0x7fc3ac05aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:02.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b316c700 1 -- 172.21.15.63:0/3202045777 shutdown_connections 2020-05-18T21:27:02.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b316c700 1 -- 172.21.15.63:0/3202045777 wait complete. 2020-05-18T21:27:02.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b316c700 1 Processor -- start 2020-05-18T21:27:02.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b316c700 1 -- start start 2020-05-18T21:27:02.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b316c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3ac069fd0 0x7fc3ac13bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:02.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b316c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc3ac13cae0 0x7fc3ac13f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:02.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b316c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ac0b77b0 con 0x7fc3ac1429e0 2020-05-18T21:27:02.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b316c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ac0b7a50 con 0x7fc3ac13cae0 2020-05-18T21:27:02.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.807+0000 7fc3b316c700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac063370 con 0x7fc3ac069fd0 2020-05-18T21:27:02.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc3b1969700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc3ac13cae0 0x7fc3ac13f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:02.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc3b1969700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc3ac13cae0 0x7fc3ac13f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53228/0 (socket says 172.21.15.63:53228) 2020-05-18T21:27:02.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc3b1969700 1 -- 172.21.15.63:0/4227295659 learned_addr learned my addr 172.21.15.63:0/4227295659 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:02.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc3b216a700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3ac069fd0 0x7fc3ac13bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:02.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc3b1969700 1 -- 172.21.15.63:0/4227295659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3ac069fd0 msgr2=0x7fc3ac13bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc3b1969700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3ac069fd0 0x7fc3ac13bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:02.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc3b1969700 1 -- 172.21.15.63:0/4227295659 >> v1:172.21.15.155:6789/0 conn(0x7fc3ac1429e0 legacy=0x7fc3ac1567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc3b1969700 1 -- 172.21.15.63:0/4227295659 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac09cee0 con 0x7fc3ac13cae0 2020-05-18T21:27:02.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc3b1969700 1 --2- 172.21.15.63:0/4227295659 >> v2:172.21.15.63:3300/0 conn(0x7fc3ac13cae0 0x7fc3ac13f450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc3ac066ce0 tx=0x7fc3a8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc3b1969700 1 --2- 172.21.15.63:0/4227295659 >> v2:172.21.15.63:3300/0 conn(0x7fc3ac13cae0 0x7fc3ac13f450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc3ac066ce0 tx=0x7fc3a8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc3b1969700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ac13cae0 0x7fc3ac13f450 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7fc3ac066ce0 tx=0x7fc3a8010d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:02.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc3b1969700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ac13cae0 0x7fc3ac13f450 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7fc3ac066ce0 tx=0x7fc3a8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc3b1969700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ac13cae0 0x7fc3ac13f450 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7fc3ac066ce0 tx=0x7fc3a8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc39b7fe700 1 -- 172.21.15.63:0/4227295659 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3a8007550 con 0x7fc3ac13cae0 2020-05-18T21:27:02.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc3b1969700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ac13cae0 0x7fc3ac13f450 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7fc3ac066ce0 tx=0x7fc3a8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc39b7fe700 1 -- 172.21.15.63:0/4227295659 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a80127b0 con 0x7fc3ac13cae0 2020-05-18T21:27:02.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc3b316c700 1 -- 172.21.15.63:0/4227295659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ac13f8b0 con 0x7fc3ac13cae0 2020-05-18T21:27:02.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc39b7fe700 1 -- 172.21.15.63:0/4227295659 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3a8012b50 con 0x7fc3ac13cae0 2020-05-18T21:27:02.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc3b316c700 1 -- 172.21.15.63:0/4227295659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ac13fde0 con 0x7fc3ac13cae0 2020-05-18T21:27:02.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc3b316c700 1 -- 172.21.15.63:0/4227295659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3ac0569e0 con 0x7fc3ac13cae0 2020-05-18T21:27:02.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc3b1969700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ac13cae0 0x7fc3ac13f450 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7fc3ac066ce0 tx=0x7fc3a8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc39b7fe700 1 -- 172.21.15.63:0/4227295659 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc3a8005700 con 0x7fc3ac13cae0 2020-05-18T21:27:02.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc3b1969700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ac13cae0 0x7fc3ac13f450 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7fc3ac066ce0 tx=0x7fc3a8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc39b7fe700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc38c04f9b0 0x7fc38c051e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:02.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.811+0000 7fc39b7fe700 1 -- 172.21.15.63:0/4227295659 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc3a80645e0 con 0x7fc3ac13cae0 2020-05-18T21:27:02.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.815+0000 7fc3b216a700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc38c04f9b0 0x7fc38c051e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:02.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.815+0000 7fc3b216a700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc38c04f9b0 0x7fc38c051e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc39c002f70 tx=0x7fc39c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.815+0000 7fc3b216a700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc38c04f9b0 0x7fc38c051e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc39c002f70 tx=0x7fc39c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.815+0000 7fc3b216a700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc38c04f9b0 0x7fc38c051e70 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fc39c002f70 tx=0x7fc39c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:02.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.819+0000 7fc3b1969700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ac13cae0 0x7fc3ac13f450 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7fc3ac066ce0 tx=0x7fc3a8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.819+0000 7fc39b7fe700 1 -- 172.21.15.63:0/4227295659 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc3a803e9d0 con 0x7fc3ac13cae0 2020-05-18T21:27:02.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.963+0000 7fc3b316c700 1 -- 172.21.15.63:0/4227295659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3ac0008d0 con 0x7fc3ac13cae0 2020-05-18T21:27:02.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.967+0000 7fc3b1969700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ac13cae0 0x7fc3ac13f450 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7fc3ac066ce0 tx=0x7fc3a8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:02.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.967+0000 7fc39b7fe700 1 -- 172.21.15.63:0/4227295659 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2137 (secure 0 0 0) 0x7fc3a8041ff0 con 0x7fc3ac13cae0 2020-05-18T21:27:02.969 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:02.969 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4404,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2550679674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2550679674},{"type":"v1","addr":"172.21.15.155:6835","nonce":2550679674}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":7}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:26:45.491730+0000","modified":"2020-05-18T21:26:49.514812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4369},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4369":{"gid":4369,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.63:6833/2283817704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2283817704},{"type":"v1","addr":"172.21.15.63:6833","nonce":2283817704}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-05-18T21:27:02.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.967+0000 7fc3b316c700 1 -- 172.21.15.63:0/4227295659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc38c04f9b0 msgr2=0x7fc38c051e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.967+0000 7fc3b316c700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc38c04f9b0 0x7fc38c051e70 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fc39c002f70 tx=0x7fc39c007a80).stop 2020-05-18T21:27:02.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.967+0000 7fc3b316c700 1 -- 172.21.15.63:0/4227295659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ac13cae0 msgr2=0x7fc3ac13f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:02.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.967+0000 7fc3b316c700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ac13cae0 0x7fc3ac13f450 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7fc3ac066ce0 tx=0x7fc3a8010d60).stop 2020-05-18T21:27:02.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.967+0000 7fc3b316c700 1 -- 172.21.15.63:0/4227295659 shutdown_connections 2020-05-18T21:27:02.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.967+0000 7fc3b316c700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc38c04f9b0 0x7fc38c051e70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:02.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.967+0000 7fc3b316c700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ac13cae0 0x7fc3ac13f450 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:02.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.967+0000 7fc3b316c700 1 --2- 172.21.15.63:0/4227295659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3ac069fd0 0x7fc3ac13bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:02.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.967+0000 7fc3b316c700 1 -- 172.21.15.63:0/4227295659 >> 172.21.15.63:0/4227295659 conn(0x7fc3ac05a7c0 msgr2=0x7fc3ac09d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:02.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.967+0000 7fc3b316c700 1 -- 172.21.15.63:0/4227295659 shutdown_connections 2020-05-18T21:27:02.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:02.967+0000 7fc3b316c700 1 -- 172.21.15.63:0/4227295659 wait complete. 2020-05-18T21:27:02.973 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 7 2020-05-18T21:27:03.183 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:26:45.491730+0000', 'modified': '2020-05-18T21:26:49.514812+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4369}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4369': {'gid': 4369, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.63:6833/2283817704', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 2283817704}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 2283817704}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:27:03.184 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:27:03.184 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:27:03.291 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:27:03.291 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:27:03.291 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:27:03.292 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4369, 2020-05-18T21:27:03.292 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:27:03.292 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:27:03.292 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 14.770260935, 2020-05-18T21:27:03.292 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 6, 2020-05-18T21:27:03.293 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 23, 2020-05-18T21:27:03.293 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 23, 2020-05-18T21:27:03.293 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 15.464732118000001 2020-05-18T21:27:03.294 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:27:03.299 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 4369, "want_state": "up:active", "state": "up:active", "rank_uptime": 14.770260935, "mdsmap_epoch": 6, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "uptime": 15.464732118000001 } 2020-05-18T21:27:03.300 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:27:03.300 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2020-05-18T21:27:03.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.301 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:27:03.306 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:27:03.307 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:03.307 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:27:03.307 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:03.307 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:27:03.307 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:03.308 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:03.308 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:03.308 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:03.308 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:03.308 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:03.309 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:03.309 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:27:03.309 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:03.309 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:27:03.309 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42819sec preferred_lft 42819sec 2020-05-18T21:27:03.310 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:27:03.310 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:03.310 INFO:teuthology.orchestra.run.smithi063.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-05-18T21:27:03.310 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 62:a7:50:8e:d1:4d brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:03.310 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:27:03.311 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:03.311 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::d461:56ff:fe10:c810/64 scope link 2020-05-18T21:27:03.311 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:03.311 INFO:teuthology.orchestra.run.smithi063.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-05-18T21:27:03.312 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 62:a7:50:8e:d1:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2020-05-18T21:27:03.312 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::60a7:50ff:fe8e:d14d/64 scope link 2020-05-18T21:27:03.312 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:03.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.313 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:27:03.327 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:27:03.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.330 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:27:03.380 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:27:03.380 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:27:03.380 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:27:03.381 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:27:03.381 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:27:03.381 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:27:03.381 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:27:03.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.382 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:27:03.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.399 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:27:03.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.413 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:27:03.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.431 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:27:03.479 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2020-05-18T21:27:03.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.481 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:27:03.488 INFO:teuthology.orchestra.run.smithi063.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-05-18T21:27:03.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.489 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:27:03.538 INFO:teuthology.orchestra.run.smithi063.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-05-18T21:27:03.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.539 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-05-18T21:27:03.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.558 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 1' 2020-05-18T21:27:03.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.570 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-05-18T21:27:03.635 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:27:03.635 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:03.635 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:27:03.635 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:03.636 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:27:03.636 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:03.636 INFO:teuthology.orchestra.run.smithi063.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-05-18T21:27:03.636 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 02:fd:d9:eb:12:c2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-05-18T21:27:03.636 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-05-18T21:27:03.637 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:03.637 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::fd:d9ff:feeb:12c2/64 scope link 2020-05-18T21:27:03.637 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:03.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.639 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-05-18T21:27:03.654 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:27:03.654 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:03.655 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:27:03.655 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:03.655 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:27:03.655 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:03.655 INFO:teuthology.orchestra.run.smithi063.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-05-18T21:27:03.656 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 02:fd:d9:eb:12:c2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-05-18T21:27:03.656 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-05-18T21:27:03.656 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:03.656 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::fd:d9ff:feeb:12c2/64 scope link 2020-05-18T21:27:03.656 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:03.659 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.2/16 2020-05-18T21:27:03.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.660 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.1' 2020-05-18T21:27:03.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.721 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:27:03.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.737 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up' 2020-05-18T21:27:03.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.801 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up' 2020-05-18T21:27:03.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.822 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254' 2020-05-18T21:27:03.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.836 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.1 up' 2020-05-18T21:27:03.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:03.908 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.1 master ceph-brx' 2020-05-18T21:27:03.929 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-05-18T21:27:03.930 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-05-18T21:27:03.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:03.930 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:27:03.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:03.980 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:27:03.995 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:27:03.997 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:27:03.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:03.998 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:27:04.005 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:27:04.006 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [50] 2020-05-18T21:27:04.006 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:27:04.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:04.009 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:27:04.024 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:27:04.025 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:27:04.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:04.026 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:27:04.073 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:27:04.090 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi063.stderr:2020-05-18T21:27:04.087+0000 7f8dc36cd080 -1 init, newargv = 0x55a359acd530 newargc=9ceph-fuse[15368]: starting ceph client 2020-05-18T21:27:04.090 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi063.stderr: 2020-05-18T21:27:04.099 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi063.stderr:ceph-fuse[15368]: starting fuse 2020-05-18T21:27:05.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:05.176 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:27:05.193 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:27:05.194 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:27:05.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:05.195 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:27:05.203 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:27:05.203 INFO:teuthology.orchestra.run.smithi063.stdout:53 2020-05-18T21:27:05.203 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50, 53] 2020-05-18T21:27:05.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:05.204 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:27:05.204 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:27:05.205 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:27:05.205 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:27:05.205 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:27:05.206 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:27:05.206 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:27:05.206 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-05-18T21:27:05.207 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:27:05.207 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:27:05.208 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:27:05.208 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:27:05.208 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:27:05.209 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:27:05.209 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:27:05.209 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:27:05.210 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:27:05.210 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:27:05.210 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:27:05.211 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:27:05.211 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:27:05.211 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.1")) 2020-05-18T21:27:05.212 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:27:05.287 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.1.15368.asok 2020-05-18T21:27:05.292 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.15368.asok 2020-05-18T21:27:05.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:05.293 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.15368.asok status 2020-05-18T21:27:05.382 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:27:05.382 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:27:05.383 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:27:05.383 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:27:05.383 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "1", 2020-05-18T21:27:05.383 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:27:05.383 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-05-18T21:27:05.384 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "15368", 2020-05-18T21:27:05.384 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:27:05.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:05.384 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:27:05.384 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:27:05.385 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4403, 2020-05-18T21:27:05.385 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:27:05.385 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:27:05.385 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:27:05.386 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 4403 2020-05-18T21:27:05.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:05.387 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:27:05.387 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:05.387 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.2:0", 2020-05-18T21:27:05.387 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3303037342 2020-05-18T21:27:05.388 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:05.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:05.388 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:27:05.388 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:05.388 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.2:0", 2020-05-18T21:27:05.388 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3303037342 2020-05-18T21:27:05.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:05.389 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.4403 192.168.0.2:0/3303037342", 2020-05-18T21:27:05.389 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.2:0/3303037342", 2020-05-18T21:27:05.389 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:27:05.390 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 6, 2020-05-18T21:27:05.390 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 23, 2020-05-18T21:27:05.390 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:27:05.390 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:27:05.391 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:27:05.397 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:27:05.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.495+0000 7fc58b59e700 1 Processor -- start 2020-05-18T21:27:05.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.495+0000 7fc58b59e700 1 -- start start 2020-05-18T21:27:05.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc58c061d80 0x7fc58c065130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:05.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc58c0acbe0 0x7fc58c0ad040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:05.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58b59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58c143090 con 0x7fc58c142bf0 2020-05-18T21:27:05.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58b59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58c0b6b10 con 0x7fc58c061d80 2020-05-18T21:27:05.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c143330 con 0x7fc58c0acbe0 2020-05-18T21:27:05.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc589d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc58c142bf0 0x7fc58c0ac4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55444/0 (socket says 172.21.15.63:55444) 2020-05-18T21:27:05.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc589d9b700 1 -- 172.21.15.63:0/2414845421 learned_addr learned my addr 172.21.15.63:0/2414845421 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:05.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58a59c700 1 --2- 172.21.15.63:0/2414845421 >> v2:172.21.15.63:3300/0 conn(0x7fc58c061d80 0x7fc58c065130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:05.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58ad9d700 1 --2- 172.21.15.63:0/2414845421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc58c0acbe0 0x7fc58c0ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:05.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58959a700 1 -- 172.21.15.63:0/2414845421 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868341667 0 0) 0x7fc58c143090 con 0x7fc58c142bf0 2020-05-18T21:27:05.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58959a700 1 -- 172.21.15.63:0/2414845421 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc56c003270 con 0x7fc58c142bf0 2020-05-18T21:27:05.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58a59c700 1 -- 172.21.15.63:0/2414845421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc58c0acbe0 msgr2=0x7fc58c0ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:05.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58a59c700 1 --2- 172.21.15.63:0/2414845421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc58c0acbe0 0x7fc58c0ad040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:05.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58a59c700 1 -- 172.21.15.63:0/2414845421 >> v1:172.21.15.63:6789/0 conn(0x7fc58c142bf0 legacy=0x7fc58c0ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:05.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58959a700 1 -- 172.21.15.63:0/2414845421 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3281531038 0 0) 0x7fc56c003270 con 0x7fc58c142bf0 2020-05-18T21:27:05.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58a59c700 1 -- 172.21.15.63:0/2414845421 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c1435d0 con 0x7fc58c061d80 2020-05-18T21:27:05.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58a59c700 1 --2- 172.21.15.63:0/2414845421 >> v2:172.21.15.63:3300/0 conn(0x7fc58c061d80 0x7fc58c065130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc574001c50 tx=0x7fc57c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58a59c700 1 --2- 172.21.15.63:0/2414845421 >> v2:172.21.15.63:3300/0 conn(0x7fc58c061d80 0x7fc58c065130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc574001c50 tx=0x7fc57c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58a59c700 1 --2- 172.21.15.63:0/2414845421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc58c061d80 0x7fc58c065130 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7fc574001c50 tx=0x7fc57c007a80).ready entity=mon.0 client_cookie=16efe9f666131def server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:05.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58a59c700 1 --2- 172.21.15.63:0/2414845421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc58c061d80 0x7fc58c065130 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fc574001c50 tx=0x7fc57c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58959a700 1 -- 172.21.15.63:0/2414845421 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc574001ab0 con 0x7fc58c061d80 2020-05-18T21:27:05.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58a59c700 1 --2- 172.21.15.63:0/2414845421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc58c061d80 0x7fc58c065130 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fc574001c50 tx=0x7fc57c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58959a700 1 -- 172.21.15.63:0/2414845421 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c008e40 con 0x7fc58c061d80 2020-05-18T21:27:05.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58a59c700 1 --2- 172.21.15.63:0/2414845421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc58c061d80 0x7fc58c065130 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fc574001c50 tx=0x7fc57c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58959a700 1 -- 172.21.15.63:0/2414845421 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc57c011440 con 0x7fc58c061d80 2020-05-18T21:27:05.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58b59e700 1 -- 172.21.15.63:0/2414845421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc58c061d80 msgr2=0x7fc58c065130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:05.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58b59e700 1 --2- 172.21.15.63:0/2414845421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc58c061d80 0x7fc58c065130 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7fc574001c50 tx=0x7fc57c007a80).stop 2020-05-18T21:27:05.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58b59e700 1 -- 172.21.15.63:0/2414845421 shutdown_connections 2020-05-18T21:27:05.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58b59e700 1 --2- 172.21.15.63:0/2414845421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc58c0acbe0 0x7fc58c0ad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:05.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58b59e700 1 --2- 172.21.15.63:0/2414845421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc58c061d80 0x7fc58c065130 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:05.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58b59e700 1 -- 172.21.15.63:0/2414845421 >> 172.21.15.63:0/2414845421 conn(0x7fc58c066d00 msgr2=0x7fc58c05a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:05.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58b59e700 1 -- 172.21.15.63:0/2414845421 shutdown_connections 2020-05-18T21:27:05.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.499+0000 7fc58b59e700 1 -- 172.21.15.63:0/2414845421 wait complete. 2020-05-18T21:27:05.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58b59e700 1 Processor -- start 2020-05-18T21:27:05.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58b59e700 1 -- start start 2020-05-18T21:27:05.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc58c061d80 0x7fc58c140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:05.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc58c142bf0 0x7fc58c1310e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:05.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58b59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58c149010 con 0x7fc58c0acbe0 2020-05-18T21:27:05.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58b59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58c131540 con 0x7fc58c061d80 2020-05-18T21:27:05.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c13f420 con 0x7fc58c142bf0 2020-05-18T21:27:05.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc58c061d80 0x7fc58c140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:05.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc58c061d80 0x7fc58c140960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53262/0 (socket says 172.21.15.63:53262) 2020-05-18T21:27:05.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58a59c700 1 -- 172.21.15.63:0/3929578198 learned_addr learned my addr 172.21.15.63:0/3929578198 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:05.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58ad9d700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc58c142bf0 0x7fc58c1310e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:05.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58a59c700 1 -- 172.21.15.63:0/3929578198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc58c142bf0 msgr2=0x7fc58c1310e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:05.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58a59c700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc58c142bf0 0x7fc58c1310e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:05.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58a59c700 1 -- 172.21.15.63:0/3929578198 >> v1:172.21.15.155:6789/0 conn(0x7fc58c0acbe0 legacy=0x7fc58c132b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:05.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58a59c700 1 -- 172.21.15.63:0/3929578198 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c13f6c0 con 0x7fc58c061d80 2020-05-18T21:27:05.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58a59c700 1 --2- 172.21.15.63:0/3929578198 >> v2:172.21.15.63:3300/0 conn(0x7fc58c061d80 0x7fc58c140960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc574001ab0 tx=0x7fc57c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58a59c700 1 --2- 172.21.15.63:0/3929578198 >> v2:172.21.15.63:3300/0 conn(0x7fc58c061d80 0x7fc58c140960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc574001ab0 tx=0x7fc57c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58a59c700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc58c061d80 0x7fc58c140960 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7fc574001ab0 tx=0x7fc57c007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:05.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58a59c700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc58c061d80 0x7fc58c140960 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7fc574001ab0 tx=0x7fc57c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58a59c700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc58c061d80 0x7fc58c140960 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7fc574001ab0 tx=0x7fc57c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc5837fe700 1 -- 172.21.15.63:0/3929578198 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc57c007360 con 0x7fc58c061d80 2020-05-18T21:27:05.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58a59c700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc58c061d80 0x7fc58c140960 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7fc574001ab0 tx=0x7fc57c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc5837fe700 1 -- 172.21.15.63:0/3929578198 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c0074c0 con 0x7fc58c061d80 2020-05-18T21:27:05.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58b59e700 1 -- 172.21.15.63:0/3929578198 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c13f960 con 0x7fc58c061d80 2020-05-18T21:27:05.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc5837fe700 1 -- 172.21.15.63:0/3929578198 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc57c011a80 con 0x7fc58c061d80 2020-05-18T21:27:05.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.503+0000 7fc58b59e700 1 -- 172.21.15.63:0/3929578198 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c1481e0 con 0x7fc58c061d80 2020-05-18T21:27:05.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.507+0000 7fc58b59e700 1 -- 172.21.15.63:0/3929578198 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58c0569e0 con 0x7fc58c061d80 2020-05-18T21:27:05.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.507+0000 7fc58a59c700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc58c061d80 0x7fc58c140960 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7fc574001ab0 tx=0x7fc57c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.507+0000 7fc5837fe700 1 -- 172.21.15.63:0/3929578198 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc57c011be0 con 0x7fc58c061d80 2020-05-18T21:27:05.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.507+0000 7fc58a59c700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc58c061d80 0x7fc58c140960 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7fc574001ab0 tx=0x7fc57c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.507+0000 7fc5837fe700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc57004f9b0 0x7fc570051e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:05.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.507+0000 7fc5837fe700 1 -- 172.21.15.63:0/3929578198 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc57c0644a0 con 0x7fc58c061d80 2020-05-18T21:27:05.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.507+0000 7fc589d9b700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc57004f9b0 0x7fc570051e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:05.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.507+0000 7fc589d9b700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc57004f9b0 0x7fc570051e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc574001c90 tx=0x7fc574001410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.507+0000 7fc589d9b700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc57004f9b0 0x7fc570051e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc574001c90 tx=0x7fc574001410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.507+0000 7fc589d9b700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc57004f9b0 0x7fc570051e70 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7fc574001c90 tx=0x7fc574001410).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:05.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.511+0000 7fc58a59c700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc58c061d80 0x7fc58c140960 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7fc574001ab0 tx=0x7fc57c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.511+0000 7fc5837fe700 1 -- 172.21.15.63:0/3929578198 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc57c03e890 con 0x7fc58c061d80 2020-05-18T21:27:05.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.627+0000 7fc58b59e700 1 -- 172.21.15.63:0/3929578198 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc58c05c860 con 0x7fc58c061d80 2020-05-18T21:27:05.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.631+0000 7fc58a59c700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc58c061d80 0x7fc58c140960 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7fc574001ab0 tx=0x7fc57c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.631+0000 7fc5837fe700 1 -- 172.21.15.63:0/3929578198 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fc57c041eb0 con 0x7fc58c061d80 2020-05-18T21:27:05.634 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:05.634 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":23,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:26:47.498250+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:26:43.453504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-05-18T21:26:44.456531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:27:05.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.631+0000 7fc58b59e700 1 -- 172.21.15.63:0/3929578198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc57004f9b0 msgr2=0x7fc570051e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:05.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.631+0000 7fc58b59e700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc57004f9b0 0x7fc570051e70 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7fc574001c90 tx=0x7fc574001410).stop 2020-05-18T21:27:05.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.631+0000 7fc58b59e700 1 -- 172.21.15.63:0/3929578198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc58c061d80 msgr2=0x7fc58c140960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:05.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.631+0000 7fc58b59e700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc58c061d80 0x7fc58c140960 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7fc574001ab0 tx=0x7fc57c007a80).stop 2020-05-18T21:27:05.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.631+0000 7fc58b59e700 1 -- 172.21.15.63:0/3929578198 shutdown_connections 2020-05-18T21:27:05.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.631+0000 7fc58b59e700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc57004f9b0 0x7fc570051e70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:05.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.631+0000 7fc58b59e700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc58c142bf0 0x7fc58c1310e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:05.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.631+0000 7fc58b59e700 1 --2- 172.21.15.63:0/3929578198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc58c061d80 0x7fc58c140960 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:05.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.631+0000 7fc58b59e700 1 -- 172.21.15.63:0/3929578198 >> 172.21.15.63:0/3929578198 conn(0x7fc58c066d00 msgr2=0x7fc58c1459a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:05.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.631+0000 7fc58b59e700 1 -- 172.21.15.63:0/3929578198 shutdown_connections 2020-05-18T21:27:05.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.631+0000 7fc58b59e700 1 -- 172.21.15.63:0/3929578198 wait complete. 2020-05-18T21:27:05.646 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:26:43.453504+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:26:44.456531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:27:05.647 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:27:05.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.751+0000 7f998e2d0700 1 Processor -- start 2020-05-18T21:27:05.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.751+0000 7f998e2d0700 1 -- start start 2020-05-18T21:27:05.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.751+0000 7f998e2d0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998805ef00 0x7f9988143450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:05.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.751+0000 7f998e2d0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99880b4990 con 0x7f99880b50d0 2020-05-18T21:27:05.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.751+0000 7f998e2d0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99880b4c30 con 0x7f9988142670 2020-05-18T21:27:05.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.751+0000 7f998e2d0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998805f2e0 con 0x7f998805ef00 2020-05-18T21:27:05.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.751+0000 7f998cacd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f99880b50d0 0x7f9988141f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55460/0 (socket says 172.21.15.63:55460) 2020-05-18T21:27:05.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.751+0000 7f998cacd700 1 -- 172.21.15.63:0/1701243334 learned_addr learned my addr 172.21.15.63:0/1701243334 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:05.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.751+0000 7f998d2ce700 1 --2- 172.21.15.63:0/1701243334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998805ef00 0x7f9988143450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:05.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f997ffff700 1 -- 172.21.15.63:0/1701243334 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4082533258 0 0) 0x7f99880b4990 con 0x7f99880b50d0 2020-05-18T21:27:05.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f997ffff700 1 -- 172.21.15.63:0/1701243334 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f996c003270 con 0x7f99880b50d0 2020-05-18T21:27:05.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f997ffff700 1 -- 172.21.15.63:0/1701243334 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335709269 0 0) 0x7f99880b4c30 con 0x7f9988142670 2020-05-18T21:27:05.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f997ffff700 1 -- 172.21.15.63:0/1701243334 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99880b4990 con 0x7f9988142670 2020-05-18T21:27:05.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f998d2ce700 1 -- 172.21.15.63:0/1701243334 >> v1:172.21.15.155:6789/0 conn(0x7f9988142670 legacy=0x7f9988060fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:05.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f998d2ce700 1 -- 172.21.15.63:0/1701243334 >> v1:172.21.15.63:6789/0 conn(0x7f99880b50d0 legacy=0x7f9988141f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:05.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f998d2ce700 1 -- 172.21.15.63:0/1701243334 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99881438b0 con 0x7f998805ef00 2020-05-18T21:27:05.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f998d2ce700 1 --2- 172.21.15.63:0/1701243334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998805ef00 0x7f9988143450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9984002f70 tx=0x7f9984008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f998d2ce700 1 --2- 172.21.15.63:0/1701243334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998805ef00 0x7f9988143450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9984002f70 tx=0x7f9984008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f998d2ce700 1 --2- 172.21.15.63:0/1701243334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998805ef00 0x7f9988143450 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f9984002f70 tx=0x7f9984008920).ready entity=mon.2 client_cookie=613ef285d24e1715 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:05.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f998d2ce700 1 --2- 172.21.15.63:0/1701243334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998805ef00 0x7f9988143450 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f9984002f70 tx=0x7f9984008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f997ffff700 1 -- 172.21.15.63:0/1701243334 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9984008e80 con 0x7f998805ef00 2020-05-18T21:27:05.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f998d2ce700 1 --2- 172.21.15.63:0/1701243334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998805ef00 0x7f9988143450 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f9984002f70 tx=0x7f9984008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f997ffff700 1 -- 172.21.15.63:0/1701243334 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9984011580 con 0x7f998805ef00 2020-05-18T21:27:05.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f998d2ce700 1 --2- 172.21.15.63:0/1701243334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998805ef00 0x7f9988143450 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f9984002f70 tx=0x7f9984008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f997ffff700 1 -- 172.21.15.63:0/1701243334 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99840118e0 con 0x7f998805ef00 2020-05-18T21:27:05.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f998e2d0700 1 -- 172.21.15.63:0/1701243334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998805ef00 msgr2=0x7f9988143450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:05.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f998e2d0700 1 --2- 172.21.15.63:0/1701243334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998805ef00 0x7f9988143450 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f9984002f70 tx=0x7f9984008920).stop 2020-05-18T21:27:05.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f998e2d0700 1 -- 172.21.15.63:0/1701243334 shutdown_connections 2020-05-18T21:27:05.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f998e2d0700 1 --2- 172.21.15.63:0/1701243334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998805ef00 0x7f9988143450 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:05.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f998e2d0700 1 -- 172.21.15.63:0/1701243334 >> 172.21.15.63:0/1701243334 conn(0x7f99880b8b10 msgr2=0x7f99880b8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:05.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f998e2d0700 1 -- 172.21.15.63:0/1701243334 shutdown_connections 2020-05-18T21:27:05.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f998e2d0700 1 -- 172.21.15.63:0/1701243334 wait complete. 2020-05-18T21:27:05.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f998e2d0700 1 Processor -- start 2020-05-18T21:27:05.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.755+0000 7f998e2d0700 1 -- start start 2020-05-18T21:27:05.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998e2d0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9988142670 0x7f998808f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:05.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998e2d0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9988153850 con 0x7f99880b50d0 2020-05-18T21:27:05.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998e2d0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9988097b20 con 0x7f998805ef00 2020-05-18T21:27:05.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998e2d0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9988097dc0 con 0x7f9988142670 2020-05-18T21:27:05.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998cacd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f99880b50d0 0x7f99880b78c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55466/0 (socket says 172.21.15.63:55466) 2020-05-18T21:27:05.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998cacd700 1 -- 172.21.15.63:0/2689522620 learned_addr learned my addr 172.21.15.63:0/2689522620 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:05.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998dacf700 1 --2- 172.21.15.63:0/2689522620 >> v2:172.21.15.155:3300/0 conn(0x7f9988142670 0x7f998808f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:05.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446553895 0 0) 0x7f9988153850 con 0x7f99880b50d0 2020-05-18T21:27:05.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9970002fe0 con 0x7f99880b50d0 2020-05-18T21:27:05.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4099514946 0 0) 0x7f9988097b20 con 0x7f998805ef00 2020-05-18T21:27:05.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9988153850 con 0x7f998805ef00 2020-05-18T21:27:05.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1756879412 0 0) 0x7f9970002fe0 con 0x7f99880b50d0 2020-05-18T21:27:05.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9988097b20 con 0x7f99880b50d0 2020-05-18T21:27:05.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f99780018b0 con 0x7f99880b50d0 2020-05-18T21:27:05.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 >> v2:172.21.15.155:3300/0 conn(0x7f9988142670 msgr2=0x7f998808f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:05.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 --2- 172.21.15.63:0/2689522620 >> v2:172.21.15.155:3300/0 conn(0x7f9988142670 0x7f998808f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:05.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 >> v1:172.21.15.155:6789/0 conn(0x7f998805ef00 legacy=0x7f9988153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:05.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 >> v1:172.21.15.63:6789/0 conn(0x7f99880b50d0 legacy=0x7f99880b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:05.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9970004bf0 0x7f9970004fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:05.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9970003b30 0x7f9970003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:05.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9970004410 0x7f997000b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:05.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9988097dc0 con 0x7f9970004bf0 2020-05-18T21:27:05.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99700048f0 con 0x7f9970003b30 2020-05-18T21:27:05.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997000bbc0 con 0x7f9970004410 2020-05-18T21:27:05.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998d2ce700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9970004bf0 0x7f9970004fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:05.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998dacf700 1 --2- 172.21.15.63:0/2689522620 >> v2:172.21.15.155:3300/0 conn(0x7f9988142670 0x7f998808f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:05.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998cacd700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9970003b30 0x7f9970003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:05.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998dacf700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9970004410 0x7f997000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:05.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998d2ce700 1 -- 172.21.15.63:0/2689522620 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9970004410 msgr2=0x7f997000b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:05.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998d2ce700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9970004410 0x7f997000b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:05.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998d2ce700 1 -- 172.21.15.63:0/2689522620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9970003b30 msgr2=0x7f9970003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:05.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998d2ce700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9970003b30 0x7f9970003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:05.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998d2ce700 1 -- 172.21.15.63:0/2689522620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99880b7fd0 con 0x7f9970004bf0 2020-05-18T21:27:05.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998e2d0700 1 -- 172.21.15.63:0/2689522620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998814d200 con 0x7f9970004bf0 2020-05-18T21:27:05.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998d2ce700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9970004bf0 0x7f9970004fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9970004b00 tx=0x7f9988143a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998cacd700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9970003b30 0x7f9970003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:27:05.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998dacf700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9970004410 0x7f997000b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:27:05.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998dacf700 1 -- 172.21.15.63:0/2689522620 reap_dead start 2020-05-18T21:27:05.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998e2d0700 1 -- 172.21.15.63:0/2689522620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99880973a0 con 0x7f9970004bf0 2020-05-18T21:27:05.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998d2ce700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9970004bf0 0x7f9970004fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9970004b00 tx=0x7f9988143a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998d2ce700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9970004bf0 0x7f9970004fd0 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7f9970004b00 tx=0x7f9988143a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:05.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998d2ce700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9970004bf0 0x7f9970004fd0 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f9970004b00 tx=0x7f9988143a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9984007360 con 0x7f9970004bf0 2020-05-18T21:27:05.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998d2ce700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9970004bf0 0x7f9970004fd0 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f9970004b00 tx=0x7f9988143a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f998d2ce700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9970004bf0 0x7f9970004fd0 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f9970004b00 tx=0x7f9988143a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9984007500 con 0x7f9970004bf0 2020-05-18T21:27:05.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.759+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99840058f0 con 0x7f9970004bf0 2020-05-18T21:27:05.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.763+0000 7f998d2ce700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9970004bf0 0x7f9970004fd0 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f9970004b00 tx=0x7f9988143a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.763+0000 7f998e2d0700 1 -- 172.21.15.63:0/2689522620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9964003380 con 0x7f9970004bf0 2020-05-18T21:27:05.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.763+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9984005a50 con 0x7f9970004bf0 2020-05-18T21:27:05.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.763+0000 7f998d2ce700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9970004bf0 0x7f9970004fd0 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f9970004b00 tx=0x7f9988143a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.763+0000 7f997e7fc700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9970053900 0x7f9970055dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:05.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.763+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9984064540 con 0x7f9970004bf0 2020-05-18T21:27:05.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.763+0000 7f998cacd700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9970053900 0x7f9970055dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:05.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.763+0000 7f998cacd700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9970053900 0x7f9970055dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9978001040 tx=0x7f997800a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.763+0000 7f998cacd700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9970053900 0x7f9970055dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9978001040 tx=0x7f997800a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.763+0000 7f998cacd700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9970053900 0x7f9970055dc0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f9978001040 tx=0x7f997800a720).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:05.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.767+0000 7f998d2ce700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9970004bf0 0x7f9970004fd0 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f9970004b00 tx=0x7f9988143a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.767+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f998403e9f0 con 0x7f9970004bf0 2020-05-18T21:27:05.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.883+0000 7f998e2d0700 1 -- 172.21.15.63:0/2689522620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9964002260 con 0x7f9970004bf0 2020-05-18T21:27:05.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.883+0000 7f998d2ce700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9970004bf0 0x7f9970004fd0 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f9970004b00 tx=0x7f9988143a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:05.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.883+0000 7f997e7fc700 1 -- 172.21.15.63:0/2689522620 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9984042010 con 0x7f9970004bf0 2020-05-18T21:27:05.886 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:27:05.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.883+0000 7f998e2d0700 1 -- 172.21.15.63:0/2689522620 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9970053900 msgr2=0x7f9970055dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:05.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.883+0000 7f998e2d0700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9970053900 0x7f9970055dc0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f9978001040 tx=0x7f997800a720).stop 2020-05-18T21:27:05.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.883+0000 7f998e2d0700 1 -- 172.21.15.63:0/2689522620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9970004bf0 msgr2=0x7f9970004fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:05.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.883+0000 7f998e2d0700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9970004bf0 0x7f9970004fd0 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7f9970004b00 tx=0x7f9988143a40).stop 2020-05-18T21:27:05.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.883+0000 7f998e2d0700 1 -- 172.21.15.63:0/2689522620 shutdown_connections 2020-05-18T21:27:05.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.883+0000 7f998e2d0700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9970053900 0x7f9970055dc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:05.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.883+0000 7f998e2d0700 1 --2- 172.21.15.63:0/2689522620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9970004bf0 0x7f9970004fd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:05.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.883+0000 7f998e2d0700 1 -- 172.21.15.63:0/2689522620 >> 172.21.15.63:0/2689522620 conn(0x7f99880b8b10 msgr2=0x7f9988142e10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:05.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.883+0000 7f998e2d0700 1 -- 172.21.15.63:0/2689522620 shutdown_connections 2020-05-18T21:27:05.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.883+0000 7f998e2d0700 1 -- 172.21.15.63:0/2689522620 wait complete. 2020-05-18T21:27:05.898 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:27:06.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.999+0000 7f4004930700 1 Processor -- start 2020-05-18T21:27:06.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:05.999+0000 7f4004930700 1 -- start start 2020-05-18T21:27:06.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f4004930700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f400006a630 0x7f40000adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:06.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f4004930700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40000b4450 0x7f40000b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:06.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f4004930700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40000b3790 con 0x7f4000149d50 2020-05-18T21:27:06.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f4004930700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40000b39f0 con 0x7f400006a630 2020-05-18T21:27:06.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f4004930700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40000b3c90 con 0x7f40000b4450 2020-05-18T21:27:06.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f3ffeffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f400006a630 0x7f40000adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:06.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f3ffeffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f400006a630 0x7f40000adb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53292/0 (socket says 172.21.15.63:53292) 2020-05-18T21:27:06.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f3ffeffd700 1 -- 172.21.15.63:0/1093799908 learned_addr learned my addr 172.21.15.63:0/1093799908 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:06.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f3ffffff700 1 --2- 172.21.15.63:0/1093799908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40000b4450 0x7f40000b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:06.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f3ffeffd700 1 -- 172.21.15.63:0/1093799908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40000b4450 msgr2=0x7f40000b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f3ffeffd700 1 --2- 172.21.15.63:0/1093799908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40000b4450 0x7f40000b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f3ffeffd700 1 -- 172.21.15.63:0/1093799908 >> v1:172.21.15.155:6789/0 conn(0x7f4000149d50 legacy=0x7f40000ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f3ffe7fc700 1 -- 172.21.15.63:0/1093799908 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626228173 0 0) 0x7f40000b3790 con 0x7f4000149d50 2020-05-18T21:27:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f3ffeffd700 1 -- 172.21.15.63:0/1093799908 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40000adf60 con 0x7f400006a630 2020-05-18T21:27:06.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f3ffeffd700 1 --2- 172.21.15.63:0/1093799908 >> v2:172.21.15.63:3300/0 conn(0x7f400006a630 0x7f40000adb00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3ff0002f70 tx=0x7f3ff0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f3ffeffd700 1 --2- 172.21.15.63:0/1093799908 >> v2:172.21.15.63:3300/0 conn(0x7f400006a630 0x7f40000adb00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3ff0002f70 tx=0x7f3ff0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f3ffeffd700 1 --2- 172.21.15.63:0/1093799908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f400006a630 0x7f40000adb00 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f3ff0002f70 tx=0x7f3ff0007a80).ready entity=mon.0 client_cookie=ff64157309ec25fe server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:06.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f3ffeffd700 1 --2- 172.21.15.63:0/1093799908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f400006a630 0x7f40000adb00 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f3ff0002f70 tx=0x7f3ff0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f3ffe7fc700 1 -- 172.21.15.63:0/1093799908 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ff0008e50 con 0x7f400006a630 2020-05-18T21:27:06.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f3ffeffd700 1 --2- 172.21.15.63:0/1093799908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f400006a630 0x7f40000adb00 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f3ff0002f70 tx=0x7f3ff0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f3ffe7fc700 1 -- 172.21.15.63:0/1093799908 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff0010750 con 0x7f400006a630 2020-05-18T21:27:06.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f4004930700 1 -- 172.21.15.63:0/1093799908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f400006a630 msgr2=0x7f40000adb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f3ffeffd700 1 --2- 172.21.15.63:0/1093799908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f400006a630 0x7f40000adb00 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f3ff0002f70 tx=0x7f3ff0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f3ffe7fc700 1 -- 172.21.15.63:0/1093799908 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ff0010b30 con 0x7f400006a630 2020-05-18T21:27:06.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f4004930700 1 --2- 172.21.15.63:0/1093799908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f400006a630 0x7f40000adb00 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f3ff0002f70 tx=0x7f3ff0007a80).stop 2020-05-18T21:27:06.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f4004930700 1 -- 172.21.15.63:0/1093799908 shutdown_connections 2020-05-18T21:27:06.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f4004930700 1 --2- 172.21.15.63:0/1093799908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40000b4450 0x7f40000b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:06.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f4004930700 1 --2- 172.21.15.63:0/1093799908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f400006a630 0x7f40000adb00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:06.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f4004930700 1 -- 172.21.15.63:0/1093799908 >> 172.21.15.63:0/1093799908 conn(0x7f400005fb90 msgr2=0x7f4000069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:06.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f4004930700 1 -- 172.21.15.63:0/1093799908 shutdown_connections 2020-05-18T21:27:06.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.003+0000 7f4004930700 1 -- 172.21.15.63:0/1093799908 wait complete. 2020-05-18T21:27:06.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f4004930700 1 Processor -- start 2020-05-18T21:27:06.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f4004930700 1 -- start start 2020-05-18T21:27:06.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f4004930700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f400006a630 0x7f40000654f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:06.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f4004930700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f400015b3c0 con 0x7f40000b4450 2020-05-18T21:27:06.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f4004930700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f400015b660 con 0x7f4000149d50 2020-05-18T21:27:06.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f4004930700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400015b1e0 con 0x7f400006a630 2020-05-18T21:27:06.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f3ffeffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f40000b4450 0x7f40001464b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55486/0 (socket says 172.21.15.63:55486) 2020-05-18T21:27:06.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f3ffeffd700 1 -- 172.21.15.63:0/693128680 learned_addr learned my addr 172.21.15.63:0/693128680 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:06.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f3fff7fe700 1 --2- 172.21.15.63:0/693128680 >> v2:172.21.15.155:3300/0 conn(0x7f400006a630 0x7f40000654f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:06.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f3ffcff9700 1 -- 172.21.15.63:0/693128680 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479256648 0 0) 0x7f400015b3c0 con 0x7f40000b4450 2020-05-18T21:27:06.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f3ffcff9700 1 -- 172.21.15.63:0/693128680 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fd8002fe0 con 0x7f40000b4450 2020-05-18T21:27:06.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f3fff7fe700 1 -- 172.21.15.63:0/693128680 >> v1:172.21.15.155:6789/0 conn(0x7f4000149d50 legacy=0x7f4000063770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f3fff7fe700 1 -- 172.21.15.63:0/693128680 >> v1:172.21.15.63:6789/0 conn(0x7f40000b4450 legacy=0x7f40001464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f3fff7fe700 1 -- 172.21.15.63:0/693128680 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4000146bc0 con 0x7f400006a630 2020-05-18T21:27:06.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f3fff7fe700 1 --2- 172.21.15.63:0/693128680 >> v2:172.21.15.155:3300/0 conn(0x7f400006a630 0x7f40000654f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ff8001250 tx=0x7f3ff8010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f3fff7fe700 1 --2- 172.21.15.63:0/693128680 >> v2:172.21.15.155:3300/0 conn(0x7f400006a630 0x7f40000654f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ff8001250 tx=0x7f3ff8010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f3fff7fe700 1 --2- 172.21.15.63:0/693128680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f400006a630 0x7f40000654f0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f3ff8001250 tx=0x7f3ff8010d20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:06.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f3fff7fe700 1 --2- 172.21.15.63:0/693128680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f400006a630 0x7f40000654f0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f3ff8001250 tx=0x7f3ff8010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f3ffcff9700 1 -- 172.21.15.63:0/693128680 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ff80101e0 con 0x7f400006a630 2020-05-18T21:27:06.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f3fff7fe700 1 --2- 172.21.15.63:0/693128680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f400006a630 0x7f40000654f0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f3ff8001250 tx=0x7f3ff8010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f3fff7fe700 1 --2- 172.21.15.63:0/693128680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f400006a630 0x7f40000654f0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f3ff8001250 tx=0x7f3ff8010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f3ffcff9700 1 -- 172.21.15.63:0/693128680 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff8010340 con 0x7f400006a630 2020-05-18T21:27:06.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f3ffcff9700 1 -- 172.21.15.63:0/693128680 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ff8010720 con 0x7f400006a630 2020-05-18T21:27:06.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f4004930700 1 -- 172.21.15.63:0/693128680 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40000b15d0 con 0x7f400006a630 2020-05-18T21:27:06.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.007+0000 7f4004930700 1 -- 172.21.15.63:0/693128680 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40000b1a50 con 0x7f400006a630 2020-05-18T21:27:06.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.011+0000 7f3fff7fe700 1 --2- 172.21.15.63:0/693128680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f400006a630 0x7f40000654f0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f3ff8001250 tx=0x7f3ff8010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.011+0000 7f4004930700 1 -- 172.21.15.63:0/693128680 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40000569e0 con 0x7f400006a630 2020-05-18T21:27:06.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.011+0000 7f3ffcff9700 1 -- 172.21.15.63:0/693128680 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3ff80068a0 con 0x7f400006a630 2020-05-18T21:27:06.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.011+0000 7f3fff7fe700 1 --2- 172.21.15.63:0/693128680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f400006a630 0x7f40000654f0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f3ff8001250 tx=0x7f3ff8010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.011+0000 7f3ffcff9700 1 --2- 172.21.15.63:0/693128680 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3fd804fd80 0x7f3fd8052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:06.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.011+0000 7f3ffcff9700 1 -- 172.21.15.63:0/693128680 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3ff8063fe0 con 0x7f400006a630 2020-05-18T21:27:06.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.011+0000 7f3ffeffd700 1 --2- 172.21.15.63:0/693128680 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3fd804fd80 0x7f3fd8052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:06.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.011+0000 7f3ffeffd700 1 --2- 172.21.15.63:0/693128680 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3fd804fd80 0x7f3fd8052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ff0000bc0 tx=0x7f3ff0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.011+0000 7f3ffeffd700 1 --2- 172.21.15.63:0/693128680 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3fd804fd80 0x7f3fd8052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ff0000bc0 tx=0x7f3ff0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.011+0000 7f3ffeffd700 1 --2- 172.21.15.63:0/693128680 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3fd804fd80 0x7f3fd8052240 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f3ff0000bc0 tx=0x7f3ff0007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:06.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.019+0000 7f3fff7fe700 1 --2- 172.21.15.63:0/693128680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f400006a630 0x7f40000654f0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f3ff8001250 tx=0x7f3ff8010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.019+0000 7f3ffcff9700 1 -- 172.21.15.63:0/693128680 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3ff803e3d0 con 0x7f400006a630 2020-05-18T21:27:06.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.139+0000 7f4004930700 1 -- 172.21.15.63:0/693128680 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f40000b58b0 con 0x7f400006a630 2020-05-18T21:27:06.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.139+0000 7f3fff7fe700 1 --2- 172.21.15.63:0/693128680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f400006a630 0x7f40000654f0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f3ff8001250 tx=0x7f3ff8010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.139+0000 7f3ffcff9700 1 -- 172.21.15.63:0/693128680 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3ff80419f0 con 0x7f400006a630 2020-05-18T21:27:06.143 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:06.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.143+0000 7f4004930700 1 -- 172.21.15.63:0/693128680 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3fd804fd80 msgr2=0x7f3fd8052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.143+0000 7f4004930700 1 --2- 172.21.15.63:0/693128680 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3fd804fd80 0x7f3fd8052240 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f3ff0000bc0 tx=0x7f3ff0007a80).stop 2020-05-18T21:27:06.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.143+0000 7f4004930700 1 -- 172.21.15.63:0/693128680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f400006a630 msgr2=0x7f40000654f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.143+0000 7f4004930700 1 --2- 172.21.15.63:0/693128680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f400006a630 0x7f40000654f0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f3ff8001250 tx=0x7f3ff8010d20).stop 2020-05-18T21:27:06.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.143+0000 7f4004930700 1 -- 172.21.15.63:0/693128680 shutdown_connections 2020-05-18T21:27:06.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.143+0000 7f4004930700 1 --2- 172.21.15.63:0/693128680 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3fd804fd80 0x7f3fd8052240 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:06.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.143+0000 7f4004930700 1 --2- 172.21.15.63:0/693128680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f400006a630 0x7f40000654f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:06.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.143+0000 7f4004930700 1 -- 172.21.15.63:0/693128680 >> 172.21.15.63:0/693128680 conn(0x7f400005fb90 msgr2=0x7f40000b2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:06.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.143+0000 7f4004930700 1 -- 172.21.15.63:0/693128680 shutdown_connections 2020-05-18T21:27:06.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.143+0000 7f4004930700 1 -- 172.21.15.63:0/693128680 wait complete. 2020-05-18T21:27:06.157 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:27:06.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.259+0000 7fd519bb8700 1 Processor -- start 2020-05-18T21:27:06.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.259+0000 7fd519bb8700 1 -- start start 2020-05-18T21:27:06.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd519bb8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd514143430 0x7fd514145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:06.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd519bb8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5140b7bf0 0x7fd5140b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:06.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd519bb8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd514143810 con 0x7fd5140b6d70 2020-05-18T21:27:06.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd519bb8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5140b7210 con 0x7fd514143430 2020-05-18T21:27:06.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd519bb8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5140b74b0 con 0x7fd5140b7bf0 2020-05-18T21:27:06.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd513fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5140b7bf0 0x7fd5140b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:06.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd5137fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd514143430 0x7fd514145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:06.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd513fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5140b7bf0 0x7fd5140b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:44008/0 (socket says 172.21.15.63:44008) 2020-05-18T21:27:06.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd512ffd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd5140b6d70 0x7fd5140b9160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:53810/0 (socket says 172.21.15.63:53810) 2020-05-18T21:27:06.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd513fff700 1 -- 172.21.15.63:0/3702887216 learned_addr learned my addr 172.21.15.63:0/3702887216 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:06.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd5127fc700 1 -- 172.21.15.63:0/3702887216 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2994617976 0 0) 0x7fd514143810 con 0x7fd5140b6d70 2020-05-18T21:27:06.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd5127fc700 1 -- 172.21.15.63:0/3702887216 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4f4003270 con 0x7fd5140b6d70 2020-05-18T21:27:06.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd513fff700 1 -- 172.21.15.63:0/3702887216 >> v2:172.21.15.155:3300/0 conn(0x7fd514143430 msgr2=0x7fd514145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:06.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd513fff700 1 --2- 172.21.15.63:0/3702887216 >> v2:172.21.15.155:3300/0 conn(0x7fd514143430 0x7fd514145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:06.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd513fff700 1 -- 172.21.15.63:0/3702887216 >> v1:172.21.15.155:6789/0 conn(0x7fd5140b6d70 legacy=0x7fd5140b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd513fff700 1 -- 172.21.15.63:0/3702887216 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5140b7750 con 0x7fd5140b7bf0 2020-05-18T21:27:06.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd5137fe700 1 --2- 172.21.15.63:0/3702887216 >> v2:172.21.15.155:3300/0 conn(0x7fd514143430 0x7fd514145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:06.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd513fff700 1 --2- 172.21.15.63:0/3702887216 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5140b7bf0 0x7fd5140b4290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd50c0032f0 tx=0x7fd50c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd513fff700 1 --2- 172.21.15.63:0/3702887216 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5140b7bf0 0x7fd5140b4290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd50c0032f0 tx=0x7fd50c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd513fff700 1 --2- 172.21.15.63:0/3702887216 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5140b7bf0 0x7fd5140b4290 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fd50c0032f0 tx=0x7fd50c007e00).ready entity=mon.2 client_cookie=f9c35769a83654f9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:06.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd513fff700 1 --2- 172.21.15.63:0/3702887216 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5140b7bf0 0x7fd5140b4290 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fd50c0032f0 tx=0x7fd50c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd5127fc700 1 -- 172.21.15.63:0/3702887216 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd50c011c60 con 0x7fd5140b7bf0 2020-05-18T21:27:06.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd513fff700 1 --2- 172.21.15.63:0/3702887216 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5140b7bf0 0x7fd5140b4290 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fd50c0032f0 tx=0x7fd50c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd5127fc700 1 -- 172.21.15.63:0/3702887216 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c011dc0 con 0x7fd5140b7bf0 2020-05-18T21:27:06.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd513fff700 1 --2- 172.21.15.63:0/3702887216 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5140b7bf0 0x7fd5140b4290 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fd50c0032f0 tx=0x7fd50c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd519bb8700 1 -- 172.21.15.63:0/3702887216 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5140b7bf0 msgr2=0x7fd5140b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd5127fc700 1 -- 172.21.15.63:0/3702887216 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd50c00a370 con 0x7fd5140b7bf0 2020-05-18T21:27:06.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd519bb8700 1 --2- 172.21.15.63:0/3702887216 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5140b7bf0 0x7fd5140b4290 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fd50c0032f0 tx=0x7fd50c007e00).stop 2020-05-18T21:27:06.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd519bb8700 1 -- 172.21.15.63:0/3702887216 shutdown_connections 2020-05-18T21:27:06.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd519bb8700 1 --2- 172.21.15.63:0/3702887216 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5140b7bf0 0x7fd5140b4290 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:06.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd519bb8700 1 --2- 172.21.15.63:0/3702887216 >> v2:172.21.15.155:3300/0 conn(0x7fd514143430 0x7fd514145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:06.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd519bb8700 1 -- 172.21.15.63:0/3702887216 >> 172.21.15.63:0/3702887216 conn(0x7fd514069b70 msgr2=0x7fd514069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:06.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd519bb8700 1 -- 172.21.15.63:0/3702887216 shutdown_connections 2020-05-18T21:27:06.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.263+0000 7fd519bb8700 1 -- 172.21.15.63:0/3702887216 wait complete. 2020-05-18T21:27:06.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd519bb8700 1 Processor -- start 2020-05-18T21:27:06.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd519bb8700 1 -- start start 2020-05-18T21:27:06.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd519bb8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5140b6d70 0x7fd514141370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:06.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd519bb8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd514143430 0x7fd514156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:06.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd519bb8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd514156bd0 con 0x7fd5140b7bf0 2020-05-18T21:27:06.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd519bb8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd514156e40 con 0x7fd514143430 2020-05-18T21:27:06.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd519bb8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5141570e0 con 0x7fd5140b6d70 2020-05-18T21:27:06.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd513fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd514143430 0x7fd514156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:06.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd512ffd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd5140b7bf0 0x7fd5140b2800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:53814/0 (socket says 172.21.15.63:53814) 2020-05-18T21:27:06.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd512ffd700 1 -- 172.21.15.63:0/3357525755 learned_addr learned my addr 172.21.15.63:0/3357525755 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:06.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd5137fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5140b6d70 0x7fd514141370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:06.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd513fff700 1 -- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5140b6d70 msgr2=0x7fd514141370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd513fff700 1 --2- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5140b6d70 0x7fd514141370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:06.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd513fff700 1 -- 172.21.15.63:0/3357525755 >> v1:172.21.15.155:6789/0 conn(0x7fd5140b7bf0 legacy=0x7fd5140b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd513fff700 1 -- 172.21.15.63:0/3357525755 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd514157380 con 0x7fd514143430 2020-05-18T21:27:06.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd513fff700 1 --2- 172.21.15.63:0/3357525755 >> v2:172.21.15.155:3300/0 conn(0x7fd514143430 0x7fd514156770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd50c0032f0 tx=0x7fd50c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd513fff700 1 --2- 172.21.15.63:0/3357525755 >> v2:172.21.15.155:3300/0 conn(0x7fd514143430 0x7fd514156770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd50c0032f0 tx=0x7fd50c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd513fff700 1 --2- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd514143430 0x7fd514156770 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7fd50c0032f0 tx=0x7fd50c007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:06.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd513fff700 1 --2- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd514143430 0x7fd514156770 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fd50c0032f0 tx=0x7fd50c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.267+0000 7fd510ff9700 1 -- 172.21.15.63:0/3357525755 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd50c010540 con 0x7fd514143430 2020-05-18T21:27:06.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.271+0000 7fd513fff700 1 --2- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd514143430 0x7fd514156770 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fd50c0032f0 tx=0x7fd50c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.271+0000 7fd513fff700 1 --2- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd514143430 0x7fd514156770 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fd50c0032f0 tx=0x7fd50c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.271+0000 7fd510ff9700 1 -- 172.21.15.63:0/3357525755 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c00ae20 con 0x7fd514143430 2020-05-18T21:27:06.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.271+0000 7fd519bb8700 1 -- 172.21.15.63:0/3357525755 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5140b2f10 con 0x7fd514143430 2020-05-18T21:27:06.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.271+0000 7fd510ff9700 1 -- 172.21.15.63:0/3357525755 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd50c005e60 con 0x7fd514143430 2020-05-18T21:27:06.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.271+0000 7fd519bb8700 1 -- 172.21.15.63:0/3357525755 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5141481a0 con 0x7fd514143430 2020-05-18T21:27:06.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.271+0000 7fd513fff700 1 --2- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd514143430 0x7fd514156770 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fd50c0032f0 tx=0x7fd50c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.271+0000 7fd519bb8700 1 -- 172.21.15.63:0/3357525755 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd514157510 con 0x7fd514143430 2020-05-18T21:27:06.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.271+0000 7fd513fff700 1 --2- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd514143430 0x7fd514156770 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fd50c0032f0 tx=0x7fd50c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.271+0000 7fd510ff9700 1 -- 172.21.15.63:0/3357525755 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd50c008460 con 0x7fd514143430 2020-05-18T21:27:06.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.271+0000 7fd510ff9700 1 --2- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4f804f990 0x7fd4f8051e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:06.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.271+0000 7fd510ff9700 1 -- 172.21.15.63:0/3357525755 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd50c064620 con 0x7fd514143430 2020-05-18T21:27:06.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.271+0000 7fd5137fe700 1 --2- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4f804f990 0x7fd4f8051e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:06.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.271+0000 7fd5137fe700 1 --2- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4f804f990 0x7fd4f8051e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd504002f70 tx=0x7fd50400ebe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.271+0000 7fd5137fe700 1 --2- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4f804f990 0x7fd4f8051e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd504002f70 tx=0x7fd50400ebe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.271+0000 7fd5137fe700 1 --2- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4f804f990 0x7fd4f8051e50 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7fd504002f70 tx=0x7fd50400ebe0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:06.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.279+0000 7fd513fff700 1 --2- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd514143430 0x7fd514156770 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fd50c0032f0 tx=0x7fd50c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.279+0000 7fd510ff9700 1 -- 172.21.15.63:0/3357525755 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd50c03e9d0 con 0x7fd514143430 2020-05-18T21:27:06.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.399+0000 7fd519bb8700 1 -- 172.21.15.63:0/3357525755 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd5140569e0 con 0x7fd514143430 2020-05-18T21:27:06.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.403+0000 7fd513fff700 1 --2- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd514143430 0x7fd514156770 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fd50c0032f0 tx=0x7fd50c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.403+0000 7fd510ff9700 1 -- 172.21.15.63:0/3357525755 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd50c041ff0 con 0x7fd514143430 2020-05-18T21:27:06.405 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:06.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.403+0000 7fd519bb8700 1 -- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4f804f990 msgr2=0x7fd4f8051e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.403+0000 7fd519bb8700 1 --2- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4f804f990 0x7fd4f8051e50 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7fd504002f70 tx=0x7fd50400ebe0).stop 2020-05-18T21:27:06.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.403+0000 7fd519bb8700 1 -- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd514143430 msgr2=0x7fd514156770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.403+0000 7fd519bb8700 1 --2- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd514143430 0x7fd514156770 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7fd50c0032f0 tx=0x7fd50c007e00).stop 2020-05-18T21:27:06.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.403+0000 7fd519bb8700 1 -- 172.21.15.63:0/3357525755 shutdown_connections 2020-05-18T21:27:06.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.403+0000 7fd519bb8700 1 --2- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4f804f990 0x7fd4f8051e50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:06.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.403+0000 7fd519bb8700 1 --2- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd514143430 0x7fd514156770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:06.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.403+0000 7fd519bb8700 1 --2- 172.21.15.63:0/3357525755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5140b6d70 0x7fd514141370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:06.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.403+0000 7fd519bb8700 1 -- 172.21.15.63:0/3357525755 >> 172.21.15.63:0/3357525755 conn(0x7fd514069b70 msgr2=0x7fd514060c10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:06.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.403+0000 7fd519bb8700 1 -- 172.21.15.63:0/3357525755 shutdown_connections 2020-05-18T21:27:06.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.403+0000 7fd519bb8700 1 -- 172.21.15.63:0/3357525755 wait complete. 2020-05-18T21:27:06.418 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:27:06.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.527+0000 7fb50c59f700 1 Processor -- start 2020-05-18T21:27:06.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.527+0000 7fb50c59f700 1 -- start start 2020-05-18T21:27:06.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.527+0000 7fb50c59f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb504146ac0 0x7fb50406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:06.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.527+0000 7fb50c59f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504143100 0x7fb504143570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:06.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.527+0000 7fb50c59f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb504146fa0 con 0x7fb5040b9540 2020-05-18T21:27:06.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.527+0000 7fb50c59f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5040b59c0 con 0x7fb504146ac0 2020-05-18T21:27:06.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.527+0000 7fb50c59f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5040b5c60 con 0x7fb504143100 2020-05-18T21:27:06.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.527+0000 7fb509b3a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb504146ac0 0x7fb50406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:06.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.527+0000 7fb509b3a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb504146ac0 0x7fb50406a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53318/0 (socket says 172.21.15.63:53318) 2020-05-18T21:27:06.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.527+0000 7fb509b3a700 1 -- 172.21.15.63:0/2132426698 learned_addr learned my addr 172.21.15.63:0/2132426698 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:06.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.527+0000 7fb50ab3c700 1 --2- 172.21.15.63:0/2132426698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504143100 0x7fb504143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:06.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.527+0000 7fb509b3a700 1 -- 172.21.15.63:0/2132426698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504143100 msgr2=0x7fb504143570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:06.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.527+0000 7fb509b3a700 1 --2- 172.21.15.63:0/2132426698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504143100 0x7fb504143570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:06.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.527+0000 7fb509b3a700 1 -- 172.21.15.63:0/2132426698 >> v1:172.21.15.155:6789/0 conn(0x7fb5040b9540 legacy=0x7fb5040b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.527+0000 7fb509b3a700 1 -- 172.21.15.63:0/2132426698 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5040b6810 con 0x7fb504146ac0 2020-05-18T21:27:06.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.527+0000 7fb509b3a700 1 --2- 172.21.15.63:0/2132426698 >> v2:172.21.15.63:3300/0 conn(0x7fb504146ac0 0x7fb50406a280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb500002f70 tx=0x7fb500007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.527+0000 7fb509b3a700 1 --2- 172.21.15.63:0/2132426698 >> v2:172.21.15.63:3300/0 conn(0x7fb504146ac0 0x7fb50406a280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb500002f70 tx=0x7fb500007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.527+0000 7fb509b3a700 1 --2- 172.21.15.63:0/2132426698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb504146ac0 0x7fb50406a280 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7fb500002f70 tx=0x7fb500007a80).ready entity=mon.0 client_cookie=32c428368d483aa0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:06.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb509b3a700 1 --2- 172.21.15.63:0/2132426698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb504146ac0 0x7fb50406a280 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7fb500002f70 tx=0x7fb500007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb509b3a700 1 --2- 172.21.15.63:0/2132426698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb504146ac0 0x7fb50406a280 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7fb500002f70 tx=0x7fb500007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb509339700 1 -- 172.21.15.63:0/2132426698 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5000116b0 con 0x7fb504146ac0 2020-05-18T21:27:06.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb509b3a700 1 --2- 172.21.15.63:0/2132426698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb504146ac0 0x7fb50406a280 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7fb500002f70 tx=0x7fb500007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb509339700 1 -- 172.21.15.63:0/2132426698 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb500011810 con 0x7fb504146ac0 2020-05-18T21:27:06.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb509339700 1 -- 172.21.15.63:0/2132426698 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb500011c30 con 0x7fb504146ac0 2020-05-18T21:27:06.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb50c59f700 1 -- 172.21.15.63:0/2132426698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb504146ac0 msgr2=0x7fb50406a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb50c59f700 1 --2- 172.21.15.63:0/2132426698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb504146ac0 0x7fb50406a280 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7fb500002f70 tx=0x7fb500007a80).stop 2020-05-18T21:27:06.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb50c59f700 1 -- 172.21.15.63:0/2132426698 shutdown_connections 2020-05-18T21:27:06.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb50c59f700 1 --2- 172.21.15.63:0/2132426698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504143100 0x7fb504143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:06.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb50c59f700 1 --2- 172.21.15.63:0/2132426698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb504146ac0 0x7fb50406a280 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:06.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb50c59f700 1 -- 172.21.15.63:0/2132426698 >> 172.21.15.63:0/2132426698 conn(0x7fb50405f2e0 msgr2=0x7fb504069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:06.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb50c59f700 1 -- 172.21.15.63:0/2132426698 shutdown_connections 2020-05-18T21:27:06.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb50c59f700 1 -- 172.21.15.63:0/2132426698 wait complete. 2020-05-18T21:27:06.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb50c59f700 1 Processor -- start 2020-05-18T21:27:06.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb50c59f700 1 -- start start 2020-05-18T21:27:06.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb50c59f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504146ac0 0x7fb504153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:06.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb50c59f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5041542a0 con 0x7fb5040b9540 2020-05-18T21:27:06.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb50c59f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb504153460 con 0x7fb504143100 2020-05-18T21:27:06.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb50c59f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb504153700 con 0x7fb504146ac0 2020-05-18T21:27:06.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb50a33b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb5040b9540 0x7fb504149a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55512/0 (socket says 172.21.15.63:55512) 2020-05-18T21:27:06.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb50a33b700 1 -- 172.21.15.63:0/3529448645 learned_addr learned my addr 172.21.15.63:0/3529448645 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:06.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb50ab3c700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504146ac0 0x7fb504153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:06.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb4f37fe700 1 -- 172.21.15.63:0/3529448645 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488420272 0 0) 0x7fb5041542a0 con 0x7fb5040b9540 2020-05-18T21:27:06.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb4f37fe700 1 -- 172.21.15.63:0/3529448645 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4e4002fe0 con 0x7fb5040b9540 2020-05-18T21:27:06.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb4f37fe700 1 -- 172.21.15.63:0/3529448645 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227035348 0 0) 0x7fb504153460 con 0x7fb504143100 2020-05-18T21:27:06.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.531+0000 7fb4f37fe700 1 -- 172.21.15.63:0/3529448645 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5041542a0 con 0x7fb504143100 2020-05-18T21:27:06.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb4f37fe700 1 -- 172.21.15.63:0/3529448645 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1643265462 0 0) 0x7fb4e4002fe0 con 0x7fb5040b9540 2020-05-18T21:27:06.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb4f37fe700 1 -- 172.21.15.63:0/3529448645 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb504153460 con 0x7fb5040b9540 2020-05-18T21:27:06.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb4f37fe700 1 -- 172.21.15.63:0/3529448645 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fb4f4001970 con 0x7fb5040b9540 2020-05-18T21:27:06.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb50ab3c700 1 -- 172.21.15.63:0/3529448645 >> v1:172.21.15.155:6789/0 conn(0x7fb504143100 legacy=0x7fb5040ba6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb50ab3c700 1 -- 172.21.15.63:0/3529448645 >> v1:172.21.15.63:6789/0 conn(0x7fb5040b9540 legacy=0x7fb504149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb50ab3c700 1 -- 172.21.15.63:0/3529448645 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5041539a0 con 0x7fb504146ac0 2020-05-18T21:27:06.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb50ab3c700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504146ac0 0x7fb504153e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb4fc0032f0 tx=0x7fb4fc010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb50ab3c700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504146ac0 0x7fb504153e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb4fc0032f0 tx=0x7fb4fc010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb50ab3c700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504146ac0 0x7fb504153e40 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fb4fc0032f0 tx=0x7fb4fc010f00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:06.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb50ab3c700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504146ac0 0x7fb504153e40 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fb4fc0032f0 tx=0x7fb4fc010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb4f37fe700 1 -- 172.21.15.63:0/3529448645 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4fc005a80 con 0x7fb504146ac0 2020-05-18T21:27:06.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb50c59f700 1 -- 172.21.15.63:0/3529448645 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5040bade0 con 0x7fb504146ac0 2020-05-18T21:27:06.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb50ab3c700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504146ac0 0x7fb504153e40 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fb4fc0032f0 tx=0x7fb4fc010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb4f37fe700 1 -- 172.21.15.63:0/3529448645 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc005be0 con 0x7fb504146ac0 2020-05-18T21:27:06.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb50ab3c700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504146ac0 0x7fb504153e40 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fb4fc0032f0 tx=0x7fb4fc010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb50c59f700 1 -- 172.21.15.63:0/3529448645 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5040acba0 con 0x7fb504146ac0 2020-05-18T21:27:06.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb4f37fe700 1 -- 172.21.15.63:0/3529448645 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4fc00c730 con 0x7fb504146ac0 2020-05-18T21:27:06.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb50ab3c700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504146ac0 0x7fb504153e40 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fb4fc0032f0 tx=0x7fb4fc010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb50ab3c700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504146ac0 0x7fb504153e40 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fb4fc0032f0 tx=0x7fb4fc010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb4f37fe700 1 -- 172.21.15.63:0/3529448645 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb4fc00c930 con 0x7fb504146ac0 2020-05-18T21:27:06.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb50c59f700 1 -- 172.21.15.63:0/3529448645 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5040569e0 con 0x7fb504146ac0 2020-05-18T21:27:06.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb4f37fe700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4e4050160 0x7fb4e4052620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:06.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.535+0000 7fb4f37fe700 1 -- 172.21.15.63:0/3529448645 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb4fc063810 con 0x7fb504146ac0 2020-05-18T21:27:06.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.539+0000 7fb50a33b700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4e4050160 0x7fb4e4052620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:06.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.539+0000 7fb50a33b700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4e4050160 0x7fb4e4052620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb4f4001740 tx=0x7fb4f4009550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.539+0000 7fb50a33b700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4e4050160 0x7fb4e4052620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb4f4001740 tx=0x7fb4f4009550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.539+0000 7fb50a33b700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4e4050160 0x7fb4e4052620 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7fb4f4001740 tx=0x7fb4f4009550).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:06.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.547+0000 7fb50ab3c700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504146ac0 0x7fb504153e40 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fb4fc0032f0 tx=0x7fb4fc010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.547+0000 7fb4f37fe700 1 -- 172.21.15.63:0/3529448645 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb4fc03db00 con 0x7fb504146ac0 2020-05-18T21:27:06.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.667+0000 7fb50c59f700 1 -- 172.21.15.63:0/3529448645 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb5040008d0 con 0x7fb504146ac0 2020-05-18T21:27:06.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.667+0000 7fb50ab3c700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504146ac0 0x7fb504153e40 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fb4fc0032f0 tx=0x7fb4fc010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.667+0000 7fb4f37fe700 1 -- 172.21.15.63:0/3529448645 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb4fc041120 con 0x7fb504146ac0 2020-05-18T21:27:06.671 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:06.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.671+0000 7fb50c59f700 1 -- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4e4050160 msgr2=0x7fb4e4052620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.671+0000 7fb50c59f700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4e4050160 0x7fb4e4052620 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7fb4f4001740 tx=0x7fb4f4009550).stop 2020-05-18T21:27:06.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.671+0000 7fb50c59f700 1 -- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504146ac0 msgr2=0x7fb504153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.671+0000 7fb50c59f700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504146ac0 0x7fb504153e40 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fb4fc0032f0 tx=0x7fb4fc010f00).stop 2020-05-18T21:27:06.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.671+0000 7fb50c59f700 1 -- 172.21.15.63:0/3529448645 shutdown_connections 2020-05-18T21:27:06.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.671+0000 7fb50c59f700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4e4050160 0x7fb4e4052620 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:06.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.671+0000 7fb50c59f700 1 --2- 172.21.15.63:0/3529448645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb504146ac0 0x7fb504153e40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:06.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.671+0000 7fb50c59f700 1 -- 172.21.15.63:0/3529448645 >> 172.21.15.63:0/3529448645 conn(0x7fb50405f2e0 msgr2=0x7fb5040b9920 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:06.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.671+0000 7fb50c59f700 1 -- 172.21.15.63:0/3529448645 shutdown_connections 2020-05-18T21:27:06.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.671+0000 7fb50c59f700 1 -- 172.21.15.63:0/3529448645 wait complete. 2020-05-18T21:27:06.686 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:27:06.687 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:27:06.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b10e1700 1 Processor -- start 2020-05-18T21:27:06.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b10e1700 1 -- start start 2020-05-18T21:27:06.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b10e1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1ac0b93f0 0x7fe1ac145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:06.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b10e1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe1ac0b7ca0 0x7fe1ac142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:06.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b10e1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe1ac1432f0 0x7fe1ac060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:06.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b10e1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ac0b7020 con 0x7fe1ac1432f0 2020-05-18T21:27:06.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b10e1700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ac0b72c0 con 0x7fe1ac0b7ca0 2020-05-18T21:27:06.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b10e1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0b7560 con 0x7fe1ac0b93f0 2020-05-18T21:27:06.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b08e0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe1ac1432f0 0x7fe1ac060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:06.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b08e0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe1ac1432f0 0x7fe1ac060430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53334/0 (socket says 172.21.15.63:53334) 2020-05-18T21:27:06.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b08e0700 1 -- 172.21.15.63:0/1024269145 learned_addr learned my addr 172.21.15.63:0/1024269145 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:06.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1ab7fe700 1 --2- 172.21.15.63:0/1024269145 >> v2:172.21.15.155:3300/0 conn(0x7fe1ac0b7ca0 0x7fe1ac142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:06.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1abfff700 1 --2- 172.21.15.63:0/1024269145 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1ac0b93f0 0x7fe1ac145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:06.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b08e0700 1 -- 172.21.15.63:0/1024269145 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1ac0b93f0 msgr2=0x7fe1ac145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:06.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b08e0700 1 --2- 172.21.15.63:0/1024269145 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1ac0b93f0 0x7fe1ac145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:06.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b08e0700 1 -- 172.21.15.63:0/1024269145 >> v2:172.21.15.155:3300/0 conn(0x7fe1ac0b7ca0 msgr2=0x7fe1ac142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:06.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b08e0700 1 --2- 172.21.15.63:0/1024269145 >> v2:172.21.15.155:3300/0 conn(0x7fe1ac0b7ca0 0x7fe1ac142e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:06.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b08e0700 1 -- 172.21.15.63:0/1024269145 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac0b7800 con 0x7fe1ac1432f0 2020-05-18T21:27:06.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b08e0700 1 --2- 172.21.15.63:0/1024269145 >> v2:172.21.15.63:3300/0 conn(0x7fe1ac1432f0 0x7fe1ac060430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe1ac0619f0 tx=0x7fe1a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b08e0700 1 --2- 172.21.15.63:0/1024269145 >> v2:172.21.15.63:3300/0 conn(0x7fe1ac1432f0 0x7fe1ac060430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe1ac0619f0 tx=0x7fe1a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b08e0700 1 --2- 172.21.15.63:0/1024269145 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac1432f0 0x7fe1ac060430 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7fe1ac0619f0 tx=0x7fe1a4007e00).ready entity=mon.0 client_cookie=fc9efe0e623216 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:06.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b08e0700 1 --2- 172.21.15.63:0/1024269145 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac1432f0 0x7fe1ac060430 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fe1ac0619f0 tx=0x7fe1a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1aaffd700 1 -- 172.21.15.63:0/1024269145 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1a4011c20 con 0x7fe1ac1432f0 2020-05-18T21:27:06.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b08e0700 1 --2- 172.21.15.63:0/1024269145 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac1432f0 0x7fe1ac060430 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fe1ac0619f0 tx=0x7fe1a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1aaffd700 1 -- 172.21.15.63:0/1024269145 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a4011d80 con 0x7fe1ac1432f0 2020-05-18T21:27:06.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b08e0700 1 --2- 172.21.15.63:0/1024269145 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac1432f0 0x7fe1ac060430 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fe1ac0619f0 tx=0x7fe1a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1aaffd700 1 -- 172.21.15.63:0/1024269145 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1a400a370 con 0x7fe1ac1432f0 2020-05-18T21:27:06.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b10e1700 1 -- 172.21.15.63:0/1024269145 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac1432f0 msgr2=0x7fe1ac060430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.787+0000 7fe1b10e1700 1 --2- 172.21.15.63:0/1024269145 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac1432f0 0x7fe1ac060430 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7fe1ac0619f0 tx=0x7fe1a4007e00).stop 2020-05-18T21:27:06.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.791+0000 7fe1b10e1700 1 -- 172.21.15.63:0/1024269145 shutdown_connections 2020-05-18T21:27:06.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.791+0000 7fe1b10e1700 1 --2- 172.21.15.63:0/1024269145 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac1432f0 0x7fe1ac060430 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:06.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.791+0000 7fe1b10e1700 1 --2- 172.21.15.63:0/1024269145 >> v2:172.21.15.155:3300/0 conn(0x7fe1ac0b7ca0 0x7fe1ac142e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:06.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.791+0000 7fe1b10e1700 1 --2- 172.21.15.63:0/1024269145 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1ac0b93f0 0x7fe1ac145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:06.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.791+0000 7fe1b10e1700 1 -- 172.21.15.63:0/1024269145 >> 172.21.15.63:0/1024269145 conn(0x7fe1ac069b70 msgr2=0x7fe1ac069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:06.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.791+0000 7fe1b10e1700 1 -- 172.21.15.63:0/1024269145 shutdown_connections 2020-05-18T21:27:06.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.791+0000 7fe1b10e1700 1 -- 172.21.15.63:0/1024269145 wait complete. 2020-05-18T21:27:06.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.791+0000 7fe1b10e1700 1 Processor -- start 2020-05-18T21:27:06.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.791+0000 7fe1b10e1700 1 -- start start 2020-05-18T21:27:06.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1b10e1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe1ac0b7ca0 0x7fe1ac144af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:06.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1b10e1700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac1414c0 con 0x7fe1ac0b93f0 2020-05-18T21:27:06.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1b10e1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac144f50 con 0x7fe1ac1432f0 2020-05-18T21:27:06.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1b10e1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ac143880 con 0x7fe1ac0b7ca0 2020-05-18T21:27:06.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1abfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe1ac0b7ca0 0x7fe1ac144af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:06.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1ab7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe1ac0b93f0 0x7fe1ac140db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55528/0 (socket says 172.21.15.63:55528) 2020-05-18T21:27:06.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1ab7fe700 1 -- 172.21.15.63:0/3888975992 learned_addr learned my addr 172.21.15.63:0/3888975992 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:06.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1abfff700 1 -- 172.21.15.63:0/3888975992 >> v1:172.21.15.155:6789/0 conn(0x7fe1ac1432f0 legacy=0x7fe1ac13e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1abfff700 1 -- 172.21.15.63:0/3888975992 >> v1:172.21.15.63:6789/0 conn(0x7fe1ac0b93f0 legacy=0x7fe1ac140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1abfff700 1 -- 172.21.15.63:0/3888975992 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac143b20 con 0x7fe1ac0b7ca0 2020-05-18T21:27:06.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1abfff700 1 --2- 172.21.15.63:0/3888975992 >> v2:172.21.15.63:3300/0 conn(0x7fe1ac0b7ca0 0x7fe1ac144af0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe19c002f70 tx=0x7fe19c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1abfff700 1 --2- 172.21.15.63:0/3888975992 >> v2:172.21.15.63:3300/0 conn(0x7fe1ac0b7ca0 0x7fe1ac144af0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe19c002f70 tx=0x7fe19c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1abfff700 1 --2- 172.21.15.63:0/3888975992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0b7ca0 0x7fe1ac144af0 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7fe19c002f70 tx=0x7fe19c010c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:06.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1abfff700 1 --2- 172.21.15.63:0/3888975992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0b7ca0 0x7fe1ac144af0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fe19c002f70 tx=0x7fe19c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1abfff700 1 --2- 172.21.15.63:0/3888975992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0b7ca0 0x7fe1ac144af0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fe19c002f70 tx=0x7fe19c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1a97fa700 1 -- 172.21.15.63:0/3888975992 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe19c007550 con 0x7fe1ac0b7ca0 2020-05-18T21:27:06.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1abfff700 1 --2- 172.21.15.63:0/3888975992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0b7ca0 0x7fe1ac144af0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fe19c002f70 tx=0x7fe19c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1a97fa700 1 -- 172.21.15.63:0/3888975992 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19c005700 con 0x7fe1ac0b7ca0 2020-05-18T21:27:06.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1b10e1700 1 -- 172.21.15.63:0/3888975992 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac13e750 con 0x7fe1ac0b7ca0 2020-05-18T21:27:06.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1a97fa700 1 -- 172.21.15.63:0/3888975992 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe19c005ae0 con 0x7fe1ac0b7ca0 2020-05-18T21:27:06.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1b10e1700 1 -- 172.21.15.63:0/3888975992 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac143fc0 con 0x7fe1ac0b7ca0 2020-05-18T21:27:06.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1abfff700 1 --2- 172.21.15.63:0/3888975992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0b7ca0 0x7fe1ac144af0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fe19c002f70 tx=0x7fe19c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1b10e1700 1 -- 172.21.15.63:0/3888975992 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac143cb0 con 0x7fe1ac0b7ca0 2020-05-18T21:27:06.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1a97fa700 1 -- 172.21.15.63:0/3888975992 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe19c005d50 con 0x7fe1ac0b7ca0 2020-05-18T21:27:06.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.795+0000 7fe1abfff700 1 --2- 172.21.15.63:0/3888975992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0b7ca0 0x7fe1ac144af0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fe19c002f70 tx=0x7fe19c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.799+0000 7fe1a97fa700 1 --2- 172.21.15.63:0/3888975992 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe19004f990 0x7fe190051e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:06.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.799+0000 7fe1a97fa700 1 -- 172.21.15.63:0/3888975992 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe19c063fe0 con 0x7fe1ac0b7ca0 2020-05-18T21:27:06.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.799+0000 7fe1ab7fe700 1 --2- 172.21.15.63:0/3888975992 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe19004f990 0x7fe190051e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:06.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.799+0000 7fe1ab7fe700 1 --2- 172.21.15.63:0/3888975992 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe19004f990 0x7fe190051e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe1ac0b5640 tx=0x7fe19400c860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.799+0000 7fe1ab7fe700 1 --2- 172.21.15.63:0/3888975992 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe19004f990 0x7fe190051e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe1ac0b5640 tx=0x7fe19400c860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.799+0000 7fe1ab7fe700 1 --2- 172.21.15.63:0/3888975992 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe19004f990 0x7fe190051e50 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fe1ac0b5640 tx=0x7fe19400c860).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:06.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.803+0000 7fe1abfff700 1 --2- 172.21.15.63:0/3888975992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0b7ca0 0x7fe1ac144af0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fe19c002f70 tx=0x7fe19c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.803+0000 7fe1a97fa700 1 -- 172.21.15.63:0/3888975992 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe19c03e310 con 0x7fe1ac0b7ca0 2020-05-18T21:27:06.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.951+0000 7fe1b10e1700 1 -- 172.21.15.63:0/3888975992 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1ac0569e0 con 0x7fe1ac0b7ca0 2020-05-18T21:27:06.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.955+0000 7fe1abfff700 1 --2- 172.21.15.63:0/3888975992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0b7ca0 0x7fe1ac144af0 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fe19c002f70 tx=0x7fe19c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:06.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.955+0000 7fe1a97fa700 1 -- 172.21.15.63:0/3888975992 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2137 (secure 0 0 0) 0x7fe19c041930 con 0x7fe1ac0b7ca0 2020-05-18T21:27:06.958 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:06.958 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4404,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2550679674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2550679674},{"type":"v1","addr":"172.21.15.155:6835","nonce":2550679674}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":7}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:26:45.491730+0000","modified":"2020-05-18T21:26:49.514812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4369},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4369":{"gid":4369,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.63:6833/2283817704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2283817704},{"type":"v1","addr":"172.21.15.63:6833","nonce":2283817704}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-05-18T21:27:06.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.955+0000 7fe1b10e1700 1 -- 172.21.15.63:0/3888975992 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe19004f990 msgr2=0x7fe190051e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.955+0000 7fe1b10e1700 1 --2- 172.21.15.63:0/3888975992 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe19004f990 0x7fe190051e50 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fe1ac0b5640 tx=0x7fe19400c860).stop 2020-05-18T21:27:06.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.955+0000 7fe1b10e1700 1 -- 172.21.15.63:0/3888975992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0b7ca0 msgr2=0x7fe1ac144af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:06.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.955+0000 7fe1b10e1700 1 --2- 172.21.15.63:0/3888975992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0b7ca0 0x7fe1ac144af0 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7fe19c002f70 tx=0x7fe19c010c30).stop 2020-05-18T21:27:06.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.955+0000 7fe1b10e1700 1 -- 172.21.15.63:0/3888975992 shutdown_connections 2020-05-18T21:27:06.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.955+0000 7fe1b10e1700 1 --2- 172.21.15.63:0/3888975992 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe19004f990 0x7fe190051e50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:06.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.955+0000 7fe1b10e1700 1 --2- 172.21.15.63:0/3888975992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0b7ca0 0x7fe1ac144af0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:06.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.955+0000 7fe1b10e1700 1 -- 172.21.15.63:0/3888975992 >> 172.21.15.63:0/3888975992 conn(0x7fe1ac069b70 msgr2=0x7fe1ac05c280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:06.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.955+0000 7fe1b10e1700 1 -- 172.21.15.63:0/3888975992 shutdown_connections 2020-05-18T21:27:06.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:06.955+0000 7fe1b10e1700 1 -- 172.21.15.63:0/3888975992 wait complete. 2020-05-18T21:27:06.963 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 7 2020-05-18T21:27:07.171 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:26:45.491730+0000', 'modified': '2020-05-18T21:26:49.514812+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4369}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4369': {'gid': 4369, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.63:6833/2283817704', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 2283817704}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 2283817704}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:27:07.172 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:27:07.172 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:27:07.278 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:27:07.279 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:27:07.279 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:27:07.279 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4369, 2020-05-18T21:27:07.279 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:27:07.280 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:27:07.280 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 18.757784486999999, 2020-05-18T21:27:07.280 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 6, 2020-05-18T21:27:07.280 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 23, 2020-05-18T21:27:07.280 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 23, 2020-05-18T21:27:07.281 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 19.452261699000001 2020-05-18T21:27:07.281 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:27:07.288 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 4369, "want_state": "up:active", "state": "up:active", "rank_uptime": 18.757784486999999, "mdsmap_epoch": 6, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "uptime": 19.452261699000001 } 2020-05-18T21:27:07.288 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:27:07.289 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2020-05-18T21:27:07.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.290 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:27:07.298 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:27:07.298 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:07.298 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:27:07.299 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:07.299 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:27:07.299 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:07.299 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:07.300 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:07.300 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:07.300 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:07.300 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:07.300 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:07.301 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:27:07.301 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:07.301 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:27:07.301 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42820sec preferred_lft 42820sec 2020-05-18T21:27:07.301 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:27:07.302 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:07.302 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:27:07.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.303 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:27:07.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.368 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:27:07.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.382 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:27:07.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.395 INFO:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:27:07.452 INFO:teuthology.orchestra.run.smithi155.stdout:1 2020-05-18T21:27:07.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.455 INFO:teuthology.orchestra.run.smithi155:> route 2020-05-18T21:27:07.486 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2020-05-18T21:27:07.486 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:27:07.486 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:27:07.486 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:27:07.487 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:27:07.487 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:27:07.487 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:27:07.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.488 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:27:07.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.542 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:27:07.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.561 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:27:07.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.624 INFO:teuthology.orchestra.run.smithi155:> ip netns list 2020-05-18T21:27:07.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.631 INFO:teuthology.orchestra.run.smithi155:> ip netns list-id 2020-05-18T21:27:07.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.639 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2' 2020-05-18T21:27:07.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.703 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 0' 2020-05-18T21:27:07.716 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.1/16 2020-05-18T21:27:07.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.717 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.0' 2020-05-18T21:27:07.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.742 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:27:07.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.809 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up' 2020-05-18T21:27:07.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.830 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up' 2020-05-18T21:27:07.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.847 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254' 2020-05-18T21:27:07.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.910 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip link set brx.0 up' 2020-05-18T21:27:07.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:07.925 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip link set dev brx.0 master ceph-brx' 2020-05-18T21:27:07.938 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2020-05-18T21:27:07.939 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.2 at ubuntu@smithi155.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2... 2020-05-18T21:27:07.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:07.939 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:27:07.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:07.989 INFO:teuthology.orchestra.run.smithi155:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:27:08.004 INFO:teuthology.orchestra.run.smithi155.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:27:08.005 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:27:08.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:08.006 INFO:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2020-05-18T21:27:08.011 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:27:08.011 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.2 /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:27:08.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:08.056 INFO:teuthology.orchestra.run.smithi155:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:27:08.072 INFO:teuthology.orchestra.run.smithi155.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:27:08.073 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:27:08.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:08.074 INFO:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2020-05-18T21:27:08.165 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi155.stderr:2020-05-18T21:27:08.161+0000 7f52542e3080 -1 init, newargv = 0x55d0e6ec7530 newargc=9ceph-fuse[ 2020-05-18T21:27:08.165 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi155.stderr:13743]: starting ceph client 2020-05-18T21:27:08.175 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi155.stderr:ceph-fuse[13743]: starting fuse 2020-05-18T21:27:09.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:09.181 INFO:teuthology.orchestra.run.smithi155:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:27:09.197 INFO:teuthology.orchestra.run.smithi155.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:27:09.198 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:27:09.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:09.199 INFO:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2020-05-18T21:27:09.248 INFO:teuthology.orchestra.run.smithi155.stdout:50 2020-05-18T21:27:09.249 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:27:09.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:09.249 INFO:teuthology.orchestra.run.smithi155:> sudo python3 -c ' 2020-05-18T21:27:09.250 INFO:teuthology.orchestra.run.smithi155:> import glob 2020-05-18T21:27:09.250 INFO:teuthology.orchestra.run.smithi155:> import re 2020-05-18T21:27:09.251 INFO:teuthology.orchestra.run.smithi155:> import os 2020-05-18T21:27:09.251 INFO:teuthology.orchestra.run.smithi155:> import subprocess 2020-05-18T21:27:09.251 INFO:teuthology.orchestra.run.smithi155:> 2020-05-18T21:27:09.252 INFO:teuthology.orchestra.run.smithi155:> def find_socket(client_name): 2020-05-18T21:27:09.252 INFO:teuthology.orchestra.run.smithi155:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2020-05-18T21:27:09.252 INFO:teuthology.orchestra.run.smithi155:> files = glob.glob(asok_path) 2020-05-18T21:27:09.253 INFO:teuthology.orchestra.run.smithi155:> 2020-05-18T21:27:09.253 INFO:teuthology.orchestra.run.smithi155:> # Given a non-glob path, it better be there 2020-05-18T21:27:09.253 INFO:teuthology.orchestra.run.smithi155:> if "*" not in asok_path: 2020-05-18T21:27:09.254 INFO:teuthology.orchestra.run.smithi155:> assert(len(files) == 1) 2020-05-18T21:27:09.254 INFO:teuthology.orchestra.run.smithi155:> return files[0] 2020-05-18T21:27:09.254 INFO:teuthology.orchestra.run.smithi155:> 2020-05-18T21:27:09.255 INFO:teuthology.orchestra.run.smithi155:> for f in files: 2020-05-18T21:27:09.255 INFO:teuthology.orchestra.run.smithi155:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:27:09.255 INFO:teuthology.orchestra.run.smithi155:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:27:09.256 INFO:teuthology.orchestra.run.smithi155:> return f 2020-05-18T21:27:09.256 INFO:teuthology.orchestra.run.smithi155:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:27:09.256 INFO:teuthology.orchestra.run.smithi155:> 2020-05-18T21:27:09.257 INFO:teuthology.orchestra.run.smithi155:> print(find_socket("client.2")) 2020-05-18T21:27:09.257 INFO:teuthology.orchestra.run.smithi155:> ' 2020-05-18T21:27:09.300 INFO:teuthology.orchestra.run.smithi155.stdout:/var/run/ceph/ceph-client.2.13743.asok 2020-05-18T21:27:09.304 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.13743.asok 2020-05-18T21:27:09.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:09.305 INFO:teuthology.orchestra.run.smithi155:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.13743.asok status 2020-05-18T21:27:09.389 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:27:09.389 INFO:teuthology.orchestra.run.smithi155.stdout: "metadata": { 2020-05-18T21:27:09.389 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:27:09.390 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:27:09.390 INFO:teuthology.orchestra.run.smithi155.stdout: "entity_id": "2", 2020-05-18T21:27:09.390 INFO:teuthology.orchestra.run.smithi155.stdout: "hostname": "smithi155", 2020-05-18T21:27:09.390 INFO:teuthology.orchestra.run.smithi155.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2020-05-18T21:27:09.390 INFO:teuthology.orchestra.run.smithi155.stdout: "pid": "13743", 2020-05-18T21:27:09.391 INFO:teuthology.orchestra.run.smithi155.stdout: "root": "/" 2020-05-18T21:27:09.391 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:27:09.391 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_count": 0, 2020-05-18T21:27:09.391 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_pinned_count": 0, 2020-05-18T21:27:09.391 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 4792, 2020-05-18T21:27:09.392 INFO:teuthology.orchestra.run.smithi155.stdout: "inst": { 2020-05-18T21:27:09.392 INFO:teuthology.orchestra.run.smithi155.stdout: "name": { 2020-05-18T21:27:09.392 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "client", 2020-05-18T21:27:09.392 INFO:teuthology.orchestra.run.smithi155.stdout: "num": 4792 2020-05-18T21:27:09.392 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:27:09.393 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2020-05-18T21:27:09.393 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2020-05-18T21:27:09.393 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:27:09.393 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 2994206604 2020-05-18T21:27:09.393 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:27:09.394 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:27:09.394 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2020-05-18T21:27:09.394 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2020-05-18T21:27:09.394 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:27:09.394 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 2994206604 2020-05-18T21:27:09.395 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:27:09.395 INFO:teuthology.orchestra.run.smithi155.stdout: "inst_str": "client.4792 192.168.0.1:0/2994206604", 2020-05-18T21:27:09.395 INFO:teuthology.orchestra.run.smithi155.stdout: "addr_str": "192.168.0.1:0/2994206604", 2020-05-18T21:27:09.395 INFO:teuthology.orchestra.run.smithi155.stdout: "inode_count": 1, 2020-05-18T21:27:09.395 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_epoch": 6, 2020-05-18T21:27:09.396 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch": 23, 2020-05-18T21:27:09.396 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:27:09.396 INFO:teuthology.orchestra.run.smithi155.stdout: "blacklisted": false 2020-05-18T21:27:09.396 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:27:09.398 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:27:09.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5b2a3a700 1 Processor -- start 2020-05-18T21:27:09.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5b2a3a700 1 -- start start 2020-05-18T21:27:09.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5b2a3a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5ac145790 0x7fd5ac0b6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:09.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5b2a3a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd5ac145b70 0x7fd5ac0b8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:09.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5b2a3a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5ac0b5910 con 0x7fd5ac0b92f0 2020-05-18T21:27:09.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5b2a3a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ac0b5b40 con 0x7fd5ac145b70 2020-05-18T21:27:09.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5b2a3a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac0b5de0 con 0x7fd5ac145790 2020-05-18T21:27:09.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5ab7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd5ac145b70 0x7fd5ac0b8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:09.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5b0fd7700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd5ac0b92f0 0x7fd5ac0b4580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55536/0 (socket says 172.21.15.63:55536) 2020-05-18T21:27:09.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5b0fd7700 1 -- 172.21.15.63:0/3540201674 learned_addr learned my addr 172.21.15.63:0/3540201674 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:09.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5abfff700 1 --2- 172.21.15.63:0/3540201674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5ac145790 0x7fd5ac0b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:09.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5ab7fe700 1 -- 172.21.15.63:0/3540201674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5ac145790 msgr2=0x7fd5ac0b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:09.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5ab7fe700 1 --2- 172.21.15.63:0/3540201674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5ac145790 0x7fd5ac0b6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:09.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5ab7fe700 1 -- 172.21.15.63:0/3540201674 >> v1:172.21.15.63:6789/0 conn(0x7fd5ac0b92f0 legacy=0x7fd5ac0b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:09.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5ab7fe700 1 -- 172.21.15.63:0/3540201674 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac0b6080 con 0x7fd5ac145b70 2020-05-18T21:27:09.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5aaffd700 1 -- 172.21.15.63:0/3540201674 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987159395 0 0) 0x7fd5ac0b5910 con 0x7fd5ac0b92f0 2020-05-18T21:27:09.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5ab7fe700 1 --2- 172.21.15.63:0/3540201674 >> v2:172.21.15.63:3300/0 conn(0x7fd5ac145b70 0x7fd5ac0b8e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd59c002f70 tx=0x7fd59c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5ab7fe700 1 --2- 172.21.15.63:0/3540201674 >> v2:172.21.15.63:3300/0 conn(0x7fd5ac145b70 0x7fd5ac0b8e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd59c002f70 tx=0x7fd59c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5ab7fe700 1 --2- 172.21.15.63:0/3540201674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5ac145b70 0x7fd5ac0b8e90 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7fd59c002f70 tx=0x7fd59c007a80).ready entity=mon.0 client_cookie=4e0e153e44f23495 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:09.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5ab7fe700 1 --2- 172.21.15.63:0/3540201674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5ac145b70 0x7fd5ac0b8e90 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7fd59c002f70 tx=0x7fd59c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5ab7fe700 1 --2- 172.21.15.63:0/3540201674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5ac145b70 0x7fd5ac0b8e90 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7fd59c002f70 tx=0x7fd59c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5aaffd700 1 -- 172.21.15.63:0/3540201674 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd59c008e80 con 0x7fd5ac145b70 2020-05-18T21:27:09.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5ab7fe700 1 --2- 172.21.15.63:0/3540201674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5ac145b70 0x7fd5ac0b8e90 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7fd59c002f70 tx=0x7fd59c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5aaffd700 1 -- 172.21.15.63:0/3540201674 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c0115f0 con 0x7fd5ac145b70 2020-05-18T21:27:09.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5aaffd700 1 -- 172.21.15.63:0/3540201674 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd59c0119d0 con 0x7fd5ac145b70 2020-05-18T21:27:09.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5b2a3a700 1 -- 172.21.15.63:0/3540201674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5ac145b70 msgr2=0x7fd5ac0b8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:09.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.507+0000 7fd5b2a3a700 1 --2- 172.21.15.63:0/3540201674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5ac145b70 0x7fd5ac0b8e90 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7fd59c002f70 tx=0x7fd59c007a80).stop 2020-05-18T21:27:09.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.511+0000 7fd5b2a3a700 1 -- 172.21.15.63:0/3540201674 shutdown_connections 2020-05-18T21:27:09.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.511+0000 7fd5b2a3a700 1 --2- 172.21.15.63:0/3540201674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5ac145b70 0x7fd5ac0b8e90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:09.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.511+0000 7fd5b2a3a700 1 --2- 172.21.15.63:0/3540201674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5ac145790 0x7fd5ac0b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:09.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.511+0000 7fd5b2a3a700 1 -- 172.21.15.63:0/3540201674 >> 172.21.15.63:0/3540201674 conn(0x7fd5ac069b70 msgr2=0x7fd5ac069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:09.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.511+0000 7fd5b2a3a700 1 -- 172.21.15.63:0/3540201674 shutdown_connections 2020-05-18T21:27:09.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.511+0000 7fd5b2a3a700 1 -- 172.21.15.63:0/3540201674 wait complete. 2020-05-18T21:27:09.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.511+0000 7fd5b2a3a700 1 Processor -- start 2020-05-18T21:27:09.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.511+0000 7fd5b2a3a700 1 -- start start 2020-05-18T21:27:09.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5b2a3a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd5ac145790 0x7fd5ac144b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:09.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5b2a3a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5ac145b70 0x7fd5ac152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:09.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5b2a3a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5ac1540d0 con 0x7fd5ac0b92f0 2020-05-18T21:27:09.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5b2a3a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ac1530e0 con 0x7fd5ac145790 2020-05-18T21:27:09.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5b2a3a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac13b130 con 0x7fd5ac145b70 2020-05-18T21:27:09.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5ab7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd5ac145790 0x7fd5ac144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:09.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5abfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd5ac0b92f0 0x7fd5ac141670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55538/0 (socket says 172.21.15.63:55538) 2020-05-18T21:27:09.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5ab7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd5ac145790 0x7fd5ac144b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53352/0 (socket says 172.21.15.63:53352) 2020-05-18T21:27:09.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5abfff700 1 -- 172.21.15.63:0/4213605080 learned_addr learned my addr 172.21.15.63:0/4213605080 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:09.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5b0fd7700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5ac145b70 0x7fd5ac152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:09.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5ab7fe700 1 -- 172.21.15.63:0/4213605080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5ac145b70 msgr2=0x7fd5ac152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:09.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5ab7fe700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5ac145b70 0x7fd5ac152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:09.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5ab7fe700 1 -- 172.21.15.63:0/4213605080 >> v1:172.21.15.63:6789/0 conn(0x7fd5ac0b92f0 legacy=0x7fd5ac141670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:09.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5a97fa700 1 -- 172.21.15.63:0/4213605080 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246149333 0 0) 0x7fd5ac1540d0 con 0x7fd5ac0b92f0 2020-05-18T21:27:09.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5ab7fe700 1 -- 172.21.15.63:0/4213605080 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac13b3d0 con 0x7fd5ac145790 2020-05-18T21:27:09.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5ab7fe700 1 --2- 172.21.15.63:0/4213605080 >> v2:172.21.15.63:3300/0 conn(0x7fd5ac145790 0x7fd5ac144b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd59c002f70 tx=0x7fd59c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5ab7fe700 1 --2- 172.21.15.63:0/4213605080 >> v2:172.21.15.63:3300/0 conn(0x7fd5ac145790 0x7fd5ac144b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd59c002f70 tx=0x7fd59c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5ab7fe700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5ac145790 0x7fd5ac144b50 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7fd59c002f70 tx=0x7fd59c007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:09.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5ab7fe700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5ac145790 0x7fd5ac144b50 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fd59c002f70 tx=0x7fd59c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5ab7fe700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5ac145790 0x7fd5ac144b50 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fd59c002f70 tx=0x7fd59c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5a97fa700 1 -- 172.21.15.63:0/4213605080 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd59c00f860 con 0x7fd5ac145790 2020-05-18T21:27:09.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5ab7fe700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5ac145790 0x7fd5ac144b50 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fd59c002f70 tx=0x7fd59c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5a97fa700 1 -- 172.21.15.63:0/4213605080 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c011a20 con 0x7fd5ac145790 2020-05-18T21:27:09.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5b2a3a700 1 -- 172.21.15.63:0/4213605080 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5ac1430f0 con 0x7fd5ac145790 2020-05-18T21:27:09.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5a97fa700 1 -- 172.21.15.63:0/4213605080 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd59c007550 con 0x7fd5ac145790 2020-05-18T21:27:09.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5b2a3a700 1 -- 172.21.15.63:0/4213605080 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5ac153bf0 con 0x7fd5ac145790 2020-05-18T21:27:09.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5ab7fe700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5ac145790 0x7fd5ac144b50 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fd59c002f70 tx=0x7fd59c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5b2a3a700 1 -- 172.21.15.63:0/4213605080 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ac13b560 con 0x7fd5ac145790 2020-05-18T21:27:09.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5a97fa700 1 -- 172.21.15.63:0/4213605080 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd59c005700 con 0x7fd5ac145790 2020-05-18T21:27:09.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.515+0000 7fd5ab7fe700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5ac145790 0x7fd5ac144b50 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fd59c002f70 tx=0x7fd59c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.519+0000 7fd5a97fa700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd59004f8e0 0x7fd590051da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:09.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.519+0000 7fd5a97fa700 1 -- 172.21.15.63:0/4213605080 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd59c064390 con 0x7fd5ac145790 2020-05-18T21:27:09.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.519+0000 7fd5abfff700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd59004f8e0 0x7fd590051da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:09.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.519+0000 7fd5abfff700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd59004f8e0 0x7fd590051da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd594007fe0 tx=0x7fd5940081b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.519+0000 7fd5abfff700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd59004f8e0 0x7fd590051da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd594007fe0 tx=0x7fd5940081b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.519+0000 7fd5abfff700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd59004f8e0 0x7fd590051da0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7fd594007fe0 tx=0x7fd5940081b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:09.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.523+0000 7fd5ab7fe700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5ac145790 0x7fd5ac144b50 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fd59c002f70 tx=0x7fd59c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.523+0000 7fd5a97fa700 1 -- 172.21.15.63:0/4213605080 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd59c03e7e0 con 0x7fd5ac145790 2020-05-18T21:27:09.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.643+0000 7fd5b2a3a700 1 -- 172.21.15.63:0/4213605080 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5ac0569e0 con 0x7fd5ac145790 2020-05-18T21:27:09.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.643+0000 7fd5ab7fe700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5ac145790 0x7fd5ac144b50 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fd59c002f70 tx=0x7fd59c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.643+0000 7fd5a97fa700 1 -- 172.21.15.63:0/4213605080 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fd59c041e00 con 0x7fd5ac145790 2020-05-18T21:27:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:09.648 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":23,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:26:47.498250+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:26:43.453504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-05-18T21:26:44.456531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:27:09.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.643+0000 7fd5b2a3a700 1 -- 172.21.15.63:0/4213605080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd59004f8e0 msgr2=0x7fd590051da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:09.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.643+0000 7fd5b2a3a700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd59004f8e0 0x7fd590051da0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7fd594007fe0 tx=0x7fd5940081b0).stop 2020-05-18T21:27:09.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.643+0000 7fd5b2a3a700 1 -- 172.21.15.63:0/4213605080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5ac145790 msgr2=0x7fd5ac144b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:09.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.643+0000 7fd5b2a3a700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5ac145790 0x7fd5ac144b50 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7fd59c002f70 tx=0x7fd59c007a80).stop 2020-05-18T21:27:09.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.647+0000 7fd5b2a3a700 1 -- 172.21.15.63:0/4213605080 shutdown_connections 2020-05-18T21:27:09.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.647+0000 7fd5b2a3a700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd59004f8e0 0x7fd590051da0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:09.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.647+0000 7fd5b2a3a700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5ac145b70 0x7fd5ac152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:09.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.647+0000 7fd5b2a3a700 1 --2- 172.21.15.63:0/4213605080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5ac145790 0x7fd5ac144b50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:09.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.647+0000 7fd5b2a3a700 1 -- 172.21.15.63:0/4213605080 >> 172.21.15.63:0/4213605080 conn(0x7fd5ac069b70 msgr2=0x7fd5ac13f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:09.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.647+0000 7fd5b2a3a700 1 -- 172.21.15.63:0/4213605080 shutdown_connections 2020-05-18T21:27:09.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.647+0000 7fd5b2a3a700 1 -- 172.21.15.63:0/4213605080 wait complete. 2020-05-18T21:27:09.660 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:26:43.453504+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:26:44.456531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:27:09.661 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:27:09.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.763+0000 7f0fd2dc0700 1 Processor -- start 2020-05-18T21:27:09.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.763+0000 7f0fd2dc0700 1 -- start start 2020-05-18T21:27:09.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd2dc0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc0bc8d0 0x7f0fcc060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:09.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd2dc0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0fcc145e30 0x7f0fcc142f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:09.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd2dc0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fcc146420 con 0x7f0fcc143380 2020-05-18T21:27:09.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd2dc0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fcc146e00 con 0x7f0fcc145e30 2020-05-18T21:27:09.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd2dc0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc1466c0 con 0x7f0fcc0bc8d0 2020-05-18T21:27:09.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd15bd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0fcc145e30 0x7f0fcc142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:09.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd1dbe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc0bc8d0 0x7f0fcc060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:09.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd15bd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0fcc145e30 0x7f0fcc142f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:39974/0 (socket says 172.21.15.63:39974) 2020-05-18T21:27:09.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd15bd700 1 -- 172.21.15.63:0/4240183841 learned_addr learned my addr 172.21.15.63:0/4240183841 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:09.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd15bd700 1 -- 172.21.15.63:0/4240183841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc0bc8d0 msgr2=0x7f0fcc060b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:09.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd15bd700 1 --2- 172.21.15.63:0/4240183841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc0bc8d0 0x7f0fcc060b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:09.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd15bd700 1 -- 172.21.15.63:0/4240183841 >> v1:172.21.15.155:6789/0 conn(0x7f0fcc143380 legacy=0x7f0fcc12e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd15bd700 1 -- 172.21.15.63:0/4240183841 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fcc146960 con 0x7f0fcc145e30 2020-05-18T21:27:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd15bd700 1 --2- 172.21.15.63:0/4240183841 >> v2:172.21.15.155:3300/0 conn(0x7f0fcc145e30 0x7f0fcc142f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0fc0002f70 tx=0x7f0fcc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd15bd700 1 --2- 172.21.15.63:0/4240183841 >> v2:172.21.15.155:3300/0 conn(0x7f0fcc145e30 0x7f0fcc142f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0fc0002f70 tx=0x7f0fcc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd15bd700 1 --2- 172.21.15.63:0/4240183841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fcc145e30 0x7f0fcc142f20 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f0fc0002f70 tx=0x7f0fcc061d60).ready entity=mon.1 client_cookie=6fbb9c96cd5e4381 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd15bd700 1 --2- 172.21.15.63:0/4240183841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fcc145e30 0x7f0fcc142f20 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f0fc0002f70 tx=0x7f0fcc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd0dbc700 1 -- 172.21.15.63:0/4240183841 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fc00116b0 con 0x7f0fcc145e30 2020-05-18T21:27:09.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd15bd700 1 --2- 172.21.15.63:0/4240183841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fcc145e30 0x7f0fcc142f20 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f0fc0002f70 tx=0x7f0fcc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd0dbc700 1 -- 172.21.15.63:0/4240183841 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc0011810 con 0x7f0fcc145e30 2020-05-18T21:27:09.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd15bd700 1 --2- 172.21.15.63:0/4240183841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fcc145e30 0x7f0fcc142f20 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f0fc0002f70 tx=0x7f0fcc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd0dbc700 1 -- 172.21.15.63:0/4240183841 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fc0011c30 con 0x7f0fcc145e30 2020-05-18T21:27:09.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd2dc0700 1 -- 172.21.15.63:0/4240183841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fcc145e30 msgr2=0x7f0fcc142f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:09.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd2dc0700 1 --2- 172.21.15.63:0/4240183841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fcc145e30 0x7f0fcc142f20 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f0fc0002f70 tx=0x7f0fcc061d60).stop 2020-05-18T21:27:09.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd2dc0700 1 -- 172.21.15.63:0/4240183841 shutdown_connections 2020-05-18T21:27:09.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd2dc0700 1 --2- 172.21.15.63:0/4240183841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fcc145e30 0x7f0fcc142f20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:09.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd2dc0700 1 --2- 172.21.15.63:0/4240183841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc0bc8d0 0x7f0fcc060b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:09.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd2dc0700 1 -- 172.21.15.63:0/4240183841 >> 172.21.15.63:0/4240183841 conn(0x7f0fcc05f3b0 msgr2=0x7f0fcc05f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:09.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd2dc0700 1 -- 172.21.15.63:0/4240183841 shutdown_connections 2020-05-18T21:27:09.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.767+0000 7f0fd2dc0700 1 -- 172.21.15.63:0/4240183841 wait complete. 2020-05-18T21:27:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.771+0000 7f0fd2dc0700 1 Processor -- start 2020-05-18T21:27:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.771+0000 7f0fd2dc0700 1 -- start start 2020-05-18T21:27:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.771+0000 7f0fd2dc0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0fcc0bc8d0 0x7f0fcc153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.771+0000 7f0fd2dc0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc145e30 0x7f0fcc0b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.771+0000 7f0fd2dc0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fcc115d80 con 0x7f0fcc143380 2020-05-18T21:27:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.771+0000 7f0fd2dc0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fcc152fe0 con 0x7f0fcc0bc8d0 2020-05-18T21:27:09.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.771+0000 7f0fd2dc0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc154010 con 0x7f0fcc145e30 2020-05-18T21:27:09.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.771+0000 7f0fd25bf700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc145e30 0x7f0fcc0b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:09.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.771+0000 7f0fd1dbe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0fcc0bc8d0 0x7f0fcc153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:09.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.771+0000 7f0fd25bf700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc145e30 0x7f0fcc0b2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:44070/0 (socket says 172.21.15.63:44070) 2020-05-18T21:27:09.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.771+0000 7f0fd25bf700 1 -- 172.21.15.63:0/167852850 learned_addr learned my addr 172.21.15.63:0/167852850 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fd25bf700 1 -- 172.21.15.63:0/167852850 >> v2:172.21.15.155:3300/0 conn(0x7f0fcc0bc8d0 msgr2=0x7f0fcc153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fd25bf700 1 --2- 172.21.15.63:0/167852850 >> v2:172.21.15.155:3300/0 conn(0x7f0fcc0bc8d0 0x7f0fcc153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fd25bf700 1 -- 172.21.15.63:0/167852850 >> v1:172.21.15.155:6789/0 conn(0x7f0fcc143380 legacy=0x7f0fcc115670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fd25bf700 1 -- 172.21.15.63:0/167852850 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fcc0b3390 con 0x7f0fcc145e30 2020-05-18T21:27:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fd1dbe700 1 --2- 172.21.15.63:0/167852850 >> v2:172.21.15.155:3300/0 conn(0x7f0fcc0bc8d0 0x7f0fcc153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fd25bf700 1 --2- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc145e30 0x7f0fcc0b2f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0fc40012d0 tx=0x7f0fc4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fd25bf700 1 --2- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc145e30 0x7f0fcc0b2f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0fc40012d0 tx=0x7f0fc4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fd25bf700 1 --2- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc145e30 0x7f0fcc0b2f30 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f0fc40012d0 tx=0x7f0fc4010d20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fd25bf700 1 --2- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc145e30 0x7f0fcc0b2f30 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f0fc40012d0 tx=0x7f0fc4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fd25bf700 1 --2- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc145e30 0x7f0fcc0b2f30 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f0fc40012d0 tx=0x7f0fc4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fbeffd700 1 -- 172.21.15.63:0/167852850 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fc40103d0 con 0x7f0fcc145e30 2020-05-18T21:27:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fd25bf700 1 --2- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc145e30 0x7f0fcc0b2f30 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f0fc40012d0 tx=0x7f0fc4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fbeffd700 1 -- 172.21.15.63:0/167852850 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc4010530 con 0x7f0fcc145e30 2020-05-18T21:27:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fd2dc0700 1 -- 172.21.15.63:0/167852850 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fcc153230 con 0x7f0fcc145e30 2020-05-18T21:27:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fbeffd700 1 -- 172.21.15.63:0/167852850 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fc4012380 con 0x7f0fcc145e30 2020-05-18T21:27:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fd2dc0700 1 -- 172.21.15.63:0/167852850 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fcc0af0d0 con 0x7f0fcc145e30 2020-05-18T21:27:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fd25bf700 1 --2- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc145e30 0x7f0fcc0b2f30 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f0fc40012d0 tx=0x7f0fc4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fd2dc0700 1 -- 172.21.15.63:0/167852850 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fcc0569e0 con 0x7f0fcc145e30 2020-05-18T21:27:09.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fbeffd700 1 -- 172.21.15.63:0/167852850 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0fc40068a0 con 0x7f0fcc145e30 2020-05-18T21:27:09.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.775+0000 7f0fd25bf700 1 --2- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc145e30 0x7f0fcc0b2f30 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f0fc40012d0 tx=0x7f0fc4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.779+0000 7f0fbeffd700 1 --2- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fac04fa90 0x7f0fac051f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:09.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.779+0000 7f0fbeffd700 1 -- 172.21.15.63:0/167852850 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0fc4063eb0 con 0x7f0fcc145e30 2020-05-18T21:27:09.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.779+0000 7f0fd1dbe700 1 --2- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fac04fa90 0x7f0fac051f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:09.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.779+0000 7f0fd1dbe700 1 --2- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fac04fa90 0x7f0fac051f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0fc8002f70 tx=0x7f0fc8007c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.779+0000 7f0fd1dbe700 1 --2- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fac04fa90 0x7f0fac051f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0fc8002f70 tx=0x7f0fc8007c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.779+0000 7f0fd1dbe700 1 --2- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fac04fa90 0x7f0fac051f50 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f0fc8002f70 tx=0x7f0fc8007c90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:09.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.787+0000 7f0fd25bf700 1 --2- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc145e30 0x7f0fcc0b2f30 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f0fc40012d0 tx=0x7f0fc4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.787+0000 7f0fbeffd700 1 -- 172.21.15.63:0/167852850 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f0fc403e1e0 con 0x7f0fcc145e30 2020-05-18T21:27:09.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.903+0000 7f0fd2dc0700 1 -- 172.21.15.63:0/167852850 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0fcc153910 con 0x7f0fcc145e30 2020-05-18T21:27:09.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.903+0000 7f0fd25bf700 1 --2- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc145e30 0x7f0fcc0b2f30 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f0fc40012d0 tx=0x7f0fc4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:09.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.903+0000 7f0fbeffd700 1 -- 172.21.15.63:0/167852850 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0fc4041800 con 0x7f0fcc145e30 2020-05-18T21:27:09.907 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:27:09.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.907+0000 7f0fd2dc0700 1 -- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fac04fa90 msgr2=0x7f0fac051f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:09.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.907+0000 7f0fd2dc0700 1 --2- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fac04fa90 0x7f0fac051f50 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f0fc8002f70 tx=0x7f0fc8007c90).stop 2020-05-18T21:27:09.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.907+0000 7f0fd2dc0700 1 -- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc145e30 msgr2=0x7f0fcc0b2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:09.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.907+0000 7f0fd2dc0700 1 --2- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc145e30 0x7f0fcc0b2f30 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f0fc40012d0 tx=0x7f0fc4010d20).stop 2020-05-18T21:27:09.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.907+0000 7f0fd2dc0700 1 -- 172.21.15.63:0/167852850 shutdown_connections 2020-05-18T21:27:09.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.907+0000 7f0fd2dc0700 1 --2- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fac04fa90 0x7f0fac051f50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:09.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.907+0000 7f0fd2dc0700 1 --2- 172.21.15.63:0/167852850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fcc145e30 0x7f0fcc0b2f30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:09.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.907+0000 7f0fd2dc0700 1 --2- 172.21.15.63:0/167852850 >> v2:172.21.15.155:3300/0 conn(0x7f0fcc0bc8d0 0x7f0fcc153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:09.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.907+0000 7f0fd2dc0700 1 -- 172.21.15.63:0/167852850 >> 172.21.15.63:0/167852850 conn(0x7f0fcc05f3b0 msgr2=0x7f0fcc0611a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:09.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.907+0000 7f0fd2dc0700 1 -- 172.21.15.63:0/167852850 shutdown_connections 2020-05-18T21:27:09.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:09.907+0000 7f0fd2dc0700 1 -- 172.21.15.63:0/167852850 wait complete. 2020-05-18T21:27:09.925 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:27:10.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.019+0000 7f9118ee0700 1 Processor -- start 2020-05-18T21:27:10.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.019+0000 7f9118ee0700 1 -- start start 2020-05-18T21:27:10.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.019+0000 7f9118ee0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9114062130 0x7f911413f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:10.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.019+0000 7f9118ee0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f911413fd80 0x7f91140b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:10.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.019+0000 7f9118ee0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91141465b0 con 0x7f911405f410 2020-05-18T21:27:10.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.019+0000 7f9118ee0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9114146850 con 0x7f911413fd80 2020-05-18T21:27:10.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.019+0000 7f9118ee0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9114146af0 con 0x7f9114062130 2020-05-18T21:27:10.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.019+0000 7f9113fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f911413fd80 0x7f91140b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:10.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.019+0000 7f9112ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9114062130 0x7f911413f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:10.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.019+0000 7f9112ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9114062130 0x7f911413f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:39990/0 (socket says 172.21.15.63:39990) 2020-05-18T21:27:10.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.019+0000 7f9112ffd700 1 -- 172.21.15.63:0/3238898705 learned_addr learned my addr 172.21.15.63:0/3238898705 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:10.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.019+0000 7f91137fe700 1 --1- 172.21.15.63:0/3238898705 >> v1:172.21.15.155:6789/0 conn(0x7f911405f410 0x7f9114145dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:53876/0 (socket says 172.21.15.63:53876) 2020-05-18T21:27:10.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f9112ffd700 1 -- 172.21.15.63:0/3238898705 >> v2:172.21.15.63:3300/0 conn(0x7f911413fd80 msgr2=0x7f91140b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:10.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f9112ffd700 1 --2- 172.21.15.63:0/3238898705 >> v2:172.21.15.63:3300/0 conn(0x7f911413fd80 0x7f91140b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:10.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f9112ffd700 1 -- 172.21.15.63:0/3238898705 >> v1:172.21.15.155:6789/0 conn(0x7f911405f410 legacy=0x7f9114145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f9112ffd700 1 -- 172.21.15.63:0/3238898705 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91141401c0 con 0x7f9114062130 2020-05-18T21:27:10.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f9113fff700 1 --2- 172.21.15.63:0/3238898705 >> v2:172.21.15.63:3300/0 conn(0x7f911413fd80 0x7f91140b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:10.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f9112ffd700 1 --2- 172.21.15.63:0/3238898705 >> v2:172.21.15.155:3300/0 conn(0x7f9114062130 0x7f911413f920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9108002f70 tx=0x7f9108007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f9112ffd700 1 --2- 172.21.15.63:0/3238898705 >> v2:172.21.15.155:3300/0 conn(0x7f9114062130 0x7f911413f920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9108002f70 tx=0x7f9108007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f9112ffd700 1 --2- 172.21.15.63:0/3238898705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9114062130 0x7f911413f920 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f9108002f70 tx=0x7f9108007a80).ready entity=mon.1 client_cookie=8d6b792f6016b2d6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:10.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f9112ffd700 1 --2- 172.21.15.63:0/3238898705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9114062130 0x7f911413f920 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f9108002f70 tx=0x7f9108007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f91127fc700 1 -- 172.21.15.63:0/3238898705 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91080116b0 con 0x7f9114062130 2020-05-18T21:27:10.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f9112ffd700 1 --2- 172.21.15.63:0/3238898705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9114062130 0x7f911413f920 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f9108002f70 tx=0x7f9108007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f91127fc700 1 -- 172.21.15.63:0/3238898705 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9108011810 con 0x7f9114062130 2020-05-18T21:27:10.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f9112ffd700 1 --2- 172.21.15.63:0/3238898705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9114062130 0x7f911413f920 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f9108002f70 tx=0x7f9108007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f91127fc700 1 -- 172.21.15.63:0/3238898705 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9108011c30 con 0x7f9114062130 2020-05-18T21:27:10.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f9118ee0700 1 -- 172.21.15.63:0/3238898705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9114062130 msgr2=0x7f911413f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f9118ee0700 1 --2- 172.21.15.63:0/3238898705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9114062130 0x7f911413f920 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f9108002f70 tx=0x7f9108007a80).stop 2020-05-18T21:27:10.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f9118ee0700 1 -- 172.21.15.63:0/3238898705 shutdown_connections 2020-05-18T21:27:10.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f9118ee0700 1 --2- 172.21.15.63:0/3238898705 >> v2:172.21.15.63:3300/0 conn(0x7f911413fd80 0x7f91140b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:10.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f9118ee0700 1 --2- 172.21.15.63:0/3238898705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9114062130 0x7f911413f920 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f9118ee0700 1 -- 172.21.15.63:0/3238898705 >> 172.21.15.63:0/3238898705 conn(0x7f911406a600 msgr2=0x7f91140b6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:10.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f9118ee0700 1 -- 172.21.15.63:0/3238898705 shutdown_connections 2020-05-18T21:27:10.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.023+0000 7f9118ee0700 1 -- 172.21.15.63:0/3238898705 wait complete. 2020-05-18T21:27:10.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9118ee0700 1 Processor -- start 2020-05-18T21:27:10.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9118ee0700 1 -- start start 2020-05-18T21:27:10.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9118ee0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9114062130 0x7f9114147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:10.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9118ee0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f911413fd80 0x7f9114156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:10.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9118ee0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9114147490 con 0x7f911405f410 2020-05-18T21:27:10.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9118ee0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91140b8db0 con 0x7f9114062130 2020-05-18T21:27:10.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9118ee0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9114155ce0 con 0x7f911413fd80 2020-05-18T21:27:10.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9112ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9114062130 0x7f9114147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:10.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9112ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9114062130 0x7f9114147030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53380/0 (socket says 172.21.15.63:53380) 2020-05-18T21:27:10.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9112ffd700 1 -- 172.21.15.63:0/80294922 learned_addr learned my addr 172.21.15.63:0/80294922 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:10.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9113fff700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f911413fd80 0x7f9114156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:10.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9112ffd700 1 -- 172.21.15.63:0/80294922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f911413fd80 msgr2=0x7f9114156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9112ffd700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f911413fd80 0x7f9114156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9112ffd700 1 -- 172.21.15.63:0/80294922 >> v1:172.21.15.155:6789/0 conn(0x7f911405f410 legacy=0x7f91140b8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9112ffd700 1 -- 172.21.15.63:0/80294922 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9114155a10 con 0x7f9114062130 2020-05-18T21:27:10.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9112ffd700 1 --2- 172.21.15.63:0/80294922 >> v2:172.21.15.63:3300/0 conn(0x7f9114062130 0x7f9114147030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9108002f70 tx=0x7f9108007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9112ffd700 1 --2- 172.21.15.63:0/80294922 >> v2:172.21.15.63:3300/0 conn(0x7f9114062130 0x7f9114147030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9108002f70 tx=0x7f9108007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9112ffd700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9114062130 0x7f9114147030 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f9108002f70 tx=0x7f9108007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:10.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9112ffd700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9114062130 0x7f9114147030 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f9108002f70 tx=0x7f9108007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.027+0000 7f9110ff9700 1 -- 172.21.15.63:0/80294922 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9108007360 con 0x7f9114062130 2020-05-18T21:27:10.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.031+0000 7f9118ee0700 1 -- 172.21.15.63:0/80294922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9114143110 con 0x7f9114062130 2020-05-18T21:27:10.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.031+0000 7f9112ffd700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9114062130 0x7f9114147030 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f9108002f70 tx=0x7f9108007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.031+0000 7f9110ff9700 1 -- 172.21.15.63:0/80294922 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91080074c0 con 0x7f9114062130 2020-05-18T21:27:10.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.031+0000 7f9112ffd700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9114062130 0x7f9114147030 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f9108002f70 tx=0x7f9108007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.031+0000 7f9118ee0700 1 -- 172.21.15.63:0/80294922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9114156800 con 0x7f9114062130 2020-05-18T21:27:10.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.031+0000 7f9110ff9700 1 -- 172.21.15.63:0/80294922 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91080058f0 con 0x7f9114062130 2020-05-18T21:27:10.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.031+0000 7f9112ffd700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9114062130 0x7f9114147030 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f9108002f70 tx=0x7f9108007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.031+0000 7f9110ff9700 1 -- 172.21.15.63:0/80294922 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9108005b30 con 0x7f9114062130 2020-05-18T21:27:10.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.031+0000 7f9112ffd700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9114062130 0x7f9114147030 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f9108002f70 tx=0x7f9108007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.031+0000 7f9118ee0700 1 -- 172.21.15.63:0/80294922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91140b8c10 con 0x7f9114062130 2020-05-18T21:27:10.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.031+0000 7f9110ff9700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f90f404f980 0x7f90f4051e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:10.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.031+0000 7f9110ff9700 1 -- 172.21.15.63:0/80294922 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f91080641d0 con 0x7f9114062130 2020-05-18T21:27:10.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.031+0000 7f91137fe700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f90f404f980 0x7f90f4051e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:10.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.031+0000 7f91137fe700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f90f404f980 0x7f90f4051e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f91140a02b0 tx=0x7f910c0018b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.035+0000 7f91137fe700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f90f404f980 0x7f90f4051e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f91140a02b0 tx=0x7f910c0018b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.035+0000 7f91137fe700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f90f404f980 0x7f90f4051e40 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f91140a02b0 tx=0x7f910c0018b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:10.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.039+0000 7f9112ffd700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9114062130 0x7f9114147030 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f9108002f70 tx=0x7f9108007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.039+0000 7f9110ff9700 1 -- 172.21.15.63:0/80294922 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f91140b8c10 con 0x7f9114062130 2020-05-18T21:27:10.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.155+0000 7f9118ee0700 1 -- 172.21.15.63:0/80294922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f91140b8c10 con 0x7f9114062130 2020-05-18T21:27:10.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.159+0000 7f9112ffd700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9114062130 0x7f9114147030 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f9108002f70 tx=0x7f9108007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.159+0000 7f9110ff9700 1 -- 172.21.15.63:0/80294922 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f91140b8c10 con 0x7f9114062130 2020-05-18T21:27:10.161 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:10.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.159+0000 7f9118ee0700 1 -- 172.21.15.63:0/80294922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f90f404f980 msgr2=0x7f90f4051e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.159+0000 7f9118ee0700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f90f404f980 0x7f90f4051e40 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f91140a02b0 tx=0x7f910c0018b0).stop 2020-05-18T21:27:10.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.159+0000 7f9118ee0700 1 -- 172.21.15.63:0/80294922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9114062130 msgr2=0x7f9114147030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.159+0000 7f9118ee0700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9114062130 0x7f9114147030 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f9108002f70 tx=0x7f9108007a80).stop 2020-05-18T21:27:10.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.159+0000 7f9118ee0700 1 -- 172.21.15.63:0/80294922 shutdown_connections 2020-05-18T21:27:10.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.159+0000 7f9118ee0700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f90f404f980 0x7f90f4051e40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.159+0000 7f9118ee0700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f911413fd80 0x7f9114156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.159+0000 7f9118ee0700 1 --2- 172.21.15.63:0/80294922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9114062130 0x7f9114147030 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.159+0000 7f9118ee0700 1 -- 172.21.15.63:0/80294922 >> 172.21.15.63:0/80294922 conn(0x7f911406a600 msgr2=0x7f9114148530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:10.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.159+0000 7f9118ee0700 1 -- 172.21.15.63:0/80294922 shutdown_connections 2020-05-18T21:27:10.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.159+0000 7f9118ee0700 1 -- 172.21.15.63:0/80294922 wait complete. 2020-05-18T21:27:10.173 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:27:10.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4f318700 1 Processor -- start 2020-05-18T21:27:10.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4f318700 1 -- start start 2020-05-18T21:27:10.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4f318700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe48142ed0 0x7efe480606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:10.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4f318700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe480b4630 con 0x7efe48065a10 2020-05-18T21:27:10.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4f318700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe48060c50 con 0x7efe480b4f60 2020-05-18T21:27:10.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4f318700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe48060ef0 con 0x7efe48142ed0 2020-05-18T21:27:10.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4db15700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe48142ed0 0x7efe480606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:10.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4eb17700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efe48065a10 0x7efe48145790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55578/0 (socket says 172.21.15.63:55578) 2020-05-18T21:27:10.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4eb17700 1 -- 172.21.15.63:0/2798966124 learned_addr learned my addr 172.21.15.63:0/2798966124 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:10.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4db15700 1 -- 172.21.15.63:0/2798966124 >> v1:172.21.15.155:6789/0 conn(0x7efe480b4f60 legacy=0x7efe481427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4db15700 1 -- 172.21.15.63:0/2798966124 >> v1:172.21.15.63:6789/0 conn(0x7efe48065a10 legacy=0x7efe48145790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4d314700 1 -- 172.21.15.63:0/2798966124 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886271817 0 0) 0x7efe480b4630 con 0x7efe48065a10 2020-05-18T21:27:10.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4db15700 1 -- 172.21.15.63:0/2798966124 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe48061190 con 0x7efe48142ed0 2020-05-18T21:27:10.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4db15700 1 --2- 172.21.15.63:0/2798966124 >> v2:172.21.15.63:3300/0 conn(0x7efe48142ed0 0x7efe480606d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efe38002f70 tx=0x7efe38007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4db15700 1 --2- 172.21.15.63:0/2798966124 >> v2:172.21.15.63:3300/0 conn(0x7efe48142ed0 0x7efe480606d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efe38002f70 tx=0x7efe38007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4db15700 1 --2- 172.21.15.63:0/2798966124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe48142ed0 0x7efe480606d0 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7efe38002f70 tx=0x7efe38007a80).ready entity=mon.0 client_cookie=64b7f2b93e628408 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:10.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4db15700 1 --2- 172.21.15.63:0/2798966124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe48142ed0 0x7efe480606d0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7efe38002f70 tx=0x7efe38007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4d314700 1 -- 172.21.15.63:0/2798966124 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe38008e80 con 0x7efe48142ed0 2020-05-18T21:27:10.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4db15700 1 --2- 172.21.15.63:0/2798966124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe48142ed0 0x7efe480606d0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7efe38002f70 tx=0x7efe38007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4db15700 1 --2- 172.21.15.63:0/2798966124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe48142ed0 0x7efe480606d0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7efe38002f70 tx=0x7efe38007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4d314700 1 -- 172.21.15.63:0/2798966124 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe380116a0 con 0x7efe48142ed0 2020-05-18T21:27:10.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4d314700 1 -- 172.21.15.63:0/2798966124 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe38011ac0 con 0x7efe48142ed0 2020-05-18T21:27:10.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4f318700 1 -- 172.21.15.63:0/2798966124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe48142ed0 msgr2=0x7efe480606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4f318700 1 --2- 172.21.15.63:0/2798966124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe48142ed0 0x7efe480606d0 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7efe38002f70 tx=0x7efe38007a80).stop 2020-05-18T21:27:10.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.279+0000 7efe4f318700 1 -- 172.21.15.63:0/2798966124 shutdown_connections 2020-05-18T21:27:10.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe4f318700 1 --2- 172.21.15.63:0/2798966124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe48142ed0 0x7efe480606d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe4f318700 1 -- 172.21.15.63:0/2798966124 >> 172.21.15.63:0/2798966124 conn(0x7efe4805fbd0 msgr2=0x7efe48069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:10.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe4f318700 1 -- 172.21.15.63:0/2798966124 shutdown_connections 2020-05-18T21:27:10.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe4f318700 1 -- 172.21.15.63:0/2798966124 wait complete. 2020-05-18T21:27:10.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe4f318700 1 Processor -- start 2020-05-18T21:27:10.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe4f318700 1 -- start start 2020-05-18T21:27:10.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe4f318700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe480b4f60 0x7efe4812d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:10.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe4f318700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe4813f1f0 con 0x7efe48142ed0 2020-05-18T21:27:10.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe4f318700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe4812e770 con 0x7efe48065a10 2020-05-18T21:27:10.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe4f318700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4813f470 con 0x7efe480b4f60 2020-05-18T21:27:10.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe4eb17700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efe48142ed0 0x7efe4813f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55584/0 (socket says 172.21.15.63:55584) 2020-05-18T21:27:10.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe4eb17700 1 -- 172.21.15.63:0/1441363884 learned_addr learned my addr 172.21.15.63:0/1441363884 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:10.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe4db15700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe480b4f60 0x7efe4812d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:10.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe377fe700 1 -- 172.21.15.63:0/1441363884 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003841254 0 0) 0x7efe4812e770 con 0x7efe48065a10 2020-05-18T21:27:10.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe377fe700 1 -- 172.21.15.63:0/1441363884 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe28002fe0 con 0x7efe48065a10 2020-05-18T21:27:10.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe377fe700 1 -- 172.21.15.63:0/1441363884 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2630283899 0 0) 0x7efe4813f1f0 con 0x7efe48142ed0 2020-05-18T21:27:10.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe377fe700 1 -- 172.21.15.63:0/1441363884 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe4812e770 con 0x7efe48142ed0 2020-05-18T21:27:10.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe4db15700 1 -- 172.21.15.63:0/1441363884 >> v1:172.21.15.155:6789/0 conn(0x7efe48065a10 legacy=0x7efe4813b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe4db15700 1 -- 172.21.15.63:0/1441363884 >> v1:172.21.15.63:6789/0 conn(0x7efe48142ed0 legacy=0x7efe4813f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.283+0000 7efe4db15700 1 -- 172.21.15.63:0/1441363884 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4812e470 con 0x7efe480b4f60 2020-05-18T21:27:10.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.287+0000 7efe4db15700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe480b4f60 0x7efe4812d540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe38002f70 tx=0x7efe38007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.287+0000 7efe4db15700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe480b4f60 0x7efe4812d540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe38002f70 tx=0x7efe38007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.287+0000 7efe4db15700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe480b4f60 0x7efe4812d540 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7efe38002f70 tx=0x7efe38007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:10.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.287+0000 7efe4db15700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe480b4f60 0x7efe4812d540 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7efe38002f70 tx=0x7efe38007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.287+0000 7efe377fe700 1 -- 172.21.15.63:0/1441363884 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe38007360 con 0x7efe480b4f60 2020-05-18T21:27:10.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.287+0000 7efe4db15700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe480b4f60 0x7efe4812d540 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7efe38002f70 tx=0x7efe38007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.287+0000 7efe4db15700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe480b4f60 0x7efe4812d540 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7efe38002f70 tx=0x7efe38007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.287+0000 7efe377fe700 1 -- 172.21.15.63:0/1441363884 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe380074c0 con 0x7efe480b4f60 2020-05-18T21:27:10.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.287+0000 7efe377fe700 1 -- 172.21.15.63:0/1441363884 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe38007630 con 0x7efe480b4f60 2020-05-18T21:27:10.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.287+0000 7efe4f318700 1 -- 172.21.15.63:0/1441363884 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe48132030 con 0x7efe480b4f60 2020-05-18T21:27:10.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.287+0000 7efe4f318700 1 -- 172.21.15.63:0/1441363884 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe48132d80 con 0x7efe480b4f60 2020-05-18T21:27:10.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.287+0000 7efe4f318700 1 -- 172.21.15.63:0/1441363884 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe48133230 con 0x7efe480b4f60 2020-05-18T21:27:10.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.287+0000 7efe4db15700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe480b4f60 0x7efe4812d540 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7efe38002f70 tx=0x7efe38007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.287+0000 7efe377fe700 1 -- 172.21.15.63:0/1441363884 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7efe380058f0 con 0x7efe480b4f60 2020-05-18T21:27:10.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.287+0000 7efe4db15700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe480b4f60 0x7efe4812d540 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7efe38002f70 tx=0x7efe38007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.291+0000 7efe377fe700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe2804fe80 0x7efe28052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:10.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.291+0000 7efe377fe700 1 -- 172.21.15.63:0/1441363884 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efe380645d0 con 0x7efe480b4f60 2020-05-18T21:27:10.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.291+0000 7efe4e316700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe2804fe80 0x7efe28052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:10.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.291+0000 7efe4e316700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe2804fe80 0x7efe28052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe44001020 tx=0x7efe44002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.291+0000 7efe4e316700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe2804fe80 0x7efe28052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe44001020 tx=0x7efe44002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.291+0000 7efe4e316700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe2804fe80 0x7efe28052340 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7efe44001020 tx=0x7efe44002740).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:10.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.299+0000 7efe4db15700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe480b4f60 0x7efe4812d540 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7efe38002f70 tx=0x7efe38007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.299+0000 7efe377fe700 1 -- 172.21.15.63:0/1441363884 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7efe3803e9c0 con 0x7efe480b4f60 2020-05-18T21:27:10.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.415+0000 7efe4f318700 1 -- 172.21.15.63:0/1441363884 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efe4813f610 con 0x7efe480b4f60 2020-05-18T21:27:10.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.415+0000 7efe4db15700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe480b4f60 0x7efe4812d540 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7efe38002f70 tx=0x7efe38007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.415+0000 7efe377fe700 1 -- 172.21.15.63:0/1441363884 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7efe38041fe0 con 0x7efe480b4f60 2020-05-18T21:27:10.421 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:10.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.419+0000 7efe4f318700 1 -- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe2804fe80 msgr2=0x7efe28052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.419+0000 7efe4f318700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe2804fe80 0x7efe28052340 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7efe44001020 tx=0x7efe44002740).stop 2020-05-18T21:27:10.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.419+0000 7efe4f318700 1 -- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe480b4f60 msgr2=0x7efe4812d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.419+0000 7efe4f318700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe480b4f60 0x7efe4812d540 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7efe38002f70 tx=0x7efe38007a80).stop 2020-05-18T21:27:10.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.419+0000 7efe4f318700 1 -- 172.21.15.63:0/1441363884 shutdown_connections 2020-05-18T21:27:10.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.419+0000 7efe4f318700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe2804fe80 0x7efe28052340 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.419+0000 7efe4f318700 1 --2- 172.21.15.63:0/1441363884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe480b4f60 0x7efe4812d540 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.419+0000 7efe4f318700 1 -- 172.21.15.63:0/1441363884 >> 172.21.15.63:0/1441363884 conn(0x7efe4805fbd0 msgr2=0x7efe480b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:10.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.419+0000 7efe4f318700 1 -- 172.21.15.63:0/1441363884 shutdown_connections 2020-05-18T21:27:10.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.419+0000 7efe4f318700 1 -- 172.21.15.63:0/1441363884 wait complete. 2020-05-18T21:27:10.433 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:27:10.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.539+0000 7f67327c7700 1 Processor -- start 2020-05-18T21:27:10.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.539+0000 7f67327c7700 1 -- start start 2020-05-18T21:27:10.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.539+0000 7f67327c7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f672c0b9500 0x7f672c0b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:10.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.539+0000 7f67327c7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c060660 con 0x7f672c0b42b0 2020-05-18T21:27:10.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.539+0000 7f67327c7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c060890 con 0x7f672c0b6d90 2020-05-18T21:27:10.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.539+0000 7f67327c7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672c060b30 con 0x7f672c0b9500 2020-05-18T21:27:10.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.539+0000 7f672bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f672c0b9500 0x7f672c0b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:10.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f672bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f672c0b9500 0x7f672c0b8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53400/0 (socket says 172.21.15.63:53400) 2020-05-18T21:27:10.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f672bfff700 1 -- 172.21.15.63:0/1945390628 learned_addr learned my addr 172.21.15.63:0/1945390628 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:10.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f672bfff700 1 -- 172.21.15.63:0/1945390628 >> v1:172.21.15.155:6789/0 conn(0x7f672c0b6d90 legacy=0x7f672c061270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f672bfff700 1 -- 172.21.15.63:0/1945390628 >> v1:172.21.15.63:6789/0 conn(0x7f672c0b42b0 legacy=0x7f672c12ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f672affd700 1 -- 172.21.15.63:0/1945390628 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3459601558 0 0) 0x7f672c060660 con 0x7f672c0b42b0 2020-05-18T21:27:10.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f672bfff700 1 -- 172.21.15.63:0/1945390628 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c060dd0 con 0x7f672c0b9500 2020-05-18T21:27:10.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f672bfff700 1 --2- 172.21.15.63:0/1945390628 >> v2:172.21.15.63:3300/0 conn(0x7f672c0b9500 0x7f672c0b8630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f672c0b41c0 tx=0x7f671c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f672bfff700 1 --2- 172.21.15.63:0/1945390628 >> v2:172.21.15.63:3300/0 conn(0x7f672c0b9500 0x7f672c0b8630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f672c0b41c0 tx=0x7f671c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f672bfff700 1 --2- 172.21.15.63:0/1945390628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672c0b9500 0x7f672c0b8630 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7f672c0b41c0 tx=0x7f671c008920).ready entity=mon.0 client_cookie=6767ab72f0b51a8e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:10.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f672bfff700 1 --2- 172.21.15.63:0/1945390628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672c0b9500 0x7f672c0b8630 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f672c0b41c0 tx=0x7f671c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f672bfff700 1 --2- 172.21.15.63:0/1945390628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672c0b9500 0x7f672c0b8630 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f672c0b41c0 tx=0x7f671c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f672affd700 1 -- 172.21.15.63:0/1945390628 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f671c011760 con 0x7f672c0b9500 2020-05-18T21:27:10.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f672bfff700 1 --2- 172.21.15.63:0/1945390628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672c0b9500 0x7f672c0b8630 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f672c0b41c0 tx=0x7f671c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f672affd700 1 -- 172.21.15.63:0/1945390628 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c0118c0 con 0x7f672c0b9500 2020-05-18T21:27:10.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f672affd700 1 -- 172.21.15.63:0/1945390628 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f671c011ce0 con 0x7f672c0b9500 2020-05-18T21:27:10.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f67327c7700 1 -- 172.21.15.63:0/1945390628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672c0b9500 msgr2=0x7f672c0b8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f67327c7700 1 --2- 172.21.15.63:0/1945390628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672c0b9500 0x7f672c0b8630 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7f672c0b41c0 tx=0x7f671c008920).stop 2020-05-18T21:27:10.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f67327c7700 1 -- 172.21.15.63:0/1945390628 shutdown_connections 2020-05-18T21:27:10.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f67327c7700 1 --2- 172.21.15.63:0/1945390628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672c0b9500 0x7f672c0b8630 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f67327c7700 1 -- 172.21.15.63:0/1945390628 >> 172.21.15.63:0/1945390628 conn(0x7f672c069b70 msgr2=0x7f672c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:10.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f67327c7700 1 -- 172.21.15.63:0/1945390628 shutdown_connections 2020-05-18T21:27:10.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.543+0000 7f67327c7700 1 -- 172.21.15.63:0/1945390628 wait complete. 2020-05-18T21:27:10.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f67327c7700 1 Processor -- start 2020-05-18T21:27:10.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f67327c7700 1 -- start start 2020-05-18T21:27:10.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f67327c7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f672c0b42b0 0x7f672c0b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:10.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f67327c7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f672c0b6d90 0x7f672c0b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:10.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f67327c7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f672c0b9500 0x7f672c1567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:10.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f67327c7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672c0aee40 con 0x7f672c0b9500 2020-05-18T21:27:10.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f67327c7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672c0b30c0 con 0x7f672c0b42b0 2020-05-18T21:27:10.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f67327c7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672c12ecb0 con 0x7f672c0b6d90 2020-05-18T21:27:10.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f6730d64700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f672c0b9500 0x7f672c1567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:10.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f6730d64700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f672c0b9500 0x7f672c1567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53410/0 (socket says 172.21.15.63:53410) 2020-05-18T21:27:10.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f6730d64700 1 -- 172.21.15.63:0/3622082333 learned_addr learned my addr 172.21.15.63:0/3622082333 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:10.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f672b7fe700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f672c0b6d90 0x7f672c0b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:10.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f672bfff700 1 --2- 172.21.15.63:0/3622082333 >> v2:172.21.15.155:3300/0 conn(0x7f672c0b42b0 0x7f672c0b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:10.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f6730d64700 1 -- 172.21.15.63:0/3622082333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f672c0b6d90 msgr2=0x7f672c0b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f6730d64700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f672c0b6d90 0x7f672c0b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f6730d64700 1 -- 172.21.15.63:0/3622082333 >> v2:172.21.15.155:3300/0 conn(0x7f672c0b42b0 msgr2=0x7f672c0b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f6730d64700 1 --2- 172.21.15.63:0/3622082333 >> v2:172.21.15.155:3300/0 conn(0x7f672c0b42b0 0x7f672c0b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f6730d64700 1 -- 172.21.15.63:0/3622082333 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c12ef50 con 0x7f672c0b9500 2020-05-18T21:27:10.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f6730d64700 1 --2- 172.21.15.63:0/3622082333 >> v2:172.21.15.63:3300/0 conn(0x7f672c0b9500 0x7f672c1567e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6724001250 tx=0x7f6724010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f6730d64700 1 --2- 172.21.15.63:0/3622082333 >> v2:172.21.15.63:3300/0 conn(0x7f672c0b9500 0x7f672c1567e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6724001250 tx=0x7f6724010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f6730d64700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672c0b9500 0x7f672c1567e0 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f6724001250 tx=0x7f6724010dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:10.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f6730d64700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672c0b9500 0x7f672c1567e0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f6724001250 tx=0x7f6724010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f6730d64700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672c0b9500 0x7f672c1567e0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f6724001250 tx=0x7f6724010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f67297fa700 1 -- 172.21.15.63:0/3622082333 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67240101e0 con 0x7f672c0b9500 2020-05-18T21:27:10.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f6730d64700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672c0b9500 0x7f672c1567e0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f6724001250 tx=0x7f6724010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f67297fa700 1 -- 172.21.15.63:0/3622082333 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6724010340 con 0x7f672c0b9500 2020-05-18T21:27:10.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f67327c7700 1 -- 172.21.15.63:0/3622082333 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672c156c40 con 0x7f672c0b9500 2020-05-18T21:27:10.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f67297fa700 1 -- 172.21.15.63:0/3622082333 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6724010760 con 0x7f672c0b9500 2020-05-18T21:27:10.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f67327c7700 1 -- 172.21.15.63:0/3622082333 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672c157170 con 0x7f672c0b9500 2020-05-18T21:27:10.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f6730d64700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672c0b9500 0x7f672c1567e0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f6724001250 tx=0x7f6724010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f67297fa700 1 -- 172.21.15.63:0/3622082333 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f67240068a0 con 0x7f672c0b9500 2020-05-18T21:27:10.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f6730d64700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672c0b9500 0x7f672c1567e0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f6724001250 tx=0x7f6724010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.547+0000 7f67327c7700 1 -- 172.21.15.63:0/3622082333 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672c12eb10 con 0x7f672c0b9500 2020-05-18T21:27:10.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.551+0000 7f67297fa700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f671004fac0 0x7f6710051f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:10.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.551+0000 7f67297fa700 1 -- 172.21.15.63:0/3622082333 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6724063da0 con 0x7f672c0b9500 2020-05-18T21:27:10.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.551+0000 7f672bfff700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f671004fac0 0x7f6710051f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:10.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.551+0000 7f672bfff700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f671004fac0 0x7f6710051f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f672c0b41c0 tx=0x7f671c011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.551+0000 7f672bfff700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f671004fac0 0x7f6710051f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f672c0b41c0 tx=0x7f671c011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.551+0000 7f672bfff700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f671004fac0 0x7f6710051f80 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f672c0b41c0 tx=0x7f671c011510).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:10.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.555+0000 7f6730d64700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672c0b9500 0x7f672c1567e0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f6724001250 tx=0x7f6724010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.555+0000 7f67297fa700 1 -- 172.21.15.63:0/3622082333 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f672c12eb10 con 0x7f672c0b9500 2020-05-18T21:27:10.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.671+0000 7f67327c7700 1 -- 172.21.15.63:0/3622082333 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f672c12f0e0 con 0x7f672c0b9500 2020-05-18T21:27:10.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.671+0000 7f6730d64700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672c0b9500 0x7f672c1567e0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f6724001250 tx=0x7f6724010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.671+0000 7f67297fa700 1 -- 172.21.15.63:0/3622082333 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f672c12f0e0 con 0x7f672c0b9500 2020-05-18T21:27:10.676 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:10.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.675+0000 7f67327c7700 1 -- 172.21.15.63:0/3622082333 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f671004fac0 msgr2=0x7f6710051f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.675+0000 7f67327c7700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f671004fac0 0x7f6710051f80 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f672c0b41c0 tx=0x7f671c011510).stop 2020-05-18T21:27:10.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.675+0000 7f67327c7700 1 -- 172.21.15.63:0/3622082333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672c0b9500 msgr2=0x7f672c1567e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.675+0000 7f67327c7700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672c0b9500 0x7f672c1567e0 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f6724001250 tx=0x7f6724010dd0).stop 2020-05-18T21:27:10.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.675+0000 7f67327c7700 1 -- 172.21.15.63:0/3622082333 shutdown_connections 2020-05-18T21:27:10.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.675+0000 7f67327c7700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f671004fac0 0x7f6710051f80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.675+0000 7f67327c7700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672c0b9500 0x7f672c1567e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.675+0000 7f67327c7700 1 --2- 172.21.15.63:0/3622082333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f672c0b6d90 0x7f672c0b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.675+0000 7f67327c7700 1 --2- 172.21.15.63:0/3622082333 >> v2:172.21.15.155:3300/0 conn(0x7f672c0b42b0 0x7f672c0b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.675+0000 7f67327c7700 1 -- 172.21.15.63:0/3622082333 >> 172.21.15.63:0/3622082333 conn(0x7f672c069b70 msgr2=0x7f672c05c280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:10.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.675+0000 7f67327c7700 1 -- 172.21.15.63:0/3622082333 shutdown_connections 2020-05-18T21:27:10.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.675+0000 7f67327c7700 1 -- 172.21.15.63:0/3622082333 wait complete. 2020-05-18T21:27:10.694 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:27:10.695 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:27:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.795+0000 7f7c3bfff700 1 Processor -- start 2020-05-18T21:27:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.795+0000 7f7c3bfff700 1 -- start start 2020-05-18T21:27:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c3c0b4760 0x7f7c3c0648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7c3c064d20 0x7f7c3c14d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3bfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3c14a330 con 0x7f7c3c05f110 2020-05-18T21:27:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3c14a140 con 0x7f7c3c064d20 2020-05-18T21:27:10.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3bfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c14a5d0 con 0x7f7c3c0b4760 2020-05-18T21:27:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3a7fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c3c0b4760 0x7f7c3c0648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3b7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7c3c064d20 0x7f7c3c14d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3a7fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c3c0b4760 0x7f7c3c0648c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:44116/0 (socket says 172.21.15.63:44116) 2020-05-18T21:27:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3a7fc700 1 -- 172.21.15.63:0/2855403646 learned_addr learned my addr 172.21.15.63:0/2855403646 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3a7fc700 1 -- 172.21.15.63:0/2855403646 >> v2:172.21.15.155:3300/0 conn(0x7f7c3c064d20 msgr2=0x7f7c3c14d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3a7fc700 1 --2- 172.21.15.63:0/2855403646 >> v2:172.21.15.155:3300/0 conn(0x7f7c3c064d20 0x7f7c3c14d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3a7fc700 1 -- 172.21.15.63:0/2855403646 >> v1:172.21.15.155:6789/0 conn(0x7f7c3c05f110 legacy=0x7f7c3c14aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3a7fc700 1 -- 172.21.15.63:0/2855403646 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c063430 con 0x7f7c3c0b4760 2020-05-18T21:27:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3a7fc700 1 --2- 172.21.15.63:0/2855403646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c3c0b4760 0x7f7c3c0648c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7c3c060a90 tx=0x7f7c30008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3a7fc700 1 --2- 172.21.15.63:0/2855403646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c3c0b4760 0x7f7c3c0648c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7c3c060a90 tx=0x7f7c30008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3a7fc700 1 --2- 172.21.15.63:0/2855403646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c3c0b4760 0x7f7c3c0648c0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f7c3c060a90 tx=0x7f7c30008920).ready entity=mon.2 client_cookie=6c721256385d0657 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3a7fc700 1 --2- 172.21.15.63:0/2855403646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c3c0b4760 0x7f7c3c0648c0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f7c3c060a90 tx=0x7f7c30008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c39ffb700 1 -- 172.21.15.63:0/2855403646 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c300116b0 con 0x7f7c3c0b4760 2020-05-18T21:27:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3a7fc700 1 --2- 172.21.15.63:0/2855403646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c3c0b4760 0x7f7c3c0648c0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f7c3c060a90 tx=0x7f7c30008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3a7fc700 1 --2- 172.21.15.63:0/2855403646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c3c0b4760 0x7f7c3c0648c0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f7c3c060a90 tx=0x7f7c30008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c39ffb700 1 -- 172.21.15.63:0/2855403646 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c30011810 con 0x7f7c3c0b4760 2020-05-18T21:27:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c39ffb700 1 -- 172.21.15.63:0/2855403646 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c30011c30 con 0x7f7c3c0b4760 2020-05-18T21:27:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3bfff700 1 -- 172.21.15.63:0/2855403646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c3c0b4760 msgr2=0x7f7c3c0648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3bfff700 1 --2- 172.21.15.63:0/2855403646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c3c0b4760 0x7f7c3c0648c0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f7c3c060a90 tx=0x7f7c30008920).stop 2020-05-18T21:27:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3bfff700 1 -- 172.21.15.63:0/2855403646 shutdown_connections 2020-05-18T21:27:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3bfff700 1 --2- 172.21.15.63:0/2855403646 >> v2:172.21.15.155:3300/0 conn(0x7f7c3c064d20 0x7f7c3c14d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3bfff700 1 --2- 172.21.15.63:0/2855403646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c3c0b4760 0x7f7c3c0648c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3bfff700 1 -- 172.21.15.63:0/2855403646 >> 172.21.15.63:0/2855403646 conn(0x7f7c3c069fc0 msgr2=0x7f7c3c06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:10.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3bfff700 1 -- 172.21.15.63:0/2855403646 shutdown_connections 2020-05-18T21:27:10.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.799+0000 7f7c3bfff700 1 -- 172.21.15.63:0/2855403646 wait complete. 2020-05-18T21:27:10.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.803+0000 7f7c3bfff700 1 Processor -- start 2020-05-18T21:27:10.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.803+0000 7f7c3bfff700 1 -- start start 2020-05-18T21:27:10.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c3c064d20 0x7f7c3c145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:10.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7c3c0b4760 0x7f7c3c0aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:10.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3bfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3c147ea0 con 0x7f7c3c05f110 2020-05-18T21:27:10.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3c145ca0 con 0x7f7c3c0b4760 2020-05-18T21:27:10.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3bfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c145f40 con 0x7f7c3c064d20 2020-05-18T21:27:10.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3a7fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c3c064d20 0x7f7c3c145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:10.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3b7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7c3c0b4760 0x7f7c3c0aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:10.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3a7fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c3c064d20 0x7f7c3c145720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:44124/0 (socket says 172.21.15.63:44124) 2020-05-18T21:27:10.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3a7fc700 1 -- 172.21.15.63:0/1381831311 learned_addr learned my addr 172.21.15.63:0/1381831311 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:10.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3b7fe700 1 -- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c3c064d20 msgr2=0x7f7c3c145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3b7fe700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c3c064d20 0x7f7c3c145720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c2bfff700 1 -- 172.21.15.63:0/1381831311 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738504852 0 0) 0x7f7c3c147ea0 con 0x7f7c3c05f110 2020-05-18T21:27:10.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3b7fe700 1 -- 172.21.15.63:0/1381831311 >> v1:172.21.15.155:6789/0 conn(0x7f7c3c05f110 legacy=0x7f7c3c143860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3b7fe700 1 -- 172.21.15.63:0/1381831311 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c1461e0 con 0x7f7c3c0b4760 2020-05-18T21:27:10.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3a7fc700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c3c064d20 0x7f7c3c145720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:10.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3b7fe700 1 --2- 172.21.15.63:0/1381831311 >> v2:172.21.15.155:3300/0 conn(0x7f7c3c0b4760 0x7f7c3c0aefe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c340032f0 tx=0x7f7c34010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3b7fe700 1 --2- 172.21.15.63:0/1381831311 >> v2:172.21.15.155:3300/0 conn(0x7f7c3c0b4760 0x7f7c3c0aefe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c340032f0 tx=0x7f7c34010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3b7fe700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c3c0b4760 0x7f7c3c0aefe0 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f7c340032f0 tx=0x7f7c34010f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:10.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3b7fe700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c3c0b4760 0x7f7c3c0aefe0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f7c340032f0 tx=0x7f7c34010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c2bfff700 1 -- 172.21.15.63:0/1381831311 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c3400ec30 con 0x7f7c3c0b4760 2020-05-18T21:27:10.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3b7fe700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c3c0b4760 0x7f7c3c0aefe0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f7c340032f0 tx=0x7f7c34010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3b7fe700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c3c0b4760 0x7f7c3c0aefe0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f7c340032f0 tx=0x7f7c34010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c2bfff700 1 -- 172.21.15.63:0/1381831311 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3400ed90 con 0x7f7c3c0b4760 2020-05-18T21:27:10.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3bfff700 1 -- 172.21.15.63:0/1381831311 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3c0af440 con 0x7f7c3c0b4760 2020-05-18T21:27:10.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c2bfff700 1 -- 172.21.15.63:0/1381831311 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c34011930 con 0x7f7c3c0b4760 2020-05-18T21:27:10.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3bfff700 1 -- 172.21.15.63:0/1381831311 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3c146820 con 0x7f7c3c0b4760 2020-05-18T21:27:10.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3b7fe700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c3c0b4760 0x7f7c3c0aefe0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f7c340032f0 tx=0x7f7c34010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.807+0000 7f7c3bfff700 1 -- 172.21.15.63:0/1381831311 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3c0569e0 con 0x7f7c3c0b4760 2020-05-18T21:27:10.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.811+0000 7f7c2bfff700 1 -- 172.21.15.63:0/1381831311 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7c34011ba0 con 0x7f7c3c0b4760 2020-05-18T21:27:10.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.811+0000 7f7c3b7fe700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c3c0b4760 0x7f7c3c0aefe0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f7c340032f0 tx=0x7f7c34010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.811+0000 7f7c2bfff700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c1804f940 0x7f7c18051e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:10.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.811+0000 7f7c2bfff700 1 -- 172.21.15.63:0/1381831311 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7c34063a50 con 0x7f7c3c0b4760 2020-05-18T21:27:10.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.811+0000 7f7c3affd700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c1804f940 0x7f7c18051e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:10.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.811+0000 7f7c3affd700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c1804f940 0x7f7c18051e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c2c0021b0 tx=0x7f7c2c002760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.811+0000 7f7c3affd700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c1804f940 0x7f7c18051e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c2c0021b0 tx=0x7f7c2c002760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.811+0000 7f7c3affd700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c1804f940 0x7f7c18051e00 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f7c2c0021b0 tx=0x7f7c2c002760).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:10.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.819+0000 7f7c3b7fe700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c3c0b4760 0x7f7c3c0aefe0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f7c340032f0 tx=0x7f7c34010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.819+0000 7f7c2bfff700 1 -- 172.21.15.63:0/1381831311 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f7c3403dd80 con 0x7f7c3c0b4760 2020-05-18T21:27:10.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.975+0000 7f7c3bfff700 1 -- 172.21.15.63:0/1381831311 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c3c0625f0 con 0x7f7c3c0b4760 2020-05-18T21:27:10.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.975+0000 7f7c3b7fe700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c3c0b4760 0x7f7c3c0aefe0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f7c340032f0 tx=0x7f7c34010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:10.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.975+0000 7f7c2bfff700 1 -- 172.21.15.63:0/1381831311 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2137 (secure 0 0 0) 0x7f7c340413a0 con 0x7f7c3c0b4760 2020-05-18T21:27:10.979 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:10.979 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4404,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2550679674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2550679674},{"type":"v1","addr":"172.21.15.155:6835","nonce":2550679674}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":7}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:26:45.491730+0000","modified":"2020-05-18T21:26:49.514812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4369},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4369":{"gid":4369,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.63:6833/2283817704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2283817704},{"type":"v1","addr":"172.21.15.63:6833","nonce":2283817704}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-05-18T21:27:10.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.979+0000 7f7c3bfff700 1 -- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c1804f940 msgr2=0x7f7c18051e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.979+0000 7f7c3bfff700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c1804f940 0x7f7c18051e00 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f7c2c0021b0 tx=0x7f7c2c002760).stop 2020-05-18T21:27:10.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.979+0000 7f7c3bfff700 1 -- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c3c0b4760 msgr2=0x7f7c3c0aefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:10.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.979+0000 7f7c3bfff700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c3c0b4760 0x7f7c3c0aefe0 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f7c340032f0 tx=0x7f7c34010f00).stop 2020-05-18T21:27:10.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.979+0000 7f7c3bfff700 1 -- 172.21.15.63:0/1381831311 shutdown_connections 2020-05-18T21:27:10.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.979+0000 7f7c3bfff700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c1804f940 0x7f7c18051e00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.979+0000 7f7c3bfff700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c3c0b4760 0x7f7c3c0aefe0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.979+0000 7f7c3bfff700 1 --2- 172.21.15.63:0/1381831311 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c3c064d20 0x7f7c3c145720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:10.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.979+0000 7f7c3bfff700 1 -- 172.21.15.63:0/1381831311 >> 172.21.15.63:0/1381831311 conn(0x7f7c3c069fc0 msgr2=0x7f7c3c0b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:10.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.979+0000 7f7c3bfff700 1 -- 172.21.15.63:0/1381831311 shutdown_connections 2020-05-18T21:27:10.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:10.979+0000 7f7c3bfff700 1 -- 172.21.15.63:0/1381831311 wait complete. 2020-05-18T21:27:10.984 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 7 2020-05-18T21:27:11.199 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:26:45.491730+0000', 'modified': '2020-05-18T21:26:49.514812+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4369}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4369': {'gid': 4369, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.63:6833/2283817704', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 2283817704}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 2283817704}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:27:11.199 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:27:11.200 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:27:11.305 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:27:11.306 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:27:11.306 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:27:11.306 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4369, 2020-05-18T21:27:11.306 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:27:11.307 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:27:11.307 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 22.784373484, 2020-05-18T21:27:11.307 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 6, 2020-05-18T21:27:11.307 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 23, 2020-05-18T21:27:11.307 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 23, 2020-05-18T21:27:11.308 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 23.478850132000002 2020-05-18T21:27:11.308 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:27:11.316 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 4369, "want_state": "up:active", "state": "up:active", "rank_uptime": 22.784373484, "mdsmap_epoch": 6, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "uptime": 23.478850132000002 } 2020-05-18T21:27:11.316 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:27:11.316 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2020-05-18T21:27:11.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.317 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:27:11.325 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:27:11.325 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:11.325 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:27:11.326 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:11.326 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:27:11.326 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:11.326 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:11.326 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:11.327 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:11.327 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:11.327 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:11.327 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:11.327 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:27:11.328 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:11.328 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:27:11.328 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42816sec preferred_lft 42816sec 2020-05-18T21:27:11.328 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:27:11.328 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:11.328 INFO:teuthology.orchestra.run.smithi155.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-05-18T21:27:11.329 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 82:8e:40:6f:e7:f8 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:11.329 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:27:11.329 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:11.329 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::98e1:75ff:fea3:ccae/64 scope link 2020-05-18T21:27:11.329 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:11.330 INFO:teuthology.orchestra.run.smithi155.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-05-18T21:27:11.330 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 82:8e:40:6f:e7:f8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2020-05-18T21:27:11.330 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::808e:40ff:fe6f:e7f8/64 scope link 2020-05-18T21:27:11.330 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:11.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.331 INFO:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:27:11.346 INFO:teuthology.orchestra.run.smithi155.stdout:1 2020-05-18T21:27:11.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.348 INFO:teuthology.orchestra.run.smithi155:> route 2020-05-18T21:27:11.357 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2020-05-18T21:27:11.357 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:27:11.358 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:27:11.358 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:27:11.358 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:27:11.358 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:27:11.358 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:27:11.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.359 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:27:11.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.375 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:27:11.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.437 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:27:11.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.455 INFO:teuthology.orchestra.run.smithi155:> ip netns list 2020-05-18T21:27:11.462 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 0) 2020-05-18T21:27:11.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.463 INFO:teuthology.orchestra.run.smithi155:> ip netns list-id 2020-05-18T21:27:11.469 INFO:teuthology.orchestra.run.smithi155.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.2) 2020-05-18T21:27:11.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.469 INFO:teuthology.orchestra.run.smithi155:> ip netns list-id 2020-05-18T21:27:11.516 INFO:teuthology.orchestra.run.smithi155.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.2) 2020-05-18T21:27:11.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.518 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3' 2020-05-18T21:27:11.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.538 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1' 2020-05-18T21:27:11.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.552 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr' 2020-05-18T21:27:11.613 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:27:11.614 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:11.614 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:27:11.614 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:11.614 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:27:11.614 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:11.615 INFO:teuthology.orchestra.run.smithi155.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-05-18T21:27:11.615 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether ee:68:f9:6e:72:e5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-05-18T21:27:11.615 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-05-18T21:27:11.615 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:11.615 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec68:f9ff:fe6e:72e5/64 scope link 2020-05-18T21:27:11.616 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:11.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.617 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr' 2020-05-18T21:27:11.631 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:27:11.632 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:11.632 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:27:11.632 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:11.632 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:27:11.633 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:11.633 INFO:teuthology.orchestra.run.smithi155.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-05-18T21:27:11.633 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether ee:68:f9:6e:72:e5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-05-18T21:27:11.633 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-05-18T21:27:11.633 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:11.634 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec68:f9ff:fe6e:72e5/64 scope link 2020-05-18T21:27:11.634 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:11.635 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2020-05-18T21:27:11.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.635 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1' 2020-05-18T21:27:11.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.650 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:27:11.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.715 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up' 2020-05-18T21:27:11.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.735 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up' 2020-05-18T21:27:11.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.753 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254' 2020-05-18T21:27:11.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.768 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip link set brx.1 up' 2020-05-18T21:27:11.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:11.827 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip link set dev brx.1 master ceph-brx' 2020-05-18T21:27:11.842 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2020-05-18T21:27:11.842 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.3 at ubuntu@smithi155.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3... 2020-05-18T21:27:11.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:11.843 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:27:11.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:11.849 INFO:teuthology.orchestra.run.smithi155:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:27:11.910 INFO:teuthology.orchestra.run.smithi155.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:27:11.911 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:27:11.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:11.912 INFO:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2020-05-18T21:27:11.919 INFO:teuthology.orchestra.run.smithi155.stdout:50 2020-05-18T21:27:11.919 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [50] 2020-05-18T21:27:11.919 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.3 /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:27:11.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:11.922 INFO:teuthology.orchestra.run.smithi155:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:27:11.935 INFO:teuthology.orchestra.run.smithi155.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:27:11.936 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:27:11.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:11.936 INFO:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2020-05-18T21:27:11.941 INFO:teuthology.orchestra.run.smithi155.stdout:50 2020-05-18T21:27:12.005 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi155.stderr:2020-05-18T21:27:12.001+0000 7fe8d6b2e080 -1 init, newargv = 0x563a02dc9530 newargc=9 2020-05-18T21:27:12.006 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi155.stderr:ceph-fuse[13840]: starting ceph client 2020-05-18T21:27:12.016 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi155.stderr:ceph-fuse[13840]: starting fuse 2020-05-18T21:27:13.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:13.043 INFO:teuthology.orchestra.run.smithi155:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:27:13.059 INFO:teuthology.orchestra.run.smithi155.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:27:13.060 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:27:13.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:13.061 INFO:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2020-05-18T21:27:13.066 INFO:teuthology.orchestra.run.smithi155.stdout:50 2020-05-18T21:27:13.066 INFO:teuthology.orchestra.run.smithi155.stdout:53 2020-05-18T21:27:13.067 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50, 53] 2020-05-18T21:27:13.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:13.067 INFO:teuthology.orchestra.run.smithi155:> sudo python3 -c ' 2020-05-18T21:27:13.068 INFO:teuthology.orchestra.run.smithi155:> import glob 2020-05-18T21:27:13.068 INFO:teuthology.orchestra.run.smithi155:> import re 2020-05-18T21:27:13.068 INFO:teuthology.orchestra.run.smithi155:> import os 2020-05-18T21:27:13.069 INFO:teuthology.orchestra.run.smithi155:> import subprocess 2020-05-18T21:27:13.069 INFO:teuthology.orchestra.run.smithi155:> 2020-05-18T21:27:13.069 INFO:teuthology.orchestra.run.smithi155:> def find_socket(client_name): 2020-05-18T21:27:13.070 INFO:teuthology.orchestra.run.smithi155:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2020-05-18T21:27:13.070 INFO:teuthology.orchestra.run.smithi155:> files = glob.glob(asok_path) 2020-05-18T21:27:13.070 INFO:teuthology.orchestra.run.smithi155:> 2020-05-18T21:27:13.071 INFO:teuthology.orchestra.run.smithi155:> # Given a non-glob path, it better be there 2020-05-18T21:27:13.071 INFO:teuthology.orchestra.run.smithi155:> if "*" not in asok_path: 2020-05-18T21:27:13.071 INFO:teuthology.orchestra.run.smithi155:> assert(len(files) == 1) 2020-05-18T21:27:13.072 INFO:teuthology.orchestra.run.smithi155:> return files[0] 2020-05-18T21:27:13.072 INFO:teuthology.orchestra.run.smithi155:> 2020-05-18T21:27:13.072 INFO:teuthology.orchestra.run.smithi155:> for f in files: 2020-05-18T21:27:13.072 INFO:teuthology.orchestra.run.smithi155:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:27:13.073 INFO:teuthology.orchestra.run.smithi155:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:27:13.073 INFO:teuthology.orchestra.run.smithi155:> return f 2020-05-18T21:27:13.073 INFO:teuthology.orchestra.run.smithi155:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:27:13.074 INFO:teuthology.orchestra.run.smithi155:> 2020-05-18T21:27:13.074 INFO:teuthology.orchestra.run.smithi155:> print(find_socket("client.3")) 2020-05-18T21:27:13.074 INFO:teuthology.orchestra.run.smithi155:> ' 2020-05-18T21:27:13.154 INFO:teuthology.orchestra.run.smithi155.stdout:/var/run/ceph/ceph-client.3.13840.asok 2020-05-18T21:27:13.160 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.13840.asok 2020-05-18T21:27:13.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:13.160 INFO:teuthology.orchestra.run.smithi155:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.13840.asok status 2020-05-18T21:27:13.247 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:27:13.248 INFO:teuthology.orchestra.run.smithi155.stdout: "metadata": { 2020-05-18T21:27:13.248 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:27:13.248 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:27:13.248 INFO:teuthology.orchestra.run.smithi155.stdout: "entity_id": "3", 2020-05-18T21:27:13.248 INFO:teuthology.orchestra.run.smithi155.stdout: "hostname": "smithi155", 2020-05-18T21:27:13.249 INFO:teuthology.orchestra.run.smithi155.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2020-05-18T21:27:13.249 INFO:teuthology.orchestra.run.smithi155.stdout: "pid": "13840", 2020-05-18T21:27:13.249 INFO:teuthology.orchestra.run.smithi155.stdout: "root": "/" 2020-05-18T21:27:13.249 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:27:13.249 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_count": 0, 2020-05-18T21:27:13.250 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_pinned_count": 0, 2020-05-18T21:27:13.250 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 4466, 2020-05-18T21:27:13.250 INFO:teuthology.orchestra.run.smithi155.stdout: "inst": { 2020-05-18T21:27:13.250 INFO:teuthology.orchestra.run.smithi155.stdout: "name": { 2020-05-18T21:27:13.250 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "client", 2020-05-18T21:27:13.251 INFO:teuthology.orchestra.run.smithi155.stdout: "num": 4466 2020-05-18T21:27:13.251 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:27:13.251 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2020-05-18T21:27:13.251 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2020-05-18T21:27:13.251 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.2:0", 2020-05-18T21:27:13.251 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 3002532771 2020-05-18T21:27:13.252 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:27:13.252 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:27:13.252 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2020-05-18T21:27:13.252 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2020-05-18T21:27:13.252 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.2:0", 2020-05-18T21:27:13.253 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 3002532771 2020-05-18T21:27:13.253 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:27:13.253 INFO:teuthology.orchestra.run.smithi155.stdout: "inst_str": "client.4466 192.168.0.2:0/3002532771", 2020-05-18T21:27:13.253 INFO:teuthology.orchestra.run.smithi155.stdout: "addr_str": "192.168.0.2:0/3002532771", 2020-05-18T21:27:13.253 INFO:teuthology.orchestra.run.smithi155.stdout: "inode_count": 1, 2020-05-18T21:27:13.254 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_epoch": 6, 2020-05-18T21:27:13.254 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch": 23, 2020-05-18T21:27:13.254 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:27:13.254 INFO:teuthology.orchestra.run.smithi155.stdout: "blacklisted": false 2020-05-18T21:27:13.254 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:27:13.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:13.256 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:27:13.256 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:27:13.265 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:27:13.266 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-05-18T21:27:13.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:13.267 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:27:13.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:13.286 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:27:13.287 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:27:13.294 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:27:13.295 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-05-18T21:27:13.296 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:13.296 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:27:13.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:13.363 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:27:13.363 INFO:teuthology.orchestra.run.smithi155:> ' -- /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:27:13.372 INFO:teuthology.orchestra.run.smithi155.stdout:fuseblk 2020-05-18T21:27:13.372 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2020-05-18T21:27:13.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:13.373 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:27:13.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:13.400 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:27:13.400 INFO:teuthology.orchestra.run.smithi155:> ' -- /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:27:13.449 INFO:teuthology.orchestra.run.smithi155.stdout:fuseblk 2020-05-18T21:27:13.450 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2020-05-18T21:27:13.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:13.451 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:27:13.477 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2020-05-18T21:27:13.497 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:27:13.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2ad3ec700 1 Processor -- start 2020-05-18T21:27:13.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2ad3ec700 1 -- start start 2020-05-18T21:27:13.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2ad3ec700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd2a8147d00 0x7fd2a805bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:13.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2ad3ec700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a8063a70 con 0x7fd2a814b020 2020-05-18T21:27:13.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2ad3ec700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a80b5c20 con 0x7fd2a8069eb0 2020-05-18T21:27:13.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2ad3ec700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a80b5ec0 con 0x7fd2a8147d00 2020-05-18T21:27:13.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2a67fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd2a8147d00 0x7fd2a805bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:13.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2a77fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd2a814b020 0x7fd2a8061d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55620/0 (socket says 172.21.15.63:55620) 2020-05-18T21:27:13.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2a67fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd2a8147d00 0x7fd2a805bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53428/0 (socket says 172.21.15.63:53428) 2020-05-18T21:27:13.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2a77fe700 1 -- 172.21.15.63:0/3376222159 learned_addr learned my addr 172.21.15.63:0/3376222159 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:13.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2a67fc700 1 -- 172.21.15.63:0/3376222159 >> v1:172.21.15.155:6789/0 conn(0x7fd2a8069eb0 legacy=0x7fd2a81475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:13.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2a67fc700 1 -- 172.21.15.63:0/3376222159 >> v1:172.21.15.63:6789/0 conn(0x7fd2a814b020 legacy=0x7fd2a8061d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:13.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2a5ffb700 1 -- 172.21.15.63:0/3376222159 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794159417 0 0) 0x7fd2a8063a70 con 0x7fd2a814b020 2020-05-18T21:27:13.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2a67fc700 1 -- 172.21.15.63:0/3376222159 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a806a290 con 0x7fd2a8147d00 2020-05-18T21:27:13.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2a67fc700 1 --2- 172.21.15.63:0/3376222159 >> v2:172.21.15.63:3300/0 conn(0x7fd2a8147d00 0x7fd2a805bc00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd2a814a5d0 tx=0x7fd298008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2a67fc700 1 --2- 172.21.15.63:0/3376222159 >> v2:172.21.15.63:3300/0 conn(0x7fd2a8147d00 0x7fd2a805bc00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd2a814a5d0 tx=0x7fd298008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2a67fc700 1 --2- 172.21.15.63:0/3376222159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a8147d00 0x7fd2a805bc00 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7fd2a814a5d0 tx=0x7fd298008ca0).ready entity=mon.0 client_cookie=58c1582197fdffd2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:13.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2a67fc700 1 --2- 172.21.15.63:0/3376222159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a8147d00 0x7fd2a805bc00 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7fd2a814a5d0 tx=0x7fd298008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2a5ffb700 1 -- 172.21.15.63:0/3376222159 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd29800a180 con 0x7fd2a8147d00 2020-05-18T21:27:13.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2a67fc700 1 --2- 172.21.15.63:0/3376222159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a8147d00 0x7fd2a805bc00 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7fd2a814a5d0 tx=0x7fd298008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2a67fc700 1 --2- 172.21.15.63:0/3376222159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a8147d00 0x7fd2a805bc00 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7fd2a814a5d0 tx=0x7fd298008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2a5ffb700 1 -- 172.21.15.63:0/3376222159 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29800a2e0 con 0x7fd2a8147d00 2020-05-18T21:27:13.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2a5ffb700 1 -- 172.21.15.63:0/3376222159 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd29800a700 con 0x7fd2a8147d00 2020-05-18T21:27:13.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2ad3ec700 1 -- 172.21.15.63:0/3376222159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a8147d00 msgr2=0x7fd2a805bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:13.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2ad3ec700 1 --2- 172.21.15.63:0/3376222159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a8147d00 0x7fd2a805bc00 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7fd2a814a5d0 tx=0x7fd298008ca0).stop 2020-05-18T21:27:13.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2ad3ec700 1 -- 172.21.15.63:0/3376222159 shutdown_connections 2020-05-18T21:27:13.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2ad3ec700 1 --2- 172.21.15.63:0/3376222159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a8147d00 0x7fd2a805bc00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:13.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.601+0000 7fd2ad3ec700 1 -- 172.21.15.63:0/3376222159 >> 172.21.15.63:0/3376222159 conn(0x7fd2a80b9700 msgr2=0x7fd2a80b9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:13.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.605+0000 7fd2ad3ec700 1 -- 172.21.15.63:0/3376222159 shutdown_connections 2020-05-18T21:27:13.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.605+0000 7fd2ad3ec700 1 -- 172.21.15.63:0/3376222159 wait complete. 2020-05-18T21:27:13.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.605+0000 7fd2ad3ec700 1 Processor -- start 2020-05-18T21:27:13.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.605+0000 7fd2ad3ec700 1 -- start start 2020-05-18T21:27:13.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.605+0000 7fd2ad3ec700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd2a8069eb0 0x7fd2a81424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:13.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.605+0000 7fd2ad3ec700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd2a8147d00 0x7fd2a8146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:13.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.605+0000 7fd2ad3ec700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a815bfd0 con 0x7fd2a814b020 2020-05-18T21:27:13.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.605+0000 7fd2ad3ec700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a815bd30 con 0x7fd2a8069eb0 2020-05-18T21:27:13.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.605+0000 7fd2ad3ec700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a8157c30 con 0x7fd2a8147d00 2020-05-18T21:27:13.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd2a6ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd2a8069eb0 0x7fd2a81424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:13.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd2a6ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd2a8069eb0 0x7fd2a81424a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53436/0 (socket says 172.21.15.63:53436) 2020-05-18T21:27:13.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd2a6ffd700 1 -- 172.21.15.63:0/2118255839 learned_addr learned my addr 172.21.15.63:0/2118255839 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:13.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd2a67fc700 1 --2- 172.21.15.63:0/2118255839 >> v2:172.21.15.155:3300/0 conn(0x7fd2a8147d00 0x7fd2a8146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:13.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd2a6ffd700 1 -- 172.21.15.63:0/2118255839 >> v2:172.21.15.155:3300/0 conn(0x7fd2a8147d00 msgr2=0x7fd2a8146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:13.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd2a6ffd700 1 --2- 172.21.15.63:0/2118255839 >> v2:172.21.15.155:3300/0 conn(0x7fd2a8147d00 0x7fd2a8146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:13.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd2a6ffd700 1 -- 172.21.15.63:0/2118255839 >> v1:172.21.15.155:6789/0 conn(0x7fd2a814b020 legacy=0x7fd2a81496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:13.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd2a6ffd700 1 -- 172.21.15.63:0/2118255839 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a8149dd0 con 0x7fd2a8069eb0 2020-05-18T21:27:13.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd2a6ffd700 1 --2- 172.21.15.63:0/2118255839 >> v2:172.21.15.63:3300/0 conn(0x7fd2a8069eb0 0x7fd2a81424a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2a8064500 tx=0x7fd2900013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd2a6ffd700 1 --2- 172.21.15.63:0/2118255839 >> v2:172.21.15.63:3300/0 conn(0x7fd2a8069eb0 0x7fd2a81424a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2a8064500 tx=0x7fd2900013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd2a6ffd700 1 --2- 172.21.15.63:0/2118255839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a8069eb0 0x7fd2a81424a0 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7fd2a8064500 tx=0x7fd2900013f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:13.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd2a6ffd700 1 --2- 172.21.15.63:0/2118255839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a8069eb0 0x7fd2a81424a0 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fd2a8064500 tx=0x7fd2900013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd2a6ffd700 1 --2- 172.21.15.63:0/2118255839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a8069eb0 0x7fd2a81424a0 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fd2a8064500 tx=0x7fd2900013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd2a6ffd700 1 --2- 172.21.15.63:0/2118255839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a8069eb0 0x7fd2a81424a0 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fd2a8064500 tx=0x7fd2900013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd29ffff700 1 -- 172.21.15.63:0/2118255839 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd29000cc60 con 0x7fd2a8069eb0 2020-05-18T21:27:13.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd29ffff700 1 -- 172.21.15.63:0/2118255839 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29000cdc0 con 0x7fd2a8069eb0 2020-05-18T21:27:13.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd29ffff700 1 -- 172.21.15.63:0/2118255839 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd290011160 con 0x7fd2a8069eb0 2020-05-18T21:27:13.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd2ad3ec700 1 -- 172.21.15.63:0/2118255839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a815b910 con 0x7fd2a8069eb0 2020-05-18T21:27:13.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd2ad3ec700 1 -- 172.21.15.63:0/2118255839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a8143cc0 con 0x7fd2a8069eb0 2020-05-18T21:27:13.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd2a6ffd700 1 --2- 172.21.15.63:0/2118255839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a8069eb0 0x7fd2a81424a0 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fd2a8064500 tx=0x7fd2900013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd2ad3ec700 1 -- 172.21.15.63:0/2118255839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a80569e0 con 0x7fd2a8069eb0 2020-05-18T21:27:13.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd29ffff700 1 -- 172.21.15.63:0/2118255839 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd290006520 con 0x7fd2a8069eb0 2020-05-18T21:27:13.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.609+0000 7fd2a6ffd700 1 --2- 172.21.15.63:0/2118255839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a8069eb0 0x7fd2a81424a0 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fd2a8064500 tx=0x7fd2900013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.613+0000 7fd29ffff700 1 --2- 172.21.15.63:0/2118255839 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd28004f9e0 0x7fd280051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:13.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.613+0000 7fd29ffff700 1 -- 172.21.15.63:0/2118255839 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd290063750 con 0x7fd2a8069eb0 2020-05-18T21:27:13.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.613+0000 7fd2a67fc700 1 --2- 172.21.15.63:0/2118255839 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd28004f9e0 0x7fd280051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:13.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.613+0000 7fd2a67fc700 1 --2- 172.21.15.63:0/2118255839 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd28004f9e0 0x7fd280051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2a814a5d0 tx=0x7fd2a806a420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.613+0000 7fd2a67fc700 1 --2- 172.21.15.63:0/2118255839 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd28004f9e0 0x7fd280051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2a814a5d0 tx=0x7fd2a806a420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.613+0000 7fd2a67fc700 1 --2- 172.21.15.63:0/2118255839 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd28004f9e0 0x7fd280051ea0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7fd2a814a5d0 tx=0x7fd2a806a420).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:13.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.617+0000 7fd2a6ffd700 1 --2- 172.21.15.63:0/2118255839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a8069eb0 0x7fd2a81424a0 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fd2a8064500 tx=0x7fd2900013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.617+0000 7fd29ffff700 1 -- 172.21.15.63:0/2118255839 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd29003dae0 con 0x7fd2a8069eb0 2020-05-18T21:27:13.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.733+0000 7fd2ad3ec700 1 -- 172.21.15.63:0/2118255839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2a806ac80 con 0x7fd2a8069eb0 2020-05-18T21:27:13.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.737+0000 7fd2a6ffd700 1 --2- 172.21.15.63:0/2118255839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a8069eb0 0x7fd2a81424a0 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fd2a8064500 tx=0x7fd2900013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.737+0000 7fd29ffff700 1 -- 172.21.15.63:0/2118255839 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fd290041100 con 0x7fd2a8069eb0 2020-05-18T21:27:13.743 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:13.744 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":23,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:26:47.498250+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:26:43.453504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-05-18T21:26:44.456531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:27:13.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.737+0000 7fd2ad3ec700 1 -- 172.21.15.63:0/2118255839 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd28004f9e0 msgr2=0x7fd280051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:13.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.737+0000 7fd2ad3ec700 1 --2- 172.21.15.63:0/2118255839 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd28004f9e0 0x7fd280051ea0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7fd2a814a5d0 tx=0x7fd2a806a420).stop 2020-05-18T21:27:13.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.737+0000 7fd2ad3ec700 1 -- 172.21.15.63:0/2118255839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a8069eb0 msgr2=0x7fd2a81424a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:13.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.737+0000 7fd2ad3ec700 1 --2- 172.21.15.63:0/2118255839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a8069eb0 0x7fd2a81424a0 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7fd2a8064500 tx=0x7fd2900013f0).stop 2020-05-18T21:27:13.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.737+0000 7fd2ad3ec700 1 -- 172.21.15.63:0/2118255839 shutdown_connections 2020-05-18T21:27:13.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.737+0000 7fd2ad3ec700 1 --2- 172.21.15.63:0/2118255839 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd28004f9e0 0x7fd280051ea0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:13.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.737+0000 7fd2ad3ec700 1 --2- 172.21.15.63:0/2118255839 >> v2:172.21.15.155:3300/0 conn(0x7fd2a8147d00 0x7fd2a8146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:13.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.737+0000 7fd2ad3ec700 1 --2- 172.21.15.63:0/2118255839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a8069eb0 0x7fd2a81424a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:13.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.737+0000 7fd2ad3ec700 1 -- 172.21.15.63:0/2118255839 >> 172.21.15.63:0/2118255839 conn(0x7fd2a80b9700 msgr2=0x7fd2a814a610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:13.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.737+0000 7fd2ad3ec700 1 -- 172.21.15.63:0/2118255839 shutdown_connections 2020-05-18T21:27:13.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.737+0000 7fd2ad3ec700 1 -- 172.21.15.63:0/2118255839 wait complete. 2020-05-18T21:27:13.756 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:26:43.453504+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:26:44.456531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:27:13.757 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:27:13.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f920cbee700 1 Processor -- start 2020-05-18T21:27:13.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f920cbee700 1 -- start start 2020-05-18T21:27:13.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f920cbee700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f9208060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:13.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f920cbee700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9208145e30 0x7f9208142f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:13.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f920cbee700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9208146420 con 0x7f9208143380 2020-05-18T21:27:13.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f920cbee700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9208146e00 con 0x7f9208145e30 2020-05-18T21:27:13.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f920cbee700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92081466c0 con 0x7f92080bc8d0 2020-05-18T21:27:13.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f9206ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9208145e30 0x7f9208142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:13.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f9206ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9208145e30 0x7f9208142f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53442/0 (socket says 172.21.15.63:53442) 2020-05-18T21:27:13.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f9206ffd700 1 -- 172.21.15.63:0/3618663617 learned_addr learned my addr 172.21.15.63:0/3618663617 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:13.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f92077fe700 1 --2- 172.21.15.63:0/3618663617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f9208060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:13.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f9206ffd700 1 -- 172.21.15.63:0/3618663617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 msgr2=0x7f9208060b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:13.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f9206ffd700 1 --2- 172.21.15.63:0/3618663617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f9208060b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:13.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f9206ffd700 1 -- 172.21.15.63:0/3618663617 >> v1:172.21.15.155:6789/0 conn(0x7f9208143380 legacy=0x7f920812e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:13.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f9206ffd700 1 -- 172.21.15.63:0/3618663617 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9208146960 con 0x7f9208145e30 2020-05-18T21:27:13.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f92077fe700 1 --2- 172.21.15.63:0/3618663617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f9208060b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:27:13.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f9206ffd700 1 --2- 172.21.15.63:0/3618663617 >> v2:172.21.15.63:3300/0 conn(0x7f9208145e30 0x7f9208142f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f91f00032f0 tx=0x7f9208061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f9206ffd700 1 --2- 172.21.15.63:0/3618663617 >> v2:172.21.15.63:3300/0 conn(0x7f9208145e30 0x7f9208142f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f91f00032f0 tx=0x7f9208061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f9206ffd700 1 --2- 172.21.15.63:0/3618663617 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9208145e30 0x7f9208142f20 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7f91f00032f0 tx=0x7f9208061d60).ready entity=mon.0 client_cookie=dc0e671e7af1dc87 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:13.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f9206ffd700 1 --2- 172.21.15.63:0/3618663617 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9208145e30 0x7f9208142f20 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f91f00032f0 tx=0x7f9208061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f9206ffd700 1 --2- 172.21.15.63:0/3618663617 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9208145e30 0x7f9208142f20 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f91f00032f0 tx=0x7f9208061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f92067fc700 1 -- 172.21.15.63:0/3618663617 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91f0011dc0 con 0x7f9208145e30 2020-05-18T21:27:13.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.865+0000 7f9206ffd700 1 --2- 172.21.15.63:0/3618663617 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9208145e30 0x7f9208142f20 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f91f00032f0 tx=0x7f9208061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.869+0000 7f92067fc700 1 -- 172.21.15.63:0/3618663617 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f000a180 con 0x7f9208145e30 2020-05-18T21:27:13.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.869+0000 7f92067fc700 1 -- 172.21.15.63:0/3618663617 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91f000a5a0 con 0x7f9208145e30 2020-05-18T21:27:13.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.869+0000 7f920cbee700 1 -- 172.21.15.63:0/3618663617 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9208145e30 msgr2=0x7f9208142f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:13.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.869+0000 7f920cbee700 1 --2- 172.21.15.63:0/3618663617 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9208145e30 0x7f9208142f20 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7f91f00032f0 tx=0x7f9208061d60).stop 2020-05-18T21:27:13.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.869+0000 7f920cbee700 1 -- 172.21.15.63:0/3618663617 shutdown_connections 2020-05-18T21:27:13.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.869+0000 7f920cbee700 1 --2- 172.21.15.63:0/3618663617 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9208145e30 0x7f9208142f20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:13.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.869+0000 7f920cbee700 1 --2- 172.21.15.63:0/3618663617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f9208060b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:13.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.869+0000 7f920cbee700 1 -- 172.21.15.63:0/3618663617 >> 172.21.15.63:0/3618663617 conn(0x7f920805f3b0 msgr2=0x7f920805f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:13.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.869+0000 7f920cbee700 1 -- 172.21.15.63:0/3618663617 shutdown_connections 2020-05-18T21:27:13.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.869+0000 7f920cbee700 1 -- 172.21.15.63:0/3618663617 wait complete. 2020-05-18T21:27:13.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.869+0000 7f920cbee700 1 Processor -- start 2020-05-18T21:27:13.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.869+0000 7f920cbee700 1 -- start start 2020-05-18T21:27:13.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.869+0000 7f920cbee700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f92080ad020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:13.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.869+0000 7f920cbee700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9208143380 0x7f92080b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:13.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.869+0000 7f920cbee700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92080ae910 con 0x7f9208145e30 2020-05-18T21:27:13.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.869+0000 7f920cbee700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92080af870 con 0x7f9208143380 2020-05-18T21:27:13.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.869+0000 7f920cbee700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92080b17a0 con 0x7f92080bc8d0 2020-05-18T21:27:13.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.869+0000 7f92077fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f92080ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:13.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f92077fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f92080ad020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:44150/0 (socket says 172.21.15.63:44150) 2020-05-18T21:27:13.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f92077fe700 1 -- 172.21.15.63:0/2612001605 learned_addr learned my addr 172.21.15.63:0/2612001605 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:13.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.869+0000 7f9206ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9208143380 0x7f92080b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:13.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f92077fe700 1 -- 172.21.15.63:0/2612001605 >> v2:172.21.15.155:3300/0 conn(0x7f9208143380 msgr2=0x7f92080b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:13.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f92077fe700 1 --2- 172.21.15.63:0/2612001605 >> v2:172.21.15.155:3300/0 conn(0x7f9208143380 0x7f92080b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:13.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f92077fe700 1 -- 172.21.15.63:0/2612001605 >> v1:172.21.15.155:6789/0 conn(0x7f9208145e30 legacy=0x7f92080ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:13.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f92077fe700 1 -- 172.21.15.63:0/2612001605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92080b1a40 con 0x7f92080bc8d0 2020-05-18T21:27:13.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f92077fe700 1 --2- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f92080ad020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f91f8007960 tx=0x7f91f8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f92077fe700 1 --2- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f92080ad020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f91f8007960 tx=0x7f91f8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f92077fe700 1 --2- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f92080ad020 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f91f8007960 tx=0x7f91f8010b90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:13.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f92077fe700 1 --2- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f92080ad020 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f91f8007960 tx=0x7f91f8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f92077fe700 1 --2- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f92080ad020 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f91f8007960 tx=0x7f91f8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f9204ff9700 1 -- 172.21.15.63:0/2612001605 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91f8007180 con 0x7f92080bc8d0 2020-05-18T21:27:13.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f92077fe700 1 --2- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f92080ad020 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f91f8007960 tx=0x7f91f8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f9204ff9700 1 -- 172.21.15.63:0/2612001605 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f80072e0 con 0x7f92080bc8d0 2020-05-18T21:27:13.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f920cbee700 1 -- 172.21.15.63:0/2612001605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92080b1d40 con 0x7f92080bc8d0 2020-05-18T21:27:13.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f9204ff9700 1 -- 172.21.15.63:0/2612001605 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91f800e220 con 0x7f92080bc8d0 2020-05-18T21:27:13.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f920cbee700 1 -- 172.21.15.63:0/2612001605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92080b2fb0 con 0x7f92080bc8d0 2020-05-18T21:27:13.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f92077fe700 1 --2- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f92080ad020 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f91f8007960 tx=0x7f91f8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f920cbee700 1 -- 172.21.15.63:0/2612001605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92080569e0 con 0x7f92080bc8d0 2020-05-18T21:27:13.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f92077fe700 1 --2- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f92080ad020 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f91f8007960 tx=0x7f91f8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.873+0000 7f9204ff9700 1 -- 172.21.15.63:0/2612001605 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f91f800e490 con 0x7f92080bc8d0 2020-05-18T21:27:13.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.877+0000 7f9204ff9700 1 --2- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f91e004fa30 0x7f91e0051ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:13.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.877+0000 7f9204ff9700 1 -- 172.21.15.63:0/2612001605 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f91f8063ce0 con 0x7f92080bc8d0 2020-05-18T21:27:13.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.877+0000 7f9206ffd700 1 --2- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f91e004fa30 0x7f91e0051ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:13.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.877+0000 7f9206ffd700 1 --2- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f91e004fa30 0x7f91e0051ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f91f00032f0 tx=0x7f9208061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.877+0000 7f9206ffd700 1 --2- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f91e004fa30 0x7f91e0051ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f91f00032f0 tx=0x7f9208061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.877+0000 7f9206ffd700 1 --2- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f91e004fa30 0x7f91e0051ef0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f91f00032f0 tx=0x7f9208061d60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:13.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.885+0000 7f92077fe700 1 --2- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f92080ad020 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f91f8007960 tx=0x7f91f8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:13.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:13.885+0000 7f9204ff9700 1 -- 172.21.15.63:0/2612001605 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f91f803dfd0 con 0x7f92080bc8d0 2020-05-18T21:27:14.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.005+0000 7f920cbee700 1 -- 172.21.15.63:0/2612001605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9208060b70 con 0x7f92080bc8d0 2020-05-18T21:27:14.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.005+0000 7f92077fe700 1 --2- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f92080ad020 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f91f8007960 tx=0x7f91f8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.005+0000 7f9204ff9700 1 -- 172.21.15.63:0/2612001605 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f91f80415f0 con 0x7f92080bc8d0 2020-05-18T21:27:14.012 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:27:14.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.005+0000 7f920cbee700 1 -- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f91e004fa30 msgr2=0x7f91e0051ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.005+0000 7f920cbee700 1 --2- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f91e004fa30 0x7f91e0051ef0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f91f00032f0 tx=0x7f9208061d60).stop 2020-05-18T21:27:14.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.005+0000 7f920cbee700 1 -- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 msgr2=0x7f92080ad020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.005+0000 7f920cbee700 1 --2- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f92080ad020 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f91f8007960 tx=0x7f91f8010b90).stop 2020-05-18T21:27:14.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.005+0000 7f920cbee700 1 -- 172.21.15.63:0/2612001605 shutdown_connections 2020-05-18T21:27:14.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.005+0000 7f920cbee700 1 --2- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f91e004fa30 0x7f91e0051ef0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:14.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.005+0000 7f920cbee700 1 --2- 172.21.15.63:0/2612001605 >> v2:172.21.15.155:3300/0 conn(0x7f9208143380 0x7f92080b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:14.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.005+0000 7f920cbee700 1 --2- 172.21.15.63:0/2612001605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92080bc8d0 0x7f92080ad020 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:14.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.005+0000 7f920cbee700 1 -- 172.21.15.63:0/2612001605 >> 172.21.15.63:0/2612001605 conn(0x7f920805f3b0 msgr2=0x7f9208148b30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:14.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.005+0000 7f920cbee700 1 -- 172.21.15.63:0/2612001605 shutdown_connections 2020-05-18T21:27:14.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.005+0000 7f920cbee700 1 -- 172.21.15.63:0/2612001605 wait complete. 2020-05-18T21:27:14.024 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:27:14.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.121+0000 7f791dc46700 1 Processor -- start 2020-05-18T21:27:14.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.121+0000 7f791dc46700 1 -- start start 2020-05-18T21:27:14.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.121+0000 7f791dc46700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f7918062f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:14.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.121+0000 7f791dc46700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79180637d0 con 0x7f791806a2f0 2020-05-18T21:27:14.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.121+0000 7f791dc46700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791806a780 con 0x7f7918061360 2020-05-18T21:27:14.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.121+0000 7f791dc46700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791814a0a0 con 0x7f7918062bb0 2020-05-18T21:27:14.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.121+0000 7f791d445700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f791806a2f0 0x7f79180b5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55646/0 (socket says 172.21.15.63:55646) 2020-05-18T21:27:14.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.121+0000 7f791d445700 1 -- 172.21.15.63:0/3607043475 learned_addr learned my addr 172.21.15.63:0/3607043475 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:14.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.121+0000 7f791cc44700 1 --2- 172.21.15.63:0/3607043475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f7918062f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f79177fe700 1 -- 172.21.15.63:0/3607043475 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3550738899 0 0) 0x7f79180637d0 con 0x7f791806a2f0 2020-05-18T21:27:14.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f79177fe700 1 -- 172.21.15.63:0/3607043475 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78fc003270 con 0x7f791806a2f0 2020-05-18T21:27:14.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f79177fe700 1 -- 172.21.15.63:0/3607043475 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274067422 0 0) 0x7f791806a780 con 0x7f7918061360 2020-05-18T21:27:14.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f79177fe700 1 -- 172.21.15.63:0/3607043475 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79180637d0 con 0x7f7918061360 2020-05-18T21:27:14.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f791cc44700 1 -- 172.21.15.63:0/3607043475 >> v1:172.21.15.155:6789/0 conn(0x7f7918061360 legacy=0x7f79180b6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f791cc44700 1 -- 172.21.15.63:0/3607043475 >> v1:172.21.15.63:6789/0 conn(0x7f791806a2f0 legacy=0x7f79180b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f791cc44700 1 -- 172.21.15.63:0/3607043475 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7918063530 con 0x7f7918062bb0 2020-05-18T21:27:14.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f791cc44700 1 --2- 172.21.15.63:0/3607043475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f7918062f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f790c002f70 tx=0x7f790c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f791cc44700 1 --2- 172.21.15.63:0/3607043475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f7918062f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f790c002f70 tx=0x7f790c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f791cc44700 1 --2- 172.21.15.63:0/3607043475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f7918062f90 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f790c002f70 tx=0x7f790c008920).ready entity=mon.2 client_cookie=15494c49a93a013b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:14.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f791cc44700 1 --2- 172.21.15.63:0/3607043475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f7918062f90 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f790c002f70 tx=0x7f790c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f79177fe700 1 -- 172.21.15.63:0/3607043475 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f790c008e80 con 0x7f7918062bb0 2020-05-18T21:27:14.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f791cc44700 1 --2- 172.21.15.63:0/3607043475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f7918062f90 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f790c002f70 tx=0x7f790c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f791cc44700 1 --2- 172.21.15.63:0/3607043475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f7918062f90 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f790c002f70 tx=0x7f790c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f79177fe700 1 -- 172.21.15.63:0/3607043475 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790c011580 con 0x7f7918062bb0 2020-05-18T21:27:14.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f79177fe700 1 -- 172.21.15.63:0/3607043475 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f790c011960 con 0x7f7918062bb0 2020-05-18T21:27:14.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f791dc46700 1 -- 172.21.15.63:0/3607043475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 msgr2=0x7f7918062f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f791dc46700 1 --2- 172.21.15.63:0/3607043475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f7918062f90 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f790c002f70 tx=0x7f790c008920).stop 2020-05-18T21:27:14.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f791dc46700 1 -- 172.21.15.63:0/3607043475 shutdown_connections 2020-05-18T21:27:14.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f791dc46700 1 --2- 172.21.15.63:0/3607043475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f7918062f90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:14.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f791dc46700 1 -- 172.21.15.63:0/3607043475 >> 172.21.15.63:0/3607043475 conn(0x7f791805fbd0 msgr2=0x7f7918069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:14.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f791dc46700 1 -- 172.21.15.63:0/3607043475 shutdown_connections 2020-05-18T21:27:14.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f791dc46700 1 -- 172.21.15.63:0/3607043475 wait complete. 2020-05-18T21:27:14.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f791dc46700 1 Processor -- start 2020-05-18T21:27:14.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.125+0000 7f791dc46700 1 -- start start 2020-05-18T21:27:14.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f791dc46700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f79180b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:14.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f791dc46700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79180b3ec0 con 0x7f7918061360 2020-05-18T21:27:14.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f791dc46700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79180b4160 con 0x7f791806a2f0 2020-05-18T21:27:14.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f791dc46700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791814cb50 con 0x7f7918062bb0 2020-05-18T21:27:14.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f791cc44700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7918061360 0x7f791814c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55650/0 (socket says 172.21.15.63:55650) 2020-05-18T21:27:14.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f791cc44700 1 -- 172.21.15.63:0/17467692 learned_addr learned my addr 172.21.15.63:0/17467692 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:14.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f7917fff700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f79180b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f7915ffb700 1 -- 172.21.15.63:0/17467692 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095195465 0 0) 0x7f79180b3ec0 con 0x7f7918061360 2020-05-18T21:27:14.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f7915ffb700 1 -- 172.21.15.63:0/17467692 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7900002fe0 con 0x7f7918061360 2020-05-18T21:27:14.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f7915ffb700 1 -- 172.21.15.63:0/17467692 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584110986 0 0) 0x7f79180b4160 con 0x7f791806a2f0 2020-05-18T21:27:14.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f7915ffb700 1 -- 172.21.15.63:0/17467692 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79180b3ec0 con 0x7f791806a2f0 2020-05-18T21:27:14.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f7917fff700 1 -- 172.21.15.63:0/17467692 >> v1:172.21.15.155:6789/0 conn(0x7f791806a2f0 legacy=0x7f79180af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f7917fff700 1 -- 172.21.15.63:0/17467692 >> v1:172.21.15.63:6789/0 conn(0x7f7918061360 legacy=0x7f791814c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f7915ffb700 1 -- 172.21.15.63:0/17467692 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1945569172 0 0) 0x7f7900002fe0 con 0x7f7918061360 2020-05-18T21:27:14.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f7917fff700 1 -- 172.21.15.63:0/17467692 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791814cc90 con 0x7f7918062bb0 2020-05-18T21:27:14.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f7917fff700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f79180b47a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f790c000bf0 tx=0x7f790400c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f7917fff700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f79180b47a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f790c000bf0 tx=0x7f790400c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f7917fff700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f79180b47a0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f790c000bf0 tx=0x7f790400c420).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:14.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f7917fff700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f79180b47a0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f790c000bf0 tx=0x7f790400c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f7915ffb700 1 -- 172.21.15.63:0/17467692 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f790c008e80 con 0x7f7918062bb0 2020-05-18T21:27:14.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f7917fff700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f79180b47a0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f790c000bf0 tx=0x7f790400c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f7915ffb700 1 -- 172.21.15.63:0/17467692 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790400ca70 con 0x7f7918062bb0 2020-05-18T21:27:14.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f7917fff700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f79180b47a0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f790c000bf0 tx=0x7f790400c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f7915ffb700 1 -- 172.21.15.63:0/17467692 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7904001090 con 0x7f7918062bb0 2020-05-18T21:27:14.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f791dc46700 1 -- 172.21.15.63:0/17467692 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791815aff0 con 0x7f7918062bb0 2020-05-18T21:27:14.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.129+0000 7f791dc46700 1 -- 172.21.15.63:0/17467692 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791815b440 con 0x7f7918062bb0 2020-05-18T21:27:14.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.133+0000 7f7917fff700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f79180b47a0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f790c000bf0 tx=0x7f790400c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.133+0000 7f791dc46700 1 -- 172.21.15.63:0/17467692 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79180569e0 con 0x7f7918062bb0 2020-05-18T21:27:14.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.133+0000 7f7915ffb700 1 -- 172.21.15.63:0/17467692 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7904006520 con 0x7f7918062bb0 2020-05-18T21:27:14.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.133+0000 7f7917fff700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f79180b47a0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f790c000bf0 tx=0x7f790400c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.133+0000 7f7915ffb700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f790004fe60 0x7f7900052320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:14.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.133+0000 7f7915ffb700 1 -- 172.21.15.63:0/17467692 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7904063470 con 0x7f7918062bb0 2020-05-18T21:27:14.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.133+0000 7f791cc44700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f790004fe60 0x7f7900052320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.133+0000 7f791cc44700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f790004fe60 0x7f7900052320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f790c008360 tx=0x7f790c011330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.133+0000 7f791cc44700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f790004fe60 0x7f7900052320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f790c008360 tx=0x7f790c011330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.133+0000 7f791cc44700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f790004fe60 0x7f7900052320 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f790c008360 tx=0x7f790c011330).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:14.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.141+0000 7f7917fff700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f79180b47a0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f790c000bf0 tx=0x7f790400c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.141+0000 7f7915ffb700 1 -- 172.21.15.63:0/17467692 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f790403d860 con 0x7f7918062bb0 2020-05-18T21:27:14.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.257+0000 7f791dc46700 1 -- 172.21.15.63:0/17467692 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f79180b44e0 con 0x7f7918062bb0 2020-05-18T21:27:14.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.261+0000 7f7917fff700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f79180b47a0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f790c000bf0 tx=0x7f790400c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.261+0000 7f7915ffb700 1 -- 172.21.15.63:0/17467692 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7904040e80 con 0x7f7918062bb0 2020-05-18T21:27:14.267 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:14.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.261+0000 7f791dc46700 1 -- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f790004fe60 msgr2=0x7f7900052320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.261+0000 7f791dc46700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f790004fe60 0x7f7900052320 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f790c008360 tx=0x7f790c011330).stop 2020-05-18T21:27:14.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.261+0000 7f791dc46700 1 -- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 msgr2=0x7f79180b47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.261+0000 7f791dc46700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f79180b47a0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f790c000bf0 tx=0x7f790400c420).stop 2020-05-18T21:27:14.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.261+0000 7f791dc46700 1 -- 172.21.15.63:0/17467692 shutdown_connections 2020-05-18T21:27:14.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.261+0000 7f791dc46700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f790004fe60 0x7f7900052320 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:14.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.261+0000 7f791dc46700 1 --2- 172.21.15.63:0/17467692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7918062bb0 0x7f79180b47a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:14.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.261+0000 7f791dc46700 1 -- 172.21.15.63:0/17467692 >> 172.21.15.63:0/17467692 conn(0x7f791805fbd0 msgr2=0x7f791809fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:14.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.261+0000 7f791dc46700 1 -- 172.21.15.63:0/17467692 shutdown_connections 2020-05-18T21:27:14.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.261+0000 7f791dc46700 1 -- 172.21.15.63:0/17467692 wait complete. 2020-05-18T21:27:14.286 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:27:14.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.385+0000 7f98c359e700 1 Processor -- start 2020-05-18T21:27:14.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.385+0000 7f98c359e700 1 -- start start 2020-05-18T21:27:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c359e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f98c40b4f40 0x7f98c4061180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c359e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c406a7d0 con 0x7f98c406a2c0 2020-05-18T21:27:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c40b2a10 con 0x7f98c40b2eb0 2020-05-18T21:27:14.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c359e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c40b5320 con 0x7f98c40b4f40 2020-05-18T21:27:14.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98bbfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f98c406a2c0 0x7f98c4132360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55660/0 (socket says 172.21.15.63:55660) 2020-05-18T21:27:14.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c259c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f98c40b4f40 0x7f98c4061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98bbfff700 1 -- 172.21.15.63:0/1062703769 learned_addr learned my addr 172.21.15.63:0/1062703769 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:14.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c1d9b700 1 -- 172.21.15.63:0/1062703769 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526457586 0 0) 0x7f98c406a7d0 con 0x7f98c406a2c0 2020-05-18T21:27:14.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c1d9b700 1 -- 172.21.15.63:0/1062703769 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98a8003270 con 0x7f98c406a2c0 2020-05-18T21:27:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c1d9b700 1 -- 172.21.15.63:0/1062703769 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593111088 0 0) 0x7f98c40b2a10 con 0x7f98c40b2eb0 2020-05-18T21:27:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c259c700 1 -- 172.21.15.63:0/1062703769 >> v1:172.21.15.155:6789/0 conn(0x7f98c40b2eb0 legacy=0x7f98c40b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c259c700 1 -- 172.21.15.63:0/1062703769 >> v1:172.21.15.63:6789/0 conn(0x7f98c406a2c0 legacy=0x7f98c4132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c259c700 1 -- 172.21.15.63:0/1062703769 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c41337f0 con 0x7f98c40b4f40 2020-05-18T21:27:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c259c700 1 --2- 172.21.15.63:0/1062703769 >> v2:172.21.15.63:3300/0 conn(0x7f98c40b4f40 0x7f98c4061180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f98b40018b0 tx=0x7f98ac008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c259c700 1 --2- 172.21.15.63:0/1062703769 >> v2:172.21.15.63:3300/0 conn(0x7f98c40b4f40 0x7f98c4061180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f98b40018b0 tx=0x7f98ac008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c259c700 1 --2- 172.21.15.63:0/1062703769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98c40b4f40 0x7f98c4061180 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7f98b40018b0 tx=0x7f98ac008920).ready entity=mon.0 client_cookie=3d30f33cbc9f48b3 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c259c700 1 --2- 172.21.15.63:0/1062703769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98c40b4f40 0x7f98c4061180 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f98b40018b0 tx=0x7f98ac008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c1d9b700 1 -- 172.21.15.63:0/1062703769 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98b4001710 con 0x7f98c40b4f40 2020-05-18T21:27:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c259c700 1 --2- 172.21.15.63:0/1062703769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98c40b4f40 0x7f98c4061180 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f98b40018b0 tx=0x7f98ac008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c259c700 1 --2- 172.21.15.63:0/1062703769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98c40b4f40 0x7f98c4061180 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f98b40018b0 tx=0x7f98ac008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c1d9b700 1 -- 172.21.15.63:0/1062703769 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac008c90 con 0x7f98c40b4f40 2020-05-18T21:27:14.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c1d9b700 1 -- 172.21.15.63:0/1062703769 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98ac011300 con 0x7f98c40b4f40 2020-05-18T21:27:14.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c359e700 1 -- 172.21.15.63:0/1062703769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98c40b4f40 msgr2=0x7f98c4061180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c359e700 1 --2- 172.21.15.63:0/1062703769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98c40b4f40 0x7f98c4061180 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7f98b40018b0 tx=0x7f98ac008920).stop 2020-05-18T21:27:14.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c359e700 1 -- 172.21.15.63:0/1062703769 shutdown_connections 2020-05-18T21:27:14.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c359e700 1 --2- 172.21.15.63:0/1062703769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98c40b4f40 0x7f98c4061180 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:14.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c359e700 1 -- 172.21.15.63:0/1062703769 >> 172.21.15.63:0/1062703769 conn(0x7f98c405fbd0 msgr2=0x7f98c4069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:14.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c359e700 1 -- 172.21.15.63:0/1062703769 shutdown_connections 2020-05-18T21:27:14.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.389+0000 7f98c359e700 1 -- 172.21.15.63:0/1062703769 wait complete. 2020-05-18T21:27:14.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.393+0000 7f98c359e700 1 Processor -- start 2020-05-18T21:27:14.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.393+0000 7f98c359e700 1 -- start start 2020-05-18T21:27:14.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c359e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f98c406a2c0 0x7f98c40b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:14.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c359e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f98c40b2eb0 0x7f98c40ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:14.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c359e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c41351f0 con 0x7f98c40b4f40 2020-05-18T21:27:14.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c359e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c40acc70 con 0x7f98c406a2c0 2020-05-18T21:27:14.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c359e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c41343a0 con 0x7f98c40b2eb0 2020-05-18T21:27:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c259c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f98c406a2c0 0x7f98c40b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c2d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f98c40b4f40 0x7f98c4134ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55668/0 (socket says 172.21.15.63:55668) 2020-05-18T21:27:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c2d9d700 1 -- 172.21.15.63:0/37614984 learned_addr learned my addr 172.21.15.63:0/37614984 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98bbfff700 1 --2- 172.21.15.63:0/37614984 >> v2:172.21.15.155:3300/0 conn(0x7f98c40b2eb0 0x7f98c40ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c259c700 1 -- 172.21.15.63:0/37614984 >> v2:172.21.15.155:3300/0 conn(0x7f98c40b2eb0 msgr2=0x7f98c40ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c259c700 1 --2- 172.21.15.63:0/37614984 >> v2:172.21.15.155:3300/0 conn(0x7f98c40b2eb0 0x7f98c40ac810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:14.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98bb7fe700 1 -- 172.21.15.63:0/37614984 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068182762 0 0) 0x7f98c41351f0 con 0x7f98c40b4f40 2020-05-18T21:27:14.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c259c700 1 -- 172.21.15.63:0/37614984 >> v1:172.21.15.63:6789/0 conn(0x7f98c40b4f40 legacy=0x7f98c4134ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c259c700 1 -- 172.21.15.63:0/37614984 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c4134640 con 0x7f98c406a2c0 2020-05-18T21:27:14.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98bbfff700 1 --2- 172.21.15.63:0/37614984 >> v2:172.21.15.155:3300/0 conn(0x7f98c40b2eb0 0x7f98c40ac810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:27:14.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c259c700 1 --2- 172.21.15.63:0/37614984 >> v2:172.21.15.63:3300/0 conn(0x7f98c406a2c0 0x7f98c40b0ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f98b40018b0 tx=0x7f98c41339e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c259c700 1 --2- 172.21.15.63:0/37614984 >> v2:172.21.15.63:3300/0 conn(0x7f98c406a2c0 0x7f98c40b0ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f98b40018b0 tx=0x7f98c41339e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c259c700 1 --2- 172.21.15.63:0/37614984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98c406a2c0 0x7f98c40b0ec0 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7f98b40018b0 tx=0x7f98c41339e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:14.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c259c700 1 --2- 172.21.15.63:0/37614984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98c406a2c0 0x7f98c40b0ec0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f98b40018b0 tx=0x7f98c41339e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98bb7fe700 1 -- 172.21.15.63:0/37614984 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98ac011e00 con 0x7f98c406a2c0 2020-05-18T21:27:14.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c259c700 1 --2- 172.21.15.63:0/37614984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98c406a2c0 0x7f98c40b0ec0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f98b40018b0 tx=0x7f98c41339e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c259c700 1 --2- 172.21.15.63:0/37614984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98c406a2c0 0x7f98c40b0ec0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f98b40018b0 tx=0x7f98c41339e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98bb7fe700 1 -- 172.21.15.63:0/37614984 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac00c370 con 0x7f98c406a2c0 2020-05-18T21:27:14.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c359e700 1 -- 172.21.15.63:0/37614984 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c4134090 con 0x7f98c406a2c0 2020-05-18T21:27:14.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98bb7fe700 1 -- 172.21.15.63:0/37614984 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98ac00c750 con 0x7f98c406a2c0 2020-05-18T21:27:14.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c359e700 1 -- 172.21.15.63:0/37614984 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c415b510 con 0x7f98c406a2c0 2020-05-18T21:27:14.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c259c700 1 --2- 172.21.15.63:0/37614984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98c406a2c0 0x7f98c40b0ec0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f98b40018b0 tx=0x7f98c41339e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98bb7fe700 1 -- 172.21.15.63:0/37614984 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f98ac00c9d0 con 0x7f98c406a2c0 2020-05-18T21:27:14.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c259c700 1 --2- 172.21.15.63:0/37614984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98c406a2c0 0x7f98c40b0ec0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f98b40018b0 tx=0x7f98c41339e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98bb7fe700 1 --2- 172.21.15.63:0/37614984 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f989c04f990 0x7f989c051e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:14.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98bb7fe700 1 -- 172.21.15.63:0/37614984 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f98ac0648d0 con 0x7f98c406a2c0 2020-05-18T21:27:14.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.397+0000 7f98c359e700 1 -- 172.21.15.63:0/37614984 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c415b820 con 0x7f98c406a2c0 2020-05-18T21:27:14.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.401+0000 7f98bbfff700 1 --2- 172.21.15.63:0/37614984 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f989c04f990 0x7f989c051e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.401+0000 7f98bbfff700 1 --2- 172.21.15.63:0/37614984 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f989c04f990 0x7f989c051e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f98b40014e0 tx=0x7f98b4001a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.401+0000 7f98bbfff700 1 --2- 172.21.15.63:0/37614984 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f989c04f990 0x7f989c051e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f98b40014e0 tx=0x7f98b4001a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.401+0000 7f98bbfff700 1 --2- 172.21.15.63:0/37614984 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f989c04f990 0x7f989c051e50 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f98b40014e0 tx=0x7f98b4001a90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:14.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.405+0000 7f98c259c700 1 --2- 172.21.15.63:0/37614984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98c406a2c0 0x7f98c40b0ec0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f98b40018b0 tx=0x7f98c41339e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.405+0000 7f98bb7fe700 1 -- 172.21.15.63:0/37614984 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f98ac03ed20 con 0x7f98c406a2c0 2020-05-18T21:27:14.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.517+0000 7f98c359e700 1 -- 172.21.15.63:0/37614984 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f98c40569e0 con 0x7f98c406a2c0 2020-05-18T21:27:14.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.517+0000 7f98c259c700 1 --2- 172.21.15.63:0/37614984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98c406a2c0 0x7f98c40b0ec0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f98b40018b0 tx=0x7f98c41339e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.517+0000 7f98bb7fe700 1 -- 172.21.15.63:0/37614984 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f98ac042340 con 0x7f98c406a2c0 2020-05-18T21:27:14.527 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:14.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.521+0000 7f98c359e700 1 -- 172.21.15.63:0/37614984 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f989c04f990 msgr2=0x7f989c051e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.521+0000 7f98c359e700 1 --2- 172.21.15.63:0/37614984 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f989c04f990 0x7f989c051e50 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f98b40014e0 tx=0x7f98b4001a90).stop 2020-05-18T21:27:14.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.521+0000 7f98c359e700 1 -- 172.21.15.63:0/37614984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98c406a2c0 msgr2=0x7f98c40b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.521+0000 7f98c359e700 1 --2- 172.21.15.63:0/37614984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98c406a2c0 0x7f98c40b0ec0 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7f98b40018b0 tx=0x7f98c41339e0).stop 2020-05-18T21:27:14.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.521+0000 7f98c359e700 1 -- 172.21.15.63:0/37614984 shutdown_connections 2020-05-18T21:27:14.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.521+0000 7f98c359e700 1 --2- 172.21.15.63:0/37614984 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f989c04f990 0x7f989c051e50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:14.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.521+0000 7f98c359e700 1 --2- 172.21.15.63:0/37614984 >> v2:172.21.15.155:3300/0 conn(0x7f98c40b2eb0 0x7f98c40ac810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:14.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.521+0000 7f98c359e700 1 --2- 172.21.15.63:0/37614984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98c406a2c0 0x7f98c40b0ec0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:14.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.521+0000 7f98c359e700 1 -- 172.21.15.63:0/37614984 >> 172.21.15.63:0/37614984 conn(0x7f98c405fbd0 msgr2=0x7f98c40b3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:14.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.521+0000 7f98c359e700 1 -- 172.21.15.63:0/37614984 shutdown_connections 2020-05-18T21:27:14.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.521+0000 7f98c359e700 1 -- 172.21.15.63:0/37614984 wait complete. 2020-05-18T21:27:14.538 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:27:14.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.641+0000 7f7661c9b700 1 Processor -- start 2020-05-18T21:27:14.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.641+0000 7f7661c9b700 1 -- start start 2020-05-18T21:27:14.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f7661c9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765c0b92c0 0x7f765c145e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:14.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f7661c9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f765c0b7b80 0x7f765c0b8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:14.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f7661c9b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765c0b71a0 con 0x7f765c0603c0 2020-05-18T21:27:14.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f7661c9b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765c0b7440 con 0x7f765c0b7b80 2020-05-18T21:27:14.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f7661c9b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c0b76e0 con 0x7f765c0b92c0 2020-05-18T21:27:14.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f765bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f765c0b7b80 0x7f765c0b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f766149a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f765c0603c0 0x7f765c12eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55676/0 (socket says 172.21.15.63:55676) 2020-05-18T21:27:14.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f766149a700 1 -- 172.21.15.63:0/2672955421 learned_addr learned my addr 172.21.15.63:0/2672955421 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:14.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f7660c99700 1 --2- 172.21.15.63:0/2672955421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765c0b92c0 0x7f765c145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f765bfff700 1 -- 172.21.15.63:0/2672955421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765c0b92c0 msgr2=0x7f765c145e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:14.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f765bfff700 1 --2- 172.21.15.63:0/2672955421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765c0b92c0 0x7f765c145e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:14.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f765bfff700 1 -- 172.21.15.63:0/2672955421 >> v1:172.21.15.63:6789/0 conn(0x7f765c0603c0 legacy=0x7f765c12eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f765b7fe700 1 -- 172.21.15.63:0/2672955421 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389937571 0 0) 0x7f765c0b71a0 con 0x7f765c0603c0 2020-05-18T21:27:14.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f765bfff700 1 -- 172.21.15.63:0/2672955421 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c061c90 con 0x7f765c0b7b80 2020-05-18T21:27:14.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f765bfff700 1 --2- 172.21.15.63:0/2672955421 >> v2:172.21.15.63:3300/0 conn(0x7f765c0b7b80 0x7f765c0b8000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7644002f70 tx=0x7f7644007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f765bfff700 1 --2- 172.21.15.63:0/2672955421 >> v2:172.21.15.63:3300/0 conn(0x7f765c0b7b80 0x7f765c0b8000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7644002f70 tx=0x7f7644007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f765bfff700 1 --2- 172.21.15.63:0/2672955421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f765c0b7b80 0x7f765c0b8000 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7f7644002f70 tx=0x7f7644007a80).ready entity=mon.0 client_cookie=25e907e7b468699a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:14.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f765bfff700 1 --2- 172.21.15.63:0/2672955421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f765c0b7b80 0x7f765c0b8000 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f7644002f70 tx=0x7f7644007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f765b7fe700 1 -- 172.21.15.63:0/2672955421 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7644008e80 con 0x7f765c0b7b80 2020-05-18T21:27:14.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f765bfff700 1 --2- 172.21.15.63:0/2672955421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f765c0b7b80 0x7f765c0b8000 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f7644002f70 tx=0x7f7644007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f765b7fe700 1 -- 172.21.15.63:0/2672955421 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76440115f0 con 0x7f765c0b7b80 2020-05-18T21:27:14.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f765bfff700 1 --2- 172.21.15.63:0/2672955421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f765c0b7b80 0x7f765c0b8000 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f7644002f70 tx=0x7f7644007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f765b7fe700 1 -- 172.21.15.63:0/2672955421 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76440119d0 con 0x7f765c0b7b80 2020-05-18T21:27:14.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f7661c9b700 1 -- 172.21.15.63:0/2672955421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f765c0b7b80 msgr2=0x7f765c0b8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f7661c9b700 1 --2- 172.21.15.63:0/2672955421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f765c0b7b80 0x7f765c0b8000 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7f7644002f70 tx=0x7f7644007a80).stop 2020-05-18T21:27:14.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f7661c9b700 1 -- 172.21.15.63:0/2672955421 shutdown_connections 2020-05-18T21:27:14.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f7661c9b700 1 --2- 172.21.15.63:0/2672955421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f765c0b7b80 0x7f765c0b8000 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:14.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f7661c9b700 1 --2- 172.21.15.63:0/2672955421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765c0b92c0 0x7f765c145e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:14.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f7661c9b700 1 -- 172.21.15.63:0/2672955421 >> 172.21.15.63:0/2672955421 conn(0x7f765c069b70 msgr2=0x7f765c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:14.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f7661c9b700 1 -- 172.21.15.63:0/2672955421 shutdown_connections 2020-05-18T21:27:14.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.645+0000 7f7661c9b700 1 -- 172.21.15.63:0/2672955421 wait complete. 2020-05-18T21:27:14.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7661c9b700 1 Processor -- start 2020-05-18T21:27:14.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7661c9b700 1 -- start start 2020-05-18T21:27:14.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7661c9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f765c0603c0 0x7f765c0b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:14.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7661c9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765c0b7b80 0x7f765c0aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:14.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7661c9b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765c0b33b0 con 0x7f765c0b92c0 2020-05-18T21:27:14.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7661c9b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765c0b2eb0 con 0x7f765c0603c0 2020-05-18T21:27:14.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7661c9b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c0b3110 con 0x7f765c0b7b80 2020-05-18T21:27:14.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f766149a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f765c0b92c0 0x7f765c12b2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55680/0 (socket says 172.21.15.63:55680) 2020-05-18T21:27:14.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f766149a700 1 -- 172.21.15.63:0/376772379 learned_addr learned my addr 172.21.15.63:0/376772379 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:14.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7659ffb700 1 -- 172.21.15.63:0/376772379 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557536301 0 0) 0x7f765c0b33b0 con 0x7f765c0b92c0 2020-05-18T21:27:14.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7659ffb700 1 -- 172.21.15.63:0/376772379 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7640002fe0 con 0x7f765c0b92c0 2020-05-18T21:27:14.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f765bfff700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765c0b7b80 0x7f765c0aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7660c99700 1 --2- 172.21.15.63:0/376772379 >> v2:172.21.15.155:3300/0 conn(0x7f765c0603c0 0x7f765c0b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7659ffb700 1 -- 172.21.15.63:0/376772379 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1420387797 0 0) 0x7f7640002fe0 con 0x7f765c0b92c0 2020-05-18T21:27:14.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7659ffb700 1 -- 172.21.15.63:0/376772379 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f765c0b33b0 con 0x7f765c0b92c0 2020-05-18T21:27:14.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7659ffb700 1 -- 172.21.15.63:0/376772379 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f7654001c20 con 0x7f765c0b92c0 2020-05-18T21:27:14.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7659ffb700 1 -- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765c0b7b80 msgr2=0x7f765c0aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7659ffb700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765c0b7b80 0x7f765c0aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:14.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7659ffb700 1 -- 172.21.15.63:0/376772379 >> v2:172.21.15.155:3300/0 conn(0x7f765c0603c0 msgr2=0x7f765c0b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7659ffb700 1 --2- 172.21.15.63:0/376772379 >> v2:172.21.15.155:3300/0 conn(0x7f765c0603c0 0x7f765c0b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:14.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7659ffb700 1 -- 172.21.15.63:0/376772379 >> v1:172.21.15.63:6789/0 conn(0x7f765c0b92c0 legacy=0x7f765c12b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7659ffb700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640004b50 0x7f7640004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:14.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7659ffb700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76400039a0 0x7f7640003e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:14.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7659ffb700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765c0b7b80 0x7f7640004380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:14.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7659ffb700 1 -- 172.21.15.63:0/376772379 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c0b2eb0 con 0x7f76400039a0 2020-05-18T21:27:14.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7659ffb700 1 -- 172.21.15.63:0/376772379 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c0b3110 con 0x7f7640004b50 2020-05-18T21:27:14.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7659ffb700 1 -- 172.21.15.63:0/376772379 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764000b760 con 0x7f765c0b7b80 2020-05-18T21:27:14.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f765bfff700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76400039a0 0x7f7640003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7660c99700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640004b50 0x7f7640004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f766149a700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765c0b7b80 0x7f7640004380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f765bfff700 1 -- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765c0b7b80 msgr2=0x7f7640004380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f765bfff700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765c0b7b80 0x7f7640004380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:14.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f765bfff700 1 -- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640004b50 msgr2=0x7f7640004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f765bfff700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640004b50 0x7f7640004f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:14.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f765bfff700 1 -- 172.21.15.63:0/376772379 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c0b1fd0 con 0x7f76400039a0 2020-05-18T21:27:14.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7660c99700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640004b50 0x7f7640004f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:27:14.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7661c9b700 1 -- 172.21.15.63:0/376772379 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765c0b2470 con 0x7f76400039a0 2020-05-18T21:27:14.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f765bfff700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76400039a0 0x7f7640003e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7644002f70 tx=0x7f7644007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f766149a700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765c0b7b80 0x7f7640004380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:27:14.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f765bfff700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76400039a0 0x7f7640003e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7644002f70 tx=0x7f7644007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7661c9b700 1 -- 172.21.15.63:0/376772379 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765c0aeab0 con 0x7f76400039a0 2020-05-18T21:27:14.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f765bfff700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76400039a0 0x7f7640003e20 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7f7644002f70 tx=0x7f7644007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:14.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f765bfff700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76400039a0 0x7f7640003e20 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7f7644002f70 tx=0x7f7644007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.649+0000 7f7659ffb700 1 -- 172.21.15.63:0/376772379 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7644007360 con 0x7f76400039a0 2020-05-18T21:27:14.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.653+0000 7f765bfff700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76400039a0 0x7f7640003e20 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7f7644002f70 tx=0x7f7644007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.653+0000 7f765bfff700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76400039a0 0x7f7640003e20 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7f7644002f70 tx=0x7f7644007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.653+0000 7f7659ffb700 1 -- 172.21.15.63:0/376772379 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76440074c0 con 0x7f76400039a0 2020-05-18T21:27:14.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.653+0000 7f7659ffb700 1 -- 172.21.15.63:0/376772379 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7644007630 con 0x7f76400039a0 2020-05-18T21:27:14.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.653+0000 7f765bfff700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76400039a0 0x7f7640003e20 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7f7644002f70 tx=0x7f7644007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.653+0000 7f7661c9b700 1 -- 172.21.15.63:0/376772379 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7634003380 con 0x7f76400039a0 2020-05-18T21:27:14.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.653+0000 7f7659ffb700 1 -- 172.21.15.63:0/376772379 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f76440058f0 con 0x7f76400039a0 2020-05-18T21:27:14.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.653+0000 7f765bfff700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76400039a0 0x7f7640003e20 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7f7644002f70 tx=0x7f7644007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.653+0000 7f7659ffb700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7640057e60 0x7f764005a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:14.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.653+0000 7f7659ffb700 1 -- 172.21.15.63:0/376772379 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f76440643d0 con 0x7f76400039a0 2020-05-18T21:27:14.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.653+0000 7f7660c99700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7640057e60 0x7f764005a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.653+0000 7f7660c99700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7640057e60 0x7f764005a320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f764c002f70 tx=0x7f764c00d3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.653+0000 7f7660c99700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7640057e60 0x7f764005a320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f764c002f70 tx=0x7f764c00d3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.653+0000 7f7660c99700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7640057e60 0x7f764005a320 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f764c002f70 tx=0x7f764c00d3a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:14.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.661+0000 7f765bfff700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76400039a0 0x7f7640003e20 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7f7644002f70 tx=0x7f7644007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.661+0000 7f7659ffb700 1 -- 172.21.15.63:0/376772379 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f764403e880 con 0x7f76400039a0 2020-05-18T21:27:14.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.773+0000 7f7661c9b700 1 -- 172.21.15.63:0/376772379 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7634002240 con 0x7f76400039a0 2020-05-18T21:27:14.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.773+0000 7f765bfff700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76400039a0 0x7f7640003e20 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7f7644002f70 tx=0x7f7644007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.773+0000 7f7659ffb700 1 -- 172.21.15.63:0/376772379 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7644041ea0 con 0x7f76400039a0 2020-05-18T21:27:14.781 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:14.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.777+0000 7f7661c9b700 1 -- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7640057e60 msgr2=0x7f764005a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.777+0000 7f7661c9b700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7640057e60 0x7f764005a320 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f764c002f70 tx=0x7f764c00d3a0).stop 2020-05-18T21:27:14.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.777+0000 7f766149a700 1 -- 172.21.15.63:0/376772379 reap_dead start 2020-05-18T21:27:14.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.777+0000 7f7661c9b700 1 -- 172.21.15.63:0/376772379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76400039a0 msgr2=0x7f7640003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.777+0000 7f7661c9b700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76400039a0 0x7f7640003e20 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7f7644002f70 tx=0x7f7644007a80).stop 2020-05-18T21:27:14.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.777+0000 7f7661c9b700 1 -- 172.21.15.63:0/376772379 shutdown_connections 2020-05-18T21:27:14.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.777+0000 7f7661c9b700 1 --2- 172.21.15.63:0/376772379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76400039a0 0x7f7640003e20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:14.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.777+0000 7f7661c9b700 1 -- 172.21.15.63:0/376772379 >> 172.21.15.63:0/376772379 conn(0x7f765c069b70 msgr2=0x7f765c0b4750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:14.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.777+0000 7f7661c9b700 1 -- 172.21.15.63:0/376772379 shutdown_connections 2020-05-18T21:27:14.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.777+0000 7f7661c9b700 1 -- 172.21.15.63:0/376772379 wait complete. 2020-05-18T21:27:14.794 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:27:14.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.885+0000 7f877580f700 1 Processor -- start 2020-05-18T21:27:14.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.885+0000 7f877580f700 1 -- start start 2020-05-18T21:27:14.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f877580f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87700b2860 0x7f87700615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:14.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f877580f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f877014e570 0x7f877014a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:14.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f877580f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877014d960 con 0x7f8770060b90 2020-05-18T21:27:14.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f877580f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8770066210 con 0x7f877014e570 2020-05-18T21:27:14.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f877580f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877014db90 con 0x7f87700b2860 2020-05-18T21:27:14.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f876f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f877014e570 0x7f877014a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f876f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f877014e570 0x7f877014a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53508/0 (socket says 172.21.15.63:53508) 2020-05-18T21:27:14.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f876f7fe700 1 -- 172.21.15.63:0/3279848670 learned_addr learned my addr 172.21.15.63:0/3279848670 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:14.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f876e7fc700 1 --2- 172.21.15.63:0/3279848670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87700b2860 0x7f87700615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f876f7fe700 1 -- 172.21.15.63:0/3279848670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87700b2860 msgr2=0x7f87700615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:14.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f876f7fe700 1 --2- 172.21.15.63:0/3279848670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87700b2860 0x7f87700615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:14.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f876f7fe700 1 -- 172.21.15.63:0/3279848670 >> v1:172.21.15.155:6789/0 conn(0x7f8770060b90 legacy=0x7f8770144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f876f7fe700 1 -- 172.21.15.63:0/3279848670 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877014de30 con 0x7f877014e570 2020-05-18T21:27:14.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f876f7fe700 1 --2- 172.21.15.63:0/3279848670 >> v2:172.21.15.63:3300/0 conn(0x7f877014e570 0x7f877014a390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f87680032f0 tx=0x7f8768007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f876f7fe700 1 --2- 172.21.15.63:0/3279848670 >> v2:172.21.15.63:3300/0 conn(0x7f877014e570 0x7f877014a390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f87680032f0 tx=0x7f8768007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f876f7fe700 1 --2- 172.21.15.63:0/3279848670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f877014e570 0x7f877014a390 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7f87680032f0 tx=0x7f8768007e00).ready entity=mon.0 client_cookie=f1e0dc2f7bafbe79 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:14.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f876f7fe700 1 --2- 172.21.15.63:0/3279848670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f877014e570 0x7f877014a390 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f87680032f0 tx=0x7f8768007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f876dffb700 1 -- 172.21.15.63:0/3279848670 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8768011d10 con 0x7f877014e570 2020-05-18T21:27:14.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f876f7fe700 1 --2- 172.21.15.63:0/3279848670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f877014e570 0x7f877014a390 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f87680032f0 tx=0x7f8768007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f876dffb700 1 -- 172.21.15.63:0/3279848670 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8768011e70 con 0x7f877014e570 2020-05-18T21:27:14.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f876f7fe700 1 --2- 172.21.15.63:0/3279848670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f877014e570 0x7f877014a390 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f87680032f0 tx=0x7f8768007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f876dffb700 1 -- 172.21.15.63:0/3279848670 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f876800a370 con 0x7f877014e570 2020-05-18T21:27:14.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f877580f700 1 -- 172.21.15.63:0/3279848670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f877014e570 msgr2=0x7f877014a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f877580f700 1 --2- 172.21.15.63:0/3279848670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f877014e570 0x7f877014a390 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7f87680032f0 tx=0x7f8768007e00).stop 2020-05-18T21:27:14.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f877580f700 1 -- 172.21.15.63:0/3279848670 shutdown_connections 2020-05-18T21:27:14.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f877580f700 1 --2- 172.21.15.63:0/3279848670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f877014e570 0x7f877014a390 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:14.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f877580f700 1 --2- 172.21.15.63:0/3279848670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87700b2860 0x7f87700615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:14.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f877580f700 1 -- 172.21.15.63:0/3279848670 >> 172.21.15.63:0/3279848670 conn(0x7f87700b83d0 msgr2=0x7f87700b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:14.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f877580f700 1 -- 172.21.15.63:0/3279848670 shutdown_connections 2020-05-18T21:27:14.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.889+0000 7f877580f700 1 -- 172.21.15.63:0/3279848670 wait complete. 2020-05-18T21:27:14.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.893+0000 7f877580f700 1 Processor -- start 2020-05-18T21:27:14.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.893+0000 7f877580f700 1 -- start start 2020-05-18T21:27:14.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.893+0000 7f877580f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f87700b2860 0x7f87700ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:14.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.893+0000 7f877580f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f877014e570 0x7f87700b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:14.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.893+0000 7f877580f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877014b360 con 0x7f8770060b90 2020-05-18T21:27:14.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.893+0000 7f877580f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87700b7a00 con 0x7f87700b2860 2020-05-18T21:27:14.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.893+0000 7f877580f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877014a510 con 0x7f877014e570 2020-05-18T21:27:14.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.893+0000 7f876e7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f87700b2860 0x7f87700ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.893+0000 7f876effd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8770060b90 0x7f877014ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55698/0 (socket says 172.21.15.63:55698) 2020-05-18T21:27:14.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.893+0000 7f876effd700 1 -- 172.21.15.63:0/3821415470 learned_addr learned my addr 172.21.15.63:0/3821415470 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:14.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.893+0000 7f876f7fe700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f877014e570 0x7f87700b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.893+0000 7f876e7fc700 1 -- 172.21.15.63:0/3821415470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f877014e570 msgr2=0x7f87700b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.893+0000 7f876e7fc700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f877014e570 0x7f87700b75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:14.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.893+0000 7f876e7fc700 1 -- 172.21.15.63:0/3821415470 >> v1:172.21.15.63:6789/0 conn(0x7f8770060b90 legacy=0x7f877014ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:14.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.893+0000 7f8767fff700 1 -- 172.21.15.63:0/3821415470 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822733498 0 0) 0x7f877014b360 con 0x7f8770060b90 2020-05-18T21:27:14.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.893+0000 7f876e7fc700 1 -- 172.21.15.63:0/3821415470 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877014a7b0 con 0x7f87700b2860 2020-05-18T21:27:14.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f876e7fc700 1 --2- 172.21.15.63:0/3821415470 >> v2:172.21.15.63:3300/0 conn(0x7f87700b2860 0x7f87700ac4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8758002f70 tx=0x7f8758010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f876e7fc700 1 --2- 172.21.15.63:0/3821415470 >> v2:172.21.15.63:3300/0 conn(0x7f87700b2860 0x7f87700ac4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8758002f70 tx=0x7f8758010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f876e7fc700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87700b2860 0x7f87700ac4d0 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7f8758002f70 tx=0x7f8758010be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:14.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f876e7fc700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87700b2860 0x7f87700ac4d0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f8758002f70 tx=0x7f8758010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f8767fff700 1 -- 172.21.15.63:0/3821415470 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8758007180 con 0x7f87700b2860 2020-05-18T21:27:14.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f876e7fc700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87700b2860 0x7f87700ac4d0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f8758002f70 tx=0x7f8758010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f8767fff700 1 -- 172.21.15.63:0/3821415470 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87580072e0 con 0x7f87700b2860 2020-05-18T21:27:14.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f877580f700 1 -- 172.21.15.63:0/3821415470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87700ad5b0 con 0x7f87700b2860 2020-05-18T21:27:14.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f876e7fc700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87700b2860 0x7f87700ac4d0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f8758002f70 tx=0x7f8758010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f8767fff700 1 -- 172.21.15.63:0/3821415470 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87580089b0 con 0x7f87700b2860 2020-05-18T21:27:14.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f877580f700 1 -- 172.21.15.63:0/3821415470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87700aeba0 con 0x7f87700b2860 2020-05-18T21:27:14.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f876e7fc700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87700b2860 0x7f87700ac4d0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f8758002f70 tx=0x7f8758010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f877580f700 1 -- 172.21.15.63:0/3821415470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87700569e0 con 0x7f87700b2860 2020-05-18T21:27:14.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f8767fff700 1 -- 172.21.15.63:0/3821415470 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8758008bb0 con 0x7f87700b2860 2020-05-18T21:27:14.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f876e7fc700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87700b2860 0x7f87700ac4d0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f8758002f70 tx=0x7f8758010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f8767fff700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f875404f8f0 0x7f8754051db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:14.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f8767fff700 1 -- 172.21.15.63:0/3821415470 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8758063dc0 con 0x7f87700b2860 2020-05-18T21:27:14.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f876effd700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f875404f8f0 0x7f8754051db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:14.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f876effd700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f875404f8f0 0x7f8754051db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f87600012a0 tx=0x7f8760001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f876effd700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f875404f8f0 0x7f8754051db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f87600012a0 tx=0x7f8760001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.897+0000 7f876effd700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f875404f8f0 0x7f8754051db0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f87600012a0 tx=0x7f8760001820).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:14.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.901+0000 7f876e7fc700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87700b2860 0x7f87700ac4d0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f8758002f70 tx=0x7f8758010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:14.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:14.905+0000 7f8767fff700 1 -- 172.21.15.63:0/3821415470 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f875803e0f0 con 0x7f87700b2860 2020-05-18T21:27:15.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.021+0000 7f877580f700 1 -- 172.21.15.63:0/3821415470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87700b4060 con 0x7f87700b2860 2020-05-18T21:27:15.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.021+0000 7f876e7fc700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87700b2860 0x7f87700ac4d0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f8758002f70 tx=0x7f8758010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.025+0000 7f8767fff700 1 -- 172.21.15.63:0/3821415470 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f8758041710 con 0x7f87700b2860 2020-05-18T21:27:15.031 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:15.031 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":23,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:26:47.498250+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:26:43.453504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-05-18T21:26:44.456531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:27:15.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.025+0000 7f877580f700 1 -- 172.21.15.63:0/3821415470 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f875404f8f0 msgr2=0x7f8754051db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.025+0000 7f877580f700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f875404f8f0 0x7f8754051db0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f87600012a0 tx=0x7f8760001820).stop 2020-05-18T21:27:15.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.025+0000 7f877580f700 1 -- 172.21.15.63:0/3821415470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87700b2860 msgr2=0x7f87700ac4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.025+0000 7f877580f700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87700b2860 0x7f87700ac4d0 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7f8758002f70 tx=0x7f8758010be0).stop 2020-05-18T21:27:15.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.025+0000 7f877580f700 1 -- 172.21.15.63:0/3821415470 shutdown_connections 2020-05-18T21:27:15.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.025+0000 7f877580f700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f875404f8f0 0x7f8754051db0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.025+0000 7f877580f700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f877014e570 0x7f87700b75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.025+0000 7f877580f700 1 --2- 172.21.15.63:0/3821415470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87700b2860 0x7f87700ac4d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.025+0000 7f877580f700 1 -- 172.21.15.63:0/3821415470 >> 172.21.15.63:0/3821415470 conn(0x7f87700b83d0 msgr2=0x7f87700b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:15.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.025+0000 7f877580f700 1 -- 172.21.15.63:0/3821415470 shutdown_connections 2020-05-18T21:27:15.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.025+0000 7f877580f700 1 -- 172.21.15.63:0/3821415470 wait complete. 2020-05-18T21:27:15.043 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:26:43.453504+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:26:44.456531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:27:15.044 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:27:15.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d3fff700 1 Processor -- start 2020-05-18T21:27:15.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d3fff700 1 -- start start 2020-05-18T21:27:15.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d3fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 0x7ff4d40b5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:15.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff4d4146a00 0x7ff4d40b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:15.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d3fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d4149630 con 0x7ff4d41465a0 2020-05-18T21:27:15.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d3fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d4145e60 con 0x7ff4d4146a00 2020-05-18T21:27:15.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d3fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d4146100 con 0x7ff4d40b4f60 2020-05-18T21:27:15.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d27fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff4d41465a0 0x7ff4d412b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55706/0 (socket says 172.21.15.63:55706) 2020-05-18T21:27:15.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d27fc700 1 -- 172.21.15.63:0/2428889305 learned_addr learned my addr 172.21.15.63:0/2428889305 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:15.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d2ffd700 1 --2- 172.21.15.63:0/2428889305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 0x7ff4d40b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d37fe700 1 --2- 172.21.15.63:0/2428889305 >> v2:172.21.15.155:3300/0 conn(0x7ff4d4146a00 0x7ff4d40b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d1ffb700 1 -- 172.21.15.63:0/2428889305 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753074696 0 0) 0x7ff4d4149630 con 0x7ff4d41465a0 2020-05-18T21:27:15.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d1ffb700 1 -- 172.21.15.63:0/2428889305 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4b8003270 con 0x7ff4d41465a0 2020-05-18T21:27:15.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d37fe700 1 -- 172.21.15.63:0/2428889305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 msgr2=0x7ff4d40b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:15.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d37fe700 1 --2- 172.21.15.63:0/2428889305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 0x7ff4d40b5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:15.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d37fe700 1 -- 172.21.15.63:0/2428889305 >> v1:172.21.15.63:6789/0 conn(0x7ff4d41465a0 legacy=0x7ff4d412b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d1ffb700 1 -- 172.21.15.63:0/2428889305 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2217070438 0 0) 0x7ff4b8003270 con 0x7ff4d41465a0 2020-05-18T21:27:15.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d37fe700 1 -- 172.21.15.63:0/2428889305 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d40b5340 con 0x7ff4d4146a00 2020-05-18T21:27:15.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d2ffd700 1 --2- 172.21.15.63:0/2428889305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 0x7ff4d40b5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:15.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d37fe700 1 --2- 172.21.15.63:0/2428889305 >> v2:172.21.15.155:3300/0 conn(0x7ff4d4146a00 0x7ff4d40b2890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff4cc002f70 tx=0x7ff4cc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d37fe700 1 --2- 172.21.15.63:0/2428889305 >> v2:172.21.15.155:3300/0 conn(0x7ff4d4146a00 0x7ff4d40b2890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff4cc002f70 tx=0x7ff4cc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.145+0000 7ff4d37fe700 1 --2- 172.21.15.63:0/2428889305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4d4146a00 0x7ff4d40b2890 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7ff4cc002f70 tx=0x7ff4cc007a80).ready entity=mon.1 client_cookie=4de68dcfff37c4a1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:15.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.149+0000 7ff4d37fe700 1 --2- 172.21.15.63:0/2428889305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4d4146a00 0x7ff4d40b2890 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7ff4cc002f70 tx=0x7ff4cc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.149+0000 7ff4d1ffb700 1 -- 172.21.15.63:0/2428889305 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4cc011540 con 0x7ff4d4146a00 2020-05-18T21:27:15.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.149+0000 7ff4d37fe700 1 --2- 172.21.15.63:0/2428889305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4d4146a00 0x7ff4d40b2890 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7ff4cc002f70 tx=0x7ff4cc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.149+0000 7ff4d1ffb700 1 -- 172.21.15.63:0/2428889305 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4cc0116a0 con 0x7ff4d4146a00 2020-05-18T21:27:15.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.149+0000 7ff4d3fff700 1 -- 172.21.15.63:0/2428889305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4d4146a00 msgr2=0x7ff4d40b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.149+0000 7ff4d37fe700 1 --2- 172.21.15.63:0/2428889305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4d4146a00 0x7ff4d40b2890 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7ff4cc002f70 tx=0x7ff4cc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.149+0000 7ff4d1ffb700 1 -- 172.21.15.63:0/2428889305 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4cc011a00 con 0x7ff4d4146a00 2020-05-18T21:27:15.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.149+0000 7ff4d3fff700 1 --2- 172.21.15.63:0/2428889305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4d4146a00 0x7ff4d40b2890 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7ff4cc002f70 tx=0x7ff4cc007a80).stop 2020-05-18T21:27:15.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.149+0000 7ff4d3fff700 1 -- 172.21.15.63:0/2428889305 shutdown_connections 2020-05-18T21:27:15.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.149+0000 7ff4d3fff700 1 --2- 172.21.15.63:0/2428889305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4d4146a00 0x7ff4d40b2890 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.149+0000 7ff4d3fff700 1 --2- 172.21.15.63:0/2428889305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 0x7ff4d40b5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:15.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.149+0000 7ff4d3fff700 1 -- 172.21.15.63:0/2428889305 >> 172.21.15.63:0/2428889305 conn(0x7ff4d405fbd0 msgr2=0x7ff4d4069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:15.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.149+0000 7ff4d3fff700 1 -- 172.21.15.63:0/2428889305 shutdown_connections 2020-05-18T21:27:15.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.149+0000 7ff4d3fff700 1 -- 172.21.15.63:0/2428889305 wait complete. 2020-05-18T21:27:15.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.149+0000 7ff4d3fff700 1 Processor -- start 2020-05-18T21:27:15.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.149+0000 7ff4d3fff700 1 -- start start 2020-05-18T21:27:15.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d3fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 0x7ff4d40acf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:15.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff4d41465a0 0x7ff4d4148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:15.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d3fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d4148bc0 con 0x7ff4d4146a00 2020-05-18T21:27:15.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d3fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d4153ce0 con 0x7ff4d41465a0 2020-05-18T21:27:15.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d3fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40b0980 con 0x7ff4d40b4f60 2020-05-18T21:27:15.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d37fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff4d4146a00 0x7ff4d41535d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55716/0 (socket says 172.21.15.63:55716) 2020-05-18T21:27:15.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d37fe700 1 -- 172.21.15.63:0/2017086776 learned_addr learned my addr 172.21.15.63:0/2017086776 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:15.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d2ffd700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 0x7ff4d40acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d27fc700 1 --2- 172.21.15.63:0/2017086776 >> v2:172.21.15.155:3300/0 conn(0x7ff4d41465a0 0x7ff4d4148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4cbfff700 1 -- 172.21.15.63:0/2017086776 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407746458 0 0) 0x7ff4d4148bc0 con 0x7ff4d4146a00 2020-05-18T21:27:15.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4cbfff700 1 -- 172.21.15.63:0/2017086776 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4ac002fe0 con 0x7ff4d4146a00 2020-05-18T21:27:15.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d2ffd700 1 -- 172.21.15.63:0/2017086776 >> v2:172.21.15.155:3300/0 conn(0x7ff4d41465a0 msgr2=0x7ff4d4148760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d2ffd700 1 --2- 172.21.15.63:0/2017086776 >> v2:172.21.15.155:3300/0 conn(0x7ff4d41465a0 0x7ff4d4148760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d2ffd700 1 -- 172.21.15.63:0/2017086776 >> v1:172.21.15.63:6789/0 conn(0x7ff4d4146a00 legacy=0x7ff4d41535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d2ffd700 1 -- 172.21.15.63:0/2017086776 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d40ae670 con 0x7ff4d40b4f60 2020-05-18T21:27:15.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d2ffd700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 0x7ff4d40acf50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4cc008780 tx=0x7ff4c4011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d2ffd700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 0x7ff4d40acf50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4cc008780 tx=0x7ff4c4011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d2ffd700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 0x7ff4d40acf50 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7ff4cc008780 tx=0x7ff4c4011130).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:15.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d2ffd700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 0x7ff4d40acf50 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7ff4cc008780 tx=0x7ff4c4011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4cbfff700 1 -- 172.21.15.63:0/2017086776 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4cc008620 con 0x7ff4d40b4f60 2020-05-18T21:27:15.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d2ffd700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 0x7ff4d40acf50 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7ff4cc008780 tx=0x7ff4c4011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4cbfff700 1 -- 172.21.15.63:0/2017086776 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c4008720 con 0x7ff4d40b4f60 2020-05-18T21:27:15.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d2ffd700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 0x7ff4d40acf50 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7ff4cc008780 tx=0x7ff4c4011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d3fff700 1 -- 172.21.15.63:0/2017086776 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d40ae910 con 0x7ff4d40b4f60 2020-05-18T21:27:15.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4cbfff700 1 -- 172.21.15.63:0/2017086776 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4c4008a80 con 0x7ff4d40b4f60 2020-05-18T21:27:15.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d3fff700 1 -- 172.21.15.63:0/2017086776 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d40ae080 con 0x7ff4d40b4f60 2020-05-18T21:27:15.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.153+0000 7ff4d2ffd700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 0x7ff4d40acf50 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7ff4cc008780 tx=0x7ff4c4011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.157+0000 7ff4d3fff700 1 -- 172.21.15.63:0/2017086776 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d40569e0 con 0x7ff4d40b4f60 2020-05-18T21:27:15.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.157+0000 7ff4cbfff700 1 -- 172.21.15.63:0/2017086776 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff4c4008c80 con 0x7ff4d40b4f60 2020-05-18T21:27:15.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.157+0000 7ff4d2ffd700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 0x7ff4d40acf50 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7ff4cc008780 tx=0x7ff4c4011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.157+0000 7ff4cbfff700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff4ac04fd80 0x7ff4ac052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:15.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.157+0000 7ff4cbfff700 1 -- 172.21.15.63:0/2017086776 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff4c4063a80 con 0x7ff4d40b4f60 2020-05-18T21:27:15.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.157+0000 7ff4d27fc700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff4ac04fd80 0x7ff4ac052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.157+0000 7ff4d27fc700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff4ac04fd80 0x7ff4ac052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4bc000bc0 tx=0x7ff4bc0013b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.157+0000 7ff4d27fc700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff4ac04fd80 0x7ff4ac052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4bc000bc0 tx=0x7ff4bc0013b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.157+0000 7ff4d27fc700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff4ac04fd80 0x7ff4ac052240 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7ff4bc000bc0 tx=0x7ff4bc0013b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:15.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.165+0000 7ff4d2ffd700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 0x7ff4d40acf50 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7ff4cc008780 tx=0x7ff4c4011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.165+0000 7ff4cbfff700 1 -- 172.21.15.63:0/2017086776 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff4c403ddb0 con 0x7ff4d40b4f60 2020-05-18T21:27:15.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.281+0000 7ff4d3fff700 1 -- 172.21.15.63:0/2017086776 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff4d4067b40 con 0x7ff4d40b4f60 2020-05-18T21:27:15.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.281+0000 7ff4d2ffd700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 0x7ff4d40acf50 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7ff4cc008780 tx=0x7ff4c4011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.281+0000 7ff4cbfff700 1 -- 172.21.15.63:0/2017086776 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff4c40413d0 con 0x7ff4d40b4f60 2020-05-18T21:27:15.291 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:27:15.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.285+0000 7ff4d3fff700 1 -- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff4ac04fd80 msgr2=0x7ff4ac052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.285+0000 7ff4d3fff700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff4ac04fd80 0x7ff4ac052240 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7ff4bc000bc0 tx=0x7ff4bc0013b0).stop 2020-05-18T21:27:15.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.285+0000 7ff4d3fff700 1 -- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 msgr2=0x7ff4d40acf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.285+0000 7ff4d3fff700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 0x7ff4d40acf50 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7ff4cc008780 tx=0x7ff4c4011130).stop 2020-05-18T21:27:15.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.285+0000 7ff4d3fff700 1 -- 172.21.15.63:0/2017086776 shutdown_connections 2020-05-18T21:27:15.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.285+0000 7ff4d3fff700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff4ac04fd80 0x7ff4ac052240 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.285+0000 7ff4d3fff700 1 --2- 172.21.15.63:0/2017086776 >> v2:172.21.15.155:3300/0 conn(0x7ff4d41465a0 0x7ff4d4148760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.285+0000 7ff4d3fff700 1 --2- 172.21.15.63:0/2017086776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4d40b4f60 0x7ff4d40acf50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.285+0000 7ff4d3fff700 1 -- 172.21.15.63:0/2017086776 >> 172.21.15.63:0/2017086776 conn(0x7ff4d405fbd0 msgr2=0x7ff4d40b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:15.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.285+0000 7ff4d3fff700 1 -- 172.21.15.63:0/2017086776 shutdown_connections 2020-05-18T21:27:15.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.285+0000 7ff4d3fff700 1 -- 172.21.15.63:0/2017086776 wait complete. 2020-05-18T21:27:15.302 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:27:15.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcac5119700 1 Processor -- start 2020-05-18T21:27:15.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcac5119700 1 -- start start 2020-05-18T21:27:15.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcac5119700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcac00b58e0 0x7fcac005ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:15.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcac5119700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcac0149990 0x7fcac0149e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:15.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcac5119700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac005ff60 con 0x7fcac00b49b0 2020-05-18T21:27:15.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcac5119700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac00655f0 con 0x7fcac00b58e0 2020-05-18T21:27:15.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcac5119700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac0065890 con 0x7fcac0149990 2020-05-18T21:27:15.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcabed9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcac00b58e0 0x7fcac005ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcabe59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcac00b49b0 0x7fcac00640e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55722/0 (socket says 172.21.15.63:55722) 2020-05-18T21:27:15.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcabe59c700 1 -- 172.21.15.63:0/3198149235 learned_addr learned my addr 172.21.15.63:0/3198149235 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:15.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcabf59e700 1 --2- 172.21.15.63:0/3198149235 >> v2:172.21.15.155:3300/0 conn(0x7fcac0149990 0x7fcac0149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcabdd9b700 1 -- 172.21.15.63:0/3198149235 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318825246 0 0) 0x7fcac005ff60 con 0x7fcac00b49b0 2020-05-18T21:27:15.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcabdd9b700 1 -- 172.21.15.63:0/3198149235 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaa4003270 con 0x7fcac00b49b0 2020-05-18T21:27:15.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcabed9d700 1 -- 172.21.15.63:0/3198149235 >> v2:172.21.15.155:3300/0 conn(0x7fcac0149990 msgr2=0x7fcac0149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:15.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcabed9d700 1 --2- 172.21.15.63:0/3198149235 >> v2:172.21.15.155:3300/0 conn(0x7fcac0149990 0x7fcac0149e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:15.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcabed9d700 1 -- 172.21.15.63:0/3198149235 >> v1:172.21.15.63:6789/0 conn(0x7fcac00b49b0 legacy=0x7fcac00640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcabed9d700 1 -- 172.21.15.63:0/3198149235 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac0061cf0 con 0x7fcac00b58e0 2020-05-18T21:27:15.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcabed9d700 1 --2- 172.21.15.63:0/3198149235 >> v2:172.21.15.63:3300/0 conn(0x7fcac00b58e0 0x7fcac005ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcaa8002f70 tx=0x7fcaa8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcabed9d700 1 --2- 172.21.15.63:0/3198149235 >> v2:172.21.15.63:3300/0 conn(0x7fcac00b58e0 0x7fcac005ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcaa8002f70 tx=0x7fcaa8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcabed9d700 1 --2- 172.21.15.63:0/3198149235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcac00b58e0 0x7fcac005ed50 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7fcaa8002f70 tx=0x7fcaa8007a80).ready entity=mon.0 client_cookie=9fff8ce984fce94e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:15.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcabed9d700 1 --2- 172.21.15.63:0/3198149235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcac00b58e0 0x7fcac005ed50 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7fcaa8002f70 tx=0x7fcaa8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcabdd9b700 1 -- 172.21.15.63:0/3198149235 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaa8008e50 con 0x7fcac00b58e0 2020-05-18T21:27:15.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcabed9d700 1 --2- 172.21.15.63:0/3198149235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcac00b58e0 0x7fcac005ed50 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7fcaa8002f70 tx=0x7fcaa8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcabdd9b700 1 -- 172.21.15.63:0/3198149235 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa8011540 con 0x7fcac00b58e0 2020-05-18T21:27:15.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcabed9d700 1 --2- 172.21.15.63:0/3198149235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcac00b58e0 0x7fcac005ed50 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7fcaa8002f70 tx=0x7fcaa8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcac5119700 1 -- 172.21.15.63:0/3198149235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcac00b58e0 msgr2=0x7fcac005ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcabdd9b700 1 -- 172.21.15.63:0/3198149235 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaa8011960 con 0x7fcac00b58e0 2020-05-18T21:27:15.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.405+0000 7fcac5119700 1 --2- 172.21.15.63:0/3198149235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcac00b58e0 0x7fcac005ed50 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7fcaa8002f70 tx=0x7fcaa8007a80).stop 2020-05-18T21:27:15.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcac5119700 1 -- 172.21.15.63:0/3198149235 shutdown_connections 2020-05-18T21:27:15.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcac5119700 1 --2- 172.21.15.63:0/3198149235 >> v2:172.21.15.155:3300/0 conn(0x7fcac0149990 0x7fcac0149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:15.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcac5119700 1 --2- 172.21.15.63:0/3198149235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcac00b58e0 0x7fcac005ed50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcac5119700 1 -- 172.21.15.63:0/3198149235 >> 172.21.15.63:0/3198149235 conn(0x7fcac00b8ec0 msgr2=0x7fcac00b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:15.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcac5119700 1 -- 172.21.15.63:0/3198149235 shutdown_connections 2020-05-18T21:27:15.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcac5119700 1 -- 172.21.15.63:0/3198149235 wait complete. 2020-05-18T21:27:15.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcac5119700 1 Processor -- start 2020-05-18T21:27:15.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcac5119700 1 -- start start 2020-05-18T21:27:15.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcac5119700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcac00b49b0 0x7fcac014c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:15.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcac5119700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcac00b58e0 0x7fcac014cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:15.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcac5119700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcac0149990 0x7fcac00b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:15.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcac5119700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac00b7c10 con 0x7fcac00b58e0 2020-05-18T21:27:15.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcac5119700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac014d180 con 0x7fcac00b49b0 2020-05-18T21:27:15.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcac5119700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00b02d0 con 0x7fcac0149990 2020-05-18T21:27:15.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcabe59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcac00b58e0 0x7fcac014cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcabe59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcac00b58e0 0x7fcac014cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53540/0 (socket says 172.21.15.63:53540) 2020-05-18T21:27:15.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcabe59c700 1 -- 172.21.15.63:0/3974426987 learned_addr learned my addr 172.21.15.63:0/3974426987 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:15.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcabf59e700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcac0149990 0x7fcac00b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcabed9d700 1 --2- 172.21.15.63:0/3974426987 >> v2:172.21.15.155:3300/0 conn(0x7fcac00b49b0 0x7fcac014c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcabe59c700 1 -- 172.21.15.63:0/3974426987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcac0149990 msgr2=0x7fcac00b77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcabe59c700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcac0149990 0x7fcac00b77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcabe59c700 1 -- 172.21.15.63:0/3974426987 >> v2:172.21.15.155:3300/0 conn(0x7fcac00b49b0 msgr2=0x7fcac014c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcabe59c700 1 --2- 172.21.15.63:0/3974426987 >> v2:172.21.15.155:3300/0 conn(0x7fcac00b49b0 0x7fcac014c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcabe59c700 1 -- 172.21.15.63:0/3974426987 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac00affc0 con 0x7fcac00b58e0 2020-05-18T21:27:15.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcabe59c700 1 --2- 172.21.15.63:0/3974426987 >> v2:172.21.15.63:3300/0 conn(0x7fcac00b58e0 0x7fcac014cb50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcab8001490 tx=0x7fcab8010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcabe59c700 1 --2- 172.21.15.63:0/3974426987 >> v2:172.21.15.63:3300/0 conn(0x7fcac00b58e0 0x7fcac014cb50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcab8001490 tx=0x7fcab8010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcabe59c700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcac00b58e0 0x7fcac014cb50 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7fcab8001490 tx=0x7fcab8010e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:15.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcabe59c700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcac00b58e0 0x7fcac014cb50 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fcab8001490 tx=0x7fcab8010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcabe59c700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcac00b58e0 0x7fcac014cb50 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fcab8001490 tx=0x7fcab8010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcabe59c700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcac00b58e0 0x7fcac014cb50 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fcab8001490 tx=0x7fcab8010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcab7fff700 1 -- 172.21.15.63:0/3974426987 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcab8010470 con 0x7fcac00b58e0 2020-05-18T21:27:15.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcab7fff700 1 -- 172.21.15.63:0/3974426987 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab80105d0 con 0x7fcac00b58e0 2020-05-18T21:27:15.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcab7fff700 1 -- 172.21.15.63:0/3974426987 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcab80124c0 con 0x7fcac00b58e0 2020-05-18T21:27:15.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcac5119700 1 -- 172.21.15.63:0/3974426987 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac00b1330 con 0x7fcac00b58e0 2020-05-18T21:27:15.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.409+0000 7fcac5119700 1 -- 172.21.15.63:0/3974426987 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac00b17e0 con 0x7fcac00b58e0 2020-05-18T21:27:15.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.413+0000 7fcabe59c700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcac00b58e0 0x7fcac014cb50 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fcab8001490 tx=0x7fcab8010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.413+0000 7fcac5119700 1 -- 172.21.15.63:0/3974426987 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac014cfb0 con 0x7fcac00b58e0 2020-05-18T21:27:15.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.413+0000 7fcab7fff700 1 -- 172.21.15.63:0/3974426987 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fcab80059a0 con 0x7fcac00b58e0 2020-05-18T21:27:15.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.413+0000 7fcabe59c700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcac00b58e0 0x7fcac014cb50 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fcab8001490 tx=0x7fcab8010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.413+0000 7fcab7fff700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9804fa20 0x7fca98051ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:15.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.413+0000 7fcab7fff700 1 -- 172.21.15.63:0/3974426987 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcab80100c0 con 0x7fcac00b58e0 2020-05-18T21:27:15.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.413+0000 7fcabed9d700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9804fa20 0x7fca98051ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.413+0000 7fcabed9d700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9804fa20 0x7fca98051ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcaa8002f70 tx=0x7fcaa8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.413+0000 7fcabed9d700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9804fa20 0x7fca98051ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcaa8002f70 tx=0x7fcaa8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.413+0000 7fcabed9d700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9804fa20 0x7fca98051ee0 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fcaa8002f70 tx=0x7fcaa8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:15.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.417+0000 7fcabe59c700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcac00b58e0 0x7fcac014cb50 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fcab8001490 tx=0x7fcab8010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.417+0000 7fcab7fff700 1 -- 172.21.15.63:0/3974426987 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fcab803dff0 con 0x7fcac00b58e0 2020-05-18T21:27:15.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.533+0000 7fcac5119700 1 -- 172.21.15.63:0/3974426987 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcac00569e0 con 0x7fcac00b58e0 2020-05-18T21:27:15.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.537+0000 7fcabe59c700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcac00b58e0 0x7fcac014cb50 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fcab8001490 tx=0x7fcab8010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.537+0000 7fcab7fff700 1 -- 172.21.15.63:0/3974426987 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcab8041610 con 0x7fcac00b58e0 2020-05-18T21:27:15.543 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:15.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.537+0000 7fcac5119700 1 -- 172.21.15.63:0/3974426987 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9804fa20 msgr2=0x7fca98051ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.537+0000 7fcac5119700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9804fa20 0x7fca98051ee0 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fcaa8002f70 tx=0x7fcaa8007a80).stop 2020-05-18T21:27:15.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.537+0000 7fcac5119700 1 -- 172.21.15.63:0/3974426987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcac00b58e0 msgr2=0x7fcac014cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.537+0000 7fcac5119700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcac00b58e0 0x7fcac014cb50 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7fcab8001490 tx=0x7fcab8010e60).stop 2020-05-18T21:27:15.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.537+0000 7fcac5119700 1 -- 172.21.15.63:0/3974426987 shutdown_connections 2020-05-18T21:27:15.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.537+0000 7fcac5119700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9804fa20 0x7fca98051ee0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.537+0000 7fcac5119700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcac0149990 0x7fcac00b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.537+0000 7fcac5119700 1 --2- 172.21.15.63:0/3974426987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcac00b58e0 0x7fcac014cb50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.537+0000 7fcac5119700 1 --2- 172.21.15.63:0/3974426987 >> v2:172.21.15.155:3300/0 conn(0x7fcac00b49b0 0x7fcac014c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.537+0000 7fcac5119700 1 -- 172.21.15.63:0/3974426987 >> 172.21.15.63:0/3974426987 conn(0x7fcac00b8ec0 msgr2=0x7fcac005f260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:15.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.537+0000 7fcac5119700 1 -- 172.21.15.63:0/3974426987 shutdown_connections 2020-05-18T21:27:15.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.537+0000 7fcac5119700 1 -- 172.21.15.63:0/3974426987 wait complete. 2020-05-18T21:27:15.555 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:27:15.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.653+0000 7f7fe578e700 1 Processor -- start 2020-05-18T21:27:15.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.653+0000 7f7fe578e700 1 -- start start 2020-05-18T21:27:15.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fe578e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7fe00ae240 0x7f7fe00b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:15.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fe578e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fe00b5260 0x7f7fe01432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:15.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fe578e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe0064bd0 con 0x7f7fe00b4e80 2020-05-18T21:27:15.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fe578e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe00b56d0 con 0x7f7fe00ae240 2020-05-18T21:27:15.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fe578e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe0064e00 con 0x7f7fe00b5260 2020-05-18T21:27:15.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fde7fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7fe00ae240 0x7f7fe00b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fdf7fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fe00b5260 0x7f7fe01432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fde7fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7fe00ae240 0x7f7fe00b8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:40164/0 (socket says 172.21.15.63:40164) 2020-05-18T21:27:15.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fdf7fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fe00b5260 0x7f7fe01432c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:44252/0 (socket says 172.21.15.63:44252) 2020-05-18T21:27:15.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fde7fc700 1 -- 172.21.15.63:0/330504393 learned_addr learned my addr 172.21.15.63:0/330504393 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:15.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fdeffd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f7fe00b4e80 0x7f7fe00adb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:54050/0 (socket says 172.21.15.63:54050) 2020-05-18T21:27:15.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fde7fc700 1 -- 172.21.15.63:0/330504393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fe00b5260 msgr2=0x7f7fe01432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:15.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fde7fc700 1 --2- 172.21.15.63:0/330504393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fe00b5260 0x7f7fe01432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:15.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fde7fc700 1 -- 172.21.15.63:0/330504393 >> v1:172.21.15.155:6789/0 conn(0x7f7fe00b4e80 legacy=0x7f7fe00adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fde7fc700 1 -- 172.21.15.63:0/330504393 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe00ad3f0 con 0x7f7fe00ae240 2020-05-18T21:27:15.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fddffb700 1 -- 172.21.15.63:0/330504393 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834591595 0 0) 0x7f7fe0064bd0 con 0x7f7fe00b4e80 2020-05-18T21:27:15.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fde7fc700 1 --2- 172.21.15.63:0/330504393 >> v2:172.21.15.155:3300/0 conn(0x7f7fe00ae240 0x7f7fe00b8ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7fd00032f0 tx=0x7f7fd0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fde7fc700 1 --2- 172.21.15.63:0/330504393 >> v2:172.21.15.155:3300/0 conn(0x7f7fe00ae240 0x7f7fe00b8ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7fd00032f0 tx=0x7f7fd0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fde7fc700 1 --2- 172.21.15.63:0/330504393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fe00ae240 0x7f7fe00b8ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7f7fd00032f0 tx=0x7f7fd0007e00).ready entity=mon.1 client_cookie=ba2c3a0a727ef2b1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:15.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fde7fc700 1 --2- 172.21.15.63:0/330504393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fe00ae240 0x7f7fe00b8ed0 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f7fd00032f0 tx=0x7f7fd0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fddffb700 1 -- 172.21.15.63:0/330504393 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fd0011d10 con 0x7f7fe00ae240 2020-05-18T21:27:15.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fde7fc700 1 --2- 172.21.15.63:0/330504393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fe00ae240 0x7f7fe00b8ed0 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f7fd00032f0 tx=0x7f7fd0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fde7fc700 1 --2- 172.21.15.63:0/330504393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fe00ae240 0x7f7fe00b8ed0 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f7fd00032f0 tx=0x7f7fd0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fddffb700 1 -- 172.21.15.63:0/330504393 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd0011e70 con 0x7f7fe00ae240 2020-05-18T21:27:15.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fddffb700 1 -- 172.21.15.63:0/330504393 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fd000a370 con 0x7f7fe00ae240 2020-05-18T21:27:15.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fe578e700 1 -- 172.21.15.63:0/330504393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fe00ae240 msgr2=0x7f7fe00b8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fe578e700 1 --2- 172.21.15.63:0/330504393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fe00ae240 0x7f7fe00b8ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7f7fd00032f0 tx=0x7f7fd0007e00).stop 2020-05-18T21:27:15.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fe578e700 1 -- 172.21.15.63:0/330504393 shutdown_connections 2020-05-18T21:27:15.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fe578e700 1 --2- 172.21.15.63:0/330504393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fe00b5260 0x7f7fe01432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:15.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fe578e700 1 --2- 172.21.15.63:0/330504393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fe00ae240 0x7f7fe00b8ed0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fe578e700 1 -- 172.21.15.63:0/330504393 >> 172.21.15.63:0/330504393 conn(0x7f7fe00b83b0 msgr2=0x7f7fe00b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:15.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fe578e700 1 -- 172.21.15.63:0/330504393 shutdown_connections 2020-05-18T21:27:15.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.657+0000 7f7fe578e700 1 -- 172.21.15.63:0/330504393 wait complete. 2020-05-18T21:27:15.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fe578e700 1 Processor -- start 2020-05-18T21:27:15.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fe578e700 1 -- start start 2020-05-18T21:27:15.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fe578e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7fe00b4e80 0x7f7fe0145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:15.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fe578e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7fe00b5260 0x7f7fe0154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:15.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fe578e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe01550b0 con 0x7f7fe00ae240 2020-05-18T21:27:15.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fe578e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe0152500 con 0x7f7fe00b5260 2020-05-18T21:27:15.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fe578e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe0155350 con 0x7f7fe00b4e80 2020-05-18T21:27:15.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fdeffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7fe00ae240 0x7f7fe00b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55740/0 (socket says 172.21.15.63:55740) 2020-05-18T21:27:15.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fdeffd700 1 -- 172.21.15.63:0/1821985774 learned_addr learned my addr 172.21.15.63:0/1821985774 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:15.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fdf7fe700 1 --2- 172.21.15.63:0/1821985774 >> v2:172.21.15.63:3300/0 conn(0x7f7fe00b5260 0x7f7fe0154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fde7fc700 1 --2- 172.21.15.63:0/1821985774 >> v2:172.21.15.155:3300/0 conn(0x7f7fe00b4e80 0x7f7fe0145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fcffff700 1 -- 172.21.15.63:0/1821985774 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812709861 0 0) 0x7f7fe01550b0 con 0x7f7fe00ae240 2020-05-18T21:27:15.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fcffff700 1 -- 172.21.15.63:0/1821985774 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fbc002fe0 con 0x7f7fe00ae240 2020-05-18T21:27:15.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fdf7fe700 1 -- 172.21.15.63:0/1821985774 >> v2:172.21.15.155:3300/0 conn(0x7f7fe00b4e80 msgr2=0x7f7fe0145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fdf7fe700 1 --2- 172.21.15.63:0/1821985774 >> v2:172.21.15.155:3300/0 conn(0x7f7fe00b4e80 0x7f7fe0145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fdf7fe700 1 -- 172.21.15.63:0/1821985774 >> v1:172.21.15.63:6789/0 conn(0x7f7fe00ae240 legacy=0x7f7fe00b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fdf7fe700 1 -- 172.21.15.63:0/1821985774 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe01555f0 con 0x7f7fe00b5260 2020-05-18T21:27:15.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fdf7fe700 1 --2- 172.21.15.63:0/1821985774 >> v2:172.21.15.63:3300/0 conn(0x7f7fe00b5260 0x7f7fe0154ac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7fd8002f70 tx=0x7f7fd8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fdf7fe700 1 --2- 172.21.15.63:0/1821985774 >> v2:172.21.15.63:3300/0 conn(0x7f7fe00b5260 0x7f7fe0154ac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7fd8002f70 tx=0x7f7fd8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fdf7fe700 1 --2- 172.21.15.63:0/1821985774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe00b5260 0x7f7fe0154ac0 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7f7fd8002f70 tx=0x7f7fd8010b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:15.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fdf7fe700 1 --2- 172.21.15.63:0/1821985774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe00b5260 0x7f7fe0154ac0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f7fd8002f70 tx=0x7f7fd8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fcffff700 1 -- 172.21.15.63:0/1821985774 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fd8005b80 con 0x7f7fe00b5260 2020-05-18T21:27:15.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fdf7fe700 1 --2- 172.21.15.63:0/1821985774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe00b5260 0x7f7fe0154ac0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f7fd8002f70 tx=0x7f7fd8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fe578e700 1 -- 172.21.15.63:0/1821985774 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe00b0650 con 0x7f7fe00b5260 2020-05-18T21:27:15.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fcffff700 1 -- 172.21.15.63:0/1821985774 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd8005ce0 con 0x7f7fe00b5260 2020-05-18T21:27:15.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fdf7fe700 1 --2- 172.21.15.63:0/1821985774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe00b5260 0x7f7fe0154ac0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f7fd8002f70 tx=0x7f7fd8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fcffff700 1 -- 172.21.15.63:0/1821985774 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fd8005e50 con 0x7f7fe00b5260 2020-05-18T21:27:15.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.661+0000 7f7fe578e700 1 -- 172.21.15.63:0/1821985774 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe00b26f0 con 0x7f7fe00b5260 2020-05-18T21:27:15.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.665+0000 7f7fdf7fe700 1 --2- 172.21.15.63:0/1821985774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe00b5260 0x7f7fe0154ac0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f7fd8002f70 tx=0x7f7fd8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.665+0000 7f7fe578e700 1 -- 172.21.15.63:0/1821985774 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe00569e0 con 0x7f7fe00b5260 2020-05-18T21:27:15.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.665+0000 7f7fcffff700 1 -- 172.21.15.63:0/1821985774 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7fd8012610 con 0x7f7fe00b5260 2020-05-18T21:27:15.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.665+0000 7f7fdf7fe700 1 --2- 172.21.15.63:0/1821985774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe00b5260 0x7f7fe0154ac0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f7fd8002f70 tx=0x7f7fd8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.665+0000 7f7fcffff700 1 --2- 172.21.15.63:0/1821985774 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fbc04fd30 0x7f7fbc0521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:15.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.665+0000 7f7fcffff700 1 -- 172.21.15.63:0/1821985774 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7fd8063d60 con 0x7f7fe00b5260 2020-05-18T21:27:15.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.665+0000 7f7fdeffd700 1 --2- 172.21.15.63:0/1821985774 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fbc04fd30 0x7f7fbc0521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.665+0000 7f7fdeffd700 1 --2- 172.21.15.63:0/1821985774 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fbc04fd30 0x7f7fbc0521f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7fd4001080 tx=0x7f7fe005b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.665+0000 7f7fdeffd700 1 --2- 172.21.15.63:0/1821985774 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fbc04fd30 0x7f7fbc0521f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7fd4001080 tx=0x7f7fe005b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.665+0000 7f7fdeffd700 1 --2- 172.21.15.63:0/1821985774 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fbc04fd30 0x7f7fbc0521f0 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f7fd4001080 tx=0x7f7fe005b560).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:15.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.669+0000 7f7fdf7fe700 1 --2- 172.21.15.63:0/1821985774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe00b5260 0x7f7fe0154ac0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f7fd8002f70 tx=0x7f7fd8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.669+0000 7f7fcffff700 1 -- 172.21.15.63:0/1821985774 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f7fd80339c0 con 0x7f7fe00b5260 2020-05-18T21:27:15.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.789+0000 7f7fe578e700 1 -- 172.21.15.63:0/1821985774 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7fe00b0430 con 0x7f7fe00b5260 2020-05-18T21:27:15.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.789+0000 7f7fdf7fe700 1 --2- 172.21.15.63:0/1821985774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe00b5260 0x7f7fe0154ac0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f7fd8002f70 tx=0x7f7fd8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.789+0000 7f7fcffff700 1 -- 172.21.15.63:0/1821985774 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7fd803e090 con 0x7f7fe00b5260 2020-05-18T21:27:15.797 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:15.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.789+0000 7f7fe578e700 1 -- 172.21.15.63:0/1821985774 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fbc04fd30 msgr2=0x7f7fbc0521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.789+0000 7f7fe578e700 1 --2- 172.21.15.63:0/1821985774 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fbc04fd30 0x7f7fbc0521f0 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f7fd4001080 tx=0x7f7fe005b560).stop 2020-05-18T21:27:15.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.789+0000 7f7fe578e700 1 -- 172.21.15.63:0/1821985774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe00b5260 msgr2=0x7f7fe0154ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.789+0000 7f7fe578e700 1 --2- 172.21.15.63:0/1821985774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe00b5260 0x7f7fe0154ac0 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7f7fd8002f70 tx=0x7f7fd8010b80).stop 2020-05-18T21:27:15.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.793+0000 7f7fe578e700 1 -- 172.21.15.63:0/1821985774 shutdown_connections 2020-05-18T21:27:15.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.793+0000 7f7fe578e700 1 --2- 172.21.15.63:0/1821985774 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fbc04fd30 0x7f7fbc0521f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.793+0000 7f7fe578e700 1 --2- 172.21.15.63:0/1821985774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe00b5260 0x7f7fe0154ac0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.793+0000 7f7fe578e700 1 --2- 172.21.15.63:0/1821985774 >> v2:172.21.15.155:3300/0 conn(0x7f7fe00b4e80 0x7f7fe0145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.793+0000 7f7fe578e700 1 -- 172.21.15.63:0/1821985774 >> 172.21.15.63:0/1821985774 conn(0x7f7fe00b83b0 msgr2=0x7f7fe0060c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:15.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.793+0000 7f7fe578e700 1 -- 172.21.15.63:0/1821985774 shutdown_connections 2020-05-18T21:27:15.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.793+0000 7f7fe578e700 1 -- 172.21.15.63:0/1821985774 wait complete. 2020-05-18T21:27:15.812 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:27:15.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.921+0000 7f6c21284700 1 Processor -- start 2020-05-18T21:27:15.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.921+0000 7f6c21284700 1 -- start start 2020-05-18T21:27:15.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.921+0000 7f6c21284700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6c1c0b68d0 0x7f6c1c1469b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:15.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.921+0000 7f6c21284700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c1c149d40 0x7f6c1c060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:15.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.921+0000 7f6c21284700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1c145fd0 con 0x7f6c1c0b99d0 2020-05-18T21:27:15.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.921+0000 7f6c21284700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1c146270 con 0x7f6c1c0b68d0 2020-05-18T21:27:15.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.921+0000 7f6c21284700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c146510 con 0x7f6c1c149d40 2020-05-18T21:27:15.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.921+0000 7f6c1b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6c1c0b99d0 0x7f6c1c0b8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55748/0 (socket says 172.21.15.63:55748) 2020-05-18T21:27:15.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.921+0000 7f6c1b7fe700 1 -- 172.21.15.63:0/3151269824 learned_addr learned my addr 172.21.15.63:0/3151269824 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:15.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.921+0000 7f6c1bfff700 1 --2- 172.21.15.63:0/3151269824 >> v2:172.21.15.63:3300/0 conn(0x7f6c1c0b68d0 0x7f6c1c1469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c20a83700 1 --2- 172.21.15.63:0/3151269824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c1c149d40 0x7f6c1c060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c1affd700 1 -- 172.21.15.63:0/3151269824 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419424416 0 0) 0x7f6c1c145fd0 con 0x7f6c1c0b99d0 2020-05-18T21:27:15.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c1affd700 1 -- 172.21.15.63:0/3151269824 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bfc003270 con 0x7f6c1c0b99d0 2020-05-18T21:27:15.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c1bfff700 1 -- 172.21.15.63:0/3151269824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c1c149d40 msgr2=0x7f6c1c060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:15.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c1bfff700 1 --2- 172.21.15.63:0/3151269824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c1c149d40 0x7f6c1c060430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:15.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c1bfff700 1 -- 172.21.15.63:0/3151269824 >> v1:172.21.15.63:6789/0 conn(0x7f6c1c0b99d0 legacy=0x7f6c1c0b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c1affd700 1 -- 172.21.15.63:0/3151269824 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4011657139 0 0) 0x7f6bfc003270 con 0x7f6c1c0b99d0 2020-05-18T21:27:15.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c1bfff700 1 -- 172.21.15.63:0/3151269824 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c14a1f0 con 0x7f6c1c0b68d0 2020-05-18T21:27:15.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c1bfff700 1 --2- 172.21.15.63:0/3151269824 >> v2:172.21.15.63:3300/0 conn(0x7f6c1c0b68d0 0x7f6c1c1469b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6c040018b0 tx=0x7f6c0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c1bfff700 1 --2- 172.21.15.63:0/3151269824 >> v2:172.21.15.63:3300/0 conn(0x7f6c1c0b68d0 0x7f6c1c1469b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6c040018b0 tx=0x7f6c0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c1bfff700 1 --2- 172.21.15.63:0/3151269824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c1c0b68d0 0x7f6c1c1469b0 secure :-1 s=READY pgs=264 cs=0 l=1 rx=0x7f6c040018b0 tx=0x7f6c0c007a80).ready entity=mon.0 client_cookie=df96734f1e827951 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:15.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c1bfff700 1 --2- 172.21.15.63:0/3151269824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c1c0b68d0 0x7f6c1c1469b0 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7f6c040018b0 tx=0x7f6c0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c1affd700 1 -- 172.21.15.63:0/3151269824 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c04001710 con 0x7f6c1c0b68d0 2020-05-18T21:27:15.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c1bfff700 1 --2- 172.21.15.63:0/3151269824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c1c0b68d0 0x7f6c1c1469b0 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7f6c040018b0 tx=0x7f6c0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c1bfff700 1 --2- 172.21.15.63:0/3151269824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c1c0b68d0 0x7f6c1c1469b0 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7f6c040018b0 tx=0x7f6c0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c1affd700 1 -- 172.21.15.63:0/3151269824 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c008e40 con 0x7f6c1c0b68d0 2020-05-18T21:27:15.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c1affd700 1 -- 172.21.15.63:0/3151269824 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c0c011440 con 0x7f6c1c0b68d0 2020-05-18T21:27:15.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c21284700 1 -- 172.21.15.63:0/3151269824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c1c0b68d0 msgr2=0x7f6c1c1469b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c21284700 1 --2- 172.21.15.63:0/3151269824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c1c0b68d0 0x7f6c1c1469b0 secure :-1 s=READY pgs=264 cs=0 l=1 rx=0x7f6c040018b0 tx=0x7f6c0c007a80).stop 2020-05-18T21:27:15.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c21284700 1 -- 172.21.15.63:0/3151269824 shutdown_connections 2020-05-18T21:27:15.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c21284700 1 --2- 172.21.15.63:0/3151269824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c1c149d40 0x7f6c1c060430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:15.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c21284700 1 --2- 172.21.15.63:0/3151269824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c1c0b68d0 0x7f6c1c1469b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c21284700 1 -- 172.21.15.63:0/3151269824 >> 172.21.15.63:0/3151269824 conn(0x7f6c1c069b70 msgr2=0x7f6c1c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:15.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c21284700 1 -- 172.21.15.63:0/3151269824 shutdown_connections 2020-05-18T21:27:15.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c21284700 1 -- 172.21.15.63:0/3151269824 wait complete. 2020-05-18T21:27:15.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c21284700 1 Processor -- start 2020-05-18T21:27:15.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.925+0000 7f6c21284700 1 -- start start 2020-05-18T21:27:15.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c21284700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6c1c0b99d0 0x7f6c1c0b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:15.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c21284700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6c1c149d40 0x7f6c1c0add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:15.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c21284700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1c144400 con 0x7f6c1c0b68d0 2020-05-18T21:27:15.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c21284700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1c0b0a10 con 0x7f6c1c149d40 2020-05-18T21:27:15.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c21284700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1c0ae5b0 con 0x7f6c1c0b99d0 2020-05-18T21:27:15.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c20a83700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6c1c149d40 0x7f6c1c0add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c1bfff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f6c1c0b68d0 0x7f6c1c13ee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:54070/0 (socket says 172.21.15.63:54070) 2020-05-18T21:27:15.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c20a83700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6c1c149d40 0x7f6c1c0add90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53570/0 (socket says 172.21.15.63:53570) 2020-05-18T21:27:15.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c1bfff700 1 -- 172.21.15.63:0/757902434 learned_addr learned my addr 172.21.15.63:0/757902434 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:15.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c1b7fe700 1 --2- 172.21.15.63:0/757902434 >> v2:172.21.15.155:3300/0 conn(0x7f6c1c0b99d0 0x7f6c1c0b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c197fa700 1 -- 172.21.15.63:0/757902434 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851160213 0 0) 0x7f6c1c144400 con 0x7f6c1c0b68d0 2020-05-18T21:27:15.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c197fa700 1 -- 172.21.15.63:0/757902434 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c00002fe0 con 0x7f6c1c0b68d0 2020-05-18T21:27:15.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c20a83700 1 -- 172.21.15.63:0/757902434 >> v2:172.21.15.155:3300/0 conn(0x7f6c1c0b99d0 msgr2=0x7f6c1c0b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c20a83700 1 --2- 172.21.15.63:0/757902434 >> v2:172.21.15.155:3300/0 conn(0x7f6c1c0b99d0 0x7f6c1c0b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:15.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c20a83700 1 -- 172.21.15.63:0/757902434 >> v1:172.21.15.155:6789/0 conn(0x7f6c1c0b68d0 legacy=0x7f6c1c13ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:15.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c20a83700 1 -- 172.21.15.63:0/757902434 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c13f570 con 0x7f6c1c149d40 2020-05-18T21:27:15.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c20a83700 1 --2- 172.21.15.63:0/757902434 >> v2:172.21.15.63:3300/0 conn(0x7f6c1c149d40 0x7f6c1c0add90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6c140032f0 tx=0x7f6c14010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c20a83700 1 --2- 172.21.15.63:0/757902434 >> v2:172.21.15.63:3300/0 conn(0x7f6c1c149d40 0x7f6c1c0add90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6c140032f0 tx=0x7f6c14010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c20a83700 1 --2- 172.21.15.63:0/757902434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c1c149d40 0x7f6c1c0add90 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f6c140032f0 tx=0x7f6c14010f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:15.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c20a83700 1 --2- 172.21.15.63:0/757902434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c1c149d40 0x7f6c1c0add90 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f6c140032f0 tx=0x7f6c14010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c197fa700 1 -- 172.21.15.63:0/757902434 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c14005a80 con 0x7f6c1c149d40 2020-05-18T21:27:15.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c20a83700 1 --2- 172.21.15.63:0/757902434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c1c149d40 0x7f6c1c0add90 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f6c140032f0 tx=0x7f6c14010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c197fa700 1 -- 172.21.15.63:0/757902434 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c14005be0 con 0x7f6c1c149d40 2020-05-18T21:27:15.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c20a83700 1 --2- 172.21.15.63:0/757902434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c1c149d40 0x7f6c1c0add90 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f6c140032f0 tx=0x7f6c14010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c21284700 1 -- 172.21.15.63:0/757902434 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c1c13f840 con 0x7f6c1c149d40 2020-05-18T21:27:15.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c197fa700 1 -- 172.21.15.63:0/757902434 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c1400c940 con 0x7f6c1c149d40 2020-05-18T21:27:15.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c21284700 1 -- 172.21.15.63:0/757902434 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1c0bbc00 con 0x7f6c1c149d40 2020-05-18T21:27:15.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c20a83700 1 --2- 172.21.15.63:0/757902434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c1c149d40 0x7f6c1c0add90 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f6c140032f0 tx=0x7f6c14010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.929+0000 7f6c21284700 1 -- 172.21.15.63:0/757902434 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1c0bbf10 con 0x7f6c1c149d40 2020-05-18T21:27:15.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.933+0000 7f6c197fa700 1 -- 172.21.15.63:0/757902434 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6c1400cb80 con 0x7f6c1c149d40 2020-05-18T21:27:15.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.933+0000 7f6c20a83700 1 --2- 172.21.15.63:0/757902434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c1c149d40 0x7f6c1c0add90 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f6c140032f0 tx=0x7f6c14010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.933+0000 7f6c197fa700 1 --2- 172.21.15.63:0/757902434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c0004fdd0 0x7f6c00052290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:15.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.933+0000 7f6c197fa700 1 -- 172.21.15.63:0/757902434 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6c14063ac0 con 0x7f6c1c149d40 2020-05-18T21:27:15.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.933+0000 7f6c1bfff700 1 --2- 172.21.15.63:0/757902434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c0004fdd0 0x7f6c00052290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:15.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.933+0000 7f6c1bfff700 1 --2- 172.21.15.63:0/757902434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c0004fdd0 0x7f6c00052290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6c0c000bc0 tx=0x7f6c0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.933+0000 7f6c1bfff700 1 --2- 172.21.15.63:0/757902434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c0004fdd0 0x7f6c00052290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6c0c000bc0 tx=0x7f6c0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.933+0000 7f6c1bfff700 1 --2- 172.21.15.63:0/757902434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c0004fdd0 0x7f6c00052290 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f6c0c000bc0 tx=0x7f6c0c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:15.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.941+0000 7f6c20a83700 1 --2- 172.21.15.63:0/757902434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c1c149d40 0x7f6c1c0add90 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f6c140032f0 tx=0x7f6c14010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:15.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:15.941+0000 7f6c197fa700 1 -- 172.21.15.63:0/757902434 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6c1403deb0 con 0x7f6c1c149d40 2020-05-18T21:27:16.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.057+0000 7f6c21284700 1 -- 172.21.15.63:0/757902434 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6c1c144590 con 0x7f6c1c149d40 2020-05-18T21:27:16.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.057+0000 7f6c20a83700 1 --2- 172.21.15.63:0/757902434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c1c149d40 0x7f6c1c0add90 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f6c140032f0 tx=0x7f6c14010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.057+0000 7f6c197fa700 1 -- 172.21.15.63:0/757902434 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f6c140414d0 con 0x7f6c1c149d40 2020-05-18T21:27:16.066 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:16.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.061+0000 7f6c21284700 1 -- 172.21.15.63:0/757902434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c0004fdd0 msgr2=0x7f6c00052290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.061+0000 7f6c21284700 1 --2- 172.21.15.63:0/757902434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c0004fdd0 0x7f6c00052290 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f6c0c000bc0 tx=0x7f6c0c007a80).stop 2020-05-18T21:27:16.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.061+0000 7f6c21284700 1 -- 172.21.15.63:0/757902434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c1c149d40 msgr2=0x7f6c1c0add90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.061+0000 7f6c21284700 1 --2- 172.21.15.63:0/757902434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c1c149d40 0x7f6c1c0add90 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f6c140032f0 tx=0x7f6c14010f00).stop 2020-05-18T21:27:16.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.061+0000 7f6c21284700 1 -- 172.21.15.63:0/757902434 shutdown_connections 2020-05-18T21:27:16.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.061+0000 7f6c21284700 1 --2- 172.21.15.63:0/757902434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c0004fdd0 0x7f6c00052290 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:16.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.061+0000 7f6c21284700 1 --2- 172.21.15.63:0/757902434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c1c149d40 0x7f6c1c0add90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:16.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.061+0000 7f6c21284700 1 --2- 172.21.15.63:0/757902434 >> v2:172.21.15.155:3300/0 conn(0x7f6c1c0b99d0 0x7f6c1c0b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:16.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.061+0000 7f6c21284700 1 -- 172.21.15.63:0/757902434 >> 172.21.15.63:0/757902434 conn(0x7f6c1c069b70 msgr2=0x7f6c1c13fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:16.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.061+0000 7f6c21284700 1 -- 172.21.15.63:0/757902434 shutdown_connections 2020-05-18T21:27:16.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.061+0000 7f6c21284700 1 -- 172.21.15.63:0/757902434 wait complete. 2020-05-18T21:27:16.078 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:27:16.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2fca0b700 1 Processor -- start 2020-05-18T21:27:16.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2fca0b700 1 -- start start 2020-05-18T21:27:16.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2fca0b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2f8145df0 0x7ff2f8142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:16.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2fca0b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff2f81432f0 0x7ff2f8060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:16.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2fca0b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f80b7020 con 0x7ff2f80b93f0 2020-05-18T21:27:16.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2fca0b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f80b72c0 con 0x7ff2f81432f0 2020-05-18T21:27:16.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2fca0b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f80b7560 con 0x7ff2f8145df0 2020-05-18T21:27:16.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f6d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff2f80b93f0 0x7ff2f80b7ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55762/0 (socket says 172.21.15.63:55762) 2020-05-18T21:27:16.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f6d9d700 1 -- 172.21.15.63:0/3570767396 learned_addr learned my addr 172.21.15.63:0/3570767396 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:16.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f5d9b700 1 -- 172.21.15.63:0/3570767396 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527419383 0 0) 0x7ff2f80b7020 con 0x7ff2f80b93f0 2020-05-18T21:27:16.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f5d9b700 1 -- 172.21.15.63:0/3570767396 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2dc003270 con 0x7ff2f80b93f0 2020-05-18T21:27:16.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f659c700 1 --2- 172.21.15.63:0/3570767396 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2f8145df0 0x7ff2f8142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f759e700 1 --2- 172.21.15.63:0/3570767396 >> v2:172.21.15.155:3300/0 conn(0x7ff2f81432f0 0x7ff2f8060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f5d9b700 1 -- 172.21.15.63:0/3570767396 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 404539298 0 0) 0x7ff2dc003270 con 0x7ff2f80b93f0 2020-05-18T21:27:16.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f5d9b700 1 -- 172.21.15.63:0/3570767396 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2f8145df0 msgr2=0x7ff2f8142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:16.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f5d9b700 1 --2- 172.21.15.63:0/3570767396 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2f8145df0 0x7ff2f8142e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:16.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f5d9b700 1 -- 172.21.15.63:0/3570767396 >> v2:172.21.15.155:3300/0 conn(0x7ff2f81432f0 msgr2=0x7ff2f8060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:16.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f5d9b700 1 --2- 172.21.15.63:0/3570767396 >> v2:172.21.15.155:3300/0 conn(0x7ff2f81432f0 0x7ff2f8060430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:16.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f5d9b700 1 -- 172.21.15.63:0/3570767396 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f80b7800 con 0x7ff2f80b93f0 2020-05-18T21:27:16.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f5d9b700 1 -- 172.21.15.63:0/3570767396 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7ff2e8001a90 con 0x7ff2f80b93f0 2020-05-18T21:27:16.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f759e700 1 --2- 172.21.15.63:0/3570767396 >> v2:172.21.15.155:3300/0 conn(0x7ff2f81432f0 0x7ff2f8060430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:27:16.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f5d9b700 1 -- 172.21.15.63:0/3570767396 >> v1:172.21.15.63:6789/0 conn(0x7ff2f80b93f0 legacy=0x7ff2f80b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f5d9b700 1 --2- 172.21.15.63:0/3570767396 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2dc0037e0 0x7ff2dc003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:16.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f5d9b700 1 --2- 172.21.15.63:0/3570767396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2dc004510 0x7ff2dc004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:16.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f5d9b700 1 --2- 172.21.15.63:0/3570767396 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2dc004df0 0x7ff2dc00b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:16.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f5d9b700 1 -- 172.21.15.63:0/3570767396 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f80b72c0 con 0x7ff2dc004df0 2020-05-18T21:27:16.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f5d9b700 1 -- 172.21.15.63:0/3570767396 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f80b7560 con 0x7ff2dc004510 2020-05-18T21:27:16.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f5d9b700 1 -- 172.21.15.63:0/3570767396 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0042b0 con 0x7ff2dc0037e0 2020-05-18T21:27:16.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f6d9d700 1 --2- 172.21.15.63:0/3570767396 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2dc0037e0 0x7ff2dc003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f759e700 1 --2- 172.21.15.63:0/3570767396 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2dc004df0 0x7ff2dc00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f659c700 1 --2- 172.21.15.63:0/3570767396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2dc004510 0x7ff2dc004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f659c700 1 -- 172.21.15.63:0/3570767396 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2dc0037e0 msgr2=0x7ff2dc003c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:16.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f659c700 1 --2- 172.21.15.63:0/3570767396 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2dc0037e0 0x7ff2dc003c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:16.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f659c700 1 -- 172.21.15.63:0/3570767396 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2dc004df0 msgr2=0x7ff2dc00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:16.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f659c700 1 --2- 172.21.15.63:0/3570767396 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2dc004df0 0x7ff2dc00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:16.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f659c700 1 -- 172.21.15.63:0/3570767396 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc003270 con 0x7ff2dc004510 2020-05-18T21:27:16.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f6d9d700 1 --2- 172.21.15.63:0/3570767396 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2dc0037e0 0x7ff2dc003c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:16.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.177+0000 7ff2f659c700 1 --2- 172.21.15.63:0/3570767396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2dc004510 0x7ff2dc004990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff2dc0054e0 tx=0x7ff2e000bc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.181+0000 7ff2f659c700 1 --2- 172.21.15.63:0/3570767396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2dc004510 0x7ff2dc004990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff2dc0054e0 tx=0x7ff2e000bc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.181+0000 7ff2f659c700 1 --2- 172.21.15.63:0/3570767396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2dc004510 0x7ff2dc004990 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7ff2dc0054e0 tx=0x7ff2e000bc70).ready entity=mon.1 client_cookie=a8235dcbb33af8fb server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:16.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.181+0000 7ff2f659c700 1 --2- 172.21.15.63:0/3570767396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2dc004510 0x7ff2dc004990 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7ff2dc0054e0 tx=0x7ff2e000bc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.181+0000 7ff2f5d9b700 1 -- 172.21.15.63:0/3570767396 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2e0011bf0 con 0x7ff2dc004510 2020-05-18T21:27:16.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.181+0000 7ff2f659c700 1 --2- 172.21.15.63:0/3570767396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2dc004510 0x7ff2dc004990 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7ff2dc0054e0 tx=0x7ff2e000bc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.181+0000 7ff2f659c700 1 --2- 172.21.15.63:0/3570767396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2dc004510 0x7ff2dc004990 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7ff2dc0054e0 tx=0x7ff2e000bc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.181+0000 7ff2f5d9b700 1 -- 172.21.15.63:0/3570767396 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e0011d50 con 0x7ff2dc004510 2020-05-18T21:27:16.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.181+0000 7ff2f5d9b700 1 -- 172.21.15.63:0/3570767396 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2e00058f0 con 0x7ff2dc004510 2020-05-18T21:27:16.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.181+0000 7ff2fca0b700 1 -- 172.21.15.63:0/3570767396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2dc004510 msgr2=0x7ff2dc004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.181+0000 7ff2fca0b700 1 --2- 172.21.15.63:0/3570767396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2dc004510 0x7ff2dc004990 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7ff2dc0054e0 tx=0x7ff2e000bc70).stop 2020-05-18T21:27:16.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.181+0000 7ff2f759e700 1 -- 172.21.15.63:0/3570767396 reap_dead start 2020-05-18T21:27:16.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.181+0000 7ff2fca0b700 1 -- 172.21.15.63:0/3570767396 shutdown_connections 2020-05-18T21:27:16.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.181+0000 7ff2fca0b700 1 -- 172.21.15.63:0/3570767396 >> 172.21.15.63:0/3570767396 conn(0x7ff2f8069b70 msgr2=0x7ff2f8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:16.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.181+0000 7ff2fca0b700 1 -- 172.21.15.63:0/3570767396 shutdown_connections 2020-05-18T21:27:16.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.181+0000 7ff2fca0b700 1 -- 172.21.15.63:0/3570767396 wait complete. 2020-05-18T21:27:16.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.181+0000 7ff2fca0b700 1 Processor -- start 2020-05-18T21:27:16.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.181+0000 7ff2fca0b700 1 -- start start 2020-05-18T21:27:16.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2fca0b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff2f80b2fe0 0x7ff2f81413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:16.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2fca0b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff2f80acfa0 0x7ff2f80b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:16.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2fca0b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f81419e0 con 0x7ff2f80b5790 2020-05-18T21:27:16.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2fca0b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f8133a00 con 0x7ff2f80b2fe0 2020-05-18T21:27:16.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2fca0b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f813eab0 con 0x7ff2f80acfa0 2020-05-18T21:27:16.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2f6d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff2f80b2fe0 0x7ff2f81413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2f6d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff2f80b2fe0 0x7ff2f81413f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53586/0 (socket says 172.21.15.63:53586) 2020-05-18T21:27:16.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2f6d9d700 1 -- 172.21.15.63:0/487240754 learned_addr learned my addr 172.21.15.63:0/487240754 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:16.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2f659c700 1 --2- 172.21.15.63:0/487240754 >> v2:172.21.15.155:3300/0 conn(0x7ff2f80acfa0 0x7ff2f80b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2f659c700 1 -- 172.21.15.63:0/487240754 >> v2:172.21.15.63:3300/0 conn(0x7ff2f80b2fe0 msgr2=0x7ff2f81413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2f659c700 1 --2- 172.21.15.63:0/487240754 >> v2:172.21.15.63:3300/0 conn(0x7ff2f80b2fe0 0x7ff2f81413f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:16.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2f659c700 1 -- 172.21.15.63:0/487240754 >> v1:172.21.15.155:6789/0 conn(0x7ff2f80b5790 legacy=0x7ff2f813f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2f659c700 1 -- 172.21.15.63:0/487240754 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f813ed50 con 0x7ff2f80acfa0 2020-05-18T21:27:16.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2f659c700 1 --2- 172.21.15.63:0/487240754 >> v2:172.21.15.155:3300/0 conn(0x7ff2f80acfa0 0x7ff2f80b5330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff2dc0054e0 tx=0x7ff2e000bc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2f659c700 1 --2- 172.21.15.63:0/487240754 >> v2:172.21.15.155:3300/0 conn(0x7ff2f80acfa0 0x7ff2f80b5330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff2dc0054e0 tx=0x7ff2e000bc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2f659c700 1 --2- 172.21.15.63:0/487240754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f80acfa0 0x7ff2f80b5330 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7ff2dc0054e0 tx=0x7ff2e000bc70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:16.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2f659c700 1 --2- 172.21.15.63:0/487240754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f80acfa0 0x7ff2f80b5330 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7ff2dc0054e0 tx=0x7ff2e000bc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2effff700 1 -- 172.21.15.63:0/487240754 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2e0007be0 con 0x7ff2f80acfa0 2020-05-18T21:27:16.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2f659c700 1 --2- 172.21.15.63:0/487240754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f80acfa0 0x7ff2f80b5330 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7ff2dc0054e0 tx=0x7ff2e000bc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2f659c700 1 --2- 172.21.15.63:0/487240754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f80acfa0 0x7ff2f80b5330 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7ff2dc0054e0 tx=0x7ff2e000bc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2effff700 1 -- 172.21.15.63:0/487240754 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e0007360 con 0x7ff2f80acfa0 2020-05-18T21:27:16.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2fca0b700 1 -- 172.21.15.63:0/487240754 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f80b33c0 con 0x7ff2f80acfa0 2020-05-18T21:27:16.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2effff700 1 -- 172.21.15.63:0/487240754 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2e0005700 con 0x7ff2f80acfa0 2020-05-18T21:27:16.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2fca0b700 1 -- 172.21.15.63:0/487240754 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f80bca00 con 0x7ff2f80acfa0 2020-05-18T21:27:16.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2f659c700 1 --2- 172.21.15.63:0/487240754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f80acfa0 0x7ff2f80b5330 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7ff2dc0054e0 tx=0x7ff2e000bc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2fca0b700 1 -- 172.21.15.63:0/487240754 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f8141850 con 0x7ff2f80acfa0 2020-05-18T21:27:16.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2f659c700 1 --2- 172.21.15.63:0/487240754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f80acfa0 0x7ff2f80b5330 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7ff2dc0054e0 tx=0x7ff2e000bc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.185+0000 7ff2effff700 1 -- 172.21.15.63:0/487240754 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff2e0005970 con 0x7ff2f80acfa0 2020-05-18T21:27:16.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.189+0000 7ff2effff700 1 --2- 172.21.15.63:0/487240754 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff2d004fa60 0x7ff2d0051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:16.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.189+0000 7ff2effff700 1 -- 172.21.15.63:0/487240754 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff2e00643b0 con 0x7ff2f80acfa0 2020-05-18T21:27:16.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.189+0000 7ff2f6d9d700 1 --2- 172.21.15.63:0/487240754 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff2d004fa60 0x7ff2d0051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.189+0000 7ff2f6d9d700 1 --2- 172.21.15.63:0/487240754 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff2d004fa60 0x7ff2d0051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff2e80017a0 tx=0x7ff2e80015f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.189+0000 7ff2f6d9d700 1 --2- 172.21.15.63:0/487240754 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff2d004fa60 0x7ff2d0051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff2e80017a0 tx=0x7ff2e80015f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.189+0000 7ff2f6d9d700 1 --2- 172.21.15.63:0/487240754 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff2d004fa60 0x7ff2d0051f20 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7ff2e80017a0 tx=0x7ff2e80015f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:16.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.193+0000 7ff2f659c700 1 --2- 172.21.15.63:0/487240754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f80acfa0 0x7ff2f80b5330 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7ff2dc0054e0 tx=0x7ff2e000bc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.193+0000 7ff2effff700 1 -- 172.21.15.63:0/487240754 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff2e003e7c0 con 0x7ff2f80acfa0 2020-05-18T21:27:16.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.313+0000 7ff2fca0b700 1 -- 172.21.15.63:0/487240754 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2f813eee0 con 0x7ff2f80acfa0 2020-05-18T21:27:16.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.313+0000 7ff2f659c700 1 --2- 172.21.15.63:0/487240754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f80acfa0 0x7ff2f80b5330 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7ff2dc0054e0 tx=0x7ff2e000bc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.313+0000 7ff2effff700 1 -- 172.21.15.63:0/487240754 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16089 (secure 0 0 0) 0x7ff2e0041de0 con 0x7ff2f80acfa0 2020-05-18T21:27:16.321 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:16.321 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":23,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:26:47.498250+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:26:43.453504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-05-18T21:26:44.456531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:27:16.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.317+0000 7ff2fca0b700 1 -- 172.21.15.63:0/487240754 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff2d004fa60 msgr2=0x7ff2d0051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.317+0000 7ff2fca0b700 1 --2- 172.21.15.63:0/487240754 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff2d004fa60 0x7ff2d0051f20 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7ff2e80017a0 tx=0x7ff2e80015f0).stop 2020-05-18T21:27:16.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.317+0000 7ff2fca0b700 1 -- 172.21.15.63:0/487240754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f80acfa0 msgr2=0x7ff2f80b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.317+0000 7ff2fca0b700 1 --2- 172.21.15.63:0/487240754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f80acfa0 0x7ff2f80b5330 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7ff2dc0054e0 tx=0x7ff2e000bc70).stop 2020-05-18T21:27:16.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.317+0000 7ff2fca0b700 1 -- 172.21.15.63:0/487240754 shutdown_connections 2020-05-18T21:27:16.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.317+0000 7ff2fca0b700 1 --2- 172.21.15.63:0/487240754 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff2d004fa60 0x7ff2d0051f20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:16.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.317+0000 7ff2fca0b700 1 --2- 172.21.15.63:0/487240754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f80acfa0 0x7ff2f80b5330 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:16.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.317+0000 7ff2fca0b700 1 --2- 172.21.15.63:0/487240754 >> v2:172.21.15.63:3300/0 conn(0x7ff2f80b2fe0 0x7ff2f81413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:16.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.317+0000 7ff2fca0b700 1 -- 172.21.15.63:0/487240754 >> 172.21.15.63:0/487240754 conn(0x7ff2f8069b70 msgr2=0x7ff2f80b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:16.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.317+0000 7ff2fca0b700 1 -- 172.21.15.63:0/487240754 shutdown_connections 2020-05-18T21:27:16.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.317+0000 7ff2fca0b700 1 -- 172.21.15.63:0/487240754 wait complete. 2020-05-18T21:27:16.333 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:26:43.453504+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:26:44.456531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:27:16.334 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:27:16.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.437+0000 7fabdd882700 1 Processor -- start 2020-05-18T21:27:16.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.437+0000 7fabdd882700 1 -- start start 2020-05-18T21:27:16.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.437+0000 7fabdd882700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fabd80b4f40 0x7fabd8061180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:16.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.437+0000 7fabdd882700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fabd80b2eb0 0x7fabd80b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:16.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.437+0000 7fabdd882700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd806a7d0 con 0x7fabd806a2c0 2020-05-18T21:27:16.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.437+0000 7fabdd882700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd80b2a10 con 0x7fabd80b4f40 2020-05-18T21:27:16.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.437+0000 7fabdd882700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd80b5320 con 0x7fabd80b2eb0 2020-05-18T21:27:16.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.437+0000 7fabdc880700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fabd80b4f40 0x7fabd8061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdc880700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fabd80b4f40 0x7fabd8061180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53594/0 (socket says 172.21.15.63:53594) 2020-05-18T21:27:16.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdc880700 1 -- 172.21.15.63:0/267516066 learned_addr learned my addr 172.21.15.63:0/267516066 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:16.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdd081700 1 --2- 172.21.15.63:0/267516066 >> v2:172.21.15.155:3300/0 conn(0x7fabd80b2eb0 0x7fabd80b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdc880700 1 -- 172.21.15.63:0/267516066 >> v2:172.21.15.155:3300/0 conn(0x7fabd80b2eb0 msgr2=0x7fabd80b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:16.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdc880700 1 --2- 172.21.15.63:0/267516066 >> v2:172.21.15.155:3300/0 conn(0x7fabd80b2eb0 0x7fabd80b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:16.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdc880700 1 -- 172.21.15.63:0/267516066 >> v1:172.21.15.155:6789/0 conn(0x7fabd806a2c0 legacy=0x7fabd8132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdc880700 1 -- 172.21.15.63:0/267516066 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd81337f0 con 0x7fabd80b4f40 2020-05-18T21:27:16.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdc880700 1 --2- 172.21.15.63:0/267516066 >> v2:172.21.15.63:3300/0 conn(0x7fabd80b4f40 0x7fabd8061180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fabd00032f0 tx=0x7fabd0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdc880700 1 --2- 172.21.15.63:0/267516066 >> v2:172.21.15.63:3300/0 conn(0x7fabd80b4f40 0x7fabd8061180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fabd00032f0 tx=0x7fabd0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdc880700 1 --2- 172.21.15.63:0/267516066 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabd80b4f40 0x7fabd8061180 secure :-1 s=READY pgs=267 cs=0 l=1 rx=0x7fabd00032f0 tx=0x7fabd0007e00).ready entity=mon.0 client_cookie=da94669b9f6aedcb server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:16.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdc880700 1 --2- 172.21.15.63:0/267516066 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabd80b4f40 0x7fabd8061180 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7fabd00032f0 tx=0x7fabd0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdc880700 1 --2- 172.21.15.63:0/267516066 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabd80b4f40 0x7fabd8061180 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7fabd00032f0 tx=0x7fabd0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabd77fe700 1 -- 172.21.15.63:0/267516066 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabd0011d10 con 0x7fabd80b4f40 2020-05-18T21:27:16.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdc880700 1 --2- 172.21.15.63:0/267516066 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabd80b4f40 0x7fabd8061180 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7fabd00032f0 tx=0x7fabd0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabd77fe700 1 -- 172.21.15.63:0/267516066 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd0011e70 con 0x7fabd80b4f40 2020-05-18T21:27:16.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabd77fe700 1 -- 172.21.15.63:0/267516066 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabd000a370 con 0x7fabd80b4f40 2020-05-18T21:27:16.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdd882700 1 -- 172.21.15.63:0/267516066 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabd80b4f40 msgr2=0x7fabd8061180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdd882700 1 --2- 172.21.15.63:0/267516066 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabd80b4f40 0x7fabd8061180 secure :-1 s=READY pgs=267 cs=0 l=1 rx=0x7fabd00032f0 tx=0x7fabd0007e00).stop 2020-05-18T21:27:16.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdd882700 1 -- 172.21.15.63:0/267516066 shutdown_connections 2020-05-18T21:27:16.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdd882700 1 --2- 172.21.15.63:0/267516066 >> v2:172.21.15.155:3300/0 conn(0x7fabd80b2eb0 0x7fabd80b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:16.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdd882700 1 --2- 172.21.15.63:0/267516066 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabd80b4f40 0x7fabd8061180 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:16.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdd882700 1 -- 172.21.15.63:0/267516066 >> 172.21.15.63:0/267516066 conn(0x7fabd805fbd0 msgr2=0x7fabd8069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:16.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdd882700 1 -- 172.21.15.63:0/267516066 shutdown_connections 2020-05-18T21:27:16.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.441+0000 7fabdd882700 1 -- 172.21.15.63:0/267516066 wait complete. 2020-05-18T21:27:16.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabdd882700 1 Processor -- start 2020-05-18T21:27:16.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabdd882700 1 -- start start 2020-05-18T21:27:16.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabdd882700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd806a2c0 0x7fabd8064e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:16.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabdd882700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd80adf90 con 0x7fabd80b4f40 2020-05-18T21:27:16.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabdd882700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd814b3f0 con 0x7fabd80b2eb0 2020-05-18T21:27:16.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabdd882700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd814b690 con 0x7fabd806a2c0 2020-05-18T21:27:16.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabdd081700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fabd80b4f40 0x7fabd80ad2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55792/0 (socket says 172.21.15.63:55792) 2020-05-18T21:27:16.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabdd081700 1 -- 172.21.15.63:0/4145973240 learned_addr learned my addr 172.21.15.63:0/4145973240 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:16.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabdc880700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd806a2c0 0x7fabd8064e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabd5ffb700 1 -- 172.21.15.63:0/4145973240 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905199740 0 0) 0x7fabd80adf90 con 0x7fabd80b4f40 2020-05-18T21:27:16.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabd5ffb700 1 -- 172.21.15.63:0/4145973240 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabb8002fe0 con 0x7fabd80b4f40 2020-05-18T21:27:16.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabd5ffb700 1 -- 172.21.15.63:0/4145973240 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141950773 0 0) 0x7fabd814b3f0 con 0x7fabd80b2eb0 2020-05-18T21:27:16.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabd5ffb700 1 -- 172.21.15.63:0/4145973240 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabd80adf90 con 0x7fabd80b2eb0 2020-05-18T21:27:16.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabdc880700 1 -- 172.21.15.63:0/4145973240 >> v1:172.21.15.155:6789/0 conn(0x7fabd80b2eb0 legacy=0x7fabd81573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabdc880700 1 -- 172.21.15.63:0/4145973240 >> v1:172.21.15.63:6789/0 conn(0x7fabd80b4f40 legacy=0x7fabd80ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabdc880700 1 -- 172.21.15.63:0/4145973240 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd8157ac0 con 0x7fabd806a2c0 2020-05-18T21:27:16.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabdc880700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd806a2c0 0x7fabd8064e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fabd00032f0 tx=0x7fabd0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabdc880700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd806a2c0 0x7fabd8064e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fabd00032f0 tx=0x7fabd0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabdc880700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd806a2c0 0x7fabd8064e30 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7fabd00032f0 tx=0x7fabd0007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:16.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabdc880700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd806a2c0 0x7fabd8064e30 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fabd00032f0 tx=0x7fabd0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabd5ffb700 1 -- 172.21.15.63:0/4145973240 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabd00105d0 con 0x7fabd806a2c0 2020-05-18T21:27:16.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabdc880700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd806a2c0 0x7fabd8064e30 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fabd00032f0 tx=0x7fabd0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabdc880700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd806a2c0 0x7fabd8064e30 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fabd00032f0 tx=0x7fabd0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabd5ffb700 1 -- 172.21.15.63:0/4145973240 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd0005a80 con 0x7fabd806a2c0 2020-05-18T21:27:16.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabdd882700 1 -- 172.21.15.63:0/4145973240 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd80629b0 con 0x7fabd806a2c0 2020-05-18T21:27:16.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.445+0000 7fabd5ffb700 1 -- 172.21.15.63:0/4145973240 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabd0005e20 con 0x7fabd806a2c0 2020-05-18T21:27:16.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.449+0000 7fabdd882700 1 -- 172.21.15.63:0/4145973240 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd80adb60 con 0x7fabd806a2c0 2020-05-18T21:27:16.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.449+0000 7fabdc880700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd806a2c0 0x7fabd8064e30 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fabd00032f0 tx=0x7fabd0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.449+0000 7fabdd882700 1 -- 172.21.15.63:0/4145973240 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd80569e0 con 0x7fabd806a2c0 2020-05-18T21:27:16.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.449+0000 7fabd5ffb700 1 -- 172.21.15.63:0/4145973240 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fabd0007170 con 0x7fabd806a2c0 2020-05-18T21:27:16.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.449+0000 7fabdc880700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd806a2c0 0x7fabd8064e30 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fabd00032f0 tx=0x7fabd0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.449+0000 7fabd5ffb700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabb804ff00 0x7fabb80523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:16.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.449+0000 7fabd5ffb700 1 -- 172.21.15.63:0/4145973240 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fabd0064690 con 0x7fabd806a2c0 2020-05-18T21:27:16.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.449+0000 7fabd7fff700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabb804ff00 0x7fabb80523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.449+0000 7fabd7fff700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabb804ff00 0x7fabb80523c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fabcc001020 tx=0x7fabcc002730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.449+0000 7fabd7fff700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabb804ff00 0x7fabb80523c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fabcc001020 tx=0x7fabcc002730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.449+0000 7fabd7fff700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabb804ff00 0x7fabb80523c0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7fabcc001020 tx=0x7fabcc002730).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:16.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.461+0000 7fabdc880700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd806a2c0 0x7fabd8064e30 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fabd00032f0 tx=0x7fabd0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.461+0000 7fabd5ffb700 1 -- 172.21.15.63:0/4145973240 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fabd003eae0 con 0x7fabd806a2c0 2020-05-18T21:27:16.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.577+0000 7fabdd882700 1 -- 172.21.15.63:0/4145973240 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fabd8157c50 con 0x7fabd806a2c0 2020-05-18T21:27:16.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.577+0000 7fabdc880700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd806a2c0 0x7fabd8064e30 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fabd00032f0 tx=0x7fabd0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.577+0000 7fabd5ffb700 1 -- 172.21.15.63:0/4145973240 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7fabd8157c50 con 0x7fabd806a2c0 2020-05-18T21:27:16.586 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:27:16.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.581+0000 7fabdd882700 1 -- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabb804ff00 msgr2=0x7fabb80523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.581+0000 7fabdd882700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabb804ff00 0x7fabb80523c0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7fabcc001020 tx=0x7fabcc002730).stop 2020-05-18T21:27:16.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.581+0000 7fabdd882700 1 -- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd806a2c0 msgr2=0x7fabd8064e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.581+0000 7fabdd882700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd806a2c0 0x7fabd8064e30 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7fabd00032f0 tx=0x7fabd0007e00).stop 2020-05-18T21:27:16.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.581+0000 7fabdd882700 1 -- 172.21.15.63:0/4145973240 shutdown_connections 2020-05-18T21:27:16.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.581+0000 7fabdd882700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabb804ff00 0x7fabb80523c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:16.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.581+0000 7fabdd882700 1 --2- 172.21.15.63:0/4145973240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd806a2c0 0x7fabd8064e30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:16.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.581+0000 7fabdd882700 1 -- 172.21.15.63:0/4145973240 >> 172.21.15.63:0/4145973240 conn(0x7fabd805fbd0 msgr2=0x7fabd8131470 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:16.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.581+0000 7fabdd882700 1 -- 172.21.15.63:0/4145973240 shutdown_connections 2020-05-18T21:27:16.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.581+0000 7fabdd882700 1 -- 172.21.15.63:0/4145973240 wait complete. 2020-05-18T21:27:16.598 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:27:16.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c995f700 1 Processor -- start 2020-05-18T21:27:16.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c995f700 1 -- start start 2020-05-18T21:27:16.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c995f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41c41469b0 0x7f41c4149d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:16.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c995f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c4145fd0 con 0x7f41c40b68d0 2020-05-18T21:27:16.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c995f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c4146270 con 0x7f41c40b99d0 2020-05-18T21:27:16.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c995f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c4146510 con 0x7f41c41469b0 2020-05-18T21:27:16.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c895d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f41c40b68d0 0x7f41c40b8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55796/0 (socket says 172.21.15.63:55796) 2020-05-18T21:27:16.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c895d700 1 -- 172.21.15.63:0/3408590544 learned_addr learned my addr 172.21.15.63:0/3408590544 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:16.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c915e700 1 --2- 172.21.15.63:0/3408590544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41c41469b0 0x7f41c4149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c37fe700 1 -- 172.21.15.63:0/3408590544 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543712106 0 0) 0x7f41c4145fd0 con 0x7f41c40b68d0 2020-05-18T21:27:16.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c37fe700 1 -- 172.21.15.63:0/3408590544 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41b0003270 con 0x7f41c40b68d0 2020-05-18T21:27:16.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c37fe700 1 -- 172.21.15.63:0/3408590544 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1733084650 0 0) 0x7f41c4146270 con 0x7f41c40b99d0 2020-05-18T21:27:16.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c37fe700 1 -- 172.21.15.63:0/3408590544 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41c4145fd0 con 0x7f41c40b99d0 2020-05-18T21:27:16.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c915e700 1 -- 172.21.15.63:0/3408590544 >> v1:172.21.15.155:6789/0 conn(0x7f41c40b99d0 legacy=0x7f41c4060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c915e700 1 -- 172.21.15.63:0/3408590544 >> v1:172.21.15.63:6789/0 conn(0x7f41c40b68d0 legacy=0x7f41c40b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c915e700 1 -- 172.21.15.63:0/3408590544 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c40b6cb0 con 0x7f41c41469b0 2020-05-18T21:27:16.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c915e700 1 --2- 172.21.15.63:0/3408590544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41c41469b0 0x7f41c4149d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f41bc0032f0 tx=0x7f41bc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c915e700 1 --2- 172.21.15.63:0/3408590544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41c41469b0 0x7f41c4149d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f41bc0032f0 tx=0x7f41bc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c915e700 1 --2- 172.21.15.63:0/3408590544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41c41469b0 0x7f41c4149d40 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f41bc0032f0 tx=0x7f41bc008ca0).ready entity=mon.2 client_cookie=8f88133e9f30ea56 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:16.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c915e700 1 --2- 172.21.15.63:0/3408590544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41c41469b0 0x7f41c4149d40 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f41bc0032f0 tx=0x7f41bc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c37fe700 1 -- 172.21.15.63:0/3408590544 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41bc011df0 con 0x7f41c41469b0 2020-05-18T21:27:16.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c915e700 1 --2- 172.21.15.63:0/3408590544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41c41469b0 0x7f41c4149d40 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f41bc0032f0 tx=0x7f41bc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c915e700 1 --2- 172.21.15.63:0/3408590544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41c41469b0 0x7f41c4149d40 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f41bc0032f0 tx=0x7f41bc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c37fe700 1 -- 172.21.15.63:0/3408590544 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc00a180 con 0x7f41c41469b0 2020-05-18T21:27:16.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.701+0000 7f41c37fe700 1 -- 172.21.15.63:0/3408590544 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41bc00a560 con 0x7f41c41469b0 2020-05-18T21:27:16.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.705+0000 7f41c995f700 1 -- 172.21.15.63:0/3408590544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41c41469b0 msgr2=0x7f41c4149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.705+0000 7f41c995f700 1 --2- 172.21.15.63:0/3408590544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41c41469b0 0x7f41c4149d40 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f41bc0032f0 tx=0x7f41bc008ca0).stop 2020-05-18T21:27:16.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.705+0000 7f41c995f700 1 -- 172.21.15.63:0/3408590544 shutdown_connections 2020-05-18T21:27:16.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.705+0000 7f41c995f700 1 --2- 172.21.15.63:0/3408590544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41c41469b0 0x7f41c4149d40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:16.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.705+0000 7f41c995f700 1 -- 172.21.15.63:0/3408590544 >> 172.21.15.63:0/3408590544 conn(0x7f41c4069b70 msgr2=0x7f41c4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:16.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.705+0000 7f41c995f700 1 -- 172.21.15.63:0/3408590544 shutdown_connections 2020-05-18T21:27:16.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.705+0000 7f41c995f700 1 -- 172.21.15.63:0/3408590544 wait complete. 2020-05-18T21:27:16.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.705+0000 7f41c995f700 1 Processor -- start 2020-05-18T21:27:16.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.705+0000 7f41c995f700 1 -- start start 2020-05-18T21:27:16.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c995f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41c40b68d0 0x7f41c41565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:16.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c995f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f41c40b99d0 0x7f41c4156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:16.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c995f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c40b0080 con 0x7f41c41469b0 2020-05-18T21:27:16.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c995f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c40b0320 con 0x7f41c40b99d0 2020-05-18T21:27:16.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c995f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c40b05c0 con 0x7f41c40b68d0 2020-05-18T21:27:16.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c915e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f41c41469b0 0x7f41c4156e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55806/0 (socket says 172.21.15.63:55806) 2020-05-18T21:27:16.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c915e700 1 -- 172.21.15.63:0/3546760525 learned_addr learned my addr 172.21.15.63:0/3546760525 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:16.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c895d700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41c40b68d0 0x7f41c41565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c3fff700 1 --2- 172.21.15.63:0/3546760525 >> v2:172.21.15.155:3300/0 conn(0x7f41c40b99d0 0x7f41c4156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c1ffb700 1 -- 172.21.15.63:0/3546760525 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597346365 0 0) 0x7f41c40b0080 con 0x7f41c41469b0 2020-05-18T21:27:16.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c1ffb700 1 -- 172.21.15.63:0/3546760525 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41a4002fe0 con 0x7f41c41469b0 2020-05-18T21:27:16.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c3fff700 1 -- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41c40b68d0 msgr2=0x7f41c41565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c3fff700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41c40b68d0 0x7f41c41565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:16.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c3fff700 1 -- 172.21.15.63:0/3546760525 >> v1:172.21.15.63:6789/0 conn(0x7f41c41469b0 legacy=0x7f41c4156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c3fff700 1 -- 172.21.15.63:0/3546760525 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c40ad8d0 con 0x7f41c40b99d0 2020-05-18T21:27:16.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c3fff700 1 --2- 172.21.15.63:0/3546760525 >> v2:172.21.15.155:3300/0 conn(0x7f41c40b99d0 0x7f41c4156a00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41b8001110 tx=0x7f41b80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c3fff700 1 --2- 172.21.15.63:0/3546760525 >> v2:172.21.15.155:3300/0 conn(0x7f41c40b99d0 0x7f41c4156a00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41b8001110 tx=0x7f41b80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c3fff700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c40b99d0 0x7f41c4156a00 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7f41b8001110 tx=0x7f41b80108e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:16.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c3fff700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c40b99d0 0x7f41c4156a00 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f41b8001110 tx=0x7f41b80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c1ffb700 1 -- 172.21.15.63:0/3546760525 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41b8006c00 con 0x7f41c40b99d0 2020-05-18T21:27:16.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c3fff700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c40b99d0 0x7f41c4156a00 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f41b8001110 tx=0x7f41b80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c1ffb700 1 -- 172.21.15.63:0/3546760525 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b8006da0 con 0x7f41c40b99d0 2020-05-18T21:27:16.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c3fff700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c40b99d0 0x7f41c4156a00 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f41b8001110 tx=0x7f41b80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c995f700 1 -- 172.21.15.63:0/3546760525 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c40adb20 con 0x7f41c40b99d0 2020-05-18T21:27:16.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c1ffb700 1 -- 172.21.15.63:0/3546760525 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41b8008370 con 0x7f41c40b99d0 2020-05-18T21:27:16.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.709+0000 7f41c995f700 1 -- 172.21.15.63:0/3546760525 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c4144fc0 con 0x7f41c40b99d0 2020-05-18T21:27:16.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.713+0000 7f41c3fff700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c40b99d0 0x7f41c4156a00 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f41b8001110 tx=0x7f41b80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.713+0000 7f41c995f700 1 -- 172.21.15.63:0/3546760525 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c40569e0 con 0x7f41c40b99d0 2020-05-18T21:27:16.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.713+0000 7f41c1ffb700 1 -- 172.21.15.63:0/3546760525 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f41b8008630 con 0x7f41c40b99d0 2020-05-18T21:27:16.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.713+0000 7f41c3fff700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c40b99d0 0x7f41c4156a00 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f41b8001110 tx=0x7f41b80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.713+0000 7f41c1ffb700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41a404fd40 0x7f41a4052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:16.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.713+0000 7f41c1ffb700 1 -- 172.21.15.63:0/3546760525 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f41b8063ce0 con 0x7f41c40b99d0 2020-05-18T21:27:16.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.713+0000 7f41c895d700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41a404fd40 0x7f41a4052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.713+0000 7f41c895d700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41a404fd40 0x7f41a4052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41b4001110 tx=0x7f41b4001d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.713+0000 7f41c895d700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41a404fd40 0x7f41a4052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41b4001110 tx=0x7f41b4001d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.713+0000 7f41c895d700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41a404fd40 0x7f41a4052200 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f41b4001110 tx=0x7f41b4001d80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:16.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.721+0000 7f41c3fff700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c40b99d0 0x7f41c4156a00 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f41b8001110 tx=0x7f41b80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.721+0000 7f41c1ffb700 1 -- 172.21.15.63:0/3546760525 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f41b803e0d0 con 0x7f41c40b99d0 2020-05-18T21:27:16.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.837+0000 7f41c995f700 1 -- 172.21.15.63:0/3546760525 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f41c40008d0 con 0x7f41c40b99d0 2020-05-18T21:27:16.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.837+0000 7f41c3fff700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c40b99d0 0x7f41c4156a00 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f41b8001110 tx=0x7f41b80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.837+0000 7f41c1ffb700 1 -- 172.21.15.63:0/3546760525 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f41b80416f0 con 0x7f41c40b99d0 2020-05-18T21:27:16.846 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:16.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.841+0000 7f41c995f700 1 -- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41a404fd40 msgr2=0x7f41a4052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.841+0000 7f41c995f700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41a404fd40 0x7f41a4052200 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f41b4001110 tx=0x7f41b4001d80).stop 2020-05-18T21:27:16.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.841+0000 7f41c995f700 1 -- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c40b99d0 msgr2=0x7f41c4156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.841+0000 7f41c995f700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c40b99d0 0x7f41c4156a00 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7f41b8001110 tx=0x7f41b80108e0).stop 2020-05-18T21:27:16.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.841+0000 7f41c995f700 1 -- 172.21.15.63:0/3546760525 shutdown_connections 2020-05-18T21:27:16.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.841+0000 7f41c995f700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41a404fd40 0x7f41a4052200 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:16.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.841+0000 7f41c995f700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c40b99d0 0x7f41c4156a00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:16.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.841+0000 7f41c995f700 1 --2- 172.21.15.63:0/3546760525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41c40b68d0 0x7f41c41565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:16.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.841+0000 7f41c995f700 1 -- 172.21.15.63:0/3546760525 >> 172.21.15.63:0/3546760525 conn(0x7f41c4069b70 msgr2=0x7f41c413fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:16.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.841+0000 7f41c995f700 1 -- 172.21.15.63:0/3546760525 shutdown_connections 2020-05-18T21:27:16.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.841+0000 7f41c995f700 1 -- 172.21.15.63:0/3546760525 wait complete. 2020-05-18T21:27:16.863 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:27:16.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.961+0000 7f44ef3d9700 1 Processor -- start 2020-05-18T21:27:16.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.961+0000 7f44ef3d9700 1 -- start start 2020-05-18T21:27:16.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ef3d9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f44e805ed60 0x7f44e8144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:16.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ef3d9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44e805f5f0 0x7f44e8061c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:16.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ef3d9700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e8065330 con 0x7f44e805f140 2020-05-18T21:27:16.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ef3d9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e806a700 con 0x7f44e805ed60 2020-05-18T21:27:16.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ef3d9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e806a9a0 con 0x7f44e805f5f0 2020-05-18T21:27:16.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44edbd6700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f44e805f140 0x7f44e80b5ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55812/0 (socket says 172.21.15.63:55812) 2020-05-18T21:27:16.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44edbd6700 1 -- 172.21.15.63:0/2401369341 learned_addr learned my addr 172.21.15.63:0/2401369341 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:16.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44eebd8700 1 --2- 172.21.15.63:0/2401369341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44e805f5f0 0x7f44e8061c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ee3d7700 1 --2- 172.21.15.63:0/2401369341 >> v2:172.21.15.155:3300/0 conn(0x7f44e805ed60 0x7f44e8144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ed3d5700 1 -- 172.21.15.63:0/2401369341 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3141420664 0 0) 0x7f44e8065330 con 0x7f44e805f140 2020-05-18T21:27:16.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ed3d5700 1 -- 172.21.15.63:0/2401369341 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44d0003270 con 0x7f44e805f140 2020-05-18T21:27:16.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ee3d7700 1 -- 172.21.15.63:0/2401369341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44e805f5f0 msgr2=0x7f44e8061c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:16.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ed3d5700 1 -- 172.21.15.63:0/2401369341 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 642330095 0 0) 0x7f44d0003270 con 0x7f44e805f140 2020-05-18T21:27:16.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ee3d7700 1 --2- 172.21.15.63:0/2401369341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44e805f5f0 0x7f44e8061c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:16.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ee3d7700 1 -- 172.21.15.63:0/2401369341 >> v1:172.21.15.63:6789/0 conn(0x7f44e805f140 legacy=0x7f44e80b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ee3d7700 1 -- 172.21.15.63:0/2401369341 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e80b6600 con 0x7f44e805ed60 2020-05-18T21:27:16.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44eebd8700 1 --2- 172.21.15.63:0/2401369341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44e805f5f0 0x7f44e8061c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:16.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ee3d7700 1 --2- 172.21.15.63:0/2401369341 >> v2:172.21.15.155:3300/0 conn(0x7f44e805ed60 0x7f44e8144ae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f44dc0018b0 tx=0x7f44e4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ee3d7700 1 --2- 172.21.15.63:0/2401369341 >> v2:172.21.15.155:3300/0 conn(0x7f44e805ed60 0x7f44e8144ae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f44dc0018b0 tx=0x7f44e4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ee3d7700 1 --2- 172.21.15.63:0/2401369341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44e805ed60 0x7f44e8144ae0 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7f44dc0018b0 tx=0x7f44e4007a80).ready entity=mon.1 client_cookie=25e88c06f4e0b935 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:16.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ee3d7700 1 --2- 172.21.15.63:0/2401369341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44e805ed60 0x7f44e8144ae0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f44dc0018b0 tx=0x7f44e4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ed3d5700 1 -- 172.21.15.63:0/2401369341 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44dc001710 con 0x7f44e805ed60 2020-05-18T21:27:16.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ee3d7700 1 --2- 172.21.15.63:0/2401369341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44e805ed60 0x7f44e8144ae0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f44dc0018b0 tx=0x7f44e4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ed3d5700 1 -- 172.21.15.63:0/2401369341 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e4008e40 con 0x7f44e805ed60 2020-05-18T21:27:16.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ee3d7700 1 --2- 172.21.15.63:0/2401369341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44e805ed60 0x7f44e8144ae0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f44dc0018b0 tx=0x7f44e4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ed3d5700 1 -- 172.21.15.63:0/2401369341 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44e4011440 con 0x7f44e805ed60 2020-05-18T21:27:16.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ef3d9700 1 -- 172.21.15.63:0/2401369341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44e805ed60 msgr2=0x7f44e8144ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ef3d9700 1 --2- 172.21.15.63:0/2401369341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44e805ed60 0x7f44e8144ae0 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7f44dc0018b0 tx=0x7f44e4007a80).stop 2020-05-18T21:27:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ef3d9700 1 -- 172.21.15.63:0/2401369341 shutdown_connections 2020-05-18T21:27:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ef3d9700 1 --2- 172.21.15.63:0/2401369341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44e805f5f0 0x7f44e8061c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ef3d9700 1 --2- 172.21.15.63:0/2401369341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44e805ed60 0x7f44e8144ae0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ef3d9700 1 -- 172.21.15.63:0/2401369341 >> 172.21.15.63:0/2401369341 conn(0x7f44e805a7c0 msgr2=0x7f44e805aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ef3d9700 1 -- 172.21.15.63:0/2401369341 shutdown_connections 2020-05-18T21:27:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.965+0000 7f44ef3d9700 1 -- 172.21.15.63:0/2401369341 wait complete. 2020-05-18T21:27:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.969+0000 7f44ef3d9700 1 Processor -- start 2020-05-18T21:27:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.969+0000 7f44ef3d9700 1 -- start start 2020-05-18T21:27:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.969+0000 7f44ef3d9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f44e805ed60 0x7f44e80b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.969+0000 7f44ef3d9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f44e805f140 0x7f44e8151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.969+0000 7f44ef3d9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e80b5630 con 0x7f44e805f5f0 2020-05-18T21:27:16.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.969+0000 7f44ef3d9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e81518a0 con 0x7f44e805f140 2020-05-18T21:27:16.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.969+0000 7f44ef3d9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e8151b40 con 0x7f44e805ed60 2020-05-18T21:27:16.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.969+0000 7f44edbd6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f44e805f140 0x7f44e8151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.969+0000 7f44edbd6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f44e805f140 0x7f44e8151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53630/0 (socket says 172.21.15.63:53630) 2020-05-18T21:27:16.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.969+0000 7f44edbd6700 1 -- 172.21.15.63:0/2227166261 learned_addr learned my addr 172.21.15.63:0/2227166261 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:16.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.969+0000 7f44ee3d7700 1 --2- 172.21.15.63:0/2227166261 >> v2:172.21.15.155:3300/0 conn(0x7f44e805ed60 0x7f44e80b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.973+0000 7f44edbd6700 1 -- 172.21.15.63:0/2227166261 >> v2:172.21.15.155:3300/0 conn(0x7f44e805ed60 msgr2=0x7f44e80b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.973+0000 7f44edbd6700 1 --2- 172.21.15.63:0/2227166261 >> v2:172.21.15.155:3300/0 conn(0x7f44e805ed60 0x7f44e80b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:16.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.973+0000 7f44edbd6700 1 -- 172.21.15.63:0/2227166261 >> v1:172.21.15.155:6789/0 conn(0x7f44e805f5f0 legacy=0x7f44e80b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:16.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.973+0000 7f44edbd6700 1 -- 172.21.15.63:0/2227166261 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e8151590 con 0x7f44e805f140 2020-05-18T21:27:16.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.973+0000 7f44edbd6700 1 --2- 172.21.15.63:0/2227166261 >> v2:172.21.15.63:3300/0 conn(0x7f44e805f140 0x7f44e8151fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f44dc001970 tx=0x7f44dc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.973+0000 7f44edbd6700 1 --2- 172.21.15.63:0/2227166261 >> v2:172.21.15.63:3300/0 conn(0x7f44e805f140 0x7f44e8151fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f44dc001970 tx=0x7f44dc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.973+0000 7f44edbd6700 1 --2- 172.21.15.63:0/2227166261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e805f140 0x7f44e8151fe0 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7f44dc001970 tx=0x7f44dc010cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:16.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.973+0000 7f44edbd6700 1 --2- 172.21.15.63:0/2227166261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e805f140 0x7f44e8151fe0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7f44dc001970 tx=0x7f44dc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.973+0000 7f44edbd6700 1 --2- 172.21.15.63:0/2227166261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e805f140 0x7f44e8151fe0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7f44dc001970 tx=0x7f44dc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.973+0000 7f44edbd6700 1 --2- 172.21.15.63:0/2227166261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e805f140 0x7f44e8151fe0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7f44dc001970 tx=0x7f44dc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.973+0000 7f44db7fe700 1 -- 172.21.15.63:0/2227166261 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44dc00cc60 con 0x7f44e805f140 2020-05-18T21:27:16.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.973+0000 7f44db7fe700 1 -- 172.21.15.63:0/2227166261 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc00cdc0 con 0x7f44e805f140 2020-05-18T21:27:16.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.973+0000 7f44ef3d9700 1 -- 172.21.15.63:0/2227166261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e8152440 con 0x7f44e805f140 2020-05-18T21:27:16.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.973+0000 7f44db7fe700 1 -- 172.21.15.63:0/2227166261 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44dc004720 con 0x7f44e805f140 2020-05-18T21:27:16.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.973+0000 7f44ef3d9700 1 -- 172.21.15.63:0/2227166261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e80b3610 con 0x7f44e805f140 2020-05-18T21:27:16.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.973+0000 7f44edbd6700 1 --2- 172.21.15.63:0/2227166261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e805f140 0x7f44e8151fe0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7f44dc001970 tx=0x7f44dc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.973+0000 7f44ef3d9700 1 -- 172.21.15.63:0/2227166261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e80569e0 con 0x7f44e805f140 2020-05-18T21:27:16.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.973+0000 7f44db7fe700 1 -- 172.21.15.63:0/2227166261 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f44dc004990 con 0x7f44e805f140 2020-05-18T21:27:16.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.973+0000 7f44edbd6700 1 --2- 172.21.15.63:0/2227166261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e805f140 0x7f44e8151fe0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7f44dc001970 tx=0x7f44dc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.977+0000 7f44db7fe700 1 --2- 172.21.15.63:0/2227166261 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f44c804f9e0 0x7f44c8051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:16.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.977+0000 7f44db7fe700 1 -- 172.21.15.63:0/2227166261 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f44dc0682b0 con 0x7f44e805f140 2020-05-18T21:27:16.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.977+0000 7f44ee3d7700 1 --2- 172.21.15.63:0/2227166261 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f44c804f9e0 0x7f44c8051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:16.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.977+0000 7f44ee3d7700 1 --2- 172.21.15.63:0/2227166261 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f44c804f9e0 0x7f44c8051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f44dc0018b0 tx=0x7f44e4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.977+0000 7f44ee3d7700 1 --2- 172.21.15.63:0/2227166261 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f44c804f9e0 0x7f44c8051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f44dc0018b0 tx=0x7f44e4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.977+0000 7f44ee3d7700 1 --2- 172.21.15.63:0/2227166261 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f44c804f9e0 0x7f44c8051ea0 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f44dc0018b0 tx=0x7f44e4007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:16.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.981+0000 7f44edbd6700 1 --2- 172.21.15.63:0/2227166261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e805f140 0x7f44e8151fe0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7f44dc001970 tx=0x7f44dc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:16.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:16.981+0000 7f44db7fe700 1 -- 172.21.15.63:0/2227166261 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f44dc042640 con 0x7f44e805f140 2020-05-18T21:27:17.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.093+0000 7f44ef3d9700 1 -- 172.21.15.63:0/2227166261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f44e8151cb0 con 0x7f44e805f140 2020-05-18T21:27:17.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.097+0000 7f44edbd6700 1 --2- 172.21.15.63:0/2227166261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e805f140 0x7f44e8151fe0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7f44dc001970 tx=0x7f44dc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.097+0000 7f44db7fe700 1 -- 172.21.15.63:0/2227166261 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f44dc045c60 con 0x7f44e805f140 2020-05-18T21:27:17.103 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:17.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.097+0000 7f44ef3d9700 1 -- 172.21.15.63:0/2227166261 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f44c804f9e0 msgr2=0x7f44c8051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.097+0000 7f44ef3d9700 1 --2- 172.21.15.63:0/2227166261 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f44c804f9e0 0x7f44c8051ea0 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f44dc0018b0 tx=0x7f44e4007a80).stop 2020-05-18T21:27:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.097+0000 7f44ef3d9700 1 -- 172.21.15.63:0/2227166261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e805f140 msgr2=0x7f44e8151fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.097+0000 7f44ef3d9700 1 --2- 172.21.15.63:0/2227166261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e805f140 0x7f44e8151fe0 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7f44dc001970 tx=0x7f44dc010cb0).stop 2020-05-18T21:27:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.097+0000 7f44ef3d9700 1 -- 172.21.15.63:0/2227166261 shutdown_connections 2020-05-18T21:27:17.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.097+0000 7f44ef3d9700 1 --2- 172.21.15.63:0/2227166261 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f44c804f9e0 0x7f44c8051ea0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:17.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.097+0000 7f44ef3d9700 1 --2- 172.21.15.63:0/2227166261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e805f140 0x7f44e8151fe0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:17.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.097+0000 7f44ef3d9700 1 --2- 172.21.15.63:0/2227166261 >> v2:172.21.15.155:3300/0 conn(0x7f44e805ed60 0x7f44e80b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:17.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.097+0000 7f44ef3d9700 1 -- 172.21.15.63:0/2227166261 >> 172.21.15.63:0/2227166261 conn(0x7f44e805a7c0 msgr2=0x7f44e8147600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:17.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.097+0000 7f44ef3d9700 1 -- 172.21.15.63:0/2227166261 shutdown_connections 2020-05-18T21:27:17.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.097+0000 7f44ef3d9700 1 -- 172.21.15.63:0/2227166261 wait complete. 2020-05-18T21:27:17.115 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:27:17.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63db37c700 1 Processor -- start 2020-05-18T21:27:17.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63db37c700 1 -- start start 2020-05-18T21:27:17.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63db37c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4145a10 0x7f63d40b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:17.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63db37c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f63d4146960 0x7f63d40606c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:17.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63db37c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d4145df0 con 0x7f63d4060b20 2020-05-18T21:27:17.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63db37c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d4146e40 con 0x7f63d4146960 2020-05-18T21:27:17.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63db37c700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d4149550 con 0x7f63d4145a10 2020-05-18T21:27:17.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63d8917700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f63d4146960 0x7f63d40606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:17.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63d8917700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f63d4146960 0x7f63d40606c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53638/0 (socket says 172.21.15.63:53638) 2020-05-18T21:27:17.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63d8917700 1 -- 172.21.15.63:0/937700974 learned_addr learned my addr 172.21.15.63:0/937700974 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:17.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63d9118700 1 --2- 172.21.15.63:0/937700974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4145a10 0x7f63d40b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:17.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63d8917700 1 -- 172.21.15.63:0/937700974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4145a10 msgr2=0x7f63d40b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:17.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63d8917700 1 --2- 172.21.15.63:0/937700974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4145a10 0x7f63d40b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:17.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63d8917700 1 -- 172.21.15.63:0/937700974 >> v1:172.21.15.155:6789/0 conn(0x7f63d4060b20 legacy=0x7f63d40b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63d8917700 1 -- 172.21.15.63:0/937700974 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d41497f0 con 0x7f63d4146960 2020-05-18T21:27:17.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63d8917700 1 --2- 172.21.15.63:0/937700974 >> v2:172.21.15.63:3300/0 conn(0x7f63d4146960 0x7f63d40606c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f63c4002f70 tx=0x7f63c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63d8917700 1 --2- 172.21.15.63:0/937700974 >> v2:172.21.15.63:3300/0 conn(0x7f63d4146960 0x7f63d40606c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f63c4002f70 tx=0x7f63c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63d8917700 1 --2- 172.21.15.63:0/937700974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63d4146960 0x7f63d40606c0 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f63c4002f70 tx=0x7f63c4007a80).ready entity=mon.0 client_cookie=cd6492bb562bbfdf server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:17.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63d8917700 1 --2- 172.21.15.63:0/937700974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63d4146960 0x7f63d40606c0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f63c4002f70 tx=0x7f63c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63c3fff700 1 -- 172.21.15.63:0/937700974 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63c40116b0 con 0x7f63d4146960 2020-05-18T21:27:17.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63d8917700 1 --2- 172.21.15.63:0/937700974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63d4146960 0x7f63d40606c0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f63c4002f70 tx=0x7f63c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63d8917700 1 --2- 172.21.15.63:0/937700974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63d4146960 0x7f63d40606c0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f63c4002f70 tx=0x7f63c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63c3fff700 1 -- 172.21.15.63:0/937700974 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c4011810 con 0x7f63d4146960 2020-05-18T21:27:17.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63c3fff700 1 -- 172.21.15.63:0/937700974 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63c4011c30 con 0x7f63d4146960 2020-05-18T21:27:17.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63db37c700 1 -- 172.21.15.63:0/937700974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63d4146960 msgr2=0x7f63d40606c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.217+0000 7f63db37c700 1 --2- 172.21.15.63:0/937700974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63d4146960 0x7f63d40606c0 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f63c4002f70 tx=0x7f63c4007a80).stop 2020-05-18T21:27:17.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.221+0000 7f63db37c700 1 -- 172.21.15.63:0/937700974 shutdown_connections 2020-05-18T21:27:17.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.221+0000 7f63db37c700 1 --2- 172.21.15.63:0/937700974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63d4146960 0x7f63d40606c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:17.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.221+0000 7f63db37c700 1 --2- 172.21.15.63:0/937700974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4145a10 0x7f63d40b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:17.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.221+0000 7f63db37c700 1 -- 172.21.15.63:0/937700974 >> 172.21.15.63:0/937700974 conn(0x7f63d40b70a0 msgr2=0x7f63d40b74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:17.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.221+0000 7f63db37c700 1 -- 172.21.15.63:0/937700974 shutdown_connections 2020-05-18T21:27:17.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.221+0000 7f63db37c700 1 -- 172.21.15.63:0/937700974 wait complete. 2020-05-18T21:27:17.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.221+0000 7f63db37c700 1 Processor -- start 2020-05-18T21:27:17.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.221+0000 7f63db37c700 1 -- start start 2020-05-18T21:27:17.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.221+0000 7f63db37c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4060b20 0x7f63d4157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:17.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.221+0000 7f63db37c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d4093a40 con 0x7f63d4145a10 2020-05-18T21:27:17.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.221+0000 7f63db37c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d40a01b0 con 0x7f63d4146960 2020-05-18T21:27:17.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.221+0000 7f63db37c700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d40a0450 con 0x7f63d4060b20 2020-05-18T21:27:17.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.221+0000 7f63d8917700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f63d4145a10 0x7f63d4093330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55832/0 (socket says 172.21.15.63:55832) 2020-05-18T21:27:17.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.221+0000 7f63d8917700 1 -- 172.21.15.63:0/3825567274 learned_addr learned my addr 172.21.15.63:0/3825567274 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:17.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.221+0000 7f63d9118700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4060b20 0x7f63d4157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:17.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63c27fc700 1 -- 172.21.15.63:0/3825567274 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216808916 0 0) 0x7f63d4093a40 con 0x7f63d4145a10 2020-05-18T21:27:17.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63c27fc700 1 -- 172.21.15.63:0/3825567274 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63b4002fe0 con 0x7f63d4145a10 2020-05-18T21:27:17.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63c27fc700 1 -- 172.21.15.63:0/3825567274 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495083626 0 0) 0x7f63d40a01b0 con 0x7f63d4146960 2020-05-18T21:27:17.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63c27fc700 1 -- 172.21.15.63:0/3825567274 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63d4093a40 con 0x7f63d4146960 2020-05-18T21:27:17.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63c27fc700 1 -- 172.21.15.63:0/3825567274 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 424575874 0 0) 0x7f63b4002fe0 con 0x7f63d4145a10 2020-05-18T21:27:17.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63d9118700 1 -- 172.21.15.63:0/3825567274 >> v1:172.21.15.155:6789/0 conn(0x7f63d4146960 legacy=0x7f63d4090990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63d9118700 1 -- 172.21.15.63:0/3825567274 >> v1:172.21.15.63:6789/0 conn(0x7f63d4145a10 legacy=0x7f63d4093330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63d9118700 1 -- 172.21.15.63:0/3825567274 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d4153290 con 0x7f63d4060b20 2020-05-18T21:27:17.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63d9118700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4060b20 0x7f63d4157320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f63c4008950 tx=0x7f63d0010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63d9118700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4060b20 0x7f63d4157320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f63c4008950 tx=0x7f63d0010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63d9118700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4060b20 0x7f63d4157320 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f63c4008950 tx=0x7f63d0010c00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:17.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63d9118700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4060b20 0x7f63d4157320 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f63c4008950 tx=0x7f63d0010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63c27fc700 1 -- 172.21.15.63:0/3825567274 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63c4011ea0 con 0x7f63d4060b20 2020-05-18T21:27:17.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63d9118700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4060b20 0x7f63d4157320 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f63c4008950 tx=0x7f63d0010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63d9118700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4060b20 0x7f63d4157320 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f63c4008950 tx=0x7f63d0010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63c27fc700 1 -- 172.21.15.63:0/3825567274 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d0007360 con 0x7f63d4060b20 2020-05-18T21:27:17.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63db37c700 1 -- 172.21.15.63:0/3825567274 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d40910a0 con 0x7f63d4060b20 2020-05-18T21:27:17.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63c27fc700 1 -- 172.21.15.63:0/3825567274 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63d0005700 con 0x7f63d4060b20 2020-05-18T21:27:17.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63db37c700 1 -- 172.21.15.63:0/3825567274 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d409fb10 con 0x7f63d4060b20 2020-05-18T21:27:17.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63d9118700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4060b20 0x7f63d4157320 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f63c4008950 tx=0x7f63d0010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63db37c700 1 -- 172.21.15.63:0/3825567274 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d40569e0 con 0x7f63d4060b20 2020-05-18T21:27:17.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63c27fc700 1 -- 172.21.15.63:0/3825567274 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f63d0005900 con 0x7f63d4060b20 2020-05-18T21:27:17.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63d9118700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4060b20 0x7f63d4157320 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f63c4008950 tx=0x7f63d0010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63c27fc700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f63b404fe30 0x7f63b40522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:17.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.225+0000 7f63c27fc700 1 -- 172.21.15.63:0/3825567274 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f63d00636a0 con 0x7f63d4060b20 2020-05-18T21:27:17.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.229+0000 7f63d8917700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f63b404fe30 0x7f63b40522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:17.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.229+0000 7f63d8917700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f63b404fe30 0x7f63b40522f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f63c4010290 tx=0x7f63c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.229+0000 7f63d8917700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f63b404fe30 0x7f63b40522f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f63c4010290 tx=0x7f63c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.229+0000 7f63d8917700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f63b404fe30 0x7f63b40522f0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f63c4010290 tx=0x7f63c4007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:17.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.237+0000 7f63d9118700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4060b20 0x7f63d4157320 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f63c4008950 tx=0x7f63d0010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.237+0000 7f63c27fc700 1 -- 172.21.15.63:0/3825567274 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f63d003da90 con 0x7f63d4060b20 2020-05-18T21:27:17.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.353+0000 7f63db37c700 1 -- 172.21.15.63:0/3825567274 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f63d4153480 con 0x7f63d4060b20 2020-05-18T21:27:17.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.353+0000 7f63d9118700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4060b20 0x7f63d4157320 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f63c4008950 tx=0x7f63d0010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.353+0000 7f63c27fc700 1 -- 172.21.15.63:0/3825567274 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f63d00410b0 con 0x7f63d4060b20 2020-05-18T21:27:17.361 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:17.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.357+0000 7f63db37c700 1 -- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f63b404fe30 msgr2=0x7f63b40522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.357+0000 7f63db37c700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f63b404fe30 0x7f63b40522f0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f63c4010290 tx=0x7f63c4007a80).stop 2020-05-18T21:27:17.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.357+0000 7f63db37c700 1 -- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4060b20 msgr2=0x7f63d4157320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.357+0000 7f63db37c700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4060b20 0x7f63d4157320 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f63c4008950 tx=0x7f63d0010c00).stop 2020-05-18T21:27:17.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.357+0000 7f63db37c700 1 -- 172.21.15.63:0/3825567274 shutdown_connections 2020-05-18T21:27:17.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.357+0000 7f63db37c700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f63b404fe30 0x7f63b40522f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:17.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.357+0000 7f63db37c700 1 --2- 172.21.15.63:0/3825567274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63d4060b20 0x7f63d4157320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:17.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.357+0000 7f63db37c700 1 -- 172.21.15.63:0/3825567274 >> 172.21.15.63:0/3825567274 conn(0x7f63d40b70a0 msgr2=0x7f63d4065b60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:17.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.357+0000 7f63db37c700 1 -- 172.21.15.63:0/3825567274 shutdown_connections 2020-05-18T21:27:17.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.357+0000 7f63db37c700 1 -- 172.21.15.63:0/3825567274 wait complete. 2020-05-18T21:27:17.374 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:27:17.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.469+0000 7ff4f423a700 1 Processor -- start 2020-05-18T21:27:17.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.469+0000 7ff4f423a700 1 -- start start 2020-05-18T21:27:17.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.469+0000 7ff4f423a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4ec0b2860 0x7ff4ec0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:17.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.469+0000 7ff4f423a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ec14d960 con 0x7ff4ec060b90 2020-05-18T21:27:17.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.469+0000 7ff4f423a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ec14db90 con 0x7ff4ec14e570 2020-05-18T21:27:17.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.469+0000 7ff4f423a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec066210 con 0x7ff4ec0b2860 2020-05-18T21:27:17.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.469+0000 7ff4f1fd6700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff4ec060b90 0x7ff4ec144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55838/0 (socket says 172.21.15.63:55838) 2020-05-18T21:27:17.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f1fd6700 1 -- 172.21.15.63:0/1229883738 learned_addr learned my addr 172.21.15.63:0/1229883738 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:17.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f17d5700 1 --2- 172.21.15.63:0/1229883738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4ec0b2860 0x7ff4ec0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:17.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f0fd4700 1 -- 172.21.15.63:0/1229883738 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435876985 0 0) 0x7ff4ec14db90 con 0x7ff4ec14e570 2020-05-18T21:27:17.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f0fd4700 1 -- 172.21.15.63:0/1229883738 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4d4003270 con 0x7ff4ec14e570 2020-05-18T21:27:17.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f0fd4700 1 -- 172.21.15.63:0/1229883738 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620424976 0 0) 0x7ff4ec14d960 con 0x7ff4ec060b90 2020-05-18T21:27:17.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f17d5700 1 -- 172.21.15.63:0/1229883738 >> v1:172.21.15.155:6789/0 conn(0x7ff4ec14e570 legacy=0x7ff4ec14a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f17d5700 1 -- 172.21.15.63:0/1229883738 >> v1:172.21.15.63:6789/0 conn(0x7ff4ec060b90 legacy=0x7ff4ec144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f17d5700 1 -- 172.21.15.63:0/1229883738 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec14de30 con 0x7ff4ec0b2860 2020-05-18T21:27:17.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f17d5700 1 --2- 172.21.15.63:0/1229883738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4ec0b2860 0x7ff4ec0615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff4e8002f70 tx=0x7ff4e8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f17d5700 1 --2- 172.21.15.63:0/1229883738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4ec0b2860 0x7ff4ec0615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff4e8002f70 tx=0x7ff4e8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f17d5700 1 --2- 172.21.15.63:0/1229883738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4ec0b2860 0x7ff4ec0615e0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7ff4e8002f70 tx=0x7ff4e8008920).ready entity=mon.2 client_cookie=93de19f3657d7e1b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:17.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f17d5700 1 --2- 172.21.15.63:0/1229883738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4ec0b2860 0x7ff4ec0615e0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7ff4e8002f70 tx=0x7ff4e8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f0fd4700 1 -- 172.21.15.63:0/1229883738 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4e8008e80 con 0x7ff4ec0b2860 2020-05-18T21:27:17.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f17d5700 1 --2- 172.21.15.63:0/1229883738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4ec0b2860 0x7ff4ec0615e0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7ff4e8002f70 tx=0x7ff4e8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f17d5700 1 --2- 172.21.15.63:0/1229883738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4ec0b2860 0x7ff4ec0615e0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7ff4e8002f70 tx=0x7ff4e8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f0fd4700 1 -- 172.21.15.63:0/1229883738 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e8011630 con 0x7ff4ec0b2860 2020-05-18T21:27:17.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f0fd4700 1 -- 172.21.15.63:0/1229883738 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4e80119d0 con 0x7ff4ec0b2860 2020-05-18T21:27:17.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f423a700 1 -- 172.21.15.63:0/1229883738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4ec0b2860 msgr2=0x7ff4ec0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f423a700 1 --2- 172.21.15.63:0/1229883738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4ec0b2860 0x7ff4ec0615e0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7ff4e8002f70 tx=0x7ff4e8008920).stop 2020-05-18T21:27:17.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f423a700 1 -- 172.21.15.63:0/1229883738 shutdown_connections 2020-05-18T21:27:17.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f423a700 1 --2- 172.21.15.63:0/1229883738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4ec0b2860 0x7ff4ec0615e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:17.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f423a700 1 -- 172.21.15.63:0/1229883738 >> 172.21.15.63:0/1229883738 conn(0x7ff4ec0b83d0 msgr2=0x7ff4ec0b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:17.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f423a700 1 -- 172.21.15.63:0/1229883738 shutdown_connections 2020-05-18T21:27:17.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.473+0000 7ff4f423a700 1 -- 172.21.15.63:0/1229883738 wait complete. 2020-05-18T21:27:17.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f423a700 1 Processor -- start 2020-05-18T21:27:17.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f423a700 1 -- start start 2020-05-18T21:27:17.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f423a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4ec060b90 0x7ff4ec145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:17.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f423a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff4ec14e570 0x7ff4ec14c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:17.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f423a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ec14c870 con 0x7ff4ec0b2860 2020-05-18T21:27:17.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f423a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ec14cab0 con 0x7ff4ec14e570 2020-05-18T21:27:17.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f423a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec14cd50 con 0x7ff4ec060b90 2020-05-18T21:27:17.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f17d5700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7ff4ec0b2860 0x7ff4ec15ad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:54162/0 (socket says 172.21.15.63:54162) 2020-05-18T21:27:17.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f17d5700 1 -- 172.21.15.63:0/2287548468 learned_addr learned my addr 172.21.15.63:0/2287548468 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:17.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f27d7700 1 --2- 172.21.15.63:0/2287548468 >> v2:172.21.15.155:3300/0 conn(0x7ff4ec14e570 0x7ff4ec14c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:17.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f1fd6700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4ec060b90 0x7ff4ec145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:17.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f27d7700 1 -- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4ec060b90 msgr2=0x7ff4ec145f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f27d7700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4ec060b90 0x7ff4ec145f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:17.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f27d7700 1 -- 172.21.15.63:0/2287548468 >> v1:172.21.15.155:6789/0 conn(0x7ff4ec0b2860 legacy=0x7ff4ec15ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f27d7700 1 -- 172.21.15.63:0/2287548468 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec14a390 con 0x7ff4ec14e570 2020-05-18T21:27:17.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f27d7700 1 --2- 172.21.15.63:0/2287548468 >> v2:172.21.15.155:3300/0 conn(0x7ff4ec14e570 0x7ff4ec14c410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4e4001490 tx=0x7ff4e4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f27d7700 1 --2- 172.21.15.63:0/2287548468 >> v2:172.21.15.155:3300/0 conn(0x7ff4ec14e570 0x7ff4ec14c410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4e4001490 tx=0x7ff4e4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f27d7700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4ec14e570 0x7ff4ec14c410 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7ff4e4001490 tx=0x7ff4e4010c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:17.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f27d7700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4ec14e570 0x7ff4ec14c410 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7ff4e4001490 tx=0x7ff4e4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4deffd700 1 -- 172.21.15.63:0/2287548468 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4e4006c80 con 0x7ff4ec14e570 2020-05-18T21:27:17.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f423a700 1 -- 172.21.15.63:0/2287548468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ec15b470 con 0x7ff4ec14e570 2020-05-18T21:27:17.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f27d7700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4ec14e570 0x7ff4ec14c410 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7ff4e4001490 tx=0x7ff4e4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f27d7700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4ec14e570 0x7ff4ec14c410 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7ff4e4001490 tx=0x7ff4e4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4deffd700 1 -- 172.21.15.63:0/2287548468 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e4006de0 con 0x7ff4ec14e570 2020-05-18T21:27:17.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4deffd700 1 -- 172.21.15.63:0/2287548468 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4e4012860 con 0x7ff4ec14e570 2020-05-18T21:27:17.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.477+0000 7ff4f423a700 1 -- 172.21.15.63:0/2287548468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ec1573c0 con 0x7ff4ec14e570 2020-05-18T21:27:17.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.481+0000 7ff4f423a700 1 -- 172.21.15.63:0/2287548468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ec14a520 con 0x7ff4ec14e570 2020-05-18T21:27:17.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.481+0000 7ff4f27d7700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4ec14e570 0x7ff4ec14c410 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7ff4e4001490 tx=0x7ff4e4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.481+0000 7ff4deffd700 1 -- 172.21.15.63:0/2287548468 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff4e400b0b0 con 0x7ff4ec14e570 2020-05-18T21:27:17.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.481+0000 7ff4f27d7700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4ec14e570 0x7ff4ec14c410 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7ff4e4001490 tx=0x7ff4e4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.481+0000 7ff4deffd700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff4cc04f9b0 0x7ff4cc051e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:17.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.481+0000 7ff4deffd700 1 -- 172.21.15.63:0/2287548468 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff4e4064040 con 0x7ff4ec14e570 2020-05-18T21:27:17.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.481+0000 7ff4f1fd6700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff4cc04f9b0 0x7ff4cc051e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:17.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.481+0000 7ff4f1fd6700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff4cc04f9b0 0x7ff4cc051e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4e0005540 tx=0x7ff4e0001d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.481+0000 7ff4f1fd6700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff4cc04f9b0 0x7ff4cc051e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4e0005540 tx=0x7ff4e0001d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.481+0000 7ff4f1fd6700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff4cc04f9b0 0x7ff4cc051e70 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7ff4e0005540 tx=0x7ff4e0001d70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:17.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.489+0000 7ff4f27d7700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4ec14e570 0x7ff4ec14c410 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7ff4e4001490 tx=0x7ff4e4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.489+0000 7ff4deffd700 1 -- 172.21.15.63:0/2287548468 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff4e403e430 con 0x7ff4ec14e570 2020-05-18T21:27:17.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.609+0000 7ff4f423a700 1 -- 172.21.15.63:0/2287548468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4ec0569e0 con 0x7ff4ec14e570 2020-05-18T21:27:17.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.609+0000 7ff4f27d7700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4ec14e570 0x7ff4ec14c410 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7ff4e4001490 tx=0x7ff4e4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.609+0000 7ff4deffd700 1 -- 172.21.15.63:0/2287548468 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16089 (secure 0 0 0) 0x7ff4e4041a50 con 0x7ff4ec14e570 2020-05-18T21:27:17.617 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:17.618 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":23,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:26:47.498250+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:26:43.453504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-05-18T21:26:44.456531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:27:17.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.613+0000 7ff4f423a700 1 -- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff4cc04f9b0 msgr2=0x7ff4cc051e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.613+0000 7ff4f423a700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff4cc04f9b0 0x7ff4cc051e70 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7ff4e0005540 tx=0x7ff4e0001d70).stop 2020-05-18T21:27:17.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.613+0000 7ff4f423a700 1 -- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4ec14e570 msgr2=0x7ff4ec14c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.613+0000 7ff4f423a700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4ec14e570 0x7ff4ec14c410 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7ff4e4001490 tx=0x7ff4e4010c40).stop 2020-05-18T21:27:17.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.613+0000 7ff4f423a700 1 -- 172.21.15.63:0/2287548468 shutdown_connections 2020-05-18T21:27:17.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.613+0000 7ff4f423a700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff4cc04f9b0 0x7ff4cc051e70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:17.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.613+0000 7ff4f423a700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4ec14e570 0x7ff4ec14c410 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:17.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.613+0000 7ff4f423a700 1 --2- 172.21.15.63:0/2287548468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4ec060b90 0x7ff4ec145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:17.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.613+0000 7ff4f423a700 1 -- 172.21.15.63:0/2287548468 >> 172.21.15.63:0/2287548468 conn(0x7ff4ec0b83d0 msgr2=0x7ff4ec0b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:17.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.613+0000 7ff4f423a700 1 -- 172.21.15.63:0/2287548468 shutdown_connections 2020-05-18T21:27:17.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.613+0000 7ff4f423a700 1 -- 172.21.15.63:0/2287548468 wait complete. 2020-05-18T21:27:17.630 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:26:43.453504+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:26:44.456531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:27:17.631 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:27:17.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73fac96700 1 Processor -- start 2020-05-18T21:27:17.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73fac96700 1 -- start start 2020-05-18T21:27:17.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73fac96700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f73f4061180 0x7f73f406a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:17.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73fac96700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f406a7d0 con 0x7f73f40b2eb0 2020-05-18T21:27:17.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73fac96700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f40b2a10 con 0x7f73f40b4f40 2020-05-18T21:27:17.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73fac96700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f40b5320 con 0x7f73f4061180 2020-05-18T21:27:17.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73fa495700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f73f40b2eb0 0x7f73f40b3320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55854/0 (socket says 172.21.15.63:55854) 2020-05-18T21:27:17.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73fa495700 1 -- 172.21.15.63:0/2094790875 learned_addr learned my addr 172.21.15.63:0/2094790875 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:17.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f9493700 1 --2- 172.21.15.63:0/2094790875 >> v2:172.21.15.155:3300/0 conn(0x7f73f4061180 0x7f73f406a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:17.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f8c92700 1 -- 172.21.15.63:0/2094790875 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268510880 0 0) 0x7f73f406a7d0 con 0x7f73f40b2eb0 2020-05-18T21:27:17.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f8c92700 1 -- 172.21.15.63:0/2094790875 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73dc003270 con 0x7f73f40b2eb0 2020-05-18T21:27:17.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f8c92700 1 -- 172.21.15.63:0/2094790875 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1051435602 0 0) 0x7f73dc003270 con 0x7f73f40b2eb0 2020-05-18T21:27:17.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f8c92700 1 -- 172.21.15.63:0/2094790875 >> v2:172.21.15.155:3300/0 conn(0x7f73f4061180 msgr2=0x7f73f406a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:17.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f8c92700 1 --2- 172.21.15.63:0/2094790875 >> v2:172.21.15.155:3300/0 conn(0x7f73f4061180 0x7f73f406a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:17.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f8c92700 1 -- 172.21.15.63:0/2094790875 >> v1:172.21.15.155:6789/0 conn(0x7f73f40b4f40 legacy=0x7f73f4132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f8c92700 1 -- 172.21.15.63:0/2094790875 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f41337f0 con 0x7f73f40b2eb0 2020-05-18T21:27:17.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f8c92700 1 -- 172.21.15.63:0/2094790875 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f73ec001a90 con 0x7f73f40b2eb0 2020-05-18T21:27:17.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f8c92700 1 -- 172.21.15.63:0/2094790875 >> v1:172.21.15.63:6789/0 conn(0x7f73f40b2eb0 legacy=0x7f73f40b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f8c92700 1 --2- 172.21.15.63:0/2094790875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73dc003760 0x7f73dc003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:17.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f8c92700 1 --2- 172.21.15.63:0/2094790875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73dc004510 0x7f73dc004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:17.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f8c92700 1 --2- 172.21.15.63:0/2094790875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73dc004df0 0x7f73dc00b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:17.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f8c92700 1 -- 172.21.15.63:0/2094790875 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f40b5320 con 0x7f73dc004510 2020-05-18T21:27:17.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f8c92700 1 -- 172.21.15.63:0/2094790875 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc004200 con 0x7f73dc003760 2020-05-18T21:27:17.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f8c92700 1 -- 172.21.15.63:0/2094790875 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc00bbc0 con 0x7f73dc004df0 2020-05-18T21:27:17.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f9c94700 1 --2- 172.21.15.63:0/2094790875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73dc003760 0x7f73dc003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:17.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f9493700 1 --2- 172.21.15.63:0/2094790875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73dc004510 0x7f73dc004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:17.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73fa495700 1 --2- 172.21.15.63:0/2094790875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73dc004df0 0x7f73dc00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:17.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f9c94700 1 -- 172.21.15.63:0/2094790875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73dc004df0 msgr2=0x7f73dc00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:17.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f9c94700 1 --2- 172.21.15.63:0/2094790875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73dc004df0 0x7f73dc00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:17.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f9c94700 1 -- 172.21.15.63:0/2094790875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73dc004510 msgr2=0x7f73dc004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:17.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f9c94700 1 --2- 172.21.15.63:0/2094790875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73dc004510 0x7f73dc004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:17.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f9c94700 1 -- 172.21.15.63:0/2094790875 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc003270 con 0x7f73dc003760 2020-05-18T21:27:17.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73fa495700 1 --2- 172.21.15.63:0/2094790875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73dc004df0 0x7f73dc00b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:27:17.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f9493700 1 --2- 172.21.15.63:0/2094790875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73dc004510 0x7f73dc004990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:17.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73fa495700 1 -- 172.21.15.63:0/2094790875 reap_dead start 2020-05-18T21:27:17.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f9c94700 1 --2- 172.21.15.63:0/2094790875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73dc003760 0x7f73dc003b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f73dc0054e0 tx=0x7f73f000fd60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f9c94700 1 --2- 172.21.15.63:0/2094790875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73dc003760 0x7f73dc003b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f73dc0054e0 tx=0x7f73f000fd60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f9c94700 1 --2- 172.21.15.63:0/2094790875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73dc003760 0x7f73dc003b80 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f73dc0054e0 tx=0x7f73f000fd60).ready entity=mon.1 client_cookie=5d50af6943171750 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:17.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f9c94700 1 --2- 172.21.15.63:0/2094790875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73dc003760 0x7f73dc003b80 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f73dc0054e0 tx=0x7f73f000fd60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f8c92700 1 -- 172.21.15.63:0/2094790875 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73f0003560 con 0x7f73dc003760 2020-05-18T21:27:17.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f9c94700 1 --2- 172.21.15.63:0/2094790875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73dc003760 0x7f73dc003b80 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f73dc0054e0 tx=0x7f73f000fd60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f8c92700 1 -- 172.21.15.63:0/2094790875 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f00036c0 con 0x7f73dc003760 2020-05-18T21:27:17.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f9c94700 1 --2- 172.21.15.63:0/2094790875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73dc003760 0x7f73dc003b80 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f73dc0054e0 tx=0x7f73f000fd60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73fac96700 1 -- 172.21.15.63:0/2094790875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73dc003760 msgr2=0x7f73dc003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73f8c92700 1 -- 172.21.15.63:0/2094790875 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73f0003a60 con 0x7f73dc003760 2020-05-18T21:27:17.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.729+0000 7f73fac96700 1 --2- 172.21.15.63:0/2094790875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73dc003760 0x7f73dc003b80 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f73dc0054e0 tx=0x7f73f000fd60).stop 2020-05-18T21:27:17.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.733+0000 7f73fac96700 1 -- 172.21.15.63:0/2094790875 shutdown_connections 2020-05-18T21:27:17.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.733+0000 7f73fac96700 1 --2- 172.21.15.63:0/2094790875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73dc003760 0x7f73dc003b80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:17.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.733+0000 7f73fac96700 1 -- 172.21.15.63:0/2094790875 >> 172.21.15.63:0/2094790875 conn(0x7f73f405fbd0 msgr2=0x7f73f4069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:17.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.733+0000 7f73fac96700 1 -- 172.21.15.63:0/2094790875 shutdown_connections 2020-05-18T21:27:17.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.733+0000 7f73fac96700 1 -- 172.21.15.63:0/2094790875 wait complete. 2020-05-18T21:27:17.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.733+0000 7f73fac96700 1 Processor -- start 2020-05-18T21:27:17.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.733+0000 7f73fac96700 1 -- start start 2020-05-18T21:27:17.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73fac96700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f73dc003760 0x7f73f40b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:17.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73fac96700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f40b4490 con 0x7f73f4062dd0 2020-05-18T21:27:17.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73fac96700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f4148e00 con 0x7f73f41497e0 2020-05-18T21:27:17.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73fac96700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f41490a0 con 0x7f73dc003760 2020-05-18T21:27:17.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73f9c94700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f73dc003760 0x7f73f40b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:17.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73f9c94700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f73dc003760 0x7f73f40b4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53676/0 (socket says 172.21.15.63:53676) 2020-05-18T21:27:17.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73f9c94700 1 -- 172.21.15.63:0/1554632208 learned_addr learned my addr 172.21.15.63:0/1554632208 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:17.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73f9c94700 1 -- 172.21.15.63:0/1554632208 >> v1:172.21.15.155:6789/0 conn(0x7f73f41497e0 legacy=0x7f73f40626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73f9c94700 1 -- 172.21.15.63:0/1554632208 >> v1:172.21.15.63:6789/0 conn(0x7f73f4062dd0 legacy=0x7f73f4157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73e2ffd700 1 -- 172.21.15.63:0/1554632208 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425573871 0 0) 0x7f73f40b4490 con 0x7f73f4062dd0 2020-05-18T21:27:17.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73f9c94700 1 -- 172.21.15.63:0/1554632208 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f4149340 con 0x7f73dc003760 2020-05-18T21:27:17.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73f9c94700 1 --2- 172.21.15.63:0/1554632208 >> v2:172.21.15.63:3300/0 conn(0x7f73dc003760 0x7f73f40b4030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f73dc0054e0 tx=0x7f73f000fd60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73f9c94700 1 --2- 172.21.15.63:0/1554632208 >> v2:172.21.15.63:3300/0 conn(0x7f73dc003760 0x7f73f40b4030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f73dc0054e0 tx=0x7f73f000fd60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73f9c94700 1 --2- 172.21.15.63:0/1554632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73dc003760 0x7f73f40b4030 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7f73dc0054e0 tx=0x7f73f000fd60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:17.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73f9c94700 1 --2- 172.21.15.63:0/1554632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73dc003760 0x7f73f40b4030 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f73dc0054e0 tx=0x7f73f000fd60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73e2ffd700 1 -- 172.21.15.63:0/1554632208 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73f0011e30 con 0x7f73dc003760 2020-05-18T21:27:17.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73f9c94700 1 --2- 172.21.15.63:0/1554632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73dc003760 0x7f73f40b4030 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f73dc0054e0 tx=0x7f73f000fd60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73e2ffd700 1 -- 172.21.15.63:0/1554632208 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f0008180 con 0x7f73dc003760 2020-05-18T21:27:17.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73f9c94700 1 --2- 172.21.15.63:0/1554632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73dc003760 0x7f73f40b4030 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f73dc0054e0 tx=0x7f73f000fd60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73fac96700 1 -- 172.21.15.63:0/1554632208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f4063240 con 0x7f73dc003760 2020-05-18T21:27:17.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73e2ffd700 1 -- 172.21.15.63:0/1554632208 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73f0006520 con 0x7f73dc003760 2020-05-18T21:27:17.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73fac96700 1 -- 172.21.15.63:0/1554632208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f40645b0 con 0x7f73dc003760 2020-05-18T21:27:17.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73f9c94700 1 --2- 172.21.15.63:0/1554632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73dc003760 0x7f73f40b4030 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f73dc0054e0 tx=0x7f73f000fd60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73fac96700 1 -- 172.21.15.63:0/1554632208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f4148c40 con 0x7f73dc003760 2020-05-18T21:27:17.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73e2ffd700 1 -- 172.21.15.63:0/1554632208 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f73f0006720 con 0x7f73dc003760 2020-05-18T21:27:17.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.737+0000 7f73f9c94700 1 --2- 172.21.15.63:0/1554632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73dc003760 0x7f73f40b4030 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f73dc0054e0 tx=0x7f73f000fd60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.741+0000 7f73e2ffd700 1 --2- 172.21.15.63:0/1554632208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f73d404f840 0x7f73d4051d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:17.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.741+0000 7f73e2ffd700 1 -- 172.21.15.63:0/1554632208 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f73f0064490 con 0x7f73dc003760 2020-05-18T21:27:17.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.741+0000 7f73f9493700 1 --2- 172.21.15.63:0/1554632208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f73d404f840 0x7f73d4051d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:17.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.741+0000 7f73f9493700 1 --2- 172.21.15.63:0/1554632208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f73d404f840 0x7f73d4051d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f73f40b49c0 tx=0x7f73e400cac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.741+0000 7f73f9493700 1 --2- 172.21.15.63:0/1554632208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f73d404f840 0x7f73d4051d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f73f40b49c0 tx=0x7f73e400cac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.741+0000 7f73f9493700 1 --2- 172.21.15.63:0/1554632208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f73d404f840 0x7f73d4051d00 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f73f40b49c0 tx=0x7f73e400cac0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:17.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.745+0000 7f73f9c94700 1 --2- 172.21.15.63:0/1554632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73dc003760 0x7f73f40b4030 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f73dc0054e0 tx=0x7f73f000fd60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.745+0000 7f73e2ffd700 1 -- 172.21.15.63:0/1554632208 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f73f003e940 con 0x7f73dc003760 2020-05-18T21:27:17.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.861+0000 7f73fac96700 1 -- 172.21.15.63:0/1554632208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f73f41494d0 con 0x7f73dc003760 2020-05-18T21:27:17.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.861+0000 7f73f9c94700 1 --2- 172.21.15.63:0/1554632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73dc003760 0x7f73f40b4030 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f73dc0054e0 tx=0x7f73f000fd60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.861+0000 7f73e2ffd700 1 -- 172.21.15.63:0/1554632208 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f73f0041f60 con 0x7f73dc003760 2020-05-18T21:27:17.868 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:27:17.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.861+0000 7f73fac96700 1 -- 172.21.15.63:0/1554632208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f73d404f840 msgr2=0x7f73d4051d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.861+0000 7f73fac96700 1 --2- 172.21.15.63:0/1554632208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f73d404f840 0x7f73d4051d00 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f73f40b49c0 tx=0x7f73e400cac0).stop 2020-05-18T21:27:17.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.861+0000 7f73fac96700 1 -- 172.21.15.63:0/1554632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73dc003760 msgr2=0x7f73f40b4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.861+0000 7f73fac96700 1 --2- 172.21.15.63:0/1554632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73dc003760 0x7f73f40b4030 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7f73dc0054e0 tx=0x7f73f000fd60).stop 2020-05-18T21:27:17.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.861+0000 7f73fac96700 1 -- 172.21.15.63:0/1554632208 shutdown_connections 2020-05-18T21:27:17.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.861+0000 7f73fac96700 1 --2- 172.21.15.63:0/1554632208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f73d404f840 0x7f73d4051d00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:17.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.861+0000 7f73fac96700 1 --2- 172.21.15.63:0/1554632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73dc003760 0x7f73f40b4030 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:17.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.861+0000 7f73fac96700 1 -- 172.21.15.63:0/1554632208 >> 172.21.15.63:0/1554632208 conn(0x7f73f405fbd0 msgr2=0x7f73f4131120 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:17.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.861+0000 7f73fac96700 1 -- 172.21.15.63:0/1554632208 shutdown_connections 2020-05-18T21:27:17.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.865+0000 7f73fac96700 1 -- 172.21.15.63:0/1554632208 wait complete. 2020-05-18T21:27:17.881 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:27:17.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66bb038700 1 Processor -- start 2020-05-18T21:27:17.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66bb038700 1 -- start start 2020-05-18T21:27:17.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66bb038700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f66b40bc930 0x7f66b41469c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:17.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66bb038700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66b4060b80 0x7f66b4149da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:17.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66bb038700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b4145da0 con 0x7f66b4142fe0 2020-05-18T21:27:17.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66bb038700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b4145fe0 con 0x7f66b40bc930 2020-05-18T21:27:17.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66bb038700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b4146280 con 0x7f66b4060b80 2020-05-18T21:27:17.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66ba036700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f66b40bc930 0x7f66b41469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:17.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66ba837700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f66b4142fe0 0x7f66b40b7000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55874/0 (socket says 172.21.15.63:55874) 2020-05-18T21:27:17.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66ba837700 1 -- 172.21.15.63:0/45052542 learned_addr learned my addr 172.21.15.63:0/45052542 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:17.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66b9835700 1 --2- 172.21.15.63:0/45052542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66b4060b80 0x7f66b4149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:17.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66ba036700 1 -- 172.21.15.63:0/45052542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66b4060b80 msgr2=0x7f66b4149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:17.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66ba036700 1 --2- 172.21.15.63:0/45052542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66b4060b80 0x7f66b4149da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:17.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66ba036700 1 -- 172.21.15.63:0/45052542 >> v1:172.21.15.63:6789/0 conn(0x7f66b4142fe0 legacy=0x7f66b40b7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66ba036700 1 -- 172.21.15.63:0/45052542 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b4146520 con 0x7f66b40bc930 2020-05-18T21:27:17.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66b9034700 1 -- 172.21.15.63:0/45052542 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040542345 0 0) 0x7f66ac001490 con 0x7f66b4142fe0 2020-05-18T21:27:17.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66ba036700 1 --2- 172.21.15.63:0/45052542 >> v2:172.21.15.63:3300/0 conn(0x7f66b40bc930 0x7f66b41469c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f66b0002f70 tx=0x7f66b0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66ba036700 1 --2- 172.21.15.63:0/45052542 >> v2:172.21.15.63:3300/0 conn(0x7f66b40bc930 0x7f66b41469c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f66b0002f70 tx=0x7f66b0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66ba036700 1 --2- 172.21.15.63:0/45052542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66b40bc930 0x7f66b41469c0 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7f66b0002f70 tx=0x7f66b0007a80).ready entity=mon.0 client_cookie=6390396b1514084d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:17.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66ba036700 1 --2- 172.21.15.63:0/45052542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66b40bc930 0x7f66b41469c0 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f66b0002f70 tx=0x7f66b0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66b9034700 1 -- 172.21.15.63:0/45052542 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66b0008e80 con 0x7f66b40bc930 2020-05-18T21:27:17.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66ba036700 1 --2- 172.21.15.63:0/45052542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66b40bc930 0x7f66b41469c0 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f66b0002f70 tx=0x7f66b0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66ba036700 1 --2- 172.21.15.63:0/45052542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66b40bc930 0x7f66b41469c0 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f66b0002f70 tx=0x7f66b0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:17.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66b9034700 1 -- 172.21.15.63:0/45052542 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b00115f0 con 0x7f66b40bc930 2020-05-18T21:27:17.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66b9034700 1 -- 172.21.15.63:0/45052542 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66b00119d0 con 0x7f66b40bc930 2020-05-18T21:27:17.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66bb038700 1 -- 172.21.15.63:0/45052542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66b40bc930 msgr2=0x7f66b41469c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:17.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.985+0000 7f66bb038700 1 --2- 172.21.15.63:0/45052542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66b40bc930 0x7f66b41469c0 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7f66b0002f70 tx=0x7f66b0007a80).stop 2020-05-18T21:27:17.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.989+0000 7f66bb038700 1 -- 172.21.15.63:0/45052542 shutdown_connections 2020-05-18T21:27:17.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.989+0000 7f66bb038700 1 --2- 172.21.15.63:0/45052542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66b4060b80 0x7f66b4149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:18.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.989+0000 7f66bb038700 1 --2- 172.21.15.63:0/45052542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66b40bc930 0x7f66b41469c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:18.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.989+0000 7f66bb038700 1 -- 172.21.15.63:0/45052542 >> 172.21.15.63:0/45052542 conn(0x7f66b405f440 msgr2=0x7f66b405f820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:18.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.989+0000 7f66bb038700 1 -- 172.21.15.63:0/45052542 shutdown_connections 2020-05-18T21:27:18.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.989+0000 7f66bb038700 1 -- 172.21.15.63:0/45052542 wait complete. 2020-05-18T21:27:18.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.989+0000 7f66bb038700 1 Processor -- start 2020-05-18T21:27:18.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.989+0000 7f66bb038700 1 -- start start 2020-05-18T21:27:18.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66bb038700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66b4060b80 0x7f66b4144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:18.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66bb038700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f66b40bc930 0x7f66b4153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:18.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66bb038700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b4154120 con 0x7f66b4142fe0 2020-05-18T21:27:18.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66bb038700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b4145110 con 0x7f66b40bc930 2020-05-18T21:27:18.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66bb038700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b41532e0 con 0x7f66b4060b80 2020-05-18T21:27:18.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66ba036700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66b4060b80 0x7f66b4144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:18.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66b9835700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f66b40bc930 0x7f66b4153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:18.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66ba036700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66b4060b80 0x7f66b4144cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:44392/0 (socket says 172.21.15.63:44392) 2020-05-18T21:27:18.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66b9835700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f66b40bc930 0x7f66b4153cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:40310/0 (socket says 172.21.15.63:40310) 2020-05-18T21:27:18.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66ba036700 1 -- 172.21.15.63:0/3598966864 learned_addr learned my addr 172.21.15.63:0/3598966864 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:18.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66ba837700 1 --1- 172.21.15.63:0/3598966864 >> v1:172.21.15.155:6789/0 conn(0x7f66b4142fe0 0x7f66b40adb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:54196/0 (socket says 172.21.15.63:54196) 2020-05-18T21:27:18.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66a37fe700 1 -- 172.21.15.63:0/3598966864 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063194445 0 0) 0x7f66b4154120 con 0x7f66b4142fe0 2020-05-18T21:27:18.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66a37fe700 1 -- 172.21.15.63:0/3598966864 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6694002fe0 con 0x7f66b4142fe0 2020-05-18T21:27:18.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66b9835700 1 -- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66b4060b80 msgr2=0x7f66b4144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66b9835700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66b4060b80 0x7f66b4144cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:18.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66b9835700 1 -- 172.21.15.63:0/3598966864 >> v1:172.21.15.155:6789/0 conn(0x7f66b4142fe0 legacy=0x7f66b40adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66b9835700 1 -- 172.21.15.63:0/3598966864 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b4153580 con 0x7f66b40bc930 2020-05-18T21:27:18.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66ba036700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66b4060b80 0x7f66b4144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:18.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66b9835700 1 --2- 172.21.15.63:0/3598966864 >> v2:172.21.15.155:3300/0 conn(0x7f66b40bc930 0x7f66b4153cc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f66a4002f70 tx=0x7f66a4010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66b9835700 1 --2- 172.21.15.63:0/3598966864 >> v2:172.21.15.155:3300/0 conn(0x7f66b40bc930 0x7f66b4153cc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f66a4002f70 tx=0x7f66a4010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66b9835700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66b40bc930 0x7f66b4153cc0 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7f66a4002f70 tx=0x7f66a4010bf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:18.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66b9835700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66b40bc930 0x7f66b4153cc0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f66a4002f70 tx=0x7f66a4010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66a37fe700 1 -- 172.21.15.63:0/3598966864 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66a400e940 con 0x7f66b40bc930 2020-05-18T21:27:18.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66b9835700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66b40bc930 0x7f66b4153cc0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f66a4002f70 tx=0x7f66a4010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66a37fe700 1 -- 172.21.15.63:0/3598966864 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a400eaa0 con 0x7f66b40bc930 2020-05-18T21:27:18.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66b9835700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66b40bc930 0x7f66b4153cc0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f66a4002f70 tx=0x7f66a4010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66bb038700 1 -- 172.21.15.63:0/3598966864 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b4153820 con 0x7f66b40bc930 2020-05-18T21:27:18.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66a37fe700 1 -- 172.21.15.63:0/3598966864 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66a400ee80 con 0x7f66b40bc930 2020-05-18T21:27:18.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66bb038700 1 -- 172.21.15.63:0/3598966864 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b41457a0 con 0x7f66b40bc930 2020-05-18T21:27:18.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66bb038700 1 -- 172.21.15.63:0/3598966864 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b4153130 con 0x7f66b40bc930 2020-05-18T21:27:18.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.993+0000 7f66b9835700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66b40bc930 0x7f66b4153cc0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f66a4002f70 tx=0x7f66a4010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.997+0000 7f66a37fe700 1 -- 172.21.15.63:0/3598966864 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f66a4007190 con 0x7f66b40bc930 2020-05-18T21:27:18.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.997+0000 7f66b9835700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66b40bc930 0x7f66b4153cc0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f66a4002f70 tx=0x7f66a4010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.997+0000 7f66a37fe700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f669404fd30 0x7f66940521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:18.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.997+0000 7f66a37fe700 1 -- 172.21.15.63:0/3598966864 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f66a4063a80 con 0x7f66b40bc930 2020-05-18T21:27:18.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.997+0000 7f66ba036700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f669404fd30 0x7f66940521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:18.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.997+0000 7f66ba036700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f669404fd30 0x7f66940521f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f66b0002f70 tx=0x7f66b0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.997+0000 7f66ba036700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f669404fd30 0x7f66940521f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f66b0002f70 tx=0x7f66b0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:17.997+0000 7f66ba036700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f669404fd30 0x7f66940521f0 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f66b0002f70 tx=0x7f66b0007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:18.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.005+0000 7f66b9835700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66b40bc930 0x7f66b4153cc0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f66a4002f70 tx=0x7f66a4010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.005+0000 7f66a37fe700 1 -- 172.21.15.63:0/3598966864 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f66a403de10 con 0x7f66b40bc930 2020-05-18T21:27:18.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.121+0000 7f66bb038700 1 -- 172.21.15.63:0/3598966864 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f66b40569e0 con 0x7f66b40bc930 2020-05-18T21:27:18.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.121+0000 7f66b9835700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66b40bc930 0x7f66b4153cc0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f66a4002f70 tx=0x7f66a4010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.121+0000 7f66a37fe700 1 -- 172.21.15.63:0/3598966864 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f66a40120d0 con 0x7f66b40bc930 2020-05-18T21:27:18.130 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:18.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.125+0000 7f66bb038700 1 -- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f669404fd30 msgr2=0x7f66940521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.125+0000 7f66bb038700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f669404fd30 0x7f66940521f0 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f66b0002f70 tx=0x7f66b0007a80).stop 2020-05-18T21:27:18.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.125+0000 7f66bb038700 1 -- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66b40bc930 msgr2=0x7f66b4153cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.125+0000 7f66bb038700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66b40bc930 0x7f66b4153cc0 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7f66a4002f70 tx=0x7f66a4010bf0).stop 2020-05-18T21:27:18.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.125+0000 7f66bb038700 1 -- 172.21.15.63:0/3598966864 shutdown_connections 2020-05-18T21:27:18.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.125+0000 7f66bb038700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f669404fd30 0x7f66940521f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:18.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.125+0000 7f66bb038700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66b40bc930 0x7f66b4153cc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:18.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.125+0000 7f66bb038700 1 --2- 172.21.15.63:0/3598966864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66b4060b80 0x7f66b4144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:18.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.125+0000 7f66bb038700 1 -- 172.21.15.63:0/3598966864 >> 172.21.15.63:0/3598966864 conn(0x7f66b405f440 msgr2=0x7f66b40bbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:18.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.125+0000 7f66bb038700 1 -- 172.21.15.63:0/3598966864 shutdown_connections 2020-05-18T21:27:18.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.125+0000 7f66bb038700 1 -- 172.21.15.63:0/3598966864 wait complete. 2020-05-18T21:27:18.147 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:27:18.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.249+0000 7f10f5ee7700 1 Processor -- start 2020-05-18T21:27:18.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.249+0000 7f10f5ee7700 1 -- start start 2020-05-18T21:27:18.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.249+0000 7f10f5ee7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f10f0142ed0 0x7f10f00606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:18.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.249+0000 7f10f5ee7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10f0065a10 0x7f10f0145790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:18.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.249+0000 7f10f5ee7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f00b4630 con 0x7f10f00b4f60 2020-05-18T21:27:18.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.249+0000 7f10f5ee7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f0060c50 con 0x7f10f0142ed0 2020-05-18T21:27:18.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.249+0000 7f10f5ee7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f0060ef0 con 0x7f10f0065a10 2020-05-18T21:27:18.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.249+0000 7f10f56e6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10f0065a10 0x7f10f0145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:18.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.249+0000 7f10effff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f10f0142ed0 0x7f10f00606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:18.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.249+0000 7f10effff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f10f0142ed0 0x7f10f00606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:40316/0 (socket says 172.21.15.63:40316) 2020-05-18T21:27:18.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.249+0000 7f10f56e6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10f0065a10 0x7f10f0145790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:44402/0 (socket says 172.21.15.63:44402) 2020-05-18T21:27:18.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.249+0000 7f10effff700 1 -- 172.21.15.63:0/811421680 learned_addr learned my addr 172.21.15.63:0/811421680 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:18.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.249+0000 7f10f56e6700 1 -- 172.21.15.63:0/811421680 >> v2:172.21.15.155:3300/0 conn(0x7f10f0142ed0 msgr2=0x7f10f00606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:18.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.249+0000 7f10f56e6700 1 --2- 172.21.15.63:0/811421680 >> v2:172.21.15.155:3300/0 conn(0x7f10f0142ed0 0x7f10f00606d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:18.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.249+0000 7f10f56e6700 1 -- 172.21.15.63:0/811421680 >> v1:172.21.15.155:6789/0 conn(0x7f10f00b4f60 legacy=0x7f10f01427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.249+0000 7f10f56e6700 1 -- 172.21.15.63:0/811421680 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f0061190 con 0x7f10f0065a10 2020-05-18T21:27:18.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.249+0000 7f10effff700 1 --2- 172.21.15.63:0/811421680 >> v2:172.21.15.155:3300/0 conn(0x7f10f0142ed0 0x7f10f00606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:18.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.249+0000 7f10f56e6700 1 --2- 172.21.15.63:0/811421680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10f0065a10 0x7f10f0145790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f10e80032f0 tx=0x7f10e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.253+0000 7f10f56e6700 1 --2- 172.21.15.63:0/811421680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10f0065a10 0x7f10f0145790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f10e80032f0 tx=0x7f10e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.253+0000 7f10f56e6700 1 --2- 172.21.15.63:0/811421680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10f0065a10 0x7f10f0145790 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f10e80032f0 tx=0x7f10e8007e00).ready entity=mon.2 client_cookie=f2b9a9442b4c84c4 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:18.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.253+0000 7f10f56e6700 1 --2- 172.21.15.63:0/811421680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10f0065a10 0x7f10f0145790 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f10e80032f0 tx=0x7f10e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.253+0000 7f10ef7fe700 1 -- 172.21.15.63:0/811421680 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10e8013e80 con 0x7f10f0065a10 2020-05-18T21:27:18.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.253+0000 7f10f56e6700 1 --2- 172.21.15.63:0/811421680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10f0065a10 0x7f10f0145790 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f10e80032f0 tx=0x7f10e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.253+0000 7f10f56e6700 1 --2- 172.21.15.63:0/811421680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10f0065a10 0x7f10f0145790 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f10e80032f0 tx=0x7f10e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.253+0000 7f10ef7fe700 1 -- 172.21.15.63:0/811421680 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e800c370 con 0x7f10f0065a10 2020-05-18T21:27:18.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.253+0000 7f10ef7fe700 1 -- 172.21.15.63:0/811421680 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10e800c790 con 0x7f10f0065a10 2020-05-18T21:27:18.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.253+0000 7f10f5ee7700 1 -- 172.21.15.63:0/811421680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10f0065a10 msgr2=0x7f10f0145790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.253+0000 7f10f5ee7700 1 --2- 172.21.15.63:0/811421680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10f0065a10 0x7f10f0145790 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f10e80032f0 tx=0x7f10e8007e00).stop 2020-05-18T21:27:18.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.253+0000 7f10f5ee7700 1 -- 172.21.15.63:0/811421680 shutdown_connections 2020-05-18T21:27:18.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.253+0000 7f10f5ee7700 1 --2- 172.21.15.63:0/811421680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10f0065a10 0x7f10f0145790 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:18.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.253+0000 7f10f5ee7700 1 --2- 172.21.15.63:0/811421680 >> v2:172.21.15.155:3300/0 conn(0x7f10f0142ed0 0x7f10f00606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:18.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.253+0000 7f10f5ee7700 1 -- 172.21.15.63:0/811421680 >> 172.21.15.63:0/811421680 conn(0x7f10f005fbd0 msgr2=0x7f10f0069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:18.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.253+0000 7f10f5ee7700 1 -- 172.21.15.63:0/811421680 shutdown_connections 2020-05-18T21:27:18.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.253+0000 7f10f5ee7700 1 -- 172.21.15.63:0/811421680 wait complete. 2020-05-18T21:27:18.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f5ee7700 1 Processor -- start 2020-05-18T21:27:18.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f5ee7700 1 -- start start 2020-05-18T21:27:18.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f5ee7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f10f0065a10 0x7f10f01413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:18.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f5ee7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10f00b4f60 0x7f10f0141ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:18.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f5ee7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f10f0142ed0 0x7f10f00b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:18.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f5ee7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f0141820 con 0x7f10f0065a10 2020-05-18T21:27:18.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f5ee7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f00b8790 con 0x7f10f0142ed0 2020-05-18T21:27:18.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f5ee7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f00b8a30 con 0x7f10f00b4f60 2020-05-18T21:27:18.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f4ee5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f10f0065a10 0x7f10f01413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:18.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f4ee5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f10f0065a10 0x7f10f01413c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53704/0 (socket says 172.21.15.63:53704) 2020-05-18T21:27:18.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f4ee5700 1 -- 172.21.15.63:0/851223709 learned_addr learned my addr 172.21.15.63:0/851223709 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:18.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10effff700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10f00b4f60 0x7f10f0141ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:18.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f56e6700 1 --2- 172.21.15.63:0/851223709 >> v2:172.21.15.155:3300/0 conn(0x7f10f0142ed0 0x7f10f00b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:18.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f4ee5700 1 -- 172.21.15.63:0/851223709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10f00b4f60 msgr2=0x7f10f0141ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f4ee5700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10f00b4f60 0x7f10f0141ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:18.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f4ee5700 1 -- 172.21.15.63:0/851223709 >> v2:172.21.15.155:3300/0 conn(0x7f10f0142ed0 msgr2=0x7f10f00b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f4ee5700 1 --2- 172.21.15.63:0/851223709 >> v2:172.21.15.155:3300/0 conn(0x7f10f0142ed0 0x7f10f00b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:18.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f4ee5700 1 -- 172.21.15.63:0/851223709 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f00b8cd0 con 0x7f10f0065a10 2020-05-18T21:27:18.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f56e6700 1 --2- 172.21.15.63:0/851223709 >> v2:172.21.15.155:3300/0 conn(0x7f10f0142ed0 0x7f10f00b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:27:18.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f4ee5700 1 --2- 172.21.15.63:0/851223709 >> v2:172.21.15.63:3300/0 conn(0x7f10f0065a10 0x7f10f01413c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f10f00b92f0 tx=0x7f10e400c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f4ee5700 1 --2- 172.21.15.63:0/851223709 >> v2:172.21.15.63:3300/0 conn(0x7f10f0065a10 0x7f10f01413c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f10f00b92f0 tx=0x7f10e400c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f4ee5700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10f0065a10 0x7f10f01413c0 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7f10f00b92f0 tx=0x7f10e400c4a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:18.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f4ee5700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10f0065a10 0x7f10f01413c0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f10f00b92f0 tx=0x7f10e400c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f4ee5700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10f0065a10 0x7f10f01413c0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f10f00b92f0 tx=0x7f10e400c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10edffb700 1 -- 172.21.15.63:0/851223709 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10e400cc60 con 0x7f10f0065a10 2020-05-18T21:27:18.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f4ee5700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10f0065a10 0x7f10f01413c0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f10f00b92f0 tx=0x7f10e400c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10edffb700 1 -- 172.21.15.63:0/851223709 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e400cdc0 con 0x7f10f0065a10 2020-05-18T21:27:18.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f5ee7700 1 -- 172.21.15.63:0/851223709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f0142100 con 0x7f10f0065a10 2020-05-18T21:27:18.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10edffb700 1 -- 172.21.15.63:0/851223709 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10e4012220 con 0x7f10f0065a10 2020-05-18T21:27:18.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.257+0000 7f10f5ee7700 1 -- 172.21.15.63:0/851223709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f00b21c0 con 0x7f10f0065a10 2020-05-18T21:27:18.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.261+0000 7f10f4ee5700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10f0065a10 0x7f10f01413c0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f10f00b92f0 tx=0x7f10e400c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.261+0000 7f10f5ee7700 1 -- 172.21.15.63:0/851223709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f00569e0 con 0x7f10f0065a10 2020-05-18T21:27:18.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.261+0000 7f10edffb700 1 -- 172.21.15.63:0/851223709 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f10e4006520 con 0x7f10f0065a10 2020-05-18T21:27:18.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.261+0000 7f10f4ee5700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10f0065a10 0x7f10f01413c0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f10f00b92f0 tx=0x7f10e400c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.261+0000 7f10edffb700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f10d804fa90 0x7f10d8051f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:18.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.261+0000 7f10edffb700 1 -- 172.21.15.63:0/851223709 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f10e4063770 con 0x7f10f0065a10 2020-05-18T21:27:18.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.261+0000 7f10effff700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f10d804fa90 0x7f10d8051f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:18.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.261+0000 7f10effff700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f10d804fa90 0x7f10d8051f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f10dc002f70 tx=0x7f10dc00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.261+0000 7f10effff700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f10d804fa90 0x7f10d8051f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f10dc002f70 tx=0x7f10dc00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.261+0000 7f10effff700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f10d804fa90 0x7f10d8051f50 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f10dc002f70 tx=0x7f10dc00f570).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:18.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.269+0000 7f10f4ee5700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10f0065a10 0x7f10f01413c0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f10f00b92f0 tx=0x7f10e400c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.269+0000 7f10edffb700 1 -- 172.21.15.63:0/851223709 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f10e403db00 con 0x7f10f0065a10 2020-05-18T21:27:18.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.389+0000 7f10f5ee7700 1 -- 172.21.15.63:0/851223709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10f0065fb0 con 0x7f10f0065a10 2020-05-18T21:27:18.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.389+0000 7f10f4ee5700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10f0065a10 0x7f10f01413c0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f10f00b92f0 tx=0x7f10e400c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.393+0000 7f10edffb700 1 -- 172.21.15.63:0/851223709 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f10e4041120 con 0x7f10f0065a10 2020-05-18T21:27:18.398 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:18.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.393+0000 7f10f5ee7700 1 -- 172.21.15.63:0/851223709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f10d804fa90 msgr2=0x7f10d8051f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.393+0000 7f10f5ee7700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f10d804fa90 0x7f10d8051f50 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f10dc002f70 tx=0x7f10dc00f570).stop 2020-05-18T21:27:18.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.393+0000 7f10f5ee7700 1 -- 172.21.15.63:0/851223709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10f0065a10 msgr2=0x7f10f01413c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.393+0000 7f10f5ee7700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10f0065a10 0x7f10f01413c0 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7f10f00b92f0 tx=0x7f10e400c4a0).stop 2020-05-18T21:27:18.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.393+0000 7f10f5ee7700 1 -- 172.21.15.63:0/851223709 shutdown_connections 2020-05-18T21:27:18.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.393+0000 7f10f5ee7700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f10d804fa90 0x7f10d8051f50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:18.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.393+0000 7f10f5ee7700 1 --2- 172.21.15.63:0/851223709 >> v2:172.21.15.155:3300/0 conn(0x7f10f0142ed0 0x7f10f00b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:18.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.393+0000 7f10f5ee7700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10f00b4f60 0x7f10f0141ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:18.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.393+0000 7f10f5ee7700 1 --2- 172.21.15.63:0/851223709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10f0065a10 0x7f10f01413c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:18.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.393+0000 7f10f5ee7700 1 -- 172.21.15.63:0/851223709 >> 172.21.15.63:0/851223709 conn(0x7f10f005fbd0 msgr2=0x7f10f013bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:18.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.393+0000 7f10f5ee7700 1 -- 172.21.15.63:0/851223709 shutdown_connections 2020-05-18T21:27:18.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.393+0000 7f10f5ee7700 1 -- 172.21.15.63:0/851223709 wait complete. 2020-05-18T21:27:18.410 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:27:18.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.513+0000 7fac8aa84700 1 Processor -- start 2020-05-18T21:27:18.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.513+0000 7fac8aa84700 1 -- start start 2020-05-18T21:27:18.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8aa84700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac84143890 0x7fac84062800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:18.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8aa84700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fac8405bc50 0x7fac840b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:18.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8aa84700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8409dd80 con 0x7fac8405f410 2020-05-18T21:27:18.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8aa84700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac84062d80 con 0x7fac8405bc50 2020-05-18T21:27:18.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8aa84700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac840b6180 con 0x7fac84143890 2020-05-18T21:27:18.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac89a82700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fac8405f410 0x7fac84143180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55900/0 (socket says 172.21.15.63:55900) 2020-05-18T21:27:18.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac89a82700 1 -- 172.21.15.63:0/4107517460 learned_addr learned my addr 172.21.15.63:0/4107517460 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:18.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8a283700 1 --2- 172.21.15.63:0/4107517460 >> v2:172.21.15.63:3300/0 conn(0x7fac8405bc50 0x7fac840b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:18.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac89281700 1 --2- 172.21.15.63:0/4107517460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac84143890 0x7fac84062800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:18.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8a283700 1 -- 172.21.15.63:0/4107517460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac84143890 msgr2=0x7fac84062800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:18.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8a283700 1 --2- 172.21.15.63:0/4107517460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac84143890 0x7fac84062800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:18.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8a283700 1 -- 172.21.15.63:0/4107517460 >> v1:172.21.15.63:6789/0 conn(0x7fac8405f410 legacy=0x7fac84143180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8a283700 1 -- 172.21.15.63:0/4107517460 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac840b6420 con 0x7fac8405bc50 2020-05-18T21:27:18.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac88a80700 1 -- 172.21.15.63:0/4107517460 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782647039 0 0) 0x7fac8409dd80 con 0x7fac8405f410 2020-05-18T21:27:18.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8a283700 1 --2- 172.21.15.63:0/4107517460 >> v2:172.21.15.63:3300/0 conn(0x7fac8405bc50 0x7fac840b68c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fac7c0032f0 tx=0x7fac7c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8a283700 1 --2- 172.21.15.63:0/4107517460 >> v2:172.21.15.63:3300/0 conn(0x7fac8405bc50 0x7fac840b68c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fac7c0032f0 tx=0x7fac7c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8a283700 1 --2- 172.21.15.63:0/4107517460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac8405bc50 0x7fac840b68c0 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7fac7c0032f0 tx=0x7fac7c007e00).ready entity=mon.0 client_cookie=5adb3d3473b2f278 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:18.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8a283700 1 --2- 172.21.15.63:0/4107517460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac8405bc50 0x7fac840b68c0 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7fac7c0032f0 tx=0x7fac7c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac88a80700 1 -- 172.21.15.63:0/4107517460 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac7c010df0 con 0x7fac8405bc50 2020-05-18T21:27:18.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8a283700 1 --2- 172.21.15.63:0/4107517460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac8405bc50 0x7fac840b68c0 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7fac7c0032f0 tx=0x7fac7c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac88a80700 1 -- 172.21.15.63:0/4107517460 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7c0110d0 con 0x7fac8405bc50 2020-05-18T21:27:18.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8aa84700 1 -- 172.21.15.63:0/4107517460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac8405bc50 msgr2=0x7fac840b68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8a283700 1 --2- 172.21.15.63:0/4107517460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac8405bc50 0x7fac840b68c0 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7fac7c0032f0 tx=0x7fac7c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac88a80700 1 -- 172.21.15.63:0/4107517460 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac7c0114b0 con 0x7fac8405bc50 2020-05-18T21:27:18.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8aa84700 1 --2- 172.21.15.63:0/4107517460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac8405bc50 0x7fac840b68c0 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7fac7c0032f0 tx=0x7fac7c007e00).stop 2020-05-18T21:27:18.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8aa84700 1 -- 172.21.15.63:0/4107517460 shutdown_connections 2020-05-18T21:27:18.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8aa84700 1 --2- 172.21.15.63:0/4107517460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac8405bc50 0x7fac840b68c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:18.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8aa84700 1 --2- 172.21.15.63:0/4107517460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac84143890 0x7fac84062800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:18.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8aa84700 1 -- 172.21.15.63:0/4107517460 >> 172.21.15.63:0/4107517460 conn(0x7fac8406a600 msgr2=0x7fac840b6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:18.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8aa84700 1 -- 172.21.15.63:0/4107517460 shutdown_connections 2020-05-18T21:27:18.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.517+0000 7fac8aa84700 1 -- 172.21.15.63:0/4107517460 wait complete. 2020-05-18T21:27:18.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac8aa84700 1 Processor -- start 2020-05-18T21:27:18.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac8aa84700 1 -- start start 2020-05-18T21:27:18.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac8aa84700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fac8405f410 0x7fac84146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:18.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac8aa84700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac84143890 0x7fac84155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:18.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac8aa84700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac84155920 con 0x7fac8405bc50 2020-05-18T21:27:18.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac8aa84700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8413bc40 con 0x7fac8405f410 2020-05-18T21:27:18.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac8aa84700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac841429f0 con 0x7fac84143890 2020-05-18T21:27:18.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac89a82700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fac8405bc50 0x7fac84141460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55906/0 (socket says 172.21.15.63:55906) 2020-05-18T21:27:18.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac89a82700 1 -- 172.21.15.63:0/968396316 learned_addr learned my addr 172.21.15.63:0/968396316 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:18.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac89281700 1 --2- 172.21.15.63:0/968396316 >> v2:172.21.15.63:3300/0 conn(0x7fac8405f410 0x7fac84146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:18.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac8a283700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac84143890 0x7fac84155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:18.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac76ffd700 1 -- 172.21.15.63:0/968396316 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969608116 0 0) 0x7fac84155920 con 0x7fac8405bc50 2020-05-18T21:27:18.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac76ffd700 1 -- 172.21.15.63:0/968396316 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac64002fe0 con 0x7fac8405bc50 2020-05-18T21:27:18.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac76ffd700 1 -- 172.21.15.63:0/968396316 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1561371698 0 0) 0x7fac64002fe0 con 0x7fac8405bc50 2020-05-18T21:27:18.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac76ffd700 1 -- 172.21.15.63:0/968396316 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fac84155920 con 0x7fac8405bc50 2020-05-18T21:27:18.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac76ffd700 1 -- 172.21.15.63:0/968396316 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fac80001960 con 0x7fac8405bc50 2020-05-18T21:27:18.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac89281700 1 -- 172.21.15.63:0/968396316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac84143890 msgr2=0x7fac84155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac89281700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac84143890 0x7fac84155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:18.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac89281700 1 -- 172.21.15.63:0/968396316 >> v1:172.21.15.63:6789/0 conn(0x7fac8405bc50 legacy=0x7fac84141460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac89281700 1 -- 172.21.15.63:0/968396316 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac84140d20 con 0x7fac8405f410 2020-05-18T21:27:18.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac8a283700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac84143890 0x7fac84155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:18.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac89281700 1 --2- 172.21.15.63:0/968396316 >> v2:172.21.15.63:3300/0 conn(0x7fac8405f410 0x7fac84146250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac78002f70 tx=0x7fac78010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac89281700 1 --2- 172.21.15.63:0/968396316 >> v2:172.21.15.63:3300/0 conn(0x7fac8405f410 0x7fac84146250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac78002f70 tx=0x7fac78010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac89281700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac8405f410 0x7fac84146250 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7fac78002f70 tx=0x7fac78010bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:18.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac89281700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac8405f410 0x7fac84146250 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fac78002f70 tx=0x7fac78010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac89281700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac8405f410 0x7fac84146250 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fac78002f70 tx=0x7fac78010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac76ffd700 1 -- 172.21.15.63:0/968396316 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac78007550 con 0x7fac8405f410 2020-05-18T21:27:18.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac89281700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac8405f410 0x7fac84146250 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fac78002f70 tx=0x7fac78010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac76ffd700 1 -- 172.21.15.63:0/968396316 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac78013070 con 0x7fac8405f410 2020-05-18T21:27:18.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac8aa84700 1 -- 172.21.15.63:0/968396316 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac84140fc0 con 0x7fac8405f410 2020-05-18T21:27:18.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac76ffd700 1 -- 172.21.15.63:0/968396316 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac780058f0 con 0x7fac8405f410 2020-05-18T21:27:18.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.521+0000 7fac8aa84700 1 -- 172.21.15.63:0/968396316 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac841456a0 con 0x7fac8405f410 2020-05-18T21:27:18.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.525+0000 7fac89281700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac8405f410 0x7fac84146250 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fac78002f70 tx=0x7fac78010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.525+0000 7fac8aa84700 1 -- 172.21.15.63:0/968396316 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac840569e0 con 0x7fac8405f410 2020-05-18T21:27:18.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.525+0000 7fac76ffd700 1 -- 172.21.15.63:0/968396316 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fac78005ae0 con 0x7fac8405f410 2020-05-18T21:27:18.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.525+0000 7fac89281700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac8405f410 0x7fac84146250 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fac78002f70 tx=0x7fac78010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.525+0000 7fac76ffd700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fac64050130 0x7fac640525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:18.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.525+0000 7fac76ffd700 1 -- 172.21.15.63:0/968396316 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fac78063750 con 0x7fac8405f410 2020-05-18T21:27:18.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.525+0000 7fac89a82700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fac64050130 0x7fac640525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:18.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.525+0000 7fac89a82700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fac64050130 0x7fac640525f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac800011b0 tx=0x7fac80009660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.525+0000 7fac89a82700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fac64050130 0x7fac640525f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac800011b0 tx=0x7fac80009660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.525+0000 7fac89a82700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fac64050130 0x7fac640525f0 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7fac800011b0 tx=0x7fac80009660).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:18.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.533+0000 7fac89281700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac8405f410 0x7fac84146250 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fac78002f70 tx=0x7fac78010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.533+0000 7fac76ffd700 1 -- 172.21.15.63:0/968396316 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fac7803dae0 con 0x7fac8405f410 2020-05-18T21:27:18.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.649+0000 7fac8aa84700 1 -- 172.21.15.63:0/968396316 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac84142be0 con 0x7fac8405f410 2020-05-18T21:27:18.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.649+0000 7fac89281700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac8405f410 0x7fac84146250 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fac78002f70 tx=0x7fac78010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.653+0000 7fac76ffd700 1 -- 172.21.15.63:0/968396316 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fac78041100 con 0x7fac8405f410 2020-05-18T21:27:18.658 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:18.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.653+0000 7fac8aa84700 1 -- 172.21.15.63:0/968396316 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fac64050130 msgr2=0x7fac640525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.653+0000 7fac8aa84700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fac64050130 0x7fac640525f0 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7fac800011b0 tx=0x7fac80009660).stop 2020-05-18T21:27:18.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.653+0000 7fac8aa84700 1 -- 172.21.15.63:0/968396316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac8405f410 msgr2=0x7fac84146250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.653+0000 7fac8aa84700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac8405f410 0x7fac84146250 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7fac78002f70 tx=0x7fac78010bd0).stop 2020-05-18T21:27:18.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.653+0000 7fac8aa84700 1 -- 172.21.15.63:0/968396316 shutdown_connections 2020-05-18T21:27:18.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.653+0000 7fac8aa84700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fac64050130 0x7fac640525f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:18.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.653+0000 7fac8aa84700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac84143890 0x7fac84155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:18.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.653+0000 7fac8aa84700 1 --2- 172.21.15.63:0/968396316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac8405f410 0x7fac84146250 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:18.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.653+0000 7fac8aa84700 1 -- 172.21.15.63:0/968396316 >> 172.21.15.63:0/968396316 conn(0x7fac8406a600 msgr2=0x7fac8405c030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:18.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.653+0000 7fac8aa84700 1 -- 172.21.15.63:0/968396316 shutdown_connections 2020-05-18T21:27:18.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.653+0000 7fac8aa84700 1 -- 172.21.15.63:0/968396316 wait complete. 2020-05-18T21:27:18.681 INFO:tasks.cephfs_test_runner:Starting test: test_dir_deletion (tasks.cephfs.test_strays.TestStrays) 2020-05-18T21:27:18.682 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_strays.TestStrays.test_dir_deletion' 2020-05-18T21:27:18.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.777+0000 7faea25cf700 1 Processor -- start 2020-05-18T21:27:18.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.777+0000 7faea25cf700 1 -- start start 2020-05-18T21:27:18.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.777+0000 7faea25cf700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae9c0b2860 0x7fae9c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:18.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.777+0000 7faea25cf700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9c14d960 con 0x7fae9c060b90 2020-05-18T21:27:18.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.777+0000 7faea25cf700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9c14db90 con 0x7fae9c14e570 2020-05-18T21:27:18.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.777+0000 7faea25cf700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c066210 con 0x7fae9c0b2860 2020-05-18T21:27:18.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.777+0000 7fae9bfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fae9c060b90 0x7fae9c144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55914/0 (socket says 172.21.15.63:55914) 2020-05-18T21:27:18.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.777+0000 7fae9bfff700 1 -- 172.21.15.63:0/1443495774 learned_addr learned my addr 172.21.15.63:0/1443495774 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:18.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.777+0000 7fae9b7fe700 1 --2- 172.21.15.63:0/1443495774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae9c0b2860 0x7fae9c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:18.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.777+0000 7fae9affd700 1 -- 172.21.15.63:0/1443495774 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092826536 0 0) 0x7fae9c14d960 con 0x7fae9c060b90 2020-05-18T21:27:18.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.777+0000 7fae9affd700 1 -- 172.21.15.63:0/1443495774 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae88003270 con 0x7fae9c060b90 2020-05-18T21:27:18.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.777+0000 7fae9affd700 1 -- 172.21.15.63:0/1443495774 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028538014 0 0) 0x7fae9c14db90 con 0x7fae9c14e570 2020-05-18T21:27:18.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.777+0000 7fae9affd700 1 -- 172.21.15.63:0/1443495774 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae9c14d960 con 0x7fae9c14e570 2020-05-18T21:27:18.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.777+0000 7fae9b7fe700 1 -- 172.21.15.63:0/1443495774 >> v1:172.21.15.155:6789/0 conn(0x7fae9c14e570 legacy=0x7fae9c14a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.777+0000 7fae9b7fe700 1 -- 172.21.15.63:0/1443495774 >> v1:172.21.15.63:6789/0 conn(0x7fae9c060b90 legacy=0x7fae9c144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.777+0000 7fae9affd700 1 -- 172.21.15.63:0/1443495774 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1951395945 0 0) 0x7fae88003270 con 0x7fae9c060b90 2020-05-18T21:27:18.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.777+0000 7fae9b7fe700 1 -- 172.21.15.63:0/1443495774 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c14de30 con 0x7fae9c0b2860 2020-05-18T21:27:18.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.777+0000 7fae9b7fe700 1 --2- 172.21.15.63:0/1443495774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae9c0b2860 0x7fae9c0615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fae8c001110 tx=0x7fae90008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.781+0000 7fae9b7fe700 1 --2- 172.21.15.63:0/1443495774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae9c0b2860 0x7fae9c0615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fae8c001110 tx=0x7fae90008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.781+0000 7fae9b7fe700 1 --2- 172.21.15.63:0/1443495774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae9c0b2860 0x7fae9c0615e0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7fae8c001110 tx=0x7fae90008920).ready entity=mon.2 client_cookie=732ec3223960cdde server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:18.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.781+0000 7fae9b7fe700 1 --2- 172.21.15.63:0/1443495774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae9c0b2860 0x7fae9c0615e0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fae8c001110 tx=0x7fae90008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.781+0000 7fae9affd700 1 -- 172.21.15.63:0/1443495774 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8c001710 con 0x7fae9c0b2860 2020-05-18T21:27:18.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.781+0000 7fae9b7fe700 1 --2- 172.21.15.63:0/1443495774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae9c0b2860 0x7fae9c0615e0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fae8c001110 tx=0x7fae90008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.781+0000 7fae9b7fe700 1 --2- 172.21.15.63:0/1443495774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae9c0b2860 0x7fae9c0615e0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fae8c001110 tx=0x7fae90008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.781+0000 7fae9affd700 1 -- 172.21.15.63:0/1443495774 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae90008e80 con 0x7fae9c0b2860 2020-05-18T21:27:18.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.781+0000 7fae9affd700 1 -- 172.21.15.63:0/1443495774 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae90011440 con 0x7fae9c0b2860 2020-05-18T21:27:18.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.781+0000 7faea25cf700 1 -- 172.21.15.63:0/1443495774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae9c0b2860 msgr2=0x7fae9c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.781+0000 7faea25cf700 1 --2- 172.21.15.63:0/1443495774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae9c0b2860 0x7fae9c0615e0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7fae8c001110 tx=0x7fae90008920).stop 2020-05-18T21:27:18.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.781+0000 7faea25cf700 1 -- 172.21.15.63:0/1443495774 shutdown_connections 2020-05-18T21:27:18.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.781+0000 7faea25cf700 1 --2- 172.21.15.63:0/1443495774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae9c0b2860 0x7fae9c0615e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:18.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.781+0000 7faea25cf700 1 -- 172.21.15.63:0/1443495774 >> 172.21.15.63:0/1443495774 conn(0x7fae9c0b83d0 msgr2=0x7fae9c0b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:18.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.781+0000 7faea25cf700 1 -- 172.21.15.63:0/1443495774 shutdown_connections 2020-05-18T21:27:18.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.781+0000 7faea25cf700 1 -- 172.21.15.63:0/1443495774 wait complete. 2020-05-18T21:27:18.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7faea25cf700 1 Processor -- start 2020-05-18T21:27:18.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7faea25cf700 1 -- start start 2020-05-18T21:27:18.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7faea25cf700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fae9c0b2860 0x7fae9c0b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:18.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7faea25cf700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae9c14e570 0x7fae9c1437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:18.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7faea25cf700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9c0b7a00 con 0x7fae9c060b90 2020-05-18T21:27:18.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7faea25cf700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae9c14cd00 con 0x7fae9c0b2860 2020-05-18T21:27:18.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7faea25cf700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c14cfa0 con 0x7fae9c14e570 2020-05-18T21:27:18.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7fae9b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fae9c0b2860 0x7fae9c0b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:18.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7fae9bfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fae9c060b90 0x7fae9c14bf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55920/0 (socket says 172.21.15.63:55920) 2020-05-18T21:27:18.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7fae9bfff700 1 -- 172.21.15.63:0/2434436653 learned_addr learned my addr 172.21.15.63:0/2434436653 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:18.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7faea0b6c700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae9c14e570 0x7fae9c1437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:18.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7fae997fa700 1 -- 172.21.15.63:0/2434436653 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953004744 0 0) 0x7fae9c0b7a00 con 0x7fae9c060b90 2020-05-18T21:27:18.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7fae997fa700 1 -- 172.21.15.63:0/2434436653 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae7c002fe0 con 0x7fae9c060b90 2020-05-18T21:27:18.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7fae9b7fe700 1 -- 172.21.15.63:0/2434436653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae9c14e570 msgr2=0x7fae9c1437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7fae9b7fe700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae9c14e570 0x7fae9c1437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:18.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7fae9b7fe700 1 -- 172.21.15.63:0/2434436653 >> v1:172.21.15.63:6789/0 conn(0x7fae9c060b90 legacy=0x7fae9c14bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:18.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7fae9b7fe700 1 -- 172.21.15.63:0/2434436653 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c14d240 con 0x7fae9c0b2860 2020-05-18T21:27:18.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7fae9b7fe700 1 --2- 172.21.15.63:0/2434436653 >> v2:172.21.15.63:3300/0 conn(0x7fae9c0b2860 0x7fae9c0b75a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae8c001110 tx=0x7fae9c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7fae9b7fe700 1 --2- 172.21.15.63:0/2434436653 >> v2:172.21.15.63:3300/0 conn(0x7fae9c0b2860 0x7fae9c0b75a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae8c001110 tx=0x7fae9c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7fae9b7fe700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae9c0b2860 0x7fae9c0b75a0 secure :-1 s=READY pgs=288 cs=0 l=1 rx=0x7fae8c001110 tx=0x7fae9c05fa60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:18.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7fae9b7fe700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae9c0b2860 0x7fae9c0b75a0 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7fae8c001110 tx=0x7fae9c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7fae997fa700 1 -- 172.21.15.63:0/2434436653 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae90011c30 con 0x7fae9c0b2860 2020-05-18T21:27:18.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7fae9b7fe700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae9c0b2860 0x7fae9c0b75a0 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7fae8c001110 tx=0x7fae9c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7fae9b7fe700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae9c0b2860 0x7fae9c0b75a0 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7fae8c001110 tx=0x7fae9c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7fae997fa700 1 -- 172.21.15.63:0/2434436653 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae90011d90 con 0x7fae9c0b2860 2020-05-18T21:27:18.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7faea25cf700 1 -- 172.21.15.63:0/2434436653 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae9c147b40 con 0x7fae9c0b2860 2020-05-18T21:27:18.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7fae997fa700 1 -- 172.21.15.63:0/2434436653 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae90007360 con 0x7fae9c0b2860 2020-05-18T21:27:18.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.785+0000 7faea25cf700 1 -- 172.21.15.63:0/2434436653 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae9c143de0 con 0x7fae9c0b2860 2020-05-18T21:27:18.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.789+0000 7fae9b7fe700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae9c0b2860 0x7fae9c0b75a0 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7fae8c001110 tx=0x7fae9c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.789+0000 7fae997fa700 1 -- 172.21.15.63:0/2434436653 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fae90005700 con 0x7fae9c0b2860 2020-05-18T21:27:18.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.789+0000 7fae9b7fe700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae9c0b2860 0x7fae9c0b75a0 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7fae8c001110 tx=0x7fae9c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.789+0000 7faea25cf700 1 -- 172.21.15.63:0/2434436653 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae9c0569e0 con 0x7fae9c0b2860 2020-05-18T21:27:18.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.789+0000 7fae997fa700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fae7c04fd30 0x7fae7c0521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:18.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.789+0000 7fae997fa700 1 -- 172.21.15.63:0/2434436653 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fae90064640 con 0x7fae9c0b2860 2020-05-18T21:27:18.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.789+0000 7fae9bfff700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fae7c04fd30 0x7fae7c0521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:18.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.789+0000 7fae9bfff700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fae7c04fd30 0x7fae7c0521f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae8c001150 tx=0x7fae8c001ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.789+0000 7fae9bfff700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fae7c04fd30 0x7fae7c0521f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae8c001150 tx=0x7fae8c001ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.789+0000 7fae9bfff700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fae7c04fd30 0x7fae7c0521f0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7fae8c001150 tx=0x7fae8c001ac0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:18.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.797+0000 7fae9b7fe700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae9c0b2860 0x7fae9c0b75a0 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7fae8c001110 tx=0x7fae9c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:18.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.797+0000 7fae997fa700 1 -- 172.21.15.63:0/2434436653 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fae9003e970 con 0x7fae9c0b2860 2020-05-18T21:27:18.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:18.941+0000 7faea25cf700 1 -- 172.21.15.63:0/2434436653 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dir_deletion"]} v 0) v1 -- 0x7fae9c0008d0 con 0x7fae9c0b2860 2020-05-18T21:27:19.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:19.121+0000 7fae9b7fe700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae9c0b2860 0x7fae9c0b75a0 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7fae8c001110 tx=0x7fae9c05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:19.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:19.121+0000 7fae997fa700 1 -- 172.21.15.63:0/2434436653 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dir_deletion"]}]=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7fae90041f90 con 0x7fae9c0b2860 2020-05-18T21:27:19.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:19.125+0000 7faea25cf700 1 -- 172.21.15.63:0/2434436653 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fae7c04fd30 msgr2=0x7fae7c0521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:19.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:19.125+0000 7faea25cf700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fae7c04fd30 0x7fae7c0521f0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7fae8c001150 tx=0x7fae8c001ac0).stop 2020-05-18T21:27:19.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:19.125+0000 7faea25cf700 1 -- 172.21.15.63:0/2434436653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae9c0b2860 msgr2=0x7fae9c0b75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:19.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:19.125+0000 7faea25cf700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae9c0b2860 0x7fae9c0b75a0 secure :-1 s=READY pgs=288 cs=0 l=1 rx=0x7fae8c001110 tx=0x7fae9c05fa60).stop 2020-05-18T21:27:19.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:19.125+0000 7faea25cf700 1 -- 172.21.15.63:0/2434436653 shutdown_connections 2020-05-18T21:27:19.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:19.125+0000 7faea25cf700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fae7c04fd30 0x7fae7c0521f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:19.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:19.125+0000 7faea25cf700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae9c14e570 0x7fae9c1437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:19.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:19.125+0000 7faea25cf700 1 --2- 172.21.15.63:0/2434436653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae9c0b2860 0x7fae9c0b75a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:19.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:19.125+0000 7faea25cf700 1 -- 172.21.15.63:0/2434436653 >> 172.21.15.63:0/2434436653 conn(0x7fae9c0b83d0 msgr2=0x7fae9c0b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:19.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:19.125+0000 7faea25cf700 1 -- 172.21.15.63:0/2434436653 shutdown_connections 2020-05-18T21:27:19.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:19.125+0000 7faea25cf700 1 -- 172.21.15.63:0/2434436653 wait complete. 2020-05-18T21:27:19.147 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:27:19.148 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:27:19.167 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:27:19.188 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:27:19.189 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:27:19.189 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:27:19.189 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:27:19.217 INFO:teuthology.orchestra.run:waiting for 900 2020-05-18T21:27:19.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:19.219 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:27:19.268 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:27:19.269 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:27:19.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:19.270 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 down' 2020-05-18T21:27:19.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:19.291 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.0' 2020-05-18T21:27:19.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:19.400 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:27:19.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:19.421 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:27:19.427 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:27:19.427 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:27:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:27:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:19.428 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.429 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.429 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.430 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:27:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:27:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42803sec preferred_lft 42803sec 2020-05-18T21:27:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:27:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:19.431 INFO:teuthology.orchestra.run.smithi063.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-05-18T21:27:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 5a:1a:53:a8:5b:5d brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:27:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::d461:56ff:fe10:c810/64 scope link 2020-05-18T21:27:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:19.432 INFO:teuthology.orchestra.run.smithi063.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-05-18T21:27:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 5a:1a:53:a8:5b:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-05-18T21:27:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::581a:53ff:fea8:5b5d/64 scope link 2020-05-18T21:27:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:19.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:19.433 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:27:19.487 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:19.488 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:19.488 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:19.488 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.488 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:19.489 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.489 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:19.489 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.489 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:27:19.489 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.490 INFO:teuthology.orchestra.run.smithi063.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000 2020-05-18T21:27:19.490 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 5a:1a:53:a8:5b:5d brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.490 INFO:teuthology.orchestra.run.smithi063.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP mode DEFAULT group default qlen 1000 2020-05-18T21:27:19.490 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 5a:1a:53:a8:5b:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-05-18T21:27:19.491 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:27:19.492 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:27:19.492 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:27:19.509 INFO:teuthology.orchestra.run:waiting for 900 2020-05-18T21:27:19.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:19.510 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:27:19.561 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-05-18T21:27:19.561 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-05-18T21:27:19.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:19.562 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.1 down' 2020-05-18T21:27:19.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:19.587 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.1' 2020-05-18T21:27:19.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:19.669 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-05-18T21:27:19.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:19.690 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:27:19.698 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:27:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:27:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:27:19.700 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:19.700 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:19.700 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.700 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:19.700 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.701 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:19.701 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.701 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:27:19.701 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.701 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:27:19.702 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42803sec preferred_lft 42803sec 2020-05-18T21:27:19.702 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:27:19.702 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:19.702 INFO:teuthology.orchestra.run.smithi063.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-05-18T21:27:19.702 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.702 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:27:19.703 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:19.703 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::d461:56ff:fe10:c810/64 scope link 2020-05-18T21:27:19.703 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:19.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:19.704 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:27:19.716 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:19.717 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:19.717 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:19.717 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.717 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:19.718 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.718 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:19.718 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.718 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:27:19.718 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.718 INFO:teuthology.orchestra.run.smithi063.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000 2020-05-18T21:27:19.719 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:19.719 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:27:19.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:19.721 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:27:19.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:19.784 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:27:19.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:19.908 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:27:19.918 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:27:19.918 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:27:19.918 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:27:19.918 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:27:19.919 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:27:19.919 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:27:19.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:19.920 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:27:19.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:19.938 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:27:19.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:19.955 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:27:20.015 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi155.front.sepia.ceph.com... 2020-05-18T21:27:20.016 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:27:20.016 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:27:20.051 INFO:teuthology.orchestra.run:waiting for 900 2020-05-18T21:27:20.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:20.052 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:27:20.083 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-05-18T21:27:20.084 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' 2020-05-18T21:27:20.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:20.085 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip link set brx.0 down' 2020-05-18T21:27:20.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:20.150 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip link delete brx.0' 2020-05-18T21:27:20.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:20.221 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2' 2020-05-18T21:27:20.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:20.242 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:27:20.293 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:27:20.293 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:20.293 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:27:20.294 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:20.294 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:27:20.294 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:20.295 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:20.295 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.296 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:20.296 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.296 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:20.297 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.297 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:27:20.297 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.297 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:27:20.297 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42807sec preferred_lft 42807sec 2020-05-18T21:27:20.298 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:27:20.298 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:20.298 INFO:teuthology.orchestra.run.smithi155.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-05-18T21:27:20.298 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5a:81:ad:44:91:56 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.299 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:27:20.299 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:20.299 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::98e1:75ff:fea3:ccae/64 scope link 2020-05-18T21:27:20.299 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:20.299 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-05-18T21:27:20.300 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5a:81:ad:44:91:56 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2020-05-18T21:27:20.300 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5881:adff:fe44:9156/64 scope link 2020-05-18T21:27:20.300 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:20.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:20.302 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip link show' 2020-05-18T21:27:20.320 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:20.320 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:20.320 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:20.320 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.320 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:20.321 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.321 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:20.321 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.321 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:27:20.321 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.322 INFO:teuthology.orchestra.run.smithi155.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000 2020-05-18T21:27:20.322 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5a:81:ad:44:91:56 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.322 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP mode DEFAULT group default qlen 1000 2020-05-18T21:27:20.322 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5a:81:ad:44:91:56 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2020-05-18T21:27:20.323 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi155.front.sepia.ceph.com... 2020-05-18T21:27:20.324 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:27:20.324 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:27:20.341 INFO:teuthology.orchestra.run:waiting for 900 2020-05-18T21:27:20.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:20.342 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:27:20.389 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-05-18T21:27:20.389 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' 2020-05-18T21:27:20.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:20.390 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip link set brx.1 down' 2020-05-18T21:27:20.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:20.412 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip link delete brx.1' 2020-05-18T21:27:20.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:20.565 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3' 2020-05-18T21:27:20.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:20.587 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:27:20.595 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:27:20.595 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:20.595 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:27:20.595 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:20.596 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:27:20.596 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:20.596 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:20.596 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.597 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:20.597 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.598 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:20.598 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.598 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:27:20.598 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.599 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:27:20.599 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42806sec preferred_lft 42806sec 2020-05-18T21:27:20.599 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:27:20.599 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:20.600 INFO:teuthology.orchestra.run.smithi155.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-05-18T21:27:20.600 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.600 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:27:20.601 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:20.601 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::98e1:75ff:fea3:ccae/64 scope link 2020-05-18T21:27:20.601 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:20.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:20.602 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip link show' 2020-05-18T21:27:20.656 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:20.656 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:20.656 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:20.656 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.657 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:20.657 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.657 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:20.657 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.657 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:27:20.658 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.658 INFO:teuthology.orchestra.run.smithi155.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000 2020-05-18T21:27:20.658 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:20.659 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:27:20.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:20.660 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:27:20.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:20.678 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:27:20.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:20.833 INFO:teuthology.orchestra.run.smithi155:> route 2020-05-18T21:27:20.843 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2020-05-18T21:27:20.843 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:27:20.843 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:27:20.843 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:27:20.844 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:27:20.844 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:27:20.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:20.845 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:27:20.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:20.905 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:27:20.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:20.923 INFO:teuthology.orchestra.run.smithi155:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:27:20.934 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-05-18T21:27:21.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.041+0000 7fa2e57d7700 1 Processor -- start 2020-05-18T21:27:21.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.041+0000 7fa2e57d7700 1 -- start start 2020-05-18T21:27:21.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2e57d7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa2e0143200 0x7fa2e00ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:21.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2e57d7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa2e01435e0 0x7fa2e0143a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:21.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2e57d7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2e00b5c40 0x7fa2e00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:21.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2e57d7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e00ac4d0 con 0x7fa2e01435e0 2020-05-18T21:27:21.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2e57d7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e00ac700 con 0x7fa2e0143200 2020-05-18T21:27:21.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2e57d7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e00ac9a0 con 0x7fa2e00b5c40 2020-05-18T21:27:21.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2de7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa2e01435e0 0x7fa2e0143a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:21.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2de7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa2e01435e0 0x7fa2e0143a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53742/0 (socket says 172.21.15.63:53742) 2020-05-18T21:27:21.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2de7fc700 1 -- 172.21.15.63:0/3131962292 learned_addr learned my addr 172.21.15.63:0/3131962292 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:21.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2deffd700 1 --2- 172.21.15.63:0/3131962292 >> v2:172.21.15.155:3300/0 conn(0x7fa2e0143200 0x7fa2e00ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:21.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2df7fe700 1 --2- 172.21.15.63:0/3131962292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2e00b5c40 0x7fa2e00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:21.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2de7fc700 1 -- 172.21.15.63:0/3131962292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2e00b5c40 msgr2=0x7fa2e00b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:21.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2de7fc700 1 --2- 172.21.15.63:0/3131962292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2e00b5c40 0x7fa2e00b6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:21.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2de7fc700 1 -- 172.21.15.63:0/3131962292 >> v2:172.21.15.155:3300/0 conn(0x7fa2e0143200 msgr2=0x7fa2e00ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:21.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2de7fc700 1 --2- 172.21.15.63:0/3131962292 >> v2:172.21.15.155:3300/0 conn(0x7fa2e0143200 0x7fa2e00ad0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:21.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2de7fc700 1 -- 172.21.15.63:0/3131962292 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e00acc40 con 0x7fa2e01435e0 2020-05-18T21:27:21.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2df7fe700 1 --2- 172.21.15.63:0/3131962292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2e00b5c40 0x7fa2e00b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:27:21.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2de7fc700 1 --2- 172.21.15.63:0/3131962292 >> v2:172.21.15.63:3300/0 conn(0x7fa2e01435e0 0x7fa2e0143a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa2d4002f70 tx=0x7fa2d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2de7fc700 1 --2- 172.21.15.63:0/3131962292 >> v2:172.21.15.63:3300/0 conn(0x7fa2e01435e0 0x7fa2e0143a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa2d4002f70 tx=0x7fa2d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2de7fc700 1 --2- 172.21.15.63:0/3131962292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e01435e0 0x7fa2e0143a50 secure :-1 s=READY pgs=289 cs=0 l=1 rx=0x7fa2d4002f70 tx=0x7fa2d4007a80).ready entity=mon.0 client_cookie=a4955b3180d966d2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:21.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2de7fc700 1 --2- 172.21.15.63:0/3131962292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e01435e0 0x7fa2e0143a50 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7fa2d4002f70 tx=0x7fa2d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2ddffb700 1 -- 172.21.15.63:0/3131962292 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d40116b0 con 0x7fa2e01435e0 2020-05-18T21:27:21.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2de7fc700 1 --2- 172.21.15.63:0/3131962292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e01435e0 0x7fa2e0143a50 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7fa2d4002f70 tx=0x7fa2d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2ddffb700 1 -- 172.21.15.63:0/3131962292 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d4011810 con 0x7fa2e01435e0 2020-05-18T21:27:21.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2de7fc700 1 --2- 172.21.15.63:0/3131962292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e01435e0 0x7fa2e0143a50 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7fa2d4002f70 tx=0x7fa2d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2ddffb700 1 -- 172.21.15.63:0/3131962292 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d4011c30 con 0x7fa2e01435e0 2020-05-18T21:27:21.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2e57d7700 1 -- 172.21.15.63:0/3131962292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e01435e0 msgr2=0x7fa2e0143a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:21.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2e57d7700 1 --2- 172.21.15.63:0/3131962292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e01435e0 0x7fa2e0143a50 secure :-1 s=READY pgs=289 cs=0 l=1 rx=0x7fa2d4002f70 tx=0x7fa2d4007a80).stop 2020-05-18T21:27:21.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2e57d7700 1 -- 172.21.15.63:0/3131962292 shutdown_connections 2020-05-18T21:27:21.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2e57d7700 1 --2- 172.21.15.63:0/3131962292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2e00b5c40 0x7fa2e00b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:21.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2e57d7700 1 --2- 172.21.15.63:0/3131962292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e01435e0 0x7fa2e0143a50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:21.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2e57d7700 1 --2- 172.21.15.63:0/3131962292 >> v2:172.21.15.155:3300/0 conn(0x7fa2e0143200 0x7fa2e00ad0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:21.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2e57d7700 1 -- 172.21.15.63:0/3131962292 >> 172.21.15.63:0/3131962292 conn(0x7fa2e0066d00 msgr2=0x7fa2e00b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:21.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2e57d7700 1 -- 172.21.15.63:0/3131962292 shutdown_connections 2020-05-18T21:27:21.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.045+0000 7fa2e57d7700 1 -- 172.21.15.63:0/3131962292 wait complete. 2020-05-18T21:27:21.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2e57d7700 1 Processor -- start 2020-05-18T21:27:21.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2e57d7700 1 -- start start 2020-05-18T21:27:21.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2e57d7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2e00b5c40 0x7fa2e0140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:21.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2e57d7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa2e0143200 0x7fa2e0153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2e57d7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e00b0d30 con 0x7fa2e01435e0 2020-05-18T21:27:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2e57d7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e013e4c0 con 0x7fa2e0143200 2020-05-18T21:27:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2e57d7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e0154570 con 0x7fa2e00b5c40 2020-05-18T21:27:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2de7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa2e0143200 0x7fa2e0153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2df7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa2e01435e0 0x7fa2e013be40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55938/0 (socket says 172.21.15.63:55938) 2020-05-18T21:27:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2df7fe700 1 -- 172.21.15.63:0/1512928356 learned_addr learned my addr 172.21.15.63:0/1512928356 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2deffd700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2e00b5c40 0x7fa2e0140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2de7fc700 1 -- 172.21.15.63:0/1512928356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2e00b5c40 msgr2=0x7fa2e0140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2de7fc700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2e00b5c40 0x7fa2e0140260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2de7fc700 1 -- 172.21.15.63:0/1512928356 >> v1:172.21.15.63:6789/0 conn(0x7fa2e01435e0 legacy=0x7fa2e013be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2cffff700 1 -- 172.21.15.63:0/1512928356 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769979031 0 0) 0x7fa2e00b0d30 con 0x7fa2e01435e0 2020-05-18T21:27:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2de7fc700 1 -- 172.21.15.63:0/1512928356 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e00b1190 con 0x7fa2e0143200 2020-05-18T21:27:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2de7fc700 1 --2- 172.21.15.63:0/1512928356 >> v2:172.21.15.63:3300/0 conn(0x7fa2e0143200 0x7fa2e0153bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa2d4002f70 tx=0x7fa2d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2de7fc700 1 --2- 172.21.15.63:0/1512928356 >> v2:172.21.15.63:3300/0 conn(0x7fa2e0143200 0x7fa2e0153bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa2d4002f70 tx=0x7fa2d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2de7fc700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e0143200 0x7fa2e0153bb0 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7fa2d4002f70 tx=0x7fa2d4007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2de7fc700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e0143200 0x7fa2e0153bb0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fa2d4002f70 tx=0x7fa2d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2cffff700 1 -- 172.21.15.63:0/1512928356 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d4011ea0 con 0x7fa2e0143200 2020-05-18T21:27:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2de7fc700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e0143200 0x7fa2e0153bb0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fa2d4002f70 tx=0x7fa2d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2cffff700 1 -- 172.21.15.63:0/1512928356 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d4007360 con 0x7fa2e0143200 2020-05-18T21:27:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2de7fc700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e0143200 0x7fa2e0153bb0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fa2d4002f70 tx=0x7fa2d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2e57d7700 1 -- 172.21.15.63:0/1512928356 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e00aeb20 con 0x7fa2e0143200 2020-05-18T21:27:21.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2cffff700 1 -- 172.21.15.63:0/1512928356 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d4011cf0 con 0x7fa2e0143200 2020-05-18T21:27:21.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.049+0000 7fa2e57d7700 1 -- 172.21.15.63:0/1512928356 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e0154230 con 0x7fa2e0143200 2020-05-18T21:27:21.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.053+0000 7fa2de7fc700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e0143200 0x7fa2e0153bb0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fa2d4002f70 tx=0x7fa2d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.053+0000 7fa2e57d7700 1 -- 172.21.15.63:0/1512928356 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e013c890 con 0x7fa2e0143200 2020-05-18T21:27:21.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.053+0000 7fa2cffff700 1 -- 172.21.15.63:0/1512928356 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa2d4005700 con 0x7fa2e0143200 2020-05-18T21:27:21.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.053+0000 7fa2de7fc700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e0143200 0x7fa2e0153bb0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fa2d4002f70 tx=0x7fa2d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.053+0000 7fa2cffff700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa2bc04f830 0x7fa2bc051cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:21.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.053+0000 7fa2cffff700 1 -- 172.21.15.63:0/1512928356 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa2d4064320 con 0x7fa2e0143200 2020-05-18T21:27:21.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.053+0000 7fa2deffd700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa2bc04f830 0x7fa2bc051cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:21.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.053+0000 7fa2deffd700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa2bc04f830 0x7fa2bc051cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa2d0002f70 tx=0x7fa2d0006ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.053+0000 7fa2deffd700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa2bc04f830 0x7fa2bc051cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa2d0002f70 tx=0x7fa2d0006ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.053+0000 7fa2deffd700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa2bc04f830 0x7fa2bc051cf0 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7fa2d0002f70 tx=0x7fa2d0006ea0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:21.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.061+0000 7fa2de7fc700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e0143200 0x7fa2e0153bb0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fa2d4002f70 tx=0x7fa2d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.061+0000 7fa2cffff700 1 -- 172.21.15.63:0/1512928356 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa2d403e6b0 con 0x7fa2e0143200 2020-05-18T21:27:21.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.181+0000 7fa2e57d7700 1 -- 172.21.15.63:0/1512928356 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa2e00b1320 con 0x7fa2e0143200 2020-05-18T21:27:21.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.181+0000 7fa2de7fc700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e0143200 0x7fa2e0153bb0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fa2d4002f70 tx=0x7fa2d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.181+0000 7fa2cffff700 1 -- 172.21.15.63:0/1512928356 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v23) v1 ==== 81+0+33696 (secure 0 0 0) 0x7fa2e00b1320 con 0x7fa2e0143200 2020-05-18T21:27:21.191 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:21.191 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:27:21.191 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 23, 2020-05-18T21:27:21.194 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:27:21.194 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2020-05-18T21:26:28.798650+0000", 2020-05-18T21:27:21.194 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2020-05-18T21:26:47.498250+0000", 2020-05-18T21:27:21.195 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:27:21.195 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:27:21.195 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-05-18T21:27:21.195 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5799936, 2020-05-18T21:27:21.195 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2020-05-18T21:27:21.196 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2020-05-18T21:27:21.196 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2020-05-18T21:27:21.198 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2020-05-18T21:27:21.198 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2020-05-18T21:27:21.198 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:27:21.199 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 4, 2020-05-18T21:27:21.199 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2020-05-18T21:27:21.199 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-05-18T21:27:21.199 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2020-05-18T21:27:21.199 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2020-05-18T21:27:21.199 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 4, 2020-05-18T21:27:21.200 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 8, 2020-05-18T21:27:21.200 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2020-05-18T21:27:21.200 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "jewel", 2020-05-18T21:27:21.200 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "pacific", 2020-05-18T21:27:21.202 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:27:21.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.202 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2020-05-18T21:27:21.202 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "device_health_metrics", 2020-05-18T21:27:21.203 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:33.080792+0000", 2020-05-18T21:27:21.203 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:27:21.203 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:27:21.203 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:27:21.204 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:27:21.204 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:27:21.204 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:27:21.204 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:27:21.205 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:27:21.205 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2020-05-18T21:27:21.206 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2020-05-18T21:27:21.206 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2020-05-18T21:27:21.206 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2020-05-18T21:27:21.206 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2020-05-18T21:27:21.206 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:27:21.207 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:27:21.207 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:27:21.207 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:27:21.207 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:27:21.207 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:27:21.208 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:27:21.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.208 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "15", 2020-05-18T21:27:21.208 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:27:21.208 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:27:21.209 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:27:21.209 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:27:21.210 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:27:21.210 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:27:21.210 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:27:21.210 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:27:21.210 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:27:21.211 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:27:21.211 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:27:21.211 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:27:21.211 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:27:21.211 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:27:21.212 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:27:21.212 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:27:21.212 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:27:21.212 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:27:21.213 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:27:21.216 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:27:21.216 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:27:21.216 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:27:21.217 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:27:21.217 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:27:21.217 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:27:21.217 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:27:21.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.218 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:27:21.218 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:27:21.219 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:27:21.219 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:27:21.219 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:27:21.220 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:27:21.220 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:27:21.220 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:27:21.220 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:27:21.220 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:27:21.221 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:27:21.222 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:27:21.222 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2020-05-18T21:27:21.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.222 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:27:21.222 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_devicehealth": {} 2020-05-18T21:27:21.223 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.223 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2020-05-18T21:27:21.223 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2020-05-18T21:27:21.224 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:40.149370+0000", 2020-05-18T21:27:21.224 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:27:21.225 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:27:21.225 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:27:21.225 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:27:21.225 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:27:21.225 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:27:21.226 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:27:21.226 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:27:21.226 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:27:21.226 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:27:21.226 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:27:21.226 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:27:21.227 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:27:21.227 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:27:21.227 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:27:21.227 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:27:21.227 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:27:21.228 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:27:21.228 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:27:21.228 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:27:21.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.228 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2020-05-18T21:27:21.228 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:27:21.229 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:27:21.229 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:27:21.229 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:27:21.229 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:27:21.229 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:27:21.230 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:27:21.230 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:27:21.230 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:27:21.230 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:27:21.230 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:27:21.230 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:27:21.231 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:27:21.231 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:27:21.231 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:27:21.232 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:27:21.232 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:27:21.232 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:27:21.233 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:27:21.233 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:27:21.234 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:27:21.234 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:27:21.234 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:27:21.234 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:27:21.234 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:27:21.235 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:27:21.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.235 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:27:21.235 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:27:21.235 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:27:21.236 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:27:21.236 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:27:21.236 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:27:21.236 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:27:21.236 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:27:21.237 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:27:21.237 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:27:21.237 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:27:21.237 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:27:21.238 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:27:21.238 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2020-05-18T21:27:21.238 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.238 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 3, 2020-05-18T21:27:21.239 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2020-05-18T21:27:21.239 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:43.453504+0000", 2020-05-18T21:27:21.239 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:27:21.239 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:27:21.239 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:27:21.240 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:27:21.240 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:27:21.240 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:27:21.240 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:27:21.240 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:27:21.241 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:27:21.241 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:27:21.241 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:27:21.241 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:27:21.241 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:27:21.241 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:27:21.242 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:27:21.242 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:27:21.242 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:27:21.242 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:27:21.242 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:27:21.243 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:27:21.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.243 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "21", 2020-05-18T21:27:21.243 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:27:21.243 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:27:21.243 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:27:21.244 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:27:21.244 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:27:21.244 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:27:21.244 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:27:21.244 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:27:21.245 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:27:21.245 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:27:21.245 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:27:21.245 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:27:21.245 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:27:21.245 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:27:21.246 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:27:21.246 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:27:21.246 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:27:21.246 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:27:21.246 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:27:21.247 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:27:21.247 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:27:21.247 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:27:21.247 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:27:21.247 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:27:21.247 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:27:21.248 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:27:21.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.248 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:27:21.248 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:27:21.248 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:27:21.249 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:27:21.249 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:27:21.249 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:27:21.249 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:27:21.249 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:27:21.249 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:27:21.250 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:27:21.250 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:27:21.250 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:27:21.250 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2020-05-18T21:27:21.250 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2020-05-18T21:27:21.251 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2020-05-18T21:27:21.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.252 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:27:21.252 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:27:21.252 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2020-05-18T21:27:21.252 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.253 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.253 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 4, 2020-05-18T21:27:21.253 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2020-05-18T21:27:21.254 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:44.456531+0000", 2020-05-18T21:27:21.254 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:27:21.254 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:27:21.255 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:27:21.255 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:27:21.255 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:27:21.255 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:27:21.256 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:27:21.256 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:27:21.256 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:27:21.256 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:27:21.256 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:27:21.256 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:27:21.257 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:27:21.257 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:27:21.257 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:27:21.257 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:27:21.257 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:27:21.258 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:27:21.258 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:27:21.258 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:27:21.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.259 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "23", 2020-05-18T21:27:21.259 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:27:21.259 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:27:21.260 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:27:21.260 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:27:21.260 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:27:21.260 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:27:21.260 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:27:21.261 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:27:21.261 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:27:21.261 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:27:21.261 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:27:21.261 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:27:21.261 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:27:21.262 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:27:21.262 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:27:21.262 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:27:21.262 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:27:21.262 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:27:21.263 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:27:21.264 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:27:21.264 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:27:21.264 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:27:21.264 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:27:21.265 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:27:21.265 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:27:21.265 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:27:21.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.266 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:27:21.266 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:27:21.266 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:27:21.266 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:27:21.267 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:27:21.267 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:27:21.267 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:27:21.267 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:27:21.268 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:27:21.268 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:27:21.268 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:27:21.268 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:27:21.269 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:27:21.269 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:27:21.269 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2020-05-18T21:27:21.269 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.270 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.270 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.270 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:27:21.270 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2020-05-18T21:27:21.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.271 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:27:21.271 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "c6ae0fbf-604c-4e8d-b1b8-6038821420e3", 2020-05-18T21:27:21.271 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:27:21.272 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:27:21.272 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:27:21.272 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:27:21.272 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:27:21.273 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:27:21.273 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:27:21.273 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 20, 2020-05-18T21:27:21.273 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:27:21.274 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:27:21.274 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:27:21.274 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.275 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.275 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2020-05-18T21:27:21.275 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:27:21.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.276 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.276 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2020-05-18T21:27:21.276 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:27:21.276 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.277 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.278 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:27:21.278 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.279 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.279 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6802", 2020-05-18T21:27:21.279 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:27:21.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.280 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.280 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6803", 2020-05-18T21:27:21.280 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:27:21.281 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.281 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.281 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:27:21.282 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.282 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.282 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6806", 2020-05-18T21:27:21.283 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:27:21.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.284 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.284 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6807", 2020-05-18T21:27:21.284 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:27:21.284 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.285 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.286 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:27:21.286 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.286 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.287 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6804", 2020-05-18T21:27:21.287 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:27:21.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.289 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.289 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6805", 2020-05-18T21:27:21.290 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:27:21.290 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.290 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.291 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6801/12803", 2020-05-18T21:27:21.291 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6803/12803", 2020-05-18T21:27:21.291 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6807/12803", 2020-05-18T21:27:21.292 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6805/12803", 2020-05-18T21:27:21.292 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:27:21.292 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:27:21.292 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:27:21.293 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.293 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:27:21.294 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6", 2020-05-18T21:27:21.294 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:27:21.294 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:27:21.294 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:27:21.294 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:27:21.295 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:27:21.295 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:27:21.295 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:27:21.295 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 20, 2020-05-18T21:27:21.295 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:27:21.296 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:27:21.296 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:27:21.296 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.297 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.297 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6808", 2020-05-18T21:27:21.298 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:27:21.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.298 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.298 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6809", 2020-05-18T21:27:21.299 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:27:21.299 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.299 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.300 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:27:21.300 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.300 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.300 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6810", 2020-05-18T21:27:21.301 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:27:21.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.301 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.301 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6811", 2020-05-18T21:27:21.302 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:27:21.302 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.302 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.302 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:27:21.303 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.303 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.303 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6815", 2020-05-18T21:27:21.304 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:27:21.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.304 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.305 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6817", 2020-05-18T21:27:21.305 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:27:21.305 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.305 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.306 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:27:21.306 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.307 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.307 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6812", 2020-05-18T21:27:21.307 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:27:21.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.308 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.308 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6813", 2020-05-18T21:27:21.308 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:27:21.309 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.309 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.309 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6809/12804", 2020-05-18T21:27:21.309 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6811/12804", 2020-05-18T21:27:21.310 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6817/12804", 2020-05-18T21:27:21.310 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6813/12804", 2020-05-18T21:27:21.310 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:27:21.310 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:27:21.311 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:27:21.311 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.312 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:27:21.312 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "ec8d9fa9-dae9-45f6-b286-735ab3801c27", 2020-05-18T21:27:21.312 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:27:21.312 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:27:21.313 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:27:21.313 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:27:21.314 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:27:21.314 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:27:21.320 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:27:21.320 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 16, 2020-05-18T21:27:21.321 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:27:21.321 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:27:21.321 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:27:21.321 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.322 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.322 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6822", 2020-05-18T21:27:21.322 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:27:21.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.322 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.323 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6824", 2020-05-18T21:27:21.323 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:27:21.323 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.323 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.324 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:27:21.324 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.324 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.324 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6826", 2020-05-18T21:27:21.325 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:27:21.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.325 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.325 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6827", 2020-05-18T21:27:21.326 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:27:21.326 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.326 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.326 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:27:21.326 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.327 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.327 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6830", 2020-05-18T21:27:21.327 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:27:21.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.328 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.328 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6831", 2020-05-18T21:27:21.328 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:27:21.328 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.329 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.329 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:27:21.329 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.330 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.330 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6828", 2020-05-18T21:27:21.330 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:27:21.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.331 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.331 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6829", 2020-05-18T21:27:21.331 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:27:21.331 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.331 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.332 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6824/12806", 2020-05-18T21:27:21.332 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6827/12806", 2020-05-18T21:27:21.332 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6831/12806", 2020-05-18T21:27:21.332 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6829/12806", 2020-05-18T21:27:21.333 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:27:21.333 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:27:21.333 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:27:21.333 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.334 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:27:21.334 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "1030fedf-adad-4e79-b839-59385d4d7d2a", 2020-05-18T21:27:21.334 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:27:21.335 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:27:21.335 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:27:21.335 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:27:21.335 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:27:21.335 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:27:21.335 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:27:21.336 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 20, 2020-05-18T21:27:21.336 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:27:21.336 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:27:21.336 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:27:21.336 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.337 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.337 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6814", 2020-05-18T21:27:21.337 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:27:21.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.338 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.338 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6816", 2020-05-18T21:27:21.338 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:27:21.338 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.338 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.339 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:27:21.339 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.339 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.340 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6818", 2020-05-18T21:27:21.340 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:27:21.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.340 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.340 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6819", 2020-05-18T21:27:21.341 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:27:21.341 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.341 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.341 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:27:21.342 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.342 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.342 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6823", 2020-05-18T21:27:21.342 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:27:21.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.343 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.343 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6825", 2020-05-18T21:27:21.343 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:27:21.343 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.344 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.344 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:27:21.344 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.344 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.345 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6820", 2020-05-18T21:27:21.345 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:27:21.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.345 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.346 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6821", 2020-05-18T21:27:21.346 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:27:21.346 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.346 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.346 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6816/12805", 2020-05-18T21:27:21.347 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6819/12805", 2020-05-18T21:27:21.347 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6825/12805", 2020-05-18T21:27:21.347 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6821/12805", 2020-05-18T21:27:21.347 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:27:21.347 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:27:21.348 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:27:21.348 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.348 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:27:21.348 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "8ad15a9b-97b4-4002-b1d4-7292e09b4ef6", 2020-05-18T21:27:21.349 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:27:21.349 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:27:21.349 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:27:21.349 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:27:21.349 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:27:21.350 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:27:21.350 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:27:21.350 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 20, 2020-05-18T21:27:21.350 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:27:21.350 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:27:21.351 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:27:21.351 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.351 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.351 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6800", 2020-05-18T21:27:21.351 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:27:21.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.352 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.352 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6801", 2020-05-18T21:27:21.352 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:27:21.353 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.353 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.353 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:27:21.353 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.354 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.354 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6802", 2020-05-18T21:27:21.354 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:27:21.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.355 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.355 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6803", 2020-05-18T21:27:21.355 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:27:21.355 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.355 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.356 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:27:21.356 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.356 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.356 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6806", 2020-05-18T21:27:21.357 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:27:21.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.357 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.357 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6807", 2020-05-18T21:27:21.357 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:27:21.358 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.358 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.358 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:27:21.358 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.359 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.359 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6804", 2020-05-18T21:27:21.359 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:27:21.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.360 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.360 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6805", 2020-05-18T21:27:21.360 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:27:21.360 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.360 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.361 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6801/13023", 2020-05-18T21:27:21.361 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6803/13023", 2020-05-18T21:27:21.361 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6807/13023", 2020-05-18T21:27:21.361 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6805/13023", 2020-05-18T21:27:21.362 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:27:21.362 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:27:21.362 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:27:21.362 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.363 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:27:21.363 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0dce88f8-b984-43e1-95e2-4132171102d2", 2020-05-18T21:27:21.363 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:27:21.363 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:27:21.363 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:27:21.364 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:27:21.364 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:27:21.364 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:27:21.364 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:27:21.364 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 19, 2020-05-18T21:27:21.364 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:27:21.365 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:27:21.365 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:27:21.365 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.365 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.366 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6808", 2020-05-18T21:27:21.366 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:27:21.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.366 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.366 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6809", 2020-05-18T21:27:21.367 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:27:21.367 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.367 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.367 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:27:21.368 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.368 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.368 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6810", 2020-05-18T21:27:21.368 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:27:21.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.369 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.369 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6811", 2020-05-18T21:27:21.369 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:27:21.369 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.370 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.370 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:27:21.370 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.371 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.371 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6814", 2020-05-18T21:27:21.371 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:27:21.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.372 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.372 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6816", 2020-05-18T21:27:21.372 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:27:21.372 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.372 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.373 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:27:21.373 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.373 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.374 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6812", 2020-05-18T21:27:21.374 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:27:21.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.374 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.375 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6813", 2020-05-18T21:27:21.375 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:27:21.375 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.375 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.375 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6809/13024", 2020-05-18T21:27:21.376 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6811/13024", 2020-05-18T21:27:21.376 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6816/13024", 2020-05-18T21:27:21.376 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6813/13024", 2020-05-18T21:27:21.376 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:27:21.376 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:27:21.377 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:27:21.377 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.377 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:27:21.377 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "e1bc92f8-3692-4483-b0fb-905c94fa1469", 2020-05-18T21:27:21.378 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:27:21.378 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:27:21.378 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:27:21.378 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:27:21.378 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:27:21.379 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:27:21.379 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:27:21.379 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 21, 2020-05-18T21:27:21.379 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:27:21.379 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:27:21.379 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:27:21.380 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.380 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.380 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6815", 2020-05-18T21:27:21.380 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:27:21.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.381 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.381 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6817", 2020-05-18T21:27:21.381 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:27:21.381 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.382 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.382 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:27:21.382 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.383 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.383 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6818", 2020-05-18T21:27:21.383 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:27:21.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.384 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.384 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6819", 2020-05-18T21:27:21.384 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:27:21.384 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.384 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.385 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:27:21.385 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.385 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.386 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6822", 2020-05-18T21:27:21.386 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:27:21.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.387 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.387 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6824", 2020-05-18T21:27:21.387 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:27:21.387 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.387 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.388 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:27:21.388 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.388 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.388 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6820", 2020-05-18T21:27:21.389 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:27:21.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.389 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.389 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6821", 2020-05-18T21:27:21.389 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:27:21.390 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.390 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.390 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6817/13025", 2020-05-18T21:27:21.390 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6819/13025", 2020-05-18T21:27:21.391 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6824/13025", 2020-05-18T21:27:21.391 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6821/13025", 2020-05-18T21:27:21.391 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:27:21.391 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:27:21.391 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:27:21.391 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.392 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:27:21.392 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "b76e000c-a078-48c4-9e1e-34d286a9992c", 2020-05-18T21:27:21.392 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:27:21.393 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:27:21.393 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:27:21.393 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:27:21.393 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:27:21.393 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:27:21.393 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:27:21.394 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 16, 2020-05-18T21:27:21.394 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:27:21.394 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:27:21.394 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:27:21.394 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.395 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.395 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6823", 2020-05-18T21:27:21.395 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:27:21.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.396 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.396 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6825", 2020-05-18T21:27:21.396 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:27:21.396 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.396 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.397 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:27:21.397 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.397 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.397 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6826", 2020-05-18T21:27:21.398 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:27:21.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.398 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.398 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6827", 2020-05-18T21:27:21.399 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:27:21.399 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.399 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.400 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:27:21.400 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.400 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.400 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6830", 2020-05-18T21:27:21.401 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:27:21.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.401 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.402 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6831", 2020-05-18T21:27:21.402 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:27:21.402 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.402 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.403 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:27:21.403 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:21.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.403 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:21.403 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6828", 2020-05-18T21:27:21.403 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:27:21.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.404 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:21.404 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6829", 2020-05-18T21:27:21.404 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:27:21.405 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.405 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.405 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6825/13026", 2020-05-18T21:27:21.405 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6827/13026", 2020-05-18T21:27:21.406 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6831/13026", 2020-05-18T21:27:21.406 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6829/13026", 2020-05-18T21:27:21.406 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:27:21.406 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:27:21.406 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:27:21.407 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:21.407 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.407 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:27:21.407 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2020-05-18T21:27:21.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.408 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:27:21.408 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:27:21.408 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:27:21.408 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:27:21.408 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:27:21.409 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:27:21.409 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.281434+0000", 2020-05-18T21:27:21.409 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:27:21.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.410 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:27:21.410 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:27:21.410 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:27:21.410 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:27:21.410 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:27:21.410 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:27:21.411 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.608518+0000", 2020-05-18T21:27:21.411 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:27:21.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.411 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:27:21.412 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:27:21.412 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:27:21.412 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:27:21.412 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:27:21.412 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:27:21.412 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.582386+0000", 2020-05-18T21:27:21.413 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:27:21.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.413 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:27:21.413 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:27:21.414 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:27:21.414 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:27:21.414 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:27:21.414 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:27:21.414 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.573488+0000", 2020-05-18T21:27:21.414 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:27:21.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.415 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:27:21.415 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:27:21.415 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:27:21.416 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:27:21.416 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:27:21.416 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:27:21.416 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.604174+0000", 2020-05-18T21:27:21.416 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:27:21.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.417 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:27:21.417 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:27:21.417 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:27:21.417 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:27:21.418 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:27:21.418 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:27:21.418 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.371004+0000", 2020-05-18T21:27:21.418 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:27:21.418 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.419 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:27:21.419 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:27:21.419 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:27:21.419 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:27:21.419 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:27:21.420 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:27:21.420 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.593070+0000", 2020-05-18T21:27:21.420 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:27:21.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:21.421 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:27:21.421 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:27:21.421 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:27:21.421 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:27:21.421 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:27:21.421 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:27:21.422 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.667677+0000", 2020-05-18T21:27:21.422 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:27:21.422 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.422 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:27:21.422 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2020-05-18T21:27:21.423 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2020-05-18T21:27:21.423 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2020-05-18T21:27:21.423 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2020-05-18T21:27:21.423 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklist": {}, 2020-05-18T21:27:21.423 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2020-05-18T21:27:21.423 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2020-05-18T21:27:21.424 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2020-05-18T21:27:21.424 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2020-05-18T21:27:21.424 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2020-05-18T21:27:21.424 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2020-05-18T21:27:21.424 INFO:teuthology.orchestra.run.smithi063.stdout: "ruleset-failure-domain": "osd", 2020-05-18T21:27:21.425 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2020-05-18T21:27:21.425 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:21.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:21.425 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2020-05-18T21:27:21.425 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2020-05-18T21:27:21.425 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2020-05-18T21:27:21.426 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2020-05-18T21:27:21.426 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {} 2020-05-18T21:27:21.426 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:27:21.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.181+0000 7fa2e57d7700 1 -- 172.21.15.63:0/1512928356 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa2bc04f830 msgr2=0x7fa2bc051cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:21.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.181+0000 7fa2e57d7700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa2bc04f830 0x7fa2bc051cf0 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7fa2d0002f70 tx=0x7fa2d0006ea0).stop 2020-05-18T21:27:21.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.181+0000 7fa2e57d7700 1 -- 172.21.15.63:0/1512928356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e0143200 msgr2=0x7fa2e0153bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:21.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.181+0000 7fa2e57d7700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e0143200 0x7fa2e0153bb0 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7fa2d4002f70 tx=0x7fa2d4007a80).stop 2020-05-18T21:27:21.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.181+0000 7fa2e57d7700 1 -- 172.21.15.63:0/1512928356 shutdown_connections 2020-05-18T21:27:21.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.181+0000 7fa2e57d7700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa2bc04f830 0x7fa2bc051cf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:21.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.181+0000 7fa2e57d7700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e0143200 0x7fa2e0153bb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.181+0000 7fa2e57d7700 1 --2- 172.21.15.63:0/1512928356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2e00b5c40 0x7fa2e0140260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.181+0000 7fa2e57d7700 1 -- 172.21.15.63:0/1512928356 >> 172.21.15.63:0/1512928356 conn(0x7fa2e0066d00 msgr2=0x7fa2e00622d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.181+0000 7fa2e57d7700 1 -- 172.21.15.63:0/1512928356 shutdown_connections 2020-05-18T21:27:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.185+0000 7fa2e57d7700 1 -- 172.21.15.63:0/1512928356 wait complete. 2020-05-18T21:27:21.430 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:27:21.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848f50e700 1 Processor -- start 2020-05-18T21:27:21.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848f50e700 1 -- start start 2020-05-18T21:27:21.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848f50e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880b2860 0x7f84880615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:21.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848f50e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f848814e570 0x7f848814a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:21.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848f50e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848814d960 con 0x7f8488060b90 2020-05-18T21:27:21.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848f50e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8488066210 con 0x7f848814e570 2020-05-18T21:27:21.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848f50e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848814db90 con 0x7f84880b2860 2020-05-18T21:27:21.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848daab700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f848814e570 0x7f848814a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:21.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848d2aa700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8488060b90 0x7f8488144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55942/0 (socket says 172.21.15.63:55942) 2020-05-18T21:27:21.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848d2aa700 1 -- 172.21.15.63:0/77070144 learned_addr learned my addr 172.21.15.63:0/77070144 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:21.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848caa9700 1 --2- 172.21.15.63:0/77070144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880b2860 0x7f84880615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:21.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848daab700 1 -- 172.21.15.63:0/77070144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880b2860 msgr2=0x7f84880615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:21.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848daab700 1 --2- 172.21.15.63:0/77070144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880b2860 0x7f84880615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:21.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f847bfff700 1 -- 172.21.15.63:0/77070144 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526097874 0 0) 0x7f848814d960 con 0x7f8488060b90 2020-05-18T21:27:21.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848daab700 1 -- 172.21.15.63:0/77070144 >> v1:172.21.15.63:6789/0 conn(0x7f8488060b90 legacy=0x7f8488144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:21.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848daab700 1 -- 172.21.15.63:0/77070144 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848814de30 con 0x7f848814e570 2020-05-18T21:27:21.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848daab700 1 --2- 172.21.15.63:0/77070144 >> v2:172.21.15.63:3300/0 conn(0x7f848814e570 0x7f848814a390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8484002f70 tx=0x7f8484007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848daab700 1 --2- 172.21.15.63:0/77070144 >> v2:172.21.15.63:3300/0 conn(0x7f848814e570 0x7f848814a390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8484002f70 tx=0x7f8484007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848daab700 1 --2- 172.21.15.63:0/77070144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f848814e570 0x7f848814a390 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7f8484002f70 tx=0x7f8484007a80).ready entity=mon.0 client_cookie=d457cac5ce275989 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:21.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848daab700 1 --2- 172.21.15.63:0/77070144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f848814e570 0x7f848814a390 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f8484002f70 tx=0x7f8484007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f847bfff700 1 -- 172.21.15.63:0/77070144 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8484008e80 con 0x7f848814e570 2020-05-18T21:27:21.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848daab700 1 --2- 172.21.15.63:0/77070144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f848814e570 0x7f848814a390 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f8484002f70 tx=0x7f8484007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848daab700 1 --2- 172.21.15.63:0/77070144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f848814e570 0x7f848814a390 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f8484002f70 tx=0x7f8484007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f847bfff700 1 -- 172.21.15.63:0/77070144 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84840115f0 con 0x7f848814e570 2020-05-18T21:27:21.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f847bfff700 1 -- 172.21.15.63:0/77070144 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84840119d0 con 0x7f848814e570 2020-05-18T21:27:21.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848f50e700 1 -- 172.21.15.63:0/77070144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f848814e570 msgr2=0x7f848814a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:21.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.537+0000 7f848f50e700 1 --2- 172.21.15.63:0/77070144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f848814e570 0x7f848814a390 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7f8484002f70 tx=0x7f8484007a80).stop 2020-05-18T21:27:21.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.541+0000 7f848f50e700 1 -- 172.21.15.63:0/77070144 shutdown_connections 2020-05-18T21:27:21.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.541+0000 7f848f50e700 1 --2- 172.21.15.63:0/77070144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f848814e570 0x7f848814a390 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:21.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.541+0000 7f848f50e700 1 --2- 172.21.15.63:0/77070144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880b2860 0x7f84880615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:21.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.541+0000 7f848f50e700 1 -- 172.21.15.63:0/77070144 >> 172.21.15.63:0/77070144 conn(0x7f84880b83d0 msgr2=0x7f84880b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:21.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.541+0000 7f848f50e700 1 -- 172.21.15.63:0/77070144 shutdown_connections 2020-05-18T21:27:21.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.541+0000 7f848f50e700 1 -- 172.21.15.63:0/77070144 wait complete. 2020-05-18T21:27:21.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.541+0000 7f848f50e700 1 Processor -- start 2020-05-18T21:27:21.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.541+0000 7f848f50e700 1 -- start start 2020-05-18T21:27:21.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848f50e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f84880b2860 0x7f84881456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:21.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848f50e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84880ac770 con 0x7f848814e570 2020-05-18T21:27:21.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848f50e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8488147230 con 0x7f8488060b90 2020-05-18T21:27:21.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848f50e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84881474d0 con 0x7f84880b2860 2020-05-18T21:27:21.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848daab700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f848814e570 0x7f848814c550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55952/0 (socket says 172.21.15.63:55952) 2020-05-18T21:27:21.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848daab700 1 -- 172.21.15.63:0/1454016221 learned_addr learned my addr 172.21.15.63:0/1454016221 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:21.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848caa9700 1 --2- 172.21.15.63:0/1454016221 >> v2:172.21.15.155:3300/0 conn(0x7f84880b2860 0x7f84881456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:21.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f847a7fc700 1 -- 172.21.15.63:0/1454016221 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4268407470 0 0) 0x7f84880ac770 con 0x7f848814e570 2020-05-18T21:27:21.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f847a7fc700 1 -- 172.21.15.63:0/1454016221 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8470002fe0 con 0x7f848814e570 2020-05-18T21:27:21.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f847a7fc700 1 -- 172.21.15.63:0/1454016221 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2007033148 0 0) 0x7f8470002fe0 con 0x7f848814e570 2020-05-18T21:27:21.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848caa9700 1 -- 172.21.15.63:0/1454016221 >> v1:172.21.15.155:6789/0 conn(0x7f8488060b90 legacy=0x7f8488143470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:21.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848caa9700 1 -- 172.21.15.63:0/1454016221 >> v1:172.21.15.63:6789/0 conn(0x7f848814e570 legacy=0x7f848814c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:21.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848caa9700 1 -- 172.21.15.63:0/1454016221 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8488147770 con 0x7f84880b2860 2020-05-18T21:27:21.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848caa9700 1 --2- 172.21.15.63:0/1454016221 >> v2:172.21.15.155:3300/0 conn(0x7f84880b2860 0x7f84881456d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f84840078c0 tx=0x7f8480010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848caa9700 1 --2- 172.21.15.63:0/1454016221 >> v2:172.21.15.155:3300/0 conn(0x7f84880b2860 0x7f84881456d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f84840078c0 tx=0x7f8480010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848caa9700 1 --2- 172.21.15.63:0/1454016221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880b2860 0x7f84881456d0 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f84840078c0 tx=0x7f8480010f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:21.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848caa9700 1 --2- 172.21.15.63:0/1454016221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880b2860 0x7f84881456d0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f84840078c0 tx=0x7f8480010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f847a7fc700 1 -- 172.21.15.63:0/1454016221 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8484008e80 con 0x7f84880b2860 2020-05-18T21:27:21.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848caa9700 1 --2- 172.21.15.63:0/1454016221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880b2860 0x7f84881456d0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f84840078c0 tx=0x7f8480010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f847a7fc700 1 -- 172.21.15.63:0/1454016221 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8480005e70 con 0x7f84880b2860 2020-05-18T21:27:21.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848caa9700 1 --2- 172.21.15.63:0/1454016221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880b2860 0x7f84881456d0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f84840078c0 tx=0x7f8480010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f847a7fc700 1 -- 172.21.15.63:0/1454016221 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8480007560 con 0x7f84880b2860 2020-05-18T21:27:21.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848f50e700 1 -- 172.21.15.63:0/1454016221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8488147c10 con 0x7f84880b2860 2020-05-18T21:27:21.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848f50e700 1 -- 172.21.15.63:0/1454016221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8488143d20 con 0x7f84880b2860 2020-05-18T21:27:21.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848caa9700 1 --2- 172.21.15.63:0/1454016221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880b2860 0x7f84881456d0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f84840078c0 tx=0x7f8480010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.545+0000 7f848f50e700 1 -- 172.21.15.63:0/1454016221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848814c2c0 con 0x7f84880b2860 2020-05-18T21:27:21.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.549+0000 7f848caa9700 1 --2- 172.21.15.63:0/1454016221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880b2860 0x7f84881456d0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f84840078c0 tx=0x7f8480010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.549+0000 7f847a7fc700 1 -- 172.21.15.63:0/1454016221 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8480007760 con 0x7f84880b2860 2020-05-18T21:27:21.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.549+0000 7f847a7fc700 1 --2- 172.21.15.63:0/1454016221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f847004fce0 0x7f84700521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:21.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.549+0000 7f847a7fc700 1 -- 172.21.15.63:0/1454016221 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8480063c30 con 0x7f84880b2860 2020-05-18T21:27:21.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.549+0000 7f848d2aa700 1 --2- 172.21.15.63:0/1454016221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f847004fce0 0x7f84700521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:21.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.549+0000 7f848d2aa700 1 --2- 172.21.15.63:0/1454016221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f847004fce0 0x7f84700521a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f84880660a0 tx=0x7f847c0014b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.549+0000 7f848d2aa700 1 --2- 172.21.15.63:0/1454016221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f847004fce0 0x7f84700521a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f84880660a0 tx=0x7f847c0014b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.549+0000 7f848d2aa700 1 --2- 172.21.15.63:0/1454016221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f847004fce0 0x7f84700521a0 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f84880660a0 tx=0x7f847c0014b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:21.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.557+0000 7f848caa9700 1 --2- 172.21.15.63:0/1454016221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880b2860 0x7f84881456d0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f84840078c0 tx=0x7f8480010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.557+0000 7f847a7fc700 1 -- 172.21.15.63:0/1454016221 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f848814c2c0 con 0x7f84880b2860 2020-05-18T21:27:21.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.705+0000 7f848f50e700 1 -- 172.21.15.63:0/1454016221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f848814c2c0 con 0x7f84880b2860 2020-05-18T21:27:21.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.709+0000 7f848caa9700 1 --2- 172.21.15.63:0/1454016221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880b2860 0x7f84881456d0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f84840078c0 tx=0x7f8480010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.709+0000 7f847a7fc700 1 -- 172.21.15.63:0/1454016221 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2137 (secure 0 0 0) 0x7f848814c2c0 con 0x7f84880b2860 2020-05-18T21:27:21.714 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:21.715 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4404,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2550679674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2550679674},{"type":"v1","addr":"172.21.15.155:6835","nonce":2550679674}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":7}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:26:45.491730+0000","modified":"2020-05-18T21:26:49.514812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4369},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4369":{"gid":4369,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.63:6833/2283817704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2283817704},{"type":"v1","addr":"172.21.15.63:6833","nonce":2283817704}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-05-18T21:27:21.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.709+0000 7f848f50e700 1 -- 172.21.15.63:0/1454016221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f847004fce0 msgr2=0x7f84700521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:21.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.709+0000 7f848f50e700 1 --2- 172.21.15.63:0/1454016221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f847004fce0 0x7f84700521a0 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f84880660a0 tx=0x7f847c0014b0).stop 2020-05-18T21:27:21.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.709+0000 7f848f50e700 1 -- 172.21.15.63:0/1454016221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880b2860 msgr2=0x7f84881456d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:21.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.709+0000 7f848f50e700 1 --2- 172.21.15.63:0/1454016221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880b2860 0x7f84881456d0 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f84840078c0 tx=0x7f8480010f60).stop 2020-05-18T21:27:21.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.709+0000 7f848f50e700 1 -- 172.21.15.63:0/1454016221 shutdown_connections 2020-05-18T21:27:21.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.709+0000 7f848f50e700 1 --2- 172.21.15.63:0/1454016221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f847004fce0 0x7f84700521a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:21.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.709+0000 7f848f50e700 1 --2- 172.21.15.63:0/1454016221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880b2860 0x7f84881456d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:21.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.709+0000 7f848f50e700 1 -- 172.21.15.63:0/1454016221 >> 172.21.15.63:0/1454016221 conn(0x7f84880b83d0 msgr2=0x7f84880b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:21.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.709+0000 7f848f50e700 1 -- 172.21.15.63:0/1454016221 shutdown_connections 2020-05-18T21:27:21.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.709+0000 7f848f50e700 1 -- 172.21.15.63:0/1454016221 wait complete. 2020-05-18T21:27:21.718 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 7 2020-05-18T21:27:21.730 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-05-18T21:27:21.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.829+0000 7f7fba261700 1 Processor -- start 2020-05-18T21:27:21.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.829+0000 7f7fba261700 1 -- start start 2020-05-18T21:27:21.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fba261700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fb41456e0 0x7f7fb409b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:21.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fba261700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7fb4060b60 0x7f7fb40b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:21.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fba261700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb405f590 con 0x7f7fb40b2410 2020-05-18T21:27:21.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fba261700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb405f800 con 0x7f7fb4060b60 2020-05-18T21:27:21.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fba261700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb4145ac0 con 0x7f7fb41456e0 2020-05-18T21:27:21.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fb9a60700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7fb40b2410 0x7f7fb40b3160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55960/0 (socket says 172.21.15.63:55960) 2020-05-18T21:27:21.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fb9a60700 1 -- 172.21.15.63:0/108096662 learned_addr learned my addr 172.21.15.63:0/108096662 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:21.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fb8a5e700 1 --2- 172.21.15.63:0/108096662 >> v2:172.21.15.155:3300/0 conn(0x7f7fb4060b60 0x7f7fb40b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:21.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fb925f700 1 --2- 172.21.15.63:0/108096662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fb41456e0 0x7f7fb409b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:21.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fabfff700 1 -- 172.21.15.63:0/108096662 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079326576 0 0) 0x7f7fb405f590 con 0x7f7fb40b2410 2020-05-18T21:27:21.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fabfff700 1 -- 172.21.15.63:0/108096662 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f98003270 con 0x7f7fb40b2410 2020-05-18T21:27:21.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fb8a5e700 1 -- 172.21.15.63:0/108096662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fb41456e0 msgr2=0x7f7fb409b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:21.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fb8a5e700 1 --2- 172.21.15.63:0/108096662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fb41456e0 0x7f7fb409b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:21.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fb8a5e700 1 -- 172.21.15.63:0/108096662 >> v1:172.21.15.63:6789/0 conn(0x7f7fb40b2410 legacy=0x7f7fb40b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:21.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fb8a5e700 1 -- 172.21.15.63:0/108096662 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb40b4380 con 0x7f7fb4060b60 2020-05-18T21:27:21.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fb925f700 1 --2- 172.21.15.63:0/108096662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fb41456e0 0x7f7fb409b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:21.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fb8a5e700 1 --2- 172.21.15.63:0/108096662 >> v2:172.21.15.155:3300/0 conn(0x7f7fb4060b60 0x7f7fb40b1fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7fa4002f70 tx=0x7f7fa4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fb8a5e700 1 --2- 172.21.15.63:0/108096662 >> v2:172.21.15.155:3300/0 conn(0x7f7fb4060b60 0x7f7fb40b1fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7fa4002f70 tx=0x7f7fa4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fb8a5e700 1 --2- 172.21.15.63:0/108096662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb4060b60 0x7f7fb40b1fb0 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7f7fa4002f70 tx=0x7f7fa4007a80).ready entity=mon.1 client_cookie=cf05239a78b7bf00 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:21.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fb8a5e700 1 --2- 172.21.15.63:0/108096662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb4060b60 0x7f7fb40b1fb0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f7fa4002f70 tx=0x7f7fa4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fabfff700 1 -- 172.21.15.63:0/108096662 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fa4008e80 con 0x7f7fb4060b60 2020-05-18T21:27:21.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fb8a5e700 1 --2- 172.21.15.63:0/108096662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb4060b60 0x7f7fb40b1fb0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f7fa4002f70 tx=0x7f7fa4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fb8a5e700 1 --2- 172.21.15.63:0/108096662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb4060b60 0x7f7fb40b1fb0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f7fa4002f70 tx=0x7f7fa4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fabfff700 1 -- 172.21.15.63:0/108096662 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa4011540 con 0x7f7fb4060b60 2020-05-18T21:27:21.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fabfff700 1 -- 172.21.15.63:0/108096662 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fa4011960 con 0x7f7fb4060b60 2020-05-18T21:27:21.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fba261700 1 -- 172.21.15.63:0/108096662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb4060b60 msgr2=0x7f7fb40b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:21.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fba261700 1 --2- 172.21.15.63:0/108096662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb4060b60 0x7f7fb40b1fb0 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7f7fa4002f70 tx=0x7f7fa4007a80).stop 2020-05-18T21:27:21.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fba261700 1 -- 172.21.15.63:0/108096662 shutdown_connections 2020-05-18T21:27:21.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fba261700 1 --2- 172.21.15.63:0/108096662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb4060b60 0x7f7fb40b1fb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:21.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fba261700 1 --2- 172.21.15.63:0/108096662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fb41456e0 0x7f7fb409b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:21.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fba261700 1 -- 172.21.15.63:0/108096662 >> 172.21.15.63:0/108096662 conn(0x7f7fb40b9630 msgr2=0x7f7fb40b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:21.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fba261700 1 -- 172.21.15.63:0/108096662 shutdown_connections 2020-05-18T21:27:21.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.833+0000 7f7fba261700 1 -- 172.21.15.63:0/108096662 wait complete. 2020-05-18T21:27:21.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fba261700 1 Processor -- start 2020-05-18T21:27:21.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fba261700 1 -- start start 2020-05-18T21:27:21.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fba261700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7fb4060b60 0x7f7fb41573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:21.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fba261700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fb40b2410 0x7f7fb41438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:21.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fba261700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb4153720 con 0x7f7fb41456e0 2020-05-18T21:27:21.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fba261700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb41539c0 con 0x7f7fb4060b60 2020-05-18T21:27:21.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fba261700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb4153c60 con 0x7f7fb40b2410 2020-05-18T21:27:21.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fb9a60700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7fb41456e0 0x7f7fb41505a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55966/0 (socket says 172.21.15.63:55966) 2020-05-18T21:27:21.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fb9a60700 1 -- 172.21.15.63:0/3452094926 learned_addr learned my addr 172.21.15.63:0/3452094926 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:21.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fb925f700 1 --2- 172.21.15.63:0/3452094926 >> v2:172.21.15.155:3300/0 conn(0x7f7fb4060b60 0x7f7fb41573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:21.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fb8a5e700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fb40b2410 0x7f7fb41438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:21.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7faa7fc700 1 -- 172.21.15.63:0/3452094926 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504940654 0 0) 0x7f7fb4153720 con 0x7f7fb41456e0 2020-05-18T21:27:21.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7faa7fc700 1 -- 172.21.15.63:0/3452094926 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f9c002fe0 con 0x7f7fb41456e0 2020-05-18T21:27:21.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fb925f700 1 -- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fb40b2410 msgr2=0x7f7fb41438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:21.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fb925f700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fb40b2410 0x7f7fb41438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:21.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7faa7fc700 1 -- 172.21.15.63:0/3452094926 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3349459592 0 0) 0x7f7f9c002fe0 con 0x7f7fb41456e0 2020-05-18T21:27:21.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fb925f700 1 -- 172.21.15.63:0/3452094926 >> v1:172.21.15.63:6789/0 conn(0x7f7fb41456e0 legacy=0x7f7fb41505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:21.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fb925f700 1 -- 172.21.15.63:0/3452094926 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb4150cb0 con 0x7f7fb4060b60 2020-05-18T21:27:21.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fb8a5e700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fb40b2410 0x7f7fb41438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:21.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fb925f700 1 --2- 172.21.15.63:0/3452094926 >> v2:172.21.15.155:3300/0 conn(0x7f7fb4060b60 0x7f7fb41573c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7fac001de0 tx=0x7f7fb0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fb925f700 1 --2- 172.21.15.63:0/3452094926 >> v2:172.21.15.155:3300/0 conn(0x7f7fb4060b60 0x7f7fb41573c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7fac001de0 tx=0x7f7fb0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fb925f700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb4060b60 0x7f7fb41573c0 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7f7fac001de0 tx=0x7f7fb0010db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:21.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fb925f700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb4060b60 0x7f7fb41573c0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f7fac001de0 tx=0x7f7fb0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7faa7fc700 1 -- 172.21.15.63:0/3452094926 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fac001c40 con 0x7f7fb4060b60 2020-05-18T21:27:21.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fba261700 1 -- 172.21.15.63:0/3452094926 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb40624c0 con 0x7f7fb4060b60 2020-05-18T21:27:21.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fb925f700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb4060b60 0x7f7fb41573c0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f7fac001de0 tx=0x7f7fb0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fb925f700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb4060b60 0x7f7fb41573c0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f7fac001de0 tx=0x7f7fb0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7faa7fc700 1 -- 172.21.15.63:0/3452094926 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb0007370 con 0x7f7fb4060b60 2020-05-18T21:27:21.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7faa7fc700 1 -- 172.21.15.63:0/3452094926 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fb0005a00 con 0x7f7fb4060b60 2020-05-18T21:27:21.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.837+0000 7f7fba261700 1 -- 172.21.15.63:0/3452094926 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb4143d50 con 0x7f7fb4060b60 2020-05-18T21:27:21.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.841+0000 7f7fba261700 1 -- 172.21.15.63:0/3452094926 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb4153e60 con 0x7f7fb4060b60 2020-05-18T21:27:21.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.841+0000 7f7fb925f700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb4060b60 0x7f7fb41573c0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f7fac001de0 tx=0x7f7fb0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.841+0000 7f7faa7fc700 1 -- 172.21.15.63:0/3452094926 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7fb0013070 con 0x7f7fb4060b60 2020-05-18T21:27:21.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.841+0000 7f7fb925f700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb4060b60 0x7f7fb41573c0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f7fac001de0 tx=0x7f7fb0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.841+0000 7f7faa7fc700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7f9c04fce0 0x7f7f9c0521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:21.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.841+0000 7f7faa7fc700 1 -- 172.21.15.63:0/3452094926 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7fb00637d0 con 0x7f7fb4060b60 2020-05-18T21:27:21.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.841+0000 7f7fb8a5e700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7f9c04fce0 0x7f7f9c0521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:21.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.841+0000 7f7fb8a5e700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7f9c04fce0 0x7f7f9c0521a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7fa4002f70 tx=0x7f7fa4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.841+0000 7f7fb8a5e700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7f9c04fce0 0x7f7f9c0521a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7fa4002f70 tx=0x7f7fa4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.841+0000 7f7fb8a5e700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7f9c04fce0 0x7f7f9c0521a0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f7fa4002f70 tx=0x7f7fa4007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:21.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.849+0000 7f7fb925f700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb4060b60 0x7f7fb41573c0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f7fac001de0 tx=0x7f7fb0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:21.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.849+0000 7f7faa7fc700 1 -- 172.21.15.63:0/3452094926 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f7fb4153e60 con 0x7f7fb4060b60 2020-05-18T21:27:22.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:21.997+0000 7f7fba261700 1 -- 172.21.15.63:0/3452094926 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7fb4153e60 con 0x7f7fb4060b60 2020-05-18T21:27:22.129 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:27:22.121+0000 7fdb4592c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:27:22.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.137+0000 7f7fb925f700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb4060b60 0x7f7fb41573c0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f7fac001de0 tx=0x7f7fb0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.137+0000 7f7faa7fc700 1 -- 172.21.15.63:0/3452094926 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7fb4153e60 con 0x7f7fb4060b60 2020-05-18T21:27:22.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.141+0000 7f7fba261700 1 -- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7f9c04fce0 msgr2=0x7f7f9c0521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:22.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.141+0000 7f7fba261700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7f9c04fce0 0x7f7f9c0521a0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f7fa4002f70 tx=0x7f7fa4007a80).stop 2020-05-18T21:27:22.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.141+0000 7f7fba261700 1 -- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb4060b60 msgr2=0x7f7fb41573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:22.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.141+0000 7f7fba261700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb4060b60 0x7f7fb41573c0 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7f7fac001de0 tx=0x7f7fb0010db0).stop 2020-05-18T21:27:22.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.141+0000 7f7fba261700 1 -- 172.21.15.63:0/3452094926 shutdown_connections 2020-05-18T21:27:22.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.141+0000 7f7fba261700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7f9c04fce0 0x7f7f9c0521a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:22.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.141+0000 7f7fba261700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fb40b2410 0x7f7fb41438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:22.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.141+0000 7f7fba261700 1 --2- 172.21.15.63:0/3452094926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb4060b60 0x7f7fb41573c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:22.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.141+0000 7f7fba261700 1 -- 172.21.15.63:0/3452094926 >> 172.21.15.63:0/3452094926 conn(0x7f7fb40b9630 msgr2=0x7f7fb4140b10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:22.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.141+0000 7f7fba261700 1 -- 172.21.15.63:0/3452094926 shutdown_connections 2020-05-18T21:27:22.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.141+0000 7f7fba261700 1 -- 172.21.15.63:0/3452094926 wait complete. 2020-05-18T21:27:22.150 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-05-18T21:27:22.165 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:27:22.181 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:27:22.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.261+0000 7f26db307700 1 Processor -- start 2020-05-18T21:27:22.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.261+0000 7f26db307700 1 -- start start 2020-05-18T21:27:22.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.261+0000 7f26db307700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f26d409e7f0 0x7f26d406a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:22.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.261+0000 7f26db307700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f26d40b5040 0x7f26d4141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:22.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.261+0000 7f26db307700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26d4142350 con 0x7f26d4141f20 2020-05-18T21:27:22.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.261+0000 7f26db307700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d40b5750 con 0x7f26d40b5040 2020-05-18T21:27:22.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.261+0000 7f26db307700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d40b59f0 con 0x7f26d409e7f0 2020-05-18T21:27:22.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.261+0000 7f26d88a2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f26d40b5040 0x7f26d4141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:22.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.261+0000 7f26d90a3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f26d409e7f0 0x7f26d406a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:22.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26d98a4700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f26d4141f20 0x7f26d40610e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:54308/0 (socket says 172.21.15.63:54308) 2020-05-18T21:27:22.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26d98a4700 1 -- 172.21.15.63:0/1528293077 learned_addr learned my addr 172.21.15.63:0/1528293077 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:22.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26c3fff700 1 -- 172.21.15.63:0/1528293077 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549525674 0 0) 0x7f26d4142350 con 0x7f26d4141f20 2020-05-18T21:27:22.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26c3fff700 1 -- 172.21.15.63:0/1528293077 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26bc003270 con 0x7f26d4141f20 2020-05-18T21:27:22.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26d88a2700 1 -- 172.21.15.63:0/1528293077 >> v2:172.21.15.155:3300/0 conn(0x7f26d409e7f0 msgr2=0x7f26d406a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:22.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26d88a2700 1 --2- 172.21.15.63:0/1528293077 >> v2:172.21.15.155:3300/0 conn(0x7f26d409e7f0 0x7f26d406a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:22.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26d88a2700 1 -- 172.21.15.63:0/1528293077 >> v1:172.21.15.155:6789/0 conn(0x7f26d4141f20 legacy=0x7f26d40610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:22.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26d88a2700 1 -- 172.21.15.63:0/1528293077 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d40b5c90 con 0x7f26d40b5040 2020-05-18T21:27:22.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26d90a3700 1 --2- 172.21.15.63:0/1528293077 >> v2:172.21.15.155:3300/0 conn(0x7f26d409e7f0 0x7f26d406a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:22.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26d88a2700 1 --2- 172.21.15.63:0/1528293077 >> v2:172.21.15.63:3300/0 conn(0x7f26d40b5040 0x7f26d4141ac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f26c4002f70 tx=0x7f26c4009c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26d88a2700 1 --2- 172.21.15.63:0/1528293077 >> v2:172.21.15.63:3300/0 conn(0x7f26d40b5040 0x7f26d4141ac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f26c4002f70 tx=0x7f26c4009c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26d88a2700 1 --2- 172.21.15.63:0/1528293077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26d40b5040 0x7f26d4141ac0 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f26c4002f70 tx=0x7f26c4009c90).ready entity=mon.0 client_cookie=3a430d02270ac949 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:22.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26d88a2700 1 --2- 172.21.15.63:0/1528293077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26d40b5040 0x7f26d4141ac0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f26c4002f70 tx=0x7f26c4009c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26c3fff700 1 -- 172.21.15.63:0/1528293077 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26c400ae70 con 0x7f26d40b5040 2020-05-18T21:27:22.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26d88a2700 1 --2- 172.21.15.63:0/1528293077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26d40b5040 0x7f26d4141ac0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f26c4002f70 tx=0x7f26c4009c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26c3fff700 1 -- 172.21.15.63:0/1528293077 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c4013940 con 0x7f26d40b5040 2020-05-18T21:27:22.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26d88a2700 1 --2- 172.21.15.63:0/1528293077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26d40b5040 0x7f26d4141ac0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f26c4002f70 tx=0x7f26c4009c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26c3fff700 1 -- 172.21.15.63:0/1528293077 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26c4013d20 con 0x7f26d40b5040 2020-05-18T21:27:22.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26db307700 1 -- 172.21.15.63:0/1528293077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26d40b5040 msgr2=0x7f26d4141ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:22.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26db307700 1 --2- 172.21.15.63:0/1528293077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26d40b5040 0x7f26d4141ac0 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f26c4002f70 tx=0x7f26c4009c90).stop 2020-05-18T21:27:22.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26db307700 1 -- 172.21.15.63:0/1528293077 shutdown_connections 2020-05-18T21:27:22.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26db307700 1 --2- 172.21.15.63:0/1528293077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26d40b5040 0x7f26d4141ac0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:22.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26db307700 1 --2- 172.21.15.63:0/1528293077 >> v2:172.21.15.155:3300/0 conn(0x7f26d409e7f0 0x7f26d406a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:22.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26db307700 1 -- 172.21.15.63:0/1528293077 >> 172.21.15.63:0/1528293077 conn(0x7f26d405b240 msgr2=0x7f26d4069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:22.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26db307700 1 -- 172.21.15.63:0/1528293077 shutdown_connections 2020-05-18T21:27:22.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.265+0000 7f26db307700 1 -- 172.21.15.63:0/1528293077 wait complete. 2020-05-18T21:27:22.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.269+0000 7f26db307700 1 Processor -- start 2020-05-18T21:27:22.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.269+0000 7f26db307700 1 -- start start 2020-05-18T21:27:22.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.269+0000 7f26db307700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f26d409e7f0 0x7f26d40610e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:22.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.269+0000 7f26db307700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26d40b5040 0x7f26d4142350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:22.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.269+0000 7f26db307700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26d4142d70 con 0x7f26d4141f20 2020-05-18T21:27:22.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.269+0000 7f26db307700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d4143010 con 0x7f26d409e7f0 2020-05-18T21:27:22.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.269+0000 7f26db307700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d41432b0 con 0x7f26d40b5040 2020-05-18T21:27:22.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.269+0000 7f26d90a3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f26d409e7f0 0x7f26d40610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:22.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.269+0000 7f26d98a4700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f26d4141f20 0x7f26d40b8d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55998/0 (socket says 172.21.15.63:55998) 2020-05-18T21:27:22.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.269+0000 7f26d90a3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f26d409e7f0 0x7f26d40610e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53806/0 (socket says 172.21.15.63:53806) 2020-05-18T21:27:22.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.269+0000 7f26d98a4700 1 -- 172.21.15.63:0/642034271 learned_addr learned my addr 172.21.15.63:0/642034271 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:22.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.269+0000 7f26d88a2700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26d40b5040 0x7f26d4142350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:22.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26d90a3700 1 -- 172.21.15.63:0/642034271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26d40b5040 msgr2=0x7f26d4142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:22.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26d90a3700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26d40b5040 0x7f26d4142350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:22.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26c27fc700 1 -- 172.21.15.63:0/642034271 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3256951071 0 0) 0x7f26d4142d70 con 0x7f26d4141f20 2020-05-18T21:27:22.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26d90a3700 1 -- 172.21.15.63:0/642034271 >> v1:172.21.15.63:6789/0 conn(0x7f26d4141f20 legacy=0x7f26d40b8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:22.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26d90a3700 1 -- 172.21.15.63:0/642034271 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d40b9490 con 0x7f26d409e7f0 2020-05-18T21:27:22.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26d90a3700 1 --2- 172.21.15.63:0/642034271 >> v2:172.21.15.63:3300/0 conn(0x7f26d409e7f0 0x7f26d40610e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26d0002f70 tx=0x7f26d0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26d90a3700 1 --2- 172.21.15.63:0/642034271 >> v2:172.21.15.63:3300/0 conn(0x7f26d409e7f0 0x7f26d40610e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26d0002f70 tx=0x7f26d0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26d90a3700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26d409e7f0 0x7f26d40610e0 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7f26d0002f70 tx=0x7f26d0010db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:22.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26d90a3700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26d409e7f0 0x7f26d40610e0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f26d0002f70 tx=0x7f26d0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26c27fc700 1 -- 172.21.15.63:0/642034271 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26d0005a00 con 0x7f26d409e7f0 2020-05-18T21:27:22.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26d90a3700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26d409e7f0 0x7f26d40610e0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f26d0002f70 tx=0x7f26d0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26d90a3700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26d409e7f0 0x7f26d40610e0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f26d0002f70 tx=0x7f26d0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26c27fc700 1 -- 172.21.15.63:0/642034271 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d0005b60 con 0x7f26d409e7f0 2020-05-18T21:27:22.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26db307700 1 -- 172.21.15.63:0/642034271 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d41524f0 con 0x7f26d409e7f0 2020-05-18T21:27:22.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26c27fc700 1 -- 172.21.15.63:0/642034271 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26d0012450 con 0x7f26d409e7f0 2020-05-18T21:27:22.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26db307700 1 -- 172.21.15.63:0/642034271 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d413ea00 con 0x7f26d409e7f0 2020-05-18T21:27:22.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26d90a3700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26d409e7f0 0x7f26d40610e0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f26d0002f70 tx=0x7f26d0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26db307700 1 -- 172.21.15.63:0/642034271 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d414efd0 con 0x7f26d409e7f0 2020-05-18T21:27:22.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26c27fc700 1 -- 172.21.15.63:0/642034271 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f26d00125b0 con 0x7f26d409e7f0 2020-05-18T21:27:22.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26d90a3700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26d409e7f0 0x7f26d40610e0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f26d0002f70 tx=0x7f26d0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26c27fc700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f26b404f890 0x7f26b4051d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:22.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26c27fc700 1 -- 172.21.15.63:0/642034271 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f26d0063e50 con 0x7f26d409e7f0 2020-05-18T21:27:22.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26d88a2700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f26b404f890 0x7f26b4051d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:22.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26d88a2700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f26b404f890 0x7f26b4051d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26c4002f70 tx=0x7f26c4009c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26d88a2700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f26b404f890 0x7f26b4051d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26c4002f70 tx=0x7f26c4009c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.273+0000 7f26d88a2700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f26b404f890 0x7f26b4051d50 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f26c4002f70 tx=0x7f26c4009c90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:22.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.277+0000 7f26d90a3700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26d409e7f0 0x7f26d40610e0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f26d0002f70 tx=0x7f26d0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.277+0000 7f26c27fc700 1 -- 172.21.15.63:0/642034271 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f26d003e180 con 0x7f26d409e7f0 2020-05-18T21:27:22.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.425+0000 7f26db307700 1 -- 172.21.15.63:0/642034271 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26d40569e0 con 0x7f26d409e7f0 2020-05-18T21:27:22.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.429+0000 7f26d90a3700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26d409e7f0 0x7f26d40610e0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f26d0002f70 tx=0x7f26d0010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.429+0000 7f26c27fc700 1 -- 172.21.15.63:0/642034271 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+1777 (secure 0 0 0) 0x7f26d00417a0 con 0x7f26d409e7f0 2020-05-18T21:27:22.435 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:22.435 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4404,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2550679674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2550679674},{"type":"v1","addr":"172.21.15.155:6835","nonce":2550679674}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":7}],"filesystems":[{"mdsmap":{"epoch":8,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:26:45.491730+0000","modified":"2020-05-18T21:27:22.126771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-05-18T21:27:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.429+0000 7f26db307700 1 -- 172.21.15.63:0/642034271 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f26b404f890 msgr2=0x7f26b4051d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.429+0000 7f26db307700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f26b404f890 0x7f26b4051d50 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f26c4002f70 tx=0x7f26c4009c90).stop 2020-05-18T21:27:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.429+0000 7f26db307700 1 -- 172.21.15.63:0/642034271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26d409e7f0 msgr2=0x7f26d40610e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.429+0000 7f26db307700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26d409e7f0 0x7f26d40610e0 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7f26d0002f70 tx=0x7f26d0010db0).stop 2020-05-18T21:27:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.429+0000 7f26db307700 1 -- 172.21.15.63:0/642034271 shutdown_connections 2020-05-18T21:27:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.429+0000 7f26db307700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f26b404f890 0x7f26b4051d50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.429+0000 7f26db307700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26d40b5040 0x7f26d4142350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.429+0000 7f26db307700 1 --2- 172.21.15.63:0/642034271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26d409e7f0 0x7f26d40610e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.429+0000 7f26db307700 1 -- 172.21.15.63:0/642034271 >> 172.21.15.63:0/642034271 conn(0x7f26d405b240 msgr2=0x7f26d409cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.429+0000 7f26db307700 1 -- 172.21.15.63:0/642034271 shutdown_connections 2020-05-18T21:27:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.429+0000 7f26db307700 1 -- 172.21.15.63:0/642034271 wait complete. 2020-05-18T21:27:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2020-05-18T21:27:22.447 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-05-18T21:27:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.545+0000 7f45ad658700 1 Processor -- start 2020-05-18T21:27:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.545+0000 7f45ad658700 1 -- start start 2020-05-18T21:27:22.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.545+0000 7f45ad658700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f45a809f400 0x7f45a809c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:22.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.545+0000 7f45ad658700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f45a809cb10 0x7f45a80ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:22.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.545+0000 7f45ad658700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a8146040 con 0x7f45a80b97e0 2020-05-18T21:27:22.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.545+0000 7f45ad658700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a8069fe0 con 0x7f45a809f400 2020-05-18T21:27:22.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.545+0000 7f45ad658700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a8146270 con 0x7f45a809cb10 2020-05-18T21:27:22.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.545+0000 7f45a77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f45a809f400 0x7f45a809c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:22.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.545+0000 7f45a77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f45a809f400 0x7f45a809c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53816/0 (socket says 172.21.15.63:53816) 2020-05-18T21:27:22.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.545+0000 7f45a77fe700 1 -- 172.21.15.63:0/1079399700 learned_addr learned my addr 172.21.15.63:0/1079399700 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:22.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.545+0000 7f45ace57700 1 --2- 172.21.15.63:0/1079399700 >> v2:172.21.15.155:3300/0 conn(0x7f45a809cb10 0x7f45a80ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:22.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45a77fe700 1 -- 172.21.15.63:0/1079399700 >> v2:172.21.15.155:3300/0 conn(0x7f45a809cb10 msgr2=0x7f45a80ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:22.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45a77fe700 1 --2- 172.21.15.63:0/1079399700 >> v2:172.21.15.155:3300/0 conn(0x7f45a809cb10 0x7f45a80ae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:22.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45a77fe700 1 -- 172.21.15.63:0/1079399700 >> v1:172.21.15.155:6789/0 conn(0x7f45a80b97e0 legacy=0x7f45a8146710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:22.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45a6ffd700 1 -- 172.21.15.63:0/1079399700 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885428622 0 0) 0x7f45a8146040 con 0x7f45a80b97e0 2020-05-18T21:27:22.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45a77fe700 1 -- 172.21.15.63:0/1079399700 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a8146e20 con 0x7f45a809f400 2020-05-18T21:27:22.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45ace57700 1 --2- 172.21.15.63:0/1079399700 >> v2:172.21.15.155:3300/0 conn(0x7f45a809cb10 0x7f45a80ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:22.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45a77fe700 1 --2- 172.21.15.63:0/1079399700 >> v2:172.21.15.63:3300/0 conn(0x7f45a809f400 0x7f45a809c6b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f459c002f70 tx=0x7f459c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45a77fe700 1 --2- 172.21.15.63:0/1079399700 >> v2:172.21.15.63:3300/0 conn(0x7f45a809f400 0x7f45a809c6b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f459c002f70 tx=0x7f459c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45a77fe700 1 --2- 172.21.15.63:0/1079399700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45a809f400 0x7f45a809c6b0 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7f459c002f70 tx=0x7f459c007a80).ready entity=mon.0 client_cookie=ba6650b43ce27e11 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:22.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45a77fe700 1 --2- 172.21.15.63:0/1079399700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45a809f400 0x7f45a809c6b0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f459c002f70 tx=0x7f459c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45a6ffd700 1 -- 172.21.15.63:0/1079399700 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f459c0116b0 con 0x7f45a809f400 2020-05-18T21:27:22.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45a77fe700 1 --2- 172.21.15.63:0/1079399700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45a809f400 0x7f45a809c6b0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f459c002f70 tx=0x7f459c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45a77fe700 1 --2- 172.21.15.63:0/1079399700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45a809f400 0x7f45a809c6b0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f459c002f70 tx=0x7f459c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45a6ffd700 1 -- 172.21.15.63:0/1079399700 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c011810 con 0x7f45a809f400 2020-05-18T21:27:22.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45a6ffd700 1 -- 172.21.15.63:0/1079399700 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f459c011bf0 con 0x7f45a809f400 2020-05-18T21:27:22.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45ad658700 1 -- 172.21.15.63:0/1079399700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45a809f400 msgr2=0x7f45a809c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:22.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45ad658700 1 --2- 172.21.15.63:0/1079399700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45a809f400 0x7f45a809c6b0 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7f459c002f70 tx=0x7f459c007a80).stop 2020-05-18T21:27:22.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45ad658700 1 -- 172.21.15.63:0/1079399700 shutdown_connections 2020-05-18T21:27:22.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45ad658700 1 --2- 172.21.15.63:0/1079399700 >> v2:172.21.15.155:3300/0 conn(0x7f45a809cb10 0x7f45a80ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:22.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45ad658700 1 --2- 172.21.15.63:0/1079399700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45a809f400 0x7f45a809c6b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:22.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45ad658700 1 -- 172.21.15.63:0/1079399700 >> 172.21.15.63:0/1079399700 conn(0x7f45a805a7c0 msgr2=0x7f45a805abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:22.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45ad658700 1 -- 172.21.15.63:0/1079399700 shutdown_connections 2020-05-18T21:27:22.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45ad658700 1 -- 172.21.15.63:0/1079399700 wait complete. 2020-05-18T21:27:22.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.549+0000 7f45ad658700 1 Processor -- start 2020-05-18T21:27:22.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45ad658700 1 -- start start 2020-05-18T21:27:22.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45ad658700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f45a809cb10 0x7f45a80afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:22.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45ad658700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f45a809f400 0x7f45a80b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:22.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45ad658700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a8153a90 con 0x7f45a80b97e0 2020-05-18T21:27:22.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45ad658700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a80b0260 con 0x7f45a809cb10 2020-05-18T21:27:22.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45ad658700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a8153cc0 con 0x7f45a809f400 2020-05-18T21:27:22.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45a7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f45a809cb10 0x7f45a80afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:22.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45a7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f45a809cb10 0x7f45a80afe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53820/0 (socket says 172.21.15.63:53820) 2020-05-18T21:27:22.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45a7fff700 1 -- 172.21.15.63:0/1158930330 learned_addr learned my addr 172.21.15.63:0/1158930330 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:22.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45a77fe700 1 --2- 172.21.15.63:0/1158930330 >> v2:172.21.15.155:3300/0 conn(0x7f45a809f400 0x7f45a80b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:22.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45a7fff700 1 -- 172.21.15.63:0/1158930330 >> v2:172.21.15.155:3300/0 conn(0x7f45a809f400 msgr2=0x7f45a80b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:22.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45a7fff700 1 --2- 172.21.15.63:0/1158930330 >> v2:172.21.15.155:3300/0 conn(0x7f45a809f400 0x7f45a80b2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:22.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45a7fff700 1 -- 172.21.15.63:0/1158930330 >> v1:172.21.15.155:6789/0 conn(0x7f45a80b97e0 legacy=0x7f45a80b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:22.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45a7fff700 1 -- 172.21.15.63:0/1158930330 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a8154200 con 0x7f45a809cb10 2020-05-18T21:27:22.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45a7fff700 1 --2- 172.21.15.63:0/1158930330 >> v2:172.21.15.63:3300/0 conn(0x7f45a809cb10 0x7f45a80afe00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4598000ed0 tx=0x7f459800c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45a7fff700 1 --2- 172.21.15.63:0/1158930330 >> v2:172.21.15.63:3300/0 conn(0x7f45a809cb10 0x7f45a80afe00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4598000ed0 tx=0x7f459800c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45a7fff700 1 --2- 172.21.15.63:0/1158930330 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45a809cb10 0x7f45a80afe00 secure :-1 s=READY pgs=303 cs=0 l=1 rx=0x7f4598000ed0 tx=0x7f459800c4d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:22.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45a7fff700 1 --2- 172.21.15.63:0/1158930330 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45a809cb10 0x7f45a80afe00 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f4598000ed0 tx=0x7f459800c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45a57fa700 1 -- 172.21.15.63:0/1158930330 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f459800cc60 con 0x7f45a809cb10 2020-05-18T21:27:22.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45a7fff700 1 --2- 172.21.15.63:0/1158930330 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45a809cb10 0x7f45a80afe00 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f4598000ed0 tx=0x7f459800c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45a57fa700 1 -- 172.21.15.63:0/1158930330 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459800ce00 con 0x7f45a809cb10 2020-05-18T21:27:22.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45a7fff700 1 --2- 172.21.15.63:0/1158930330 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45a809cb10 0x7f45a80afe00 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f4598000ed0 tx=0x7f459800c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45ad658700 1 -- 172.21.15.63:0/1158930330 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a8153f60 con 0x7f45a809cb10 2020-05-18T21:27:22.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45a57fa700 1 -- 172.21.15.63:0/1158930330 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4598012260 con 0x7f45a809cb10 2020-05-18T21:27:22.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45ad658700 1 -- 172.21.15.63:0/1158930330 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a81534d0 con 0x7f45a809cb10 2020-05-18T21:27:22.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.553+0000 7f45a7fff700 1 --2- 172.21.15.63:0/1158930330 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45a809cb10 0x7f45a80afe00 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f4598000ed0 tx=0x7f459800c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.557+0000 7f45ad658700 1 -- 172.21.15.63:0/1158930330 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a80569e0 con 0x7f45a809cb10 2020-05-18T21:27:22.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.557+0000 7f45a57fa700 1 -- 172.21.15.63:0/1158930330 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4598006520 con 0x7f45a809cb10 2020-05-18T21:27:22.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.557+0000 7f45a7fff700 1 --2- 172.21.15.63:0/1158930330 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45a809cb10 0x7f45a80afe00 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f4598000ed0 tx=0x7f459800c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.557+0000 7f45a57fa700 1 --2- 172.21.15.63:0/1158930330 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f458804f8d0 0x7f4588051d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:22.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.557+0000 7f45a57fa700 1 -- 172.21.15.63:0/1158930330 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f4598063960 con 0x7f45a809cb10 2020-05-18T21:27:22.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.557+0000 7f45a77fe700 1 --2- 172.21.15.63:0/1158930330 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f458804f8d0 0x7f4588051d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:22.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.557+0000 7f45a77fe700 1 --2- 172.21.15.63:0/1158930330 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f458804f8d0 0x7f4588051d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f459c002f70 tx=0x7f459c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.557+0000 7f45a77fe700 1 --2- 172.21.15.63:0/1158930330 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f458804f8d0 0x7f4588051d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f459c002f70 tx=0x7f459c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.557+0000 7f45a77fe700 1 --2- 172.21.15.63:0/1158930330 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f458804f8d0 0x7f4588051d90 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f459c002f70 tx=0x7f459c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:22.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.565+0000 7f45a7fff700 1 --2- 172.21.15.63:0/1158930330 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45a809cb10 0x7f45a80afe00 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f4598000ed0 tx=0x7f459800c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:22.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.565+0000 7f45a57fa700 1 -- 172.21.15.63:0/1158930330 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f459803dc90 con 0x7f45a809cb10 2020-05-18T21:27:22.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:22.713+0000 7f45ad658700 1 -- 172.21.15.63:0/1158930330 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f45a806ac80 con 0x7f45a809cb10 2020-05-18T21:27:23.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.141+0000 7f45a7fff700 1 --2- 172.21.15.63:0/1158930330 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45a809cb10 0x7f45a80afe00 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f4598000ed0 tx=0x7f459800c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:23.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.141+0000 7f45a57fa700 1 -- 172.21.15.63:0/1158930330 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f45980412b0 con 0x7f45a809cb10 2020-05-18T21:27:23.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.145+0000 7f45ad658700 1 -- 172.21.15.63:0/1158930330 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f458804f8d0 msgr2=0x7f4588051d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:23.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.145+0000 7f45ad658700 1 --2- 172.21.15.63:0/1158930330 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f458804f8d0 0x7f4588051d90 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f459c002f70 tx=0x7f459c007a80).stop 2020-05-18T21:27:23.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.145+0000 7f45ad658700 1 -- 172.21.15.63:0/1158930330 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45a809cb10 msgr2=0x7f45a80afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:23.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.145+0000 7f45ad658700 1 --2- 172.21.15.63:0/1158930330 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45a809cb10 0x7f45a80afe00 secure :-1 s=READY pgs=303 cs=0 l=1 rx=0x7f4598000ed0 tx=0x7f459800c4d0).stop 2020-05-18T21:27:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.145+0000 7f45ad658700 1 -- 172.21.15.63:0/1158930330 shutdown_connections 2020-05-18T21:27:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.145+0000 7f45ad658700 1 --2- 172.21.15.63:0/1158930330 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f458804f8d0 0x7f4588051d90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.145+0000 7f45ad658700 1 --2- 172.21.15.63:0/1158930330 >> v2:172.21.15.155:3300/0 conn(0x7f45a809f400 0x7f45a80b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.145+0000 7f45ad658700 1 --2- 172.21.15.63:0/1158930330 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45a809cb10 0x7f45a80afe00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.145+0000 7f45ad658700 1 -- 172.21.15.63:0/1158930330 >> 172.21.15.63:0/1158930330 conn(0x7f45a805a7c0 msgr2=0x7f45a806a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:23.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.145+0000 7f45ad658700 1 -- 172.21.15.63:0/1158930330 shutdown_connections 2020-05-18T21:27:23.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.145+0000 7f45ad658700 1 -- 172.21.15.63:0/1158930330 wait complete. 2020-05-18T21:27:23.166 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-05-18T21:27:23.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.277+0000 7fbf45303700 1 Processor -- start 2020-05-18T21:27:23.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.277+0000 7fbf45303700 1 -- start start 2020-05-18T21:27:23.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.277+0000 7fbf45303700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbf4009e750 0x7fbf400b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:23.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.277+0000 7fbf45303700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf400b6110 con 0x7fbf401438a0 2020-05-18T21:27:23.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.277+0000 7fbf45303700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf400b63b0 con 0x7fbf400b9810 2020-05-18T21:27:23.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.277+0000 7fbf45303700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf400b6f60 con 0x7fbf4009e750 2020-05-18T21:27:23.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.277+0000 7fbf3f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbf401438a0 0x7fbf4013ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56020/0 (socket says 172.21.15.63:56020) 2020-05-18T21:27:23.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.277+0000 7fbf3f7fe700 1 -- 172.21.15.63:0/1000217955 learned_addr learned my addr 172.21.15.63:0/1000217955 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:23.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.277+0000 7fbf44b02700 1 --2- 172.21.15.63:0/1000217955 >> v2:172.21.15.63:3300/0 conn(0x7fbf4009e750 0x7fbf400b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:23.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf44b02700 1 -- 172.21.15.63:0/1000217955 >> v1:172.21.15.155:6789/0 conn(0x7fbf400b9810 legacy=0x7fbf400b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:23.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf44b02700 1 -- 172.21.15.63:0/1000217955 >> v1:172.21.15.63:6789/0 conn(0x7fbf401438a0 legacy=0x7fbf4013ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:23.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf44b02700 1 -- 172.21.15.63:0/1000217955 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf400b9bf0 con 0x7fbf4009e750 2020-05-18T21:27:23.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf44b02700 1 --2- 172.21.15.63:0/1000217955 >> v2:172.21.15.63:3300/0 conn(0x7fbf4009e750 0x7fbf400b3b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbf380032f0 tx=0x7fbf38007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:23.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf44b02700 1 --2- 172.21.15.63:0/1000217955 >> v2:172.21.15.63:3300/0 conn(0x7fbf4009e750 0x7fbf400b3b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbf380032f0 tx=0x7fbf38007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:23.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf44b02700 1 --2- 172.21.15.63:0/1000217955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf4009e750 0x7fbf400b3b60 secure :-1 s=READY pgs=305 cs=0 l=1 rx=0x7fbf380032f0 tx=0x7fbf38007e00).ready entity=mon.0 client_cookie=67bbb1928820fe7f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:23.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf44b02700 1 --2- 172.21.15.63:0/1000217955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf4009e750 0x7fbf400b3b60 secure :-1 s=THROTTLE_DONE pgs=305 cs=0 l=1 rx=0x7fbf380032f0 tx=0x7fbf38007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:23.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf44b02700 1 --2- 172.21.15.63:0/1000217955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf4009e750 0x7fbf400b3b60 secure :-1 s=THROTTLE_DONE pgs=305 cs=0 l=1 rx=0x7fbf380032f0 tx=0x7fbf38007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:23.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf3effd700 1 -- 172.21.15.63:0/1000217955 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf3800a370 con 0x7fbf4009e750 2020-05-18T21:27:23.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf44b02700 1 --2- 172.21.15.63:0/1000217955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf4009e750 0x7fbf400b3b60 secure :-1 s=THROTTLE_DONE pgs=305 cs=0 l=1 rx=0x7fbf380032f0 tx=0x7fbf38007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:23.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf3effd700 1 -- 172.21.15.63:0/1000217955 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3800a4d0 con 0x7fbf4009e750 2020-05-18T21:27:23.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf3effd700 1 -- 172.21.15.63:0/1000217955 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf3800a8f0 con 0x7fbf4009e750 2020-05-18T21:27:23.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf45303700 1 -- 172.21.15.63:0/1000217955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf4009e750 msgr2=0x7fbf400b3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:23.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf45303700 1 --2- 172.21.15.63:0/1000217955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf4009e750 0x7fbf400b3b60 secure :-1 s=READY pgs=305 cs=0 l=1 rx=0x7fbf380032f0 tx=0x7fbf38007e00).stop 2020-05-18T21:27:23.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf45303700 1 -- 172.21.15.63:0/1000217955 shutdown_connections 2020-05-18T21:27:23.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf45303700 1 --2- 172.21.15.63:0/1000217955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf4009e750 0x7fbf400b3b60 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:23.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf45303700 1 -- 172.21.15.63:0/1000217955 >> 172.21.15.63:0/1000217955 conn(0x7fbf4005a7c0 msgr2=0x7fbf4005aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:23.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf45303700 1 -- 172.21.15.63:0/1000217955 shutdown_connections 2020-05-18T21:27:23.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf45303700 1 -- 172.21.15.63:0/1000217955 wait complete. 2020-05-18T21:27:23.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf45303700 1 Processor -- start 2020-05-18T21:27:23.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.281+0000 7fbf45303700 1 -- start start 2020-05-18T21:27:23.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf45303700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbf4009e750 0x7fbf400b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:23.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf45303700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf401438a0 0x7fbf40142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:23.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf45303700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf40065980 con 0x7fbf400b9810 2020-05-18T21:27:23.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf45303700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf40153820 con 0x7fbf4009e750 2020-05-18T21:27:23.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf45303700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf401404e0 con 0x7fbf401438a0 2020-05-18T21:27:23.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf3f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbf400b9810 0x7fbf4013fdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56026/0 (socket says 172.21.15.63:56026) 2020-05-18T21:27:23.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf3f7fe700 1 -- 172.21.15.63:0/4002469267 learned_addr learned my addr 172.21.15.63:0/4002469267 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:23.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf44b02700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf401438a0 0x7fbf40142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:23.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf3ffff700 1 --2- 172.21.15.63:0/4002469267 >> v2:172.21.15.155:3300/0 conn(0x7fbf4009e750 0x7fbf400b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:23.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf3d7fa700 1 -- 172.21.15.63:0/4002469267 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163961178 0 0) 0x7fbf40065980 con 0x7fbf400b9810 2020-05-18T21:27:23.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf3d7fa700 1 -- 172.21.15.63:0/4002469267 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf24002fe0 con 0x7fbf400b9810 2020-05-18T21:27:23.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf3d7fa700 1 -- 172.21.15.63:0/4002469267 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1168375500 0 0) 0x7fbf24002fe0 con 0x7fbf400b9810 2020-05-18T21:27:23.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf3d7fa700 1 -- 172.21.15.63:0/4002469267 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbf40065980 con 0x7fbf400b9810 2020-05-18T21:27:23.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf3d7fa700 1 -- 172.21.15.63:0/4002469267 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fbf28001910 con 0x7fbf400b9810 2020-05-18T21:27:23.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf44b02700 1 -- 172.21.15.63:0/4002469267 >> v2:172.21.15.155:3300/0 conn(0x7fbf4009e750 msgr2=0x7fbf400b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:23.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf44b02700 1 --2- 172.21.15.63:0/4002469267 >> v2:172.21.15.155:3300/0 conn(0x7fbf4009e750 0x7fbf400b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:23.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf44b02700 1 -- 172.21.15.63:0/4002469267 >> v1:172.21.15.63:6789/0 conn(0x7fbf400b9810 legacy=0x7fbf4013fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:23.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf44b02700 1 -- 172.21.15.63:0/4002469267 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf40065c20 con 0x7fbf401438a0 2020-05-18T21:27:23.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf3ffff700 1 --2- 172.21.15.63:0/4002469267 >> v2:172.21.15.155:3300/0 conn(0x7fbf4009e750 0x7fbf400b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:23.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf44b02700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf401438a0 0x7fbf40142b10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf380032f0 tx=0x7fbf38007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:23.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf44b02700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf401438a0 0x7fbf40142b10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf380032f0 tx=0x7fbf38007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:23.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf44b02700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf401438a0 0x7fbf40142b10 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7fbf380032f0 tx=0x7fbf38007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:23.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf44b02700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf401438a0 0x7fbf40142b10 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7fbf380032f0 tx=0x7fbf38007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:23.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf3d7fa700 1 -- 172.21.15.63:0/4002469267 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf3800fea0 con 0x7fbf401438a0 2020-05-18T21:27:23.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf44b02700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf401438a0 0x7fbf40142b10 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7fbf380032f0 tx=0x7fbf38007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:23.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf44b02700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf401438a0 0x7fbf40142b10 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7fbf380032f0 tx=0x7fbf38007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:23.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf3d7fa700 1 -- 172.21.15.63:0/4002469267 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf38012ac0 con 0x7fbf401438a0 2020-05-18T21:27:23.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf45303700 1 -- 172.21.15.63:0/4002469267 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf40065590 con 0x7fbf401438a0 2020-05-18T21:27:23.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf3d7fa700 1 -- 172.21.15.63:0/4002469267 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf38012e20 con 0x7fbf401438a0 2020-05-18T21:27:23.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.285+0000 7fbf45303700 1 -- 172.21.15.63:0/4002469267 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf400b3110 con 0x7fbf401438a0 2020-05-18T21:27:23.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.289+0000 7fbf44b02700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf401438a0 0x7fbf40142b10 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7fbf380032f0 tx=0x7fbf38007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:23.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.289+0000 7fbf3d7fa700 1 -- 172.21.15.63:0/4002469267 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fbf38005a80 con 0x7fbf401438a0 2020-05-18T21:27:23.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.289+0000 7fbf44b02700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf401438a0 0x7fbf40142b10 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7fbf380032f0 tx=0x7fbf38007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:23.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.289+0000 7fbf45303700 1 -- 172.21.15.63:0/4002469267 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf400569e0 con 0x7fbf401438a0 2020-05-18T21:27:23.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.289+0000 7fbf3d7fa700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf24050010 0x7fbf240524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:23.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.289+0000 7fbf3d7fa700 1 -- 172.21.15.63:0/4002469267 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fbf38064070 con 0x7fbf401438a0 2020-05-18T21:27:23.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.289+0000 7fbf3ffff700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf24050010 0x7fbf240524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:23.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.289+0000 7fbf3ffff700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf24050010 0x7fbf240524d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf4005c240 tx=0x7fbf300013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:23.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.289+0000 7fbf3ffff700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf24050010 0x7fbf240524d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf4005c240 tx=0x7fbf300013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:23.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.289+0000 7fbf3ffff700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf24050010 0x7fbf240524d0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fbf4005c240 tx=0x7fbf300013e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:23.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.297+0000 7fbf44b02700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf401438a0 0x7fbf40142b10 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7fbf380032f0 tx=0x7fbf38007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:23.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.297+0000 7fbf3d7fa700 1 -- 172.21.15.63:0/4002469267 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fbf3803e520 con 0x7fbf401438a0 2020-05-18T21:27:23.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:23.417+0000 7fbf45303700 1 -- 172.21.15.63:0/4002469267 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbf4005b7d0 con 0x7fbf401438a0 2020-05-18T21:27:24.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.197+0000 7fbf44b02700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf401438a0 0x7fbf40142b10 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7fbf380032f0 tx=0x7fbf38007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:24.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.197+0000 7fbf3d7fa700 1 -- 172.21.15.63:0/4002469267 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 185+0+0 (secure 0 0 0) 0x7fbf38041b40 con 0x7fbf401438a0 2020-05-18T21:27:24.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.205+0000 7fbf45303700 1 -- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf24050010 msgr2=0x7fbf240524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:24.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.205+0000 7fbf45303700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf24050010 0x7fbf240524d0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fbf4005c240 tx=0x7fbf300013e0).stop 2020-05-18T21:27:24.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.205+0000 7fbf45303700 1 -- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf401438a0 msgr2=0x7fbf40142b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:24.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.205+0000 7fbf45303700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf401438a0 0x7fbf40142b10 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7fbf380032f0 tx=0x7fbf38007e00).stop 2020-05-18T21:27:24.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.205+0000 7fbf45303700 1 -- 172.21.15.63:0/4002469267 shutdown_connections 2020-05-18T21:27:24.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.205+0000 7fbf45303700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf24050010 0x7fbf240524d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:24.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.205+0000 7fbf45303700 1 --2- 172.21.15.63:0/4002469267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf401438a0 0x7fbf40142b10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:24.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.205+0000 7fbf45303700 1 --2- 172.21.15.63:0/4002469267 >> v2:172.21.15.155:3300/0 conn(0x7fbf4009e750 0x7fbf400b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:24.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.205+0000 7fbf45303700 1 -- 172.21.15.63:0/4002469267 >> 172.21.15.63:0/4002469267 conn(0x7fbf4005a7c0 msgr2=0x7fbf400620e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:24.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.205+0000 7fbf45303700 1 -- 172.21.15.63:0/4002469267 shutdown_connections 2020-05-18T21:27:24.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.205+0000 7fbf45303700 1 -- 172.21.15.63:0/4002469267 wait complete. 2020-05-18T21:27:24.213 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2020-05-18T21:27:24.223 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-05-18T21:27:24.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.329+0000 7ff778fa8700 1 Processor -- start 2020-05-18T21:27:24.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.329+0000 7ff778fa8700 1 -- start start 2020-05-18T21:27:24.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff778fa8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff774066e80 0x7ff774142330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:24.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff778fa8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff774142790 0x7ff77405ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:24.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff778fa8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7740b4900 con 0x7ff7740b6190 2020-05-18T21:27:24.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff778fa8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff774098c80 con 0x7ff774066e80 2020-05-18T21:27:24.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff778fa8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7740b4b30 con 0x7ff774142790 2020-05-18T21:27:24.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77259c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff7740b6190 0x7ff7740b4fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56032/0 (socket says 172.21.15.63:56032) 2020-05-18T21:27:24.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77259c700 1 -- 172.21.15.63:0/3770055619 learned_addr learned my addr 172.21.15.63:0/3770055619 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:24.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3770055619 >> v2:172.21.15.155:3300/0 conn(0x7ff774066e80 0x7ff774142330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:24.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff772d9d700 1 --2- 172.21.15.63:0/3770055619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff774142790 0x7ff77405ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:24.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77159a700 1 -- 172.21.15.63:0/3770055619 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086243568 0 0) 0x7ff7740b4900 con 0x7ff7740b6190 2020-05-18T21:27:24.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77159a700 1 -- 172.21.15.63:0/3770055619 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff754003270 con 0x7ff7740b6190 2020-05-18T21:27:24.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77159a700 1 -- 172.21.15.63:0/3770055619 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2101542751 0 0) 0x7ff754003270 con 0x7ff7740b6190 2020-05-18T21:27:24.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77159a700 1 -- 172.21.15.63:0/3770055619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff774142790 msgr2=0x7ff77405ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:24.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77159a700 1 --2- 172.21.15.63:0/3770055619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff774142790 0x7ff77405ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:24.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77159a700 1 -- 172.21.15.63:0/3770055619 >> v2:172.21.15.155:3300/0 conn(0x7ff774066e80 msgr2=0x7ff774142330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:24.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77159a700 1 --2- 172.21.15.63:0/3770055619 >> v2:172.21.15.155:3300/0 conn(0x7ff774066e80 0x7ff774142330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:24.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77159a700 1 -- 172.21.15.63:0/3770055619 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff774142c20 con 0x7ff7740b6190 2020-05-18T21:27:24.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77159a700 1 -- 172.21.15.63:0/3770055619 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7ff764001710 con 0x7ff7740b6190 2020-05-18T21:27:24.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff772d9d700 1 --2- 172.21.15.63:0/3770055619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff774142790 0x7ff77405ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:24.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3770055619 >> v2:172.21.15.155:3300/0 conn(0x7ff774066e80 0x7ff774142330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:24.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77159a700 1 -- 172.21.15.63:0/3770055619 >> v1:172.21.15.63:6789/0 conn(0x7ff7740b6190 legacy=0x7ff7740b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:24.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77159a700 1 --2- 172.21.15.63:0/3770055619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff754003760 0x7ff754003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:24.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77159a700 1 --2- 172.21.15.63:0/3770055619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7540040a0 0x7ff754004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:24.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77159a700 1 --2- 172.21.15.63:0/3770055619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff774142790 0x7ff754004b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:24.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77159a700 1 -- 172.21.15.63:0/3770055619 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff774098c80 con 0x7ff7540040a0 2020-05-18T21:27:24.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77159a700 1 -- 172.21.15.63:0/3770055619 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7740b4b30 con 0x7ff754003760 2020-05-18T21:27:24.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77159a700 1 -- 172.21.15.63:0/3770055619 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff754005110 con 0x7ff774142790 2020-05-18T21:27:24.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3770055619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7540040a0 0x7ff754004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:24.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77259c700 1 --2- 172.21.15.63:0/3770055619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff754003760 0x7ff754003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:24.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff772d9d700 1 --2- 172.21.15.63:0/3770055619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff774142790 0x7ff754004b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:24.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff771d9b700 1 -- 172.21.15.63:0/3770055619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff774142790 msgr2=0x7ff754004b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:24.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3770055619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff774142790 0x7ff754004b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:24.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff771d9b700 1 -- 172.21.15.63:0/3770055619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff754003760 msgr2=0x7ff754003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:24.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3770055619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff754003760 0x7ff754003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:24.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff771d9b700 1 -- 172.21.15.63:0/3770055619 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff754003270 con 0x7ff7540040a0 2020-05-18T21:27:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff772d9d700 1 --2- 172.21.15.63:0/3770055619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff774142790 0x7ff754004b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:27:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3770055619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7540040a0 0x7ff754004570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff75c002f70 tx=0x7ff75c00bee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3770055619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7540040a0 0x7ff754004570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff75c002f70 tx=0x7ff75c00bee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3770055619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7540040a0 0x7ff754004570 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7ff75c002f70 tx=0x7ff75c00bee0).ready entity=mon.0 client_cookie=56fb163b20f5fddf server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3770055619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7540040a0 0x7ff754004570 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7ff75c002f70 tx=0x7ff75c00bee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77159a700 1 -- 172.21.15.63:0/3770055619 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff75c010820 con 0x7ff7540040a0 2020-05-18T21:27:24.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3770055619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7540040a0 0x7ff754004570 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7ff75c002f70 tx=0x7ff75c00bee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:24.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3770055619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7540040a0 0x7ff754004570 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7ff75c002f70 tx=0x7ff75c00bee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:24.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77159a700 1 -- 172.21.15.63:0/3770055619 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c010980 con 0x7ff7540040a0 2020-05-18T21:27:24.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff77159a700 1 -- 172.21.15.63:0/3770055619 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff75c010d60 con 0x7ff7540040a0 2020-05-18T21:27:24.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff778fa8700 1 -- 172.21.15.63:0/3770055619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7540040a0 msgr2=0x7ff754004570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:24.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff778fa8700 1 --2- 172.21.15.63:0/3770055619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7540040a0 0x7ff754004570 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7ff75c002f70 tx=0x7ff75c00bee0).stop 2020-05-18T21:27:24.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.333+0000 7ff772d9d700 1 -- 172.21.15.63:0/3770055619 reap_dead start 2020-05-18T21:27:24.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.337+0000 7ff778fa8700 1 -- 172.21.15.63:0/3770055619 shutdown_connections 2020-05-18T21:27:24.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.337+0000 7ff778fa8700 1 -- 172.21.15.63:0/3770055619 >> 172.21.15.63:0/3770055619 conn(0x7ff7740b9720 msgr2=0x7ff7740b5740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:24.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.337+0000 7ff778fa8700 1 -- 172.21.15.63:0/3770055619 shutdown_connections 2020-05-18T21:27:24.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.337+0000 7ff778fa8700 1 -- 172.21.15.63:0/3770055619 wait complete. 2020-05-18T21:27:24.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.337+0000 7ff778fa8700 1 Processor -- start 2020-05-18T21:27:24.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.337+0000 7ff778fa8700 1 -- start start 2020-05-18T21:27:24.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff778fa8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff77413cac0 0x7ff77409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:24.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff778fa8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff77409e630 0x7ff77409c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:24.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff778fa8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7740b26e0 con 0x7ff7740b1920 2020-05-18T21:27:24.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff778fa8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7740b2980 con 0x7ff77409e630 2020-05-18T21:27:24.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff778fa8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7740b2410 con 0x7ff77413cac0 2020-05-18T21:27:24.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff771d9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff77413cac0 0x7ff77409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:24.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff77259c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7ff7740b1920 0x7ff7740b1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:54360/0 (socket says 172.21.15.63:54360) 2020-05-18T21:27:24.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff77259c700 1 -- 172.21.15.63:0/3431690211 learned_addr learned my addr 172.21.15.63:0/3431690211 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:24.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff772d9d700 1 --2- 172.21.15.63:0/3431690211 >> v2:172.21.15.155:3300/0 conn(0x7ff77409e630 0x7ff77409c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:24.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff771d9b700 1 -- 172.21.15.63:0/3431690211 >> v2:172.21.15.155:3300/0 conn(0x7ff77409e630 msgr2=0x7ff77409c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:24.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3431690211 >> v2:172.21.15.155:3300/0 conn(0x7ff77409e630 0x7ff77409c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:24.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff771d9b700 1 -- 172.21.15.63:0/3431690211 >> v1:172.21.15.155:6789/0 conn(0x7ff7740b1920 legacy=0x7ff7740b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:24.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff76b7fe700 1 -- 172.21.15.63:0/3431690211 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939600886 0 0) 0x7ff7740b26e0 con 0x7ff7740b1920 2020-05-18T21:27:24.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff771d9b700 1 -- 172.21.15.63:0/3431690211 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77409eaa0 con 0x7ff77413cac0 2020-05-18T21:27:24.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff772d9d700 1 --2- 172.21.15.63:0/3431690211 >> v2:172.21.15.155:3300/0 conn(0x7ff77409e630 0x7ff77409c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:24.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff77413cac0 0x7ff77409e1d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff75c002f70 tx=0x7ff75c00bee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:24.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff77413cac0 0x7ff77409e1d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff75c002f70 tx=0x7ff75c00bee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:24.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff77413cac0 0x7ff77409e1d0 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7ff75c002f70 tx=0x7ff75c00bee0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:24.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff77413cac0 0x7ff77409e1d0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7ff75c002f70 tx=0x7ff75c00bee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:24.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff76b7fe700 1 -- 172.21.15.63:0/3431690211 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff75c007c60 con 0x7ff77413cac0 2020-05-18T21:27:24.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff77413cac0 0x7ff77409e1d0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7ff75c002f70 tx=0x7ff75c00bee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:24.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff77413cac0 0x7ff77409e1d0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7ff75c002f70 tx=0x7ff75c00bee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:24.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff76b7fe700 1 -- 172.21.15.63:0/3431690211 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c007370 con 0x7ff77413cac0 2020-05-18T21:27:24.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff778fa8700 1 -- 172.21.15.63:0/3431690211 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77409cd40 con 0x7ff77413cac0 2020-05-18T21:27:24.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff76b7fe700 1 -- 172.21.15.63:0/3431690211 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff75c005700 con 0x7ff77413cac0 2020-05-18T21:27:24.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff778fa8700 1 -- 172.21.15.63:0/3431690211 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77409d1f0 con 0x7ff77413cac0 2020-05-18T21:27:24.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff778fa8700 1 -- 172.21.15.63:0/3431690211 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7740569e0 con 0x7ff77413cac0 2020-05-18T21:27:24.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.341+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff77413cac0 0x7ff77409e1d0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7ff75c002f70 tx=0x7ff75c00bee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:24.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.345+0000 7ff76b7fe700 1 -- 172.21.15.63:0/3431690211 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff75c0058b0 con 0x7ff77413cac0 2020-05-18T21:27:24.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.345+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff77413cac0 0x7ff77409e1d0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7ff75c002f70 tx=0x7ff75c00bee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:24.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.345+0000 7ff76b7fe700 1 --2- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff75804f7f0 0x7ff758051cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:24.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.345+0000 7ff76b7fe700 1 -- 172.21.15.63:0/3431690211 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5721+0+0 (secure 0 0 0) 0x7ff75c064100 con 0x7ff77413cac0 2020-05-18T21:27:24.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.345+0000 7ff77259c700 1 --2- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff75804f7f0 0x7ff758051cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:24.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.345+0000 7ff77259c700 1 --2- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff75804f7f0 0x7ff758051cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff76400f9a0 tx=0x7ff774062570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:24.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.345+0000 7ff77259c700 1 --2- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff75804f7f0 0x7ff758051cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff76400f9a0 tx=0x7ff774062570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:24.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.345+0000 7ff77259c700 1 --2- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff75804f7f0 0x7ff758051cb0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7ff76400f9a0 tx=0x7ff774062570).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:24.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.353+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff77413cac0 0x7ff77409e1d0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7ff75c002f70 tx=0x7ff75c00bee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:24.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.353+0000 7ff76b7fe700 1 -- 172.21.15.63:0/3431690211 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff75c03e5b0 con 0x7ff77413cac0 2020-05-18T21:27:24.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:24.469+0000 7ff778fa8700 1 -- 172.21.15.63:0/3431690211 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff7740b2550 con 0x7ff77413cac0 2020-05-18T21:27:25.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.201+0000 7ff771d9b700 1 --2- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff77413cac0 0x7ff77409e1d0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7ff75c002f70 tx=0x7ff75c00bee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:25.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.201+0000 7ff76b7fe700 1 -- 172.21.15.63:0/3431690211 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 173+0+0 (secure 0 0 0) 0x7ff75c041bd0 con 0x7ff77413cac0 2020-05-18T21:27:25.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.205+0000 7ff778fa8700 1 -- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff75804f7f0 msgr2=0x7ff758051cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:25.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.205+0000 7ff778fa8700 1 --2- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff75804f7f0 0x7ff758051cb0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7ff76400f9a0 tx=0x7ff774062570).stop 2020-05-18T21:27:25.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.205+0000 7ff778fa8700 1 -- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff77413cac0 msgr2=0x7ff77409e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:25.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.205+0000 7ff778fa8700 1 --2- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff77413cac0 0x7ff77409e1d0 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7ff75c002f70 tx=0x7ff75c00bee0).stop 2020-05-18T21:27:25.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.205+0000 7ff778fa8700 1 -- 172.21.15.63:0/3431690211 shutdown_connections 2020-05-18T21:27:25.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.205+0000 7ff778fa8700 1 --2- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff75804f7f0 0x7ff758051cb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:25.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.205+0000 7ff778fa8700 1 --2- 172.21.15.63:0/3431690211 >> v2:172.21.15.155:3300/0 conn(0x7ff77409e630 0x7ff77409c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:25.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.205+0000 7ff778fa8700 1 --2- 172.21.15.63:0/3431690211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff77413cac0 0x7ff77409e1d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:25.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.205+0000 7ff778fa8700 1 -- 172.21.15.63:0/3431690211 >> 172.21.15.63:0/3431690211 conn(0x7ff7740b9720 msgr2=0x7ff7740b5130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:25.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.205+0000 7ff778fa8700 1 -- 172.21.15.63:0/3431690211 shutdown_connections 2020-05-18T21:27:25.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.205+0000 7ff778fa8700 1 -- 172.21.15.63:0/3431690211 wait complete. 2020-05-18T21:27:25.216 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2020-05-18T21:27:25.226 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:27:25.226 INFO:tasks.ceph.mds.a:Stopping old one... 2020-05-18T21:27:25.227 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:27:25.227 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:27:25.227 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:27:25.228 INFO:tasks.ceph.mds.b:Stopping old one... 2020-05-18T21:27:25.228 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:27:25.228 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:27:25.237 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:27:25.238 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:27:25.240 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:27:25.240 DEBUG:teuthology.parallel:result is None 2020-05-18T21:27:25.242 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:27:25.242 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:27:25.245 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:27:25.245 DEBUG:teuthology.parallel:result is None 2020-05-18T21:27:25.246 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-05-18T21:27:25.306 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:27:25.315 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:27:25.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.341+0000 7f20dda3b700 1 Processor -- start 2020-05-18T21:27:25.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.341+0000 7f20dda3b700 1 -- start start 2020-05-18T21:27:25.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20dda3b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f20d80b9260 0x7f20d8065940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:25.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20dda3b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f20d8143a00 0x7f20d80b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:25.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20dda3b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d814a6b0 con 0x7f20d81461c0 2020-05-18T21:27:25.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20dda3b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d80b07f0 con 0x7f20d80b9260 2020-05-18T21:27:25.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20dda3b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d8147190 con 0x7f20d8143a00 2020-05-18T21:27:25.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20d6ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f20d80b9260 0x7f20d8065940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:25.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20d77fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f20d8143a00 0x7f20d80b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:25.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20d77fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f20d8143a00 0x7f20d80b1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:40494/0 (socket says 172.21.15.63:40494) 2020-05-18T21:27:25.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20d77fe700 1 -- 172.21.15.63:0/249386827 learned_addr learned my addr 172.21.15.63:0/249386827 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:25.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20d6ffd700 1 -- 172.21.15.63:0/249386827 >> v2:172.21.15.155:3300/0 conn(0x7f20d8143a00 msgr2=0x7f20d80b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:25.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20d6ffd700 1 --2- 172.21.15.63:0/249386827 >> v2:172.21.15.155:3300/0 conn(0x7f20d8143a00 0x7f20d80b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:25.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20d6ffd700 1 -- 172.21.15.63:0/249386827 >> v1:172.21.15.63:6789/0 conn(0x7f20d81461c0 legacy=0x7f20d81432f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-05-18T21:27:25.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20d6ffd700 1 -- 172.21.15.63:0/249386827 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d81467b0 con 0x7f20d80b9260 2020-05-18T21:27:25.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20d6ffd700 1 --2- 172.21.15.63:0/249386827 >> v2:172.21.15.63:3300/0 conn(0x7f20d80b9260 0x7f20d8065940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f20d8060130 tx=0x7f20c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:25.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20d6ffd700 1 --2- 172.21.15.63:0/249386827 >> v2:172.21.15.63:3300/0 conn(0x7f20d80b9260 0x7f20d8065940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f20d8060130 tx=0x7f20c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:25.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20d6ffd700 1 --2- 172.21.15.63:0/249386827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20d80b9260 0x7f20d8065940 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7f20d8060130 tx=0x7f20c8007a80).ready entity=mon.0 client_cookie=7e3d34784f8c9e11 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:25.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20d6ffd700 1 --2- 172.21.15.63:0/249386827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20d80b9260 0x7f20d8065940 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f20d8060130 tx=0x7f20c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:25.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20d5ffb700 1 -- 172.21.15.63:0/249386827 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20c8008e50 con 0x7f20d80b9260 2020-05-18T21:27:25.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20d6ffd700 1 --2- 172.21.15.63:0/249386827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20d80b9260 0x7f20d8065940 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f20d8060130 tx=0x7f20c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:25.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20d6ffd700 1 --2- 172.21.15.63:0/249386827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20d80b9260 0x7f20d8065940 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f20d8060130 tx=0x7f20c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:25.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20d5ffb700 1 -- 172.21.15.63:0/249386827 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c80115b0 con 0x7f20d80b9260 2020-05-18T21:27:25.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20d5ffb700 1 -- 172.21.15.63:0/249386827 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20c8011990 con 0x7f20d80b9260 2020-05-18T21:27:25.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20dda3b700 1 -- 172.21.15.63:0/249386827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20d80b9260 msgr2=0x7f20d8065940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:25.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.345+0000 7f20dda3b700 1 --2- 172.21.15.63:0/249386827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20d80b9260 0x7f20d8065940 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7f20d8060130 tx=0x7f20c8007a80).stop 2020-05-18T21:27:25.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.349+0000 7f20dda3b700 1 -- 172.21.15.63:0/249386827 shutdown_connections 2020-05-18T21:27:25.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.349+0000 7f20dda3b700 1 --2- 172.21.15.63:0/249386827 >> v2:172.21.15.155:3300/0 conn(0x7f20d8143a00 0x7f20d80b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:25.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.349+0000 7f20dda3b700 1 --2- 172.21.15.63:0/249386827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20d80b9260 0x7f20d8065940 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:25.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.349+0000 7f20dda3b700 1 -- 172.21.15.63:0/249386827 >> 172.21.15.63:0/249386827 conn(0x7f20d805f6f0 msgr2=0x7f20d80b8810 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:25.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.349+0000 7f20dda3b700 1 -- 172.21.15.63:0/249386827 shutdown_connections 2020-05-18T21:27:25.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.349+0000 7f20dda3b700 1 -- 172.21.15.63:0/249386827 wait complete. 2020-05-18T21:27:25.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.349+0000 7f20dda3b700 1 Processor -- start 2020-05-18T21:27:25.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.349+0000 7f20dda3b700 1 -- start start 2020-05-18T21:27:25.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.349+0000 7f20dda3b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f20d80b9260 0x7f20d81450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:25.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.349+0000 7f20dda3b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d80ad810 con 0x7f20d81461c0 2020-05-18T21:27:25.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.349+0000 7f20dda3b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d80aed10 con 0x7f20d8143a00 2020-05-18T21:27:25.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.349+0000 7f20dda3b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d80ad600 con 0x7f20d80b9260 2020-05-18T21:27:25.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20d6ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f20d80b9260 0x7f20d81450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:25.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20d77fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f20d81461c0 0x7f20d8156e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56074/0 (socket says 172.21.15.63:56074) 2020-05-18T21:27:25.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20d77fe700 1 -- 172.21.15.63:0/548298470 learned_addr learned my addr 172.21.15.63:0/548298470 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:25.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20c7fff700 1 -- 172.21.15.63:0/548298470 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321357110 0 0) 0x7f20d80aed10 con 0x7f20d8143a00 2020-05-18T21:27:25.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20c7fff700 1 -- 172.21.15.63:0/548298470 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20b4002fe0 con 0x7f20d8143a00 2020-05-18T21:27:25.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20d6ffd700 1 -- 172.21.15.63:0/548298470 >> v1:172.21.15.155:6789/0 conn(0x7f20d8143a00 legacy=0x7f20d80ac900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:25.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20c7fff700 1 -- 172.21.15.63:0/548298470 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2143854543 0 0) 0x7f20d80ad810 con 0x7f20d81461c0 2020-05-18T21:27:25.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20d6ffd700 1 -- 172.21.15.63:0/548298470 >> v1:172.21.15.63:6789/0 conn(0x7f20d81461c0 legacy=0x7f20d8156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:25.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20d6ffd700 1 -- 172.21.15.63:0/548298470 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d80aeea0 con 0x7f20d80b9260 2020-05-18T21:27:25.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20d6ffd700 1 --2- 172.21.15.63:0/548298470 >> v2:172.21.15.63:3300/0 conn(0x7f20d80b9260 0x7f20d81450f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f20d8060130 tx=0x7f20c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:25.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20d6ffd700 1 --2- 172.21.15.63:0/548298470 >> v2:172.21.15.63:3300/0 conn(0x7f20d80b9260 0x7f20d81450f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f20d8060130 tx=0x7f20c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:25.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20d6ffd700 1 --2- 172.21.15.63:0/548298470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20d80b9260 0x7f20d81450f0 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7f20d8060130 tx=0x7f20c8007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:25.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20d6ffd700 1 --2- 172.21.15.63:0/548298470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20d80b9260 0x7f20d81450f0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f20d8060130 tx=0x7f20c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:25.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20d6ffd700 1 --2- 172.21.15.63:0/548298470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20d80b9260 0x7f20d81450f0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f20d8060130 tx=0x7f20c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:25.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20c7fff700 1 -- 172.21.15.63:0/548298470 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20c8011e20 con 0x7f20d80b9260 2020-05-18T21:27:25.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20d6ffd700 1 --2- 172.21.15.63:0/548298470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20d80b9260 0x7f20d81450f0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f20d8060130 tx=0x7f20c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:25.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20c7fff700 1 -- 172.21.15.63:0/548298470 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c8007170 con 0x7f20d80b9260 2020-05-18T21:27:25.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20dda3b700 1 -- 172.21.15.63:0/548298470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d80ad010 con 0x7f20d80b9260 2020-05-18T21:27:25.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20c7fff700 1 -- 172.21.15.63:0/548298470 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20c80074d0 con 0x7f20d80b9260 2020-05-18T21:27:25.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20dda3b700 1 -- 172.21.15.63:0/548298470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d8157530 con 0x7f20d80b9260 2020-05-18T21:27:25.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20d6ffd700 1 --2- 172.21.15.63:0/548298470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20d80b9260 0x7f20d81450f0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f20d8060130 tx=0x7f20c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:25.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20dda3b700 1 -- 172.21.15.63:0/548298470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d80ada10 con 0x7f20d80b9260 2020-05-18T21:27:25.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20c7fff700 1 -- 172.21.15.63:0/548298470 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f20c8005700 con 0x7f20d80b9260 2020-05-18T21:27:25.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20d6ffd700 1 --2- 172.21.15.63:0/548298470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20d80b9260 0x7f20d81450f0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f20d8060130 tx=0x7f20c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:25.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20c7fff700 1 --2- 172.21.15.63:0/548298470 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f20b404fd80 0x7f20b4052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:25.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20c7fff700 1 -- 172.21.15.63:0/548298470 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f20c8064420 con 0x7f20d80b9260 2020-05-18T21:27:25.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20d67fc700 1 --2- 172.21.15.63:0/548298470 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f20b404fd80 0x7f20b4052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:25.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20d67fc700 1 --2- 172.21.15.63:0/548298470 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f20b404fd80 0x7f20b4052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f20cc0010a0 tx=0x7f20cc008bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:25.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20d67fc700 1 --2- 172.21.15.63:0/548298470 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f20b404fd80 0x7f20b4052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f20cc0010a0 tx=0x7f20cc008bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:25.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.353+0000 7f20d67fc700 1 --2- 172.21.15.63:0/548298470 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f20b404fd80 0x7f20b4052240 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f20cc0010a0 tx=0x7f20cc008bf0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:25.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.357+0000 7f20d6ffd700 1 --2- 172.21.15.63:0/548298470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20d80b9260 0x7f20d81450f0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f20d8060130 tx=0x7f20c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:25.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.357+0000 7f20c7fff700 1 -- 172.21.15.63:0/548298470 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f20d80ada10 con 0x7f20d80b9260 2020-05-18T21:27:25.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:25.489+0000 7f20dda3b700 1 -- 172.21.15.63:0/548298470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f20d8157b50 con 0x7f20d80b9260 2020-05-18T21:27:26.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.353+0000 7f20d6ffd700 1 --2- 172.21.15.63:0/548298470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20d80b9260 0x7f20d81450f0 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7f20d8060130 tx=0x7f20c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.353+0000 7f20d6ffd700 1 --2- 172.21.15.63:0/548298470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20d80b9260 0x7f20d81450f0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f20d8060130 tx=0x7f20c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.353+0000 7f20c7fff700 1 -- 172.21.15.63:0/548298470 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7f20c803e8d0 con 0x7f20d80b9260 2020-05-18T21:27:26.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.357+0000 7f20dda3b700 1 -- 172.21.15.63:0/548298470 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f20b404fd80 msgr2=0x7f20b4052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:26.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.357+0000 7f20dda3b700 1 --2- 172.21.15.63:0/548298470 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f20b404fd80 0x7f20b4052240 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f20cc0010a0 tx=0x7f20cc008bf0).stop 2020-05-18T21:27:26.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.357+0000 7f20dda3b700 1 -- 172.21.15.63:0/548298470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20d80b9260 msgr2=0x7f20d81450f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:26.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.357+0000 7f20dda3b700 1 --2- 172.21.15.63:0/548298470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20d80b9260 0x7f20d81450f0 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7f20d8060130 tx=0x7f20c8007a80).stop 2020-05-18T21:27:26.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.357+0000 7f20dda3b700 1 -- 172.21.15.63:0/548298470 shutdown_connections 2020-05-18T21:27:26.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.357+0000 7f20dda3b700 1 --2- 172.21.15.63:0/548298470 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f20b404fd80 0x7f20b4052240 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:26.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.357+0000 7f20dda3b700 1 --2- 172.21.15.63:0/548298470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20d80b9260 0x7f20d81450f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:26.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.357+0000 7f20dda3b700 1 -- 172.21.15.63:0/548298470 >> 172.21.15.63:0/548298470 conn(0x7f20d805f6f0 msgr2=0x7f20d80b8760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:26.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.357+0000 7f20dda3b700 1 -- 172.21.15.63:0/548298470 shutdown_connections 2020-05-18T21:27:26.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.357+0000 7f20dda3b700 1 -- 172.21.15.63:0/548298470 wait complete. 2020-05-18T21:27:26.365 INFO:teuthology.orchestra.run.smithi063.stderr: removed all blacklist entries 2020-05-18T21:27:26.377 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-05-18T21:27:26.378 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-05-18T21:27:26.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.477+0000 7f2af1066700 1 Processor -- start 2020-05-18T21:27:26.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.477+0000 7f2af1066700 1 -- start start 2020-05-18T21:27:26.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2af1066700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2aec05f110 0x7f2aec0b2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:26.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2af1066700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2aec0b81b0 0x7f2aec12ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:26.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2af1066700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec146d60 con 0x7f2aec12bec0 2020-05-18T21:27:26.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2af1066700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec0b8650 con 0x7f2aec05f110 2020-05-18T21:27:26.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2af1066700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec0b88f0 con 0x7f2aec0b81b0 2020-05-18T21:27:26.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2aebfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2aec05f110 0x7f2aec0b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:26.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2aebfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2aec05f110 0x7f2aec0b2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53894/0 (socket says 172.21.15.63:53894) 2020-05-18T21:27:26.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2aebfff700 1 -- 172.21.15.63:0/1315975437 learned_addr learned my addr 172.21.15.63:0/1315975437 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:26.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2aeb7fe700 1 --2- 172.21.15.63:0/1315975437 >> v2:172.21.15.155:3300/0 conn(0x7f2aec0b81b0 0x7f2aec12ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:26.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2aeb7fe700 1 -- 172.21.15.63:0/1315975437 >> v2:172.21.15.63:3300/0 conn(0x7f2aec05f110 msgr2=0x7f2aec0b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:26.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2aeb7fe700 1 --2- 172.21.15.63:0/1315975437 >> v2:172.21.15.63:3300/0 conn(0x7f2aec05f110 0x7f2aec0b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:26.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2aeb7fe700 1 -- 172.21.15.63:0/1315975437 >> v1:172.21.15.155:6789/0 conn(0x7f2aec12bec0 legacy=0x7f2aec149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:26.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2aeb7fe700 1 -- 172.21.15.63:0/1315975437 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec0b8b90 con 0x7f2aec0b81b0 2020-05-18T21:27:26.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2aebfff700 1 --2- 172.21.15.63:0/1315975437 >> v2:172.21.15.63:3300/0 conn(0x7f2aec05f110 0x7f2aec0b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:26.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2aeb7fe700 1 --2- 172.21.15.63:0/1315975437 >> v2:172.21.15.155:3300/0 conn(0x7f2aec0b81b0 0x7f2aec12ba60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2adc002f70 tx=0x7f2adc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2aeb7fe700 1 --2- 172.21.15.63:0/1315975437 >> v2:172.21.15.155:3300/0 conn(0x7f2aec0b81b0 0x7f2aec12ba60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2adc002f70 tx=0x7f2adc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2aeb7fe700 1 --2- 172.21.15.63:0/1315975437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aec0b81b0 0x7f2aec12ba60 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7f2adc002f70 tx=0x7f2adc007a80).ready entity=mon.1 client_cookie=2e83900344b9dce0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:26.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2aeb7fe700 1 --2- 172.21.15.63:0/1315975437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aec0b81b0 0x7f2aec12ba60 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f2adc002f70 tx=0x7f2adc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2aeaffd700 1 -- 172.21.15.63:0/1315975437 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2adc0115f0 con 0x7f2aec0b81b0 2020-05-18T21:27:26.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2aeb7fe700 1 --2- 172.21.15.63:0/1315975437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aec0b81b0 0x7f2aec12ba60 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f2adc002f70 tx=0x7f2adc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2aeb7fe700 1 --2- 172.21.15.63:0/1315975437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aec0b81b0 0x7f2aec12ba60 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f2adc002f70 tx=0x7f2adc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2aeaffd700 1 -- 172.21.15.63:0/1315975437 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc011750 con 0x7f2aec0b81b0 2020-05-18T21:27:26.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2aeaffd700 1 -- 172.21.15.63:0/1315975437 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2adc011b70 con 0x7f2aec0b81b0 2020-05-18T21:27:26.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2af1066700 1 -- 172.21.15.63:0/1315975437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aec0b81b0 msgr2=0x7f2aec12ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:26.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2af1066700 1 --2- 172.21.15.63:0/1315975437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aec0b81b0 0x7f2aec12ba60 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7f2adc002f70 tx=0x7f2adc007a80).stop 2020-05-18T21:27:26.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2af1066700 1 -- 172.21.15.63:0/1315975437 shutdown_connections 2020-05-18T21:27:26.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2af1066700 1 --2- 172.21.15.63:0/1315975437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aec0b81b0 0x7f2aec12ba60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:26.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2af1066700 1 --2- 172.21.15.63:0/1315975437 >> v2:172.21.15.63:3300/0 conn(0x7f2aec05f110 0x7f2aec0b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:26.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2af1066700 1 -- 172.21.15.63:0/1315975437 >> 172.21.15.63:0/1315975437 conn(0x7f2aec069fc0 msgr2=0x7f2aec06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:26.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2af1066700 1 -- 172.21.15.63:0/1315975437 shutdown_connections 2020-05-18T21:27:26.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.481+0000 7f2af1066700 1 -- 172.21.15.63:0/1315975437 wait complete. 2020-05-18T21:27:26.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2af1066700 1 Processor -- start 2020-05-18T21:27:26.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2af1066700 1 -- start start 2020-05-18T21:27:26.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2af1066700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2aec05f110 0x7f2aec062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:26.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2af1066700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec12bec0 0x7f2aec149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:26.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2af1066700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec1578b0 con 0x7f2aec0b81b0 2020-05-18T21:27:26.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2af1066700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec146f00 con 0x7f2aec05f110 2020-05-18T21:27:26.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2af1066700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec157410 con 0x7f2aec12bec0 2020-05-18T21:27:26.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2aebfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2aec05f110 0x7f2aec062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:26.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2aebfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2aec05f110 0x7f2aec062ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53898/0 (socket says 172.21.15.63:53898) 2020-05-18T21:27:26.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2aebfff700 1 -- 172.21.15.63:0/15521296 learned_addr learned my addr 172.21.15.63:0/15521296 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:26.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2af0865700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec12bec0 0x7f2aec149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:26.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2ae97fa700 1 -- 172.21.15.63:0/15521296 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675106121 0 0) 0x7f2aec1578b0 con 0x7f2aec0b81b0 2020-05-18T21:27:26.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2ae97fa700 1 -- 172.21.15.63:0/15521296 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2acc002fe0 con 0x7f2aec0b81b0 2020-05-18T21:27:26.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2aebfff700 1 -- 172.21.15.63:0/15521296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec12bec0 msgr2=0x7f2aec149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:26.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2aebfff700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec12bec0 0x7f2aec149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:26.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2aebfff700 1 -- 172.21.15.63:0/15521296 >> v1:172.21.15.155:6789/0 conn(0x7f2aec0b81b0 legacy=0x7f2aec127d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:26.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2aebfff700 1 -- 172.21.15.63:0/15521296 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec157610 con 0x7f2aec05f110 2020-05-18T21:27:26.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2af0865700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec12bec0 0x7f2aec149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:26.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2aebfff700 1 --2- 172.21.15.63:0/15521296 >> v2:172.21.15.63:3300/0 conn(0x7f2aec05f110 0x7f2aec062ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2ae0002f30 tx=0x7f2ae0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2aebfff700 1 --2- 172.21.15.63:0/15521296 >> v2:172.21.15.63:3300/0 conn(0x7f2aec05f110 0x7f2aec062ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2ae0002f30 tx=0x7f2ae0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2aebfff700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec05f110 0x7f2aec062ff0 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7f2ae0002f30 tx=0x7f2ae0010ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:26.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2aebfff700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec05f110 0x7f2aec062ff0 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f2ae0002f30 tx=0x7f2ae0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2ae97fa700 1 -- 172.21.15.63:0/15521296 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ae0005e30 con 0x7f2aec05f110 2020-05-18T21:27:26.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2aebfff700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec05f110 0x7f2aec062ff0 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f2ae0002f30 tx=0x7f2ae0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2af1066700 1 -- 172.21.15.63:0/15521296 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aec0622c0 con 0x7f2aec05f110 2020-05-18T21:27:26.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2ae97fa700 1 -- 172.21.15.63:0/15521296 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae0007180 con 0x7f2aec05f110 2020-05-18T21:27:26.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2aebfff700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec05f110 0x7f2aec062ff0 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f2ae0002f30 tx=0x7f2ae0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2ae97fa700 1 -- 172.21.15.63:0/15521296 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ae0007560 con 0x7f2aec05f110 2020-05-18T21:27:26.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.485+0000 7f2af1066700 1 -- 172.21.15.63:0/15521296 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aec128710 con 0x7f2aec05f110 2020-05-18T21:27:26.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.489+0000 7f2af1066700 1 -- 172.21.15.63:0/15521296 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aec0569e0 con 0x7f2aec05f110 2020-05-18T21:27:26.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.489+0000 7f2aebfff700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec05f110 0x7f2aec062ff0 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f2ae0002f30 tx=0x7f2ae0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.489+0000 7f2ae97fa700 1 -- 172.21.15.63:0/15521296 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2ae00101a0 con 0x7f2aec05f110 2020-05-18T21:27:26.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.489+0000 7f2aebfff700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec05f110 0x7f2aec062ff0 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f2ae0002f30 tx=0x7f2ae0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.489+0000 7f2ae97fa700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2acc04fdb0 0x7f2acc052270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:26.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.489+0000 7f2ae97fa700 1 -- 172.21.15.63:0/15521296 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f2ae0063ec0 con 0x7f2aec05f110 2020-05-18T21:27:26.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.489+0000 7f2aeb7fe700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2acc04fdb0 0x7f2acc052270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:26.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.489+0000 7f2aeb7fe700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2acc04fdb0 0x7f2acc052270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2adc008920 tx=0x7f2adc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.489+0000 7f2aeb7fe700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2acc04fdb0 0x7f2acc052270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2adc008920 tx=0x7f2adc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.489+0000 7f2aeb7fe700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2acc04fdb0 0x7f2acc052270 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f2adc008920 tx=0x7f2adc007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:26.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.493+0000 7f2aebfff700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec05f110 0x7f2aec062ff0 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f2ae0002f30 tx=0x7f2ae0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.493+0000 7f2ae97fa700 1 -- 172.21.15.63:0/15521296 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2ae003e1f0 con 0x7f2aec05f110 2020-05-18T21:27:26.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.645+0000 7f2af1066700 1 -- 172.21.15.63:0/15521296 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2aec0b2720 con 0x7f2aec05f110 2020-05-18T21:27:26.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.645+0000 7f2aebfff700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec05f110 0x7f2aec062ff0 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f2ae0002f30 tx=0x7f2ae0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.645+0000 7f2ae97fa700 1 -- 172.21.15.63:0/15521296 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+5917 (secure 0 0 0) 0x7f2ae0041810 con 0x7f2aec05f110 2020-05-18T21:27:26.653 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:26.653 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:27:26.654 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_dump": [ 2020-05-18T21:27:26.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.654 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.a", 2020-05-18T21:27:26.654 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJekJyyLRAAfB5XJCsXTAmZdkFOaQrokg==", 2020-05-18T21:27:26.655 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.655 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:27:26.655 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:27:26.655 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:27:26.656 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:27:26.656 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.657 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.b", 2020-05-18T21:27:26.657 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeSVE8MRAAEEytuzLtcQMC+1uQ/yh8eA==", 2020-05-18T21:27:26.657 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.657 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:27:26.657 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:27:26.658 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:27:26.658 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:27:26.658 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.659 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.0", 2020-05-18T21:27:26.659 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBq/cJeIn7mJhAArx+YEdVbsfXXNOLWdaAgWw==", 2020-05-18T21:27:26.659 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.659 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:27:26.660 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:27:26.660 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:27:26.660 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.660 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.1", 2020-05-18T21:27:26.661 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBt/cJelHywCRAAFyQ3sPEE0RTSy4tKfsDfyw==", 2020-05-18T21:27:26.661 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.661 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:27:26.662 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:27:26.662 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:27:26.662 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.663 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.2", 2020-05-18T21:27:26.663 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBv/cJecexDLBAAxhlFq20MBkKvDjuM1yi8XQ==", 2020-05-18T21:27:26.663 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.663 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:27:26.664 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:27:26.664 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:27:26.664 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.665 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.3", 2020-05-18T21:27:26.665 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBy/cJe9IqwDxAAMg1In7bIITDcOZljzzTpDQ==", 2020-05-18T21:27:26.665 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.665 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:27:26.666 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:27:26.666 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:27:26.666 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.667 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.4", 2020-05-18T21:27:26.667 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB3/cJeLXgxFhAA/kMVV5hCRny2uXKvvbu8Og==", 2020-05-18T21:27:26.667 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.667 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:27:26.667 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:27:26.667 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:27:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.5", 2020-05-18T21:27:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB5/cJeucpsNRAAjGh+6yUC8Fji9PE4COi/Eg==", 2020-05-18T21:27:26.669 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.669 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:27:26.669 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:27:26.669 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:27:26.669 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.670 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.6", 2020-05-18T21:27:26.670 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB8/cJelSPpGhAAXobGqH9qaW1VZfEpH8bUbQ==", 2020-05-18T21:27:26.670 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.670 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:27:26.671 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:27:26.671 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:27:26.671 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.672 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.7", 2020-05-18T21:27:26.672 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB+/cJeUIl5OBAAPd8H8ohOWZw9ubO7uCB6zg==", 2020-05-18T21:27:26.672 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.672 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:27:26.672 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:27:26.672 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:27:26.673 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.673 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.0", 2020-05-18T21:27:26.673 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeap3RNhAAi2vKpsKtzSL1Uuqm8pWYJQ==", 2020-05-18T21:27:26.674 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.674 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:27:26.674 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2020-05-18T21:27:26.674 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2020-05-18T21:27:26.674 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2020-05-18T21:27:26.675 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.675 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.1", 2020-05-18T21:27:26.675 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJeekrQABAA5TmzWOt24C6hgZw/WTj5dw==", 2020-05-18T21:27:26.676 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.676 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:27:26.676 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2020-05-18T21:27:26.676 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2020-05-18T21:27:26.676 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2020-05-18T21:27:26.677 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.677 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.2", 2020-05-18T21:27:26.677 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJehSnFAxAAXUZwqNTXqAApEB3nXs4u6g==", 2020-05-18T21:27:26.678 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.678 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:27:26.679 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2020-05-18T21:27:26.679 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2020-05-18T21:27:26.679 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2020-05-18T21:27:26.679 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.680 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.3", 2020-05-18T21:27:26.680 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJe2HdDBhAA07y5pn/bKKa9TBbZFvIh9g==", 2020-05-18T21:27:26.680 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.680 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:27:26.681 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2020-05-18T21:27:26.681 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2020-05-18T21:27:26.681 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2020-05-18T21:27:26.681 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.682 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.admin", 2020-05-18T21:27:26.682 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJe/K4fGRAA+rP3BYuWiyx/fKmQ3bV6Lw==", 2020-05-18T21:27:26.683 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.683 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:27:26.683 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:27:26.683 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:27:26.684 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:27:26.684 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.684 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-mds", 2020-05-18T21:27:26.685 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQCE/cJebIGvLxAAsGcz9iBBRsCaslX9WW7/YQ==", 2020-05-18T21:27:26.685 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.685 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-mds" 2020-05-18T21:27:26.685 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.686 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-mgr", 2020-05-18T21:27:26.686 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQCE/cJe5JqvLxAAgxYCG+PgP2UFgriT2FuJ8A==", 2020-05-18T21:27:26.686 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.687 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-mgr" 2020-05-18T21:27:26.687 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.687 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-osd", 2020-05-18T21:27:26.688 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQCE/cJe47GvLxAABjYQVhwxOYcWbQk7B8psTw==", 2020-05-18T21:27:26.688 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.688 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-osd" 2020-05-18T21:27:26.688 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.689 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-rbd", 2020-05-18T21:27:26.689 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQCE/cJepcivLxAA2xFdpI3Fx6hqmN5jR0/yuA==", 2020-05-18T21:27:26.689 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.690 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-rbd" 2020-05-18T21:27:26.690 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.690 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-rbd-mirror", 2020-05-18T21:27:26.691 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQCE/cJeFeWvLxAAXmqvtFxDe5C51GfWwtUkjQ==", 2020-05-18T21:27:26.691 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.691 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2020-05-18T21:27:26.691 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.692 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-rgw", 2020-05-18T21:27:26.692 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQCE/cJeQ/2vLxAAr0k9ZeTTBbqVVe5ptGbL6Q==", 2020-05-18T21:27:26.692 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.692 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-rgw" 2020-05-18T21:27:26.692 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.693 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.x", 2020-05-18T21:27:26.693 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJemmqEKhAAe5ySRz8Id0ug4matQwL0uw==", 2020-05-18T21:27:26.693 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.693 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:27:26.694 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:27:26.694 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:27:26.694 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:26.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:26.695 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.y", 2020-05-18T21:27:26.695 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeF/BNJhAAi/vrldC6qoWJWnSHpE3ung==", 2020-05-18T21:27:26.695 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:27:26.695 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:27:26.695 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:27:26.696 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:27:26.696 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.696 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:26.696 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:26.696 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:27:26.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.649+0000 7f2af1066700 1 -- 172.21.15.63:0/15521296 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2acc04fdb0 msgr2=0x7f2acc052270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:26.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.649+0000 7f2af1066700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2acc04fdb0 0x7f2acc052270 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f2adc008920 tx=0x7f2adc007a80).stop 2020-05-18T21:27:26.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.649+0000 7f2af1066700 1 -- 172.21.15.63:0/15521296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec05f110 msgr2=0x7f2aec062ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:26.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.649+0000 7f2af1066700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec05f110 0x7f2aec062ff0 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7f2ae0002f30 tx=0x7f2ae0010ef0).stop 2020-05-18T21:27:26.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.649+0000 7f2af1066700 1 -- 172.21.15.63:0/15521296 shutdown_connections 2020-05-18T21:27:26.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.649+0000 7f2af1066700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2acc04fdb0 0x7f2acc052270 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:26.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.649+0000 7f2af1066700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec12bec0 0x7f2aec149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:26.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.649+0000 7f2af1066700 1 --2- 172.21.15.63:0/15521296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec05f110 0x7f2aec062ff0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:26.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.649+0000 7f2af1066700 1 -- 172.21.15.63:0/15521296 >> 172.21.15.63:0/15521296 conn(0x7f2aec069fc0 msgr2=0x7f2aec06a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:26.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.649+0000 7f2af1066700 1 -- 172.21.15.63:0/15521296 shutdown_connections 2020-05-18T21:27:26.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.649+0000 7f2af1066700 1 -- 172.21.15.63:0/15521296 wait complete. 2020-05-18T21:27:26.701 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-mds 2020-05-18T21:27:26.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f973d89f700 1 Processor -- start 2020-05-18T21:27:26.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f973d89f700 1 -- start start 2020-05-18T21:27:26.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f973d89f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9738064f70 0x7f9738149880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:26.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f973d89f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97380b4b00 con 0x7f97380b50b0 2020-05-18T21:27:26.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f973d89f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97380622f0 con 0x7f97380b8ed0 2020-05-18T21:27:26.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f973d89f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9738065ec0 con 0x7f9738064f70 2020-05-18T21:27:26.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9736ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f97380b50b0 0x7f9738061be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56094/0 (socket says 172.21.15.63:56094) 2020-05-18T21:27:26.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9736ffd700 1 -- 172.21.15.63:0/3507139207 learned_addr learned my addr 172.21.15.63:0/3507139207 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:26.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f97377fe700 1 --2- 172.21.15.63:0/3507139207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9738064f70 0x7f9738149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:26.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9735ffb700 1 -- 172.21.15.63:0/3507139207 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077523888 0 0) 0x7f9720004880 con 0x7f97380b50b0 2020-05-18T21:27:26.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9735ffb700 1 -- 172.21.15.63:0/3507139207 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9718003270 con 0x7f97380b50b0 2020-05-18T21:27:26.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9735ffb700 1 -- 172.21.15.63:0/3507139207 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892411863 0 0) 0x7f97380622f0 con 0x7f97380b8ed0 2020-05-18T21:27:26.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9735ffb700 1 -- 172.21.15.63:0/3507139207 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9720004880 con 0x7f97380b8ed0 2020-05-18T21:27:26.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9735ffb700 1 -- 172.21.15.63:0/3507139207 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2943495543 0 0) 0x7f9718003270 con 0x7f97380b50b0 2020-05-18T21:27:26.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9735ffb700 1 -- 172.21.15.63:0/3507139207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9738064f70 msgr2=0x7f9738149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:26.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9735ffb700 1 --2- 172.21.15.63:0/3507139207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9738064f70 0x7f9738149880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:26.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9735ffb700 1 -- 172.21.15.63:0/3507139207 >> v1:172.21.15.155:6789/0 conn(0x7f97380b8ed0 legacy=0x7f9738064860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:26.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9735ffb700 1 -- 172.21.15.63:0/3507139207 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9738066160 con 0x7f97380b50b0 2020-05-18T21:27:26.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9735ffb700 1 -- 172.21.15.63:0/3507139207 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f9720005010 con 0x7f97380b50b0 2020-05-18T21:27:26.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9735ffb700 1 -- 172.21.15.63:0/3507139207 >> v1:172.21.15.63:6789/0 conn(0x7f97380b50b0 legacy=0x7f9738061be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:26.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9735ffb700 1 --2- 172.21.15.63:0/3507139207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9718003920 0x7f9718003d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:26.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9735ffb700 1 --2- 172.21.15.63:0/3507139207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9718004510 0x7f9718004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:26.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9735ffb700 1 --2- 172.21.15.63:0/3507139207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9738064f70 0x7f9718004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:26.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9735ffb700 1 -- 172.21.15.63:0/3507139207 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9738065ec0 con 0x7f9718004510 2020-05-18T21:27:26.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9735ffb700 1 -- 172.21.15.63:0/3507139207 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9718005250 con 0x7f9718003920 2020-05-18T21:27:26.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9735ffb700 1 -- 172.21.15.63:0/3507139207 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971800b760 con 0x7f9738064f70 2020-05-18T21:27:26.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f97367fc700 1 --2- 172.21.15.63:0/3507139207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9718004510 0x7f9718004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:26.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f9736ffd700 1 --2- 172.21.15.63:0/3507139207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9718003920 0x7f9718003d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:26.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f97377fe700 1 --2- 172.21.15.63:0/3507139207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9738064f70 0x7f9718004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:26.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f97367fc700 1 -- 172.21.15.63:0/3507139207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9738064f70 msgr2=0x7f9718004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:26.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f97367fc700 1 --2- 172.21.15.63:0/3507139207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9738064f70 0x7f9718004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:26.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f97367fc700 1 -- 172.21.15.63:0/3507139207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9718003920 msgr2=0x7f9718003d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:26.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f97367fc700 1 --2- 172.21.15.63:0/3507139207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9718003920 0x7f9718003d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:26.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f97367fc700 1 -- 172.21.15.63:0/3507139207 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9718003270 con 0x7f9718004510 2020-05-18T21:27:26.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f97377fe700 1 --2- 172.21.15.63:0/3507139207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9738064f70 0x7f9718004df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:27:26.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.801+0000 7f97367fc700 1 --2- 172.21.15.63:0/3507139207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9718004510 0x7f9718004990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9728001490 tx=0x7f972800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.805+0000 7f97367fc700 1 --2- 172.21.15.63:0/3507139207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9718004510 0x7f9718004990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9728001490 tx=0x7f972800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.805+0000 7f97367fc700 1 --2- 172.21.15.63:0/3507139207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9718004510 0x7f9718004990 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f9728001490 tx=0x7f972800c320).ready entity=mon.0 client_cookie=240a1ed398b5978 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:26.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.805+0000 7f97367fc700 1 --2- 172.21.15.63:0/3507139207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9718004510 0x7f9718004990 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f9728001490 tx=0x7f972800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.805+0000 7f97367fc700 1 --2- 172.21.15.63:0/3507139207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9718004510 0x7f9718004990 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f9728001490 tx=0x7f972800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.805+0000 7f9735ffb700 1 -- 172.21.15.63:0/3507139207 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9728001e80 con 0x7f9718004510 2020-05-18T21:27:26.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.805+0000 7f97367fc700 1 --2- 172.21.15.63:0/3507139207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9718004510 0x7f9718004990 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f9728001490 tx=0x7f972800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.805+0000 7f9735ffb700 1 -- 172.21.15.63:0/3507139207 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972800caa0 con 0x7f9718004510 2020-05-18T21:27:26.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.805+0000 7f9735ffb700 1 -- 172.21.15.63:0/3507139207 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97280110d0 con 0x7f9718004510 2020-05-18T21:27:26.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.805+0000 7f973d89f700 1 -- 172.21.15.63:0/3507139207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9718004510 msgr2=0x7f9718004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:26.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.805+0000 7f973d89f700 1 --2- 172.21.15.63:0/3507139207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9718004510 0x7f9718004990 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f9728001490 tx=0x7f972800c320).stop 2020-05-18T21:27:26.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.805+0000 7f97377fe700 1 -- 172.21.15.63:0/3507139207 reap_dead start 2020-05-18T21:27:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.805+0000 7f973d89f700 1 -- 172.21.15.63:0/3507139207 shutdown_connections 2020-05-18T21:27:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.805+0000 7f973d89f700 1 -- 172.21.15.63:0/3507139207 >> 172.21.15.63:0/3507139207 conn(0x7f97380b83b0 msgr2=0x7f97380b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.805+0000 7f973d89f700 1 -- 172.21.15.63:0/3507139207 shutdown_connections 2020-05-18T21:27:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.805+0000 7f973d89f700 1 -- 172.21.15.63:0/3507139207 wait complete. 2020-05-18T21:27:26.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.805+0000 7f973d89f700 1 Processor -- start 2020-05-18T21:27:26.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.805+0000 7f973d89f700 1 -- start start 2020-05-18T21:27:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f973d89f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f97380b0110 0x7f9738145650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f973d89f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97380b0580 con 0x7f9738145ab0 2020-05-18T21:27:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f973d89f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97380b0800 con 0x7f9738157ba0 2020-05-18T21:27:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f973d89f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97380adc90 con 0x7f97380b0110 2020-05-18T21:27:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f97377fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9738145ab0 0x7f9738158900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56110/0 (socket says 172.21.15.63:56110) 2020-05-18T21:27:26.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f97377fe700 1 -- 172.21.15.63:0/3003005011 learned_addr learned my addr 172.21.15.63:0/3003005011 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:26.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f97367fc700 1 --2- 172.21.15.63:0/3003005011 >> v2:172.21.15.155:3300/0 conn(0x7f97380b0110 0x7f9738145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:26.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f972ffff700 1 -- 172.21.15.63:0/3003005011 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869500650 0 0) 0x7f97380b0580 con 0x7f9738145ab0 2020-05-18T21:27:26.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f972ffff700 1 -- 172.21.15.63:0/3003005011 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f971c002fe0 con 0x7f9738145ab0 2020-05-18T21:27:26.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f972ffff700 1 -- 172.21.15.63:0/3003005011 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2877154167 0 0) 0x7f971c002fe0 con 0x7f9738145ab0 2020-05-18T21:27:26.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f97367fc700 1 -- 172.21.15.63:0/3003005011 >> v1:172.21.15.155:6789/0 conn(0x7f9738157ba0 legacy=0x7f9738157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:26.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f97367fc700 1 -- 172.21.15.63:0/3003005011 >> v1:172.21.15.63:6789/0 conn(0x7f9738145ab0 legacy=0x7f9738158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:26.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f97367fc700 1 -- 172.21.15.63:0/3003005011 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97380adf30 con 0x7f97380b0110 2020-05-18T21:27:26.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f97367fc700 1 --2- 172.21.15.63:0/3003005011 >> v2:172.21.15.155:3300/0 conn(0x7f97380b0110 0x7f9738145650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9730001670 tx=0x7f972800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f97367fc700 1 --2- 172.21.15.63:0/3003005011 >> v2:172.21.15.155:3300/0 conn(0x7f97380b0110 0x7f9738145650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9730001670 tx=0x7f972800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f97367fc700 1 --2- 172.21.15.63:0/3003005011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97380b0110 0x7f9738145650 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7f9730001670 tx=0x7f972800c320).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:26.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f97367fc700 1 --2- 172.21.15.63:0/3003005011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97380b0110 0x7f9738145650 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f9730001670 tx=0x7f972800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f972ffff700 1 -- 172.21.15.63:0/3003005011 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97300014d0 con 0x7f97380b0110 2020-05-18T21:27:26.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f97367fc700 1 --2- 172.21.15.63:0/3003005011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97380b0110 0x7f9738145650 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f9730001670 tx=0x7f972800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f97367fc700 1 --2- 172.21.15.63:0/3003005011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97380b0110 0x7f9738145650 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f9730001670 tx=0x7f972800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f972ffff700 1 -- 172.21.15.63:0/3003005011 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9728010e70 con 0x7f97380b0110 2020-05-18T21:27:26.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f973d89f700 1 -- 172.21.15.63:0/3003005011 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9738145f40 con 0x7f97380b0110 2020-05-18T21:27:26.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f972ffff700 1 -- 172.21.15.63:0/3003005011 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9728006ca0 con 0x7f97380b0110 2020-05-18T21:27:26.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f973d89f700 1 -- 172.21.15.63:0/3003005011 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97381591b0 con 0x7f97380b0110 2020-05-18T21:27:26.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f973d89f700 1 -- 172.21.15.63:0/3003005011 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97380ae0c0 con 0x7f97380b0110 2020-05-18T21:27:26.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.809+0000 7f97367fc700 1 --2- 172.21.15.63:0/3003005011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97380b0110 0x7f9738145650 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f9730001670 tx=0x7f972800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.813+0000 7f97367fc700 1 --2- 172.21.15.63:0/3003005011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97380b0110 0x7f9738145650 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f9730001670 tx=0x7f972800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.813+0000 7f972ffff700 1 -- 172.21.15.63:0/3003005011 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f97280030b0 con 0x7f97380b0110 2020-05-18T21:27:26.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.813+0000 7f972ffff700 1 --2- 172.21.15.63:0/3003005011 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f971c04fd60 0x7f971c052220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:26.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.813+0000 7f972ffff700 1 -- 172.21.15.63:0/3003005011 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9728063a40 con 0x7f97380b0110 2020-05-18T21:27:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.813+0000 7f9736ffd700 1 --2- 172.21.15.63:0/3003005011 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f971c04fd60 0x7f971c052220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.813+0000 7f9736ffd700 1 --2- 172.21.15.63:0/3003005011 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f971c04fd60 0x7f971c052220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9720004a10 tx=0x7f973805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.813+0000 7f9736ffd700 1 --2- 172.21.15.63:0/3003005011 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f971c04fd60 0x7f971c052220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9720004a10 tx=0x7f973805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.813+0000 7f9736ffd700 1 --2- 172.21.15.63:0/3003005011 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f971c04fd60 0x7f971c052220 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f9720004a10 tx=0x7f973805b560).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:26.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.821+0000 7f97367fc700 1 --2- 172.21.15.63:0/3003005011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97380b0110 0x7f9738145650 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f9730001670 tx=0x7f972800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.821+0000 7f972ffff700 1 -- 172.21.15.63:0/3003005011 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f972803dd90 con 0x7f97380b0110 2020-05-18T21:27:26.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.973+0000 7f973d89f700 1 -- 172.21.15.63:0/3003005011 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f97380569e0 con 0x7f97380b0110 2020-05-18T21:27:26.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.981+0000 7f97367fc700 1 --2- 172.21.15.63:0/3003005011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97380b0110 0x7f9738145650 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f9730001670 tx=0x7f972800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:26.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.981+0000 7f972ffff700 1 -- 172.21.15.63:0/3003005011 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v5) v1 ==== 97+0+0 (secure 0 0 0) 0x7f97280413b0 con 0x7f97380b0110 2020-05-18T21:27:26.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.985+0000 7f973d89f700 1 -- 172.21.15.63:0/3003005011 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f971c04fd60 msgr2=0x7f971c052220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:26.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.985+0000 7f973d89f700 1 --2- 172.21.15.63:0/3003005011 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f971c04fd60 0x7f971c052220 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f9720004a10 tx=0x7f973805b560).stop 2020-05-18T21:27:26.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.985+0000 7f973d89f700 1 -- 172.21.15.63:0/3003005011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97380b0110 msgr2=0x7f9738145650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:26.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.985+0000 7f973d89f700 1 --2- 172.21.15.63:0/3003005011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97380b0110 0x7f9738145650 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7f9730001670 tx=0x7f972800c320).stop 2020-05-18T21:27:26.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.985+0000 7f973d89f700 1 -- 172.21.15.63:0/3003005011 shutdown_connections 2020-05-18T21:27:26.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.985+0000 7f973d89f700 1 --2- 172.21.15.63:0/3003005011 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f971c04fd60 0x7f971c052220 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:26.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.985+0000 7f973d89f700 1 --2- 172.21.15.63:0/3003005011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97380b0110 0x7f9738145650 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:26.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.985+0000 7f973d89f700 1 -- 172.21.15.63:0/3003005011 >> 172.21.15.63:0/3003005011 conn(0x7f97380b83b0 msgr2=0x7f9738148810 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:26.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.985+0000 7f973d89f700 1 -- 172.21.15.63:0/3003005011 shutdown_connections 2020-05-18T21:27:26.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:26.985+0000 7f973d89f700 1 -- 172.21.15.63:0/3003005011 wait complete. 2020-05-18T21:27:26.994 INFO:teuthology.orchestra.run.smithi063.stderr:updated 2020-05-18T21:27:27.005 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-mgr 2020-05-18T21:27:27.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907f125700 1 Processor -- start 2020-05-18T21:27:27.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907f125700 1 -- start start 2020-05-18T21:27:27.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907f125700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f90780b50b0 0x7f90780b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:27.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907f125700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9078061be0 0x7f9078062020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:27.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907f125700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9078064860 0x7f9078064d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:27.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907f125700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9078065ec0 con 0x7f9078064860 2020-05-18T21:27:27.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907f125700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9078066160 con 0x7f90780b50b0 2020-05-18T21:27:27.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907f125700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9078064120 con 0x7f9078061be0 2020-05-18T21:27:27.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907d6c2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9078064860 0x7f9078064d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:27.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907d6c2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9078064860 0x7f9078064d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53926/0 (socket says 172.21.15.63:53926) 2020-05-18T21:27:27.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907d6c2700 1 -- 172.21.15.63:0/1594820160 learned_addr learned my addr 172.21.15.63:0/1594820160 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:27.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f9077fff700 1 --2- 172.21.15.63:0/1594820160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9078061be0 0x7f9078062020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:27.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907cec1700 1 --2- 172.21.15.63:0/1594820160 >> v2:172.21.15.155:3300/0 conn(0x7f90780b50b0 0x7f90780b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:27.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907d6c2700 1 -- 172.21.15.63:0/1594820160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9078061be0 msgr2=0x7f9078062020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:27.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907d6c2700 1 --2- 172.21.15.63:0/1594820160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9078061be0 0x7f9078062020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:27.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907d6c2700 1 -- 172.21.15.63:0/1594820160 >> v2:172.21.15.155:3300/0 conn(0x7f90780b50b0 msgr2=0x7f90780b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:27.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907d6c2700 1 --2- 172.21.15.63:0/1594820160 >> v2:172.21.15.155:3300/0 conn(0x7f90780b50b0 0x7f90780b8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:27.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907d6c2700 1 -- 172.21.15.63:0/1594820160 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90780643c0 con 0x7f9078064860 2020-05-18T21:27:27.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907cec1700 1 --2- 172.21.15.63:0/1594820160 >> v2:172.21.15.155:3300/0 conn(0x7f90780b50b0 0x7f90780b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:27:27.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907d6c2700 1 --2- 172.21.15.63:0/1594820160 >> v2:172.21.15.63:3300/0 conn(0x7f9078064860 0x7f9078064d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9070002f70 tx=0x7f9070007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.101+0000 7f907d6c2700 1 --2- 172.21.15.63:0/1594820160 >> v2:172.21.15.63:3300/0 conn(0x7f9078064860 0x7f9078064d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9070002f70 tx=0x7f9070007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.105+0000 7f907d6c2700 1 --2- 172.21.15.63:0/1594820160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078064860 0x7f9078064d10 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7f9070002f70 tx=0x7f9070007a80).ready entity=mon.0 client_cookie=928eb60c646b66fd server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:27.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.105+0000 7f907d6c2700 1 --2- 172.21.15.63:0/1594820160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078064860 0x7f9078064d10 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f9070002f70 tx=0x7f9070007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.105+0000 7f907d6c2700 1 --2- 172.21.15.63:0/1594820160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078064860 0x7f9078064d10 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f9070002f70 tx=0x7f9070007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.105+0000 7f90777fe700 1 -- 172.21.15.63:0/1594820160 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90700116b0 con 0x7f9078064860 2020-05-18T21:27:27.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.105+0000 7f907d6c2700 1 --2- 172.21.15.63:0/1594820160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078064860 0x7f9078064d10 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f9070002f70 tx=0x7f9070007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.105+0000 7f90777fe700 1 -- 172.21.15.63:0/1594820160 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9070011810 con 0x7f9078064860 2020-05-18T21:27:27.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.105+0000 7f90777fe700 1 -- 172.21.15.63:0/1594820160 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9070011c30 con 0x7f9078064860 2020-05-18T21:27:27.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.105+0000 7f907f125700 1 -- 172.21.15.63:0/1594820160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078064860 msgr2=0x7f9078064d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:27.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.105+0000 7f907f125700 1 --2- 172.21.15.63:0/1594820160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078064860 0x7f9078064d10 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7f9070002f70 tx=0x7f9070007a80).stop 2020-05-18T21:27:27.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.105+0000 7f907f125700 1 -- 172.21.15.63:0/1594820160 shutdown_connections 2020-05-18T21:27:27.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.105+0000 7f907f125700 1 --2- 172.21.15.63:0/1594820160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078064860 0x7f9078064d10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:27.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.105+0000 7f907f125700 1 --2- 172.21.15.63:0/1594820160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9078061be0 0x7f9078062020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:27.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.105+0000 7f907f125700 1 --2- 172.21.15.63:0/1594820160 >> v2:172.21.15.155:3300/0 conn(0x7f90780b50b0 0x7f90780b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:27.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.105+0000 7f907f125700 1 -- 172.21.15.63:0/1594820160 >> 172.21.15.63:0/1594820160 conn(0x7f90780b83b0 msgr2=0x7f90780b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:27.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.105+0000 7f907f125700 1 -- 172.21.15.63:0/1594820160 shutdown_connections 2020-05-18T21:27:27.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.105+0000 7f907f125700 1 -- 172.21.15.63:0/1594820160 wait complete. 2020-05-18T21:27:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.105+0000 7f907f125700 1 Processor -- start 2020-05-18T21:27:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.105+0000 7f907f125700 1 -- start start 2020-05-18T21:27:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f907f125700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9078064860 0x7f90780afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f907f125700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90780b50b0 0x7f907813a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f907f125700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f907813a730 con 0x7f9078061be0 2020-05-18T21:27:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f907f125700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90780b1d60 con 0x7f9078064860 2020-05-18T21:27:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f907f125700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9078139e40 con 0x7f90780b50b0 2020-05-18T21:27:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f9077fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9078064860 0x7f90780afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f9077fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9078064860 0x7f90780afa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53934/0 (socket says 172.21.15.63:53934) 2020-05-18T21:27:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f9077fff700 1 -- 172.21.15.63:0/2184131007 learned_addr learned my addr 172.21.15.63:0/2184131007 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f907d6c2700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90780b50b0 0x7f907813a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f9077fff700 1 -- 172.21.15.63:0/2184131007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90780b50b0 msgr2=0x7f907813a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f9077fff700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90780b50b0 0x7f907813a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f9077fff700 1 -- 172.21.15.63:0/2184131007 >> v1:172.21.15.155:6789/0 conn(0x7f9078061be0 legacy=0x7f90780af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f9075ffb700 1 -- 172.21.15.63:0/2184131007 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209128004 0 0) 0x7f907813a730 con 0x7f9078061be0 2020-05-18T21:27:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f9077fff700 1 -- 172.21.15.63:0/2184131007 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907813a9d0 con 0x7f9078064860 2020-05-18T21:27:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f9077fff700 1 --2- 172.21.15.63:0/2184131007 >> v2:172.21.15.63:3300/0 conn(0x7f9078064860 0x7f90780afa70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f906c002f70 tx=0x7f906c010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f9077fff700 1 --2- 172.21.15.63:0/2184131007 >> v2:172.21.15.63:3300/0 conn(0x7f9078064860 0x7f90780afa70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f906c002f70 tx=0x7f906c010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f9077fff700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078064860 0x7f90780afa70 secure :-1 s=READY pgs=322 cs=0 l=1 rx=0x7f906c002f70 tx=0x7f906c010d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f9077fff700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078064860 0x7f90780afa70 secure :-1 s=THROTTLE_DONE pgs=322 cs=0 l=1 rx=0x7f906c002f70 tx=0x7f906c010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f9075ffb700 1 -- 172.21.15.63:0/2184131007 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f906c007180 con 0x7f9078064860 2020-05-18T21:27:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f9077fff700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078064860 0x7f90780afa70 secure :-1 s=THROTTLE_DONE pgs=322 cs=0 l=1 rx=0x7f906c002f70 tx=0x7f906c010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f9075ffb700 1 -- 172.21.15.63:0/2184131007 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c0072e0 con 0x7f9078064860 2020-05-18T21:27:27.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f9077fff700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078064860 0x7f90780afa70 secure :-1 s=THROTTLE_DONE pgs=322 cs=0 l=1 rx=0x7f906c002f70 tx=0x7f906c010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f907f125700 1 -- 172.21.15.63:0/2184131007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907805f5a0 con 0x7f9078064860 2020-05-18T21:27:27.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f9075ffb700 1 -- 172.21.15.63:0/2184131007 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f906c0123d0 con 0x7f9078064860 2020-05-18T21:27:27.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f907f125700 1 -- 172.21.15.63:0/2184131007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907805fa50 con 0x7f9078064860 2020-05-18T21:27:27.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f9077fff700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078064860 0x7f90780afa70 secure :-1 s=THROTTLE_DONE pgs=322 cs=0 l=1 rx=0x7f906c002f70 tx=0x7f906c010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.109+0000 7f907f125700 1 -- 172.21.15.63:0/2184131007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90780569e0 con 0x7f9078064860 2020-05-18T21:27:27.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.113+0000 7f9075ffb700 1 -- 172.21.15.63:0/2184131007 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f906c010190 con 0x7f9078064860 2020-05-18T21:27:27.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.113+0000 7f9077fff700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078064860 0x7f90780afa70 secure :-1 s=THROTTLE_DONE pgs=322 cs=0 l=1 rx=0x7f906c002f70 tx=0x7f906c010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.113+0000 7f9075ffb700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f905804f8f0 0x7f9058051db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:27.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.113+0000 7f9075ffb700 1 -- 172.21.15.63:0/2184131007 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f906c064090 con 0x7f9078064860 2020-05-18T21:27:27.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.113+0000 7f907cec1700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f905804f8f0 0x7f9058051db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:27.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.113+0000 7f907cec1700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f905804f8f0 0x7f9058051db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f90680032b0 tx=0x7f907805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.113+0000 7f907cec1700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f905804f8f0 0x7f9058051db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f90680032b0 tx=0x7f907805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.113+0000 7f907cec1700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f905804f8f0 0x7f9058051db0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f90680032b0 tx=0x7f907805b560).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:27.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.117+0000 7f9077fff700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078064860 0x7f90780afa70 secure :-1 s=THROTTLE_DONE pgs=322 cs=0 l=1 rx=0x7f906c002f70 tx=0x7f906c010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.117+0000 7f9075ffb700 1 -- 172.21.15.63:0/2184131007 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f906c03e3c0 con 0x7f9078064860 2020-05-18T21:27:27.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.273+0000 7f907f125700 1 -- 172.21.15.63:0/2184131007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f9078060f10 con 0x7f9078064860 2020-05-18T21:27:27.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.281+0000 7f9077fff700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078064860 0x7f90780afa70 secure :-1 s=THROTTLE_DONE pgs=322 cs=0 l=1 rx=0x7f906c002f70 tx=0x7f906c010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.281+0000 7f9075ffb700 1 -- 172.21.15.63:0/2184131007 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v6) v1 ==== 97+0+0 (secure 0 0 0) 0x7f906c0419e0 con 0x7f9078064860 2020-05-18T21:27:27.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.281+0000 7f907f125700 1 -- 172.21.15.63:0/2184131007 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f905804f8f0 msgr2=0x7f9058051db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:27.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.281+0000 7f907f125700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f905804f8f0 0x7f9058051db0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f90680032b0 tx=0x7f907805b560).stop 2020-05-18T21:27:27.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.281+0000 7f907f125700 1 -- 172.21.15.63:0/2184131007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078064860 msgr2=0x7f90780afa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:27.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.281+0000 7f907f125700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078064860 0x7f90780afa70 secure :-1 s=READY pgs=322 cs=0 l=1 rx=0x7f906c002f70 tx=0x7f906c010d30).stop 2020-05-18T21:27:27.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.281+0000 7f907f125700 1 -- 172.21.15.63:0/2184131007 shutdown_connections 2020-05-18T21:27:27.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.281+0000 7f907f125700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f905804f8f0 0x7f9058051db0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:27.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.281+0000 7f907f125700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90780b50b0 0x7f907813a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:27.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.281+0000 7f907f125700 1 --2- 172.21.15.63:0/2184131007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078064860 0x7f90780afa70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:27.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.281+0000 7f907f125700 1 -- 172.21.15.63:0/2184131007 >> 172.21.15.63:0/2184131007 conn(0x7f90780b83b0 msgr2=0x7f9078148cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:27.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.281+0000 7f907f125700 1 -- 172.21.15.63:0/2184131007 shutdown_connections 2020-05-18T21:27:27.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.285+0000 7f907f125700 1 -- 172.21.15.63:0/2184131007 wait complete. 2020-05-18T21:27:27.292 INFO:teuthology.orchestra.run.smithi063.stderr:updated 2020-05-18T21:27:27.302 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-osd 2020-05-18T21:27:27.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.397+0000 7f05c3fff700 1 Processor -- start 2020-05-18T21:27:27.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.397+0000 7f05c3fff700 1 -- start start 2020-05-18T21:27:27.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.397+0000 7f05c3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f05c4143110 0x7f05c405f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:27.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.397+0000 7f05c3fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c4142ca0 con 0x7f05c40606d0 2020-05-18T21:27:27.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.397+0000 7f05c3fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c4062b40 con 0x7f05c4141c50 2020-05-18T21:27:27.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.397+0000 7f05c3fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c4062de0 con 0x7f05c4143110 2020-05-18T21:27:27.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.397+0000 7f05c37fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f05c40606d0 0x7f05c4060b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56132/0 (socket says 172.21.15.63:56132) 2020-05-18T21:27:27.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.397+0000 7f05c37fe700 1 -- 172.21.15.63:0/12505601 learned_addr learned my addr 172.21.15.63:0/12505601 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:27.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.397+0000 7f05c27fc700 1 --2- 172.21.15.63:0/12505601 >> v2:172.21.15.155:3300/0 conn(0x7f05c4143110 0x7f05c405f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:27.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.397+0000 7f05c1ffb700 1 -- 172.21.15.63:0/12505601 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29719668 0 0) 0x7f05c4142ca0 con 0x7f05c40606d0 2020-05-18T21:27:27.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.397+0000 7f05c1ffb700 1 -- 172.21.15.63:0/12505601 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05a4003270 con 0x7f05c40606d0 2020-05-18T21:27:27.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.397+0000 7f05c27fc700 1 -- 172.21.15.63:0/12505601 >> v1:172.21.15.155:6789/0 conn(0x7f05c4141c50 legacy=0x7f05c405f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:27.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.397+0000 7f05c27fc700 1 -- 172.21.15.63:0/12505601 >> v1:172.21.15.63:6789/0 conn(0x7f05c40606d0 legacy=0x7f05c4060b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:27.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.397+0000 7f05c27fc700 1 -- 172.21.15.63:0/12505601 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c40631e0 con 0x7f05c4143110 2020-05-18T21:27:27.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.397+0000 7f05c27fc700 1 --2- 172.21.15.63:0/12505601 >> v2:172.21.15.155:3300/0 conn(0x7f05c4143110 0x7f05c405f760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.397+0000 7f05c27fc700 1 --2- 172.21.15.63:0/12505601 >> v2:172.21.15.155:3300/0 conn(0x7f05c4143110 0x7f05c405f760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.397+0000 7f05c27fc700 1 --2- 172.21.15.63:0/12505601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05c4143110 0x7f05c405f760 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).ready entity=mon.1 client_cookie=81f436958888155 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:27.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.401+0000 7f05c27fc700 1 --2- 172.21.15.63:0/12505601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05c4143110 0x7f05c405f760 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.401+0000 7f05c1ffb700 1 -- 172.21.15.63:0/12505601 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05b4008e80 con 0x7f05c4143110 2020-05-18T21:27:27.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.401+0000 7f05c27fc700 1 --2- 172.21.15.63:0/12505601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05c4143110 0x7f05c405f760 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.401+0000 7f05c1ffb700 1 -- 172.21.15.63:0/12505601 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b4012700 con 0x7f05c4143110 2020-05-18T21:27:27.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.401+0000 7f05c27fc700 1 --2- 172.21.15.63:0/12505601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05c4143110 0x7f05c405f760 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.401+0000 7f05c1ffb700 1 -- 172.21.15.63:0/12505601 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05b4012ae0 con 0x7f05c4143110 2020-05-18T21:27:27.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.401+0000 7f05c3fff700 1 -- 172.21.15.63:0/12505601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05c4143110 msgr2=0x7f05c405f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:27.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.401+0000 7f05c3fff700 1 --2- 172.21.15.63:0/12505601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05c4143110 0x7f05c405f760 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).stop 2020-05-18T21:27:27.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.401+0000 7f05c3fff700 1 -- 172.21.15.63:0/12505601 shutdown_connections 2020-05-18T21:27:27.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.401+0000 7f05c3fff700 1 --2- 172.21.15.63:0/12505601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05c4143110 0x7f05c405f760 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:27.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.401+0000 7f05c3fff700 1 -- 172.21.15.63:0/12505601 >> 172.21.15.63:0/12505601 conn(0x7f05c409da60 msgr2=0x7f05c409de70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:27.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.401+0000 7f05c3fff700 1 -- 172.21.15.63:0/12505601 shutdown_connections 2020-05-18T21:27:27.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.401+0000 7f05c3fff700 1 -- 172.21.15.63:0/12505601 wait complete. 2020-05-18T21:27:27.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.401+0000 7f05c3fff700 1 Processor -- start 2020-05-18T21:27:27.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.401+0000 7f05c3fff700 1 -- start start 2020-05-18T21:27:27.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c3fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05c40606d0 0x7f05c40b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:27.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f05c4141c50 0x7f05c40b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:27.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f05c4143110 0x7f05c4156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:27.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c3fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c41453c0 con 0x7f05c4141c50 2020-05-18T21:27:27.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c3fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c4156590 con 0x7f05c4143110 2020-05-18T21:27:27.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c3fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40b49b0 con 0x7f05c40606d0 2020-05-18T21:27:27.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c27fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f05c4141c50 0x7f05c40b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:27.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c27fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f05c4141c50 0x7f05c40b1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53948/0 (socket says 172.21.15.63:53948) 2020-05-18T21:27:27.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c27fc700 1 -- 172.21.15.63:0/2446446867 learned_addr learned my addr 172.21.15.63:0/2446446867 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:27.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c2ffd700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05c40606d0 0x7f05c40b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:27.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c37fe700 1 --2- 172.21.15.63:0/2446446867 >> v2:172.21.15.155:3300/0 conn(0x7f05c4143110 0x7f05c4156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:27.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c27fc700 1 -- 172.21.15.63:0/2446446867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05c40606d0 msgr2=0x7f05c40b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:27.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c27fc700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05c40606d0 0x7f05c40b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:27.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c27fc700 1 -- 172.21.15.63:0/2446446867 >> v2:172.21.15.155:3300/0 conn(0x7f05c4143110 msgr2=0x7f05c4156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:27.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c27fc700 1 --2- 172.21.15.63:0/2446446867 >> v2:172.21.15.155:3300/0 conn(0x7f05c4143110 0x7f05c4156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:27.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c27fc700 1 -- 172.21.15.63:0/2446446867 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c41455f0 con 0x7f05c4141c50 2020-05-18T21:27:27.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c2ffd700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05c40606d0 0x7f05c40b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:27.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c27fc700 1 --2- 172.21.15.63:0/2446446867 >> v2:172.21.15.63:3300/0 conn(0x7f05c4141c50 0x7f05c40b1800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c27fc700 1 --2- 172.21.15.63:0/2446446867 >> v2:172.21.15.63:3300/0 conn(0x7f05c4141c50 0x7f05c40b1800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c27fc700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05c4141c50 0x7f05c40b1800 secure :-1 s=READY pgs=324 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:27.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c27fc700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05c4141c50 0x7f05c40b1800 secure :-1 s=THROTTLE_DONE pgs=324 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c27fc700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05c4141c50 0x7f05c40b1800 secure :-1 s=THROTTLE_DONE pgs=324 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05bbfff700 1 -- 172.21.15.63:0/2446446867 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05b400f8b0 con 0x7f05c4141c50 2020-05-18T21:27:27.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c27fc700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05c4141c50 0x7f05c40b1800 secure :-1 s=THROTTLE_DONE pgs=324 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05bbfff700 1 -- 172.21.15.63:0/2446446867 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b4007170 con 0x7f05c4141c50 2020-05-18T21:27:27.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c3fff700 1 -- 172.21.15.63:0/2446446867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c40b25a0 con 0x7f05c4141c50 2020-05-18T21:27:27.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05bbfff700 1 -- 172.21.15.63:0/2446446867 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05b4007590 con 0x7f05c4141c50 2020-05-18T21:27:27.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c3fff700 1 -- 172.21.15.63:0/2446446867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c4153450 con 0x7f05c4141c50 2020-05-18T21:27:27.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c27fc700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05c4141c50 0x7f05c40b1800 secure :-1 s=THROTTLE_DONE pgs=324 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.405+0000 7f05c3fff700 1 -- 172.21.15.63:0/2446446867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c4145780 con 0x7f05c4141c50 2020-05-18T21:27:27.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.409+0000 7f05bbfff700 1 -- 172.21.15.63:0/2446446867 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f05b4005700 con 0x7f05c4141c50 2020-05-18T21:27:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.409+0000 7f05c27fc700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05c4141c50 0x7f05c40b1800 secure :-1 s=THROTTLE_DONE pgs=324 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.409+0000 7f05bbfff700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05a804fac0 0x7f05a8051f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.409+0000 7f05bbfff700 1 -- 172.21.15.63:0/2446446867 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f05b4064590 con 0x7f05c4141c50 2020-05-18T21:27:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.409+0000 7f05c2ffd700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05a804fac0 0x7f05a8051f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.409+0000 7f05c2ffd700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05a804fac0 0x7f05a8051f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05c405eac0 tx=0x7f05ac0013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.409+0000 7f05c2ffd700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05a804fac0 0x7f05a8051f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05c405eac0 tx=0x7f05ac0013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.409+0000 7f05c2ffd700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05a804fac0 0x7f05a8051f80 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f05c405eac0 tx=0x7f05ac0013e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:27.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.413+0000 7f05c27fc700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05c4141c50 0x7f05c40b1800 secure :-1 s=THROTTLE_DONE pgs=324 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.413+0000 7f05bbfff700 1 -- 172.21.15.63:0/2446446867 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f05b403e9e0 con 0x7f05c4141c50 2020-05-18T21:27:27.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.573+0000 7f05c3fff700 1 -- 172.21.15.63:0/2446446867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f05c40569e0 con 0x7f05c4141c50 2020-05-18T21:27:27.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.581+0000 7f05c27fc700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05c4141c50 0x7f05c40b1800 secure :-1 s=THROTTLE_DONE pgs=324 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.581+0000 7f05bbfff700 1 -- 172.21.15.63:0/2446446867 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f05b4042000 con 0x7f05c4141c50 2020-05-18T21:27:27.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.581+0000 7f05c3fff700 1 -- 172.21.15.63:0/2446446867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05a804fac0 msgr2=0x7f05a8051f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:27.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.581+0000 7f05c3fff700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05a804fac0 0x7f05a8051f80 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f05c405eac0 tx=0x7f05ac0013e0).stop 2020-05-18T21:27:27.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.581+0000 7f05c3fff700 1 -- 172.21.15.63:0/2446446867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05c4141c50 msgr2=0x7f05c40b1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:27.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.581+0000 7f05c3fff700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05c4141c50 0x7f05c40b1800 secure :-1 s=READY pgs=324 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).stop 2020-05-18T21:27:27.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.581+0000 7f05c3fff700 1 -- 172.21.15.63:0/2446446867 shutdown_connections 2020-05-18T21:27:27.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.581+0000 7f05c3fff700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05a804fac0 0x7f05a8051f80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:27.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.581+0000 7f05c3fff700 1 --2- 172.21.15.63:0/2446446867 >> v2:172.21.15.155:3300/0 conn(0x7f05c4143110 0x7f05c4156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:27.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.581+0000 7f05c3fff700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05c4141c50 0x7f05c40b1800 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:27.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.581+0000 7f05c3fff700 1 --2- 172.21.15.63:0/2446446867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05c40606d0 0x7f05c40b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:27.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.581+0000 7f05c3fff700 1 -- 172.21.15.63:0/2446446867 >> 172.21.15.63:0/2446446867 conn(0x7f05c409da60 msgr2=0x7f05c4062140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:27.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.585+0000 7f05c3fff700 1 -- 172.21.15.63:0/2446446867 shutdown_connections 2020-05-18T21:27:27.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.585+0000 7f05c3fff700 1 -- 172.21.15.63:0/2446446867 wait complete. 2020-05-18T21:27:27.593 INFO:teuthology.orchestra.run.smithi063.stderr:updated 2020-05-18T21:27:27.604 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-rbd 2020-05-18T21:27:27.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dcbba0700 1 Processor -- start 2020-05-18T21:27:27.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dcbba0700 1 -- start start 2020-05-18T21:27:27.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dcbba0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8dc4142340 0x7f8dc406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:27.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dcbba0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8dc4145ad0 0x7f8dc4145f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:27.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dcbba0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc406a9e0 con 0x7f8dc4142f30 2020-05-18T21:27:27.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dcbba0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc41427b0 con 0x7f8dc4145ad0 2020-05-18T21:27:27.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dcbba0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc4143310 con 0x7f8dc4142340 2020-05-18T21:27:27.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dca13d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8dc4145ad0 0x7f8dc4145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:27.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dca13d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8dc4145ad0 0x7f8dc4145f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53956/0 (socket says 172.21.15.63:53956) 2020-05-18T21:27:27.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dca13d700 1 -- 172.21.15.63:0/1237441796 learned_addr learned my addr 172.21.15.63:0/1237441796 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:27.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dc993c700 1 --1- 172.21.15.63:0/1237441796 >> v1:172.21.15.63:6789/0 conn(0x7f8dc4142f30 0x7f8dc40b5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56142/0 (socket says 172.21.15.63:56142) 2020-05-18T21:27:27.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dc913b700 1 --2- 172.21.15.63:0/1237441796 >> v2:172.21.15.155:3300/0 conn(0x7f8dc4142340 0x7f8dc406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:27.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dca13d700 1 -- 172.21.15.63:0/1237441796 >> v2:172.21.15.155:3300/0 conn(0x7f8dc4142340 msgr2=0x7f8dc406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:27.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dca13d700 1 --2- 172.21.15.63:0/1237441796 >> v2:172.21.15.155:3300/0 conn(0x7f8dc4142340 0x7f8dc406a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:27.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dca13d700 1 -- 172.21.15.63:0/1237441796 >> v1:172.21.15.63:6789/0 conn(0x7f8dc4142f30 legacy=0x7f8dc40b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:27.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dc893a700 1 -- 172.21.15.63:0/1237441796 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417895652 0 0) 0x7f8dc0001110 con 0x7f8dc4142f30 2020-05-18T21:27:27.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dca13d700 1 -- 172.21.15.63:0/1237441796 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc40af210 con 0x7f8dc4145ad0 2020-05-18T21:27:27.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dca13d700 1 --2- 172.21.15.63:0/1237441796 >> v2:172.21.15.63:3300/0 conn(0x7f8dc4145ad0 0x7f8dc4145f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8dbc0032f0 tx=0x7f8dbc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dca13d700 1 --2- 172.21.15.63:0/1237441796 >> v2:172.21.15.63:3300/0 conn(0x7f8dc4145ad0 0x7f8dc4145f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8dbc0032f0 tx=0x7f8dbc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dca13d700 1 --2- 172.21.15.63:0/1237441796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8dc4145ad0 0x7f8dc4145f00 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7f8dbc0032f0 tx=0x7f8dbc007e00).ready entity=mon.0 client_cookie=ff0a7cbf96e2273f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:27.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dca13d700 1 --2- 172.21.15.63:0/1237441796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8dc4145ad0 0x7f8dc4145f00 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f8dbc0032f0 tx=0x7f8dbc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dca13d700 1 --2- 172.21.15.63:0/1237441796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8dc4145ad0 0x7f8dc4145f00 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f8dbc0032f0 tx=0x7f8dbc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dc893a700 1 -- 172.21.15.63:0/1237441796 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dbc011e00 con 0x7f8dc4145ad0 2020-05-18T21:27:27.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dca13d700 1 --2- 172.21.15.63:0/1237441796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8dc4145ad0 0x7f8dc4145f00 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f8dbc0032f0 tx=0x7f8dbc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dc893a700 1 -- 172.21.15.63:0/1237441796 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc00a180 con 0x7f8dc4145ad0 2020-05-18T21:27:27.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dc893a700 1 -- 172.21.15.63:0/1237441796 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dbc00a560 con 0x7f8dc4145ad0 2020-05-18T21:27:27.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dcbba0700 1 -- 172.21.15.63:0/1237441796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8dc4145ad0 msgr2=0x7f8dc4145f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:27.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.701+0000 7f8dcbba0700 1 --2- 172.21.15.63:0/1237441796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8dc4145ad0 0x7f8dc4145f00 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7f8dbc0032f0 tx=0x7f8dbc007e00).stop 2020-05-18T21:27:27.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dcbba0700 1 -- 172.21.15.63:0/1237441796 shutdown_connections 2020-05-18T21:27:27.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dcbba0700 1 --2- 172.21.15.63:0/1237441796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8dc4145ad0 0x7f8dc4145f00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:27.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dcbba0700 1 --2- 172.21.15.63:0/1237441796 >> v2:172.21.15.155:3300/0 conn(0x7f8dc4142340 0x7f8dc406a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:27.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dcbba0700 1 -- 172.21.15.63:0/1237441796 >> 172.21.15.63:0/1237441796 conn(0x7f8dc40b9740 msgr2=0x7f8dc40b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:27.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dcbba0700 1 -- 172.21.15.63:0/1237441796 shutdown_connections 2020-05-18T21:27:27.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dcbba0700 1 -- 172.21.15.63:0/1237441796 wait complete. 2020-05-18T21:27:27.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dcbba0700 1 Processor -- start 2020-05-18T21:27:27.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dcbba0700 1 -- start start 2020-05-18T21:27:27.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dcbba0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8dc4142340 0x7f8dc40afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:27.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dcbba0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8dc4142f30 0x7f8dc40b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:27.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dcbba0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc413f890 con 0x7f8dc4145ad0 2020-05-18T21:27:27.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dcbba0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc40b25e0 con 0x7f8dc4142f30 2020-05-18T21:27:27.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dcbba0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc40b2890 con 0x7f8dc4142340 2020-05-18T21:27:27.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dc913b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8dc4142f30 0x7f8dc40b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:27.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dc913b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8dc4142f30 0x7f8dc40b2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53962/0 (socket says 172.21.15.63:53962) 2020-05-18T21:27:27.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dc913b700 1 -- 172.21.15.63:0/351613256 learned_addr learned my addr 172.21.15.63:0/351613256 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:27.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dc993c700 1 --2- 172.21.15.63:0/351613256 >> v2:172.21.15.155:3300/0 conn(0x7f8dc4142340 0x7f8dc40afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:27.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dc913b700 1 -- 172.21.15.63:0/351613256 >> v2:172.21.15.155:3300/0 conn(0x7f8dc4142340 msgr2=0x7f8dc40afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:27.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dc913b700 1 --2- 172.21.15.63:0/351613256 >> v2:172.21.15.155:3300/0 conn(0x7f8dc4142340 0x7f8dc40afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:27.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dc913b700 1 -- 172.21.15.63:0/351613256 >> v1:172.21.15.155:6789/0 conn(0x7f8dc4145ad0 legacy=0x7f8dc413d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:27.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dc913b700 1 -- 172.21.15.63:0/351613256 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc40b2b30 con 0x7f8dc4142f30 2020-05-18T21:27:27.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.705+0000 7f8dc913b700 1 --2- 172.21.15.63:0/351613256 >> v2:172.21.15.63:3300/0 conn(0x7f8dc4142f30 0x7f8dc40b2180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8db40030b0 tx=0x7f8db4010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8dc913b700 1 --2- 172.21.15.63:0/351613256 >> v2:172.21.15.63:3300/0 conn(0x7f8dc4142f30 0x7f8dc40b2180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8db40030b0 tx=0x7f8db4010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8dc913b700 1 --2- 172.21.15.63:0/351613256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8dc4142f30 0x7f8dc40b2180 secure :-1 s=READY pgs=327 cs=0 l=1 rx=0x7f8db40030b0 tx=0x7f8db4010d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:27.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8dc913b700 1 --2- 172.21.15.63:0/351613256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8dc4142f30 0x7f8dc40b2180 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7f8db40030b0 tx=0x7f8db4010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8db2ffd700 1 -- 172.21.15.63:0/351613256 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8db4007180 con 0x7f8dc4142f30 2020-05-18T21:27:27.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8dc913b700 1 --2- 172.21.15.63:0/351613256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8dc4142f30 0x7f8dc40b2180 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7f8db40030b0 tx=0x7f8db4010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8dcbba0700 1 -- 172.21.15.63:0/351613256 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc413f5d0 con 0x7f8dc4142f30 2020-05-18T21:27:27.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8db2ffd700 1 -- 172.21.15.63:0/351613256 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db40072e0 con 0x7f8dc4142f30 2020-05-18T21:27:27.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8dc913b700 1 --2- 172.21.15.63:0/351613256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8dc4142f30 0x7f8dc40b2180 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7f8db40030b0 tx=0x7f8db4010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8db2ffd700 1 -- 172.21.15.63:0/351613256 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8db4012330 con 0x7f8dc4142f30 2020-05-18T21:27:27.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8dcbba0700 1 -- 172.21.15.63:0/351613256 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc40b58e0 con 0x7f8dc4142f30 2020-05-18T21:27:27.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8dc913b700 1 --2- 172.21.15.63:0/351613256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8dc4142f30 0x7f8dc40b2180 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7f8db40030b0 tx=0x7f8db4010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8db2ffd700 1 -- 172.21.15.63:0/351613256 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8db4010190 con 0x7f8dc4142f30 2020-05-18T21:27:27.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8dc913b700 1 --2- 172.21.15.63:0/351613256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8dc4142f30 0x7f8dc40b2180 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7f8db40030b0 tx=0x7f8db4010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8dcbba0700 1 -- 172.21.15.63:0/351613256 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc40b5d90 con 0x7f8dc4142f30 2020-05-18T21:27:27.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8db2ffd700 1 --2- 172.21.15.63:0/351613256 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8da404f8c0 0x7f8da4051d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:27.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8db2ffd700 1 -- 172.21.15.63:0/351613256 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f8db4063f70 con 0x7f8dc4142f30 2020-05-18T21:27:27.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8dc993c700 1 --2- 172.21.15.63:0/351613256 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8da404f8c0 0x7f8da4051d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:27.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8dc993c700 1 --2- 172.21.15.63:0/351613256 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8da404f8c0 0x7f8da4051d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8dc0000bc0 tx=0x7f8dc0001980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8dc993c700 1 --2- 172.21.15.63:0/351613256 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8da404f8c0 0x7f8da4051d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8dc0000bc0 tx=0x7f8dc0001980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.709+0000 7f8dc993c700 1 --2- 172.21.15.63:0/351613256 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8da404f8c0 0x7f8da4051d80 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f8dc0000bc0 tx=0x7f8dc0001980).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:27.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.717+0000 7f8dc913b700 1 --2- 172.21.15.63:0/351613256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8dc4142f30 0x7f8dc40b2180 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7f8db40030b0 tx=0x7f8db4010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.717+0000 7f8db2ffd700 1 -- 172.21.15.63:0/351613256 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f8db403e300 con 0x7f8dc4142f30 2020-05-18T21:27:27.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.865+0000 7f8dcbba0700 1 -- 172.21.15.63:0/351613256 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f8dc40569e0 con 0x7f8dc4142f30 2020-05-18T21:27:27.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.873+0000 7f8dc913b700 1 --2- 172.21.15.63:0/351613256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8dc4142f30 0x7f8dc40b2180 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7f8db40030b0 tx=0x7f8db4010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:27.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.873+0000 7f8db2ffd700 1 -- 172.21.15.63:0/351613256 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8db4041920 con 0x7f8dc4142f30 2020-05-18T21:27:27.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.877+0000 7f8dcbba0700 1 -- 172.21.15.63:0/351613256 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8da404f8c0 msgr2=0x7f8da4051d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:27.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.877+0000 7f8dcbba0700 1 --2- 172.21.15.63:0/351613256 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8da404f8c0 0x7f8da4051d80 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f8dc0000bc0 tx=0x7f8dc0001980).stop 2020-05-18T21:27:27.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.877+0000 7f8dcbba0700 1 -- 172.21.15.63:0/351613256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8dc4142f30 msgr2=0x7f8dc40b2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:27.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.877+0000 7f8dcbba0700 1 --2- 172.21.15.63:0/351613256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8dc4142f30 0x7f8dc40b2180 secure :-1 s=READY pgs=327 cs=0 l=1 rx=0x7f8db40030b0 tx=0x7f8db4010d10).stop 2020-05-18T21:27:27.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.877+0000 7f8dcbba0700 1 -- 172.21.15.63:0/351613256 shutdown_connections 2020-05-18T21:27:27.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.877+0000 7f8dcbba0700 1 --2- 172.21.15.63:0/351613256 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8da404f8c0 0x7f8da4051d80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:27.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.877+0000 7f8dcbba0700 1 --2- 172.21.15.63:0/351613256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8dc4142f30 0x7f8dc40b2180 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:27.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.877+0000 7f8dcbba0700 1 --2- 172.21.15.63:0/351613256 >> v2:172.21.15.155:3300/0 conn(0x7f8dc4142340 0x7f8dc40afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:27.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.877+0000 7f8dcbba0700 1 -- 172.21.15.63:0/351613256 >> 172.21.15.63:0/351613256 conn(0x7f8dc40b9740 msgr2=0x7f8dc406a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:27.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.877+0000 7f8dcbba0700 1 -- 172.21.15.63:0/351613256 shutdown_connections 2020-05-18T21:27:27.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.877+0000 7f8dcbba0700 1 -- 172.21.15.63:0/351613256 wait complete. 2020-05-18T21:27:27.886 INFO:teuthology.orchestra.run.smithi063.stderr:updated 2020-05-18T21:27:27.896 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-rbd-mirror 2020-05-18T21:27:27.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.989+0000 7f55e4e12700 1 Processor -- start 2020-05-18T21:27:27.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.989+0000 7f55e4e12700 1 -- start start 2020-05-18T21:27:27.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.989+0000 7f55e4e12700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55e00b8ed0 0x7f55e0064860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:27.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.989+0000 7f55e4e12700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55e0064cc0 0x7f55e0149880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:27.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.989+0000 7f55e4e12700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e00b4b00 con 0x7f55e00b50b0 2020-05-18T21:27:27.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.989+0000 7f55e4e12700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e00622f0 con 0x7f55e0064cc0 2020-05-18T21:27:27.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.989+0000 7f55e4e12700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e0065ec0 con 0x7f55e00b8ed0 2020-05-18T21:27:27.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55ded9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55e0064cc0 0x7f55e0149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:27.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55ddd9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55e00b8ed0 0x7f55e0064860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:27.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55de59c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f55e00b50b0 0x7f55e0061be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:54472/0 (socket says 172.21.15.63:54472) 2020-05-18T21:27:28.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55ded9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55e0064cc0 0x7f55e0149880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:40586/0 (socket says 172.21.15.63:40586) 2020-05-18T21:27:28.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55de59c700 1 -- 172.21.15.63:0/1237179593 learned_addr learned my addr 172.21.15.63:0/1237179593 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:28.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55ddd9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55e00b8ed0 0x7f55e0064860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:44674/0 (socket says 172.21.15.63:44674) 2020-05-18T21:27:28.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55ded9d700 1 -- 172.21.15.63:0/1237179593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55e00b8ed0 msgr2=0x7f55e0064860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:28.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55ded9d700 1 --2- 172.21.15.63:0/1237179593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55e00b8ed0 0x7f55e0064860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:28.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55ded9d700 1 -- 172.21.15.63:0/1237179593 >> v1:172.21.15.155:6789/0 conn(0x7f55e00b50b0 legacy=0x7f55e0061be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55ded9d700 1 -- 172.21.15.63:0/1237179593 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e0066160 con 0x7f55e0064cc0 2020-05-18T21:27:28.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55ded9d700 1 --2- 172.21.15.63:0/1237179593 >> v2:172.21.15.155:3300/0 conn(0x7f55e0064cc0 0x7f55e0149880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f55d0002f70 tx=0x7f55d0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55ded9d700 1 --2- 172.21.15.63:0/1237179593 >> v2:172.21.15.155:3300/0 conn(0x7f55e0064cc0 0x7f55e0149880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f55d0002f70 tx=0x7f55d0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55ded9d700 1 --2- 172.21.15.63:0/1237179593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e0064cc0 0x7f55e0149880 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7f55d0002f70 tx=0x7f55d0007a80).ready entity=mon.1 client_cookie=c222dc1f74bad595 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:28.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55ded9d700 1 --2- 172.21.15.63:0/1237179593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e0064cc0 0x7f55e0149880 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f55d0002f70 tx=0x7f55d0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55dd59a700 1 -- 172.21.15.63:0/1237179593 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55d0008e80 con 0x7f55e0064cc0 2020-05-18T21:27:28.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55ded9d700 1 --2- 172.21.15.63:0/1237179593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e0064cc0 0x7f55e0149880 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f55d0002f70 tx=0x7f55d0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55dd59a700 1 -- 172.21.15.63:0/1237179593 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d00115f0 con 0x7f55e0064cc0 2020-05-18T21:27:28.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55ded9d700 1 --2- 172.21.15.63:0/1237179593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e0064cc0 0x7f55e0149880 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f55d0002f70 tx=0x7f55d0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55dd59a700 1 -- 172.21.15.63:0/1237179593 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55d0011a10 con 0x7f55e0064cc0 2020-05-18T21:27:28.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55e4e12700 1 -- 172.21.15.63:0/1237179593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e0064cc0 msgr2=0x7f55e0149880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55e4e12700 1 --2- 172.21.15.63:0/1237179593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e0064cc0 0x7f55e0149880 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7f55d0002f70 tx=0x7f55d0007a80).stop 2020-05-18T21:27:28.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55e4e12700 1 -- 172.21.15.63:0/1237179593 shutdown_connections 2020-05-18T21:27:28.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55e4e12700 1 --2- 172.21.15.63:0/1237179593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e0064cc0 0x7f55e0149880 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:28.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55e4e12700 1 --2- 172.21.15.63:0/1237179593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55e00b8ed0 0x7f55e0064860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:28.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55e4e12700 1 -- 172.21.15.63:0/1237179593 >> 172.21.15.63:0/1237179593 conn(0x7f55e00b83b0 msgr2=0x7f55e00b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:28.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55e4e12700 1 -- 172.21.15.63:0/1237179593 shutdown_connections 2020-05-18T21:27:28.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.993+0000 7f55e4e12700 1 -- 172.21.15.63:0/1237179593 wait complete. 2020-05-18T21:27:28.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.997+0000 7f55e4e12700 1 Processor -- start 2020-05-18T21:27:28.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.997+0000 7f55e4e12700 1 -- start start 2020-05-18T21:27:28.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.997+0000 7f55e4e12700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55e0064cc0 0x7f55e00b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:28.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.997+0000 7f55e4e12700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55e00b50b0 0x7f55e0158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:28.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.997+0000 7f55e4e12700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e0157bf0 con 0x7f55e00b8ed0 2020-05-18T21:27:28.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.997+0000 7f55e4e12700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e00b4320 con 0x7f55e00b50b0 2020-05-18T21:27:28.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.997+0000 7f55e4e12700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e0157a00 con 0x7f55e0064cc0 2020-05-18T21:27:28.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.997+0000 7f55ded9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f55e00b8ed0 0x7f55e00b7780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56166/0 (socket says 172.21.15.63:56166) 2020-05-18T21:27:28.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.997+0000 7f55ded9d700 1 -- 172.21.15.63:0/1487449867 learned_addr learned my addr 172.21.15.63:0/1487449867 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:28.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:27.997+0000 7f55de59c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55e0064cc0 0x7f55e00b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:28.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55ddd9b700 1 --2- 172.21.15.63:0/1487449867 >> v2:172.21.15.155:3300/0 conn(0x7f55e00b50b0 0x7f55e0158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:28.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55d77fe700 1 -- 172.21.15.63:0/1487449867 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105021589 0 0) 0x7f55e0157bf0 con 0x7f55e00b8ed0 2020-05-18T21:27:28.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55d77fe700 1 -- 172.21.15.63:0/1487449867 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55c4002fe0 con 0x7f55e00b8ed0 2020-05-18T21:27:28.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55d77fe700 1 -- 172.21.15.63:0/1487449867 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2590825761 0 0) 0x7f55c4002fe0 con 0x7f55e00b8ed0 2020-05-18T21:27:28.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55ddd9b700 1 -- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55e0064cc0 msgr2=0x7f55e00b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55ddd9b700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55e0064cc0 0x7f55e00b3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:28.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55ddd9b700 1 -- 172.21.15.63:0/1487449867 >> v1:172.21.15.63:6789/0 conn(0x7f55e00b8ed0 legacy=0x7f55e00b7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55ddd9b700 1 -- 172.21.15.63:0/1487449867 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e0157e90 con 0x7f55e00b50b0 2020-05-18T21:27:28.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55de59c700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55e0064cc0 0x7f55e00b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:28.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55ddd9b700 1 --2- 172.21.15.63:0/1487449867 >> v2:172.21.15.155:3300/0 conn(0x7f55e00b50b0 0x7f55e0158330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f55d0007b20 tx=0x7f55c8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55ddd9b700 1 --2- 172.21.15.63:0/1487449867 >> v2:172.21.15.155:3300/0 conn(0x7f55e00b50b0 0x7f55e0158330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f55d0007b20 tx=0x7f55c8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55ddd9b700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e00b50b0 0x7f55e0158330 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7f55d0007b20 tx=0x7f55c8010c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:28.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55ddd9b700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e00b50b0 0x7f55e0158330 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f55d0007b20 tx=0x7f55c8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55ddd9b700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e00b50b0 0x7f55e0158330 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f55d0007b20 tx=0x7f55c8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55d77fe700 1 -- 172.21.15.63:0/1487449867 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55d0008e80 con 0x7f55e00b50b0 2020-05-18T21:27:28.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55ddd9b700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e00b50b0 0x7f55e0158330 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f55d0007b20 tx=0x7f55c8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55d77fe700 1 -- 172.21.15.63:0/1487449867 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c800e750 con 0x7f55e00b50b0 2020-05-18T21:27:28.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55e4e12700 1 -- 172.21.15.63:0/1487449867 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e00b7e90 con 0x7f55e00b50b0 2020-05-18T21:27:28.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55d77fe700 1 -- 172.21.15.63:0/1487449867 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55c800eab0 con 0x7f55e00b50b0 2020-05-18T21:27:28.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55e4e12700 1 -- 172.21.15.63:0/1487449867 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e0158810 con 0x7f55e00b50b0 2020-05-18T21:27:28.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55ddd9b700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e00b50b0 0x7f55e0158330 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f55d0007b20 tx=0x7f55c8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55e4e12700 1 -- 172.21.15.63:0/1487449867 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e0158020 con 0x7f55e00b50b0 2020-05-18T21:27:28.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55d77fe700 1 -- 172.21.15.63:0/1487449867 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f55c800eca0 con 0x7f55e00b50b0 2020-05-18T21:27:28.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55ddd9b700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e00b50b0 0x7f55e0158330 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f55d0007b20 tx=0x7f55c8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.001+0000 7f55d77fe700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55c404fdb0 0x7f55c4052270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:28.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.005+0000 7f55d77fe700 1 -- 172.21.15.63:0/1487449867 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f55c8063350 con 0x7f55e00b50b0 2020-05-18T21:27:28.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.005+0000 7f55de59c700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55c404fdb0 0x7f55c4052270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:28.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.005+0000 7f55de59c700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55c404fdb0 0x7f55c4052270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f55e0064740 tx=0x7f55e005b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.005+0000 7f55de59c700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55c404fdb0 0x7f55c4052270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f55e0064740 tx=0x7f55e005b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.005+0000 7f55de59c700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55c404fdb0 0x7f55c4052270 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f55e0064740 tx=0x7f55e005b560).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:28.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.013+0000 7f55ddd9b700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e00b50b0 0x7f55e0158330 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f55d0007b20 tx=0x7f55c8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.013+0000 7f55d77fe700 1 -- 172.21.15.63:0/1487449867 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f55c803d680 con 0x7f55e00b50b0 2020-05-18T21:27:28.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.165+0000 7f55e4e12700 1 -- 172.21.15.63:0/1487449867 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f55e00569e0 con 0x7f55e00b50b0 2020-05-18T21:27:28.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.173+0000 7f55ddd9b700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e00b50b0 0x7f55e0158330 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f55d0007b20 tx=0x7f55c8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.177+0000 7f55d77fe700 1 -- 172.21.15.63:0/1487449867 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f55c8040ca0 con 0x7f55e00b50b0 2020-05-18T21:27:28.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.177+0000 7f55e4e12700 1 -- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55c404fdb0 msgr2=0x7f55c4052270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.177+0000 7f55e4e12700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55c404fdb0 0x7f55c4052270 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f55e0064740 tx=0x7f55e005b560).stop 2020-05-18T21:27:28.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.177+0000 7f55e4e12700 1 -- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e00b50b0 msgr2=0x7f55e0158330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.177+0000 7f55e4e12700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e00b50b0 0x7f55e0158330 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7f55d0007b20 tx=0x7f55c8010c10).stop 2020-05-18T21:27:28.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.177+0000 7f55e4e12700 1 -- 172.21.15.63:0/1487449867 shutdown_connections 2020-05-18T21:27:28.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.177+0000 7f55e4e12700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55c404fdb0 0x7f55c4052270 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:28.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.177+0000 7f55e4e12700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e00b50b0 0x7f55e0158330 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:28.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.177+0000 7f55e4e12700 1 --2- 172.21.15.63:0/1487449867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55e0064cc0 0x7f55e00b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:28.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.177+0000 7f55e4e12700 1 -- 172.21.15.63:0/1487449867 >> 172.21.15.63:0/1487449867 conn(0x7f55e00b83b0 msgr2=0x7f55e014a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:28.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.177+0000 7f55e4e12700 1 -- 172.21.15.63:0/1487449867 shutdown_connections 2020-05-18T21:27:28.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.177+0000 7f55e4e12700 1 -- 172.21.15.63:0/1487449867 wait complete. 2020-05-18T21:27:28.188 INFO:teuthology.orchestra.run.smithi063.stderr:updated 2020-05-18T21:27:28.200 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-rgw 2020-05-18T21:27:28.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.297+0000 7f5a396f3700 1 Processor -- start 2020-05-18T21:27:28.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.297+0000 7f5a396f3700 1 -- start start 2020-05-18T21:27:28.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a396f3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340ae240 0x7f5a340b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a396f3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a340b5260 0x7f5a341432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a396f3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a34064bd0 con 0x7f5a340b4e80 2020-05-18T21:27:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a396f3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a340b56f0 con 0x7f5a340b5260 2020-05-18T21:27:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a396f3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a34064e00 con 0x7f5a340ae240 2020-05-18T21:27:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a32ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5a340b4e80 0x7f5a340adb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56170/0 (socket says 172.21.15.63:56170) 2020-05-18T21:27:28.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a32ffd700 1 -- 172.21.15.63:0/454908120 learned_addr learned my addr 172.21.15.63:0/454908120 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:28.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a337fe700 1 --2- 172.21.15.63:0/454908120 >> v2:172.21.15.155:3300/0 conn(0x7f5a340b5260 0x7f5a341432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:28.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a327fc700 1 --2- 172.21.15.63:0/454908120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340ae240 0x7f5a340b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a31ffb700 1 -- 172.21.15.63:0/454908120 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807173991 0 0) 0x7f5a34064bd0 con 0x7f5a340b4e80 2020-05-18T21:27:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a31ffb700 1 -- 172.21.15.63:0/454908120 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a14003270 con 0x7f5a340b4e80 2020-05-18T21:27:28.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a337fe700 1 -- 172.21.15.63:0/454908120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340ae240 msgr2=0x7f5a340b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:28.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a337fe700 1 --2- 172.21.15.63:0/454908120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340ae240 0x7f5a340b8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:28.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a337fe700 1 -- 172.21.15.63:0/454908120 >> v1:172.21.15.63:6789/0 conn(0x7f5a340b4e80 legacy=0x7f5a340adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a337fe700 1 -- 172.21.15.63:0/454908120 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a340ad3f0 con 0x7f5a340b5260 2020-05-18T21:27:28.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a337fe700 1 --2- 172.21.15.63:0/454908120 >> v2:172.21.15.155:3300/0 conn(0x7f5a340b5260 0x7f5a341432c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5a2c0032f0 tx=0x7f5a2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a337fe700 1 --2- 172.21.15.63:0/454908120 >> v2:172.21.15.155:3300/0 conn(0x7f5a340b5260 0x7f5a341432c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5a2c0032f0 tx=0x7f5a2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a337fe700 1 --2- 172.21.15.63:0/454908120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a340b5260 0x7f5a341432c0 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7f5a2c0032f0 tx=0x7f5a2c007e00).ready entity=mon.1 client_cookie=bdb9650b364ee7a0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:28.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a337fe700 1 --2- 172.21.15.63:0/454908120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a340b5260 0x7f5a341432c0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f5a2c0032f0 tx=0x7f5a2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a31ffb700 1 -- 172.21.15.63:0/454908120 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a2c011db0 con 0x7f5a340b5260 2020-05-18T21:27:28.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a337fe700 1 --2- 172.21.15.63:0/454908120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a340b5260 0x7f5a341432c0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f5a2c0032f0 tx=0x7f5a2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a337fe700 1 --2- 172.21.15.63:0/454908120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a340b5260 0x7f5a341432c0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f5a2c0032f0 tx=0x7f5a2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a31ffb700 1 -- 172.21.15.63:0/454908120 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c00a180 con 0x7f5a340b5260 2020-05-18T21:27:28.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a31ffb700 1 -- 172.21.15.63:0/454908120 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a2c00a560 con 0x7f5a340b5260 2020-05-18T21:27:28.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a396f3700 1 -- 172.21.15.63:0/454908120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a340b5260 msgr2=0x7f5a341432c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a396f3700 1 --2- 172.21.15.63:0/454908120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a340b5260 0x7f5a341432c0 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7f5a2c0032f0 tx=0x7f5a2c007e00).stop 2020-05-18T21:27:28.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a396f3700 1 -- 172.21.15.63:0/454908120 shutdown_connections 2020-05-18T21:27:28.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a396f3700 1 --2- 172.21.15.63:0/454908120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a340b5260 0x7f5a341432c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:28.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a396f3700 1 --2- 172.21.15.63:0/454908120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340ae240 0x7f5a340b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:28.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a396f3700 1 -- 172.21.15.63:0/454908120 >> 172.21.15.63:0/454908120 conn(0x7f5a340b83b0 msgr2=0x7f5a340b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:28.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a396f3700 1 -- 172.21.15.63:0/454908120 shutdown_connections 2020-05-18T21:27:28.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.301+0000 7f5a396f3700 1 -- 172.21.15.63:0/454908120 wait complete. 2020-05-18T21:27:28.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.305+0000 7f5a396f3700 1 Processor -- start 2020-05-18T21:27:28.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.305+0000 7f5a396f3700 1 -- start start 2020-05-18T21:27:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.305+0000 7f5a396f3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340b4e80 0x7f5a34144460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.305+0000 7f5a396f3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3413b760 con 0x7f5a340b5260 2020-05-18T21:27:28.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.305+0000 7f5a396f3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a341448c0 con 0x7f5a340ae240 2020-05-18T21:27:28.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.305+0000 7f5a396f3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a341495a0 con 0x7f5a340b4e80 2020-05-18T21:27:28.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.305+0000 7f5a337fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5a340b5260 0x7f5a34148b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56180/0 (socket says 172.21.15.63:56180) 2020-05-18T21:27:28.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.305+0000 7f5a337fe700 1 -- 172.21.15.63:0/1232351605 learned_addr learned my addr 172.21.15.63:0/1232351605 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:28.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.305+0000 7f5a327fc700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340b4e80 0x7f5a34144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:28.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.305+0000 7f5a2bfff700 1 -- 172.21.15.63:0/1232351605 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269561510 0 0) 0x7f5a3413b760 con 0x7f5a340b5260 2020-05-18T21:27:28.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.305+0000 7f5a2bfff700 1 -- 172.21.15.63:0/1232351605 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a18002fe0 con 0x7f5a340b5260 2020-05-18T21:27:28.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.305+0000 7f5a2bfff700 1 -- 172.21.15.63:0/1232351605 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1292543315 0 0) 0x7f5a341448c0 con 0x7f5a340ae240 2020-05-18T21:27:28.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.305+0000 7f5a2bfff700 1 -- 172.21.15.63:0/1232351605 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a3413b760 con 0x7f5a340ae240 2020-05-18T21:27:28.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a327fc700 1 -- 172.21.15.63:0/1232351605 >> v1:172.21.15.155:6789/0 conn(0x7f5a340ae240 legacy=0x7f5a3413be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a327fc700 1 -- 172.21.15.63:0/1232351605 >> v1:172.21.15.63:6789/0 conn(0x7f5a340b5260 legacy=0x7f5a34148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a327fc700 1 -- 172.21.15.63:0/1232351605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3413b990 con 0x7f5a340b4e80 2020-05-18T21:27:28.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a327fc700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340b4e80 0x7f5a34144460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a1c002f70 tx=0x7f5a1c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a327fc700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340b4e80 0x7f5a34144460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a1c002f70 tx=0x7f5a1c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a327fc700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340b4e80 0x7f5a34144460 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f5a1c002f70 tx=0x7f5a1c010c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:28.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a327fc700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340b4e80 0x7f5a34144460 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f5a1c002f70 tx=0x7f5a1c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a2bfff700 1 -- 172.21.15.63:0/1232351605 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a1c007550 con 0x7f5a340b4e80 2020-05-18T21:27:28.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a327fc700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340b4e80 0x7f5a34144460 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f5a1c002f70 tx=0x7f5a1c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a2bfff700 1 -- 172.21.15.63:0/1232351605 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1c005700 con 0x7f5a340b4e80 2020-05-18T21:27:28.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a327fc700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340b4e80 0x7f5a34144460 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f5a1c002f70 tx=0x7f5a1c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a396f3700 1 -- 172.21.15.63:0/1232351605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a34149210 con 0x7f5a340b4e80 2020-05-18T21:27:28.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a2bfff700 1 -- 172.21.15.63:0/1232351605 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a1c005a60 con 0x7f5a340b4e80 2020-05-18T21:27:28.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a396f3700 1 -- 172.21.15.63:0/1232351605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a34153770 con 0x7f5a340b4e80 2020-05-18T21:27:28.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a327fc700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340b4e80 0x7f5a34144460 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f5a1c002f70 tx=0x7f5a1c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a396f3700 1 -- 172.21.15.63:0/1232351605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a34149400 con 0x7f5a340b4e80 2020-05-18T21:27:28.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a2bfff700 1 -- 172.21.15.63:0/1232351605 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5a1c005c60 con 0x7f5a340b4e80 2020-05-18T21:27:28.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a327fc700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340b4e80 0x7f5a34144460 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f5a1c002f70 tx=0x7f5a1c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a2bfff700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a1804fe80 0x7f5a18052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:28.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a2bfff700 1 -- 172.21.15.63:0/1232351605 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5a1c063e20 con 0x7f5a340b4e80 2020-05-18T21:27:28.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.309+0000 7f5a32ffd700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a1804fe80 0x7f5a18052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:28.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.313+0000 7f5a32ffd700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a1804fe80 0x7f5a18052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a24001440 tx=0x7f5a3405b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.313+0000 7f5a32ffd700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a1804fe80 0x7f5a18052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a24001440 tx=0x7f5a3405b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.313+0000 7f5a32ffd700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a1804fe80 0x7f5a18052340 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f5a24001440 tx=0x7f5a3405b560).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:28.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.317+0000 7f5a327fc700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340b4e80 0x7f5a34144460 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f5a1c002f70 tx=0x7f5a1c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.317+0000 7f5a2bfff700 1 -- 172.21.15.63:0/1232351605 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f5a34149400 con 0x7f5a340b4e80 2020-05-18T21:27:28.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.473+0000 7f5a396f3700 1 -- 172.21.15.63:0/1232351605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f5a341493a0 con 0x7f5a340b4e80 2020-05-18T21:27:28.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.481+0000 7f5a327fc700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340b4e80 0x7f5a34144460 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f5a1c002f70 tx=0x7f5a1c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.481+0000 7f5a2bfff700 1 -- 172.21.15.63:0/1232351605 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5a1c03e150 con 0x7f5a340b4e80 2020-05-18T21:27:28.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.485+0000 7f5a396f3700 1 -- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a1804fe80 msgr2=0x7f5a18052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.485+0000 7f5a396f3700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a1804fe80 0x7f5a18052340 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f5a24001440 tx=0x7f5a3405b560).stop 2020-05-18T21:27:28.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.485+0000 7f5a396f3700 1 -- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340b4e80 msgr2=0x7f5a34144460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.485+0000 7f5a396f3700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340b4e80 0x7f5a34144460 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f5a1c002f70 tx=0x7f5a1c010c10).stop 2020-05-18T21:27:28.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.485+0000 7f5a396f3700 1 -- 172.21.15.63:0/1232351605 shutdown_connections 2020-05-18T21:27:28.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.485+0000 7f5a396f3700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a1804fe80 0x7f5a18052340 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:28.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.485+0000 7f5a396f3700 1 --2- 172.21.15.63:0/1232351605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a340b4e80 0x7f5a34144460 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:28.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.485+0000 7f5a396f3700 1 -- 172.21.15.63:0/1232351605 >> 172.21.15.63:0/1232351605 conn(0x7f5a340b83b0 msgr2=0x7f5a34142770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:28.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.485+0000 7f5a396f3700 1 -- 172.21.15.63:0/1232351605 shutdown_connections 2020-05-18T21:27:28.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.485+0000 7f5a396f3700 1 -- 172.21.15.63:0/1232351605 wait complete. 2020-05-18T21:27:28.495 INFO:teuthology.orchestra.run.smithi063.stderr:updated 2020-05-18T21:27:28.506 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:27:28.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.601+0000 7f7caf581700 1 Processor -- start 2020-05-18T21:27:28.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.601+0000 7f7caf581700 1 -- start start 2020-05-18T21:27:28.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.601+0000 7f7caf581700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7ca805f110 0x7f7ca80acea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:28.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.601+0000 7f7caf581700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7ca813c710 0x7f7ca813cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:28.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.601+0000 7f7caf581700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca813cfa0 con 0x7f7ca80659d0 2020-05-18T21:27:28.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.601+0000 7f7caf581700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca80b4af0 con 0x7f7ca805f110 2020-05-18T21:27:28.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.601+0000 7f7caf581700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca81460e0 con 0x7f7ca813c710 2020-05-18T21:27:28.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7cae57f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7ca805f110 0x7f7ca80acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:28.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7cadd7e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7ca80659d0 0x7f7ca8146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56184/0 (socket says 172.21.15.63:56184) 2020-05-18T21:27:28.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7cadd7e700 1 -- 172.21.15.63:0/3771508980 learned_addr learned my addr 172.21.15.63:0/3771508980 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:28.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7caed80700 1 --2- 172.21.15.63:0/3771508980 >> v2:172.21.15.155:3300/0 conn(0x7f7ca813c710 0x7f7ca813cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:28.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7cae57f700 1 -- 172.21.15.63:0/3771508980 >> v2:172.21.15.155:3300/0 conn(0x7f7ca813c710 msgr2=0x7f7ca813cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:28.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7cae57f700 1 --2- 172.21.15.63:0/3771508980 >> v2:172.21.15.155:3300/0 conn(0x7f7ca813c710 0x7f7ca813cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:28.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7cae57f700 1 -- 172.21.15.63:0/3771508980 >> v1:172.21.15.63:6789/0 conn(0x7f7ca80659d0 legacy=0x7f7ca8146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7cae57f700 1 -- 172.21.15.63:0/3771508980 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca8146380 con 0x7f7ca805f110 2020-05-18T21:27:28.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7caed80700 1 --2- 172.21.15.63:0/3771508980 >> v2:172.21.15.155:3300/0 conn(0x7f7ca813c710 0x7f7ca813cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:27:28.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7cae57f700 1 --2- 172.21.15.63:0/3771508980 >> v2:172.21.15.63:3300/0 conn(0x7f7ca805f110 0x7f7ca80acea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7ca4002f70 tx=0x7f7ca4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7cae57f700 1 --2- 172.21.15.63:0/3771508980 >> v2:172.21.15.63:3300/0 conn(0x7f7ca805f110 0x7f7ca80acea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7ca4002f70 tx=0x7f7ca4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7cae57f700 1 --2- 172.21.15.63:0/3771508980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca805f110 0x7f7ca80acea0 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f7ca4002f70 tx=0x7f7ca4007a80).ready entity=mon.0 client_cookie=e5c019b836b454fd server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:28.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7cae57f700 1 --2- 172.21.15.63:0/3771508980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca805f110 0x7f7ca80acea0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f7ca4002f70 tx=0x7f7ca4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7cae57f700 1 --2- 172.21.15.63:0/3771508980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca805f110 0x7f7ca80acea0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f7ca4002f70 tx=0x7f7ca4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7cae57f700 1 --2- 172.21.15.63:0/3771508980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca805f110 0x7f7ca80acea0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f7ca4002f70 tx=0x7f7ca4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7cad57d700 1 -- 172.21.15.63:0/3771508980 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ca4008e50 con 0x7f7ca805f110 2020-05-18T21:27:28.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7cad57d700 1 -- 172.21.15.63:0/3771508980 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca40116a0 con 0x7f7ca805f110 2020-05-18T21:27:28.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7cad57d700 1 -- 172.21.15.63:0/3771508980 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ca4011ac0 con 0x7f7ca805f110 2020-05-18T21:27:28.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7caf581700 1 -- 172.21.15.63:0/3771508980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca805f110 msgr2=0x7f7ca80acea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7caf581700 1 --2- 172.21.15.63:0/3771508980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca805f110 0x7f7ca80acea0 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f7ca4002f70 tx=0x7f7ca4007a80).stop 2020-05-18T21:27:28.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7caf581700 1 -- 172.21.15.63:0/3771508980 shutdown_connections 2020-05-18T21:27:28.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7caf581700 1 --2- 172.21.15.63:0/3771508980 >> v2:172.21.15.155:3300/0 conn(0x7f7ca813c710 0x7f7ca813cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:28.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7caf581700 1 --2- 172.21.15.63:0/3771508980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca805f110 0x7f7ca80acea0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:28.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7caf581700 1 -- 172.21.15.63:0/3771508980 >> 172.21.15.63:0/3771508980 conn(0x7f7ca8069fc0 msgr2=0x7f7ca806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:28.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7caf581700 1 -- 172.21.15.63:0/3771508980 shutdown_connections 2020-05-18T21:27:28.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7caf581700 1 -- 172.21.15.63:0/3771508980 wait complete. 2020-05-18T21:27:28.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7caf581700 1 Processor -- start 2020-05-18T21:27:28.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.605+0000 7f7caf581700 1 -- start start 2020-05-18T21:27:28.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caf581700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ca805f110 0x7f7ca80af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:28.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caf581700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7ca80659d0 0x7f7ca8133de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:28.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caf581700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7ca813c710 0x7f7ca80b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:28.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caf581700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca80b2100 con 0x7f7ca813c710 2020-05-18T21:27:28.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caf581700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca8134240 con 0x7f7ca80659d0 2020-05-18T21:27:28.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caf581700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca8141680 con 0x7f7ca805f110 2020-05-18T21:27:28.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caed80700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7ca813c710 0x7f7ca80b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:28.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caed80700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7ca813c710 0x7f7ca80b19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54004/0 (socket says 172.21.15.63:54004) 2020-05-18T21:27:28.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caed80700 1 -- 172.21.15.63:0/2087224925 learned_addr learned my addr 172.21.15.63:0/2087224925 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:28.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7cae57f700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ca805f110 0x7f7ca80af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:28.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7cadd7e700 1 --2- 172.21.15.63:0/2087224925 >> v2:172.21.15.155:3300/0 conn(0x7f7ca80659d0 0x7f7ca8133de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:28.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caed80700 1 -- 172.21.15.63:0/2087224925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ca805f110 msgr2=0x7f7ca80af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caed80700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ca805f110 0x7f7ca80af790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:28.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caed80700 1 -- 172.21.15.63:0/2087224925 >> v2:172.21.15.155:3300/0 conn(0x7f7ca80659d0 msgr2=0x7f7ca8133de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caed80700 1 --2- 172.21.15.63:0/2087224925 >> v2:172.21.15.155:3300/0 conn(0x7f7ca80659d0 0x7f7ca8133de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:28.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caed80700 1 -- 172.21.15.63:0/2087224925 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca8141920 con 0x7f7ca813c710 2020-05-18T21:27:28.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7cae57f700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ca805f110 0x7f7ca80af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:27:28.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caed80700 1 --2- 172.21.15.63:0/2087224925 >> v2:172.21.15.63:3300/0 conn(0x7f7ca813c710 0x7f7ca80b19f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7ca00032f0 tx=0x7f7ca0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caed80700 1 --2- 172.21.15.63:0/2087224925 >> v2:172.21.15.63:3300/0 conn(0x7f7ca813c710 0x7f7ca80b19f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7ca00032f0 tx=0x7f7ca0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caed80700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca813c710 0x7f7ca80b19f0 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7f7ca00032f0 tx=0x7f7ca0010ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:28.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caed80700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca813c710 0x7f7ca80b19f0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f7ca00032f0 tx=0x7f7ca0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7c977fe700 1 -- 172.21.15.63:0/2087224925 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ca0005e70 con 0x7f7ca813c710 2020-05-18T21:27:28.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caed80700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca813c710 0x7f7ca80b19f0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f7ca00032f0 tx=0x7f7ca0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7c977fe700 1 -- 172.21.15.63:0/2087224925 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca0007560 con 0x7f7ca813c710 2020-05-18T21:27:28.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caed80700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca813c710 0x7f7ca80b19f0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f7ca00032f0 tx=0x7f7ca0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caf581700 1 -- 172.21.15.63:0/2087224925 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca80b1e50 con 0x7f7ca813c710 2020-05-18T21:27:28.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7c977fe700 1 -- 172.21.15.63:0/2087224925 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ca0007900 con 0x7f7ca813c710 2020-05-18T21:27:28.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caf581700 1 -- 172.21.15.63:0/2087224925 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca81536e0 con 0x7f7ca813c710 2020-05-18T21:27:28.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caed80700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca813c710 0x7f7ca80b19f0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f7ca00032f0 tx=0x7f7ca0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7c977fe700 1 -- 172.21.15.63:0/2087224925 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7ca00101a0 con 0x7f7ca813c710 2020-05-18T21:27:28.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.609+0000 7f7caed80700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca813c710 0x7f7ca80b19f0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f7ca00032f0 tx=0x7f7ca0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.613+0000 7f7caf581700 1 -- 172.21.15.63:0/2087224925 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca80569e0 con 0x7f7ca813c710 2020-05-18T21:27:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.613+0000 7f7c977fe700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c8804f950 0x7f7c88051e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.613+0000 7f7c977fe700 1 -- 172.21.15.63:0/2087224925 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7ca0063ec0 con 0x7f7ca813c710 2020-05-18T21:27:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.613+0000 7f7cae57f700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c8804f950 0x7f7c88051e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.613+0000 7f7cae57f700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c8804f950 0x7f7c88051e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7ca4002f70 tx=0x7f7ca4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.613+0000 7f7cae57f700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c8804f950 0x7f7c88051e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7ca4002f70 tx=0x7f7ca4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.613+0000 7f7cae57f700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c8804f950 0x7f7c88051e10 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f7ca4002f70 tx=0x7f7ca4007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:28.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.617+0000 7f7caed80700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca813c710 0x7f7ca80b19f0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f7ca00032f0 tx=0x7f7ca0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.617+0000 7f7c977fe700 1 -- 172.21.15.63:0/2087224925 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f7ca003e1f0 con 0x7f7ca813c710 2020-05-18T21:27:28.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.733+0000 7f7caf581700 1 -- 172.21.15.63:0/2087224925 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ca80623b0 con 0x7f7ca813c710 2020-05-18T21:27:28.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.737+0000 7f7caed80700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca813c710 0x7f7ca80b19f0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f7ca00032f0 tx=0x7f7ca0010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.737+0000 7f7c977fe700 1 -- 172.21.15.63:0/2087224925 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+13232 (secure 0 0 0) 0x7f7ca0041810 con 0x7f7ca813c710 2020-05-18T21:27:28.742 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:28.743 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:27:26.348483+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:27:28.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.737+0000 7f7caf581700 1 -- 172.21.15.63:0/2087224925 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c8804f950 msgr2=0x7f7c88051e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.737+0000 7f7caf581700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c8804f950 0x7f7c88051e10 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f7ca4002f70 tx=0x7f7ca4007a80).stop 2020-05-18T21:27:28.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.737+0000 7f7caf581700 1 -- 172.21.15.63:0/2087224925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca813c710 msgr2=0x7f7ca80b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.737+0000 7f7caf581700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca813c710 0x7f7ca80b19f0 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7f7ca00032f0 tx=0x7f7ca0010ec0).stop 2020-05-18T21:27:28.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.737+0000 7f7caf581700 1 -- 172.21.15.63:0/2087224925 shutdown_connections 2020-05-18T21:27:28.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.737+0000 7f7caf581700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c8804f950 0x7f7c88051e10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:28.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.737+0000 7f7caf581700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca813c710 0x7f7ca80b19f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:28.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.737+0000 7f7caf581700 1 --2- 172.21.15.63:0/2087224925 >> v2:172.21.15.155:3300/0 conn(0x7f7ca80659d0 0x7f7ca8133de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:28.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.737+0000 7f7caf581700 1 --2- 172.21.15.63:0/2087224925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ca805f110 0x7f7ca80af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:28.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.737+0000 7f7caf581700 1 -- 172.21.15.63:0/2087224925 >> 172.21.15.63:0/2087224925 conn(0x7f7ca8069fc0 msgr2=0x7f7ca8061be0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:28.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.737+0000 7f7caf581700 1 -- 172.21.15.63:0/2087224925 shutdown_connections 2020-05-18T21:27:28.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.737+0000 7f7caf581700 1 -- 172.21.15.63:0/2087224925 wait complete. 2020-05-18T21:27:28.755 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-05-18T21:27:28.757 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:27:28.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.857+0000 7ff2d8bd2700 1 Processor -- start 2020-05-18T21:27:28.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.857+0000 7ff2d8bd2700 1 -- start start 2020-05-18T21:27:28.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.857+0000 7ff2d8bd2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2d40b5930 0x7ff2d412b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:28.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.857+0000 7ff2d8bd2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff2d412bd60 0x7ff2d40b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:28.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.857+0000 7ff2d8bd2700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d412c1f0 con 0x7ff2d40b4f60 2020-05-18T21:27:28.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.857+0000 7ff2d8bd2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d4149630 con 0x7ff2d412bd60 2020-05-18T21:27:28.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.857+0000 7ff2d8bd2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4145e60 con 0x7ff2d40b5930 2020-05-18T21:27:28.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.857+0000 7ff2d37fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff2d40b4f60 0x7ff2d41465a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56198/0 (socket says 172.21.15.63:56198) 2020-05-18T21:27:28.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.857+0000 7ff2d37fe700 1 -- 172.21.15.63:0/2579128334 learned_addr learned my addr 172.21.15.63:0/2579128334 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:28.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.857+0000 7ff2d3fff700 1 --2- 172.21.15.63:0/2579128334 >> v2:172.21.15.155:3300/0 conn(0x7ff2d412bd60 0x7ff2d40b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:28.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.857+0000 7ff2d2ffd700 1 --2- 172.21.15.63:0/2579128334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2d40b5930 0x7ff2d412b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:28.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.857+0000 7ff2d27fc700 1 -- 172.21.15.63:0/2579128334 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179200928 0 0) 0x7ff2d412c1f0 con 0x7ff2d40b4f60 2020-05-18T21:27:28.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d27fc700 1 -- 172.21.15.63:0/2579128334 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2c0003270 con 0x7ff2d40b4f60 2020-05-18T21:27:28.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d3fff700 1 -- 172.21.15.63:0/2579128334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2d40b5930 msgr2=0x7ff2d412b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:28.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d3fff700 1 --2- 172.21.15.63:0/2579128334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2d40b5930 0x7ff2d412b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:28.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d3fff700 1 -- 172.21.15.63:0/2579128334 >> v1:172.21.15.63:6789/0 conn(0x7ff2d40b4f60 legacy=0x7ff2d41465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d3fff700 1 -- 172.21.15.63:0/2579128334 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d4146100 con 0x7ff2d412bd60 2020-05-18T21:27:28.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d3fff700 1 --2- 172.21.15.63:0/2579128334 >> v2:172.21.15.155:3300/0 conn(0x7ff2d412bd60 0x7ff2d40b2890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff2cc0032f0 tx=0x7ff2cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d3fff700 1 --2- 172.21.15.63:0/2579128334 >> v2:172.21.15.155:3300/0 conn(0x7ff2d412bd60 0x7ff2d40b2890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff2cc0032f0 tx=0x7ff2cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d3fff700 1 --2- 172.21.15.63:0/2579128334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2d412bd60 0x7ff2d40b2890 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7ff2cc0032f0 tx=0x7ff2cc007e00).ready entity=mon.1 client_cookie=6d31ec999c82a91f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:28.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d3fff700 1 --2- 172.21.15.63:0/2579128334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2d412bd60 0x7ff2d40b2890 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7ff2cc0032f0 tx=0x7ff2cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d27fc700 1 -- 172.21.15.63:0/2579128334 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2cc011db0 con 0x7ff2d412bd60 2020-05-18T21:27:28.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d3fff700 1 --2- 172.21.15.63:0/2579128334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2d412bd60 0x7ff2d40b2890 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7ff2cc0032f0 tx=0x7ff2cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d3fff700 1 --2- 172.21.15.63:0/2579128334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2d412bd60 0x7ff2d40b2890 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7ff2cc0032f0 tx=0x7ff2cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d27fc700 1 -- 172.21.15.63:0/2579128334 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc00a180 con 0x7ff2d412bd60 2020-05-18T21:27:28.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d27fc700 1 -- 172.21.15.63:0/2579128334 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2cc00a560 con 0x7ff2d412bd60 2020-05-18T21:27:28.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d8bd2700 1 -- 172.21.15.63:0/2579128334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2d412bd60 msgr2=0x7ff2d40b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d8bd2700 1 --2- 172.21.15.63:0/2579128334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2d412bd60 0x7ff2d40b2890 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7ff2cc0032f0 tx=0x7ff2cc007e00).stop 2020-05-18T21:27:28.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d8bd2700 1 -- 172.21.15.63:0/2579128334 shutdown_connections 2020-05-18T21:27:28.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d8bd2700 1 --2- 172.21.15.63:0/2579128334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2d412bd60 0x7ff2d40b2890 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:28.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d8bd2700 1 --2- 172.21.15.63:0/2579128334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2d40b5930 0x7ff2d412b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:28.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d8bd2700 1 -- 172.21.15.63:0/2579128334 >> 172.21.15.63:0/2579128334 conn(0x7ff2d405fbd0 msgr2=0x7ff2d4069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:28.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d8bd2700 1 -- 172.21.15.63:0/2579128334 shutdown_connections 2020-05-18T21:27:28.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.861+0000 7ff2d8bd2700 1 -- 172.21.15.63:0/2579128334 wait complete. 2020-05-18T21:27:28.876 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:27:28.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.865+0000 7ff2d8bd2700 1 Processor -- start 2020-05-18T21:27:28.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.865+0000 7ff2d8bd2700 1 -- start start 2020-05-18T21:27:28.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.865+0000 7ff2d8bd2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff2d40b4f60 0x7ff2d4112120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:28.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.865+0000 7ff2d8bd2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2d40b5930 0x7ff2d40b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:28.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.865+0000 7ff2d8bd2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d4157470 con 0x7ff2d412bd60 2020-05-18T21:27:28.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.865+0000 7ff2d8bd2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d4157710 con 0x7ff2d40b4f60 2020-05-18T21:27:28.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.865+0000 7ff2d8bd2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4111c80 con 0x7ff2d40b5930 2020-05-18T21:27:28.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.865+0000 7ff2d37fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff2d40b4f60 0x7ff2d4112120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:28.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.865+0000 7ff2d2ffd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2d40b5930 0x7ff2d40b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:28.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.865+0000 7ff2d37fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff2d40b4f60 0x7ff2d4112120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:40632/0 (socket says 172.21.15.63:40632) 2020-05-18T21:27:28.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.865+0000 7ff2d2ffd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2d40b5930 0x7ff2d40b09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:44720/0 (socket says 172.21.15.63:44720) 2020-05-18T21:27:28.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.865+0000 7ff2d37fe700 1 -- 172.21.15.63:0/515454165 learned_addr learned my addr 172.21.15.63:0/515454165 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:28.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d37fe700 1 -- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2d40b5930 msgr2=0x7ff2d40b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d37fe700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2d40b5930 0x7ff2d40b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:28.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d37fe700 1 -- 172.21.15.63:0/515454165 >> v1:172.21.15.155:6789/0 conn(0x7ff2d412bd60 legacy=0x7ff2d4156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:28.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d37fe700 1 -- 172.21.15.63:0/515454165 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d40b1b70 con 0x7ff2d40b4f60 2020-05-18T21:27:28.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d2ffd700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2d40b5930 0x7ff2d40b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:28.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d37fe700 1 --2- 172.21.15.63:0/515454165 >> v2:172.21.15.155:3300/0 conn(0x7ff2d40b4f60 0x7ff2d4112120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff2d4114830 tx=0x7ff2c80109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d37fe700 1 --2- 172.21.15.63:0/515454165 >> v2:172.21.15.155:3300/0 conn(0x7ff2d40b4f60 0x7ff2d4112120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff2d4114830 tx=0x7ff2c80109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d37fe700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2d40b4f60 0x7ff2d4112120 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7ff2d4114830 tx=0x7ff2c80109d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:28.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d37fe700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2d40b4f60 0x7ff2d4112120 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7ff2d4114830 tx=0x7ff2c80109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d0ff9700 1 -- 172.21.15.63:0/515454165 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2c8005d00 con 0x7ff2d40b4f60 2020-05-18T21:27:28.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d37fe700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2d40b4f60 0x7ff2d4112120 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7ff2d4114830 tx=0x7ff2c80109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d37fe700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2d40b4f60 0x7ff2d4112120 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7ff2d4114830 tx=0x7ff2c80109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d0ff9700 1 -- 172.21.15.63:0/515454165 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c8005e60 con 0x7ff2d40b4f60 2020-05-18T21:27:28.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d8bd2700 1 -- 172.21.15.63:0/515454165 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d4152800 con 0x7ff2d40b4f60 2020-05-18T21:27:28.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d0ff9700 1 -- 172.21.15.63:0/515454165 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2c80062c0 con 0x7ff2d40b4f60 2020-05-18T21:27:28.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d8bd2700 1 -- 172.21.15.63:0/515454165 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d4152cb0 con 0x7ff2d40b4f60 2020-05-18T21:27:28.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d8bd2700 1 -- 172.21.15.63:0/515454165 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d40b1dc0 con 0x7ff2d40b4f60 2020-05-18T21:27:28.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d37fe700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2d40b4f60 0x7ff2d4112120 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7ff2d4114830 tx=0x7ff2c80109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d0ff9700 1 -- 172.21.15.63:0/515454165 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff2c8006530 con 0x7ff2d40b4f60 2020-05-18T21:27:28.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.869+0000 7ff2d37fe700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2d40b4f60 0x7ff2d4112120 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7ff2d4114830 tx=0x7ff2c80109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.873+0000 7ff2d0ff9700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff2b404fa10 0x7ff2b4051ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:28.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.873+0000 7ff2d0ff9700 1 -- 172.21.15.63:0/515454165 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff2c80090c0 con 0x7ff2d40b4f60 2020-05-18T21:27:28.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.873+0000 7ff2d2ffd700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff2b404fa10 0x7ff2b4051ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:28.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.873+0000 7ff2d2ffd700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff2b404fa10 0x7ff2b4051ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff2c4002f70 tx=0x7ff2c4007c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.873+0000 7ff2d2ffd700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff2b404fa10 0x7ff2b4051ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff2c4002f70 tx=0x7ff2c4007c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.873+0000 7ff2d2ffd700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff2b404fa10 0x7ff2b4051ed0 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7ff2c4002f70 tx=0x7ff2c4007c90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:28.886 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:27:28.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.877+0000 7ff2d37fe700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2d40b4f60 0x7ff2d4112120 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7ff2d4114830 tx=0x7ff2c80109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:28.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:28.877+0000 7ff2d0ff9700 1 -- 172.21.15.63:0/515454165 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff2c803e0a0 con 0x7ff2d40b4f60 2020-05-18T21:27:29.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.001+0000 7ff2d8bd2700 1 -- 172.21.15.63:0/515454165 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff2d40569e0 con 0x7ff2d40b4f60 2020-05-18T21:27:29.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.001+0000 7ff2d37fe700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2d40b4f60 0x7ff2d4112120 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7ff2d4114830 tx=0x7ff2c80109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.001+0000 7ff2d0ff9700 1 -- 172.21.15.63:0/515454165 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v29) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff2c80416c0 con 0x7ff2d40b4f60 2020-05-18T21:27:29.009 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:27:29.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.005+0000 7ff2d8bd2700 1 -- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff2b404fa10 msgr2=0x7ff2b4051ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:29.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.005+0000 7ff2d8bd2700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff2b404fa10 0x7ff2b4051ed0 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7ff2c4002f70 tx=0x7ff2c4007c90).stop 2020-05-18T21:27:29.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.005+0000 7ff2d8bd2700 1 -- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2d40b4f60 msgr2=0x7ff2d4112120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:29.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.005+0000 7ff2d8bd2700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2d40b4f60 0x7ff2d4112120 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7ff2d4114830 tx=0x7ff2c80109d0).stop 2020-05-18T21:27:29.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.005+0000 7ff2d8bd2700 1 -- 172.21.15.63:0/515454165 shutdown_connections 2020-05-18T21:27:29.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.005+0000 7ff2d8bd2700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff2b404fa10 0x7ff2b4051ed0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:29.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.005+0000 7ff2d8bd2700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2d40b5930 0x7ff2d40b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:29.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.005+0000 7ff2d8bd2700 1 --2- 172.21.15.63:0/515454165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2d40b4f60 0x7ff2d4112120 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:29.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.005+0000 7ff2d8bd2700 1 -- 172.21.15.63:0/515454165 >> 172.21.15.63:0/515454165 conn(0x7ff2d405fbd0 msgr2=0x7ff2d4148a50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:29.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.005+0000 7ff2d8bd2700 1 -- 172.21.15.63:0/515454165 shutdown_connections 2020-05-18T21:27:29.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.005+0000 7ff2d8bd2700 1 -- 172.21.15.63:0/515454165 wait complete. 2020-05-18T21:27:29.027 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:27:29.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.129+0000 7fed4f982700 1 Processor -- start 2020-05-18T21:27:29.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4f982700 1 -- start start 2020-05-18T21:27:29.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4f982700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed480b9500 0x7fed480b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:29.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4f982700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fed480b6d90 0x7fed48061270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:29.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4f982700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fed480616d0 0x7fed480b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:29.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4f982700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed480b7ec0 con 0x7fed480616d0 2020-05-18T21:27:29.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4f982700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed48060660 con 0x7fed480b6d90 2020-05-18T21:27:29.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4f982700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed48060890 con 0x7fed480b9500 2020-05-18T21:27:29.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4df1f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fed480616d0 0x7fed480b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:29.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4df1f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fed480616d0 0x7fed480b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54028/0 (socket says 172.21.15.63:54028) 2020-05-18T21:27:29.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4df1f700 1 -- 172.21.15.63:0/500319002 learned_addr learned my addr 172.21.15.63:0/500319002 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:29.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4cf1d700 1 --2- 172.21.15.63:0/500319002 >> v2:172.21.15.155:3300/0 conn(0x7fed480b6d90 0x7fed48061270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:29.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4d71e700 1 --2- 172.21.15.63:0/500319002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed480b9500 0x7fed480b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:29.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4df1f700 1 -- 172.21.15.63:0/500319002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed480b9500 msgr2=0x7fed480b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:29.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4df1f700 1 --2- 172.21.15.63:0/500319002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed480b9500 0x7fed480b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:29.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4df1f700 1 -- 172.21.15.63:0/500319002 >> v2:172.21.15.155:3300/0 conn(0x7fed480b6d90 msgr2=0x7fed48061270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:29.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4df1f700 1 --2- 172.21.15.63:0/500319002 >> v2:172.21.15.155:3300/0 conn(0x7fed480b6d90 0x7fed48061270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:29.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4df1f700 1 -- 172.21.15.63:0/500319002 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed48060b30 con 0x7fed480616d0 2020-05-18T21:27:29.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4df1f700 1 --2- 172.21.15.63:0/500319002 >> v2:172.21.15.63:3300/0 conn(0x7fed480616d0 0x7fed480b42b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fed4806ab40 tx=0x7fed40008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4df1f700 1 --2- 172.21.15.63:0/500319002 >> v2:172.21.15.63:3300/0 conn(0x7fed480616d0 0x7fed480b42b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fed4806ab40 tx=0x7fed40008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4df1f700 1 --2- 172.21.15.63:0/500319002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed480616d0 0x7fed480b42b0 secure :-1 s=READY pgs=335 cs=0 l=1 rx=0x7fed4806ab40 tx=0x7fed40008ca0).ready entity=mon.0 client_cookie=67bcba190fca48e1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:29.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4df1f700 1 --2- 172.21.15.63:0/500319002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed480616d0 0x7fed480b42b0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fed4806ab40 tx=0x7fed40008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed3bfff700 1 -- 172.21.15.63:0/500319002 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed40011c20 con 0x7fed480616d0 2020-05-18T21:27:29.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4df1f700 1 --2- 172.21.15.63:0/500319002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed480616d0 0x7fed480b42b0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fed4806ab40 tx=0x7fed40008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed3bfff700 1 -- 172.21.15.63:0/500319002 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed40011d80 con 0x7fed480616d0 2020-05-18T21:27:29.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4df1f700 1 --2- 172.21.15.63:0/500319002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed480616d0 0x7fed480b42b0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fed4806ab40 tx=0x7fed40008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed3bfff700 1 -- 172.21.15.63:0/500319002 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed4000a370 con 0x7fed480616d0 2020-05-18T21:27:29.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4f982700 1 -- 172.21.15.63:0/500319002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed480616d0 msgr2=0x7fed480b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:29.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.133+0000 7fed4f982700 1 --2- 172.21.15.63:0/500319002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed480616d0 0x7fed480b42b0 secure :-1 s=READY pgs=335 cs=0 l=1 rx=0x7fed4806ab40 tx=0x7fed40008ca0).stop 2020-05-18T21:27:29.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4f982700 1 -- 172.21.15.63:0/500319002 shutdown_connections 2020-05-18T21:27:29.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4f982700 1 --2- 172.21.15.63:0/500319002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed480616d0 0x7fed480b42b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:29.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4f982700 1 --2- 172.21.15.63:0/500319002 >> v2:172.21.15.155:3300/0 conn(0x7fed480b6d90 0x7fed48061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:29.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4f982700 1 --2- 172.21.15.63:0/500319002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed480b9500 0x7fed480b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:29.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4f982700 1 -- 172.21.15.63:0/500319002 >> 172.21.15.63:0/500319002 conn(0x7fed48069b70 msgr2=0x7fed48069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:29.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4f982700 1 -- 172.21.15.63:0/500319002 shutdown_connections 2020-05-18T21:27:29.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4f982700 1 -- 172.21.15.63:0/500319002 wait complete. 2020-05-18T21:27:29.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4f982700 1 Processor -- start 2020-05-18T21:27:29.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4f982700 1 -- start start 2020-05-18T21:27:29.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4f982700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fed480b6d90 0x7fed48140930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:29.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4f982700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fed480b9500 0x7fed48142440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:29.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4f982700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed480632e0 con 0x7fed480616d0 2020-05-18T21:27:29.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4f982700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4813fde0 con 0x7fed480b6d90 2020-05-18T21:27:29.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4f982700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed48142f90 con 0x7fed480b9500 2020-05-18T21:27:29.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4cf1d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fed480b6d90 0x7fed48140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:29.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4cf1d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fed480b6d90 0x7fed48140930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54032/0 (socket says 172.21.15.63:54032) 2020-05-18T21:27:29.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4cf1d700 1 -- 172.21.15.63:0/3950580459 learned_addr learned my addr 172.21.15.63:0/3950580459 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:29.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4df1f700 1 --2- 172.21.15.63:0/3950580459 >> v2:172.21.15.155:3300/0 conn(0x7fed480b9500 0x7fed48142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:29.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4cf1d700 1 -- 172.21.15.63:0/3950580459 >> v2:172.21.15.155:3300/0 conn(0x7fed480b9500 msgr2=0x7fed48142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:29.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4cf1d700 1 --2- 172.21.15.63:0/3950580459 >> v2:172.21.15.155:3300/0 conn(0x7fed480b9500 0x7fed48142440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:29.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4cf1d700 1 -- 172.21.15.63:0/3950580459 >> v1:172.21.15.63:6789/0 conn(0x7fed480616d0 legacy=0x7fed4812dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:29.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.137+0000 7fed4cf1d700 1 -- 172.21.15.63:0/3950580459 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4812e6f0 con 0x7fed480b6d90 2020-05-18T21:27:29.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed4cf1d700 1 --2- 172.21.15.63:0/3950580459 >> v2:172.21.15.63:3300/0 conn(0x7fed480b6d90 0x7fed48140930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fed44002f70 tx=0x7fed44010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed4cf1d700 1 --2- 172.21.15.63:0/3950580459 >> v2:172.21.15.63:3300/0 conn(0x7fed480b6d90 0x7fed48140930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fed44002f70 tx=0x7fed44010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed4cf1d700 1 --2- 172.21.15.63:0/3950580459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed480b6d90 0x7fed48140930 secure :-1 s=READY pgs=337 cs=0 l=1 rx=0x7fed44002f70 tx=0x7fed44010d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:29.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed4cf1d700 1 --2- 172.21.15.63:0/3950580459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed480b6d90 0x7fed48140930 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7fed44002f70 tx=0x7fed44010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed3a7fc700 1 -- 172.21.15.63:0/3950580459 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed44007180 con 0x7fed480b6d90 2020-05-18T21:27:29.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed4cf1d700 1 --2- 172.21.15.63:0/3950580459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed480b6d90 0x7fed48140930 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7fed44002f70 tx=0x7fed44010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed4cf1d700 1 --2- 172.21.15.63:0/3950580459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed480b6d90 0x7fed48140930 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7fed44002f70 tx=0x7fed44010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed3a7fc700 1 -- 172.21.15.63:0/3950580459 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed440072e0 con 0x7fed480b6d90 2020-05-18T21:27:29.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed4f982700 1 -- 172.21.15.63:0/3950580459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed481428a0 con 0x7fed480b6d90 2020-05-18T21:27:29.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed3a7fc700 1 -- 172.21.15.63:0/3950580459 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed44012390 con 0x7fed480b6d90 2020-05-18T21:27:29.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed4f982700 1 -- 172.21.15.63:0/3950580459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed48063740 con 0x7fed480b6d90 2020-05-18T21:27:29.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed4cf1d700 1 --2- 172.21.15.63:0/3950580459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed480b6d90 0x7fed48140930 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7fed44002f70 tx=0x7fed44010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed3a7fc700 1 -- 172.21.15.63:0/3950580459 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fed44010190 con 0x7fed480b6d90 2020-05-18T21:27:29.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed4cf1d700 1 --2- 172.21.15.63:0/3950580459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed480b6d90 0x7fed48140930 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7fed44002f70 tx=0x7fed44010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed4f982700 1 -- 172.21.15.63:0/3950580459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed48142dd0 con 0x7fed480b6d90 2020-05-18T21:27:29.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed3a7fc700 1 --2- 172.21.15.63:0/3950580459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fed3004fa30 0x7fed30051ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:29.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed3a7fc700 1 -- 172.21.15.63:0/3950580459 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fed44063fe0 con 0x7fed480b6d90 2020-05-18T21:27:29.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed4d71e700 1 --2- 172.21.15.63:0/3950580459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fed3004fa30 0x7fed30051ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:29.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed4d71e700 1 --2- 172.21.15.63:0/3950580459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fed3004fa30 0x7fed30051ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fed48064590 tx=0x7fed3c0086a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed4d71e700 1 --2- 172.21.15.63:0/3950580459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fed3004fa30 0x7fed30051ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fed48064590 tx=0x7fed3c0086a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.141+0000 7fed4d71e700 1 --2- 172.21.15.63:0/3950580459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fed3004fa30 0x7fed30051ef0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7fed48064590 tx=0x7fed3c0086a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:29.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.149+0000 7fed4cf1d700 1 --2- 172.21.15.63:0/3950580459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed480b6d90 0x7fed48140930 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7fed44002f70 tx=0x7fed44010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.149+0000 7fed3a7fc700 1 -- 172.21.15.63:0/3950580459 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fed4403e3d0 con 0x7fed480b6d90 2020-05-18T21:27:29.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.265+0000 7fed4f982700 1 -- 172.21.15.63:0/3950580459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fed480569e0 con 0x7fed480b6d90 2020-05-18T21:27:29.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.265+0000 7fed4cf1d700 1 --2- 172.21.15.63:0/3950580459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed480b6d90 0x7fed48140930 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7fed44002f70 tx=0x7fed44010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.265+0000 7fed3a7fc700 1 -- 172.21.15.63:0/3950580459 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fed440419f0 con 0x7fed480b6d90 2020-05-18T21:27:29.274 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:29.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.269+0000 7fed4f982700 1 -- 172.21.15.63:0/3950580459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fed3004fa30 msgr2=0x7fed30051ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:29.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.269+0000 7fed4f982700 1 --2- 172.21.15.63:0/3950580459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fed3004fa30 0x7fed30051ef0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7fed48064590 tx=0x7fed3c0086a0).stop 2020-05-18T21:27:29.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.269+0000 7fed4f982700 1 -- 172.21.15.63:0/3950580459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed480b6d90 msgr2=0x7fed48140930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:29.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.269+0000 7fed4f982700 1 --2- 172.21.15.63:0/3950580459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed480b6d90 0x7fed48140930 secure :-1 s=READY pgs=337 cs=0 l=1 rx=0x7fed44002f70 tx=0x7fed44010d30).stop 2020-05-18T21:27:29.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.269+0000 7fed4f982700 1 -- 172.21.15.63:0/3950580459 shutdown_connections 2020-05-18T21:27:29.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.269+0000 7fed4f982700 1 --2- 172.21.15.63:0/3950580459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fed3004fa30 0x7fed30051ef0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:29.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.269+0000 7fed4f982700 1 --2- 172.21.15.63:0/3950580459 >> v2:172.21.15.155:3300/0 conn(0x7fed480b9500 0x7fed48142440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:29.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.269+0000 7fed4f982700 1 --2- 172.21.15.63:0/3950580459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed480b6d90 0x7fed48140930 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:29.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.269+0000 7fed4f982700 1 -- 172.21.15.63:0/3950580459 >> 172.21.15.63:0/3950580459 conn(0x7fed48069b70 msgr2=0x7fed48069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:29.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.269+0000 7fed4f982700 1 -- 172.21.15.63:0/3950580459 shutdown_connections 2020-05-18T21:27:29.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.269+0000 7fed4f982700 1 -- 172.21.15.63:0/3950580459 wait complete. 2020-05-18T21:27:29.290 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-05-18T21:27:29.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.389+0000 7fe094d1c700 1 Processor -- start 2020-05-18T21:27:29.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.389+0000 7fe094d1c700 1 -- start start 2020-05-18T21:27:29.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.389+0000 7fe094d1c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe0901435a0 0x7fe090060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:29.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.389+0000 7fe094d1c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0900b7020 con 0x7fe0900b93f0 2020-05-18T21:27:29.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.389+0000 7fe094d1c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0900b72c0 con 0x7fe090145df0 2020-05-18T21:27:29.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.389+0000 7fe094d1c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0900b7560 con 0x7fe0901435a0 2020-05-18T21:27:29.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.389+0000 7fe08f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe0900b93f0 0x7fe0900b7ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56226/0 (socket says 172.21.15.63:56226) 2020-05-18T21:27:29.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.389+0000 7fe08f7fe700 1 -- 172.21.15.63:0/3462822530 learned_addr learned my addr 172.21.15.63:0/3462822530 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:29.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.389+0000 7fe08ffff700 1 --2- 172.21.15.63:0/3462822530 >> v2:172.21.15.63:3300/0 conn(0x7fe0901435a0 0x7fe090060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:29.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe08effd700 1 -- 172.21.15.63:0/3462822530 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80643895 0 0) 0x7fe0900b7020 con 0x7fe0900b93f0 2020-05-18T21:27:29.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe08effd700 1 -- 172.21.15.63:0/3462822530 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe070003270 con 0x7fe0900b93f0 2020-05-18T21:27:29.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe08effd700 1 -- 172.21.15.63:0/3462822530 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970782516 0 0) 0x7fe0900b72c0 con 0x7fe090145df0 2020-05-18T21:27:29.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe08effd700 1 -- 172.21.15.63:0/3462822530 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0900b7020 con 0x7fe090145df0 2020-05-18T21:27:29.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe08effd700 1 -- 172.21.15.63:0/3462822530 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3099233943 0 0) 0x7fe070003270 con 0x7fe0900b93f0 2020-05-18T21:27:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe08ffff700 1 -- 172.21.15.63:0/3462822530 >> v1:172.21.15.155:6789/0 conn(0x7fe090145df0 legacy=0x7fe090142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe08ffff700 1 -- 172.21.15.63:0/3462822530 >> v1:172.21.15.63:6789/0 conn(0x7fe0900b93f0 legacy=0x7fe0900b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe08ffff700 1 -- 172.21.15.63:0/3462822530 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0900b7800 con 0x7fe0901435a0 2020-05-18T21:27:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe08ffff700 1 --2- 172.21.15.63:0/3462822530 >> v2:172.21.15.63:3300/0 conn(0x7fe0901435a0 0x7fe090060430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe080001110 tx=0x7fe088007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe08ffff700 1 --2- 172.21.15.63:0/3462822530 >> v2:172.21.15.63:3300/0 conn(0x7fe0901435a0 0x7fe090060430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe080001110 tx=0x7fe088007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe08ffff700 1 --2- 172.21.15.63:0/3462822530 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0901435a0 0x7fe090060430 secure :-1 s=READY pgs=339 cs=0 l=1 rx=0x7fe080001110 tx=0x7fe088007e00).ready entity=mon.0 client_cookie=4f2d48d20f5bda84 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:29.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe08ffff700 1 --2- 172.21.15.63:0/3462822530 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0901435a0 0x7fe090060430 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7fe080001110 tx=0x7fe088007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe08effd700 1 -- 172.21.15.63:0/3462822530 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe080001710 con 0x7fe0901435a0 2020-05-18T21:27:29.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe08ffff700 1 --2- 172.21.15.63:0/3462822530 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0901435a0 0x7fe090060430 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7fe080001110 tx=0x7fe088007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe08ffff700 1 --2- 172.21.15.63:0/3462822530 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0901435a0 0x7fe090060430 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7fe080001110 tx=0x7fe088007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe08effd700 1 -- 172.21.15.63:0/3462822530 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe088011ac0 con 0x7fe0901435a0 2020-05-18T21:27:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe08effd700 1 -- 172.21.15.63:0/3462822530 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe088011e60 con 0x7fe0901435a0 2020-05-18T21:27:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe094d1c700 1 -- 172.21.15.63:0/3462822530 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0901435a0 msgr2=0x7fe090060430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe094d1c700 1 --2- 172.21.15.63:0/3462822530 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0901435a0 0x7fe090060430 secure :-1 s=READY pgs=339 cs=0 l=1 rx=0x7fe080001110 tx=0x7fe088007e00).stop 2020-05-18T21:27:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe094d1c700 1 -- 172.21.15.63:0/3462822530 shutdown_connections 2020-05-18T21:27:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe094d1c700 1 --2- 172.21.15.63:0/3462822530 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0901435a0 0x7fe090060430 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:29.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe094d1c700 1 -- 172.21.15.63:0/3462822530 >> 172.21.15.63:0/3462822530 conn(0x7fe090069b70 msgr2=0x7fe090069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:29.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe094d1c700 1 -- 172.21.15.63:0/3462822530 shutdown_connections 2020-05-18T21:27:29.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.393+0000 7fe094d1c700 1 -- 172.21.15.63:0/3462822530 wait complete. 2020-05-18T21:27:29.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe094d1c700 1 Processor -- start 2020-05-18T21:27:29.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe094d1c700 1 -- start start 2020-05-18T21:27:29.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe094d1c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe0901435a0 0x7fe090141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:29.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe094d1c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe090145df0 0x7fe0900ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:29.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe094d1c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe090142040 con 0x7fe0900b93f0 2020-05-18T21:27:29.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe094d1c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0900acc70 con 0x7fe0901435a0 2020-05-18T21:27:29.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe094d1c700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09013ea20 con 0x7fe090145df0 2020-05-18T21:27:29.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe087fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe0901435a0 0x7fe090141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:29.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe08f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe0900b93f0 0x7fe090153680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56232/0 (socket says 172.21.15.63:56232) 2020-05-18T21:27:29.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe08f7fe700 1 -- 172.21.15.63:0/2519452665 learned_addr learned my addr 172.21.15.63:0/2519452665 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:29.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe08ffff700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe090145df0 0x7fe0900ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:29.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe087fff700 1 -- 172.21.15.63:0/2519452665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe090145df0 msgr2=0x7fe0900ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:29.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe087fff700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe090145df0 0x7fe0900ac810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:29.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe087fff700 1 -- 172.21.15.63:0/2519452665 >> v1:172.21.15.63:6789/0 conn(0x7fe0900b93f0 legacy=0x7fe090153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:29.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe087fff700 1 -- 172.21.15.63:0/2519452665 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09013ecc0 con 0x7fe0901435a0 2020-05-18T21:27:29.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe08d7fa700 1 -- 172.21.15.63:0/2519452665 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863714671 0 0) 0x7fe090142040 con 0x7fe0900b93f0 2020-05-18T21:27:29.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe087fff700 1 --2- 172.21.15.63:0/2519452665 >> v2:172.21.15.63:3300/0 conn(0x7fe0901435a0 0x7fe090141be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe078001110 tx=0x7fe078010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe087fff700 1 --2- 172.21.15.63:0/2519452665 >> v2:172.21.15.63:3300/0 conn(0x7fe0901435a0 0x7fe090141be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe078001110 tx=0x7fe078010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe087fff700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0901435a0 0x7fe090141be0 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7fe078001110 tx=0x7fe078010990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:29.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe087fff700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0901435a0 0x7fe090141be0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7fe078001110 tx=0x7fe078010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.397+0000 7fe08d7fa700 1 -- 172.21.15.63:0/2519452665 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe078006c00 con 0x7fe0901435a0 2020-05-18T21:27:29.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.401+0000 7fe087fff700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0901435a0 0x7fe090141be0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7fe078001110 tx=0x7fe078010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.401+0000 7fe094d1c700 1 -- 172.21.15.63:0/2519452665 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09013ef60 con 0x7fe0901435a0 2020-05-18T21:27:29.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.401+0000 7fe08d7fa700 1 -- 172.21.15.63:0/2519452665 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe078006da0 con 0x7fe0901435a0 2020-05-18T21:27:29.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.401+0000 7fe087fff700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0901435a0 0x7fe090141be0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7fe078001110 tx=0x7fe078010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.401+0000 7fe08d7fa700 1 -- 172.21.15.63:0/2519452665 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe078008370 con 0x7fe0901435a0 2020-05-18T21:27:29.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.401+0000 7fe094d1c700 1 -- 172.21.15.63:0/2519452665 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0901402e0 con 0x7fe0901435a0 2020-05-18T21:27:29.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.401+0000 7fe087fff700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0901435a0 0x7fe090141be0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7fe078001110 tx=0x7fe078010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.401+0000 7fe094d1c700 1 -- 172.21.15.63:0/2519452665 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0900569e0 con 0x7fe0901435a0 2020-05-18T21:27:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.401+0000 7fe08d7fa700 1 -- 172.21.15.63:0/2519452665 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe0780085f0 con 0x7fe0901435a0 2020-05-18T21:27:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.401+0000 7fe087fff700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0901435a0 0x7fe090141be0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7fe078001110 tx=0x7fe078010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.401+0000 7fe08d7fa700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe07404f860 0x7fe074051d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.401+0000 7fe08d7fa700 1 -- 172.21.15.63:0/2519452665 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe078063cd0 con 0x7fe0901435a0 2020-05-18T21:27:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.401+0000 7fe08f7fe700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe07404f860 0x7fe074051d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.401+0000 7fe08f7fe700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe07404f860 0x7fe074051d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe080000f50 tx=0x7fe08000c940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.401+0000 7fe08f7fe700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe07404f860 0x7fe074051d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe080000f50 tx=0x7fe08000c940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.401+0000 7fe08f7fe700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe07404f860 0x7fe074051d20 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7fe080000f50 tx=0x7fe08000c940).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.409+0000 7fe087fff700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0901435a0 0x7fe090141be0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7fe078001110 tx=0x7fe078010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.409+0000 7fe08d7fa700 1 -- 172.21.15.63:0/2519452665 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe07803e000 con 0x7fe0901435a0 2020-05-18T21:27:29.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.529+0000 7fe094d1c700 1 -- 172.21.15.63:0/2519452665 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe0901402e0 con 0x7fe0901435a0 2020-05-18T21:27:29.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.529+0000 7fe087fff700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0901435a0 0x7fe090141be0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7fe078001110 tx=0x7fe078010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.529+0000 7fe08d7fa700 1 -- 172.21.15.63:0/2519452665 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+143 (secure 0 0 0) 0x7fe0901402e0 con 0x7fe0901435a0 2020-05-18T21:27:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:29.536 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:27:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2020-05-18T21:27:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "device_health_metrics" 2020-05-18T21:27:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 2, 2020-05-18T21:27:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "rbd" 2020-05-18T21:27:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:29.538 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:27:29.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.529+0000 7fe094d1c700 1 -- 172.21.15.63:0/2519452665 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe07404f860 msgr2=0x7fe074051d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:29.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.529+0000 7fe094d1c700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe07404f860 0x7fe074051d20 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7fe080000f50 tx=0x7fe08000c940).stop 2020-05-18T21:27:29.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.529+0000 7fe094d1c700 1 -- 172.21.15.63:0/2519452665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0901435a0 msgr2=0x7fe090141be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:29.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.529+0000 7fe094d1c700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0901435a0 0x7fe090141be0 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7fe078001110 tx=0x7fe078010990).stop 2020-05-18T21:27:29.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.529+0000 7fe094d1c700 1 -- 172.21.15.63:0/2519452665 shutdown_connections 2020-05-18T21:27:29.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.529+0000 7fe094d1c700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe07404f860 0x7fe074051d20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:29.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.529+0000 7fe094d1c700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe090145df0 0x7fe0900ac810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:29.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.529+0000 7fe094d1c700 1 --2- 172.21.15.63:0/2519452665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0901435a0 0x7fe090141be0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:29.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.529+0000 7fe094d1c700 1 -- 172.21.15.63:0/2519452665 >> 172.21.15.63:0/2519452665 conn(0x7fe090069b70 msgr2=0x7fe090147f50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:29.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.529+0000 7fe094d1c700 1 -- 172.21.15.63:0/2519452665 shutdown_connections 2020-05-18T21:27:29.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.529+0000 7fe094d1c700 1 -- 172.21.15.63:0/2519452665 wait complete. 2020-05-18T21:27:29.548 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-05-18T21:27:29.549 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-05-18T21:27:29.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0e57dc700 1 Processor -- start 2020-05-18T21:27:29.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0e57dc700 1 -- start start 2020-05-18T21:27:29.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0e57dc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa0e00bc8d0 0x7fa0e0060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:29.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0e57dc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0e0143630 0x7fa0e012e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:29.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0e57dc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e0146420 con 0x7fa0e0145e30 2020-05-18T21:27:29.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0e57dc700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e0146e00 con 0x7fa0e00bc8d0 2020-05-18T21:27:29.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0e57dc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e01466c0 con 0x7fa0e0143630 2020-05-18T21:27:29.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0dffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa0e00bc8d0 0x7fa0e0060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:29.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0dffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa0e00bc8d0 0x7fa0e0060b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54052/0 (socket says 172.21.15.63:54052) 2020-05-18T21:27:29.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0dffff700 1 -- 172.21.15.63:0/3671153674 learned_addr learned my addr 172.21.15.63:0/3671153674 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:29.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0e4fdb700 1 --2- 172.21.15.63:0/3671153674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0e0143630 0x7fa0e012e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:29.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0dffff700 1 -- 172.21.15.63:0/3671153674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0e0143630 msgr2=0x7fa0e012e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:29.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0dffff700 1 --2- 172.21.15.63:0/3671153674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0e0143630 0x7fa0e012e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:29.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0dffff700 1 -- 172.21.15.63:0/3671153674 >> v1:172.21.15.155:6789/0 conn(0x7fa0e0145e30 legacy=0x7fa0e0142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:29.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0dffff700 1 -- 172.21.15.63:0/3671153674 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e0146960 con 0x7fa0e00bc8d0 2020-05-18T21:27:29.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0dffff700 1 --2- 172.21.15.63:0/3671153674 >> v2:172.21.15.63:3300/0 conn(0x7fa0e00bc8d0 0x7fa0e0060b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa0d0002f70 tx=0x7fa0d0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0dffff700 1 --2- 172.21.15.63:0/3671153674 >> v2:172.21.15.63:3300/0 conn(0x7fa0e00bc8d0 0x7fa0e0060b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa0d0002f70 tx=0x7fa0d0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0dffff700 1 --2- 172.21.15.63:0/3671153674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e00bc8d0 0x7fa0e0060b00 secure :-1 s=READY pgs=342 cs=0 l=1 rx=0x7fa0d0002f70 tx=0x7fa0d0007a80).ready entity=mon.0 client_cookie=78be02442217fcc server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:29.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0dffff700 1 --2- 172.21.15.63:0/3671153674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e00bc8d0 0x7fa0e0060b00 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7fa0d0002f70 tx=0x7fa0d0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0deffd700 1 -- 172.21.15.63:0/3671153674 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0d00116b0 con 0x7fa0e00bc8d0 2020-05-18T21:27:29.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0dffff700 1 --2- 172.21.15.63:0/3671153674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e00bc8d0 0x7fa0e0060b00 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7fa0d0002f70 tx=0x7fa0d0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0dffff700 1 --2- 172.21.15.63:0/3671153674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e00bc8d0 0x7fa0e0060b00 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7fa0d0002f70 tx=0x7fa0d0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0deffd700 1 -- 172.21.15.63:0/3671153674 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d0011810 con 0x7fa0e00bc8d0 2020-05-18T21:27:29.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0deffd700 1 -- 172.21.15.63:0/3671153674 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0d0011c30 con 0x7fa0e00bc8d0 2020-05-18T21:27:29.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0e57dc700 1 -- 172.21.15.63:0/3671153674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e00bc8d0 msgr2=0x7fa0e0060b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:29.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.653+0000 7fa0e57dc700 1 --2- 172.21.15.63:0/3671153674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e00bc8d0 0x7fa0e0060b00 secure :-1 s=READY pgs=342 cs=0 l=1 rx=0x7fa0d0002f70 tx=0x7fa0d0007a80).stop 2020-05-18T21:27:29.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0e57dc700 1 -- 172.21.15.63:0/3671153674 shutdown_connections 2020-05-18T21:27:29.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0e57dc700 1 --2- 172.21.15.63:0/3671153674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0e0143630 0x7fa0e012e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:29.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0e57dc700 1 --2- 172.21.15.63:0/3671153674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e00bc8d0 0x7fa0e0060b00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:29.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0e57dc700 1 -- 172.21.15.63:0/3671153674 >> 172.21.15.63:0/3671153674 conn(0x7fa0e005f3b0 msgr2=0x7fa0e005f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:29.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0e57dc700 1 -- 172.21.15.63:0/3671153674 shutdown_connections 2020-05-18T21:27:29.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0e57dc700 1 -- 172.21.15.63:0/3671153674 wait complete. 2020-05-18T21:27:29.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0e57dc700 1 Processor -- start 2020-05-18T21:27:29.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0e57dc700 1 -- start start 2020-05-18T21:27:29.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0e57dc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa0e00bc8d0 0x7fa0e0140420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:29.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0e57dc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa0e0143630 0x7fa0e00ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:29.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0e57dc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0e0145e30 0x7fa0e0148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:29.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0e57dc700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e00b41c0 con 0x7fa0e0143630 2020-05-18T21:27:29.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0e57dc700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e0148970 con 0x7fa0e00bc8d0 2020-05-18T21:27:29.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0e57dc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e00adf80 con 0x7fa0e0145e30 2020-05-18T21:27:29.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0df7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa0e0143630 0x7fa0e00ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:29.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0df7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa0e0143630 0x7fa0e00ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54058/0 (socket says 172.21.15.63:54058) 2020-05-18T21:27:29.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0df7fe700 1 -- 172.21.15.63:0/3013851593 learned_addr learned my addr 172.21.15.63:0/3013851593 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:29.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0dffff700 1 --2- 172.21.15.63:0/3013851593 >> v2:172.21.15.155:3300/0 conn(0x7fa0e00bc8d0 0x7fa0e0140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:29.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0e4fdb700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0e0145e30 0x7fa0e0148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:29.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0df7fe700 1 -- 172.21.15.63:0/3013851593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0e0145e30 msgr2=0x7fa0e0148510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:29.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0df7fe700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0e0145e30 0x7fa0e0148510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:29.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0df7fe700 1 -- 172.21.15.63:0/3013851593 >> v2:172.21.15.155:3300/0 conn(0x7fa0e00bc8d0 msgr2=0x7fa0e0140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:29.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0df7fe700 1 --2- 172.21.15.63:0/3013851593 >> v2:172.21.15.155:3300/0 conn(0x7fa0e00bc8d0 0x7fa0e0140420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:29.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0df7fe700 1 -- 172.21.15.63:0/3013851593 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e00b60b0 con 0x7fa0e0143630 2020-05-18T21:27:29.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0df7fe700 1 --2- 172.21.15.63:0/3013851593 >> v2:172.21.15.63:3300/0 conn(0x7fa0e0143630 0x7fa0e00ada00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa0e00bc550 tx=0x7fa0e0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0df7fe700 1 --2- 172.21.15.63:0/3013851593 >> v2:172.21.15.63:3300/0 conn(0x7fa0e0143630 0x7fa0e00ada00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa0e00bc550 tx=0x7fa0e0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0df7fe700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e0143630 0x7fa0e00ada00 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7fa0e00bc550 tx=0x7fa0e0061d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:29.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0df7fe700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e0143630 0x7fa0e00ada00 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7fa0e00bc550 tx=0x7fa0e0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0df7fe700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e0143630 0x7fa0e00ada00 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7fa0e00bc550 tx=0x7fa0e0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0dd7fa700 1 -- 172.21.15.63:0/3013851593 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0c800cc40 con 0x7fa0e0143630 2020-05-18T21:27:29.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0df7fe700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e0143630 0x7fa0e00ada00 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7fa0e00bc550 tx=0x7fa0e0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0dd7fa700 1 -- 172.21.15.63:0/3013851593 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c800cda0 con 0x7fa0e0143630 2020-05-18T21:27:29.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0dd7fa700 1 -- 172.21.15.63:0/3013851593 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0c8012310 con 0x7fa0e0143630 2020-05-18T21:27:29.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0e57dc700 1 -- 172.21.15.63:0/3013851593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e01536e0 con 0x7fa0e0143630 2020-05-18T21:27:29.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.657+0000 7fa0e57dc700 1 -- 172.21.15.63:0/3013851593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e0153b90 con 0x7fa0e0143630 2020-05-18T21:27:29.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.661+0000 7fa0df7fe700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e0143630 0x7fa0e00ada00 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7fa0e00bc550 tx=0x7fa0e0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.661+0000 7fa0e57dc700 1 -- 172.21.15.63:0/3013851593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e0142cd0 con 0x7fa0e0143630 2020-05-18T21:27:29.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.661+0000 7fa0dd7fa700 1 -- 172.21.15.63:0/3013851593 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa0c8012580 con 0x7fa0e0143630 2020-05-18T21:27:29.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.661+0000 7fa0df7fe700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e0143630 0x7fa0e00ada00 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7fa0e00bc550 tx=0x7fa0e0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.661+0000 7fa0dd7fa700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa0c404fb80 0x7fa0c4052040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:29.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.661+0000 7fa0dd7fa700 1 -- 172.21.15.63:0/3013851593 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa0c80638f0 con 0x7fa0e0143630 2020-05-18T21:27:29.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.661+0000 7fa0dffff700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa0c404fb80 0x7fa0c4052040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:29.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.661+0000 7fa0dffff700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa0c404fb80 0x7fa0c4052040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa0d0002f70 tx=0x7fa0d0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.661+0000 7fa0dffff700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa0c404fb80 0x7fa0c4052040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa0d0002f70 tx=0x7fa0d0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.661+0000 7fa0dffff700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa0c404fb80 0x7fa0c4052040 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7fa0d0002f70 tx=0x7fa0d0007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:29.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.669+0000 7fa0df7fe700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e0143630 0x7fa0e00ada00 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7fa0e00bc550 tx=0x7fa0e0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:29.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.669+0000 7fa0dd7fa700 1 -- 172.21.15.63:0/3013851593 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa0c803dc20 con 0x7fa0e0143630 2020-05-18T21:27:29.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:29.781+0000 7fa0e57dc700 1 -- 172.21.15.63:0/3013851593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fa0e00569e0 con 0x7fa0e0143630 2020-05-18T21:27:30.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.573+0000 7fa0df7fe700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e0143630 0x7fa0e00ada00 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7fa0e00bc550 tx=0x7fa0e0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:30.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.573+0000 7fa0dd7fa700 1 -- 172.21.15.63:0/3013851593 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v30) v1 ==== 133+0+0 (secure 0 0 0) 0x7fa0c8041240 con 0x7fa0e0143630 2020-05-18T21:27:30.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.581+0000 7fa0e57dc700 1 -- 172.21.15.63:0/3013851593 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa0c404fb80 msgr2=0x7fa0c4052040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:30.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.581+0000 7fa0e57dc700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa0c404fb80 0x7fa0c4052040 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7fa0d0002f70 tx=0x7fa0d0007a80).stop 2020-05-18T21:27:30.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.581+0000 7fa0e57dc700 1 -- 172.21.15.63:0/3013851593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e0143630 msgr2=0x7fa0e00ada00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:30.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.581+0000 7fa0e57dc700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e0143630 0x7fa0e00ada00 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7fa0e00bc550 tx=0x7fa0e0061d60).stop 2020-05-18T21:27:30.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.581+0000 7fa0e57dc700 1 -- 172.21.15.63:0/3013851593 shutdown_connections 2020-05-18T21:27:30.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.581+0000 7fa0e57dc700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa0c404fb80 0x7fa0c4052040 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:30.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.581+0000 7fa0e57dc700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0e0145e30 0x7fa0e0148510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:30.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.581+0000 7fa0e57dc700 1 --2- 172.21.15.63:0/3013851593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e0143630 0x7fa0e00ada00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:30.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.581+0000 7fa0e57dc700 1 --2- 172.21.15.63:0/3013851593 >> v2:172.21.15.155:3300/0 conn(0x7fa0e00bc8d0 0x7fa0e0140420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:30.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.581+0000 7fa0e57dc700 1 -- 172.21.15.63:0/3013851593 >> 172.21.15.63:0/3013851593 conn(0x7fa0e005f3b0 msgr2=0x7fa0e0142ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:30.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.581+0000 7fa0e57dc700 1 -- 172.21.15.63:0/3013851593 shutdown_connections 2020-05-18T21:27:30.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.581+0000 7fa0e57dc700 1 -- 172.21.15.63:0/3013851593 wait complete. 2020-05-18T21:27:30.590 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2020-05-18T21:27:30.602 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-05-18T21:27:30.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.713+0000 7ffad2540700 1 Processor -- start 2020-05-18T21:27:30.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.713+0000 7ffad2540700 1 -- start start 2020-05-18T21:27:30.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.713+0000 7ffad2540700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffacc0b95a0 0x7ffacc05f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:30.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.713+0000 7ffad2540700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffacc149560 0x7ffacc1499f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:30.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.713+0000 7ffad2540700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffacc061d50 con 0x7ffacc05fd20 2020-05-18T21:27:30.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.713+0000 7ffad2540700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc0b3820 con 0x7ffacc0b95a0 2020-05-18T21:27:30.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.713+0000 7ffad2540700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc05edf0 con 0x7ffacc149560 2020-05-18T21:27:30.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.713+0000 7ffad153e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffacc0b95a0 0x7ffacc05f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:30.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.713+0000 7ffad153e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffacc0b95a0 0x7ffacc05f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54066/0 (socket says 172.21.15.63:54066) 2020-05-18T21:27:30.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.713+0000 7ffad153e700 1 -- 172.21.15.63:0/3998511270 learned_addr learned my addr 172.21.15.63:0/3998511270 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:30.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.713+0000 7ffad1d3f700 1 --2- 172.21.15.63:0/3998511270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffacc149560 0x7ffacc1499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:30.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.713+0000 7ffad153e700 1 -- 172.21.15.63:0/3998511270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffacc149560 msgr2=0x7ffacc1499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:30.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.713+0000 7ffad153e700 1 --2- 172.21.15.63:0/3998511270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffacc149560 0x7ffacc1499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:30.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.713+0000 7ffad153e700 1 -- 172.21.15.63:0/3998511270 >> v1:172.21.15.63:6789/0 conn(0x7ffacc05fd20 legacy=0x7ffacc145590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:30.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffad153e700 1 -- 172.21.15.63:0/3998511270 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc0b9980 con 0x7ffacc0b95a0 2020-05-18T21:27:30.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.713+0000 7ffacbfff700 1 -- 172.21.15.63:0/3998511270 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217316409 0 0) 0x7ffacc061d50 con 0x7ffacc05fd20 2020-05-18T21:27:30.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffad153e700 1 --2- 172.21.15.63:0/3998511270 >> v2:172.21.15.63:3300/0 conn(0x7ffacc0b95a0 0x7ffacc05f790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffac40032f0 tx=0x7ffac4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:30.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffad153e700 1 --2- 172.21.15.63:0/3998511270 >> v2:172.21.15.63:3300/0 conn(0x7ffacc0b95a0 0x7ffacc05f790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffac40032f0 tx=0x7ffac4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:30.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffad153e700 1 --2- 172.21.15.63:0/3998511270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffacc0b95a0 0x7ffacc05f790 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7ffac40032f0 tx=0x7ffac4007e00).ready entity=mon.0 client_cookie=ea2b7ebd72715d9d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:30.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffad153e700 1 --2- 172.21.15.63:0/3998511270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffacc0b95a0 0x7ffacc05f790 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7ffac40032f0 tx=0x7ffac4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:30.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffacbfff700 1 -- 172.21.15.63:0/3998511270 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffac4011d10 con 0x7ffacc0b95a0 2020-05-18T21:27:30.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffad153e700 1 --2- 172.21.15.63:0/3998511270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffacc0b95a0 0x7ffacc05f790 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7ffac40032f0 tx=0x7ffac4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:30.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffacbfff700 1 -- 172.21.15.63:0/3998511270 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac4011e70 con 0x7ffacc0b95a0 2020-05-18T21:27:30.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffad153e700 1 --2- 172.21.15.63:0/3998511270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffacc0b95a0 0x7ffacc05f790 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7ffac40032f0 tx=0x7ffac4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:30.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffacbfff700 1 -- 172.21.15.63:0/3998511270 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffac400a370 con 0x7ffacc0b95a0 2020-05-18T21:27:30.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffad2540700 1 -- 172.21.15.63:0/3998511270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffacc0b95a0 msgr2=0x7ffacc05f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:30.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffad2540700 1 --2- 172.21.15.63:0/3998511270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffacc0b95a0 0x7ffacc05f790 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7ffac40032f0 tx=0x7ffac4007e00).stop 2020-05-18T21:27:30.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffad2540700 1 -- 172.21.15.63:0/3998511270 shutdown_connections 2020-05-18T21:27:30.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffad2540700 1 --2- 172.21.15.63:0/3998511270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffacc149560 0x7ffacc1499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:30.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffad2540700 1 --2- 172.21.15.63:0/3998511270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffacc0b95a0 0x7ffacc05f790 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:30.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffad2540700 1 -- 172.21.15.63:0/3998511270 >> 172.21.15.63:0/3998511270 conn(0x7ffacc06a640 msgr2=0x7ffacc0b8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:30.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffad2540700 1 -- 172.21.15.63:0/3998511270 shutdown_connections 2020-05-18T21:27:30.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffad2540700 1 -- 172.21.15.63:0/3998511270 wait complete. 2020-05-18T21:27:30.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffad2540700 1 Processor -- start 2020-05-18T21:27:30.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.717+0000 7ffad2540700 1 -- start start 2020-05-18T21:27:30.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffad2540700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffacc149560 0x7ffacc098d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:30.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffad2540700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffacc153460 con 0x7ffacc0b95a0 2020-05-18T21:27:30.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffad2540700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffacc156e50 con 0x7ffacc05fd20 2020-05-18T21:27:30.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffad2540700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc1570f0 con 0x7ffacc149560 2020-05-18T21:27:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffad1d3f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffacc149560 0x7ffacc098d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:30.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffad1d3f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffacc149560 0x7ffacc098d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54076/0 (socket says 172.21.15.63:54076) 2020-05-18T21:27:30.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffad1d3f700 1 -- 172.21.15.63:0/2484988520 learned_addr learned my addr 172.21.15.63:0/2484988520 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:30.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffad0d3d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ffacc0b95a0 0x7ffacc09d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56262/0 (socket says 172.21.15.63:56262) 2020-05-18T21:27:30.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffaca7fc700 1 -- 172.21.15.63:0/2484988520 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867040738 0 0) 0x7ffacc156e50 con 0x7ffacc05fd20 2020-05-18T21:27:30.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffaca7fc700 1 -- 172.21.15.63:0/2484988520 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaac002fe0 con 0x7ffacc05fd20 2020-05-18T21:27:30.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffad1d3f700 1 -- 172.21.15.63:0/2484988520 >> v1:172.21.15.155:6789/0 conn(0x7ffacc05fd20 legacy=0x7ffacc09ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:30.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffad1d3f700 1 -- 172.21.15.63:0/2484988520 >> v1:172.21.15.63:6789/0 conn(0x7ffacc0b95a0 legacy=0x7ffacc09d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:30.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffaca7fc700 1 -- 172.21.15.63:0/2484988520 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694637623 0 0) 0x7ffacc153460 con 0x7ffacc0b95a0 2020-05-18T21:27:30.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffad1d3f700 1 -- 172.21.15.63:0/2484988520 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc157390 con 0x7ffacc149560 2020-05-18T21:27:30.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffad1d3f700 1 --2- 172.21.15.63:0/2484988520 >> v2:172.21.15.63:3300/0 conn(0x7ffacc149560 0x7ffacc098d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffac4008290 tx=0x7ffabc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:30.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffad1d3f700 1 --2- 172.21.15.63:0/2484988520 >> v2:172.21.15.63:3300/0 conn(0x7ffacc149560 0x7ffacc098d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffac4008290 tx=0x7ffabc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:30.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffad1d3f700 1 --2- 172.21.15.63:0/2484988520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffacc149560 0x7ffacc098d60 secure :-1 s=READY pgs=347 cs=0 l=1 rx=0x7ffac4008290 tx=0x7ffabc010c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:30.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffad1d3f700 1 --2- 172.21.15.63:0/2484988520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffacc149560 0x7ffacc098d60 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7ffac4008290 tx=0x7ffabc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:30.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffaca7fc700 1 -- 172.21.15.63:0/2484988520 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffabc007550 con 0x7ffacc149560 2020-05-18T21:27:30.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffad1d3f700 1 --2- 172.21.15.63:0/2484988520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffacc149560 0x7ffacc098d60 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7ffac4008290 tx=0x7ffabc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:30.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffad2540700 1 -- 172.21.15.63:0/2484988520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffacc157830 con 0x7ffacc149560 2020-05-18T21:27:30.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffaca7fc700 1 -- 172.21.15.63:0/2484988520 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc005700 con 0x7ffacc149560 2020-05-18T21:27:30.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffad1d3f700 1 --2- 172.21.15.63:0/2484988520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffacc149560 0x7ffacc098d60 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7ffac4008290 tx=0x7ffabc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:30.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffad2540700 1 -- 172.21.15.63:0/2484988520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc156ad0 con 0x7ffacc149560 2020-05-18T21:27:30.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.721+0000 7ffaca7fc700 1 -- 172.21.15.63:0/2484988520 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffabc005ab0 con 0x7ffacc149560 2020-05-18T21:27:30.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.725+0000 7ffad1d3f700 1 --2- 172.21.15.63:0/2484988520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffacc149560 0x7ffacc098d60 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7ffac4008290 tx=0x7ffabc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:30.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.725+0000 7ffad2540700 1 -- 172.21.15.63:0/2484988520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffacc157520 con 0x7ffacc149560 2020-05-18T21:27:30.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.725+0000 7ffaca7fc700 1 -- 172.21.15.63:0/2484988520 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ffabc005c10 con 0x7ffacc149560 2020-05-18T21:27:30.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.725+0000 7ffad1d3f700 1 --2- 172.21.15.63:0/2484988520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffacc149560 0x7ffacc098d60 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7ffac4008290 tx=0x7ffabc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:30.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.725+0000 7ffaca7fc700 1 --2- 172.21.15.63:0/2484988520 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffaac04fd00 0x7ffaac0521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:30.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.725+0000 7ffaca7fc700 1 -- 172.21.15.63:0/2484988520 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5607+0+0 (secure 0 0 0) 0x7ffabc063f90 con 0x7ffacc149560 2020-05-18T21:27:30.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.725+0000 7ffad153e700 1 --2- 172.21.15.63:0/2484988520 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffaac04fd00 0x7ffaac0521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:30.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.725+0000 7ffad153e700 1 --2- 172.21.15.63:0/2484988520 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffaac04fd00 0x7ffaac0521c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffac4000f40 tx=0x7ffac4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:30.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.725+0000 7ffad153e700 1 --2- 172.21.15.63:0/2484988520 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffaac04fd00 0x7ffaac0521c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffac4000f40 tx=0x7ffac4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:30.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.725+0000 7ffad153e700 1 --2- 172.21.15.63:0/2484988520 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffaac04fd00 0x7ffaac0521c0 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7ffac4000f40 tx=0x7ffac4007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:30.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.729+0000 7ffad1d3f700 1 --2- 172.21.15.63:0/2484988520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffacc149560 0x7ffacc098d60 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7ffac4008290 tx=0x7ffabc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:30.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.729+0000 7ffaca7fc700 1 -- 172.21.15.63:0/2484988520 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ffabc03e2c0 con 0x7ffacc149560 2020-05-18T21:27:30.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:30.841+0000 7ffad2540700 1 -- 172.21.15.63:0/2484988520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7ffacc0569e0 con 0x7ffacc149560 2020-05-18T21:27:31.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.585+0000 7ffad1d3f700 1 --2- 172.21.15.63:0/2484988520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffacc149560 0x7ffacc098d60 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7ffac4008290 tx=0x7ffabc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:31.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.585+0000 7ffaca7fc700 1 -- 172.21.15.63:0/2484988520 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v31) v1 ==== 125+0+0 (secure 0 0 0) 0x7ffabc0418e0 con 0x7ffacc149560 2020-05-18T21:27:31.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.601+0000 7ffad2540700 1 -- 172.21.15.63:0/2484988520 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffaac04fd00 msgr2=0x7ffaac0521c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:31.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.601+0000 7ffad2540700 1 --2- 172.21.15.63:0/2484988520 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffaac04fd00 0x7ffaac0521c0 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7ffac4000f40 tx=0x7ffac4007e00).stop 2020-05-18T21:27:31.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.601+0000 7ffad2540700 1 -- 172.21.15.63:0/2484988520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffacc149560 msgr2=0x7ffacc098d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:31.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.601+0000 7ffad2540700 1 --2- 172.21.15.63:0/2484988520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffacc149560 0x7ffacc098d60 secure :-1 s=READY pgs=347 cs=0 l=1 rx=0x7ffac4008290 tx=0x7ffabc010c30).stop 2020-05-18T21:27:31.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.601+0000 7ffad2540700 1 -- 172.21.15.63:0/2484988520 shutdown_connections 2020-05-18T21:27:31.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.601+0000 7ffad2540700 1 --2- 172.21.15.63:0/2484988520 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffaac04fd00 0x7ffaac0521c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:31.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.601+0000 7ffad2540700 1 --2- 172.21.15.63:0/2484988520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffacc149560 0x7ffacc098d60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:31.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.601+0000 7ffad2540700 1 -- 172.21.15.63:0/2484988520 >> 172.21.15.63:0/2484988520 conn(0x7ffacc06a640 msgr2=0x7ffacc0b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:31.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.601+0000 7ffad2540700 1 -- 172.21.15.63:0/2484988520 shutdown_connections 2020-05-18T21:27:31.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.601+0000 7ffad2540700 1 -- 172.21.15.63:0/2484988520 wait complete. 2020-05-18T21:27:31.610 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2020-05-18T21:27:31.619 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-05-18T21:27:31.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbe066e700 1 Processor -- start 2020-05-18T21:27:31.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbe066e700 1 -- start start 2020-05-18T21:27:31.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbe066e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdbd80af5b0 0x7fdbd8069b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:31.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbe066e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdbd814d930 0x7fdbd814dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:31.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbe066e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd8098640 con 0x7fdbd80b61d0 2020-05-18T21:27:31.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbe066e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd80ae220 con 0x7fdbd80af5b0 2020-05-18T21:27:31.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbe066e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd80983a0 con 0x7fdbd814d930 2020-05-18T21:27:31.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbddc09700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdbd80af5b0 0x7fdbd8069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:31.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbddc09700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdbd80af5b0 0x7fdbd8069b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54082/0 (socket says 172.21.15.63:54082) 2020-05-18T21:27:31.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbddc09700 1 -- 172.21.15.63:0/3233269292 learned_addr learned my addr 172.21.15.63:0/3233269292 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:31.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbdec0b700 1 --2- 172.21.15.63:0/3233269292 >> v2:172.21.15.155:3300/0 conn(0x7fdbd814d930 0x7fdbd814dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:31.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbddc09700 1 -- 172.21.15.63:0/3233269292 >> v2:172.21.15.155:3300/0 conn(0x7fdbd814d930 msgr2=0x7fdbd814dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:31.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbddc09700 1 --2- 172.21.15.63:0/3233269292 >> v2:172.21.15.155:3300/0 conn(0x7fdbd814d930 0x7fdbd814dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:31.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbddc09700 1 -- 172.21.15.63:0/3233269292 >> v1:172.21.15.155:6789/0 conn(0x7fdbd80b61d0 legacy=0x7fdbd81499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:31.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbddc09700 1 -- 172.21.15.63:0/3233269292 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd806a770 con 0x7fdbd80af5b0 2020-05-18T21:27:31.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbdec0b700 1 --2- 172.21.15.63:0/3233269292 >> v2:172.21.15.155:3300/0 conn(0x7fdbd814d930 0x7fdbd814dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:27:31.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbddc09700 1 --2- 172.21.15.63:0/3233269292 >> v2:172.21.15.63:3300/0 conn(0x7fdbd80af5b0 0x7fdbd8069b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdbc8002f70 tx=0x7fdbc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:31.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbddc09700 1 --2- 172.21.15.63:0/3233269292 >> v2:172.21.15.63:3300/0 conn(0x7fdbd80af5b0 0x7fdbd8069b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdbc8002f70 tx=0x7fdbc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:31.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbddc09700 1 --2- 172.21.15.63:0/3233269292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbd80af5b0 0x7fdbd8069b70 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7fdbc8002f70 tx=0x7fdbc8007a80).ready entity=mon.0 client_cookie=32e76da0a3ff8968 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:31.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbddc09700 1 --2- 172.21.15.63:0/3233269292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbd80af5b0 0x7fdbd8069b70 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7fdbc8002f70 tx=0x7fdbc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:31.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbddc09700 1 --2- 172.21.15.63:0/3233269292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbd80af5b0 0x7fdbd8069b70 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7fdbc8002f70 tx=0x7fdbc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:31.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbdd408700 1 -- 172.21.15.63:0/3233269292 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbc8008e50 con 0x7fdbd80af5b0 2020-05-18T21:27:31.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbddc09700 1 --2- 172.21.15.63:0/3233269292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbd80af5b0 0x7fdbd8069b70 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7fdbc8002f70 tx=0x7fdbc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:31.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbdd408700 1 -- 172.21.15.63:0/3233269292 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc8010800 con 0x7fdbd80af5b0 2020-05-18T21:27:31.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbdd408700 1 -- 172.21.15.63:0/3233269292 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbc8010c20 con 0x7fdbd80af5b0 2020-05-18T21:27:31.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbe066e700 1 -- 172.21.15.63:0/3233269292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbd80af5b0 msgr2=0x7fdbd8069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:31.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.713+0000 7fdbe066e700 1 --2- 172.21.15.63:0/3233269292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbd80af5b0 0x7fdbd8069b70 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7fdbc8002f70 tx=0x7fdbc8007a80).stop 2020-05-18T21:27:31.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.717+0000 7fdbe066e700 1 -- 172.21.15.63:0/3233269292 shutdown_connections 2020-05-18T21:27:31.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.717+0000 7fdbe066e700 1 --2- 172.21.15.63:0/3233269292 >> v2:172.21.15.155:3300/0 conn(0x7fdbd814d930 0x7fdbd814dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:31.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.717+0000 7fdbe066e700 1 --2- 172.21.15.63:0/3233269292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbd80af5b0 0x7fdbd8069b70 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:31.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.717+0000 7fdbe066e700 1 -- 172.21.15.63:0/3233269292 >> 172.21.15.63:0/3233269292 conn(0x7fdbd80b9770 msgr2=0x7fdbd80b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:31.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.717+0000 7fdbe066e700 1 -- 172.21.15.63:0/3233269292 shutdown_connections 2020-05-18T21:27:31.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.717+0000 7fdbe066e700 1 -- 172.21.15.63:0/3233269292 wait complete. 2020-05-18T21:27:31.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.717+0000 7fdbe066e700 1 Processor -- start 2020-05-18T21:27:31.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.717+0000 7fdbe066e700 1 -- start start 2020-05-18T21:27:31.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbe066e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdbd80af5b0 0x7fdbd8149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:31.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbe066e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdbd80b61d0 0x7fdbd80b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:31.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbe066e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbd814d930 0x7fdbd814cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:31.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbe066e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd814b230 con 0x7fdbd80af5b0 2020-05-18T21:27:31.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbe066e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd814d670 con 0x7fdbd80b61d0 2020-05-18T21:27:31.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbe066e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd80b30e0 con 0x7fdbd814d930 2020-05-18T21:27:31.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbde40a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdbd80af5b0 0x7fdbd8149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:31.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbde40a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdbd80af5b0 0x7fdbd8149b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54086/0 (socket says 172.21.15.63:54086) 2020-05-18T21:27:31.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbde40a700 1 -- 172.21.15.63:0/3465515323 learned_addr learned my addr 172.21.15.63:0/3465515323 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:31.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbddc09700 1 --2- 172.21.15.63:0/3465515323 >> v2:172.21.15.155:3300/0 conn(0x7fdbd80b61d0 0x7fdbd80b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:31.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbdec0b700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbd814d930 0x7fdbd814cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:31.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbde40a700 1 -- 172.21.15.63:0/3465515323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbd814d930 msgr2=0x7fdbd814cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:31.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbde40a700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbd814d930 0x7fdbd814cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:31.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbde40a700 1 -- 172.21.15.63:0/3465515323 >> v2:172.21.15.155:3300/0 conn(0x7fdbd80b61d0 msgr2=0x7fdbd80b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:31.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbde40a700 1 --2- 172.21.15.63:0/3465515323 >> v2:172.21.15.155:3300/0 conn(0x7fdbd80b61d0 0x7fdbd80b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:31.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbde40a700 1 -- 172.21.15.63:0/3465515323 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd814d3e0 con 0x7fdbd80af5b0 2020-05-18T21:27:31.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbdec0b700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbd814d930 0x7fdbd814cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:27:31.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbde40a700 1 --2- 172.21.15.63:0/3465515323 >> v2:172.21.15.63:3300/0 conn(0x7fdbd80af5b0 0x7fdbd8149b30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdbd814d7b0 tx=0x7fdbd400c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:31.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbde40a700 1 --2- 172.21.15.63:0/3465515323 >> v2:172.21.15.63:3300/0 conn(0x7fdbd80af5b0 0x7fdbd8149b30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdbd814d7b0 tx=0x7fdbd400c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:31.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbde40a700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbd80af5b0 0x7fdbd8149b30 secure :-1 s=READY pgs=349 cs=0 l=1 rx=0x7fdbd814d7b0 tx=0x7fdbd400c4d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:31.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbde40a700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbd80af5b0 0x7fdbd8149b30 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7fdbd814d7b0 tx=0x7fdbd400c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:31.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbde40a700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbd80af5b0 0x7fdbd8149b30 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7fdbd814d7b0 tx=0x7fdbd400c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:31.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbc77fe700 1 -- 172.21.15.63:0/3465515323 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbd400cc60 con 0x7fdbd80af5b0 2020-05-18T21:27:31.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbde40a700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbd80af5b0 0x7fdbd8149b30 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7fdbd814d7b0 tx=0x7fdbd400c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:31.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbc77fe700 1 -- 172.21.15.63:0/3465515323 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd400ce00 con 0x7fdbd80af5b0 2020-05-18T21:27:31.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbe066e700 1 -- 172.21.15.63:0/3465515323 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd814b420 con 0x7fdbd80af5b0 2020-05-18T21:27:31.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbc77fe700 1 -- 172.21.15.63:0/3465515323 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbd4012220 con 0x7fdbd80af5b0 2020-05-18T21:27:31.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.721+0000 7fdbe066e700 1 -- 172.21.15.63:0/3465515323 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd809df20 con 0x7fdbd80af5b0 2020-05-18T21:27:31.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.725+0000 7fdbde40a700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbd80af5b0 0x7fdbd8149b30 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7fdbd814d7b0 tx=0x7fdbd400c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:31.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.725+0000 7fdbe066e700 1 -- 172.21.15.63:0/3465515323 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd80569e0 con 0x7fdbd80af5b0 2020-05-18T21:27:31.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.725+0000 7fdbc77fe700 1 -- 172.21.15.63:0/3465515323 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fdbd4006520 con 0x7fdbd80af5b0 2020-05-18T21:27:31.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.725+0000 7fdbde40a700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbd80af5b0 0x7fdbd8149b30 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7fdbd814d7b0 tx=0x7fdbd400c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:31.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.725+0000 7fdbc77fe700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbb804f9b0 0x7fdbb8051e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:31.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.725+0000 7fdbc77fe700 1 -- 172.21.15.63:0/3465515323 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fdbd4063800 con 0x7fdbd80af5b0 2020-05-18T21:27:31.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.725+0000 7fdbddc09700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbb804f9b0 0x7fdbb8051e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:31.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.725+0000 7fdbddc09700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbb804f9b0 0x7fdbb8051e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdbc8002f70 tx=0x7fdbc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:31.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.725+0000 7fdbddc09700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbb804f9b0 0x7fdbb8051e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdbc8002f70 tx=0x7fdbc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:31.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.725+0000 7fdbddc09700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbb804f9b0 0x7fdbb8051e70 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fdbc8002f70 tx=0x7fdbc8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:31.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.729+0000 7fdbde40a700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbd80af5b0 0x7fdbd8149b30 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7fdbd814d7b0 tx=0x7fdbd400c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:31.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.729+0000 7fdbc77fe700 1 -- 172.21.15.63:0/3465515323 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fdbd403db90 con 0x7fdbd80af5b0 2020-05-18T21:27:31.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.877+0000 7fdbe066e700 1 -- 172.21.15.63:0/3465515323 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fdbd814b890 con 0x7fdbd80af5b0 2020-05-18T21:27:31.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.885+0000 7fdbde40a700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbd80af5b0 0x7fdbd8149b30 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7fdbd814d7b0 tx=0x7fdbd400c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:31.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.889+0000 7fdbc77fe700 1 -- 172.21.15.63:0/3465515323 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 5 and data pool 6 v11) v1 ==== 187+0+0 (secure 0 0 0) 0x7fdbd40411b0 con 0x7fdbd80af5b0 2020-05-18T21:27:31.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.893+0000 7fdbe066e700 1 -- 172.21.15.63:0/3465515323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbb804f9b0 msgr2=0x7fdbb8051e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:31.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.893+0000 7fdbe066e700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbb804f9b0 0x7fdbb8051e70 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fdbc8002f70 tx=0x7fdbc8007a80).stop 2020-05-18T21:27:31.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.893+0000 7fdbe066e700 1 -- 172.21.15.63:0/3465515323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbd80af5b0 msgr2=0x7fdbd8149b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:31.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.893+0000 7fdbe066e700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbd80af5b0 0x7fdbd8149b30 secure :-1 s=READY pgs=349 cs=0 l=1 rx=0x7fdbd814d7b0 tx=0x7fdbd400c4d0).stop 2020-05-18T21:27:31.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.893+0000 7fdbe066e700 1 -- 172.21.15.63:0/3465515323 shutdown_connections 2020-05-18T21:27:31.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.893+0000 7fdbe066e700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbb804f9b0 0x7fdbb8051e70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:31.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.893+0000 7fdbe066e700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbd814d930 0x7fdbd814cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:31.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.893+0000 7fdbe066e700 1 --2- 172.21.15.63:0/3465515323 >> v2:172.21.15.155:3300/0 conn(0x7fdbd80b61d0 0x7fdbd80b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:31.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.893+0000 7fdbe066e700 1 --2- 172.21.15.63:0/3465515323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbd80af5b0 0x7fdbd8149b30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:31.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.893+0000 7fdbe066e700 1 -- 172.21.15.63:0/3465515323 >> 172.21.15.63:0/3465515323 conn(0x7fdbd80b9770 msgr2=0x7fdbd809b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:31.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.897+0000 7fdbe066e700 1 -- 172.21.15.63:0/3465515323 shutdown_connections 2020-05-18T21:27:31.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:31.897+0000 7fdbe066e700 1 -- 172.21.15.63:0/3465515323 wait complete. 2020-05-18T21:27:31.911 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 5 and data pool 6 2020-05-18T21:27:31.922 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:27:32.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f5515fa5700 1 Processor -- start 2020-05-18T21:27:32.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f5515fa5700 1 -- start start 2020-05-18T21:27:32.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f5515fa5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 0x7f551006a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:32.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f5515fa5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f55100b3d30 0x7f55100b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:32.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f5515fa5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55100b79c0 con 0x7f5510149d90 2020-05-18T21:27:32.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f5515fa5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55100b7bf0 con 0x7f55100b3d30 2020-05-18T21:27:32.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f5515fa5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5510061c00 con 0x7f5510066f20 2020-05-18T21:27:32.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f550ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f55100b3d30 0x7f55100b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:32.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f550ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f55100b3d30 0x7f55100b41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54098/0 (socket says 172.21.15.63:54098) 2020-05-18T21:27:32.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f550ffff700 1 -- 172.21.15.63:0/3537666955 learned_addr learned my addr 172.21.15.63:0/3537666955 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:32.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f5506ffd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 0x7f551006a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:32.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f550effd700 1 -- 172.21.15.63:0/3537666955 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681010545 0 0) 0x7f55100b79c0 con 0x7f5510149d90 2020-05-18T21:27:32.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f550effd700 1 -- 172.21.15.63:0/3537666955 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54f0003270 con 0x7f5510149d90 2020-05-18T21:27:32.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f550ffff700 1 -- 172.21.15.63:0/3537666955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 msgr2=0x7f551006a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:32.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f550ffff700 1 --2- 172.21.15.63:0/3537666955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 0x7f551006a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:32.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f550ffff700 1 -- 172.21.15.63:0/3537666955 >> v1:172.21.15.155:6789/0 conn(0x7f5510149d90 legacy=0x7f55100b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:32.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f550ffff700 1 -- 172.21.15.63:0/3537666955 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55100b7e90 con 0x7f55100b3d30 2020-05-18T21:27:32.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f550ffff700 1 --2- 172.21.15.63:0/3537666955 >> v2:172.21.15.63:3300/0 conn(0x7f55100b3d30 0x7f55100b41c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f55080032f0 tx=0x7f5508007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f550ffff700 1 --2- 172.21.15.63:0/3537666955 >> v2:172.21.15.63:3300/0 conn(0x7f55100b3d30 0x7f55100b41c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f55080032f0 tx=0x7f5508007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f550ffff700 1 --2- 172.21.15.63:0/3537666955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55100b3d30 0x7f55100b41c0 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f55080032f0 tx=0x7f5508007e00).ready entity=mon.0 client_cookie=568cce0b1226198 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:32.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f550ffff700 1 --2- 172.21.15.63:0/3537666955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55100b3d30 0x7f55100b41c0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f55080032f0 tx=0x7f5508007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f550effd700 1 -- 172.21.15.63:0/3537666955 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5508011c60 con 0x7f55100b3d30 2020-05-18T21:27:32.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f550ffff700 1 --2- 172.21.15.63:0/3537666955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55100b3d30 0x7f55100b41c0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f55080032f0 tx=0x7f5508007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f550ffff700 1 --2- 172.21.15.63:0/3537666955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55100b3d30 0x7f55100b41c0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f55080032f0 tx=0x7f5508007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f550effd700 1 -- 172.21.15.63:0/3537666955 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5508011dc0 con 0x7f55100b3d30 2020-05-18T21:27:32.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f550effd700 1 -- 172.21.15.63:0/3537666955 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f550800a370 con 0x7f55100b3d30 2020-05-18T21:27:32.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f5515fa5700 1 -- 172.21.15.63:0/3537666955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55100b3d30 msgr2=0x7f55100b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:32.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.013+0000 7f5515fa5700 1 --2- 172.21.15.63:0/3537666955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55100b3d30 0x7f55100b41c0 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f55080032f0 tx=0x7f5508007e00).stop 2020-05-18T21:27:32.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f5515fa5700 1 -- 172.21.15.63:0/3537666955 shutdown_connections 2020-05-18T21:27:32.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f5515fa5700 1 --2- 172.21.15.63:0/3537666955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55100b3d30 0x7f55100b41c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:32.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f5515fa5700 1 --2- 172.21.15.63:0/3537666955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 0x7f551006a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:32.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f5515fa5700 1 -- 172.21.15.63:0/3537666955 >> 172.21.15.63:0/3537666955 conn(0x7f551005b240 msgr2=0x7f5510069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:32.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f5515fa5700 1 -- 172.21.15.63:0/3537666955 shutdown_connections 2020-05-18T21:27:32.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f5515fa5700 1 -- 172.21.15.63:0/3537666955 wait complete. 2020-05-18T21:27:32.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f5515fa5700 1 Processor -- start 2020-05-18T21:27:32.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f5515fa5700 1 -- start start 2020-05-18T21:27:32.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f5515fa5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 0x7f55100b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:32.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f5515fa5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55100b3d30 0x7f5510144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:32.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f5515fa5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551015ae10 con 0x7f5510149d90 2020-05-18T21:27:32.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f5515fa5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5510158360 con 0x7f55100b3d30 2020-05-18T21:27:32.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f5515fa5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551015b0b0 con 0x7f5510066f20 2020-05-18T21:27:32.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f550ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5510149d90 0x7f55100aecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56292/0 (socket says 172.21.15.63:56292) 2020-05-18T21:27:32.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f550ffff700 1 -- 172.21.15.63:0/3520222106 learned_addr learned my addr 172.21.15.63:0/3520222106 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:32.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f550f7fe700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 0x7f55100b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:32.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f5506ffd700 1 --2- 172.21.15.63:0/3520222106 >> v2:172.21.15.155:3300/0 conn(0x7f55100b3d30 0x7f5510144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:32.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f550d7fa700 1 -- 172.21.15.63:0/3520222106 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742458087 0 0) 0x7f551015ae10 con 0x7f5510149d90 2020-05-18T21:27:32.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f550d7fa700 1 -- 172.21.15.63:0/3520222106 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54f4002fe0 con 0x7f5510149d90 2020-05-18T21:27:32.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f550f7fe700 1 -- 172.21.15.63:0/3520222106 >> v2:172.21.15.155:3300/0 conn(0x7f55100b3d30 msgr2=0x7f5510144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:32.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f550f7fe700 1 --2- 172.21.15.63:0/3520222106 >> v2:172.21.15.155:3300/0 conn(0x7f55100b3d30 0x7f5510144650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:32.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f550f7fe700 1 -- 172.21.15.63:0/3520222106 >> v1:172.21.15.63:6789/0 conn(0x7f5510149d90 legacy=0x7f55100aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:32.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.017+0000 7f550f7fe700 1 -- 172.21.15.63:0/3520222106 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551015b350 con 0x7f5510066f20 2020-05-18T21:27:32.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.021+0000 7f550f7fe700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 0x7f55100b12c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5500001110 tx=0x7f5500001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.021+0000 7f550f7fe700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 0x7f55100b12c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5500001110 tx=0x7f5500001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.021+0000 7f550f7fe700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 0x7f55100b12c0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f5500001110 tx=0x7f5500001e80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:32.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.021+0000 7f550f7fe700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 0x7f55100b12c0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f5500001110 tx=0x7f5500001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.021+0000 7f550d7fa700 1 -- 172.21.15.63:0/3520222106 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f550000cd50 con 0x7f5510066f20 2020-05-18T21:27:32.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.021+0000 7f550f7fe700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 0x7f55100b12c0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f5500001110 tx=0x7f5500001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.021+0000 7f5515fa5700 1 -- 172.21.15.63:0/3520222106 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55100b3010 con 0x7f5510066f20 2020-05-18T21:27:32.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.021+0000 7f550d7fa700 1 -- 172.21.15.63:0/3520222106 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550000e180 con 0x7f5510066f20 2020-05-18T21:27:32.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.021+0000 7f550f7fe700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 0x7f55100b12c0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f5500001110 tx=0x7f5500001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.021+0000 7f550d7fa700 1 -- 172.21.15.63:0/3520222106 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f550000e560 con 0x7f5510066f20 2020-05-18T21:27:32.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.021+0000 7f5515fa5700 1 -- 172.21.15.63:0/3520222106 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551015b7f0 con 0x7f5510066f20 2020-05-18T21:27:32.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.021+0000 7f550f7fe700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 0x7f55100b12c0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f5500001110 tx=0x7f5500001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.021+0000 7f5515fa5700 1 -- 172.21.15.63:0/3520222106 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55100569e0 con 0x7f5510066f20 2020-05-18T21:27:32.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.021+0000 7f550d7fa700 1 -- 172.21.15.63:0/3520222106 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f550000e7e0 con 0x7f5510066f20 2020-05-18T21:27:32.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.021+0000 7f550f7fe700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 0x7f55100b12c0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f5500001110 tx=0x7f5500001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.021+0000 7f550d7fa700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f54f404fdb0 0x7f54f4052270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:32.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.021+0000 7f550d7fa700 1 -- 172.21.15.63:0/3520222106 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f55000637f0 con 0x7f5510066f20 2020-05-18T21:27:32.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.021+0000 7f5506ffd700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f54f404fdb0 0x7f54f4052270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:32.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.025+0000 7f5506ffd700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f54f404fdb0 0x7f54f4052270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f54f8002f70 tx=0x7f54f8002f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.025+0000 7f5506ffd700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f54f404fdb0 0x7f54f4052270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f54f8002f70 tx=0x7f54f8002f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.025+0000 7f5506ffd700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f54f404fdb0 0x7f54f4052270 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7f54f8002f70 tx=0x7f54f8002f10).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:32.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.033+0000 7f550f7fe700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 0x7f55100b12c0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f5500001110 tx=0x7f5500001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.033+0000 7f550d7fa700 1 -- 172.21.15.63:0/3520222106 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f550003db20 con 0x7f5510066f20 2020-05-18T21:27:32.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.149+0000 7f5515fa5700 1 -- 172.21.15.63:0/3520222106 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55100008d0 con 0x7f5510066f20 2020-05-18T21:27:32.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.153+0000 7f550f7fe700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 0x7f55100b12c0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f5500001110 tx=0x7f5500001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.153+0000 7f550d7fa700 1 -- 172.21.15.63:0/3520222106 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16102 (secure 0 0 0) 0x7f5500041140 con 0x7f5510066f20 2020-05-18T21:27:32.161 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:32.161 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":32,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:27:31.884116+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:27:29.817430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2020-05-18T21:27:30.879596+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:27:32.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.157+0000 7f5515fa5700 1 -- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f54f404fdb0 msgr2=0x7f54f4052270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:32.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.157+0000 7f5515fa5700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f54f404fdb0 0x7f54f4052270 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7f54f8002f70 tx=0x7f54f8002f10).stop 2020-05-18T21:27:32.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.157+0000 7f5515fa5700 1 -- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 msgr2=0x7f55100b12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:32.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.157+0000 7f5515fa5700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 0x7f55100b12c0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f5500001110 tx=0x7f5500001e80).stop 2020-05-18T21:27:32.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.157+0000 7f5515fa5700 1 -- 172.21.15.63:0/3520222106 shutdown_connections 2020-05-18T21:27:32.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.157+0000 7f5515fa5700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f54f404fdb0 0x7f54f4052270 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:32.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.157+0000 7f5515fa5700 1 --2- 172.21.15.63:0/3520222106 >> v2:172.21.15.155:3300/0 conn(0x7f55100b3d30 0x7f5510144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:32.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.157+0000 7f5515fa5700 1 --2- 172.21.15.63:0/3520222106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5510066f20 0x7f55100b12c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:32.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.157+0000 7f5515fa5700 1 -- 172.21.15.63:0/3520222106 >> 172.21.15.63:0/3520222106 conn(0x7f551005b240 msgr2=0x7f55101489d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:32.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.157+0000 7f5515fa5700 1 -- 172.21.15.63:0/3520222106 shutdown_connections 2020-05-18T21:27:32.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.157+0000 7f5515fa5700 1 -- 172.21.15.63:0/3520222106 wait complete. 2020-05-18T21:27:32.180 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:27:32.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.277+0000 7fda8480d700 1 Processor -- start 2020-05-18T21:27:32.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.277+0000 7fda8480d700 1 -- start start 2020-05-18T21:27:32.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda8480d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fda800bbcd0 0x7fda800afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:32.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda8480d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda800b0280 0x7fda8012efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:32.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda8480d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda800af980 con 0x7fda800bb5e0 2020-05-18T21:27:32.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda8480d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda800af7a0 con 0x7fda800bbcd0 2020-05-18T21:27:32.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda8480d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda800bb9c0 con 0x7fda800b0280 2020-05-18T21:27:32.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda7dd9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fda800bbcd0 0x7fda800afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:32.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda7ed9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda800b0280 0x7fda8012efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:32.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda7dd9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fda800bbcd0 0x7fda800afe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54110/0 (socket says 172.21.15.63:54110) 2020-05-18T21:27:32.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda7dd9b700 1 -- 172.21.15.63:0/2310291135 learned_addr learned my addr 172.21.15.63:0/2310291135 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:32.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda7ed9d700 1 -- 172.21.15.63:0/2310291135 >> v2:172.21.15.63:3300/0 conn(0x7fda800bbcd0 msgr2=0x7fda800afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:32.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda7ed9d700 1 --2- 172.21.15.63:0/2310291135 >> v2:172.21.15.63:3300/0 conn(0x7fda800bbcd0 0x7fda800afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:32.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda7d59a700 1 -- 172.21.15.63:0/2310291135 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676347378 0 0) 0x7fda800af980 con 0x7fda800bb5e0 2020-05-18T21:27:32.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda7ed9d700 1 -- 172.21.15.63:0/2310291135 >> v1:172.21.15.155:6789/0 conn(0x7fda800bb5e0 legacy=0x7fda800acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:32.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda7ed9d700 1 -- 172.21.15.63:0/2310291135 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda800af3d0 con 0x7fda800b0280 2020-05-18T21:27:32.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda7dd9b700 1 --2- 172.21.15.63:0/2310291135 >> v2:172.21.15.63:3300/0 conn(0x7fda800bbcd0 0x7fda800afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:32.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda7ed9d700 1 --2- 172.21.15.63:0/2310291135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda800b0280 0x7fda8012efd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fda78002f70 tx=0x7fda78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda7ed9d700 1 --2- 172.21.15.63:0/2310291135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda800b0280 0x7fda8012efd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fda78002f70 tx=0x7fda78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda7ed9d700 1 --2- 172.21.15.63:0/2310291135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda800b0280 0x7fda8012efd0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7fda78002f70 tx=0x7fda78007a80).ready entity=mon.2 client_cookie=b47a0f04a0fa6b1d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:32.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda7ed9d700 1 --2- 172.21.15.63:0/2310291135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda800b0280 0x7fda8012efd0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fda78002f70 tx=0x7fda78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda7d59a700 1 -- 172.21.15.63:0/2310291135 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda78008e80 con 0x7fda800b0280 2020-05-18T21:27:32.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda7ed9d700 1 --2- 172.21.15.63:0/2310291135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda800b0280 0x7fda8012efd0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fda78002f70 tx=0x7fda78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda7ed9d700 1 --2- 172.21.15.63:0/2310291135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda800b0280 0x7fda8012efd0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fda78002f70 tx=0x7fda78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda7d59a700 1 -- 172.21.15.63:0/2310291135 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda780115f0 con 0x7fda800b0280 2020-05-18T21:27:32.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda7d59a700 1 -- 172.21.15.63:0/2310291135 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda780119d0 con 0x7fda800b0280 2020-05-18T21:27:32.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda8480d700 1 -- 172.21.15.63:0/2310291135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda800b0280 msgr2=0x7fda8012efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:32.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda8480d700 1 --2- 172.21.15.63:0/2310291135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda800b0280 0x7fda8012efd0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7fda78002f70 tx=0x7fda78007a80).stop 2020-05-18T21:27:32.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda8480d700 1 -- 172.21.15.63:0/2310291135 shutdown_connections 2020-05-18T21:27:32.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda8480d700 1 --2- 172.21.15.63:0/2310291135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda800b0280 0x7fda8012efd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:32.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda8480d700 1 --2- 172.21.15.63:0/2310291135 >> v2:172.21.15.63:3300/0 conn(0x7fda800bbcd0 0x7fda800afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:32.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda8480d700 1 -- 172.21.15.63:0/2310291135 >> 172.21.15.63:0/2310291135 conn(0x7fda80069b70 msgr2=0x7fda80069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:32.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda8480d700 1 -- 172.21.15.63:0/2310291135 shutdown_connections 2020-05-18T21:27:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.281+0000 7fda8480d700 1 -- 172.21.15.63:0/2310291135 wait complete. 2020-05-18T21:27:32.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.285+0000 7fda8480d700 1 Processor -- start 2020-05-18T21:27:32.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.285+0000 7fda8480d700 1 -- start start 2020-05-18T21:27:32.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.285+0000 7fda8480d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fda800b0280 0x7fda800b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:32.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.285+0000 7fda8480d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda800b2540 con 0x7fda800bb5e0 2020-05-18T21:27:32.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.285+0000 7fda8480d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda800b27e0 con 0x7fda800bbcd0 2020-05-18T21:27:32.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.285+0000 7fda8480d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda800b69f0 con 0x7fda800b0280 2020-05-18T21:27:32.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.285+0000 7fda7dd9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fda800bb5e0 0x7fda801457b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56304/0 (socket says 172.21.15.63:56304) 2020-05-18T21:27:32.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.285+0000 7fda7dd9b700 1 -- 172.21.15.63:0/341853725 learned_addr learned my addr 172.21.15.63:0/341853725 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:32.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.285+0000 7fda7e59c700 1 --2- 172.21.15.63:0/341853725 >> v2:172.21.15.155:3300/0 conn(0x7fda800b0280 0x7fda800b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:32.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.285+0000 7fda777fe700 1 -- 172.21.15.63:0/341853725 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643145181 0 0) 0x7fda800b2540 con 0x7fda800bb5e0 2020-05-18T21:27:32.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.285+0000 7fda777fe700 1 -- 172.21.15.63:0/341853725 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda64002fe0 con 0x7fda800bb5e0 2020-05-18T21:27:32.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.285+0000 7fda7e59c700 1 -- 172.21.15.63:0/341853725 >> v1:172.21.15.155:6789/0 conn(0x7fda800bbcd0 legacy=0x7fda800b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:32.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.285+0000 7fda777fe700 1 -- 172.21.15.63:0/341853725 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291650728 0 0) 0x7fda800b27e0 con 0x7fda800bbcd0 2020-05-18T21:27:32.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.285+0000 7fda7e59c700 1 -- 172.21.15.63:0/341853725 >> v1:172.21.15.63:6789/0 conn(0x7fda800bb5e0 legacy=0x7fda801457b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:32.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.285+0000 7fda7e59c700 1 -- 172.21.15.63:0/341853725 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda800b2a80 con 0x7fda800b0280 2020-05-18T21:27:32.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.285+0000 7fda7e59c700 1 --2- 172.21.15.63:0/341853725 >> v2:172.21.15.155:3300/0 conn(0x7fda800b0280 0x7fda800b6590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fda68007a80 tx=0x7fda70010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.285+0000 7fda7e59c700 1 --2- 172.21.15.63:0/341853725 >> v2:172.21.15.155:3300/0 conn(0x7fda800b0280 0x7fda800b6590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fda68007a80 tx=0x7fda70010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.285+0000 7fda7e59c700 1 --2- 172.21.15.63:0/341853725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda800b0280 0x7fda800b6590 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7fda68007a80 tx=0x7fda70010cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:32.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.289+0000 7fda7e59c700 1 --2- 172.21.15.63:0/341853725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda800b0280 0x7fda800b6590 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fda68007a80 tx=0x7fda70010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.289+0000 7fda777fe700 1 -- 172.21.15.63:0/341853725 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda70006c80 con 0x7fda800b0280 2020-05-18T21:27:32.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.289+0000 7fda7e59c700 1 --2- 172.21.15.63:0/341853725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda800b0280 0x7fda800b6590 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fda68007a80 tx=0x7fda70010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.289+0000 7fda777fe700 1 -- 172.21.15.63:0/341853725 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda70006de0 con 0x7fda800b0280 2020-05-18T21:27:32.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.289+0000 7fda7e59c700 1 --2- 172.21.15.63:0/341853725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda800b0280 0x7fda800b6590 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fda68007a80 tx=0x7fda70010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.289+0000 7fda8480d700 1 -- 172.21.15.63:0/341853725 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda80157810 con 0x7fda800b0280 2020-05-18T21:27:32.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.289+0000 7fda777fe700 1 -- 172.21.15.63:0/341853725 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda700024c0 con 0x7fda800b0280 2020-05-18T21:27:32.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.289+0000 7fda8480d700 1 -- 172.21.15.63:0/341853725 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda800b20a0 con 0x7fda800b0280 2020-05-18T21:27:32.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.289+0000 7fda8480d700 1 -- 172.21.15.63:0/341853725 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda800b23b0 con 0x7fda800b0280 2020-05-18T21:27:32.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.289+0000 7fda7e59c700 1 --2- 172.21.15.63:0/341853725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda800b0280 0x7fda800b6590 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fda68007a80 tx=0x7fda70010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.289+0000 7fda777fe700 1 -- 172.21.15.63:0/341853725 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fda700026c0 con 0x7fda800b0280 2020-05-18T21:27:32.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.289+0000 7fda7e59c700 1 --2- 172.21.15.63:0/341853725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda800b0280 0x7fda800b6590 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fda68007a80 tx=0x7fda70010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.289+0000 7fda777fe700 1 --2- 172.21.15.63:0/341853725 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fda6404fca0 0x7fda64052160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:32.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.289+0000 7fda777fe700 1 -- 172.21.15.63:0/341853725 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fda7000b0b0 con 0x7fda800b0280 2020-05-18T21:27:32.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.289+0000 7fda7dd9b700 1 --2- 172.21.15.63:0/341853725 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fda6404fca0 0x7fda64052160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:32.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.293+0000 7fda7dd9b700 1 --2- 172.21.15.63:0/341853725 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fda6404fca0 0x7fda64052160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fda68007720 tx=0x7fda680023c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.293+0000 7fda7dd9b700 1 --2- 172.21.15.63:0/341853725 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fda6404fca0 0x7fda64052160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fda68007720 tx=0x7fda680023c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.293+0000 7fda7dd9b700 1 --2- 172.21.15.63:0/341853725 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fda6404fca0 0x7fda64052160 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7fda68007720 tx=0x7fda680023c0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:32.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.297+0000 7fda7e59c700 1 --2- 172.21.15.63:0/341853725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda800b0280 0x7fda800b6590 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fda68007a80 tx=0x7fda70010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.297+0000 7fda777fe700 1 -- 172.21.15.63:0/341853725 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fda70041c60 con 0x7fda800b0280 2020-05-18T21:27:32.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.413+0000 7fda8480d700 1 -- 172.21.15.63:0/341853725 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda800b2c10 con 0x7fda800b0280 2020-05-18T21:27:32.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.417+0000 7fda7e59c700 1 --2- 172.21.15.63:0/341853725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda800b0280 0x7fda800b6590 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fda68007a80 tx=0x7fda70010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.417+0000 7fda777fe700 1 -- 172.21.15.63:0/341853725 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16102 (secure 0 0 0) 0x7fda70041850 con 0x7fda800b0280 2020-05-18T21:27:32.424 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:32.424 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":32,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:27:31.884116+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:27:29.817430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2020-05-18T21:27:30.879596+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:27:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.417+0000 7fda8480d700 1 -- 172.21.15.63:0/341853725 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fda6404fca0 msgr2=0x7fda64052160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.417+0000 7fda8480d700 1 --2- 172.21.15.63:0/341853725 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fda6404fca0 0x7fda64052160 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7fda68007720 tx=0x7fda680023c0).stop 2020-05-18T21:27:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.417+0000 7fda8480d700 1 -- 172.21.15.63:0/341853725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda800b0280 msgr2=0x7fda800b6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.417+0000 7fda8480d700 1 --2- 172.21.15.63:0/341853725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda800b0280 0x7fda800b6590 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7fda68007a80 tx=0x7fda70010cb0).stop 2020-05-18T21:27:32.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.417+0000 7fda8480d700 1 -- 172.21.15.63:0/341853725 shutdown_connections 2020-05-18T21:27:32.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.417+0000 7fda8480d700 1 --2- 172.21.15.63:0/341853725 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fda6404fca0 0x7fda64052160 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:32.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.417+0000 7fda8480d700 1 --2- 172.21.15.63:0/341853725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda800b0280 0x7fda800b6590 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:32.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.417+0000 7fda8480d700 1 -- 172.21.15.63:0/341853725 >> 172.21.15.63:0/341853725 conn(0x7fda80069b70 msgr2=0x7fda8005c280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:32.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.417+0000 7fda8480d700 1 -- 172.21.15.63:0/341853725 shutdown_connections 2020-05-18T21:27:32.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.417+0000 7fda8480d700 1 -- 172.21.15.63:0/341853725 wait complete. 2020-05-18T21:27:32.437 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-05-18T21:27:32.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.541+0000 7fee85396700 1 Processor -- start 2020-05-18T21:27:32.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.541+0000 7fee85396700 1 -- start start 2020-05-18T21:27:32.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.541+0000 7fee85396700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fee80060b00 0x7fee80145e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:32.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.541+0000 7fee85396700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee80146420 con 0x7fee800bc8d0 2020-05-18T21:27:32.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.541+0000 7fee85396700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee801466c0 con 0x7fee80143630 2020-05-18T21:27:32.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.541+0000 7fee85396700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee80146e00 con 0x7fee80060b00 2020-05-18T21:27:32.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.541+0000 7fee7ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fee800bc8d0 0x7fee80142f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56310/0 (socket says 172.21.15.63:56310) 2020-05-18T21:27:32.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.541+0000 7fee7ffff700 1 -- 172.21.15.63:0/2154841954 learned_addr learned my addr 172.21.15.63:0/2154841954 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:32.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.541+0000 7fee84b95700 1 --2- 172.21.15.63:0/2154841954 >> v2:172.21.15.155:3300/0 conn(0x7fee80060b00 0x7fee80145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:32.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.541+0000 7fee7effd700 1 -- 172.21.15.63:0/2154841954 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827328035 0 0) 0x7fee80146420 con 0x7fee800bc8d0 2020-05-18T21:27:32.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.541+0000 7fee7effd700 1 -- 172.21.15.63:0/2154841954 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee6c003270 con 0x7fee800bc8d0 2020-05-18T21:27:32.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.541+0000 7fee7effd700 1 -- 172.21.15.63:0/2154841954 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378243615 0 0) 0x7fee801466c0 con 0x7fee80143630 2020-05-18T21:27:32.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.541+0000 7fee7effd700 1 -- 172.21.15.63:0/2154841954 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee80146420 con 0x7fee80143630 2020-05-18T21:27:32.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.541+0000 7fee7effd700 1 -- 172.21.15.63:0/2154841954 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3819505255 0 0) 0x7fee6c003270 con 0x7fee800bc8d0 2020-05-18T21:27:32.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.541+0000 7fee84b95700 1 -- 172.21.15.63:0/2154841954 >> v1:172.21.15.155:6789/0 conn(0x7fee80143630 legacy=0x7fee8012e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:32.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.541+0000 7fee84b95700 1 -- 172.21.15.63:0/2154841954 >> v1:172.21.15.63:6789/0 conn(0x7fee800bc8d0 legacy=0x7fee80142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:32.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.541+0000 7fee84b95700 1 -- 172.21.15.63:0/2154841954 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee80146960 con 0x7fee80060b00 2020-05-18T21:27:32.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.541+0000 7fee84b95700 1 --2- 172.21.15.63:0/2154841954 >> v2:172.21.15.155:3300/0 conn(0x7fee80060b00 0x7fee80145e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fee74001110 tx=0x7fee78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.545+0000 7fee84b95700 1 --2- 172.21.15.63:0/2154841954 >> v2:172.21.15.155:3300/0 conn(0x7fee80060b00 0x7fee80145e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fee74001110 tx=0x7fee78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.545+0000 7fee84b95700 1 --2- 172.21.15.63:0/2154841954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee80060b00 0x7fee80145e30 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7fee74001110 tx=0x7fee78007e00).ready entity=mon.1 client_cookie=5db4ca5219cc1a11 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:32.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.545+0000 7fee84b95700 1 --2- 172.21.15.63:0/2154841954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee80060b00 0x7fee80145e30 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7fee74001110 tx=0x7fee78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.545+0000 7fee7effd700 1 -- 172.21.15.63:0/2154841954 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee74001710 con 0x7fee80060b00 2020-05-18T21:27:32.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.545+0000 7fee84b95700 1 --2- 172.21.15.63:0/2154841954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee80060b00 0x7fee80145e30 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7fee74001110 tx=0x7fee78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.545+0000 7fee84b95700 1 --2- 172.21.15.63:0/2154841954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee80060b00 0x7fee80145e30 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7fee74001110 tx=0x7fee78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.545+0000 7fee7effd700 1 -- 172.21.15.63:0/2154841954 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee78011ac0 con 0x7fee80060b00 2020-05-18T21:27:32.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.545+0000 7fee7effd700 1 -- 172.21.15.63:0/2154841954 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee78011e60 con 0x7fee80060b00 2020-05-18T21:27:32.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.545+0000 7fee85396700 1 -- 172.21.15.63:0/2154841954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee80060b00 msgr2=0x7fee80145e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:32.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.545+0000 7fee85396700 1 --2- 172.21.15.63:0/2154841954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee80060b00 0x7fee80145e30 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7fee74001110 tx=0x7fee78007e00).stop 2020-05-18T21:27:32.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.545+0000 7fee85396700 1 -- 172.21.15.63:0/2154841954 shutdown_connections 2020-05-18T21:27:32.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.545+0000 7fee85396700 1 --2- 172.21.15.63:0/2154841954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee80060b00 0x7fee80145e30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:32.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.545+0000 7fee85396700 1 -- 172.21.15.63:0/2154841954 >> 172.21.15.63:0/2154841954 conn(0x7fee8005f3b0 msgr2=0x7fee8005f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:32.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.545+0000 7fee85396700 1 -- 172.21.15.63:0/2154841954 shutdown_connections 2020-05-18T21:27:32.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.545+0000 7fee85396700 1 -- 172.21.15.63:0/2154841954 wait complete. 2020-05-18T21:27:32.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee85396700 1 Processor -- start 2020-05-18T21:27:32.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee85396700 1 -- start start 2020-05-18T21:27:32.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee85396700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fee80060b00 0x7fee80145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:32.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee85396700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee800bc8d0 0x7fee80157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:32.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee85396700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fee80143630 0x7fee800b9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:32.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee85396700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee801577a0 con 0x7fee80143630 2020-05-18T21:27:32.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee85396700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee800b9c60 con 0x7fee80060b00 2020-05-18T21:27:32.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee84b95700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fee80143630 0x7fee800b9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:32.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee84b95700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fee80143630 0x7fee800b9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54132/0 (socket says 172.21.15.63:54132) 2020-05-18T21:27:32.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee84b95700 1 -- 172.21.15.63:0/3574978311 learned_addr learned my addr 172.21.15.63:0/3574978311 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:32.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee7ffff700 1 --2- 172.21.15.63:0/3574978311 >> v2:172.21.15.155:3300/0 conn(0x7fee80060b00 0x7fee80145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:32.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee7f7fe700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee800bc8d0 0x7fee80157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:32.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee85396700 1 -- 172.21.15.63:0/3574978311 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee801536a0 con 0x7fee800bc8d0 2020-05-18T21:27:32.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee84b95700 1 -- 172.21.15.63:0/3574978311 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee800bc8d0 msgr2=0x7fee80157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:32.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee84b95700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee800bc8d0 0x7fee80157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:32.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee84b95700 1 -- 172.21.15.63:0/3574978311 >> v2:172.21.15.155:3300/0 conn(0x7fee80060b00 msgr2=0x7fee80145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:32.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee84b95700 1 --2- 172.21.15.63:0/3574978311 >> v2:172.21.15.155:3300/0 conn(0x7fee80060b00 0x7fee80145bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:32.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee84b95700 1 -- 172.21.15.63:0/3574978311 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee80153940 con 0x7fee80143630 2020-05-18T21:27:32.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee84b95700 1 --2- 172.21.15.63:0/3574978311 >> v2:172.21.15.63:3300/0 conn(0x7fee80143630 0x7fee800b9800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee74001110 tx=0x7fee78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee84b95700 1 --2- 172.21.15.63:0/3574978311 >> v2:172.21.15.63:3300/0 conn(0x7fee80143630 0x7fee800b9800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee74001110 tx=0x7fee78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee84b95700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee80143630 0x7fee800b9800 secure :-1 s=READY pgs=354 cs=0 l=1 rx=0x7fee74001110 tx=0x7fee78007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:32.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee84b95700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee80143630 0x7fee800b9800 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fee74001110 tx=0x7fee78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee84b95700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee80143630 0x7fee800b9800 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fee74001110 tx=0x7fee78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.549+0000 7fee7d7fa700 1 -- 172.21.15.63:0/3574978311 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee78005c70 con 0x7fee80143630 2020-05-18T21:27:32.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.553+0000 7fee84b95700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee80143630 0x7fee800b9800 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fee74001110 tx=0x7fee78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.553+0000 7fee7d7fa700 1 -- 172.21.15.63:0/3574978311 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee78005dd0 con 0x7fee80143630 2020-05-18T21:27:32.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.553+0000 7fee85396700 1 -- 172.21.15.63:0/3574978311 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee80153390 con 0x7fee80143630 2020-05-18T21:27:32.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.553+0000 7fee7d7fa700 1 -- 172.21.15.63:0/3574978311 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee78007360 con 0x7fee80143630 2020-05-18T21:27:32.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.553+0000 7fee85396700 1 -- 172.21.15.63:0/3574978311 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee80154000 con 0x7fee80143630 2020-05-18T21:27:32.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.553+0000 7fee84b95700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee80143630 0x7fee800b9800 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fee74001110 tx=0x7fee78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.553+0000 7fee85396700 1 -- 172.21.15.63:0/3574978311 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee80154310 con 0x7fee80143630 2020-05-18T21:27:32.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.553+0000 7fee7d7fa700 1 -- 172.21.15.63:0/3574978311 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fee780077e0 con 0x7fee80143630 2020-05-18T21:27:32.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.553+0000 7fee84b95700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee80143630 0x7fee800b9800 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fee74001110 tx=0x7fee78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.553+0000 7fee7d7fa700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee6004f9f0 0x7fee60051eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:32.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.553+0000 7fee7d7fa700 1 -- 172.21.15.63:0/3574978311 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fee78064940 con 0x7fee80143630 2020-05-18T21:27:32.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.553+0000 7fee7ffff700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee6004f9f0 0x7fee60051eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:32.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.553+0000 7fee7ffff700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee6004f9f0 0x7fee60051eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee74000fe0 tx=0x7fee7400caf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.553+0000 7fee7ffff700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee6004f9f0 0x7fee60051eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee74000fe0 tx=0x7fee7400caf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.553+0000 7fee7ffff700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee6004f9f0 0x7fee60051eb0 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7fee74000fe0 tx=0x7fee7400caf0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:32.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.561+0000 7fee84b95700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee80143630 0x7fee800b9800 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fee74001110 tx=0x7fee78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.561+0000 7fee7d7fa700 1 -- 172.21.15.63:0/3574978311 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fee7803ed30 con 0x7fee80143630 2020-05-18T21:27:32.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.709+0000 7fee85396700 1 -- 172.21.15.63:0/3574978311 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fee800569e0 con 0x7fee80143630 2020-05-18T21:27:32.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.901+0000 7fee84b95700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee80143630 0x7fee800b9800 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fee74001110 tx=0x7fee78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:32.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.901+0000 7fee7d7fa700 1 -- 172.21.15.63:0/3574978311 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7fee78042350 con 0x7fee80143630 2020-05-18T21:27:32.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.901+0000 7fee85396700 1 -- 172.21.15.63:0/3574978311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee6004f9f0 msgr2=0x7fee60051eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:32.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.901+0000 7fee85396700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee6004f9f0 0x7fee60051eb0 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7fee74000fe0 tx=0x7fee7400caf0).stop 2020-05-18T21:27:32.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.901+0000 7fee85396700 1 -- 172.21.15.63:0/3574978311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee80143630 msgr2=0x7fee800b9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:32.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.901+0000 7fee85396700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee80143630 0x7fee800b9800 secure :-1 s=READY pgs=354 cs=0 l=1 rx=0x7fee74001110 tx=0x7fee78007e00).stop 2020-05-18T21:27:32.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.901+0000 7fee85396700 1 -- 172.21.15.63:0/3574978311 shutdown_connections 2020-05-18T21:27:32.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.901+0000 7fee85396700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee6004f9f0 0x7fee60051eb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:32.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.901+0000 7fee85396700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee80143630 0x7fee800b9800 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:32.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.901+0000 7fee85396700 1 --2- 172.21.15.63:0/3574978311 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee800bc8d0 0x7fee80157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:32.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.901+0000 7fee85396700 1 --2- 172.21.15.63:0/3574978311 >> v2:172.21.15.155:3300/0 conn(0x7fee80060b00 0x7fee80145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:32.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.901+0000 7fee85396700 1 -- 172.21.15.63:0/3574978311 >> 172.21.15.63:0/3574978311 conn(0x7fee8005f3b0 msgr2=0x7fee800baee0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:32.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.901+0000 7fee85396700 1 -- 172.21.15.63:0/3574978311 shutdown_connections 2020-05-18T21:27:32.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:32.901+0000 7fee85396700 1 -- 172.21.15.63:0/3574978311 wait complete. 2020-05-18T21:27:32.922 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:27:33.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.021+0000 7f6e370f5700 1 Processor -- start 2020-05-18T21:27:33.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.021+0000 7f6e370f5700 1 -- start start 2020-05-18T21:27:33.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.021+0000 7f6e370f5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6e300b71e0 0x7f6e30144520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:33.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.021+0000 7f6e370f5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e30144080 con 0x7f6e30063370 2020-05-18T21:27:33.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.021+0000 7f6e370f5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e30143b10 con 0x7f6e30147110 2020-05-18T21:27:33.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.021+0000 7f6e370f5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e300b75c0 con 0x7f6e300b71e0 2020-05-18T21:27:33.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e360f3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6e300b71e0 0x7f6e30144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:33.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e368f4700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6e30063370 0x7f6e300649b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56328/0 (socket says 172.21.15.63:56328) 2020-05-18T21:27:33.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e368f4700 1 -- 172.21.15.63:0/3203659368 learned_addr learned my addr 172.21.15.63:0/3203659368 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:33.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e360f3700 1 -- 172.21.15.63:0/3203659368 >> v1:172.21.15.155:6789/0 conn(0x7f6e30147110 legacy=0x7f6e3012cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e360f3700 1 -- 172.21.15.63:0/3203659368 >> v1:172.21.15.63:6789/0 conn(0x7f6e30063370 legacy=0x7f6e300649b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e360f3700 1 -- 172.21.15.63:0/3203659368 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e30144980 con 0x7f6e300b71e0 2020-05-18T21:27:33.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e360f3700 1 --2- 172.21.15.63:0/3203659368 >> v2:172.21.15.63:3300/0 conn(0x7f6e300b71e0 0x7f6e30144520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6e280032f0 tx=0x7f6e30066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e360f3700 1 --2- 172.21.15.63:0/3203659368 >> v2:172.21.15.63:3300/0 conn(0x7f6e300b71e0 0x7f6e30144520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6e280032f0 tx=0x7f6e30066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e360f3700 1 --2- 172.21.15.63:0/3203659368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e300b71e0 0x7f6e30144520 secure :-1 s=READY pgs=356 cs=0 l=1 rx=0x7f6e280032f0 tx=0x7f6e30066620).ready entity=mon.0 client_cookie=6ebd4312dc0b1ea server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:33.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e360f3700 1 --2- 172.21.15.63:0/3203659368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e300b71e0 0x7f6e30144520 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7f6e280032f0 tx=0x7f6e30066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e360f3700 1 --2- 172.21.15.63:0/3203659368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e300b71e0 0x7f6e30144520 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7f6e280032f0 tx=0x7f6e30066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e360f3700 1 --2- 172.21.15.63:0/3203659368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e300b71e0 0x7f6e30144520 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7f6e280032f0 tx=0x7f6e30066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e350f1700 1 -- 172.21.15.63:0/3203659368 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e2800a180 con 0x7f6e300b71e0 2020-05-18T21:27:33.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e350f1700 1 -- 172.21.15.63:0/3203659368 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2800a2e0 con 0x7f6e300b71e0 2020-05-18T21:27:33.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e370f5700 1 -- 172.21.15.63:0/3203659368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e300b71e0 msgr2=0x7f6e30144520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e370f5700 1 --2- 172.21.15.63:0/3203659368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e300b71e0 0x7f6e30144520 secure :-1 s=READY pgs=356 cs=0 l=1 rx=0x7f6e280032f0 tx=0x7f6e30066620).stop 2020-05-18T21:27:33.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e350f1700 1 -- 172.21.15.63:0/3203659368 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e2800a700 con 0x7f6e300b71e0 2020-05-18T21:27:33.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e370f5700 1 -- 172.21.15.63:0/3203659368 shutdown_connections 2020-05-18T21:27:33.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e370f5700 1 --2- 172.21.15.63:0/3203659368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e300b71e0 0x7f6e30144520 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:33.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e370f5700 1 -- 172.21.15.63:0/3203659368 >> 172.21.15.63:0/3203659368 conn(0x7f6e3005eee0 msgr2=0x7f6e3005f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:33.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e370f5700 1 -- 172.21.15.63:0/3203659368 shutdown_connections 2020-05-18T21:27:33.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e370f5700 1 -- 172.21.15.63:0/3203659368 wait complete. 2020-05-18T21:27:33.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e370f5700 1 Processor -- start 2020-05-18T21:27:33.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.025+0000 7f6e370f5700 1 -- start start 2020-05-18T21:27:33.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e370f5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6e30063370 0x7f6e30060310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:33.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e370f5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6e300b71e0 0x7f6e300b9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:33.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e370f5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e30147110 0x7f6e300b86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:33.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e370f5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e300b8b10 con 0x7f6e300b71e0 2020-05-18T21:27:33.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e370f5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e30061b50 con 0x7f6e30063370 2020-05-18T21:27:33.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e370f5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e300bb0c0 con 0x7f6e30147110 2020-05-18T21:27:33.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e358f2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6e300b71e0 0x7f6e300b9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:33.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e358f2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6e300b71e0 0x7f6e300b9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54146/0 (socket says 172.21.15.63:54146) 2020-05-18T21:27:33.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e358f2700 1 -- 172.21.15.63:0/2001481382 learned_addr learned my addr 172.21.15.63:0/2001481382 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:33.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e368f4700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e30147110 0x7f6e300b86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:33.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e360f3700 1 --2- 172.21.15.63:0/2001481382 >> v2:172.21.15.155:3300/0 conn(0x7f6e30063370 0x7f6e30060310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:33.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e358f2700 1 -- 172.21.15.63:0/2001481382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e30147110 msgr2=0x7f6e300b86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e358f2700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e30147110 0x7f6e300b86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:33.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e358f2700 1 -- 172.21.15.63:0/2001481382 >> v2:172.21.15.155:3300/0 conn(0x7f6e30063370 msgr2=0x7f6e30060310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e358f2700 1 --2- 172.21.15.63:0/2001481382 >> v2:172.21.15.155:3300/0 conn(0x7f6e30063370 0x7f6e30060310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:33.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e358f2700 1 -- 172.21.15.63:0/2001481382 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e300b9bf0 con 0x7f6e300b71e0 2020-05-18T21:27:33.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e360f3700 1 --2- 172.21.15.63:0/2001481382 >> v2:172.21.15.155:3300/0 conn(0x7f6e30063370 0x7f6e30060310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:27:33.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e358f2700 1 --2- 172.21.15.63:0/2001481382 >> v2:172.21.15.63:3300/0 conn(0x7f6e300b71e0 0x7f6e300b9200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6e30063d60 tx=0x7f6e20001e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e358f2700 1 --2- 172.21.15.63:0/2001481382 >> v2:172.21.15.63:3300/0 conn(0x7f6e300b71e0 0x7f6e300b9200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6e30063d60 tx=0x7f6e20001e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e358f2700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e300b71e0 0x7f6e300b9200 secure :-1 s=READY pgs=357 cs=0 l=1 rx=0x7f6e30063d60 tx=0x7f6e20001e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:33.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e358f2700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e300b71e0 0x7f6e300b9200 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f6e30063d60 tx=0x7f6e20001e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e1f7fe700 1 -- 172.21.15.63:0/2001481382 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e2000cc30 con 0x7f6e300b71e0 2020-05-18T21:27:33.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e358f2700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e300b71e0 0x7f6e300b9200 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f6e30063d60 tx=0x7f6e20001e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e358f2700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e300b71e0 0x7f6e300b9200 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f6e30063d60 tx=0x7f6e20001e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e1f7fe700 1 -- 172.21.15.63:0/2001481382 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2000cd90 con 0x7f6e300b71e0 2020-05-18T21:27:33.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e370f5700 1 -- 172.21.15.63:0/2001481382 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e300b9730 con 0x7f6e300b71e0 2020-05-18T21:27:33.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e1f7fe700 1 -- 172.21.15.63:0/2001481382 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e200122e0 con 0x7f6e300b71e0 2020-05-18T21:27:33.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e370f5700 1 -- 172.21.15.63:0/2001481382 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e300b3c40 con 0x7f6e300b71e0 2020-05-18T21:27:33.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e358f2700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e300b71e0 0x7f6e300b9200 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f6e30063d60 tx=0x7f6e20001e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e370f5700 1 -- 172.21.15.63:0/2001481382 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e30061cc0 con 0x7f6e300b71e0 2020-05-18T21:27:33.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e1f7fe700 1 -- 172.21.15.63:0/2001481382 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6e20006520 con 0x7f6e300b71e0 2020-05-18T21:27:33.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e358f2700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e300b71e0 0x7f6e300b9200 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f6e30063d60 tx=0x7f6e20001e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.029+0000 7f6e1f7fe700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6e1004f9e0 0x7f6e10051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.033+0000 7f6e1f7fe700 1 -- 172.21.15.63:0/2001481382 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6e200638d0 con 0x7f6e300b71e0 2020-05-18T21:27:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.033+0000 7f6e360f3700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6e1004f9e0 0x7f6e10051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.033+0000 7f6e360f3700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6e1004f9e0 0x7f6e10051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6e280032f0 tx=0x7f6e30066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.033+0000 7f6e360f3700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6e1004f9e0 0x7f6e10051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6e280032f0 tx=0x7f6e30066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.033+0000 7f6e360f3700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6e1004f9e0 0x7f6e10051ea0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f6e280032f0 tx=0x7f6e30066620).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:33.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.037+0000 7f6e358f2700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e300b71e0 0x7f6e300b9200 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f6e30063d60 tx=0x7f6e20001e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.037+0000 7f6e1f7fe700 1 -- 172.21.15.63:0/2001481382 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6e30061cc0 con 0x7f6e300b71e0 2020-05-18T21:27:33.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.185+0000 7f6e370f5700 1 -- 172.21.15.63:0/2001481382 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e30061cc0 con 0x7f6e300b71e0 2020-05-18T21:27:33.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.185+0000 7f6e358f2700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e300b71e0 0x7f6e300b9200 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f6e30063d60 tx=0x7f6e20001e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.185+0000 7f6e1f7fe700 1 -- 172.21.15.63:0/2001481382 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f6e30061cc0 con 0x7f6e300b71e0 2020-05-18T21:27:33.191 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:33.191 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5055,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2600411689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2600411689},{"type":"v1","addr":"172.21.15.63:6833","nonce":2600411689}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:27:31.884487+0000","modified":"2020-05-18T21:27:32.888860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5064},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5064":{"gid":5064,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1028402057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1028402057},{"type":"v1","addr":"172.21.15.155:6835","nonce":1028402057}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-05-18T21:27:33.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.185+0000 7f6e370f5700 1 -- 172.21.15.63:0/2001481382 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6e1004f9e0 msgr2=0x7f6e10051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.185+0000 7f6e370f5700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6e1004f9e0 0x7f6e10051ea0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f6e280032f0 tx=0x7f6e30066620).stop 2020-05-18T21:27:33.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.185+0000 7f6e370f5700 1 -- 172.21.15.63:0/2001481382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e300b71e0 msgr2=0x7f6e300b9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.185+0000 7f6e370f5700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e300b71e0 0x7f6e300b9200 secure :-1 s=READY pgs=357 cs=0 l=1 rx=0x7f6e30063d60 tx=0x7f6e20001e70).stop 2020-05-18T21:27:33.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.185+0000 7f6e370f5700 1 -- 172.21.15.63:0/2001481382 shutdown_connections 2020-05-18T21:27:33.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.185+0000 7f6e370f5700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6e1004f9e0 0x7f6e10051ea0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:33.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.185+0000 7f6e370f5700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e30147110 0x7f6e300b86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:33.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.185+0000 7f6e370f5700 1 --2- 172.21.15.63:0/2001481382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e300b71e0 0x7f6e300b9200 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:33.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.185+0000 7f6e370f5700 1 --2- 172.21.15.63:0/2001481382 >> v2:172.21.15.155:3300/0 conn(0x7f6e30063370 0x7f6e30060310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:33.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.185+0000 7f6e370f5700 1 -- 172.21.15.63:0/2001481382 >> 172.21.15.63:0/2001481382 conn(0x7f6e3005eee0 msgr2=0x7f6e300648c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:33.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.185+0000 7f6e370f5700 1 -- 172.21.15.63:0/2001481382 shutdown_connections 2020-05-18T21:27:33.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.185+0000 7f6e370f5700 1 -- 172.21.15.63:0/2001481382 wait complete. 2020-05-18T21:27:33.196 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 12 2020-05-18T21:27:33.204 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:27:33.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3ffff700 1 Processor -- start 2020-05-18T21:27:33.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3ffff700 1 -- start start 2020-05-18T21:27:33.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fab4005f110 0x7fab400b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:33.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3ffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4014a330 con 0x7fab40064fd0 2020-05-18T21:27:33.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3ffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4014a5d0 con 0x7fab4014aa70 2020-05-18T21:27:33.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3ffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4014a140 con 0x7fab4005f110 2020-05-18T21:27:33.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fab40064fd0 0x7fab4014d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56342/0 (socket says 172.21.15.63:56342) 2020-05-18T21:27:33.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3f7fe700 1 -- 172.21.15.63:0/483859910 learned_addr learned my addr 172.21.15.63:0/483859910 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3effd700 1 --2- 172.21.15.63:0/483859910 >> v2:172.21.15.155:3300/0 conn(0x7fab4005f110 0x7fab400b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3dffb700 1 -- 172.21.15.63:0/483859910 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327288013 0 0) 0x7fab4014a330 con 0x7fab40064fd0 2020-05-18T21:27:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3dffb700 1 -- 172.21.15.63:0/483859910 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab20003270 con 0x7fab40064fd0 2020-05-18T21:27:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3dffb700 1 -- 172.21.15.63:0/483859910 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309093627 0 0) 0x7fab4014a5d0 con 0x7fab4014aa70 2020-05-18T21:27:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3dffb700 1 -- 172.21.15.63:0/483859910 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab4014a330 con 0x7fab4014aa70 2020-05-18T21:27:33.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3effd700 1 -- 172.21.15.63:0/483859910 >> v1:172.21.15.155:6789/0 conn(0x7fab4014aa70 legacy=0x7fab400648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3effd700 1 -- 172.21.15.63:0/483859910 >> v1:172.21.15.63:6789/0 conn(0x7fab40064fd0 legacy=0x7fab4014d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3effd700 1 -- 172.21.15.63:0/483859910 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40063430 con 0x7fab4005f110 2020-05-18T21:27:33.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3effd700 1 --2- 172.21.15.63:0/483859910 >> v2:172.21.15.155:3300/0 conn(0x7fab4005f110 0x7fab400b4760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fab28002f70 tx=0x7fab28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3effd700 1 --2- 172.21.15.63:0/483859910 >> v2:172.21.15.155:3300/0 conn(0x7fab4005f110 0x7fab400b4760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fab28002f70 tx=0x7fab28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3effd700 1 --2- 172.21.15.63:0/483859910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab4005f110 0x7fab400b4760 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7fab28002f70 tx=0x7fab28007a80).ready entity=mon.1 client_cookie=61bd3a5a9590da29 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:33.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3effd700 1 --2- 172.21.15.63:0/483859910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab4005f110 0x7fab400b4760 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7fab28002f70 tx=0x7fab28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3dffb700 1 -- 172.21.15.63:0/483859910 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab28008e80 con 0x7fab4005f110 2020-05-18T21:27:33.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3effd700 1 --2- 172.21.15.63:0/483859910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab4005f110 0x7fab400b4760 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7fab28002f70 tx=0x7fab28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3dffb700 1 -- 172.21.15.63:0/483859910 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab28011540 con 0x7fab4005f110 2020-05-18T21:27:33.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3effd700 1 --2- 172.21.15.63:0/483859910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab4005f110 0x7fab400b4760 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7fab28002f70 tx=0x7fab28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3dffb700 1 -- 172.21.15.63:0/483859910 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab28011920 con 0x7fab4005f110 2020-05-18T21:27:33.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3ffff700 1 -- 172.21.15.63:0/483859910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab4005f110 msgr2=0x7fab400b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.305+0000 7fab3ffff700 1 --2- 172.21.15.63:0/483859910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab4005f110 0x7fab400b4760 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7fab28002f70 tx=0x7fab28007a80).stop 2020-05-18T21:27:33.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3ffff700 1 -- 172.21.15.63:0/483859910 shutdown_connections 2020-05-18T21:27:33.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3ffff700 1 --2- 172.21.15.63:0/483859910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab4005f110 0x7fab400b4760 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:33.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3ffff700 1 -- 172.21.15.63:0/483859910 >> 172.21.15.63:0/483859910 conn(0x7fab40069fc0 msgr2=0x7fab4006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:33.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3ffff700 1 -- 172.21.15.63:0/483859910 shutdown_connections 2020-05-18T21:27:33.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3ffff700 1 -- 172.21.15.63:0/483859910 wait complete. 2020-05-18T21:27:33.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3ffff700 1 Processor -- start 2020-05-18T21:27:33.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3ffff700 1 -- start start 2020-05-18T21:27:33.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fab40064fd0 0x7fab40147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:33.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab4014aa70 0x7fab40144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:33.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3ffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab40145370 con 0x7fab4005f110 2020-05-18T21:27:33.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3ffff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab400ac700 con 0x7fab40064fd0 2020-05-18T21:27:33.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3ffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab401455b0 con 0x7fab4014aa70 2020-05-18T21:27:33.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3e7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fab40064fd0 0x7fab40147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3e7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fab40064fd0 0x7fab40147810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54156/0 (socket says 172.21.15.63:54156) 2020-05-18T21:27:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3e7fc700 1 -- 172.21.15.63:0/3611206659 learned_addr learned my addr 172.21.15.63:0/3611206659 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3f7fe700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab4014aa70 0x7fab40144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3e7fc700 1 -- 172.21.15.63:0/3611206659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab4014aa70 msgr2=0x7fab40144f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3e7fc700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab4014aa70 0x7fab40144f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3e7fc700 1 -- 172.21.15.63:0/3611206659 >> v1:172.21.15.63:6789/0 conn(0x7fab4005f110 legacy=0x7fab40142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3e7fc700 1 -- 172.21.15.63:0/3611206659 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40145850 con 0x7fab40064fd0 2020-05-18T21:27:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3e7fc700 1 --2- 172.21.15.63:0/3611206659 >> v2:172.21.15.63:3300/0 conn(0x7fab40064fd0 0x7fab40147810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab38001550 tx=0x7fab38003230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3e7fc700 1 --2- 172.21.15.63:0/3611206659 >> v2:172.21.15.63:3300/0 conn(0x7fab40064fd0 0x7fab40147810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab38001550 tx=0x7fab38003230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3e7fc700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab40064fd0 0x7fab40147810 secure :-1 s=READY pgs=360 cs=0 l=1 rx=0x7fab38001550 tx=0x7fab38003230).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3e7fc700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab40064fd0 0x7fab40147810 secure :-1 s=THROTTLE_DONE pgs=360 cs=0 l=1 rx=0x7fab38001550 tx=0x7fab38003230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3e7fc700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab40064fd0 0x7fab40147810 secure :-1 s=THROTTLE_DONE pgs=360 cs=0 l=1 rx=0x7fab38001550 tx=0x7fab38003230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3e7fc700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab40064fd0 0x7fab40147810 secure :-1 s=THROTTLE_DONE pgs=360 cs=0 l=1 rx=0x7fab38001550 tx=0x7fab38003230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab37fff700 1 -- 172.21.15.63:0/3611206659 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab3800cce0 con 0x7fab40064fd0 2020-05-18T21:27:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab37fff700 1 -- 172.21.15.63:0/3611206659 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3800ce40 con 0x7fab40064fd0 2020-05-18T21:27:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab3ffff700 1 -- 172.21.15.63:0/3611206659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab401431f0 con 0x7fab40064fd0 2020-05-18T21:27:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.309+0000 7fab37fff700 1 -- 172.21.15.63:0/3611206659 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab38011990 con 0x7fab40064fd0 2020-05-18T21:27:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.313+0000 7fab3ffff700 1 -- 172.21.15.63:0/3611206659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab40143720 con 0x7fab40064fd0 2020-05-18T21:27:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.313+0000 7fab3e7fc700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab40064fd0 0x7fab40147810 secure :-1 s=THROTTLE_DONE pgs=360 cs=0 l=1 rx=0x7fab38001550 tx=0x7fab38003230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.313+0000 7fab3ffff700 1 -- 172.21.15.63:0/3611206659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab400569e0 con 0x7fab40064fd0 2020-05-18T21:27:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.313+0000 7fab37fff700 1 -- 172.21.15.63:0/3611206659 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fab38011c00 con 0x7fab40064fd0 2020-05-18T21:27:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.313+0000 7fab3e7fc700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab40064fd0 0x7fab40147810 secure :-1 s=THROTTLE_DONE pgs=360 cs=0 l=1 rx=0x7fab38001550 tx=0x7fab38003230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.313+0000 7fab37fff700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab2404fa50 0x7fab24051f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.313+0000 7fab37fff700 1 -- 172.21.15.63:0/3611206659 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fab38063ac0 con 0x7fab40064fd0 2020-05-18T21:27:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.313+0000 7fab3effd700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab2404fa50 0x7fab24051f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.313+0000 7fab3effd700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab2404fa50 0x7fab24051f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab401416b0 tx=0x7fab28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.313+0000 7fab3effd700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab2404fa50 0x7fab24051f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab401416b0 tx=0x7fab28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.313+0000 7fab3effd700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab2404fa50 0x7fab24051f10 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7fab401416b0 tx=0x7fab28007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:33.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.317+0000 7fab3e7fc700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab40064fd0 0x7fab40147810 secure :-1 s=THROTTLE_DONE pgs=360 cs=0 l=1 rx=0x7fab38001550 tx=0x7fab38003230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.317+0000 7fab37fff700 1 -- 172.21.15.63:0/3611206659 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fab3803ddf0 con 0x7fab40064fd0 2020-05-18T21:27:33.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.433+0000 7fab3ffff700 1 -- 172.21.15.63:0/3611206659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab4015b340 con 0x7fab40064fd0 2020-05-18T21:27:33.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.433+0000 7fab3e7fc700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab40064fd0 0x7fab40147810 secure :-1 s=THROTTLE_DONE pgs=360 cs=0 l=1 rx=0x7fab38001550 tx=0x7fab38003230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.433+0000 7fab37fff700 1 -- 172.21.15.63:0/3611206659 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fab38041410 con 0x7fab40064fd0 2020-05-18T21:27:33.442 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:33.443 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":33,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:27:32.887660+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:27:29.817430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2020-05-18T21:27:30.879596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:27:33.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.437+0000 7fab3ffff700 1 -- 172.21.15.63:0/3611206659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab2404fa50 msgr2=0x7fab24051f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.437+0000 7fab3ffff700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab2404fa50 0x7fab24051f10 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7fab401416b0 tx=0x7fab28007a80).stop 2020-05-18T21:27:33.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.437+0000 7fab3ffff700 1 -- 172.21.15.63:0/3611206659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab40064fd0 msgr2=0x7fab40147810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.437+0000 7fab3ffff700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab40064fd0 0x7fab40147810 secure :-1 s=READY pgs=360 cs=0 l=1 rx=0x7fab38001550 tx=0x7fab38003230).stop 2020-05-18T21:27:33.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.437+0000 7fab3ffff700 1 -- 172.21.15.63:0/3611206659 shutdown_connections 2020-05-18T21:27:33.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.437+0000 7fab3ffff700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab2404fa50 0x7fab24051f10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:33.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.437+0000 7fab3ffff700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab4014aa70 0x7fab40144f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:33.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.437+0000 7fab3ffff700 1 --2- 172.21.15.63:0/3611206659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab40064fd0 0x7fab40147810 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:33.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.437+0000 7fab3ffff700 1 -- 172.21.15.63:0/3611206659 >> 172.21.15.63:0/3611206659 conn(0x7fab40069fc0 msgr2=0x7fab400648a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:33.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.437+0000 7fab3ffff700 1 -- 172.21.15.63:0/3611206659 shutdown_connections 2020-05-18T21:27:33.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.437+0000 7fab3ffff700 1 -- 172.21.15.63:0/3611206659 wait complete. 2020-05-18T21:27:33.455 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:27:33.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.565+0000 7f2a30ff5700 1 Processor -- start 2020-05-18T21:27:33.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.565+0000 7f2a30ff5700 1 -- start start 2020-05-18T21:27:33.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.565+0000 7f2a30ff5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2a2c0b6410 0x7f2a2c0b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:33.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.565+0000 7f2a30ff5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a2c151bc0 0x7f2a2c152030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:33.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.565+0000 7f2a30ff5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2c025500 con 0x7f2a2c0b5cb0 2020-05-18T21:27:33.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.565+0000 7f2a30ff5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c064ee0 con 0x7f2a2c0b6410 2020-05-18T21:27:33.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.565+0000 7f2a30ff5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c0b67f0 con 0x7f2a2c151bc0 2020-05-18T21:27:33.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.565+0000 7f2a2bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2a2c0b6410 0x7f2a2c0b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:33.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.565+0000 7f2a2bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2a2c0b6410 0x7f2a2c0b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54164/0 (socket says 172.21.15.63:54164) 2020-05-18T21:27:33.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.565+0000 7f2a2bfff700 1 -- 172.21.15.63:0/2293749935 learned_addr learned my addr 172.21.15.63:0/2293749935 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:33.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.565+0000 7f2a32257700 1 --2- 172.21.15.63:0/2293749935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a2c151bc0 0x7f2a2c152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:33.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.565+0000 7f2a2bfff700 1 -- 172.21.15.63:0/2293749935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a2c151bc0 msgr2=0x7f2a2c152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:33.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.565+0000 7f2a2bfff700 1 --2- 172.21.15.63:0/2293749935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a2c151bc0 0x7f2a2c152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:33.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.565+0000 7f2a2bfff700 1 -- 172.21.15.63:0/2293749935 >> v1:172.21.15.155:6789/0 conn(0x7f2a2c0b5cb0 legacy=0x7f2a2c061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.565+0000 7f2a2bfff700 1 -- 172.21.15.63:0/2293749935 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c025180 con 0x7f2a2c0b6410 2020-05-18T21:27:33.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.565+0000 7f2a2bfff700 1 --2- 172.21.15.63:0/2293749935 >> v2:172.21.15.63:3300/0 conn(0x7f2a2c0b6410 0x7f2a2c0b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2a240032f0 tx=0x7f2a24007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.565+0000 7f2a2bfff700 1 --2- 172.21.15.63:0/2293749935 >> v2:172.21.15.63:3300/0 conn(0x7f2a2c0b6410 0x7f2a2c0b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2a240032f0 tx=0x7f2a24007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.565+0000 7f2a2bfff700 1 --2- 172.21.15.63:0/2293749935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a2c0b6410 0x7f2a2c0b6cd0 secure :-1 s=READY pgs=361 cs=0 l=1 rx=0x7f2a240032f0 tx=0x7f2a24007e00).ready entity=mon.0 client_cookie=d8d99ecf8b2f8567 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:33.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.569+0000 7f2a2bfff700 1 --2- 172.21.15.63:0/2293749935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a2c0b6410 0x7f2a2c0b6cd0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f2a240032f0 tx=0x7f2a24007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.569+0000 7f2a2bfff700 1 --2- 172.21.15.63:0/2293749935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a2c0b6410 0x7f2a2c0b6cd0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f2a240032f0 tx=0x7f2a24007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.569+0000 7f2a2bfff700 1 --2- 172.21.15.63:0/2293749935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a2c0b6410 0x7f2a2c0b6cd0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f2a240032f0 tx=0x7f2a24007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.569+0000 7f2a2affd700 1 -- 172.21.15.63:0/2293749935 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a24011d10 con 0x7f2a2c0b6410 2020-05-18T21:27:33.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.569+0000 7f2a2affd700 1 -- 172.21.15.63:0/2293749935 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a24011e70 con 0x7f2a2c0b6410 2020-05-18T21:27:33.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.569+0000 7f2a2affd700 1 -- 172.21.15.63:0/2293749935 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a2400a370 con 0x7f2a2c0b6410 2020-05-18T21:27:33.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.569+0000 7f2a30ff5700 1 -- 172.21.15.63:0/2293749935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a2c0b6410 msgr2=0x7f2a2c0b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.569+0000 7f2a30ff5700 1 --2- 172.21.15.63:0/2293749935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a2c0b6410 0x7f2a2c0b6cd0 secure :-1 s=READY pgs=361 cs=0 l=1 rx=0x7f2a240032f0 tx=0x7f2a24007e00).stop 2020-05-18T21:27:33.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.569+0000 7f2a30ff5700 1 -- 172.21.15.63:0/2293749935 shutdown_connections 2020-05-18T21:27:33.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.569+0000 7f2a30ff5700 1 --2- 172.21.15.63:0/2293749935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a2c151bc0 0x7f2a2c152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:33.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.569+0000 7f2a30ff5700 1 --2- 172.21.15.63:0/2293749935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a2c0b6410 0x7f2a2c0b6cd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:33.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.569+0000 7f2a30ff5700 1 -- 172.21.15.63:0/2293749935 >> 172.21.15.63:0/2293749935 conn(0x7f2a2c069b70 msgr2=0x7f2a2c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:33.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.569+0000 7f2a30ff5700 1 -- 172.21.15.63:0/2293749935 shutdown_connections 2020-05-18T21:27:33.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.569+0000 7f2a30ff5700 1 -- 172.21.15.63:0/2293749935 wait complete. 2020-05-18T21:27:33.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.573+0000 7f2a30ff5700 1 Processor -- start 2020-05-18T21:27:33.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.573+0000 7f2a30ff5700 1 -- start start 2020-05-18T21:27:33.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.573+0000 7f2a30ff5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2a2c151bc0 0x7f2a2c0b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:33.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.573+0000 7f2a30ff5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2c0b43b0 con 0x7f2a2c0b6410 2020-05-18T21:27:33.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.573+0000 7f2a30ff5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2c0b1380 con 0x7f2a2c0b5cb0 2020-05-18T21:27:33.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.573+0000 7f2a30ff5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c0b5000 con 0x7f2a2c151bc0 2020-05-18T21:27:33.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.573+0000 7f2a2b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2a2c0b6410 0x7f2a2c07f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56360/0 (socket says 172.21.15.63:56360) 2020-05-18T21:27:33.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.573+0000 7f2a2b7fe700 1 -- 172.21.15.63:0/2966263908 learned_addr learned my addr 172.21.15.63:0/2966263908 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:33.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.573+0000 7f2a2bfff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f2a2c0b5cb0 0x7f2a2c0b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:54674/0 (socket says 172.21.15.63:54674) 2020-05-18T21:27:33.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.573+0000 7f2a32257700 1 --2- 172.21.15.63:0/2966263908 >> v2:172.21.15.155:3300/0 conn(0x7f2a2c151bc0 0x7f2a2c0b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:33.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a28ff9700 1 -- 172.21.15.63:0/2966263908 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249832558 0 0) 0x7f2a2c0b43b0 con 0x7f2a2c0b6410 2020-05-18T21:27:33.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a32257700 1 -- 172.21.15.63:0/2966263908 >> v1:172.21.15.155:6789/0 conn(0x7f2a2c0b5cb0 legacy=0x7f2a2c0b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a32257700 1 -- 172.21.15.63:0/2966263908 >> v1:172.21.15.63:6789/0 conn(0x7f2a2c0b6410 legacy=0x7f2a2c07f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a32257700 1 -- 172.21.15.63:0/2966263908 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c0b4620 con 0x7f2a2c151bc0 2020-05-18T21:27:33.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a32257700 1 --2- 172.21.15.63:0/2966263908 >> v2:172.21.15.155:3300/0 conn(0x7f2a2c151bc0 0x7f2a2c0b0f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2a24008290 tx=0x7f2a1c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a32257700 1 --2- 172.21.15.63:0/2966263908 >> v2:172.21.15.155:3300/0 conn(0x7f2a2c151bc0 0x7f2a2c0b0f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2a24008290 tx=0x7f2a1c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a32257700 1 --2- 172.21.15.63:0/2966263908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a2c151bc0 0x7f2a2c0b0f20 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7f2a24008290 tx=0x7f2a1c010bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:33.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a32257700 1 --2- 172.21.15.63:0/2966263908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a2c151bc0 0x7f2a2c0b0f20 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f2a24008290 tx=0x7f2a1c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a28ff9700 1 -- 172.21.15.63:0/2966263908 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a1c007550 con 0x7f2a2c151bc0 2020-05-18T21:27:33.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a32257700 1 --2- 172.21.15.63:0/2966263908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a2c151bc0 0x7f2a2c0b0f20 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f2a24008290 tx=0x7f2a1c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a28ff9700 1 -- 172.21.15.63:0/2966263908 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c005700 con 0x7f2a2c151bc0 2020-05-18T21:27:33.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a32257700 1 --2- 172.21.15.63:0/2966263908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a2c151bc0 0x7f2a2c0b0f20 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f2a24008290 tx=0x7f2a1c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a30ff5700 1 -- 172.21.15.63:0/2966263908 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2c0b48c0 con 0x7f2a2c151bc0 2020-05-18T21:27:33.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a28ff9700 1 -- 172.21.15.63:0/2966263908 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a1c005aa0 con 0x7f2a2c151bc0 2020-05-18T21:27:33.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a30ff5700 1 -- 172.21.15.63:0/2966263908 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c080040 con 0x7f2a2c151bc0 2020-05-18T21:27:33.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a32257700 1 --2- 172.21.15.63:0/2966263908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a2c151bc0 0x7f2a2c0b0f20 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f2a24008290 tx=0x7f2a1c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a28ff9700 1 -- 172.21.15.63:0/2966263908 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2a1c005ca0 con 0x7f2a2c151bc0 2020-05-18T21:27:33.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a32257700 1 --2- 172.21.15.63:0/2966263908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a2c151bc0 0x7f2a2c0b0f20 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f2a24008290 tx=0x7f2a1c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a28ff9700 1 --2- 172.21.15.63:0/2966263908 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2a1004f840 0x7f2a10051d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:33.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a30ff5700 1 -- 172.21.15.63:0/2966263908 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c0569e0 con 0x7f2a2c151bc0 2020-05-18T21:27:33.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a28ff9700 1 -- 172.21.15.63:0/2966263908 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2a1c013070 con 0x7f2a2c151bc0 2020-05-18T21:27:33.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a2bfff700 1 --2- 172.21.15.63:0/2966263908 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2a1004f840 0x7f2a10051d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:33.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a2bfff700 1 --2- 172.21.15.63:0/2966263908 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2a1004f840 0x7f2a10051d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2a24008880 tx=0x7f2a24007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a2bfff700 1 --2- 172.21.15.63:0/2966263908 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2a1004f840 0x7f2a10051d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2a24008880 tx=0x7f2a24007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.577+0000 7f2a2bfff700 1 --2- 172.21.15.63:0/2966263908 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2a1004f840 0x7f2a10051d00 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f2a24008880 tx=0x7f2a24007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:33.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.585+0000 7f2a32257700 1 --2- 172.21.15.63:0/2966263908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a2c151bc0 0x7f2a2c0b0f20 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f2a24008290 tx=0x7f2a1c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.585+0000 7f2a28ff9700 1 -- 172.21.15.63:0/2966263908 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2a1c03e130 con 0x7f2a2c151bc0 2020-05-18T21:27:33.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.737+0000 7f2a30ff5700 1 -- 172.21.15.63:0/2966263908 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f2a2c0aee60 con 0x7f2a2c151bc0 2020-05-18T21:27:33.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.745+0000 7f2a32257700 1 --2- 172.21.15.63:0/2966263908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a2c151bc0 0x7f2a2c0b0f20 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f2a24008290 tx=0x7f2a1c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.745+0000 7f2a28ff9700 1 -- 172.21.15.63:0/2966263908 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v11) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2a1c041750 con 0x7f2a2c151bc0 2020-05-18T21:27:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.749+0000 7f2a30ff5700 1 -- 172.21.15.63:0/2966263908 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2a1004f840 msgr2=0x7f2a10051d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.749+0000 7f2a30ff5700 1 --2- 172.21.15.63:0/2966263908 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2a1004f840 0x7f2a10051d00 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f2a24008880 tx=0x7f2a24007e00).stop 2020-05-18T21:27:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.749+0000 7f2a30ff5700 1 -- 172.21.15.63:0/2966263908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a2c151bc0 msgr2=0x7f2a2c0b0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.749+0000 7f2a30ff5700 1 --2- 172.21.15.63:0/2966263908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a2c151bc0 0x7f2a2c0b0f20 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7f2a24008290 tx=0x7f2a1c010bb0).stop 2020-05-18T21:27:33.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.749+0000 7f2a30ff5700 1 -- 172.21.15.63:0/2966263908 shutdown_connections 2020-05-18T21:27:33.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.749+0000 7f2a30ff5700 1 --2- 172.21.15.63:0/2966263908 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2a1004f840 0x7f2a10051d00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:33.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.749+0000 7f2a30ff5700 1 --2- 172.21.15.63:0/2966263908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a2c151bc0 0x7f2a2c0b0f20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:33.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.749+0000 7f2a30ff5700 1 -- 172.21.15.63:0/2966263908 >> 172.21.15.63:0/2966263908 conn(0x7f2a2c069b70 msgr2=0x7f2a2c130d00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:33.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.749+0000 7f2a30ff5700 1 -- 172.21.15.63:0/2966263908 shutdown_connections 2020-05-18T21:27:33.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.749+0000 7f2a30ff5700 1 -- 172.21.15.63:0/2966263908 wait complete. 2020-05-18T21:27:33.758 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.0 2020-05-18T21:27:33.767 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:27:33.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.877+0000 7f1d2698a700 1 Processor -- start 2020-05-18T21:27:33.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.877+0000 7f1d2698a700 1 -- start start 2020-05-18T21:27:33.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.877+0000 7f1d2698a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1d200b6cd0 0x7f1d201522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:33.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.877+0000 7f1d2698a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d20025500 con 0x7f1d200b5cb0 2020-05-18T21:27:33.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.877+0000 7f1d2698a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d20064ee0 con 0x7f1d200b6410 2020-05-18T21:27:33.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.877+0000 7f1d2698a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d200b67f0 con 0x7f1d200b6cd0 2020-05-18T21:27:33.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.877+0000 7f1d25988700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1d200b5cb0 0x7f1d20151bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56368/0 (socket says 172.21.15.63:56368) 2020-05-18T21:27:33.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.877+0000 7f1d25988700 1 -- 172.21.15.63:0/3826271319 learned_addr learned my addr 172.21.15.63:0/3826271319 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:33.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.877+0000 7f1d27bec700 1 --2- 172.21.15.63:0/3826271319 >> v2:172.21.15.63:3300/0 conn(0x7f1d200b6cd0 0x7f1d201522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:33.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.877+0000 7f1d27bec700 1 -- 172.21.15.63:0/3826271319 >> v1:172.21.15.155:6789/0 conn(0x7f1d200b6410 legacy=0x7f1d20061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.877+0000 7f1d27bec700 1 -- 172.21.15.63:0/3826271319 >> v1:172.21.15.63:6789/0 conn(0x7f1d200b5cb0 legacy=0x7f1d20151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.877+0000 7f1d25187700 1 -- 172.21.15.63:0/3826271319 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3708023828 0 0) 0x7f1d20025500 con 0x7f1d200b5cb0 2020-05-18T21:27:33.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.877+0000 7f1d27bec700 1 -- 172.21.15.63:0/3826271319 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d20025180 con 0x7f1d200b6cd0 2020-05-18T21:27:33.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.877+0000 7f1d27bec700 1 --2- 172.21.15.63:0/3826271319 >> v2:172.21.15.63:3300/0 conn(0x7f1d200b6cd0 0x7f1d201522d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1d180032f0 tx=0x7f1d18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.881+0000 7f1d27bec700 1 --2- 172.21.15.63:0/3826271319 >> v2:172.21.15.63:3300/0 conn(0x7f1d200b6cd0 0x7f1d201522d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1d180032f0 tx=0x7f1d18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.881+0000 7f1d27bec700 1 --2- 172.21.15.63:0/3826271319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d200b6cd0 0x7f1d201522d0 secure :-1 s=READY pgs=364 cs=0 l=1 rx=0x7f1d180032f0 tx=0x7f1d18007e00).ready entity=mon.0 client_cookie=cc48c5b4ca37e5b5 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:33.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.881+0000 7f1d27bec700 1 --2- 172.21.15.63:0/3826271319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d200b6cd0 0x7f1d201522d0 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7f1d180032f0 tx=0x7f1d18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.881+0000 7f1d25187700 1 -- 172.21.15.63:0/3826271319 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d1800a180 con 0x7f1d200b6cd0 2020-05-18T21:27:33.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.881+0000 7f1d27bec700 1 --2- 172.21.15.63:0/3826271319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d200b6cd0 0x7f1d201522d0 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7f1d180032f0 tx=0x7f1d18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.881+0000 7f1d27bec700 1 --2- 172.21.15.63:0/3826271319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d200b6cd0 0x7f1d201522d0 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7f1d180032f0 tx=0x7f1d18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.881+0000 7f1d25187700 1 -- 172.21.15.63:0/3826271319 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1800a2e0 con 0x7f1d200b6cd0 2020-05-18T21:27:33.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.881+0000 7f1d25187700 1 -- 172.21.15.63:0/3826271319 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d1800a700 con 0x7f1d200b6cd0 2020-05-18T21:27:33.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.881+0000 7f1d2698a700 1 -- 172.21.15.63:0/3826271319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d200b6cd0 msgr2=0x7f1d201522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.881+0000 7f1d2698a700 1 --2- 172.21.15.63:0/3826271319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d200b6cd0 0x7f1d201522d0 secure :-1 s=READY pgs=364 cs=0 l=1 rx=0x7f1d180032f0 tx=0x7f1d18007e00).stop 2020-05-18T21:27:33.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.881+0000 7f1d2698a700 1 -- 172.21.15.63:0/3826271319 shutdown_connections 2020-05-18T21:27:33.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.881+0000 7f1d2698a700 1 --2- 172.21.15.63:0/3826271319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d200b6cd0 0x7f1d201522d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:33.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.881+0000 7f1d2698a700 1 -- 172.21.15.63:0/3826271319 >> 172.21.15.63:0/3826271319 conn(0x7f1d20069b70 msgr2=0x7f1d20069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:33.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.881+0000 7f1d2698a700 1 -- 172.21.15.63:0/3826271319 shutdown_connections 2020-05-18T21:27:33.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.881+0000 7f1d2698a700 1 -- 172.21.15.63:0/3826271319 wait complete. 2020-05-18T21:27:33.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.881+0000 7f1d2698a700 1 Processor -- start 2020-05-18T21:27:33.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d2698a700 1 -- start start 2020-05-18T21:27:33.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d2698a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1d200b6cd0 0x7f1d200b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:33.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d2698a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d200740a0 con 0x7f1d200b6410 2020-05-18T21:27:33.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d2698a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d200b39f0 con 0x7f1d200b5cb0 2020-05-18T21:27:33.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d2698a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d20074310 con 0x7f1d200b6cd0 2020-05-18T21:27:33.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d25988700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1d200b6410 0x7f1d200af470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56374/0 (socket says 172.21.15.63:56374) 2020-05-18T21:27:33.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d25988700 1 -- 172.21.15.63:0/1522404000 learned_addr learned my addr 172.21.15.63:0/1522404000 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:33.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d27bec700 1 --2- 172.21.15.63:0/1522404000 >> v2:172.21.15.155:3300/0 conn(0x7f1d200b6cd0 0x7f1d200b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:33.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d16ffd700 1 -- 172.21.15.63:0/1522404000 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199220893 0 0) 0x7f1d200740a0 con 0x7f1d200b6410 2020-05-18T21:27:33.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d16ffd700 1 -- 172.21.15.63:0/1522404000 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d08003270 con 0x7f1d200b6410 2020-05-18T21:27:33.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d16ffd700 1 -- 172.21.15.63:0/1522404000 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367534374 0 0) 0x7f1d200b39f0 con 0x7f1d200b5cb0 2020-05-18T21:27:33.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d16ffd700 1 -- 172.21.15.63:0/1522404000 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d200740a0 con 0x7f1d200b5cb0 2020-05-18T21:27:33.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d16ffd700 1 -- 172.21.15.63:0/1522404000 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2501881658 0 0) 0x7f1d08003270 con 0x7f1d200b6410 2020-05-18T21:27:33.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d27bec700 1 -- 172.21.15.63:0/1522404000 >> v1:172.21.15.155:6789/0 conn(0x7f1d200b5cb0 legacy=0x7f1d20073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d27bec700 1 -- 172.21.15.63:0/1522404000 >> v1:172.21.15.63:6789/0 conn(0x7f1d200b6410 legacy=0x7f1d200af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:33.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d27bec700 1 -- 172.21.15.63:0/1522404000 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d200745b0 con 0x7f1d200b6cd0 2020-05-18T21:27:33.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d27bec700 1 --2- 172.21.15.63:0/1522404000 >> v2:172.21.15.155:3300/0 conn(0x7f1d200b6cd0 0x7f1d200b3590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d100010c0 tx=0x7f1d18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d27bec700 1 --2- 172.21.15.63:0/1522404000 >> v2:172.21.15.155:3300/0 conn(0x7f1d200b6cd0 0x7f1d200b3590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d100010c0 tx=0x7f1d18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d27bec700 1 --2- 172.21.15.63:0/1522404000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d200b6cd0 0x7f1d200b3590 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7f1d100010c0 tx=0x7f1d18007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:33.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d27bec700 1 --2- 172.21.15.63:0/1522404000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d200b6cd0 0x7f1d200b3590 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f1d100010c0 tx=0x7f1d18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d16ffd700 1 -- 172.21.15.63:0/1522404000 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d100019a0 con 0x7f1d200b6cd0 2020-05-18T21:27:33.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d27bec700 1 --2- 172.21.15.63:0/1522404000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d200b6cd0 0x7f1d200b3590 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f1d100010c0 tx=0x7f1d18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d16ffd700 1 -- 172.21.15.63:0/1522404000 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d18005a80 con 0x7f1d200b6cd0 2020-05-18T21:27:33.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d2698a700 1 -- 172.21.15.63:0/1522404000 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d200b1da0 con 0x7f1d200b6cd0 2020-05-18T21:27:33.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d27bec700 1 --2- 172.21.15.63:0/1522404000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d200b6cd0 0x7f1d200b3590 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f1d100010c0 tx=0x7f1d18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d16ffd700 1 -- 172.21.15.63:0/1522404000 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d18005de0 con 0x7f1d200b6cd0 2020-05-18T21:27:33.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.885+0000 7f1d2698a700 1 -- 172.21.15.63:0/1522404000 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d200afb80 con 0x7f1d200b6cd0 2020-05-18T21:27:33.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.889+0000 7f1d27bec700 1 --2- 172.21.15.63:0/1522404000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d200b6cd0 0x7f1d200b3590 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f1d100010c0 tx=0x7f1d18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.889+0000 7f1d2698a700 1 -- 172.21.15.63:0/1522404000 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d200b1f90 con 0x7f1d200b6cd0 2020-05-18T21:27:33.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.889+0000 7f1d16ffd700 1 -- 172.21.15.63:0/1522404000 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1d18007170 con 0x7f1d200b6cd0 2020-05-18T21:27:33.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.889+0000 7f1d27bec700 1 --2- 172.21.15.63:0/1522404000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d200b6cd0 0x7f1d200b3590 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f1d100010c0 tx=0x7f1d18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.889+0000 7f1d16ffd700 1 --2- 172.21.15.63:0/1522404000 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1d0804fe80 0x7f1d08052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:33.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.889+0000 7f1d16ffd700 1 -- 172.21.15.63:0/1522404000 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1d18064720 con 0x7f1d200b6cd0 2020-05-18T21:27:33.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.889+0000 7f1d26189700 1 --2- 172.21.15.63:0/1522404000 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1d0804fe80 0x7f1d08052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:33.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.889+0000 7f1d26189700 1 --2- 172.21.15.63:0/1522404000 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1d0804fe80 0x7f1d08052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d1c001020 tx=0x7f1d1c002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.889+0000 7f1d26189700 1 --2- 172.21.15.63:0/1522404000 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1d0804fe80 0x7f1d08052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d1c001020 tx=0x7f1d1c002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.889+0000 7f1d26189700 1 --2- 172.21.15.63:0/1522404000 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1d0804fe80 0x7f1d08052340 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f1d1c001020 tx=0x7f1d1c002740).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.901+0000 7f1d27bec700 1 --2- 172.21.15.63:0/1522404000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d200b6cd0 0x7f1d200b3590 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f1d100010c0 tx=0x7f1d18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:33.901+0000 7f1d16ffd700 1 -- 172.21.15.63:0/1522404000 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f1d1803eb70 con 0x7f1d200b6cd0 2020-05-18T21:27:34.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.053+0000 7f1d2698a700 1 -- 172.21.15.63:0/1522404000 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1d200569e0 con 0x7f1d200b6cd0 2020-05-18T21:27:34.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.065+0000 7f1d27bec700 1 --2- 172.21.15.63:0/1522404000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d200b6cd0 0x7f1d200b3590 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f1d100010c0 tx=0x7f1d18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.065+0000 7f1d16ffd700 1 -- 172.21.15.63:0/1522404000 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1d18042190 con 0x7f1d200b6cd0 2020-05-18T21:27:34.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.069+0000 7f1d2698a700 1 -- 172.21.15.63:0/1522404000 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1d0804fe80 msgr2=0x7f1d08052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.069+0000 7f1d2698a700 1 --2- 172.21.15.63:0/1522404000 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1d0804fe80 0x7f1d08052340 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f1d1c001020 tx=0x7f1d1c002740).stop 2020-05-18T21:27:34.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.069+0000 7f1d2698a700 1 -- 172.21.15.63:0/1522404000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d200b6cd0 msgr2=0x7f1d200b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.069+0000 7f1d2698a700 1 --2- 172.21.15.63:0/1522404000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d200b6cd0 0x7f1d200b3590 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7f1d100010c0 tx=0x7f1d18007e00).stop 2020-05-18T21:27:34.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.069+0000 7f1d2698a700 1 -- 172.21.15.63:0/1522404000 shutdown_connections 2020-05-18T21:27:34.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.069+0000 7f1d2698a700 1 --2- 172.21.15.63:0/1522404000 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1d0804fe80 0x7f1d08052340 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:34.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.069+0000 7f1d2698a700 1 --2- 172.21.15.63:0/1522404000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d200b6cd0 0x7f1d200b3590 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:34.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.069+0000 7f1d2698a700 1 -- 172.21.15.63:0/1522404000 >> 172.21.15.63:0/1522404000 conn(0x7f1d20069b70 msgr2=0x7f1d20133a60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:34.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.069+0000 7f1d2698a700 1 -- 172.21.15.63:0/1522404000 shutdown_connections 2020-05-18T21:27:34.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.069+0000 7f1d2698a700 1 -- 172.21.15.63:0/1522404000 wait complete. 2020-05-18T21:27:34.078 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.1 2020-05-18T21:27:34.090 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:27:34.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.197+0000 7f41b1206700 1 Processor -- start 2020-05-18T21:27:34.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.197+0000 7f41b1206700 1 -- start start 2020-05-18T21:27:34.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.197+0000 7f41b1206700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f41ac0b6410 0x7f41ac0b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:34.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.197+0000 7f41b1206700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ac025500 con 0x7f41ac0b5cb0 2020-05-18T21:27:34.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.197+0000 7f41b1206700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ac064ee0 con 0x7f41ac151bc0 2020-05-18T21:27:34.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.197+0000 7f41b1206700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ac0b67f0 con 0x7f41ac0b6410 2020-05-18T21:27:34.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.197+0000 7f41b0a05700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f41ac0b6410 0x7f41ac0b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:34.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.197+0000 7f41abfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f41ac0b5cb0 0x7f41ac061af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56380/0 (socket says 172.21.15.63:56380) 2020-05-18T21:27:34.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.197+0000 7f41abfff700 1 -- 172.21.15.63:0/237461256 learned_addr learned my addr 172.21.15.63:0/237461256 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:34.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41ab7fe700 1 -- 172.21.15.63:0/237461256 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661665898 0 0) 0x7f41ac025500 con 0x7f41ac0b5cb0 2020-05-18T21:27:34.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41ab7fe700 1 -- 172.21.15.63:0/237461256 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4194003270 con 0x7f41ac0b5cb0 2020-05-18T21:27:34.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41b0a05700 1 -- 172.21.15.63:0/237461256 >> v1:172.21.15.155:6789/0 conn(0x7f41ac151bc0 legacy=0x7f41ac152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41ab7fe700 1 -- 172.21.15.63:0/237461256 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75156439 0 0) 0x7f41ac064ee0 con 0x7f41ac151bc0 2020-05-18T21:27:34.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41b0a05700 1 -- 172.21.15.63:0/237461256 >> v1:172.21.15.63:6789/0 conn(0x7f41ac0b5cb0 legacy=0x7f41ac061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41b0a05700 1 -- 172.21.15.63:0/237461256 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac025180 con 0x7f41ac0b6410 2020-05-18T21:27:34.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41b0a05700 1 --2- 172.21.15.63:0/237461256 >> v2:172.21.15.63:3300/0 conn(0x7f41ac0b6410 0x7f41ac0b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f419c002f70 tx=0x7f419c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41b0a05700 1 --2- 172.21.15.63:0/237461256 >> v2:172.21.15.63:3300/0 conn(0x7f41ac0b6410 0x7f41ac0b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f419c002f70 tx=0x7f419c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41b0a05700 1 --2- 172.21.15.63:0/237461256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41ac0b6410 0x7f41ac0b6cd0 secure :-1 s=READY pgs=367 cs=0 l=1 rx=0x7f419c002f70 tx=0x7f419c007a80).ready entity=mon.0 client_cookie=f8f6db85c9b4d83f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:34.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41b0a05700 1 --2- 172.21.15.63:0/237461256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41ac0b6410 0x7f41ac0b6cd0 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f419c002f70 tx=0x7f419c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41ab7fe700 1 -- 172.21.15.63:0/237461256 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f419c008e80 con 0x7f41ac0b6410 2020-05-18T21:27:34.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41b0a05700 1 --2- 172.21.15.63:0/237461256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41ac0b6410 0x7f41ac0b6cd0 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f419c002f70 tx=0x7f419c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41ab7fe700 1 -- 172.21.15.63:0/237461256 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c0115f0 con 0x7f41ac0b6410 2020-05-18T21:27:34.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41b0a05700 1 --2- 172.21.15.63:0/237461256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41ac0b6410 0x7f41ac0b6cd0 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f419c002f70 tx=0x7f419c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41ab7fe700 1 -- 172.21.15.63:0/237461256 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f419c011990 con 0x7f41ac0b6410 2020-05-18T21:27:34.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41b1206700 1 -- 172.21.15.63:0/237461256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41ac0b6410 msgr2=0x7f41ac0b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41b1206700 1 --2- 172.21.15.63:0/237461256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41ac0b6410 0x7f41ac0b6cd0 secure :-1 s=READY pgs=367 cs=0 l=1 rx=0x7f419c002f70 tx=0x7f419c007a80).stop 2020-05-18T21:27:34.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41b1206700 1 -- 172.21.15.63:0/237461256 shutdown_connections 2020-05-18T21:27:34.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41b1206700 1 --2- 172.21.15.63:0/237461256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41ac0b6410 0x7f41ac0b6cd0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:34.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41b1206700 1 -- 172.21.15.63:0/237461256 >> 172.21.15.63:0/237461256 conn(0x7f41ac069b70 msgr2=0x7f41ac069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:34.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41b1206700 1 -- 172.21.15.63:0/237461256 shutdown_connections 2020-05-18T21:27:34.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.201+0000 7f41b1206700 1 -- 172.21.15.63:0/237461256 wait complete. 2020-05-18T21:27:34.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41b1206700 1 Processor -- start 2020-05-18T21:27:34.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41b1206700 1 -- start start 2020-05-18T21:27:34.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41b1206700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f41ac0b5cb0 0x7f41ac136560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:34.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41b1206700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ac1369c0 con 0x7f41ac0b6410 2020-05-18T21:27:34.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41b1206700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ac135b80 con 0x7f41ac151bc0 2020-05-18T21:27:34.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41b1206700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ac135e20 con 0x7f41ac0b5cb0 2020-05-18T21:27:34.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41abfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f41ac0b6410 0x7f41ac15ae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56388/0 (socket says 172.21.15.63:56388) 2020-05-18T21:27:34.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41abfff700 1 -- 172.21.15.63:0/724789955 learned_addr learned my addr 172.21.15.63:0/724789955 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:34.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41b0a05700 1 --2- 172.21.15.63:0/724789955 >> v2:172.21.15.155:3300/0 conn(0x7f41ac0b5cb0 0x7f41ac136560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:34.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41a97fa700 1 -- 172.21.15.63:0/724789955 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857366192 0 0) 0x7f41ac1369c0 con 0x7f41ac0b6410 2020-05-18T21:27:34.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41a97fa700 1 -- 172.21.15.63:0/724789955 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f418c003270 con 0x7f41ac0b6410 2020-05-18T21:27:34.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41a97fa700 1 -- 172.21.15.63:0/724789955 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182580062 0 0) 0x7f41ac135b80 con 0x7f41ac151bc0 2020-05-18T21:27:34.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41a97fa700 1 -- 172.21.15.63:0/724789955 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41ac1369c0 con 0x7f41ac151bc0 2020-05-18T21:27:34.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41b0a05700 1 -- 172.21.15.63:0/724789955 >> v1:172.21.15.155:6789/0 conn(0x7f41ac151bc0 legacy=0x7f41ac0b89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41b0a05700 1 -- 172.21.15.63:0/724789955 >> v1:172.21.15.63:6789/0 conn(0x7f41ac0b6410 legacy=0x7f41ac15ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41a97fa700 1 -- 172.21.15.63:0/724789955 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1749072983 0 0) 0x7f418c003270 con 0x7f41ac0b6410 2020-05-18T21:27:34.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41b0a05700 1 -- 172.21.15.63:0/724789955 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac1360c0 con 0x7f41ac0b5cb0 2020-05-18T21:27:34.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41b0a05700 1 --2- 172.21.15.63:0/724789955 >> v2:172.21.15.155:3300/0 conn(0x7f41ac0b5cb0 0x7f41ac136560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41a0000f50 tx=0x7f419c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41b0a05700 1 --2- 172.21.15.63:0/724789955 >> v2:172.21.15.155:3300/0 conn(0x7f41ac0b5cb0 0x7f41ac136560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41a0000f50 tx=0x7f419c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41b0a05700 1 --2- 172.21.15.63:0/724789955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41ac0b5cb0 0x7f41ac136560 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7f41a0000f50 tx=0x7f419c007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:34.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41b0a05700 1 --2- 172.21.15.63:0/724789955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41ac0b5cb0 0x7f41ac136560 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f41a0000f50 tx=0x7f419c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41a97fa700 1 -- 172.21.15.63:0/724789955 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41a00019c0 con 0x7f41ac0b5cb0 2020-05-18T21:27:34.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41b0a05700 1 --2- 172.21.15.63:0/724789955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41ac0b5cb0 0x7f41ac136560 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f41a0000f50 tx=0x7f419c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41b1206700 1 -- 172.21.15.63:0/724789955 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ac0b90c0 con 0x7f41ac0b5cb0 2020-05-18T21:27:34.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41a97fa700 1 -- 172.21.15.63:0/724789955 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c00f6b0 con 0x7f41ac0b5cb0 2020-05-18T21:27:34.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41b0a05700 1 --2- 172.21.15.63:0/724789955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41ac0b5cb0 0x7f41ac136560 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f41a0000f50 tx=0x7f419c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41a97fa700 1 -- 172.21.15.63:0/724789955 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f419c007170 con 0x7f41ac0b5cb0 2020-05-18T21:27:34.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.205+0000 7f41b1206700 1 -- 172.21.15.63:0/724789955 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ac151580 con 0x7f41ac0b5cb0 2020-05-18T21:27:34.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.209+0000 7f41b0a05700 1 --2- 172.21.15.63:0/724789955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41ac0b5cb0 0x7f41ac136560 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f41a0000f50 tx=0x7f419c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.209+0000 7f41b1206700 1 -- 172.21.15.63:0/724789955 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ac136280 con 0x7f41ac0b5cb0 2020-05-18T21:27:34.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.209+0000 7f41a97fa700 1 -- 172.21.15.63:0/724789955 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f419c007370 con 0x7f41ac0b5cb0 2020-05-18T21:27:34.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.209+0000 7f41b0a05700 1 --2- 172.21.15.63:0/724789955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41ac0b5cb0 0x7f41ac136560 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f41a0000f50 tx=0x7f419c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.209+0000 7f41a97fa700 1 --2- 172.21.15.63:0/724789955 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f418c04fe30 0x7f418c0522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:34.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.209+0000 7f41a97fa700 1 -- 172.21.15.63:0/724789955 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f419c063d00 con 0x7f41ac0b5cb0 2020-05-18T21:27:34.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.209+0000 7f41abfff700 1 --2- 172.21.15.63:0/724789955 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f418c04fe30 0x7f418c0522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:34.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.213+0000 7f41abfff700 1 --2- 172.21.15.63:0/724789955 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f418c04fe30 0x7f418c0522f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41a00016d0 tx=0x7f41a0009580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.213+0000 7f41abfff700 1 --2- 172.21.15.63:0/724789955 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f418c04fe30 0x7f418c0522f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41a00016d0 tx=0x7f41a0009580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.213+0000 7f41abfff700 1 --2- 172.21.15.63:0/724789955 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f418c04fe30 0x7f418c0522f0 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7f41a00016d0 tx=0x7f41a0009580).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:34.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.221+0000 7f41b0a05700 1 --2- 172.21.15.63:0/724789955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41ac0b5cb0 0x7f41ac136560 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f41a0000f50 tx=0x7f419c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.221+0000 7f41a97fa700 1 -- 172.21.15.63:0/724789955 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f419c03e1b0 con 0x7f41ac0b5cb0 2020-05-18T21:27:34.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.377+0000 7f41b1206700 1 -- 172.21.15.63:0/724789955 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f41ac0569e0 con 0x7f41ac0b5cb0 2020-05-18T21:27:34.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.385+0000 7f41b0a05700 1 --2- 172.21.15.63:0/724789955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41ac0b5cb0 0x7f41ac136560 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f41a0000f50 tx=0x7f419c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.385+0000 7f41a97fa700 1 -- 172.21.15.63:0/724789955 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7f419c0417d0 con 0x7f41ac0b5cb0 2020-05-18T21:27:34.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.385+0000 7f41b1206700 1 -- 172.21.15.63:0/724789955 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f418c04fe30 msgr2=0x7f418c0522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.385+0000 7f41b1206700 1 --2- 172.21.15.63:0/724789955 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f418c04fe30 0x7f418c0522f0 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7f41a00016d0 tx=0x7f41a0009580).stop 2020-05-18T21:27:34.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.385+0000 7f41b1206700 1 -- 172.21.15.63:0/724789955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41ac0b5cb0 msgr2=0x7f41ac136560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.385+0000 7f41b1206700 1 --2- 172.21.15.63:0/724789955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41ac0b5cb0 0x7f41ac136560 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7f41a0000f50 tx=0x7f419c007a80).stop 2020-05-18T21:27:34.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.385+0000 7f41b1206700 1 -- 172.21.15.63:0/724789955 shutdown_connections 2020-05-18T21:27:34.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.385+0000 7f41b1206700 1 --2- 172.21.15.63:0/724789955 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f418c04fe30 0x7f418c0522f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:34.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.385+0000 7f41b1206700 1 --2- 172.21.15.63:0/724789955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41ac0b5cb0 0x7f41ac136560 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:34.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.385+0000 7f41b1206700 1 -- 172.21.15.63:0/724789955 >> 172.21.15.63:0/724789955 conn(0x7f41ac069b70 msgr2=0x7f41ac15d190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:34.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.385+0000 7f41b1206700 1 -- 172.21.15.63:0/724789955 shutdown_connections 2020-05-18T21:27:34.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.389+0000 7f41b1206700 1 -- 172.21.15.63:0/724789955 wait complete. 2020-05-18T21:27:34.396 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.2 2020-05-18T21:27:34.406 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:27:34.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa58df700 1 Processor -- start 2020-05-18T21:27:34.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa58df700 1 -- start start 2020-05-18T21:27:34.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa58df700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbaa00b6410 0x7fbaa00b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:34.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa58df700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbaa0151bc0 0x7fbaa0152030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:34.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa58df700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa0025500 con 0x7fbaa00b5cb0 2020-05-18T21:27:34.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa58df700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa0064ee0 con 0x7fbaa0151bc0 2020-05-18T21:27:34.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa58df700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa00b67f0 con 0x7fbaa00b6410 2020-05-18T21:27:34.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa6b41700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbaa0151bc0 0x7fbaa0152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:34.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa6b41700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbaa0151bc0 0x7fbaa0152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54208/0 (socket says 172.21.15.63:54208) 2020-05-18T21:27:34.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa6b41700 1 -- 172.21.15.63:0/3871328767 learned_addr learned my addr 172.21.15.63:0/3871328767 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:34.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa50de700 1 --2- 172.21.15.63:0/3871328767 >> v2:172.21.15.155:3300/0 conn(0x7fbaa00b6410 0x7fbaa00b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:34.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa6b41700 1 -- 172.21.15.63:0/3871328767 >> v2:172.21.15.155:3300/0 conn(0x7fbaa00b6410 msgr2=0x7fbaa00b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:34.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa6b41700 1 --2- 172.21.15.63:0/3871328767 >> v2:172.21.15.155:3300/0 conn(0x7fbaa00b6410 0x7fbaa00b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:34.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa6b41700 1 -- 172.21.15.63:0/3871328767 >> v1:172.21.15.63:6789/0 conn(0x7fbaa00b5cb0 legacy=0x7fbaa0061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fba97fff700 1 -- 172.21.15.63:0/3871328767 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150984901 0 0) 0x7fbaa0025500 con 0x7fbaa00b5cb0 2020-05-18T21:27:34.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa6b41700 1 -- 172.21.15.63:0/3871328767 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa0025180 con 0x7fbaa0151bc0 2020-05-18T21:27:34.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa50de700 1 --2- 172.21.15.63:0/3871328767 >> v2:172.21.15.155:3300/0 conn(0x7fbaa00b6410 0x7fbaa00b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:27:34.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa6b41700 1 --2- 172.21.15.63:0/3871328767 >> v2:172.21.15.63:3300/0 conn(0x7fbaa0151bc0 0x7fbaa0152030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fba980032f0 tx=0x7fba98007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa6b41700 1 --2- 172.21.15.63:0/3871328767 >> v2:172.21.15.63:3300/0 conn(0x7fbaa0151bc0 0x7fbaa0152030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fba980032f0 tx=0x7fba98007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa6b41700 1 --2- 172.21.15.63:0/3871328767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaa0151bc0 0x7fbaa0152030 secure :-1 s=READY pgs=370 cs=0 l=1 rx=0x7fba980032f0 tx=0x7fba98007e00).ready entity=mon.0 client_cookie=ffed06bf44fbca82 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:34.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa6b41700 1 --2- 172.21.15.63:0/3871328767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaa0151bc0 0x7fbaa0152030 secure :-1 s=THROTTLE_DONE pgs=370 cs=0 l=1 rx=0x7fba980032f0 tx=0x7fba98007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fba97fff700 1 -- 172.21.15.63:0/3871328767 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba98011dc0 con 0x7fbaa0151bc0 2020-05-18T21:27:34.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa6b41700 1 --2- 172.21.15.63:0/3871328767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaa0151bc0 0x7fbaa0152030 secure :-1 s=THROTTLE_DONE pgs=370 cs=0 l=1 rx=0x7fba980032f0 tx=0x7fba98007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa6b41700 1 --2- 172.21.15.63:0/3871328767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaa0151bc0 0x7fbaa0152030 secure :-1 s=THROTTLE_DONE pgs=370 cs=0 l=1 rx=0x7fba980032f0 tx=0x7fba98007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fba97fff700 1 -- 172.21.15.63:0/3871328767 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9800a180 con 0x7fbaa0151bc0 2020-05-18T21:27:34.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fba97fff700 1 -- 172.21.15.63:0/3871328767 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba9800a560 con 0x7fbaa0151bc0 2020-05-18T21:27:34.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa58df700 1 -- 172.21.15.63:0/3871328767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaa0151bc0 msgr2=0x7fbaa0152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa58df700 1 --2- 172.21.15.63:0/3871328767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaa0151bc0 0x7fbaa0152030 secure :-1 s=READY pgs=370 cs=0 l=1 rx=0x7fba980032f0 tx=0x7fba98007e00).stop 2020-05-18T21:27:34.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa58df700 1 -- 172.21.15.63:0/3871328767 shutdown_connections 2020-05-18T21:27:34.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa58df700 1 --2- 172.21.15.63:0/3871328767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaa0151bc0 0x7fbaa0152030 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:34.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa58df700 1 --2- 172.21.15.63:0/3871328767 >> v2:172.21.15.155:3300/0 conn(0x7fbaa00b6410 0x7fbaa00b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:34.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa58df700 1 -- 172.21.15.63:0/3871328767 >> 172.21.15.63:0/3871328767 conn(0x7fbaa0069b70 msgr2=0x7fbaa0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:34.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa58df700 1 -- 172.21.15.63:0/3871328767 shutdown_connections 2020-05-18T21:27:34.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.513+0000 7fbaa58df700 1 -- 172.21.15.63:0/3871328767 wait complete. 2020-05-18T21:27:34.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa58df700 1 Processor -- start 2020-05-18T21:27:34.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa58df700 1 -- start start 2020-05-18T21:27:34.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa58df700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaa00b6410 0x7fbaa00b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:34.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa58df700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbaa0151bc0 0x7fbaa00ac760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:34.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa58df700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa0140be0 con 0x7fbaa00b5cb0 2020-05-18T21:27:34.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa58df700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa0140e80 con 0x7fbaa0151bc0 2020-05-18T21:27:34.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa58df700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa0130e10 con 0x7fbaa00b6410 2020-05-18T21:27:34.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa6b41700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbaa0151bc0 0x7fbaa00ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:34.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa48dd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaa00b6410 0x7fbaa00b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:34.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa48dd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaa00b6410 0x7fbaa00b4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:44912/0 (socket says 172.21.15.63:44912) 2020-05-18T21:27:34.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa48dd700 1 -- 172.21.15.63:0/4247413183 learned_addr learned my addr 172.21.15.63:0/4247413183 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:34.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa6b41700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbaa0151bc0 0x7fbaa00ac760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:40830/0 (socket says 172.21.15.63:40830) 2020-05-18T21:27:34.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa50de700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fbaa00b5cb0 0x7fbaa01312b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:54716/0 (socket says 172.21.15.63:54716) 2020-05-18T21:27:34.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fba95ffb700 1 -- 172.21.15.63:0/4247413183 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697408288 0 0) 0x7fbaa0140be0 con 0x7fbaa00b5cb0 2020-05-18T21:27:34.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fba95ffb700 1 -- 172.21.15.63:0/4247413183 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba80003270 con 0x7fbaa00b5cb0 2020-05-18T21:27:34.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa48dd700 1 -- 172.21.15.63:0/4247413183 >> v2:172.21.15.155:3300/0 conn(0x7fbaa0151bc0 msgr2=0x7fbaa00ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa48dd700 1 --2- 172.21.15.63:0/4247413183 >> v2:172.21.15.155:3300/0 conn(0x7fbaa0151bc0 0x7fbaa00ac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:34.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa48dd700 1 -- 172.21.15.63:0/4247413183 >> v1:172.21.15.155:6789/0 conn(0x7fbaa00b5cb0 legacy=0x7fbaa01312b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa48dd700 1 -- 172.21.15.63:0/4247413183 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa01319c0 con 0x7fbaa00b6410 2020-05-18T21:27:34.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa6b41700 1 --2- 172.21.15.63:0/4247413183 >> v2:172.21.15.155:3300/0 conn(0x7fbaa0151bc0 0x7fbaa00ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:34.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa48dd700 1 --2- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaa00b6410 0x7fbaa00b4ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fba90000bc0 tx=0x7fba9000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa48dd700 1 --2- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaa00b6410 0x7fbaa00b4ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fba90000bc0 tx=0x7fba9000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.517+0000 7fbaa48dd700 1 --2- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaa00b6410 0x7fbaa00b4ad0 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7fba90000bc0 tx=0x7fba9000c4a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:34.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.521+0000 7fbaa48dd700 1 --2- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaa00b6410 0x7fbaa00b4ad0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fba90000bc0 tx=0x7fba9000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.521+0000 7fba95ffb700 1 -- 172.21.15.63:0/4247413183 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba9000cc60 con 0x7fbaa00b6410 2020-05-18T21:27:34.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.521+0000 7fbaa48dd700 1 --2- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaa00b6410 0x7fbaa00b4ad0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fba90000bc0 tx=0x7fba9000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.521+0000 7fbaa48dd700 1 --2- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaa00b6410 0x7fbaa00b4ad0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fba90000bc0 tx=0x7fba9000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.521+0000 7fba95ffb700 1 -- 172.21.15.63:0/4247413183 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9000cdc0 con 0x7fbaa00b6410 2020-05-18T21:27:34.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.521+0000 7fbaa58df700 1 -- 172.21.15.63:0/4247413183 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa00b5170 con 0x7fbaa00b6410 2020-05-18T21:27:34.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.521+0000 7fba95ffb700 1 -- 172.21.15.63:0/4247413183 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba90011140 con 0x7fbaa00b6410 2020-05-18T21:27:34.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.521+0000 7fbaa58df700 1 -- 172.21.15.63:0/4247413183 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa00acd60 con 0x7fbaa00b6410 2020-05-18T21:27:34.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.521+0000 7fbaa48dd700 1 --2- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaa00b6410 0x7fbaa00b4ad0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fba90000bc0 tx=0x7fba9000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.521+0000 7fbaa58df700 1 -- 172.21.15.63:0/4247413183 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa0130c60 con 0x7fbaa00b6410 2020-05-18T21:27:34.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.525+0000 7fba95ffb700 1 -- 172.21.15.63:0/4247413183 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fba90006520 con 0x7fbaa00b6410 2020-05-18T21:27:34.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.525+0000 7fbaa48dd700 1 --2- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaa00b6410 0x7fbaa00b4ad0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fba90000bc0 tx=0x7fba9000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.525+0000 7fba95ffb700 1 --2- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fba8004fdc0 0x7fba80052280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:34.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.525+0000 7fba95ffb700 1 -- 172.21.15.63:0/4247413183 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fba90063620 con 0x7fbaa00b6410 2020-05-18T21:27:34.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.525+0000 7fbaa50de700 1 --2- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fba8004fdc0 0x7fba80052280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:34.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.525+0000 7fbaa50de700 1 --2- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fba8004fdc0 0x7fba80052280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fba9c007760 tx=0x7fba9c0013c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.525+0000 7fbaa50de700 1 --2- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fba8004fdc0 0x7fba80052280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fba9c007760 tx=0x7fba9c0013c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.525+0000 7fbaa50de700 1 --2- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fba8004fdc0 0x7fba80052280 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7fba9c007760 tx=0x7fba9c0013c0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:34.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.533+0000 7fbaa48dd700 1 --2- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaa00b6410 0x7fbaa00b4ad0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fba90000bc0 tx=0x7fba9000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.533+0000 7fba95ffb700 1 -- 172.21.15.63:0/4247413183 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fba9003d9b0 con 0x7fbaa00b6410 2020-05-18T21:27:34.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.685+0000 7fbaa58df700 1 -- 172.21.15.63:0/4247413183 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fbaa0131b50 con 0x7fbaa00b6410 2020-05-18T21:27:34.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.693+0000 7fbaa48dd700 1 --2- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaa00b6410 0x7fbaa00b4ad0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fba90000bc0 tx=0x7fba9000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.693+0000 7fba95ffb700 1 -- 172.21.15.63:0/4247413183 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7fbaa0131b50 con 0x7fbaa00b6410 2020-05-18T21:27:34.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.697+0000 7fbaa58df700 1 -- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fba8004fdc0 msgr2=0x7fba80052280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.697+0000 7fbaa58df700 1 --2- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fba8004fdc0 0x7fba80052280 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7fba9c007760 tx=0x7fba9c0013c0).stop 2020-05-18T21:27:34.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.697+0000 7fbaa58df700 1 -- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaa00b6410 msgr2=0x7fbaa00b4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.697+0000 7fbaa58df700 1 --2- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaa00b6410 0x7fbaa00b4ad0 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7fba90000bc0 tx=0x7fba9000c4a0).stop 2020-05-18T21:27:34.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.697+0000 7fbaa58df700 1 -- 172.21.15.63:0/4247413183 shutdown_connections 2020-05-18T21:27:34.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.697+0000 7fbaa58df700 1 --2- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fba8004fdc0 0x7fba80052280 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:34.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.697+0000 7fbaa58df700 1 --2- 172.21.15.63:0/4247413183 >> v2:172.21.15.155:3300/0 conn(0x7fbaa0151bc0 0x7fbaa00ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:34.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.697+0000 7fbaa58df700 1 --2- 172.21.15.63:0/4247413183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaa00b6410 0x7fbaa00b4ad0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:34.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.697+0000 7fbaa58df700 1 -- 172.21.15.63:0/4247413183 >> 172.21.15.63:0/4247413183 conn(0x7fbaa0069b70 msgr2=0x7fbaa0024770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:34.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.697+0000 7fbaa58df700 1 -- 172.21.15.63:0/4247413183 shutdown_connections 2020-05-18T21:27:34.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.697+0000 7fbaa58df700 1 -- 172.21.15.63:0/4247413183 wait complete. 2020-05-18T21:27:34.706 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.3 2020-05-18T21:27:34.715 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:27:34.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.809+0000 7f2aaafde700 1 Processor -- start 2020-05-18T21:27:34.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aaafde700 1 -- start start 2020-05-18T21:27:34.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aaafde700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2aa40b2860 0x7f2aa40615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:34.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aaafde700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa414e570 0x7f2aa414a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:34.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aaafde700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa414d960 con 0x7f2aa4060b90 2020-05-18T21:27:34.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aaafde700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa4066210 con 0x7f2aa40b2860 2020-05-18T21:27:34.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aaafde700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa414db90 con 0x7f2aa414e570 2020-05-18T21:27:34.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2aa40b2860 0x7f2aa40615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:34.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2aa40b2860 0x7f2aa40615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:40834/0 (socket says 172.21.15.63:40834) 2020-05-18T21:27:34.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa957b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa414e570 0x7f2aa414a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:34.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa3fff700 1 -- 172.21.15.63:0/252699594 learned_addr learned my addr 172.21.15.63:0/252699594 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:34.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa8d7a700 1 --1- 172.21.15.63:0/252699594 >> v1:172.21.15.155:6789/0 conn(0x7f2aa4060b90 0x7f2aa4144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:54724/0 (socket says 172.21.15.63:54724) 2020-05-18T21:27:34.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa3fff700 1 -- 172.21.15.63:0/252699594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa414e570 msgr2=0x7f2aa414a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:34.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa3fff700 1 --2- 172.21.15.63:0/252699594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa414e570 0x7f2aa414a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:34.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa3fff700 1 -- 172.21.15.63:0/252699594 >> v1:172.21.15.155:6789/0 conn(0x7f2aa4060b90 legacy=0x7f2aa4144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa37fe700 1 -- 172.21.15.63:0/252699594 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178079841 0 0) 0x7f2aa414d960 con 0x7f2aa4060b90 2020-05-18T21:27:34.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa3fff700 1 -- 172.21.15.63:0/252699594 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa414de30 con 0x7f2aa40b2860 2020-05-18T21:27:34.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa957b700 1 --2- 172.21.15.63:0/252699594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa414e570 0x7f2aa414a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:34.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa3fff700 1 --2- 172.21.15.63:0/252699594 >> v2:172.21.15.155:3300/0 conn(0x7f2aa40b2860 0x7f2aa40615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2a94002f70 tx=0x7f2a94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa3fff700 1 --2- 172.21.15.63:0/252699594 >> v2:172.21.15.155:3300/0 conn(0x7f2aa40b2860 0x7f2aa40615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2a94002f70 tx=0x7f2a94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa3fff700 1 --2- 172.21.15.63:0/252699594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa40b2860 0x7f2aa40615e0 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7f2a94002f70 tx=0x7f2a94007a80).ready entity=mon.1 client_cookie=44d9fd387398690e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:34.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa3fff700 1 --2- 172.21.15.63:0/252699594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa40b2860 0x7f2aa40615e0 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f2a94002f70 tx=0x7f2a94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa37fe700 1 -- 172.21.15.63:0/252699594 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a94008e60 con 0x7f2aa40b2860 2020-05-18T21:27:34.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa3fff700 1 --2- 172.21.15.63:0/252699594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa40b2860 0x7f2aa40615e0 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f2a94002f70 tx=0x7f2a94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa37fe700 1 -- 172.21.15.63:0/252699594 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a940118a0 con 0x7f2aa40b2860 2020-05-18T21:27:34.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa3fff700 1 --2- 172.21.15.63:0/252699594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa40b2860 0x7f2aa40615e0 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f2a94002f70 tx=0x7f2a94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aa37fe700 1 -- 172.21.15.63:0/252699594 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a94011c40 con 0x7f2aa40b2860 2020-05-18T21:27:34.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aaafde700 1 -- 172.21.15.63:0/252699594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa40b2860 msgr2=0x7f2aa40615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.813+0000 7f2aaafde700 1 --2- 172.21.15.63:0/252699594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa40b2860 0x7f2aa40615e0 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7f2a94002f70 tx=0x7f2a94007a80).stop 2020-05-18T21:27:34.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.817+0000 7f2aaafde700 1 -- 172.21.15.63:0/252699594 shutdown_connections 2020-05-18T21:27:34.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.817+0000 7f2aaafde700 1 --2- 172.21.15.63:0/252699594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa414e570 0x7f2aa414a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:34.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.817+0000 7f2aaafde700 1 --2- 172.21.15.63:0/252699594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa40b2860 0x7f2aa40615e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:34.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.817+0000 7f2aaafde700 1 -- 172.21.15.63:0/252699594 >> 172.21.15.63:0/252699594 conn(0x7f2aa40b83d0 msgr2=0x7f2aa40b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:34.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.817+0000 7f2aaafde700 1 -- 172.21.15.63:0/252699594 shutdown_connections 2020-05-18T21:27:34.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.817+0000 7f2aaafde700 1 -- 172.21.15.63:0/252699594 wait complete. 2020-05-18T21:27:34.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.817+0000 7f2aaafde700 1 Processor -- start 2020-05-18T21:27:34.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.817+0000 7f2aaafde700 1 -- start start 2020-05-18T21:27:34.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aaafde700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2aa40b2860 0x7f2aa40b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:34.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aaafde700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa414e570 0x7f2aa415b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:34.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aaafde700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa40b3510 con 0x7f2aa4060b90 2020-05-18T21:27:34.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aaafde700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa4149eb0 con 0x7f2aa40b2860 2020-05-18T21:27:34.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aaafde700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa415ad00 con 0x7f2aa414e570 2020-05-18T21:27:34.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa8d7a700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f2aa4060b90 0x7f2aa4149610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:54728/0 (socket says 172.21.15.63:54728) 2020-05-18T21:27:34.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2aa40b2860 0x7f2aa40b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:34.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa957b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa414e570 0x7f2aa415b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:34.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa8d7a700 1 -- 172.21.15.63:0/3359629890 learned_addr learned my addr 172.21.15.63:0/3359629890 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:34.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa3fff700 1 -- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa414e570 msgr2=0x7f2aa415b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa3fff700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa414e570 0x7f2aa415b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:34.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa3fff700 1 -- 172.21.15.63:0/3359629890 >> v1:172.21.15.155:6789/0 conn(0x7f2aa4060b90 legacy=0x7f2aa4149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa1ffb700 1 -- 172.21.15.63:0/3359629890 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835846365 0 0) 0x7f2aa40b3510 con 0x7f2aa4060b90 2020-05-18T21:27:34.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa3fff700 1 -- 172.21.15.63:0/3359629890 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa4157c40 con 0x7f2aa40b2860 2020-05-18T21:27:34.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa957b700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa414e570 0x7f2aa415b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:34.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa3fff700 1 --2- 172.21.15.63:0/3359629890 >> v2:172.21.15.155:3300/0 conn(0x7f2aa40b2860 0x7f2aa40b30b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2a94002f70 tx=0x7f2a94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa3fff700 1 --2- 172.21.15.63:0/3359629890 >> v2:172.21.15.155:3300/0 conn(0x7f2aa40b2860 0x7f2aa40b30b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2a94002f70 tx=0x7f2a94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa3fff700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa40b2860 0x7f2aa40b30b0 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f2a94002f70 tx=0x7f2a94007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:34.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa3fff700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa40b2860 0x7f2aa40b30b0 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f2a94002f70 tx=0x7f2a94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa1ffb700 1 -- 172.21.15.63:0/3359629890 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a9400f940 con 0x7f2aa40b2860 2020-05-18T21:27:34.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa3fff700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa40b2860 0x7f2aa40b30b0 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f2a94002f70 tx=0x7f2a94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa3fff700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa40b2860 0x7f2aa40b30b0 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f2a94002f70 tx=0x7f2a94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aaafde700 1 -- 172.21.15.63:0/3359629890 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa4157e50 con 0x7f2aa40b2860 2020-05-18T21:27:34.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa1ffb700 1 -- 172.21.15.63:0/3359629890 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a94011e40 con 0x7f2aa40b2860 2020-05-18T21:27:34.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa1ffb700 1 -- 172.21.15.63:0/3359629890 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a94007550 con 0x7f2aa40b2860 2020-05-18T21:27:34.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aaafde700 1 -- 172.21.15.63:0/3359629890 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa40ac7d0 con 0x7f2aa40b2860 2020-05-18T21:27:34.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aa3fff700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa40b2860 0x7f2aa40b30b0 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f2a94002f70 tx=0x7f2a94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.821+0000 7f2aaafde700 1 -- 172.21.15.63:0/3359629890 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa40569e0 con 0x7f2aa40b2860 2020-05-18T21:27:34.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.825+0000 7f2aa1ffb700 1 -- 172.21.15.63:0/3359629890 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2a94005700 con 0x7f2aa40b2860 2020-05-18T21:27:34.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.825+0000 7f2aa3fff700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa40b2860 0x7f2aa40b30b0 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f2a94002f70 tx=0x7f2a94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.825+0000 7f2aa1ffb700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2a8404f880 0x7f2a84051d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:34.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.825+0000 7f2aa1ffb700 1 -- 172.21.15.63:0/3359629890 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2a94064040 con 0x7f2aa40b2860 2020-05-18T21:27:34.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.825+0000 7f2aa8d7a700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2a8404f880 0x7f2a84051d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:34.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.825+0000 7f2aa8d7a700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2a8404f880 0x7f2a84051d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2a98001360 tx=0x7f2a98001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.825+0000 7f2aa8d7a700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2a8404f880 0x7f2a84051d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2a98001360 tx=0x7f2a98001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.825+0000 7f2aa8d7a700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2a8404f880 0x7f2a84051d40 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f2a98001360 tx=0x7f2a98001820).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:34.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.833+0000 7f2aa3fff700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa40b2860 0x7f2aa40b30b0 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f2a94002f70 tx=0x7f2a94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.833+0000 7f2aa1ffb700 1 -- 172.21.15.63:0/3359629890 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2a9403e430 con 0x7f2aa40b2860 2020-05-18T21:27:34.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.981+0000 7f2aaafde700 1 -- 172.21.15.63:0/3359629890 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2aa415ae40 con 0x7f2aa40b2860 2020-05-18T21:27:34.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.981+0000 7f2aa3fff700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa40b2860 0x7f2aa40b30b0 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f2a94002f70 tx=0x7f2a94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:34.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.981+0000 7f2aa1ffb700 1 -- 172.21.15.63:0/3359629890 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f2a94041a50 con 0x7f2aa40b2860 2020-05-18T21:27:34.988 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:34.988 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5055,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2600411689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2600411689},{"type":"v1","addr":"172.21.15.63:6833","nonce":2600411689}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:27:31.884487+0000","modified":"2020-05-18T21:27:32.888860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5064},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5064":{"gid":5064,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1028402057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1028402057},{"type":"v1","addr":"172.21.15.155:6835","nonce":1028402057}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-05-18T21:27:34.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.981+0000 7f2aaafde700 1 -- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2a8404f880 msgr2=0x7f2a84051d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.981+0000 7f2aaafde700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2a8404f880 0x7f2a84051d40 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f2a98001360 tx=0x7f2a98001820).stop 2020-05-18T21:27:34.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.981+0000 7f2aaafde700 1 -- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa40b2860 msgr2=0x7f2aa40b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:34.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.981+0000 7f2aaafde700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa40b2860 0x7f2aa40b30b0 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f2a94002f70 tx=0x7f2a94007a80).stop 2020-05-18T21:27:34.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.981+0000 7f2aaafde700 1 -- 172.21.15.63:0/3359629890 shutdown_connections 2020-05-18T21:27:34.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.981+0000 7f2aaafde700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2a8404f880 0x7f2a84051d40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:34.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.981+0000 7f2aaafde700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa414e570 0x7f2aa415b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:34.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.981+0000 7f2aaafde700 1 --2- 172.21.15.63:0/3359629890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa40b2860 0x7f2aa40b30b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:34.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.981+0000 7f2aaafde700 1 -- 172.21.15.63:0/3359629890 >> 172.21.15.63:0/3359629890 conn(0x7f2aa40b83d0 msgr2=0x7f2aa4064240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:34.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.981+0000 7f2aaafde700 1 -- 172.21.15.63:0/3359629890 shutdown_connections 2020-05-18T21:27:34.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:34.981+0000 7f2aaafde700 1 -- 172.21.15.63:0/3359629890 wait complete. 2020-05-18T21:27:34.992 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 12 2020-05-18T21:27:35.203 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:27:31.884487+0000', 'modified': '2020-05-18T21:27:32.888860+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5064}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5064': {'gid': 5064, 'name': 'b', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6835/1028402057', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 1028402057}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 1028402057}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:27:35.203 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:27:35.204 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:27:35.306 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:27:35.307 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:27:35.307 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2020-05-18T21:27:35.307 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 5064, 2020-05-18T21:27:35.307 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:27:35.308 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:27:35.308 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 3.4157222909999998, 2020-05-18T21:27:35.308 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 12, 2020-05-18T21:27:35.308 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 33, 2020-05-18T21:27:35.308 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 33, 2020-05-18T21:27:35.308 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 9.9877260010000004 2020-05-18T21:27:35.309 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:27:35.315 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 5064, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.4157222909999998, "mdsmap_epoch": 12, "osdmap_epoch": 33, "osdmap_epoch_barrier": 33, "uptime": 9.9877260010000004 } 2020-05-18T21:27:35.316 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:27:35.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.417+0000 7f7aaf59e700 1 Processor -- start 2020-05-18T21:27:35.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.417+0000 7f7aaf59e700 1 -- start start 2020-05-18T21:27:35.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aaf59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7ab0149db0 0x7f7ab01492f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:35.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aaf59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ab01468f0 0x7f7ab00628e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:35.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aaf59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab0145cc0 con 0x7f7ab0060310 2020-05-18T21:27:35.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aaf59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab014a190 con 0x7f7ab0149db0 2020-05-18T21:27:35.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aaf59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab0060fd0 con 0x7f7ab01468f0 2020-05-18T21:27:35.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aae59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7ab0149db0 0x7f7ab01492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:35.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aae59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7ab0149db0 0x7f7ab01492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:40848/0 (socket says 172.21.15.63:40848) 2020-05-18T21:27:35.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aaed9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ab01468f0 0x7f7ab00628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:35.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aae59c700 1 -- 172.21.15.63:0/3894282970 learned_addr learned my addr 172.21.15.63:0/3894282970 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:35.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aae59c700 1 -- 172.21.15.63:0/3894282970 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ab01468f0 msgr2=0x7f7ab00628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:35.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aae59c700 1 --2- 172.21.15.63:0/3894282970 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ab01468f0 0x7f7ab00628e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:35.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aae59c700 1 -- 172.21.15.63:0/3894282970 >> v1:172.21.15.155:6789/0 conn(0x7f7ab0060310 legacy=0x7f7ab00b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:35.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aae59c700 1 -- 172.21.15.63:0/3894282970 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab0145f10 con 0x7f7ab0149db0 2020-05-18T21:27:35.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aaed9d700 1 --2- 172.21.15.63:0/3894282970 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ab01468f0 0x7f7ab00628e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:35.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aae59c700 1 --2- 172.21.15.63:0/3894282970 >> v2:172.21.15.155:3300/0 conn(0x7f7ab0149db0 0x7f7ab01492f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7aa0002f70 tx=0x7f7ab0066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aae59c700 1 --2- 172.21.15.63:0/3894282970 >> v2:172.21.15.155:3300/0 conn(0x7f7ab0149db0 0x7f7ab01492f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7aa0002f70 tx=0x7f7ab0066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aae59c700 1 --2- 172.21.15.63:0/3894282970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab0149db0 0x7f7ab01492f0 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7f7aa0002f70 tx=0x7f7ab0066620).ready entity=mon.1 client_cookie=a14b7f5cc201d8e0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:35.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aae59c700 1 --2- 172.21.15.63:0/3894282970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab0149db0 0x7f7ab01492f0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f7aa0002f70 tx=0x7f7ab0066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aad59a700 1 -- 172.21.15.63:0/3894282970 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aa00116b0 con 0x7f7ab0149db0 2020-05-18T21:27:35.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aae59c700 1 --2- 172.21.15.63:0/3894282970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab0149db0 0x7f7ab01492f0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f7aa0002f70 tx=0x7f7ab0066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aae59c700 1 --2- 172.21.15.63:0/3894282970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab0149db0 0x7f7ab01492f0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f7aa0002f70 tx=0x7f7ab0066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aad59a700 1 -- 172.21.15.63:0/3894282970 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa0011810 con 0x7f7ab0149db0 2020-05-18T21:27:35.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aad59a700 1 -- 172.21.15.63:0/3894282970 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aa0011c30 con 0x7f7ab0149db0 2020-05-18T21:27:35.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aaf59e700 1 -- 172.21.15.63:0/3894282970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab0149db0 msgr2=0x7f7ab01492f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:35.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.421+0000 7f7aaf59e700 1 --2- 172.21.15.63:0/3894282970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab0149db0 0x7f7ab01492f0 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7f7aa0002f70 tx=0x7f7ab0066620).stop 2020-05-18T21:27:35.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.425+0000 7f7aaf59e700 1 -- 172.21.15.63:0/3894282970 shutdown_connections 2020-05-18T21:27:35.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.425+0000 7f7aaf59e700 1 --2- 172.21.15.63:0/3894282970 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ab01468f0 0x7f7ab00628e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:35.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.425+0000 7f7aaf59e700 1 --2- 172.21.15.63:0/3894282970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab0149db0 0x7f7ab01492f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:35.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.425+0000 7f7aaf59e700 1 -- 172.21.15.63:0/3894282970 >> 172.21.15.63:0/3894282970 conn(0x7f7ab005eee0 msgr2=0x7f7ab005f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:35.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.425+0000 7f7aaf59e700 1 -- 172.21.15.63:0/3894282970 shutdown_connections 2020-05-18T21:27:35.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.425+0000 7f7aaf59e700 1 -- 172.21.15.63:0/3894282970 wait complete. 2020-05-18T21:27:35.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.425+0000 7f7aaf59e700 1 Processor -- start 2020-05-18T21:27:35.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.425+0000 7f7aaf59e700 1 -- start start 2020-05-18T21:27:35.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7aaf59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7ab0149db0 0x7f7ab00b1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:35.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7aaf59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab00b45c0 con 0x7f7ab01468f0 2020-05-18T21:27:35.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7aaf59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab013ec20 con 0x7f7ab0060310 2020-05-18T21:27:35.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7aaf59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab00b43d0 con 0x7f7ab0149db0 2020-05-18T21:27:35.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7aadd9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7ab01468f0 0x7f7ab0153530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56428/0 (socket says 172.21.15.63:56428) 2020-05-18T21:27:35.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7aadd9b700 1 -- 172.21.15.63:0/4243950953 learned_addr learned my addr 172.21.15.63:0/4243950953 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:35.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7aaed9d700 1 --2- 172.21.15.63:0/4243950953 >> v2:172.21.15.155:3300/0 conn(0x7f7ab0149db0 0x7f7ab00b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:35.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7a9f7fe700 1 -- 172.21.15.63:0/4243950953 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858685242 0 0) 0x7f7ab00b45c0 con 0x7f7ab01468f0 2020-05-18T21:27:35.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7a9f7fe700 1 -- 172.21.15.63:0/4243950953 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a8c002fe0 con 0x7f7ab01468f0 2020-05-18T21:27:35.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7aaed9d700 1 -- 172.21.15.63:0/4243950953 >> v1:172.21.15.155:6789/0 conn(0x7f7ab0060310 legacy=0x7f7ab013e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:35.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7aaed9d700 1 -- 172.21.15.63:0/4243950953 >> v1:172.21.15.63:6789/0 conn(0x7f7ab01468f0 legacy=0x7f7ab0153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:35.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7aaed9d700 1 -- 172.21.15.63:0/4243950953 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab00b1c60 con 0x7f7ab0149db0 2020-05-18T21:27:35.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7aaed9d700 1 --2- 172.21.15.63:0/4243950953 >> v2:172.21.15.155:3300/0 conn(0x7f7ab0149db0 0x7f7ab00b1410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7aa80032f0 tx=0x7f7aa8011080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7aaed9d700 1 --2- 172.21.15.63:0/4243950953 >> v2:172.21.15.155:3300/0 conn(0x7f7ab0149db0 0x7f7ab00b1410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7aa80032f0 tx=0x7f7aa8011080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7aaed9d700 1 --2- 172.21.15.63:0/4243950953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab0149db0 0x7f7ab00b1410 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7f7aa80032f0 tx=0x7f7aa8011080).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:35.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7aaed9d700 1 --2- 172.21.15.63:0/4243950953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab0149db0 0x7f7ab00b1410 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f7aa80032f0 tx=0x7f7aa8011080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7a9f7fe700 1 -- 172.21.15.63:0/4243950953 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aa800cb40 con 0x7f7ab0149db0 2020-05-18T21:27:35.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7aaed9d700 1 --2- 172.21.15.63:0/4243950953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab0149db0 0x7f7ab00b1410 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f7aa80032f0 tx=0x7f7aa8011080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7aaf59e700 1 -- 172.21.15.63:0/4243950953 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab013e710 con 0x7f7ab0149db0 2020-05-18T21:27:35.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7a9f7fe700 1 -- 172.21.15.63:0/4243950953 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa800cca0 con 0x7f7ab0149db0 2020-05-18T21:27:35.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7aaed9d700 1 --2- 172.21.15.63:0/4243950953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab0149db0 0x7f7ab00b1410 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f7aa80032f0 tx=0x7f7aa8011080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7a9f7fe700 1 -- 172.21.15.63:0/4243950953 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aa8012720 con 0x7f7ab0149db0 2020-05-18T21:27:35.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.429+0000 7f7aaf59e700 1 -- 172.21.15.63:0/4243950953 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab00b0a80 con 0x7f7ab0149db0 2020-05-18T21:27:35.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.433+0000 7f7aaed9d700 1 --2- 172.21.15.63:0/4243950953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab0149db0 0x7f7ab00b1410 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f7aa80032f0 tx=0x7f7aa8011080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.433+0000 7f7aaf59e700 1 -- 172.21.15.63:0/4243950953 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab013edb0 con 0x7f7ab0149db0 2020-05-18T21:27:35.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.433+0000 7f7a9f7fe700 1 -- 172.21.15.63:0/4243950953 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7aa800e1a0 con 0x7f7ab0149db0 2020-05-18T21:27:35.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.433+0000 7f7aaed9d700 1 --2- 172.21.15.63:0/4243950953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab0149db0 0x7f7ab00b1410 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f7aa80032f0 tx=0x7f7aa8011080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.433+0000 7f7a9f7fe700 1 --2- 172.21.15.63:0/4243950953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7a8c04fd60 0x7f7a8c052220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:35.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.433+0000 7f7a9f7fe700 1 -- 172.21.15.63:0/4243950953 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7aa8063e00 con 0x7f7ab0149db0 2020-05-18T21:27:35.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.433+0000 7f7aae59c700 1 --2- 172.21.15.63:0/4243950953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7a8c04fd60 0x7f7a8c052220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:35.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.433+0000 7f7aae59c700 1 --2- 172.21.15.63:0/4243950953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7a8c04fd60 0x7f7a8c052220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7ab0065690 tx=0x7f7ab0066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.433+0000 7f7aae59c700 1 --2- 172.21.15.63:0/4243950953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7a8c04fd60 0x7f7a8c052220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7ab0065690 tx=0x7f7ab0066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.433+0000 7f7aae59c700 1 --2- 172.21.15.63:0/4243950953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7a8c04fd60 0x7f7a8c052220 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7f7ab0065690 tx=0x7f7ab0066620).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:35.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.441+0000 7f7aaed9d700 1 --2- 172.21.15.63:0/4243950953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab0149db0 0x7f7ab00b1410 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f7aa80032f0 tx=0x7f7aa8011080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.441+0000 7f7a9f7fe700 1 -- 172.21.15.63:0/4243950953 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f7aa803e1f0 con 0x7f7ab0149db0 2020-05-18T21:27:35.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.557+0000 7f7aaf59e700 1 -- 172.21.15.63:0/4243950953 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ab00569e0 con 0x7f7ab0149db0 2020-05-18T21:27:35.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.561+0000 7f7aaed9d700 1 --2- 172.21.15.63:0/4243950953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab0149db0 0x7f7ab00b1410 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f7aa80032f0 tx=0x7f7aa8011080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.561+0000 7f7a9f7fe700 1 -- 172.21.15.63:0/4243950953 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f7aa8041810 con 0x7f7ab0149db0 2020-05-18T21:27:35.568 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:35.568 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":33,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:27:32.887660+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:27:29.817430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2020-05-18T21:27:30.879596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:27:35.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.561+0000 7f7aaf59e700 1 -- 172.21.15.63:0/4243950953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7a8c04fd60 msgr2=0x7f7a8c052220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:35.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.561+0000 7f7aaf59e700 1 --2- 172.21.15.63:0/4243950953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7a8c04fd60 0x7f7a8c052220 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7f7ab0065690 tx=0x7f7ab0066620).stop 2020-05-18T21:27:35.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.561+0000 7f7aaf59e700 1 -- 172.21.15.63:0/4243950953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab0149db0 msgr2=0x7f7ab00b1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:35.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.561+0000 7f7aaf59e700 1 --2- 172.21.15.63:0/4243950953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab0149db0 0x7f7ab00b1410 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7f7aa80032f0 tx=0x7f7aa8011080).stop 2020-05-18T21:27:35.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.561+0000 7f7aaf59e700 1 -- 172.21.15.63:0/4243950953 shutdown_connections 2020-05-18T21:27:35.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.561+0000 7f7aaf59e700 1 --2- 172.21.15.63:0/4243950953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7a8c04fd60 0x7f7a8c052220 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:35.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.561+0000 7f7aaf59e700 1 --2- 172.21.15.63:0/4243950953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab0149db0 0x7f7ab00b1410 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:35.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.561+0000 7f7aaf59e700 1 -- 172.21.15.63:0/4243950953 >> 172.21.15.63:0/4243950953 conn(0x7f7ab005eee0 msgr2=0x7f7ab00ba5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:35.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.561+0000 7f7aaf59e700 1 -- 172.21.15.63:0/4243950953 shutdown_connections 2020-05-18T21:27:35.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.561+0000 7f7aaf59e700 1 -- 172.21.15.63:0/4243950953 wait complete. 2020-05-18T21:27:35.581 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:27:29.817430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:27:30.879596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:27:35.582 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:27:35.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.685+0000 7fe15cd79700 1 Processor -- start 2020-05-18T21:27:35.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.685+0000 7fe15cd79700 1 -- start start 2020-05-18T21:27:35.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.685+0000 7fe15cd79700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe1580b3690 0x7fe158066080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:35.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.685+0000 7fe15cd79700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe158062780 con 0x7fe15809eba0 2020-05-18T21:27:35.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.685+0000 7fe15cd79700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15806a4d0 con 0x7fe15813ff20 2020-05-18T21:27:35.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.685+0000 7fe1577fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe15809eba0 0x7fe15809ef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56434/0 (socket says 172.21.15.63:56434) 2020-05-18T21:27:35.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.685+0000 7fe15cd79700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15806a770 con 0x7fe1580b3690 2020-05-18T21:27:35.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.685+0000 7fe1577fe700 1 -- 172.21.15.63:0/3156982568 learned_addr learned my addr 172.21.15.63:0/3156982568 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:35.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.685+0000 7fe156ffd700 1 --2- 172.21.15.63:0/3156982568 >> v2:172.21.15.63:3300/0 conn(0x7fe1580b3690 0x7fe158066080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:35.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe1567fc700 1 -- 172.21.15.63:0/3156982568 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986666395 0 0) 0x7fe158062780 con 0x7fe15809eba0 2020-05-18T21:27:35.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe1567fc700 1 -- 172.21.15.63:0/3156982568 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe144003270 con 0x7fe15809eba0 2020-05-18T21:27:35.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe156ffd700 1 -- 172.21.15.63:0/3156982568 >> v1:172.21.15.155:6789/0 conn(0x7fe15813ff20 legacy=0x7fe158149860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:35.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe156ffd700 1 -- 172.21.15.63:0/3156982568 >> v1:172.21.15.63:6789/0 conn(0x7fe15809eba0 legacy=0x7fe15809ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:35.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe156ffd700 1 -- 172.21.15.63:0/3156982568 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe158140390 con 0x7fe1580b3690 2020-05-18T21:27:35.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe156ffd700 1 --2- 172.21.15.63:0/3156982568 >> v2:172.21.15.63:3300/0 conn(0x7fe1580b3690 0x7fe158066080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe14c002f70 tx=0x7fe14c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe156ffd700 1 --2- 172.21.15.63:0/3156982568 >> v2:172.21.15.63:3300/0 conn(0x7fe1580b3690 0x7fe158066080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe14c002f70 tx=0x7fe14c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe156ffd700 1 --2- 172.21.15.63:0/3156982568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1580b3690 0x7fe158066080 secure :-1 s=READY pgs=373 cs=0 l=1 rx=0x7fe14c002f70 tx=0x7fe14c007a80).ready entity=mon.0 client_cookie=3c45813cfd3a53c1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:35.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe156ffd700 1 --2- 172.21.15.63:0/3156982568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1580b3690 0x7fe158066080 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7fe14c002f70 tx=0x7fe14c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe1567fc700 1 -- 172.21.15.63:0/3156982568 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe14c008e80 con 0x7fe1580b3690 2020-05-18T21:27:35.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe156ffd700 1 --2- 172.21.15.63:0/3156982568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1580b3690 0x7fe158066080 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7fe14c002f70 tx=0x7fe14c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe156ffd700 1 --2- 172.21.15.63:0/3156982568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1580b3690 0x7fe158066080 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7fe14c002f70 tx=0x7fe14c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe1567fc700 1 -- 172.21.15.63:0/3156982568 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c0115f0 con 0x7fe1580b3690 2020-05-18T21:27:35.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe1567fc700 1 -- 172.21.15.63:0/3156982568 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe14c0119d0 con 0x7fe1580b3690 2020-05-18T21:27:35.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe15cd79700 1 -- 172.21.15.63:0/3156982568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1580b3690 msgr2=0x7fe158066080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:35.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe15cd79700 1 --2- 172.21.15.63:0/3156982568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1580b3690 0x7fe158066080 secure :-1 s=READY pgs=373 cs=0 l=1 rx=0x7fe14c002f70 tx=0x7fe14c007a80).stop 2020-05-18T21:27:35.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe15cd79700 1 -- 172.21.15.63:0/3156982568 shutdown_connections 2020-05-18T21:27:35.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe15cd79700 1 --2- 172.21.15.63:0/3156982568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1580b3690 0x7fe158066080 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:35.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe15cd79700 1 -- 172.21.15.63:0/3156982568 >> 172.21.15.63:0/3156982568 conn(0x7fe15805a7c0 msgr2=0x7fe15805aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:35.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe15cd79700 1 -- 172.21.15.63:0/3156982568 shutdown_connections 2020-05-18T21:27:35.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.689+0000 7fe15cd79700 1 -- 172.21.15.63:0/3156982568 wait complete. 2020-05-18T21:27:35.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe15cd79700 1 Processor -- start 2020-05-18T21:27:35.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe15cd79700 1 -- start start 2020-05-18T21:27:35.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe15cd79700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe1580b3690 0x7fe15814a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:35.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe15cd79700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15814a8f0 con 0x7fe15813ff20 2020-05-18T21:27:35.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe15cd79700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15814ab90 con 0x7fe15809eba0 2020-05-18T21:27:35.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe15cd79700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe158145b50 con 0x7fe1580b3690 2020-05-18T21:27:35.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe157fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe15813ff20 0x7fe158145ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56444/0 (socket says 172.21.15.63:56444) 2020-05-18T21:27:35.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe157fff700 1 -- 172.21.15.63:0/2509347827 learned_addr learned my addr 172.21.15.63:0/2509347827 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:35.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe156ffd700 1 --2- 172.21.15.63:0/2509347827 >> v2:172.21.15.155:3300/0 conn(0x7fe1580b3690 0x7fe15814a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:35.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe154ff9700 1 -- 172.21.15.63:0/2509347827 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490546798 0 0) 0x7fe15814a8f0 con 0x7fe15813ff20 2020-05-18T21:27:35.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe154ff9700 1 -- 172.21.15.63:0/2509347827 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe138002fe0 con 0x7fe15813ff20 2020-05-18T21:27:35.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe154ff9700 1 -- 172.21.15.63:0/2509347827 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4111747008 0 0) 0x7fe138002fe0 con 0x7fe15813ff20 2020-05-18T21:27:35.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe154ff9700 1 -- 172.21.15.63:0/2509347827 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe15814a8f0 con 0x7fe15813ff20 2020-05-18T21:27:35.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe154ff9700 1 -- 172.21.15.63:0/2509347827 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fe150001d00 con 0x7fe15813ff20 2020-05-18T21:27:35.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe156ffd700 1 -- 172.21.15.63:0/2509347827 >> v1:172.21.15.155:6789/0 conn(0x7fe15809eba0 legacy=0x7fe15813e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:35.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe156ffd700 1 -- 172.21.15.63:0/2509347827 >> v1:172.21.15.63:6789/0 conn(0x7fe15813ff20 legacy=0x7fe158145ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:35.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe156ffd700 1 -- 172.21.15.63:0/2509347827 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15813e970 con 0x7fe1580b3690 2020-05-18T21:27:35.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe156ffd700 1 --2- 172.21.15.63:0/2509347827 >> v2:172.21.15.155:3300/0 conn(0x7fe1580b3690 0x7fe15814a3e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe14c002f70 tx=0x7fe14c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe156ffd700 1 --2- 172.21.15.63:0/2509347827 >> v2:172.21.15.155:3300/0 conn(0x7fe1580b3690 0x7fe15814a3e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe14c002f70 tx=0x7fe14c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.693+0000 7fe156ffd700 1 --2- 172.21.15.63:0/2509347827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1580b3690 0x7fe15814a3e0 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7fe14c002f70 tx=0x7fe14c007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:35.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.697+0000 7fe156ffd700 1 --2- 172.21.15.63:0/2509347827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1580b3690 0x7fe15814a3e0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fe14c002f70 tx=0x7fe14c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.697+0000 7fe156ffd700 1 --2- 172.21.15.63:0/2509347827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1580b3690 0x7fe15814a3e0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fe14c002f70 tx=0x7fe14c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.697+0000 7fe154ff9700 1 -- 172.21.15.63:0/2509347827 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe14c011e80 con 0x7fe1580b3690 2020-05-18T21:27:35.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.697+0000 7fe156ffd700 1 --2- 172.21.15.63:0/2509347827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1580b3690 0x7fe15814a3e0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fe14c002f70 tx=0x7fe14c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.697+0000 7fe154ff9700 1 -- 172.21.15.63:0/2509347827 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c007170 con 0x7fe1580b3690 2020-05-18T21:27:35.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.697+0000 7fe15cd79700 1 -- 172.21.15.63:0/2509347827 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1581422b0 con 0x7fe1580b3690 2020-05-18T21:27:35.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.697+0000 7fe154ff9700 1 -- 172.21.15.63:0/2509347827 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe14c0074d0 con 0x7fe1580b3690 2020-05-18T21:27:35.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.697+0000 7fe15cd79700 1 -- 172.21.15.63:0/2509347827 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe158142700 con 0x7fe1580b3690 2020-05-18T21:27:35.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.697+0000 7fe156ffd700 1 --2- 172.21.15.63:0/2509347827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1580b3690 0x7fe15814a3e0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fe14c002f70 tx=0x7fe14c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.697+0000 7fe15cd79700 1 -- 172.21.15.63:0/2509347827 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1580569e0 con 0x7fe1580b3690 2020-05-18T21:27:35.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.701+0000 7fe154ff9700 1 -- 172.21.15.63:0/2509347827 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe14c005700 con 0x7fe1580b3690 2020-05-18T21:27:35.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.701+0000 7fe156ffd700 1 --2- 172.21.15.63:0/2509347827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1580b3690 0x7fe15814a3e0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fe14c002f70 tx=0x7fe14c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.701+0000 7fe154ff9700 1 --2- 172.21.15.63:0/2509347827 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe13804ffc0 0x7fe138052480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:35.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.701+0000 7fe154ff9700 1 -- 172.21.15.63:0/2509347827 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe14c064090 con 0x7fe1580b3690 2020-05-18T21:27:35.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.701+0000 7fe1577fe700 1 --2- 172.21.15.63:0/2509347827 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe13804ffc0 0x7fe138052480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:35.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.701+0000 7fe1577fe700 1 --2- 172.21.15.63:0/2509347827 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe13804ffc0 0x7fe138052480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe1580653f0 tx=0x7fe1480014b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.701+0000 7fe1577fe700 1 --2- 172.21.15.63:0/2509347827 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe13804ffc0 0x7fe138052480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe1580653f0 tx=0x7fe1480014b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.701+0000 7fe1577fe700 1 --2- 172.21.15.63:0/2509347827 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe13804ffc0 0x7fe138052480 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7fe1580653f0 tx=0x7fe1480014b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:35.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.709+0000 7fe156ffd700 1 --2- 172.21.15.63:0/2509347827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1580b3690 0x7fe15814a3e0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fe14c002f70 tx=0x7fe14c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.709+0000 7fe154ff9700 1 -- 172.21.15.63:0/2509347827 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe14c03e540 con 0x7fe1580b3690 2020-05-18T21:27:35.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.825+0000 7fe15cd79700 1 -- 172.21.15.63:0/2509347827 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe15805b7d0 con 0x7fe1580b3690 2020-05-18T21:27:35.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.825+0000 7fe156ffd700 1 --2- 172.21.15.63:0/2509347827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1580b3690 0x7fe15814a3e0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fe14c002f70 tx=0x7fe14c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.825+0000 7fe154ff9700 1 -- 172.21.15.63:0/2509347827 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v33) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe14c041b60 con 0x7fe1580b3690 2020-05-18T21:27:35.834 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:27:35.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.829+0000 7fe15cd79700 1 -- 172.21.15.63:0/2509347827 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe13804ffc0 msgr2=0x7fe138052480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:35.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.829+0000 7fe15cd79700 1 --2- 172.21.15.63:0/2509347827 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe13804ffc0 0x7fe138052480 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7fe1580653f0 tx=0x7fe1480014b0).stop 2020-05-18T21:27:35.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.829+0000 7fe15cd79700 1 -- 172.21.15.63:0/2509347827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1580b3690 msgr2=0x7fe15814a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:35.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.829+0000 7fe15cd79700 1 --2- 172.21.15.63:0/2509347827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1580b3690 0x7fe15814a3e0 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7fe14c002f70 tx=0x7fe14c007a80).stop 2020-05-18T21:27:35.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.829+0000 7fe15cd79700 1 -- 172.21.15.63:0/2509347827 shutdown_connections 2020-05-18T21:27:35.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.829+0000 7fe15cd79700 1 --2- 172.21.15.63:0/2509347827 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe13804ffc0 0x7fe138052480 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:35.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.829+0000 7fe15cd79700 1 --2- 172.21.15.63:0/2509347827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1580b3690 0x7fe15814a3e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:35.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.829+0000 7fe15cd79700 1 -- 172.21.15.63:0/2509347827 >> 172.21.15.63:0/2509347827 conn(0x7fe15805a7c0 msgr2=0x7fe1580b9440 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:35.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.829+0000 7fe15cd79700 1 -- 172.21.15.63:0/2509347827 shutdown_connections 2020-05-18T21:27:35.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.829+0000 7fe15cd79700 1 -- 172.21.15.63:0/2509347827 wait complete. 2020-05-18T21:27:35.846 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:27:35.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15fac0b700 1 Processor -- start 2020-05-18T21:27:35.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15fac0b700 1 -- start start 2020-05-18T21:27:35.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15fac0b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b8630 0x7f15f40b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:35.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15fac0b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f15f40b42b0 0x7f15f40b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:35.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15fac0b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f40b4ba0 con 0x7f15f40b9500 2020-05-18T21:27:35.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15fac0b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f4060890 con 0x7f15f40b42b0 2020-05-18T21:27:35.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15fac0b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f4060b30 con 0x7f15f40b8630 2020-05-18T21:27:35.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15f89a7700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f15f40b9500 0x7f15f4061270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56448/0 (socket says 172.21.15.63:56448) 2020-05-18T21:27:35.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15f89a7700 1 -- 172.21.15.63:0/701964637 learned_addr learned my addr 172.21.15.63:0/701964637 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:35.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15f91a8700 1 --2- 172.21.15.63:0/701964637 >> v2:172.21.15.63:3300/0 conn(0x7f15f40b42b0 0x7f15f40b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:35.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15f3fff700 1 --2- 172.21.15.63:0/701964637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b8630 0x7f15f40b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:35.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15f37fe700 1 -- 172.21.15.63:0/701964637 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27734120 0 0) 0x7f15f40b4ba0 con 0x7f15f40b9500 2020-05-18T21:27:35.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15f37fe700 1 -- 172.21.15.63:0/701964637 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15d4003270 con 0x7f15f40b9500 2020-05-18T21:27:35.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15f37fe700 1 -- 172.21.15.63:0/701964637 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2796043834 0 0) 0x7f15d4003270 con 0x7f15f40b9500 2020-05-18T21:27:35.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15f91a8700 1 -- 172.21.15.63:0/701964637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b8630 msgr2=0x7f15f40b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:35.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15f91a8700 1 --2- 172.21.15.63:0/701964637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b8630 0x7f15f40b6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:35.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15f91a8700 1 -- 172.21.15.63:0/701964637 >> v1:172.21.15.63:6789/0 conn(0x7f15f40b9500 legacy=0x7f15f4061270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:35.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15f91a8700 1 -- 172.21.15.63:0/701964637 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f4060dd0 con 0x7f15f40b42b0 2020-05-18T21:27:35.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15f91a8700 1 --2- 172.21.15.63:0/701964637 >> v2:172.21.15.63:3300/0 conn(0x7f15f40b42b0 0x7f15f40b4740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f15e40018b0 tx=0x7f15ec008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15f91a8700 1 --2- 172.21.15.63:0/701964637 >> v2:172.21.15.63:3300/0 conn(0x7f15f40b42b0 0x7f15f40b4740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f15e40018b0 tx=0x7f15ec008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.953+0000 7f15f91a8700 1 --2- 172.21.15.63:0/701964637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15f40b42b0 0x7f15f40b4740 secure :-1 s=READY pgs=376 cs=0 l=1 rx=0x7f15e40018b0 tx=0x7f15ec008ca0).ready entity=mon.0 client_cookie=8acb3e5d9fac3970 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:35.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.957+0000 7f15f91a8700 1 --2- 172.21.15.63:0/701964637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15f40b42b0 0x7f15f40b4740 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f15e40018b0 tx=0x7f15ec008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.957+0000 7f15f37fe700 1 -- 172.21.15.63:0/701964637 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15e4001710 con 0x7f15f40b42b0 2020-05-18T21:27:35.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.957+0000 7f15f91a8700 1 --2- 172.21.15.63:0/701964637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15f40b42b0 0x7f15f40b4740 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f15e40018b0 tx=0x7f15ec008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.957+0000 7f15f37fe700 1 -- 172.21.15.63:0/701964637 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec011ac0 con 0x7f15f40b42b0 2020-05-18T21:27:35.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.957+0000 7f15f91a8700 1 --2- 172.21.15.63:0/701964637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15f40b42b0 0x7f15f40b4740 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f15e40018b0 tx=0x7f15ec008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.957+0000 7f15fac0b700 1 -- 172.21.15.63:0/701964637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15f40b42b0 msgr2=0x7f15f40b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:35.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.957+0000 7f15f37fe700 1 -- 172.21.15.63:0/701964637 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15ec011e60 con 0x7f15f40b42b0 2020-05-18T21:27:35.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.957+0000 7f15fac0b700 1 --2- 172.21.15.63:0/701964637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15f40b42b0 0x7f15f40b4740 secure :-1 s=READY pgs=376 cs=0 l=1 rx=0x7f15e40018b0 tx=0x7f15ec008ca0).stop 2020-05-18T21:27:35.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.957+0000 7f15fac0b700 1 -- 172.21.15.63:0/701964637 shutdown_connections 2020-05-18T21:27:35.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.957+0000 7f15fac0b700 1 --2- 172.21.15.63:0/701964637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15f40b42b0 0x7f15f40b4740 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:35.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.957+0000 7f15fac0b700 1 --2- 172.21.15.63:0/701964637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b8630 0x7f15f40b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:35.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.957+0000 7f15fac0b700 1 -- 172.21.15.63:0/701964637 >> 172.21.15.63:0/701964637 conn(0x7f15f4069b70 msgr2=0x7f15f4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:35.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.957+0000 7f15fac0b700 1 -- 172.21.15.63:0/701964637 shutdown_connections 2020-05-18T21:27:35.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.957+0000 7f15fac0b700 1 -- 172.21.15.63:0/701964637 wait complete. 2020-05-18T21:27:35.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.957+0000 7f15fac0b700 1 Processor -- start 2020-05-18T21:27:35.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.957+0000 7f15fac0b700 1 -- start start 2020-05-18T21:27:35.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15fac0b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b42b0 0x7f15f4157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:35.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15fac0b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f15f40b9500 0x7f15f412f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:35.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15fac0b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f412eee0 con 0x7f15f40b8630 2020-05-18T21:27:35.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15fac0b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f4153210 con 0x7f15f40b9500 2020-05-18T21:27:35.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15fac0b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f4153480 con 0x7f15f40b42b0 2020-05-18T21:27:35.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15f3fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f15f40b8630 0x7f15f4153bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56456/0 (socket says 172.21.15.63:56456) 2020-05-18T21:27:35.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15f3fff700 1 -- 172.21.15.63:0/2526026199 learned_addr learned my addr 172.21.15.63:0/2526026199 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:35.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15f89a7700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b42b0 0x7f15f4157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:35.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15f91a8700 1 --2- 172.21.15.63:0/2526026199 >> v2:172.21.15.155:3300/0 conn(0x7f15f40b9500 0x7f15f412f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:35.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15f1ffb700 1 -- 172.21.15.63:0/2526026199 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516813110 0 0) 0x7f15f412eee0 con 0x7f15f40b8630 2020-05-18T21:27:35.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15f1ffb700 1 -- 172.21.15.63:0/2526026199 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15d8002fe0 con 0x7f15f40b8630 2020-05-18T21:27:35.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15f89a7700 1 -- 172.21.15.63:0/2526026199 >> v2:172.21.15.155:3300/0 conn(0x7f15f40b9500 msgr2=0x7f15f412f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:35.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15f89a7700 1 --2- 172.21.15.63:0/2526026199 >> v2:172.21.15.155:3300/0 conn(0x7f15f40b9500 0x7f15f412f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:35.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15f89a7700 1 -- 172.21.15.63:0/2526026199 >> v1:172.21.15.63:6789/0 conn(0x7f15f40b8630 legacy=0x7f15f4153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:35.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15f89a7700 1 -- 172.21.15.63:0/2526026199 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f4153720 con 0x7f15f40b42b0 2020-05-18T21:27:35.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15f89a7700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b42b0 0x7f15f4157230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f15e4001970 tx=0x7f15e4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15f89a7700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b42b0 0x7f15f4157230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f15e4001970 tx=0x7f15e4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15f89a7700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b42b0 0x7f15f4157230 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f15e4001970 tx=0x7f15e4010c30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:35.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15f89a7700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b42b0 0x7f15f4157230 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f15e4001970 tx=0x7f15e4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15f1ffb700 1 -- 172.21.15.63:0/2526026199 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15e400c960 con 0x7f15f40b42b0 2020-05-18T21:27:35.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15f89a7700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b42b0 0x7f15f4157230 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f15e4001970 tx=0x7f15e4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15f89a7700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b42b0 0x7f15f4157230 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f15e4001970 tx=0x7f15e4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15f1ffb700 1 -- 172.21.15.63:0/2526026199 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e400cac0 con 0x7f15f40b42b0 2020-05-18T21:27:35.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15fac0b700 1 -- 172.21.15.63:0/2526026199 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f40b4a20 con 0x7f15f40b42b0 2020-05-18T21:27:35.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15f1ffb700 1 -- 172.21.15.63:0/2526026199 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15e400cea0 con 0x7f15f40b42b0 2020-05-18T21:27:35.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.961+0000 7f15fac0b700 1 -- 172.21.15.63:0/2526026199 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f412cfc0 con 0x7f15f40b42b0 2020-05-18T21:27:35.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.965+0000 7f15f89a7700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b42b0 0x7f15f4157230 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f15e4001970 tx=0x7f15e4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.965+0000 7f15f89a7700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b42b0 0x7f15f4157230 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f15e4001970 tx=0x7f15e4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.965+0000 7f15fac0b700 1 -- 172.21.15.63:0/2526026199 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f41576f0 con 0x7f15f40b42b0 2020-05-18T21:27:35.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.965+0000 7f15f1ffb700 1 -- 172.21.15.63:0/2526026199 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f15e4004530 con 0x7f15f40b42b0 2020-05-18T21:27:35.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.965+0000 7f15f1ffb700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f15d804fd90 0x7f15d8052250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:35.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.965+0000 7f15f1ffb700 1 -- 172.21.15.63:0/2526026199 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f15e4063b50 con 0x7f15f40b42b0 2020-05-18T21:27:35.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.965+0000 7f15f3fff700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f15d804fd90 0x7f15d8052250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:35.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.965+0000 7f15f3fff700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f15d804fd90 0x7f15d8052250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f15dc002f70 tx=0x7f15dc0098f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.965+0000 7f15f3fff700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f15d804fd90 0x7f15d8052250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f15dc002f70 tx=0x7f15dc0098f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.965+0000 7f15f3fff700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f15d804fd90 0x7f15d8052250 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f15dc002f70 tx=0x7f15dc0098f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:35.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.973+0000 7f15f89a7700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b42b0 0x7f15f4157230 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f15e4001970 tx=0x7f15e4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:35.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:35.973+0000 7f15f1ffb700 1 -- 172.21.15.63:0/2526026199 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f15f41576f0 con 0x7f15f40b42b0 2020-05-18T21:27:36.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.093+0000 7f15fac0b700 1 -- 172.21.15.63:0/2526026199 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f15f4153920 con 0x7f15f40b42b0 2020-05-18T21:27:36.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.093+0000 7f15f89a7700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b42b0 0x7f15f4157230 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f15e4001970 tx=0x7f15e4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.093+0000 7f15f1ffb700 1 -- 172.21.15.63:0/2526026199 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v33) v1 ==== 92+0+10 (secure 0 0 0) 0x7f15f4153920 con 0x7f15f40b42b0 2020-05-18T21:27:36.102 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.097+0000 7f15fac0b700 1 -- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f15d804fd90 msgr2=0x7f15d8052250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.097+0000 7f15fac0b700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f15d804fd90 0x7f15d8052250 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f15dc002f70 tx=0x7f15dc0098f0).stop 2020-05-18T21:27:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.097+0000 7f15fac0b700 1 -- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b42b0 msgr2=0x7f15f4157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.097+0000 7f15fac0b700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b42b0 0x7f15f4157230 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f15e4001970 tx=0x7f15e4010c30).stop 2020-05-18T21:27:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.097+0000 7f15fac0b700 1 -- 172.21.15.63:0/2526026199 shutdown_connections 2020-05-18T21:27:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.097+0000 7f15fac0b700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f15d804fd90 0x7f15d8052250 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.097+0000 7f15fac0b700 1 --2- 172.21.15.63:0/2526026199 >> v2:172.21.15.155:3300/0 conn(0x7f15f40b9500 0x7f15f412f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:36.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.097+0000 7f15fac0b700 1 --2- 172.21.15.63:0/2526026199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40b42b0 0x7f15f4157230 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:36.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.097+0000 7f15fac0b700 1 -- 172.21.15.63:0/2526026199 >> 172.21.15.63:0/2526026199 conn(0x7f15f4069b70 msgr2=0x7f15f40bb560 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:36.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.097+0000 7f15fac0b700 1 -- 172.21.15.63:0/2526026199 shutdown_connections 2020-05-18T21:27:36.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.097+0000 7f15fac0b700 1 -- 172.21.15.63:0/2526026199 wait complete. 2020-05-18T21:27:36.114 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:27:36.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f365cb40700 1 Processor -- start 2020-05-18T21:27:36.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f365cb40700 1 -- start start 2020-05-18T21:27:36.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f365cb40700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f36580bc8d0 0x7f3658060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:36.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f365cb40700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3658143630 0x7f365812e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:36.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f365cb40700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3658146420 con 0x7f3658145e30 2020-05-18T21:27:36.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f365cb40700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3658146e00 con 0x7f36580bc8d0 2020-05-18T21:27:36.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f365cb40700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36581466c0 con 0x7f3658143630 2020-05-18T21:27:36.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f364effd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3658145e30 0x7f3658142f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56462/0 (socket says 172.21.15.63:56462) 2020-05-18T21:27:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f36577fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f36580bc8d0 0x7f3658060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f364effd700 1 -- 172.21.15.63:0/746038467 learned_addr learned my addr 172.21.15.63:0/746038467 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f3657fff700 1 --2- 172.21.15.63:0/746038467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3658143630 0x7f365812e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:36.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f36577fe700 1 -- 172.21.15.63:0/746038467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3658143630 msgr2=0x7f365812e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:36.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f36577fe700 1 --2- 172.21.15.63:0/746038467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3658143630 0x7f365812e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:36.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f36577fe700 1 -- 172.21.15.63:0/746038467 >> v1:172.21.15.63:6789/0 conn(0x7f3658145e30 legacy=0x7f3658142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f3656ffd700 1 -- 172.21.15.63:0/746038467 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230046533 0 0) 0x7f3658146420 con 0x7f3658145e30 2020-05-18T21:27:36.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f36577fe700 1 -- 172.21.15.63:0/746038467 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3658146960 con 0x7f36580bc8d0 2020-05-18T21:27:36.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f3657fff700 1 --2- 172.21.15.63:0/746038467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3658143630 0x7f365812e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:27:36.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f36577fe700 1 --2- 172.21.15.63:0/746038467 >> v2:172.21.15.63:3300/0 conn(0x7f36580bc8d0 0x7f3658060b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3648002f70 tx=0x7f3648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f36577fe700 1 --2- 172.21.15.63:0/746038467 >> v2:172.21.15.63:3300/0 conn(0x7f36580bc8d0 0x7f3658060b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3648002f70 tx=0x7f3648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f36577fe700 1 --2- 172.21.15.63:0/746038467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36580bc8d0 0x7f3658060b00 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7f3648002f70 tx=0x7f3648007a80).ready entity=mon.0 client_cookie=a33d48b70bef5e88 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:36.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f36577fe700 1 --2- 172.21.15.63:0/746038467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36580bc8d0 0x7f3658060b00 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f3648002f70 tx=0x7f3648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f3656ffd700 1 -- 172.21.15.63:0/746038467 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3648008e80 con 0x7f36580bc8d0 2020-05-18T21:27:36.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f36577fe700 1 --2- 172.21.15.63:0/746038467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36580bc8d0 0x7f3658060b00 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f3648002f70 tx=0x7f3648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f3656ffd700 1 -- 172.21.15.63:0/746038467 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36480116a0 con 0x7f36580bc8d0 2020-05-18T21:27:36.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f36577fe700 1 --2- 172.21.15.63:0/746038467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36580bc8d0 0x7f3658060b00 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f3648002f70 tx=0x7f3648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f3656ffd700 1 -- 172.21.15.63:0/746038467 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3648011a80 con 0x7f36580bc8d0 2020-05-18T21:27:36.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f365cb40700 1 -- 172.21.15.63:0/746038467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36580bc8d0 msgr2=0x7f3658060b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.237+0000 7f365cb40700 1 --2- 172.21.15.63:0/746038467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36580bc8d0 0x7f3658060b00 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7f3648002f70 tx=0x7f3648007a80).stop 2020-05-18T21:27:36.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f365cb40700 1 -- 172.21.15.63:0/746038467 shutdown_connections 2020-05-18T21:27:36.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f365cb40700 1 --2- 172.21.15.63:0/746038467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3658143630 0x7f365812e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:36.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f365cb40700 1 --2- 172.21.15.63:0/746038467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36580bc8d0 0x7f3658060b00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:36.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f365cb40700 1 -- 172.21.15.63:0/746038467 >> 172.21.15.63:0/746038467 conn(0x7f365805f3b0 msgr2=0x7f365805f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:36.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f365cb40700 1 -- 172.21.15.63:0/746038467 shutdown_connections 2020-05-18T21:27:36.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f365cb40700 1 -- 172.21.15.63:0/746038467 wait complete. 2020-05-18T21:27:36.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f365cb40700 1 Processor -- start 2020-05-18T21:27:36.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f365cb40700 1 -- start start 2020-05-18T21:27:36.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f365cb40700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f36580bc8d0 0x7f36580b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:36.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f365cb40700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3658157640 con 0x7f3658145e30 2020-05-18T21:27:36.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f365cb40700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36581586a0 con 0x7f3658143630 2020-05-18T21:27:36.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f365cb40700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3658157890 con 0x7f36580bc8d0 2020-05-18T21:27:36.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f3657fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3658145e30 0x7f3658144c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56472/0 (socket says 172.21.15.63:56472) 2020-05-18T21:27:36.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f36577fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f36580bc8d0 0x7f36580b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:36.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f3657fff700 1 -- 172.21.15.63:0/4016216078 learned_addr learned my addr 172.21.15.63:0/4016216078 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:36.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f36577fe700 1 -- 172.21.15.63:0/4016216078 >> v1:172.21.15.155:6789/0 conn(0x7f3658143630 legacy=0x7f3658157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f36557fa700 1 -- 172.21.15.63:0/4016216078 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266310531 0 0) 0x7f3658157640 con 0x7f3658145e30 2020-05-18T21:27:36.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f36577fe700 1 -- 172.21.15.63:0/4016216078 >> v1:172.21.15.63:6789/0 conn(0x7f3658145e30 legacy=0x7f3658144c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f36577fe700 1 -- 172.21.15.63:0/4016216078 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36580b60e0 con 0x7f36580bc8d0 2020-05-18T21:27:36.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f36577fe700 1 --2- 172.21.15.63:0/4016216078 >> v2:172.21.15.63:3300/0 conn(0x7f36580bc8d0 0x7f36580b5b30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f36581424b0 tx=0x7f3648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f36577fe700 1 --2- 172.21.15.63:0/4016216078 >> v2:172.21.15.63:3300/0 conn(0x7f36580bc8d0 0x7f36580b5b30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f36581424b0 tx=0x7f3648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.241+0000 7f36577fe700 1 --2- 172.21.15.63:0/4016216078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36580bc8d0 0x7f36580b5b30 secure :-1 s=READY pgs=381 cs=0 l=1 rx=0x7f36581424b0 tx=0x7f3648007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:36.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.245+0000 7f36577fe700 1 --2- 172.21.15.63:0/4016216078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36580bc8d0 0x7f36580b5b30 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7f36581424b0 tx=0x7f3648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.245+0000 7f36557fa700 1 -- 172.21.15.63:0/4016216078 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3648007360 con 0x7f36580bc8d0 2020-05-18T21:27:36.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.245+0000 7f36577fe700 1 --2- 172.21.15.63:0/4016216078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36580bc8d0 0x7f36580b5b30 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7f36581424b0 tx=0x7f3648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.245+0000 7f36557fa700 1 -- 172.21.15.63:0/4016216078 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36480074c0 con 0x7f36580bc8d0 2020-05-18T21:27:36.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.245+0000 7f36577fe700 1 --2- 172.21.15.63:0/4016216078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36580bc8d0 0x7f36580b5b30 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7f36581424b0 tx=0x7f3648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.245+0000 7f36557fa700 1 -- 172.21.15.63:0/4016216078 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3648007630 con 0x7f36580bc8d0 2020-05-18T21:27:36.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.245+0000 7f365cb40700 1 -- 172.21.15.63:0/4016216078 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3658157af0 con 0x7f36580bc8d0 2020-05-18T21:27:36.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.245+0000 7f365cb40700 1 -- 172.21.15.63:0/4016216078 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3658065de0 con 0x7f36580bc8d0 2020-05-18T21:27:36.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.245+0000 7f36577fe700 1 --2- 172.21.15.63:0/4016216078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36580bc8d0 0x7f36580b5b30 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7f36581424b0 tx=0x7f3648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.245+0000 7f365cb40700 1 -- 172.21.15.63:0/4016216078 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36580569e0 con 0x7f36580bc8d0 2020-05-18T21:27:36.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.245+0000 7f36557fa700 1 -- 172.21.15.63:0/4016216078 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f36480058f0 con 0x7f36580bc8d0 2020-05-18T21:27:36.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.245+0000 7f36577fe700 1 --2- 172.21.15.63:0/4016216078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36580bc8d0 0x7f36580b5b30 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7f36581424b0 tx=0x7f3648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.245+0000 7f36557fa700 1 --2- 172.21.15.63:0/4016216078 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f363c04f990 0x7f363c051e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:36.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.245+0000 7f36557fa700 1 -- 172.21.15.63:0/4016216078 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3648064380 con 0x7f36580bc8d0 2020-05-18T21:27:36.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.245+0000 7f364effd700 1 --2- 172.21.15.63:0/4016216078 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f363c04f990 0x7f363c051e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:36.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.245+0000 7f364effd700 1 --2- 172.21.15.63:0/4016216078 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f363c04f990 0x7f363c051e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3640000bc0 tx=0x7f3658061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.245+0000 7f364effd700 1 --2- 172.21.15.63:0/4016216078 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f363c04f990 0x7f363c051e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3640000bc0 tx=0x7f3658061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.245+0000 7f364effd700 1 --2- 172.21.15.63:0/4016216078 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f363c04f990 0x7f363c051e50 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f3640000bc0 tx=0x7f3658061d60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:36.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.253+0000 7f36577fe700 1 --2- 172.21.15.63:0/4016216078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36580bc8d0 0x7f36580b5b30 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7f36581424b0 tx=0x7f3648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.253+0000 7f36557fa700 1 -- 172.21.15.63:0/4016216078 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f364803e830 con 0x7f36580bc8d0 2020-05-18T21:27:36.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.365+0000 7f365cb40700 1 -- 172.21.15.63:0/4016216078 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f36580008d0 con 0x7f36580bc8d0 2020-05-18T21:27:36.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.369+0000 7f36577fe700 1 --2- 172.21.15.63:0/4016216078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36580bc8d0 0x7f36580b5b30 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7f36581424b0 tx=0x7f3648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.369+0000 7f36557fa700 1 -- 172.21.15.63:0/4016216078 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3648041e50 con 0x7f36580bc8d0 2020-05-18T21:27:36.375 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:36.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.369+0000 7f365cb40700 1 -- 172.21.15.63:0/4016216078 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f363c04f990 msgr2=0x7f363c051e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.369+0000 7f365cb40700 1 --2- 172.21.15.63:0/4016216078 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f363c04f990 0x7f363c051e50 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f3640000bc0 tx=0x7f3658061d60).stop 2020-05-18T21:27:36.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.369+0000 7f365cb40700 1 -- 172.21.15.63:0/4016216078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36580bc8d0 msgr2=0x7f36580b5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.369+0000 7f365cb40700 1 --2- 172.21.15.63:0/4016216078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36580bc8d0 0x7f36580b5b30 secure :-1 s=READY pgs=381 cs=0 l=1 rx=0x7f36581424b0 tx=0x7f3648007a80).stop 2020-05-18T21:27:36.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.369+0000 7f365cb40700 1 -- 172.21.15.63:0/4016216078 shutdown_connections 2020-05-18T21:27:36.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.369+0000 7f365cb40700 1 --2- 172.21.15.63:0/4016216078 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f363c04f990 0x7f363c051e50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:36.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.369+0000 7f365cb40700 1 --2- 172.21.15.63:0/4016216078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36580bc8d0 0x7f36580b5b30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:36.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.369+0000 7f365cb40700 1 -- 172.21.15.63:0/4016216078 >> 172.21.15.63:0/4016216078 conn(0x7f365805f3b0 msgr2=0x7f36580bbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:36.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.369+0000 7f365cb40700 1 -- 172.21.15.63:0/4016216078 shutdown_connections 2020-05-18T21:27:36.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.369+0000 7f365cb40700 1 -- 172.21.15.63:0/4016216078 wait complete. 2020-05-18T21:27:36.388 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:27:36.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.497+0000 7fd894394700 1 Processor -- start 2020-05-18T21:27:36.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.497+0000 7fd894394700 1 -- start start 2020-05-18T21:27:36.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.497+0000 7fd894394700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd88c0b9500 0x7fd88c0b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:36.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.497+0000 7fd894394700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd88c0b6d90 0x7fd88c061270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:36.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.497+0000 7fd894394700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd88c060660 con 0x7fd88c0616d0 2020-05-18T21:27:36.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.497+0000 7fd894394700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88c0b7ec0 con 0x7fd88c0b6d90 2020-05-18T21:27:36.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.497+0000 7fd894394700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c060890 con 0x7fd88c0b9500 2020-05-18T21:27:36.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd89192f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd88c0b6d90 0x7fd88c061270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:36.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd89192f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd88c0b6d90 0x7fd88c061270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54288/0 (socket says 172.21.15.63:54288) 2020-05-18T21:27:36.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd89192f700 1 -- 172.21.15.63:0/1539110256 learned_addr learned my addr 172.21.15.63:0/1539110256 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:36.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd892130700 1 --2- 172.21.15.63:0/1539110256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd88c0b9500 0x7fd88c0b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:36.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd89192f700 1 -- 172.21.15.63:0/1539110256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd88c0b9500 msgr2=0x7fd88c0b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:36.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd89192f700 1 --2- 172.21.15.63:0/1539110256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd88c0b9500 0x7fd88c0b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:36.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd89192f700 1 -- 172.21.15.63:0/1539110256 >> v1:172.21.15.63:6789/0 conn(0x7fd88c0616d0 legacy=0x7fd88c0b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd89192f700 1 -- 172.21.15.63:0/1539110256 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c060b30 con 0x7fd88c0b6d90 2020-05-18T21:27:36.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd89192f700 1 --2- 172.21.15.63:0/1539110256 >> v2:172.21.15.63:3300/0 conn(0x7fd88c0b6d90 0x7fd88c061270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd88c06ab40 tx=0x7fd888008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd89192f700 1 --2- 172.21.15.63:0/1539110256 >> v2:172.21.15.63:3300/0 conn(0x7fd88c0b6d90 0x7fd88c061270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd88c06ab40 tx=0x7fd888008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd89192f700 1 --2- 172.21.15.63:0/1539110256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88c0b6d90 0x7fd88c061270 secure :-1 s=READY pgs=383 cs=0 l=1 rx=0x7fd88c06ab40 tx=0x7fd888008920).ready entity=mon.0 client_cookie=483b651fc5ebaa4b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:36.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd89192f700 1 --2- 172.21.15.63:0/1539110256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88c0b6d90 0x7fd88c061270 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7fd88c06ab40 tx=0x7fd888008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd89112e700 1 -- 172.21.15.63:0/1539110256 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8880115b0 con 0x7fd88c0b6d90 2020-05-18T21:27:36.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd89192f700 1 --2- 172.21.15.63:0/1539110256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88c0b6d90 0x7fd88c061270 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7fd88c06ab40 tx=0x7fd888008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd89192f700 1 --2- 172.21.15.63:0/1539110256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88c0b6d90 0x7fd88c061270 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7fd88c06ab40 tx=0x7fd888008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd89112e700 1 -- 172.21.15.63:0/1539110256 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd888011710 con 0x7fd88c0b6d90 2020-05-18T21:27:36.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd89112e700 1 -- 172.21.15.63:0/1539110256 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd888011ab0 con 0x7fd88c0b6d90 2020-05-18T21:27:36.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd894394700 1 -- 172.21.15.63:0/1539110256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88c0b6d90 msgr2=0x7fd88c061270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd894394700 1 --2- 172.21.15.63:0/1539110256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88c0b6d90 0x7fd88c061270 secure :-1 s=READY pgs=383 cs=0 l=1 rx=0x7fd88c06ab40 tx=0x7fd888008920).stop 2020-05-18T21:27:36.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd894394700 1 -- 172.21.15.63:0/1539110256 shutdown_connections 2020-05-18T21:27:36.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd894394700 1 --2- 172.21.15.63:0/1539110256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88c0b6d90 0x7fd88c061270 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:36.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd894394700 1 --2- 172.21.15.63:0/1539110256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd88c0b9500 0x7fd88c0b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:36.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd894394700 1 -- 172.21.15.63:0/1539110256 >> 172.21.15.63:0/1539110256 conn(0x7fd88c069b70 msgr2=0x7fd88c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:36.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd894394700 1 -- 172.21.15.63:0/1539110256 shutdown_connections 2020-05-18T21:27:36.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd894394700 1 -- 172.21.15.63:0/1539110256 wait complete. 2020-05-18T21:27:36.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd894394700 1 Processor -- start 2020-05-18T21:27:36.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.501+0000 7fd894394700 1 -- start start 2020-05-18T21:27:36.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd894394700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd88c0616d0 0x7fd88c0b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:36.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd894394700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd88c0b9500 0x7fd88c12f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:36.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd894394700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd88c0b2860 con 0x7fd88c0b6d90 2020-05-18T21:27:36.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd894394700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88c0b33c0 con 0x7fd88c0616d0 2020-05-18T21:27:36.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd894394700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88c12fb80 con 0x7fd88c0b9500 2020-05-18T21:27:36.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd892130700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd88c0616d0 0x7fd88c0b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:36.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd892130700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd88c0616d0 0x7fd88c0b2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54294/0 (socket says 172.21.15.63:54294) 2020-05-18T21:27:36.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd892130700 1 -- 172.21.15.63:0/3413044773 learned_addr learned my addr 172.21.15.63:0/3413044773 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:36.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd892931700 1 --2- 172.21.15.63:0/3413044773 >> v2:172.21.15.155:3300/0 conn(0x7fd88c0b9500 0x7fd88c12f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:36.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd892130700 1 -- 172.21.15.63:0/3413044773 >> v2:172.21.15.155:3300/0 conn(0x7fd88c0b9500 msgr2=0x7fd88c12f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd892130700 1 --2- 172.21.15.63:0/3413044773 >> v2:172.21.15.155:3300/0 conn(0x7fd88c0b9500 0x7fd88c12f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:36.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd892130700 1 -- 172.21.15.63:0/3413044773 >> v1:172.21.15.155:6789/0 conn(0x7fd88c0b6d90 legacy=0x7fd88c156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd892130700 1 -- 172.21.15.63:0/3413044773 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c0b2ac0 con 0x7fd88c0616d0 2020-05-18T21:27:36.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd892130700 1 --2- 172.21.15.63:0/3413044773 >> v2:172.21.15.63:3300/0 conn(0x7fd88c0616d0 0x7fd88c0b2f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd87c0030b0 tx=0x7fd87c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd892130700 1 --2- 172.21.15.63:0/3413044773 >> v2:172.21.15.63:3300/0 conn(0x7fd88c0616d0 0x7fd88c0b2f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd87c0030b0 tx=0x7fd87c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd892130700 1 --2- 172.21.15.63:0/3413044773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88c0616d0 0x7fd88c0b2f60 secure :-1 s=READY pgs=384 cs=0 l=1 rx=0x7fd87c0030b0 tx=0x7fd87c010cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:36.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd892130700 1 --2- 172.21.15.63:0/3413044773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88c0616d0 0x7fd88c0b2f60 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7fd87c0030b0 tx=0x7fd87c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd87b7fe700 1 -- 172.21.15.63:0/3413044773 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd87c007180 con 0x7fd88c0616d0 2020-05-18T21:27:36.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd892130700 1 --2- 172.21.15.63:0/3413044773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88c0616d0 0x7fd88c0b2f60 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7fd87c0030b0 tx=0x7fd87c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd892130700 1 --2- 172.21.15.63:0/3413044773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88c0616d0 0x7fd88c0b2f60 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7fd87c0030b0 tx=0x7fd87c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd87b7fe700 1 -- 172.21.15.63:0/3413044773 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c0072e0 con 0x7fd88c0616d0 2020-05-18T21:27:36.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd894394700 1 -- 172.21.15.63:0/3413044773 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88c12f8d0 con 0x7fd88c0616d0 2020-05-18T21:27:36.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd87b7fe700 1 -- 172.21.15.63:0/3413044773 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd87c012330 con 0x7fd88c0616d0 2020-05-18T21:27:36.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd894394700 1 -- 172.21.15.63:0/3413044773 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88c1573b0 con 0x7fd88c0616d0 2020-05-18T21:27:36.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd894394700 1 -- 172.21.15.63:0/3413044773 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd88c0b2cc0 con 0x7fd88c0616d0 2020-05-18T21:27:36.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.505+0000 7fd892130700 1 --2- 172.21.15.63:0/3413044773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88c0616d0 0x7fd88c0b2f60 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7fd87c0030b0 tx=0x7fd87c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.509+0000 7fd87b7fe700 1 -- 172.21.15.63:0/3413044773 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd87c0125b0 con 0x7fd88c0616d0 2020-05-18T21:27:36.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.509+0000 7fd892130700 1 --2- 172.21.15.63:0/3413044773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88c0616d0 0x7fd88c0b2f60 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7fd87c0030b0 tx=0x7fd87c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.509+0000 7fd87b7fe700 1 --2- 172.21.15.63:0/3413044773 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd86c04fa50 0x7fd86c051f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:36.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.509+0000 7fd87b7fe700 1 -- 172.21.15.63:0/3413044773 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd87c064290 con 0x7fd88c0616d0 2020-05-18T21:27:36.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.509+0000 7fd89192f700 1 --2- 172.21.15.63:0/3413044773 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd86c04fa50 0x7fd86c051f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:36.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.509+0000 7fd89192f700 1 --2- 172.21.15.63:0/3413044773 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd86c04fa50 0x7fd86c051f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd88c130de0 tx=0x7fd888011360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.509+0000 7fd89192f700 1 --2- 172.21.15.63:0/3413044773 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd86c04fa50 0x7fd86c051f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd88c130de0 tx=0x7fd888011360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.509+0000 7fd89192f700 1 --2- 172.21.15.63:0/3413044773 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd86c04fa50 0x7fd86c051f10 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7fd88c130de0 tx=0x7fd888011360).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:36.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.513+0000 7fd892130700 1 --2- 172.21.15.63:0/3413044773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88c0616d0 0x7fd88c0b2f60 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7fd87c0030b0 tx=0x7fd87c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.513+0000 7fd87b7fe700 1 -- 172.21.15.63:0/3413044773 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd88c0b2cc0 con 0x7fd88c0616d0 2020-05-18T21:27:36.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.633+0000 7fd894394700 1 -- 172.21.15.63:0/3413044773 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd88c0b2cc0 con 0x7fd88c0616d0 2020-05-18T21:27:36.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.633+0000 7fd892130700 1 --2- 172.21.15.63:0/3413044773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88c0616d0 0x7fd88c0b2f60 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7fd87c0030b0 tx=0x7fd87c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.633+0000 7fd87b7fe700 1 -- 172.21.15.63:0/3413044773 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd88c0b2cc0 con 0x7fd88c0616d0 2020-05-18T21:27:36.644 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:27:36.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.637+0000 7fd894394700 1 -- 172.21.15.63:0/3413044773 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd86c04fa50 msgr2=0x7fd86c051f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.637+0000 7fd894394700 1 --2- 172.21.15.63:0/3413044773 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd86c04fa50 0x7fd86c051f10 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7fd88c130de0 tx=0x7fd888011360).stop 2020-05-18T21:27:36.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.637+0000 7fd894394700 1 -- 172.21.15.63:0/3413044773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88c0616d0 msgr2=0x7fd88c0b2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.637+0000 7fd894394700 1 --2- 172.21.15.63:0/3413044773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88c0616d0 0x7fd88c0b2f60 secure :-1 s=READY pgs=384 cs=0 l=1 rx=0x7fd87c0030b0 tx=0x7fd87c010cd0).stop 2020-05-18T21:27:36.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.637+0000 7fd894394700 1 -- 172.21.15.63:0/3413044773 shutdown_connections 2020-05-18T21:27:36.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.637+0000 7fd894394700 1 --2- 172.21.15.63:0/3413044773 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd86c04fa50 0x7fd86c051f10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:36.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.637+0000 7fd894394700 1 --2- 172.21.15.63:0/3413044773 >> v2:172.21.15.155:3300/0 conn(0x7fd88c0b9500 0x7fd88c12f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:36.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.637+0000 7fd894394700 1 --2- 172.21.15.63:0/3413044773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88c0616d0 0x7fd88c0b2f60 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:36.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.637+0000 7fd894394700 1 -- 172.21.15.63:0/3413044773 >> 172.21.15.63:0/3413044773 conn(0x7fd88c069b70 msgr2=0x7fd88c0bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:36.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.637+0000 7fd894394700 1 -- 172.21.15.63:0/3413044773 shutdown_connections 2020-05-18T21:27:36.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.637+0000 7fd894394700 1 -- 172.21.15.63:0/3413044773 wait complete. 2020-05-18T21:27:36.668 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:27:36.669 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:27:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.777+0000 7f8976be2700 1 Processor -- start 2020-05-18T21:27:36.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.777+0000 7f8976be2700 1 -- start start 2020-05-18T21:27:36.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.777+0000 7f8976be2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f897005f110 0x7f89700b2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:36.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.777+0000 7f8976be2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8970145d50 0x7f8970146200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:36.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.777+0000 7f8976be2700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89700b8650 con 0x7f89700b81b0 2020-05-18T21:27:36.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.777+0000 7f8976be2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89700b88f0 con 0x7f897005f110 2020-05-18T21:27:36.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.777+0000 7f8976be2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89700b8b90 con 0x7f8970145d50 2020-05-18T21:27:36.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.777+0000 7f89753df700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f89700b81b0 0x7f897012ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56490/0 (socket says 172.21.15.63:56490) 2020-05-18T21:27:36.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.777+0000 7f89753df700 1 -- 172.21.15.63:0/1452505865 learned_addr learned my addr 172.21.15.63:0/1452505865 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:36.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f89763e1700 1 --2- 172.21.15.63:0/1452505865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8970145d50 0x7f8970146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:36.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f8975be0700 1 --2- 172.21.15.63:0/1452505865 >> v2:172.21.15.155:3300/0 conn(0x7f897005f110 0x7f89700b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:36.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f8974bde700 1 -- 172.21.15.63:0/1452505865 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711723472 0 0) 0x7f89700b8650 con 0x7f89700b81b0 2020-05-18T21:27:36.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f8974bde700 1 -- 172.21.15.63:0/1452505865 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8958003270 con 0x7f89700b81b0 2020-05-18T21:27:36.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f89763e1700 1 -- 172.21.15.63:0/1452505865 >> v2:172.21.15.155:3300/0 conn(0x7f897005f110 msgr2=0x7f89700b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:36.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f89763e1700 1 --2- 172.21.15.63:0/1452505865 >> v2:172.21.15.155:3300/0 conn(0x7f897005f110 0x7f89700b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:36.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f89763e1700 1 -- 172.21.15.63:0/1452505865 >> v1:172.21.15.63:6789/0 conn(0x7f89700b81b0 legacy=0x7f897012ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f89763e1700 1 -- 172.21.15.63:0/1452505865 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89700b9030 con 0x7f8970145d50 2020-05-18T21:27:36.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f89763e1700 1 --2- 172.21.15.63:0/1452505865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8970145d50 0x7f8970146200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f89680032f0 tx=0x7f8968007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f89763e1700 1 --2- 172.21.15.63:0/1452505865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8970145d50 0x7f8970146200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f89680032f0 tx=0x7f8968007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f89763e1700 1 --2- 172.21.15.63:0/1452505865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8970145d50 0x7f8970146200 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f89680032f0 tx=0x7f8968007e00).ready entity=mon.2 client_cookie=c5dd3e3be8d00ccb server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:36.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f89763e1700 1 --2- 172.21.15.63:0/1452505865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8970145d50 0x7f8970146200 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f89680032f0 tx=0x7f8968007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f8974bde700 1 -- 172.21.15.63:0/1452505865 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8968011db0 con 0x7f8970145d50 2020-05-18T21:27:36.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f89763e1700 1 --2- 172.21.15.63:0/1452505865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8970145d50 0x7f8970146200 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f89680032f0 tx=0x7f8968007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f89763e1700 1 --2- 172.21.15.63:0/1452505865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8970145d50 0x7f8970146200 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f89680032f0 tx=0x7f8968007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f8974bde700 1 -- 172.21.15.63:0/1452505865 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896800a180 con 0x7f8970145d50 2020-05-18T21:27:36.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f8974bde700 1 -- 172.21.15.63:0/1452505865 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f896800a5a0 con 0x7f8970145d50 2020-05-18T21:27:36.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f8976be2700 1 -- 172.21.15.63:0/1452505865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8970145d50 msgr2=0x7f8970146200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f8976be2700 1 --2- 172.21.15.63:0/1452505865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8970145d50 0x7f8970146200 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f89680032f0 tx=0x7f8968007e00).stop 2020-05-18T21:27:36.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f8976be2700 1 -- 172.21.15.63:0/1452505865 shutdown_connections 2020-05-18T21:27:36.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f8976be2700 1 --2- 172.21.15.63:0/1452505865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8970145d50 0x7f8970146200 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:36.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f8976be2700 1 --2- 172.21.15.63:0/1452505865 >> v2:172.21.15.155:3300/0 conn(0x7f897005f110 0x7f89700b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:36.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f8976be2700 1 -- 172.21.15.63:0/1452505865 >> 172.21.15.63:0/1452505865 conn(0x7f8970069fc0 msgr2=0x7f897006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:36.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f8976be2700 1 -- 172.21.15.63:0/1452505865 shutdown_connections 2020-05-18T21:27:36.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.781+0000 7f8976be2700 1 -- 172.21.15.63:0/1452505865 wait complete. 2020-05-18T21:27:36.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f8976be2700 1 Processor -- start 2020-05-18T21:27:36.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f8976be2700 1 -- start start 2020-05-18T21:27:36.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f8976be2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8970145d50 0x7f8970060af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:36.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f8976be2700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8970146b70 con 0x7f89700b81b0 2020-05-18T21:27:36.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f8976be2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8970063b40 con 0x7f897005f110 2020-05-18T21:27:36.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f8976be2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8970060f50 con 0x7f8970145d50 2020-05-18T21:27:36.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f89753df700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f89700b81b0 0x7f8970127d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56498/0 (socket says 172.21.15.63:56498) 2020-05-18T21:27:36.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f89753df700 1 -- 172.21.15.63:0/63382250 learned_addr learned my addr 172.21.15.63:0/63382250 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:36.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f89763e1700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8970145d50 0x7f8970060af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:36.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827843875 0 0) 0x7f8970146b70 con 0x7f89700b81b0 2020-05-18T21:27:36.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8950002fe0 con 0x7f89700b81b0 2020-05-18T21:27:36.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662732740 0 0) 0x7f8970063b40 con 0x7f897005f110 2020-05-18T21:27:36.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8970146b70 con 0x7f897005f110 2020-05-18T21:27:36.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1199750030 0 0) 0x7f8950002fe0 con 0x7f89700b81b0 2020-05-18T21:27:36.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8970063b40 con 0x7f89700b81b0 2020-05-18T21:27:36.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f89600019a0 con 0x7f89700b81b0 2020-05-18T21:27:36.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8970145d50 msgr2=0x7f8970060af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f895effd700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8970145d50 0x7f8970060af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:36.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 >> v1:172.21.15.155:6789/0 conn(0x7f897005f110 legacy=0x7f89700611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 >> v1:172.21.15.63:6789/0 conn(0x7f89700b81b0 legacy=0x7f8970127d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f895effd700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8950004bf0 0x7f8950004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:36.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f895effd700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8950003880 0x7f8950003d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:36.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f895effd700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8950004160 0x7f895000b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:36.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8970060f50 con 0x7f8950003880 2020-05-18T21:27:36.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8950004720 con 0x7f8950004160 2020-05-18T21:27:36.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895000bc10 con 0x7f8950004bf0 2020-05-18T21:27:36.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.785+0000 7f89753df700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8950003880 0x7f8950003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:36.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f8975be0700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8950004bf0 0x7f8950004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:36.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f89763e1700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8950004160 0x7f895000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:36.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f89753df700 1 -- 172.21.15.63:0/63382250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8950004bf0 msgr2=0x7f8950004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f89753df700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8950004bf0 0x7f8950004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:36.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f89753df700 1 -- 172.21.15.63:0/63382250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8950004160 msgr2=0x7f895000b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f89753df700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8950004160 0x7f895000b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:36.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f89753df700 1 -- 172.21.15.63:0/63382250 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8970146da0 con 0x7f8950003880 2020-05-18T21:27:36.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f8976be2700 1 -- 172.21.15.63:0/63382250 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8970147040 con 0x7f8950003880 2020-05-18T21:27:36.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f89763e1700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8950004160 0x7f895000b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:27:36.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f8976be2700 1 -- 172.21.15.63:0/63382250 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8970148b20 con 0x7f8950003880 2020-05-18T21:27:36.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f89753df700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8950003880 0x7f8950003d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8960001770 tx=0x7f89600112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f89753df700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8950003880 0x7f8950003d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8960001770 tx=0x7f89600112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f89753df700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8950003880 0x7f8950003d00 secure :-1 s=READY pgs=387 cs=0 l=1 rx=0x7f8960001770 tx=0x7f89600112f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:36.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f89753df700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8950003880 0x7f8950003d00 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7f8960001770 tx=0x7f89600112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f896000ee30 con 0x7f8950003880 2020-05-18T21:27:36.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f89753df700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8950003880 0x7f8950003d00 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7f8960001770 tx=0x7f89600112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8960011d00 con 0x7f8950003880 2020-05-18T21:27:36.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f89753df700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8950003880 0x7f8950003d00 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7f8960001770 tx=0x7f89600112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8960011e70 con 0x7f8950003880 2020-05-18T21:27:36.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f89753df700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8950003880 0x7f8950003d00 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7f8960001770 tx=0x7f89600112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8960005810 con 0x7f8950003880 2020-05-18T21:27:36.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f89753df700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8950003880 0x7f8950003d00 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7f8960001770 tx=0x7f89600112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f8976be2700 1 -- 172.21.15.63:0/63382250 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894c003380 con 0x7f8950003880 2020-05-18T21:27:36.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f895effd700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8950058430 0x7f895005a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:36.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.789+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8960063f30 con 0x7f8950003880 2020-05-18T21:27:36.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.793+0000 7f8975be0700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8950058430 0x7f895005a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.793+0000 7f8975be0700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8950058430 0x7f895005a8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f896c002f30 tx=0x7f896c00d3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.793+0000 7f8975be0700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8950058430 0x7f895005a8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f896c002f30 tx=0x7f896c00d3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.793+0000 7f8975be0700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8950058430 0x7f895005a8f0 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f896c002f30 tx=0x7f896c00d3a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.797+0000 7f89753df700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8950003880 0x7f8950003d00 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7f8960001770 tx=0x7f89600112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.797+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f896003e320 con 0x7f8950003880 2020-05-18T21:27:36.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.949+0000 7f8976be2700 1 -- 172.21.15.63:0/63382250 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f894c003720 con 0x7f8950003880 2020-05-18T21:27:36.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.949+0000 7f89753df700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8950003880 0x7f8950003d00 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7f8960001770 tx=0x7f89600112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:36.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.949+0000 7f895effd700 1 -- 172.21.15.63:0/63382250 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f8960041940 con 0x7f8950003880 2020-05-18T21:27:36.958 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:36.958 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5055,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2600411689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2600411689},{"type":"v1","addr":"172.21.15.63:6833","nonce":2600411689}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:27:31.884487+0000","modified":"2020-05-18T21:27:32.888860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5064},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5064":{"gid":5064,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1028402057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1028402057},{"type":"v1","addr":"172.21.15.155:6835","nonce":1028402057}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-05-18T21:27:36.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.953+0000 7f8976be2700 1 -- 172.21.15.63:0/63382250 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8950058430 msgr2=0x7f895005a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.953+0000 7f8976be2700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8950058430 0x7f895005a8f0 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f896c002f30 tx=0x7f896c00d3a0).stop 2020-05-18T21:27:36.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.953+0000 7f89763e1700 1 -- 172.21.15.63:0/63382250 reap_dead start 2020-05-18T21:27:36.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.953+0000 7f8976be2700 1 -- 172.21.15.63:0/63382250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8950003880 msgr2=0x7f8950003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:36.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.953+0000 7f8976be2700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8950003880 0x7f8950003d00 secure :-1 s=READY pgs=387 cs=0 l=1 rx=0x7f8960001770 tx=0x7f89600112f0).stop 2020-05-18T21:27:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.953+0000 7f8976be2700 1 -- 172.21.15.63:0/63382250 shutdown_connections 2020-05-18T21:27:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.953+0000 7f8976be2700 1 --2- 172.21.15.63:0/63382250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8950003880 0x7f8950003d00 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.953+0000 7f8976be2700 1 -- 172.21.15.63:0/63382250 >> 172.21.15.63:0/63382250 conn(0x7f8970069fc0 msgr2=0x7f897005c280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.953+0000 7f8976be2700 1 -- 172.21.15.63:0/63382250 shutdown_connections 2020-05-18T21:27:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:36.953+0000 7f8976be2700 1 -- 172.21.15.63:0/63382250 wait complete. 2020-05-18T21:27:36.962 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 12 2020-05-18T21:27:37.173 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:27:31.884487+0000', 'modified': '2020-05-18T21:27:32.888860+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5064}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5064': {'gid': 5064, 'name': 'b', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6835/1028402057', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 1028402057}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 1028402057}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:27:37.174 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:27:37.174 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:27:37.285 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:27:37.286 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:27:37.286 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2020-05-18T21:27:37.286 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 5064, 2020-05-18T21:27:37.286 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:27:37.286 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:27:37.287 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 5.3940116570000001, 2020-05-18T21:27:37.287 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 12, 2020-05-18T21:27:37.287 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 33, 2020-05-18T21:27:37.287 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 33, 2020-05-18T21:27:37.287 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 11.966012128999999 2020-05-18T21:27:37.288 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:27:37.294 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 5064, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.3940116570000001, "mdsmap_epoch": 12, "osdmap_epoch": 33, "osdmap_epoch_barrier": 33, "uptime": 11.966012128999999 } 2020-05-18T21:27:37.294 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:27:37.295 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:27:37.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.296 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:27:37.305 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:27:37.306 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:37.306 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:27:37.306 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:37.307 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:27:37.307 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:37.307 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:37.307 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:37.307 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:37.308 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:37.308 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:37.308 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:37.308 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:27:37.309 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:37.309 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:27:37.309 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42785sec preferred_lft 42785sec 2020-05-18T21:27:37.310 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:27:37.310 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:37.310 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:27:37.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.312 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:27:37.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.333 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:27:37.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.394 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:27:37.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.409 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:27:37.423 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:27:37.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.426 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:27:37.474 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:27:37.474 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:27:37.475 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:27:37.475 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:27:37.475 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:27:37.475 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:27:37.475 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:27:37.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.476 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:27:37.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.495 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:27:37.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.508 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:27:37.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.524 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:27:37.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.532 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:27:37.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.583 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:27:37.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.600 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-05-18T21:27:37.660 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-05-18T21:27:37.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.661 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-05-18T21:27:37.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.681 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:27:37.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.700 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-05-18T21:27:37.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.763 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-05-18T21:27:37.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.781 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-05-18T21:27:37.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.797 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 up' 2020-05-18T21:27:37.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:37.812 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.0 master ceph-brx' 2020-05-18T21:27:37.876 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-05-18T21:27:37.877 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-05-18T21:27:37.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:37.878 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:27:37.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:37.886 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:27:37.943 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:27:37.944 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:27:37.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:37.946 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:27:37.951 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:27:37.952 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:27:37.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:37.955 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:27:37.972 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:27:37.973 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:27:37.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:37.975 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:27:38.039 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2020-05-18T21:27:38.033+0000 7f78eac86080 -1 init, newargv = 0x557a8d31f530 newargc=9 2020-05-18T21:27:38.039 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[17659]: starting ceph client 2020-05-18T21:27:38.051 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[17659]: starting fuse 2020-05-18T21:27:39.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:39.125 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:27:39.143 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:27:39.144 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:27:39.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:39.146 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:27:39.151 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:27:39.151 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:27:39.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:39.152 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:27:39.153 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:27:39.153 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:27:39.153 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:27:39.154 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:27:39.154 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:27:39.155 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:27:39.155 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:27:39.155 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:27:39.156 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:27:39.156 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:27:39.157 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:27:39.157 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:27:39.158 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:27:39.158 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:27:39.158 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:27:39.159 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:27:39.159 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:27:39.160 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:27:39.160 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:27:39.160 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:27:39.161 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:27:39.161 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:27:39.237 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.17659.asok 2020-05-18T21:27:39.242 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.17659.asok 2020-05-18T21:27:39.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:39.243 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.17659.asok status 2020-05-18T21:27:39.327 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:27:39.327 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:27:39.327 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:27:39.328 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:27:39.328 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:27:39.328 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:27:39.328 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:27:39.329 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "17659", 2020-05-18T21:27:39.329 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:27:39.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:39.329 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:27:39.329 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:27:39.330 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 5298, 2020-05-18T21:27:39.330 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:27:39.330 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:27:39.330 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:27:39.330 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 5298 2020-05-18T21:27:39.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:39.331 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:27:39.331 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:39.331 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:27:39.331 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 549049691 2020-05-18T21:27:39.331 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:39.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:39.332 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:27:39.332 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:39.332 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:27:39.332 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 549049691 2020-05-18T21:27:39.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:39.333 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.5298 192.168.0.1:0/549049691", 2020-05-18T21:27:39.333 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/549049691", 2020-05-18T21:27:39.333 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:27:39.333 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 12, 2020-05-18T21:27:39.334 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 33, 2020-05-18T21:27:39.334 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:27:39.338 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:27:39.338 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:27:39.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:39.340 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:27:39.340 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:27:39.350 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:27:39.351 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-05-18T21:27:39.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:27:39.352 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:27:39.412 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:27:39.413 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:27:39.414 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:27:39.414 INFO:teuthology.orchestra.run.smithi063:> mount_path = "/home/ubuntu/cephtest/mnt.0" 2020-05-18T21:27:39.415 INFO:teuthology.orchestra.run.smithi063:> subdir = "delete_me" 2020-05-18T21:27:39.415 INFO:teuthology.orchestra.run.smithi063:> size = 1024 2020-05-18T21:27:39.415 INFO:teuthology.orchestra.run.smithi063:> file_count = 1000 2020-05-18T21:27:39.416 INFO:teuthology.orchestra.run.smithi063:> os.mkdir(os.path.join(mount_path, subdir)) 2020-05-18T21:27:39.416 INFO:teuthology.orchestra.run.smithi063:> for i in range(0, file_count): 2020-05-18T21:27:39.416 INFO:teuthology.orchestra.run.smithi063:> filename = "{0}_{1}.bin".format(i, size) 2020-05-18T21:27:39.417 INFO:teuthology.orchestra.run.smithi063:> with open(os.path.join(mount_path, subdir, filename), '"'"'w'"'"') as f: 2020-05-18T21:27:39.417 INFO:teuthology.orchestra.run.smithi063:> f.write(size * '"'"'x'"'"') 2020-05-18T21:27:39.418 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:27:43.288 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:27:43.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.393+0000 7fe7632d4700 1 Processor -- start 2020-05-18T21:27:43.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.393+0000 7fe7632d4700 1 -- start start 2020-05-18T21:27:43.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.393+0000 7fe7632d4700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe75c064fd0 0x7fe75c14d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:43.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.393+0000 7fe7632d4700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75c14a330 con 0x7fe75c05f110 2020-05-18T21:27:43.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.393+0000 7fe7632d4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75c14a5d0 con 0x7fe75c0b4760 2020-05-18T21:27:43.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.393+0000 7fe7632d4700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c14a140 con 0x7fe75c064fd0 2020-05-18T21:27:43.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.393+0000 7fe7622d2700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe75c05f110 0x7fe75c14aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56550/0 (socket says 172.21.15.63:56550) 2020-05-18T21:27:43.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.393+0000 7fe7622d2700 1 -- 172.21.15.63:0/151175617 learned_addr learned my addr 172.21.15.63:0/151175617 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:43.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.393+0000 7fe762ad3700 1 --2- 172.21.15.63:0/151175617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe75c064fd0 0x7fe75c14d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:43.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe7612d0700 1 -- 172.21.15.63:0/151175617 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2939237067 0 0) 0x7fe75c14a330 con 0x7fe75c05f110 2020-05-18T21:27:43.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe7612d0700 1 -- 172.21.15.63:0/151175617 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe744003270 con 0x7fe75c05f110 2020-05-18T21:27:43.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe7612d0700 1 -- 172.21.15.63:0/151175617 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978644368 0 0) 0x7fe75c14a5d0 con 0x7fe75c0b4760 2020-05-18T21:27:43.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe7612d0700 1 -- 172.21.15.63:0/151175617 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe75c14a330 con 0x7fe75c0b4760 2020-05-18T21:27:43.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe762ad3700 1 -- 172.21.15.63:0/151175617 >> v1:172.21.15.155:6789/0 conn(0x7fe75c0b4760 legacy=0x7fe75c0648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:43.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe762ad3700 1 -- 172.21.15.63:0/151175617 >> v1:172.21.15.63:6789/0 conn(0x7fe75c05f110 legacy=0x7fe75c14aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:43.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe762ad3700 1 -- 172.21.15.63:0/151175617 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c063430 con 0x7fe75c064fd0 2020-05-18T21:27:43.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe762ad3700 1 --2- 172.21.15.63:0/151175617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe75c064fd0 0x7fe75c14d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe7540032f0 tx=0x7fe754008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:43.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe762ad3700 1 --2- 172.21.15.63:0/151175617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe75c064fd0 0x7fe75c14d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe7540032f0 tx=0x7fe754008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:43.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe762ad3700 1 --2- 172.21.15.63:0/151175617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe75c064fd0 0x7fe75c14d710 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7fe7540032f0 tx=0x7fe754008ca0).ready entity=mon.2 client_cookie=934192301ec53477 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:43.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe762ad3700 1 --2- 172.21.15.63:0/151175617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe75c064fd0 0x7fe75c14d710 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7fe7540032f0 tx=0x7fe754008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:43.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe7612d0700 1 -- 172.21.15.63:0/151175617 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe754011df0 con 0x7fe75c064fd0 2020-05-18T21:27:43.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe762ad3700 1 --2- 172.21.15.63:0/151175617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe75c064fd0 0x7fe75c14d710 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7fe7540032f0 tx=0x7fe754008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:43.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe7612d0700 1 -- 172.21.15.63:0/151175617 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75400a180 con 0x7fe75c064fd0 2020-05-18T21:27:43.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe762ad3700 1 --2- 172.21.15.63:0/151175617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe75c064fd0 0x7fe75c14d710 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7fe7540032f0 tx=0x7fe754008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:43.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe7632d4700 1 -- 172.21.15.63:0/151175617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe75c064fd0 msgr2=0x7fe75c14d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:43.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe7612d0700 1 -- 172.21.15.63:0/151175617 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe75400a560 con 0x7fe75c064fd0 2020-05-18T21:27:43.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe7632d4700 1 --2- 172.21.15.63:0/151175617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe75c064fd0 0x7fe75c14d710 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7fe7540032f0 tx=0x7fe754008ca0).stop 2020-05-18T21:27:43.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe7632d4700 1 -- 172.21.15.63:0/151175617 shutdown_connections 2020-05-18T21:27:43.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe7632d4700 1 --2- 172.21.15.63:0/151175617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe75c064fd0 0x7fe75c14d710 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:43.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe7632d4700 1 -- 172.21.15.63:0/151175617 >> 172.21.15.63:0/151175617 conn(0x7fe75c069fc0 msgr2=0x7fe75c06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:43.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe7632d4700 1 -- 172.21.15.63:0/151175617 shutdown_connections 2020-05-18T21:27:43.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.397+0000 7fe7632d4700 1 -- 172.21.15.63:0/151175617 wait complete. 2020-05-18T21:27:43.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe7632d4700 1 Processor -- start 2020-05-18T21:27:43.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe7632d4700 1 -- start start 2020-05-18T21:27:43.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe7632d4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe75c05f110 0x7fe75c149c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:43.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe7632d4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe75c064fd0 0x7fe75c1421a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:43.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe7632d4700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe75c0b4760 0x7fe75c142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:43.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe7632d4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75c142a60 con 0x7fe75c064fd0 2020-05-18T21:27:43.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe7632d4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75c1494c0 con 0x7fe75c05f110 2020-05-18T21:27:43.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe7632d4700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c149760 con 0x7fe75c0b4760 2020-05-18T21:27:43.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe761ad1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe75c064fd0 0x7fe75c1421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:43.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe761ad1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe75c064fd0 0x7fe75c1421a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54368/0 (socket says 172.21.15.63:54368) 2020-05-18T21:27:43.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe761ad1700 1 -- 172.21.15.63:0/2604561446 learned_addr learned my addr 172.21.15.63:0/2604561446 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:43.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe762ad3700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe75c0b4760 0x7fe75c142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:43.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe7622d2700 1 --2- 172.21.15.63:0/2604561446 >> v2:172.21.15.155:3300/0 conn(0x7fe75c05f110 0x7fe75c149c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:43.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe761ad1700 1 -- 172.21.15.63:0/2604561446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe75c0b4760 msgr2=0x7fe75c142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:43.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe761ad1700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe75c0b4760 0x7fe75c142600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:43.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe761ad1700 1 -- 172.21.15.63:0/2604561446 >> v2:172.21.15.155:3300/0 conn(0x7fe75c05f110 msgr2=0x7fe75c149c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:43.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe761ad1700 1 --2- 172.21.15.63:0/2604561446 >> v2:172.21.15.155:3300/0 conn(0x7fe75c05f110 0x7fe75c149c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:43.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe761ad1700 1 -- 172.21.15.63:0/2604561446 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c149a00 con 0x7fe75c064fd0 2020-05-18T21:27:43.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe761ad1700 1 --2- 172.21.15.63:0/2604561446 >> v2:172.21.15.63:3300/0 conn(0x7fe75c064fd0 0x7fe75c1421a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe74c001110 tx=0x7fe74c00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:43.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe761ad1700 1 --2- 172.21.15.63:0/2604561446 >> v2:172.21.15.63:3300/0 conn(0x7fe75c064fd0 0x7fe75c1421a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe74c001110 tx=0x7fe74c00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:43.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe761ad1700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c064fd0 0x7fe75c1421a0 secure :-1 s=READY pgs=392 cs=0 l=1 rx=0x7fe74c001110 tx=0x7fe74c00c4a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:43.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe761ad1700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c064fd0 0x7fe75c1421a0 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7fe74c001110 tx=0x7fe74c00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:43.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe761ad1700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c064fd0 0x7fe75c1421a0 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7fe74c001110 tx=0x7fe74c00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:43.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe74b7fe700 1 -- 172.21.15.63:0/2604561446 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe74c00cc60 con 0x7fe75c064fd0 2020-05-18T21:27:43.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe761ad1700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c064fd0 0x7fe75c1421a0 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7fe74c001110 tx=0x7fe74c00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:43.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe74b7fe700 1 -- 172.21.15.63:0/2604561446 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c00cdc0 con 0x7fe75c064fd0 2020-05-18T21:27:43.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe7632d4700 1 -- 172.21.15.63:0/2604561446 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75c15aea0 con 0x7fe75c064fd0 2020-05-18T21:27:43.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe74b7fe700 1 -- 172.21.15.63:0/2604561446 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe74c00e370 con 0x7fe75c064fd0 2020-05-18T21:27:43.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.401+0000 7fe7632d4700 1 -- 172.21.15.63:0/2604561446 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75c15b320 con 0x7fe75c064fd0 2020-05-18T21:27:43.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.405+0000 7fe761ad1700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c064fd0 0x7fe75c1421a0 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7fe74c001110 tx=0x7fe74c00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:43.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.405+0000 7fe7632d4700 1 -- 172.21.15.63:0/2604561446 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75c0569e0 con 0x7fe75c064fd0 2020-05-18T21:27:43.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.405+0000 7fe74b7fe700 1 -- 172.21.15.63:0/2604561446 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe74c00e5e0 con 0x7fe75c064fd0 2020-05-18T21:27:43.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.405+0000 7fe761ad1700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c064fd0 0x7fe75c1421a0 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7fe74c001110 tx=0x7fe74c00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:43.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.405+0000 7fe74b7fe700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe73c04fb60 0x7fe73c052020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:43.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.405+0000 7fe74b7fe700 1 -- 172.21.15.63:0/2604561446 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe74c0638e0 con 0x7fe75c064fd0 2020-05-18T21:27:43.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.405+0000 7fe7622d2700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe73c04fb60 0x7fe73c052020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:43.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.405+0000 7fe7622d2700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe73c04fb60 0x7fe73c052020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe758001110 tx=0x7fe758001da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:43.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.405+0000 7fe7622d2700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe73c04fb60 0x7fe73c052020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe758001110 tx=0x7fe758001da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:43.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.405+0000 7fe7622d2700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe73c04fb60 0x7fe73c052020 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7fe758001110 tx=0x7fe758001da0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:43.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.413+0000 7fe761ad1700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c064fd0 0x7fe75c1421a0 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7fe74c001110 tx=0x7fe74c00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:43.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.413+0000 7fe74b7fe700 1 -- 172.21.15.63:0/2604561446 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe74c03dc70 con 0x7fe75c064fd0 2020-05-18T21:27:43.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.565+0000 7fe7632d4700 1 -- 172.21.15.63:0/2604561446 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe75c0625f0 con 0x7fe75c064fd0 2020-05-18T21:27:43.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.565+0000 7fe761ad1700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c064fd0 0x7fe75c1421a0 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7fe74c001110 tx=0x7fe74c00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:43.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.565+0000 7fe74b7fe700 1 -- 172.21.15.63:0/2604561446 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2141 (secure 0 0 0) 0x7fe74c041290 con 0x7fe75c064fd0 2020-05-18T21:27:43.573 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:43.573 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5055,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2600411689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2600411689},{"type":"v1","addr":"172.21.15.63:6833","nonce":2600411689}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:27:31.884487+0000","modified":"2020-05-18T21:27:32.888860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5064},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5064":{"gid":5064,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1028402057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1028402057},{"type":"v1","addr":"172.21.15.155:6835","nonce":1028402057}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-05-18T21:27:43.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.565+0000 7fe7632d4700 1 -- 172.21.15.63:0/2604561446 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe73c04fb60 msgr2=0x7fe73c052020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:43.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.565+0000 7fe7632d4700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe73c04fb60 0x7fe73c052020 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7fe758001110 tx=0x7fe758001da0).stop 2020-05-18T21:27:43.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.565+0000 7fe7632d4700 1 -- 172.21.15.63:0/2604561446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c064fd0 msgr2=0x7fe75c1421a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:43.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.565+0000 7fe7632d4700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c064fd0 0x7fe75c1421a0 secure :-1 s=READY pgs=392 cs=0 l=1 rx=0x7fe74c001110 tx=0x7fe74c00c4a0).stop 2020-05-18T21:27:43.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.565+0000 7fe7632d4700 1 -- 172.21.15.63:0/2604561446 shutdown_connections 2020-05-18T21:27:43.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.565+0000 7fe7632d4700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe73c04fb60 0x7fe73c052020 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:43.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.565+0000 7fe7632d4700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe75c0b4760 0x7fe75c142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:43.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.569+0000 7fe7632d4700 1 --2- 172.21.15.63:0/2604561446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c064fd0 0x7fe75c1421a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:43.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.569+0000 7fe7632d4700 1 --2- 172.21.15.63:0/2604561446 >> v2:172.21.15.155:3300/0 conn(0x7fe75c05f110 0x7fe75c149c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:43.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.569+0000 7fe7632d4700 1 -- 172.21.15.63:0/2604561446 >> 172.21.15.63:0/2604561446 conn(0x7fe75c069fc0 msgr2=0x7fe75c0b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:43.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.569+0000 7fe7632d4700 1 -- 172.21.15.63:0/2604561446 shutdown_connections 2020-05-18T21:27:43.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:43.569+0000 7fe7632d4700 1 -- 172.21.15.63:0/2604561446 wait complete. 2020-05-18T21:27:43.577 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 12 2020-05-18T21:27:43.585 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok flush journal 2020-05-18T21:27:44.153 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:27:44.153 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "", 2020-05-18T21:27:44.153 INFO:teuthology.orchestra.run.smithi155.stdout: "return_code": 0 2020-05-18T21:27:44.154 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:27:44.168 INFO:tasks.cephfs.filesystem:_json_asok output: { "message": "", "return_code": 0 } 2020-05-18T21:27:44.169 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:27:44.170 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:27:44.170 INFO:teuthology.orchestra.run.smithi063:> import stat 2020-05-18T21:27:44.171 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:27:44.171 INFO:teuthology.orchestra.run.smithi063:> print(os.stat("/home/ubuntu/cephtest/mnt.0/delete_me").st_ino) 2020-05-18T21:27:44.171 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:27:44.247 INFO:teuthology.orchestra.run.smithi063.stdout:1099511627776 2020-05-18T21:27:44.439 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_metadata stat 10000000000.00000000 2020-05-18T21:27:44.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.465+0000 7f5b02e67b80 1 Processor -- start 2020-05-18T21:27:44.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.465+0000 7f5b02e67b80 1 -- start start 2020-05-18T21:27:44.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.465+0000 7f5b02e67b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55ee36468680 0x55ee364638e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:44.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.465+0000 7f5b02e67b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x55ee36468a60 0x55ee364617e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:44.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b02e67b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ee36468ea0 0x55ee3646ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:44.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b02e67b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ee36324110 con 0x55ee36468680 2020-05-18T21:27:44.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b02e67b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ee36314a40 con 0x55ee36468a60 2020-05-18T21:27:44.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b02e67b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee363bb570 con 0x55ee36468ea0 2020-05-18T21:27:44.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b012aa700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55ee36468680 0x55ee364638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:44.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b012aa700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55ee36468680 0x55ee364638e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54380/0 (socket says 172.21.15.63:54380) 2020-05-18T21:27:44.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b00aa9700 1 --2- 172.21.15.63:0/996935270 >> v2:172.21.15.155:3300/0 conn(0x55ee36468a60 0x55ee364617e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:44.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b012aa700 1 -- 172.21.15.63:0/996935270 learned_addr learned my addr 172.21.15.63:0/996935270 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:44.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b01aab700 1 --2- 172.21.15.63:0/996935270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ee36468ea0 0x55ee3646ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:44.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b012aa700 1 -- 172.21.15.63:0/996935270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ee36468ea0 msgr2=0x55ee3646ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:44.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b012aa700 1 --2- 172.21.15.63:0/996935270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ee36468ea0 0x55ee3646ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:44.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b012aa700 1 -- 172.21.15.63:0/996935270 >> v2:172.21.15.155:3300/0 conn(0x55ee36468a60 msgr2=0x55ee364617e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:44.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b012aa700 1 --2- 172.21.15.63:0/996935270 >> v2:172.21.15.155:3300/0 conn(0x55ee36468a60 0x55ee364617e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:44.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b012aa700 1 -- 172.21.15.63:0/996935270 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee363384b0 con 0x55ee36468680 2020-05-18T21:27:44.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b00aa9700 1 --2- 172.21.15.63:0/996935270 >> v2:172.21.15.155:3300/0 conn(0x55ee36468a60 0x55ee364617e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:44.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b012aa700 1 --2- 172.21.15.63:0/996935270 >> v2:172.21.15.63:3300/0 conn(0x55ee36468680 0x55ee364638e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5af4002f30 tx=0x7f5af400ab50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:44.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b012aa700 1 --2- 172.21.15.63:0/996935270 >> v2:172.21.15.63:3300/0 conn(0x55ee36468680 0x55ee364638e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5af4002f30 tx=0x7f5af400ab50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:44.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b012aa700 1 --2- 172.21.15.63:0/996935270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee36468680 0x55ee364638e0 secure :-1 s=READY pgs=394 cs=0 l=1 rx=0x7f5af4002f30 tx=0x7f5af400ab50).ready entity=mon.0 client_cookie=2e0849e38c3578c7 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:44.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b012aa700 1 --2- 172.21.15.63:0/996935270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee36468680 0x55ee364638e0 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f5af4002f30 tx=0x7f5af400ab50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:44.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b012aa700 1 --2- 172.21.15.63:0/996935270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee36468680 0x55ee364638e0 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f5af4002f30 tx=0x7f5af400ab50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:44.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5afaffd700 1 -- 172.21.15.63:0/996935270 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5af4010b50 con 0x55ee36468680 2020-05-18T21:27:44.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b012aa700 1 --2- 172.21.15.63:0/996935270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee36468680 0x55ee364638e0 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f5af4002f30 tx=0x7f5af400ab50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:44.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5afaffd700 1 -- 172.21.15.63:0/996935270 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af4010cb0 con 0x55ee36468680 2020-05-18T21:27:44.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5afaffd700 1 -- 172.21.15.63:0/996935270 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5af4004490 con 0x55ee36468680 2020-05-18T21:27:44.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b02e67b80 1 -- 172.21.15.63:0/996935270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee36468680 msgr2=0x55ee364638e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:44.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b02e67b80 1 --2- 172.21.15.63:0/996935270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee36468680 0x55ee364638e0 secure :-1 s=READY pgs=394 cs=0 l=1 rx=0x7f5af4002f30 tx=0x7f5af400ab50).stop 2020-05-18T21:27:44.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b02e67b80 1 -- 172.21.15.63:0/996935270 shutdown_connections 2020-05-18T21:27:44.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b02e67b80 1 --2- 172.21.15.63:0/996935270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ee36468ea0 0x55ee3646ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:44.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b02e67b80 1 --2- 172.21.15.63:0/996935270 >> v2:172.21.15.155:3300/0 conn(0x55ee36468a60 0x55ee364617e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:44.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b02e67b80 1 --2- 172.21.15.63:0/996935270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee36468680 0x55ee364638e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:44.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b02e67b80 1 -- 172.21.15.63:0/996935270 >> 172.21.15.63:0/996935270 conn(0x55ee363db850 msgr2=0x55ee363bbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:44.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b02e67b80 1 -- 172.21.15.63:0/996935270 shutdown_connections 2020-05-18T21:27:44.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.469+0000 7f5b02e67b80 1 -- 172.21.15.63:0/996935270 wait complete. 2020-05-18T21:27:44.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.473+0000 7f5b02e67b80 1 Processor -- start 2020-05-18T21:27:44.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.473+0000 7f5b02e67b80 1 -- start start 2020-05-18T21:27:44.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.473+0000 7f5b02e67b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ee36468680 0x55ee3646be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:44.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.473+0000 7f5b02e67b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x55ee36468ea0 0x55ee364654c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:44.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.473+0000 7f5b02e67b80 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55ee36318460 con 0x55ee36468a60 2020-05-18T21:27:44.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.473+0000 7f5b02e67b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ee36465920 con 0x55ee36468ea0 2020-05-18T21:27:44.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.473+0000 7f5b02e67b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee364693e0 con 0x55ee36468680 2020-05-18T21:27:44.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.473+0000 7f5b012aa700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ee36468680 0x55ee3646be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:44.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.473+0000 7f5b00aa9700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x55ee36468a60 0x55ee363972a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:54892/0 (socket says 172.21.15.63:54892) 2020-05-18T21:27:44.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.473+0000 7f5b00aa9700 1 -- 172.21.15.63:0/1351038821 learned_addr learned my addr 172.21.15.63:0/1351038821 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:44.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.473+0000 7f5b01aab700 1 --2- 172.21.15.63:0/1351038821 >> v2:172.21.15.155:3300/0 conn(0x55ee36468ea0 0x55ee364654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:44.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.473+0000 7f5afa7fc700 1 -- 172.21.15.63:0/1351038821 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280425848 0 0) 0x55ee36318460 con 0x55ee36468a60 2020-05-18T21:27:44.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.473+0000 7f5afa7fc700 1 -- 172.21.15.63:0/1351038821 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ae4002020 con 0x55ee36468a60 2020-05-18T21:27:44.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.473+0000 7f5b012aa700 1 -- 172.21.15.63:0/1351038821 >> v2:172.21.15.155:3300/0 conn(0x55ee36468ea0 msgr2=0x55ee364654c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:44.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.473+0000 7f5b012aa700 1 --2- 172.21.15.63:0/1351038821 >> v2:172.21.15.155:3300/0 conn(0x55ee36468ea0 0x55ee364654c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:44.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.473+0000 7f5b012aa700 1 -- 172.21.15.63:0/1351038821 >> v1:172.21.15.155:6789/0 conn(0x55ee36468a60 legacy=0x55ee363972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:44.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.473+0000 7f5b012aa700 1 -- 172.21.15.63:0/1351038821 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee36469680 con 0x55ee36468680 2020-05-18T21:27:44.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.473+0000 7f5b012aa700 1 --2- 172.21.15.63:0/1351038821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ee36468680 0x55ee3646be70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5af4002f30 tx=0x7f5af400ab50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:44.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.477+0000 7f5b012aa700 1 --2- 172.21.15.63:0/1351038821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ee36468680 0x55ee3646be70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5af4002f30 tx=0x7f5af400ab50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:44.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.477+0000 7f5b012aa700 1 --2- 172.21.15.63:0/1351038821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ee36468680 0x55ee3646be70 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f5af4002f30 tx=0x7f5af400ab50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:44.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.477+0000 7f5b012aa700 1 --2- 172.21.15.63:0/1351038821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ee36468680 0x55ee3646be70 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f5af4002f30 tx=0x7f5af400ab50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:44.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.477+0000 7f5b012aa700 1 --2- 172.21.15.63:0/1351038821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ee36468680 0x55ee3646be70 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f5af4002f30 tx=0x7f5af400ab50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:44.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.477+0000 7f5afa7fc700 1 -- 172.21.15.63:0/1351038821 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5af4004e80 con 0x55ee36468680 2020-05-18T21:27:44.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.477+0000 7f5b012aa700 1 --2- 172.21.15.63:0/1351038821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ee36468680 0x55ee3646be70 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f5af4002f30 tx=0x7f5af400ab50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:44.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.477+0000 7f5afa7fc700 1 -- 172.21.15.63:0/1351038821 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af4009450 con 0x55ee36468680 2020-05-18T21:27:44.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.477+0000 7f5b02e67b80 1 -- 172.21.15.63:0/1351038821 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ee36469920 con 0x55ee36468680 2020-05-18T21:27:44.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.477+0000 7f5afa7fc700 1 -- 172.21.15.63:0/1351038821 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5af40097b0 con 0x55ee36468680 2020-05-18T21:27:44.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.477+0000 7f5b02e67b80 1 -- 172.21.15.63:0/1351038821 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee36465110 con 0x55ee36468680 2020-05-18T21:27:44.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.477+0000 7f5b012aa700 1 --2- 172.21.15.63:0/1351038821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ee36468680 0x55ee3646be70 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f5af4002f30 tx=0x7f5af400ab50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:44.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.477+0000 7f5afa7fc700 1 -- 172.21.15.63:0/1351038821 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5af4009a20 con 0x55ee36468680 2020-05-18T21:27:44.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.477+0000 7f5b012aa700 1 --2- 172.21.15.63:0/1351038821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ee36468680 0x55ee3646be70 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f5af4002f30 tx=0x7f5af400ab50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:44.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5afa7fc700 1 --2- 172.21.15.63:0/1351038821 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ae404e9d0 0x7f5ae4050e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:44.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5afa7fc700 1 -- 172.21.15.63:0/1351038821 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5af40634c0 con 0x55ee36468680 2020-05-18T21:27:44.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b00aa9700 1 --2- 172.21.15.63:0/1351038821 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ae404e9d0 0x7f5ae4050e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:44.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b02e67b80 1 --2- 172.21.15.63:0/1351038821 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55ee3645c920 0x55ee3646a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:44.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b02e67b80 1 -- 172.21.15.63:0/1351038821 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- osd_op(unknown.0.0:1 5.0 5:0cf6ad0f:::10000000000.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected e33) v8 -- 0x55ee3646a730 con 0x55ee3645c920 2020-05-18T21:27:44.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b00aa9700 1 --2- 172.21.15.63:0/1351038821 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ae404e9d0 0x7f5ae4050e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5aec0013b0 tx=0x7f5aec008840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:44.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b01aab700 1 --2- 172.21.15.63:0/1351038821 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55ee3645c920 0x55ee3646a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:44.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b00aa9700 1 --2- 172.21.15.63:0/1351038821 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ae404e9d0 0x7f5ae4050e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5aec0013b0 tx=0x7f5aec008840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:44.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b00aa9700 1 --2- 172.21.15.63:0/1351038821 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ae404e9d0 0x7f5ae4050e90 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f5aec0013b0 tx=0x7f5aec008840).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:44.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b01aab700 1 --2- 172.21.15.63:0/1351038821 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55ee3645c920 0x55ee3646a2d0 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:44.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b01aab700 1 -- 172.21.15.63:0/1351038821 <== osd.3 v2:172.21.15.63:6814/12805 1 ==== osd_op_reply(1 10000000000.00000000 [stat out=16b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x7f5afc007870 con 0x55ee3645c920 2020-05-18T21:27:44.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b02e67b80 1 -- 172.21.15.63:0/1351038821 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55ee3645c920 msgr2=0x55ee3646a2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:44.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b02e67b80 1 --2- 172.21.15.63:0/1351038821 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55ee3645c920 0x55ee3646a2d0 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:44.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b02e67b80 1 -- 172.21.15.63:0/1351038821 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ae404e9d0 msgr2=0x7f5ae4050e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:44.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b02e67b80 1 --2- 172.21.15.63:0/1351038821 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ae404e9d0 0x7f5ae4050e90 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f5aec0013b0 tx=0x7f5aec008840).stop 2020-05-18T21:27:44.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b02e67b80 1 -- 172.21.15.63:0/1351038821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ee36468680 msgr2=0x55ee3646be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:44.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b02e67b80 1 --2- 172.21.15.63:0/1351038821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ee36468680 0x55ee3646be70 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f5af4002f30 tx=0x7f5af400ab50).stop 2020-05-18T21:27:44.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b01aab700 1 -- 172.21.15.63:0/1351038821 reap_dead start 2020-05-18T21:27:44.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b02e67b80 1 -- 172.21.15.63:0/1351038821 shutdown_connections 2020-05-18T21:27:44.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b02e67b80 1 -- 172.21.15.63:0/1351038821 >> 172.21.15.63:0/1351038821 conn(0x55ee363db850 msgr2=0x55ee363bd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:44.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b02e67b80 1 -- 172.21.15.63:0/1351038821 shutdown_connections 2020-05-18T21:27:44.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:44.481+0000 7f5b02e67b80 1 -- 172.21.15.63:0/1351038821 wait complete. 2020-05-18T21:27:44.499 INFO:teuthology.orchestra.run.smithi063.stdout:cephfs_metadata/10000000000.00000000 mtime 2020-05-18T21:27:43.000000+0000, size 0 2020-05-18T21:27:44.499 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rm -rf delete_me) 2020-05-18T21:27:48.607 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:27:48.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.705+0000 7ffb5a1fa700 1 Processor -- start 2020-05-18T21:27:48.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.705+0000 7ffb5a1fa700 1 -- start start 2020-05-18T21:27:48.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb5a1fa700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb54145f40 0x7ffb54061670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:48.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb5a1fa700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb54149e80 0x7ffb540b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:48.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb5a1fa700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb54146e60 con 0x7ffb54060b90 2020-05-18T21:27:48.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb5a1fa700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb54146480 con 0x7ffb54149e80 2020-05-18T21:27:48.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb5a1fa700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb54146720 con 0x7ffb54145f40 2020-05-18T21:27:48.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb53fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb54149e80 0x7ffb540b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:48.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb53fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb54149e80 0x7ffb540b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54400/0 (socket says 172.21.15.63:54400) 2020-05-18T21:27:48.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb53fff700 1 -- 172.21.15.63:0/635445146 learned_addr learned my addr 172.21.15.63:0/635445146 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:48.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb52ffd700 1 --2- 172.21.15.63:0/635445146 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb54145f40 0x7ffb54061670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:48.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb53fff700 1 -- 172.21.15.63:0/635445146 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb54145f40 msgr2=0x7ffb54061670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:48.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb53fff700 1 --2- 172.21.15.63:0/635445146 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb54145f40 0x7ffb54061670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:48.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb527fc700 1 -- 172.21.15.63:0/635445146 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291739519 0 0) 0x7ffb54146e60 con 0x7ffb54060b90 2020-05-18T21:27:48.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb53fff700 1 -- 172.21.15.63:0/635445146 >> v1:172.21.15.155:6789/0 conn(0x7ffb54060b90 legacy=0x7ffb54149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:48.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb53fff700 1 -- 172.21.15.63:0/635445146 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb541469c0 con 0x7ffb54149e80 2020-05-18T21:27:48.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb53fff700 1 --2- 172.21.15.63:0/635445146 >> v2:172.21.15.63:3300/0 conn(0x7ffb54149e80 0x7ffb540b1b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffb4c0032f0 tx=0x7ffb4c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:48.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb53fff700 1 --2- 172.21.15.63:0/635445146 >> v2:172.21.15.63:3300/0 conn(0x7ffb54149e80 0x7ffb540b1b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffb4c0032f0 tx=0x7ffb4c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:48.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb53fff700 1 --2- 172.21.15.63:0/635445146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb54149e80 0x7ffb540b1b40 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7ffb4c0032f0 tx=0x7ffb4c007e00).ready entity=mon.0 client_cookie=9ed140cb7ca74bc6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:48.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb53fff700 1 --2- 172.21.15.63:0/635445146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb54149e80 0x7ffb540b1b40 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7ffb4c0032f0 tx=0x7ffb4c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:48.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb527fc700 1 -- 172.21.15.63:0/635445146 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb4c011d10 con 0x7ffb54149e80 2020-05-18T21:27:48.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb53fff700 1 --2- 172.21.15.63:0/635445146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb54149e80 0x7ffb540b1b40 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7ffb4c0032f0 tx=0x7ffb4c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:48.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb53fff700 1 --2- 172.21.15.63:0/635445146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb54149e80 0x7ffb540b1b40 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7ffb4c0032f0 tx=0x7ffb4c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:48.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb527fc700 1 -- 172.21.15.63:0/635445146 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4c011e70 con 0x7ffb54149e80 2020-05-18T21:27:48.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb527fc700 1 -- 172.21.15.63:0/635445146 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb4c00a370 con 0x7ffb54149e80 2020-05-18T21:27:48.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb5a1fa700 1 -- 172.21.15.63:0/635445146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb54149e80 msgr2=0x7ffb540b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:48.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb5a1fa700 1 --2- 172.21.15.63:0/635445146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb54149e80 0x7ffb540b1b40 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7ffb4c0032f0 tx=0x7ffb4c007e00).stop 2020-05-18T21:27:48.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb5a1fa700 1 -- 172.21.15.63:0/635445146 shutdown_connections 2020-05-18T21:27:48.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb5a1fa700 1 --2- 172.21.15.63:0/635445146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb54149e80 0x7ffb540b1b40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:48.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb5a1fa700 1 --2- 172.21.15.63:0/635445146 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb54145f40 0x7ffb54061670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:48.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb5a1fa700 1 -- 172.21.15.63:0/635445146 >> 172.21.15.63:0/635445146 conn(0x7ffb540b83d0 msgr2=0x7ffb540b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:48.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.709+0000 7ffb5a1fa700 1 -- 172.21.15.63:0/635445146 shutdown_connections 2020-05-18T21:27:48.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.713+0000 7ffb5a1fa700 1 -- 172.21.15.63:0/635445146 wait complete. 2020-05-18T21:27:48.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.713+0000 7ffb5a1fa700 1 Processor -- start 2020-05-18T21:27:48.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.713+0000 7ffb5a1fa700 1 -- start start 2020-05-18T21:27:48.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb5a1fa700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb54149e80 0x7ffb540b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:48.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb5a1fa700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb54062cd0 con 0x7ffb54060b90 2020-05-18T21:27:48.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb5a1fa700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb54062f70 con 0x7ffb54145f40 2020-05-18T21:27:48.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb5a1fa700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb540b7c80 con 0x7ffb54149e80 2020-05-18T21:27:48.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb537fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ffb54060b90 0x7ffb540636b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56590/0 (socket says 172.21.15.63:56590) 2020-05-18T21:27:48.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb537fe700 1 -- 172.21.15.63:0/1360903687 learned_addr learned my addr 172.21.15.63:0/1360903687 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:48.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb53fff700 1 --2- 172.21.15.63:0/1360903687 >> v2:172.21.15.63:3300/0 conn(0x7ffb54149e80 0x7ffb540b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:48.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb50ff9700 1 -- 172.21.15.63:0/1360903687 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191712413 0 0) 0x7ffb54062cd0 con 0x7ffb54060b90 2020-05-18T21:27:48.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb50ff9700 1 -- 172.21.15.63:0/1360903687 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb38002fe0 con 0x7ffb54060b90 2020-05-18T21:27:48.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb50ff9700 1 -- 172.21.15.63:0/1360903687 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208915440 0 0) 0x7ffb54062f70 con 0x7ffb54145f40 2020-05-18T21:27:48.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb50ff9700 1 -- 172.21.15.63:0/1360903687 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb54062cd0 con 0x7ffb54145f40 2020-05-18T21:27:48.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb53fff700 1 -- 172.21.15.63:0/1360903687 >> v1:172.21.15.155:6789/0 conn(0x7ffb54145f40 legacy=0x7ffb541526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:48.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb53fff700 1 -- 172.21.15.63:0/1360903687 >> v1:172.21.15.63:6789/0 conn(0x7ffb54060b90 legacy=0x7ffb540636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:48.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb53fff700 1 -- 172.21.15.63:0/1360903687 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb54063210 con 0x7ffb54149e80 2020-05-18T21:27:48.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb53fff700 1 --2- 172.21.15.63:0/1360903687 >> v2:172.21.15.63:3300/0 conn(0x7ffb54149e80 0x7ffb540b7790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb4c0032f0 tx=0x7ffb4c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:48.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb53fff700 1 --2- 172.21.15.63:0/1360903687 >> v2:172.21.15.63:3300/0 conn(0x7ffb54149e80 0x7ffb540b7790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb4c0032f0 tx=0x7ffb4c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:48.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb53fff700 1 --2- 172.21.15.63:0/1360903687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb54149e80 0x7ffb540b7790 secure :-1 s=READY pgs=397 cs=0 l=1 rx=0x7ffb4c0032f0 tx=0x7ffb4c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:48.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb53fff700 1 --2- 172.21.15.63:0/1360903687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb54149e80 0x7ffb540b7790 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7ffb4c0032f0 tx=0x7ffb4c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:48.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb50ff9700 1 -- 172.21.15.63:0/1360903687 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb4c005a80 con 0x7ffb54149e80 2020-05-18T21:27:48.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb53fff700 1 --2- 172.21.15.63:0/1360903687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb54149e80 0x7ffb540b7790 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7ffb4c0032f0 tx=0x7ffb4c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:48.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb50ff9700 1 -- 172.21.15.63:0/1360903687 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4c005be0 con 0x7ffb54149e80 2020-05-18T21:27:48.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb53fff700 1 --2- 172.21.15.63:0/1360903687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb54149e80 0x7ffb540b7790 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7ffb4c0032f0 tx=0x7ffb4c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:48.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb5a1fa700 1 -- 172.21.15.63:0/1360903687 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb54152e00 con 0x7ffb54149e80 2020-05-18T21:27:48.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb50ff9700 1 -- 172.21.15.63:0/1360903687 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb4c0110d0 con 0x7ffb54149e80 2020-05-18T21:27:48.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb5a1fa700 1 -- 172.21.15.63:0/1360903687 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb54140d20 con 0x7ffb54149e80 2020-05-18T21:27:48.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.717+0000 7ffb53fff700 1 --2- 172.21.15.63:0/1360903687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb54149e80 0x7ffb540b7790 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7ffb4c0032f0 tx=0x7ffb4c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:48.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.721+0000 7ffb5a1fa700 1 -- 172.21.15.63:0/1360903687 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb540569e0 con 0x7ffb54149e80 2020-05-18T21:27:48.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.721+0000 7ffb50ff9700 1 -- 172.21.15.63:0/1360903687 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ffb4c0112d0 con 0x7ffb54149e80 2020-05-18T21:27:48.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.721+0000 7ffb53fff700 1 --2- 172.21.15.63:0/1360903687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb54149e80 0x7ffb540b7790 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7ffb4c0032f0 tx=0x7ffb4c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:48.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.721+0000 7ffb50ff9700 1 --2- 172.21.15.63:0/1360903687 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb3804ff10 0x7ffb380523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:48.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.721+0000 7ffb50ff9700 1 -- 172.21.15.63:0/1360903687 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffb4c0642d0 con 0x7ffb54149e80 2020-05-18T21:27:48.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.721+0000 7ffb537fe700 1 --2- 172.21.15.63:0/1360903687 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb3804ff10 0x7ffb380523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:48.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.721+0000 7ffb537fe700 1 --2- 172.21.15.63:0/1360903687 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb3804ff10 0x7ffb380523d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb44001070 tx=0x7ffb440017d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:48.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.721+0000 7ffb537fe700 1 --2- 172.21.15.63:0/1360903687 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb3804ff10 0x7ffb380523d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb44001070 tx=0x7ffb440017d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:48.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.721+0000 7ffb537fe700 1 --2- 172.21.15.63:0/1360903687 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb3804ff10 0x7ffb380523d0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7ffb44001070 tx=0x7ffb440017d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:48.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.725+0000 7ffb53fff700 1 --2- 172.21.15.63:0/1360903687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb54149e80 0x7ffb540b7790 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7ffb4c0032f0 tx=0x7ffb4c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:48.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.725+0000 7ffb50ff9700 1 -- 172.21.15.63:0/1360903687 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ffb4c03e6c0 con 0x7ffb54149e80 2020-05-18T21:27:48.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.877+0000 7ffb5a1fa700 1 -- 172.21.15.63:0/1360903687 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb540633a0 con 0x7ffb54149e80 2020-05-18T21:27:48.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.877+0000 7ffb53fff700 1 --2- 172.21.15.63:0/1360903687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb54149e80 0x7ffb540b7790 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7ffb4c0032f0 tx=0x7ffb4c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:48.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.877+0000 7ffb50ff9700 1 -- 172.21.15.63:0/1360903687 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2141 (secure 0 0 0) 0x7ffb4c041ce0 con 0x7ffb54149e80 2020-05-18T21:27:48.885 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:48.886 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5055,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2600411689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2600411689},{"type":"v1","addr":"172.21.15.63:6833","nonce":2600411689}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:27:31.884487+0000","modified":"2020-05-18T21:27:32.888860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5064},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5064":{"gid":5064,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1028402057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1028402057},{"type":"v1","addr":"172.21.15.155:6835","nonce":1028402057}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-05-18T21:27:48.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.881+0000 7ffb5a1fa700 1 -- 172.21.15.63:0/1360903687 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb3804ff10 msgr2=0x7ffb380523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:48.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.881+0000 7ffb5a1fa700 1 --2- 172.21.15.63:0/1360903687 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb3804ff10 0x7ffb380523d0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7ffb44001070 tx=0x7ffb440017d0).stop 2020-05-18T21:27:48.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.881+0000 7ffb5a1fa700 1 -- 172.21.15.63:0/1360903687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb54149e80 msgr2=0x7ffb540b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:48.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.881+0000 7ffb5a1fa700 1 --2- 172.21.15.63:0/1360903687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb54149e80 0x7ffb540b7790 secure :-1 s=READY pgs=397 cs=0 l=1 rx=0x7ffb4c0032f0 tx=0x7ffb4c007e00).stop 2020-05-18T21:27:48.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.881+0000 7ffb5a1fa700 1 -- 172.21.15.63:0/1360903687 shutdown_connections 2020-05-18T21:27:48.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.881+0000 7ffb5a1fa700 1 --2- 172.21.15.63:0/1360903687 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb3804ff10 0x7ffb380523d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:48.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.881+0000 7ffb5a1fa700 1 --2- 172.21.15.63:0/1360903687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb54149e80 0x7ffb540b7790 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:48.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.881+0000 7ffb5a1fa700 1 -- 172.21.15.63:0/1360903687 >> 172.21.15.63:0/1360903687 conn(0x7ffb540b83d0 msgr2=0x7ffb5413fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:48.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.881+0000 7ffb5a1fa700 1 -- 172.21.15.63:0/1360903687 shutdown_connections 2020-05-18T21:27:48.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:48.881+0000 7ffb5a1fa700 1 -- 172.21.15.63:0/1360903687 wait complete. 2020-05-18T21:27:48.890 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 12 2020-05-18T21:27:48.898 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok flush journal 2020-05-18T21:27:49.090 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:27:49.090 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "", 2020-05-18T21:27:49.091 INFO:teuthology.orchestra.run.smithi155.stdout: "return_code": 0 2020-05-18T21:27:49.091 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:27:49.099 INFO:tasks.cephfs.filesystem:_json_asok output: { "message": "", "return_code": 0 } 2020-05-18T21:27:49.099 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:27:49.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0d57e3700 1 Processor -- start 2020-05-18T21:27:49.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0d57e3700 1 -- start start 2020-05-18T21:27:49.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0d57e3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd0d0060b90 0x7fd0d00615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:49.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0d57e3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0d014e570 0x7fd0d014a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:49.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0d57e3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d014d960 con 0x7fd0d00b2860 2020-05-18T21:27:49.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0d57e3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d0066210 con 0x7fd0d0060b90 2020-05-18T21:27:49.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0d57e3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d014db90 con 0x7fd0d014e570 2020-05-18T21:27:49.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0ceffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd0d0060b90 0x7fd0d00615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:49.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0ceffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd0d0060b90 0x7fd0d00615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54410/0 (socket says 172.21.15.63:54410) 2020-05-18T21:27:49.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0ceffd700 1 -- 172.21.15.63:0/1772789166 learned_addr learned my addr 172.21.15.63:0/1772789166 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:49.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0ce7fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd0d00b2860 0x7fd0d0144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56600/0 (socket says 172.21.15.63:56600) 2020-05-18T21:27:49.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0cf7fe700 1 --2- 172.21.15.63:0/1772789166 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0d014e570 0x7fd0d014a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:49.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0ceffd700 1 -- 172.21.15.63:0/1772789166 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0d014e570 msgr2=0x7fd0d014a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:49.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0ceffd700 1 --2- 172.21.15.63:0/1772789166 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0d014e570 0x7fd0d014a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:49.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0ceffd700 1 -- 172.21.15.63:0/1772789166 >> v1:172.21.15.63:6789/0 conn(0x7fd0d00b2860 legacy=0x7fd0d0144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:49.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0ceffd700 1 -- 172.21.15.63:0/1772789166 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d014de30 con 0x7fd0d0060b90 2020-05-18T21:27:49.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0ceffd700 1 --2- 172.21.15.63:0/1772789166 >> v2:172.21.15.63:3300/0 conn(0x7fd0d0060b90 0x7fd0d00615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd0c0002f70 tx=0x7fd0c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0ceffd700 1 --2- 172.21.15.63:0/1772789166 >> v2:172.21.15.63:3300/0 conn(0x7fd0d0060b90 0x7fd0d00615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd0c0002f70 tx=0x7fd0c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0ceffd700 1 --2- 172.21.15.63:0/1772789166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0d0060b90 0x7fd0d00615e0 secure :-1 s=READY pgs=399 cs=0 l=1 rx=0x7fd0c0002f70 tx=0x7fd0c0007a80).ready entity=mon.0 client_cookie=2ee91a1ed7c01d7 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:49.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0ceffd700 1 --2- 172.21.15.63:0/1772789166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0d0060b90 0x7fd0d00615e0 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7fd0c0002f70 tx=0x7fd0c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0cdffb700 1 -- 172.21.15.63:0/1772789166 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0c0011760 con 0x7fd0d0060b90 2020-05-18T21:27:49.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0ceffd700 1 --2- 172.21.15.63:0/1772789166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0d0060b90 0x7fd0d00615e0 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7fd0c0002f70 tx=0x7fd0c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0cdffb700 1 -- 172.21.15.63:0/1772789166 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c00118c0 con 0x7fd0d0060b90 2020-05-18T21:27:49.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0ceffd700 1 --2- 172.21.15.63:0/1772789166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0d0060b90 0x7fd0d00615e0 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7fd0c0002f70 tx=0x7fd0c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0cdffb700 1 -- 172.21.15.63:0/1772789166 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0c0011ce0 con 0x7fd0d0060b90 2020-05-18T21:27:49.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0d57e3700 1 -- 172.21.15.63:0/1772789166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0d0060b90 msgr2=0x7fd0d00615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:49.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0d57e3700 1 --2- 172.21.15.63:0/1772789166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0d0060b90 0x7fd0d00615e0 secure :-1 s=READY pgs=399 cs=0 l=1 rx=0x7fd0c0002f70 tx=0x7fd0c0007a80).stop 2020-05-18T21:27:49.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0d57e3700 1 -- 172.21.15.63:0/1772789166 shutdown_connections 2020-05-18T21:27:49.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0d57e3700 1 --2- 172.21.15.63:0/1772789166 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0d014e570 0x7fd0d014a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:49.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.193+0000 7fd0d57e3700 1 --2- 172.21.15.63:0/1772789166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0d0060b90 0x7fd0d00615e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:49.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.197+0000 7fd0d57e3700 1 -- 172.21.15.63:0/1772789166 >> 172.21.15.63:0/1772789166 conn(0x7fd0d00b83d0 msgr2=0x7fd0d00b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:49.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.197+0000 7fd0d57e3700 1 -- 172.21.15.63:0/1772789166 shutdown_connections 2020-05-18T21:27:49.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.197+0000 7fd0d57e3700 1 -- 172.21.15.63:0/1772789166 wait complete. 2020-05-18T21:27:49.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.197+0000 7fd0d57e3700 1 Processor -- start 2020-05-18T21:27:49.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.197+0000 7fd0d57e3700 1 -- start start 2020-05-18T21:27:49.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0d57e3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd0d0060b90 0x7fd0d0065510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:49.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0d57e3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d014a3c0 con 0x7fd0d00b2860 2020-05-18T21:27:49.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0d57e3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d0065970 con 0x7fd0d014e570 2020-05-18T21:27:49.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0d57e3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d00ac570 con 0x7fd0d0060b90 2020-05-18T21:27:49.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0ce7fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd0d00b2860 0x7fd0d00acf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56606/0 (socket says 172.21.15.63:56606) 2020-05-18T21:27:49.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0ce7fc700 1 -- 172.21.15.63:0/437418634 learned_addr learned my addr 172.21.15.63:0/437418634 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:49.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0ceffd700 1 --2- 172.21.15.63:0/437418634 >> v2:172.21.15.155:3300/0 conn(0x7fd0d0060b90 0x7fd0d0065510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:49.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0bffff700 1 -- 172.21.15.63:0/437418634 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820053245 0 0) 0x7fd0d014a3c0 con 0x7fd0d00b2860 2020-05-18T21:27:49.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0bffff700 1 -- 172.21.15.63:0/437418634 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0ac002fe0 con 0x7fd0d00b2860 2020-05-18T21:27:49.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0bffff700 1 -- 172.21.15.63:0/437418634 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2996842617 0 0) 0x7fd0ac002fe0 con 0x7fd0d00b2860 2020-05-18T21:27:49.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0bffff700 1 -- 172.21.15.63:0/437418634 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd0d014a3c0 con 0x7fd0d00b2860 2020-05-18T21:27:49.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0bffff700 1 -- 172.21.15.63:0/437418634 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fd0c4001930 con 0x7fd0d00b2860 2020-05-18T21:27:49.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0bffff700 1 -- 172.21.15.63:0/437418634 >> v2:172.21.15.155:3300/0 conn(0x7fd0d0060b90 msgr2=0x7fd0d0065510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:49.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0bffff700 1 --2- 172.21.15.63:0/437418634 >> v2:172.21.15.155:3300/0 conn(0x7fd0d0060b90 0x7fd0d0065510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:49.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0bffff700 1 -- 172.21.15.63:0/437418634 >> v1:172.21.15.155:6789/0 conn(0x7fd0d014e570 legacy=0x7fd0d0149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:49.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0bffff700 1 -- 172.21.15.63:0/437418634 >> v1:172.21.15.63:6789/0 conn(0x7fd0d00b2860 legacy=0x7fd0d00acf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:49.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0bffff700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0ac004a80 0x7fd0ac004e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:49.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0bffff700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0ac0039a0 0x7fd0ac003e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:49.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0bffff700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0ac004260 0x7fd0ac00b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:49.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0bffff700 1 -- 172.21.15.63:0/437418634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00ac570 con 0x7fd0ac004260 2020-05-18T21:27:49.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0bffff700 1 -- 172.21.15.63:0/437418634 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac0046e0 con 0x7fd0ac0039a0 2020-05-18T21:27:49.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0bffff700 1 -- 172.21.15.63:0/437418634 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac004870 con 0x7fd0ac004a80 2020-05-18T21:27:49.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0ceffd700 1 --2- 172.21.15.63:0/437418634 >> v2:172.21.15.155:3300/0 conn(0x7fd0d0060b90 0x7fd0d0065510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:49.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0cf7fe700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0ac004260 0x7fd0ac00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:49.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0ce7fc700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0ac0039a0 0x7fd0ac003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:49.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0ceffd700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0ac004a80 0x7fd0ac004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:49.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0cf7fe700 1 -- 172.21.15.63:0/437418634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0ac004a80 msgr2=0x7fd0ac004e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:49.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0cf7fe700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0ac004a80 0x7fd0ac004e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:49.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0cf7fe700 1 -- 172.21.15.63:0/437418634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0ac0039a0 msgr2=0x7fd0ac003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:49.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0cf7fe700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0ac0039a0 0x7fd0ac003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:49.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0cf7fe700 1 -- 172.21.15.63:0/437418634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d00ac810 con 0x7fd0ac004260 2020-05-18T21:27:49.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0d57e3700 1 -- 172.21.15.63:0/437418634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d00acab0 con 0x7fd0ac004260 2020-05-18T21:27:49.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0cf7fe700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0ac004260 0x7fd0ac00b760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd0c80022d0 tx=0x7fd0c8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0d57e3700 1 -- 172.21.15.63:0/437418634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d0145a00 con 0x7fd0ac004260 2020-05-18T21:27:49.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0cf7fe700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0ac004260 0x7fd0ac00b760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd0c80022d0 tx=0x7fd0c8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0cf7fe700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0ac004260 0x7fd0ac00b760 secure :-1 s=READY pgs=401 cs=0 l=1 rx=0x7fd0c80022d0 tx=0x7fd0c8010e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:49.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0cf7fe700 1 -- 172.21.15.63:0/437418634 reap_dead start 2020-05-18T21:27:49.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0cf7fe700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0ac004260 0x7fd0ac00b760 secure :-1 s=THROTTLE_DONE pgs=401 cs=0 l=1 rx=0x7fd0c80022d0 tx=0x7fd0c8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0cf7fe700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0ac004260 0x7fd0ac00b760 secure :-1 s=THROTTLE_DONE pgs=401 cs=0 l=1 rx=0x7fd0c80022d0 tx=0x7fd0c8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0bffff700 1 -- 172.21.15.63:0/437418634 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0c8012ba0 con 0x7fd0ac004260 2020-05-18T21:27:49.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0cf7fe700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0ac004260 0x7fd0ac00b760 secure :-1 s=THROTTLE_DONE pgs=401 cs=0 l=1 rx=0x7fd0c80022d0 tx=0x7fd0c8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0bffff700 1 -- 172.21.15.63:0/437418634 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c8012d00 con 0x7fd0ac004260 2020-05-18T21:27:49.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.201+0000 7fd0bffff700 1 -- 172.21.15.63:0/437418634 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0c8012e70 con 0x7fd0ac004260 2020-05-18T21:27:49.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.205+0000 7fd0cf7fe700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0ac004260 0x7fd0ac00b760 secure :-1 s=THROTTLE_DONE pgs=401 cs=0 l=1 rx=0x7fd0c80022d0 tx=0x7fd0c8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.205+0000 7fd0d57e3700 1 -- 172.21.15.63:0/437418634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b0003380 con 0x7fd0ac004260 2020-05-18T21:27:49.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.205+0000 7fd0bffff700 1 -- 172.21.15.63:0/437418634 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd0c80115b0 con 0x7fd0ac004260 2020-05-18T21:27:49.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.205+0000 7fd0cf7fe700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0ac004260 0x7fd0ac00b760 secure :-1 s=THROTTLE_DONE pgs=401 cs=0 l=1 rx=0x7fd0c80022d0 tx=0x7fd0c8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.205+0000 7fd0bffff700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd0ac0537d0 0x7fd0ac055c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:49.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.205+0000 7fd0bffff700 1 -- 172.21.15.63:0/437418634 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd0c8064350 con 0x7fd0ac004260 2020-05-18T21:27:49.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.205+0000 7fd0ceffd700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd0ac0537d0 0x7fd0ac055c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:49.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.205+0000 7fd0ceffd700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd0ac0537d0 0x7fd0ac055c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd0c0002f70 tx=0x7fd0c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.205+0000 7fd0ceffd700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd0ac0537d0 0x7fd0ac055c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd0c0002f70 tx=0x7fd0c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.205+0000 7fd0ceffd700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd0ac0537d0 0x7fd0ac055c90 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fd0c0002f70 tx=0x7fd0c0007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:49.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.213+0000 7fd0cf7fe700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0ac004260 0x7fd0ac00b760 secure :-1 s=THROTTLE_DONE pgs=401 cs=0 l=1 rx=0x7fd0c80022d0 tx=0x7fd0c8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.213+0000 7fd0bffff700 1 -- 172.21.15.63:0/437418634 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd0c803e6e0 con 0x7fd0ac004260 2020-05-18T21:27:49.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.353+0000 7fd0d57e3700 1 -- 172.21.15.63:0/437418634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0b0003720 con 0x7fd0ac004260 2020-05-18T21:27:49.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.353+0000 7fd0cf7fe700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0ac004260 0x7fd0ac00b760 secure :-1 s=THROTTLE_DONE pgs=401 cs=0 l=1 rx=0x7fd0c80022d0 tx=0x7fd0c8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.353+0000 7fd0bffff700 1 -- 172.21.15.63:0/437418634 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2141 (secure 0 0 0) 0x7fd0c8041d00 con 0x7fd0ac004260 2020-05-18T21:27:49.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.357+0000 7fd0d57e3700 1 -- 172.21.15.63:0/437418634 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd0ac0537d0 msgr2=0x7fd0ac055c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:49.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.357+0000 7fd0d57e3700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd0ac0537d0 0x7fd0ac055c90 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fd0c0002f70 tx=0x7fd0c0007a80).stop 2020-05-18T21:27:49.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.357+0000 7fd0d57e3700 1 -- 172.21.15.63:0/437418634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0ac004260 msgr2=0x7fd0ac00b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:49.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.357+0000 7fd0d57e3700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0ac004260 0x7fd0ac00b760 secure :-1 s=READY pgs=401 cs=0 l=1 rx=0x7fd0c80022d0 tx=0x7fd0c8010e10).stop 2020-05-18T21:27:49.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.357+0000 7fd0d57e3700 1 -- 172.21.15.63:0/437418634 shutdown_connections 2020-05-18T21:27:49.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.357+0000 7fd0d57e3700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd0ac0537d0 0x7fd0ac055c90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:49.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.357+0000 7fd0d57e3700 1 --2- 172.21.15.63:0/437418634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0ac004260 0x7fd0ac00b760 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:49.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.357+0000 7fd0d57e3700 1 -- 172.21.15.63:0/437418634 >> 172.21.15.63:0/437418634 conn(0x7fd0d00b83d0 msgr2=0x7fd0d0062f20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:49.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.357+0000 7fd0d57e3700 1 -- 172.21.15.63:0/437418634 shutdown_connections 2020-05-18T21:27:49.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.357+0000 7fd0d57e3700 1 -- 172.21.15.63:0/437418634 wait complete. 2020-05-18T21:27:49.372 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 12 2020-05-18T21:27:49.373 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:49.373 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5055,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2600411689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2600411689},{"type":"v1","addr":"172.21.15.63:6833","nonce":2600411689}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:27:31.884487+0000","modified":"2020-05-18T21:27:32.888860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5064},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5064":{"gid":5064,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1028402057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1028402057},{"type":"v1","addr":"172.21.15.155:6835","nonce":1028402057}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-05-18T21:27:49.374 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump mds_cache strays_created 2020-05-18T21:27:49.484 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:27:49.484 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:27:49.485 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 1001 2020-05-18T21:27:49.485 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:27:49.485 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:27:49.494 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_created": 1001 } } 2020-05-18T21:27:49.495 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:27:49.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff701858700 1 Processor -- start 2020-05-18T21:27:49.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff701858700 1 -- start start 2020-05-18T21:27:49.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff701858700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff6fc05f110 0x7ff6fc0b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:49.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff701858700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc064fd0 0x7ff6fc14d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:49.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff701858700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc14a330 con 0x7ff6fc14aa70 2020-05-18T21:27:49.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff701858700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc14a140 con 0x7ff6fc05f110 2020-05-18T21:27:49.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff701858700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc065460 con 0x7ff6fc064fd0 2020-05-18T21:27:49.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff700856700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff6fc05f110 0x7ff6fc0b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:49.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff6fbfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff6fc14aa70 0x7ff6fc0648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56620/0 (socket says 172.21.15.63:56620) 2020-05-18T21:27:49.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff6fbfff700 1 -- 172.21.15.63:0/1663584853 learned_addr learned my addr 172.21.15.63:0/1663584853 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:49.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff701057700 1 --2- 172.21.15.63:0/1663584853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc064fd0 0x7ff6fc14d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:49.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff6fb7fe700 1 -- 172.21.15.63:0/1663584853 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834247930 0 0) 0x7ff6fc14a330 con 0x7ff6fc14aa70 2020-05-18T21:27:49.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff6fb7fe700 1 -- 172.21.15.63:0/1663584853 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6dc003270 con 0x7ff6fc14aa70 2020-05-18T21:27:49.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff700856700 1 -- 172.21.15.63:0/1663584853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc064fd0 msgr2=0x7ff6fc14d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:49.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff700856700 1 --2- 172.21.15.63:0/1663584853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc064fd0 0x7ff6fc14d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:49.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff700856700 1 -- 172.21.15.63:0/1663584853 >> v1:172.21.15.63:6789/0 conn(0x7ff6fc14aa70 legacy=0x7ff6fc0648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:49.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff700856700 1 -- 172.21.15.63:0/1663584853 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc14a5d0 con 0x7ff6fc05f110 2020-05-18T21:27:49.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff700856700 1 --2- 172.21.15.63:0/1663584853 >> v2:172.21.15.63:3300/0 conn(0x7ff6fc05f110 0x7ff6fc0b4760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff6fc063c70 tx=0x7ff6f4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff700856700 1 --2- 172.21.15.63:0/1663584853 >> v2:172.21.15.63:3300/0 conn(0x7ff6fc05f110 0x7ff6fc0b4760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff6fc063c70 tx=0x7ff6f4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff700856700 1 --2- 172.21.15.63:0/1663584853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6fc05f110 0x7ff6fc0b4760 secure :-1 s=READY pgs=403 cs=0 l=1 rx=0x7ff6fc063c70 tx=0x7ff6f4008ca0).ready entity=mon.0 client_cookie=b74f4f44927fc085 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:49.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff700856700 1 --2- 172.21.15.63:0/1663584853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6fc05f110 0x7ff6fc0b4760 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7ff6fc063c70 tx=0x7ff6f4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff6fb7fe700 1 -- 172.21.15.63:0/1663584853 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6f4011db0 con 0x7ff6fc05f110 2020-05-18T21:27:49.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff700856700 1 --2- 172.21.15.63:0/1663584853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6fc05f110 0x7ff6fc0b4760 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7ff6fc063c70 tx=0x7ff6f4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff6fb7fe700 1 -- 172.21.15.63:0/1663584853 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f400a180 con 0x7ff6fc05f110 2020-05-18T21:27:49.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff700856700 1 --2- 172.21.15.63:0/1663584853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6fc05f110 0x7ff6fc0b4760 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7ff6fc063c70 tx=0x7ff6f4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff701858700 1 -- 172.21.15.63:0/1663584853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6fc05f110 msgr2=0x7ff6fc0b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:49.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff6fb7fe700 1 -- 172.21.15.63:0/1663584853 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6f400a560 con 0x7ff6fc05f110 2020-05-18T21:27:49.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.597+0000 7ff701858700 1 --2- 172.21.15.63:0/1663584853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6fc05f110 0x7ff6fc0b4760 secure :-1 s=READY pgs=403 cs=0 l=1 rx=0x7ff6fc063c70 tx=0x7ff6f4008ca0).stop 2020-05-18T21:27:49.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.601+0000 7ff701858700 1 -- 172.21.15.63:0/1663584853 shutdown_connections 2020-05-18T21:27:49.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.601+0000 7ff701858700 1 --2- 172.21.15.63:0/1663584853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc064fd0 0x7ff6fc14d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:49.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.601+0000 7ff701858700 1 --2- 172.21.15.63:0/1663584853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6fc05f110 0x7ff6fc0b4760 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:49.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.601+0000 7ff701858700 1 -- 172.21.15.63:0/1663584853 >> 172.21.15.63:0/1663584853 conn(0x7ff6fc069fc0 msgr2=0x7ff6fc06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:49.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.601+0000 7ff701858700 1 -- 172.21.15.63:0/1663584853 shutdown_connections 2020-05-18T21:27:49.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.601+0000 7ff701858700 1 -- 172.21.15.63:0/1663584853 wait complete. 2020-05-18T21:27:49.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.601+0000 7ff701858700 1 Processor -- start 2020-05-18T21:27:49.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.601+0000 7ff701858700 1 -- start start 2020-05-18T21:27:49.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff701858700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff6fc05f110 0x7ff6fc158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:49.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff701858700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff6fc064fd0 0x7ff6fc157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:49.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff701858700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc1581c0 con 0x7ff6fc14aa70 2020-05-18T21:27:49.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff701858700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc149890 con 0x7ff6fc05f110 2020-05-18T21:27:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff701858700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc149b10 con 0x7ff6fc064fd0 2020-05-18T21:27:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff701057700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff6fc14aa70 0x7ff6fc1330b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56628/0 (socket says 172.21.15.63:56628) 2020-05-18T21:27:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff701057700 1 -- 172.21.15.63:0/575536702 learned_addr learned my addr 172.21.15.63:0/575536702 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff700856700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff6fc05f110 0x7ff6fc158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff6fbfff700 1 --2- 172.21.15.63:0/575536702 >> v2:172.21.15.155:3300/0 conn(0x7ff6fc064fd0 0x7ff6fc157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:49.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff700856700 1 -- 172.21.15.63:0/575536702 >> v2:172.21.15.155:3300/0 conn(0x7ff6fc064fd0 msgr2=0x7ff6fc157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:49.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff700856700 1 --2- 172.21.15.63:0/575536702 >> v2:172.21.15.155:3300/0 conn(0x7ff6fc064fd0 0x7ff6fc157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:49.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff700856700 1 -- 172.21.15.63:0/575536702 >> v1:172.21.15.63:6789/0 conn(0x7ff6fc14aa70 legacy=0x7ff6fc1330b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:49.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff700856700 1 -- 172.21.15.63:0/575536702 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc144dd0 con 0x7ff6fc05f110 2020-05-18T21:27:49.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff6f9ffb700 1 -- 172.21.15.63:0/575536702 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969223312 0 0) 0x7ff6fc1581c0 con 0x7ff6fc14aa70 2020-05-18T21:27:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff700856700 1 --2- 172.21.15.63:0/575536702 >> v2:172.21.15.63:3300/0 conn(0x7ff6fc05f110 0x7ff6fc158520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff6fc063c70 tx=0x7ff6fc0640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff700856700 1 --2- 172.21.15.63:0/575536702 >> v2:172.21.15.63:3300/0 conn(0x7ff6fc05f110 0x7ff6fc158520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff6fc063c70 tx=0x7ff6fc0640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff700856700 1 --2- 172.21.15.63:0/575536702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6fc05f110 0x7ff6fc158520 secure :-1 s=READY pgs=405 cs=0 l=1 rx=0x7ff6fc063c70 tx=0x7ff6fc0640f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff700856700 1 --2- 172.21.15.63:0/575536702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6fc05f110 0x7ff6fc158520 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7ff6fc063c70 tx=0x7ff6fc0640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff6f9ffb700 1 -- 172.21.15.63:0/575536702 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6f4005c70 con 0x7ff6fc05f110 2020-05-18T21:27:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff700856700 1 --2- 172.21.15.63:0/575536702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6fc05f110 0x7ff6fc158520 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7ff6fc063c70 tx=0x7ff6fc0640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff6f9ffb700 1 -- 172.21.15.63:0/575536702 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f4005dd0 con 0x7ff6fc05f110 2020-05-18T21:27:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff701858700 1 -- 172.21.15.63:0/575536702 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc1494b0 con 0x7ff6fc05f110 2020-05-18T21:27:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff700856700 1 --2- 172.21.15.63:0/575536702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6fc05f110 0x7ff6fc158520 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7ff6fc063c70 tx=0x7ff6fc0640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff6f9ffb700 1 -- 172.21.15.63:0/575536702 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6f4007360 con 0x7ff6fc05f110 2020-05-18T21:27:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff701858700 1 -- 172.21.15.63:0/575536702 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc147730 con 0x7ff6fc05f110 2020-05-18T21:27:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.605+0000 7ff700856700 1 --2- 172.21.15.63:0/575536702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6fc05f110 0x7ff6fc158520 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7ff6fc063c70 tx=0x7ff6fc0640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.609+0000 7ff6f9ffb700 1 -- 172.21.15.63:0/575536702 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff6f40075e0 con 0x7ff6fc05f110 2020-05-18T21:27:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.609+0000 7ff700856700 1 --2- 172.21.15.63:0/575536702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6fc05f110 0x7ff6fc158520 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7ff6fc063c70 tx=0x7ff6fc0640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.609+0000 7ff701858700 1 -- 172.21.15.63:0/575536702 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc0569e0 con 0x7ff6fc05f110 2020-05-18T21:27:49.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.609+0000 7ff6f9ffb700 1 --2- 172.21.15.63:0/575536702 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff6e004f8f0 0x7ff6e0051db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:49.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.609+0000 7ff6f9ffb700 1 -- 172.21.15.63:0/575536702 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff6f4064b90 con 0x7ff6fc05f110 2020-05-18T21:27:49.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.609+0000 7ff6fbfff700 1 --2- 172.21.15.63:0/575536702 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff6e004f8f0 0x7ff6e0051db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:49.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.609+0000 7ff6fbfff700 1 --2- 172.21.15.63:0/575536702 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff6e004f8f0 0x7ff6e0051db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff6e4001110 tx=0x7ff6e40013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.609+0000 7ff6fbfff700 1 --2- 172.21.15.63:0/575536702 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff6e004f8f0 0x7ff6e0051db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff6e4001110 tx=0x7ff6e40013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.609+0000 7ff6fbfff700 1 --2- 172.21.15.63:0/575536702 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff6e004f8f0 0x7ff6e0051db0 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7ff6e4001110 tx=0x7ff6e40013e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:49.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.613+0000 7ff700856700 1 --2- 172.21.15.63:0/575536702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6fc05f110 0x7ff6fc158520 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7ff6fc063c70 tx=0x7ff6fc0640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.613+0000 7ff6f9ffb700 1 -- 172.21.15.63:0/575536702 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff6f403ef80 con 0x7ff6fc05f110 2020-05-18T21:27:49.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.761+0000 7ff701858700 1 -- 172.21.15.63:0/575536702 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6fc0b5b60 con 0x7ff6fc05f110 2020-05-18T21:27:49.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.761+0000 7ff700856700 1 --2- 172.21.15.63:0/575536702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6fc05f110 0x7ff6fc158520 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7ff6fc063c70 tx=0x7ff6fc0640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:49.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.761+0000 7ff6f9ffb700 1 -- 172.21.15.63:0/575536702 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2141 (secure 0 0 0) 0x7ff6f40425a0 con 0x7ff6fc05f110 2020-05-18T21:27:49.769 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:49.770 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5055,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2600411689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2600411689},{"type":"v1","addr":"172.21.15.63:6833","nonce":2600411689}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:27:31.884487+0000","modified":"2020-05-18T21:27:32.888860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5064},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5064":{"gid":5064,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1028402057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1028402057},{"type":"v1","addr":"172.21.15.155:6835","nonce":1028402057}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-05-18T21:27:49.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.765+0000 7ff701858700 1 -- 172.21.15.63:0/575536702 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff6e004f8f0 msgr2=0x7ff6e0051db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:49.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.765+0000 7ff701858700 1 --2- 172.21.15.63:0/575536702 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff6e004f8f0 0x7ff6e0051db0 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7ff6e4001110 tx=0x7ff6e40013e0).stop 2020-05-18T21:27:49.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.765+0000 7ff701858700 1 -- 172.21.15.63:0/575536702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6fc05f110 msgr2=0x7ff6fc158520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:49.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.765+0000 7ff701858700 1 --2- 172.21.15.63:0/575536702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6fc05f110 0x7ff6fc158520 secure :-1 s=READY pgs=405 cs=0 l=1 rx=0x7ff6fc063c70 tx=0x7ff6fc0640f0).stop 2020-05-18T21:27:49.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.765+0000 7ff701858700 1 -- 172.21.15.63:0/575536702 shutdown_connections 2020-05-18T21:27:49.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.765+0000 7ff701858700 1 --2- 172.21.15.63:0/575536702 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff6e004f8f0 0x7ff6e0051db0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:49.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.765+0000 7ff701858700 1 --2- 172.21.15.63:0/575536702 >> v2:172.21.15.155:3300/0 conn(0x7ff6fc064fd0 0x7ff6fc157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:49.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.765+0000 7ff701858700 1 --2- 172.21.15.63:0/575536702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6fc05f110 0x7ff6fc158520 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:49.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.765+0000 7ff701858700 1 -- 172.21.15.63:0/575536702 >> 172.21.15.63:0/575536702 conn(0x7ff6fc069fc0 msgr2=0x7ff6fc064850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:49.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.765+0000 7ff701858700 1 -- 172.21.15.63:0/575536702 shutdown_connections 2020-05-18T21:27:49.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:49.765+0000 7ff701858700 1 -- 172.21.15.63:0/575536702 wait complete. 2020-05-18T21:27:49.773 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 12 2020-05-18T21:27:49.782 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump mds_cache strays_enqueued 2020-05-18T21:27:49.883 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:27:49.884 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:27:49.884 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 763 2020-05-18T21:27:49.884 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:27:49.884 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:27:49.892 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_enqueued": 763 } } 2020-05-18T21:27:49.893 DEBUG:tasks.ceph_test_case:wait_until_equal: 763 != 1001, waiting (timeout=600)... 2020-05-18T21:27:54.894 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:27:55.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa41d11c700 1 Processor -- start 2020-05-18T21:27:55.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa41d11c700 1 -- start start 2020-05-18T21:27:55.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa41d11c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa41805f110 0x7fa4180b2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:55.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa41d11c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4180b8650 con 0x7fa4180b81b0 2020-05-18T21:27:55.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa41d11c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4180b88f0 con 0x7fa418145d50 2020-05-18T21:27:55.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa41d11c700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4180b8b90 con 0x7fa41805f110 2020-05-18T21:27:55.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa4177fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa4180b81b0 0x7fa41812ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56632/0 (socket says 172.21.15.63:56632) 2020-05-18T21:27:55.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa4177fe700 1 -- 172.21.15.63:0/216613666 learned_addr learned my addr 172.21.15.63:0/216613666 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:55.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa417fff700 1 --2- 172.21.15.63:0/216613666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa41805f110 0x7fa4180b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa416ffd700 1 -- 172.21.15.63:0/216613666 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578390720 0 0) 0x7fa4180b8650 con 0x7fa4180b81b0 2020-05-18T21:27:55.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa416ffd700 1 -- 172.21.15.63:0/216613666 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3f8003270 con 0x7fa4180b81b0 2020-05-18T21:27:55.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa416ffd700 1 -- 172.21.15.63:0/216613666 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534662157 0 0) 0x7fa4180b88f0 con 0x7fa418145d50 2020-05-18T21:27:55.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa416ffd700 1 -- 172.21.15.63:0/216613666 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4180b8650 con 0x7fa418145d50 2020-05-18T21:27:55.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa416ffd700 1 -- 172.21.15.63:0/216613666 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1328164119 0 0) 0x7fa3f8003270 con 0x7fa4180b81b0 2020-05-18T21:27:55.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa416ffd700 1 -- 172.21.15.63:0/216613666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa41805f110 msgr2=0x7fa4180b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:55.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa416ffd700 1 --2- 172.21.15.63:0/216613666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa41805f110 0x7fa4180b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:55.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa416ffd700 1 -- 172.21.15.63:0/216613666 >> v1:172.21.15.155:6789/0 conn(0x7fa418145d50 legacy=0x7fa418146200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa416ffd700 1 -- 172.21.15.63:0/216613666 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4180b9030 con 0x7fa4180b81b0 2020-05-18T21:27:55.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa416ffd700 1 -- 172.21.15.63:0/216613666 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fa400001710 con 0x7fa4180b81b0 2020-05-18T21:27:55.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa416ffd700 1 -- 172.21.15.63:0/216613666 >> v1:172.21.15.63:6789/0 conn(0x7fa4180b81b0 legacy=0x7fa41812ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa416ffd700 1 --2- 172.21.15.63:0/216613666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3f8003920 0x7fa3f8003d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:55.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa416ffd700 1 --2- 172.21.15.63:0/216613666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa41805f110 0x7fa3f8004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:55.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa416ffd700 1 --2- 172.21.15.63:0/216613666 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3f8004970 0x7fa3f8004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:55.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa416ffd700 1 -- 172.21.15.63:0/216613666 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4180b8b90 con 0x7fa3f8004970 2020-05-18T21:27:55.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa416ffd700 1 -- 172.21.15.63:0/216613666 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f8005250 con 0x7fa3f8003920 2020-05-18T21:27:55.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa416ffd700 1 -- 172.21.15.63:0/216613666 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f800b760 con 0x7fa41805f110 2020-05-18T21:27:55.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa41c91b700 1 --2- 172.21.15.63:0/216613666 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3f8004970 0x7fa3f8004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa4177fe700 1 --2- 172.21.15.63:0/216613666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa41805f110 0x7fa3f8004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.001+0000 7fa417fff700 1 --2- 172.21.15.63:0/216613666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3f8003920 0x7fa3f8003d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41c91b700 1 -- 172.21.15.63:0/216613666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa41805f110 msgr2=0x7fa3f8004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:55.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41c91b700 1 --2- 172.21.15.63:0/216613666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa41805f110 0x7fa3f8004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:55.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41c91b700 1 -- 172.21.15.63:0/216613666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3f8003920 msgr2=0x7fa3f8003d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:55.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41c91b700 1 --2- 172.21.15.63:0/216613666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3f8003920 0x7fa3f8003d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:55.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41c91b700 1 -- 172.21.15.63:0/216613666 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f8003270 con 0x7fa3f8004970 2020-05-18T21:27:55.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41c91b700 1 --2- 172.21.15.63:0/216613666 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3f8004970 0x7fa3f8004df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa410001490 tx=0x7fa410010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41c91b700 1 --2- 172.21.15.63:0/216613666 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3f8004970 0x7fa3f8004df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa410001490 tx=0x7fa410010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41c91b700 1 --2- 172.21.15.63:0/216613666 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3f8004970 0x7fa3f8004df0 secure :-1 s=READY pgs=407 cs=0 l=1 rx=0x7fa410001490 tx=0x7fa410010210).ready entity=mon.0 client_cookie=495dd833bac42b3d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:55.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41c91b700 1 --2- 172.21.15.63:0/216613666 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3f8004970 0x7fa3f8004df0 secure :-1 s=THROTTLE_DONE pgs=407 cs=0 l=1 rx=0x7fa410001490 tx=0x7fa410010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa416ffd700 1 -- 172.21.15.63:0/216613666 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa410010ea0 con 0x7fa3f8004970 2020-05-18T21:27:55.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41c91b700 1 --2- 172.21.15.63:0/216613666 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3f8004970 0x7fa3f8004df0 secure :-1 s=THROTTLE_DONE pgs=407 cs=0 l=1 rx=0x7fa410001490 tx=0x7fa410010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa416ffd700 1 -- 172.21.15.63:0/216613666 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4100068a0 con 0x7fa3f8004970 2020-05-18T21:27:55.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41c91b700 1 --2- 172.21.15.63:0/216613666 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3f8004970 0x7fa3f8004df0 secure :-1 s=THROTTLE_DONE pgs=407 cs=0 l=1 rx=0x7fa410001490 tx=0x7fa410010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa416ffd700 1 -- 172.21.15.63:0/216613666 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa410006cc0 con 0x7fa3f8004970 2020-05-18T21:27:55.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41d11c700 1 -- 172.21.15.63:0/216613666 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3f8004970 msgr2=0x7fa3f8004df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41d11c700 1 --2- 172.21.15.63:0/216613666 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3f8004970 0x7fa3f8004df0 secure :-1 s=READY pgs=407 cs=0 l=1 rx=0x7fa410001490 tx=0x7fa410010210).stop 2020-05-18T21:27:55.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41c91b700 1 -- 172.21.15.63:0/216613666 reap_dead start 2020-05-18T21:27:55.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41d11c700 1 -- 172.21.15.63:0/216613666 shutdown_connections 2020-05-18T21:27:55.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41d11c700 1 -- 172.21.15.63:0/216613666 >> 172.21.15.63:0/216613666 conn(0x7fa418069fc0 msgr2=0x7fa41806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:55.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41d11c700 1 -- 172.21.15.63:0/216613666 shutdown_connections 2020-05-18T21:27:55.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41d11c700 1 -- 172.21.15.63:0/216613666 wait complete. 2020-05-18T21:27:55.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41d11c700 1 Processor -- start 2020-05-18T21:27:55.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.005+0000 7fa41d11c700 1 -- start start 2020-05-18T21:27:55.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa41d11c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa4180652a0 0x7fa418156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:55.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa41d11c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa418157530 con 0x7fa4181569b0 2020-05-18T21:27:55.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa41d11c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa418153fe0 con 0x7fa418062120 2020-05-18T21:27:55.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa41d11c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa418064f80 con 0x7fa4180652a0 2020-05-18T21:27:55.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa4177fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa4180652a0 0x7fa418156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa417fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa4181569b0 0x7fa4181538d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56644/0 (socket says 172.21.15.63:56644) 2020-05-18T21:27:55.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa417fff700 1 -- 172.21.15.63:0/2864150681 learned_addr learned my addr 172.21.15.63:0/2864150681 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:55.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa4177fe700 1 -- 172.21.15.63:0/2864150681 >> v1:172.21.15.155:6789/0 conn(0x7fa418062120 legacy=0x7fa418131fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa4177fe700 1 -- 172.21.15.63:0/2864150681 >> v1:172.21.15.63:6789/0 conn(0x7fa4181569b0 legacy=0x7fa4181538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa4157fa700 1 -- 172.21.15.63:0/2864150681 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722968640 0 0) 0x7fa418157530 con 0x7fa4181569b0 2020-05-18T21:27:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa4177fe700 1 -- 172.21.15.63:0/2864150681 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa418153190 con 0x7fa4180652a0 2020-05-18T21:27:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa4177fe700 1 --2- 172.21.15.63:0/2864150681 >> v2:172.21.15.63:3300/0 conn(0x7fa4180652a0 0x7fa418156d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4000014e0 tx=0x7fa4180b3840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa4177fe700 1 --2- 172.21.15.63:0/2864150681 >> v2:172.21.15.63:3300/0 conn(0x7fa4180652a0 0x7fa418156d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4000014e0 tx=0x7fa4180b3840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa4177fe700 1 --2- 172.21.15.63:0/2864150681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4180652a0 0x7fa418156d90 secure :-1 s=READY pgs=409 cs=0 l=1 rx=0x7fa4000014e0 tx=0x7fa4180b3840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:55.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa4177fe700 1 --2- 172.21.15.63:0/2864150681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4180652a0 0x7fa418156d90 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fa4000014e0 tx=0x7fa4180b3840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa4157fa700 1 -- 172.21.15.63:0/2864150681 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa400011c30 con 0x7fa4180652a0 2020-05-18T21:27:55.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa4177fe700 1 --2- 172.21.15.63:0/2864150681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4180652a0 0x7fa418156d90 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fa4000014e0 tx=0x7fa4180b3840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa4177fe700 1 --2- 172.21.15.63:0/2864150681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4180652a0 0x7fa418156d90 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fa4000014e0 tx=0x7fa4180b3840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa4157fa700 1 -- 172.21.15.63:0/2864150681 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa400011d90 con 0x7fa4180652a0 2020-05-18T21:27:55.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa4157fa700 1 -- 172.21.15.63:0/2864150681 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa40000c930 con 0x7fa4180652a0 2020-05-18T21:27:55.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa41d11c700 1 -- 172.21.15.63:0/2864150681 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa418153430 con 0x7fa4180652a0 2020-05-18T21:27:55.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa41d11c700 1 -- 172.21.15.63:0/2864150681 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4181326e0 con 0x7fa4180652a0 2020-05-18T21:27:55.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.009+0000 7fa4177fe700 1 --2- 172.21.15.63:0/2864150681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4180652a0 0x7fa418156d90 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fa4000014e0 tx=0x7fa4180b3840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.013+0000 7fa4157fa700 1 -- 172.21.15.63:0/2864150681 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa40000cba0 con 0x7fa4180652a0 2020-05-18T21:27:55.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.013+0000 7fa4177fe700 1 --2- 172.21.15.63:0/2864150681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4180652a0 0x7fa418156d90 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fa4000014e0 tx=0x7fa4180b3840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.013+0000 7fa41d11c700 1 -- 172.21.15.63:0/2864150681 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa418152fe0 con 0x7fa4180652a0 2020-05-18T21:27:55.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.013+0000 7fa4157fa700 1 --2- 172.21.15.63:0/2864150681 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa3fc04f7d0 0x7fa3fc051c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:55.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.013+0000 7fa4157fa700 1 -- 172.21.15.63:0/2864150681 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa400063880 con 0x7fa4180652a0 2020-05-18T21:27:55.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.013+0000 7fa417fff700 1 --2- 172.21.15.63:0/2864150681 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa3fc04f7d0 0x7fa3fc051c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.013+0000 7fa417fff700 1 --2- 172.21.15.63:0/2864150681 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa3fc04f7d0 0x7fa3fc051c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa408002f10 tx=0x7fa408008280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.013+0000 7fa417fff700 1 --2- 172.21.15.63:0/2864150681 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa3fc04f7d0 0x7fa3fc051c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa408002f10 tx=0x7fa408008280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.013+0000 7fa417fff700 1 --2- 172.21.15.63:0/2864150681 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa3fc04f7d0 0x7fa3fc051c90 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7fa408002f10 tx=0x7fa408008280).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:55.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.017+0000 7fa4177fe700 1 --2- 172.21.15.63:0/2864150681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4180652a0 0x7fa418156d90 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fa4000014e0 tx=0x7fa4180b3840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.017+0000 7fa4157fa700 1 -- 172.21.15.63:0/2864150681 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa40003dc10 con 0x7fa4180652a0 2020-05-18T21:27:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.161+0000 7fa41d11c700 1 -- 172.21.15.63:0/2864150681 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4180569e0 con 0x7fa4180652a0 2020-05-18T21:27:55.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.165+0000 7fa4177fe700 1 --2- 172.21.15.63:0/2864150681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4180652a0 0x7fa418156d90 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fa4000014e0 tx=0x7fa4180b3840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.165+0000 7fa4157fa700 1 -- 172.21.15.63:0/2864150681 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2141 (secure 0 0 0) 0x7fa400041230 con 0x7fa4180652a0 2020-05-18T21:27:55.170 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:55.171 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5055,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2600411689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2600411689},{"type":"v1","addr":"172.21.15.63:6833","nonce":2600411689}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:27:31.884487+0000","modified":"2020-05-18T21:27:32.888860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5064},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5064":{"gid":5064,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1028402057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1028402057},{"type":"v1","addr":"172.21.15.155:6835","nonce":1028402057}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-05-18T21:27:55.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.165+0000 7fa41d11c700 1 -- 172.21.15.63:0/2864150681 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa3fc04f7d0 msgr2=0x7fa3fc051c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.165+0000 7fa41d11c700 1 --2- 172.21.15.63:0/2864150681 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa3fc04f7d0 0x7fa3fc051c90 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7fa408002f10 tx=0x7fa408008280).stop 2020-05-18T21:27:55.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.165+0000 7fa41d11c700 1 -- 172.21.15.63:0/2864150681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4180652a0 msgr2=0x7fa418156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.165+0000 7fa41d11c700 1 --2- 172.21.15.63:0/2864150681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4180652a0 0x7fa418156d90 secure :-1 s=READY pgs=409 cs=0 l=1 rx=0x7fa4000014e0 tx=0x7fa4180b3840).stop 2020-05-18T21:27:55.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.165+0000 7fa41d11c700 1 -- 172.21.15.63:0/2864150681 shutdown_connections 2020-05-18T21:27:55.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.165+0000 7fa41d11c700 1 --2- 172.21.15.63:0/2864150681 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa3fc04f7d0 0x7fa3fc051c90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:55.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.165+0000 7fa41d11c700 1 --2- 172.21.15.63:0/2864150681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4180652a0 0x7fa418156d90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:55.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.165+0000 7fa41d11c700 1 -- 172.21.15.63:0/2864150681 >> 172.21.15.63:0/2864150681 conn(0x7fa418069fc0 msgr2=0x7fa4180b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:55.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.165+0000 7fa41d11c700 1 -- 172.21.15.63:0/2864150681 shutdown_connections 2020-05-18T21:27:55.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.165+0000 7fa41d11c700 1 -- 172.21.15.63:0/2864150681 wait complete. 2020-05-18T21:27:55.174 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 12 2020-05-18T21:27:55.183 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump mds_cache strays_enqueued 2020-05-18T21:27:55.287 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:27:55.287 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:27:55.287 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 1001 2020-05-18T21:27:55.288 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:27:55.288 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:27:55.296 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_enqueued": 1001 } } 2020-05-18T21:27:55.296 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:27:55.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.397+0000 7fd3a7fff700 1 Processor -- start 2020-05-18T21:27:55.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.397+0000 7fd3a7fff700 1 -- start start 2020-05-18T21:27:55.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.397+0000 7fd3a7fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3a805f110 0x7fd3a80b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:55.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.397+0000 7fd3a7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd3a814aa70 0x7fd3a80648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:55.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.397+0000 7fd3a7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd3a8064d20 0x7fd3a814d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:55.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.397+0000 7fd3a7fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a814a140 con 0x7fd3a8064d20 2020-05-18T21:27:55.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.397+0000 7fd3a7fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a814a330 con 0x7fd3a814aa70 2020-05-18T21:27:55.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.397+0000 7fd3a7fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a814a5d0 con 0x7fd3a805f110 2020-05-18T21:27:55.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd3a8064d20 0x7fd3a814d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd3a8064d20 0x7fd3a814d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54466/0 (socket says 172.21.15.63:54466) 2020-05-18T21:27:55.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a77fe700 1 -- 172.21.15.63:0/3880974124 learned_addr learned my addr 172.21.15.63:0/3880974124 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:55.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a67fc700 1 --2- 172.21.15.63:0/3880974124 >> v2:172.21.15.155:3300/0 conn(0x7fd3a814aa70 0x7fd3a80648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a6ffd700 1 --2- 172.21.15.63:0/3880974124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3a805f110 0x7fd3a80b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a77fe700 1 -- 172.21.15.63:0/3880974124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3a805f110 msgr2=0x7fd3a80b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:55.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a77fe700 1 --2- 172.21.15.63:0/3880974124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3a805f110 0x7fd3a80b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:55.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a77fe700 1 -- 172.21.15.63:0/3880974124 >> v2:172.21.15.155:3300/0 conn(0x7fd3a814aa70 msgr2=0x7fd3a80648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:55.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a77fe700 1 --2- 172.21.15.63:0/3880974124 >> v2:172.21.15.155:3300/0 conn(0x7fd3a814aa70 0x7fd3a80648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:55.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a77fe700 1 -- 172.21.15.63:0/3880974124 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a8063430 con 0x7fd3a8064d20 2020-05-18T21:27:55.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a67fc700 1 --2- 172.21.15.63:0/3880974124 >> v2:172.21.15.155:3300/0 conn(0x7fd3a814aa70 0x7fd3a80648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:27:55.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a77fe700 1 --2- 172.21.15.63:0/3880974124 >> v2:172.21.15.63:3300/0 conn(0x7fd3a8064d20 0x7fd3a814d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd3a8063c70 tx=0x7fd398007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a77fe700 1 --2- 172.21.15.63:0/3880974124 >> v2:172.21.15.63:3300/0 conn(0x7fd3a8064d20 0x7fd3a814d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd3a8063c70 tx=0x7fd398007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a77fe700 1 --2- 172.21.15.63:0/3880974124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3a8064d20 0x7fd3a814d710 secure :-1 s=READY pgs=410 cs=0 l=1 rx=0x7fd3a8063c70 tx=0x7fd398007a80).ready entity=mon.0 client_cookie=caf2c7ff6688ef05 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:55.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a77fe700 1 --2- 172.21.15.63:0/3880974124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3a8064d20 0x7fd3a814d710 secure :-1 s=THROTTLE_DONE pgs=410 cs=0 l=1 rx=0x7fd3a8063c70 tx=0x7fd398007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a77fe700 1 --2- 172.21.15.63:0/3880974124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3a8064d20 0x7fd3a814d710 secure :-1 s=THROTTLE_DONE pgs=410 cs=0 l=1 rx=0x7fd3a8063c70 tx=0x7fd398007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a5ffb700 1 -- 172.21.15.63:0/3880974124 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd398011720 con 0x7fd3a8064d20 2020-05-18T21:27:55.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a77fe700 1 --2- 172.21.15.63:0/3880974124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3a8064d20 0x7fd3a814d710 secure :-1 s=THROTTLE_DONE pgs=410 cs=0 l=1 rx=0x7fd3a8063c70 tx=0x7fd398007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a5ffb700 1 -- 172.21.15.63:0/3880974124 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd398011880 con 0x7fd3a8064d20 2020-05-18T21:27:55.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a7fff700 1 -- 172.21.15.63:0/3880974124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3a8064d20 msgr2=0x7fd3a814d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a5ffb700 1 -- 172.21.15.63:0/3880974124 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd398011ca0 con 0x7fd3a8064d20 2020-05-18T21:27:55.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a7fff700 1 --2- 172.21.15.63:0/3880974124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3a8064d20 0x7fd3a814d710 secure :-1 s=READY pgs=410 cs=0 l=1 rx=0x7fd3a8063c70 tx=0x7fd398007a80).stop 2020-05-18T21:27:55.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a7fff700 1 -- 172.21.15.63:0/3880974124 shutdown_connections 2020-05-18T21:27:55.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a7fff700 1 --2- 172.21.15.63:0/3880974124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3a8064d20 0x7fd3a814d710 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:55.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a7fff700 1 --2- 172.21.15.63:0/3880974124 >> v2:172.21.15.155:3300/0 conn(0x7fd3a814aa70 0x7fd3a80648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:55.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a7fff700 1 --2- 172.21.15.63:0/3880974124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3a805f110 0x7fd3a80b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:55.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a7fff700 1 -- 172.21.15.63:0/3880974124 >> 172.21.15.63:0/3880974124 conn(0x7fd3a8069fc0 msgr2=0x7fd3a806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:55.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a7fff700 1 -- 172.21.15.63:0/3880974124 shutdown_connections 2020-05-18T21:27:55.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.401+0000 7fd3a7fff700 1 -- 172.21.15.63:0/3880974124 wait complete. 2020-05-18T21:27:55.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.405+0000 7fd3a7fff700 1 Processor -- start 2020-05-18T21:27:55.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.405+0000 7fd3a7fff700 1 -- start start 2020-05-18T21:27:55.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.405+0000 7fd3a7fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3a805f110 0x7fd3a81580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:55.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.405+0000 7fd3a7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd3a814aa70 0x7fd3a8144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:55.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.405+0000 7fd3a7fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a81576c0 con 0x7fd3a8064d20 2020-05-18T21:27:55.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.405+0000 7fd3a7fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a81574d0 con 0x7fd3a814aa70 2020-05-18T21:27:55.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.405+0000 7fd3a7fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a8158500 con 0x7fd3a805f110 2020-05-18T21:27:55.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.405+0000 7fd3a77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd3a814aa70 0x7fd3a8144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.405+0000 7fd3a67fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd3a8064d20 0x7fd3a814c1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56660/0 (socket says 172.21.15.63:56660) 2020-05-18T21:27:55.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.405+0000 7fd3a67fc700 1 -- 172.21.15.63:0/2279611891 learned_addr learned my addr 172.21.15.63:0/2279611891 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:55.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.405+0000 7fd3a6ffd700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3a805f110 0x7fd3a81580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd3a77fe700 1 -- 172.21.15.63:0/2279611891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3a805f110 msgr2=0x7fd3a81580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd3a77fe700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3a805f110 0x7fd3a81580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:55.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd3a77fe700 1 -- 172.21.15.63:0/2279611891 >> v1:172.21.15.63:6789/0 conn(0x7fd3a8064d20 legacy=0x7fd3a814c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd3a77fe700 1 -- 172.21.15.63:0/2279611891 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a8157960 con 0x7fd3a814aa70 2020-05-18T21:27:55.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd39ffff700 1 -- 172.21.15.63:0/2279611891 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985584140 0 0) 0x7fd3a81576c0 con 0x7fd3a8064d20 2020-05-18T21:27:55.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd3a77fe700 1 --2- 172.21.15.63:0/2279611891 >> v2:172.21.15.63:3300/0 conn(0x7fd3a814aa70 0x7fd3a8144790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3a8142440 tx=0x7fd398007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd3a77fe700 1 --2- 172.21.15.63:0/2279611891 >> v2:172.21.15.63:3300/0 conn(0x7fd3a814aa70 0x7fd3a8144790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3a8142440 tx=0x7fd398007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd3a77fe700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3a814aa70 0x7fd3a8144790 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7fd3a8142440 tx=0x7fd398007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:55.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd3a77fe700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3a814aa70 0x7fd3a8144790 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7fd3a8142440 tx=0x7fd398007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd3a77fe700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3a814aa70 0x7fd3a8144790 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7fd3a8142440 tx=0x7fd398007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd39ffff700 1 -- 172.21.15.63:0/2279611891 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd39800f960 con 0x7fd3a814aa70 2020-05-18T21:27:55.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd3a77fe700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3a814aa70 0x7fd3a8144790 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7fd3a8142440 tx=0x7fd398007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd39ffff700 1 -- 172.21.15.63:0/2279611891 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd398011d20 con 0x7fd3a814aa70 2020-05-18T21:27:55.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd3a7fff700 1 -- 172.21.15.63:0/2279611891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a8157c00 con 0x7fd3a814aa70 2020-05-18T21:27:55.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd39ffff700 1 -- 172.21.15.63:0/2279611891 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd398005ae0 con 0x7fd3a814aa70 2020-05-18T21:27:55.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd3a7fff700 1 -- 172.21.15.63:0/2279611891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a8144bf0 con 0x7fd3a814aa70 2020-05-18T21:27:55.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd3a77fe700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3a814aa70 0x7fd3a8144790 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7fd3a8142440 tx=0x7fd398007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd3a7fff700 1 -- 172.21.15.63:0/2279611891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a8157e00 con 0x7fd3a814aa70 2020-05-18T21:27:55.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd39ffff700 1 -- 172.21.15.63:0/2279611891 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd398005d50 con 0x7fd3a814aa70 2020-05-18T21:27:55.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd3a77fe700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3a814aa70 0x7fd3a8144790 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7fd3a8142440 tx=0x7fd398007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd39ffff700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd38c04f970 0x7fd38c051e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:55.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd39ffff700 1 -- 172.21.15.63:0/2279611891 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd398064440 con 0x7fd3a814aa70 2020-05-18T21:27:55.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.409+0000 7fd3a6ffd700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd38c04f970 0x7fd38c051e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.413+0000 7fd3a6ffd700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd38c04f970 0x7fd38c051e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3a00032f0 tx=0x7fd3a000dad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.413+0000 7fd3a6ffd700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd38c04f970 0x7fd38c051e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3a00032f0 tx=0x7fd3a000dad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.413+0000 7fd3a6ffd700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd38c04f970 0x7fd38c051e30 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7fd3a00032f0 tx=0x7fd3a000dad0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:55.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.417+0000 7fd3a77fe700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3a814aa70 0x7fd3a8144790 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7fd3a8142440 tx=0x7fd398007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.417+0000 7fd39ffff700 1 -- 172.21.15.63:0/2279611891 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd3a8157e00 con 0x7fd3a814aa70 2020-05-18T21:27:55.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.565+0000 7fd3a7fff700 1 -- 172.21.15.63:0/2279611891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3a8157e00 con 0x7fd3a814aa70 2020-05-18T21:27:55.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.565+0000 7fd3a77fe700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3a814aa70 0x7fd3a8144790 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7fd3a8142440 tx=0x7fd398007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.565+0000 7fd39ffff700 1 -- 172.21.15.63:0/2279611891 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2141 (secure 0 0 0) 0x7fd3a8157e00 con 0x7fd3a814aa70 2020-05-18T21:27:55.572 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:55.572 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5055,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2600411689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2600411689},{"type":"v1","addr":"172.21.15.63:6833","nonce":2600411689}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:27:31.884487+0000","modified":"2020-05-18T21:27:32.888860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5064},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5064":{"gid":5064,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1028402057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1028402057},{"type":"v1","addr":"172.21.15.155:6835","nonce":1028402057}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-05-18T21:27:55.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.565+0000 7fd3a7fff700 1 -- 172.21.15.63:0/2279611891 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd38c04f970 msgr2=0x7fd38c051e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.565+0000 7fd3a7fff700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd38c04f970 0x7fd38c051e30 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7fd3a00032f0 tx=0x7fd3a000dad0).stop 2020-05-18T21:27:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.565+0000 7fd3a7fff700 1 -- 172.21.15.63:0/2279611891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3a814aa70 msgr2=0x7fd3a8144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.565+0000 7fd3a7fff700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3a814aa70 0x7fd3a8144790 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7fd3a8142440 tx=0x7fd398007a80).stop 2020-05-18T21:27:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.565+0000 7fd3a7fff700 1 -- 172.21.15.63:0/2279611891 shutdown_connections 2020-05-18T21:27:55.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.565+0000 7fd3a7fff700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd38c04f970 0x7fd38c051e30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:55.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.565+0000 7fd3a7fff700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3a814aa70 0x7fd3a8144790 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:55.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.565+0000 7fd3a7fff700 1 --2- 172.21.15.63:0/2279611891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3a805f110 0x7fd3a81580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:55.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.565+0000 7fd3a7fff700 1 -- 172.21.15.63:0/2279611891 >> 172.21.15.63:0/2279611891 conn(0x7fd3a8069fc0 msgr2=0x7fd3a8060420 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:55.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.565+0000 7fd3a7fff700 1 -- 172.21.15.63:0/2279611891 shutdown_connections 2020-05-18T21:27:55.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.565+0000 7fd3a7fff700 1 -- 172.21.15.63:0/2279611891 wait complete. 2020-05-18T21:27:55.576 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 12 2020-05-18T21:27:55.584 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump purge_queue pq_executed 2020-05-18T21:27:55.693 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:27:55.694 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2020-05-18T21:27:55.694 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 1001 2020-05-18T21:27:55.694 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:27:55.694 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:27:55.702 INFO:tasks.cephfs.filesystem:_json_asok output: { "purge_queue": { "pq_executed": 1001 } } 2020-05-18T21:27:55.702 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_metadata stat 10000000000.00000000 2020-05-18T21:27:55.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.729+0000 7f646d376b80 1 Processor -- start 2020-05-18T21:27:55.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.729+0000 7f646d376b80 1 -- start start 2020-05-18T21:27:55.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.729+0000 7f646d376b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f8421f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:55.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.729+0000 7f646d376b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x5636f8415e70 0x5636f841cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:55.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.729+0000 7f646d376b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x5636f82f3d20 con 0x5636f838fe10 2020-05-18T21:27:55.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.729+0000 7f646d376b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x5636f82cba40 con 0x5636f8415e70 2020-05-18T21:27:55.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.729+0000 7f646d376b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636f8415700 con 0x5636f838f570 2020-05-18T21:27:55.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.729+0000 7f6463fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x5636f838fe10 0x5636f8371260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56674/0 (socket says 172.21.15.63:56674) 2020-05-18T21:27:55.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.729+0000 7f6463fff700 1 -- 172.21.15.63:0/940975530 learned_addr learned my addr 172.21.15.63:0/940975530 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:55.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.729+0000 7f646bfba700 1 --2- 172.21.15.63:0/940975530 >> v2:172.21.15.155:3300/0 conn(0x5636f8415e70 0x5636f841cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.729+0000 7f646b7b9700 1 --2- 172.21.15.63:0/940975530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f8421f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.729+0000 7f6469fb6700 1 -- 172.21.15.63:0/940975530 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392757935 0 0) 0x5636f82f3d20 con 0x5636f838fe10 2020-05-18T21:27:55.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.729+0000 7f6469fb6700 1 -- 172.21.15.63:0/940975530 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f644c002020 con 0x5636f838fe10 2020-05-18T21:27:55.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.729+0000 7f646b7b9700 1 -- 172.21.15.63:0/940975530 >> v2:172.21.15.155:3300/0 conn(0x5636f8415e70 msgr2=0x5636f841cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:55.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.729+0000 7f646b7b9700 1 --2- 172.21.15.63:0/940975530 >> v2:172.21.15.155:3300/0 conn(0x5636f8415e70 0x5636f841cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:55.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.729+0000 7f646b7b9700 1 -- 172.21.15.63:0/940975530 >> v1:172.21.15.63:6789/0 conn(0x5636f838fe10 legacy=0x5636f8371260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.729+0000 7f646b7b9700 1 -- 172.21.15.63:0/940975530 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636f82ef4b0 con 0x5636f838f570 2020-05-18T21:27:55.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.729+0000 7f646b7b9700 1 --2- 172.21.15.63:0/940975530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f8421f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f645c002f70 tx=0x7f645c00aa70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646b7b9700 1 --2- 172.21.15.63:0/940975530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f8421f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f645c002f70 tx=0x7f645c00aa70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646b7b9700 1 --2- 172.21.15.63:0/940975530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f8421f20 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f645c002f70 tx=0x7f645c00aa70).ready entity=mon.2 client_cookie=5d5e25632a5a1fa2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:55.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646b7b9700 1 --2- 172.21.15.63:0/940975530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f8421f20 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f645c002f70 tx=0x7f645c00aa70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646b7b9700 1 --2- 172.21.15.63:0/940975530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f8421f20 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f645c002f70 tx=0x7f645c00aa70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f6469fb6700 1 -- 172.21.15.63:0/940975530 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f645c004980 con 0x5636f838f570 2020-05-18T21:27:55.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646b7b9700 1 --2- 172.21.15.63:0/940975530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f8421f20 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f645c002f70 tx=0x7f645c00aa70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f6469fb6700 1 -- 172.21.15.63:0/940975530 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c004ae0 con 0x5636f838f570 2020-05-18T21:27:55.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646d376b80 1 -- 172.21.15.63:0/940975530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 msgr2=0x5636f8421f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f6469fb6700 1 -- 172.21.15.63:0/940975530 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f645c010240 con 0x5636f838f570 2020-05-18T21:27:55.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646d376b80 1 --2- 172.21.15.63:0/940975530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f8421f20 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f645c002f70 tx=0x7f645c00aa70).stop 2020-05-18T21:27:55.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646d376b80 1 -- 172.21.15.63:0/940975530 shutdown_connections 2020-05-18T21:27:55.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646d376b80 1 --2- 172.21.15.63:0/940975530 >> v2:172.21.15.155:3300/0 conn(0x5636f8415e70 0x5636f841cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:55.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646d376b80 1 --2- 172.21.15.63:0/940975530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f8421f20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:55.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646d376b80 1 -- 172.21.15.63:0/940975530 >> 172.21.15.63:0/940975530 conn(0x5636f8390640 msgr2=0x5636f83399c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:55.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646d376b80 1 -- 172.21.15.63:0/940975530 shutdown_connections 2020-05-18T21:27:55.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646d376b80 1 -- 172.21.15.63:0/940975530 wait complete. 2020-05-18T21:27:55.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646d376b80 1 Processor -- start 2020-05-18T21:27:55.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646d376b80 1 -- start start 2020-05-18T21:27:55.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646d376b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f838d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:55.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646d376b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x5636f838fe10 0x5636f8421690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:55.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646d376b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x5636f82cf460 con 0x5636f8415e70 2020-05-18T21:27:55.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646d376b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x5636f838db00 con 0x5636f838fe10 2020-05-18T21:27:55.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646d376b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636f838dda0 con 0x5636f838f570 2020-05-18T21:27:55.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f6463fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x5636f838fe10 0x5636f8421690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f6463fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x5636f838fe10 0x5636f8421690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54490/0 (socket says 172.21.15.63:54490) 2020-05-18T21:27:55.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646bfba700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x5636f8415e70 0x5636f8371410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56682/0 (socket says 172.21.15.63:56682) 2020-05-18T21:27:55.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f6463fff700 1 -- 172.21.15.63:0/3699779875 learned_addr learned my addr 172.21.15.63:0/3699779875 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:55.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.733+0000 7f646b7b9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f838d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.737+0000 7f64697b5700 1 -- 172.21.15.63:0/3699779875 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2571138818 0 0) 0x5636f82cf460 con 0x5636f8415e70 2020-05-18T21:27:55.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.737+0000 7f646b7b9700 1 -- 172.21.15.63:0/3699779875 >> v2:172.21.15.63:3300/0 conn(0x5636f838fe10 msgr2=0x5636f8421690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.737+0000 7f646b7b9700 1 --2- 172.21.15.63:0/3699779875 >> v2:172.21.15.63:3300/0 conn(0x5636f838fe10 0x5636f8421690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:55.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.737+0000 7f646b7b9700 1 -- 172.21.15.63:0/3699779875 >> v1:172.21.15.63:6789/0 conn(0x5636f8415e70 legacy=0x5636f8371410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.737+0000 7f646b7b9700 1 -- 172.21.15.63:0/3699779875 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636f842e520 con 0x5636f838f570 2020-05-18T21:27:55.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.737+0000 7f6463fff700 1 --2- 172.21.15.63:0/3699779875 >> v2:172.21.15.63:3300/0 conn(0x5636f838fe10 0x5636f8421690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:55.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.737+0000 7f646b7b9700 1 --2- 172.21.15.63:0/3699779875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f838d460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f645c002f70 tx=0x7f645c00aa70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.737+0000 7f646b7b9700 1 --2- 172.21.15.63:0/3699779875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f838d460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f645c002f70 tx=0x7f645c00aa70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.737+0000 7f646b7b9700 1 --2- 172.21.15.63:0/3699779875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f838d460 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f645c002f70 tx=0x7f645c00aa70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:55.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.737+0000 7f646b7b9700 1 --2- 172.21.15.63:0/3699779875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f838d460 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f645c002f70 tx=0x7f645c00aa70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.737+0000 7f64697b5700 1 -- 172.21.15.63:0/3699779875 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f645c009d30 con 0x5636f838f570 2020-05-18T21:27:55.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.737+0000 7f646b7b9700 1 --2- 172.21.15.63:0/3699779875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f838d460 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f645c002f70 tx=0x7f645c00aa70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.737+0000 7f646b7b9700 1 --2- 172.21.15.63:0/3699779875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f838d460 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f645c002f70 tx=0x7f645c00aa70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.737+0000 7f64697b5700 1 -- 172.21.15.63:0/3699779875 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c010430 con 0x5636f838f570 2020-05-18T21:27:55.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.737+0000 7f646d376b80 1 -- 172.21.15.63:0/3699779875 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5636f842e770 con 0x5636f838f570 2020-05-18T21:27:55.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.737+0000 7f64697b5700 1 -- 172.21.15.63:0/3699779875 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f645c0107d0 con 0x5636f838f570 2020-05-18T21:27:55.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.737+0000 7f646d376b80 1 -- 172.21.15.63:0/3699779875 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5636f8413470 con 0x5636f838f570 2020-05-18T21:27:55.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.737+0000 7f646b7b9700 1 --2- 172.21.15.63:0/3699779875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f838d460 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f645c002f70 tx=0x7f645c00aa70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f64697b5700 1 -- 172.21.15.63:0/3699779875 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f645c010a40 con 0x5636f838f570 2020-05-18T21:27:55.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f646b7b9700 1 --2- 172.21.15.63:0/3699779875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f838d460 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f645c002f70 tx=0x7f645c00aa70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f64697b5700 1 --2- 172.21.15.63:0/3699779875 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f644c04e6d0 0x7f644c050b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:55.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f64697b5700 1 -- 172.21.15.63:0/3699779875 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f645c063d00 con 0x5636f838f570 2020-05-18T21:27:55.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f6463fff700 1 --2- 172.21.15.63:0/3699779875 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f644c04e6d0 0x7f644c050b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f646d376b80 1 --2- 172.21.15.63:0/3699779875 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x5636f842ae10 0x5636f8436c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:55.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f646d376b80 1 -- 172.21.15.63:0/3699779875 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- osd_op(unknown.0.0:1 5.0 5:0cf6ad0f:::10000000000.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected e33) v8 -- 0x5636f842b250 con 0x5636f842ae10 2020-05-18T21:27:55.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f6463fff700 1 --2- 172.21.15.63:0/3699779875 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f644c04e6d0 0x7f644c050b90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6454002f70 tx=0x7f6454006850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f6463fff700 1 --2- 172.21.15.63:0/3699779875 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f644c04e6d0 0x7f644c050b90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6454002f70 tx=0x7f6454006850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f646bfba700 1 --2- 172.21.15.63:0/3699779875 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x5636f842ae10 0x5636f8436c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f6463fff700 1 --2- 172.21.15.63:0/3699779875 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f644c04e6d0 0x7f644c050b90 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7f6454002f70 tx=0x7f6454006850).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:55.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f646bfba700 1 --2- 172.21.15.63:0/3699779875 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x5636f842ae10 0x5636f8436c50 crc :-1 s=READY pgs=11 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:55.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f646bfba700 1 -- 172.21.15.63:0/3699779875 <== osd.3 v2:172.21.15.63:6814/12805 1 ==== osd_op_reply(1 10000000000.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f6464010330 con 0x5636f842ae10 2020-05-18T21:27:55.761 INFO:teuthology.orchestra.run.smithi063.stderr: error stat-ing cephfs_metadata/10000000000.00000000: (2) No such file or directory 2020-05-18T21:27:55.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f646d376b80 1 -- 172.21.15.63:0/3699779875 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x5636f842ae10 msgr2=0x5636f8436c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f646d376b80 1 --2- 172.21.15.63:0/3699779875 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x5636f842ae10 0x5636f8436c50 crc :-1 s=READY pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:55.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f646d376b80 1 -- 172.21.15.63:0/3699779875 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f644c04e6d0 msgr2=0x7f644c050b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f646d376b80 1 --2- 172.21.15.63:0/3699779875 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f644c04e6d0 0x7f644c050b90 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7f6454002f70 tx=0x7f6454006850).stop 2020-05-18T21:27:55.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f646d376b80 1 -- 172.21.15.63:0/3699779875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 msgr2=0x5636f838d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f646d376b80 1 --2- 172.21.15.63:0/3699779875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5636f838f570 0x5636f838d460 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f645c002f70 tx=0x7f645c00aa70).stop 2020-05-18T21:27:55.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f646bfba700 1 -- 172.21.15.63:0/3699779875 reap_dead start 2020-05-18T21:27:55.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f646d376b80 1 -- 172.21.15.63:0/3699779875 shutdown_connections 2020-05-18T21:27:55.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f646d376b80 1 -- 172.21.15.63:0/3699779875 >> 172.21.15.63:0/3699779875 conn(0x5636f8390640 msgr2=0x5636f834f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:55.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f646d376b80 1 -- 172.21.15.63:0/3699779875 shutdown_connections 2020-05-18T21:27:55.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.741+0000 7f646d376b80 1 -- 172.21.15.63:0/3699779875 wait complete. 2020-05-18T21:27:55.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:27:55.765 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early df --format=json-pretty 2020-05-18T21:27:55.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.905+0000 7f2e7c969700 1 Processor -- start 2020-05-18T21:27:55.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.905+0000 7f2e7c969700 1 -- start start 2020-05-18T21:27:55.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.905+0000 7f2e7c969700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2e7805f1e0 0x7f2e780b2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:55.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.905+0000 7f2e7c969700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e7813c870 0x7f2e7813ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:55.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.905+0000 7f2e7c969700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2e78146250 0x7f2e781466e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:55.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.905+0000 7f2e7c969700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7813d130 con 0x7f2e7805f1e0 2020-05-18T21:27:55.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.905+0000 7f2e7c969700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e78143030 con 0x7f2e78146250 2020-05-18T21:27:55.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.905+0000 7f2e7c969700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e781432d0 con 0x7f2e7813c870 2020-05-18T21:27:55.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.905+0000 7f2e7659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2e7805f1e0 0x7f2e780b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.905+0000 7f2e76d9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2e78146250 0x7f2e781466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.905+0000 7f2e7659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2e7805f1e0 0x7f2e780b2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54500/0 (socket says 172.21.15.63:54500) 2020-05-18T21:27:55.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.905+0000 7f2e7659c700 1 -- 172.21.15.63:0/1447503468 learned_addr learned my addr 172.21.15.63:0/1447503468 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:55.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.905+0000 7f2e75d9b700 1 --2- 172.21.15.63:0/1447503468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e7813c870 0x7f2e7813ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.905+0000 7f2e76d9d700 1 -- 172.21.15.63:0/1447503468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e7813c870 msgr2=0x7f2e7813ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:55.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.905+0000 7f2e76d9d700 1 --2- 172.21.15.63:0/1447503468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e7813c870 0x7f2e7813ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:55.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.905+0000 7f2e76d9d700 1 -- 172.21.15.63:0/1447503468 >> v2:172.21.15.63:3300/0 conn(0x7f2e7805f1e0 msgr2=0x7f2e780b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:55.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.905+0000 7f2e76d9d700 1 --2- 172.21.15.63:0/1447503468 >> v2:172.21.15.63:3300/0 conn(0x7f2e7805f1e0 0x7f2e780b2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:55.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.905+0000 7f2e76d9d700 1 -- 172.21.15.63:0/1447503468 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e78143570 con 0x7f2e78146250 2020-05-18T21:27:55.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.905+0000 7f2e7659c700 1 --2- 172.21.15.63:0/1447503468 >> v2:172.21.15.63:3300/0 conn(0x7f2e7805f1e0 0x7f2e780b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:55.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.909+0000 7f2e76d9d700 1 --2- 172.21.15.63:0/1447503468 >> v2:172.21.15.155:3300/0 conn(0x7f2e78146250 0x7f2e781466e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2e781438f0 tx=0x7f2e68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.909+0000 7f2e76d9d700 1 --2- 172.21.15.63:0/1447503468 >> v2:172.21.15.155:3300/0 conn(0x7f2e78146250 0x7f2e781466e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2e781438f0 tx=0x7f2e68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.909+0000 7f2e76d9d700 1 --2- 172.21.15.63:0/1447503468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e78146250 0x7f2e781466e0 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f2e781438f0 tx=0x7f2e68007a80).ready entity=mon.1 client_cookie=5b365e0f2fddd8a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:55.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.909+0000 7f2e76d9d700 1 --2- 172.21.15.63:0/1447503468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e78146250 0x7f2e781466e0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f2e781438f0 tx=0x7f2e68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.909+0000 7f2e76d9d700 1 --2- 172.21.15.63:0/1447503468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e78146250 0x7f2e781466e0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f2e781438f0 tx=0x7f2e68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.909+0000 7f2e7559a700 1 -- 172.21.15.63:0/1447503468 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e68008e80 con 0x7f2e78146250 2020-05-18T21:27:55.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.909+0000 7f2e76d9d700 1 --2- 172.21.15.63:0/1447503468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e78146250 0x7f2e781466e0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f2e781438f0 tx=0x7f2e68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.909+0000 7f2e7559a700 1 -- 172.21.15.63:0/1447503468 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68011500 con 0x7f2e78146250 2020-05-18T21:27:55.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.909+0000 7f2e7559a700 1 -- 172.21.15.63:0/1447503468 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e68011920 con 0x7f2e78146250 2020-05-18T21:27:55.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.909+0000 7f2e7c969700 1 -- 172.21.15.63:0/1447503468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e78146250 msgr2=0x7f2e781466e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.909+0000 7f2e7c969700 1 --2- 172.21.15.63:0/1447503468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e78146250 0x7f2e781466e0 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f2e781438f0 tx=0x7f2e68007a80).stop 2020-05-18T21:27:55.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.909+0000 7f2e7c969700 1 -- 172.21.15.63:0/1447503468 shutdown_connections 2020-05-18T21:27:55.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.909+0000 7f2e7c969700 1 --2- 172.21.15.63:0/1447503468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e78146250 0x7f2e781466e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:55.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.909+0000 7f2e7c969700 1 --2- 172.21.15.63:0/1447503468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e7813c870 0x7f2e7813ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:55.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.909+0000 7f2e7c969700 1 --2- 172.21.15.63:0/1447503468 >> v2:172.21.15.63:3300/0 conn(0x7f2e7805f1e0 0x7f2e780b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:55.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.909+0000 7f2e7c969700 1 -- 172.21.15.63:0/1447503468 >> 172.21.15.63:0/1447503468 conn(0x7f2e78069fc0 msgr2=0x7f2e7806a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:55.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.909+0000 7f2e7c969700 1 -- 172.21.15.63:0/1447503468 shutdown_connections 2020-05-18T21:27:55.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.909+0000 7f2e7c969700 1 -- 172.21.15.63:0/1447503468 wait complete. 2020-05-18T21:27:55.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.909+0000 7f2e7c969700 1 Processor -- start 2020-05-18T21:27:55.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e7c969700 1 -- start start 2020-05-18T21:27:55.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e7c969700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e7805f1e0 0x7f2e780ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:55.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e7c969700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2e78146250 0x7f2e78064010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:55.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e7c969700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e78064470 con 0x7f2e7813c870 2020-05-18T21:27:55.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e7c969700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7813d2d0 con 0x7f2e78146250 2020-05-18T21:27:55.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e7c969700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7813d570 con 0x7f2e7805f1e0 2020-05-18T21:27:55.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e76d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2e78146250 0x7f2e78064010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e75d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2e7813c870 0x7f2e780b1ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56696/0 (socket says 172.21.15.63:56696) 2020-05-18T21:27:55.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e76d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2e78146250 0x7f2e78064010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54510/0 (socket says 172.21.15.63:54510) 2020-05-18T21:27:55.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e75d9b700 1 -- 172.21.15.63:0/3876975339 learned_addr learned my addr 172.21.15.63:0/3876975339 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:55.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e7659c700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e7805f1e0 0x7f2e780ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e76d9d700 1 -- 172.21.15.63:0/3876975339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e7805f1e0 msgr2=0x7f2e780ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e76d9d700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e7805f1e0 0x7f2e780ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:55.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e76d9d700 1 -- 172.21.15.63:0/3876975339 >> v1:172.21.15.63:6789/0 conn(0x7f2e7813c870 legacy=0x7f2e780b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:55.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e76d9d700 1 -- 172.21.15.63:0/3876975339 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7813d810 con 0x7f2e78146250 2020-05-18T21:27:55.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e677fe700 1 -- 172.21.15.63:0/3876975339 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641472350 0 0) 0x7f2e78064470 con 0x7f2e7813c870 2020-05-18T21:27:55.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e76d9d700 1 --2- 172.21.15.63:0/3876975339 >> v2:172.21.15.63:3300/0 conn(0x7f2e78146250 0x7f2e78064010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2e781459e0 tx=0x7f2e68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e76d9d700 1 --2- 172.21.15.63:0/3876975339 >> v2:172.21.15.63:3300/0 conn(0x7f2e78146250 0x7f2e78064010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2e781459e0 tx=0x7f2e68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e76d9d700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e78146250 0x7f2e78064010 secure :-1 s=READY pgs=417 cs=0 l=1 rx=0x7f2e781459e0 tx=0x7f2e68007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:55.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e76d9d700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e78146250 0x7f2e78064010 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f2e781459e0 tx=0x7f2e68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e677fe700 1 -- 172.21.15.63:0/3876975339 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e68011900 con 0x7f2e78146250 2020-05-18T21:27:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e76d9d700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e78146250 0x7f2e78064010 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f2e781459e0 tx=0x7f2e68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e76d9d700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e78146250 0x7f2e78064010 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f2e781459e0 tx=0x7f2e68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e677fe700 1 -- 172.21.15.63:0/3876975339 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68005700 con 0x7f2e78146250 2020-05-18T21:27:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e7c969700 1 -- 172.21.15.63:0/3876975339 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7813dab0 con 0x7f2e78146250 2020-05-18T21:27:55.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e677fe700 1 -- 172.21.15.63:0/3876975339 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e68005a60 con 0x7f2e78146250 2020-05-18T21:27:55.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.913+0000 7f2e7c969700 1 -- 172.21.15.63:0/3876975339 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e780b2360 con 0x7f2e78146250 2020-05-18T21:27:55.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.917+0000 7f2e76d9d700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e78146250 0x7f2e78064010 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f2e781459e0 tx=0x7f2e68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.917+0000 7f2e7c969700 1 -- 172.21.15.63:0/3876975339 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e780569e0 con 0x7f2e78146250 2020-05-18T21:27:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.917+0000 7f2e677fe700 1 -- 172.21.15.63:0/3876975339 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2e68005c60 con 0x7f2e78146250 2020-05-18T21:27:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.917+0000 7f2e76d9d700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e78146250 0x7f2e78064010 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f2e781459e0 tx=0x7f2e68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.917+0000 7f2e677fe700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e5404f880 0x7f2e54051d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.917+0000 7f2e677fe700 1 -- 172.21.15.63:0/3876975339 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2e680645c0 con 0x7f2e78146250 2020-05-18T21:27:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.917+0000 7f2e7659c700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e5404f880 0x7f2e54051d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:55.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.917+0000 7f2e7659c700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e5404f880 0x7f2e54051d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2e700032f0 tx=0x7f2e7000ef60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.917+0000 7f2e7659c700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e5404f880 0x7f2e54051d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2e700032f0 tx=0x7f2e7000ef60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.917+0000 7f2e7659c700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e5404f880 0x7f2e54051d40 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f2e700032f0 tx=0x7f2e7000ef60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:55.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.921+0000 7f2e76d9d700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e78146250 0x7f2e78064010 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f2e781459e0 tx=0x7f2e68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:55.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:55.921+0000 7f2e677fe700 1 -- 172.21.15.63:0/3876975339 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2e6803e9b0 con 0x7f2e78146250 2020-05-18T21:27:56.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:56.081+0000 7f2e7c969700 1 -- 172.21.15.63:0/3876975339 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f2e78064c20 con 0x7f2e78146250 2020-05-18T21:27:56.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:56.081+0000 7f2e76d9d700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e78146250 0x7f2e78064010 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f2e781459e0 tx=0x7f2e68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:56.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:56.081+0000 7f2e677fe700 1 -- 172.21.15.63:0/3876975339 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1941 (secure 0 0 0) 0x7f2e68041fd0 con 0x7f2e78146250 2020-05-18T21:27:56.087 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:56.088 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:27:56.088 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:27:56.088 INFO:teuthology.orchestra.run.smithi063.stdout: "total_bytes": 773094113280, 2020-05-18T21:27:56.088 INFO:teuthology.orchestra.run.smithi063.stdout: "total_avail_bytes": 764485566464, 2020-05-18T21:27:56.089 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_bytes": 18612224, 2020-05-18T21:27:56.089 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_bytes": 8608546816, 2020-05-18T21:27:56.089 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_ratio": 0.011135186068713665, 2020-05-18T21:27:56.089 INFO:teuthology.orchestra.run.smithi063.stdout: "num_osds": 8, 2020-05-18T21:27:56.089 INFO:teuthology.orchestra.run.smithi063.stdout: "num_per_pool_osds": 8, 2020-05-18T21:27:56.090 INFO:teuthology.orchestra.run.smithi063.stdout: "num_per_pool_omap_osds": 8 2020-05-18T21:27:56.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:56.090 INFO:teuthology.orchestra.run.smithi063.stdout: "stats_by_class": { 2020-05-18T21:27:56.090 INFO:teuthology.orchestra.run.smithi063.stdout: "ssd": { 2020-05-18T21:27:56.090 INFO:teuthology.orchestra.run.smithi063.stdout: "total_bytes": 773094113280, 2020-05-18T21:27:56.091 INFO:teuthology.orchestra.run.smithi063.stdout: "total_avail_bytes": 764485566464, 2020-05-18T21:27:56.091 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_bytes": 18612224, 2020-05-18T21:27:56.091 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_bytes": 8608546816, 2020-05-18T21:27:56.091 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_ratio": 0.011135186068713665 2020-05-18T21:27:56.091 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:56.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:56.092 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:27:56.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:56.092 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_health_metrics", 2020-05-18T21:27:56.092 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 1, 2020-05-18T21:27:56.092 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:27:56.093 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 0, 2020-05-18T21:27:56.093 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 2, 2020-05-18T21:27:56.093 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 0, 2020-05-18T21:27:56.094 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 0, 2020-05-18T21:27:56.094 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 0, 2020-05-18T21:27:56.094 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362906386432 2020-05-18T21:27:56.094 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:56.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:56.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:56.095 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd", 2020-05-18T21:27:56.095 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 2, 2020-05-18T21:27:56.095 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:27:56.095 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 0, 2020-05-18T21:27:56.095 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 0, 2020-05-18T21:27:56.096 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 0, 2020-05-18T21:27:56.096 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 0, 2020-05-18T21:27:56.096 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 0, 2020-05-18T21:27:56.096 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362906386432 2020-05-18T21:27:56.096 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:56.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:56.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:56.097 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephfs_metadata", 2020-05-18T21:27:56.097 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 5, 2020-05-18T21:27:56.097 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:27:56.098 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 3538584, 2020-05-18T21:27:56.098 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 23, 2020-05-18T21:27:56.098 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 6968, 2020-05-18T21:27:56.098 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 7135232, 2020-05-18T21:27:56.099 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 9.8305818028165959e-06, 2020-05-18T21:27:56.099 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362906386432 2020-05-18T21:27:56.099 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:56.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:56.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:56.100 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephfs_data", 2020-05-18T21:27:56.100 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 6, 2020-05-18T21:27:56.100 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:27:56.100 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 0, 2020-05-18T21:27:56.100 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 0, 2020-05-18T21:27:56.100 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 0, 2020-05-18T21:27:56.101 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 0, 2020-05-18T21:27:56.101 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 0, 2020-05-18T21:27:56.101 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362906386432 2020-05-18T21:27:56.101 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:56.101 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:56.102 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:56.102 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:27:56.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:56.081+0000 7f2e7c969700 1 -- 172.21.15.63:0/3876975339 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e5404f880 msgr2=0x7f2e54051d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:56.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:56.081+0000 7f2e7c969700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e5404f880 0x7f2e54051d40 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f2e700032f0 tx=0x7f2e7000ef60).stop 2020-05-18T21:27:56.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:56.081+0000 7f2e7c969700 1 -- 172.21.15.63:0/3876975339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e78146250 msgr2=0x7f2e78064010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:56.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:56.081+0000 7f2e7c969700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e78146250 0x7f2e78064010 secure :-1 s=READY pgs=417 cs=0 l=1 rx=0x7f2e781459e0 tx=0x7f2e68007a80).stop 2020-05-18T21:27:56.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:56.081+0000 7f2e7c969700 1 -- 172.21.15.63:0/3876975339 shutdown_connections 2020-05-18T21:27:56.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:56.081+0000 7f2e7c969700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e5404f880 0x7f2e54051d40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:56.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:56.081+0000 7f2e7c969700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e78146250 0x7f2e78064010 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:56.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:56.081+0000 7f2e7c969700 1 --2- 172.21.15.63:0/3876975339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e7805f1e0 0x7f2e780ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:56.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:56.081+0000 7f2e7c969700 1 -- 172.21.15.63:0/3876975339 >> 172.21.15.63:0/3876975339 conn(0x7f2e78069fc0 msgr2=0x7f2e78142860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:56.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:56.081+0000 7f2e7c969700 1 -- 172.21.15.63:0/3876975339 shutdown_connections 2020-05-18T21:27:56.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:56.081+0000 7f2e7c969700 1 -- 172.21.15.63:0/3876975339 wait complete. 2020-05-18T21:27:56.106 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s 2020-05-18T21:27:56.106 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:27:56.107 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:27:56.126 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:27:56.146 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:27:56.147 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:27:56.147 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:27:56.148 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:27:56.172 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[17659]: fuse finished with error 0 and tester_r 0 2020-05-18T21:27:56.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.176 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:27:56.231 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:27:56.232 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:27:56.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.233 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 down' 2020-05-18T21:27:56.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.264 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.0' 2020-05-18T21:27:56.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.396 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:27:56.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.422 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:27:56.429 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:27:56.429 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:56.430 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:27:56.430 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:56.430 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:27:56.430 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:56.431 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:56.431 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.431 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:56.431 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.431 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:56.432 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.432 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:27:56.432 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.432 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:27:56.432 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42766sec preferred_lft 42766sec 2020-05-18T21:27:56.433 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:27:56.433 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:56.433 INFO:teuthology.orchestra.run.smithi063.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-05-18T21:27:56.433 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.433 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:27:56.434 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:56.434 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::7f:79ff:fe9e:c338/64 scope link 2020-05-18T21:27:56.434 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:56.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.435 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:27:56.505 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:56.506 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:56.506 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:56.506 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.506 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:56.507 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.507 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:56.507 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.507 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:27:56.507 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.507 INFO:teuthology.orchestra.run.smithi063.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:27:56.508 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.508 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:27:56.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.509 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:27:56.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.537 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:27:56.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.688 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:27:56.698 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:27:56.699 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:27:56.699 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:27:56.699 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:27:56.699 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:27:56.699 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:27:56.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.701 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:27:56.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.720 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:27:56.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.780 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:27:56.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.800 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:27:56.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.808 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:27:56.815 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-05-18T21:27:56.815 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:27:56.816 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-05-18T21:27:56.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.817 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:27:56.864 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:27:56.865 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:56.865 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:27:56.866 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:56.866 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:27:56.866 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:56.867 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:56.867 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.867 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:56.868 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.868 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:56.868 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.868 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:27:56.869 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.869 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:27:56.869 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42766sec preferred_lft 42766sec 2020-05-18T21:27:56.870 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:27:56.870 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:56.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.871 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:27:56.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.880 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:27:56.887 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2020-05-18T21:27:56.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:27:56.888 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-05-18T21:27:56.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.889 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:27:56.902 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:27:56.902 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:56.903 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:27:56.903 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:56.903 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:27:56.903 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:56.904 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:56.904 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.905 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:56.905 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.905 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:56.905 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.906 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:27:56.906 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.906 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:27:56.907 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42770sec preferred_lft 42770sec 2020-05-18T21:27:56.907 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:27:56.907 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:56.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.910 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:27:56.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.917 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:27:56.967 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2020-05-18T21:27:56.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:27:56.969 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-05-18T21:27:56.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.971 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:27:56.978 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:27:56.979 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:27:56.979 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:27:56.980 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:56.980 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:27:56.980 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:56.980 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:56.981 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.981 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:56.981 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.981 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:27:56.982 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.982 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:27:56.982 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:27:56.983 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:27:56.983 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42770sec preferred_lft 42770sec 2020-05-18T21:27:56.983 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:27:56.983 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:27:56.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:27:56.984 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:27:56.992 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_strays.TestStrays.test_dir_deletion' 2020-05-18T21:27:57.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.097+0000 7f02bdc25700 1 Processor -- start 2020-05-18T21:27:57.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.097+0000 7f02bdc25700 1 -- start start 2020-05-18T21:27:57.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02bdc25700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f02b8060b90 0x7f02b80b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:57.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02bdc25700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02b8146c90 0x7f02b80624a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:57.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02bdc25700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b8061870 con 0x7f02b8062900 2020-05-18T21:27:57.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02bdc25700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b8061d60 con 0x7f02b8060b90 2020-05-18T21:27:57.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02bdc25700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b8062000 con 0x7f02b8146c90 2020-05-18T21:27:57.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b6ffd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02b8146c90 0x7f02b80624a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:57.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b6ffd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02b8146c90 0x7f02b80624a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:45216/0 (socket says 172.21.15.63:45216) 2020-05-18T21:27:57.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b6ffd700 1 -- 172.21.15.63:0/3950540221 learned_addr learned my addr 172.21.15.63:0/3950540221 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:57.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b77fe700 1 --2- 172.21.15.63:0/3950540221 >> v2:172.21.15.155:3300/0 conn(0x7f02b8060b90 0x7f02b80b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:57.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b67fc700 1 -- 172.21.15.63:0/3950540221 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346899259 0 0) 0x7f02b8061870 con 0x7f02b8062900 2020-05-18T21:27:57.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b67fc700 1 -- 172.21.15.63:0/3950540221 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0298003270 con 0x7f02b8062900 2020-05-18T21:27:57.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b6ffd700 1 -- 172.21.15.63:0/3950540221 >> v2:172.21.15.155:3300/0 conn(0x7f02b8060b90 msgr2=0x7f02b80b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:57.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b6ffd700 1 --2- 172.21.15.63:0/3950540221 >> v2:172.21.15.155:3300/0 conn(0x7f02b8060b90 0x7f02b80b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:57.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b6ffd700 1 -- 172.21.15.63:0/3950540221 >> v1:172.21.15.155:6789/0 conn(0x7f02b8062900 legacy=0x7f02b80b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:57.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b6ffd700 1 -- 172.21.15.63:0/3950540221 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b8147210 con 0x7f02b8146c90 2020-05-18T21:27:57.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b77fe700 1 --2- 172.21.15.63:0/3950540221 >> v2:172.21.15.155:3300/0 conn(0x7f02b8060b90 0x7f02b80b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:57.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b6ffd700 1 --2- 172.21.15.63:0/3950540221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02b8146c90 0x7f02b80624a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f02a0002f70 tx=0x7f02a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:57.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b6ffd700 1 --2- 172.21.15.63:0/3950540221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02b8146c90 0x7f02b80624a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f02a0002f70 tx=0x7f02a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:57.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b6ffd700 1 --2- 172.21.15.63:0/3950540221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02b8146c90 0x7f02b80624a0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f02a0002f70 tx=0x7f02a0007a80).ready entity=mon.2 client_cookie=39aec26119fcd327 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:57.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b6ffd700 1 --2- 172.21.15.63:0/3950540221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02b8146c90 0x7f02b80624a0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f02a0002f70 tx=0x7f02a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:57.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b67fc700 1 -- 172.21.15.63:0/3950540221 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02a0008e50 con 0x7f02b8146c90 2020-05-18T21:27:57.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b6ffd700 1 --2- 172.21.15.63:0/3950540221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02b8146c90 0x7f02b80624a0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f02a0002f70 tx=0x7f02a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:57.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b6ffd700 1 --2- 172.21.15.63:0/3950540221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02b8146c90 0x7f02b80624a0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f02a0002f70 tx=0x7f02a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:57.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b67fc700 1 -- 172.21.15.63:0/3950540221 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a0011890 con 0x7f02b8146c90 2020-05-18T21:27:57.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02b67fc700 1 -- 172.21.15.63:0/3950540221 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02a0011cb0 con 0x7f02b8146c90 2020-05-18T21:27:57.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02bdc25700 1 -- 172.21.15.63:0/3950540221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02b8146c90 msgr2=0x7f02b80624a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:57.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02bdc25700 1 --2- 172.21.15.63:0/3950540221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02b8146c90 0x7f02b80624a0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f02a0002f70 tx=0x7f02a0007a80).stop 2020-05-18T21:27:57.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02bdc25700 1 -- 172.21.15.63:0/3950540221 shutdown_connections 2020-05-18T21:27:57.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02bdc25700 1 --2- 172.21.15.63:0/3950540221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02b8146c90 0x7f02b80624a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:57.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02bdc25700 1 --2- 172.21.15.63:0/3950540221 >> v2:172.21.15.155:3300/0 conn(0x7f02b8060b90 0x7f02b80b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:57.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02bdc25700 1 -- 172.21.15.63:0/3950540221 >> 172.21.15.63:0/3950540221 conn(0x7f02b80b83d0 msgr2=0x7f02b80b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:57.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02bdc25700 1 -- 172.21.15.63:0/3950540221 shutdown_connections 2020-05-18T21:27:57.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.101+0000 7f02bdc25700 1 -- 172.21.15.63:0/3950540221 wait complete. 2020-05-18T21:27:57.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.105+0000 7f02bdc25700 1 Processor -- start 2020-05-18T21:27:57.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.105+0000 7f02bdc25700 1 -- start start 2020-05-18T21:27:57.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02bdc25700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f02b8062900 0x7f02b8145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:57.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02bdc25700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b81434d0 con 0x7f02b8060b90 2020-05-18T21:27:57.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02bdc25700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b8143770 con 0x7f02b8146c90 2020-05-18T21:27:57.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02bdc25700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b8143a10 con 0x7f02b8062900 2020-05-18T21:27:57.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02b77fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f02b8060b90 0x7f02b813cb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56708/0 (socket says 172.21.15.63:56708) 2020-05-18T21:27:57.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02b77fe700 1 -- 172.21.15.63:0/952317987 learned_addr learned my addr 172.21.15.63:0/952317987 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:57.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02b6ffd700 1 --2- 172.21.15.63:0/952317987 >> v2:172.21.15.63:3300/0 conn(0x7f02b8062900 0x7f02b8145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:57.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02b4ff9700 1 -- 172.21.15.63:0/952317987 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568179609 0 0) 0x7f02b81434d0 con 0x7f02b8060b90 2020-05-18T21:27:57.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02b4ff9700 1 -- 172.21.15.63:0/952317987 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f029c002fe0 con 0x7f02b8060b90 2020-05-18T21:27:57.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02b6ffd700 1 -- 172.21.15.63:0/952317987 >> v1:172.21.15.155:6789/0 conn(0x7f02b8146c90 legacy=0x7f02b8143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:57.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02b6ffd700 1 -- 172.21.15.63:0/952317987 >> v1:172.21.15.63:6789/0 conn(0x7f02b8060b90 legacy=0x7f02b813cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:57.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02b6ffd700 1 -- 172.21.15.63:0/952317987 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b813d2a0 con 0x7f02b8062900 2020-05-18T21:27:57.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02b6ffd700 1 --2- 172.21.15.63:0/952317987 >> v2:172.21.15.63:3300/0 conn(0x7f02b8062900 0x7f02b8145540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f02a0002f70 tx=0x7f02a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:57.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02b6ffd700 1 --2- 172.21.15.63:0/952317987 >> v2:172.21.15.63:3300/0 conn(0x7f02b8062900 0x7f02b8145540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f02a0002f70 tx=0x7f02a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:57.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02b6ffd700 1 --2- 172.21.15.63:0/952317987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02b8062900 0x7f02b8145540 secure :-1 s=READY pgs=419 cs=0 l=1 rx=0x7f02a0002f70 tx=0x7f02a0007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:57.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02b6ffd700 1 --2- 172.21.15.63:0/952317987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02b8062900 0x7f02b8145540 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7f02a0002f70 tx=0x7f02a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:57.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02b6ffd700 1 --2- 172.21.15.63:0/952317987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02b8062900 0x7f02b8145540 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7f02a0002f70 tx=0x7f02a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:57.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02b6ffd700 1 --2- 172.21.15.63:0/952317987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02b8062900 0x7f02b8145540 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7f02a0002f70 tx=0x7f02a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:57.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02b4ff9700 1 -- 172.21.15.63:0/952317987 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02a000f870 con 0x7f02b8062900 2020-05-18T21:27:57.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02b4ff9700 1 -- 172.21.15.63:0/952317987 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a0007180 con 0x7f02b8062900 2020-05-18T21:27:57.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02bdc25700 1 -- 172.21.15.63:0/952317987 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b81517a0 con 0x7f02b8062900 2020-05-18T21:27:57.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02b4ff9700 1 -- 172.21.15.63:0/952317987 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02a00074e0 con 0x7f02b8062900 2020-05-18T21:27:57.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.109+0000 7f02bdc25700 1 -- 172.21.15.63:0/952317987 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b80ada00 con 0x7f02b8062900 2020-05-18T21:27:57.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.113+0000 7f02bdc25700 1 -- 172.21.15.63:0/952317987 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b80569e0 con 0x7f02b8062900 2020-05-18T21:27:57.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.113+0000 7f02b6ffd700 1 --2- 172.21.15.63:0/952317987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02b8062900 0x7f02b8145540 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7f02a0002f70 tx=0x7f02a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:57.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.113+0000 7f02b4ff9700 1 -- 172.21.15.63:0/952317987 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f02a0005700 con 0x7f02b8062900 2020-05-18T21:27:57.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.113+0000 7f02b6ffd700 1 --2- 172.21.15.63:0/952317987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02b8062900 0x7f02b8145540 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7f02a0002f70 tx=0x7f02a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:57.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.117+0000 7f02b4ff9700 1 --2- 172.21.15.63:0/952317987 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f029c04fd40 0x7f029c052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:57.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.117+0000 7f02b4ff9700 1 -- 172.21.15.63:0/952317987 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f02a0063ef0 con 0x7f02b8062900 2020-05-18T21:27:57.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.117+0000 7f02b77fe700 1 --2- 172.21.15.63:0/952317987 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f029c04fd40 0x7f029c052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:57.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.117+0000 7f02b77fe700 1 --2- 172.21.15.63:0/952317987 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f029c04fd40 0x7f029c052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f02a8002f70 tx=0x7f02a80093f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:57.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.117+0000 7f02b77fe700 1 --2- 172.21.15.63:0/952317987 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f029c04fd40 0x7f029c052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f02a8002f70 tx=0x7f02a80093f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:57.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.117+0000 7f02b77fe700 1 --2- 172.21.15.63:0/952317987 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f029c04fd40 0x7f029c052200 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f02a8002f70 tx=0x7f02a80093f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:57.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.121+0000 7f02b6ffd700 1 --2- 172.21.15.63:0/952317987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02b8062900 0x7f02b8145540 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7f02a0002f70 tx=0x7f02a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:57.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.121+0000 7f02b4ff9700 1 -- 172.21.15.63:0/952317987 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f02a003e3a0 con 0x7f02b8062900 2020-05-18T21:27:57.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:57.273+0000 7f02bdc25700 1 -- 172.21.15.63:0/952317987 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dir_deletion"]} v 0) v1 -- 0x7f02b813d430 con 0x7f02b8062900 2020-05-18T21:27:58.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.109+0000 7f02b6ffd700 1 --2- 172.21.15.63:0/952317987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02b8062900 0x7f02b8145540 secure :-1 s=READY pgs=419 cs=0 l=1 rx=0x7f02a0002f70 tx=0x7f02a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:58.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.117+0000 7f02b6ffd700 1 --2- 172.21.15.63:0/952317987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02b8062900 0x7f02b8145540 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7f02a0002f70 tx=0x7f02a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:58.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.117+0000 7f02b4ff9700 1 -- 172.21.15.63:0/952317987 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dir_deletion"]}]=0 v75) v1 ==== 132+0+0 (secure 0 0 0) 0x7f02a00419c0 con 0x7f02b8062900 2020-05-18T21:27:58.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.121+0000 7f02bdc25700 1 -- 172.21.15.63:0/952317987 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f029c04fd40 msgr2=0x7f029c052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:58.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.121+0000 7f02bdc25700 1 --2- 172.21.15.63:0/952317987 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f029c04fd40 0x7f029c052200 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f02a8002f70 tx=0x7f02a80093f0).stop 2020-05-18T21:27:58.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.121+0000 7f02bdc25700 1 -- 172.21.15.63:0/952317987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02b8062900 msgr2=0x7f02b8145540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:58.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.121+0000 7f02bdc25700 1 --2- 172.21.15.63:0/952317987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02b8062900 0x7f02b8145540 secure :-1 s=READY pgs=419 cs=0 l=1 rx=0x7f02a0002f70 tx=0x7f02a0007a80).stop 2020-05-18T21:27:58.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.121+0000 7f02bdc25700 1 -- 172.21.15.63:0/952317987 shutdown_connections 2020-05-18T21:27:58.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.121+0000 7f02bdc25700 1 --2- 172.21.15.63:0/952317987 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f029c04fd40 0x7f029c052200 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:58.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.121+0000 7f02bdc25700 1 --2- 172.21.15.63:0/952317987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02b8062900 0x7f02b8145540 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:58.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.121+0000 7f02bdc25700 1 -- 172.21.15.63:0/952317987 >> 172.21.15.63:0/952317987 conn(0x7f02b80b83d0 msgr2=0x7f02b80640a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:58.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.121+0000 7f02bdc25700 1 -- 172.21.15.63:0/952317987 shutdown_connections 2020-05-18T21:27:58.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.121+0000 7f02bdc25700 1 -- 172.21.15.63:0/952317987 wait complete. 2020-05-18T21:27:58.144 INFO:tasks.cephfs_test_runner:test_dir_deletion (tasks.cephfs.test_strays.TestStrays) ... ok 2020-05-18T21:27:58.145 INFO:tasks.cephfs_test_runner:Starting test: test_dirfrag_limit (tasks.cephfs.test_strays.TestStrays) 2020-05-18T21:27:58.146 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit' 2020-05-18T21:27:58.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728f45f700 1 Processor -- start 2020-05-18T21:27:58.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728f45f700 1 -- start start 2020-05-18T21:27:58.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728f45f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7288142bf0 0x7f7288065130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:58.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728f45f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7288143090 con 0x7f72880acbe0 2020-05-18T21:27:58.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728f45f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7288143330 con 0x7f7288061d80 2020-05-18T21:27:58.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728f45f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72880b6b10 con 0x7f7288142bf0 2020-05-18T21:27:58.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728ec5e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f72880acbe0 0x7f728814c650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56720/0 (socket says 172.21.15.63:56720) 2020-05-18T21:27:58.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728ec5e700 1 -- 172.21.15.63:0/3410475930 learned_addr learned my addr 172.21.15.63:0/3410475930 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:58.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728dc5c700 1 --2- 172.21.15.63:0/3410475930 >> v2:172.21.15.155:3300/0 conn(0x7f7288142bf0 0x7f7288065130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:58.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728d45b700 1 -- 172.21.15.63:0/3410475930 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273680945 0 0) 0x7f7288143090 con 0x7f72880acbe0 2020-05-18T21:27:58.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728d45b700 1 -- 172.21.15.63:0/3410475930 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7274003270 con 0x7f72880acbe0 2020-05-18T21:27:58.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728dc5c700 1 -- 172.21.15.63:0/3410475930 >> v1:172.21.15.155:6789/0 conn(0x7f7288061d80 legacy=0x7f72880ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:58.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728dc5c700 1 -- 172.21.15.63:0/3410475930 >> v1:172.21.15.63:6789/0 conn(0x7f72880acbe0 legacy=0x7f728814c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:58.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728dc5c700 1 -- 172.21.15.63:0/3410475930 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72881435d0 con 0x7f7288142bf0 2020-05-18T21:27:58.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728dc5c700 1 --2- 172.21.15.63:0/3410475930 >> v2:172.21.15.155:3300/0 conn(0x7f7288142bf0 0x7f7288065130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f72780032f0 tx=0x7f7278007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:58.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728dc5c700 1 --2- 172.21.15.63:0/3410475930 >> v2:172.21.15.155:3300/0 conn(0x7f7288142bf0 0x7f7288065130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f72780032f0 tx=0x7f7278007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:58.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728dc5c700 1 --2- 172.21.15.63:0/3410475930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7288142bf0 0x7f7288065130 secure :-1 s=READY pgs=303 cs=0 l=1 rx=0x7f72780032f0 tx=0x7f7278007e00).ready entity=mon.1 client_cookie=75f0979c35232d5 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:58.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728dc5c700 1 --2- 172.21.15.63:0/3410475930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7288142bf0 0x7f7288065130 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f72780032f0 tx=0x7f7278007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:58.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728d45b700 1 -- 172.21.15.63:0/3410475930 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7278011e60 con 0x7f7288142bf0 2020-05-18T21:27:58.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728dc5c700 1 --2- 172.21.15.63:0/3410475930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7288142bf0 0x7f7288065130 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f72780032f0 tx=0x7f7278007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:58.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728dc5c700 1 --2- 172.21.15.63:0/3410475930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7288142bf0 0x7f7288065130 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f72780032f0 tx=0x7f7278007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:58.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728d45b700 1 -- 172.21.15.63:0/3410475930 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727800a180 con 0x7f7288142bf0 2020-05-18T21:27:58.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728f45f700 1 -- 172.21.15.63:0/3410475930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7288142bf0 msgr2=0x7f7288065130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:58.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728f45f700 1 --2- 172.21.15.63:0/3410475930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7288142bf0 0x7f7288065130 secure :-1 s=READY pgs=303 cs=0 l=1 rx=0x7f72780032f0 tx=0x7f7278007e00).stop 2020-05-18T21:27:58.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.253+0000 7f728d45b700 1 -- 172.21.15.63:0/3410475930 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f727800a520 con 0x7f7288142bf0 2020-05-18T21:27:58.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728f45f700 1 -- 172.21.15.63:0/3410475930 shutdown_connections 2020-05-18T21:27:58.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728f45f700 1 --2- 172.21.15.63:0/3410475930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7288142bf0 0x7f7288065130 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:58.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728f45f700 1 -- 172.21.15.63:0/3410475930 >> 172.21.15.63:0/3410475930 conn(0x7f7288066d00 msgr2=0x7f728805a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:58.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728f45f700 1 -- 172.21.15.63:0/3410475930 shutdown_connections 2020-05-18T21:27:58.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728f45f700 1 -- 172.21.15.63:0/3410475930 wait complete. 2020-05-18T21:27:58.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728f45f700 1 Processor -- start 2020-05-18T21:27:58.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728f45f700 1 -- start start 2020-05-18T21:27:58.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728f45f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7288061d80 0x7f72881446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:58.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728f45f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7288142bf0 0x7f7288153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:58.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728f45f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7288143d10 con 0x7f72880acbe0 2020-05-18T21:27:58.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728f45f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7288143fb0 con 0x7f7288142bf0 2020-05-18T21:27:58.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728f45f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7288144250 con 0x7f7288061d80 2020-05-18T21:27:58.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728ec5e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7288142bf0 0x7f7288153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:58.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728e45d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7288061d80 0x7f72881446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:58.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728dc5c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f72880acbe0 0x7f72880b8410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:55040/0 (socket says 172.21.15.63:55040) 2020-05-18T21:27:58.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728ec5e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7288142bf0 0x7f7288153930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:41154/0 (socket says 172.21.15.63:41154) 2020-05-18T21:27:58.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728e45d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7288061d80 0x7f72881446f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:45236/0 (socket says 172.21.15.63:45236) 2020-05-18T21:27:58.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728dc5c700 1 -- 172.21.15.63:0/3515040608 learned_addr learned my addr 172.21.15.63:0/3515040608 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:58.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728ec5e700 1 -- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7288061d80 msgr2=0x7f72881446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:58.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728ec5e700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7288061d80 0x7f72881446f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:58.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728ec5e700 1 -- 172.21.15.63:0/3515040608 >> v1:172.21.15.155:6789/0 conn(0x7f72880acbe0 legacy=0x7f72880b8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:58.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728ec5e700 1 -- 172.21.15.63:0/3515040608 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7288143a00 con 0x7f7288142bf0 2020-05-18T21:27:58.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f72877fe700 1 -- 172.21.15.63:0/3515040608 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869175927 0 0) 0x7f7288143d10 con 0x7f72880acbe0 2020-05-18T21:27:58.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.257+0000 7f728e45d700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7288061d80 0x7f72881446f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:27:58.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f728ec5e700 1 --2- 172.21.15.63:0/3515040608 >> v2:172.21.15.155:3300/0 conn(0x7f7288142bf0 0x7f7288153930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7280001110 tx=0x7f7280010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:58.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f728ec5e700 1 --2- 172.21.15.63:0/3515040608 >> v2:172.21.15.155:3300/0 conn(0x7f7288142bf0 0x7f7288153930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7280001110 tx=0x7f7280010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:58.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f728ec5e700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7288142bf0 0x7f7288153930 secure :-1 s=READY pgs=305 cs=0 l=1 rx=0x7f7280001110 tx=0x7f7280010890).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:58.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f728ec5e700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7288142bf0 0x7f7288153930 secure :-1 s=THROTTLE_DONE pgs=305 cs=0 l=1 rx=0x7f7280001110 tx=0x7f7280010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:58.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f72877fe700 1 -- 172.21.15.63:0/3515040608 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7280005d00 con 0x7f7288142bf0 2020-05-18T21:27:58.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f728ec5e700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7288142bf0 0x7f7288153930 secure :-1 s=THROTTLE_DONE pgs=305 cs=0 l=1 rx=0x7f7280001110 tx=0x7f7280010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:58.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f728ec5e700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7288142bf0 0x7f7288153930 secure :-1 s=THROTTLE_DONE pgs=305 cs=0 l=1 rx=0x7f7280001110 tx=0x7f7280010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:58.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f72877fe700 1 -- 172.21.15.63:0/3515040608 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7280005e60 con 0x7f7288142bf0 2020-05-18T21:27:58.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f728f45f700 1 -- 172.21.15.63:0/3515040608 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72880b8b20 con 0x7f7288142bf0 2020-05-18T21:27:58.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f72877fe700 1 -- 172.21.15.63:0/3515040608 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72800062c0 con 0x7f7288142bf0 2020-05-18T21:27:58.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f728f45f700 1 -- 172.21.15.63:0/3515040608 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7288140ec0 con 0x7f7288142bf0 2020-05-18T21:27:58.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f728ec5e700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7288142bf0 0x7f7288153930 secure :-1 s=THROTTLE_DONE pgs=305 cs=0 l=1 rx=0x7f7280001110 tx=0x7f7280010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:58.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f728f45f700 1 -- 172.21.15.63:0/3515040608 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72880569e0 con 0x7f7288142bf0 2020-05-18T21:27:58.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f72877fe700 1 -- 172.21.15.63:0/3515040608 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f72800064f0 con 0x7f7288142bf0 2020-05-18T21:27:58.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f728ec5e700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7288142bf0 0x7f7288153930 secure :-1 s=THROTTLE_DONE pgs=305 cs=0 l=1 rx=0x7f7280001110 tx=0x7f7280010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:58.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f72877fe700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f726804f890 0x7f7268051d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:58.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f72877fe700 1 -- 172.21.15.63:0/3515040608 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f72800090c0 con 0x7f7288142bf0 2020-05-18T21:27:58.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f728e45d700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f726804f890 0x7f7268051d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:58.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f728e45d700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f726804f890 0x7f7268051d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f72880b72a0 tx=0x7f727c0013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:58.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f728e45d700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f726804f890 0x7f7268051d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f72880b72a0 tx=0x7f727c0013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:58.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.261+0000 7f728e45d700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f726804f890 0x7f7268051d50 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f72880b72a0 tx=0x7f727c0013e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:58.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.273+0000 7f728ec5e700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7288142bf0 0x7f7288153930 secure :-1 s=THROTTLE_DONE pgs=305 cs=0 l=1 rx=0x7f7280001110 tx=0x7f7280010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:58.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.273+0000 7f72877fe700 1 -- 172.21.15.63:0/3515040608 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f728003e050 con 0x7f7288142bf0 2020-05-18T21:27:58.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:58.429+0000 7f728f45f700 1 -- 172.21.15.63:0/3515040608 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit"]} v 0) v1 -- 0x7f728806ac80 con 0x7f7288142bf0 2020-05-18T21:27:58.937 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:27:58.953 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:27:59.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.121+0000 7f728ec5e700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7288142bf0 0x7f7288153930 secure :-1 s=THROTTLE_DONE pgs=305 cs=0 l=1 rx=0x7f7280001110 tx=0x7f7280010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.121+0000 7f72877fe700 1 -- 172.21.15.63:0/3515040608 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit"]}]=0 v76) v1 ==== 136+0+0 (secure 0 0 0) 0x7f7280041670 con 0x7f7288142bf0 2020-05-18T21:27:59.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.125+0000 7f728f45f700 1 -- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f726804f890 msgr2=0x7f7268051d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:59.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.125+0000 7f728f45f700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f726804f890 0x7f7268051d50 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f72880b72a0 tx=0x7f727c0013e0).stop 2020-05-18T21:27:59.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.125+0000 7f728f45f700 1 -- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7288142bf0 msgr2=0x7f7288153930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:59.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.125+0000 7f728f45f700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7288142bf0 0x7f7288153930 secure :-1 s=READY pgs=305 cs=0 l=1 rx=0x7f7280001110 tx=0x7f7280010890).stop 2020-05-18T21:27:59.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.125+0000 7f728f45f700 1 -- 172.21.15.63:0/3515040608 shutdown_connections 2020-05-18T21:27:59.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.125+0000 7f728f45f700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f726804f890 0x7f7268051d50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:59.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.125+0000 7f728f45f700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7288142bf0 0x7f7288153930 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:59.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.125+0000 7f728f45f700 1 --2- 172.21.15.63:0/3515040608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7288061d80 0x7f72881446f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:59.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.125+0000 7f728f45f700 1 -- 172.21.15.63:0/3515040608 >> 172.21.15.63:0/3515040608 conn(0x7f7288066d00 msgr2=0x7f728813c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:59.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.125+0000 7f728f45f700 1 -- 172.21.15.63:0/3515040608 shutdown_connections 2020-05-18T21:27:59.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.125+0000 7f728f45f700 1 -- 172.21.15.63:0/3515040608 wait complete. 2020-05-18T21:27:59.152 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:27:59.152 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:27:59.186 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:27:59.218 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:27:59.219 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-05-18T21:27:59.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f019e082700 1 Processor -- start 2020-05-18T21:27:59.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f019e082700 1 -- start start 2020-05-18T21:27:59.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f019e082700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f019805f110 0x7f01980b2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:59.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f019e082700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0198145d50 0x7f0198146200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:59.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f019e082700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01980b8650 con 0x7f01980b81b0 2020-05-18T21:27:59.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f019e082700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01980b88f0 con 0x7f0198145d50 2020-05-18T21:27:59.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f019e082700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01980b8b90 con 0x7f019805f110 2020-05-18T21:27:59.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f019d881700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0198145d50 0x7f0198146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:59.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f019d881700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0198145d50 0x7f0198146200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54546/0 (socket says 172.21.15.63:54546) 2020-05-18T21:27:59.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f019d881700 1 -- 172.21.15.63:0/824268354 learned_addr learned my addr 172.21.15.63:0/824268354 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:59.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f019d080700 1 --2- 172.21.15.63:0/824268354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f019805f110 0x7f01980b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:59.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f019d881700 1 -- 172.21.15.63:0/824268354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f019805f110 msgr2=0x7f01980b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:27:59.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f018bfff700 1 -- 172.21.15.63:0/824268354 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814665222 0 0) 0x7f01980b8650 con 0x7f01980b81b0 2020-05-18T21:27:59.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f019d881700 1 --2- 172.21.15.63:0/824268354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f019805f110 0x7f01980b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:59.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f019d881700 1 -- 172.21.15.63:0/824268354 >> v1:172.21.15.155:6789/0 conn(0x7f01980b81b0 legacy=0x7f019812ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:59.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f019d881700 1 -- 172.21.15.63:0/824268354 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01980b9030 con 0x7f0198145d50 2020-05-18T21:27:59.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f019d881700 1 --2- 172.21.15.63:0/824268354 >> v2:172.21.15.63:3300/0 conn(0x7f0198145d50 0x7f0198146200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f01900032f0 tx=0x7f0190007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f019d881700 1 --2- 172.21.15.63:0/824268354 >> v2:172.21.15.63:3300/0 conn(0x7f0198145d50 0x7f0198146200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f01900032f0 tx=0x7f0190007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f019d881700 1 --2- 172.21.15.63:0/824268354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0198145d50 0x7f0198146200 secure :-1 s=READY pgs=421 cs=0 l=1 rx=0x7f01900032f0 tx=0x7f0190007e00).ready entity=mon.0 client_cookie=58b6ea34beba33eb server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:59.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.345+0000 7f019d881700 1 --2- 172.21.15.63:0/824268354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0198145d50 0x7f0198146200 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7f01900032f0 tx=0x7f0190007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.349+0000 7f018bfff700 1 -- 172.21.15.63:0/824268354 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0190011d10 con 0x7f0198145d50 2020-05-18T21:27:59.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.349+0000 7f019d881700 1 --2- 172.21.15.63:0/824268354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0198145d50 0x7f0198146200 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7f01900032f0 tx=0x7f0190007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.349+0000 7f018bfff700 1 -- 172.21.15.63:0/824268354 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0190011e70 con 0x7f0198145d50 2020-05-18T21:27:59.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.349+0000 7f019d881700 1 --2- 172.21.15.63:0/824268354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0198145d50 0x7f0198146200 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7f01900032f0 tx=0x7f0190007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.349+0000 7f018bfff700 1 -- 172.21.15.63:0/824268354 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f019000a370 con 0x7f0198145d50 2020-05-18T21:27:59.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.349+0000 7f019e082700 1 -- 172.21.15.63:0/824268354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0198145d50 msgr2=0x7f0198146200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:59.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.349+0000 7f019e082700 1 --2- 172.21.15.63:0/824268354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0198145d50 0x7f0198146200 secure :-1 s=READY pgs=421 cs=0 l=1 rx=0x7f01900032f0 tx=0x7f0190007e00).stop 2020-05-18T21:27:59.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.349+0000 7f019e082700 1 -- 172.21.15.63:0/824268354 shutdown_connections 2020-05-18T21:27:59.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.349+0000 7f019e082700 1 --2- 172.21.15.63:0/824268354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0198145d50 0x7f0198146200 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:59.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.349+0000 7f019e082700 1 --2- 172.21.15.63:0/824268354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f019805f110 0x7f01980b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:27:59.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.349+0000 7f019e082700 1 -- 172.21.15.63:0/824268354 >> 172.21.15.63:0/824268354 conn(0x7f0198069fc0 msgr2=0x7f019806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:59.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.349+0000 7f019e082700 1 -- 172.21.15.63:0/824268354 shutdown_connections 2020-05-18T21:27:59.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.349+0000 7f019e082700 1 -- 172.21.15.63:0/824268354 wait complete. 2020-05-18T21:27:59.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019e082700 1 Processor -- start 2020-05-18T21:27:59.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019e082700 1 -- start start 2020-05-18T21:27:59.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019e082700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f019805f110 0x7f01980634e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:59.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019e082700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f01980b81b0 0x7f0198127d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:59.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019e082700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0198063bf0 con 0x7f0198145d50 2020-05-18T21:27:59.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019e082700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0198148960 con 0x7f019805f110 2020-05-18T21:27:59.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019e082700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0198148c00 con 0x7f01980b81b0 2020-05-18T21:27:59.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019d080700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f019805f110 0x7f01980634e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:59.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019d080700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f019805f110 0x7f01980634e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54548/0 (socket says 172.21.15.63:54548) 2020-05-18T21:27:59.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019d080700 1 -- 172.21.15.63:0/3577080204 learned_addr learned my addr 172.21.15.63:0/3577080204 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:27:59.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019d881700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0198145d50 0x7f0198060af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56740/0 (socket says 172.21.15.63:56740) 2020-05-18T21:27:59.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019c87f700 1 --2- 172.21.15.63:0/3577080204 >> v2:172.21.15.155:3300/0 conn(0x7f01980b81b0 0x7f0198127d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:59.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019d080700 1 -- 172.21.15.63:0/3577080204 >> v2:172.21.15.155:3300/0 conn(0x7f01980b81b0 msgr2=0x7f0198127d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:59.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019d080700 1 --2- 172.21.15.63:0/3577080204 >> v2:172.21.15.155:3300/0 conn(0x7f01980b81b0 0x7f0198127d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:59.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019d080700 1 -- 172.21.15.63:0/3577080204 >> v1:172.21.15.63:6789/0 conn(0x7f0198145d50 legacy=0x7f0198060af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:59.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019d080700 1 -- 172.21.15.63:0/3577080204 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0198063940 con 0x7f019805f110 2020-05-18T21:27:59.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f018a7fc700 1 -- 172.21.15.63:0/3577080204 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198550893 0 0) 0x7f0198063bf0 con 0x7f0198145d50 2020-05-18T21:27:59.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019d080700 1 --2- 172.21.15.63:0/3577080204 >> v2:172.21.15.63:3300/0 conn(0x7f019805f110 0x7f01980634e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f018c0030b0 tx=0x7f018c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019d080700 1 --2- 172.21.15.63:0/3577080204 >> v2:172.21.15.63:3300/0 conn(0x7f019805f110 0x7f01980634e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f018c0030b0 tx=0x7f018c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019d080700 1 --2- 172.21.15.63:0/3577080204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f019805f110 0x7f01980634e0 secure :-1 s=READY pgs=423 cs=0 l=1 rx=0x7f018c0030b0 tx=0x7f018c010cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:59.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019d080700 1 --2- 172.21.15.63:0/3577080204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f019805f110 0x7f01980634e0 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f018c0030b0 tx=0x7f018c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f018a7fc700 1 -- 172.21.15.63:0/3577080204 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f018c007180 con 0x7f019805f110 2020-05-18T21:27:59.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019d080700 1 --2- 172.21.15.63:0/3577080204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f019805f110 0x7f01980634e0 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f018c0030b0 tx=0x7f018c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019d080700 1 --2- 172.21.15.63:0/3577080204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f019805f110 0x7f01980634e0 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f018c0030b0 tx=0x7f018c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f018a7fc700 1 -- 172.21.15.63:0/3577080204 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c0072e0 con 0x7f019805f110 2020-05-18T21:27:59.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019e082700 1 -- 172.21.15.63:0/3577080204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0198146160 con 0x7f019805f110 2020-05-18T21:27:59.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f018a7fc700 1 -- 172.21.15.63:0/3577080204 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f018c012330 con 0x7f019805f110 2020-05-18T21:27:59.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.353+0000 7f019e082700 1 -- 172.21.15.63:0/3577080204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0198061420 con 0x7f019805f110 2020-05-18T21:27:59.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.357+0000 7f019d080700 1 --2- 172.21.15.63:0/3577080204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f019805f110 0x7f01980634e0 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f018c0030b0 tx=0x7f018c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.357+0000 7f019e082700 1 -- 172.21.15.63:0/3577080204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01980569e0 con 0x7f019805f110 2020-05-18T21:27:59.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.357+0000 7f018a7fc700 1 -- 172.21.15.63:0/3577080204 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f018c0125a0 con 0x7f019805f110 2020-05-18T21:27:59.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.357+0000 7f019d080700 1 --2- 172.21.15.63:0/3577080204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f019805f110 0x7f01980634e0 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f018c0030b0 tx=0x7f018c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.357+0000 7f018a7fc700 1 --2- 172.21.15.63:0/3577080204 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f018004f8b0 0x7f0180051d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:59.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.357+0000 7f018a7fc700 1 -- 172.21.15.63:0/3577080204 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f018c0641f0 con 0x7f019805f110 2020-05-18T21:27:59.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.357+0000 7f019c87f700 1 --2- 172.21.15.63:0/3577080204 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f018004f8b0 0x7f0180051d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:59.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.357+0000 7f019c87f700 1 --2- 172.21.15.63:0/3577080204 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f018004f8b0 0x7f0180051d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0194000bc0 tx=0x7f01940039a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.357+0000 7f019c87f700 1 --2- 172.21.15.63:0/3577080204 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f018004f8b0 0x7f0180051d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0194000bc0 tx=0x7f01940039a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.357+0000 7f019c87f700 1 --2- 172.21.15.63:0/3577080204 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f018004f8b0 0x7f0180051d70 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f0194000bc0 tx=0x7f01940039a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:59.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.361+0000 7f019d080700 1 --2- 172.21.15.63:0/3577080204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f019805f110 0x7f01980634e0 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f018c0030b0 tx=0x7f018c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.361+0000 7f018a7fc700 1 -- 172.21.15.63:0/3577080204 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f018c03e580 con 0x7f019805f110 2020-05-18T21:27:59.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.481+0000 7f019e082700 1 -- 172.21.15.63:0/3577080204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f01980b2720 con 0x7f019805f110 2020-05-18T21:27:59.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.481+0000 7f019d080700 1 --2- 172.21.15.63:0/3577080204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f019805f110 0x7f01980634e0 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f018c0030b0 tx=0x7f018c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.481+0000 7f018a7fc700 1 -- 172.21.15.63:0/3577080204 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v33) v1 ==== 81+0+33696 (secure 0 0 0) 0x7f018c041ba0 con 0x7f019805f110 2020-05-18T21:27:59.490 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:59.490 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:27:59.491 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 33, 2020-05-18T21:27:59.491 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:27:59.491 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2020-05-18T21:26:28.798650+0000", 2020-05-18T21:27:59.491 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2020-05-18T21:27:32.887660+0000", 2020-05-18T21:27:59.491 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:27:59.492 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:27:59.492 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-05-18T21:27:59.492 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5799936, 2020-05-18T21:27:59.492 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2020-05-18T21:27:59.492 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2020-05-18T21:27:59.493 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2020-05-18T21:27:59.493 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2020-05-18T21:27:59.493 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2020-05-18T21:27:59.493 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:27:59.493 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 4, 2020-05-18T21:27:59.494 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2020-05-18T21:27:59.494 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-05-18T21:27:59.494 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2020-05-18T21:27:59.494 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2020-05-18T21:27:59.494 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 6, 2020-05-18T21:27:59.495 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 8, 2020-05-18T21:27:59.495 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2020-05-18T21:27:59.495 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "jewel", 2020-05-18T21:27:59.495 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "pacific", 2020-05-18T21:27:59.495 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:27:59.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.496 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2020-05-18T21:27:59.496 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "device_health_metrics", 2020-05-18T21:27:59.496 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:33.080792+0000", 2020-05-18T21:27:59.496 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:27:59.496 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:27:59.497 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:27:59.497 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:27:59.497 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:27:59.497 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:27:59.497 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:27:59.498 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:27:59.498 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2020-05-18T21:27:59.498 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2020-05-18T21:27:59.498 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2020-05-18T21:27:59.498 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2020-05-18T21:27:59.499 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2020-05-18T21:27:59.499 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:27:59.499 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:27:59.499 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:27:59.499 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:27:59.499 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:27:59.500 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:27:59.500 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:27:59.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.500 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "15", 2020-05-18T21:27:59.500 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:27:59.501 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:27:59.501 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:27:59.501 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:27:59.501 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:27:59.501 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:27:59.502 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:27:59.502 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:27:59.502 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:27:59.502 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:27:59.502 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:27:59.503 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:27:59.503 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:27:59.503 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:27:59.503 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:27:59.503 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:27:59.503 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:27:59.504 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:27:59.504 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:27:59.504 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:27:59.504 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:27:59.504 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:27:59.505 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:27:59.505 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:27:59.505 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:27:59.505 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:27:59.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.505 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:27:59.506 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:27:59.506 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:27:59.506 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:27:59.506 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:27:59.506 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:27:59.507 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:27:59.507 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:27:59.507 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:27:59.507 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:27:59.507 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:27:59.508 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:27:59.508 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2020-05-18T21:27:59.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.508 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:27:59.508 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_devicehealth": {} 2020-05-18T21:27:59.508 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.509 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2020-05-18T21:27:59.509 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2020-05-18T21:27:59.509 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:40.149370+0000", 2020-05-18T21:27:59.510 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:27:59.510 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:27:59.510 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:27:59.510 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:27:59.510 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:27:59.511 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:27:59.511 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:27:59.511 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:27:59.511 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:27:59.511 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:27:59.511 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:27:59.512 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:27:59.512 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:27:59.512 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:27:59.512 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:27:59.512 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:27:59.513 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:27:59.513 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:27:59.513 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:27:59.513 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:27:59.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.514 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2020-05-18T21:27:59.514 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:27:59.514 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:27:59.514 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:27:59.514 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:27:59.514 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:27:59.515 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:27:59.515 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:27:59.515 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:27:59.515 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:27:59.515 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:27:59.516 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:27:59.516 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:27:59.516 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:27:59.516 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:27:59.516 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:27:59.516 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:27:59.517 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:27:59.517 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:27:59.517 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:27:59.517 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:27:59.517 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:27:59.518 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:27:59.518 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:27:59.518 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:27:59.518 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:27:59.518 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:27:59.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.519 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:27:59.519 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:27:59.519 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:27:59.519 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:27:59.519 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:27:59.520 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:27:59.520 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:27:59.520 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:27:59.520 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:27:59.520 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:27:59.521 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:27:59.521 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:27:59.521 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:27:59.521 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2020-05-18T21:27:59.521 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.522 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 5, 2020-05-18T21:27:59.522 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2020-05-18T21:27:59.522 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:27:29.817430+0000", 2020-05-18T21:27:59.522 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:27:59.523 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:27:59.523 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:27:59.523 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:27:59.523 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:27:59.523 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:27:59.524 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:27:59.524 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:27:59.524 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:27:59.524 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:27:59.524 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:27:59.524 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:27:59.525 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:27:59.525 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:27:59.525 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:27:59.525 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:27:59.525 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:27:59.526 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:27:59.526 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:27:59.526 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:27:59.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.526 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "32", 2020-05-18T21:27:59.527 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:27:59.527 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:27:59.527 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:27:59.527 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:27:59.527 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:27:59.527 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:27:59.528 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:27:59.528 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:27:59.528 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:27:59.528 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:27:59.528 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:27:59.529 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:27:59.529 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:27:59.529 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:27:59.529 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:27:59.529 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:27:59.529 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:27:59.530 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:27:59.530 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:27:59.530 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:27:59.530 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:27:59.530 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:27:59.531 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:27:59.531 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:27:59.531 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:27:59.531 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:27:59.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.532 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:27:59.532 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:27:59.532 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:27:59.532 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:27:59.532 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:27:59.532 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:27:59.533 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:27:59.533 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:27:59.533 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:27:59.533 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:27:59.533 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:27:59.534 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:27:59.534 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2020-05-18T21:27:59.534 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2020-05-18T21:27:59.534 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2020-05-18T21:27:59.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.534 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:27:59.535 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:27:59.535 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2020-05-18T21:27:59.535 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.535 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.536 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 6, 2020-05-18T21:27:59.536 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2020-05-18T21:27:59.536 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:27:30.879596+0000", 2020-05-18T21:27:59.536 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:27:59.537 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:27:59.537 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:27:59.537 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:27:59.537 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:27:59.537 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:27:59.538 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:27:59.538 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:27:59.538 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:27:59.538 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:27:59.538 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:27:59.538 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:27:59.539 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:27:59.539 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:27:59.539 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:27:59.539 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:27:59.539 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:27:59.540 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:27:59.540 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:27:59.540 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:27:59.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.540 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "33", 2020-05-18T21:27:59.541 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:27:59.541 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:27:59.541 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:27:59.541 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:27:59.541 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:27:59.541 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:27:59.542 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:27:59.542 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:27:59.542 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:27:59.542 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:27:59.542 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:27:59.543 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:27:59.543 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:27:59.543 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:27:59.543 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:27:59.543 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:27:59.544 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:27:59.544 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:27:59.544 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:27:59.544 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:27:59.544 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:27:59.544 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:27:59.545 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:27:59.545 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:27:59.545 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:27:59.545 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:27:59.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.546 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:27:59.546 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:27:59.552 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:27:59.552 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:27:59.552 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:27:59.552 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:27:59.553 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:27:59.553 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:27:59.553 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:27:59.553 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:27:59.553 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:27:59.554 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:27:59.554 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:27:59.554 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:27:59.554 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2020-05-18T21:27:59.554 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.555 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.555 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.555 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:27:59.555 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2020-05-18T21:27:59.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.556 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:27:59.556 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "c6ae0fbf-604c-4e8d-b1b8-6038821420e3", 2020-05-18T21:27:59.556 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:27:59.556 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:27:59.556 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:27:59.557 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:27:59.557 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:27:59.557 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:27:59.557 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:27:59.557 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 31, 2020-05-18T21:27:59.558 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:27:59.558 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:27:59.558 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:27:59.558 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.558 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.559 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2020-05-18T21:27:59.559 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:27:59.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.559 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.560 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2020-05-18T21:27:59.560 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:27:59.560 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.560 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.561 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:27:59.561 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.561 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.561 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6802", 2020-05-18T21:27:59.562 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:27:59.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.562 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.562 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6803", 2020-05-18T21:27:59.563 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:27:59.563 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.563 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.563 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:27:59.563 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.564 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.564 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6806", 2020-05-18T21:27:59.564 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:27:59.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.565 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.565 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6807", 2020-05-18T21:27:59.565 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:27:59.565 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.566 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.566 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:27:59.566 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.567 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.567 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6804", 2020-05-18T21:27:59.567 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:27:59.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.567 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.568 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6805", 2020-05-18T21:27:59.568 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:27:59.568 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.568 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.569 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6801/12803", 2020-05-18T21:27:59.569 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6803/12803", 2020-05-18T21:27:59.569 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6807/12803", 2020-05-18T21:27:59.569 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6805/12803", 2020-05-18T21:27:59.569 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:27:59.570 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:27:59.570 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:27:59.570 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.571 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:27:59.571 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6", 2020-05-18T21:27:59.571 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:27:59.571 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:27:59.571 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:27:59.571 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:27:59.572 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:27:59.572 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:27:59.572 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:27:59.572 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 31, 2020-05-18T21:27:59.572 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:27:59.573 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:27:59.573 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:27:59.573 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.573 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.574 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6808", 2020-05-18T21:27:59.574 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:27:59.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.574 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.575 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6809", 2020-05-18T21:27:59.575 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:27:59.575 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.575 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.576 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:27:59.576 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.576 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.576 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6810", 2020-05-18T21:27:59.576 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:27:59.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.577 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.578 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6811", 2020-05-18T21:27:59.578 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:27:59.578 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.578 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.579 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:27:59.579 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.579 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.579 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6815", 2020-05-18T21:27:59.579 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:27:59.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.580 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.580 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6817", 2020-05-18T21:27:59.580 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:27:59.581 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.581 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.581 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:27:59.581 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.582 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.582 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6812", 2020-05-18T21:27:59.582 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:27:59.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.583 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.583 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6813", 2020-05-18T21:27:59.583 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:27:59.583 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.584 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.584 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6809/12804", 2020-05-18T21:27:59.584 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6811/12804", 2020-05-18T21:27:59.584 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6817/12804", 2020-05-18T21:27:59.585 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6813/12804", 2020-05-18T21:27:59.585 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:27:59.585 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:27:59.585 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:27:59.585 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.586 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:27:59.586 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "ec8d9fa9-dae9-45f6-b286-735ab3801c27", 2020-05-18T21:27:59.586 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:27:59.586 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:27:59.587 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:27:59.587 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:27:59.587 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:27:59.587 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:27:59.587 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:27:59.588 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 30, 2020-05-18T21:27:59.588 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:27:59.588 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:27:59.588 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:27:59.588 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.589 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.589 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6822", 2020-05-18T21:27:59.589 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:27:59.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.590 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.590 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6824", 2020-05-18T21:27:59.590 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:27:59.590 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.590 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.591 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:27:59.591 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.591 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.592 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6826", 2020-05-18T21:27:59.592 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:27:59.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.592 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.592 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6827", 2020-05-18T21:27:59.593 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:27:59.593 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.593 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.593 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:27:59.594 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.594 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.594 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6830", 2020-05-18T21:27:59.594 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:27:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6831", 2020-05-18T21:27:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:27:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:27:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6828", 2020-05-18T21:27:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:27:59.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.598 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.598 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6829", 2020-05-18T21:27:59.598 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:27:59.598 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.599 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.599 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6824/12806", 2020-05-18T21:27:59.599 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6827/12806", 2020-05-18T21:27:59.599 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6831/12806", 2020-05-18T21:27:59.600 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6829/12806", 2020-05-18T21:27:59.600 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:27:59.600 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:27:59.600 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:27:59.600 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.601 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:27:59.601 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "1030fedf-adad-4e79-b839-59385d4d7d2a", 2020-05-18T21:27:59.601 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:27:59.602 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:27:59.602 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:27:59.602 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:27:59.602 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:27:59.602 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:27:59.603 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:27:59.603 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 31, 2020-05-18T21:27:59.603 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:27:59.603 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:27:59.603 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:27:59.604 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.604 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.604 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6814", 2020-05-18T21:27:59.604 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:27:59.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.605 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.605 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6816", 2020-05-18T21:27:59.605 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:27:59.605 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.606 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.606 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:27:59.606 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.607 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.607 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6818", 2020-05-18T21:27:59.607 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:27:59.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.608 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.608 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6819", 2020-05-18T21:27:59.608 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:27:59.608 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.608 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.609 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:27:59.609 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.609 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.609 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6823", 2020-05-18T21:27:59.610 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:27:59.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.610 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.610 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6825", 2020-05-18T21:27:59.611 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:27:59.611 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.611 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.611 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:27:59.611 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.612 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.612 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6820", 2020-05-18T21:27:59.612 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:27:59.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.613 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.613 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6821", 2020-05-18T21:27:59.613 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:27:59.613 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.614 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.614 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6816/12805", 2020-05-18T21:27:59.614 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6819/12805", 2020-05-18T21:27:59.614 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6825/12805", 2020-05-18T21:27:59.615 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6821/12805", 2020-05-18T21:27:59.615 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:27:59.615 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:27:59.615 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:27:59.615 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.616 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:27:59.616 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "8ad15a9b-97b4-4002-b1d4-7292e09b4ef6", 2020-05-18T21:27:59.616 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:27:59.616 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:27:59.617 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:27:59.617 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:27:59.617 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:27:59.617 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:27:59.617 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:27:59.618 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 31, 2020-05-18T21:27:59.618 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:27:59.618 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:27:59.618 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:27:59.618 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.619 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.619 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6800", 2020-05-18T21:27:59.619 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:27:59.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.620 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.620 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6801", 2020-05-18T21:27:59.620 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:27:59.620 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.620 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.621 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:27:59.621 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.621 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.622 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6802", 2020-05-18T21:27:59.622 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:27:59.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.622 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.622 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6803", 2020-05-18T21:27:59.623 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:27:59.623 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.623 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.623 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:27:59.624 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.624 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.624 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6806", 2020-05-18T21:27:59.624 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:27:59.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.625 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.625 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6807", 2020-05-18T21:27:59.625 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:27:59.625 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.626 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.626 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:27:59.626 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6804", 2020-05-18T21:27:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:27:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6805", 2020-05-18T21:27:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:27:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6801/13023", 2020-05-18T21:27:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6803/13023", 2020-05-18T21:27:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6807/13023", 2020-05-18T21:27:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6805/13023", 2020-05-18T21:27:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:27:59.630 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:27:59.630 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:27:59.630 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.631 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:27:59.631 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0dce88f8-b984-43e1-95e2-4132171102d2", 2020-05-18T21:27:59.631 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:27:59.631 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:27:59.631 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:27:59.632 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:27:59.632 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:27:59.632 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:27:59.632 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:27:59.632 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 31, 2020-05-18T21:27:59.632 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:27:59.633 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:27:59.633 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:27:59.633 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.633 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.634 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6808", 2020-05-18T21:27:59.634 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:27:59.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.634 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.635 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6809", 2020-05-18T21:27:59.635 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:27:59.635 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.635 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.635 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:27:59.636 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.636 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.636 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6810", 2020-05-18T21:27:59.636 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:27:59.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.637 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.637 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6811", 2020-05-18T21:27:59.637 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:27:59.638 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.638 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.638 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:27:59.638 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.639 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.639 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6814", 2020-05-18T21:27:59.639 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:27:59.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.640 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.640 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6816", 2020-05-18T21:27:59.640 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:27:59.640 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.640 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.641 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:27:59.641 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.641 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.642 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6812", 2020-05-18T21:27:59.642 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:27:59.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.642 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.643 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6813", 2020-05-18T21:27:59.643 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:27:59.643 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.643 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.644 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6809/13024", 2020-05-18T21:27:59.644 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6811/13024", 2020-05-18T21:27:59.644 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6816/13024", 2020-05-18T21:27:59.644 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6813/13024", 2020-05-18T21:27:59.644 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:27:59.644 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:27:59.645 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:27:59.645 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.645 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:27:59.646 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "e1bc92f8-3692-4483-b0fb-905c94fa1469", 2020-05-18T21:27:59.646 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:27:59.646 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:27:59.646 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:27:59.646 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:27:59.647 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:27:59.647 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:27:59.647 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:27:59.647 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 30, 2020-05-18T21:27:59.647 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:27:59.648 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:27:59.648 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:27:59.648 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.648 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.648 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6815", 2020-05-18T21:27:59.649 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:27:59.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.649 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.649 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6817", 2020-05-18T21:27:59.650 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:27:59.650 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.650 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.650 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:27:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6818", 2020-05-18T21:27:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:27:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6819", 2020-05-18T21:27:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:27:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:27:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6822", 2020-05-18T21:27:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:27:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6824", 2020-05-18T21:27:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:27:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:27:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6820", 2020-05-18T21:27:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:27:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6821", 2020-05-18T21:27:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:27:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6817/13025", 2020-05-18T21:27:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6819/13025", 2020-05-18T21:27:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6824/13025", 2020-05-18T21:27:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6821/13025", 2020-05-18T21:27:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:27:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:27:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:27:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:27:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "b76e000c-a078-48c4-9e1e-34d286a9992c", 2020-05-18T21:27:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:27:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:27:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:27:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:27:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:27:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:27:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:27:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 31, 2020-05-18T21:27:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:27:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:27:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:27:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6823", 2020-05-18T21:27:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:27:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6825", 2020-05-18T21:27:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:27:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:27:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6826", 2020-05-18T21:27:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:27:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6827", 2020-05-18T21:27:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:27:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:27:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6830", 2020-05-18T21:27:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:27:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6831", 2020-05-18T21:27:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:27:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.671 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.671 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:27:59.671 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:27:59.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.672 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:27:59.672 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6828", 2020-05-18T21:27:59.672 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:27:59.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.672 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:27:59.673 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6829", 2020-05-18T21:27:59.673 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:27:59.673 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.673 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.674 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6825/13026", 2020-05-18T21:27:59.674 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6827/13026", 2020-05-18T21:27:59.674 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6831/13026", 2020-05-18T21:27:59.674 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6829/13026", 2020-05-18T21:27:59.674 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:27:59.675 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:27:59.675 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:27:59.675 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:27:59.675 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.675 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:27:59.676 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2020-05-18T21:27:59.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.676 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:27:59.676 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:27:59.676 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:27:59.677 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:27:59.677 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:27:59.677 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:27:59.677 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.281434+0000", 2020-05-18T21:27:59.677 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:27:59.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.678 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:27:59.678 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:27:59.679 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:27:59.679 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:27:59.679 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:27:59.679 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:27:59.679 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.608518+0000", 2020-05-18T21:27:59.680 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:27:59.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.680 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:27:59.680 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:27:59.680 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:27:59.681 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:27:59.681 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:27:59.681 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:27:59.681 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.582386+0000", 2020-05-18T21:27:59.681 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:27:59.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.682 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:27:59.682 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:27:59.682 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:27:59.683 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:27:59.683 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:27:59.683 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:27:59.683 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.573488+0000", 2020-05-18T21:27:59.683 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:27:59.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.684 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:27:59.684 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:27:59.684 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:27:59.684 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:27:59.685 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:27:59.685 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:27:59.685 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.604174+0000", 2020-05-18T21:27:59.685 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:27:59.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.686 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:27:59.686 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:27:59.686 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:27:59.686 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:27:59.687 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:27:59.687 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:27:59.687 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.371004+0000", 2020-05-18T21:27:59.687 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:27:59.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.688 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:27:59.688 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:27:59.688 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:27:59.688 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:27:59.688 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:27:59.689 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:27:59.689 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.593070+0000", 2020-05-18T21:27:59.689 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:27:59.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:27:59.690 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:27:59.690 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:27:59.690 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:27:59.690 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:27:59.690 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:27:59.691 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:27:59.691 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.667677+0000", 2020-05-18T21:27:59.691 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:27:59.691 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.691 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:27:59.692 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2020-05-18T21:27:59.692 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2020-05-18T21:27:59.692 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2020-05-18T21:27:59.692 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2020-05-18T21:27:59.692 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklist": {}, 2020-05-18T21:27:59.692 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2020-05-18T21:27:59.693 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2020-05-18T21:27:59.693 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2020-05-18T21:27:59.693 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2020-05-18T21:27:59.693 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2020-05-18T21:27:59.693 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2020-05-18T21:27:59.694 INFO:teuthology.orchestra.run.smithi063.stdout: "ruleset-failure-domain": "osd", 2020-05-18T21:27:59.694 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2020-05-18T21:27:59.694 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:27:59.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:27:59.694 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2020-05-18T21:27:59.695 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2020-05-18T21:27:59.695 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2020-05-18T21:27:59.695 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2020-05-18T21:27:59.695 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {} 2020-05-18T21:27:59.695 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:27:59.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.485+0000 7f019e082700 1 -- 172.21.15.63:0/3577080204 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f018004f8b0 msgr2=0x7f0180051d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:59.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.485+0000 7f019e082700 1 --2- 172.21.15.63:0/3577080204 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f018004f8b0 0x7f0180051d70 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f0194000bc0 tx=0x7f01940039a0).stop 2020-05-18T21:27:59.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.485+0000 7f019e082700 1 -- 172.21.15.63:0/3577080204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f019805f110 msgr2=0x7f01980634e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:59.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.485+0000 7f019e082700 1 --2- 172.21.15.63:0/3577080204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f019805f110 0x7f01980634e0 secure :-1 s=READY pgs=423 cs=0 l=1 rx=0x7f018c0030b0 tx=0x7f018c010cd0).stop 2020-05-18T21:27:59.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.485+0000 7f019e082700 1 -- 172.21.15.63:0/3577080204 shutdown_connections 2020-05-18T21:27:59.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.485+0000 7f019e082700 1 --2- 172.21.15.63:0/3577080204 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f018004f8b0 0x7f0180051d70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:59.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.485+0000 7f019e082700 1 --2- 172.21.15.63:0/3577080204 >> v2:172.21.15.155:3300/0 conn(0x7f01980b81b0 0x7f0198127d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:59.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.485+0000 7f019e082700 1 --2- 172.21.15.63:0/3577080204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f019805f110 0x7f01980634e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:59.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.485+0000 7f019e082700 1 -- 172.21.15.63:0/3577080204 >> 172.21.15.63:0/3577080204 conn(0x7f0198069fc0 msgr2=0x7f019805c280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:59.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.485+0000 7f019e082700 1 -- 172.21.15.63:0/3577080204 shutdown_connections 2020-05-18T21:27:59.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.485+0000 7f019e082700 1 -- 172.21.15.63:0/3577080204 wait complete. 2020-05-18T21:27:59.700 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:27:59.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f883b212700 1 Processor -- start 2020-05-18T21:27:59.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f883b212700 1 -- start start 2020-05-18T21:27:59.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f883b212700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883412a0e0 0x7f8834147e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:27:59.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f883b212700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8834144240 con 0x7f8834143da0 2020-05-18T21:27:59.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f883b212700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88341444e0 con 0x7f8834060b90 2020-05-18T21:27:59.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f883b212700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8834144780 con 0x7f883412a0e0 2020-05-18T21:27:59.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f8833fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8834143da0 0x7f88340650c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56746/0 (socket says 172.21.15.63:56746) 2020-05-18T21:27:59.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f8833fff700 1 -- 172.21.15.63:0/3258147232 learned_addr learned my addr 172.21.15.63:0/3258147232 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:59.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f88397af700 1 --2- 172.21.15.63:0/3258147232 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883412a0e0 0x7f8834147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:59.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f88337fe700 1 -- 172.21.15.63:0/3258147232 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1777440327 0 0) 0x7f8834144240 con 0x7f8834143da0 2020-05-18T21:27:59.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f88337fe700 1 -- 172.21.15.63:0/3258147232 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8820003270 con 0x7f8834143da0 2020-05-18T21:27:59.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f88337fe700 1 -- 172.21.15.63:0/3258147232 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122910159 0 0) 0x7f88341444e0 con 0x7f8834060b90 2020-05-18T21:27:59.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f88337fe700 1 -- 172.21.15.63:0/3258147232 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8834144240 con 0x7f8834060b90 2020-05-18T21:27:59.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f88397af700 1 -- 172.21.15.63:0/3258147232 >> v1:172.21.15.155:6789/0 conn(0x7f8834060b90 legacy=0x7f88341299d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:59.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f88397af700 1 -- 172.21.15.63:0/3258147232 >> v1:172.21.15.63:6789/0 conn(0x7f8834143da0 legacy=0x7f88340650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:59.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f88397af700 1 -- 172.21.15.63:0/3258147232 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8834144c20 con 0x7f883412a0e0 2020-05-18T21:27:59.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f88397af700 1 --2- 172.21.15.63:0/3258147232 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883412a0e0 0x7f8834147e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f882c002f70 tx=0x7f882c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f88397af700 1 --2- 172.21.15.63:0/3258147232 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883412a0e0 0x7f8834147e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f882c002f70 tx=0x7f882c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f88397af700 1 --2- 172.21.15.63:0/3258147232 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883412a0e0 0x7f8834147e60 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f882c002f70 tx=0x7f882c008920).ready entity=mon.2 client_cookie=10094ed66608df9b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:59.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f88397af700 1 --2- 172.21.15.63:0/3258147232 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883412a0e0 0x7f8834147e60 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f882c002f70 tx=0x7f882c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f88397af700 1 --2- 172.21.15.63:0/3258147232 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883412a0e0 0x7f8834147e60 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f882c002f70 tx=0x7f882c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f88337fe700 1 -- 172.21.15.63:0/3258147232 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f882c008e80 con 0x7f883412a0e0 2020-05-18T21:27:59.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f88397af700 1 --2- 172.21.15.63:0/3258147232 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883412a0e0 0x7f8834147e60 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f882c002f70 tx=0x7f882c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f88337fe700 1 -- 172.21.15.63:0/3258147232 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c011580 con 0x7f883412a0e0 2020-05-18T21:27:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f88337fe700 1 -- 172.21.15.63:0/3258147232 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f882c011960 con 0x7f883412a0e0 2020-05-18T21:27:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f883b212700 1 -- 172.21.15.63:0/3258147232 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883412a0e0 msgr2=0x7f8834147e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.809+0000 7f883b212700 1 --2- 172.21.15.63:0/3258147232 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883412a0e0 0x7f8834147e60 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f882c002f70 tx=0x7f882c008920).stop 2020-05-18T21:27:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.813+0000 7f883b212700 1 -- 172.21.15.63:0/3258147232 shutdown_connections 2020-05-18T21:27:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.813+0000 7f883b212700 1 --2- 172.21.15.63:0/3258147232 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883412a0e0 0x7f8834147e60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:59.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.813+0000 7f883b212700 1 -- 172.21.15.63:0/3258147232 >> 172.21.15.63:0/3258147232 conn(0x7f88340b83d0 msgr2=0x7f88340b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:59.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.813+0000 7f883b212700 1 -- 172.21.15.63:0/3258147232 shutdown_connections 2020-05-18T21:27:59.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.813+0000 7f883b212700 1 -- 172.21.15.63:0/3258147232 wait complete. 2020-05-18T21:27:59.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.813+0000 7f883b212700 1 Processor -- start 2020-05-18T21:27:59.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.813+0000 7f883b212700 1 -- start start 2020-05-18T21:27:59.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.813+0000 7f883b212700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8834060b90 0x7f8834128ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:59.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.813+0000 7f883b212700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883412a0e0 0x7f88340acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:59.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.813+0000 7f883b212700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88340ad1d0 con 0x7f8834143da0 2020-05-18T21:27:59.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.813+0000 7f883b212700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883412b4d0 con 0x7f8834060b90 2020-05-18T21:27:59.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.813+0000 7f883b212700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88340ad410 con 0x7f883412a0e0 2020-05-18T21:27:59.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.813+0000 7f8833fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883412a0e0 0x7f88340acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:59.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.813+0000 7f8838fae700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8834060b90 0x7f8834128ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:59.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.813+0000 7f88397af700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f8834143da0 0x7f8834142cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:55070/0 (socket says 172.21.15.63:55070) 2020-05-18T21:27:59.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.813+0000 7f88397af700 1 -- 172.21.15.63:0/3565114585 learned_addr learned my addr 172.21.15.63:0/3565114585 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:27:59.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.813+0000 7f8833fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883412a0e0 0x7f88340acd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:45266/0 (socket says 172.21.15.63:45266) 2020-05-18T21:27:59.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f8838fae700 1 -- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883412a0e0 msgr2=0x7f88340acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:59.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f8838fae700 1 --2- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883412a0e0 0x7f88340acd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:59.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f8838fae700 1 -- 172.21.15.63:0/3565114585 >> v1:172.21.15.155:6789/0 conn(0x7f8834143da0 legacy=0x7f8834142cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:59.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f8838fae700 1 -- 172.21.15.63:0/3565114585 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88340ad6b0 con 0x7f8834060b90 2020-05-18T21:27:59.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f8831ffb700 1 -- 172.21.15.63:0/3565114585 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1938565046 0 0) 0x7f8834144c20 con 0x7f8834143da0 2020-05-18T21:27:59.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f8838fae700 1 --2- 172.21.15.63:0/3565114585 >> v2:172.21.15.155:3300/0 conn(0x7f8834060b90 0x7f8834128ae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8824001490 tx=0x7f8824010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f8838fae700 1 --2- 172.21.15.63:0/3565114585 >> v2:172.21.15.155:3300/0 conn(0x7f8834060b90 0x7f8834128ae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8824001490 tx=0x7f8824010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f8838fae700 1 --2- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8834060b90 0x7f8834128ae0 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7f8824001490 tx=0x7f8824010c60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:59.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f8838fae700 1 --2- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8834060b90 0x7f8834128ae0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f8824001490 tx=0x7f8824010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f8831ffb700 1 -- 172.21.15.63:0/3565114585 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8824012330 con 0x7f8834060b90 2020-05-18T21:27:59.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f8838fae700 1 --2- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8834060b90 0x7f8834128ae0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f8824001490 tx=0x7f8824010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f8831ffb700 1 -- 172.21.15.63:0/3565114585 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88240124d0 con 0x7f8834060b90 2020-05-18T21:27:59.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f8838fae700 1 --2- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8834060b90 0x7f8834128ae0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f8824001490 tx=0x7f8824010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f883b212700 1 -- 172.21.15.63:0/3565114585 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88340ad950 con 0x7f8834060b90 2020-05-18T21:27:59.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f8831ffb700 1 -- 172.21.15.63:0/3565114585 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88240128b0 con 0x7f8834060b90 2020-05-18T21:27:59.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f883b212700 1 -- 172.21.15.63:0/3565114585 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88341433e0 con 0x7f8834060b90 2020-05-18T21:27:59.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f8838fae700 1 --2- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8834060b90 0x7f8834128ae0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f8824001490 tx=0x7f8824010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f883b212700 1 -- 172.21.15.63:0/3565114585 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88340569e0 con 0x7f8834060b90 2020-05-18T21:27:59.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f8831ffb700 1 -- 172.21.15.63:0/3565114585 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8824012b30 con 0x7f8834060b90 2020-05-18T21:27:59.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f8838fae700 1 --2- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8834060b90 0x7f8834128ae0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f8824001490 tx=0x7f8824010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.817+0000 7f8831ffb700 1 --2- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f881404f890 0x7f8814051d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:27:59.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.821+0000 7f8831ffb700 1 -- 172.21.15.63:0/3565114585 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8824064410 con 0x7f8834060b90 2020-05-18T21:27:59.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.821+0000 7f8833fff700 1 --2- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f881404f890 0x7f8814051d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:27:59.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.821+0000 7f8833fff700 1 --2- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f881404f890 0x7f8814051d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8828001110 tx=0x7f8828001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.821+0000 7f8833fff700 1 --2- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f881404f890 0x7f8814051d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8828001110 tx=0x7f8828001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.821+0000 7f8833fff700 1 --2- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f881404f890 0x7f8814051d50 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7f8828001110 tx=0x7f8828001e40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:27:59.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.829+0000 7f8838fae700 1 --2- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8834060b90 0x7f8834128ae0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f8824001490 tx=0x7f8824010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.829+0000 7f8831ffb700 1 -- 172.21.15.63:0/3565114585 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f882403e740 con 0x7f8834060b90 2020-05-18T21:27:59.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.981+0000 7f883b212700 1 -- 172.21.15.63:0/3565114585 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8834143b80 con 0x7f8834060b90 2020-05-18T21:27:59.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.981+0000 7f8838fae700 1 --2- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8834060b90 0x7f8834128ae0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f8824001490 tx=0x7f8824010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:27:59.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.981+0000 7f8831ffb700 1 -- 172.21.15.63:0/3565114585 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f8824041d60 con 0x7f8834060b90 2020-05-18T21:27:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:27:59.989 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5055,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2600411689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2600411689},{"type":"v1","addr":"172.21.15.63:6833","nonce":2600411689}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:27:31.884487+0000","modified":"2020-05-18T21:27:32.888860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5064},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5064":{"gid":5064,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1028402057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1028402057},{"type":"v1","addr":"172.21.15.155:6835","nonce":1028402057}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-05-18T21:27:59.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.985+0000 7f883b212700 1 -- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f881404f890 msgr2=0x7f8814051d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:59.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.985+0000 7f883b212700 1 --2- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f881404f890 0x7f8814051d50 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7f8828001110 tx=0x7f8828001e40).stop 2020-05-18T21:27:59.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.985+0000 7f883b212700 1 -- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8834060b90 msgr2=0x7f8834128ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:27:59.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.985+0000 7f883b212700 1 --2- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8834060b90 0x7f8834128ae0 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7f8824001490 tx=0x7f8824010c60).stop 2020-05-18T21:27:59.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.985+0000 7f883b212700 1 -- 172.21.15.63:0/3565114585 shutdown_connections 2020-05-18T21:27:59.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.985+0000 7f883b212700 1 --2- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f881404f890 0x7f8814051d50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:59.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.985+0000 7f883b212700 1 --2- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883412a0e0 0x7f88340acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:59.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.985+0000 7f883b212700 1 --2- 172.21.15.63:0/3565114585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8834060b90 0x7f8834128ae0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:27:59.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.985+0000 7f883b212700 1 -- 172.21.15.63:0/3565114585 >> 172.21.15.63:0/3565114585 conn(0x7f88340b83d0 msgr2=0x7f88340b7820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:27:59.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.985+0000 7f883b212700 1 -- 172.21.15.63:0/3565114585 shutdown_connections 2020-05-18T21:27:59.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:27:59.985+0000 7f883b212700 1 -- 172.21.15.63:0/3565114585 wait complete. 2020-05-18T21:27:59.993 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 12 2020-05-18T21:28:00.002 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-05-18T21:28:00.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb97d6700 1 Processor -- start 2020-05-18T21:28:00.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb97d6700 1 -- start start 2020-05-18T21:28:00.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb97d6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdfb4133bc0 0x7fdfb414db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:00.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb97d6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b3830 0x7fdfb40b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:00.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb97d6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb4133fa0 con 0x7fdfb40b2820 2020-05-18T21:28:00.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb97d6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb40b2cb0 con 0x7fdfb4133bc0 2020-05-18T21:28:00.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb97d6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40b1e40 con 0x7fdfb40b3830 2020-05-18T21:28:00.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb2ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdfb4133bc0 0x7fdfb414db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:00.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb2ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdfb4133bc0 0x7fdfb414db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54570/0 (socket says 172.21.15.63:54570) 2020-05-18T21:28:00.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb2ffd700 1 -- 172.21.15.63:0/244203717 learned_addr learned my addr 172.21.15.63:0/244203717 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:00.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb37fe700 1 --2- 172.21.15.63:0/244203717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b3830 0x7fdfb40b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:00.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb2ffd700 1 -- 172.21.15.63:0/244203717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b3830 msgr2=0x7fdfb40b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:00.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/244203717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b3830 0x7fdfb40b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:00.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb2ffd700 1 -- 172.21.15.63:0/244203717 >> v1:172.21.15.155:6789/0 conn(0x7fdfb40b2820 legacy=0x7fdfb40b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:00.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb1ffb700 1 -- 172.21.15.63:0/244203717 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377051439 0 0) 0x7fdfb4133fa0 con 0x7fdfb40b2820 2020-05-18T21:28:00.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb2ffd700 1 -- 172.21.15.63:0/244203717 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb40b20e0 con 0x7fdfb4133bc0 2020-05-18T21:28:00.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/244203717 >> v2:172.21.15.63:3300/0 conn(0x7fdfb4133bc0 0x7fdfb414db90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdf9c002f70 tx=0x7fdf9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:00.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/244203717 >> v2:172.21.15.63:3300/0 conn(0x7fdfb4133bc0 0x7fdfb414db90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdf9c002f70 tx=0x7fdf9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:00.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/244203717 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb4133bc0 0x7fdfb414db90 secure :-1 s=READY pgs=425 cs=0 l=1 rx=0x7fdf9c002f70 tx=0x7fdf9c007a80).ready entity=mon.0 client_cookie=6a1f5884375cd741 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:00.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/244203717 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb4133bc0 0x7fdfb414db90 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7fdf9c002f70 tx=0x7fdf9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:00.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb1ffb700 1 -- 172.21.15.63:0/244203717 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf9c0116b0 con 0x7fdfb4133bc0 2020-05-18T21:28:00.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/244203717 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb4133bc0 0x7fdfb414db90 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7fdf9c002f70 tx=0x7fdf9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:00.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb1ffb700 1 -- 172.21.15.63:0/244203717 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9c011810 con 0x7fdfb4133bc0 2020-05-18T21:28:00.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/244203717 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb4133bc0 0x7fdfb414db90 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7fdf9c002f70 tx=0x7fdf9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:00.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb1ffb700 1 -- 172.21.15.63:0/244203717 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf9c011bf0 con 0x7fdfb4133bc0 2020-05-18T21:28:00.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb97d6700 1 -- 172.21.15.63:0/244203717 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb4133bc0 msgr2=0x7fdfb414db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:00.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb97d6700 1 --2- 172.21.15.63:0/244203717 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb4133bc0 0x7fdfb414db90 secure :-1 s=READY pgs=425 cs=0 l=1 rx=0x7fdf9c002f70 tx=0x7fdf9c007a80).stop 2020-05-18T21:28:00.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb97d6700 1 -- 172.21.15.63:0/244203717 shutdown_connections 2020-05-18T21:28:00.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb97d6700 1 --2- 172.21.15.63:0/244203717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b3830 0x7fdfb40b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:00.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb97d6700 1 --2- 172.21.15.63:0/244203717 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb4133bc0 0x7fdfb414db90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:00.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb97d6700 1 -- 172.21.15.63:0/244203717 >> 172.21.15.63:0/244203717 conn(0x7fdfb405f6f0 msgr2=0x7fdfb40b8810 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:00.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb97d6700 1 -- 172.21.15.63:0/244203717 shutdown_connections 2020-05-18T21:28:00.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.093+0000 7fdfb97d6700 1 -- 172.21.15.63:0/244203717 wait complete. 2020-05-18T21:28:00.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfb97d6700 1 Processor -- start 2020-05-18T21:28:00.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfb97d6700 1 -- start start 2020-05-18T21:28:00.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfb97d6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b2820 0x7fdfb40ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:00.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfb97d6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdfb4133bc0 0x7fdfb4060f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:00.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfb97d6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb414e4f0 con 0x7fdfb40b3830 2020-05-18T21:28:00.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfb97d6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb40acc70 con 0x7fdfb4133bc0 2020-05-18T21:28:00.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfb97d6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb414dd10 con 0x7fdfb40b2820 2020-05-18T21:28:00.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfb27fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdfb40b3830 0x7fdfb40ae1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56764/0 (socket says 172.21.15.63:56764) 2020-05-18T21:28:00.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfb27fc700 1 -- 172.21.15.63:0/1093937614 learned_addr learned my addr 172.21.15.63:0/1093937614 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:00.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b2820 0x7fdfb40ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:00.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfb37fe700 1 --2- 172.21.15.63:0/1093937614 >> v2:172.21.15.155:3300/0 conn(0x7fdfb4133bc0 0x7fdfb4060f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:00.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfabfff700 1 -- 172.21.15.63:0/1093937614 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003967061 0 0) 0x7fdfb414e4f0 con 0x7fdfb40b3830 2020-05-18T21:28:00.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfabfff700 1 -- 172.21.15.63:0/1093937614 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf98002fe0 con 0x7fdfb40b3830 2020-05-18T21:28:00.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfb2ffd700 1 -- 172.21.15.63:0/1093937614 >> v2:172.21.15.155:3300/0 conn(0x7fdfb4133bc0 msgr2=0x7fdfb4060f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:00.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/1093937614 >> v2:172.21.15.155:3300/0 conn(0x7fdfb4133bc0 0x7fdfb4060f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:00.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfb2ffd700 1 -- 172.21.15.63:0/1093937614 >> v1:172.21.15.63:6789/0 conn(0x7fdfb40b3830 legacy=0x7fdfb40ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:00.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfb2ffd700 1 -- 172.21.15.63:0/1093937614 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb414dfb0 con 0x7fdfb40b2820 2020-05-18T21:28:00.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfb37fe700 1 --2- 172.21.15.63:0/1093937614 >> v2:172.21.15.155:3300/0 conn(0x7fdfb4133bc0 0x7fdfb4060f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:00.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b2820 0x7fdfb40ac810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdf9c002f70 tx=0x7fdf9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:00.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b2820 0x7fdfb40ac810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdf9c002f70 tx=0x7fdf9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:00.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.097+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b2820 0x7fdfb40ac810 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fdf9c002f70 tx=0x7fdf9c007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:00.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.101+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b2820 0x7fdfb40ac810 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fdf9c002f70 tx=0x7fdf9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:00.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.101+0000 7fdfabfff700 1 -- 172.21.15.63:0/1093937614 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf9c011e70 con 0x7fdfb40b2820 2020-05-18T21:28:00.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.101+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b2820 0x7fdfb40ac810 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fdf9c002f70 tx=0x7fdf9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:00.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.101+0000 7fdfabfff700 1 -- 172.21.15.63:0/1093937614 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9c011c40 con 0x7fdfb40b2820 2020-05-18T21:28:00.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.101+0000 7fdfb97d6700 1 -- 172.21.15.63:0/1093937614 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb414e250 con 0x7fdfb40b2820 2020-05-18T21:28:00.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.101+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b2820 0x7fdfb40ac810 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fdf9c002f70 tx=0x7fdf9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:00.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.101+0000 7fdfabfff700 1 -- 172.21.15.63:0/1093937614 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf9c007550 con 0x7fdfb40b2820 2020-05-18T21:28:00.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.101+0000 7fdfb97d6700 1 -- 172.21.15.63:0/1093937614 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb414c650 con 0x7fdfb40b2820 2020-05-18T21:28:00.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.101+0000 7fdfb97d6700 1 -- 172.21.15.63:0/1093937614 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb40569e0 con 0x7fdfb40b2820 2020-05-18T21:28:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.101+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b2820 0x7fdfb40ac810 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fdf9c002f70 tx=0x7fdf9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.101+0000 7fdfabfff700 1 -- 172.21.15.63:0/1093937614 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fdf9c005700 con 0x7fdfb40b2820 2020-05-18T21:28:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.101+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b2820 0x7fdfb40ac810 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fdf9c002f70 tx=0x7fdf9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.101+0000 7fdfabfff700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdf9804fce0 0x7fdf980521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.101+0000 7fdfabfff700 1 -- 172.21.15.63:0/1093937614 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdf9c064220 con 0x7fdfb40b2820 2020-05-18T21:28:00.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.101+0000 7fdfb27fc700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdf9804fce0 0x7fdf980521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:00.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.105+0000 7fdfb27fc700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdf9804fce0 0x7fdf980521a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdfa4001100 tx=0x7fdfa4001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:00.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.105+0000 7fdfb27fc700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdf9804fce0 0x7fdf980521a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdfa4001100 tx=0x7fdfa4001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:00.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.105+0000 7fdfb27fc700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdf9804fce0 0x7fdf980521a0 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7fdfa4001100 tx=0x7fdfa4001880).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:00.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.113+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b2820 0x7fdfb40ac810 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fdf9c002f70 tx=0x7fdf9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:00.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.113+0000 7fdfabfff700 1 -- 172.21.15.63:0/1093937614 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fdf9c03e610 con 0x7fdfb40b2820 2020-05-18T21:28:00.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:00.265+0000 7fdfb97d6700 1 -- 172.21.15.63:0/1093937614 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdfb4060ce0 con 0x7fdfb40b2820 2020-05-18T21:28:01.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.097+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b2820 0x7fdfb40ac810 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fdf9c002f70 tx=0x7fdf9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.126 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:28:01.121+0000 7fdb4592c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:28:01.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.125+0000 7fdfb2ffd700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b2820 0x7fdfb40ac810 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fdf9c002f70 tx=0x7fdf9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.129+0000 7fdfabfff700 1 -- 172.21.15.63:0/1093937614 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v13) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdf9c041c30 con 0x7fdfb40b2820 2020-05-18T21:28:01.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.129+0000 7fdfb97d6700 1 -- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdf9804fce0 msgr2=0x7fdf980521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:01.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.129+0000 7fdfb97d6700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdf9804fce0 0x7fdf980521a0 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7fdfa4001100 tx=0x7fdfa4001880).stop 2020-05-18T21:28:01.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.129+0000 7fdfb97d6700 1 -- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b2820 msgr2=0x7fdfb40ac810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:01.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.129+0000 7fdfb97d6700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b2820 0x7fdfb40ac810 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fdf9c002f70 tx=0x7fdf9c007a80).stop 2020-05-18T21:28:01.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.129+0000 7fdfb97d6700 1 -- 172.21.15.63:0/1093937614 shutdown_connections 2020-05-18T21:28:01.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.129+0000 7fdfb97d6700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdf9804fce0 0x7fdf980521a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:01.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.129+0000 7fdfb97d6700 1 --2- 172.21.15.63:0/1093937614 >> v2:172.21.15.155:3300/0 conn(0x7fdfb4133bc0 0x7fdfb4060f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:01.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.129+0000 7fdfb97d6700 1 --2- 172.21.15.63:0/1093937614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb40b2820 0x7fdfb40ac810 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:01.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.129+0000 7fdfb97d6700 1 -- 172.21.15.63:0/1093937614 >> 172.21.15.63:0/1093937614 conn(0x7fdfb405f6f0 msgr2=0x7fdfb41327b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:01.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.129+0000 7fdfb97d6700 1 -- 172.21.15.63:0/1093937614 shutdown_connections 2020-05-18T21:28:01.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.129+0000 7fdfb97d6700 1 -- 172.21.15.63:0/1093937614 wait complete. 2020-05-18T21:28:01.140 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-05-18T21:28:01.153 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:28:01.169 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:28:01.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.249+0000 7f1c7e425700 1 Processor -- start 2020-05-18T21:28:01.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.249+0000 7f1c7e425700 1 -- start start 2020-05-18T21:28:01.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7e425700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c780615e0 0x7f1c7814e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:01.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7e425700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7814d960 con 0x7f1c780b2860 2020-05-18T21:28:01.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7e425700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7814db90 con 0x7f1c78060b90 2020-05-18T21:28:01.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7e425700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c78066210 con 0x7f1c780615e0 2020-05-18T21:28:01.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7c9c2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c780615e0 0x7f1c7814e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:01.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7c9c2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c780615e0 0x7f1c7814e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54588/0 (socket says 172.21.15.63:54588) 2020-05-18T21:28:01.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c777fe700 1 --1- 172.21.15.63:0/3901681958 >> v1:172.21.15.63:6789/0 conn(0x7f1c780b2860 0x7f1c7814a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56772/0 (socket says 172.21.15.63:56772) 2020-05-18T21:28:01.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7c9c2700 1 -- 172.21.15.63:0/3901681958 learned_addr learned my addr 172.21.15.63:0/3901681958 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:01.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7c9c2700 1 -- 172.21.15.63:0/3901681958 >> v1:172.21.15.155:6789/0 conn(0x7f1c78060b90 legacy=0x7f1c78144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:01.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7c9c2700 1 -- 172.21.15.63:0/3901681958 >> v1:172.21.15.63:6789/0 conn(0x7f1c780b2860 legacy=0x7f1c7814a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:01.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7c9c2700 1 -- 172.21.15.63:0/3901681958 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7814de30 con 0x7f1c780615e0 2020-05-18T21:28:01.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7c9c2700 1 --2- 172.21.15.63:0/3901681958 >> v2:172.21.15.63:3300/0 conn(0x7f1c780615e0 0x7f1c7814e570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1c700032f0 tx=0x7f1c70007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7c9c2700 1 --2- 172.21.15.63:0/3901681958 >> v2:172.21.15.63:3300/0 conn(0x7f1c780615e0 0x7f1c7814e570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1c700032f0 tx=0x7f1c70007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7c9c2700 1 --2- 172.21.15.63:0/3901681958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780615e0 0x7f1c7814e570 secure :-1 s=READY pgs=430 cs=0 l=1 rx=0x7f1c700032f0 tx=0x7f1c70007e00).ready entity=mon.0 client_cookie=2cbfa1a5ff1d5d2f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:01.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7c9c2700 1 --2- 172.21.15.63:0/3901681958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780615e0 0x7f1c7814e570 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7f1c700032f0 tx=0x7f1c70007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7c9c2700 1 --2- 172.21.15.63:0/3901681958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780615e0 0x7f1c7814e570 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7f1c700032f0 tx=0x7f1c70007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c76ffd700 1 -- 172.21.15.63:0/3901681958 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c70011dc0 con 0x7f1c780615e0 2020-05-18T21:28:01.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7c9c2700 1 --2- 172.21.15.63:0/3901681958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780615e0 0x7f1c7814e570 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7f1c700032f0 tx=0x7f1c70007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c76ffd700 1 -- 172.21.15.63:0/3901681958 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7000a180 con 0x7f1c780615e0 2020-05-18T21:28:01.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c76ffd700 1 -- 172.21.15.63:0/3901681958 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c7000a5a0 con 0x7f1c780615e0 2020-05-18T21:28:01.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7e425700 1 -- 172.21.15.63:0/3901681958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780615e0 msgr2=0x7f1c7814e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:01.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7e425700 1 --2- 172.21.15.63:0/3901681958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780615e0 0x7f1c7814e570 secure :-1 s=READY pgs=430 cs=0 l=1 rx=0x7f1c700032f0 tx=0x7f1c70007e00).stop 2020-05-18T21:28:01.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7e425700 1 -- 172.21.15.63:0/3901681958 shutdown_connections 2020-05-18T21:28:01.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7e425700 1 --2- 172.21.15.63:0/3901681958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780615e0 0x7f1c7814e570 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:01.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7e425700 1 -- 172.21.15.63:0/3901681958 >> 172.21.15.63:0/3901681958 conn(0x7f1c780b83d0 msgr2=0x7f1c780b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:01.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7e425700 1 -- 172.21.15.63:0/3901681958 shutdown_connections 2020-05-18T21:28:01.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.253+0000 7f1c7e425700 1 -- 172.21.15.63:0/3901681958 wait complete. 2020-05-18T21:28:01.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.257+0000 7f1c7e425700 1 Processor -- start 2020-05-18T21:28:01.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.257+0000 7f1c7e425700 1 -- start start 2020-05-18T21:28:01.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.257+0000 7f1c7e425700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c78060b90 0x7f1c780b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:01.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.257+0000 7f1c7e425700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c780615e0 0x7f1c780b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:01.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.257+0000 7f1c7e425700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c781583e0 con 0x7f1c780b2860 2020-05-18T21:28:01.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.257+0000 7f1c7e425700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c78158680 con 0x7f1c780615e0 2020-05-18T21:28:01.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.257+0000 7f1c7e425700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780adbe0 con 0x7f1c78060b90 2020-05-18T21:28:01.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.257+0000 7f1c777fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c780615e0 0x7f1c780b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:01.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.257+0000 7f1c777fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c780615e0 0x7f1c780b6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54594/0 (socket says 172.21.15.63:54594) 2020-05-18T21:28:01.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.257+0000 7f1c777fe700 1 -- 172.21.15.63:0/2781404922 learned_addr learned my addr 172.21.15.63:0/2781404922 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:01.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.257+0000 7f1c77fff700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c78060b90 0x7f1c780b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:01.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.257+0000 7f1c777fe700 1 -- 172.21.15.63:0/2781404922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c78060b90 msgr2=0x7f1c780b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:01.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.257+0000 7f1c777fe700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c78060b90 0x7f1c780b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:01.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.257+0000 7f1c777fe700 1 -- 172.21.15.63:0/2781404922 >> v1:172.21.15.155:6789/0 conn(0x7f1c780b2860 legacy=0x7f1c781450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:01.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.257+0000 7f1c777fe700 1 -- 172.21.15.63:0/2781404922 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c780add50 con 0x7f1c780615e0 2020-05-18T21:28:01.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.257+0000 7f1c777fe700 1 --2- 172.21.15.63:0/2781404922 >> v2:172.21.15.63:3300/0 conn(0x7f1c780615e0 0x7f1c780b6610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c78067d20 tx=0x7f1c68001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.257+0000 7f1c777fe700 1 --2- 172.21.15.63:0/2781404922 >> v2:172.21.15.63:3300/0 conn(0x7f1c780615e0 0x7f1c780b6610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c78067d20 tx=0x7f1c68001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.257+0000 7f1c777fe700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780615e0 0x7f1c780b6610 secure :-1 s=READY pgs=431 cs=0 l=1 rx=0x7f1c78067d20 tx=0x7f1c68001400).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:01.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.261+0000 7f1c777fe700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780615e0 0x7f1c780b6610 secure :-1 s=THROTTLE_DONE pgs=431 cs=0 l=1 rx=0x7f1c78067d20 tx=0x7f1c68001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.261+0000 7f1c777fe700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780615e0 0x7f1c780b6610 secure :-1 s=THROTTLE_DONE pgs=431 cs=0 l=1 rx=0x7f1c78067d20 tx=0x7f1c68001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.261+0000 7f1c777fe700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780615e0 0x7f1c780b6610 secure :-1 s=THROTTLE_DONE pgs=431 cs=0 l=1 rx=0x7f1c78067d20 tx=0x7f1c68001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.261+0000 7f1c757fa700 1 -- 172.21.15.63:0/2781404922 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c68011650 con 0x7f1c780615e0 2020-05-18T21:28:01.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.261+0000 7f1c757fa700 1 -- 172.21.15.63:0/2781404922 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c680117b0 con 0x7f1c780615e0 2020-05-18T21:28:01.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.261+0000 7f1c757fa700 1 -- 172.21.15.63:0/2781404922 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c68011bd0 con 0x7f1c780615e0 2020-05-18T21:28:01.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.261+0000 7f1c7e425700 1 -- 172.21.15.63:0/2781404922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c780b4c90 con 0x7f1c780615e0 2020-05-18T21:28:01.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.261+0000 7f1c7e425700 1 -- 172.21.15.63:0/2781404922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c780b6c10 con 0x7f1c780615e0 2020-05-18T21:28:01.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.261+0000 7f1c7e425700 1 -- 172.21.15.63:0/2781404922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c50003380 con 0x7f1c780615e0 2020-05-18T21:28:01.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.261+0000 7f1c777fe700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780615e0 0x7f1c780b6610 secure :-1 s=THROTTLE_DONE pgs=431 cs=0 l=1 rx=0x7f1c78067d20 tx=0x7f1c68001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.265+0000 7f1c757fa700 1 -- 172.21.15.63:0/2781404922 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1c680071a0 con 0x7f1c780615e0 2020-05-18T21:28:01.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.265+0000 7f1c777fe700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780615e0 0x7f1c780b6610 secure :-1 s=THROTTLE_DONE pgs=431 cs=0 l=1 rx=0x7f1c78067d20 tx=0x7f1c68001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.265+0000 7f1c757fa700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c5c04fab0 0x7f1c5c051f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:01.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.265+0000 7f1c757fa700 1 -- 172.21.15.63:0/2781404922 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1c68063700 con 0x7f1c780615e0 2020-05-18T21:28:01.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.265+0000 7f1c77fff700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c5c04fab0 0x7f1c5c051f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:01.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.265+0000 7f1c77fff700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c5c04fab0 0x7f1c5c051f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c78060650 tx=0x7f1c60003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.265+0000 7f1c77fff700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c5c04fab0 0x7f1c5c051f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c78060650 tx=0x7f1c60003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.265+0000 7f1c77fff700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c5c04fab0 0x7f1c5c051f70 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7f1c78060650 tx=0x7f1c60003e60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:01.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.269+0000 7f1c777fe700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780615e0 0x7f1c780b6610 secure :-1 s=THROTTLE_DONE pgs=431 cs=0 l=1 rx=0x7f1c78067d20 tx=0x7f1c68001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.269+0000 7f1c757fa700 1 -- 172.21.15.63:0/2781404922 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f1c6803da90 con 0x7f1c780615e0 2020-05-18T21:28:01.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.413+0000 7f1c7e425700 1 -- 172.21.15.63:0/2781404922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c50003720 con 0x7f1c780615e0 2020-05-18T21:28:01.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.417+0000 7f1c777fe700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780615e0 0x7f1c780b6610 secure :-1 s=THROTTLE_DONE pgs=431 cs=0 l=1 rx=0x7f1c78067d20 tx=0x7f1c68001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.417+0000 7f1c757fa700 1 -- 172.21.15.63:0/2781404922 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+1777 (secure 0 0 0) 0x7f1c680410b0 con 0x7f1c780615e0 2020-05-18T21:28:01.424 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:01.424 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5055,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2600411689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2600411689},{"type":"v1","addr":"172.21.15.63:6833","nonce":2600411689}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:27:31.884487+0000","modified":"2020-05-18T21:28:01.123735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-05-18T21:28:01.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.417+0000 7f1c7e425700 1 -- 172.21.15.63:0/2781404922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c5c04fab0 msgr2=0x7f1c5c051f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:01.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.417+0000 7f1c7e425700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c5c04fab0 0x7f1c5c051f70 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7f1c78060650 tx=0x7f1c60003e60).stop 2020-05-18T21:28:01.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.417+0000 7f1c7e425700 1 -- 172.21.15.63:0/2781404922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780615e0 msgr2=0x7f1c780b6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:01.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.417+0000 7f1c7e425700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780615e0 0x7f1c780b6610 secure :-1 s=READY pgs=431 cs=0 l=1 rx=0x7f1c78067d20 tx=0x7f1c68001400).stop 2020-05-18T21:28:01.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.417+0000 7f1c7e425700 1 -- 172.21.15.63:0/2781404922 shutdown_connections 2020-05-18T21:28:01.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.417+0000 7f1c7e425700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c5c04fab0 0x7f1c5c051f70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:01.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.417+0000 7f1c7e425700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780615e0 0x7f1c780b6610 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:01.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.417+0000 7f1c7e425700 1 --2- 172.21.15.63:0/2781404922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c78060b90 0x7f1c780b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:01.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.417+0000 7f1c7e425700 1 -- 172.21.15.63:0/2781404922 >> 172.21.15.63:0/2781404922 conn(0x7f1c780b83d0 msgr2=0x7f1c78064760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:01.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.417+0000 7f1c7e425700 1 -- 172.21.15.63:0/2781404922 shutdown_connections 2020-05-18T21:28:01.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.417+0000 7f1c7e425700 1 -- 172.21.15.63:0/2781404922 wait complete. 2020-05-18T21:28:01.440 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2020-05-18T21:28:01.441 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-05-18T21:28:01.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c99ca700 1 Processor -- start 2020-05-18T21:28:01.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c99ca700 1 -- start start 2020-05-18T21:28:01.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c99ca700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f80c40b4f60 0x7f80c4145c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:01.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c99ca700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f80c41492a0 0x7f80c41499b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:01.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c99ca700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c4146170 con 0x7f80c4149e10 2020-05-18T21:28:01.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c99ca700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c4146410 con 0x7f80c41492a0 2020-05-18T21:28:01.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c99ca700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c41466b0 con 0x7f80c40b4f60 2020-05-18T21:28:01.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f80c41492a0 0x7f80c41499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:01.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f80c41492a0 0x7f80c41499b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54600/0 (socket says 172.21.15.63:54600) 2020-05-18T21:28:01.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c3fff700 1 -- 172.21.15.63:0/1069332287 learned_addr learned my addr 172.21.15.63:0/1069332287 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:01.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c89c8700 1 --2- 172.21.15.63:0/1069332287 >> v2:172.21.15.155:3300/0 conn(0x7f80c40b4f60 0x7f80c4145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:01.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c3fff700 1 -- 172.21.15.63:0/1069332287 >> v2:172.21.15.155:3300/0 conn(0x7f80c40b4f60 msgr2=0x7f80c4145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:01.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c3fff700 1 --2- 172.21.15.63:0/1069332287 >> v2:172.21.15.155:3300/0 conn(0x7f80c40b4f60 0x7f80c4145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:01.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c3fff700 1 -- 172.21.15.63:0/1069332287 >> v1:172.21.15.155:6789/0 conn(0x7f80c4149e10 legacy=0x7f80c40b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:01.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c3fff700 1 -- 172.21.15.63:0/1069332287 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c4146b50 con 0x7f80c41492a0 2020-05-18T21:28:01.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c3fff700 1 --2- 172.21.15.63:0/1069332287 >> v2:172.21.15.63:3300/0 conn(0x7f80c41492a0 0x7f80c41499b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f80c406a850 tx=0x7f80b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c3fff700 1 --2- 172.21.15.63:0/1069332287 >> v2:172.21.15.63:3300/0 conn(0x7f80c41492a0 0x7f80c41499b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f80c406a850 tx=0x7f80b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c3fff700 1 --2- 172.21.15.63:0/1069332287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80c41492a0 0x7f80c41499b0 secure :-1 s=READY pgs=432 cs=0 l=1 rx=0x7f80c406a850 tx=0x7f80b4007a80).ready entity=mon.0 client_cookie=eb79565aa8470955 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:01.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c3fff700 1 --2- 172.21.15.63:0/1069332287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80c41492a0 0x7f80c41499b0 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7f80c406a850 tx=0x7f80b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c37fe700 1 -- 172.21.15.63:0/1069332287 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80b4011720 con 0x7f80c41492a0 2020-05-18T21:28:01.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c3fff700 1 --2- 172.21.15.63:0/1069332287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80c41492a0 0x7f80c41499b0 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7f80c406a850 tx=0x7f80b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c37fe700 1 -- 172.21.15.63:0/1069332287 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b4011880 con 0x7f80c41492a0 2020-05-18T21:28:01.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c3fff700 1 --2- 172.21.15.63:0/1069332287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80c41492a0 0x7f80c41499b0 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7f80c406a850 tx=0x7f80b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c37fe700 1 -- 172.21.15.63:0/1069332287 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80b4011c60 con 0x7f80c41492a0 2020-05-18T21:28:01.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.553+0000 7f80c99ca700 1 -- 172.21.15.63:0/1069332287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80c41492a0 msgr2=0x7f80c41499b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:01.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.557+0000 7f80c99ca700 1 --2- 172.21.15.63:0/1069332287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80c41492a0 0x7f80c41499b0 secure :-1 s=READY pgs=432 cs=0 l=1 rx=0x7f80c406a850 tx=0x7f80b4007a80).stop 2020-05-18T21:28:01.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.557+0000 7f80c99ca700 1 -- 172.21.15.63:0/1069332287 shutdown_connections 2020-05-18T21:28:01.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.557+0000 7f80c99ca700 1 --2- 172.21.15.63:0/1069332287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80c41492a0 0x7f80c41499b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:01.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.557+0000 7f80c99ca700 1 --2- 172.21.15.63:0/1069332287 >> v2:172.21.15.155:3300/0 conn(0x7f80c40b4f60 0x7f80c4145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:01.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.557+0000 7f80c99ca700 1 -- 172.21.15.63:0/1069332287 >> 172.21.15.63:0/1069332287 conn(0x7f80c4069b70 msgr2=0x7f80c4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:01.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.557+0000 7f80c99ca700 1 -- 172.21.15.63:0/1069332287 shutdown_connections 2020-05-18T21:28:01.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.557+0000 7f80c99ca700 1 -- 172.21.15.63:0/1069332287 wait complete. 2020-05-18T21:28:01.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.557+0000 7f80c99ca700 1 Processor -- start 2020-05-18T21:28:01.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.557+0000 7f80c99ca700 1 -- start start 2020-05-18T21:28:01.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.557+0000 7f80c99ca700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f80c4149e10 0x7f80c40b76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:01.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.557+0000 7f80c99ca700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c41401b0 con 0x7f80c40b4f60 2020-05-18T21:28:01.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.557+0000 7f80c99ca700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c4140450 con 0x7f80c41492a0 2020-05-18T21:28:01.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.557+0000 7f80c99ca700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c41406f0 con 0x7f80c4149e10 2020-05-18T21:28:01.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.557+0000 7f80c89c8700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f80c40b4f60 0x7f80c41425e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56792/0 (socket says 172.21.15.63:56792) 2020-05-18T21:28:01.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.557+0000 7f80c89c8700 1 -- 172.21.15.63:0/2067918280 learned_addr learned my addr 172.21.15.63:0/2067918280 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:01.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.557+0000 7f80c91c9700 1 --2- 172.21.15.63:0/2067918280 >> v2:172.21.15.155:3300/0 conn(0x7f80c4149e10 0x7f80c40b76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:01.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c1ffb700 1 -- 172.21.15.63:0/2067918280 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187514244 0 0) 0x7f80c41401b0 con 0x7f80c40b4f60 2020-05-18T21:28:01.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c1ffb700 1 -- 172.21.15.63:0/2067918280 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80a4002fe0 con 0x7f80c40b4f60 2020-05-18T21:28:01.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c1ffb700 1 -- 172.21.15.63:0/2067918280 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3214239966 0 0) 0x7f80a4002fe0 con 0x7f80c40b4f60 2020-05-18T21:28:01.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c1ffb700 1 -- 172.21.15.63:0/2067918280 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f80c41401b0 con 0x7f80c40b4f60 2020-05-18T21:28:01.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c1ffb700 1 -- 172.21.15.63:0/2067918280 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f80b8002600 con 0x7f80c40b4f60 2020-05-18T21:28:01.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c91c9700 1 -- 172.21.15.63:0/2067918280 >> v1:172.21.15.155:6789/0 conn(0x7f80c41492a0 legacy=0x7f80c4153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:01.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c91c9700 1 -- 172.21.15.63:0/2067918280 >> v1:172.21.15.63:6789/0 conn(0x7f80c40b4f60 legacy=0x7f80c41425e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:01.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c91c9700 1 -- 172.21.15.63:0/2067918280 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c4140990 con 0x7f80c4149e10 2020-05-18T21:28:01.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c91c9700 1 --2- 172.21.15.63:0/2067918280 >> v2:172.21.15.155:3300/0 conn(0x7f80c4149e10 0x7f80c40b76e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f80b4008500 tx=0x7f80bc010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c91c9700 1 --2- 172.21.15.63:0/2067918280 >> v2:172.21.15.155:3300/0 conn(0x7f80c4149e10 0x7f80c40b76e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f80b4008500 tx=0x7f80bc010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c91c9700 1 --2- 172.21.15.63:0/2067918280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c4149e10 0x7f80c40b76e0 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7f80b4008500 tx=0x7f80bc010b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:01.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c91c9700 1 --2- 172.21.15.63:0/2067918280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c4149e10 0x7f80c40b76e0 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f80b4008500 tx=0x7f80bc010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c1ffb700 1 -- 172.21.15.63:0/2067918280 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80bc006d70 con 0x7f80c4149e10 2020-05-18T21:28:01.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c91c9700 1 --2- 172.21.15.63:0/2067918280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c4149e10 0x7f80c40b76e0 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f80b4008500 tx=0x7f80bc010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c99ca700 1 -- 172.21.15.63:0/2067918280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c40b25d0 con 0x7f80c4149e10 2020-05-18T21:28:01.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c1ffb700 1 -- 172.21.15.63:0/2067918280 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80bc008180 con 0x7f80c4149e10 2020-05-18T21:28:01.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c91c9700 1 --2- 172.21.15.63:0/2067918280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c4149e10 0x7f80c40b76e0 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f80b4008500 tx=0x7f80bc010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c99ca700 1 -- 172.21.15.63:0/2067918280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c4142f10 con 0x7f80c4149e10 2020-05-18T21:28:01.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c1ffb700 1 -- 172.21.15.63:0/2067918280 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80bc008570 con 0x7f80c4149e10 2020-05-18T21:28:01.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c99ca700 1 -- 172.21.15.63:0/2067918280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c40569e0 con 0x7f80c4149e10 2020-05-18T21:28:01.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c91c9700 1 --2- 172.21.15.63:0/2067918280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c4149e10 0x7f80c40b76e0 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f80b4008500 tx=0x7f80bc010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c1ffb700 1 -- 172.21.15.63:0/2067918280 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f80bc0086d0 con 0x7f80c4149e10 2020-05-18T21:28:01.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c91c9700 1 --2- 172.21.15.63:0/2067918280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c4149e10 0x7f80c40b76e0 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f80b4008500 tx=0x7f80bc010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c1ffb700 1 --2- 172.21.15.63:0/2067918280 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f80a4050030 0x7f80a40524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.561+0000 7f80c1ffb700 1 -- 172.21.15.63:0/2067918280 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f80bc063be0 con 0x7f80c4149e10 2020-05-18T21:28:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.565+0000 7f80c89c8700 1 --2- 172.21.15.63:0/2067918280 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f80a4050030 0x7f80a40524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.565+0000 7f80c89c8700 1 --2- 172.21.15.63:0/2067918280 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f80a4050030 0x7f80a40524f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f80b8007aa0 tx=0x7f80b8002b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.565+0000 7f80c89c8700 1 --2- 172.21.15.63:0/2067918280 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f80a4050030 0x7f80a40524f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f80b8007aa0 tx=0x7f80b8002b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.565+0000 7f80c89c8700 1 --2- 172.21.15.63:0/2067918280 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f80a4050030 0x7f80a40524f0 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f80b8007aa0 tx=0x7f80b8002b70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.569+0000 7f80c91c9700 1 --2- 172.21.15.63:0/2067918280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c4149e10 0x7f80c40b76e0 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f80b4008500 tx=0x7f80bc010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:01.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.569+0000 7f80c1ffb700 1 -- 172.21.15.63:0/2067918280 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f80bc03df10 con 0x7f80c4149e10 2020-05-18T21:28:01.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:01.717+0000 7f80c99ca700 1 -- 172.21.15.63:0/2067918280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f80c40008d0 con 0x7f80c4149e10 2020-05-18T21:28:02.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.281+0000 7f80c91c9700 1 --2- 172.21.15.63:0/2067918280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c4149e10 0x7f80c40b76e0 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f80b4008500 tx=0x7f80bc010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:02.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.281+0000 7f80c1ffb700 1 -- 172.21.15.63:0/2067918280 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7f80bc041530 con 0x7f80c4149e10 2020-05-18T21:28:02.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.285+0000 7f80c99ca700 1 -- 172.21.15.63:0/2067918280 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f80a4050030 msgr2=0x7f80a40524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:02.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.285+0000 7f80c99ca700 1 --2- 172.21.15.63:0/2067918280 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f80a4050030 0x7f80a40524f0 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f80b8007aa0 tx=0x7f80b8002b70).stop 2020-05-18T21:28:02.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.285+0000 7f80c99ca700 1 -- 172.21.15.63:0/2067918280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c4149e10 msgr2=0x7f80c40b76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:02.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.285+0000 7f80c99ca700 1 --2- 172.21.15.63:0/2067918280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c4149e10 0x7f80c40b76e0 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7f80b4008500 tx=0x7f80bc010b30).stop 2020-05-18T21:28:02.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.285+0000 7f80c99ca700 1 -- 172.21.15.63:0/2067918280 shutdown_connections 2020-05-18T21:28:02.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.285+0000 7f80c99ca700 1 --2- 172.21.15.63:0/2067918280 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f80a4050030 0x7f80a40524f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:02.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.285+0000 7f80c99ca700 1 --2- 172.21.15.63:0/2067918280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c4149e10 0x7f80c40b76e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:02.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.285+0000 7f80c99ca700 1 -- 172.21.15.63:0/2067918280 >> 172.21.15.63:0/2067918280 conn(0x7f80c4069b70 msgr2=0x7f80c40b6350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:02.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.285+0000 7f80c99ca700 1 -- 172.21.15.63:0/2067918280 shutdown_connections 2020-05-18T21:28:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.285+0000 7f80c99ca700 1 -- 172.21.15.63:0/2067918280 wait complete. 2020-05-18T21:28:02.308 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-05-18T21:28:02.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.417+0000 7f5aa9b4e700 1 Processor -- start 2020-05-18T21:28:02.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.417+0000 7f5aa9b4e700 1 -- start start 2020-05-18T21:28:02.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa9b4e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5aa40b61d0 0x7f5aa40af600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:02.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa9b4e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5aa4065df0 0x7f5aa41464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:02.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa9b4e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa41499b0 con 0x7f5aa4149510 2020-05-18T21:28:02.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa9b4e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa40ae290 con 0x7f5aa4065df0 2020-05-18T21:28:02.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa9b4e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa4149c50 con 0x7f5aa40b61d0 2020-05-18T21:28:02.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5aa4065df0 0x7f5aa41464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:02.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5aa4065df0 0x7f5aa41464c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54616/0 (socket says 172.21.15.63:54616) 2020-05-18T21:28:02.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa3fff700 1 -- 172.21.15.63:0/3688604381 learned_addr learned my addr 172.21.15.63:0/3688604381 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:02.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa37fe700 1 --2- 172.21.15.63:0/3688604381 >> v2:172.21.15.155:3300/0 conn(0x7f5aa40b61d0 0x7f5aa40af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:02.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa3fff700 1 -- 172.21.15.63:0/3688604381 >> v2:172.21.15.155:3300/0 conn(0x7f5aa40b61d0 msgr2=0x7f5aa40af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:02.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa3fff700 1 --2- 172.21.15.63:0/3688604381 >> v2:172.21.15.155:3300/0 conn(0x7f5aa40b61d0 0x7f5aa40af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:02.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa3fff700 1 -- 172.21.15.63:0/3688604381 >> v1:172.21.15.155:6789/0 conn(0x7f5aa4149510 legacy=0x7f5aa40656e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:02.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa3fff700 1 -- 172.21.15.63:0/3688604381 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa4149ef0 con 0x7f5aa4065df0 2020-05-18T21:28:02.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa37fe700 1 --2- 172.21.15.63:0/3688604381 >> v2:172.21.15.155:3300/0 conn(0x7f5aa40b61d0 0x7f5aa40af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:28:02.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa3fff700 1 --2- 172.21.15.63:0/3688604381 >> v2:172.21.15.63:3300/0 conn(0x7f5aa4065df0 0x7f5aa41464c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5a9c0032f0 tx=0x7f5a9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:02.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa3fff700 1 --2- 172.21.15.63:0/3688604381 >> v2:172.21.15.63:3300/0 conn(0x7f5aa4065df0 0x7f5aa41464c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5a9c0032f0 tx=0x7f5a9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:02.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa3fff700 1 --2- 172.21.15.63:0/3688604381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aa4065df0 0x7f5aa41464c0 secure :-1 s=READY pgs=434 cs=0 l=1 rx=0x7f5a9c0032f0 tx=0x7f5a9c007e00).ready entity=mon.0 client_cookie=10af6adf1665543a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:02.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa3fff700 1 --2- 172.21.15.63:0/3688604381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aa4065df0 0x7f5aa41464c0 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7f5a9c0032f0 tx=0x7f5a9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:02.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa3fff700 1 --2- 172.21.15.63:0/3688604381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aa4065df0 0x7f5aa41464c0 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7f5a9c0032f0 tx=0x7f5a9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:02.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa3fff700 1 --2- 172.21.15.63:0/3688604381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aa4065df0 0x7f5aa41464c0 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7f5a9c0032f0 tx=0x7f5a9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:02.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa2ffd700 1 -- 172.21.15.63:0/3688604381 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a9c011dc0 con 0x7f5aa4065df0 2020-05-18T21:28:02.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa2ffd700 1 -- 172.21.15.63:0/3688604381 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9c00a180 con 0x7f5aa4065df0 2020-05-18T21:28:02.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa2ffd700 1 -- 172.21.15.63:0/3688604381 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a9c00a5a0 con 0x7f5aa4065df0 2020-05-18T21:28:02.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa9b4e700 1 -- 172.21.15.63:0/3688604381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aa4065df0 msgr2=0x7f5aa41464c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:02.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa9b4e700 1 --2- 172.21.15.63:0/3688604381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aa4065df0 0x7f5aa41464c0 secure :-1 s=READY pgs=434 cs=0 l=1 rx=0x7f5a9c0032f0 tx=0x7f5a9c007e00).stop 2020-05-18T21:28:02.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa9b4e700 1 -- 172.21.15.63:0/3688604381 shutdown_connections 2020-05-18T21:28:02.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa9b4e700 1 --2- 172.21.15.63:0/3688604381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aa4065df0 0x7f5aa41464c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:02.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa9b4e700 1 --2- 172.21.15.63:0/3688604381 >> v2:172.21.15.155:3300/0 conn(0x7f5aa40b61d0 0x7f5aa40af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:02.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa9b4e700 1 -- 172.21.15.63:0/3688604381 >> 172.21.15.63:0/3688604381 conn(0x7f5aa40b9770 msgr2=0x7f5aa40b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:02.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa9b4e700 1 -- 172.21.15.63:0/3688604381 shutdown_connections 2020-05-18T21:28:02.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.421+0000 7f5aa9b4e700 1 -- 172.21.15.63:0/3688604381 wait complete. 2020-05-18T21:28:02.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa9b4e700 1 Processor -- start 2020-05-18T21:28:02.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa9b4e700 1 -- start start 2020-05-18T21:28:02.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa9b4e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aa40b61d0 0x7f5aa41444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:02.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa9b4e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5aa4149510 0x7f5aa4140eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:02.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa9b4e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa4144950 con 0x7f5aa4065df0 2020-05-18T21:28:02.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa9b4e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa4147520 con 0x7f5aa4149510 2020-05-18T21:28:02.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa9b4e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa41477c0 con 0x7f5aa40b61d0 2020-05-18T21:28:02.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5aa4149510 0x7f5aa4140eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:02.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa37fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f5aa4065df0 0x7f5aa4148cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:55122/0 (socket says 172.21.15.63:55122) 2020-05-18T21:28:02.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa37fe700 1 -- 172.21.15.63:0/953176848 learned_addr learned my addr 172.21.15.63:0/953176848 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:02.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5a9affd700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aa40b61d0 0x7f5aa41444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:02.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa17fa700 1 -- 172.21.15.63:0/953176848 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225875658 0 0) 0x7f5aa4144950 con 0x7f5aa4065df0 2020-05-18T21:28:02.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa17fa700 1 -- 172.21.15.63:0/953176848 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a88002fe0 con 0x7f5aa4065df0 2020-05-18T21:28:02.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa3fff700 1 -- 172.21.15.63:0/953176848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aa40b61d0 msgr2=0x7f5aa41444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:02.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa3fff700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aa40b61d0 0x7f5aa41444f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:02.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa3fff700 1 -- 172.21.15.63:0/953176848 >> v1:172.21.15.155:6789/0 conn(0x7f5aa4065df0 legacy=0x7f5aa4148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:02.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa3fff700 1 -- 172.21.15.63:0/953176848 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa4147a60 con 0x7f5aa4149510 2020-05-18T21:28:02.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa3fff700 1 --2- 172.21.15.63:0/953176848 >> v2:172.21.15.63:3300/0 conn(0x7f5aa4149510 0x7f5aa4140eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a9c0032f0 tx=0x7f5a9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:02.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa3fff700 1 --2- 172.21.15.63:0/953176848 >> v2:172.21.15.63:3300/0 conn(0x7f5aa4149510 0x7f5aa4140eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a9c0032f0 tx=0x7f5a9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:02.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa3fff700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aa4149510 0x7f5aa4140eb0 secure :-1 s=READY pgs=435 cs=0 l=1 rx=0x7f5a9c0032f0 tx=0x7f5a9c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:02.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa3fff700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aa4149510 0x7f5aa4140eb0 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7f5a9c0032f0 tx=0x7f5a9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:02.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa3fff700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aa4149510 0x7f5aa4140eb0 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7f5a9c0032f0 tx=0x7f5a9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:02.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa17fa700 1 -- 172.21.15.63:0/953176848 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a9c011ea0 con 0x7f5aa4149510 2020-05-18T21:28:02.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.425+0000 7f5aa3fff700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aa4149510 0x7f5aa4140eb0 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7f5a9c0032f0 tx=0x7f5a9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:02.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.429+0000 7f5aa17fa700 1 -- 172.21.15.63:0/953176848 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9c00a5e0 con 0x7f5aa4149510 2020-05-18T21:28:02.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.429+0000 7f5aa17fa700 1 -- 172.21.15.63:0/953176848 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a9c005e60 con 0x7f5aa4149510 2020-05-18T21:28:02.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.429+0000 7f5aa9b4e700 1 -- 172.21.15.63:0/953176848 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa41470f0 con 0x7f5aa4149510 2020-05-18T21:28:02.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.429+0000 7f5aa9b4e700 1 -- 172.21.15.63:0/953176848 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa41480a0 con 0x7f5aa4149510 2020-05-18T21:28:02.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.429+0000 7f5aa3fff700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aa4149510 0x7f5aa4140eb0 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7f5a9c0032f0 tx=0x7f5a9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:02.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.429+0000 7f5aa9b4e700 1 -- 172.21.15.63:0/953176848 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa40569e0 con 0x7f5aa4149510 2020-05-18T21:28:02.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.429+0000 7f5aa17fa700 1 -- 172.21.15.63:0/953176848 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5a9c0071c0 con 0x7f5aa4149510 2020-05-18T21:28:02.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.429+0000 7f5aa3fff700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aa4149510 0x7f5aa4140eb0 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7f5a9c0032f0 tx=0x7f5a9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:02.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.429+0000 7f5aa17fa700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a8804fd90 0x7f5a88052250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:02.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.429+0000 7f5aa17fa700 1 -- 172.21.15.63:0/953176848 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f5a9c0648c0 con 0x7f5aa4149510 2020-05-18T21:28:02.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.429+0000 7f5aa37fe700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a8804fd90 0x7f5a88052250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:02.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.433+0000 7f5aa37fe700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a8804fd90 0x7f5a88052250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a94002f70 tx=0x7f5a94008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:02.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.433+0000 7f5aa37fe700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a8804fd90 0x7f5a88052250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a94002f70 tx=0x7f5a94008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:02.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.433+0000 7f5aa37fe700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a8804fd90 0x7f5a88052250 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f5a94002f70 tx=0x7f5a94008020).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:02.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.437+0000 7f5aa3fff700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aa4149510 0x7f5aa4140eb0 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7f5a9c0032f0 tx=0x7f5a9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:02.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.437+0000 7f5aa17fa700 1 -- 172.21.15.63:0/953176848 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f5a9c03ebf0 con 0x7f5aa4149510 2020-05-18T21:28:02.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:02.557+0000 7f5aa9b4e700 1 -- 172.21.15.63:0/953176848 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5aa409edc0 con 0x7f5aa4149510 2020-05-18T21:28:03.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.289+0000 7f5aa3fff700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aa4149510 0x7f5aa4140eb0 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7f5a9c0032f0 tx=0x7f5a9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:03.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.289+0000 7f5aa17fa700 1 -- 172.21.15.63:0/953176848 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) v1 ==== 185+0+0 (secure 0 0 0) 0x7f5a9c042210 con 0x7f5aa4149510 2020-05-18T21:28:03.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.293+0000 7f5aa9b4e700 1 -- 172.21.15.63:0/953176848 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a8804fd90 msgr2=0x7f5a88052250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:03.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.293+0000 7f5aa9b4e700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a8804fd90 0x7f5a88052250 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f5a94002f70 tx=0x7f5a94008020).stop 2020-05-18T21:28:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.293+0000 7f5aa9b4e700 1 -- 172.21.15.63:0/953176848 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aa4149510 msgr2=0x7f5aa4140eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.293+0000 7f5aa9b4e700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aa4149510 0x7f5aa4140eb0 secure :-1 s=READY pgs=435 cs=0 l=1 rx=0x7f5a9c0032f0 tx=0x7f5a9c007e00).stop 2020-05-18T21:28:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.293+0000 7f5aa9b4e700 1 -- 172.21.15.63:0/953176848 shutdown_connections 2020-05-18T21:28:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.293+0000 7f5aa9b4e700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a8804fd90 0x7f5a88052250 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.293+0000 7f5aa9b4e700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aa4149510 0x7f5aa4140eb0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:03.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.293+0000 7f5aa9b4e700 1 --2- 172.21.15.63:0/953176848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aa40b61d0 0x7f5aa41444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:03.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.293+0000 7f5aa9b4e700 1 -- 172.21.15.63:0/953176848 >> 172.21.15.63:0/953176848 conn(0x7f5aa40b9770 msgr2=0x7f5aa40b55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:03.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.293+0000 7f5aa9b4e700 1 -- 172.21.15.63:0/953176848 shutdown_connections 2020-05-18T21:28:03.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.293+0000 7f5aa9b4e700 1 -- 172.21.15.63:0/953176848 wait complete. 2020-05-18T21:28:03.304 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2020-05-18T21:28:03.314 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-05-18T21:28:03.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.413+0000 7fbc10d16700 1 Processor -- start 2020-05-18T21:28:03.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.413+0000 7fbc10d16700 1 -- start start 2020-05-18T21:28:03.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc10d16700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbc0c0bc8d0 0x7fbc0c060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:03.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc10d16700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc0c143630 0x7fbc0c12e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:03.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc10d16700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc0c146420 con 0x7fbc0c145e30 2020-05-18T21:28:03.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc10d16700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc0c146e00 con 0x7fbc0c0bc8d0 2020-05-18T21:28:03.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc10d16700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c1466c0 con 0x7fbc0c143630 2020-05-18T21:28:03.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc0bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc0c143630 0x7fbc0c12e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:03.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc0b7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbc0c0bc8d0 0x7fbc0c060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:03.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc0bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc0c143630 0x7fbc0c12e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:45330/0 (socket says 172.21.15.63:45330) 2020-05-18T21:28:03.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc02ffd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fbc0c145e30 0x7fbc0c142f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:55132/0 (socket says 172.21.15.63:55132) 2020-05-18T21:28:03.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc0bfff700 1 -- 172.21.15.63:0/879350398 learned_addr learned my addr 172.21.15.63:0/879350398 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:03.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc0affd700 1 -- 172.21.15.63:0/879350398 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509108860 0 0) 0x7fbc0c146420 con 0x7fbc0c145e30 2020-05-18T21:28:03.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc0bfff700 1 -- 172.21.15.63:0/879350398 >> v2:172.21.15.155:3300/0 conn(0x7fbc0c0bc8d0 msgr2=0x7fbc0c060b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:03.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc0bfff700 1 --2- 172.21.15.63:0/879350398 >> v2:172.21.15.155:3300/0 conn(0x7fbc0c0bc8d0 0x7fbc0c060b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:03.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc0bfff700 1 -- 172.21.15.63:0/879350398 >> v1:172.21.15.155:6789/0 conn(0x7fbc0c145e30 legacy=0x7fbc0c142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:03.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc0bfff700 1 -- 172.21.15.63:0/879350398 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0c146960 con 0x7fbc0c143630 2020-05-18T21:28:03.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc0bfff700 1 --2- 172.21.15.63:0/879350398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc0c143630 0x7fbc0c12e770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbc040032f0 tx=0x7fbc04007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:03.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc0bfff700 1 --2- 172.21.15.63:0/879350398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc0c143630 0x7fbc0c12e770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbc040032f0 tx=0x7fbc04007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:03.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc0bfff700 1 --2- 172.21.15.63:0/879350398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc0c143630 0x7fbc0c12e770 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fbc040032f0 tx=0x7fbc04007e00).ready entity=mon.2 client_cookie=cd52f9c8cfd17234 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:03.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc0bfff700 1 --2- 172.21.15.63:0/879350398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc0c143630 0x7fbc0c12e770 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fbc040032f0 tx=0x7fbc04007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:03.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc0affd700 1 -- 172.21.15.63:0/879350398 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc04011d10 con 0x7fbc0c143630 2020-05-18T21:28:03.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc0bfff700 1 --2- 172.21.15.63:0/879350398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc0c143630 0x7fbc0c12e770 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fbc040032f0 tx=0x7fbc04007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:03.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc0bfff700 1 --2- 172.21.15.63:0/879350398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc0c143630 0x7fbc0c12e770 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fbc040032f0 tx=0x7fbc04007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:03.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc0affd700 1 -- 172.21.15.63:0/879350398 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc04011e70 con 0x7fbc0c143630 2020-05-18T21:28:03.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc0affd700 1 -- 172.21.15.63:0/879350398 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc0400a370 con 0x7fbc0c143630 2020-05-18T21:28:03.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc10d16700 1 -- 172.21.15.63:0/879350398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc0c143630 msgr2=0x7fbc0c12e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:03.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc10d16700 1 --2- 172.21.15.63:0/879350398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc0c143630 0x7fbc0c12e770 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fbc040032f0 tx=0x7fbc04007e00).stop 2020-05-18T21:28:03.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc10d16700 1 -- 172.21.15.63:0/879350398 shutdown_connections 2020-05-18T21:28:03.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc10d16700 1 --2- 172.21.15.63:0/879350398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc0c143630 0x7fbc0c12e770 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:03.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc10d16700 1 --2- 172.21.15.63:0/879350398 >> v2:172.21.15.155:3300/0 conn(0x7fbc0c0bc8d0 0x7fbc0c060b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:03.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc10d16700 1 -- 172.21.15.63:0/879350398 >> 172.21.15.63:0/879350398 conn(0x7fbc0c05f3b0 msgr2=0x7fbc0c05f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:03.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc10d16700 1 -- 172.21.15.63:0/879350398 shutdown_connections 2020-05-18T21:28:03.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.417+0000 7fbc10d16700 1 -- 172.21.15.63:0/879350398 wait complete. 2020-05-18T21:28:03.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc10d16700 1 Processor -- start 2020-05-18T21:28:03.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc10d16700 1 -- start start 2020-05-18T21:28:03.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc10d16700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbc0c143630 0x7fbc0c0acba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:03.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc10d16700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbc0c145e30 0x7fbc0c156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:03.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc10d16700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc0c156690 con 0x7fbc0c0bc8d0 2020-05-18T21:28:03.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc10d16700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc0c0ad1d0 con 0x7fbc0c143630 2020-05-18T21:28:03.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc10d16700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc0c0ad470 con 0x7fbc0c145e30 2020-05-18T21:28:03.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc02ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbc0c143630 0x7fbc0c0acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:03.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc0b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbc0c0bc8d0 0x7fbc0c0b4320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56818/0 (socket says 172.21.15.63:56818) 2020-05-18T21:28:03.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc0b7fe700 1 -- 172.21.15.63:0/2564561523 learned_addr learned my addr 172.21.15.63:0/2564561523 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:03.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc0bfff700 1 --2- 172.21.15.63:0/2564561523 >> v2:172.21.15.155:3300/0 conn(0x7fbc0c145e30 0x7fbc0c156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:03.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc02ffd700 1 -- 172.21.15.63:0/2564561523 >> v2:172.21.15.155:3300/0 conn(0x7fbc0c145e30 msgr2=0x7fbc0c156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:03.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc02ffd700 1 --2- 172.21.15.63:0/2564561523 >> v2:172.21.15.155:3300/0 conn(0x7fbc0c145e30 0x7fbc0c156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:03.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc02ffd700 1 -- 172.21.15.63:0/2564561523 >> v1:172.21.15.63:6789/0 conn(0x7fbc0c0bc8d0 legacy=0x7fbc0c0b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:03.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc02ffd700 1 -- 172.21.15.63:0/2564561523 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0c0ae980 con 0x7fbc0c143630 2020-05-18T21:28:03.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc02ffd700 1 --2- 172.21.15.63:0/2564561523 >> v2:172.21.15.63:3300/0 conn(0x7fbc0c143630 0x7fbc0c0acba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbbf4000bc0 tx=0x7fbc0c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:03.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc02ffd700 1 --2- 172.21.15.63:0/2564561523 >> v2:172.21.15.63:3300/0 conn(0x7fbc0c143630 0x7fbc0c0acba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbbf4000bc0 tx=0x7fbc0c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:03.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc02ffd700 1 --2- 172.21.15.63:0/2564561523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc0c143630 0x7fbc0c0acba0 secure :-1 s=READY pgs=437 cs=0 l=1 rx=0x7fbbf4000bc0 tx=0x7fbc0c061d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:03.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc02ffd700 1 --2- 172.21.15.63:0/2564561523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc0c143630 0x7fbc0c0acba0 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7fbbf4000bc0 tx=0x7fbc0c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:03.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc02ffd700 1 --2- 172.21.15.63:0/2564561523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc0c143630 0x7fbc0c0acba0 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7fbbf4000bc0 tx=0x7fbc0c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:03.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc097fa700 1 -- 172.21.15.63:0/2564561523 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbf4011630 con 0x7fbc0c143630 2020-05-18T21:28:03.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc02ffd700 1 --2- 172.21.15.63:0/2564561523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc0c143630 0x7fbc0c0acba0 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7fbbf4000bc0 tx=0x7fbc0c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:03.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc097fa700 1 -- 172.21.15.63:0/2564561523 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf4011790 con 0x7fbc0c143630 2020-05-18T21:28:03.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc10d16700 1 -- 172.21.15.63:0/2564561523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc0c0b4a30 con 0x7fbc0c143630 2020-05-18T21:28:03.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc097fa700 1 -- 172.21.15.63:0/2564561523 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbf4011b70 con 0x7fbc0c143630 2020-05-18T21:28:03.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.421+0000 7fbc10d16700 1 -- 172.21.15.63:0/2564561523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc0c153fc0 con 0x7fbc0c143630 2020-05-18T21:28:03.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.425+0000 7fbc02ffd700 1 --2- 172.21.15.63:0/2564561523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc0c143630 0x7fbc0c0acba0 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7fbbf4000bc0 tx=0x7fbc0c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:03.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.425+0000 7fbc10d16700 1 -- 172.21.15.63:0/2564561523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc0c0ad000 con 0x7fbc0c143630 2020-05-18T21:28:03.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.425+0000 7fbc097fa700 1 -- 172.21.15.63:0/2564561523 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fbbf40071a0 con 0x7fbc0c143630 2020-05-18T21:28:03.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.425+0000 7fbc02ffd700 1 --2- 172.21.15.63:0/2564561523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc0c143630 0x7fbc0c0acba0 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7fbbf4000bc0 tx=0x7fbc0c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:03.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.425+0000 7fbc097fa700 1 --2- 172.21.15.63:0/2564561523 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbbf004fa30 0x7fbbf0051ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.425+0000 7fbc097fa700 1 -- 172.21.15.63:0/2564561523 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fbbf4063860 con 0x7fbc0c143630 2020-05-18T21:28:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.425+0000 7fbc0b7fe700 1 --2- 172.21.15.63:0/2564561523 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbbf004fa30 0x7fbbf0051ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.425+0000 7fbc0b7fe700 1 --2- 172.21.15.63:0/2564561523 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbbf004fa30 0x7fbbf0051ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbc0c0b5170 tx=0x7fbbfc00c840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.425+0000 7fbc0b7fe700 1 --2- 172.21.15.63:0/2564561523 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbbf004fa30 0x7fbbf0051ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbc0c0b5170 tx=0x7fbbfc00c840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.425+0000 7fbc0b7fe700 1 --2- 172.21.15.63:0/2564561523 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbbf004fa30 0x7fbbf0051ef0 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7fbc0c0b5170 tx=0x7fbbfc00c840).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:03.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.433+0000 7fbc02ffd700 1 --2- 172.21.15.63:0/2564561523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc0c143630 0x7fbc0c0acba0 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7fbbf4000bc0 tx=0x7fbc0c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:03.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.433+0000 7fbc097fa700 1 -- 172.21.15.63:0/2564561523 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fbbf403db90 con 0x7fbc0c143630 2020-05-18T21:28:03.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:03.553+0000 7fbc10d16700 1 -- 172.21.15.63:0/2564561523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbc0c0aeb10 con 0x7fbc0c143630 2020-05-18T21:28:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.293+0000 7fbc02ffd700 1 --2- 172.21.15.63:0/2564561523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc0c143630 0x7fbc0c0acba0 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7fbbf4000bc0 tx=0x7fbc0c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.293+0000 7fbc097fa700 1 -- 172.21.15.63:0/2564561523 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) v1 ==== 173+0+0 (secure 0 0 0) 0x7fbbf40411b0 con 0x7fbc0c143630 2020-05-18T21:28:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.297+0000 7fbc10d16700 1 -- 172.21.15.63:0/2564561523 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbbf004fa30 msgr2=0x7fbbf0051ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.297+0000 7fbc10d16700 1 --2- 172.21.15.63:0/2564561523 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbbf004fa30 0x7fbbf0051ef0 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7fbc0c0b5170 tx=0x7fbbfc00c840).stop 2020-05-18T21:28:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.297+0000 7fbc10d16700 1 -- 172.21.15.63:0/2564561523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc0c143630 msgr2=0x7fbc0c0acba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.297+0000 7fbc10d16700 1 --2- 172.21.15.63:0/2564561523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc0c143630 0x7fbc0c0acba0 secure :-1 s=READY pgs=437 cs=0 l=1 rx=0x7fbbf4000bc0 tx=0x7fbc0c061d60).stop 2020-05-18T21:28:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.297+0000 7fbc10d16700 1 -- 172.21.15.63:0/2564561523 shutdown_connections 2020-05-18T21:28:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.297+0000 7fbc10d16700 1 --2- 172.21.15.63:0/2564561523 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbbf004fa30 0x7fbbf0051ef0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.297+0000 7fbc10d16700 1 --2- 172.21.15.63:0/2564561523 >> v2:172.21.15.155:3300/0 conn(0x7fbc0c145e30 0x7fbc0c156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.297+0000 7fbc10d16700 1 --2- 172.21.15.63:0/2564561523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc0c143630 0x7fbc0c0acba0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.297+0000 7fbc10d16700 1 -- 172.21.15.63:0/2564561523 >> 172.21.15.63:0/2564561523 conn(0x7fbc0c05f3b0 msgr2=0x7fbc0c12ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.297+0000 7fbc10d16700 1 -- 172.21.15.63:0/2564561523 shutdown_connections 2020-05-18T21:28:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.297+0000 7fbc10d16700 1 -- 172.21.15.63:0/2564561523 wait complete. 2020-05-18T21:28:04.307 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2020-05-18T21:28:04.319 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:28:04.319 INFO:tasks.ceph.mds.a:Stopping old one... 2020-05-18T21:28:04.320 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:28:04.320 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:28:04.320 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:28:04.320 INFO:tasks.ceph.mds.b:Stopping old one... 2020-05-18T21:28:04.321 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:28:04.321 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:28:04.332 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:28:04.332 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:28:04.334 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:28:04.334 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:28:04.336 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:28:04.336 DEBUG:teuthology.parallel:result is None 2020-05-18T21:28:04.337 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:28:04.338 DEBUG:teuthology.parallel:result is None 2020-05-18T21:28:04.338 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-05-18T21:28:04.401 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:28:04.408 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:28:04.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852fede700 1 Processor -- start 2020-05-18T21:28:04.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852fede700 1 -- start start 2020-05-18T21:28:04.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852fede700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f852809e620 0x7f8528099c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:04.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852fede700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f85280b5e30 0x7f85280b6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:04.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852fede700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852809b9d0 con 0x7f852809b530 2020-05-18T21:28:04.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852fede700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8528145ea0 con 0x7f852809e620 2020-05-18T21:28:04.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852fede700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8528099880 con 0x7f85280b5e30 2020-05-18T21:28:04.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852dc7a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f852809e620 0x7f8528099c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:04.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852e47b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f85280b5e30 0x7f85280b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:04.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852d479700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f852809b530 0x7f8528099170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:55158/0 (socket says 172.21.15.63:55158) 2020-05-18T21:28:04.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852d479700 1 -- 172.21.15.63:0/2443287755 learned_addr learned my addr 172.21.15.63:0/2443287755 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:04.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852dc7a700 1 --2- 172.21.15.63:0/2443287755 >> v2:172.21.15.63:3300/0 conn(0x7f852809e620 0x7f8528099c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54652/0 (socket says 172.21.15.63:54652) 2020-05-18T21:28:04.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852dc7a700 1 -- 172.21.15.63:0/2443287755 >> v2:172.21.15.155:3300/0 conn(0x7f85280b5e30 msgr2=0x7f85280b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:04.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852dc7a700 1 --2- 172.21.15.63:0/2443287755 >> v2:172.21.15.155:3300/0 conn(0x7f85280b5e30 0x7f85280b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:04.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852dc7a700 1 -- 172.21.15.63:0/2443287755 >> v1:172.21.15.155:6789/0 conn(0x7f852809b530 legacy=0x7f8528099170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852dc7a700 1 -- 172.21.15.63:0/2443287755 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8528098a30 con 0x7f852809e620 2020-05-18T21:28:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852dc7a700 1 --2- 172.21.15.63:0/2443287755 >> v2:172.21.15.63:3300/0 conn(0x7f852809e620 0x7f8528099c10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8528145fe0 tx=0x7f8520008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852dc7a700 1 --2- 172.21.15.63:0/2443287755 >> v2:172.21.15.63:3300/0 conn(0x7f852809e620 0x7f8528099c10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8528145fe0 tx=0x7f8520008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852dc7a700 1 --2- 172.21.15.63:0/2443287755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f852809e620 0x7f8528099c10 secure :-1 s=READY pgs=440 cs=0 l=1 rx=0x7f8528145fe0 tx=0x7f8520008ca0).ready entity=mon.0 client_cookie=f701b298c4e5babb server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852dc7a700 1 --2- 172.21.15.63:0/2443287755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f852809e620 0x7f8528099c10 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f8528145fe0 tx=0x7f8520008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:04.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852dc7a700 1 --2- 172.21.15.63:0/2443287755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f852809e620 0x7f8528099c10 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f8528145fe0 tx=0x7f8520008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:04.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852cc78700 1 -- 172.21.15.63:0/2443287755 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8520011e60 con 0x7f852809e620 2020-05-18T21:28:04.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852dc7a700 1 --2- 172.21.15.63:0/2443287755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f852809e620 0x7f8528099c10 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f8528145fe0 tx=0x7f8520008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:04.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852cc78700 1 -- 172.21.15.63:0/2443287755 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852000a180 con 0x7f852809e620 2020-05-18T21:28:04.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852cc78700 1 -- 172.21.15.63:0/2443287755 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f852000a560 con 0x7f852809e620 2020-05-18T21:28:04.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852fede700 1 -- 172.21.15.63:0/2443287755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f852809e620 msgr2=0x7f8528099c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:04.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.429+0000 7f852fede700 1 --2- 172.21.15.63:0/2443287755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f852809e620 0x7f8528099c10 secure :-1 s=READY pgs=440 cs=0 l=1 rx=0x7f8528145fe0 tx=0x7f8520008ca0).stop 2020-05-18T21:28:04.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.433+0000 7f852fede700 1 -- 172.21.15.63:0/2443287755 shutdown_connections 2020-05-18T21:28:04.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.433+0000 7f852fede700 1 --2- 172.21.15.63:0/2443287755 >> v2:172.21.15.155:3300/0 conn(0x7f85280b5e30 0x7f85280b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:04.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.433+0000 7f852fede700 1 --2- 172.21.15.63:0/2443287755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f852809e620 0x7f8528099c10 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:04.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.433+0000 7f852fede700 1 -- 172.21.15.63:0/2443287755 >> 172.21.15.63:0/2443287755 conn(0x7f85280b9750 msgr2=0x7f85280b5720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:04.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.433+0000 7f852fede700 1 -- 172.21.15.63:0/2443287755 shutdown_connections 2020-05-18T21:28:04.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.433+0000 7f852fede700 1 -- 172.21.15.63:0/2443287755 wait complete. 2020-05-18T21:28:04.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.433+0000 7f852fede700 1 Processor -- start 2020-05-18T21:28:04.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.433+0000 7f852fede700 1 -- start start 2020-05-18T21:28:04.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.433+0000 7f852fede700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85280b5e30 0x7f85280b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:04.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.433+0000 7f852fede700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8528153810 con 0x7f852809e620 2020-05-18T21:28:04.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.433+0000 7f852fede700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85281543c0 con 0x7f852809b530 2020-05-18T21:28:04.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.433+0000 7f852fede700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85280b0420 con 0x7f85280b5e30 2020-05-18T21:28:04.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f852e47b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85280b5e30 0x7f85280b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:04.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f852e47b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85280b5e30 0x7f85280b1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54658/0 (socket says 172.21.15.63:54658) 2020-05-18T21:28:04.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f852e47b700 1 -- 172.21.15.63:0/1762533809 learned_addr learned my addr 172.21.15.63:0/1762533809 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:04.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f852e47b700 1 -- 172.21.15.63:0/1762533809 >> v1:172.21.15.155:6789/0 conn(0x7f852809b530 legacy=0x7f8528153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:04.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f8516ffd700 1 -- 172.21.15.63:0/1762533809 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967539824 0 0) 0x7f85281543c0 con 0x7f852809b530 2020-05-18T21:28:04.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f852e47b700 1 -- 172.21.15.63:0/1762533809 >> v1:172.21.15.63:6789/0 conn(0x7f852809e620 legacy=0x7f85280b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:04.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f852e47b700 1 -- 172.21.15.63:0/1762533809 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85280b0560 con 0x7f85280b5e30 2020-05-18T21:28:04.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f852e47b700 1 --2- 172.21.15.63:0/1762533809 >> v2:172.21.15.63:3300/0 conn(0x7f85280b5e30 0x7f85280b1f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8518001020 tx=0x7f8524010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:04.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f852e47b700 1 --2- 172.21.15.63:0/1762533809 >> v2:172.21.15.63:3300/0 conn(0x7f85280b5e30 0x7f85280b1f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8518001020 tx=0x7f8524010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:04.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f852e47b700 1 --2- 172.21.15.63:0/1762533809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85280b5e30 0x7f85280b1f90 secure :-1 s=READY pgs=442 cs=0 l=1 rx=0x7f8518001020 tx=0x7f8524010ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:04.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f852e47b700 1 --2- 172.21.15.63:0/1762533809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85280b5e30 0x7f85280b1f90 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f8518001020 tx=0x7f8524010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:04.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f852e47b700 1 --2- 172.21.15.63:0/1762533809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85280b5e30 0x7f85280b1f90 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f8518001020 tx=0x7f8524010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:04.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f8516ffd700 1 -- 172.21.15.63:0/1762533809 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8524005990 con 0x7f85280b5e30 2020-05-18T21:28:04.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f852e47b700 1 --2- 172.21.15.63:0/1762533809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85280b5e30 0x7f85280b1f90 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f8518001020 tx=0x7f8524010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:04.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f8516ffd700 1 -- 172.21.15.63:0/1762533809 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8524005af0 con 0x7f85280b5e30 2020-05-18T21:28:04.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f852fede700 1 -- 172.21.15.63:0/1762533809 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8528145100 con 0x7f85280b5e30 2020-05-18T21:28:04.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f8516ffd700 1 -- 172.21.15.63:0/1762533809 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8524005e90 con 0x7f85280b5e30 2020-05-18T21:28:04.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f852fede700 1 -- 172.21.15.63:0/1762533809 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8528145550 con 0x7f85280b5e30 2020-05-18T21:28:04.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f852e47b700 1 --2- 172.21.15.63:0/1762533809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85280b5e30 0x7f85280b1f90 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f8518001020 tx=0x7f8524010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:04.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f852fede700 1 -- 172.21.15.63:0/1762533809 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85281539a0 con 0x7f85280b5e30 2020-05-18T21:28:04.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f8516ffd700 1 -- 172.21.15.63:0/1762533809 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f85240126b0 con 0x7f85280b5e30 2020-05-18T21:28:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f852e47b700 1 --2- 172.21.15.63:0/1762533809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85280b5e30 0x7f85280b1f90 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f8518001020 tx=0x7f8524010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f8516ffd700 1 --2- 172.21.15.63:0/1762533809 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f850804f9b0 0x7f8508051e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f8516ffd700 1 -- 172.21.15.63:0/1762533809 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f8524063cd0 con 0x7f85280b5e30 2020-05-18T21:28:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.437+0000 7f852dc7a700 1 --2- 172.21.15.63:0/1762533809 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f850804f9b0 0x7f8508051e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.441+0000 7f852dc7a700 1 --2- 172.21.15.63:0/1762533809 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f850804f9b0 0x7f8508051e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8520008880 tx=0x7f852809a9d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.441+0000 7f852dc7a700 1 --2- 172.21.15.63:0/1762533809 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f850804f9b0 0x7f8508051e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8520008880 tx=0x7f852809a9d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.441+0000 7f852dc7a700 1 --2- 172.21.15.63:0/1762533809 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f850804f9b0 0x7f8508051e70 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f8520008880 tx=0x7f852809a9d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.445+0000 7f852e47b700 1 --2- 172.21.15.63:0/1762533809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85280b5e30 0x7f85280b1f90 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f8518001020 tx=0x7f8524010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.445+0000 7f8516ffd700 1 -- 172.21.15.63:0/1762533809 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f852403e000 con 0x7f85280b5e30 2020-05-18T21:28:04.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:04.577+0000 7f852fede700 1 -- 172.21.15.63:0/1762533809 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f85280569e0 con 0x7f85280b5e30 2020-05-18T21:28:05.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.425+0000 7f852e47b700 1 --2- 172.21.15.63:0/1762533809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85280b5e30 0x7f85280b1f90 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f8518001020 tx=0x7f8524010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.425+0000 7f8516ffd700 1 -- 172.21.15.63:0/1762533809 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v37) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8524041620 con 0x7f85280b5e30 2020-05-18T21:28:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.429+0000 7f852fede700 1 -- 172.21.15.63:0/1762533809 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f850804f9b0 msgr2=0x7f8508051e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.429+0000 7f852fede700 1 --2- 172.21.15.63:0/1762533809 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f850804f9b0 0x7f8508051e70 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f8520008880 tx=0x7f852809a9d0).stop 2020-05-18T21:28:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.429+0000 7f852fede700 1 -- 172.21.15.63:0/1762533809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85280b5e30 msgr2=0x7f85280b1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.429+0000 7f852fede700 1 --2- 172.21.15.63:0/1762533809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85280b5e30 0x7f85280b1f90 secure :-1 s=READY pgs=442 cs=0 l=1 rx=0x7f8518001020 tx=0x7f8524010ca0).stop 2020-05-18T21:28:05.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.429+0000 7f852fede700 1 -- 172.21.15.63:0/1762533809 shutdown_connections 2020-05-18T21:28:05.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.429+0000 7f852fede700 1 --2- 172.21.15.63:0/1762533809 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f850804f9b0 0x7f8508051e70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:05.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.429+0000 7f852fede700 1 --2- 172.21.15.63:0/1762533809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85280b5e30 0x7f85280b1f90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:05.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.429+0000 7f852fede700 1 -- 172.21.15.63:0/1762533809 >> 172.21.15.63:0/1762533809 conn(0x7f85280b9750 msgr2=0x7f8528099090 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:05.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.429+0000 7f852fede700 1 -- 172.21.15.63:0/1762533809 shutdown_connections 2020-05-18T21:28:05.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.429+0000 7f852fede700 1 -- 172.21.15.63:0/1762533809 wait complete. 2020-05-18T21:28:05.438 INFO:teuthology.orchestra.run.smithi063.stderr: removed all blacklist entries 2020-05-18T21:28:05.448 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-05-18T21:28:05.449 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-05-18T21:28:05.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.549+0000 7ff105a3d700 1 Processor -- start 2020-05-18T21:28:05.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.549+0000 7ff105a3d700 1 -- start start 2020-05-18T21:28:05.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.549+0000 7ff105a3d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1000615e0 0x7ff10014e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:05.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.549+0000 7ff105a3d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10014d960 con 0x7ff100060b90 2020-05-18T21:28:05.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.549+0000 7ff105a3d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10014db90 con 0x7ff1000b2860 2020-05-18T21:28:05.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.549+0000 7ff105a3d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff100066210 con 0x7ff1000615e0 2020-05-18T21:28:05.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0feffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff100060b90 0x7ff100144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56852/0 (socket says 172.21.15.63:56852) 2020-05-18T21:28:05.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0feffd700 1 -- 172.21.15.63:0/4119314302 learned_addr learned my addr 172.21.15.63:0/4119314302 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:05.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0ff7fe700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1000615e0 0x7ff10014e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:05.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fdffb700 1 -- 172.21.15.63:0/4119314302 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873559153 0 0) 0x7ff10014d960 con 0x7ff100060b90 2020-05-18T21:28:05.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fdffb700 1 -- 172.21.15.63:0/4119314302 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0e0003270 con 0x7ff100060b90 2020-05-18T21:28:05.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fdffb700 1 -- 172.21.15.63:0/4119314302 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3128804579 0 0) 0x7ff0e0003270 con 0x7ff100060b90 2020-05-18T21:28:05.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fdffb700 1 -- 172.21.15.63:0/4119314302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1000615e0 msgr2=0x7ff10014e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:05.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fdffb700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1000615e0 0x7ff10014e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:05.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fdffb700 1 -- 172.21.15.63:0/4119314302 >> v1:172.21.15.155:6789/0 conn(0x7ff1000b2860 legacy=0x7ff10014a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:05.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fdffb700 1 -- 172.21.15.63:0/4119314302 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10014de30 con 0x7ff100060b90 2020-05-18T21:28:05.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fdffb700 1 -- 172.21.15.63:0/4119314302 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7ff0f0001a90 con 0x7ff100060b90 2020-05-18T21:28:05.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0ff7fe700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1000615e0 0x7ff10014e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:28:05.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fdffb700 1 -- 172.21.15.63:0/4119314302 >> v1:172.21.15.63:6789/0 conn(0x7ff100060b90 legacy=0x7ff100144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:05.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fdffb700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0e0003790 0x7ff0e0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:05.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fdffb700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e0004040 0x7ff0e0004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:05.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fdffb700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1000615e0 0x7ff0e0004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:05.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fdffb700 1 -- 172.21.15.63:0/4119314302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff100066210 con 0x7ff0e0004040 2020-05-18T21:28:05.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fdffb700 1 -- 172.21.15.63:0/4119314302 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0005000 con 0x7ff0e0003790 2020-05-18T21:28:05.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fdffb700 1 -- 172.21.15.63:0/4119314302 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00051c0 con 0x7ff1000615e0 2020-05-18T21:28:05.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e0004040 0x7ff0e0004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:05.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0feffd700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0e0003790 0x7ff0e0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:05.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0ff7fe700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1000615e0 0x7ff0e0004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:05.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fe7fc700 1 -- 172.21.15.63:0/4119314302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1000615e0 msgr2=0x7ff0e0004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:05.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1000615e0 0x7ff0e0004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:05.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fe7fc700 1 -- 172.21.15.63:0/4119314302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0e0003790 msgr2=0x7ff0e0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:05.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0e0003790 0x7ff0e0003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:05.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fe7fc700 1 -- 172.21.15.63:0/4119314302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e0003270 con 0x7ff0e0004040 2020-05-18T21:28:05.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0feffd700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0e0003790 0x7ff0e0003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:05.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0ff7fe700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1000615e0 0x7ff0e0004ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:05.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e0004040 0x7ff0e0004510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff0e8001020 tx=0x7ff0e800fe10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e0004040 0x7ff0e0004510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff0e8001020 tx=0x7ff0e800fe10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e0004040 0x7ff0e0004510 secure :-1 s=READY pgs=444 cs=0 l=1 rx=0x7ff0e8001020 tx=0x7ff0e800fe10).ready entity=mon.0 client_cookie=ffd42dd286cc108c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:05.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e0004040 0x7ff0e0004510 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7ff0e8001020 tx=0x7ff0e800fe10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fdffb700 1 -- 172.21.15.63:0/4119314302 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0e8003560 con 0x7ff0e0004040 2020-05-18T21:28:05.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e0004040 0x7ff0e0004510 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7ff0e8001020 tx=0x7ff0e800fe10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fdffb700 1 -- 172.21.15.63:0/4119314302 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e80036c0 con 0x7ff0e0004040 2020-05-18T21:28:05.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e0004040 0x7ff0e0004510 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7ff0e8001020 tx=0x7ff0e800fe10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff105a3d700 1 -- 172.21.15.63:0/4119314302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e0004040 msgr2=0x7ff0e0004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:05.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0fdffb700 1 -- 172.21.15.63:0/4119314302 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0e8003aa0 con 0x7ff0e0004040 2020-05-18T21:28:05.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff105a3d700 1 --2- 172.21.15.63:0/4119314302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e0004040 0x7ff0e0004510 secure :-1 s=READY pgs=444 cs=0 l=1 rx=0x7ff0e8001020 tx=0x7ff0e800fe10).stop 2020-05-18T21:28:05.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff0ff7fe700 1 -- 172.21.15.63:0/4119314302 reap_dead start 2020-05-18T21:28:05.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff105a3d700 1 -- 172.21.15.63:0/4119314302 shutdown_connections 2020-05-18T21:28:05.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff105a3d700 1 -- 172.21.15.63:0/4119314302 >> 172.21.15.63:0/4119314302 conn(0x7ff1000b83d0 msgr2=0x7ff1000b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:05.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff105a3d700 1 -- 172.21.15.63:0/4119314302 shutdown_connections 2020-05-18T21:28:05.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.553+0000 7ff105a3d700 1 -- 172.21.15.63:0/4119314302 wait complete. 2020-05-18T21:28:05.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff105a3d700 1 Processor -- start 2020-05-18T21:28:05.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff105a3d700 1 -- start start 2020-05-18T21:28:05.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff105a3d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff10014bfb0 0x7ff10014c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:05.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff105a3d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff10014c9d0 0x7ff100160af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:05.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff105a3d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff100145b90 con 0x7ff100157930 2020-05-18T21:28:05.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff105a3d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1001462d0 con 0x7ff10014bfb0 2020-05-18T21:28:05.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff105a3d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10014d440 con 0x7ff10014c9d0 2020-05-18T21:28:05.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff0fe7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff10014bfb0 0x7ff10014c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:05.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff0feffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff100157930 0x7ff100157d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56864/0 (socket says 172.21.15.63:56864) 2020-05-18T21:28:05.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff0feffd700 1 -- 172.21.15.63:0/1241050536 learned_addr learned my addr 172.21.15.63:0/1241050536 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:05.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff0ff7fe700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff10014c9d0 0x7ff100160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:05.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff0fe7fc700 1 -- 172.21.15.63:0/1241050536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff10014c9d0 msgr2=0x7ff100160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:05.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff10014c9d0 0x7ff100160af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:05.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff0fe7fc700 1 -- 172.21.15.63:0/1241050536 >> v1:172.21.15.63:6789/0 conn(0x7ff100157930 legacy=0x7ff100157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:05.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff0f7fff700 1 -- 172.21.15.63:0/1241050536 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930527018 0 0) 0x7ff100145b90 con 0x7ff100157930 2020-05-18T21:28:05.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff0fe7fc700 1 -- 172.21.15.63:0/1241050536 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff100145e30 con 0x7ff10014bfb0 2020-05-18T21:28:05.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff0ff7fe700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff10014c9d0 0x7ff100160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:28:05.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/1241050536 >> v2:172.21.15.63:3300/0 conn(0x7ff10014bfb0 0x7ff10014c570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff0e8001020 tx=0x7ff0e800fe10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/1241050536 >> v2:172.21.15.63:3300/0 conn(0x7ff10014bfb0 0x7ff10014c570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff0e8001020 tx=0x7ff0e800fe10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10014bfb0 0x7ff10014c570 secure :-1 s=READY pgs=446 cs=0 l=1 rx=0x7ff0e8001020 tx=0x7ff0e800fe10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:05.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10014bfb0 0x7ff10014c570 secure :-1 s=THROTTLE_DONE pgs=446 cs=0 l=1 rx=0x7ff0e8001020 tx=0x7ff0e800fe10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff0f7fff700 1 -- 172.21.15.63:0/1241050536 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0e8008370 con 0x7ff10014bfb0 2020-05-18T21:28:05.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10014bfb0 0x7ff10014c570 secure :-1 s=THROTTLE_DONE pgs=446 cs=0 l=1 rx=0x7ff0e8001020 tx=0x7ff0e800fe10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10014bfb0 0x7ff10014c570 secure :-1 s=THROTTLE_DONE pgs=446 cs=0 l=1 rx=0x7ff0e8001020 tx=0x7ff0e800fe10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff0f7fff700 1 -- 172.21.15.63:0/1241050536 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e8008b30 con 0x7ff10014bfb0 2020-05-18T21:28:05.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff105a3d700 1 -- 172.21.15.63:0/1241050536 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1000ad670 con 0x7ff10014bfb0 2020-05-18T21:28:05.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff0f7fff700 1 -- 172.21.15.63:0/1241050536 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0e8006520 con 0x7ff10014bfb0 2020-05-18T21:28:05.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.557+0000 7ff105a3d700 1 -- 172.21.15.63:0/1241050536 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1001610f0 con 0x7ff10014bfb0 2020-05-18T21:28:05.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.561+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10014bfb0 0x7ff10014c570 secure :-1 s=THROTTLE_DONE pgs=446 cs=0 l=1 rx=0x7ff0e8001020 tx=0x7ff0e800fe10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.561+0000 7ff105a3d700 1 -- 172.21.15.63:0/1241050536 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff100145ff0 con 0x7ff10014bfb0 2020-05-18T21:28:05.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.561+0000 7ff0f7fff700 1 -- 172.21.15.63:0/1241050536 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff0e8006720 con 0x7ff10014bfb0 2020-05-18T21:28:05.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.561+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10014bfb0 0x7ff10014c570 secure :-1 s=THROTTLE_DONE pgs=446 cs=0 l=1 rx=0x7ff0e8001020 tx=0x7ff0e800fe10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.561+0000 7ff0f7fff700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff0e404f8e0 0x7ff0e4051da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:05.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.561+0000 7ff0f7fff700 1 -- 172.21.15.63:0/1241050536 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff0e8064260 con 0x7ff10014bfb0 2020-05-18T21:28:05.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.561+0000 7ff0feffd700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff0e404f8e0 0x7ff0e4051da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:05.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.561+0000 7ff0feffd700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff0e404f8e0 0x7ff0e4051da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff0f0001400 tx=0x7ff10005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.561+0000 7ff0feffd700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff0e404f8e0 0x7ff0e4051da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff0f0001400 tx=0x7ff10005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.561+0000 7ff0feffd700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff0e404f8e0 0x7ff0e4051da0 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7ff0f0001400 tx=0x7ff10005fa60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:05.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.565+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10014bfb0 0x7ff10014c570 secure :-1 s=THROTTLE_DONE pgs=446 cs=0 l=1 rx=0x7ff0e8001020 tx=0x7ff0e800fe10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.565+0000 7ff0f7fff700 1 -- 172.21.15.63:0/1241050536 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff0e803e710 con 0x7ff10014bfb0 2020-05-18T21:28:05.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.713+0000 7ff105a3d700 1 -- 172.21.15.63:0/1241050536 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff1000ad800 con 0x7ff10014bfb0 2020-05-18T21:28:05.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.717+0000 7ff0fe7fc700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10014bfb0 0x7ff10014c570 secure :-1 s=THROTTLE_DONE pgs=446 cs=0 l=1 rx=0x7ff0e8001020 tx=0x7ff0e800fe10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.717+0000 7ff0f7fff700 1 -- 172.21.15.63:0/1241050536 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+4513 (secure 0 0 0) 0x7ff1000ad800 con 0x7ff10014bfb0 2020-05-18T21:28:05.723 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:05.723 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:28:05.723 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_dump": [ 2020-05-18T21:28:05.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:05.724 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.a", 2020-05-18T21:28:05.724 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJekJyyLRAAfB5XJCsXTAmZdkFOaQrokg==", 2020-05-18T21:28:05.724 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:05.725 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:28:05.725 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:05.725 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:05.725 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:05.725 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:05.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:05.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:05.726 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.b", 2020-05-18T21:28:05.726 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeSVE8MRAAEEytuzLtcQMC+1uQ/yh8eA==", 2020-05-18T21:28:05.727 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:05.727 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:28:05.727 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:05.727 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:05.727 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:05.728 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:05.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:05.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:05.728 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.0", 2020-05-18T21:28:05.728 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBq/cJeIn7mJhAArx+YEdVbsfXXNOLWdaAgWw==", 2020-05-18T21:28:05.729 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:05.729 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:05.729 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:05.729 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:05.730 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:05.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:05.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:05.730 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.1", 2020-05-18T21:28:05.730 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBt/cJelHywCRAAFyQ3sPEE0RTSy4tKfsDfyw==", 2020-05-18T21:28:05.731 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:05.731 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:05.731 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:05.731 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:05.731 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:05.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:05.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:05.732 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.2", 2020-05-18T21:28:05.732 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBv/cJecexDLBAAxhlFq20MBkKvDjuM1yi8XQ==", 2020-05-18T21:28:05.732 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:05.733 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:05.733 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:05.733 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:05.733 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:05.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.3", 2020-05-18T21:28:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBy/cJe9IqwDxAAMg1In7bIITDcOZljzzTpDQ==", 2020-05-18T21:28:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:05.735 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:05.735 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:05.735 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:05.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:05.735 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:05.736 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.4", 2020-05-18T21:28:05.736 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB3/cJeLXgxFhAA/kMVV5hCRny2uXKvvbu8Og==", 2020-05-18T21:28:05.736 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:05.736 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:05.737 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:05.737 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:05.737 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:05.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:05.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:05.739 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.5", 2020-05-18T21:28:05.739 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB5/cJeucpsNRAAjGh+6yUC8Fji9PE4COi/Eg==", 2020-05-18T21:28:05.740 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:05.740 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:05.740 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:05.740 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:05.741 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:05.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:05.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:05.741 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.6", 2020-05-18T21:28:05.741 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB8/cJelSPpGhAAXobGqH9qaW1VZfEpH8bUbQ==", 2020-05-18T21:28:05.742 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:05.742 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:05.742 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:05.742 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:05.742 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:05.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:05.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:05.743 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.7", 2020-05-18T21:28:05.743 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB+/cJeUIl5OBAAPd8H8ohOWZw9ubO7uCB6zg==", 2020-05-18T21:28:05.743 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:05.744 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:05.744 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:05.744 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:05.744 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:05.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:05.745 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:05.745 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.0", 2020-05-18T21:28:05.745 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeap3RNhAAi2vKpsKtzSL1Uuqm8pWYJQ==", 2020-05-18T21:28:05.745 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:05.746 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:28:05.746 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:28:05.746 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:28:05.746 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:05.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:05.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:05.747 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.1", 2020-05-18T21:28:05.747 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJeekrQABAA5TmzWOt24C6hgZw/WTj5dw==", 2020-05-18T21:28:05.747 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:05.748 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:28:05.748 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:28:05.748 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:28:05.748 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:05.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:05.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:05.749 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.2", 2020-05-18T21:28:05.749 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJehSnFAxAAXUZwqNTXqAApEB3nXs4u6g==", 2020-05-18T21:28:05.749 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:28:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:28:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:28:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:05.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:05.751 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.3", 2020-05-18T21:28:05.751 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJe2HdDBhAA07y5pn/bKKa9TBbZFvIh9g==", 2020-05-18T21:28:05.751 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:05.752 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:28:05.752 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:28:05.752 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:28:05.752 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:05.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:05.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:05.753 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.admin", 2020-05-18T21:28:05.753 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJe/K4fGRAA+rP3BYuWiyx/fKmQ3bV6Lw==", 2020-05-18T21:28:05.753 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:05.754 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:28:05.754 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:05.754 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:05.754 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:05.754 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:05.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:05.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:05.755 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.x", 2020-05-18T21:28:05.755 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJemmqEKhAAe5ySRz8Id0ug4matQwL0uw==", 2020-05-18T21:28:05.755 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:05.756 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:28:05.756 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:28:05.756 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:05.756 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:05.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:05.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:05.757 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.y", 2020-05-18T21:28:05.757 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeF/BNJhAAi/vrldC6qoWJWnSHpE3ung==", 2020-05-18T21:28:05.757 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:05.758 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:28:05.758 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:28:05.758 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:05.758 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:05.759 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:05.759 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:05.759 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:28:05.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.717+0000 7ff105a3d700 1 -- 172.21.15.63:0/1241050536 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff0e404f8e0 msgr2=0x7ff0e4051da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:05.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.717+0000 7ff105a3d700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff0e404f8e0 0x7ff0e4051da0 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7ff0f0001400 tx=0x7ff10005fa60).stop 2020-05-18T21:28:05.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.717+0000 7ff105a3d700 1 -- 172.21.15.63:0/1241050536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10014bfb0 msgr2=0x7ff10014c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:05.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.717+0000 7ff105a3d700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10014bfb0 0x7ff10014c570 secure :-1 s=READY pgs=446 cs=0 l=1 rx=0x7ff0e8001020 tx=0x7ff0e800fe10).stop 2020-05-18T21:28:05.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.717+0000 7ff105a3d700 1 -- 172.21.15.63:0/1241050536 shutdown_connections 2020-05-18T21:28:05.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.717+0000 7ff105a3d700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff0e404f8e0 0x7ff0e4051da0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:05.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.717+0000 7ff105a3d700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff10014c9d0 0x7ff100160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:05.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.717+0000 7ff105a3d700 1 --2- 172.21.15.63:0/1241050536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10014bfb0 0x7ff10014c570 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:05.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.717+0000 7ff105a3d700 1 -- 172.21.15.63:0/1241050536 >> 172.21.15.63:0/1241050536 conn(0x7ff1000b83d0 msgr2=0x7ff1000b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:05.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.717+0000 7ff105a3d700 1 -- 172.21.15.63:0/1241050536 shutdown_connections 2020-05-18T21:28:05.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.717+0000 7ff105a3d700 1 -- 172.21.15.63:0/1241050536 wait complete. 2020-05-18T21:28:05.764 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:28:05.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.865+0000 7f4a71b12700 1 Processor -- start 2020-05-18T21:28:05.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.865+0000 7f4a71b12700 1 -- start start 2020-05-18T21:28:05.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.865+0000 7f4a71b12700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4a6c0b4760 0x7f4a6c0648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:05.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.865+0000 7f4a71b12700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a6c064d20 0x7f4a6c14d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:05.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.865+0000 7f4a71b12700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6c14a330 con 0x7f4a6c05f110 2020-05-18T21:28:05.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.865+0000 7f4a71b12700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6c14a140 con 0x7f4a6c0b4760 2020-05-18T21:28:05.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.865+0000 7f4a71b12700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c14a5d0 con 0x7f4a6c064d20 2020-05-18T21:28:05.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.865+0000 7f4a70b10700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4a6c05f110 0x7f4a6c14aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56872/0 (socket says 172.21.15.63:56872) 2020-05-18T21:28:05.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.865+0000 7f4a70b10700 1 -- 172.21.15.63:0/1617571605 learned_addr learned my addr 172.21.15.63:0/1617571605 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:05.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.865+0000 7f4a71311700 1 --2- 172.21.15.63:0/1617571605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a6c064d20 0x7f4a6c14d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:05.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.865+0000 7f4a6bfff700 1 --2- 172.21.15.63:0/1617571605 >> v2:172.21.15.155:3300/0 conn(0x7f4a6c0b4760 0x7f4a6c0648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:05.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.865+0000 7f4a6b7fe700 1 -- 172.21.15.63:0/1617571605 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407942159 0 0) 0x7f4a6c14a330 con 0x7f4a6c05f110 2020-05-18T21:28:05.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.865+0000 7f4a6b7fe700 1 -- 172.21.15.63:0/1617571605 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a58003270 con 0x7f4a6c05f110 2020-05-18T21:28:05.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a71311700 1 -- 172.21.15.63:0/1617571605 >> v2:172.21.15.155:3300/0 conn(0x7f4a6c0b4760 msgr2=0x7f4a6c0648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:05.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a71311700 1 --2- 172.21.15.63:0/1617571605 >> v2:172.21.15.155:3300/0 conn(0x7f4a6c0b4760 0x7f4a6c0648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:05.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a71311700 1 -- 172.21.15.63:0/1617571605 >> v1:172.21.15.63:6789/0 conn(0x7f4a6c05f110 legacy=0x7f4a6c14aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:05.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a71311700 1 -- 172.21.15.63:0/1617571605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c063430 con 0x7f4a6c064d20 2020-05-18T21:28:05.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a71311700 1 --2- 172.21.15.63:0/1617571605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a6c064d20 0x7f4a6c14d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4a640032f0 tx=0x7f4a64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a71311700 1 --2- 172.21.15.63:0/1617571605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a6c064d20 0x7f4a6c14d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4a640032f0 tx=0x7f4a64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a71311700 1 --2- 172.21.15.63:0/1617571605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a6c064d20 0x7f4a6c14d710 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f4a640032f0 tx=0x7f4a64007e00).ready entity=mon.2 client_cookie=48173588371b61db server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:05.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a71311700 1 --2- 172.21.15.63:0/1617571605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a6c064d20 0x7f4a6c14d710 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f4a640032f0 tx=0x7f4a64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a6b7fe700 1 -- 172.21.15.63:0/1617571605 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a64011db0 con 0x7f4a6c064d20 2020-05-18T21:28:05.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a71311700 1 --2- 172.21.15.63:0/1617571605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a6c064d20 0x7f4a6c14d710 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f4a640032f0 tx=0x7f4a64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a6b7fe700 1 -- 172.21.15.63:0/1617571605 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6400a180 con 0x7f4a6c064d20 2020-05-18T21:28:05.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a71311700 1 --2- 172.21.15.63:0/1617571605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a6c064d20 0x7f4a6c14d710 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f4a640032f0 tx=0x7f4a64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a6b7fe700 1 -- 172.21.15.63:0/1617571605 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a6400a560 con 0x7f4a6c064d20 2020-05-18T21:28:05.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a71b12700 1 -- 172.21.15.63:0/1617571605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a6c064d20 msgr2=0x7f4a6c14d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:05.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a71b12700 1 --2- 172.21.15.63:0/1617571605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a6c064d20 0x7f4a6c14d710 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f4a640032f0 tx=0x7f4a64007e00).stop 2020-05-18T21:28:05.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a71b12700 1 -- 172.21.15.63:0/1617571605 shutdown_connections 2020-05-18T21:28:05.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a71b12700 1 --2- 172.21.15.63:0/1617571605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a6c064d20 0x7f4a6c14d710 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:05.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a71b12700 1 --2- 172.21.15.63:0/1617571605 >> v2:172.21.15.155:3300/0 conn(0x7f4a6c0b4760 0x7f4a6c0648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:05.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a71b12700 1 -- 172.21.15.63:0/1617571605 >> 172.21.15.63:0/1617571605 conn(0x7f4a6c069fc0 msgr2=0x7f4a6c06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:05.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a71b12700 1 -- 172.21.15.63:0/1617571605 shutdown_connections 2020-05-18T21:28:05.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.869+0000 7f4a71b12700 1 -- 172.21.15.63:0/1617571605 wait complete. 2020-05-18T21:28:05.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a71b12700 1 Processor -- start 2020-05-18T21:28:05.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a71b12700 1 -- start start 2020-05-18T21:28:05.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a71b12700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4a6c05f110 0x7f4a6c142760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:05.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a71b12700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6c143450 con 0x7f4a6c064d20 2020-05-18T21:28:05.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a71b12700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6c145be0 con 0x7f4a6c0b4760 2020-05-18T21:28:05.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a71b12700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6c148160 con 0x7f4a6c05f110 2020-05-18T21:28:05.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a70b10700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4a6c05f110 0x7f4a6c142760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:05.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a6bfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4a6c064d20 0x7f4a6c142d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56880/0 (socket says 172.21.15.63:56880) 2020-05-18T21:28:05.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a6bfff700 1 -- 172.21.15.63:0/1031489580 learned_addr learned my addr 172.21.15.63:0/1031489580 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:05.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a70b10700 1 -- 172.21.15.63:0/1031489580 >> v1:172.21.15.155:6789/0 conn(0x7f4a6c0b4760 legacy=0x7f4a6c13fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:05.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a69ffb700 1 -- 172.21.15.63:0/1031489580 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011428319 0 0) 0x7f4a6c145be0 con 0x7f4a6c0b4760 2020-05-18T21:28:05.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a70b10700 1 -- 172.21.15.63:0/1031489580 >> v1:172.21.15.63:6789/0 conn(0x7f4a6c064d20 legacy=0x7f4a6c142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:05.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a70b10700 1 -- 172.21.15.63:0/1031489580 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c140600 con 0x7f4a6c05f110 2020-05-18T21:28:05.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a70b10700 1 --2- 172.21.15.63:0/1031489580 >> v2:172.21.15.63:3300/0 conn(0x7f4a6c05f110 0x7f4a6c142760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a60008020 tx=0x7f4a5c0109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a70b10700 1 --2- 172.21.15.63:0/1031489580 >> v2:172.21.15.63:3300/0 conn(0x7f4a6c05f110 0x7f4a6c142760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a60008020 tx=0x7f4a5c0109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a70b10700 1 --2- 172.21.15.63:0/1031489580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a6c05f110 0x7f4a6c142760 secure :-1 s=READY pgs=449 cs=0 l=1 rx=0x7f4a60008020 tx=0x7f4a5c0109c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:05.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a70b10700 1 --2- 172.21.15.63:0/1031489580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a6c05f110 0x7f4a6c142760 secure :-1 s=THROTTLE_DONE pgs=449 cs=0 l=1 rx=0x7f4a60008020 tx=0x7f4a5c0109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a70b10700 1 --2- 172.21.15.63:0/1031489580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a6c05f110 0x7f4a6c142760 secure :-1 s=THROTTLE_DONE pgs=449 cs=0 l=1 rx=0x7f4a60008020 tx=0x7f4a5c0109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a69ffb700 1 -- 172.21.15.63:0/1031489580 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a5c005d00 con 0x7f4a6c05f110 2020-05-18T21:28:05.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a70b10700 1 --2- 172.21.15.63:0/1031489580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a6c05f110 0x7f4a6c142760 secure :-1 s=THROTTLE_DONE pgs=449 cs=0 l=1 rx=0x7f4a60008020 tx=0x7f4a5c0109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a69ffb700 1 -- 172.21.15.63:0/1031489580 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5c005e60 con 0x7f4a6c05f110 2020-05-18T21:28:05.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a71b12700 1 -- 172.21.15.63:0/1031489580 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6c148600 con 0x7f4a6c05f110 2020-05-18T21:28:05.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a69ffb700 1 -- 172.21.15.63:0/1031489580 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a5c0062c0 con 0x7f4a6c05f110 2020-05-18T21:28:05.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.873+0000 7f4a71b12700 1 -- 172.21.15.63:0/1031489580 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6c1457b0 con 0x7f4a6c05f110 2020-05-18T21:28:05.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.877+0000 7f4a70b10700 1 --2- 172.21.15.63:0/1031489580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a6c05f110 0x7f4a6c142760 secure :-1 s=THROTTLE_DONE pgs=449 cs=0 l=1 rx=0x7f4a60008020 tx=0x7f4a5c0109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.877+0000 7f4a71b12700 1 -- 172.21.15.63:0/1031489580 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6c0569e0 con 0x7f4a6c05f110 2020-05-18T21:28:05.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.877+0000 7f4a69ffb700 1 -- 172.21.15.63:0/1031489580 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4a5c0064c0 con 0x7f4a6c05f110 2020-05-18T21:28:05.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.877+0000 7f4a70b10700 1 --2- 172.21.15.63:0/1031489580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a6c05f110 0x7f4a6c142760 secure :-1 s=THROTTLE_DONE pgs=449 cs=0 l=1 rx=0x7f4a60008020 tx=0x7f4a5c0109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.877+0000 7f4a69ffb700 1 --2- 172.21.15.63:0/1031489580 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4a4c04f780 0x7f4a4c051c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:05.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.877+0000 7f4a69ffb700 1 -- 172.21.15.63:0/1031489580 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f4a5c0090c0 con 0x7f4a6c05f110 2020-05-18T21:28:05.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.877+0000 7f4a6bfff700 1 --2- 172.21.15.63:0/1031489580 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4a4c04f780 0x7f4a4c051c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:05.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.877+0000 7f4a6bfff700 1 --2- 172.21.15.63:0/1031489580 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4a4c04f780 0x7f4a4c051c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a600030b0 tx=0x7f4a60009070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.877+0000 7f4a6bfff700 1 --2- 172.21.15.63:0/1031489580 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4a4c04f780 0x7f4a4c051c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a600030b0 tx=0x7f4a60009070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.877+0000 7f4a6bfff700 1 --2- 172.21.15.63:0/1031489580 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4a4c04f780 0x7f4a4c051c40 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f4a600030b0 tx=0x7f4a60009070).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:05.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.881+0000 7f4a70b10700 1 --2- 172.21.15.63:0/1031489580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a6c05f110 0x7f4a6c142760 secure :-1 s=THROTTLE_DONE pgs=449 cs=0 l=1 rx=0x7f4a60008020 tx=0x7f4a5c0109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:05.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:05.881+0000 7f4a69ffb700 1 -- 172.21.15.63:0/1031489580 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f4a5c03e080 con 0x7f4a6c05f110 2020-05-18T21:28:06.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.001+0000 7f4a71b12700 1 -- 172.21.15.63:0/1031489580 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a6c148330 con 0x7f4a6c05f110 2020-05-18T21:28:06.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.001+0000 7f4a70b10700 1 --2- 172.21.15.63:0/1031489580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a6c05f110 0x7f4a6c142760 secure :-1 s=THROTTLE_DONE pgs=449 cs=0 l=1 rx=0x7f4a60008020 tx=0x7f4a5c0109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.001+0000 7f4a69ffb700 1 -- 172.21.15.63:0/1031489580 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+13232 (secure 0 0 0) 0x7f4a5c0416a0 con 0x7f4a6c05f110 2020-05-18T21:28:06.009 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:06.009 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":37,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:28:05.417900+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:28:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.005+0000 7f4a71b12700 1 -- 172.21.15.63:0/1031489580 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4a4c04f780 msgr2=0x7f4a4c051c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.005+0000 7f4a71b12700 1 --2- 172.21.15.63:0/1031489580 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4a4c04f780 0x7f4a4c051c40 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f4a600030b0 tx=0x7f4a60009070).stop 2020-05-18T21:28:06.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.005+0000 7f4a71b12700 1 -- 172.21.15.63:0/1031489580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a6c05f110 msgr2=0x7f4a6c142760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.005+0000 7f4a71b12700 1 --2- 172.21.15.63:0/1031489580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a6c05f110 0x7f4a6c142760 secure :-1 s=READY pgs=449 cs=0 l=1 rx=0x7f4a60008020 tx=0x7f4a5c0109c0).stop 2020-05-18T21:28:06.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.005+0000 7f4a71b12700 1 -- 172.21.15.63:0/1031489580 shutdown_connections 2020-05-18T21:28:06.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.005+0000 7f4a71b12700 1 --2- 172.21.15.63:0/1031489580 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4a4c04f780 0x7f4a4c051c40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:06.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.005+0000 7f4a71b12700 1 --2- 172.21.15.63:0/1031489580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a6c05f110 0x7f4a6c142760 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:06.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.005+0000 7f4a71b12700 1 -- 172.21.15.63:0/1031489580 >> 172.21.15.63:0/1031489580 conn(0x7f4a6c069fc0 msgr2=0x7f4a6c14d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:06.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.005+0000 7f4a71b12700 1 -- 172.21.15.63:0/1031489580 shutdown_connections 2020-05-18T21:28:06.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.005+0000 7f4a71b12700 1 -- 172.21.15.63:0/1031489580 wait complete. 2020-05-18T21:28:06.022 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-05-18T21:28:06.023 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:28:06.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.125+0000 7fef220f9700 1 Processor -- start 2020-05-18T21:28:06.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.125+0000 7fef220f9700 1 -- start start 2020-05-18T21:28:06.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.125+0000 7fef220f9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fef1c05f980 0x7fef1c09f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:06.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.125+0000 7fef220f9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef1c0b1120 0x7fef1c09f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:06.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.125+0000 7fef220f9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1c0b4ad0 con 0x7fef1c0b0720 2020-05-18T21:28:06.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.125+0000 7fef220f9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1c0b4d70 con 0x7fef1c05f980 2020-05-18T21:28:06.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.125+0000 7fef220f9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c05be20 con 0x7fef1c0b1120 2020-05-18T21:28:06.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.125+0000 7fef210f7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fef1c05f980 0x7fef1c09f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:06.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.125+0000 7fef218f8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef1c0b1120 0x7fef1c09f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:06.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.125+0000 7fef208f6700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fef1c0b0720 0x7fef1c0b6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:55202/0 (socket says 172.21.15.63:55202) 2020-05-18T21:28:06.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.125+0000 7fef208f6700 1 -- 172.21.15.63:0/2176287428 learned_addr learned my addr 172.21.15.63:0/2176287428 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:06.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.125+0000 7fef210f7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fef1c05f980 0x7fef1c09f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:41314/0 (socket says 172.21.15.63:41314) 2020-05-18T21:28:06.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef07fff700 1 -- 172.21.15.63:0/2176287428 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111332643 0 0) 0x7fef1c0b4ad0 con 0x7fef1c0b0720 2020-05-18T21:28:06.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef07fff700 1 -- 172.21.15.63:0/2176287428 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef00003270 con 0x7fef1c0b0720 2020-05-18T21:28:06.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef218f8700 1 -- 172.21.15.63:0/2176287428 >> v2:172.21.15.155:3300/0 conn(0x7fef1c05f980 msgr2=0x7fef1c09f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:06.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef218f8700 1 --2- 172.21.15.63:0/2176287428 >> v2:172.21.15.155:3300/0 conn(0x7fef1c05f980 0x7fef1c09f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:06.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef218f8700 1 -- 172.21.15.63:0/2176287428 >> v1:172.21.15.155:6789/0 conn(0x7fef1c0b0720 legacy=0x7fef1c0b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef218f8700 1 -- 172.21.15.63:0/2176287428 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c05bf60 con 0x7fef1c0b1120 2020-05-18T21:28:06.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef218f8700 1 --2- 172.21.15.63:0/2176287428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef1c0b1120 0x7fef1c09f020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fef1c0b62a0 tx=0x7fef14008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef218f8700 1 --2- 172.21.15.63:0/2176287428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef1c0b1120 0x7fef1c09f020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fef1c0b62a0 tx=0x7fef14008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef218f8700 1 --2- 172.21.15.63:0/2176287428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef1c0b1120 0x7fef1c09f020 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fef1c0b62a0 tx=0x7fef14008ca0).ready entity=mon.2 client_cookie=a23efd2c21c56655 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:06.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef218f8700 1 --2- 172.21.15.63:0/2176287428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef1c0b1120 0x7fef1c09f020 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fef1c0b62a0 tx=0x7fef14008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef07fff700 1 -- 172.21.15.63:0/2176287428 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef14011db0 con 0x7fef1c0b1120 2020-05-18T21:28:06.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef218f8700 1 --2- 172.21.15.63:0/2176287428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef1c0b1120 0x7fef1c09f020 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fef1c0b62a0 tx=0x7fef14008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef218f8700 1 --2- 172.21.15.63:0/2176287428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef1c0b1120 0x7fef1c09f020 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fef1c0b62a0 tx=0x7fef14008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef07fff700 1 -- 172.21.15.63:0/2176287428 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1400a180 con 0x7fef1c0b1120 2020-05-18T21:28:06.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef07fff700 1 -- 172.21.15.63:0/2176287428 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef1400a5a0 con 0x7fef1c0b1120 2020-05-18T21:28:06.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef220f9700 1 -- 172.21.15.63:0/2176287428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef1c0b1120 msgr2=0x7fef1c09f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef220f9700 1 --2- 172.21.15.63:0/2176287428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef1c0b1120 0x7fef1c09f020 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fef1c0b62a0 tx=0x7fef14008ca0).stop 2020-05-18T21:28:06.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef220f9700 1 -- 172.21.15.63:0/2176287428 shutdown_connections 2020-05-18T21:28:06.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef220f9700 1 --2- 172.21.15.63:0/2176287428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef1c0b1120 0x7fef1c09f020 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:06.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef220f9700 1 --2- 172.21.15.63:0/2176287428 >> v2:172.21.15.155:3300/0 conn(0x7fef1c05f980 0x7fef1c09f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:06.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef220f9700 1 -- 172.21.15.63:0/2176287428 >> 172.21.15.63:0/2176287428 conn(0x7fef1c06a680 msgr2=0x7fef1c05f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:06.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef220f9700 1 -- 172.21.15.63:0/2176287428 shutdown_connections 2020-05-18T21:28:06.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef220f9700 1 -- 172.21.15.63:0/2176287428 wait complete. 2020-05-18T21:28:06.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef220f9700 1 Processor -- start 2020-05-18T21:28:06.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef220f9700 1 -- start start 2020-05-18T21:28:06.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef220f9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fef1c0b0720 0x7fef1c146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:06.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef220f9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fef1c0b1120 0x7fef1c1450a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:06.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef220f9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1c145500 con 0x7fef1c05f980 2020-05-18T21:28:06.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef220f9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1c064fb0 con 0x7fef1c0b1120 2020-05-18T21:28:06.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef220f9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1c065190 con 0x7fef1c0b0720 2020-05-18T21:28:06.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.129+0000 7fef218f8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fef1c0b1120 0x7fef1c1450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:06.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef218f8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fef1c0b1120 0x7fef1c1450a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54708/0 (socket says 172.21.15.63:54708) 2020-05-18T21:28:06.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef218f8700 1 -- 172.21.15.63:0/1383979492 learned_addr learned my addr 172.21.15.63:0/1383979492 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:06.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef208f6700 1 --2- 172.21.15.63:0/1383979492 >> v2:172.21.15.155:3300/0 conn(0x7fef1c0b0720 0x7fef1c146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:06.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef218f8700 1 -- 172.21.15.63:0/1383979492 >> v2:172.21.15.155:3300/0 conn(0x7fef1c0b0720 msgr2=0x7fef1c146840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef218f8700 1 --2- 172.21.15.63:0/1383979492 >> v2:172.21.15.155:3300/0 conn(0x7fef1c0b0720 0x7fef1c146840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:06.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef218f8700 1 -- 172.21.15.63:0/1383979492 >> v1:172.21.15.155:6789/0 conn(0x7fef1c05f980 legacy=0x7fef1c065b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef218f8700 1 -- 172.21.15.63:0/1383979492 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c065430 con 0x7fef1c0b1120 2020-05-18T21:28:06.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef218f8700 1 --2- 172.21.15.63:0/1383979492 >> v2:172.21.15.63:3300/0 conn(0x7fef1c0b1120 0x7fef1c1450a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fef1c0b62a0 tx=0x7fef1c09dca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef218f8700 1 --2- 172.21.15.63:0/1383979492 >> v2:172.21.15.63:3300/0 conn(0x7fef1c0b1120 0x7fef1c1450a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fef1c0b62a0 tx=0x7fef1c09dca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef218f8700 1 --2- 172.21.15.63:0/1383979492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef1c0b1120 0x7fef1c1450a0 secure :-1 s=READY pgs=450 cs=0 l=1 rx=0x7fef1c0b62a0 tx=0x7fef1c09dca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:06.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef218f8700 1 --2- 172.21.15.63:0/1383979492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef1c0b1120 0x7fef1c1450a0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7fef1c0b62a0 tx=0x7fef1c09dca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef218f8700 1 --2- 172.21.15.63:0/1383979492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef1c0b1120 0x7fef1c1450a0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7fef1c0b62a0 tx=0x7fef1c09dca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef218f8700 1 --2- 172.21.15.63:0/1383979492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef1c0b1120 0x7fef1c1450a0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7fef1c0b62a0 tx=0x7fef1c09dca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef0effd700 1 -- 172.21.15.63:0/1383979492 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef140114d0 con 0x7fef1c0b1120 2020-05-18T21:28:06.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef0effd700 1 -- 172.21.15.63:0/1383979492 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1400ae30 con 0x7fef1c0b1120 2020-05-18T21:28:06.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef220f9700 1 -- 172.21.15.63:0/1383979492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef1c0656d0 con 0x7fef1c0b1120 2020-05-18T21:28:06.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef0effd700 1 -- 172.21.15.63:0/1383979492 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef14005c70 con 0x7fef1c0b1120 2020-05-18T21:28:06.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef220f9700 1 -- 172.21.15.63:0/1383979492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1c064000 con 0x7fef1c0b1120 2020-05-18T21:28:06.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef218f8700 1 --2- 172.21.15.63:0/1383979492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef1c0b1120 0x7fef1c1450a0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7fef1c0b62a0 tx=0x7fef1c09dca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef220f9700 1 -- 172.21.15.63:0/1383979492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef1c0569e0 con 0x7fef1c0b1120 2020-05-18T21:28:06.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef0effd700 1 -- 172.21.15.63:0/1383979492 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fef14010560 con 0x7fef1c0b1120 2020-05-18T21:28:06.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.133+0000 7fef218f8700 1 --2- 172.21.15.63:0/1383979492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef1c0b1120 0x7fef1c1450a0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7fef1c0b62a0 tx=0x7fef1c09dca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.137+0000 7fef0effd700 1 --2- 172.21.15.63:0/1383979492 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feef804fad0 0x7feef8051f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:06.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.137+0000 7fef0effd700 1 -- 172.21.15.63:0/1383979492 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fef140646e0 con 0x7fef1c0b1120 2020-05-18T21:28:06.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.137+0000 7fef210f7700 1 --2- 172.21.15.63:0/1383979492 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feef804fad0 0x7feef8051f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:06.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.137+0000 7fef210f7700 1 --2- 172.21.15.63:0/1383979492 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feef804fad0 0x7feef8051f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fef1c145a80 tx=0x7fef18007740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.137+0000 7fef210f7700 1 --2- 172.21.15.63:0/1383979492 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feef804fad0 0x7feef8051f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fef1c145a80 tx=0x7fef18007740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.137+0000 7fef210f7700 1 --2- 172.21.15.63:0/1383979492 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feef804fad0 0x7feef8051f90 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7fef1c145a80 tx=0x7fef18007740).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:06.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.141+0000 7fef218f8700 1 --2- 172.21.15.63:0/1383979492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef1c0b1120 0x7fef1c1450a0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7fef1c0b62a0 tx=0x7fef1c09dca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.141+0000 7fef0effd700 1 -- 172.21.15.63:0/1383979492 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fef1403ea10 con 0x7fef1c0b1120 2020-05-18T21:28:06.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.253+0000 7fef220f9700 1 -- 172.21.15.63:0/1383979492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fef1c09f930 con 0x7fef1c0b1120 2020-05-18T21:28:06.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.253+0000 7fef218f8700 1 --2- 172.21.15.63:0/1383979492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef1c0b1120 0x7fef1c1450a0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7fef1c0b62a0 tx=0x7fef1c09dca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.257+0000 7fef0effd700 1 -- 172.21.15.63:0/1383979492 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v37) v1 ==== 110+0+10 (secure 0 0 0) 0x7fef14042030 con 0x7fef1c0b1120 2020-05-18T21:28:06.263 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:28:06.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.257+0000 7fef220f9700 1 -- 172.21.15.63:0/1383979492 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feef804fad0 msgr2=0x7feef8051f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.257+0000 7fef220f9700 1 --2- 172.21.15.63:0/1383979492 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feef804fad0 0x7feef8051f90 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7fef1c145a80 tx=0x7fef18007740).stop 2020-05-18T21:28:06.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.257+0000 7fef220f9700 1 -- 172.21.15.63:0/1383979492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef1c0b1120 msgr2=0x7fef1c1450a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.257+0000 7fef220f9700 1 --2- 172.21.15.63:0/1383979492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef1c0b1120 0x7fef1c1450a0 secure :-1 s=READY pgs=450 cs=0 l=1 rx=0x7fef1c0b62a0 tx=0x7fef1c09dca0).stop 2020-05-18T21:28:06.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.257+0000 7fef220f9700 1 -- 172.21.15.63:0/1383979492 shutdown_connections 2020-05-18T21:28:06.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.257+0000 7fef220f9700 1 --2- 172.21.15.63:0/1383979492 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feef804fad0 0x7feef8051f90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:06.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.257+0000 7fef220f9700 1 --2- 172.21.15.63:0/1383979492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef1c0b1120 0x7fef1c1450a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:06.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.257+0000 7fef220f9700 1 --2- 172.21.15.63:0/1383979492 >> v2:172.21.15.155:3300/0 conn(0x7fef1c0b0720 0x7fef1c146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:06.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.257+0000 7fef220f9700 1 -- 172.21.15.63:0/1383979492 >> 172.21.15.63:0/1383979492 conn(0x7fef1c06a680 msgr2=0x7fef1c0b6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:06.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.257+0000 7fef220f9700 1 -- 172.21.15.63:0/1383979492 shutdown_connections 2020-05-18T21:28:06.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.257+0000 7fef220f9700 1 -- 172.21.15.63:0/1383979492 wait complete. 2020-05-18T21:28:06.275 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:28:06.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.373+0000 7f1555010700 1 Processor -- start 2020-05-18T21:28:06.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.373+0000 7f1555010700 1 -- start start 2020-05-18T21:28:06.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.373+0000 7f1555010700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f155006a630 0x7f15500adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:06.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.373+0000 7f1555010700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15500b3790 con 0x7f1550149d50 2020-05-18T21:28:06.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.373+0000 7f1555010700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15500b39f0 con 0x7f15500b4450 2020-05-18T21:28:06.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.373+0000 7f1555010700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15500b3c90 con 0x7f155006a630 2020-05-18T21:28:06.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.373+0000 7f154ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1550149d50 0x7f15500ad3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56902/0 (socket says 172.21.15.63:56902) 2020-05-18T21:28:06.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.373+0000 7f154ffff700 1 -- 172.21.15.63:0/2189261268 learned_addr learned my addr 172.21.15.63:0/2189261268 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:06.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.373+0000 7f154f7fe700 1 --2- 172.21.15.63:0/2189261268 >> v2:172.21.15.155:3300/0 conn(0x7f155006a630 0x7f15500adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:06.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f154effd700 1 -- 172.21.15.63:0/2189261268 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324091680 0 0) 0x7f15500b3790 con 0x7f1550149d50 2020-05-18T21:28:06.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f154effd700 1 -- 172.21.15.63:0/2189261268 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1530003270 con 0x7f1550149d50 2020-05-18T21:28:06.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f154f7fe700 1 -- 172.21.15.63:0/2189261268 >> v1:172.21.15.155:6789/0 conn(0x7f15500b4450 legacy=0x7f15500b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f154f7fe700 1 -- 172.21.15.63:0/2189261268 >> v1:172.21.15.63:6789/0 conn(0x7f1550149d50 legacy=0x7f15500ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f154f7fe700 1 -- 172.21.15.63:0/2189261268 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15500adf60 con 0x7f155006a630 2020-05-18T21:28:06.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f154f7fe700 1 --2- 172.21.15.63:0/2189261268 >> v2:172.21.15.155:3300/0 conn(0x7f155006a630 0x7f15500adb00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f15380032f0 tx=0x7f1538007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f154f7fe700 1 --2- 172.21.15.63:0/2189261268 >> v2:172.21.15.155:3300/0 conn(0x7f155006a630 0x7f15500adb00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f15380032f0 tx=0x7f1538007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f154f7fe700 1 --2- 172.21.15.63:0/2189261268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f155006a630 0x7f15500adb00 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f15380032f0 tx=0x7f1538007e00).ready entity=mon.1 client_cookie=234a6f354a6cebd1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:06.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f154f7fe700 1 --2- 172.21.15.63:0/2189261268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f155006a630 0x7f15500adb00 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f15380032f0 tx=0x7f1538007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f154effd700 1 -- 172.21.15.63:0/2189261268 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1538010e90 con 0x7f155006a630 2020-05-18T21:28:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f154f7fe700 1 --2- 172.21.15.63:0/2189261268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f155006a630 0x7f15500adb00 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f15380032f0 tx=0x7f1538007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f154f7fe700 1 --2- 172.21.15.63:0/2189261268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f155006a630 0x7f15500adb00 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f15380032f0 tx=0x7f1538007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f154effd700 1 -- 172.21.15.63:0/2189261268 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15380110d0 con 0x7f155006a630 2020-05-18T21:28:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f154effd700 1 -- 172.21.15.63:0/2189261268 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1538011470 con 0x7f155006a630 2020-05-18T21:28:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f1555010700 1 -- 172.21.15.63:0/2189261268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f155006a630 msgr2=0x7f15500adb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f1555010700 1 --2- 172.21.15.63:0/2189261268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f155006a630 0x7f15500adb00 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f15380032f0 tx=0x7f1538007e00).stop 2020-05-18T21:28:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f1555010700 1 -- 172.21.15.63:0/2189261268 shutdown_connections 2020-05-18T21:28:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f1555010700 1 --2- 172.21.15.63:0/2189261268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f155006a630 0x7f15500adb00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f1555010700 1 -- 172.21.15.63:0/2189261268 >> 172.21.15.63:0/2189261268 conn(0x7f155005fb90 msgr2=0x7f1550069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f1555010700 1 -- 172.21.15.63:0/2189261268 shutdown_connections 2020-05-18T21:28:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f1555010700 1 -- 172.21.15.63:0/2189261268 wait complete. 2020-05-18T21:28:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f1555010700 1 Processor -- start 2020-05-18T21:28:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.377+0000 7f1555010700 1 -- start start 2020-05-18T21:28:06.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f1555010700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f155006a630 0x7f155014bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:06.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f1555010700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1550149d50 0x7f1550146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:06.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f1555010700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155014c0f0 con 0x7f15500b4450 2020-05-18T21:28:06.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f1555010700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1550063600 con 0x7f1550149d50 2020-05-18T21:28:06.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f1555010700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15500631e0 con 0x7f155006a630 2020-05-18T21:28:06.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f154f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f15500b4450 0x7f15501464b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56908/0 (socket says 172.21.15.63:56908) 2020-05-18T21:28:06.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f154f7fe700 1 -- 172.21.15.63:0/2259603825 learned_addr learned my addr 172.21.15.63:0/2259603825 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:06.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f155480f700 1 --2- 172.21.15.63:0/2259603825 >> v2:172.21.15.63:3300/0 conn(0x7f1550149d50 0x7f1550146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:06.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f154ffff700 1 --2- 172.21.15.63:0/2259603825 >> v2:172.21.15.155:3300/0 conn(0x7f155006a630 0x7f155014bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:06.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f154d7fa700 1 -- 172.21.15.63:0/2259603825 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642002035 0 0) 0x7f155014c0f0 con 0x7f15500b4450 2020-05-18T21:28:06.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f154d7fa700 1 -- 172.21.15.63:0/2259603825 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1534002fe0 con 0x7f15500b4450 2020-05-18T21:28:06.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f155480f700 1 -- 172.21.15.63:0/2259603825 >> v2:172.21.15.155:3300/0 conn(0x7f155006a630 msgr2=0x7f155014bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f155480f700 1 --2- 172.21.15.63:0/2259603825 >> v2:172.21.15.155:3300/0 conn(0x7f155006a630 0x7f155014bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:06.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f155480f700 1 -- 172.21.15.63:0/2259603825 >> v1:172.21.15.63:6789/0 conn(0x7f15500b4450 legacy=0x7f15501464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f154d7fa700 1 -- 172.21.15.63:0/2259603825 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1318966356 0 0) 0x7f1534002fe0 con 0x7f15500b4450 2020-05-18T21:28:06.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f155480f700 1 -- 172.21.15.63:0/2259603825 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1550064ab0 con 0x7f1550149d50 2020-05-18T21:28:06.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f154ffff700 1 --2- 172.21.15.63:0/2259603825 >> v2:172.21.15.155:3300/0 conn(0x7f155006a630 0x7f155014bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:06.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f155480f700 1 --2- 172.21.15.63:0/2259603825 >> v2:172.21.15.63:3300/0 conn(0x7f1550149d50 0x7f1550146bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1538008bc0 tx=0x7f1548010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f155480f700 1 --2- 172.21.15.63:0/2259603825 >> v2:172.21.15.63:3300/0 conn(0x7f1550149d50 0x7f1550146bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1538008bc0 tx=0x7f1548010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f155480f700 1 --2- 172.21.15.63:0/2259603825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1550149d50 0x7f1550146bc0 secure :-1 s=READY pgs=453 cs=0 l=1 rx=0x7f1538008bc0 tx=0x7f1548010860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:06.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f155480f700 1 --2- 172.21.15.63:0/2259603825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1550149d50 0x7f1550146bc0 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f1538008bc0 tx=0x7f1548010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f154d7fa700 1 -- 172.21.15.63:0/2259603825 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1538008a20 con 0x7f1550149d50 2020-05-18T21:28:06.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f155480f700 1 --2- 172.21.15.63:0/2259603825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1550149d50 0x7f1550146bc0 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f1538008bc0 tx=0x7f1548010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f155480f700 1 --2- 172.21.15.63:0/2259603825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1550149d50 0x7f1550146bc0 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f1538008bc0 tx=0x7f1548010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f154d7fa700 1 -- 172.21.15.63:0/2259603825 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1548006a10 con 0x7f1550149d50 2020-05-18T21:28:06.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f1555010700 1 -- 172.21.15.63:0/2259603825 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1550064d00 con 0x7f1550149d50 2020-05-18T21:28:06.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f154d7fa700 1 -- 172.21.15.63:0/2259603825 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1548006db0 con 0x7f1550149d50 2020-05-18T21:28:06.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f1555010700 1 -- 172.21.15.63:0/2259603825 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155014ec00 con 0x7f1550149d50 2020-05-18T21:28:06.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f1555010700 1 -- 172.21.15.63:0/2259603825 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15500569e0 con 0x7f1550149d50 2020-05-18T21:28:06.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.381+0000 7f155480f700 1 --2- 172.21.15.63:0/2259603825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1550149d50 0x7f1550146bc0 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f1538008bc0 tx=0x7f1548010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.385+0000 7f154d7fa700 1 -- 172.21.15.63:0/2259603825 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f154800a2b0 con 0x7f1550149d50 2020-05-18T21:28:06.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.385+0000 7f155480f700 1 --2- 172.21.15.63:0/2259603825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1550149d50 0x7f1550146bc0 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f1538008bc0 tx=0x7f1548010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.385+0000 7f154d7fa700 1 --2- 172.21.15.63:0/2259603825 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f153404fd90 0x7f1534052250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:06.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.385+0000 7f154d7fa700 1 -- 172.21.15.63:0/2259603825 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1548063630 con 0x7f1550149d50 2020-05-18T21:28:06.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.385+0000 7f154ffff700 1 --2- 172.21.15.63:0/2259603825 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f153404fd90 0x7f1534052250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:06.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.385+0000 7f154ffff700 1 --2- 172.21.15.63:0/2259603825 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f153404fd90 0x7f1534052250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1540001110 tx=0x7f1540001e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.385+0000 7f154ffff700 1 --2- 172.21.15.63:0/2259603825 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f153404fd90 0x7f1534052250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1540001110 tx=0x7f1540001e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.385+0000 7f154ffff700 1 --2- 172.21.15.63:0/2259603825 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f153404fd90 0x7f1534052250 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f1540001110 tx=0x7f1540001e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:06.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.389+0000 7f155480f700 1 --2- 172.21.15.63:0/2259603825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1550149d50 0x7f1550146bc0 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f1538008bc0 tx=0x7f1548010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.389+0000 7f154d7fa700 1 -- 172.21.15.63:0/2259603825 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f154803d9c0 con 0x7f1550149d50 2020-05-18T21:28:06.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.501+0000 7f1555010700 1 -- 172.21.15.63:0/2259603825 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1550065b40 con 0x7f1550149d50 2020-05-18T21:28:06.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.501+0000 7f155480f700 1 --2- 172.21.15.63:0/2259603825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1550149d50 0x7f1550146bc0 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f1538008bc0 tx=0x7f1548010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.501+0000 7f154d7fa700 1 -- 172.21.15.63:0/2259603825 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1548040fe0 con 0x7f1550149d50 2020-05-18T21:28:06.507 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:28:06.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.501+0000 7f1555010700 1 -- 172.21.15.63:0/2259603825 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f153404fd90 msgr2=0x7f1534052250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.501+0000 7f1555010700 1 --2- 172.21.15.63:0/2259603825 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f153404fd90 0x7f1534052250 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f1540001110 tx=0x7f1540001e00).stop 2020-05-18T21:28:06.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.501+0000 7f1555010700 1 -- 172.21.15.63:0/2259603825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1550149d50 msgr2=0x7f1550146bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.501+0000 7f1555010700 1 --2- 172.21.15.63:0/2259603825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1550149d50 0x7f1550146bc0 secure :-1 s=READY pgs=453 cs=0 l=1 rx=0x7f1538008bc0 tx=0x7f1548010860).stop 2020-05-18T21:28:06.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.501+0000 7f1555010700 1 -- 172.21.15.63:0/2259603825 shutdown_connections 2020-05-18T21:28:06.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.501+0000 7f1555010700 1 --2- 172.21.15.63:0/2259603825 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f153404fd90 0x7f1534052250 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:06.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.501+0000 7f1555010700 1 --2- 172.21.15.63:0/2259603825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1550149d50 0x7f1550146bc0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:06.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.501+0000 7f1555010700 1 --2- 172.21.15.63:0/2259603825 >> v2:172.21.15.155:3300/0 conn(0x7f155006a630 0x7f155014bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:06.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.501+0000 7f1555010700 1 -- 172.21.15.63:0/2259603825 >> 172.21.15.63:0/2259603825 conn(0x7f155005fb90 msgr2=0x7f15500b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:06.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.501+0000 7f1555010700 1 -- 172.21.15.63:0/2259603825 shutdown_connections 2020-05-18T21:28:06.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.501+0000 7f1555010700 1 -- 172.21.15.63:0/2259603825 wait complete. 2020-05-18T21:28:06.520 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-05-18T21:28:06.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.617+0000 7fd571dc6700 1 Processor -- start 2020-05-18T21:28:06.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.617+0000 7fd571dc6700 1 -- start start 2020-05-18T21:28:06.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.617+0000 7fd571dc6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56c05bda0 0x7fd56c142f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:06.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.617+0000 7fd571dc6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd56c12ba80 0x7fd56c12bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:06.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.617+0000 7fd571dc6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56c05ab40 con 0x7fd56c0652b0 2020-05-18T21:28:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.617+0000 7fd571dc6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56c0b6a10 con 0x7fd56c12ba80 2020-05-18T21:28:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.617+0000 7fd571dc6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c05ade0 con 0x7fd56c05bda0 2020-05-18T21:28:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.617+0000 7fd56b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd56c0652b0 0x7fd56c1400d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56916/0 (socket says 172.21.15.63:56916) 2020-05-18T21:28:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.617+0000 7fd56b7fe700 1 -- 172.21.15.63:0/3784224891 learned_addr learned my addr 172.21.15.63:0/3784224891 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.617+0000 7fd56affd700 1 --2- 172.21.15.63:0/3784224891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56c05bda0 0x7fd56c142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:06.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.617+0000 7fd56bfff700 1 --2- 172.21.15.63:0/3784224891 >> v2:172.21.15.155:3300/0 conn(0x7fd56c12ba80 0x7fd56c12bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:06.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.617+0000 7fd56a7fc700 1 -- 172.21.15.63:0/3784224891 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649985921 0 0) 0x7fd56c05ab40 con 0x7fd56c0652b0 2020-05-18T21:28:06.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.617+0000 7fd56a7fc700 1 -- 172.21.15.63:0/3784224891 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd558003270 con 0x7fd56c0652b0 2020-05-18T21:28:06.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.617+0000 7fd56affd700 1 -- 172.21.15.63:0/3784224891 >> v2:172.21.15.155:3300/0 conn(0x7fd56c12ba80 msgr2=0x7fd56c12bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:06.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.617+0000 7fd56affd700 1 --2- 172.21.15.63:0/3784224891 >> v2:172.21.15.155:3300/0 conn(0x7fd56c12ba80 0x7fd56c12bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:06.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.617+0000 7fd56affd700 1 -- 172.21.15.63:0/3784224891 >> v1:172.21.15.63:6789/0 conn(0x7fd56c0652b0 legacy=0x7fd56c1400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.617+0000 7fd56affd700 1 -- 172.21.15.63:0/3784224891 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c05b080 con 0x7fd56c05bda0 2020-05-18T21:28:06.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.617+0000 7fd56bfff700 1 --2- 172.21.15.63:0/3784224891 >> v2:172.21.15.155:3300/0 conn(0x7fd56c12ba80 0x7fd56c12bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:06.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.621+0000 7fd56affd700 1 --2- 172.21.15.63:0/3784224891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56c05bda0 0x7fd56c142f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd56c05b400 tx=0x7fd560008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.621+0000 7fd56affd700 1 --2- 172.21.15.63:0/3784224891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56c05bda0 0x7fd56c142f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd56c05b400 tx=0x7fd560008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.621+0000 7fd56affd700 1 --2- 172.21.15.63:0/3784224891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56c05bda0 0x7fd56c142f30 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7fd56c05b400 tx=0x7fd560008920).ready entity=mon.2 client_cookie=670010a6ce8bb586 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:06.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.621+0000 7fd56affd700 1 --2- 172.21.15.63:0/3784224891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56c05bda0 0x7fd56c142f30 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fd56c05b400 tx=0x7fd560008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.621+0000 7fd56a7fc700 1 -- 172.21.15.63:0/3784224891 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd560008e80 con 0x7fd56c05bda0 2020-05-18T21:28:06.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.621+0000 7fd56affd700 1 --2- 172.21.15.63:0/3784224891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56c05bda0 0x7fd56c142f30 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fd56c05b400 tx=0x7fd560008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.621+0000 7fd56affd700 1 --2- 172.21.15.63:0/3784224891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56c05bda0 0x7fd56c142f30 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fd56c05b400 tx=0x7fd560008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.621+0000 7fd56a7fc700 1 -- 172.21.15.63:0/3784224891 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd560011540 con 0x7fd56c05bda0 2020-05-18T21:28:06.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.621+0000 7fd56a7fc700 1 -- 172.21.15.63:0/3784224891 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd560011960 con 0x7fd56c05bda0 2020-05-18T21:28:06.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.621+0000 7fd571dc6700 1 -- 172.21.15.63:0/3784224891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56c05bda0 msgr2=0x7fd56c142f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.621+0000 7fd571dc6700 1 --2- 172.21.15.63:0/3784224891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56c05bda0 0x7fd56c142f30 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7fd56c05b400 tx=0x7fd560008920).stop 2020-05-18T21:28:06.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.621+0000 7fd571dc6700 1 -- 172.21.15.63:0/3784224891 shutdown_connections 2020-05-18T21:28:06.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.621+0000 7fd571dc6700 1 --2- 172.21.15.63:0/3784224891 >> v2:172.21.15.155:3300/0 conn(0x7fd56c12ba80 0x7fd56c12bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:06.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.621+0000 7fd571dc6700 1 --2- 172.21.15.63:0/3784224891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56c05bda0 0x7fd56c142f30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:06.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.621+0000 7fd571dc6700 1 -- 172.21.15.63:0/3784224891 >> 172.21.15.63:0/3784224891 conn(0x7fd56c066ed0 msgr2=0x7fd56c0b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:06.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.621+0000 7fd571dc6700 1 -- 172.21.15.63:0/3784224891 shutdown_connections 2020-05-18T21:28:06.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.621+0000 7fd571dc6700 1 -- 172.21.15.63:0/3784224891 wait complete. 2020-05-18T21:28:06.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.621+0000 7fd571dc6700 1 Processor -- start 2020-05-18T21:28:06.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.621+0000 7fd571dc6700 1 -- start start 2020-05-18T21:28:06.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd571dc6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd56c0652b0 0x7fd56c129b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:06.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd571dc6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56c12ba80 0x7fd56c12aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:06.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd571dc6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56c12a0c0 con 0x7fd56c05bda0 2020-05-18T21:28:06.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd571dc6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56c12a360 con 0x7fd56c0652b0 2020-05-18T21:28:06.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd571dc6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c12a600 con 0x7fd56c12ba80 2020-05-18T21:28:06.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd56affd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd56c0652b0 0x7fd56c129b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:06.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd56bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56c12ba80 0x7fd56c12aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:06.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd56b7fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd56c05bda0 0x7fd56c0b3650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:55236/0 (socket says 172.21.15.63:55236) 2020-05-18T21:28:06.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd56affd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd56c0652b0 0x7fd56c129b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:41352/0 (socket says 172.21.15.63:41352) 2020-05-18T21:28:06.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd56b7fe700 1 -- 172.21.15.63:0/3770344628 learned_addr learned my addr 172.21.15.63:0/3770344628 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:06.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd56affd700 1 -- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56c12ba80 msgr2=0x7fd56c12aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd56affd700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56c12ba80 0x7fd56c12aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:06.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd56affd700 1 -- 172.21.15.63:0/3770344628 >> v1:172.21.15.155:6789/0 conn(0x7fd56c05bda0 legacy=0x7fd56c0b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd568ff9700 1 -- 172.21.15.63:0/3770344628 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269898625 0 0) 0x7fd56c12a0c0 con 0x7fd56c05bda0 2020-05-18T21:28:06.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd56affd700 1 -- 172.21.15.63:0/3770344628 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c155690 con 0x7fd56c0652b0 2020-05-18T21:28:06.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd56bfff700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56c12ba80 0x7fd56c12aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:06.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd56affd700 1 --2- 172.21.15.63:0/3770344628 >> v2:172.21.15.155:3300/0 conn(0x7fd56c0652b0 0x7fd56c129b90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd56c0b35c0 tx=0x7fd56c0b8500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd56affd700 1 --2- 172.21.15.63:0/3770344628 >> v2:172.21.15.155:3300/0 conn(0x7fd56c0652b0 0x7fd56c129b90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd56c0b35c0 tx=0x7fd56c0b8500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd56affd700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd56c0652b0 0x7fd56c129b90 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7fd56c0b35c0 tx=0x7fd56c0b8500).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:06.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd56affd700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd56c0652b0 0x7fd56c129b90 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fd56c0b35c0 tx=0x7fd56c0b8500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd568ff9700 1 -- 172.21.15.63:0/3770344628 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5600119c0 con 0x7fd56c0652b0 2020-05-18T21:28:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd56affd700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd56c0652b0 0x7fd56c129b90 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fd56c0b35c0 tx=0x7fd56c0b8500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd56affd700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd56c0652b0 0x7fd56c129b90 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fd56c0b35c0 tx=0x7fd56c0b8500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd568ff9700 1 -- 172.21.15.63:0/3770344628 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd560007170 con 0x7fd56c0652b0 2020-05-18T21:28:06.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd571dc6700 1 -- 172.21.15.63:0/3770344628 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56c154e50 con 0x7fd56c0652b0 2020-05-18T21:28:06.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd568ff9700 1 -- 172.21.15.63:0/3770344628 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5600074d0 con 0x7fd56c0652b0 2020-05-18T21:28:06.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.625+0000 7fd571dc6700 1 -- 172.21.15.63:0/3770344628 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56c0b3d60 con 0x7fd56c0652b0 2020-05-18T21:28:06.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.629+0000 7fd56affd700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd56c0652b0 0x7fd56c129b90 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fd56c0b35c0 tx=0x7fd56c0b8500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.629+0000 7fd571dc6700 1 -- 172.21.15.63:0/3770344628 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56c0569e0 con 0x7fd56c0652b0 2020-05-18T21:28:06.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.629+0000 7fd568ff9700 1 -- 172.21.15.63:0/3770344628 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd5600080e0 con 0x7fd56c0652b0 2020-05-18T21:28:06.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.629+0000 7fd56affd700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd56c0652b0 0x7fd56c129b90 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fd56c0b35c0 tx=0x7fd56c0b8500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.629+0000 7fd568ff9700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd54c04f950 0x7fd54c051e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:06.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.629+0000 7fd568ff9700 1 -- 172.21.15.63:0/3770344628 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd560064260 con 0x7fd56c0652b0 2020-05-18T21:28:06.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.629+0000 7fd56b7fe700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd54c04f950 0x7fd54c051e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:06.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.629+0000 7fd56b7fe700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd54c04f950 0x7fd54c051e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd55c0010d0 tx=0x7fd55c001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.629+0000 7fd56b7fe700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd54c04f950 0x7fd54c051e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd55c0010d0 tx=0x7fd55c001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.629+0000 7fd56b7fe700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd54c04f950 0x7fd54c051e10 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7fd55c0010d0 tx=0x7fd55c001720).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:06.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.637+0000 7fd56affd700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd56c0652b0 0x7fd56c129b90 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fd56c0b35c0 tx=0x7fd56c0b8500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.637+0000 7fd568ff9700 1 -- 172.21.15.63:0/3770344628 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd56003e710 con 0x7fd56c0652b0 2020-05-18T21:28:06.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.761+0000 7fd571dc6700 1 -- 172.21.15.63:0/3770344628 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd56c12a770 con 0x7fd56c0652b0 2020-05-18T21:28:06.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.761+0000 7fd56affd700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd56c0652b0 0x7fd56c129b90 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fd56c0b35c0 tx=0x7fd56c0b8500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.761+0000 7fd568ff9700 1 -- 172.21.15.63:0/3770344628 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+143 (secure 0 0 0) 0x7fd560041d30 con 0x7fd56c0652b0 2020-05-18T21:28:06.770 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:06.770 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:28:06.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:06.770 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2020-05-18T21:28:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "device_health_metrics" 2020-05-18T21:28:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 2, 2020-05-18T21:28:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "rbd" 2020-05-18T21:28:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:06.772 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:28:06.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.765+0000 7fd571dc6700 1 -- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd54c04f950 msgr2=0x7fd54c051e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.765+0000 7fd571dc6700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd54c04f950 0x7fd54c051e10 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7fd55c0010d0 tx=0x7fd55c001720).stop 2020-05-18T21:28:06.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.765+0000 7fd571dc6700 1 -- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd56c0652b0 msgr2=0x7fd56c129b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.765+0000 7fd571dc6700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd56c0652b0 0x7fd56c129b90 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7fd56c0b35c0 tx=0x7fd56c0b8500).stop 2020-05-18T21:28:06.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.765+0000 7fd571dc6700 1 -- 172.21.15.63:0/3770344628 shutdown_connections 2020-05-18T21:28:06.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.765+0000 7fd571dc6700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd54c04f950 0x7fd54c051e10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:06.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.765+0000 7fd571dc6700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd56c12ba80 0x7fd56c12aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:06.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.765+0000 7fd571dc6700 1 --2- 172.21.15.63:0/3770344628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd56c0652b0 0x7fd56c129b90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:06.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.765+0000 7fd571dc6700 1 -- 172.21.15.63:0/3770344628 >> 172.21.15.63:0/3770344628 conn(0x7fd56c066ed0 msgr2=0x7fd56c13f470 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:06.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.765+0000 7fd571dc6700 1 -- 172.21.15.63:0/3770344628 shutdown_connections 2020-05-18T21:28:06.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.765+0000 7fd571dc6700 1 -- 172.21.15.63:0/3770344628 wait complete. 2020-05-18T21:28:06.787 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-05-18T21:28:06.787 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-05-18T21:28:06.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48c304700 1 Processor -- start 2020-05-18T21:28:06.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48c304700 1 -- start start 2020-05-18T21:28:06.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48c304700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc4840b6d70 0x7fc484145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:06.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48c304700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b7bf0 0x7fc4840b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:06.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48c304700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc484143810 con 0x7fc484143430 2020-05-18T21:28:06.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48c304700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4840b7210 con 0x7fc4840b6d70 2020-05-18T21:28:06.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48c304700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840b74b0 con 0x7fc4840b7bf0 2020-05-18T21:28:06.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48989f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc4840b6d70 0x7fc484145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:06.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48a0a0700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fc484143430 0x7fc4840b9160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:55244/0 (socket says 172.21.15.63:55244) 2020-05-18T21:28:06.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48a0a0700 1 -- 172.21.15.63:0/282331645 learned_addr learned my addr 172.21.15.63:0/282331645 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:06.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48a8a1700 1 --2- 172.21.15.63:0/282331645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b7bf0 0x7fc4840b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:06.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48989f700 1 -- 172.21.15.63:0/282331645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b7bf0 msgr2=0x7fc4840b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:06.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48989f700 1 --2- 172.21.15.63:0/282331645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b7bf0 0x7fc4840b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:06.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48989f700 1 -- 172.21.15.63:0/282331645 >> v1:172.21.15.155:6789/0 conn(0x7fc484143430 legacy=0x7fc4840b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48989f700 1 -- 172.21.15.63:0/282331645 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4840b7750 con 0x7fc4840b6d70 2020-05-18T21:28:06.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48989f700 1 --2- 172.21.15.63:0/282331645 >> v2:172.21.15.155:3300/0 conn(0x7fc4840b6d70 0x7fc484145dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc474002f70 tx=0x7fc48405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48989f700 1 --2- 172.21.15.63:0/282331645 >> v2:172.21.15.155:3300/0 conn(0x7fc4840b6d70 0x7fc484145dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc474002f70 tx=0x7fc48405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48989f700 1 --2- 172.21.15.63:0/282331645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4840b6d70 0x7fc484145dd0 secure :-1 s=READY pgs=336 cs=0 l=1 rx=0x7fc474002f70 tx=0x7fc48405ab60).ready entity=mon.1 client_cookie=445befea4e59645b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:06.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48989f700 1 --2- 172.21.15.63:0/282331645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4840b6d70 0x7fc484145dd0 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7fc474002f70 tx=0x7fc48405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48909e700 1 -- 172.21.15.63:0/282331645 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc474008e80 con 0x7fc4840b6d70 2020-05-18T21:28:06.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48989f700 1 --2- 172.21.15.63:0/282331645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4840b6d70 0x7fc484145dd0 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7fc474002f70 tx=0x7fc48405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48989f700 1 --2- 172.21.15.63:0/282331645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4840b6d70 0x7fc484145dd0 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7fc474002f70 tx=0x7fc48405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48909e700 1 -- 172.21.15.63:0/282331645 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4740115f0 con 0x7fc4840b6d70 2020-05-18T21:28:06.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48909e700 1 -- 172.21.15.63:0/282331645 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc474011a10 con 0x7fc4840b6d70 2020-05-18T21:28:06.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48c304700 1 -- 172.21.15.63:0/282331645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4840b6d70 msgr2=0x7fc484145dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.893+0000 7fc48c304700 1 --2- 172.21.15.63:0/282331645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4840b6d70 0x7fc484145dd0 secure :-1 s=READY pgs=336 cs=0 l=1 rx=0x7fc474002f70 tx=0x7fc48405ab60).stop 2020-05-18T21:28:06.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.897+0000 7fc48c304700 1 -- 172.21.15.63:0/282331645 shutdown_connections 2020-05-18T21:28:06.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.897+0000 7fc48c304700 1 --2- 172.21.15.63:0/282331645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b7bf0 0x7fc4840b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:06.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.897+0000 7fc48c304700 1 --2- 172.21.15.63:0/282331645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4840b6d70 0x7fc484145dd0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:06.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.897+0000 7fc48c304700 1 -- 172.21.15.63:0/282331645 >> 172.21.15.63:0/282331645 conn(0x7fc484069b70 msgr2=0x7fc484069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:06.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.897+0000 7fc48c304700 1 -- 172.21.15.63:0/282331645 shutdown_connections 2020-05-18T21:28:06.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.897+0000 7fc48c304700 1 -- 172.21.15.63:0/282331645 wait complete. 2020-05-18T21:28:06.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.897+0000 7fc48c304700 1 Processor -- start 2020-05-18T21:28:06.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.897+0000 7fc48c304700 1 -- start start 2020-05-18T21:28:06.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.897+0000 7fc48c304700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b6d70 0x7fc48413de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:06.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.897+0000 7fc48c304700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc484146f00 con 0x7fc484143430 2020-05-18T21:28:06.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.897+0000 7fc48c304700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4841471a0 con 0x7fc4840b7bf0 2020-05-18T21:28:06.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.897+0000 7fc48c304700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc484146cf0 con 0x7fc4840b6d70 2020-05-18T21:28:06.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.897+0000 7fc48a8a1700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc484143430 0x7fc48412dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56938/0 (socket says 172.21.15.63:56938) 2020-05-18T21:28:06.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.897+0000 7fc48a8a1700 1 -- 172.21.15.63:0/16329976 learned_addr learned my addr 172.21.15.63:0/16329976 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:06.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.897+0000 7fc48a0a0700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b6d70 0x7fc48413de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:06.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc4737fe700 1 -- 172.21.15.63:0/16329976 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530835465 0 0) 0x7fc484146f00 con 0x7fc484143430 2020-05-18T21:28:06.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc4737fe700 1 -- 172.21.15.63:0/16329976 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc464002fe0 con 0x7fc484143430 2020-05-18T21:28:06.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc4737fe700 1 -- 172.21.15.63:0/16329976 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539683873 0 0) 0x7fc4841471a0 con 0x7fc4840b7bf0 2020-05-18T21:28:06.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc4737fe700 1 -- 172.21.15.63:0/16329976 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc484146f00 con 0x7fc4840b7bf0 2020-05-18T21:28:06.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc48a0a0700 1 -- 172.21.15.63:0/16329976 >> v1:172.21.15.155:6789/0 conn(0x7fc4840b7bf0 legacy=0x7fc48413ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc48a0a0700 1 -- 172.21.15.63:0/16329976 >> v1:172.21.15.63:6789/0 conn(0x7fc484143430 legacy=0x7fc48412dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:06.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc48a0a0700 1 -- 172.21.15.63:0/16329976 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48413f150 con 0x7fc4840b6d70 2020-05-18T21:28:06.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc48a0a0700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b6d70 0x7fc48413de50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc4840600b0 tx=0x7fc480010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc48a0a0700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b6d70 0x7fc48413de50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc4840600b0 tx=0x7fc480010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc48a0a0700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b6d70 0x7fc48413de50 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fc4840600b0 tx=0x7fc480010900).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:06.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc48a0a0700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b6d70 0x7fc48413de50 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fc4840600b0 tx=0x7fc480010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc4737fe700 1 -- 172.21.15.63:0/16329976 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc480005ce0 con 0x7fc4840b6d70 2020-05-18T21:28:06.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc48a0a0700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b6d70 0x7fc48413de50 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fc4840600b0 tx=0x7fc480010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc48a0a0700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b6d70 0x7fc48413de50 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fc4840600b0 tx=0x7fc480010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc4737fe700 1 -- 172.21.15.63:0/16329976 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc480005e40 con 0x7fc4840b6d70 2020-05-18T21:28:06.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc48c304700 1 -- 172.21.15.63:0/16329976 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48412e480 con 0x7fc4840b6d70 2020-05-18T21:28:06.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc4737fe700 1 -- 172.21.15.63:0/16329976 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4800062c0 con 0x7fc4840b6d70 2020-05-18T21:28:06.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc48c304700 1 -- 172.21.15.63:0/16329976 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc484145020 con 0x7fc4840b6d70 2020-05-18T21:28:06.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc48a0a0700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b6d70 0x7fc48413de50 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fc4840600b0 tx=0x7fc480010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc48c304700 1 -- 172.21.15.63:0/16329976 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4840569e0 con 0x7fc4840b6d70 2020-05-18T21:28:06.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc4737fe700 1 -- 172.21.15.63:0/16329976 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc480006530 con 0x7fc4840b6d70 2020-05-18T21:28:06.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.901+0000 7fc48a0a0700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b6d70 0x7fc48413de50 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fc4840600b0 tx=0x7fc480010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.905+0000 7fc4737fe700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc46404ff30 0x7fc4640523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:06.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.905+0000 7fc4737fe700 1 -- 172.21.15.63:0/16329976 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc4800090c0 con 0x7fc4840b6d70 2020-05-18T21:28:06.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.905+0000 7fc48989f700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc46404ff30 0x7fc4640523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:06.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.905+0000 7fc48989f700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc46404ff30 0x7fc4640523f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc474008500 tx=0x7fc48405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.905+0000 7fc48989f700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc46404ff30 0x7fc4640523f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc474008500 tx=0x7fc48405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.905+0000 7fc48989f700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc46404ff30 0x7fc4640523f0 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7fc474008500 tx=0x7fc48405ab60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:06.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.913+0000 7fc48a0a0700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b6d70 0x7fc48413de50 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fc4840600b0 tx=0x7fc480010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:06.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:06.913+0000 7fc4737fe700 1 -- 172.21.15.63:0/16329976 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc48003dfd0 con 0x7fc4840b6d70 2020-05-18T21:28:07.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.029+0000 7fc48c304700 1 -- 172.21.15.63:0/16329976 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fc4840678d0 con 0x7fc4840b6d70 2020-05-18T21:28:07.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.321+0000 7fc48a0a0700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b6d70 0x7fc48413de50 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fc4840600b0 tx=0x7fc480010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:07.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.321+0000 7fc4737fe700 1 -- 172.21.15.63:0/16329976 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v38) v1 ==== 133+0+0 (secure 0 0 0) 0x7fc4800415f0 con 0x7fc4840b6d70 2020-05-18T21:28:07.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.325+0000 7fc48c304700 1 -- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc46404ff30 msgr2=0x7fc4640523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:07.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.325+0000 7fc48c304700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc46404ff30 0x7fc4640523f0 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7fc474008500 tx=0x7fc48405ab60).stop 2020-05-18T21:28:07.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.325+0000 7fc48c304700 1 -- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b6d70 msgr2=0x7fc48413de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:07.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.325+0000 7fc48c304700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b6d70 0x7fc48413de50 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fc4840600b0 tx=0x7fc480010900).stop 2020-05-18T21:28:07.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.325+0000 7fc48c304700 1 -- 172.21.15.63:0/16329976 shutdown_connections 2020-05-18T21:28:07.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.325+0000 7fc48c304700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc46404ff30 0x7fc4640523f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:07.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.325+0000 7fc48c304700 1 --2- 172.21.15.63:0/16329976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4840b6d70 0x7fc48413de50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:07.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.325+0000 7fc48c304700 1 -- 172.21.15.63:0/16329976 >> 172.21.15.63:0/16329976 conn(0x7fc484069b70 msgr2=0x7fc48405c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:07.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.325+0000 7fc48c304700 1 -- 172.21.15.63:0/16329976 shutdown_connections 2020-05-18T21:28:07.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.325+0000 7fc48c304700 1 -- 172.21.15.63:0/16329976 wait complete. 2020-05-18T21:28:07.334 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2020-05-18T21:28:07.346 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-05-18T21:28:07.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.445+0000 7f5dcda65700 1 Processor -- start 2020-05-18T21:28:07.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.445+0000 7f5dcda65700 1 -- start start 2020-05-18T21:28:07.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dcda65700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5dc80b9500 0x7f5dc80b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:07.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dcda65700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5dc80b6d90 0x7f5dc8061270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:07.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dcda65700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc80616d0 0x7f5dc80b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:07.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dcda65700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc80b7ec0 con 0x7f5dc80b9500 2020-05-18T21:28:07.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dcda65700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc8060660 con 0x7f5dc80b6d90 2020-05-18T21:28:07.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dcda65700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc8060890 con 0x7f5dc80616d0 2020-05-18T21:28:07.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dc77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5dc80b9500 0x7f5dc80b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:07.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dc77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5dc80b9500 0x7f5dc80b8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54754/0 (socket says 172.21.15.63:54754) 2020-05-18T21:28:07.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dc77fe700 1 -- 172.21.15.63:0/2645307319 learned_addr learned my addr 172.21.15.63:0/2645307319 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:07.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dc7fff700 1 --2- 172.21.15.63:0/2645307319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc80616d0 0x7f5dc80b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:07.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dbffff700 1 --2- 172.21.15.63:0/2645307319 >> v2:172.21.15.155:3300/0 conn(0x7f5dc80b6d90 0x7f5dc8061270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:07.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dc77fe700 1 -- 172.21.15.63:0/2645307319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc80616d0 msgr2=0x7f5dc80b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:07.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dc77fe700 1 --2- 172.21.15.63:0/2645307319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc80616d0 0x7f5dc80b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:07.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dc77fe700 1 -- 172.21.15.63:0/2645307319 >> v2:172.21.15.155:3300/0 conn(0x7f5dc80b6d90 msgr2=0x7f5dc8061270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:07.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dc77fe700 1 --2- 172.21.15.63:0/2645307319 >> v2:172.21.15.155:3300/0 conn(0x7f5dc80b6d90 0x7f5dc8061270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:07.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dc77fe700 1 -- 172.21.15.63:0/2645307319 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc8060b30 con 0x7f5dc80b9500 2020-05-18T21:28:07.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dc77fe700 1 --2- 172.21.15.63:0/2645307319 >> v2:172.21.15.63:3300/0 conn(0x7f5dc80b9500 0x7f5dc80b8630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5dc806ab40 tx=0x7f5db8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:07.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dc77fe700 1 --2- 172.21.15.63:0/2645307319 >> v2:172.21.15.63:3300/0 conn(0x7f5dc80b9500 0x7f5dc80b8630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5dc806ab40 tx=0x7f5db8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:07.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dc77fe700 1 --2- 172.21.15.63:0/2645307319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc80b9500 0x7f5dc80b8630 secure :-1 s=READY pgs=456 cs=0 l=1 rx=0x7f5dc806ab40 tx=0x7f5db8008920).ready entity=mon.0 client_cookie=229d4709fcd14db2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:07.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dc77fe700 1 --2- 172.21.15.63:0/2645307319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc80b9500 0x7f5dc80b8630 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7f5dc806ab40 tx=0x7f5db8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:07.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dc6ffd700 1 -- 172.21.15.63:0/2645307319 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5db8011600 con 0x7f5dc80b9500 2020-05-18T21:28:07.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dc77fe700 1 --2- 172.21.15.63:0/2645307319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc80b9500 0x7f5dc80b8630 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7f5dc806ab40 tx=0x7f5db8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:07.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dc77fe700 1 --2- 172.21.15.63:0/2645307319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc80b9500 0x7f5dc80b8630 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7f5dc806ab40 tx=0x7f5db8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:07.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dc6ffd700 1 -- 172.21.15.63:0/2645307319 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db8011760 con 0x7f5dc80b9500 2020-05-18T21:28:07.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dc6ffd700 1 -- 172.21.15.63:0/2645307319 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5db8011b80 con 0x7f5dc80b9500 2020-05-18T21:28:07.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dcda65700 1 -- 172.21.15.63:0/2645307319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc80b9500 msgr2=0x7f5dc80b8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:07.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dcda65700 1 --2- 172.21.15.63:0/2645307319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc80b9500 0x7f5dc80b8630 secure :-1 s=READY pgs=456 cs=0 l=1 rx=0x7f5dc806ab40 tx=0x7f5db8008920).stop 2020-05-18T21:28:07.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dcda65700 1 -- 172.21.15.63:0/2645307319 shutdown_connections 2020-05-18T21:28:07.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dcda65700 1 --2- 172.21.15.63:0/2645307319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc80616d0 0x7f5dc80b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:07.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dcda65700 1 --2- 172.21.15.63:0/2645307319 >> v2:172.21.15.155:3300/0 conn(0x7f5dc80b6d90 0x7f5dc8061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:07.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dcda65700 1 --2- 172.21.15.63:0/2645307319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc80b9500 0x7f5dc80b8630 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:07.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dcda65700 1 -- 172.21.15.63:0/2645307319 >> 172.21.15.63:0/2645307319 conn(0x7f5dc8069b70 msgr2=0x7f5dc8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:07.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dcda65700 1 -- 172.21.15.63:0/2645307319 shutdown_connections 2020-05-18T21:28:07.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.449+0000 7f5dcda65700 1 -- 172.21.15.63:0/2645307319 wait complete. 2020-05-18T21:28:07.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dcda65700 1 Processor -- start 2020-05-18T21:28:07.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dcda65700 1 -- start start 2020-05-18T21:28:07.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dcda65700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc80b6d90 0x7f5dc81529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:07.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dcda65700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5dc80b9500 0x7f5dc80adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:07.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dcda65700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc80af070 con 0x7f5dc80616d0 2020-05-18T21:28:07.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dcda65700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc80ae370 con 0x7f5dc80b9500 2020-05-18T21:28:07.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dcda65700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc812ca80 con 0x7f5dc80b6d90 2020-05-18T21:28:07.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dc7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5dc80b9500 0x7f5dc80adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:07.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dc77fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5dc80616d0 0x7f5dc8156490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56948/0 (socket says 172.21.15.63:56948) 2020-05-18T21:28:07.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dc77fe700 1 -- 172.21.15.63:0/2306903053 learned_addr learned my addr 172.21.15.63:0/2306903053 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:07.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dbffff700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc80b6d90 0x7f5dc81529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:07.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dc57fa700 1 -- 172.21.15.63:0/2306903053 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325677872 0 0) 0x7f5dc80af070 con 0x7f5dc80616d0 2020-05-18T21:28:07.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dc7fff700 1 -- 172.21.15.63:0/2306903053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc80b6d90 msgr2=0x7f5dc81529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:07.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dc7fff700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc80b6d90 0x7f5dc81529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:07.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dc7fff700 1 -- 172.21.15.63:0/2306903053 >> v1:172.21.15.63:6789/0 conn(0x7f5dc80616d0 legacy=0x7f5dc8156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:07.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dc7fff700 1 -- 172.21.15.63:0/2306903053 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc80af310 con 0x7f5dc80b9500 2020-05-18T21:28:07.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dc7fff700 1 --2- 172.21.15.63:0/2306903053 >> v2:172.21.15.63:3300/0 conn(0x7f5dc80b9500 0x7f5dc80adf10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5dc00032f0 tx=0x7f5dc0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:07.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dc7fff700 1 --2- 172.21.15.63:0/2306903053 >> v2:172.21.15.63:3300/0 conn(0x7f5dc80b9500 0x7f5dc80adf10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5dc00032f0 tx=0x7f5dc0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:07.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dc7fff700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc80b9500 0x7f5dc80adf10 secure :-1 s=READY pgs=458 cs=0 l=1 rx=0x7f5dc00032f0 tx=0x7f5dc0010f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:07.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dc7fff700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc80b9500 0x7f5dc80adf10 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7f5dc00032f0 tx=0x7f5dc0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:07.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dc7fff700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc80b9500 0x7f5dc80adf10 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7f5dc00032f0 tx=0x7f5dc0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:07.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dc57fa700 1 -- 172.21.15.63:0/2306903053 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dc0005a80 con 0x7f5dc80b9500 2020-05-18T21:28:07.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dc7fff700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc80b9500 0x7f5dc80adf10 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7f5dc00032f0 tx=0x7f5dc0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:07.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dc57fa700 1 -- 172.21.15.63:0/2306903053 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc0005be0 con 0x7f5dc80b9500 2020-05-18T21:28:07.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dc57fa700 1 -- 172.21.15.63:0/2306903053 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dc00129f0 con 0x7f5dc80b9500 2020-05-18T21:28:07.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.453+0000 7f5dcda65700 1 -- 172.21.15.63:0/2306903053 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc80ada70 con 0x7f5dc80b9500 2020-05-18T21:28:07.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.457+0000 7f5dcda65700 1 -- 172.21.15.63:0/2306903053 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc80acbf0 con 0x7f5dc80b9500 2020-05-18T21:28:07.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.457+0000 7f5dc7fff700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc80b9500 0x7f5dc80adf10 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7f5dc00032f0 tx=0x7f5dc0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:07.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.457+0000 7f5dcda65700 1 -- 172.21.15.63:0/2306903053 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc80adc00 con 0x7f5dc80b9500 2020-05-18T21:28:07.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.457+0000 7f5dc57fa700 1 -- 172.21.15.63:0/2306903053 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5dc0012c20 con 0x7f5dc80b9500 2020-05-18T21:28:07.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.457+0000 7f5dc7fff700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc80b9500 0x7f5dc80adf10 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7f5dc00032f0 tx=0x7f5dc0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:07.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.457+0000 7f5dc57fa700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5dac04f8d0 0x7f5dac051d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:07.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.457+0000 7f5dc57fa700 1 -- 172.21.15.63:0/2306903053 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f5dc0063bd0 con 0x7f5dc80b9500 2020-05-18T21:28:07.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.457+0000 7f5dc77fe700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5dac04f8d0 0x7f5dac051d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:07.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.457+0000 7f5dc77fe700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5dac04f8d0 0x7f5dac051d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5db8008320 tx=0x7f5db80113b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:07.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.461+0000 7f5dc77fe700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5dac04f8d0 0x7f5dac051d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5db8008320 tx=0x7f5db80113b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:07.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.461+0000 7f5dc77fe700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5dac04f8d0 0x7f5dac051d90 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f5db8008320 tx=0x7f5db80113b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:07.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.465+0000 7f5dc7fff700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc80b9500 0x7f5dc80adf10 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7f5dc00032f0 tx=0x7f5dc0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:07.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.465+0000 7f5dc57fa700 1 -- 172.21.15.63:0/2306903053 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f5dc003df60 con 0x7f5dc80b9500 2020-05-18T21:28:07.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:07.589+0000 7f5dcda65700 1 -- 172.21.15.63:0/2306903053 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f5dc80569e0 con 0x7f5dc80b9500 2020-05-18T21:28:08.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.325+0000 7f5dc7fff700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc80b9500 0x7f5dc80adf10 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7f5dc00032f0 tx=0x7f5dc0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.325+0000 7f5dc57fa700 1 -- 172.21.15.63:0/2306903053 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v39) v1 ==== 125+0+0 (secure 0 0 0) 0x7f5dc0041580 con 0x7f5dc80b9500 2020-05-18T21:28:08.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.333+0000 7f5dcda65700 1 -- 172.21.15.63:0/2306903053 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5dac04f8d0 msgr2=0x7f5dac051d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:08.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.333+0000 7f5dcda65700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5dac04f8d0 0x7f5dac051d90 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f5db8008320 tx=0x7f5db80113b0).stop 2020-05-18T21:28:08.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.333+0000 7f5dcda65700 1 -- 172.21.15.63:0/2306903053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc80b9500 msgr2=0x7f5dc80adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:08.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.333+0000 7f5dcda65700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc80b9500 0x7f5dc80adf10 secure :-1 s=READY pgs=458 cs=0 l=1 rx=0x7f5dc00032f0 tx=0x7f5dc0010f30).stop 2020-05-18T21:28:08.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.333+0000 7f5dcda65700 1 -- 172.21.15.63:0/2306903053 shutdown_connections 2020-05-18T21:28:08.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.333+0000 7f5dcda65700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5dac04f8d0 0x7f5dac051d90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:08.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.333+0000 7f5dcda65700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc80b9500 0x7f5dc80adf10 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:08.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.333+0000 7f5dcda65700 1 --2- 172.21.15.63:0/2306903053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc80b6d90 0x7f5dc81529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:08.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.333+0000 7f5dcda65700 1 -- 172.21.15.63:0/2306903053 >> 172.21.15.63:0/2306903053 conn(0x7f5dc8069b70 msgr2=0x7f5dc812e260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:08.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.333+0000 7f5dcda65700 1 -- 172.21.15.63:0/2306903053 shutdown_connections 2020-05-18T21:28:08.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.333+0000 7f5dcda65700 1 -- 172.21.15.63:0/2306903053 wait complete. 2020-05-18T21:28:08.341 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2020-05-18T21:28:08.351 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-05-18T21:28:08.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59dff63700 1 Processor -- start 2020-05-18T21:28:08.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59dff63700 1 -- start start 2020-05-18T21:28:08.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59dff63700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f59d8069eb0 0x7f59d80624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:08.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59dff63700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59d80b1850 0x7f59d8146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:08.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59dff63700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d8147300 con 0x7f59d8146a60 2020-05-18T21:28:08.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59dff63700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d80b3fb0 con 0x7f59d8069eb0 2020-05-18T21:28:08.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59dff63700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80b4250 con 0x7f59d80b1850 2020-05-18T21:28:08.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59ddcff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f59d8069eb0 0x7f59d80624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:08.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59ddcff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f59d8069eb0 0x7f59d80624e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54768/0 (socket says 172.21.15.63:54768) 2020-05-18T21:28:08.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59ddcff700 1 -- 172.21.15.63:0/2217804052 learned_addr learned my addr 172.21.15.63:0/2217804052 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:08.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59dd4fe700 1 --1- 172.21.15.63:0/2217804052 >> v1:172.21.15.63:6789/0 conn(0x7f59d8146a60 0x7f59d805ebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56958/0 (socket says 172.21.15.63:56958) 2020-05-18T21:28:08.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59de500700 1 --2- 172.21.15.63:0/2217804052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59d80b1850 0x7f59d8146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:08.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59ddcff700 1 -- 172.21.15.63:0/2217804052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59d80b1850 msgr2=0x7f59d8146ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:08.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59ddcff700 1 --2- 172.21.15.63:0/2217804052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59d80b1850 0x7f59d8146ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:08.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59ddcff700 1 -- 172.21.15.63:0/2217804052 >> v1:172.21.15.63:6789/0 conn(0x7f59d8146a60 legacy=0x7f59d805ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:08.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59ddcff700 1 -- 172.21.15.63:0/2217804052 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d80b44f0 con 0x7f59d8069eb0 2020-05-18T21:28:08.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59dccfd700 1 -- 172.21.15.63:0/2217804052 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104740141 0 0) 0x7f59d8147300 con 0x7f59d8146a60 2020-05-18T21:28:08.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59ddcff700 1 --2- 172.21.15.63:0/2217804052 >> v2:172.21.15.63:3300/0 conn(0x7f59d8069eb0 0x7f59d80624e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f59c80032f0 tx=0x7f59c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59ddcff700 1 --2- 172.21.15.63:0/2217804052 >> v2:172.21.15.63:3300/0 conn(0x7f59d8069eb0 0x7f59d80624e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f59c80032f0 tx=0x7f59c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59ddcff700 1 --2- 172.21.15.63:0/2217804052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59d8069eb0 0x7f59d80624e0 secure :-1 s=READY pgs=460 cs=0 l=1 rx=0x7f59c80032f0 tx=0x7f59c8007e00).ready entity=mon.0 client_cookie=68bc22168bd8a8d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:08.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59ddcff700 1 --2- 172.21.15.63:0/2217804052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59d8069eb0 0x7f59d80624e0 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7f59c80032f0 tx=0x7f59c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.441+0000 7f59dccfd700 1 -- 172.21.15.63:0/2217804052 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59c8011dc0 con 0x7f59d8069eb0 2020-05-18T21:28:08.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59ddcff700 1 --2- 172.21.15.63:0/2217804052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59d8069eb0 0x7f59d80624e0 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7f59c80032f0 tx=0x7f59c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59dccfd700 1 -- 172.21.15.63:0/2217804052 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c800a180 con 0x7f59d8069eb0 2020-05-18T21:28:08.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59ddcff700 1 --2- 172.21.15.63:0/2217804052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59d8069eb0 0x7f59d80624e0 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7f59c80032f0 tx=0x7f59c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59dff63700 1 -- 172.21.15.63:0/2217804052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59d8069eb0 msgr2=0x7f59d80624e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:08.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59dccfd700 1 -- 172.21.15.63:0/2217804052 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59c800a560 con 0x7f59d8069eb0 2020-05-18T21:28:08.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59dff63700 1 --2- 172.21.15.63:0/2217804052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59d8069eb0 0x7f59d80624e0 secure :-1 s=READY pgs=460 cs=0 l=1 rx=0x7f59c80032f0 tx=0x7f59c8007e00).stop 2020-05-18T21:28:08.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59dff63700 1 -- 172.21.15.63:0/2217804052 shutdown_connections 2020-05-18T21:28:08.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59dff63700 1 --2- 172.21.15.63:0/2217804052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59d80b1850 0x7f59d8146ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:08.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59dff63700 1 --2- 172.21.15.63:0/2217804052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59d8069eb0 0x7f59d80624e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:08.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59dff63700 1 -- 172.21.15.63:0/2217804052 >> 172.21.15.63:0/2217804052 conn(0x7f59d80b9700 msgr2=0x7f59d80b9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:08.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59dff63700 1 -- 172.21.15.63:0/2217804052 shutdown_connections 2020-05-18T21:28:08.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59dff63700 1 -- 172.21.15.63:0/2217804052 wait complete. 2020-05-18T21:28:08.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59dff63700 1 Processor -- start 2020-05-18T21:28:08.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59dff63700 1 -- start start 2020-05-18T21:28:08.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59dff63700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f59d80b1850 0x7f59d809b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:08.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59dff63700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f59d8146a60 0x7f59d8144700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:08.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59dff63700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d80b75a0 con 0x7f59d8069eb0 2020-05-18T21:28:08.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59dff63700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d80b7390 con 0x7f59d8146a60 2020-05-18T21:28:08.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59dff63700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d80b7840 con 0x7f59d80b1850 2020-05-18T21:28:08.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59de500700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f59d8146a60 0x7f59d8144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:08.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59dd4fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f59d80b1850 0x7f59d809b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:08.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59de500700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f59d8146a60 0x7f59d8144700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54778/0 (socket says 172.21.15.63:54778) 2020-05-18T21:28:08.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59ddcff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f59d8069eb0 0x7f59d8143ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:55278/0 (socket says 172.21.15.63:55278) 2020-05-18T21:28:08.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59de500700 1 -- 172.21.15.63:0/3743661632 learned_addr learned my addr 172.21.15.63:0/3743661632 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:08.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59de500700 1 -- 172.21.15.63:0/3743661632 >> v2:172.21.15.155:3300/0 conn(0x7f59d80b1850 msgr2=0x7f59d809b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:08.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59de500700 1 --2- 172.21.15.63:0/3743661632 >> v2:172.21.15.155:3300/0 conn(0x7f59d80b1850 0x7f59d809b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:08.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59de500700 1 -- 172.21.15.63:0/3743661632 >> v1:172.21.15.155:6789/0 conn(0x7f59d8069eb0 legacy=0x7f59d8143ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:08.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.445+0000 7f59de500700 1 -- 172.21.15.63:0/3743661632 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d80b7ae0 con 0x7f59d8146a60 2020-05-18T21:28:08.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59de500700 1 --2- 172.21.15.63:0/3743661632 >> v2:172.21.15.63:3300/0 conn(0x7f59d8146a60 0x7f59d8144700 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59d0002f70 tx=0x7f59d0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59de500700 1 --2- 172.21.15.63:0/3743661632 >> v2:172.21.15.63:3300/0 conn(0x7f59d8146a60 0x7f59d8144700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59d0002f70 tx=0x7f59d0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59de500700 1 --2- 172.21.15.63:0/3743661632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59d8146a60 0x7f59d8144700 secure :-1 s=READY pgs=461 cs=0 l=1 rx=0x7f59d0002f70 tx=0x7f59d0010bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:08.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59de500700 1 --2- 172.21.15.63:0/3743661632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59d8146a60 0x7f59d8144700 secure :-1 s=THROTTLE_DONE pgs=461 cs=0 l=1 rx=0x7f59d0002f70 tx=0x7f59d0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59d6ffd700 1 -- 172.21.15.63:0/3743661632 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59d0007180 con 0x7f59d8146a60 2020-05-18T21:28:08.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59de500700 1 --2- 172.21.15.63:0/3743661632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59d8146a60 0x7f59d8144700 secure :-1 s=THROTTLE_DONE pgs=461 cs=0 l=1 rx=0x7f59d0002f70 tx=0x7f59d0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59de500700 1 --2- 172.21.15.63:0/3743661632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59d8146a60 0x7f59d8144700 secure :-1 s=THROTTLE_DONE pgs=461 cs=0 l=1 rx=0x7f59d0002f70 tx=0x7f59d0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59d6ffd700 1 -- 172.21.15.63:0/3743661632 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d00072e0 con 0x7f59d8146a60 2020-05-18T21:28:08.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59dff63700 1 -- 172.21.15.63:0/3743661632 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d80b7f80 con 0x7f59d8146a60 2020-05-18T21:28:08.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59d6ffd700 1 -- 172.21.15.63:0/3743661632 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59d0012250 con 0x7f59d8146a60 2020-05-18T21:28:08.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59dff63700 1 -- 172.21.15.63:0/3743661632 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d80b9110 con 0x7f59d8146a60 2020-05-18T21:28:08.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59de500700 1 --2- 172.21.15.63:0/3743661632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59d8146a60 0x7f59d8144700 secure :-1 s=THROTTLE_DONE pgs=461 cs=0 l=1 rx=0x7f59d0002f70 tx=0x7f59d0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59dff63700 1 -- 172.21.15.63:0/3743661632 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d80b7ce0 con 0x7f59d8146a60 2020-05-18T21:28:08.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59d6ffd700 1 -- 172.21.15.63:0/3743661632 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f59d00124c0 con 0x7f59d8146a60 2020-05-18T21:28:08.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59de500700 1 --2- 172.21.15.63:0/3743661632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59d8146a60 0x7f59d8144700 secure :-1 s=THROTTLE_DONE pgs=461 cs=0 l=1 rx=0x7f59d0002f70 tx=0x7f59d0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59d6ffd700 1 --2- 172.21.15.63:0/3743661632 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f59b804fa10 0x7f59b8051ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:08.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59d6ffd700 1 -- 172.21.15.63:0/3743661632 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f59d0064050 con 0x7f59d8146a60 2020-05-18T21:28:08.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59ddcff700 1 --2- 172.21.15.63:0/3743661632 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f59b804fa10 0x7f59b8051ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:08.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59ddcff700 1 --2- 172.21.15.63:0/3743661632 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f59b804fa10 0x7f59b8051ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59d8153360 tx=0x7f59c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59ddcff700 1 --2- 172.21.15.63:0/3743661632 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f59b804fa10 0x7f59b8051ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59d8153360 tx=0x7f59c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.449+0000 7f59ddcff700 1 --2- 172.21.15.63:0/3743661632 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f59b804fa10 0x7f59b8051ed0 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f59d8153360 tx=0x7f59c8007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:08.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.457+0000 7f59de500700 1 --2- 172.21.15.63:0/3743661632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59d8146a60 0x7f59d8144700 secure :-1 s=THROTTLE_DONE pgs=461 cs=0 l=1 rx=0x7f59d0002f70 tx=0x7f59d0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.457+0000 7f59d6ffd700 1 -- 172.21.15.63:0/3743661632 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f59d80b7ce0 con 0x7f59d8146a60 2020-05-18T21:28:08.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.605+0000 7f59dff63700 1 -- 172.21.15.63:0/3743661632 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f59d80b7ce0 con 0x7f59d8146a60 2020-05-18T21:28:08.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.617+0000 7f59de500700 1 --2- 172.21.15.63:0/3743661632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59d8146a60 0x7f59d8144700 secure :-1 s=THROTTLE_DONE pgs=461 cs=0 l=1 rx=0x7f59d0002f70 tx=0x7f59d0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.617+0000 7f59d6ffd700 1 -- 172.21.15.63:0/3743661632 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 7 and data pool 8 v16) v1 ==== 187+0+0 (secure 0 0 0) 0x7f59d80b7ce0 con 0x7f59d8146a60 2020-05-18T21:28:08.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.617+0000 7f59dff63700 1 -- 172.21.15.63:0/3743661632 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f59b804fa10 msgr2=0x7f59b8051ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:08.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.617+0000 7f59dff63700 1 --2- 172.21.15.63:0/3743661632 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f59b804fa10 0x7f59b8051ed0 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f59d8153360 tx=0x7f59c8007e00).stop 2020-05-18T21:28:08.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.617+0000 7f59dff63700 1 -- 172.21.15.63:0/3743661632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59d8146a60 msgr2=0x7f59d8144700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:08.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.617+0000 7f59dff63700 1 --2- 172.21.15.63:0/3743661632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59d8146a60 0x7f59d8144700 secure :-1 s=READY pgs=461 cs=0 l=1 rx=0x7f59d0002f70 tx=0x7f59d0010bb0).stop 2020-05-18T21:28:08.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.617+0000 7f59dff63700 1 -- 172.21.15.63:0/3743661632 shutdown_connections 2020-05-18T21:28:08.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.617+0000 7f59dff63700 1 --2- 172.21.15.63:0/3743661632 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f59b804fa10 0x7f59b8051ed0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:08.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.617+0000 7f59dff63700 1 --2- 172.21.15.63:0/3743661632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59d8146a60 0x7f59d8144700 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:08.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.617+0000 7f59dff63700 1 --2- 172.21.15.63:0/3743661632 >> v2:172.21.15.155:3300/0 conn(0x7f59d80b1850 0x7f59d809b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:08.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.617+0000 7f59dff63700 1 -- 172.21.15.63:0/3743661632 >> 172.21.15.63:0/3743661632 conn(0x7f59d80b9700 msgr2=0x7f59d805eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:08.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.617+0000 7f59dff63700 1 -- 172.21.15.63:0/3743661632 shutdown_connections 2020-05-18T21:28:08.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.617+0000 7f59dff63700 1 -- 172.21.15.63:0/3743661632 wait complete. 2020-05-18T21:28:08.628 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 7 and data pool 8 2020-05-18T21:28:08.640 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:28:08.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.725+0000 7fe872612700 1 Processor -- start 2020-05-18T21:28:08.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.725+0000 7fe872612700 1 -- start start 2020-05-18T21:28:08.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.725+0000 7fe872612700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe86c1492f0 0x7fe86c1468f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:08.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.725+0000 7fe872612700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe86c145cc0 con 0x7fe86c060310 2020-05-18T21:28:08.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.725+0000 7fe872612700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe86c14a190 con 0x7fe86c149db0 2020-05-18T21:28:08.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.725+0000 7fe872612700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86c060fd0 con 0x7fe86c1492f0 2020-05-18T21:28:08.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.725+0000 7fe870e0f700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe86c060310 0x7fe86c0628e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56984/0 (socket says 172.21.15.63:56984) 2020-05-18T21:28:08.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.725+0000 7fe870e0f700 1 -- 172.21.15.63:0/647972285 learned_addr learned my addr 172.21.15.63:0/647972285 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:08.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.725+0000 7fe871e11700 1 --2- 172.21.15.63:0/647972285 >> v2:172.21.15.155:3300/0 conn(0x7fe86c1492f0 0x7fe86c1468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:08.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.725+0000 7fe85bfff700 1 -- 172.21.15.63:0/647972285 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204154241 0 0) 0x7fe86c145cc0 con 0x7fe86c060310 2020-05-18T21:28:08.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.725+0000 7fe85bfff700 1 -- 172.21.15.63:0/647972285 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe854003270 con 0x7fe86c060310 2020-05-18T21:28:08.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe85bfff700 1 -- 172.21.15.63:0/647972285 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1524783902 0 0) 0x7fe854003270 con 0x7fe86c060310 2020-05-18T21:28:08.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe871e11700 1 -- 172.21.15.63:0/647972285 >> v1:172.21.15.155:6789/0 conn(0x7fe86c149db0 legacy=0x7fe86c0b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:08.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe871e11700 1 -- 172.21.15.63:0/647972285 >> v1:172.21.15.63:6789/0 conn(0x7fe86c060310 legacy=0x7fe86c0628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:08.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe871e11700 1 -- 172.21.15.63:0/647972285 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86c145f10 con 0x7fe86c1492f0 2020-05-18T21:28:08.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe871e11700 1 --2- 172.21.15.63:0/647972285 >> v2:172.21.15.155:3300/0 conn(0x7fe86c1492f0 0x7fe86c1468f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe85c0018b0 tx=0x7fe864007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe871e11700 1 --2- 172.21.15.63:0/647972285 >> v2:172.21.15.155:3300/0 conn(0x7fe86c1492f0 0x7fe86c1468f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe85c0018b0 tx=0x7fe864007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe871e11700 1 --2- 172.21.15.63:0/647972285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe86c1492f0 0x7fe86c1468f0 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7fe85c0018b0 tx=0x7fe864007e00).ready entity=mon.1 client_cookie=230899f607460a58 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:08.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe871e11700 1 --2- 172.21.15.63:0/647972285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe86c1492f0 0x7fe86c1468f0 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7fe85c0018b0 tx=0x7fe864007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe85bfff700 1 -- 172.21.15.63:0/647972285 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe85c001710 con 0x7fe86c1492f0 2020-05-18T21:28:08.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe871e11700 1 --2- 172.21.15.63:0/647972285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe86c1492f0 0x7fe86c1468f0 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7fe85c0018b0 tx=0x7fe864007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe85bfff700 1 -- 172.21.15.63:0/647972285 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe864011b70 con 0x7fe86c1492f0 2020-05-18T21:28:08.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe871e11700 1 --2- 172.21.15.63:0/647972285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe86c1492f0 0x7fe86c1468f0 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7fe85c0018b0 tx=0x7fe864007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe85bfff700 1 -- 172.21.15.63:0/647972285 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe86400a180 con 0x7fe86c1492f0 2020-05-18T21:28:08.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe872612700 1 -- 172.21.15.63:0/647972285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe86c1492f0 msgr2=0x7fe86c1468f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:08.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe872612700 1 --2- 172.21.15.63:0/647972285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe86c1492f0 0x7fe86c1468f0 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7fe85c0018b0 tx=0x7fe864007e00).stop 2020-05-18T21:28:08.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe872612700 1 -- 172.21.15.63:0/647972285 shutdown_connections 2020-05-18T21:28:08.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe872612700 1 --2- 172.21.15.63:0/647972285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe86c1492f0 0x7fe86c1468f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:08.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe872612700 1 -- 172.21.15.63:0/647972285 >> 172.21.15.63:0/647972285 conn(0x7fe86c05eee0 msgr2=0x7fe86c05f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:08.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe872612700 1 -- 172.21.15.63:0/647972285 shutdown_connections 2020-05-18T21:28:08.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe872612700 1 -- 172.21.15.63:0/647972285 wait complete. 2020-05-18T21:28:08.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe872612700 1 Processor -- start 2020-05-18T21:28:08.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.729+0000 7fe872612700 1 -- start start 2020-05-18T21:28:08.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe872612700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe86c1492f0 0x7fe86c157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:08.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe872612700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe86c149db0 0x7fe86c1486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:08.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe872612700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe86c13dfc0 con 0x7fe86c060310 2020-05-18T21:28:08.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe872612700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86c140a70 con 0x7fe86c149db0 2020-05-18T21:28:08.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe872612700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86c148b10 con 0x7fe86c1492f0 2020-05-18T21:28:08.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe871610700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe86c060310 0x7fe86c140360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56988/0 (socket says 172.21.15.63:56988) 2020-05-18T21:28:08.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe871610700 1 -- 172.21.15.63:0/5363037 learned_addr learned my addr 172.21.15.63:0/5363037 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:08.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe871e11700 1 --2- 172.21.15.63:0/5363037 >> v2:172.21.15.63:3300/0 conn(0x7fe86c149db0 0x7fe86c1486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:08.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe870e0f700 1 --2- 172.21.15.63:0/5363037 >> v2:172.21.15.155:3300/0 conn(0x7fe86c1492f0 0x7fe86c157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe871e11700 1 -- 172.21.15.63:0/5363037 >> v2:172.21.15.155:3300/0 conn(0x7fe86c1492f0 msgr2=0x7fe86c157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe871e11700 1 --2- 172.21.15.63:0/5363037 >> v2:172.21.15.155:3300/0 conn(0x7fe86c1492f0 0x7fe86c157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe871e11700 1 -- 172.21.15.63:0/5363037 >> v1:172.21.15.63:6789/0 conn(0x7fe86c060310 legacy=0x7fe86c140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe85a7fc700 1 -- 172.21.15.63:0/5363037 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844535941 0 0) 0x7fe86c13dfc0 con 0x7fe86c060310 2020-05-18T21:28:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe871e11700 1 -- 172.21.15.63:0/5363037 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86c143a00 con 0x7fe86c149db0 2020-05-18T21:28:08.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe871e11700 1 --2- 172.21.15.63:0/5363037 >> v2:172.21.15.63:3300/0 conn(0x7fe86c149db0 0x7fe86c1486b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe85c0018b0 tx=0x7fe864007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe871e11700 1 --2- 172.21.15.63:0/5363037 >> v2:172.21.15.63:3300/0 conn(0x7fe86c149db0 0x7fe86c1486b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe85c0018b0 tx=0x7fe864007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe871e11700 1 --2- 172.21.15.63:0/5363037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe86c149db0 0x7fe86c1486b0 secure :-1 s=READY pgs=464 cs=0 l=1 rx=0x7fe85c0018b0 tx=0x7fe864007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:08.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe871e11700 1 --2- 172.21.15.63:0/5363037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe86c149db0 0x7fe86c1486b0 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7fe85c0018b0 tx=0x7fe864007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe85a7fc700 1 -- 172.21.15.63:0/5363037 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe864005c70 con 0x7fe86c149db0 2020-05-18T21:28:08.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe871e11700 1 --2- 172.21.15.63:0/5363037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe86c149db0 0x7fe86c1486b0 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7fe85c0018b0 tx=0x7fe864007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe85a7fc700 1 -- 172.21.15.63:0/5363037 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe864005dd0 con 0x7fe86c149db0 2020-05-18T21:28:08.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe871e11700 1 --2- 172.21.15.63:0/5363037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe86c149db0 0x7fe86c1486b0 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7fe85c0018b0 tx=0x7fe864007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe85a7fc700 1 -- 172.21.15.63:0/5363037 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe864007360 con 0x7fe86c149db0 2020-05-18T21:28:08.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe872612700 1 -- 172.21.15.63:0/5363037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe86c143ca0 con 0x7fe86c149db0 2020-05-18T21:28:08.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe872612700 1 -- 172.21.15.63:0/5363037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe86c13db60 con 0x7fe86c149db0 2020-05-18T21:28:08.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.733+0000 7fe871e11700 1 --2- 172.21.15.63:0/5363037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe86c149db0 0x7fe86c1486b0 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7fe85c0018b0 tx=0x7fe864007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.737+0000 7fe85a7fc700 1 -- 172.21.15.63:0/5363037 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe864007620 con 0x7fe86c149db0 2020-05-18T21:28:08.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.737+0000 7fe871e11700 1 --2- 172.21.15.63:0/5363037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe86c149db0 0x7fe86c1486b0 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7fe85c0018b0 tx=0x7fe864007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.737+0000 7fe872612700 1 -- 172.21.15.63:0/5363037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe86c0569e0 con 0x7fe86c149db0 2020-05-18T21:28:08.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.737+0000 7fe85a7fc700 1 --2- 172.21.15.63:0/5363037 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe84c04f830 0x7fe84c051cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:08.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.737+0000 7fe85a7fc700 1 -- 172.21.15.63:0/5363037 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe864064840 con 0x7fe86c149db0 2020-05-18T21:28:08.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.737+0000 7fe871610700 1 --2- 172.21.15.63:0/5363037 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe84c04f830 0x7fe84c051cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:08.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.737+0000 7fe871610700 1 --2- 172.21.15.63:0/5363037 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe84c04f830 0x7fe84c051cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe8680012b0 tx=0x7fe86c066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.737+0000 7fe871610700 1 --2- 172.21.15.63:0/5363037 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe84c04f830 0x7fe84c051cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe8680012b0 tx=0x7fe86c066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.737+0000 7fe871610700 1 --2- 172.21.15.63:0/5363037 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe84c04f830 0x7fe84c051cf0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7fe8680012b0 tx=0x7fe86c066620).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:08.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.745+0000 7fe871e11700 1 --2- 172.21.15.63:0/5363037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe86c149db0 0x7fe86c1486b0 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7fe85c0018b0 tx=0x7fe864007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.745+0000 7fe85a7fc700 1 -- 172.21.15.63:0/5363037 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe86403ec30 con 0x7fe86c149db0 2020-05-18T21:28:08.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.857+0000 7fe872612700 1 -- 172.21.15.63:0/5363037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe86c146190 con 0x7fe86c149db0 2020-05-18T21:28:08.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.861+0000 7fe871e11700 1 --2- 172.21.15.63:0/5363037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe86c149db0 0x7fe86c1486b0 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7fe85c0018b0 tx=0x7fe864007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.861+0000 7fe85a7fc700 1 -- 172.21.15.63:0/5363037 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fe864042250 con 0x7fe86c149db0 2020-05-18T21:28:08.867 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:08.867 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":41,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:28:08.611559+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:28:07.066659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2020-05-18T21:28:07.623692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:28:08.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.861+0000 7fe872612700 1 -- 172.21.15.63:0/5363037 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe84c04f830 msgr2=0x7fe84c051cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:08.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.861+0000 7fe872612700 1 --2- 172.21.15.63:0/5363037 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe84c04f830 0x7fe84c051cf0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7fe8680012b0 tx=0x7fe86c066620).stop 2020-05-18T21:28:08.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.861+0000 7fe872612700 1 -- 172.21.15.63:0/5363037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe86c149db0 msgr2=0x7fe86c1486b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:08.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.861+0000 7fe872612700 1 --2- 172.21.15.63:0/5363037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe86c149db0 0x7fe86c1486b0 secure :-1 s=READY pgs=464 cs=0 l=1 rx=0x7fe85c0018b0 tx=0x7fe864007e00).stop 2020-05-18T21:28:08.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.861+0000 7fe872612700 1 -- 172.21.15.63:0/5363037 shutdown_connections 2020-05-18T21:28:08.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.861+0000 7fe872612700 1 --2- 172.21.15.63:0/5363037 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe84c04f830 0x7fe84c051cf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:08.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.861+0000 7fe872612700 1 --2- 172.21.15.63:0/5363037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe86c149db0 0x7fe86c1486b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:08.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.861+0000 7fe872612700 1 --2- 172.21.15.63:0/5363037 >> v2:172.21.15.155:3300/0 conn(0x7fe86c1492f0 0x7fe86c157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:08.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.861+0000 7fe872612700 1 -- 172.21.15.63:0/5363037 >> 172.21.15.63:0/5363037 conn(0x7fe86c05eee0 msgr2=0x7fe86c0bab20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:08.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.861+0000 7fe872612700 1 -- 172.21.15.63:0/5363037 shutdown_connections 2020-05-18T21:28:08.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.861+0000 7fe872612700 1 -- 172.21.15.63:0/5363037 wait complete. 2020-05-18T21:28:08.880 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:28:08.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.977+0000 7fa2715b8700 1 Processor -- start 2020-05-18T21:28:08.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.977+0000 7fa2715b8700 1 -- start start 2020-05-18T21:28:08.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.977+0000 7fa2715b8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa26c064fd0 0x7fa26c14d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:08.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.977+0000 7fa2715b8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26c14a330 con 0x7fa26c0b4760 2020-05-18T21:28:08.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.977+0000 7fa2715b8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26c14a5d0 con 0x7fa26c05f110 2020-05-18T21:28:08.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.977+0000 7fa2715b8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26c14a140 con 0x7fa26c064fd0 2020-05-18T21:28:08.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.977+0000 7fa2637fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa26c0b4760 0x7fa26c0648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56998/0 (socket says 172.21.15.63:56998) 2020-05-18T21:28:08.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.977+0000 7fa2637fe700 1 -- 172.21.15.63:0/4093085774 learned_addr learned my addr 172.21.15.63:0/4093085774 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:08.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.977+0000 7fa270db7700 1 --2- 172.21.15.63:0/4093085774 >> v2:172.21.15.155:3300/0 conn(0x7fa26c064fd0 0x7fa26c14d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:08.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa26b7fe700 1 -- 172.21.15.63:0/4093085774 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073841713 0 0) 0x7fa26c14a5d0 con 0x7fa26c05f110 2020-05-18T21:28:08.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa26b7fe700 1 -- 172.21.15.63:0/4093085774 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa24c003270 con 0x7fa26c05f110 2020-05-18T21:28:08.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa26b7fe700 1 -- 172.21.15.63:0/4093085774 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162465248 0 0) 0x7fa26c14a330 con 0x7fa26c0b4760 2020-05-18T21:28:08.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa26b7fe700 1 -- 172.21.15.63:0/4093085774 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa26c14a5d0 con 0x7fa26c0b4760 2020-05-18T21:28:08.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa270db7700 1 -- 172.21.15.63:0/4093085774 >> v1:172.21.15.155:6789/0 conn(0x7fa26c05f110 legacy=0x7fa26c14aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:08.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa270db7700 1 -- 172.21.15.63:0/4093085774 >> v1:172.21.15.63:6789/0 conn(0x7fa26c0b4760 legacy=0x7fa26c0648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:08.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa270db7700 1 -- 172.21.15.63:0/4093085774 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c063430 con 0x7fa26c064fd0 2020-05-18T21:28:08.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa270db7700 1 --2- 172.21.15.63:0/4093085774 >> v2:172.21.15.155:3300/0 conn(0x7fa26c064fd0 0x7fa26c14d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa2640032f0 tx=0x7fa264007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa270db7700 1 --2- 172.21.15.63:0/4093085774 >> v2:172.21.15.155:3300/0 conn(0x7fa26c064fd0 0x7fa26c14d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa2640032f0 tx=0x7fa264007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa270db7700 1 --2- 172.21.15.63:0/4093085774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa26c064fd0 0x7fa26c14d710 secure :-1 s=READY pgs=342 cs=0 l=1 rx=0x7fa2640032f0 tx=0x7fa264007e00).ready entity=mon.1 client_cookie=36ca07ebb874c9b8 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:08.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa270db7700 1 --2- 172.21.15.63:0/4093085774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa26c064fd0 0x7fa26c14d710 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7fa2640032f0 tx=0x7fa264007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa26b7fe700 1 -- 172.21.15.63:0/4093085774 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa264011db0 con 0x7fa26c064fd0 2020-05-18T21:28:08.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa270db7700 1 --2- 172.21.15.63:0/4093085774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa26c064fd0 0x7fa26c14d710 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7fa2640032f0 tx=0x7fa264007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa26b7fe700 1 -- 172.21.15.63:0/4093085774 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26400a180 con 0x7fa26c064fd0 2020-05-18T21:28:08.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa270db7700 1 --2- 172.21.15.63:0/4093085774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa26c064fd0 0x7fa26c14d710 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7fa2640032f0 tx=0x7fa264007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:08.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa26b7fe700 1 -- 172.21.15.63:0/4093085774 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa26400a4e0 con 0x7fa26c064fd0 2020-05-18T21:28:08.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa2715b8700 1 -- 172.21.15.63:0/4093085774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa26c064fd0 msgr2=0x7fa26c14d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:09.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa2715b8700 1 --2- 172.21.15.63:0/4093085774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa26c064fd0 0x7fa26c14d710 secure :-1 s=READY pgs=342 cs=0 l=1 rx=0x7fa2640032f0 tx=0x7fa264007e00).stop 2020-05-18T21:28:09.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa2715b8700 1 -- 172.21.15.63:0/4093085774 shutdown_connections 2020-05-18T21:28:09.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa2715b8700 1 --2- 172.21.15.63:0/4093085774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa26c064fd0 0x7fa26c14d710 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:09.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa2715b8700 1 -- 172.21.15.63:0/4093085774 >> 172.21.15.63:0/4093085774 conn(0x7fa26c069fc0 msgr2=0x7fa26c06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:09.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa2715b8700 1 -- 172.21.15.63:0/4093085774 shutdown_connections 2020-05-18T21:28:09.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa2715b8700 1 -- 172.21.15.63:0/4093085774 wait complete. 2020-05-18T21:28:09.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa2715b8700 1 Processor -- start 2020-05-18T21:28:09.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.981+0000 7fa2715b8700 1 -- start start 2020-05-18T21:28:09.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa2715b8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa26c064fd0 0x7fa26c147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:09.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa2715b8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa26c0b4760 0x7fa26c146e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:09.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa2715b8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26c14b270 con 0x7fa26c05f110 2020-05-18T21:28:09.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa2715b8700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26c15bbb0 con 0x7fa26c0b4760 2020-05-18T21:28:09.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa2715b8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26c141630 con 0x7fa26c064fd0 2020-05-18T21:28:09.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa26bfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa26c05f110 0x7fa26c142c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57002/0 (socket says 172.21.15.63:57002) 2020-05-18T21:28:09.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa26bfff700 1 -- 172.21.15.63:0/1601893311 learned_addr learned my addr 172.21.15.63:0/1601893311 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:09.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa270db7700 1 --2- 172.21.15.63:0/1601893311 >> v2:172.21.15.63:3300/0 conn(0x7fa26c0b4760 0x7fa26c146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:09.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa269ffb700 1 -- 172.21.15.63:0/1601893311 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265327427 0 0) 0x7fa26c14b270 con 0x7fa26c05f110 2020-05-18T21:28:09.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa2637fe700 1 --2- 172.21.15.63:0/1601893311 >> v2:172.21.15.155:3300/0 conn(0x7fa26c064fd0 0x7fa26c147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:09.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa269ffb700 1 -- 172.21.15.63:0/1601893311 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa250002fe0 con 0x7fa26c05f110 2020-05-18T21:28:09.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa270db7700 1 -- 172.21.15.63:0/1601893311 >> v2:172.21.15.155:3300/0 conn(0x7fa26c064fd0 msgr2=0x7fa26c147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:09.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa270db7700 1 --2- 172.21.15.63:0/1601893311 >> v2:172.21.15.155:3300/0 conn(0x7fa26c064fd0 0x7fa26c147770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:09.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa270db7700 1 -- 172.21.15.63:0/1601893311 >> v1:172.21.15.63:6789/0 conn(0x7fa26c05f110 legacy=0x7fa26c142c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:09.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa270db7700 1 -- 172.21.15.63:0/1601893311 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c147400 con 0x7fa26c0b4760 2020-05-18T21:28:09.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa2637fe700 1 --2- 172.21.15.63:0/1601893311 >> v2:172.21.15.155:3300/0 conn(0x7fa26c064fd0 0x7fa26c147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:28:09.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa270db7700 1 --2- 172.21.15.63:0/1601893311 >> v2:172.21.15.63:3300/0 conn(0x7fa26c0b4760 0x7fa26c146e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa2640032f0 tx=0x7fa264007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa270db7700 1 --2- 172.21.15.63:0/1601893311 >> v2:172.21.15.63:3300/0 conn(0x7fa26c0b4760 0x7fa26c146e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa2640032f0 tx=0x7fa264007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa270db7700 1 --2- 172.21.15.63:0/1601893311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c0b4760 0x7fa26c146e40 secure :-1 s=READY pgs=467 cs=0 l=1 rx=0x7fa2640032f0 tx=0x7fa264007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:09.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa270db7700 1 --2- 172.21.15.63:0/1601893311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c0b4760 0x7fa26c146e40 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7fa2640032f0 tx=0x7fa264007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa269ffb700 1 -- 172.21.15.63:0/1601893311 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa264008aa0 con 0x7fa26c0b4760 2020-05-18T21:28:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa270db7700 1 --2- 172.21.15.63:0/1601893311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c0b4760 0x7fa26c146e40 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7fa2640032f0 tx=0x7fa264007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa2715b8700 1 -- 172.21.15.63:0/1601893311 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26c14b4a0 con 0x7fa26c0b4760 2020-05-18T21:28:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa269ffb700 1 -- 172.21.15.63:0/1601893311 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa264005c70 con 0x7fa26c0b4760 2020-05-18T21:28:09.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa270db7700 1 --2- 172.21.15.63:0/1601893311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c0b4760 0x7fa26c146e40 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7fa2640032f0 tx=0x7fa264007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa269ffb700 1 -- 172.21.15.63:0/1601893311 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa264005de0 con 0x7fa26c0b4760 2020-05-18T21:28:09.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa2715b8700 1 -- 172.21.15.63:0/1601893311 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa26c1434e0 con 0x7fa26c0b4760 2020-05-18T21:28:09.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.985+0000 7fa270db7700 1 --2- 172.21.15.63:0/1601893311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c0b4760 0x7fa26c146e40 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7fa2640032f0 tx=0x7fa264007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.989+0000 7fa2715b8700 1 -- 172.21.15.63:0/1601893311 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa26c0569e0 con 0x7fa26c0b4760 2020-05-18T21:28:09.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.989+0000 7fa269ffb700 1 -- 172.21.15.63:0/1601893311 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa26400f7a0 con 0x7fa26c0b4760 2020-05-18T21:28:09.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.989+0000 7fa270db7700 1 --2- 172.21.15.63:0/1601893311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c0b4760 0x7fa26c146e40 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7fa2640032f0 tx=0x7fa264007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.989+0000 7fa269ffb700 1 --2- 172.21.15.63:0/1601893311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa25004fd20 0x7fa2500521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:09.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.989+0000 7fa269ffb700 1 -- 172.21.15.63:0/1601893311 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa264064bf0 con 0x7fa26c0b4760 2020-05-18T21:28:09.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.989+0000 7fa26bfff700 1 --2- 172.21.15.63:0/1601893311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa25004fd20 0x7fa2500521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:09.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.989+0000 7fa26bfff700 1 --2- 172.21.15.63:0/1601893311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa25004fd20 0x7fa2500521e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa25c001180 tx=0x7fa25c002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.989+0000 7fa26bfff700 1 --2- 172.21.15.63:0/1601893311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa25004fd20 0x7fa2500521e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa25c001180 tx=0x7fa25c002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.989+0000 7fa26bfff700 1 --2- 172.21.15.63:0/1601893311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa25004fd20 0x7fa2500521e0 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7fa25c001180 tx=0x7fa25c002860).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:09.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.993+0000 7fa270db7700 1 --2- 172.21.15.63:0/1601893311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c0b4760 0x7fa26c146e40 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7fa2640032f0 tx=0x7fa264007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:08.993+0000 7fa269ffb700 1 -- 172.21.15.63:0/1601893311 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa26403efe0 con 0x7fa26c0b4760 2020-05-18T21:28:09.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.109+0000 7fa2715b8700 1 -- 172.21.15.63:0/1601893311 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa26c0625f0 con 0x7fa26c0b4760 2020-05-18T21:28:09.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.113+0000 7fa270db7700 1 --2- 172.21.15.63:0/1601893311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c0b4760 0x7fa26c146e40 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7fa2640032f0 tx=0x7fa264007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.113+0000 7fa269ffb700 1 -- 172.21.15.63:0/1601893311 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fa264042600 con 0x7fa26c0b4760 2020-05-18T21:28:09.119 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:09.119 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":41,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:28:08.611559+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:28:07.066659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2020-05-18T21:28:07.623692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:28:09.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.113+0000 7fa2715b8700 1 -- 172.21.15.63:0/1601893311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa25004fd20 msgr2=0x7fa2500521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:09.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.113+0000 7fa2715b8700 1 --2- 172.21.15.63:0/1601893311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa25004fd20 0x7fa2500521e0 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7fa25c001180 tx=0x7fa25c002860).stop 2020-05-18T21:28:09.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.113+0000 7fa2715b8700 1 -- 172.21.15.63:0/1601893311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c0b4760 msgr2=0x7fa26c146e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:09.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.113+0000 7fa2715b8700 1 --2- 172.21.15.63:0/1601893311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c0b4760 0x7fa26c146e40 secure :-1 s=READY pgs=467 cs=0 l=1 rx=0x7fa2640032f0 tx=0x7fa264007e00).stop 2020-05-18T21:28:09.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.113+0000 7fa2715b8700 1 -- 172.21.15.63:0/1601893311 shutdown_connections 2020-05-18T21:28:09.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.113+0000 7fa2715b8700 1 --2- 172.21.15.63:0/1601893311 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa25004fd20 0x7fa2500521e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:09.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.113+0000 7fa2715b8700 1 --2- 172.21.15.63:0/1601893311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c0b4760 0x7fa26c146e40 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:09.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.113+0000 7fa2715b8700 1 --2- 172.21.15.63:0/1601893311 >> v2:172.21.15.155:3300/0 conn(0x7fa26c064fd0 0x7fa26c147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:09.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.113+0000 7fa2715b8700 1 -- 172.21.15.63:0/1601893311 >> 172.21.15.63:0/1601893311 conn(0x7fa26c069fc0 msgr2=0x7fa26c060c90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:09.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.113+0000 7fa2715b8700 1 -- 172.21.15.63:0/1601893311 shutdown_connections 2020-05-18T21:28:09.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.113+0000 7fa2715b8700 1 -- 172.21.15.63:0/1601893311 wait complete. 2020-05-18T21:28:09.131 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-05-18T21:28:09.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f6a81700 1 Processor -- start 2020-05-18T21:28:09.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f6a81700 1 -- start start 2020-05-18T21:28:09.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f6a81700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f09f00b4f40 0x7f09f0061180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:09.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f6a81700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09f006a2c0 0x7f09f0132360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:09.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f6a81700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f0132c70 con 0x7f09f01327c0 2020-05-18T21:28:09.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f6a81700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f006a7d0 con 0x7f09f00b4f40 2020-05-18T21:28:09.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f6a81700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f00b2a10 con 0x7f09f006a2c0 2020-05-18T21:28:09.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f6280700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f09f01327c0 0x7f09f014d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57014/0 (socket says 172.21.15.63:57014) 2020-05-18T21:28:09.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f6280700 1 -- 172.21.15.63:0/4213093322 learned_addr learned my addr 172.21.15.63:0/4213093322 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:09.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f527e700 1 --2- 172.21.15.63:0/4213093322 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09f006a2c0 0x7f09f0132360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:09.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f5a7f700 1 --2- 172.21.15.63:0/4213093322 >> v2:172.21.15.155:3300/0 conn(0x7f09f00b4f40 0x7f09f0061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:09.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f4a7d700 1 -- 172.21.15.63:0/4213093322 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929187478 0 0) 0x7f09f0132c70 con 0x7f09f01327c0 2020-05-18T21:28:09.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f4a7d700 1 -- 172.21.15.63:0/4213093322 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09d8003270 con 0x7f09f01327c0 2020-05-18T21:28:09.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f4a7d700 1 -- 172.21.15.63:0/4213093322 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3993188206 0 0) 0x7f09d8003270 con 0x7f09f01327c0 2020-05-18T21:28:09.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f4a7d700 1 -- 172.21.15.63:0/4213093322 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09f006a2c0 msgr2=0x7f09f0132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:09.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f4a7d700 1 --2- 172.21.15.63:0/4213093322 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09f006a2c0 0x7f09f0132360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:09.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f4a7d700 1 -- 172.21.15.63:0/4213093322 >> v2:172.21.15.155:3300/0 conn(0x7f09f00b4f40 msgr2=0x7f09f0061180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:09.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f4a7d700 1 --2- 172.21.15.63:0/4213093322 >> v2:172.21.15.155:3300/0 conn(0x7f09f00b4f40 0x7f09f0061180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:09.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f4a7d700 1 -- 172.21.15.63:0/4213093322 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f00b5320 con 0x7f09f01327c0 2020-05-18T21:28:09.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.237+0000 7f09f4a7d700 1 -- 172.21.15.63:0/4213093322 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f09e8001a90 con 0x7f09f01327c0 2020-05-18T21:28:09.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f4a7d700 1 -- 172.21.15.63:0/4213093322 >> v1:172.21.15.63:6789/0 conn(0x7f09f01327c0 legacy=0x7f09f014d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:09.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f4a7d700 1 --2- 172.21.15.63:0/4213093322 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09f006a2c0 0x7f09d8003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:09.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f4a7d700 1 --2- 172.21.15.63:0/4213093322 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09d8003bc0 0x7f09d8004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:09.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f4a7d700 1 --2- 172.21.15.63:0/4213093322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09d8004600 0x7f09d8004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:09.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f4a7d700 1 -- 172.21.15.63:0/4213093322 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f006a7d0 con 0x7f09d8003bc0 2020-05-18T21:28:09.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f4a7d700 1 -- 172.21.15.63:0/4213093322 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f00b2a10 con 0x7f09d8004600 2020-05-18T21:28:09.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f4a7d700 1 -- 172.21.15.63:0/4213093322 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d8005090 con 0x7f09f006a2c0 2020-05-18T21:28:09.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f527e700 1 --2- 172.21.15.63:0/4213093322 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09d8003bc0 0x7f09d8004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:09.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f5a7f700 1 --2- 172.21.15.63:0/4213093322 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09f006a2c0 0x7f09d8003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:09.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f6280700 1 --2- 172.21.15.63:0/4213093322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09d8004600 0x7f09d8004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:09.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f527e700 1 -- 172.21.15.63:0/4213093322 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09f006a2c0 msgr2=0x7f09d8003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:09.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f527e700 1 --2- 172.21.15.63:0/4213093322 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09f006a2c0 0x7f09d8003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:09.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f527e700 1 -- 172.21.15.63:0/4213093322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09d8004600 msgr2=0x7f09d8004a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:09.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f527e700 1 --2- 172.21.15.63:0/4213093322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09d8004600 0x7f09d8004a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:09.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f527e700 1 -- 172.21.15.63:0/4213093322 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d8003270 con 0x7f09d8003bc0 2020-05-18T21:28:09.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f5a7f700 1 --2- 172.21.15.63:0/4213093322 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09f006a2c0 0x7f09d8003760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:28:09.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f527e700 1 --2- 172.21.15.63:0/4213093322 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09d8003bc0 0x7f09d8004020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f09e4002f70 tx=0x7f09e4010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f527e700 1 --2- 172.21.15.63:0/4213093322 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09d8003bc0 0x7f09d8004020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f09e4002f70 tx=0x7f09e4010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f527e700 1 --2- 172.21.15.63:0/4213093322 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09d8003bc0 0x7f09d8004020 secure :-1 s=READY pgs=469 cs=0 l=1 rx=0x7f09e4002f70 tx=0x7f09e4010110).ready entity=mon.0 client_cookie=e584414d05abd70 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:09.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f527e700 1 --2- 172.21.15.63:0/4213093322 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09d8003bc0 0x7f09d8004020 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7f09e4002f70 tx=0x7f09e4010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f4a7d700 1 -- 172.21.15.63:0/4213093322 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09e4010e20 con 0x7f09d8003bc0 2020-05-18T21:28:09.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f527e700 1 --2- 172.21.15.63:0/4213093322 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09d8003bc0 0x7f09d8004020 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7f09e4002f70 tx=0x7f09e4010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f4a7d700 1 -- 172.21.15.63:0/4213093322 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e4008990 con 0x7f09d8003bc0 2020-05-18T21:28:09.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f527e700 1 --2- 172.21.15.63:0/4213093322 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09d8003bc0 0x7f09d8004020 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7f09e4002f70 tx=0x7f09e4010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f6a81700 1 -- 172.21.15.63:0/4213093322 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09d8003bc0 msgr2=0x7f09d8004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:09.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f4a7d700 1 -- 172.21.15.63:0/4213093322 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09e4008cf0 con 0x7f09d8003bc0 2020-05-18T21:28:09.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f6a81700 1 --2- 172.21.15.63:0/4213093322 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09d8003bc0 0x7f09d8004020 secure :-1 s=READY pgs=469 cs=0 l=1 rx=0x7f09e4002f70 tx=0x7f09e4010110).stop 2020-05-18T21:28:09.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f6280700 1 -- 172.21.15.63:0/4213093322 reap_dead start 2020-05-18T21:28:09.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f6a81700 1 -- 172.21.15.63:0/4213093322 shutdown_connections 2020-05-18T21:28:09.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f6a81700 1 -- 172.21.15.63:0/4213093322 >> 172.21.15.63:0/4213093322 conn(0x7f09f005fbd0 msgr2=0x7f09f0069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:09.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f6a81700 1 -- 172.21.15.63:0/4213093322 shutdown_connections 2020-05-18T21:28:09.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f6a81700 1 -- 172.21.15.63:0/4213093322 wait complete. 2020-05-18T21:28:09.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f6a81700 1 Processor -- start 2020-05-18T21:28:09.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.241+0000 7f09f6a81700 1 -- start start 2020-05-18T21:28:09.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6a81700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f09f0131150 0x7f09f0131590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:09.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6a81700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f09f00b1530 0x7f09f00b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:09.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6a81700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f014ad60 con 0x7f09f0063130 2020-05-18T21:28:09.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6a81700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f00b1250 con 0x7f09f00b1530 2020-05-18T21:28:09.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6a81700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f01319f0 con 0x7f09f0131150 2020-05-18T21:28:09.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6280700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f09f00b1530 0x7f09f00b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:09.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6280700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f09f00b1530 0x7f09f00b1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54838/0 (socket says 172.21.15.63:54838) 2020-05-18T21:28:09.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6280700 1 -- 172.21.15.63:0/3641905345 learned_addr learned my addr 172.21.15.63:0/3641905345 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:09.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f527e700 1 --2- 172.21.15.63:0/3641905345 >> v2:172.21.15.155:3300/0 conn(0x7f09f0131150 0x7f09f0131590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:09.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6280700 1 -- 172.21.15.63:0/3641905345 >> v2:172.21.15.155:3300/0 conn(0x7f09f0131150 msgr2=0x7f09f0131590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:09.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6280700 1 --2- 172.21.15.63:0/3641905345 >> v2:172.21.15.155:3300/0 conn(0x7f09f0131150 0x7f09f0131590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:09.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6280700 1 -- 172.21.15.63:0/3641905345 >> v1:172.21.15.155:6789/0 conn(0x7f09f0063130 legacy=0x7f09f00b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:09.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6280700 1 -- 172.21.15.63:0/3641905345 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f014b000 con 0x7f09f00b1530 2020-05-18T21:28:09.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6280700 1 --2- 172.21.15.63:0/3641905345 >> v2:172.21.15.63:3300/0 conn(0x7f09f00b1530 0x7f09f00b1980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f09e8001490 tx=0x7f09f00b54b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6280700 1 --2- 172.21.15.63:0/3641905345 >> v2:172.21.15.63:3300/0 conn(0x7f09f00b1530 0x7f09f00b1980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f09e8001490 tx=0x7f09f00b54b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6280700 1 --2- 172.21.15.63:0/3641905345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f00b1530 0x7f09f00b1980 secure :-1 s=READY pgs=470 cs=0 l=1 rx=0x7f09e8001490 tx=0x7f09f00b54b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:09.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6280700 1 --2- 172.21.15.63:0/3641905345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f00b1530 0x7f09f00b1980 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7f09e8001490 tx=0x7f09f00b54b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6280700 1 --2- 172.21.15.63:0/3641905345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f00b1530 0x7f09f00b1980 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7f09e8001490 tx=0x7f09f00b54b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09e2ffd700 1 -- 172.21.15.63:0/3641905345 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09e8004b60 con 0x7f09f00b1530 2020-05-18T21:28:09.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6280700 1 --2- 172.21.15.63:0/3641905345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f00b1530 0x7f09f00b1980 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7f09e8001490 tx=0x7f09f00b54b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09e2ffd700 1 -- 172.21.15.63:0/3641905345 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e8004cc0 con 0x7f09f00b1530 2020-05-18T21:28:09.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6a81700 1 -- 172.21.15.63:0/3641905345 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f014b2a0 con 0x7f09f00b1530 2020-05-18T21:28:09.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09e2ffd700 1 -- 172.21.15.63:0/3641905345 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09e8004e30 con 0x7f09f00b1530 2020-05-18T21:28:09.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6a81700 1 -- 172.21.15.63:0/3641905345 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f014aa50 con 0x7f09f00b1530 2020-05-18T21:28:09.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.245+0000 7f09f6280700 1 --2- 172.21.15.63:0/3641905345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f00b1530 0x7f09f00b1980 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7f09e8001490 tx=0x7f09f00b54b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.249+0000 7f09f6a81700 1 -- 172.21.15.63:0/3641905345 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f014b460 con 0x7f09f00b1530 2020-05-18T21:28:09.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.249+0000 7f09e2ffd700 1 -- 172.21.15.63:0/3641905345 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f09e800d2c0 con 0x7f09f00b1530 2020-05-18T21:28:09.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.249+0000 7f09f6280700 1 --2- 172.21.15.63:0/3641905345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f00b1530 0x7f09f00b1980 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7f09e8001490 tx=0x7f09f00b54b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.249+0000 7f09e2ffd700 1 --2- 172.21.15.63:0/3641905345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f09d004fa10 0x7f09d0051ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:09.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.249+0000 7f09e2ffd700 1 -- 172.21.15.63:0/3641905345 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f09e8063b70 con 0x7f09f00b1530 2020-05-18T21:28:09.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.249+0000 7f09f5a7f700 1 --2- 172.21.15.63:0/3641905345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f09d004fa10 0x7f09d0051ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:09.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.249+0000 7f09f5a7f700 1 --2- 172.21.15.63:0/3641905345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f09d004fa10 0x7f09d0051ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f09f0065640 tx=0x7f09ec007740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.249+0000 7f09f5a7f700 1 --2- 172.21.15.63:0/3641905345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f09d004fa10 0x7f09d0051ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f09f0065640 tx=0x7f09ec007740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.249+0000 7f09f5a7f700 1 --2- 172.21.15.63:0/3641905345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f09d004fa10 0x7f09d0051ed0 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f09f0065640 tx=0x7f09ec007740).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:09.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.253+0000 7f09f6280700 1 --2- 172.21.15.63:0/3641905345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f00b1530 0x7f09f00b1980 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7f09e8001490 tx=0x7f09f00b54b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.253+0000 7f09e2ffd700 1 -- 172.21.15.63:0/3641905345 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f09e803dea0 con 0x7f09f00b1530 2020-05-18T21:28:09.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.405+0000 7f09f6a81700 1 -- 172.21.15.63:0/3641905345 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f09f00569e0 con 0x7f09f00b1530 2020-05-18T21:28:09.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.625+0000 7f09f6280700 1 --2- 172.21.15.63:0/3641905345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f00b1530 0x7f09f00b1980 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7f09e8001490 tx=0x7f09f00b54b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.625+0000 7f09e2ffd700 1 -- 172.21.15.63:0/3641905345 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f09e80414c0 con 0x7f09f00b1530 2020-05-18T21:28:09.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.629+0000 7f09f6a81700 1 -- 172.21.15.63:0/3641905345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f09d004fa10 msgr2=0x7f09d0051ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:09.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.629+0000 7f09f6a81700 1 --2- 172.21.15.63:0/3641905345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f09d004fa10 0x7f09d0051ed0 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f09f0065640 tx=0x7f09ec007740).stop 2020-05-18T21:28:09.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.629+0000 7f09f6a81700 1 -- 172.21.15.63:0/3641905345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f00b1530 msgr2=0x7f09f00b1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:09.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.629+0000 7f09f6a81700 1 --2- 172.21.15.63:0/3641905345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f00b1530 0x7f09f00b1980 secure :-1 s=READY pgs=470 cs=0 l=1 rx=0x7f09e8001490 tx=0x7f09f00b54b0).stop 2020-05-18T21:28:09.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.629+0000 7f09f6a81700 1 -- 172.21.15.63:0/3641905345 shutdown_connections 2020-05-18T21:28:09.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.629+0000 7f09f6a81700 1 --2- 172.21.15.63:0/3641905345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f09d004fa10 0x7f09d0051ed0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:09.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.629+0000 7f09f6a81700 1 --2- 172.21.15.63:0/3641905345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f00b1530 0x7f09f00b1980 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:09.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.629+0000 7f09f6a81700 1 --2- 172.21.15.63:0/3641905345 >> v2:172.21.15.155:3300/0 conn(0x7f09f0131150 0x7f09f0131590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:09.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.629+0000 7f09f6a81700 1 -- 172.21.15.63:0/3641905345 >> 172.21.15.63:0/3641905345 conn(0x7f09f005fbd0 msgr2=0x7f09f0132c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:09.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.629+0000 7f09f6a81700 1 -- 172.21.15.63:0/3641905345 shutdown_connections 2020-05-18T21:28:09.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.629+0000 7f09f6a81700 1 -- 172.21.15.63:0/3641905345 wait complete. 2020-05-18T21:28:09.653 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:28:09.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.753+0000 7f4b2e4ca700 1 Processor -- start 2020-05-18T21:28:09.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b2e4ca700 1 -- start start 2020-05-18T21:28:09.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b2e4ca700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4b28060b90 0x7f4b280615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:09.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b2e4ca700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2814d960 con 0x7f4b2814e570 2020-05-18T21:28:09.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b2e4ca700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2814db90 con 0x7f4b280b2860 2020-05-18T21:28:09.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b2e4ca700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b28066210 con 0x7f4b28060b90 2020-05-18T21:28:09.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b2ca67700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4b2814e570 0x7f4b2814a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57034/0 (socket says 172.21.15.63:57034) 2020-05-18T21:28:09.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b2ca67700 1 -- 172.21.15.63:0/2572892322 learned_addr learned my addr 172.21.15.63:0/2572892322 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:09.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b27fff700 1 --2- 172.21.15.63:0/2572892322 >> v2:172.21.15.155:3300/0 conn(0x7f4b28060b90 0x7f4b280615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:09.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b27fff700 1 -- 172.21.15.63:0/2572892322 >> v1:172.21.15.155:6789/0 conn(0x7f4b280b2860 legacy=0x7f4b28144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:09.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b27fff700 1 -- 172.21.15.63:0/2572892322 >> v1:172.21.15.63:6789/0 conn(0x7f4b2814e570 legacy=0x7f4b2814a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:09.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b26ffd700 1 -- 172.21.15.63:0/2572892322 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602358827 0 0) 0x7f4b2814d960 con 0x7f4b2814e570 2020-05-18T21:28:09.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b27fff700 1 -- 172.21.15.63:0/2572892322 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2814de30 con 0x7f4b28060b90 2020-05-18T21:28:09.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b27fff700 1 --2- 172.21.15.63:0/2572892322 >> v2:172.21.15.155:3300/0 conn(0x7f4b28060b90 0x7f4b280615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4b28062dc0 tx=0x7f4b18008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b27fff700 1 --2- 172.21.15.63:0/2572892322 >> v2:172.21.15.155:3300/0 conn(0x7f4b28060b90 0x7f4b280615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4b28062dc0 tx=0x7f4b18008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b27fff700 1 --2- 172.21.15.63:0/2572892322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b28060b90 0x7f4b280615e0 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7f4b28062dc0 tx=0x7f4b18008ca0).ready entity=mon.1 client_cookie=3cd533e22f2ea8ac server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:09.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b27fff700 1 --2- 172.21.15.63:0/2572892322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b28060b90 0x7f4b280615e0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f4b28062dc0 tx=0x7f4b18008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b26ffd700 1 -- 172.21.15.63:0/2572892322 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b1800a180 con 0x7f4b28060b90 2020-05-18T21:28:09.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b27fff700 1 --2- 172.21.15.63:0/2572892322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b28060b90 0x7f4b280615e0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f4b28062dc0 tx=0x7f4b18008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b26ffd700 1 -- 172.21.15.63:0/2572892322 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1800a2e0 con 0x7f4b28060b90 2020-05-18T21:28:09.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b27fff700 1 --2- 172.21.15.63:0/2572892322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b28060b90 0x7f4b280615e0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f4b28062dc0 tx=0x7f4b18008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b26ffd700 1 -- 172.21.15.63:0/2572892322 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b1800a700 con 0x7f4b28060b90 2020-05-18T21:28:09.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b2e4ca700 1 -- 172.21.15.63:0/2572892322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b28060b90 msgr2=0x7f4b280615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:09.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b2e4ca700 1 --2- 172.21.15.63:0/2572892322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b28060b90 0x7f4b280615e0 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7f4b28062dc0 tx=0x7f4b18008ca0).stop 2020-05-18T21:28:09.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b2e4ca700 1 -- 172.21.15.63:0/2572892322 shutdown_connections 2020-05-18T21:28:09.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b2e4ca700 1 --2- 172.21.15.63:0/2572892322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b28060b90 0x7f4b280615e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:09.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b2e4ca700 1 -- 172.21.15.63:0/2572892322 >> 172.21.15.63:0/2572892322 conn(0x7f4b280b83d0 msgr2=0x7f4b280b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:09.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b2e4ca700 1 -- 172.21.15.63:0/2572892322 shutdown_connections 2020-05-18T21:28:09.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.757+0000 7f4b2e4ca700 1 -- 172.21.15.63:0/2572892322 wait complete. 2020-05-18T21:28:09.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.761+0000 7f4b2e4ca700 1 Processor -- start 2020-05-18T21:28:09.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.761+0000 7f4b2e4ca700 1 -- start start 2020-05-18T21:28:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b2e4ca700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4b28060b90 0x7f4b2814d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b2e4ca700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2815b0a0 con 0x7f4b280b2860 2020-05-18T21:28:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b2e4ca700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2815b300 con 0x7f4b2814e570 2020-05-18T21:28:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b2e4ca700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2815b5a0 con 0x7f4b28060b90 2020-05-18T21:28:09.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b27fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4b28060b90 0x7f4b2814d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:09.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b27fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4b28060b90 0x7f4b2814d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54848/0 (socket says 172.21.15.63:54848) 2020-05-18T21:28:09.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b277fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4b280b2860 0x7f4b28146440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57038/0 (socket says 172.21.15.63:57038) 2020-05-18T21:28:09.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b27fff700 1 -- 172.21.15.63:0/4065389709 learned_addr learned my addr 172.21.15.63:0/4065389709 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:09.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b27fff700 1 -- 172.21.15.63:0/4065389709 >> v1:172.21.15.155:6789/0 conn(0x7f4b2814e570 legacy=0x7f4b280aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:09.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b257fa700 1 -- 172.21.15.63:0/4065389709 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111551266 0 0) 0x7f4b2815b0a0 con 0x7f4b280b2860 2020-05-18T21:28:09.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b27fff700 1 -- 172.21.15.63:0/4065389709 >> v1:172.21.15.63:6789/0 conn(0x7f4b280b2860 legacy=0x7f4b28146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:09.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b27fff700 1 -- 172.21.15.63:0/4065389709 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b28146b50 con 0x7f4b28060b90 2020-05-18T21:28:09.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b27fff700 1 --2- 172.21.15.63:0/4065389709 >> v2:172.21.15.63:3300/0 conn(0x7f4b28060b90 0x7f4b2814d060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4b28062dc0 tx=0x7f4b2805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b27fff700 1 --2- 172.21.15.63:0/4065389709 >> v2:172.21.15.63:3300/0 conn(0x7f4b28060b90 0x7f4b2814d060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4b28062dc0 tx=0x7f4b2805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b27fff700 1 --2- 172.21.15.63:0/4065389709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b28060b90 0x7f4b2814d060 secure :-1 s=READY pgs=473 cs=0 l=1 rx=0x7f4b28062dc0 tx=0x7f4b2805fa60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:09.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b27fff700 1 --2- 172.21.15.63:0/4065389709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b28060b90 0x7f4b2814d060 secure :-1 s=THROTTLE_DONE pgs=473 cs=0 l=1 rx=0x7f4b28062dc0 tx=0x7f4b2805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b257fa700 1 -- 172.21.15.63:0/4065389709 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b18005c70 con 0x7f4b28060b90 2020-05-18T21:28:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b27fff700 1 --2- 172.21.15.63:0/4065389709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b28060b90 0x7f4b2814d060 secure :-1 s=THROTTLE_DONE pgs=473 cs=0 l=1 rx=0x7f4b28062dc0 tx=0x7f4b2805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b257fa700 1 -- 172.21.15.63:0/4065389709 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b18005dd0 con 0x7f4b28060b90 2020-05-18T21:28:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b2e4ca700 1 -- 172.21.15.63:0/4065389709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b28146da0 con 0x7f4b28060b90 2020-05-18T21:28:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b27fff700 1 --2- 172.21.15.63:0/4065389709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b28060b90 0x7f4b2814d060 secure :-1 s=THROTTLE_DONE pgs=473 cs=0 l=1 rx=0x7f4b28062dc0 tx=0x7f4b2805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b257fa700 1 -- 172.21.15.63:0/4065389709 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b1800f820 con 0x7f4b28060b90 2020-05-18T21:28:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b2e4ca700 1 -- 172.21.15.63:0/4065389709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2815bc60 con 0x7f4b28060b90 2020-05-18T21:28:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.765+0000 7f4b27fff700 1 --2- 172.21.15.63:0/4065389709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b28060b90 0x7f4b2814d060 secure :-1 s=THROTTLE_DONE pgs=473 cs=0 l=1 rx=0x7f4b28062dc0 tx=0x7f4b2805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.769+0000 7f4b2e4ca700 1 -- 172.21.15.63:0/4065389709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b280569e0 con 0x7f4b28060b90 2020-05-18T21:28:09.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.769+0000 7f4b257fa700 1 -- 172.21.15.63:0/4065389709 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4b1800fa60 con 0x7f4b28060b90 2020-05-18T21:28:09.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.769+0000 7f4b27fff700 1 --2- 172.21.15.63:0/4065389709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b28060b90 0x7f4b2814d060 secure :-1 s=THROTTLE_DONE pgs=473 cs=0 l=1 rx=0x7f4b28062dc0 tx=0x7f4b2805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.769+0000 7f4b257fa700 1 --2- 172.21.15.63:0/4065389709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4b0c04f8d0 0x7f4b0c051d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:09.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.769+0000 7f4b257fa700 1 -- 172.21.15.63:0/4065389709 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4b18064df0 con 0x7f4b28060b90 2020-05-18T21:28:09.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.769+0000 7f4b277fe700 1 --2- 172.21.15.63:0/4065389709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4b0c04f8d0 0x7f4b0c051d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.769+0000 7f4b277fe700 1 --2- 172.21.15.63:0/4065389709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4b0c04f8d0 0x7f4b0c051d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4b10001260 tx=0x7f4b100017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.769+0000 7f4b277fe700 1 --2- 172.21.15.63:0/4065389709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4b0c04f8d0 0x7f4b0c051d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4b10001260 tx=0x7f4b100017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.769+0000 7f4b277fe700 1 --2- 172.21.15.63:0/4065389709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4b0c04f8d0 0x7f4b0c051d90 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f4b10001260 tx=0x7f4b100017f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.773+0000 7f4b27fff700 1 --2- 172.21.15.63:0/4065389709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b28060b90 0x7f4b2814d060 secure :-1 s=THROTTLE_DONE pgs=473 cs=0 l=1 rx=0x7f4b28062dc0 tx=0x7f4b2805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.773+0000 7f4b257fa700 1 -- 172.21.15.63:0/4065389709 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f4b18068e60 con 0x7f4b28060b90 2020-05-18T21:28:09.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.925+0000 7f4b2e4ca700 1 -- 172.21.15.63:0/4065389709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b2815b6e0 con 0x7f4b28060b90 2020-05-18T21:28:09.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.925+0000 7f4b27fff700 1 --2- 172.21.15.63:0/4065389709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b28060b90 0x7f4b2814d060 secure :-1 s=THROTTLE_DONE pgs=473 cs=0 l=1 rx=0x7f4b28062dc0 tx=0x7f4b2805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:09.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.925+0000 7f4b257fa700 1 -- 172.21.15.63:0/4065389709 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+2138 (secure 0 0 0) 0x7f4b1803f1e0 con 0x7f4b28060b90 2020-05-18T21:28:09.931 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:09.931 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593103128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593103128},{"type":"v1","addr":"172.21.15.155:6835","nonce":593103128}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:28:08.611856+0000","modified":"2020-05-18T21:28:09.616560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/3182633142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3182633142},{"type":"v1","addr":"172.21.15.63:6833","nonce":3182633142}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-05-18T21:28:09.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.925+0000 7f4b2e4ca700 1 -- 172.21.15.63:0/4065389709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4b0c04f8d0 msgr2=0x7f4b0c051d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:09.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.925+0000 7f4b2e4ca700 1 --2- 172.21.15.63:0/4065389709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4b0c04f8d0 0x7f4b0c051d90 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f4b10001260 tx=0x7f4b100017f0).stop 2020-05-18T21:28:09.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.925+0000 7f4b2e4ca700 1 -- 172.21.15.63:0/4065389709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b28060b90 msgr2=0x7f4b2814d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:09.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.925+0000 7f4b2e4ca700 1 --2- 172.21.15.63:0/4065389709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b28060b90 0x7f4b2814d060 secure :-1 s=READY pgs=473 cs=0 l=1 rx=0x7f4b28062dc0 tx=0x7f4b2805fa60).stop 2020-05-18T21:28:09.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.925+0000 7f4b2e4ca700 1 -- 172.21.15.63:0/4065389709 shutdown_connections 2020-05-18T21:28:09.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.925+0000 7f4b2e4ca700 1 --2- 172.21.15.63:0/4065389709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4b0c04f8d0 0x7f4b0c051d90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:09.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.925+0000 7f4b2e4ca700 1 --2- 172.21.15.63:0/4065389709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b28060b90 0x7f4b2814d060 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:09.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.925+0000 7f4b2e4ca700 1 -- 172.21.15.63:0/4065389709 >> 172.21.15.63:0/4065389709 conn(0x7f4b280b83d0 msgr2=0x7f4b28065840 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:09.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.925+0000 7f4b2e4ca700 1 -- 172.21.15.63:0/4065389709 shutdown_connections 2020-05-18T21:28:09.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:09.925+0000 7f4b2e4ca700 1 -- 172.21.15.63:0/4065389709 wait complete. 2020-05-18T21:28:09.935 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2020-05-18T21:28:09.944 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:28:10.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.041+0000 7f5a749dc700 1 Processor -- start 2020-05-18T21:28:10.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.041+0000 7f5a749dc700 1 -- start start 2020-05-18T21:28:10.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.041+0000 7f5a749dc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a70145df0 0x7f5a70142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:10.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.041+0000 7f5a749dc700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a700b7020 con 0x7f5a700b93f0 2020-05-18T21:28:10.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.041+0000 7f5a749dc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a700b72c0 con 0x7f5a701432f0 2020-05-18T21:28:10.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.041+0000 7f5a749dc700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a700b7560 con 0x7f5a70145df0 2020-05-18T21:28:10.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.041+0000 7f5a6ed9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5a700b93f0 0x7f5a700b7ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57044/0 (socket says 172.21.15.63:57044) 2020-05-18T21:28:10.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.041+0000 7f5a6ed9d700 1 -- 172.21.15.63:0/4044978438 learned_addr learned my addr 172.21.15.63:0/4044978438 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:10.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.041+0000 7f5a6e59c700 1 --2- 172.21.15.63:0/4044978438 >> v2:172.21.15.155:3300/0 conn(0x7f5a70145df0 0x7f5a70142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.041+0000 7f5a6dd9b700 1 -- 172.21.15.63:0/4044978438 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944882733 0 0) 0x7f5a700b7020 con 0x7f5a700b93f0 2020-05-18T21:28:10.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.041+0000 7f5a6dd9b700 1 -- 172.21.15.63:0/4044978438 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a54003270 con 0x7f5a700b93f0 2020-05-18T21:28:10.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.041+0000 7f5a6e59c700 1 -- 172.21.15.63:0/4044978438 >> v1:172.21.15.155:6789/0 conn(0x7f5a701432f0 legacy=0x7f5a70060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.041+0000 7f5a6e59c700 1 -- 172.21.15.63:0/4044978438 >> v1:172.21.15.63:6789/0 conn(0x7f5a700b93f0 legacy=0x7f5a700b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.045+0000 7f5a6e59c700 1 -- 172.21.15.63:0/4044978438 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a700b7800 con 0x7f5a70145df0 2020-05-18T21:28:10.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.045+0000 7f5a6e59c700 1 --2- 172.21.15.63:0/4044978438 >> v2:172.21.15.155:3300/0 conn(0x7f5a70145df0 0x7f5a70142e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5a60002f70 tx=0x7f5a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.045+0000 7f5a6e59c700 1 --2- 172.21.15.63:0/4044978438 >> v2:172.21.15.155:3300/0 conn(0x7f5a70145df0 0x7f5a70142e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5a60002f70 tx=0x7f5a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.045+0000 7f5a6e59c700 1 --2- 172.21.15.63:0/4044978438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a70145df0 0x7f5a70142e90 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f5a60002f70 tx=0x7f5a60007a80).ready entity=mon.1 client_cookie=7d3f0e8578aa4bce server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:10.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.045+0000 7f5a6e59c700 1 --2- 172.21.15.63:0/4044978438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a70145df0 0x7f5a70142e90 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f5a60002f70 tx=0x7f5a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.045+0000 7f5a6dd9b700 1 -- 172.21.15.63:0/4044978438 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a60008e80 con 0x7f5a70145df0 2020-05-18T21:28:10.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.045+0000 7f5a6e59c700 1 --2- 172.21.15.63:0/4044978438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a70145df0 0x7f5a70142e90 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f5a60002f70 tx=0x7f5a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.045+0000 7f5a6dd9b700 1 -- 172.21.15.63:0/4044978438 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a600115f0 con 0x7f5a70145df0 2020-05-18T21:28:10.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.045+0000 7f5a6e59c700 1 --2- 172.21.15.63:0/4044978438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a70145df0 0x7f5a70142e90 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f5a60002f70 tx=0x7f5a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.045+0000 7f5a6dd9b700 1 -- 172.21.15.63:0/4044978438 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a60011990 con 0x7f5a70145df0 2020-05-18T21:28:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.045+0000 7f5a749dc700 1 -- 172.21.15.63:0/4044978438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a70145df0 msgr2=0x7f5a70142e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.045+0000 7f5a749dc700 1 --2- 172.21.15.63:0/4044978438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a70145df0 0x7f5a70142e90 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f5a60002f70 tx=0x7f5a60007a80).stop 2020-05-18T21:28:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.045+0000 7f5a749dc700 1 -- 172.21.15.63:0/4044978438 shutdown_connections 2020-05-18T21:28:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.045+0000 7f5a749dc700 1 --2- 172.21.15.63:0/4044978438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a70145df0 0x7f5a70142e90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:10.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.045+0000 7f5a749dc700 1 -- 172.21.15.63:0/4044978438 >> 172.21.15.63:0/4044978438 conn(0x7f5a70069b70 msgr2=0x7f5a70069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:10.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.045+0000 7f5a749dc700 1 -- 172.21.15.63:0/4044978438 shutdown_connections 2020-05-18T21:28:10.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.045+0000 7f5a749dc700 1 -- 172.21.15.63:0/4044978438 wait complete. 2020-05-18T21:28:10.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.045+0000 7f5a749dc700 1 Processor -- start 2020-05-18T21:28:10.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.045+0000 7f5a749dc700 1 -- start start 2020-05-18T21:28:10.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a749dc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a700b93f0 0x7f5a70140670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:10.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a749dc700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a700ba7f0 con 0x7f5a70145df0 2020-05-18T21:28:10.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a749dc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a700baa90 con 0x7f5a701432f0 2020-05-18T21:28:10.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a749dc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700bad30 con 0x7f5a700b93f0 2020-05-18T21:28:10.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a6f59e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5a70145df0 0x7f5a700bc3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57054/0 (socket says 172.21.15.63:57054) 2020-05-18T21:28:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a6f59e700 1 -- 172.21.15.63:0/1251708957 learned_addr learned my addr 172.21.15.63:0/1251708957 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a6ed9d700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a700b93f0 0x7f5a70140670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857749976 0 0) 0x7f5a700ba7f0 con 0x7f5a70145df0 2020-05-18T21:28:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a4c002fe0 con 0x7f5a70145df0 2020-05-18T21:28:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406023555 0 0) 0x7f5a700baa90 con 0x7f5a701432f0 2020-05-18T21:28:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a700ba7f0 con 0x7f5a701432f0 2020-05-18T21:28:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1857320738 0 0) 0x7f5a4c002fe0 con 0x7f5a70145df0 2020-05-18T21:28:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5a700baa90 con 0x7f5a70145df0 2020-05-18T21:28:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f5a68001d00 con 0x7f5a70145df0 2020-05-18T21:28:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a700b93f0 msgr2=0x7f5a70140670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a700b93f0 0x7f5a70140670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:10.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 >> v1:172.21.15.155:6789/0 conn(0x7f5a701432f0 legacy=0x7f5a7013c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 >> v1:172.21.15.63:6789/0 conn(0x7f5a70145df0 legacy=0x7f5a700bc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a4c004bf0 0x7f5a4c004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:10.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a700b93f0 0x7f5a4c003b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:10.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a4c003f90 0x7f5a4c004410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:10.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700bad30 con 0x7f5a4c004bf0 2020-05-18T21:28:10.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c004870 con 0x7f5a4c003f90 2020-05-18T21:28:10.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c00b760 con 0x7f5a700b93f0 2020-05-18T21:28:10.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a6ed9d700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a4c004bf0 0x7f5a4c004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a6e59c700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a700b93f0 0x7f5a4c003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a6f59e700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a4c003f90 0x7f5a4c004410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a6ed9d700 1 -- 172.21.15.63:0/1251708957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a700b93f0 msgr2=0x7f5a4c003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a6ed9d700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a700b93f0 0x7f5a4c003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:10.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a6ed9d700 1 -- 172.21.15.63:0/1251708957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a4c003f90 msgr2=0x7f5a4c004410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a6ed9d700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a4c003f90 0x7f5a4c004410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:10.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a6ed9d700 1 -- 172.21.15.63:0/1251708957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a700bcb00 con 0x7f5a4c004bf0 2020-05-18T21:28:10.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a749dc700 1 -- 172.21.15.63:0/1251708957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a70140670 con 0x7f5a4c004bf0 2020-05-18T21:28:10.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a749dc700 1 -- 172.21.15.63:0/1251708957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7013bf50 con 0x7f5a4c004bf0 2020-05-18T21:28:10.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a6ed9d700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a4c004bf0 0x7f5a4c004ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a64001110 tx=0x7f5a64001ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a6ed9d700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a4c004bf0 0x7f5a4c004ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a64001110 tx=0x7f5a64001ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a6ed9d700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a4c004bf0 0x7f5a4c004ff0 secure :-1 s=READY pgs=476 cs=0 l=1 rx=0x7f5a64001110 tx=0x7f5a64001ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a6ed9d700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a4c004bf0 0x7f5a4c004ff0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f5a64001110 tx=0x7f5a64001ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a640126b0 con 0x7f5a4c004bf0 2020-05-18T21:28:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a6ed9d700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a4c004bf0 0x7f5a4c004ff0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f5a64001110 tx=0x7f5a64001ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a6ed9d700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a4c004bf0 0x7f5a4c004ff0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f5a64001110 tx=0x7f5a64001ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a64012810 con 0x7f5a4c004bf0 2020-05-18T21:28:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a64012bf0 con 0x7f5a4c004bf0 2020-05-18T21:28:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.049+0000 7f5a749dc700 1 -- 172.21.15.63:0/1251708957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a50003380 con 0x7f5a4c004bf0 2020-05-18T21:28:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.053+0000 7f5a6ed9d700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a4c004bf0 0x7f5a4c004ff0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f5a64001110 tx=0x7f5a64001ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.053+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5a64012d50 con 0x7f5a4c004bf0 2020-05-18T21:28:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.053+0000 7f5a6ed9d700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a4c004bf0 0x7f5a4c004ff0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f5a64001110 tx=0x7f5a64001ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.053+0000 7f5a5ffff700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a4c057d20 0x7f5a4c05a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.053+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5a64063d30 con 0x7f5a4c004bf0 2020-05-18T21:28:10.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.053+0000 7f5a6e59c700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a4c057d20 0x7f5a4c05a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.053+0000 7f5a6e59c700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a4c057d20 0x7f5a4c05a1e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a60008500 tx=0x7f5a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.053+0000 7f5a6e59c700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a4c057d20 0x7f5a4c05a1e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a60008500 tx=0x7f5a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.053+0000 7f5a6e59c700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a4c057d20 0x7f5a4c05a1e0 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7f5a60008500 tx=0x7f5a60007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:10.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.057+0000 7f5a6ed9d700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a4c004bf0 0x7f5a4c004ff0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f5a64001110 tx=0x7f5a64001ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.057+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f5a6403e0c0 con 0x7f5a4c004bf0 2020-05-18T21:28:10.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.173+0000 7f5a749dc700 1 -- 172.21.15.63:0/1251708957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a50002210 con 0x7f5a4c004bf0 2020-05-18T21:28:10.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.177+0000 7f5a6ed9d700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a4c004bf0 0x7f5a4c004ff0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f5a64001110 tx=0x7f5a64001ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.177+0000 7f5a5ffff700 1 -- 172.21.15.63:0/1251708957 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f5a640416e0 con 0x7f5a4c004bf0 2020-05-18T21:28:10.184 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:10.184 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":41,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:28:08.611559+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:28:07.066659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2020-05-18T21:28:07.623692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:28:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.177+0000 7f5a749dc700 1 -- 172.21.15.63:0/1251708957 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a4c057d20 msgr2=0x7f5a4c05a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.177+0000 7f5a749dc700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5a4c057d20 0x7f5a4c05a1e0 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7f5a60008500 tx=0x7f5a60007a80).stop 2020-05-18T21:28:10.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.177+0000 7f5a749dc700 1 -- 172.21.15.63:0/1251708957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a4c004bf0 msgr2=0x7f5a4c004ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.177+0000 7f5a6f59e700 1 -- 172.21.15.63:0/1251708957 reap_dead start 2020-05-18T21:28:10.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.177+0000 7f5a749dc700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a4c004bf0 0x7f5a4c004ff0 secure :-1 s=READY pgs=476 cs=0 l=1 rx=0x7f5a64001110 tx=0x7f5a64001ea0).stop 2020-05-18T21:28:10.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.177+0000 7f5a749dc700 1 -- 172.21.15.63:0/1251708957 shutdown_connections 2020-05-18T21:28:10.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.177+0000 7f5a749dc700 1 --2- 172.21.15.63:0/1251708957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a4c004bf0 0x7f5a4c004ff0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.177+0000 7f5a749dc700 1 -- 172.21.15.63:0/1251708957 >> 172.21.15.63:0/1251708957 conn(0x7f5a70069b70 msgr2=0x7f5a700b9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.177+0000 7f5a749dc700 1 -- 172.21.15.63:0/1251708957 shutdown_connections 2020-05-18T21:28:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.177+0000 7f5a749dc700 1 -- 172.21.15.63:0/1251708957 wait complete. 2020-05-18T21:28:10.197 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:28:10.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153e8ce700 1 Processor -- start 2020-05-18T21:28:10.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153e8ce700 1 -- start start 2020-05-18T21:28:10.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153e8ce700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f15380b8c30 0x7f15381566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:10.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153e8ce700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1538157260 0x7f153815c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:10.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153e8ce700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1538065a70 con 0x7f15380ad070 2020-05-18T21:28:10.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153e8ce700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15380801d0 con 0x7f15380b8c30 2020-05-18T21:28:10.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153e8ce700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15380b5ae0 con 0x7f1538157260 2020-05-18T21:28:10.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153ce6b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f15380b8c30 0x7f15381566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153ce6b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f15380b8c30 0x7f15381566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54876/0 (socket says 172.21.15.63:54876) 2020-05-18T21:28:10.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153ce6b700 1 -- 172.21.15.63:0/2053603244 learned_addr learned my addr 172.21.15.63:0/2053603244 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:10.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153d66c700 1 --2- 172.21.15.63:0/2053603244 >> v2:172.21.15.155:3300/0 conn(0x7f1538157260 0x7f153815c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153ce6b700 1 -- 172.21.15.63:0/2053603244 >> v2:172.21.15.155:3300/0 conn(0x7f1538157260 msgr2=0x7f153815c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:10.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153ce6b700 1 --2- 172.21.15.63:0/2053603244 >> v2:172.21.15.155:3300/0 conn(0x7f1538157260 0x7f153815c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:10.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153ce6b700 1 -- 172.21.15.63:0/2053603244 >> v1:172.21.15.155:6789/0 conn(0x7f15380ad070 legacy=0x7f1538156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153ce6b700 1 -- 172.21.15.63:0/2053603244 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15380b9010 con 0x7f15380b8c30 2020-05-18T21:28:10.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153ce6b700 1 --2- 172.21.15.63:0/2053603244 >> v2:172.21.15.63:3300/0 conn(0x7f15380b8c30 0x7f15381566f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1528002f70 tx=0x7f1528007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153ce6b700 1 --2- 172.21.15.63:0/2053603244 >> v2:172.21.15.63:3300/0 conn(0x7f15380b8c30 0x7f15381566f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1528002f70 tx=0x7f1528007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153ce6b700 1 --2- 172.21.15.63:0/2053603244 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15380b8c30 0x7f15381566f0 secure :-1 s=READY pgs=477 cs=0 l=1 rx=0x7f1528002f70 tx=0x7f1528007a80).ready entity=mon.0 client_cookie=f86927399d7b9410 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:10.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153ce6b700 1 --2- 172.21.15.63:0/2053603244 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15380b8c30 0x7f15381566f0 secure :-1 s=THROTTLE_DONE pgs=477 cs=0 l=1 rx=0x7f1528002f70 tx=0x7f1528007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153ce6b700 1 --2- 172.21.15.63:0/2053603244 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15380b8c30 0x7f15381566f0 secure :-1 s=THROTTLE_DONE pgs=477 cs=0 l=1 rx=0x7f1528002f70 tx=0x7f1528007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f15377fe700 1 -- 172.21.15.63:0/2053603244 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15280116b0 con 0x7f15380b8c30 2020-05-18T21:28:10.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153ce6b700 1 --2- 172.21.15.63:0/2053603244 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15380b8c30 0x7f15381566f0 secure :-1 s=THROTTLE_DONE pgs=477 cs=0 l=1 rx=0x7f1528002f70 tx=0x7f1528007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f15377fe700 1 -- 172.21.15.63:0/2053603244 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1528011810 con 0x7f15380b8c30 2020-05-18T21:28:10.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f15377fe700 1 -- 172.21.15.63:0/2053603244 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1528011c30 con 0x7f15380b8c30 2020-05-18T21:28:10.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153e8ce700 1 -- 172.21.15.63:0/2053603244 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15380b8c30 msgr2=0x7f15381566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.309+0000 7f153e8ce700 1 --2- 172.21.15.63:0/2053603244 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15380b8c30 0x7f15381566f0 secure :-1 s=READY pgs=477 cs=0 l=1 rx=0x7f1528002f70 tx=0x7f1528007a80).stop 2020-05-18T21:28:10.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.313+0000 7f153e8ce700 1 -- 172.21.15.63:0/2053603244 shutdown_connections 2020-05-18T21:28:10.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.313+0000 7f153e8ce700 1 --2- 172.21.15.63:0/2053603244 >> v2:172.21.15.155:3300/0 conn(0x7f1538157260 0x7f153815c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:10.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.313+0000 7f153e8ce700 1 --2- 172.21.15.63:0/2053603244 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15380b8c30 0x7f15381566f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:10.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.313+0000 7f153e8ce700 1 -- 172.21.15.63:0/2053603244 >> 172.21.15.63:0/2053603244 conn(0x7f153806a640 msgr2=0x7f15380b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:10.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.313+0000 7f153e8ce700 1 -- 172.21.15.63:0/2053603244 shutdown_connections 2020-05-18T21:28:10.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.313+0000 7f153e8ce700 1 -- 172.21.15.63:0/2053603244 wait complete. 2020-05-18T21:28:10.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.313+0000 7f153e8ce700 1 Processor -- start 2020-05-18T21:28:10.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.313+0000 7f153e8ce700 1 -- start start 2020-05-18T21:28:10.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.313+0000 7f153e8ce700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15380ad070 0x7f1538065240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:10.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.313+0000 7f153e8ce700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1538157260 0x7f15380608f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:10.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.313+0000 7f153e8ce700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15380635f0 con 0x7f15380b8c30 2020-05-18T21:28:10.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.313+0000 7f153e8ce700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1538063890 con 0x7f1538157260 2020-05-18T21:28:10.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.313+0000 7f153e8ce700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1538140250 con 0x7f15380ad070 2020-05-18T21:28:10.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.313+0000 7f1537fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f15380b8c30 0x7f1538144490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57070/0 (socket says 172.21.15.63:57070) 2020-05-18T21:28:10.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.313+0000 7f1537fff700 1 -- 172.21.15.63:0/2812674241 learned_addr learned my addr 172.21.15.63:0/2812674241 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:10.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f153d66c700 1 --2- 172.21.15.63:0/2812674241 >> v2:172.21.15.155:3300/0 conn(0x7f1538157260 0x7f15380608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f153ce6b700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15380ad070 0x7f1538065240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f15357fa700 1 -- 172.21.15.63:0/2812674241 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615507142 0 0) 0x7f15380635f0 con 0x7f15380b8c30 2020-05-18T21:28:10.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f15357fa700 1 -- 172.21.15.63:0/2812674241 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1518003270 con 0x7f15380b8c30 2020-05-18T21:28:10.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f153d66c700 1 -- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15380ad070 msgr2=0x7f1538065240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f153d66c700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15380ad070 0x7f1538065240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:10.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f153d66c700 1 -- 172.21.15.63:0/2812674241 >> v1:172.21.15.63:6789/0 conn(0x7f15380b8c30 legacy=0x7f1538144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f153d66c700 1 -- 172.21.15.63:0/2812674241 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1538060d50 con 0x7f1538157260 2020-05-18T21:28:10.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f153d66c700 1 --2- 172.21.15.63:0/2812674241 >> v2:172.21.15.155:3300/0 conn(0x7f1538157260 0x7f15380608f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f15300032f0 tx=0x7f1530010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f153d66c700 1 --2- 172.21.15.63:0/2812674241 >> v2:172.21.15.155:3300/0 conn(0x7f1538157260 0x7f15380608f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f15300032f0 tx=0x7f1530010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f153d66c700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1538157260 0x7f15380608f0 secure :-1 s=READY pgs=351 cs=0 l=1 rx=0x7f15300032f0 tx=0x7f1530010ef0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:10.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f153d66c700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1538157260 0x7f15380608f0 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f15300032f0 tx=0x7f1530010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f15357fa700 1 -- 172.21.15.63:0/2812674241 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1530007370 con 0x7f1538157260 2020-05-18T21:28:10.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f153d66c700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1538157260 0x7f15380608f0 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f15300032f0 tx=0x7f1530010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f15357fa700 1 -- 172.21.15.63:0/2812674241 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15300074d0 con 0x7f1538157260 2020-05-18T21:28:10.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f153d66c700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1538157260 0x7f15380608f0 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f15300032f0 tx=0x7f1530010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f15357fa700 1 -- 172.21.15.63:0/2812674241 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15300078b0 con 0x7f1538157260 2020-05-18T21:28:10.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f153e8ce700 1 -- 172.21.15.63:0/2812674241 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1538060fa0 con 0x7f1538157260 2020-05-18T21:28:10.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f153e8ce700 1 -- 172.21.15.63:0/2812674241 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1538061ea0 con 0x7f1538157260 2020-05-18T21:28:10.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f153e8ce700 1 -- 172.21.15.63:0/2812674241 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15380569e0 con 0x7f1538157260 2020-05-18T21:28:10.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f153d66c700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1538157260 0x7f15380608f0 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f15300032f0 tx=0x7f1530010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f15357fa700 1 -- 172.21.15.63:0/2812674241 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1530012510 con 0x7f1538157260 2020-05-18T21:28:10.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.317+0000 7f153d66c700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1538157260 0x7f15380608f0 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f15300032f0 tx=0x7f1530010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.321+0000 7f15357fa700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f151804fd40 0x7f1518052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:10.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.321+0000 7f15357fa700 1 -- 172.21.15.63:0/2812674241 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1530064250 con 0x7f1538157260 2020-05-18T21:28:10.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.321+0000 7f153ce6b700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f151804fd40 0x7f1518052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.321+0000 7f153ce6b700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f151804fd40 0x7f1518052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1528002f70 tx=0x7f1528007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.321+0000 7f153ce6b700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f151804fd40 0x7f1518052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1528002f70 tx=0x7f1528007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.321+0000 7f153ce6b700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f151804fd40 0x7f1518052200 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f1528002f70 tx=0x7f1528007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:10.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.329+0000 7f153d66c700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1538157260 0x7f15380608f0 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f15300032f0 tx=0x7f1530010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.329+0000 7f15357fa700 1 -- 172.21.15.63:0/2812674241 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f153003e5e0 con 0x7f1538157260 2020-05-18T21:28:10.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.477+0000 7f153e8ce700 1 -- 172.21.15.63:0/2812674241 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f15380639d0 con 0x7f1538157260 2020-05-18T21:28:10.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.489+0000 7f153d66c700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1538157260 0x7f15380608f0 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f15300032f0 tx=0x7f1530010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.489+0000 7f15357fa700 1 -- 172.21.15.63:0/2812674241 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1530041c00 con 0x7f1538157260 2020-05-18T21:28:10.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.489+0000 7f153e8ce700 1 -- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f151804fd40 msgr2=0x7f1518052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.489+0000 7f153e8ce700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f151804fd40 0x7f1518052200 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f1528002f70 tx=0x7f1528007a80).stop 2020-05-18T21:28:10.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.489+0000 7f153e8ce700 1 -- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1538157260 msgr2=0x7f15380608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.489+0000 7f153e8ce700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1538157260 0x7f15380608f0 secure :-1 s=READY pgs=351 cs=0 l=1 rx=0x7f15300032f0 tx=0x7f1530010ef0).stop 2020-05-18T21:28:10.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.489+0000 7f153e8ce700 1 -- 172.21.15.63:0/2812674241 shutdown_connections 2020-05-18T21:28:10.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.489+0000 7f153e8ce700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f151804fd40 0x7f1518052200 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:10.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.489+0000 7f153e8ce700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1538157260 0x7f15380608f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:10.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.489+0000 7f153e8ce700 1 --2- 172.21.15.63:0/2812674241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15380ad070 0x7f1538065240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:10.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.489+0000 7f153e8ce700 1 -- 172.21.15.63:0/2812674241 >> 172.21.15.63:0/2812674241 conn(0x7f153806a640 msgr2=0x7f15380b65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:10.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.489+0000 7f153e8ce700 1 -- 172.21.15.63:0/2812674241 shutdown_connections 2020-05-18T21:28:10.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.489+0000 7f153e8ce700 1 -- 172.21.15.63:0/2812674241 wait complete. 2020-05-18T21:28:10.499 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.0 2020-05-18T21:28:10.508 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:28:10.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.613+0000 7f1cf7127700 1 Processor -- start 2020-05-18T21:28:10.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.613+0000 7f1cf7127700 1 -- start start 2020-05-18T21:28:10.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.613+0000 7f1cf7127700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1cf00ad070 0x7f1cf0156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:10.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.613+0000 7f1cf7127700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf0157260 0x7f1cf015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:10.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.613+0000 7f1cf7127700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf0065a70 con 0x7f1cf00b8c30 2020-05-18T21:28:10.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.613+0000 7f1cf7127700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf00801d0 con 0x7f1cf00ad070 2020-05-18T21:28:10.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.613+0000 7f1cf7127700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf00b5ae0 con 0x7f1cf0157260 2020-05-18T21:28:10.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.613+0000 7f1cf56c4700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1cf00b8c30 0x7f1cf01566f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57078/0 (socket says 172.21.15.63:57078) 2020-05-18T21:28:10.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.613+0000 7f1cf56c4700 1 -- 172.21.15.63:0/4066970683 learned_addr learned my addr 172.21.15.63:0/4066970683 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:10.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.613+0000 7f1cf4ec3700 1 --2- 172.21.15.63:0/4066970683 >> v2:172.21.15.63:3300/0 conn(0x7f1cf00ad070 0x7f1cf0156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.613+0000 7f1cf5ec5700 1 --2- 172.21.15.63:0/4066970683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf0157260 0x7f1cf015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1ceffff700 1 -- 172.21.15.63:0/4066970683 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645288480 0 0) 0x7f1cf0065a70 con 0x7f1cf00b8c30 2020-05-18T21:28:10.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1ceffff700 1 -- 172.21.15.63:0/4066970683 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cd8003270 con 0x7f1cf00b8c30 2020-05-18T21:28:10.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1cf5ec5700 1 -- 172.21.15.63:0/4066970683 >> v2:172.21.15.63:3300/0 conn(0x7f1cf00ad070 msgr2=0x7f1cf0156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:10.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1cf5ec5700 1 --2- 172.21.15.63:0/4066970683 >> v2:172.21.15.63:3300/0 conn(0x7f1cf00ad070 0x7f1cf0156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:10.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1cf5ec5700 1 -- 172.21.15.63:0/4066970683 >> v1:172.21.15.63:6789/0 conn(0x7f1cf00b8c30 legacy=0x7f1cf01566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1cf5ec5700 1 -- 172.21.15.63:0/4066970683 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf00b9010 con 0x7f1cf0157260 2020-05-18T21:28:10.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1cf5ec5700 1 --2- 172.21.15.63:0/4066970683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf0157260 0x7f1cf015c9c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1ce8002f70 tx=0x7f1ce8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1cf5ec5700 1 --2- 172.21.15.63:0/4066970683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf0157260 0x7f1cf015c9c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1ce8002f70 tx=0x7f1ce8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1cf5ec5700 1 --2- 172.21.15.63:0/4066970683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf0157260 0x7f1cf015c9c0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f1ce8002f70 tx=0x7f1ce8007a80).ready entity=mon.2 client_cookie=b25cd7881123a975 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:10.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1cf5ec5700 1 --2- 172.21.15.63:0/4066970683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf0157260 0x7f1cf015c9c0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f1ce8002f70 tx=0x7f1ce8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1ceffff700 1 -- 172.21.15.63:0/4066970683 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce8008e80 con 0x7f1cf0157260 2020-05-18T21:28:10.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1cf5ec5700 1 --2- 172.21.15.63:0/4066970683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf0157260 0x7f1cf015c9c0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f1ce8002f70 tx=0x7f1ce8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1cf5ec5700 1 --2- 172.21.15.63:0/4066970683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf0157260 0x7f1cf015c9c0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f1ce8002f70 tx=0x7f1ce8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1ceffff700 1 -- 172.21.15.63:0/4066970683 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce8011540 con 0x7f1cf0157260 2020-05-18T21:28:10.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1ceffff700 1 -- 172.21.15.63:0/4066970683 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce8011920 con 0x7f1cf0157260 2020-05-18T21:28:10.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1cf7127700 1 -- 172.21.15.63:0/4066970683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf0157260 msgr2=0x7f1cf015c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1cf7127700 1 --2- 172.21.15.63:0/4066970683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf0157260 0x7f1cf015c9c0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f1ce8002f70 tx=0x7f1ce8007a80).stop 2020-05-18T21:28:10.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1cf7127700 1 -- 172.21.15.63:0/4066970683 shutdown_connections 2020-05-18T21:28:10.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1cf7127700 1 --2- 172.21.15.63:0/4066970683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf0157260 0x7f1cf015c9c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:10.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1cf7127700 1 --2- 172.21.15.63:0/4066970683 >> v2:172.21.15.63:3300/0 conn(0x7f1cf00ad070 0x7f1cf0156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:10.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1cf7127700 1 -- 172.21.15.63:0/4066970683 >> 172.21.15.63:0/4066970683 conn(0x7f1cf006a640 msgr2=0x7f1cf00b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:10.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1cf7127700 1 -- 172.21.15.63:0/4066970683 shutdown_connections 2020-05-18T21:28:10.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.617+0000 7f1cf7127700 1 -- 172.21.15.63:0/4066970683 wait complete. 2020-05-18T21:28:10.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.621+0000 7f1cf7127700 1 Processor -- start 2020-05-18T21:28:10.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.621+0000 7f1cf7127700 1 -- start start 2020-05-18T21:28:10.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.621+0000 7f1cf7127700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1cf00ad070 0x7f1cf0064e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:10.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.621+0000 7f1cf7127700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf00b8c30 0x7f1cf0072640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:10.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.621+0000 7f1cf7127700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf01217d0 con 0x7f1cf0157260 2020-05-18T21:28:10.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.621+0000 7f1cf7127700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf00652d0 con 0x7f1cf00ad070 2020-05-18T21:28:10.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.621+0000 7f1cf7127700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf0072fc0 con 0x7f1cf00b8c30 2020-05-18T21:28:10.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.621+0000 7f1cf56c4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1cf00ad070 0x7f1cf0064e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.621+0000 7f1cf4ec3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf00b8c30 0x7f1cf0072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.621+0000 7f1cf5ec5700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f1cf0157260 0x7f1cf006f580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:55404/0 (socket says 172.21.15.63:55404) 2020-05-18T21:28:10.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.621+0000 7f1cf5ec5700 1 -- 172.21.15.63:0/2482609444 learned_addr learned my addr 172.21.15.63:0/2482609444 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:10.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cf4ec3700 1 -- 172.21.15.63:0/2482609444 >> v2:172.21.15.155:3300/0 conn(0x7f1cf00ad070 msgr2=0x7f1cf0064e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cf4ec3700 1 --2- 172.21.15.63:0/2482609444 >> v2:172.21.15.155:3300/0 conn(0x7f1cf00ad070 0x7f1cf0064e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:10.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cf4ec3700 1 -- 172.21.15.63:0/2482609444 >> v1:172.21.15.155:6789/0 conn(0x7f1cf0157260 legacy=0x7f1cf006f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cf4ec3700 1 -- 172.21.15.63:0/2482609444 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf0073260 con 0x7f1cf00b8c30 2020-05-18T21:28:10.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cf4ec3700 1 --2- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf00b8c30 0x7f1cf0072640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1cf0064440 tx=0x7f1ce4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cf4ec3700 1 --2- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf00b8c30 0x7f1cf0072640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1cf0064440 tx=0x7f1ce4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cf4ec3700 1 --2- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf00b8c30 0x7f1cf0072640 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f1cf0064440 tx=0x7f1ce4010c30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cf4ec3700 1 --2- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf00b8c30 0x7f1cf0072640 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f1cf0064440 tx=0x7f1ce4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cedffb700 1 -- 172.21.15.63:0/2482609444 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce4007550 con 0x7f1cf00b8c30 2020-05-18T21:28:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cf4ec3700 1 --2- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf00b8c30 0x7f1cf0072640 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f1cf0064440 tx=0x7f1ce4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cf4ec3700 1 --2- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf00b8c30 0x7f1cf0072640 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f1cf0064440 tx=0x7f1ce4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cedffb700 1 -- 172.21.15.63:0/2482609444 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce4005700 con 0x7f1cf00b8c30 2020-05-18T21:28:10.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cf7127700 1 -- 172.21.15.63:0/2482609444 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf01209d0 con 0x7f1cf00b8c30 2020-05-18T21:28:10.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cedffb700 1 -- 172.21.15.63:0/2482609444 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce4005b20 con 0x7f1cf00b8c30 2020-05-18T21:28:10.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cf7127700 1 -- 172.21.15.63:0/2482609444 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf0072c40 con 0x7f1cf00b8c30 2020-05-18T21:28:10.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cf4ec3700 1 --2- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf00b8c30 0x7f1cf0072640 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f1cf0064440 tx=0x7f1ce4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cf7127700 1 -- 172.21.15.63:0/2482609444 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf00736e0 con 0x7f1cf00b8c30 2020-05-18T21:28:10.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cedffb700 1 -- 172.21.15.63:0/2482609444 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1ce4012590 con 0x7f1cf00b8c30 2020-05-18T21:28:10.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cf4ec3700 1 --2- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf00b8c30 0x7f1cf0072640 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f1cf0064440 tx=0x7f1ce4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.625+0000 7f1cedffb700 1 --2- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cd004f970 0x7f1cd0051e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:10.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.629+0000 7f1cedffb700 1 -- 172.21.15.63:0/2482609444 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1ce4063f50 con 0x7f1cf00b8c30 2020-05-18T21:28:10.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.629+0000 7f1cf56c4700 1 --2- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cd004f970 0x7f1cd0051e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.629+0000 7f1cf56c4700 1 --2- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cd004f970 0x7f1cd0051e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1ce0001490 tx=0x7f1ce0002100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.629+0000 7f1cf56c4700 1 --2- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cd004f970 0x7f1cd0051e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1ce0001490 tx=0x7f1ce0002100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.629+0000 7f1cf56c4700 1 --2- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cd004f970 0x7f1cd0051e30 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7f1ce0001490 tx=0x7f1ce0002100).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:10.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.633+0000 7f1cf4ec3700 1 --2- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf00b8c30 0x7f1cf0072640 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f1cf0064440 tx=0x7f1ce4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.633+0000 7f1cedffb700 1 -- 172.21.15.63:0/2482609444 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f1cf00736e0 con 0x7f1cf00b8c30 2020-05-18T21:28:10.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.793+0000 7f1cf7127700 1 -- 172.21.15.63:0/2482609444 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1cf00736e0 con 0x7f1cf00b8c30 2020-05-18T21:28:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.801+0000 7f1cf4ec3700 1 --2- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf00b8c30 0x7f1cf0072640 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f1cf0064440 tx=0x7f1ce4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.801+0000 7f1cedffb700 1 -- 172.21.15.63:0/2482609444 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1cf00736e0 con 0x7f1cf00b8c30 2020-05-18T21:28:10.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.805+0000 7f1cf7127700 1 -- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cd004f970 msgr2=0x7f1cd0051e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.805+0000 7f1cf7127700 1 --2- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cd004f970 0x7f1cd0051e30 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7f1ce0001490 tx=0x7f1ce0002100).stop 2020-05-18T21:28:10.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.805+0000 7f1cf7127700 1 -- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf00b8c30 msgr2=0x7f1cf0072640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.805+0000 7f1cf7127700 1 --2- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf00b8c30 0x7f1cf0072640 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f1cf0064440 tx=0x7f1ce4010c30).stop 2020-05-18T21:28:10.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.805+0000 7f1cf7127700 1 -- 172.21.15.63:0/2482609444 shutdown_connections 2020-05-18T21:28:10.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.805+0000 7f1cf7127700 1 --2- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cd004f970 0x7f1cd0051e30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:10.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.805+0000 7f1cf7127700 1 --2- 172.21.15.63:0/2482609444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf00b8c30 0x7f1cf0072640 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:10.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.805+0000 7f1cf7127700 1 --2- 172.21.15.63:0/2482609444 >> v2:172.21.15.155:3300/0 conn(0x7f1cf00ad070 0x7f1cf0064e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:10.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.805+0000 7f1cf7127700 1 -- 172.21.15.63:0/2482609444 >> 172.21.15.63:0/2482609444 conn(0x7f1cf006a640 msgr2=0x7f1cf00b7910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:10.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.805+0000 7f1cf7127700 1 -- 172.21.15.63:0/2482609444 shutdown_connections 2020-05-18T21:28:10.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.805+0000 7f1cf7127700 1 -- 172.21.15.63:0/2482609444 wait complete. 2020-05-18T21:28:10.812 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.1 2020-05-18T21:28:10.822 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:28:10.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.925+0000 7efd7947c700 1 Processor -- start 2020-05-18T21:28:10.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.925+0000 7efd7947c700 1 -- start start 2020-05-18T21:28:10.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd7947c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efd740b8c30 0x7efd741566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:10.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd7947c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd740ad070 0x7efd74156b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:10.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd7947c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd74065a70 con 0x7efd74156fb0 2020-05-18T21:28:10.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd7947c700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd740801d0 con 0x7efd740b8c30 2020-05-18T21:28:10.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd7947c700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd740b5ae0 con 0x7efd740ad070 2020-05-18T21:28:10.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd73fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efd74156fb0 0x7efd7415b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57094/0 (socket says 172.21.15.63:57094) 2020-05-18T21:28:10.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd73fff700 1 -- 172.21.15.63:0/104961642 learned_addr learned my addr 172.21.15.63:0/104961642 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:10.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd72ffd700 1 --2- 172.21.15.63:0/104961642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd740ad070 0x7efd74156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd737fe700 1 --2- 172.21.15.63:0/104961642 >> v2:172.21.15.155:3300/0 conn(0x7efd740b8c30 0x7efd741566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd727fc700 1 -- 172.21.15.63:0/104961642 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954517417 0 0) 0x7efd74065a70 con 0x7efd74156fb0 2020-05-18T21:28:10.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd727fc700 1 -- 172.21.15.63:0/104961642 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd5c003270 con 0x7efd74156fb0 2020-05-18T21:28:10.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd727fc700 1 -- 172.21.15.63:0/104961642 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2243113406 0 0) 0x7efd5c003270 con 0x7efd74156fb0 2020-05-18T21:28:10.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd737fe700 1 -- 172.21.15.63:0/104961642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd740ad070 msgr2=0x7efd74156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:10.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd737fe700 1 --2- 172.21.15.63:0/104961642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd740ad070 0x7efd74156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:10.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd737fe700 1 -- 172.21.15.63:0/104961642 >> v1:172.21.15.63:6789/0 conn(0x7efd74156fb0 legacy=0x7efd7415b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd737fe700 1 -- 172.21.15.63:0/104961642 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd740b9010 con 0x7efd740b8c30 2020-05-18T21:28:10.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd72ffd700 1 --2- 172.21.15.63:0/104961642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd740ad070 0x7efd74156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:10.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd737fe700 1 --2- 172.21.15.63:0/104961642 >> v2:172.21.15.155:3300/0 conn(0x7efd740b8c30 0x7efd741566f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efd6c0018b0 tx=0x7efd64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd737fe700 1 --2- 172.21.15.63:0/104961642 >> v2:172.21.15.155:3300/0 conn(0x7efd740b8c30 0x7efd741566f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efd6c0018b0 tx=0x7efd64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd737fe700 1 --2- 172.21.15.63:0/104961642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd740b8c30 0x7efd741566f0 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7efd6c0018b0 tx=0x7efd64007e00).ready entity=mon.1 client_cookie=21bedaa7eb0f90d4 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:10.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd737fe700 1 --2- 172.21.15.63:0/104961642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd740b8c30 0x7efd741566f0 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7efd6c0018b0 tx=0x7efd64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd727fc700 1 -- 172.21.15.63:0/104961642 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd6c001710 con 0x7efd740b8c30 2020-05-18T21:28:10.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd737fe700 1 --2- 172.21.15.63:0/104961642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd740b8c30 0x7efd741566f0 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7efd6c0018b0 tx=0x7efd64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd737fe700 1 --2- 172.21.15.63:0/104961642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd740b8c30 0x7efd741566f0 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7efd6c0018b0 tx=0x7efd64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd727fc700 1 -- 172.21.15.63:0/104961642 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd64011ac0 con 0x7efd740b8c30 2020-05-18T21:28:10.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd727fc700 1 -- 172.21.15.63:0/104961642 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd64011e60 con 0x7efd740b8c30 2020-05-18T21:28:10.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd7947c700 1 -- 172.21.15.63:0/104961642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd740b8c30 msgr2=0x7efd741566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd7947c700 1 --2- 172.21.15.63:0/104961642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd740b8c30 0x7efd741566f0 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7efd6c0018b0 tx=0x7efd64007e00).stop 2020-05-18T21:28:10.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd7947c700 1 -- 172.21.15.63:0/104961642 shutdown_connections 2020-05-18T21:28:10.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd7947c700 1 --2- 172.21.15.63:0/104961642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd740ad070 0x7efd74156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:10.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd7947c700 1 --2- 172.21.15.63:0/104961642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd740b8c30 0x7efd741566f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:10.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd7947c700 1 -- 172.21.15.63:0/104961642 >> 172.21.15.63:0/104961642 conn(0x7efd7406a640 msgr2=0x7efd740b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:10.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd7947c700 1 -- 172.21.15.63:0/104961642 shutdown_connections 2020-05-18T21:28:10.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.929+0000 7efd7947c700 1 -- 172.21.15.63:0/104961642 wait complete. 2020-05-18T21:28:10.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.933+0000 7efd7947c700 1 Processor -- start 2020-05-18T21:28:10.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.933+0000 7efd7947c700 1 -- start start 2020-05-18T21:28:10.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.933+0000 7efd7947c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efd740ad070 0x7efd74074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:10.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.933+0000 7efd7947c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd74075170 con 0x7efd740b8c30 2020-05-18T21:28:10.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.933+0000 7efd7947c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd74075410 con 0x7efd74156fb0 2020-05-18T21:28:10.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.933+0000 7efd7947c700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd740756b0 con 0x7efd740ad070 2020-05-18T21:28:10.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.933+0000 7efd72ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efd740b8c30 0x7efd740b6280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57100/0 (socket says 172.21.15.63:57100) 2020-05-18T21:28:10.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.933+0000 7efd72ffd700 1 -- 172.21.15.63:0/3218349012 learned_addr learned my addr 172.21.15.63:0/3218349012 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:10.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd737fe700 1 --2- 172.21.15.63:0/3218349012 >> v2:172.21.15.155:3300/0 conn(0x7efd740ad070 0x7efd74074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd5bfff700 1 -- 172.21.15.63:0/3218349012 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3314507332 0 0) 0x7efd74075170 con 0x7efd740b8c30 2020-05-18T21:28:10.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd5bfff700 1 -- 172.21.15.63:0/3218349012 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd54003270 con 0x7efd740b8c30 2020-05-18T21:28:10.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd5bfff700 1 -- 172.21.15.63:0/3218349012 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965139313 0 0) 0x7efd74075410 con 0x7efd74156fb0 2020-05-18T21:28:10.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd5bfff700 1 -- 172.21.15.63:0/3218349012 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd74075170 con 0x7efd74156fb0 2020-05-18T21:28:10.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd737fe700 1 -- 172.21.15.63:0/3218349012 >> v1:172.21.15.155:6789/0 conn(0x7efd74156fb0 legacy=0x7efd74061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd737fe700 1 -- 172.21.15.63:0/3218349012 >> v1:172.21.15.63:6789/0 conn(0x7efd740b8c30 legacy=0x7efd740b6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:10.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd5bfff700 1 -- 172.21.15.63:0/3218349012 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3166230603 0 0) 0x7efd54003270 con 0x7efd740b8c30 2020-05-18T21:28:10.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd737fe700 1 -- 172.21.15.63:0/3218349012 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd740652a0 con 0x7efd740ad070 2020-05-18T21:28:10.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd737fe700 1 --2- 172.21.15.63:0/3218349012 >> v2:172.21.15.155:3300/0 conn(0x7efd740ad070 0x7efd74074c60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efd6c0018b0 tx=0x7efd64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd737fe700 1 --2- 172.21.15.63:0/3218349012 >> v2:172.21.15.155:3300/0 conn(0x7efd740ad070 0x7efd74074c60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efd6c0018b0 tx=0x7efd64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd737fe700 1 --2- 172.21.15.63:0/3218349012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd740ad070 0x7efd74074c60 secure :-1 s=READY pgs=355 cs=0 l=1 rx=0x7efd6c0018b0 tx=0x7efd64007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:10.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd737fe700 1 --2- 172.21.15.63:0/3218349012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd740ad070 0x7efd74074c60 secure :-1 s=THROTTLE_DONE pgs=355 cs=0 l=1 rx=0x7efd6c0018b0 tx=0x7efd64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd5bfff700 1 -- 172.21.15.63:0/3218349012 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd64005c70 con 0x7efd740ad070 2020-05-18T21:28:10.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd737fe700 1 --2- 172.21.15.63:0/3218349012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd740ad070 0x7efd74074c60 secure :-1 s=THROTTLE_DONE pgs=355 cs=0 l=1 rx=0x7efd6c0018b0 tx=0x7efd64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd737fe700 1 --2- 172.21.15.63:0/3218349012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd740ad070 0x7efd74074c60 secure :-1 s=THROTTLE_DONE pgs=355 cs=0 l=1 rx=0x7efd6c0018b0 tx=0x7efd64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd5bfff700 1 -- 172.21.15.63:0/3218349012 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd64005dd0 con 0x7efd740ad070 2020-05-18T21:28:10.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd7947c700 1 -- 172.21.15.63:0/3218349012 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd74075b50 con 0x7efd740ad070 2020-05-18T21:28:10.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd5bfff700 1 -- 172.21.15.63:0/3218349012 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd64007360 con 0x7efd740ad070 2020-05-18T21:28:10.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd7947c700 1 -- 172.21.15.63:0/3218349012 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd74062290 con 0x7efd740ad070 2020-05-18T21:28:10.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd737fe700 1 --2- 172.21.15.63:0/3218349012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd740ad070 0x7efd74074c60 secure :-1 s=THROTTLE_DONE pgs=355 cs=0 l=1 rx=0x7efd6c0018b0 tx=0x7efd64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.937+0000 7efd7947c700 1 -- 172.21.15.63:0/3218349012 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd740569e0 con 0x7efd740ad070 2020-05-18T21:28:10.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.941+0000 7efd5bfff700 1 -- 172.21.15.63:0/3218349012 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7efd64007760 con 0x7efd740ad070 2020-05-18T21:28:10.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.941+0000 7efd737fe700 1 --2- 172.21.15.63:0/3218349012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd740ad070 0x7efd74074c60 secure :-1 s=THROTTLE_DONE pgs=355 cs=0 l=1 rx=0x7efd6c0018b0 tx=0x7efd64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.941+0000 7efd5bfff700 1 --2- 172.21.15.63:0/3218349012 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd5404feb0 0x7efd54052370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:10.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.941+0000 7efd5bfff700 1 -- 172.21.15.63:0/3218349012 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efd64064440 con 0x7efd740ad070 2020-05-18T21:28:10.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.941+0000 7efd72ffd700 1 --2- 172.21.15.63:0/3218349012 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd5404feb0 0x7efd54052370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:10.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.941+0000 7efd72ffd700 1 --2- 172.21.15.63:0/3218349012 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd5404feb0 0x7efd54052370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efd68007b40 tx=0x7efd680024f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.941+0000 7efd72ffd700 1 --2- 172.21.15.63:0/3218349012 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd5404feb0 0x7efd54052370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efd68007b40 tx=0x7efd680024f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.941+0000 7efd72ffd700 1 --2- 172.21.15.63:0/3218349012 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd5404feb0 0x7efd54052370 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7efd68007b40 tx=0x7efd680024f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:10.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.949+0000 7efd737fe700 1 --2- 172.21.15.63:0/3218349012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd740ad070 0x7efd74074c60 secure :-1 s=THROTTLE_DONE pgs=355 cs=0 l=1 rx=0x7efd6c0018b0 tx=0x7efd64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:10.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:10.949+0000 7efd5bfff700 1 -- 172.21.15.63:0/3218349012 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7efd6403e8f0 con 0x7efd740ad070 2020-05-18T21:28:11.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.105+0000 7efd7947c700 1 -- 172.21.15.63:0/3218349012 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7efd740b6990 con 0x7efd740ad070 2020-05-18T21:28:11.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.113+0000 7efd737fe700 1 --2- 172.21.15.63:0/3218349012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd740ad070 0x7efd74074c60 secure :-1 s=THROTTLE_DONE pgs=355 cs=0 l=1 rx=0x7efd6c0018b0 tx=0x7efd64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.113+0000 7efd5bfff700 1 -- 172.21.15.63:0/3218349012 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v17) v1 ==== 184+0+0 (secure 0 0 0) 0x7efd740b6990 con 0x7efd740ad070 2020-05-18T21:28:11.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.117+0000 7efd7947c700 1 -- 172.21.15.63:0/3218349012 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd5404feb0 msgr2=0x7efd54052370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:11.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.117+0000 7efd7947c700 1 --2- 172.21.15.63:0/3218349012 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd5404feb0 0x7efd54052370 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7efd68007b40 tx=0x7efd680024f0).stop 2020-05-18T21:28:11.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.117+0000 7efd7947c700 1 -- 172.21.15.63:0/3218349012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd740ad070 msgr2=0x7efd74074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:11.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.117+0000 7efd7947c700 1 --2- 172.21.15.63:0/3218349012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd740ad070 0x7efd74074c60 secure :-1 s=READY pgs=355 cs=0 l=1 rx=0x7efd6c0018b0 tx=0x7efd64007e00).stop 2020-05-18T21:28:11.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.117+0000 7efd7947c700 1 -- 172.21.15.63:0/3218349012 shutdown_connections 2020-05-18T21:28:11.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.117+0000 7efd7947c700 1 --2- 172.21.15.63:0/3218349012 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd5404feb0 0x7efd54052370 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:11.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.117+0000 7efd7947c700 1 --2- 172.21.15.63:0/3218349012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd740ad070 0x7efd74074c60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:11.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.117+0000 7efd7947c700 1 -- 172.21.15.63:0/3218349012 >> 172.21.15.63:0/3218349012 conn(0x7efd7406a640 msgr2=0x7efd740b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:11.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.117+0000 7efd7947c700 1 -- 172.21.15.63:0/3218349012 shutdown_connections 2020-05-18T21:28:11.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.117+0000 7efd7947c700 1 -- 172.21.15.63:0/3218349012 wait complete. 2020-05-18T21:28:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.2 2020-05-18T21:28:11.135 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:28:11.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f7246545700 1 Processor -- start 2020-05-18T21:28:11.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f7246545700 1 -- start start 2020-05-18T21:28:11.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f7246545700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f72400b8c30 0x7f72401566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:11.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f7246545700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7240157260 0x7f724015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:11.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f7246545700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7240065a70 con 0x7f72400ad070 2020-05-18T21:28:11.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f7246545700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72400801d0 con 0x7f7240157260 2020-05-18T21:28:11.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f7246545700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72400b5ae0 con 0x7f72400b8c30 2020-05-18T21:28:11.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f723ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f72400ad070 0x7f7240156b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57108/0 (socket says 172.21.15.63:57108) 2020-05-18T21:28:11.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f723ffff700 1 -- 172.21.15.63:0/1269299908 learned_addr learned my addr 172.21.15.63:0/1269299908 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:11.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f72452e3700 1 --2- 172.21.15.63:0/1269299908 >> v2:172.21.15.63:3300/0 conn(0x7f7240157260 0x7f724015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:11.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f7244ae2700 1 --2- 172.21.15.63:0/1269299908 >> v2:172.21.15.155:3300/0 conn(0x7f72400b8c30 0x7f72401566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:11.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f723f7fe700 1 -- 172.21.15.63:0/1269299908 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129824654 0 0) 0x7f7240065a70 con 0x7f72400ad070 2020-05-18T21:28:11.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f723f7fe700 1 -- 172.21.15.63:0/1269299908 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f722c003270 con 0x7f72400ad070 2020-05-18T21:28:11.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f72452e3700 1 -- 172.21.15.63:0/1269299908 >> v2:172.21.15.155:3300/0 conn(0x7f72400b8c30 msgr2=0x7f72401566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:11.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f72452e3700 1 --2- 172.21.15.63:0/1269299908 >> v2:172.21.15.155:3300/0 conn(0x7f72400b8c30 0x7f72401566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:11.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f72452e3700 1 -- 172.21.15.63:0/1269299908 >> v1:172.21.15.63:6789/0 conn(0x7f72400ad070 legacy=0x7f7240156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:11.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f72452e3700 1 -- 172.21.15.63:0/1269299908 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72400b9010 con 0x7f7240157260 2020-05-18T21:28:11.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f72452e3700 1 --2- 172.21.15.63:0/1269299908 >> v2:172.21.15.63:3300/0 conn(0x7f7240157260 0x7f724015c9c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7230002f70 tx=0x7f7230007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f72452e3700 1 --2- 172.21.15.63:0/1269299908 >> v2:172.21.15.63:3300/0 conn(0x7f7240157260 0x7f724015c9c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7230002f70 tx=0x7f7230007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f72452e3700 1 --2- 172.21.15.63:0/1269299908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7240157260 0x7f724015c9c0 secure :-1 s=READY pgs=483 cs=0 l=1 rx=0x7f7230002f70 tx=0x7f7230007a80).ready entity=mon.0 client_cookie=91a8559b3e79b267 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:11.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f72452e3700 1 --2- 172.21.15.63:0/1269299908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7240157260 0x7f724015c9c0 secure :-1 s=THROTTLE_DONE pgs=483 cs=0 l=1 rx=0x7f7230002f70 tx=0x7f7230007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f723f7fe700 1 -- 172.21.15.63:0/1269299908 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7230008e50 con 0x7f7240157260 2020-05-18T21:28:11.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f72452e3700 1 --2- 172.21.15.63:0/1269299908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7240157260 0x7f724015c9c0 secure :-1 s=THROTTLE_DONE pgs=483 cs=0 l=1 rx=0x7f7230002f70 tx=0x7f7230007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f72452e3700 1 --2- 172.21.15.63:0/1269299908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7240157260 0x7f724015c9c0 secure :-1 s=THROTTLE_DONE pgs=483 cs=0 l=1 rx=0x7f7230002f70 tx=0x7f7230007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f723f7fe700 1 -- 172.21.15.63:0/1269299908 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7230011540 con 0x7f7240157260 2020-05-18T21:28:11.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f723f7fe700 1 -- 172.21.15.63:0/1269299908 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7230011960 con 0x7f7240157260 2020-05-18T21:28:11.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f7246545700 1 -- 172.21.15.63:0/1269299908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7240157260 msgr2=0x7f724015c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:11.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.245+0000 7f7246545700 1 --2- 172.21.15.63:0/1269299908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7240157260 0x7f724015c9c0 secure :-1 s=READY pgs=483 cs=0 l=1 rx=0x7f7230002f70 tx=0x7f7230007a80).stop 2020-05-18T21:28:11.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.249+0000 7f7246545700 1 -- 172.21.15.63:0/1269299908 shutdown_connections 2020-05-18T21:28:11.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.249+0000 7f7246545700 1 --2- 172.21.15.63:0/1269299908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7240157260 0x7f724015c9c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:11.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.249+0000 7f7246545700 1 --2- 172.21.15.63:0/1269299908 >> v2:172.21.15.155:3300/0 conn(0x7f72400b8c30 0x7f72401566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:11.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.249+0000 7f7246545700 1 -- 172.21.15.63:0/1269299908 >> 172.21.15.63:0/1269299908 conn(0x7f724006a640 msgr2=0x7f72400b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:11.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.249+0000 7f7246545700 1 -- 172.21.15.63:0/1269299908 shutdown_connections 2020-05-18T21:28:11.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.249+0000 7f7246545700 1 -- 172.21.15.63:0/1269299908 wait complete. 2020-05-18T21:28:11.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.249+0000 7f7246545700 1 Processor -- start 2020-05-18T21:28:11.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.249+0000 7f7246545700 1 -- start start 2020-05-18T21:28:11.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7246545700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f72400ad070 0x7f724013ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:11.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7246545700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7240157260 0x7f72401432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:11.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7246545700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72400b60e0 con 0x7f72400b8c30 2020-05-18T21:28:11.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7246545700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7240070590 con 0x7f72400ad070 2020-05-18T21:28:11.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7246545700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72400b6310 con 0x7f7240157260 2020-05-18T21:28:11.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7244ae2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f72400ad070 0x7f724013ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:11.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7244ae2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f72400ad070 0x7f724013ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54924/0 (socket says 172.21.15.63:54924) 2020-05-18T21:28:11.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f723ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f72400b8c30 0x7f7240127fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57114/0 (socket says 172.21.15.63:57114) 2020-05-18T21:28:11.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7244ae2700 1 -- 172.21.15.63:0/838405129 learned_addr learned my addr 172.21.15.63:0/838405129 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:11.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f72452e3700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7240157260 0x7f72401432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:11.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7244ae2700 1 -- 172.21.15.63:0/838405129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7240157260 msgr2=0x7f72401432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:11.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7244ae2700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7240157260 0x7f72401432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:11.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7244ae2700 1 -- 172.21.15.63:0/838405129 >> v1:172.21.15.63:6789/0 conn(0x7f72400b8c30 legacy=0x7f7240127fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:11.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f723d7fa700 1 -- 172.21.15.63:0/838405129 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49935100 0 0) 0x7f72400b60e0 con 0x7f72400b8c30 2020-05-18T21:28:11.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7244ae2700 1 -- 172.21.15.63:0/838405129 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72400b65b0 con 0x7f72400ad070 2020-05-18T21:28:11.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7244ae2700 1 --2- 172.21.15.63:0/838405129 >> v2:172.21.15.63:3300/0 conn(0x7f72400ad070 0x7f724013ee30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7238003430 tx=0x7f7238011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7244ae2700 1 --2- 172.21.15.63:0/838405129 >> v2:172.21.15.63:3300/0 conn(0x7f72400ad070 0x7f724013ee30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7238003430 tx=0x7f7238011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7244ae2700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72400ad070 0x7f724013ee30 secure :-1 s=READY pgs=485 cs=0 l=1 rx=0x7f7238003430 tx=0x7f7238011100).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:11.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7244ae2700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72400ad070 0x7f724013ee30 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7f7238003430 tx=0x7f7238011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f723d7fa700 1 -- 172.21.15.63:0/838405129 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7238005e70 con 0x7f72400ad070 2020-05-18T21:28:11.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7244ae2700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72400ad070 0x7f724013ee30 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7f7238003430 tx=0x7f7238011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f723d7fa700 1 -- 172.21.15.63:0/838405129 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7238012b70 con 0x7f72400ad070 2020-05-18T21:28:11.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7244ae2700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72400ad070 0x7f724013ee30 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7f7238003430 tx=0x7f7238011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7246545700 1 -- 172.21.15.63:0/838405129 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72400b6850 con 0x7f72400ad070 2020-05-18T21:28:11.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f723d7fa700 1 -- 172.21.15.63:0/838405129 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7238007180 con 0x7f72400ad070 2020-05-18T21:28:11.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7246545700 1 -- 172.21.15.63:0/838405129 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7240143720 con 0x7f72400ad070 2020-05-18T21:28:11.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7244ae2700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72400ad070 0x7f724013ee30 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7f7238003430 tx=0x7f7238011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7246545700 1 -- 172.21.15.63:0/838405129 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7240063720 con 0x7f72400ad070 2020-05-18T21:28:11.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f723d7fa700 1 -- 172.21.15.63:0/838405129 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f723800e1a0 con 0x7f72400ad070 2020-05-18T21:28:11.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f7244ae2700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72400ad070 0x7f724013ee30 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7f7238003430 tx=0x7f7238011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.253+0000 7f723d7fa700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f722404f860 0x7f7224051d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:11.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.257+0000 7f723d7fa700 1 -- 172.21.15.63:0/838405129 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7238063df0 con 0x7f72400ad070 2020-05-18T21:28:11.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.257+0000 7f723ffff700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f722404f860 0x7f7224051d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:11.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.257+0000 7f723ffff700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f722404f860 0x7f7224051d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f72280010d0 tx=0x7f72280016f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.257+0000 7f723ffff700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f722404f860 0x7f7224051d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f72280010d0 tx=0x7f72280016f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.257+0000 7f723ffff700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f722404f860 0x7f7224051d20 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f72280010d0 tx=0x7f72280016f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:11.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.261+0000 7f7244ae2700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72400ad070 0x7f724013ee30 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7f7238003430 tx=0x7f7238011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.261+0000 7f723d7fa700 1 -- 172.21.15.63:0/838405129 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f7238067e60 con 0x7f72400ad070 2020-05-18T21:28:11.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.413+0000 7f7246545700 1 -- 172.21.15.63:0/838405129 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f72400b69e0 con 0x7f72400ad070 2020-05-18T21:28:11.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.421+0000 7f7244ae2700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72400ad070 0x7f724013ee30 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7f7238003430 tx=0x7f7238011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.421+0000 7f723d7fa700 1 -- 172.21.15.63:0/838405129 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v18) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7238041bb0 con 0x7f72400ad070 2020-05-18T21:28:11.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.421+0000 7f7246545700 1 -- 172.21.15.63:0/838405129 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f722404f860 msgr2=0x7f7224051d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:11.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.421+0000 7f7246545700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f722404f860 0x7f7224051d20 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f72280010d0 tx=0x7f72280016f0).stop 2020-05-18T21:28:11.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.421+0000 7f7246545700 1 -- 172.21.15.63:0/838405129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72400ad070 msgr2=0x7f724013ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:11.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.421+0000 7f7246545700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72400ad070 0x7f724013ee30 secure :-1 s=READY pgs=485 cs=0 l=1 rx=0x7f7238003430 tx=0x7f7238011100).stop 2020-05-18T21:28:11.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.421+0000 7f7246545700 1 -- 172.21.15.63:0/838405129 shutdown_connections 2020-05-18T21:28:11.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.421+0000 7f7246545700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f722404f860 0x7f7224051d20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:11.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.421+0000 7f7246545700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7240157260 0x7f72401432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:11.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.421+0000 7f7246545700 1 --2- 172.21.15.63:0/838405129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72400ad070 0x7f724013ee30 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:11.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.421+0000 7f7246545700 1 -- 172.21.15.63:0/838405129 >> 172.21.15.63:0/838405129 conn(0x7f724006a640 msgr2=0x7f72400ae4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:11.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.421+0000 7f7246545700 1 -- 172.21.15.63:0/838405129 shutdown_connections 2020-05-18T21:28:11.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.421+0000 7f7246545700 1 -- 172.21.15.63:0/838405129 wait complete. 2020-05-18T21:28:11.431 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.3 2020-05-18T21:28:11.443 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:28:11.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f0828864700 1 Processor -- start 2020-05-18T21:28:11.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f0828864700 1 -- start start 2020-05-18T21:28:11.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f0828864700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0824069eb0 0x7f082414e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:11.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f0828864700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0824147580 0x7f08241479a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:11.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f0828864700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082414e840 con 0x7f0824064220 2020-05-18T21:28:11.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f0828864700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08240b6660 con 0x7f0824147580 2020-05-18T21:28:11.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f0828864700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08240b6900 con 0x7f0824069eb0 2020-05-18T21:28:11.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f0823fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0824147580 0x7f08241479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:11.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f08237fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0824069eb0 0x7f082414e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:11.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f08237fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0824069eb0 0x7f082414e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:41550/0 (socket says 172.21.15.63:41550) 2020-05-18T21:28:11.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f08237fe700 1 -- 172.21.15.63:0/2275408145 learned_addr learned my addr 172.21.15.63:0/2275408145 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:11.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f0822ffd700 1 --1- 172.21.15.63:0/2275408145 >> v1:172.21.15.155:6789/0 conn(0x7f0824064220 0x7f0824061a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:55436/0 (socket says 172.21.15.63:55436) 2020-05-18T21:28:11.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f0823fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0824147580 0x7f08241479a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54936/0 (socket says 172.21.15.63:54936) 2020-05-18T21:28:11.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f08237fe700 1 -- 172.21.15.63:0/2275408145 >> v2:172.21.15.63:3300/0 conn(0x7f0824147580 msgr2=0x7f08241479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:11.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f08237fe700 1 --2- 172.21.15.63:0/2275408145 >> v2:172.21.15.63:3300/0 conn(0x7f0824147580 0x7f08241479a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:11.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f08237fe700 1 -- 172.21.15.63:0/2275408145 >> v1:172.21.15.155:6789/0 conn(0x7f0824064220 legacy=0x7f0824061a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:11.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f08237fe700 1 -- 172.21.15.63:0/2275408145 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082406a290 con 0x7f0824069eb0 2020-05-18T21:28:11.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f08227fc700 1 -- 172.21.15.63:0/2275408145 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525338476 0 0) 0x7f082414e840 con 0x7f0824064220 2020-05-18T21:28:11.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f08237fe700 1 --2- 172.21.15.63:0/2275408145 >> v2:172.21.15.155:3300/0 conn(0x7f0824069eb0 0x7f082414e3e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f080c002f70 tx=0x7f080c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f08237fe700 1 --2- 172.21.15.63:0/2275408145 >> v2:172.21.15.155:3300/0 conn(0x7f0824069eb0 0x7f082414e3e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f080c002f70 tx=0x7f080c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f08237fe700 1 --2- 172.21.15.63:0/2275408145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0824069eb0 0x7f082414e3e0 secure :-1 s=READY pgs=357 cs=0 l=1 rx=0x7f080c002f70 tx=0x7f080c007a80).ready entity=mon.1 client_cookie=7eb4ea5934395496 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:11.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f08237fe700 1 --2- 172.21.15.63:0/2275408145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0824069eb0 0x7f082414e3e0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f080c002f70 tx=0x7f080c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f08227fc700 1 -- 172.21.15.63:0/2275408145 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080c0116b0 con 0x7f0824069eb0 2020-05-18T21:28:11.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f08237fe700 1 --2- 172.21.15.63:0/2275408145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0824069eb0 0x7f082414e3e0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f080c002f70 tx=0x7f080c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f08237fe700 1 --2- 172.21.15.63:0/2275408145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0824069eb0 0x7f082414e3e0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f080c002f70 tx=0x7f080c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f08227fc700 1 -- 172.21.15.63:0/2275408145 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c011810 con 0x7f0824069eb0 2020-05-18T21:28:11.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f0828864700 1 -- 172.21.15.63:0/2275408145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0824069eb0 msgr2=0x7f082414e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:11.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f08227fc700 1 -- 172.21.15.63:0/2275408145 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080c011bf0 con 0x7f0824069eb0 2020-05-18T21:28:11.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.537+0000 7f0828864700 1 --2- 172.21.15.63:0/2275408145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0824069eb0 0x7f082414e3e0 secure :-1 s=READY pgs=357 cs=0 l=1 rx=0x7f080c002f70 tx=0x7f080c007a80).stop 2020-05-18T21:28:11.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f0828864700 1 -- 172.21.15.63:0/2275408145 shutdown_connections 2020-05-18T21:28:11.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f0828864700 1 --2- 172.21.15.63:0/2275408145 >> v2:172.21.15.63:3300/0 conn(0x7f0824147580 0x7f08241479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:11.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f0828864700 1 --2- 172.21.15.63:0/2275408145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0824069eb0 0x7f082414e3e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:11.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f0828864700 1 -- 172.21.15.63:0/2275408145 >> 172.21.15.63:0/2275408145 conn(0x7f0824066d00 msgr2=0x7f082405a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:11.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f0828864700 1 -- 172.21.15.63:0/2275408145 shutdown_connections 2020-05-18T21:28:11.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f0828864700 1 -- 172.21.15.63:0/2275408145 wait complete. 2020-05-18T21:28:11.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f0828864700 1 Processor -- start 2020-05-18T21:28:11.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f0828864700 1 -- start start 2020-05-18T21:28:11.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f0828864700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0824064220 0x7f08240ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:11.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f0828864700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0824147580 0x7f0824063780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:11.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f0828864700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0824157890 con 0x7f0824069eb0 2020-05-18T21:28:11.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f0828864700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0824157b30 con 0x7f0824064220 2020-05-18T21:28:11.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f0828864700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0824157dd0 con 0x7f0824147580 2020-05-18T21:28:11.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f0822ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0824069eb0 0x7f0824158270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57128/0 (socket says 172.21.15.63:57128) 2020-05-18T21:28:11.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f0822ffd700 1 -- 172.21.15.63:0/416285528 learned_addr learned my addr 172.21.15.63:0/416285528 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:11.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f08237fe700 1 --2- 172.21.15.63:0/416285528 >> v2:172.21.15.155:3300/0 conn(0x7f0824064220 0x7f08240ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:11.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f0823fff700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0824147580 0x7f0824063780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:11.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f0820ff9700 1 -- 172.21.15.63:0/416285528 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407023569 0 0) 0x7f0824157890 con 0x7f0824069eb0 2020-05-18T21:28:11.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f0820ff9700 1 -- 172.21.15.63:0/416285528 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0808002fe0 con 0x7f0824069eb0 2020-05-18T21:28:11.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f08237fe700 1 -- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0824147580 msgr2=0x7f0824063780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:11.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f08237fe700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0824147580 0x7f0824063780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:11.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f08237fe700 1 -- 172.21.15.63:0/416285528 >> v1:172.21.15.63:6789/0 conn(0x7f0824069eb0 legacy=0x7f0824158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:11.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f08237fe700 1 -- 172.21.15.63:0/416285528 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08240af330 con 0x7f0824064220 2020-05-18T21:28:11.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f08237fe700 1 --2- 172.21.15.63:0/416285528 >> v2:172.21.15.155:3300/0 conn(0x7f0824064220 0x7f08240ae870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f080c002f70 tx=0x7f080c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f08237fe700 1 --2- 172.21.15.63:0/416285528 >> v2:172.21.15.155:3300/0 conn(0x7f0824064220 0x7f08240ae870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f080c002f70 tx=0x7f080c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.541+0000 7f08237fe700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0824064220 0x7f08240ae870 secure :-1 s=READY pgs=358 cs=0 l=1 rx=0x7f080c002f70 tx=0x7f080c007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:11.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.545+0000 7f08237fe700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0824064220 0x7f08240ae870 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7f080c002f70 tx=0x7f080c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.545+0000 7f08237fe700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0824064220 0x7f08240ae870 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7f080c002f70 tx=0x7f080c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.545+0000 7f0820ff9700 1 -- 172.21.15.63:0/416285528 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080c011e60 con 0x7f0824064220 2020-05-18T21:28:11.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.545+0000 7f08237fe700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0824064220 0x7f08240ae870 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7f080c002f70 tx=0x7f080c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.545+0000 7f0820ff9700 1 -- 172.21.15.63:0/416285528 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c011c40 con 0x7f0824064220 2020-05-18T21:28:11.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.545+0000 7f0828864700 1 -- 172.21.15.63:0/416285528 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08240b06b0 con 0x7f0824064220 2020-05-18T21:28:11.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.545+0000 7f0820ff9700 1 -- 172.21.15.63:0/416285528 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080c007550 con 0x7f0824064220 2020-05-18T21:28:11.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.545+0000 7f0828864700 1 -- 172.21.15.63:0/416285528 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08240b0b60 con 0x7f0824064220 2020-05-18T21:28:11.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.545+0000 7f08237fe700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0824064220 0x7f08240ae870 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7f080c002f70 tx=0x7f080c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.545+0000 7f0828864700 1 -- 172.21.15.63:0/416285528 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08240569e0 con 0x7f0824064220 2020-05-18T21:28:11.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.545+0000 7f0820ff9700 1 -- 172.21.15.63:0/416285528 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f080c005700 con 0x7f0824064220 2020-05-18T21:28:11.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.545+0000 7f08237fe700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0824064220 0x7f08240ae870 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7f080c002f70 tx=0x7f080c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.545+0000 7f0820ff9700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f080804fd60 0x7f0808052220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:11.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.545+0000 7f0820ff9700 1 -- 172.21.15.63:0/416285528 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f080c064170 con 0x7f0824064220 2020-05-18T21:28:11.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.545+0000 7f0822ffd700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f080804fd60 0x7f0808052220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:11.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.545+0000 7f0822ffd700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f080804fd60 0x7f0808052220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f081c001410 tx=0x7f081c001af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.545+0000 7f0822ffd700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f080804fd60 0x7f0808052220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f081c001410 tx=0x7f081c001af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.545+0000 7f0822ffd700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f080804fd60 0x7f0808052220 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7f081c001410 tx=0x7f081c001af0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:11.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.557+0000 7f08237fe700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0824064220 0x7f08240ae870 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7f080c002f70 tx=0x7f080c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.557+0000 7f0820ff9700 1 -- 172.21.15.63:0/416285528 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f080c03e560 con 0x7f0824064220 2020-05-18T21:28:11.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.701+0000 7f0828864700 1 -- 172.21.15.63:0/416285528 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0824157f40 con 0x7f0824064220 2020-05-18T21:28:11.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.705+0000 7f08237fe700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0824064220 0x7f08240ae870 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7f080c002f70 tx=0x7f080c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:11.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.705+0000 7f0820ff9700 1 -- 172.21.15.63:0/416285528 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+2138 (secure 0 0 0) 0x7f080c041b80 con 0x7f0824064220 2020-05-18T21:28:11.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.705+0000 7f0828864700 1 -- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f080804fd60 msgr2=0x7f0808052220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:11.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.705+0000 7f0828864700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f080804fd60 0x7f0808052220 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7f081c001410 tx=0x7f081c001af0).stop 2020-05-18T21:28:11.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.705+0000 7f0828864700 1 -- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0824064220 msgr2=0x7f08240ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:11.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.705+0000 7f0828864700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0824064220 0x7f08240ae870 secure :-1 s=READY pgs=358 cs=0 l=1 rx=0x7f080c002f70 tx=0x7f080c007a80).stop 2020-05-18T21:28:11.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.705+0000 7f0828864700 1 -- 172.21.15.63:0/416285528 shutdown_connections 2020-05-18T21:28:11.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.705+0000 7f0828864700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f080804fd60 0x7f0808052220 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:11.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.705+0000 7f0828864700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0824147580 0x7f0824063780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:11.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.705+0000 7f0828864700 1 --2- 172.21.15.63:0/416285528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0824064220 0x7f08240ae870 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:11.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.705+0000 7f0828864700 1 -- 172.21.15.63:0/416285528 >> 172.21.15.63:0/416285528 conn(0x7f0824066d00 msgr2=0x7f0824146580 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:11.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.705+0000 7f0828864700 1 -- 172.21.15.63:0/416285528 shutdown_connections 2020-05-18T21:28:11.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:11.705+0000 7f0828864700 1 -- 172.21.15.63:0/416285528 wait complete. 2020-05-18T21:28:11.719 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2020-05-18T21:28:11.719 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:11.719 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593103128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593103128},{"type":"v1","addr":"172.21.15.155:6835","nonce":593103128}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:28:08.611856+0000","modified":"2020-05-18T21:28:09.616560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/3182633142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3182633142},{"type":"v1","addr":"172.21.15.63:6833","nonce":3182633142}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-05-18T21:28:11.926 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:28:08.611856+0000', 'modified': '2020-05-18T21:28:09.616560+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5413}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5413': {'gid': 5413, 'name': 'a', 'rank': 0, 'incarnation': 16, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/3182633142', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 3182633142}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 3182633142}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:28:11.927 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:28:11.927 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:28:12.036 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:28:12.037 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:28:12.037 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:28:12.037 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 5413, 2020-05-18T21:28:12.037 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:28:12.037 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:28:12.038 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 3.4167262950000001, 2020-05-18T21:28:12.038 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 17, 2020-05-18T21:28:12.038 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 41, 2020-05-18T21:28:12.038 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 41, 2020-05-18T21:28:12.038 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 7.6337121669999997 2020-05-18T21:28:12.039 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:28:12.045 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 5413, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.4167262950000001, "mdsmap_epoch": 17, "osdmap_epoch": 41, "osdmap_epoch_barrier": 41, "uptime": 7.6337121669999997 } 2020-05-18T21:28:12.046 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:28:12.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dd4841700 1 Processor -- start 2020-05-18T21:28:12.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dd4841700 1 -- start start 2020-05-18T21:28:12.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dd4841700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9dd00b4760 0x7f9dd00648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:12.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dd4841700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9dd0064d20 0x7f9dd014d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:12.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dd4841700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd014a330 con 0x7f9dd005f110 2020-05-18T21:28:12.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dd4841700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd014a140 con 0x7f9dd00b4760 2020-05-18T21:28:12.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dd4841700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd014a5d0 con 0x7f9dd0064d20 2020-05-18T21:28:12.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dcf7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9dd005f110 0x7f9dd014aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57134/0 (socket says 172.21.15.63:57134) 2020-05-18T21:28:12.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dceffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9dd00b4760 0x7f9dd00648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dcf7fe700 1 -- 172.21.15.63:0/4120805083 learned_addr learned my addr 172.21.15.63:0/4120805083 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:12.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dcffff700 1 --2- 172.21.15.63:0/4120805083 >> v2:172.21.15.155:3300/0 conn(0x7f9dd0064d20 0x7f9dd014d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dceffd700 1 -- 172.21.15.63:0/4120805083 >> v2:172.21.15.155:3300/0 conn(0x7f9dd0064d20 msgr2=0x7f9dd014d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:12.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dceffd700 1 --2- 172.21.15.63:0/4120805083 >> v2:172.21.15.155:3300/0 conn(0x7f9dd0064d20 0x7f9dd014d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:12.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dceffd700 1 -- 172.21.15.63:0/4120805083 >> v1:172.21.15.63:6789/0 conn(0x7f9dd005f110 legacy=0x7f9dd014aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dceffd700 1 -- 172.21.15.63:0/4120805083 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd0063430 con 0x7f9dd00b4760 2020-05-18T21:28:12.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dceffd700 1 --2- 172.21.15.63:0/4120805083 >> v2:172.21.15.63:3300/0 conn(0x7f9dd00b4760 0x7f9dd00648c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9dc80032f0 tx=0x7f9dc8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dceffd700 1 --2- 172.21.15.63:0/4120805083 >> v2:172.21.15.63:3300/0 conn(0x7f9dd00b4760 0x7f9dd00648c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9dc80032f0 tx=0x7f9dc8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dceffd700 1 --2- 172.21.15.63:0/4120805083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dd00b4760 0x7f9dd00648c0 secure :-1 s=READY pgs=488 cs=0 l=1 rx=0x7f9dc80032f0 tx=0x7f9dc8007e00).ready entity=mon.0 client_cookie=be02ca74da6b34ea server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:12.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dceffd700 1 --2- 172.21.15.63:0/4120805083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dd00b4760 0x7f9dd00648c0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f9dc80032f0 tx=0x7f9dc8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dce7fc700 1 -- 172.21.15.63:0/4120805083 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dc8011e60 con 0x7f9dd00b4760 2020-05-18T21:28:12.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dceffd700 1 --2- 172.21.15.63:0/4120805083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dd00b4760 0x7f9dd00648c0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f9dc80032f0 tx=0x7f9dc8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dce7fc700 1 -- 172.21.15.63:0/4120805083 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc800a180 con 0x7f9dd00b4760 2020-05-18T21:28:12.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dceffd700 1 --2- 172.21.15.63:0/4120805083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dd00b4760 0x7f9dd00648c0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f9dc80032f0 tx=0x7f9dc8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dce7fc700 1 -- 172.21.15.63:0/4120805083 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dc800a560 con 0x7f9dd00b4760 2020-05-18T21:28:12.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dd4841700 1 -- 172.21.15.63:0/4120805083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dd00b4760 msgr2=0x7f9dd00648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.145+0000 7f9dd4841700 1 --2- 172.21.15.63:0/4120805083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dd00b4760 0x7f9dd00648c0 secure :-1 s=READY pgs=488 cs=0 l=1 rx=0x7f9dc80032f0 tx=0x7f9dc8007e00).stop 2020-05-18T21:28:12.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dd4841700 1 -- 172.21.15.63:0/4120805083 shutdown_connections 2020-05-18T21:28:12.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dd4841700 1 --2- 172.21.15.63:0/4120805083 >> v2:172.21.15.155:3300/0 conn(0x7f9dd0064d20 0x7f9dd014d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:12.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dd4841700 1 --2- 172.21.15.63:0/4120805083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dd00b4760 0x7f9dd00648c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:12.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dd4841700 1 -- 172.21.15.63:0/4120805083 >> 172.21.15.63:0/4120805083 conn(0x7f9dd0069fc0 msgr2=0x7f9dd006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:12.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dd4841700 1 -- 172.21.15.63:0/4120805083 shutdown_connections 2020-05-18T21:28:12.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dd4841700 1 -- 172.21.15.63:0/4120805083 wait complete. 2020-05-18T21:28:12.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dd4841700 1 Processor -- start 2020-05-18T21:28:12.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dd4841700 1 -- start start 2020-05-18T21:28:12.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dd4841700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9dd0064d20 0x7f9dd0141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:12.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dd4841700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9dd00b4760 0x7f9dd015a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:12.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dd4841700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd015a960 con 0x7f9dd005f110 2020-05-18T21:28:12.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dd4841700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd00b3b70 con 0x7f9dd00b4760 2020-05-18T21:28:12.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dd4841700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd0147d10 con 0x7f9dd0064d20 2020-05-18T21:28:12.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dcf7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9dd005f110 0x7f9dd00b3d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57140/0 (socket says 172.21.15.63:57140) 2020-05-18T21:28:12.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dcffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9dd00b4760 0x7f9dd015a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dcf7fe700 1 -- 172.21.15.63:0/4278702542 learned_addr learned my addr 172.21.15.63:0/4278702542 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:12.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dceffd700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9dd0064d20 0x7f9dd0141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dccff9700 1 -- 172.21.15.63:0/4278702542 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167799047 0 0) 0x7f9dd015a960 con 0x7f9dd005f110 2020-05-18T21:28:12.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dccff9700 1 -- 172.21.15.63:0/4278702542 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9da8002fe0 con 0x7f9dd005f110 2020-05-18T21:28:12.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dcffff700 1 -- 172.21.15.63:0/4278702542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9dd0064d20 msgr2=0x7f9dd0141990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dcffff700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9dd0064d20 0x7f9dd0141990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:12.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dcffff700 1 -- 172.21.15.63:0/4278702542 >> v1:172.21.15.63:6789/0 conn(0x7f9dd005f110 legacy=0x7f9dd00b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dcffff700 1 -- 172.21.15.63:0/4278702542 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd00b38d0 con 0x7f9dd00b4760 2020-05-18T21:28:12.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.149+0000 7f9dcffff700 1 --2- 172.21.15.63:0/4278702542 >> v2:172.21.15.63:3300/0 conn(0x7f9dd00b4760 0x7f9dd015a210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9dc0002f70 tx=0x7f9dc0010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.153+0000 7f9dcffff700 1 --2- 172.21.15.63:0/4278702542 >> v2:172.21.15.63:3300/0 conn(0x7f9dd00b4760 0x7f9dd015a210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9dc0002f70 tx=0x7f9dc0010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.153+0000 7f9dcffff700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dd00b4760 0x7f9dd015a210 secure :-1 s=READY pgs=490 cs=0 l=1 rx=0x7f9dc0002f70 tx=0x7f9dc0010b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:12.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.153+0000 7f9dcffff700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dd00b4760 0x7f9dd015a210 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7f9dc0002f70 tx=0x7f9dc0010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.153+0000 7f9dccff9700 1 -- 172.21.15.63:0/4278702542 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dc0007550 con 0x7f9dd00b4760 2020-05-18T21:28:12.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.153+0000 7f9dcffff700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dd00b4760 0x7f9dd015a210 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7f9dc0002f70 tx=0x7f9dc0010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.153+0000 7f9dccff9700 1 -- 172.21.15.63:0/4278702542 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc0005700 con 0x7f9dd00b4760 2020-05-18T21:28:12.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.153+0000 7f9dd4841700 1 -- 172.21.15.63:0/4278702542 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd015a670 con 0x7f9dd00b4760 2020-05-18T21:28:12.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.153+0000 7f9dcffff700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dd00b4760 0x7f9dd015a210 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7f9dc0002f70 tx=0x7f9dc0010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.153+0000 7f9dccff9700 1 -- 172.21.15.63:0/4278702542 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dc0005a60 con 0x7f9dd00b4760 2020-05-18T21:28:12.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.153+0000 7f9dd4841700 1 -- 172.21.15.63:0/4278702542 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd01432e0 con 0x7f9dd00b4760 2020-05-18T21:28:12.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.153+0000 7f9dcffff700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dd00b4760 0x7f9dd015a210 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7f9dc0002f70 tx=0x7f9dc0010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.153+0000 7f9dd4841700 1 -- 172.21.15.63:0/4278702542 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd00569e0 con 0x7f9dd00b4760 2020-05-18T21:28:12.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.153+0000 7f9dccff9700 1 -- 172.21.15.63:0/4278702542 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9dc0005c60 con 0x7f9dd00b4760 2020-05-18T21:28:12.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.153+0000 7f9dcffff700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dd00b4760 0x7f9dd015a210 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7f9dc0002f70 tx=0x7f9dc0010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.153+0000 7f9dccff9700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9da804fd80 0x7f9da8052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:12.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.153+0000 7f9dccff9700 1 -- 172.21.15.63:0/4278702542 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9dc0063b20 con 0x7f9dd00b4760 2020-05-18T21:28:12.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.153+0000 7f9dcf7fe700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9da804fd80 0x7f9da8052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.153+0000 7f9dcf7fe700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9da804fd80 0x7f9da8052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9db8000f30 tx=0x7f9db80016f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.157+0000 7f9dcf7fe700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9da804fd80 0x7f9da8052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9db8000f30 tx=0x7f9db80016f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.157+0000 7f9dcf7fe700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9da804fd80 0x7f9da8052240 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7f9db8000f30 tx=0x7f9db80016f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:12.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.157+0000 7f9dcffff700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dd00b4760 0x7f9dd015a210 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7f9dc0002f70 tx=0x7f9dc0010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.157+0000 7f9dccff9700 1 -- 172.21.15.63:0/4278702542 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9dc003deb0 con 0x7f9dd00b4760 2020-05-18T21:28:12.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.273+0000 7f9dd4841700 1 -- 172.21.15.63:0/4278702542 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9dd00625f0 con 0x7f9dd00b4760 2020-05-18T21:28:12.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.277+0000 7f9dcffff700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dd00b4760 0x7f9dd015a210 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7f9dc0002f70 tx=0x7f9dc0010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.277+0000 7f9dccff9700 1 -- 172.21.15.63:0/4278702542 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f9dc00414d0 con 0x7f9dd00b4760 2020-05-18T21:28:12.284 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:12.284 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":41,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:28:08.611559+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:28:07.066659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2020-05-18T21:28:07.623692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:28:12.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.277+0000 7f9dd4841700 1 -- 172.21.15.63:0/4278702542 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9da804fd80 msgr2=0x7f9da8052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.277+0000 7f9dd4841700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9da804fd80 0x7f9da8052240 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7f9db8000f30 tx=0x7f9db80016f0).stop 2020-05-18T21:28:12.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.277+0000 7f9dd4841700 1 -- 172.21.15.63:0/4278702542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dd00b4760 msgr2=0x7f9dd015a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.277+0000 7f9dd4841700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dd00b4760 0x7f9dd015a210 secure :-1 s=READY pgs=490 cs=0 l=1 rx=0x7f9dc0002f70 tx=0x7f9dc0010b80).stop 2020-05-18T21:28:12.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.277+0000 7f9dd4841700 1 -- 172.21.15.63:0/4278702542 shutdown_connections 2020-05-18T21:28:12.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.277+0000 7f9dd4841700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9da804fd80 0x7f9da8052240 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:12.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.277+0000 7f9dd4841700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dd00b4760 0x7f9dd015a210 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:12.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.277+0000 7f9dd4841700 1 --2- 172.21.15.63:0/4278702542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9dd0064d20 0x7f9dd0141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:12.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.277+0000 7f9dd4841700 1 -- 172.21.15.63:0/4278702542 >> 172.21.15.63:0/4278702542 conn(0x7f9dd0069fc0 msgr2=0x7f9dd014d700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:12.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.277+0000 7f9dd4841700 1 -- 172.21.15.63:0/4278702542 shutdown_connections 2020-05-18T21:28:12.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.277+0000 7f9dd4841700 1 -- 172.21.15.63:0/4278702542 wait complete. 2020-05-18T21:28:12.300 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:28:07.066659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:28:07.623692+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:28:12.301 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:28:12.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800e859700 1 Processor -- start 2020-05-18T21:28:12.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800e859700 1 -- start start 2020-05-18T21:28:12.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800e859700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f80080b3460 0x7f800806a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:12.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800e859700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8008065fe0 0x7f8008145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:12.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800e859700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800806a790 con 0x7f8008069eb0 2020-05-18T21:28:12.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800e859700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8008062420 con 0x7f80080b3460 2020-05-18T21:28:12.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800e859700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8008062560 con 0x7f8008065fe0 2020-05-18T21:28:12.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800d056700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f80080b3460 0x7f800806a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800d857700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8008069eb0 0x7f800813fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57148/0 (socket says 172.21.15.63:57148) 2020-05-18T21:28:12.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800d857700 1 -- 172.21.15.63:0/3532266744 learned_addr learned my addr 172.21.15.63:0/3532266744 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:12.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800e058700 1 --2- 172.21.15.63:0/3532266744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8008065fe0 0x7f8008145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800d056700 1 -- 172.21.15.63:0/3532266744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8008065fe0 msgr2=0x7f8008145fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:12.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800d056700 1 --2- 172.21.15.63:0/3532266744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8008065fe0 0x7f8008145fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:12.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800d056700 1 -- 172.21.15.63:0/3532266744 >> v1:172.21.15.63:6789/0 conn(0x7f8008069eb0 legacy=0x7f800813fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800d056700 1 -- 172.21.15.63:0/3532266744 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800814a370 con 0x7f80080b3460 2020-05-18T21:28:12.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800d056700 1 --2- 172.21.15.63:0/3532266744 >> v2:172.21.15.63:3300/0 conn(0x7f80080b3460 0x7f800806a290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7ff8002f70 tx=0x7f7ff8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800d056700 1 --2- 172.21.15.63:0/3532266744 >> v2:172.21.15.63:3300/0 conn(0x7f80080b3460 0x7f800806a290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7ff8002f70 tx=0x7f7ff8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800d056700 1 --2- 172.21.15.63:0/3532266744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80080b3460 0x7f800806a290 secure :-1 s=READY pgs=492 cs=0 l=1 rx=0x7f7ff8002f70 tx=0x7f7ff8007a80).ready entity=mon.0 client_cookie=9a89022247b4af88 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:12.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800d056700 1 --2- 172.21.15.63:0/3532266744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80080b3460 0x7f800806a290 secure :-1 s=THROTTLE_DONE pgs=492 cs=0 l=1 rx=0x7f7ff8002f70 tx=0x7f7ff8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800d056700 1 --2- 172.21.15.63:0/3532266744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80080b3460 0x7f800806a290 secure :-1 s=THROTTLE_DONE pgs=492 cs=0 l=1 rx=0x7f7ff8002f70 tx=0x7f7ff8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800c855700 1 -- 172.21.15.63:0/3532266744 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff8008e80 con 0x7f80080b3460 2020-05-18T21:28:12.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800d056700 1 --2- 172.21.15.63:0/3532266744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80080b3460 0x7f800806a290 secure :-1 s=THROTTLE_DONE pgs=492 cs=0 l=1 rx=0x7f7ff8002f70 tx=0x7f7ff8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800c855700 1 -- 172.21.15.63:0/3532266744 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff80116a0 con 0x7f80080b3460 2020-05-18T21:28:12.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800c855700 1 -- 172.21.15.63:0/3532266744 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff8011ac0 con 0x7f80080b3460 2020-05-18T21:28:12.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800e859700 1 -- 172.21.15.63:0/3532266744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80080b3460 msgr2=0x7f800806a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.401+0000 7f800e859700 1 --2- 172.21.15.63:0/3532266744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80080b3460 0x7f800806a290 secure :-1 s=READY pgs=492 cs=0 l=1 rx=0x7f7ff8002f70 tx=0x7f7ff8007a80).stop 2020-05-18T21:28:12.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.405+0000 7f800e859700 1 -- 172.21.15.63:0/3532266744 shutdown_connections 2020-05-18T21:28:12.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.405+0000 7f800e859700 1 --2- 172.21.15.63:0/3532266744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8008065fe0 0x7f8008145fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:12.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.405+0000 7f800e859700 1 --2- 172.21.15.63:0/3532266744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80080b3460 0x7f800806a290 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:12.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.405+0000 7f800e859700 1 -- 172.21.15.63:0/3532266744 >> 172.21.15.63:0/3532266744 conn(0x7f800805ebc0 msgr2=0x7f800805efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:12.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.405+0000 7f800e859700 1 -- 172.21.15.63:0/3532266744 shutdown_connections 2020-05-18T21:28:12.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.405+0000 7f800e859700 1 -- 172.21.15.63:0/3532266744 wait complete. 2020-05-18T21:28:12.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.405+0000 7f800e859700 1 Processor -- start 2020-05-18T21:28:12.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.405+0000 7f800e859700 1 -- start start 2020-05-18T21:28:12.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.405+0000 7f800e859700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8008065fe0 0x7f800813e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:12.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.405+0000 7f800e859700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8008069eb0 0x7f8008133850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:12.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.405+0000 7f800e859700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80080b88e0 con 0x7f80080b3460 2020-05-18T21:28:12.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.405+0000 7f800e859700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8008145340 con 0x7f8008065fe0 2020-05-18T21:28:12.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.405+0000 7f800e859700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80081434e0 con 0x7f8008069eb0 2020-05-18T21:28:12.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.405+0000 7f800d857700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8008065fe0 0x7f800813e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.405+0000 7f800e058700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f80080b3460 0x7f8008133cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57158/0 (socket says 172.21.15.63:57158) 2020-05-18T21:28:12.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.405+0000 7f800e058700 1 -- 172.21.15.63:0/1910581200 learned_addr learned my addr 172.21.15.63:0/1910581200 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:12.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.405+0000 7f800d056700 1 --2- 172.21.15.63:0/1910581200 >> v2:172.21.15.155:3300/0 conn(0x7f8008069eb0 0x7f8008133850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.405+0000 7f7ff6ffd700 1 -- 172.21.15.63:0/1910581200 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813938413 0 0) 0x7f80080b88e0 con 0x7f80080b3460 2020-05-18T21:28:12.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f7ff6ffd700 1 -- 172.21.15.63:0/1910581200 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fe8002fe0 con 0x7f80080b3460 2020-05-18T21:28:12.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f800d857700 1 -- 172.21.15.63:0/1910581200 >> v2:172.21.15.155:3300/0 conn(0x7f8008069eb0 msgr2=0x7f8008133850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f800d857700 1 --2- 172.21.15.63:0/1910581200 >> v2:172.21.15.155:3300/0 conn(0x7f8008069eb0 0x7f8008133850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:12.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f800d857700 1 -- 172.21.15.63:0/1910581200 >> v1:172.21.15.63:6789/0 conn(0x7f80080b3460 legacy=0x7f8008133cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f800d857700 1 -- 172.21.15.63:0/1910581200 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80081455b0 con 0x7f8008065fe0 2020-05-18T21:28:12.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f800d056700 1 --2- 172.21.15.63:0/1910581200 >> v2:172.21.15.155:3300/0 conn(0x7f8008069eb0 0x7f8008133850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:12.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f800d857700 1 --2- 172.21.15.63:0/1910581200 >> v2:172.21.15.63:3300/0 conn(0x7f8008065fe0 0x7f800813e3a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f800805fa30 tx=0x7f80040108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f800d857700 1 --2- 172.21.15.63:0/1910581200 >> v2:172.21.15.63:3300/0 conn(0x7f8008065fe0 0x7f800813e3a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f800805fa30 tx=0x7f80040108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f800d857700 1 --2- 172.21.15.63:0/1910581200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8008065fe0 0x7f800813e3a0 secure :-1 s=READY pgs=494 cs=0 l=1 rx=0x7f800805fa30 tx=0x7f80040108d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:12.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f800d857700 1 --2- 172.21.15.63:0/1910581200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8008065fe0 0x7f800813e3a0 secure :-1 s=THROTTLE_DONE pgs=494 cs=0 l=1 rx=0x7f800805fa30 tx=0x7f80040108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f7ff6ffd700 1 -- 172.21.15.63:0/1910581200 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8004005ce0 con 0x7f8008065fe0 2020-05-18T21:28:12.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f800d857700 1 --2- 172.21.15.63:0/1910581200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8008065fe0 0x7f800813e3a0 secure :-1 s=THROTTLE_DONE pgs=494 cs=0 l=1 rx=0x7f800805fa30 tx=0x7f80040108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f800d857700 1 --2- 172.21.15.63:0/1910581200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8008065fe0 0x7f800813e3a0 secure :-1 s=THROTTLE_DONE pgs=494 cs=0 l=1 rx=0x7f800805fa30 tx=0x7f80040108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f7ff6ffd700 1 -- 172.21.15.63:0/1910581200 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8004005e40 con 0x7f8008065fe0 2020-05-18T21:28:12.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f800e859700 1 -- 172.21.15.63:0/1910581200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8008145850 con 0x7f8008065fe0 2020-05-18T21:28:12.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f7ff6ffd700 1 -- 172.21.15.63:0/1910581200 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80040062c0 con 0x7f8008065fe0 2020-05-18T21:28:12.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f800e859700 1 -- 172.21.15.63:0/1910581200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8008142350 con 0x7f8008065fe0 2020-05-18T21:28:12.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f800d857700 1 --2- 172.21.15.63:0/1910581200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8008065fe0 0x7f800813e3a0 secure :-1 s=THROTTLE_DONE pgs=494 cs=0 l=1 rx=0x7f800805fa30 tx=0x7f80040108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f7ff6ffd700 1 -- 172.21.15.63:0/1910581200 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8004006530 con 0x7f8008065fe0 2020-05-18T21:28:12.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f800e859700 1 -- 172.21.15.63:0/1910581200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80080569e0 con 0x7f8008065fe0 2020-05-18T21:28:12.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f800d857700 1 --2- 172.21.15.63:0/1910581200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8008065fe0 0x7f800813e3a0 secure :-1 s=THROTTLE_DONE pgs=494 cs=0 l=1 rx=0x7f800805fa30 tx=0x7f80040108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f7ff6ffd700 1 --2- 172.21.15.63:0/1910581200 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fe804fd80 0x7f7fe8052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:12.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f7ff6ffd700 1 -- 172.21.15.63:0/1910581200 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f80040090c0 con 0x7f8008065fe0 2020-05-18T21:28:12.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.409+0000 7f800d056700 1 --2- 172.21.15.63:0/1910581200 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fe804fd80 0x7f7fe8052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.413+0000 7f800d056700 1 --2- 172.21.15.63:0/1910581200 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fe804fd80 0x7f7fe8052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7ff8002f70 tx=0x7f7ff8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.413+0000 7f800d056700 1 --2- 172.21.15.63:0/1910581200 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fe804fd80 0x7f7fe8052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7ff8002f70 tx=0x7f7ff8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.413+0000 7f800d056700 1 --2- 172.21.15.63:0/1910581200 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fe804fd80 0x7f7fe8052240 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f7ff8002f70 tx=0x7f7ff8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:12.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.417+0000 7f800d857700 1 --2- 172.21.15.63:0/1910581200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8008065fe0 0x7f800813e3a0 secure :-1 s=THROTTLE_DONE pgs=494 cs=0 l=1 rx=0x7f800805fa30 tx=0x7f80040108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.417+0000 7f7ff6ffd700 1 -- 172.21.15.63:0/1910581200 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f800403e140 con 0x7f8008065fe0 2020-05-18T21:28:12.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.529+0000 7f800e859700 1 -- 172.21.15.63:0/1910581200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8008141070 con 0x7f8008065fe0 2020-05-18T21:28:12.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.529+0000 7f800d857700 1 --2- 172.21.15.63:0/1910581200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8008065fe0 0x7f800813e3a0 secure :-1 s=THROTTLE_DONE pgs=494 cs=0 l=1 rx=0x7f800805fa30 tx=0x7f80040108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.529+0000 7f7ff6ffd700 1 -- 172.21.15.63:0/1910581200 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v41) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8004041760 con 0x7f8008065fe0 2020-05-18T21:28:12.537 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:28:12.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.533+0000 7f800e859700 1 -- 172.21.15.63:0/1910581200 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fe804fd80 msgr2=0x7f7fe8052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.533+0000 7f800e859700 1 --2- 172.21.15.63:0/1910581200 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fe804fd80 0x7f7fe8052240 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f7ff8002f70 tx=0x7f7ff8007a80).stop 2020-05-18T21:28:12.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.533+0000 7f800e859700 1 -- 172.21.15.63:0/1910581200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8008065fe0 msgr2=0x7f800813e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.533+0000 7f800e859700 1 --2- 172.21.15.63:0/1910581200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8008065fe0 0x7f800813e3a0 secure :-1 s=READY pgs=494 cs=0 l=1 rx=0x7f800805fa30 tx=0x7f80040108d0).stop 2020-05-18T21:28:12.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.533+0000 7f800e859700 1 -- 172.21.15.63:0/1910581200 shutdown_connections 2020-05-18T21:28:12.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.533+0000 7f800e859700 1 --2- 172.21.15.63:0/1910581200 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fe804fd80 0x7f7fe8052240 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:12.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.533+0000 7f800e859700 1 --2- 172.21.15.63:0/1910581200 >> v2:172.21.15.155:3300/0 conn(0x7f8008069eb0 0x7f8008133850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:12.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.533+0000 7f800e859700 1 --2- 172.21.15.63:0/1910581200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8008065fe0 0x7f800813e3a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:12.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.533+0000 7f800e859700 1 -- 172.21.15.63:0/1910581200 >> 172.21.15.63:0/1910581200 conn(0x7f800805ebc0 msgr2=0x7f800813eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:12.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.533+0000 7f800e859700 1 -- 172.21.15.63:0/1910581200 shutdown_connections 2020-05-18T21:28:12.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.533+0000 7f800e859700 1 -- 172.21.15.63:0/1910581200 wait complete. 2020-05-18T21:28:12.549 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:28:12.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.653+0000 7fd6f7338700 1 Processor -- start 2020-05-18T21:28:12.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.653+0000 7fd6f7338700 1 -- start start 2020-05-18T21:28:12.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.653+0000 7fd6f7338700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6f00b58e0 0x7fd6f0060850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:12.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.653+0000 7fd6f7338700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f0060cb0 0x7fd6f005ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:12.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.653+0000 7fd6f7338700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f0143ee0 con 0x7fd6f005f1b0 2020-05-18T21:28:12.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.653+0000 7fd6f7338700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f005f800 con 0x7fd6f00b58e0 2020-05-18T21:28:12.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.653+0000 7fd6f7338700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f00b5cc0 con 0x7fd6f0060cb0 2020-05-18T21:28:12.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.653+0000 7fd6f50d4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6f00b58e0 0x7fd6f0060850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.653+0000 7fd6f58d5700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd6f005f1b0 0x7fd6f0144380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57166/0 (socket says 172.21.15.63:57166) 2020-05-18T21:28:12.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.653+0000 7fd6f58d5700 1 -- 172.21.15.63:0/3214585583 learned_addr learned my addr 172.21.15.63:0/3214585583 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:12.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.653+0000 7fd6f48d3700 1 --2- 172.21.15.63:0/3214585583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f0060cb0 0x7fd6f005ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6dbfff700 1 -- 172.21.15.63:0/3214585583 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801995957 0 0) 0x7fd6f0143ee0 con 0x7fd6f005f1b0 2020-05-18T21:28:12.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6dbfff700 1 -- 172.21.15.63:0/3214585583 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d4003270 con 0x7fd6f005f1b0 2020-05-18T21:28:12.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f50d4700 1 -- 172.21.15.63:0/3214585583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f0060cb0 msgr2=0x7fd6f005ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:12.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f50d4700 1 --2- 172.21.15.63:0/3214585583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f0060cb0 0x7fd6f005ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:12.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f50d4700 1 -- 172.21.15.63:0/3214585583 >> v1:172.21.15.63:6789/0 conn(0x7fd6f005f1b0 legacy=0x7fd6f0144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f50d4700 1 -- 172.21.15.63:0/3214585583 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f0064ec0 con 0x7fd6f00b58e0 2020-05-18T21:28:12.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f48d3700 1 --2- 172.21.15.63:0/3214585583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f0060cb0 0x7fd6f005ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:12.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f50d4700 1 --2- 172.21.15.63:0/3214585583 >> v2:172.21.15.63:3300/0 conn(0x7fd6f00b58e0 0x7fd6f0060850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd6ec002f70 tx=0x7fd6ec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f50d4700 1 --2- 172.21.15.63:0/3214585583 >> v2:172.21.15.63:3300/0 conn(0x7fd6f00b58e0 0x7fd6f0060850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd6ec002f70 tx=0x7fd6ec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f50d4700 1 --2- 172.21.15.63:0/3214585583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6f00b58e0 0x7fd6f0060850 secure :-1 s=READY pgs=496 cs=0 l=1 rx=0x7fd6ec002f70 tx=0x7fd6ec007a80).ready entity=mon.0 client_cookie=eb064e4ea9e89167 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:12.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f50d4700 1 --2- 172.21.15.63:0/3214585583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6f00b58e0 0x7fd6f0060850 secure :-1 s=THROTTLE_DONE pgs=496 cs=0 l=1 rx=0x7fd6ec002f70 tx=0x7fd6ec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6dbfff700 1 -- 172.21.15.63:0/3214585583 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6ec008e80 con 0x7fd6f00b58e0 2020-05-18T21:28:12.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f50d4700 1 --2- 172.21.15.63:0/3214585583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6f00b58e0 0x7fd6f0060850 secure :-1 s=THROTTLE_DONE pgs=496 cs=0 l=1 rx=0x7fd6ec002f70 tx=0x7fd6ec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6dbfff700 1 -- 172.21.15.63:0/3214585583 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec011540 con 0x7fd6f00b58e0 2020-05-18T21:28:12.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f50d4700 1 --2- 172.21.15.63:0/3214585583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6f00b58e0 0x7fd6f0060850 secure :-1 s=THROTTLE_DONE pgs=496 cs=0 l=1 rx=0x7fd6ec002f70 tx=0x7fd6ec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f7338700 1 -- 172.21.15.63:0/3214585583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6f00b58e0 msgr2=0x7fd6f0060850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6dbfff700 1 -- 172.21.15.63:0/3214585583 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6ec011920 con 0x7fd6f00b58e0 2020-05-18T21:28:12.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f7338700 1 --2- 172.21.15.63:0/3214585583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6f00b58e0 0x7fd6f0060850 secure :-1 s=READY pgs=496 cs=0 l=1 rx=0x7fd6ec002f70 tx=0x7fd6ec007a80).stop 2020-05-18T21:28:12.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f7338700 1 -- 172.21.15.63:0/3214585583 shutdown_connections 2020-05-18T21:28:12.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f7338700 1 --2- 172.21.15.63:0/3214585583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f0060cb0 0x7fd6f005ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:12.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f7338700 1 --2- 172.21.15.63:0/3214585583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6f00b58e0 0x7fd6f0060850 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:12.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f7338700 1 -- 172.21.15.63:0/3214585583 >> 172.21.15.63:0/3214585583 conn(0x7fd6f00b8ec0 msgr2=0x7fd6f00b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:12.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f7338700 1 -- 172.21.15.63:0/3214585583 shutdown_connections 2020-05-18T21:28:12.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f7338700 1 -- 172.21.15.63:0/3214585583 wait complete. 2020-05-18T21:28:12.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f7338700 1 Processor -- start 2020-05-18T21:28:12.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.657+0000 7fd6f7338700 1 -- start start 2020-05-18T21:28:12.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f7338700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f00b58e0 0x7fd6f0146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:12.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f7338700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f0063c50 con 0x7fd6f005f1b0 2020-05-18T21:28:12.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f7338700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f0154300 con 0x7fd6f0060cb0 2020-05-18T21:28:12.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f7338700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f01452b0 con 0x7fd6f00b58e0 2020-05-18T21:28:12.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f50d4700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd6f005f1b0 0x7fd6f0153300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57168/0 (socket says 172.21.15.63:57168) 2020-05-18T21:28:12.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f50d4700 1 -- 172.21.15.63:0/3554113544 learned_addr learned my addr 172.21.15.63:0/3554113544 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:12.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f58d5700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f00b58e0 0x7fd6f0146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6e2ffd700 1 -- 172.21.15.63:0/3554113544 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213506913 0 0) 0x7fd6f0063c50 con 0x7fd6f005f1b0 2020-05-18T21:28:12.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6e2ffd700 1 -- 172.21.15.63:0/3554113544 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6cc002fe0 con 0x7fd6f005f1b0 2020-05-18T21:28:12.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6e2ffd700 1 -- 172.21.15.63:0/3554113544 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3045017111 0 0) 0x7fd6cc002fe0 con 0x7fd6f005f1b0 2020-05-18T21:28:12.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6e2ffd700 1 -- 172.21.15.63:0/3554113544 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd6f0063c50 con 0x7fd6f005f1b0 2020-05-18T21:28:12.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6e2ffd700 1 -- 172.21.15.63:0/3554113544 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fd6ec008e80 con 0x7fd6f005f1b0 2020-05-18T21:28:12.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6e2ffd700 1 -- 172.21.15.63:0/3554113544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f00b58e0 msgr2=0x7fd6f0146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6e2ffd700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f00b58e0 0x7fd6f0146700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:12.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6e2ffd700 1 -- 172.21.15.63:0/3554113544 >> v1:172.21.15.155:6789/0 conn(0x7fd6f0060cb0 legacy=0x7fd6f0153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6e2ffd700 1 -- 172.21.15.63:0/3554113544 >> v1:172.21.15.63:6789/0 conn(0x7fd6f005f1b0 legacy=0x7fd6f0153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6e2ffd700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6cc004a80 0x7fd6cc004e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:12.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6e2ffd700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f00b58e0 0x7fd6cc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:12.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6e2ffd700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6cc003e00 0x7fd6cc0042b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:12.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6e2ffd700 1 -- 172.21.15.63:0/3554113544 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f01452b0 con 0x7fd6cc003e00 2020-05-18T21:28:12.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6e2ffd700 1 -- 172.21.15.63:0/3554113544 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc0053a0 con 0x7fd6cc004a80 2020-05-18T21:28:12.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6e2ffd700 1 -- 172.21.15.63:0/3554113544 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc005530 con 0x7fd6f00b58e0 2020-05-18T21:28:12.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f58d5700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6cc003e00 0x7fd6cc0042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f50d4700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6cc004a80 0x7fd6cc004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f48d3700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f00b58e0 0x7fd6cc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f58d5700 1 -- 172.21.15.63:0/3554113544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f00b58e0 msgr2=0x7fd6cc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f58d5700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f00b58e0 0x7fd6cc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:12.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f58d5700 1 -- 172.21.15.63:0/3554113544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6cc004a80 msgr2=0x7fd6cc004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f58d5700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6cc004a80 0x7fd6cc004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:12.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f58d5700 1 -- 172.21.15.63:0/3554113544 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00627d0 con 0x7fd6cc003e00 2020-05-18T21:28:12.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f7338700 1 -- 172.21.15.63:0/3554113544 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f0062a70 con 0x7fd6cc003e00 2020-05-18T21:28:12.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f58d5700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6cc003e00 0x7fd6cc0042b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6e8001110 tx=0x7fd6e80012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f7338700 1 -- 172.21.15.63:0/3554113544 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f0146700 con 0x7fd6cc003e00 2020-05-18T21:28:12.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f58d5700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6cc003e00 0x7fd6cc0042b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6e8001110 tx=0x7fd6e80012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f58d5700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6cc003e00 0x7fd6cc0042b0 secure :-1 s=READY pgs=498 cs=0 l=1 rx=0x7fd6e8001110 tx=0x7fd6e80012e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:12.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f58d5700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6cc003e00 0x7fd6cc0042b0 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7fd6e8001110 tx=0x7fd6e80012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6e2ffd700 1 -- 172.21.15.63:0/3554113544 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6e800cca0 con 0x7fd6cc003e00 2020-05-18T21:28:12.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f58d5700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6cc003e00 0x7fd6cc0042b0 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7fd6e8001110 tx=0x7fd6e80012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6e2ffd700 1 -- 172.21.15.63:0/3554113544 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e800ce00 con 0x7fd6cc003e00 2020-05-18T21:28:12.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f58d5700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6cc003e00 0x7fd6cc0042b0 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7fd6e8001110 tx=0x7fd6e80012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6e2ffd700 1 -- 172.21.15.63:0/3554113544 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6e8004720 con 0x7fd6cc003e00 2020-05-18T21:28:12.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f7338700 1 -- 172.21.15.63:0/3554113544 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d0003380 con 0x7fd6cc003e00 2020-05-18T21:28:12.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.661+0000 7fd6f58d5700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6cc003e00 0x7fd6cc0042b0 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7fd6e8001110 tx=0x7fd6e80012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.665+0000 7fd6e2ffd700 1 -- 172.21.15.63:0/3554113544 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd6e8010290 con 0x7fd6cc003e00 2020-05-18T21:28:12.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.665+0000 7fd6f58d5700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6cc003e00 0x7fd6cc0042b0 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7fd6e8001110 tx=0x7fd6e80012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.665+0000 7fd6e2ffd700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd6cc057da0 0x7fd6cc05a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:12.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.665+0000 7fd6e2ffd700 1 -- 172.21.15.63:0/3554113544 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd6e80100d0 con 0x7fd6cc003e00 2020-05-18T21:28:12.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.665+0000 7fd6f50d4700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd6cc057da0 0x7fd6cc05a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.665+0000 7fd6f50d4700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd6cc057da0 0x7fd6cc05a260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6ec008950 tx=0x7fd6ec007b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.665+0000 7fd6f50d4700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd6cc057da0 0x7fd6cc05a260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6ec008950 tx=0x7fd6ec007b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.665+0000 7fd6f50d4700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd6cc057da0 0x7fd6cc05a260 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7fd6ec008950 tx=0x7fd6ec007b20).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:12.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.669+0000 7fd6f58d5700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6cc003e00 0x7fd6cc0042b0 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7fd6e8001110 tx=0x7fd6e80012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.669+0000 7fd6e2ffd700 1 -- 172.21.15.63:0/3554113544 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd6e803dfe0 con 0x7fd6cc003e00 2020-05-18T21:28:12.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.785+0000 7fd6f7338700 1 -- 172.21.15.63:0/3554113544 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd6d0002240 con 0x7fd6cc003e00 2020-05-18T21:28:12.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.785+0000 7fd6f58d5700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6cc003e00 0x7fd6cc0042b0 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7fd6e8001110 tx=0x7fd6e80012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.785+0000 7fd6e2ffd700 1 -- 172.21.15.63:0/3554113544 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd6e8041600 con 0x7fd6cc003e00 2020-05-18T21:28:12.794 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:28:12.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.789+0000 7fd6f7338700 1 -- 172.21.15.63:0/3554113544 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd6cc057da0 msgr2=0x7fd6cc05a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.789+0000 7fd6f7338700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd6cc057da0 0x7fd6cc05a260 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7fd6ec008950 tx=0x7fd6ec007b20).stop 2020-05-18T21:28:12.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.789+0000 7fd6f7338700 1 -- 172.21.15.63:0/3554113544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6cc003e00 msgr2=0x7fd6cc0042b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.789+0000 7fd6f7338700 1 --2- 172.21.15.63:0/3554113544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6cc003e00 0x7fd6cc0042b0 secure :-1 s=READY pgs=498 cs=0 l=1 rx=0x7fd6e8001110 tx=0x7fd6e80012e0).stop 2020-05-18T21:28:12.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.789+0000 7fd6f58d5700 1 -- 172.21.15.63:0/3554113544 reap_dead start 2020-05-18T21:28:12.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.789+0000 7fd6f58d5700 1 -- 172.21.15.63:0/3554113544 reap_dead start 2020-05-18T21:28:12.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.789+0000 7fd6f7338700 1 -- 172.21.15.63:0/3554113544 shutdown_connections 2020-05-18T21:28:12.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.789+0000 7fd6f7338700 1 -- 172.21.15.63:0/3554113544 >> 172.21.15.63:0/3554113544 conn(0x7fd6f00b8ec0 msgr2=0x7fd6f00b76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:12.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.789+0000 7fd6f7338700 1 -- 172.21.15.63:0/3554113544 shutdown_connections 2020-05-18T21:28:12.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.789+0000 7fd6f7338700 1 -- 172.21.15.63:0/3554113544 wait complete. 2020-05-18T21:28:12.806 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:28:12.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.905+0000 7f232f46e700 1 Processor -- start 2020-05-18T21:28:12.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.905+0000 7f232f46e700 1 -- start start 2020-05-18T21:28:12.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.905+0000 7f232f46e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f23280b4460 0x7f23280b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:12.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.905+0000 7f232f46e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23280b6c10 0x7f23280b70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:12.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.905+0000 7f232f46e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2328146740 con 0x7f2328145ca0 2020-05-18T21:28:12.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.905+0000 7f232f46e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23281469e0 con 0x7f23280b4460 2020-05-18T21:28:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.905+0000 7f232f46e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23280b4840 con 0x7f23280b6c10 2020-05-18T21:28:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232e46c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f23280b4460 0x7f23280b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232dc6b700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f2328145ca0 0x7f23280b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:55502/0 (socket says 172.21.15.63:55502) 2020-05-18T21:28:12.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232ec6d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23280b6c10 0x7f23280b70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232dc6b700 1 -- 172.21.15.63:0/3672937129 learned_addr learned my addr 172.21.15.63:0/3672937129 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:12.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232d46a700 1 -- 172.21.15.63:0/3672937129 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722181318 0 0) 0x7f2328146740 con 0x7f2328145ca0 2020-05-18T21:28:12.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232d46a700 1 -- 172.21.15.63:0/3672937129 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2310003270 con 0x7f2328145ca0 2020-05-18T21:28:12.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232e46c700 1 -- 172.21.15.63:0/3672937129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23280b6c10 msgr2=0x7f23280b70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:12.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232e46c700 1 --2- 172.21.15.63:0/3672937129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23280b6c10 0x7f23280b70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:12.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232e46c700 1 -- 172.21.15.63:0/3672937129 >> v1:172.21.15.155:6789/0 conn(0x7f2328145ca0 legacy=0x7f23280b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232d46a700 1 -- 172.21.15.63:0/3672937129 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2121366262 0 0) 0x7f2310003270 con 0x7f2328145ca0 2020-05-18T21:28:12.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232e46c700 1 -- 172.21.15.63:0/3672937129 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23280b0ff0 con 0x7f23280b4460 2020-05-18T21:28:12.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232ec6d700 1 --2- 172.21.15.63:0/3672937129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23280b6c10 0x7f23280b70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:12.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232e46c700 1 --2- 172.21.15.63:0/3672937129 >> v2:172.21.15.155:3300/0 conn(0x7f23280b4460 0x7f23280b1550 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f23180018b0 tx=0x7f2324007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232e46c700 1 --2- 172.21.15.63:0/3672937129 >> v2:172.21.15.155:3300/0 conn(0x7f23280b4460 0x7f23280b1550 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f23180018b0 tx=0x7f2324007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232e46c700 1 --2- 172.21.15.63:0/3672937129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23280b4460 0x7f23280b1550 secure :-1 s=READY pgs=361 cs=0 l=1 rx=0x7f23180018b0 tx=0x7f2324007a80).ready entity=mon.1 client_cookie=986951d573545018 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:12.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232e46c700 1 --2- 172.21.15.63:0/3672937129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23280b4460 0x7f23280b1550 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f23180018b0 tx=0x7f2324007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232d46a700 1 -- 172.21.15.63:0/3672937129 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2318001710 con 0x7f23280b4460 2020-05-18T21:28:12.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232e46c700 1 --2- 172.21.15.63:0/3672937129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23280b4460 0x7f23280b1550 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f23180018b0 tx=0x7f2324007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232d46a700 1 -- 172.21.15.63:0/3672937129 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2324008e40 con 0x7f23280b4460 2020-05-18T21:28:12.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232e46c700 1 --2- 172.21.15.63:0/3672937129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23280b4460 0x7f23280b1550 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f23180018b0 tx=0x7f2324007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232f46e700 1 -- 172.21.15.63:0/3672937129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23280b4460 msgr2=0x7f23280b1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232d46a700 1 -- 172.21.15.63:0/3672937129 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2324011440 con 0x7f23280b4460 2020-05-18T21:28:12.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232f46e700 1 --2- 172.21.15.63:0/3672937129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23280b4460 0x7f23280b1550 secure :-1 s=READY pgs=361 cs=0 l=1 rx=0x7f23180018b0 tx=0x7f2324007a80).stop 2020-05-18T21:28:12.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232f46e700 1 -- 172.21.15.63:0/3672937129 shutdown_connections 2020-05-18T21:28:12.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232f46e700 1 --2- 172.21.15.63:0/3672937129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23280b6c10 0x7f23280b70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:12.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232f46e700 1 --2- 172.21.15.63:0/3672937129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23280b4460 0x7f23280b1550 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:12.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232f46e700 1 -- 172.21.15.63:0/3672937129 >> 172.21.15.63:0/3672937129 conn(0x7f2328069b70 msgr2=0x7f2328069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:12.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232f46e700 1 -- 172.21.15.63:0/3672937129 shutdown_connections 2020-05-18T21:28:12.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.909+0000 7f232f46e700 1 -- 172.21.15.63:0/3672937129 wait complete. 2020-05-18T21:28:12.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232f46e700 1 Processor -- start 2020-05-18T21:28:12.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232f46e700 1 -- start start 2020-05-18T21:28:12.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232f46e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f23280b6c10 0x7f2328155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:12.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232f46e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2328145ca0 0x7f2328156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:12.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232f46e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2328147780 con 0x7f23280b4460 2020-05-18T21:28:12.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232f46e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23280630b0 con 0x7f23280b6c10 2020-05-18T21:28:12.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232f46e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23281479e0 con 0x7f2328145ca0 2020-05-18T21:28:12.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232dc6b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f23280b6c10 0x7f2328155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232dc6b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f23280b6c10 0x7f2328155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55002/0 (socket says 172.21.15.63:55002) 2020-05-18T21:28:12.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232dc6b700 1 -- 172.21.15.63:0/1536100947 learned_addr learned my addr 172.21.15.63:0/1536100947 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:12.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232ec6d700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2328145ca0 0x7f2328156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232dc6b700 1 -- 172.21.15.63:0/1536100947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2328145ca0 msgr2=0x7f2328156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232dc6b700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2328145ca0 0x7f2328156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:12.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232dc6b700 1 -- 172.21.15.63:0/1536100947 >> v1:172.21.15.155:6789/0 conn(0x7f23280b4460 legacy=0x7f2328141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:12.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232dc6b700 1 -- 172.21.15.63:0/1536100947 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2328147c80 con 0x7f23280b6c10 2020-05-18T21:28:12.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232ec6d700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2328145ca0 0x7f2328156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:28:12.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232dc6b700 1 --2- 172.21.15.63:0/1536100947 >> v2:172.21.15.63:3300/0 conn(0x7f23280b6c10 0x7f2328155be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2318001970 tx=0x7f2318010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232dc6b700 1 --2- 172.21.15.63:0/1536100947 >> v2:172.21.15.63:3300/0 conn(0x7f23280b6c10 0x7f2328155be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2318001970 tx=0x7f2318010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232dc6b700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23280b6c10 0x7f2328155be0 secure :-1 s=READY pgs=499 cs=0 l=1 rx=0x7f2318001970 tx=0x7f2318010da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:12.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f232dc6b700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23280b6c10 0x7f2328155be0 secure :-1 s=THROTTLE_DONE pgs=499 cs=0 l=1 rx=0x7f2318001970 tx=0x7f2318010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.913+0000 7f23177fe700 1 -- 172.21.15.63:0/1536100947 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2318012b20 con 0x7f23280b6c10 2020-05-18T21:28:12.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.917+0000 7f232dc6b700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23280b6c10 0x7f2328155be0 secure :-1 s=THROTTLE_DONE pgs=499 cs=0 l=1 rx=0x7f2318001970 tx=0x7f2318010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.917+0000 7f232f46e700 1 -- 172.21.15.63:0/1536100947 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2328147f20 con 0x7f23280b6c10 2020-05-18T21:28:12.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.917+0000 7f23177fe700 1 -- 172.21.15.63:0/1536100947 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2318012c80 con 0x7f23280b6c10 2020-05-18T21:28:12.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.917+0000 7f232dc6b700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23280b6c10 0x7f2328155be0 secure :-1 s=THROTTLE_DONE pgs=499 cs=0 l=1 rx=0x7f2318001970 tx=0x7f2318010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.917+0000 7f232f46e700 1 -- 172.21.15.63:0/1536100947 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2328142480 con 0x7f23280b6c10 2020-05-18T21:28:12.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.917+0000 7f23177fe700 1 -- 172.21.15.63:0/1536100947 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2318012e80 con 0x7f23280b6c10 2020-05-18T21:28:12.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.917+0000 7f232dc6b700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23280b6c10 0x7f2328155be0 secure :-1 s=THROTTLE_DONE pgs=499 cs=0 l=1 rx=0x7f2318001970 tx=0x7f2318010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.917+0000 7f23177fe700 1 -- 172.21.15.63:0/1536100947 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f231800c7a0 con 0x7f23280b6c10 2020-05-18T21:28:12.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.917+0000 7f232dc6b700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23280b6c10 0x7f2328155be0 secure :-1 s=THROTTLE_DONE pgs=499 cs=0 l=1 rx=0x7f2318001970 tx=0x7f2318010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.917+0000 7f232f46e700 1 -- 172.21.15.63:0/1536100947 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2304003380 con 0x7f23280b6c10 2020-05-18T21:28:12.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.917+0000 7f23177fe700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f230804f980 0x7f2308051e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:12.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.917+0000 7f23177fe700 1 -- 172.21.15.63:0/1536100947 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2318063bf0 con 0x7f23280b6c10 2020-05-18T21:28:12.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.917+0000 7f232e46c700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f230804f980 0x7f2308051e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:12.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.917+0000 7f232e46c700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f230804f980 0x7f2308051e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2328043400 tx=0x7f2324007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.917+0000 7f232e46c700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f230804f980 0x7f2308051e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2328043400 tx=0x7f2324007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.917+0000 7f232e46c700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f230804f980 0x7f2308051e40 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f2328043400 tx=0x7f2324007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:12.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.925+0000 7f232dc6b700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23280b6c10 0x7f2328155be0 secure :-1 s=THROTTLE_DONE pgs=499 cs=0 l=1 rx=0x7f2318001970 tx=0x7f2318010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:12.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:12.925+0000 7f23177fe700 1 -- 172.21.15.63:0/1536100947 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f23180419b0 con 0x7f23280b6c10 2020-05-18T21:28:13.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.037+0000 7f232f46e700 1 -- 172.21.15.63:0/1536100947 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2304002240 con 0x7f23280b6c10 2020-05-18T21:28:13.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.037+0000 7f232dc6b700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23280b6c10 0x7f2328155be0 secure :-1 s=THROTTLE_DONE pgs=499 cs=0 l=1 rx=0x7f2318001970 tx=0x7f2318010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.037+0000 7f23177fe700 1 -- 172.21.15.63:0/1536100947 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2318041540 con 0x7f23280b6c10 2020-05-18T21:28:13.045 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:28:13.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.037+0000 7f232f46e700 1 -- 172.21.15.63:0/1536100947 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f230804f980 msgr2=0x7f2308051e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:13.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.037+0000 7f232f46e700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f230804f980 0x7f2308051e40 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f2328043400 tx=0x7f2324007a80).stop 2020-05-18T21:28:13.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.037+0000 7f232f46e700 1 -- 172.21.15.63:0/1536100947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23280b6c10 msgr2=0x7f2328155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:13.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.037+0000 7f232f46e700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23280b6c10 0x7f2328155be0 secure :-1 s=READY pgs=499 cs=0 l=1 rx=0x7f2318001970 tx=0x7f2318010da0).stop 2020-05-18T21:28:13.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.037+0000 7f232f46e700 1 -- 172.21.15.63:0/1536100947 shutdown_connections 2020-05-18T21:28:13.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.037+0000 7f232f46e700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f230804f980 0x7f2308051e40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:13.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.041+0000 7f232f46e700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2328145ca0 0x7f2328156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:13.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.041+0000 7f232f46e700 1 --2- 172.21.15.63:0/1536100947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23280b6c10 0x7f2328155be0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:13.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.041+0000 7f232f46e700 1 -- 172.21.15.63:0/1536100947 >> 172.21.15.63:0/1536100947 conn(0x7f2328069b70 msgr2=0x7f23281443e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:13.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.041+0000 7f232f46e700 1 -- 172.21.15.63:0/1536100947 shutdown_connections 2020-05-18T21:28:13.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.041+0000 7f232f46e700 1 -- 172.21.15.63:0/1536100947 wait complete. 2020-05-18T21:28:13.056 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:28:13.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.157+0000 7fd75ffff700 1 Processor -- start 2020-05-18T21:28:13.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.157+0000 7fd75ffff700 1 -- start start 2020-05-18T21:28:13.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd760145790 0x7fd760065dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:13.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd760145b70 0x7fd760061030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:13.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75ffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7601461b0 con 0x7fd7600b4890 2020-05-18T21:28:13.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75ffff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7601466f0 con 0x7fd760145b70 2020-05-18T21:28:13.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75ffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd760146450 con 0x7fd760145790 2020-05-18T21:28:13.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75e7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd760145b70 0x7fd760061030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:13.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd7600b4890 0x7fd7600ad770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57200/0 (socket says 172.21.15.63:57200) 2020-05-18T21:28:13.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75e7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd760145b70 0x7fd760061030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55008/0 (socket says 172.21.15.63:55008) 2020-05-18T21:28:13.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75f7fe700 1 -- 172.21.15.63:0/3853642597 learned_addr learned my addr 172.21.15.63:0/3853642597 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:13.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75effd700 1 --2- 172.21.15.63:0/3853642597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd760145790 0x7fd760065dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:13.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75e7fc700 1 -- 172.21.15.63:0/3853642597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd760145790 msgr2=0x7fd760065dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:13.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75e7fc700 1 --2- 172.21.15.63:0/3853642597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd760145790 0x7fd760065dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:13.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75e7fc700 1 -- 172.21.15.63:0/3853642597 >> v1:172.21.15.63:6789/0 conn(0x7fd7600b4890 legacy=0x7fd7600ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:13.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75dffb700 1 -- 172.21.15.63:0/3853642597 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062738238 0 0) 0x7fd7601461b0 con 0x7fd7600b4890 2020-05-18T21:28:13.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75e7fc700 1 -- 172.21.15.63:0/3853642597 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd760061490 con 0x7fd760145b70 2020-05-18T21:28:13.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75e7fc700 1 --2- 172.21.15.63:0/3853642597 >> v2:172.21.15.63:3300/0 conn(0x7fd760145b70 0x7fd760061030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd748002f70 tx=0x7fd748007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75e7fc700 1 --2- 172.21.15.63:0/3853642597 >> v2:172.21.15.63:3300/0 conn(0x7fd760145b70 0x7fd760061030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd748002f70 tx=0x7fd748007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75e7fc700 1 --2- 172.21.15.63:0/3853642597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd760145b70 0x7fd760061030 secure :-1 s=READY pgs=501 cs=0 l=1 rx=0x7fd748002f70 tx=0x7fd748007a80).ready entity=mon.0 client_cookie=dbe3e1c5ac6b0747 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:13.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75e7fc700 1 --2- 172.21.15.63:0/3853642597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd760145b70 0x7fd760061030 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7fd748002f70 tx=0x7fd748007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75dffb700 1 -- 172.21.15.63:0/3853642597 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd748008e80 con 0x7fd760145b70 2020-05-18T21:28:13.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75e7fc700 1 --2- 172.21.15.63:0/3853642597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd760145b70 0x7fd760061030 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7fd748002f70 tx=0x7fd748007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75e7fc700 1 --2- 172.21.15.63:0/3853642597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd760145b70 0x7fd760061030 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7fd748002f70 tx=0x7fd748007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75dffb700 1 -- 172.21.15.63:0/3853642597 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7480116a0 con 0x7fd760145b70 2020-05-18T21:28:13.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75dffb700 1 -- 172.21.15.63:0/3853642597 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd748011a80 con 0x7fd760145b70 2020-05-18T21:28:13.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75ffff700 1 -- 172.21.15.63:0/3853642597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd760145b70 msgr2=0x7fd760061030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:13.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75ffff700 1 --2- 172.21.15.63:0/3853642597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd760145b70 0x7fd760061030 secure :-1 s=READY pgs=501 cs=0 l=1 rx=0x7fd748002f70 tx=0x7fd748007a80).stop 2020-05-18T21:28:13.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75ffff700 1 -- 172.21.15.63:0/3853642597 shutdown_connections 2020-05-18T21:28:13.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75ffff700 1 --2- 172.21.15.63:0/3853642597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd760145b70 0x7fd760061030 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:13.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75ffff700 1 --2- 172.21.15.63:0/3853642597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd760145790 0x7fd760065dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:13.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75ffff700 1 -- 172.21.15.63:0/3853642597 >> 172.21.15.63:0/3853642597 conn(0x7fd76005fb90 msgr2=0x7fd760069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:13.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75ffff700 1 -- 172.21.15.63:0/3853642597 shutdown_connections 2020-05-18T21:28:13.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75ffff700 1 -- 172.21.15.63:0/3853642597 wait complete. 2020-05-18T21:28:13.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75ffff700 1 Processor -- start 2020-05-18T21:28:13.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.161+0000 7fd75ffff700 1 -- start start 2020-05-18T21:28:13.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd7600b4890 0x7fd760144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:13.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75ffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76013fcd0 con 0x7fd760145b70 2020-05-18T21:28:13.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75ffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd760145250 con 0x7fd760145790 2020-05-18T21:28:13.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75ffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76013fac0 con 0x7fd7600b4890 2020-05-18T21:28:13.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd760145b70 0x7fd760140410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57204/0 (socket says 172.21.15.63:57204) 2020-05-18T21:28:13.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75f7fe700 1 -- 172.21.15.63:0/1855154485 learned_addr learned my addr 172.21.15.63:0/1855154485 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:13.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75effd700 1 --2- 172.21.15.63:0/1855154485 >> v2:172.21.15.155:3300/0 conn(0x7fd7600b4890 0x7fd760144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:13.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 326916037 0 0) 0x7fd76013fcd0 con 0x7fd760145b70 2020-05-18T21:28:13.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd744002fe0 con 0x7fd760145b70 2020-05-18T21:28:13.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397595624 0 0) 0x7fd760145250 con 0x7fd760145790 2020-05-18T21:28:13.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd76013fcd0 con 0x7fd760145790 2020-05-18T21:28:13.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1390899647 0 0) 0x7fd744002fe0 con 0x7fd760145b70 2020-05-18T21:28:13.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd760145250 con 0x7fd760145b70 2020-05-18T21:28:13.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fd758001c20 con 0x7fd760145b70 2020-05-18T21:28:13.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 >> v2:172.21.15.155:3300/0 conn(0x7fd7600b4890 msgr2=0x7fd760144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:13.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 --2- 172.21.15.63:0/1855154485 >> v2:172.21.15.155:3300/0 conn(0x7fd7600b4890 0x7fd760144250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:13.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 >> v1:172.21.15.155:6789/0 conn(0x7fd760145790 legacy=0x7fd76013e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:13.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 >> v1:172.21.15.63:6789/0 conn(0x7fd760145b70 legacy=0x7fd760140410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:13.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd744004bf0 0x7fd744004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:13.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd744003b30 0x7fd744003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:13.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd744004410 0x7fd74400b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:13.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76013fac0 con 0x7fd744004bf0 2020-05-18T21:28:13.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74400bbc0 con 0x7fd744004410 2020-05-18T21:28:13.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74400bd00 con 0x7fd744003b30 2020-05-18T21:28:13.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75effd700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd744004bf0 0x7fd744004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:13.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75e7fc700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd744003b30 0x7fd744003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:13.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75f7fe700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd744004410 0x7fd74400b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:13.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75effd700 1 -- 172.21.15.63:0/1855154485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd744003b30 msgr2=0x7fd744003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:13.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75effd700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd744003b30 0x7fd744003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:13.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75effd700 1 -- 172.21.15.63:0/1855154485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd744004410 msgr2=0x7fd74400b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:13.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75effd700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd744004410 0x7fd74400b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:13.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75f7fe700 1 -- 172.21.15.63:0/1855154485 reap_dead start 2020-05-18T21:28:13.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75effd700 1 -- 172.21.15.63:0/1855154485 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7601453e0 con 0x7fd744004bf0 2020-05-18T21:28:13.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75ffff700 1 -- 172.21.15.63:0/1855154485 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd760065c00 con 0x7fd744004bf0 2020-05-18T21:28:13.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75ffff700 1 -- 172.21.15.63:0/1855154485 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7601443f0 con 0x7fd744004bf0 2020-05-18T21:28:13.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75effd700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd744004bf0 0x7fd744004ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd7440056d0 tx=0x7fd750010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75effd700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd744004bf0 0x7fd744004ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd7440056d0 tx=0x7fd750010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75effd700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd744004bf0 0x7fd744004ff0 secure :-1 s=READY pgs=503 cs=0 l=1 rx=0x7fd7440056d0 tx=0x7fd750010f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:13.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75effd700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd744004bf0 0x7fd744004ff0 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7fd7440056d0 tx=0x7fd750010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd750006500 con 0x7fd744004bf0 2020-05-18T21:28:13.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75effd700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd744004bf0 0x7fd744004ff0 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7fd7440056d0 tx=0x7fd750010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75effd700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd744004bf0 0x7fd744004ff0 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7fd7440056d0 tx=0x7fd750010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd750006660 con 0x7fd744004bf0 2020-05-18T21:28:13.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd750011950 con 0x7fd744004bf0 2020-05-18T21:28:13.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75effd700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd744004bf0 0x7fd744004ff0 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7fd7440056d0 tx=0x7fd750010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.165+0000 7fd75ffff700 1 -- 172.21.15.63:0/1855154485 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd738003380 con 0x7fd744004bf0 2020-05-18T21:28:13.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.169+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd750011ab0 con 0x7fd744004bf0 2020-05-18T21:28:13.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.169+0000 7fd75effd700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd744004bf0 0x7fd744004ff0 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7fd7440056d0 tx=0x7fd750010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.169+0000 7fd757fff700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd744053b00 0x7fd744055fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:13.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.169+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd750063c40 con 0x7fd744004bf0 2020-05-18T21:28:13.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.169+0000 7fd75e7fc700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd744053b00 0x7fd744055fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:13.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.169+0000 7fd75e7fc700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd744053b00 0x7fd744055fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd748007f10 tx=0x7fd748007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.169+0000 7fd75e7fc700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd744053b00 0x7fd744055fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd748007f10 tx=0x7fd748007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.169+0000 7fd75e7fc700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd744053b00 0x7fd744055fc0 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7fd748007f10 tx=0x7fd748007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:13.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.173+0000 7fd75effd700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd744004bf0 0x7fd744004ff0 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7fd7440056d0 tx=0x7fd750010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.173+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd75003e0b0 con 0x7fd744004bf0 2020-05-18T21:28:13.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.293+0000 7fd75ffff700 1 -- 172.21.15.63:0/1855154485 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd738002240 con 0x7fd744004bf0 2020-05-18T21:28:13.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.293+0000 7fd75effd700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd744004bf0 0x7fd744004ff0 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7fd7440056d0 tx=0x7fd750010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.293+0000 7fd757fff700 1 -- 172.21.15.63:0/1855154485 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd7500416d0 con 0x7fd744004bf0 2020-05-18T21:28:13.299 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:28:13.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.293+0000 7fd75ffff700 1 -- 172.21.15.63:0/1855154485 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd744053b00 msgr2=0x7fd744055fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:13.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.293+0000 7fd75ffff700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd744053b00 0x7fd744055fc0 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7fd748007f10 tx=0x7fd748007a80).stop 2020-05-18T21:28:13.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.293+0000 7fd75ffff700 1 -- 172.21.15.63:0/1855154485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd744004bf0 msgr2=0x7fd744004ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:13.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.293+0000 7fd75ffff700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd744004bf0 0x7fd744004ff0 secure :-1 s=READY pgs=503 cs=0 l=1 rx=0x7fd7440056d0 tx=0x7fd750010f20).stop 2020-05-18T21:28:13.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.293+0000 7fd75ffff700 1 -- 172.21.15.63:0/1855154485 shutdown_connections 2020-05-18T21:28:13.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.293+0000 7fd75ffff700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd744053b00 0x7fd744055fc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:13.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.293+0000 7fd75ffff700 1 --2- 172.21.15.63:0/1855154485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd744004bf0 0x7fd744004ff0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:13.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.293+0000 7fd75ffff700 1 -- 172.21.15.63:0/1855154485 >> 172.21.15.63:0/1855154485 conn(0x7fd76005fb90 msgr2=0x7fd7600b6100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:13.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.293+0000 7fd75ffff700 1 -- 172.21.15.63:0/1855154485 shutdown_connections 2020-05-18T21:28:13.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.293+0000 7fd75ffff700 1 -- 172.21.15.63:0/1855154485 wait complete. 2020-05-18T21:28:13.311 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:28:13.312 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:28:13.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.409+0000 7fd911ab4700 1 Processor -- start 2020-05-18T21:28:13.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.409+0000 7fd911ab4700 1 -- start start 2020-05-18T21:28:13.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.409+0000 7fd911ab4700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd90c0632f0 0x7fd90c142190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:13.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.409+0000 7fd911ab4700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd90c145790 con 0x7fd90c0b45f0 2020-05-18T21:28:13.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.409+0000 7fd911ab4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd90c145a30 con 0x7fd90c0658a0 2020-05-18T21:28:13.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.409+0000 7fd911ab4700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c065c80 con 0x7fd90c0632f0 2020-05-18T21:28:13.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.409+0000 7fd90bfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd90c0b45f0 0x7fd90c145ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57216/0 (socket says 172.21.15.63:57216) 2020-05-18T21:28:13.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.409+0000 7fd90bfff700 1 -- 172.21.15.63:0/162096435 learned_addr learned my addr 172.21.15.63:0/162096435 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:13.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.409+0000 7fd9112b3700 1 --2- 172.21.15.63:0/162096435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd90c0632f0 0x7fd90c142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:13.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd90b7fe700 1 -- 172.21.15.63:0/162096435 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30204473 0 0) 0x7fd90c145790 con 0x7fd90c0b45f0 2020-05-18T21:28:13.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd90b7fe700 1 -- 172.21.15.63:0/162096435 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8f0003270 con 0x7fd90c0b45f0 2020-05-18T21:28:13.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd90b7fe700 1 -- 172.21.15.63:0/162096435 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872981580 0 0) 0x7fd90c145a30 con 0x7fd90c0658a0 2020-05-18T21:28:13.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd90b7fe700 1 -- 172.21.15.63:0/162096435 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd90c145790 con 0x7fd90c0658a0 2020-05-18T21:28:13.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd9112b3700 1 -- 172.21.15.63:0/162096435 >> v1:172.21.15.155:6789/0 conn(0x7fd90c0658a0 legacy=0x7fd90c0b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:13.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd9112b3700 1 -- 172.21.15.63:0/162096435 >> v1:172.21.15.63:6789/0 conn(0x7fd90c0b45f0 legacy=0x7fd90c145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:13.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd9112b3700 1 -- 172.21.15.63:0/162096435 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c0b8910 con 0x7fd90c0632f0 2020-05-18T21:28:13.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd9112b3700 1 --2- 172.21.15.63:0/162096435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd90c0632f0 0x7fd90c142190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd9040032f0 tx=0x7fd904008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd9112b3700 1 --2- 172.21.15.63:0/162096435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd90c0632f0 0x7fd90c142190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd9040032f0 tx=0x7fd904008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd9112b3700 1 --2- 172.21.15.63:0/162096435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd90c0632f0 0x7fd90c142190 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7fd9040032f0 tx=0x7fd904008ca0).ready entity=mon.2 client_cookie=98ebe1ede8ce8133 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:13.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd9112b3700 1 --2- 172.21.15.63:0/162096435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd90c0632f0 0x7fd90c142190 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fd9040032f0 tx=0x7fd904008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd90b7fe700 1 -- 172.21.15.63:0/162096435 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd904011df0 con 0x7fd90c0632f0 2020-05-18T21:28:13.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd9112b3700 1 --2- 172.21.15.63:0/162096435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd90c0632f0 0x7fd90c142190 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fd9040032f0 tx=0x7fd904008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd90b7fe700 1 -- 172.21.15.63:0/162096435 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90400a180 con 0x7fd90c0632f0 2020-05-18T21:28:13.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd9112b3700 1 --2- 172.21.15.63:0/162096435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd90c0632f0 0x7fd90c142190 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fd9040032f0 tx=0x7fd904008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd90b7fe700 1 -- 172.21.15.63:0/162096435 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd90400a4e0 con 0x7fd90c0632f0 2020-05-18T21:28:13.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd911ab4700 1 -- 172.21.15.63:0/162096435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd90c0632f0 msgr2=0x7fd90c142190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:13.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd911ab4700 1 --2- 172.21.15.63:0/162096435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd90c0632f0 0x7fd90c142190 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7fd9040032f0 tx=0x7fd904008ca0).stop 2020-05-18T21:28:13.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd911ab4700 1 -- 172.21.15.63:0/162096435 shutdown_connections 2020-05-18T21:28:13.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd911ab4700 1 --2- 172.21.15.63:0/162096435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd90c0632f0 0x7fd90c142190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:13.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd911ab4700 1 -- 172.21.15.63:0/162096435 >> 172.21.15.63:0/162096435 conn(0x7fd90c069fc0 msgr2=0x7fd90c06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:13.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd911ab4700 1 -- 172.21.15.63:0/162096435 shutdown_connections 2020-05-18T21:28:13.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd911ab4700 1 -- 172.21.15.63:0/162096435 wait complete. 2020-05-18T21:28:13.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd911ab4700 1 Processor -- start 2020-05-18T21:28:13.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.413+0000 7fd911ab4700 1 -- start start 2020-05-18T21:28:13.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd911ab4700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd90c0632f0 0x7fd90c13bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:13.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd911ab4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd90c0658a0 0x7fd90c1411f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:13.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd911ab4700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd90c13c350 con 0x7fd90c0b45f0 2020-05-18T21:28:13.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd911ab4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd90c141b70 con 0x7fd90c0658a0 2020-05-18T21:28:13.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd911ab4700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c13c8b0 con 0x7fd90c0632f0 2020-05-18T21:28:13.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd90bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd90c0658a0 0x7fd90c1411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:13.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd9112b3700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd90c0b45f0 0x7fd90c12f790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57226/0 (socket says 172.21.15.63:57226) 2020-05-18T21:28:13.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd9112b3700 1 -- 172.21.15.63:0/2516790864 learned_addr learned my addr 172.21.15.63:0/2516790864 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:13.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd910ab2700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd90c0632f0 0x7fd90c13bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:13.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd909ffb700 1 -- 172.21.15.63:0/2516790864 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465189785 0 0) 0x7fd90c13c350 con 0x7fd90c0b45f0 2020-05-18T21:28:13.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd909ffb700 1 -- 172.21.15.63:0/2516790864 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8f4002fe0 con 0x7fd90c0b45f0 2020-05-18T21:28:13.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd90bfff700 1 -- 172.21.15.63:0/2516790864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd90c0632f0 msgr2=0x7fd90c13bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:13.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd90bfff700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd90c0632f0 0x7fd90c13bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:13.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd90bfff700 1 -- 172.21.15.63:0/2516790864 >> v1:172.21.15.63:6789/0 conn(0x7fd90c0b45f0 legacy=0x7fd90c12f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:13.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd90bfff700 1 -- 172.21.15.63:0/2516790864 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c13cb50 con 0x7fd90c0658a0 2020-05-18T21:28:13.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd90bfff700 1 --2- 172.21.15.63:0/2516790864 >> v2:172.21.15.63:3300/0 conn(0x7fd90c0658a0 0x7fd90c1411f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd8f8001110 tx=0x7fd8f8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd90bfff700 1 --2- 172.21.15.63:0/2516790864 >> v2:172.21.15.63:3300/0 conn(0x7fd90c0658a0 0x7fd90c1411f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd8f8001110 tx=0x7fd8f8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd90bfff700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0658a0 0x7fd90c1411f0 secure :-1 s=READY pgs=506 cs=0 l=1 rx=0x7fd8f8001110 tx=0x7fd8f8010930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:13.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd90bfff700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0658a0 0x7fd90c1411f0 secure :-1 s=THROTTLE_DONE pgs=506 cs=0 l=1 rx=0x7fd8f8001110 tx=0x7fd8f8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd909ffb700 1 -- 172.21.15.63:0/2516790864 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8f8005d00 con 0x7fd90c0658a0 2020-05-18T21:28:13.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd90bfff700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0658a0 0x7fd90c1411f0 secure :-1 s=THROTTLE_DONE pgs=506 cs=0 l=1 rx=0x7fd8f8001110 tx=0x7fd8f8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd90bfff700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0658a0 0x7fd90c1411f0 secure :-1 s=THROTTLE_DONE pgs=506 cs=0 l=1 rx=0x7fd8f8001110 tx=0x7fd8f8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd909ffb700 1 -- 172.21.15.63:0/2516790864 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f8005e60 con 0x7fd90c0658a0 2020-05-18T21:28:13.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd911ab4700 1 -- 172.21.15.63:0/2516790864 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90c1322e0 con 0x7fd90c0658a0 2020-05-18T21:28:13.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd909ffb700 1 -- 172.21.15.63:0/2516790864 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8f80062c0 con 0x7fd90c0658a0 2020-05-18T21:28:13.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd911ab4700 1 -- 172.21.15.63:0/2516790864 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90c141650 con 0x7fd90c0658a0 2020-05-18T21:28:13.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.417+0000 7fd90bfff700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0658a0 0x7fd90c1411f0 secure :-1 s=THROTTLE_DONE pgs=506 cs=0 l=1 rx=0x7fd8f8001110 tx=0x7fd8f8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.421+0000 7fd911ab4700 1 -- 172.21.15.63:0/2516790864 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd90c141960 con 0x7fd90c0658a0 2020-05-18T21:28:13.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.421+0000 7fd909ffb700 1 -- 172.21.15.63:0/2516790864 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd8f8006530 con 0x7fd90c0658a0 2020-05-18T21:28:13.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.421+0000 7fd90bfff700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0658a0 0x7fd90c1411f0 secure :-1 s=THROTTLE_DONE pgs=506 cs=0 l=1 rx=0x7fd8f8001110 tx=0x7fd8f8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.421+0000 7fd909ffb700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd8f404fd50 0x7fd8f4052210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:13.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.421+0000 7fd909ffb700 1 -- 172.21.15.63:0/2516790864 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd8f80090c0 con 0x7fd90c0658a0 2020-05-18T21:28:13.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.421+0000 7fd910ab2700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd8f404fd50 0x7fd8f4052210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:13.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.421+0000 7fd910ab2700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd8f404fd50 0x7fd8f4052210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd900001110 tx=0x7fd9000010b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.421+0000 7fd910ab2700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd8f404fd50 0x7fd8f4052210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd900001110 tx=0x7fd9000010b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.421+0000 7fd910ab2700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd8f404fd50 0x7fd8f4052210 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7fd900001110 tx=0x7fd9000010b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:13.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.425+0000 7fd90bfff700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0658a0 0x7fd90c1411f0 secure :-1 s=THROTTLE_DONE pgs=506 cs=0 l=1 rx=0x7fd8f8001110 tx=0x7fd8f8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.425+0000 7fd909ffb700 1 -- 172.21.15.63:0/2516790864 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd8f803dff0 con 0x7fd90c0658a0 2020-05-18T21:28:13.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.573+0000 7fd911ab4700 1 -- 172.21.15.63:0/2516790864 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd90c0569e0 con 0x7fd90c0658a0 2020-05-18T21:28:13.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.577+0000 7fd90bfff700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0658a0 0x7fd90c1411f0 secure :-1 s=THROTTLE_DONE pgs=506 cs=0 l=1 rx=0x7fd8f8001110 tx=0x7fd8f8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:13.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.577+0000 7fd909ffb700 1 -- 172.21.15.63:0/2516790864 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+2138 (secure 0 0 0) 0x7fd8f8041610 con 0x7fd90c0658a0 2020-05-18T21:28:13.583 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:13.584 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593103128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593103128},{"type":"v1","addr":"172.21.15.155:6835","nonce":593103128}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:28:08.611856+0000","modified":"2020-05-18T21:28:09.616560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/3182633142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3182633142},{"type":"v1","addr":"172.21.15.63:6833","nonce":3182633142}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-05-18T21:28:13.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.577+0000 7fd911ab4700 1 -- 172.21.15.63:0/2516790864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd8f404fd50 msgr2=0x7fd8f4052210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:13.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.577+0000 7fd911ab4700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd8f404fd50 0x7fd8f4052210 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7fd900001110 tx=0x7fd9000010b0).stop 2020-05-18T21:28:13.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.577+0000 7fd911ab4700 1 -- 172.21.15.63:0/2516790864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0658a0 msgr2=0x7fd90c1411f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:13.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.577+0000 7fd911ab4700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0658a0 0x7fd90c1411f0 secure :-1 s=READY pgs=506 cs=0 l=1 rx=0x7fd8f8001110 tx=0x7fd8f8010930).stop 2020-05-18T21:28:13.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.577+0000 7fd911ab4700 1 -- 172.21.15.63:0/2516790864 shutdown_connections 2020-05-18T21:28:13.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.577+0000 7fd911ab4700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd8f404fd50 0x7fd8f4052210 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:13.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.577+0000 7fd911ab4700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0658a0 0x7fd90c1411f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:13.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.577+0000 7fd911ab4700 1 --2- 172.21.15.63:0/2516790864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd90c0632f0 0x7fd90c13bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:13.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.577+0000 7fd911ab4700 1 -- 172.21.15.63:0/2516790864 >> 172.21.15.63:0/2516790864 conn(0x7fd90c069fc0 msgr2=0x7fd90c0b8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:13.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.577+0000 7fd911ab4700 1 -- 172.21.15.63:0/2516790864 shutdown_connections 2020-05-18T21:28:13.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:13.577+0000 7fd911ab4700 1 -- 172.21.15.63:0/2516790864 wait complete. 2020-05-18T21:28:13.588 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2020-05-18T21:28:13.800 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:28:08.611856+0000', 'modified': '2020-05-18T21:28:09.616560+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5413}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5413': {'gid': 5413, 'name': 'a', 'rank': 0, 'incarnation': 16, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/3182633142', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 3182633142}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 3182633142}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:28:13.800 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:28:13.801 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:28:13.909 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:28:13.909 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:28:13.909 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:28:13.909 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 5413, 2020-05-18T21:28:13.910 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:28:13.910 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:28:13.910 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 5.2892740829999996, 2020-05-18T21:28:13.910 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 17, 2020-05-18T21:28:13.910 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 41, 2020-05-18T21:28:13.911 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 41, 2020-05-18T21:28:13.911 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 9.5062593559999993 2020-05-18T21:28:13.911 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:28:13.918 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 5413, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.2892740829999996, "mdsmap_epoch": 17, "osdmap_epoch": 41, "osdmap_epoch_barrier": 41, "uptime": 9.5062593559999993 } 2020-05-18T21:28:13.918 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:28:13.919 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:28:13.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:13.920 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:28:13.927 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:28:13.928 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:28:13.928 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:28:13.928 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:13.928 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:28:13.929 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:13.929 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:13.929 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:13.929 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:13.929 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:13.930 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:13.930 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:13.930 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:28:13.930 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:13.930 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:28:13.931 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42749sec preferred_lft 42749sec 2020-05-18T21:28:13.931 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:28:13.931 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:13.931 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:28:13.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:13.932 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:28:13.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:13.949 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:28:13.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:13.965 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:28:14.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:14.026 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:28:14.038 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:28:14.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:14.040 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:28:14.047 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:28:14.048 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:28:14.048 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:28:14.048 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:28:14.048 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:28:14.049 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:28:14.049 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:28:14.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:14.050 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:28:14.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:14.067 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:28:14.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:14.131 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:28:14.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:14.146 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:28:14.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:14.152 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:28:14.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:14.159 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:28:14.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:14.221 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-05-18T21:28:14.237 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-05-18T21:28:14.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:14.238 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-05-18T21:28:14.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:14.254 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:28:14.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:14.318 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-05-18T21:28:14.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:14.333 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-05-18T21:28:14.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:14.349 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-05-18T21:28:14.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:14.409 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 up' 2020-05-18T21:28:14.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:14.424 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.0 master ceph-brx' 2020-05-18T21:28:14.438 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-05-18T21:28:14.438 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-05-18T21:28:14.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:14.439 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:14.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:14.489 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:28:14.504 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:28:14.505 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:28:14.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:14.506 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:28:14.512 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:28:14.512 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:14.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:14.556 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:28:14.577 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:28:14.577 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:28:14.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:14.578 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:28:14.642 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2020-05-18T21:28:14.633+0000 7f48a7cc6080 -1 init, newargv = 0x55a367386530 newargc=9ceph-fuse[19120]: starting ceph client 2020-05-18T21:28:14.642 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr: 2020-05-18T21:28:14.652 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[19120]: starting fuse 2020-05-18T21:28:15.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:15.686 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:28:15.704 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:28:15.706 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:28:15.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:15.707 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:28:15.714 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:28:15.715 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:28:15.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:15.716 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:28:15.716 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:28:15.716 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:28:15.717 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:28:15.717 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:28:15.718 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:28:15.718 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:28:15.719 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:28:15.719 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:28:15.719 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:28:15.720 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:28:15.720 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:28:15.721 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:28:15.721 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:28:15.722 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:28:15.722 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:28:15.722 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:28:15.723 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:28:15.723 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:28:15.724 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:28:15.724 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:28:15.724 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:28:15.725 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:28:15.772 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.19120.asok 2020-05-18T21:28:15.777 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.19120.asok 2020-05-18T21:28:15.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:15.778 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.19120.asok status 2020-05-18T21:28:15.864 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:28:15.865 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:28:15.865 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:28:15.866 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:28:15.866 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:28:15.867 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:28:15.867 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:28:15.867 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "19120", 2020-05-18T21:28:15.868 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:28:15.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:15.868 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:28:15.868 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:28:15.868 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 5661, 2020-05-18T21:28:15.869 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:28:15.869 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:28:15.869 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:28:15.869 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 5661 2020-05-18T21:28:15.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:15.870 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:28:15.870 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:15.870 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:28:15.870 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2883419836 2020-05-18T21:28:15.871 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:15.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:15.871 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:28:15.871 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:15.871 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:28:15.872 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2883419836 2020-05-18T21:28:15.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:15.872 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.5661 192.168.0.1:0/2883419836", 2020-05-18T21:28:15.872 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/2883419836", 2020-05-18T21:28:15.873 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:28:15.873 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 17, 2020-05-18T21:28:15.873 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 41, 2020-05-18T21:28:15.873 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:28:15.873 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:28:15.874 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:28:15.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:15.875 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:28:15.876 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:15.883 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:28:15.884 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-05-18T21:28:15.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:15.885 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:15.902 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:28:16.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.001+0000 7ff7affff700 1 Processor -- start 2020-05-18T21:28:16.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.001+0000 7ff7affff700 1 -- start start 2020-05-18T21:28:16.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.001+0000 7ff7affff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff7b00b6e80 0x7ff7b014e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:16.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.001+0000 7ff7affff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff7b00628e0 0x7ff7b0062d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:16.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.001+0000 7ff7affff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b014d980 con 0x7ff7b00b7260 2020-05-18T21:28:16.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.001+0000 7ff7affff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b014d7a0 con 0x7ff7b00b6e80 2020-05-18T21:28:16.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.001+0000 7ff7affff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b014dc20 con 0x7ff7b00628e0 2020-05-18T21:28:16.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.001+0000 7ff7aeffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff7b00b6e80 0x7ff7b014e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:16.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.001+0000 7ff7aeffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff7b00b6e80 0x7ff7b014e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55060/0 (socket says 172.21.15.63:55060) 2020-05-18T21:28:16.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.001+0000 7ff7aeffd700 1 -- 172.21.15.63:0/3000177642 learned_addr learned my addr 172.21.15.63:0/3000177642 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:16.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.001+0000 7ff7af7fe700 1 --2- 172.21.15.63:0/3000177642 >> v2:172.21.15.155:3300/0 conn(0x7ff7b00628e0 0x7ff7b0062d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:16.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7aeffd700 1 -- 172.21.15.63:0/3000177642 >> v2:172.21.15.155:3300/0 conn(0x7ff7b00628e0 msgr2=0x7ff7b0062d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:16.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7aeffd700 1 --2- 172.21.15.63:0/3000177642 >> v2:172.21.15.155:3300/0 conn(0x7ff7b00628e0 0x7ff7b0062d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:16.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7aeffd700 1 -- 172.21.15.63:0/3000177642 >> v1:172.21.15.155:6789/0 conn(0x7ff7b00b7260 legacy=0x7ff7b014ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:16.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7aeffd700 1 -- 172.21.15.63:0/3000177642 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b014dec0 con 0x7ff7b00b6e80 2020-05-18T21:28:16.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7aeffd700 1 --2- 172.21.15.63:0/3000177642 >> v2:172.21.15.63:3300/0 conn(0x7ff7b00b6e80 0x7ff7b014e360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff7a0002f70 tx=0x7ff7b0066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:16.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7aeffd700 1 --2- 172.21.15.63:0/3000177642 >> v2:172.21.15.63:3300/0 conn(0x7ff7b00b6e80 0x7ff7b014e360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff7a0002f70 tx=0x7ff7b0066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:16.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7aeffd700 1 --2- 172.21.15.63:0/3000177642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7b00b6e80 0x7ff7b014e360 secure :-1 s=READY pgs=509 cs=0 l=1 rx=0x7ff7a0002f70 tx=0x7ff7b0066620).ready entity=mon.0 client_cookie=630b52d7ecabe6a1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:16.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7aeffd700 1 --2- 172.21.15.63:0/3000177642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7b00b6e80 0x7ff7b014e360 secure :-1 s=THROTTLE_DONE pgs=509 cs=0 l=1 rx=0x7ff7a0002f70 tx=0x7ff7b0066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:16.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7adffb700 1 -- 172.21.15.63:0/3000177642 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7a0008e50 con 0x7ff7b00b6e80 2020-05-18T21:28:16.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7aeffd700 1 --2- 172.21.15.63:0/3000177642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7b00b6e80 0x7ff7b014e360 secure :-1 s=THROTTLE_DONE pgs=509 cs=0 l=1 rx=0x7ff7a0002f70 tx=0x7ff7b0066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:16.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7adffb700 1 -- 172.21.15.63:0/3000177642 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a0010750 con 0x7ff7b00b6e80 2020-05-18T21:28:16.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7aeffd700 1 --2- 172.21.15.63:0/3000177642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7b00b6e80 0x7ff7b014e360 secure :-1 s=THROTTLE_DONE pgs=509 cs=0 l=1 rx=0x7ff7a0002f70 tx=0x7ff7b0066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:16.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7adffb700 1 -- 172.21.15.63:0/3000177642 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7a0010b70 con 0x7ff7b00b6e80 2020-05-18T21:28:16.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7affff700 1 -- 172.21.15.63:0/3000177642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7b00b6e80 msgr2=0x7ff7b014e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:16.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7affff700 1 --2- 172.21.15.63:0/3000177642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7b00b6e80 0x7ff7b014e360 secure :-1 s=READY pgs=509 cs=0 l=1 rx=0x7ff7a0002f70 tx=0x7ff7b0066620).stop 2020-05-18T21:28:16.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7affff700 1 -- 172.21.15.63:0/3000177642 shutdown_connections 2020-05-18T21:28:16.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7affff700 1 --2- 172.21.15.63:0/3000177642 >> v2:172.21.15.155:3300/0 conn(0x7ff7b00628e0 0x7ff7b0062d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:16.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7affff700 1 --2- 172.21.15.63:0/3000177642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7b00b6e80 0x7ff7b014e360 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:16.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7affff700 1 -- 172.21.15.63:0/3000177642 >> 172.21.15.63:0/3000177642 conn(0x7ff7b005eee0 msgr2=0x7ff7b005f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:16.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7affff700 1 -- 172.21.15.63:0/3000177642 shutdown_connections 2020-05-18T21:28:16.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7affff700 1 -- 172.21.15.63:0/3000177642 wait complete. 2020-05-18T21:28:16.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7affff700 1 Processor -- start 2020-05-18T21:28:16.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.005+0000 7ff7affff700 1 -- start start 2020-05-18T21:28:16.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7affff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b00628e0 0x7ff7b0148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:16.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7affff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff7b00b6e80 0x7ff7b0147340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:16.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7affff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff7b00b7260 0x7ff7b0147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:16.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7affff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b0148390 con 0x7ff7b00b6e80 2020-05-18T21:28:16.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7affff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b0148630 con 0x7ff7b00b7260 2020-05-18T21:28:16.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7affff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b01488d0 con 0x7ff7b00628e0 2020-05-18T21:28:16.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7ae7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff7b00b6e80 0x7ff7b0147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:16.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7ae7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff7b00b6e80 0x7ff7b0147340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55064/0 (socket says 172.21.15.63:55064) 2020-05-18T21:28:16.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7ae7fc700 1 -- 172.21.15.63:0/675457507 learned_addr learned my addr 172.21.15.63:0/675457507 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:16.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7af7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff7b00b7260 0x7ff7b0147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:16.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7aeffd700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b00628e0 0x7ff7b0148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:16.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7af7fe700 1 -- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b00628e0 msgr2=0x7ff7b0148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:16.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7af7fe700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b00628e0 0x7ff7b0148d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:16.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7af7fe700 1 -- 172.21.15.63:0/675457507 >> v2:172.21.15.63:3300/0 conn(0x7ff7b00b6e80 msgr2=0x7ff7b0147340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:16.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7af7fe700 1 --2- 172.21.15.63:0/675457507 >> v2:172.21.15.63:3300/0 conn(0x7ff7b00b6e80 0x7ff7b0147340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:16.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7af7fe700 1 -- 172.21.15.63:0/675457507 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b0065010 con 0x7ff7b00b7260 2020-05-18T21:28:16.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7ae7fc700 1 --2- 172.21.15.63:0/675457507 >> v2:172.21.15.63:3300/0 conn(0x7ff7b00b6e80 0x7ff7b0147340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:16.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7af7fe700 1 --2- 172.21.15.63:0/675457507 >> v2:172.21.15.155:3300/0 conn(0x7ff7b00b7260 0x7ff7b0147d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7a80032f0 tx=0x7ff7a8010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:16.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7af7fe700 1 --2- 172.21.15.63:0/675457507 >> v2:172.21.15.155:3300/0 conn(0x7ff7b00b7260 0x7ff7b0147d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7a80032f0 tx=0x7ff7a8010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:16.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7af7fe700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b00b7260 0x7ff7b0147d60 secure :-1 s=READY pgs=367 cs=0 l=1 rx=0x7ff7a80032f0 tx=0x7ff7a8010f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:16.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7af7fe700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b00b7260 0x7ff7b0147d60 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7ff7a80032f0 tx=0x7ff7a8010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:16.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7a7fff700 1 -- 172.21.15.63:0/675457507 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7a8005a80 con 0x7ff7b00b7260 2020-05-18T21:28:16.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7af7fe700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b00b7260 0x7ff7b0147d60 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7ff7a80032f0 tx=0x7ff7a8010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:16.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7af7fe700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b00b7260 0x7ff7b0147d60 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7ff7a80032f0 tx=0x7ff7a8010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:16.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7a7fff700 1 -- 172.21.15.63:0/675457507 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a8005be0 con 0x7ff7b00b7260 2020-05-18T21:28:16.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7affff700 1 -- 172.21.15.63:0/675457507 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b0065260 con 0x7ff7b00b7260 2020-05-18T21:28:16.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7a7fff700 1 -- 172.21.15.63:0/675457507 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7a800c940 con 0x7ff7b00b7260 2020-05-18T21:28:16.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7affff700 1 -- 172.21.15.63:0/675457507 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b01435a0 con 0x7ff7b00b7260 2020-05-18T21:28:16.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7affff700 1 -- 172.21.15.63:0/675457507 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b01481c0 con 0x7ff7b00b7260 2020-05-18T21:28:16.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.009+0000 7ff7af7fe700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b00b7260 0x7ff7b0147d60 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7ff7a80032f0 tx=0x7ff7a8010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:16.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.013+0000 7ff7a7fff700 1 -- 172.21.15.63:0/675457507 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff7a80101b0 con 0x7ff7b00b7260 2020-05-18T21:28:16.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.013+0000 7ff7af7fe700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b00b7260 0x7ff7b0147d60 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7ff7a80032f0 tx=0x7ff7a8010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:16.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.013+0000 7ff7a7fff700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff78804fac0 0x7ff788051f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:16.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.013+0000 7ff7a7fff700 1 -- 172.21.15.63:0/675457507 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff7a8063b60 con 0x7ff7b00b7260 2020-05-18T21:28:16.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.013+0000 7ff7aeffd700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff78804fac0 0x7ff788051f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:16.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.013+0000 7ff7aeffd700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff78804fac0 0x7ff788051f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7a0002f70 tx=0x7ff7b0066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:16.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.013+0000 7ff7aeffd700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff78804fac0 0x7ff788051f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7a0002f70 tx=0x7ff7b0066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:16.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.013+0000 7ff7aeffd700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff78804fac0 0x7ff788051f80 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7ff7a0002f70 tx=0x7ff7b0066620).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:16.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.017+0000 7ff7af7fe700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b00b7260 0x7ff7b0147d60 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7ff7a80032f0 tx=0x7ff7a8010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:16.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.017+0000 7ff7a7fff700 1 -- 172.21.15.63:0/675457507 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff7a803df50 con 0x7ff7b00b7260 2020-05-18T21:28:16.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.169+0000 7ff7affff700 1 -- 172.21.15.63:0/675457507 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7b00569e0 con 0x7ff7b00b7260 2020-05-18T21:28:16.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.169+0000 7ff7af7fe700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b00b7260 0x7ff7b0147d60 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7ff7a80032f0 tx=0x7ff7a8010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:16.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.169+0000 7ff7a7fff700 1 -- 172.21.15.63:0/675457507 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+2138 (secure 0 0 0) 0x7ff7a8041570 con 0x7ff7b00b7260 2020-05-18T21:28:16.176 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:16.176 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593103128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593103128},{"type":"v1","addr":"172.21.15.155:6835","nonce":593103128}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:28:08.611856+0000","modified":"2020-05-18T21:28:09.616560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/3182633142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3182633142},{"type":"v1","addr":"172.21.15.63:6833","nonce":3182633142}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-05-18T21:28:16.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.173+0000 7ff7affff700 1 -- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff78804fac0 msgr2=0x7ff788051f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:16.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.173+0000 7ff7affff700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff78804fac0 0x7ff788051f80 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7ff7a0002f70 tx=0x7ff7b0066620).stop 2020-05-18T21:28:16.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.173+0000 7ff7affff700 1 -- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b00b7260 msgr2=0x7ff7b0147d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:16.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.173+0000 7ff7affff700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b00b7260 0x7ff7b0147d60 secure :-1 s=READY pgs=367 cs=0 l=1 rx=0x7ff7a80032f0 tx=0x7ff7a8010f00).stop 2020-05-18T21:28:16.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.173+0000 7ff7affff700 1 -- 172.21.15.63:0/675457507 shutdown_connections 2020-05-18T21:28:16.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.173+0000 7ff7affff700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff78804fac0 0x7ff788051f80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:16.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.173+0000 7ff7affff700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b00b7260 0x7ff7b0147d60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:16.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.173+0000 7ff7affff700 1 --2- 172.21.15.63:0/675457507 >> v2:172.21.15.63:3300/0 conn(0x7ff7b00b6e80 0x7ff7b0147340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:16.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.173+0000 7ff7affff700 1 --2- 172.21.15.63:0/675457507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b00628e0 0x7ff7b0148d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:16.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.173+0000 7ff7affff700 1 -- 172.21.15.63:0/675457507 >> 172.21.15.63:0/675457507 conn(0x7ff7b005eee0 msgr2=0x7ff7b0060ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:16.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.173+0000 7ff7affff700 1 -- 172.21.15.63:0/675457507 shutdown_connections 2020-05-18T21:28:16.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:16.173+0000 7ff7affff700 1 -- 172.21.15.63:0/675457507 wait complete. 2020-05-18T21:28:16.181 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2020-05-18T21:28:16.189 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config set mds_bal_fragment_size_max 50 2020-05-18T21:28:16.280 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:28:16.280 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "mds_bal_fragment_size_max = '50' (not observed, change may require restart) " 2020-05-18T21:28:16.281 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:28:16.293 INFO:tasks.cephfs.filesystem:_json_asok output: { "success": "mds_bal_fragment_size_max = '50' (not observed, change may require restart) " } 2020-05-18T21:28:16.294 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:28:16.295 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:28:16.296 INFO:teuthology.orchestra.run.smithi063:> path = os.path.join("/home/ubuntu/cephtest/mnt.0", "subdir") 2020-05-18T21:28:16.296 INFO:teuthology.orchestra.run.smithi063:> os.mkdir(path) 2020-05-18T21:28:16.297 INFO:teuthology.orchestra.run.smithi063:> for n in range(0, 51): 2020-05-18T21:28:16.297 INFO:teuthology.orchestra.run.smithi063:> with open(os.path.join(path, "%s" % n), '"'"'w'"'"') as f: 2020-05-18T21:28:16.297 INFO:teuthology.orchestra.run.smithi063:> f.write(str(n)) 2020-05-18T21:28:16.298 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:28:16.570 INFO:teuthology.orchestra.run.smithi063.stderr:Traceback (most recent call last): 2020-05-18T21:28:16.571 INFO:teuthology.orchestra.run.smithi063.stderr: File "", line 6, in 2020-05-18T21:28:16.571 INFO:teuthology.orchestra.run.smithi063.stderr:OSError: [Errno 28] No space left on device: '/home/ubuntu/cephtest/mnt.0/subdir/50' 2020-05-18T21:28:16.757 INFO:teuthology.orchestra.run.smithi063.stderr:daemon-helper: command failed with exit status 1 2020-05-18T21:28:16.764 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:28:16.765 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:28:16.766 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:28:16.766 INFO:teuthology.orchestra.run.smithi063:> path = os.path.join("/home/ubuntu/cephtest/mnt.0", "subdir2") 2020-05-18T21:28:16.767 INFO:teuthology.orchestra.run.smithi063:> os.mkdir(path) 2020-05-18T21:28:16.767 INFO:teuthology.orchestra.run.smithi063:> for n in range(0, 50): 2020-05-18T21:28:16.767 INFO:teuthology.orchestra.run.smithi063:> with open(os.path.join(path, "%s" % n), '"'"'w'"'"') as f: 2020-05-18T21:28:16.768 INFO:teuthology.orchestra.run.smithi063:> f.write(str(n)) 2020-05-18T21:28:16.768 INFO:teuthology.orchestra.run.smithi063:> dfd = os.open(path, os.O_DIRECTORY) 2020-05-18T21:28:16.769 INFO:teuthology.orchestra.run.smithi063:> os.fsync(dfd) 2020-05-18T21:28:16.769 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:28:17.037 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:28:17.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.137+0000 7f771a57e700 1 Processor -- start 2020-05-18T21:28:17.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.137+0000 7f771a57e700 1 -- start start 2020-05-18T21:28:17.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.137+0000 7f771a57e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f77140b5ea0 0x7f7714146db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:17.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.137+0000 7f771a57e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f771414a230 0x7f77140b8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:17.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.137+0000 7f771a57e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7714147210 con 0x7f7714069eb0 2020-05-18T21:28:17.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.137+0000 7f771a57e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77141463d0 con 0x7f77140b5ea0 2020-05-18T21:28:17.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.137+0000 7f771a57e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7714146670 con 0x7f771414a230 2020-05-18T21:28:17.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.137+0000 7f77137fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f77140b5ea0 0x7f7714146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:17.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f77137fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f77140b5ea0 0x7f7714146db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55084/0 (socket says 172.21.15.63:55084) 2020-05-18T21:28:17.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f7713fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f7714069eb0 0x7f771412f1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:55586/0 (socket says 172.21.15.63:55586) 2020-05-18T21:28:17.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f77137fe700 1 -- 172.21.15.63:0/3971042232 learned_addr learned my addr 172.21.15.63:0/3971042232 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:17.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f7718b1b700 1 --2- 172.21.15.63:0/3971042232 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f771414a230 0x7f77140b8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:17.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f77137fe700 1 -- 172.21.15.63:0/3971042232 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f771414a230 msgr2=0x7f77140b8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:17.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f77137fe700 1 --2- 172.21.15.63:0/3971042232 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f771414a230 0x7f77140b8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:17.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f7712ffd700 1 -- 172.21.15.63:0/3971042232 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179970039 0 0) 0x7f7714147210 con 0x7f7714069eb0 2020-05-18T21:28:17.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f77137fe700 1 -- 172.21.15.63:0/3971042232 >> v1:172.21.15.155:6789/0 conn(0x7f7714069eb0 legacy=0x7f771412f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:17.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f77137fe700 1 -- 172.21.15.63:0/3971042232 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7714146910 con 0x7f77140b5ea0 2020-05-18T21:28:17.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f77137fe700 1 --2- 172.21.15.63:0/3971042232 >> v2:172.21.15.63:3300/0 conn(0x7f77140b5ea0 0x7f7714146db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7708002f70 tx=0x7f7708007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:17.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f77137fe700 1 --2- 172.21.15.63:0/3971042232 >> v2:172.21.15.63:3300/0 conn(0x7f77140b5ea0 0x7f7714146db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7708002f70 tx=0x7f7708007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:17.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f77137fe700 1 --2- 172.21.15.63:0/3971042232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77140b5ea0 0x7f7714146db0 secure :-1 s=READY pgs=510 cs=0 l=1 rx=0x7f7708002f70 tx=0x7f7708007a80).ready entity=mon.0 client_cookie=8e629efd9fe00b5f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:17.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f77137fe700 1 --2- 172.21.15.63:0/3971042232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77140b5ea0 0x7f7714146db0 secure :-1 s=THROTTLE_DONE pgs=510 cs=0 l=1 rx=0x7f7708002f70 tx=0x7f7708007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:17.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f77137fe700 1 --2- 172.21.15.63:0/3971042232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77140b5ea0 0x7f7714146db0 secure :-1 s=THROTTLE_DONE pgs=510 cs=0 l=1 rx=0x7f7708002f70 tx=0x7f7708007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:17.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f7712ffd700 1 -- 172.21.15.63:0/3971042232 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77080116b0 con 0x7f77140b5ea0 2020-05-18T21:28:17.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f77137fe700 1 --2- 172.21.15.63:0/3971042232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77140b5ea0 0x7f7714146db0 secure :-1 s=THROTTLE_DONE pgs=510 cs=0 l=1 rx=0x7f7708002f70 tx=0x7f7708007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:17.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f7712ffd700 1 -- 172.21.15.63:0/3971042232 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7708011810 con 0x7f77140b5ea0 2020-05-18T21:28:17.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f7712ffd700 1 -- 172.21.15.63:0/3971042232 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7708011bf0 con 0x7f77140b5ea0 2020-05-18T21:28:17.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f771a57e700 1 -- 172.21.15.63:0/3971042232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77140b5ea0 msgr2=0x7f7714146db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:17.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f771a57e700 1 --2- 172.21.15.63:0/3971042232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77140b5ea0 0x7f7714146db0 secure :-1 s=READY pgs=510 cs=0 l=1 rx=0x7f7708002f70 tx=0x7f7708007a80).stop 2020-05-18T21:28:17.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f771a57e700 1 -- 172.21.15.63:0/3971042232 shutdown_connections 2020-05-18T21:28:17.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f771a57e700 1 --2- 172.21.15.63:0/3971042232 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f771414a230 0x7f77140b8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:17.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f771a57e700 1 --2- 172.21.15.63:0/3971042232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77140b5ea0 0x7f7714146db0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:17.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f771a57e700 1 -- 172.21.15.63:0/3971042232 >> 172.21.15.63:0/3971042232 conn(0x7f7714066ed0 msgr2=0x7f77140b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:17.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f771a57e700 1 -- 172.21.15.63:0/3971042232 shutdown_connections 2020-05-18T21:28:17.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.141+0000 7f771a57e700 1 -- 172.21.15.63:0/3971042232 wait complete. 2020-05-18T21:28:17.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f771a57e700 1 Processor -- start 2020-05-18T21:28:17.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f771a57e700 1 -- start start 2020-05-18T21:28:17.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f771a57e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f771414a230 0x7f7714063520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:17.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f771a57e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f771405a810 con 0x7f7714069eb0 2020-05-18T21:28:17.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f771a57e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f771405b700 con 0x7f77140b5ea0 2020-05-18T21:28:17.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f771a57e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771405aa40 con 0x7f771414a230 2020-05-18T21:28:17.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f7713fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7714069eb0 0x7f77140b4e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57276/0 (socket says 172.21.15.63:57276) 2020-05-18T21:28:17.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f7713fff700 1 -- 172.21.15.63:0/2299436870 learned_addr learned my addr 172.21.15.63:0/2299436870 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:17.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f7718b1b700 1 --2- 172.21.15.63:0/2299436870 >> v2:172.21.15.63:3300/0 conn(0x7f771414a230 0x7f7714063520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:17.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f77117fa700 1 -- 172.21.15.63:0/2299436870 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649530344 0 0) 0x7f771405b700 con 0x7f77140b5ea0 2020-05-18T21:28:17.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f77117fa700 1 -- 172.21.15.63:0/2299436870 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76f4002fe0 con 0x7f77140b5ea0 2020-05-18T21:28:17.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f77117fa700 1 -- 172.21.15.63:0/2299436870 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504043477 0 0) 0x7f771405a810 con 0x7f7714069eb0 2020-05-18T21:28:17.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f7718b1b700 1 -- 172.21.15.63:0/2299436870 >> v1:172.21.15.155:6789/0 conn(0x7f77140b5ea0 legacy=0x7f77141452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:17.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f7718b1b700 1 -- 172.21.15.63:0/2299436870 >> v1:172.21.15.63:6789/0 conn(0x7f7714069eb0 legacy=0x7f77140b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:17.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f7718b1b700 1 -- 172.21.15.63:0/2299436870 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771405b990 con 0x7f771414a230 2020-05-18T21:28:17.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f7718b1b700 1 --2- 172.21.15.63:0/2299436870 >> v2:172.21.15.63:3300/0 conn(0x7f771414a230 0x7f7714063520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f770c0032f0 tx=0x7f770c010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:17.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f7718b1b700 1 --2- 172.21.15.63:0/2299436870 >> v2:172.21.15.63:3300/0 conn(0x7f771414a230 0x7f7714063520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f770c0032f0 tx=0x7f770c010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:17.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f7718b1b700 1 --2- 172.21.15.63:0/2299436870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f771414a230 0x7f7714063520 secure :-1 s=READY pgs=512 cs=0 l=1 rx=0x7f770c0032f0 tx=0x7f770c010f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:17.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f7718b1b700 1 --2- 172.21.15.63:0/2299436870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f771414a230 0x7f7714063520 secure :-1 s=THROTTLE_DONE pgs=512 cs=0 l=1 rx=0x7f770c0032f0 tx=0x7f770c010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:17.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f77117fa700 1 -- 172.21.15.63:0/2299436870 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f770c005a80 con 0x7f771414a230 2020-05-18T21:28:17.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f7718b1b700 1 --2- 172.21.15.63:0/2299436870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f771414a230 0x7f7714063520 secure :-1 s=THROTTLE_DONE pgs=512 cs=0 l=1 rx=0x7f770c0032f0 tx=0x7f770c010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:17.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f77117fa700 1 -- 172.21.15.63:0/2299436870 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c005be0 con 0x7f771414a230 2020-05-18T21:28:17.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f7718b1b700 1 --2- 172.21.15.63:0/2299436870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f771414a230 0x7f7714063520 secure :-1 s=THROTTLE_DONE pgs=512 cs=0 l=1 rx=0x7f770c0032f0 tx=0x7f770c010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:17.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f77117fa700 1 -- 172.21.15.63:0/2299436870 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f770c012990 con 0x7f771414a230 2020-05-18T21:28:17.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.145+0000 7f771a57e700 1 -- 172.21.15.63:0/2299436870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771405be30 con 0x7f771414a230 2020-05-18T21:28:17.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.149+0000 7f771a57e700 1 -- 172.21.15.63:0/2299436870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77140b56e0 con 0x7f771414a230 2020-05-18T21:28:17.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.149+0000 7f7718b1b700 1 --2- 172.21.15.63:0/2299436870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f771414a230 0x7f7714063520 secure :-1 s=THROTTLE_DONE pgs=512 cs=0 l=1 rx=0x7f770c0032f0 tx=0x7f770c010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:17.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.149+0000 7f771a57e700 1 -- 172.21.15.63:0/2299436870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7714145cf0 con 0x7f771414a230 2020-05-18T21:28:17.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.149+0000 7f77117fa700 1 -- 172.21.15.63:0/2299436870 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f770c012b90 con 0x7f771414a230 2020-05-18T21:28:17.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.149+0000 7f7718b1b700 1 --2- 172.21.15.63:0/2299436870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f771414a230 0x7f7714063520 secure :-1 s=THROTTLE_DONE pgs=512 cs=0 l=1 rx=0x7f770c0032f0 tx=0x7f770c010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:17.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.149+0000 7f77117fa700 1 --2- 172.21.15.63:0/2299436870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f76f404fce0 0x7f76f40521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:17.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.149+0000 7f77117fa700 1 -- 172.21.15.63:0/2299436870 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f770c063a60 con 0x7f771414a230 2020-05-18T21:28:17.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.149+0000 7f7713fff700 1 --2- 172.21.15.63:0/2299436870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f76f404fce0 0x7f76f40521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:17.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.149+0000 7f7713fff700 1 --2- 172.21.15.63:0/2299436870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f76f404fce0 0x7f76f40521a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7704001190 tx=0x7f7704001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:17.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.149+0000 7f7713fff700 1 --2- 172.21.15.63:0/2299436870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f76f404fce0 0x7f76f40521a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7704001190 tx=0x7f7704001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:17.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.149+0000 7f7713fff700 1 --2- 172.21.15.63:0/2299436870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f76f404fce0 0x7f76f40521a0 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7f7704001190 tx=0x7f7704001810).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:17.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.157+0000 7f7718b1b700 1 --2- 172.21.15.63:0/2299436870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f771414a230 0x7f7714063520 secure :-1 s=THROTTLE_DONE pgs=512 cs=0 l=1 rx=0x7f770c0032f0 tx=0x7f770c010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:17.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.157+0000 7f77117fa700 1 -- 172.21.15.63:0/2299436870 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f7714145cf0 con 0x7f771414a230 2020-05-18T21:28:17.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.305+0000 7f771a57e700 1 -- 172.21.15.63:0/2299436870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7714145cf0 con 0x7f771414a230 2020-05-18T21:28:17.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.305+0000 7f7718b1b700 1 --2- 172.21.15.63:0/2299436870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f771414a230 0x7f7714063520 secure :-1 s=THROTTLE_DONE pgs=512 cs=0 l=1 rx=0x7f770c0032f0 tx=0x7f770c010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:17.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.305+0000 7f77117fa700 1 -- 172.21.15.63:0/2299436870 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+2138 (secure 0 0 0) 0x7f7714145cf0 con 0x7f771414a230 2020-05-18T21:28:17.312 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:17.313 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593103128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593103128},{"type":"v1","addr":"172.21.15.155:6835","nonce":593103128}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:28:08.611856+0000","modified":"2020-05-18T21:28:09.616560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/3182633142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3182633142},{"type":"v1","addr":"172.21.15.63:6833","nonce":3182633142}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-05-18T21:28:17.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.305+0000 7f771a57e700 1 -- 172.21.15.63:0/2299436870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f76f404fce0 msgr2=0x7f76f40521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:17.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.305+0000 7f771a57e700 1 --2- 172.21.15.63:0/2299436870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f76f404fce0 0x7f76f40521a0 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7f7704001190 tx=0x7f7704001810).stop 2020-05-18T21:28:17.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.305+0000 7f771a57e700 1 -- 172.21.15.63:0/2299436870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f771414a230 msgr2=0x7f7714063520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:17.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.305+0000 7f771a57e700 1 --2- 172.21.15.63:0/2299436870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f771414a230 0x7f7714063520 secure :-1 s=READY pgs=512 cs=0 l=1 rx=0x7f770c0032f0 tx=0x7f770c010f00).stop 2020-05-18T21:28:17.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.309+0000 7f771a57e700 1 -- 172.21.15.63:0/2299436870 shutdown_connections 2020-05-18T21:28:17.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.309+0000 7f771a57e700 1 --2- 172.21.15.63:0/2299436870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f76f404fce0 0x7f76f40521a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:17.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.309+0000 7f771a57e700 1 --2- 172.21.15.63:0/2299436870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f771414a230 0x7f7714063520 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:17.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.309+0000 7f771a57e700 1 -- 172.21.15.63:0/2299436870 >> 172.21.15.63:0/2299436870 conn(0x7f7714066ed0 msgr2=0x7f7714062500 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:17.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.309+0000 7f771a57e700 1 -- 172.21.15.63:0/2299436870 shutdown_connections 2020-05-18T21:28:17.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:17.309+0000 7f771a57e700 1 -- 172.21.15.63:0/2299436870 wait complete. 2020-05-18T21:28:17.318 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2020-05-18T21:28:17.329 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok dirfrag split /subdir2 0/0 1 2020-05-18T21:28:17.432 INFO:tasks.cephfs.filesystem:_json_asok output: 2020-05-18T21:28:17.433 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:28:17.433 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:28:17.434 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:17.448 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[19120]: fuse finished with error 0 and tester_r 0 2020-05-18T21:28:17.450 INFO:teuthology.orchestra.run:waiting for 900 2020-05-18T21:28:23.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:23.555 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:23.563 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:28:23.564 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:28:23.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:23.565 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 down' 2020-05-18T21:28:23.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:23.590 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.0' 2020-05-18T21:28:23.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:23.720 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:28:23.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:23.739 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:28:23.745 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:28:23.745 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:28:23.746 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:28:23.746 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:23.746 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:28:23.746 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:23.747 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:23.747 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:23.747 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:23.747 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:23.747 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:23.748 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:23.748 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:28:23.748 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:23.748 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:28:23.748 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42739sec preferred_lft 42739sec 2020-05-18T21:28:23.749 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:28:23.749 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:23.749 INFO:teuthology.orchestra.run.smithi063.stdout:11: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-05-18T21:28:23.749 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:23.750 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:28:23.750 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:23.750 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::c4c4:fff:fed3:1aa2/64 scope link 2020-05-18T21:28:23.750 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:23.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:23.751 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:28:23.767 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:28:23.767 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:28:23.767 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:28:23.768 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:23.768 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:28:23.768 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:23.768 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:28:23.769 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:23.769 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:28:23.769 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:23.769 INFO:teuthology.orchestra.run.smithi063.stdout:11: ceph-brx: mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:28:23.774 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:23.775 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:28:23.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:23.777 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:28:23.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:23.844 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:28:23.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:23.952 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:28:23.963 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:28:23.964 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:28:23.964 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:28:23.964 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:28:23.964 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:28:23.965 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:28:23.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:23.966 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:28:23.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:23.983 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:28:24.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:24.042 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:28:24.059 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush journal 2020-05-18T21:28:24.254 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:28:24.254 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "", 2020-05-18T21:28:24.255 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0 2020-05-18T21:28:24.255 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:28:24.262 INFO:tasks.cephfs.filesystem:_json_asok output: { "message": "", "return_code": 0 } 2020-05-18T21:28:24.263 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:28:24.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.353+0000 7fa62b59e700 1 Processor -- start 2020-05-18T21:28:24.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.353+0000 7fa62b59e700 1 -- start start 2020-05-18T21:28:24.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.353+0000 7fa62b59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa62c0b4760 0x7fa62c0648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:24.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.353+0000 7fa62b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa62c064d20 0x7fa62c14d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:24.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.353+0000 7fa62b59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c14a330 con 0x7fa62c05f110 2020-05-18T21:28:24.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.353+0000 7fa62b59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62c14a140 con 0x7fa62c064d20 2020-05-18T21:28:24.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.353+0000 7fa62b59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62c14a5d0 con 0x7fa62c0b4760 2020-05-18T21:28:24.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.353+0000 7fa62ad9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa62c064d20 0x7fa62c14d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:24.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.353+0000 7fa62ad9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa62c064d20 0x7fa62c14d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55104/0 (socket says 172.21.15.63:55104) 2020-05-18T21:28:24.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.353+0000 7fa62ad9d700 1 -- 172.21.15.63:0/370449587 learned_addr learned my addr 172.21.15.63:0/370449587 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:24.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.353+0000 7fa629d9b700 1 --2- 172.21.15.63:0/370449587 >> v2:172.21.15.155:3300/0 conn(0x7fa62c0b4760 0x7fa62c0648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:24.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.353+0000 7fa62ad9d700 1 -- 172.21.15.63:0/370449587 >> v2:172.21.15.155:3300/0 conn(0x7fa62c0b4760 msgr2=0x7fa62c0648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:24.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.353+0000 7fa62ad9d700 1 --2- 172.21.15.63:0/370449587 >> v2:172.21.15.155:3300/0 conn(0x7fa62c0b4760 0x7fa62c0648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:24.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.353+0000 7fa62ad9d700 1 -- 172.21.15.63:0/370449587 >> v1:172.21.15.155:6789/0 conn(0x7fa62c05f110 legacy=0x7fa62c14aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:24.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.353+0000 7fa62ad9d700 1 -- 172.21.15.63:0/370449587 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c063430 con 0x7fa62c064d20 2020-05-18T21:28:24.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.353+0000 7fa629d9b700 1 --2- 172.21.15.63:0/370449587 >> v2:172.21.15.155:3300/0 conn(0x7fa62c0b4760 0x7fa62c0648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:28:24.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.357+0000 7fa62ad9d700 1 --2- 172.21.15.63:0/370449587 >> v2:172.21.15.63:3300/0 conn(0x7fa62c064d20 0x7fa62c14d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa6240032f0 tx=0x7fa624007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.357+0000 7fa62ad9d700 1 --2- 172.21.15.63:0/370449587 >> v2:172.21.15.63:3300/0 conn(0x7fa62c064d20 0x7fa62c14d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa6240032f0 tx=0x7fa624007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.357+0000 7fa62ad9d700 1 --2- 172.21.15.63:0/370449587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa62c064d20 0x7fa62c14d710 secure :-1 s=READY pgs=513 cs=0 l=1 rx=0x7fa6240032f0 tx=0x7fa624007e00).ready entity=mon.0 client_cookie=345118a09f0bf8db server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:24.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.357+0000 7fa62ad9d700 1 --2- 172.21.15.63:0/370449587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa62c064d20 0x7fa62c14d710 secure :-1 s=THROTTLE_DONE pgs=513 cs=0 l=1 rx=0x7fa6240032f0 tx=0x7fa624007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.357+0000 7fa62ad9d700 1 --2- 172.21.15.63:0/370449587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa62c064d20 0x7fa62c14d710 secure :-1 s=THROTTLE_DONE pgs=513 cs=0 l=1 rx=0x7fa6240032f0 tx=0x7fa624007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.357+0000 7fa62959a700 1 -- 172.21.15.63:0/370449587 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa624011dc0 con 0x7fa62c064d20 2020-05-18T21:28:24.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.357+0000 7fa62ad9d700 1 --2- 172.21.15.63:0/370449587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa62c064d20 0x7fa62c14d710 secure :-1 s=THROTTLE_DONE pgs=513 cs=0 l=1 rx=0x7fa6240032f0 tx=0x7fa624007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.357+0000 7fa62959a700 1 -- 172.21.15.63:0/370449587 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62400a180 con 0x7fa62c064d20 2020-05-18T21:28:24.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.357+0000 7fa62959a700 1 -- 172.21.15.63:0/370449587 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa62400a5a0 con 0x7fa62c064d20 2020-05-18T21:28:24.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.357+0000 7fa62b59e700 1 -- 172.21.15.63:0/370449587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa62c064d20 msgr2=0x7fa62c14d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:24.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.357+0000 7fa62b59e700 1 --2- 172.21.15.63:0/370449587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa62c064d20 0x7fa62c14d710 secure :-1 s=READY pgs=513 cs=0 l=1 rx=0x7fa6240032f0 tx=0x7fa624007e00).stop 2020-05-18T21:28:24.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.357+0000 7fa62b59e700 1 -- 172.21.15.63:0/370449587 shutdown_connections 2020-05-18T21:28:24.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.357+0000 7fa62b59e700 1 --2- 172.21.15.63:0/370449587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa62c064d20 0x7fa62c14d710 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:24.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.357+0000 7fa62b59e700 1 --2- 172.21.15.63:0/370449587 >> v2:172.21.15.155:3300/0 conn(0x7fa62c0b4760 0x7fa62c0648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:24.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.357+0000 7fa62b59e700 1 -- 172.21.15.63:0/370449587 >> 172.21.15.63:0/370449587 conn(0x7fa62c069fc0 msgr2=0x7fa62c06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:24.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.357+0000 7fa62b59e700 1 -- 172.21.15.63:0/370449587 shutdown_connections 2020-05-18T21:28:24.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.357+0000 7fa62b59e700 1 -- 172.21.15.63:0/370449587 wait complete. 2020-05-18T21:28:24.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.357+0000 7fa62b59e700 1 Processor -- start 2020-05-18T21:28:24.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.357+0000 7fa62b59e700 1 -- start start 2020-05-18T21:28:24.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa62c064d20 0x7fa62c0b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:24.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa62c0b4760 0x7fa62c144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:24.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62b59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c147790 con 0x7fa62c05f110 2020-05-18T21:28:24.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62b59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62c1474f0 con 0x7fa62c0b4760 2020-05-18T21:28:24.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c145370 con 0x7fa62c064d20 2020-05-18T21:28:24.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62a59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa62c05f110 0x7fa62c146c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57294/0 (socket says 172.21.15.63:57294) 2020-05-18T21:28:24.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62a59c700 1 -- 172.21.15.63:0/3836579762 learned_addr learned my addr 172.21.15.63:0/3836579762 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:24.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62ad9d700 1 --2- 172.21.15.63:0/3836579762 >> v2:172.21.15.63:3300/0 conn(0x7fa62c0b4760 0x7fa62c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:24.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa629d9b700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa62c064d20 0x7fa62c0b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:24.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa6237fe700 1 -- 172.21.15.63:0/3836579762 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637753697 0 0) 0x7fa62c147790 con 0x7fa62c05f110 2020-05-18T21:28:24.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa6237fe700 1 -- 172.21.15.63:0/3836579762 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa610002fe0 con 0x7fa62c05f110 2020-05-18T21:28:24.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62ad9d700 1 -- 172.21.15.63:0/3836579762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa62c064d20 msgr2=0x7fa62c0b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:24.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62ad9d700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa62c064d20 0x7fa62c0b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:24.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62ad9d700 1 -- 172.21.15.63:0/3836579762 >> v1:172.21.15.63:6789/0 conn(0x7fa62c05f110 legacy=0x7fa62c146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:24.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62ad9d700 1 -- 172.21.15.63:0/3836579762 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c142200 con 0x7fa62c0b4760 2020-05-18T21:28:24.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62ad9d700 1 --2- 172.21.15.63:0/3836579762 >> v2:172.21.15.63:3300/0 conn(0x7fa62c0b4760 0x7fa62c144790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa6240032f0 tx=0x7fa624007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62ad9d700 1 --2- 172.21.15.63:0/3836579762 >> v2:172.21.15.63:3300/0 conn(0x7fa62c0b4760 0x7fa62c144790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa6240032f0 tx=0x7fa624007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62ad9d700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa62c0b4760 0x7fa62c144790 secure :-1 s=READY pgs=515 cs=0 l=1 rx=0x7fa6240032f0 tx=0x7fa624007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:24.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62ad9d700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa62c0b4760 0x7fa62c144790 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7fa6240032f0 tx=0x7fa624007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa6237fe700 1 -- 172.21.15.63:0/3836579762 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa624011e20 con 0x7fa62c0b4760 2020-05-18T21:28:24.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62ad9d700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa62c0b4760 0x7fa62c144790 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7fa6240032f0 tx=0x7fa624007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa6237fe700 1 -- 172.21.15.63:0/3836579762 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa624005a80 con 0x7fa62c0b4760 2020-05-18T21:28:24.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62ad9d700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa62c0b4760 0x7fa62c144790 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7fa6240032f0 tx=0x7fa624007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62b59e700 1 -- 172.21.15.63:0/3836579762 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c142450 con 0x7fa62c0b4760 2020-05-18T21:28:24.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa6237fe700 1 -- 172.21.15.63:0/3836579762 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa624005e60 con 0x7fa62c0b4760 2020-05-18T21:28:24.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.361+0000 7fa62b59e700 1 -- 172.21.15.63:0/3836579762 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c140d20 con 0x7fa62c0b4760 2020-05-18T21:28:24.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.365+0000 7fa62ad9d700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa62c0b4760 0x7fa62c144790 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7fa6240032f0 tx=0x7fa624007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.365+0000 7fa62b59e700 1 -- 172.21.15.63:0/3836579762 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62c0569e0 con 0x7fa62c0b4760 2020-05-18T21:28:24.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.365+0000 7fa6237fe700 1 -- 172.21.15.63:0/3836579762 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa624007170 con 0x7fa62c0b4760 2020-05-18T21:28:24.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.365+0000 7fa62ad9d700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa62c0b4760 0x7fa62c144790 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7fa6240032f0 tx=0x7fa624007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.365+0000 7fa6237fe700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa61004fd30 0x7fa6100521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:24.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.365+0000 7fa6237fe700 1 -- 172.21.15.63:0/3836579762 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa624064800 con 0x7fa62c0b4760 2020-05-18T21:28:24.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.365+0000 7fa62a59c700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa61004fd30 0x7fa6100521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:24.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.365+0000 7fa62a59c700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa61004fd30 0x7fa6100521f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa61c001110 tx=0x7fa61c001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.365+0000 7fa62a59c700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa61004fd30 0x7fa6100521f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa61c001110 tx=0x7fa61c001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.365+0000 7fa62a59c700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa61004fd30 0x7fa6100521f0 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7fa61c001110 tx=0x7fa61c001820).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:24.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.369+0000 7fa62ad9d700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa62c0b4760 0x7fa62c144790 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7fa6240032f0 tx=0x7fa624007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.369+0000 7fa6237fe700 1 -- 172.21.15.63:0/3836579762 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa62403ec50 con 0x7fa62c0b4760 2020-05-18T21:28:24.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.489+0000 7fa62b59e700 1 -- 172.21.15.63:0/3836579762 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa62c0625f0 con 0x7fa62c0b4760 2020-05-18T21:28:24.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.489+0000 7fa62ad9d700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa62c0b4760 0x7fa62c144790 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7fa6240032f0 tx=0x7fa624007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.489+0000 7fa6237fe700 1 -- 172.21.15.63:0/3836579762 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fa624042270 con 0x7fa62c0b4760 2020-05-18T21:28:24.496 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:24.497 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":41,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:28:08.611559+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:28:07.066659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2020-05-18T21:28:07.623692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:28:24.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.493+0000 7fa62b59e700 1 -- 172.21.15.63:0/3836579762 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa61004fd30 msgr2=0x7fa6100521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:24.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.493+0000 7fa62b59e700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa61004fd30 0x7fa6100521f0 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7fa61c001110 tx=0x7fa61c001820).stop 2020-05-18T21:28:24.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.493+0000 7fa62b59e700 1 -- 172.21.15.63:0/3836579762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa62c0b4760 msgr2=0x7fa62c144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:24.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.493+0000 7fa62b59e700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa62c0b4760 0x7fa62c144790 secure :-1 s=READY pgs=515 cs=0 l=1 rx=0x7fa6240032f0 tx=0x7fa624007e00).stop 2020-05-18T21:28:24.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.493+0000 7fa62b59e700 1 -- 172.21.15.63:0/3836579762 shutdown_connections 2020-05-18T21:28:24.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.493+0000 7fa62b59e700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa61004fd30 0x7fa6100521f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:24.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.493+0000 7fa62b59e700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa62c0b4760 0x7fa62c144790 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:24.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.493+0000 7fa62b59e700 1 --2- 172.21.15.63:0/3836579762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa62c064d20 0x7fa62c0b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:24.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.493+0000 7fa62b59e700 1 -- 172.21.15.63:0/3836579762 >> 172.21.15.63:0/3836579762 conn(0x7fa62c069fc0 msgr2=0x7fa62c05c280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:24.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.493+0000 7fa62b59e700 1 -- 172.21.15.63:0/3836579762 shutdown_connections 2020-05-18T21:28:24.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.493+0000 7fa62b59e700 1 -- 172.21.15.63:0/3836579762 wait complete. 2020-05-18T21:28:24.512 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:28:07.066659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:28:07.623692+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:28:24.514 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:28:24.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63999ac700 1 Processor -- start 2020-05-18T21:28:24.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63999ac700 1 -- start start 2020-05-18T21:28:24.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63999ac700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f639405ef00 0x7f6394066ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:24.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63999ac700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6394143870 0x7f639409aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:24.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63999ac700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f639409ae80 con 0x7f639409b2f0 2020-05-18T21:28:24.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63999ac700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6394099da0 con 0x7f639405ef00 2020-05-18T21:28:24.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63999ac700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639409a040 con 0x7f6394143870 2020-05-18T21:28:24.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63989aa700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f639405ef00 0x7f6394066ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:24.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f6393fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f639409b2f0 0x7f6394143160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57302/0 (socket says 172.21.15.63:57302) 2020-05-18T21:28:24.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63989aa700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f639405ef00 0x7f6394066ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55116/0 (socket says 172.21.15.63:55116) 2020-05-18T21:28:24.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f6393fff700 1 -- 172.21.15.63:0/3419890306 learned_addr learned my addr 172.21.15.63:0/3419890306 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:24.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63991ab700 1 --2- 172.21.15.63:0/3419890306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6394143870 0x7f639409aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:24.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63989aa700 1 -- 172.21.15.63:0/3419890306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6394143870 msgr2=0x7f639409aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:24.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63989aa700 1 --2- 172.21.15.63:0/3419890306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6394143870 0x7f639409aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:24.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63989aa700 1 -- 172.21.15.63:0/3419890306 >> v1:172.21.15.63:6789/0 conn(0x7f639409b2f0 legacy=0x7f6394143160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:24.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63989aa700 1 -- 172.21.15.63:0/3419890306 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639409a2e0 con 0x7f639405ef00 2020-05-18T21:28:24.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63991ab700 1 --2- 172.21.15.63:0/3419890306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6394143870 0x7f639409aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:28:24.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63989aa700 1 --2- 172.21.15.63:0/3419890306 >> v2:172.21.15.63:3300/0 conn(0x7f639405ef00 0x7f6394066ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6384002f70 tx=0x7f6384007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63989aa700 1 --2- 172.21.15.63:0/3419890306 >> v2:172.21.15.63:3300/0 conn(0x7f639405ef00 0x7f6394066ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6384002f70 tx=0x7f6384007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63989aa700 1 --2- 172.21.15.63:0/3419890306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f639405ef00 0x7f6394066ef0 secure :-1 s=READY pgs=517 cs=0 l=1 rx=0x7f6384002f70 tx=0x7f6384007a80).ready entity=mon.0 client_cookie=21379f6410a4e447 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:24.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63989aa700 1 --2- 172.21.15.63:0/3419890306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f639405ef00 0x7f6394066ef0 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7f6384002f70 tx=0x7f6384007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63937fe700 1 -- 172.21.15.63:0/3419890306 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6384008e80 con 0x7f639405ef00 2020-05-18T21:28:24.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63989aa700 1 --2- 172.21.15.63:0/3419890306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f639405ef00 0x7f6394066ef0 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7f6384002f70 tx=0x7f6384007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63989aa700 1 --2- 172.21.15.63:0/3419890306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f639405ef00 0x7f6394066ef0 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7f6384002f70 tx=0x7f6384007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63937fe700 1 -- 172.21.15.63:0/3419890306 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63840116a0 con 0x7f639405ef00 2020-05-18T21:28:24.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63937fe700 1 -- 172.21.15.63:0/3419890306 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6384011ac0 con 0x7f639405ef00 2020-05-18T21:28:24.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63999ac700 1 -- 172.21.15.63:0/3419890306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f639405ef00 msgr2=0x7f6394066ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:24.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63999ac700 1 --2- 172.21.15.63:0/3419890306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f639405ef00 0x7f6394066ef0 secure :-1 s=READY pgs=517 cs=0 l=1 rx=0x7f6384002f70 tx=0x7f6384007a80).stop 2020-05-18T21:28:24.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63999ac700 1 -- 172.21.15.63:0/3419890306 shutdown_connections 2020-05-18T21:28:24.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63999ac700 1 --2- 172.21.15.63:0/3419890306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6394143870 0x7f639409aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:24.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63999ac700 1 --2- 172.21.15.63:0/3419890306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f639405ef00 0x7f6394066ef0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:24.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63999ac700 1 -- 172.21.15.63:0/3419890306 >> 172.21.15.63:0/3419890306 conn(0x7f63940b8b10 msgr2=0x7f63940b8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:24.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63999ac700 1 -- 172.21.15.63:0/3419890306 shutdown_connections 2020-05-18T21:28:24.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.617+0000 7f63999ac700 1 -- 172.21.15.63:0/3419890306 wait complete. 2020-05-18T21:28:24.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f63999ac700 1 Processor -- start 2020-05-18T21:28:24.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f63999ac700 1 -- start start 2020-05-18T21:28:24.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f63999ac700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f639405ef00 0x7f63941440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:24.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f63999ac700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f639409b2f0 0x7f639409e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:24.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f63999ac700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63941451b0 con 0x7f6394143870 2020-05-18T21:28:24.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f63999ac700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6394146ba0 con 0x7f639409b2f0 2020-05-18T21:28:24.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f63999ac700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6394145450 con 0x7f639405ef00 2020-05-18T21:28:24.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f6393fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f639409b2f0 0x7f639409e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:24.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f63991ab700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6394143870 0x7f639413ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57312/0 (socket says 172.21.15.63:57312) 2020-05-18T21:28:24.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f63991ab700 1 -- 172.21.15.63:0/1008322847 learned_addr learned my addr 172.21.15.63:0/1008322847 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:24.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f63989aa700 1 --2- 172.21.15.63:0/1008322847 >> v2:172.21.15.155:3300/0 conn(0x7f639405ef00 0x7f63941440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:24.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f6391ffb700 1 -- 172.21.15.63:0/1008322847 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106902832 0 0) 0x7f63941451b0 con 0x7f6394143870 2020-05-18T21:28:24.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f6391ffb700 1 -- 172.21.15.63:0/1008322847 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6378002fe0 con 0x7f6394143870 2020-05-18T21:28:24.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f6393fff700 1 -- 172.21.15.63:0/1008322847 >> v2:172.21.15.155:3300/0 conn(0x7f639405ef00 msgr2=0x7f63941440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:24.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f6393fff700 1 --2- 172.21.15.63:0/1008322847 >> v2:172.21.15.155:3300/0 conn(0x7f639405ef00 0x7f63941440b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:24.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f6393fff700 1 -- 172.21.15.63:0/1008322847 >> v1:172.21.15.63:6789/0 conn(0x7f6394143870 legacy=0x7f639413ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:24.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f6393fff700 1 -- 172.21.15.63:0/1008322847 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63941456f0 con 0x7f639409b2f0 2020-05-18T21:28:24.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f6393fff700 1 --2- 172.21.15.63:0/1008322847 >> v2:172.21.15.63:3300/0 conn(0x7f639409b2f0 0x7f639409e470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f63940669e0 tx=0x7f637c0108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f6393fff700 1 --2- 172.21.15.63:0/1008322847 >> v2:172.21.15.63:3300/0 conn(0x7f639409b2f0 0x7f639409e470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f63940669e0 tx=0x7f637c0108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f6393fff700 1 --2- 172.21.15.63:0/1008322847 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f639409b2f0 0x7f639409e470 secure :-1 s=READY pgs=519 cs=0 l=1 rx=0x7f63940669e0 tx=0x7f637c0108d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:24.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.621+0000 7f6393fff700 1 --2- 172.21.15.63:0/1008322847 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f639409b2f0 0x7f639409e470 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7f63940669e0 tx=0x7f637c0108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.625+0000 7f6393fff700 1 --2- 172.21.15.63:0/1008322847 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f639409b2f0 0x7f639409e470 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7f63940669e0 tx=0x7f637c0108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.625+0000 7f6391ffb700 1 -- 172.21.15.63:0/1008322847 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f637c005ce0 con 0x7f639409b2f0 2020-05-18T21:28:24.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.625+0000 7f6393fff700 1 --2- 172.21.15.63:0/1008322847 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f639409b2f0 0x7f639409e470 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7f63940669e0 tx=0x7f637c0108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.625+0000 7f6391ffb700 1 -- 172.21.15.63:0/1008322847 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c005e40 con 0x7f639409b2f0 2020-05-18T21:28:24.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.625+0000 7f63999ac700 1 -- 172.21.15.63:0/1008322847 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639409e8d0 con 0x7f639409b2f0 2020-05-18T21:28:24.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.625+0000 7f6391ffb700 1 -- 172.21.15.63:0/1008322847 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f637c0062c0 con 0x7f639409b2f0 2020-05-18T21:28:24.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.625+0000 7f63999ac700 1 -- 172.21.15.63:0/1008322847 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63940afa90 con 0x7f639409b2f0 2020-05-18T21:28:24.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.625+0000 7f6393fff700 1 --2- 172.21.15.63:0/1008322847 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f639409b2f0 0x7f639409e470 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7f63940669e0 tx=0x7f637c0108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.625+0000 7f63999ac700 1 -- 172.21.15.63:0/1008322847 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63940569e0 con 0x7f639409b2f0 2020-05-18T21:28:24.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.625+0000 7f6391ffb700 1 -- 172.21.15.63:0/1008322847 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f637c006530 con 0x7f639409b2f0 2020-05-18T21:28:24.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.625+0000 7f6393fff700 1 --2- 172.21.15.63:0/1008322847 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f639409b2f0 0x7f639409e470 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7f63940669e0 tx=0x7f637c0108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.625+0000 7f6391ffb700 1 --2- 172.21.15.63:0/1008322847 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f637804fd40 0x7f6378052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:24.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.625+0000 7f6391ffb700 1 -- 172.21.15.63:0/1008322847 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f637c0090c0 con 0x7f639409b2f0 2020-05-18T21:28:24.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.625+0000 7f63989aa700 1 --2- 172.21.15.63:0/1008322847 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f637804fd40 0x7f6378052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:24.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.625+0000 7f63989aa700 1 --2- 172.21.15.63:0/1008322847 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f637804fd40 0x7f6378052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6384002f70 tx=0x7f6384007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.629+0000 7f63989aa700 1 --2- 172.21.15.63:0/1008322847 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f637804fd40 0x7f6378052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6384002f70 tx=0x7f6384007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.629+0000 7f63989aa700 1 --2- 172.21.15.63:0/1008322847 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f637804fd40 0x7f6378052200 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f6384002f70 tx=0x7f6384007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:24.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.629+0000 7f6393fff700 1 --2- 172.21.15.63:0/1008322847 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f639409b2f0 0x7f639409e470 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7f63940669e0 tx=0x7f637c0108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.629+0000 7f6391ffb700 1 -- 172.21.15.63:0/1008322847 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f637c03e0a0 con 0x7f639409b2f0 2020-05-18T21:28:24.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.745+0000 7f63999ac700 1 -- 172.21.15.63:0/1008322847 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f63940008d0 con 0x7f639409b2f0 2020-05-18T21:28:24.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.745+0000 7f6393fff700 1 --2- 172.21.15.63:0/1008322847 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f639409b2f0 0x7f639409e470 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7f63940669e0 tx=0x7f637c0108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.745+0000 7f6391ffb700 1 -- 172.21.15.63:0/1008322847 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v41) v1 ==== 110+0+10 (secure 0 0 0) 0x7f637c0416c0 con 0x7f639409b2f0 2020-05-18T21:28:24.754 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:28:24.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.749+0000 7f63999ac700 1 -- 172.21.15.63:0/1008322847 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f637804fd40 msgr2=0x7f6378052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:24.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.749+0000 7f63999ac700 1 --2- 172.21.15.63:0/1008322847 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f637804fd40 0x7f6378052200 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f6384002f70 tx=0x7f6384007a80).stop 2020-05-18T21:28:24.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.749+0000 7f63999ac700 1 -- 172.21.15.63:0/1008322847 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f639409b2f0 msgr2=0x7f639409e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:24.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.749+0000 7f63999ac700 1 --2- 172.21.15.63:0/1008322847 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f639409b2f0 0x7f639409e470 secure :-1 s=READY pgs=519 cs=0 l=1 rx=0x7f63940669e0 tx=0x7f637c0108d0).stop 2020-05-18T21:28:24.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.749+0000 7f63999ac700 1 -- 172.21.15.63:0/1008322847 shutdown_connections 2020-05-18T21:28:24.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.749+0000 7f63999ac700 1 --2- 172.21.15.63:0/1008322847 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f637804fd40 0x7f6378052200 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:24.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.749+0000 7f63999ac700 1 --2- 172.21.15.63:0/1008322847 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f639409b2f0 0x7f639409e470 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:24.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.749+0000 7f63999ac700 1 --2- 172.21.15.63:0/1008322847 >> v2:172.21.15.155:3300/0 conn(0x7f639405ef00 0x7f63941440b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:24.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.749+0000 7f63999ac700 1 -- 172.21.15.63:0/1008322847 >> 172.21.15.63:0/1008322847 conn(0x7f63940b8b10 msgr2=0x7f63940b7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:24.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.749+0000 7f63999ac700 1 -- 172.21.15.63:0/1008322847 shutdown_connections 2020-05-18T21:28:24.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.749+0000 7f63999ac700 1 -- 172.21.15.63:0/1008322847 wait complete. 2020-05-18T21:28:24.773 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:28:24.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad231e700 1 Processor -- start 2020-05-18T21:28:24.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad231e700 1 -- start start 2020-05-18T21:28:24.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad231e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbacc06a630 0x7fbacc0adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:24.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad231e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbacc0b4450 0x7fbacc0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:24.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad231e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbacc0b3790 con 0x7fbacc149d50 2020-05-18T21:28:24.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad231e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbacc0b3f30 con 0x7fbacc0b4450 2020-05-18T21:28:24.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad231e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc0b39f0 con 0x7fbacc06a630 2020-05-18T21:28:24.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad131c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbacc149d50 0x7fbacc0ad3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57316/0 (socket says 172.21.15.63:57316) 2020-05-18T21:28:24.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad131c700 1 -- 172.21.15.63:0/1193828655 learned_addr learned my addr 172.21.15.63:0/1193828655 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:24.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad0b1b700 1 --2- 172.21.15.63:0/1193828655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbacc06a630 0x7fbacc0adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:24.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad1b1d700 1 --2- 172.21.15.63:0/1193828655 >> v2:172.21.15.155:3300/0 conn(0x7fbacc0b4450 0x7fbacc0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:24.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbabffff700 1 -- 172.21.15.63:0/1193828655 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916860770 0 0) 0x7fbacc0b3790 con 0x7fbacc149d50 2020-05-18T21:28:24.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbabffff700 1 -- 172.21.15.63:0/1193828655 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbab0003270 con 0x7fbacc149d50 2020-05-18T21:28:24.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad0b1b700 1 -- 172.21.15.63:0/1193828655 >> v2:172.21.15.155:3300/0 conn(0x7fbacc0b4450 msgr2=0x7fbacc0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:24.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad0b1b700 1 --2- 172.21.15.63:0/1193828655 >> v2:172.21.15.155:3300/0 conn(0x7fbacc0b4450 0x7fbacc0b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:24.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad0b1b700 1 -- 172.21.15.63:0/1193828655 >> v1:172.21.15.63:6789/0 conn(0x7fbacc149d50 legacy=0x7fbacc0ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:24.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad0b1b700 1 -- 172.21.15.63:0/1193828655 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc0b3c90 con 0x7fbacc06a630 2020-05-18T21:28:24.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad0b1b700 1 --2- 172.21.15.63:0/1193828655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbacc06a630 0x7fbacc0adb00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbac0002f70 tx=0x7fbac0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad0b1b700 1 --2- 172.21.15.63:0/1193828655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbacc06a630 0x7fbacc0adb00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbac0002f70 tx=0x7fbac0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad0b1b700 1 --2- 172.21.15.63:0/1193828655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbacc06a630 0x7fbacc0adb00 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fbac0002f70 tx=0x7fbac0007a80).ready entity=mon.2 client_cookie=716e5ff545041a10 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:24.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad0b1b700 1 --2- 172.21.15.63:0/1193828655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbacc06a630 0x7fbacc0adb00 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fbac0002f70 tx=0x7fbac0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbabffff700 1 -- 172.21.15.63:0/1193828655 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbac0008d70 con 0x7fbacc06a630 2020-05-18T21:28:24.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad0b1b700 1 --2- 172.21.15.63:0/1193828655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbacc06a630 0x7fbacc0adb00 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fbac0002f70 tx=0x7fbac0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad0b1b700 1 --2- 172.21.15.63:0/1193828655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbacc06a630 0x7fbacc0adb00 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fbac0002f70 tx=0x7fbac0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbabffff700 1 -- 172.21.15.63:0/1193828655 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac00116e0 con 0x7fbacc06a630 2020-05-18T21:28:24.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbabffff700 1 -- 172.21.15.63:0/1193828655 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbac0011ac0 con 0x7fbacc06a630 2020-05-18T21:28:24.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad231e700 1 -- 172.21.15.63:0/1193828655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbacc06a630 msgr2=0x7fbacc0adb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:24.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.881+0000 7fbad231e700 1 --2- 172.21.15.63:0/1193828655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbacc06a630 0x7fbacc0adb00 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fbac0002f70 tx=0x7fbac0007a80).stop 2020-05-18T21:28:24.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.885+0000 7fbad231e700 1 -- 172.21.15.63:0/1193828655 shutdown_connections 2020-05-18T21:28:24.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.885+0000 7fbad231e700 1 --2- 172.21.15.63:0/1193828655 >> v2:172.21.15.155:3300/0 conn(0x7fbacc0b4450 0x7fbacc0b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:24.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.885+0000 7fbad231e700 1 --2- 172.21.15.63:0/1193828655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbacc06a630 0x7fbacc0adb00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:24.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.885+0000 7fbad231e700 1 -- 172.21.15.63:0/1193828655 >> 172.21.15.63:0/1193828655 conn(0x7fbacc05fb90 msgr2=0x7fbacc069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:24.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.885+0000 7fbad231e700 1 -- 172.21.15.63:0/1193828655 shutdown_connections 2020-05-18T21:28:24.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.885+0000 7fbad231e700 1 -- 172.21.15.63:0/1193828655 wait complete. 2020-05-18T21:28:24.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.885+0000 7fbad231e700 1 Processor -- start 2020-05-18T21:28:24.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.885+0000 7fbad231e700 1 -- start start 2020-05-18T21:28:24.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.885+0000 7fbad231e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbacc06a630 0x7fbacc15bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:24.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.885+0000 7fbad231e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbacc14e4d0 con 0x7fbacc149d50 2020-05-18T21:28:24.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.885+0000 7fbad231e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbacc15c420 con 0x7fbacc0b4450 2020-05-18T21:28:24.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.885+0000 7fbad231e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbacc14e230 con 0x7fbacc06a630 2020-05-18T21:28:24.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.885+0000 7fbad131c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbacc06a630 0x7fbacc15bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:24.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbad1b1d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbacc149d50 0x7fbacc0af420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57326/0 (socket says 172.21.15.63:57326) 2020-05-18T21:28:24.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbad1b1d700 1 -- 172.21.15.63:0/1517176295 learned_addr learned my addr 172.21.15.63:0/1517176295 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:24.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbad131c700 1 -- 172.21.15.63:0/1517176295 >> v1:172.21.15.155:6789/0 conn(0x7fbacc0b4450 legacy=0x7fbacc14c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:24.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbad131c700 1 -- 172.21.15.63:0/1517176295 >> v1:172.21.15.63:6789/0 conn(0x7fbacc149d50 legacy=0x7fbacc0af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:24.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbabe7fc700 1 -- 172.21.15.63:0/1517176295 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195172402 0 0) 0x7fbacc14e4d0 con 0x7fbacc149d50 2020-05-18T21:28:24.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbad131c700 1 -- 172.21.15.63:0/1517176295 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc061d80 con 0x7fbacc06a630 2020-05-18T21:28:24.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbad131c700 1 --2- 172.21.15.63:0/1517176295 >> v2:172.21.15.63:3300/0 conn(0x7fbacc06a630 0x7fbacc15bfc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbac8001110 tx=0x7fbac80109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbad131c700 1 --2- 172.21.15.63:0/1517176295 >> v2:172.21.15.63:3300/0 conn(0x7fbacc06a630 0x7fbacc15bfc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbac8001110 tx=0x7fbac80109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbad131c700 1 --2- 172.21.15.63:0/1517176295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbacc06a630 0x7fbacc15bfc0 secure :-1 s=READY pgs=522 cs=0 l=1 rx=0x7fbac8001110 tx=0x7fbac80109a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:24.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbad131c700 1 --2- 172.21.15.63:0/1517176295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbacc06a630 0x7fbacc15bfc0 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7fbac8001110 tx=0x7fbac80109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbabe7fc700 1 -- 172.21.15.63:0/1517176295 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbac8005d00 con 0x7fbacc06a630 2020-05-18T21:28:24.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbad131c700 1 --2- 172.21.15.63:0/1517176295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbacc06a630 0x7fbacc15bfc0 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7fbac8001110 tx=0x7fbac80109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbad231e700 1 -- 172.21.15.63:0/1517176295 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbacc0b1f30 con 0x7fbacc06a630 2020-05-18T21:28:24.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbabe7fc700 1 -- 172.21.15.63:0/1517176295 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac8005e60 con 0x7fbacc06a630 2020-05-18T21:28:24.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbad131c700 1 --2- 172.21.15.63:0/1517176295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbacc06a630 0x7fbacc15bfc0 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7fbac8001110 tx=0x7fbac80109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbabe7fc700 1 -- 172.21.15.63:0/1517176295 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbac80062c0 con 0x7fbacc06a630 2020-05-18T21:28:24.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbad231e700 1 -- 172.21.15.63:0/1517176295 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbacc14cc00 con 0x7fbacc06a630 2020-05-18T21:28:24.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbad131c700 1 --2- 172.21.15.63:0/1517176295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbacc06a630 0x7fbacc15bfc0 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7fbac8001110 tx=0x7fbac80109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbabe7fc700 1 -- 172.21.15.63:0/1517176295 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fbac8006500 con 0x7fbacc06a630 2020-05-18T21:28:24.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbad131c700 1 --2- 172.21.15.63:0/1517176295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbacc06a630 0x7fbacc15bfc0 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7fbac8001110 tx=0x7fbac80109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.889+0000 7fbad231e700 1 -- 172.21.15.63:0/1517176295 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbacc0569e0 con 0x7fbacc06a630 2020-05-18T21:28:24.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.893+0000 7fbabe7fc700 1 --2- 172.21.15.63:0/1517176295 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbab404f8a0 0x7fbab4051d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:24.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.893+0000 7fbabe7fc700 1 -- 172.21.15.63:0/1517176295 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbac80090c0 con 0x7fbacc06a630 2020-05-18T21:28:24.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.893+0000 7fbad0b1b700 1 --2- 172.21.15.63:0/1517176295 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbab404f8a0 0x7fbab4051d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:24.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.893+0000 7fbad0b1b700 1 --2- 172.21.15.63:0/1517176295 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbab404f8a0 0x7fbab4051d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbacc0aff20 tx=0x7fbac0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.893+0000 7fbad0b1b700 1 --2- 172.21.15.63:0/1517176295 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbab404f8a0 0x7fbab4051d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbacc0aff20 tx=0x7fbac0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.893+0000 7fbad0b1b700 1 --2- 172.21.15.63:0/1517176295 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbab404f8a0 0x7fbab4051d60 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7fbacc0aff20 tx=0x7fbac0007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:24.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.897+0000 7fbad131c700 1 --2- 172.21.15.63:0/1517176295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbacc06a630 0x7fbacc15bfc0 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7fbac8001110 tx=0x7fbac80109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:24.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:24.897+0000 7fbabe7fc700 1 -- 172.21.15.63:0/1517176295 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fbac803e230 con 0x7fbacc06a630 2020-05-18T21:28:25.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.017+0000 7fbad231e700 1 -- 172.21.15.63:0/1517176295 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbacc0ae500 con 0x7fbacc06a630 2020-05-18T21:28:25.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.017+0000 7fbad131c700 1 --2- 172.21.15.63:0/1517176295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbacc06a630 0x7fbacc15bfc0 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7fbac8001110 tx=0x7fbac80109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.017+0000 7fbabe7fc700 1 -- 172.21.15.63:0/1517176295 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbac8041850 con 0x7fbacc06a630 2020-05-18T21:28:25.027 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:28:25.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.021+0000 7fbad231e700 1 -- 172.21.15.63:0/1517176295 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbab404f8a0 msgr2=0x7fbab4051d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.021+0000 7fbad231e700 1 --2- 172.21.15.63:0/1517176295 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbab404f8a0 0x7fbab4051d60 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7fbacc0aff20 tx=0x7fbac0007a80).stop 2020-05-18T21:28:25.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.021+0000 7fbad231e700 1 -- 172.21.15.63:0/1517176295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbacc06a630 msgr2=0x7fbacc15bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.021+0000 7fbad231e700 1 --2- 172.21.15.63:0/1517176295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbacc06a630 0x7fbacc15bfc0 secure :-1 s=READY pgs=522 cs=0 l=1 rx=0x7fbac8001110 tx=0x7fbac80109a0).stop 2020-05-18T21:28:25.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.021+0000 7fbad231e700 1 -- 172.21.15.63:0/1517176295 shutdown_connections 2020-05-18T21:28:25.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.021+0000 7fbad231e700 1 --2- 172.21.15.63:0/1517176295 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbab404f8a0 0x7fbab4051d60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:25.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.021+0000 7fbad231e700 1 --2- 172.21.15.63:0/1517176295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbacc06a630 0x7fbacc15bfc0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:25.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.021+0000 7fbad231e700 1 -- 172.21.15.63:0/1517176295 >> 172.21.15.63:0/1517176295 conn(0x7fbacc05fb90 msgr2=0x7fbacc05beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:25.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.021+0000 7fbad231e700 1 -- 172.21.15.63:0/1517176295 shutdown_connections 2020-05-18T21:28:25.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.021+0000 7fbad231e700 1 -- 172.21.15.63:0/1517176295 wait complete. 2020-05-18T21:28:25.038 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:28:25.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36bfff700 1 Processor -- start 2020-05-18T21:28:25.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36bfff700 1 -- start start 2020-05-18T21:28:25.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb36c05ef00 0x7fb36c142110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:25.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb36c061b30 0x7fb36c145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:25.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36bfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36c0b4e90 con 0x7fb36c066b60 2020-05-18T21:28:25.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb36c142620 con 0x7fb36c05ef00 2020-05-18T21:28:25.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36bfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c1428c0 con 0x7fb36c061b30 2020-05-18T21:28:25.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb36c05ef00 0x7fb36c142110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:25.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb36c05ef00 0x7fb36c142110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55142/0 (socket says 172.21.15.63:55142) 2020-05-18T21:28:25.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36affd700 1 -- 172.21.15.63:0/1451793060 learned_addr learned my addr 172.21.15.63:0/1451793060 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:25.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36a7fc700 1 --2- 172.21.15.63:0/1451793060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb36c061b30 0x7fb36c145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:25.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36affd700 1 -- 172.21.15.63:0/1451793060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb36c061b30 msgr2=0x7fb36c145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:25.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36affd700 1 --2- 172.21.15.63:0/1451793060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb36c061b30 0x7fb36c145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:25.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36affd700 1 -- 172.21.15.63:0/1451793060 >> v1:172.21.15.155:6789/0 conn(0x7fb36c066b60 legacy=0x7fb36c145db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36affd700 1 -- 172.21.15.63:0/1451793060 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c142b60 con 0x7fb36c05ef00 2020-05-18T21:28:25.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36affd700 1 --2- 172.21.15.63:0/1451793060 >> v2:172.21.15.63:3300/0 conn(0x7fb36c05ef00 0x7fb36c142110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb35c002f70 tx=0x7fb35c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36affd700 1 --2- 172.21.15.63:0/1451793060 >> v2:172.21.15.63:3300/0 conn(0x7fb36c05ef00 0x7fb36c142110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb35c002f70 tx=0x7fb35c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36affd700 1 --2- 172.21.15.63:0/1451793060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c05ef00 0x7fb36c142110 secure :-1 s=READY pgs=523 cs=0 l=1 rx=0x7fb35c002f70 tx=0x7fb35c007a80).ready entity=mon.0 client_cookie=c0e925e211caefb2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:25.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36affd700 1 --2- 172.21.15.63:0/1451793060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c05ef00 0x7fb36c142110 secure :-1 s=THROTTLE_DONE pgs=523 cs=0 l=1 rx=0x7fb35c002f70 tx=0x7fb35c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36affd700 1 --2- 172.21.15.63:0/1451793060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c05ef00 0x7fb36c142110 secure :-1 s=THROTTLE_DONE pgs=523 cs=0 l=1 rx=0x7fb35c002f70 tx=0x7fb35c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb369ffb700 1 -- 172.21.15.63:0/1451793060 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb35c0138c0 con 0x7fb36c05ef00 2020-05-18T21:28:25.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36affd700 1 --2- 172.21.15.63:0/1451793060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c05ef00 0x7fb36c142110 secure :-1 s=THROTTLE_DONE pgs=523 cs=0 l=1 rx=0x7fb35c002f70 tx=0x7fb35c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb369ffb700 1 -- 172.21.15.63:0/1451793060 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35c013a20 con 0x7fb36c05ef00 2020-05-18T21:28:25.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb369ffb700 1 -- 172.21.15.63:0/1451793060 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb35c013e40 con 0x7fb36c05ef00 2020-05-18T21:28:25.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36bfff700 1 -- 172.21.15.63:0/1451793060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c05ef00 msgr2=0x7fb36c142110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36bfff700 1 --2- 172.21.15.63:0/1451793060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c05ef00 0x7fb36c142110 secure :-1 s=READY pgs=523 cs=0 l=1 rx=0x7fb35c002f70 tx=0x7fb35c007a80).stop 2020-05-18T21:28:25.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36bfff700 1 -- 172.21.15.63:0/1451793060 shutdown_connections 2020-05-18T21:28:25.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36bfff700 1 --2- 172.21.15.63:0/1451793060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb36c061b30 0x7fb36c145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:25.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36bfff700 1 --2- 172.21.15.63:0/1451793060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c05ef00 0x7fb36c142110 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:25.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36bfff700 1 -- 172.21.15.63:0/1451793060 >> 172.21.15.63:0/1451793060 conn(0x7fb36c0b8b10 msgr2=0x7fb36c0b8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:25.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36bfff700 1 -- 172.21.15.63:0/1451793060 shutdown_connections 2020-05-18T21:28:25.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.141+0000 7fb36bfff700 1 -- 172.21.15.63:0/1451793060 wait complete. 2020-05-18T21:28:25.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36bfff700 1 Processor -- start 2020-05-18T21:28:25.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36bfff700 1 -- start start 2020-05-18T21:28:25.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb36c05ef00 0x7fb36c09a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:25.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb36c061b30 0x7fb36c0b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:25.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb36c066b60 0x7fb36c097660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:25.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb36c0b2070 con 0x7fb36c066b60 2020-05-18T21:28:25.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb36c153540 con 0x7fb36c061b30 2020-05-18T21:28:25.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36bfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c1537e0 con 0x7fb36c05ef00 2020-05-18T21:28:25.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36a7fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb36c061b30 0x7fb36c0b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:25.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb36c066b60 0x7fb36c097660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:25.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36a7fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb36c061b30 0x7fb36c0b1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:41766/0 (socket says 172.21.15.63:41766) 2020-05-18T21:28:25.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb36c066b60 0x7fb36c097660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55152/0 (socket says 172.21.15.63:55152) 2020-05-18T21:28:25.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36a7fc700 1 -- 172.21.15.63:0/4175536178 learned_addr learned my addr 172.21.15.63:0/4175536178 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:25.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36affd700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb36c05ef00 0x7fb36c09a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:25.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36b7fe700 1 -- 172.21.15.63:0/4175536178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb36c05ef00 msgr2=0x7fb36c09a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36b7fe700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb36c05ef00 0x7fb36c09a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:25.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36b7fe700 1 -- 172.21.15.63:0/4175536178 >> v2:172.21.15.155:3300/0 conn(0x7fb36c061b30 msgr2=0x7fb36c0b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36b7fe700 1 --2- 172.21.15.63:0/4175536178 >> v2:172.21.15.155:3300/0 conn(0x7fb36c061b30 0x7fb36c0b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:25.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36b7fe700 1 -- 172.21.15.63:0/4175536178 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c153a80 con 0x7fb36c066b60 2020-05-18T21:28:25.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36a7fc700 1 --2- 172.21.15.63:0/4175536178 >> v2:172.21.15.155:3300/0 conn(0x7fb36c061b30 0x7fb36c0b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:25.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36b7fe700 1 --2- 172.21.15.63:0/4175536178 >> v2:172.21.15.63:3300/0 conn(0x7fb36c066b60 0x7fb36c097660 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb36c06ad40 tx=0x7fb364010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36b7fe700 1 --2- 172.21.15.63:0/4175536178 >> v2:172.21.15.63:3300/0 conn(0x7fb36c066b60 0x7fb36c097660 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb36c06ad40 tx=0x7fb364010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36b7fe700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c066b60 0x7fb36c097660 secure :-1 s=READY pgs=524 cs=0 l=1 rx=0x7fb36c06ad40 tx=0x7fb364010be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:25.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36b7fe700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c066b60 0x7fb36c097660 secure :-1 s=THROTTLE_DONE pgs=524 cs=0 l=1 rx=0x7fb36c06ad40 tx=0x7fb364010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36b7fe700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c066b60 0x7fb36c097660 secure :-1 s=THROTTLE_DONE pgs=524 cs=0 l=1 rx=0x7fb36c06ad40 tx=0x7fb364010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36b7fe700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c066b60 0x7fb36c097660 secure :-1 s=THROTTLE_DONE pgs=524 cs=0 l=1 rx=0x7fb36c06ad40 tx=0x7fb364010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb35bfff700 1 -- 172.21.15.63:0/4175536178 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb364002280 con 0x7fb36c066b60 2020-05-18T21:28:25.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb35bfff700 1 -- 172.21.15.63:0/4175536178 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb364002420 con 0x7fb36c066b60 2020-05-18T21:28:25.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36bfff700 1 -- 172.21.15.63:0/4175536178 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb36c153f20 con 0x7fb36c066b60 2020-05-18T21:28:25.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb35bfff700 1 -- 172.21.15.63:0/4175536178 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb364002840 con 0x7fb36c066b60 2020-05-18T21:28:25.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.145+0000 7fb36bfff700 1 -- 172.21.15.63:0/4175536178 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36c153050 con 0x7fb36c066b60 2020-05-18T21:28:25.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.149+0000 7fb36b7fe700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c066b60 0x7fb36c097660 secure :-1 s=THROTTLE_DONE pgs=524 cs=0 l=1 rx=0x7fb36c06ad40 tx=0x7fb364010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.149+0000 7fb36bfff700 1 -- 172.21.15.63:0/4175536178 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36c1533b0 con 0x7fb36c066b60 2020-05-18T21:28:25.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.149+0000 7fb35bfff700 1 -- 172.21.15.63:0/4175536178 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb364002ab0 con 0x7fb36c066b60 2020-05-18T21:28:25.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.149+0000 7fb36b7fe700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c066b60 0x7fb36c097660 secure :-1 s=THROTTLE_DONE pgs=524 cs=0 l=1 rx=0x7fb36c06ad40 tx=0x7fb364010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.149+0000 7fb35bfff700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb34804fa20 0x7fb348051ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:25.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.149+0000 7fb35bfff700 1 -- 172.21.15.63:0/4175536178 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb364064090 con 0x7fb36c066b60 2020-05-18T21:28:25.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.149+0000 7fb36affd700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb34804fa20 0x7fb348051ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:25.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.149+0000 7fb36affd700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb34804fa20 0x7fb348051ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb35c002f70 tx=0x7fb35c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.149+0000 7fb36affd700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb34804fa20 0x7fb348051ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb35c002f70 tx=0x7fb35c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.149+0000 7fb36affd700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb34804fa20 0x7fb348051ee0 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7fb35c002f70 tx=0x7fb35c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:25.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.153+0000 7fb36b7fe700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c066b60 0x7fb36c097660 secure :-1 s=THROTTLE_DONE pgs=524 cs=0 l=1 rx=0x7fb36c06ad40 tx=0x7fb364010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.153+0000 7fb35bfff700 1 -- 172.21.15.63:0/4175536178 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb36403e3c0 con 0x7fb36c066b60 2020-05-18T21:28:25.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.269+0000 7fb36bfff700 1 -- 172.21.15.63:0/4175536178 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb36c097e00 con 0x7fb36c066b60 2020-05-18T21:28:25.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.273+0000 7fb36b7fe700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c066b60 0x7fb36c097660 secure :-1 s=THROTTLE_DONE pgs=524 cs=0 l=1 rx=0x7fb36c06ad40 tx=0x7fb364010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.273+0000 7fb35bfff700 1 -- 172.21.15.63:0/4175536178 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb3640419e0 con 0x7fb36c066b60 2020-05-18T21:28:25.279 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:28:25.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.273+0000 7fb36bfff700 1 -- 172.21.15.63:0/4175536178 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb34804fa20 msgr2=0x7fb348051ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.273+0000 7fb36bfff700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb34804fa20 0x7fb348051ee0 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7fb35c002f70 tx=0x7fb35c007a80).stop 2020-05-18T21:28:25.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.273+0000 7fb36bfff700 1 -- 172.21.15.63:0/4175536178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c066b60 msgr2=0x7fb36c097660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.273+0000 7fb36bfff700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c066b60 0x7fb36c097660 secure :-1 s=READY pgs=524 cs=0 l=1 rx=0x7fb36c06ad40 tx=0x7fb364010be0).stop 2020-05-18T21:28:25.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.273+0000 7fb36bfff700 1 -- 172.21.15.63:0/4175536178 shutdown_connections 2020-05-18T21:28:25.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.273+0000 7fb36bfff700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb34804fa20 0x7fb348051ee0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:25.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.273+0000 7fb36bfff700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c066b60 0x7fb36c097660 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:25.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.273+0000 7fb36bfff700 1 --2- 172.21.15.63:0/4175536178 >> v2:172.21.15.155:3300/0 conn(0x7fb36c061b30 0x7fb36c0b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:25.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.273+0000 7fb36bfff700 1 --2- 172.21.15.63:0/4175536178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb36c05ef00 0x7fb36c09a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:25.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.273+0000 7fb36bfff700 1 -- 172.21.15.63:0/4175536178 >> 172.21.15.63:0/4175536178 conn(0x7fb36c0b8b10 msgr2=0x7fb36c0ae610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:25.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.273+0000 7fb36bfff700 1 -- 172.21.15.63:0/4175536178 shutdown_connections 2020-05-18T21:28:25.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.273+0000 7fb36bfff700 1 -- 172.21.15.63:0/4175536178 wait complete. 2020-05-18T21:28:25.291 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:28:25.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.397+0000 7fc9ce0e8700 1 Processor -- start 2020-05-18T21:28:25.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.397+0000 7fc9ce0e8700 1 -- start start 2020-05-18T21:28:25.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.397+0000 7fc9ce0e8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc9c80b99d0 0x7fc9c81469b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:25.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.397+0000 7fc9ce0e8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c8145fd0 con 0x7fc9c80b68d0 2020-05-18T21:28:25.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.397+0000 7fc9ce0e8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c8146270 con 0x7fc9c8149d40 2020-05-18T21:28:25.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.397+0000 7fc9ce0e8700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c8146510 con 0x7fc9c80b99d0 2020-05-18T21:28:25.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.397+0000 7fc9cd0e6700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc9c80b68d0 0x7fc9c80b8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57344/0 (socket says 172.21.15.63:57344) 2020-05-18T21:28:25.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.397+0000 7fc9cd0e6700 1 -- 172.21.15.63:0/934949535 learned_addr learned my addr 172.21.15.63:0/934949535 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:25.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.397+0000 7fc9cc8e5700 1 --2- 172.21.15.63:0/934949535 >> v2:172.21.15.63:3300/0 conn(0x7fc9c80b99d0 0x7fc9c81469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:25.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.397+0000 7fc9bffff700 1 -- 172.21.15.63:0/934949535 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140643221 0 0) 0x7fc9c8145fd0 con 0x7fc9c80b68d0 2020-05-18T21:28:25.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.397+0000 7fc9cc8e5700 1 -- 172.21.15.63:0/934949535 >> v1:172.21.15.155:6789/0 conn(0x7fc9c8149d40 legacy=0x7fc9c8060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.397+0000 7fc9cc8e5700 1 -- 172.21.15.63:0/934949535 >> v1:172.21.15.63:6789/0 conn(0x7fc9c80b68d0 legacy=0x7fc9c80b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.397+0000 7fc9cc8e5700 1 -- 172.21.15.63:0/934949535 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c814a1f0 con 0x7fc9c80b99d0 2020-05-18T21:28:25.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.401+0000 7fc9cc8e5700 1 --2- 172.21.15.63:0/934949535 >> v2:172.21.15.63:3300/0 conn(0x7fc9c80b99d0 0x7fc9c81469b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc9c4002f70 tx=0x7fc9c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.401+0000 7fc9cc8e5700 1 --2- 172.21.15.63:0/934949535 >> v2:172.21.15.63:3300/0 conn(0x7fc9c80b99d0 0x7fc9c81469b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc9c4002f70 tx=0x7fc9c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.401+0000 7fc9cc8e5700 1 --2- 172.21.15.63:0/934949535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c80b99d0 0x7fc9c81469b0 secure :-1 s=READY pgs=526 cs=0 l=1 rx=0x7fc9c4002f70 tx=0x7fc9c4007a80).ready entity=mon.0 client_cookie=cfdeaab707bc639c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:25.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.401+0000 7fc9cc8e5700 1 --2- 172.21.15.63:0/934949535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c80b99d0 0x7fc9c81469b0 secure :-1 s=THROTTLE_DONE pgs=526 cs=0 l=1 rx=0x7fc9c4002f70 tx=0x7fc9c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.401+0000 7fc9bffff700 1 -- 172.21.15.63:0/934949535 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9c4008e80 con 0x7fc9c80b99d0 2020-05-18T21:28:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.401+0000 7fc9cc8e5700 1 --2- 172.21.15.63:0/934949535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c80b99d0 0x7fc9c81469b0 secure :-1 s=THROTTLE_DONE pgs=526 cs=0 l=1 rx=0x7fc9c4002f70 tx=0x7fc9c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.401+0000 7fc9bffff700 1 -- 172.21.15.63:0/934949535 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c40116a0 con 0x7fc9c80b99d0 2020-05-18T21:28:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.401+0000 7fc9ce0e8700 1 -- 172.21.15.63:0/934949535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c80b99d0 msgr2=0x7fc9c81469b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.401+0000 7fc9cc8e5700 1 --2- 172.21.15.63:0/934949535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c80b99d0 0x7fc9c81469b0 secure :-1 s=THROTTLE_DONE pgs=526 cs=0 l=1 rx=0x7fc9c4002f70 tx=0x7fc9c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.401+0000 7fc9bffff700 1 -- 172.21.15.63:0/934949535 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9c4011ac0 con 0x7fc9c80b99d0 2020-05-18T21:28:25.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.401+0000 7fc9ce0e8700 1 --2- 172.21.15.63:0/934949535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c80b99d0 0x7fc9c81469b0 secure :-1 s=READY pgs=526 cs=0 l=1 rx=0x7fc9c4002f70 tx=0x7fc9c4007a80).stop 2020-05-18T21:28:25.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.401+0000 7fc9ce0e8700 1 -- 172.21.15.63:0/934949535 shutdown_connections 2020-05-18T21:28:25.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.401+0000 7fc9ce0e8700 1 --2- 172.21.15.63:0/934949535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c80b99d0 0x7fc9c81469b0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:25.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.401+0000 7fc9ce0e8700 1 -- 172.21.15.63:0/934949535 >> 172.21.15.63:0/934949535 conn(0x7fc9c8069b70 msgr2=0x7fc9c8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:25.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.401+0000 7fc9ce0e8700 1 -- 172.21.15.63:0/934949535 shutdown_connections 2020-05-18T21:28:25.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.401+0000 7fc9ce0e8700 1 -- 172.21.15.63:0/934949535 wait complete. 2020-05-18T21:28:25.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.401+0000 7fc9ce0e8700 1 Processor -- start 2020-05-18T21:28:25.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9ce0e8700 1 -- start start 2020-05-18T21:28:25.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9ce0e8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc9c80b68d0 0x7fc9c8144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:25.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9ce0e8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc9c8149d40 0x7fc9c813f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:25.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9ce0e8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c80b02e0 con 0x7fc9c80b99d0 2020-05-18T21:28:25.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9ce0e8700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c80b0580 con 0x7fc9c8149d40 2020-05-18T21:28:25.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9ce0e8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c80b0000 con 0x7fc9c80b68d0 2020-05-18T21:28:25.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9cd8e7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc9c8149d40 0x7fc9c813f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:25.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9cd0e6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc9c80b68d0 0x7fc9c8144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:25.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9cd0e6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc9c80b68d0 0x7fc9c8144c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:41778/0 (socket says 172.21.15.63:41778) 2020-05-18T21:28:25.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9cd0e6700 1 -- 172.21.15.63:0/3900276431 learned_addr learned my addr 172.21.15.63:0/3900276431 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:25.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9cd8e7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc9c8149d40 0x7fc9c813f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55166/0 (socket says 172.21.15.63:55166) 2020-05-18T21:28:25.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9cd8e7700 1 -- 172.21.15.63:0/3900276431 >> v2:172.21.15.155:3300/0 conn(0x7fc9c80b68d0 msgr2=0x7fc9c8144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9cd8e7700 1 --2- 172.21.15.63:0/3900276431 >> v2:172.21.15.155:3300/0 conn(0x7fc9c80b68d0 0x7fc9c8144c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:25.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9cd8e7700 1 -- 172.21.15.63:0/3900276431 >> v1:172.21.15.155:6789/0 conn(0x7fc9c80b99d0 legacy=0x7fc9c80af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9cd8e7700 1 -- 172.21.15.63:0/3900276431 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c8145740 con 0x7fc9c8149d40 2020-05-18T21:28:25.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9cd8e7700 1 --2- 172.21.15.63:0/3900276431 >> v2:172.21.15.63:3300/0 conn(0x7fc9c8149d40 0x7fc9c813f050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9c80b8c90 tx=0x7fc9c0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9cd8e7700 1 --2- 172.21.15.63:0/3900276431 >> v2:172.21.15.63:3300/0 conn(0x7fc9c8149d40 0x7fc9c813f050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9c80b8c90 tx=0x7fc9c0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9cd8e7700 1 --2- 172.21.15.63:0/3900276431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c8149d40 0x7fc9c813f050 secure :-1 s=READY pgs=527 cs=0 l=1 rx=0x7fc9c80b8c90 tx=0x7fc9c0010be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:25.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9cd8e7700 1 --2- 172.21.15.63:0/3900276431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c8149d40 0x7fc9c813f050 secure :-1 s=THROTTLE_DONE pgs=527 cs=0 l=1 rx=0x7fc9c80b8c90 tx=0x7fc9c0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9cd8e7700 1 --2- 172.21.15.63:0/3900276431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c8149d40 0x7fc9c813f050 secure :-1 s=THROTTLE_DONE pgs=527 cs=0 l=1 rx=0x7fc9c80b8c90 tx=0x7fc9c0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9be7fc700 1 -- 172.21.15.63:0/3900276431 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9c0002280 con 0x7fc9c8149d40 2020-05-18T21:28:25.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9cd8e7700 1 --2- 172.21.15.63:0/3900276431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c8149d40 0x7fc9c813f050 secure :-1 s=THROTTLE_DONE pgs=527 cs=0 l=1 rx=0x7fc9c80b8c90 tx=0x7fc9c0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9be7fc700 1 -- 172.21.15.63:0/3900276431 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c00023e0 con 0x7fc9c8149d40 2020-05-18T21:28:25.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9be7fc700 1 -- 172.21.15.63:0/3900276431 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9c0002800 con 0x7fc9c8149d40 2020-05-18T21:28:25.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9ce0e8700 1 -- 172.21.15.63:0/3900276431 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c813f4b0 con 0x7fc9c8149d40 2020-05-18T21:28:25.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.405+0000 7fc9ce0e8700 1 -- 172.21.15.63:0/3900276431 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c813f960 con 0x7fc9c8149d40 2020-05-18T21:28:25.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.409+0000 7fc9cd8e7700 1 --2- 172.21.15.63:0/3900276431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c8149d40 0x7fc9c813f050 secure :-1 s=THROTTLE_DONE pgs=527 cs=0 l=1 rx=0x7fc9c80b8c90 tx=0x7fc9c0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.409+0000 7fc9ce0e8700 1 -- 172.21.15.63:0/3900276431 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c80b0140 con 0x7fc9c8149d40 2020-05-18T21:28:25.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.409+0000 7fc9be7fc700 1 -- 172.21.15.63:0/3900276431 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc9c0002a40 con 0x7fc9c8149d40 2020-05-18T21:28:25.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.409+0000 7fc9cd8e7700 1 --2- 172.21.15.63:0/3900276431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c8149d40 0x7fc9c813f050 secure :-1 s=THROTTLE_DONE pgs=527 cs=0 l=1 rx=0x7fc9c80b8c90 tx=0x7fc9c0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.409+0000 7fc9be7fc700 1 --2- 172.21.15.63:0/3900276431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc9b004fa20 0x7fc9b0051ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:25.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.409+0000 7fc9be7fc700 1 -- 172.21.15.63:0/3900276431 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc9c0064280 con 0x7fc9c8149d40 2020-05-18T21:28:25.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.409+0000 7fc9cd0e6700 1 --2- 172.21.15.63:0/3900276431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc9b004fa20 0x7fc9b0051ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:25.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.409+0000 7fc9cd0e6700 1 --2- 172.21.15.63:0/3900276431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc9b004fa20 0x7fc9b0051ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9b8000bc0 tx=0x7fc9b80018a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.409+0000 7fc9cd0e6700 1 --2- 172.21.15.63:0/3900276431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc9b004fa20 0x7fc9b0051ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9b8000bc0 tx=0x7fc9b80018a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.409+0000 7fc9cd0e6700 1 --2- 172.21.15.63:0/3900276431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc9b004fa20 0x7fc9b0051ee0 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7fc9b8000bc0 tx=0x7fc9b80018a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:25.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.417+0000 7fc9cd8e7700 1 --2- 172.21.15.63:0/3900276431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c8149d40 0x7fc9c813f050 secure :-1 s=THROTTLE_DONE pgs=527 cs=0 l=1 rx=0x7fc9c80b8c90 tx=0x7fc9c0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.417+0000 7fc9be7fc700 1 -- 172.21.15.63:0/3900276431 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc9c80b0140 con 0x7fc9c8149d40 2020-05-18T21:28:25.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.533+0000 7fc9ce0e8700 1 -- 172.21.15.63:0/3900276431 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9c80b0140 con 0x7fc9c8149d40 2020-05-18T21:28:25.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.533+0000 7fc9cd8e7700 1 --2- 172.21.15.63:0/3900276431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c8149d40 0x7fc9c813f050 secure :-1 s=THROTTLE_DONE pgs=527 cs=0 l=1 rx=0x7fc9c80b8c90 tx=0x7fc9c0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.533+0000 7fc9be7fc700 1 -- 172.21.15.63:0/3900276431 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc9c80b0140 con 0x7fc9c8149d40 2020-05-18T21:28:25.542 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:28:25.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.537+0000 7fc9ce0e8700 1 -- 172.21.15.63:0/3900276431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc9b004fa20 msgr2=0x7fc9b0051ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.537+0000 7fc9ce0e8700 1 --2- 172.21.15.63:0/3900276431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc9b004fa20 0x7fc9b0051ee0 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7fc9b8000bc0 tx=0x7fc9b80018a0).stop 2020-05-18T21:28:25.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.537+0000 7fc9ce0e8700 1 -- 172.21.15.63:0/3900276431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c8149d40 msgr2=0x7fc9c813f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.537+0000 7fc9ce0e8700 1 --2- 172.21.15.63:0/3900276431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c8149d40 0x7fc9c813f050 secure :-1 s=READY pgs=527 cs=0 l=1 rx=0x7fc9c80b8c90 tx=0x7fc9c0010be0).stop 2020-05-18T21:28:25.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.537+0000 7fc9ce0e8700 1 -- 172.21.15.63:0/3900276431 shutdown_connections 2020-05-18T21:28:25.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.537+0000 7fc9ce0e8700 1 --2- 172.21.15.63:0/3900276431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc9b004fa20 0x7fc9b0051ee0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:25.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.537+0000 7fc9ce0e8700 1 --2- 172.21.15.63:0/3900276431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c8149d40 0x7fc9c813f050 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:25.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.537+0000 7fc9ce0e8700 1 --2- 172.21.15.63:0/3900276431 >> v2:172.21.15.155:3300/0 conn(0x7fc9c80b68d0 0x7fc9c8144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:25.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.537+0000 7fc9ce0e8700 1 -- 172.21.15.63:0/3900276431 >> 172.21.15.63:0/3900276431 conn(0x7fc9c8069b70 msgr2=0x7fc9c80ba9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:25.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.537+0000 7fc9ce0e8700 1 -- 172.21.15.63:0/3900276431 shutdown_connections 2020-05-18T21:28:25.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.537+0000 7fc9ce0e8700 1 -- 172.21.15.63:0/3900276431 wait complete. 2020-05-18T21:28:25.559 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:28:25.560 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:28:25.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.657+0000 7f1a2a1cb700 1 Processor -- start 2020-05-18T21:28:25.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.657+0000 7f1a2a1cb700 1 -- start start 2020-05-18T21:28:25.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.657+0000 7f1a2a1cb700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1a2405f110 0x7f1a240b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:25.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.657+0000 7f1a2a1cb700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1a2414aa70 0x7f1a240648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:25.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.657+0000 7f1a2a1cb700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2414a330 con 0x7f1a24064d20 2020-05-18T21:28:25.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.657+0000 7f1a2a1cb700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2414a140 con 0x7f1a2405f110 2020-05-18T21:28:25.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.657+0000 7f1a2a1cb700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2414a5d0 con 0x7f1a2414aa70 2020-05-18T21:28:25.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a291c9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1a2405f110 0x7f1a240b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:25.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a291c9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1a2405f110 0x7f1a240b4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55172/0 (socket says 172.21.15.63:55172) 2020-05-18T21:28:25.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a291c9700 1 -- 172.21.15.63:0/1970757247 learned_addr learned my addr 172.21.15.63:0/1970757247 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:25.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a289c8700 1 --2- 172.21.15.63:0/1970757247 >> v2:172.21.15.155:3300/0 conn(0x7f1a2414aa70 0x7f1a240648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:25.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a17fff700 1 -- 172.21.15.63:0/1970757247 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201753356 0 0) 0x7f1a2414a330 con 0x7f1a24064d20 2020-05-18T21:28:25.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a291c9700 1 -- 172.21.15.63:0/1970757247 >> v2:172.21.15.155:3300/0 conn(0x7f1a2414aa70 msgr2=0x7f1a240648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:25.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a291c9700 1 --2- 172.21.15.63:0/1970757247 >> v2:172.21.15.155:3300/0 conn(0x7f1a2414aa70 0x7f1a240648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:25.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a291c9700 1 -- 172.21.15.63:0/1970757247 >> v1:172.21.15.155:6789/0 conn(0x7f1a24064d20 legacy=0x7f1a2414d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a291c9700 1 -- 172.21.15.63:0/1970757247 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a24063430 con 0x7f1a2405f110 2020-05-18T21:28:25.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a291c9700 1 --2- 172.21.15.63:0/1970757247 >> v2:172.21.15.63:3300/0 conn(0x7f1a2405f110 0x7f1a240b4760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1a20002f70 tx=0x7f1a20007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a291c9700 1 --2- 172.21.15.63:0/1970757247 >> v2:172.21.15.63:3300/0 conn(0x7f1a2405f110 0x7f1a240b4760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1a20002f70 tx=0x7f1a20007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a291c9700 1 --2- 172.21.15.63:0/1970757247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a2405f110 0x7f1a240b4760 secure :-1 s=READY pgs=528 cs=0 l=1 rx=0x7f1a20002f70 tx=0x7f1a20007a80).ready entity=mon.0 client_cookie=e67db34e731abec1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:25.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a291c9700 1 --2- 172.21.15.63:0/1970757247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a2405f110 0x7f1a240b4760 secure :-1 s=THROTTLE_DONE pgs=528 cs=0 l=1 rx=0x7f1a20002f70 tx=0x7f1a20007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a17fff700 1 -- 172.21.15.63:0/1970757247 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a200116b0 con 0x7f1a2405f110 2020-05-18T21:28:25.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a291c9700 1 --2- 172.21.15.63:0/1970757247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a2405f110 0x7f1a240b4760 secure :-1 s=THROTTLE_DONE pgs=528 cs=0 l=1 rx=0x7f1a20002f70 tx=0x7f1a20007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a17fff700 1 -- 172.21.15.63:0/1970757247 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a20011810 con 0x7f1a2405f110 2020-05-18T21:28:25.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a291c9700 1 --2- 172.21.15.63:0/1970757247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a2405f110 0x7f1a240b4760 secure :-1 s=THROTTLE_DONE pgs=528 cs=0 l=1 rx=0x7f1a20002f70 tx=0x7f1a20007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a17fff700 1 -- 172.21.15.63:0/1970757247 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a20011bf0 con 0x7f1a2405f110 2020-05-18T21:28:25.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a2a1cb700 1 -- 172.21.15.63:0/1970757247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a2405f110 msgr2=0x7f1a240b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a2a1cb700 1 --2- 172.21.15.63:0/1970757247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a2405f110 0x7f1a240b4760 secure :-1 s=READY pgs=528 cs=0 l=1 rx=0x7f1a20002f70 tx=0x7f1a20007a80).stop 2020-05-18T21:28:25.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a2a1cb700 1 -- 172.21.15.63:0/1970757247 shutdown_connections 2020-05-18T21:28:25.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a2a1cb700 1 --2- 172.21.15.63:0/1970757247 >> v2:172.21.15.155:3300/0 conn(0x7f1a2414aa70 0x7f1a240648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:25.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a2a1cb700 1 --2- 172.21.15.63:0/1970757247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a2405f110 0x7f1a240b4760 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:25.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a2a1cb700 1 -- 172.21.15.63:0/1970757247 >> 172.21.15.63:0/1970757247 conn(0x7f1a24069fc0 msgr2=0x7f1a2406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:25.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a2a1cb700 1 -- 172.21.15.63:0/1970757247 shutdown_connections 2020-05-18T21:28:25.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.661+0000 7f1a2a1cb700 1 -- 172.21.15.63:0/1970757247 wait complete. 2020-05-18T21:28:25.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.665+0000 7f1a2a1cb700 1 Processor -- start 2020-05-18T21:28:25.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.665+0000 7f1a2a1cb700 1 -- start start 2020-05-18T21:28:25.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.665+0000 7f1a2a1cb700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1a2405f110 0x7f1a24139790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:25.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.665+0000 7f1a2a1cb700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1a2414aa70 0x7f1a2414d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:25.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.665+0000 7f1a2a1cb700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2414cac0 con 0x7f1a24064d20 2020-05-18T21:28:25.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.665+0000 7f1a2a1cb700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a24139bf0 con 0x7f1a2414aa70 2020-05-18T21:28:25.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.665+0000 7f1a2a1cb700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2414cd60 con 0x7f1a2405f110 2020-05-18T21:28:25.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.665+0000 7f1a299ca700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1a2414aa70 0x7f1a2414d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:25.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.665+0000 7f1a291c9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1a2405f110 0x7f1a24139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:25.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.665+0000 7f1a289c8700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f1a24064d20 0x7f1a240b6690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:55682/0 (socket says 172.21.15.63:55682) 2020-05-18T21:28:25.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.665+0000 7f1a289c8700 1 -- 172.21.15.63:0/2649484599 learned_addr learned my addr 172.21.15.63:0/2649484599 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:25.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.665+0000 7f1a291c9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1a2405f110 0x7f1a24139790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:41792/0 (socket says 172.21.15.63:41792) 2020-05-18T21:28:25.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.665+0000 7f1a299ca700 1 --2- 172.21.15.63:0/2649484599 >> v2:172.21.15.63:3300/0 conn(0x7f1a2414aa70 0x7f1a2414d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55180/0 (socket says 172.21.15.63:55180) 2020-05-18T21:28:25.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a167fc700 1 -- 172.21.15.63:0/2649484599 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539847506 0 0) 0x7f1a2414cac0 con 0x7f1a24064d20 2020-05-18T21:28:25.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a167fc700 1 -- 172.21.15.63:0/2649484599 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a0c002fe0 con 0x7f1a24064d20 2020-05-18T21:28:25.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a299ca700 1 -- 172.21.15.63:0/2649484599 >> v2:172.21.15.155:3300/0 conn(0x7f1a2405f110 msgr2=0x7f1a24139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a299ca700 1 --2- 172.21.15.63:0/2649484599 >> v2:172.21.15.155:3300/0 conn(0x7f1a2405f110 0x7f1a24139790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:25.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a299ca700 1 -- 172.21.15.63:0/2649484599 >> v1:172.21.15.155:6789/0 conn(0x7f1a24064d20 legacy=0x7f1a240b6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a299ca700 1 -- 172.21.15.63:0/2649484599 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2414d000 con 0x7f1a2414aa70 2020-05-18T21:28:25.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a299ca700 1 --2- 172.21.15.63:0/2649484599 >> v2:172.21.15.63:3300/0 conn(0x7f1a2414aa70 0x7f1a2414d250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1a1c000f40 tx=0x7f1a1c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a299ca700 1 --2- 172.21.15.63:0/2649484599 >> v2:172.21.15.63:3300/0 conn(0x7f1a2414aa70 0x7f1a2414d250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1a1c000f40 tx=0x7f1a1c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a299ca700 1 --2- 172.21.15.63:0/2649484599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a2414aa70 0x7f1a2414d250 secure :-1 s=READY pgs=529 cs=0 l=1 rx=0x7f1a1c000f40 tx=0x7f1a1c010bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:25.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a299ca700 1 --2- 172.21.15.63:0/2649484599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a2414aa70 0x7f1a2414d250 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7f1a1c000f40 tx=0x7f1a1c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a167fc700 1 -- 172.21.15.63:0/2649484599 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a1c002280 con 0x7f1a2414aa70 2020-05-18T21:28:25.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a299ca700 1 --2- 172.21.15.63:0/2649484599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a2414aa70 0x7f1a2414d250 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7f1a1c000f40 tx=0x7f1a1c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a299ca700 1 --2- 172.21.15.63:0/2649484599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a2414aa70 0x7f1a2414d250 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7f1a1c000f40 tx=0x7f1a1c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a167fc700 1 -- 172.21.15.63:0/2649484599 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c002420 con 0x7f1a2414aa70 2020-05-18T21:28:25.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a2a1cb700 1 -- 172.21.15.63:0/2649484599 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2414dd90 con 0x7f1a2414aa70 2020-05-18T21:28:25.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a167fc700 1 -- 172.21.15.63:0/2649484599 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a1c002840 con 0x7f1a2414aa70 2020-05-18T21:28:25.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a2a1cb700 1 -- 172.21.15.63:0/2649484599 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a240b7140 con 0x7f1a2414aa70 2020-05-18T21:28:25.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a299ca700 1 --2- 172.21.15.63:0/2649484599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a2414aa70 0x7f1a2414d250 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7f1a1c000f40 tx=0x7f1a1c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a2a1cb700 1 -- 172.21.15.63:0/2649484599 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a24157930 con 0x7f1a2414aa70 2020-05-18T21:28:25.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a167fc700 1 -- 172.21.15.63:0/2649484599 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1a1c002ab0 con 0x7f1a2414aa70 2020-05-18T21:28:25.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.669+0000 7f1a299ca700 1 --2- 172.21.15.63:0/2649484599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a2414aa70 0x7f1a2414d250 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7f1a1c000f40 tx=0x7f1a1c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.673+0000 7f1a167fc700 1 --2- 172.21.15.63:0/2649484599 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1a0c04fd10 0x7f1a0c0521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:25.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.673+0000 7f1a167fc700 1 -- 172.21.15.63:0/2649484599 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1a1c064110 con 0x7f1a2414aa70 2020-05-18T21:28:25.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.673+0000 7f1a291c9700 1 --2- 172.21.15.63:0/2649484599 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1a0c04fd10 0x7f1a0c0521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:25.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.673+0000 7f1a291c9700 1 --2- 172.21.15.63:0/2649484599 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1a0c04fd10 0x7f1a0c0521d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1a20002f70 tx=0x7f1a20007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.673+0000 7f1a291c9700 1 --2- 172.21.15.63:0/2649484599 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1a0c04fd10 0x7f1a0c0521d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1a20002f70 tx=0x7f1a20007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.673+0000 7f1a291c9700 1 --2- 172.21.15.63:0/2649484599 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1a0c04fd10 0x7f1a0c0521d0 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7f1a20002f70 tx=0x7f1a20007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:25.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.677+0000 7f1a299ca700 1 --2- 172.21.15.63:0/2649484599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a2414aa70 0x7f1a2414d250 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7f1a1c000f40 tx=0x7f1a1c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.677+0000 7f1a167fc700 1 -- 172.21.15.63:0/2649484599 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f1a1c03e440 con 0x7f1a2414aa70 2020-05-18T21:28:25.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.825+0000 7f1a2a1cb700 1 -- 172.21.15.63:0/2649484599 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a2414df20 con 0x7f1a2414aa70 2020-05-18T21:28:25.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.825+0000 7f1a299ca700 1 --2- 172.21.15.63:0/2649484599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a2414aa70 0x7f1a2414d250 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7f1a1c000f40 tx=0x7f1a1c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:25.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.825+0000 7f1a167fc700 1 -- 172.21.15.63:0/2649484599 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+2138 (secure 0 0 0) 0x7f1a1c041a60 con 0x7f1a2414aa70 2020-05-18T21:28:25.832 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:25.832 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593103128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593103128},{"type":"v1","addr":"172.21.15.155:6835","nonce":593103128}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:28:08.611856+0000","modified":"2020-05-18T21:28:09.616560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/3182633142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3182633142},{"type":"v1","addr":"172.21.15.63:6833","nonce":3182633142}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-05-18T21:28:25.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.825+0000 7f1a2a1cb700 1 -- 172.21.15.63:0/2649484599 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1a0c04fd10 msgr2=0x7f1a0c0521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.825+0000 7f1a2a1cb700 1 --2- 172.21.15.63:0/2649484599 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1a0c04fd10 0x7f1a0c0521d0 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7f1a20002f70 tx=0x7f1a20007a80).stop 2020-05-18T21:28:25.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.825+0000 7f1a2a1cb700 1 -- 172.21.15.63:0/2649484599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a2414aa70 msgr2=0x7f1a2414d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:25.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.825+0000 7f1a2a1cb700 1 --2- 172.21.15.63:0/2649484599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a2414aa70 0x7f1a2414d250 secure :-1 s=READY pgs=529 cs=0 l=1 rx=0x7f1a1c000f40 tx=0x7f1a1c010bb0).stop 2020-05-18T21:28:25.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.825+0000 7f1a2a1cb700 1 -- 172.21.15.63:0/2649484599 shutdown_connections 2020-05-18T21:28:25.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.825+0000 7f1a2a1cb700 1 --2- 172.21.15.63:0/2649484599 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1a0c04fd10 0x7f1a0c0521d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:25.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.825+0000 7f1a2a1cb700 1 --2- 172.21.15.63:0/2649484599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a2414aa70 0x7f1a2414d250 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:25.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.825+0000 7f1a2a1cb700 1 --2- 172.21.15.63:0/2649484599 >> v2:172.21.15.155:3300/0 conn(0x7f1a2405f110 0x7f1a24139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:25.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.825+0000 7f1a2a1cb700 1 -- 172.21.15.63:0/2649484599 >> 172.21.15.63:0/2649484599 conn(0x7f1a24069fc0 msgr2=0x7f1a2406a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:25.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.829+0000 7f1a2a1cb700 1 -- 172.21.15.63:0/2649484599 shutdown_connections 2020-05-18T21:28:25.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:25.829+0000 7f1a2a1cb700 1 -- 172.21.15.63:0/2649484599 wait complete. 2020-05-18T21:28:25.838 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2020-05-18T21:28:26.045 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:28:08.611856+0000', 'modified': '2020-05-18T21:28:09.616560+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5413}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5413': {'gid': 5413, 'name': 'a', 'rank': 0, 'incarnation': 16, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/3182633142', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 3182633142}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 3182633142}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:28:26.046 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:28:26.047 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:28:26.156 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:28:26.157 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:28:26.157 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:28:26.157 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 5413, 2020-05-18T21:28:26.158 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:28:26.158 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:28:26.158 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 17.536956151999998, 2020-05-18T21:28:26.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 17, 2020-05-18T21:28:26.159 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 41, 2020-05-18T21:28:26.159 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 41, 2020-05-18T21:28:26.159 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 21.753938747999999 2020-05-18T21:28:26.159 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:28:26.167 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 5413, "want_state": "up:active", "state": "up:active", "rank_uptime": 17.536956151999998, "mdsmap_epoch": 17, "osdmap_epoch": 41, "osdmap_epoch_barrier": 41, "uptime": 21.753938747999999 } 2020-05-18T21:28:26.167 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:28:26.168 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:28:26.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.169 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:28:26.177 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:28:26.177 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:28:26.177 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:28:26.178 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:26.178 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:28:26.178 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:26.178 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:26.179 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:26.179 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:26.179 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:26.180 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:26.180 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:26.180 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:28:26.180 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:26.180 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:28:26.181 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42736sec preferred_lft 42736sec 2020-05-18T21:28:26.181 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:28:26.181 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:26.182 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:28:26.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.183 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:28:26.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.201 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:28:26.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.215 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:28:26.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.276 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:28:26.289 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:28:26.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.291 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:28:26.298 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:28:26.299 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:28:26.299 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:28:26.299 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:28:26.299 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:28:26.299 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:28:26.300 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:28:26.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.301 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:28:26.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.360 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:28:26.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.376 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:28:26.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.394 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:28:26.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.446 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:28:26.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.453 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:28:26.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.475 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-05-18T21:28:26.533 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-05-18T21:28:26.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.535 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-05-18T21:28:26.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.552 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:28:26.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.571 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-05-18T21:28:26.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.633 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-05-18T21:28:26.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.650 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-05-18T21:28:26.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.669 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 up' 2020-05-18T21:28:26.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:26.686 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.0 master ceph-brx' 2020-05-18T21:28:26.749 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-05-18T21:28:26.750 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-05-18T21:28:26.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:26.751 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:26.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:26.759 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:28:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:28:26.777 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:28:26.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:26.779 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:28:26.828 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:28:26.829 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:26.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:26.832 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:28:26.849 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:28:26.851 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:28:26.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:26.852 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:28:26.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2020-05-18T21:28:26.909+0000 7f4acdbce080 -1 init, newargv = 0x55ed530ac530 newargc=9 2020-05-18T21:28:26.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[19523]: starting ceph client 2020-05-18T21:28:26.927 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[19523]: starting fuse 2020-05-18T21:28:28.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:28.001 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:28:28.017 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:28:28.018 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:28:28.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:28.019 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:28:28.026 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:28:28.027 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:28:28.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:28.028 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:28:28.028 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:28:28.029 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:28:28.029 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:28:28.029 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:28:28.030 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:28:28.030 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:28:28.031 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:28:28.031 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:28:28.032 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:28:28.032 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:28:28.032 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:28:28.033 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:28:28.033 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:28:28.034 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:28:28.034 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:28:28.035 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:28:28.035 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:28:28.036 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:28:28.036 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:28:28.036 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:28:28.037 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:28:28.038 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:28:28.082 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.19523.asok 2020-05-18T21:28:28.087 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.19523.asok 2020-05-18T21:28:28.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:28.088 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.19523.asok status 2020-05-18T21:28:28.222 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:28:28.222 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:28:28.222 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:28:28.223 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:28:28.223 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:28:28.223 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:28:28.223 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:28:28.223 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "19523", 2020-05-18T21:28:28.224 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:28:28.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:28.224 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:28:28.224 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:28:28.224 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 5733, 2020-05-18T21:28:28.224 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:28:28.225 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:28:28.225 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:28:28.225 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 5733 2020-05-18T21:28:28.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:28.225 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:28:28.226 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:28.226 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:28:28.226 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 583032371 2020-05-18T21:28:28.226 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:28.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:28.226 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:28:28.227 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:28.227 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:28:28.227 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 583032371 2020-05-18T21:28:28.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:28.227 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.5733 192.168.0.1:0/583032371", 2020-05-18T21:28:28.228 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/583032371", 2020-05-18T21:28:28.228 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:28:28.228 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 17, 2020-05-18T21:28:28.228 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 41, 2020-05-18T21:28:28.228 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:28:28.228 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:28:28.229 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:28:28.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:28.231 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:28:28.231 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:28.240 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:28:28.240 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-05-18T21:28:28.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:28.241 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:28.260 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:28:28.260 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:28:28.261 INFO:teuthology.orchestra.run.smithi063:> path = os.path.join("/home/ubuntu/cephtest/mnt.0", "subdir2") 2020-05-18T21:28:28.261 INFO:teuthology.orchestra.run.smithi063:> for n in range(50, (50*3)//2): 2020-05-18T21:28:28.262 INFO:teuthology.orchestra.run.smithi063:> with open(os.path.join(path, "%s" % n), '"'"'w'"'"') as f: 2020-05-18T21:28:28.262 INFO:teuthology.orchestra.run.smithi063:> f.write(str(n)) 2020-05-18T21:28:28.262 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:28:28.570 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:28:28.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.677+0000 7efde2546700 1 Processor -- start 2020-05-18T21:28:28.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.677+0000 7efde2546700 1 -- start start 2020-05-18T21:28:28.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.677+0000 7efde2546700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efddc1435d0 0x7efddc063ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:28.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.677+0000 7efde2546700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efddc147140 0x7efddc05edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:28.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.677+0000 7efde2546700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efddc1480a0 con 0x7efddc05f230 2020-05-18T21:28:28.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.677+0000 7efde2546700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efddc1476c0 con 0x7efddc1435d0 2020-05-18T21:28:28.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.677+0000 7efde2546700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efddc147960 con 0x7efddc147140 2020-05-18T21:28:28.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.677+0000 7efde1544700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efddc1435d0 0x7efddc063ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:28.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.677+0000 7efde1544700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efddc1435d0 0x7efddc063ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55216/0 (socket says 172.21.15.63:55216) 2020-05-18T21:28:28.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.677+0000 7efde1544700 1 -- 172.21.15.63:0/1727040285 learned_addr learned my addr 172.21.15.63:0/1727040285 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:28.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.677+0000 7efde0d43700 1 --2- 172.21.15.63:0/1727040285 >> v2:172.21.15.155:3300/0 conn(0x7efddc147140 0x7efddc05edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:28.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.677+0000 7efde1544700 1 -- 172.21.15.63:0/1727040285 >> v2:172.21.15.155:3300/0 conn(0x7efddc147140 msgr2=0x7efddc05edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:28.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.677+0000 7efde1544700 1 --2- 172.21.15.63:0/1727040285 >> v2:172.21.15.155:3300/0 conn(0x7efddc147140 0x7efddc05edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:28.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.677+0000 7efde1544700 1 -- 172.21.15.63:0/1727040285 >> v1:172.21.15.155:6789/0 conn(0x7efddc05f230 legacy=0x7efddc0b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:28.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.677+0000 7efde1544700 1 -- 172.21.15.63:0/1727040285 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc147c00 con 0x7efddc1435d0 2020-05-18T21:28:28.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.677+0000 7efde0d43700 1 --2- 172.21.15.63:0/1727040285 >> v2:172.21.15.155:3300/0 conn(0x7efddc147140 0x7efddc05edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:28:28.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.677+0000 7efde1544700 1 --2- 172.21.15.63:0/1727040285 >> v2:172.21.15.63:3300/0 conn(0x7efddc1435d0 0x7efddc063ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efdd0002f70 tx=0x7efdd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:28.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.677+0000 7efde1544700 1 --2- 172.21.15.63:0/1727040285 >> v2:172.21.15.63:3300/0 conn(0x7efddc1435d0 0x7efddc063ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efdd0002f70 tx=0x7efdd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:28.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.677+0000 7efde1544700 1 --2- 172.21.15.63:0/1727040285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efddc1435d0 0x7efddc063ce0 secure :-1 s=READY pgs=534 cs=0 l=1 rx=0x7efdd0002f70 tx=0x7efdd0007a80).ready entity=mon.0 client_cookie=28210e1a83c64f9f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:28.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.681+0000 7efde1544700 1 --2- 172.21.15.63:0/1727040285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efddc1435d0 0x7efddc063ce0 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7efdd0002f70 tx=0x7efdd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:28.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.681+0000 7efdc7fff700 1 -- 172.21.15.63:0/1727040285 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd0011760 con 0x7efddc1435d0 2020-05-18T21:28:28.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.681+0000 7efde1544700 1 --2- 172.21.15.63:0/1727040285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efddc1435d0 0x7efddc063ce0 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7efdd0002f70 tx=0x7efdd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:28.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.681+0000 7efdc7fff700 1 -- 172.21.15.63:0/1727040285 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd00118c0 con 0x7efddc1435d0 2020-05-18T21:28:28.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.681+0000 7efde1544700 1 --2- 172.21.15.63:0/1727040285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efddc1435d0 0x7efddc063ce0 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7efdd0002f70 tx=0x7efdd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:28.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.681+0000 7efde2546700 1 -- 172.21.15.63:0/1727040285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efddc1435d0 msgr2=0x7efddc063ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:28.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.681+0000 7efdc7fff700 1 -- 172.21.15.63:0/1727040285 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd0011ce0 con 0x7efddc1435d0 2020-05-18T21:28:28.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.681+0000 7efde2546700 1 --2- 172.21.15.63:0/1727040285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efddc1435d0 0x7efddc063ce0 secure :-1 s=READY pgs=534 cs=0 l=1 rx=0x7efdd0002f70 tx=0x7efdd0007a80).stop 2020-05-18T21:28:28.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.681+0000 7efde2546700 1 -- 172.21.15.63:0/1727040285 shutdown_connections 2020-05-18T21:28:28.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.681+0000 7efde2546700 1 --2- 172.21.15.63:0/1727040285 >> v2:172.21.15.155:3300/0 conn(0x7efddc147140 0x7efddc05edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:28.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.681+0000 7efde2546700 1 --2- 172.21.15.63:0/1727040285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efddc1435d0 0x7efddc063ce0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:28.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.681+0000 7efde2546700 1 -- 172.21.15.63:0/1727040285 >> 172.21.15.63:0/1727040285 conn(0x7efddc069fc0 msgr2=0x7efddc06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:28.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.681+0000 7efde2546700 1 -- 172.21.15.63:0/1727040285 shutdown_connections 2020-05-18T21:28:28.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.681+0000 7efde2546700 1 -- 172.21.15.63:0/1727040285 wait complete. 2020-05-18T21:28:28.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.681+0000 7efde2546700 1 Processor -- start 2020-05-18T21:28:28.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.681+0000 7efde2546700 1 -- start start 2020-05-18T21:28:28.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde2546700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efddc05f230 0x7efddc1447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:28.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde2546700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efddc1435d0 0x7efddc151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:28.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde2546700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efddc143de0 con 0x7efddc147140 2020-05-18T21:28:28.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde2546700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efddc144080 con 0x7efddc05f230 2020-05-18T21:28:28.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde2546700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efddc144320 con 0x7efddc1435d0 2020-05-18T21:28:28.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde1544700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efddc05f230 0x7efddc1447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:28.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde1544700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efddc05f230 0x7efddc1447c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55220/0 (socket says 172.21.15.63:55220) 2020-05-18T21:28:28.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde1544700 1 -- 172.21.15.63:0/3323159732 learned_addr learned my addr 172.21.15.63:0/3323159732 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:28.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde0d43700 1 --2- 172.21.15.63:0/3323159732 >> v2:172.21.15.155:3300/0 conn(0x7efddc1435d0 0x7efddc151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:28.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde1544700 1 -- 172.21.15.63:0/3323159732 >> v2:172.21.15.155:3300/0 conn(0x7efddc1435d0 msgr2=0x7efddc151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:28.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde1544700 1 --2- 172.21.15.63:0/3323159732 >> v2:172.21.15.155:3300/0 conn(0x7efddc1435d0 0x7efddc151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:28.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde1544700 1 -- 172.21.15.63:0/3323159732 >> v1:172.21.15.155:6789/0 conn(0x7efddc147140 legacy=0x7efddc13d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:28.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde1544700 1 -- 172.21.15.63:0/3323159732 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc0ada40 con 0x7efddc05f230 2020-05-18T21:28:28.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde1544700 1 --2- 172.21.15.63:0/3323159732 >> v2:172.21.15.63:3300/0 conn(0x7efddc05f230 0x7efddc1447c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efdd0002f70 tx=0x7efdd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:28.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde1544700 1 --2- 172.21.15.63:0/3323159732 >> v2:172.21.15.63:3300/0 conn(0x7efddc05f230 0x7efddc1447c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efdd0002f70 tx=0x7efdd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:28.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde1544700 1 --2- 172.21.15.63:0/3323159732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efddc05f230 0x7efddc1447c0 secure :-1 s=READY pgs=535 cs=0 l=1 rx=0x7efdd0002f70 tx=0x7efdd0007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:28.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde1544700 1 --2- 172.21.15.63:0/3323159732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efddc05f230 0x7efddc1447c0 secure :-1 s=THROTTLE_DONE pgs=535 cs=0 l=1 rx=0x7efdd0002f70 tx=0x7efdd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:28.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efdceffd700 1 -- 172.21.15.63:0/3323159732 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd000f960 con 0x7efddc05f230 2020-05-18T21:28:28.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde1544700 1 --2- 172.21.15.63:0/3323159732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efddc05f230 0x7efddc1447c0 secure :-1 s=THROTTLE_DONE pgs=535 cs=0 l=1 rx=0x7efdd0002f70 tx=0x7efdd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:28.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde1544700 1 --2- 172.21.15.63:0/3323159732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efddc05f230 0x7efddc1447c0 secure :-1 s=THROTTLE_DONE pgs=535 cs=0 l=1 rx=0x7efdd0002f70 tx=0x7efdd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:28.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efdceffd700 1 -- 172.21.15.63:0/3323159732 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd0007170 con 0x7efddc05f230 2020-05-18T21:28:28.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde2546700 1 -- 172.21.15.63:0/3323159732 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efddc1439b0 con 0x7efddc05f230 2020-05-18T21:28:28.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efdceffd700 1 -- 172.21.15.63:0/3323159732 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd0007510 con 0x7efddc05f230 2020-05-18T21:28:28.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.685+0000 7efde2546700 1 -- 172.21.15.63:0/3323159732 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efddc150750 con 0x7efddc05f230 2020-05-18T21:28:28.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.689+0000 7efde1544700 1 --2- 172.21.15.63:0/3323159732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efddc05f230 0x7efddc1447c0 secure :-1 s=THROTTLE_DONE pgs=535 cs=0 l=1 rx=0x7efdd0002f70 tx=0x7efdd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:28.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.689+0000 7efde2546700 1 -- 172.21.15.63:0/3323159732 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efddc0569e0 con 0x7efddc05f230 2020-05-18T21:28:28.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.689+0000 7efdceffd700 1 -- 172.21.15.63:0/3323159732 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7efdd0005700 con 0x7efddc05f230 2020-05-18T21:28:28.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.689+0000 7efde1544700 1 --2- 172.21.15.63:0/3323159732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efddc05f230 0x7efddc1447c0 secure :-1 s=THROTTLE_DONE pgs=535 cs=0 l=1 rx=0x7efdd0002f70 tx=0x7efdd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:28.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.689+0000 7efdceffd700 1 --2- 172.21.15.63:0/3323159732 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdb804f9c0 0x7efdb8051e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:28.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.689+0000 7efdceffd700 1 -- 172.21.15.63:0/3323159732 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efdd00643b0 con 0x7efddc05f230 2020-05-18T21:28:28.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.689+0000 7efde0d43700 1 --2- 172.21.15.63:0/3323159732 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdb804f9c0 0x7efdb8051e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:28.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.689+0000 7efde0d43700 1 --2- 172.21.15.63:0/3323159732 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdb804f9c0 0x7efdb8051e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efdd8002f70 tx=0x7efdd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:28.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.689+0000 7efde0d43700 1 --2- 172.21.15.63:0/3323159732 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdb804f9c0 0x7efdb8051e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efdd8002f70 tx=0x7efdd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:28.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.689+0000 7efde0d43700 1 --2- 172.21.15.63:0/3323159732 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdb804f9c0 0x7efdb8051e80 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7efdd8002f70 tx=0x7efdd8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:28.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.697+0000 7efde1544700 1 --2- 172.21.15.63:0/3323159732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efddc05f230 0x7efddc1447c0 secure :-1 s=THROTTLE_DONE pgs=535 cs=0 l=1 rx=0x7efdd0002f70 tx=0x7efdd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:28.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.697+0000 7efdceffd700 1 -- 172.21.15.63:0/3323159732 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7efdd003e860 con 0x7efddc05f230 2020-05-18T21:28:28.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.845+0000 7efde2546700 1 -- 172.21.15.63:0/3323159732 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efddc150da0 con 0x7efddc05f230 2020-05-18T21:28:28.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.845+0000 7efde1544700 1 --2- 172.21.15.63:0/3323159732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efddc05f230 0x7efddc1447c0 secure :-1 s=THROTTLE_DONE pgs=535 cs=0 l=1 rx=0x7efdd0002f70 tx=0x7efdd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:28.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.845+0000 7efdceffd700 1 -- 172.21.15.63:0/3323159732 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+2138 (secure 0 0 0) 0x7efdd0041e80 con 0x7efddc05f230 2020-05-18T21:28:28.853 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:28.853 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593103128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593103128},{"type":"v1","addr":"172.21.15.155:6835","nonce":593103128}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:28:08.611856+0000","modified":"2020-05-18T21:28:09.616560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/3182633142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3182633142},{"type":"v1","addr":"172.21.15.63:6833","nonce":3182633142}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-05-18T21:28:28.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.849+0000 7efde2546700 1 -- 172.21.15.63:0/3323159732 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdb804f9c0 msgr2=0x7efdb8051e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:28.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.849+0000 7efde2546700 1 --2- 172.21.15.63:0/3323159732 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdb804f9c0 0x7efdb8051e80 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7efdd8002f70 tx=0x7efdd8007a80).stop 2020-05-18T21:28:28.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.849+0000 7efde2546700 1 -- 172.21.15.63:0/3323159732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efddc05f230 msgr2=0x7efddc1447c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:28.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.849+0000 7efde2546700 1 --2- 172.21.15.63:0/3323159732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efddc05f230 0x7efddc1447c0 secure :-1 s=READY pgs=535 cs=0 l=1 rx=0x7efdd0002f70 tx=0x7efdd0007a80).stop 2020-05-18T21:28:28.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.849+0000 7efde2546700 1 -- 172.21.15.63:0/3323159732 shutdown_connections 2020-05-18T21:28:28.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.849+0000 7efde2546700 1 --2- 172.21.15.63:0/3323159732 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdb804f9c0 0x7efdb8051e80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:28.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.849+0000 7efde2546700 1 --2- 172.21.15.63:0/3323159732 >> v2:172.21.15.155:3300/0 conn(0x7efddc1435d0 0x7efddc151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:28.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.849+0000 7efde2546700 1 --2- 172.21.15.63:0/3323159732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efddc05f230 0x7efddc1447c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:28.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.849+0000 7efde2546700 1 -- 172.21.15.63:0/3323159732 >> 172.21.15.63:0/3323159732 conn(0x7efddc069fc0 msgr2=0x7efddc0b4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:28.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.849+0000 7efde2546700 1 -- 172.21.15.63:0/3323159732 shutdown_connections 2020-05-18T21:28:28.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:28.849+0000 7efde2546700 1 -- 172.21.15.63:0/3323159732 wait complete. 2020-05-18T21:28:28.857 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2020-05-18T21:28:28.865 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_created 2020-05-18T21:28:28.959 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:28:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:28:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_created": 0 2020-05-18T21:28:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:28.960 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:28:28.967 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_created": 0 } } 2020-05-18T21:28:28.968 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:28:28.968 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:28:28.969 INFO:teuthology.orchestra.run.smithi063:> path = os.path.join("/home/ubuntu/cephtest/mnt.0", "subdir3") 2020-05-18T21:28:28.969 INFO:teuthology.orchestra.run.smithi063:> os.mkdir(path) 2020-05-18T21:28:28.970 INFO:teuthology.orchestra.run.smithi063:> for n in range(500): 2020-05-18T21:28:28.970 INFO:teuthology.orchestra.run.smithi063:> fpath = os.path.join(path, "%s" % n) 2020-05-18T21:28:28.971 INFO:teuthology.orchestra.run.smithi063:> with open(fpath, '"'"'w'"'"') as f: 2020-05-18T21:28:28.971 INFO:teuthology.orchestra.run.smithi063:> f.write(str(n)) 2020-05-18T21:28:28.971 INFO:teuthology.orchestra.run.smithi063:> os.unlink(fpath) 2020-05-18T21:28:28.972 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:28:29.023 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:28:29.025 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:28:29.355 INFO:teuthology.orchestra.run.smithi063.stderr:Traceback (most recent call last): 2020-05-18T21:28:29.355 INFO:teuthology.orchestra.run.smithi063.stderr: File "", line 9, in 2020-05-18T21:28:29.355 INFO:teuthology.orchestra.run.smithi063.stderr:OSError: [Errno 28] No space left on device: '/home/ubuntu/cephtest/mnt.0/subdir3/50' 2020-05-18T21:28:29.423 INFO:teuthology.orchestra.run.smithi063.stderr:daemon-helper: command failed with exit status 1 2020-05-18T21:28:29.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:28:29.436 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:28:29.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.533+0000 7f50890d2700 1 Processor -- start 2020-05-18T21:28:29.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.533+0000 7f50890d2700 1 -- start start 2020-05-18T21:28:29.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.533+0000 7f50890d2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5084147110 0x7f508412cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:29.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.533+0000 7f50890d2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5084063370 0x7f508412cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:29.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.533+0000 7f50890d2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5084144080 con 0x7f50840b71e0 2020-05-18T21:28:29.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.533+0000 7f50890d2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5084143ea0 con 0x7f5084147110 2020-05-18T21:28:29.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.533+0000 7f50890d2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508412d3d0 con 0x7f5084063370 2020-05-18T21:28:29.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.533+0000 7f507bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5084147110 0x7f508412cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:29.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.533+0000 7f5083fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f50840b71e0 0x7f5084144520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:55734/0 (socket says 172.21.15.63:55734) 2020-05-18T21:28:29.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.533+0000 7f507bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5084147110 0x7f508412cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:41848/0 (socket says 172.21.15.63:41848) 2020-05-18T21:28:29.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.533+0000 7f50888d1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5084063370 0x7f508412cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:29.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.533+0000 7f507bfff700 1 -- 172.21.15.63:0/4212139553 learned_addr learned my addr 172.21.15.63:0/4212139553 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:29.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.533+0000 7f507bfff700 1 -- 172.21.15.63:0/4212139553 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5084063370 msgr2=0x7f508412cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:29.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.533+0000 7f507bfff700 1 --2- 172.21.15.63:0/4212139553 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5084063370 0x7f508412cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:29.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.533+0000 7f507bfff700 1 -- 172.21.15.63:0/4212139553 >> v1:172.21.15.155:6789/0 conn(0x7f50840b71e0 legacy=0x7f5084144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:29.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f507bfff700 1 -- 172.21.15.63:0/4212139553 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5084143b10 con 0x7f5084147110 2020-05-18T21:28:29.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f50888d1700 1 --2- 172.21.15.63:0/4212139553 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5084063370 0x7f508412cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:29.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f507bfff700 1 --2- 172.21.15.63:0/4212139553 >> v2:172.21.15.155:3300/0 conn(0x7f5084147110 0x7f508412cb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f50840648c0 tx=0x7f506c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f507bfff700 1 --2- 172.21.15.63:0/4212139553 >> v2:172.21.15.155:3300/0 conn(0x7f5084147110 0x7f508412cb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f50840648c0 tx=0x7f506c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f507bfff700 1 --2- 172.21.15.63:0/4212139553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5084147110 0x7f508412cb10 secure :-1 s=READY pgs=380 cs=0 l=1 rx=0x7f50840648c0 tx=0x7f506c008920).ready entity=mon.1 client_cookie=5de4fa4cd047282b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:29.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f507bfff700 1 --2- 172.21.15.63:0/4212139553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5084147110 0x7f508412cb10 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f50840648c0 tx=0x7f506c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f507bfff700 1 --2- 172.21.15.63:0/4212139553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5084147110 0x7f508412cb10 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f50840648c0 tx=0x7f506c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f50837fe700 1 -- 172.21.15.63:0/4212139553 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f506c0116b0 con 0x7f5084147110 2020-05-18T21:28:29.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f507bfff700 1 --2- 172.21.15.63:0/4212139553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5084147110 0x7f508412cb10 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f50840648c0 tx=0x7f506c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f50837fe700 1 -- 172.21.15.63:0/4212139553 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c011810 con 0x7f5084147110 2020-05-18T21:28:29.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f50837fe700 1 -- 172.21.15.63:0/4212139553 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f506c011c30 con 0x7f5084147110 2020-05-18T21:28:29.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f50890d2700 1 -- 172.21.15.63:0/4212139553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5084147110 msgr2=0x7f508412cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:29.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f50890d2700 1 --2- 172.21.15.63:0/4212139553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5084147110 0x7f508412cb10 secure :-1 s=READY pgs=380 cs=0 l=1 rx=0x7f50840648c0 tx=0x7f506c008920).stop 2020-05-18T21:28:29.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f50890d2700 1 -- 172.21.15.63:0/4212139553 shutdown_connections 2020-05-18T21:28:29.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f50890d2700 1 --2- 172.21.15.63:0/4212139553 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5084063370 0x7f508412cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:29.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f50890d2700 1 --2- 172.21.15.63:0/4212139553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5084147110 0x7f508412cb10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:29.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f50890d2700 1 -- 172.21.15.63:0/4212139553 >> 172.21.15.63:0/4212139553 conn(0x7f508405eee0 msgr2=0x7f508405f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:29.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f50890d2700 1 -- 172.21.15.63:0/4212139553 shutdown_connections 2020-05-18T21:28:29.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f50890d2700 1 -- 172.21.15.63:0/4212139553 wait complete. 2020-05-18T21:28:29.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f50890d2700 1 Processor -- start 2020-05-18T21:28:29.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.537+0000 7f50890d2700 1 -- start start 2020-05-18T21:28:29.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f50890d2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5084063370 0x7f50840b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:29.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f50890d2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f50840b71e0 0x7f50840b8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:29.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f50890d2700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50840bac30 con 0x7f5084147110 2020-05-18T21:28:29.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f50890d2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50840baed0 con 0x7f5084063370 2020-05-18T21:28:29.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f50890d2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50840bb170 con 0x7f50840b71e0 2020-05-18T21:28:29.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f5083fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5084063370 0x7f50840b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:29.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f50888d1700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5084147110 0x7f50840b8b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57428/0 (socket says 172.21.15.63:57428) 2020-05-18T21:28:29.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f5083fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5084063370 0x7f50840b08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55236/0 (socket says 172.21.15.63:55236) 2020-05-18T21:28:29.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f50888d1700 1 -- 172.21.15.63:0/3883063345 learned_addr learned my addr 172.21.15.63:0/3883063345 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:29.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f507bfff700 1 --2- 172.21.15.63:0/3883063345 >> v2:172.21.15.155:3300/0 conn(0x7f50840b71e0 0x7f50840b8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:29.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f5083fff700 1 -- 172.21.15.63:0/3883063345 >> v2:172.21.15.155:3300/0 conn(0x7f50840b71e0 msgr2=0x7f50840b8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:29.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f5083fff700 1 --2- 172.21.15.63:0/3883063345 >> v2:172.21.15.155:3300/0 conn(0x7f50840b71e0 0x7f50840b8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:29.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f5081ffb700 1 -- 172.21.15.63:0/3883063345 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376196434 0 0) 0x7f50840bac30 con 0x7f5084147110 2020-05-18T21:28:29.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f5083fff700 1 -- 172.21.15.63:0/3883063345 >> v1:172.21.15.63:6789/0 conn(0x7f5084147110 legacy=0x7f50840b8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:29.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f5083fff700 1 -- 172.21.15.63:0/3883063345 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50840ba840 con 0x7f5084063370 2020-05-18T21:28:29.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f5083fff700 1 --2- 172.21.15.63:0/3883063345 >> v2:172.21.15.63:3300/0 conn(0x7f5084063370 0x7f50840b08e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5084060770 tx=0x7f5084066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f5083fff700 1 --2- 172.21.15.63:0/3883063345 >> v2:172.21.15.63:3300/0 conn(0x7f5084063370 0x7f50840b08e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5084060770 tx=0x7f5084066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f5083fff700 1 --2- 172.21.15.63:0/3883063345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5084063370 0x7f50840b08e0 secure :-1 s=READY pgs=537 cs=0 l=1 rx=0x7f5084060770 tx=0x7f5084066620).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:29.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f5083fff700 1 --2- 172.21.15.63:0/3883063345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5084063370 0x7f50840b08e0 secure :-1 s=THROTTLE_DONE pgs=537 cs=0 l=1 rx=0x7f5084060770 tx=0x7f5084066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f5081ffb700 1 -- 172.21.15.63:0/3883063345 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50740115a0 con 0x7f5084063370 2020-05-18T21:28:29.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f5083fff700 1 --2- 172.21.15.63:0/3883063345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5084063370 0x7f50840b08e0 secure :-1 s=THROTTLE_DONE pgs=537 cs=0 l=1 rx=0x7f5084060770 tx=0x7f5084066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f5083fff700 1 --2- 172.21.15.63:0/3883063345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5084063370 0x7f50840b08e0 secure :-1 s=THROTTLE_DONE pgs=537 cs=0 l=1 rx=0x7f5084060770 tx=0x7f5084066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f5081ffb700 1 -- 172.21.15.63:0/3883063345 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5074011700 con 0x7f5084063370 2020-05-18T21:28:29.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f50890d2700 1 -- 172.21.15.63:0/3883063345 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5084060ed0 con 0x7f5084063370 2020-05-18T21:28:29.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f5081ffb700 1 -- 172.21.15.63:0/3883063345 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5074011b20 con 0x7f5084063370 2020-05-18T21:28:29.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f50890d2700 1 -- 172.21.15.63:0/3883063345 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50840b9400 con 0x7f5084063370 2020-05-18T21:28:29.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f5083fff700 1 --2- 172.21.15.63:0/3883063345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5084063370 0x7f50840b08e0 secure :-1 s=THROTTLE_DONE pgs=537 cs=0 l=1 rx=0x7f5084060770 tx=0x7f5084066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.541+0000 7f50890d2700 1 -- 172.21.15.63:0/3883063345 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50840569e0 con 0x7f5084063370 2020-05-18T21:28:29.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.545+0000 7f5081ffb700 1 -- 172.21.15.63:0/3883063345 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f507400b370 con 0x7f5084063370 2020-05-18T21:28:29.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.545+0000 7f5083fff700 1 --2- 172.21.15.63:0/3883063345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5084063370 0x7f50840b08e0 secure :-1 s=THROTTLE_DONE pgs=537 cs=0 l=1 rx=0x7f5084060770 tx=0x7f5084066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.545+0000 7f5081ffb700 1 --2- 172.21.15.63:0/3883063345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f506804f7d0 0x7f5068051c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:29.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.545+0000 7f5081ffb700 1 -- 172.21.15.63:0/3883063345 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5074063d40 con 0x7f5084063370 2020-05-18T21:28:29.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.545+0000 7f507bfff700 1 --2- 172.21.15.63:0/3883063345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f506804f7d0 0x7f5068051c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:29.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.545+0000 7f507bfff700 1 --2- 172.21.15.63:0/3883063345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f506804f7d0 0x7f5068051c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f50840648c0 tx=0x7f5084143ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.545+0000 7f507bfff700 1 --2- 172.21.15.63:0/3883063345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f506804f7d0 0x7f5068051c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f50840648c0 tx=0x7f5084143ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.545+0000 7f507bfff700 1 --2- 172.21.15.63:0/3883063345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f506804f7d0 0x7f5068051c90 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f50840648c0 tx=0x7f5084143ca0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:29.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.553+0000 7f5083fff700 1 --2- 172.21.15.63:0/3883063345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5084063370 0x7f50840b08e0 secure :-1 s=THROTTLE_DONE pgs=537 cs=0 l=1 rx=0x7f5084060770 tx=0x7f5084066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.553+0000 7f5081ffb700 1 -- 172.21.15.63:0/3883063345 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f507403e0d0 con 0x7f5084063370 2020-05-18T21:28:29.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.701+0000 7f50890d2700 1 -- 172.21.15.63:0/3883063345 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5084147f90 con 0x7f5084063370 2020-05-18T21:28:29.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.701+0000 7f5083fff700 1 --2- 172.21.15.63:0/3883063345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5084063370 0x7f50840b08e0 secure :-1 s=THROTTLE_DONE pgs=537 cs=0 l=1 rx=0x7f5084060770 tx=0x7f5084066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.701+0000 7f5081ffb700 1 -- 172.21.15.63:0/3883063345 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+2138 (secure 0 0 0) 0x7f50740416f0 con 0x7f5084063370 2020-05-18T21:28:29.714 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:29.715 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593103128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593103128},{"type":"v1","addr":"172.21.15.155:6835","nonce":593103128}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:28:08.611856+0000","modified":"2020-05-18T21:28:09.616560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/3182633142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3182633142},{"type":"v1","addr":"172.21.15.63:6833","nonce":3182633142}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-05-18T21:28:29.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.701+0000 7f50890d2700 1 -- 172.21.15.63:0/3883063345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f506804f7d0 msgr2=0x7f5068051c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:29.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.701+0000 7f50890d2700 1 --2- 172.21.15.63:0/3883063345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f506804f7d0 0x7f5068051c90 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f50840648c0 tx=0x7f5084143ca0).stop 2020-05-18T21:28:29.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.701+0000 7f50890d2700 1 -- 172.21.15.63:0/3883063345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5084063370 msgr2=0x7f50840b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:29.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.701+0000 7f50890d2700 1 --2- 172.21.15.63:0/3883063345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5084063370 0x7f50840b08e0 secure :-1 s=READY pgs=537 cs=0 l=1 rx=0x7f5084060770 tx=0x7f5084066620).stop 2020-05-18T21:28:29.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.701+0000 7f50890d2700 1 -- 172.21.15.63:0/3883063345 shutdown_connections 2020-05-18T21:28:29.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.701+0000 7f50890d2700 1 --2- 172.21.15.63:0/3883063345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f506804f7d0 0x7f5068051c90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:29.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.701+0000 7f50890d2700 1 --2- 172.21.15.63:0/3883063345 >> v2:172.21.15.155:3300/0 conn(0x7f50840b71e0 0x7f50840b8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:29.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.701+0000 7f50890d2700 1 --2- 172.21.15.63:0/3883063345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5084063370 0x7f50840b08e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:29.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.701+0000 7f50890d2700 1 -- 172.21.15.63:0/3883063345 >> 172.21.15.63:0/3883063345 conn(0x7f508405eee0 msgr2=0x7f508405f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:29.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.701+0000 7f50890d2700 1 -- 172.21.15.63:0/3883063345 shutdown_connections 2020-05-18T21:28:29.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.701+0000 7f50890d2700 1 -- 172.21.15.63:0/3883063345 wait complete. 2020-05-18T21:28:29.719 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2020-05-18T21:28:29.720 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_created 2020-05-18T21:28:29.819 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:28:29.820 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:28:29.820 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_created": 50 2020-05-18T21:28:29.820 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:29.820 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:28:29.828 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_created": 50 } } 2020-05-18T21:28:29.829 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:28:29.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.925+0000 7fdb2b228700 1 Processor -- start 2020-05-18T21:28:29.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.925+0000 7fdb2b228700 1 -- start start 2020-05-18T21:28:29.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.925+0000 7fdb2b228700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb240b4e50 0x7fdb240b2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:29.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.925+0000 7fdb2b228700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb24149510 con 0x7fdb2409c940 2020-05-18T21:28:29.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.925+0000 7fdb2b228700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb241497b0 con 0x7fdb240b5540 2020-05-18T21:28:29.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.925+0000 7fdb2b228700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2409d0c0 con 0x7fdb240b4e50 2020-05-18T21:28:29.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.925+0000 7fdb29a25700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdb2409c940 0x7fdb24149c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57434/0 (socket says 172.21.15.63:57434) 2020-05-18T21:28:29.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.925+0000 7fdb29a25700 1 -- 172.21.15.63:0/1587929503 learned_addr learned my addr 172.21.15.63:0/1587929503 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:29.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.925+0000 7fdb2a226700 1 --2- 172.21.15.63:0/1587929503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb240b4e50 0x7fdb240b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:29.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 -- 172.21.15.63:0/1587929503 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565188329 0 0) 0x7fdb24149510 con 0x7fdb2409c940 2020-05-18T21:28:29.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 -- 172.21.15.63:0/1587929503 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb10003270 con 0x7fdb2409c940 2020-05-18T21:28:29.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 -- 172.21.15.63:0/1587929503 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884683391 0 0) 0x7fdb241497b0 con 0x7fdb240b5540 2020-05-18T21:28:29.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 -- 172.21.15.63:0/1587929503 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb24149510 con 0x7fdb240b5540 2020-05-18T21:28:29.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 -- 172.21.15.63:0/1587929503 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1668170903 0 0) 0x7fdb10003270 con 0x7fdb2409c940 2020-05-18T21:28:29.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 -- 172.21.15.63:0/1587929503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb240b4e50 msgr2=0x7fdb240b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:29.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 --2- 172.21.15.63:0/1587929503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb240b4e50 0x7fdb240b2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:29.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 -- 172.21.15.63:0/1587929503 >> v1:172.21.15.155:6789/0 conn(0x7fdb240b5540 legacy=0x7fdb24145d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:29.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 -- 172.21.15.63:0/1587929503 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb240b5230 con 0x7fdb2409c940 2020-05-18T21:28:29.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 -- 172.21.15.63:0/1587929503 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fdb18001710 con 0x7fdb2409c940 2020-05-18T21:28:29.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 -- 172.21.15.63:0/1587929503 >> v1:172.21.15.63:6789/0 conn(0x7fdb2409c940 legacy=0x7fdb24149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:29.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 --2- 172.21.15.63:0/1587929503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb10003920 0x7fdb10003d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:29.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 --2- 172.21.15.63:0/1587929503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb240b4e50 0x7fdb10004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:29.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 --2- 172.21.15.63:0/1587929503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb10004970 0x7fdb10004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:29.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 -- 172.21.15.63:0/1587929503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb10005250 con 0x7fdb10004970 2020-05-18T21:28:29.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 -- 172.21.15.63:0/1587929503 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb100053c0 con 0x7fdb10003920 2020-05-18T21:28:29.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 -- 172.21.15.63:0/1587929503 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1000b760 con 0x7fdb240b4e50 2020-05-18T21:28:29.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/1587929503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb10004970 0x7fdb10004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:29.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2a226700 1 --2- 172.21.15.63:0/1587929503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb10003920 0x7fdb10003d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:29.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29a25700 1 --2- 172.21.15.63:0/1587929503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb240b4e50 0x7fdb10004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:29.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2aa27700 1 -- 172.21.15.63:0/1587929503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb240b4e50 msgr2=0x7fdb10004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:29.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/1587929503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb240b4e50 0x7fdb10004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:29.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2aa27700 1 -- 172.21.15.63:0/1587929503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb10003920 msgr2=0x7fdb10003d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:29.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/1587929503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb10003920 0x7fdb10003d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:29.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2aa27700 1 -- 172.21.15.63:0/1587929503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb10003270 con 0x7fdb10004970 2020-05-18T21:28:29.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/1587929503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb10004970 0x7fdb10004df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdb1c001110 tx=0x7fdb1c00fe90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/1587929503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb10004970 0x7fdb10004df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdb1c001110 tx=0x7fdb1c00fe90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/1587929503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb10004970 0x7fdb10004df0 secure :-1 s=READY pgs=539 cs=0 l=1 rx=0x7fdb1c001110 tx=0x7fdb1c00fe90).ready entity=mon.0 client_cookie=1e11d74bd2564c1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:29.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/1587929503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb10004970 0x7fdb10004df0 secure :-1 s=THROTTLE_DONE pgs=539 cs=0 l=1 rx=0x7fdb1c001110 tx=0x7fdb1c00fe90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/1587929503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb10004970 0x7fdb10004df0 secure :-1 s=THROTTLE_DONE pgs=539 cs=0 l=1 rx=0x7fdb1c001110 tx=0x7fdb1c00fe90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 -- 172.21.15.63:0/1587929503 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb1c010b20 con 0x7fdb10004970 2020-05-18T21:28:29.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/1587929503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb10004970 0x7fdb10004df0 secure :-1 s=THROTTLE_DONE pgs=539 cs=0 l=1 rx=0x7fdb1c001110 tx=0x7fdb1c00fe90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:29.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 -- 172.21.15.63:0/1587929503 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1c010cc0 con 0x7fdb10004970 2020-05-18T21:28:29.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb29224700 1 -- 172.21.15.63:0/1587929503 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb1c006710 con 0x7fdb10004970 2020-05-18T21:28:29.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2b228700 1 -- 172.21.15.63:0/1587929503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb10004970 msgr2=0x7fdb10004df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:29.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2b228700 1 --2- 172.21.15.63:0/1587929503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb10004970 0x7fdb10004df0 secure :-1 s=READY pgs=539 cs=0 l=1 rx=0x7fdb1c001110 tx=0x7fdb1c00fe90).stop 2020-05-18T21:28:29.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2aa27700 1 -- 172.21.15.63:0/1587929503 reap_dead start 2020-05-18T21:28:29.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2b228700 1 -- 172.21.15.63:0/1587929503 shutdown_connections 2020-05-18T21:28:29.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2b228700 1 -- 172.21.15.63:0/1587929503 >> 172.21.15.63:0/1587929503 conn(0x7fdb2405a7c0 msgr2=0x7fdb2405aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:29.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2b228700 1 -- 172.21.15.63:0/1587929503 shutdown_connections 2020-05-18T21:28:29.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.929+0000 7fdb2b228700 1 -- 172.21.15.63:0/1587929503 wait complete. 2020-05-18T21:28:29.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2b228700 1 Processor -- start 2020-05-18T21:28:30.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2b228700 1 -- start start 2020-05-18T21:28:30.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2b228700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb240b3270 0x7fdb24144580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:30.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2b228700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb240628a0 con 0x7fdb241423e0 2020-05-18T21:28:30.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2b228700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb24141ac0 con 0x7fdb24141f60 2020-05-18T21:28:30.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2b228700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb240626c0 con 0x7fdb240b3270 2020-05-18T21:28:30.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2aa27700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdb241423e0 0x7fdb241569d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57448/0 (socket says 172.21.15.63:57448) 2020-05-18T21:28:30.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2aa27700 1 -- 172.21.15.63:0/3682896627 learned_addr learned my addr 172.21.15.63:0/3682896627 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:30.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2a226700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb240b3270 0x7fdb24144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:30.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb237fe700 1 -- 172.21.15.63:0/3682896627 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440880050 0 0) 0x7fdb240628a0 con 0x7fdb241423e0 2020-05-18T21:28:30.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb237fe700 1 -- 172.21.15.63:0/3682896627 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb04002fe0 con 0x7fdb241423e0 2020-05-18T21:28:30.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb237fe700 1 -- 172.21.15.63:0/3682896627 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4100650540 0 0) 0x7fdb04002fe0 con 0x7fdb241423e0 2020-05-18T21:28:30.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb237fe700 1 -- 172.21.15.63:0/3682896627 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdb240628a0 con 0x7fdb241423e0 2020-05-18T21:28:30.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb237fe700 1 -- 172.21.15.63:0/3682896627 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fdb1c0012f0 con 0x7fdb241423e0 2020-05-18T21:28:30.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb237fe700 1 -- 172.21.15.63:0/3682896627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb240b3270 msgr2=0x7fdb24144580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:30.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb237fe700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb240b3270 0x7fdb24144580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:30.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb237fe700 1 -- 172.21.15.63:0/3682896627 >> v1:172.21.15.155:6789/0 conn(0x7fdb24141f60 legacy=0x7fdb24063d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:30.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb237fe700 1 -- 172.21.15.63:0/3682896627 >> v1:172.21.15.63:6789/0 conn(0x7fdb241423e0 legacy=0x7fdb241569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:30.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb237fe700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb04004a80 0x7fdb04004e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:30.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb237fe700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb240b3270 0x7fdb040039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:30.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb237fe700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb04005330 0x7fdb04003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:30.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb237fe700 1 -- 172.21.15.63:0/3682896627 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb240626c0 con 0x7fdb04005330 2020-05-18T21:28:30.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb237fe700 1 -- 172.21.15.63:0/3682896627 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04004480 con 0x7fdb04004a80 2020-05-18T21:28:30.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb237fe700 1 -- 172.21.15.63:0/3682896627 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04004640 con 0x7fdb240b3270 2020-05-18T21:28:30.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb04005330 0x7fdb04003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:30.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb29a25700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb240b3270 0x7fdb040039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:30.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2a226700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb04004a80 0x7fdb04004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:30.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2aa27700 1 -- 172.21.15.63:0/3682896627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb240b3270 msgr2=0x7fdb040039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:30.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb240b3270 0x7fdb040039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:30.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2aa27700 1 -- 172.21.15.63:0/3682896627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb04004a80 msgr2=0x7fdb04004e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:30.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb04004a80 0x7fdb04004e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:30.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2aa27700 1 -- 172.21.15.63:0/3682896627 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb240b3650 con 0x7fdb04005330 2020-05-18T21:28:30.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2a226700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb04004a80 0x7fdb04004e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:28:30.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2b228700 1 -- 172.21.15.63:0/3682896627 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb24144140 con 0x7fdb04005330 2020-05-18T21:28:30.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb04005330 0x7fdb04003ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb180018f0 tx=0x7fdb1c00fe90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:30.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2b228700 1 -- 172.21.15.63:0/3682896627 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb240644a0 con 0x7fdb04005330 2020-05-18T21:28:30.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb04005330 0x7fdb04003ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb180018f0 tx=0x7fdb1c00fe90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:30.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb04005330 0x7fdb04003ea0 secure :-1 s=READY pgs=541 cs=0 l=1 rx=0x7fdb180018f0 tx=0x7fdb1c00fe90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:30.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb04005330 0x7fdb04003ea0 secure :-1 s=THROTTLE_DONE pgs=541 cs=0 l=1 rx=0x7fdb180018f0 tx=0x7fdb1c00fe90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:30.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb237fe700 1 -- 172.21.15.63:0/3682896627 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb1c0115d0 con 0x7fdb04005330 2020-05-18T21:28:30.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb04005330 0x7fdb04003ea0 secure :-1 s=THROTTLE_DONE pgs=541 cs=0 l=1 rx=0x7fdb180018f0 tx=0x7fdb1c00fe90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:30.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb237fe700 1 -- 172.21.15.63:0/3682896627 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1c011730 con 0x7fdb04005330 2020-05-18T21:28:30.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb04005330 0x7fdb04003ea0 secure :-1 s=THROTTLE_DONE pgs=541 cs=0 l=1 rx=0x7fdb180018f0 tx=0x7fdb1c00fe90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:30.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb237fe700 1 -- 172.21.15.63:0/3682896627 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb1c0101d0 con 0x7fdb04005330 2020-05-18T21:28:30.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.933+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb04005330 0x7fdb04003ea0 secure :-1 s=THROTTLE_DONE pgs=541 cs=0 l=1 rx=0x7fdb180018f0 tx=0x7fdb1c00fe90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:30.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.937+0000 7fdb2b228700 1 -- 172.21.15.63:0/3682896627 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb00003380 con 0x7fdb04005330 2020-05-18T21:28:30.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.937+0000 7fdb237fe700 1 -- 172.21.15.63:0/3682896627 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fdb1c00b0b0 con 0x7fdb04005330 2020-05-18T21:28:30.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.937+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb04005330 0x7fdb04003ea0 secure :-1 s=THROTTLE_DONE pgs=541 cs=0 l=1 rx=0x7fdb180018f0 tx=0x7fdb1c00fe90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:30.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.937+0000 7fdb237fe700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdb04057c10 0x7fdb0405a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:30.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.937+0000 7fdb237fe700 1 -- 172.21.15.63:0/3682896627 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdb1c0640b0 con 0x7fdb04005330 2020-05-18T21:28:30.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.937+0000 7fdb2a226700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdb04057c10 0x7fdb0405a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:30.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.937+0000 7fdb2a226700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdb04057c10 0x7fdb0405a0d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb140032f0 tx=0x7fdb14003290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:30.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.937+0000 7fdb2a226700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdb04057c10 0x7fdb0405a0d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb140032f0 tx=0x7fdb14003290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:30.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.937+0000 7fdb2a226700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdb04057c10 0x7fdb0405a0d0 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7fdb140032f0 tx=0x7fdb14003290).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:30.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.941+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb04005330 0x7fdb04003ea0 secure :-1 s=THROTTLE_DONE pgs=541 cs=0 l=1 rx=0x7fdb180018f0 tx=0x7fdb1c00fe90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:30.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:29.941+0000 7fdb237fe700 1 -- 172.21.15.63:0/3682896627 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fdb1c03e560 con 0x7fdb04005330 2020-05-18T21:28:30.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:30.093+0000 7fdb2b228700 1 -- 172.21.15.63:0/3682896627 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb00003720 con 0x7fdb04005330 2020-05-18T21:28:30.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:30.097+0000 7fdb2aa27700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb04005330 0x7fdb04003ea0 secure :-1 s=THROTTLE_DONE pgs=541 cs=0 l=1 rx=0x7fdb180018f0 tx=0x7fdb1c00fe90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:30.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:30.097+0000 7fdb237fe700 1 -- 172.21.15.63:0/3682896627 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+2138 (secure 0 0 0) 0x7fdb1c001e60 con 0x7fdb04005330 2020-05-18T21:28:30.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:30.097+0000 7fdb2b228700 1 -- 172.21.15.63:0/3682896627 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdb04057c10 msgr2=0x7fdb0405a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:30.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:30.097+0000 7fdb2b228700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdb04057c10 0x7fdb0405a0d0 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7fdb140032f0 tx=0x7fdb14003290).stop 2020-05-18T21:28:30.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:30.097+0000 7fdb2b228700 1 -- 172.21.15.63:0/3682896627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb04005330 msgr2=0x7fdb04003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:30.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:30.097+0000 7fdb2b228700 1 --2- 172.21.15.63:0/3682896627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb04005330 0x7fdb04003ea0 secure :-1 s=READY pgs=541 cs=0 l=1 rx=0x7fdb180018f0 tx=0x7fdb1c00fe90).stop 2020-05-18T21:28:30.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:30.097+0000 7fdb2aa27700 1 -- 172.21.15.63:0/3682896627 reap_dead start 2020-05-18T21:28:30.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:30.097+0000 7fdb2aa27700 1 -- 172.21.15.63:0/3682896627 reap_dead start 2020-05-18T21:28:30.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:30.097+0000 7fdb2b228700 1 -- 172.21.15.63:0/3682896627 shutdown_connections 2020-05-18T21:28:30.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:30.097+0000 7fdb2b228700 1 -- 172.21.15.63:0/3682896627 >> 172.21.15.63:0/3682896627 conn(0x7fdb2405a7c0 msgr2=0x7fdb24145090 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:30.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:30.097+0000 7fdb2b228700 1 -- 172.21.15.63:0/3682896627 shutdown_connections 2020-05-18T21:28:30.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:30.097+0000 7fdb2b228700 1 -- 172.21.15.63:0/3682896627 wait complete. 2020-05-18T21:28:30.186 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2020-05-18T21:28:30.187 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:30.187 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593103128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593103128},{"type":"v1","addr":"172.21.15.155:6835","nonce":593103128}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:28:08.611856+0000","modified":"2020-05-18T21:28:09.616560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/3182633142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3182633142},{"type":"v1","addr":"172.21.15.63:6833","nonce":3182633142}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-05-18T21:28:30.188 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_enqueued 2020-05-18T21:28:30.327 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:28:30.328 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:28:30.328 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 0 2020-05-18T21:28:30.328 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:30.328 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:28:30.330 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_enqueued": 0 } } 2020-05-18T21:28:30.331 DEBUG:tasks.ceph_test_case:wait_until_equal: 0 != 50, waiting (timeout=60)... 2020-05-18T21:28:35.332 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:28:35.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d829c9700 1 Processor -- start 2020-05-18T21:28:35.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d829c9700 1 -- start start 2020-05-18T21:28:35.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d829c9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2d7c0b2860 0x7f2d7c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:35.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d829c9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d7c14e570 0x7f2d7c14a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:35.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d829c9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d7c14d960 con 0x7f2d7c060b90 2020-05-18T21:28:35.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d829c9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d7c066210 con 0x7f2d7c0b2860 2020-05-18T21:28:35.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d829c9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c14db90 con 0x7f2d7c14e570 2020-05-18T21:28:35.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d737fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2d7c0b2860 0x7f2d7c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:35.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d737fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2d7c0b2860 0x7f2d7c0615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55272/0 (socket says 172.21.15.63:55272) 2020-05-18T21:28:35.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d737fe700 1 -- 172.21.15.63:0/4084346476 learned_addr learned my addr 172.21.15.63:0/4084346476 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:35.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d80f66700 1 --2- 172.21.15.63:0/4084346476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d7c14e570 0x7f2d7c14a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:35.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d7b7fe700 1 -- 172.21.15.63:0/4084346476 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260056906 0 0) 0x7f2d7c14d960 con 0x7f2d7c060b90 2020-05-18T21:28:35.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d737fe700 1 -- 172.21.15.63:0/4084346476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d7c14e570 msgr2=0x7f2d7c14a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:35.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d737fe700 1 --2- 172.21.15.63:0/4084346476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d7c14e570 0x7f2d7c14a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:35.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d737fe700 1 -- 172.21.15.63:0/4084346476 >> v1:172.21.15.155:6789/0 conn(0x7f2d7c060b90 legacy=0x7f2d7c144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:35.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d737fe700 1 -- 172.21.15.63:0/4084346476 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c14de30 con 0x7f2d7c0b2860 2020-05-18T21:28:35.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d80f66700 1 --2- 172.21.15.63:0/4084346476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d7c14e570 0x7f2d7c14a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:35.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d737fe700 1 --2- 172.21.15.63:0/4084346476 >> v2:172.21.15.63:3300/0 conn(0x7f2d7c0b2860 0x7f2d7c0615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2d64002f70 tx=0x7f2d64007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d737fe700 1 --2- 172.21.15.63:0/4084346476 >> v2:172.21.15.63:3300/0 conn(0x7f2d7c0b2860 0x7f2d7c0615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2d64002f70 tx=0x7f2d64007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d737fe700 1 --2- 172.21.15.63:0/4084346476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d7c0b2860 0x7f2d7c0615e0 secure :-1 s=READY pgs=542 cs=0 l=1 rx=0x7f2d64002f70 tx=0x7f2d64007a80).ready entity=mon.0 client_cookie=4e2491cb4d2fe66 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:35.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d737fe700 1 --2- 172.21.15.63:0/4084346476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d7c0b2860 0x7f2d7c0615e0 secure :-1 s=THROTTLE_DONE pgs=542 cs=0 l=1 rx=0x7f2d64002f70 tx=0x7f2d64007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d737fe700 1 --2- 172.21.15.63:0/4084346476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d7c0b2860 0x7f2d7c0615e0 secure :-1 s=THROTTLE_DONE pgs=542 cs=0 l=1 rx=0x7f2d64002f70 tx=0x7f2d64007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d7b7fe700 1 -- 172.21.15.63:0/4084346476 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d640116b0 con 0x7f2d7c0b2860 2020-05-18T21:28:35.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d737fe700 1 --2- 172.21.15.63:0/4084346476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d7c0b2860 0x7f2d7c0615e0 secure :-1 s=THROTTLE_DONE pgs=542 cs=0 l=1 rx=0x7f2d64002f70 tx=0x7f2d64007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d7b7fe700 1 -- 172.21.15.63:0/4084346476 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d64011810 con 0x7f2d7c0b2860 2020-05-18T21:28:35.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d7b7fe700 1 -- 172.21.15.63:0/4084346476 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d64011bf0 con 0x7f2d7c0b2860 2020-05-18T21:28:35.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d829c9700 1 -- 172.21.15.63:0/4084346476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d7c0b2860 msgr2=0x7f2d7c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:35.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.441+0000 7f2d829c9700 1 --2- 172.21.15.63:0/4084346476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d7c0b2860 0x7f2d7c0615e0 secure :-1 s=READY pgs=542 cs=0 l=1 rx=0x7f2d64002f70 tx=0x7f2d64007a80).stop 2020-05-18T21:28:35.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d829c9700 1 -- 172.21.15.63:0/4084346476 shutdown_connections 2020-05-18T21:28:35.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d829c9700 1 --2- 172.21.15.63:0/4084346476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d7c14e570 0x7f2d7c14a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:35.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d829c9700 1 --2- 172.21.15.63:0/4084346476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d7c0b2860 0x7f2d7c0615e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:35.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d829c9700 1 -- 172.21.15.63:0/4084346476 >> 172.21.15.63:0/4084346476 conn(0x7f2d7c0b83d0 msgr2=0x7f2d7c0b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:35.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d829c9700 1 -- 172.21.15.63:0/4084346476 shutdown_connections 2020-05-18T21:28:35.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d829c9700 1 -- 172.21.15.63:0/4084346476 wait complete. 2020-05-18T21:28:35.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d829c9700 1 Processor -- start 2020-05-18T21:28:35.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d829c9700 1 -- start start 2020-05-18T21:28:35.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d829c9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2d7c060b90 0x7f2d7c0ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:35.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d829c9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d7c14e570 0x7f2d7c147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:35.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d829c9700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d7c15ad30 con 0x7f2d7c0b2860 2020-05-18T21:28:35.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d829c9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d7c15afd0 con 0x7f2d7c060b90 2020-05-18T21:28:35.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d829c9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c14a0b0 con 0x7f2d7c14e570 2020-05-18T21:28:35.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d7bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2d7c060b90 0x7f2d7c0ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:35.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d7bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2d7c060b90 0x7f2d7c0ac4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55276/0 (socket says 172.21.15.63:55276) 2020-05-18T21:28:35.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d737fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2d7c0b2860 0x7f2d7c15b470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57466/0 (socket says 172.21.15.63:57466) 2020-05-18T21:28:35.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d7bfff700 1 -- 172.21.15.63:0/3479028130 learned_addr learned my addr 172.21.15.63:0/3479028130 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:35.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d80f66700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d7c14e570 0x7f2d7c147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:35.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d7bfff700 1 -- 172.21.15.63:0/3479028130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d7c14e570 msgr2=0x7f2d7c147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:35.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d7bfff700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d7c14e570 0x7f2d7c147990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:35.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d7bfff700 1 -- 172.21.15.63:0/3479028130 >> v1:172.21.15.63:6789/0 conn(0x7f2d7c0b2860 legacy=0x7f2d7c15b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:35.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d7bfff700 1 -- 172.21.15.63:0/3479028130 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c0b2f10 con 0x7f2d7c060b90 2020-05-18T21:28:35.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.445+0000 7f2d79ffb700 1 -- 172.21.15.63:0/3479028130 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294248181 0 0) 0x7f2d7c15ad30 con 0x7f2d7c0b2860 2020-05-18T21:28:35.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.449+0000 7f2d7bfff700 1 --2- 172.21.15.63:0/3479028130 >> v2:172.21.15.63:3300/0 conn(0x7f2d7c060b90 0x7f2d7c0ac4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2d6c000bc0 tx=0x7f2d6c010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.449+0000 7f2d7bfff700 1 --2- 172.21.15.63:0/3479028130 >> v2:172.21.15.63:3300/0 conn(0x7f2d7c060b90 0x7f2d7c0ac4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2d6c000bc0 tx=0x7f2d6c010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.449+0000 7f2d7bfff700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d7c060b90 0x7f2d7c0ac4d0 secure :-1 s=READY pgs=544 cs=0 l=1 rx=0x7f2d6c000bc0 tx=0x7f2d6c010a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:35.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.449+0000 7f2d7bfff700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d7c060b90 0x7f2d7c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f2d6c000bc0 tx=0x7f2d6c010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.449+0000 7f2d79ffb700 1 -- 172.21.15.63:0/3479028130 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d6c00cc60 con 0x7f2d7c060b90 2020-05-18T21:28:35.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.449+0000 7f2d7bfff700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d7c060b90 0x7f2d7c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f2d6c000bc0 tx=0x7f2d6c010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.449+0000 7f2d7bfff700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d7c060b90 0x7f2d7c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f2d6c000bc0 tx=0x7f2d6c010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.449+0000 7f2d79ffb700 1 -- 172.21.15.63:0/3479028130 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6c00cdc0 con 0x7f2d7c060b90 2020-05-18T21:28:35.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.449+0000 7f2d79ffb700 1 -- 172.21.15.63:0/3479028130 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d6c012310 con 0x7f2d7c060b90 2020-05-18T21:28:35.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.449+0000 7f2d829c9700 1 -- 172.21.15.63:0/3479028130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d7c0b31c0 con 0x7f2d7c060b90 2020-05-18T21:28:35.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.449+0000 7f2d829c9700 1 -- 172.21.15.63:0/3479028130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7c157c60 con 0x7f2d7c060b90 2020-05-18T21:28:35.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.449+0000 7f2d7bfff700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d7c060b90 0x7f2d7c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f2d6c000bc0 tx=0x7f2d6c010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.449+0000 7f2d79ffb700 1 -- 172.21.15.63:0/3479028130 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2d6c006520 con 0x7f2d7c060b90 2020-05-18T21:28:35.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.449+0000 7f2d7bfff700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d7c060b90 0x7f2d7c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f2d6c000bc0 tx=0x7f2d6c010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.449+0000 7f2d829c9700 1 -- 172.21.15.63:0/3479028130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d7c0569e0 con 0x7f2d7c060b90 2020-05-18T21:28:35.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.449+0000 7f2d79ffb700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2d6004f860 0x7f2d60051d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:35.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.449+0000 7f2d79ffb700 1 -- 172.21.15.63:0/3479028130 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2d6c063940 con 0x7f2d7c060b90 2020-05-18T21:28:35.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.449+0000 7f2d737fe700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2d6004f860 0x7f2d60051d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:35.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.449+0000 7f2d737fe700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2d6004f860 0x7f2d60051d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2d64000bc0 tx=0x7f2d64007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.453+0000 7f2d737fe700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2d6004f860 0x7f2d60051d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2d64000bc0 tx=0x7f2d64007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.453+0000 7f2d737fe700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2d6004f860 0x7f2d60051d20 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7f2d64000bc0 tx=0x7f2d64007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:35.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.457+0000 7f2d7bfff700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d7c060b90 0x7f2d7c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f2d6c000bc0 tx=0x7f2d6c010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.457+0000 7f2d79ffb700 1 -- 172.21.15.63:0/3479028130 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2d6c03dcd0 con 0x7f2d7c060b90 2020-05-18T21:28:35.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.605+0000 7f2d829c9700 1 -- 172.21.15.63:0/3479028130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d7c0008d0 con 0x7f2d7c060b90 2020-05-18T21:28:35.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.605+0000 7f2d7bfff700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d7c060b90 0x7f2d7c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f2d6c000bc0 tx=0x7f2d6c010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.605+0000 7f2d79ffb700 1 -- 172.21.15.63:0/3479028130 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+2138 (secure 0 0 0) 0x7f2d6c0412f0 con 0x7f2d7c060b90 2020-05-18T21:28:35.612 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:35.612 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593103128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593103128},{"type":"v1","addr":"172.21.15.155:6835","nonce":593103128}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:28:08.611856+0000","modified":"2020-05-18T21:28:09.616560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/3182633142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3182633142},{"type":"v1","addr":"172.21.15.63:6833","nonce":3182633142}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-05-18T21:28:35.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.605+0000 7f2d829c9700 1 -- 172.21.15.63:0/3479028130 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2d6004f860 msgr2=0x7f2d60051d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:35.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.605+0000 7f2d829c9700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2d6004f860 0x7f2d60051d20 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7f2d64000bc0 tx=0x7f2d64007a80).stop 2020-05-18T21:28:35.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.605+0000 7f2d829c9700 1 -- 172.21.15.63:0/3479028130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d7c060b90 msgr2=0x7f2d7c0ac4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:35.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.605+0000 7f2d829c9700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d7c060b90 0x7f2d7c0ac4d0 secure :-1 s=READY pgs=544 cs=0 l=1 rx=0x7f2d6c000bc0 tx=0x7f2d6c010a50).stop 2020-05-18T21:28:35.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.605+0000 7f2d829c9700 1 -- 172.21.15.63:0/3479028130 shutdown_connections 2020-05-18T21:28:35.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.605+0000 7f2d829c9700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2d6004f860 0x7f2d60051d20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:35.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.605+0000 7f2d829c9700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d7c14e570 0x7f2d7c147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:35.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.605+0000 7f2d829c9700 1 --2- 172.21.15.63:0/3479028130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d7c060b90 0x7f2d7c0ac4d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:35.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.605+0000 7f2d829c9700 1 -- 172.21.15.63:0/3479028130 >> 172.21.15.63:0/3479028130 conn(0x7f2d7c0b83d0 msgr2=0x7f2d7c0b7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:35.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.605+0000 7f2d829c9700 1 -- 172.21.15.63:0/3479028130 shutdown_connections 2020-05-18T21:28:35.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.609+0000 7f2d829c9700 1 -- 172.21.15.63:0/3479028130 wait complete. 2020-05-18T21:28:35.616 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2020-05-18T21:28:35.623 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_enqueued 2020-05-18T21:28:35.722 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:28:35.722 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:28:35.722 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 50 2020-05-18T21:28:35.723 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:35.723 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:28:35.731 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_enqueued": 50 } } 2020-05-18T21:28:35.732 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:28:35.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.825+0000 7fde3359e700 1 Processor -- start 2020-05-18T21:28:35.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.825+0000 7fde3359e700 1 -- start start 2020-05-18T21:28:35.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.825+0000 7fde3359e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fde34062f20 0x7fde340b6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:35.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.825+0000 7fde3359e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde34149690 con 0x7fde34069eb0 2020-05-18T21:28:35.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.825+0000 7fde3359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde34149930 con 0x7fde341453d0 2020-05-18T21:28:35.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.825+0000 7fde3359e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde3414a4e0 con 0x7fde34062f20 2020-05-18T21:28:35.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.825+0000 7fde31d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fde34062f20 0x7fde340b6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:35.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.825+0000 7fde3259c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fde34069eb0 0x7fde34149dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57472/0 (socket says 172.21.15.63:57472) 2020-05-18T21:28:35.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.825+0000 7fde3259c700 1 -- 172.21.15.63:0/1525513968 learned_addr learned my addr 172.21.15.63:0/1525513968 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:35.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.825+0000 7fde31d9b700 1 -- 172.21.15.63:0/1525513968 >> v1:172.21.15.155:6789/0 conn(0x7fde341453d0 legacy=0x7fde34145840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:35.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.825+0000 7fde31d9b700 1 -- 172.21.15.63:0/1525513968 >> v1:172.21.15.63:6789/0 conn(0x7fde34069eb0 legacy=0x7fde34149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:35.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.825+0000 7fde3159a700 1 -- 172.21.15.63:0/1525513968 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205433504 0 0) 0x7fde34149690 con 0x7fde34069eb0 2020-05-18T21:28:35.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.825+0000 7fde31d9b700 1 -- 172.21.15.63:0/1525513968 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde34064450 con 0x7fde34062f20 2020-05-18T21:28:35.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.829+0000 7fde31d9b700 1 --2- 172.21.15.63:0/1525513968 >> v2:172.21.15.63:3300/0 conn(0x7fde34062f20 0x7fde340b6500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fde28002f70 tx=0x7fde28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.829+0000 7fde31d9b700 1 --2- 172.21.15.63:0/1525513968 >> v2:172.21.15.63:3300/0 conn(0x7fde34062f20 0x7fde340b6500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fde28002f70 tx=0x7fde28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.829+0000 7fde31d9b700 1 --2- 172.21.15.63:0/1525513968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde34062f20 0x7fde340b6500 secure :-1 s=READY pgs=546 cs=0 l=1 rx=0x7fde28002f70 tx=0x7fde28007a80).ready entity=mon.0 client_cookie=503a03f5e0cd6000 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:35.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.829+0000 7fde31d9b700 1 --2- 172.21.15.63:0/1525513968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde34062f20 0x7fde340b6500 secure :-1 s=THROTTLE_DONE pgs=546 cs=0 l=1 rx=0x7fde28002f70 tx=0x7fde28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.829+0000 7fde3159a700 1 -- 172.21.15.63:0/1525513968 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde28008e80 con 0x7fde34062f20 2020-05-18T21:28:35.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.829+0000 7fde31d9b700 1 --2- 172.21.15.63:0/1525513968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde34062f20 0x7fde340b6500 secure :-1 s=THROTTLE_DONE pgs=546 cs=0 l=1 rx=0x7fde28002f70 tx=0x7fde28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.829+0000 7fde3159a700 1 -- 172.21.15.63:0/1525513968 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde280116a0 con 0x7fde34062f20 2020-05-18T21:28:35.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.829+0000 7fde31d9b700 1 --2- 172.21.15.63:0/1525513968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde34062f20 0x7fde340b6500 secure :-1 s=THROTTLE_DONE pgs=546 cs=0 l=1 rx=0x7fde28002f70 tx=0x7fde28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.829+0000 7fde3359e700 1 -- 172.21.15.63:0/1525513968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde34062f20 msgr2=0x7fde340b6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:35.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.829+0000 7fde3159a700 1 -- 172.21.15.63:0/1525513968 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde28011ac0 con 0x7fde34062f20 2020-05-18T21:28:35.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.829+0000 7fde3359e700 1 --2- 172.21.15.63:0/1525513968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde34062f20 0x7fde340b6500 secure :-1 s=READY pgs=546 cs=0 l=1 rx=0x7fde28002f70 tx=0x7fde28007a80).stop 2020-05-18T21:28:35.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.829+0000 7fde3359e700 1 -- 172.21.15.63:0/1525513968 shutdown_connections 2020-05-18T21:28:35.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.829+0000 7fde3359e700 1 --2- 172.21.15.63:0/1525513968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde34062f20 0x7fde340b6500 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:35.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.829+0000 7fde3359e700 1 -- 172.21.15.63:0/1525513968 >> 172.21.15.63:0/1525513968 conn(0x7fde34066d00 msgr2=0x7fde3405a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:35.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.829+0000 7fde3359e700 1 -- 172.21.15.63:0/1525513968 shutdown_connections 2020-05-18T21:28:35.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.829+0000 7fde3359e700 1 -- 172.21.15.63:0/1525513968 wait complete. 2020-05-18T21:28:35.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.829+0000 7fde3359e700 1 Processor -- start 2020-05-18T21:28:35.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.829+0000 7fde3359e700 1 -- start start 2020-05-18T21:28:35.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde3359e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde34062f20 0x7fde340b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:35.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde3359e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde340b1d90 con 0x7fde341453d0 2020-05-18T21:28:35.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde3359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde340b4860 con 0x7fde34069eb0 2020-05-18T21:28:35.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde3359e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde34144620 con 0x7fde34062f20 2020-05-18T21:28:35.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde32d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fde341453d0 0x7fde34140220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57482/0 (socket says 172.21.15.63:57482) 2020-05-18T21:28:35.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde32d9d700 1 -- 172.21.15.63:0/1701779782 learned_addr learned my addr 172.21.15.63:0/1701779782 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:35.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde3259c700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde34062f20 0x7fde340b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:35.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde237fe700 1 -- 172.21.15.63:0/1701779782 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135951931 0 0) 0x7fde340b1d90 con 0x7fde341453d0 2020-05-18T21:28:35.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde237fe700 1 -- 172.21.15.63:0/1701779782 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde10002fe0 con 0x7fde341453d0 2020-05-18T21:28:35.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde237fe700 1 -- 172.21.15.63:0/1701779782 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165064159 0 0) 0x7fde340b4860 con 0x7fde34069eb0 2020-05-18T21:28:35.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde237fe700 1 -- 172.21.15.63:0/1701779782 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde340b1d90 con 0x7fde34069eb0 2020-05-18T21:28:35.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde3259c700 1 -- 172.21.15.63:0/1701779782 >> v1:172.21.15.155:6789/0 conn(0x7fde34069eb0 legacy=0x7fde340b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:35.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde237fe700 1 -- 172.21.15.63:0/1701779782 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 676976112 0 0) 0x7fde10002fe0 con 0x7fde341453d0 2020-05-18T21:28:35.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde3259c700 1 -- 172.21.15.63:0/1701779782 >> v1:172.21.15.63:6789/0 conn(0x7fde341453d0 legacy=0x7fde34140220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:35.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde3259c700 1 -- 172.21.15.63:0/1701779782 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde340b3a60 con 0x7fde34062f20 2020-05-18T21:28:35.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde3259c700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde34062f20 0x7fde340b0ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fde2c001d70 tx=0x7fde24010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde3259c700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde34062f20 0x7fde340b0ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fde2c001d70 tx=0x7fde24010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde3259c700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde34062f20 0x7fde340b0ee0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fde2c001d70 tx=0x7fde24010940).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:35.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde3259c700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde34062f20 0x7fde340b0ee0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fde2c001d70 tx=0x7fde24010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde237fe700 1 -- 172.21.15.63:0/1701779782 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde2c001c10 con 0x7fde34062f20 2020-05-18T21:28:35.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde3359e700 1 -- 172.21.15.63:0/1701779782 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde34140930 con 0x7fde34062f20 2020-05-18T21:28:35.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde3259c700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde34062f20 0x7fde340b0ee0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fde2c001d70 tx=0x7fde24010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde237fe700 1 -- 172.21.15.63:0/1701779782 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde240058e0 con 0x7fde34062f20 2020-05-18T21:28:35.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde3259c700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde34062f20 0x7fde340b0ee0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fde2c001d70 tx=0x7fde24010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde3359e700 1 -- 172.21.15.63:0/1701779782 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde340b1900 con 0x7fde34062f20 2020-05-18T21:28:35.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde237fe700 1 -- 172.21.15.63:0/1701779782 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde24005c90 con 0x7fde34062f20 2020-05-18T21:28:35.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde3259c700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde34062f20 0x7fde340b0ee0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fde2c001d70 tx=0x7fde24010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.833+0000 7fde3359e700 1 -- 172.21.15.63:0/1701779782 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde340b46c0 con 0x7fde34062f20 2020-05-18T21:28:35.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.837+0000 7fde237fe700 1 -- 172.21.15.63:0/1701779782 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fde2400a360 con 0x7fde34062f20 2020-05-18T21:28:35.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.837+0000 7fde3259c700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde34062f20 0x7fde340b0ee0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fde2c001d70 tx=0x7fde24010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.837+0000 7fde237fe700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde1004fdd0 0x7fde10052290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:35.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.837+0000 7fde237fe700 1 -- 172.21.15.63:0/1701779782 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fde240090c0 con 0x7fde34062f20 2020-05-18T21:28:35.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.837+0000 7fde31d9b700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde1004fdd0 0x7fde10052290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:35.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.837+0000 7fde31d9b700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde1004fdd0 0x7fde10052290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fde28007f10 tx=0x7fde28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.837+0000 7fde31d9b700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde1004fdd0 0x7fde10052290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fde28007f10 tx=0x7fde28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.837+0000 7fde31d9b700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde1004fdd0 0x7fde10052290 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7fde28007f10 tx=0x7fde28007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:35.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.845+0000 7fde3259c700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde34062f20 0x7fde340b0ee0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fde2c001d70 tx=0x7fde24010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:35.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.845+0000 7fde237fe700 1 -- 172.21.15.63:0/1701779782 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fde340b46c0 con 0x7fde34062f20 2020-05-18T21:28:35.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.993+0000 7fde3359e700 1 -- 172.21.15.63:0/1701779782 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde340b46c0 con 0x7fde34062f20 2020-05-18T21:28:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.993+0000 7fde3259c700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde34062f20 0x7fde340b0ee0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fde2c001d70 tx=0x7fde24010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.993+0000 7fde237fe700 1 -- 172.21.15.63:0/1701779782 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+2138 (secure 0 0 0) 0x7fde340b46c0 con 0x7fde34062f20 2020-05-18T21:28:36.000 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:36.001 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593103128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593103128},{"type":"v1","addr":"172.21.15.155:6835","nonce":593103128}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:28:08.611856+0000","modified":"2020-05-18T21:28:09.616560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/3182633142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3182633142},{"type":"v1","addr":"172.21.15.63:6833","nonce":3182633142}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-05-18T21:28:36.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.997+0000 7fde3359e700 1 -- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde1004fdd0 msgr2=0x7fde10052290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:36.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.997+0000 7fde3359e700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde1004fdd0 0x7fde10052290 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7fde28007f10 tx=0x7fde28007a80).stop 2020-05-18T21:28:36.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.997+0000 7fde3359e700 1 -- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde34062f20 msgr2=0x7fde340b0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:36.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.997+0000 7fde3359e700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde34062f20 0x7fde340b0ee0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fde2c001d70 tx=0x7fde24010940).stop 2020-05-18T21:28:36.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.997+0000 7fde3359e700 1 -- 172.21.15.63:0/1701779782 shutdown_connections 2020-05-18T21:28:36.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.997+0000 7fde3359e700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde1004fdd0 0x7fde10052290 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:36.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.997+0000 7fde3359e700 1 --2- 172.21.15.63:0/1701779782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde34062f20 0x7fde340b0ee0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:36.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.997+0000 7fde3359e700 1 -- 172.21.15.63:0/1701779782 >> 172.21.15.63:0/1701779782 conn(0x7fde34066d00 msgr2=0x7fde34061a00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:36.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.997+0000 7fde3359e700 1 -- 172.21.15.63:0/1701779782 shutdown_connections 2020-05-18T21:28:36.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:35.997+0000 7fde3359e700 1 -- 172.21.15.63:0/1701779782 wait complete. 2020-05-18T21:28:36.004 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2020-05-18T21:28:36.014 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump purge_queue pq_executed 2020-05-18T21:28:36.112 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:28:36.113 INFO:teuthology.orchestra.run.smithi063.stdout: "purge_queue": { 2020-05-18T21:28:36.113 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executed": 50 2020-05-18T21:28:36.114 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:36.114 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:28:36.121 INFO:tasks.cephfs.filesystem:_json_asok output: { "purge_queue": { "pq_executed": 50 } } 2020-05-18T21:28:36.122 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:28:36.122 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:28:36.123 INFO:teuthology.orchestra.run.smithi063:> path = os.path.join("/home/ubuntu/cephtest/mnt.0", "subdir4") 2020-05-18T21:28:36.123 INFO:teuthology.orchestra.run.smithi063:> os.mkdir(path) 2020-05-18T21:28:36.123 INFO:teuthology.orchestra.run.smithi063:> for n in range(50): 2020-05-18T21:28:36.124 INFO:teuthology.orchestra.run.smithi063:> fpath = os.path.join(path, "%s" % n) 2020-05-18T21:28:36.124 INFO:teuthology.orchestra.run.smithi063:> with open(fpath, '"'"'w'"'"') as f: 2020-05-18T21:28:36.125 INFO:teuthology.orchestra.run.smithi063:> f.write(str(n)) 2020-05-18T21:28:36.125 INFO:teuthology.orchestra.run.smithi063:> os.unlink(fpath) 2020-05-18T21:28:36.125 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:28:36.590 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:28:36.590 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:28:36.609 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:28:36.630 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:28:36.630 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:28:36.631 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:28:36.631 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:36.647 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[19523]: fuse finished with error 0 and tester_r 0 2020-05-18T21:28:36.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:36.651 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:36.700 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:28:36.701 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:28:36.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:36.702 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 down' 2020-05-18T21:28:36.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:36.721 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.0' 2020-05-18T21:28:36.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:36.848 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:28:36.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:36.868 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:28:36.874 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:28:36.874 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:28:36.874 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:28:36.875 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:36.875 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:28:36.875 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:36.875 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:36.875 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:36.876 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:36.876 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:36.876 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:36.876 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:36.876 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:28:36.876 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:36.877 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:28:36.877 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42726sec preferred_lft 42726sec 2020-05-18T21:28:36.877 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:28:36.877 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:36.877 INFO:teuthology.orchestra.run.smithi063.stdout:13: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-05-18T21:28:36.878 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:36.878 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:28:36.878 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:36.878 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::f87b:58ff:feac:5b49/64 scope link 2020-05-18T21:28:36.878 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:36.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:36.879 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:28:36.935 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:28:36.936 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:28:36.936 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:28:36.936 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:36.937 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:28:36.937 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:36.937 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:28:36.938 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:36.938 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:28:36.938 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:36.939 INFO:teuthology.orchestra.run.smithi063.stdout:13: ceph-brx: mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:28:36.939 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:36.940 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:28:36.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:36.943 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:28:36.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:36.969 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:28:37.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:37.116 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:28:37.126 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:28:37.127 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:28:37.127 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:28:37.127 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:28:37.127 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:28:37.127 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:28:37.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:37.128 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:28:37.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:37.155 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:28:37.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:37.216 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:28:37.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:37.355 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:37.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:37.362 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:28:37.369 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-05-18T21:28:37.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:28:37.370 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-05-18T21:28:37.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:37.371 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:28:37.420 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:28:37.420 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:28:37.420 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:28:37.420 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:37.421 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:28:37.421 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:37.421 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:37.421 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:37.422 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:37.422 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:37.422 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:37.422 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:37.423 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:28:37.423 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:37.423 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:28:37.424 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42725sec preferred_lft 42725sec 2020-05-18T21:28:37.424 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:28:37.424 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:37.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:37.425 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:28:37.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:37.432 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:28:37.440 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2020-05-18T21:28:37.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:28:37.441 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-05-18T21:28:37.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:37.442 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:28:37.491 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:28:37.491 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:28:37.491 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:28:37.492 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:37.492 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:28:37.492 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:37.492 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:37.492 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:37.493 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:37.493 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:37.493 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:37.493 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:37.493 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:28:37.494 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:37.494 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:28:37.494 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42730sec preferred_lft 42730sec 2020-05-18T21:28:37.494 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:28:37.494 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:37.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:37.495 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:28:37.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:37.503 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:28:37.509 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2020-05-18T21:28:37.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:28:37.526 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-05-18T21:28:37.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:37.528 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:28:37.567 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:28:37.567 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:28:37.568 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:28:37.568 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:37.568 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:28:37.568 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:37.568 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:37.569 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:37.569 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:37.569 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:37.569 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:37.569 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:37.570 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:28:37.570 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:37.570 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:28:37.570 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42729sec preferred_lft 42729sec 2020-05-18T21:28:37.570 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:28:37.571 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:37.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:37.572 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:28:37.578 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit' 2020-05-18T21:28:37.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bfeb07700 1 Processor -- start 2020-05-18T21:28:37.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bfeb07700 1 -- start start 2020-05-18T21:28:37.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bfeb07700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bf80615e0 0x7f2bf814e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:37.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bfeb07700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf814d960 con 0x7f2bf8060b90 2020-05-18T21:28:37.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bfeb07700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf814db90 con 0x7f2bf80b2860 2020-05-18T21:28:37.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bfeb07700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf8066210 con 0x7f2bf80615e0 2020-05-18T21:28:37.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bfc8a3700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2bf8060b90 0x7f2bf8144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57486/0 (socket says 172.21.15.63:57486) 2020-05-18T21:28:37.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bfc8a3700 1 -- 172.21.15.63:0/1669099686 learned_addr learned my addr 172.21.15.63:0/1669099686 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:37.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bfd0a4700 1 --2- 172.21.15.63:0/1669099686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bf80615e0 0x7f2bf814e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:37.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bf77fe700 1 -- 172.21.15.63:0/1669099686 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906856954 0 0) 0x7f2bf814d960 con 0x7f2bf8060b90 2020-05-18T21:28:37.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bf77fe700 1 -- 172.21.15.63:0/1669099686 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bdc003270 con 0x7f2bf8060b90 2020-05-18T21:28:37.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bf77fe700 1 -- 172.21.15.63:0/1669099686 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686181681 0 0) 0x7f2bf814db90 con 0x7f2bf80b2860 2020-05-18T21:28:37.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bf77fe700 1 -- 172.21.15.63:0/1669099686 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bf814d960 con 0x7f2bf80b2860 2020-05-18T21:28:37.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bf77fe700 1 -- 172.21.15.63:0/1669099686 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1753930364 0 0) 0x7f2bdc003270 con 0x7f2bf8060b90 2020-05-18T21:28:37.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bf77fe700 1 -- 172.21.15.63:0/1669099686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bf80615e0 msgr2=0x7f2bf814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:37.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bf77fe700 1 --2- 172.21.15.63:0/1669099686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bf80615e0 0x7f2bf814e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:37.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bf77fe700 1 -- 172.21.15.63:0/1669099686 >> v1:172.21.15.155:6789/0 conn(0x7f2bf80b2860 legacy=0x7f2bf814a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:37.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bf77fe700 1 -- 172.21.15.63:0/1669099686 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf814de30 con 0x7f2bf8060b90 2020-05-18T21:28:37.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bf77fe700 1 -- 172.21.15.63:0/1669099686 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f2be0001710 con 0x7f2bf8060b90 2020-05-18T21:28:37.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bf77fe700 1 -- 172.21.15.63:0/1669099686 >> v1:172.21.15.63:6789/0 conn(0x7f2bf8060b90 legacy=0x7f2bf8144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:37.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bf77fe700 1 --2- 172.21.15.63:0/1669099686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bf80615e0 0x7f2bdc003920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:37.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bf77fe700 1 --2- 172.21.15.63:0/1669099686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc003d80 0x7f2bdc004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:37.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bf77fe700 1 --2- 172.21.15.63:0/1669099686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bdc004970 0x7f2bdc004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:37.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bf77fe700 1 -- 172.21.15.63:0/1669099686 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf8066210 con 0x7f2bdc003d80 2020-05-18T21:28:37.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bf77fe700 1 -- 172.21.15.63:0/1669099686 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc005250 con 0x7f2bdc004970 2020-05-18T21:28:37.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bf77fe700 1 -- 172.21.15.63:0/1669099686 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc00b760 con 0x7f2bf80615e0 2020-05-18T21:28:37.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bf7fff700 1 --2- 172.21.15.63:0/1669099686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc003d80 0x7f2bdc004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:37.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bfc8a3700 1 --2- 172.21.15.63:0/1669099686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bf80615e0 0x7f2bdc003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:37.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.685+0000 7f2bfd0a4700 1 --2- 172.21.15.63:0/1669099686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bdc004970 0x7f2bdc004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:37.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bf7fff700 1 -- 172.21.15.63:0/1669099686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bf80615e0 msgr2=0x7f2bdc003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:37.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bf7fff700 1 --2- 172.21.15.63:0/1669099686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bf80615e0 0x7f2bdc003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:37.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bf7fff700 1 -- 172.21.15.63:0/1669099686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bdc004970 msgr2=0x7f2bdc004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:37.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bf7fff700 1 --2- 172.21.15.63:0/1669099686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bdc004970 0x7f2bdc004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:37.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bf7fff700 1 -- 172.21.15.63:0/1669099686 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc003270 con 0x7f2bdc003d80 2020-05-18T21:28:37.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bfc8a3700 1 --2- 172.21.15.63:0/1669099686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bf80615e0 0x7f2bdc003920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:37.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bf7fff700 1 --2- 172.21.15.63:0/1669099686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc003d80 0x7f2bdc004510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2be8001490 tx=0x7f2be800c240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:37.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bf7fff700 1 --2- 172.21.15.63:0/1669099686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc003d80 0x7f2bdc004510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2be8001490 tx=0x7f2be800c240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:37.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bf7fff700 1 --2- 172.21.15.63:0/1669099686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc003d80 0x7f2bdc004510 secure :-1 s=READY pgs=549 cs=0 l=1 rx=0x7f2be8001490 tx=0x7f2be800c240).ready entity=mon.0 client_cookie=2c60fd37f59d8b02 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:37.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bf7fff700 1 --2- 172.21.15.63:0/1669099686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc003d80 0x7f2bdc004510 secure :-1 s=THROTTLE_DONE pgs=549 cs=0 l=1 rx=0x7f2be8001490 tx=0x7f2be800c240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:37.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bf7fff700 1 --2- 172.21.15.63:0/1669099686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc003d80 0x7f2bdc004510 secure :-1 s=THROTTLE_DONE pgs=549 cs=0 l=1 rx=0x7f2be8001490 tx=0x7f2be800c240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:37.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bf77fe700 1 -- 172.21.15.63:0/1669099686 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2be8001e80 con 0x7f2bdc003d80 2020-05-18T21:28:37.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bf7fff700 1 --2- 172.21.15.63:0/1669099686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc003d80 0x7f2bdc004510 secure :-1 s=THROTTLE_DONE pgs=549 cs=0 l=1 rx=0x7f2be8001490 tx=0x7f2be800c240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:37.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bf77fe700 1 -- 172.21.15.63:0/1669099686 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be800cd70 con 0x7f2bdc003d80 2020-05-18T21:28:37.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bf77fe700 1 -- 172.21.15.63:0/1669099686 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2be80114d0 con 0x7f2bdc003d80 2020-05-18T21:28:37.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bfeb07700 1 -- 172.21.15.63:0/1669099686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc003d80 msgr2=0x7f2bdc004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:37.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bfeb07700 1 --2- 172.21.15.63:0/1669099686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc003d80 0x7f2bdc004510 secure :-1 s=READY pgs=549 cs=0 l=1 rx=0x7f2be8001490 tx=0x7f2be800c240).stop 2020-05-18T21:28:37.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bfd0a4700 1 -- 172.21.15.63:0/1669099686 reap_dead start 2020-05-18T21:28:37.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bfeb07700 1 -- 172.21.15.63:0/1669099686 shutdown_connections 2020-05-18T21:28:37.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bfeb07700 1 -- 172.21.15.63:0/1669099686 >> 172.21.15.63:0/1669099686 conn(0x7f2bf80b83d0 msgr2=0x7f2bf80b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:37.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bfeb07700 1 -- 172.21.15.63:0/1669099686 shutdown_connections 2020-05-18T21:28:37.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.689+0000 7f2bfeb07700 1 -- 172.21.15.63:0/1669099686 wait complete. 2020-05-18T21:28:37.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfeb07700 1 Processor -- start 2020-05-18T21:28:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfeb07700 1 -- start start 2020-05-18T21:28:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfeb07700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2bf8148220 0x7f2bf81580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfeb07700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bf814b0f0 0x7f2bf814c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:37.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfeb07700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf814a710 con 0x7f2bf814ce10 2020-05-18T21:28:37.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfeb07700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf814a9b0 con 0x7f2bf8148220 2020-05-18T21:28:37.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfeb07700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf814ac50 con 0x7f2bf814b0f0 2020-05-18T21:28:37.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfc8a3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2bf8148220 0x7f2bf81580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:37.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfc8a3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2bf8148220 0x7f2bf81580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:41926/0 (socket says 172.21.15.63:41926) 2020-05-18T21:28:37.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfc8a3700 1 -- 172.21.15.63:0/3086329745 learned_addr learned my addr 172.21.15.63:0/3086329745 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:37.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bf7fff700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bf814b0f0 0x7f2bf814c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:37.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfc8a3700 1 -- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bf814b0f0 msgr2=0x7f2bf814c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:37.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfc8a3700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bf814b0f0 0x7f2bf814c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:37.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfc8a3700 1 -- 172.21.15.63:0/3086329745 >> v1:172.21.15.155:6789/0 conn(0x7f2bf814ce10 legacy=0x7f2bf815ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:37.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfc8a3700 1 -- 172.21.15.63:0/3086329745 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf8148600 con 0x7f2bf8148220 2020-05-18T21:28:37.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfc8a3700 1 --2- 172.21.15.63:0/3086329745 >> v2:172.21.15.155:3300/0 conn(0x7f2bf8148220 0x7f2bf81580d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2be00014e0 tx=0x7f2bf805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:37.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfc8a3700 1 --2- 172.21.15.63:0/3086329745 >> v2:172.21.15.155:3300/0 conn(0x7f2bf8148220 0x7f2bf81580d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2be00014e0 tx=0x7f2bf805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:37.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfc8a3700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf8148220 0x7f2bf81580d0 secure :-1 s=READY pgs=388 cs=0 l=1 rx=0x7f2be00014e0 tx=0x7f2bf805fa60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:37.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfc8a3700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf8148220 0x7f2bf81580d0 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f2be00014e0 tx=0x7f2bf805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:37.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bf5ffb700 1 -- 172.21.15.63:0/3086329745 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2be0010370 con 0x7f2bf8148220 2020-05-18T21:28:37.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfc8a3700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf8148220 0x7f2bf81580d0 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f2be00014e0 tx=0x7f2bf805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:37.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfc8a3700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf8148220 0x7f2bf81580d0 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f2be00014e0 tx=0x7f2bf805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:37.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bf5ffb700 1 -- 172.21.15.63:0/3086329745 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be00104d0 con 0x7f2bf8148220 2020-05-18T21:28:37.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfeb07700 1 -- 172.21.15.63:0/3086329745 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf814d2a0 con 0x7f2bf8148220 2020-05-18T21:28:37.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bf5ffb700 1 -- 172.21.15.63:0/3086329745 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2be00127e0 con 0x7f2bf8148220 2020-05-18T21:28:37.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.693+0000 7f2bfeb07700 1 -- 172.21.15.63:0/3086329745 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf80acad0 con 0x7f2bf8148220 2020-05-18T21:28:37.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.697+0000 7f2bfeb07700 1 -- 172.21.15.63:0/3086329745 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf80569e0 con 0x7f2bf8148220 2020-05-18T21:28:37.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.697+0000 7f2bfc8a3700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf8148220 0x7f2bf81580d0 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f2be00014e0 tx=0x7f2bf805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:37.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.697+0000 7f2bf5ffb700 1 -- 172.21.15.63:0/3086329745 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2be0012a50 con 0x7f2bf8148220 2020-05-18T21:28:37.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.697+0000 7f2bfc8a3700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf8148220 0x7f2bf81580d0 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f2be00014e0 tx=0x7f2bf805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:37.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.697+0000 7f2bf5ffb700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2bd004f900 0x7f2bd0051dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:37.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.697+0000 7f2bf5ffb700 1 -- 172.21.15.63:0/3086329745 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2be0063e60 con 0x7f2bf8148220 2020-05-18T21:28:37.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.697+0000 7f2bf7fff700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2bd004f900 0x7f2bd0051dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:37.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.697+0000 7f2bf7fff700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2bd004f900 0x7f2bd0051dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2be8001490 tx=0x7f2be800c240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:37.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.697+0000 7f2bf7fff700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2bd004f900 0x7f2bd0051dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2be8001490 tx=0x7f2be800c240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:37.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.697+0000 7f2bf7fff700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2bd004f900 0x7f2bd0051dc0 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f2be8001490 tx=0x7f2be800c240).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:37.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.709+0000 7f2bfc8a3700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf8148220 0x7f2bf81580d0 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f2be00014e0 tx=0x7f2bf805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:37.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.709+0000 7f2bf5ffb700 1 -- 172.21.15.63:0/3086329745 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2be003e1f0 con 0x7f2bf8148220 2020-05-18T21:28:37.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:37.865+0000 7f2bfeb07700 1 -- 172.21.15.63:0/3086329745 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit"]} v 0) v1 -- 0x7f2bf814ae50 con 0x7f2bf8148220 2020-05-18T21:28:38.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.133+0000 7f2bfc8a3700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf8148220 0x7f2bf81580d0 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f2be00014e0 tx=0x7f2bf805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:38.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.133+0000 7f2bf5ffb700 1 -- 172.21.15.63:0/3086329745 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit"]}]=0 v106) v1 ==== 133+0+0 (secure 0 0 0) 0x7f2be0041810 con 0x7f2bf8148220 2020-05-18T21:28:38.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.133+0000 7f2bfeb07700 1 -- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2bd004f900 msgr2=0x7f2bd0051dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:38.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.133+0000 7f2bfeb07700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2bd004f900 0x7f2bd0051dc0 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f2be8001490 tx=0x7f2be800c240).stop 2020-05-18T21:28:38.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.133+0000 7f2bfeb07700 1 -- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf8148220 msgr2=0x7f2bf81580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:38.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.133+0000 7f2bfeb07700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf8148220 0x7f2bf81580d0 secure :-1 s=READY pgs=388 cs=0 l=1 rx=0x7f2be00014e0 tx=0x7f2bf805fa60).stop 2020-05-18T21:28:38.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.133+0000 7f2bfeb07700 1 -- 172.21.15.63:0/3086329745 shutdown_connections 2020-05-18T21:28:38.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.133+0000 7f2bfeb07700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2bd004f900 0x7f2bd0051dc0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:38.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.133+0000 7f2bfeb07700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bf814b0f0 0x7f2bf814c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:38.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.133+0000 7f2bfeb07700 1 --2- 172.21.15.63:0/3086329745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf8148220 0x7f2bf81580d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:38.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.137+0000 7f2bfeb07700 1 -- 172.21.15.63:0/3086329745 >> 172.21.15.63:0/3086329745 conn(0x7f2bf80b83d0 msgr2=0x7f2bf81495f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:38.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.137+0000 7f2bfeb07700 1 -- 172.21.15.63:0/3086329745 shutdown_connections 2020-05-18T21:28:38.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.137+0000 7f2bfeb07700 1 -- 172.21.15.63:0/3086329745 wait complete. 2020-05-18T21:28:38.157 INFO:tasks.cephfs_test_runner:test_dirfrag_limit (tasks.cephfs.test_strays.TestStrays) ... ok 2020-05-18T21:28:38.158 INFO:tasks.cephfs_test_runner:Starting test: test_fancy_layout (tasks.cephfs.test_strays.TestStrays) 2020-05-18T21:28:38.158 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_strays.TestStrays.test_fancy_layout' 2020-05-18T21:28:38.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.265+0000 7fe102b8a700 1 Processor -- start 2020-05-18T21:28:38.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.265+0000 7fe102b8a700 1 -- start start 2020-05-18T21:28:38.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.265+0000 7fe102b8a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe0fc145df0 0x7fe0fc142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:38.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.265+0000 7fe102b8a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0fc0b7020 con 0x7fe0fc1432f0 2020-05-18T21:28:38.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.265+0000 7fe102b8a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0fc0b72c0 con 0x7fe0fc0b93f0 2020-05-18T21:28:38.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.265+0000 7fe102b8a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0fc0b7560 con 0x7fe0fc145df0 2020-05-18T21:28:38.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.265+0000 7fe102389700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe0fc1432f0 0x7fe0fc060430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57510/0 (socket says 172.21.15.63:57510) 2020-05-18T21:28:38.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.265+0000 7fe102389700 1 -- 172.21.15.63:0/386734144 learned_addr learned my addr 172.21.15.63:0/386734144 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:38.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.265+0000 7fe101387700 1 --2- 172.21.15.63:0/386734144 >> v2:172.21.15.155:3300/0 conn(0x7fe0fc145df0 0x7fe0fc142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:38.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.265+0000 7fe100b86700 1 -- 172.21.15.63:0/386734144 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634277583 0 0) 0x7fe0fc0b7020 con 0x7fe0fc1432f0 2020-05-18T21:28:38.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.265+0000 7fe100b86700 1 -- 172.21.15.63:0/386734144 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0e4003270 con 0x7fe0fc1432f0 2020-05-18T21:28:38.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe101387700 1 -- 172.21.15.63:0/386734144 >> v1:172.21.15.155:6789/0 conn(0x7fe0fc0b93f0 legacy=0x7fe0fc0b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:38.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe101387700 1 -- 172.21.15.63:0/386734144 >> v1:172.21.15.63:6789/0 conn(0x7fe0fc1432f0 legacy=0x7fe0fc060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:38.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe100b86700 1 -- 172.21.15.63:0/386734144 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2654030162 0 0) 0x7fe0e4003270 con 0x7fe0fc1432f0 2020-05-18T21:28:38.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe101387700 1 -- 172.21.15.63:0/386734144 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc0b7800 con 0x7fe0fc145df0 2020-05-18T21:28:38.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe101387700 1 --2- 172.21.15.63:0/386734144 >> v2:172.21.15.155:3300/0 conn(0x7fe0fc145df0 0x7fe0fc142e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe0f4001c30 tx=0x7fe0f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:38.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe101387700 1 --2- 172.21.15.63:0/386734144 >> v2:172.21.15.155:3300/0 conn(0x7fe0fc145df0 0x7fe0fc142e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe0f4001c30 tx=0x7fe0f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:38.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe101387700 1 --2- 172.21.15.63:0/386734144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0fc145df0 0x7fe0fc142e90 secure :-1 s=READY pgs=390 cs=0 l=1 rx=0x7fe0f4001c30 tx=0x7fe0f8007a80).ready entity=mon.1 client_cookie=f9ad358bceb49e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:38.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe101387700 1 --2- 172.21.15.63:0/386734144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0fc145df0 0x7fe0fc142e90 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7fe0f4001c30 tx=0x7fe0f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:38.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe101387700 1 --2- 172.21.15.63:0/386734144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0fc145df0 0x7fe0fc142e90 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7fe0f4001c30 tx=0x7fe0f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:38.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe100b86700 1 -- 172.21.15.63:0/386734144 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0f4001a90 con 0x7fe0fc145df0 2020-05-18T21:28:38.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe101387700 1 --2- 172.21.15.63:0/386734144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0fc145df0 0x7fe0fc142e90 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7fe0f4001c30 tx=0x7fe0f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:38.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe100b86700 1 -- 172.21.15.63:0/386734144 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f8008e40 con 0x7fe0fc145df0 2020-05-18T21:28:38.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe100b86700 1 -- 172.21.15.63:0/386734144 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0f80114f0 con 0x7fe0fc145df0 2020-05-18T21:28:38.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe102b8a700 1 -- 172.21.15.63:0/386734144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0fc145df0 msgr2=0x7fe0fc142e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:38.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe102b8a700 1 --2- 172.21.15.63:0/386734144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0fc145df0 0x7fe0fc142e90 secure :-1 s=READY pgs=390 cs=0 l=1 rx=0x7fe0f4001c30 tx=0x7fe0f8007a80).stop 2020-05-18T21:28:38.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe102b8a700 1 -- 172.21.15.63:0/386734144 shutdown_connections 2020-05-18T21:28:38.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe102b8a700 1 --2- 172.21.15.63:0/386734144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0fc145df0 0x7fe0fc142e90 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:38.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe102b8a700 1 -- 172.21.15.63:0/386734144 >> 172.21.15.63:0/386734144 conn(0x7fe0fc069b70 msgr2=0x7fe0fc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:38.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe102b8a700 1 -- 172.21.15.63:0/386734144 shutdown_connections 2020-05-18T21:28:38.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.269+0000 7fe102b8a700 1 -- 172.21.15.63:0/386734144 wait complete. 2020-05-18T21:28:38.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe102b8a700 1 Processor -- start 2020-05-18T21:28:38.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe102b8a700 1 -- start start 2020-05-18T21:28:38.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe102b8a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe0fc0b93f0 0x7fe0fc0bb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:38.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe102b8a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0fc13f760 con 0x7fe0fc1432f0 2020-05-18T21:28:38.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe102b8a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0fc13ddc0 con 0x7fe0fc145df0 2020-05-18T21:28:38.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe102b8a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0fc13e060 con 0x7fe0fc0b93f0 2020-05-18T21:28:38.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe101387700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe0fc1432f0 0x7fe0fc13bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57514/0 (socket says 172.21.15.63:57514) 2020-05-18T21:28:38.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe101387700 1 -- 172.21.15.63:0/112110464 learned_addr learned my addr 172.21.15.63:0/112110464 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:38.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe101b88700 1 --2- 172.21.15.63:0/112110464 >> v2:172.21.15.155:3300/0 conn(0x7fe0fc0b93f0 0x7fe0fc0bb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:38.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe0eaffd700 1 -- 172.21.15.63:0/112110464 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64801572 0 0) 0x7fe0fc13f760 con 0x7fe0fc1432f0 2020-05-18T21:28:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe0eaffd700 1 -- 172.21.15.63:0/112110464 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0dc002fe0 con 0x7fe0fc1432f0 2020-05-18T21:28:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe101b88700 1 -- 172.21.15.63:0/112110464 >> v1:172.21.15.155:6789/0 conn(0x7fe0fc145df0 legacy=0x7fe0fc13c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe0eaffd700 1 -- 172.21.15.63:0/112110464 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2754853665 0 0) 0x7fe0dc002fe0 con 0x7fe0fc1432f0 2020-05-18T21:28:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe101b88700 1 -- 172.21.15.63:0/112110464 >> v1:172.21.15.63:6789/0 conn(0x7fe0fc1432f0 legacy=0x7fe0fc13bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe101b88700 1 -- 172.21.15.63:0/112110464 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc13c2a0 con 0x7fe0fc0b93f0 2020-05-18T21:28:38.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe101b88700 1 --2- 172.21.15.63:0/112110464 >> v2:172.21.15.155:3300/0 conn(0x7fe0fc0b93f0 0x7fe0fc0bb980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe0f8008840 tx=0x7fe0ec0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:38.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe101b88700 1 --2- 172.21.15.63:0/112110464 >> v2:172.21.15.155:3300/0 conn(0x7fe0fc0b93f0 0x7fe0fc0bb980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe0f8008840 tx=0x7fe0ec0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:38.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe101b88700 1 --2- 172.21.15.63:0/112110464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0fc0b93f0 0x7fe0fc0bb980 secure :-1 s=READY pgs=392 cs=0 l=1 rx=0x7fe0f8008840 tx=0x7fe0ec0108a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:38.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe101b88700 1 --2- 172.21.15.63:0/112110464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0fc0b93f0 0x7fe0fc0bb980 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7fe0f8008840 tx=0x7fe0ec0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:38.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe0eaffd700 1 -- 172.21.15.63:0/112110464 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0f80086a0 con 0x7fe0fc0b93f0 2020-05-18T21:28:38.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe101b88700 1 --2- 172.21.15.63:0/112110464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0fc0b93f0 0x7fe0fc0bb980 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7fe0f8008840 tx=0x7fe0ec0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:38.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe101b88700 1 --2- 172.21.15.63:0/112110464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0fc0b93f0 0x7fe0fc0bb980 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7fe0f8008840 tx=0x7fe0ec0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:38.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.273+0000 7fe0eaffd700 1 -- 172.21.15.63:0/112110464 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec006b00 con 0x7fe0fc0b93f0 2020-05-18T21:28:38.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.277+0000 7fe102b8a700 1 -- 172.21.15.63:0/112110464 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0fc140bd0 con 0x7fe0fc0b93f0 2020-05-18T21:28:38.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.277+0000 7fe0eaffd700 1 -- 172.21.15.63:0/112110464 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0ec006e60 con 0x7fe0fc0b93f0 2020-05-18T21:28:38.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.277+0000 7fe102b8a700 1 -- 172.21.15.63:0/112110464 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0fc0ba8c0 con 0x7fe0fc0b93f0 2020-05-18T21:28:38.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.277+0000 7fe101b88700 1 --2- 172.21.15.63:0/112110464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0fc0b93f0 0x7fe0fc0bb980 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7fe0f8008840 tx=0x7fe0ec0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:38.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.277+0000 7fe102b8a700 1 -- 172.21.15.63:0/112110464 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0fc0bad70 con 0x7fe0fc0b93f0 2020-05-18T21:28:38.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.277+0000 7fe101b88700 1 --2- 172.21.15.63:0/112110464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0fc0b93f0 0x7fe0fc0bb980 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7fe0f8008840 tx=0x7fe0ec0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:38.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.277+0000 7fe0eaffd700 1 -- 172.21.15.63:0/112110464 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe0ec00a2b0 con 0x7fe0fc0b93f0 2020-05-18T21:28:38.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.277+0000 7fe0eaffd700 1 --2- 172.21.15.63:0/112110464 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe0dc04fce0 0x7fe0dc0521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:38.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.277+0000 7fe0eaffd700 1 -- 172.21.15.63:0/112110464 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe0ec063760 con 0x7fe0fc0b93f0 2020-05-18T21:28:38.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.277+0000 7fe101387700 1 --2- 172.21.15.63:0/112110464 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe0dc04fce0 0x7fe0dc0521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:38.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.277+0000 7fe101387700 1 --2- 172.21.15.63:0/112110464 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe0dc04fce0 0x7fe0dc0521a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe0f8003030 tx=0x7fe0f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:38.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.277+0000 7fe101387700 1 --2- 172.21.15.63:0/112110464 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe0dc04fce0 0x7fe0dc0521a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe0f8003030 tx=0x7fe0f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:38.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.277+0000 7fe101387700 1 --2- 172.21.15.63:0/112110464 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe0dc04fce0 0x7fe0dc0521a0 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7fe0f8003030 tx=0x7fe0f8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:38.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.289+0000 7fe101b88700 1 --2- 172.21.15.63:0/112110464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0fc0b93f0 0x7fe0fc0bb980 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7fe0f8008840 tx=0x7fe0ec0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:38.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.289+0000 7fe0eaffd700 1 -- 172.21.15.63:0/112110464 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe0ec03dab0 con 0x7fe0fc0b93f0 2020-05-18T21:28:38.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:38.445+0000 7fe102b8a700 1 -- 172.21.15.63:0/112110464 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_fancy_layout"]} v 0) v1 -- 0x7fe0fc13f8f0 con 0x7fe0fc0b93f0 2020-05-18T21:28:39.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.137+0000 7fe101b88700 1 --2- 172.21.15.63:0/112110464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0fc0b93f0 0x7fe0fc0bb980 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7fe0f8008840 tx=0x7fe0ec0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.137+0000 7fe0eaffd700 1 -- 172.21.15.63:0/112110464 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_fancy_layout"]}]=0 v107) v1 ==== 135+0+0 (secure 0 0 0) 0x7fe0ec0410d0 con 0x7fe0fc0b93f0 2020-05-18T21:28:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.141+0000 7fe102b8a700 1 -- 172.21.15.63:0/112110464 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe0dc04fce0 msgr2=0x7fe0dc0521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.141+0000 7fe102b8a700 1 --2- 172.21.15.63:0/112110464 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe0dc04fce0 0x7fe0dc0521a0 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7fe0f8003030 tx=0x7fe0f8007a80).stop 2020-05-18T21:28:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.141+0000 7fe102b8a700 1 -- 172.21.15.63:0/112110464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0fc0b93f0 msgr2=0x7fe0fc0bb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:39.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.141+0000 7fe102b8a700 1 --2- 172.21.15.63:0/112110464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0fc0b93f0 0x7fe0fc0bb980 secure :-1 s=READY pgs=392 cs=0 l=1 rx=0x7fe0f8008840 tx=0x7fe0ec0108a0).stop 2020-05-18T21:28:39.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.141+0000 7fe102b8a700 1 -- 172.21.15.63:0/112110464 shutdown_connections 2020-05-18T21:28:39.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.141+0000 7fe102b8a700 1 --2- 172.21.15.63:0/112110464 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe0dc04fce0 0x7fe0dc0521a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:39.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.141+0000 7fe102b8a700 1 --2- 172.21.15.63:0/112110464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0fc0b93f0 0x7fe0fc0bb980 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:39.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.141+0000 7fe102b8a700 1 -- 172.21.15.63:0/112110464 >> 172.21.15.63:0/112110464 conn(0x7fe0fc069b70 msgr2=0x7fe0fc0b7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:39.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.141+0000 7fe102b8a700 1 -- 172.21.15.63:0/112110464 shutdown_connections 2020-05-18T21:28:39.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.141+0000 7fe102b8a700 1 -- 172.21.15.63:0/112110464 wait complete. 2020-05-18T21:28:39.170 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:28:39.170 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:28:39.196 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:28:39.217 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:28:39.218 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-05-18T21:28:39.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b86a3700 1 Processor -- start 2020-05-18T21:28:39.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b86a3700 1 -- start start 2020-05-18T21:28:39.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b86a3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f39b00652b0 0x7f39b0142f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:39.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b86a3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f39b005bda0 0x7f39b01400d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:39.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b86a3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b005ab40 con 0x7f39b0140530 2020-05-18T21:28:39.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b86a3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b00b6a10 con 0x7f39b00652b0 2020-05-18T21:28:39.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b86a3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b005ade0 con 0x7f39b005bda0 2020-05-18T21:28:39.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b643f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f39b00652b0 0x7f39b0142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:39.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b643f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f39b00652b0 0x7f39b0142f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55332/0 (socket says 172.21.15.63:55332) 2020-05-18T21:28:39.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b643f700 1 -- 172.21.15.63:0/2926858763 learned_addr learned my addr 172.21.15.63:0/2926858763 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:39.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b5c3e700 1 --2- 172.21.15.63:0/2926858763 >> v2:172.21.15.155:3300/0 conn(0x7f39b005bda0 0x7f39b01400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:39.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b643f700 1 -- 172.21.15.63:0/2926858763 >> v2:172.21.15.155:3300/0 conn(0x7f39b005bda0 msgr2=0x7f39b01400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:39.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b643f700 1 --2- 172.21.15.63:0/2926858763 >> v2:172.21.15.155:3300/0 conn(0x7f39b005bda0 0x7f39b01400d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:39.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b643f700 1 -- 172.21.15.63:0/2926858763 >> v1:172.21.15.155:6789/0 conn(0x7f39b0140530 legacy=0x7f39b012ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:39.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b643f700 1 -- 172.21.15.63:0/2926858763 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b005b080 con 0x7f39b00652b0 2020-05-18T21:28:39.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b643f700 1 --2- 172.21.15.63:0/2926858763 >> v2:172.21.15.63:3300/0 conn(0x7f39b00652b0 0x7f39b0142f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f39ac002f70 tx=0x7f39ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b643f700 1 --2- 172.21.15.63:0/2926858763 >> v2:172.21.15.63:3300/0 conn(0x7f39b00652b0 0x7f39b0142f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f39ac002f70 tx=0x7f39ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b643f700 1 --2- 172.21.15.63:0/2926858763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39b00652b0 0x7f39b0142f30 secure :-1 s=READY pgs=552 cs=0 l=1 rx=0x7f39ac002f70 tx=0x7f39ac007a80).ready entity=mon.0 client_cookie=97a613d1d22897cd server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:39.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b643f700 1 --2- 172.21.15.63:0/2926858763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39b00652b0 0x7f39b0142f30 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7f39ac002f70 tx=0x7f39ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b643f700 1 --2- 172.21.15.63:0/2926858763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39b00652b0 0x7f39b0142f30 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7f39ac002f70 tx=0x7f39ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b643f700 1 --2- 172.21.15.63:0/2926858763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39b00652b0 0x7f39b0142f30 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7f39ac002f70 tx=0x7f39ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b543d700 1 -- 172.21.15.63:0/2926858763 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39ac0116b0 con 0x7f39b00652b0 2020-05-18T21:28:39.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b543d700 1 -- 172.21.15.63:0/2926858763 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac011810 con 0x7f39b00652b0 2020-05-18T21:28:39.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b86a3700 1 -- 172.21.15.63:0/2926858763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39b00652b0 msgr2=0x7f39b0142f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:39.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b86a3700 1 --2- 172.21.15.63:0/2926858763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39b00652b0 0x7f39b0142f30 secure :-1 s=READY pgs=552 cs=0 l=1 rx=0x7f39ac002f70 tx=0x7f39ac007a80).stop 2020-05-18T21:28:39.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.341+0000 7f39b543d700 1 -- 172.21.15.63:0/2926858763 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39ac011c30 con 0x7f39b00652b0 2020-05-18T21:28:39.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.345+0000 7f39b86a3700 1 -- 172.21.15.63:0/2926858763 shutdown_connections 2020-05-18T21:28:39.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.345+0000 7f39b86a3700 1 --2- 172.21.15.63:0/2926858763 >> v2:172.21.15.155:3300/0 conn(0x7f39b005bda0 0x7f39b01400d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:39.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.345+0000 7f39b86a3700 1 --2- 172.21.15.63:0/2926858763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39b00652b0 0x7f39b0142f30 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:39.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.345+0000 7f39b86a3700 1 -- 172.21.15.63:0/2926858763 >> 172.21.15.63:0/2926858763 conn(0x7f39b0066ed0 msgr2=0x7f39b00b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:39.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.345+0000 7f39b86a3700 1 -- 172.21.15.63:0/2926858763 shutdown_connections 2020-05-18T21:28:39.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.345+0000 7f39b86a3700 1 -- 172.21.15.63:0/2926858763 wait complete. 2020-05-18T21:28:39.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.345+0000 7f39b86a3700 1 Processor -- start 2020-05-18T21:28:39.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.345+0000 7f39b86a3700 1 -- start start 2020-05-18T21:28:39.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.345+0000 7f39b86a3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39b005bda0 0x7f39b0137bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:39.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.345+0000 7f39b86a3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f39b0140530 0x7f39b0134530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:39.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.345+0000 7f39b86a3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b01455d0 con 0x7f39b00652b0 2020-05-18T21:28:39.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.345+0000 7f39b86a3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b01453f0 con 0x7f39b0140530 2020-05-18T21:28:39.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.345+0000 7f39b86a3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b0145870 con 0x7f39b005bda0 2020-05-18T21:28:39.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.345+0000 7f39b5c3e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f39b00652b0 0x7f39b0122350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57528/0 (socket says 172.21.15.63:57528) 2020-05-18T21:28:39.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.345+0000 7f39b5c3e700 1 -- 172.21.15.63:0/3368773770 learned_addr learned my addr 172.21.15.63:0/3368773770 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:39.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.345+0000 7f39b6c40700 1 --2- 172.21.15.63:0/3368773770 >> v2:172.21.15.63:3300/0 conn(0x7f39b0140530 0x7f39b0134530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:39.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.345+0000 7f39b643f700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39b005bda0 0x7f39b0137bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:39.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.345+0000 7f399f7fe700 1 -- 172.21.15.63:0/3368773770 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478081514 0 0) 0x7f39b01455d0 con 0x7f39b00652b0 2020-05-18T21:28:39.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.345+0000 7f399f7fe700 1 -- 172.21.15.63:0/3368773770 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3990002fe0 con 0x7f39b00652b0 2020-05-18T21:28:39.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f39b643f700 1 -- 172.21.15.63:0/3368773770 >> v2:172.21.15.63:3300/0 conn(0x7f39b0140530 msgr2=0x7f39b0134530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:39.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f39b643f700 1 --2- 172.21.15.63:0/3368773770 >> v2:172.21.15.63:3300/0 conn(0x7f39b0140530 0x7f39b0134530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:39.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f39b643f700 1 -- 172.21.15.63:0/3368773770 >> v1:172.21.15.63:6789/0 conn(0x7f39b00652b0 legacy=0x7f39b0122350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:39.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f39b643f700 1 -- 172.21.15.63:0/3368773770 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b0144f80 con 0x7f39b005bda0 2020-05-18T21:28:39.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f39b6c40700 1 --2- 172.21.15.63:0/3368773770 >> v2:172.21.15.63:3300/0 conn(0x7f39b0140530 0x7f39b0134530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:39.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f39b643f700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39b005bda0 0x7f39b0137bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f39ac002f70 tx=0x7f39ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f39b643f700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39b005bda0 0x7f39b0137bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f39ac002f70 tx=0x7f39ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f39b643f700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39b005bda0 0x7f39b0137bb0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f39ac002f70 tx=0x7f39ac007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:39.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f39b643f700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39b005bda0 0x7f39b0137bb0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f39ac002f70 tx=0x7f39ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f399f7fe700 1 -- 172.21.15.63:0/3368773770 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39ac011ea0 con 0x7f39b005bda0 2020-05-18T21:28:39.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f39b643f700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39b005bda0 0x7f39b0137bb0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f39ac002f70 tx=0x7f39ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f39b86a3700 1 -- 172.21.15.63:0/3368773770 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b0145d10 con 0x7f39b005bda0 2020-05-18T21:28:39.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f399f7fe700 1 -- 172.21.15.63:0/3368773770 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac007170 con 0x7f39b005bda0 2020-05-18T21:28:39.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f39b643f700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39b005bda0 0x7f39b0137bb0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f39ac002f70 tx=0x7f39ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f399f7fe700 1 -- 172.21.15.63:0/3368773770 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39ac007510 con 0x7f39b005bda0 2020-05-18T21:28:39.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f39b86a3700 1 -- 172.21.15.63:0/3368773770 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b0122c80 con 0x7f39b005bda0 2020-05-18T21:28:39.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f39b643f700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39b005bda0 0x7f39b0137bb0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f39ac002f70 tx=0x7f39ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f39b86a3700 1 -- 172.21.15.63:0/3368773770 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b00569e0 con 0x7f39b005bda0 2020-05-18T21:28:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f399f7fe700 1 -- 172.21.15.63:0/3368773770 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f39ac005700 con 0x7f39b005bda0 2020-05-18T21:28:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f39b643f700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39b005bda0 0x7f39b0137bb0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f39ac002f70 tx=0x7f39ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f399f7fe700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f399004fce0 0x7f39900521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.349+0000 7f399f7fe700 1 -- 172.21.15.63:0/3368773770 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f39ac0640e0 con 0x7f39b005bda0 2020-05-18T21:28:39.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.353+0000 7f39b5c3e700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f399004fce0 0x7f39900521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:39.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.353+0000 7f39b5c3e700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f399004fce0 0x7f39900521a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f39a0002f70 tx=0x7f39a00098f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.353+0000 7f39b5c3e700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f399004fce0 0x7f39900521a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f39a0002f70 tx=0x7f39a00098f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.353+0000 7f39b5c3e700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f399004fce0 0x7f39900521a0 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f39a0002f70 tx=0x7f39a00098f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:39.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.361+0000 7f39b643f700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39b005bda0 0x7f39b0137bb0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f39ac002f70 tx=0x7f39ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.361+0000 7f399f7fe700 1 -- 172.21.15.63:0/3368773770 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f39ac03e530 con 0x7f39b005bda0 2020-05-18T21:28:39.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.481+0000 7f39b86a3700 1 -- 172.21.15.63:0/3368773770 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f39b0145170 con 0x7f39b005bda0 2020-05-18T21:28:39.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.485+0000 7f39b643f700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39b005bda0 0x7f39b0137bb0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f39ac002f70 tx=0x7f39ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.485+0000 7f399f7fe700 1 -- 172.21.15.63:0/3368773770 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v41) v1 ==== 81+0+33696 (secure 0 0 0) 0x7f39ac041b50 con 0x7f39b005bda0 2020-05-18T21:28:39.492 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:39.492 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:28:39.492 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 41, 2020-05-18T21:28:39.493 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:28:39.493 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2020-05-18T21:26:28.798650+0000", 2020-05-18T21:28:39.493 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2020-05-18T21:28:08.611559+0000", 2020-05-18T21:28:39.494 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:28:39.494 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:28:39.494 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-05-18T21:28:39.494 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5799936, 2020-05-18T21:28:39.495 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2020-05-18T21:28:39.495 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2020-05-18T21:28:39.495 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2020-05-18T21:28:39.495 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2020-05-18T21:28:39.495 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2020-05-18T21:28:39.495 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:28:39.496 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 4, 2020-05-18T21:28:39.496 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2020-05-18T21:28:39.496 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-05-18T21:28:39.496 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2020-05-18T21:28:39.496 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2020-05-18T21:28:39.497 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 8, 2020-05-18T21:28:39.497 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 8, 2020-05-18T21:28:39.497 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2020-05-18T21:28:39.497 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "jewel", 2020-05-18T21:28:39.497 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "pacific", 2020-05-18T21:28:39.498 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:28:39.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.498 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2020-05-18T21:28:39.498 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "device_health_metrics", 2020-05-18T21:28:39.498 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:33.080792+0000", 2020-05-18T21:28:39.499 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:28:39.499 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:28:39.499 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:28:39.499 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:28:39.499 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:28:39.499 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:28:39.500 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:28:39.500 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:28:39.500 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2020-05-18T21:28:39.500 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2020-05-18T21:28:39.500 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2020-05-18T21:28:39.501 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2020-05-18T21:28:39.501 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2020-05-18T21:28:39.501 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:28:39.501 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:28:39.501 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:28:39.502 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:28:39.502 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:28:39.502 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:28:39.502 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:28:39.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.503 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "15", 2020-05-18T21:28:39.503 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:28:39.503 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:28:39.503 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:28:39.504 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:28:39.504 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:28:39.504 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:28:39.504 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:28:39.504 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:28:39.505 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:28:39.505 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:28:39.505 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:28:39.505 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:28:39.505 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:28:39.506 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:28:39.506 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:28:39.506 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:28:39.506 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:28:39.506 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:28:39.507 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:28:39.507 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:28:39.507 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:28:39.507 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:28:39.508 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:28:39.508 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:28:39.508 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:28:39.509 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:28:39.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.509 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:28:39.510 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:28:39.510 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:28:39.510 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:28:39.510 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:28:39.511 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:28:39.511 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:28:39.511 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:28:39.512 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:28:39.512 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:28:39.512 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:28:39.513 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:28:39.513 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2020-05-18T21:28:39.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.513 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:28:39.514 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_devicehealth": {} 2020-05-18T21:28:39.514 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.515 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2020-05-18T21:28:39.515 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2020-05-18T21:28:39.516 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:40.149370+0000", 2020-05-18T21:28:39.516 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:28:39.516 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:28:39.516 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:28:39.517 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:28:39.517 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:28:39.517 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:28:39.518 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:28:39.518 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:28:39.518 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:28:39.518 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:28:39.519 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:28:39.519 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:28:39.519 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:28:39.520 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:28:39.520 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:28:39.520 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:28:39.521 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:28:39.521 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:28:39.521 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:28:39.522 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:28:39.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.522 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2020-05-18T21:28:39.523 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:28:39.523 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:28:39.523 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:28:39.524 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:28:39.524 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:28:39.524 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:28:39.524 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:28:39.525 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:28:39.525 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:28:39.525 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:28:39.526 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:28:39.526 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:28:39.526 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:28:39.527 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:28:39.527 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:28:39.527 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:28:39.528 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:28:39.528 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:28:39.528 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:28:39.529 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:28:39.529 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:28:39.529 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:28:39.530 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:28:39.530 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:28:39.530 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:28:39.531 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:28:39.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.531 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:28:39.532 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:28:39.532 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:28:39.533 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:28:39.533 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:28:39.533 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:28:39.534 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:28:39.534 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:28:39.534 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:28:39.535 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:28:39.535 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:28:39.535 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:28:39.536 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:28:39.536 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2020-05-18T21:28:39.536 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.537 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 7, 2020-05-18T21:28:39.538 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2020-05-18T21:28:39.538 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:28:07.066659+0000", 2020-05-18T21:28:39.538 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:28:39.539 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:28:39.539 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:28:39.539 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:28:39.540 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:28:39.540 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:28:39.540 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:28:39.541 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:28:39.541 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:28:39.541 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:28:39.542 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:28:39.542 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:28:39.542 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:28:39.543 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:28:39.543 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:28:39.543 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:28:39.544 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:28:39.544 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:28:39.544 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:28:39.545 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:28:39.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.545 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "41", 2020-05-18T21:28:39.546 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:28:39.546 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:28:39.546 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:28:39.546 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:28:39.547 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:28:39.547 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:28:39.547 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:28:39.547 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:28:39.547 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:28:39.547 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:28:39.548 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:28:39.548 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:28:39.548 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:28:39.548 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:28:39.548 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:28:39.549 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:28:39.549 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:28:39.549 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:28:39.549 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:28:39.549 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:28:39.550 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:28:39.550 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:28:39.550 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:28:39.550 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:28:39.550 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:28:39.551 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:28:39.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.556 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:28:39.556 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:28:39.557 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:28:39.557 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:28:39.557 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:28:39.557 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:28:39.558 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:28:39.558 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:28:39.558 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:28:39.558 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:28:39.559 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:28:39.559 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:28:39.559 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2020-05-18T21:28:39.559 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2020-05-18T21:28:39.559 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2020-05-18T21:28:39.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.560 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:28:39.560 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:28:39.560 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2020-05-18T21:28:39.560 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.560 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.561 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 8, 2020-05-18T21:28:39.561 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2020-05-18T21:28:39.561 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:28:07.623692+0000", 2020-05-18T21:28:39.562 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:28:39.562 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:28:39.562 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:28:39.562 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:28:39.562 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:28:39.563 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:28:39.563 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:28:39.563 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:28:39.563 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:28:39.563 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:28:39.564 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:28:39.564 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:28:39.564 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:28:39.564 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:28:39.564 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:28:39.564 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:28:39.565 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:28:39.565 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:28:39.565 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:28:39.565 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:28:39.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.566 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "41", 2020-05-18T21:28:39.566 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:28:39.566 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:28:39.566 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:28:39.566 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:28:39.567 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:28:39.567 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:28:39.567 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:28:39.567 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:28:39.568 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:28:39.568 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:28:39.568 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:28:39.568 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:28:39.569 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:28:39.569 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:28:39.569 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:28:39.569 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:28:39.569 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:28:39.570 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:28:39.570 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:28:39.570 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:28:39.570 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:28:39.570 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:28:39.571 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:28:39.571 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:28:39.571 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:28:39.571 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:28:39.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.572 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:28:39.572 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:28:39.572 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:28:39.572 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:28:39.572 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:28:39.572 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:28:39.573 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:28:39.573 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:28:39.573 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:28:39.573 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:28:39.573 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:28:39.574 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:28:39.574 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:28:39.574 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:28:39.574 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2020-05-18T21:28:39.575 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.575 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.575 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.575 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:28:39.575 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2020-05-18T21:28:39.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.576 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:28:39.576 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "c6ae0fbf-604c-4e8d-b1b8-6038821420e3", 2020-05-18T21:28:39.576 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:28:39.576 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:28:39.576 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:28:39.577 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:28:39.577 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:28:39.577 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:28:39.578 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:28:39.578 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 39, 2020-05-18T21:28:39.578 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:28:39.579 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:28:39.579 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:28:39.579 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.580 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.580 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2020-05-18T21:28:39.581 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:28:39.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.581 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.582 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2020-05-18T21:28:39.582 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:28:39.582 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.582 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.583 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:28:39.583 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.584 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.584 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6802", 2020-05-18T21:28:39.585 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:28:39.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.586 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.586 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6803", 2020-05-18T21:28:39.586 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:28:39.587 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.587 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.588 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:28:39.588 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.589 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.589 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6806", 2020-05-18T21:28:39.589 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:28:39.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.590 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.591 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6807", 2020-05-18T21:28:39.591 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:28:39.591 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.592 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.592 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:28:39.592 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.593 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.593 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6804", 2020-05-18T21:28:39.594 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:28:39.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.595 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.595 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6805", 2020-05-18T21:28:39.595 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:28:39.595 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.596 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.596 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6801/12803", 2020-05-18T21:28:39.597 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6803/12803", 2020-05-18T21:28:39.597 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6807/12803", 2020-05-18T21:28:39.597 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6805/12803", 2020-05-18T21:28:39.598 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:28:39.598 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:28:39.598 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:28:39.599 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.600 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:28:39.600 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6", 2020-05-18T21:28:39.600 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:28:39.600 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:28:39.601 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:28:39.601 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:28:39.601 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:28:39.602 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:28:39.602 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:28:39.602 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 39, 2020-05-18T21:28:39.603 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:28:39.603 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:28:39.603 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:28:39.603 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.604 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.604 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6808", 2020-05-18T21:28:39.605 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:28:39.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.606 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.606 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6809", 2020-05-18T21:28:39.606 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:28:39.607 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.607 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.607 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:28:39.608 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.608 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.609 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6810", 2020-05-18T21:28:39.609 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:28:39.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.610 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.610 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6811", 2020-05-18T21:28:39.611 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:28:39.611 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.611 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.612 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:28:39.612 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.612 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.613 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6815", 2020-05-18T21:28:39.613 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:28:39.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.613 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.614 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6817", 2020-05-18T21:28:39.614 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:28:39.614 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.614 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.614 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:28:39.615 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.615 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.615 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6812", 2020-05-18T21:28:39.615 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:28:39.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.616 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.616 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6813", 2020-05-18T21:28:39.616 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:28:39.616 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.617 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.617 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6809/12804", 2020-05-18T21:28:39.617 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6811/12804", 2020-05-18T21:28:39.617 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6817/12804", 2020-05-18T21:28:39.618 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6813/12804", 2020-05-18T21:28:39.618 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:28:39.618 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:28:39.618 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:28:39.618 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.619 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:28:39.619 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "ec8d9fa9-dae9-45f6-b286-735ab3801c27", 2020-05-18T21:28:39.619 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:28:39.619 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:28:39.620 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:28:39.620 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:28:39.620 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:28:39.620 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:28:39.620 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:28:39.621 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 30, 2020-05-18T21:28:39.621 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:28:39.621 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:28:39.621 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:28:39.621 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.622 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.622 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6822", 2020-05-18T21:28:39.622 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:28:39.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.623 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.623 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6824", 2020-05-18T21:28:39.623 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:28:39.623 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.623 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.624 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:28:39.624 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.624 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.624 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6826", 2020-05-18T21:28:39.625 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:28:39.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.625 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.625 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6827", 2020-05-18T21:28:39.626 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:28:39.626 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.626 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.626 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:28:39.626 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.627 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.627 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6830", 2020-05-18T21:28:39.627 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:28:39.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.628 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.628 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6831", 2020-05-18T21:28:39.628 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:28:39.628 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.629 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.629 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:28:39.629 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.629 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.630 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6828", 2020-05-18T21:28:39.630 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:28:39.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.630 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.631 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6829", 2020-05-18T21:28:39.631 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:28:39.631 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.631 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.632 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6824/12806", 2020-05-18T21:28:39.632 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6827/12806", 2020-05-18T21:28:39.632 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6831/12806", 2020-05-18T21:28:39.632 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6829/12806", 2020-05-18T21:28:39.633 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:28:39.633 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:28:39.633 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:28:39.633 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.634 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:28:39.634 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "1030fedf-adad-4e79-b839-59385d4d7d2a", 2020-05-18T21:28:39.634 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:28:39.634 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:28:39.634 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:28:39.635 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:28:39.635 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:28:39.635 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:28:39.635 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:28:39.635 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 39, 2020-05-18T21:28:39.636 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:28:39.636 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:28:39.636 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:28:39.636 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.636 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.637 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6814", 2020-05-18T21:28:39.637 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:28:39.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.637 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.638 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6816", 2020-05-18T21:28:39.638 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:28:39.638 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.638 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.639 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:28:39.639 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.639 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.639 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6818", 2020-05-18T21:28:39.640 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:28:39.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.640 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.640 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6819", 2020-05-18T21:28:39.641 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:28:39.641 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.641 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.641 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:28:39.642 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.642 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.642 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6823", 2020-05-18T21:28:39.642 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:28:39.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.643 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.643 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6825", 2020-05-18T21:28:39.643 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:28:39.643 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.644 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.644 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:28:39.644 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.645 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.645 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6820", 2020-05-18T21:28:39.645 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:28:39.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.646 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.646 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6821", 2020-05-18T21:28:39.646 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:28:39.646 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.646 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.647 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6816/12805", 2020-05-18T21:28:39.647 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6819/12805", 2020-05-18T21:28:39.647 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6825/12805", 2020-05-18T21:28:39.647 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6821/12805", 2020-05-18T21:28:39.647 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:28:39.648 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:28:39.648 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:28:39.648 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.648 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:28:39.649 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "8ad15a9b-97b4-4002-b1d4-7292e09b4ef6", 2020-05-18T21:28:39.649 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:28:39.649 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:28:39.649 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:28:39.649 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:28:39.650 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:28:39.650 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:28:39.650 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:28:39.650 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 39, 2020-05-18T21:28:39.650 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:28:39.650 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:28:39.651 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:28:39.651 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.651 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.651 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6800", 2020-05-18T21:28:39.652 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:28:39.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.652 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.652 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6801", 2020-05-18T21:28:39.653 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:28:39.653 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.653 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.653 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:28:39.653 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.654 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.654 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6802", 2020-05-18T21:28:39.654 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:28:39.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.655 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.655 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6803", 2020-05-18T21:28:39.655 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:28:39.655 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.655 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.656 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:28:39.656 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.656 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.657 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6806", 2020-05-18T21:28:39.657 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:28:39.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.657 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.657 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6807", 2020-05-18T21:28:39.658 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:28:39.658 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.658 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.658 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:28:39.659 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.659 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.659 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6804", 2020-05-18T21:28:39.659 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:28:39.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.661 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.661 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6805", 2020-05-18T21:28:39.661 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:28:39.661 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.662 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.662 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6801/13023", 2020-05-18T21:28:39.662 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6803/13023", 2020-05-18T21:28:39.663 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6807/13023", 2020-05-18T21:28:39.663 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6805/13023", 2020-05-18T21:28:39.663 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:28:39.663 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:28:39.663 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:28:39.663 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.664 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:28:39.664 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0dce88f8-b984-43e1-95e2-4132171102d2", 2020-05-18T21:28:39.664 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:28:39.665 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:28:39.665 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:28:39.665 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:28:39.665 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:28:39.665 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:28:39.666 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:28:39.666 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 39, 2020-05-18T21:28:39.666 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:28:39.666 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:28:39.666 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:28:39.666 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.667 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.667 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6808", 2020-05-18T21:28:39.667 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:28:39.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.668 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.668 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6809", 2020-05-18T21:28:39.668 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:28:39.668 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.668 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.669 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:28:39.669 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.669 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.670 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6810", 2020-05-18T21:28:39.670 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:28:39.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.670 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.670 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6811", 2020-05-18T21:28:39.671 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:28:39.671 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.671 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.671 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:28:39.672 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.672 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.672 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6814", 2020-05-18T21:28:39.672 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:28:39.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.673 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.673 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6816", 2020-05-18T21:28:39.673 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:28:39.673 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.674 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.674 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:28:39.674 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.675 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.675 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6812", 2020-05-18T21:28:39.675 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:28:39.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.675 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.676 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6813", 2020-05-18T21:28:39.676 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:28:39.676 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.676 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.677 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6809/13024", 2020-05-18T21:28:39.677 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6811/13024", 2020-05-18T21:28:39.677 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6816/13024", 2020-05-18T21:28:39.677 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6813/13024", 2020-05-18T21:28:39.677 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:28:39.678 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:28:39.678 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:28:39.678 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.678 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:28:39.679 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "e1bc92f8-3692-4483-b0fb-905c94fa1469", 2020-05-18T21:28:39.679 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:28:39.679 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:28:39.679 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:28:39.679 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:28:39.680 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:28:39.680 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:28:39.680 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:28:39.680 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 39, 2020-05-18T21:28:39.680 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:28:39.680 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:28:39.681 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:28:39.681 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.681 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.681 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6815", 2020-05-18T21:28:39.682 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:28:39.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.682 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.682 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6817", 2020-05-18T21:28:39.683 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:28:39.683 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.683 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.683 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:28:39.683 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.684 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.684 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6818", 2020-05-18T21:28:39.684 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:28:39.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.685 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.685 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6819", 2020-05-18T21:28:39.685 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:28:39.685 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.685 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.686 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:28:39.686 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.686 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.687 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6822", 2020-05-18T21:28:39.687 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:28:39.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.687 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.688 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6824", 2020-05-18T21:28:39.688 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:28:39.688 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.688 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.689 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:28:39.689 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.689 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.689 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6820", 2020-05-18T21:28:39.690 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:28:39.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.690 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.690 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6821", 2020-05-18T21:28:39.691 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:28:39.691 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.691 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.691 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6817/13025", 2020-05-18T21:28:39.692 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6819/13025", 2020-05-18T21:28:39.692 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6824/13025", 2020-05-18T21:28:39.692 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6821/13025", 2020-05-18T21:28:39.692 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:28:39.692 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:28:39.692 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:28:39.693 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.693 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:28:39.693 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "b76e000c-a078-48c4-9e1e-34d286a9992c", 2020-05-18T21:28:39.694 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:28:39.694 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:28:39.694 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:28:39.694 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:28:39.694 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:28:39.694 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:28:39.695 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:28:39.695 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 38, 2020-05-18T21:28:39.695 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:28:39.695 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:28:39.695 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:28:39.696 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.696 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.696 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6823", 2020-05-18T21:28:39.696 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:28:39.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.697 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.697 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6825", 2020-05-18T21:28:39.697 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:28:39.697 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.698 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.698 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:28:39.698 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.699 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.699 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6826", 2020-05-18T21:28:39.699 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:28:39.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.699 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.700 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6827", 2020-05-18T21:28:39.700 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:28:39.700 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.700 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.701 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:28:39.701 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.701 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.701 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6830", 2020-05-18T21:28:39.701 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:28:39.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.702 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.702 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6831", 2020-05-18T21:28:39.702 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:28:39.703 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.703 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.703 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:28:39.703 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:28:39.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.704 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:28:39.704 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6828", 2020-05-18T21:28:39.704 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:28:39.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.705 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:39.705 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6829", 2020-05-18T21:28:39.705 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:28:39.705 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.705 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.706 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6825/13026", 2020-05-18T21:28:39.706 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6827/13026", 2020-05-18T21:28:39.706 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6831/13026", 2020-05-18T21:28:39.706 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6829/13026", 2020-05-18T21:28:39.706 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:28:39.707 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:28:39.707 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:28:39.707 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:39.707 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.707 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:28:39.708 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2020-05-18T21:28:39.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.708 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:28:39.708 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:28:39.708 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:28:39.708 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:28:39.709 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:28:39.709 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:28:39.709 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.281434+0000", 2020-05-18T21:28:39.709 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:28:39.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.710 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:28:39.710 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:28:39.710 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:28:39.710 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:28:39.710 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:28:39.711 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:28:39.711 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.608518+0000", 2020-05-18T21:28:39.711 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:28:39.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.712 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:28:39.712 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:28:39.712 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:28:39.712 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:28:39.712 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:28:39.712 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:28:39.713 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.582386+0000", 2020-05-18T21:28:39.713 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:28:39.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.713 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:28:39.714 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:28:39.714 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:28:39.714 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:28:39.714 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:28:39.714 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:28:39.715 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.573488+0000", 2020-05-18T21:28:39.715 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:28:39.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.715 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:28:39.715 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:28:39.716 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:28:39.716 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:28:39.716 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:28:39.716 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:28:39.716 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.604174+0000", 2020-05-18T21:28:39.717 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:28:39.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.717 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:28:39.717 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:28:39.717 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:28:39.718 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:28:39.718 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:28:39.718 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:28:39.718 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.371004+0000", 2020-05-18T21:28:39.718 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:28:39.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.719 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:28:39.723 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:28:39.723 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:28:39.724 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:28:39.724 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:28:39.724 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:28:39.724 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.593070+0000", 2020-05-18T21:28:39.724 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:28:39.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:39.725 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:28:39.725 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:28:39.725 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:28:39.725 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:28:39.726 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:28:39.726 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:28:39.726 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.667677+0000", 2020-05-18T21:28:39.726 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:28:39.726 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.727 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:28:39.727 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2020-05-18T21:28:39.727 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2020-05-18T21:28:39.727 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2020-05-18T21:28:39.727 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2020-05-18T21:28:39.727 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklist": {}, 2020-05-18T21:28:39.728 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2020-05-18T21:28:39.728 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2020-05-18T21:28:39.728 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2020-05-18T21:28:39.728 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2020-05-18T21:28:39.728 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2020-05-18T21:28:39.729 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2020-05-18T21:28:39.729 INFO:teuthology.orchestra.run.smithi063.stdout: "ruleset-failure-domain": "osd", 2020-05-18T21:28:39.729 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2020-05-18T21:28:39.729 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:39.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:39.729 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2020-05-18T21:28:39.730 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2020-05-18T21:28:39.730 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2020-05-18T21:28:39.730 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2020-05-18T21:28:39.730 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {} 2020-05-18T21:28:39.730 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:28:39.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.485+0000 7f39b86a3700 1 -- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f399004fce0 msgr2=0x7f39900521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:39.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.485+0000 7f39b86a3700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f399004fce0 0x7f39900521a0 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f39a0002f70 tx=0x7f39a00098f0).stop 2020-05-18T21:28:39.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.485+0000 7f39b86a3700 1 -- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39b005bda0 msgr2=0x7f39b0137bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:39.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.485+0000 7f39b86a3700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39b005bda0 0x7f39b0137bb0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f39ac002f70 tx=0x7f39ac007a80).stop 2020-05-18T21:28:39.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.489+0000 7f39b86a3700 1 -- 172.21.15.63:0/3368773770 shutdown_connections 2020-05-18T21:28:39.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.489+0000 7f39b86a3700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f399004fce0 0x7f39900521a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:39.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.489+0000 7f39b86a3700 1 --2- 172.21.15.63:0/3368773770 >> v2:172.21.15.63:3300/0 conn(0x7f39b0140530 0x7f39b0134530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:39.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.489+0000 7f39b86a3700 1 --2- 172.21.15.63:0/3368773770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39b005bda0 0x7f39b0137bb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:39.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.489+0000 7f39b86a3700 1 -- 172.21.15.63:0/3368773770 >> 172.21.15.63:0/3368773770 conn(0x7f39b0066ed0 msgr2=0x7f39b0064610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:39.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.489+0000 7f39b86a3700 1 -- 172.21.15.63:0/3368773770 shutdown_connections 2020-05-18T21:28:39.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.489+0000 7f39b86a3700 1 -- 172.21.15.63:0/3368773770 wait complete. 2020-05-18T21:28:39.735 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:28:39.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb11bd93700 1 Processor -- start 2020-05-18T21:28:39.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb11bd93700 1 -- start start 2020-05-18T21:28:39.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb11bd93700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb114060b90 0x7fb1140615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:39.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb11bd93700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11414d960 con 0x7fb1140b2860 2020-05-18T21:28:39.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb11bd93700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11414db90 con 0x7fb11414e570 2020-05-18T21:28:39.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb11bd93700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb114066210 con 0x7fb114060b90 2020-05-18T21:28:39.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb11932e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb1140b2860 0x7fb114144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57534/0 (socket says 172.21.15.63:57534) 2020-05-18T21:28:39.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb11932e700 1 -- 172.21.15.63:0/939062180 learned_addr learned my addr 172.21.15.63:0/939062180 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:39.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb119b2f700 1 --2- 172.21.15.63:0/939062180 >> v2:172.21.15.155:3300/0 conn(0x7fb114060b90 0x7fb1140615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:39.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb118b2d700 1 -- 172.21.15.63:0/939062180 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092189077 0 0) 0x7fb11414d960 con 0x7fb1140b2860 2020-05-18T21:28:39.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb118b2d700 1 -- 172.21.15.63:0/939062180 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb100003270 con 0x7fb1140b2860 2020-05-18T21:28:39.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb119b2f700 1 -- 172.21.15.63:0/939062180 >> v1:172.21.15.155:6789/0 conn(0x7fb11414e570 legacy=0x7fb11414a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:39.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb119b2f700 1 -- 172.21.15.63:0/939062180 >> v1:172.21.15.63:6789/0 conn(0x7fb1140b2860 legacy=0x7fb114144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:39.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb119b2f700 1 -- 172.21.15.63:0/939062180 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11414de30 con 0x7fb114060b90 2020-05-18T21:28:39.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb119b2f700 1 --2- 172.21.15.63:0/939062180 >> v2:172.21.15.155:3300/0 conn(0x7fb114060b90 0x7fb1140615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb114062dc0 tx=0x7fb110008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb119b2f700 1 --2- 172.21.15.63:0/939062180 >> v2:172.21.15.155:3300/0 conn(0x7fb114060b90 0x7fb1140615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb114062dc0 tx=0x7fb110008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb119b2f700 1 --2- 172.21.15.63:0/939062180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb114060b90 0x7fb1140615e0 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7fb114062dc0 tx=0x7fb110008920).ready entity=mon.1 client_cookie=f4f7470ed8db04bf server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:39.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb119b2f700 1 --2- 172.21.15.63:0/939062180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb114060b90 0x7fb1140615e0 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7fb114062dc0 tx=0x7fb110008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb118b2d700 1 -- 172.21.15.63:0/939062180 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb110008e80 con 0x7fb114060b90 2020-05-18T21:28:39.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb119b2f700 1 --2- 172.21.15.63:0/939062180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb114060b90 0x7fb1140615e0 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7fb114062dc0 tx=0x7fb110008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb119b2f700 1 --2- 172.21.15.63:0/939062180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb114060b90 0x7fb1140615e0 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7fb114062dc0 tx=0x7fb110008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb118b2d700 1 -- 172.21.15.63:0/939062180 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1100115f0 con 0x7fb114060b90 2020-05-18T21:28:39.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb11bd93700 1 -- 172.21.15.63:0/939062180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb114060b90 msgr2=0x7fb1140615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:39.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb118b2d700 1 -- 172.21.15.63:0/939062180 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1100119d0 con 0x7fb114060b90 2020-05-18T21:28:39.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb11bd93700 1 --2- 172.21.15.63:0/939062180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb114060b90 0x7fb1140615e0 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7fb114062dc0 tx=0x7fb110008920).stop 2020-05-18T21:28:39.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb11bd93700 1 -- 172.21.15.63:0/939062180 shutdown_connections 2020-05-18T21:28:39.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb11bd93700 1 --2- 172.21.15.63:0/939062180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb114060b90 0x7fb1140615e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:39.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb11bd93700 1 -- 172.21.15.63:0/939062180 >> 172.21.15.63:0/939062180 conn(0x7fb1140b83d0 msgr2=0x7fb1140b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:39.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb11bd93700 1 -- 172.21.15.63:0/939062180 shutdown_connections 2020-05-18T21:28:39.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.841+0000 7fb11bd93700 1 -- 172.21.15.63:0/939062180 wait complete. 2020-05-18T21:28:39.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.845+0000 7fb11bd93700 1 Processor -- start 2020-05-18T21:28:39.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.845+0000 7fb11bd93700 1 -- start start 2020-05-18T21:28:39.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.845+0000 7fb11bd93700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb114060b90 0x7fb1141457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:39.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.845+0000 7fb11bd93700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb1140b2860 0x7fb11414a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:39.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.845+0000 7fb11bd93700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb114145c40 con 0x7fb11414e570 2020-05-18T21:28:39.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.845+0000 7fb11bd93700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11414bb50 con 0x7fb114060b90 2020-05-18T21:28:39.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.845+0000 7fb11bd93700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11414bdf0 con 0x7fb1140b2860 2020-05-18T21:28:39.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.845+0000 7fb119b2f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb114060b90 0x7fb1141457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:39.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.845+0000 7fb119b2f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb114060b90 0x7fb1141457e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55352/0 (socket says 172.21.15.63:55352) 2020-05-18T21:28:39.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.845+0000 7fb119b2f700 1 -- 172.21.15.63:0/3893934006 learned_addr learned my addr 172.21.15.63:0/3893934006 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:39.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.845+0000 7fb11932e700 1 --2- 172.21.15.63:0/3893934006 >> v2:172.21.15.155:3300/0 conn(0x7fb1140b2860 0x7fb11414a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:39.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb10affd700 1 -- 172.21.15.63:0/3893934006 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855854712 0 0) 0x7fb114145c40 con 0x7fb11414e570 2020-05-18T21:28:39.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb119b2f700 1 -- 172.21.15.63:0/3893934006 >> v2:172.21.15.155:3300/0 conn(0x7fb1140b2860 msgr2=0x7fb11414a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:39.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb119b2f700 1 --2- 172.21.15.63:0/3893934006 >> v2:172.21.15.155:3300/0 conn(0x7fb1140b2860 0x7fb11414a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:39.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb119b2f700 1 -- 172.21.15.63:0/3893934006 >> v1:172.21.15.155:6789/0 conn(0x7fb11414e570 legacy=0x7fb114144a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:39.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb119b2f700 1 -- 172.21.15.63:0/3893934006 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11414c090 con 0x7fb114060b90 2020-05-18T21:28:39.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb119b2f700 1 --2- 172.21.15.63:0/3893934006 >> v2:172.21.15.63:3300/0 conn(0x7fb114060b90 0x7fb1141457e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb114062dc0 tx=0x7fb11405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb119b2f700 1 --2- 172.21.15.63:0/3893934006 >> v2:172.21.15.63:3300/0 conn(0x7fb114060b90 0x7fb1141457e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb114062dc0 tx=0x7fb11405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb119b2f700 1 --2- 172.21.15.63:0/3893934006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb114060b90 0x7fb1141457e0 secure :-1 s=READY pgs=555 cs=0 l=1 rx=0x7fb114062dc0 tx=0x7fb11405fa60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:39.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb119b2f700 1 --2- 172.21.15.63:0/3893934006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb114060b90 0x7fb1141457e0 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7fb114062dc0 tx=0x7fb11405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb10affd700 1 -- 172.21.15.63:0/3893934006 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb11000f860 con 0x7fb114060b90 2020-05-18T21:28:39.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb119b2f700 1 --2- 172.21.15.63:0/3893934006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb114060b90 0x7fb1141457e0 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7fb114062dc0 tx=0x7fb11405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb119b2f700 1 --2- 172.21.15.63:0/3893934006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb114060b90 0x7fb1141457e0 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7fb114062dc0 tx=0x7fb11405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb10affd700 1 -- 172.21.15.63:0/3893934006 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb110007360 con 0x7fb114060b90 2020-05-18T21:28:39.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb11bd93700 1 -- 172.21.15.63:0/3893934006 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb114145190 con 0x7fb114060b90 2020-05-18T21:28:39.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb10affd700 1 -- 172.21.15.63:0/3893934006 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb110007550 con 0x7fb114060b90 2020-05-18T21:28:39.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb11bd93700 1 -- 172.21.15.63:0/3893934006 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb11414ae10 con 0x7fb114060b90 2020-05-18T21:28:39.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb119b2f700 1 --2- 172.21.15.63:0/3893934006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb114060b90 0x7fb1141457e0 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7fb114062dc0 tx=0x7fb11405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb11bd93700 1 -- 172.21.15.63:0/3893934006 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb11414c270 con 0x7fb114060b90 2020-05-18T21:28:39.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb10affd700 1 -- 172.21.15.63:0/3893934006 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb1100058f0 con 0x7fb114060b90 2020-05-18T21:28:39.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb119b2f700 1 --2- 172.21.15.63:0/3893934006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb114060b90 0x7fb1141457e0 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7fb114062dc0 tx=0x7fb11405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb10affd700 1 --2- 172.21.15.63:0/3893934006 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0f404f890 0x7fb0f4051d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:39.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb10affd700 1 -- 172.21.15.63:0/3893934006 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb1100644d0 con 0x7fb114060b90 2020-05-18T21:28:39.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.849+0000 7fb11932e700 1 --2- 172.21.15.63:0/3893934006 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0f404f890 0x7fb0f4051d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:39.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.853+0000 7fb11932e700 1 --2- 172.21.15.63:0/3893934006 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0f404f890 0x7fb0f4051d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb10c001490 tx=0x7fb10c00ccd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.853+0000 7fb11932e700 1 --2- 172.21.15.63:0/3893934006 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0f404f890 0x7fb0f4051d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb10c001490 tx=0x7fb10c00ccd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.853+0000 7fb11932e700 1 --2- 172.21.15.63:0/3893934006 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0f404f890 0x7fb0f4051d50 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7fb10c001490 tx=0x7fb10c00ccd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:39.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.857+0000 7fb119b2f700 1 --2- 172.21.15.63:0/3893934006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb114060b90 0x7fb1141457e0 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7fb114062dc0 tx=0x7fb11405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:39.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:39.857+0000 7fb10affd700 1 -- 172.21.15.63:0/3893934006 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb11003e860 con 0x7fb114060b90 2020-05-18T21:28:40.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.009+0000 7fb11bd93700 1 -- 172.21.15.63:0/3893934006 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1140569e0 con 0x7fb114060b90 2020-05-18T21:28:40.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.009+0000 7fb119b2f700 1 --2- 172.21.15.63:0/3893934006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb114060b90 0x7fb1141457e0 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7fb114062dc0 tx=0x7fb11405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:40.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.009+0000 7fb10affd700 1 -- 172.21.15.63:0/3893934006 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+2138 (secure 0 0 0) 0x7fb110041e80 con 0x7fb114060b90 2020-05-18T21:28:40.016 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:40.016 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593103128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593103128},{"type":"v1","addr":"172.21.15.155:6835","nonce":593103128}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:28:08.611856+0000","modified":"2020-05-18T21:28:09.616560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/3182633142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3182633142},{"type":"v1","addr":"172.21.15.63:6833","nonce":3182633142}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-05-18T21:28:40.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.009+0000 7fb11bd93700 1 -- 172.21.15.63:0/3893934006 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0f404f890 msgr2=0x7fb0f4051d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:40.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.009+0000 7fb11bd93700 1 --2- 172.21.15.63:0/3893934006 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0f404f890 0x7fb0f4051d50 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7fb10c001490 tx=0x7fb10c00ccd0).stop 2020-05-18T21:28:40.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.009+0000 7fb11bd93700 1 -- 172.21.15.63:0/3893934006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb114060b90 msgr2=0x7fb1141457e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:40.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.009+0000 7fb11bd93700 1 --2- 172.21.15.63:0/3893934006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb114060b90 0x7fb1141457e0 secure :-1 s=READY pgs=555 cs=0 l=1 rx=0x7fb114062dc0 tx=0x7fb11405fa60).stop 2020-05-18T21:28:40.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.009+0000 7fb11bd93700 1 -- 172.21.15.63:0/3893934006 shutdown_connections 2020-05-18T21:28:40.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.009+0000 7fb11bd93700 1 --2- 172.21.15.63:0/3893934006 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0f404f890 0x7fb0f4051d50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:40.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.009+0000 7fb11bd93700 1 --2- 172.21.15.63:0/3893934006 >> v2:172.21.15.155:3300/0 conn(0x7fb1140b2860 0x7fb11414a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:40.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.009+0000 7fb11bd93700 1 --2- 172.21.15.63:0/3893934006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb114060b90 0x7fb1141457e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:40.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.009+0000 7fb11bd93700 1 -- 172.21.15.63:0/3893934006 >> 172.21.15.63:0/3893934006 conn(0x7fb1140b83d0 msgr2=0x7fb114146a10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:40.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.009+0000 7fb11bd93700 1 -- 172.21.15.63:0/3893934006 shutdown_connections 2020-05-18T21:28:40.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.013+0000 7fb11bd93700 1 -- 172.21.15.63:0/3893934006 wait complete. 2020-05-18T21:28:40.022 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2020-05-18T21:28:40.028 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-05-18T21:28:40.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.129+0000 7f482a410700 1 Processor -- start 2020-05-18T21:28:40.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.129+0000 7f482a410700 1 -- start start 2020-05-18T21:28:40.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.129+0000 7f482a410700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f482409e6c0 0x7f48240b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:40.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.129+0000 7f482a410700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f48241430e0 0x7f482409c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:40.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.133+0000 7f482a410700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482409cf30 con 0x7f48240b51c0 2020-05-18T21:28:40.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.133+0000 7f482a410700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48240b3510 con 0x7f48241430e0 2020-05-18T21:28:40.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.133+0000 7f482a410700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48240b3270 con 0x7f482409e6c0 2020-05-18T21:28:40.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.133+0000 7f4828c0d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f48240b51c0 0x7f482409bc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57550/0 (socket says 172.21.15.63:57550) 2020-05-18T21:28:40.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.133+0000 7f4828c0d700 1 -- 172.21.15.63:0/3810641639 learned_addr learned my addr 172.21.15.63:0/3810641639 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:40.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.133+0000 7f4829c0f700 1 --2- 172.21.15.63:0/3810641639 >> v2:172.21.15.63:3300/0 conn(0x7f48241430e0 0x7f482409c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:40.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.133+0000 7f482940e700 1 --2- 172.21.15.63:0/3810641639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f482409e6c0 0x7f48240b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:40.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.133+0000 7f4829c0f700 1 -- 172.21.15.63:0/3810641639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f482409e6c0 msgr2=0x7f48240b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:40.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.133+0000 7f4829c0f700 1 --2- 172.21.15.63:0/3810641639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f482409e6c0 0x7f48240b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:40.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.133+0000 7f4829c0f700 1 -- 172.21.15.63:0/3810641639 >> v1:172.21.15.63:6789/0 conn(0x7f48240b51c0 legacy=0x7f482409bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:40.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.133+0000 7f4829c0f700 1 -- 172.21.15.63:0/3810641639 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482409eaa0 con 0x7f48241430e0 2020-05-18T21:28:40.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.133+0000 7f4829c0f700 1 --2- 172.21.15.63:0/3810641639 >> v2:172.21.15.63:3300/0 conn(0x7f48241430e0 0x7f482409c360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f481c0032f0 tx=0x7f481c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:40.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.133+0000 7f4829c0f700 1 --2- 172.21.15.63:0/3810641639 >> v2:172.21.15.63:3300/0 conn(0x7f48241430e0 0x7f482409c360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f481c0032f0 tx=0x7f481c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:40.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.133+0000 7f4829c0f700 1 --2- 172.21.15.63:0/3810641639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48241430e0 0x7f482409c360 secure :-1 s=READY pgs=557 cs=0 l=1 rx=0x7f481c0032f0 tx=0x7f481c007e00).ready entity=mon.0 client_cookie=4b15a5edc82bd2c4 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:40.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.133+0000 7f4829c0f700 1 --2- 172.21.15.63:0/3810641639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48241430e0 0x7f482409c360 secure :-1 s=THROTTLE_DONE pgs=557 cs=0 l=1 rx=0x7f481c0032f0 tx=0x7f481c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:40.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.133+0000 7f4813fff700 1 -- 172.21.15.63:0/3810641639 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f481c013e80 con 0x7f48241430e0 2020-05-18T21:28:40.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.133+0000 7f4829c0f700 1 --2- 172.21.15.63:0/3810641639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48241430e0 0x7f482409c360 secure :-1 s=THROTTLE_DONE pgs=557 cs=0 l=1 rx=0x7f481c0032f0 tx=0x7f481c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:40.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.133+0000 7f4813fff700 1 -- 172.21.15.63:0/3810641639 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481c00c370 con 0x7f48241430e0 2020-05-18T21:28:40.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.133+0000 7f4829c0f700 1 --2- 172.21.15.63:0/3810641639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48241430e0 0x7f482409c360 secure :-1 s=THROTTLE_DONE pgs=557 cs=0 l=1 rx=0x7f481c0032f0 tx=0x7f481c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:40.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.137+0000 7f4813fff700 1 -- 172.21.15.63:0/3810641639 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f481c00c790 con 0x7f48241430e0 2020-05-18T21:28:40.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.137+0000 7f482a410700 1 -- 172.21.15.63:0/3810641639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48241430e0 msgr2=0x7f482409c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:40.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.137+0000 7f482a410700 1 --2- 172.21.15.63:0/3810641639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48241430e0 0x7f482409c360 secure :-1 s=READY pgs=557 cs=0 l=1 rx=0x7f481c0032f0 tx=0x7f481c007e00).stop 2020-05-18T21:28:40.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.137+0000 7f482a410700 1 -- 172.21.15.63:0/3810641639 shutdown_connections 2020-05-18T21:28:40.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.137+0000 7f482a410700 1 --2- 172.21.15.63:0/3810641639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48241430e0 0x7f482409c360 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:40.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.137+0000 7f482a410700 1 --2- 172.21.15.63:0/3810641639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f482409e6c0 0x7f48240b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:40.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.137+0000 7f482a410700 1 -- 172.21.15.63:0/3810641639 >> 172.21.15.63:0/3810641639 conn(0x7f48240b9630 msgr2=0x7f48240b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:40.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.137+0000 7f482a410700 1 -- 172.21.15.63:0/3810641639 shutdown_connections 2020-05-18T21:28:40.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.137+0000 7f482a410700 1 -- 172.21.15.63:0/3810641639 wait complete. 2020-05-18T21:28:40.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.137+0000 7f482a410700 1 Processor -- start 2020-05-18T21:28:40.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.137+0000 7f482a410700 1 -- start start 2020-05-18T21:28:40.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f482a410700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f482409e6c0 0x7f4824153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:40.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f482a410700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48241539d0 con 0x7f48240b51c0 2020-05-18T21:28:40.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f482a410700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4824153c70 con 0x7f48241430e0 2020-05-18T21:28:40.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f482a410700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4824153f10 con 0x7f482409e6c0 2020-05-18T21:28:40.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f4828c0d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f48240b51c0 0x7f48240653d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57556/0 (socket says 172.21.15.63:57556) 2020-05-18T21:28:40.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f4828c0d700 1 -- 172.21.15.63:0/2302799689 learned_addr learned my addr 172.21.15.63:0/2302799689 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:40.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f482940e700 1 --2- 172.21.15.63:0/2302799689 >> v2:172.21.15.155:3300/0 conn(0x7f482409e6c0 0x7f4824153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:40.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f48127fc700 1 -- 172.21.15.63:0/2302799689 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145046768 0 0) 0x7f48241539d0 con 0x7f48240b51c0 2020-05-18T21:28:40.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f48127fc700 1 -- 172.21.15.63:0/2302799689 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4804002fe0 con 0x7f48240b51c0 2020-05-18T21:28:40.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f48127fc700 1 -- 172.21.15.63:0/2302799689 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506206734 0 0) 0x7f4824153c70 con 0x7f48241430e0 2020-05-18T21:28:40.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f482940e700 1 -- 172.21.15.63:0/2302799689 >> v1:172.21.15.155:6789/0 conn(0x7f48241430e0 legacy=0x7f4824090a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:40.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f482940e700 1 -- 172.21.15.63:0/2302799689 >> v1:172.21.15.63:6789/0 conn(0x7f48240b51c0 legacy=0x7f48240653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:40.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f482940e700 1 -- 172.21.15.63:0/2302799689 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4824065ae0 con 0x7f482409e6c0 2020-05-18T21:28:40.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f482940e700 1 --2- 172.21.15.63:0/2302799689 >> v2:172.21.15.155:3300/0 conn(0x7f482409e6c0 0x7f4824153460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4814001b40 tx=0x7f4820010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:40.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f482940e700 1 --2- 172.21.15.63:0/2302799689 >> v2:172.21.15.155:3300/0 conn(0x7f482409e6c0 0x7f4824153460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4814001b40 tx=0x7f4820010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:40.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f482940e700 1 --2- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f482409e6c0 0x7f4824153460 secure :-1 s=READY pgs=398 cs=0 l=1 rx=0x7f4814001b40 tx=0x7f4820010be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:40.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f482940e700 1 --2- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f482409e6c0 0x7f4824153460 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f4814001b40 tx=0x7f4820010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:40.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f48127fc700 1 -- 172.21.15.63:0/2302799689 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48140019a0 con 0x7f482409e6c0 2020-05-18T21:28:40.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f482940e700 1 --2- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f482409e6c0 0x7f4824153460 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f4814001b40 tx=0x7f4820010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:40.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f482940e700 1 --2- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f482409e6c0 0x7f4824153460 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f4814001b40 tx=0x7f4820010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:40.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f482a410700 1 -- 172.21.15.63:0/2302799689 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48240b2770 con 0x7f482409e6c0 2020-05-18T21:28:40.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f48127fc700 1 -- 172.21.15.63:0/2302799689 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4820013070 con 0x7f482409e6c0 2020-05-18T21:28:40.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f48127fc700 1 -- 172.21.15.63:0/2302799689 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4820007550 con 0x7f482409e6c0 2020-05-18T21:28:40.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f482a410700 1 -- 172.21.15.63:0/2302799689 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4824156c30 con 0x7f482409e6c0 2020-05-18T21:28:40.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f482940e700 1 --2- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f482409e6c0 0x7f4824153460 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f4814001b40 tx=0x7f4820010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:40.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.141+0000 7f482a410700 1 -- 172.21.15.63:0/2302799689 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48240569e0 con 0x7f482409e6c0 2020-05-18T21:28:40.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.145+0000 7f48127fc700 1 -- 172.21.15.63:0/2302799689 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4820005700 con 0x7f482409e6c0 2020-05-18T21:28:40.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.145+0000 7f482940e700 1 --2- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f482409e6c0 0x7f4824153460 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f4814001b40 tx=0x7f4820010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:40.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.145+0000 7f48127fc700 1 --2- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f480404fca0 0x7f4804052160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:40.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.145+0000 7f48127fc700 1 -- 172.21.15.63:0/2302799689 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4820063700 con 0x7f482409e6c0 2020-05-18T21:28:40.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.145+0000 7f4828c0d700 1 --2- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f480404fca0 0x7f4804052160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:40.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.145+0000 7f4828c0d700 1 --2- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f480404fca0 0x7f4804052160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f48140011a0 tx=0x7f4814009660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:40.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.145+0000 7f4828c0d700 1 --2- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f480404fca0 0x7f4804052160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f48140011a0 tx=0x7f4814009660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:40.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.145+0000 7f4828c0d700 1 --2- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f480404fca0 0x7f4804052160 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7f48140011a0 tx=0x7f4814009660).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:40.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.149+0000 7f482940e700 1 --2- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f482409e6c0 0x7f4824153460 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f4814001b40 tx=0x7f4820010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:40.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.149+0000 7f48127fc700 1 -- 172.21.15.63:0/2302799689 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f482003da30 con 0x7f482409e6c0 2020-05-18T21:28:40.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:40.305+0000 7f482a410700 1 -- 172.21.15.63:0/2302799689 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4824065c70 con 0x7f482409e6c0 2020-05-18T21:28:41.139 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:28:41.133+0000 7fdb4592c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:28:41.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.141+0000 7f482940e700 1 --2- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f482409e6c0 0x7f4824153460 secure :-1 s=READY pgs=398 cs=0 l=1 rx=0x7f4814001b40 tx=0x7f4820010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.149+0000 7f482940e700 1 --2- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f482409e6c0 0x7f4824153460 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f4814001b40 tx=0x7f4820010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.149+0000 7f48127fc700 1 -- 172.21.15.63:0/2302799689 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4820041050 con 0x7f482409e6c0 2020-05-18T21:28:41.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.149+0000 7f482a410700 1 -- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f480404fca0 msgr2=0x7f4804052160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:41.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.149+0000 7f482a410700 1 --2- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f480404fca0 0x7f4804052160 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7f48140011a0 tx=0x7f4814009660).stop 2020-05-18T21:28:41.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.149+0000 7f482a410700 1 -- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f482409e6c0 msgr2=0x7f4824153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:41.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.149+0000 7f482a410700 1 --2- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f482409e6c0 0x7f4824153460 secure :-1 s=READY pgs=398 cs=0 l=1 rx=0x7f4814001b40 tx=0x7f4820010be0).stop 2020-05-18T21:28:41.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.149+0000 7f482a410700 1 -- 172.21.15.63:0/2302799689 shutdown_connections 2020-05-18T21:28:41.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.149+0000 7f482a410700 1 --2- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f480404fca0 0x7f4804052160 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:41.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.149+0000 7f482a410700 1 --2- 172.21.15.63:0/2302799689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f482409e6c0 0x7f4824153460 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:41.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.149+0000 7f482a410700 1 -- 172.21.15.63:0/2302799689 >> 172.21.15.63:0/2302799689 conn(0x7f48240b9630 msgr2=0x7f48241427d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:41.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.149+0000 7f482a410700 1 -- 172.21.15.63:0/2302799689 shutdown_connections 2020-05-18T21:28:41.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.149+0000 7f482a410700 1 -- 172.21.15.63:0/2302799689 wait complete. 2020-05-18T21:28:41.160 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-05-18T21:28:41.172 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:28:41.191 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:28:41.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.265+0000 7fe02756d700 1 Processor -- start 2020-05-18T21:28:41.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe02756d700 1 -- start start 2020-05-18T21:28:41.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe02756d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe02009bd20 0x7fe02009d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:41.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe02756d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0201461c0 con 0x7fe020145d10 2020-05-18T21:28:41.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe02756d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe02009c1c0 con 0x7fe020098fb0 2020-05-18T21:28:41.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe02756d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02009c460 con 0x7fe02009bd20 2020-05-18T21:28:41.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe026d6c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe020145d10 0x7fe02014f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57578/0 (socket says 172.21.15.63:57578) 2020-05-18T21:28:41.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe026d6c700 1 -- 172.21.15.63:0/2118159728 learned_addr learned my addr 172.21.15.63:0/2118159728 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:41.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe025d6a700 1 --2- 172.21.15.63:0/2118159728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe02009bd20 0x7fe02009d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:41.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe025569700 1 -- 172.21.15.63:0/2118159728 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460781788 0 0) 0x7fe0201461c0 con 0x7fe020145d10 2020-05-18T21:28:41.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe025569700 1 -- 172.21.15.63:0/2118159728 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe00c003270 con 0x7fe020145d10 2020-05-18T21:28:41.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe025569700 1 -- 172.21.15.63:0/2118159728 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1063584015 0 0) 0x7fe02009c1c0 con 0x7fe020098fb0 2020-05-18T21:28:41.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe025569700 1 -- 172.21.15.63:0/2118159728 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0201461c0 con 0x7fe020098fb0 2020-05-18T21:28:41.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe025d6a700 1 -- 172.21.15.63:0/2118159728 >> v1:172.21.15.155:6789/0 conn(0x7fe020098fb0 legacy=0x7fe020065520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:41.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe025d6a700 1 -- 172.21.15.63:0/2118159728 >> v1:172.21.15.63:6789/0 conn(0x7fe020145d10 legacy=0x7fe02014f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:41.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe025d6a700 1 -- 172.21.15.63:0/2118159728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02009c700 con 0x7fe02009bd20 2020-05-18T21:28:41.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe025d6a700 1 --2- 172.21.15.63:0/2118159728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe02009bd20 0x7fe02009d910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe014002f70 tx=0x7fe014008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe025d6a700 1 --2- 172.21.15.63:0/2118159728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe02009bd20 0x7fe02009d910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe014002f70 tx=0x7fe014008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe025d6a700 1 --2- 172.21.15.63:0/2118159728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe02009bd20 0x7fe02009d910 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7fe014002f70 tx=0x7fe014008920).ready entity=mon.2 client_cookie=6e8da77271a5423 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:41.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe025d6a700 1 --2- 172.21.15.63:0/2118159728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe02009bd20 0x7fe02009d910 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fe014002f70 tx=0x7fe014008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe025569700 1 -- 172.21.15.63:0/2118159728 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe014008e80 con 0x7fe02009bd20 2020-05-18T21:28:41.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe025d6a700 1 --2- 172.21.15.63:0/2118159728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe02009bd20 0x7fe02009d910 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fe014002f70 tx=0x7fe014008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe025d6a700 1 --2- 172.21.15.63:0/2118159728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe02009bd20 0x7fe02009d910 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fe014002f70 tx=0x7fe014008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe025569700 1 -- 172.21.15.63:0/2118159728 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe014011580 con 0x7fe02009bd20 2020-05-18T21:28:41.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe025569700 1 -- 172.21.15.63:0/2118159728 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe014011960 con 0x7fe02009bd20 2020-05-18T21:28:41.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe02756d700 1 -- 172.21.15.63:0/2118159728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe02009bd20 msgr2=0x7fe02009d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:41.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe02756d700 1 --2- 172.21.15.63:0/2118159728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe02009bd20 0x7fe02009d910 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7fe014002f70 tx=0x7fe014008920).stop 2020-05-18T21:28:41.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe02756d700 1 -- 172.21.15.63:0/2118159728 shutdown_connections 2020-05-18T21:28:41.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe02756d700 1 --2- 172.21.15.63:0/2118159728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe02009bd20 0x7fe02009d910 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:41.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe02756d700 1 -- 172.21.15.63:0/2118159728 >> 172.21.15.63:0/2118159728 conn(0x7fe02005f630 msgr2=0x7fe02005a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:41.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe02756d700 1 -- 172.21.15.63:0/2118159728 shutdown_connections 2020-05-18T21:28:41.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.269+0000 7fe02756d700 1 -- 172.21.15.63:0/2118159728 wait complete. 2020-05-18T21:28:41.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.273+0000 7fe02756d700 1 Processor -- start 2020-05-18T21:28:41.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.273+0000 7fe02756d700 1 -- start start 2020-05-18T21:28:41.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.273+0000 7fe02756d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe020098fb0 0x7fe0200b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:41.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.273+0000 7fe02756d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0200ae3c0 con 0x7fe02009bd20 2020-05-18T21:28:41.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.273+0000 7fe02756d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0200b79e0 con 0x7fe020145d10 2020-05-18T21:28:41.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.273+0000 7fe02756d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe020157630 con 0x7fe020098fb0 2020-05-18T21:28:41.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.273+0000 7fe025d6a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe02009bd20 0x7fe0200b2690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57582/0 (socket says 172.21.15.63:57582) 2020-05-18T21:28:41.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.273+0000 7fe025d6a700 1 -- 172.21.15.63:0/2630180641 learned_addr learned my addr 172.21.15.63:0/2630180641 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:41.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.273+0000 7fe02656b700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe020098fb0 0x7fe0200b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:41.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.273+0000 7fe01f7fe700 1 -- 172.21.15.63:0/2630180641 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972698003 0 0) 0x7fe0200ae3c0 con 0x7fe02009bd20 2020-05-18T21:28:41.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.273+0000 7fe01f7fe700 1 -- 172.21.15.63:0/2630180641 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe000002fe0 con 0x7fe02009bd20 2020-05-18T21:28:41.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.273+0000 7fe01f7fe700 1 -- 172.21.15.63:0/2630180641 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1664493444 0 0) 0x7fe0200b79e0 con 0x7fe020145d10 2020-05-18T21:28:41.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.273+0000 7fe01f7fe700 1 -- 172.21.15.63:0/2630180641 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0200ae3c0 con 0x7fe020145d10 2020-05-18T21:28:41.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.273+0000 7fe01f7fe700 1 -- 172.21.15.63:0/2630180641 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 746674246 0 0) 0x7fe000002fe0 con 0x7fe02009bd20 2020-05-18T21:28:41.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.273+0000 7fe01f7fe700 1 -- 172.21.15.63:0/2630180641 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe0200b79e0 con 0x7fe02009bd20 2020-05-18T21:28:41.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.273+0000 7fe01f7fe700 1 -- 172.21.15.63:0/2630180641 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fe014008e80 con 0x7fe02009bd20 2020-05-18T21:28:41.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.273+0000 7fe02656b700 1 -- 172.21.15.63:0/2630180641 >> v1:172.21.15.155:6789/0 conn(0x7fe020145d10 legacy=0x7fe020156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:41.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.273+0000 7fe02656b700 1 -- 172.21.15.63:0/2630180641 >> v1:172.21.15.63:6789/0 conn(0x7fe02009bd20 legacy=0x7fe0200b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:41.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.273+0000 7fe02656b700 1 -- 172.21.15.63:0/2630180641 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0200b3040 con 0x7fe020098fb0 2020-05-18T21:28:41.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.277+0000 7fe02656b700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe020098fb0 0x7fe0200b07f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe010001110 tx=0x7fe010010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.277+0000 7fe02656b700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe020098fb0 0x7fe0200b07f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe010001110 tx=0x7fe010010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.277+0000 7fe02656b700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe020098fb0 0x7fe0200b07f0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fe010001110 tx=0x7fe010010910).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:41.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.277+0000 7fe02656b700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe020098fb0 0x7fe0200b07f0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fe010001110 tx=0x7fe010010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.277+0000 7fe01f7fe700 1 -- 172.21.15.63:0/2630180641 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0100069f0 con 0x7fe020098fb0 2020-05-18T21:28:41.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.277+0000 7fe02656b700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe020098fb0 0x7fe0200b07f0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fe010001110 tx=0x7fe010010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.277+0000 7fe02656b700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe020098fb0 0x7fe0200b07f0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fe010001110 tx=0x7fe010010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.277+0000 7fe01f7fe700 1 -- 172.21.15.63:0/2630180641 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe010006b50 con 0x7fe020098fb0 2020-05-18T21:28:41.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.277+0000 7fe02756d700 1 -- 172.21.15.63:0/2630180641 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0200b7c10 con 0x7fe020098fb0 2020-05-18T21:28:41.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.277+0000 7fe01f7fe700 1 -- 172.21.15.63:0/2630180641 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe010008180 con 0x7fe020098fb0 2020-05-18T21:28:41.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.277+0000 7fe02756d700 1 -- 172.21.15.63:0/2630180641 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe020156e90 con 0x7fe020098fb0 2020-05-18T21:28:41.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.277+0000 7fe02656b700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe020098fb0 0x7fe0200b07f0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fe010001110 tx=0x7fe010010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.277+0000 7fe02756d700 1 -- 172.21.15.63:0/2630180641 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0200569e0 con 0x7fe020098fb0 2020-05-18T21:28:41.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.277+0000 7fe01f7fe700 1 -- 172.21.15.63:0/2630180641 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe0100083f0 con 0x7fe020098fb0 2020-05-18T21:28:41.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.277+0000 7fe02656b700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe020098fb0 0x7fe0200b07f0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fe010001110 tx=0x7fe010010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.277+0000 7fe01f7fe700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe000050130 0x7fe0000525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:41.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.281+0000 7fe01f7fe700 1 -- 172.21.15.63:0/2630180641 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe0100639c0 con 0x7fe020098fb0 2020-05-18T21:28:41.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.281+0000 7fe025d6a700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe000050130 0x7fe0000525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:41.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.281+0000 7fe025d6a700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe000050130 0x7fe0000525f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe014010120 tx=0x7fe020146ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.281+0000 7fe025d6a700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe000050130 0x7fe0000525f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe014010120 tx=0x7fe020146ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.281+0000 7fe025d6a700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe000050130 0x7fe0000525f0 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7fe014010120 tx=0x7fe020146ea0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:41.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.289+0000 7fe02656b700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe020098fb0 0x7fe0200b07f0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fe010001110 tx=0x7fe010010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.289+0000 7fe01f7fe700 1 -- 172.21.15.63:0/2630180641 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe01003dcf0 con 0x7fe020098fb0 2020-05-18T21:28:41.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.437+0000 7fe02756d700 1 -- 172.21.15.63:0/2630180641 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0200671b0 con 0x7fe020098fb0 2020-05-18T21:28:41.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.441+0000 7fe02656b700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe020098fb0 0x7fe0200b07f0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fe010001110 tx=0x7fe010010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.441+0000 7fe01f7fe700 1 -- 172.21.15.63:0/2630180641 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+1777 (secure 0 0 0) 0x7fe010041310 con 0x7fe020098fb0 2020-05-18T21:28:41.446 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:41.446 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/593103128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":593103128},{"type":"v1","addr":"172.21.15.155:6835","nonce":593103128}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:28:08.611856+0000","modified":"2020-05-18T21:28:41.137911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-05-18T21:28:41.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.441+0000 7fe02756d700 1 -- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe000050130 msgr2=0x7fe0000525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:41.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.441+0000 7fe02756d700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe000050130 0x7fe0000525f0 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7fe014010120 tx=0x7fe020146ea0).stop 2020-05-18T21:28:41.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.441+0000 7fe02756d700 1 -- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe020098fb0 msgr2=0x7fe0200b07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:41.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.441+0000 7fe02756d700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe020098fb0 0x7fe0200b07f0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fe010001110 tx=0x7fe010010910).stop 2020-05-18T21:28:41.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.441+0000 7fe02756d700 1 -- 172.21.15.63:0/2630180641 shutdown_connections 2020-05-18T21:28:41.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.441+0000 7fe02756d700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe000050130 0x7fe0000525f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:41.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.441+0000 7fe02756d700 1 --2- 172.21.15.63:0/2630180641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe020098fb0 0x7fe0200b07f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:41.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.441+0000 7fe02756d700 1 -- 172.21.15.63:0/2630180641 >> 172.21.15.63:0/2630180641 conn(0x7fe02005f630 msgr2=0x7fe02009d840 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:41.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.441+0000 7fe02756d700 1 -- 172.21.15.63:0/2630180641 shutdown_connections 2020-05-18T21:28:41.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.441+0000 7fe02756d700 1 -- 172.21.15.63:0/2630180641 wait complete. 2020-05-18T21:28:41.453 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 18 2020-05-18T21:28:41.465 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-05-18T21:28:41.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.569+0000 7fa9d1d16700 1 Processor -- start 2020-05-18T21:28:41.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.569+0000 7fa9d1d16700 1 -- start start 2020-05-18T21:28:41.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1d16700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa9cc0610b0 0x7fa9cc0b7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:41.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1d16700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa9cc145da0 0x7fa9cc1461f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:41.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1d16700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9cc060430 con 0x7fa9cc0b93f0 2020-05-18T21:28:41.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1d16700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9cc0606d0 con 0x7fa9cc145da0 2020-05-18T21:28:41.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1d16700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9cc060970 con 0x7fa9cc0610b0 2020-05-18T21:28:41.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1515700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa9cc145da0 0x7fa9cc1461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:41.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1515700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa9cc145da0 0x7fa9cc1461f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55404/0 (socket says 172.21.15.63:55404) 2020-05-18T21:28:41.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1515700 1 -- 172.21.15.63:0/3182793144 learned_addr learned my addr 172.21.15.63:0/3182793144 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:41.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9cbfff700 1 --2- 172.21.15.63:0/3182793144 >> v2:172.21.15.155:3300/0 conn(0x7fa9cc0610b0 0x7fa9cc0b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:41.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1515700 1 -- 172.21.15.63:0/3182793144 >> v2:172.21.15.155:3300/0 conn(0x7fa9cc0610b0 msgr2=0x7fa9cc0b7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:41.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1515700 1 --2- 172.21.15.63:0/3182793144 >> v2:172.21.15.155:3300/0 conn(0x7fa9cc0610b0 0x7fa9cc0b7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:41.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1515700 1 -- 172.21.15.63:0/3182793144 >> v1:172.21.15.155:6789/0 conn(0x7fa9cc0b93f0 legacy=0x7fa9cc0b7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:41.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1515700 1 -- 172.21.15.63:0/3182793144 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc060c10 con 0x7fa9cc145da0 2020-05-18T21:28:41.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1515700 1 --2- 172.21.15.63:0/3182793144 >> v2:172.21.15.63:3300/0 conn(0x7fa9cc145da0 0x7fa9cc1461f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa9c4002f70 tx=0x7fa9c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1515700 1 --2- 172.21.15.63:0/3182793144 >> v2:172.21.15.63:3300/0 conn(0x7fa9cc145da0 0x7fa9cc1461f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa9c4002f70 tx=0x7fa9c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1515700 1 --2- 172.21.15.63:0/3182793144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc145da0 0x7fa9cc1461f0 secure :-1 s=READY pgs=563 cs=0 l=1 rx=0x7fa9c4002f70 tx=0x7fa9c4007a80).ready entity=mon.0 client_cookie=2c1b224ea267087 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:41.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1515700 1 --2- 172.21.15.63:0/3182793144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc145da0 0x7fa9cc1461f0 secure :-1 s=THROTTLE_DONE pgs=563 cs=0 l=1 rx=0x7fa9c4002f70 tx=0x7fa9c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9cb7fe700 1 -- 172.21.15.63:0/3182793144 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c40116b0 con 0x7fa9cc145da0 2020-05-18T21:28:41.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1515700 1 --2- 172.21.15.63:0/3182793144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc145da0 0x7fa9cc1461f0 secure :-1 s=THROTTLE_DONE pgs=563 cs=0 l=1 rx=0x7fa9c4002f70 tx=0x7fa9c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9cb7fe700 1 -- 172.21.15.63:0/3182793144 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c4011810 con 0x7fa9cc145da0 2020-05-18T21:28:41.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1515700 1 --2- 172.21.15.63:0/3182793144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc145da0 0x7fa9cc1461f0 secure :-1 s=THROTTLE_DONE pgs=563 cs=0 l=1 rx=0x7fa9c4002f70 tx=0x7fa9c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9cb7fe700 1 -- 172.21.15.63:0/3182793144 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c4011c30 con 0x7fa9cc145da0 2020-05-18T21:28:41.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1d16700 1 -- 172.21.15.63:0/3182793144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc145da0 msgr2=0x7fa9cc1461f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:41.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1d16700 1 --2- 172.21.15.63:0/3182793144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc145da0 0x7fa9cc1461f0 secure :-1 s=READY pgs=563 cs=0 l=1 rx=0x7fa9c4002f70 tx=0x7fa9c4007a80).stop 2020-05-18T21:28:41.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1d16700 1 -- 172.21.15.63:0/3182793144 shutdown_connections 2020-05-18T21:28:41.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1d16700 1 --2- 172.21.15.63:0/3182793144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc145da0 0x7fa9cc1461f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:41.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1d16700 1 --2- 172.21.15.63:0/3182793144 >> v2:172.21.15.155:3300/0 conn(0x7fa9cc0610b0 0x7fa9cc0b7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:41.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1d16700 1 -- 172.21.15.63:0/3182793144 >> 172.21.15.63:0/3182793144 conn(0x7fa9cc069b70 msgr2=0x7fa9cc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:41.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1d16700 1 -- 172.21.15.63:0/3182793144 shutdown_connections 2020-05-18T21:28:41.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.573+0000 7fa9d1d16700 1 -- 172.21.15.63:0/3182793144 wait complete. 2020-05-18T21:28:41.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9d1d16700 1 Processor -- start 2020-05-18T21:28:41.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9d1d16700 1 -- start start 2020-05-18T21:28:41.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9d1d16700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9cc0610b0 0x7fa9cc142fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:41.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9d1d16700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa9cc0b93f0 0x7fa9cc13c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:41.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9d1d16700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa9cc145da0 0x7fa9cc141190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:41.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9d1d16700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9cc13ca90 con 0x7fa9cc0b93f0 2020-05-18T21:28:41.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9d1d16700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9cc1407b0 con 0x7fa9cc145da0 2020-05-18T21:28:41.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9d1d16700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc140a50 con 0x7fa9cc0610b0 2020-05-18T21:28:41.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9cbfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa9cc0b93f0 0x7fa9cc13c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:41.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9cbfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa9cc0b93f0 0x7fa9cc13c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55408/0 (socket says 172.21.15.63:55408) 2020-05-18T21:28:41.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9cbfff700 1 -- 172.21.15.63:0/3737919161 learned_addr learned my addr 172.21.15.63:0/3737919161 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:41.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9d0d14700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9cc0610b0 0x7fa9cc142fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:41.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9d1515700 1 --2- 172.21.15.63:0/3737919161 >> v2:172.21.15.155:3300/0 conn(0x7fa9cc145da0 0x7fa9cc141190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:41.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9cbfff700 1 -- 172.21.15.63:0/3737919161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9cc0610b0 msgr2=0x7fa9cc142fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:41.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9cbfff700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9cc0610b0 0x7fa9cc142fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:41.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9cbfff700 1 -- 172.21.15.63:0/3737919161 >> v2:172.21.15.155:3300/0 conn(0x7fa9cc145da0 msgr2=0x7fa9cc141190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:41.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9cbfff700 1 --2- 172.21.15.63:0/3737919161 >> v2:172.21.15.155:3300/0 conn(0x7fa9cc145da0 0x7fa9cc141190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:41.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9cbfff700 1 -- 172.21.15.63:0/3737919161 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc140cf0 con 0x7fa9cc0b93f0 2020-05-18T21:28:41.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9cbfff700 1 --2- 172.21.15.63:0/3737919161 >> v2:172.21.15.63:3300/0 conn(0x7fa9cc0b93f0 0x7fa9cc13c5a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa9c00030b0 tx=0x7fa9c0010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9cbfff700 1 --2- 172.21.15.63:0/3737919161 >> v2:172.21.15.63:3300/0 conn(0x7fa9cc0b93f0 0x7fa9cc13c5a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa9c00030b0 tx=0x7fa9c0010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.577+0000 7fa9cbfff700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0b93f0 0x7fa9cc13c5a0 secure :-1 s=READY pgs=564 cs=0 l=1 rx=0x7fa9c00030b0 tx=0x7fa9c0010d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:41.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.581+0000 7fa9cbfff700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0b93f0 0x7fa9cc13c5a0 secure :-1 s=THROTTLE_DONE pgs=564 cs=0 l=1 rx=0x7fa9c00030b0 tx=0x7fa9c0010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.581+0000 7fa9c9ffb700 1 -- 172.21.15.63:0/3737919161 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c0007180 con 0x7fa9cc0b93f0 2020-05-18T21:28:41.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.581+0000 7fa9cbfff700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0b93f0 0x7fa9cc13c5a0 secure :-1 s=THROTTLE_DONE pgs=564 cs=0 l=1 rx=0x7fa9c00030b0 tx=0x7fa9c0010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.581+0000 7fa9d1d16700 1 -- 172.21.15.63:0/3737919161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9cc140430 con 0x7fa9cc0b93f0 2020-05-18T21:28:41.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.581+0000 7fa9cbfff700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0b93f0 0x7fa9cc13c5a0 secure :-1 s=THROTTLE_DONE pgs=564 cs=0 l=1 rx=0x7fa9c00030b0 tx=0x7fa9c0010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.581+0000 7fa9c9ffb700 1 -- 172.21.15.63:0/3737919161 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c00072e0 con 0x7fa9cc0b93f0 2020-05-18T21:28:41.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.581+0000 7fa9c9ffb700 1 -- 172.21.15.63:0/3737919161 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c0012280 con 0x7fa9cc0b93f0 2020-05-18T21:28:41.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.581+0000 7fa9d1d16700 1 -- 172.21.15.63:0/3737919161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9cc143f70 con 0x7fa9cc0b93f0 2020-05-18T21:28:41.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.581+0000 7fa9cbfff700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0b93f0 0x7fa9cc13c5a0 secure :-1 s=THROTTLE_DONE pgs=564 cs=0 l=1 rx=0x7fa9c00030b0 tx=0x7fa9c0010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.581+0000 7fa9d1d16700 1 -- 172.21.15.63:0/3737919161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9cc0569e0 con 0x7fa9cc0b93f0 2020-05-18T21:28:41.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.581+0000 7fa9c9ffb700 1 -- 172.21.15.63:0/3737919161 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa9c0010190 con 0x7fa9cc0b93f0 2020-05-18T21:28:41.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.581+0000 7fa9cbfff700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0b93f0 0x7fa9cc13c5a0 secure :-1 s=THROTTLE_DONE pgs=564 cs=0 l=1 rx=0x7fa9c00030b0 tx=0x7fa9c0010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.581+0000 7fa9c9ffb700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa9ac04fa90 0x7fa9ac051f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:41.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.581+0000 7fa9c9ffb700 1 -- 172.21.15.63:0/3737919161 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa9c0063db0 con 0x7fa9cc0b93f0 2020-05-18T21:28:41.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.581+0000 7fa9d0d14700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa9ac04fa90 0x7fa9ac051f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:41.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.581+0000 7fa9d0d14700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa9ac04fa90 0x7fa9ac051f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa9cc05b950 tx=0x7fa9bc0041e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.581+0000 7fa9d0d14700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa9ac04fa90 0x7fa9ac051f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa9cc05b950 tx=0x7fa9bc0041e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.581+0000 7fa9d0d14700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa9ac04fa90 0x7fa9ac051f50 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7fa9cc05b950 tx=0x7fa9bc0041e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:41.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.589+0000 7fa9cbfff700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0b93f0 0x7fa9cc13c5a0 secure :-1 s=THROTTLE_DONE pgs=564 cs=0 l=1 rx=0x7fa9c00030b0 tx=0x7fa9c0010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:41.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.589+0000 7fa9c9ffb700 1 -- 172.21.15.63:0/3737919161 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa9c003e0e0 con 0x7fa9cc0b93f0 2020-05-18T21:28:41.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:41.737+0000 7fa9d1d16700 1 -- 172.21.15.63:0/3737919161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa9cc0ac6e0 con 0x7fa9cc0b93f0 2020-05-18T21:28:42.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.153+0000 7fa9cbfff700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0b93f0 0x7fa9cc13c5a0 secure :-1 s=THROTTLE_DONE pgs=564 cs=0 l=1 rx=0x7fa9c00030b0 tx=0x7fa9c0010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:42.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.153+0000 7fa9c9ffb700 1 -- 172.21.15.63:0/3737919161 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa9c0041700 con 0x7fa9cc0b93f0 2020-05-18T21:28:42.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.157+0000 7fa9d1d16700 1 -- 172.21.15.63:0/3737919161 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa9ac04fa90 msgr2=0x7fa9ac051f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:42.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.157+0000 7fa9d1d16700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa9ac04fa90 0x7fa9ac051f50 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7fa9cc05b950 tx=0x7fa9bc0041e0).stop 2020-05-18T21:28:42.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.157+0000 7fa9d1d16700 1 -- 172.21.15.63:0/3737919161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0b93f0 msgr2=0x7fa9cc13c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:42.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.157+0000 7fa9d1d16700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0b93f0 0x7fa9cc13c5a0 secure :-1 s=READY pgs=564 cs=0 l=1 rx=0x7fa9c00030b0 tx=0x7fa9c0010d10).stop 2020-05-18T21:28:42.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.157+0000 7fa9d1d16700 1 -- 172.21.15.63:0/3737919161 shutdown_connections 2020-05-18T21:28:42.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.157+0000 7fa9d1d16700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa9ac04fa90 0x7fa9ac051f50 secure :-1 s=CLOSED pgs=226 cs=0 l=1 rx=0x7fa9cc05b950 tx=0x7fa9bc0041e0).stop 2020-05-18T21:28:42.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.157+0000 7fa9d1d16700 1 --2- 172.21.15.63:0/3737919161 >> v2:172.21.15.155:3300/0 conn(0x7fa9cc145da0 0x7fa9cc141190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:42.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.157+0000 7fa9d1d16700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0b93f0 0x7fa9cc13c5a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:42.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.157+0000 7fa9d1d16700 1 --2- 172.21.15.63:0/3737919161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9cc0610b0 0x7fa9cc142fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:42.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.157+0000 7fa9d1d16700 1 -- 172.21.15.63:0/3737919161 >> 172.21.15.63:0/3737919161 conn(0x7fa9cc069b70 msgr2=0x7fa9cc0bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:42.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.157+0000 7fa9d1d16700 1 -- 172.21.15.63:0/3737919161 shutdown_connections 2020-05-18T21:28:42.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.157+0000 7fa9d1d16700 1 -- 172.21.15.63:0/3737919161 wait complete. 2020-05-18T21:28:42.177 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-05-18T21:28:42.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.289+0000 7fa12c8f2700 1 Processor -- start 2020-05-18T21:28:42.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.289+0000 7fa12c8f2700 1 -- start start 2020-05-18T21:28:42.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa12c8f2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa1280b9810 0x7fa1281438a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:42.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa12c8f2700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1280b6110 con 0x7fa12809e750 2020-05-18T21:28:42.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa12c8f2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1280b63b0 con 0x7fa12813ff90 2020-05-18T21:28:42.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa12c8f2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1280b6f60 con 0x7fa1280b9810 2020-05-18T21:28:42.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa126ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa12809e750 0x7fa1280b6850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57606/0 (socket says 172.21.15.63:57606) 2020-05-18T21:28:42.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa126ffd700 1 -- 172.21.15.63:0/3327483598 learned_addr learned my addr 172.21.15.63:0/3327483598 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:42.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa1277fe700 1 --2- 172.21.15.63:0/3327483598 >> v2:172.21.15.155:3300/0 conn(0x7fa1280b9810 0x7fa1281438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:42.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa1267fc700 1 -- 172.21.15.63:0/3327483598 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767006776 0 0) 0x7fa1280b6110 con 0x7fa12809e750 2020-05-18T21:28:42.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa1267fc700 1 -- 172.21.15.63:0/3327483598 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa114003270 con 0x7fa12809e750 2020-05-18T21:28:42.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa1277fe700 1 -- 172.21.15.63:0/3327483598 >> v1:172.21.15.155:6789/0 conn(0x7fa12813ff90 legacy=0x7fa1280b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:42.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa1277fe700 1 -- 172.21.15.63:0/3327483598 >> v1:172.21.15.63:6789/0 conn(0x7fa12809e750 legacy=0x7fa1280b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:42.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa1277fe700 1 -- 172.21.15.63:0/3327483598 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1280b9bf0 con 0x7fa1280b9810 2020-05-18T21:28:42.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa1277fe700 1 --2- 172.21.15.63:0/3327483598 >> v2:172.21.15.155:3300/0 conn(0x7fa1280b9810 0x7fa1281438a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa118002f70 tx=0x7fa118007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:42.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa1277fe700 1 --2- 172.21.15.63:0/3327483598 >> v2:172.21.15.155:3300/0 conn(0x7fa1280b9810 0x7fa1281438a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa118002f70 tx=0x7fa118007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:42.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa1277fe700 1 --2- 172.21.15.63:0/3327483598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1280b9810 0x7fa1281438a0 secure :-1 s=READY pgs=405 cs=0 l=1 rx=0x7fa118002f70 tx=0x7fa118007a80).ready entity=mon.1 client_cookie=31b2b4bd5025ed8e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:42.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa1277fe700 1 --2- 172.21.15.63:0/3327483598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1280b9810 0x7fa1281438a0 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7fa118002f70 tx=0x7fa118007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:42.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa1267fc700 1 -- 172.21.15.63:0/3327483598 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa118008e80 con 0x7fa1280b9810 2020-05-18T21:28:42.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa1277fe700 1 --2- 172.21.15.63:0/3327483598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1280b9810 0x7fa1281438a0 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7fa118002f70 tx=0x7fa118007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:42.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa1277fe700 1 --2- 172.21.15.63:0/3327483598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1280b9810 0x7fa1281438a0 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7fa118002f70 tx=0x7fa118007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:42.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa1267fc700 1 -- 172.21.15.63:0/3327483598 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1180115f0 con 0x7fa1280b9810 2020-05-18T21:28:42.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa1267fc700 1 -- 172.21.15.63:0/3327483598 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa118011990 con 0x7fa1280b9810 2020-05-18T21:28:42.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa12c8f2700 1 -- 172.21.15.63:0/3327483598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1280b9810 msgr2=0x7fa1281438a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:42.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa12c8f2700 1 --2- 172.21.15.63:0/3327483598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1280b9810 0x7fa1281438a0 secure :-1 s=READY pgs=405 cs=0 l=1 rx=0x7fa118002f70 tx=0x7fa118007a80).stop 2020-05-18T21:28:42.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa12c8f2700 1 -- 172.21.15.63:0/3327483598 shutdown_connections 2020-05-18T21:28:42.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa12c8f2700 1 --2- 172.21.15.63:0/3327483598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1280b9810 0x7fa1281438a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:42.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa12c8f2700 1 -- 172.21.15.63:0/3327483598 >> 172.21.15.63:0/3327483598 conn(0x7fa12805a7c0 msgr2=0x7fa12805aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:42.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa12c8f2700 1 -- 172.21.15.63:0/3327483598 shutdown_connections 2020-05-18T21:28:42.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.293+0000 7fa12c8f2700 1 -- 172.21.15.63:0/3327483598 wait complete. 2020-05-18T21:28:42.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.297+0000 7fa12c8f2700 1 Processor -- start 2020-05-18T21:28:42.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.297+0000 7fa12c8f2700 1 -- start start 2020-05-18T21:28:42.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.297+0000 7fa12c8f2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa1280b9810 0x7fa128141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:42.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.297+0000 7fa12c8f2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa12813ff90 0x7fa128145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:42.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.297+0000 7fa12c8f2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa128145b30 con 0x7fa12809e750 2020-05-18T21:28:42.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.297+0000 7fa12c8f2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa128145dd0 con 0x7fa1280b9810 2020-05-18T21:28:42.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.297+0000 7fa12c8f2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa128062fa0 con 0x7fa12813ff90 2020-05-18T21:28:42.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.297+0000 7fa126ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa1280b9810 0x7fa128141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:42.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.297+0000 7fa126ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa1280b9810 0x7fa128141800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:42040/0 (socket says 172.21.15.63:42040) 2020-05-18T21:28:42.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.297+0000 7fa1277fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fa12809e750 0x7fa1280b2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:55926/0 (socket says 172.21.15.63:55926) 2020-05-18T21:28:42.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.297+0000 7fa126ffd700 1 -- 172.21.15.63:0/307212864 learned_addr learned my addr 172.21.15.63:0/307212864 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:42.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.297+0000 7fa127fff700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa12813ff90 0x7fa128145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:42.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.297+0000 7fa126ffd700 1 -- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa12813ff90 msgr2=0x7fa128145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:42.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.297+0000 7fa126ffd700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa12813ff90 0x7fa128145500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:42.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.297+0000 7fa126ffd700 1 -- 172.21.15.63:0/307212864 >> v1:172.21.15.155:6789/0 conn(0x7fa12809e750 legacy=0x7fa1280b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:42.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.297+0000 7fa126ffd700 1 -- 172.21.15.63:0/307212864 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa128156b00 con 0x7fa1280b9810 2020-05-18T21:28:42.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.297+0000 7fa127fff700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa12813ff90 0x7fa128145500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:42.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.297+0000 7fa126ffd700 1 --2- 172.21.15.63:0/307212864 >> v2:172.21.15.155:3300/0 conn(0x7fa1280b9810 0x7fa128141800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa11c001110 tx=0x7fa11c010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:42.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.297+0000 7fa126ffd700 1 --2- 172.21.15.63:0/307212864 >> v2:172.21.15.155:3300/0 conn(0x7fa1280b9810 0x7fa128141800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa11c001110 tx=0x7fa11c010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:42.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.301+0000 7fa126ffd700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1280b9810 0x7fa128141800 secure :-1 s=READY pgs=407 cs=0 l=1 rx=0x7fa11c001110 tx=0x7fa11c010950).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:42.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.301+0000 7fa126ffd700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1280b9810 0x7fa128141800 secure :-1 s=THROTTLE_DONE pgs=407 cs=0 l=1 rx=0x7fa11c001110 tx=0x7fa11c010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:42.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.301+0000 7fa126ffd700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1280b9810 0x7fa128141800 secure :-1 s=THROTTLE_DONE pgs=407 cs=0 l=1 rx=0x7fa11c001110 tx=0x7fa11c010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:42.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.301+0000 7fa124ff9700 1 -- 172.21.15.63:0/307212864 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa11c005d00 con 0x7fa1280b9810 2020-05-18T21:28:42.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.301+0000 7fa126ffd700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1280b9810 0x7fa128141800 secure :-1 s=THROTTLE_DONE pgs=407 cs=0 l=1 rx=0x7fa11c001110 tx=0x7fa11c010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:42.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.301+0000 7fa124ff9700 1 -- 172.21.15.63:0/307212864 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c005e60 con 0x7fa1280b9810 2020-05-18T21:28:42.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.301+0000 7fa12c8f2700 1 -- 172.21.15.63:0/307212864 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa128156db0 con 0x7fa1280b9810 2020-05-18T21:28:42.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.301+0000 7fa124ff9700 1 -- 172.21.15.63:0/307212864 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa11c0062c0 con 0x7fa1280b9810 2020-05-18T21:28:42.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.301+0000 7fa12c8f2700 1 -- 172.21.15.63:0/307212864 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa128152be0 con 0x7fa1280b9810 2020-05-18T21:28:42.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.301+0000 7fa126ffd700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1280b9810 0x7fa128141800 secure :-1 s=THROTTLE_DONE pgs=407 cs=0 l=1 rx=0x7fa11c001110 tx=0x7fa11c010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:42.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.301+0000 7fa12c8f2700 1 -- 172.21.15.63:0/307212864 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa128145960 con 0x7fa1280b9810 2020-05-18T21:28:42.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.301+0000 7fa124ff9700 1 -- 172.21.15.63:0/307212864 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa11c0064f0 con 0x7fa1280b9810 2020-05-18T21:28:42.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.301+0000 7fa126ffd700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1280b9810 0x7fa128141800 secure :-1 s=THROTTLE_DONE pgs=407 cs=0 l=1 rx=0x7fa11c001110 tx=0x7fa11c010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:42.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.301+0000 7fa124ff9700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa10804f9f0 0x7fa108051eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:42.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.301+0000 7fa124ff9700 1 -- 172.21.15.63:0/307212864 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa11c0090c0 con 0x7fa1280b9810 2020-05-18T21:28:42.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.301+0000 7fa1277fe700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa10804f9f0 0x7fa108051eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:42.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.301+0000 7fa1277fe700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa10804f9f0 0x7fa108051eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa1280b3350 tx=0x7fa118007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:42.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.305+0000 7fa1277fe700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa10804f9f0 0x7fa108051eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa1280b3350 tx=0x7fa118007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:42.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.305+0000 7fa1277fe700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa10804f9f0 0x7fa108051eb0 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7fa1280b3350 tx=0x7fa118007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:42.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.313+0000 7fa126ffd700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1280b9810 0x7fa128141800 secure :-1 s=THROTTLE_DONE pgs=407 cs=0 l=1 rx=0x7fa11c001110 tx=0x7fa11c010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:42.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.313+0000 7fa124ff9700 1 -- 172.21.15.63:0/307212864 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa11c03e0c0 con 0x7fa1280b9810 2020-05-18T21:28:42.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:42.433+0000 7fa12c8f2700 1 -- 172.21.15.63:0/307212864 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa1280569e0 con 0x7fa1280b9810 2020-05-18T21:28:43.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.165+0000 7fa126ffd700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1280b9810 0x7fa128141800 secure :-1 s=THROTTLE_DONE pgs=407 cs=0 l=1 rx=0x7fa11c001110 tx=0x7fa11c010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:43.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.165+0000 7fa124ff9700 1 -- 172.21.15.63:0/307212864 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) v1 ==== 185+0+0 (secure 0 0 0) 0x7fa11c0416e0 con 0x7fa1280b9810 2020-05-18T21:28:43.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.169+0000 7fa12c8f2700 1 -- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa10804f9f0 msgr2=0x7fa108051eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:43.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.169+0000 7fa12c8f2700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa10804f9f0 0x7fa108051eb0 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7fa1280b3350 tx=0x7fa118007a80).stop 2020-05-18T21:28:43.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.169+0000 7fa12c8f2700 1 -- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1280b9810 msgr2=0x7fa128141800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:43.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.169+0000 7fa12c8f2700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1280b9810 0x7fa128141800 secure :-1 s=READY pgs=407 cs=0 l=1 rx=0x7fa11c001110 tx=0x7fa11c010950).stop 2020-05-18T21:28:43.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.169+0000 7fa12c8f2700 1 -- 172.21.15.63:0/307212864 shutdown_connections 2020-05-18T21:28:43.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.169+0000 7fa12c8f2700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa10804f9f0 0x7fa108051eb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:43.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.169+0000 7fa12c8f2700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa12813ff90 0x7fa128145500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:43.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.169+0000 7fa12c8f2700 1 --2- 172.21.15.63:0/307212864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1280b9810 0x7fa128141800 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:43.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.169+0000 7fa12c8f2700 1 -- 172.21.15.63:0/307212864 >> 172.21.15.63:0/307212864 conn(0x7fa12805a7c0 msgr2=0x7fa128061c10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:43.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.169+0000 7fa12c8f2700 1 -- 172.21.15.63:0/307212864 shutdown_connections 2020-05-18T21:28:43.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.169+0000 7fa12c8f2700 1 -- 172.21.15.63:0/307212864 wait complete. 2020-05-18T21:28:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2020-05-18T21:28:43.188 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-05-18T21:28:43.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.289+0000 7fd0721dc700 1 Processor -- start 2020-05-18T21:28:43.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.289+0000 7fd0721dc700 1 -- start start 2020-05-18T21:28:43.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd0721dc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd06c0b4e80 0x7fd06c0b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:43.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd0721dc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd06c0ae240 0x7fd06c1432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:43.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd0721dc700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06c064bd0 con 0x7fd06c0b5260 2020-05-18T21:28:43.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd0721dc700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06c0b56a0 con 0x7fd06c0ae240 2020-05-18T21:28:43.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd0721dc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c064e00 con 0x7fd06c0b4e80 2020-05-18T21:28:43.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd06c0ae240 0x7fd06c1432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:43.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06affd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd06c0b5260 0x7fd06c0adb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57620/0 (socket says 172.21.15.63:57620) 2020-05-18T21:28:43.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06affd700 1 -- 172.21.15.63:0/1181542590 learned_addr learned my addr 172.21.15.63:0/1181542590 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:43.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06b7fe700 1 --2- 172.21.15.63:0/1181542590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd06c0b4e80 0x7fd06c0b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:43.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06a7fc700 1 -- 172.21.15.63:0/1181542590 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424960639 0 0) 0x7fd06c064bd0 con 0x7fd06c0b5260 2020-05-18T21:28:43.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06a7fc700 1 -- 172.21.15.63:0/1181542590 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd058003270 con 0x7fd06c0b5260 2020-05-18T21:28:43.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06bfff700 1 -- 172.21.15.63:0/1181542590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd06c0b4e80 msgr2=0x7fd06c0b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:43.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06bfff700 1 --2- 172.21.15.63:0/1181542590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd06c0b4e80 0x7fd06c0b8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:43.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06bfff700 1 -- 172.21.15.63:0/1181542590 >> v1:172.21.15.63:6789/0 conn(0x7fd06c0b5260 legacy=0x7fd06c0adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:43.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06a7fc700 1 -- 172.21.15.63:0/1181542590 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1190963397 0 0) 0x7fd058003270 con 0x7fd06c0b5260 2020-05-18T21:28:43.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06bfff700 1 -- 172.21.15.63:0/1181542590 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c0ad3f0 con 0x7fd06c0ae240 2020-05-18T21:28:43.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06bfff700 1 --2- 172.21.15.63:0/1181542590 >> v2:172.21.15.63:3300/0 conn(0x7fd06c0ae240 0x7fd06c1432c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd05c0018b0 tx=0x7fd064007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:43.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06bfff700 1 --2- 172.21.15.63:0/1181542590 >> v2:172.21.15.63:3300/0 conn(0x7fd06c0ae240 0x7fd06c1432c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd05c0018b0 tx=0x7fd064007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:43.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06bfff700 1 --2- 172.21.15.63:0/1181542590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd06c0ae240 0x7fd06c1432c0 secure :-1 s=READY pgs=567 cs=0 l=1 rx=0x7fd05c0018b0 tx=0x7fd064007e00).ready entity=mon.0 client_cookie=eb55c17868ce59dd server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:43.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06bfff700 1 --2- 172.21.15.63:0/1181542590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd06c0ae240 0x7fd06c1432c0 secure :-1 s=THROTTLE_DONE pgs=567 cs=0 l=1 rx=0x7fd05c0018b0 tx=0x7fd064007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:43.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06a7fc700 1 -- 172.21.15.63:0/1181542590 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd05c001710 con 0x7fd06c0ae240 2020-05-18T21:28:43.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06bfff700 1 --2- 172.21.15.63:0/1181542590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd06c0ae240 0x7fd06c1432c0 secure :-1 s=THROTTLE_DONE pgs=567 cs=0 l=1 rx=0x7fd05c0018b0 tx=0x7fd064007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:43.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06bfff700 1 --2- 172.21.15.63:0/1181542590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd06c0ae240 0x7fd06c1432c0 secure :-1 s=THROTTLE_DONE pgs=567 cs=0 l=1 rx=0x7fd05c0018b0 tx=0x7fd064007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:43.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06a7fc700 1 -- 172.21.15.63:0/1181542590 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd064011ac0 con 0x7fd06c0ae240 2020-05-18T21:28:43.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd06a7fc700 1 -- 172.21.15.63:0/1181542590 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd064011e60 con 0x7fd06c0ae240 2020-05-18T21:28:43.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd0721dc700 1 -- 172.21.15.63:0/1181542590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd06c0ae240 msgr2=0x7fd06c1432c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:43.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd0721dc700 1 --2- 172.21.15.63:0/1181542590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd06c0ae240 0x7fd06c1432c0 secure :-1 s=READY pgs=567 cs=0 l=1 rx=0x7fd05c0018b0 tx=0x7fd064007e00).stop 2020-05-18T21:28:43.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd0721dc700 1 -- 172.21.15.63:0/1181542590 shutdown_connections 2020-05-18T21:28:43.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd0721dc700 1 --2- 172.21.15.63:0/1181542590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd06c0ae240 0x7fd06c1432c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:43.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd0721dc700 1 --2- 172.21.15.63:0/1181542590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd06c0b4e80 0x7fd06c0b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:43.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd0721dc700 1 -- 172.21.15.63:0/1181542590 >> 172.21.15.63:0/1181542590 conn(0x7fd06c0b83b0 msgr2=0x7fd06c0b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:43.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd0721dc700 1 -- 172.21.15.63:0/1181542590 shutdown_connections 2020-05-18T21:28:43.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.293+0000 7fd0721dc700 1 -- 172.21.15.63:0/1181542590 wait complete. 2020-05-18T21:28:43.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd0721dc700 1 Processor -- start 2020-05-18T21:28:43.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd0721dc700 1 -- start start 2020-05-18T21:28:43.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd0721dc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd06c0b4e80 0x7fd06c153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:43.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd0721dc700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06c1354a0 con 0x7fd06c0b5260 2020-05-18T21:28:43.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd0721dc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06c135700 con 0x7fd06c0ae240 2020-05-18T21:28:43.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd0721dc700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06c1535f0 con 0x7fd06c0b4e80 2020-05-18T21:28:43.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd06affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd06c0b4e80 0x7fd06c153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:43.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd06bfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd06c0b5260 0x7fd06c1420e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57626/0 (socket says 172.21.15.63:57626) 2020-05-18T21:28:43.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd06bfff700 1 -- 172.21.15.63:0/1869324626 learned_addr learned my addr 172.21.15.63:0/1869324626 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:43.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd06affd700 1 -- 172.21.15.63:0/1869324626 >> v1:172.21.15.155:6789/0 conn(0x7fd06c0ae240 legacy=0x7fd06c113380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:43.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd06affd700 1 -- 172.21.15.63:0/1869324626 >> v1:172.21.15.63:6789/0 conn(0x7fd06c0b5260 legacy=0x7fd06c1420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:43.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd068ff9700 1 -- 172.21.15.63:0/1869324626 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992995025 0 0) 0x7fd06c1354a0 con 0x7fd06c0b5260 2020-05-18T21:28:43.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd06affd700 1 -- 172.21.15.63:0/1869324626 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c1359a0 con 0x7fd06c0b4e80 2020-05-18T21:28:43.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd06affd700 1 --2- 172.21.15.63:0/1869324626 >> v2:172.21.15.63:3300/0 conn(0x7fd06c0b4e80 0x7fd06c153190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd06c112840 tx=0x7fd05c010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:43.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd06affd700 1 --2- 172.21.15.63:0/1869324626 >> v2:172.21.15.63:3300/0 conn(0x7fd06c0b4e80 0x7fd06c153190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd06c112840 tx=0x7fd05c010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:43.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd06affd700 1 --2- 172.21.15.63:0/1869324626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd06c0b4e80 0x7fd06c153190 secure :-1 s=READY pgs=569 cs=0 l=1 rx=0x7fd06c112840 tx=0x7fd05c010c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:43.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd06affd700 1 --2- 172.21.15.63:0/1869324626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd06c0b4e80 0x7fd06c153190 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fd06c112840 tx=0x7fd05c010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:43.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd068ff9700 1 -- 172.21.15.63:0/1869324626 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd05c00cc90 con 0x7fd06c0b4e80 2020-05-18T21:28:43.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd06affd700 1 --2- 172.21.15.63:0/1869324626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd06c0b4e80 0x7fd06c153190 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fd06c112840 tx=0x7fd05c010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:43.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd06affd700 1 --2- 172.21.15.63:0/1869324626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd06c0b4e80 0x7fd06c153190 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fd06c112840 tx=0x7fd05c010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:43.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd068ff9700 1 -- 172.21.15.63:0/1869324626 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c00cdf0 con 0x7fd06c0b4e80 2020-05-18T21:28:43.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd0721dc700 1 -- 172.21.15.63:0/1869324626 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06c113a90 con 0x7fd06c0b4e80 2020-05-18T21:28:43.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd068ff9700 1 -- 172.21.15.63:0/1869324626 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd05c004720 con 0x7fd06c0b4e80 2020-05-18T21:28:43.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.297+0000 7fd0721dc700 1 -- 172.21.15.63:0/1869324626 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06c062bf0 con 0x7fd06c0b4e80 2020-05-18T21:28:43.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.301+0000 7fd06affd700 1 --2- 172.21.15.63:0/1869324626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd06c0b4e80 0x7fd06c153190 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fd06c112840 tx=0x7fd05c010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:43.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.301+0000 7fd0721dc700 1 -- 172.21.15.63:0/1869324626 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd06c135b30 con 0x7fd06c0b4e80 2020-05-18T21:28:43.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.301+0000 7fd068ff9700 1 -- 172.21.15.63:0/1869324626 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd05c004990 con 0x7fd06c0b4e80 2020-05-18T21:28:43.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.301+0000 7fd06affd700 1 --2- 172.21.15.63:0/1869324626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd06c0b4e80 0x7fd06c153190 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fd06c112840 tx=0x7fd05c010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:43.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.301+0000 7fd068ff9700 1 --2- 172.21.15.63:0/1869324626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd04c04f880 0x7fd04c051d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:43.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.301+0000 7fd068ff9700 1 -- 172.21.15.63:0/1869324626 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fd05c063c50 con 0x7fd06c0b4e80 2020-05-18T21:28:43.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.301+0000 7fd06b7fe700 1 --2- 172.21.15.63:0/1869324626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd04c04f880 0x7fd04c051d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:43.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.301+0000 7fd06b7fe700 1 --2- 172.21.15.63:0/1869324626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd04c04f880 0x7fd04c051d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd060007960 tx=0x7fd06c05b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:43.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.301+0000 7fd06b7fe700 1 --2- 172.21.15.63:0/1869324626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd04c04f880 0x7fd04c051d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd060007960 tx=0x7fd06c05b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:43.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.301+0000 7fd06b7fe700 1 --2- 172.21.15.63:0/1869324626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd04c04f880 0x7fd04c051d40 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7fd060007960 tx=0x7fd06c05b560).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:43.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.305+0000 7fd06affd700 1 --2- 172.21.15.63:0/1869324626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd06c0b4e80 0x7fd06c153190 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fd06c112840 tx=0x7fd05c010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:43.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.305+0000 7fd068ff9700 1 -- 172.21.15.63:0/1869324626 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd05c03df80 con 0x7fd06c0b4e80 2020-05-18T21:28:43.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:43.421+0000 7fd0721dc700 1 -- 172.21.15.63:0/1869324626 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd06c0569e0 con 0x7fd06c0b4e80 2020-05-18T21:28:44.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.173+0000 7fd06affd700 1 --2- 172.21.15.63:0/1869324626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd06c0b4e80 0x7fd06c153190 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fd06c112840 tx=0x7fd05c010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:44.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.173+0000 7fd068ff9700 1 -- 172.21.15.63:0/1869324626 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd05c0415a0 con 0x7fd06c0b4e80 2020-05-18T21:28:44.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.177+0000 7fd0721dc700 1 -- 172.21.15.63:0/1869324626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd04c04f880 msgr2=0x7fd04c051d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:44.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.177+0000 7fd0721dc700 1 --2- 172.21.15.63:0/1869324626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd04c04f880 0x7fd04c051d40 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7fd060007960 tx=0x7fd06c05b560).stop 2020-05-18T21:28:44.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.177+0000 7fd0721dc700 1 -- 172.21.15.63:0/1869324626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd06c0b4e80 msgr2=0x7fd06c153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:44.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.177+0000 7fd0721dc700 1 --2- 172.21.15.63:0/1869324626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd06c0b4e80 0x7fd06c153190 secure :-1 s=READY pgs=569 cs=0 l=1 rx=0x7fd06c112840 tx=0x7fd05c010c90).stop 2020-05-18T21:28:44.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.177+0000 7fd0721dc700 1 -- 172.21.15.63:0/1869324626 shutdown_connections 2020-05-18T21:28:44.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.177+0000 7fd0721dc700 1 --2- 172.21.15.63:0/1869324626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd04c04f880 0x7fd04c051d40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:44.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.177+0000 7fd0721dc700 1 --2- 172.21.15.63:0/1869324626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd06c0b4e80 0x7fd06c153190 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:44.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.177+0000 7fd0721dc700 1 -- 172.21.15.63:0/1869324626 >> 172.21.15.63:0/1869324626 conn(0x7fd06c0b83b0 msgr2=0x7fd06c063f90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:44.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.177+0000 7fd0721dc700 1 -- 172.21.15.63:0/1869324626 shutdown_connections 2020-05-18T21:28:44.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.177+0000 7fd0721dc700 1 -- 172.21.15.63:0/1869324626 wait complete. 2020-05-18T21:28:44.185 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2020-05-18T21:28:44.199 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:28:44.199 INFO:tasks.ceph.mds.a:Stopping old one... 2020-05-18T21:28:44.199 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:28:44.200 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:28:44.200 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:28:44.200 INFO:tasks.ceph.mds.b:Stopping old one... 2020-05-18T21:28:44.200 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:28:44.201 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:28:44.212 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:28:44.212 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:28:44.213 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:28:44.214 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:28:44.216 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:28:44.216 DEBUG:teuthology.parallel:result is None 2020-05-18T21:28:44.217 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:28:44.217 DEBUG:teuthology.parallel:result is None 2020-05-18T21:28:44.218 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-05-18T21:28:44.290 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:28:44.290 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:28:44.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65dc88e700 1 Processor -- start 2020-05-18T21:28:44.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65dc88e700 1 -- start start 2020-05-18T21:28:44.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65dc88e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f65d805efd0 0x7f65d805fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:44.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65dc88e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d8143e40 0x7f65d80afa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:44.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65dc88e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d8144550 con 0x7f65d80afea0 2020-05-18T21:28:44.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65dc88e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d81447f0 con 0x7f65d805efd0 2020-05-18T21:28:44.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65dc88e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d8144a90 con 0x7f65d8143e40 2020-05-18T21:28:44.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65d6d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f65d80afea0 0x7f65d80b4fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57646/0 (socket says 172.21.15.63:57646) 2020-05-18T21:28:44.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65d6d9d700 1 -- 172.21.15.63:0/692010149 learned_addr learned my addr 172.21.15.63:0/692010149 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:44.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65d659c700 1 --2- 172.21.15.63:0/692010149 >> v2:172.21.15.155:3300/0 conn(0x7f65d805efd0 0x7f65d805fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:44.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65cffff700 1 --2- 172.21.15.63:0/692010149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d8143e40 0x7f65d80afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:44.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65d5d9b700 1 -- 172.21.15.63:0/692010149 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2362529136 0 0) 0x7f65d8144550 con 0x7f65d80afea0 2020-05-18T21:28:44.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65d5d9b700 1 -- 172.21.15.63:0/692010149 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65b8003270 con 0x7f65d80afea0 2020-05-18T21:28:44.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65cffff700 1 -- 172.21.15.63:0/692010149 >> v2:172.21.15.155:3300/0 conn(0x7f65d805efd0 msgr2=0x7f65d805fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:44.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65cffff700 1 --2- 172.21.15.63:0/692010149 >> v2:172.21.15.155:3300/0 conn(0x7f65d805efd0 0x7f65d805fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:44.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65cffff700 1 -- 172.21.15.63:0/692010149 >> v1:172.21.15.63:6789/0 conn(0x7f65d80afea0 legacy=0x7f65d80b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:44.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65cffff700 1 -- 172.21.15.63:0/692010149 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d81442a0 con 0x7f65d8143e40 2020-05-18T21:28:44.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65d659c700 1 --2- 172.21.15.63:0/692010149 >> v2:172.21.15.155:3300/0 conn(0x7f65d805efd0 0x7f65d805fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:44.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65cffff700 1 --2- 172.21.15.63:0/692010149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d8143e40 0x7f65d80afa40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f65c0002f70 tx=0x7f65c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:44.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65cffff700 1 --2- 172.21.15.63:0/692010149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d8143e40 0x7f65d80afa40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f65c0002f70 tx=0x7f65c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:44.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65cffff700 1 --2- 172.21.15.63:0/692010149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d8143e40 0x7f65d80afa40 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f65c0002f70 tx=0x7f65c0007a80).ready entity=mon.2 client_cookie=77ff64c860677eca server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:44.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65cffff700 1 --2- 172.21.15.63:0/692010149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d8143e40 0x7f65d80afa40 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f65c0002f70 tx=0x7f65c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:44.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65d5d9b700 1 -- 172.21.15.63:0/692010149 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65c0008e80 con 0x7f65d8143e40 2020-05-18T21:28:44.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65cffff700 1 --2- 172.21.15.63:0/692010149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d8143e40 0x7f65d80afa40 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f65c0002f70 tx=0x7f65c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:44.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65d5d9b700 1 -- 172.21.15.63:0/692010149 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c0011540 con 0x7f65d8143e40 2020-05-18T21:28:44.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65cffff700 1 --2- 172.21.15.63:0/692010149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d8143e40 0x7f65d80afa40 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f65c0002f70 tx=0x7f65c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:44.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65d5d9b700 1 -- 172.21.15.63:0/692010149 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65c0011920 con 0x7f65d8143e40 2020-05-18T21:28:44.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65dc88e700 1 -- 172.21.15.63:0/692010149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d8143e40 msgr2=0x7f65d80afa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:44.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.325+0000 7f65dc88e700 1 --2- 172.21.15.63:0/692010149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d8143e40 0x7f65d80afa40 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f65c0002f70 tx=0x7f65c0007a80).stop 2020-05-18T21:28:44.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.329+0000 7f65dc88e700 1 -- 172.21.15.63:0/692010149 shutdown_connections 2020-05-18T21:28:44.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.329+0000 7f65dc88e700 1 --2- 172.21.15.63:0/692010149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d8143e40 0x7f65d80afa40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:44.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.329+0000 7f65dc88e700 1 --2- 172.21.15.63:0/692010149 >> v2:172.21.15.155:3300/0 conn(0x7f65d805efd0 0x7f65d805fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:44.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.329+0000 7f65dc88e700 1 -- 172.21.15.63:0/692010149 >> 172.21.15.63:0/692010149 conn(0x7f65d80ba600 msgr2=0x7f65d80baa10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:44.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.329+0000 7f65dc88e700 1 -- 172.21.15.63:0/692010149 shutdown_connections 2020-05-18T21:28:44.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.329+0000 7f65dc88e700 1 -- 172.21.15.63:0/692010149 wait complete. 2020-05-18T21:28:44.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.329+0000 7f65dc88e700 1 Processor -- start 2020-05-18T21:28:44.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.329+0000 7f65dc88e700 1 -- start start 2020-05-18T21:28:44.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65dc88e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f65d805efd0 0x7f65d80b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:44.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65dc88e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d80afea0 0x7f65d8142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:44.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65dc88e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d8155580 con 0x7f65d8143e40 2020-05-18T21:28:44.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65dc88e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d8151210 con 0x7f65d805efd0 2020-05-18T21:28:44.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65dc88e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d81514b0 con 0x7f65d80afea0 2020-05-18T21:28:44.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65d659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f65d805efd0 0x7f65d80b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:44.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65d6d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f65d8143e40 0x7f65d8151950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57652/0 (socket says 172.21.15.63:57652) 2020-05-18T21:28:44.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65d6d9d700 1 -- 172.21.15.63:0/3810728552 learned_addr learned my addr 172.21.15.63:0/3810728552 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:44.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65cffff700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d80afea0 0x7f65d8142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:44.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65cf7fe700 1 -- 172.21.15.63:0/3810728552 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951448940 0 0) 0x7f65d8155580 con 0x7f65d8143e40 2020-05-18T21:28:44.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65cf7fe700 1 -- 172.21.15.63:0/3810728552 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65bc002fe0 con 0x7f65d8143e40 2020-05-18T21:28:44.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65d659c700 1 -- 172.21.15.63:0/3810728552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d80afea0 msgr2=0x7f65d8142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:44.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65d659c700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d80afea0 0x7f65d8142550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:44.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65d659c700 1 -- 172.21.15.63:0/3810728552 >> v1:172.21.15.63:6789/0 conn(0x7f65d8143e40 legacy=0x7f65d8151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:44.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65d659c700 1 -- 172.21.15.63:0/3810728552 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d8152060 con 0x7f65d805efd0 2020-05-18T21:28:44.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65d659c700 1 --2- 172.21.15.63:0/3810728552 >> v2:172.21.15.63:3300/0 conn(0x7f65d805efd0 0x7f65d80b3640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f65d80b4c70 tx=0x7f65c8010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:44.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65d659c700 1 --2- 172.21.15.63:0/3810728552 >> v2:172.21.15.63:3300/0 conn(0x7f65d805efd0 0x7f65d80b3640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f65d80b4c70 tx=0x7f65c8010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:44.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65d659c700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d805efd0 0x7f65d80b3640 secure :-1 s=READY pgs=575 cs=0 l=1 rx=0x7f65d80b4c70 tx=0x7f65c8010db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:44.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65d659c700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d805efd0 0x7f65d80b3640 secure :-1 s=THROTTLE_DONE pgs=575 cs=0 l=1 rx=0x7f65d80b4c70 tx=0x7f65c8010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:44.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65cf7fe700 1 -- 172.21.15.63:0/3810728552 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65c8007560 con 0x7f65d805efd0 2020-05-18T21:28:44.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65d659c700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d805efd0 0x7f65d80b3640 secure :-1 s=THROTTLE_DONE pgs=575 cs=0 l=1 rx=0x7f65d80b4c70 tx=0x7f65c8010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:44.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65d659c700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d805efd0 0x7f65d80b3640 secure :-1 s=THROTTLE_DONE pgs=575 cs=0 l=1 rx=0x7f65d80b4c70 tx=0x7f65c8010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:44.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65cf7fe700 1 -- 172.21.15.63:0/3810728552 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c8005a00 con 0x7f65d805efd0 2020-05-18T21:28:44.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65dc88e700 1 -- 172.21.15.63:0/3810728552 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d80b7de0 con 0x7f65d805efd0 2020-05-18T21:28:44.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65cf7fe700 1 -- 172.21.15.63:0/3810728552 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65c8005de0 con 0x7f65d805efd0 2020-05-18T21:28:44.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65dc88e700 1 -- 172.21.15.63:0/3810728552 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d81552d0 con 0x7f65d805efd0 2020-05-18T21:28:44.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65d659c700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d805efd0 0x7f65d80b3640 secure :-1 s=THROTTLE_DONE pgs=575 cs=0 l=1 rx=0x7f65d80b4c70 tx=0x7f65c8010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:44.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.333+0000 7f65dc88e700 1 -- 172.21.15.63:0/3810728552 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d80569e0 con 0x7f65d805efd0 2020-05-18T21:28:44.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.337+0000 7f65cf7fe700 1 -- 172.21.15.63:0/3810728552 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f65c8009490 con 0x7f65d805efd0 2020-05-18T21:28:44.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.337+0000 7f65d659c700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d805efd0 0x7f65d80b3640 secure :-1 s=THROTTLE_DONE pgs=575 cs=0 l=1 rx=0x7f65d80b4c70 tx=0x7f65c8010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:44.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.337+0000 7f65cf7fe700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f65bc04fdd0 0x7f65bc052290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:44.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.337+0000 7f65cf7fe700 1 -- 172.21.15.63:0/3810728552 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f65c80640d0 con 0x7f65d805efd0 2020-05-18T21:28:44.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.337+0000 7f65cffff700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f65bc04fdd0 0x7f65bc052290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:44.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.337+0000 7f65cffff700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f65bc04fdd0 0x7f65bc052290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f65c0002f70 tx=0x7f65c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:44.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.337+0000 7f65cffff700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f65bc04fdd0 0x7f65bc052290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f65c0002f70 tx=0x7f65c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:44.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.337+0000 7f65cffff700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f65bc04fdd0 0x7f65bc052290 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7f65c0002f70 tx=0x7f65c0007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:44.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.345+0000 7f65d659c700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d805efd0 0x7f65d80b3640 secure :-1 s=THROTTLE_DONE pgs=575 cs=0 l=1 rx=0x7f65d80b4c70 tx=0x7f65c8010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:44.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.345+0000 7f65cf7fe700 1 -- 172.21.15.63:0/3810728552 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f65c803e400 con 0x7f65d805efd0 2020-05-18T21:28:44.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:44.473+0000 7f65dc88e700 1 -- 172.21.15.63:0/3810728552 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f65d806ab80 con 0x7f65d805efd0 2020-05-18T21:28:45.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.181+0000 7f65d659c700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d805efd0 0x7f65d80b3640 secure :-1 s=THROTTLE_DONE pgs=575 cs=0 l=1 rx=0x7f65d80b4c70 tx=0x7f65c8010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.181+0000 7f65cf7fe700 1 -- 172.21.15.63:0/3810728552 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v45) v1 ==== 97+0+0 (secure 0 0 0) 0x7f65c8041a20 con 0x7f65d805efd0 2020-05-18T21:28:45.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.185+0000 7f65dc88e700 1 -- 172.21.15.63:0/3810728552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f65bc04fdd0 msgr2=0x7f65bc052290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:45.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.185+0000 7f65dc88e700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f65bc04fdd0 0x7f65bc052290 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7f65c0002f70 tx=0x7f65c0007a80).stop 2020-05-18T21:28:45.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.185+0000 7f65dc88e700 1 -- 172.21.15.63:0/3810728552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d805efd0 msgr2=0x7f65d80b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:45.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.185+0000 7f65dc88e700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d805efd0 0x7f65d80b3640 secure :-1 s=READY pgs=575 cs=0 l=1 rx=0x7f65d80b4c70 tx=0x7f65c8010db0).stop 2020-05-18T21:28:45.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.189+0000 7f65dc88e700 1 -- 172.21.15.63:0/3810728552 shutdown_connections 2020-05-18T21:28:45.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.189+0000 7f65dc88e700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f65bc04fdd0 0x7f65bc052290 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:45.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.189+0000 7f65dc88e700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d80afea0 0x7f65d8142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:45.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.189+0000 7f65dc88e700 1 --2- 172.21.15.63:0/3810728552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d805efd0 0x7f65d80b3640 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:45.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.189+0000 7f65dc88e700 1 -- 172.21.15.63:0/3810728552 >> 172.21.15.63:0/3810728552 conn(0x7f65d80ba600 msgr2=0x7f65d80ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:45.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.189+0000 7f65dc88e700 1 -- 172.21.15.63:0/3810728552 shutdown_connections 2020-05-18T21:28:45.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.189+0000 7f65dc88e700 1 -- 172.21.15.63:0/3810728552 wait complete. 2020-05-18T21:28:45.196 INFO:teuthology.orchestra.run.smithi063.stderr: removed all blacklist entries 2020-05-18T21:28:45.208 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-05-18T21:28:45.209 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-05-18T21:28:45.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.309+0000 7f0ec094d700 1 Processor -- start 2020-05-18T21:28:45.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.309+0000 7f0ec094d700 1 -- start start 2020-05-18T21:28:45.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.309+0000 7f0ec094d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ebc145df0 0x7f0ebc142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:45.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.309+0000 7f0ec094d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ebc0b7020 con 0x7f0ebc1432f0 2020-05-18T21:28:45.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.309+0000 7f0ec094d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ebc0b72c0 con 0x7f0ebc0b93f0 2020-05-18T21:28:45.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.309+0000 7f0ec094d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc0b7560 con 0x7f0ebc145df0 2020-05-18T21:28:45.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ebbfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0ebc1432f0 0x7f0ebc060430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57660/0 (socket says 172.21.15.63:57660) 2020-05-18T21:28:45.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ebbfff700 1 -- 172.21.15.63:0/4232316844 learned_addr learned my addr 172.21.15.63:0/4232316844 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:45.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ebaffd700 1 --2- 172.21.15.63:0/4232316844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ebc145df0 0x7f0ebc142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:45.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0eba7fc700 1 -- 172.21.15.63:0/4232316844 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480888562 0 0) 0x7f0ebc0b7020 con 0x7f0ebc1432f0 2020-05-18T21:28:45.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0eba7fc700 1 -- 172.21.15.63:0/4232316844 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea8003270 con 0x7f0ebc1432f0 2020-05-18T21:28:45.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0eba7fc700 1 -- 172.21.15.63:0/4232316844 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211518021 0 0) 0x7f0ebc0b72c0 con 0x7f0ebc0b93f0 2020-05-18T21:28:45.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0eba7fc700 1 -- 172.21.15.63:0/4232316844 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ebc0b7020 con 0x7f0ebc0b93f0 2020-05-18T21:28:45.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ebaffd700 1 -- 172.21.15.63:0/4232316844 >> v1:172.21.15.155:6789/0 conn(0x7f0ebc0b93f0 legacy=0x7f0ebc0b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:45.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ebaffd700 1 -- 172.21.15.63:0/4232316844 >> v1:172.21.15.63:6789/0 conn(0x7f0ebc1432f0 legacy=0x7f0ebc060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:45.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ebaffd700 1 -- 172.21.15.63:0/4232316844 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ebc0b7800 con 0x7f0ebc145df0 2020-05-18T21:28:45.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ebaffd700 1 --2- 172.21.15.63:0/4232316844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ebc145df0 0x7f0ebc142e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0eac002f70 tx=0x7f0eac008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ebaffd700 1 --2- 172.21.15.63:0/4232316844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ebc145df0 0x7f0ebc142e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0eac002f70 tx=0x7f0eac008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ebaffd700 1 --2- 172.21.15.63:0/4232316844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ebc145df0 0x7f0ebc142e90 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f0eac002f70 tx=0x7f0eac008920).ready entity=mon.2 client_cookie=710519b1c7a13fa1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:45.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ebaffd700 1 --2- 172.21.15.63:0/4232316844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ebc145df0 0x7f0ebc142e90 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f0eac002f70 tx=0x7f0eac008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0eba7fc700 1 -- 172.21.15.63:0/4232316844 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eac008e80 con 0x7f0ebc145df0 2020-05-18T21:28:45.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ebaffd700 1 --2- 172.21.15.63:0/4232316844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ebc145df0 0x7f0ebc142e90 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f0eac002f70 tx=0x7f0eac008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0eba7fc700 1 -- 172.21.15.63:0/4232316844 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac011580 con 0x7f0ebc145df0 2020-05-18T21:28:45.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ebaffd700 1 --2- 172.21.15.63:0/4232316844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ebc145df0 0x7f0ebc142e90 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f0eac002f70 tx=0x7f0eac008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ec094d700 1 -- 172.21.15.63:0/4232316844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ebc145df0 msgr2=0x7f0ebc142e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:45.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0eba7fc700 1 -- 172.21.15.63:0/4232316844 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eac0118e0 con 0x7f0ebc145df0 2020-05-18T21:28:45.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ec094d700 1 --2- 172.21.15.63:0/4232316844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ebc145df0 0x7f0ebc142e90 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f0eac002f70 tx=0x7f0eac008920).stop 2020-05-18T21:28:45.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ec094d700 1 -- 172.21.15.63:0/4232316844 shutdown_connections 2020-05-18T21:28:45.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ec094d700 1 --2- 172.21.15.63:0/4232316844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ebc145df0 0x7f0ebc142e90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:45.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ec094d700 1 -- 172.21.15.63:0/4232316844 >> 172.21.15.63:0/4232316844 conn(0x7f0ebc069b70 msgr2=0x7f0ebc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:45.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ec094d700 1 -- 172.21.15.63:0/4232316844 shutdown_connections 2020-05-18T21:28:45.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ec094d700 1 -- 172.21.15.63:0/4232316844 wait complete. 2020-05-18T21:28:45.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ec094d700 1 Processor -- start 2020-05-18T21:28:45.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.313+0000 7f0ec094d700 1 -- start start 2020-05-18T21:28:45.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ec094d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ebc0b93f0 0x7f0ebc0bc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:45.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ec094d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0ebc1432f0 0x7f0ebc157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:45.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ec094d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ebc1575c0 con 0x7f0ebc145df0 2020-05-18T21:28:45.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ec094d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ebc0bbb10 con 0x7f0ebc1432f0 2020-05-18T21:28:45.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ec094d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc140180 con 0x7f0ebc0b93f0 2020-05-18T21:28:45.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ebaffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0ebc1432f0 0x7f0ebc157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:45.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ebbfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0ebc145df0 0x7f0ebc13d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57662/0 (socket says 172.21.15.63:57662) 2020-05-18T21:28:45.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ebbfff700 1 -- 172.21.15.63:0/3368828181 learned_addr learned my addr 172.21.15.63:0/3368828181 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:45.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ebb7fe700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ebc0b93f0 0x7f0ebc0bc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:45.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0eb8ff9700 1 -- 172.21.15.63:0/3368828181 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855592747 0 0) 0x7f0ebc1575c0 con 0x7f0ebc145df0 2020-05-18T21:28:45.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0eb8ff9700 1 -- 172.21.15.63:0/3368828181 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e9c002fe0 con 0x7f0ebc145df0 2020-05-18T21:28:45.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ebaffd700 1 -- 172.21.15.63:0/3368828181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ebc0b93f0 msgr2=0x7f0ebc0bc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:45.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ebaffd700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ebc0b93f0 0x7f0ebc0bc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:45.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ebaffd700 1 -- 172.21.15.63:0/3368828181 >> v1:172.21.15.63:6789/0 conn(0x7f0ebc145df0 legacy=0x7f0ebc13d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:45.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ebaffd700 1 -- 172.21.15.63:0/3368828181 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ebc13dba0 con 0x7f0ebc1432f0 2020-05-18T21:28:45.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ebaffd700 1 --2- 172.21.15.63:0/3368828181 >> v2:172.21.15.63:3300/0 conn(0x7f0ebc1432f0 0x7f0ebc157160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ebc13f490 tx=0x7f0eac011330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ebaffd700 1 --2- 172.21.15.63:0/3368828181 >> v2:172.21.15.63:3300/0 conn(0x7f0ebc1432f0 0x7f0ebc157160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ebc13f490 tx=0x7f0eac011330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ebaffd700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ebc1432f0 0x7f0ebc157160 secure :-1 s=READY pgs=578 cs=0 l=1 rx=0x7f0ebc13f490 tx=0x7f0eac011330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:45.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ebaffd700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ebc1432f0 0x7f0ebc157160 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7f0ebc13f490 tx=0x7f0eac011330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0eb8ff9700 1 -- 172.21.15.63:0/3368828181 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eac00f8a0 con 0x7f0ebc1432f0 2020-05-18T21:28:45.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ebaffd700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ebc1432f0 0x7f0ebc157160 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7f0ebc13f490 tx=0x7f0eac011330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ebaffd700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ebc1432f0 0x7f0ebc157160 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7f0ebc13f490 tx=0x7f0eac011330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0eb8ff9700 1 -- 172.21.15.63:0/3368828181 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac007170 con 0x7f0ebc1432f0 2020-05-18T21:28:45.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ec094d700 1 -- 172.21.15.63:0/3368828181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ebc141630 con 0x7f0ebc1432f0 2020-05-18T21:28:45.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0eb8ff9700 1 -- 172.21.15.63:0/3368828181 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eac007550 con 0x7f0ebc1432f0 2020-05-18T21:28:45.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ec094d700 1 -- 172.21.15.63:0/3368828181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ebc0ba720 con 0x7f0ebc1432f0 2020-05-18T21:28:45.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ebaffd700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ebc1432f0 0x7f0ebc157160 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7f0ebc13f490 tx=0x7f0eac011330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.317+0000 7f0ec094d700 1 -- 172.21.15.63:0/3368828181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ebc13ffc0 con 0x7f0ebc1432f0 2020-05-18T21:28:45.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.321+0000 7f0eb8ff9700 1 -- 172.21.15.63:0/3368828181 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0eac005700 con 0x7f0ebc1432f0 2020-05-18T21:28:45.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.321+0000 7f0ebaffd700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ebc1432f0 0x7f0ebc157160 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7f0ebc13f490 tx=0x7f0eac011330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.321+0000 7f0eb8ff9700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9c04fd50 0x7f0e9c052210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:45.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.321+0000 7f0eb8ff9700 1 -- 172.21.15.63:0/3368828181 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f0eac064500 con 0x7f0ebc1432f0 2020-05-18T21:28:45.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.321+0000 7f0ebb7fe700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9c04fd50 0x7f0e9c052210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:45.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.321+0000 7f0ebb7fe700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9c04fd50 0x7f0e9c052210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0eb0001110 tx=0x7f0eb00010b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.321+0000 7f0ebb7fe700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9c04fd50 0x7f0e9c052210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0eb0001110 tx=0x7f0eb00010b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.321+0000 7f0ebb7fe700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9c04fd50 0x7f0e9c052210 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f0eb0001110 tx=0x7f0eb00010b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:45.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.325+0000 7f0ebaffd700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ebc1432f0 0x7f0ebc157160 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7f0ebc13f490 tx=0x7f0eac011330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.325+0000 7f0eb8ff9700 1 -- 172.21.15.63:0/3368828181 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f0eac03e890 con 0x7f0ebc1432f0 2020-05-18T21:28:45.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.473+0000 7f0ec094d700 1 -- 172.21.15.63:0/3368828181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0ebc0437e0 con 0x7f0ebc1432f0 2020-05-18T21:28:45.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.473+0000 7f0ebaffd700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ebc1432f0 0x7f0ebc157160 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7f0ebc13f490 tx=0x7f0eac011330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.473+0000 7f0eb8ff9700 1 -- 172.21.15.63:0/3368828181 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+4513 (secure 0 0 0) 0x7f0eac041eb0 con 0x7f0ebc1432f0 2020-05-18T21:28:45.481 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:45.481 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:28:45.482 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_dump": [ 2020-05-18T21:28:45.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:45.482 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.a", 2020-05-18T21:28:45.482 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJekJyyLRAAfB5XJCsXTAmZdkFOaQrokg==", 2020-05-18T21:28:45.482 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:45.483 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:28:45.483 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:45.483 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:45.483 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:45.483 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:45.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:45.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:45.484 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.b", 2020-05-18T21:28:45.484 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeSVE8MRAAEEytuzLtcQMC+1uQ/yh8eA==", 2020-05-18T21:28:45.485 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:45.485 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:28:45.485 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:45.485 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:45.485 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:45.486 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:45.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:45.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:45.486 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.0", 2020-05-18T21:28:45.486 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBq/cJeIn7mJhAArx+YEdVbsfXXNOLWdaAgWw==", 2020-05-18T21:28:45.487 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:45.487 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:45.487 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:45.487 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:45.487 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:45.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:45.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:45.488 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.1", 2020-05-18T21:28:45.488 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBt/cJelHywCRAAFyQ3sPEE0RTSy4tKfsDfyw==", 2020-05-18T21:28:45.488 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:45.489 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:45.489 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:45.489 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:45.489 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:45.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:45.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:45.490 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.2", 2020-05-18T21:28:45.490 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBv/cJecexDLBAAxhlFq20MBkKvDjuM1yi8XQ==", 2020-05-18T21:28:45.490 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:45.490 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:45.490 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:45.491 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:45.491 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:45.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:45.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:45.491 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.3", 2020-05-18T21:28:45.492 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBy/cJe9IqwDxAAMg1In7bIITDcOZljzzTpDQ==", 2020-05-18T21:28:45.492 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:45.492 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:45.492 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:45.493 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:45.493 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:45.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:45.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:45.493 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.4", 2020-05-18T21:28:45.494 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB3/cJeLXgxFhAA/kMVV5hCRny2uXKvvbu8Og==", 2020-05-18T21:28:45.494 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:45.494 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:45.494 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:45.494 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:45.494 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:45.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:45.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:45.495 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.5", 2020-05-18T21:28:45.495 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB5/cJeucpsNRAAjGh+6yUC8Fji9PE4COi/Eg==", 2020-05-18T21:28:45.495 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:45.496 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:45.496 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:45.496 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:45.496 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:45.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:45.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:45.497 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.6", 2020-05-18T21:28:45.497 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB8/cJelSPpGhAAXobGqH9qaW1VZfEpH8bUbQ==", 2020-05-18T21:28:45.497 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:45.497 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:45.497 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:45.498 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:45.498 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:45.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:45.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:45.499 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.7", 2020-05-18T21:28:45.499 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB+/cJeUIl5OBAAPd8H8ohOWZw9ubO7uCB6zg==", 2020-05-18T21:28:45.499 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:45.499 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:45.500 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:45.500 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:45.500 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:45.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:45.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:45.500 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.0", 2020-05-18T21:28:45.501 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeap3RNhAAi2vKpsKtzSL1Uuqm8pWYJQ==", 2020-05-18T21:28:45.501 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:45.501 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:28:45.501 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:28:45.501 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:28:45.502 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:45.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:45.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:45.502 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.1", 2020-05-18T21:28:45.502 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJeekrQABAA5TmzWOt24C6hgZw/WTj5dw==", 2020-05-18T21:28:45.503 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:45.503 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:28:45.503 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:28:45.504 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:28:45.504 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:45.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:45.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:45.504 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.2", 2020-05-18T21:28:45.505 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJehSnFAxAAXUZwqNTXqAApEB3nXs4u6g==", 2020-05-18T21:28:45.505 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:45.505 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:28:45.505 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:28:45.505 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:28:45.506 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:45.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:45.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:45.506 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.3", 2020-05-18T21:28:45.506 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJe2HdDBhAA07y5pn/bKKa9TBbZFvIh9g==", 2020-05-18T21:28:45.507 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:45.507 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:28:45.507 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:28:45.507 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:28:45.507 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:45.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:45.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:45.508 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.admin", 2020-05-18T21:28:45.508 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJe/K4fGRAA+rP3BYuWiyx/fKmQ3bV6Lw==", 2020-05-18T21:28:45.508 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:45.508 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:28:45.509 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:28:45.509 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:28:45.509 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:45.509 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:45.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:45.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:45.510 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.x", 2020-05-18T21:28:45.510 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJemmqEKhAAe5ySRz8Id0ug4matQwL0uw==", 2020-05-18T21:28:45.510 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:45.510 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:28:45.511 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:28:45.511 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:45.511 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:45.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:45.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:45.511 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.y", 2020-05-18T21:28:45.512 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeF/BNJhAAi/vrldC6qoWJWnSHpE3ung==", 2020-05-18T21:28:45.512 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:28:45.512 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:28:45.512 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:28:45.512 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:28:45.513 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:45.513 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:45.513 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:45.513 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:28:45.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.477+0000 7f0ec094d700 1 -- 172.21.15.63:0/3368828181 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9c04fd50 msgr2=0x7f0e9c052210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:45.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.477+0000 7f0ec094d700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9c04fd50 0x7f0e9c052210 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f0eb0001110 tx=0x7f0eb00010b0).stop 2020-05-18T21:28:45.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.477+0000 7f0ec094d700 1 -- 172.21.15.63:0/3368828181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ebc1432f0 msgr2=0x7f0ebc157160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:45.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.477+0000 7f0ec094d700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ebc1432f0 0x7f0ebc157160 secure :-1 s=READY pgs=578 cs=0 l=1 rx=0x7f0ebc13f490 tx=0x7f0eac011330).stop 2020-05-18T21:28:45.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.477+0000 7f0ec094d700 1 -- 172.21.15.63:0/3368828181 shutdown_connections 2020-05-18T21:28:45.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.477+0000 7f0ec094d700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9c04fd50 0x7f0e9c052210 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:45.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.477+0000 7f0ec094d700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ebc1432f0 0x7f0ebc157160 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:45.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.477+0000 7f0ec094d700 1 --2- 172.21.15.63:0/3368828181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ebc0b93f0 0x7f0ebc0bc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:45.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.477+0000 7f0ec094d700 1 -- 172.21.15.63:0/3368828181 >> 172.21.15.63:0/3368828181 conn(0x7f0ebc069b70 msgr2=0x7f0ebc069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:45.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.477+0000 7f0ec094d700 1 -- 172.21.15.63:0/3368828181 shutdown_connections 2020-05-18T21:28:45.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.477+0000 7f0ec094d700 1 -- 172.21.15.63:0/3368828181 wait complete. 2020-05-18T21:28:45.518 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:28:45.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.621+0000 7f6236044700 1 Processor -- start 2020-05-18T21:28:45.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.621+0000 7f6236044700 1 -- start start 2020-05-18T21:28:45.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.621+0000 7f6236044700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6230143da0 0x7f623012a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:45.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.621+0000 7f6236044700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6230147e60 0x7f62300650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:45.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.621+0000 7f6236044700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6230144240 con 0x7f6230060b90 2020-05-18T21:28:45.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.621+0000 7f6236044700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62301444e0 con 0x7f6230147e60 2020-05-18T21:28:45.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.621+0000 7f6236044700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6230144780 con 0x7f6230143da0 2020-05-18T21:28:45.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f622ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6230147e60 0x7f62300650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:45.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f622ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6230147e60 0x7f62300650c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55486/0 (socket says 172.21.15.63:55486) 2020-05-18T21:28:45.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f622ffff700 1 -- 172.21.15.63:0/1201099460 learned_addr learned my addr 172.21.15.63:0/1201099460 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:45.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f622effd700 1 --2- 172.21.15.63:0/1201099460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6230143da0 0x7f623012a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:45.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f622ffff700 1 -- 172.21.15.63:0/1201099460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6230143da0 msgr2=0x7f623012a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:45.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f622ffff700 1 --2- 172.21.15.63:0/1201099460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6230143da0 0x7f623012a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:45.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f622ffff700 1 -- 172.21.15.63:0/1201099460 >> v1:172.21.15.155:6789/0 conn(0x7f6230060b90 legacy=0x7f62301299d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:45.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f622ffff700 1 -- 172.21.15.63:0/1201099460 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6230144c20 con 0x7f6230147e60 2020-05-18T21:28:45.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f622effd700 1 --2- 172.21.15.63:0/1201099460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6230143da0 0x7f623012a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:45.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f622ffff700 1 --2- 172.21.15.63:0/1201099460 >> v2:172.21.15.63:3300/0 conn(0x7f6230147e60 0x7f62300650c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f62280032f0 tx=0x7f6228007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f622ffff700 1 --2- 172.21.15.63:0/1201099460 >> v2:172.21.15.63:3300/0 conn(0x7f6230147e60 0x7f62300650c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f62280032f0 tx=0x7f6228007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f622ffff700 1 --2- 172.21.15.63:0/1201099460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6230147e60 0x7f62300650c0 secure :-1 s=READY pgs=579 cs=0 l=1 rx=0x7f62280032f0 tx=0x7f6228007e00).ready entity=mon.0 client_cookie=8c071e2a1e809151 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:45.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f622ffff700 1 --2- 172.21.15.63:0/1201099460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6230147e60 0x7f62300650c0 secure :-1 s=THROTTLE_DONE pgs=579 cs=0 l=1 rx=0x7f62280032f0 tx=0x7f6228007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f622e7fc700 1 -- 172.21.15.63:0/1201099460 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6228011d10 con 0x7f6230147e60 2020-05-18T21:28:45.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f622ffff700 1 --2- 172.21.15.63:0/1201099460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6230147e60 0x7f62300650c0 secure :-1 s=THROTTLE_DONE pgs=579 cs=0 l=1 rx=0x7f62280032f0 tx=0x7f6228007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f622e7fc700 1 -- 172.21.15.63:0/1201099460 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6228011e70 con 0x7f6230147e60 2020-05-18T21:28:45.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f622ffff700 1 --2- 172.21.15.63:0/1201099460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6230147e60 0x7f62300650c0 secure :-1 s=THROTTLE_DONE pgs=579 cs=0 l=1 rx=0x7f62280032f0 tx=0x7f6228007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f6236044700 1 -- 172.21.15.63:0/1201099460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6230147e60 msgr2=0x7f62300650c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:45.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f622e7fc700 1 -- 172.21.15.63:0/1201099460 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f622800a370 con 0x7f6230147e60 2020-05-18T21:28:45.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f6236044700 1 --2- 172.21.15.63:0/1201099460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6230147e60 0x7f62300650c0 secure :-1 s=READY pgs=579 cs=0 l=1 rx=0x7f62280032f0 tx=0x7f6228007e00).stop 2020-05-18T21:28:45.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f6236044700 1 -- 172.21.15.63:0/1201099460 shutdown_connections 2020-05-18T21:28:45.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f6236044700 1 --2- 172.21.15.63:0/1201099460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6230147e60 0x7f62300650c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:45.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f6236044700 1 --2- 172.21.15.63:0/1201099460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6230143da0 0x7f623012a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:45.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f6236044700 1 -- 172.21.15.63:0/1201099460 >> 172.21.15.63:0/1201099460 conn(0x7f62300b83d0 msgr2=0x7f62300b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:45.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f6236044700 1 -- 172.21.15.63:0/1201099460 shutdown_connections 2020-05-18T21:28:45.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.625+0000 7f6236044700 1 -- 172.21.15.63:0/1201099460 wait complete. 2020-05-18T21:28:45.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.629+0000 7f6236044700 1 Processor -- start 2020-05-18T21:28:45.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.629+0000 7f6236044700 1 -- start start 2020-05-18T21:28:45.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.629+0000 7f6236044700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6230060b90 0x7f62301297a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:45.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.629+0000 7f6236044700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6230143da0 0x7f62301460e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:45.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.629+0000 7f6236044700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6230146540 con 0x7f6230147e60 2020-05-18T21:28:45.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.629+0000 7f6236044700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623012a880 con 0x7f6230143da0 2020-05-18T21:28:45.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.629+0000 7f6236044700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623012ab20 con 0x7f6230060b90 2020-05-18T21:28:45.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.629+0000 7f622effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6230143da0 0x7f62301460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:45.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.629+0000 7f622effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6230143da0 0x7f62301460e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55490/0 (socket says 172.21.15.63:55490) 2020-05-18T21:28:45.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.629+0000 7f622effd700 1 -- 172.21.15.63:0/1992754212 learned_addr learned my addr 172.21.15.63:0/1992754212 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:45.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.629+0000 7f622f7fe700 1 --2- 172.21.15.63:0/1992754212 >> v2:172.21.15.155:3300/0 conn(0x7f6230060b90 0x7f62301297a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:45.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.629+0000 7f622effd700 1 -- 172.21.15.63:0/1992754212 >> v2:172.21.15.155:3300/0 conn(0x7f6230060b90 msgr2=0x7f62301297a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:45.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.629+0000 7f622effd700 1 --2- 172.21.15.63:0/1992754212 >> v2:172.21.15.155:3300/0 conn(0x7f6230060b90 0x7f62301297a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:45.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.629+0000 7f622effd700 1 -- 172.21.15.63:0/1992754212 >> v1:172.21.15.155:6789/0 conn(0x7f6230147e60 legacy=0x7f6230153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:45.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.629+0000 7f622effd700 1 -- 172.21.15.63:0/1992754212 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623012adc0 con 0x7f6230143da0 2020-05-18T21:28:45.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.629+0000 7f622effd700 1 --2- 172.21.15.63:0/1992754212 >> v2:172.21.15.63:3300/0 conn(0x7f6230143da0 0x7f62301460e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6230142e90 tx=0x7f6218010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.629+0000 7f622effd700 1 --2- 172.21.15.63:0/1992754212 >> v2:172.21.15.63:3300/0 conn(0x7f6230143da0 0x7f62301460e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6230142e90 tx=0x7f6218010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.629+0000 7f622effd700 1 --2- 172.21.15.63:0/1992754212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6230143da0 0x7f62301460e0 secure :-1 s=READY pgs=580 cs=0 l=1 rx=0x7f6230142e90 tx=0x7f6218010f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:45.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.629+0000 7f622effd700 1 --2- 172.21.15.63:0/1992754212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6230143da0 0x7f62301460e0 secure :-1 s=THROTTLE_DONE pgs=580 cs=0 l=1 rx=0x7f6230142e90 tx=0x7f6218010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.633+0000 7f622effd700 1 --2- 172.21.15.63:0/1992754212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6230143da0 0x7f62301460e0 secure :-1 s=THROTTLE_DONE pgs=580 cs=0 l=1 rx=0x7f6230142e90 tx=0x7f6218010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.633+0000 7f622effd700 1 --2- 172.21.15.63:0/1992754212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6230143da0 0x7f62301460e0 secure :-1 s=THROTTLE_DONE pgs=580 cs=0 l=1 rx=0x7f6230142e90 tx=0x7f6218010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.633+0000 7f622cff9700 1 -- 172.21.15.63:0/1992754212 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f621800e370 con 0x7f6230143da0 2020-05-18T21:28:45.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.633+0000 7f622cff9700 1 -- 172.21.15.63:0/1992754212 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6218012a90 con 0x7f6230143da0 2020-05-18T21:28:45.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.633+0000 7f6236044700 1 -- 172.21.15.63:0/1992754212 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623012c220 con 0x7f6230143da0 2020-05-18T21:28:45.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.633+0000 7f622cff9700 1 -- 172.21.15.63:0/1992754212 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6218012df0 con 0x7f6230143da0 2020-05-18T21:28:45.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.633+0000 7f6236044700 1 -- 172.21.15.63:0/1992754212 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623014eae0 con 0x7f6230143da0 2020-05-18T21:28:45.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.633+0000 7f622effd700 1 --2- 172.21.15.63:0/1992754212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6230143da0 0x7f62301460e0 secure :-1 s=THROTTLE_DONE pgs=580 cs=0 l=1 rx=0x7f6230142e90 tx=0x7f6218010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.633+0000 7f622cff9700 1 -- 172.21.15.63:0/1992754212 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f62180071a0 con 0x7f6230143da0 2020-05-18T21:28:45.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.633+0000 7f622effd700 1 --2- 172.21.15.63:0/1992754212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6230143da0 0x7f62301460e0 secure :-1 s=THROTTLE_DONE pgs=580 cs=0 l=1 rx=0x7f6230142e90 tx=0x7f6218010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.633+0000 7f6236044700 1 -- 172.21.15.63:0/1992754212 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623012af70 con 0x7f6230143da0 2020-05-18T21:28:45.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.633+0000 7f622cff9700 1 --2- 172.21.15.63:0/1992754212 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f621404f9e0 0x7f6214051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:45.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.633+0000 7f622cff9700 1 -- 172.21.15.63:0/1992754212 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6218063b60 con 0x7f6230143da0 2020-05-18T21:28:45.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.633+0000 7f622f7fe700 1 --2- 172.21.15.63:0/1992754212 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f621404f9e0 0x7f6214051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:45.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.633+0000 7f622f7fe700 1 --2- 172.21.15.63:0/1992754212 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f621404f9e0 0x7f6214051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6230060650 tx=0x7f6220001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.633+0000 7f622f7fe700 1 --2- 172.21.15.63:0/1992754212 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f621404f9e0 0x7f6214051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6230060650 tx=0x7f6220001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.633+0000 7f622f7fe700 1 --2- 172.21.15.63:0/1992754212 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f621404f9e0 0x7f6214051ea0 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7f6230060650 tx=0x7f6220001810).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:45.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.641+0000 7f622effd700 1 --2- 172.21.15.63:0/1992754212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6230143da0 0x7f62301460e0 secure :-1 s=THROTTLE_DONE pgs=580 cs=0 l=1 rx=0x7f6230142e90 tx=0x7f6218010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.641+0000 7f622cff9700 1 -- 172.21.15.63:0/1992754212 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f621803def0 con 0x7f6230143da0 2020-05-18T21:28:45.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.757+0000 7f6236044700 1 -- 172.21.15.63:0/1992754212 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62300569e0 con 0x7f6230143da0 2020-05-18T21:28:45.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.757+0000 7f622effd700 1 --2- 172.21.15.63:0/1992754212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6230143da0 0x7f62301460e0 secure :-1 s=THROTTLE_DONE pgs=580 cs=0 l=1 rx=0x7f6230142e90 tx=0x7f6218010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.757+0000 7f622cff9700 1 -- 172.21.15.63:0/1992754212 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+13232 (secure 0 0 0) 0x7f6218041510 con 0x7f6230143da0 2020-05-18T21:28:45.766 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:45.766 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":45,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:28:45.173300+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:28:45.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.761+0000 7f6236044700 1 -- 172.21.15.63:0/1992754212 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f621404f9e0 msgr2=0x7f6214051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:45.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.761+0000 7f6236044700 1 --2- 172.21.15.63:0/1992754212 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f621404f9e0 0x7f6214051ea0 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7f6230060650 tx=0x7f6220001810).stop 2020-05-18T21:28:45.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.761+0000 7f6236044700 1 -- 172.21.15.63:0/1992754212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6230143da0 msgr2=0x7f62301460e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:45.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.761+0000 7f6236044700 1 --2- 172.21.15.63:0/1992754212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6230143da0 0x7f62301460e0 secure :-1 s=READY pgs=580 cs=0 l=1 rx=0x7f6230142e90 tx=0x7f6218010f30).stop 2020-05-18T21:28:45.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.761+0000 7f6236044700 1 -- 172.21.15.63:0/1992754212 shutdown_connections 2020-05-18T21:28:45.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.761+0000 7f6236044700 1 --2- 172.21.15.63:0/1992754212 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f621404f9e0 0x7f6214051ea0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:45.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.761+0000 7f6236044700 1 --2- 172.21.15.63:0/1992754212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6230143da0 0x7f62301460e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:45.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.761+0000 7f6236044700 1 --2- 172.21.15.63:0/1992754212 >> v2:172.21.15.155:3300/0 conn(0x7f6230060b90 0x7f62301297a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:45.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.761+0000 7f6236044700 1 -- 172.21.15.63:0/1992754212 >> 172.21.15.63:0/1992754212 conn(0x7f62300b83d0 msgr2=0x7f6230065050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:45.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.761+0000 7f6236044700 1 -- 172.21.15.63:0/1992754212 shutdown_connections 2020-05-18T21:28:45.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.761+0000 7f6236044700 1 -- 172.21.15.63:0/1992754212 wait complete. 2020-05-18T21:28:45.779 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-05-18T21:28:45.779 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:28:45.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.881+0000 7f07f739d700 1 Processor -- start 2020-05-18T21:28:45.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.881+0000 7f07f739d700 1 -- start start 2020-05-18T21:28:45.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f739d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f07f00b6190 0x7f07f014da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:45.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f739d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07f00611f0 0x7f07f0147590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:45.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f739d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f00af7c0 con 0x7f07f01479f0 2020-05-18T21:28:45.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f739d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f014e9c0 con 0x7f07f00611f0 2020-05-18T21:28:45.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f739d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f014b460 con 0x7f07f00b6190 2020-05-18T21:28:45.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f4938700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07f00611f0 0x7f07f0147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:45.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f4938700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07f00611f0 0x7f07f0147590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55498/0 (socket says 172.21.15.63:55498) 2020-05-18T21:28:45.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f4938700 1 -- 172.21.15.63:0/2820812439 learned_addr learned my addr 172.21.15.63:0/2820812439 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:45.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f5139700 1 --2- 172.21.15.63:0/2820812439 >> v2:172.21.15.155:3300/0 conn(0x7f07f00b6190 0x7f07f014da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:45.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07dffff700 1 -- 172.21.15.63:0/2820812439 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008121910 0 0) 0x7f07f00af7c0 con 0x7f07f01479f0 2020-05-18T21:28:45.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f4938700 1 -- 172.21.15.63:0/2820812439 >> v2:172.21.15.155:3300/0 conn(0x7f07f00b6190 msgr2=0x7f07f014da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:45.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f4938700 1 --2- 172.21.15.63:0/2820812439 >> v2:172.21.15.155:3300/0 conn(0x7f07f00b6190 0x7f07f014da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:45.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f4938700 1 -- 172.21.15.63:0/2820812439 >> v1:172.21.15.155:6789/0 conn(0x7f07f01479f0 legacy=0x7f07f00b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:45.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f4938700 1 -- 172.21.15.63:0/2820812439 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f014dfe0 con 0x7f07f00611f0 2020-05-18T21:28:45.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f4938700 1 --2- 172.21.15.63:0/2820812439 >> v2:172.21.15.63:3300/0 conn(0x7f07f00611f0 0x7f07f0147590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f07e0002f70 tx=0x7f07e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f4938700 1 --2- 172.21.15.63:0/2820812439 >> v2:172.21.15.63:3300/0 conn(0x7f07f00611f0 0x7f07f0147590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f07e0002f70 tx=0x7f07e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f4938700 1 --2- 172.21.15.63:0/2820812439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07f00611f0 0x7f07f0147590 secure :-1 s=READY pgs=581 cs=0 l=1 rx=0x7f07e0002f70 tx=0x7f07e0007a80).ready entity=mon.0 client_cookie=840556ce64f8d482 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:45.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f4938700 1 --2- 172.21.15.63:0/2820812439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07f00611f0 0x7f07f0147590 secure :-1 s=THROTTLE_DONE pgs=581 cs=0 l=1 rx=0x7f07e0002f70 tx=0x7f07e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07dffff700 1 -- 172.21.15.63:0/2820812439 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07e00116b0 con 0x7f07f00611f0 2020-05-18T21:28:45.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f4938700 1 --2- 172.21.15.63:0/2820812439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07f00611f0 0x7f07f0147590 secure :-1 s=THROTTLE_DONE pgs=581 cs=0 l=1 rx=0x7f07e0002f70 tx=0x7f07e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07dffff700 1 -- 172.21.15.63:0/2820812439 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e0011810 con 0x7f07f00611f0 2020-05-18T21:28:45.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f4938700 1 --2- 172.21.15.63:0/2820812439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07f00611f0 0x7f07f0147590 secure :-1 s=THROTTLE_DONE pgs=581 cs=0 l=1 rx=0x7f07e0002f70 tx=0x7f07e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07dffff700 1 -- 172.21.15.63:0/2820812439 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07e0011bf0 con 0x7f07f00611f0 2020-05-18T21:28:45.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f739d700 1 -- 172.21.15.63:0/2820812439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07f00611f0 msgr2=0x7f07f0147590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:45.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.885+0000 7f07f739d700 1 --2- 172.21.15.63:0/2820812439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07f00611f0 0x7f07f0147590 secure :-1 s=READY pgs=581 cs=0 l=1 rx=0x7f07e0002f70 tx=0x7f07e0007a80).stop 2020-05-18T21:28:45.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.889+0000 7f07f739d700 1 -- 172.21.15.63:0/2820812439 shutdown_connections 2020-05-18T21:28:45.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.889+0000 7f07f739d700 1 --2- 172.21.15.63:0/2820812439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07f00611f0 0x7f07f0147590 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:45.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.889+0000 7f07f739d700 1 --2- 172.21.15.63:0/2820812439 >> v2:172.21.15.155:3300/0 conn(0x7f07f00b6190 0x7f07f014da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:45.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.889+0000 7f07f739d700 1 -- 172.21.15.63:0/2820812439 >> 172.21.15.63:0/2820812439 conn(0x7f07f00b9720 msgr2=0x7f07f00b5740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:45.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.889+0000 7f07f739d700 1 -- 172.21.15.63:0/2820812439 shutdown_connections 2020-05-18T21:28:45.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.889+0000 7f07f739d700 1 -- 172.21.15.63:0/2820812439 wait complete. 2020-05-18T21:28:45.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.889+0000 7f07f739d700 1 Processor -- start 2020-05-18T21:28:45.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.889+0000 7f07f739d700 1 -- start start 2020-05-18T21:28:45.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.889+0000 7f07f739d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f07f00611f0 0x7f07f0158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:45.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.889+0000 7f07f739d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f009a4f0 con 0x7f07f01479f0 2020-05-18T21:28:45.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.889+0000 7f07f739d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f01585b0 con 0x7f07f00b6190 2020-05-18T21:28:45.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.889+0000 7f07f739d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f009a750 con 0x7f07f00611f0 2020-05-18T21:28:45.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.889+0000 7f07f593a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f07f01479f0 0x7f07f00b13f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57694/0 (socket says 172.21.15.63:57694) 2020-05-18T21:28:45.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.889+0000 7f07f593a700 1 -- 172.21.15.63:0/3769024168 learned_addr learned my addr 172.21.15.63:0/3769024168 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:45.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.889+0000 7f07f5139700 1 --2- 172.21.15.63:0/3769024168 >> v2:172.21.15.155:3300/0 conn(0x7f07f00611f0 0x7f07f0158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:45.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.893+0000 7f07de7fc700 1 -- 172.21.15.63:0/3769024168 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729426249 0 0) 0x7f07f009a4f0 con 0x7f07f01479f0 2020-05-18T21:28:45.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.893+0000 7f07de7fc700 1 -- 172.21.15.63:0/3769024168 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07d0002fe0 con 0x7f07f01479f0 2020-05-18T21:28:45.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.893+0000 7f07de7fc700 1 -- 172.21.15.63:0/3769024168 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049854573 0 0) 0x7f07f01585b0 con 0x7f07f00b6190 2020-05-18T21:28:45.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.893+0000 7f07f5139700 1 -- 172.21.15.63:0/3769024168 >> v1:172.21.15.155:6789/0 conn(0x7f07f00b6190 legacy=0x7f07f0146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:45.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.893+0000 7f07f5139700 1 -- 172.21.15.63:0/3769024168 >> v1:172.21.15.63:6789/0 conn(0x7f07f01479f0 legacy=0x7f07f00b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:45.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.893+0000 7f07f5139700 1 -- 172.21.15.63:0/3769024168 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f009a9f0 con 0x7f07f00611f0 2020-05-18T21:28:45.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.893+0000 7f07f5139700 1 --2- 172.21.15.63:0/3769024168 >> v2:172.21.15.155:3300/0 conn(0x7f07f00611f0 0x7f07f0158150 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f07e80014f0 tx=0x7f07ec010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.893+0000 7f07f5139700 1 --2- 172.21.15.63:0/3769024168 >> v2:172.21.15.155:3300/0 conn(0x7f07f00611f0 0x7f07f0158150 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f07e80014f0 tx=0x7f07ec010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.893+0000 7f07f5139700 1 --2- 172.21.15.63:0/3769024168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07f00611f0 0x7f07f0158150 secure :-1 s=READY pgs=420 cs=0 l=1 rx=0x7f07e80014f0 tx=0x7f07ec010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:45.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.893+0000 7f07f5139700 1 --2- 172.21.15.63:0/3769024168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07f00611f0 0x7f07f0158150 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f07e80014f0 tx=0x7f07ec010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.893+0000 7f07de7fc700 1 -- 172.21.15.63:0/3769024168 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07ec007550 con 0x7f07f00611f0 2020-05-18T21:28:45.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.893+0000 7f07f5139700 1 --2- 172.21.15.63:0/3769024168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07f00611f0 0x7f07f0158150 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f07e80014f0 tx=0x7f07ec010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.893+0000 7f07f5139700 1 --2- 172.21.15.63:0/3769024168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07f00611f0 0x7f07f0158150 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f07e80014f0 tx=0x7f07ec010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.893+0000 7f07de7fc700 1 -- 172.21.15.63:0/3769024168 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec005700 con 0x7f07f00611f0 2020-05-18T21:28:45.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.893+0000 7f07f739d700 1 -- 172.21.15.63:0/3769024168 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f009b680 con 0x7f07f00611f0 2020-05-18T21:28:45.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.893+0000 7f07de7fc700 1 -- 172.21.15.63:0/3769024168 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07ec005a60 con 0x7f07f00611f0 2020-05-18T21:28:45.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.893+0000 7f07f739d700 1 -- 172.21.15.63:0/3769024168 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f0146f00 con 0x7f07f00611f0 2020-05-18T21:28:45.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.893+0000 7f07f5139700 1 --2- 172.21.15.63:0/3769024168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07f00611f0 0x7f07f0158150 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f07e80014f0 tx=0x7f07ec010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.893+0000 7f07f739d700 1 -- 172.21.15.63:0/3769024168 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f00b1100 con 0x7f07f00611f0 2020-05-18T21:28:45.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.897+0000 7f07de7fc700 1 -- 172.21.15.63:0/3769024168 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f07ec005c60 con 0x7f07f00611f0 2020-05-18T21:28:45.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.897+0000 7f07f5139700 1 --2- 172.21.15.63:0/3769024168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07f00611f0 0x7f07f0158150 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f07e80014f0 tx=0x7f07ec010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.897+0000 7f07de7fc700 1 --2- 172.21.15.63:0/3769024168 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f07d004fc70 0x7f07d0052130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:45.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.897+0000 7f07de7fc700 1 -- 172.21.15.63:0/3769024168 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f07ec063c00 con 0x7f07f00611f0 2020-05-18T21:28:45.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.897+0000 7f07f4938700 1 --2- 172.21.15.63:0/3769024168 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f07d004fc70 0x7f07d0052130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:45.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.897+0000 7f07f4938700 1 --2- 172.21.15.63:0/3769024168 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f07d004fc70 0x7f07d0052130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f07e0000bc0 tx=0x7f07e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.897+0000 7f07f4938700 1 --2- 172.21.15.63:0/3769024168 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f07d004fc70 0x7f07d0052130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f07e0000bc0 tx=0x7f07e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.897+0000 7f07f4938700 1 --2- 172.21.15.63:0/3769024168 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f07d004fc70 0x7f07d0052130 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f07e0000bc0 tx=0x7f07e0007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:45.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.905+0000 7f07f5139700 1 --2- 172.21.15.63:0/3769024168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07f00611f0 0x7f07f0158150 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f07e80014f0 tx=0x7f07ec010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:45.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:45.905+0000 7f07de7fc700 1 -- 172.21.15.63:0/3769024168 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f07ec03df30 con 0x7f07f00611f0 2020-05-18T21:28:46.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.025+0000 7f07f739d700 1 -- 172.21.15.63:0/3769024168 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f07f00569e0 con 0x7f07f00611f0 2020-05-18T21:28:46.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.025+0000 7f07f5139700 1 --2- 172.21.15.63:0/3769024168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07f00611f0 0x7f07f0158150 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f07e80014f0 tx=0x7f07ec010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.025+0000 7f07de7fc700 1 -- 172.21.15.63:0/3769024168 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v45) v1 ==== 110+0+10 (secure 0 0 0) 0x7f07ec041550 con 0x7f07f00611f0 2020-05-18T21:28:46.032 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:28:46.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.029+0000 7f07f739d700 1 -- 172.21.15.63:0/3769024168 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f07d004fc70 msgr2=0x7f07d0052130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:46.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.029+0000 7f07f739d700 1 --2- 172.21.15.63:0/3769024168 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f07d004fc70 0x7f07d0052130 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f07e0000bc0 tx=0x7f07e0007a80).stop 2020-05-18T21:28:46.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.029+0000 7f07f739d700 1 -- 172.21.15.63:0/3769024168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07f00611f0 msgr2=0x7f07f0158150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:46.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.029+0000 7f07f739d700 1 --2- 172.21.15.63:0/3769024168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07f00611f0 0x7f07f0158150 secure :-1 s=READY pgs=420 cs=0 l=1 rx=0x7f07e80014f0 tx=0x7f07ec010bd0).stop 2020-05-18T21:28:46.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.029+0000 7f07f739d700 1 -- 172.21.15.63:0/3769024168 shutdown_connections 2020-05-18T21:28:46.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.029+0000 7f07f739d700 1 --2- 172.21.15.63:0/3769024168 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f07d004fc70 0x7f07d0052130 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:46.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.029+0000 7f07f739d700 1 --2- 172.21.15.63:0/3769024168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07f00611f0 0x7f07f0158150 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:46.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.029+0000 7f07f739d700 1 -- 172.21.15.63:0/3769024168 >> 172.21.15.63:0/3769024168 conn(0x7f07f00b9720 msgr2=0x7f07f005ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:46.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.029+0000 7f07f739d700 1 -- 172.21.15.63:0/3769024168 shutdown_connections 2020-05-18T21:28:46.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.029+0000 7f07f739d700 1 -- 172.21.15.63:0/3769024168 wait complete. 2020-05-18T21:28:46.048 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:28:46.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.153+0000 7fc711209700 1 Processor -- start 2020-05-18T21:28:46.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.153+0000 7fc711209700 1 -- start start 2020-05-18T21:28:46.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc711209700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc70c0b05d0 0x7fc70c0606a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:46.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc711209700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc70c0b4d60 0x7fc70c0b5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:46.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc711209700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70c061520 con 0x7fc70c05f410 2020-05-18T21:28:46.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc711209700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70c0b5670 con 0x7fc70c0b4d60 2020-05-18T21:28:46.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc711209700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0b12b0 con 0x7fc70c0b05d0 2020-05-18T21:28:46.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc710a08700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc70c0b4d60 0x7fc70c0b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:46.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc710a08700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc70c0b4d60 0x7fc70c0b5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:42130/0 (socket says 172.21.15.63:42130) 2020-05-18T21:28:46.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc70bfff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fc70c05f410 0x7fc70c060e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:56014/0 (socket says 172.21.15.63:56014) 2020-05-18T21:28:46.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc703fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc70c0b05d0 0x7fc70c0606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:46.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc710a08700 1 -- 172.21.15.63:0/1321000217 learned_addr learned my addr 172.21.15.63:0/1321000217 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:46.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc710a08700 1 -- 172.21.15.63:0/1321000217 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc70c0b05d0 msgr2=0x7fc70c0606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:46.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc710a08700 1 --2- 172.21.15.63:0/1321000217 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc70c0b05d0 0x7fc70c0606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:46.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc710a08700 1 -- 172.21.15.63:0/1321000217 >> v1:172.21.15.155:6789/0 conn(0x7fc70c05f410 legacy=0x7fc70c060e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:46.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc710a08700 1 -- 172.21.15.63:0/1321000217 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c05bcf0 con 0x7fc70c0b4d60 2020-05-18T21:28:46.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc710a08700 1 --2- 172.21.15.63:0/1321000217 >> v2:172.21.15.155:3300/0 conn(0x7fc70c0b4d60 0x7fc70c0b5210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc7040032f0 tx=0x7fc704007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc710a08700 1 --2- 172.21.15.63:0/1321000217 >> v2:172.21.15.155:3300/0 conn(0x7fc70c0b4d60 0x7fc70c0b5210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc7040032f0 tx=0x7fc704007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc710a08700 1 --2- 172.21.15.63:0/1321000217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc70c0b4d60 0x7fc70c0b5210 secure :-1 s=READY pgs=422 cs=0 l=1 rx=0x7fc7040032f0 tx=0x7fc704007e00).ready entity=mon.1 client_cookie=a0c1b19a15e1d69a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:46.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc710a08700 1 --2- 172.21.15.63:0/1321000217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc70c0b4d60 0x7fc70c0b5210 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7fc7040032f0 tx=0x7fc704007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc70b7fe700 1 -- 172.21.15.63:0/1321000217 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc704011d10 con 0x7fc70c0b4d60 2020-05-18T21:28:46.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc710a08700 1 --2- 172.21.15.63:0/1321000217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc70c0b4d60 0x7fc70c0b5210 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7fc7040032f0 tx=0x7fc704007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc710a08700 1 --2- 172.21.15.63:0/1321000217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc70c0b4d60 0x7fc70c0b5210 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7fc7040032f0 tx=0x7fc704007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc70b7fe700 1 -- 172.21.15.63:0/1321000217 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc704011e70 con 0x7fc70c0b4d60 2020-05-18T21:28:46.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc70b7fe700 1 -- 172.21.15.63:0/1321000217 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc70400a370 con 0x7fc70c0b4d60 2020-05-18T21:28:46.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc711209700 1 -- 172.21.15.63:0/1321000217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc70c0b4d60 msgr2=0x7fc70c0b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:46.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc711209700 1 --2- 172.21.15.63:0/1321000217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc70c0b4d60 0x7fc70c0b5210 secure :-1 s=READY pgs=422 cs=0 l=1 rx=0x7fc7040032f0 tx=0x7fc704007e00).stop 2020-05-18T21:28:46.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc711209700 1 -- 172.21.15.63:0/1321000217 shutdown_connections 2020-05-18T21:28:46.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc711209700 1 --2- 172.21.15.63:0/1321000217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc70c0b4d60 0x7fc70c0b5210 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:46.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc711209700 1 --2- 172.21.15.63:0/1321000217 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc70c0b05d0 0x7fc70c0606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:46.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc711209700 1 -- 172.21.15.63:0/1321000217 >> 172.21.15.63:0/1321000217 conn(0x7fc70c06a640 msgr2=0x7fc70c0b6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:46.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc711209700 1 -- 172.21.15.63:0/1321000217 shutdown_connections 2020-05-18T21:28:46.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.157+0000 7fc711209700 1 -- 172.21.15.63:0/1321000217 wait complete. 2020-05-18T21:28:46.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.161+0000 7fc711209700 1 Processor -- start 2020-05-18T21:28:46.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.161+0000 7fc711209700 1 -- start start 2020-05-18T21:28:46.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.161+0000 7fc711209700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc70c05f410 0x7fc70c149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:46.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.161+0000 7fc711209700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc70c0b4d60 0x7fc70c147da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:46.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.161+0000 7fc711209700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70c064440 con 0x7fc70c0b05d0 2020-05-18T21:28:46.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.161+0000 7fc711209700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70c065530 con 0x7fc70c0b4d60 2020-05-18T21:28:46.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.161+0000 7fc711209700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c148200 con 0x7fc70c05f410 2020-05-18T21:28:46.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.161+0000 7fc710a08700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc70c0b4d60 0x7fc70c147da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:46.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.161+0000 7fc710a08700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc70c0b4d60 0x7fc70c147da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55520/0 (socket says 172.21.15.63:55520) 2020-05-18T21:28:46.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.161+0000 7fc70bfff700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc70c05f410 0x7fc70c149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:46.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.161+0000 7fc710a08700 1 -- 172.21.15.63:0/2211780571 learned_addr learned my addr 172.21.15.63:0/2211780571 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:46.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc710a08700 1 -- 172.21.15.63:0/2211780571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc70c05f410 msgr2=0x7fc70c149470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:46.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc710a08700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc70c05f410 0x7fc70c149470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:46.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc710a08700 1 -- 172.21.15.63:0/2211780571 >> v1:172.21.15.155:6789/0 conn(0x7fc70c0b05d0 legacy=0x7fc70c064e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:46.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc710a08700 1 -- 172.21.15.63:0/2211780571 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c0646e0 con 0x7fc70c0b4d60 2020-05-18T21:28:46.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc710a08700 1 --2- 172.21.15.63:0/2211780571 >> v2:172.21.15.63:3300/0 conn(0x7fc70c0b4d60 0x7fc70c147da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc7040032f0 tx=0x7fc704007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc710a08700 1 --2- 172.21.15.63:0/2211780571 >> v2:172.21.15.63:3300/0 conn(0x7fc70c0b4d60 0x7fc70c147da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc7040032f0 tx=0x7fc704007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc710a08700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc70c0b4d60 0x7fc70c147da0 secure :-1 s=READY pgs=583 cs=0 l=1 rx=0x7fc7040032f0 tx=0x7fc704007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:46.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc710a08700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc70c0b4d60 0x7fc70c147da0 secure :-1 s=THROTTLE_DONE pgs=583 cs=0 l=1 rx=0x7fc7040032f0 tx=0x7fc704007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc709ffb700 1 -- 172.21.15.63:0/2211780571 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc704005a80 con 0x7fc70c0b4d60 2020-05-18T21:28:46.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc711209700 1 -- 172.21.15.63:0/2211780571 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70c064980 con 0x7fc70c0b4d60 2020-05-18T21:28:46.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc710a08700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc70c0b4d60 0x7fc70c147da0 secure :-1 s=THROTTLE_DONE pgs=583 cs=0 l=1 rx=0x7fc7040032f0 tx=0x7fc704007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc709ffb700 1 -- 172.21.15.63:0/2211780571 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc704005be0 con 0x7fc70c0b4d60 2020-05-18T21:28:46.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc710a08700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc70c0b4d60 0x7fc70c147da0 secure :-1 s=THROTTLE_DONE pgs=583 cs=0 l=1 rx=0x7fc7040032f0 tx=0x7fc704007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc711209700 1 -- 172.21.15.63:0/2211780571 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70c063fd0 con 0x7fc70c0b4d60 2020-05-18T21:28:46.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc709ffb700 1 -- 172.21.15.63:0/2211780571 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7040110d0 con 0x7fc70c0b4d60 2020-05-18T21:28:46.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc710a08700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc70c0b4d60 0x7fc70c147da0 secure :-1 s=THROTTLE_DONE pgs=583 cs=0 l=1 rx=0x7fc7040032f0 tx=0x7fc704007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc709ffb700 1 -- 172.21.15.63:0/2211780571 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc704011310 con 0x7fc70c0b4d60 2020-05-18T21:28:46.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc710a08700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc70c0b4d60 0x7fc70c147da0 secure :-1 s=THROTTLE_DONE pgs=583 cs=0 l=1 rx=0x7fc7040032f0 tx=0x7fc704007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc711209700 1 -- 172.21.15.63:0/2211780571 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70c064b80 con 0x7fc70c0b4d60 2020-05-18T21:28:46.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc709ffb700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc6f004f8f0 0x7fc6f0051db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:46.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc709ffb700 1 -- 172.21.15.63:0/2211780571 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc7040644b0 con 0x7fc70c0b4d60 2020-05-18T21:28:46.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.165+0000 7fc70bfff700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc6f004f8f0 0x7fc6f0051db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:46.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.169+0000 7fc70bfff700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc6f004f8f0 0x7fc6f0051db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc70c05eab0 tx=0x7fc6fc001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.169+0000 7fc70bfff700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc6f004f8f0 0x7fc6f0051db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc70c05eab0 tx=0x7fc6fc001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.169+0000 7fc70bfff700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc6f004f8f0 0x7fc6f0051db0 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7fc70c05eab0 tx=0x7fc6fc001de0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:46.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.177+0000 7fc710a08700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc70c0b4d60 0x7fc70c147da0 secure :-1 s=THROTTLE_DONE pgs=583 cs=0 l=1 rx=0x7fc7040032f0 tx=0x7fc704007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.177+0000 7fc709ffb700 1 -- 172.21.15.63:0/2211780571 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc70c064b80 con 0x7fc70c0b4d60 2020-05-18T21:28:46.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.293+0000 7fc711209700 1 -- 172.21.15.63:0/2211780571 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc70c064b80 con 0x7fc70c0b4d60 2020-05-18T21:28:46.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.297+0000 7fc710a08700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc70c0b4d60 0x7fc70c147da0 secure :-1 s=THROTTLE_DONE pgs=583 cs=0 l=1 rx=0x7fc7040032f0 tx=0x7fc704007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.297+0000 7fc709ffb700 1 -- 172.21.15.63:0/2211780571 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v45) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc70c064b80 con 0x7fc70c0b4d60 2020-05-18T21:28:46.303 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:28:46.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.297+0000 7fc711209700 1 -- 172.21.15.63:0/2211780571 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc6f004f8f0 msgr2=0x7fc6f0051db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:46.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.297+0000 7fc711209700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc6f004f8f0 0x7fc6f0051db0 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7fc70c05eab0 tx=0x7fc6fc001de0).stop 2020-05-18T21:28:46.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.297+0000 7fc711209700 1 -- 172.21.15.63:0/2211780571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc70c0b4d60 msgr2=0x7fc70c147da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:46.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.297+0000 7fc711209700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc70c0b4d60 0x7fc70c147da0 secure :-1 s=READY pgs=583 cs=0 l=1 rx=0x7fc7040032f0 tx=0x7fc704007e00).stop 2020-05-18T21:28:46.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.297+0000 7fc711209700 1 -- 172.21.15.63:0/2211780571 shutdown_connections 2020-05-18T21:28:46.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.297+0000 7fc711209700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc6f004f8f0 0x7fc6f0051db0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:46.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.297+0000 7fc711209700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc70c0b4d60 0x7fc70c147da0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:46.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.297+0000 7fc711209700 1 --2- 172.21.15.63:0/2211780571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc70c05f410 0x7fc70c149470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:46.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.297+0000 7fc711209700 1 -- 172.21.15.63:0/2211780571 >> 172.21.15.63:0/2211780571 conn(0x7fc70c06a640 msgr2=0x7fc70c05c360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:46.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.297+0000 7fc711209700 1 -- 172.21.15.63:0/2211780571 shutdown_connections 2020-05-18T21:28:46.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.297+0000 7fc711209700 1 -- 172.21.15.63:0/2211780571 wait complete. 2020-05-18T21:28:46.315 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-05-18T21:28:46.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bf21a700 1 Processor -- start 2020-05-18T21:28:46.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bf21a700 1 -- start start 2020-05-18T21:28:46.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bf21a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00b8069fb0 0x7f00b8147c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:46.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bf21a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b8148080 con 0x7f00b80b50a0 2020-05-18T21:28:46.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bf21a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b80b63d0 con 0x7f00b80b5ff0 2020-05-18T21:28:46.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bf21a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b8063a80 con 0x7f00b8069fb0 2020-05-18T21:28:46.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bda17700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f00b80b50a0 0x7f00b8063e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57712/0 (socket says 172.21.15.63:57712) 2020-05-18T21:28:46.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bda17700 1 -- 172.21.15.63:0/1280521053 learned_addr learned my addr 172.21.15.63:0/1280521053 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:46.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bea19700 1 --2- 172.21.15.63:0/1280521053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00b8069fb0 0x7f00b8147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:46.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bd216700 1 -- 172.21.15.63:0/1280521053 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128599219 0 0) 0x7f00b4001110 con 0x7f00b80b50a0 2020-05-18T21:28:46.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bd216700 1 -- 172.21.15.63:0/1280521053 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00a0003270 con 0x7f00b80b50a0 2020-05-18T21:28:46.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bd216700 1 -- 172.21.15.63:0/1280521053 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987003746 0 0) 0x7f00b80b63d0 con 0x7f00b80b5ff0 2020-05-18T21:28:46.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bd216700 1 -- 172.21.15.63:0/1280521053 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00b4001110 con 0x7f00b80b5ff0 2020-05-18T21:28:46.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bd216700 1 -- 172.21.15.63:0/1280521053 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4152995837 0 0) 0x7f00a0003270 con 0x7f00b80b50a0 2020-05-18T21:28:46.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bd216700 1 -- 172.21.15.63:0/1280521053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00b8069fb0 msgr2=0x7f00b8147c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:46.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bd216700 1 --2- 172.21.15.63:0/1280521053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00b8069fb0 0x7f00b8147c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:46.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bd216700 1 -- 172.21.15.63:0/1280521053 >> v1:172.21.15.155:6789/0 conn(0x7f00b80b5ff0 legacy=0x7f00b809df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:46.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bd216700 1 -- 172.21.15.63:0/1280521053 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b806a5e0 con 0x7f00b80b50a0 2020-05-18T21:28:46.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bd216700 1 -- 172.21.15.63:0/1280521053 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f00b40018a0 con 0x7f00b80b50a0 2020-05-18T21:28:46.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bd216700 1 -- 172.21.15.63:0/1280521053 >> v1:172.21.15.63:6789/0 conn(0x7f00b80b50a0 legacy=0x7f00b8063e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:46.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bd216700 1 --2- 172.21.15.63:0/1280521053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00a0003920 0x7f00a0003d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:46.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bd216700 1 --2- 172.21.15.63:0/1280521053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00b8069fb0 0x7f00a0004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:46.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bd216700 1 --2- 172.21.15.63:0/1280521053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00a0004970 0x7f00a0004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:46.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bd216700 1 -- 172.21.15.63:0/1280521053 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a0005250 con 0x7f00a0004970 2020-05-18T21:28:46.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bd216700 1 -- 172.21.15.63:0/1280521053 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a00053c0 con 0x7f00a0003920 2020-05-18T21:28:46.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bd216700 1 -- 172.21.15.63:0/1280521053 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a000b760 con 0x7f00b8069fb0 2020-05-18T21:28:46.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bea19700 1 --2- 172.21.15.63:0/1280521053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00a0004970 0x7f00a0004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:46.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00be218700 1 --2- 172.21.15.63:0/1280521053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00a0003920 0x7f00a0003d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:46.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bda17700 1 --2- 172.21.15.63:0/1280521053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00b8069fb0 0x7f00a0004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:46.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bea19700 1 -- 172.21.15.63:0/1280521053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00b8069fb0 msgr2=0x7f00a0004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:46.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bea19700 1 --2- 172.21.15.63:0/1280521053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00b8069fb0 0x7f00a0004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:46.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bea19700 1 -- 172.21.15.63:0/1280521053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00a0003920 msgr2=0x7f00a0003d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:46.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bea19700 1 --2- 172.21.15.63:0/1280521053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00a0003920 0x7f00a0003d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:46.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.413+0000 7f00bea19700 1 -- 172.21.15.63:0/1280521053 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a0003270 con 0x7f00a0004970 2020-05-18T21:28:46.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.417+0000 7f00bea19700 1 --2- 172.21.15.63:0/1280521053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00a0004970 0x7f00a0004df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f00b00032f0 tx=0x7f00b00103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.417+0000 7f00bea19700 1 --2- 172.21.15.63:0/1280521053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00a0004970 0x7f00a0004df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f00b00032f0 tx=0x7f00b00103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.417+0000 7f00bea19700 1 --2- 172.21.15.63:0/1280521053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00a0004970 0x7f00a0004df0 secure :-1 s=READY pgs=585 cs=0 l=1 rx=0x7f00b00032f0 tx=0x7f00b00103e0).ready entity=mon.0 client_cookie=9b15c5f0f899c0e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:46.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.417+0000 7f00bea19700 1 --2- 172.21.15.63:0/1280521053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00a0004970 0x7f00a0004df0 secure :-1 s=THROTTLE_DONE pgs=585 cs=0 l=1 rx=0x7f00b00032f0 tx=0x7f00b00103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.417+0000 7f00bea19700 1 --2- 172.21.15.63:0/1280521053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00a0004970 0x7f00a0004df0 secure :-1 s=THROTTLE_DONE pgs=585 cs=0 l=1 rx=0x7f00b00032f0 tx=0x7f00b00103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.417+0000 7f00bd216700 1 -- 172.21.15.63:0/1280521053 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00b0010e80 con 0x7f00a0004970 2020-05-18T21:28:46.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.417+0000 7f00bd216700 1 -- 172.21.15.63:0/1280521053 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b0005c70 con 0x7f00a0004970 2020-05-18T21:28:46.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.417+0000 7f00bea19700 1 --2- 172.21.15.63:0/1280521053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00a0004970 0x7f00a0004df0 secure :-1 s=THROTTLE_DONE pgs=585 cs=0 l=1 rx=0x7f00b00032f0 tx=0x7f00b00103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.417+0000 7f00bd216700 1 -- 172.21.15.63:0/1280521053 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00b0005de0 con 0x7f00a0004970 2020-05-18T21:28:46.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.417+0000 7f00bf21a700 1 -- 172.21.15.63:0/1280521053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00a0004970 msgr2=0x7f00a0004df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:46.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.417+0000 7f00bf21a700 1 --2- 172.21.15.63:0/1280521053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00a0004970 0x7f00a0004df0 secure :-1 s=READY pgs=585 cs=0 l=1 rx=0x7f00b00032f0 tx=0x7f00b00103e0).stop 2020-05-18T21:28:46.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.417+0000 7f00bea19700 1 -- 172.21.15.63:0/1280521053 reap_dead start 2020-05-18T21:28:46.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.417+0000 7f00bf21a700 1 -- 172.21.15.63:0/1280521053 shutdown_connections 2020-05-18T21:28:46.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.417+0000 7f00bf21a700 1 -- 172.21.15.63:0/1280521053 >> 172.21.15.63:0/1280521053 conn(0x7f00b805a7c0 msgr2=0x7f00b805aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:46.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.417+0000 7f00bf21a700 1 -- 172.21.15.63:0/1280521053 shutdown_connections 2020-05-18T21:28:46.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.417+0000 7f00bf21a700 1 -- 172.21.15.63:0/1280521053 wait complete. 2020-05-18T21:28:46.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.417+0000 7f00bf21a700 1 Processor -- start 2020-05-18T21:28:46.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bf21a700 1 -- start start 2020-05-18T21:28:46.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bf21a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f00b80b4090 0x7f00b80b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:46.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bf21a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f00b813f460 0x7f00b813f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:46.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bf21a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b8145690 con 0x7f00b8065570 2020-05-18T21:28:46.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bf21a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b80add60 con 0x7f00b813f460 2020-05-18T21:28:46.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bf21a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b8145930 con 0x7f00b80b4090 2020-05-18T21:28:46.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00be218700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f00b8065570 0x7f00b8146070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57724/0 (socket says 172.21.15.63:57724) 2020-05-18T21:28:46.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00be218700 1 -- 172.21.15.63:0/14429023 learned_addr learned my addr 172.21.15.63:0/14429023 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:46.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bea19700 1 --2- 172.21.15.63:0/14429023 >> v2:172.21.15.63:3300/0 conn(0x7f00b813f460 0x7f00b813f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:46.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bda17700 1 --2- 172.21.15.63:0/14429023 >> v2:172.21.15.155:3300/0 conn(0x7f00b80b4090 0x7f00b80b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:46.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bea19700 1 -- 172.21.15.63:0/14429023 >> v2:172.21.15.155:3300/0 conn(0x7f00b80b4090 msgr2=0x7f00b80b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:46.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bea19700 1 --2- 172.21.15.63:0/14429023 >> v2:172.21.15.155:3300/0 conn(0x7f00b80b4090 0x7f00b80b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:46.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bea19700 1 -- 172.21.15.63:0/14429023 >> v1:172.21.15.63:6789/0 conn(0x7f00b8065570 legacy=0x7f00b8146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:46.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bea19700 1 -- 172.21.15.63:0/14429023 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b8145bd0 con 0x7f00b813f460 2020-05-18T21:28:46.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bea19700 1 --2- 172.21.15.63:0/14429023 >> v2:172.21.15.63:3300/0 conn(0x7f00b813f460 0x7f00b813f890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f00b80af8e0 tx=0x7f00b00103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bea19700 1 --2- 172.21.15.63:0/14429023 >> v2:172.21.15.63:3300/0 conn(0x7f00b813f460 0x7f00b813f890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f00b80af8e0 tx=0x7f00b00103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bea19700 1 --2- 172.21.15.63:0/14429023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00b813f460 0x7f00b813f890 secure :-1 s=READY pgs=587 cs=0 l=1 rx=0x7f00b80af8e0 tx=0x7f00b00103e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:46.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bea19700 1 --2- 172.21.15.63:0/14429023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00b813f460 0x7f00b813f890 secure :-1 s=THROTTLE_DONE pgs=587 cs=0 l=1 rx=0x7f00b80af8e0 tx=0x7f00b00103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bea19700 1 --2- 172.21.15.63:0/14429023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00b813f460 0x7f00b813f890 secure :-1 s=THROTTLE_DONE pgs=587 cs=0 l=1 rx=0x7f00b80af8e0 tx=0x7f00b00103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bea19700 1 --2- 172.21.15.63:0/14429023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00b813f460 0x7f00b813f890 secure :-1 s=THROTTLE_DONE pgs=587 cs=0 l=1 rx=0x7f00b80af8e0 tx=0x7f00b00103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00a77fe700 1 -- 172.21.15.63:0/14429023 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00b0005a80 con 0x7f00b813f460 2020-05-18T21:28:46.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00a77fe700 1 -- 172.21.15.63:0/14429023 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b0005be0 con 0x7f00b813f460 2020-05-18T21:28:46.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bf21a700 1 -- 172.21.15.63:0/14429023 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b813fcf0 con 0x7f00b813f460 2020-05-18T21:28:46.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00a77fe700 1 -- 172.21.15.63:0/14429023 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00b000e410 con 0x7f00b813f460 2020-05-18T21:28:46.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.421+0000 7f00bf21a700 1 -- 172.21.15.63:0/14429023 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b8151320 con 0x7f00b813f460 2020-05-18T21:28:46.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.425+0000 7f00bea19700 1 --2- 172.21.15.63:0/14429023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00b813f460 0x7f00b813f890 secure :-1 s=THROTTLE_DONE pgs=587 cs=0 l=1 rx=0x7f00b80af8e0 tx=0x7f00b00103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.425+0000 7f00bf21a700 1 -- 172.21.15.63:0/14429023 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b80569e0 con 0x7f00b813f460 2020-05-18T21:28:46.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.425+0000 7f00a77fe700 1 -- 172.21.15.63:0/14429023 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f00b000e570 con 0x7f00b813f460 2020-05-18T21:28:46.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.425+0000 7f00bea19700 1 --2- 172.21.15.63:0/14429023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00b813f460 0x7f00b813f890 secure :-1 s=THROTTLE_DONE pgs=587 cs=0 l=1 rx=0x7f00b80af8e0 tx=0x7f00b00103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.425+0000 7f00a77fe700 1 --2- 172.21.15.63:0/14429023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f009804fa30 0x7f0098051ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:46.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.425+0000 7f00a77fe700 1 -- 172.21.15.63:0/14429023 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f00b0063f00 con 0x7f00b813f460 2020-05-18T21:28:46.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.425+0000 7f00be218700 1 --2- 172.21.15.63:0/14429023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f009804fa30 0x7f0098051ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:46.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.425+0000 7f00be218700 1 --2- 172.21.15.63:0/14429023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f009804fa30 0x7f0098051ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f00a8001790 tx=0x7f00a8001190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.425+0000 7f00be218700 1 --2- 172.21.15.63:0/14429023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f009804fa30 0x7f0098051ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f00a8001790 tx=0x7f00a8001190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.425+0000 7f00be218700 1 --2- 172.21.15.63:0/14429023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f009804fa30 0x7f0098051ef0 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f00a8001790 tx=0x7f00a8001190).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:46.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.429+0000 7f00bea19700 1 --2- 172.21.15.63:0/14429023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00b813f460 0x7f00b813f890 secure :-1 s=THROTTLE_DONE pgs=587 cs=0 l=1 rx=0x7f00b80af8e0 tx=0x7f00b00103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.433+0000 7f00a77fe700 1 -- 172.21.15.63:0/14429023 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f00b003e290 con 0x7f00b813f460 2020-05-18T21:28:46.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.549+0000 7f00bf21a700 1 -- 172.21.15.63:0/14429023 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f00b8066310 con 0x7f00b813f460 2020-05-18T21:28:46.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.549+0000 7f00bea19700 1 --2- 172.21.15.63:0/14429023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00b813f460 0x7f00b813f890 secure :-1 s=THROTTLE_DONE pgs=587 cs=0 l=1 rx=0x7f00b80af8e0 tx=0x7f00b00103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.549+0000 7f00a77fe700 1 -- 172.21.15.63:0/14429023 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v45) v1 ==== 84+0+143 (secure 0 0 0) 0x7f00b00418b0 con 0x7f00b813f460 2020-05-18T21:28:46.556 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:46.556 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:28:46.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:46.557 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2020-05-18T21:28:46.557 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "device_health_metrics" 2020-05-18T21:28:46.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:46.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:46.559 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 2, 2020-05-18T21:28:46.559 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "rbd" 2020-05-18T21:28:46.559 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:46.560 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:28:46.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.549+0000 7f00bf21a700 1 -- 172.21.15.63:0/14429023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f009804fa30 msgr2=0x7f0098051ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:46.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.549+0000 7f00bf21a700 1 --2- 172.21.15.63:0/14429023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f009804fa30 0x7f0098051ef0 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f00a8001790 tx=0x7f00a8001190).stop 2020-05-18T21:28:46.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.549+0000 7f00bf21a700 1 -- 172.21.15.63:0/14429023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00b813f460 msgr2=0x7f00b813f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:46.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.549+0000 7f00bf21a700 1 --2- 172.21.15.63:0/14429023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00b813f460 0x7f00b813f890 secure :-1 s=READY pgs=587 cs=0 l=1 rx=0x7f00b80af8e0 tx=0x7f00b00103e0).stop 2020-05-18T21:28:46.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.549+0000 7f00bf21a700 1 -- 172.21.15.63:0/14429023 shutdown_connections 2020-05-18T21:28:46.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.549+0000 7f00bf21a700 1 --2- 172.21.15.63:0/14429023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f009804fa30 0x7f0098051ef0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:46.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.549+0000 7f00bf21a700 1 --2- 172.21.15.63:0/14429023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00b813f460 0x7f00b813f890 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:46.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.549+0000 7f00bf21a700 1 --2- 172.21.15.63:0/14429023 >> v2:172.21.15.155:3300/0 conn(0x7f00b80b4090 0x7f00b80b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:46.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.549+0000 7f00bf21a700 1 -- 172.21.15.63:0/14429023 >> 172.21.15.63:0/14429023 conn(0x7f00b805a7c0 msgr2=0x7f00b8142ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:46.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.549+0000 7f00bf21a700 1 -- 172.21.15.63:0/14429023 shutdown_connections 2020-05-18T21:28:46.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.549+0000 7f00bf21a700 1 -- 172.21.15.63:0/14429023 wait complete. 2020-05-18T21:28:46.568 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-05-18T21:28:46.568 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-05-18T21:28:46.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.673+0000 7f33f2a96700 1 Processor -- start 2020-05-18T21:28:46.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2a96700 1 -- start start 2020-05-18T21:28:46.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2a96700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f33ec0b4f60 0x7f33ec0606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:46.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2a96700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f33ec142ed0 0x7f33ec145790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:46.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2a96700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ec0b4630 con 0x7f33ec065a10 2020-05-18T21:28:46.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2a96700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec060c50 con 0x7f33ec142ed0 2020-05-18T21:28:46.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2a96700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec060ef0 con 0x7f33ec0b4f60 2020-05-18T21:28:46.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2295700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f33ec142ed0 0x7f33ec145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:46.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f1293700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f33ec065a10 0x7f33ec1427c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57734/0 (socket says 172.21.15.63:57734) 2020-05-18T21:28:46.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f1293700 1 -- 172.21.15.63:0/988290370 learned_addr learned my addr 172.21.15.63:0/988290370 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:46.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f1a94700 1 --2- 172.21.15.63:0/988290370 >> v2:172.21.15.155:3300/0 conn(0x7f33ec0b4f60 0x7f33ec0606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:46.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2295700 1 -- 172.21.15.63:0/988290370 >> v2:172.21.15.155:3300/0 conn(0x7f33ec0b4f60 msgr2=0x7f33ec0606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:46.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2295700 1 --2- 172.21.15.63:0/988290370 >> v2:172.21.15.155:3300/0 conn(0x7f33ec0b4f60 0x7f33ec0606d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:46.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2295700 1 -- 172.21.15.63:0/988290370 >> v1:172.21.15.63:6789/0 conn(0x7f33ec065a10 legacy=0x7f33ec1427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:46.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2295700 1 -- 172.21.15.63:0/988290370 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec061190 con 0x7f33ec142ed0 2020-05-18T21:28:46.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f1a94700 1 --2- 172.21.15.63:0/988290370 >> v2:172.21.15.155:3300/0 conn(0x7f33ec0b4f60 0x7f33ec0606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:28:46.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2295700 1 --2- 172.21.15.63:0/988290370 >> v2:172.21.15.63:3300/0 conn(0x7f33ec142ed0 0x7f33ec145790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f33e40032f0 tx=0x7f33e4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2295700 1 --2- 172.21.15.63:0/988290370 >> v2:172.21.15.63:3300/0 conn(0x7f33ec142ed0 0x7f33ec145790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f33e40032f0 tx=0x7f33e4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2295700 1 --2- 172.21.15.63:0/988290370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33ec142ed0 0x7f33ec145790 secure :-1 s=READY pgs=589 cs=0 l=1 rx=0x7f33e40032f0 tx=0x7f33e4007e00).ready entity=mon.0 client_cookie=fdcf0fe8d302aad5 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:46.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2295700 1 --2- 172.21.15.63:0/988290370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33ec142ed0 0x7f33ec145790 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f33e40032f0 tx=0x7f33e4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f0a92700 1 -- 172.21.15.63:0/988290370 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33e400a180 con 0x7f33ec142ed0 2020-05-18T21:28:46.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2295700 1 --2- 172.21.15.63:0/988290370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33ec142ed0 0x7f33ec145790 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f33e40032f0 tx=0x7f33e4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2295700 1 --2- 172.21.15.63:0/988290370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33ec142ed0 0x7f33ec145790 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f33e40032f0 tx=0x7f33e4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f0a92700 1 -- 172.21.15.63:0/988290370 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e400a2e0 con 0x7f33ec142ed0 2020-05-18T21:28:46.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f0a92700 1 -- 172.21.15.63:0/988290370 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33e400a700 con 0x7f33ec142ed0 2020-05-18T21:28:46.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2a96700 1 -- 172.21.15.63:0/988290370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33ec142ed0 msgr2=0x7f33ec145790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:46.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2a96700 1 --2- 172.21.15.63:0/988290370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33ec142ed0 0x7f33ec145790 secure :-1 s=READY pgs=589 cs=0 l=1 rx=0x7f33e40032f0 tx=0x7f33e4007e00).stop 2020-05-18T21:28:46.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2a96700 1 -- 172.21.15.63:0/988290370 shutdown_connections 2020-05-18T21:28:46.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2a96700 1 --2- 172.21.15.63:0/988290370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33ec142ed0 0x7f33ec145790 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:46.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2a96700 1 --2- 172.21.15.63:0/988290370 >> v2:172.21.15.155:3300/0 conn(0x7f33ec0b4f60 0x7f33ec0606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:46.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2a96700 1 -- 172.21.15.63:0/988290370 >> 172.21.15.63:0/988290370 conn(0x7f33ec05fbd0 msgr2=0x7f33ec069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:46.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2a96700 1 -- 172.21.15.63:0/988290370 shutdown_connections 2020-05-18T21:28:46.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.677+0000 7f33f2a96700 1 -- 172.21.15.63:0/988290370 wait complete. 2020-05-18T21:28:46.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33f2a96700 1 Processor -- start 2020-05-18T21:28:46.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33f2a96700 1 -- start start 2020-05-18T21:28:46.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33f2a96700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f33ec142ed0 0x7f33ec134360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:46.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33f2a96700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ec155cc0 con 0x7f33ec065a10 2020-05-18T21:28:46.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33f2a96700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ec13bd10 con 0x7f33ec0b4f60 2020-05-18T21:28:46.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33f2a96700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec13bfb0 con 0x7f33ec142ed0 2020-05-18T21:28:46.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33f1a94700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f33ec065a10 0x7f33ec154ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57738/0 (socket says 172.21.15.63:57738) 2020-05-18T21:28:46.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33f1a94700 1 -- 172.21.15.63:0/3582157321 learned_addr learned my addr 172.21.15.63:0/3582157321 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:46.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33f2295700 1 --2- 172.21.15.63:0/3582157321 >> v2:172.21.15.63:3300/0 conn(0x7f33ec142ed0 0x7f33ec134360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:46.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33daffd700 1 -- 172.21.15.63:0/3582157321 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940689206 0 0) 0x7f33ec155cc0 con 0x7f33ec065a10 2020-05-18T21:28:46.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33daffd700 1 -- 172.21.15.63:0/3582157321 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33cc002fe0 con 0x7f33ec065a10 2020-05-18T21:28:46.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33daffd700 1 -- 172.21.15.63:0/3582157321 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417005191 0 0) 0x7f33ec13bd10 con 0x7f33ec0b4f60 2020-05-18T21:28:46.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33daffd700 1 -- 172.21.15.63:0/3582157321 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33ec155cc0 con 0x7f33ec0b4f60 2020-05-18T21:28:46.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33f2295700 1 -- 172.21.15.63:0/3582157321 >> v1:172.21.15.155:6789/0 conn(0x7f33ec0b4f60 legacy=0x7f33ec1555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:46.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33f2295700 1 -- 172.21.15.63:0/3582157321 >> v1:172.21.15.63:6789/0 conn(0x7f33ec065a10 legacy=0x7f33ec154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:46.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33daffd700 1 -- 172.21.15.63:0/3582157321 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4051929874 0 0) 0x7f33cc002fe0 con 0x7f33ec065a10 2020-05-18T21:28:46.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33f2295700 1 -- 172.21.15.63:0/3582157321 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec13c250 con 0x7f33ec142ed0 2020-05-18T21:28:46.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33f2295700 1 --2- 172.21.15.63:0/3582157321 >> v2:172.21.15.63:3300/0 conn(0x7f33ec142ed0 0x7f33ec134360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f33dc001020 tx=0x7f33e4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33f2295700 1 --2- 172.21.15.63:0/3582157321 >> v2:172.21.15.63:3300/0 conn(0x7f33ec142ed0 0x7f33ec134360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f33dc001020 tx=0x7f33e4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.681+0000 7f33f2295700 1 --2- 172.21.15.63:0/3582157321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33ec142ed0 0x7f33ec134360 secure :-1 s=READY pgs=591 cs=0 l=1 rx=0x7f33dc001020 tx=0x7f33e4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:46.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.685+0000 7f33f2295700 1 --2- 172.21.15.63:0/3582157321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33ec142ed0 0x7f33ec134360 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7f33dc001020 tx=0x7f33e4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.685+0000 7f33daffd700 1 -- 172.21.15.63:0/3582157321 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33e40105c0 con 0x7f33ec142ed0 2020-05-18T21:28:46.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.685+0000 7f33f2295700 1 --2- 172.21.15.63:0/3582157321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33ec142ed0 0x7f33ec134360 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7f33dc001020 tx=0x7f33e4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.685+0000 7f33f2295700 1 --2- 172.21.15.63:0/3582157321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33ec142ed0 0x7f33ec134360 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7f33dc001020 tx=0x7f33e4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.685+0000 7f33daffd700 1 -- 172.21.15.63:0/3582157321 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e400f590 con 0x7f33ec142ed0 2020-05-18T21:28:46.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.685+0000 7f33f2a96700 1 -- 172.21.15.63:0/3582157321 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ec13ca90 con 0x7f33ec142ed0 2020-05-18T21:28:46.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.685+0000 7f33daffd700 1 -- 172.21.15.63:0/3582157321 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33e400f930 con 0x7f33ec142ed0 2020-05-18T21:28:46.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.685+0000 7f33f2a96700 1 -- 172.21.15.63:0/3582157321 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ec1410e0 con 0x7f33ec142ed0 2020-05-18T21:28:46.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.685+0000 7f33f2295700 1 --2- 172.21.15.63:0/3582157321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33ec142ed0 0x7f33ec134360 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7f33dc001020 tx=0x7f33e4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.685+0000 7f33f2a96700 1 -- 172.21.15.63:0/3582157321 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ec130c10 con 0x7f33ec142ed0 2020-05-18T21:28:46.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.685+0000 7f33daffd700 1 -- 172.21.15.63:0/3582157321 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f33e4005a80 con 0x7f33ec142ed0 2020-05-18T21:28:46.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.685+0000 7f33f2295700 1 --2- 172.21.15.63:0/3582157321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33ec142ed0 0x7f33ec134360 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7f33dc001020 tx=0x7f33e4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.685+0000 7f33daffd700 1 --2- 172.21.15.63:0/3582157321 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f33cc04fe80 0x7f33cc052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:46.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.685+0000 7f33daffd700 1 -- 172.21.15.63:0/3582157321 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f33e4064c80 con 0x7f33ec142ed0 2020-05-18T21:28:46.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.685+0000 7f33f1a94700 1 --2- 172.21.15.63:0/3582157321 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f33cc04fe80 0x7f33cc052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:46.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.689+0000 7f33f1a94700 1 --2- 172.21.15.63:0/3582157321 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f33cc04fe80 0x7f33cc052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f33e8007a80 tx=0x7f33e8002690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.689+0000 7f33f1a94700 1 --2- 172.21.15.63:0/3582157321 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f33cc04fe80 0x7f33cc052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f33e8007a80 tx=0x7f33e8002690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.689+0000 7f33f1a94700 1 --2- 172.21.15.63:0/3582157321 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f33cc04fe80 0x7f33cc052340 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7f33e8007a80 tx=0x7f33e8002690).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:46.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.693+0000 7f33f2295700 1 --2- 172.21.15.63:0/3582157321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33ec142ed0 0x7f33ec134360 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7f33dc001020 tx=0x7f33e4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:46.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.693+0000 7f33daffd700 1 -- 172.21.15.63:0/3582157321 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f33e403f010 con 0x7f33ec142ed0 2020-05-18T21:28:46.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:46.809+0000 7f33f2a96700 1 -- 172.21.15.63:0/3582157321 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f33ec0569e0 con 0x7f33ec142ed0 2020-05-18T21:28:47.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.197+0000 7f33f2295700 1 --2- 172.21.15.63:0/3582157321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33ec142ed0 0x7f33ec134360 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7f33dc001020 tx=0x7f33e4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:47.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.197+0000 7f33daffd700 1 -- 172.21.15.63:0/3582157321 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v46) v1 ==== 133+0+0 (secure 0 0 0) 0x7f33e4042630 con 0x7f33ec142ed0 2020-05-18T21:28:47.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.201+0000 7f33f2a96700 1 -- 172.21.15.63:0/3582157321 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f33cc04fe80 msgr2=0x7f33cc052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:47.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.201+0000 7f33f2a96700 1 --2- 172.21.15.63:0/3582157321 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f33cc04fe80 0x7f33cc052340 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7f33e8007a80 tx=0x7f33e8002690).stop 2020-05-18T21:28:47.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.201+0000 7f33f2a96700 1 -- 172.21.15.63:0/3582157321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33ec142ed0 msgr2=0x7f33ec134360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:47.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.201+0000 7f33f2a96700 1 --2- 172.21.15.63:0/3582157321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33ec142ed0 0x7f33ec134360 secure :-1 s=READY pgs=591 cs=0 l=1 rx=0x7f33dc001020 tx=0x7f33e4007e00).stop 2020-05-18T21:28:47.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.201+0000 7f33f2a96700 1 -- 172.21.15.63:0/3582157321 shutdown_connections 2020-05-18T21:28:47.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.201+0000 7f33f2a96700 1 --2- 172.21.15.63:0/3582157321 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f33cc04fe80 0x7f33cc052340 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:47.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.201+0000 7f33f2a96700 1 --2- 172.21.15.63:0/3582157321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33ec142ed0 0x7f33ec134360 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:47.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.201+0000 7f33f2a96700 1 -- 172.21.15.63:0/3582157321 >> 172.21.15.63:0/3582157321 conn(0x7f33ec05fbd0 msgr2=0x7f33ec144280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:47.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.201+0000 7f33f2a96700 1 -- 172.21.15.63:0/3582157321 shutdown_connections 2020-05-18T21:28:47.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.205+0000 7f33f2a96700 1 -- 172.21.15.63:0/3582157321 wait complete. 2020-05-18T21:28:47.210 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2020-05-18T21:28:47.223 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-05-18T21:28:47.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc7fff700 1 Processor -- start 2020-05-18T21:28:47.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc7fff700 1 -- start start 2020-05-18T21:28:47.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7fc8149d50 0x7f7fc806a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:47.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7fc80b4450 0x7f7fc80b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:47.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc7fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc80b3790 con 0x7f7fc80ad3f0 2020-05-18T21:28:47.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc7fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc80b39f0 con 0x7f7fc8149d50 2020-05-18T21:28:47.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc7fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc80b3c90 con 0x7f7fc80b4450 2020-05-18T21:28:47.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc6ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7fc8149d50 0x7f7fc806a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:47.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc6ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7fc8149d50 0x7f7fc806a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55558/0 (socket says 172.21.15.63:55558) 2020-05-18T21:28:47.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc6ffd700 1 -- 172.21.15.63:0/2010775701 learned_addr learned my addr 172.21.15.63:0/2010775701 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:47.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc77fe700 1 --2- 172.21.15.63:0/2010775701 >> v2:172.21.15.155:3300/0 conn(0x7f7fc80b4450 0x7f7fc80b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:47.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc6ffd700 1 -- 172.21.15.63:0/2010775701 >> v2:172.21.15.155:3300/0 conn(0x7f7fc80b4450 msgr2=0x7f7fc80b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:47.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc6ffd700 1 --2- 172.21.15.63:0/2010775701 >> v2:172.21.15.155:3300/0 conn(0x7f7fc80b4450 0x7f7fc80b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:47.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc6ffd700 1 -- 172.21.15.63:0/2010775701 >> v1:172.21.15.155:6789/0 conn(0x7f7fc80ad3f0 legacy=0x7f7fc80ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:47.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc6ffd700 1 -- 172.21.15.63:0/2010775701 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc80adf70 con 0x7f7fc8149d50 2020-05-18T21:28:47.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc6ffd700 1 --2- 172.21.15.63:0/2010775701 >> v2:172.21.15.63:3300/0 conn(0x7f7fc8149d50 0x7f7fc806a630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7fb8002f70 tx=0x7f7fb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:47.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc6ffd700 1 --2- 172.21.15.63:0/2010775701 >> v2:172.21.15.63:3300/0 conn(0x7f7fc8149d50 0x7f7fc806a630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7fb8002f70 tx=0x7f7fb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:47.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc6ffd700 1 --2- 172.21.15.63:0/2010775701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fc8149d50 0x7f7fc806a630 secure :-1 s=READY pgs=592 cs=0 l=1 rx=0x7f7fb8002f70 tx=0x7f7fb8007a80).ready entity=mon.0 client_cookie=68592255c657607e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:47.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc6ffd700 1 --2- 172.21.15.63:0/2010775701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fc8149d50 0x7f7fc806a630 secure :-1 s=THROTTLE_DONE pgs=592 cs=0 l=1 rx=0x7f7fb8002f70 tx=0x7f7fb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:47.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc6ffd700 1 --2- 172.21.15.63:0/2010775701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fc8149d50 0x7f7fc806a630 secure :-1 s=THROTTLE_DONE pgs=592 cs=0 l=1 rx=0x7f7fb8002f70 tx=0x7f7fb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:47.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc6ffd700 1 --2- 172.21.15.63:0/2010775701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fc8149d50 0x7f7fc806a630 secure :-1 s=THROTTLE_DONE pgs=592 cs=0 l=1 rx=0x7f7fb8002f70 tx=0x7f7fb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:47.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc5ffb700 1 -- 172.21.15.63:0/2010775701 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fb8008e50 con 0x7f7fc8149d50 2020-05-18T21:28:47.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc5ffb700 1 -- 172.21.15.63:0/2010775701 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb8010750 con 0x7f7fc8149d50 2020-05-18T21:28:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc5ffb700 1 -- 172.21.15.63:0/2010775701 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fb8010b70 con 0x7f7fc8149d50 2020-05-18T21:28:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc7fff700 1 -- 172.21.15.63:0/2010775701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fc8149d50 msgr2=0x7f7fc806a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.329+0000 7f7fc7fff700 1 --2- 172.21.15.63:0/2010775701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fc8149d50 0x7f7fc806a630 secure :-1 s=READY pgs=592 cs=0 l=1 rx=0x7f7fb8002f70 tx=0x7f7fb8007a80).stop 2020-05-18T21:28:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.333+0000 7f7fc7fff700 1 -- 172.21.15.63:0/2010775701 shutdown_connections 2020-05-18T21:28:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.333+0000 7f7fc7fff700 1 --2- 172.21.15.63:0/2010775701 >> v2:172.21.15.155:3300/0 conn(0x7f7fc80b4450 0x7f7fc80b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.333+0000 7f7fc7fff700 1 --2- 172.21.15.63:0/2010775701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fc8149d50 0x7f7fc806a630 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:47.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.333+0000 7f7fc7fff700 1 -- 172.21.15.63:0/2010775701 >> 172.21.15.63:0/2010775701 conn(0x7f7fc805fb90 msgr2=0x7f7fc8069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:47.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.333+0000 7f7fc7fff700 1 -- 172.21.15.63:0/2010775701 shutdown_connections 2020-05-18T21:28:47.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.333+0000 7f7fc7fff700 1 -- 172.21.15.63:0/2010775701 wait complete. 2020-05-18T21:28:47.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.333+0000 7f7fc7fff700 1 Processor -- start 2020-05-18T21:28:47.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.333+0000 7f7fc7fff700 1 -- start start 2020-05-18T21:28:47.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.333+0000 7f7fc7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7fc80ad3f0 0x7f7fc8064e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:47.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.333+0000 7f7fc7fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fc8149d50 0x7f7fc80b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:47.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.333+0000 7f7fc7fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc80b13d0 con 0x7f7fc80b4450 2020-05-18T21:28:47.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.333+0000 7f7fc7fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc814b3c0 con 0x7f7fc80ad3f0 2020-05-18T21:28:47.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.333+0000 7f7fc7fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc814b660 con 0x7f7fc8149d50 2020-05-18T21:28:47.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.333+0000 7f7fc67fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7fc80b4450 0x7f7fc814bda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57754/0 (socket says 172.21.15.63:57754) 2020-05-18T21:28:47.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.333+0000 7f7fc67fc700 1 -- 172.21.15.63:0/1846826438 learned_addr learned my addr 172.21.15.63:0/1846826438 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:47.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.333+0000 7f7fc6ffd700 1 --2- 172.21.15.63:0/1846826438 >> v2:172.21.15.155:3300/0 conn(0x7f7fc80ad3f0 0x7f7fc8064e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:47.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.333+0000 7f7fc77fe700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fc8149d50 0x7f7fc80b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:47.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fc6ffd700 1 -- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fc8149d50 msgr2=0x7f7fc80b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:47.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fc6ffd700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fc8149d50 0x7f7fc80b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:47.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fc6ffd700 1 -- 172.21.15.63:0/1846826438 >> v1:172.21.15.63:6789/0 conn(0x7f7fc80b4450 legacy=0x7f7fc814bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:47.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fc6ffd700 1 -- 172.21.15.63:0/1846826438 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc814b900 con 0x7f7fc80ad3f0 2020-05-18T21:28:47.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fc6ffd700 1 --2- 172.21.15.63:0/1846826438 >> v2:172.21.15.155:3300/0 conn(0x7f7fc80ad3f0 0x7f7fc8064e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7fb8002f70 tx=0x7f7fb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:47.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fc77fe700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fc8149d50 0x7f7fc80b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:47.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fc6ffd700 1 --2- 172.21.15.63:0/1846826438 >> v2:172.21.15.155:3300/0 conn(0x7f7fc80ad3f0 0x7f7fc8064e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7fb8002f70 tx=0x7f7fb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:47.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fc6ffd700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fc80ad3f0 0x7f7fc8064e60 secure :-1 s=READY pgs=427 cs=0 l=1 rx=0x7f7fb8002f70 tx=0x7f7fb8007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:47.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fc6ffd700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fc80ad3f0 0x7f7fc8064e60 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7f7fb8002f70 tx=0x7f7fb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:47.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fbffff700 1 -- 172.21.15.63:0/1846826438 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fb8010270 con 0x7f7fc80ad3f0 2020-05-18T21:28:47.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fc6ffd700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fc80ad3f0 0x7f7fc8064e60 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7f7fb8002f70 tx=0x7f7fb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:47.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fc6ffd700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fc80ad3f0 0x7f7fc8064e60 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7f7fb8002f70 tx=0x7f7fb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:47.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fbffff700 1 -- 172.21.15.63:0/1846826438 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb800f6c0 con 0x7f7fc80ad3f0 2020-05-18T21:28:47.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fc7fff700 1 -- 172.21.15.63:0/1846826438 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc815bcf0 con 0x7f7fc80ad3f0 2020-05-18T21:28:47.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fbffff700 1 -- 172.21.15.63:0/1846826438 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fb8007180 con 0x7f7fc80ad3f0 2020-05-18T21:28:47.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fc7fff700 1 -- 172.21.15.63:0/1846826438 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc815c1a0 con 0x7f7fc80ad3f0 2020-05-18T21:28:47.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fc6ffd700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fc80ad3f0 0x7f7fc8064e60 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7f7fb8002f70 tx=0x7f7fb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:47.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fc7fff700 1 -- 172.21.15.63:0/1846826438 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc80569e0 con 0x7f7fc80ad3f0 2020-05-18T21:28:47.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fbffff700 1 -- 172.21.15.63:0/1846826438 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7fb80073b0 con 0x7f7fc80ad3f0 2020-05-18T21:28:47.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fc6ffd700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fc80ad3f0 0x7f7fc8064e60 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7f7fb8002f70 tx=0x7f7fb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:47.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.337+0000 7f7fbffff700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fac04fb30 0x7f7fac051ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:47.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.341+0000 7f7fbffff700 1 -- 172.21.15.63:0/1846826438 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f7fb8063a70 con 0x7f7fc80ad3f0 2020-05-18T21:28:47.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.341+0000 7f7fc67fc700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fac04fb30 0x7f7fac051ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:47.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.341+0000 7f7fc67fc700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fac04fb30 0x7f7fac051ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7fc80b1a20 tx=0x7f7fb00015e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:47.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.341+0000 7f7fc67fc700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fac04fb30 0x7f7fac051ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7fc80b1a20 tx=0x7f7fb00015e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:47.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.341+0000 7f7fc67fc700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fac04fb30 0x7f7fac051ff0 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f7fc80b1a20 tx=0x7f7fb00015e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:47.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.349+0000 7f7fc6ffd700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fc80ad3f0 0x7f7fc8064e60 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7f7fb8002f70 tx=0x7f7fb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:47.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.349+0000 7f7fbffff700 1 -- 172.21.15.63:0/1846826438 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f7fb803de60 con 0x7f7fc80ad3f0 2020-05-18T21:28:47.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:47.469+0000 7f7fc7fff700 1 -- 172.21.15.63:0/1846826438 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f7fc805c940 con 0x7f7fc80ad3f0 2020-05-18T21:28:48.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.205+0000 7f7fc6ffd700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fc80ad3f0 0x7f7fc8064e60 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7f7fb8002f70 tx=0x7f7fb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.205+0000 7f7fbffff700 1 -- 172.21.15.63:0/1846826438 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7fb80150f0 con 0x7f7fc80ad3f0 2020-05-18T21:28:48.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.213+0000 7f7fc7fff700 1 -- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fac04fb30 msgr2=0x7f7fac051ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:48.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.213+0000 7f7fc7fff700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fac04fb30 0x7f7fac051ff0 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f7fc80b1a20 tx=0x7f7fb00015e0).stop 2020-05-18T21:28:48.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.213+0000 7f7fc7fff700 1 -- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fc80ad3f0 msgr2=0x7f7fc8064e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:48.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.213+0000 7f7fc7fff700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fc80ad3f0 0x7f7fc8064e60 secure :-1 s=READY pgs=427 cs=0 l=1 rx=0x7f7fb8002f70 tx=0x7f7fb8007a80).stop 2020-05-18T21:28:48.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.213+0000 7f7fc7fff700 1 -- 172.21.15.63:0/1846826438 shutdown_connections 2020-05-18T21:28:48.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.213+0000 7f7fc7fff700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7fac04fb30 0x7f7fac051ff0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:48.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.213+0000 7f7fc7fff700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fc8149d50 0x7f7fc80b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:48.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.213+0000 7f7fc7fff700 1 --2- 172.21.15.63:0/1846826438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fc80ad3f0 0x7f7fc8064e60 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:48.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.213+0000 7f7fc7fff700 1 -- 172.21.15.63:0/1846826438 >> 172.21.15.63:0/1846826438 conn(0x7f7fc805fb90 msgr2=0x7f7fc80b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:48.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.213+0000 7f7fc7fff700 1 -- 172.21.15.63:0/1846826438 shutdown_connections 2020-05-18T21:28:48.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.213+0000 7f7fc7fff700 1 -- 172.21.15.63:0/1846826438 wait complete. 2020-05-18T21:28:48.220 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2020-05-18T21:28:48.231 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-05-18T21:28:48.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.333+0000 7f3d4bfff700 1 Processor -- start 2020-05-18T21:28:48.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.333+0000 7f3d4bfff700 1 -- start start 2020-05-18T21:28:48.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.333+0000 7f3d4bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d4c06a630 0x7f3d4c0adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:48.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.333+0000 7f3d4bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3d4c0b4450 0x7f3d4c0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:48.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.333+0000 7f3d4bfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4c0b3790 con 0x7f3d4c149d50 2020-05-18T21:28:48.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.333+0000 7f3d4bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4c0b3f30 con 0x7f3d4c0b4450 2020-05-18T21:28:48.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.333+0000 7f3d4bfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0b39f0 con 0x7f3d4c06a630 2020-05-18T21:28:48.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.333+0000 7f3d4affd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f3d4c149d50 0x7f3d4c0ad3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:56076/0 (socket says 172.21.15.63:56076) 2020-05-18T21:28:48.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.333+0000 7f3d4a7fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d4c06a630 0x7f3d4c0adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:48.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.333+0000 7f3d4affd700 1 -- 172.21.15.63:0/1574568047 learned_addr learned my addr 172.21.15.63:0/1574568047 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:48.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.333+0000 7f3d4b7fe700 1 --2- 172.21.15.63:0/1574568047 >> v2:172.21.15.63:3300/0 conn(0x7f3d4c0b4450 0x7f3d4c0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:48.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.337+0000 7f3d4b7fe700 1 -- 172.21.15.63:0/1574568047 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d4c06a630 msgr2=0x7f3d4c0adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:48.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.337+0000 7f3d4b7fe700 1 --2- 172.21.15.63:0/1574568047 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d4c06a630 0x7f3d4c0adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:48.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.337+0000 7f3d4b7fe700 1 -- 172.21.15.63:0/1574568047 >> v1:172.21.15.155:6789/0 conn(0x7f3d4c149d50 legacy=0x7f3d4c0ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:48.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.337+0000 7f3d4b7fe700 1 -- 172.21.15.63:0/1574568047 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c0b3c90 con 0x7f3d4c0b4450 2020-05-18T21:28:48.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.337+0000 7f3d4a7fc700 1 --2- 172.21.15.63:0/1574568047 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d4c06a630 0x7f3d4c0adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:48.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.337+0000 7f3d4b7fe700 1 --2- 172.21.15.63:0/1574568047 >> v2:172.21.15.63:3300/0 conn(0x7f3d4c0b4450 0x7f3d4c0b48e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3d440032f0 tx=0x7f3d44007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.337+0000 7f3d4b7fe700 1 --2- 172.21.15.63:0/1574568047 >> v2:172.21.15.63:3300/0 conn(0x7f3d4c0b4450 0x7f3d4c0b48e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3d440032f0 tx=0x7f3d44007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.337+0000 7f3d4b7fe700 1 --2- 172.21.15.63:0/1574568047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d4c0b4450 0x7f3d4c0b48e0 secure :-1 s=READY pgs=594 cs=0 l=1 rx=0x7f3d440032f0 tx=0x7f3d44007e00).ready entity=mon.0 client_cookie=67f5b035c63202d8 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:48.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.341+0000 7f3d4b7fe700 1 --2- 172.21.15.63:0/1574568047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d4c0b4450 0x7f3d4c0b48e0 secure :-1 s=THROTTLE_DONE pgs=594 cs=0 l=1 rx=0x7f3d440032f0 tx=0x7f3d44007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.341+0000 7f3d49ffb700 1 -- 172.21.15.63:0/1574568047 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d44010df0 con 0x7f3d4c0b4450 2020-05-18T21:28:48.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.341+0000 7f3d4b7fe700 1 --2- 172.21.15.63:0/1574568047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d4c0b4450 0x7f3d4c0b48e0 secure :-1 s=THROTTLE_DONE pgs=594 cs=0 l=1 rx=0x7f3d440032f0 tx=0x7f3d44007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.341+0000 7f3d49ffb700 1 -- 172.21.15.63:0/1574568047 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d440110d0 con 0x7f3d4c0b4450 2020-05-18T21:28:48.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.341+0000 7f3d4b7fe700 1 --2- 172.21.15.63:0/1574568047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d4c0b4450 0x7f3d4c0b48e0 secure :-1 s=THROTTLE_DONE pgs=594 cs=0 l=1 rx=0x7f3d440032f0 tx=0x7f3d44007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.341+0000 7f3d4bfff700 1 -- 172.21.15.63:0/1574568047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d4c0b4450 msgr2=0x7f3d4c0b48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:48.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.341+0000 7f3d49ffb700 1 -- 172.21.15.63:0/1574568047 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d440114f0 con 0x7f3d4c0b4450 2020-05-18T21:28:48.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.341+0000 7f3d4bfff700 1 --2- 172.21.15.63:0/1574568047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d4c0b4450 0x7f3d4c0b48e0 secure :-1 s=READY pgs=594 cs=0 l=1 rx=0x7f3d440032f0 tx=0x7f3d44007e00).stop 2020-05-18T21:28:48.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.341+0000 7f3d4bfff700 1 -- 172.21.15.63:0/1574568047 shutdown_connections 2020-05-18T21:28:48.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.341+0000 7f3d4bfff700 1 --2- 172.21.15.63:0/1574568047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d4c0b4450 0x7f3d4c0b48e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:48.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.341+0000 7f3d4bfff700 1 --2- 172.21.15.63:0/1574568047 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d4c06a630 0x7f3d4c0adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:48.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.341+0000 7f3d4bfff700 1 -- 172.21.15.63:0/1574568047 >> 172.21.15.63:0/1574568047 conn(0x7f3d4c05fb90 msgr2=0x7f3d4c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:48.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.341+0000 7f3d4bfff700 1 -- 172.21.15.63:0/1574568047 shutdown_connections 2020-05-18T21:28:48.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.341+0000 7f3d4bfff700 1 -- 172.21.15.63:0/1574568047 wait complete. 2020-05-18T21:28:48.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4bfff700 1 Processor -- start 2020-05-18T21:28:48.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4bfff700 1 -- start start 2020-05-18T21:28:48.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3d4c06a630 0x7f3d4c14f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:48.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3d4c0b4450 0x7f3d4c146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:48.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d4c149d50 0x7f3d4c14c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:48.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4c157ca0 con 0x7f3d4c06a630 2020-05-18T21:28:48.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4c157ee0 con 0x7f3d4c0b4450 2020-05-18T21:28:48.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4bfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0b1b90 con 0x7f3d4c149d50 2020-05-18T21:28:48.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3d4c06a630 0x7f3d4c14f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:48.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3d4c06a630 0x7f3d4c14f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55578/0 (socket says 172.21.15.63:55578) 2020-05-18T21:28:48.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4affd700 1 -- 172.21.15.63:0/2490610043 learned_addr learned my addr 172.21.15.63:0/2490610043 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:48.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4b7fe700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d4c149d50 0x7f3d4c14c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:48.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4a7fc700 1 --2- 172.21.15.63:0/2490610043 >> v2:172.21.15.155:3300/0 conn(0x7f3d4c0b4450 0x7f3d4c146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:48.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4affd700 1 -- 172.21.15.63:0/2490610043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d4c149d50 msgr2=0x7f3d4c14c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:48.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4affd700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d4c149d50 0x7f3d4c14c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:48.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4affd700 1 -- 172.21.15.63:0/2490610043 >> v2:172.21.15.155:3300/0 conn(0x7f3d4c0b4450 msgr2=0x7f3d4c146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:48.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4affd700 1 --2- 172.21.15.63:0/2490610043 >> v2:172.21.15.155:3300/0 conn(0x7f3d4c0b4450 0x7f3d4c146ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:48.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4affd700 1 -- 172.21.15.63:0/2490610043 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c14deb0 con 0x7f3d4c06a630 2020-05-18T21:28:48.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4affd700 1 --2- 172.21.15.63:0/2490610043 >> v2:172.21.15.63:3300/0 conn(0x7f3d4c06a630 0x7f3d4c14f400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3d4c05c1f0 tx=0x7f3d40010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4affd700 1 --2- 172.21.15.63:0/2490610043 >> v2:172.21.15.63:3300/0 conn(0x7f3d4c06a630 0x7f3d4c14f400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3d4c05c1f0 tx=0x7f3d40010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4affd700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d4c06a630 0x7f3d4c14f400 secure :-1 s=READY pgs=595 cs=0 l=1 rx=0x7f3d4c05c1f0 tx=0x7f3d40010940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:48.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4affd700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d4c06a630 0x7f3d4c14f400 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7f3d4c05c1f0 tx=0x7f3d40010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4affd700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d4c06a630 0x7f3d4c14f400 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7f3d4c05c1f0 tx=0x7f3d40010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4affd700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d4c06a630 0x7f3d4c14f400 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7f3d4c05c1f0 tx=0x7f3d40010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d3bfff700 1 -- 172.21.15.63:0/2490610043 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d40005ce0 con 0x7f3d4c06a630 2020-05-18T21:28:48.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d3bfff700 1 -- 172.21.15.63:0/2490610043 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d40005e40 con 0x7f3d4c06a630 2020-05-18T21:28:48.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4bfff700 1 -- 172.21.15.63:0/2490610043 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4c0b1680 con 0x7f3d4c06a630 2020-05-18T21:28:48.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d3bfff700 1 -- 172.21.15.63:0/2490610043 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d400062c0 con 0x7f3d4c06a630 2020-05-18T21:28:48.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4bfff700 1 -- 172.21.15.63:0/2490610043 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4c14cbe0 con 0x7f3d4c06a630 2020-05-18T21:28:48.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4affd700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d4c06a630 0x7f3d4c14f400 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7f3d4c05c1f0 tx=0x7f3d40010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.345+0000 7f3d4bfff700 1 -- 172.21.15.63:0/2490610043 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2c003380 con 0x7f3d4c06a630 2020-05-18T21:28:48.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.349+0000 7f3d3bfff700 1 -- 172.21.15.63:0/2490610043 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3d40006530 con 0x7f3d4c06a630 2020-05-18T21:28:48.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.349+0000 7f3d4affd700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d4c06a630 0x7f3d4c14f400 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7f3d4c05c1f0 tx=0x7f3d40010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.349+0000 7f3d3bfff700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3d2804fa30 0x7f3d28051ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:48.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.349+0000 7f3d3bfff700 1 -- 172.21.15.63:0/2490610043 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f3d400090c0 con 0x7f3d4c06a630 2020-05-18T21:28:48.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.349+0000 7f3d4a7fc700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3d2804fa30 0x7f3d28051ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:48.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.349+0000 7f3d4a7fc700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3d2804fa30 0x7f3d28051ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3d3c002f70 tx=0x7f3d3c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.349+0000 7f3d4a7fc700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3d2804fa30 0x7f3d28051ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3d3c002f70 tx=0x7f3d3c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.349+0000 7f3d4a7fc700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3d2804fa30 0x7f3d28051ef0 secure :-1 s=READY pgs=238 cs=0 l=1 rx=0x7f3d3c002f70 tx=0x7f3d3c00f570).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:48.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.353+0000 7f3d4affd700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d4c06a630 0x7f3d4c14f400 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7f3d4c05c1f0 tx=0x7f3d40010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.353+0000 7f3d3bfff700 1 -- 172.21.15.63:0/2490610043 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3d4003e010 con 0x7f3d4c06a630 2020-05-18T21:28:48.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.501+0000 7f3d4bfff700 1 -- 172.21.15.63:0/2490610043 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f3d2c0022a0 con 0x7f3d4c06a630 2020-05-18T21:28:48.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.505+0000 7f3d4affd700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d4c06a630 0x7f3d4c14f400 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7f3d4c05c1f0 tx=0x7f3d40010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.509+0000 7f3d3bfff700 1 -- 172.21.15.63:0/2490610043 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 9 and data pool 10 v20) v1 ==== 188+0+0 (secure 0 0 0) 0x7f3d40041630 con 0x7f3d4c06a630 2020-05-18T21:28:48.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.513+0000 7f3d4bfff700 1 -- 172.21.15.63:0/2490610043 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3d2804fa30 msgr2=0x7f3d28051ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:48.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.513+0000 7f3d4bfff700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3d2804fa30 0x7f3d28051ef0 secure :-1 s=READY pgs=238 cs=0 l=1 rx=0x7f3d3c002f70 tx=0x7f3d3c00f570).stop 2020-05-18T21:28:48.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.513+0000 7f3d4bfff700 1 -- 172.21.15.63:0/2490610043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d4c06a630 msgr2=0x7f3d4c14f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:48.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.513+0000 7f3d4bfff700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d4c06a630 0x7f3d4c14f400 secure :-1 s=READY pgs=595 cs=0 l=1 rx=0x7f3d4c05c1f0 tx=0x7f3d40010940).stop 2020-05-18T21:28:48.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.513+0000 7f3d4bfff700 1 -- 172.21.15.63:0/2490610043 shutdown_connections 2020-05-18T21:28:48.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.513+0000 7f3d4bfff700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3d2804fa30 0x7f3d28051ef0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:48.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.513+0000 7f3d4bfff700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d4c149d50 0x7f3d4c14c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:48.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.513+0000 7f3d4bfff700 1 --2- 172.21.15.63:0/2490610043 >> v2:172.21.15.155:3300/0 conn(0x7f3d4c0b4450 0x7f3d4c146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:48.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.513+0000 7f3d4bfff700 1 --2- 172.21.15.63:0/2490610043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d4c06a630 0x7f3d4c14f400 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:48.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.513+0000 7f3d4bfff700 1 -- 172.21.15.63:0/2490610043 >> 172.21.15.63:0/2490610043 conn(0x7f3d4c05fb90 msgr2=0x7f3d4c060ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:48.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.513+0000 7f3d4bfff700 1 -- 172.21.15.63:0/2490610043 shutdown_connections 2020-05-18T21:28:48.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.513+0000 7f3d4bfff700 1 -- 172.21.15.63:0/2490610043 wait complete. 2020-05-18T21:28:48.522 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 9 and data pool 10 2020-05-18T21:28:48.532 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:28:48.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.613+0000 7fd9bea53700 1 Processor -- start 2020-05-18T21:28:48.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.613+0000 7fd9bea53700 1 -- start start 2020-05-18T21:28:48.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9bea53700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 0x7fd9b81492f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:48.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9bea53700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd9b81468f0 0x7fd9b80628e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:48.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9bea53700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b8145cc0 con 0x7fd9b8149db0 2020-05-18T21:28:48.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9bea53700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b814a190 con 0x7fd9b81468f0 2020-05-18T21:28:48.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9bea53700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b8060fd0 con 0x7fd9b8060310 2020-05-18T21:28:48.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9be252700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd9b81468f0 0x7fd9b80628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:48.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9be252700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd9b81468f0 0x7fd9b80628e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:42208/0 (socket says 172.21.15.63:42208) 2020-05-18T21:28:48.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9be252700 1 -- 172.21.15.63:0/4275030719 learned_addr learned my addr 172.21.15.63:0/4275030719 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:48.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9bd250700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 0x7fd9b81492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:48.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9be252700 1 -- 172.21.15.63:0/4275030719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 msgr2=0x7fd9b81492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:48.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9be252700 1 --2- 172.21.15.63:0/4275030719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 0x7fd9b81492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:48.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9be252700 1 -- 172.21.15.63:0/4275030719 >> v1:172.21.15.155:6789/0 conn(0x7fd9b8149db0 legacy=0x7fd9b80b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:48.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9be252700 1 -- 172.21.15.63:0/4275030719 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8145f10 con 0x7fd9b81468f0 2020-05-18T21:28:48.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9bca4f700 1 -- 172.21.15.63:0/4275030719 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434828857 0 0) 0x7fd9b8145cc0 con 0x7fd9b8149db0 2020-05-18T21:28:48.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9be252700 1 --2- 172.21.15.63:0/4275030719 >> v2:172.21.15.155:3300/0 conn(0x7fd9b81468f0 0x7fd9b80628e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd9b00032f0 tx=0x7fd9b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9be252700 1 --2- 172.21.15.63:0/4275030719 >> v2:172.21.15.155:3300/0 conn(0x7fd9b81468f0 0x7fd9b80628e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd9b00032f0 tx=0x7fd9b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9be252700 1 --2- 172.21.15.63:0/4275030719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b81468f0 0x7fd9b80628e0 secure :-1 s=READY pgs=430 cs=0 l=1 rx=0x7fd9b00032f0 tx=0x7fd9b0007e00).ready entity=mon.1 client_cookie=8937e4c7c43c9076 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:48.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9be252700 1 --2- 172.21.15.63:0/4275030719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b81468f0 0x7fd9b80628e0 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7fd9b00032f0 tx=0x7fd9b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9bca4f700 1 -- 172.21.15.63:0/4275030719 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9b0011d10 con 0x7fd9b81468f0 2020-05-18T21:28:48.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9be252700 1 --2- 172.21.15.63:0/4275030719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b81468f0 0x7fd9b80628e0 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7fd9b00032f0 tx=0x7fd9b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9be252700 1 --2- 172.21.15.63:0/4275030719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b81468f0 0x7fd9b80628e0 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7fd9b00032f0 tx=0x7fd9b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9bca4f700 1 -- 172.21.15.63:0/4275030719 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b0011e70 con 0x7fd9b81468f0 2020-05-18T21:28:48.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9bea53700 1 -- 172.21.15.63:0/4275030719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b81468f0 msgr2=0x7fd9b80628e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:48.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9bea53700 1 --2- 172.21.15.63:0/4275030719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b81468f0 0x7fd9b80628e0 secure :-1 s=READY pgs=430 cs=0 l=1 rx=0x7fd9b00032f0 tx=0x7fd9b0007e00).stop 2020-05-18T21:28:48.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9bca4f700 1 -- 172.21.15.63:0/4275030719 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9b000a370 con 0x7fd9b81468f0 2020-05-18T21:28:48.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9bea53700 1 -- 172.21.15.63:0/4275030719 shutdown_connections 2020-05-18T21:28:48.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9bea53700 1 --2- 172.21.15.63:0/4275030719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b81468f0 0x7fd9b80628e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:48.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9bea53700 1 --2- 172.21.15.63:0/4275030719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 0x7fd9b81492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:48.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9bea53700 1 -- 172.21.15.63:0/4275030719 >> 172.21.15.63:0/4275030719 conn(0x7fd9b805eee0 msgr2=0x7fd9b805f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:48.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9bea53700 1 -- 172.21.15.63:0/4275030719 shutdown_connections 2020-05-18T21:28:48.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.617+0000 7fd9bea53700 1 -- 172.21.15.63:0/4275030719 wait complete. 2020-05-18T21:28:48.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bea53700 1 Processor -- start 2020-05-18T21:28:48.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bea53700 1 -- start start 2020-05-18T21:28:48.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bea53700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 0x7fd9b8157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:48.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bea53700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd9b8149db0 0x7fd9b8062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:48.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bea53700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b80630a0 con 0x7fd9b81468f0 2020-05-18T21:28:48.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bea53700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b8152f30 con 0x7fd9b8149db0 2020-05-18T21:28:48.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bea53700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b81531d0 con 0x7fd9b8060310 2020-05-18T21:28:48.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9be252700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd9b8149db0 0x7fd9b8062c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:48.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bda51700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 0x7fd9b8157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:48.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bd250700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd9b81468f0 0x7fd9b8153910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:56100/0 (socket says 172.21.15.63:56100) 2020-05-18T21:28:48.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bd250700 1 -- 172.21.15.63:0/892253198 learned_addr learned my addr 172.21.15.63:0/892253198 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9a6ffd700 1 -- 172.21.15.63:0/892253198 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819456820 0 0) 0x7fd9b80630a0 con 0x7fd9b81468f0 2020-05-18T21:28:48.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9a6ffd700 1 -- 172.21.15.63:0/892253198 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd998002fe0 con 0x7fd9b81468f0 2020-05-18T21:28:48.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bda51700 1 -- 172.21.15.63:0/892253198 >> v2:172.21.15.63:3300/0 conn(0x7fd9b8149db0 msgr2=0x7fd9b8062c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:48.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bda51700 1 --2- 172.21.15.63:0/892253198 >> v2:172.21.15.63:3300/0 conn(0x7fd9b8149db0 0x7fd9b8062c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:48.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bda51700 1 -- 172.21.15.63:0/892253198 >> v1:172.21.15.155:6789/0 conn(0x7fd9b81468f0 legacy=0x7fd9b8153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:48.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bda51700 1 -- 172.21.15.63:0/892253198 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8153470 con 0x7fd9b8060310 2020-05-18T21:28:48.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bda51700 1 --2- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 0x7fd9b8157010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd9b40010b0 tx=0x7fd9b8066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bda51700 1 --2- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 0x7fd9b8157010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd9b40010b0 tx=0x7fd9b8066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bda51700 1 --2- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 0x7fd9b8157010 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7fd9b40010b0 tx=0x7fd9b8066620).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:48.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bda51700 1 --2- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 0x7fd9b8157010 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fd9b40010b0 tx=0x7fd9b8066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9a6ffd700 1 -- 172.21.15.63:0/892253198 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9b4006c50 con 0x7fd9b8060310 2020-05-18T21:28:48.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bda51700 1 --2- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 0x7fd9b8157010 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fd9b40010b0 tx=0x7fd9b8066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bea53700 1 -- 172.21.15.63:0/892253198 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b813bbb0 con 0x7fd9b8060310 2020-05-18T21:28:48.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9a6ffd700 1 -- 172.21.15.63:0/892253198 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b4006db0 con 0x7fd9b8060310 2020-05-18T21:28:48.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bda51700 1 --2- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 0x7fd9b8157010 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fd9b40010b0 tx=0x7fd9b8066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9a6ffd700 1 -- 172.21.15.63:0/892253198 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9b4011070 con 0x7fd9b8060310 2020-05-18T21:28:48.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.621+0000 7fd9bea53700 1 -- 172.21.15.63:0/892253198 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b813c080 con 0x7fd9b8060310 2020-05-18T21:28:48.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.625+0000 7fd9bda51700 1 --2- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 0x7fd9b8157010 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fd9b40010b0 tx=0x7fd9b8066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.625+0000 7fd9bea53700 1 -- 172.21.15.63:0/892253198 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b80569e0 con 0x7fd9b8060310 2020-05-18T21:28:48.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.625+0000 7fd9a6ffd700 1 -- 172.21.15.63:0/892253198 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd9b4011330 con 0x7fd9b8060310 2020-05-18T21:28:48.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.625+0000 7fd9bda51700 1 --2- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 0x7fd9b8157010 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fd9b40010b0 tx=0x7fd9b8066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.625+0000 7fd9a6ffd700 1 --2- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd99804fce0 0x7fd9980521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:48.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.625+0000 7fd9a6ffd700 1 -- 172.21.15.63:0/892253198 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd9b4063b60 con 0x7fd9b8060310 2020-05-18T21:28:48.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.625+0000 7fd9bd250700 1 --2- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd99804fce0 0x7fd9980521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:48.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.625+0000 7fd9bd250700 1 --2- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd99804fce0 0x7fd9980521a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd9a8002f70 tx=0x7fd9a80090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.625+0000 7fd9bd250700 1 --2- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd99804fce0 0x7fd9980521a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd9a8002f70 tx=0x7fd9a80090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.625+0000 7fd9bd250700 1 --2- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd99804fce0 0x7fd9980521a0 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7fd9a8002f70 tx=0x7fd9a80090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:48.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.633+0000 7fd9bda51700 1 --2- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 0x7fd9b8157010 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fd9b40010b0 tx=0x7fd9b8066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.633+0000 7fd9a6ffd700 1 -- 172.21.15.63:0/892253198 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd9b403de90 con 0x7fd9b8060310 2020-05-18T21:28:48.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.753+0000 7fd9bea53700 1 -- 172.21.15.63:0/892253198 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9b8153600 con 0x7fd9b8060310 2020-05-18T21:28:48.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.753+0000 7fd9bda51700 1 --2- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 0x7fd9b8157010 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fd9b40010b0 tx=0x7fd9b8066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:48.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.757+0000 7fd9a6ffd700 1 -- 172.21.15.63:0/892253198 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16104 (secure 0 0 0) 0x7fd9b40414b0 con 0x7fd9b8060310 2020-05-18T21:28:48.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.757+0000 7fd9bea53700 1 -- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd99804fce0 msgr2=0x7fd9980521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:48.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.757+0000 7fd9bea53700 1 --2- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd99804fce0 0x7fd9980521a0 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7fd9a8002f70 tx=0x7fd9a80090f0).stop 2020-05-18T21:28:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.757+0000 7fd9bea53700 1 -- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 msgr2=0x7fd9b8157010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.757+0000 7fd9bea53700 1 --2- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 0x7fd9b8157010 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7fd9b40010b0 tx=0x7fd9b8066620).stop 2020-05-18T21:28:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.757+0000 7fd9bea53700 1 -- 172.21.15.63:0/892253198 shutdown_connections 2020-05-18T21:28:48.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.757+0000 7fd9bea53700 1 --2- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd99804fce0 0x7fd9980521a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:48.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.757+0000 7fd9bea53700 1 --2- 172.21.15.63:0/892253198 >> v2:172.21.15.63:3300/0 conn(0x7fd9b8149db0 0x7fd9b8062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:48.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.757+0000 7fd9bea53700 1 --2- 172.21.15.63:0/892253198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b8060310 0x7fd9b8157010 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:48.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.757+0000 7fd9bea53700 1 -- 172.21.15.63:0/892253198 >> 172.21.15.63:0/892253198 conn(0x7fd9b805eee0 msgr2=0x7fd9b813f070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:48.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.757+0000 7fd9bea53700 1 -- 172.21.15.63:0/892253198 shutdown_connections 2020-05-18T21:28:48.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:48.757+0000 7fd9bea53700 1 -- 172.21.15.63:0/892253198 wait complete. 2020-05-18T21:28:48.956 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:48.956 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":50,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:28:48.505449+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:28:46.842474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2020-05-18T21:28:47.510399+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:28:48.958 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:28:49.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.069+0000 7fe19f1b4700 1 Processor -- start 2020-05-18T21:28:49.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.069+0000 7fe19f1b4700 1 -- start start 2020-05-18T21:28:49.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.069+0000 7fe19f1b4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe1980b5c00 0x7fe198149f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:49.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.069+0000 7fe19f1b4700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1980b4f60 0x7fe1980b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:49.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.069+0000 7fe19f1b4700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1980637b0 con 0x7fe1980b0d40 2020-05-18T21:28:49.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.069+0000 7fe19f1b4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1980635a0 con 0x7fe1980b5c00 2020-05-18T21:28:49.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.069+0000 7fe19f1b4700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe198063a50 con 0x7fe1980b4f60 2020-05-18T21:28:49.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe19d751700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe1980b0d40 0x7fe198069b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57792/0 (socket says 172.21.15.63:57792) 2020-05-18T21:28:49.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe19d751700 1 -- 172.21.15.63:0/1750001529 learned_addr learned my addr 172.21.15.63:0/1750001529 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:49.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe19cf50700 1 --2- 172.21.15.63:0/1750001529 >> v2:172.21.15.63:3300/0 conn(0x7fe1980b5c00 0x7fe198149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:49.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe197fff700 1 --2- 172.21.15.63:0/1750001529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1980b4f60 0x7fe1980b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:49.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe1977fe700 1 -- 172.21.15.63:0/1750001529 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461877002 0 0) 0x7fe1980637b0 con 0x7fe1980b0d40 2020-05-18T21:28:49.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe1977fe700 1 -- 172.21.15.63:0/1750001529 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe178003270 con 0x7fe1980b0d40 2020-05-18T21:28:49.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe1977fe700 1 -- 172.21.15.63:0/1750001529 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1157035389 0 0) 0x7fe178003270 con 0x7fe1980b0d40 2020-05-18T21:28:49.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe1977fe700 1 -- 172.21.15.63:0/1750001529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1980b4f60 msgr2=0x7fe1980b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:49.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe1977fe700 1 --2- 172.21.15.63:0/1750001529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1980b4f60 0x7fe1980b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:49.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe1977fe700 1 -- 172.21.15.63:0/1750001529 >> v2:172.21.15.63:3300/0 conn(0x7fe1980b5c00 msgr2=0x7fe198149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:49.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe1977fe700 1 --2- 172.21.15.63:0/1750001529 >> v2:172.21.15.63:3300/0 conn(0x7fe1980b5c00 0x7fe198149f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:49.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe1977fe700 1 -- 172.21.15.63:0/1750001529 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1980bb4a0 con 0x7fe1980b0d40 2020-05-18T21:28:49.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe1977fe700 1 -- 172.21.15.63:0/1750001529 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fe190001a90 con 0x7fe1980b0d40 2020-05-18T21:28:49.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe1977fe700 1 -- 172.21.15.63:0/1750001529 >> v1:172.21.15.63:6789/0 conn(0x7fe1980b0d40 legacy=0x7fe198069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:49.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe1977fe700 1 --2- 172.21.15.63:0/1750001529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe178003760 0x7fe178003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:49.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe1977fe700 1 --2- 172.21.15.63:0/1750001529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1780040a0 0x7fe178004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:49.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe1977fe700 1 --2- 172.21.15.63:0/1750001529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1980b4f60 0x7fe178004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:49.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe1977fe700 1 -- 172.21.15.63:0/1750001529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980635a0 con 0x7fe1780040a0 2020-05-18T21:28:49.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe1977fe700 1 -- 172.21.15.63:0/1750001529 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe198063a50 con 0x7fe178003760 2020-05-18T21:28:49.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe1977fe700 1 -- 172.21.15.63:0/1750001529 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe178005030 con 0x7fe1980b4f60 2020-05-18T21:28:49.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe197fff700 1 --2- 172.21.15.63:0/1750001529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1780040a0 0x7fe178004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:49.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe197fff700 1 -- 172.21.15.63:0/1750001529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1980b4f60 msgr2=0x7fe178004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:49.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe19d751700 1 --2- 172.21.15.63:0/1750001529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1980b4f60 0x7fe178004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:49.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe19cf50700 1 --2- 172.21.15.63:0/1750001529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe178003760 0x7fe178003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:49.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe197fff700 1 --2- 172.21.15.63:0/1750001529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1980b4f60 0x7fe178004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:49.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe197fff700 1 -- 172.21.15.63:0/1750001529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe178003760 msgr2=0x7fe178003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:49.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe197fff700 1 --2- 172.21.15.63:0/1750001529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe178003760 0x7fe178003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:49.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe197fff700 1 -- 172.21.15.63:0/1750001529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe178003270 con 0x7fe1780040a0 2020-05-18T21:28:49.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe19d751700 1 --2- 172.21.15.63:0/1750001529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1980b4f60 0x7fe178004b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:28:49.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe19cf50700 1 --2- 172.21.15.63:0/1750001529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe178003760 0x7fe178003b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:28:49.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe197fff700 1 --2- 172.21.15.63:0/1750001529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1780040a0 0x7fe178004570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe180002f70 tx=0x7fe180010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe197fff700 1 --2- 172.21.15.63:0/1750001529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1780040a0 0x7fe178004570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe180002f70 tx=0x7fe180010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe197fff700 1 --2- 172.21.15.63:0/1750001529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1780040a0 0x7fe178004570 secure :-1 s=READY pgs=597 cs=0 l=1 rx=0x7fe180002f70 tx=0x7fe180010110).ready entity=mon.0 client_cookie=8b60da125998db5c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:49.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe197fff700 1 --2- 172.21.15.63:0/1750001529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1780040a0 0x7fe178004570 secure :-1 s=THROTTLE_DONE pgs=597 cs=0 l=1 rx=0x7fe180002f70 tx=0x7fe180010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe1977fe700 1 -- 172.21.15.63:0/1750001529 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe180010e20 con 0x7fe1780040a0 2020-05-18T21:28:49.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe197fff700 1 --2- 172.21.15.63:0/1750001529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1780040a0 0x7fe178004570 secure :-1 s=THROTTLE_DONE pgs=597 cs=0 l=1 rx=0x7fe180002f70 tx=0x7fe180010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe1977fe700 1 -- 172.21.15.63:0/1750001529 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe180008990 con 0x7fe1780040a0 2020-05-18T21:28:49.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe197fff700 1 --2- 172.21.15.63:0/1750001529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1780040a0 0x7fe178004570 secure :-1 s=THROTTLE_DONE pgs=597 cs=0 l=1 rx=0x7fe180002f70 tx=0x7fe180010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe1977fe700 1 -- 172.21.15.63:0/1750001529 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe180008cf0 con 0x7fe1780040a0 2020-05-18T21:28:49.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe19f1b4700 1 -- 172.21.15.63:0/1750001529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1780040a0 msgr2=0x7fe178004570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:49.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe19f1b4700 1 --2- 172.21.15.63:0/1750001529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1780040a0 0x7fe178004570 secure :-1 s=READY pgs=597 cs=0 l=1 rx=0x7fe180002f70 tx=0x7fe180010110).stop 2020-05-18T21:28:49.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe19d751700 1 -- 172.21.15.63:0/1750001529 reap_dead start 2020-05-18T21:28:49.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe19f1b4700 1 -- 172.21.15.63:0/1750001529 shutdown_connections 2020-05-18T21:28:49.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe19f1b4700 1 -- 172.21.15.63:0/1750001529 >> 172.21.15.63:0/1750001529 conn(0x7fe1980ba5c0 msgr2=0x7fe1980ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:49.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe19f1b4700 1 -- 172.21.15.63:0/1750001529 shutdown_connections 2020-05-18T21:28:49.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.073+0000 7fe19f1b4700 1 -- 172.21.15.63:0/1750001529 wait complete. 2020-05-18T21:28:49.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.077+0000 7fe19f1b4700 1 Processor -- start 2020-05-18T21:28:49.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.077+0000 7fe19f1b4700 1 -- start start 2020-05-18T21:28:49.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.077+0000 7fe19f1b4700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe198065560 0x7fe1980b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:49.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.077+0000 7fe19f1b4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe198146f70 0x7fe198143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:49.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.077+0000 7fe19f1b4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe1981473c0 0x7fe1980b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:49.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.077+0000 7fe19f1b4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1980b42f0 con 0x7fe198146f70 2020-05-18T21:28:49.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.077+0000 7fe19f1b4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1980b4590 con 0x7fe1981473c0 2020-05-18T21:28:49.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.077+0000 7fe19f1b4700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe198146ad0 con 0x7fe198065560 2020-05-18T21:28:49.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.077+0000 7fe197fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe198146f70 0x7fe198143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:49.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe197fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe198146f70 0x7fe198143c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55616/0 (socket says 172.21.15.63:55616) 2020-05-18T21:28:49.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe197fff700 1 -- 172.21.15.63:0/1880763421 learned_addr learned my addr 172.21.15.63:0/1880763421 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:49.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe19cf50700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe198065560 0x7fe1980b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:49.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe19d751700 1 --2- 172.21.15.63:0/1880763421 >> v2:172.21.15.155:3300/0 conn(0x7fe1981473c0 0x7fe1980b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:49.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe197fff700 1 -- 172.21.15.63:0/1880763421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe198065560 msgr2=0x7fe1980b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:49.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe197fff700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe198065560 0x7fe1980b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:49.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe197fff700 1 -- 172.21.15.63:0/1880763421 >> v2:172.21.15.155:3300/0 conn(0x7fe1981473c0 msgr2=0x7fe1980b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:49.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe197fff700 1 --2- 172.21.15.63:0/1880763421 >> v2:172.21.15.155:3300/0 conn(0x7fe1981473c0 0x7fe1980b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:49.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe197fff700 1 -- 172.21.15.63:0/1880763421 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe198065940 con 0x7fe198146f70 2020-05-18T21:28:49.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe197fff700 1 --2- 172.21.15.63:0/1880763421 >> v2:172.21.15.63:3300/0 conn(0x7fe198146f70 0x7fe198143c10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe180002f70 tx=0x7fe180010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe197fff700 1 --2- 172.21.15.63:0/1880763421 >> v2:172.21.15.63:3300/0 conn(0x7fe198146f70 0x7fe198143c10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe180002f70 tx=0x7fe180010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe197fff700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe198146f70 0x7fe198143c10 secure :-1 s=READY pgs=598 cs=0 l=1 rx=0x7fe180002f70 tx=0x7fe180010110).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:49.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe197fff700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe198146f70 0x7fe198143c10 secure :-1 s=THROTTLE_DONE pgs=598 cs=0 l=1 rx=0x7fe180002f70 tx=0x7fe180010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe195ffb700 1 -- 172.21.15.63:0/1880763421 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe180007c60 con 0x7fe198146f70 2020-05-18T21:28:49.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe197fff700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe198146f70 0x7fe198143c10 secure :-1 s=THROTTLE_DONE pgs=598 cs=0 l=1 rx=0x7fe180002f70 tx=0x7fe180010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe195ffb700 1 -- 172.21.15.63:0/1880763421 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1800058f0 con 0x7fe198146f70 2020-05-18T21:28:49.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe19f1b4700 1 -- 172.21.15.63:0/1880763421 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe198147810 con 0x7fe198146f70 2020-05-18T21:28:49.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe197fff700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe198146f70 0x7fe198143c10 secure :-1 s=THROTTLE_DONE pgs=598 cs=0 l=1 rx=0x7fe180002f70 tx=0x7fe180010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe195ffb700 1 -- 172.21.15.63:0/1880763421 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe180005cd0 con 0x7fe198146f70 2020-05-18T21:28:49.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe19f1b4700 1 -- 172.21.15.63:0/1880763421 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1980b3630 con 0x7fe198146f70 2020-05-18T21:28:49.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe197fff700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe198146f70 0x7fe198143c10 secure :-1 s=THROTTLE_DONE pgs=598 cs=0 l=1 rx=0x7fe180002f70 tx=0x7fe180010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe19f1b4700 1 -- 172.21.15.63:0/1880763421 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1980569e0 con 0x7fe198146f70 2020-05-18T21:28:49.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe195ffb700 1 -- 172.21.15.63:0/1880763421 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe180014240 con 0x7fe198146f70 2020-05-18T21:28:49.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe197fff700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe198146f70 0x7fe198143c10 secure :-1 s=THROTTLE_DONE pgs=598 cs=0 l=1 rx=0x7fe180002f70 tx=0x7fe180010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe195ffb700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe17c04f9e0 0x7fe17c051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:49.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe195ffb700 1 -- 172.21.15.63:0/1880763421 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe180063f60 con 0x7fe198146f70 2020-05-18T21:28:49.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.081+0000 7fe19cf50700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe17c04f9e0 0x7fe17c051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:49.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.085+0000 7fe19cf50700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe17c04f9e0 0x7fe17c051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe188002f70 tx=0x7fe18800c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.085+0000 7fe19cf50700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe17c04f9e0 0x7fe17c051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe188002f70 tx=0x7fe18800c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.085+0000 7fe19cf50700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe17c04f9e0 0x7fe17c051ea0 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7fe188002f70 tx=0x7fe18800c830).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:49.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.089+0000 7fe197fff700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe198146f70 0x7fe198143c10 secure :-1 s=THROTTLE_DONE pgs=598 cs=0 l=1 rx=0x7fe180002f70 tx=0x7fe180010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.089+0000 7fe195ffb700 1 -- 172.21.15.63:0/1880763421 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe18003e350 con 0x7fe198146f70 2020-05-18T21:28:49.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.205+0000 7fe19f1b4700 1 -- 172.21.15.63:0/1880763421 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe198146c40 con 0x7fe198146f70 2020-05-18T21:28:49.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.205+0000 7fe197fff700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe198146f70 0x7fe198143c10 secure :-1 s=THROTTLE_DONE pgs=598 cs=0 l=1 rx=0x7fe180002f70 tx=0x7fe180010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.205+0000 7fe195ffb700 1 -- 172.21.15.63:0/1880763421 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16104 (secure 0 0 0) 0x7fe180041970 con 0x7fe198146f70 2020-05-18T21:28:49.212 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:49.213 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":50,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:28:48.505449+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:28:46.842474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2020-05-18T21:28:47.510399+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:28:49.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.209+0000 7fe19f1b4700 1 -- 172.21.15.63:0/1880763421 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe17c04f9e0 msgr2=0x7fe17c051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:49.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.209+0000 7fe19f1b4700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe17c04f9e0 0x7fe17c051ea0 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7fe188002f70 tx=0x7fe18800c830).stop 2020-05-18T21:28:49.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.209+0000 7fe19f1b4700 1 -- 172.21.15.63:0/1880763421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe198146f70 msgr2=0x7fe198143c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:49.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.209+0000 7fe19f1b4700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe198146f70 0x7fe198143c10 secure :-1 s=READY pgs=598 cs=0 l=1 rx=0x7fe180002f70 tx=0x7fe180010110).stop 2020-05-18T21:28:49.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.209+0000 7fe19f1b4700 1 -- 172.21.15.63:0/1880763421 shutdown_connections 2020-05-18T21:28:49.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.209+0000 7fe19f1b4700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe17c04f9e0 0x7fe17c051ea0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:49.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.209+0000 7fe19f1b4700 1 --2- 172.21.15.63:0/1880763421 >> v2:172.21.15.155:3300/0 conn(0x7fe1981473c0 0x7fe1980b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:49.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.209+0000 7fe19f1b4700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe198146f70 0x7fe198143c10 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:49.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.209+0000 7fe19f1b4700 1 --2- 172.21.15.63:0/1880763421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe198065560 0x7fe1980b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:49.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.209+0000 7fe19f1b4700 1 -- 172.21.15.63:0/1880763421 >> 172.21.15.63:0/1880763421 conn(0x7fe1980ba5c0 msgr2=0x7fe1980ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:49.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.209+0000 7fe19f1b4700 1 -- 172.21.15.63:0/1880763421 shutdown_connections 2020-05-18T21:28:49.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.209+0000 7fe19f1b4700 1 -- 172.21.15.63:0/1880763421 wait complete. 2020-05-18T21:28:49.226 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-05-18T21:28:49.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa153022700 1 Processor -- start 2020-05-18T21:28:49.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa153022700 1 -- start start 2020-05-18T21:28:49.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa153022700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa14c061180 0x7fa14c06a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:49.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa153022700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa14c0b2eb0 0x7fa14c0b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:49.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa153022700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa14c06a7d0 con 0x7fa14c0b4f40 2020-05-18T21:28:49.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa153022700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa14c0b2a10 con 0x7fa14c0b2eb0 2020-05-18T21:28:49.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa153022700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa14c0b5320 con 0x7fa14c061180 2020-05-18T21:28:49.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa152821700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa14c0b2eb0 0x7fa14c0b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:49.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa152020700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa14c0b4f40 0x7fa14c132360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57810/0 (socket says 172.21.15.63:57810) 2020-05-18T21:28:49.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa152020700 1 -- 172.21.15.63:0/2505121952 learned_addr learned my addr 172.21.15.63:0/2505121952 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:49.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa15181f700 1 --2- 172.21.15.63:0/2505121952 >> v2:172.21.15.155:3300/0 conn(0x7fa14c061180 0x7fa14c06a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:49.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa15101e700 1 -- 172.21.15.63:0/2505121952 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065743952 0 0) 0x7fa14c06a7d0 con 0x7fa14c0b4f40 2020-05-18T21:28:49.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa15101e700 1 -- 172.21.15.63:0/2505121952 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa134003270 con 0x7fa14c0b4f40 2020-05-18T21:28:49.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa152821700 1 -- 172.21.15.63:0/2505121952 >> v2:172.21.15.155:3300/0 conn(0x7fa14c061180 msgr2=0x7fa14c06a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:49.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa152821700 1 --2- 172.21.15.63:0/2505121952 >> v2:172.21.15.155:3300/0 conn(0x7fa14c061180 0x7fa14c06a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:49.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa152821700 1 -- 172.21.15.63:0/2505121952 >> v1:172.21.15.63:6789/0 conn(0x7fa14c0b4f40 legacy=0x7fa14c132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:49.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa152821700 1 -- 172.21.15.63:0/2505121952 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c1337f0 con 0x7fa14c0b2eb0 2020-05-18T21:28:49.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa152821700 1 --2- 172.21.15.63:0/2505121952 >> v2:172.21.15.63:3300/0 conn(0x7fa14c0b2eb0 0x7fa14c0b3320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa1440032f0 tx=0x7fa144007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa152821700 1 --2- 172.21.15.63:0/2505121952 >> v2:172.21.15.63:3300/0 conn(0x7fa14c0b2eb0 0x7fa14c0b3320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa1440032f0 tx=0x7fa144007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa152821700 1 --2- 172.21.15.63:0/2505121952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa14c0b2eb0 0x7fa14c0b3320 secure :-1 s=READY pgs=600 cs=0 l=1 rx=0x7fa1440032f0 tx=0x7fa144007e00).ready entity=mon.0 client_cookie=f5156d3a4f1a4ff1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:49.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.329+0000 7fa152821700 1 --2- 172.21.15.63:0/2505121952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa14c0b2eb0 0x7fa14c0b3320 secure :-1 s=THROTTLE_DONE pgs=600 cs=0 l=1 rx=0x7fa1440032f0 tx=0x7fa144007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.333+0000 7fa15101e700 1 -- 172.21.15.63:0/2505121952 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa144011db0 con 0x7fa14c0b2eb0 2020-05-18T21:28:49.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.333+0000 7fa152821700 1 --2- 172.21.15.63:0/2505121952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa14c0b2eb0 0x7fa14c0b3320 secure :-1 s=THROTTLE_DONE pgs=600 cs=0 l=1 rx=0x7fa1440032f0 tx=0x7fa144007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.333+0000 7fa15101e700 1 -- 172.21.15.63:0/2505121952 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14400a180 con 0x7fa14c0b2eb0 2020-05-18T21:28:49.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.333+0000 7fa152821700 1 --2- 172.21.15.63:0/2505121952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa14c0b2eb0 0x7fa14c0b3320 secure :-1 s=THROTTLE_DONE pgs=600 cs=0 l=1 rx=0x7fa1440032f0 tx=0x7fa144007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.333+0000 7fa15101e700 1 -- 172.21.15.63:0/2505121952 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14400a5a0 con 0x7fa14c0b2eb0 2020-05-18T21:28:49.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.333+0000 7fa153022700 1 -- 172.21.15.63:0/2505121952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa14c0b2eb0 msgr2=0x7fa14c0b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:49.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.333+0000 7fa153022700 1 --2- 172.21.15.63:0/2505121952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa14c0b2eb0 0x7fa14c0b3320 secure :-1 s=READY pgs=600 cs=0 l=1 rx=0x7fa1440032f0 tx=0x7fa144007e00).stop 2020-05-18T21:28:49.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.333+0000 7fa153022700 1 -- 172.21.15.63:0/2505121952 shutdown_connections 2020-05-18T21:28:49.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.333+0000 7fa153022700 1 --2- 172.21.15.63:0/2505121952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa14c0b2eb0 0x7fa14c0b3320 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:49.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.333+0000 7fa153022700 1 --2- 172.21.15.63:0/2505121952 >> v2:172.21.15.155:3300/0 conn(0x7fa14c061180 0x7fa14c06a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:49.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.333+0000 7fa153022700 1 -- 172.21.15.63:0/2505121952 >> 172.21.15.63:0/2505121952 conn(0x7fa14c05fbd0 msgr2=0x7fa14c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:49.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.333+0000 7fa153022700 1 -- 172.21.15.63:0/2505121952 shutdown_connections 2020-05-18T21:28:49.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.333+0000 7fa153022700 1 -- 172.21.15.63:0/2505121952 wait complete. 2020-05-18T21:28:49.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.333+0000 7fa153022700 1 Processor -- start 2020-05-18T21:28:49.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.333+0000 7fa153022700 1 -- start start 2020-05-18T21:28:49.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa153022700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa14c0b4f40 0x7fa14c14ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:49.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa153022700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa14c0ad180 con 0x7fa14c061180 2020-05-18T21:28:49.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa153022700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa14c0ad420 con 0x7fa14c0b2eb0 2020-05-18T21:28:49.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa153022700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa14c0acea0 con 0x7fa14c0b4f40 2020-05-18T21:28:49.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa152020700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa14c061180 0x7fa14c0b1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57816/0 (socket says 172.21.15.63:57816) 2020-05-18T21:28:49.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa152020700 1 -- 172.21.15.63:0/788452965 learned_addr learned my addr 172.21.15.63:0/788452965 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:49.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa152821700 1 --2- 172.21.15.63:0/788452965 >> v2:172.21.15.63:3300/0 conn(0x7fa14c0b4f40 0x7fa14c14ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:49.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa13f7fe700 1 -- 172.21.15.63:0/788452965 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4174710091 0 0) 0x7fa14c0ad180 con 0x7fa14c061180 2020-05-18T21:28:49.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa152821700 1 -- 172.21.15.63:0/788452965 >> v1:172.21.15.155:6789/0 conn(0x7fa14c0b2eb0 legacy=0x7fa14c14a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:49.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa152821700 1 -- 172.21.15.63:0/788452965 >> v1:172.21.15.63:6789/0 conn(0x7fa14c061180 legacy=0x7fa14c0b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:49.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa152821700 1 -- 172.21.15.63:0/788452965 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c0b2210 con 0x7fa14c0b4f40 2020-05-18T21:28:49.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa152821700 1 --2- 172.21.15.63:0/788452965 >> v2:172.21.15.63:3300/0 conn(0x7fa14c0b4f40 0x7fa14c14ccb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa140002f30 tx=0x7fa144007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa152821700 1 --2- 172.21.15.63:0/788452965 >> v2:172.21.15.63:3300/0 conn(0x7fa14c0b4f40 0x7fa14c14ccb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa140002f30 tx=0x7fa144007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa152821700 1 --2- 172.21.15.63:0/788452965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa14c0b4f40 0x7fa14c14ccb0 secure :-1 s=READY pgs=602 cs=0 l=1 rx=0x7fa140002f30 tx=0x7fa144007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:49.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa152821700 1 --2- 172.21.15.63:0/788452965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa14c0b4f40 0x7fa14c14ccb0 secure :-1 s=THROTTLE_DONE pgs=602 cs=0 l=1 rx=0x7fa140002f30 tx=0x7fa144007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa13f7fe700 1 -- 172.21.15.63:0/788452965 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa144011e90 con 0x7fa14c0b4f40 2020-05-18T21:28:49.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa152821700 1 --2- 172.21.15.63:0/788452965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa14c0b4f40 0x7fa14c14ccb0 secure :-1 s=THROTTLE_DONE pgs=602 cs=0 l=1 rx=0x7fa140002f30 tx=0x7fa144007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa152821700 1 --2- 172.21.15.63:0/788452965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa14c0b4f40 0x7fa14c14ccb0 secure :-1 s=THROTTLE_DONE pgs=602 cs=0 l=1 rx=0x7fa140002f30 tx=0x7fa144007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa13f7fe700 1 -- 172.21.15.63:0/788452965 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa144010460 con 0x7fa14c0b4f40 2020-05-18T21:28:49.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa153022700 1 -- 172.21.15.63:0/788452965 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14c0b2400 con 0x7fa14c0b4f40 2020-05-18T21:28:49.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa13f7fe700 1 -- 172.21.15.63:0/788452965 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa144005e60 con 0x7fa14c0b4f40 2020-05-18T21:28:49.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.337+0000 7fa153022700 1 -- 172.21.15.63:0/788452965 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14c0655c0 con 0x7fa14c0b4f40 2020-05-18T21:28:49.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.341+0000 7fa153022700 1 -- 172.21.15.63:0/788452965 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa14c0acfe0 con 0x7fa14c0b4f40 2020-05-18T21:28:49.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.341+0000 7fa152821700 1 --2- 172.21.15.63:0/788452965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa14c0b4f40 0x7fa14c14ccb0 secure :-1 s=THROTTLE_DONE pgs=602 cs=0 l=1 rx=0x7fa140002f30 tx=0x7fa144007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.341+0000 7fa13f7fe700 1 -- 172.21.15.63:0/788452965 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa1440071c0 con 0x7fa14c0b4f40 2020-05-18T21:28:49.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.341+0000 7fa152821700 1 --2- 172.21.15.63:0/788452965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa14c0b4f40 0x7fa14c14ccb0 secure :-1 s=THROTTLE_DONE pgs=602 cs=0 l=1 rx=0x7fa140002f30 tx=0x7fa144007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.341+0000 7fa13f7fe700 1 --2- 172.21.15.63:0/788452965 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa12c04f8f0 0x7fa12c051db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:49.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.341+0000 7fa13f7fe700 1 -- 172.21.15.63:0/788452965 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa144064850 con 0x7fa14c0b4f40 2020-05-18T21:28:49.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.341+0000 7fa152020700 1 --2- 172.21.15.63:0/788452965 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa12c04f8f0 0x7fa12c051db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:49.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.341+0000 7fa152020700 1 --2- 172.21.15.63:0/788452965 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa12c04f8f0 0x7fa12c051db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa1480010d0 tx=0x7fa148001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.341+0000 7fa152020700 1 --2- 172.21.15.63:0/788452965 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa12c04f8f0 0x7fa12c051db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa1480010d0 tx=0x7fa148001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.341+0000 7fa152020700 1 --2- 172.21.15.63:0/788452965 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa12c04f8f0 0x7fa12c051db0 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7fa1480010d0 tx=0x7fa148001720).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:49.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.345+0000 7fa152821700 1 --2- 172.21.15.63:0/788452965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa14c0b4f40 0x7fa14c14ccb0 secure :-1 s=THROTTLE_DONE pgs=602 cs=0 l=1 rx=0x7fa140002f30 tx=0x7fa144007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:49.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.345+0000 7fa13f7fe700 1 -- 172.21.15.63:0/788452965 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa14c0acfe0 con 0x7fa14c0b4f40 2020-05-18T21:28:49.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:49.493+0000 7fa153022700 1 -- 172.21.15.63:0/788452965 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa14c0acfe0 con 0x7fa14c0b4f40 2020-05-18T21:28:50.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.229+0000 7fa152821700 1 --2- 172.21.15.63:0/788452965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa14c0b4f40 0x7fa14c14ccb0 secure :-1 s=THROTTLE_DONE pgs=602 cs=0 l=1 rx=0x7fa140002f30 tx=0x7fa144007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.229+0000 7fa13f7fe700 1 -- 172.21.15.63:0/788452965 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa14c0acfe0 con 0x7fa14c0b4f40 2020-05-18T21:28:50.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.233+0000 7fa153022700 1 -- 172.21.15.63:0/788452965 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa12c04f8f0 msgr2=0x7fa12c051db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.233+0000 7fa153022700 1 --2- 172.21.15.63:0/788452965 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa12c04f8f0 0x7fa12c051db0 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7fa1480010d0 tx=0x7fa148001720).stop 2020-05-18T21:28:50.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.233+0000 7fa153022700 1 -- 172.21.15.63:0/788452965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa14c0b4f40 msgr2=0x7fa14c14ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.233+0000 7fa153022700 1 --2- 172.21.15.63:0/788452965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa14c0b4f40 0x7fa14c14ccb0 secure :-1 s=READY pgs=602 cs=0 l=1 rx=0x7fa140002f30 tx=0x7fa144007e00).stop 2020-05-18T21:28:50.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.233+0000 7fa153022700 1 -- 172.21.15.63:0/788452965 shutdown_connections 2020-05-18T21:28:50.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.233+0000 7fa153022700 1 --2- 172.21.15.63:0/788452965 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa12c04f8f0 0x7fa12c051db0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:50.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.233+0000 7fa153022700 1 --2- 172.21.15.63:0/788452965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa14c0b4f40 0x7fa14c14ccb0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:50.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.233+0000 7fa153022700 1 -- 172.21.15.63:0/788452965 >> 172.21.15.63:0/788452965 conn(0x7fa14c05fbd0 msgr2=0x7fa14c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:50.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.233+0000 7fa153022700 1 -- 172.21.15.63:0/788452965 shutdown_connections 2020-05-18T21:28:50.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.233+0000 7fa153022700 1 -- 172.21.15.63:0/788452965 wait complete. 2020-05-18T21:28:50.251 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:28:50.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.357+0000 7fe9cffff700 1 Processor -- start 2020-05-18T21:28:50.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.357+0000 7fe9cffff700 1 -- start start 2020-05-18T21:28:50.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9cffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe9d013cae0 0x7fe9d0060fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:50.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9cffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9d0062970 0x7fe9d0062db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:50.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9cffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d013cec0 con 0x7fe9d01429e0 2020-05-18T21:28:50.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9cffff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d0061f20 con 0x7fe9d013cae0 2020-05-18T21:28:50.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9cffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d0061540 con 0x7fe9d0062970 2020-05-18T21:28:50.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9ceffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe9d013cae0 0x7fe9d0060fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:50.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9ceffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe9d013cae0 0x7fe9d0060fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55636/0 (socket says 172.21.15.63:55636) 2020-05-18T21:28:50.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9ceffd700 1 -- 172.21.15.63:0/335999042 learned_addr learned my addr 172.21.15.63:0/335999042 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:50.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9c7fff700 1 --1- 172.21.15.63:0/335999042 >> v1:172.21.15.63:6789/0 conn(0x7fe9d01429e0 0x7fe9d0069b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57826/0 (socket says 172.21.15.63:57826) 2020-05-18T21:28:50.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9cf7fe700 1 --2- 172.21.15.63:0/335999042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9d0062970 0x7fe9d0062db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:50.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9ceffd700 1 -- 172.21.15.63:0/335999042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9d0062970 msgr2=0x7fe9d0062db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:50.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9ceffd700 1 --2- 172.21.15.63:0/335999042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9d0062970 0x7fe9d0062db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:50.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9ce7fc700 1 -- 172.21.15.63:0/335999042 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523657011 0 0) 0x7fe9d013cec0 con 0x7fe9d01429e0 2020-05-18T21:28:50.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9ceffd700 1 -- 172.21.15.63:0/335999042 >> v1:172.21.15.63:6789/0 conn(0x7fe9d01429e0 legacy=0x7fe9d0069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9ceffd700 1 -- 172.21.15.63:0/335999042 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d00617e0 con 0x7fe9d013cae0 2020-05-18T21:28:50.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9ceffd700 1 --2- 172.21.15.63:0/335999042 >> v2:172.21.15.63:3300/0 conn(0x7fe9d013cae0 0x7fe9d0060fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe9c0002f70 tx=0x7fe9c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9ceffd700 1 --2- 172.21.15.63:0/335999042 >> v2:172.21.15.63:3300/0 conn(0x7fe9d013cae0 0x7fe9d0060fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe9c0002f70 tx=0x7fe9c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9ceffd700 1 --2- 172.21.15.63:0/335999042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9d013cae0 0x7fe9d0060fc0 secure :-1 s=READY pgs=604 cs=0 l=1 rx=0x7fe9c0002f70 tx=0x7fe9c0007a80).ready entity=mon.0 client_cookie=c41b466ca4ef3a82 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:50.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9ceffd700 1 --2- 172.21.15.63:0/335999042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9d013cae0 0x7fe9d0060fc0 secure :-1 s=THROTTLE_DONE pgs=604 cs=0 l=1 rx=0x7fe9c0002f70 tx=0x7fe9c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9ce7fc700 1 -- 172.21.15.63:0/335999042 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c0011760 con 0x7fe9d013cae0 2020-05-18T21:28:50.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9ceffd700 1 --2- 172.21.15.63:0/335999042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9d013cae0 0x7fe9d0060fc0 secure :-1 s=THROTTLE_DONE pgs=604 cs=0 l=1 rx=0x7fe9c0002f70 tx=0x7fe9c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9ce7fc700 1 -- 172.21.15.63:0/335999042 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c00118c0 con 0x7fe9d013cae0 2020-05-18T21:28:50.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9ceffd700 1 --2- 172.21.15.63:0/335999042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9d013cae0 0x7fe9d0060fc0 secure :-1 s=THROTTLE_DONE pgs=604 cs=0 l=1 rx=0x7fe9c0002f70 tx=0x7fe9c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9ce7fc700 1 -- 172.21.15.63:0/335999042 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c0011ca0 con 0x7fe9d013cae0 2020-05-18T21:28:50.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9cffff700 1 -- 172.21.15.63:0/335999042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9d013cae0 msgr2=0x7fe9d0060fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9cffff700 1 --2- 172.21.15.63:0/335999042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9d013cae0 0x7fe9d0060fc0 secure :-1 s=READY pgs=604 cs=0 l=1 rx=0x7fe9c0002f70 tx=0x7fe9c0007a80).stop 2020-05-18T21:28:50.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9cffff700 1 -- 172.21.15.63:0/335999042 shutdown_connections 2020-05-18T21:28:50.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9cffff700 1 --2- 172.21.15.63:0/335999042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9d0062970 0x7fe9d0062db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:50.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9cffff700 1 --2- 172.21.15.63:0/335999042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9d013cae0 0x7fe9d0060fc0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:50.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9cffff700 1 -- 172.21.15.63:0/335999042 >> 172.21.15.63:0/335999042 conn(0x7fe9d005a7c0 msgr2=0x7fe9d005aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:50.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9cffff700 1 -- 172.21.15.63:0/335999042 shutdown_connections 2020-05-18T21:28:50.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.361+0000 7fe9cffff700 1 -- 172.21.15.63:0/335999042 wait complete. 2020-05-18T21:28:50.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9cffff700 1 Processor -- start 2020-05-18T21:28:50.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9cffff700 1 -- start start 2020-05-18T21:28:50.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9cffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9d0062970 0x7fe9d00650d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:50.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9cffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe9d01429e0 0x7fe9d013e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:50.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9cffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d013edd0 con 0x7fe9d013cae0 2020-05-18T21:28:50.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9cffff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d013f350 con 0x7fe9d01429e0 2020-05-18T21:28:50.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9cffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d013f090 con 0x7fe9d0062970 2020-05-18T21:28:50.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9cf7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe9d01429e0 0x7fe9d013e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:50.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9cf7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe9d01429e0 0x7fe9d013e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55644/0 (socket says 172.21.15.63:55644) 2020-05-18T21:28:50.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9cf7fe700 1 -- 172.21.15.63:0/1309118691 learned_addr learned my addr 172.21.15.63:0/1309118691 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:50.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9ceffd700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9d0062970 0x7fe9d00650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:50.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9ccff9700 1 -- 172.21.15.63:0/1309118691 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855024344 0 0) 0x7fe9d013edd0 con 0x7fe9d013cae0 2020-05-18T21:28:50.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9ccff9700 1 -- 172.21.15.63:0/1309118691 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9b4002fe0 con 0x7fe9d013cae0 2020-05-18T21:28:50.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9cf7fe700 1 -- 172.21.15.63:0/1309118691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9d0062970 msgr2=0x7fe9d00650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9cf7fe700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9d0062970 0x7fe9d00650d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:50.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9cf7fe700 1 -- 172.21.15.63:0/1309118691 >> v1:172.21.15.155:6789/0 conn(0x7fe9d013cae0 legacy=0x7fe9d0063360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9cf7fe700 1 -- 172.21.15.63:0/1309118691 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d0141ea0 con 0x7fe9d01429e0 2020-05-18T21:28:50.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9ceffd700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9d0062970 0x7fe9d00650d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:50.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9cf7fe700 1 --2- 172.21.15.63:0/1309118691 >> v2:172.21.15.63:3300/0 conn(0x7fe9d01429e0 0x7fe9d013e7a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9c80032f0 tx=0x7fe9c8010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9cf7fe700 1 --2- 172.21.15.63:0/1309118691 >> v2:172.21.15.63:3300/0 conn(0x7fe9d01429e0 0x7fe9d013e7a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9c80032f0 tx=0x7fe9c8010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.365+0000 7fe9cf7fe700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9d01429e0 0x7fe9d013e7a0 secure :-1 s=READY pgs=605 cs=0 l=1 rx=0x7fe9c80032f0 tx=0x7fe9c8010f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:50.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.369+0000 7fe9cf7fe700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9d01429e0 0x7fe9d013e7a0 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7fe9c80032f0 tx=0x7fe9c8010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.369+0000 7fe9cf7fe700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9d01429e0 0x7fe9d013e7a0 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7fe9c80032f0 tx=0x7fe9c8010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.369+0000 7fe9ccff9700 1 -- 172.21.15.63:0/1309118691 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c8005e70 con 0x7fe9d01429e0 2020-05-18T21:28:50.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.369+0000 7fe9cf7fe700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9d01429e0 0x7fe9d013e7a0 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7fe9c80032f0 tx=0x7fe9c8010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.369+0000 7fe9ccff9700 1 -- 172.21.15.63:0/1309118691 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c8007560 con 0x7fe9d01429e0 2020-05-18T21:28:50.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.369+0000 7fe9cffff700 1 -- 172.21.15.63:0/1309118691 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d0142150 con 0x7fe9d01429e0 2020-05-18T21:28:50.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.369+0000 7fe9ccff9700 1 -- 172.21.15.63:0/1309118691 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c8007900 con 0x7fe9d01429e0 2020-05-18T21:28:50.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.369+0000 7fe9cffff700 1 -- 172.21.15.63:0/1309118691 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d0063f30 con 0x7fe9d01429e0 2020-05-18T21:28:50.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.369+0000 7fe9cf7fe700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9d01429e0 0x7fe9d013e7a0 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7fe9c80032f0 tx=0x7fe9c8010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.369+0000 7fe9cffff700 1 -- 172.21.15.63:0/1309118691 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d013ec00 con 0x7fe9d01429e0 2020-05-18T21:28:50.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.369+0000 7fe9ccff9700 1 -- 172.21.15.63:0/1309118691 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe9c80101a0 con 0x7fe9d01429e0 2020-05-18T21:28:50.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.369+0000 7fe9cf7fe700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9d01429e0 0x7fe9d013e7a0 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7fe9c80032f0 tx=0x7fe9c8010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.369+0000 7fe9ccff9700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9b404fdd0 0x7fe9b4052290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:50.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.369+0000 7fe9ccff9700 1 -- 172.21.15.63:0/1309118691 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe9c8063be0 con 0x7fe9d01429e0 2020-05-18T21:28:50.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.369+0000 7fe9ceffd700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9b404fdd0 0x7fe9b4052290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:50.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.369+0000 7fe9ceffd700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9b404fdd0 0x7fe9b4052290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9c0002f70 tx=0x7fe9c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.373+0000 7fe9ceffd700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9b404fdd0 0x7fe9b4052290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9c0002f70 tx=0x7fe9c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.373+0000 7fe9ceffd700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9b404fdd0 0x7fe9b4052290 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7fe9c0002f70 tx=0x7fe9c0007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:50.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.377+0000 7fe9cf7fe700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9d01429e0 0x7fe9d013e7a0 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7fe9c80032f0 tx=0x7fe9c8010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.377+0000 7fe9ccff9700 1 -- 172.21.15.63:0/1309118691 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe9c803dfd0 con 0x7fe9d01429e0 2020-05-18T21:28:50.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.525+0000 7fe9cffff700 1 -- 172.21.15.63:0/1309118691 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9d00569e0 con 0x7fe9d01429e0 2020-05-18T21:28:50.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.529+0000 7fe9cf7fe700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9d01429e0 0x7fe9d013e7a0 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7fe9c80032f0 tx=0x7fe9c8010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.529+0000 7fe9ccff9700 1 -- 172.21.15.63:0/1309118691 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+2142 (secure 0 0 0) 0x7fe9c80415f0 con 0x7fe9d01429e0 2020-05-18T21:28:50.535 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:50.535 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":22,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/2663525728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2663525728},{"type":"v1","addr":"172.21.15.63:6833","nonce":2663525728}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:28:48.505607+0000","modified":"2020-05-18T21:28:50.219314+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5850},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5850":{"gid":5850,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1866128236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1866128236},{"type":"v1","addr":"172.21.15.155:6835","nonce":1866128236}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-05-18T21:28:50.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.529+0000 7fe9cffff700 1 -- 172.21.15.63:0/1309118691 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9b404fdd0 msgr2=0x7fe9b4052290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.529+0000 7fe9cffff700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9b404fdd0 0x7fe9b4052290 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7fe9c0002f70 tx=0x7fe9c0007a80).stop 2020-05-18T21:28:50.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.529+0000 7fe9cffff700 1 -- 172.21.15.63:0/1309118691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9d01429e0 msgr2=0x7fe9d013e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.529+0000 7fe9cffff700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9d01429e0 0x7fe9d013e7a0 secure :-1 s=READY pgs=605 cs=0 l=1 rx=0x7fe9c80032f0 tx=0x7fe9c8010f30).stop 2020-05-18T21:28:50.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.529+0000 7fe9cffff700 1 -- 172.21.15.63:0/1309118691 shutdown_connections 2020-05-18T21:28:50.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.529+0000 7fe9cffff700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9b404fdd0 0x7fe9b4052290 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:50.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.529+0000 7fe9cffff700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9d01429e0 0x7fe9d013e7a0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:50.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.529+0000 7fe9cffff700 1 --2- 172.21.15.63:0/1309118691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9d0062970 0x7fe9d00650d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:50.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.529+0000 7fe9cffff700 1 -- 172.21.15.63:0/1309118691 >> 172.21.15.63:0/1309118691 conn(0x7fe9d005a7c0 msgr2=0x7fe9d009dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:50.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.529+0000 7fe9cffff700 1 -- 172.21.15.63:0/1309118691 shutdown_connections 2020-05-18T21:28:50.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.529+0000 7fe9cffff700 1 -- 172.21.15.63:0/1309118691 wait complete. 2020-05-18T21:28:50.540 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 22 2020-05-18T21:28:50.553 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:28:50.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.653+0000 7f79e7fff700 1 Processor -- start 2020-05-18T21:28:50.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.653+0000 7f79e7fff700 1 -- start start 2020-05-18T21:28:50.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.653+0000 7f79e7fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79e81435d0 0x7f79e8063ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:50.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.653+0000 7f79e7fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e81480a0 con 0x7f79e80ad180 2020-05-18T21:28:50.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.653+0000 7f79e7fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e81476c0 con 0x7f79e8147140 2020-05-18T21:28:50.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.653+0000 7f79e7fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e8147960 con 0x7f79e81435d0 2020-05-18T21:28:50.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e77fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f79e80ad180 0x7f79e80ad5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57842/0 (socket says 172.21.15.63:57842) 2020-05-18T21:28:50.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e77fe700 1 -- 172.21.15.63:0/996961971 learned_addr learned my addr 172.21.15.63:0/996961971 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:50.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e6ffd700 1 --2- 172.21.15.63:0/996961971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79e81435d0 0x7f79e8063ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:50.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e5ffb700 1 -- 172.21.15.63:0/996961971 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517270758 0 0) 0x7f79e81480a0 con 0x7f79e80ad180 2020-05-18T21:28:50.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e5ffb700 1 -- 172.21.15.63:0/996961971 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79cc003270 con 0x7f79e80ad180 2020-05-18T21:28:50.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e5ffb700 1 -- 172.21.15.63:0/996961971 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893053286 0 0) 0x7f79e81476c0 con 0x7f79e8147140 2020-05-18T21:28:50.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e5ffb700 1 -- 172.21.15.63:0/996961971 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79e81480a0 con 0x7f79e8147140 2020-05-18T21:28:50.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e5ffb700 1 -- 172.21.15.63:0/996961971 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4080081185 0 0) 0x7f79cc003270 con 0x7f79e80ad180 2020-05-18T21:28:50.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e6ffd700 1 -- 172.21.15.63:0/996961971 >> v1:172.21.15.155:6789/0 conn(0x7f79e8147140 legacy=0x7f79e805edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e6ffd700 1 -- 172.21.15.63:0/996961971 >> v1:172.21.15.63:6789/0 conn(0x7f79e80ad180 legacy=0x7f79e80ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e6ffd700 1 -- 172.21.15.63:0/996961971 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e8147c00 con 0x7f79e81435d0 2020-05-18T21:28:50.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e6ffd700 1 --2- 172.21.15.63:0/996961971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79e81435d0 0x7f79e8063ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f79e0001490 tx=0x7f79d8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e6ffd700 1 --2- 172.21.15.63:0/996961971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79e81435d0 0x7f79e8063ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f79e0001490 tx=0x7f79d8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e6ffd700 1 --2- 172.21.15.63:0/996961971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79e81435d0 0x7f79e8063ce0 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f79e0001490 tx=0x7f79d8008920).ready entity=mon.2 client_cookie=8dc41522d1816214 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:50.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e6ffd700 1 --2- 172.21.15.63:0/996961971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79e81435d0 0x7f79e8063ce0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f79e0001490 tx=0x7f79d8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e5ffb700 1 -- 172.21.15.63:0/996961971 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79e0001a90 con 0x7f79e81435d0 2020-05-18T21:28:50.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e6ffd700 1 --2- 172.21.15.63:0/996961971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79e81435d0 0x7f79e8063ce0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f79e0001490 tx=0x7f79d8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e5ffb700 1 -- 172.21.15.63:0/996961971 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d8008e80 con 0x7f79e81435d0 2020-05-18T21:28:50.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e6ffd700 1 --2- 172.21.15.63:0/996961971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79e81435d0 0x7f79e8063ce0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f79e0001490 tx=0x7f79d8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e5ffb700 1 -- 172.21.15.63:0/996961971 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d8011440 con 0x7f79e81435d0 2020-05-18T21:28:50.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e7fff700 1 -- 172.21.15.63:0/996961971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79e81435d0 msgr2=0x7f79e8063ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e7fff700 1 --2- 172.21.15.63:0/996961971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79e81435d0 0x7f79e8063ce0 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f79e0001490 tx=0x7f79d8008920).stop 2020-05-18T21:28:50.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e7fff700 1 -- 172.21.15.63:0/996961971 shutdown_connections 2020-05-18T21:28:50.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e7fff700 1 --2- 172.21.15.63:0/996961971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79e81435d0 0x7f79e8063ce0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:50.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e7fff700 1 -- 172.21.15.63:0/996961971 >> 172.21.15.63:0/996961971 conn(0x7f79e8069fc0 msgr2=0x7f79e806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:50.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e7fff700 1 -- 172.21.15.63:0/996961971 shutdown_connections 2020-05-18T21:28:50.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.657+0000 7f79e7fff700 1 -- 172.21.15.63:0/996961971 wait complete. 2020-05-18T21:28:50.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e7fff700 1 Processor -- start 2020-05-18T21:28:50.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e7fff700 1 -- start start 2020-05-18T21:28:50.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f79e81435d0 0x7f79e813e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:50.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e7fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e80b4000 con 0x7f79e80ad180 2020-05-18T21:28:50.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e7fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e80b42a0 con 0x7f79e8147140 2020-05-18T21:28:50.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e7fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e813b670 con 0x7f79e81435d0 2020-05-18T21:28:50.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e6ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f79e80ad180 0x7f79e813af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57844/0 (socket says 172.21.15.63:57844) 2020-05-18T21:28:50.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e6ffd700 1 -- 172.21.15.63:0/52426780 learned_addr learned my addr 172.21.15.63:0/52426780 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:50.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e67fc700 1 --2- 172.21.15.63:0/52426780 >> v2:172.21.15.155:3300/0 conn(0x7f79e81435d0 0x7f79e813e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:50.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230390939 0 0) 0x7f79e80b4000 con 0x7f79e80ad180 2020-05-18T21:28:50.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79c4002fe0 con 0x7f79e80ad180 2020-05-18T21:28:50.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207315146 0 0) 0x7f79e80b42a0 con 0x7f79e8147140 2020-05-18T21:28:50.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79e80b4000 con 0x7f79e8147140 2020-05-18T21:28:50.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 779535091 0 0) 0x7f79c4002fe0 con 0x7f79e80ad180 2020-05-18T21:28:50.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f79e80b42a0 con 0x7f79e80ad180 2020-05-18T21:28:50.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f79d80086a0 con 0x7f79e80ad180 2020-05-18T21:28:50.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 >> v2:172.21.15.155:3300/0 conn(0x7f79e81435d0 msgr2=0x7f79e813e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79d7fff700 1 --2- 172.21.15.63:0/52426780 >> v2:172.21.15.155:3300/0 conn(0x7f79e81435d0 0x7f79e813e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:50.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 >> v1:172.21.15.155:6789/0 conn(0x7f79e8147140 legacy=0x7f79e8137ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 >> v1:172.21.15.63:6789/0 conn(0x7f79e80ad180 legacy=0x7f79e813af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79d7fff700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79c4004bf0 0x7f79c4004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:50.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79d7fff700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79c4003b30 0x7f79c4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:50.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79d7fff700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79c40043d0 0x7f79c400b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:50.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e813b670 con 0x7f79c40043d0 2020-05-18T21:28:50.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c400bbc0 con 0x7f79c4003b30 2020-05-18T21:28:50.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c400bd00 con 0x7f79c4004bf0 2020-05-18T21:28:50.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e77fe700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79c40043d0 0x7f79c400b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:50.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e6ffd700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79c4004bf0 0x7f79c4004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:50.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e67fc700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79c4003b30 0x7f79c4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:50.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e77fe700 1 -- 172.21.15.63:0/52426780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79c4004bf0 msgr2=0x7f79c4004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e77fe700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79c4004bf0 0x7f79c4004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:50.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e77fe700 1 -- 172.21.15.63:0/52426780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79c4003b30 msgr2=0x7f79c4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e77fe700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79c4003b30 0x7f79c4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:50.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e77fe700 1 -- 172.21.15.63:0/52426780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e80b4540 con 0x7f79c40043d0 2020-05-18T21:28:50.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e7fff700 1 -- 172.21.15.63:0/52426780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e8062970 con 0x7f79c40043d0 2020-05-18T21:28:50.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e7fff700 1 -- 172.21.15.63:0/52426780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e80b2910 con 0x7f79c40043d0 2020-05-18T21:28:50.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.661+0000 7f79e77fe700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79c40043d0 0x7f79c400b760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79e0001c70 tx=0x7f79e00110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.665+0000 7f79e77fe700 1 -- 172.21.15.63:0/52426780 reap_dead start 2020-05-18T21:28:50.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.665+0000 7f79e77fe700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79c40043d0 0x7f79c400b760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79e0001c70 tx=0x7f79e00110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.665+0000 7f79e77fe700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79c40043d0 0x7f79c400b760 secure :-1 s=READY pgs=608 cs=0 l=1 rx=0x7f79e0001c70 tx=0x7f79e00110f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:50.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.665+0000 7f79e77fe700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79c40043d0 0x7f79c400b760 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f79e0001c70 tx=0x7f79e00110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.665+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79e000ce20 con 0x7f79c40043d0 2020-05-18T21:28:50.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.665+0000 7f79e77fe700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79c40043d0 0x7f79c400b760 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f79e0001c70 tx=0x7f79e00110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.665+0000 7f79e77fe700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79c40043d0 0x7f79c400b760 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f79e0001c70 tx=0x7f79e00110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.665+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e0004aa0 con 0x7f79c40043d0 2020-05-18T21:28:50.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.665+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79e0004e00 con 0x7f79c40043d0 2020-05-18T21:28:50.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.665+0000 7f79e7fff700 1 -- 172.21.15.63:0/52426780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c8003380 con 0x7f79c40043d0 2020-05-18T21:28:50.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.665+0000 7f79e77fe700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79c40043d0 0x7f79c400b760 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f79e0001c70 tx=0x7f79e00110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.665+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f79e00061a0 con 0x7f79c40043d0 2020-05-18T21:28:50.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.665+0000 7f79e77fe700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79c40043d0 0x7f79c400b760 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f79e0001c70 tx=0x7f79e00110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.665+0000 7f79d7fff700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f79c4053a90 0x7f79c4055f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:50.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.665+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f79e0063b60 con 0x7f79c40043d0 2020-05-18T21:28:50.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.665+0000 7f79e6ffd700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f79c4053a90 0x7f79c4055f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:50.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.665+0000 7f79e6ffd700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f79c4053a90 0x7f79c4055f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79e80b7d80 tx=0x7f79e80b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.665+0000 7f79e6ffd700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f79c4053a90 0x7f79c4055f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79e80b7d80 tx=0x7f79e80b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.665+0000 7f79e6ffd700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f79c4053a90 0x7f79c4055f50 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f79e80b7d80 tx=0x7f79e80b4cd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:50.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.673+0000 7f79e77fe700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79c40043d0 0x7f79c400b760 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f79e0001c70 tx=0x7f79e00110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.673+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f79e003de90 con 0x7f79c40043d0 2020-05-18T21:28:50.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.789+0000 7f79e7fff700 1 -- 172.21.15.63:0/52426780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79c8002210 con 0x7f79c40043d0 2020-05-18T21:28:50.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.793+0000 7f79e77fe700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79c40043d0 0x7f79c400b760 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f79e0001c70 tx=0x7f79e00110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.793+0000 7f79d7fff700 1 -- 172.21.15.63:0/52426780 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16091 (secure 0 0 0) 0x7f79e00414b0 con 0x7f79c40043d0 2020-05-18T21:28:50.798 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:50.798 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":51,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:28:49.508247+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:28:46.842474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2020-05-18T21:28:47.510399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:28:50.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.793+0000 7f79e7fff700 1 -- 172.21.15.63:0/52426780 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f79c4053a90 msgr2=0x7f79c4055f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.793+0000 7f79e7fff700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f79c4053a90 0x7f79c4055f50 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f79e80b7d80 tx=0x7f79e80b4cd0).stop 2020-05-18T21:28:50.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.793+0000 7f79e7fff700 1 -- 172.21.15.63:0/52426780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79c40043d0 msgr2=0x7f79c400b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.793+0000 7f79e7fff700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79c40043d0 0x7f79c400b760 secure :-1 s=READY pgs=608 cs=0 l=1 rx=0x7f79e0001c70 tx=0x7f79e00110f0).stop 2020-05-18T21:28:50.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.793+0000 7f79e7fff700 1 -- 172.21.15.63:0/52426780 shutdown_connections 2020-05-18T21:28:50.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.793+0000 7f79e7fff700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f79c4053a90 0x7f79c4055f50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:50.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.793+0000 7f79e7fff700 1 --2- 172.21.15.63:0/52426780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79c40043d0 0x7f79c400b760 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:50.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.793+0000 7f79e7fff700 1 -- 172.21.15.63:0/52426780 >> 172.21.15.63:0/52426780 conn(0x7f79e8069fc0 msgr2=0x7f79e8064550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:50.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.793+0000 7f79e7fff700 1 -- 172.21.15.63:0/52426780 shutdown_connections 2020-05-18T21:28:50.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.793+0000 7f79e7fff700 1 -- 172.21.15.63:0/52426780 wait complete. 2020-05-18T21:28:50.811 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:28:50.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.921+0000 7fc624620700 1 Processor -- start 2020-05-18T21:28:50.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.921+0000 7fc624620700 1 -- start start 2020-05-18T21:28:50.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.921+0000 7fc624620700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc61c15b9c0 0x7fc61c15ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:50.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.921+0000 7fc624620700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61c157510 con 0x7fc61c0b8c30 2020-05-18T21:28:50.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.921+0000 7fc624620700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61c065a70 con 0x7fc61c0ad070 2020-05-18T21:28:50.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.921+0000 7fc624620700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c0801d0 con 0x7fc61c15b9c0 2020-05-18T21:28:50.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.921+0000 7fc622bbd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc61c0b8c30 0x7fc61c1566f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57858/0 (socket says 172.21.15.63:57858) 2020-05-18T21:28:50.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.921+0000 7fc622bbd700 1 -- 172.21.15.63:0/2623144517 learned_addr learned my addr 172.21.15.63:0/2623144517 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:50.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.921+0000 7fc6233be700 1 --2- 172.21.15.63:0/2623144517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc61c15b9c0 0x7fc61c15ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:50.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.921+0000 7fc621bbb700 1 -- 172.21.15.63:0/2623144517 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908532952 0 0) 0x7fc61c157510 con 0x7fc61c0b8c30 2020-05-18T21:28:50.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.921+0000 7fc621bbb700 1 -- 172.21.15.63:0/2623144517 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc608003270 con 0x7fc61c0b8c30 2020-05-18T21:28:50.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.921+0000 7fc621bbb700 1 -- 172.21.15.63:0/2623144517 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280827351 0 0) 0x7fc61c065a70 con 0x7fc61c0ad070 2020-05-18T21:28:50.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.921+0000 7fc621bbb700 1 -- 172.21.15.63:0/2623144517 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc61c157510 con 0x7fc61c0ad070 2020-05-18T21:28:50.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.921+0000 7fc6233be700 1 -- 172.21.15.63:0/2623144517 >> v1:172.21.15.155:6789/0 conn(0x7fc61c0ad070 legacy=0x7fc61c156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.921+0000 7fc6233be700 1 -- 172.21.15.63:0/2623144517 >> v1:172.21.15.63:6789/0 conn(0x7fc61c0b8c30 legacy=0x7fc61c1566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.921+0000 7fc621bbb700 1 -- 172.21.15.63:0/2623144517 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1597727062 0 0) 0x7fc608003270 con 0x7fc61c0b8c30 2020-05-18T21:28:50.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.921+0000 7fc6233be700 1 -- 172.21.15.63:0/2623144517 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c0b9010 con 0x7fc61c15b9c0 2020-05-18T21:28:50.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.921+0000 7fc6233be700 1 --2- 172.21.15.63:0/2623144517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc61c15b9c0 0x7fc61c15ddb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc618001110 tx=0x7fc614008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.925+0000 7fc6233be700 1 --2- 172.21.15.63:0/2623144517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc61c15b9c0 0x7fc61c15ddb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc618001110 tx=0x7fc614008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.925+0000 7fc6233be700 1 --2- 172.21.15.63:0/2623144517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc61c15b9c0 0x7fc61c15ddb0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fc618001110 tx=0x7fc614008ca0).ready entity=mon.2 client_cookie=6089e1aef6593335 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:50.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.925+0000 7fc6233be700 1 --2- 172.21.15.63:0/2623144517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc61c15b9c0 0x7fc61c15ddb0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fc618001110 tx=0x7fc614008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.925+0000 7fc621bbb700 1 -- 172.21.15.63:0/2623144517 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc618001710 con 0x7fc61c15b9c0 2020-05-18T21:28:50.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.925+0000 7fc6233be700 1 --2- 172.21.15.63:0/2623144517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc61c15b9c0 0x7fc61c15ddb0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fc618001110 tx=0x7fc614008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.925+0000 7fc6233be700 1 --2- 172.21.15.63:0/2623144517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc61c15b9c0 0x7fc61c15ddb0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fc618001110 tx=0x7fc614008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.925+0000 7fc621bbb700 1 -- 172.21.15.63:0/2623144517 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc614011ac0 con 0x7fc61c15b9c0 2020-05-18T21:28:50.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.925+0000 7fc621bbb700 1 -- 172.21.15.63:0/2623144517 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc614011e60 con 0x7fc61c15b9c0 2020-05-18T21:28:50.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.925+0000 7fc624620700 1 -- 172.21.15.63:0/2623144517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc61c15b9c0 msgr2=0x7fc61c15ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.925+0000 7fc624620700 1 --2- 172.21.15.63:0/2623144517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc61c15b9c0 0x7fc61c15ddb0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fc618001110 tx=0x7fc614008ca0).stop 2020-05-18T21:28:50.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.925+0000 7fc624620700 1 -- 172.21.15.63:0/2623144517 shutdown_connections 2020-05-18T21:28:50.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.925+0000 7fc624620700 1 --2- 172.21.15.63:0/2623144517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc61c15b9c0 0x7fc61c15ddb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:50.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.925+0000 7fc624620700 1 -- 172.21.15.63:0/2623144517 >> 172.21.15.63:0/2623144517 conn(0x7fc61c06a640 msgr2=0x7fc61c0b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:50.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.925+0000 7fc624620700 1 -- 172.21.15.63:0/2623144517 shutdown_connections 2020-05-18T21:28:50.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.925+0000 7fc624620700 1 -- 172.21.15.63:0/2623144517 wait complete. 2020-05-18T21:28:50.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc624620700 1 Processor -- start 2020-05-18T21:28:50.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc624620700 1 -- start start 2020-05-18T21:28:50.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc624620700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc61c0ad070 0x7fc61c13ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:50.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc624620700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc61c0b8c30 0x7fc61c061dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:50.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc624620700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61c07f820 con 0x7fc61c15b9c0 2020-05-18T21:28:50.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc624620700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61c06f890 con 0x7fc61c0b8c30 2020-05-18T21:28:50.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc624620700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61c07fd60 con 0x7fc61c0ad070 2020-05-18T21:28:50.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc6223bc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc61c0b8c30 0x7fc61c061dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:50.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc6223bc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc61c0b8c30 0x7fc61c061dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55678/0 (socket says 172.21.15.63:55678) 2020-05-18T21:28:50.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc6223bc700 1 -- 172.21.15.63:0/3479484590 learned_addr learned my addr 172.21.15.63:0/3479484590 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:50.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc622bbd700 1 --2- 172.21.15.63:0/3479484590 >> v2:172.21.15.155:3300/0 conn(0x7fc61c0ad070 0x7fc61c13ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:50.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc6223bc700 1 -- 172.21.15.63:0/3479484590 >> v2:172.21.15.155:3300/0 conn(0x7fc61c0ad070 msgr2=0x7fc61c13ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc6223bc700 1 --2- 172.21.15.63:0/3479484590 >> v2:172.21.15.155:3300/0 conn(0x7fc61c0ad070 0x7fc61c13ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:50.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc6223bc700 1 -- 172.21.15.63:0/3479484590 >> v1:172.21.15.155:6789/0 conn(0x7fc61c15b9c0 legacy=0x7fc61c06fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:50.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc6223bc700 1 -- 172.21.15.63:0/3479484590 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c07fac0 con 0x7fc61c0b8c30 2020-05-18T21:28:50.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc6223bc700 1 --2- 172.21.15.63:0/3479484590 >> v2:172.21.15.63:3300/0 conn(0x7fc61c0b8c30 0x7fc61c061dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc60c001110 tx=0x7fc60c002ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc6223bc700 1 --2- 172.21.15.63:0/3479484590 >> v2:172.21.15.63:3300/0 conn(0x7fc61c0b8c30 0x7fc61c061dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc60c001110 tx=0x7fc60c002ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc6223bc700 1 --2- 172.21.15.63:0/3479484590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc61c0b8c30 0x7fc61c061dc0 secure :-1 s=READY pgs=610 cs=0 l=1 rx=0x7fc60c001110 tx=0x7fc60c002ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:50.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc6223bc700 1 --2- 172.21.15.63:0/3479484590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc61c0b8c30 0x7fc61c061dc0 secure :-1 s=THROTTLE_DONE pgs=610 cs=0 l=1 rx=0x7fc60c001110 tx=0x7fc60c002ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc6223bc700 1 --2- 172.21.15.63:0/3479484590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc61c0b8c30 0x7fc61c061dc0 secure :-1 s=THROTTLE_DONE pgs=610 cs=0 l=1 rx=0x7fc60c001110 tx=0x7fc60c002ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc6137fe700 1 -- 172.21.15.63:0/3479484590 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc60c00cc30 con 0x7fc61c0b8c30 2020-05-18T21:28:50.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc6223bc700 1 --2- 172.21.15.63:0/3479484590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc61c0b8c30 0x7fc61c061dc0 secure :-1 s=THROTTLE_DONE pgs=610 cs=0 l=1 rx=0x7fc60c001110 tx=0x7fc60c002ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc6137fe700 1 -- 172.21.15.63:0/3479484590 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60c00cd90 con 0x7fc61c0b8c30 2020-05-18T21:28:50.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc624620700 1 -- 172.21.15.63:0/3479484590 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61c15aa00 con 0x7fc61c0b8c30 2020-05-18T21:28:50.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc6137fe700 1 -- 172.21.15.63:0/3479484590 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc60c014440 con 0x7fc61c0b8c30 2020-05-18T21:28:50.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.929+0000 7fc624620700 1 -- 172.21.15.63:0/3479484590 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61c07f0a0 con 0x7fc61c0b8c30 2020-05-18T21:28:50.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.933+0000 7fc6223bc700 1 --2- 172.21.15.63:0/3479484590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc61c0b8c30 0x7fc61c061dc0 secure :-1 s=THROTTLE_DONE pgs=610 cs=0 l=1 rx=0x7fc60c001110 tx=0x7fc60c002ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.933+0000 7fc624620700 1 -- 172.21.15.63:0/3479484590 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61c06f9e0 con 0x7fc61c0b8c30 2020-05-18T21:28:50.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.933+0000 7fc6137fe700 1 -- 172.21.15.63:0/3479484590 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc60c0146b0 con 0x7fc61c0b8c30 2020-05-18T21:28:50.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.933+0000 7fc6223bc700 1 --2- 172.21.15.63:0/3479484590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc61c0b8c30 0x7fc61c061dc0 secure :-1 s=THROTTLE_DONE pgs=610 cs=0 l=1 rx=0x7fc60c001110 tx=0x7fc60c002ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.933+0000 7fc6137fe700 1 --2- 172.21.15.63:0/3479484590 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc60404fa60 0x7fc604051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:50.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.933+0000 7fc6137fe700 1 -- 172.21.15.63:0/3479484590 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc60c065ef0 con 0x7fc61c0b8c30 2020-05-18T21:28:50.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.933+0000 7fc622bbd700 1 --2- 172.21.15.63:0/3479484590 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc60404fa60 0x7fc604051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:50.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.933+0000 7fc622bbd700 1 --2- 172.21.15.63:0/3479484590 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc60404fa60 0x7fc604051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc618000fe0 tx=0x7fc61800cb50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.933+0000 7fc622bbd700 1 --2- 172.21.15.63:0/3479484590 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc60404fa60 0x7fc604051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc618000fe0 tx=0x7fc61800cb50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.933+0000 7fc622bbd700 1 --2- 172.21.15.63:0/3479484590 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc60404fa60 0x7fc604051f20 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7fc618000fe0 tx=0x7fc61800cb50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:50.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.937+0000 7fc6223bc700 1 --2- 172.21.15.63:0/3479484590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc61c0b8c30 0x7fc61c061dc0 secure :-1 s=THROTTLE_DONE pgs=610 cs=0 l=1 rx=0x7fc60c001110 tx=0x7fc60c002ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:50.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:50.937+0000 7fc6137fe700 1 -- 172.21.15.63:0/3479484590 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc60c040220 con 0x7fc61c0b8c30 2020-05-18T21:28:51.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.093+0000 7fc624620700 1 -- 172.21.15.63:0/3479484590 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fc61c0569e0 con 0x7fc61c0b8c30 2020-05-18T21:28:51.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.097+0000 7fc6223bc700 1 --2- 172.21.15.63:0/3479484590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc61c0b8c30 0x7fc61c061dc0 secure :-1 s=THROTTLE_DONE pgs=610 cs=0 l=1 rx=0x7fc60c001110 tx=0x7fc60c002ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.097+0000 7fc6137fe700 1 -- 172.21.15.63:0/3479484590 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v19) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc60c043840 con 0x7fc61c0b8c30 2020-05-18T21:28:51.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.101+0000 7fc624620700 1 -- 172.21.15.63:0/3479484590 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc60404fa60 msgr2=0x7fc604051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.101+0000 7fc624620700 1 --2- 172.21.15.63:0/3479484590 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc60404fa60 0x7fc604051f20 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7fc618000fe0 tx=0x7fc61800cb50).stop 2020-05-18T21:28:51.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.101+0000 7fc624620700 1 -- 172.21.15.63:0/3479484590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc61c0b8c30 msgr2=0x7fc61c061dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.101+0000 7fc624620700 1 --2- 172.21.15.63:0/3479484590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc61c0b8c30 0x7fc61c061dc0 secure :-1 s=READY pgs=610 cs=0 l=1 rx=0x7fc60c001110 tx=0x7fc60c002ea0).stop 2020-05-18T21:28:51.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.101+0000 7fc624620700 1 -- 172.21.15.63:0/3479484590 shutdown_connections 2020-05-18T21:28:51.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.101+0000 7fc624620700 1 --2- 172.21.15.63:0/3479484590 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc60404fa60 0x7fc604051f20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:51.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.101+0000 7fc624620700 1 --2- 172.21.15.63:0/3479484590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc61c0b8c30 0x7fc61c061dc0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:51.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.101+0000 7fc624620700 1 --2- 172.21.15.63:0/3479484590 >> v2:172.21.15.155:3300/0 conn(0x7fc61c0ad070 0x7fc61c13ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:51.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.101+0000 7fc624620700 1 -- 172.21.15.63:0/3479484590 >> 172.21.15.63:0/3479484590 conn(0x7fc61c06a640 msgr2=0x7fc61c05f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:51.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.101+0000 7fc624620700 1 -- 172.21.15.63:0/3479484590 shutdown_connections 2020-05-18T21:28:51.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.101+0000 7fc624620700 1 -- 172.21.15.63:0/3479484590 wait complete. 2020-05-18T21:28:51.110 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.0 2020-05-18T21:28:51.124 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:28:51.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.233+0000 7f7c2f59e700 1 Processor -- start 2020-05-18T21:28:51.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.233+0000 7f7c2f59e700 1 -- start start 2020-05-18T21:28:51.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.233+0000 7f7c2f59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7c300b6410 0x7f7c300b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:51.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.233+0000 7f7c2f59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c30025500 con 0x7f7c300b5cb0 2020-05-18T21:28:51.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.233+0000 7f7c2f59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c30064ee0 con 0x7f7c30151bc0 2020-05-18T21:28:51.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.233+0000 7f7c2f59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c300b67f0 con 0x7f7c300b6410 2020-05-18T21:28:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.233+0000 7f7c2ed9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7c300b6410 0x7f7c300b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.233+0000 7f7c2e59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7c300b5cb0 0x7f7c30061af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57874/0 (socket says 172.21.15.63:57874) 2020-05-18T21:28:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.233+0000 7f7c2e59c700 1 -- 172.21.15.63:0/646481623 learned_addr learned my addr 172.21.15.63:0/646481623 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2ed9d700 1 -- 172.21.15.63:0/646481623 >> v1:172.21.15.155:6789/0 conn(0x7f7c30151bc0 legacy=0x7f7c30152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2ed9d700 1 -- 172.21.15.63:0/646481623 >> v1:172.21.15.63:6789/0 conn(0x7f7c300b5cb0 legacy=0x7f7c30061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2dd9b700 1 -- 172.21.15.63:0/646481623 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944298354 0 0) 0x7f7c30025500 con 0x7f7c300b5cb0 2020-05-18T21:28:51.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2ed9d700 1 -- 172.21.15.63:0/646481623 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c30025180 con 0x7f7c300b6410 2020-05-18T21:28:51.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2ed9d700 1 --2- 172.21.15.63:0/646481623 >> v2:172.21.15.63:3300/0 conn(0x7f7c300b6410 0x7f7c300b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7c20002f70 tx=0x7f7c20007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2ed9d700 1 --2- 172.21.15.63:0/646481623 >> v2:172.21.15.63:3300/0 conn(0x7f7c300b6410 0x7f7c300b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7c20002f70 tx=0x7f7c20007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2ed9d700 1 --2- 172.21.15.63:0/646481623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c300b6410 0x7f7c300b6cd0 secure :-1 s=READY pgs=612 cs=0 l=1 rx=0x7f7c20002f70 tx=0x7f7c20007a80).ready entity=mon.0 client_cookie=8e07b16f7e07b5f6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2ed9d700 1 --2- 172.21.15.63:0/646481623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c300b6410 0x7f7c300b6cd0 secure :-1 s=THROTTLE_DONE pgs=612 cs=0 l=1 rx=0x7f7c20002f70 tx=0x7f7c20007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2dd9b700 1 -- 172.21.15.63:0/646481623 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c20008e80 con 0x7f7c300b6410 2020-05-18T21:28:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2ed9d700 1 --2- 172.21.15.63:0/646481623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c300b6410 0x7f7c300b6cd0 secure :-1 s=THROTTLE_DONE pgs=612 cs=0 l=1 rx=0x7f7c20002f70 tx=0x7f7c20007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2ed9d700 1 --2- 172.21.15.63:0/646481623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c300b6410 0x7f7c300b6cd0 secure :-1 s=THROTTLE_DONE pgs=612 cs=0 l=1 rx=0x7f7c20002f70 tx=0x7f7c20007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2dd9b700 1 -- 172.21.15.63:0/646481623 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c200116a0 con 0x7f7c300b6410 2020-05-18T21:28:51.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2dd9b700 1 -- 172.21.15.63:0/646481623 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c20011ac0 con 0x7f7c300b6410 2020-05-18T21:28:51.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2f59e700 1 -- 172.21.15.63:0/646481623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c300b6410 msgr2=0x7f7c300b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2f59e700 1 --2- 172.21.15.63:0/646481623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c300b6410 0x7f7c300b6cd0 secure :-1 s=READY pgs=612 cs=0 l=1 rx=0x7f7c20002f70 tx=0x7f7c20007a80).stop 2020-05-18T21:28:51.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2f59e700 1 -- 172.21.15.63:0/646481623 shutdown_connections 2020-05-18T21:28:51.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2f59e700 1 --2- 172.21.15.63:0/646481623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c300b6410 0x7f7c300b6cd0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:51.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2f59e700 1 -- 172.21.15.63:0/646481623 >> 172.21.15.63:0/646481623 conn(0x7f7c30069b70 msgr2=0x7f7c30069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:51.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2f59e700 1 -- 172.21.15.63:0/646481623 shutdown_connections 2020-05-18T21:28:51.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2f59e700 1 -- 172.21.15.63:0/646481623 wait complete. 2020-05-18T21:28:51.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2f59e700 1 Processor -- start 2020-05-18T21:28:51.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.237+0000 7f7c2f59e700 1 -- start start 2020-05-18T21:28:51.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c2f59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7c300b6410 0x7f7c300782a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:51.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c2f59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c30156130 con 0x7f7c300b5cb0 2020-05-18T21:28:51.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c2f59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c301563d0 con 0x7f7c30151bc0 2020-05-18T21:28:51.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c2f59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c30154240 con 0x7f7c300b6410 2020-05-18T21:28:51.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c2e59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7c300b6410 0x7f7c300782a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:51.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c2ed9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7c300b5cb0 0x7f7c30153b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57878/0 (socket says 172.21.15.63:57878) 2020-05-18T21:28:51.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c2e59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7c300b6410 0x7f7c300782a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55692/0 (socket says 172.21.15.63:55692) 2020-05-18T21:28:51.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c2ed9d700 1 -- 172.21.15.63:0/1039446045 learned_addr learned my addr 172.21.15.63:0/1039446045 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:51.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c2e59c700 1 -- 172.21.15.63:0/1039446045 >> v1:172.21.15.155:6789/0 conn(0x7f7c30151bc0 legacy=0x7f7c301527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c2e59c700 1 -- 172.21.15.63:0/1039446045 >> v1:172.21.15.63:6789/0 conn(0x7f7c300b5cb0 legacy=0x7f7c30153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c2e59c700 1 -- 172.21.15.63:0/1039446045 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c30154380 con 0x7f7c300b6410 2020-05-18T21:28:51.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c2e59c700 1 --2- 172.21.15.63:0/1039446045 >> v2:172.21.15.63:3300/0 conn(0x7f7c300b6410 0x7f7c300782a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c24000bc0 tx=0x7f7c240109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c2e59c700 1 --2- 172.21.15.63:0/1039446045 >> v2:172.21.15.63:3300/0 conn(0x7f7c300b6410 0x7f7c300782a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c24000bc0 tx=0x7f7c240109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c2e59c700 1 --2- 172.21.15.63:0/1039446045 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c300b6410 0x7f7c300782a0 secure :-1 s=READY pgs=614 cs=0 l=1 rx=0x7f7c24000bc0 tx=0x7f7c240109b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:51.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c2e59c700 1 --2- 172.21.15.63:0/1039446045 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c300b6410 0x7f7c300782a0 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7f7c24000bc0 tx=0x7f7c240109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c2e59c700 1 --2- 172.21.15.63:0/1039446045 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c300b6410 0x7f7c300782a0 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7f7c24000bc0 tx=0x7f7c240109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c2e59c700 1 --2- 172.21.15.63:0/1039446045 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c300b6410 0x7f7c300782a0 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7f7c24000bc0 tx=0x7f7c240109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c1f7fe700 1 -- 172.21.15.63:0/1039446045 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c24005ce0 con 0x7f7c300b6410 2020-05-18T21:28:51.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c1f7fe700 1 -- 172.21.15.63:0/1039446045 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c24005e40 con 0x7f7c300b6410 2020-05-18T21:28:51.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c2f59e700 1 -- 172.21.15.63:0/1039446045 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c30156870 con 0x7f7c300b6410 2020-05-18T21:28:51.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c1f7fe700 1 -- 172.21.15.63:0/1039446045 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c24006340 con 0x7f7c300b6410 2020-05-18T21:28:51.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.241+0000 7f7c2f59e700 1 -- 172.21.15.63:0/1039446045 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c30144830 con 0x7f7c300b6410 2020-05-18T21:28:51.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.245+0000 7f7c2e59c700 1 --2- 172.21.15.63:0/1039446045 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c300b6410 0x7f7c300782a0 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7f7c24000bc0 tx=0x7f7c240109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.245+0000 7f7c1f7fe700 1 -- 172.21.15.63:0/1039446045 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7c240065b0 con 0x7f7c300b6410 2020-05-18T21:28:51.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.245+0000 7f7c2e59c700 1 --2- 172.21.15.63:0/1039446045 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c300b6410 0x7f7c300782a0 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7f7c24000bc0 tx=0x7f7c240109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.245+0000 7f7c2f59e700 1 -- 172.21.15.63:0/1039446045 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c30144ce0 con 0x7f7c300b6410 2020-05-18T21:28:51.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.245+0000 7f7c1f7fe700 1 --2- 172.21.15.63:0/1039446045 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c1404f960 0x7f7c14051e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:51.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.245+0000 7f7c1f7fe700 1 -- 172.21.15.63:0/1039446045 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7c240090c0 con 0x7f7c300b6410 2020-05-18T21:28:51.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.245+0000 7f7c2ed9d700 1 --2- 172.21.15.63:0/1039446045 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c1404f960 0x7f7c14051e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:51.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.245+0000 7f7c2ed9d700 1 --2- 172.21.15.63:0/1039446045 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c1404f960 0x7f7c14051e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c30078ed0 tx=0x7f7c20007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.245+0000 7f7c2ed9d700 1 --2- 172.21.15.63:0/1039446045 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c1404f960 0x7f7c14051e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c30078ed0 tx=0x7f7c20007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.245+0000 7f7c2ed9d700 1 --2- 172.21.15.63:0/1039446045 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c1404f960 0x7f7c14051e20 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7f7c30078ed0 tx=0x7f7c20007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:51.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.249+0000 7f7c2e59c700 1 --2- 172.21.15.63:0/1039446045 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c300b6410 0x7f7c300782a0 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7f7c24000bc0 tx=0x7f7c240109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.249+0000 7f7c1f7fe700 1 -- 172.21.15.63:0/1039446045 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f7c2403e1e0 con 0x7f7c300b6410 2020-05-18T21:28:51.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.401+0000 7f7c2f59e700 1 -- 172.21.15.63:0/1039446045 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7c30156560 con 0x7f7c300b6410 2020-05-18T21:28:51.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.405+0000 7f7c2e59c700 1 --2- 172.21.15.63:0/1039446045 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c300b6410 0x7f7c300782a0 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7f7c24000bc0 tx=0x7f7c240109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.405+0000 7f7c1f7fe700 1 -- 172.21.15.63:0/1039446045 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v20) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7c24041800 con 0x7f7c300b6410 2020-05-18T21:28:51.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.409+0000 7f7c2f59e700 1 -- 172.21.15.63:0/1039446045 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c1404f960 msgr2=0x7f7c14051e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.409+0000 7f7c2f59e700 1 --2- 172.21.15.63:0/1039446045 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c1404f960 0x7f7c14051e20 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7f7c30078ed0 tx=0x7f7c20007a80).stop 2020-05-18T21:28:51.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.409+0000 7f7c2f59e700 1 -- 172.21.15.63:0/1039446045 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c300b6410 msgr2=0x7f7c300782a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.409+0000 7f7c2f59e700 1 --2- 172.21.15.63:0/1039446045 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c300b6410 0x7f7c300782a0 secure :-1 s=READY pgs=614 cs=0 l=1 rx=0x7f7c24000bc0 tx=0x7f7c240109b0).stop 2020-05-18T21:28:51.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.409+0000 7f7c2f59e700 1 -- 172.21.15.63:0/1039446045 shutdown_connections 2020-05-18T21:28:51.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.409+0000 7f7c2f59e700 1 --2- 172.21.15.63:0/1039446045 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c1404f960 0x7f7c14051e20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:51.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.409+0000 7f7c2f59e700 1 --2- 172.21.15.63:0/1039446045 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c300b6410 0x7f7c300782a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:51.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.409+0000 7f7c2f59e700 1 -- 172.21.15.63:0/1039446045 >> 172.21.15.63:0/1039446045 conn(0x7f7c30069b70 msgr2=0x7f7c300b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:51.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.409+0000 7f7c2f59e700 1 -- 172.21.15.63:0/1039446045 shutdown_connections 2020-05-18T21:28:51.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.409+0000 7f7c2f59e700 1 -- 172.21.15.63:0/1039446045 wait complete. 2020-05-18T21:28:51.416 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.1 2020-05-18T21:28:51.425 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:28:51.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.545+0000 7f8d68cbf700 1 Processor -- start 2020-05-18T21:28:51.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.545+0000 7f8d68cbf700 1 -- start start 2020-05-18T21:28:51.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.545+0000 7f8d68cbf700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d640b6410 0x7f8d640b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:51.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.545+0000 7f8d68cbf700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b5cb0 0x7f8d64061af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:51.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.545+0000 7f8d68cbf700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d64025500 con 0x7f8d64151bc0 2020-05-18T21:28:51.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.545+0000 7f8d68cbf700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d64064ee0 con 0x7f8d640b6410 2020-05-18T21:28:51.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.545+0000 7f8d68cbf700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d640b67f0 con 0x7f8d640b5cb0 2020-05-18T21:28:51.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.545+0000 7f8d63fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d640b6410 0x7f8d640b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:51.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.545+0000 7f8d637fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b5cb0 0x7f8d64061af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:51.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.545+0000 7f8d63fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d640b6410 0x7f8d640b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:42314/0 (socket says 172.21.15.63:42314) 2020-05-18T21:28:51.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.545+0000 7f8d63fff700 1 -- 172.21.15.63:0/792803191 learned_addr learned my addr 172.21.15.63:0/792803191 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:51.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.545+0000 7f8d63fff700 1 -- 172.21.15.63:0/792803191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b5cb0 msgr2=0x7f8d64061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:51.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.545+0000 7f8d63fff700 1 --2- 172.21.15.63:0/792803191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b5cb0 0x7f8d64061af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:51.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.545+0000 7f8d63fff700 1 -- 172.21.15.63:0/792803191 >> v1:172.21.15.155:6789/0 conn(0x7f8d64151bc0 legacy=0x7f8d64152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.545+0000 7f8d63fff700 1 -- 172.21.15.63:0/792803191 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d64025180 con 0x7f8d640b6410 2020-05-18T21:28:51.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.545+0000 7f8d62ffd700 1 -- 172.21.15.63:0/792803191 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146785269 0 0) 0x7f8d64025500 con 0x7f8d64151bc0 2020-05-18T21:28:51.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.549+0000 7f8d63fff700 1 --2- 172.21.15.63:0/792803191 >> v2:172.21.15.155:3300/0 conn(0x7f8d640b6410 0x7f8d640b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8d540032f0 tx=0x7f8d54007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.549+0000 7f8d63fff700 1 --2- 172.21.15.63:0/792803191 >> v2:172.21.15.155:3300/0 conn(0x7f8d640b6410 0x7f8d640b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8d540032f0 tx=0x7f8d54007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.549+0000 7f8d63fff700 1 --2- 172.21.15.63:0/792803191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d640b6410 0x7f8d640b6cd0 secure :-1 s=READY pgs=441 cs=0 l=1 rx=0x7f8d540032f0 tx=0x7f8d54007e00).ready entity=mon.1 client_cookie=5abb09f7f02c2d5a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:51.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.549+0000 7f8d63fff700 1 --2- 172.21.15.63:0/792803191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d640b6410 0x7f8d640b6cd0 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7f8d540032f0 tx=0x7f8d54007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.549+0000 7f8d62ffd700 1 -- 172.21.15.63:0/792803191 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d54011d10 con 0x7f8d640b6410 2020-05-18T21:28:51.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.549+0000 7f8d63fff700 1 --2- 172.21.15.63:0/792803191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d640b6410 0x7f8d640b6cd0 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7f8d540032f0 tx=0x7f8d54007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.549+0000 7f8d63fff700 1 --2- 172.21.15.63:0/792803191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d640b6410 0x7f8d640b6cd0 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7f8d540032f0 tx=0x7f8d54007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.549+0000 7f8d62ffd700 1 -- 172.21.15.63:0/792803191 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d54011e70 con 0x7f8d640b6410 2020-05-18T21:28:51.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.549+0000 7f8d62ffd700 1 -- 172.21.15.63:0/792803191 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d5400a370 con 0x7f8d640b6410 2020-05-18T21:28:51.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.549+0000 7f8d68cbf700 1 -- 172.21.15.63:0/792803191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d640b6410 msgr2=0x7f8d640b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.549+0000 7f8d68cbf700 1 --2- 172.21.15.63:0/792803191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d640b6410 0x7f8d640b6cd0 secure :-1 s=READY pgs=441 cs=0 l=1 rx=0x7f8d540032f0 tx=0x7f8d54007e00).stop 2020-05-18T21:28:51.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.549+0000 7f8d68cbf700 1 -- 172.21.15.63:0/792803191 shutdown_connections 2020-05-18T21:28:51.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.549+0000 7f8d68cbf700 1 --2- 172.21.15.63:0/792803191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b5cb0 0x7f8d64061af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:51.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.549+0000 7f8d68cbf700 1 --2- 172.21.15.63:0/792803191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d640b6410 0x7f8d640b6cd0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:51.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.549+0000 7f8d68cbf700 1 -- 172.21.15.63:0/792803191 >> 172.21.15.63:0/792803191 conn(0x7f8d64069b70 msgr2=0x7f8d64069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:51.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.549+0000 7f8d68cbf700 1 -- 172.21.15.63:0/792803191 shutdown_connections 2020-05-18T21:28:51.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.549+0000 7f8d68cbf700 1 -- 172.21.15.63:0/792803191 wait complete. 2020-05-18T21:28:51.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.553+0000 7f8d68cbf700 1 Processor -- start 2020-05-18T21:28:51.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.553+0000 7f8d68cbf700 1 -- start start 2020-05-18T21:28:51.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.553+0000 7f8d68cbf700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b6410 0x7f8d641158f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:51.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.553+0000 7f8d68cbf700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d64116470 con 0x7f8d64151bc0 2020-05-18T21:28:51.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.553+0000 7f8d68cbf700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d640b15f0 con 0x7f8d640b5cb0 2020-05-18T21:28:51.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.553+0000 7f8d68cbf700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d640b1890 con 0x7f8d640b6410 2020-05-18T21:28:51.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.553+0000 7f8d69f21700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8d64151bc0 0x7f8d640b1d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57896/0 (socket says 172.21.15.63:57896) 2020-05-18T21:28:51.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.553+0000 7f8d69f21700 1 -- 172.21.15.63:0/2660143044 learned_addr learned my addr 172.21.15.63:0/2660143044 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:51.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.553+0000 7f8d637fe700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b6410 0x7f8d641158f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:51.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.553+0000 7f8d60ff9700 1 -- 172.21.15.63:0/2660143044 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655769686 0 0) 0x7f8d64116470 con 0x7f8d64151bc0 2020-05-18T21:28:51.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.553+0000 7f8d60ff9700 1 -- 172.21.15.63:0/2660143044 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d44003270 con 0x7f8d64151bc0 2020-05-18T21:28:51.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.553+0000 7f8d60ff9700 1 -- 172.21.15.63:0/2660143044 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627367452 0 0) 0x7f8d640b15f0 con 0x7f8d640b5cb0 2020-05-18T21:28:51.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.553+0000 7f8d60ff9700 1 -- 172.21.15.63:0/2660143044 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d64116470 con 0x7f8d640b5cb0 2020-05-18T21:28:51.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.557+0000 7f8d637fe700 1 -- 172.21.15.63:0/2660143044 >> v1:172.21.15.155:6789/0 conn(0x7f8d640b5cb0 legacy=0x7f8d640ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.557+0000 7f8d637fe700 1 -- 172.21.15.63:0/2660143044 >> v1:172.21.15.63:6789/0 conn(0x7f8d64151bc0 legacy=0x7f8d640b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.557+0000 7f8d637fe700 1 -- 172.21.15.63:0/2660143044 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d640aedf0 con 0x7f8d640b6410 2020-05-18T21:28:51.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.557+0000 7f8d637fe700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b6410 0x7f8d641158f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d58002f70 tx=0x7f8d58010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.557+0000 7f8d637fe700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b6410 0x7f8d641158f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d58002f70 tx=0x7f8d58010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.557+0000 7f8d637fe700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b6410 0x7f8d641158f0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f8d58002f70 tx=0x7f8d58010bf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:51.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.557+0000 7f8d637fe700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b6410 0x7f8d641158f0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f8d58002f70 tx=0x7f8d58010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.557+0000 7f8d637fe700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b6410 0x7f8d641158f0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f8d58002f70 tx=0x7f8d58010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.557+0000 7f8d60ff9700 1 -- 172.21.15.63:0/2660143044 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d58007550 con 0x7f8d640b6410 2020-05-18T21:28:51.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.557+0000 7f8d637fe700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b6410 0x7f8d641158f0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f8d58002f70 tx=0x7f8d58010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.557+0000 7f8d60ff9700 1 -- 172.21.15.63:0/2660143044 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d58005700 con 0x7f8d640b6410 2020-05-18T21:28:51.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.557+0000 7f8d68cbf700 1 -- 172.21.15.63:0/2660143044 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d640b2440 con 0x7f8d640b6410 2020-05-18T21:28:51.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.557+0000 7f8d60ff9700 1 -- 172.21.15.63:0/2660143044 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d58005aa0 con 0x7f8d640b6410 2020-05-18T21:28:51.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.557+0000 7f8d68cbf700 1 -- 172.21.15.63:0/2660143044 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d640b52d0 con 0x7f8d640b6410 2020-05-18T21:28:51.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.557+0000 7f8d68cbf700 1 -- 172.21.15.63:0/2660143044 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d640569e0 con 0x7f8d640b6410 2020-05-18T21:28:51.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.557+0000 7f8d637fe700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b6410 0x7f8d641158f0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f8d58002f70 tx=0x7f8d58010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.557+0000 7f8d60ff9700 1 -- 172.21.15.63:0/2660143044 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8d58005d10 con 0x7f8d640b6410 2020-05-18T21:28:51.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.557+0000 7f8d637fe700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b6410 0x7f8d641158f0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f8d58002f70 tx=0x7f8d58010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.561+0000 7f8d60ff9700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d4404feb0 0x7f8d44052370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:51.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.561+0000 7f8d60ff9700 1 -- 172.21.15.63:0/2660143044 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8d58064090 con 0x7f8d640b6410 2020-05-18T21:28:51.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.561+0000 7f8d63fff700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d4404feb0 0x7f8d44052370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:51.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.561+0000 7f8d63fff700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d4404feb0 0x7f8d44052370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d54008290 tx=0x7f8d54007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.561+0000 7f8d63fff700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d4404feb0 0x7f8d44052370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d54008290 tx=0x7f8d54007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.561+0000 7f8d63fff700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d4404feb0 0x7f8d44052370 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7f8d54008290 tx=0x7f8d54007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:51.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.565+0000 7f8d637fe700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b6410 0x7f8d641158f0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f8d58002f70 tx=0x7f8d58010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.565+0000 7f8d60ff9700 1 -- 172.21.15.63:0/2660143044 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f8d5803e420 con 0x7f8d640b6410 2020-05-18T21:28:51.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.713+0000 7f8d68cbf700 1 -- 172.21.15.63:0/2660143044 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8d64143300 con 0x7f8d640b6410 2020-05-18T21:28:51.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.725+0000 7f8d637fe700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b6410 0x7f8d641158f0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f8d58002f70 tx=0x7f8d58010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.725+0000 7f8d60ff9700 1 -- 172.21.15.63:0/2660143044 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v21) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8d58041a40 con 0x7f8d640b6410 2020-05-18T21:28:51.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.725+0000 7f8d68cbf700 1 -- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d4404feb0 msgr2=0x7f8d44052370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.725+0000 7f8d68cbf700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d4404feb0 0x7f8d44052370 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7f8d54008290 tx=0x7f8d54007e00).stop 2020-05-18T21:28:51.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.725+0000 7f8d68cbf700 1 -- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b6410 msgr2=0x7f8d641158f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.725+0000 7f8d68cbf700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b6410 0x7f8d641158f0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f8d58002f70 tx=0x7f8d58010bf0).stop 2020-05-18T21:28:51.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.725+0000 7f8d68cbf700 1 -- 172.21.15.63:0/2660143044 shutdown_connections 2020-05-18T21:28:51.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.725+0000 7f8d68cbf700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d4404feb0 0x7f8d44052370 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:51.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.725+0000 7f8d68cbf700 1 --2- 172.21.15.63:0/2660143044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d640b6410 0x7f8d641158f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:51.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.725+0000 7f8d68cbf700 1 -- 172.21.15.63:0/2660143044 >> 172.21.15.63:0/2660143044 conn(0x7f8d64069b70 msgr2=0x7f8d640652a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:51.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.725+0000 7f8d68cbf700 1 -- 172.21.15.63:0/2660143044 shutdown_connections 2020-05-18T21:28:51.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.725+0000 7f8d68cbf700 1 -- 172.21.15.63:0/2660143044 wait complete. 2020-05-18T21:28:51.735 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.2 2020-05-18T21:28:51.744 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:28:51.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f9844f7d700 1 Processor -- start 2020-05-18T21:28:51.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f9844f7d700 1 -- start start 2020-05-18T21:28:51.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f9844f7d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98400ad070 0x7f9840156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:51.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f9844f7d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9840065a70 con 0x7f9840157260 2020-05-18T21:28:51.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f9844f7d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98400b9010 con 0x7f98400b8c30 2020-05-18T21:28:51.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f9844f7d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98400801d0 con 0x7f98400ad070 2020-05-18T21:28:51.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f983f59e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9840157260 0x7f984015c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57904/0 (socket says 172.21.15.63:57904) 2020-05-18T21:28:51.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f983f59e700 1 -- 172.21.15.63:0/1286999151 learned_addr learned my addr 172.21.15.63:0/1286999151 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:51.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f983e59c700 1 --2- 172.21.15.63:0/1286999151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98400ad070 0x7f9840156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:51.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f983dd9b700 1 -- 172.21.15.63:0/1286999151 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683978077 0 0) 0x7f9840065a70 con 0x7f9840157260 2020-05-18T21:28:51.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f983dd9b700 1 -- 172.21.15.63:0/1286999151 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f982c003270 con 0x7f9840157260 2020-05-18T21:28:51.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f983dd9b700 1 -- 172.21.15.63:0/1286999151 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231525827 0 0) 0x7f98400b9010 con 0x7f98400b8c30 2020-05-18T21:28:51.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f983dd9b700 1 -- 172.21.15.63:0/1286999151 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9840065a70 con 0x7f98400b8c30 2020-05-18T21:28:51.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f983e59c700 1 -- 172.21.15.63:0/1286999151 >> v1:172.21.15.155:6789/0 conn(0x7f98400b8c30 legacy=0x7f98401566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f983e59c700 1 -- 172.21.15.63:0/1286999151 >> v1:172.21.15.63:6789/0 conn(0x7f9840157260 legacy=0x7f984015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f983e59c700 1 -- 172.21.15.63:0/1286999151 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984005bf00 con 0x7f98400ad070 2020-05-18T21:28:51.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f983e59c700 1 --2- 172.21.15.63:0/1286999151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98400ad070 0x7f9840156e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9828002f70 tx=0x7f9828008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f983e59c700 1 --2- 172.21.15.63:0/1286999151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98400ad070 0x7f9840156e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9828002f70 tx=0x7f9828008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f983e59c700 1 --2- 172.21.15.63:0/1286999151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98400ad070 0x7f9840156e00 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f9828002f70 tx=0x7f9828008920).ready entity=mon.2 client_cookie=3dc81fb1c4120220 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:51.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f983e59c700 1 --2- 172.21.15.63:0/1286999151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98400ad070 0x7f9840156e00 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f9828002f70 tx=0x7f9828008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f983dd9b700 1 -- 172.21.15.63:0/1286999151 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9828008e80 con 0x7f98400ad070 2020-05-18T21:28:51.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f983e59c700 1 --2- 172.21.15.63:0/1286999151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98400ad070 0x7f9840156e00 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f9828002f70 tx=0x7f9828008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.853+0000 7f983e59c700 1 --2- 172.21.15.63:0/1286999151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98400ad070 0x7f9840156e00 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f9828002f70 tx=0x7f9828008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.857+0000 7f983dd9b700 1 -- 172.21.15.63:0/1286999151 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9828011580 con 0x7f98400ad070 2020-05-18T21:28:51.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.857+0000 7f983dd9b700 1 -- 172.21.15.63:0/1286999151 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9828011960 con 0x7f98400ad070 2020-05-18T21:28:51.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.857+0000 7f9844f7d700 1 -- 172.21.15.63:0/1286999151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98400ad070 msgr2=0x7f9840156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.857+0000 7f9844f7d700 1 --2- 172.21.15.63:0/1286999151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98400ad070 0x7f9840156e00 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f9828002f70 tx=0x7f9828008920).stop 2020-05-18T21:28:51.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.857+0000 7f9844f7d700 1 -- 172.21.15.63:0/1286999151 shutdown_connections 2020-05-18T21:28:51.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.857+0000 7f9844f7d700 1 --2- 172.21.15.63:0/1286999151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98400ad070 0x7f9840156e00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:51.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.857+0000 7f9844f7d700 1 -- 172.21.15.63:0/1286999151 >> 172.21.15.63:0/1286999151 conn(0x7f984006a640 msgr2=0x7f98400b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:51.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.857+0000 7f9844f7d700 1 -- 172.21.15.63:0/1286999151 shutdown_connections 2020-05-18T21:28:51.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.857+0000 7f9844f7d700 1 -- 172.21.15.63:0/1286999151 wait complete. 2020-05-18T21:28:51.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f9844f7d700 1 Processor -- start 2020-05-18T21:28:51.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f9844f7d700 1 -- start start 2020-05-18T21:28:51.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f9844f7d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f98400ad070 0x7f98400651d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:51.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f9844f7d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9840063350 con 0x7f9840157260 2020-05-18T21:28:51.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f9844f7d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98401209f0 con 0x7f98400b8c30 2020-05-18T21:28:51.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f9844f7d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9840072b00 con 0x7f98400ad070 2020-05-18T21:28:51.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f983f59e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9840157260 0x7f9840120e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57910/0 (socket says 172.21.15.63:57910) 2020-05-18T21:28:51.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f983f59e700 1 -- 172.21.15.63:0/3052637787 learned_addr learned my addr 172.21.15.63:0/3052637787 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:51.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f983ed9d700 1 --2- 172.21.15.63:0/3052637787 >> v2:172.21.15.155:3300/0 conn(0x7f98400ad070 0x7f98400651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:51.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f98377fe700 1 -- 172.21.15.63:0/3052637787 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406449831 0 0) 0x7f9840063350 con 0x7f9840157260 2020-05-18T21:28:51.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f98377fe700 1 -- 172.21.15.63:0/3052637787 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9824003270 con 0x7f9840157260 2020-05-18T21:28:51.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f983ed9d700 1 -- 172.21.15.63:0/3052637787 >> v1:172.21.15.155:6789/0 conn(0x7f98400b8c30 legacy=0x7f98400723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f983ed9d700 1 -- 172.21.15.63:0/3052637787 >> v1:172.21.15.63:6789/0 conn(0x7f9840157260 legacy=0x7f9840120e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:51.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f983ed9d700 1 -- 172.21.15.63:0/3052637787 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9840072c40 con 0x7f98400ad070 2020-05-18T21:28:51.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f983ed9d700 1 --2- 172.21.15.63:0/3052637787 >> v2:172.21.15.155:3300/0 conn(0x7f98400ad070 0x7f98400651d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9838001490 tx=0x7f9838012e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f983ed9d700 1 --2- 172.21.15.63:0/3052637787 >> v2:172.21.15.155:3300/0 conn(0x7f98400ad070 0x7f98400651d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9838001490 tx=0x7f9838012e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f983ed9d700 1 --2- 172.21.15.63:0/3052637787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98400ad070 0x7f98400651d0 secure :-1 s=READY pgs=445 cs=0 l=1 rx=0x7f9838001490 tx=0x7f9838012e70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:51.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f983ed9d700 1 --2- 172.21.15.63:0/3052637787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98400ad070 0x7f98400651d0 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7f9838001490 tx=0x7f9838012e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f98377fe700 1 -- 172.21.15.63:0/3052637787 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9838014540 con 0x7f98400ad070 2020-05-18T21:28:51.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f983ed9d700 1 --2- 172.21.15.63:0/3052637787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98400ad070 0x7f98400651d0 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7f9838001490 tx=0x7f9838012e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f983ed9d700 1 --2- 172.21.15.63:0/3052637787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98400ad070 0x7f98400651d0 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7f9838001490 tx=0x7f9838012e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f98377fe700 1 -- 172.21.15.63:0/3052637787 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98380146e0 con 0x7f98400ad070 2020-05-18T21:28:51.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f9844f7d700 1 -- 172.21.15.63:0/3052637787 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98401215a0 con 0x7f98400ad070 2020-05-18T21:28:51.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.861+0000 7f98377fe700 1 -- 172.21.15.63:0/3052637787 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9838014ac0 con 0x7f98400ad070 2020-05-18T21:28:51.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.865+0000 7f9844f7d700 1 -- 172.21.15.63:0/3052637787 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9840064a30 con 0x7f98400ad070 2020-05-18T21:28:51.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.865+0000 7f983ed9d700 1 --2- 172.21.15.63:0/3052637787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98400ad070 0x7f98400651d0 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7f9838001490 tx=0x7f9838012e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.865+0000 7f9844f7d700 1 -- 172.21.15.63:0/3052637787 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98400569e0 con 0x7f98400ad070 2020-05-18T21:28:51.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.865+0000 7f98377fe700 1 -- 172.21.15.63:0/3052637787 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9838014cc0 con 0x7f98400ad070 2020-05-18T21:28:51.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.865+0000 7f983ed9d700 1 --2- 172.21.15.63:0/3052637787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98400ad070 0x7f98400651d0 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7f9838001490 tx=0x7f9838012e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.865+0000 7f98377fe700 1 --2- 172.21.15.63:0/3052637787 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f982404fd20 0x7f98240521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:51.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.865+0000 7f98377fe700 1 -- 172.21.15.63:0/3052637787 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9838066360 con 0x7f98400ad070 2020-05-18T21:28:51.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.865+0000 7f983e59c700 1 --2- 172.21.15.63:0/3052637787 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f982404fd20 0x7f98240521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:51.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.865+0000 7f983e59c700 1 --2- 172.21.15.63:0/3052637787 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f982404fd20 0x7f98240521e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9840062b30 tx=0x7f9840066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.865+0000 7f983e59c700 1 --2- 172.21.15.63:0/3052637787 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f982404fd20 0x7f98240521e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9840062b30 tx=0x7f9840066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.865+0000 7f983e59c700 1 --2- 172.21.15.63:0/3052637787 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f982404fd20 0x7f98240521e0 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7f9840062b30 tx=0x7f9840066290).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:51.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.877+0000 7f983ed9d700 1 --2- 172.21.15.63:0/3052637787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98400ad070 0x7f98400651d0 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7f9838001490 tx=0x7f9838012e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:51.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:51.877+0000 7f98377fe700 1 -- 172.21.15.63:0/3052637787 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9838040690 con 0x7f98400ad070 2020-05-18T21:28:52.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.029+0000 7f9844f7d700 1 -- 172.21.15.63:0/3052637787 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f98400008d0 con 0x7f98400ad070 2020-05-18T21:28:52.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.041+0000 7f983ed9d700 1 --2- 172.21.15.63:0/3052637787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98400ad070 0x7f98400651d0 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7f9838001490 tx=0x7f9838012e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.041+0000 7f98377fe700 1 -- 172.21.15.63:0/3052637787 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v22) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9838043cb0 con 0x7f98400ad070 2020-05-18T21:28:52.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.041+0000 7f9844f7d700 1 -- 172.21.15.63:0/3052637787 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f982404fd20 msgr2=0x7f98240521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:52.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.041+0000 7f9844f7d700 1 --2- 172.21.15.63:0/3052637787 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f982404fd20 0x7f98240521e0 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7f9840062b30 tx=0x7f9840066290).stop 2020-05-18T21:28:52.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.045+0000 7f9844f7d700 1 -- 172.21.15.63:0/3052637787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98400ad070 msgr2=0x7f98400651d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:52.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.045+0000 7f9844f7d700 1 --2- 172.21.15.63:0/3052637787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98400ad070 0x7f98400651d0 secure :-1 s=READY pgs=445 cs=0 l=1 rx=0x7f9838001490 tx=0x7f9838012e70).stop 2020-05-18T21:28:52.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.045+0000 7f9844f7d700 1 -- 172.21.15.63:0/3052637787 shutdown_connections 2020-05-18T21:28:52.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.045+0000 7f9844f7d700 1 --2- 172.21.15.63:0/3052637787 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f982404fd20 0x7f98240521e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:52.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.045+0000 7f9844f7d700 1 --2- 172.21.15.63:0/3052637787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98400ad070 0x7f98400651d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:52.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.045+0000 7f9844f7d700 1 -- 172.21.15.63:0/3052637787 >> 172.21.15.63:0/3052637787 conn(0x7f984006a640 msgr2=0x7f98400b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:52.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.045+0000 7f9844f7d700 1 -- 172.21.15.63:0/3052637787 shutdown_connections 2020-05-18T21:28:52.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.045+0000 7f9844f7d700 1 -- 172.21.15.63:0/3052637787 wait complete. 2020-05-18T21:28:52.052 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.3 2020-05-18T21:28:52.063 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:28:52.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.161+0000 7f771a064700 1 Processor -- start 2020-05-18T21:28:52.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.161+0000 7f771a064700 1 -- start start 2020-05-18T21:28:52.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f771a064700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7714060b90 0x7f77140615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:52.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f771a064700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f77140b2860 0x7f771414e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f771a064700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7714144090 0x7f77141444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f771a064700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7714144920 con 0x7f7714060b90 2020-05-18T21:28:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f771a064700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7714066210 con 0x7f77140b2860 2020-05-18T21:28:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f771a064700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771414d960 con 0x7f7714144090 2020-05-18T21:28:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f77137fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7714060b90 0x7f77140615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f77137fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7714060b90 0x7f77140615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55728/0 (socket says 172.21.15.63:55728) 2020-05-18T21:28:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f77137fe700 1 -- 172.21.15.63:0/80272606 learned_addr learned my addr 172.21.15.63:0/80272606 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f7712ffd700 1 --2- 172.21.15.63:0/80272606 >> v2:172.21.15.155:3300/0 conn(0x7f77140b2860 0x7f771414e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f7713fff700 1 --2- 172.21.15.63:0/80272606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7714144090 0x7f77141444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f77137fe700 1 -- 172.21.15.63:0/80272606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7714144090 msgr2=0x7f77141444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f77137fe700 1 --2- 172.21.15.63:0/80272606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7714144090 0x7f77141444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f77137fe700 1 -- 172.21.15.63:0/80272606 >> v2:172.21.15.155:3300/0 conn(0x7f77140b2860 msgr2=0x7f771414e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f77137fe700 1 --2- 172.21.15.63:0/80272606 >> v2:172.21.15.155:3300/0 conn(0x7f77140b2860 0x7f771414e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f77137fe700 1 -- 172.21.15.63:0/80272606 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771414db90 con 0x7f7714060b90 2020-05-18T21:28:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f77137fe700 1 --2- 172.21.15.63:0/80272606 >> v2:172.21.15.63:3300/0 conn(0x7f7714060b90 0x7f77140615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7714066350 tx=0x7f7708008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f77137fe700 1 --2- 172.21.15.63:0/80272606 >> v2:172.21.15.63:3300/0 conn(0x7f7714060b90 0x7f77140615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7714066350 tx=0x7f7708008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f77137fe700 1 --2- 172.21.15.63:0/80272606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7714060b90 0x7f77140615e0 secure :-1 s=READY pgs=618 cs=0 l=1 rx=0x7f7714066350 tx=0x7f7708008920).ready entity=mon.0 client_cookie=5a6594b81c78ca28 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f77137fe700 1 --2- 172.21.15.63:0/80272606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7714060b90 0x7f77140615e0 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f7714066350 tx=0x7f7708008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f77127fc700 1 -- 172.21.15.63:0/80272606 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7708011600 con 0x7f7714060b90 2020-05-18T21:28:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f77137fe700 1 --2- 172.21.15.63:0/80272606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7714060b90 0x7f77140615e0 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f7714066350 tx=0x7f7708008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f77137fe700 1 --2- 172.21.15.63:0/80272606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7714060b90 0x7f77140615e0 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f7714066350 tx=0x7f7708008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f77127fc700 1 -- 172.21.15.63:0/80272606 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7708011760 con 0x7f7714060b90 2020-05-18T21:28:52.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f77127fc700 1 -- 172.21.15.63:0/80272606 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7708011b80 con 0x7f7714060b90 2020-05-18T21:28:52.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f771a064700 1 -- 172.21.15.63:0/80272606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7714060b90 msgr2=0x7f77140615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:52.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f771a064700 1 --2- 172.21.15.63:0/80272606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7714060b90 0x7f77140615e0 secure :-1 s=READY pgs=618 cs=0 l=1 rx=0x7f7714066350 tx=0x7f7708008920).stop 2020-05-18T21:28:52.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f771a064700 1 -- 172.21.15.63:0/80272606 shutdown_connections 2020-05-18T21:28:52.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f771a064700 1 --2- 172.21.15.63:0/80272606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7714144090 0x7f77141444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:52.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f771a064700 1 --2- 172.21.15.63:0/80272606 >> v2:172.21.15.155:3300/0 conn(0x7f77140b2860 0x7f771414e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:52.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f771a064700 1 --2- 172.21.15.63:0/80272606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7714060b90 0x7f77140615e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:52.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f771a064700 1 -- 172.21.15.63:0/80272606 >> 172.21.15.63:0/80272606 conn(0x7f77140b83d0 msgr2=0x7f77140b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:52.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f771a064700 1 -- 172.21.15.63:0/80272606 shutdown_connections 2020-05-18T21:28:52.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.165+0000 7f771a064700 1 -- 172.21.15.63:0/80272606 wait complete. 2020-05-18T21:28:52.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f771a064700 1 Processor -- start 2020-05-18T21:28:52.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f771a064700 1 -- start start 2020-05-18T21:28:52.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f771a064700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7714060b90 0x7f771415abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:52.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f771a064700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77140b2860 0x7f771414b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:52.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f771a064700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f771414be50 con 0x7f7714144090 2020-05-18T21:28:52.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f771a064700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771414d420 con 0x7f7714060b90 2020-05-18T21:28:52.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f771a064700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771414c0f0 con 0x7f77140b2860 2020-05-18T21:28:52.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f77137fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7714060b90 0x7f771415abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f77137fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7714060b90 0x7f771415abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55734/0 (socket says 172.21.15.63:55734) 2020-05-18T21:28:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f77137fe700 1 -- 172.21.15.63:0/1688852061 learned_addr learned my addr 172.21.15.63:0/1688852061 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f7712ffd700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77140b2860 0x7f771414b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f77137fe700 1 -- 172.21.15.63:0/1688852061 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77140b2860 msgr2=0x7f771414b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f77137fe700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77140b2860 0x7f771414b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f77137fe700 1 -- 172.21.15.63:0/1688852061 >> v1:172.21.15.155:6789/0 conn(0x7f7714144090 legacy=0x7f771414c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f77137fe700 1 -- 172.21.15.63:0/1688852061 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771414cca0 con 0x7f7714060b90 2020-05-18T21:28:52.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f77137fe700 1 --2- 172.21.15.63:0/1688852061 >> v2:172.21.15.63:3300/0 conn(0x7f7714060b90 0x7f771415abb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7714066350 tx=0x7f771405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f77137fe700 1 --2- 172.21.15.63:0/1688852061 >> v2:172.21.15.63:3300/0 conn(0x7f7714060b90 0x7f771415abb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7714066350 tx=0x7f771405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f77137fe700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7714060b90 0x7f771415abb0 secure :-1 s=READY pgs=619 cs=0 l=1 rx=0x7f7714066350 tx=0x7f771405fa60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:52.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f77137fe700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7714060b90 0x7f771415abb0 secure :-1 s=THROTTLE_DONE pgs=619 cs=0 l=1 rx=0x7f7714066350 tx=0x7f771405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f77137fe700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7714060b90 0x7f771415abb0 secure :-1 s=THROTTLE_DONE pgs=619 cs=0 l=1 rx=0x7f7714066350 tx=0x7f771405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f7710ff9700 1 -- 172.21.15.63:0/1688852061 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7708011b00 con 0x7f7714060b90 2020-05-18T21:28:52.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f77137fe700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7714060b90 0x7f771415abb0 secure :-1 s=THROTTLE_DONE pgs=619 cs=0 l=1 rx=0x7f7714066350 tx=0x7f771405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f7710ff9700 1 -- 172.21.15.63:0/1688852061 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7708007170 con 0x7f7714060b90 2020-05-18T21:28:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f771a064700 1 -- 172.21.15.63:0/1688852061 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77140b30b0 con 0x7f7714060b90 2020-05-18T21:28:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f7710ff9700 1 -- 172.21.15.63:0/1688852061 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7708007510 con 0x7f7714060b90 2020-05-18T21:28:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f771a064700 1 -- 172.21.15.63:0/1688852061 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77140b3560 con 0x7f7714060b90 2020-05-18T21:28:52.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.169+0000 7f771a064700 1 -- 172.21.15.63:0/1688852061 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f771414bc90 con 0x7f7714060b90 2020-05-18T21:28:52.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.173+0000 7f77137fe700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7714060b90 0x7f771415abb0 secure :-1 s=THROTTLE_DONE pgs=619 cs=0 l=1 rx=0x7f7714066350 tx=0x7f771405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.173+0000 7f7710ff9700 1 -- 172.21.15.63:0/1688852061 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7708005700 con 0x7f7714060b90 2020-05-18T21:28:52.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.173+0000 7f77137fe700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7714060b90 0x7f771415abb0 secure :-1 s=THROTTLE_DONE pgs=619 cs=0 l=1 rx=0x7f7714066350 tx=0x7f771405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.173+0000 7f7710ff9700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f76f404f9f0 0x7f76f4051eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:52.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.173+0000 7f7710ff9700 1 -- 172.21.15.63:0/1688852061 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7708064270 con 0x7f7714060b90 2020-05-18T21:28:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.173+0000 7f7712ffd700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f76f404f9f0 0x7f76f4051eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.173+0000 7f7712ffd700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f76f404f9f0 0x7f76f4051eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7704002f70 tx=0x7f7704006e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.173+0000 7f7712ffd700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f76f404f9f0 0x7f76f4051eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7704002f70 tx=0x7f7704006e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.173+0000 7f7712ffd700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f76f404f9f0 0x7f76f4051eb0 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7f7704002f70 tx=0x7f7704006e90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:52.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.181+0000 7f77137fe700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7714060b90 0x7f771415abb0 secure :-1 s=THROTTLE_DONE pgs=619 cs=0 l=1 rx=0x7f7714066350 tx=0x7f771405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.181+0000 7f7710ff9700 1 -- 172.21.15.63:0/1688852061 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f770803e6c0 con 0x7f7714060b90 2020-05-18T21:28:52.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.333+0000 7f771a064700 1 -- 172.21.15.63:0/1688852061 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77140569e0 con 0x7f7714060b90 2020-05-18T21:28:52.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.337+0000 7f77137fe700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7714060b90 0x7f771415abb0 secure :-1 s=THROTTLE_DONE pgs=619 cs=0 l=1 rx=0x7f7714066350 tx=0x7f771405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.337+0000 7f7710ff9700 1 -- 172.21.15.63:0/1688852061 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f7708041ce0 con 0x7f7714060b90 2020-05-18T21:28:52.342 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:52.343 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":22,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/2663525728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2663525728},{"type":"v1","addr":"172.21.15.63:6833","nonce":2663525728}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:28:48.505607+0000","modified":"2020-05-18T21:28:50.219314+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5850},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5850":{"gid":5850,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1866128236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1866128236},{"type":"v1","addr":"172.21.15.155:6835","nonce":1866128236}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-05-18T21:28:52.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.337+0000 7f771a064700 1 -- 172.21.15.63:0/1688852061 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f76f404f9f0 msgr2=0x7f76f4051eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:52.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.337+0000 7f771a064700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f76f404f9f0 0x7f76f4051eb0 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7f7704002f70 tx=0x7f7704006e90).stop 2020-05-18T21:28:52.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.337+0000 7f771a064700 1 -- 172.21.15.63:0/1688852061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7714060b90 msgr2=0x7f771415abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:52.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.337+0000 7f771a064700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7714060b90 0x7f771415abb0 secure :-1 s=READY pgs=619 cs=0 l=1 rx=0x7f7714066350 tx=0x7f771405fa60).stop 2020-05-18T21:28:52.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.337+0000 7f771a064700 1 -- 172.21.15.63:0/1688852061 shutdown_connections 2020-05-18T21:28:52.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.337+0000 7f771a064700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f76f404f9f0 0x7f76f4051eb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:52.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.337+0000 7f771a064700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77140b2860 0x7f771414b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:52.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.337+0000 7f771a064700 1 --2- 172.21.15.63:0/1688852061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7714060b90 0x7f771415abb0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:52.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.337+0000 7f771a064700 1 -- 172.21.15.63:0/1688852061 >> 172.21.15.63:0/1688852061 conn(0x7f77140b83d0 msgr2=0x7f7714142600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:52.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.337+0000 7f771a064700 1 -- 172.21.15.63:0/1688852061 shutdown_connections 2020-05-18T21:28:52.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.337+0000 7f771a064700 1 -- 172.21.15.63:0/1688852061 wait complete. 2020-05-18T21:28:52.347 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 22 2020-05-18T21:28:52.557 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:28:48.505607+0000', 'modified': '2020-05-18T21:28:50.219314+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5850}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5850': {'gid': 5850, 'name': 'b', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6835/1866128236', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 1866128236}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 1866128236}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:28:52.558 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:28:52.559 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:28:52.667 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:28:52.667 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:28:52.668 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2020-05-18T21:28:52.668 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 5850, 2020-05-18T21:28:52.668 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:28:52.669 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:28:52.669 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 4.1562707000000003, 2020-05-18T21:28:52.669 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 22, 2020-05-18T21:28:52.669 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 51, 2020-05-18T21:28:52.669 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 51, 2020-05-18T21:28:52.670 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 8.3750667140000008 2020-05-18T21:28:52.670 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:28:52.676 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 5850, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.1562707000000003, "mdsmap_epoch": 22, "osdmap_epoch": 51, "osdmap_epoch_barrier": 51, "uptime": 8.3750667140000008 } 2020-05-18T21:28:52.677 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:28:52.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.785+0000 7f6c8b59e700 1 Processor -- start 2020-05-18T21:28:52.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.785+0000 7f6c8b59e700 1 -- start start 2020-05-18T21:28:52.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.785+0000 7f6c8b59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6c8c0632e0 0x7f6c8c144820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:52.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.785+0000 7f6c8b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c147100 0x7f6c8c141270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:52.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.785+0000 7f6c8b59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8c143e40 con 0x7f6c8c0b71b0 2020-05-18T21:28:52.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.785+0000 7f6c8b59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8c1440e0 con 0x7f6c8c0632e0 2020-05-18T21:28:52.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.785+0000 7f6c8b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c144380 con 0x7f6c8c147100 2020-05-18T21:28:52.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.785+0000 7f6c8a59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6c8c0b71b0 0x7f6c8c140b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57930/0 (socket says 172.21.15.63:57930) 2020-05-18T21:28:52.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.785+0000 7f6c8a59c700 1 -- 172.21.15.63:0/375998881 learned_addr learned my addr 172.21.15.63:0/375998881 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:52.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.785+0000 7f6c89d9b700 1 --2- 172.21.15.63:0/375998881 >> v2:172.21.15.155:3300/0 conn(0x7f6c8c0632e0 0x7f6c8c144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:52.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.785+0000 7f6c8ad9d700 1 --2- 172.21.15.63:0/375998881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c147100 0x7f6c8c141270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:52.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.785+0000 7f6c8959a700 1 -- 172.21.15.63:0/375998881 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169853289 0 0) 0x7f6c8c143e40 con 0x7f6c8c0b71b0 2020-05-18T21:28:52.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.785+0000 7f6c8959a700 1 -- 172.21.15.63:0/375998881 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c6c003270 con 0x7f6c8c0b71b0 2020-05-18T21:28:52.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c89d9b700 1 -- 172.21.15.63:0/375998881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c147100 msgr2=0x7f6c8c141270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:52.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c89d9b700 1 --2- 172.21.15.63:0/375998881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c147100 0x7f6c8c141270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:52.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c89d9b700 1 -- 172.21.15.63:0/375998881 >> v1:172.21.15.63:6789/0 conn(0x7f6c8c0b71b0 legacy=0x7f6c8c140b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:52.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c89d9b700 1 -- 172.21.15.63:0/375998881 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c0b7590 con 0x7f6c8c0632e0 2020-05-18T21:28:52.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c89d9b700 1 --2- 172.21.15.63:0/375998881 >> v2:172.21.15.155:3300/0 conn(0x7f6c8c0632e0 0x7f6c8c144820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6c740032f0 tx=0x7f6c74007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c89d9b700 1 --2- 172.21.15.63:0/375998881 >> v2:172.21.15.155:3300/0 conn(0x7f6c8c0632e0 0x7f6c8c144820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6c740032f0 tx=0x7f6c74007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c89d9b700 1 --2- 172.21.15.63:0/375998881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c8c0632e0 0x7f6c8c144820 secure :-1 s=READY pgs=447 cs=0 l=1 rx=0x7f6c740032f0 tx=0x7f6c74007e00).ready entity=mon.1 client_cookie=53b6e8f74c175a83 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:52.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c89d9b700 1 --2- 172.21.15.63:0/375998881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c8c0632e0 0x7f6c8c144820 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7f6c740032f0 tx=0x7f6c74007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c8959a700 1 -- 172.21.15.63:0/375998881 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c74011db0 con 0x7f6c8c0632e0 2020-05-18T21:28:52.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c89d9b700 1 --2- 172.21.15.63:0/375998881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c8c0632e0 0x7f6c8c144820 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7f6c740032f0 tx=0x7f6c74007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c89d9b700 1 --2- 172.21.15.63:0/375998881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c8c0632e0 0x7f6c8c144820 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7f6c740032f0 tx=0x7f6c74007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c8959a700 1 -- 172.21.15.63:0/375998881 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7400a180 con 0x7f6c8c0632e0 2020-05-18T21:28:52.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c8959a700 1 -- 172.21.15.63:0/375998881 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c7400a560 con 0x7f6c8c0632e0 2020-05-18T21:28:52.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c8b59e700 1 -- 172.21.15.63:0/375998881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c8c0632e0 msgr2=0x7f6c8c144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:52.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c8b59e700 1 --2- 172.21.15.63:0/375998881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c8c0632e0 0x7f6c8c144820 secure :-1 s=READY pgs=447 cs=0 l=1 rx=0x7f6c740032f0 tx=0x7f6c74007e00).stop 2020-05-18T21:28:52.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c8b59e700 1 -- 172.21.15.63:0/375998881 shutdown_connections 2020-05-18T21:28:52.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c8b59e700 1 --2- 172.21.15.63:0/375998881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c147100 0x7f6c8c141270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:52.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c8b59e700 1 --2- 172.21.15.63:0/375998881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c8c0632e0 0x7f6c8c144820 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:52.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c8b59e700 1 -- 172.21.15.63:0/375998881 >> 172.21.15.63:0/375998881 conn(0x7f6c8c05eee0 msgr2=0x7f6c8c05f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:52.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c8b59e700 1 -- 172.21.15.63:0/375998881 shutdown_connections 2020-05-18T21:28:52.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c8b59e700 1 -- 172.21.15.63:0/375998881 wait complete. 2020-05-18T21:28:52.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c8b59e700 1 Processor -- start 2020-05-18T21:28:52.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c8b59e700 1 -- start start 2020-05-18T21:28:52.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c8b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c0b71b0 0x7f6c8c0b4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:52.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c8b59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8c149a40 con 0x7f6c8c0632e0 2020-05-18T21:28:52.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c8b59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8c1425a0 con 0x7f6c8c147100 2020-05-18T21:28:52.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c8b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c14d150 con 0x7f6c8c0b71b0 2020-05-18T21:28:52.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c8a59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6c8c0632e0 0x7f6c8c141780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57934/0 (socket says 172.21.15.63:57934) 2020-05-18T21:28:52.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c8a59c700 1 -- 172.21.15.63:0/3962000702 learned_addr learned my addr 172.21.15.63:0/3962000702 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:52.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.789+0000 7f6c89d9b700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c0b71b0 0x7f6c8c0b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:52.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c837fe700 1 -- 172.21.15.63:0/3962000702 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079538267 0 0) 0x7f6c8c1425a0 con 0x7f6c8c147100 2020-05-18T21:28:52.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c837fe700 1 -- 172.21.15.63:0/3962000702 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c70002fe0 con 0x7f6c8c147100 2020-05-18T21:28:52.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c837fe700 1 -- 172.21.15.63:0/3962000702 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624089429 0 0) 0x7f6c8c149a40 con 0x7f6c8c0632e0 2020-05-18T21:28:52.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c837fe700 1 -- 172.21.15.63:0/3962000702 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c8c1425a0 con 0x7f6c8c0632e0 2020-05-18T21:28:52.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c89d9b700 1 -- 172.21.15.63:0/3962000702 >> v1:172.21.15.155:6789/0 conn(0x7f6c8c147100 legacy=0x7f6c8c141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:52.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c89d9b700 1 -- 172.21.15.63:0/3962000702 >> v1:172.21.15.63:6789/0 conn(0x7f6c8c0632e0 legacy=0x7f6c8c141780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:52.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c89d9b700 1 -- 172.21.15.63:0/3962000702 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c142e40 con 0x7f6c8c0b71b0 2020-05-18T21:28:52.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c89d9b700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c0b71b0 0x7f6c8c0b4760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6c740032f0 tx=0x7f6c74007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c89d9b700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c0b71b0 0x7f6c8c0b4760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6c740032f0 tx=0x7f6c74007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c89d9b700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c0b71b0 0x7f6c8c0b4760 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f6c740032f0 tx=0x7f6c74007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:52.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c89d9b700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c0b71b0 0x7f6c8c0b4760 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f6c740032f0 tx=0x7f6c74007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c837fe700 1 -- 172.21.15.63:0/3962000702 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c74005a80 con 0x7f6c8c0b71b0 2020-05-18T21:28:52.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c89d9b700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c0b71b0 0x7f6c8c0b4760 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f6c740032f0 tx=0x7f6c74007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c837fe700 1 -- 172.21.15.63:0/3962000702 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c74005be0 con 0x7f6c8c0b71b0 2020-05-18T21:28:52.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c89d9b700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c0b71b0 0x7f6c8c0b4760 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f6c740032f0 tx=0x7f6c74007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c8b59e700 1 -- 172.21.15.63:0/3962000702 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8c1430e0 con 0x7f6c8c0b71b0 2020-05-18T21:28:52.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c837fe700 1 -- 172.21.15.63:0/3962000702 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c7400f5b0 con 0x7f6c8c0b71b0 2020-05-18T21:28:52.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c8b59e700 1 -- 172.21.15.63:0/3962000702 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8c14cb90 con 0x7f6c8c0b71b0 2020-05-18T21:28:52.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c89d9b700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c0b71b0 0x7f6c8c0b4760 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f6c740032f0 tx=0x7f6c74007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c8b59e700 1 -- 172.21.15.63:0/3962000702 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8c0569e0 con 0x7f6c8c0b71b0 2020-05-18T21:28:52.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c837fe700 1 -- 172.21.15.63:0/3962000702 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6c7400f7f0 con 0x7f6c8c0b71b0 2020-05-18T21:28:52.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c89d9b700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c0b71b0 0x7f6c8c0b4760 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f6c740032f0 tx=0x7f6c74007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.793+0000 7f6c837fe700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c7004fec0 0x7f6c70052380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:52.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.797+0000 7f6c837fe700 1 -- 172.21.15.63:0/3962000702 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6c74064b70 con 0x7f6c8c0b71b0 2020-05-18T21:28:52.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.797+0000 7f6c8a59c700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c7004fec0 0x7f6c70052380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:52.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.797+0000 7f6c8a59c700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c7004fec0 0x7f6c70052380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6c7c001050 tx=0x7f6c8c043b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.797+0000 7f6c8a59c700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c7004fec0 0x7f6c70052380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6c7c001050 tx=0x7f6c8c043b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.797+0000 7f6c8a59c700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c7004fec0 0x7f6c70052380 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7f6c7c001050 tx=0x7f6c8c043b60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:52.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.801+0000 7f6c89d9b700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c0b71b0 0x7f6c8c0b4760 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f6c740032f0 tx=0x7f6c74007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.801+0000 7f6c837fe700 1 -- 172.21.15.63:0/3962000702 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6c7403efc0 con 0x7f6c8c0b71b0 2020-05-18T21:28:52.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.921+0000 7f6c8b59e700 1 -- 172.21.15.63:0/3962000702 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c8c146d00 con 0x7f6c8c0b71b0 2020-05-18T21:28:52.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.921+0000 7f6c89d9b700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c0b71b0 0x7f6c8c0b4760 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f6c740032f0 tx=0x7f6c74007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:52.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.921+0000 7f6c837fe700 1 -- 172.21.15.63:0/3962000702 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16091 (secure 0 0 0) 0x7f6c740425e0 con 0x7f6c8c0b71b0 2020-05-18T21:28:52.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.925+0000 7f6c8b59e700 1 -- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c7004fec0 msgr2=0x7f6c70052380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:52.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.925+0000 7f6c8b59e700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c7004fec0 0x7f6c70052380 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7f6c7c001050 tx=0x7f6c8c043b60).stop 2020-05-18T21:28:52.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.925+0000 7f6c8b59e700 1 -- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c0b71b0 msgr2=0x7f6c8c0b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:52.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.925+0000 7f6c8b59e700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c0b71b0 0x7f6c8c0b4760 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f6c740032f0 tx=0x7f6c74007e00).stop 2020-05-18T21:28:52.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.925+0000 7f6c8b59e700 1 -- 172.21.15.63:0/3962000702 shutdown_connections 2020-05-18T21:28:52.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.925+0000 7f6c8b59e700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c7004fec0 0x7f6c70052380 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:52.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.925+0000 7f6c8b59e700 1 --2- 172.21.15.63:0/3962000702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c8c0b71b0 0x7f6c8c0b4760 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:52.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.925+0000 7f6c8b59e700 1 -- 172.21.15.63:0/3962000702 >> 172.21.15.63:0/3962000702 conn(0x7f6c8c05eee0 msgr2=0x7f6c8c05f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:52.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.925+0000 7f6c8b59e700 1 -- 172.21.15.63:0/3962000702 shutdown_connections 2020-05-18T21:28:52.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:52.925+0000 7f6c8b59e700 1 -- 172.21.15.63:0/3962000702 wait complete. 2020-05-18T21:28:52.933 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:52.933 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":51,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:28:49.508247+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:28:46.842474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2020-05-18T21:28:47.510399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:28:52.942 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:28:46.842474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:28:47.510399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:28:52.943 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:28:53.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.041+0000 7f7b65631700 1 Processor -- start 2020-05-18T21:28:53.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b65631700 1 -- start start 2020-05-18T21:28:53.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b65631700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7b600ad0f0 0x7f7b600b8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:53.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b65631700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b600ba3e0 con 0x7f7b60145dd0 2020-05-18T21:28:53.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b65631700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b600b9ea0 con 0x7f7b601459f0 2020-05-18T21:28:53.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b65631700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b600ae270 con 0x7f7b600ad0f0 2020-05-18T21:28:53.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7b60145dd0 0x7f7b600afb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57946/0 (socket says 172.21.15.63:57946) 2020-05-18T21:28:53.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5f7fe700 1 -- 172.21.15.63:0/2246606393 learned_addr learned my addr 172.21.15.63:0/2246606393 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:53.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/2246606393 >> v2:172.21.15.155:3300/0 conn(0x7f7b600ad0f0 0x7f7b600b8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5dffb700 1 -- 172.21.15.63:0/2246606393 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722338749 0 0) 0x7f7b600ba3e0 con 0x7f7b60145dd0 2020-05-18T21:28:53.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5dffb700 1 -- 172.21.15.63:0/2246606393 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b40003270 con 0x7f7b60145dd0 2020-05-18T21:28:53.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5dffb700 1 -- 172.21.15.63:0/2246606393 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781271385 0 0) 0x7f7b600b9ea0 con 0x7f7b601459f0 2020-05-18T21:28:53.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5dffb700 1 -- 172.21.15.63:0/2246606393 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b600ba3e0 con 0x7f7b601459f0 2020-05-18T21:28:53.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5dffb700 1 -- 172.21.15.63:0/2246606393 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1150178910 0 0) 0x7f7b40003270 con 0x7f7b60145dd0 2020-05-18T21:28:53.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5dffb700 1 -- 172.21.15.63:0/2246606393 >> v2:172.21.15.155:3300/0 conn(0x7f7b600ad0f0 msgr2=0x7f7b600b8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:53.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5dffb700 1 --2- 172.21.15.63:0/2246606393 >> v2:172.21.15.155:3300/0 conn(0x7f7b600ad0f0 0x7f7b600b8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:53.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5dffb700 1 -- 172.21.15.63:0/2246606393 >> v1:172.21.15.155:6789/0 conn(0x7f7b601459f0 legacy=0x7f7b600bc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5dffb700 1 -- 172.21.15.63:0/2246606393 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b600ba140 con 0x7f7b60145dd0 2020-05-18T21:28:53.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5dffb700 1 -- 172.21.15.63:0/2246606393 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f7b58001a90 con 0x7f7b60145dd0 2020-05-18T21:28:53.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/2246606393 >> v2:172.21.15.155:3300/0 conn(0x7f7b600ad0f0 0x7f7b600b8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:53.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5dffb700 1 -- 172.21.15.63:0/2246606393 >> v1:172.21.15.63:6789/0 conn(0x7f7b60145dd0 legacy=0x7f7b600afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5dffb700 1 --2- 172.21.15.63:0/2246606393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b400038f0 0x7f7b40003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:53.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5dffb700 1 --2- 172.21.15.63:0/2246606393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b40004510 0x7f7b40004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:53.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5dffb700 1 --2- 172.21.15.63:0/2246606393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b40004df0 0x7f7b4000b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:53.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5dffb700 1 -- 172.21.15.63:0/2246606393 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b600ae270 con 0x7f7b40004510 2020-05-18T21:28:53.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5dffb700 1 -- 172.21.15.63:0/2246606393 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400053e0 con 0x7f7b400038f0 2020-05-18T21:28:53.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5dffb700 1 -- 172.21.15.63:0/2246606393 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4000bc40 con 0x7f7b40004df0 2020-05-18T21:28:53.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/2246606393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b40004510 0x7f7b40004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5effd700 1 --2- 172.21.15.63:0/2246606393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b400038f0 0x7f7b40003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5f7fe700 1 --2- 172.21.15.63:0/2246606393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b40004df0 0x7f7b4000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5e7fc700 1 -- 172.21.15.63:0/2246606393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b40004df0 msgr2=0x7f7b4000b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:53.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/2246606393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b40004df0 0x7f7b4000b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:53.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5e7fc700 1 -- 172.21.15.63:0/2246606393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b400038f0 msgr2=0x7f7b40003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:53.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/2246606393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b400038f0 0x7f7b40003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:53.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5e7fc700 1 -- 172.21.15.63:0/2246606393 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b40003270 con 0x7f7b40004510 2020-05-18T21:28:53.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5effd700 1 --2- 172.21.15.63:0/2246606393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b400038f0 0x7f7b40003cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:53.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5f7fe700 1 -- 172.21.15.63:0/2246606393 reap_dead start 2020-05-18T21:28:53.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/2246606393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b40004510 0x7f7b40004990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7b48002f70 tx=0x7f7b4800be70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/2246606393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b40004510 0x7f7b40004990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7b48002f70 tx=0x7f7b4800be70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.045+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/2246606393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b40004510 0x7f7b40004990 secure :-1 s=READY pgs=623 cs=0 l=1 rx=0x7f7b48002f70 tx=0x7f7b4800be70).ready entity=mon.0 client_cookie=5edd0edf8a8454a8 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:53.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.049+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/2246606393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b40004510 0x7f7b40004990 secure :-1 s=THROTTLE_DONE pgs=623 cs=0 l=1 rx=0x7f7b48002f70 tx=0x7f7b4800be70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.049+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/2246606393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b40004510 0x7f7b40004990 secure :-1 s=THROTTLE_DONE pgs=623 cs=0 l=1 rx=0x7f7b48002f70 tx=0x7f7b4800be70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.049+0000 7f7b5dffb700 1 -- 172.21.15.63:0/2246606393 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b4800e7f0 con 0x7f7b40004510 2020-05-18T21:28:53.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.049+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/2246606393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b40004510 0x7f7b40004990 secure :-1 s=THROTTLE_DONE pgs=623 cs=0 l=1 rx=0x7f7b48002f70 tx=0x7f7b4800be70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.049+0000 7f7b5dffb700 1 -- 172.21.15.63:0/2246606393 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4800e950 con 0x7f7b40004510 2020-05-18T21:28:53.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.049+0000 7f7b5dffb700 1 -- 172.21.15.63:0/2246606393 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b4800ecb0 con 0x7f7b40004510 2020-05-18T21:28:53.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.049+0000 7f7b65631700 1 -- 172.21.15.63:0/2246606393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b40004510 msgr2=0x7f7b40004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.049+0000 7f7b65631700 1 --2- 172.21.15.63:0/2246606393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b40004510 0x7f7b40004990 secure :-1 s=READY pgs=623 cs=0 l=1 rx=0x7f7b48002f70 tx=0x7f7b4800be70).stop 2020-05-18T21:28:53.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.049+0000 7f7b65631700 1 -- 172.21.15.63:0/2246606393 shutdown_connections 2020-05-18T21:28:53.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.049+0000 7f7b65631700 1 --2- 172.21.15.63:0/2246606393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b40004510 0x7f7b40004990 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:53.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.049+0000 7f7b65631700 1 -- 172.21.15.63:0/2246606393 >> 172.21.15.63:0/2246606393 conn(0x7f7b6005f540 msgr2=0x7f7b6005f920 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:53.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.049+0000 7f7b65631700 1 -- 172.21.15.63:0/2246606393 shutdown_connections 2020-05-18T21:28:53.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.049+0000 7f7b65631700 1 -- 172.21.15.63:0/2246606393 wait complete. 2020-05-18T21:28:53.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.049+0000 7f7b65631700 1 Processor -- start 2020-05-18T21:28:53.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.049+0000 7f7b65631700 1 -- start start 2020-05-18T21:28:53.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.049+0000 7f7b65631700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7b600b16f0 0x7f7b601538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:53.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.049+0000 7f7b65631700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b60144c80 con 0x7f7b60144820 2020-05-18T21:28:53.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.049+0000 7f7b65631700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b600afa40 con 0x7f7b40004510 2020-05-18T21:28:53.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.049+0000 7f7b65631700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b60153d50 con 0x7f7b600b16f0 2020-05-18T21:28:53.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b5f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7b60144820 0x7f7b600b0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57958/0 (socket says 172.21.15.63:57958) 2020-05-18T21:28:53.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b5f7fe700 1 -- 172.21.15.63:0/202092405 learned_addr learned my addr 172.21.15.63:0/202092405 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:53.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/202092405 >> v2:172.21.15.155:3300/0 conn(0x7f7b600b16f0 0x7f7b601538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b57fff700 1 -- 172.21.15.63:0/202092405 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2535078216 0 0) 0x7f7b60144c80 con 0x7f7b60144820 2020-05-18T21:28:53.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b57fff700 1 -- 172.21.15.63:0/202092405 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b44002fe0 con 0x7f7b60144820 2020-05-18T21:28:53.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b57fff700 1 -- 172.21.15.63:0/202092405 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2457608236 0 0) 0x7f7b44002fe0 con 0x7f7b60144820 2020-05-18T21:28:53.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b5e7fc700 1 -- 172.21.15.63:0/202092405 >> v1:172.21.15.155:6789/0 conn(0x7f7b40004510 legacy=0x7f7b60132ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b5e7fc700 1 -- 172.21.15.63:0/202092405 >> v1:172.21.15.63:6789/0 conn(0x7f7b60144820 legacy=0x7f7b600b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b5e7fc700 1 -- 172.21.15.63:0/202092405 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b600afce0 con 0x7f7b600b16f0 2020-05-18T21:28:53.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/202092405 >> v2:172.21.15.155:3300/0 conn(0x7f7b600b16f0 0x7f7b601538f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b58000f40 tx=0x7f7b4800be70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/202092405 >> v2:172.21.15.155:3300/0 conn(0x7f7b600b16f0 0x7f7b601538f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b58000f40 tx=0x7f7b4800be70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/202092405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b600b16f0 0x7f7b601538f0 secure :-1 s=READY pgs=451 cs=0 l=1 rx=0x7f7b58000f40 tx=0x7f7b4800be70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:53.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/202092405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b600b16f0 0x7f7b601538f0 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7f7b58000f40 tx=0x7f7b4800be70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b57fff700 1 -- 172.21.15.63:0/202092405 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b58001a90 con 0x7f7b600b16f0 2020-05-18T21:28:53.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/202092405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b600b16f0 0x7f7b601538f0 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7f7b58000f40 tx=0x7f7b4800be70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b57fff700 1 -- 172.21.15.63:0/202092405 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b48011a60 con 0x7f7b600b16f0 2020-05-18T21:28:53.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b65631700 1 -- 172.21.15.63:0/202092405 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b601335b0 con 0x7f7b600b16f0 2020-05-18T21:28:53.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/202092405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b600b16f0 0x7f7b601538f0 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7f7b58000f40 tx=0x7f7b4800be70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b57fff700 1 -- 172.21.15.63:0/202092405 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b48011dc0 con 0x7f7b600b16f0 2020-05-18T21:28:53.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b65631700 1 -- 172.21.15.63:0/202092405 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b600b3a10 con 0x7f7b600b16f0 2020-05-18T21:28:53.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/202092405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b600b16f0 0x7f7b601538f0 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7f7b58000f40 tx=0x7f7b4800be70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.053+0000 7f7b65631700 1 -- 172.21.15.63:0/202092405 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b600afe70 con 0x7f7b600b16f0 2020-05-18T21:28:53.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.057+0000 7f7b57fff700 1 -- 172.21.15.63:0/202092405 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7b48007180 con 0x7f7b600b16f0 2020-05-18T21:28:53.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.057+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/202092405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b600b16f0 0x7f7b601538f0 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7f7b58000f40 tx=0x7f7b4800be70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.057+0000 7f7b57fff700 1 --2- 172.21.15.63:0/202092405 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b4404fce0 0x7f7b440521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:53.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.057+0000 7f7b57fff700 1 -- 172.21.15.63:0/202092405 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7b48063cd0 con 0x7f7b600b16f0 2020-05-18T21:28:53.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.057+0000 7f7b5effd700 1 --2- 172.21.15.63:0/202092405 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b4404fce0 0x7f7b440521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.057+0000 7f7b5effd700 1 --2- 172.21.15.63:0/202092405 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b4404fce0 0x7f7b440521a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b50003f00 tx=0x7f7b50001620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.057+0000 7f7b5effd700 1 --2- 172.21.15.63:0/202092405 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b4404fce0 0x7f7b440521a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b50003f00 tx=0x7f7b50001620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.057+0000 7f7b5effd700 1 --2- 172.21.15.63:0/202092405 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b4404fce0 0x7f7b440521a0 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7f7b50003f00 tx=0x7f7b50001620).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:53.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.065+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/202092405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b600b16f0 0x7f7b601538f0 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7f7b58000f40 tx=0x7f7b4800be70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.065+0000 7f7b57fff700 1 -- 172.21.15.63:0/202092405 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f7b4803e180 con 0x7f7b600b16f0 2020-05-18T21:28:53.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.181+0000 7f7b65631700 1 -- 172.21.15.63:0/202092405 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7b600569e0 con 0x7f7b600b16f0 2020-05-18T21:28:53.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.181+0000 7f7b5e7fc700 1 --2- 172.21.15.63:0/202092405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b600b16f0 0x7f7b601538f0 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7f7b58000f40 tx=0x7f7b4800be70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.181+0000 7f7b57fff700 1 -- 172.21.15.63:0/202092405 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v51) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7b48066020 con 0x7f7b600b16f0 2020-05-18T21:28:53.189 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:28:53.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.185+0000 7f7b65631700 1 -- 172.21.15.63:0/202092405 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b4404fce0 msgr2=0x7f7b440521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.185+0000 7f7b65631700 1 --2- 172.21.15.63:0/202092405 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b4404fce0 0x7f7b440521a0 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7f7b50003f00 tx=0x7f7b50001620).stop 2020-05-18T21:28:53.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.185+0000 7f7b65631700 1 -- 172.21.15.63:0/202092405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b600b16f0 msgr2=0x7f7b601538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.185+0000 7f7b65631700 1 --2- 172.21.15.63:0/202092405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b600b16f0 0x7f7b601538f0 secure :-1 s=READY pgs=451 cs=0 l=1 rx=0x7f7b58000f40 tx=0x7f7b4800be70).stop 2020-05-18T21:28:53.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.185+0000 7f7b65631700 1 -- 172.21.15.63:0/202092405 shutdown_connections 2020-05-18T21:28:53.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.185+0000 7f7b65631700 1 --2- 172.21.15.63:0/202092405 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b4404fce0 0x7f7b440521a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:53.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.185+0000 7f7b65631700 1 --2- 172.21.15.63:0/202092405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b600b16f0 0x7f7b601538f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:53.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.185+0000 7f7b65631700 1 -- 172.21.15.63:0/202092405 >> 172.21.15.63:0/202092405 conn(0x7f7b6005f540 msgr2=0x7f7b60060490 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:53.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.185+0000 7f7b65631700 1 -- 172.21.15.63:0/202092405 shutdown_connections 2020-05-18T21:28:53.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.185+0000 7f7b65631700 1 -- 172.21.15.63:0/202092405 wait complete. 2020-05-18T21:28:53.201 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:28:53.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71ca8f2700 1 Processor -- start 2020-05-18T21:28:53.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71ca8f2700 1 -- start start 2020-05-18T21:28:53.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71ca8f2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f71c40b54f0 0x7f71c40adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:53.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71ca8f2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71c40b0260 0x7f71c40b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:53.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71ca8f2700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c40adf60 con 0x7f71c4143a70 2020-05-18T21:28:53.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71ca8f2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c40b4db0 con 0x7f71c40b54f0 2020-05-18T21:28:53.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71ca8f2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40b5050 con 0x7f71c40b0260 2020-05-18T21:28:53.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c98f0700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f71c4143a70 0x7f71c40ad3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57962/0 (socket says 172.21.15.63:57962) 2020-05-18T21:28:53.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c98f0700 1 -- 172.21.15.63:0/4267537604 learned_addr learned my addr 172.21.15.63:0/4267537604 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:53.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c90ef700 1 --2- 172.21.15.63:0/4267537604 >> v2:172.21.15.155:3300/0 conn(0x7f71c40b54f0 0x7f71c40adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71ca0f1700 1 --2- 172.21.15.63:0/4267537604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71c40b0260 0x7f71c40b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c88ee700 1 -- 172.21.15.63:0/4267537604 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515277000 0 0) 0x7f71c40adf60 con 0x7f71c4143a70 2020-05-18T21:28:53.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c88ee700 1 -- 172.21.15.63:0/4267537604 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71ac003270 con 0x7f71c4143a70 2020-05-18T21:28:53.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c88ee700 1 -- 172.21.15.63:0/4267537604 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3670015015 0 0) 0x7f71ac003270 con 0x7f71c4143a70 2020-05-18T21:28:53.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c88ee700 1 -- 172.21.15.63:0/4267537604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71c40b0260 msgr2=0x7f71c40b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:53.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c88ee700 1 --2- 172.21.15.63:0/4267537604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71c40b0260 0x7f71c40b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:53.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c88ee700 1 -- 172.21.15.63:0/4267537604 >> v2:172.21.15.155:3300/0 conn(0x7f71c40b54f0 msgr2=0x7f71c40adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:53.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c88ee700 1 --2- 172.21.15.63:0/4267537604 >> v2:172.21.15.155:3300/0 conn(0x7f71c40b54f0 0x7f71c40adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:53.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c88ee700 1 -- 172.21.15.63:0/4267537604 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c40ae400 con 0x7f71c4143a70 2020-05-18T21:28:53.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c88ee700 1 -- 172.21.15.63:0/4267537604 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f71c0001730 con 0x7f71c4143a70 2020-05-18T21:28:53.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c88ee700 1 -- 172.21.15.63:0/4267537604 >> v1:172.21.15.63:6789/0 conn(0x7f71c4143a70 legacy=0x7f71c40ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c88ee700 1 --2- 172.21.15.63:0/4267537604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71c40b0260 0x7f71ac003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:53.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c88ee700 1 --2- 172.21.15.63:0/4267537604 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71ac003bc0 0x7f71ac004040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:53.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c88ee700 1 --2- 172.21.15.63:0/4267537604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71ac004600 0x7f71ac004a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:53.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c88ee700 1 -- 172.21.15.63:0/4267537604 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40b4db0 con 0x7f71ac003bc0 2020-05-18T21:28:53.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c88ee700 1 -- 172.21.15.63:0/4267537604 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40b5050 con 0x7f71ac004600 2020-05-18T21:28:53.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c88ee700 1 -- 172.21.15.63:0/4267537604 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac0050b0 con 0x7f71c40b0260 2020-05-18T21:28:53.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c90ef700 1 --2- 172.21.15.63:0/4267537604 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71ac003bc0 0x7f71ac004040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c98f0700 1 --2- 172.21.15.63:0/4267537604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71c40b0260 0x7f71ac003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71ca0f1700 1 --2- 172.21.15.63:0/4267537604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71ac004600 0x7f71ac004a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c90ef700 1 -- 172.21.15.63:0/4267537604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71c40b0260 msgr2=0x7f71ac003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:53.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c90ef700 1 --2- 172.21.15.63:0/4267537604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71c40b0260 0x7f71ac003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:53.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c90ef700 1 -- 172.21.15.63:0/4267537604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71ac004600 msgr2=0x7f71ac004a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:53.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c90ef700 1 --2- 172.21.15.63:0/4267537604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71ac004600 0x7f71ac004a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:53.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c90ef700 1 -- 172.21.15.63:0/4267537604 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac003270 con 0x7f71ac003bc0 2020-05-18T21:28:53.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c98f0700 1 --2- 172.21.15.63:0/4267537604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71c40b0260 0x7f71ac003760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:53.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c90ef700 1 --2- 172.21.15.63:0/4267537604 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71ac003bc0 0x7f71ac004040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f71b4002f70 tx=0x7f71b4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c90ef700 1 --2- 172.21.15.63:0/4267537604 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71ac003bc0 0x7f71ac004040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f71b4002f70 tx=0x7f71b4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.305+0000 7f71c90ef700 1 --2- 172.21.15.63:0/4267537604 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71ac003bc0 0x7f71ac004040 secure :-1 s=READY pgs=626 cs=0 l=1 rx=0x7f71b4002f70 tx=0x7f71b4010060).ready entity=mon.0 client_cookie=4d0702f75a8cd7a7 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:53.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.309+0000 7f71c90ef700 1 --2- 172.21.15.63:0/4267537604 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71ac003bc0 0x7f71ac004040 secure :-1 s=THROTTLE_DONE pgs=626 cs=0 l=1 rx=0x7f71b4002f70 tx=0x7f71b4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.309+0000 7f71c90ef700 1 --2- 172.21.15.63:0/4267537604 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71ac003bc0 0x7f71ac004040 secure :-1 s=THROTTLE_DONE pgs=626 cs=0 l=1 rx=0x7f71b4002f70 tx=0x7f71b4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.309+0000 7f71c88ee700 1 -- 172.21.15.63:0/4267537604 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71b4008e30 con 0x7f71ac003bc0 2020-05-18T21:28:53.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.309+0000 7f71c90ef700 1 --2- 172.21.15.63:0/4267537604 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71ac003bc0 0x7f71ac004040 secure :-1 s=THROTTLE_DONE pgs=626 cs=0 l=1 rx=0x7f71b4002f70 tx=0x7f71b4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.309+0000 7f71c88ee700 1 -- 172.21.15.63:0/4267537604 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b4010910 con 0x7f71ac003bc0 2020-05-18T21:28:53.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.309+0000 7f71c88ee700 1 -- 172.21.15.63:0/4267537604 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71b4010c70 con 0x7f71ac003bc0 2020-05-18T21:28:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.309+0000 7f71ca8f2700 1 -- 172.21.15.63:0/4267537604 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71ac003bc0 msgr2=0x7f71ac004040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.309+0000 7f71ca8f2700 1 --2- 172.21.15.63:0/4267537604 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71ac003bc0 0x7f71ac004040 secure :-1 s=READY pgs=626 cs=0 l=1 rx=0x7f71b4002f70 tx=0x7f71b4010060).stop 2020-05-18T21:28:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.309+0000 7f71ca0f1700 1 -- 172.21.15.63:0/4267537604 reap_dead start 2020-05-18T21:28:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.309+0000 7f71ca8f2700 1 -- 172.21.15.63:0/4267537604 shutdown_connections 2020-05-18T21:28:53.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.309+0000 7f71ca8f2700 1 -- 172.21.15.63:0/4267537604 >> 172.21.15.63:0/4267537604 conn(0x7f71c405fb90 msgr2=0x7f71c4069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:53.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.309+0000 7f71ca8f2700 1 -- 172.21.15.63:0/4267537604 shutdown_connections 2020-05-18T21:28:53.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.309+0000 7f71ca8f2700 1 -- 172.21.15.63:0/4267537604 wait complete. 2020-05-18T21:28:53.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.309+0000 7f71ca8f2700 1 Processor -- start 2020-05-18T21:28:53.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.309+0000 7f71ca8f2700 1 -- start start 2020-05-18T21:28:53.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71ca8f2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f71c4135180 0x7f71c40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:53.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71ca8f2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f71c4135560 0x7f71c41359d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:53.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71ca8f2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c4062260 con 0x7f71c4112e50 2020-05-18T21:28:53.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71ca8f2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c4062500 con 0x7f71c4135180 2020-05-18T21:28:53.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71ca8f2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c40627a0 con 0x7f71c4135560 2020-05-18T21:28:53.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71c98f0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f71c4135180 0x7f71c40612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71c98f0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f71c4135180 0x7f71c40612a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55786/0 (socket says 172.21.15.63:55786) 2020-05-18T21:28:53.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71c98f0700 1 -- 172.21.15.63:0/2539563167 learned_addr learned my addr 172.21.15.63:0/2539563167 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:53.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71c90ef700 1 --2- 172.21.15.63:0/2539563167 >> v2:172.21.15.155:3300/0 conn(0x7f71c4135560 0x7f71c41359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71c98f0700 1 -- 172.21.15.63:0/2539563167 >> v2:172.21.15.155:3300/0 conn(0x7f71c4135560 msgr2=0x7f71c41359d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71c98f0700 1 --2- 172.21.15.63:0/2539563167 >> v2:172.21.15.155:3300/0 conn(0x7f71c4135560 0x7f71c41359d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:53.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71c98f0700 1 -- 172.21.15.63:0/2539563167 >> v1:172.21.15.155:6789/0 conn(0x7f71c4112e50 legacy=0x7f71c4113280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71c98f0700 1 -- 172.21.15.63:0/2539563167 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c41362a0 con 0x7f71c4135180 2020-05-18T21:28:53.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71c98f0700 1 --2- 172.21.15.63:0/2539563167 >> v2:172.21.15.63:3300/0 conn(0x7f71c4135180 0x7f71c40612a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f71c40b1350 tx=0x7f71c40ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71c98f0700 1 --2- 172.21.15.63:0/2539563167 >> v2:172.21.15.63:3300/0 conn(0x7f71c4135180 0x7f71c40612a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f71c40b1350 tx=0x7f71c40ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71c98f0700 1 --2- 172.21.15.63:0/2539563167 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71c4135180 0x7f71c40612a0 secure :-1 s=READY pgs=627 cs=0 l=1 rx=0x7f71c40b1350 tx=0x7f71c40ae590).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:53.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71c98f0700 1 --2- 172.21.15.63:0/2539563167 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71c4135180 0x7f71c40612a0 secure :-1 s=THROTTLE_DONE pgs=627 cs=0 l=1 rx=0x7f71c40b1350 tx=0x7f71c40ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71c98f0700 1 --2- 172.21.15.63:0/2539563167 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71c4135180 0x7f71c40612a0 secure :-1 s=THROTTLE_DONE pgs=627 cs=0 l=1 rx=0x7f71c40b1350 tx=0x7f71c40ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71c98f0700 1 --2- 172.21.15.63:0/2539563167 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71c4135180 0x7f71c40612a0 secure :-1 s=THROTTLE_DONE pgs=627 cs=0 l=1 rx=0x7f71c40b1350 tx=0x7f71c40ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71b2ffd700 1 -- 172.21.15.63:0/2539563167 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c000ea80 con 0x7f71c4135180 2020-05-18T21:28:53.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71b2ffd700 1 -- 172.21.15.63:0/2539563167 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c000ebe0 con 0x7f71c4135180 2020-05-18T21:28:53.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71ca8f2700 1 -- 172.21.15.63:0/2539563167 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c4135e30 con 0x7f71c4135180 2020-05-18T21:28:53.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71b2ffd700 1 -- 172.21.15.63:0/2539563167 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c0004530 con 0x7f71c4135180 2020-05-18T21:28:53.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71ca8f2700 1 -- 172.21.15.63:0/2539563167 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c4063ac0 con 0x7f71c4135180 2020-05-18T21:28:53.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71c98f0700 1 --2- 172.21.15.63:0/2539563167 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71c4135180 0x7f71c40612a0 secure :-1 s=THROTTLE_DONE pgs=627 cs=0 l=1 rx=0x7f71c40b1350 tx=0x7f71c40ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71ca8f2700 1 -- 172.21.15.63:0/2539563167 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c40569e0 con 0x7f71c4135180 2020-05-18T21:28:53.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71b2ffd700 1 -- 172.21.15.63:0/2539563167 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f71c00047a0 con 0x7f71c4135180 2020-05-18T21:28:53.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71c98f0700 1 --2- 172.21.15.63:0/2539563167 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71c4135180 0x7f71c40612a0 secure :-1 s=THROTTLE_DONE pgs=627 cs=0 l=1 rx=0x7f71c40b1350 tx=0x7f71c40ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71b2ffd700 1 --2- 172.21.15.63:0/2539563167 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71a404fa50 0x7f71a4051f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:53.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.313+0000 7f71b2ffd700 1 -- 172.21.15.63:0/2539563167 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f71c0063c10 con 0x7f71c4135180 2020-05-18T21:28:53.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.317+0000 7f71c90ef700 1 --2- 172.21.15.63:0/2539563167 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71a404fa50 0x7f71a4051f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.317+0000 7f71c90ef700 1 --2- 172.21.15.63:0/2539563167 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71a404fa50 0x7f71a4051f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f71b4002f70 tx=0x7f71b4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.317+0000 7f71c90ef700 1 --2- 172.21.15.63:0/2539563167 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71a404fa50 0x7f71a4051f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f71b4002f70 tx=0x7f71b4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.317+0000 7f71c90ef700 1 --2- 172.21.15.63:0/2539563167 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71a404fa50 0x7f71a4051f10 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7f71b4002f70 tx=0x7f71b4010060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:53.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.321+0000 7f71c98f0700 1 --2- 172.21.15.63:0/2539563167 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71c4135180 0x7f71c40612a0 secure :-1 s=THROTTLE_DONE pgs=627 cs=0 l=1 rx=0x7f71c40b1350 tx=0x7f71c40ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.321+0000 7f71b2ffd700 1 -- 172.21.15.63:0/2539563167 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f71c003dfa0 con 0x7f71c4135180 2020-05-18T21:28:53.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.437+0000 7f71ca8f2700 1 -- 172.21.15.63:0/2539563167 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f71c406a9a0 con 0x7f71c4135180 2020-05-18T21:28:53.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.437+0000 7f71c98f0700 1 --2- 172.21.15.63:0/2539563167 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71c4135180 0x7f71c40612a0 secure :-1 s=THROTTLE_DONE pgs=627 cs=0 l=1 rx=0x7f71c40b1350 tx=0x7f71c40ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.437+0000 7f71b2ffd700 1 -- 172.21.15.63:0/2539563167 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v51) v1 ==== 92+0+10 (secure 0 0 0) 0x7f71c00415c0 con 0x7f71c4135180 2020-05-18T21:28:53.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.441+0000 7f71ca8f2700 1 -- 172.21.15.63:0/2539563167 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71a404fa50 msgr2=0x7f71a4051f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.441+0000 7f71ca8f2700 1 --2- 172.21.15.63:0/2539563167 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71a404fa50 0x7f71a4051f10 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7f71b4002f70 tx=0x7f71b4010060).stop 2020-05-18T21:28:53.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.441+0000 7f71ca8f2700 1 -- 172.21.15.63:0/2539563167 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71c4135180 msgr2=0x7f71c40612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.441+0000 7f71ca8f2700 1 --2- 172.21.15.63:0/2539563167 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71c4135180 0x7f71c40612a0 secure :-1 s=READY pgs=627 cs=0 l=1 rx=0x7f71c40b1350 tx=0x7f71c40ae590).stop 2020-05-18T21:28:53.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.441+0000 7f71ca8f2700 1 -- 172.21.15.63:0/2539563167 shutdown_connections 2020-05-18T21:28:53.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.441+0000 7f71ca8f2700 1 --2- 172.21.15.63:0/2539563167 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71a404fa50 0x7f71a4051f10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:53.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.441+0000 7f71ca8f2700 1 --2- 172.21.15.63:0/2539563167 >> v2:172.21.15.155:3300/0 conn(0x7f71c4135560 0x7f71c41359d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:53.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.441+0000 7f71ca8f2700 1 --2- 172.21.15.63:0/2539563167 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71c4135180 0x7f71c40612a0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:53.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.441+0000 7f71ca8f2700 1 -- 172.21.15.63:0/2539563167 >> 172.21.15.63:0/2539563167 conn(0x7f71c405fb90 msgr2=0x7f71c4142fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:53.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.441+0000 7f71ca8f2700 1 -- 172.21.15.63:0/2539563167 shutdown_connections 2020-05-18T21:28:53.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.441+0000 7f71ca8f2700 1 -- 172.21.15.63:0/2539563167 wait complete. 2020-05-18T21:28:53.480 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:28:53.480 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:28:53.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.593+0000 7f655b59e700 1 Processor -- start 2020-05-18T21:28:53.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.593+0000 7f655b59e700 1 -- start start 2020-05-18T21:28:53.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.593+0000 7f655b59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f655c0b4f60 0x7f655c06a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:53.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.593+0000 7f655b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f655c060e10 0x7f655c061210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:53.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.593+0000 7f655b59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655c065a50 con 0x7f655c0653f0 2020-05-18T21:28:53.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.593+0000 7f655b59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655c065860 con 0x7f655c060e10 2020-05-18T21:28:53.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.593+0000 7f655b59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655c0606d0 con 0x7f655c0b4f60 2020-05-18T21:28:53.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.593+0000 7f655ad9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f655c060e10 0x7f655c061210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f6559d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f655c0653f0 0x7f655c129880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57984/0 (socket says 172.21.15.63:57984) 2020-05-18T21:28:53.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f6559d9b700 1 -- 172.21.15.63:0/1559694985 learned_addr learned my addr 172.21.15.63:0/1559694985 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:53.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655a59c700 1 --2- 172.21.15.63:0/1559694985 >> v2:172.21.15.155:3300/0 conn(0x7f655c0b4f60 0x7f655c06a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655ad9d700 1 -- 172.21.15.63:0/1559694985 >> v2:172.21.15.155:3300/0 conn(0x7f655c0b4f60 msgr2=0x7f655c06a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:53.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655ad9d700 1 --2- 172.21.15.63:0/1559694985 >> v2:172.21.15.155:3300/0 conn(0x7f655c0b4f60 0x7f655c06a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:53.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655ad9d700 1 -- 172.21.15.63:0/1559694985 >> v1:172.21.15.63:6789/0 conn(0x7f655c0653f0 legacy=0x7f655c129880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655ad9d700 1 -- 172.21.15.63:0/1559694985 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c060970 con 0x7f655c060e10 2020-05-18T21:28:53.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655ad9d700 1 --2- 172.21.15.63:0/1559694985 >> v2:172.21.15.63:3300/0 conn(0x7f655c060e10 0x7f655c061210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f65540032f0 tx=0x7f6554007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655ad9d700 1 --2- 172.21.15.63:0/1559694985 >> v2:172.21.15.63:3300/0 conn(0x7f655c060e10 0x7f655c061210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f65540032f0 tx=0x7f6554007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655ad9d700 1 --2- 172.21.15.63:0/1559694985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f655c060e10 0x7f655c061210 secure :-1 s=READY pgs=629 cs=0 l=1 rx=0x7f65540032f0 tx=0x7f6554007e00).ready entity=mon.0 client_cookie=848f4f0026dc2984 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:53.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655ad9d700 1 --2- 172.21.15.63:0/1559694985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f655c060e10 0x7f655c061210 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7f65540032f0 tx=0x7f6554007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655959a700 1 -- 172.21.15.63:0/1559694985 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6554011e60 con 0x7f655c060e10 2020-05-18T21:28:53.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655ad9d700 1 --2- 172.21.15.63:0/1559694985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f655c060e10 0x7f655c061210 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7f65540032f0 tx=0x7f6554007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655959a700 1 -- 172.21.15.63:0/1559694985 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655400a180 con 0x7f655c060e10 2020-05-18T21:28:53.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655ad9d700 1 --2- 172.21.15.63:0/1559694985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f655c060e10 0x7f655c061210 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7f65540032f0 tx=0x7f6554007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655959a700 1 -- 172.21.15.63:0/1559694985 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f655400a560 con 0x7f655c060e10 2020-05-18T21:28:53.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655b59e700 1 -- 172.21.15.63:0/1559694985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f655c060e10 msgr2=0x7f655c061210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655b59e700 1 --2- 172.21.15.63:0/1559694985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f655c060e10 0x7f655c061210 secure :-1 s=READY pgs=629 cs=0 l=1 rx=0x7f65540032f0 tx=0x7f6554007e00).stop 2020-05-18T21:28:53.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655b59e700 1 -- 172.21.15.63:0/1559694985 shutdown_connections 2020-05-18T21:28:53.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655b59e700 1 --2- 172.21.15.63:0/1559694985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f655c060e10 0x7f655c061210 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:53.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655b59e700 1 --2- 172.21.15.63:0/1559694985 >> v2:172.21.15.155:3300/0 conn(0x7f655c0b4f60 0x7f655c06a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:53.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655b59e700 1 -- 172.21.15.63:0/1559694985 >> 172.21.15.63:0/1559694985 conn(0x7f655c05fbd0 msgr2=0x7f655c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:53.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655b59e700 1 -- 172.21.15.63:0/1559694985 shutdown_connections 2020-05-18T21:28:53.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.597+0000 7f655b59e700 1 -- 172.21.15.63:0/1559694985 wait complete. 2020-05-18T21:28:53.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.601+0000 7f655b59e700 1 Processor -- start 2020-05-18T21:28:53.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.601+0000 7f655b59e700 1 -- start start 2020-05-18T21:28:53.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f655c0653f0 0x7f655c12c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:53.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655b59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f655c0b4f60 0x7f655c12b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:53.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655b59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655c12b520 con 0x7f655c060e10 2020-05-18T21:28:53.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655b59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655c12a100 con 0x7f655c0b4f60 2020-05-18T21:28:53.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c12a3a0 con 0x7f655c0653f0 2020-05-18T21:28:53.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655a59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f655c060e10 0x7f655c151020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57988/0 (socket says 172.21.15.63:57988) 2020-05-18T21:28:53.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655a59c700 1 -- 172.21.15.63:0/2481829406 learned_addr learned my addr 172.21.15.63:0/2481829406 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:53.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f6559d9b700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f655c0653f0 0x7f655c12c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655ad9d700 1 --2- 172.21.15.63:0/2481829406 >> v2:172.21.15.155:3300/0 conn(0x7f655c0b4f60 0x7f655c12b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f65537fe700 1 -- 172.21.15.63:0/2481829406 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278938351 0 0) 0x7f655c12b520 con 0x7f655c060e10 2020-05-18T21:28:53.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f65537fe700 1 -- 172.21.15.63:0/2481829406 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6540002fe0 con 0x7f655c060e10 2020-05-18T21:28:53.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f65537fe700 1 -- 172.21.15.63:0/2481829406 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2976262853 0 0) 0x7f6540002fe0 con 0x7f655c060e10 2020-05-18T21:28:53.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655ad9d700 1 -- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f655c0653f0 msgr2=0x7f655c12c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655ad9d700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f655c0653f0 0x7f655c12c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:53.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655ad9d700 1 -- 172.21.15.63:0/2481829406 >> v1:172.21.15.63:6789/0 conn(0x7f655c060e10 legacy=0x7f655c151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655ad9d700 1 -- 172.21.15.63:0/2481829406 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c1545f0 con 0x7f655c0b4f60 2020-05-18T21:28:53.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655ad9d700 1 --2- 172.21.15.63:0/2481829406 >> v2:172.21.15.155:3300/0 conn(0x7f655c0b4f60 0x7f655c12b810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f654c001670 tx=0x7f6554007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655ad9d700 1 --2- 172.21.15.63:0/2481829406 >> v2:172.21.15.155:3300/0 conn(0x7f655c0b4f60 0x7f655c12b810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f654c001670 tx=0x7f6554007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655ad9d700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f655c0b4f60 0x7f655c12b810 secure :-1 s=READY pgs=453 cs=0 l=1 rx=0x7f654c001670 tx=0x7f6554007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:53.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655ad9d700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f655c0b4f60 0x7f655c12b810 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f654c001670 tx=0x7f6554007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f65537fe700 1 -- 172.21.15.63:0/2481829406 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f654c0014d0 con 0x7f655c0b4f60 2020-05-18T21:28:53.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655ad9d700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f655c0b4f60 0x7f655c12b810 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f654c001670 tx=0x7f6554007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655ad9d700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f655c0b4f60 0x7f655c12b810 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f654c001670 tx=0x7f6554007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f65537fe700 1 -- 172.21.15.63:0/2481829406 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655400ae20 con 0x7f655c0b4f60 2020-05-18T21:28:53.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655b59e700 1 -- 172.21.15.63:0/2481829406 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655c151730 con 0x7f655c0b4f60 2020-05-18T21:28:53.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f65537fe700 1 -- 172.21.15.63:0/2481829406 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6554005c70 con 0x7f655c0b4f60 2020-05-18T21:28:53.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655b59e700 1 -- 172.21.15.63:0/2481829406 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655c0b8d80 con 0x7f655c0b4f60 2020-05-18T21:28:53.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655ad9d700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f655c0b4f60 0x7f655c12b810 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f654c001670 tx=0x7f6554007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.605+0000 7f655b59e700 1 -- 172.21.15.63:0/2481829406 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655c0569e0 con 0x7f655c0b4f60 2020-05-18T21:28:53.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.609+0000 7f65537fe700 1 -- 172.21.15.63:0/2481829406 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6554007170 con 0x7f655c0b4f60 2020-05-18T21:28:53.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.609+0000 7f655ad9d700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f655c0b4f60 0x7f655c12b810 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f654c001670 tx=0x7f6554007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.609+0000 7f65537fe700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6540054120 0x7f65400565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:53.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.609+0000 7f65537fe700 1 -- 172.21.15.63:0/2481829406 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6554064630 con 0x7f655c0b4f60 2020-05-18T21:28:53.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.609+0000 7f655a59c700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6540054120 0x7f65400565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.609+0000 7f655a59c700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6540054120 0x7f65400565e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f654c0016b0 tx=0x7f654c001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.609+0000 7f655a59c700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6540054120 0x7f65400565e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f654c0016b0 tx=0x7f654c001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.609+0000 7f655a59c700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6540054120 0x7f65400565e0 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7f654c0016b0 tx=0x7f654c001950).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:53.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.613+0000 7f655ad9d700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f655c0b4f60 0x7f655c12b810 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f654c001670 tx=0x7f6554007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.613+0000 7f65537fe700 1 -- 172.21.15.63:0/2481829406 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f655403e960 con 0x7f655c0b4f60 2020-05-18T21:28:53.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.733+0000 7f655b59e700 1 -- 172.21.15.63:0/2481829406 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f655c154780 con 0x7f655c0b4f60 2020-05-18T21:28:53.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.733+0000 7f655ad9d700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f655c0b4f60 0x7f655c12b810 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f654c001670 tx=0x7f6554007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.733+0000 7f65537fe700 1 -- 172.21.15.63:0/2481829406 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6554041f80 con 0x7f655c0b4f60 2020-05-18T21:28:53.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.733+0000 7f655b59e700 1 -- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6540054120 msgr2=0x7f65400565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.737+0000 7f655b59e700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6540054120 0x7f65400565e0 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7f654c0016b0 tx=0x7f654c001950).stop 2020-05-18T21:28:53.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.737+0000 7f655b59e700 1 -- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f655c0b4f60 msgr2=0x7f655c12b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.737+0000 7f655b59e700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f655c0b4f60 0x7f655c12b810 secure :-1 s=READY pgs=453 cs=0 l=1 rx=0x7f654c001670 tx=0x7f6554007e00).stop 2020-05-18T21:28:53.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.737+0000 7f655b59e700 1 -- 172.21.15.63:0/2481829406 shutdown_connections 2020-05-18T21:28:53.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.737+0000 7f655b59e700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6540054120 0x7f65400565e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:53.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.737+0000 7f655b59e700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f655c0b4f60 0x7f655c12b810 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:53.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.737+0000 7f655b59e700 1 --2- 172.21.15.63:0/2481829406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f655c0653f0 0x7f655c12c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:53.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.737+0000 7f655b59e700 1 -- 172.21.15.63:0/2481829406 >> 172.21.15.63:0/2481829406 conn(0x7f655c05fbd0 msgr2=0x7f655c0b5340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:53.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.737+0000 7f655b59e700 1 -- 172.21.15.63:0/2481829406 shutdown_connections 2020-05-18T21:28:53.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.737+0000 7f655b59e700 1 -- 172.21.15.63:0/2481829406 wait complete. 2020-05-18T21:28:53.748 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:28:53.759 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:28:53.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f5187fff700 1 Processor -- start 2020-05-18T21:28:53.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f5187fff700 1 -- start start 2020-05-18T21:28:53.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f5187fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f518806a420 0x7f518814ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:53.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f5187fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f518814db40 con 0x7f51880b9830 2020-05-18T21:28:53.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f5187fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f518814dde0 con 0x7f518814e7c0 2020-05-18T21:28:53.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f5187fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518814e080 con 0x7f518806a420 2020-05-18T21:28:53.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f5186ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f51880b9830 0x7f51881441f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57996/0 (socket says 172.21.15.63:57996) 2020-05-18T21:28:53.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f5186ffd700 1 -- 172.21.15.63:0/1663314840 learned_addr learned my addr 172.21.15.63:0/1663314840 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:53.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f51877fe700 1 --2- 172.21.15.63:0/1663314840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f518806a420 0x7f518814ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f5185ffb700 1 -- 172.21.15.63:0/1663314840 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945485589 0 0) 0x7f518814db40 con 0x7f51880b9830 2020-05-18T21:28:53.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f5185ffb700 1 -- 172.21.15.63:0/1663314840 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5168003270 con 0x7f51880b9830 2020-05-18T21:28:53.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f5185ffb700 1 -- 172.21.15.63:0/1663314840 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465083059 0 0) 0x7f518814dde0 con 0x7f518814e7c0 2020-05-18T21:28:53.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f5185ffb700 1 -- 172.21.15.63:0/1663314840 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f518814db40 con 0x7f518814e7c0 2020-05-18T21:28:53.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f51877fe700 1 -- 172.21.15.63:0/1663314840 >> v1:172.21.15.155:6789/0 conn(0x7f518814e7c0 legacy=0x7f518814a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f51877fe700 1 -- 172.21.15.63:0/1663314840 >> v1:172.21.15.63:6789/0 conn(0x7f51880b9830 legacy=0x7f51881441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f5185ffb700 1 -- 172.21.15.63:0/1663314840 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4221746066 0 0) 0x7f5168003270 con 0x7f51880b9830 2020-05-18T21:28:53.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f51877fe700 1 -- 172.21.15.63:0/1663314840 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518814e320 con 0x7f518806a420 2020-05-18T21:28:53.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f51877fe700 1 --2- 172.21.15.63:0/1663314840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f518806a420 0x7f518814ac80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5178001110 tx=0x7f5180008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f51877fe700 1 --2- 172.21.15.63:0/1663314840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f518806a420 0x7f518814ac80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5178001110 tx=0x7f5180008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f51877fe700 1 --2- 172.21.15.63:0/1663314840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f518806a420 0x7f518814ac80 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f5178001110 tx=0x7f5180008ca0).ready entity=mon.2 client_cookie=5e7f931e992acb7e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:53.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f51877fe700 1 --2- 172.21.15.63:0/1663314840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f518806a420 0x7f518814ac80 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f5178001110 tx=0x7f5180008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.865+0000 7f5185ffb700 1 -- 172.21.15.63:0/1663314840 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5178001710 con 0x7f518806a420 2020-05-18T21:28:53.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.869+0000 7f51877fe700 1 --2- 172.21.15.63:0/1663314840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f518806a420 0x7f518814ac80 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f5178001110 tx=0x7f5180008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.869+0000 7f5185ffb700 1 -- 172.21.15.63:0/1663314840 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5180011ac0 con 0x7f518806a420 2020-05-18T21:28:53.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.869+0000 7f51877fe700 1 --2- 172.21.15.63:0/1663314840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f518806a420 0x7f518814ac80 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f5178001110 tx=0x7f5180008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.869+0000 7f5185ffb700 1 -- 172.21.15.63:0/1663314840 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5180011e20 con 0x7f518806a420 2020-05-18T21:28:53.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.869+0000 7f5187fff700 1 -- 172.21.15.63:0/1663314840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f518806a420 msgr2=0x7f518814ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.869+0000 7f5187fff700 1 --2- 172.21.15.63:0/1663314840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f518806a420 0x7f518814ac80 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f5178001110 tx=0x7f5180008ca0).stop 2020-05-18T21:28:53.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.869+0000 7f5187fff700 1 -- 172.21.15.63:0/1663314840 shutdown_connections 2020-05-18T21:28:53.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.869+0000 7f5187fff700 1 --2- 172.21.15.63:0/1663314840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f518806a420 0x7f518814ac80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:53.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.869+0000 7f5187fff700 1 -- 172.21.15.63:0/1663314840 >> 172.21.15.63:0/1663314840 conn(0x7f518805a7c0 msgr2=0x7f518805aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:53.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.869+0000 7f5187fff700 1 -- 172.21.15.63:0/1663314840 shutdown_connections 2020-05-18T21:28:53.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.869+0000 7f5187fff700 1 -- 172.21.15.63:0/1663314840 wait complete. 2020-05-18T21:28:53.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.869+0000 7f5187fff700 1 Processor -- start 2020-05-18T21:28:53.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.869+0000 7f5187fff700 1 -- start start 2020-05-18T21:28:53.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5187fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f518806a420 0x7f5188145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:53.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5187fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f518814e7c0 0x7f518814c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:53.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5187fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5188145ea0 con 0x7f51880b9830 2020-05-18T21:28:53.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5187fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f518813a540 con 0x7f518806a420 2020-05-18T21:28:53.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5187fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5188063df0 con 0x7f518814e7c0 2020-05-18T21:28:53.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5186ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f518806a420 0x7f5188145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5186ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f518806a420 0x7f5188145a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55816/0 (socket says 172.21.15.63:55816) 2020-05-18T21:28:53.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f51877fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f518814e7c0 0x7f518814c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5186ffd700 1 -- 172.21.15.63:0/72857514 learned_addr learned my addr 172.21.15.63:0/72857514 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:53.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5186ffd700 1 -- 172.21.15.63:0/72857514 >> v2:172.21.15.155:3300/0 conn(0x7f518814e7c0 msgr2=0x7f518814c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5186ffd700 1 --2- 172.21.15.63:0/72857514 >> v2:172.21.15.155:3300/0 conn(0x7f518814e7c0 0x7f518814c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:53.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5186ffd700 1 -- 172.21.15.63:0/72857514 >> v1:172.21.15.155:6789/0 conn(0x7f51880b9830 legacy=0x7f5188063550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:53.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5186ffd700 1 -- 172.21.15.63:0/72857514 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5188064090 con 0x7f518806a420 2020-05-18T21:28:53.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5186ffd700 1 --2- 172.21.15.63:0/72857514 >> v2:172.21.15.63:3300/0 conn(0x7f518806a420 0x7f5188145a40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5178000fe0 tx=0x7f517800c540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5186ffd700 1 --2- 172.21.15.63:0/72857514 >> v2:172.21.15.63:3300/0 conn(0x7f518806a420 0x7f5188145a40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5178000fe0 tx=0x7f517800c540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5186ffd700 1 --2- 172.21.15.63:0/72857514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f518806a420 0x7f5188145a40 secure :-1 s=READY pgs=632 cs=0 l=1 rx=0x7f5178000fe0 tx=0x7f517800c540).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:53.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5186ffd700 1 --2- 172.21.15.63:0/72857514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f518806a420 0x7f5188145a40 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7f5178000fe0 tx=0x7f517800c540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f517ffff700 1 -- 172.21.15.63:0/72857514 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5178012a50 con 0x7f518806a420 2020-05-18T21:28:53.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5186ffd700 1 --2- 172.21.15.63:0/72857514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f518806a420 0x7f5188145a40 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7f5178000fe0 tx=0x7f517800c540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5186ffd700 1 --2- 172.21.15.63:0/72857514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f518806a420 0x7f5188145a40 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7f5178000fe0 tx=0x7f517800c540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f517ffff700 1 -- 172.21.15.63:0/72857514 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5178012bb0 con 0x7f518806a420 2020-05-18T21:28:53.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5187fff700 1 -- 172.21.15.63:0/72857514 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5188064330 con 0x7f518806a420 2020-05-18T21:28:53.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f517ffff700 1 -- 172.21.15.63:0/72857514 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f517800c5b0 con 0x7f518806a420 2020-05-18T21:28:53.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5187fff700 1 -- 172.21.15.63:0/72857514 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5188157ca0 con 0x7f518806a420 2020-05-18T21:28:53.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5186ffd700 1 --2- 172.21.15.63:0/72857514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f518806a420 0x7f5188145a40 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7f5178000fe0 tx=0x7f517800c540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.873+0000 7f5187fff700 1 -- 172.21.15.63:0/72857514 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51880569e0 con 0x7f518806a420 2020-05-18T21:28:53.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.877+0000 7f517ffff700 1 -- 172.21.15.63:0/72857514 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f517800c820 con 0x7f518806a420 2020-05-18T21:28:53.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.877+0000 7f5186ffd700 1 --2- 172.21.15.63:0/72857514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f518806a420 0x7f5188145a40 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7f5178000fe0 tx=0x7f517800c540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.877+0000 7f517ffff700 1 --2- 172.21.15.63:0/72857514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f516c04fa60 0x7f516c051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:53.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.877+0000 7f517ffff700 1 -- 172.21.15.63:0/72857514 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5178063cb0 con 0x7f518806a420 2020-05-18T21:28:53.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.877+0000 7f51867fc700 1 --2- 172.21.15.63:0/72857514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f516c04fa60 0x7f516c051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:53.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.877+0000 7f51867fc700 1 --2- 172.21.15.63:0/72857514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f516c04fa60 0x7f516c051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5188147d20 tx=0x7f51700026c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.877+0000 7f51867fc700 1 --2- 172.21.15.63:0/72857514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f516c04fa60 0x7f516c051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5188147d20 tx=0x7f51700026c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.877+0000 7f51867fc700 1 --2- 172.21.15.63:0/72857514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f516c04fa60 0x7f516c051f20 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7f5188147d20 tx=0x7f51700026c0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:53.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.881+0000 7f5186ffd700 1 --2- 172.21.15.63:0/72857514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f518806a420 0x7f5188145a40 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7f5178000fe0 tx=0x7f517800c540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:53.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.881+0000 7f517ffff700 1 -- 172.21.15.63:0/72857514 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f517803dfe0 con 0x7f518806a420 2020-05-18T21:28:54.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.997+0000 7f5187fff700 1 -- 172.21.15.63:0/72857514 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5188157ca0 con 0x7f518806a420 2020-05-18T21:28:54.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.997+0000 7f5186ffd700 1 --2- 172.21.15.63:0/72857514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f518806a420 0x7f5188145a40 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7f5178000fe0 tx=0x7f517800c540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:54.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:53.997+0000 7f517ffff700 1 -- 172.21.15.63:0/72857514 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5188157ca0 con 0x7f518806a420 2020-05-18T21:28:54.005 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:28:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.001+0000 7f5187fff700 1 -- 172.21.15.63:0/72857514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f516c04fa60 msgr2=0x7f516c051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.001+0000 7f5187fff700 1 --2- 172.21.15.63:0/72857514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f516c04fa60 0x7f516c051f20 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7f5188147d20 tx=0x7f51700026c0).stop 2020-05-18T21:28:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.001+0000 7f5187fff700 1 -- 172.21.15.63:0/72857514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f518806a420 msgr2=0x7f5188145a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.001+0000 7f5187fff700 1 --2- 172.21.15.63:0/72857514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f518806a420 0x7f5188145a40 secure :-1 s=READY pgs=632 cs=0 l=1 rx=0x7f5178000fe0 tx=0x7f517800c540).stop 2020-05-18T21:28:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.001+0000 7f5187fff700 1 -- 172.21.15.63:0/72857514 shutdown_connections 2020-05-18T21:28:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.001+0000 7f5187fff700 1 --2- 172.21.15.63:0/72857514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f516c04fa60 0x7f516c051f20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.001+0000 7f5187fff700 1 --2- 172.21.15.63:0/72857514 >> v2:172.21.15.155:3300/0 conn(0x7f518814e7c0 0x7f518814c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.001+0000 7f5187fff700 1 --2- 172.21.15.63:0/72857514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f518806a420 0x7f5188145a40 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.001+0000 7f5187fff700 1 -- 172.21.15.63:0/72857514 >> 172.21.15.63:0/72857514 conn(0x7f518805a7c0 msgr2=0x7f51880b5320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.001+0000 7f5187fff700 1 -- 172.21.15.63:0/72857514 shutdown_connections 2020-05-18T21:28:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.001+0000 7f5187fff700 1 -- 172.21.15.63:0/72857514 wait complete. 2020-05-18T21:28:54.017 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:28:54.018 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:28:54.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.113+0000 7fc9b2e67700 1 Processor -- start 2020-05-18T21:28:54.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.113+0000 7fc9b2e67700 1 -- start start 2020-05-18T21:28:54.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.113+0000 7fc9b2e67700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9ac0632f0 0x7fc9ac142190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:54.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.113+0000 7fc9b2e67700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ac145790 con 0x7fc9ac0b45f0 2020-05-18T21:28:54.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.113+0000 7fc9b2e67700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ac145a30 con 0x7fc9ac0658a0 2020-05-18T21:28:54.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.113+0000 7fc9b2e67700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac065c80 con 0x7fc9ac0632f0 2020-05-18T21:28:54.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.113+0000 7fc9b1664700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc9ac0b45f0 0x7fc9ac145ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58010/0 (socket says 172.21.15.63:58010) 2020-05-18T21:28:54.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.113+0000 7fc9b1664700 1 -- 172.21.15.63:0/2184004200 learned_addr learned my addr 172.21.15.63:0/2184004200 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:54.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.113+0000 7fc9b2666700 1 --2- 172.21.15.63:0/2184004200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9ac0632f0 0x7fc9ac142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:54.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b0e63700 1 -- 172.21.15.63:0/2184004200 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349168887 0 0) 0x7fc9ac145790 con 0x7fc9ac0b45f0 2020-05-18T21:28:54.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b0e63700 1 -- 172.21.15.63:0/2184004200 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc994003270 con 0x7fc9ac0b45f0 2020-05-18T21:28:54.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b2666700 1 -- 172.21.15.63:0/2184004200 >> v1:172.21.15.155:6789/0 conn(0x7fc9ac0658a0 legacy=0x7fc9ac0b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:54.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b2666700 1 -- 172.21.15.63:0/2184004200 >> v1:172.21.15.63:6789/0 conn(0x7fc9ac0b45f0 legacy=0x7fc9ac145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:54.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b2666700 1 -- 172.21.15.63:0/2184004200 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac0b8910 con 0x7fc9ac0632f0 2020-05-18T21:28:54.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b2666700 1 --2- 172.21.15.63:0/2184004200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9ac0632f0 0x7fc9ac142190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc9a40032f0 tx=0x7fc9a4009010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:54.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b2666700 1 --2- 172.21.15.63:0/2184004200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9ac0632f0 0x7fc9ac142190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc9a40032f0 tx=0x7fc9a4009010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:54.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b2666700 1 --2- 172.21.15.63:0/2184004200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9ac0632f0 0x7fc9ac142190 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7fc9a40032f0 tx=0x7fc9a4009010).ready entity=mon.2 client_cookie=c5a8e44e8fa9856e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:54.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b2666700 1 --2- 172.21.15.63:0/2184004200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9ac0632f0 0x7fc9ac142190 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fc9a40032f0 tx=0x7fc9a4009010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:54.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b0e63700 1 -- 172.21.15.63:0/2184004200 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9a4009830 con 0x7fc9ac0632f0 2020-05-18T21:28:54.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b2666700 1 --2- 172.21.15.63:0/2184004200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9ac0632f0 0x7fc9ac142190 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fc9a40032f0 tx=0x7fc9a4009010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:54.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b2666700 1 --2- 172.21.15.63:0/2184004200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9ac0632f0 0x7fc9ac142190 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fc9a40032f0 tx=0x7fc9a4009010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:54.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b0e63700 1 -- 172.21.15.63:0/2184004200 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a4009990 con 0x7fc9ac0632f0 2020-05-18T21:28:54.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b0e63700 1 -- 172.21.15.63:0/2184004200 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9a4009d70 con 0x7fc9ac0632f0 2020-05-18T21:28:54.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b2e67700 1 -- 172.21.15.63:0/2184004200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9ac0632f0 msgr2=0x7fc9ac142190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:54.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b2e67700 1 --2- 172.21.15.63:0/2184004200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9ac0632f0 0x7fc9ac142190 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7fc9a40032f0 tx=0x7fc9a4009010).stop 2020-05-18T21:28:54.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b2e67700 1 -- 172.21.15.63:0/2184004200 shutdown_connections 2020-05-18T21:28:54.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b2e67700 1 --2- 172.21.15.63:0/2184004200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9ac0632f0 0x7fc9ac142190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:54.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b2e67700 1 -- 172.21.15.63:0/2184004200 >> 172.21.15.63:0/2184004200 conn(0x7fc9ac069fc0 msgr2=0x7fc9ac06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:54.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b2e67700 1 -- 172.21.15.63:0/2184004200 shutdown_connections 2020-05-18T21:28:54.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b2e67700 1 -- 172.21.15.63:0/2184004200 wait complete. 2020-05-18T21:28:54.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b2e67700 1 Processor -- start 2020-05-18T21:28:54.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.117+0000 7fc9b2e67700 1 -- start start 2020-05-18T21:28:54.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b2e67700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc9ac0b45f0 0x7fc9ac1444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:54.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b2e67700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ac152ab0 con 0x7fc9ac0658a0 2020-05-18T21:28:54.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b2e67700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ac152d50 con 0x7fc9ac0632f0 2020-05-18T21:28:54.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b2e67700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ac1531f0 con 0x7fc9ac0b45f0 2020-05-18T21:28:54.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b1664700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc9ac0658a0 0x7fc9ac13cfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58018/0 (socket says 172.21.15.63:58018) 2020-05-18T21:28:54.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b2666700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc9ac0b45f0 0x7fc9ac1444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:54.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b1664700 1 -- 172.21.15.63:0/3009062787 learned_addr learned my addr 172.21.15.63:0/3009062787 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:54.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc99affd700 1 -- 172.21.15.63:0/3009062787 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847771080 0 0) 0x7fc9ac152ab0 con 0x7fc9ac0658a0 2020-05-18T21:28:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc99affd700 1 -- 172.21.15.63:0/3009062787 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc98c002fe0 con 0x7fc9ac0658a0 2020-05-18T21:28:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc99affd700 1 -- 172.21.15.63:0/3009062787 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43403736 0 0) 0x7fc9ac152d50 con 0x7fc9ac0632f0 2020-05-18T21:28:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc99affd700 1 -- 172.21.15.63:0/3009062787 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9ac152ab0 con 0x7fc9ac0632f0 2020-05-18T21:28:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b2666700 1 -- 172.21.15.63:0/3009062787 >> v1:172.21.15.155:6789/0 conn(0x7fc9ac0632f0 legacy=0x7fc9ac12ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b2666700 1 -- 172.21.15.63:0/3009062787 >> v1:172.21.15.63:6789/0 conn(0x7fc9ac0658a0 legacy=0x7fc9ac13cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:54.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b2666700 1 -- 172.21.15.63:0/3009062787 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac144b90 con 0x7fc9ac0b45f0 2020-05-18T21:28:54.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b2666700 1 --2- 172.21.15.63:0/3009062787 >> v2:172.21.15.63:3300/0 conn(0x7fc9ac0b45f0 0x7fc9ac1444f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9a40032f0 tx=0x7fc9a4009010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:54.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b2666700 1 --2- 172.21.15.63:0/3009062787 >> v2:172.21.15.63:3300/0 conn(0x7fc9ac0b45f0 0x7fc9ac1444f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9a40032f0 tx=0x7fc9a4009010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:54.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b2666700 1 --2- 172.21.15.63:0/3009062787 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9ac0b45f0 0x7fc9ac1444f0 secure :-1 s=READY pgs=635 cs=0 l=1 rx=0x7fc9a40032f0 tx=0x7fc9a4009010).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:54.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b2666700 1 --2- 172.21.15.63:0/3009062787 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9ac0b45f0 0x7fc9ac1444f0 secure :-1 s=THROTTLE_DONE pgs=635 cs=0 l=1 rx=0x7fc9a40032f0 tx=0x7fc9a4009010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:54.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc99affd700 1 -- 172.21.15.63:0/3009062787 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9a4005a80 con 0x7fc9ac0b45f0 2020-05-18T21:28:54.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b2666700 1 --2- 172.21.15.63:0/3009062787 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9ac0b45f0 0x7fc9ac1444f0 secure :-1 s=THROTTLE_DONE pgs=635 cs=0 l=1 rx=0x7fc9a40032f0 tx=0x7fc9a4009010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:54.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b2666700 1 --2- 172.21.15.63:0/3009062787 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9ac0b45f0 0x7fc9ac1444f0 secure :-1 s=THROTTLE_DONE pgs=635 cs=0 l=1 rx=0x7fc9a40032f0 tx=0x7fc9a4009010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:54.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc99affd700 1 -- 172.21.15.63:0/3009062787 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a4005be0 con 0x7fc9ac0b45f0 2020-05-18T21:28:54.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc99affd700 1 -- 172.21.15.63:0/3009062787 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9a400a0d0 con 0x7fc9ac0b45f0 2020-05-18T21:28:54.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b2e67700 1 -- 172.21.15.63:0/3009062787 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ac1523e0 con 0x7fc9ac0b45f0 2020-05-18T21:28:54.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b2e67700 1 -- 172.21.15.63:0/3009062787 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ac12b630 con 0x7fc9ac0b45f0 2020-05-18T21:28:54.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b2666700 1 --2- 172.21.15.63:0/3009062787 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9ac0b45f0 0x7fc9ac1444f0 secure :-1 s=THROTTLE_DONE pgs=635 cs=0 l=1 rx=0x7fc9a40032f0 tx=0x7fc9a4009010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:54.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.121+0000 7fc9b2e67700 1 -- 172.21.15.63:0/3009062787 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ac152900 con 0x7fc9ac0b45f0 2020-05-18T21:28:54.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.125+0000 7fc99affd700 1 -- 172.21.15.63:0/3009062787 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc9a400a230 con 0x7fc9ac0b45f0 2020-05-18T21:28:54.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.125+0000 7fc9b2666700 1 --2- 172.21.15.63:0/3009062787 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9ac0b45f0 0x7fc9ac1444f0 secure :-1 s=THROTTLE_DONE pgs=635 cs=0 l=1 rx=0x7fc9a40032f0 tx=0x7fc9a4009010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:54.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.125+0000 7fc99affd700 1 --2- 172.21.15.63:0/3009062787 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc98c04fed0 0x7fc98c052390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:54.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.125+0000 7fc99affd700 1 -- 172.21.15.63:0/3009062787 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc9a4066770 con 0x7fc9ac0b45f0 2020-05-18T21:28:54.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.125+0000 7fc9b1e65700 1 --2- 172.21.15.63:0/3009062787 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc98c04fed0 0x7fc98c052390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:54.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.125+0000 7fc9b1e65700 1 --2- 172.21.15.63:0/3009062787 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc98c04fed0 0x7fc98c052390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9a8001020 tx=0x7fc9a8002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:54.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.125+0000 7fc9b1e65700 1 --2- 172.21.15.63:0/3009062787 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc98c04fed0 0x7fc98c052390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9a8001020 tx=0x7fc9a8002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:54.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.125+0000 7fc9b1e65700 1 --2- 172.21.15.63:0/3009062787 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc98c04fed0 0x7fc98c052390 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7fc9a8001020 tx=0x7fc9a8002740).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:54.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.133+0000 7fc9b2666700 1 --2- 172.21.15.63:0/3009062787 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9ac0b45f0 0x7fc9ac1444f0 secure :-1 s=THROTTLE_DONE pgs=635 cs=0 l=1 rx=0x7fc9a40032f0 tx=0x7fc9a4009010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:54.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.133+0000 7fc99affd700 1 -- 172.21.15.63:0/3009062787 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc9a4040bc0 con 0x7fc9ac0b45f0 2020-05-18T21:28:54.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.281+0000 7fc9b2e67700 1 -- 172.21.15.63:0/3009062787 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9ac0569e0 con 0x7fc9ac0b45f0 2020-05-18T21:28:54.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.281+0000 7fc9b2666700 1 --2- 172.21.15.63:0/3009062787 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9ac0b45f0 0x7fc9ac1444f0 secure :-1 s=THROTTLE_DONE pgs=635 cs=0 l=1 rx=0x7fc9a40032f0 tx=0x7fc9a4009010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:54.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.281+0000 7fc99affd700 1 -- 172.21.15.63:0/3009062787 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+2142 (secure 0 0 0) 0x7fc9a40441e0 con 0x7fc9ac0b45f0 2020-05-18T21:28:54.287 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:54.287 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":22,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/2663525728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2663525728},{"type":"v1","addr":"172.21.15.63:6833","nonce":2663525728}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:28:48.505607+0000","modified":"2020-05-18T21:28:50.219314+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5850},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5850":{"gid":5850,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1866128236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1866128236},{"type":"v1","addr":"172.21.15.155:6835","nonce":1866128236}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-05-18T21:28:54.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.281+0000 7fc9b2e67700 1 -- 172.21.15.63:0/3009062787 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc98c04fed0 msgr2=0x7fc98c052390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:54.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.281+0000 7fc9b2e67700 1 --2- 172.21.15.63:0/3009062787 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc98c04fed0 0x7fc98c052390 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7fc9a8001020 tx=0x7fc9a8002740).stop 2020-05-18T21:28:54.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.281+0000 7fc9b2e67700 1 -- 172.21.15.63:0/3009062787 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9ac0b45f0 msgr2=0x7fc9ac1444f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:54.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.281+0000 7fc9b2e67700 1 --2- 172.21.15.63:0/3009062787 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9ac0b45f0 0x7fc9ac1444f0 secure :-1 s=READY pgs=635 cs=0 l=1 rx=0x7fc9a40032f0 tx=0x7fc9a4009010).stop 2020-05-18T21:28:54.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.281+0000 7fc9b2e67700 1 -- 172.21.15.63:0/3009062787 shutdown_connections 2020-05-18T21:28:54.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.281+0000 7fc9b2e67700 1 --2- 172.21.15.63:0/3009062787 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc98c04fed0 0x7fc98c052390 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:54.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.281+0000 7fc9b2e67700 1 --2- 172.21.15.63:0/3009062787 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9ac0b45f0 0x7fc9ac1444f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:54.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.281+0000 7fc9b2e67700 1 -- 172.21.15.63:0/3009062787 >> 172.21.15.63:0/3009062787 conn(0x7fc9ac069fc0 msgr2=0x7fc9ac06a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:54.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.281+0000 7fc9b2e67700 1 -- 172.21.15.63:0/3009062787 shutdown_connections 2020-05-18T21:28:54.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:54.281+0000 7fc9b2e67700 1 -- 172.21.15.63:0/3009062787 wait complete. 2020-05-18T21:28:54.292 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 22 2020-05-18T21:28:54.502 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:28:48.505607+0000', 'modified': '2020-05-18T21:28:50.219314+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5850}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5850': {'gid': 5850, 'name': 'b', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6835/1866128236', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 1866128236}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 1866128236}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:28:54.503 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:28:54.503 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:28:54.610 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:28:54.610 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:28:54.611 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2020-05-18T21:28:54.611 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 5850, 2020-05-18T21:28:54.611 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:28:54.611 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:28:54.611 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 6.0994331800000001, 2020-05-18T21:28:54.612 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 22, 2020-05-18T21:28:54.612 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 51, 2020-05-18T21:28:54.612 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 51, 2020-05-18T21:28:54.612 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 10.318227887000001 2020-05-18T21:28:54.612 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:28:54.619 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 5850, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.0994331800000001, "mdsmap_epoch": 22, "osdmap_epoch": 51, "osdmap_epoch_barrier": 51, "uptime": 10.318227887000001 } 2020-05-18T21:28:54.619 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:28:54.620 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:28:54.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:54.621 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:28:54.630 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:28:54.630 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:28:54.631 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:28:54.631 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:54.631 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:28:54.631 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:54.632 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:54.632 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:54.632 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:54.632 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:54.633 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:54.633 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:54.634 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:28:54.634 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:54.634 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:28:54.634 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42708sec preferred_lft 42708sec 2020-05-18T21:28:54.635 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:28:54.635 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:54.635 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:28:54.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:54.636 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:28:54.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:54.694 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:28:54.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:54.708 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:28:54.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:54.785 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:28:54.808 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:28:54.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:54.811 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:28:54.862 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:28:54.868 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:28:54.868 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:28:54.869 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:28:54.869 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:28:54.869 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:28:54.870 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:28:54.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:54.871 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:28:54.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:54.892 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:28:54.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:54.908 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:28:54.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:54.966 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:28:54.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:54.975 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:28:54.993 INFO:teuthology.orchestra.run.smithi063.stdout:nsid 0 2020-05-18T21:28:54.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:54.994 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:28:55.043 INFO:teuthology.orchestra.run.smithi063.stdout:nsid 0 2020-05-18T21:28:55.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:55.044 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:28:55.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:55.064 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 1' 2020-05-18T21:28:55.080 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-05-18T21:28:55.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:55.081 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.1' 2020-05-18T21:28:55.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:55.141 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:28:55.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:55.157 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-05-18T21:28:55.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:55.171 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-05-18T21:28:55.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:55.232 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-05-18T21:28:55.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:55.248 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.1 up' 2020-05-18T21:28:55.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:55.263 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.1 master ceph-brx' 2020-05-18T21:28:55.324 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-05-18T21:28:55.324 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-05-18T21:28:55.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:55.325 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:55.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:55.331 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:28:55.344 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:28:55.345 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:28:55.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:55.346 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:28:55.395 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:28:55.396 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:55.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:55.399 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:28:55.420 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:28:55.420 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:28:55.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:55.421 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:28:55.481 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2020-05-18T21:28:55.477+0000 7f509e857080 -1 init, newargv = 0x56169ff2d530 newargc=9ceph-fuse[ 2020-05-18T21:28:55.482 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:20904]: starting ceph client 2020-05-18T21:28:55.492 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[20904]: starting fuse 2020-05-18T21:28:56.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:56.572 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:28:56.590 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:28:56.592 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:28:56.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:56.593 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:28:56.598 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:28:56.598 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:28:56.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:56.599 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:28:56.600 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:28:56.600 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:28:56.600 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:28:56.601 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:28:56.601 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:28:56.602 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:28:56.602 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:28:56.602 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:28:56.603 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:28:56.603 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:28:56.604 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:28:56.604 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:28:56.604 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:28:56.605 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:28:56.605 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:28:56.606 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:28:56.606 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:28:56.607 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:28:56.607 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:28:56.607 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:28:56.608 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:28:56.608 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:28:56.687 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.20904.asok 2020-05-18T21:28:56.692 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.20904.asok 2020-05-18T21:28:56.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:56.693 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.20904.asok status 2020-05-18T21:28:56.787 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:28:56.787 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:28:56.787 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:28:56.788 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:28:56.788 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:28:56.788 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:28:56.788 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:28:56.788 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "20904", 2020-05-18T21:28:56.789 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:28:56.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:56.789 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:28:56.789 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:28:56.789 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 6045, 2020-05-18T21:28:56.790 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:28:56.790 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:28:56.790 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:28:56.790 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 6045 2020-05-18T21:28:56.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:56.791 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:28:56.791 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:56.791 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:28:56.791 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 698969885 2020-05-18T21:28:56.791 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:56.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:56.792 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:28:56.792 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:28:56.792 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:28:56.792 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 698969885 2020-05-18T21:28:56.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:56.793 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.6045 192.168.0.1:0/698969885", 2020-05-18T21:28:56.793 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/698969885", 2020-05-18T21:28:56.793 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:28:56.793 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 22, 2020-05-18T21:28:56.793 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 51, 2020-05-18T21:28:56.793 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:28:56.794 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:28:56.794 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:28:56.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:56.796 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:28:56.796 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:56.803 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:28:56.804 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-05-18T21:28:56.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:28:56.805 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:56.868 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo touch fancy_layout_file) 2020-05-18T21:28:56.898 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.file.layout -v 'stripe_unit=1048576 stripe_count=4 object_size=8388608' fancy_layout_file) 2020-05-18T21:28:56.935 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo dd if=/dev/urandom of=fancy_layout_file bs=1M conv=fdatasync count=35 seek=0) 2020-05-18T21:28:57.310 INFO:teuthology.orchestra.run.smithi063.stderr:35+0 records in 2020-05-18T21:28:57.310 INFO:teuthology.orchestra.run.smithi063.stderr:35+0 records out 2020-05-18T21:28:57.310 INFO:teuthology.orchestra.run.smithi063.stderr:36700160 bytes (37 MB, 35 MiB) copied, 0.353641 s, 104 MB/s 2020-05-18T21:28:57.311 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rm -f fancy_layout_file) 2020-05-18T21:28:57.331 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:28:57.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.433+0000 7fee39cbc700 1 Processor -- start 2020-05-18T21:28:57.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.433+0000 7fee39cbc700 1 -- start start 2020-05-18T21:28:57.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee39cbc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee3409e4b0 0x7fee34069fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:57.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee39cbc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fee3413d720 0x7fee3413dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:57.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee39cbc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3413e010 con 0x7fee3409e0d0 2020-05-18T21:28:57.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee39cbc700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3406a5e0 con 0x7fee3413d720 2020-05-18T21:28:57.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee39cbc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3406a880 con 0x7fee3409e4b0 2020-05-18T21:28:57.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee394bb700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fee3413d720 0x7fee3413dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:57.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee394bb700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fee3413d720 0x7fee3413dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55866/0 (socket says 172.21.15.63:55866) 2020-05-18T21:28:57.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee394bb700 1 -- 172.21.15.63:0/3177109909 learned_addr learned my addr 172.21.15.63:0/3177109909 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:57.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee33fff700 1 --2- 172.21.15.63:0/3177109909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee3409e4b0 0x7fee34069fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:57.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee394bb700 1 -- 172.21.15.63:0/3177109909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee3409e4b0 msgr2=0x7fee34069fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:57.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee394bb700 1 --2- 172.21.15.63:0/3177109909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee3409e4b0 0x7fee34069fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:57.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee337fe700 1 -- 172.21.15.63:0/3177109909 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445997083 0 0) 0x7fee3413e010 con 0x7fee3409e0d0 2020-05-18T21:28:57.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee394bb700 1 -- 172.21.15.63:0/3177109909 >> v1:172.21.15.155:6789/0 conn(0x7fee3409e0d0 legacy=0x7fee34147a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:57.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee394bb700 1 -- 172.21.15.63:0/3177109909 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee34064a90 con 0x7fee3413d720 2020-05-18T21:28:57.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee394bb700 1 --2- 172.21.15.63:0/3177109909 >> v2:172.21.15.63:3300/0 conn(0x7fee3413d720 0x7fee3413dbb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fee2c0032f0 tx=0x7fee2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee394bb700 1 --2- 172.21.15.63:0/3177109909 >> v2:172.21.15.63:3300/0 conn(0x7fee3413d720 0x7fee3413dbb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fee2c0032f0 tx=0x7fee2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee394bb700 1 --2- 172.21.15.63:0/3177109909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee3413d720 0x7fee3413dbb0 secure :-1 s=READY pgs=640 cs=0 l=1 rx=0x7fee2c0032f0 tx=0x7fee2c007e00).ready entity=mon.0 client_cookie=6ac332e03f770a81 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:57.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee394bb700 1 --2- 172.21.15.63:0/3177109909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee3413d720 0x7fee3413dbb0 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7fee2c0032f0 tx=0x7fee2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee337fe700 1 -- 172.21.15.63:0/3177109909 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee2c011d10 con 0x7fee3413d720 2020-05-18T21:28:57.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee394bb700 1 --2- 172.21.15.63:0/3177109909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee3413d720 0x7fee3413dbb0 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7fee2c0032f0 tx=0x7fee2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee337fe700 1 -- 172.21.15.63:0/3177109909 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2c011e70 con 0x7fee3413d720 2020-05-18T21:28:57.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee394bb700 1 --2- 172.21.15.63:0/3177109909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee3413d720 0x7fee3413dbb0 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7fee2c0032f0 tx=0x7fee2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.437+0000 7fee337fe700 1 -- 172.21.15.63:0/3177109909 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee2c00a370 con 0x7fee3413d720 2020-05-18T21:28:57.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.441+0000 7fee39cbc700 1 -- 172.21.15.63:0/3177109909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee3413d720 msgr2=0x7fee3413dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:57.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.441+0000 7fee39cbc700 1 --2- 172.21.15.63:0/3177109909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee3413d720 0x7fee3413dbb0 secure :-1 s=READY pgs=640 cs=0 l=1 rx=0x7fee2c0032f0 tx=0x7fee2c007e00).stop 2020-05-18T21:28:57.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.441+0000 7fee39cbc700 1 -- 172.21.15.63:0/3177109909 shutdown_connections 2020-05-18T21:28:57.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.441+0000 7fee39cbc700 1 --2- 172.21.15.63:0/3177109909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee3413d720 0x7fee3413dbb0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.441+0000 7fee39cbc700 1 --2- 172.21.15.63:0/3177109909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee3409e4b0 0x7fee34069fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.441+0000 7fee39cbc700 1 -- 172.21.15.63:0/3177109909 >> 172.21.15.63:0/3177109909 conn(0x7fee3405a7c0 msgr2=0x7fee3405aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.441+0000 7fee39cbc700 1 -- 172.21.15.63:0/3177109909 shutdown_connections 2020-05-18T21:28:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.441+0000 7fee39cbc700 1 -- 172.21.15.63:0/3177109909 wait complete. 2020-05-18T21:28:57.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.441+0000 7fee39cbc700 1 Processor -- start 2020-05-18T21:28:57.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.441+0000 7fee39cbc700 1 -- start start 2020-05-18T21:28:57.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee39cbc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee3409e0d0 0x7fee3413c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:57.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee39cbc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fee3413d720 0x7fee341508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:57.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee39cbc700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3413a8b0 con 0x7fee3409e4b0 2020-05-18T21:28:57.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee39cbc700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3413ab50 con 0x7fee3413d720 2020-05-18T21:28:57.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee39cbc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3413adf0 con 0x7fee3409e0d0 2020-05-18T21:28:57.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee33fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fee3409e4b0 0x7fee34144d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58058/0 (socket says 172.21.15.63:58058) 2020-05-18T21:28:57.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee33fff700 1 -- 172.21.15.63:0/1992364584 learned_addr learned my addr 172.21.15.63:0/1992364584 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:57.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee394bb700 1 --2- 172.21.15.63:0/1992364584 >> v2:172.21.15.63:3300/0 conn(0x7fee3413d720 0x7fee341508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:57.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee38cba700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee3409e0d0 0x7fee3413c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:57.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee31ffb700 1 -- 172.21.15.63:0/1992364584 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985870498 0 0) 0x7fee3413a8b0 con 0x7fee3409e4b0 2020-05-18T21:28:57.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee31ffb700 1 -- 172.21.15.63:0/1992364584 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee14002fe0 con 0x7fee3409e4b0 2020-05-18T21:28:57.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee394bb700 1 -- 172.21.15.63:0/1992364584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee3409e0d0 msgr2=0x7fee3413c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:57.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee394bb700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee3409e0d0 0x7fee3413c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:57.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee394bb700 1 -- 172.21.15.63:0/1992364584 >> v1:172.21.15.63:6789/0 conn(0x7fee3409e4b0 legacy=0x7fee34144d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:57.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee31ffb700 1 -- 172.21.15.63:0/1992364584 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2460383363 0 0) 0x7fee14002fe0 con 0x7fee3409e4b0 2020-05-18T21:28:57.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee394bb700 1 -- 172.21.15.63:0/1992364584 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee34145440 con 0x7fee3413d720 2020-05-18T21:28:57.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee38cba700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee3409e0d0 0x7fee3413c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:57.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee394bb700 1 --2- 172.21.15.63:0/1992364584 >> v2:172.21.15.63:3300/0 conn(0x7fee3413d720 0x7fee341508a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee28001670 tx=0x7fee2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee394bb700 1 --2- 172.21.15.63:0/1992364584 >> v2:172.21.15.63:3300/0 conn(0x7fee3413d720 0x7fee341508a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee28001670 tx=0x7fee2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee394bb700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee3413d720 0x7fee341508a0 secure :-1 s=READY pgs=642 cs=0 l=1 rx=0x7fee28001670 tx=0x7fee2c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:57.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee394bb700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee3413d720 0x7fee341508a0 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7fee28001670 tx=0x7fee2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee31ffb700 1 -- 172.21.15.63:0/1992364584 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee280014d0 con 0x7fee3413d720 2020-05-18T21:28:57.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee394bb700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee3413d720 0x7fee341508a0 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7fee28001670 tx=0x7fee2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee394bb700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee3413d720 0x7fee341508a0 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7fee28001670 tx=0x7fee2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee31ffb700 1 -- 172.21.15.63:0/1992364584 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2c008aa0 con 0x7fee3413d720 2020-05-18T21:28:57.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee39cbc700 1 -- 172.21.15.63:0/1992364584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee341517b0 con 0x7fee3413d720 2020-05-18T21:28:57.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee31ffb700 1 -- 172.21.15.63:0/1992364584 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee2c005c70 con 0x7fee3413d720 2020-05-18T21:28:57.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee39cbc700 1 -- 172.21.15.63:0/1992364584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee3413b290 con 0x7fee3413d720 2020-05-18T21:28:57.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.445+0000 7fee394bb700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee3413d720 0x7fee341508a0 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7fee28001670 tx=0x7fee2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.449+0000 7fee39cbc700 1 -- 172.21.15.63:0/1992364584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee340569e0 con 0x7fee3413d720 2020-05-18T21:28:57.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.449+0000 7fee31ffb700 1 -- 172.21.15.63:0/1992364584 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fee2c007170 con 0x7fee3413d720 2020-05-18T21:28:57.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.449+0000 7fee394bb700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee3413d720 0x7fee341508a0 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7fee28001670 tx=0x7fee2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.449+0000 7fee31ffb700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee1404fcd0 0x7fee14052190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:57.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.449+0000 7fee31ffb700 1 -- 172.21.15.63:0/1992364584 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fee2c0643b0 con 0x7fee3413d720 2020-05-18T21:28:57.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.449+0000 7fee38cba700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee1404fcd0 0x7fee14052190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:57.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.449+0000 7fee38cba700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee1404fcd0 0x7fee14052190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee24000ed0 tx=0x7fee240013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.449+0000 7fee38cba700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee1404fcd0 0x7fee14052190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee24000ed0 tx=0x7fee240013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.449+0000 7fee38cba700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee1404fcd0 0x7fee14052190 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fee24000ed0 tx=0x7fee240013e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:57.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.453+0000 7fee394bb700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee3413d720 0x7fee341508a0 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7fee28001670 tx=0x7fee2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.453+0000 7fee31ffb700 1 -- 172.21.15.63:0/1992364584 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fee2c03e860 con 0x7fee3413d720 2020-05-18T21:28:57.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.605+0000 7fee39cbc700 1 -- 172.21.15.63:0/1992364584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee3413af60 con 0x7fee3413d720 2020-05-18T21:28:57.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.605+0000 7fee394bb700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee3413d720 0x7fee341508a0 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7fee28001670 tx=0x7fee2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.605+0000 7fee31ffb700 1 -- 172.21.15.63:0/1992364584 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+2142 (secure 0 0 0) 0x7fee2c041e80 con 0x7fee3413d720 2020-05-18T21:28:57.611 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:57.612 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":22,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/2663525728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2663525728},{"type":"v1","addr":"172.21.15.63:6833","nonce":2663525728}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:28:48.505607+0000","modified":"2020-05-18T21:28:50.219314+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5850},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5850":{"gid":5850,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1866128236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1866128236},{"type":"v1","addr":"172.21.15.155:6835","nonce":1866128236}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-05-18T21:28:57.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.605+0000 7fee39cbc700 1 -- 172.21.15.63:0/1992364584 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee1404fcd0 msgr2=0x7fee14052190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:57.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.605+0000 7fee39cbc700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee1404fcd0 0x7fee14052190 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fee24000ed0 tx=0x7fee240013e0).stop 2020-05-18T21:28:57.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.605+0000 7fee39cbc700 1 -- 172.21.15.63:0/1992364584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee3413d720 msgr2=0x7fee341508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.605+0000 7fee39cbc700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee3413d720 0x7fee341508a0 secure :-1 s=READY pgs=642 cs=0 l=1 rx=0x7fee28001670 tx=0x7fee2c007e00).stop 2020-05-18T21:28:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.605+0000 7fee39cbc700 1 -- 172.21.15.63:0/1992364584 shutdown_connections 2020-05-18T21:28:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.605+0000 7fee39cbc700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee1404fcd0 0x7fee14052190 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.605+0000 7fee39cbc700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee3413d720 0x7fee341508a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.605+0000 7fee39cbc700 1 --2- 172.21.15.63:0/1992364584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee3409e0d0 0x7fee3413c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.605+0000 7fee39cbc700 1 -- 172.21.15.63:0/1992364584 >> 172.21.15.63:0/1992364584 conn(0x7fee3405a7c0 msgr2=0x7fee3413ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.609+0000 7fee39cbc700 1 -- 172.21.15.63:0/1992364584 shutdown_connections 2020-05-18T21:28:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.609+0000 7fee39cbc700 1 -- 172.21.15.63:0/1992364584 wait complete. 2020-05-18T21:28:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 22 2020-05-18T21:28:57.624 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok flush journal 2020-05-18T21:28:57.748 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:28:57.749 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "", 2020-05-18T21:28:57.749 INFO:teuthology.orchestra.run.smithi155.stdout: "return_code": 0 2020-05-18T21:28:57.749 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:28:57.759 INFO:tasks.cephfs.filesystem:_json_asok output: { "message": "", "return_code": 0 } 2020-05-18T21:28:57.759 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early df --format=json-pretty 2020-05-18T21:28:57.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.857+0000 7f3b14b72700 1 Processor -- start 2020-05-18T21:28:57.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.857+0000 7f3b14b72700 1 -- start start 2020-05-18T21:28:57.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.857+0000 7f3b14b72700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b10146be0 0x7f3b1006a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:57.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.857+0000 7f3b14b72700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3b100b7cc0 0x7f3b10145e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:57.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.857+0000 7f3b14b72700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b100b5630 0x7f3b100b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:57.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.857+0000 7f3b14b72700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b100b8160 con 0x7f3b10146be0 2020-05-18T21:28:57.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.857+0000 7f3b14b72700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b10061c00 con 0x7f3b100b7cc0 2020-05-18T21:28:57.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.857+0000 7f3b14b72700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b10061ea0 con 0x7f3b100b5630 2020-05-18T21:28:57.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b0e59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b10146be0 0x7f3b1006a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:57.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b07fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3b100b7cc0 0x7f3b10145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:57.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b0ed9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b100b5630 0x7f3b100b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:57.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b0e59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b10146be0 0x7f3b1006a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55878/0 (socket says 172.21.15.63:55878) 2020-05-18T21:28:57.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b0e59c700 1 -- 172.21.15.63:0/2809739886 learned_addr learned my addr 172.21.15.63:0/2809739886 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:28:57.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b07fff700 1 -- 172.21.15.63:0/2809739886 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b100b5630 msgr2=0x7f3b100b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:57.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b07fff700 1 --2- 172.21.15.63:0/2809739886 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b100b5630 0x7f3b100b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:57.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b07fff700 1 -- 172.21.15.63:0/2809739886 >> v2:172.21.15.63:3300/0 conn(0x7f3b10146be0 msgr2=0x7f3b1006a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:57.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b07fff700 1 --2- 172.21.15.63:0/2809739886 >> v2:172.21.15.63:3300/0 conn(0x7f3b10146be0 0x7f3b1006a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:57.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b07fff700 1 -- 172.21.15.63:0/2809739886 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b101462c0 con 0x7f3b100b7cc0 2020-05-18T21:28:57.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b0e59c700 1 --2- 172.21.15.63:0/2809739886 >> v2:172.21.15.63:3300/0 conn(0x7f3b10146be0 0x7f3b1006a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:57.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b0ed9d700 1 --2- 172.21.15.63:0/2809739886 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b100b5630 0x7f3b100b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:57.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b07fff700 1 --2- 172.21.15.63:0/2809739886 >> v2:172.21.15.155:3300/0 conn(0x7f3b100b7cc0 0x7f3b10145e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3af8002f70 tx=0x7f3af8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b07fff700 1 --2- 172.21.15.63:0/2809739886 >> v2:172.21.15.155:3300/0 conn(0x7f3b100b7cc0 0x7f3b10145e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3af8002f70 tx=0x7f3af8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b07fff700 1 --2- 172.21.15.63:0/2809739886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b100b7cc0 0x7f3b10145e60 secure :-1 s=READY pgs=459 cs=0 l=1 rx=0x7f3af8002f70 tx=0x7f3af8007a80).ready entity=mon.1 client_cookie=ac971e61b83d6ae8 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:57.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b07fff700 1 --2- 172.21.15.63:0/2809739886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b100b7cc0 0x7f3b10145e60 secure :-1 s=THROTTLE_DONE pgs=459 cs=0 l=1 rx=0x7f3af8002f70 tx=0x7f3af8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b0dd9b700 1 -- 172.21.15.63:0/2809739886 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3af8008e50 con 0x7f3b100b7cc0 2020-05-18T21:28:57.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b07fff700 1 --2- 172.21.15.63:0/2809739886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b100b7cc0 0x7f3b10145e60 secure :-1 s=THROTTLE_DONE pgs=459 cs=0 l=1 rx=0x7f3af8002f70 tx=0x7f3af8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b07fff700 1 --2- 172.21.15.63:0/2809739886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b100b7cc0 0x7f3b10145e60 secure :-1 s=THROTTLE_DONE pgs=459 cs=0 l=1 rx=0x7f3af8002f70 tx=0x7f3af8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b0dd9b700 1 -- 172.21.15.63:0/2809739886 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af8011540 con 0x7f3b100b7cc0 2020-05-18T21:28:57.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b0dd9b700 1 -- 172.21.15.63:0/2809739886 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3af8011960 con 0x7f3b100b7cc0 2020-05-18T21:28:57.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b14b72700 1 -- 172.21.15.63:0/2809739886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b100b7cc0 msgr2=0x7f3b10145e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:57.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b14b72700 1 --2- 172.21.15.63:0/2809739886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b100b7cc0 0x7f3b10145e60 secure :-1 s=READY pgs=459 cs=0 l=1 rx=0x7f3af8002f70 tx=0x7f3af8007a80).stop 2020-05-18T21:28:57.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b14b72700 1 -- 172.21.15.63:0/2809739886 shutdown_connections 2020-05-18T21:28:57.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b14b72700 1 --2- 172.21.15.63:0/2809739886 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b100b5630 0x7f3b100b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:57.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b14b72700 1 --2- 172.21.15.63:0/2809739886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b100b7cc0 0x7f3b10145e60 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:57.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b14b72700 1 --2- 172.21.15.63:0/2809739886 >> v2:172.21.15.63:3300/0 conn(0x7f3b10146be0 0x7f3b1006a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:57.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b14b72700 1 -- 172.21.15.63:0/2809739886 >> 172.21.15.63:0/2809739886 conn(0x7f3b1005b240 msgr2=0x7f3b10069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:57.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b14b72700 1 -- 172.21.15.63:0/2809739886 shutdown_connections 2020-05-18T21:28:57.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.861+0000 7f3b14b72700 1 -- 172.21.15.63:0/2809739886 wait complete. 2020-05-18T21:28:57.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.865+0000 7f3b14b72700 1 Processor -- start 2020-05-18T21:28:57.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.865+0000 7f3b14b72700 1 -- start start 2020-05-18T21:28:57.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.865+0000 7f3b14b72700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3b100b5630 0x7f3b10156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:57.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.865+0000 7f3b14b72700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b10146be0 0x7f3b100af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:57.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.865+0000 7f3b14b72700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b100af4c0 con 0x7f3b100b7cc0 2020-05-18T21:28:57.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.865+0000 7f3b14b72700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1013e520 con 0x7f3b100b5630 2020-05-18T21:28:57.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.865+0000 7f3b14b72700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b10153890 con 0x7f3b10146be0 2020-05-18T21:28:57.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.865+0000 7f3b07fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3b100b7cc0 0x7f3b10157180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58070/0 (socket says 172.21.15.63:58070) 2020-05-18T21:28:57.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.865+0000 7f3b07fff700 1 -- 172.21.15.63:0/572930218 learned_addr learned my addr 172.21.15.63:0/572930218 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:57.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.865+0000 7f3b0e59c700 1 --2- 172.21.15.63:0/572930218 >> v2:172.21.15.155:3300/0 conn(0x7f3b100b5630 0x7f3b10156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:57.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.865+0000 7f3b0ed9d700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b10146be0 0x7f3b100af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:57.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.865+0000 7f3b077fe700 1 -- 172.21.15.63:0/572930218 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813242729 0 0) 0x7f3b100af4c0 con 0x7f3b100b7cc0 2020-05-18T21:28:57.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.865+0000 7f3b077fe700 1 -- 172.21.15.63:0/572930218 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3af4002fe0 con 0x7f3b100b7cc0 2020-05-18T21:28:57.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b077fe700 1 -- 172.21.15.63:0/572930218 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 447334715 0 0) 0x7f3af4002fe0 con 0x7f3b100b7cc0 2020-05-18T21:28:57.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b0ed9d700 1 -- 172.21.15.63:0/572930218 >> v2:172.21.15.155:3300/0 conn(0x7f3b100b5630 msgr2=0x7f3b10156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:57.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b0ed9d700 1 --2- 172.21.15.63:0/572930218 >> v2:172.21.15.155:3300/0 conn(0x7f3b100b5630 0x7f3b10156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:57.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b0ed9d700 1 -- 172.21.15.63:0/572930218 >> v1:172.21.15.63:6789/0 conn(0x7f3b100b7cc0 legacy=0x7f3b10157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:57.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b0ed9d700 1 -- 172.21.15.63:0/572930218 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b10153b30 con 0x7f3b10146be0 2020-05-18T21:28:57.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b0e59c700 1 --2- 172.21.15.63:0/572930218 >> v2:172.21.15.155:3300/0 conn(0x7f3b100b5630 0x7f3b10156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:28:57.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b0ed9d700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b10146be0 0x7f3b100af060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3af8007ae0 tx=0x7f3b08011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b0ed9d700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b10146be0 0x7f3b100af060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3af8007ae0 tx=0x7f3b08011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b0ed9d700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b10146be0 0x7f3b100af060 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f3af8007ae0 tx=0x7f3b08011050).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:57.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b0ed9d700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b10146be0 0x7f3b100af060 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f3af8007ae0 tx=0x7f3b08011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b077fe700 1 -- 172.21.15.63:0/572930218 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3af8008e50 con 0x7f3b10146be0 2020-05-18T21:28:57.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b0ed9d700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b10146be0 0x7f3b100af060 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f3af8007ae0 tx=0x7f3b08011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b0ed9d700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b10146be0 0x7f3b100af060 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f3af8007ae0 tx=0x7f3b08011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b077fe700 1 -- 172.21.15.63:0/572930218 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b08005e70 con 0x7f3b10146be0 2020-05-18T21:28:57.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b14b72700 1 -- 172.21.15.63:0/572930218 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b10157890 con 0x7f3b10146be0 2020-05-18T21:28:57.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b077fe700 1 -- 172.21.15.63:0/572930218 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b0800cb40 con 0x7f3b10146be0 2020-05-18T21:28:57.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b14b72700 1 -- 172.21.15.63:0/572930218 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b101535f0 con 0x7f3b10146be0 2020-05-18T21:28:57.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b0ed9d700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b10146be0 0x7f3b100af060 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f3af8007ae0 tx=0x7f3b08011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b14b72700 1 -- 172.21.15.63:0/572930218 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b100569e0 con 0x7f3b10146be0 2020-05-18T21:28:57.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b077fe700 1 -- 172.21.15.63:0/572930218 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3b0800ccf0 con 0x7f3b10146be0 2020-05-18T21:28:57.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.869+0000 7f3b0ed9d700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b10146be0 0x7f3b100af060 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f3af8007ae0 tx=0x7f3b08011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.873+0000 7f3b077fe700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3af404fd80 0x7f3af4052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:57.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.873+0000 7f3b077fe700 1 -- 172.21.15.63:0/572930218 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3b080636c0 con 0x7f3b10146be0 2020-05-18T21:28:57.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.873+0000 7f3b0e59c700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3af404fd80 0x7f3af4052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:57.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.873+0000 7f3b0e59c700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3af404fd80 0x7f3af4052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b00002f70 tx=0x7f3b00007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.873+0000 7f3b0e59c700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3af404fd80 0x7f3af4052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b00002f70 tx=0x7f3b00007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.873+0000 7f3b0e59c700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3af404fd80 0x7f3af4052240 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7f3b00002f70 tx=0x7f3b00007720).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:57.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.881+0000 7f3b0ed9d700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b10146be0 0x7f3b100af060 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f3af8007ae0 tx=0x7f3b08011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:57.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:57.881+0000 7f3b077fe700 1 -- 172.21.15.63:0/572930218 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3b0803dab0 con 0x7f3b10146be0 2020-05-18T21:28:58.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.037+0000 7f3b14b72700 1 -- 172.21.15.63:0/572930218 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f3b100008d0 con 0x7f3b10146be0 2020-05-18T21:28:58.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.037+0000 7f3b0ed9d700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b10146be0 0x7f3b100af060 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f3af8007ae0 tx=0x7f3b08011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:58.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.037+0000 7f3b077fe700 1 -- 172.21.15.63:0/572930218 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1932 (secure 0 0 0) 0x7f3b080410d0 con 0x7f3b10146be0 2020-05-18T21:28:58.044 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:28:58.044 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:28:58.045 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:28:58.045 INFO:teuthology.orchestra.run.smithi063.stdout: "total_bytes": 773094113280, 2020-05-18T21:28:58.045 INFO:teuthology.orchestra.run.smithi063.stdout: "total_avail_bytes": 764499165184, 2020-05-18T21:28:58.045 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_bytes": 5013504, 2020-05-18T21:28:58.045 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_bytes": 8594948096, 2020-05-18T21:28:58.046 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_ratio": 0.011117596179246902, 2020-05-18T21:28:58.046 INFO:teuthology.orchestra.run.smithi063.stdout: "num_osds": 8, 2020-05-18T21:28:58.046 INFO:teuthology.orchestra.run.smithi063.stdout: "num_per_pool_osds": 8, 2020-05-18T21:28:58.046 INFO:teuthology.orchestra.run.smithi063.stdout: "num_per_pool_omap_osds": 8 2020-05-18T21:28:58.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:58.047 INFO:teuthology.orchestra.run.smithi063.stdout: "stats_by_class": { 2020-05-18T21:28:58.047 INFO:teuthology.orchestra.run.smithi063.stdout: "ssd": { 2020-05-18T21:28:58.047 INFO:teuthology.orchestra.run.smithi063.stdout: "total_bytes": 773094113280, 2020-05-18T21:28:58.047 INFO:teuthology.orchestra.run.smithi063.stdout: "total_avail_bytes": 764499165184, 2020-05-18T21:28:58.048 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_bytes": 5013504, 2020-05-18T21:28:58.048 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_bytes": 8594948096, 2020-05-18T21:28:58.048 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_ratio": 0.011117596179246902 2020-05-18T21:28:58.048 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:58.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:58.049 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:28:58.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:58.049 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_health_metrics", 2020-05-18T21:28:58.049 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 1, 2020-05-18T21:28:58.050 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:28:58.050 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 0, 2020-05-18T21:28:58.050 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 2, 2020-05-18T21:28:58.050 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 0, 2020-05-18T21:28:58.050 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 0, 2020-05-18T21:28:58.050 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 0, 2020-05-18T21:28:58.051 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362922180608 2020-05-18T21:28:58.051 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:58.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:58.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:58.051 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd", 2020-05-18T21:28:58.052 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 2, 2020-05-18T21:28:58.052 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:28:58.052 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 0, 2020-05-18T21:28:58.052 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 0, 2020-05-18T21:28:58.052 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 0, 2020-05-18T21:28:58.053 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 0, 2020-05-18T21:28:58.053 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 0, 2020-05-18T21:28:58.053 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362922180608 2020-05-18T21:28:58.053 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:58.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:58.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:58.054 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephfs_metadata", 2020-05-18T21:28:58.054 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 9, 2020-05-18T21:28:58.054 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:28:58.054 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 2724, 2020-05-18T21:28:58.054 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 22, 2020-05-18T21:28:58.055 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 64, 2020-05-18T21:28:58.055 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 65536, 2020-05-18T21:28:58.055 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 9.028931913235283e-08, 2020-05-18T21:28:58.055 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362922180608 2020-05-18T21:28:58.055 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:58.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:28:58.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:28:58.056 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephfs_data", 2020-05-18T21:28:58.056 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 10, 2020-05-18T21:28:58.056 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:28:58.057 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 0, 2020-05-18T21:28:58.057 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 0, 2020-05-18T21:28:58.057 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 0, 2020-05-18T21:28:58.057 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 0, 2020-05-18T21:28:58.058 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 0, 2020-05-18T21:28:58.058 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362922180608 2020-05-18T21:28:58.059 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:58.059 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:28:58.059 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:28:58.059 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:28:58.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.041+0000 7f3b14b72700 1 -- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3af404fd80 msgr2=0x7f3af4052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:58.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.041+0000 7f3b14b72700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3af404fd80 0x7f3af4052240 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7f3b00002f70 tx=0x7f3b00007720).stop 2020-05-18T21:28:58.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.041+0000 7f3b14b72700 1 -- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b10146be0 msgr2=0x7f3b100af060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:58.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.041+0000 7f3b14b72700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b10146be0 0x7f3b100af060 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f3af8007ae0 tx=0x7f3b08011050).stop 2020-05-18T21:28:58.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.041+0000 7f3b14b72700 1 -- 172.21.15.63:0/572930218 shutdown_connections 2020-05-18T21:28:58.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.041+0000 7f3b14b72700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3af404fd80 0x7f3af4052240 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:58.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.041+0000 7f3b14b72700 1 --2- 172.21.15.63:0/572930218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b10146be0 0x7f3b100af060 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:58.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.041+0000 7f3b14b72700 1 --2- 172.21.15.63:0/572930218 >> v2:172.21.15.155:3300/0 conn(0x7f3b100b5630 0x7f3b10156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:58.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.041+0000 7f3b14b72700 1 -- 172.21.15.63:0/572930218 >> 172.21.15.63:0/572930218 conn(0x7f3b1005b240 msgr2=0x7f3b10145190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:58.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.041+0000 7f3b14b72700 1 -- 172.21.15.63:0/572930218 shutdown_connections 2020-05-18T21:28:58.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.041+0000 7f3b14b72700 1 -- 172.21.15.63:0/572930218 wait complete. 2020-05-18T21:28:58.063 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s 2020-05-18T21:28:58.064 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:28:58.064 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:28:58.084 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:28:58.105 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:28:58.106 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:28:58.106 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:28:58.106 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:58.139 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[20904]: fuse finished with error 0 and tester_r 0 2020-05-18T21:28:58.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.144 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:58.150 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:28:58.151 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:28:58.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.152 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.1 down' 2020-05-18T21:28:58.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.169 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.1' 2020-05-18T21:28:58.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.291 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:28:58.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.309 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:28:58.316 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:28:58.317 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:28:58.317 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:28:58.317 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:58.317 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:28:58.317 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:58.318 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:58.318 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.318 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:58.318 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.318 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:58.319 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.319 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:28:58.319 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.319 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:28:58.319 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42704sec preferred_lft 42704sec 2020-05-18T21:28:58.320 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:28:58.320 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:58.320 INFO:teuthology.orchestra.run.smithi063.stdout:15: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-05-18T21:28:58.320 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.320 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:28:58.320 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:58.321 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::247d:57ff:fe9a:89b2/64 scope link 2020-05-18T21:28:58.321 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:58.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.322 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:28:58.377 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:28:58.378 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:28:58.378 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:28:58.378 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.378 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:28:58.379 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.379 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:28:58.379 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.379 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:28:58.379 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.380 INFO:teuthology.orchestra.run.smithi063.stdout:15: ceph-brx: mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:28:58.380 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.381 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:28:58.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.382 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:28:58.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.401 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:28:58.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.539 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:28:58.545 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:28:58.545 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:28:58.545 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:28:58.546 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:28:58.546 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:28:58.546 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:28:58.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.547 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:28:58.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.561 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:28:58.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.573 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:28:58.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.588 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:28:58.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.636 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:28:58.643 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-05-18T21:28:58.644 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:28:58.644 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-05-18T21:28:58.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.645 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:28:58.653 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:28:58.653 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:28:58.653 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:28:58.654 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:58.654 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:28:58.654 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:58.654 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:58.654 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.655 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:58.655 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.655 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:58.655 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.655 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:28:58.656 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.656 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:28:58.656 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42704sec preferred_lft 42704sec 2020-05-18T21:28:58.656 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:28:58.656 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:58.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.657 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:28:58.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.704 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:28:58.711 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2020-05-18T21:28:58.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:28:58.713 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-05-18T21:28:58.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.714 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:28:58.766 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:28:58.767 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:28:58.767 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:28:58.767 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:58.767 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:28:58.768 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:58.768 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:58.768 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.768 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:58.768 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.769 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:58.769 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.769 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:28:58.769 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.769 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:28:58.770 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42708sec preferred_lft 42708sec 2020-05-18T21:28:58.770 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:28:58.770 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:58.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.771 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:28:58.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.779 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:28:58.785 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2020-05-18T21:28:58.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:28:58.787 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-05-18T21:28:58.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.788 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:28:58.834 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:28:58.834 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:28:58.835 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:28:58.835 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:58.835 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:28:58.835 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:58.835 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:58.836 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.836 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:58.836 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.836 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:28:58.836 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.837 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:28:58.837 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:28:58.837 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:28:58.837 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42708sec preferred_lft 42708sec 2020-05-18T21:28:58.837 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:28:58.838 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:28:58.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:28:58.838 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:28:58.845 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_strays.TestStrays.test_fancy_layout' 2020-05-18T21:28:58.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.949+0000 7f2adb59e700 1 Processor -- start 2020-05-18T21:28:58.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.949+0000 7f2adb59e700 1 -- start start 2020-05-18T21:28:58.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.949+0000 7f2adb59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2adc05f110 0x7f2adc0b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:58.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.949+0000 7f2adb59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2adc064fd0 0x7f2adc14d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:58.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.949+0000 7f2adb59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2adc14a330 con 0x7f2adc14aa70 2020-05-18T21:28:58.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.949+0000 7f2adb59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc14a140 con 0x7f2adc05f110 2020-05-18T21:28:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.949+0000 7f2adb59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc065460 con 0x7f2adc064fd0 2020-05-18T21:28:58.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.949+0000 7f2ada59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2adc05f110 0x7f2adc0b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:58.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.949+0000 7f2ad3fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2adc14aa70 0x7f2adc0648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58078/0 (socket says 172.21.15.63:58078) 2020-05-18T21:28:58.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.949+0000 7f2ad3fff700 1 -- 172.21.15.63:0/2424144056 learned_addr learned my addr 172.21.15.63:0/2424144056 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:58.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.949+0000 7f2adad9d700 1 --2- 172.21.15.63:0/2424144056 >> v2:172.21.15.155:3300/0 conn(0x7f2adc064fd0 0x7f2adc14d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:58.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2ad9d9b700 1 -- 172.21.15.63:0/2424144056 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038987741 0 0) 0x7f2adc14a330 con 0x7f2adc14aa70 2020-05-18T21:28:58.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2ad9d9b700 1 -- 172.21.15.63:0/2424144056 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2abc003270 con 0x7f2adc14aa70 2020-05-18T21:28:58.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2ada59c700 1 -- 172.21.15.63:0/2424144056 >> v2:172.21.15.155:3300/0 conn(0x7f2adc064fd0 msgr2=0x7f2adc14d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:28:58.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2ada59c700 1 --2- 172.21.15.63:0/2424144056 >> v2:172.21.15.155:3300/0 conn(0x7f2adc064fd0 0x7f2adc14d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:58.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2ada59c700 1 -- 172.21.15.63:0/2424144056 >> v1:172.21.15.63:6789/0 conn(0x7f2adc14aa70 legacy=0x7f2adc0648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:58.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2ad9d9b700 1 -- 172.21.15.63:0/2424144056 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1136155103 0 0) 0x7f2abc003270 con 0x7f2adc14aa70 2020-05-18T21:28:58.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2ada59c700 1 -- 172.21.15.63:0/2424144056 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc14a5d0 con 0x7f2adc05f110 2020-05-18T21:28:58.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2ada59c700 1 --2- 172.21.15.63:0/2424144056 >> v2:172.21.15.63:3300/0 conn(0x7f2adc05f110 0x7f2adc0b4760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2ac40018b0 tx=0x7f2acc008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:58.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2ada59c700 1 --2- 172.21.15.63:0/2424144056 >> v2:172.21.15.63:3300/0 conn(0x7f2adc05f110 0x7f2adc0b4760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2ac40018b0 tx=0x7f2acc008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:58.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2ada59c700 1 --2- 172.21.15.63:0/2424144056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2adc05f110 0x7f2adc0b4760 secure :-1 s=READY pgs=645 cs=0 l=1 rx=0x7f2ac40018b0 tx=0x7f2acc008920).ready entity=mon.0 client_cookie=d9e7b24c0d39ddf9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:58.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2ada59c700 1 --2- 172.21.15.63:0/2424144056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2adc05f110 0x7f2adc0b4760 secure :-1 s=THROTTLE_DONE pgs=645 cs=0 l=1 rx=0x7f2ac40018b0 tx=0x7f2acc008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:58.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2ad9d9b700 1 -- 172.21.15.63:0/2424144056 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ac4001710 con 0x7f2adc05f110 2020-05-18T21:28:58.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2ada59c700 1 --2- 172.21.15.63:0/2424144056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2adc05f110 0x7f2adc0b4760 secure :-1 s=THROTTLE_DONE pgs=645 cs=0 l=1 rx=0x7f2ac40018b0 tx=0x7f2acc008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:58.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2ada59c700 1 --2- 172.21.15.63:0/2424144056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2adc05f110 0x7f2adc0b4760 secure :-1 s=THROTTLE_DONE pgs=645 cs=0 l=1 rx=0x7f2ac40018b0 tx=0x7f2acc008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:58.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2ad9d9b700 1 -- 172.21.15.63:0/2424144056 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc008e80 con 0x7f2adc05f110 2020-05-18T21:28:58.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2ad9d9b700 1 -- 172.21.15.63:0/2424144056 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2acc011440 con 0x7f2adc05f110 2020-05-18T21:28:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2adb59e700 1 -- 172.21.15.63:0/2424144056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2adc05f110 msgr2=0x7f2adc0b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2adb59e700 1 --2- 172.21.15.63:0/2424144056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2adc05f110 0x7f2adc0b4760 secure :-1 s=READY pgs=645 cs=0 l=1 rx=0x7f2ac40018b0 tx=0x7f2acc008920).stop 2020-05-18T21:28:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2adb59e700 1 -- 172.21.15.63:0/2424144056 shutdown_connections 2020-05-18T21:28:58.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2adb59e700 1 --2- 172.21.15.63:0/2424144056 >> v2:172.21.15.155:3300/0 conn(0x7f2adc064fd0 0x7f2adc14d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:28:58.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2adb59e700 1 --2- 172.21.15.63:0/2424144056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2adc05f110 0x7f2adc0b4760 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:58.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2adb59e700 1 -- 172.21.15.63:0/2424144056 >> 172.21.15.63:0/2424144056 conn(0x7f2adc069fc0 msgr2=0x7f2adc06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:58.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2adb59e700 1 -- 172.21.15.63:0/2424144056 shutdown_connections 2020-05-18T21:28:58.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.953+0000 7f2adb59e700 1 -- 172.21.15.63:0/2424144056 wait complete. 2020-05-18T21:28:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2adb59e700 1 Processor -- start 2020-05-18T21:28:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2adb59e700 1 -- start start 2020-05-18T21:28:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2adb59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2adc14aa70 0x7f2adc142e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2adb59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2adc145ee0 con 0x7f2adc05f110 2020-05-18T21:28:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2adb59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2adc0add60 con 0x7f2adc064fd0 2020-05-18T21:28:58.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2adb59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc1432f0 con 0x7f2adc14aa70 2020-05-18T21:28:58.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2ada59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2adc05f110 0x7f2adc0ad5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58084/0 (socket says 172.21.15.63:58084) 2020-05-18T21:28:58.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2ada59c700 1 -- 172.21.15.63:0/2082724193 learned_addr learned my addr 172.21.15.63:0/2082724193 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:58.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2adad9d700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2adc14aa70 0x7f2adc142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:58.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2ad37fe700 1 -- 172.21.15.63:0/2082724193 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690839145 0 0) 0x7f2adc145ee0 con 0x7f2adc05f110 2020-05-18T21:28:58.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2ad37fe700 1 -- 172.21.15.63:0/2082724193 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ac0002fe0 con 0x7f2adc05f110 2020-05-18T21:28:58.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2ad37fe700 1 -- 172.21.15.63:0/2082724193 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809327267 0 0) 0x7f2adc0add60 con 0x7f2adc064fd0 2020-05-18T21:28:58.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2ad37fe700 1 -- 172.21.15.63:0/2082724193 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2adc145ee0 con 0x7f2adc064fd0 2020-05-18T21:28:58.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2ad37fe700 1 -- 172.21.15.63:0/2082724193 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1537103753 0 0) 0x7f2ac0002fe0 con 0x7f2adc05f110 2020-05-18T21:28:58.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2adad9d700 1 -- 172.21.15.63:0/2082724193 >> v1:172.21.15.155:6789/0 conn(0x7f2adc064fd0 legacy=0x7f2adc15a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2adad9d700 1 -- 172.21.15.63:0/2082724193 >> v1:172.21.15.63:6789/0 conn(0x7f2adc05f110 legacy=0x7f2adc0ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2adad9d700 1 -- 172.21.15.63:0/2082724193 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc144790 con 0x7f2adc14aa70 2020-05-18T21:28:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2adad9d700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2adc14aa70 0x7f2adc142e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2acc0087c0 tx=0x7f2ad4010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2adad9d700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2adc14aa70 0x7f2adc142e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2acc0087c0 tx=0x7f2ad4010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2adad9d700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2adc14aa70 0x7f2adc142e90 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f2acc0087c0 tx=0x7f2ad4010f20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:58.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2adad9d700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2adc14aa70 0x7f2adc142e90 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f2acc0087c0 tx=0x7f2ad4010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:58.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2ad37fe700 1 -- 172.21.15.63:0/2082724193 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2acc008620 con 0x7f2adc14aa70 2020-05-18T21:28:58.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2adad9d700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2adc14aa70 0x7f2adc142e90 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f2acc0087c0 tx=0x7f2ad4010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:58.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2ad37fe700 1 -- 172.21.15.63:0/2082724193 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad4005e70 con 0x7f2adc14aa70 2020-05-18T21:28:58.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2adad9d700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2adc14aa70 0x7f2adc142e90 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f2acc0087c0 tx=0x7f2ad4010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:58.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2adb59e700 1 -- 172.21.15.63:0/2082724193 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2adc144a30 con 0x7f2adc14aa70 2020-05-18T21:28:58.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2ad37fe700 1 -- 172.21.15.63:0/2082724193 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ad4007560 con 0x7f2adc14aa70 2020-05-18T21:28:58.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.957+0000 7f2adb59e700 1 -- 172.21.15.63:0/2082724193 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2adc15b0a0 con 0x7f2adc14aa70 2020-05-18T21:28:58.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.961+0000 7f2adb59e700 1 -- 172.21.15.63:0/2082724193 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2adc0569e0 con 0x7f2adc14aa70 2020-05-18T21:28:58.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.961+0000 7f2adad9d700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2adc14aa70 0x7f2adc142e90 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f2acc0087c0 tx=0x7f2ad4010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:58.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.961+0000 7f2ad37fe700 1 -- 172.21.15.63:0/2082724193 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2ad4007760 con 0x7f2adc14aa70 2020-05-18T21:28:58.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.961+0000 7f2adad9d700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2adc14aa70 0x7f2adc142e90 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f2acc0087c0 tx=0x7f2ad4010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:58.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.961+0000 7f2ad37fe700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ac004fe80 0x7f2ac0052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:58.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.961+0000 7f2ad37fe700 1 -- 172.21.15.63:0/2082724193 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2ad4063ac0 con 0x7f2adc14aa70 2020-05-18T21:28:58.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.961+0000 7f2ada59c700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ac004fe80 0x7f2ac0052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:58.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.965+0000 7f2ada59c700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ac004fe80 0x7f2ac0052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2acc008360 tx=0x7f2adc0640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:58.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.965+0000 7f2ada59c700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ac004fe80 0x7f2ac0052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2acc008360 tx=0x7f2adc0640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:58.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.965+0000 7f2ada59c700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ac004fe80 0x7f2ac0052340 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7f2acc008360 tx=0x7f2adc0640f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:58.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.973+0000 7f2adad9d700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2adc14aa70 0x7f2adc142e90 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f2acc0087c0 tx=0x7f2ad4010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:58.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:58.973+0000 7f2ad37fe700 1 -- 172.21.15.63:0/2082724193 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2ad403ddf0 con 0x7f2adc14aa70 2020-05-18T21:28:59.086 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:28:59.089 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:28:59.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.129+0000 7f2adb59e700 1 -- 172.21.15.63:0/2082724193 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_fancy_layout"]} v 0) v1 -- 0x7f2adc0625f0 con 0x7f2adc14aa70 2020-05-18T21:28:59.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.609+0000 7f2adad9d700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2adc14aa70 0x7f2adc142e90 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f2acc0087c0 tx=0x7f2ad4010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:59.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.609+0000 7f2ad37fe700 1 -- 172.21.15.63:0/2082724193 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_fancy_layout"]}]=0 v125) v1 ==== 132+0+0 (secure 0 0 0) 0x7f2ad4041410 con 0x7f2adc14aa70 2020-05-18T21:28:59.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.613+0000 7f2adb59e700 1 -- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ac004fe80 msgr2=0x7f2ac0052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:59.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.613+0000 7f2adb59e700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ac004fe80 0x7f2ac0052340 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7f2acc008360 tx=0x7f2adc0640f0).stop 2020-05-18T21:28:59.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.613+0000 7f2adb59e700 1 -- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2adc14aa70 msgr2=0x7f2adc142e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:59.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.613+0000 7f2adb59e700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2adc14aa70 0x7f2adc142e90 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f2acc0087c0 tx=0x7f2ad4010f20).stop 2020-05-18T21:28:59.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.613+0000 7f2adb59e700 1 -- 172.21.15.63:0/2082724193 shutdown_connections 2020-05-18T21:28:59.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.613+0000 7f2adb59e700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ac004fe80 0x7f2ac0052340 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:59.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.613+0000 7f2adb59e700 1 --2- 172.21.15.63:0/2082724193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2adc14aa70 0x7f2adc142e90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:59.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.613+0000 7f2adb59e700 1 -- 172.21.15.63:0/2082724193 >> 172.21.15.63:0/2082724193 conn(0x7f2adc069fc0 msgr2=0x7f2adc143580 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:59.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.613+0000 7f2adb59e700 1 -- 172.21.15.63:0/2082724193 shutdown_connections 2020-05-18T21:28:59.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.613+0000 7f2adb59e700 1 -- 172.21.15.63:0/2082724193 wait complete. 2020-05-18T21:28:59.635 INFO:tasks.cephfs_test_runner:test_fancy_layout (tasks.cephfs.test_strays.TestStrays) ... ok 2020-05-18T21:28:59.636 INFO:tasks.cephfs_test_runner:Starting test: test_files_throttle (tasks.cephfs.test_strays.TestStrays) 2020-05-18T21:28:59.636 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_strays.TestStrays.test_files_throttle' 2020-05-18T21:28:59.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff0626bc700 1 Processor -- start 2020-05-18T21:28:59.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff0626bc700 1 -- start start 2020-05-18T21:28:59.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff0626bc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff05c064fd0 0x7ff05c14d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:28:59.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff0626bc700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05c14a330 con 0x7ff05c0b4760 2020-05-18T21:28:59.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff0626bc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05c14a5d0 con 0x7ff05c05f110 2020-05-18T21:28:59.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff0626bc700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05c14a140 con 0x7ff05c064fd0 2020-05-18T21:28:59.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff060eb9700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff05c0b4760 0x7ff05c0648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58094/0 (socket says 172.21.15.63:58094) 2020-05-18T21:28:59.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff060eb9700 1 -- 172.21.15.63:0/1233627682 learned_addr learned my addr 172.21.15.63:0/1233627682 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:59.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff061ebb700 1 --2- 172.21.15.63:0/1233627682 >> v2:172.21.15.63:3300/0 conn(0x7ff05c064fd0 0x7ff05c14d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:59.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff047fff700 1 -- 172.21.15.63:0/1233627682 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1914058186 0 0) 0x7ff05c14a5d0 con 0x7ff05c05f110 2020-05-18T21:28:59.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff047fff700 1 -- 172.21.15.63:0/1233627682 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff040003270 con 0x7ff05c05f110 2020-05-18T21:28:59.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff061ebb700 1 -- 172.21.15.63:0/1233627682 >> v1:172.21.15.155:6789/0 conn(0x7ff05c05f110 legacy=0x7ff05c14aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:59.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff047fff700 1 -- 172.21.15.63:0/1233627682 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103055958 0 0) 0x7ff05c14a330 con 0x7ff05c0b4760 2020-05-18T21:28:59.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff061ebb700 1 -- 172.21.15.63:0/1233627682 >> v1:172.21.15.63:6789/0 conn(0x7ff05c0b4760 legacy=0x7ff05c0648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:59.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff061ebb700 1 -- 172.21.15.63:0/1233627682 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c063430 con 0x7ff05c064fd0 2020-05-18T21:28:59.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff061ebb700 1 --2- 172.21.15.63:0/1233627682 >> v2:172.21.15.63:3300/0 conn(0x7ff05c064fd0 0x7ff05c14d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff0540032f0 tx=0x7ff054007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:59.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff061ebb700 1 --2- 172.21.15.63:0/1233627682 >> v2:172.21.15.63:3300/0 conn(0x7ff05c064fd0 0x7ff05c14d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff0540032f0 tx=0x7ff054007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:59.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff061ebb700 1 --2- 172.21.15.63:0/1233627682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff05c064fd0 0x7ff05c14d710 secure :-1 s=READY pgs=648 cs=0 l=1 rx=0x7ff0540032f0 tx=0x7ff054007e00).ready entity=mon.0 client_cookie=65917e9d4fdaa0cf server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:59.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff061ebb700 1 --2- 172.21.15.63:0/1233627682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff05c064fd0 0x7ff05c14d710 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7ff0540032f0 tx=0x7ff054007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:59.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff047fff700 1 -- 172.21.15.63:0/1233627682 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff054011e60 con 0x7ff05c064fd0 2020-05-18T21:28:59.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff061ebb700 1 --2- 172.21.15.63:0/1233627682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff05c064fd0 0x7ff05c14d710 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7ff0540032f0 tx=0x7ff054007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:59.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff061ebb700 1 --2- 172.21.15.63:0/1233627682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff05c064fd0 0x7ff05c14d710 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7ff0540032f0 tx=0x7ff054007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:59.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff047fff700 1 -- 172.21.15.63:0/1233627682 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05400a180 con 0x7ff05c064fd0 2020-05-18T21:28:59.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff047fff700 1 -- 172.21.15.63:0/1233627682 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff05400a4e0 con 0x7ff05c064fd0 2020-05-18T21:28:59.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff0626bc700 1 -- 172.21.15.63:0/1233627682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff05c064fd0 msgr2=0x7ff05c14d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:59.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.741+0000 7ff0626bc700 1 --2- 172.21.15.63:0/1233627682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff05c064fd0 0x7ff05c14d710 secure :-1 s=READY pgs=648 cs=0 l=1 rx=0x7ff0540032f0 tx=0x7ff054007e00).stop 2020-05-18T21:28:59.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.745+0000 7ff0626bc700 1 -- 172.21.15.63:0/1233627682 shutdown_connections 2020-05-18T21:28:59.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.745+0000 7ff0626bc700 1 --2- 172.21.15.63:0/1233627682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff05c064fd0 0x7ff05c14d710 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:59.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.745+0000 7ff0626bc700 1 -- 172.21.15.63:0/1233627682 >> 172.21.15.63:0/1233627682 conn(0x7ff05c069fc0 msgr2=0x7ff05c06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:28:59.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.745+0000 7ff0626bc700 1 -- 172.21.15.63:0/1233627682 shutdown_connections 2020-05-18T21:28:59.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.745+0000 7ff0626bc700 1 -- 172.21.15.63:0/1233627682 wait complete. 2020-05-18T21:28:59.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.745+0000 7ff0626bc700 1 Processor -- start 2020-05-18T21:28:59.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.745+0000 7ff0626bc700 1 -- start start 2020-05-18T21:28:59.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.745+0000 7ff0626bc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff05c064fd0 0x7ff05c158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:59.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.745+0000 7ff0626bc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff05c0b4760 0x7ff05c147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:59.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.745+0000 7ff0626bc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05c0ad140 con 0x7ff05c05f110 2020-05-18T21:28:59.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.745+0000 7ff0626bc700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05c1584e0 con 0x7ff05c064fd0 2020-05-18T21:28:59.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.745+0000 7ff0626bc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c1476b0 con 0x7ff05c0b4760 2020-05-18T21:28:59.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff060eb9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff05c064fd0 0x7ff05c158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:59.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff0616ba700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7ff05c05f110 0x7ff05c0b3b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:56414/0 (socket says 172.21.15.63:56414) 2020-05-18T21:28:59.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff0616ba700 1 -- 172.21.15.63:0/1845775140 learned_addr learned my addr 172.21.15.63:0/1845775140 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:28:59.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff061ebb700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff05c0b4760 0x7ff05c147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:59.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff04effd700 1 -- 172.21.15.63:0/1845775140 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311831544 0 0) 0x7ff05c0ad140 con 0x7ff05c05f110 2020-05-18T21:28:59.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff04effd700 1 -- 172.21.15.63:0/1845775140 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff038002fe0 con 0x7ff05c05f110 2020-05-18T21:28:59.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff060eb9700 1 -- 172.21.15.63:0/1845775140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff05c0b4760 msgr2=0x7ff05c147250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:59.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff060eb9700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff05c0b4760 0x7ff05c147250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:28:59.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff060eb9700 1 -- 172.21.15.63:0/1845775140 >> v1:172.21.15.155:6789/0 conn(0x7ff05c05f110 legacy=0x7ff05c0b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:28:59.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff060eb9700 1 -- 172.21.15.63:0/1845775140 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c0ad3e0 con 0x7ff05c064fd0 2020-05-18T21:28:59.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff060eb9700 1 --2- 172.21.15.63:0/1845775140 >> v2:172.21.15.63:3300/0 conn(0x7ff05c064fd0 0x7ff05c158080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff050000bc0 tx=0x7ff050010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:59.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff060eb9700 1 --2- 172.21.15.63:0/1845775140 >> v2:172.21.15.63:3300/0 conn(0x7ff05c064fd0 0x7ff05c158080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff050000bc0 tx=0x7ff050010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:59.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff060eb9700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff05c064fd0 0x7ff05c158080 secure :-1 s=READY pgs=649 cs=0 l=1 rx=0x7ff050000bc0 tx=0x7ff050010900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:59.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff060eb9700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff05c064fd0 0x7ff05c158080 secure :-1 s=THROTTLE_DONE pgs=649 cs=0 l=1 rx=0x7ff050000bc0 tx=0x7ff050010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:59.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff04effd700 1 -- 172.21.15.63:0/1845775140 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff050005ce0 con 0x7ff05c064fd0 2020-05-18T21:28:59.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff060eb9700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff05c064fd0 0x7ff05c158080 secure :-1 s=THROTTLE_DONE pgs=649 cs=0 l=1 rx=0x7ff050000bc0 tx=0x7ff050010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:59.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff04effd700 1 -- 172.21.15.63:0/1845775140 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff050005e40 con 0x7ff05c064fd0 2020-05-18T21:28:59.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff060eb9700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff05c064fd0 0x7ff05c158080 secure :-1 s=THROTTLE_DONE pgs=649 cs=0 l=1 rx=0x7ff050000bc0 tx=0x7ff050010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:59.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff04effd700 1 -- 172.21.15.63:0/1845775140 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0500062c0 con 0x7ff05c064fd0 2020-05-18T21:28:59.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff0626bc700 1 -- 172.21.15.63:0/1845775140 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05c0ad680 con 0x7ff05c064fd0 2020-05-18T21:28:59.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff0626bc700 1 -- 172.21.15.63:0/1845775140 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05c0add40 con 0x7ff05c064fd0 2020-05-18T21:28:59.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff060eb9700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff05c064fd0 0x7ff05c158080 secure :-1 s=THROTTLE_DONE pgs=649 cs=0 l=1 rx=0x7ff050000bc0 tx=0x7ff050010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:59.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.749+0000 7ff0626bc700 1 -- 172.21.15.63:0/1845775140 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05c0569e0 con 0x7ff05c064fd0 2020-05-18T21:28:59.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.753+0000 7ff04effd700 1 -- 172.21.15.63:0/1845775140 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff050006580 con 0x7ff05c064fd0 2020-05-18T21:28:59.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.753+0000 7ff060eb9700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff05c064fd0 0x7ff05c158080 secure :-1 s=THROTTLE_DONE pgs=649 cs=0 l=1 rx=0x7ff050000bc0 tx=0x7ff050010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:59.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.753+0000 7ff04effd700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff03804fd50 0x7ff038052210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:28:59.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.753+0000 7ff04effd700 1 -- 172.21.15.63:0/1845775140 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff0500090c0 con 0x7ff05c064fd0 2020-05-18T21:28:59.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.753+0000 7ff0616ba700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff03804fd50 0x7ff038052210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:28:59.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.753+0000 7ff0616ba700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff03804fd50 0x7ff038052210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff0580011a0 tx=0x7ff058002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:59.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.753+0000 7ff0616ba700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff03804fd50 0x7ff038052210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff0580011a0 tx=0x7ff058002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:59.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.753+0000 7ff0616ba700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff03804fd50 0x7ff038052210 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7ff0580011a0 tx=0x7ff058002860).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:28:59.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.757+0000 7ff060eb9700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff05c064fd0 0x7ff05c158080 secure :-1 s=THROTTLE_DONE pgs=649 cs=0 l=1 rx=0x7ff050000bc0 tx=0x7ff050010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:28:59.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.757+0000 7ff04effd700 1 -- 172.21.15.63:0/1845775140 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff05003e140 con 0x7ff05c064fd0 2020-05-18T21:28:59.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:28:59.913+0000 7ff0626bc700 1 -- 172.21.15.63:0/1845775140 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_files_throttle"]} v 0) v1 -- 0x7ff05c14e3e0 con 0x7ff05c064fd0 2020-05-18T21:29:00.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.609+0000 7ff060eb9700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff05c064fd0 0x7ff05c158080 secure :-1 s=THROTTLE_DONE pgs=649 cs=0 l=1 rx=0x7ff050000bc0 tx=0x7ff050010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:00.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.609+0000 7ff04effd700 1 -- 172.21.15.63:0/1845775140 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_files_throttle"]}]=0 v126) v1 ==== 137+0+0 (secure 0 0 0) 0x7ff050041760 con 0x7ff05c064fd0 2020-05-18T21:29:00.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.613+0000 7ff0626bc700 1 -- 172.21.15.63:0/1845775140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff03804fd50 msgr2=0x7ff038052210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:00.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.613+0000 7ff0626bc700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff03804fd50 0x7ff038052210 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7ff0580011a0 tx=0x7ff058002860).stop 2020-05-18T21:29:00.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.613+0000 7ff0626bc700 1 -- 172.21.15.63:0/1845775140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff05c064fd0 msgr2=0x7ff05c158080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:00.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.613+0000 7ff0626bc700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff05c064fd0 0x7ff05c158080 secure :-1 s=READY pgs=649 cs=0 l=1 rx=0x7ff050000bc0 tx=0x7ff050010900).stop 2020-05-18T21:29:00.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.613+0000 7ff0626bc700 1 -- 172.21.15.63:0/1845775140 shutdown_connections 2020-05-18T21:29:00.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.613+0000 7ff0626bc700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff03804fd50 0x7ff038052210 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:00.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.613+0000 7ff0626bc700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff05c0b4760 0x7ff05c147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:00.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.613+0000 7ff0626bc700 1 --2- 172.21.15.63:0/1845775140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff05c064fd0 0x7ff05c158080 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:00.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.613+0000 7ff0626bc700 1 -- 172.21.15.63:0/1845775140 >> 172.21.15.63:0/1845775140 conn(0x7ff05c069fc0 msgr2=0x7ff05c1438f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:00.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.613+0000 7ff0626bc700 1 -- 172.21.15.63:0/1845775140 shutdown_connections 2020-05-18T21:29:00.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.613+0000 7ff0626bc700 1 -- 172.21.15.63:0/1845775140 wait complete. 2020-05-18T21:29:00.636 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:29:00.637 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:29:00.656 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:29:00.675 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:29:00.676 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-05-18T21:29:00.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f45419cd700 1 Processor -- start 2020-05-18T21:29:00.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f45419cd700 1 -- start start 2020-05-18T21:29:00.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f45419cd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f453c060b90 0x7f453c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:00.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f45419cd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f453c14e570 0x7f453c14a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:00.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f45419cd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453c14d960 con 0x7f453c0b2860 2020-05-18T21:29:00.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f45419cd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f453c066210 con 0x7f453c060b90 2020-05-18T21:29:00.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f45419cd700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f453c14db90 con 0x7f453c14e570 2020-05-18T21:29:00.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f453affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f453c060b90 0x7f453c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:00.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f453affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f453c060b90 0x7f453c0615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55920/0 (socket says 172.21.15.63:55920) 2020-05-18T21:29:00.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f453affd700 1 -- 172.21.15.63:0/3432058598 learned_addr learned my addr 172.21.15.63:0/3432058598 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:00.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f453b7fe700 1 --2- 172.21.15.63:0/3432058598 >> v2:172.21.15.155:3300/0 conn(0x7f453c14e570 0x7f453c14a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:00.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f453b7fe700 1 -- 172.21.15.63:0/3432058598 >> v2:172.21.15.63:3300/0 conn(0x7f453c060b90 msgr2=0x7f453c0615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:00.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f453b7fe700 1 --2- 172.21.15.63:0/3432058598 >> v2:172.21.15.63:3300/0 conn(0x7f453c060b90 0x7f453c0615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:00.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f453b7fe700 1 -- 172.21.15.63:0/3432058598 >> v1:172.21.15.155:6789/0 conn(0x7f453c0b2860 legacy=0x7f453c144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:00.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f453b7fe700 1 -- 172.21.15.63:0/3432058598 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c14de30 con 0x7f453c14e570 2020-05-18T21:29:00.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f453affd700 1 --2- 172.21.15.63:0/3432058598 >> v2:172.21.15.63:3300/0 conn(0x7f453c060b90 0x7f453c0615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:29:00.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f453b7fe700 1 --2- 172.21.15.63:0/3432058598 >> v2:172.21.15.155:3300/0 conn(0x7f453c14e570 0x7f453c14a390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f453c062dc0 tx=0x7f4534007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:00.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f453b7fe700 1 --2- 172.21.15.63:0/3432058598 >> v2:172.21.15.155:3300/0 conn(0x7f453c14e570 0x7f453c14a390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f453c062dc0 tx=0x7f4534007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:00.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f453b7fe700 1 --2- 172.21.15.63:0/3432058598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f453c14e570 0x7f453c14a390 secure :-1 s=READY pgs=464 cs=0 l=1 rx=0x7f453c062dc0 tx=0x7f4534007e00).ready entity=mon.1 client_cookie=2fbda01f55c11be0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:00.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f453b7fe700 1 --2- 172.21.15.63:0/3432058598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f453c14e570 0x7f453c14a390 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7f453c062dc0 tx=0x7f4534007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:00.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f4539ffb700 1 -- 172.21.15.63:0/3432058598 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4534011e20 con 0x7f453c14e570 2020-05-18T21:29:00.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f453b7fe700 1 --2- 172.21.15.63:0/3432058598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f453c14e570 0x7f453c14a390 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7f453c062dc0 tx=0x7f4534007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:00.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f4539ffb700 1 -- 172.21.15.63:0/3432058598 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453400a180 con 0x7f453c14e570 2020-05-18T21:29:00.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f453b7fe700 1 --2- 172.21.15.63:0/3432058598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f453c14e570 0x7f453c14a390 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7f453c062dc0 tx=0x7f4534007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:00.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f4539ffb700 1 -- 172.21.15.63:0/3432058598 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f453400a5a0 con 0x7f453c14e570 2020-05-18T21:29:00.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f45419cd700 1 -- 172.21.15.63:0/3432058598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f453c14e570 msgr2=0x7f453c14a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:00.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.781+0000 7f45419cd700 1 --2- 172.21.15.63:0/3432058598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f453c14e570 0x7f453c14a390 secure :-1 s=READY pgs=464 cs=0 l=1 rx=0x7f453c062dc0 tx=0x7f4534007e00).stop 2020-05-18T21:29:00.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.785+0000 7f45419cd700 1 -- 172.21.15.63:0/3432058598 shutdown_connections 2020-05-18T21:29:00.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.785+0000 7f45419cd700 1 --2- 172.21.15.63:0/3432058598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f453c14e570 0x7f453c14a390 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:00.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.785+0000 7f45419cd700 1 --2- 172.21.15.63:0/3432058598 >> v2:172.21.15.63:3300/0 conn(0x7f453c060b90 0x7f453c0615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:00.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.785+0000 7f45419cd700 1 -- 172.21.15.63:0/3432058598 >> 172.21.15.63:0/3432058598 conn(0x7f453c0b83d0 msgr2=0x7f453c0b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:00.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.785+0000 7f45419cd700 1 -- 172.21.15.63:0/3432058598 shutdown_connections 2020-05-18T21:29:00.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.785+0000 7f45419cd700 1 -- 172.21.15.63:0/3432058598 wait complete. 2020-05-18T21:29:00.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.785+0000 7f45419cd700 1 Processor -- start 2020-05-18T21:29:00.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.785+0000 7f45419cd700 1 -- start start 2020-05-18T21:29:00.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.785+0000 7f45419cd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f453c0b2860 0x7f453c147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:00.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.785+0000 7f45419cd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453c158330 con 0x7f453c060b90 2020-05-18T21:29:00.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.785+0000 7f45419cd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453c0acea0 con 0x7f453c14e570 2020-05-18T21:29:00.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.785+0000 7f45419cd700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453c0ad240 con 0x7f453c0b2860 2020-05-18T21:29:00.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.785+0000 7f453affd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f453c060b90 0x7f453c0b1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58112/0 (socket says 172.21.15.63:58112) 2020-05-18T21:29:00.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.785+0000 7f453affd700 1 -- 172.21.15.63:0/412704253 learned_addr learned my addr 172.21.15.63:0/412704253 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:00.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.785+0000 7f453a7fc700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f453c0b2860 0x7f453c147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:00.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.785+0000 7f452bfff700 1 -- 172.21.15.63:0/412704253 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817376982 0 0) 0x7f453c158330 con 0x7f453c060b90 2020-05-18T21:29:00.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.785+0000 7f452bfff700 1 -- 172.21.15.63:0/412704253 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4518002fe0 con 0x7f453c060b90 2020-05-18T21:29:00.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f452bfff700 1 -- 172.21.15.63:0/412704253 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49604130 0 0) 0x7f453c0acea0 con 0x7f453c14e570 2020-05-18T21:29:00.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f452bfff700 1 -- 172.21.15.63:0/412704253 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f453c158330 con 0x7f453c14e570 2020-05-18T21:29:00.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f453a7fc700 1 -- 172.21.15.63:0/412704253 >> v1:172.21.15.155:6789/0 conn(0x7f453c14e570 legacy=0x7f453c1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:00.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f453a7fc700 1 -- 172.21.15.63:0/412704253 >> v1:172.21.15.63:6789/0 conn(0x7f453c060b90 legacy=0x7f453c0b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:00.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f453a7fc700 1 -- 172.21.15.63:0/412704253 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c0b2030 con 0x7f453c0b2860 2020-05-18T21:29:00.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f453a7fc700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f453c0b2860 0x7f453c147f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f453c0b92c0 tx=0x7f4530010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:00.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f453a7fc700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f453c0b2860 0x7f453c147f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f453c0b92c0 tx=0x7f4530010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:00.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f453a7fc700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f453c0b2860 0x7f453c147f20 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f453c0b92c0 tx=0x7f4530010920).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:00.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f453a7fc700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f453c0b2860 0x7f453c147f20 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f453c0b92c0 tx=0x7f4530010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:00.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f452bfff700 1 -- 172.21.15.63:0/412704253 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f453000cc40 con 0x7f453c0b2860 2020-05-18T21:29:00.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f45419cd700 1 -- 172.21.15.63:0/412704253 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453c157ff0 con 0x7f453c0b2860 2020-05-18T21:29:00.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f453a7fc700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f453c0b2860 0x7f453c147f20 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f453c0b92c0 tx=0x7f4530010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:00.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f452bfff700 1 -- 172.21.15.63:0/412704253 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453000cda0 con 0x7f453c0b2860 2020-05-18T21:29:00.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f453a7fc700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f453c0b2860 0x7f453c147f20 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f453c0b92c0 tx=0x7f4530010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:00.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f452bfff700 1 -- 172.21.15.63:0/412704253 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4530011050 con 0x7f453c0b2860 2020-05-18T21:29:00.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f45419cd700 1 -- 172.21.15.63:0/412704253 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453c147a60 con 0x7f453c0b2860 2020-05-18T21:29:00.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f45419cd700 1 -- 172.21.15.63:0/412704253 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453c158510 con 0x7f453c0b2860 2020-05-18T21:29:00.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f453a7fc700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f453c0b2860 0x7f453c147f20 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f453c0b92c0 tx=0x7f4530010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:00.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f452bfff700 1 -- 172.21.15.63:0/412704253 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4530006520 con 0x7f453c0b2860 2020-05-18T21:29:00.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.789+0000 7f453a7fc700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f453c0b2860 0x7f453c147f20 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f453c0b92c0 tx=0x7f4530010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:00.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.793+0000 7f452bfff700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f451804fea0 0x7f4518052360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:00.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.793+0000 7f452bfff700 1 -- 172.21.15.63:0/412704253 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4530063640 con 0x7f453c0b2860 2020-05-18T21:29:00.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.793+0000 7f453affd700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f451804fea0 0x7f4518052360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:00.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.793+0000 7f453affd700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f451804fea0 0x7f4518052360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f452c002f70 tx=0x7f452c0093f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:00.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.793+0000 7f453affd700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f451804fea0 0x7f4518052360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f452c002f70 tx=0x7f452c0093f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:00.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.793+0000 7f453affd700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f451804fea0 0x7f4518052360 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7f452c002f70 tx=0x7f452c0093f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:00.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.801+0000 7f453a7fc700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f453c0b2860 0x7f453c147f20 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f453c0b92c0 tx=0x7f4530010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:00.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.801+0000 7f452bfff700 1 -- 172.21.15.63:0/412704253 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f453003d970 con 0x7f453c0b2860 2020-05-18T21:29:00.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.917+0000 7f45419cd700 1 -- 172.21.15.63:0/412704253 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f453c158510 con 0x7f453c0b2860 2020-05-18T21:29:00.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.917+0000 7f453a7fc700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f453c0b2860 0x7f453c147f20 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f453c0b92c0 tx=0x7f4530010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:00.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.917+0000 7f452bfff700 1 -- 172.21.15.63:0/412704253 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v51) v1 ==== 81+0+33698 (secure 0 0 0) 0x7f453c158510 con 0x7f453c0b2860 2020-05-18T21:29:00.925 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:00.926 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:29:00.926 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 51, 2020-05-18T21:29:00.926 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:29:00.926 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2020-05-18T21:26:28.798650+0000", 2020-05-18T21:29:00.927 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2020-05-18T21:28:49.508247+0000", 2020-05-18T21:29:00.927 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:29:00.927 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:29:00.927 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-05-18T21:29:00.927 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5799936, 2020-05-18T21:29:00.928 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2020-05-18T21:29:00.928 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2020-05-18T21:29:00.928 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2020-05-18T21:29:00.928 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2020-05-18T21:29:00.928 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2020-05-18T21:29:00.929 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:29:00.929 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 4, 2020-05-18T21:29:00.929 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2020-05-18T21:29:00.929 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-05-18T21:29:00.930 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2020-05-18T21:29:00.930 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2020-05-18T21:29:00.930 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 10, 2020-05-18T21:29:00.930 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 8, 2020-05-18T21:29:00.930 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2020-05-18T21:29:00.930 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "jewel", 2020-05-18T21:29:00.931 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "pacific", 2020-05-18T21:29:00.931 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:29:00.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:00.931 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2020-05-18T21:29:00.931 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "device_health_metrics", 2020-05-18T21:29:00.932 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:33.080792+0000", 2020-05-18T21:29:00.932 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:29:00.932 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:29:00.932 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:29:00.932 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:29:00.933 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:29:00.933 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:29:00.933 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:29:00.933 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:29:00.933 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2020-05-18T21:29:00.934 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2020-05-18T21:29:00.934 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2020-05-18T21:29:00.934 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2020-05-18T21:29:00.934 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2020-05-18T21:29:00.934 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:29:00.934 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:29:00.935 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:29:00.935 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:29:00.935 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:29:00.935 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:29:00.935 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:29:00.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:00.936 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "15", 2020-05-18T21:29:00.936 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:29:00.936 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:29:00.936 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:29:00.936 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:29:00.937 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:29:00.937 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:29:00.937 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:29:00.937 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:29:00.937 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:29:00.938 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:29:00.938 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:29:00.938 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:29:00.938 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:29:00.938 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:29:00.939 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:29:00.939 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:29:00.939 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:29:00.939 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:29:00.939 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:29:00.939 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:29:00.940 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:29:00.940 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:29:00.940 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:29:00.940 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:29:00.940 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:29:00.941 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:29:00.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:00.941 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:29:00.941 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:29:00.941 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:29:00.942 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:29:00.942 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:29:00.942 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:29:00.942 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:29:00.943 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:29:00.943 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:29:00.944 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:29:00.945 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:29:00.945 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:29:00.945 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2020-05-18T21:29:00.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:00.945 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:29:00.946 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_devicehealth": {} 2020-05-18T21:29:00.946 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:00.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:00.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:00.946 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2020-05-18T21:29:00.947 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2020-05-18T21:29:00.947 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:40.149370+0000", 2020-05-18T21:29:00.947 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:29:00.947 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:29:00.947 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:29:00.947 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:29:00.950 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:29:00.950 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:29:00.951 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:29:00.951 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:29:00.953 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:29:00.953 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:29:00.953 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:29:00.954 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:29:00.954 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:29:00.954 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:29:00.955 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:29:00.955 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:29:00.955 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:29:00.956 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:29:00.956 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:29:00.956 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:29:00.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:00.957 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2020-05-18T21:29:00.957 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:29:00.958 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:29:00.958 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:29:00.959 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:29:00.959 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:29:00.959 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:29:00.960 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:29:00.960 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:29:00.960 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:29:00.961 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:29:00.961 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:29:00.961 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:29:00.962 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:29:00.962 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:29:00.962 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:29:00.963 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:29:00.963 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:29:00.963 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:29:00.964 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:29:00.964 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:29:00.964 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:29:00.965 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:29:00.965 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:29:00.965 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:29:00.966 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:29:00.966 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:29:00.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:00.967 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:29:00.967 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:29:00.967 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:29:00.968 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:29:00.968 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:29:00.968 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:29:00.969 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:29:00.969 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:29:00.969 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:29:00.970 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:29:00.970 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:29:00.970 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:29:00.971 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:29:00.971 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2020-05-18T21:29:00.971 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:00.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:00.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:00.972 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 9, 2020-05-18T21:29:00.973 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2020-05-18T21:29:00.973 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:28:46.842474+0000", 2020-05-18T21:29:00.973 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:29:00.974 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:29:00.974 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:29:00.974 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:29:00.975 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:29:00.975 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:29:00.975 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:29:00.978 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:29:00.978 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:29:00.979 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:29:00.979 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:29:00.979 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:29:00.980 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:29:00.980 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:29:00.981 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:29:00.981 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:29:00.981 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:29:00.982 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:29:00.982 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:29:00.982 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:29:00.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:00.983 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "50", 2020-05-18T21:29:00.983 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:29:00.984 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:29:00.984 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:29:00.984 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:29:00.984 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:29:00.985 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:29:00.985 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:29:00.986 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:29:00.987 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:29:00.987 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:29:00.987 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:29:00.988 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:29:00.988 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:29:00.988 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:29:00.989 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:29:00.989 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:29:00.989 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:29:00.990 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:29:00.990 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:29:00.991 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:29:00.991 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:29:00.991 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:29:00.992 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:29:00.992 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:29:00.992 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:29:00.993 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:29:00.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:00.993 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:29:00.994 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:29:00.994 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:29:00.994 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:29:00.995 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:29:00.995 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:29:00.995 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:29:00.996 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:29:00.996 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:29:00.996 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:29:00.997 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:29:00.997 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:29:00.997 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2020-05-18T21:29:00.998 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2020-05-18T21:29:00.998 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2020-05-18T21:29:00.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:00.999 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:29:00.999 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:29:00.999 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2020-05-18T21:29:01.000 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.000 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.001 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 10, 2020-05-18T21:29:01.001 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2020-05-18T21:29:01.002 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:28:47.510399+0000", 2020-05-18T21:29:01.002 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:29:01.002 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:29:01.003 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:29:01.003 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:29:01.003 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:29:01.004 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:29:01.004 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:29:01.004 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:29:01.005 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:29:01.005 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:29:01.006 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:29:01.006 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:29:01.006 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:29:01.007 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:29:01.007 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:29:01.007 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:29:01.008 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:29:01.008 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:29:01.008 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:29:01.009 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:29:01.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.009 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "51", 2020-05-18T21:29:01.009 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:29:01.010 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:29:01.010 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:29:01.010 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:29:01.010 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:29:01.010 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:29:01.011 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:29:01.011 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:29:01.011 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:29:01.011 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:29:01.011 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:29:01.011 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:29:01.012 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:29:01.012 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:29:01.012 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:29:01.012 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:29:01.012 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:29:01.013 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:29:01.013 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:29:01.013 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:29:01.013 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:29:01.013 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:29:01.014 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:29:01.014 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:29:01.014 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:29:01.014 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:29:01.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.015 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:29:01.015 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:29:01.015 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:29:01.015 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:29:01.015 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:29:01.015 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:29:01.016 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:29:01.016 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:29:01.016 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:29:01.016 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:29:01.016 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:29:01.017 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:29:01.017 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:29:01.017 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:29:01.017 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2020-05-18T21:29:01.017 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.018 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.018 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.018 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:29:01.018 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2020-05-18T21:29:01.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.018 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:29:01.019 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "c6ae0fbf-604c-4e8d-b1b8-6038821420e3", 2020-05-18T21:29:01.019 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:29:01.019 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:29:01.019 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:29:01.019 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:29:01.020 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:29:01.020 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:29:01.020 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:29:01.020 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 47, 2020-05-18T21:29:01.020 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:29:01.021 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:29:01.021 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:29:01.021 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.021 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.021 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2020-05-18T21:29:01.022 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:29:01.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.022 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.022 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2020-05-18T21:29:01.023 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:29:01.023 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.023 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.023 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:29:01.023 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.024 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.024 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6802", 2020-05-18T21:29:01.024 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:29:01.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.025 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.025 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6803", 2020-05-18T21:29:01.025 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:29:01.025 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.026 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.026 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:29:01.026 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.026 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.027 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6806", 2020-05-18T21:29:01.027 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:29:01.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.027 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.028 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6807", 2020-05-18T21:29:01.028 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:29:01.028 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.028 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.029 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:29:01.029 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.029 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.029 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6804", 2020-05-18T21:29:01.030 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:29:01.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.030 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.030 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6805", 2020-05-18T21:29:01.030 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:29:01.031 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.031 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.031 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6801/12803", 2020-05-18T21:29:01.031 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6803/12803", 2020-05-18T21:29:01.032 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6807/12803", 2020-05-18T21:29:01.032 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6805/12803", 2020-05-18T21:29:01.032 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:29:01.032 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:29:01.032 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:29:01.032 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.033 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:29:01.033 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6", 2020-05-18T21:29:01.033 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:29:01.034 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:29:01.034 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:29:01.034 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:29:01.034 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:29:01.034 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:29:01.035 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:29:01.035 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 47, 2020-05-18T21:29:01.035 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:29:01.035 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:29:01.035 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:29:01.035 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.036 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.036 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6808", 2020-05-18T21:29:01.036 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:29:01.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.037 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.037 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6809", 2020-05-18T21:29:01.037 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:29:01.037 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.038 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.038 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:29:01.038 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.038 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.039 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6810", 2020-05-18T21:29:01.039 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:29:01.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.039 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.040 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6811", 2020-05-18T21:29:01.040 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:29:01.040 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.040 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.041 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:29:01.041 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.041 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.041 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6815", 2020-05-18T21:29:01.041 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:29:01.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.042 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.042 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6817", 2020-05-18T21:29:01.042 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:29:01.043 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.043 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.043 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:29:01.043 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.044 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.044 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6812", 2020-05-18T21:29:01.044 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:29:01.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.045 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.045 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6813", 2020-05-18T21:29:01.045 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:29:01.045 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.045 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.046 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6809/12804", 2020-05-18T21:29:01.046 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6811/12804", 2020-05-18T21:29:01.046 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6817/12804", 2020-05-18T21:29:01.046 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6813/12804", 2020-05-18T21:29:01.046 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:29:01.047 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:29:01.047 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:29:01.047 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.048 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:29:01.048 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "ec8d9fa9-dae9-45f6-b286-735ab3801c27", 2020-05-18T21:29:01.048 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:29:01.048 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:29:01.048 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:29:01.048 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:29:01.049 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:29:01.049 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:29:01.049 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:29:01.049 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 47, 2020-05-18T21:29:01.049 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:29:01.050 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:29:01.050 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:29:01.050 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.050 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.050 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6822", 2020-05-18T21:29:01.051 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:29:01.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.051 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.051 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6824", 2020-05-18T21:29:01.052 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:29:01.052 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.052 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.052 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:29:01.053 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.053 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.053 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6826", 2020-05-18T21:29:01.054 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:29:01.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.054 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.054 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6827", 2020-05-18T21:29:01.055 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:29:01.055 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.055 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.055 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:29:01.055 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.056 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.056 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6830", 2020-05-18T21:29:01.056 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:29:01.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.057 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.057 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6831", 2020-05-18T21:29:01.057 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:29:01.057 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.058 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.058 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:29:01.058 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.058 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.059 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6828", 2020-05-18T21:29:01.059 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:29:01.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.059 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.060 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6829", 2020-05-18T21:29:01.060 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:29:01.060 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.060 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.061 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6824/12806", 2020-05-18T21:29:01.061 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6827/12806", 2020-05-18T21:29:01.061 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6831/12806", 2020-05-18T21:29:01.061 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6829/12806", 2020-05-18T21:29:01.061 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:29:01.061 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:29:01.062 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:29:01.062 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.062 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:29:01.063 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "1030fedf-adad-4e79-b839-59385d4d7d2a", 2020-05-18T21:29:01.063 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:29:01.063 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:29:01.063 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:29:01.063 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:29:01.063 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:29:01.064 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:29:01.064 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:29:01.064 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 46, 2020-05-18T21:29:01.064 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:29:01.064 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:29:01.065 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:29:01.065 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.066 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.066 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6814", 2020-05-18T21:29:01.067 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:29:01.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.067 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.067 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6816", 2020-05-18T21:29:01.068 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:29:01.068 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.068 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.068 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:29:01.069 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.069 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.069 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6818", 2020-05-18T21:29:01.069 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:29:01.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.070 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.070 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6819", 2020-05-18T21:29:01.070 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:29:01.071 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.071 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.071 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:29:01.071 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.072 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.072 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6823", 2020-05-18T21:29:01.072 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:29:01.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.073 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.073 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6825", 2020-05-18T21:29:01.073 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:29:01.073 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.074 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.074 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:29:01.074 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.074 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.075 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6820", 2020-05-18T21:29:01.075 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:29:01.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.075 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.076 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6821", 2020-05-18T21:29:01.076 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:29:01.076 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.076 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.076 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6816/12805", 2020-05-18T21:29:01.077 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6819/12805", 2020-05-18T21:29:01.077 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6825/12805", 2020-05-18T21:29:01.077 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6821/12805", 2020-05-18T21:29:01.077 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:29:01.077 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:29:01.078 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:29:01.078 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.078 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:29:01.079 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "8ad15a9b-97b4-4002-b1d4-7292e09b4ef6", 2020-05-18T21:29:01.079 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:29:01.079 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:29:01.079 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:29:01.079 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:29:01.080 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:29:01.080 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:29:01.080 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:29:01.080 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 47, 2020-05-18T21:29:01.080 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:29:01.080 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:29:01.081 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:29:01.081 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.081 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.081 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6800", 2020-05-18T21:29:01.082 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:29:01.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.082 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.082 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6801", 2020-05-18T21:29:01.082 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:29:01.083 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.083 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.083 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:29:01.083 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.084 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.084 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6802", 2020-05-18T21:29:01.084 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:29:01.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.085 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.085 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6803", 2020-05-18T21:29:01.085 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:29:01.085 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.086 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.086 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:29:01.086 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.087 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.087 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6806", 2020-05-18T21:29:01.087 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:29:01.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.088 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.088 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6807", 2020-05-18T21:29:01.088 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:29:01.088 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.088 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.089 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:29:01.089 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.089 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.090 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6804", 2020-05-18T21:29:01.090 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:29:01.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.090 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.090 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6805", 2020-05-18T21:29:01.091 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:29:01.091 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.091 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.091 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6801/13023", 2020-05-18T21:29:01.092 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6803/13023", 2020-05-18T21:29:01.092 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6807/13023", 2020-05-18T21:29:01.092 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6805/13023", 2020-05-18T21:29:01.092 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:29:01.092 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:29:01.092 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:29:01.093 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.093 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:29:01.093 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0dce88f8-b984-43e1-95e2-4132171102d2", 2020-05-18T21:29:01.094 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:29:01.094 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:29:01.094 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:29:01.094 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:29:01.094 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:29:01.095 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:29:01.095 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:29:01.095 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 47, 2020-05-18T21:29:01.095 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:29:01.095 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:29:01.095 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:29:01.096 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.096 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.096 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6808", 2020-05-18T21:29:01.096 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:29:01.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.097 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.097 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6809", 2020-05-18T21:29:01.097 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:29:01.097 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.098 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.098 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:29:01.098 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.099 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.099 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6810", 2020-05-18T21:29:01.099 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:29:01.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.099 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.100 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6811", 2020-05-18T21:29:01.100 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:29:01.100 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.100 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.101 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:29:01.101 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.101 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.101 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6814", 2020-05-18T21:29:01.102 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:29:01.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.102 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.102 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6816", 2020-05-18T21:29:01.102 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:29:01.103 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.103 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.103 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:29:01.103 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.104 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.104 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6812", 2020-05-18T21:29:01.104 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:29:01.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.105 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.105 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6813", 2020-05-18T21:29:01.105 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:29:01.105 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.105 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.106 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6809/13024", 2020-05-18T21:29:01.106 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6811/13024", 2020-05-18T21:29:01.106 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6816/13024", 2020-05-18T21:29:01.106 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6813/13024", 2020-05-18T21:29:01.107 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:29:01.107 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:29:01.107 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:29:01.107 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.108 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:29:01.108 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "e1bc92f8-3692-4483-b0fb-905c94fa1469", 2020-05-18T21:29:01.108 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:29:01.108 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:29:01.108 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:29:01.109 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:29:01.109 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:29:01.109 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:29:01.109 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:29:01.109 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 49, 2020-05-18T21:29:01.110 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:29:01.110 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:29:01.110 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:29:01.110 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.110 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.111 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6815", 2020-05-18T21:29:01.111 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:29:01.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.111 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.112 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6817", 2020-05-18T21:29:01.112 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:29:01.112 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.112 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.113 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:29:01.113 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.113 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.113 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6818", 2020-05-18T21:29:01.113 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:29:01.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.114 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.114 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6819", 2020-05-18T21:29:01.114 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:29:01.115 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.115 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.115 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:29:01.115 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.116 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.116 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6822", 2020-05-18T21:29:01.116 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:29:01.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.117 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.117 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6824", 2020-05-18T21:29:01.117 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:29:01.117 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.117 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:29:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6820", 2020-05-18T21:29:01.119 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:29:01.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.119 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.119 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6821", 2020-05-18T21:29:01.120 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:29:01.120 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.120 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.120 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6817/13025", 2020-05-18T21:29:01.120 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6819/13025", 2020-05-18T21:29:01.121 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6824/13025", 2020-05-18T21:29:01.121 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6821/13025", 2020-05-18T21:29:01.121 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:29:01.121 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:29:01.121 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:29:01.122 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.122 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:29:01.122 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "b76e000c-a078-48c4-9e1e-34d286a9992c", 2020-05-18T21:29:01.123 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:29:01.123 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:29:01.123 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:29:01.123 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:29:01.123 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:29:01.123 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:29:01.124 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:29:01.124 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 46, 2020-05-18T21:29:01.124 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:29:01.124 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:29:01.124 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:29:01.125 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.125 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.125 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6823", 2020-05-18T21:29:01.126 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:29:01.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.126 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.126 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6825", 2020-05-18T21:29:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:29:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:29:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6826", 2020-05-18T21:29:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:29:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.129 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.129 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6827", 2020-05-18T21:29:01.129 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:29:01.129 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:29:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.131 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6830", 2020-05-18T21:29:01.131 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:29:01.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.131 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.132 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6831", 2020-05-18T21:29:01.132 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:29:01.132 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.132 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.133 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:29:01.133 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:01.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.133 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:01.133 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6828", 2020-05-18T21:29:01.134 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:29:01.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.134 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:01.135 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6829", 2020-05-18T21:29:01.135 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:29:01.135 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.135 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.136 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6825/13026", 2020-05-18T21:29:01.136 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6827/13026", 2020-05-18T21:29:01.136 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6831/13026", 2020-05-18T21:29:01.136 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6829/13026", 2020-05-18T21:29:01.136 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:29:01.136 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:29:01.137 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:29:01.137 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:01.137 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.137 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:29:01.137 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2020-05-18T21:29:01.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.138 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:29:01.138 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:29:01.138 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:29:01.138 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:29:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:29:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:29:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.281434+0000", 2020-05-18T21:29:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:29:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.140 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:29:01.140 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:29:01.140 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:29:01.140 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:29:01.140 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:29:01.141 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:29:01.141 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.608518+0000", 2020-05-18T21:29:01.141 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:29:01.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.142 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:29:01.142 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:29:01.142 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:29:01.142 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:29:01.142 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:29:01.142 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:29:01.143 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.582386+0000", 2020-05-18T21:29:01.143 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:29:01.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.143 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:29:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:29:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:29:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:29:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:29:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:29:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.573488+0000", 2020-05-18T21:29:01.145 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:29:01.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.145 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:29:01.145 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:29:01.146 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:29:01.146 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:29:01.146 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:29:01.146 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:29:01.146 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.604174+0000", 2020-05-18T21:29:01.147 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:29:01.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.147 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:29:01.147 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:29:01.147 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:29:01.148 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:29:01.148 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:29:01.148 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:29:01.148 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.371004+0000", 2020-05-18T21:29:01.148 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:29:01.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.149 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:29:01.149 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:29:01.149 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:29:01.149 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:29:01.150 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:29:01.150 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:29:01.150 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.593070+0000", 2020-05-18T21:29:01.150 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:29:01.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:01.151 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:29:01.151 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:29:01.151 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:29:01.151 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:29:01.152 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:29:01.152 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:29:01.152 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.667677+0000", 2020-05-18T21:29:01.152 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:29:01.152 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.152 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:29:01.153 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2020-05-18T21:29:01.153 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2020-05-18T21:29:01.153 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2020-05-18T21:29:01.153 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2020-05-18T21:29:01.153 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklist": {}, 2020-05-18T21:29:01.154 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2020-05-18T21:29:01.154 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2020-05-18T21:29:01.154 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2020-05-18T21:29:01.154 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2020-05-18T21:29:01.154 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2020-05-18T21:29:01.154 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2020-05-18T21:29:01.155 INFO:teuthology.orchestra.run.smithi063.stdout: "ruleset-failure-domain": "osd", 2020-05-18T21:29:01.155 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2020-05-18T21:29:01.155 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:01.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:01.155 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2020-05-18T21:29:01.156 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2020-05-18T21:29:01.156 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2020-05-18T21:29:01.156 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2020-05-18T21:29:01.156 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {} 2020-05-18T21:29:01.156 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:29:01.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.921+0000 7f45419cd700 1 -- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f451804fea0 msgr2=0x7f4518052360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:01.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.921+0000 7f45419cd700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f451804fea0 0x7f4518052360 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7f452c002f70 tx=0x7f452c0093f0).stop 2020-05-18T21:29:01.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.921+0000 7f45419cd700 1 -- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f453c0b2860 msgr2=0x7f453c147f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:01.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.921+0000 7f45419cd700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f453c0b2860 0x7f453c147f20 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f453c0b92c0 tx=0x7f4530010920).stop 2020-05-18T21:29:01.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.921+0000 7f45419cd700 1 -- 172.21.15.63:0/412704253 shutdown_connections 2020-05-18T21:29:01.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.921+0000 7f45419cd700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f451804fea0 0x7f4518052360 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:01.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.921+0000 7f45419cd700 1 --2- 172.21.15.63:0/412704253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f453c0b2860 0x7f453c147f20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:01.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.921+0000 7f45419cd700 1 -- 172.21.15.63:0/412704253 >> 172.21.15.63:0/412704253 conn(0x7f453c0b83d0 msgr2=0x7f453c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:01.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.921+0000 7f45419cd700 1 -- 172.21.15.63:0/412704253 shutdown_connections 2020-05-18T21:29:01.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:00.921+0000 7f45419cd700 1 -- 172.21.15.63:0/412704253 wait complete. 2020-05-18T21:29:01.161 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:01.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.269+0000 7fd6b9f01700 1 Processor -- start 2020-05-18T21:29:01.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.269+0000 7fd6b9f01700 1 -- start start 2020-05-18T21:29:01.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.269+0000 7fd6b9f01700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd6b40b6e80 0x7fd6b414e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:01.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.269+0000 7fd6b9f01700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b414d6e0 con 0x7fd6b40628e0 2020-05-18T21:29:01.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.269+0000 7fd6b9f01700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b414d980 con 0x7fd6b40b7260 2020-05-18T21:29:01.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.269+0000 7fd6b9f01700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b414dc20 con 0x7fd6b40b6e80 2020-05-18T21:29:01.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b9700700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd6b40628e0 0x7fd6b4062d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58124/0 (socket says 172.21.15.63:58124) 2020-05-18T21:29:01.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b8eff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd6b40b6e80 0x7fd6b414e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:01.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b9700700 1 -- 172.21.15.63:0/3118887050 learned_addr learned my addr 172.21.15.63:0/3118887050 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:01.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b37fe700 1 -- 172.21.15.63:0/3118887050 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346495905 0 0) 0x7fd6b414d6e0 con 0x7fd6b40628e0 2020-05-18T21:29:01.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b37fe700 1 -- 172.21.15.63:0/3118887050 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd694003270 con 0x7fd6b40628e0 2020-05-18T21:29:01.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b8eff700 1 -- 172.21.15.63:0/3118887050 >> v1:172.21.15.155:6789/0 conn(0x7fd6b40b7260 legacy=0x7fd6b414ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:01.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b8eff700 1 -- 172.21.15.63:0/3118887050 >> v1:172.21.15.63:6789/0 conn(0x7fd6b40628e0 legacy=0x7fd6b4062d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:01.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b8eff700 1 -- 172.21.15.63:0/3118887050 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b414dec0 con 0x7fd6b40b6e80 2020-05-18T21:29:01.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b8eff700 1 --2- 172.21.15.63:0/3118887050 >> v2:172.21.15.155:3300/0 conn(0x7fd6b40b6e80 0x7fd6b414e360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd6a4002f70 tx=0x7fd6b4066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b8eff700 1 --2- 172.21.15.63:0/3118887050 >> v2:172.21.15.155:3300/0 conn(0x7fd6b40b6e80 0x7fd6b414e360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd6a4002f70 tx=0x7fd6b4066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b8eff700 1 --2- 172.21.15.63:0/3118887050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6b40b6e80 0x7fd6b414e360 secure :-1 s=READY pgs=467 cs=0 l=1 rx=0x7fd6a4002f70 tx=0x7fd6b4066620).ready entity=mon.1 client_cookie=f6cd8157809af916 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:01.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b8eff700 1 --2- 172.21.15.63:0/3118887050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6b40b6e80 0x7fd6b414e360 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7fd6a4002f70 tx=0x7fd6b4066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b37fe700 1 -- 172.21.15.63:0/3118887050 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a4008e10 con 0x7fd6b40b6e80 2020-05-18T21:29:01.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b8eff700 1 --2- 172.21.15.63:0/3118887050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6b40b6e80 0x7fd6b414e360 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7fd6a4002f70 tx=0x7fd6b4066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b37fe700 1 -- 172.21.15.63:0/3118887050 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a4011790 con 0x7fd6b40b6e80 2020-05-18T21:29:01.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b8eff700 1 --2- 172.21.15.63:0/3118887050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6b40b6e80 0x7fd6b414e360 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7fd6a4002f70 tx=0x7fd6b4066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b9f01700 1 -- 172.21.15.63:0/3118887050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6b40b6e80 msgr2=0x7fd6b414e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:01.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b37fe700 1 -- 172.21.15.63:0/3118887050 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a4011b30 con 0x7fd6b40b6e80 2020-05-18T21:29:01.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b9f01700 1 --2- 172.21.15.63:0/3118887050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6b40b6e80 0x7fd6b414e360 secure :-1 s=READY pgs=467 cs=0 l=1 rx=0x7fd6a4002f70 tx=0x7fd6b4066620).stop 2020-05-18T21:29:01.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b9f01700 1 -- 172.21.15.63:0/3118887050 shutdown_connections 2020-05-18T21:29:01.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b9f01700 1 --2- 172.21.15.63:0/3118887050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6b40b6e80 0x7fd6b414e360 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:01.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b9f01700 1 -- 172.21.15.63:0/3118887050 >> 172.21.15.63:0/3118887050 conn(0x7fd6b405eee0 msgr2=0x7fd6b405f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:01.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b9f01700 1 -- 172.21.15.63:0/3118887050 shutdown_connections 2020-05-18T21:29:01.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.273+0000 7fd6b9f01700 1 -- 172.21.15.63:0/3118887050 wait complete. 2020-05-18T21:29:01.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b9f01700 1 Processor -- start 2020-05-18T21:29:01.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b9f01700 1 -- start start 2020-05-18T21:29:01.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b9f01700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b40b6e80 0x7fd6b40ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:01.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b9f01700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd6b40b7260 0x7fd6b4149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:01.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b9f01700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b414a230 con 0x7fd6b40628e0 2020-05-18T21:29:01.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b9f01700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b4149cf0 con 0x7fd6b40b7260 2020-05-18T21:29:01.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b9f01700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b4149f90 con 0x7fd6b40b6e80 2020-05-18T21:29:01.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b8eff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd6b40628e0 0x7fd6b40acc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58126/0 (socket says 172.21.15.63:58126) 2020-05-18T21:29:01.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b8eff700 1 -- 172.21.15.63:0/82357592 learned_addr learned my addr 172.21.15.63:0/82357592 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:01.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b9700700 1 --2- 172.21.15.63:0/82357592 >> v2:172.21.15.155:3300/0 conn(0x7fd6b40b7260 0x7fd6b4149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:01.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b3fff700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b40b6e80 0x7fd6b40ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:01.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b1ffb700 1 -- 172.21.15.63:0/82357592 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318294477 0 0) 0x7fd6b414a230 con 0x7fd6b40628e0 2020-05-18T21:29:01.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b1ffb700 1 -- 172.21.15.63:0/82357592 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd698002fe0 con 0x7fd6b40628e0 2020-05-18T21:29:01.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b1ffb700 1 -- 172.21.15.63:0/82357592 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1367772430 0 0) 0x7fd698002fe0 con 0x7fd6b40628e0 2020-05-18T21:29:01.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b1ffb700 1 -- 172.21.15.63:0/82357592 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd6b414a230 con 0x7fd6b40628e0 2020-05-18T21:29:01.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b1ffb700 1 -- 172.21.15.63:0/82357592 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fd6a40086f0 con 0x7fd6b40628e0 2020-05-18T21:29:01.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b1ffb700 1 -- 172.21.15.63:0/82357592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b40b6e80 msgr2=0x7fd6b40ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:01.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b1ffb700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b40b6e80 0x7fd6b40ac4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:01.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b1ffb700 1 -- 172.21.15.63:0/82357592 >> v2:172.21.15.155:3300/0 conn(0x7fd6b40b7260 msgr2=0x7fd6b4149460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:01.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b1ffb700 1 --2- 172.21.15.63:0/82357592 >> v2:172.21.15.155:3300/0 conn(0x7fd6b40b7260 0x7fd6b4149460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:01.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b1ffb700 1 -- 172.21.15.63:0/82357592 >> v1:172.21.15.63:6789/0 conn(0x7fd6b40628e0 legacy=0x7fd6b40acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:01.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b1ffb700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd698004a80 0x7fd698004e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:01.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b1ffb700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b40b6e80 0x7fd6980039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:01.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b1ffb700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd698003e00 0x7fd698004280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:01.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b1ffb700 1 -- 172.21.15.63:0/82357592 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b4149cf0 con 0x7fd698004a80 2020-05-18T21:29:01.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b1ffb700 1 -- 172.21.15.63:0/82357592 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b4149f90 con 0x7fd698003e00 2020-05-18T21:29:01.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b1ffb700 1 -- 172.21.15.63:0/82357592 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd698004820 con 0x7fd6b40b6e80 2020-05-18T21:29:01.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b8eff700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd698004a80 0x7fd698004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:01.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b3fff700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b40b6e80 0x7fd6980039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:01.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b9700700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd698003e00 0x7fd698004280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:01.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b8eff700 1 -- 172.21.15.63:0/82357592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b40b6e80 msgr2=0x7fd6980039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:01.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b8eff700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b40b6e80 0x7fd6980039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:01.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b8eff700 1 -- 172.21.15.63:0/82357592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd698003e00 msgr2=0x7fd698004280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:01.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b8eff700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd698003e00 0x7fd698004280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:01.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b8eff700 1 -- 172.21.15.63:0/82357592 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b414bde0 con 0x7fd698004a80 2020-05-18T21:29:01.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b9f01700 1 -- 172.21.15.63:0/82357592 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b414c030 con 0x7fd698004a80 2020-05-18T21:29:01.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b8eff700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd698004a80 0x7fd698004e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6a4010190 tx=0x7fd6b4066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b9f01700 1 -- 172.21.15.63:0/82357592 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b40ac670 con 0x7fd698004a80 2020-05-18T21:29:01.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b8eff700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd698004a80 0x7fd698004e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6a4010190 tx=0x7fd6b4066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.277+0000 7fd6b8eff700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd698004a80 0x7fd698004e80 secure :-1 s=READY pgs=653 cs=0 l=1 rx=0x7fd6a4010190 tx=0x7fd6b4066620).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:01.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.281+0000 7fd6b8eff700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd698004a80 0x7fd698004e80 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7fd6a4010190 tx=0x7fd6b4066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.281+0000 7fd6b1ffb700 1 -- 172.21.15.63:0/82357592 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a4007c10 con 0x7fd698004a80 2020-05-18T21:29:01.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.281+0000 7fd6b8eff700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd698004a80 0x7fd698004e80 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7fd6a4010190 tx=0x7fd6b4066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.281+0000 7fd6b1ffb700 1 -- 172.21.15.63:0/82357592 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a4007170 con 0x7fd698004a80 2020-05-18T21:29:01.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.281+0000 7fd6b8eff700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd698004a80 0x7fd698004e80 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7fd6a4010190 tx=0x7fd6b4066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.281+0000 7fd6b1ffb700 1 -- 172.21.15.63:0/82357592 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a4007510 con 0x7fd698004a80 2020-05-18T21:29:01.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.281+0000 7fd6b9f01700 1 -- 172.21.15.63:0/82357592 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68c003380 con 0x7fd698004a80 2020-05-18T21:29:01.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.281+0000 7fd6b8eff700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd698004a80 0x7fd698004e80 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7fd6a4010190 tx=0x7fd6b4066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.281+0000 7fd6b1ffb700 1 -- 172.21.15.63:0/82357592 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd6a4005700 con 0x7fd698004a80 2020-05-18T21:29:01.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.281+0000 7fd6b8eff700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd698004a80 0x7fd698004e80 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7fd6a4010190 tx=0x7fd6b4066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.281+0000 7fd6b1ffb700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd698057a90 0x7fd698059f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:01.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.281+0000 7fd6b1ffb700 1 -- 172.21.15.63:0/82357592 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd6a4064ad0 con 0x7fd698004a80 2020-05-18T21:29:01.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.281+0000 7fd6b3fff700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd698057a90 0x7fd698059f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:01.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.281+0000 7fd6b3fff700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd698057a90 0x7fd698059f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6b40b7950 tx=0x7fd69c003ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.285+0000 7fd6b3fff700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd698057a90 0x7fd698059f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6b40b7950 tx=0x7fd69c003ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.285+0000 7fd6b3fff700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd698057a90 0x7fd698059f50 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7fd6b40b7950 tx=0x7fd69c003ea0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:01.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.289+0000 7fd6b8eff700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd698004a80 0x7fd698004e80 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7fd6a4010190 tx=0x7fd6b4066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.289+0000 7fd6b1ffb700 1 -- 172.21.15.63:0/82357592 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd6a403ef80 con 0x7fd698004a80 2020-05-18T21:29:01.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.437+0000 7fd6b9f01700 1 -- 172.21.15.63:0/82357592 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd68c003720 con 0x7fd698004a80 2020-05-18T21:29:01.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.437+0000 7fd6b8eff700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd698004a80 0x7fd698004e80 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7fd6a4010190 tx=0x7fd6b4066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.437+0000 7fd6b1ffb700 1 -- 172.21.15.63:0/82357592 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+2142 (secure 0 0 0) 0x7fd6a40425a0 con 0x7fd698004a80 2020-05-18T21:29:01.445 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:01.445 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":22,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/2663525728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2663525728},{"type":"v1","addr":"172.21.15.63:6833","nonce":2663525728}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:28:48.505607+0000","modified":"2020-05-18T21:28:50.219314+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5850},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5850":{"gid":5850,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1866128236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1866128236},{"type":"v1","addr":"172.21.15.155:6835","nonce":1866128236}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-05-18T21:29:01.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.441+0000 7fd6b9f01700 1 -- 172.21.15.63:0/82357592 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd698057a90 msgr2=0x7fd698059f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:01.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.441+0000 7fd6b9f01700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd698057a90 0x7fd698059f50 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7fd6b40b7950 tx=0x7fd69c003ea0).stop 2020-05-18T21:29:01.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.441+0000 7fd6b9f01700 1 -- 172.21.15.63:0/82357592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd698004a80 msgr2=0x7fd698004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:01.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.441+0000 7fd6b9f01700 1 --2- 172.21.15.63:0/82357592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd698004a80 0x7fd698004e80 secure :-1 s=READY pgs=653 cs=0 l=1 rx=0x7fd6a4010190 tx=0x7fd6b4066620).stop 2020-05-18T21:29:01.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.441+0000 7fd6b9700700 1 -- 172.21.15.63:0/82357592 reap_dead start 2020-05-18T21:29:01.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.441+0000 7fd6b9700700 1 -- 172.21.15.63:0/82357592 reap_dead start 2020-05-18T21:29:01.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.441+0000 7fd6b9f01700 1 -- 172.21.15.63:0/82357592 shutdown_connections 2020-05-18T21:29:01.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.441+0000 7fd6b9f01700 1 -- 172.21.15.63:0/82357592 >> 172.21.15.63:0/82357592 conn(0x7fd6b405eee0 msgr2=0x7fd6b40b59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:01.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.441+0000 7fd6b9f01700 1 -- 172.21.15.63:0/82357592 shutdown_connections 2020-05-18T21:29:01.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.441+0000 7fd6b9f01700 1 -- 172.21.15.63:0/82357592 wait complete. 2020-05-18T21:29:01.449 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 22 2020-05-18T21:29:01.457 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-05-18T21:29:01.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc05317b700 1 Processor -- start 2020-05-18T21:29:01.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc05317b700 1 -- start start 2020-05-18T21:29:01.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc05317b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc04c0b2310 0x7fc04c14e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:01.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc05317b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04c14e660 con 0x7fc04c065a10 2020-05-18T21:29:01.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc05317b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04c14b0d0 con 0x7fc04c0b89a0 2020-05-18T21:29:01.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc05317b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04c0b4bd0 con 0x7fc04c0b2310 2020-05-18T21:29:01.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc051978700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc04c065a10 0x7fc04c14a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58140/0 (socket says 172.21.15.63:58140) 2020-05-18T21:29:01.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc051978700 1 -- 172.21.15.63:0/485993872 learned_addr learned my addr 172.21.15.63:0/485993872 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:01.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc052179700 1 --2- 172.21.15.63:0/485993872 >> v2:172.21.15.155:3300/0 conn(0x7fc04c0b2310 0x7fc04c14e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:01.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc051177700 1 -- 172.21.15.63:0/485993872 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924585240 0 0) 0x7fc04c14e660 con 0x7fc04c065a10 2020-05-18T21:29:01.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc051177700 1 -- 172.21.15.63:0/485993872 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc034003270 con 0x7fc04c065a10 2020-05-18T21:29:01.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc051177700 1 -- 172.21.15.63:0/485993872 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1916948593 0 0) 0x7fc034003270 con 0x7fc04c065a10 2020-05-18T21:29:01.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc051177700 1 -- 172.21.15.63:0/485993872 >> v2:172.21.15.155:3300/0 conn(0x7fc04c0b2310 msgr2=0x7fc04c14e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:01.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc051177700 1 --2- 172.21.15.63:0/485993872 >> v2:172.21.15.155:3300/0 conn(0x7fc04c0b2310 0x7fc04c14e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:01.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc051177700 1 -- 172.21.15.63:0/485993872 >> v1:172.21.15.155:6789/0 conn(0x7fc04c0b89a0 legacy=0x7fc04c0ae7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:01.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc051177700 1 -- 172.21.15.63:0/485993872 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c14a280 con 0x7fc04c065a10 2020-05-18T21:29:01.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc051177700 1 -- 172.21.15.63:0/485993872 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fc040001a90 con 0x7fc04c065a10 2020-05-18T21:29:01.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc051177700 1 -- 172.21.15.63:0/485993872 >> v1:172.21.15.63:6789/0 conn(0x7fc04c065a10 legacy=0x7fc04c14a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:01.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc051177700 1 --2- 172.21.15.63:0/485993872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034003760 0x7fc034003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:01.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc051177700 1 --2- 172.21.15.63:0/485993872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc034004510 0x7fc034004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:01.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc051177700 1 --2- 172.21.15.63:0/485993872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc034004df0 0x7fc03400b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:01.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc051177700 1 -- 172.21.15.63:0/485993872 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c0b4bd0 con 0x7fc034004510 2020-05-18T21:29:01.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc051177700 1 -- 172.21.15.63:0/485993872 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc034004200 con 0x7fc034004df0 2020-05-18T21:29:01.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc051177700 1 -- 172.21.15.63:0/485993872 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03400bbc0 con 0x7fc034003760 2020-05-18T21:29:01.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.561+0000 7fc051978700 1 --2- 172.21.15.63:0/485993872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc034004510 0x7fc034004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:01.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc052179700 1 --2- 172.21.15.63:0/485993872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034003760 0x7fc034003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:01.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc05297a700 1 --2- 172.21.15.63:0/485993872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc034004df0 0x7fc03400b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:01.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc051978700 1 -- 172.21.15.63:0/485993872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034003760 msgr2=0x7fc034003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:01.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc051978700 1 --2- 172.21.15.63:0/485993872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034003760 0x7fc034003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:01.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc051978700 1 -- 172.21.15.63:0/485993872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc034004df0 msgr2=0x7fc03400b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:01.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc051978700 1 --2- 172.21.15.63:0/485993872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc034004df0 0x7fc03400b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:01.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc051978700 1 -- 172.21.15.63:0/485993872 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc034003270 con 0x7fc034004510 2020-05-18T21:29:01.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc05297a700 1 -- 172.21.15.63:0/485993872 reap_dead start 2020-05-18T21:29:01.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc052179700 1 --2- 172.21.15.63:0/485993872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034003760 0x7fc034003b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:29:01.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc051978700 1 --2- 172.21.15.63:0/485993872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc034004510 0x7fc034004990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc0400017a0 tx=0x7fc04000c6d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc051978700 1 --2- 172.21.15.63:0/485993872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc034004510 0x7fc034004990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc0400017a0 tx=0x7fc04000c6d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc051978700 1 --2- 172.21.15.63:0/485993872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc034004510 0x7fc034004990 secure :-1 s=READY pgs=655 cs=0 l=1 rx=0x7fc0400017a0 tx=0x7fc04000c6d0).ready entity=mon.0 client_cookie=befced17a272a209 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:01.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc051978700 1 --2- 172.21.15.63:0/485993872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc034004510 0x7fc034004990 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7fc0400017a0 tx=0x7fc04000c6d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc051177700 1 -- 172.21.15.63:0/485993872 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc040005d80 con 0x7fc034004510 2020-05-18T21:29:01.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc051978700 1 --2- 172.21.15.63:0/485993872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc034004510 0x7fc034004990 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7fc0400017a0 tx=0x7fc04000c6d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc051978700 1 --2- 172.21.15.63:0/485993872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc034004510 0x7fc034004990 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7fc0400017a0 tx=0x7fc04000c6d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc051177700 1 -- 172.21.15.63:0/485993872 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04000e180 con 0x7fc034004510 2020-05-18T21:29:01.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc051177700 1 -- 172.21.15.63:0/485993872 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc04000e520 con 0x7fc034004510 2020-05-18T21:29:01.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc05317b700 1 -- 172.21.15.63:0/485993872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc034004510 msgr2=0x7fc034004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:01.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc05317b700 1 --2- 172.21.15.63:0/485993872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc034004510 0x7fc034004990 secure :-1 s=READY pgs=655 cs=0 l=1 rx=0x7fc0400017a0 tx=0x7fc04000c6d0).stop 2020-05-18T21:29:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc05317b700 1 -- 172.21.15.63:0/485993872 shutdown_connections 2020-05-18T21:29:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc05317b700 1 --2- 172.21.15.63:0/485993872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc034004510 0x7fc034004990 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc05317b700 1 -- 172.21.15.63:0/485993872 >> 172.21.15.63:0/485993872 conn(0x7fc04c05fb50 msgr2=0x7fc04c0b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc05317b700 1 -- 172.21.15.63:0/485993872 shutdown_connections 2020-05-18T21:29:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc05317b700 1 -- 172.21.15.63:0/485993872 wait complete. 2020-05-18T21:29:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc05317b700 1 Processor -- start 2020-05-18T21:29:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.565+0000 7fc05317b700 1 -- start start 2020-05-18T21:29:01.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc05317b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034004510 0x7fc04c060670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:01.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc05317b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc04c157650 0x7fc04c065110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:01.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc05317b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04c1484c0 con 0x7fc04c147090 2020-05-18T21:29:01.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc05317b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04c0b0710 con 0x7fc04c157650 2020-05-18T21:29:01.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc05317b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c144ef0 con 0x7fc034004510 2020-05-18T21:29:01.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc05297a700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fc04c147090 0x7fc04c15ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:56470/0 (socket says 172.21.15.63:56470) 2020-05-18T21:29:01.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc052179700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034004510 0x7fc04c060670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:01.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc05297a700 1 -- 172.21.15.63:0/3133919797 learned_addr learned my addr 172.21.15.63:0/3133919797 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:01.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc051978700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc04c157650 0x7fc04c065110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:01.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc03f7fe700 1 -- 172.21.15.63:0/3133919797 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920069403 0 0) 0x7fc04c1484c0 con 0x7fc04c147090 2020-05-18T21:29:01.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc03f7fe700 1 -- 172.21.15.63:0/3133919797 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc02c002fe0 con 0x7fc04c147090 2020-05-18T21:29:01.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc052179700 1 -- 172.21.15.63:0/3133919797 >> v2:172.21.15.155:3300/0 conn(0x7fc04c157650 msgr2=0x7fc04c065110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:01.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc052179700 1 --2- 172.21.15.63:0/3133919797 >> v2:172.21.15.155:3300/0 conn(0x7fc04c157650 0x7fc04c065110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:01.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc052179700 1 -- 172.21.15.63:0/3133919797 >> v1:172.21.15.155:6789/0 conn(0x7fc04c147090 legacy=0x7fc04c15ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:01.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc052179700 1 -- 172.21.15.63:0/3133919797 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c065570 con 0x7fc034004510 2020-05-18T21:29:01.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc051978700 1 --2- 172.21.15.63:0/3133919797 >> v2:172.21.15.155:3300/0 conn(0x7fc04c157650 0x7fc04c065110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:29:01.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc052179700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034004510 0x7fc04c060670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc048002f70 tx=0x7fc04c05e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc052179700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034004510 0x7fc04c060670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc048002f70 tx=0x7fc04c05e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc052179700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034004510 0x7fc04c060670 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fc048002f70 tx=0x7fc04c05e150).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:01.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc052179700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034004510 0x7fc04c060670 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fc048002f70 tx=0x7fc04c05e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc03f7fe700 1 -- 172.21.15.63:0/3133919797 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc048012b30 con 0x7fc034004510 2020-05-18T21:29:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc05317b700 1 -- 172.21.15.63:0/3133919797 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04c060c60 con 0x7fc034004510 2020-05-18T21:29:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc052179700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034004510 0x7fc04c060670 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fc048002f70 tx=0x7fc04c05e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc03f7fe700 1 -- 172.21.15.63:0/3133919797 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc048012cd0 con 0x7fc034004510 2020-05-18T21:29:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc052179700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034004510 0x7fc04c060670 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fc048002f70 tx=0x7fc04c05e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc03f7fe700 1 -- 172.21.15.63:0/3133919797 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc048012e40 con 0x7fc034004510 2020-05-18T21:29:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.569+0000 7fc05317b700 1 -- 172.21.15.63:0/3133919797 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04c0611a0 con 0x7fc034004510 2020-05-18T21:29:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.573+0000 7fc05317b700 1 -- 172.21.15.63:0/3133919797 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04c0569e0 con 0x7fc034004510 2020-05-18T21:29:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.573+0000 7fc052179700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034004510 0x7fc04c060670 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fc048002f70 tx=0x7fc04c05e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.573+0000 7fc03f7fe700 1 -- 172.21.15.63:0/3133919797 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc048007160 con 0x7fc034004510 2020-05-18T21:29:01.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.573+0000 7fc052179700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034004510 0x7fc04c060670 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fc048002f70 tx=0x7fc04c05e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.573+0000 7fc03f7fe700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc02c04fcf0 0x7fc02c0521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:01.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.573+0000 7fc03f7fe700 1 -- 172.21.15.63:0/3133919797 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc048064030 con 0x7fc034004510 2020-05-18T21:29:01.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.573+0000 7fc051978700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc02c04fcf0 0x7fc02c0521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:01.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.573+0000 7fc051978700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc02c04fcf0 0x7fc02c0521b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc0400017a0 tx=0x7fc04000c6d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.573+0000 7fc051978700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc02c04fcf0 0x7fc02c0521b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc0400017a0 tx=0x7fc04000c6d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.573+0000 7fc051978700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc02c04fcf0 0x7fc02c0521b0 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7fc0400017a0 tx=0x7fc04000c6d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:01.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.581+0000 7fc052179700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034004510 0x7fc04c060670 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fc048002f70 tx=0x7fc04c05e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.581+0000 7fc03f7fe700 1 -- 172.21.15.63:0/3133919797 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc04803e3c0 con 0x7fc034004510 2020-05-18T21:29:01.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:01.737+0000 7fc05317b700 1 -- 172.21.15.63:0/3133919797 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc04c060ad0 con 0x7fc034004510 2020-05-18T21:29:02.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.569+0000 7fc052179700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034004510 0x7fc04c060670 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fc048002f70 tx=0x7fc04c05e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:02.622 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:29:02.617+0000 7fdb4592c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:29:02.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.633+0000 7fc052179700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034004510 0x7fc04c060670 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fc048002f70 tx=0x7fc04c05e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:02.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.633+0000 7fc03f7fe700 1 -- 172.21.15.63:0/3133919797 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc0480419e0 con 0x7fc034004510 2020-05-18T21:29:02.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.637+0000 7fc05317b700 1 -- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc02c04fcf0 msgr2=0x7fc02c0521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:02.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.637+0000 7fc05317b700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc02c04fcf0 0x7fc02c0521b0 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7fc0400017a0 tx=0x7fc04000c6d0).stop 2020-05-18T21:29:02.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.637+0000 7fc05317b700 1 -- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034004510 msgr2=0x7fc04c060670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:02.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.637+0000 7fc05317b700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034004510 0x7fc04c060670 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fc048002f70 tx=0x7fc04c05e150).stop 2020-05-18T21:29:02.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.637+0000 7fc05317b700 1 -- 172.21.15.63:0/3133919797 shutdown_connections 2020-05-18T21:29:02.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.637+0000 7fc05317b700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc02c04fcf0 0x7fc02c0521b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:02.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.637+0000 7fc05317b700 1 --2- 172.21.15.63:0/3133919797 >> v2:172.21.15.155:3300/0 conn(0x7fc04c157650 0x7fc04c065110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:02.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.637+0000 7fc05317b700 1 --2- 172.21.15.63:0/3133919797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc034004510 0x7fc04c060670 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:02.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.637+0000 7fc05317b700 1 -- 172.21.15.63:0/3133919797 >> 172.21.15.63:0/3133919797 conn(0x7fc04c05fb50 msgr2=0x7fc04c05c160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:02.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.637+0000 7fc05317b700 1 -- 172.21.15.63:0/3133919797 shutdown_connections 2020-05-18T21:29:02.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.637+0000 7fc05317b700 1 -- 172.21.15.63:0/3133919797 wait complete. 2020-05-18T21:29:02.646 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-05-18T21:29:02.660 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:02.666 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:29:02.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.765+0000 7f4bf786a700 1 Processor -- start 2020-05-18T21:29:02.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.765+0000 7f4bf786a700 1 -- start start 2020-05-18T21:29:02.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.765+0000 7f4bf786a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4bf00b7cc0 0x7f4bf006a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:02.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.765+0000 7f4bf786a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4bf0145e60 0x7f4bf0149670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:02.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.765+0000 7f4bf786a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf00b8160 con 0x7f4bf0146be0 2020-05-18T21:29:02.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.765+0000 7f4bf786a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf0061c00 con 0x7f4bf00b7cc0 2020-05-18T21:29:02.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.765+0000 7f4bf786a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf0061ea0 con 0x7f4bf0145e60 2020-05-18T21:29:02.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.765+0000 7f4bf4e05700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4bf00b7cc0 0x7f4bf006a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:02.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.765+0000 7f4bf5606700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4bf0146be0 0x7f4bf00b5630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58158/0 (socket says 172.21.15.63:58158) 2020-05-18T21:29:02.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.765+0000 7f4bf5606700 1 -- 172.21.15.63:0/2698824005 learned_addr learned my addr 172.21.15.63:0/2698824005 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:02.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.765+0000 7f4bf5e07700 1 --2- 172.21.15.63:0/2698824005 >> v2:172.21.15.155:3300/0 conn(0x7f4bf0145e60 0x7f4bf0149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:02.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4bf4e05700 1 -- 172.21.15.63:0/2698824005 >> v2:172.21.15.155:3300/0 conn(0x7f4bf0145e60 msgr2=0x7f4bf0149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:02.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4bf4e05700 1 --2- 172.21.15.63:0/2698824005 >> v2:172.21.15.155:3300/0 conn(0x7f4bf0145e60 0x7f4bf0149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:02.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4bf4e05700 1 -- 172.21.15.63:0/2698824005 >> v1:172.21.15.63:6789/0 conn(0x7f4bf0146be0 legacy=0x7f4bf00b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:02.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4be7fff700 1 -- 172.21.15.63:0/2698824005 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975021258 0 0) 0x7f4bf00b8160 con 0x7f4bf0146be0 2020-05-18T21:29:02.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4bf4e05700 1 -- 172.21.15.63:0/2698824005 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf0146280 con 0x7f4bf00b7cc0 2020-05-18T21:29:02.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4bf4e05700 1 --2- 172.21.15.63:0/2698824005 >> v2:172.21.15.63:3300/0 conn(0x7f4bf00b7cc0 0x7f4bf006a280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4bec002f70 tx=0x7f4bec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:02.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4bf4e05700 1 --2- 172.21.15.63:0/2698824005 >> v2:172.21.15.63:3300/0 conn(0x7f4bf00b7cc0 0x7f4bf006a280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4bec002f70 tx=0x7f4bec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:02.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4bf4e05700 1 --2- 172.21.15.63:0/2698824005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf00b7cc0 0x7f4bf006a280 secure :-1 s=READY pgs=657 cs=0 l=1 rx=0x7f4bec002f70 tx=0x7f4bec007a80).ready entity=mon.0 client_cookie=a4aad57984a197b8 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:02.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4bf4e05700 1 --2- 172.21.15.63:0/2698824005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf00b7cc0 0x7f4bf006a280 secure :-1 s=THROTTLE_DONE pgs=657 cs=0 l=1 rx=0x7f4bec002f70 tx=0x7f4bec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:02.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4be7fff700 1 -- 172.21.15.63:0/2698824005 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bec008e50 con 0x7f4bf00b7cc0 2020-05-18T21:29:02.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4bf4e05700 1 --2- 172.21.15.63:0/2698824005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf00b7cc0 0x7f4bf006a280 secure :-1 s=THROTTLE_DONE pgs=657 cs=0 l=1 rx=0x7f4bec002f70 tx=0x7f4bec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:02.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4bf4e05700 1 --2- 172.21.15.63:0/2698824005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf00b7cc0 0x7f4bf006a280 secure :-1 s=THROTTLE_DONE pgs=657 cs=0 l=1 rx=0x7f4bec002f70 tx=0x7f4bec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:02.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4be7fff700 1 -- 172.21.15.63:0/2698824005 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec0115f0 con 0x7f4bf00b7cc0 2020-05-18T21:29:02.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4be7fff700 1 -- 172.21.15.63:0/2698824005 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bec0119d0 con 0x7f4bf00b7cc0 2020-05-18T21:29:02.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4bf786a700 1 -- 172.21.15.63:0/2698824005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf00b7cc0 msgr2=0x7f4bf006a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:02.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4bf786a700 1 --2- 172.21.15.63:0/2698824005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf00b7cc0 0x7f4bf006a280 secure :-1 s=READY pgs=657 cs=0 l=1 rx=0x7f4bec002f70 tx=0x7f4bec007a80).stop 2020-05-18T21:29:02.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4bf786a700 1 -- 172.21.15.63:0/2698824005 shutdown_connections 2020-05-18T21:29:02.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4bf786a700 1 --2- 172.21.15.63:0/2698824005 >> v2:172.21.15.155:3300/0 conn(0x7f4bf0145e60 0x7f4bf0149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:02.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4bf786a700 1 --2- 172.21.15.63:0/2698824005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf00b7cc0 0x7f4bf006a280 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:02.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4bf786a700 1 -- 172.21.15.63:0/2698824005 >> 172.21.15.63:0/2698824005 conn(0x7f4bf005b240 msgr2=0x7f4bf0069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:02.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4bf786a700 1 -- 172.21.15.63:0/2698824005 shutdown_connections 2020-05-18T21:29:02.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.769+0000 7f4bf786a700 1 -- 172.21.15.63:0/2698824005 wait complete. 2020-05-18T21:29:02.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf786a700 1 Processor -- start 2020-05-18T21:29:02.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf786a700 1 -- start start 2020-05-18T21:29:02.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf786a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bf00b7cc0 0x7f4bf0153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:02.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf786a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4bf0145e60 0x7f4bf00afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:02.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf786a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf0153ef0 con 0x7f4bf0146be0 2020-05-18T21:29:02.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf786a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf0153510 con 0x7f4bf0145e60 2020-05-18T21:29:02.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf786a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf01537b0 con 0x7f4bf00b7cc0 2020-05-18T21:29:02.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf4e05700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4bf0145e60 0x7f4bf00afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:02.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf4e05700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4bf0145e60 0x7f4bf00afeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55978/0 (socket says 172.21.15.63:55978) 2020-05-18T21:29:02.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf4e05700 1 -- 172.21.15.63:0/1623561661 learned_addr learned my addr 172.21.15.63:0/1623561661 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:02.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf5606700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bf00b7cc0 0x7f4bf0153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:02.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf4e05700 1 -- 172.21.15.63:0/1623561661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bf00b7cc0 msgr2=0x7f4bf0153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:02.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf4e05700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bf00b7cc0 0x7f4bf0153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:02.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf4e05700 1 -- 172.21.15.63:0/1623561661 >> v1:172.21.15.155:6789/0 conn(0x7f4bf0146be0 legacy=0x7f4bf009e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:02.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf4e05700 1 -- 172.21.15.63:0/1623561661 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf0153a50 con 0x7f4bf0145e60 2020-05-18T21:29:02.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf4e05700 1 --2- 172.21.15.63:0/1623561661 >> v2:172.21.15.63:3300/0 conn(0x7f4bf0145e60 0x7f4bf00afeb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4bec002f70 tx=0x7f4bec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:02.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf4e05700 1 --2- 172.21.15.63:0/1623561661 >> v2:172.21.15.63:3300/0 conn(0x7f4bf0145e60 0x7f4bf00afeb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4bec002f70 tx=0x7f4bec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:02.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf4e05700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf0145e60 0x7f4bf00afeb0 secure :-1 s=READY pgs=658 cs=0 l=1 rx=0x7f4bec002f70 tx=0x7f4bec007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:02.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf4e05700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf0145e60 0x7f4bf00afeb0 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7f4bec002f70 tx=0x7f4bec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:02.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4be67fc700 1 -- 172.21.15.63:0/1623561661 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bec00f880 con 0x7f4bf0145e60 2020-05-18T21:29:02.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf4e05700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf0145e60 0x7f4bf00afeb0 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7f4bec002f70 tx=0x7f4bec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:02.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4be67fc700 1 -- 172.21.15.63:0/1623561661 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec007360 con 0x7f4bf0145e60 2020-05-18T21:29:02.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf4e05700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf0145e60 0x7f4bf00afeb0 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7f4bec002f70 tx=0x7f4bec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:02.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4bf786a700 1 -- 172.21.15.63:0/1623561661 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf01573a0 con 0x7f4bf0145e60 2020-05-18T21:29:02.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.773+0000 7f4be67fc700 1 -- 172.21.15.63:0/1623561661 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bec005700 con 0x7f4bf0145e60 2020-05-18T21:29:02.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.777+0000 7f4bf786a700 1 -- 172.21.15.63:0/1623561661 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf009e9b0 con 0x7f4bf0145e60 2020-05-18T21:29:02.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.777+0000 7f4bf4e05700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf0145e60 0x7f4bf00afeb0 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7f4bec002f70 tx=0x7f4bec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:02.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.777+0000 7f4bf786a700 1 -- 172.21.15.63:0/1623561661 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf00b4b80 con 0x7f4bf0145e60 2020-05-18T21:29:02.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.777+0000 7f4be67fc700 1 -- 172.21.15.63:0/1623561661 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4bec0058b0 con 0x7f4bf0145e60 2020-05-18T21:29:02.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.777+0000 7f4bf4e05700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf0145e60 0x7f4bf00afeb0 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7f4bec002f70 tx=0x7f4bec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:02.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.777+0000 7f4be67fc700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4bd804f950 0x7f4bd8051e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:02.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.777+0000 7f4be67fc700 1 -- 172.21.15.63:0/1623561661 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f4bec064570 con 0x7f4bf0145e60 2020-05-18T21:29:02.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.777+0000 7f4bf5606700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4bd804f950 0x7f4bd8051e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:02.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.777+0000 7f4bf5606700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4bd804f950 0x7f4bd8051e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4be0000bc0 tx=0x7f4be0001750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:02.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.777+0000 7f4bf5606700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4bd804f950 0x7f4bd8051e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4be0000bc0 tx=0x7f4be0001750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:02.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.777+0000 7f4bf5606700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4bd804f950 0x7f4bd8051e10 secure :-1 s=READY pgs=264 cs=0 l=1 rx=0x7f4be0000bc0 tx=0x7f4be0001750).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:02.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.785+0000 7f4bf4e05700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf0145e60 0x7f4bf00afeb0 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7f4bec002f70 tx=0x7f4bec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:02.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.785+0000 7f4be67fc700 1 -- 172.21.15.63:0/1623561661 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f4bec03e9c0 con 0x7f4bf0145e60 2020-05-18T21:29:02.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.941+0000 7f4bf786a700 1 -- 172.21.15.63:0/1623561661 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bf00569e0 con 0x7f4bf0145e60 2020-05-18T21:29:02.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.941+0000 7f4bf4e05700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf0145e60 0x7f4bf00afeb0 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7f4bec002f70 tx=0x7f4bec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:02.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.941+0000 7f4be67fc700 1 -- 172.21.15.63:0/1623561661 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+1778 (secure 0 0 0) 0x7f4bec041fe0 con 0x7f4bf0145e60 2020-05-18T21:29:02.947 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:02.947 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":23,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/2663525728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2663525728},{"type":"v1","addr":"172.21.15.63:6833","nonce":2663525728}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:28:48.505607+0000","modified":"2020-05-18T21:29:02.621093+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-05-18T21:29:02.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.941+0000 7f4bf786a700 1 -- 172.21.15.63:0/1623561661 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4bd804f950 msgr2=0x7f4bd8051e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:02.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.941+0000 7f4bf786a700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4bd804f950 0x7f4bd8051e10 secure :-1 s=READY pgs=264 cs=0 l=1 rx=0x7f4be0000bc0 tx=0x7f4be0001750).stop 2020-05-18T21:29:02.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.941+0000 7f4bf786a700 1 -- 172.21.15.63:0/1623561661 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf0145e60 msgr2=0x7f4bf00afeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:02.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.941+0000 7f4bf786a700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf0145e60 0x7f4bf00afeb0 secure :-1 s=READY pgs=658 cs=0 l=1 rx=0x7f4bec002f70 tx=0x7f4bec007a80).stop 2020-05-18T21:29:02.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.941+0000 7f4bf786a700 1 -- 172.21.15.63:0/1623561661 shutdown_connections 2020-05-18T21:29:02.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.941+0000 7f4bf786a700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4bd804f950 0x7f4bd8051e10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:02.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.941+0000 7f4bf786a700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf0145e60 0x7f4bf00afeb0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:02.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.941+0000 7f4bf786a700 1 --2- 172.21.15.63:0/1623561661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bf00b7cc0 0x7f4bf0153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:02.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.941+0000 7f4bf786a700 1 -- 172.21.15.63:0/1623561661 >> 172.21.15.63:0/1623561661 conn(0x7f4bf005b240 msgr2=0x7f4bf01440e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:02.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.941+0000 7f4bf786a700 1 -- 172.21.15.63:0/1623561661 shutdown_connections 2020-05-18T21:29:02.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:02.941+0000 7f4bf786a700 1 -- 172.21.15.63:0/1623561661 wait complete. 2020-05-18T21:29:02.951 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 23 2020-05-18T21:29:02.959 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-05-18T21:29:03.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd535c65700 1 Processor -- start 2020-05-18T21:29:03.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd535c65700 1 -- start start 2020-05-18T21:29:03.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd535c65700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5301459f0 0x7fd5300b8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:03.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd535c65700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd5300ad0f0 0x7fd5300bc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:03.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd535c65700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd5300bcbb0 0x7fd530145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:03.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd535c65700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5300ae270 con 0x7fd5300ad0f0 2020-05-18T21:29:03.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd535c65700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5300ba3e0 con 0x7fd5300bcbb0 2020-05-18T21:29:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd535c65700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5300b9ea0 con 0x7fd5301459f0 2020-05-18T21:29:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd5300ad0f0 0x7fd5300bc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd5300ad0f0 0x7fd5300bc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55984/0 (socket says 172.21.15.63:55984) 2020-05-18T21:29:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52effd700 1 -- 172.21.15.63:0/2281229844 learned_addr learned my addr 172.21.15.63:0/2281229844 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52ffff700 1 --2- 172.21.15.63:0/2281229844 >> v2:172.21.15.155:3300/0 conn(0x7fd5300bcbb0 0x7fd530145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52f7fe700 1 --2- 172.21.15.63:0/2281229844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5301459f0 0x7fd5300b8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52effd700 1 -- 172.21.15.63:0/2281229844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5301459f0 msgr2=0x7fd5300b8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52effd700 1 --2- 172.21.15.63:0/2281229844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5301459f0 0x7fd5300b8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52effd700 1 -- 172.21.15.63:0/2281229844 >> v2:172.21.15.155:3300/0 conn(0x7fd5300bcbb0 msgr2=0x7fd530145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52effd700 1 --2- 172.21.15.63:0/2281229844 >> v2:172.21.15.155:3300/0 conn(0x7fd5300bcbb0 0x7fd530145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:03.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52effd700 1 -- 172.21.15.63:0/2281229844 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5300ba140 con 0x7fd5300ad0f0 2020-05-18T21:29:03.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52ffff700 1 --2- 172.21.15.63:0/2281229844 >> v2:172.21.15.155:3300/0 conn(0x7fd5300bcbb0 0x7fd530145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:29:03.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52effd700 1 --2- 172.21.15.63:0/2281229844 >> v2:172.21.15.63:3300/0 conn(0x7fd5300ad0f0 0x7fd5300bc750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd5300ae3b0 tx=0x7fd520008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52effd700 1 --2- 172.21.15.63:0/2281229844 >> v2:172.21.15.63:3300/0 conn(0x7fd5300ad0f0 0x7fd5300bc750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd5300ae3b0 tx=0x7fd520008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52effd700 1 --2- 172.21.15.63:0/2281229844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5300ad0f0 0x7fd5300bc750 secure :-1 s=READY pgs=659 cs=0 l=1 rx=0x7fd5300ae3b0 tx=0x7fd520008920).ready entity=mon.0 client_cookie=fd98ae236f425706 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:03.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52effd700 1 --2- 172.21.15.63:0/2281229844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5300ad0f0 0x7fd5300bc750 secure :-1 s=THROTTLE_DONE pgs=659 cs=0 l=1 rx=0x7fd5300ae3b0 tx=0x7fd520008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52e7fc700 1 -- 172.21.15.63:0/2281229844 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd520011760 con 0x7fd5300ad0f0 2020-05-18T21:29:03.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52effd700 1 --2- 172.21.15.63:0/2281229844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5300ad0f0 0x7fd5300bc750 secure :-1 s=THROTTLE_DONE pgs=659 cs=0 l=1 rx=0x7fd5300ae3b0 tx=0x7fd520008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52e7fc700 1 -- 172.21.15.63:0/2281229844 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5200118c0 con 0x7fd5300ad0f0 2020-05-18T21:29:03.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52effd700 1 --2- 172.21.15.63:0/2281229844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5300ad0f0 0x7fd5300bc750 secure :-1 s=THROTTLE_DONE pgs=659 cs=0 l=1 rx=0x7fd5300ae3b0 tx=0x7fd520008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd52e7fc700 1 -- 172.21.15.63:0/2281229844 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd520011ce0 con 0x7fd5300ad0f0 2020-05-18T21:29:03.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.061+0000 7fd535c65700 1 -- 172.21.15.63:0/2281229844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5300ad0f0 msgr2=0x7fd5300bc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:03.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd535c65700 1 --2- 172.21.15.63:0/2281229844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5300ad0f0 0x7fd5300bc750 secure :-1 s=READY pgs=659 cs=0 l=1 rx=0x7fd5300ae3b0 tx=0x7fd520008920).stop 2020-05-18T21:29:03.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd535c65700 1 -- 172.21.15.63:0/2281229844 shutdown_connections 2020-05-18T21:29:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd535c65700 1 --2- 172.21.15.63:0/2281229844 >> v2:172.21.15.155:3300/0 conn(0x7fd5300bcbb0 0x7fd530145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd535c65700 1 --2- 172.21.15.63:0/2281229844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5300ad0f0 0x7fd5300bc750 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd535c65700 1 --2- 172.21.15.63:0/2281229844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5301459f0 0x7fd5300b8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd535c65700 1 -- 172.21.15.63:0/2281229844 >> 172.21.15.63:0/2281229844 conn(0x7fd53005f540 msgr2=0x7fd53005f920 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:03.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd535c65700 1 -- 172.21.15.63:0/2281229844 shutdown_connections 2020-05-18T21:29:03.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd535c65700 1 -- 172.21.15.63:0/2281229844 wait complete. 2020-05-18T21:29:03.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd535c65700 1 Processor -- start 2020-05-18T21:29:03.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd535c65700 1 -- start start 2020-05-18T21:29:03.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd535c65700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5300ad0f0 0x7fd5301400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:03.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd535c65700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd5301459f0 0x7fd530140500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:03.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd535c65700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5300b5320 con 0x7fd5300bcbb0 2020-05-18T21:29:03.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd535c65700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd530140960 con 0x7fd5301459f0 2020-05-18T21:29:03.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd535c65700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5300b22a0 con 0x7fd5300ad0f0 2020-05-18T21:29:03.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd52effd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd5300bcbb0 0x7fd530156d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58178/0 (socket says 172.21.15.63:58178) 2020-05-18T21:29:03.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd52effd700 1 -- 172.21.15.63:0/20893772 learned_addr learned my addr 172.21.15.63:0/20893772 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:03.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd52ffff700 1 --2- 172.21.15.63:0/20893772 >> v2:172.21.15.63:3300/0 conn(0x7fd5301459f0 0x7fd530140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:03.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd52f7fe700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5300ad0f0 0x7fd5301400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:03.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd52ffff700 1 -- 172.21.15.63:0/20893772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5300ad0f0 msgr2=0x7fd5301400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:03.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd52ffff700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5300ad0f0 0x7fd5301400a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd52cff9700 1 -- 172.21.15.63:0/20893772 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2400308352 0 0) 0x7fd5300b5320 con 0x7fd5300bcbb0 2020-05-18T21:29:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd52ffff700 1 -- 172.21.15.63:0/20893772 >> v1:172.21.15.63:6789/0 conn(0x7fd5300bcbb0 legacy=0x7fd530156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd52ffff700 1 -- 172.21.15.63:0/20893772 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5300b18c0 con 0x7fd5301459f0 2020-05-18T21:29:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd52ffff700 1 --2- 172.21.15.63:0/20893772 >> v2:172.21.15.63:3300/0 conn(0x7fd5301459f0 0x7fd530140500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd5280032f0 tx=0x7fd528010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd52ffff700 1 --2- 172.21.15.63:0/20893772 >> v2:172.21.15.63:3300/0 conn(0x7fd5301459f0 0x7fd530140500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd5280032f0 tx=0x7fd528010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd52ffff700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5301459f0 0x7fd530140500 secure :-1 s=READY pgs=661 cs=0 l=1 rx=0x7fd5280032f0 tx=0x7fd528010e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:03.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd52ffff700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5301459f0 0x7fd530140500 secure :-1 s=THROTTLE_DONE pgs=661 cs=0 l=1 rx=0x7fd5280032f0 tx=0x7fd528010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd52ffff700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5301459f0 0x7fd530140500 secure :-1 s=THROTTLE_DONE pgs=661 cs=0 l=1 rx=0x7fd5280032f0 tx=0x7fd528010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd52ffff700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5301459f0 0x7fd530140500 secure :-1 s=THROTTLE_DONE pgs=661 cs=0 l=1 rx=0x7fd5280032f0 tx=0x7fd528010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd52cff9700 1 -- 172.21.15.63:0/20893772 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd528005e70 con 0x7fd5301459f0 2020-05-18T21:29:03.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd52cff9700 1 -- 172.21.15.63:0/20893772 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd528007560 con 0x7fd5301459f0 2020-05-18T21:29:03.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd535c65700 1 -- 172.21.15.63:0/20893772 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5300b1b60 con 0x7fd5301459f0 2020-05-18T21:29:03.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.065+0000 7fd52cff9700 1 -- 172.21.15.63:0/20893772 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd528007900 con 0x7fd5301459f0 2020-05-18T21:29:03.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.069+0000 7fd535c65700 1 -- 172.21.15.63:0/20893772 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5300b1420 con 0x7fd5301459f0 2020-05-18T21:29:03.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.069+0000 7fd52ffff700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5301459f0 0x7fd530140500 secure :-1 s=THROTTLE_DONE pgs=661 cs=0 l=1 rx=0x7fd5280032f0 tx=0x7fd528010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.069+0000 7fd535c65700 1 -- 172.21.15.63:0/20893772 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5300b1720 con 0x7fd5301459f0 2020-05-18T21:29:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.069+0000 7fd52cff9700 1 -- 172.21.15.63:0/20893772 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd528010190 con 0x7fd5301459f0 2020-05-18T21:29:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.069+0000 7fd52ffff700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5301459f0 0x7fd530140500 secure :-1 s=THROTTLE_DONE pgs=661 cs=0 l=1 rx=0x7fd5280032f0 tx=0x7fd528010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.069+0000 7fd52cff9700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd51004f930 0x7fd510051df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.069+0000 7fd52cff9700 1 -- 172.21.15.63:0/20893772 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd528063e90 con 0x7fd5301459f0 2020-05-18T21:29:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.069+0000 7fd52f7fe700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd51004f930 0x7fd510051df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:03.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.069+0000 7fd52f7fe700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd51004f930 0x7fd510051df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd524002f70 tx=0x7fd52400a820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.069+0000 7fd52f7fe700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd51004f930 0x7fd510051df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd524002f70 tx=0x7fd52400a820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.069+0000 7fd52f7fe700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd51004f930 0x7fd510051df0 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7fd524002f70 tx=0x7fd52400a820).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:03.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.077+0000 7fd52ffff700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5301459f0 0x7fd530140500 secure :-1 s=THROTTLE_DONE pgs=661 cs=0 l=1 rx=0x7fd5280032f0 tx=0x7fd528010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.077+0000 7fd52cff9700 1 -- 172.21.15.63:0/20893772 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd5300b1720 con 0x7fd5301459f0 2020-05-18T21:29:03.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.225+0000 7fd535c65700 1 -- 172.21.15.63:0/20893772 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd5300b1720 con 0x7fd5301459f0 2020-05-18T21:29:03.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.633+0000 7fd52ffff700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5301459f0 0x7fd530140500 secure :-1 s=THROTTLE_DONE pgs=661 cs=0 l=1 rx=0x7fd5280032f0 tx=0x7fd528010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.633+0000 7fd52cff9700 1 -- 172.21.15.63:0/20893772 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd5300b1720 con 0x7fd5301459f0 2020-05-18T21:29:03.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.637+0000 7fd535c65700 1 -- 172.21.15.63:0/20893772 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd51004f930 msgr2=0x7fd510051df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:03.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.637+0000 7fd535c65700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd51004f930 0x7fd510051df0 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7fd524002f70 tx=0x7fd52400a820).stop 2020-05-18T21:29:03.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.637+0000 7fd535c65700 1 -- 172.21.15.63:0/20893772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5301459f0 msgr2=0x7fd530140500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:03.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.637+0000 7fd535c65700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5301459f0 0x7fd530140500 secure :-1 s=READY pgs=661 cs=0 l=1 rx=0x7fd5280032f0 tx=0x7fd528010e90).stop 2020-05-18T21:29:03.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.637+0000 7fd535c65700 1 -- 172.21.15.63:0/20893772 shutdown_connections 2020-05-18T21:29:03.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.637+0000 7fd535c65700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd51004f930 0x7fd510051df0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:03.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.637+0000 7fd535c65700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5301459f0 0x7fd530140500 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:03.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.637+0000 7fd535c65700 1 --2- 172.21.15.63:0/20893772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5300ad0f0 0x7fd5301400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:03.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.637+0000 7fd535c65700 1 -- 172.21.15.63:0/20893772 >> 172.21.15.63:0/20893772 conn(0x7fd53005f540 msgr2=0x7fd530060490 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:03.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.637+0000 7fd535c65700 1 -- 172.21.15.63:0/20893772 shutdown_connections 2020-05-18T21:29:03.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.637+0000 7fd535c65700 1 -- 172.21.15.63:0/20893772 wait complete. 2020-05-18T21:29:03.660 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-05-18T21:29:03.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.769+0000 7f1fedef9700 1 Processor -- start 2020-05-18T21:29:03.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.769+0000 7f1fedef9700 1 -- start start 2020-05-18T21:29:03.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.769+0000 7f1fedef9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1fe80b9810 0x7f1fe81438a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:03.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.769+0000 7f1fedef9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fe809e750 0x7f1fe80b6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:03.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fedef9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe80b6110 con 0x7f1fe80b6cb0 2020-05-18T21:29:03.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fedef9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe80b63b0 con 0x7f1fe80b9810 2020-05-18T21:29:03.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fedef9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe80b9bf0 con 0x7f1fe809e750 2020-05-18T21:29:03.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fe7fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fe809e750 0x7f1fe80b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:03.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fecef7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1fe80b9810 0x7f1fe81438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:03.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fe7fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fe809e750 0x7f1fe80b6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:46700/0 (socket says 172.21.15.63:46700) 2020-05-18T21:29:03.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fe7fff700 1 -- 172.21.15.63:0/4270452579 learned_addr learned my addr 172.21.15.63:0/4270452579 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:03.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fed6f8700 1 --1- 172.21.15.63:0/4270452579 >> v1:172.21.15.155:6789/0 conn(0x7f1fe80b6cb0 0x7f1fe813ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:56506/0 (socket says 172.21.15.63:56506) 2020-05-18T21:29:03.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fe7fff700 1 -- 172.21.15.63:0/4270452579 >> v2:172.21.15.155:3300/0 conn(0x7f1fe80b9810 msgr2=0x7f1fe81438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:03.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fe7fff700 1 --2- 172.21.15.63:0/4270452579 >> v2:172.21.15.155:3300/0 conn(0x7f1fe80b9810 0x7f1fe81438a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:03.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fe7fff700 1 -- 172.21.15.63:0/4270452579 >> v1:172.21.15.155:6789/0 conn(0x7f1fe80b6cb0 legacy=0x7f1fe813ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:03.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fe77fe700 1 -- 172.21.15.63:0/4270452579 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63502692 0 0) 0x7f1fe80b6110 con 0x7f1fe80b6cb0 2020-05-18T21:29:03.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fe7fff700 1 -- 172.21.15.63:0/4270452579 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe80b4d90 con 0x7f1fe809e750 2020-05-18T21:29:03.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fe7fff700 1 --2- 172.21.15.63:0/4270452579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fe809e750 0x7f1fe80b6850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1fd8002f70 tx=0x7f1fd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fe7fff700 1 --2- 172.21.15.63:0/4270452579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fe809e750 0x7f1fe80b6850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1fd8002f70 tx=0x7f1fd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fe7fff700 1 --2- 172.21.15.63:0/4270452579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fe809e750 0x7f1fe80b6850 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f1fd8002f70 tx=0x7f1fd8007a80).ready entity=mon.2 client_cookie=a96e3081dcaf4690 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:03.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fe7fff700 1 --2- 172.21.15.63:0/4270452579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fe809e750 0x7f1fe80b6850 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f1fd8002f70 tx=0x7f1fd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fe77fe700 1 -- 172.21.15.63:0/4270452579 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fd80116b0 con 0x7f1fe809e750 2020-05-18T21:29:03.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fe7fff700 1 --2- 172.21.15.63:0/4270452579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fe809e750 0x7f1fe80b6850 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f1fd8002f70 tx=0x7f1fd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fe7fff700 1 --2- 172.21.15.63:0/4270452579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fe809e750 0x7f1fe80b6850 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f1fd8002f70 tx=0x7f1fd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fe77fe700 1 -- 172.21.15.63:0/4270452579 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd8011810 con 0x7f1fe809e750 2020-05-18T21:29:03.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fe77fe700 1 -- 172.21.15.63:0/4270452579 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fd8011bf0 con 0x7f1fe809e750 2020-05-18T21:29:03.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fedef9700 1 -- 172.21.15.63:0/4270452579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fe809e750 msgr2=0x7f1fe80b6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:03.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fedef9700 1 --2- 172.21.15.63:0/4270452579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fe809e750 0x7f1fe80b6850 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f1fd8002f70 tx=0x7f1fd8007a80).stop 2020-05-18T21:29:03.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fedef9700 1 -- 172.21.15.63:0/4270452579 shutdown_connections 2020-05-18T21:29:03.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fedef9700 1 --2- 172.21.15.63:0/4270452579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fe809e750 0x7f1fe80b6850 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:03.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fedef9700 1 --2- 172.21.15.63:0/4270452579 >> v2:172.21.15.155:3300/0 conn(0x7f1fe80b9810 0x7f1fe81438a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:03.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fedef9700 1 -- 172.21.15.63:0/4270452579 >> 172.21.15.63:0/4270452579 conn(0x7f1fe805a7c0 msgr2=0x7f1fe805aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:03.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fedef9700 1 -- 172.21.15.63:0/4270452579 shutdown_connections 2020-05-18T21:29:03.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.773+0000 7f1fedef9700 1 -- 172.21.15.63:0/4270452579 wait complete. 2020-05-18T21:29:03.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.777+0000 7f1fedef9700 1 Processor -- start 2020-05-18T21:29:03.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.777+0000 7f1fedef9700 1 -- start start 2020-05-18T21:29:03.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.777+0000 7f1fedef9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1fe809e750 0x7f1fe8062fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.777+0000 7f1fedef9700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe8064730 con 0x7f1fe80b9810 2020-05-18T21:29:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.777+0000 7f1fedef9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe8063520 con 0x7f1fe81517f0 2020-05-18T21:29:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.777+0000 7f1fedef9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe80637c0 con 0x7f1fe809e750 2020-05-18T21:29:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.777+0000 7f1fe7fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1fe80b9810 0x7f1fe8138980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58194/0 (socket says 172.21.15.63:58194) 2020-05-18T21:29:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.777+0000 7f1fe7fff700 1 -- 172.21.15.63:0/3354899982 learned_addr learned my addr 172.21.15.63:0/3354899982 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:03.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.777+0000 7f1fecef7700 1 --2- 172.21.15.63:0/3354899982 >> v2:172.21.15.155:3300/0 conn(0x7f1fe809e750 0x7f1fe8062fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:03.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.777+0000 7f1fe5ffb700 1 -- 172.21.15.63:0/3354899982 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412920352 0 0) 0x7f1fe8064730 con 0x7f1fe80b9810 2020-05-18T21:29:03.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.777+0000 7f1fe5ffb700 1 -- 172.21.15.63:0/3354899982 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fcc002fe0 con 0x7f1fe80b9810 2020-05-18T21:29:03.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.777+0000 7f1fe5ffb700 1 -- 172.21.15.63:0/3354899982 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126715054 0 0) 0x7f1fe8063520 con 0x7f1fe81517f0 2020-05-18T21:29:03.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.777+0000 7f1fe5ffb700 1 -- 172.21.15.63:0/3354899982 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fe8064730 con 0x7f1fe81517f0 2020-05-18T21:29:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fe5ffb700 1 -- 172.21.15.63:0/3354899982 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3323688502 0 0) 0x7f1fcc002fe0 con 0x7f1fe80b9810 2020-05-18T21:29:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fe5ffb700 1 -- 172.21.15.63:0/3354899982 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1fe8063520 con 0x7f1fe80b9810 2020-05-18T21:29:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fe5ffb700 1 -- 172.21.15.63:0/3354899982 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f1fd8011e70 con 0x7f1fe80b9810 2020-05-18T21:29:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fecef7700 1 -- 172.21.15.63:0/3354899982 >> v1:172.21.15.155:6789/0 conn(0x7f1fe81517f0 legacy=0x7f1fe813fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fecef7700 1 -- 172.21.15.63:0/3354899982 >> v1:172.21.15.63:6789/0 conn(0x7f1fe80b9810 legacy=0x7f1fe8138980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fecef7700 1 -- 172.21.15.63:0/3354899982 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe8063a60 con 0x7f1fe809e750 2020-05-18T21:29:03.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fecef7700 1 --2- 172.21.15.63:0/3354899982 >> v2:172.21.15.155:3300/0 conn(0x7f1fe809e750 0x7f1fe8062fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1fd0002f70 tx=0x7f1fd0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fecef7700 1 --2- 172.21.15.63:0/3354899982 >> v2:172.21.15.155:3300/0 conn(0x7f1fe809e750 0x7f1fe8062fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1fd0002f70 tx=0x7f1fd0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fecef7700 1 --2- 172.21.15.63:0/3354899982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe809e750 0x7f1fe8062fa0 secure :-1 s=READY pgs=476 cs=0 l=1 rx=0x7f1fd0002f70 tx=0x7f1fd0010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:03.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fecef7700 1 --2- 172.21.15.63:0/3354899982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe809e750 0x7f1fe8062fa0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f1fd0002f70 tx=0x7f1fd0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fe5ffb700 1 -- 172.21.15.63:0/3354899982 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fd0007550 con 0x7f1fe809e750 2020-05-18T21:29:03.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fecef7700 1 --2- 172.21.15.63:0/3354899982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe809e750 0x7f1fe8062fa0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f1fd0002f70 tx=0x7f1fd0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fecef7700 1 --2- 172.21.15.63:0/3354899982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe809e750 0x7f1fe8062fa0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f1fd0002f70 tx=0x7f1fd0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fe5ffb700 1 -- 172.21.15.63:0/3354899982 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd0005700 con 0x7f1fe809e750 2020-05-18T21:29:03.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fedef9700 1 -- 172.21.15.63:0/3354899982 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe8139090 con 0x7f1fe809e750 2020-05-18T21:29:03.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fe5ffb700 1 -- 172.21.15.63:0/3354899982 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fd0005a60 con 0x7f1fe809e750 2020-05-18T21:29:03.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fedef9700 1 -- 172.21.15.63:0/3354899982 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe8065d30 con 0x7f1fe809e750 2020-05-18T21:29:03.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fecef7700 1 --2- 172.21.15.63:0/3354899982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe809e750 0x7f1fe8062fa0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f1fd0002f70 tx=0x7f1fd0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fedef9700 1 -- 172.21.15.63:0/3354899982 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe80569e0 con 0x7f1fe809e750 2020-05-18T21:29:03.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fe5ffb700 1 -- 172.21.15.63:0/3354899982 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1fd0005c50 con 0x7f1fe809e750 2020-05-18T21:29:03.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fecef7700 1 --2- 172.21.15.63:0/3354899982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe809e750 0x7f1fe8062fa0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f1fd0002f70 tx=0x7f1fd0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fe5ffb700 1 --2- 172.21.15.63:0/3354899982 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1fcc050130 0x7f1fcc0525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:03.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.781+0000 7f1fe5ffb700 1 -- 172.21.15.63:0/3354899982 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1fd0063790 con 0x7f1fe809e750 2020-05-18T21:29:03.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.785+0000 7f1fe7fff700 1 --2- 172.21.15.63:0/3354899982 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1fcc050130 0x7f1fcc0525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:03.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.785+0000 7f1fe7fff700 1 --2- 172.21.15.63:0/3354899982 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1fcc050130 0x7f1fcc0525f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1fd8008360 tx=0x7f1fd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.785+0000 7f1fe7fff700 1 --2- 172.21.15.63:0/3354899982 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1fcc050130 0x7f1fcc0525f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1fd8008360 tx=0x7f1fd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.785+0000 7f1fe7fff700 1 --2- 172.21.15.63:0/3354899982 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1fcc050130 0x7f1fcc0525f0 secure :-1 s=READY pgs=267 cs=0 l=1 rx=0x7f1fd8008360 tx=0x7f1fd8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:03.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.793+0000 7f1fecef7700 1 --2- 172.21.15.63:0/3354899982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe809e750 0x7f1fe8062fa0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f1fd0002f70 tx=0x7f1fd0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:03.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.793+0000 7f1fe5ffb700 1 -- 172.21.15.63:0/3354899982 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f1fd003dac0 con 0x7f1fe809e750 2020-05-18T21:29:03.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:03.913+0000 7f1fedef9700 1 -- 172.21.15.63:0/3354899982 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1fe805c860 con 0x7f1fe809e750 2020-05-18T21:29:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.685+0000 7f1fecef7700 1 --2- 172.21.15.63:0/3354899982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe809e750 0x7f1fe8062fa0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f1fd0002f70 tx=0x7f1fd0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.685+0000 7f1fe5ffb700 1 -- 172.21.15.63:0/3354899982 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) v1 ==== 185+0+0 (secure 0 0 0) 0x7f1fd00410e0 con 0x7f1fe809e750 2020-05-18T21:29:04.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.689+0000 7f1fedef9700 1 -- 172.21.15.63:0/3354899982 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1fcc050130 msgr2=0x7f1fcc0525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:04.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.689+0000 7f1fedef9700 1 --2- 172.21.15.63:0/3354899982 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1fcc050130 0x7f1fcc0525f0 secure :-1 s=READY pgs=267 cs=0 l=1 rx=0x7f1fd8008360 tx=0x7f1fd8007a80).stop 2020-05-18T21:29:04.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.689+0000 7f1fedef9700 1 -- 172.21.15.63:0/3354899982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe809e750 msgr2=0x7f1fe8062fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:04.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.689+0000 7f1fedef9700 1 --2- 172.21.15.63:0/3354899982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe809e750 0x7f1fe8062fa0 secure :-1 s=READY pgs=476 cs=0 l=1 rx=0x7f1fd0002f70 tx=0x7f1fd0010bd0).stop 2020-05-18T21:29:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.693+0000 7f1fedef9700 1 -- 172.21.15.63:0/3354899982 shutdown_connections 2020-05-18T21:29:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.693+0000 7f1fedef9700 1 --2- 172.21.15.63:0/3354899982 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1fcc050130 0x7f1fcc0525f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.693+0000 7f1fedef9700 1 --2- 172.21.15.63:0/3354899982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe809e750 0x7f1fe8062fa0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.693+0000 7f1fedef9700 1 -- 172.21.15.63:0/3354899982 >> 172.21.15.63:0/3354899982 conn(0x7f1fe805a7c0 msgr2=0x7f1fe80b3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.693+0000 7f1fedef9700 1 -- 172.21.15.63:0/3354899982 shutdown_connections 2020-05-18T21:29:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.693+0000 7f1fedef9700 1 -- 172.21.15.63:0/3354899982 wait complete. 2020-05-18T21:29:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2020-05-18T21:29:04.712 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-05-18T21:29:04.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.809+0000 7fe35ebf3700 1 Processor -- start 2020-05-18T21:29:04.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.809+0000 7fe35ebf3700 1 -- start start 2020-05-18T21:29:04.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.809+0000 7fe35ebf3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe3580b4460 0x7fe3580b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:04.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.809+0000 7fe35ebf3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3580b6c10 0x7fe3580b70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:04.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.809+0000 7fe35ebf3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe358146740 con 0x7fe358145ca0 2020-05-18T21:29:04.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.809+0000 7fe35ebf3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3581469e0 con 0x7fe3580b4460 2020-05-18T21:29:04.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.809+0000 7fe35ebf3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580b4840 con 0x7fe3580b6c10 2020-05-18T21:29:04.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35d3f0700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe358145ca0 0x7fe3580b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58200/0 (socket says 172.21.15.63:58200) 2020-05-18T21:29:04.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35d3f0700 1 -- 172.21.15.63:0/3327542748 learned_addr learned my addr 172.21.15.63:0/3327542748 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:04.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35e3f2700 1 --2- 172.21.15.63:0/3327542748 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3580b6c10 0x7fe3580b70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:04.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35dbf1700 1 --2- 172.21.15.63:0/3327542748 >> v2:172.21.15.155:3300/0 conn(0x7fe3580b4460 0x7fe3580b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:04.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35cbef700 1 -- 172.21.15.63:0/3327542748 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844394297 0 0) 0x7fe358146740 con 0x7fe358145ca0 2020-05-18T21:29:04.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35cbef700 1 -- 172.21.15.63:0/3327542748 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe340003270 con 0x7fe358145ca0 2020-05-18T21:29:04.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35cbef700 1 -- 172.21.15.63:0/3327542748 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1958920946 0 0) 0x7fe340003270 con 0x7fe358145ca0 2020-05-18T21:29:04.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35cbef700 1 -- 172.21.15.63:0/3327542748 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3580b6c10 msgr2=0x7fe3580b70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:04.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35cbef700 1 --2- 172.21.15.63:0/3327542748 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3580b6c10 0x7fe3580b70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:04.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35cbef700 1 -- 172.21.15.63:0/3327542748 >> v2:172.21.15.155:3300/0 conn(0x7fe3580b4460 msgr2=0x7fe3580b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:04.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35cbef700 1 --2- 172.21.15.63:0/3327542748 >> v2:172.21.15.155:3300/0 conn(0x7fe3580b4460 0x7fe3580b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:04.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35cbef700 1 -- 172.21.15.63:0/3327542748 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3580b0ff0 con 0x7fe358145ca0 2020-05-18T21:29:04.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35cbef700 1 -- 172.21.15.63:0/3327542748 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fe354001710 con 0x7fe358145ca0 2020-05-18T21:29:04.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35cbef700 1 -- 172.21.15.63:0/3327542748 >> v1:172.21.15.63:6789/0 conn(0x7fe358145ca0 legacy=0x7fe3580b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:04.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35cbef700 1 --2- 172.21.15.63:0/3327542748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe340003760 0x7fe340003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:04.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35cbef700 1 --2- 172.21.15.63:0/3327542748 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3580b6c10 0x7fe340004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:04.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35cbef700 1 --2- 172.21.15.63:0/3327542748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe340004970 0x7fe340004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:04.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35cbef700 1 -- 172.21.15.63:0/3327542748 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3581469e0 con 0x7fe340003760 2020-05-18T21:29:04.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35cbef700 1 -- 172.21.15.63:0/3327542748 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580b4840 con 0x7fe340004970 2020-05-18T21:29:04.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35cbef700 1 -- 172.21.15.63:0/3327542748 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3400053c0 con 0x7fe3580b6c10 2020-05-18T21:29:04.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35dbf1700 1 --2- 172.21.15.63:0/3327542748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe340003760 0x7fe340003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:04.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35e3f2700 1 --2- 172.21.15.63:0/3327542748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe340004970 0x7fe340004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:04.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35d3f0700 1 --2- 172.21.15.63:0/3327542748 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3580b6c10 0x7fe340004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:04.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35dbf1700 1 -- 172.21.15.63:0/3327542748 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3580b6c10 msgr2=0x7fe340004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:04.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35dbf1700 1 --2- 172.21.15.63:0/3327542748 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3580b6c10 0x7fe340004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:04.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35dbf1700 1 -- 172.21.15.63:0/3327542748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe340004970 msgr2=0x7fe340004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:04.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35dbf1700 1 --2- 172.21.15.63:0/3327542748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe340004970 0x7fe340004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35dbf1700 1 -- 172.21.15.63:0/3327542748 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe340003270 con 0x7fe340003760 2020-05-18T21:29:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35dbf1700 1 --2- 172.21.15.63:0/3327542748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe340003760 0x7fe340003b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe348002f70 tx=0x7fe348010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:04.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35dbf1700 1 --2- 172.21.15.63:0/3327542748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe340003760 0x7fe340003b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe348002f70 tx=0x7fe348010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:04.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35dbf1700 1 --2- 172.21.15.63:0/3327542748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe340003760 0x7fe340003b80 secure :-1 s=READY pgs=664 cs=0 l=1 rx=0x7fe348002f70 tx=0x7fe348010110).ready entity=mon.0 client_cookie=fa582d477cac8018 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:04.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35dbf1700 1 --2- 172.21.15.63:0/3327542748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe340003760 0x7fe340003b80 secure :-1 s=THROTTLE_DONE pgs=664 cs=0 l=1 rx=0x7fe348002f70 tx=0x7fe348010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:04.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35cbef700 1 -- 172.21.15.63:0/3327542748 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3480089b0 con 0x7fe340003760 2020-05-18T21:29:04.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35dbf1700 1 --2- 172.21.15.63:0/3327542748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe340003760 0x7fe340003b80 secure :-1 s=THROTTLE_DONE pgs=664 cs=0 l=1 rx=0x7fe348002f70 tx=0x7fe348010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:04.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35dbf1700 1 --2- 172.21.15.63:0/3327542748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe340003760 0x7fe340003b80 secure :-1 s=THROTTLE_DONE pgs=664 cs=0 l=1 rx=0x7fe348002f70 tx=0x7fe348010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:04.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35cbef700 1 -- 172.21.15.63:0/3327542748 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe348008b10 con 0x7fe340003760 2020-05-18T21:29:04.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35cbef700 1 -- 172.21.15.63:0/3327542748 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3480110d0 con 0x7fe340003760 2020-05-18T21:29:04.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35ebf3700 1 -- 172.21.15.63:0/3327542748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe340003760 msgr2=0x7fe340003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:04.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35ebf3700 1 --2- 172.21.15.63:0/3327542748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe340003760 0x7fe340003b80 secure :-1 s=READY pgs=664 cs=0 l=1 rx=0x7fe348002f70 tx=0x7fe348010110).stop 2020-05-18T21:29:04.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35e3f2700 1 -- 172.21.15.63:0/3327542748 reap_dead start 2020-05-18T21:29:04.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35ebf3700 1 -- 172.21.15.63:0/3327542748 shutdown_connections 2020-05-18T21:29:04.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35ebf3700 1 -- 172.21.15.63:0/3327542748 >> 172.21.15.63:0/3327542748 conn(0x7fe358069b70 msgr2=0x7fe358069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:04.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35ebf3700 1 -- 172.21.15.63:0/3327542748 shutdown_connections 2020-05-18T21:29:04.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.813+0000 7fe35ebf3700 1 -- 172.21.15.63:0/3327542748 wait complete. 2020-05-18T21:29:04.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.817+0000 7fe35ebf3700 1 Processor -- start 2020-05-18T21:29:04.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.817+0000 7fe35ebf3700 1 -- start start 2020-05-18T21:29:04.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.817+0000 7fe35ebf3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe358065960 0x7fe3581482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:04.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.817+0000 7fe35ebf3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe358148a50 con 0x7fe3580b2ee0 2020-05-18T21:29:04.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.817+0000 7fe35ebf3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe358148cf0 con 0x7fe358152540 2020-05-18T21:29:04.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.817+0000 7fe35dbf1700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe3580b2ee0 0x7fe358146da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58212/0 (socket says 172.21.15.63:58212) 2020-05-18T21:29:04.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.817+0000 7fe35dbf1700 1 -- 172.21.15.63:0/4050597461 learned_addr learned my addr 172.21.15.63:0/4050597461 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:04.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.817+0000 7fe35ebf3700 1 -- 172.21.15.63:0/4050597461 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3581362a0 con 0x7fe358065960 2020-05-18T21:29:04.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.817+0000 7fe35d3f0700 1 --2- 172.21.15.63:0/4050597461 >> v2:172.21.15.155:3300/0 conn(0x7fe358065960 0x7fe3581482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:04.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.817+0000 7fe346ffd700 1 -- 172.21.15.63:0/4050597461 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104524661 0 0) 0x7fe358148a50 con 0x7fe3580b2ee0 2020-05-18T21:29:04.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.817+0000 7fe346ffd700 1 -- 172.21.15.63:0/4050597461 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe338002fe0 con 0x7fe3580b2ee0 2020-05-18T21:29:04.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.817+0000 7fe35d3f0700 1 -- 172.21.15.63:0/4050597461 >> v1:172.21.15.155:6789/0 conn(0x7fe358152540 legacy=0x7fe3581535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:04.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.817+0000 7fe35d3f0700 1 -- 172.21.15.63:0/4050597461 >> v1:172.21.15.63:6789/0 conn(0x7fe3580b2ee0 legacy=0x7fe358146da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:04.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.817+0000 7fe35d3f0700 1 -- 172.21.15.63:0/4050597461 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe358153110 con 0x7fe358065960 2020-05-18T21:29:04.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.817+0000 7fe35d3f0700 1 --2- 172.21.15.63:0/4050597461 >> v2:172.21.15.155:3300/0 conn(0x7fe358065960 0x7fe3581482d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe354001420 tx=0x7fe358146640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:04.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.821+0000 7fe35d3f0700 1 --2- 172.21.15.63:0/4050597461 >> v2:172.21.15.155:3300/0 conn(0x7fe358065960 0x7fe3581482d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe354001420 tx=0x7fe358146640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:04.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.821+0000 7fe35d3f0700 1 --2- 172.21.15.63:0/4050597461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe358065960 0x7fe3581482d0 secure :-1 s=READY pgs=478 cs=0 l=1 rx=0x7fe354001420 tx=0x7fe358146640).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:04.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.821+0000 7fe35d3f0700 1 --2- 172.21.15.63:0/4050597461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe358065960 0x7fe3581482d0 secure :-1 s=THROTTLE_DONE pgs=478 cs=0 l=1 rx=0x7fe354001420 tx=0x7fe358146640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:04.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.821+0000 7fe346ffd700 1 -- 172.21.15.63:0/4050597461 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3540045f0 con 0x7fe358065960 2020-05-18T21:29:04.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.821+0000 7fe35d3f0700 1 --2- 172.21.15.63:0/4050597461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe358065960 0x7fe3581482d0 secure :-1 s=THROTTLE_DONE pgs=478 cs=0 l=1 rx=0x7fe354001420 tx=0x7fe358146640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:04.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.821+0000 7fe346ffd700 1 -- 172.21.15.63:0/4050597461 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe354004750 con 0x7fe358065960 2020-05-18T21:29:04.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.821+0000 7fe35d3f0700 1 --2- 172.21.15.63:0/4050597461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe358065960 0x7fe3581482d0 secure :-1 s=THROTTLE_DONE pgs=478 cs=0 l=1 rx=0x7fe354001420 tx=0x7fe358146640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:04.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.821+0000 7fe35ebf3700 1 -- 172.21.15.63:0/4050597461 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe358147510 con 0x7fe358065960 2020-05-18T21:29:04.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.821+0000 7fe346ffd700 1 -- 172.21.15.63:0/4050597461 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe354004ab0 con 0x7fe358065960 2020-05-18T21:29:04.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.821+0000 7fe35ebf3700 1 -- 172.21.15.63:0/4050597461 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe358153cc0 con 0x7fe358065960 2020-05-18T21:29:04.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.821+0000 7fe35d3f0700 1 --2- 172.21.15.63:0/4050597461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe358065960 0x7fe3581482d0 secure :-1 s=THROTTLE_DONE pgs=478 cs=0 l=1 rx=0x7fe354001420 tx=0x7fe358146640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:04.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.821+0000 7fe35ebf3700 1 -- 172.21.15.63:0/4050597461 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3580569e0 con 0x7fe358065960 2020-05-18T21:29:04.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.821+0000 7fe346ffd700 1 -- 172.21.15.63:0/4050597461 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe354004cf0 con 0x7fe358065960 2020-05-18T21:29:04.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.821+0000 7fe35d3f0700 1 --2- 172.21.15.63:0/4050597461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe358065960 0x7fe3581482d0 secure :-1 s=THROTTLE_DONE pgs=478 cs=0 l=1 rx=0x7fe354001420 tx=0x7fe358146640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:04.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.821+0000 7fe346ffd700 1 --2- 172.21.15.63:0/4050597461 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe33804fce0 0x7fe3380521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:04.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.821+0000 7fe346ffd700 1 -- 172.21.15.63:0/4050597461 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fe354063ca0 con 0x7fe358065960 2020-05-18T21:29:04.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.821+0000 7fe35dbf1700 1 --2- 172.21.15.63:0/4050597461 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe33804fce0 0x7fe3380521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:04.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.825+0000 7fe35dbf1700 1 --2- 172.21.15.63:0/4050597461 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe33804fce0 0x7fe3380521a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe3580658b0 tx=0x7fe348010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:04.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.825+0000 7fe35dbf1700 1 --2- 172.21.15.63:0/4050597461 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe33804fce0 0x7fe3380521a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe3580658b0 tx=0x7fe348010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:04.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.825+0000 7fe35dbf1700 1 --2- 172.21.15.63:0/4050597461 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe33804fce0 0x7fe3380521a0 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7fe3580658b0 tx=0x7fe348010110).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:04.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.833+0000 7fe35d3f0700 1 --2- 172.21.15.63:0/4050597461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe358065960 0x7fe3581482d0 secure :-1 s=THROTTLE_DONE pgs=478 cs=0 l=1 rx=0x7fe354001420 tx=0x7fe358146640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.833+0000 7fe346ffd700 1 -- 172.21.15.63:0/4050597461 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe35403dfd0 con 0x7fe358065960 2020-05-18T21:29:04.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:04.953+0000 7fe35ebf3700 1 -- 172.21.15.63:0/4050597461 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe35806a6e0 con 0x7fe358065960 2020-05-18T21:29:05.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.697+0000 7fe35d3f0700 1 --2- 172.21.15.63:0/4050597461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe358065960 0x7fe3581482d0 secure :-1 s=THROTTLE_DONE pgs=478 cs=0 l=1 rx=0x7fe354001420 tx=0x7fe358146640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:05.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.697+0000 7fe346ffd700 1 -- 172.21.15.63:0/4050597461 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) v1 ==== 173+0+0 (secure 0 0 0) 0x7fe3540415f0 con 0x7fe358065960 2020-05-18T21:29:05.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.701+0000 7fe35ebf3700 1 -- 172.21.15.63:0/4050597461 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe33804fce0 msgr2=0x7fe3380521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:05.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.701+0000 7fe35ebf3700 1 --2- 172.21.15.63:0/4050597461 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe33804fce0 0x7fe3380521a0 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7fe3580658b0 tx=0x7fe348010110).stop 2020-05-18T21:29:05.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.701+0000 7fe35ebf3700 1 -- 172.21.15.63:0/4050597461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe358065960 msgr2=0x7fe3581482d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:05.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.701+0000 7fe35ebf3700 1 --2- 172.21.15.63:0/4050597461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe358065960 0x7fe3581482d0 secure :-1 s=READY pgs=478 cs=0 l=1 rx=0x7fe354001420 tx=0x7fe358146640).stop 2020-05-18T21:29:05.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.701+0000 7fe35ebf3700 1 -- 172.21.15.63:0/4050597461 shutdown_connections 2020-05-18T21:29:05.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.701+0000 7fe35ebf3700 1 --2- 172.21.15.63:0/4050597461 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe33804fce0 0x7fe3380521a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:05.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.701+0000 7fe35ebf3700 1 --2- 172.21.15.63:0/4050597461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe358065960 0x7fe3581482d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:05.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.701+0000 7fe35ebf3700 1 -- 172.21.15.63:0/4050597461 >> 172.21.15.63:0/4050597461 conn(0x7fe358069b70 msgr2=0x7fe358061d50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:05.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.701+0000 7fe35ebf3700 1 -- 172.21.15.63:0/4050597461 shutdown_connections 2020-05-18T21:29:05.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.701+0000 7fe35ebf3700 1 -- 172.21.15.63:0/4050597461 wait complete. 2020-05-18T21:29:05.708 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2020-05-18T21:29:05.722 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:29:05.722 INFO:tasks.ceph.mds.a:Stopping old one... 2020-05-18T21:29:05.723 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:29:05.723 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:29:05.723 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:29:05.723 INFO:tasks.ceph.mds.b:Stopping old one... 2020-05-18T21:29:05.724 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:29:05.724 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:29:05.738 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:29:05.738 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:29:05.739 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:29:05.740 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:29:05.741 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:29:05.742 DEBUG:teuthology.parallel:result is None 2020-05-18T21:29:05.743 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:29:05.743 DEBUG:teuthology.parallel:result is None 2020-05-18T21:29:05.744 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-05-18T21:29:05.812 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:29:05.815 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:29:05.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c0b59e700 1 Processor -- start 2020-05-18T21:29:05.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c0b59e700 1 -- start start 2020-05-18T21:29:05.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c0b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c04006bf0 0x7f4c040dbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:05.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c0b59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4c040419c0 0x7f4c04047140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:05.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c0b59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c04040fe0 con 0x7f4c040c1c80 2020-05-18T21:29:05.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c0b59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c04041280 con 0x7f4c040419c0 2020-05-18T21:29:05.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c0b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c04041520 con 0x7f4c04006bf0 2020-05-18T21:29:05.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c0a59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4c040c1c80 0x7f4c040484d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58232/0 (socket says 172.21.15.63:58232) 2020-05-18T21:29:05.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c0a59c700 1 -- 172.21.15.63:0/1011774675 learned_addr learned my addr 172.21.15.63:0/1011774675 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:05.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c09d9b700 1 --2- 172.21.15.63:0/1011774675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c04006bf0 0x7f4c040dbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:05.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c0ad9d700 1 --2- 172.21.15.63:0/1011774675 >> v2:172.21.15.155:3300/0 conn(0x7f4c040419c0 0x7f4c04047140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:05.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c0959a700 1 -- 172.21.15.63:0/1011774675 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282130586 0 0) 0x7f4c04040fe0 con 0x7f4c040c1c80 2020-05-18T21:29:05.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c0959a700 1 -- 172.21.15.63:0/1011774675 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf0003270 con 0x7f4c040c1c80 2020-05-18T21:29:05.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c09d9b700 1 -- 172.21.15.63:0/1011774675 >> v2:172.21.15.155:3300/0 conn(0x7f4c040419c0 msgr2=0x7f4c04047140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:05.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c09d9b700 1 --2- 172.21.15.63:0/1011774675 >> v2:172.21.15.155:3300/0 conn(0x7f4c040419c0 0x7f4c04047140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:05.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c0959a700 1 -- 172.21.15.63:0/1011774675 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2642080133 0 0) 0x7f4bf0003270 con 0x7f4c040c1c80 2020-05-18T21:29:05.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c09d9b700 1 -- 172.21.15.63:0/1011774675 >> v1:172.21.15.63:6789/0 conn(0x7f4c040c1c80 legacy=0x7f4c040484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:05.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c09d9b700 1 -- 172.21.15.63:0/1011774675 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c040c2060 con 0x7f4c04006bf0 2020-05-18T21:29:05.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c09d9b700 1 --2- 172.21.15.63:0/1011774675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c04006bf0 0x7f4c040dbd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4bfc002f70 tx=0x7f4bfc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:05.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c09d9b700 1 --2- 172.21.15.63:0/1011774675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c04006bf0 0x7f4c040dbd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4bfc002f70 tx=0x7f4bfc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:05.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.849+0000 7f4c09d9b700 1 --2- 172.21.15.63:0/1011774675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c04006bf0 0x7f4c040dbd30 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f4bfc002f70 tx=0x7f4bfc007a80).ready entity=mon.2 client_cookie=a958e40ef068543c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:05.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.853+0000 7f4c09d9b700 1 --2- 172.21.15.63:0/1011774675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c04006bf0 0x7f4c040dbd30 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f4bfc002f70 tx=0x7f4bfc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:05.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.853+0000 7f4c0959a700 1 -- 172.21.15.63:0/1011774675 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c0c05ccd0 con 0x7f4c04006bf0 2020-05-18T21:29:05.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.853+0000 7f4c09d9b700 1 --2- 172.21.15.63:0/1011774675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c04006bf0 0x7f4c040dbd30 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f4bfc002f70 tx=0x7f4bfc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:05.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.853+0000 7f4c09d9b700 1 --2- 172.21.15.63:0/1011774675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c04006bf0 0x7f4c040dbd30 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f4bfc002f70 tx=0x7f4bfc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:05.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.853+0000 7f4c0959a700 1 -- 172.21.15.63:0/1011774675 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc008e80 con 0x7f4c04006bf0 2020-05-18T21:29:05.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.853+0000 7f4c0959a700 1 -- 172.21.15.63:0/1011774675 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bfc0116b0 con 0x7f4c04006bf0 2020-05-18T21:29:05.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.853+0000 7f4c0b59e700 1 -- 172.21.15.63:0/1011774675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c04006bf0 msgr2=0x7f4c040dbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:05.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.853+0000 7f4c0b59e700 1 --2- 172.21.15.63:0/1011774675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c04006bf0 0x7f4c040dbd30 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f4bfc002f70 tx=0x7f4bfc007a80).stop 2020-05-18T21:29:05.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.853+0000 7f4c0b59e700 1 -- 172.21.15.63:0/1011774675 shutdown_connections 2020-05-18T21:29:05.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.853+0000 7f4c0b59e700 1 --2- 172.21.15.63:0/1011774675 >> v2:172.21.15.155:3300/0 conn(0x7f4c040419c0 0x7f4c04047140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:05.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.853+0000 7f4c0b59e700 1 --2- 172.21.15.63:0/1011774675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c04006bf0 0x7f4c040dbd30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:05.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.853+0000 7f4c0b59e700 1 -- 172.21.15.63:0/1011774675 >> 172.21.15.63:0/1011774675 conn(0x7f4c04007410 msgr2=0x7f4c040077f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:05.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.853+0000 7f4c0b59e700 1 -- 172.21.15.63:0/1011774675 shutdown_connections 2020-05-18T21:29:05.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.853+0000 7f4c0b59e700 1 -- 172.21.15.63:0/1011774675 wait complete. 2020-05-18T21:29:05.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.853+0000 7f4c0b59e700 1 Processor -- start 2020-05-18T21:29:05.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.853+0000 7f4c0b59e700 1 -- start start 2020-05-18T21:29:05.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4c040419c0 0x7f4c04043a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:05.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0b59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4c040c1c80 0x7f4c040db430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:05.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0b59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c0402efd0 con 0x7f4c04006bf0 2020-05-18T21:29:05.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0b59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c04043080 con 0x7f4c040419c0 2020-05-18T21:29:05.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0b59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0402f270 con 0x7f4c040c1c80 2020-05-18T21:29:05.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c09d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4c040419c0 0x7f4c04043a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:05.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c09d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4c040419c0 0x7f4c04043a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56052/0 (socket says 172.21.15.63:56052) 2020-05-18T21:29:05.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c09d9b700 1 -- 172.21.15.63:0/54404489 learned_addr learned my addr 172.21.15.63:0/54404489 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:05.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0ad9d700 1 --2- 172.21.15.63:0/54404489 >> v2:172.21.15.155:3300/0 conn(0x7f4c040c1c80 0x7f4c040db430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:05.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4bfb7fe700 1 -- 172.21.15.63:0/54404489 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894315600 0 0) 0x7f4c0402efd0 con 0x7f4c04006bf0 2020-05-18T21:29:05.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4bfb7fe700 1 -- 172.21.15.63:0/54404489 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be8002fe0 con 0x7f4c04006bf0 2020-05-18T21:29:05.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0ad9d700 1 -- 172.21.15.63:0/54404489 >> v2:172.21.15.63:3300/0 conn(0x7f4c040419c0 msgr2=0x7f4c04043a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:05.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0ad9d700 1 --2- 172.21.15.63:0/54404489 >> v2:172.21.15.63:3300/0 conn(0x7f4c040419c0 0x7f4c04043a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:05.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0ad9d700 1 -- 172.21.15.63:0/54404489 >> v1:172.21.15.155:6789/0 conn(0x7f4c04006bf0 legacy=0x7f4c04043330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:05.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0ad9d700 1 -- 172.21.15.63:0/54404489 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c04042ce0 con 0x7f4c040c1c80 2020-05-18T21:29:05.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c09d9b700 1 --2- 172.21.15.63:0/54404489 >> v2:172.21.15.63:3300/0 conn(0x7f4c040419c0 0x7f4c04043a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:29:05.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0ad9d700 1 --2- 172.21.15.63:0/54404489 >> v2:172.21.15.155:3300/0 conn(0x7f4c040c1c80 0x7f4c040db430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4c00002f70 tx=0x7f4c00010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:05.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0ad9d700 1 --2- 172.21.15.63:0/54404489 >> v2:172.21.15.155:3300/0 conn(0x7f4c040c1c80 0x7f4c040db430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4c00002f70 tx=0x7f4c00010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:05.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0ad9d700 1 --2- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c040c1c80 0x7f4c040db430 secure :-1 s=READY pgs=482 cs=0 l=1 rx=0x7f4c00002f70 tx=0x7f4c00010b60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:05.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0ad9d700 1 --2- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c040c1c80 0x7f4c040db430 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7f4c00002f70 tx=0x7f4c00010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:05.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4bfb7fe700 1 -- 172.21.15.63:0/54404489 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c00007180 con 0x7f4c040c1c80 2020-05-18T21:29:05.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0ad9d700 1 --2- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c040c1c80 0x7f4c040db430 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7f4c00002f70 tx=0x7f4c00010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:05.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4bfb7fe700 1 -- 172.21.15.63:0/54404489 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c000072e0 con 0x7f4c040c1c80 2020-05-18T21:29:05.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0ad9d700 1 --2- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c040c1c80 0x7f4c040db430 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7f4c00002f70 tx=0x7f4c00010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:05.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0b59e700 1 -- 172.21.15.63:0/54404489 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c040daff0 con 0x7f4c040c1c80 2020-05-18T21:29:05.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4bfb7fe700 1 -- 172.21.15.63:0/54404489 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c000089b0 con 0x7f4c040c1c80 2020-05-18T21:29:05.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0b59e700 1 -- 172.21.15.63:0/54404489 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c04044620 con 0x7f4c040c1c80 2020-05-18T21:29:05.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0ad9d700 1 --2- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c040c1c80 0x7f4c040db430 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7f4c00002f70 tx=0x7f4c00010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:05.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0b59e700 1 -- 172.21.15.63:0/54404489 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c04044930 con 0x7f4c040c1c80 2020-05-18T21:29:05.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4bfb7fe700 1 -- 172.21.15.63:0/54404489 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4c00008bb0 con 0x7f4c040c1c80 2020-05-18T21:29:05.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.857+0000 7f4c0ad9d700 1 --2- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c040c1c80 0x7f4c040db430 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7f4c00002f70 tx=0x7f4c00010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:05.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.861+0000 7f4bfb7fe700 1 --2- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4be804fce0 0x7f4be80521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:05.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.861+0000 7f4bfb7fe700 1 -- 172.21.15.63:0/54404489 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f4c00063b10 con 0x7f4c040c1c80 2020-05-18T21:29:05.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.861+0000 7f4c0a59c700 1 --2- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4be804fce0 0x7f4be80521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:05.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.861+0000 7f4c0a59c700 1 --2- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4be804fce0 0x7f4be80521a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4c0402e2d0 tx=0x7f4c0c05d220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:05.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.861+0000 7f4c0a59c700 1 --2- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4be804fce0 0x7f4be80521a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4c0402e2d0 tx=0x7f4c0c05d220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:05.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.861+0000 7f4c0a59c700 1 --2- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4be804fce0 0x7f4be80521a0 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7f4c0402e2d0 tx=0x7f4c0c05d220).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:05.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.865+0000 7f4c0ad9d700 1 --2- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c040c1c80 0x7f4c040db430 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7f4c00002f70 tx=0x7f4c00010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:05.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.865+0000 7f4bfb7fe700 1 -- 172.21.15.63:0/54404489 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f4c0003dea0 con 0x7f4c040c1c80 2020-05-18T21:29:05.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:05.989+0000 7f4c0b59e700 1 -- 172.21.15.63:0/54404489 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f4c04004d00 con 0x7f4c040c1c80 2020-05-18T21:29:06.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.857+0000 7f4c0ad9d700 1 --2- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c040c1c80 0x7f4c040db430 secure :-1 s=READY pgs=482 cs=0 l=1 rx=0x7f4c00002f70 tx=0x7f4c00010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:06.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.861+0000 7f4c0ad9d700 1 --2- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c040c1c80 0x7f4c040db430 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7f4c00002f70 tx=0x7f4c00010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:06.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.861+0000 7f4bfb7fe700 1 -- 172.21.15.63:0/54404489 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v57) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4c000414c0 con 0x7f4c040c1c80 2020-05-18T21:29:06.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.865+0000 7f4c0b59e700 1 -- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4be804fce0 msgr2=0x7f4be80521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:06.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.865+0000 7f4c0b59e700 1 --2- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4be804fce0 0x7f4be80521a0 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7f4c0402e2d0 tx=0x7f4c0c05d220).stop 2020-05-18T21:29:06.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.865+0000 7f4c0b59e700 1 -- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c040c1c80 msgr2=0x7f4c040db430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:06.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.865+0000 7f4c0b59e700 1 --2- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c040c1c80 0x7f4c040db430 secure :-1 s=READY pgs=482 cs=0 l=1 rx=0x7f4c00002f70 tx=0x7f4c00010b60).stop 2020-05-18T21:29:06.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.865+0000 7f4c0b59e700 1 -- 172.21.15.63:0/54404489 shutdown_connections 2020-05-18T21:29:06.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.865+0000 7f4c0b59e700 1 --2- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4be804fce0 0x7f4be80521a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:06.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.865+0000 7f4c0b59e700 1 --2- 172.21.15.63:0/54404489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c040c1c80 0x7f4c040db430 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:06.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.865+0000 7f4c0b59e700 1 --2- 172.21.15.63:0/54404489 >> v2:172.21.15.63:3300/0 conn(0x7f4c040419c0 0x7f4c04043a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:06.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.865+0000 7f4c0b59e700 1 -- 172.21.15.63:0/54404489 >> 172.21.15.63:0/54404489 conn(0x7f4c04007410 msgr2=0x7f4c040db930 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:06.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.865+0000 7f4c0b59e700 1 -- 172.21.15.63:0/54404489 shutdown_connections 2020-05-18T21:29:06.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.865+0000 7f4c0b59e700 1 -- 172.21.15.63:0/54404489 wait complete. 2020-05-18T21:29:06.873 INFO:teuthology.orchestra.run.smithi063.stderr: removed all blacklist entries 2020-05-18T21:29:06.886 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-05-18T21:29:06.886 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-05-18T21:29:06.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.989+0000 7f0a419d8700 1 Processor -- start 2020-05-18T21:29:06.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.989+0000 7f0a419d8700 1 -- start start 2020-05-18T21:29:06.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.989+0000 7f0a419d8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b4f60 0x7f0a3c149f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:06.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.989+0000 7f0a419d8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0a3c146110 0x7f0a3c146580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:06.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.989+0000 7f0a419d8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c0637b0 con 0x7f0a3c0b5c00 2020-05-18T21:29:06.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.989+0000 7f0a419d8700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c063a50 con 0x7f0a3c146110 2020-05-18T21:29:06.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.989+0000 7f0a419d8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c0bb4a0 con 0x7f0a3c0b4f60 2020-05-18T21:29:07.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a3b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0a3c146110 0x7f0a3c146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:07.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a3affd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0a3c0b5c00 0x7f0a3c0b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58248/0 (socket says 172.21.15.63:58248) 2020-05-18T21:29:07.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a3affd700 1 -- 172.21.15.63:0/394912620 learned_addr learned my addr 172.21.15.63:0/394912620 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:07.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a3a7fc700 1 --2- 172.21.15.63:0/394912620 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b4f60 0x7f0a3c149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:07.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a3b7fe700 1 -- 172.21.15.63:0/394912620 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b4f60 msgr2=0x7f0a3c149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:07.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a3b7fe700 1 --2- 172.21.15.63:0/394912620 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b4f60 0x7f0a3c149f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:07.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a3b7fe700 1 -- 172.21.15.63:0/394912620 >> v1:172.21.15.63:6789/0 conn(0x7f0a3c0b5c00 legacy=0x7f0a3c0b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a39ffb700 1 -- 172.21.15.63:0/394912620 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161420526 0 0) 0x7f0a3c0637b0 con 0x7f0a3c0b5c00 2020-05-18T21:29:07.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a3b7fe700 1 -- 172.21.15.63:0/394912620 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c063200 con 0x7f0a3c146110 2020-05-18T21:29:07.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a3b7fe700 1 --2- 172.21.15.63:0/394912620 >> v2:172.21.15.63:3300/0 conn(0x7f0a3c146110 0x7f0a3c146580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0a340032f0 tx=0x7f0a34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a3b7fe700 1 --2- 172.21.15.63:0/394912620 >> v2:172.21.15.63:3300/0 conn(0x7f0a3c146110 0x7f0a3c146580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0a340032f0 tx=0x7f0a34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a3b7fe700 1 --2- 172.21.15.63:0/394912620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a3c146110 0x7f0a3c146580 secure :-1 s=READY pgs=671 cs=0 l=1 rx=0x7f0a340032f0 tx=0x7f0a34007e00).ready entity=mon.0 client_cookie=84f0fe3a3fc37eac server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:07.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a3b7fe700 1 --2- 172.21.15.63:0/394912620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a3c146110 0x7f0a3c146580 secure :-1 s=THROTTLE_DONE pgs=671 cs=0 l=1 rx=0x7f0a340032f0 tx=0x7f0a34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a39ffb700 1 -- 172.21.15.63:0/394912620 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a34011e60 con 0x7f0a3c146110 2020-05-18T21:29:07.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a3b7fe700 1 --2- 172.21.15.63:0/394912620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a3c146110 0x7f0a3c146580 secure :-1 s=THROTTLE_DONE pgs=671 cs=0 l=1 rx=0x7f0a340032f0 tx=0x7f0a34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a3b7fe700 1 --2- 172.21.15.63:0/394912620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a3c146110 0x7f0a3c146580 secure :-1 s=THROTTLE_DONE pgs=671 cs=0 l=1 rx=0x7f0a340032f0 tx=0x7f0a34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a39ffb700 1 -- 172.21.15.63:0/394912620 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3400a180 con 0x7f0a3c146110 2020-05-18T21:29:07.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a39ffb700 1 -- 172.21.15.63:0/394912620 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a3400a520 con 0x7f0a3c146110 2020-05-18T21:29:07.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a419d8700 1 -- 172.21.15.63:0/394912620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a3c146110 msgr2=0x7f0a3c146580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a419d8700 1 --2- 172.21.15.63:0/394912620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a3c146110 0x7f0a3c146580 secure :-1 s=READY pgs=671 cs=0 l=1 rx=0x7f0a340032f0 tx=0x7f0a34007e00).stop 2020-05-18T21:29:07.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a419d8700 1 -- 172.21.15.63:0/394912620 shutdown_connections 2020-05-18T21:29:07.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a419d8700 1 --2- 172.21.15.63:0/394912620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a3c146110 0x7f0a3c146580 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:07.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a419d8700 1 --2- 172.21.15.63:0/394912620 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b4f60 0x7f0a3c149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:07.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a419d8700 1 -- 172.21.15.63:0/394912620 >> 172.21.15.63:0/394912620 conn(0x7f0a3c0ba5c0 msgr2=0x7f0a3c0ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:07.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a419d8700 1 -- 172.21.15.63:0/394912620 shutdown_connections 2020-05-18T21:29:07.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.993+0000 7f0a419d8700 1 -- 172.21.15.63:0/394912620 wait complete. 2020-05-18T21:29:07.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a419d8700 1 Processor -- start 2020-05-18T21:29:07.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a419d8700 1 -- start start 2020-05-18T21:29:07.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a419d8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b5c00 0x7f0a3c1441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:07.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a419d8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0a3c146110 0x7f0a3c1479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:07.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a419d8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c147e40 con 0x7f0a3c0b4f60 2020-05-18T21:29:07.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a419d8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c1413a0 con 0x7f0a3c146110 2020-05-18T21:29:07.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a419d8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c0b1ba0 con 0x7f0a3c0b5c00 2020-05-18T21:29:07.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a3b7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0a3c146110 0x7f0a3c1479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:07.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a3a7fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b5c00 0x7f0a3c1441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:07.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a3affd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f0a3c0b4f60 0x7f0a3c12ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:56570/0 (socket says 172.21.15.63:56570) 2020-05-18T21:29:07.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a3affd700 1 -- 172.21.15.63:0/1971242901 learned_addr learned my addr 172.21.15.63:0/1971242901 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:07.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a33fff700 1 -- 172.21.15.63:0/1971242901 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920467854 0 0) 0x7f0a3c147e40 con 0x7f0a3c0b4f60 2020-05-18T21:29:07.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a33fff700 1 -- 172.21.15.63:0/1971242901 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a20002fe0 con 0x7f0a3c0b4f60 2020-05-18T21:29:07.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a3a7fc700 1 -- 172.21.15.63:0/1971242901 >> v2:172.21.15.155:3300/0 conn(0x7f0a3c146110 msgr2=0x7f0a3c1479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a3a7fc700 1 --2- 172.21.15.63:0/1971242901 >> v2:172.21.15.155:3300/0 conn(0x7f0a3c146110 0x7f0a3c1479e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:07.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a3a7fc700 1 -- 172.21.15.63:0/1971242901 >> v1:172.21.15.155:6789/0 conn(0x7f0a3c0b4f60 legacy=0x7f0a3c12ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a3a7fc700 1 -- 172.21.15.63:0/1971242901 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c0b1e40 con 0x7f0a3c0b5c00 2020-05-18T21:29:07.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a3a7fc700 1 --2- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b5c00 0x7f0a3c1441e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0a2c002f70 tx=0x7f0a2c010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a3a7fc700 1 --2- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b5c00 0x7f0a3c1441e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0a2c002f70 tx=0x7f0a2c010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a3a7fc700 1 --2- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b5c00 0x7f0a3c1441e0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f0a2c002f70 tx=0x7f0a2c010bf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:07.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a3a7fc700 1 --2- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b5c00 0x7f0a3c1441e0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f0a2c002f70 tx=0x7f0a2c010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:06.997+0000 7f0a33fff700 1 -- 172.21.15.63:0/1971242901 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a2c007550 con 0x7f0a3c0b5c00 2020-05-18T21:29:07.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.001+0000 7f0a3a7fc700 1 --2- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b5c00 0x7f0a3c1441e0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f0a2c002f70 tx=0x7f0a2c010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.001+0000 7f0a33fff700 1 -- 172.21.15.63:0/1971242901 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c005700 con 0x7f0a3c0b5c00 2020-05-18T21:29:07.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.001+0000 7f0a3a7fc700 1 --2- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b5c00 0x7f0a3c1441e0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f0a2c002f70 tx=0x7f0a2c010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.001+0000 7f0a419d8700 1 -- 172.21.15.63:0/1971242901 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3c0b20e0 con 0x7f0a3c0b5c00 2020-05-18T21:29:07.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.001+0000 7f0a33fff700 1 -- 172.21.15.63:0/1971242901 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a2c005b20 con 0x7f0a3c0b5c00 2020-05-18T21:29:07.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.001+0000 7f0a419d8700 1 -- 172.21.15.63:0/1971242901 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3c12d570 con 0x7f0a3c0b5c00 2020-05-18T21:29:07.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.001+0000 7f0a3a7fc700 1 --2- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b5c00 0x7f0a3c1441e0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f0a2c002f70 tx=0x7f0a2c010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.001+0000 7f0a419d8700 1 -- 172.21.15.63:0/1971242901 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3c0569e0 con 0x7f0a3c0b5c00 2020-05-18T21:29:07.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.001+0000 7f0a33fff700 1 -- 172.21.15.63:0/1971242901 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0a2c00c5c0 con 0x7f0a3c0b5c00 2020-05-18T21:29:07.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.001+0000 7f0a3a7fc700 1 --2- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b5c00 0x7f0a3c1441e0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f0a2c002f70 tx=0x7f0a2c010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.001+0000 7f0a33fff700 1 --2- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0a2004fd40 0x7f0a20052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:07.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.001+0000 7f0a33fff700 1 -- 172.21.15.63:0/1971242901 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f0a2c063e20 con 0x7f0a3c0b5c00 2020-05-18T21:29:07.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.001+0000 7f0a3affd700 1 --2- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0a2004fd40 0x7f0a20052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:07.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.005+0000 7f0a3affd700 1 --2- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0a2004fd40 0x7f0a20052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0a24005560 tx=0x7f0a240016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.005+0000 7f0a3affd700 1 --2- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0a2004fd40 0x7f0a20052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0a24005560 tx=0x7f0a240016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.005+0000 7f0a3affd700 1 --2- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0a2004fd40 0x7f0a20052200 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7f0a24005560 tx=0x7f0a240016e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:07.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.009+0000 7f0a3a7fc700 1 --2- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b5c00 0x7f0a3c1441e0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f0a2c002f70 tx=0x7f0a2c010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.013+0000 7f0a33fff700 1 -- 172.21.15.63:0/1971242901 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f0a2c03e150 con 0x7f0a3c0b5c00 2020-05-18T21:29:07.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.161+0000 7f0a419d8700 1 -- 172.21.15.63:0/1971242901 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0a3c0b5390 con 0x7f0a3c0b5c00 2020-05-18T21:29:07.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.165+0000 7f0a3a7fc700 1 --2- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b5c00 0x7f0a3c1441e0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f0a2c002f70 tx=0x7f0a2c010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.165+0000 7f0a33fff700 1 -- 172.21.15.63:0/1971242901 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+4513 (secure 0 0 0) 0x7f0a2c041770 con 0x7f0a3c0b5c00 2020-05-18T21:29:07.170 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:07.170 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:29:07.170 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_dump": [ 2020-05-18T21:29:07.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:07.171 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.a", 2020-05-18T21:29:07.171 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJekJyyLRAAfB5XJCsXTAmZdkFOaQrokg==", 2020-05-18T21:29:07.171 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:29:07.171 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:29:07.171 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:29:07.172 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:29:07.172 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:29:07.172 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:07.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:07.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:07.172 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.b", 2020-05-18T21:29:07.173 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeSVE8MRAAEEytuzLtcQMC+1uQ/yh8eA==", 2020-05-18T21:29:07.173 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:29:07.173 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:29:07.173 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:29:07.173 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:29:07.174 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:29:07.174 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:07.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:07.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:07.174 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.0", 2020-05-18T21:29:07.175 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBq/cJeIn7mJhAArx+YEdVbsfXXNOLWdaAgWw==", 2020-05-18T21:29:07.175 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:29:07.175 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:29:07.175 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:29:07.175 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:29:07.176 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:07.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:07.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:07.176 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.1", 2020-05-18T21:29:07.176 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBt/cJelHywCRAAFyQ3sPEE0RTSy4tKfsDfyw==", 2020-05-18T21:29:07.176 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:29:07.177 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:29:07.177 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:29:07.177 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:29:07.177 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:07.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:07.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:07.178 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.2", 2020-05-18T21:29:07.178 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBv/cJecexDLBAAxhlFq20MBkKvDjuM1yi8XQ==", 2020-05-18T21:29:07.178 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:29:07.178 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:29:07.178 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:29:07.179 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:29:07.179 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:07.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:07.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:07.179 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.3", 2020-05-18T21:29:07.180 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBy/cJe9IqwDxAAMg1In7bIITDcOZljzzTpDQ==", 2020-05-18T21:29:07.180 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:29:07.180 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:29:07.180 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:29:07.180 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:29:07.181 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:07.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:07.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:07.181 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.4", 2020-05-18T21:29:07.181 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB3/cJeLXgxFhAA/kMVV5hCRny2uXKvvbu8Og==", 2020-05-18T21:29:07.181 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:29:07.182 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:29:07.182 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:29:07.182 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:29:07.182 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:07.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:07.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:07.183 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.5", 2020-05-18T21:29:07.183 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB5/cJeucpsNRAAjGh+6yUC8Fji9PE4COi/Eg==", 2020-05-18T21:29:07.183 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:29:07.183 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:29:07.183 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:29:07.184 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:29:07.184 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:07.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:07.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:07.184 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.6", 2020-05-18T21:29:07.185 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB8/cJelSPpGhAAXobGqH9qaW1VZfEpH8bUbQ==", 2020-05-18T21:29:07.185 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:29:07.185 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:29:07.185 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:29:07.185 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:29:07.186 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:07.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:07.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:07.186 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.7", 2020-05-18T21:29:07.186 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB+/cJeUIl5OBAAPd8H8ohOWZw9ubO7uCB6zg==", 2020-05-18T21:29:07.187 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:29:07.187 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:29:07.187 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:29:07.187 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:29:07.187 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:07.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:07.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:07.188 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.0", 2020-05-18T21:29:07.188 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeap3RNhAAi2vKpsKtzSL1Uuqm8pWYJQ==", 2020-05-18T21:29:07.188 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:29:07.188 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:29:07.189 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:29:07.189 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:29:07.189 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:07.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:07.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:07.190 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.1", 2020-05-18T21:29:07.190 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJeekrQABAA5TmzWOt24C6hgZw/WTj5dw==", 2020-05-18T21:29:07.190 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:29:07.190 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:29:07.190 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:29:07.190 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:29:07.191 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:07.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:07.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:07.191 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.2", 2020-05-18T21:29:07.191 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJehSnFAxAAXUZwqNTXqAApEB3nXs4u6g==", 2020-05-18T21:29:07.192 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:29:07.192 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:29:07.192 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:29:07.192 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:29:07.192 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:07.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:07.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:07.193 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.3", 2020-05-18T21:29:07.193 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJe2HdDBhAA07y5pn/bKKa9TBbZFvIh9g==", 2020-05-18T21:29:07.193 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:29:07.193 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:29:07.194 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:29:07.194 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:29:07.194 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:07.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:07.194 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:07.195 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.admin", 2020-05-18T21:29:07.195 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJe/K4fGRAA+rP3BYuWiyx/fKmQ3bV6Lw==", 2020-05-18T21:29:07.195 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:29:07.195 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:29:07.195 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:29:07.195 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:29:07.196 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:29:07.196 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:07.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:07.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:07.196 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.x", 2020-05-18T21:29:07.197 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJemmqEKhAAe5ySRz8Id0ug4matQwL0uw==", 2020-05-18T21:29:07.197 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:29:07.197 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:29:07.197 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:29:07.197 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:29:07.198 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:07.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:07.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:07.198 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.y", 2020-05-18T21:29:07.198 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeF/BNJhAAi/vrldC6qoWJWnSHpE3ung==", 2020-05-18T21:29:07.198 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:29:07.199 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:29:07.199 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:29:07.199 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:29:07.199 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:07.199 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:07.200 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:07.200 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:29:07.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.165+0000 7f0a419d8700 1 -- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0a2004fd40 msgr2=0x7f0a20052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.165+0000 7f0a419d8700 1 --2- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0a2004fd40 0x7f0a20052200 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7f0a24005560 tx=0x7f0a240016e0).stop 2020-05-18T21:29:07.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.165+0000 7f0a419d8700 1 -- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b5c00 msgr2=0x7f0a3c1441e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.165+0000 7f0a419d8700 1 --2- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b5c00 0x7f0a3c1441e0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f0a2c002f70 tx=0x7f0a2c010bf0).stop 2020-05-18T21:29:07.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.165+0000 7f0a419d8700 1 -- 172.21.15.63:0/1971242901 shutdown_connections 2020-05-18T21:29:07.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.165+0000 7f0a419d8700 1 --2- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0a2004fd40 0x7f0a20052200 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:07.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.165+0000 7f0a419d8700 1 --2- 172.21.15.63:0/1971242901 >> v2:172.21.15.155:3300/0 conn(0x7f0a3c146110 0x7f0a3c1479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:07.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.165+0000 7f0a419d8700 1 --2- 172.21.15.63:0/1971242901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0b5c00 0x7f0a3c1441e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:07.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.165+0000 7f0a419d8700 1 -- 172.21.15.63:0/1971242901 >> 172.21.15.63:0/1971242901 conn(0x7f0a3c0ba5c0 msgr2=0x7f0a3c1487d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:07.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.165+0000 7f0a419d8700 1 -- 172.21.15.63:0/1971242901 shutdown_connections 2020-05-18T21:29:07.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.165+0000 7f0a419d8700 1 -- 172.21.15.63:0/1971242901 wait complete. 2020-05-18T21:29:07.204 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:29:07.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6464c5e700 1 Processor -- start 2020-05-18T21:29:07.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6464c5e700 1 -- start start 2020-05-18T21:29:07.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6464c5e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6460060310 0x7f64601492f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:07.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6464c5e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6460145cc0 con 0x7f6460149db0 2020-05-18T21:29:07.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6464c5e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646014a190 con 0x7f64601468f0 2020-05-18T21:29:07.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6464c5e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6460060fd0 con 0x7f6460060310 2020-05-18T21:29:07.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6457fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6460060310 0x7f64601492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:07.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6457fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6460060310 0x7f64601492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56076/0 (socket says 172.21.15.63:56076) 2020-05-18T21:29:07.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f645f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6460149db0 0x7f64600b6e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58262/0 (socket says 172.21.15.63:58262) 2020-05-18T21:29:07.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6457fff700 1 -- 172.21.15.63:0/2935979897 learned_addr learned my addr 172.21.15.63:0/2935979897 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:07.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f645effd700 1 -- 172.21.15.63:0/2935979897 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563751797 0 0) 0x7f6460145cc0 con 0x7f6460149db0 2020-05-18T21:29:07.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f645effd700 1 -- 172.21.15.63:0/2935979897 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6440003270 con 0x7f6460149db0 2020-05-18T21:29:07.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f645effd700 1 -- 172.21.15.63:0/2935979897 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3875305108 0 0) 0x7f646014a190 con 0x7f64601468f0 2020-05-18T21:29:07.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f645effd700 1 -- 172.21.15.63:0/2935979897 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6460145cc0 con 0x7f64601468f0 2020-05-18T21:29:07.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f645effd700 1 -- 172.21.15.63:0/2935979897 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3604154534 0 0) 0x7f6440003270 con 0x7f6460149db0 2020-05-18T21:29:07.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6457fff700 1 -- 172.21.15.63:0/2935979897 >> v1:172.21.15.155:6789/0 conn(0x7f64601468f0 legacy=0x7f64600628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6457fff700 1 -- 172.21.15.63:0/2935979897 >> v1:172.21.15.63:6789/0 conn(0x7f6460149db0 legacy=0x7f64600b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6457fff700 1 -- 172.21.15.63:0/2935979897 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6460145f10 con 0x7f6460060310 2020-05-18T21:29:07.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6457fff700 1 --2- 172.21.15.63:0/2935979897 >> v2:172.21.15.63:3300/0 conn(0x7f6460060310 0x7f64601492f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f64500011d0 tx=0x7f6448007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6457fff700 1 --2- 172.21.15.63:0/2935979897 >> v2:172.21.15.63:3300/0 conn(0x7f6460060310 0x7f64601492f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f64500011d0 tx=0x7f6448007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6457fff700 1 --2- 172.21.15.63:0/2935979897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6460060310 0x7f64601492f0 secure :-1 s=READY pgs=673 cs=0 l=1 rx=0x7f64500011d0 tx=0x7f6448007a80).ready entity=mon.0 client_cookie=26ece06df751d506 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:07.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6457fff700 1 --2- 172.21.15.63:0/2935979897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6460060310 0x7f64601492f0 secure :-1 s=THROTTLE_DONE pgs=673 cs=0 l=1 rx=0x7f64500011d0 tx=0x7f6448007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f645effd700 1 -- 172.21.15.63:0/2935979897 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64500017d0 con 0x7f6460060310 2020-05-18T21:29:07.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6457fff700 1 --2- 172.21.15.63:0/2935979897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6460060310 0x7f64601492f0 secure :-1 s=THROTTLE_DONE pgs=673 cs=0 l=1 rx=0x7f64500011d0 tx=0x7f6448007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6457fff700 1 --2- 172.21.15.63:0/2935979897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6460060310 0x7f64601492f0 secure :-1 s=THROTTLE_DONE pgs=673 cs=0 l=1 rx=0x7f64500011d0 tx=0x7f6448007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f645effd700 1 -- 172.21.15.63:0/2935979897 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6448011310 con 0x7f6460060310 2020-05-18T21:29:07.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f645effd700 1 -- 172.21.15.63:0/2935979897 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64480116b0 con 0x7f6460060310 2020-05-18T21:29:07.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6464c5e700 1 -- 172.21.15.63:0/2935979897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6460060310 msgr2=0x7f64601492f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.305+0000 7f6464c5e700 1 --2- 172.21.15.63:0/2935979897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6460060310 0x7f64601492f0 secure :-1 s=READY pgs=673 cs=0 l=1 rx=0x7f64500011d0 tx=0x7f6448007a80).stop 2020-05-18T21:29:07.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.309+0000 7f6464c5e700 1 -- 172.21.15.63:0/2935979897 shutdown_connections 2020-05-18T21:29:07.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.309+0000 7f6464c5e700 1 --2- 172.21.15.63:0/2935979897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6460060310 0x7f64601492f0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:07.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.309+0000 7f6464c5e700 1 -- 172.21.15.63:0/2935979897 >> 172.21.15.63:0/2935979897 conn(0x7f646005eee0 msgr2=0x7f646005f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:07.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.309+0000 7f6464c5e700 1 -- 172.21.15.63:0/2935979897 shutdown_connections 2020-05-18T21:29:07.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.309+0000 7f6464c5e700 1 -- 172.21.15.63:0/2935979897 wait complete. 2020-05-18T21:29:07.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.309+0000 7f6464c5e700 1 Processor -- start 2020-05-18T21:29:07.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.309+0000 7f6464c5e700 1 -- start start 2020-05-18T21:29:07.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f6464c5e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64601468f0 0x7f6460152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:07.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f6464c5e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64601402f0 con 0x7f6460149db0 2020-05-18T21:29:07.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f6464c5e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6460140a60 con 0x7f6460060310 2020-05-18T21:29:07.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f6464c5e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6460140520 con 0x7f64601468f0 2020-05-18T21:29:07.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f645ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6460149db0 0x7f646013db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58272/0 (socket says 172.21.15.63:58272) 2020-05-18T21:29:07.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f645ffff700 1 -- 172.21.15.63:0/3215198635 learned_addr learned my addr 172.21.15.63:0/3215198635 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:07.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f6457fff700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64601468f0 0x7f6460152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:07.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f645d7fa700 1 -- 172.21.15.63:0/3215198635 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253230159 0 0) 0x7f64601402f0 con 0x7f6460149db0 2020-05-18T21:29:07.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f645d7fa700 1 -- 172.21.15.63:0/3215198635 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6444002fe0 con 0x7f6460149db0 2020-05-18T21:29:07.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f645d7fa700 1 -- 172.21.15.63:0/3215198635 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911396361 0 0) 0x7f6460140a60 con 0x7f6460060310 2020-05-18T21:29:07.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f645d7fa700 1 -- 172.21.15.63:0/3215198635 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64601402f0 con 0x7f6460060310 2020-05-18T21:29:07.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f6457fff700 1 -- 172.21.15.63:0/3215198635 >> v1:172.21.15.155:6789/0 conn(0x7f6460060310 legacy=0x7f6460148db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f6457fff700 1 -- 172.21.15.63:0/3215198635 >> v1:172.21.15.63:6789/0 conn(0x7f6460149db0 legacy=0x7f646013db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f6457fff700 1 -- 172.21.15.63:0/3215198635 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64601407c0 con 0x7f64601468f0 2020-05-18T21:29:07.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f6457fff700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64601468f0 0x7f6460152b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f64500011d0 tx=0x7f6448007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f6457fff700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64601468f0 0x7f6460152b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f64500011d0 tx=0x7f6448007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f6457fff700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64601468f0 0x7f6460152b60 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f64500011d0 tx=0x7f6448007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:07.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f6457fff700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64601468f0 0x7f6460152b60 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f64500011d0 tx=0x7f6448007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f645d7fa700 1 -- 172.21.15.63:0/3215198635 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f644800f7a0 con 0x7f64601468f0 2020-05-18T21:29:07.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f6457fff700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64601468f0 0x7f6460152b60 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f64500011d0 tx=0x7f6448007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f6457fff700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64601468f0 0x7f6460152b60 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f64500011d0 tx=0x7f6448007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f645d7fa700 1 -- 172.21.15.63:0/3215198635 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644800f900 con 0x7f64601468f0 2020-05-18T21:29:07.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f6464c5e700 1 -- 172.21.15.63:0/3215198635 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6460152fc0 con 0x7f64601468f0 2020-05-18T21:29:07.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f645d7fa700 1 -- 172.21.15.63:0/3215198635 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64480125a0 con 0x7f64601468f0 2020-05-18T21:29:07.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f6464c5e700 1 -- 172.21.15.63:0/3215198635 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64601474d0 con 0x7f64601468f0 2020-05-18T21:29:07.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f6457fff700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64601468f0 0x7f6460152b60 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f64500011d0 tx=0x7f6448007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.313+0000 7f6464c5e700 1 -- 172.21.15.63:0/3215198635 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64600569e0 con 0x7f64601468f0 2020-05-18T21:29:07.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.317+0000 7f645d7fa700 1 -- 172.21.15.63:0/3215198635 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f64480127d0 con 0x7f64601468f0 2020-05-18T21:29:07.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.317+0000 7f6457fff700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64601468f0 0x7f6460152b60 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f64500011d0 tx=0x7f6448007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.317+0000 7f645d7fa700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f644404fef0 0x7f64440523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:07.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.317+0000 7f645d7fa700 1 -- 172.21.15.63:0/3215198635 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6448064620 con 0x7f64601468f0 2020-05-18T21:29:07.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.317+0000 7f645f7fe700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f644404fef0 0x7f64440523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:07.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.317+0000 7f645f7fe700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f644404fef0 0x7f64440523b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f64500019b0 tx=0x7f6460066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.317+0000 7f645f7fe700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f644404fef0 0x7f64440523b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f64500019b0 tx=0x7f6460066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.317+0000 7f645f7fe700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f644404fef0 0x7f64440523b0 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f64500019b0 tx=0x7f6460066620).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:07.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.325+0000 7f6457fff700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64601468f0 0x7f6460152b60 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f64500011d0 tx=0x7f6448007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.325+0000 7f645d7fa700 1 -- 172.21.15.63:0/3215198635 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f644803ea10 con 0x7f64601468f0 2020-05-18T21:29:07.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.445+0000 7f6464c5e700 1 -- 172.21.15.63:0/3215198635 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64600008d0 con 0x7f64601468f0 2020-05-18T21:29:07.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.445+0000 7f6457fff700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64601468f0 0x7f6460152b60 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f64500011d0 tx=0x7f6448007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.445+0000 7f645d7fa700 1 -- 172.21.15.63:0/3215198635 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+13233 (secure 0 0 0) 0x7f6448042030 con 0x7f64601468f0 2020-05-18T21:29:07.453 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:07.453 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":57,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:29:06.856150+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:29:07.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.449+0000 7f6464c5e700 1 -- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f644404fef0 msgr2=0x7f64440523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.449+0000 7f6464c5e700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f644404fef0 0x7f64440523b0 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f64500019b0 tx=0x7f6460066620).stop 2020-05-18T21:29:07.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.449+0000 7f6464c5e700 1 -- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64601468f0 msgr2=0x7f6460152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.449+0000 7f6464c5e700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64601468f0 0x7f6460152b60 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f64500011d0 tx=0x7f6448007a80).stop 2020-05-18T21:29:07.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.449+0000 7f6464c5e700 1 -- 172.21.15.63:0/3215198635 shutdown_connections 2020-05-18T21:29:07.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.449+0000 7f6464c5e700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f644404fef0 0x7f64440523b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:07.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.449+0000 7f6464c5e700 1 --2- 172.21.15.63:0/3215198635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64601468f0 0x7f6460152b60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:07.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.449+0000 7f6464c5e700 1 -- 172.21.15.63:0/3215198635 >> 172.21.15.63:0/3215198635 conn(0x7f646005eee0 msgr2=0x7f64600b6060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:07.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.449+0000 7f6464c5e700 1 -- 172.21.15.63:0/3215198635 shutdown_connections 2020-05-18T21:29:07.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.449+0000 7f6464c5e700 1 -- 172.21.15.63:0/3215198635 wait complete. 2020-05-18T21:29:07.471 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-05-18T21:29:07.471 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:29:07.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.577+0000 7f57ee7bd700 1 Processor -- start 2020-05-18T21:29:07.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.577+0000 7f57ee7bd700 1 -- start start 2020-05-18T21:29:07.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57ee7bd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57e80b6d70 0x7f57e8145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:07.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57ee7bd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e8143810 con 0x7f57e80b7bf0 2020-05-18T21:29:07.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57ee7bd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e80b7210 con 0x7f57e8143430 2020-05-18T21:29:07.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57ee7bd700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e80b74b0 con 0x7f57e80b6d70 2020-05-18T21:29:07.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57ecd5a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f57e80b7bf0 0x7f57e80b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58280/0 (socket says 172.21.15.63:58280) 2020-05-18T21:29:07.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57ecd5a700 1 -- 172.21.15.63:0/3428114523 learned_addr learned my addr 172.21.15.63:0/3428114523 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:07.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57e77fe700 1 --2- 172.21.15.63:0/3428114523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57e80b6d70 0x7f57e8145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:07.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57e6ffd700 1 -- 172.21.15.63:0/3428114523 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275275490 0 0) 0x7f57e8143810 con 0x7f57e80b7bf0 2020-05-18T21:29:07.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57e6ffd700 1 -- 172.21.15.63:0/3428114523 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57c8003270 con 0x7f57e80b7bf0 2020-05-18T21:29:07.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57e6ffd700 1 -- 172.21.15.63:0/3428114523 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715974660 0 0) 0x7f57e80b7210 con 0x7f57e8143430 2020-05-18T21:29:07.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57e6ffd700 1 -- 172.21.15.63:0/3428114523 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57e8143810 con 0x7f57e8143430 2020-05-18T21:29:07.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57e77fe700 1 -- 172.21.15.63:0/3428114523 >> v1:172.21.15.155:6789/0 conn(0x7f57e8143430 legacy=0x7f57e80b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57e77fe700 1 -- 172.21.15.63:0/3428114523 >> v1:172.21.15.63:6789/0 conn(0x7f57e80b7bf0 legacy=0x7f57e80b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57e77fe700 1 -- 172.21.15.63:0/3428114523 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e80b7750 con 0x7f57e80b6d70 2020-05-18T21:29:07.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57e77fe700 1 --2- 172.21.15.63:0/3428114523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57e80b6d70 0x7f57e8145dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f57d8002f70 tx=0x7f57e805ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57e77fe700 1 --2- 172.21.15.63:0/3428114523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57e80b6d70 0x7f57e8145dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f57d8002f70 tx=0x7f57e805ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57e77fe700 1 --2- 172.21.15.63:0/3428114523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57e80b6d70 0x7f57e8145dd0 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f57d8002f70 tx=0x7f57e805ab60).ready entity=mon.2 client_cookie=cf05219b77b1ae4a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:07.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57e77fe700 1 --2- 172.21.15.63:0/3428114523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57e80b6d70 0x7f57e8145dd0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f57d8002f70 tx=0x7f57e805ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57e6ffd700 1 -- 172.21.15.63:0/3428114523 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57d8011580 con 0x7f57e80b6d70 2020-05-18T21:29:07.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57e77fe700 1 --2- 172.21.15.63:0/3428114523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57e80b6d70 0x7f57e8145dd0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f57d8002f70 tx=0x7f57e805ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57e77fe700 1 --2- 172.21.15.63:0/3428114523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57e80b6d70 0x7f57e8145dd0 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f57d8002f70 tx=0x7f57e805ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57e6ffd700 1 -- 172.21.15.63:0/3428114523 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d80116e0 con 0x7f57e80b6d70 2020-05-18T21:29:07.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57e6ffd700 1 -- 172.21.15.63:0/3428114523 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57d8011a80 con 0x7f57e80b6d70 2020-05-18T21:29:07.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57ee7bd700 1 -- 172.21.15.63:0/3428114523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57e80b6d70 msgr2=0x7f57e8145dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57ee7bd700 1 --2- 172.21.15.63:0/3428114523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57e80b6d70 0x7f57e8145dd0 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f57d8002f70 tx=0x7f57e805ab60).stop 2020-05-18T21:29:07.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57ee7bd700 1 -- 172.21.15.63:0/3428114523 shutdown_connections 2020-05-18T21:29:07.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57ee7bd700 1 --2- 172.21.15.63:0/3428114523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57e80b6d70 0x7f57e8145dd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:07.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57ee7bd700 1 -- 172.21.15.63:0/3428114523 >> 172.21.15.63:0/3428114523 conn(0x7f57e8069b70 msgr2=0x7f57e8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:07.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57ee7bd700 1 -- 172.21.15.63:0/3428114523 shutdown_connections 2020-05-18T21:29:07.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.581+0000 7f57ee7bd700 1 -- 172.21.15.63:0/3428114523 wait complete. 2020-05-18T21:29:07.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ee7bd700 1 Processor -- start 2020-05-18T21:29:07.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ee7bd700 1 -- start start 2020-05-18T21:29:07.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ee7bd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f57e8143430 0x7f57e80afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:07.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ee7bd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e80afef0 con 0x7f57e80b6d70 2020-05-18T21:29:07.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ee7bd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e80af0b0 con 0x7f57e80b7bf0 2020-05-18T21:29:07.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ee7bd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e80af350 con 0x7f57e8143430 2020-05-18T21:29:07.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57e7fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f57e80b6d70 0x7f57e8141e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58282/0 (socket says 172.21.15.63:58282) 2020-05-18T21:29:07.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57e7fff700 1 -- 172.21.15.63:0/3496200173 learned_addr learned my addr 172.21.15.63:0/3496200173 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:07.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ecd5a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f57e8143430 0x7f57e80afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:07.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57e57fa700 1 -- 172.21.15.63:0/3496200173 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133608483 0 0) 0x7f57e80afef0 con 0x7f57e80b6d70 2020-05-18T21:29:07.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57e57fa700 1 -- 172.21.15.63:0/3496200173 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57cc002fe0 con 0x7f57e80b6d70 2020-05-18T21:29:07.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ecd5a700 1 -- 172.21.15.63:0/3496200173 >> v1:172.21.15.155:6789/0 conn(0x7f57e80b7bf0 legacy=0x7f57e80ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ecd5a700 1 -- 172.21.15.63:0/3496200173 >> v1:172.21.15.63:6789/0 conn(0x7f57e80b6d70 legacy=0x7f57e8141e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ecd5a700 1 -- 172.21.15.63:0/3496200173 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e80af5f0 con 0x7f57e8143430 2020-05-18T21:29:07.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ecd5a700 1 --2- 172.21.15.63:0/3496200173 >> v2:172.21.15.63:3300/0 conn(0x7f57e8143430 0x7f57e80afa90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57e0001490 tx=0x7f57e0010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ecd5a700 1 --2- 172.21.15.63:0/3496200173 >> v2:172.21.15.63:3300/0 conn(0x7f57e8143430 0x7f57e80afa90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57e0001490 tx=0x7f57e0010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ecd5a700 1 --2- 172.21.15.63:0/3496200173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57e8143430 0x7f57e80afa90 secure :-1 s=READY pgs=677 cs=0 l=1 rx=0x7f57e0001490 tx=0x7f57e0010c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:07.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ecd5a700 1 --2- 172.21.15.63:0/3496200173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57e8143430 0x7f57e80afa90 secure :-1 s=THROTTLE_DONE pgs=677 cs=0 l=1 rx=0x7f57e0001490 tx=0x7f57e0010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57e57fa700 1 -- 172.21.15.63:0/3496200173 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57e0005e90 con 0x7f57e8143430 2020-05-18T21:29:07.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ecd5a700 1 --2- 172.21.15.63:0/3496200173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57e8143430 0x7f57e80afa90 secure :-1 s=THROTTLE_DONE pgs=677 cs=0 l=1 rx=0x7f57e0001490 tx=0x7f57e0010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ecd5a700 1 --2- 172.21.15.63:0/3496200173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57e8143430 0x7f57e80afa90 secure :-1 s=THROTTLE_DONE pgs=677 cs=0 l=1 rx=0x7f57e0001490 tx=0x7f57e0010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57e57fa700 1 -- 172.21.15.63:0/3496200173 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e00124d0 con 0x7f57e8143430 2020-05-18T21:29:07.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57e57fa700 1 -- 172.21.15.63:0/3496200173 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57e00128b0 con 0x7f57e8143430 2020-05-18T21:29:07.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ee7bd700 1 -- 172.21.15.63:0/3496200173 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e814a1a0 con 0x7f57e8143430 2020-05-18T21:29:07.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ee7bd700 1 -- 172.21.15.63:0/3496200173 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e8142560 con 0x7f57e8143430 2020-05-18T21:29:07.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ecd5a700 1 --2- 172.21.15.63:0/3496200173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57e8143430 0x7f57e80afa90 secure :-1 s=THROTTLE_DONE pgs=677 cs=0 l=1 rx=0x7f57e0001490 tx=0x7f57e0010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.585+0000 7f57ee7bd700 1 -- 172.21.15.63:0/3496200173 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e80569e0 con 0x7f57e8143430 2020-05-18T21:29:07.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.589+0000 7f57e57fa700 1 -- 172.21.15.63:0/3496200173 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f57e0012b20 con 0x7f57e8143430 2020-05-18T21:29:07.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.589+0000 7f57ecd5a700 1 --2- 172.21.15.63:0/3496200173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57e8143430 0x7f57e80afa90 secure :-1 s=THROTTLE_DONE pgs=677 cs=0 l=1 rx=0x7f57e0001490 tx=0x7f57e0010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.589+0000 7f57e57fa700 1 --2- 172.21.15.63:0/3496200173 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f57cc04fd40 0x7f57cc052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:07.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.589+0000 7f57e57fa700 1 -- 172.21.15.63:0/3496200173 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f57e00090c0 con 0x7f57e8143430 2020-05-18T21:29:07.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.589+0000 7f57e7fff700 1 --2- 172.21.15.63:0/3496200173 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f57cc04fd40 0x7f57cc052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:07.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.589+0000 7f57e7fff700 1 --2- 172.21.15.63:0/3496200173 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f57cc04fd40 0x7f57cc052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57d00011a0 tx=0x7f57d0002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.589+0000 7f57e7fff700 1 --2- 172.21.15.63:0/3496200173 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f57cc04fd40 0x7f57cc052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57d00011a0 tx=0x7f57d0002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.589+0000 7f57e7fff700 1 --2- 172.21.15.63:0/3496200173 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f57cc04fd40 0x7f57cc052200 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7f57d00011a0 tx=0x7f57d0002860).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:07.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.597+0000 7f57ecd5a700 1 --2- 172.21.15.63:0/3496200173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57e8143430 0x7f57e80afa90 secure :-1 s=THROTTLE_DONE pgs=677 cs=0 l=1 rx=0x7f57e0001490 tx=0x7f57e0010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.597+0000 7f57e57fa700 1 -- 172.21.15.63:0/3496200173 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f57e003e6f0 con 0x7f57e8143430 2020-05-18T21:29:07.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.709+0000 7f57ee7bd700 1 -- 172.21.15.63:0/3496200173 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f57e80678d0 con 0x7f57e8143430 2020-05-18T21:29:07.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.713+0000 7f57ecd5a700 1 --2- 172.21.15.63:0/3496200173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57e8143430 0x7f57e80afa90 secure :-1 s=THROTTLE_DONE pgs=677 cs=0 l=1 rx=0x7f57e0001490 tx=0x7f57e0010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.713+0000 7f57e57fa700 1 -- 172.21.15.63:0/3496200173 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v57) v1 ==== 110+0+10 (secure 0 0 0) 0x7f57e0041d10 con 0x7f57e8143430 2020-05-18T21:29:07.718 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:29:07.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.713+0000 7f57ee7bd700 1 -- 172.21.15.63:0/3496200173 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f57cc04fd40 msgr2=0x7f57cc052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.713+0000 7f57ee7bd700 1 --2- 172.21.15.63:0/3496200173 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f57cc04fd40 0x7f57cc052200 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7f57d00011a0 tx=0x7f57d0002860).stop 2020-05-18T21:29:07.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.713+0000 7f57ee7bd700 1 -- 172.21.15.63:0/3496200173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57e8143430 msgr2=0x7f57e80afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.713+0000 7f57ee7bd700 1 --2- 172.21.15.63:0/3496200173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57e8143430 0x7f57e80afa90 secure :-1 s=READY pgs=677 cs=0 l=1 rx=0x7f57e0001490 tx=0x7f57e0010c10).stop 2020-05-18T21:29:07.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.713+0000 7f57ee7bd700 1 -- 172.21.15.63:0/3496200173 shutdown_connections 2020-05-18T21:29:07.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.713+0000 7f57ee7bd700 1 --2- 172.21.15.63:0/3496200173 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f57cc04fd40 0x7f57cc052200 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:07.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.713+0000 7f57ee7bd700 1 --2- 172.21.15.63:0/3496200173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57e8143430 0x7f57e80afa90 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:07.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.713+0000 7f57ee7bd700 1 -- 172.21.15.63:0/3496200173 >> 172.21.15.63:0/3496200173 conn(0x7f57e8069b70 msgr2=0x7f57e80613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:07.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.713+0000 7f57ee7bd700 1 -- 172.21.15.63:0/3496200173 shutdown_connections 2020-05-18T21:29:07.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.713+0000 7f57ee7bd700 1 -- 172.21.15.63:0/3496200173 wait complete. 2020-05-18T21:29:07.729 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:29:07.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.845+0000 7fac11b3f700 1 Processor -- start 2020-05-18T21:29:07.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.845+0000 7fac11b3f700 1 -- start start 2020-05-18T21:29:07.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac11b3f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fac0c05f410 0x7fac0c062800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:07.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac11b3f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c09dd80 con 0x7fac0c05bc50 2020-05-18T21:29:07.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac11b3f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c062d80 con 0x7fac0c143890 2020-05-18T21:29:07.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac11b3f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0c0b6180 con 0x7fac0c05f410 2020-05-18T21:29:07.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0bfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fac0c05bc50 0x7fac0c143180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58292/0 (socket says 172.21.15.63:58292) 2020-05-18T21:29:07.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0bfff700 1 -- 172.21.15.63:0/3118863105 learned_addr learned my addr 172.21.15.63:0/3118863105 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:07.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac10b3d700 1 --2- 172.21.15.63:0/3118863105 >> v2:172.21.15.155:3300/0 conn(0x7fac0c05f410 0x7fac0c062800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:07.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 -- 172.21.15.63:0/3118863105 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782794467 0 0) 0x7fac0c09dd80 con 0x7fac0c05bc50 2020-05-18T21:29:07.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 -- 172.21.15.63:0/3118863105 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabf0003270 con 0x7fac0c05bc50 2020-05-18T21:29:07.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 -- 172.21.15.63:0/3118863105 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391735365 0 0) 0x7fac0c062d80 con 0x7fac0c143890 2020-05-18T21:29:07.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 -- 172.21.15.63:0/3118863105 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac0c09dd80 con 0x7fac0c143890 2020-05-18T21:29:07.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 -- 172.21.15.63:0/3118863105 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3174058273 0 0) 0x7fabf0003270 con 0x7fac0c05bc50 2020-05-18T21:29:07.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 -- 172.21.15.63:0/3118863105 >> v2:172.21.15.155:3300/0 conn(0x7fac0c05f410 msgr2=0x7fac0c062800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:07.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 --2- 172.21.15.63:0/3118863105 >> v2:172.21.15.155:3300/0 conn(0x7fac0c05f410 0x7fac0c062800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:07.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 -- 172.21.15.63:0/3118863105 >> v1:172.21.15.155:6789/0 conn(0x7fac0c143890 legacy=0x7fac0c0b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 -- 172.21.15.63:0/3118863105 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c0b6420 con 0x7fac0c05bc50 2020-05-18T21:29:07.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 -- 172.21.15.63:0/3118863105 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fabf8001710 con 0x7fac0c05bc50 2020-05-18T21:29:07.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 -- 172.21.15.63:0/3118863105 >> v1:172.21.15.63:6789/0 conn(0x7fac0c05bc50 legacy=0x7fac0c143180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 --2- 172.21.15.63:0/3118863105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf00038f0 0x7fabf0003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 --2- 172.21.15.63:0/3118863105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabf0004510 0x7fabf0004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 --2- 172.21.15.63:0/3118863105 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabf0004df0 0x7fabf000b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 -- 172.21.15.63:0/3118863105 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0b6180 con 0x7fabf00038f0 2020-05-18T21:29:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 -- 172.21.15.63:0/3118863105 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00053e0 con 0x7fabf0004510 2020-05-18T21:29:07.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 -- 172.21.15.63:0/3118863105 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf000bc40 con 0x7fabf0004df0 2020-05-18T21:29:07.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac10b3d700 1 --2- 172.21.15.63:0/3118863105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf00038f0 0x7fabf0003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:07.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0bfff700 1 --2- 172.21.15.63:0/3118863105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabf0004510 0x7fabf0004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:07.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac1133e700 1 --2- 172.21.15.63:0/3118863105 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabf0004df0 0x7fabf000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:07.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac10b3d700 1 -- 172.21.15.63:0/3118863105 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabf0004df0 msgr2=0x7fabf000b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac10b3d700 1 --2- 172.21.15.63:0/3118863105 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabf0004df0 0x7fabf000b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac10b3d700 1 -- 172.21.15.63:0/3118863105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabf0004510 msgr2=0x7fabf0004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac10b3d700 1 --2- 172.21.15.63:0/3118863105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabf0004510 0x7fabf0004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac1133e700 1 -- 172.21.15.63:0/3118863105 reap_dead start 2020-05-18T21:29:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac10b3d700 1 -- 172.21.15.63:0/3118863105 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf0003270 con 0x7fabf00038f0 2020-05-18T21:29:07.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac10b3d700 1 --2- 172.21.15.63:0/3118863105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf00038f0 0x7fabf0003cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fac00002f70 tx=0x7fac00010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac10b3d700 1 --2- 172.21.15.63:0/3118863105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf00038f0 0x7fabf0003cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fac00002f70 tx=0x7fac00010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac10b3d700 1 --2- 172.21.15.63:0/3118863105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf00038f0 0x7fabf0003cf0 secure :-1 s=READY pgs=679 cs=0 l=1 rx=0x7fac00002f70 tx=0x7fac00010060).ready entity=mon.0 client_cookie=5b4a5b4f703977b8 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:07.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac10b3d700 1 --2- 172.21.15.63:0/3118863105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf00038f0 0x7fabf0003cf0 secure :-1 s=THROTTLE_DONE pgs=679 cs=0 l=1 rx=0x7fac00002f70 tx=0x7fac00010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac10b3d700 1 --2- 172.21.15.63:0/3118863105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf00038f0 0x7fabf0003cf0 secure :-1 s=THROTTLE_DONE pgs=679 cs=0 l=1 rx=0x7fac00002f70 tx=0x7fac00010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 -- 172.21.15.63:0/3118863105 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac00008d70 con 0x7fabf00038f0 2020-05-18T21:29:07.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac10b3d700 1 --2- 172.21.15.63:0/3118863105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf00038f0 0x7fabf0003cf0 secure :-1 s=THROTTLE_DONE pgs=679 cs=0 l=1 rx=0x7fac00002f70 tx=0x7fac00010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 -- 172.21.15.63:0/3118863105 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac00010910 con 0x7fabf00038f0 2020-05-18T21:29:07.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac0b7fe700 1 -- 172.21.15.63:0/3118863105 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac00010c70 con 0x7fabf00038f0 2020-05-18T21:29:07.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac11b3f700 1 -- 172.21.15.63:0/3118863105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf00038f0 msgr2=0x7fabf0003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.849+0000 7fac11b3f700 1 --2- 172.21.15.63:0/3118863105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf00038f0 0x7fabf0003cf0 secure :-1 s=READY pgs=679 cs=0 l=1 rx=0x7fac00002f70 tx=0x7fac00010060).stop 2020-05-18T21:29:07.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.853+0000 7fac11b3f700 1 -- 172.21.15.63:0/3118863105 shutdown_connections 2020-05-18T21:29:07.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.853+0000 7fac11b3f700 1 --2- 172.21.15.63:0/3118863105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf00038f0 0x7fabf0003cf0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:07.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.853+0000 7fac11b3f700 1 -- 172.21.15.63:0/3118863105 >> 172.21.15.63:0/3118863105 conn(0x7fac0c06a600 msgr2=0x7fac0c0b6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:07.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.853+0000 7fac11b3f700 1 -- 172.21.15.63:0/3118863105 shutdown_connections 2020-05-18T21:29:07.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.853+0000 7fac11b3f700 1 -- 172.21.15.63:0/3118863105 wait complete. 2020-05-18T21:29:07.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.853+0000 7fac11b3f700 1 Processor -- start 2020-05-18T21:29:07.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.853+0000 7fac11b3f700 1 -- start start 2020-05-18T21:29:07.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac11b3f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabf00038f0 0x7fac0c065bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:07.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac11b3f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c144c40 con 0x7fac0c0b9f90 2020-05-18T21:29:07.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac11b3f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c144ee0 con 0x7fac0c144620 2020-05-18T21:29:07.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac11b3f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c144a60 con 0x7fabf00038f0 2020-05-18T21:29:07.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac1133e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fac0c0b9f90 0x7fac0c145620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58306/0 (socket says 172.21.15.63:58306) 2020-05-18T21:29:07.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac1133e700 1 -- 172.21.15.63:0/2295468422 learned_addr learned my addr 172.21.15.63:0/2295468422 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:07.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac10b3d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabf00038f0 0x7fac0c065bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:07.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac09ffb700 1 -- 172.21.15.63:0/2295468422 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3778783276 0 0) 0x7fac0c144c40 con 0x7fac0c0b9f90 2020-05-18T21:29:07.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac09ffb700 1 -- 172.21.15.63:0/2295468422 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabf4002fe0 con 0x7fac0c0b9f90 2020-05-18T21:29:07.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac10b3d700 1 -- 172.21.15.63:0/2295468422 >> v1:172.21.15.155:6789/0 conn(0x7fac0c144620 legacy=0x7fac0c12df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac10b3d700 1 -- 172.21.15.63:0/2295468422 >> v1:172.21.15.63:6789/0 conn(0x7fac0c0b9f90 legacy=0x7fac0c145620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac10b3d700 1 -- 172.21.15.63:0/2295468422 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c145180 con 0x7fabf00038f0 2020-05-18T21:29:07.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac10b3d700 1 --2- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabf00038f0 0x7fac0c065bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac00002f70 tx=0x7fac00010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac10b3d700 1 --2- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabf00038f0 0x7fac0c065bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac00002f70 tx=0x7fac00010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac10b3d700 1 --2- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabf00038f0 0x7fac0c065bb0 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7fac00002f70 tx=0x7fac00010060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:07.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac10b3d700 1 --2- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabf00038f0 0x7fac0c065bb0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fac00002f70 tx=0x7fac00010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac09ffb700 1 -- 172.21.15.63:0/2295468422 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac000078c0 con 0x7fabf00038f0 2020-05-18T21:29:07.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac10b3d700 1 --2- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabf00038f0 0x7fac0c065bb0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fac00002f70 tx=0x7fac00010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac09ffb700 1 -- 172.21.15.63:0/2295468422 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac000058f0 con 0x7fabf00038f0 2020-05-18T21:29:07.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac10b3d700 1 --2- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabf00038f0 0x7fac0c065bb0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fac00002f70 tx=0x7fac00010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac11b3f700 1 -- 172.21.15.63:0/2295468422 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0c0ba3d0 con 0x7fabf00038f0 2020-05-18T21:29:07.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac09ffb700 1 -- 172.21.15.63:0/2295468422 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac00005c50 con 0x7fabf00038f0 2020-05-18T21:29:07.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.857+0000 7fac11b3f700 1 -- 172.21.15.63:0/2295468422 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0c1513e0 con 0x7fabf00038f0 2020-05-18T21:29:07.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.861+0000 7fac11b3f700 1 -- 172.21.15.63:0/2295468422 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0c145310 con 0x7fabf00038f0 2020-05-18T21:29:07.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.865+0000 7fac10b3d700 1 --2- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabf00038f0 0x7fac0c065bb0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fac00002f70 tx=0x7fac00010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.865+0000 7fac10b3d700 1 --2- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabf00038f0 0x7fac0c065bb0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fac00002f70 tx=0x7fac00010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.865+0000 7fac09ffb700 1 -- 172.21.15.63:0/2295468422 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fac00007180 con 0x7fabf00038f0 2020-05-18T21:29:07.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.865+0000 7fac09ffb700 1 --2- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabf404fcf0 0x7fabf40521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:07.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.865+0000 7fac09ffb700 1 -- 172.21.15.63:0/2295468422 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fac00063fc0 con 0x7fabf00038f0 2020-05-18T21:29:07.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.865+0000 7fac0bfff700 1 --2- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabf404fcf0 0x7fabf40521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:07.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.865+0000 7fac0bfff700 1 --2- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabf404fcf0 0x7fabf40521b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac0c13de70 tx=0x7fabf800fa80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.865+0000 7fac0bfff700 1 --2- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabf404fcf0 0x7fabf40521b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac0c13de70 tx=0x7fabf800fa80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.865+0000 7fac0bfff700 1 --2- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabf404fcf0 0x7fabf40521b0 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7fac0c13de70 tx=0x7fabf800fa80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:07.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.873+0000 7fac10b3d700 1 --2- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabf00038f0 0x7fac0c065bb0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fac00002f70 tx=0x7fac00010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.873+0000 7fac09ffb700 1 -- 172.21.15.63:0/2295468422 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fac0003e430 con 0x7fabf00038f0 2020-05-18T21:29:07.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.989+0000 7fac11b3f700 1 -- 172.21.15.63:0/2295468422 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fac0c0569e0 con 0x7fabf00038f0 2020-05-18T21:29:07.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.989+0000 7fac10b3d700 1 --2- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabf00038f0 0x7fac0c065bb0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fac00002f70 tx=0x7fac00010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:07.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.989+0000 7fac09ffb700 1 -- 172.21.15.63:0/2295468422 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v57) v1 ==== 92+0+10 (secure 0 0 0) 0x7fac00041a50 con 0x7fabf00038f0 2020-05-18T21:29:07.996 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:29:07.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.993+0000 7fac11b3f700 1 -- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabf404fcf0 msgr2=0x7fabf40521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.993+0000 7fac11b3f700 1 --2- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabf404fcf0 0x7fabf40521b0 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7fac0c13de70 tx=0x7fabf800fa80).stop 2020-05-18T21:29:07.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.993+0000 7fac11b3f700 1 -- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabf00038f0 msgr2=0x7fac0c065bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:07.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.993+0000 7fac11b3f700 1 --2- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabf00038f0 0x7fac0c065bb0 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7fac00002f70 tx=0x7fac00010060).stop 2020-05-18T21:29:07.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.993+0000 7fac11b3f700 1 -- 172.21.15.63:0/2295468422 shutdown_connections 2020-05-18T21:29:07.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.993+0000 7fac11b3f700 1 --2- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabf404fcf0 0x7fabf40521b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:07.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.993+0000 7fac11b3f700 1 --2- 172.21.15.63:0/2295468422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabf00038f0 0x7fac0c065bb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:07.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.993+0000 7fac11b3f700 1 -- 172.21.15.63:0/2295468422 >> 172.21.15.63:0/2295468422 conn(0x7fac0c06a600 msgr2=0x7fac0c062850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:07.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.993+0000 7fac11b3f700 1 -- 172.21.15.63:0/2295468422 shutdown_connections 2020-05-18T21:29:07.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:07.993+0000 7fac11b3f700 1 -- 172.21.15.63:0/2295468422 wait complete. 2020-05-18T21:29:08.009 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-05-18T21:29:08.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.105+0000 7f9a1b59e700 1 Processor -- start 2020-05-18T21:29:08.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.105+0000 7f9a1b59e700 1 -- start start 2020-05-18T21:29:08.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.105+0000 7f9a1b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9a1c1402e0 0x7f9a1c0ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:08.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.105+0000 7f9a1b59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a1c0b3000 0x7f9a1c05a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:08.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.105+0000 7f9a1b59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1c0b0f40 con 0x7f9a1c05ac20 2020-05-18T21:29:08.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.105+0000 7f9a1b59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1c1406c0 con 0x7f9a1c1402e0 2020-05-18T21:29:08.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.105+0000 7f9a1b59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1c0b0410 con 0x7f9a1c0b3000 2020-05-18T21:29:08.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.105+0000 7f9a1a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9a1c1402e0 0x7f9a1c0ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:08.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.105+0000 7f9a1a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9a1c1402e0 0x7f9a1c0ac4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56124/0 (socket says 172.21.15.63:56124) 2020-05-18T21:29:08.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.105+0000 7f9a1a59c700 1 -- 172.21.15.63:0/125825669 learned_addr learned my addr 172.21.15.63:0/125825669 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:08.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.105+0000 7f9a19d9b700 1 --2- 172.21.15.63:0/125825669 >> v2:172.21.15.155:3300/0 conn(0x7f9a1c0b3000 0x7f9a1c05a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:08.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.105+0000 7f9a1a59c700 1 -- 172.21.15.63:0/125825669 >> v2:172.21.15.155:3300/0 conn(0x7f9a1c0b3000 msgr2=0x7f9a1c05a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:08.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.105+0000 7f9a1a59c700 1 --2- 172.21.15.63:0/125825669 >> v2:172.21.15.155:3300/0 conn(0x7f9a1c0b3000 0x7f9a1c05a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:08.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.105+0000 7f9a1a59c700 1 -- 172.21.15.63:0/125825669 >> v1:172.21.15.155:6789/0 conn(0x7f9a1c05ac20 legacy=0x7f9a1c0b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:08.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.105+0000 7f9a1a59c700 1 -- 172.21.15.63:0/125825669 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c0b35f0 con 0x7f9a1c1402e0 2020-05-18T21:29:08.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.105+0000 7f9a1a59c700 1 --2- 172.21.15.63:0/125825669 >> v2:172.21.15.63:3300/0 conn(0x7f9a1c1402e0 0x7f9a1c0ac4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9a14001490 tx=0x7f9a0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.109+0000 7f9a1a59c700 1 --2- 172.21.15.63:0/125825669 >> v2:172.21.15.63:3300/0 conn(0x7f9a1c1402e0 0x7f9a1c0ac4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9a14001490 tx=0x7f9a0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.109+0000 7f9a1a59c700 1 --2- 172.21.15.63:0/125825669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c1402e0 0x7f9a1c0ac4d0 secure :-1 s=READY pgs=681 cs=0 l=1 rx=0x7f9a14001490 tx=0x7f9a0c007a80).ready entity=mon.0 client_cookie=86d089202e755914 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:08.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.109+0000 7f9a1a59c700 1 --2- 172.21.15.63:0/125825669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c1402e0 0x7f9a1c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=681 cs=0 l=1 rx=0x7f9a14001490 tx=0x7f9a0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.109+0000 7f9a1a59c700 1 --2- 172.21.15.63:0/125825669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c1402e0 0x7f9a1c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=681 cs=0 l=1 rx=0x7f9a14001490 tx=0x7f9a0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.109+0000 7f9a1959a700 1 -- 172.21.15.63:0/125825669 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a0c008e50 con 0x7f9a1c1402e0 2020-05-18T21:29:08.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.109+0000 7f9a1a59c700 1 --2- 172.21.15.63:0/125825669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c1402e0 0x7f9a1c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=681 cs=0 l=1 rx=0x7f9a14001490 tx=0x7f9a0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.109+0000 7f9a1959a700 1 -- 172.21.15.63:0/125825669 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0c011750 con 0x7f9a1c1402e0 2020-05-18T21:29:08.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.109+0000 7f9a1959a700 1 -- 172.21.15.63:0/125825669 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a0c011b30 con 0x7f9a1c1402e0 2020-05-18T21:29:08.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.109+0000 7f9a1b59e700 1 -- 172.21.15.63:0/125825669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c1402e0 msgr2=0x7f9a1c0ac4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:08.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.109+0000 7f9a1b59e700 1 --2- 172.21.15.63:0/125825669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c1402e0 0x7f9a1c0ac4d0 secure :-1 s=READY pgs=681 cs=0 l=1 rx=0x7f9a14001490 tx=0x7f9a0c007a80).stop 2020-05-18T21:29:08.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.109+0000 7f9a1b59e700 1 -- 172.21.15.63:0/125825669 shutdown_connections 2020-05-18T21:29:08.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.109+0000 7f9a1b59e700 1 --2- 172.21.15.63:0/125825669 >> v2:172.21.15.155:3300/0 conn(0x7f9a1c0b3000 0x7f9a1c05a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:08.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.109+0000 7f9a1b59e700 1 --2- 172.21.15.63:0/125825669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c1402e0 0x7f9a1c0ac4d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:08.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.109+0000 7f9a1b59e700 1 -- 172.21.15.63:0/125825669 >> 172.21.15.63:0/125825669 conn(0x7f9a1c066d00 msgr2=0x7f9a1c0b9590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:08.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.109+0000 7f9a1b59e700 1 -- 172.21.15.63:0/125825669 shutdown_connections 2020-05-18T21:29:08.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.109+0000 7f9a1b59e700 1 -- 172.21.15.63:0/125825669 wait complete. 2020-05-18T21:29:08.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.109+0000 7f9a1b59e700 1 Processor -- start 2020-05-18T21:29:08.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.109+0000 7f9a1b59e700 1 -- start start 2020-05-18T21:29:08.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a1c05ac20 0x7f9a1c148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:08.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1b59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a1c1402e0 0x7f9a1c13c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:08.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1b59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1c157120 con 0x7f9a1c0b3000 2020-05-18T21:29:08.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1b59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1c1573c0 con 0x7f9a1c1402e0 2020-05-18T21:29:08.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c157660 con 0x7f9a1c05ac20 2020-05-18T21:29:08.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1a59c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a1c05ac20 0x7f9a1c148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:08.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1ad9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a1c1402e0 0x7f9a1c13c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:08.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1a59c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a1c05ac20 0x7f9a1c148b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:46830/0 (socket says 172.21.15.63:46830) 2020-05-18T21:29:08.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1a59c700 1 -- 172.21.15.63:0/783193105 learned_addr learned my addr 172.21.15.63:0/783193105 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:08.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1ad9d700 1 -- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a1c05ac20 msgr2=0x7f9a1c148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:08.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1ad9d700 1 --2- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a1c05ac20 0x7f9a1c148b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:08.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1ad9d700 1 -- 172.21.15.63:0/783193105 >> v1:172.21.15.155:6789/0 conn(0x7f9a1c0b3000 legacy=0x7f9a1c13bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:08.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1ad9d700 1 -- 172.21.15.63:0/783193105 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c0addc0 con 0x7f9a1c1402e0 2020-05-18T21:29:08.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1ad9d700 1 --2- 172.21.15.63:0/783193105 >> v2:172.21.15.155:3300/0 conn(0x7f9a1c1402e0 0x7f9a1c13c5e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a14001550 tx=0x7f9a1400c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1ad9d700 1 --2- 172.21.15.63:0/783193105 >> v2:172.21.15.155:3300/0 conn(0x7f9a1c1402e0 0x7f9a1c13c5e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a14001550 tx=0x7f9a1400c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1ad9d700 1 --2- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a1c1402e0 0x7f9a1c13c5e0 secure :-1 s=READY pgs=492 cs=0 l=1 rx=0x7f9a14001550 tx=0x7f9a1400c8a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:08.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1ad9d700 1 --2- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a1c1402e0 0x7f9a1c13c5e0 secure :-1 s=THROTTLE_DONE pgs=492 cs=0 l=1 rx=0x7f9a14001550 tx=0x7f9a1400c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a137fe700 1 -- 172.21.15.63:0/783193105 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a140101e0 con 0x7f9a1c1402e0 2020-05-18T21:29:08.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1ad9d700 1 --2- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a1c1402e0 0x7f9a1c13c5e0 secure :-1 s=THROTTLE_DONE pgs=492 cs=0 l=1 rx=0x7f9a14001550 tx=0x7f9a1400c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1ad9d700 1 --2- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a1c1402e0 0x7f9a1c13c5e0 secure :-1 s=THROTTLE_DONE pgs=492 cs=0 l=1 rx=0x7f9a14001550 tx=0x7f9a1400c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a137fe700 1 -- 172.21.15.63:0/783193105 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a14010340 con 0x7f9a1c1402e0 2020-05-18T21:29:08.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1b59e700 1 -- 172.21.15.63:0/783193105 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1c0ae010 con 0x7f9a1c1402e0 2020-05-18T21:29:08.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a137fe700 1 -- 172.21.15.63:0/783193105 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a14010720 con 0x7f9a1c1402e0 2020-05-18T21:29:08.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1b59e700 1 -- 172.21.15.63:0/783193105 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1c0af8e0 con 0x7f9a1c1402e0 2020-05-18T21:29:08.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1b59e700 1 -- 172.21.15.63:0/783193105 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1c0569e0 con 0x7f9a1c1402e0 2020-05-18T21:29:08.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.113+0000 7f9a1ad9d700 1 --2- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a1c1402e0 0x7f9a1c13c5e0 secure :-1 s=THROTTLE_DONE pgs=492 cs=0 l=1 rx=0x7f9a14001550 tx=0x7f9a1400c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.117+0000 7f9a137fe700 1 -- 172.21.15.63:0/783193105 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9a140068a0 con 0x7f9a1c1402e0 2020-05-18T21:29:08.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.117+0000 7f9a1ad9d700 1 --2- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a1c1402e0 0x7f9a1c13c5e0 secure :-1 s=THROTTLE_DONE pgs=492 cs=0 l=1 rx=0x7f9a14001550 tx=0x7f9a1400c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.117+0000 7f9a137fe700 1 --2- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a0004fa60 0x7f9a00051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:08.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.117+0000 7f9a137fe700 1 -- 172.21.15.63:0/783193105 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9a14063ce0 con 0x7f9a1c1402e0 2020-05-18T21:29:08.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.117+0000 7f9a1a59c700 1 --2- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a0004fa60 0x7f9a00051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:08.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.117+0000 7f9a1a59c700 1 --2- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a0004fa60 0x7f9a00051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a14001490 tx=0x7f9a0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.117+0000 7f9a1a59c700 1 --2- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a0004fa60 0x7f9a00051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a14001490 tx=0x7f9a0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.117+0000 7f9a1a59c700 1 --2- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a0004fa60 0x7f9a00051f20 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7f9a14001490 tx=0x7f9a0c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:08.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.125+0000 7f9a1ad9d700 1 --2- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a1c1402e0 0x7f9a1c13c5e0 secure :-1 s=THROTTLE_DONE pgs=492 cs=0 l=1 rx=0x7f9a14001550 tx=0x7f9a1400c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.125+0000 7f9a137fe700 1 -- 172.21.15.63:0/783193105 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9a1403e070 con 0x7f9a1c1402e0 2020-05-18T21:29:08.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.249+0000 7f9a1b59e700 1 -- 172.21.15.63:0/783193105 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9a1c157830 con 0x7f9a1c1402e0 2020-05-18T21:29:08.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.249+0000 7f9a1ad9d700 1 --2- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a1c1402e0 0x7f9a1c13c5e0 secure :-1 s=THROTTLE_DONE pgs=492 cs=0 l=1 rx=0x7f9a14001550 tx=0x7f9a1400c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.249+0000 7f9a137fe700 1 -- 172.21.15.63:0/783193105 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v57) v1 ==== 84+0+143 (secure 0 0 0) 0x7f9a14041690 con 0x7f9a1c1402e0 2020-05-18T21:29:08.256 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:08.257 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:29:08.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:08.257 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2020-05-18T21:29:08.257 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "device_health_metrics" 2020-05-18T21:29:08.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:08.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:08.258 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 2, 2020-05-18T21:29:08.258 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "rbd" 2020-05-18T21:29:08.258 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:08.258 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:29:08.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.253+0000 7f9a1b59e700 1 -- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a0004fa60 msgr2=0x7f9a00051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:08.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.253+0000 7f9a1b59e700 1 --2- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a0004fa60 0x7f9a00051f20 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7f9a14001490 tx=0x7f9a0c007a80).stop 2020-05-18T21:29:08.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.253+0000 7f9a1b59e700 1 -- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a1c1402e0 msgr2=0x7f9a1c13c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:08.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.253+0000 7f9a1b59e700 1 --2- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a1c1402e0 0x7f9a1c13c5e0 secure :-1 s=READY pgs=492 cs=0 l=1 rx=0x7f9a14001550 tx=0x7f9a1400c8a0).stop 2020-05-18T21:29:08.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.253+0000 7f9a1b59e700 1 -- 172.21.15.63:0/783193105 shutdown_connections 2020-05-18T21:29:08.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.253+0000 7f9a1b59e700 1 --2- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a0004fa60 0x7f9a00051f20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:08.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.253+0000 7f9a1b59e700 1 --2- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a1c1402e0 0x7f9a1c13c5e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:08.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.253+0000 7f9a1b59e700 1 --2- 172.21.15.63:0/783193105 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a1c05ac20 0x7f9a1c148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:08.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.253+0000 7f9a1b59e700 1 -- 172.21.15.63:0/783193105 >> 172.21.15.63:0/783193105 conn(0x7f9a1c066d00 msgr2=0x7f9a1c0b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:08.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.253+0000 7f9a1b59e700 1 -- 172.21.15.63:0/783193105 shutdown_connections 2020-05-18T21:29:08.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.253+0000 7f9a1b59e700 1 -- 172.21.15.63:0/783193105 wait complete. 2020-05-18T21:29:08.273 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-05-18T21:29:08.274 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-05-18T21:29:08.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0bfff700 1 Processor -- start 2020-05-18T21:29:08.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0bfff700 1 -- start start 2020-05-18T21:29:08.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fed0c0b5100 0x7fed0c0b5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:08.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fed0c0b59d0 0x7fed0c0b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:08.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0bfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0c145cd0 con 0x7fed0c09e550 2020-05-18T21:29:08.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0c0b4a70 con 0x7fed0c0b59d0 2020-05-18T21:29:08.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0c149550 con 0x7fed0c0b5100 2020-05-18T21:29:08.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fed0c0b59d0 0x7fed0c0b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:08.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fed0c0b59d0 0x7fed0c0b5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56140/0 (socket says 172.21.15.63:56140) 2020-05-18T21:29:08.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0b7fe700 1 -- 172.21.15.63:0/1396079027 learned_addr learned my addr 172.21.15.63:0/1396079027 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:08.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed027fc700 1 --2- 172.21.15.63:0/1396079027 >> v2:172.21.15.155:3300/0 conn(0x7fed0c0b5100 0x7fed0c0b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:08.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0b7fe700 1 -- 172.21.15.63:0/1396079027 >> v2:172.21.15.155:3300/0 conn(0x7fed0c0b5100 msgr2=0x7fed0c0b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:08.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0b7fe700 1 --2- 172.21.15.63:0/1396079027 >> v2:172.21.15.155:3300/0 conn(0x7fed0c0b5100 0x7fed0c0b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:08.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0b7fe700 1 -- 172.21.15.63:0/1396079027 >> v1:172.21.15.155:6789/0 conn(0x7fed0c09e550 legacy=0x7fed0c0b91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:08.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0b7fe700 1 -- 172.21.15.63:0/1396079027 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c0b4c60 con 0x7fed0c0b59d0 2020-05-18T21:29:08.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0b7fe700 1 --2- 172.21.15.63:0/1396079027 >> v2:172.21.15.63:3300/0 conn(0x7fed0c0b59d0 0x7fed0c0b5e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fed040032f0 tx=0x7fed04007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0b7fe700 1 --2- 172.21.15.63:0/1396079027 >> v2:172.21.15.63:3300/0 conn(0x7fed0c0b59d0 0x7fed0c0b5e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fed040032f0 tx=0x7fed04007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0b7fe700 1 --2- 172.21.15.63:0/1396079027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed0c0b59d0 0x7fed0c0b5e30 secure :-1 s=READY pgs=682 cs=0 l=1 rx=0x7fed040032f0 tx=0x7fed04007e00).ready entity=mon.0 client_cookie=5884e4609748c6ca server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:08.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0b7fe700 1 --2- 172.21.15.63:0/1396079027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed0c0b59d0 0x7fed0c0b5e30 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7fed040032f0 tx=0x7fed04007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0b7fe700 1 --2- 172.21.15.63:0/1396079027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed0c0b59d0 0x7fed0c0b5e30 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7fed040032f0 tx=0x7fed04007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0a7fc700 1 -- 172.21.15.63:0/1396079027 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed04011d10 con 0x7fed0c0b59d0 2020-05-18T21:29:08.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0b7fe700 1 --2- 172.21.15.63:0/1396079027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed0c0b59d0 0x7fed0c0b5e30 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7fed040032f0 tx=0x7fed04007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0a7fc700 1 -- 172.21.15.63:0/1396079027 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed04011e70 con 0x7fed0c0b59d0 2020-05-18T21:29:08.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0a7fc700 1 -- 172.21.15.63:0/1396079027 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed0400a370 con 0x7fed0c0b59d0 2020-05-18T21:29:08.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0bfff700 1 -- 172.21.15.63:0/1396079027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed0c0b59d0 msgr2=0x7fed0c0b5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:08.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.381+0000 7fed0bfff700 1 --2- 172.21.15.63:0/1396079027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed0c0b59d0 0x7fed0c0b5e30 secure :-1 s=READY pgs=682 cs=0 l=1 rx=0x7fed040032f0 tx=0x7fed04007e00).stop 2020-05-18T21:29:08.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.385+0000 7fed0bfff700 1 -- 172.21.15.63:0/1396079027 shutdown_connections 2020-05-18T21:29:08.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.385+0000 7fed0bfff700 1 --2- 172.21.15.63:0/1396079027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed0c0b59d0 0x7fed0c0b5e30 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:08.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.385+0000 7fed0bfff700 1 --2- 172.21.15.63:0/1396079027 >> v2:172.21.15.155:3300/0 conn(0x7fed0c0b5100 0x7fed0c0b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:08.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.385+0000 7fed0bfff700 1 -- 172.21.15.63:0/1396079027 >> 172.21.15.63:0/1396079027 conn(0x7fed0c05b210 msgr2=0x7fed0c0b8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:08.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.385+0000 7fed0bfff700 1 -- 172.21.15.63:0/1396079027 shutdown_connections 2020-05-18T21:29:08.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.385+0000 7fed0bfff700 1 -- 172.21.15.63:0/1396079027 wait complete. 2020-05-18T21:29:08.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.385+0000 7fed0bfff700 1 Processor -- start 2020-05-18T21:29:08.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.385+0000 7fed0bfff700 1 -- start start 2020-05-18T21:29:08.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.385+0000 7fed0bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fed0c09e550 0x7fed0c1567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:08.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.385+0000 7fed0bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fed0c0b59d0 0x7fed0c09cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:08.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.385+0000 7fed0bfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0c09d3f0 con 0x7fed0c0b5100 2020-05-18T21:29:08.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.385+0000 7fed0bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0c1428d0 con 0x7fed0c09e550 2020-05-18T21:29:08.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.385+0000 7fed0bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0c146580 con 0x7fed0c0b59d0 2020-05-18T21:29:08.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.385+0000 7fed0affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fed0c09e550 0x7fed0c1567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:08.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.385+0000 7fed0affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fed0c09e550 0x7fed0c1567c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56144/0 (socket says 172.21.15.63:56144) 2020-05-18T21:29:08.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.385+0000 7fed0affd700 1 -- 172.21.15.63:0/1014539061 learned_addr learned my addr 172.21.15.63:0/1014539061 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:08.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.385+0000 7fed0b7fe700 1 --2- 172.21.15.63:0/1014539061 >> v2:172.21.15.155:3300/0 conn(0x7fed0c0b59d0 0x7fed0c09cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:08.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.389+0000 7fed0affd700 1 -- 172.21.15.63:0/1014539061 >> v2:172.21.15.155:3300/0 conn(0x7fed0c0b59d0 msgr2=0x7fed0c09cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:08.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.389+0000 7fed0affd700 1 --2- 172.21.15.63:0/1014539061 >> v2:172.21.15.155:3300/0 conn(0x7fed0c0b59d0 0x7fed0c09cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:08.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.389+0000 7fed0affd700 1 -- 172.21.15.63:0/1014539061 >> v1:172.21.15.155:6789/0 conn(0x7fed0c0b5100 legacy=0x7fed0c063a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:08.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.389+0000 7fed0affd700 1 -- 172.21.15.63:0/1014539061 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c146820 con 0x7fed0c09e550 2020-05-18T21:29:08.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.389+0000 7fed0affd700 1 --2- 172.21.15.63:0/1014539061 >> v2:172.21.15.63:3300/0 conn(0x7fed0c09e550 0x7fed0c1567c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fed0c062290 tx=0x7fecfc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.389+0000 7fed0affd700 1 --2- 172.21.15.63:0/1014539061 >> v2:172.21.15.63:3300/0 conn(0x7fed0c09e550 0x7fed0c1567c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fed0c062290 tx=0x7fecfc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.389+0000 7fed0affd700 1 --2- 172.21.15.63:0/1014539061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed0c09e550 0x7fed0c1567c0 secure :-1 s=READY pgs=683 cs=0 l=1 rx=0x7fed0c062290 tx=0x7fecfc010ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:08.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.389+0000 7fed0affd700 1 --2- 172.21.15.63:0/1014539061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed0c09e550 0x7fed0c1567c0 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7fed0c062290 tx=0x7fecfc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.389+0000 7fed08ff9700 1 -- 172.21.15.63:0/1014539061 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecfc012530 con 0x7fed0c09e550 2020-05-18T21:29:08.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.389+0000 7fed0affd700 1 --2- 172.21.15.63:0/1014539061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed0c09e550 0x7fed0c1567c0 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7fed0c062290 tx=0x7fecfc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.389+0000 7fed08ff9700 1 -- 172.21.15.63:0/1014539061 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc012690 con 0x7fed0c09e550 2020-05-18T21:29:08.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.389+0000 7fed0bfff700 1 -- 172.21.15.63:0/1014539061 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0c146ac0 con 0x7fed0c09e550 2020-05-18T21:29:08.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.389+0000 7fed0affd700 1 --2- 172.21.15.63:0/1014539061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed0c09e550 0x7fed0c1567c0 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7fed0c062290 tx=0x7fecfc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.389+0000 7fed08ff9700 1 -- 172.21.15.63:0/1014539061 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecfc012ab0 con 0x7fed0c09e550 2020-05-18T21:29:08.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.389+0000 7fed0bfff700 1 -- 172.21.15.63:0/1014539061 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0c146120 con 0x7fed0c09e550 2020-05-18T21:29:08.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.389+0000 7fed0affd700 1 --2- 172.21.15.63:0/1014539061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed0c09e550 0x7fed0c1567c0 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7fed0c062290 tx=0x7fecfc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.389+0000 7fed0bfff700 1 -- 172.21.15.63:0/1014539061 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0c0569e0 con 0x7fed0c09e550 2020-05-18T21:29:08.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.389+0000 7fed08ff9700 1 -- 172.21.15.63:0/1014539061 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fecfc012d70 con 0x7fed0c09e550 2020-05-18T21:29:08.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.389+0000 7fed0affd700 1 --2- 172.21.15.63:0/1014539061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed0c09e550 0x7fed0c1567c0 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7fed0c062290 tx=0x7fecfc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.393+0000 7fed08ff9700 1 --2- 172.21.15.63:0/1014539061 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fecf004fa50 0x7fecf0051f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:08.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.393+0000 7fed08ff9700 1 -- 172.21.15.63:0/1014539061 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fecfc0636f0 con 0x7fed0c09e550 2020-05-18T21:29:08.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.393+0000 7fed027fc700 1 --2- 172.21.15.63:0/1014539061 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fecf004fa50 0x7fecf0051f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:08.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.393+0000 7fed027fc700 1 --2- 172.21.15.63:0/1014539061 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fecf004fa50 0x7fecf0051f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fed0c1473d0 tx=0x7fecf4007740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.393+0000 7fed027fc700 1 --2- 172.21.15.63:0/1014539061 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fecf004fa50 0x7fecf0051f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fed0c1473d0 tx=0x7fecf4007740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.393+0000 7fed027fc700 1 --2- 172.21.15.63:0/1014539061 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fecf004fa50 0x7fecf0051f10 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7fed0c1473d0 tx=0x7fecf4007740).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:08.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.397+0000 7fed0affd700 1 --2- 172.21.15.63:0/1014539061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed0c09e550 0x7fed0c1567c0 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7fed0c062290 tx=0x7fecfc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.397+0000 7fed08ff9700 1 -- 172.21.15.63:0/1014539061 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fecfc03da20 con 0x7fed0c09e550 2020-05-18T21:29:08.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.513+0000 7fed0bfff700 1 -- 172.21.15.63:0/1014539061 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fed0c145cd0 con 0x7fed0c09e550 2020-05-18T21:29:08.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.865+0000 7fed0affd700 1 --2- 172.21.15.63:0/1014539061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed0c09e550 0x7fed0c1567c0 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7fed0c062290 tx=0x7fecfc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:08.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.865+0000 7fed08ff9700 1 -- 172.21.15.63:0/1014539061 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v58) v1 ==== 133+0+0 (secure 0 0 0) 0x7fecfc041040 con 0x7fed0c09e550 2020-05-18T21:29:08.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.873+0000 7fed0bfff700 1 -- 172.21.15.63:0/1014539061 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fecf004fa50 msgr2=0x7fecf0051f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:08.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.873+0000 7fed0bfff700 1 --2- 172.21.15.63:0/1014539061 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fecf004fa50 0x7fecf0051f10 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7fed0c1473d0 tx=0x7fecf4007740).stop 2020-05-18T21:29:08.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.873+0000 7fed0bfff700 1 -- 172.21.15.63:0/1014539061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed0c09e550 msgr2=0x7fed0c1567c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:08.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.873+0000 7fed0bfff700 1 --2- 172.21.15.63:0/1014539061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed0c09e550 0x7fed0c1567c0 secure :-1 s=READY pgs=683 cs=0 l=1 rx=0x7fed0c062290 tx=0x7fecfc010ab0).stop 2020-05-18T21:29:08.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.873+0000 7fed0bfff700 1 -- 172.21.15.63:0/1014539061 shutdown_connections 2020-05-18T21:29:08.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.873+0000 7fed0bfff700 1 --2- 172.21.15.63:0/1014539061 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fecf004fa50 0x7fecf0051f10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:08.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.873+0000 7fed0bfff700 1 --2- 172.21.15.63:0/1014539061 >> v2:172.21.15.155:3300/0 conn(0x7fed0c0b59d0 0x7fed0c09cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:08.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.873+0000 7fed0bfff700 1 --2- 172.21.15.63:0/1014539061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed0c09e550 0x7fed0c1567c0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:08.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.873+0000 7fed0bfff700 1 -- 172.21.15.63:0/1014539061 >> 172.21.15.63:0/1014539061 conn(0x7fed0c05b210 msgr2=0x7fed0c1450a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:08.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.873+0000 7fed0bfff700 1 -- 172.21.15.63:0/1014539061 shutdown_connections 2020-05-18T21:29:08.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:08.873+0000 7fed0bfff700 1 -- 172.21.15.63:0/1014539061 wait complete. 2020-05-18T21:29:08.881 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2020-05-18T21:29:08.891 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-05-18T21:29:09.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.001+0000 7ff8f20b6700 1 Processor -- start 2020-05-18T21:29:09.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.001+0000 7ff8f20b6700 1 -- start start 2020-05-18T21:29:09.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.001+0000 7ff8f20b6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8ec0b68d0 0x7ff8ec1469b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:09.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.001+0000 7ff8f20b6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff8ec0b99d0 0x7ff8ec149d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:09.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.001+0000 7ff8f20b6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ec145fd0 con 0x7ff8ec0b8ed0 2020-05-18T21:29:09.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.001+0000 7ff8f20b6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ec146270 con 0x7ff8ec0b99d0 2020-05-18T21:29:09.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.001+0000 7ff8f20b6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec146510 con 0x7ff8ec0b68d0 2020-05-18T21:29:09.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.001+0000 7ff8f08b3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff8ec0b99d0 0x7ff8ec149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:09.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.001+0000 7ff8f08b3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff8ec0b99d0 0x7ff8ec149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56152/0 (socket says 172.21.15.63:56152) 2020-05-18T21:29:09.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.001+0000 7ff8f08b3700 1 -- 172.21.15.63:0/1448518606 learned_addr learned my addr 172.21.15.63:0/1448518606 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:09.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.001+0000 7ff8f10b4700 1 --2- 172.21.15.63:0/1448518606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8ec0b68d0 0x7ff8ec1469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:09.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8dffff700 1 -- 172.21.15.63:0/1448518606 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582528995 0 0) 0x7ff8ec145fd0 con 0x7ff8ec0b8ed0 2020-05-18T21:29:09.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8dffff700 1 -- 172.21.15.63:0/1448518606 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8d4003270 con 0x7ff8ec0b8ed0 2020-05-18T21:29:09.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8f08b3700 1 -- 172.21.15.63:0/1448518606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8ec0b68d0 msgr2=0x7ff8ec1469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:09.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8f08b3700 1 --2- 172.21.15.63:0/1448518606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8ec0b68d0 0x7ff8ec1469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:09.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8f08b3700 1 -- 172.21.15.63:0/1448518606 >> v1:172.21.15.155:6789/0 conn(0x7ff8ec0b8ed0 legacy=0x7ff8ec060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:09.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8f08b3700 1 -- 172.21.15.63:0/1448518606 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec0b6cb0 con 0x7ff8ec0b99d0 2020-05-18T21:29:09.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8f08b3700 1 --2- 172.21.15.63:0/1448518606 >> v2:172.21.15.63:3300/0 conn(0x7ff8ec0b99d0 0x7ff8ec149d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff8ec0b8c90 tx=0x7ff8e8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:09.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8f08b3700 1 --2- 172.21.15.63:0/1448518606 >> v2:172.21.15.63:3300/0 conn(0x7ff8ec0b99d0 0x7ff8ec149d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff8ec0b8c90 tx=0x7ff8e8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:09.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8f08b3700 1 --2- 172.21.15.63:0/1448518606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8ec0b99d0 0x7ff8ec149d40 secure :-1 s=READY pgs=684 cs=0 l=1 rx=0x7ff8ec0b8c90 tx=0x7ff8e8008920).ready entity=mon.0 client_cookie=99a039da65edf1c9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:09.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8f08b3700 1 --2- 172.21.15.63:0/1448518606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8ec0b99d0 0x7ff8ec149d40 secure :-1 s=THROTTLE_DONE pgs=684 cs=0 l=1 rx=0x7ff8ec0b8c90 tx=0x7ff8e8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:09.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8f08b3700 1 --2- 172.21.15.63:0/1448518606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8ec0b99d0 0x7ff8ec149d40 secure :-1 s=THROTTLE_DONE pgs=684 cs=0 l=1 rx=0x7ff8ec0b8c90 tx=0x7ff8e8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:09.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8dffff700 1 -- 172.21.15.63:0/1448518606 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e8011600 con 0x7ff8ec0b99d0 2020-05-18T21:29:09.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8f08b3700 1 --2- 172.21.15.63:0/1448518606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8ec0b99d0 0x7ff8ec149d40 secure :-1 s=THROTTLE_DONE pgs=684 cs=0 l=1 rx=0x7ff8ec0b8c90 tx=0x7ff8e8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:09.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8dffff700 1 -- 172.21.15.63:0/1448518606 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e8011760 con 0x7ff8ec0b99d0 2020-05-18T21:29:09.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8dffff700 1 -- 172.21.15.63:0/1448518606 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e8011b80 con 0x7ff8ec0b99d0 2020-05-18T21:29:09.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8f20b6700 1 -- 172.21.15.63:0/1448518606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8ec0b99d0 msgr2=0x7ff8ec149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:09.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8f20b6700 1 --2- 172.21.15.63:0/1448518606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8ec0b99d0 0x7ff8ec149d40 secure :-1 s=READY pgs=684 cs=0 l=1 rx=0x7ff8ec0b8c90 tx=0x7ff8e8008920).stop 2020-05-18T21:29:09.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8f20b6700 1 -- 172.21.15.63:0/1448518606 shutdown_connections 2020-05-18T21:29:09.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8f20b6700 1 --2- 172.21.15.63:0/1448518606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8ec0b99d0 0x7ff8ec149d40 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:09.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8f20b6700 1 --2- 172.21.15.63:0/1448518606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8ec0b68d0 0x7ff8ec1469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:09.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8f20b6700 1 -- 172.21.15.63:0/1448518606 >> 172.21.15.63:0/1448518606 conn(0x7ff8ec069b70 msgr2=0x7ff8ec069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:09.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8f20b6700 1 -- 172.21.15.63:0/1448518606 shutdown_connections 2020-05-18T21:29:09.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.005+0000 7ff8f20b6700 1 -- 172.21.15.63:0/1448518606 wait complete. 2020-05-18T21:29:09.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.009+0000 7ff8f20b6700 1 Processor -- start 2020-05-18T21:29:09.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.009+0000 7ff8f20b6700 1 -- start start 2020-05-18T21:29:09.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.009+0000 7ff8f20b6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff8ec0b99d0 0x7ff8ec0ae490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:09.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.009+0000 7ff8f20b6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ec1541c0 con 0x7ff8ec0b8ed0 2020-05-18T21:29:09.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.009+0000 7ff8f20b6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ec1421e0 con 0x7ff8ec0b68d0 2020-05-18T21:29:09.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.009+0000 7ff8f20b6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ec153370 con 0x7ff8ec0b99d0 2020-05-18T21:29:09.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.009+0000 7ff8f08b3700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff8ec0b8ed0 0x7ff8ec143cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58346/0 (socket says 172.21.15.63:58346) 2020-05-18T21:29:09.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.009+0000 7ff8f08b3700 1 -- 172.21.15.63:0/3998921606 learned_addr learned my addr 172.21.15.63:0/3998921606 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:09.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.009+0000 7ff8f18b5700 1 --2- 172.21.15.63:0/3998921606 >> v2:172.21.15.63:3300/0 conn(0x7ff8ec0b99d0 0x7ff8ec0ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:09.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8de7fc700 1 -- 172.21.15.63:0/3998921606 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779701653 0 0) 0x7ff8ec1541c0 con 0x7ff8ec0b8ed0 2020-05-18T21:29:09.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8de7fc700 1 -- 172.21.15.63:0/3998921606 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8cc002fe0 con 0x7ff8ec0b8ed0 2020-05-18T21:29:09.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8de7fc700 1 -- 172.21.15.63:0/3998921606 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532936860 0 0) 0x7ff8ec1421e0 con 0x7ff8ec0b68d0 2020-05-18T21:29:09.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8de7fc700 1 -- 172.21.15.63:0/3998921606 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8ec1541c0 con 0x7ff8ec0b68d0 2020-05-18T21:29:09.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8f18b5700 1 -- 172.21.15.63:0/3998921606 >> v1:172.21.15.155:6789/0 conn(0x7ff8ec0b68d0 legacy=0x7ff8ec153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:09.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8f18b5700 1 -- 172.21.15.63:0/3998921606 >> v1:172.21.15.63:6789/0 conn(0x7ff8ec0b8ed0 legacy=0x7ff8ec143cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8f18b5700 1 -- 172.21.15.63:0/3998921606 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec153610 con 0x7ff8ec0b99d0 2020-05-18T21:29:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8f18b5700 1 --2- 172.21.15.63:0/3998921606 >> v2:172.21.15.63:3300/0 conn(0x7ff8ec0b99d0 0x7ff8ec0ae490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff8e4001490 tx=0x7ff8e4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8f18b5700 1 --2- 172.21.15.63:0/3998921606 >> v2:172.21.15.63:3300/0 conn(0x7ff8ec0b99d0 0x7ff8ec0ae490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff8e4001490 tx=0x7ff8e4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8f18b5700 1 --2- 172.21.15.63:0/3998921606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8ec0b99d0 0x7ff8ec0ae490 secure :-1 s=READY pgs=686 cs=0 l=1 rx=0x7ff8e4001490 tx=0x7ff8e4010c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8f18b5700 1 --2- 172.21.15.63:0/3998921606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8ec0b99d0 0x7ff8ec0ae490 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7ff8e4001490 tx=0x7ff8e4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:09.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8de7fc700 1 -- 172.21.15.63:0/3998921606 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e4012230 con 0x7ff8ec0b99d0 2020-05-18T21:29:09.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8f18b5700 1 --2- 172.21.15.63:0/3998921606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8ec0b99d0 0x7ff8ec0ae490 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7ff8e4001490 tx=0x7ff8e4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:09.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8f18b5700 1 --2- 172.21.15.63:0/3998921606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8ec0b99d0 0x7ff8ec0ae490 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7ff8e4001490 tx=0x7ff8e4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:09.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8de7fc700 1 -- 172.21.15.63:0/3998921606 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e4012390 con 0x7ff8ec0b99d0 2020-05-18T21:29:09.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8f20b6700 1 -- 172.21.15.63:0/3998921606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ec1443e0 con 0x7ff8ec0b99d0 2020-05-18T21:29:09.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8de7fc700 1 -- 172.21.15.63:0/3998921606 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e40127b0 con 0x7ff8ec0b99d0 2020-05-18T21:29:09.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8f20b6700 1 -- 172.21.15.63:0/3998921606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ec141090 con 0x7ff8ec0b99d0 2020-05-18T21:29:09.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8f18b5700 1 --2- 172.21.15.63:0/3998921606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8ec0b99d0 0x7ff8ec0ae490 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7ff8e4001490 tx=0x7ff8e4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:09.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8f20b6700 1 -- 172.21.15.63:0/3998921606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8ec141fd0 con 0x7ff8ec0b99d0 2020-05-18T21:29:09.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8de7fc700 1 -- 172.21.15.63:0/3998921606 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff8e4012a20 con 0x7ff8ec0b99d0 2020-05-18T21:29:09.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8f18b5700 1 --2- 172.21.15.63:0/3998921606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8ec0b99d0 0x7ff8ec0ae490 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7ff8e4001490 tx=0x7ff8e4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:09.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.013+0000 7ff8de7fc700 1 --2- 172.21.15.63:0/3998921606 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8cc04fed0 0x7ff8cc052390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:09.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.017+0000 7ff8de7fc700 1 -- 172.21.15.63:0/3998921606 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5607+0+0 (secure 0 0 0) 0x7ff8e40640b0 con 0x7ff8ec0b99d0 2020-05-18T21:29:09.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.017+0000 7ff8f10b4700 1 --2- 172.21.15.63:0/3998921606 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8cc04fed0 0x7ff8cc052390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:09.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.017+0000 7ff8f10b4700 1 --2- 172.21.15.63:0/3998921606 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8cc04fed0 0x7ff8cc052390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff8e0002f30 tx=0x7ff8e00090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:09.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.017+0000 7ff8f10b4700 1 --2- 172.21.15.63:0/3998921606 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8cc04fed0 0x7ff8cc052390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff8e0002f30 tx=0x7ff8e00090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:09.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.017+0000 7ff8f10b4700 1 --2- 172.21.15.63:0/3998921606 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8cc04fed0 0x7ff8cc052390 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7ff8e0002f30 tx=0x7ff8e00090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:09.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.021+0000 7ff8f18b5700 1 --2- 172.21.15.63:0/3998921606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8ec0b99d0 0x7ff8ec0ae490 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7ff8e4001490 tx=0x7ff8e4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:09.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.021+0000 7ff8de7fc700 1 -- 172.21.15.63:0/3998921606 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff8e403e4a0 con 0x7ff8ec0b99d0 2020-05-18T21:29:09.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.141+0000 7ff8f20b6700 1 -- 172.21.15.63:0/3998921606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7ff8ec0569e0 con 0x7ff8ec0b99d0 2020-05-18T21:29:09.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.881+0000 7ff8f18b5700 1 --2- 172.21.15.63:0/3998921606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8ec0b99d0 0x7ff8ec0ae490 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7ff8e4001490 tx=0x7ff8e4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:09.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.881+0000 7ff8de7fc700 1 -- 172.21.15.63:0/3998921606 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v59) v1 ==== 125+0+0 (secure 0 0 0) 0x7ff8e4041ac0 con 0x7ff8ec0b99d0 2020-05-18T21:29:09.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.885+0000 7ff8f20b6700 1 -- 172.21.15.63:0/3998921606 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8cc04fed0 msgr2=0x7ff8cc052390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:09.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.885+0000 7ff8f20b6700 1 --2- 172.21.15.63:0/3998921606 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8cc04fed0 0x7ff8cc052390 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7ff8e0002f30 tx=0x7ff8e00090f0).stop 2020-05-18T21:29:09.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.885+0000 7ff8f20b6700 1 -- 172.21.15.63:0/3998921606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8ec0b99d0 msgr2=0x7ff8ec0ae490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:09.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.885+0000 7ff8f20b6700 1 --2- 172.21.15.63:0/3998921606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8ec0b99d0 0x7ff8ec0ae490 secure :-1 s=READY pgs=686 cs=0 l=1 rx=0x7ff8e4001490 tx=0x7ff8e4010c40).stop 2020-05-18T21:29:09.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.885+0000 7ff8f20b6700 1 -- 172.21.15.63:0/3998921606 shutdown_connections 2020-05-18T21:29:09.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.885+0000 7ff8f20b6700 1 --2- 172.21.15.63:0/3998921606 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8cc04fed0 0x7ff8cc052390 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:09.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.885+0000 7ff8f20b6700 1 --2- 172.21.15.63:0/3998921606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8ec0b99d0 0x7ff8ec0ae490 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:09.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.885+0000 7ff8f20b6700 1 -- 172.21.15.63:0/3998921606 >> 172.21.15.63:0/3998921606 conn(0x7ff8ec069b70 msgr2=0x7ff8ec142520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:09.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.885+0000 7ff8f20b6700 1 -- 172.21.15.63:0/3998921606 shutdown_connections 2020-05-18T21:29:09.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:09.885+0000 7ff8f20b6700 1 -- 172.21.15.63:0/3998921606 wait complete. 2020-05-18T21:29:09.894 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2020-05-18T21:29:09.905 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-05-18T21:29:10.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.005+0000 7f731d94f700 1 Processor -- start 2020-05-18T21:29:10.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.005+0000 7f731d94f700 1 -- start start 2020-05-18T21:29:10.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.005+0000 7f731d94f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f73180b61d0 0x7f73180af600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:10.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.005+0000 7f731d94f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7318065df0 0x7f73181464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:10.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.005+0000 7f731d94f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73181499b0 con 0x7f7318149510 2020-05-18T21:29:10.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.005+0000 7f731d94f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73180ae290 con 0x7f73180b61d0 2020-05-18T21:29:10.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.005+0000 7f731d94f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7318149c50 con 0x7f7318065df0 2020-05-18T21:29:10.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.005+0000 7f7316ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f73180b61d0 0x7f73180af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.005+0000 7f73167fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7318149510 0x7f73180656e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58354/0 (socket says 172.21.15.63:58354) 2020-05-18T21:29:10.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.005+0000 7f73167fc700 1 -- 172.21.15.63:0/3150763817 learned_addr learned my addr 172.21.15.63:0/3150763817 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:10.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f73177fe700 1 --2- 172.21.15.63:0/3150763817 >> v2:172.21.15.155:3300/0 conn(0x7f7318065df0 0x7f73181464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f7316ffd700 1 -- 172.21.15.63:0/3150763817 >> v2:172.21.15.155:3300/0 conn(0x7f7318065df0 msgr2=0x7f73181464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:10.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f7316ffd700 1 --2- 172.21.15.63:0/3150763817 >> v2:172.21.15.155:3300/0 conn(0x7f7318065df0 0x7f73181464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:10.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f7316ffd700 1 -- 172.21.15.63:0/3150763817 >> v1:172.21.15.63:6789/0 conn(0x7f7318149510 legacy=0x7f73180656e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f7315ffb700 1 -- 172.21.15.63:0/3150763817 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886233951 0 0) 0x7f73181499b0 con 0x7f7318149510 2020-05-18T21:29:10.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f7316ffd700 1 -- 172.21.15.63:0/3150763817 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7318149ef0 con 0x7f73180b61d0 2020-05-18T21:29:10.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f7316ffd700 1 --2- 172.21.15.63:0/3150763817 >> v2:172.21.15.63:3300/0 conn(0x7f73180b61d0 0x7f73180af600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f73080032f0 tx=0x7f7308007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f7316ffd700 1 --2- 172.21.15.63:0/3150763817 >> v2:172.21.15.63:3300/0 conn(0x7f73180b61d0 0x7f73180af600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f73080032f0 tx=0x7f7308007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f7316ffd700 1 --2- 172.21.15.63:0/3150763817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73180b61d0 0x7f73180af600 secure :-1 s=READY pgs=688 cs=0 l=1 rx=0x7f73080032f0 tx=0x7f7308007e00).ready entity=mon.0 client_cookie=217cc76f88205a61 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:10.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f7316ffd700 1 --2- 172.21.15.63:0/3150763817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73180b61d0 0x7f73180af600 secure :-1 s=THROTTLE_DONE pgs=688 cs=0 l=1 rx=0x7f73080032f0 tx=0x7f7308007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f7315ffb700 1 -- 172.21.15.63:0/3150763817 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f730800a180 con 0x7f73180b61d0 2020-05-18T21:29:10.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f7316ffd700 1 --2- 172.21.15.63:0/3150763817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73180b61d0 0x7f73180af600 secure :-1 s=THROTTLE_DONE pgs=688 cs=0 l=1 rx=0x7f73080032f0 tx=0x7f7308007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f7316ffd700 1 --2- 172.21.15.63:0/3150763817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73180b61d0 0x7f73180af600 secure :-1 s=THROTTLE_DONE pgs=688 cs=0 l=1 rx=0x7f73080032f0 tx=0x7f7308007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f7315ffb700 1 -- 172.21.15.63:0/3150763817 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730800a2e0 con 0x7f73180b61d0 2020-05-18T21:29:10.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f7315ffb700 1 -- 172.21.15.63:0/3150763817 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f730800a6c0 con 0x7f73180b61d0 2020-05-18T21:29:10.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f731d94f700 1 -- 172.21.15.63:0/3150763817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73180b61d0 msgr2=0x7f73180af600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f731d94f700 1 --2- 172.21.15.63:0/3150763817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73180b61d0 0x7f73180af600 secure :-1 s=READY pgs=688 cs=0 l=1 rx=0x7f73080032f0 tx=0x7f7308007e00).stop 2020-05-18T21:29:10.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f731d94f700 1 -- 172.21.15.63:0/3150763817 shutdown_connections 2020-05-18T21:29:10.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f731d94f700 1 --2- 172.21.15.63:0/3150763817 >> v2:172.21.15.155:3300/0 conn(0x7f7318065df0 0x7f73181464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:10.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f731d94f700 1 --2- 172.21.15.63:0/3150763817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73180b61d0 0x7f73180af600 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:10.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f731d94f700 1 -- 172.21.15.63:0/3150763817 >> 172.21.15.63:0/3150763817 conn(0x7f73180b9770 msgr2=0x7f73180b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:10.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f731d94f700 1 -- 172.21.15.63:0/3150763817 shutdown_connections 2020-05-18T21:29:10.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f731d94f700 1 -- 172.21.15.63:0/3150763817 wait complete. 2020-05-18T21:29:10.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f731d94f700 1 Processor -- start 2020-05-18T21:29:10.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f731d94f700 1 -- start start 2020-05-18T21:29:10.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f731d94f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7318065df0 0x7f73181574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:10.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f731d94f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7318144520 con 0x7f7318149510 2020-05-18T21:29:10.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f731d94f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731813faa0 con 0x7f73180b61d0 2020-05-18T21:29:10.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f731d94f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731813f8b0 con 0x7f7318065df0 2020-05-18T21:29:10.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f7316ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7318065df0 0x7f73181574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f73177fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7318149510 0x7f731813c030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58362/0 (socket says 172.21.15.63:58362) 2020-05-18T21:29:10.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f7316ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7318065df0 0x7f73181574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56170/0 (socket says 172.21.15.63:56170) 2020-05-18T21:29:10.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.009+0000 7f73177fe700 1 -- 172.21.15.63:0/3802458850 learned_addr learned my addr 172.21.15.63:0/3802458850 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:10.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f7316ffd700 1 -- 172.21.15.63:0/3802458850 >> v1:172.21.15.155:6789/0 conn(0x7f73180b61d0 legacy=0x7f731813cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f730ffff700 1 -- 172.21.15.63:0/3802458850 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 632939479 0 0) 0x7f7318144520 con 0x7f7318149510 2020-05-18T21:29:10.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f7316ffd700 1 -- 172.21.15.63:0/3802458850 >> v1:172.21.15.63:6789/0 conn(0x7f7318149510 legacy=0x7f731813c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f7316ffd700 1 -- 172.21.15.63:0/3802458850 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7318144cf0 con 0x7f7318065df0 2020-05-18T21:29:10.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f7316ffd700 1 --2- 172.21.15.63:0/3802458850 >> v2:172.21.15.63:3300/0 conn(0x7f7318065df0 0x7f73181574d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f73080032f0 tx=0x7f7308007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f7316ffd700 1 --2- 172.21.15.63:0/3802458850 >> v2:172.21.15.63:3300/0 conn(0x7f7318065df0 0x7f73181574d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f73080032f0 tx=0x7f7308007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f7316ffd700 1 --2- 172.21.15.63:0/3802458850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7318065df0 0x7f73181574d0 secure :-1 s=READY pgs=690 cs=0 l=1 rx=0x7f73080032f0 tx=0x7f7308007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:10.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f7316ffd700 1 --2- 172.21.15.63:0/3802458850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7318065df0 0x7f73181574d0 secure :-1 s=THROTTLE_DONE pgs=690 cs=0 l=1 rx=0x7f73080032f0 tx=0x7f7308007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f730ffff700 1 -- 172.21.15.63:0/3802458850 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7308005c70 con 0x7f7318065df0 2020-05-18T21:29:10.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f7316ffd700 1 --2- 172.21.15.63:0/3802458850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7318065df0 0x7f73181574d0 secure :-1 s=THROTTLE_DONE pgs=690 cs=0 l=1 rx=0x7f73080032f0 tx=0x7f7308007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f7316ffd700 1 --2- 172.21.15.63:0/3802458850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7318065df0 0x7f73181574d0 secure :-1 s=THROTTLE_DONE pgs=690 cs=0 l=1 rx=0x7f73080032f0 tx=0x7f7308007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f730ffff700 1 -- 172.21.15.63:0/3802458850 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7308005dd0 con 0x7f7318065df0 2020-05-18T21:29:10.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f731d94f700 1 -- 172.21.15.63:0/3802458850 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7318144080 con 0x7f7318065df0 2020-05-18T21:29:10.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f730ffff700 1 -- 172.21.15.63:0/3802458850 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f730800f890 con 0x7f7318065df0 2020-05-18T21:29:10.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f731d94f700 1 -- 172.21.15.63:0/3802458850 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731813c8e0 con 0x7f7318065df0 2020-05-18T21:29:10.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f7316ffd700 1 --2- 172.21.15.63:0/3802458850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7318065df0 0x7f73181574d0 secure :-1 s=THROTTLE_DONE pgs=690 cs=0 l=1 rx=0x7f73080032f0 tx=0x7f7308007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f731d94f700 1 -- 172.21.15.63:0/3802458850 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7318144360 con 0x7f7318065df0 2020-05-18T21:29:10.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f730ffff700 1 -- 172.21.15.63:0/3802458850 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f730800fb00 con 0x7f7318065df0 2020-05-18T21:29:10.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f7316ffd700 1 --2- 172.21.15.63:0/3802458850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7318065df0 0x7f73181574d0 secure :-1 s=THROTTLE_DONE pgs=690 cs=0 l=1 rx=0x7f73080032f0 tx=0x7f7308007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f730ffff700 1 --2- 172.21.15.63:0/3802458850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f72fc04f920 0x7f72fc051de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:10.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f730ffff700 1 -- 172.21.15.63:0/3802458850 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f7308064d90 con 0x7f7318065df0 2020-05-18T21:29:10.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.013+0000 7f73167fc700 1 --2- 172.21.15.63:0/3802458850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f72fc04f920 0x7f72fc051de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.017+0000 7f73167fc700 1 --2- 172.21.15.63:0/3802458850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f72fc04f920 0x7f72fc051de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f73180b8890 tx=0x7f7300001530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.017+0000 7f73167fc700 1 --2- 172.21.15.63:0/3802458850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f72fc04f920 0x7f72fc051de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f73180b8890 tx=0x7f7300001530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.017+0000 7f73167fc700 1 --2- 172.21.15.63:0/3802458850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f72fc04f920 0x7f72fc051de0 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f73180b8890 tx=0x7f7300001530).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:10.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.021+0000 7f7316ffd700 1 --2- 172.21.15.63:0/3802458850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7318065df0 0x7f73181574d0 secure :-1 s=THROTTLE_DONE pgs=690 cs=0 l=1 rx=0x7f73080032f0 tx=0x7f7308007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.021+0000 7f730ffff700 1 -- 172.21.15.63:0/3802458850 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f730803f1e0 con 0x7f7318065df0 2020-05-18T21:29:10.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.169+0000 7f731d94f700 1 -- 172.21.15.63:0/3802458850 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f731813fc30 con 0x7f7318065df0 2020-05-18T21:29:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.181+0000 7f7316ffd700 1 --2- 172.21.15.63:0/3802458850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7318065df0 0x7f73181574d0 secure :-1 s=THROTTLE_DONE pgs=690 cs=0 l=1 rx=0x7f73080032f0 tx=0x7f7308007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.181+0000 7f730ffff700 1 -- 172.21.15.63:0/3802458850 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 11 and data pool 12 v26) v1 ==== 189+0+0 (secure 0 0 0) 0x7f7308042800 con 0x7f7318065df0 2020-05-18T21:29:10.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.185+0000 7f731d94f700 1 -- 172.21.15.63:0/3802458850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f72fc04f920 msgr2=0x7f72fc051de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.185+0000 7f731d94f700 1 --2- 172.21.15.63:0/3802458850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f72fc04f920 0x7f72fc051de0 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f73180b8890 tx=0x7f7300001530).stop 2020-05-18T21:29:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.185+0000 7f731d94f700 1 -- 172.21.15.63:0/3802458850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7318065df0 msgr2=0x7f73181574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.185+0000 7f731d94f700 1 --2- 172.21.15.63:0/3802458850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7318065df0 0x7f73181574d0 secure :-1 s=READY pgs=690 cs=0 l=1 rx=0x7f73080032f0 tx=0x7f7308007e00).stop 2020-05-18T21:29:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.185+0000 7f731d94f700 1 -- 172.21.15.63:0/3802458850 shutdown_connections 2020-05-18T21:29:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.185+0000 7f731d94f700 1 --2- 172.21.15.63:0/3802458850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f72fc04f920 0x7f72fc051de0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.185+0000 7f731d94f700 1 --2- 172.21.15.63:0/3802458850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7318065df0 0x7f73181574d0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:10.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.185+0000 7f731d94f700 1 -- 172.21.15.63:0/3802458850 >> 172.21.15.63:0/3802458850 conn(0x7f73180b9770 msgr2=0x7f731806a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:10.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.185+0000 7f731d94f700 1 -- 172.21.15.63:0/3802458850 shutdown_connections 2020-05-18T21:29:10.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.185+0000 7f731d94f700 1 -- 172.21.15.63:0/3802458850 wait complete. 2020-05-18T21:29:10.193 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 11 and data pool 12 2020-05-18T21:29:10.206 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:29:10.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe76d4d6700 1 Processor -- start 2020-05-18T21:29:10.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe76d4d6700 1 -- start start 2020-05-18T21:29:10.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe76d4d6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe768060b90 0x7fe7680615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:10.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe76d4d6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe7680b2860 0x7fe76814e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:10.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe76d4d6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe768144090 0x7fe7681444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:10.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe76d4d6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe768144920 con 0x7fe7680b2860 2020-05-18T21:29:10.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe76d4d6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe768066210 con 0x7fe768060b90 2020-05-18T21:29:10.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe76d4d6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76814d960 con 0x7fe768144090 2020-05-18T21:29:10.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe75e7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe7680b2860 0x7fe76814e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe75e7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe7680b2860 0x7fe76814e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56180/0 (socket says 172.21.15.63:56180) 2020-05-18T21:29:10.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe75e7fc700 1 -- 172.21.15.63:0/2486435705 learned_addr learned my addr 172.21.15.63:0/2486435705 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:10.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe7677fe700 1 --2- 172.21.15.63:0/2486435705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe768144090 0x7fe7681444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe766ffd700 1 --2- 172.21.15.63:0/2486435705 >> v2:172.21.15.155:3300/0 conn(0x7fe768060b90 0x7fe7680615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe75e7fc700 1 -- 172.21.15.63:0/2486435705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe768144090 msgr2=0x7fe7681444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:10.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe75e7fc700 1 --2- 172.21.15.63:0/2486435705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe768144090 0x7fe7681444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:10.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe75e7fc700 1 -- 172.21.15.63:0/2486435705 >> v2:172.21.15.155:3300/0 conn(0x7fe768060b90 msgr2=0x7fe7680615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:10.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe75e7fc700 1 --2- 172.21.15.63:0/2486435705 >> v2:172.21.15.155:3300/0 conn(0x7fe768060b90 0x7fe7680615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:10.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe75e7fc700 1 -- 172.21.15.63:0/2486435705 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76814db90 con 0x7fe7680b2860 2020-05-18T21:29:10.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe766ffd700 1 --2- 172.21.15.63:0/2486435705 >> v2:172.21.15.155:3300/0 conn(0x7fe768060b90 0x7fe7680615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:29:10.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe7677fe700 1 --2- 172.21.15.63:0/2486435705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe768144090 0x7fe7681444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:29:10.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe75e7fc700 1 --2- 172.21.15.63:0/2486435705 >> v2:172.21.15.63:3300/0 conn(0x7fe7680b2860 0x7fe76814e570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe768066350 tx=0x7fe750008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe75e7fc700 1 --2- 172.21.15.63:0/2486435705 >> v2:172.21.15.63:3300/0 conn(0x7fe7680b2860 0x7fe76814e570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe768066350 tx=0x7fe750008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe75e7fc700 1 --2- 172.21.15.63:0/2486435705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7680b2860 0x7fe76814e570 secure :-1 s=READY pgs=691 cs=0 l=1 rx=0x7fe768066350 tx=0x7fe750008920).ready entity=mon.0 client_cookie=60483dbd4c7b3aa3 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:10.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe75e7fc700 1 --2- 172.21.15.63:0/2486435705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7680b2860 0x7fe76814e570 secure :-1 s=THROTTLE_DONE pgs=691 cs=0 l=1 rx=0x7fe768066350 tx=0x7fe750008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe7667fc700 1 -- 172.21.15.63:0/2486435705 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe750011760 con 0x7fe7680b2860 2020-05-18T21:29:10.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe75e7fc700 1 --2- 172.21.15.63:0/2486435705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7680b2860 0x7fe76814e570 secure :-1 s=THROTTLE_DONE pgs=691 cs=0 l=1 rx=0x7fe768066350 tx=0x7fe750008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe7667fc700 1 -- 172.21.15.63:0/2486435705 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7500118c0 con 0x7fe7680b2860 2020-05-18T21:29:10.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe75e7fc700 1 --2- 172.21.15.63:0/2486435705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7680b2860 0x7fe76814e570 secure :-1 s=THROTTLE_DONE pgs=691 cs=0 l=1 rx=0x7fe768066350 tx=0x7fe750008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe7667fc700 1 -- 172.21.15.63:0/2486435705 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe750011ce0 con 0x7fe7680b2860 2020-05-18T21:29:10.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe76d4d6700 1 -- 172.21.15.63:0/2486435705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7680b2860 msgr2=0x7fe76814e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe76d4d6700 1 --2- 172.21.15.63:0/2486435705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7680b2860 0x7fe76814e570 secure :-1 s=READY pgs=691 cs=0 l=1 rx=0x7fe768066350 tx=0x7fe750008920).stop 2020-05-18T21:29:10.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe76d4d6700 1 -- 172.21.15.63:0/2486435705 shutdown_connections 2020-05-18T21:29:10.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe76d4d6700 1 --2- 172.21.15.63:0/2486435705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe768144090 0x7fe7681444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:10.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe76d4d6700 1 --2- 172.21.15.63:0/2486435705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7680b2860 0x7fe76814e570 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:10.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe76d4d6700 1 --2- 172.21.15.63:0/2486435705 >> v2:172.21.15.155:3300/0 conn(0x7fe768060b90 0x7fe7680615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:10.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe76d4d6700 1 -- 172.21.15.63:0/2486435705 >> 172.21.15.63:0/2486435705 conn(0x7fe7680b83d0 msgr2=0x7fe7680b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:10.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe76d4d6700 1 -- 172.21.15.63:0/2486435705 shutdown_connections 2020-05-18T21:29:10.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.293+0000 7fe76d4d6700 1 -- 172.21.15.63:0/2486435705 wait complete. 2020-05-18T21:29:10.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe76d4d6700 1 Processor -- start 2020-05-18T21:29:10.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe76d4d6700 1 -- start start 2020-05-18T21:29:10.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe76d4d6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe768060b90 0x7fe76814c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:10.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe76d4d6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe7680b2860 0x7fe768064b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:10.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe76d4d6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe768064fe0 con 0x7fe768144090 2020-05-18T21:29:10.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe76d4d6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7681461c0 con 0x7fe768060b90 2020-05-18T21:29:10.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe76d4d6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76815b920 con 0x7fe7680b2860 2020-05-18T21:29:10.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe766ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe768060b90 0x7fe76814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe766ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe768060b90 0x7fe76814c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56184/0 (socket says 172.21.15.63:56184) 2020-05-18T21:29:10.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe766ffd700 1 -- 172.21.15.63:0/3359353319 learned_addr learned my addr 172.21.15.63:0/3359353319 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:10.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe75e7fc700 1 --2- 172.21.15.63:0/3359353319 >> v2:172.21.15.155:3300/0 conn(0x7fe7680b2860 0x7fe768064b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe766ffd700 1 -- 172.21.15.63:0/3359353319 >> v2:172.21.15.155:3300/0 conn(0x7fe7680b2860 msgr2=0x7fe768064b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe766ffd700 1 --2- 172.21.15.63:0/3359353319 >> v2:172.21.15.155:3300/0 conn(0x7fe7680b2860 0x7fe768064b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:10.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe766ffd700 1 -- 172.21.15.63:0/3359353319 >> v1:172.21.15.63:6789/0 conn(0x7fe768144090 legacy=0x7fe7680b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe764ff9700 1 -- 172.21.15.63:0/3359353319 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305046048 0 0) 0x7fe768064fe0 con 0x7fe768144090 2020-05-18T21:29:10.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe766ffd700 1 -- 172.21.15.63:0/3359353319 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7681463b0 con 0x7fe768060b90 2020-05-18T21:29:10.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe766ffd700 1 --2- 172.21.15.63:0/3359353319 >> v2:172.21.15.63:3300/0 conn(0x7fe768060b90 0x7fe76814c940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe758002f70 tx=0x7fe758010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe766ffd700 1 --2- 172.21.15.63:0/3359353319 >> v2:172.21.15.63:3300/0 conn(0x7fe768060b90 0x7fe76814c940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe758002f70 tx=0x7fe758010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe766ffd700 1 --2- 172.21.15.63:0/3359353319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe768060b90 0x7fe76814c940 secure :-1 s=READY pgs=693 cs=0 l=1 rx=0x7fe758002f70 tx=0x7fe758010b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:10.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe766ffd700 1 --2- 172.21.15.63:0/3359353319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe768060b90 0x7fe76814c940 secure :-1 s=THROTTLE_DONE pgs=693 cs=0 l=1 rx=0x7fe758002f70 tx=0x7fe758010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe764ff9700 1 -- 172.21.15.63:0/3359353319 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe758007180 con 0x7fe768060b90 2020-05-18T21:29:10.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe76d4d6700 1 -- 172.21.15.63:0/3359353319 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76815b540 con 0x7fe768060b90 2020-05-18T21:29:10.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe766ffd700 1 --2- 172.21.15.63:0/3359353319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe768060b90 0x7fe76814c940 secure :-1 s=THROTTLE_DONE pgs=693 cs=0 l=1 rx=0x7fe758002f70 tx=0x7fe758010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe766ffd700 1 --2- 172.21.15.63:0/3359353319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe768060b90 0x7fe76814c940 secure :-1 s=THROTTLE_DONE pgs=693 cs=0 l=1 rx=0x7fe758002f70 tx=0x7fe758010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.297+0000 7fe764ff9700 1 -- 172.21.15.63:0/3359353319 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7580072e0 con 0x7fe768060b90 2020-05-18T21:29:10.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.301+0000 7fe764ff9700 1 -- 172.21.15.63:0/3359353319 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe758005a00 con 0x7fe768060b90 2020-05-18T21:29:10.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.301+0000 7fe76d4d6700 1 -- 172.21.15.63:0/3359353319 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7680b1f00 con 0x7fe768060b90 2020-05-18T21:29:10.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.301+0000 7fe766ffd700 1 --2- 172.21.15.63:0/3359353319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe768060b90 0x7fe76814c940 secure :-1 s=THROTTLE_DONE pgs=693 cs=0 l=1 rx=0x7fe758002f70 tx=0x7fe758010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.301+0000 7fe76d4d6700 1 -- 172.21.15.63:0/3359353319 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7680569e0 con 0x7fe768060b90 2020-05-18T21:29:10.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.301+0000 7fe764ff9700 1 -- 172.21.15.63:0/3359353319 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe758005c00 con 0x7fe768060b90 2020-05-18T21:29:10.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.301+0000 7fe766ffd700 1 --2- 172.21.15.63:0/3359353319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe768060b90 0x7fe76814c940 secure :-1 s=THROTTLE_DONE pgs=693 cs=0 l=1 rx=0x7fe758002f70 tx=0x7fe758010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.301+0000 7fe764ff9700 1 --2- 172.21.15.63:0/3359353319 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe74c04f860 0x7fe74c051d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:10.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.301+0000 7fe764ff9700 1 -- 172.21.15.63:0/3359353319 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe758063b90 con 0x7fe768060b90 2020-05-18T21:29:10.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.301+0000 7fe75e7fc700 1 --2- 172.21.15.63:0/3359353319 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe74c04f860 0x7fe74c051d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.301+0000 7fe75e7fc700 1 --2- 172.21.15.63:0/3359353319 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe74c04f860 0x7fe74c051d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe768066350 tx=0x7fe76805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.301+0000 7fe75e7fc700 1 --2- 172.21.15.63:0/3359353319 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe74c04f860 0x7fe74c051d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe768066350 tx=0x7fe76805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.301+0000 7fe75e7fc700 1 --2- 172.21.15.63:0/3359353319 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe74c04f860 0x7fe74c051d20 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7fe768066350 tx=0x7fe76805fa60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:10.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.309+0000 7fe766ffd700 1 --2- 172.21.15.63:0/3359353319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe768060b90 0x7fe76814c940 secure :-1 s=THROTTLE_DONE pgs=693 cs=0 l=1 rx=0x7fe758002f70 tx=0x7fe758010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.309+0000 7fe764ff9700 1 -- 172.21.15.63:0/3359353319 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe75803dec0 con 0x7fe768060b90 2020-05-18T21:29:10.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.425+0000 7fe76d4d6700 1 -- 172.21.15.63:0/3359353319 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7680008d0 con 0x7fe768060b90 2020-05-18T21:29:10.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.425+0000 7fe766ffd700 1 --2- 172.21.15.63:0/3359353319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe768060b90 0x7fe76814c940 secure :-1 s=THROTTLE_DONE pgs=693 cs=0 l=1 rx=0x7fe758002f70 tx=0x7fe758010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.425+0000 7fe764ff9700 1 -- 172.21.15.63:0/3359353319 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16105 (secure 0 0 0) 0x7fe7580414e0 con 0x7fe768060b90 2020-05-18T21:29:10.432 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:10.432 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":60,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:29:10.174607+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:29:08.544924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2020-05-18T21:29:09.178610+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:29:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.429+0000 7fe76d4d6700 1 -- 172.21.15.63:0/3359353319 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe74c04f860 msgr2=0x7fe74c051d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.429+0000 7fe76d4d6700 1 --2- 172.21.15.63:0/3359353319 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe74c04f860 0x7fe74c051d20 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7fe768066350 tx=0x7fe76805fa60).stop 2020-05-18T21:29:10.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.429+0000 7fe76d4d6700 1 -- 172.21.15.63:0/3359353319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe768060b90 msgr2=0x7fe76814c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.429+0000 7fe76d4d6700 1 --2- 172.21.15.63:0/3359353319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe768060b90 0x7fe76814c940 secure :-1 s=READY pgs=693 cs=0 l=1 rx=0x7fe758002f70 tx=0x7fe758010b00).stop 2020-05-18T21:29:10.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.429+0000 7fe76d4d6700 1 -- 172.21.15.63:0/3359353319 shutdown_connections 2020-05-18T21:29:10.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.429+0000 7fe76d4d6700 1 --2- 172.21.15.63:0/3359353319 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe74c04f860 0x7fe74c051d20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:10.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.429+0000 7fe76d4d6700 1 --2- 172.21.15.63:0/3359353319 >> v2:172.21.15.155:3300/0 conn(0x7fe7680b2860 0x7fe768064b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:10.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.429+0000 7fe76d4d6700 1 --2- 172.21.15.63:0/3359353319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe768060b90 0x7fe76814c940 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:10.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.429+0000 7fe76d4d6700 1 -- 172.21.15.63:0/3359353319 >> 172.21.15.63:0/3359353319 conn(0x7fe7680b83d0 msgr2=0x7fe7680657e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:10.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.429+0000 7fe76d4d6700 1 -- 172.21.15.63:0/3359353319 shutdown_connections 2020-05-18T21:29:10.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.429+0000 7fe76d4d6700 1 -- 172.21.15.63:0/3359353319 wait complete. 2020-05-18T21:29:10.444 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:29:10.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6bcbc9700 1 Processor -- start 2020-05-18T21:29:10.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6bcbc9700 1 -- start start 2020-05-18T21:29:10.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6bcbc9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd6b80b93f0 0x7fd6b8145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:10.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6bcbc9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b80b7ca0 0x7fd6b8142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:10.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6bcbc9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6b81432f0 0x7fd6b8060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:10.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6bcbc9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b80b7020 con 0x7fd6b81432f0 2020-05-18T21:29:10.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6bcbc9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b80b72c0 con 0x7fd6b80b93f0 2020-05-18T21:29:10.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6bcbc9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b80b7560 con 0x7fd6b80b7ca0 2020-05-18T21:29:10.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6b6ffd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b80b7ca0 0x7fd6b8142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6b7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6b81432f0 0x7fd6b8060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6b6ffd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b80b7ca0 0x7fd6b8142e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:46896/0 (socket says 172.21.15.63:46896) 2020-05-18T21:29:10.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6b77fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd6b80b93f0 0x7fd6b8145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6b6ffd700 1 -- 172.21.15.63:0/3941680187 learned_addr learned my addr 172.21.15.63:0/3941680187 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:10.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6b6ffd700 1 -- 172.21.15.63:0/3941680187 >> v2:172.21.15.155:3300/0 conn(0x7fd6b80b93f0 msgr2=0x7fd6b8145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:10.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6b6ffd700 1 --2- 172.21.15.63:0/3941680187 >> v2:172.21.15.155:3300/0 conn(0x7fd6b80b93f0 0x7fd6b8145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:10.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6b6ffd700 1 -- 172.21.15.63:0/3941680187 >> v2:172.21.15.63:3300/0 conn(0x7fd6b81432f0 msgr2=0x7fd6b8060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:10.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6b6ffd700 1 --2- 172.21.15.63:0/3941680187 >> v2:172.21.15.63:3300/0 conn(0x7fd6b81432f0 0x7fd6b8060430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:10.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6b6ffd700 1 -- 172.21.15.63:0/3941680187 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b80b7800 con 0x7fd6b80b7ca0 2020-05-18T21:29:10.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6b6ffd700 1 --2- 172.21.15.63:0/3941680187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b80b7ca0 0x7fd6b8142e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd6b80619f0 tx=0x7fd6a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6b6ffd700 1 --2- 172.21.15.63:0/3941680187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b80b7ca0 0x7fd6b8142e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd6b80619f0 tx=0x7fd6a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.541+0000 7fd6b6ffd700 1 --2- 172.21.15.63:0/3941680187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b80b7ca0 0x7fd6b8142e90 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7fd6b80619f0 tx=0x7fd6a0007a80).ready entity=mon.2 client_cookie=c94bdba101543e82 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:10.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.545+0000 7fd6b6ffd700 1 --2- 172.21.15.63:0/3941680187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b80b7ca0 0x7fd6b8142e90 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fd6b80619f0 tx=0x7fd6a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.545+0000 7fd6b67fc700 1 -- 172.21.15.63:0/3941680187 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a00115c0 con 0x7fd6b80b7ca0 2020-05-18T21:29:10.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.545+0000 7fd6b6ffd700 1 --2- 172.21.15.63:0/3941680187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b80b7ca0 0x7fd6b8142e90 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fd6b80619f0 tx=0x7fd6a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.545+0000 7fd6b6ffd700 1 --2- 172.21.15.63:0/3941680187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b80b7ca0 0x7fd6b8142e90 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fd6b80619f0 tx=0x7fd6a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.545+0000 7fd6b67fc700 1 -- 172.21.15.63:0/3941680187 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a0011720 con 0x7fd6b80b7ca0 2020-05-18T21:29:10.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.545+0000 7fd6b67fc700 1 -- 172.21.15.63:0/3941680187 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a0011b40 con 0x7fd6b80b7ca0 2020-05-18T21:29:10.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.545+0000 7fd6bcbc9700 1 -- 172.21.15.63:0/3941680187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b80b7ca0 msgr2=0x7fd6b8142e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.545+0000 7fd6bcbc9700 1 --2- 172.21.15.63:0/3941680187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b80b7ca0 0x7fd6b8142e90 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7fd6b80619f0 tx=0x7fd6a0007a80).stop 2020-05-18T21:29:10.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.545+0000 7fd6bcbc9700 1 -- 172.21.15.63:0/3941680187 shutdown_connections 2020-05-18T21:29:10.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.545+0000 7fd6bcbc9700 1 --2- 172.21.15.63:0/3941680187 >> v2:172.21.15.63:3300/0 conn(0x7fd6b81432f0 0x7fd6b8060430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:10.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.545+0000 7fd6bcbc9700 1 --2- 172.21.15.63:0/3941680187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6b80b7ca0 0x7fd6b8142e90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:10.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.545+0000 7fd6bcbc9700 1 --2- 172.21.15.63:0/3941680187 >> v2:172.21.15.155:3300/0 conn(0x7fd6b80b93f0 0x7fd6b8145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:10.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.545+0000 7fd6bcbc9700 1 -- 172.21.15.63:0/3941680187 >> 172.21.15.63:0/3941680187 conn(0x7fd6b8069b70 msgr2=0x7fd6b8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:10.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.545+0000 7fd6bcbc9700 1 -- 172.21.15.63:0/3941680187 shutdown_connections 2020-05-18T21:29:10.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.545+0000 7fd6bcbc9700 1 -- 172.21.15.63:0/3941680187 wait complete. 2020-05-18T21:29:10.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.545+0000 7fd6bcbc9700 1 Processor -- start 2020-05-18T21:29:10.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.545+0000 7fd6bcbc9700 1 -- start start 2020-05-18T21:29:10.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6bcbc9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6b80b7ca0 0x7fd6b8157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:10.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6bcbc9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd6b80b93f0 0x7fd6b813f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:10.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6bcbc9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b80bca60 con 0x7fd6b81432f0 2020-05-18T21:29:10.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6bcbc9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b80ba7b0 con 0x7fd6b80b7ca0 2020-05-18T21:29:10.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6bcbc9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b813e020 con 0x7fd6b80b93f0 2020-05-18T21:29:10.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6b77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6b80b7ca0 0x7fd6b8157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6b77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6b80b7ca0 0x7fd6b8157920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56198/0 (socket says 172.21.15.63:56198) 2020-05-18T21:29:10.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6b77fe700 1 -- 172.21.15.63:0/278814156 learned_addr learned my addr 172.21.15.63:0/278814156 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:10.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6b6ffd700 1 --2- 172.21.15.63:0/278814156 >> v2:172.21.15.155:3300/0 conn(0x7fd6b80b93f0 0x7fd6b813f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6b77fe700 1 -- 172.21.15.63:0/278814156 >> v2:172.21.15.155:3300/0 conn(0x7fd6b80b93f0 msgr2=0x7fd6b813f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6b77fe700 1 --2- 172.21.15.63:0/278814156 >> v2:172.21.15.155:3300/0 conn(0x7fd6b80b93f0 0x7fd6b813f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:10.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6b77fe700 1 -- 172.21.15.63:0/278814156 >> v1:172.21.15.155:6789/0 conn(0x7fd6b81432f0 legacy=0x7fd6b80bac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6b77fe700 1 -- 172.21.15.63:0/278814156 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b813e190 con 0x7fd6b80b7ca0 2020-05-18T21:29:10.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6b77fe700 1 --2- 172.21.15.63:0/278814156 >> v2:172.21.15.63:3300/0 conn(0x7fd6b80b7ca0 0x7fd6b8157920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6a8003430 tx=0x7fd6a8011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6b77fe700 1 --2- 172.21.15.63:0/278814156 >> v2:172.21.15.63:3300/0 conn(0x7fd6b80b7ca0 0x7fd6b8157920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6a8003430 tx=0x7fd6a8011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6b77fe700 1 --2- 172.21.15.63:0/278814156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6b80b7ca0 0x7fd6b8157920 secure :-1 s=READY pgs=694 cs=0 l=1 rx=0x7fd6a8003430 tx=0x7fd6a8011100).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:10.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6b77fe700 1 --2- 172.21.15.63:0/278814156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6b80b7ca0 0x7fd6b8157920 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7fd6a8003430 tx=0x7fd6a8011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6b4ff9700 1 -- 172.21.15.63:0/278814156 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a8005e70 con 0x7fd6b80b7ca0 2020-05-18T21:29:10.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6b77fe700 1 --2- 172.21.15.63:0/278814156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6b80b7ca0 0x7fd6b8157920 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7fd6a8003430 tx=0x7fd6a8011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6b77fe700 1 --2- 172.21.15.63:0/278814156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6b80b7ca0 0x7fd6b8157920 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7fd6a8003430 tx=0x7fd6a8011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6b4ff9700 1 -- 172.21.15.63:0/278814156 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a8012b40 con 0x7fd6b80b7ca0 2020-05-18T21:29:10.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6bcbc9700 1 -- 172.21.15.63:0/278814156 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b813e3e0 con 0x7fd6b80b7ca0 2020-05-18T21:29:10.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6b4ff9700 1 -- 172.21.15.63:0/278814156 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a8007180 con 0x7fd6b80b7ca0 2020-05-18T21:29:10.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6bcbc9700 1 -- 172.21.15.63:0/278814156 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b80bc4c0 con 0x7fd6b80b7ca0 2020-05-18T21:29:10.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6bcbc9700 1 -- 172.21.15.63:0/278814156 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b80569e0 con 0x7fd6b80b7ca0 2020-05-18T21:29:10.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.549+0000 7fd6b77fe700 1 --2- 172.21.15.63:0/278814156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6b80b7ca0 0x7fd6b8157920 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7fd6a8003430 tx=0x7fd6a8011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.553+0000 7fd6b4ff9700 1 -- 172.21.15.63:0/278814156 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd6a800e1a0 con 0x7fd6b80b7ca0 2020-05-18T21:29:10.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.553+0000 7fd6b77fe700 1 --2- 172.21.15.63:0/278814156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6b80b7ca0 0x7fd6b8157920 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7fd6a8003430 tx=0x7fd6a8011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.553+0000 7fd6b4ff9700 1 --2- 172.21.15.63:0/278814156 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd69c04fa60 0x7fd69c051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:10.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.553+0000 7fd6b4ff9700 1 -- 172.21.15.63:0/278814156 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd6a8063ea0 con 0x7fd6b80b7ca0 2020-05-18T21:29:10.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.553+0000 7fd6b6ffd700 1 --2- 172.21.15.63:0/278814156 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd69c04fa60 0x7fd69c051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.553+0000 7fd6b6ffd700 1 --2- 172.21.15.63:0/278814156 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd69c04fa60 0x7fd69c051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6b80619f0 tx=0x7fd6a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.553+0000 7fd6b6ffd700 1 --2- 172.21.15.63:0/278814156 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd69c04fa60 0x7fd69c051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6b80619f0 tx=0x7fd6a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.553+0000 7fd6b6ffd700 1 --2- 172.21.15.63:0/278814156 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd69c04fa60 0x7fd69c051f20 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7fd6b80619f0 tx=0x7fd6a0007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:10.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.557+0000 7fd6b77fe700 1 --2- 172.21.15.63:0/278814156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6b80b7ca0 0x7fd6b8157920 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7fd6a8003430 tx=0x7fd6a8011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.557+0000 7fd6b4ff9700 1 -- 172.21.15.63:0/278814156 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd6a803e230 con 0x7fd6b80b7ca0 2020-05-18T21:29:10.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.669+0000 7fd6bcbc9700 1 -- 172.21.15.63:0/278814156 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6b80ba260 con 0x7fd6b80b7ca0 2020-05-18T21:29:10.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.673+0000 7fd6b77fe700 1 --2- 172.21.15.63:0/278814156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6b80b7ca0 0x7fd6b8157920 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7fd6a8003430 tx=0x7fd6a8011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.673+0000 7fd6b4ff9700 1 -- 172.21.15.63:0/278814156 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16105 (secure 0 0 0) 0x7fd6a8041850 con 0x7fd6b80b7ca0 2020-05-18T21:29:10.678 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:10.679 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":60,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:29:10.174607+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:29:08.544924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2020-05-18T21:29:09.178610+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:29:10.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.673+0000 7fd6bcbc9700 1 -- 172.21.15.63:0/278814156 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd69c04fa60 msgr2=0x7fd69c051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.673+0000 7fd6bcbc9700 1 --2- 172.21.15.63:0/278814156 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd69c04fa60 0x7fd69c051f20 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7fd6b80619f0 tx=0x7fd6a0007a80).stop 2020-05-18T21:29:10.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.673+0000 7fd6bcbc9700 1 -- 172.21.15.63:0/278814156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6b80b7ca0 msgr2=0x7fd6b8157920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.673+0000 7fd6bcbc9700 1 --2- 172.21.15.63:0/278814156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6b80b7ca0 0x7fd6b8157920 secure :-1 s=READY pgs=694 cs=0 l=1 rx=0x7fd6a8003430 tx=0x7fd6a8011100).stop 2020-05-18T21:29:10.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.673+0000 7fd6bcbc9700 1 -- 172.21.15.63:0/278814156 shutdown_connections 2020-05-18T21:29:10.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.673+0000 7fd6bcbc9700 1 --2- 172.21.15.63:0/278814156 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd69c04fa60 0x7fd69c051f20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:10.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.673+0000 7fd6bcbc9700 1 --2- 172.21.15.63:0/278814156 >> v2:172.21.15.155:3300/0 conn(0x7fd6b80b93f0 0x7fd6b813f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:10.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.673+0000 7fd6bcbc9700 1 --2- 172.21.15.63:0/278814156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6b80b7ca0 0x7fd6b8157920 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:10.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.673+0000 7fd6bcbc9700 1 -- 172.21.15.63:0/278814156 >> 172.21.15.63:0/278814156 conn(0x7fd6b8069b70 msgr2=0x7fd6b8148880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:10.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.673+0000 7fd6bcbc9700 1 -- 172.21.15.63:0/278814156 shutdown_connections 2020-05-18T21:29:10.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.673+0000 7fd6bcbc9700 1 -- 172.21.15.63:0/278814156 wait complete. 2020-05-18T21:29:10.692 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-05-18T21:29:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.793+0000 7f24ad96e700 1 Processor -- start 2020-05-18T21:29:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.793+0000 7f24ad96e700 1 -- start start 2020-05-18T21:29:10.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad96e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a806a490 0x7f24a80653f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:10.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad96e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f24a8060e10 0x7f24a8061260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:10.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad96e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a8065a50 con 0x7f24a80b4f60 2020-05-18T21:29:10.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad96e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a8065850 con 0x7f24a8060e10 2020-05-18T21:29:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad96e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80606d0 con 0x7f24a806a490 2020-05-18T21:29:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad16d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f24a8060e10 0x7f24a8061260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24a7fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a806a490 0x7f24a80653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad16d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f24a8060e10 0x7f24a8061260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56210/0 (socket says 172.21.15.63:56210) 2020-05-18T21:29:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad16d700 1 -- 172.21.15.63:0/3636931404 learned_addr learned my addr 172.21.15.63:0/3636931404 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad16d700 1 -- 172.21.15.63:0/3636931404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a806a490 msgr2=0x7f24a80653f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad16d700 1 --2- 172.21.15.63:0/3636931404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a806a490 0x7f24a80653f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad16d700 1 -- 172.21.15.63:0/3636931404 >> v1:172.21.15.155:6789/0 conn(0x7f24a80b4f60 legacy=0x7f24a8129880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24a77fe700 1 -- 172.21.15.63:0/3636931404 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492436379 0 0) 0x7f24a8065a50 con 0x7f24a80b4f60 2020-05-18T21:29:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad16d700 1 -- 172.21.15.63:0/3636931404 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a8060970 con 0x7f24a8060e10 2020-05-18T21:29:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24a7fff700 1 --2- 172.21.15.63:0/3636931404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a806a490 0x7f24a80653f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:29:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad16d700 1 --2- 172.21.15.63:0/3636931404 >> v2:172.21.15.63:3300/0 conn(0x7f24a8060e10 0x7f24a8061260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f24a00032f0 tx=0x7f24a0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad16d700 1 --2- 172.21.15.63:0/3636931404 >> v2:172.21.15.63:3300/0 conn(0x7f24a8060e10 0x7f24a8061260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f24a00032f0 tx=0x7f24a0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad16d700 1 --2- 172.21.15.63:0/3636931404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24a8060e10 0x7f24a8061260 secure :-1 s=READY pgs=695 cs=0 l=1 rx=0x7f24a00032f0 tx=0x7f24a0007e00).ready entity=mon.0 client_cookie=3507c1c7cc681582 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad16d700 1 --2- 172.21.15.63:0/3636931404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24a8060e10 0x7f24a8061260 secure :-1 s=THROTTLE_DONE pgs=695 cs=0 l=1 rx=0x7f24a00032f0 tx=0x7f24a0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24a77fe700 1 -- 172.21.15.63:0/3636931404 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24a0011d10 con 0x7f24a8060e10 2020-05-18T21:29:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad16d700 1 --2- 172.21.15.63:0/3636931404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24a8060e10 0x7f24a8061260 secure :-1 s=THROTTLE_DONE pgs=695 cs=0 l=1 rx=0x7f24a00032f0 tx=0x7f24a0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24a77fe700 1 -- 172.21.15.63:0/3636931404 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a0011e70 con 0x7f24a8060e10 2020-05-18T21:29:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad16d700 1 --2- 172.21.15.63:0/3636931404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24a8060e10 0x7f24a8061260 secure :-1 s=THROTTLE_DONE pgs=695 cs=0 l=1 rx=0x7f24a00032f0 tx=0x7f24a0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24a77fe700 1 -- 172.21.15.63:0/3636931404 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24a000a370 con 0x7f24a8060e10 2020-05-18T21:29:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad96e700 1 -- 172.21.15.63:0/3636931404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24a8060e10 msgr2=0x7f24a8061260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad96e700 1 --2- 172.21.15.63:0/3636931404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24a8060e10 0x7f24a8061260 secure :-1 s=READY pgs=695 cs=0 l=1 rx=0x7f24a00032f0 tx=0x7f24a0007e00).stop 2020-05-18T21:29:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad96e700 1 -- 172.21.15.63:0/3636931404 shutdown_connections 2020-05-18T21:29:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad96e700 1 --2- 172.21.15.63:0/3636931404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24a8060e10 0x7f24a8061260 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad96e700 1 --2- 172.21.15.63:0/3636931404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a806a490 0x7f24a80653f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:10.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad96e700 1 -- 172.21.15.63:0/3636931404 >> 172.21.15.63:0/3636931404 conn(0x7f24a805fbd0 msgr2=0x7f24a8069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:10.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad96e700 1 -- 172.21.15.63:0/3636931404 shutdown_connections 2020-05-18T21:29:10.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.797+0000 7f24ad96e700 1 -- 172.21.15.63:0/3636931404 wait complete. 2020-05-18T21:29:10.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24ad96e700 1 Processor -- start 2020-05-18T21:29:10.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24ad96e700 1 -- start start 2020-05-18T21:29:10.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24ad96e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a80b4f60 0x7f24a812c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:10.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24ad96e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a80ae5f0 con 0x7f24a806a490 2020-05-18T21:29:10.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24ad96e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a80ae890 con 0x7f24a8060e10 2020-05-18T21:29:10.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24ad96e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80af400 con 0x7f24a80b4f60 2020-05-18T21:29:10.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24a7fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f24a806a490 0x7f24a80aecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58402/0 (socket says 172.21.15.63:58402) 2020-05-18T21:29:10.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24a7fff700 1 -- 172.21.15.63:0/1946054667 learned_addr learned my addr 172.21.15.63:0/1946054667 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:10.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24ad16d700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a80b4f60 0x7f24a812c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502258836 0 0) 0x7f24a80ae5f0 con 0x7f24a806a490 2020-05-18T21:29:10.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f248c002fe0 con 0x7f24a806a490 2020-05-18T21:29:10.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414250557 0 0) 0x7f24a80ae890 con 0x7f24a8060e10 2020-05-18T21:29:10.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24a80ae5f0 con 0x7f24a8060e10 2020-05-18T21:29:10.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2591296221 0 0) 0x7f248c002fe0 con 0x7f24a806a490 2020-05-18T21:29:10.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f24a80ae890 con 0x7f24a806a490 2020-05-18T21:29:10.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f2490002500 con 0x7f24a806a490 2020-05-18T21:29:10.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a80b4f60 msgr2=0x7f24a812c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24a5ffb700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a80b4f60 0x7f24a812c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:10.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 >> v1:172.21.15.155:6789/0 conn(0x7f24a8060e10 legacy=0x7f24a80add10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 >> v1:172.21.15.63:6789/0 conn(0x7f24a806a490 legacy=0x7f24a80aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24a5ffb700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f248c004bf0 0x7f248c005010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:10.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24a5ffb700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f248c003b30 0x7f248c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:10.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24a5ffb700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f248c004410 0x7f248c00b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:10.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80af400 con 0x7f248c004410 2020-05-18T21:29:10.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c00bbc0 con 0x7f248c003b30 2020-05-18T21:29:10.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.801+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248c00bd00 con 0x7f248c004bf0 2020-05-18T21:29:10.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24ac96c700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f248c004bf0 0x7f248c005010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24ad16d700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f248c004410 0x7f248c00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24a7fff700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f248c003b30 0x7f248c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24ac96c700 1 -- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f248c003b30 msgr2=0x7f248c003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24ac96c700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f248c003b30 0x7f248c003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:10.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24ac96c700 1 -- 172.21.15.63:0/1946054667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f248c004410 msgr2=0x7f248c00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:10.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24ac96c700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f248c004410 0x7f248c00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:10.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24ac96c700 1 -- 172.21.15.63:0/1946054667 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a812b320 con 0x7f248c004bf0 2020-05-18T21:29:10.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24ad96e700 1 -- 172.21.15.63:0/1946054667 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a812b570 con 0x7f248c004bf0 2020-05-18T21:29:10.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24ac96c700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f248c004bf0 0x7f248c005010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2498000f20 tx=0x7f2498010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24ad16d700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f248c004410 0x7f248c00b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:29:10.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24ad96e700 1 -- 172.21.15.63:0/1946054667 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a812c6e0 con 0x7f248c004bf0 2020-05-18T21:29:10.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24ac96c700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f248c004bf0 0x7f248c005010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2498000f20 tx=0x7f2498010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24ac96c700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f248c004bf0 0x7f248c005010 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7f2498000f20 tx=0x7f2498010b30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:10.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24ac96c700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f248c004bf0 0x7f248c005010 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f2498000f20 tx=0x7f2498010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f249800c960 con 0x7f248c004bf0 2020-05-18T21:29:10.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24ac96c700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f248c004bf0 0x7f248c005010 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f2498000f20 tx=0x7f2498010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24ac96c700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f248c004bf0 0x7f248c005010 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f2498000f20 tx=0x7f2498010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249800cac0 con 0x7f248c004bf0 2020-05-18T21:29:10.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f249800ce20 con 0x7f248c004bf0 2020-05-18T21:29:10.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24ad96e700 1 -- 172.21.15.63:0/1946054667 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2480003380 con 0x7f248c004bf0 2020-05-18T21:29:10.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24ac96c700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f248c004bf0 0x7f248c005010 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f2498000f20 tx=0x7f2498010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2498010280 con 0x7f248c004bf0 2020-05-18T21:29:10.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.805+0000 7f24ac96c700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f248c004bf0 0x7f248c005010 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f2498000f20 tx=0x7f2498010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.809+0000 7f24a5ffb700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f248c058380 0x7f248c05a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:10.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.809+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2498063710 con 0x7f248c004bf0 2020-05-18T21:29:10.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.809+0000 7f24a7fff700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f248c058380 0x7f248c05a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:10.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.809+0000 7f24a7fff700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f248c058380 0x7f248c05a840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2490007b00 tx=0x7f249000d780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.809+0000 7f24a7fff700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f248c058380 0x7f248c05a840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2490007b00 tx=0x7f249000d780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.809+0000 7f24a7fff700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f248c058380 0x7f248c05a840 secure :-1 s=READY pgs=282 cs=0 l=1 rx=0x7f2490007b00 tx=0x7f249000d780).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:10.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.813+0000 7f24ac96c700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f248c004bf0 0x7f248c005010 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f2498000f20 tx=0x7f2498010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:10.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.813+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f249803db60 con 0x7f248c004bf0 2020-05-18T21:29:10.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:10.969+0000 7f24ad96e700 1 -- 172.21.15.63:0/1946054667 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2480002260 con 0x7f248c004bf0 2020-05-18T21:29:11.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.193+0000 7f24ac96c700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f248c004bf0 0x7f248c005010 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f2498000f20 tx=0x7f2498010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.193+0000 7f24a5ffb700 1 -- 172.21.15.63:0/1946054667 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v27) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2498041180 con 0x7f248c004bf0 2020-05-18T21:29:11.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.197+0000 7f24ad96e700 1 -- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f248c058380 msgr2=0x7f248c05a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.197+0000 7f24ad96e700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f248c058380 0x7f248c05a840 secure :-1 s=READY pgs=282 cs=0 l=1 rx=0x7f2490007b00 tx=0x7f249000d780).stop 2020-05-18T21:29:11.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.197+0000 7f24ad96e700 1 -- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f248c004bf0 msgr2=0x7f248c005010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.197+0000 7f24ad96e700 1 --2- 172.21.15.63:0/1946054667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f248c004bf0 0x7f248c005010 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7f2498000f20 tx=0x7f2498010b30).stop 2020-05-18T21:29:11.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.197+0000 7f24ad16d700 1 -- 172.21.15.63:0/1946054667 reap_dead start 2020-05-18T21:29:11.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.197+0000 7f24ad96e700 1 -- 172.21.15.63:0/1946054667 shutdown_connections 2020-05-18T21:29:11.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.197+0000 7f24ad96e700 1 -- 172.21.15.63:0/1946054667 >> 172.21.15.63:0/1946054667 conn(0x7f24a805fbd0 msgr2=0x7f24a81470b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:11.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.197+0000 7f24ad96e700 1 -- 172.21.15.63:0/1946054667 shutdown_connections 2020-05-18T21:29:11.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.197+0000 7f24ad96e700 1 -- 172.21.15.63:0/1946054667 wait complete. 2020-05-18T21:29:11.217 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.317+0000 7fb28b59e700 1 Processor -- start 2020-05-18T21:29:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.317+0000 7fb28b59e700 1 -- start start 2020-05-18T21:29:11.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.317+0000 7fb28b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 0x7fb28c0b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:11.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.317+0000 7fb28b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb28c14aa70 0x7fb28c0648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:11.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb28b59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb28c14a330 con 0x7fb28c064d20 2020-05-18T21:29:11.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb28b59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb28c14a140 con 0x7fb28c14aa70 2020-05-18T21:29:11.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb28b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c14a5d0 con 0x7fb28c05f110 2020-05-18T21:29:11.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb289d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb28c14aa70 0x7fb28c0648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:11.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb289d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb28c14aa70 0x7fb28c0648c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56226/0 (socket says 172.21.15.63:56226) 2020-05-18T21:29:11.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb289d9b700 1 -- 172.21.15.63:0/402375623 learned_addr learned my addr 172.21.15.63:0/402375623 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:11.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb28a59c700 1 --2- 172.21.15.63:0/402375623 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 0x7fb28c0b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:11.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb289d9b700 1 -- 172.21.15.63:0/402375623 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 msgr2=0x7fb28c0b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:11.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb289d9b700 1 --2- 172.21.15.63:0/402375623 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 0x7fb28c0b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:11.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb289d9b700 1 -- 172.21.15.63:0/402375623 >> v1:172.21.15.155:6789/0 conn(0x7fb28c064d20 legacy=0x7fb28c14d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:11.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb289d9b700 1 -- 172.21.15.63:0/402375623 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c063430 con 0x7fb28c14aa70 2020-05-18T21:29:11.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb28a59c700 1 --2- 172.21.15.63:0/402375623 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 0x7fb28c0b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:29:11.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb289d9b700 1 --2- 172.21.15.63:0/402375623 >> v2:172.21.15.63:3300/0 conn(0x7fb28c14aa70 0x7fb28c0648c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb28c063c70 tx=0x7fb27c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb289d9b700 1 --2- 172.21.15.63:0/402375623 >> v2:172.21.15.63:3300/0 conn(0x7fb28c14aa70 0x7fb28c0648c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb28c063c70 tx=0x7fb27c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb289d9b700 1 --2- 172.21.15.63:0/402375623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb28c14aa70 0x7fb28c0648c0 secure :-1 s=READY pgs=697 cs=0 l=1 rx=0x7fb28c063c70 tx=0x7fb27c008920).ready entity=mon.0 client_cookie=e588428a13739778 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:11.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb289d9b700 1 --2- 172.21.15.63:0/402375623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb28c14aa70 0x7fb28c0648c0 secure :-1 s=THROTTLE_DONE pgs=697 cs=0 l=1 rx=0x7fb28c063c70 tx=0x7fb27c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb289d9b700 1 --2- 172.21.15.63:0/402375623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb28c14aa70 0x7fb28c0648c0 secure :-1 s=THROTTLE_DONE pgs=697 cs=0 l=1 rx=0x7fb28c063c70 tx=0x7fb27c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb289d9b700 1 --2- 172.21.15.63:0/402375623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb28c14aa70 0x7fb28c0648c0 secure :-1 s=THROTTLE_DONE pgs=697 cs=0 l=1 rx=0x7fb28c063c70 tx=0x7fb27c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb28959a700 1 -- 172.21.15.63:0/402375623 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb27c011720 con 0x7fb28c14aa70 2020-05-18T21:29:11.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb28959a700 1 -- 172.21.15.63:0/402375623 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27c011880 con 0x7fb28c14aa70 2020-05-18T21:29:11.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb28959a700 1 -- 172.21.15.63:0/402375623 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb27c011c60 con 0x7fb28c14aa70 2020-05-18T21:29:11.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb28b59e700 1 -- 172.21.15.63:0/402375623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb28c14aa70 msgr2=0x7fb28c0648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb28b59e700 1 --2- 172.21.15.63:0/402375623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb28c14aa70 0x7fb28c0648c0 secure :-1 s=READY pgs=697 cs=0 l=1 rx=0x7fb28c063c70 tx=0x7fb27c008920).stop 2020-05-18T21:29:11.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb28b59e700 1 -- 172.21.15.63:0/402375623 shutdown_connections 2020-05-18T21:29:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb28b59e700 1 --2- 172.21.15.63:0/402375623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb28c14aa70 0x7fb28c0648c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb28b59e700 1 --2- 172.21.15.63:0/402375623 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 0x7fb28c0b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb28b59e700 1 -- 172.21.15.63:0/402375623 >> 172.21.15.63:0/402375623 conn(0x7fb28c069fc0 msgr2=0x7fb28c06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb28b59e700 1 -- 172.21.15.63:0/402375623 shutdown_connections 2020-05-18T21:29:11.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb28b59e700 1 -- 172.21.15.63:0/402375623 wait complete. 2020-05-18T21:29:11.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb28b59e700 1 Processor -- start 2020-05-18T21:29:11.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.321+0000 7fb28b59e700 1 -- start start 2020-05-18T21:29:11.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb28b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 0x7fb28c146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:11.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb28b59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb28c0b7de0 con 0x7fb28c14aa70 2020-05-18T21:29:11.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb28b59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb28c0b8080 con 0x7fb28c064d20 2020-05-18T21:29:11.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb28b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c0b8320 con 0x7fb28c05f110 2020-05-18T21:29:11.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb28ad9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb28c14aa70 0x7fb28c144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58422/0 (socket says 172.21.15.63:58422) 2020-05-18T21:29:11.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb28ad9d700 1 -- 172.21.15.63:0/939466192 learned_addr learned my addr 172.21.15.63:0/939466192 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:11.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb28a59c700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 0x7fb28c146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:11.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb27b7fe700 1 -- 172.21.15.63:0/939466192 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746485696 0 0) 0x7fb28c0b7de0 con 0x7fb28c14aa70 2020-05-18T21:29:11.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb27b7fe700 1 -- 172.21.15.63:0/939466192 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb268002fe0 con 0x7fb28c14aa70 2020-05-18T21:29:11.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb27b7fe700 1 -- 172.21.15.63:0/939466192 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048715823 0 0) 0x7fb28c0b8080 con 0x7fb28c064d20 2020-05-18T21:29:11.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb27b7fe700 1 -- 172.21.15.63:0/939466192 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb28c0b7de0 con 0x7fb28c064d20 2020-05-18T21:29:11.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb27b7fe700 1 -- 172.21.15.63:0/939466192 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2101301522 0 0) 0x7fb268002fe0 con 0x7fb28c14aa70 2020-05-18T21:29:11.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb28a59c700 1 -- 172.21.15.63:0/939466192 >> v1:172.21.15.155:6789/0 conn(0x7fb28c064d20 legacy=0x7fb28c132490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb28a59c700 1 -- 172.21.15.63:0/939466192 >> v1:172.21.15.63:6789/0 conn(0x7fb28c14aa70 legacy=0x7fb28c144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb28a59c700 1 -- 172.21.15.63:0/939466192 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c0b7ad0 con 0x7fb28c05f110 2020-05-18T21:29:11.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb28a59c700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 0x7fb28c146ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb284002df0 tx=0x7fb280010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb28a59c700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 0x7fb28c146ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb284002df0 tx=0x7fb280010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb28a59c700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 0x7fb28c146ee0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7fb284002df0 tx=0x7fb280010a70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:11.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb28a59c700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 0x7fb28c146ee0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fb284002df0 tx=0x7fb280010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb27b7fe700 1 -- 172.21.15.63:0/939466192 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb284002c50 con 0x7fb28c05f110 2020-05-18T21:29:11.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb28a59c700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 0x7fb28c146ee0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fb284002df0 tx=0x7fb280010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb28a59c700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 0x7fb28c146ee0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fb284002df0 tx=0x7fb280010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb27b7fe700 1 -- 172.21.15.63:0/939466192 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb280009d80 con 0x7fb28c05f110 2020-05-18T21:29:11.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb28b59e700 1 -- 172.21.15.63:0/939466192 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28c132ba0 con 0x7fb28c05f110 2020-05-18T21:29:11.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb27b7fe700 1 -- 172.21.15.63:0/939466192 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2800093b0 con 0x7fb28c05f110 2020-05-18T21:29:11.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.325+0000 7fb28b59e700 1 -- 172.21.15.63:0/939466192 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28c0b9000 con 0x7fb28c05f110 2020-05-18T21:29:11.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.329+0000 7fb28a59c700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 0x7fb28c146ee0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fb284002df0 tx=0x7fb280010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.329+0000 7fb28b59e700 1 -- 172.21.15.63:0/939466192 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb28c0569e0 con 0x7fb28c05f110 2020-05-18T21:29:11.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.329+0000 7fb28a59c700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 0x7fb28c146ee0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fb284002df0 tx=0x7fb280010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.329+0000 7fb27b7fe700 1 -- 172.21.15.63:0/939466192 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb2800095f0 con 0x7fb28c05f110 2020-05-18T21:29:11.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.329+0000 7fb27b7fe700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb26804fe80 0x7fb268052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:11.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.329+0000 7fb27b7fe700 1 -- 172.21.15.63:0/939466192 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb280063270 con 0x7fb28c05f110 2020-05-18T21:29:11.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.329+0000 7fb289d9b700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb26804fe80 0x7fb268052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:11.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.329+0000 7fb289d9b700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb26804fe80 0x7fb268052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb27c008500 tx=0x7fb28c0635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.329+0000 7fb289d9b700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb26804fe80 0x7fb268052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb27c008500 tx=0x7fb28c0635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.329+0000 7fb289d9b700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb26804fe80 0x7fb268052340 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7fb27c008500 tx=0x7fb28c0635c0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:11.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.337+0000 7fb28a59c700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 0x7fb28c146ee0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fb284002df0 tx=0x7fb280010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.337+0000 7fb27b7fe700 1 -- 172.21.15.63:0/939466192 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb28003d620 con 0x7fb28c05f110 2020-05-18T21:29:11.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.489+0000 7fb28b59e700 1 -- 172.21.15.63:0/939466192 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb28c0b6960 con 0x7fb28c05f110 2020-05-18T21:29:11.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.493+0000 7fb28a59c700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 0x7fb28c146ee0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fb284002df0 tx=0x7fb280010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.493+0000 7fb27b7fe700 1 -- 172.21.15.63:0/939466192 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2143 (secure 0 0 0) 0x7fb280040c40 con 0x7fb28c05f110 2020-05-18T21:29:11.498 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:11.498 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/3008842702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3008842702},{"type":"v1","addr":"172.21.15.63:6833","nonce":3008842702}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:11.179187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5138":{"gid":5138,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/3117563034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3117563034},{"type":"v1","addr":"172.21.15.155:6835","nonce":3117563034}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:11.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.493+0000 7fb28b59e700 1 -- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb26804fe80 msgr2=0x7fb268052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.493+0000 7fb28b59e700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb26804fe80 0x7fb268052340 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7fb27c008500 tx=0x7fb28c0635c0).stop 2020-05-18T21:29:11.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.493+0000 7fb28b59e700 1 -- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 msgr2=0x7fb28c146ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.493+0000 7fb28b59e700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 0x7fb28c146ee0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7fb284002df0 tx=0x7fb280010a70).stop 2020-05-18T21:29:11.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.493+0000 7fb28b59e700 1 -- 172.21.15.63:0/939466192 shutdown_connections 2020-05-18T21:29:11.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.493+0000 7fb28b59e700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb26804fe80 0x7fb268052340 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:11.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.493+0000 7fb28b59e700 1 --2- 172.21.15.63:0/939466192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb28c05f110 0x7fb28c146ee0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:11.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.493+0000 7fb28b59e700 1 -- 172.21.15.63:0/939466192 >> 172.21.15.63:0/939466192 conn(0x7fb28c069fc0 msgr2=0x7fb28c149650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:11.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.493+0000 7fb28b59e700 1 -- 172.21.15.63:0/939466192 shutdown_connections 2020-05-18T21:29:11.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.493+0000 7fb28b59e700 1 -- 172.21.15.63:0/939466192 wait complete. 2020-05-18T21:29:11.502 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 27 2020-05-18T21:29:11.511 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:29:11.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab7ab43700 1 Processor -- start 2020-05-18T21:29:11.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab7ab43700 1 -- start start 2020-05-18T21:29:11.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab7ab43700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fab74147110 0x7fab7412cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:11.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab7ab43700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fab74063370 0x7fab7412cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:11.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab7ab43700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab74144080 con 0x7fab740b71e0 2020-05-18T21:29:11.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab7ab43700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab74143ea0 con 0x7fab74147110 2020-05-18T21:29:11.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab7ab43700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab7412d3d0 con 0x7fab74063370 2020-05-18T21:29:11.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab79340700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fab74147110 0x7fab7412cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:11.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab79340700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fab74147110 0x7fab7412cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56240/0 (socket says 172.21.15.63:56240) 2020-05-18T21:29:11.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab79340700 1 -- 172.21.15.63:0/1749018589 learned_addr learned my addr 172.21.15.63:0/1749018589 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:11.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab7a342700 1 --2- 172.21.15.63:0/1749018589 >> v2:172.21.15.155:3300/0 conn(0x7fab74063370 0x7fab7412cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:11.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab79340700 1 -- 172.21.15.63:0/1749018589 >> v2:172.21.15.155:3300/0 conn(0x7fab74063370 msgr2=0x7fab7412cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:11.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab79340700 1 --2- 172.21.15.63:0/1749018589 >> v2:172.21.15.155:3300/0 conn(0x7fab74063370 0x7fab7412cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:11.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab79340700 1 -- 172.21.15.63:0/1749018589 >> v1:172.21.15.155:6789/0 conn(0x7fab740b71e0 legacy=0x7fab74144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab79340700 1 -- 172.21.15.63:0/1749018589 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab74143b10 con 0x7fab74147110 2020-05-18T21:29:11.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab79340700 1 --2- 172.21.15.63:0/1749018589 >> v2:172.21.15.63:3300/0 conn(0x7fab74147110 0x7fab7412cb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fab740648c0 tx=0x7fab68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab79340700 1 --2- 172.21.15.63:0/1749018589 >> v2:172.21.15.63:3300/0 conn(0x7fab74147110 0x7fab7412cb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fab740648c0 tx=0x7fab68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab79340700 1 --2- 172.21.15.63:0/1749018589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab74147110 0x7fab7412cb10 secure :-1 s=READY pgs=699 cs=0 l=1 rx=0x7fab740648c0 tx=0x7fab68007e00).ready entity=mon.0 client_cookie=acadf3a36df7d614 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:11.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab79340700 1 --2- 172.21.15.63:0/1749018589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab74147110 0x7fab7412cb10 secure :-1 s=THROTTLE_DONE pgs=699 cs=0 l=1 rx=0x7fab740648c0 tx=0x7fab68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab78b3f700 1 -- 172.21.15.63:0/1749018589 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab68011d80 con 0x7fab74147110 2020-05-18T21:29:11.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.605+0000 7fab79340700 1 --2- 172.21.15.63:0/1749018589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab74147110 0x7fab7412cb10 secure :-1 s=THROTTLE_DONE pgs=699 cs=0 l=1 rx=0x7fab740648c0 tx=0x7fab68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab78b3f700 1 -- 172.21.15.63:0/1749018589 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6800a180 con 0x7fab74147110 2020-05-18T21:29:11.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab79340700 1 --2- 172.21.15.63:0/1749018589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab74147110 0x7fab7412cb10 secure :-1 s=THROTTLE_DONE pgs=699 cs=0 l=1 rx=0x7fab740648c0 tx=0x7fab68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab7ab43700 1 -- 172.21.15.63:0/1749018589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab74147110 msgr2=0x7fab7412cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab78b3f700 1 -- 172.21.15.63:0/1749018589 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab6800a5a0 con 0x7fab74147110 2020-05-18T21:29:11.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab7ab43700 1 --2- 172.21.15.63:0/1749018589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab74147110 0x7fab7412cb10 secure :-1 s=READY pgs=699 cs=0 l=1 rx=0x7fab740648c0 tx=0x7fab68007e00).stop 2020-05-18T21:29:11.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab7ab43700 1 -- 172.21.15.63:0/1749018589 shutdown_connections 2020-05-18T21:29:11.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab7ab43700 1 --2- 172.21.15.63:0/1749018589 >> v2:172.21.15.155:3300/0 conn(0x7fab74063370 0x7fab7412cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:11.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab7ab43700 1 --2- 172.21.15.63:0/1749018589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab74147110 0x7fab7412cb10 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:11.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab7ab43700 1 -- 172.21.15.63:0/1749018589 >> 172.21.15.63:0/1749018589 conn(0x7fab7405eee0 msgr2=0x7fab7405f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:11.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab7ab43700 1 -- 172.21.15.63:0/1749018589 shutdown_connections 2020-05-18T21:29:11.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab7ab43700 1 -- 172.21.15.63:0/1749018589 wait complete. 2020-05-18T21:29:11.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab7ab43700 1 Processor -- start 2020-05-18T21:29:11.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab7ab43700 1 -- start start 2020-05-18T21:29:11.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab7ab43700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fab74063370 0x7fab740ba340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:11.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab7ab43700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b71e0 0x7fab740b6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:11.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab7ab43700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab7411f290 con 0x7fab74147110 2020-05-18T21:29:11.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab7ab43700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab740b8a80 con 0x7fab74063370 2020-05-18T21:29:11.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab7ab43700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab740b6ac0 con 0x7fab740b71e0 2020-05-18T21:29:11.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab79340700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b71e0 0x7fab740b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:11.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab79340700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b71e0 0x7fab740b6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:46948/0 (socket says 172.21.15.63:46948) 2020-05-18T21:29:11.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab79340700 1 -- 172.21.15.63:0/4150689610 learned_addr learned my addr 172.21.15.63:0/4150689610 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:11.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.609+0000 7fab79b41700 1 --2- 172.21.15.63:0/4150689610 >> v2:172.21.15.155:3300/0 conn(0x7fab74063370 0x7fab740ba340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:11.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab66ffd700 1 -- 172.21.15.63:0/4150689610 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335697335 0 0) 0x7fab7411f290 con 0x7fab74147110 2020-05-18T21:29:11.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab66ffd700 1 -- 172.21.15.63:0/4150689610 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab54002fe0 con 0x7fab74147110 2020-05-18T21:29:11.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab79340700 1 -- 172.21.15.63:0/4150689610 >> v2:172.21.15.155:3300/0 conn(0x7fab74063370 msgr2=0x7fab740ba340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab79340700 1 --2- 172.21.15.63:0/4150689610 >> v2:172.21.15.155:3300/0 conn(0x7fab74063370 0x7fab740ba340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:11.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab79340700 1 -- 172.21.15.63:0/4150689610 >> v1:172.21.15.155:6789/0 conn(0x7fab74147110 legacy=0x7fab740b8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab79340700 1 -- 172.21.15.63:0/4150689610 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab740ba900 con 0x7fab740b71e0 2020-05-18T21:29:11.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab79340700 1 --2- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b71e0 0x7fab740b6660 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab740648c0 tx=0x7fab68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab79340700 1 --2- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b71e0 0x7fab740b6660 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab740648c0 tx=0x7fab68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab79340700 1 --2- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b71e0 0x7fab740b6660 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7fab740648c0 tx=0x7fab68007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:11.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab79340700 1 --2- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b71e0 0x7fab740b6660 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fab740648c0 tx=0x7fab68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab66ffd700 1 -- 172.21.15.63:0/4150689610 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab68005a80 con 0x7fab740b71e0 2020-05-18T21:29:11.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab79340700 1 --2- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b71e0 0x7fab740b6660 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fab740648c0 tx=0x7fab68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab66ffd700 1 -- 172.21.15.63:0/4150689610 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab68005be0 con 0x7fab740b71e0 2020-05-18T21:29:11.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab7ab43700 1 -- 172.21.15.63:0/4150689610 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7411f4c0 con 0x7fab740b71e0 2020-05-18T21:29:11.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab79340700 1 --2- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b71e0 0x7fab740b6660 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fab740648c0 tx=0x7fab68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab66ffd700 1 -- 172.21.15.63:0/4150689610 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab68007170 con 0x7fab740b71e0 2020-05-18T21:29:11.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab7ab43700 1 -- 172.21.15.63:0/4150689610 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab74121410 con 0x7fab740b71e0 2020-05-18T21:29:11.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab79340700 1 --2- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b71e0 0x7fab740b6660 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fab740648c0 tx=0x7fab68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab7ab43700 1 -- 172.21.15.63:0/4150689610 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab740569e0 con 0x7fab740b71e0 2020-05-18T21:29:11.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab79340700 1 --2- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b71e0 0x7fab740b6660 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fab740648c0 tx=0x7fab68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab66ffd700 1 -- 172.21.15.63:0/4150689610 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fab68007430 con 0x7fab740b71e0 2020-05-18T21:29:11.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab66ffd700 1 --2- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab5404fd10 0x7fab540521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:11.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab66ffd700 1 -- 172.21.15.63:0/4150689610 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fab680649e0 con 0x7fab740b71e0 2020-05-18T21:29:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.613+0000 7fab79b41700 1 --2- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab5404fd10 0x7fab540521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.617+0000 7fab79b41700 1 --2- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab5404fd10 0x7fab540521d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab74063d60 tx=0x7fab74066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.617+0000 7fab79b41700 1 --2- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab5404fd10 0x7fab540521d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab74063d60 tx=0x7fab74066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.617+0000 7fab79b41700 1 --2- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab5404fd10 0x7fab540521d0 secure :-1 s=READY pgs=284 cs=0 l=1 rx=0x7fab74063d60 tx=0x7fab74066620).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:11.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.625+0000 7fab79340700 1 --2- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b71e0 0x7fab740b6660 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fab740648c0 tx=0x7fab68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.625+0000 7fab66ffd700 1 -- 172.21.15.63:0/4150689610 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fab6803ed90 con 0x7fab740b71e0 2020-05-18T21:29:11.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.741+0000 7fab7ab43700 1 -- 172.21.15.63:0/4150689610 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab74147f90 con 0x7fab740b71e0 2020-05-18T21:29:11.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.741+0000 7fab79340700 1 --2- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b71e0 0x7fab740b6660 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fab740648c0 tx=0x7fab68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.741+0000 7fab66ffd700 1 -- 172.21.15.63:0/4150689610 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16092 (secure 0 0 0) 0x7fab680423b0 con 0x7fab740b71e0 2020-05-18T21:29:11.749 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:11.750 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":61,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:29:11.178136+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:29:08.544924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2020-05-18T21:29:09.178610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:29:11.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.745+0000 7fab7ab43700 1 -- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab5404fd10 msgr2=0x7fab540521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.745+0000 7fab7ab43700 1 --2- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab5404fd10 0x7fab540521d0 secure :-1 s=READY pgs=284 cs=0 l=1 rx=0x7fab74063d60 tx=0x7fab74066620).stop 2020-05-18T21:29:11.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.745+0000 7fab7ab43700 1 -- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b71e0 msgr2=0x7fab740b6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.745+0000 7fab7ab43700 1 --2- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b71e0 0x7fab740b6660 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7fab740648c0 tx=0x7fab68007e00).stop 2020-05-18T21:29:11.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.745+0000 7fab7ab43700 1 -- 172.21.15.63:0/4150689610 shutdown_connections 2020-05-18T21:29:11.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.745+0000 7fab7ab43700 1 --2- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab5404fd10 0x7fab540521d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:11.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.745+0000 7fab7ab43700 1 --2- 172.21.15.63:0/4150689610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b71e0 0x7fab740b6660 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:11.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.745+0000 7fab7ab43700 1 --2- 172.21.15.63:0/4150689610 >> v2:172.21.15.155:3300/0 conn(0x7fab74063370 0x7fab740ba340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:11.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.745+0000 7fab7ab43700 1 -- 172.21.15.63:0/4150689610 >> 172.21.15.63:0/4150689610 conn(0x7fab7405eee0 msgr2=0x7fab7405f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:11.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.745+0000 7fab7ab43700 1 -- 172.21.15.63:0/4150689610 shutdown_connections 2020-05-18T21:29:11.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.745+0000 7fab7ab43700 1 -- 172.21.15.63:0/4150689610 wait complete. 2020-05-18T21:29:11.762 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:29:11.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.865+0000 7fc44d2e0700 1 Processor -- start 2020-05-18T21:29:11.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.865+0000 7fc44d2e0700 1 -- start start 2020-05-18T21:29:11.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc44d2e0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc4480b6410 0x7fc4480b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:11.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc44d2e0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4480b5cb0 0x7fc448061af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:11.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc44d2e0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc448025500 con 0x7fc448151bc0 2020-05-18T21:29:11.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc44d2e0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc448064ee0 con 0x7fc4480b6410 2020-05-18T21:29:11.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc44d2e0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4480b67f0 con 0x7fc4480b5cb0 2020-05-18T21:29:11.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc44e542700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc448151bc0 0x7fc448152030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58444/0 (socket says 172.21.15.63:58444) 2020-05-18T21:29:11.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc44e542700 1 -- 172.21.15.63:0/2754246869 learned_addr learned my addr 172.21.15.63:0/2754246869 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:11.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc447fff700 1 --2- 172.21.15.63:0/2754246869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4480b5cb0 0x7fc448061af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:11.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc44cadf700 1 --2- 172.21.15.63:0/2754246869 >> v2:172.21.15.155:3300/0 conn(0x7fc4480b6410 0x7fc4480b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:11.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc4477fe700 1 -- 172.21.15.63:0/2754246869 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302750582 0 0) 0x7fc448025500 con 0x7fc448151bc0 2020-05-18T21:29:11.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc4477fe700 1 -- 172.21.15.63:0/2754246869 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc430003270 con 0x7fc448151bc0 2020-05-18T21:29:11.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc4477fe700 1 -- 172.21.15.63:0/2754246869 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2152534466 0 0) 0x7fc430003270 con 0x7fc448151bc0 2020-05-18T21:29:11.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc447fff700 1 -- 172.21.15.63:0/2754246869 >> v2:172.21.15.155:3300/0 conn(0x7fc4480b6410 msgr2=0x7fc4480b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:11.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc447fff700 1 --2- 172.21.15.63:0/2754246869 >> v2:172.21.15.155:3300/0 conn(0x7fc4480b6410 0x7fc4480b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:11.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc447fff700 1 -- 172.21.15.63:0/2754246869 >> v1:172.21.15.63:6789/0 conn(0x7fc448151bc0 legacy=0x7fc448152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc447fff700 1 -- 172.21.15.63:0/2754246869 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc448025180 con 0x7fc4480b5cb0 2020-05-18T21:29:11.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc447fff700 1 --2- 172.21.15.63:0/2754246869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4480b5cb0 0x7fc448061af0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc440001c30 tx=0x7fc43c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc447fff700 1 --2- 172.21.15.63:0/2754246869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4480b5cb0 0x7fc448061af0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc440001c30 tx=0x7fc43c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc447fff700 1 --2- 172.21.15.63:0/2754246869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4480b5cb0 0x7fc448061af0 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7fc440001c30 tx=0x7fc43c007a80).ready entity=mon.2 client_cookie=4913a8df2f1a3f04 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:11.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc447fff700 1 --2- 172.21.15.63:0/2754246869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4480b5cb0 0x7fc448061af0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7fc440001c30 tx=0x7fc43c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc4477fe700 1 -- 172.21.15.63:0/2754246869 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc440001a90 con 0x7fc4480b5cb0 2020-05-18T21:29:11.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc447fff700 1 --2- 172.21.15.63:0/2754246869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4480b5cb0 0x7fc448061af0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7fc440001c30 tx=0x7fc43c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc447fff700 1 --2- 172.21.15.63:0/2754246869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4480b5cb0 0x7fc448061af0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7fc440001c30 tx=0x7fc43c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc4477fe700 1 -- 172.21.15.63:0/2754246869 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43c008e40 con 0x7fc4480b5cb0 2020-05-18T21:29:11.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc4477fe700 1 -- 172.21.15.63:0/2754246869 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc43c011440 con 0x7fc4480b5cb0 2020-05-18T21:29:11.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc44d2e0700 1 -- 172.21.15.63:0/2754246869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4480b5cb0 msgr2=0x7fc448061af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.869+0000 7fc44d2e0700 1 --2- 172.21.15.63:0/2754246869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4480b5cb0 0x7fc448061af0 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7fc440001c30 tx=0x7fc43c007a80).stop 2020-05-18T21:29:11.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc44d2e0700 1 -- 172.21.15.63:0/2754246869 shutdown_connections 2020-05-18T21:29:11.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc44d2e0700 1 --2- 172.21.15.63:0/2754246869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4480b5cb0 0x7fc448061af0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:11.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc44d2e0700 1 --2- 172.21.15.63:0/2754246869 >> v2:172.21.15.155:3300/0 conn(0x7fc4480b6410 0x7fc4480b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:11.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc44d2e0700 1 -- 172.21.15.63:0/2754246869 >> 172.21.15.63:0/2754246869 conn(0x7fc448069b70 msgr2=0x7fc448069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:11.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc44d2e0700 1 -- 172.21.15.63:0/2754246869 shutdown_connections 2020-05-18T21:29:11.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc44d2e0700 1 -- 172.21.15.63:0/2754246869 wait complete. 2020-05-18T21:29:11.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc44d2e0700 1 Processor -- start 2020-05-18T21:29:11.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc44d2e0700 1 -- start start 2020-05-18T21:29:11.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc44d2e0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc4480b5cb0 0x7fc448129830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:11.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc44d2e0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc448151bc0 0x7fc4481248d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:11.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc44d2e0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4480b7ff0 con 0x7fc4480b6410 2020-05-18T21:29:11.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc44d2e0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4480b8290 con 0x7fc4480b5cb0 2020-05-18T21:29:11.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc44d2e0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4480b8530 con 0x7fc448151bc0 2020-05-18T21:29:11.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc447fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc4480b6410 0x7fc448128cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58446/0 (socket says 172.21.15.63:58446) 2020-05-18T21:29:11.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc447fff700 1 -- 172.21.15.63:0/2886638567 learned_addr learned my addr 172.21.15.63:0/2886638567 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:11.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc44cadf700 1 --2- 172.21.15.63:0/2886638567 >> v2:172.21.15.155:3300/0 conn(0x7fc4480b5cb0 0x7fc448129830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:11.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc44e542700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc448151bc0 0x7fc4481248d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:11.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc4457fa700 1 -- 172.21.15.63:0/2886638567 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4007905909 0 0) 0x7fc4480b7ff0 con 0x7fc4480b6410 2020-05-18T21:29:11.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc4457fa700 1 -- 172.21.15.63:0/2886638567 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc428003270 con 0x7fc4480b6410 2020-05-18T21:29:11.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc4457fa700 1 -- 172.21.15.63:0/2886638567 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1853704248 0 0) 0x7fc428003270 con 0x7fc4480b6410 2020-05-18T21:29:11.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc4457fa700 1 -- 172.21.15.63:0/2886638567 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc4480b7ff0 con 0x7fc4480b6410 2020-05-18T21:29:11.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc4457fa700 1 -- 172.21.15.63:0/2886638567 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fc43c008620 con 0x7fc4480b6410 2020-05-18T21:29:11.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc4457fa700 1 -- 172.21.15.63:0/2886638567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc448151bc0 msgr2=0x7fc4481248d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc4457fa700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc448151bc0 0x7fc4481248d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:11.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc4457fa700 1 -- 172.21.15.63:0/2886638567 >> v2:172.21.15.155:3300/0 conn(0x7fc4480b5cb0 msgr2=0x7fc448129830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc4457fa700 1 --2- 172.21.15.63:0/2886638567 >> v2:172.21.15.155:3300/0 conn(0x7fc4480b5cb0 0x7fc448129830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:11.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc4457fa700 1 -- 172.21.15.63:0/2886638567 >> v1:172.21.15.63:6789/0 conn(0x7fc4480b6410 legacy=0x7fc448128cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc4457fa700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc428003830 0x7fc428003c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:11.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc4457fa700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc428004510 0x7fc428004990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:11.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc4457fa700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc428004df0 0x7fc42800b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:11.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc4457fa700 1 -- 172.21.15.63:0/2886638567 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4480b8290 con 0x7fc428003830 2020-05-18T21:29:11.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc4457fa700 1 -- 172.21.15.63:0/2886638567 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4480b8530 con 0x7fc428004510 2020-05-18T21:29:11.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc4457fa700 1 -- 172.21.15.63:0/2886638567 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4280053a0 con 0x7fc428004df0 2020-05-18T21:29:11.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.873+0000 7fc44cadf700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc428003830 0x7fc428003c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:11.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc44e542700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc428004df0 0x7fc42800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:11.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc447fff700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc428004510 0x7fc428004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:11.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc44cadf700 1 -- 172.21.15.63:0/2886638567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc428004df0 msgr2=0x7fc42800b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc44cadf700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc428004df0 0x7fc42800b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:11.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc44cadf700 1 -- 172.21.15.63:0/2886638567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc428004510 msgr2=0x7fc428004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:11.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc44cadf700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc428004510 0x7fc428004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:11.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc44cadf700 1 -- 172.21.15.63:0/2886638567 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4480b89d0 con 0x7fc428003830 2020-05-18T21:29:11.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc44d2e0700 1 -- 172.21.15.63:0/2886638567 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4481293c0 con 0x7fc428003830 2020-05-18T21:29:11.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc44cadf700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc428003830 0x7fc428003c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc4280054e0 tx=0x7fc438010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc44d2e0700 1 -- 172.21.15.63:0/2886638567 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4480b7b30 con 0x7fc428003830 2020-05-18T21:29:11.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc44cadf700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc428003830 0x7fc428003c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc4280054e0 tx=0x7fc438010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc44cadf700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc428003830 0x7fc428003c50 secure :-1 s=READY pgs=702 cs=0 l=1 rx=0x7fc4280054e0 tx=0x7fc438010ff0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:11.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc44cadf700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc428003830 0x7fc428003c50 secure :-1 s=THROTTLE_DONE pgs=702 cs=0 l=1 rx=0x7fc4280054e0 tx=0x7fc438010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc4457fa700 1 -- 172.21.15.63:0/2886638567 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc438007400 con 0x7fc428003830 2020-05-18T21:29:11.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc44cadf700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc428003830 0x7fc428003c50 secure :-1 s=THROTTLE_DONE pgs=702 cs=0 l=1 rx=0x7fc4280054e0 tx=0x7fc438010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc4457fa700 1 -- 172.21.15.63:0/2886638567 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc438007560 con 0x7fc428003830 2020-05-18T21:29:11.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc44cadf700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc428003830 0x7fc428003c50 secure :-1 s=THROTTLE_DONE pgs=702 cs=0 l=1 rx=0x7fc4280054e0 tx=0x7fc438010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc4457fa700 1 -- 172.21.15.63:0/2886638567 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc438011b00 con 0x7fc428003830 2020-05-18T21:29:11.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc44d2e0700 1 -- 172.21.15.63:0/2886638567 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc420003380 con 0x7fc428003830 2020-05-18T21:29:11.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.877+0000 7fc44cadf700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc428003830 0x7fc428003c50 secure :-1 s=THROTTLE_DONE pgs=702 cs=0 l=1 rx=0x7fc4280054e0 tx=0x7fc438010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.881+0000 7fc4457fa700 1 -- 172.21.15.63:0/2886638567 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc438011c60 con 0x7fc428003830 2020-05-18T21:29:11.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.881+0000 7fc44cadf700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc428003830 0x7fc428003c50 secure :-1 s=THROTTLE_DONE pgs=702 cs=0 l=1 rx=0x7fc4280054e0 tx=0x7fc438010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.881+0000 7fc4457fa700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc428058130 0x7fc42805a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:11.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.881+0000 7fc4457fa700 1 -- 172.21.15.63:0/2886638567 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc438063ae0 con 0x7fc428003830 2020-05-18T21:29:11.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.881+0000 7fc447fff700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc428058130 0x7fc42805a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:11.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.881+0000 7fc447fff700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc428058130 0x7fc42805a5f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc43c007ae0 tx=0x7fc43c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.881+0000 7fc447fff700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc428058130 0x7fc42805a5f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc43c007ae0 tx=0x7fc43c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.881+0000 7fc447fff700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc428058130 0x7fc42805a5f0 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7fc43c007ae0 tx=0x7fc43c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:11.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.889+0000 7fc44cadf700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc428003830 0x7fc428003c50 secure :-1 s=THROTTLE_DONE pgs=702 cs=0 l=1 rx=0x7fc4280054e0 tx=0x7fc438010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:11.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:11.889+0000 7fc4457fa700 1 -- 172.21.15.63:0/2886638567 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc43803ded0 con 0x7fc428003830 2020-05-18T21:29:12.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.037+0000 7fc44d2e0700 1 -- 172.21.15.63:0/2886638567 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fc4200022c0 con 0x7fc428003830 2020-05-18T21:29:12.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.041+0000 7fc44cadf700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc428003830 0x7fc428003c50 secure :-1 s=THROTTLE_DONE pgs=702 cs=0 l=1 rx=0x7fc4280054e0 tx=0x7fc438010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.041+0000 7fc4457fa700 1 -- 172.21.15.63:0/2886638567 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v23) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc4380414f0 con 0x7fc428003830 2020-05-18T21:29:12.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.045+0000 7fc44d2e0700 1 -- 172.21.15.63:0/2886638567 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc428058130 msgr2=0x7fc42805a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.045+0000 7fc44d2e0700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc428058130 0x7fc42805a5f0 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7fc43c007ae0 tx=0x7fc43c007a80).stop 2020-05-18T21:29:12.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.045+0000 7fc44d2e0700 1 -- 172.21.15.63:0/2886638567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc428003830 msgr2=0x7fc428003c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.045+0000 7fc44d2e0700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc428003830 0x7fc428003c50 secure :-1 s=READY pgs=702 cs=0 l=1 rx=0x7fc4280054e0 tx=0x7fc438010ff0).stop 2020-05-18T21:29:12.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.045+0000 7fc44e542700 1 -- 172.21.15.63:0/2886638567 reap_dead start 2020-05-18T21:29:12.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.045+0000 7fc44d2e0700 1 -- 172.21.15.63:0/2886638567 shutdown_connections 2020-05-18T21:29:12.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.045+0000 7fc44d2e0700 1 --2- 172.21.15.63:0/2886638567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc428003830 0x7fc428003c50 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:12.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.045+0000 7fc44d2e0700 1 -- 172.21.15.63:0/2886638567 >> 172.21.15.63:0/2886638567 conn(0x7fc448069b70 msgr2=0x7fc448151150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:12.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.045+0000 7fc44d2e0700 1 -- 172.21.15.63:0/2886638567 shutdown_connections 2020-05-18T21:29:12.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.045+0000 7fc44d2e0700 1 -- 172.21.15.63:0/2886638567 wait complete. 2020-05-18T21:29:12.053 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.0 2020-05-18T21:29:12.066 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:29:12.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.177+0000 7fa611278700 1 Processor -- start 2020-05-18T21:29:12.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.177+0000 7fa611278700 1 -- start start 2020-05-18T21:29:12.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa611278700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa60c0b6410 0x7fa60c0b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:12.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa611278700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa60c0b5cb0 0x7fa60c061af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:12.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa611278700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60c025500 con 0x7fa60c151bc0 2020-05-18T21:29:12.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa611278700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c064ee0 con 0x7fa60c0b6410 2020-05-18T21:29:12.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa611278700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c0b67f0 con 0x7fa60c0b5cb0 2020-05-18T21:29:12.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa610a77700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa60c0b6410 0x7fa60c0b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:12.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa610a77700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa60c0b6410 0x7fa60c0b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56272/0 (socket says 172.21.15.63:56272) 2020-05-18T21:29:12.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa610a77700 1 -- 172.21.15.63:0/4215997191 learned_addr learned my addr 172.21.15.63:0/4215997191 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:12.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa60bfff700 1 --2- 172.21.15.63:0/4215997191 >> v2:172.21.15.155:3300/0 conn(0x7fa60c0b5cb0 0x7fa60c061af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:12.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa610a77700 1 -- 172.21.15.63:0/4215997191 >> v2:172.21.15.155:3300/0 conn(0x7fa60c0b5cb0 msgr2=0x7fa60c061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:12.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa610a77700 1 --2- 172.21.15.63:0/4215997191 >> v2:172.21.15.155:3300/0 conn(0x7fa60c0b5cb0 0x7fa60c061af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:12.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa610a77700 1 -- 172.21.15.63:0/4215997191 >> v1:172.21.15.63:6789/0 conn(0x7fa60c151bc0 legacy=0x7fa60c152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa60b7fe700 1 -- 172.21.15.63:0/4215997191 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4132719174 0 0) 0x7fa60c025500 con 0x7fa60c151bc0 2020-05-18T21:29:12.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa610a77700 1 -- 172.21.15.63:0/4215997191 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c025180 con 0x7fa60c0b6410 2020-05-18T21:29:12.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa610a77700 1 --2- 172.21.15.63:0/4215997191 >> v2:172.21.15.63:3300/0 conn(0x7fa60c0b6410 0x7fa60c0b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa5f4002f70 tx=0x7fa5f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa610a77700 1 --2- 172.21.15.63:0/4215997191 >> v2:172.21.15.63:3300/0 conn(0x7fa60c0b6410 0x7fa60c0b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa5f4002f70 tx=0x7fa5f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa610a77700 1 --2- 172.21.15.63:0/4215997191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa60c0b6410 0x7fa60c0b6cd0 secure :-1 s=READY pgs=704 cs=0 l=1 rx=0x7fa5f4002f70 tx=0x7fa5f4007a80).ready entity=mon.0 client_cookie=bf90921dda92685c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:12.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa610a77700 1 --2- 172.21.15.63:0/4215997191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa60c0b6410 0x7fa60c0b6cd0 secure :-1 s=THROTTLE_DONE pgs=704 cs=0 l=1 rx=0x7fa5f4002f70 tx=0x7fa5f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa610a77700 1 --2- 172.21.15.63:0/4215997191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa60c0b6410 0x7fa60c0b6cd0 secure :-1 s=THROTTLE_DONE pgs=704 cs=0 l=1 rx=0x7fa5f4002f70 tx=0x7fa5f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa60b7fe700 1 -- 172.21.15.63:0/4215997191 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f40116b0 con 0x7fa60c0b6410 2020-05-18T21:29:12.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa610a77700 1 --2- 172.21.15.63:0/4215997191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa60c0b6410 0x7fa60c0b6cd0 secure :-1 s=THROTTLE_DONE pgs=704 cs=0 l=1 rx=0x7fa5f4002f70 tx=0x7fa5f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa60b7fe700 1 -- 172.21.15.63:0/4215997191 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f4011810 con 0x7fa60c0b6410 2020-05-18T21:29:12.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa60b7fe700 1 -- 172.21.15.63:0/4215997191 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f4011bf0 con 0x7fa60c0b6410 2020-05-18T21:29:12.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa611278700 1 -- 172.21.15.63:0/4215997191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa60c0b6410 msgr2=0x7fa60c0b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa611278700 1 --2- 172.21.15.63:0/4215997191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa60c0b6410 0x7fa60c0b6cd0 secure :-1 s=READY pgs=704 cs=0 l=1 rx=0x7fa5f4002f70 tx=0x7fa5f4007a80).stop 2020-05-18T21:29:12.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa611278700 1 -- 172.21.15.63:0/4215997191 shutdown_connections 2020-05-18T21:29:12.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa611278700 1 --2- 172.21.15.63:0/4215997191 >> v2:172.21.15.155:3300/0 conn(0x7fa60c0b5cb0 0x7fa60c061af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:12.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa611278700 1 --2- 172.21.15.63:0/4215997191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa60c0b6410 0x7fa60c0b6cd0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:12.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa611278700 1 -- 172.21.15.63:0/4215997191 >> 172.21.15.63:0/4215997191 conn(0x7fa60c069b70 msgr2=0x7fa60c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:12.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa611278700 1 -- 172.21.15.63:0/4215997191 shutdown_connections 2020-05-18T21:29:12.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.181+0000 7fa611278700 1 -- 172.21.15.63:0/4215997191 wait complete. 2020-05-18T21:29:12.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa611278700 1 Processor -- start 2020-05-18T21:29:12.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa611278700 1 -- start start 2020-05-18T21:29:12.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa611278700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa60c0b5cb0 0x7fa60c0b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:12.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa611278700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa60c151bc0 0x7fa60c061e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:12.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa611278700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60c062290 con 0x7fa60c0b6410 2020-05-18T21:29:12.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa611278700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c0b2c70 con 0x7fa60c151bc0 2020-05-18T21:29:12.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa611278700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0b2f10 con 0x7fa60c0b5cb0 2020-05-18T21:29:12.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa60bfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa60c0b6410 0x7fa60c07fd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58466/0 (socket says 172.21.15.63:58466) 2020-05-18T21:29:12.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa60bfff700 1 -- 172.21.15.63:0/3069144307 learned_addr learned my addr 172.21.15.63:0/3069144307 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:12.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa6124da700 1 --2- 172.21.15.63:0/3069144307 >> v2:172.21.15.155:3300/0 conn(0x7fa60c151bc0 0x7fa60c061e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:12.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa610a77700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa60c0b5cb0 0x7fa60c0b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:12.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa6097fa700 1 -- 172.21.15.63:0/3069144307 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967417681 0 0) 0x7fa60c062290 con 0x7fa60c0b6410 2020-05-18T21:29:12.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa6097fa700 1 -- 172.21.15.63:0/3069144307 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5f0003270 con 0x7fa60c0b6410 2020-05-18T21:29:12.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa6097fa700 1 -- 172.21.15.63:0/3069144307 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2113477720 0 0) 0x7fa5f0003270 con 0x7fa60c0b6410 2020-05-18T21:29:12.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa6097fa700 1 -- 172.21.15.63:0/3069144307 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa60c062290 con 0x7fa60c0b6410 2020-05-18T21:29:12.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa6097fa700 1 -- 172.21.15.63:0/3069144307 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fa5fc0014d0 con 0x7fa60c0b6410 2020-05-18T21:29:12.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa6097fa700 1 -- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa60c0b5cb0 msgr2=0x7fa60c0b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa6097fa700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa60c0b5cb0 0x7fa60c0b3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:12.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa6097fa700 1 -- 172.21.15.63:0/3069144307 >> v2:172.21.15.155:3300/0 conn(0x7fa60c151bc0 msgr2=0x7fa60c061e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa6097fa700 1 --2- 172.21.15.63:0/3069144307 >> v2:172.21.15.155:3300/0 conn(0x7fa60c151bc0 0x7fa60c061e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:12.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa6097fa700 1 -- 172.21.15.63:0/3069144307 >> v1:172.21.15.63:6789/0 conn(0x7fa60c0b6410 legacy=0x7fa60c07fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa6097fa700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5f0003830 0x7fa5f0003c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:12.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa6097fa700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5f0004510 0x7fa5f0004990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:12.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa6097fa700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5f0004df0 0x7fa5f000b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:12.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa6097fa700 1 -- 172.21.15.63:0/3069144307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0b2c70 con 0x7fa5f0004510 2020-05-18T21:29:12.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa6097fa700 1 -- 172.21.15.63:0/3069144307 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0b2f10 con 0x7fa5f0003830 2020-05-18T21:29:12.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa6097fa700 1 -- 172.21.15.63:0/3069144307 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00053e0 con 0x7fa5f0004df0 2020-05-18T21:29:12.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa6124da700 1 --2- 172.21.15.63:0/3069144307 >> v2:172.21.15.155:3300/0 conn(0x7fa60c151bc0 0x7fa60c061e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:29:12.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.185+0000 7fa610a77700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa60c0b5cb0 0x7fa60c0b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:29:12.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa60bfff700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5f0004510 0x7fa5f0004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:12.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa610a77700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5f0003830 0x7fa5f0003c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:12.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa6124da700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5f0004df0 0x7fa5f000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:12.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa610a77700 1 -- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5f0004df0 msgr2=0x7fa5f000b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa610a77700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5f0004df0 0x7fa5f000b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:12.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa610a77700 1 -- 172.21.15.63:0/3069144307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5f0004510 msgr2=0x7fa5f0004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa610a77700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5f0004510 0x7fa5f0004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:12.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa610a77700 1 -- 172.21.15.63:0/3069144307 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c0b3d90 con 0x7fa5f0003830 2020-05-18T21:29:12.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa6124da700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5f0004df0 0x7fa5f000b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:29:12.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa611278700 1 -- 172.21.15.63:0/3069144307 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60c0b3650 con 0x7fa5f0003830 2020-05-18T21:29:12.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa610a77700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5f0003830 0x7fa5f0003c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa5f4002f70 tx=0x7fa5f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa60bfff700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5f0004510 0x7fa5f0004990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:29:12.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa611278700 1 -- 172.21.15.63:0/3069144307 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60c126ac0 con 0x7fa5f0003830 2020-05-18T21:29:12.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa610a77700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5f0003830 0x7fa5f0003c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa5f4002f70 tx=0x7fa5f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa610a77700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5f0003830 0x7fa5f0003c50 secure :-1 s=READY pgs=505 cs=0 l=1 rx=0x7fa5f4002f70 tx=0x7fa5f4007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:12.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa610a77700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5f0003830 0x7fa5f0003c50 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7fa5f4002f70 tx=0x7fa5f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa6097fa700 1 -- 172.21.15.63:0/3069144307 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f4011c40 con 0x7fa5f0003830 2020-05-18T21:29:12.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa610a77700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5f0003830 0x7fa5f0003c50 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7fa5f4002f70 tx=0x7fa5f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa6097fa700 1 -- 172.21.15.63:0/3069144307 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f4007360 con 0x7fa5f0003830 2020-05-18T21:29:12.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa610a77700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5f0003830 0x7fa5f0003c50 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7fa5f4002f70 tx=0x7fa5f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa6097fa700 1 -- 172.21.15.63:0/3069144307 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f4005700 con 0x7fa5f0003830 2020-05-18T21:29:12.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa610a77700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5f0003830 0x7fa5f0003c50 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7fa5f4002f70 tx=0x7fa5f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa611278700 1 -- 172.21.15.63:0/3069144307 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e4003380 con 0x7fa5f0003830 2020-05-18T21:29:12.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa6097fa700 1 -- 172.21.15.63:0/3069144307 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa5f4005860 con 0x7fa5f0003830 2020-05-18T21:29:12.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa610a77700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5f0003830 0x7fa5f0003c50 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7fa5f4002f70 tx=0x7fa5f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.189+0000 7fa6097fa700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa5f0058100 0x7fa5f005a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:12.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.193+0000 7fa6097fa700 1 -- 172.21.15.63:0/3069144307 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa5f4064040 con 0x7fa5f0003830 2020-05-18T21:29:12.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.193+0000 7fa60bfff700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa5f0058100 0x7fa5f005a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:12.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.193+0000 7fa60bfff700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa5f0058100 0x7fa5f005a5c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa5fc007a80 tx=0x7fa5fc001740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.193+0000 7fa60bfff700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa5f0058100 0x7fa5f005a5c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa5fc007a80 tx=0x7fa5fc001740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.193+0000 7fa60bfff700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa5f0058100 0x7fa5f005a5c0 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7fa5fc007a80 tx=0x7fa5fc001740).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:12.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.201+0000 7fa610a77700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5f0003830 0x7fa5f0003c50 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7fa5f4002f70 tx=0x7fa5f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.201+0000 7fa6097fa700 1 -- 172.21.15.63:0/3069144307 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa5f403e4f0 con 0x7fa5f0003830 2020-05-18T21:29:12.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.353+0000 7fa611278700 1 -- 172.21.15.63:0/3069144307 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa5e40022c0 con 0x7fa5f0003830 2020-05-18T21:29:12.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.361+0000 7fa610a77700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5f0003830 0x7fa5f0003c50 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7fa5f4002f70 tx=0x7fa5f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.361+0000 7fa6097fa700 1 -- 172.21.15.63:0/3069144307 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v24) v1 ==== 184+0+0 (secure 0 0 0) 0x7fa5f4041b10 con 0x7fa5f0003830 2020-05-18T21:29:12.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.365+0000 7fa611278700 1 -- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa5f0058100 msgr2=0x7fa5f005a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.365+0000 7fa611278700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa5f0058100 0x7fa5f005a5c0 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7fa5fc007a80 tx=0x7fa5fc001740).stop 2020-05-18T21:29:12.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.365+0000 7fa611278700 1 -- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5f0003830 msgr2=0x7fa5f0003c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.365+0000 7fa611278700 1 --2- 172.21.15.63:0/3069144307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5f0003830 0x7fa5f0003c50 secure :-1 s=READY pgs=505 cs=0 l=1 rx=0x7fa5f4002f70 tx=0x7fa5f4007a80).stop 2020-05-18T21:29:12.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.365+0000 7fa6124da700 1 -- 172.21.15.63:0/3069144307 reap_dead start 2020-05-18T21:29:12.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.365+0000 7fa611278700 1 -- 172.21.15.63:0/3069144307 shutdown_connections 2020-05-18T21:29:12.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.365+0000 7fa611278700 1 -- 172.21.15.63:0/3069144307 >> 172.21.15.63:0/3069144307 conn(0x7fa60c069b70 msgr2=0x7fa60c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:12.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.365+0000 7fa611278700 1 -- 172.21.15.63:0/3069144307 shutdown_connections 2020-05-18T21:29:12.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.365+0000 7fa611278700 1 -- 172.21.15.63:0/3069144307 wait complete. 2020-05-18T21:29:12.373 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.1 2020-05-18T21:29:12.383 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:29:12.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.493+0000 7fd7fe366700 1 Processor -- start 2020-05-18T21:29:12.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.493+0000 7fd7fe366700 1 -- start start 2020-05-18T21:29:12.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7fe366700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd7f80b6410 0x7fd7f80b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:12.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7fe366700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7f80b5cb0 0x7fd7f8061af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:12.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7fe366700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd7f8151bc0 0x7fd7f8152030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:12.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7fe366700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f8025500 con 0x7fd7f8151bc0 2020-05-18T21:29:12.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7fe366700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f8064ee0 con 0x7fd7f80b6410 2020-05-18T21:29:12.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7fe366700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80b67f0 con 0x7fd7f80b5cb0 2020-05-18T21:29:12.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7ff5c8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd7f8151bc0 0x7fd7f8152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:12.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7ff5c8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd7f8151bc0 0x7fd7f8152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56294/0 (socket says 172.21.15.63:56294) 2020-05-18T21:29:12.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7ff5c8700 1 -- 172.21.15.63:0/2176554817 learned_addr learned my addr 172.21.15.63:0/2176554817 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:12.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7fdb65700 1 --2- 172.21.15.63:0/2176554817 >> v2:172.21.15.155:3300/0 conn(0x7fd7f80b6410 0x7fd7f80b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:12.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7fd364700 1 --2- 172.21.15.63:0/2176554817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7f80b5cb0 0x7fd7f8061af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:12.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7ff5c8700 1 -- 172.21.15.63:0/2176554817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7f80b5cb0 msgr2=0x7fd7f8061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:12.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7ff5c8700 1 --2- 172.21.15.63:0/2176554817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7f80b5cb0 0x7fd7f8061af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:12.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7ff5c8700 1 -- 172.21.15.63:0/2176554817 >> v2:172.21.15.155:3300/0 conn(0x7fd7f80b6410 msgr2=0x7fd7f80b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:12.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7ff5c8700 1 --2- 172.21.15.63:0/2176554817 >> v2:172.21.15.155:3300/0 conn(0x7fd7f80b6410 0x7fd7f80b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:12.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7ff5c8700 1 -- 172.21.15.63:0/2176554817 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f8025180 con 0x7fd7f8151bc0 2020-05-18T21:29:12.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7fdb65700 1 --2- 172.21.15.63:0/2176554817 >> v2:172.21.15.155:3300/0 conn(0x7fd7f80b6410 0x7fd7f80b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:29:12.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7ff5c8700 1 --2- 172.21.15.63:0/2176554817 >> v2:172.21.15.63:3300/0 conn(0x7fd7f8151bc0 0x7fd7f8152030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd7f0002f70 tx=0x7fd7f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7ff5c8700 1 --2- 172.21.15.63:0/2176554817 >> v2:172.21.15.63:3300/0 conn(0x7fd7f8151bc0 0x7fd7f8152030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd7f0002f70 tx=0x7fd7f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7ff5c8700 1 --2- 172.21.15.63:0/2176554817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7f8151bc0 0x7fd7f8152030 secure :-1 s=READY pgs=706 cs=0 l=1 rx=0x7fd7f0002f70 tx=0x7fd7f0007a80).ready entity=mon.0 client_cookie=9b3857e03343b328 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:12.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7ff5c8700 1 --2- 172.21.15.63:0/2176554817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7f8151bc0 0x7fd7f8152030 secure :-1 s=THROTTLE_DONE pgs=706 cs=0 l=1 rx=0x7fd7f0002f70 tx=0x7fd7f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7fcb63700 1 -- 172.21.15.63:0/2176554817 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7f000f650 con 0x7fd7f8151bc0 2020-05-18T21:29:12.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7ff5c8700 1 --2- 172.21.15.63:0/2176554817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7f8151bc0 0x7fd7f8152030 secure :-1 s=THROTTLE_DONE pgs=706 cs=0 l=1 rx=0x7fd7f0002f70 tx=0x7fd7f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7fcb63700 1 -- 172.21.15.63:0/2176554817 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f000f7b0 con 0x7fd7f8151bc0 2020-05-18T21:29:12.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7ff5c8700 1 --2- 172.21.15.63:0/2176554817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7f8151bc0 0x7fd7f8152030 secure :-1 s=THROTTLE_DONE pgs=706 cs=0 l=1 rx=0x7fd7f0002f70 tx=0x7fd7f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7fcb63700 1 -- 172.21.15.63:0/2176554817 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7f0011900 con 0x7fd7f8151bc0 2020-05-18T21:29:12.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7fe366700 1 -- 172.21.15.63:0/2176554817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7f8151bc0 msgr2=0x7fd7f8152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.497+0000 7fd7fe366700 1 --2- 172.21.15.63:0/2176554817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7f8151bc0 0x7fd7f8152030 secure :-1 s=READY pgs=706 cs=0 l=1 rx=0x7fd7f0002f70 tx=0x7fd7f0007a80).stop 2020-05-18T21:29:12.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.501+0000 7fd7fe366700 1 -- 172.21.15.63:0/2176554817 shutdown_connections 2020-05-18T21:29:12.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.501+0000 7fd7fe366700 1 --2- 172.21.15.63:0/2176554817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7f8151bc0 0x7fd7f8152030 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:12.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.501+0000 7fd7fe366700 1 --2- 172.21.15.63:0/2176554817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7f80b5cb0 0x7fd7f8061af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:12.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.501+0000 7fd7fe366700 1 --2- 172.21.15.63:0/2176554817 >> v2:172.21.15.155:3300/0 conn(0x7fd7f80b6410 0x7fd7f80b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:12.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.501+0000 7fd7fe366700 1 -- 172.21.15.63:0/2176554817 >> 172.21.15.63:0/2176554817 conn(0x7fd7f8069b70 msgr2=0x7fd7f8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:12.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.501+0000 7fd7fe366700 1 -- 172.21.15.63:0/2176554817 shutdown_connections 2020-05-18T21:29:12.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.501+0000 7fd7fe366700 1 -- 172.21.15.63:0/2176554817 wait complete. 2020-05-18T21:29:12.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.501+0000 7fd7fe366700 1 Processor -- start 2020-05-18T21:29:12.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.501+0000 7fd7fe366700 1 -- start start 2020-05-18T21:29:12.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7fe366700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd7f80b6410 0x7fd7f80ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:12.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7fe366700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f8150bb0 con 0x7fd7f80b5cb0 2020-05-18T21:29:12.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7fe366700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f80755a0 con 0x7fd7f8151bc0 2020-05-18T21:29:12.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7fe366700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f8075840 con 0x7fd7f80b6410 2020-05-18T21:29:12.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7fdb65700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd7f80b5cb0 0x7fd7f80ac670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58484/0 (socket says 172.21.15.63:58484) 2020-05-18T21:29:12.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7fdb65700 1 -- 172.21.15.63:0/468974705 learned_addr learned my addr 172.21.15.63:0/468974705 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:12.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7fd364700 1 --2- 172.21.15.63:0/468974705 >> v2:172.21.15.155:3300/0 conn(0x7fd7f80b6410 0x7fd7f80ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:12.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7ee7fc700 1 -- 172.21.15.63:0/468974705 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513752649 0 0) 0x7fd7f8150bb0 con 0x7fd7f80b5cb0 2020-05-18T21:29:12.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7ee7fc700 1 -- 172.21.15.63:0/468974705 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7e0003270 con 0x7fd7f80b5cb0 2020-05-18T21:29:12.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7fd364700 1 -- 172.21.15.63:0/468974705 >> v1:172.21.15.155:6789/0 conn(0x7fd7f8151bc0 legacy=0x7fd7f814dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7fd364700 1 -- 172.21.15.63:0/468974705 >> v1:172.21.15.63:6789/0 conn(0x7fd7f80b5cb0 legacy=0x7fd7f80ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7ee7fc700 1 -- 172.21.15.63:0/468974705 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165486723 0 0) 0x7fd7f80755a0 con 0x7fd7f8151bc0 2020-05-18T21:29:12.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7fd364700 1 -- 172.21.15.63:0/468974705 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f8075ae0 con 0x7fd7f80b6410 2020-05-18T21:29:12.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7fd364700 1 --2- 172.21.15.63:0/468974705 >> v2:172.21.15.155:3300/0 conn(0x7fd7f80b6410 0x7fd7f80ae0a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd7f40029e0 tx=0x7fd7e8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7fd364700 1 --2- 172.21.15.63:0/468974705 >> v2:172.21.15.155:3300/0 conn(0x7fd7f80b6410 0x7fd7f80ae0a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd7f40029e0 tx=0x7fd7e8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7fd364700 1 --2- 172.21.15.63:0/468974705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7f80b6410 0x7fd7f80ae0a0 secure :-1 s=READY pgs=507 cs=0 l=1 rx=0x7fd7f40029e0 tx=0x7fd7e8010c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:12.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7fd364700 1 --2- 172.21.15.63:0/468974705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7f80b6410 0x7fd7f80ae0a0 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7fd7f40029e0 tx=0x7fd7e8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7ee7fc700 1 -- 172.21.15.63:0/468974705 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7f4002880 con 0x7fd7f80b6410 2020-05-18T21:29:12.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7fd364700 1 --2- 172.21.15.63:0/468974705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7f80b6410 0x7fd7f80ae0a0 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7fd7f40029e0 tx=0x7fd7e8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7fe366700 1 -- 172.21.15.63:0/468974705 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f8075f80 con 0x7fd7f80b6410 2020-05-18T21:29:12.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7fd364700 1 --2- 172.21.15.63:0/468974705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7f80b6410 0x7fd7f80ae0a0 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7fd7f40029e0 tx=0x7fd7e8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7ee7fc700 1 -- 172.21.15.63:0/468974705 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e8007360 con 0x7fd7f80b6410 2020-05-18T21:29:12.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7ee7fc700 1 -- 172.21.15.63:0/468974705 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7e8005700 con 0x7fd7f80b6410 2020-05-18T21:29:12.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7fe366700 1 -- 172.21.15.63:0/468974705 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f80750b0 con 0x7fd7f80b6410 2020-05-18T21:29:12.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.505+0000 7fd7fd364700 1 --2- 172.21.15.63:0/468974705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7f80b6410 0x7fd7f80ae0a0 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7fd7f40029e0 tx=0x7fd7e8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.509+0000 7fd7fe366700 1 -- 172.21.15.63:0/468974705 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f80753c0 con 0x7fd7f80b6410 2020-05-18T21:29:12.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.509+0000 7fd7ee7fc700 1 -- 172.21.15.63:0/468974705 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd7e8005900 con 0x7fd7f80b6410 2020-05-18T21:29:12.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.509+0000 7fd7fd364700 1 --2- 172.21.15.63:0/468974705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7f80b6410 0x7fd7f80ae0a0 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7fd7f40029e0 tx=0x7fd7e8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.509+0000 7fd7ee7fc700 1 --2- 172.21.15.63:0/468974705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd7e004fc80 0x7fd7e0052140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:12.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.509+0000 7fd7ee7fc700 1 -- 172.21.15.63:0/468974705 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd7e8063a60 con 0x7fd7f80b6410 2020-05-18T21:29:12.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.509+0000 7fd7fdb65700 1 --2- 172.21.15.63:0/468974705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd7e004fc80 0x7fd7e0052140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:12.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.509+0000 7fd7fdb65700 1 --2- 172.21.15.63:0/468974705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd7e004fc80 0x7fd7e0052140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd7f4003430 tx=0x7fd7f4002ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.509+0000 7fd7fdb65700 1 --2- 172.21.15.63:0/468974705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd7e004fc80 0x7fd7e0052140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd7f4003430 tx=0x7fd7f4002ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.509+0000 7fd7fdb65700 1 --2- 172.21.15.63:0/468974705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd7e004fc80 0x7fd7e0052140 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7fd7f4003430 tx=0x7fd7f4002ac0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:12.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.517+0000 7fd7fd364700 1 --2- 172.21.15.63:0/468974705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7f80b6410 0x7fd7f80ae0a0 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7fd7f40029e0 tx=0x7fd7e8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.517+0000 7fd7ee7fc700 1 -- 172.21.15.63:0/468974705 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd7e803ddf0 con 0x7fd7f80b6410 2020-05-18T21:29:12.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.673+0000 7fd7fe366700 1 -- 172.21.15.63:0/468974705 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd7f80569e0 con 0x7fd7f80b6410 2020-05-18T21:29:12.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.681+0000 7fd7fd364700 1 --2- 172.21.15.63:0/468974705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7f80b6410 0x7fd7f80ae0a0 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7fd7f40029e0 tx=0x7fd7e8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.681+0000 7fd7ee7fc700 1 -- 172.21.15.63:0/468974705 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v25) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd7e8041410 con 0x7fd7f80b6410 2020-05-18T21:29:12.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.685+0000 7fd7fe366700 1 -- 172.21.15.63:0/468974705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd7e004fc80 msgr2=0x7fd7e0052140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.685+0000 7fd7fe366700 1 --2- 172.21.15.63:0/468974705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd7e004fc80 0x7fd7e0052140 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7fd7f4003430 tx=0x7fd7f4002ac0).stop 2020-05-18T21:29:12.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.685+0000 7fd7fe366700 1 -- 172.21.15.63:0/468974705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7f80b6410 msgr2=0x7fd7f80ae0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.685+0000 7fd7fe366700 1 --2- 172.21.15.63:0/468974705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7f80b6410 0x7fd7f80ae0a0 secure :-1 s=READY pgs=507 cs=0 l=1 rx=0x7fd7f40029e0 tx=0x7fd7e8010c70).stop 2020-05-18T21:29:12.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.685+0000 7fd7fe366700 1 -- 172.21.15.63:0/468974705 shutdown_connections 2020-05-18T21:29:12.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.685+0000 7fd7fe366700 1 --2- 172.21.15.63:0/468974705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd7e004fc80 0x7fd7e0052140 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:12.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.685+0000 7fd7fe366700 1 --2- 172.21.15.63:0/468974705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7f80b6410 0x7fd7f80ae0a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:12.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.685+0000 7fd7fe366700 1 -- 172.21.15.63:0/468974705 >> 172.21.15.63:0/468974705 conn(0x7fd7f8069b70 msgr2=0x7fd7f80b7260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:12.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.685+0000 7fd7fe366700 1 -- 172.21.15.63:0/468974705 shutdown_connections 2020-05-18T21:29:12.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.685+0000 7fd7fe366700 1 -- 172.21.15.63:0/468974705 wait complete. 2020-05-18T21:29:12.693 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.2 2020-05-18T21:29:12.703 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:29:12.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f2045195700 1 Processor -- start 2020-05-18T21:29:12.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f2045195700 1 -- start start 2020-05-18T21:29:12.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f2045195700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20400b8c30 0x7f20401566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:12.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f2045195700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2040065a70 con 0x7f20400ad070 2020-05-18T21:29:12.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f2045195700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20400b9010 con 0x7f2040157260 2020-05-18T21:29:12.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f2045195700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20400801d0 con 0x7f20400b8c30 2020-05-18T21:29:12.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203ed9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f20400ad070 0x7f2040156b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58496/0 (socket says 172.21.15.63:58496) 2020-05-18T21:29:12.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203ed9d700 1 -- 172.21.15.63:0/2494659879 learned_addr learned my addr 172.21.15.63:0/2494659879 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:12.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203f59e700 1 --2- 172.21.15.63:0/2494659879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20400b8c30 0x7f20401566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:12.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203e59c700 1 -- 172.21.15.63:0/2494659879 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165115577 0 0) 0x7f2040065a70 con 0x7f20400ad070 2020-05-18T21:29:12.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203e59c700 1 -- 172.21.15.63:0/2494659879 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f202c003270 con 0x7f20400ad070 2020-05-18T21:29:12.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203e59c700 1 -- 172.21.15.63:0/2494659879 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800167320 0 0) 0x7f20400b9010 con 0x7f2040157260 2020-05-18T21:29:12.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203e59c700 1 -- 172.21.15.63:0/2494659879 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2040065a70 con 0x7f2040157260 2020-05-18T21:29:12.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203f59e700 1 -- 172.21.15.63:0/2494659879 >> v1:172.21.15.155:6789/0 conn(0x7f2040157260 legacy=0x7f204015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203e59c700 1 -- 172.21.15.63:0/2494659879 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2450888381 0 0) 0x7f202c003270 con 0x7f20400ad070 2020-05-18T21:29:12.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203f59e700 1 -- 172.21.15.63:0/2494659879 >> v1:172.21.15.63:6789/0 conn(0x7f20400ad070 legacy=0x7f2040156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203f59e700 1 -- 172.21.15.63:0/2494659879 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204005bf00 con 0x7f20400b8c30 2020-05-18T21:29:12.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203f59e700 1 --2- 172.21.15.63:0/2494659879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20400b8c30 0x7f20401566f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2028001110 tx=0x7f2030008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203f59e700 1 --2- 172.21.15.63:0/2494659879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20400b8c30 0x7f20401566f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2028001110 tx=0x7f2030008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203f59e700 1 --2- 172.21.15.63:0/2494659879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20400b8c30 0x7f20401566f0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f2028001110 tx=0x7f2030008ca0).ready entity=mon.2 client_cookie=45d36ed8e0d8224d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:12.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203f59e700 1 --2- 172.21.15.63:0/2494659879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20400b8c30 0x7f20401566f0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f2028001110 tx=0x7f2030008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203e59c700 1 -- 172.21.15.63:0/2494659879 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2028001710 con 0x7f20400b8c30 2020-05-18T21:29:12.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203f59e700 1 --2- 172.21.15.63:0/2494659879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20400b8c30 0x7f20401566f0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f2028001110 tx=0x7f2030008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203e59c700 1 -- 172.21.15.63:0/2494659879 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2030011ac0 con 0x7f20400b8c30 2020-05-18T21:29:12.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203f59e700 1 --2- 172.21.15.63:0/2494659879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20400b8c30 0x7f20401566f0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f2028001110 tx=0x7f2030008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f2045195700 1 -- 172.21.15.63:0/2494659879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20400b8c30 msgr2=0x7f20401566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f203e59c700 1 -- 172.21.15.63:0/2494659879 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2030011e20 con 0x7f20400b8c30 2020-05-18T21:29:12.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.841+0000 7f2045195700 1 --2- 172.21.15.63:0/2494659879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20400b8c30 0x7f20401566f0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f2028001110 tx=0x7f2030008ca0).stop 2020-05-18T21:29:12.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.845+0000 7f2045195700 1 -- 172.21.15.63:0/2494659879 shutdown_connections 2020-05-18T21:29:12.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.845+0000 7f2045195700 1 --2- 172.21.15.63:0/2494659879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20400b8c30 0x7f20401566f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:12.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.845+0000 7f2045195700 1 -- 172.21.15.63:0/2494659879 >> 172.21.15.63:0/2494659879 conn(0x7f204006a640 msgr2=0x7f20400b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:12.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.845+0000 7f2045195700 1 -- 172.21.15.63:0/2494659879 shutdown_connections 2020-05-18T21:29:12.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.845+0000 7f2045195700 1 -- 172.21.15.63:0/2494659879 wait complete. 2020-05-18T21:29:12.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.845+0000 7f2045195700 1 Processor -- start 2020-05-18T21:29:12.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.845+0000 7f2045195700 1 -- start start 2020-05-18T21:29:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.845+0000 7f2045195700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f20400ad070 0x7f20400b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.845+0000 7f2045195700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20400b8c30 0x7f204007f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.845+0000 7f2045195700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2040157260 0x7f20400648f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.845+0000 7f2045195700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204007fcd0 con 0x7f2040157260 2020-05-18T21:29:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.845+0000 7f2045195700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20400b45e0 con 0x7f20400ad070 2020-05-18T21:29:12.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.845+0000 7f2045195700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20400b4880 con 0x7f20400b8c30 2020-05-18T21:29:12.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2044994700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2040157260 0x7f20400648f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:12.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2044994700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2040157260 0x7f20400648f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56312/0 (socket says 172.21.15.63:56312) 2020-05-18T21:29:12.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2044994700 1 -- 172.21.15.63:0/750718090 learned_addr learned my addr 172.21.15.63:0/750718090 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:12.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f203ed9d700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20400b8c30 0x7f204007f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:12.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f203f59e700 1 --2- 172.21.15.63:0/750718090 >> v2:172.21.15.155:3300/0 conn(0x7f20400ad070 0x7f20400b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:12.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2044994700 1 -- 172.21.15.63:0/750718090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20400b8c30 msgr2=0x7f204007f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2044994700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20400b8c30 0x7f204007f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:12.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2044994700 1 -- 172.21.15.63:0/750718090 >> v2:172.21.15.155:3300/0 conn(0x7f20400ad070 msgr2=0x7f20400b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:12.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2044994700 1 --2- 172.21.15.63:0/750718090 >> v2:172.21.15.155:3300/0 conn(0x7f20400ad070 0x7f20400b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:12.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2044994700 1 -- 172.21.15.63:0/750718090 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20400b4b20 con 0x7f2040157260 2020-05-18T21:29:12.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2044994700 1 --2- 172.21.15.63:0/750718090 >> v2:172.21.15.63:3300/0 conn(0x7f2040157260 0x7f20400648f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2038001110 tx=0x7f203800c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2044994700 1 --2- 172.21.15.63:0/750718090 >> v2:172.21.15.63:3300/0 conn(0x7f2040157260 0x7f20400648f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2038001110 tx=0x7f203800c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2044994700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2040157260 0x7f20400648f0 secure :-1 s=READY pgs=709 cs=0 l=1 rx=0x7f2038001110 tx=0x7f203800c420).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:12.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2044994700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2040157260 0x7f20400648f0 secure :-1 s=THROTTLE_DONE pgs=709 cs=0 l=1 rx=0x7f2038001110 tx=0x7f203800c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2037fff700 1 -- 172.21.15.63:0/750718090 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f203800cc60 con 0x7f2040157260 2020-05-18T21:29:12.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2044994700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2040157260 0x7f20400648f0 secure :-1 s=THROTTLE_DONE pgs=709 cs=0 l=1 rx=0x7f2038001110 tx=0x7f203800c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2044994700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2040157260 0x7f20400648f0 secure :-1 s=THROTTLE_DONE pgs=709 cs=0 l=1 rx=0x7f2038001110 tx=0x7f203800c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2037fff700 1 -- 172.21.15.63:0/750718090 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203800cdc0 con 0x7f2040157260 2020-05-18T21:29:12.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2045195700 1 -- 172.21.15.63:0/750718090 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2040064d50 con 0x7f2040157260 2020-05-18T21:29:12.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2037fff700 1 -- 172.21.15.63:0/750718090 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f203800e370 con 0x7f2040157260 2020-05-18T21:29:12.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2045195700 1 -- 172.21.15.63:0/750718090 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2040123f70 con 0x7f2040157260 2020-05-18T21:29:12.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2044994700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2040157260 0x7f20400648f0 secure :-1 s=THROTTLE_DONE pgs=709 cs=0 l=1 rx=0x7f2038001110 tx=0x7f203800c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2045195700 1 -- 172.21.15.63:0/750718090 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20400b4d20 con 0x7f2040157260 2020-05-18T21:29:12.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2037fff700 1 -- 172.21.15.63:0/750718090 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f203800e5e0 con 0x7f2040157260 2020-05-18T21:29:12.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2044994700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2040157260 0x7f20400648f0 secure :-1 s=THROTTLE_DONE pgs=709 cs=0 l=1 rx=0x7f2038001110 tx=0x7f203800c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.849+0000 7f2037fff700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f202404fa30 0x7f2024051ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:12.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.853+0000 7f2037fff700 1 -- 172.21.15.63:0/750718090 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2038063a60 con 0x7f2040157260 2020-05-18T21:29:12.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.853+0000 7f203f59e700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f202404fa30 0x7f2024051ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:12.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.853+0000 7f203f59e700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f202404fa30 0x7f2024051ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2028001110 tx=0x7f2040066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.853+0000 7f203f59e700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f202404fa30 0x7f2024051ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2028001110 tx=0x7f2040066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.853+0000 7f203f59e700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f202404fa30 0x7f2024051ef0 secure :-1 s=READY pgs=288 cs=0 l=1 rx=0x7f2028001110 tx=0x7f2040066290).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:12.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.857+0000 7f2044994700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2040157260 0x7f20400648f0 secure :-1 s=THROTTLE_DONE pgs=709 cs=0 l=1 rx=0x7f2038001110 tx=0x7f203800c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:12.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:12.857+0000 7f2037fff700 1 -- 172.21.15.63:0/750718090 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f20400b4d20 con 0x7f2040157260 2020-05-18T21:29:13.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.009+0000 7f2045195700 1 -- 172.21.15.63:0/750718090 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f20400b4d20 con 0x7f2040157260 2020-05-18T21:29:13.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.017+0000 7f2044994700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2040157260 0x7f20400648f0 secure :-1 s=THROTTLE_DONE pgs=709 cs=0 l=1 rx=0x7f2038001110 tx=0x7f203800c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.017+0000 7f2037fff700 1 -- 172.21.15.63:0/750718090 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v26) v1 ==== 184+0+0 (secure 0 0 0) 0x7f20400b4d20 con 0x7f2040157260 2020-05-18T21:29:13.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.021+0000 7f2045195700 1 -- 172.21.15.63:0/750718090 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f202404fa30 msgr2=0x7f2024051ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:13.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.021+0000 7f2045195700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f202404fa30 0x7f2024051ef0 secure :-1 s=READY pgs=288 cs=0 l=1 rx=0x7f2028001110 tx=0x7f2040066290).stop 2020-05-18T21:29:13.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.021+0000 7f2045195700 1 -- 172.21.15.63:0/750718090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2040157260 msgr2=0x7f20400648f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:13.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.021+0000 7f2045195700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2040157260 0x7f20400648f0 secure :-1 s=READY pgs=709 cs=0 l=1 rx=0x7f2038001110 tx=0x7f203800c420).stop 2020-05-18T21:29:13.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.021+0000 7f2045195700 1 -- 172.21.15.63:0/750718090 shutdown_connections 2020-05-18T21:29:13.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.021+0000 7f2045195700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f202404fa30 0x7f2024051ef0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:13.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.021+0000 7f2045195700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2040157260 0x7f20400648f0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:13.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.021+0000 7f2045195700 1 --2- 172.21.15.63:0/750718090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20400b8c30 0x7f204007f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:13.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.021+0000 7f2045195700 1 --2- 172.21.15.63:0/750718090 >> v2:172.21.15.155:3300/0 conn(0x7f20400ad070 0x7f20400b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:13.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.021+0000 7f2045195700 1 -- 172.21.15.63:0/750718090 >> 172.21.15.63:0/750718090 conn(0x7f204006a640 msgr2=0x7f20400b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:13.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.021+0000 7f2045195700 1 -- 172.21.15.63:0/750718090 shutdown_connections 2020-05-18T21:29:13.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.021+0000 7f2045195700 1 -- 172.21.15.63:0/750718090 wait complete. 2020-05-18T21:29:13.029 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.3 2020-05-18T21:29:13.038 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:13.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16f555700 1 Processor -- start 2020-05-18T21:29:13.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16f555700 1 -- start start 2020-05-18T21:29:13.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16f555700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1680b5990 0x7ff1680b8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:13.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16f555700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1680b87c0 0x7ff168149a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:13.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16f555700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16814a940 con 0x7ff168069eb0 2020-05-18T21:29:13.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16f555700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff16814eb00 con 0x7ff1680b5990 2020-05-18T21:29:13.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16f555700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16806a290 con 0x7ff1680b87c0 2020-05-18T21:29:13.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16caf0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1680b5990 0x7ff1680b8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:13.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16caf0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1680b5990 0x7ff1680b8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:42936/0 (socket says 172.21.15.63:42936) 2020-05-18T21:29:13.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16caf0700 1 -- 172.21.15.63:0/238140651 learned_addr learned my addr 172.21.15.63:0/238140651 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:13.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16daf2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1680b87c0 0x7ff168149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:13.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16caf0700 1 -- 172.21.15.63:0/238140651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1680b87c0 msgr2=0x7ff168149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:13.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16caf0700 1 --2- 172.21.15.63:0/238140651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1680b87c0 0x7ff168149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:13.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16caf0700 1 -- 172.21.15.63:0/238140651 >> v1:172.21.15.155:6789/0 conn(0x7ff168069eb0 legacy=0x7ff16814ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:13.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16caf0700 1 -- 172.21.15.63:0/238140651 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1680b6e80 con 0x7ff1680b5990 2020-05-18T21:29:13.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16caf0700 1 --2- 172.21.15.63:0/238140651 >> v2:172.21.15.155:3300/0 conn(0x7ff1680b5990 0x7ff1680b8360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff1580032f0 tx=0x7ff158007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16caf0700 1 --2- 172.21.15.63:0/238140651 >> v2:172.21.15.155:3300/0 conn(0x7ff1680b5990 0x7ff1680b8360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff1580032f0 tx=0x7ff158007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16caf0700 1 --2- 172.21.15.63:0/238140651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1680b5990 0x7ff1680b8360 secure :-1 s=READY pgs=510 cs=0 l=1 rx=0x7ff1580032f0 tx=0x7ff158007e00).ready entity=mon.1 client_cookie=87b1594a79f745c4 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:13.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16caf0700 1 --2- 172.21.15.63:0/238140651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1680b5990 0x7ff1680b8360 secure :-1 s=THROTTLE_DONE pgs=510 cs=0 l=1 rx=0x7ff1580032f0 tx=0x7ff158007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff167fff700 1 -- 172.21.15.63:0/238140651 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff158011d10 con 0x7ff1680b5990 2020-05-18T21:29:13.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16caf0700 1 --2- 172.21.15.63:0/238140651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1680b5990 0x7ff1680b8360 secure :-1 s=THROTTLE_DONE pgs=510 cs=0 l=1 rx=0x7ff1580032f0 tx=0x7ff158007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16caf0700 1 --2- 172.21.15.63:0/238140651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1680b5990 0x7ff1680b8360 secure :-1 s=THROTTLE_DONE pgs=510 cs=0 l=1 rx=0x7ff1580032f0 tx=0x7ff158007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff167fff700 1 -- 172.21.15.63:0/238140651 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff158011e70 con 0x7ff1680b5990 2020-05-18T21:29:13.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff167fff700 1 -- 172.21.15.63:0/238140651 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff15800a370 con 0x7ff1680b5990 2020-05-18T21:29:13.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16f555700 1 -- 172.21.15.63:0/238140651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1680b5990 msgr2=0x7ff1680b8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:13.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.141+0000 7ff16f555700 1 --2- 172.21.15.63:0/238140651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1680b5990 0x7ff1680b8360 secure :-1 s=READY pgs=510 cs=0 l=1 rx=0x7ff1580032f0 tx=0x7ff158007e00).stop 2020-05-18T21:29:13.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.145+0000 7ff16f555700 1 -- 172.21.15.63:0/238140651 shutdown_connections 2020-05-18T21:29:13.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.145+0000 7ff16f555700 1 --2- 172.21.15.63:0/238140651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1680b87c0 0x7ff168149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:13.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.145+0000 7ff16f555700 1 --2- 172.21.15.63:0/238140651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1680b5990 0x7ff1680b8360 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:13.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.145+0000 7ff16f555700 1 -- 172.21.15.63:0/238140651 >> 172.21.15.63:0/238140651 conn(0x7ff168066ed0 msgr2=0x7ff1680b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:13.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.145+0000 7ff16f555700 1 -- 172.21.15.63:0/238140651 shutdown_connections 2020-05-18T21:29:13.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.145+0000 7ff16f555700 1 -- 172.21.15.63:0/238140651 wait complete. 2020-05-18T21:29:13.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.145+0000 7ff16f555700 1 Processor -- start 2020-05-18T21:29:13.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.145+0000 7ff16f555700 1 -- start start 2020-05-18T21:29:13.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.145+0000 7ff16f555700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff1680b5990 0x7ff168065240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:13.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.145+0000 7ff16f555700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1680b87c0 0x7ff1680b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:13.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.145+0000 7ff16f555700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1680b0120 con 0x7ff168069eb0 2020-05-18T21:29:13.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.145+0000 7ff16f555700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1680b03c0 con 0x7ff1680b5990 2020-05-18T21:29:13.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.145+0000 7ff16f555700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1680b4b30 con 0x7ff1680b87c0 2020-05-18T21:29:13.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff16caf0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff1680b5990 0x7ff168065240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:13.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff16daf2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1680b87c0 0x7ff1680b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:13.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff16caf0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff1680b5990 0x7ff168065240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56326/0 (socket says 172.21.15.63:56326) 2020-05-18T21:29:13.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff16caf0700 1 -- 172.21.15.63:0/1467313427 learned_addr learned my addr 172.21.15.63:0/1467313427 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:13.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff16caf0700 1 -- 172.21.15.63:0/1467313427 >> v2:172.21.15.155:3300/0 conn(0x7ff1680b87c0 msgr2=0x7ff1680b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:13.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff16caf0700 1 --2- 172.21.15.63:0/1467313427 >> v2:172.21.15.155:3300/0 conn(0x7ff1680b87c0 0x7ff1680b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:13.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff16caf0700 1 -- 172.21.15.63:0/1467313427 >> v1:172.21.15.155:6789/0 conn(0x7ff168069eb0 legacy=0x7ff168145320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:13.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff16caf0700 1 -- 172.21.15.63:0/1467313427 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff168145a30 con 0x7ff1680b5990 2020-05-18T21:29:13.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff16caf0700 1 --2- 172.21.15.63:0/1467313427 >> v2:172.21.15.63:3300/0 conn(0x7ff1680b5990 0x7ff168065240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff1580032f0 tx=0x7ff158007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff16caf0700 1 --2- 172.21.15.63:0/1467313427 >> v2:172.21.15.63:3300/0 conn(0x7ff1680b5990 0x7ff168065240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff1580032f0 tx=0x7ff158007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff16caf0700 1 --2- 172.21.15.63:0/1467313427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1680b5990 0x7ff168065240 secure :-1 s=READY pgs=710 cs=0 l=1 rx=0x7ff1580032f0 tx=0x7ff158007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:13.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff16caf0700 1 --2- 172.21.15.63:0/1467313427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1680b5990 0x7ff168065240 secure :-1 s=THROTTLE_DONE pgs=710 cs=0 l=1 rx=0x7ff1580032f0 tx=0x7ff158007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff1667fc700 1 -- 172.21.15.63:0/1467313427 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff158005a80 con 0x7ff1680b5990 2020-05-18T21:29:13.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff16caf0700 1 --2- 172.21.15.63:0/1467313427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1680b5990 0x7ff168065240 secure :-1 s=THROTTLE_DONE pgs=710 cs=0 l=1 rx=0x7ff1580032f0 tx=0x7ff158007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff16caf0700 1 --2- 172.21.15.63:0/1467313427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1680b5990 0x7ff168065240 secure :-1 s=THROTTLE_DONE pgs=710 cs=0 l=1 rx=0x7ff1580032f0 tx=0x7ff158007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff1667fc700 1 -- 172.21.15.63:0/1467313427 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff158005be0 con 0x7ff1680b5990 2020-05-18T21:29:13.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff16f555700 1 -- 172.21.15.63:0/1467313427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1680afd50 con 0x7ff1680b5990 2020-05-18T21:29:13.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff1667fc700 1 -- 172.21.15.63:0/1467313427 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff158007170 con 0x7ff1680b5990 2020-05-18T21:29:13.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff16f555700 1 -- 172.21.15.63:0/1467313427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff168065d90 con 0x7ff1680b5990 2020-05-18T21:29:13.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff16caf0700 1 --2- 172.21.15.63:0/1467313427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1680b5990 0x7ff168065240 secure :-1 s=THROTTLE_DONE pgs=710 cs=0 l=1 rx=0x7ff1580032f0 tx=0x7ff158007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff1667fc700 1 -- 172.21.15.63:0/1467313427 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff1580073a0 con 0x7ff1680b5990 2020-05-18T21:29:13.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff16caf0700 1 --2- 172.21.15.63:0/1467313427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1680b5990 0x7ff168065240 secure :-1 s=THROTTLE_DONE pgs=710 cs=0 l=1 rx=0x7ff1580032f0 tx=0x7ff158007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff16f555700 1 -- 172.21.15.63:0/1467313427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1680569e0 con 0x7ff1680b5990 2020-05-18T21:29:13.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.149+0000 7ff1667fc700 1 --2- 172.21.15.63:0/1467313427 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff14804fa10 0x7ff148051ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:13.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.153+0000 7ff1667fc700 1 -- 172.21.15.63:0/1467313427 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff158064900 con 0x7ff1680b5990 2020-05-18T21:29:13.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.153+0000 7ff16d2f1700 1 --2- 172.21.15.63:0/1467313427 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff14804fa10 0x7ff148051ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:13.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.153+0000 7ff16d2f1700 1 --2- 172.21.15.63:0/1467313427 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff14804fa10 0x7ff148051ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff168065000 tx=0x7ff15c0025a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.153+0000 7ff16d2f1700 1 --2- 172.21.15.63:0/1467313427 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff14804fa10 0x7ff148051ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff168065000 tx=0x7ff15c0025a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.153+0000 7ff16d2f1700 1 --2- 172.21.15.63:0/1467313427 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff14804fa10 0x7ff148051ed0 secure :-1 s=READY pgs=289 cs=0 l=1 rx=0x7ff168065000 tx=0x7ff15c0025a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:13.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.157+0000 7ff16caf0700 1 --2- 172.21.15.63:0/1467313427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1680b5990 0x7ff168065240 secure :-1 s=THROTTLE_DONE pgs=710 cs=0 l=1 rx=0x7ff1580032f0 tx=0x7ff158007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.157+0000 7ff1667fc700 1 -- 172.21.15.63:0/1467313427 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff15803ed50 con 0x7ff1680b5990 2020-05-18T21:29:13.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.305+0000 7ff16f555700 1 -- 172.21.15.63:0/1467313427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1680b5560 con 0x7ff1680b5990 2020-05-18T21:29:13.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.305+0000 7ff16caf0700 1 --2- 172.21.15.63:0/1467313427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1680b5990 0x7ff168065240 secure :-1 s=THROTTLE_DONE pgs=710 cs=0 l=1 rx=0x7ff1580032f0 tx=0x7ff158007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.305+0000 7ff1667fc700 1 -- 172.21.15.63:0/1467313427 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2143 (secure 0 0 0) 0x7ff158042370 con 0x7ff1680b5990 2020-05-18T21:29:13.312 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:13.312 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/3008842702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3008842702},{"type":"v1","addr":"172.21.15.63:6833","nonce":3008842702}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:11.179187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5138":{"gid":5138,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/3117563034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3117563034},{"type":"v1","addr":"172.21.15.155:6835","nonce":3117563034}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:13.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.305+0000 7ff16f555700 1 -- 172.21.15.63:0/1467313427 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff14804fa10 msgr2=0x7ff148051ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:13.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.305+0000 7ff16f555700 1 --2- 172.21.15.63:0/1467313427 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff14804fa10 0x7ff148051ed0 secure :-1 s=READY pgs=289 cs=0 l=1 rx=0x7ff168065000 tx=0x7ff15c0025a0).stop 2020-05-18T21:29:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.305+0000 7ff16f555700 1 -- 172.21.15.63:0/1467313427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1680b5990 msgr2=0x7ff168065240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.305+0000 7ff16f555700 1 --2- 172.21.15.63:0/1467313427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1680b5990 0x7ff168065240 secure :-1 s=READY pgs=710 cs=0 l=1 rx=0x7ff1580032f0 tx=0x7ff158007e00).stop 2020-05-18T21:29:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.305+0000 7ff16f555700 1 -- 172.21.15.63:0/1467313427 shutdown_connections 2020-05-18T21:29:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.305+0000 7ff16f555700 1 --2- 172.21.15.63:0/1467313427 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff14804fa10 0x7ff148051ed0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.305+0000 7ff16f555700 1 --2- 172.21.15.63:0/1467313427 >> v2:172.21.15.155:3300/0 conn(0x7ff1680b87c0 0x7ff1680b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:13.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.305+0000 7ff16f555700 1 --2- 172.21.15.63:0/1467313427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1680b5990 0x7ff168065240 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:13.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.309+0000 7ff16f555700 1 -- 172.21.15.63:0/1467313427 >> 172.21.15.63:0/1467313427 conn(0x7ff168066ed0 msgr2=0x7ff16814d020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:13.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.309+0000 7ff16f555700 1 -- 172.21.15.63:0/1467313427 shutdown_connections 2020-05-18T21:29:13.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.309+0000 7ff16f555700 1 -- 172.21.15.63:0/1467313427 wait complete. 2020-05-18T21:29:13.316 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 27 2020-05-18T21:29:13.525 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:29:10.174981+0000', 'modified': '2020-05-18T21:29:11.179187+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5138': {'gid': 5138, 'name': 'b', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6835/3117563034', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3117563034}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3117563034}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:29:13.525 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:29:13.526 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:29:13.638 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:29:13.638 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:29:13.639 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2020-05-18T21:29:13.639 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 5138, 2020-05-18T21:29:13.639 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:29:13.639 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:29:13.639 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 3.4563947439999998, 2020-05-18T21:29:13.640 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 27, 2020-05-18T21:29:13.640 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 61, 2020-05-18T21:29:13.640 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 61, 2020-05-18T21:29:13.640 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 7.8195998820000003 2020-05-18T21:29:13.640 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:29:13.647 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 5138, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.4563947439999998, "mdsmap_epoch": 27, "osdmap_epoch": 61, "osdmap_epoch_barrier": 61, "uptime": 7.8195998820000003 } 2020-05-18T21:29:13.648 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:29:13.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4ce58ff700 1 Processor -- start 2020-05-18T21:29:13.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4ce58ff700 1 -- start start 2020-05-18T21:29:13.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4ce58ff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4ce0060b90 0x7f4ce0145f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:13.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4ce58ff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4ce0149e80 0x7f4ce00b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:13.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4ce58ff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce0146e60 con 0x7f4ce0061670 2020-05-18T21:29:13.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4ce58ff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce0146480 con 0x7f4ce0060b90 2020-05-18T21:29:13.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4ce58ff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce0146720 con 0x7f4ce0149e80 2020-05-18T21:29:13.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4cd67fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4ce0061670 0x7f4ce0149770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58522/0 (socket says 172.21.15.63:58522) 2020-05-18T21:29:13.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4cdeffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4ce0060b90 0x7f4ce0145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:13.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4cd67fc700 1 -- 172.21.15.63:0/3979212731 learned_addr learned my addr 172.21.15.63:0/3979212731 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:13.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4cdf7fe700 1 --2- 172.21.15.63:0/3979212731 >> v2:172.21.15.155:3300/0 conn(0x7f4ce0149e80 0x7f4ce00b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:13.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4cde7fc700 1 -- 172.21.15.63:0/3979212731 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823930652 0 0) 0x7f4ce0146e60 con 0x7f4ce0061670 2020-05-18T21:29:13.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4cde7fc700 1 -- 172.21.15.63:0/3979212731 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cc0003270 con 0x7f4ce0061670 2020-05-18T21:29:13.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4cdeffd700 1 -- 172.21.15.63:0/3979212731 >> v2:172.21.15.155:3300/0 conn(0x7f4ce0149e80 msgr2=0x7f4ce00b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:13.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/3979212731 >> v2:172.21.15.155:3300/0 conn(0x7f4ce0149e80 0x7f4ce00b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:13.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4cdeffd700 1 -- 172.21.15.63:0/3979212731 >> v1:172.21.15.63:6789/0 conn(0x7f4ce0061670 legacy=0x7f4ce0149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:13.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4cdeffd700 1 -- 172.21.15.63:0/3979212731 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce01469c0 con 0x7f4ce0060b90 2020-05-18T21:29:13.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/3979212731 >> v2:172.21.15.63:3300/0 conn(0x7f4ce0060b90 0x7f4ce0145f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4cd0002f70 tx=0x7f4cd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/3979212731 >> v2:172.21.15.63:3300/0 conn(0x7f4ce0060b90 0x7f4ce0145f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4cd0002f70 tx=0x7f4cd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/3979212731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce0060b90 0x7f4ce0145f40 secure :-1 s=READY pgs=712 cs=0 l=1 rx=0x7f4cd0002f70 tx=0x7f4cd0007a80).ready entity=mon.0 client_cookie=6cb9caf0008f3125 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:13.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/3979212731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce0060b90 0x7f4ce0145f40 secure :-1 s=THROTTLE_DONE pgs=712 cs=0 l=1 rx=0x7f4cd0002f70 tx=0x7f4cd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/3979212731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce0060b90 0x7f4ce0145f40 secure :-1 s=THROTTLE_DONE pgs=712 cs=0 l=1 rx=0x7f4cd0002f70 tx=0x7f4cd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4cde7fc700 1 -- 172.21.15.63:0/3979212731 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cd0008e50 con 0x7f4ce0060b90 2020-05-18T21:29:13.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/3979212731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce0060b90 0x7f4ce0145f40 secure :-1 s=THROTTLE_DONE pgs=712 cs=0 l=1 rx=0x7f4cd0002f70 tx=0x7f4cd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4cde7fc700 1 -- 172.21.15.63:0/3979212731 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd0011540 con 0x7f4ce0060b90 2020-05-18T21:29:13.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4cde7fc700 1 -- 172.21.15.63:0/3979212731 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cd0011960 con 0x7f4ce0060b90 2020-05-18T21:29:13.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4ce58ff700 1 -- 172.21.15.63:0/3979212731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce0060b90 msgr2=0x7f4ce0145f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:13.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4ce58ff700 1 --2- 172.21.15.63:0/3979212731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce0060b90 0x7f4ce0145f40 secure :-1 s=READY pgs=712 cs=0 l=1 rx=0x7f4cd0002f70 tx=0x7f4cd0007a80).stop 2020-05-18T21:29:13.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4ce58ff700 1 -- 172.21.15.63:0/3979212731 shutdown_connections 2020-05-18T21:29:13.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4ce58ff700 1 --2- 172.21.15.63:0/3979212731 >> v2:172.21.15.155:3300/0 conn(0x7f4ce0149e80 0x7f4ce00b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:13.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4ce58ff700 1 --2- 172.21.15.63:0/3979212731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce0060b90 0x7f4ce0145f40 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:13.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4ce58ff700 1 -- 172.21.15.63:0/3979212731 >> 172.21.15.63:0/3979212731 conn(0x7f4ce00b83d0 msgr2=0x7f4ce00b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:13.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4ce58ff700 1 -- 172.21.15.63:0/3979212731 shutdown_connections 2020-05-18T21:29:13.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.757+0000 7f4ce58ff700 1 -- 172.21.15.63:0/3979212731 wait complete. 2020-05-18T21:29:13.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4ce58ff700 1 Processor -- start 2020-05-18T21:29:13.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4ce58ff700 1 -- start start 2020-05-18T21:29:13.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4ce58ff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4ce0060b90 0x7f4ce0061b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:13.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4ce58ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ce0061670 0x7f4ce0065e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:13.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4ce58ff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4ce0149e80 0x7f4ce012efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:13.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4ce58ff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce012f410 con 0x7f4ce0060b90 2020-05-18T21:29:13.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4ce58ff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce0062360 con 0x7f4ce0149e80 2020-05-18T21:29:13.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4ce58ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce0062590 con 0x7f4ce0061670 2020-05-18T21:29:13.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cdeffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4ce0060b90 0x7f4ce0061b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:13.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cdeffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4ce0060b90 0x7f4ce0061b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56338/0 (socket says 172.21.15.63:56338) 2020-05-18T21:29:13.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cdeffd700 1 -- 172.21.15.63:0/3484440865 learned_addr learned my addr 172.21.15.63:0/3484440865 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:13.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cdf7fe700 1 --2- 172.21.15.63:0/3484440865 >> v2:172.21.15.155:3300/0 conn(0x7f4ce0149e80 0x7f4ce012efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:13.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cd67fc700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ce0061670 0x7f4ce0065e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:13.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cdeffd700 1 -- 172.21.15.63:0/3484440865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ce0061670 msgr2=0x7f4ce0065e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:13.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ce0061670 0x7f4ce0065e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:13.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cdeffd700 1 -- 172.21.15.63:0/3484440865 >> v2:172.21.15.155:3300/0 conn(0x7f4ce0149e80 msgr2=0x7f4ce012efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:13.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/3484440865 >> v2:172.21.15.155:3300/0 conn(0x7f4ce0149e80 0x7f4ce012efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:13.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cdeffd700 1 -- 172.21.15.63:0/3484440865 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce0062830 con 0x7f4ce0060b90 2020-05-18T21:29:13.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cd67fc700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ce0061670 0x7f4ce0065e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:29:13.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/3484440865 >> v2:172.21.15.63:3300/0 conn(0x7f4ce0060b90 0x7f4ce0061b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4cd0002f70 tx=0x7f4cd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/3484440865 >> v2:172.21.15.63:3300/0 conn(0x7f4ce0060b90 0x7f4ce0061b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4cd0002f70 tx=0x7f4cd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce0060b90 0x7f4ce0061b20 secure :-1 s=READY pgs=713 cs=0 l=1 rx=0x7f4cd0002f70 tx=0x7f4cd0007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:13.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce0060b90 0x7f4ce0061b20 secure :-1 s=THROTTLE_DONE pgs=713 cs=0 l=1 rx=0x7f4cd0002f70 tx=0x7f4cd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce0060b90 0x7f4ce0061b20 secure :-1 s=THROTTLE_DONE pgs=713 cs=0 l=1 rx=0x7f4cd0002f70 tx=0x7f4cd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cdcff9700 1 -- 172.21.15.63:0/3484440865 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cd0007170 con 0x7f4ce0060b90 2020-05-18T21:29:13.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce0060b90 0x7f4ce0061b20 secure :-1 s=THROTTLE_DONE pgs=713 cs=0 l=1 rx=0x7f4cd0002f70 tx=0x7f4cd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cdcff9700 1 -- 172.21.15.63:0/3484440865 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd00072d0 con 0x7f4ce0060b90 2020-05-18T21:29:13.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4ce58ff700 1 -- 172.21.15.63:0/3484440865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce0142980 con 0x7f4ce0060b90 2020-05-18T21:29:13.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4cdcff9700 1 -- 172.21.15.63:0/3484440865 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cd0005700 con 0x7f4ce0060b90 2020-05-18T21:29:13.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.761+0000 7f4ce58ff700 1 -- 172.21.15.63:0/3484440865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce0064310 con 0x7f4ce0060b90 2020-05-18T21:29:13.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.765+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce0060b90 0x7f4ce0061b20 secure :-1 s=THROTTLE_DONE pgs=713 cs=0 l=1 rx=0x7f4cd0002f70 tx=0x7f4cd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.765+0000 7f4ce58ff700 1 -- 172.21.15.63:0/3484440865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce00569e0 con 0x7f4ce0060b90 2020-05-18T21:29:13.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.765+0000 7f4cdcff9700 1 -- 172.21.15.63:0/3484440865 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4cd00059c0 con 0x7f4ce0060b90 2020-05-18T21:29:13.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.765+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce0060b90 0x7f4ce0061b20 secure :-1 s=THROTTLE_DONE pgs=713 cs=0 l=1 rx=0x7f4cd0002f70 tx=0x7f4cd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.765+0000 7f4cdcff9700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4cc404fa30 0x7f4cc4051ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:13.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.765+0000 7f4cdcff9700 1 -- 172.21.15.63:0/3484440865 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4cd0064780 con 0x7f4ce0060b90 2020-05-18T21:29:13.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.765+0000 7f4cd67fc700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4cc404fa30 0x7f4cc4051ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:13.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.769+0000 7f4cd67fc700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4cc404fa30 0x7f4cc4051ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4cc8001110 tx=0x7f4cc8001860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.769+0000 7f4cd67fc700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4cc404fa30 0x7f4cc4051ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4cc8001110 tx=0x7f4cc8001860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.769+0000 7f4cd67fc700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4cc404fa30 0x7f4cc4051ef0 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7f4cc8001110 tx=0x7f4cc8001860).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:13.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.773+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce0060b90 0x7f4ce0061b20 secure :-1 s=THROTTLE_DONE pgs=713 cs=0 l=1 rx=0x7f4cd0002f70 tx=0x7f4cd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.773+0000 7f4cdcff9700 1 -- 172.21.15.63:0/3484440865 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f4cd003eab0 con 0x7f4ce0060b90 2020-05-18T21:29:13.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.889+0000 7f4ce58ff700 1 -- 172.21.15.63:0/3484440865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ce00b0c70 con 0x7f4ce0060b90 2020-05-18T21:29:13.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.889+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce0060b90 0x7f4ce0061b20 secure :-1 s=THROTTLE_DONE pgs=713 cs=0 l=1 rx=0x7f4cd0002f70 tx=0x7f4cd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:13.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.889+0000 7f4cdcff9700 1 -- 172.21.15.63:0/3484440865 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16092 (secure 0 0 0) 0x7f4cd00420d0 con 0x7f4ce0060b90 2020-05-18T21:29:13.897 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:13.897 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":61,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:29:11.178136+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:29:08.544924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2020-05-18T21:29:09.178610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:29:13.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.893+0000 7f4ce58ff700 1 -- 172.21.15.63:0/3484440865 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4cc404fa30 msgr2=0x7f4cc4051ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:13.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.893+0000 7f4ce58ff700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4cc404fa30 0x7f4cc4051ef0 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7f4cc8001110 tx=0x7f4cc8001860).stop 2020-05-18T21:29:13.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.893+0000 7f4ce58ff700 1 -- 172.21.15.63:0/3484440865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce0060b90 msgr2=0x7f4ce0061b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:13.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.893+0000 7f4ce58ff700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce0060b90 0x7f4ce0061b20 secure :-1 s=READY pgs=713 cs=0 l=1 rx=0x7f4cd0002f70 tx=0x7f4cd0007a80).stop 2020-05-18T21:29:13.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.893+0000 7f4ce58ff700 1 -- 172.21.15.63:0/3484440865 shutdown_connections 2020-05-18T21:29:13.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.893+0000 7f4ce58ff700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4cc404fa30 0x7f4cc4051ef0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:13.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.893+0000 7f4ce58ff700 1 --2- 172.21.15.63:0/3484440865 >> v2:172.21.15.155:3300/0 conn(0x7f4ce0149e80 0x7f4ce012efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:13.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.893+0000 7f4ce58ff700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ce0061670 0x7f4ce0065e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:13.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.893+0000 7f4ce58ff700 1 --2- 172.21.15.63:0/3484440865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce0060b90 0x7f4ce0061b20 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:13.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.893+0000 7f4ce58ff700 1 -- 172.21.15.63:0/3484440865 >> 172.21.15.63:0/3484440865 conn(0x7f4ce00b83d0 msgr2=0x7f4ce01494b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:13.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.893+0000 7f4ce58ff700 1 -- 172.21.15.63:0/3484440865 shutdown_connections 2020-05-18T21:29:13.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:13.893+0000 7f4ce58ff700 1 -- 172.21.15.63:0/3484440865 wait complete. 2020-05-18T21:29:13.910 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:29:08.544924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:29:09.178610+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:29:13.911 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:29:14.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.017+0000 7f4f3bfff700 1 Processor -- start 2020-05-18T21:29:14.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.017+0000 7f4f3bfff700 1 -- start start 2020-05-18T21:29:14.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4f3c0bc8d0 0x7f4f3c060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:14.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4f3c143630 0x7f4f3c12e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:14.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3bfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3c146420 con 0x7f4f3c145e30 2020-05-18T21:29:14.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c146e00 con 0x7f4f3c0bc8d0 2020-05-18T21:29:14.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c1466c0 con 0x7f4f3c143630 2020-05-18T21:29:14.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4f3c0bc8d0 0x7f4f3c060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4f3c0bc8d0 0x7f4f3c060b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56346/0 (socket says 172.21.15.63:56346) 2020-05-18T21:29:14.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3affd700 1 -- 172.21.15.63:0/2933807323 learned_addr learned my addr 172.21.15.63:0/2933807323 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:14.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3b7fe700 1 --2- 172.21.15.63:0/2933807323 >> v2:172.21.15.155:3300/0 conn(0x7f4f3c143630 0x7f4f3c12e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3affd700 1 -- 172.21.15.63:0/2933807323 >> v2:172.21.15.155:3300/0 conn(0x7f4f3c143630 msgr2=0x7f4f3c12e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:14.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3affd700 1 --2- 172.21.15.63:0/2933807323 >> v2:172.21.15.155:3300/0 conn(0x7f4f3c143630 0x7f4f3c12e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:14.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3affd700 1 -- 172.21.15.63:0/2933807323 >> v1:172.21.15.155:6789/0 conn(0x7f4f3c145e30 legacy=0x7f4f3c142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3affd700 1 -- 172.21.15.63:0/2933807323 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c146960 con 0x7f4f3c0bc8d0 2020-05-18T21:29:14.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3affd700 1 --2- 172.21.15.63:0/2933807323 >> v2:172.21.15.63:3300/0 conn(0x7f4f3c0bc8d0 0x7f4f3c060b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4f340032f0 tx=0x7f4f34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3affd700 1 --2- 172.21.15.63:0/2933807323 >> v2:172.21.15.63:3300/0 conn(0x7f4f3c0bc8d0 0x7f4f3c060b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4f340032f0 tx=0x7f4f34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3affd700 1 --2- 172.21.15.63:0/2933807323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f3c0bc8d0 0x7f4f3c060b00 secure :-1 s=READY pgs=714 cs=0 l=1 rx=0x7f4f340032f0 tx=0x7f4f34007e00).ready entity=mon.0 client_cookie=8edd6c121a50d14a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:14.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3affd700 1 --2- 172.21.15.63:0/2933807323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f3c0bc8d0 0x7f4f3c060b00 secure :-1 s=THROTTLE_DONE pgs=714 cs=0 l=1 rx=0x7f4f340032f0 tx=0x7f4f34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3affd700 1 --2- 172.21.15.63:0/2933807323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f3c0bc8d0 0x7f4f3c060b00 secure :-1 s=THROTTLE_DONE pgs=714 cs=0 l=1 rx=0x7f4f340032f0 tx=0x7f4f34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f39ffb700 1 -- 172.21.15.63:0/2933807323 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f34011d10 con 0x7f4f3c0bc8d0 2020-05-18T21:29:14.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3affd700 1 --2- 172.21.15.63:0/2933807323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f3c0bc8d0 0x7f4f3c060b00 secure :-1 s=THROTTLE_DONE pgs=714 cs=0 l=1 rx=0x7f4f340032f0 tx=0x7f4f34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f39ffb700 1 -- 172.21.15.63:0/2933807323 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f34011e70 con 0x7f4f3c0bc8d0 2020-05-18T21:29:14.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f39ffb700 1 -- 172.21.15.63:0/2933807323 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f3400a370 con 0x7f4f3c0bc8d0 2020-05-18T21:29:14.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3bfff700 1 -- 172.21.15.63:0/2933807323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f3c0bc8d0 msgr2=0x7f4f3c060b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3bfff700 1 --2- 172.21.15.63:0/2933807323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f3c0bc8d0 0x7f4f3c060b00 secure :-1 s=READY pgs=714 cs=0 l=1 rx=0x7f4f340032f0 tx=0x7f4f34007e00).stop 2020-05-18T21:29:14.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3bfff700 1 -- 172.21.15.63:0/2933807323 shutdown_connections 2020-05-18T21:29:14.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3bfff700 1 --2- 172.21.15.63:0/2933807323 >> v2:172.21.15.155:3300/0 conn(0x7f4f3c143630 0x7f4f3c12e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:14.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3bfff700 1 --2- 172.21.15.63:0/2933807323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f3c0bc8d0 0x7f4f3c060b00 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3bfff700 1 -- 172.21.15.63:0/2933807323 >> 172.21.15.63:0/2933807323 conn(0x7f4f3c05f3b0 msgr2=0x7f4f3c05f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:14.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3bfff700 1 -- 172.21.15.63:0/2933807323 shutdown_connections 2020-05-18T21:29:14.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.021+0000 7f4f3bfff700 1 -- 172.21.15.63:0/2933807323 wait complete. 2020-05-18T21:29:14.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3bfff700 1 Processor -- start 2020-05-18T21:29:14.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3bfff700 1 -- start start 2020-05-18T21:29:14.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4f3c143630 0x7f4f3c0acc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:14.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3bfff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3c13ebd0 con 0x7f4f3c0bc8d0 2020-05-18T21:29:14.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3bfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3c143a60 con 0x7f4f3c145e30 2020-05-18T21:29:14.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c0adc70 con 0x7f4f3c143630 2020-05-18T21:29:14.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3affd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4f3c0bc8d0 0x7f4f3c156a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58540/0 (socket says 172.21.15.63:58540) 2020-05-18T21:29:14.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3affd700 1 -- 172.21.15.63:0/567635048 learned_addr learned my addr 172.21.15.63:0/567635048 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:14.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3a7fc700 1 --2- 172.21.15.63:0/567635048 >> v2:172.21.15.155:3300/0 conn(0x7f4f3c143630 0x7f4f3c0acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f33fff700 1 -- 172.21.15.63:0/567635048 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788207637 0 0) 0x7f4f3c13ebd0 con 0x7f4f3c0bc8d0 2020-05-18T21:29:14.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f33fff700 1 -- 172.21.15.63:0/567635048 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f20002fe0 con 0x7f4f3c0bc8d0 2020-05-18T21:29:14.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f33fff700 1 -- 172.21.15.63:0/567635048 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2705794795 0 0) 0x7f4f20002fe0 con 0x7f4f3c0bc8d0 2020-05-18T21:29:14.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f33fff700 1 -- 172.21.15.63:0/567635048 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4f3c13ebd0 con 0x7f4f3c0bc8d0 2020-05-18T21:29:14.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f33fff700 1 -- 172.21.15.63:0/567635048 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f4f34008980 con 0x7f4f3c0bc8d0 2020-05-18T21:29:14.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f33fff700 1 -- 172.21.15.63:0/567635048 >> v2:172.21.15.155:3300/0 conn(0x7f4f3c143630 msgr2=0x7f4f3c0acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f33fff700 1 --2- 172.21.15.63:0/567635048 >> v2:172.21.15.155:3300/0 conn(0x7f4f3c143630 0x7f4f3c0acc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f33fff700 1 -- 172.21.15.63:0/567635048 >> v1:172.21.15.155:6789/0 conn(0x7f4f3c145e30 legacy=0x7f4f3c0ad0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f33fff700 1 -- 172.21.15.63:0/567635048 >> v1:172.21.15.63:6789/0 conn(0x7f4f3c0bc8d0 legacy=0x7f4f3c156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f33fff700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f20004ad0 0x7f4f20004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:14.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f33fff700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f200039a0 0x7f4f20003e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:14.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f33fff700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f20004280 0x7f4f2000b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:14.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f33fff700 1 -- 172.21.15.63:0/567635048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c0adc70 con 0x7f4f20004ad0 2020-05-18T21:29:14.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f33fff700 1 -- 172.21.15.63:0/567635048 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f20004870 con 0x7f4f200039a0 2020-05-18T21:29:14.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f33fff700 1 -- 172.21.15.63:0/567635048 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2000bc40 con 0x7f4f20004280 2020-05-18T21:29:14.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3affd700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f20004ad0 0x7f4f20004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3a7fc700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f200039a0 0x7f4f20003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3b7fe700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f20004280 0x7f4f2000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3affd700 1 -- 172.21.15.63:0/567635048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f20004280 msgr2=0x7f4f2000b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3affd700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f20004280 0x7f4f2000b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3affd700 1 -- 172.21.15.63:0/567635048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f200039a0 msgr2=0x7f4f20003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3affd700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f200039a0 0x7f4f20003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3affd700 1 -- 172.21.15.63:0/567635048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c13ee00 con 0x7f4f20004ad0 2020-05-18T21:29:14.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3b7fe700 1 -- 172.21.15.63:0/567635048 reap_dead start 2020-05-18T21:29:14.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3bfff700 1 -- 172.21.15.63:0/567635048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3c141150 con 0x7f4f20004ad0 2020-05-18T21:29:14.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3bfff700 1 -- 172.21.15.63:0/567635048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3c157300 con 0x7f4f20004ad0 2020-05-18T21:29:14.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.025+0000 7f4f3affd700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f20004ad0 0x7f4f20004ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4f340086a0 tx=0x7f4f34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.029+0000 7f4f3affd700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f20004ad0 0x7f4f20004ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4f340086a0 tx=0x7f4f34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.029+0000 7f4f3affd700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f20004ad0 0x7f4f20004ed0 secure :-1 s=READY pgs=716 cs=0 l=1 rx=0x7f4f340086a0 tx=0x7f4f34007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:14.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.029+0000 7f4f3affd700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f20004ad0 0x7f4f20004ed0 secure :-1 s=THROTTLE_DONE pgs=716 cs=0 l=1 rx=0x7f4f340086a0 tx=0x7f4f34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.029+0000 7f4f3affd700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f20004ad0 0x7f4f20004ed0 secure :-1 s=THROTTLE_DONE pgs=716 cs=0 l=1 rx=0x7f4f340086a0 tx=0x7f4f34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.029+0000 7f4f3affd700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f20004ad0 0x7f4f20004ed0 secure :-1 s=THROTTLE_DONE pgs=716 cs=0 l=1 rx=0x7f4f340086a0 tx=0x7f4f34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.029+0000 7f4f33fff700 1 -- 172.21.15.63:0/567635048 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f34005e60 con 0x7f4f20004ad0 2020-05-18T21:29:14.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.029+0000 7f4f33fff700 1 -- 172.21.15.63:0/567635048 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3400f770 con 0x7f4f20004ad0 2020-05-18T21:29:14.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.029+0000 7f4f33fff700 1 -- 172.21.15.63:0/567635048 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f3400fb50 con 0x7f4f20004ad0 2020-05-18T21:29:14.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.029+0000 7f4f3affd700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f20004ad0 0x7f4f20004ed0 secure :-1 s=THROTTLE_DONE pgs=716 cs=0 l=1 rx=0x7f4f340086a0 tx=0x7f4f34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.029+0000 7f4f3bfff700 1 -- 172.21.15.63:0/567635048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f14003380 con 0x7f4f20004ad0 2020-05-18T21:29:14.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.029+0000 7f4f33fff700 1 -- 172.21.15.63:0/567635048 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4f34007170 con 0x7f4f20004ad0 2020-05-18T21:29:14.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.029+0000 7f4f3affd700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f20004ad0 0x7f4f20004ed0 secure :-1 s=THROTTLE_DONE pgs=716 cs=0 l=1 rx=0x7f4f340086a0 tx=0x7f4f34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.029+0000 7f4f33fff700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f200539f0 0x7f4f20055eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:14.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.029+0000 7f4f33fff700 1 -- 172.21.15.63:0/567635048 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4f34064db0 con 0x7f4f20004ad0 2020-05-18T21:29:14.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.029+0000 7f4f3a7fc700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f200539f0 0x7f4f20055eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.029+0000 7f4f3a7fc700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f200539f0 0x7f4f20055eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4f3c0bc550 tx=0x7f4f3c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.029+0000 7f4f3a7fc700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f200539f0 0x7f4f20055eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4f3c0bc550 tx=0x7f4f3c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.029+0000 7f4f3a7fc700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f200539f0 0x7f4f20055eb0 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7f4f3c0bc550 tx=0x7f4f3c061d60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:14.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.037+0000 7f4f3affd700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f20004ad0 0x7f4f20004ed0 secure :-1 s=THROTTLE_DONE pgs=716 cs=0 l=1 rx=0x7f4f340086a0 tx=0x7f4f34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.037+0000 7f4f33fff700 1 -- 172.21.15.63:0/567635048 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f4f3403f160 con 0x7f4f20004ad0 2020-05-18T21:29:14.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.149+0000 7f4f3bfff700 1 -- 172.21.15.63:0/567635048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4f14002260 con 0x7f4f20004ad0 2020-05-18T21:29:14.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.153+0000 7f4f3affd700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f20004ad0 0x7f4f20004ed0 secure :-1 s=THROTTLE_DONE pgs=716 cs=0 l=1 rx=0x7f4f340086a0 tx=0x7f4f34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.153+0000 7f4f33fff700 1 -- 172.21.15.63:0/567635048 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v61) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4f34042780 con 0x7f4f20004ad0 2020-05-18T21:29:14.158 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:29:14.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.153+0000 7f4f3bfff700 1 -- 172.21.15.63:0/567635048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f200539f0 msgr2=0x7f4f20055eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.153+0000 7f4f3bfff700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f200539f0 0x7f4f20055eb0 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7f4f3c0bc550 tx=0x7f4f3c061d60).stop 2020-05-18T21:29:14.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.153+0000 7f4f3bfff700 1 -- 172.21.15.63:0/567635048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f20004ad0 msgr2=0x7f4f20004ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.153+0000 7f4f3bfff700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f20004ad0 0x7f4f20004ed0 secure :-1 s=READY pgs=716 cs=0 l=1 rx=0x7f4f340086a0 tx=0x7f4f34007e00).stop 2020-05-18T21:29:14.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.153+0000 7f4f3bfff700 1 -- 172.21.15.63:0/567635048 shutdown_connections 2020-05-18T21:29:14.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.153+0000 7f4f3bfff700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f200539f0 0x7f4f20055eb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.153+0000 7f4f3bfff700 1 --2- 172.21.15.63:0/567635048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f20004ad0 0x7f4f20004ed0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.153+0000 7f4f3bfff700 1 -- 172.21.15.63:0/567635048 >> 172.21.15.63:0/567635048 conn(0x7f4f3c05f3b0 msgr2=0x7f4f3c0bbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:14.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.153+0000 7f4f3bfff700 1 -- 172.21.15.63:0/567635048 shutdown_connections 2020-05-18T21:29:14.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.153+0000 7f4f3bfff700 1 -- 172.21.15.63:0/567635048 wait complete. 2020-05-18T21:29:14.171 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:29:14.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.273+0000 7f1fb7fff700 1 Processor -- start 2020-05-18T21:29:14.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.273+0000 7f1fb7fff700 1 -- start start 2020-05-18T21:29:14.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1fb7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1fb805ebf0 0x7f1fb80b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:14.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1fb7fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb80b3bf0 con 0x7f1fb80b44f0 2020-05-18T21:29:14.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1fb7fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb80adb10 con 0x7f1fb80ad730 2020-05-18T21:29:14.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1fb7fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb80b2990 con 0x7f1fb805ebf0 2020-05-18T21:29:14.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1faffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1fb805ebf0 0x7f1fb80b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1fb77fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1fb80b44f0 0x7f1fb80b4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58558/0 (socket says 172.21.15.63:58558) 2020-05-18T21:29:14.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1fb77fe700 1 -- 172.21.15.63:0/3406017618 learned_addr learned my addr 172.21.15.63:0/3406017618 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:14.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1faffff700 1 -- 172.21.15.63:0/3406017618 >> v1:172.21.15.155:6789/0 conn(0x7f1fb80ad730 legacy=0x7f1fb8145570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1faffff700 1 -- 172.21.15.63:0/3406017618 >> v1:172.21.15.63:6789/0 conn(0x7f1fb80b44f0 legacy=0x7f1fb80b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1faffff700 1 -- 172.21.15.63:0/3406017618 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb80b2ca0 con 0x7f1fb805ebf0 2020-05-18T21:29:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1fb67fc700 1 -- 172.21.15.63:0/3406017618 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188104610 0 0) 0x7f1fb80b3bf0 con 0x7f1fb80b44f0 2020-05-18T21:29:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1faffff700 1 --2- 172.21.15.63:0/3406017618 >> v2:172.21.15.63:3300/0 conn(0x7f1fb805ebf0 0x7f1fb80b4090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1fa0002f70 tx=0x7f1fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1faffff700 1 --2- 172.21.15.63:0/3406017618 >> v2:172.21.15.63:3300/0 conn(0x7f1fb805ebf0 0x7f1fb80b4090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1fa0002f70 tx=0x7f1fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1faffff700 1 --2- 172.21.15.63:0/3406017618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1fb805ebf0 0x7f1fb80b4090 secure :-1 s=READY pgs=718 cs=0 l=1 rx=0x7f1fa0002f70 tx=0x7f1fa0007a80).ready entity=mon.0 client_cookie=689a4dfd3284f76 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1faffff700 1 --2- 172.21.15.63:0/3406017618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1fb805ebf0 0x7f1fb80b4090 secure :-1 s=THROTTLE_DONE pgs=718 cs=0 l=1 rx=0x7f1fa0002f70 tx=0x7f1fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1fb67fc700 1 -- 172.21.15.63:0/3406017618 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fa0008e80 con 0x7f1fb805ebf0 2020-05-18T21:29:14.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1faffff700 1 --2- 172.21.15.63:0/3406017618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1fb805ebf0 0x7f1fb80b4090 secure :-1 s=THROTTLE_DONE pgs=718 cs=0 l=1 rx=0x7f1fa0002f70 tx=0x7f1fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1fb67fc700 1 -- 172.21.15.63:0/3406017618 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa00116a0 con 0x7f1fb805ebf0 2020-05-18T21:29:14.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1faffff700 1 --2- 172.21.15.63:0/3406017618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1fb805ebf0 0x7f1fb80b4090 secure :-1 s=THROTTLE_DONE pgs=718 cs=0 l=1 rx=0x7f1fa0002f70 tx=0x7f1fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1fb67fc700 1 -- 172.21.15.63:0/3406017618 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fa0011ac0 con 0x7f1fb805ebf0 2020-05-18T21:29:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1fb7fff700 1 -- 172.21.15.63:0/3406017618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1fb805ebf0 msgr2=0x7f1fb80b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1fb7fff700 1 --2- 172.21.15.63:0/3406017618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1fb805ebf0 0x7f1fb80b4090 secure :-1 s=READY pgs=718 cs=0 l=1 rx=0x7f1fa0002f70 tx=0x7f1fa0007a80).stop 2020-05-18T21:29:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1fb7fff700 1 -- 172.21.15.63:0/3406017618 shutdown_connections 2020-05-18T21:29:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1fb7fff700 1 --2- 172.21.15.63:0/3406017618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1fb805ebf0 0x7f1fb80b4090 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1fb7fff700 1 -- 172.21.15.63:0/3406017618 >> 172.21.15.63:0/3406017618 conn(0x7f1fb805fb90 msgr2=0x7f1fb8069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1fb7fff700 1 -- 172.21.15.63:0/3406017618 shutdown_connections 2020-05-18T21:29:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.277+0000 7f1fb7fff700 1 -- 172.21.15.63:0/3406017618 wait complete. 2020-05-18T21:29:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1fb7fff700 1 Processor -- start 2020-05-18T21:29:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1fb7fff700 1 -- start start 2020-05-18T21:29:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1fb7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1fb805ebf0 0x7f1fb80b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1fb7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1fb80ad730 0x7f1fb8154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1fb7fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb8137130 con 0x7f1fb80b44f0 2020-05-18T21:29:14.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1fb7fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb8153740 con 0x7f1fb80ad730 2020-05-18T21:29:14.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1fb7fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb81539e0 con 0x7f1fb805ebf0 2020-05-18T21:29:14.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1faffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1fb80ad730 0x7f1fb8154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1faffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1fb80ad730 0x7f1fb8154120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56372/0 (socket says 172.21.15.63:56372) 2020-05-18T21:29:14.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1faffff700 1 -- 172.21.15.63:0/2972189611 learned_addr learned my addr 172.21.15.63:0/2972189611 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:14.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1fb6ffd700 1 --2- 172.21.15.63:0/2972189611 >> v2:172.21.15.155:3300/0 conn(0x7f1fb805ebf0 0x7f1fb80b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1faffff700 1 -- 172.21.15.63:0/2972189611 >> v2:172.21.15.155:3300/0 conn(0x7f1fb805ebf0 msgr2=0x7f1fb80b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1faffff700 1 --2- 172.21.15.63:0/2972189611 >> v2:172.21.15.155:3300/0 conn(0x7f1fb805ebf0 0x7f1fb80b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1faffff700 1 -- 172.21.15.63:0/2972189611 >> v1:172.21.15.155:6789/0 conn(0x7f1fb80b44f0 legacy=0x7f1fb8135b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1faffff700 1 -- 172.21.15.63:0/2972189611 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb8153c80 con 0x7f1fb80ad730 2020-05-18T21:29:14.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1fb6ffd700 1 --2- 172.21.15.63:0/2972189611 >> v2:172.21.15.155:3300/0 conn(0x7f1fb805ebf0 0x7f1fb80b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:29:14.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1faffff700 1 --2- 172.21.15.63:0/2972189611 >> v2:172.21.15.63:3300/0 conn(0x7f1fb80ad730 0x7f1fb8154120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1fa0002f70 tx=0x7f1fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1faffff700 1 --2- 172.21.15.63:0/2972189611 >> v2:172.21.15.63:3300/0 conn(0x7f1fb80ad730 0x7f1fb8154120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1fa0002f70 tx=0x7f1fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1faffff700 1 --2- 172.21.15.63:0/2972189611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1fb80ad730 0x7f1fb8154120 secure :-1 s=READY pgs=719 cs=0 l=1 rx=0x7f1fa0002f70 tx=0x7f1fa0007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:14.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1faffff700 1 --2- 172.21.15.63:0/2972189611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1fb80ad730 0x7f1fb8154120 secure :-1 s=THROTTLE_DONE pgs=719 cs=0 l=1 rx=0x7f1fa0002f70 tx=0x7f1fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1faffff700 1 --2- 172.21.15.63:0/2972189611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1fb80ad730 0x7f1fb8154120 secure :-1 s=THROTTLE_DONE pgs=719 cs=0 l=1 rx=0x7f1fa0002f70 tx=0x7f1fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1fb4ff9700 1 -- 172.21.15.63:0/2972189611 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fa0007360 con 0x7f1fb80ad730 2020-05-18T21:29:14.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1faffff700 1 --2- 172.21.15.63:0/2972189611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1fb80ad730 0x7f1fb8154120 secure :-1 s=THROTTLE_DONE pgs=719 cs=0 l=1 rx=0x7f1fa0002f70 tx=0x7f1fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1fb4ff9700 1 -- 172.21.15.63:0/2972189611 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa00074c0 con 0x7f1fb80ad730 2020-05-18T21:29:14.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1fb7fff700 1 -- 172.21.15.63:0/2972189611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb8136230 con 0x7f1fb80ad730 2020-05-18T21:29:14.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1fb4ff9700 1 -- 172.21.15.63:0/2972189611 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fa00058f0 con 0x7f1fb80ad730 2020-05-18T21:29:14.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1fb7fff700 1 -- 172.21.15.63:0/2972189611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb8112840 con 0x7f1fb80ad730 2020-05-18T21:29:14.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.281+0000 7f1faffff700 1 --2- 172.21.15.63:0/2972189611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1fb80ad730 0x7f1fb8154120 secure :-1 s=THROTTLE_DONE pgs=719 cs=0 l=1 rx=0x7f1fa0002f70 tx=0x7f1fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.285+0000 7f1fb7fff700 1 -- 172.21.15.63:0/2972189611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb8153e10 con 0x7f1fb80ad730 2020-05-18T21:29:14.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.285+0000 7f1fb4ff9700 1 -- 172.21.15.63:0/2972189611 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1fa0005b60 con 0x7f1fb80ad730 2020-05-18T21:29:14.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.285+0000 7f1faffff700 1 --2- 172.21.15.63:0/2972189611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1fb80ad730 0x7f1fb8154120 secure :-1 s=THROTTLE_DONE pgs=719 cs=0 l=1 rx=0x7f1fa0002f70 tx=0x7f1fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.285+0000 7f1fb4ff9700 1 --2- 172.21.15.63:0/2972189611 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f9c04fa30 0x7f1f9c051ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:14.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.285+0000 7f1fb4ff9700 1 -- 172.21.15.63:0/2972189611 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1fa0064850 con 0x7f1fb80ad730 2020-05-18T21:29:14.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.285+0000 7f1fb6ffd700 1 --2- 172.21.15.63:0/2972189611 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f9c04fa30 0x7f1f9c051ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.285+0000 7f1fb6ffd700 1 --2- 172.21.15.63:0/2972189611 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f9c04fa30 0x7f1f9c051ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1fb8069480 tx=0x7f1fa80017d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.285+0000 7f1fb6ffd700 1 --2- 172.21.15.63:0/2972189611 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f9c04fa30 0x7f1f9c051ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1fb8069480 tx=0x7f1fa80017d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.285+0000 7f1fb6ffd700 1 --2- 172.21.15.63:0/2972189611 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f9c04fa30 0x7f1f9c051ef0 secure :-1 s=READY pgs=292 cs=0 l=1 rx=0x7f1fb8069480 tx=0x7f1fa80017d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:14.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.293+0000 7f1faffff700 1 --2- 172.21.15.63:0/2972189611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1fb80ad730 0x7f1fb8154120 secure :-1 s=THROTTLE_DONE pgs=719 cs=0 l=1 rx=0x7f1fa0002f70 tx=0x7f1fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.293+0000 7f1fb4ff9700 1 -- 172.21.15.63:0/2972189611 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f1fa003eca0 con 0x7f1fb80ad730 2020-05-18T21:29:14.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.409+0000 7f1fb7fff700 1 -- 172.21.15.63:0/2972189611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1fb80569e0 con 0x7f1fb80ad730 2020-05-18T21:29:14.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.413+0000 7f1faffff700 1 --2- 172.21.15.63:0/2972189611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1fb80ad730 0x7f1fb8154120 secure :-1 s=THROTTLE_DONE pgs=719 cs=0 l=1 rx=0x7f1fa0002f70 tx=0x7f1fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.413+0000 7f1fb4ff9700 1 -- 172.21.15.63:0/2972189611 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v61) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1fa00422c0 con 0x7f1fb80ad730 2020-05-18T21:29:14.418 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:29:14.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.413+0000 7f1fb7fff700 1 -- 172.21.15.63:0/2972189611 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f9c04fa30 msgr2=0x7f1f9c051ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.413+0000 7f1fb7fff700 1 --2- 172.21.15.63:0/2972189611 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f9c04fa30 0x7f1f9c051ef0 secure :-1 s=READY pgs=292 cs=0 l=1 rx=0x7f1fb8069480 tx=0x7f1fa80017d0).stop 2020-05-18T21:29:14.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.413+0000 7f1fb7fff700 1 -- 172.21.15.63:0/2972189611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1fb80ad730 msgr2=0x7f1fb8154120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.413+0000 7f1fb7fff700 1 --2- 172.21.15.63:0/2972189611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1fb80ad730 0x7f1fb8154120 secure :-1 s=READY pgs=719 cs=0 l=1 rx=0x7f1fa0002f70 tx=0x7f1fa0007a80).stop 2020-05-18T21:29:14.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.413+0000 7f1fb7fff700 1 -- 172.21.15.63:0/2972189611 shutdown_connections 2020-05-18T21:29:14.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.413+0000 7f1fb7fff700 1 --2- 172.21.15.63:0/2972189611 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f9c04fa30 0x7f1f9c051ef0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.413+0000 7f1fb7fff700 1 --2- 172.21.15.63:0/2972189611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1fb80ad730 0x7f1fb8154120 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.413+0000 7f1fb7fff700 1 --2- 172.21.15.63:0/2972189611 >> v2:172.21.15.155:3300/0 conn(0x7f1fb805ebf0 0x7f1fb80b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.413+0000 7f1fb7fff700 1 -- 172.21.15.63:0/2972189611 >> 172.21.15.63:0/2972189611 conn(0x7f1fb805fb90 msgr2=0x7f1fb8142dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:14.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.413+0000 7f1fb7fff700 1 -- 172.21.15.63:0/2972189611 shutdown_connections 2020-05-18T21:29:14.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.413+0000 7f1fb7fff700 1 -- 172.21.15.63:0/2972189611 wait complete. 2020-05-18T21:29:14.430 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:29:14.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.525+0000 7f8e4202c700 1 Processor -- start 2020-05-18T21:29:14.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e4202c700 1 -- start start 2020-05-18T21:29:14.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e4202c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8e3c0b8ed0 0x7f8e3c064860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:14.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e4202c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8e3c064cc0 0x7f8e3c149880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:14.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e4202c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3c0b4b00 con 0x7f8e3c0b50b0 2020-05-18T21:29:14.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e4202c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3c0622f0 con 0x7f8e3c0b8ed0 2020-05-18T21:29:14.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e4202c700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3c065ec0 con 0x7f8e3c064cc0 2020-05-18T21:29:14.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e3affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8e3c0b8ed0 0x7f8e3c064860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e3b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8e3c0b50b0 0x7f8e3c061be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58568/0 (socket says 172.21.15.63:58568) 2020-05-18T21:29:14.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e3affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8e3c0b8ed0 0x7f8e3c064860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56382/0 (socket says 172.21.15.63:56382) 2020-05-18T21:29:14.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e3b7fe700 1 -- 172.21.15.63:0/31774096 learned_addr learned my addr 172.21.15.63:0/31774096 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:14.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e3bfff700 1 --2- 172.21.15.63:0/31774096 >> v2:172.21.15.155:3300/0 conn(0x7f8e3c064cc0 0x7f8e3c149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e3affd700 1 -- 172.21.15.63:0/31774096 >> v2:172.21.15.155:3300/0 conn(0x7f8e3c064cc0 msgr2=0x7f8e3c149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:14.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e3affd700 1 --2- 172.21.15.63:0/31774096 >> v2:172.21.15.155:3300/0 conn(0x7f8e3c064cc0 0x7f8e3c149880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:14.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e3a7fc700 1 -- 172.21.15.63:0/31774096 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359053913 0 0) 0x7f8e2c001290 con 0x7f8e3c0b50b0 2020-05-18T21:29:14.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e3affd700 1 -- 172.21.15.63:0/31774096 >> v1:172.21.15.63:6789/0 conn(0x7f8e3c0b50b0 legacy=0x7f8e3c061be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e3affd700 1 -- 172.21.15.63:0/31774096 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c066160 con 0x7f8e3c0b8ed0 2020-05-18T21:29:14.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e3affd700 1 --2- 172.21.15.63:0/31774096 >> v2:172.21.15.63:3300/0 conn(0x7f8e3c0b8ed0 0x7f8e3c064860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8e24002f70 tx=0x7f8e24007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e3affd700 1 --2- 172.21.15.63:0/31774096 >> v2:172.21.15.63:3300/0 conn(0x7f8e3c0b8ed0 0x7f8e3c064860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8e24002f70 tx=0x7f8e24007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e3affd700 1 --2- 172.21.15.63:0/31774096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e3c0b8ed0 0x7f8e3c064860 secure :-1 s=READY pgs=721 cs=0 l=1 rx=0x7f8e24002f70 tx=0x7f8e24007a80).ready entity=mon.0 client_cookie=536001163a503020 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:14.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e3affd700 1 --2- 172.21.15.63:0/31774096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e3c0b8ed0 0x7f8e3c064860 secure :-1 s=THROTTLE_DONE pgs=721 cs=0 l=1 rx=0x7f8e24002f70 tx=0x7f8e24007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e3a7fc700 1 -- 172.21.15.63:0/31774096 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e24008e50 con 0x7f8e3c0b8ed0 2020-05-18T21:29:14.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e3affd700 1 --2- 172.21.15.63:0/31774096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e3c0b8ed0 0x7f8e3c064860 secure :-1 s=THROTTLE_DONE pgs=721 cs=0 l=1 rx=0x7f8e24002f70 tx=0x7f8e24007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e3affd700 1 --2- 172.21.15.63:0/31774096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e3c0b8ed0 0x7f8e3c064860 secure :-1 s=THROTTLE_DONE pgs=721 cs=0 l=1 rx=0x7f8e24002f70 tx=0x7f8e24007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e3a7fc700 1 -- 172.21.15.63:0/31774096 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e240116a0 con 0x7f8e3c0b8ed0 2020-05-18T21:29:14.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e3a7fc700 1 -- 172.21.15.63:0/31774096 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e24011a80 con 0x7f8e3c0b8ed0 2020-05-18T21:29:14.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e4202c700 1 -- 172.21.15.63:0/31774096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e3c0b8ed0 msgr2=0x7f8e3c064860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e4202c700 1 --2- 172.21.15.63:0/31774096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e3c0b8ed0 0x7f8e3c064860 secure :-1 s=READY pgs=721 cs=0 l=1 rx=0x7f8e24002f70 tx=0x7f8e24007a80).stop 2020-05-18T21:29:14.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e4202c700 1 -- 172.21.15.63:0/31774096 shutdown_connections 2020-05-18T21:29:14.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e4202c700 1 --2- 172.21.15.63:0/31774096 >> v2:172.21.15.155:3300/0 conn(0x7f8e3c064cc0 0x7f8e3c149880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:14.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e4202c700 1 --2- 172.21.15.63:0/31774096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e3c0b8ed0 0x7f8e3c064860 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e4202c700 1 -- 172.21.15.63:0/31774096 >> 172.21.15.63:0/31774096 conn(0x7f8e3c0b83b0 msgr2=0x7f8e3c0b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:14.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e4202c700 1 -- 172.21.15.63:0/31774096 shutdown_connections 2020-05-18T21:29:14.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.529+0000 7f8e4202c700 1 -- 172.21.15.63:0/31774096 wait complete. 2020-05-18T21:29:14.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e4202c700 1 Processor -- start 2020-05-18T21:29:14.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e4202c700 1 -- start start 2020-05-18T21:29:14.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e4202c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8e3c0b50b0 0x7f8e3c1453c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:14.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e4202c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3c13cf90 con 0x7f8e3c064cc0 2020-05-18T21:29:14.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e4202c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3c0b2ce0 con 0x7f8e3c0b8ed0 2020-05-18T21:29:14.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e4202c700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3c0b2ff0 con 0x7f8e3c0b50b0 2020-05-18T21:29:14.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e3b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8e3c064cc0 0x7f8e3c0ad3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58574/0 (socket says 172.21.15.63:58574) 2020-05-18T21:29:14.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e3b7fe700 1 -- 172.21.15.63:0/2770104864 learned_addr learned my addr 172.21.15.63:0/2770104864 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:14.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e3affd700 1 --2- 172.21.15.63:0/2770104864 >> v2:172.21.15.155:3300/0 conn(0x7f8e3c0b50b0 0x7f8e3c1453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e38ff9700 1 -- 172.21.15.63:0/2770104864 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854406422 0 0) 0x7f8e3c13cf90 con 0x7f8e3c064cc0 2020-05-18T21:29:14.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e38ff9700 1 -- 172.21.15.63:0/2770104864 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e20002fe0 con 0x7f8e3c064cc0 2020-05-18T21:29:14.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e38ff9700 1 -- 172.21.15.63:0/2770104864 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1406057369 0 0) 0x7f8e20002fe0 con 0x7f8e3c064cc0 2020-05-18T21:29:14.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e38ff9700 1 -- 172.21.15.63:0/2770104864 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8e3c13cf90 con 0x7f8e3c064cc0 2020-05-18T21:29:14.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e38ff9700 1 -- 172.21.15.63:0/2770104864 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f8e2c001bb0 con 0x7f8e3c064cc0 2020-05-18T21:29:14.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e38ff9700 1 -- 172.21.15.63:0/2770104864 >> v2:172.21.15.155:3300/0 conn(0x7f8e3c0b50b0 msgr2=0x7f8e3c1453c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e38ff9700 1 --2- 172.21.15.63:0/2770104864 >> v2:172.21.15.155:3300/0 conn(0x7f8e3c0b50b0 0x7f8e3c1453c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e38ff9700 1 -- 172.21.15.63:0/2770104864 >> v1:172.21.15.155:6789/0 conn(0x7f8e3c0b8ed0 legacy=0x7f8e3c143ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e38ff9700 1 -- 172.21.15.63:0/2770104864 >> v1:172.21.15.63:6789/0 conn(0x7f8e3c064cc0 legacy=0x7f8e3c0ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e38ff9700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e20004a80 0x7f8e20004e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:14.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e38ff9700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e200039a0 0x7f8e20003de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:14.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e38ff9700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e20004240 0x7f8e2000b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:14.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e38ff9700 1 -- 172.21.15.63:0/2770104864 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c0b2ff0 con 0x7f8e20004240 2020-05-18T21:29:14.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e38ff9700 1 -- 172.21.15.63:0/2770104864 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e20004750 con 0x7f8e20004a80 2020-05-18T21:29:14.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.533+0000 7f8e38ff9700 1 -- 172.21.15.63:0/2770104864 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2000bbc0 con 0x7f8e200039a0 2020-05-18T21:29:14.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e3bfff700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e20004240 0x7f8e2000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e3affd700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e200039a0 0x7f8e20003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e3b7fe700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e20004a80 0x7f8e20004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e3bfff700 1 -- 172.21.15.63:0/2770104864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e200039a0 msgr2=0x7f8e20003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e3bfff700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e200039a0 0x7f8e20003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e3bfff700 1 -- 172.21.15.63:0/2770104864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e20004a80 msgr2=0x7f8e20004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e3bfff700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e20004a80 0x7f8e20004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e3bfff700 1 -- 172.21.15.63:0/2770104864 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c0b3290 con 0x7f8e20004240 2020-05-18T21:29:14.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e4202c700 1 -- 172.21.15.63:0/2770104864 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3c144600 con 0x7f8e20004240 2020-05-18T21:29:14.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e4202c700 1 -- 172.21.15.63:0/2770104864 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3c0af690 con 0x7f8e20004240 2020-05-18T21:29:14.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e3bfff700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e20004240 0x7f8e2000b760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8e3c1577c0 tx=0x7f8e34010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e3bfff700 1 -- 172.21.15.63:0/2770104864 reap_dead start 2020-05-18T21:29:14.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e3bfff700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e20004240 0x7f8e2000b760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8e3c1577c0 tx=0x7f8e34010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e3bfff700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e20004240 0x7f8e2000b760 secure :-1 s=READY pgs=723 cs=0 l=1 rx=0x7f8e3c1577c0 tx=0x7f8e34010e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:14.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e3bfff700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e20004240 0x7f8e2000b760 secure :-1 s=THROTTLE_DONE pgs=723 cs=0 l=1 rx=0x7f8e3c1577c0 tx=0x7f8e34010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e38ff9700 1 -- 172.21.15.63:0/2770104864 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e34005a80 con 0x7f8e20004240 2020-05-18T21:29:14.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e3bfff700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e20004240 0x7f8e2000b760 secure :-1 s=THROTTLE_DONE pgs=723 cs=0 l=1 rx=0x7f8e3c1577c0 tx=0x7f8e34010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e38ff9700 1 -- 172.21.15.63:0/2770104864 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e34005be0 con 0x7f8e20004240 2020-05-18T21:29:14.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e3bfff700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e20004240 0x7f8e2000b760 secure :-1 s=THROTTLE_DONE pgs=723 cs=0 l=1 rx=0x7f8e3c1577c0 tx=0x7f8e34010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e38ff9700 1 -- 172.21.15.63:0/2770104864 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e3400e8e0 con 0x7f8e20004240 2020-05-18T21:29:14.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e4202c700 1 -- 172.21.15.63:0/2770104864 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e14003380 con 0x7f8e20004240 2020-05-18T21:29:14.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e3bfff700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e20004240 0x7f8e2000b760 secure :-1 s=THROTTLE_DONE pgs=723 cs=0 l=1 rx=0x7f8e3c1577c0 tx=0x7f8e34010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e38ff9700 1 -- 172.21.15.63:0/2770104864 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8e3400ea40 con 0x7f8e20004240 2020-05-18T21:29:14.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.537+0000 7f8e3bfff700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e20004240 0x7f8e2000b760 secure :-1 s=THROTTLE_DONE pgs=723 cs=0 l=1 rx=0x7f8e3c1577c0 tx=0x7f8e34010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.541+0000 7f8e38ff9700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8e20053880 0x7f8e20055d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:14.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.541+0000 7f8e38ff9700 1 -- 172.21.15.63:0/2770104864 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8e340637f0 con 0x7f8e20004240 2020-05-18T21:29:14.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.541+0000 7f8e3b7fe700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8e20053880 0x7f8e20055d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.541+0000 7f8e3b7fe700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8e20053880 0x7f8e20055d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8e2c001240 tx=0x7f8e3c05b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.541+0000 7f8e3b7fe700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8e20053880 0x7f8e20055d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8e2c001240 tx=0x7f8e3c05b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.541+0000 7f8e3b7fe700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8e20053880 0x7f8e20055d40 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7f8e2c001240 tx=0x7f8e3c05b560).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:14.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.545+0000 7f8e3bfff700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e20004240 0x7f8e2000b760 secure :-1 s=THROTTLE_DONE pgs=723 cs=0 l=1 rx=0x7f8e3c1577c0 tx=0x7f8e34010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.545+0000 7f8e38ff9700 1 -- 172.21.15.63:0/2770104864 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f8e3403dc40 con 0x7f8e20004240 2020-05-18T21:29:14.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.661+0000 7f8e4202c700 1 -- 172.21.15.63:0/2770104864 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e14002240 con 0x7f8e20004240 2020-05-18T21:29:14.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.665+0000 7f8e3bfff700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e20004240 0x7f8e2000b760 secure :-1 s=THROTTLE_DONE pgs=723 cs=0 l=1 rx=0x7f8e3c1577c0 tx=0x7f8e34010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.665+0000 7f8e38ff9700 1 -- 172.21.15.63:0/2770104864 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8e34041260 con 0x7f8e20004240 2020-05-18T21:29:14.670 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:29:14.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.665+0000 7f8e4202c700 1 -- 172.21.15.63:0/2770104864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8e20053880 msgr2=0x7f8e20055d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.665+0000 7f8e4202c700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8e20053880 0x7f8e20055d40 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7f8e2c001240 tx=0x7f8e3c05b560).stop 2020-05-18T21:29:14.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.665+0000 7f8e4202c700 1 -- 172.21.15.63:0/2770104864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e20004240 msgr2=0x7f8e2000b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.665+0000 7f8e4202c700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e20004240 0x7f8e2000b760 secure :-1 s=READY pgs=723 cs=0 l=1 rx=0x7f8e3c1577c0 tx=0x7f8e34010e60).stop 2020-05-18T21:29:14.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.665+0000 7f8e4202c700 1 -- 172.21.15.63:0/2770104864 shutdown_connections 2020-05-18T21:29:14.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.665+0000 7f8e4202c700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8e20053880 0x7f8e20055d40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.665+0000 7f8e4202c700 1 --2- 172.21.15.63:0/2770104864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e20004240 0x7f8e2000b760 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.665+0000 7f8e4202c700 1 -- 172.21.15.63:0/2770104864 >> 172.21.15.63:0/2770104864 conn(0x7f8e3c0b83b0 msgr2=0x7f8e3c060590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:14.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.665+0000 7f8e4202c700 1 -- 172.21.15.63:0/2770104864 shutdown_connections 2020-05-18T21:29:14.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.665+0000 7f8e4202c700 1 -- 172.21.15.63:0/2770104864 wait complete. 2020-05-18T21:29:14.682 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:29:14.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5afd46700 1 Processor -- start 2020-05-18T21:29:14.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5afd46700 1 -- start start 2020-05-18T21:29:14.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5afd46700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5a809b0b0 0x7fd5a80b3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5afd46700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd5a8146490 0x7fd5a8146920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5afd46700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a80b5590 con 0x7fd5a80aef00 2020-05-18T21:29:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5afd46700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a80b3c00 con 0x7fd5a8146490 2020-05-18T21:29:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5afd46700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a80b3ea0 con 0x7fd5a809b0b0 2020-05-18T21:29:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5adae2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5a809b0b0 0x7fd5a80b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5ae2e3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd5a8146490 0x7fd5a8146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5ae2e3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd5a8146490 0x7fd5a8146920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:43018/0 (socket says 172.21.15.63:43018) 2020-05-18T21:29:14.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5ae2e3700 1 -- 172.21.15.63:0/1510579424 learned_addr learned my addr 172.21.15.63:0/1510579424 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:14.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5adae2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5a809b0b0 0x7fd5a80b3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:47102/0 (socket says 172.21.15.63:47102) 2020-05-18T21:29:14.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5ae2e3700 1 -- 172.21.15.63:0/1510579424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5a809b0b0 msgr2=0x7fd5a80b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5ae2e3700 1 --2- 172.21.15.63:0/1510579424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5a809b0b0 0x7fd5a80b3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5ae2e3700 1 -- 172.21.15.63:0/1510579424 >> v1:172.21.15.155:6789/0 conn(0x7fd5a80aef00 legacy=0x7fd5a80b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5ae2e3700 1 -- 172.21.15.63:0/1510579424 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a80b4140 con 0x7fd5a8146490 2020-05-18T21:29:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5adae2700 1 --2- 172.21.15.63:0/1510579424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5a809b0b0 0x7fd5a80b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:29:14.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5ae2e3700 1 --2- 172.21.15.63:0/1510579424 >> v2:172.21.15.155:3300/0 conn(0x7fd5a8146490 0x7fd5a8146920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd5a00032f0 tx=0x7fd5a0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5ae2e3700 1 --2- 172.21.15.63:0/1510579424 >> v2:172.21.15.155:3300/0 conn(0x7fd5a8146490 0x7fd5a8146920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd5a00032f0 tx=0x7fd5a0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5ae2e3700 1 --2- 172.21.15.63:0/1510579424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5a8146490 0x7fd5a8146920 secure :-1 s=READY pgs=518 cs=0 l=1 rx=0x7fd5a00032f0 tx=0x7fd5a0007e00).ready entity=mon.1 client_cookie=7a96a07583a84874 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:14.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5ae2e3700 1 --2- 172.21.15.63:0/1510579424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5a8146490 0x7fd5a8146920 secure :-1 s=THROTTLE_DONE pgs=518 cs=0 l=1 rx=0x7fd5a00032f0 tx=0x7fd5a0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5acae0700 1 -- 172.21.15.63:0/1510579424 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5a000a180 con 0x7fd5a8146490 2020-05-18T21:29:14.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.789+0000 7fd5ae2e3700 1 --2- 172.21.15.63:0/1510579424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5a8146490 0x7fd5a8146920 secure :-1 s=THROTTLE_DONE pgs=518 cs=0 l=1 rx=0x7fd5a00032f0 tx=0x7fd5a0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.793+0000 7fd5ae2e3700 1 --2- 172.21.15.63:0/1510579424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5a8146490 0x7fd5a8146920 secure :-1 s=THROTTLE_DONE pgs=518 cs=0 l=1 rx=0x7fd5a00032f0 tx=0x7fd5a0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.793+0000 7fd5acae0700 1 -- 172.21.15.63:0/1510579424 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a000a2e0 con 0x7fd5a8146490 2020-05-18T21:29:14.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.793+0000 7fd5acae0700 1 -- 172.21.15.63:0/1510579424 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5a000a700 con 0x7fd5a8146490 2020-05-18T21:29:14.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.793+0000 7fd5afd46700 1 -- 172.21.15.63:0/1510579424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5a8146490 msgr2=0x7fd5a8146920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.793+0000 7fd5afd46700 1 --2- 172.21.15.63:0/1510579424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5a8146490 0x7fd5a8146920 secure :-1 s=READY pgs=518 cs=0 l=1 rx=0x7fd5a00032f0 tx=0x7fd5a0007e00).stop 2020-05-18T21:29:14.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.793+0000 7fd5afd46700 1 -- 172.21.15.63:0/1510579424 shutdown_connections 2020-05-18T21:29:14.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.793+0000 7fd5afd46700 1 --2- 172.21.15.63:0/1510579424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5a8146490 0x7fd5a8146920 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.793+0000 7fd5afd46700 1 --2- 172.21.15.63:0/1510579424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5a809b0b0 0x7fd5a80b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:14.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.793+0000 7fd5afd46700 1 -- 172.21.15.63:0/1510579424 >> 172.21.15.63:0/1510579424 conn(0x7fd5a80b9770 msgr2=0x7fd5a80b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:14.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.793+0000 7fd5afd46700 1 -- 172.21.15.63:0/1510579424 shutdown_connections 2020-05-18T21:29:14.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.793+0000 7fd5afd46700 1 -- 172.21.15.63:0/1510579424 wait complete. 2020-05-18T21:29:14.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.793+0000 7fd5afd46700 1 Processor -- start 2020-05-18T21:29:14.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.793+0000 7fd5afd46700 1 -- start start 2020-05-18T21:29:14.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5afd46700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd5a809b0b0 0x7fd5a809dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:14.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5afd46700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd5a80aef00 0x7fd5a80b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:14.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5afd46700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a809d220 con 0x7fd5a8146490 2020-05-18T21:29:14.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5afd46700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a809e060 con 0x7fd5a809b0b0 2020-05-18T21:29:14.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5afd46700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a80b1560 con 0x7fd5a80aef00 2020-05-18T21:29:14.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5adae2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd5a809b0b0 0x7fd5a809dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5ae2e3700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd5a8146490 0x7fd5a8099360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58598/0 (socket says 172.21.15.63:58598) 2020-05-18T21:29:14.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5ae2e3700 1 -- 172.21.15.63:0/3853086454 learned_addr learned my addr 172.21.15.63:0/3853086454 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:14.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5ad2e1700 1 --2- 172.21.15.63:0/3853086454 >> v2:172.21.15.155:3300/0 conn(0x7fd5a80aef00 0x7fd5a80b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5adae2700 1 -- 172.21.15.63:0/3853086454 >> v2:172.21.15.155:3300/0 conn(0x7fd5a80aef00 msgr2=0x7fd5a80b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5adae2700 1 --2- 172.21.15.63:0/3853086454 >> v2:172.21.15.155:3300/0 conn(0x7fd5a80aef00 0x7fd5a80b1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5adae2700 1 -- 172.21.15.63:0/3853086454 >> v1:172.21.15.63:6789/0 conn(0x7fd5a8146490 legacy=0x7fd5a8099360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5adae2700 1 -- 172.21.15.63:0/3853086454 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a809d4c0 con 0x7fd5a809b0b0 2020-05-18T21:29:14.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5adae2700 1 --2- 172.21.15.63:0/3853086454 >> v2:172.21.15.63:3300/0 conn(0x7fd5a809b0b0 0x7fd5a809dc00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd5a4002f70 tx=0x7fd5a4010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5adae2700 1 --2- 172.21.15.63:0/3853086454 >> v2:172.21.15.63:3300/0 conn(0x7fd5a809b0b0 0x7fd5a809dc00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd5a4002f70 tx=0x7fd5a4010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5adae2700 1 --2- 172.21.15.63:0/3853086454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5a809b0b0 0x7fd5a809dc00 secure :-1 s=READY pgs=725 cs=0 l=1 rx=0x7fd5a4002f70 tx=0x7fd5a4010db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:14.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5adae2700 1 --2- 172.21.15.63:0/3853086454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5a809b0b0 0x7fd5a809dc00 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7fd5a4002f70 tx=0x7fd5a4010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd59affd700 1 -- 172.21.15.63:0/3853086454 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5a4007560 con 0x7fd5a809b0b0 2020-05-18T21:29:14.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5adae2700 1 --2- 172.21.15.63:0/3853086454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5a809b0b0 0x7fd5a809dc00 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7fd5a4002f70 tx=0x7fd5a4010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5adae2700 1 --2- 172.21.15.63:0/3853086454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5a809b0b0 0x7fd5a809dc00 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7fd5a4002f70 tx=0x7fd5a4010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd59affd700 1 -- 172.21.15.63:0/3853086454 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a4005a00 con 0x7fd5a809b0b0 2020-05-18T21:29:14.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5afd46700 1 -- 172.21.15.63:0/3853086454 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a809d760 con 0x7fd5a809b0b0 2020-05-18T21:29:14.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd59affd700 1 -- 172.21.15.63:0/3853086454 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5a4005de0 con 0x7fd5a809b0b0 2020-05-18T21:29:14.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.797+0000 7fd5afd46700 1 -- 172.21.15.63:0/3853086454 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a8099a70 con 0x7fd5a809b0b0 2020-05-18T21:29:14.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.801+0000 7fd5adae2700 1 --2- 172.21.15.63:0/3853086454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5a809b0b0 0x7fd5a809dc00 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7fd5a4002f70 tx=0x7fd5a4010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.801+0000 7fd5afd46700 1 -- 172.21.15.63:0/3853086454 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a80569e0 con 0x7fd5a809b0b0 2020-05-18T21:29:14.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.801+0000 7fd59affd700 1 -- 172.21.15.63:0/3853086454 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd5a4009490 con 0x7fd5a809b0b0 2020-05-18T21:29:14.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.801+0000 7fd5adae2700 1 --2- 172.21.15.63:0/3853086454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5a809b0b0 0x7fd5a809dc00 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7fd5a4002f70 tx=0x7fd5a4010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.801+0000 7fd59affd700 1 --2- 172.21.15.63:0/3853086454 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd58804fa20 0x7fd588051ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:14.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.801+0000 7fd59affd700 1 -- 172.21.15.63:0/3853086454 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd5a4063f20 con 0x7fd5a809b0b0 2020-05-18T21:29:14.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.801+0000 7fd5ad2e1700 1 --2- 172.21.15.63:0/3853086454 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd58804fa20 0x7fd588051ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:14.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.801+0000 7fd5ad2e1700 1 --2- 172.21.15.63:0/3853086454 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd58804fa20 0x7fd588051ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd5a80665a0 tx=0x7fd59c001450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.801+0000 7fd5ad2e1700 1 --2- 172.21.15.63:0/3853086454 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd58804fa20 0x7fd588051ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd5a80665a0 tx=0x7fd59c001450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.801+0000 7fd5ad2e1700 1 --2- 172.21.15.63:0/3853086454 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd58804fa20 0x7fd588051ee0 secure :-1 s=READY pgs=294 cs=0 l=1 rx=0x7fd5a80665a0 tx=0x7fd59c001450).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:14.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.809+0000 7fd5adae2700 1 --2- 172.21.15.63:0/3853086454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5a809b0b0 0x7fd5a809dc00 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7fd5a4002f70 tx=0x7fd5a4010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.809+0000 7fd59affd700 1 -- 172.21.15.63:0/3853086454 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd5a403e250 con 0x7fd5a809b0b0 2020-05-18T21:29:14.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.929+0000 7fd5afd46700 1 -- 172.21.15.63:0/3853086454 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5a809d8f0 con 0x7fd5a809b0b0 2020-05-18T21:29:14.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.929+0000 7fd5adae2700 1 --2- 172.21.15.63:0/3853086454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5a809b0b0 0x7fd5a809dc00 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7fd5a4002f70 tx=0x7fd5a4010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:14.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.929+0000 7fd59affd700 1 -- 172.21.15.63:0/3853086454 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd5a4041870 con 0x7fd5a809b0b0 2020-05-18T21:29:14.936 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:29:14.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.933+0000 7fd5afd46700 1 -- 172.21.15.63:0/3853086454 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd58804fa20 msgr2=0x7fd588051ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.933+0000 7fd5afd46700 1 --2- 172.21.15.63:0/3853086454 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd58804fa20 0x7fd588051ee0 secure :-1 s=READY pgs=294 cs=0 l=1 rx=0x7fd5a80665a0 tx=0x7fd59c001450).stop 2020-05-18T21:29:14.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.933+0000 7fd5afd46700 1 -- 172.21.15.63:0/3853086454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5a809b0b0 msgr2=0x7fd5a809dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:14.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.933+0000 7fd5afd46700 1 --2- 172.21.15.63:0/3853086454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5a809b0b0 0x7fd5a809dc00 secure :-1 s=READY pgs=725 cs=0 l=1 rx=0x7fd5a4002f70 tx=0x7fd5a4010db0).stop 2020-05-18T21:29:14.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.933+0000 7fd5afd46700 1 -- 172.21.15.63:0/3853086454 shutdown_connections 2020-05-18T21:29:14.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.933+0000 7fd5afd46700 1 --2- 172.21.15.63:0/3853086454 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd58804fa20 0x7fd588051ee0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.933+0000 7fd5afd46700 1 --2- 172.21.15.63:0/3853086454 >> v2:172.21.15.155:3300/0 conn(0x7fd5a80aef00 0x7fd5a80b1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.933+0000 7fd5afd46700 1 --2- 172.21.15.63:0/3853086454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5a809b0b0 0x7fd5a809dc00 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:14.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.933+0000 7fd5afd46700 1 -- 172.21.15.63:0/3853086454 >> 172.21.15.63:0/3853086454 conn(0x7fd5a80b9770 msgr2=0x7fd5a80b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:14.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.933+0000 7fd5afd46700 1 -- 172.21.15.63:0/3853086454 shutdown_connections 2020-05-18T21:29:14.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:14.933+0000 7fd5afd46700 1 -- 172.21.15.63:0/3853086454 wait complete. 2020-05-18T21:29:14.948 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:29:14.949 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:15.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c88fd700 1 Processor -- start 2020-05-18T21:29:15.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c88fd700 1 -- start start 2020-05-18T21:29:15.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c88fd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f62c40b4760 0x7f62c40648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:15.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c88fd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62c4064d20 0x7f62c414d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:15.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c88fd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c414a330 con 0x7f62c405f110 2020-05-18T21:29:15.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c88fd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c414a140 con 0x7f62c40b4760 2020-05-18T21:29:15.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c88fd700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c414a5d0 con 0x7f62c4064d20 2020-05-18T21:29:15.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c2ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f62c40b4760 0x7f62c40648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:15.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c2ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f62c40b4760 0x7f62c40648c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56416/0 (socket says 172.21.15.63:56416) 2020-05-18T21:29:15.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c2ffd700 1 -- 172.21.15.63:0/1585933642 learned_addr learned my addr 172.21.15.63:0/1585933642 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:15.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c3fff700 1 --2- 172.21.15.63:0/1585933642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62c4064d20 0x7f62c414d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:15.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c2ffd700 1 -- 172.21.15.63:0/1585933642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62c4064d20 msgr2=0x7f62c414d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:15.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c2ffd700 1 --2- 172.21.15.63:0/1585933642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62c4064d20 0x7f62c414d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:15.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c2ffd700 1 -- 172.21.15.63:0/1585933642 >> v1:172.21.15.155:6789/0 conn(0x7f62c405f110 legacy=0x7f62c414aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:15.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c2ffd700 1 -- 172.21.15.63:0/1585933642 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c4063430 con 0x7f62c40b4760 2020-05-18T21:29:15.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c2ffd700 1 --2- 172.21.15.63:0/1585933642 >> v2:172.21.15.63:3300/0 conn(0x7f62c40b4760 0x7f62c40648c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f62bc0032f0 tx=0x7f62bc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:15.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c2ffd700 1 --2- 172.21.15.63:0/1585933642 >> v2:172.21.15.63:3300/0 conn(0x7f62c40b4760 0x7f62c40648c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f62bc0032f0 tx=0x7f62bc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:15.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c2ffd700 1 --2- 172.21.15.63:0/1585933642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c40b4760 0x7f62c40648c0 secure :-1 s=READY pgs=726 cs=0 l=1 rx=0x7f62bc0032f0 tx=0x7f62bc007e00).ready entity=mon.0 client_cookie=b1bd1de5a6f9d858 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:15.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c2ffd700 1 --2- 172.21.15.63:0/1585933642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c40b4760 0x7f62c40648c0 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7f62bc0032f0 tx=0x7f62bc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:15.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c2ffd700 1 --2- 172.21.15.63:0/1585933642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c40b4760 0x7f62c40648c0 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7f62bc0032f0 tx=0x7f62bc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:15.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c2ffd700 1 --2- 172.21.15.63:0/1585933642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c40b4760 0x7f62c40648c0 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7f62bc0032f0 tx=0x7f62bc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:15.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c27fc700 1 -- 172.21.15.63:0/1585933642 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62bc011dc0 con 0x7f62c40b4760 2020-05-18T21:29:15.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c27fc700 1 -- 172.21.15.63:0/1585933642 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc00a180 con 0x7f62c40b4760 2020-05-18T21:29:15.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c27fc700 1 -- 172.21.15.63:0/1585933642 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62bc00a5a0 con 0x7f62c40b4760 2020-05-18T21:29:15.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c88fd700 1 -- 172.21.15.63:0/1585933642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c40b4760 msgr2=0x7f62c40648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:15.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c88fd700 1 --2- 172.21.15.63:0/1585933642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c40b4760 0x7f62c40648c0 secure :-1 s=READY pgs=726 cs=0 l=1 rx=0x7f62bc0032f0 tx=0x7f62bc007e00).stop 2020-05-18T21:29:15.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c88fd700 1 -- 172.21.15.63:0/1585933642 shutdown_connections 2020-05-18T21:29:15.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c88fd700 1 --2- 172.21.15.63:0/1585933642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62c4064d20 0x7f62c414d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:15.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c88fd700 1 --2- 172.21.15.63:0/1585933642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c40b4760 0x7f62c40648c0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:15.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c88fd700 1 -- 172.21.15.63:0/1585933642 >> 172.21.15.63:0/1585933642 conn(0x7f62c4069fc0 msgr2=0x7f62c406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:15.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c88fd700 1 -- 172.21.15.63:0/1585933642 shutdown_connections 2020-05-18T21:29:15.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.049+0000 7f62c88fd700 1 -- 172.21.15.63:0/1585933642 wait complete. 2020-05-18T21:29:15.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c88fd700 1 Processor -- start 2020-05-18T21:29:15.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c88fd700 1 -- start start 2020-05-18T21:29:15.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c88fd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f62c405f110 0x7f62c41499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:15.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c88fd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f62c40b4760 0x7f62c4132490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:15.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c88fd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c4142350 con 0x7f62c4064d20 2020-05-18T21:29:15.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c88fd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c41425f0 con 0x7f62c405f110 2020-05-18T21:29:15.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c88fd700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c4142890 con 0x7f62c40b4760 2020-05-18T21:29:15.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c37fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f62c405f110 0x7f62c41499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:15.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c37fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f62c405f110 0x7f62c41499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56420/0 (socket says 172.21.15.63:56420) 2020-05-18T21:29:15.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c37fe700 1 -- 172.21.15.63:0/1362777988 learned_addr learned my addr 172.21.15.63:0/1362777988 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:15.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c3fff700 1 --2- 172.21.15.63:0/1362777988 >> v2:172.21.15.155:3300/0 conn(0x7f62c40b4760 0x7f62c4132490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:15.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c37fe700 1 -- 172.21.15.63:0/1362777988 >> v2:172.21.15.155:3300/0 conn(0x7f62c40b4760 msgr2=0x7f62c4132490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:15.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c37fe700 1 --2- 172.21.15.63:0/1362777988 >> v2:172.21.15.155:3300/0 conn(0x7f62c40b4760 0x7f62c4132490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:15.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c37fe700 1 -- 172.21.15.63:0/1362777988 >> v1:172.21.15.63:6789/0 conn(0x7f62c4064d20 legacy=0x7f62c4148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:15.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c37fe700 1 -- 172.21.15.63:0/1362777988 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c40ac4d0 con 0x7f62c405f110 2020-05-18T21:29:15.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c37fe700 1 --2- 172.21.15.63:0/1362777988 >> v2:172.21.15.63:3300/0 conn(0x7f62c405f110 0x7f62c41499f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f62c41486b0 tx=0x7f62ac00c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:15.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c37fe700 1 --2- 172.21.15.63:0/1362777988 >> v2:172.21.15.63:3300/0 conn(0x7f62c405f110 0x7f62c41499f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f62c41486b0 tx=0x7f62ac00c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:15.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c37fe700 1 --2- 172.21.15.63:0/1362777988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c405f110 0x7f62c41499f0 secure :-1 s=READY pgs=728 cs=0 l=1 rx=0x7f62c41486b0 tx=0x7f62ac00c480).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:15.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c37fe700 1 --2- 172.21.15.63:0/1362777988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c405f110 0x7f62c41499f0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f62c41486b0 tx=0x7f62ac00c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:15.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c0ff9700 1 -- 172.21.15.63:0/1362777988 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62ac00cc60 con 0x7f62c405f110 2020-05-18T21:29:15.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c37fe700 1 --2- 172.21.15.63:0/1362777988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c405f110 0x7f62c41499f0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f62c41486b0 tx=0x7f62ac00c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:15.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c37fe700 1 --2- 172.21.15.63:0/1362777988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c405f110 0x7f62c41499f0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f62c41486b0 tx=0x7f62ac00c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:15.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c0ff9700 1 -- 172.21.15.63:0/1362777988 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac00cdc0 con 0x7f62c405f110 2020-05-18T21:29:15.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c88fd700 1 -- 172.21.15.63:0/1362777988 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c4149140 con 0x7f62c405f110 2020-05-18T21:29:15.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c0ff9700 1 -- 172.21.15.63:0/1362777988 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62ac0111b0 con 0x7f62c405f110 2020-05-18T21:29:15.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.053+0000 7f62c88fd700 1 -- 172.21.15.63:0/1362777988 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c4132b10 con 0x7f62c405f110 2020-05-18T21:29:15.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.057+0000 7f62c37fe700 1 --2- 172.21.15.63:0/1362777988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c405f110 0x7f62c41499f0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f62c41486b0 tx=0x7f62ac00c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:15.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.057+0000 7f62c88fd700 1 -- 172.21.15.63:0/1362777988 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c41429d0 con 0x7f62c405f110 2020-05-18T21:29:15.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.057+0000 7f62c0ff9700 1 -- 172.21.15.63:0/1362777988 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f62ac006520 con 0x7f62c405f110 2020-05-18T21:29:15.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.057+0000 7f62c37fe700 1 --2- 172.21.15.63:0/1362777988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c405f110 0x7f62c41499f0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f62c41486b0 tx=0x7f62ac00c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:15.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.057+0000 7f62c0ff9700 1 --2- 172.21.15.63:0/1362777988 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f62a804fa10 0x7f62a8051ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:15.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.057+0000 7f62c0ff9700 1 -- 172.21.15.63:0/1362777988 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f62ac063680 con 0x7f62c405f110 2020-05-18T21:29:15.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.057+0000 7f62c2ffd700 1 --2- 172.21.15.63:0/1362777988 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f62a804fa10 0x7f62a8051ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:15.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.057+0000 7f62c2ffd700 1 --2- 172.21.15.63:0/1362777988 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f62a804fa10 0x7f62a8051ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f62bc008290 tx=0x7f62bc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:15.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.057+0000 7f62c2ffd700 1 --2- 172.21.15.63:0/1362777988 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f62a804fa10 0x7f62a8051ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f62bc008290 tx=0x7f62bc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:15.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.057+0000 7f62c2ffd700 1 --2- 172.21.15.63:0/1362777988 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f62a804fa10 0x7f62a8051ed0 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7f62bc008290 tx=0x7f62bc007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:15.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.065+0000 7f62c37fe700 1 --2- 172.21.15.63:0/1362777988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c405f110 0x7f62c41499f0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f62c41486b0 tx=0x7f62ac00c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:15.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.065+0000 7f62c0ff9700 1 -- 172.21.15.63:0/1362777988 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f62ac03da10 con 0x7f62c405f110 2020-05-18T21:29:15.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.217+0000 7f62c88fd700 1 -- 172.21.15.63:0/1362777988 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62c40ac660 con 0x7f62c405f110 2020-05-18T21:29:15.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.217+0000 7f62c37fe700 1 --2- 172.21.15.63:0/1362777988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c405f110 0x7f62c41499f0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f62c41486b0 tx=0x7f62ac00c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:15.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.217+0000 7f62c0ff9700 1 -- 172.21.15.63:0/1362777988 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f62ac041030 con 0x7f62c405f110 2020-05-18T21:29:15.224 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:15.224 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/3008842702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3008842702},{"type":"v1","addr":"172.21.15.63:6833","nonce":3008842702}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:11.179187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5138":{"gid":5138,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/3117563034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3117563034},{"type":"v1","addr":"172.21.15.155:6835","nonce":3117563034}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:15.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.217+0000 7f62c88fd700 1 -- 172.21.15.63:0/1362777988 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f62a804fa10 msgr2=0x7f62a8051ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:15.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.217+0000 7f62c88fd700 1 --2- 172.21.15.63:0/1362777988 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f62a804fa10 0x7f62a8051ed0 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7f62bc008290 tx=0x7f62bc007e00).stop 2020-05-18T21:29:15.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.217+0000 7f62c88fd700 1 -- 172.21.15.63:0/1362777988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c405f110 msgr2=0x7f62c41499f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:15.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.217+0000 7f62c88fd700 1 --2- 172.21.15.63:0/1362777988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c405f110 0x7f62c41499f0 secure :-1 s=READY pgs=728 cs=0 l=1 rx=0x7f62c41486b0 tx=0x7f62ac00c480).stop 2020-05-18T21:29:15.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.217+0000 7f62c88fd700 1 -- 172.21.15.63:0/1362777988 shutdown_connections 2020-05-18T21:29:15.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.217+0000 7f62c88fd700 1 --2- 172.21.15.63:0/1362777988 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f62a804fa10 0x7f62a8051ed0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:15.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.217+0000 7f62c88fd700 1 --2- 172.21.15.63:0/1362777988 >> v2:172.21.15.155:3300/0 conn(0x7f62c40b4760 0x7f62c4132490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:15.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.217+0000 7f62c88fd700 1 --2- 172.21.15.63:0/1362777988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c405f110 0x7f62c41499f0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:15.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.217+0000 7f62c88fd700 1 -- 172.21.15.63:0/1362777988 >> 172.21.15.63:0/1362777988 conn(0x7f62c4069fc0 msgr2=0x7f62c40b7780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:15.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.217+0000 7f62c88fd700 1 -- 172.21.15.63:0/1362777988 shutdown_connections 2020-05-18T21:29:15.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:15.217+0000 7f62c88fd700 1 -- 172.21.15.63:0/1362777988 wait complete. 2020-05-18T21:29:15.229 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 27 2020-05-18T21:29:15.438 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:29:10.174981+0000', 'modified': '2020-05-18T21:29:11.179187+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5138': {'gid': 5138, 'name': 'b', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6835/3117563034', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3117563034}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3117563034}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:29:15.439 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:29:15.440 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:29:15.544 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:29:15.545 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:29:15.545 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2020-05-18T21:29:15.545 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 5138, 2020-05-18T21:29:15.546 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:29:15.546 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:29:15.546 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 5.3623230179999997, 2020-05-18T21:29:15.546 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 27, 2020-05-18T21:29:15.547 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 61, 2020-05-18T21:29:15.547 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 61, 2020-05-18T21:29:15.547 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 9.7255288150000005 2020-05-18T21:29:15.547 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:29:15.553 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 5138, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.3623230179999997, "mdsmap_epoch": 27, "osdmap_epoch": 61, "osdmap_epoch_barrier": 61, "uptime": 9.7255288150000005 } 2020-05-18T21:29:15.554 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:29:15.554 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:29:15.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:15.555 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:29:15.564 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:29:15.564 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:29:15.564 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:29:15.565 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:29:15.565 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:29:15.565 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:29:15.565 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:29:15.566 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:15.566 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:29:15.566 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:15.566 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:29:15.567 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:15.567 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:29:15.567 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:15.567 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:29:15.568 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42687sec preferred_lft 42687sec 2020-05-18T21:29:15.568 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:29:15.568 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:29:15.569 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:29:15.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:15.570 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:29:15.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:15.594 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:29:15.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:15.658 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:29:15.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:15.679 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:29:15.740 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:29:15.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:15.743 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:29:15.754 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:29:15.754 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:29:15.754 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:29:15.754 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:29:15.755 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:29:15.755 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:29:15.755 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:29:15.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:15.756 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:29:15.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:15.775 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:29:15.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:15.844 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:29:15.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:15.862 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:29:15.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:15.912 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:29:15.921 INFO:teuthology.orchestra.run.smithi063.stdout:nsid 0 2020-05-18T21:29:15.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:15.922 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:29:15.928 INFO:teuthology.orchestra.run.smithi063.stdout:nsid 0 2020-05-18T21:29:15.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:15.929 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:29:15.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:15.995 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 1' 2020-05-18T21:29:16.014 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-05-18T21:29:16.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:16.015 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.1' 2020-05-18T21:29:16.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:16.080 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:29:16.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:16.099 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-05-18T21:29:16.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:16.113 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-05-18T21:29:16.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:16.178 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-05-18T21:29:16.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:16.197 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.1 up' 2020-05-18T21:29:16.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:16.260 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.1 master ceph-brx' 2020-05-18T21:29:16.274 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-05-18T21:29:16.275 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-05-18T21:29:16.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:29:16.276 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:29:16.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:29:16.283 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:29:16.347 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:29:16.349 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:29:16.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:29:16.351 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:29:16.360 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:29:16.360 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:29:16.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:29:16.404 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:29:16.422 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:29:16.423 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:29:16.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:29:16.424 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:29:16.493 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2020-05-18T21:29:16.489+0000 7efcdc268080 -1 init, newargv = 0x563b86962530 newargc=9 2020-05-18T21:29:16.494 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[22155]: starting ceph client 2020-05-18T21:29:16.505 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[22155]: starting fuse 2020-05-18T21:29:17.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:29:17.531 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:29:17.549 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:29:17.550 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:29:17.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:29:17.551 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:29:17.556 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:29:17.556 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:29:17.557 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:29:17.557 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:29:17.558 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:29:17.558 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:29:17.559 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:29:17.559 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:29:17.560 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:29:17.560 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:29:17.560 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:29:17.561 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:29:17.561 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:29:17.562 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:29:17.562 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:29:17.562 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:29:17.563 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:29:17.563 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:29:17.564 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:29:17.564 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:29:17.564 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:29:17.565 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:29:17.565 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:29:17.566 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:29:17.567 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:29:17.568 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:29:17.612 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.22155.asok 2020-05-18T21:29:17.616 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.22155.asok 2020-05-18T21:29:17.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:29:17.618 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.22155.asok status 2020-05-18T21:29:17.702 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:29:17.702 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:29:17.702 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:29:17.702 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:29:17.703 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:29:17.703 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:29:17.703 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:29:17.703 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "22155", 2020-05-18T21:29:17.704 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:29:17.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:17.705 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:29:17.705 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:29:17.705 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 6333, 2020-05-18T21:29:17.705 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:29:17.705 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:29:17.706 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:29:17.706 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 6333 2020-05-18T21:29:17.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:17.706 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:29:17.707 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:17.707 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:29:17.707 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3501875496 2020-05-18T21:29:17.707 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:17.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:17.707 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:29:17.708 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:17.708 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:29:17.708 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3501875496 2020-05-18T21:29:17.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:17.708 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.6333 192.168.0.1:0/3501875496", 2020-05-18T21:29:17.709 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/3501875496", 2020-05-18T21:29:17.709 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:29:17.709 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 27, 2020-05-18T21:29:17.709 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 61, 2020-05-18T21:29:17.709 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:29:17.710 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:29:17.710 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:29:17.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:29:17.712 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:29:17.712 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:29:17.718 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:29:17.719 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-05-18T21:29:17.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:29:17.720 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:29:17.737 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:29:17.739 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:29:17.773 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2020-05-18T21:29:17.773 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2020-05-18T21:29:17.774 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:29:17.774 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2020-05-18T21:29:17.774 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.775 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2020-05-18T21:29:17.775 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.775 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2020-05-18T21:29:17.776 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.776 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2020-05-18T21:29:17.776 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2020-05-18T21:29:17.776 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2020-05-18T21:29:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2020-05-18T21:29:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:29:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2020-05-18T21:29:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:29:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:29:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2020-05-18T21:29:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2020-05-18T21:29:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2020-05-18T21:29:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:29:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:29:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2020-05-18T21:29:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:29:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2020-05-18T21:29:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:29:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:29:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2020-05-18T21:29:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.781 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:29:17.781 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.781 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2020-05-18T21:29:17.781 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.781 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2020-05-18T21:29:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2020-05-18T21:29:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2020-05-18T21:29:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:29:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:29:17.783 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.783 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2020-05-18T21:29:17.783 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2020-05-18T21:29:17.783 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.783 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2020-05-18T21:29:17.784 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2020-05-18T21:29:17.784 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.784 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2020-05-18T21:29:17.784 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2020-05-18T21:29:17.784 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.784 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2020-05-18T21:29:17.785 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2020-05-18T21:29:17.785 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2020-05-18T21:29:17.785 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.785 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2020-05-18T21:29:17.785 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2020-05-18T21:29:17.786 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.786 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:29:17.786 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2020-05-18T21:29:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2020-05-18T21:29:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:29:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2020-05-18T21:29:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2020-05-18T21:29:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2020-05-18T21:29:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2020-05-18T21:29:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2020-05-18T21:29:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2020-05-18T21:29:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2020-05-18T21:29:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2020-05-18T21:29:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2020-05-18T21:29:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2020-05-18T21:29:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: debug filestore = 20 2020-05-18T21:29:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: debug journal = 20 2020-05-18T21:29:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 20 2020-05-18T21:29:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 25 2020-05-18T21:29:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2020-05-18T21:29:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:29:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2020-05-18T21:29:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:29:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:29:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2020-05-18T21:29:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:29:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.792 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2020-05-18T21:29:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2020-05-18T21:29:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:29:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:29:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2020-05-18T21:29:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.793 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2020-05-18T21:29:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:29:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2020-05-18T21:29:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:29:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2020-05-18T21:29:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2020-05-18T21:29:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2020-05-18T21:29:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2020-05-18T21:29:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2020-05-18T21:29:17.796 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.796 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2020-05-18T21:29:17.796 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2020-05-18T21:29:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2020-05-18T21:29:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2020-05-18T21:29:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:29:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:29:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2020-05-18T21:29:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2020-05-18T21:29:17.798 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:17.798 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2020-05-18T21:29:17.798 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2020-05-18T21:29:17.798 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2020-05-18T21:29:17.798 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2020-05-18T21:29:17.799 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2020-05-18T21:29:17.799 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2020-05-18T21:29:17.799 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2020-05-18T21:29:17.799 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2020-05-18T21:29:17.799 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:17.800 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal frag = True 2020-05-18T21:29:17.800 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal fragment size max = 10000 2020-05-18T21:29:17.800 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal merge size = 5 2020-05-18T21:29:17.800 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split bits = 3 2020-05-18T21:29:17.800 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split size = 100 2020-05-18T21:29:17.800 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2020-05-18T21:29:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2020-05-18T21:29:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2020-05-18T21:29:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2020-05-18T21:29:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:29:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_files = 6 2020-05-18T21:29:17.803 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2020-05-18T21:29:17.803 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2020-05-18T21:29:17.803 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:29:17.803 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2020-05-18T21:29:17.804 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.804 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2020-05-18T21:29:17.804 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.804 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2020-05-18T21:29:17.804 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.805 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2020-05-18T21:29:17.805 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2020-05-18T21:29:17.805 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.805 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2020-05-18T21:29:17.806 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2020-05-18T21:29:17.806 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.806 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:29:17.807 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2020-05-18T21:29:17.807 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.807 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:29:17.807 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:29:17.808 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.808 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2020-05-18T21:29:17.808 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.808 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2020-05-18T21:29:17.808 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2020-05-18T21:29:17.809 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:29:17.809 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:29:17.809 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2020-05-18T21:29:17.809 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:29:17.809 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2020-05-18T21:29:17.809 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:29:17.810 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:29:17.810 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2020-05-18T21:29:17.810 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.810 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:29:17.810 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.811 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2020-05-18T21:29:17.811 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.811 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2020-05-18T21:29:17.811 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.811 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2020-05-18T21:29:17.811 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2020-05-18T21:29:17.812 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:29:17.812 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:29:17.812 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.812 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2020-05-18T21:29:17.813 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2020-05-18T21:29:17.813 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.813 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2020-05-18T21:29:17.813 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2020-05-18T21:29:17.814 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.814 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2020-05-18T21:29:17.814 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2020-05-18T21:29:17.814 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.814 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2020-05-18T21:29:17.814 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2020-05-18T21:29:17.815 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2020-05-18T21:29:17.815 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.815 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2020-05-18T21:29:17.815 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2020-05-18T21:29:17.815 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.816 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:29:17.816 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.816 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2020-05-18T21:29:17.816 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.816 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2020-05-18T21:29:17.817 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.817 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:29:17.817 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2020-05-18T21:29:17.818 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.818 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2020-05-18T21:29:17.818 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2020-05-18T21:29:17.818 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2020-05-18T21:29:17.819 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2020-05-18T21:29:17.819 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2020-05-18T21:29:17.819 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2020-05-18T21:29:17.819 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2020-05-18T21:29:17.819 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2020-05-18T21:29:17.819 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2020-05-18T21:29:17.820 INFO:teuthology.orchestra.run.smithi155.stdout: debug filestore = 20 2020-05-18T21:29:17.820 INFO:teuthology.orchestra.run.smithi155.stdout: debug journal = 20 2020-05-18T21:29:17.820 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 20 2020-05-18T21:29:17.820 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 25 2020-05-18T21:29:17.820 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2020-05-18T21:29:17.821 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:29:17.821 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2020-05-18T21:29:17.821 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:29:17.821 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:29:17.821 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2020-05-18T21:29:17.821 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:29:17.822 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.822 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2020-05-18T21:29:17.822 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:17.822 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2020-05-18T21:29:17.822 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:29:17.822 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:29:17.823 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:17.823 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:17.823 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2020-05-18T21:29:17.823 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.823 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2020-05-18T21:29:17.824 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:17.824 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:29:17.824 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2020-05-18T21:29:17.824 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:29:17.824 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2020-05-18T21:29:17.824 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2020-05-18T21:29:17.825 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:17.825 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2020-05-18T21:29:17.825 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2020-05-18T21:29:17.825 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:17.825 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2020-05-18T21:29:17.826 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.826 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2020-05-18T21:29:17.826 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2020-05-18T21:29:17.826 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2020-05-18T21:29:17.826 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2020-05-18T21:29:17.826 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:29:17.827 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:29:17.827 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2020-05-18T21:29:17.827 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2020-05-18T21:29:17.828 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:17.828 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2020-05-18T21:29:17.828 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2020-05-18T21:29:17.828 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2020-05-18T21:29:17.828 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2020-05-18T21:29:17.829 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2020-05-18T21:29:17.829 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2020-05-18T21:29:17.829 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2020-05-18T21:29:17.829 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2020-05-18T21:29:17.829 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:17.829 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal frag = True 2020-05-18T21:29:17.830 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2020-05-18T21:29:17.830 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2020-05-18T21:29:17.830 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2020-05-18T21:29:17.830 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2020-05-18T21:29:17.830 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2020-05-18T21:29:17.831 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2020-05-18T21:29:17.831 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2020-05-18T21:29:17.831 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2020-05-18T21:29:17.831 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:29:17.831 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_files = 6 2020-05-18T21:29:17.833 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:29:17.846 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:29:17.879 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2020-05-18T21:29:17.879 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2020-05-18T21:29:17.879 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:29:17.879 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2020-05-18T21:29:17.880 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.880 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2020-05-18T21:29:17.880 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.880 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2020-05-18T21:29:17.880 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.880 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2020-05-18T21:29:17.881 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2020-05-18T21:29:17.881 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.881 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2020-05-18T21:29:17.882 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2020-05-18T21:29:17.882 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.882 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:29:17.882 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2020-05-18T21:29:17.883 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.883 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:29:17.883 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:29:17.883 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.883 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2020-05-18T21:29:17.883 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.884 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2020-05-18T21:29:17.884 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2020-05-18T21:29:17.884 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:29:17.884 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:29:17.884 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2020-05-18T21:29:17.885 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:29:17.885 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2020-05-18T21:29:17.885 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:29:17.885 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:29:17.885 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2020-05-18T21:29:17.885 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.886 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:29:17.886 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.886 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2020-05-18T21:29:17.886 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.886 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2020-05-18T21:29:17.887 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.887 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2020-05-18T21:29:17.887 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2020-05-18T21:29:17.887 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:29:17.887 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:29:17.888 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.888 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2020-05-18T21:29:17.888 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2020-05-18T21:29:17.888 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.888 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2020-05-18T21:29:17.888 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2020-05-18T21:29:17.889 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.889 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2020-05-18T21:29:17.889 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2020-05-18T21:29:17.889 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.889 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2020-05-18T21:29:17.890 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2020-05-18T21:29:17.890 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2020-05-18T21:29:17.890 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.890 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2020-05-18T21:29:17.890 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2020-05-18T21:29:17.890 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.891 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:29:17.891 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.891 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2020-05-18T21:29:17.891 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.891 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2020-05-18T21:29:17.892 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.892 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:29:17.892 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2020-05-18T21:29:17.893 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.893 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2020-05-18T21:29:17.893 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2020-05-18T21:29:17.893 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2020-05-18T21:29:17.893 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2020-05-18T21:29:17.893 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2020-05-18T21:29:17.894 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2020-05-18T21:29:17.894 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2020-05-18T21:29:17.894 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2020-05-18T21:29:17.894 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2020-05-18T21:29:17.894 INFO:teuthology.orchestra.run.smithi063.stdout: debug filestore = 20 2020-05-18T21:29:17.895 INFO:teuthology.orchestra.run.smithi063.stdout: debug journal = 20 2020-05-18T21:29:17.895 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 20 2020-05-18T21:29:17.895 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 25 2020-05-18T21:29:17.895 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2020-05-18T21:29:17.895 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:29:17.895 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2020-05-18T21:29:17.896 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:29:17.896 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:29:17.896 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2020-05-18T21:29:17.896 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:29:17.896 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.897 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2020-05-18T21:29:17.897 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:17.897 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2020-05-18T21:29:17.897 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:29:17.897 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:29:17.897 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:17.898 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:17.898 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2020-05-18T21:29:17.898 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.898 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2020-05-18T21:29:17.898 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:17.899 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:29:17.899 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2020-05-18T21:29:17.899 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:29:17.899 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2020-05-18T21:29:17.899 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2020-05-18T21:29:17.899 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:17.900 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2020-05-18T21:29:17.900 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2020-05-18T21:29:17.900 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:17.900 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2020-05-18T21:29:17.900 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:17.901 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2020-05-18T21:29:17.901 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2020-05-18T21:29:17.901 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2020-05-18T21:29:17.901 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2020-05-18T21:29:17.901 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:29:17.901 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:29:17.902 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2020-05-18T21:29:17.904 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2020-05-18T21:29:17.904 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:17.904 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2020-05-18T21:29:17.905 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2020-05-18T21:29:17.905 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2020-05-18T21:29:17.905 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2020-05-18T21:29:17.906 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2020-05-18T21:29:17.906 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2020-05-18T21:29:17.906 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2020-05-18T21:29:17.906 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2020-05-18T21:29:17.906 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:17.907 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal frag = True 2020-05-18T21:29:17.907 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal fragment size max = 10000 2020-05-18T21:29:17.907 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal merge size = 5 2020-05-18T21:29:17.907 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split bits = 3 2020-05-18T21:29:17.907 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split size = 100 2020-05-18T21:29:17.908 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2020-05-18T21:29:17.908 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2020-05-18T21:29:17.908 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2020-05-18T21:29:17.908 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2020-05-18T21:29:17.908 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:29:17.909 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_files = 6 2020-05-18T21:29:17.909 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_ops = 100000000 2020-05-18T21:29:17.910 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2020-05-18T21:29:17.911 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2020-05-18T21:29:17.911 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:29:17.911 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2020-05-18T21:29:17.911 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.911 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2020-05-18T21:29:17.911 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.912 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2020-05-18T21:29:17.912 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.913 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2020-05-18T21:29:17.913 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2020-05-18T21:29:17.913 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.913 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2020-05-18T21:29:17.914 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2020-05-18T21:29:17.914 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.914 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:29:17.914 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2020-05-18T21:29:17.915 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.915 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:29:17.915 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:29:17.915 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.915 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2020-05-18T21:29:17.915 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.916 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2020-05-18T21:29:17.916 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2020-05-18T21:29:17.916 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:29:17.916 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:29:17.916 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2020-05-18T21:29:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:29:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2020-05-18T21:29:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:29:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:29:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2020-05-18T21:29:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:29:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2020-05-18T21:29:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2020-05-18T21:29:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2020-05-18T21:29:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2020-05-18T21:29:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:29:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:29:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.920 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2020-05-18T21:29:17.920 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2020-05-18T21:29:17.920 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.920 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2020-05-18T21:29:17.920 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2020-05-18T21:29:17.921 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.921 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2020-05-18T21:29:17.921 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2020-05-18T21:29:17.921 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.921 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2020-05-18T21:29:17.921 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2020-05-18T21:29:17.922 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2020-05-18T21:29:17.922 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.922 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2020-05-18T21:29:17.923 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2020-05-18T21:29:17.923 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.923 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:29:17.923 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.923 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2020-05-18T21:29:17.924 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.924 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2020-05-18T21:29:17.924 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.924 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:29:17.924 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2020-05-18T21:29:17.925 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.925 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2020-05-18T21:29:17.925 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2020-05-18T21:29:17.925 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2020-05-18T21:29:17.925 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2020-05-18T21:29:17.925 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2020-05-18T21:29:17.926 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2020-05-18T21:29:17.926 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2020-05-18T21:29:17.926 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2020-05-18T21:29:17.926 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2020-05-18T21:29:17.926 INFO:teuthology.orchestra.run.smithi155.stdout: debug filestore = 20 2020-05-18T21:29:17.927 INFO:teuthology.orchestra.run.smithi155.stdout: debug journal = 20 2020-05-18T21:29:17.927 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 20 2020-05-18T21:29:17.927 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 25 2020-05-18T21:29:17.927 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2020-05-18T21:29:17.927 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:29:17.927 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2020-05-18T21:29:17.928 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:29:17.928 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:29:17.928 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2020-05-18T21:29:17.928 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:29:17.928 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.929 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2020-05-18T21:29:17.929 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:17.929 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2020-05-18T21:29:17.929 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:29:17.929 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:29:17.929 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:17.930 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:17.930 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2020-05-18T21:29:17.930 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.930 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2020-05-18T21:29:17.930 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:17.931 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:29:17.931 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2020-05-18T21:29:17.931 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:29:17.931 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2020-05-18T21:29:17.931 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2020-05-18T21:29:17.931 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:17.932 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2020-05-18T21:29:17.932 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2020-05-18T21:29:17.932 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:17.932 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2020-05-18T21:29:17.933 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:17.933 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2020-05-18T21:29:17.933 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2020-05-18T21:29:17.933 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2020-05-18T21:29:17.934 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2020-05-18T21:29:17.934 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:29:17.934 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:29:17.934 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2020-05-18T21:29:17.934 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2020-05-18T21:29:17.934 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:17.935 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2020-05-18T21:29:17.935 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2020-05-18T21:29:17.935 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2020-05-18T21:29:17.935 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2020-05-18T21:29:17.935 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2020-05-18T21:29:17.936 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2020-05-18T21:29:17.936 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2020-05-18T21:29:17.936 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2020-05-18T21:29:17.936 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:17.936 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal frag = True 2020-05-18T21:29:17.936 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2020-05-18T21:29:17.937 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2020-05-18T21:29:17.937 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2020-05-18T21:29:17.937 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2020-05-18T21:29:17.937 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2020-05-18T21:29:17.937 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2020-05-18T21:29:17.938 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2020-05-18T21:29:17.938 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2020-05-18T21:29:17.938 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:29:17.938 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_files = 6 2020-05-18T21:29:17.938 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_ops = 100000000 2020-05-18T21:29:17.939 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:29:18.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.053+0000 7f189ef83700 1 Processor -- start 2020-05-18T21:29:18.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.053+0000 7f189ef83700 1 -- start start 2020-05-18T21:29:18.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.053+0000 7f189ef83700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18980b9910 0x7f189809eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:18.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.053+0000 7f189ef83700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189805f620 con 0x7f189809dcb0 2020-05-18T21:29:18.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.053+0000 7f189ef83700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189814b3d0 con 0x7f189809e110 2020-05-18T21:29:18.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.053+0000 7f189ef83700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18980b9cf0 con 0x7f18980b9910 2020-05-18T21:29:18.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.053+0000 7f1897fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f189809dcb0 0x7f189814da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58628/0 (socket says 172.21.15.63:58628) 2020-05-18T21:29:18.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.053+0000 7f1897fff700 1 -- 172.21.15.63:0/2249042253 learned_addr learned my addr 172.21.15.63:0/2249042253 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:18.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.053+0000 7f189cd1f700 1 --2- 172.21.15.63:0/2249042253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18980b9910 0x7f189809eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:18.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.053+0000 7f18977fe700 1 -- 172.21.15.63:0/2249042253 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056534680 0 0) 0x7f189805f620 con 0x7f189809dcb0 2020-05-18T21:29:18.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.053+0000 7f18977fe700 1 -- 172.21.15.63:0/2249042253 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1884003270 con 0x7f189809dcb0 2020-05-18T21:29:18.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.053+0000 7f189cd1f700 1 -- 172.21.15.63:0/2249042253 >> v1:172.21.15.155:6789/0 conn(0x7f189809e110 legacy=0x7f189814e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:18.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.053+0000 7f189cd1f700 1 -- 172.21.15.63:0/2249042253 >> v1:172.21.15.63:6789/0 conn(0x7f189809dcb0 legacy=0x7f189814da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:18.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.053+0000 7f18977fe700 1 -- 172.21.15.63:0/2249042253 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367652327 0 0) 0x7f189814b3d0 con 0x7f189809e110 2020-05-18T21:29:18.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.053+0000 7f189cd1f700 1 -- 172.21.15.63:0/2249042253 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189814af00 con 0x7f18980b9910 2020-05-18T21:29:18.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.057+0000 7f189cd1f700 1 --2- 172.21.15.63:0/2249042253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18980b9910 0x7f189809eed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1888002f70 tx=0x7f1888008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.057+0000 7f189cd1f700 1 --2- 172.21.15.63:0/2249042253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18980b9910 0x7f189809eed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1888002f70 tx=0x7f1888008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.057+0000 7f189cd1f700 1 --2- 172.21.15.63:0/2249042253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18980b9910 0x7f189809eed0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f1888002f70 tx=0x7f1888008920).ready entity=mon.2 client_cookie=8169ffdea69835f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:18.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.057+0000 7f189cd1f700 1 --2- 172.21.15.63:0/2249042253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18980b9910 0x7f189809eed0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f1888002f70 tx=0x7f1888008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.057+0000 7f18977fe700 1 -- 172.21.15.63:0/2249042253 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1888008e80 con 0x7f18980b9910 2020-05-18T21:29:18.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.057+0000 7f189cd1f700 1 --2- 172.21.15.63:0/2249042253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18980b9910 0x7f189809eed0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f1888002f70 tx=0x7f1888008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.057+0000 7f189cd1f700 1 --2- 172.21.15.63:0/2249042253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18980b9910 0x7f189809eed0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f1888002f70 tx=0x7f1888008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.057+0000 7f18977fe700 1 -- 172.21.15.63:0/2249042253 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1888011630 con 0x7f18980b9910 2020-05-18T21:29:18.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.057+0000 7f18977fe700 1 -- 172.21.15.63:0/2249042253 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18880119d0 con 0x7f18980b9910 2020-05-18T21:29:18.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.057+0000 7f189ef83700 1 -- 172.21.15.63:0/2249042253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18980b9910 msgr2=0x7f189809eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:18.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.057+0000 7f189ef83700 1 --2- 172.21.15.63:0/2249042253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18980b9910 0x7f189809eed0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f1888002f70 tx=0x7f1888008920).stop 2020-05-18T21:29:18.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.057+0000 7f189ef83700 1 -- 172.21.15.63:0/2249042253 shutdown_connections 2020-05-18T21:29:18.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.057+0000 7f189ef83700 1 --2- 172.21.15.63:0/2249042253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18980b9910 0x7f189809eed0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:18.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.057+0000 7f189ef83700 1 -- 172.21.15.63:0/2249042253 >> 172.21.15.63:0/2249042253 conn(0x7f18980650b0 msgr2=0x7f189805ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:18.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.057+0000 7f189ef83700 1 -- 172.21.15.63:0/2249042253 shutdown_connections 2020-05-18T21:29:18.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.057+0000 7f189ef83700 1 -- 172.21.15.63:0/2249042253 wait complete. 2020-05-18T21:29:18.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.057+0000 7f189ef83700 1 Processor -- start 2020-05-18T21:29:18.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.057+0000 7f189ef83700 1 -- start start 2020-05-18T21:29:18.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f189ef83700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f189809e110 0x7f18980a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:18.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f189ef83700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f18980b9910 0x7f18980a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:18.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f189ef83700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18980a2150 con 0x7f189809dcb0 2020-05-18T21:29:18.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f189ef83700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f189814e7c0 con 0x7f18980b9910 2020-05-18T21:29:18.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f189ef83700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18980a23f0 con 0x7f189809e110 2020-05-18T21:29:18.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f189d520700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f18980b9910 0x7f18980a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:18.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f1897fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f189809e110 0x7f18980a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:18.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f189cd1f700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f189809dcb0 0x7f189814e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:56950/0 (socket says 172.21.15.63:56950) 2020-05-18T21:29:18.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f189cd1f700 1 -- 172.21.15.63:0/1925540979 learned_addr learned my addr 172.21.15.63:0/1925540979 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:18.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f1895ffb700 1 -- 172.21.15.63:0/1925540979 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709564422 0 0) 0x7f18980a2150 con 0x7f189809dcb0 2020-05-18T21:29:18.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f1895ffb700 1 -- 172.21.15.63:0/1925540979 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1878002fe0 con 0x7f189809dcb0 2020-05-18T21:29:18.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f1897fff700 1 -- 172.21.15.63:0/1925540979 >> v2:172.21.15.63:3300/0 conn(0x7f18980b9910 msgr2=0x7f18980a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:18.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f1897fff700 1 --2- 172.21.15.63:0/1925540979 >> v2:172.21.15.63:3300/0 conn(0x7f18980b9910 0x7f18980a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:18.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f1897fff700 1 -- 172.21.15.63:0/1925540979 >> v1:172.21.15.155:6789/0 conn(0x7f189809dcb0 legacy=0x7f189814e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:18.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f1897fff700 1 -- 172.21.15.63:0/1925540979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1898144c30 con 0x7f189809e110 2020-05-18T21:29:18.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f1897fff700 1 --2- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f189809e110 0x7f18980a15f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f188c001110 tx=0x7f188c010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f1897fff700 1 --2- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f189809e110 0x7f18980a15f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f188c001110 tx=0x7f188c010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f1897fff700 1 --2- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f189809e110 0x7f18980a15f0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f188c001110 tx=0x7f188c010910).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:18.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f1897fff700 1 --2- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f189809e110 0x7f18980a15f0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f188c001110 tx=0x7f188c010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f1895ffb700 1 -- 172.21.15.63:0/1925540979 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f188c005d00 con 0x7f189809e110 2020-05-18T21:29:18.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f1897fff700 1 --2- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f189809e110 0x7f18980a15f0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f188c001110 tx=0x7f188c010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f1895ffb700 1 -- 172.21.15.63:0/1925540979 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c005e60 con 0x7f189809e110 2020-05-18T21:29:18.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f1897fff700 1 --2- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f189809e110 0x7f18980a15f0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f188c001110 tx=0x7f188c010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f189ef83700 1 -- 172.21.15.63:0/1925540979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18980a2890 con 0x7f189809e110 2020-05-18T21:29:18.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f1895ffb700 1 -- 172.21.15.63:0/1925540979 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f188c0062c0 con 0x7f189809e110 2020-05-18T21:29:18.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f189ef83700 1 -- 172.21.15.63:0/1925540979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1898141400 con 0x7f189809e110 2020-05-18T21:29:18.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.061+0000 7f1897fff700 1 --2- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f189809e110 0x7f18980a15f0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f188c001110 tx=0x7f188c010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.065+0000 7f189ef83700 1 -- 172.21.15.63:0/1925540979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f189814e900 con 0x7f189809e110 2020-05-18T21:29:18.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.065+0000 7f1895ffb700 1 -- 172.21.15.63:0/1925540979 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f188c006540 con 0x7f189809e110 2020-05-18T21:29:18.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.065+0000 7f1897fff700 1 --2- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f189809e110 0x7f18980a15f0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f188c001110 tx=0x7f188c010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.065+0000 7f1895ffb700 1 --2- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f187804fdd0 0x7f1878052290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:18.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.065+0000 7f1895ffb700 1 -- 172.21.15.63:0/1925540979 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f188c0090c0 con 0x7f189809e110 2020-05-18T21:29:18.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.065+0000 7f189cd1f700 1 --2- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f187804fdd0 0x7f1878052290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:18.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.065+0000 7f189cd1f700 1 --2- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f187804fdd0 0x7f1878052290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1888007f10 tx=0x7f1898147ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.065+0000 7f189cd1f700 1 --2- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f187804fdd0 0x7f1878052290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1888007f10 tx=0x7f1898147ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.065+0000 7f189cd1f700 1 --2- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f187804fdd0 0x7f1878052290 secure :-1 s=READY pgs=296 cs=0 l=1 rx=0x7f1888007f10 tx=0x7f1898147ff0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:18.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.073+0000 7f1897fff700 1 --2- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f189809e110 0x7f18980a15f0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f188c001110 tx=0x7f188c010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.073+0000 7f1895ffb700 1 -- 172.21.15.63:0/1925540979 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f189814e900 con 0x7f189809e110 2020-05-18T21:29:18.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.189+0000 7f189ef83700 1 -- 172.21.15.63:0/1925540979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f18980a1fb0 con 0x7f189809e110 2020-05-18T21:29:18.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.193+0000 7f1897fff700 1 --2- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f189809e110 0x7f18980a15f0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f188c001110 tx=0x7f188c010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.193+0000 7f1895ffb700 1 -- 172.21.15.63:0/1925540979 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+10 (secure 0 0 0) 0x7f18980a1fb0 con 0x7f189809e110 2020-05-18T21:29:18.198 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:29:18.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.193+0000 7f189ef83700 1 -- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f187804fdd0 msgr2=0x7f1878052290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:18.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.193+0000 7f189ef83700 1 --2- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f187804fdd0 0x7f1878052290 secure :-1 s=READY pgs=296 cs=0 l=1 rx=0x7f1888007f10 tx=0x7f1898147ff0).stop 2020-05-18T21:29:18.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.193+0000 7f189ef83700 1 -- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f189809e110 msgr2=0x7f18980a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:18.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.193+0000 7f189ef83700 1 --2- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f189809e110 0x7f18980a15f0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f188c001110 tx=0x7f188c010910).stop 2020-05-18T21:29:18.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.193+0000 7f189ef83700 1 -- 172.21.15.63:0/1925540979 shutdown_connections 2020-05-18T21:29:18.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.193+0000 7f189ef83700 1 --2- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f187804fdd0 0x7f1878052290 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:18.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.193+0000 7f189ef83700 1 --2- 172.21.15.63:0/1925540979 >> v2:172.21.15.63:3300/0 conn(0x7f18980b9910 0x7f18980a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:18.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.193+0000 7f189ef83700 1 --2- 172.21.15.63:0/1925540979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f189809e110 0x7f18980a15f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:18.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.193+0000 7f189ef83700 1 -- 172.21.15.63:0/1925540979 >> 172.21.15.63:0/1925540979 conn(0x7f18980650b0 msgr2=0x7f189805aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:18.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.193+0000 7f189ef83700 1 -- 172.21.15.63:0/1925540979 shutdown_connections 2020-05-18T21:29:18.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.197+0000 7f189ef83700 1 -- 172.21.15.63:0/1925540979 wait complete. 2020-05-18T21:29:18.216 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:29:18.224 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:29:18.249 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2020-05-18T21:29:18.250 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2020-05-18T21:29:18.250 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:29:18.250 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2020-05-18T21:29:18.250 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.251 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2020-05-18T21:29:18.251 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.251 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2020-05-18T21:29:18.251 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.251 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2020-05-18T21:29:18.252 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2020-05-18T21:29:18.253 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.253 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2020-05-18T21:29:18.254 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2020-05-18T21:29:18.254 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.254 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:29:18.254 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2020-05-18T21:29:18.254 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.254 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:29:18.255 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:29:18.255 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.255 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2020-05-18T21:29:18.255 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.255 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2020-05-18T21:29:18.256 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2020-05-18T21:29:18.256 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:29:18.256 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:29:18.256 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2020-05-18T21:29:18.256 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:29:18.257 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2020-05-18T21:29:18.257 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:29:18.257 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:29:18.257 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2020-05-18T21:29:18.257 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.257 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:29:18.258 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.258 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2020-05-18T21:29:18.258 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.258 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2020-05-18T21:29:18.258 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.259 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2020-05-18T21:29:18.259 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2020-05-18T21:29:18.259 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:29:18.259 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:29:18.259 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.259 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2020-05-18T21:29:18.260 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2020-05-18T21:29:18.260 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.260 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2020-05-18T21:29:18.260 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2020-05-18T21:29:18.260 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.261 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2020-05-18T21:29:18.261 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2020-05-18T21:29:18.261 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.261 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2020-05-18T21:29:18.261 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2020-05-18T21:29:18.261 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2020-05-18T21:29:18.262 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.262 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2020-05-18T21:29:18.262 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2020-05-18T21:29:18.263 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.263 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:29:18.263 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.263 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2020-05-18T21:29:18.263 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.264 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2020-05-18T21:29:18.264 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.264 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:29:18.264 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2020-05-18T21:29:18.264 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.265 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2020-05-18T21:29:18.265 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2020-05-18T21:29:18.265 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2020-05-18T21:29:18.265 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2020-05-18T21:29:18.265 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2020-05-18T21:29:18.266 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2020-05-18T21:29:18.267 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2020-05-18T21:29:18.267 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2020-05-18T21:29:18.267 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2020-05-18T21:29:18.267 INFO:teuthology.orchestra.run.smithi063.stdout: debug filestore = 20 2020-05-18T21:29:18.267 INFO:teuthology.orchestra.run.smithi063.stdout: debug journal = 20 2020-05-18T21:29:18.268 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 20 2020-05-18T21:29:18.268 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 25 2020-05-18T21:29:18.268 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2020-05-18T21:29:18.268 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:29:18.268 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2020-05-18T21:29:18.268 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:29:18.269 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:29:18.269 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2020-05-18T21:29:18.269 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:29:18.269 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.269 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2020-05-18T21:29:18.270 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:18.270 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2020-05-18T21:29:18.270 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:29:18.270 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:29:18.270 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:18.271 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:18.271 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2020-05-18T21:29:18.271 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.271 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2020-05-18T21:29:18.271 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:18.271 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:29:18.272 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2020-05-18T21:29:18.272 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:29:18.272 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2020-05-18T21:29:18.272 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2020-05-18T21:29:18.272 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:18.273 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2020-05-18T21:29:18.273 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2020-05-18T21:29:18.273 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:18.274 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2020-05-18T21:29:18.274 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:18.275 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2020-05-18T21:29:18.275 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2020-05-18T21:29:18.275 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2020-05-18T21:29:18.275 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2020-05-18T21:29:18.275 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:29:18.276 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:29:18.276 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2020-05-18T21:29:18.276 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2020-05-18T21:29:18.276 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:18.277 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2020-05-18T21:29:18.277 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2020-05-18T21:29:18.277 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2020-05-18T21:29:18.277 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2020-05-18T21:29:18.277 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2020-05-18T21:29:18.278 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2020-05-18T21:29:18.278 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2020-05-18T21:29:18.278 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2020-05-18T21:29:18.278 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:18.278 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal frag = True 2020-05-18T21:29:18.278 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal fragment size max = 10000 2020-05-18T21:29:18.279 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal merge size = 5 2020-05-18T21:29:18.279 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split bits = 3 2020-05-18T21:29:18.279 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split size = 100 2020-05-18T21:29:18.279 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2020-05-18T21:29:18.280 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2020-05-18T21:29:18.280 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2020-05-18T21:29:18.280 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2020-05-18T21:29:18.280 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:29:18.280 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_files = 6 2020-05-18T21:29:18.281 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_ops = 100000000 2020-05-18T21:29:18.281 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_ops_per_pg = 12500000.0 2020-05-18T21:29:18.282 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2020-05-18T21:29:18.282 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2020-05-18T21:29:18.283 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:29:18.283 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2020-05-18T21:29:18.284 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.284 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2020-05-18T21:29:18.284 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.284 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2020-05-18T21:29:18.284 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.284 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2020-05-18T21:29:18.285 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2020-05-18T21:29:18.285 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.285 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2020-05-18T21:29:18.285 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2020-05-18T21:29:18.285 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.286 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:29:18.286 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2020-05-18T21:29:18.286 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.286 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:29:18.286 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:29:18.287 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.287 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2020-05-18T21:29:18.287 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.287 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2020-05-18T21:29:18.287 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2020-05-18T21:29:18.287 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:29:18.288 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:29:18.288 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2020-05-18T21:29:18.288 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:29:18.288 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2020-05-18T21:29:18.288 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:29:18.289 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:29:18.289 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2020-05-18T21:29:18.289 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.289 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:29:18.289 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.289 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2020-05-18T21:29:18.290 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.290 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2020-05-18T21:29:18.290 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.290 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2020-05-18T21:29:18.290 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2020-05-18T21:29:18.291 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:29:18.291 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:29:18.291 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.291 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2020-05-18T21:29:18.292 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2020-05-18T21:29:18.292 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.292 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2020-05-18T21:29:18.292 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2020-05-18T21:29:18.292 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.292 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2020-05-18T21:29:18.293 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2020-05-18T21:29:18.293 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.293 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2020-05-18T21:29:18.294 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2020-05-18T21:29:18.294 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2020-05-18T21:29:18.294 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.294 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2020-05-18T21:29:18.294 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2020-05-18T21:29:18.295 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.295 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:29:18.295 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.295 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2020-05-18T21:29:18.295 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.296 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2020-05-18T21:29:18.296 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.296 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:29:18.296 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2020-05-18T21:29:18.296 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2020-05-18T21:29:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2020-05-18T21:29:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2020-05-18T21:29:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2020-05-18T21:29:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2020-05-18T21:29:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2020-05-18T21:29:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2020-05-18T21:29:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2020-05-18T21:29:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2020-05-18T21:29:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: debug filestore = 20 2020-05-18T21:29:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: debug journal = 20 2020-05-18T21:29:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 20 2020-05-18T21:29:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 25 2020-05-18T21:29:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2020-05-18T21:29:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:29:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2020-05-18T21:29:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:29:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:29:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2020-05-18T21:29:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:29:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.300 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2020-05-18T21:29:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2020-05-18T21:29:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:29:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:29:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2020-05-18T21:29:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.302 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2020-05-18T21:29:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:29:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2020-05-18T21:29:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:29:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2020-05-18T21:29:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2020-05-18T21:29:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2020-05-18T21:29:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2020-05-18T21:29:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2020-05-18T21:29:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:18.305 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2020-05-18T21:29:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2020-05-18T21:29:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2020-05-18T21:29:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2020-05-18T21:29:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:29:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:29:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2020-05-18T21:29:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2020-05-18T21:29:18.307 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:18.307 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2020-05-18T21:29:18.307 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2020-05-18T21:29:18.307 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2020-05-18T21:29:18.308 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2020-05-18T21:29:18.308 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2020-05-18T21:29:18.308 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2020-05-18T21:29:18.308 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2020-05-18T21:29:18.308 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2020-05-18T21:29:18.309 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:18.309 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal frag = True 2020-05-18T21:29:18.309 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2020-05-18T21:29:18.309 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2020-05-18T21:29:18.309 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2020-05-18T21:29:18.309 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2020-05-18T21:29:18.310 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2020-05-18T21:29:18.310 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2020-05-18T21:29:18.310 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2020-05-18T21:29:18.310 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2020-05-18T21:29:18.310 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:29:18.311 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_files = 6 2020-05-18T21:29:18.311 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_ops = 100000000 2020-05-18T21:29:18.311 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_ops_per_pg = 12500000.0 2020-05-18T21:29:18.312 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:29:18.312 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:29:18.313 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:29:18.313 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:29:18.351 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:29:18.351 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail b 2020-05-18T21:29:18.358 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:29:18.358 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail a 2020-05-18T21:29:18.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.469+0000 7f1f60b50700 1 Processor -- start 2020-05-18T21:29:18.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.469+0000 7f1f60b50700 1 -- start start 2020-05-18T21:29:18.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f60b50700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1f5c066190 0x7f1f5c09c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:18.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f60b50700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1f5c06a610 0x7f1f5c149e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:18.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f60b50700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5c14a710 con 0x7f1f5c066570 2020-05-18T21:29:18.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f60b50700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5c09bbc0 con 0x7f1f5c066190 2020-05-18T21:29:18.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f60b50700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5c05bfe0 con 0x7f1f5c06a610 2020-05-18T21:29:18.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f5a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1f5c066190 0x7f1f5c09c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:18.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f5a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1f5c066190 0x7f1f5c09c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56456/0 (socket says 172.21.15.63:56456) 2020-05-18T21:29:18.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f5a59c700 1 -- 172.21.15.63:0/2773724176 learned_addr learned my addr 172.21.15.63:0/2773724176 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:18.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f5ad9d700 1 --2- 172.21.15.63:0/2773724176 >> v2:172.21.15.155:3300/0 conn(0x7f1f5c06a610 0x7f1f5c149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:18.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f5a59c700 1 -- 172.21.15.63:0/2773724176 >> v2:172.21.15.155:3300/0 conn(0x7f1f5c06a610 msgr2=0x7f1f5c149e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:18.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f5a59c700 1 --2- 172.21.15.63:0/2773724176 >> v2:172.21.15.155:3300/0 conn(0x7f1f5c06a610 0x7f1f5c149e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:18.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f5a59c700 1 -- 172.21.15.63:0/2773724176 >> v1:172.21.15.155:6789/0 conn(0x7f1f5c066570 legacy=0x7f1f5c149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:18.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f5a59c700 1 -- 172.21.15.63:0/2773724176 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c05c280 con 0x7f1f5c066190 2020-05-18T21:29:18.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f5a59c700 1 --2- 172.21.15.63:0/2773724176 >> v2:172.21.15.63:3300/0 conn(0x7f1f5c066190 0x7f1f5c09c880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1f5c09c790 tx=0x7f1f4c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f5a59c700 1 --2- 172.21.15.63:0/2773724176 >> v2:172.21.15.63:3300/0 conn(0x7f1f5c066190 0x7f1f5c09c880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1f5c09c790 tx=0x7f1f4c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f5a59c700 1 --2- 172.21.15.63:0/2773724176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5c066190 0x7f1f5c09c880 secure :-1 s=READY pgs=734 cs=0 l=1 rx=0x7f1f5c09c790 tx=0x7f1f4c007a80).ready entity=mon.0 client_cookie=e1456edfa5d22450 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:18.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f5a59c700 1 --2- 172.21.15.63:0/2773724176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5c066190 0x7f1f5c09c880 secure :-1 s=THROTTLE_DONE pgs=734 cs=0 l=1 rx=0x7f1f5c09c790 tx=0x7f1f4c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f59d9b700 1 -- 172.21.15.63:0/2773724176 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f4c011720 con 0x7f1f5c066190 2020-05-18T21:29:18.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f5a59c700 1 --2- 172.21.15.63:0/2773724176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5c066190 0x7f1f5c09c880 secure :-1 s=THROTTLE_DONE pgs=734 cs=0 l=1 rx=0x7f1f5c09c790 tx=0x7f1f4c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f59d9b700 1 -- 172.21.15.63:0/2773724176 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c011880 con 0x7f1f5c066190 2020-05-18T21:29:18.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f5a59c700 1 --2- 172.21.15.63:0/2773724176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5c066190 0x7f1f5c09c880 secure :-1 s=THROTTLE_DONE pgs=734 cs=0 l=1 rx=0x7f1f5c09c790 tx=0x7f1f4c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f60b50700 1 -- 172.21.15.63:0/2773724176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5c066190 msgr2=0x7f1f5c09c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:18.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f59d9b700 1 -- 172.21.15.63:0/2773724176 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f4c011c60 con 0x7f1f5c066190 2020-05-18T21:29:18.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f60b50700 1 --2- 172.21.15.63:0/2773724176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5c066190 0x7f1f5c09c880 secure :-1 s=READY pgs=734 cs=0 l=1 rx=0x7f1f5c09c790 tx=0x7f1f4c007a80).stop 2020-05-18T21:29:18.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f60b50700 1 -- 172.21.15.63:0/2773724176 shutdown_connections 2020-05-18T21:29:18.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f60b50700 1 --2- 172.21.15.63:0/2773724176 >> v2:172.21.15.155:3300/0 conn(0x7f1f5c06a610 0x7f1f5c149e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:18.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f60b50700 1 --2- 172.21.15.63:0/2773724176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5c066190 0x7f1f5c09c880 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:18.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f60b50700 1 -- 172.21.15.63:0/2773724176 >> 172.21.15.63:0/2773724176 conn(0x7f1f5c05eb50 msgr2=0x7f1f5c05ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:18.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f60b50700 1 -- 172.21.15.63:0/2773724176 shutdown_connections 2020-05-18T21:29:18.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f60b50700 1 -- 172.21.15.63:0/2773724176 wait complete. 2020-05-18T21:29:18.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f60b50700 1 Processor -- start 2020-05-18T21:29:18.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.473+0000 7f1f60b50700 1 -- start start 2020-05-18T21:29:18.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f60b50700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1f5c066190 0x7f1f5c1477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:18.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f60b50700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1f5c066570 0x7f1f5c154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:18.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f60b50700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5c153690 con 0x7f1f5c06a610 2020-05-18T21:29:18.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f60b50700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5c153930 con 0x7f1f5c066190 2020-05-18T21:29:18.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f60b50700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5c153bd0 con 0x7f1f5c066570 2020-05-18T21:29:18.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f5a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1f5c066190 0x7f1f5c1477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:18.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f5a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1f5c066190 0x7f1f5c1477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56462/0 (socket says 172.21.15.63:56462) 2020-05-18T21:29:18.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f5a59c700 1 -- 172.21.15.63:0/2524200407 learned_addr learned my addr 172.21.15.63:0/2524200407 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:18.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f53fff700 1 --2- 172.21.15.63:0/2524200407 >> v2:172.21.15.155:3300/0 conn(0x7f1f5c066570 0x7f1f5c154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:18.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f5a59c700 1 -- 172.21.15.63:0/2524200407 >> v2:172.21.15.155:3300/0 conn(0x7f1f5c066570 msgr2=0x7f1f5c154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:18.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f5a59c700 1 --2- 172.21.15.63:0/2524200407 >> v2:172.21.15.155:3300/0 conn(0x7f1f5c066570 0x7f1f5c154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:18.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f5a59c700 1 -- 172.21.15.63:0/2524200407 >> v1:172.21.15.63:6789/0 conn(0x7f1f5c06a610 legacy=0x7f1f5c141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:18.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f5a59c700 1 -- 172.21.15.63:0/2524200407 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c1544d0 con 0x7f1f5c066190 2020-05-18T21:29:18.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f53fff700 1 --2- 172.21.15.63:0/2524200407 >> v2:172.21.15.155:3300/0 conn(0x7f1f5c066570 0x7f1f5c154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:29:18.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f5a59c700 1 --2- 172.21.15.63:0/2524200407 >> v2:172.21.15.63:3300/0 conn(0x7f1f5c066190 0x7f1f5c1477c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f5c09c790 tx=0x7f1f4c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f5a59c700 1 --2- 172.21.15.63:0/2524200407 >> v2:172.21.15.63:3300/0 conn(0x7f1f5c066190 0x7f1f5c1477c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f5c09c790 tx=0x7f1f4c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f5a59c700 1 --2- 172.21.15.63:0/2524200407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5c066190 0x7f1f5c1477c0 secure :-1 s=READY pgs=736 cs=0 l=1 rx=0x7f1f5c09c790 tx=0x7f1f4c007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:18.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f5a59c700 1 --2- 172.21.15.63:0/2524200407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5c066190 0x7f1f5c1477c0 secure :-1 s=THROTTLE_DONE pgs=736 cs=0 l=1 rx=0x7f1f5c09c790 tx=0x7f1f4c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f5a59c700 1 --2- 172.21.15.63:0/2524200407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5c066190 0x7f1f5c1477c0 secure :-1 s=THROTTLE_DONE pgs=736 cs=0 l=1 rx=0x7f1f5c09c790 tx=0x7f1f4c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f537fe700 1 -- 172.21.15.63:0/2524200407 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f4c011d60 con 0x7f1f5c066190 2020-05-18T21:29:18.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f5a59c700 1 --2- 172.21.15.63:0/2524200407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5c066190 0x7f1f5c1477c0 secure :-1 s=THROTTLE_DONE pgs=736 cs=0 l=1 rx=0x7f1f5c09c790 tx=0x7f1f4c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f537fe700 1 -- 172.21.15.63:0/2524200407 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c007360 con 0x7f1f5c066190 2020-05-18T21:29:18.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f60b50700 1 -- 172.21.15.63:0/2524200407 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5c0b3100 con 0x7f1f5c066190 2020-05-18T21:29:18.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f537fe700 1 -- 172.21.15.63:0/2524200407 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f4c005700 con 0x7f1f5c066190 2020-05-18T21:29:18.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f60b50700 1 -- 172.21.15.63:0/2524200407 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5c0ae0c0 con 0x7f1f5c066190 2020-05-18T21:29:18.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f5a59c700 1 --2- 172.21.15.63:0/2524200407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5c066190 0x7f1f5c1477c0 secure :-1 s=THROTTLE_DONE pgs=736 cs=0 l=1 rx=0x7f1f5c09c790 tx=0x7f1f4c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f60b50700 1 -- 172.21.15.63:0/2524200407 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5c0569e0 con 0x7f1f5c066190 2020-05-18T21:29:18.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f537fe700 1 -- 172.21.15.63:0/2524200407 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1f4c005970 con 0x7f1f5c066190 2020-05-18T21:29:18.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f5a59c700 1 --2- 172.21.15.63:0/2524200407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5c066190 0x7f1f5c1477c0 secure :-1 s=THROTTLE_DONE pgs=736 cs=0 l=1 rx=0x7f1f5c09c790 tx=0x7f1f4c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f537fe700 1 --2- 172.21.15.63:0/2524200407 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f4004f9c0 0x7f1f40051e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:18.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f537fe700 1 -- 172.21.15.63:0/2524200407 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1f4c064490 con 0x7f1f5c066190 2020-05-18T21:29:18.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.477+0000 7f1f53fff700 1 --2- 172.21.15.63:0/2524200407 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f4004f9c0 0x7f1f40051e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:18.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7f1f53fff700 1 --2- 172.21.15.63:0/2524200407 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f4004f9c0 0x7f1f40051e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f44001f90 tx=0x7f1f44002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7f1f53fff700 1 --2- 172.21.15.63:0/2524200407 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f4004f9c0 0x7f1f40051e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f44001f90 tx=0x7f1f44002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7f1f53fff700 1 --2- 172.21.15.63:0/2524200407 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f4004f9c0 0x7f1f40051e80 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7f1f44001f90 tx=0x7f1f44002860).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:18.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7ff9931e8700 1 Processor -- start 2020-05-18T21:29:18.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7ff9931e8700 1 -- start start 2020-05-18T21:29:18.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7ff9931e8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff98c144890 0x7ff98c05bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:18.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7ff9931e8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff98c065960 0x7ff98c065df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:18.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7ff9931e8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff98c0b3310 con 0x7ff98c13de40 2020-05-18T21:29:18.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7ff9931e8700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98c063e00 con 0x7ff98c144890 2020-05-18T21:29:18.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7ff9931e8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c0640a0 con 0x7ff98c065960 2020-05-18T21:29:18.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7ff9919e5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff98c144890 0x7ff98c05bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:18.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7ff9919e5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff98c144890 0x7ff98c05bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56472/0 (socket says 172.21.15.63:56472) 2020-05-18T21:29:18.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7ff9919e5700 1 -- 172.21.15.63:0/3775869532 learned_addr learned my addr 172.21.15.63:0/3775869532 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:18.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7ff9929e7700 1 --2- 172.21.15.63:0/3775869532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff98c065960 0x7ff98c065df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:18.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7ff9919e5700 1 -- 172.21.15.63:0/3775869532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff98c065960 msgr2=0x7ff98c065df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:18.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7ff9919e5700 1 --2- 172.21.15.63:0/3775869532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff98c065960 0x7ff98c065df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:18.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7ff9919e5700 1 -- 172.21.15.63:0/3775869532 >> v1:172.21.15.155:6789/0 conn(0x7ff98c13de40 legacy=0x7ff98c0b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:18.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7ff9919e5700 1 -- 172.21.15.63:0/3775869532 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c13e220 con 0x7ff98c144890 2020-05-18T21:29:18.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7ff9919e5700 1 --2- 172.21.15.63:0/3775869532 >> v2:172.21.15.63:3300/0 conn(0x7ff98c144890 0x7ff98c05bb00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff988002f70 tx=0x7ff988007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7ff9919e5700 1 --2- 172.21.15.63:0/3775869532 >> v2:172.21.15.63:3300/0 conn(0x7ff98c144890 0x7ff98c05bb00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff988002f70 tx=0x7ff988007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.481+0000 7ff9919e5700 1 --2- 172.21.15.63:0/3775869532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff98c144890 0x7ff98c05bb00 secure :-1 s=READY pgs=737 cs=0 l=1 rx=0x7ff988002f70 tx=0x7ff988007a80).ready entity=mon.0 client_cookie=711e97585a4bc55c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:18.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.485+0000 7ff9919e5700 1 --2- 172.21.15.63:0/3775869532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff98c144890 0x7ff98c05bb00 secure :-1 s=THROTTLE_DONE pgs=737 cs=0 l=1 rx=0x7ff988002f70 tx=0x7ff988007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.485+0000 7ff9919e5700 1 --2- 172.21.15.63:0/3775869532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff98c144890 0x7ff98c05bb00 secure :-1 s=THROTTLE_DONE pgs=737 cs=0 l=1 rx=0x7ff988002f70 tx=0x7ff988007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.485+0000 7ff9919e5700 1 --2- 172.21.15.63:0/3775869532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff98c144890 0x7ff98c05bb00 secure :-1 s=THROTTLE_DONE pgs=737 cs=0 l=1 rx=0x7ff988002f70 tx=0x7ff988007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.485+0000 7ff9911e4700 1 -- 172.21.15.63:0/3775869532 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff988011760 con 0x7ff98c144890 2020-05-18T21:29:18.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.485+0000 7ff9911e4700 1 -- 172.21.15.63:0/3775869532 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9880118c0 con 0x7ff98c144890 2020-05-18T21:29:18.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.485+0000 7ff9911e4700 1 -- 172.21.15.63:0/3775869532 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff988011ce0 con 0x7ff98c144890 2020-05-18T21:29:18.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.485+0000 7ff9931e8700 1 -- 172.21.15.63:0/3775869532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff98c144890 msgr2=0x7ff98c05bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:18.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.485+0000 7ff9931e8700 1 --2- 172.21.15.63:0/3775869532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff98c144890 0x7ff98c05bb00 secure :-1 s=READY pgs=737 cs=0 l=1 rx=0x7ff988002f70 tx=0x7ff988007a80).stop 2020-05-18T21:29:18.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.485+0000 7ff9931e8700 1 -- 172.21.15.63:0/3775869532 shutdown_connections 2020-05-18T21:29:18.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.485+0000 7ff9931e8700 1 --2- 172.21.15.63:0/3775869532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff98c065960 0x7ff98c065df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:18.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.485+0000 7ff9931e8700 1 --2- 172.21.15.63:0/3775869532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff98c144890 0x7ff98c05bb00 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:18.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.485+0000 7ff9931e8700 1 -- 172.21.15.63:0/3775869532 >> 172.21.15.63:0/3775869532 conn(0x7ff98c0b9810 msgr2=0x7ff98c0b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:18.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.485+0000 7ff9931e8700 1 -- 172.21.15.63:0/3775869532 shutdown_connections 2020-05-18T21:29:18.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.485+0000 7ff9931e8700 1 -- 172.21.15.63:0/3775869532 wait complete. 2020-05-18T21:29:18.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.485+0000 7ff9931e8700 1 Processor -- start 2020-05-18T21:29:18.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.485+0000 7ff9931e8700 1 -- start start 2020-05-18T21:29:18.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9931e8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff98c065960 0x7ff98c141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:18.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9931e8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff98c144890 0x7ff98c13c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:18.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9931e8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff98c13d5f0 con 0x7ff98c13de40 2020-05-18T21:29:18.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9931e8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98c13d0b0 con 0x7ff98c065960 2020-05-18T21:29:18.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9931e8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c13d350 con 0x7ff98c144890 2020-05-18T21:29:18.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9919e5700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff98c13de40 0x7ff98c137700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58666/0 (socket says 172.21.15.63:58666) 2020-05-18T21:29:18.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9919e5700 1 -- 172.21.15.63:0/2584677332 learned_addr learned my addr 172.21.15.63:0/2584677332 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:18.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9921e6700 1 --2- 172.21.15.63:0/2584677332 >> v2:172.21.15.155:3300/0 conn(0x7ff98c065960 0x7ff98c141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:18.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9929e7700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff98c144890 0x7ff98c13c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:18.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff97f7fe700 1 -- 172.21.15.63:0/2584677332 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178682506 0 0) 0x7ff98c13d5f0 con 0x7ff98c13de40 2020-05-18T21:29:18.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff97f7fe700 1 -- 172.21.15.63:0/2584677332 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff96c002fe0 con 0x7ff98c13de40 2020-05-18T21:29:18.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff97f7fe700 1 -- 172.21.15.63:0/2584677332 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2578567427 0 0) 0x7ff96c002fe0 con 0x7ff98c13de40 2020-05-18T21:29:18.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff97f7fe700 1 -- 172.21.15.63:0/2584677332 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff98c13d5f0 con 0x7ff98c13de40 2020-05-18T21:29:18.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff97f7fe700 1 -- 172.21.15.63:0/2584677332 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7ff988008600 con 0x7ff98c13de40 2020-05-18T21:29:18.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff97f7fe700 1 -- 172.21.15.63:0/2584677332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff98c144890 msgr2=0x7ff98c13c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:18.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff97f7fe700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff98c144890 0x7ff98c13c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:18.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff97f7fe700 1 -- 172.21.15.63:0/2584677332 >> v2:172.21.15.155:3300/0 conn(0x7ff98c065960 msgr2=0x7ff98c141450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:18.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff97f7fe700 1 --2- 172.21.15.63:0/2584677332 >> v2:172.21.15.155:3300/0 conn(0x7ff98c065960 0x7ff98c141450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:18.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff97f7fe700 1 -- 172.21.15.63:0/2584677332 >> v1:172.21.15.63:6789/0 conn(0x7ff98c13de40 legacy=0x7ff98c137700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:18.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff97f7fe700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff96c004a80 0x7ff96c004e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:18.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff97f7fe700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0039a0 0x7ff96c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:18.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff97f7fe700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff96c004240 0x7ff96c00b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:18.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff97f7fe700 1 -- 172.21.15.63:0/2584677332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c13d0b0 con 0x7ff96c0039a0 2020-05-18T21:29:18.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff97f7fe700 1 -- 172.21.15.63:0/2584677332 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c13d350 con 0x7ff96c004a80 2020-05-18T21:29:18.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff97f7fe700 1 -- 172.21.15.63:0/2584677332 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c004770 con 0x7ff96c004240 2020-05-18T21:29:18.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9921e6700 1 --2- 172.21.15.63:0/2584677332 >> v2:172.21.15.155:3300/0 conn(0x7ff98c065960 0x7ff98c141450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:29:18.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9919e5700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0039a0 0x7ff96c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:18.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9929e7700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff96c004240 0x7ff96c00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:18.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9921e6700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff96c004a80 0x7ff96c004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:18.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9919e5700 1 -- 172.21.15.63:0/2584677332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff96c004240 msgr2=0x7ff96c00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:18.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9919e5700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff96c004240 0x7ff96c00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:18.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9919e5700 1 -- 172.21.15.63:0/2584677332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff96c004a80 msgr2=0x7ff96c004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:18.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9919e5700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff96c004a80 0x7ff96c004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:18.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9919e5700 1 -- 172.21.15.63:0/2584677332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c137e10 con 0x7ff96c0039a0 2020-05-18T21:29:18.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9921e6700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff96c004a80 0x7ff96c004e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:29:18.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9919e5700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0039a0 0x7ff96c003de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff988008320 tx=0x7ff988007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9931e8700 1 -- 172.21.15.63:0/2584677332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98c138060 con 0x7ff96c0039a0 2020-05-18T21:29:18.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9931e8700 1 -- 172.21.15.63:0/2584677332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98c13cbc0 con 0x7ff96c0039a0 2020-05-18T21:29:18.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9919e5700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0039a0 0x7ff96c003de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff988008320 tx=0x7ff988007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9919e5700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0039a0 0x7ff96c003de0 secure :-1 s=READY pgs=739 cs=0 l=1 rx=0x7ff988008320 tx=0x7ff988007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:18.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9919e5700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0039a0 0x7ff96c003de0 secure :-1 s=THROTTLE_DONE pgs=739 cs=0 l=1 rx=0x7ff988008320 tx=0x7ff988007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff97f7fe700 1 -- 172.21.15.63:0/2584677332 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff98800ae00 con 0x7ff96c0039a0 2020-05-18T21:29:18.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9919e5700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0039a0 0x7ff96c003de0 secure :-1 s=THROTTLE_DONE pgs=739 cs=0 l=1 rx=0x7ff988008320 tx=0x7ff988007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9919e5700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0039a0 0x7ff96c003de0 secure :-1 s=THROTTLE_DONE pgs=739 cs=0 l=1 rx=0x7ff988008320 tx=0x7ff988007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff97f7fe700 1 -- 172.21.15.63:0/2584677332 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff988007170 con 0x7ff96c0039a0 2020-05-18T21:29:18.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff97f7fe700 1 -- 172.21.15.63:0/2584677332 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff988007510 con 0x7ff96c0039a0 2020-05-18T21:29:18.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.489+0000 7ff9919e5700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0039a0 0x7ff96c003de0 secure :-1 s=THROTTLE_DONE pgs=739 cs=0 l=1 rx=0x7ff988008320 tx=0x7ff988007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.493+0000 7ff9931e8700 1 -- 172.21.15.63:0/2584677332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff968003380 con 0x7ff96c0039a0 2020-05-18T21:29:18.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.493+0000 7ff97f7fe700 1 -- 172.21.15.63:0/2584677332 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff988005700 con 0x7ff96c0039a0 2020-05-18T21:29:18.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.493+0000 7ff9919e5700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0039a0 0x7ff96c003de0 secure :-1 s=THROTTLE_DONE pgs=739 cs=0 l=1 rx=0x7ff988008320 tx=0x7ff988007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.493+0000 7ff97f7fe700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff96c0580e0 0x7ff96c05a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:18.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.493+0000 7ff97f7fe700 1 -- 172.21.15.63:0/2584677332 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff988064d70 con 0x7ff96c0039a0 2020-05-18T21:29:18.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.493+0000 7ff9921e6700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff96c0580e0 0x7ff96c05a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:18.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.493+0000 7ff9921e6700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff96c0580e0 0x7ff96c05a5a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff98c061740 tx=0x7ff980001420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.493+0000 7ff9921e6700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff96c0580e0 0x7ff96c05a5a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff98c061740 tx=0x7ff980001420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.493+0000 7ff9921e6700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff96c0580e0 0x7ff96c05a5a0 secure :-1 s=READY pgs=298 cs=0 l=1 rx=0x7ff98c061740 tx=0x7ff980001420).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:18.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.497+0000 7ff9919e5700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0039a0 0x7ff96c003de0 secure :-1 s=THROTTLE_DONE pgs=739 cs=0 l=1 rx=0x7ff988008320 tx=0x7ff988007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.497+0000 7ff97f7fe700 1 -- 172.21.15.63:0/2584677332 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff98803f220 con 0x7ff96c0039a0 2020-05-18T21:29:18.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.485+0000 7f1f5a59c700 1 --2- 172.21.15.63:0/2524200407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5c066190 0x7f1f5c1477c0 secure :-1 s=THROTTLE_DONE pgs=736 cs=0 l=1 rx=0x7f1f5c09c790 tx=0x7f1f4c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:18.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.485+0000 7f1f537fe700 1 -- 172.21.15.63:0/2524200407 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f1f4c03e8e0 con 0x7f1f5c066190 2020-05-18T21:29:18.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.637+0000 7f1f60b50700 1 -- 172.21.15.63:0/2524200407 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f1f5c153dd0 con 0x7f1f5c066190 2020-05-18T21:29:18.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:18.649+0000 7ff9931e8700 1 -- 172.21.15.63:0/2584677332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7ff968002210 con 0x7ff96c0039a0 2020-05-18T21:29:19.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.477+0000 7f1f5a59c700 1 --2- 172.21.15.63:0/2524200407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5c066190 0x7f1f5c1477c0 secure :-1 s=READY pgs=736 cs=0 l=1 rx=0x7f1f5c09c790 tx=0x7f1f4c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.489+0000 7ff9919e5700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0039a0 0x7ff96c003de0 secure :-1 s=READY pgs=739 cs=0 l=1 rx=0x7ff988008320 tx=0x7ff988007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.605 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:29:19.601+0000 7fdb4592c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:29:19.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.609+0000 7f1f5a59c700 1 --2- 172.21.15.63:0/2524200407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5c066190 0x7f1f5c1477c0 secure :-1 s=THROTTLE_DONE pgs=736 cs=0 l=1 rx=0x7f1f5c09c790 tx=0x7f1f4c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.609+0000 7f1f537fe700 1 -- 172.21.15.63:0/2524200407 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5138 v28) v1 ==== 95+0+0 (secure 0 0 0) 0x7f1f4c041f00 con 0x7f1f5c066190 2020-05-18T21:29:19.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.609+0000 7ff9919e5700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0039a0 0x7ff96c003de0 secure :-1 s=THROTTLE_DONE pgs=739 cs=0 l=1 rx=0x7ff988008320 tx=0x7ff988007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.609+0000 7ff97f7fe700 1 -- 172.21.15.63:0/2584677332 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 5135 v28) v1 ==== 95+0+0 (secure 0 0 0) 0x7ff988042840 con 0x7ff96c0039a0 2020-05-18T21:29:19.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7f1f60b50700 1 -- 172.21.15.63:0/2524200407 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f4004f9c0 msgr2=0x7f1f40051e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:19.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7f1f60b50700 1 --2- 172.21.15.63:0/2524200407 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f4004f9c0 0x7f1f40051e80 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7f1f44001f90 tx=0x7f1f44002860).stop 2020-05-18T21:29:19.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7f1f60b50700 1 -- 172.21.15.63:0/2524200407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5c066190 msgr2=0x7f1f5c1477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7f1f60b50700 1 --2- 172.21.15.63:0/2524200407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5c066190 0x7f1f5c1477c0 secure :-1 s=READY pgs=736 cs=0 l=1 rx=0x7f1f5c09c790 tx=0x7f1f4c007a80).stop 2020-05-18T21:29:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7f1f60b50700 1 -- 172.21.15.63:0/2524200407 shutdown_connections 2020-05-18T21:29:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7f1f60b50700 1 --2- 172.21.15.63:0/2524200407 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1f4004f9c0 0x7f1f40051e80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7f1f60b50700 1 --2- 172.21.15.63:0/2524200407 >> v2:172.21.15.155:3300/0 conn(0x7f1f5c066570 0x7f1f5c154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7f1f60b50700 1 --2- 172.21.15.63:0/2524200407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5c066190 0x7f1f5c1477c0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7f1f60b50700 1 -- 172.21.15.63:0/2524200407 >> 172.21.15.63:0/2524200407 conn(0x7f1f5c05eb50 msgr2=0x7f1f5c149c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7f1f60b50700 1 -- 172.21.15.63:0/2524200407 shutdown_connections 2020-05-18T21:29:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7f1f60b50700 1 -- 172.21.15.63:0/2524200407 wait complete. 2020-05-18T21:29:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7ff9931e8700 1 -- 172.21.15.63:0/2584677332 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff96c0580e0 msgr2=0x7ff96c05a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7ff9931e8700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff96c0580e0 0x7ff96c05a5a0 secure :-1 s=READY pgs=298 cs=0 l=1 rx=0x7ff98c061740 tx=0x7ff980001420).stop 2020-05-18T21:29:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7ff9931e8700 1 -- 172.21.15.63:0/2584677332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0039a0 msgr2=0x7ff96c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7ff9929e7700 1 -- 172.21.15.63:0/2584677332 reap_dead start 2020-05-18T21:29:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7ff9931e8700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0039a0 0x7ff96c003de0 secure :-1 s=READY pgs=739 cs=0 l=1 rx=0x7ff988008320 tx=0x7ff988007a80).stop 2020-05-18T21:29:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7ff9931e8700 1 -- 172.21.15.63:0/2584677332 shutdown_connections 2020-05-18T21:29:19.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7ff9931e8700 1 --2- 172.21.15.63:0/2584677332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0039a0 0x7ff96c003de0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:19.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7ff9931e8700 1 -- 172.21.15.63:0/2584677332 >> 172.21.15.63:0/2584677332 conn(0x7ff98c0b9810 msgr2=0x7ff98c1422e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:19.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7ff9931e8700 1 -- 172.21.15.63:0/2584677332 shutdown_connections 2020-05-18T21:29:19.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.613+0000 7ff9931e8700 1 -- 172.21.15.63:0/2584677332 wait complete. 2020-05-18T21:29:19.624 INFO:teuthology.orchestra.run.smithi063.stderr:failed mds gid 5138 2020-05-18T21:29:19.624 INFO:teuthology.orchestra.run.smithi063.stderr:failed mds gid 5135 2020-05-18T21:29:19.636 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:29:19.636 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:29:19.637 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:29:19.638 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:29:19.640 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:29:19.640 DEBUG:teuthology.parallel:result is None 2020-05-18T21:29:19.641 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:29:19.642 DEBUG:teuthology.parallel:result is None 2020-05-18T21:29:19.642 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:19.719 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:29:19.719 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:29:19.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.741+0000 7f9d52aa9700 1 Processor -- start 2020-05-18T21:29:19.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.741+0000 7f9d52aa9700 1 -- start start 2020-05-18T21:29:19.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.741+0000 7f9d52aa9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9d4c149fd0 0x7f9d4c1465d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:19.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.741+0000 7f9d52aa9700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4c146170 con 0x7f9d4c146a30 2020-05-18T21:29:19.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.741+0000 7f9d52aa9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4c05bf80 con 0x7f9d4c0ba170 2020-05-18T21:29:19.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.741+0000 7f9d52aa9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4c05ba40 con 0x7f9d4c149fd0 2020-05-18T21:29:19.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.741+0000 7f9d51046700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9d4c146a30 0x7f9d4c143060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58698/0 (socket says 172.21.15.63:58698) 2020-05-18T21:29:19.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.741+0000 7f9d51046700 1 -- 172.21.15.63:0/2435347642 learned_addr learned my addr 172.21.15.63:0/2435347642 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:19.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.741+0000 7f9d4bfff700 1 --2- 172.21.15.63:0/2435347642 >> v2:172.21.15.155:3300/0 conn(0x7f9d4c149fd0 0x7f9d4c1465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:19.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.741+0000 7f9d4bfff700 1 -- 172.21.15.63:0/2435347642 >> v1:172.21.15.155:6789/0 conn(0x7f9d4c0ba170 legacy=0x7f9d4c09dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:19.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.741+0000 7f9d4bfff700 1 -- 172.21.15.63:0/2435347642 >> v1:172.21.15.63:6789/0 conn(0x7f9d4c146a30 legacy=0x7f9d4c143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:19.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.741+0000 7f9d4bfff700 1 -- 172.21.15.63:0/2435347642 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c05bce0 con 0x7f9d4c149fd0 2020-05-18T21:29:19.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.741+0000 7f9d4bfff700 1 --2- 172.21.15.63:0/2435347642 >> v2:172.21.15.155:3300/0 conn(0x7f9d4c149fd0 0x7f9d4c1465d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9d38002f70 tx=0x7f9d38007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.741+0000 7f9d4bfff700 1 --2- 172.21.15.63:0/2435347642 >> v2:172.21.15.155:3300/0 conn(0x7f9d4c149fd0 0x7f9d4c1465d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9d38002f70 tx=0x7f9d38007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.741+0000 7f9d4bfff700 1 --2- 172.21.15.63:0/2435347642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d4c149fd0 0x7f9d4c1465d0 secure :-1 s=READY pgs=529 cs=0 l=1 rx=0x7f9d38002f70 tx=0x7f9d38007a80).ready entity=mon.1 client_cookie=4a9dd19f53e44818 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:19.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.745+0000 7f9d4bfff700 1 --2- 172.21.15.63:0/2435347642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d4c149fd0 0x7f9d4c1465d0 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7f9d38002f70 tx=0x7f9d38007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.745+0000 7f9d4b7fe700 1 -- 172.21.15.63:0/2435347642 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d38008e80 con 0x7f9d4c149fd0 2020-05-18T21:29:19.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.745+0000 7f9d4bfff700 1 --2- 172.21.15.63:0/2435347642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d4c149fd0 0x7f9d4c1465d0 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7f9d38002f70 tx=0x7f9d38007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.745+0000 7f9d4bfff700 1 --2- 172.21.15.63:0/2435347642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d4c149fd0 0x7f9d4c1465d0 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7f9d38002f70 tx=0x7f9d38007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.745+0000 7f9d4b7fe700 1 -- 172.21.15.63:0/2435347642 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d380116a0 con 0x7f9d4c149fd0 2020-05-18T21:29:19.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.745+0000 7f9d4b7fe700 1 -- 172.21.15.63:0/2435347642 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d38011ac0 con 0x7f9d4c149fd0 2020-05-18T21:29:19.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.745+0000 7f9d52aa9700 1 -- 172.21.15.63:0/2435347642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d4c149fd0 msgr2=0x7f9d4c1465d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:19.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.745+0000 7f9d52aa9700 1 --2- 172.21.15.63:0/2435347642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d4c149fd0 0x7f9d4c1465d0 secure :-1 s=READY pgs=529 cs=0 l=1 rx=0x7f9d38002f70 tx=0x7f9d38007a80).stop 2020-05-18T21:29:19.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.749+0000 7f9d52aa9700 1 -- 172.21.15.63:0/2435347642 shutdown_connections 2020-05-18T21:29:19.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.749+0000 7f9d52aa9700 1 --2- 172.21.15.63:0/2435347642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d4c149fd0 0x7f9d4c1465d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:19.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.749+0000 7f9d52aa9700 1 -- 172.21.15.63:0/2435347642 >> 172.21.15.63:0/2435347642 conn(0x7f9d4c05fb30 msgr2=0x7f9d4c0b9720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:19.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.749+0000 7f9d52aa9700 1 -- 172.21.15.63:0/2435347642 shutdown_connections 2020-05-18T21:29:19.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.749+0000 7f9d52aa9700 1 -- 172.21.15.63:0/2435347642 wait complete. 2020-05-18T21:29:19.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.749+0000 7f9d52aa9700 1 Processor -- start 2020-05-18T21:29:19.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.749+0000 7f9d52aa9700 1 -- start start 2020-05-18T21:29:19.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.749+0000 7f9d52aa9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d4c0ba170 0x7f9d4c157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:19.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.749+0000 7f9d52aa9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9d4c146a30 0x7f9d4c0b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:19.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.749+0000 7f9d52aa9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9d4c149fd0 0x7f9d4c12e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:19.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.749+0000 7f9d52aa9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4c157e50 con 0x7f9d4c149fd0 2020-05-18T21:29:19.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.749+0000 7f9d52aa9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4c0af9a0 con 0x7f9d4c146a30 2020-05-18T21:29:19.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.749+0000 7f9d52aa9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c0afc40 con 0x7f9d4c0ba170 2020-05-18T21:29:19.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.749+0000 7f9d51046700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9d4c149fd0 0x7f9d4c12e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:19.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.749+0000 7f9d51046700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9d4c149fd0 0x7f9d4c12e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56516/0 (socket says 172.21.15.63:56516) 2020-05-18T21:29:19.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.749+0000 7f9d51046700 1 -- 172.21.15.63:0/2435828893 learned_addr learned my addr 172.21.15.63:0/2435828893 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:19.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.749+0000 7f9d4bfff700 1 --2- 172.21.15.63:0/2435828893 >> v2:172.21.15.155:3300/0 conn(0x7f9d4c146a30 0x7f9d4c0b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:19.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.749+0000 7f9d50845700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d4c0ba170 0x7f9d4c157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:19.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d51046700 1 -- 172.21.15.63:0/2435828893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d4c0ba170 msgr2=0x7f9d4c157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:19.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d51046700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d4c0ba170 0x7f9d4c157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:19.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d51046700 1 -- 172.21.15.63:0/2435828893 >> v2:172.21.15.155:3300/0 conn(0x7f9d4c146a30 msgr2=0x7f9d4c0b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:19.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d51046700 1 --2- 172.21.15.63:0/2435828893 >> v2:172.21.15.155:3300/0 conn(0x7f9d4c146a30 0x7f9d4c0b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:19.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d51046700 1 -- 172.21.15.63:0/2435828893 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c0b00e0 con 0x7f9d4c149fd0 2020-05-18T21:29:19.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d51046700 1 --2- 172.21.15.63:0/2435828893 >> v2:172.21.15.63:3300/0 conn(0x7f9d4c149fd0 0x7f9d4c12e6f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9d4c067430 tx=0x7f9d44010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d51046700 1 --2- 172.21.15.63:0/2435828893 >> v2:172.21.15.63:3300/0 conn(0x7f9d4c149fd0 0x7f9d4c12e6f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9d4c067430 tx=0x7f9d44010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d51046700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d4c149fd0 0x7f9d4c12e6f0 secure :-1 s=READY pgs=746 cs=0 l=1 rx=0x7f9d4c067430 tx=0x7f9d44010c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:19.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d51046700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d4c149fd0 0x7f9d4c12e6f0 secure :-1 s=THROTTLE_DONE pgs=746 cs=0 l=1 rx=0x7f9d4c067430 tx=0x7f9d44010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d49ffb700 1 -- 172.21.15.63:0/2435828893 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d44005e30 con 0x7f9d4c149fd0 2020-05-18T21:29:19.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d51046700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d4c149fd0 0x7f9d4c12e6f0 secure :-1 s=THROTTLE_DONE pgs=746 cs=0 l=1 rx=0x7f9d4c067430 tx=0x7f9d44010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d51046700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d4c149fd0 0x7f9d4c12e6f0 secure :-1 s=THROTTLE_DONE pgs=746 cs=0 l=1 rx=0x7f9d4c067430 tx=0x7f9d44010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d49ffb700 1 -- 172.21.15.63:0/2435828893 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d44012450 con 0x7f9d4c149fd0 2020-05-18T21:29:19.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d49ffb700 1 -- 172.21.15.63:0/2435828893 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d44012870 con 0x7f9d4c149fd0 2020-05-18T21:29:19.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d52aa9700 1 -- 172.21.15.63:0/2435828893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4c0b0390 con 0x7f9d4c149fd0 2020-05-18T21:29:19.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d52aa9700 1 -- 172.21.15.63:0/2435828893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4c0b0840 con 0x7f9d4c149fd0 2020-05-18T21:29:19.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d51046700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d4c149fd0 0x7f9d4c12e6f0 secure :-1 s=THROTTLE_DONE pgs=746 cs=0 l=1 rx=0x7f9d4c067430 tx=0x7f9d44010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d52aa9700 1 -- 172.21.15.63:0/2435828893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4c0569e0 con 0x7f9d4c149fd0 2020-05-18T21:29:19.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d49ffb700 1 -- 172.21.15.63:0/2435828893 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9d44013070 con 0x7f9d4c149fd0 2020-05-18T21:29:19.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d51046700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d4c149fd0 0x7f9d4c12e6f0 secure :-1 s=THROTTLE_DONE pgs=746 cs=0 l=1 rx=0x7f9d4c067430 tx=0x7f9d44010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d49ffb700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9d3404fa60 0x7f9d34051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:19.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d49ffb700 1 -- 172.21.15.63:0/2435828893 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9d440090c0 con 0x7f9d4c149fd0 2020-05-18T21:29:19.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.753+0000 7f9d50845700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9d3404fa60 0x7f9d34051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:19.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.757+0000 7f9d50845700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9d3404fa60 0x7f9d34051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9d4c061a90 tx=0x7f9d40003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.757+0000 7f9d50845700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9d3404fa60 0x7f9d34051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9d4c061a90 tx=0x7f9d40003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.757+0000 7f9d50845700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9d3404fa60 0x7f9d34051f20 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f9d4c061a90 tx=0x7f9d40003e60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.757+0000 7f9d51046700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d4c149fd0 0x7f9d4c12e6f0 secure :-1 s=THROTTLE_DONE pgs=746 cs=0 l=1 rx=0x7f9d4c067430 tx=0x7f9d44010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.757+0000 7f9d49ffb700 1 -- 172.21.15.63:0/2435828893 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9d4403e3d0 con 0x7f9d4c149fd0 2020-05-18T21:29:19.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.909+0000 7f9d52aa9700 1 -- 172.21.15.63:0/2435828893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d4c066900 con 0x7f9d4c149fd0 2020-05-18T21:29:19.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.909+0000 7f9d51046700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d4c149fd0 0x7f9d4c12e6f0 secure :-1 s=THROTTLE_DONE pgs=746 cs=0 l=1 rx=0x7f9d4c067430 tx=0x7f9d44010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:19.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.909+0000 7f9d49ffb700 1 -- 172.21.15.63:0/2435828893 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+1427 (secure 0 0 0) 0x7f9d440419f0 con 0x7f9d4c149fd0 2020-05-18T21:29:19.916 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:19.916 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":28,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:19.604252+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:19.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.909+0000 7f9d52aa9700 1 -- 172.21.15.63:0/2435828893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9d3404fa60 msgr2=0x7f9d34051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:19.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.909+0000 7f9d52aa9700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9d3404fa60 0x7f9d34051f20 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f9d4c061a90 tx=0x7f9d40003e60).stop 2020-05-18T21:29:19.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.913+0000 7f9d52aa9700 1 -- 172.21.15.63:0/2435828893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d4c149fd0 msgr2=0x7f9d4c12e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:19.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.913+0000 7f9d52aa9700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d4c149fd0 0x7f9d4c12e6f0 secure :-1 s=READY pgs=746 cs=0 l=1 rx=0x7f9d4c067430 tx=0x7f9d44010c70).stop 2020-05-18T21:29:19.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.913+0000 7f9d52aa9700 1 -- 172.21.15.63:0/2435828893 shutdown_connections 2020-05-18T21:29:19.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.913+0000 7f9d52aa9700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9d3404fa60 0x7f9d34051f20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:19.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.913+0000 7f9d52aa9700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d4c149fd0 0x7f9d4c12e6f0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:19.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.913+0000 7f9d52aa9700 1 --2- 172.21.15.63:0/2435828893 >> v2:172.21.15.155:3300/0 conn(0x7f9d4c146a30 0x7f9d4c0b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:19.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.913+0000 7f9d52aa9700 1 --2- 172.21.15.63:0/2435828893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d4c0ba170 0x7f9d4c157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:19.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.913+0000 7f9d52aa9700 1 -- 172.21.15.63:0/2435828893 >> 172.21.15.63:0/2435828893 conn(0x7f9d4c05fb30 msgr2=0x7f9d4c09dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:19.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.913+0000 7f9d52aa9700 1 -- 172.21.15.63:0/2435828893 shutdown_connections 2020-05-18T21:29:19.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:19.913+0000 7f9d52aa9700 1 -- 172.21.15.63:0/2435828893 wait complete. 2020-05-18T21:29:19.921 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 28 2020-05-18T21:29:20.130 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:29:10.174981+0000', 'modified': '2020-05-18T21:29:19.604252+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 62, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:29:20.131 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2020-05-18T21:29:21.132 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:21.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfd510a700 1 Processor -- start 2020-05-18T21:29:21.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfd510a700 1 -- start start 2020-05-18T21:29:21.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfd510a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcfd00b5050 0x7fcfd014da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:21.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfd510a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcfd00648f0 0x7fcfd014aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:21.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfd510a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd014aa50 con 0x7fcfd0065f70 2020-05-18T21:29:21.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfd510a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd014a840 con 0x7fcfd00b5050 2020-05-18T21:29:21.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfd510a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd0066af0 con 0x7fcfd00648f0 2020-05-18T21:29:21.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfced9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcfd00b5050 0x7fcfd014da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:21.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfced9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcfd00b5050 0x7fcfd014da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56520/0 (socket says 172.21.15.63:56520) 2020-05-18T21:29:21.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfced9d700 1 -- 172.21.15.63:0/4042084744 learned_addr learned my addr 172.21.15.63:0/4042084744 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:21.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfce59c700 1 --2- 172.21.15.63:0/4042084744 >> v2:172.21.15.155:3300/0 conn(0x7fcfd00648f0 0x7fcfd014aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:21.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfce59c700 1 -- 172.21.15.63:0/4042084744 >> v2:172.21.15.63:3300/0 conn(0x7fcfd00b5050 msgr2=0x7fcfd014da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:21.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfce59c700 1 --2- 172.21.15.63:0/4042084744 >> v2:172.21.15.63:3300/0 conn(0x7fcfd00b5050 0x7fcfd014da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:21.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfce59c700 1 -- 172.21.15.63:0/4042084744 >> v1:172.21.15.63:6789/0 conn(0x7fcfd0065f70 legacy=0x7fcfd00663e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:21.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfce59c700 1 -- 172.21.15.63:0/4042084744 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd00b5430 con 0x7fcfd00648f0 2020-05-18T21:29:21.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfced9d700 1 --2- 172.21.15.63:0/4042084744 >> v2:172.21.15.63:3300/0 conn(0x7fcfd00b5050 0x7fcfd014da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:29:21.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfce59c700 1 --2- 172.21.15.63:0/4042084744 >> v2:172.21.15.155:3300/0 conn(0x7fcfd00648f0 0x7fcfd014aef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcfc80032f0 tx=0x7fcfc8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:21.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfce59c700 1 --2- 172.21.15.63:0/4042084744 >> v2:172.21.15.155:3300/0 conn(0x7fcfd00648f0 0x7fcfd014aef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcfc80032f0 tx=0x7fcfc8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:21.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfce59c700 1 --2- 172.21.15.63:0/4042084744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfd00648f0 0x7fcfd014aef0 secure :-1 s=READY pgs=530 cs=0 l=1 rx=0x7fcfc80032f0 tx=0x7fcfc8007e00).ready entity=mon.1 client_cookie=cec8ace7f68017a9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:21.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfce59c700 1 --2- 172.21.15.63:0/4042084744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfd00648f0 0x7fcfd014aef0 secure :-1 s=THROTTLE_DONE pgs=530 cs=0 l=1 rx=0x7fcfc80032f0 tx=0x7fcfc8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:21.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfcdd9b700 1 -- 172.21.15.63:0/4042084744 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfc8011e60 con 0x7fcfd00648f0 2020-05-18T21:29:21.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfce59c700 1 --2- 172.21.15.63:0/4042084744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfd00648f0 0x7fcfd014aef0 secure :-1 s=THROTTLE_DONE pgs=530 cs=0 l=1 rx=0x7fcfc80032f0 tx=0x7fcfc8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:21.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfcdd9b700 1 -- 172.21.15.63:0/4042084744 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc800a180 con 0x7fcfd00648f0 2020-05-18T21:29:21.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfce59c700 1 --2- 172.21.15.63:0/4042084744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfd00648f0 0x7fcfd014aef0 secure :-1 s=THROTTLE_DONE pgs=530 cs=0 l=1 rx=0x7fcfc80032f0 tx=0x7fcfc8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:21.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfd510a700 1 -- 172.21.15.63:0/4042084744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfd00648f0 msgr2=0x7fcfd014aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:21.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfd510a700 1 --2- 172.21.15.63:0/4042084744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfd00648f0 0x7fcfd014aef0 secure :-1 s=READY pgs=530 cs=0 l=1 rx=0x7fcfc80032f0 tx=0x7fcfc8007e00).stop 2020-05-18T21:29:21.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.241+0000 7fcfcdd9b700 1 -- 172.21.15.63:0/4042084744 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfc800a560 con 0x7fcfd00648f0 2020-05-18T21:29:21.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfd510a700 1 -- 172.21.15.63:0/4042084744 shutdown_connections 2020-05-18T21:29:21.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfd510a700 1 --2- 172.21.15.63:0/4042084744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfd00648f0 0x7fcfd014aef0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:21.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfd510a700 1 --2- 172.21.15.63:0/4042084744 >> v2:172.21.15.63:3300/0 conn(0x7fcfd00b5050 0x7fcfd014da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:21.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfd510a700 1 -- 172.21.15.63:0/4042084744 >> 172.21.15.63:0/4042084744 conn(0x7fcfd00b8630 msgr2=0x7fcfd00b8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:21.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfd510a700 1 -- 172.21.15.63:0/4042084744 shutdown_connections 2020-05-18T21:29:21.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfd510a700 1 -- 172.21.15.63:0/4042084744 wait complete. 2020-05-18T21:29:21.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfd510a700 1 Processor -- start 2020-05-18T21:29:21.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfd510a700 1 -- start start 2020-05-18T21:29:21.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfd510a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcfd00648f0 0x7fcfd0132e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:21.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfd510a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfd0065f70 0x7fcfd015b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:21.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfd510a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd015be00 con 0x7fcfd00b5050 2020-05-18T21:29:21.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfd510a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd0131a80 con 0x7fcfd00648f0 2020-05-18T21:29:21.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfd510a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd012fe90 con 0x7fcfd0065f70 2020-05-18T21:29:21.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfced9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcfd00648f0 0x7fcfd0132e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:21.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfced9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcfd00648f0 0x7fcfd0132e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56526/0 (socket says 172.21.15.63:56526) 2020-05-18T21:29:21.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfced9d700 1 -- 172.21.15.63:0/2138181969 learned_addr learned my addr 172.21.15.63:0/2138181969 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:21.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfce59c700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfd0065f70 0x7fcfd015b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:21.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfced9d700 1 -- 172.21.15.63:0/2138181969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfd0065f70 msgr2=0x7fcfd015b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:21.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfced9d700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfd0065f70 0x7fcfd015b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:21.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfced9d700 1 -- 172.21.15.63:0/2138181969 >> v1:172.21.15.63:6789/0 conn(0x7fcfd00b5050 legacy=0x7fcfd0131370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:21.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfced9d700 1 -- 172.21.15.63:0/2138181969 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd0130130 con 0x7fcfd00648f0 2020-05-18T21:29:21.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfced9d700 1 --2- 172.21.15.63:0/2138181969 >> v2:172.21.15.63:3300/0 conn(0x7fcfd00648f0 0x7fcfd0132e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcfb8007760 tx=0x7fcfb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:21.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfced9d700 1 --2- 172.21.15.63:0/2138181969 >> v2:172.21.15.63:3300/0 conn(0x7fcfd00648f0 0x7fcfd0132e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcfb8007760 tx=0x7fcfb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:21.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.245+0000 7fcfced9d700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfd00648f0 0x7fcfd0132e50 secure :-1 s=READY pgs=749 cs=0 l=1 rx=0x7fcfb8007760 tx=0x7fcfb8007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:21.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.249+0000 7fcfced9d700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfd00648f0 0x7fcfd0132e50 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7fcfb8007760 tx=0x7fcfb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:21.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.249+0000 7fcfced9d700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfd00648f0 0x7fcfd0132e50 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7fcfb8007760 tx=0x7fcfb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:21.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.249+0000 7fcfced9d700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfd00648f0 0x7fcfd0132e50 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7fcfb8007760 tx=0x7fcfb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:21.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.249+0000 7fcfc7fff700 1 -- 172.21.15.63:0/2138181969 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfb8011d00 con 0x7fcfd00648f0 2020-05-18T21:29:21.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.249+0000 7fcfc7fff700 1 -- 172.21.15.63:0/2138181969 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb8011e60 con 0x7fcfd00648f0 2020-05-18T21:29:21.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.249+0000 7fcfd510a700 1 -- 172.21.15.63:0/2138181969 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd01303d0 con 0x7fcfd00648f0 2020-05-18T21:29:21.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.249+0000 7fcfc7fff700 1 -- 172.21.15.63:0/2138181969 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfb80059b0 con 0x7fcfd00648f0 2020-05-18T21:29:21.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.249+0000 7fcfd510a700 1 -- 172.21.15.63:0/2138181969 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd00acd30 con 0x7fcfd00648f0 2020-05-18T21:29:21.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.249+0000 7fcfced9d700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfd00648f0 0x7fcfd0132e50 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7fcfb8007760 tx=0x7fcfb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:21.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.249+0000 7fcfd510a700 1 -- 172.21.15.63:0/2138181969 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd00569e0 con 0x7fcfd00648f0 2020-05-18T21:29:21.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.249+0000 7fcfc7fff700 1 -- 172.21.15.63:0/2138181969 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fcfb8005c20 con 0x7fcfd00648f0 2020-05-18T21:29:21.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.249+0000 7fcfced9d700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfd00648f0 0x7fcfd0132e50 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7fcfb8007760 tx=0x7fcfb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:21.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.249+0000 7fcfc7fff700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcfa804fa10 0x7fcfa8051ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:21.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.249+0000 7fcfc7fff700 1 -- 172.21.15.63:0/2138181969 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fcfb8063ba0 con 0x7fcfd00648f0 2020-05-18T21:29:21.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.249+0000 7fcfce59c700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcfa804fa10 0x7fcfa8051ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:21.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.253+0000 7fcfce59c700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcfa804fa10 0x7fcfa8051ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcfc80032f0 tx=0x7fcfc8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:21.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.253+0000 7fcfce59c700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcfa804fa10 0x7fcfa8051ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcfc80032f0 tx=0x7fcfc8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:21.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.253+0000 7fcfce59c700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcfa804fa10 0x7fcfa8051ed0 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7fcfc80032f0 tx=0x7fcfc8007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:21.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.257+0000 7fcfced9d700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfd00648f0 0x7fcfd0132e50 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7fcfb8007760 tx=0x7fcfb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:21.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.257+0000 7fcfc7fff700 1 -- 172.21.15.63:0/2138181969 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fcfb803ded0 con 0x7fcfd00648f0 2020-05-18T21:29:21.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.405+0000 7fcfd510a700 1 -- 172.21.15.63:0/2138181969 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfd005e490 con 0x7fcfd00648f0 2020-05-18T21:29:21.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.405+0000 7fcfced9d700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfd00648f0 0x7fcfd0132e50 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7fcfb8007760 tx=0x7fcfb8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:21.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.405+0000 7fcfc7fff700 1 -- 172.21.15.63:0/2138181969 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+1789 (secure 0 0 0) 0x7fcfb80414f0 con 0x7fcfd00648f0 2020-05-18T21:29:21.411 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:21.411 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":30,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:20.669971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6319":{"gid":6319,"name":"b","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.155:6835/400120989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":400120989},{"type":"v1","addr":"172.21.15.155:6835","nonce":400120989}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:21.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.405+0000 7fcfd510a700 1 -- 172.21.15.63:0/2138181969 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcfa804fa10 msgr2=0x7fcfa8051ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:21.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.405+0000 7fcfd510a700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcfa804fa10 0x7fcfa8051ed0 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7fcfc80032f0 tx=0x7fcfc8007e00).stop 2020-05-18T21:29:21.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.405+0000 7fcfd510a700 1 -- 172.21.15.63:0/2138181969 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfd00648f0 msgr2=0x7fcfd0132e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:21.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.405+0000 7fcfd510a700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfd00648f0 0x7fcfd0132e50 secure :-1 s=READY pgs=749 cs=0 l=1 rx=0x7fcfb8007760 tx=0x7fcfb8007a80).stop 2020-05-18T21:29:21.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.405+0000 7fcfd510a700 1 -- 172.21.15.63:0/2138181969 shutdown_connections 2020-05-18T21:29:21.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.405+0000 7fcfd510a700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcfa804fa10 0x7fcfa8051ed0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:21.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.405+0000 7fcfd510a700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfd0065f70 0x7fcfd015b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:21.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.405+0000 7fcfd510a700 1 --2- 172.21.15.63:0/2138181969 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfd00648f0 0x7fcfd0132e50 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:21.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.405+0000 7fcfd510a700 1 -- 172.21.15.63:0/2138181969 >> 172.21.15.63:0/2138181969 conn(0x7fcfd00b8630 msgr2=0x7fcfd0149b00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:21.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.405+0000 7fcfd510a700 1 -- 172.21.15.63:0/2138181969 shutdown_connections 2020-05-18T21:29:21.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:21.405+0000 7fcfd510a700 1 -- 172.21.15.63:0/2138181969 wait complete. 2020-05-18T21:29:21.415 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 30 2020-05-18T21:29:21.625 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:29:10.174981+0000', 'modified': '2020-05-18T21:29:20.669971+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 62, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6319}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6319': {'gid': 6319, 'name': 'b', 'rank': 0, 'incarnation': 30, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.155:6835/400120989', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 400120989}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 400120989}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:29:21.626 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6319:up:replay 2020-05-18T21:29:22.627 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:22.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.733+0000 7fd58400e700 1 Processor -- start 2020-05-18T21:29:22.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.733+0000 7fd58400e700 1 -- start start 2020-05-18T21:29:22.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd58400e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd57c05fea0 0x7fd57c145c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:22.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd58400e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd57c142260 0x7fd57c0af840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:22.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd58400e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd57c0aee60 con 0x7fd57c05bc80 2020-05-18T21:29:22.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd58400e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57c0af100 con 0x7fd57c05fea0 2020-05-18T21:29:22.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd58400e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c0af3a0 con 0x7fd57c142260 2020-05-18T21:29:22.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd581daa700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd57c05fea0 0x7fd57c145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:22.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd581daa700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd57c05fea0 0x7fd57c145c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56536/0 (socket says 172.21.15.63:56536) 2020-05-18T21:29:22.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd581daa700 1 -- 172.21.15.63:0/464675630 learned_addr learned my addr 172.21.15.63:0/464675630 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:22.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd5825ab700 1 --2- 172.21.15.63:0/464675630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd57c142260 0x7fd57c0af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:22.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd581daa700 1 -- 172.21.15.63:0/464675630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd57c142260 msgr2=0x7fd57c0af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:22.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd581daa700 1 --2- 172.21.15.63:0/464675630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd57c142260 0x7fd57c0af840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:22.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd581daa700 1 -- 172.21.15.63:0/464675630 >> v1:172.21.15.155:6789/0 conn(0x7fd57c05bc80 legacy=0x7fd57c141b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:22.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd581daa700 1 -- 172.21.15.63:0/464675630 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c060280 con 0x7fd57c05fea0 2020-05-18T21:29:22.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd581daa700 1 --2- 172.21.15.63:0/464675630 >> v2:172.21.15.63:3300/0 conn(0x7fd57c05fea0 0x7fd57c145c00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd578002f70 tx=0x7fd578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:22.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd581daa700 1 --2- 172.21.15.63:0/464675630 >> v2:172.21.15.63:3300/0 conn(0x7fd57c05fea0 0x7fd57c145c00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd578002f70 tx=0x7fd578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:22.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd581daa700 1 --2- 172.21.15.63:0/464675630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd57c05fea0 0x7fd57c145c00 secure :-1 s=READY pgs=750 cs=0 l=1 rx=0x7fd578002f70 tx=0x7fd578007a80).ready entity=mon.0 client_cookie=e747f5f4adacf58c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:22.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd581daa700 1 --2- 172.21.15.63:0/464675630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd57c05fea0 0x7fd57c145c00 secure :-1 s=THROTTLE_DONE pgs=750 cs=0 l=1 rx=0x7fd578002f70 tx=0x7fd578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:22.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd581daa700 1 --2- 172.21.15.63:0/464675630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd57c05fea0 0x7fd57c145c00 secure :-1 s=THROTTLE_DONE pgs=750 cs=0 l=1 rx=0x7fd578002f70 tx=0x7fd578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:22.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd581daa700 1 --2- 172.21.15.63:0/464675630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd57c05fea0 0x7fd57c145c00 secure :-1 s=THROTTLE_DONE pgs=750 cs=0 l=1 rx=0x7fd578002f70 tx=0x7fd578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:22.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd580da8700 1 -- 172.21.15.63:0/464675630 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd578011760 con 0x7fd57c05fea0 2020-05-18T21:29:22.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd580da8700 1 -- 172.21.15.63:0/464675630 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5780118c0 con 0x7fd57c05fea0 2020-05-18T21:29:22.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd580da8700 1 -- 172.21.15.63:0/464675630 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd578011ce0 con 0x7fd57c05fea0 2020-05-18T21:29:22.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd58400e700 1 -- 172.21.15.63:0/464675630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd57c05fea0 msgr2=0x7fd57c145c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:22.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.737+0000 7fd58400e700 1 --2- 172.21.15.63:0/464675630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd57c05fea0 0x7fd57c145c00 secure :-1 s=READY pgs=750 cs=0 l=1 rx=0x7fd578002f70 tx=0x7fd578007a80).stop 2020-05-18T21:29:22.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.741+0000 7fd58400e700 1 -- 172.21.15.63:0/464675630 shutdown_connections 2020-05-18T21:29:22.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.741+0000 7fd58400e700 1 --2- 172.21.15.63:0/464675630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd57c142260 0x7fd57c0af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:22.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.741+0000 7fd58400e700 1 --2- 172.21.15.63:0/464675630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd57c05fea0 0x7fd57c145c00 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:22.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.741+0000 7fd58400e700 1 -- 172.21.15.63:0/464675630 >> 172.21.15.63:0/464675630 conn(0x7fd57c061b30 msgr2=0x7fd57c061f40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:22.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.741+0000 7fd58400e700 1 -- 172.21.15.63:0/464675630 shutdown_connections 2020-05-18T21:29:22.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.741+0000 7fd58400e700 1 -- 172.21.15.63:0/464675630 wait complete. 2020-05-18T21:29:22.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.741+0000 7fd58400e700 1 Processor -- start 2020-05-18T21:29:22.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.741+0000 7fd58400e700 1 -- start start 2020-05-18T21:29:22.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.741+0000 7fd58400e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd57c05fea0 0x7fd57c145630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:22.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.741+0000 7fd58400e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd57c142260 0x7fd57c141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:22.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.741+0000 7fd58400e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd57c142be0 con 0x7fd57c05bc80 2020-05-18T21:29:22.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.741+0000 7fd58400e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57c139d00 con 0x7fd57c05fea0 2020-05-18T21:29:22.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.741+0000 7fd58400e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c1426a0 con 0x7fd57c142260 2020-05-18T21:29:22.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.741+0000 7fd5815a9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd57c05fea0 0x7fd57c145630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:22.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.741+0000 7fd5815a9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd57c05fea0 0x7fd57c145630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56544/0 (socket says 172.21.15.63:56544) 2020-05-18T21:29:22.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.741+0000 7fd5815a9700 1 -- 172.21.15.63:0/3483916052 learned_addr learned my addr 172.21.15.63:0/3483916052 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:22.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.741+0000 7fd5825ab700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd57c142260 0x7fd57c141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:22.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd5815a9700 1 -- 172.21.15.63:0/3483916052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd57c142260 msgr2=0x7fd57c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:22.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd5815a9700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd57c142260 0x7fd57c141d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:22.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd56affd700 1 -- 172.21.15.63:0/3483916052 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984705224 0 0) 0x7fd57c142be0 con 0x7fd57c05bc80 2020-05-18T21:29:22.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd5815a9700 1 -- 172.21.15.63:0/3483916052 >> v1:172.21.15.155:6789/0 conn(0x7fd57c05bc80 legacy=0x7fd57c0b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:22.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd5815a9700 1 -- 172.21.15.63:0/3483916052 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c142940 con 0x7fd57c05fea0 2020-05-18T21:29:22.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd5815a9700 1 --2- 172.21.15.63:0/3483916052 >> v2:172.21.15.63:3300/0 conn(0x7fd57c05fea0 0x7fd57c145630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd57c061710 tx=0x7fd56c00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:22.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd5815a9700 1 --2- 172.21.15.63:0/3483916052 >> v2:172.21.15.63:3300/0 conn(0x7fd57c05fea0 0x7fd57c145630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd57c061710 tx=0x7fd56c00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:22.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd5815a9700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd57c05fea0 0x7fd57c145630 secure :-1 s=READY pgs=751 cs=0 l=1 rx=0x7fd57c061710 tx=0x7fd56c00c4a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:22.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd5815a9700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd57c05fea0 0x7fd57c145630 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7fd57c061710 tx=0x7fd56c00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:22.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd56affd700 1 -- 172.21.15.63:0/3483916052 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd56c00cc60 con 0x7fd57c05fea0 2020-05-18T21:29:22.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd5815a9700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd57c05fea0 0x7fd57c145630 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7fd57c061710 tx=0x7fd56c00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:22.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd56affd700 1 -- 172.21.15.63:0/3483916052 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56c00cdc0 con 0x7fd57c05fea0 2020-05-18T21:29:22.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd5815a9700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd57c05fea0 0x7fd57c145630 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7fd57c061710 tx=0x7fd56c00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:22.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd56affd700 1 -- 172.21.15.63:0/3483916052 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd56c012260 con 0x7fd57c05fea0 2020-05-18T21:29:22.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd58400e700 1 -- 172.21.15.63:0/3483916052 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd57c143750 con 0x7fd57c05fea0 2020-05-18T21:29:22.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd58400e700 1 -- 172.21.15.63:0/3483916052 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57c136cb0 con 0x7fd57c05fea0 2020-05-18T21:29:22.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd5815a9700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd57c05fea0 0x7fd57c145630 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7fd57c061710 tx=0x7fd56c00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:22.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd56affd700 1 -- 172.21.15.63:0/3483916052 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd56c006520 con 0x7fd57c05fea0 2020-05-18T21:29:22.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd5815a9700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd57c05fea0 0x7fd57c145630 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7fd57c061710 tx=0x7fd56c00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:22.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd58400e700 1 -- 172.21.15.63:0/3483916052 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57c141ad0 con 0x7fd57c05fea0 2020-05-18T21:29:22.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd56affd700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd55c04f850 0x7fd55c051d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:22.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.745+0000 7fd56affd700 1 -- 172.21.15.63:0/3483916052 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd56c063860 con 0x7fd57c05fea0 2020-05-18T21:29:22.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.749+0000 7fd581daa700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd55c04f850 0x7fd55c051d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:22.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.749+0000 7fd581daa700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd55c04f850 0x7fd55c051d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd578000bc0 tx=0x7fd578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:22.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.749+0000 7fd581daa700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd55c04f850 0x7fd55c051d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd578000bc0 tx=0x7fd578007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:22.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.749+0000 7fd581daa700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd55c04f850 0x7fd55c051d10 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7fd578000bc0 tx=0x7fd578007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:22.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.753+0000 7fd5815a9700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd57c05fea0 0x7fd57c145630 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7fd57c061710 tx=0x7fd56c00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:22.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.753+0000 7fd56affd700 1 -- 172.21.15.63:0/3483916052 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd57c141ad0 con 0x7fd57c05fea0 2020-05-18T21:29:22.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.901+0000 7fd58400e700 1 -- 172.21.15.63:0/3483916052 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd57c141ad0 con 0x7fd57c05fea0 2020-05-18T21:29:22.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.901+0000 7fd5815a9700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd57c05fea0 0x7fd57c145630 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7fd57c061710 tx=0x7fd56c00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:22.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.901+0000 7fd56affd700 1 -- 172.21.15.63:0/3483916052 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+1789 (secure 0 0 0) 0x7fd57c141ad0 con 0x7fd57c05fea0 2020-05-18T21:29:22.909 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:22.909 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":32,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:22.682765+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6319":{"gid":6319,"name":"b","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.155:6835/400120989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":400120989},{"type":"v1","addr":"172.21.15.155:6835","nonce":400120989}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:22.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.905+0000 7fd58400e700 1 -- 172.21.15.63:0/3483916052 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd55c04f850 msgr2=0x7fd55c051d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:22.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.905+0000 7fd58400e700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd55c04f850 0x7fd55c051d10 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7fd578000bc0 tx=0x7fd578007a80).stop 2020-05-18T21:29:22.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.905+0000 7fd58400e700 1 -- 172.21.15.63:0/3483916052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd57c05fea0 msgr2=0x7fd57c145630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:22.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.905+0000 7fd58400e700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd57c05fea0 0x7fd57c145630 secure :-1 s=READY pgs=751 cs=0 l=1 rx=0x7fd57c061710 tx=0x7fd56c00c4a0).stop 2020-05-18T21:29:22.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.905+0000 7fd58400e700 1 -- 172.21.15.63:0/3483916052 shutdown_connections 2020-05-18T21:29:22.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.905+0000 7fd58400e700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd55c04f850 0x7fd55c051d10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:22.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.905+0000 7fd58400e700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd57c142260 0x7fd57c141d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:22.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.905+0000 7fd58400e700 1 --2- 172.21.15.63:0/3483916052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd57c05fea0 0x7fd57c145630 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:22.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.905+0000 7fd58400e700 1 -- 172.21.15.63:0/3483916052 >> 172.21.15.63:0/3483916052 conn(0x7fd57c061b30 msgr2=0x7fd57c0b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:22.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.905+0000 7fd58400e700 1 -- 172.21.15.63:0/3483916052 shutdown_connections 2020-05-18T21:29:22.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:22.905+0000 7fd58400e700 1 -- 172.21.15.63:0/3483916052 wait complete. 2020-05-18T21:29:22.914 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 32 2020-05-18T21:29:23.123 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:29:10.174981+0000', 'modified': '2020-05-18T21:29:22.682765+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 62, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6319}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6319': {'gid': 6319, 'name': 'b', 'rank': 0, 'incarnation': 30, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.155:6835/400120989', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 400120989}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 400120989}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:29:23.123 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6319:up:rejoin 2020-05-18T21:29:24.124 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:24.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f6069d6d700 1 Processor -- start 2020-05-18T21:29:24.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f6069d6d700 1 -- start start 2020-05-18T21:29:24.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f6069d6d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60640aefc0 0x7f6064145c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:24.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f6069d6d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606414a040 con 0x7f60640658c0 2020-05-18T21:29:24.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f6069d6d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606414a2c0 con 0x7f60640b5ea0 2020-05-18T21:29:24.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f6069d6d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606414a560 con 0x7f60640aefc0 2020-05-18T21:29:24.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f6068d6b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f60640658c0 0x7f6064145500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58740/0 (socket says 172.21.15.63:58740) 2020-05-18T21:29:24.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f6068d6b700 1 -- 172.21.15.63:0/392597031 learned_addr learned my addr 172.21.15.63:0/392597031 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:24.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f606956c700 1 --2- 172.21.15.63:0/392597031 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60640aefc0 0x7f6064145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:24.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f60637fe700 1 -- 172.21.15.63:0/392597031 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248520237 0 0) 0x7f606414a040 con 0x7f60640658c0 2020-05-18T21:29:24.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f60637fe700 1 -- 172.21.15.63:0/392597031 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6050003270 con 0x7f60640658c0 2020-05-18T21:29:24.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f60637fe700 1 -- 172.21.15.63:0/392597031 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986571319 0 0) 0x7f606414a2c0 con 0x7f60640b5ea0 2020-05-18T21:29:24.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f60637fe700 1 -- 172.21.15.63:0/392597031 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f606414a040 con 0x7f60640b5ea0 2020-05-18T21:29:24.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f606956c700 1 -- 172.21.15.63:0/392597031 >> v1:172.21.15.155:6789/0 conn(0x7f60640b5ea0 legacy=0x7f60640ad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:24.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f606956c700 1 -- 172.21.15.63:0/392597031 >> v1:172.21.15.63:6789/0 conn(0x7f60640658c0 legacy=0x7f6064145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:24.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f606956c700 1 -- 172.21.15.63:0/392597031 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60640b5a00 con 0x7f60640aefc0 2020-05-18T21:29:24.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f606956c700 1 --2- 172.21.15.63:0/392597031 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60640aefc0 0x7f6064145c10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f605c0032f0 tx=0x7f605c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:24.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f606956c700 1 --2- 172.21.15.63:0/392597031 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60640aefc0 0x7f6064145c10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f605c0032f0 tx=0x7f605c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:24.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f606956c700 1 --2- 172.21.15.63:0/392597031 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60640aefc0 0x7f6064145c10 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f605c0032f0 tx=0x7f605c008ca0).ready entity=mon.2 client_cookie=ca5c7141ccb0a17e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:24.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f606956c700 1 --2- 172.21.15.63:0/392597031 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60640aefc0 0x7f6064145c10 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f605c0032f0 tx=0x7f605c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:24.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f60637fe700 1 -- 172.21.15.63:0/392597031 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f605c011df0 con 0x7f60640aefc0 2020-05-18T21:29:24.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.233+0000 7f606956c700 1 --2- 172.21.15.63:0/392597031 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60640aefc0 0x7f6064145c10 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f605c0032f0 tx=0x7f605c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:24.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.237+0000 7f60637fe700 1 -- 172.21.15.63:0/392597031 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605c00a180 con 0x7f60640aefc0 2020-05-18T21:29:24.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.237+0000 7f606956c700 1 --2- 172.21.15.63:0/392597031 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60640aefc0 0x7f6064145c10 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f605c0032f0 tx=0x7f605c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:24.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.237+0000 7f60637fe700 1 -- 172.21.15.63:0/392597031 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f605c00a4e0 con 0x7f60640aefc0 2020-05-18T21:29:24.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.237+0000 7f6069d6d700 1 -- 172.21.15.63:0/392597031 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60640aefc0 msgr2=0x7f6064145c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:24.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.237+0000 7f6069d6d700 1 --2- 172.21.15.63:0/392597031 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60640aefc0 0x7f6064145c10 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f605c0032f0 tx=0x7f605c008ca0).stop 2020-05-18T21:29:24.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.237+0000 7f6069d6d700 1 -- 172.21.15.63:0/392597031 shutdown_connections 2020-05-18T21:29:24.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.237+0000 7f6069d6d700 1 --2- 172.21.15.63:0/392597031 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60640aefc0 0x7f6064145c10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:24.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.237+0000 7f6069d6d700 1 -- 172.21.15.63:0/392597031 >> 172.21.15.63:0/392597031 conn(0x7f6064066850 msgr2=0x7f6064066c30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:24.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.237+0000 7f6069d6d700 1 -- 172.21.15.63:0/392597031 shutdown_connections 2020-05-18T21:29:24.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.237+0000 7f6069d6d700 1 -- 172.21.15.63:0/392597031 wait complete. 2020-05-18T21:29:24.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.237+0000 7f6069d6d700 1 Processor -- start 2020-05-18T21:29:24.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.237+0000 7f6069d6d700 1 -- start start 2020-05-18T21:29:24.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f6069d6d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f60640aefc0 0x7f606413d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:24.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f6069d6d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f60640b5ea0 0x7f6064141a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:24.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f6069d6d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6064141870 con 0x7f60640658c0 2020-05-18T21:29:24.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f6069d6d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f606413d920 con 0x7f60640b5ea0 2020-05-18T21:29:24.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f6069d6d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f606413dbc0 con 0x7f60640aefc0 2020-05-18T21:29:24.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f606956c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f60640b5ea0 0x7f6064141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:24.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f6068d6b700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f60640658c0 0x7f6064141160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:57060/0 (socket says 172.21.15.63:57060) 2020-05-18T21:29:24.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f606956c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f60640b5ea0 0x7f6064141a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56560/0 (socket says 172.21.15.63:56560) 2020-05-18T21:29:24.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f6068d6b700 1 -- 172.21.15.63:0/2794135112 learned_addr learned my addr 172.21.15.63:0/2794135112 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:24.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f6063fff700 1 --2- 172.21.15.63:0/2794135112 >> v2:172.21.15.155:3300/0 conn(0x7f60640aefc0 0x7f606413d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:24.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f606956c700 1 -- 172.21.15.63:0/2794135112 >> v2:172.21.15.155:3300/0 conn(0x7f60640aefc0 msgr2=0x7f606413d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:24.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f606956c700 1 --2- 172.21.15.63:0/2794135112 >> v2:172.21.15.155:3300/0 conn(0x7f60640aefc0 0x7f606413d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:24.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f606956c700 1 -- 172.21.15.63:0/2794135112 >> v1:172.21.15.155:6789/0 conn(0x7f60640658c0 legacy=0x7f6064141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:24.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f6061ffb700 1 -- 172.21.15.63:0/2794135112 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859674459 0 0) 0x7f6064141870 con 0x7f60640658c0 2020-05-18T21:29:24.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f606956c700 1 -- 172.21.15.63:0/2794135112 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606413de60 con 0x7f60640b5ea0 2020-05-18T21:29:24.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f606956c700 1 --2- 172.21.15.63:0/2794135112 >> v2:172.21.15.63:3300/0 conn(0x7f60640b5ea0 0x7f6064141a80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f605c0032f0 tx=0x7f605c0116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:24.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f606956c700 1 --2- 172.21.15.63:0/2794135112 >> v2:172.21.15.63:3300/0 conn(0x7f60640b5ea0 0x7f6064141a80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f605c0032f0 tx=0x7f605c0116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:24.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f606956c700 1 --2- 172.21.15.63:0/2794135112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640b5ea0 0x7f6064141a80 secure :-1 s=READY pgs=753 cs=0 l=1 rx=0x7f605c0032f0 tx=0x7f605c0116b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:24.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f606956c700 1 --2- 172.21.15.63:0/2794135112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640b5ea0 0x7f6064141a80 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f605c0032f0 tx=0x7f605c0116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:24.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f6061ffb700 1 -- 172.21.15.63:0/2794135112 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f605c005c70 con 0x7f60640b5ea0 2020-05-18T21:29:24.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f606956c700 1 --2- 172.21.15.63:0/2794135112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640b5ea0 0x7f6064141a80 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f605c0032f0 tx=0x7f605c0116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:24.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f6061ffb700 1 -- 172.21.15.63:0/2794135112 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605c005dd0 con 0x7f60640b5ea0 2020-05-18T21:29:24.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f6069d6d700 1 -- 172.21.15.63:0/2794135112 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606413d510 con 0x7f60640b5ea0 2020-05-18T21:29:24.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f6069d6d700 1 -- 172.21.15.63:0/2794135112 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6064140740 con 0x7f60640b5ea0 2020-05-18T21:29:24.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f606956c700 1 --2- 172.21.15.63:0/2794135112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640b5ea0 0x7f6064141a80 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f605c0032f0 tx=0x7f605c0116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:24.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f6061ffb700 1 -- 172.21.15.63:0/2794135112 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f605c007360 con 0x7f60640b5ea0 2020-05-18T21:29:24.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f606956c700 1 --2- 172.21.15.63:0/2794135112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640b5ea0 0x7f6064141a80 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f605c0032f0 tx=0x7f605c0116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:24.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f6069d6d700 1 -- 172.21.15.63:0/2794135112 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60640569e0 con 0x7f60640b5ea0 2020-05-18T21:29:24.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f6061ffb700 1 -- 172.21.15.63:0/2794135112 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f605c0074c0 con 0x7f60640b5ea0 2020-05-18T21:29:24.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.241+0000 7f606956c700 1 --2- 172.21.15.63:0/2794135112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640b5ea0 0x7f6064141a80 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f605c0032f0 tx=0x7f605c0116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:24.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.245+0000 7f6061ffb700 1 --2- 172.21.15.63:0/2794135112 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f604404f9c0 0x7f6044051e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:24.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.245+0000 7f6061ffb700 1 -- 172.21.15.63:0/2794135112 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f605c064cc0 con 0x7f60640b5ea0 2020-05-18T21:29:24.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.245+0000 7f6068d6b700 1 --2- 172.21.15.63:0/2794135112 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f604404f9c0 0x7f6044051e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:24.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.245+0000 7f6068d6b700 1 --2- 172.21.15.63:0/2794135112 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f604404f9c0 0x7f6044051e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6058000f50 tx=0x7f6058001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:24.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.245+0000 7f6068d6b700 1 --2- 172.21.15.63:0/2794135112 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f604404f9c0 0x7f6044051e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6058000f50 tx=0x7f6058001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:24.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.245+0000 7f6068d6b700 1 --2- 172.21.15.63:0/2794135112 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f604404f9c0 0x7f6044051e80 secure :-1 s=READY pgs=303 cs=0 l=1 rx=0x7f6058000f50 tx=0x7f6058001700).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:24.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.249+0000 7f606956c700 1 --2- 172.21.15.63:0/2794135112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640b5ea0 0x7f6064141a80 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f605c0032f0 tx=0x7f605c0116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:24.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.249+0000 7f6061ffb700 1 -- 172.21.15.63:0/2794135112 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f605c03f0b0 con 0x7f60640b5ea0 2020-05-18T21:29:24.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.397+0000 7f6069d6d700 1 -- 172.21.15.63:0/2794135112 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60640acb30 con 0x7f60640b5ea0 2020-05-18T21:29:24.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.397+0000 7f606956c700 1 --2- 172.21.15.63:0/2794135112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640b5ea0 0x7f6064141a80 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f605c0032f0 tx=0x7f605c0116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:24.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.397+0000 7f6061ffb700 1 -- 172.21.15.63:0/2794135112 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+1795 (secure 0 0 0) 0x7f605c0426d0 con 0x7f60640b5ea0 2020-05-18T21:29:24.403 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:24.403 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:23.686337+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6319":{"gid":6319,"name":"b","rank":0,"incarnation":30,"state":"up:clientreplay","state_seq":4,"addr":"172.21.15.155:6835/400120989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":400120989},{"type":"v1","addr":"172.21.15.155:6835","nonce":400120989}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:24.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.397+0000 7f6069d6d700 1 -- 172.21.15.63:0/2794135112 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f604404f9c0 msgr2=0x7f6044051e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:24.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.397+0000 7f6069d6d700 1 --2- 172.21.15.63:0/2794135112 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f604404f9c0 0x7f6044051e80 secure :-1 s=READY pgs=303 cs=0 l=1 rx=0x7f6058000f50 tx=0x7f6058001700).stop 2020-05-18T21:29:24.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.397+0000 7f6069d6d700 1 -- 172.21.15.63:0/2794135112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640b5ea0 msgr2=0x7f6064141a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:24.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.397+0000 7f6069d6d700 1 --2- 172.21.15.63:0/2794135112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640b5ea0 0x7f6064141a80 secure :-1 s=READY pgs=753 cs=0 l=1 rx=0x7f605c0032f0 tx=0x7f605c0116b0).stop 2020-05-18T21:29:24.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.397+0000 7f6069d6d700 1 -- 172.21.15.63:0/2794135112 shutdown_connections 2020-05-18T21:29:24.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.397+0000 7f6069d6d700 1 --2- 172.21.15.63:0/2794135112 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f604404f9c0 0x7f6044051e80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:24.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.397+0000 7f6069d6d700 1 --2- 172.21.15.63:0/2794135112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640b5ea0 0x7f6064141a80 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:24.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.397+0000 7f6069d6d700 1 --2- 172.21.15.63:0/2794135112 >> v2:172.21.15.155:3300/0 conn(0x7f60640aefc0 0x7f606413d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:24.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.397+0000 7f6069d6d700 1 -- 172.21.15.63:0/2794135112 >> 172.21.15.63:0/2794135112 conn(0x7f6064066850 msgr2=0x7f606405af60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:24.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.397+0000 7f6069d6d700 1 -- 172.21.15.63:0/2794135112 shutdown_connections 2020-05-18T21:29:24.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:24.397+0000 7f6069d6d700 1 -- 172.21.15.63:0/2794135112 wait complete. 2020-05-18T21:29:24.407 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 33 2020-05-18T21:29:24.618 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:29:10.174981+0000', 'modified': '2020-05-18T21:29:23.686337+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 62, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6319}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6319': {'gid': 6319, 'name': 'b', 'rank': 0, 'incarnation': 30, 'state': 'up:clientreplay', 'state_seq': 4, 'addr': '172.21.15.155:6835/400120989', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 400120989}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 400120989}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:29:24.618 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6319:up:clientreplay 2020-05-18T21:29:25.620 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:25.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.721+0000 7fc8f65e5700 1 Processor -- start 2020-05-18T21:29:25.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.721+0000 7fc8f65e5700 1 -- start start 2020-05-18T21:29:25.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8f65e5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc8f0145c60 0x7fc8f0065f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:25.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8f65e5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc8f009f000 0x7fc8f00b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:25.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8f65e5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f00b94c0 con 0x7fc8f00ba0d0 2020-05-18T21:29:25.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8f65e5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f0146040 con 0x7fc8f0145c60 2020-05-18T21:29:25.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8f65e5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f00b96f0 con 0x7fc8f009f000 2020-05-18T21:29:25.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8effff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc8f0145c60 0x7fc8f0065f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:25.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8effff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc8f0145c60 0x7fc8f0065f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56566/0 (socket says 172.21.15.63:56566) 2020-05-18T21:29:25.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8effff700 1 -- 172.21.15.63:0/841538517 learned_addr learned my addr 172.21.15.63:0/841538517 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:25.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8f4b82700 1 --2- 172.21.15.63:0/841538517 >> v2:172.21.15.155:3300/0 conn(0x7fc8f009f000 0x7fc8f00b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:25.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8effff700 1 -- 172.21.15.63:0/841538517 >> v2:172.21.15.155:3300/0 conn(0x7fc8f009f000 msgr2=0x7fc8f00b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:25.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8effff700 1 --2- 172.21.15.63:0/841538517 >> v2:172.21.15.155:3300/0 conn(0x7fc8f009f000 0x7fc8f00b80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:25.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8effff700 1 -- 172.21.15.63:0/841538517 >> v1:172.21.15.155:6789/0 conn(0x7fc8f00ba0d0 legacy=0x7fc8f00bca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:25.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8effff700 1 -- 172.21.15.63:0/841538517 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f00b9990 con 0x7fc8f0145c60 2020-05-18T21:29:25.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8effff700 1 --2- 172.21.15.63:0/841538517 >> v2:172.21.15.63:3300/0 conn(0x7fc8f0145c60 0x7fc8f0065f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc8f0066360 tx=0x7fc8d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:25.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8effff700 1 --2- 172.21.15.63:0/841538517 >> v2:172.21.15.63:3300/0 conn(0x7fc8f0145c60 0x7fc8f0065f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc8f0066360 tx=0x7fc8d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:25.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8effff700 1 --2- 172.21.15.63:0/841538517 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f0145c60 0x7fc8f0065f00 secure :-1 s=READY pgs=754 cs=0 l=1 rx=0x7fc8f0066360 tx=0x7fc8d8007a80).ready entity=mon.0 client_cookie=16e1d24dabe50dac server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:25.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8effff700 1 --2- 172.21.15.63:0/841538517 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f0145c60 0x7fc8f0065f00 secure :-1 s=THROTTLE_DONE pgs=754 cs=0 l=1 rx=0x7fc8f0066360 tx=0x7fc8d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:25.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8eeffd700 1 -- 172.21.15.63:0/841538517 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8d8011720 con 0x7fc8f0145c60 2020-05-18T21:29:25.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8effff700 1 --2- 172.21.15.63:0/841538517 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f0145c60 0x7fc8f0065f00 secure :-1 s=THROTTLE_DONE pgs=754 cs=0 l=1 rx=0x7fc8f0066360 tx=0x7fc8d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:25.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8effff700 1 --2- 172.21.15.63:0/841538517 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f0145c60 0x7fc8f0065f00 secure :-1 s=THROTTLE_DONE pgs=754 cs=0 l=1 rx=0x7fc8f0066360 tx=0x7fc8d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:25.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8eeffd700 1 -- 172.21.15.63:0/841538517 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d8011880 con 0x7fc8f0145c60 2020-05-18T21:29:25.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8eeffd700 1 -- 172.21.15.63:0/841538517 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8d8011c60 con 0x7fc8f0145c60 2020-05-18T21:29:25.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8f65e5700 1 -- 172.21.15.63:0/841538517 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f0145c60 msgr2=0x7fc8f0065f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:25.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8f65e5700 1 --2- 172.21.15.63:0/841538517 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f0145c60 0x7fc8f0065f00 secure :-1 s=READY pgs=754 cs=0 l=1 rx=0x7fc8f0066360 tx=0x7fc8d8007a80).stop 2020-05-18T21:29:25.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8f65e5700 1 -- 172.21.15.63:0/841538517 shutdown_connections 2020-05-18T21:29:25.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8f65e5700 1 --2- 172.21.15.63:0/841538517 >> v2:172.21.15.155:3300/0 conn(0x7fc8f009f000 0x7fc8f00b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:25.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8f65e5700 1 --2- 172.21.15.63:0/841538517 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f0145c60 0x7fc8f0065f00 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:25.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8f65e5700 1 -- 172.21.15.63:0/841538517 >> 172.21.15.63:0/841538517 conn(0x7fc8f005a7c0 msgr2=0x7fc8f005aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:25.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8f65e5700 1 -- 172.21.15.63:0/841538517 shutdown_connections 2020-05-18T21:29:25.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8f65e5700 1 -- 172.21.15.63:0/841538517 wait complete. 2020-05-18T21:29:25.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8f65e5700 1 Processor -- start 2020-05-18T21:29:25.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.725+0000 7fc8f65e5700 1 -- start start 2020-05-18T21:29:25.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8f65e5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8f009f000 0x7fc8f00b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:25.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8f65e5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc8f00ba0d0 0x7fc8f00b82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:25.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8f65e5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f00b8740 con 0x7fc8f0145c60 2020-05-18T21:29:25.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8f65e5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f01381d0 con 0x7fc8f00ba0d0 2020-05-18T21:29:25.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8f65e5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f0138470 con 0x7fc8f009f000 2020-05-18T21:29:25.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ef7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc8f00ba0d0 0x7fc8f00b82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:25.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ef7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc8f00ba0d0 0x7fc8f00b82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56574/0 (socket says 172.21.15.63:56574) 2020-05-18T21:29:25.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ef7fe700 1 -- 172.21.15.63:0/2004211140 learned_addr learned my addr 172.21.15.63:0/2004211140 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:25.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8effff700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8f009f000 0x7fc8f00b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:25.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ef7fe700 1 -- 172.21.15.63:0/2004211140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8f009f000 msgr2=0x7fc8f00b64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:25.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ef7fe700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8f009f000 0x7fc8f00b64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:25.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ef7fe700 1 -- 172.21.15.63:0/2004211140 >> v1:172.21.15.155:6789/0 conn(0x7fc8f0145c60 legacy=0x7fc8f0156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:25.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ed7fa700 1 -- 172.21.15.63:0/2004211140 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797721635 0 0) 0x7fc8f00b8740 con 0x7fc8f0145c60 2020-05-18T21:29:25.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ef7fe700 1 -- 172.21.15.63:0/2004211140 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f0138710 con 0x7fc8f00ba0d0 2020-05-18T21:29:25.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ef7fe700 1 --2- 172.21.15.63:0/2004211140 >> v2:172.21.15.63:3300/0 conn(0x7fc8f00ba0d0 0x7fc8f00b82e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc8e0001fe0 tx=0x7fc8f0060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:25.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ef7fe700 1 --2- 172.21.15.63:0/2004211140 >> v2:172.21.15.63:3300/0 conn(0x7fc8f00ba0d0 0x7fc8f00b82e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc8e0001fe0 tx=0x7fc8f0060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:25.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ef7fe700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f00ba0d0 0x7fc8f00b82e0 secure :-1 s=READY pgs=755 cs=0 l=1 rx=0x7fc8e0001fe0 tx=0x7fc8f0060a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:25.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ef7fe700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f00ba0d0 0x7fc8f00b82e0 secure :-1 s=THROTTLE_DONE pgs=755 cs=0 l=1 rx=0x7fc8e0001fe0 tx=0x7fc8f0060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:25.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ed7fa700 1 -- 172.21.15.63:0/2004211140 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8e000ccb0 con 0x7fc8f00ba0d0 2020-05-18T21:29:25.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ef7fe700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f00ba0d0 0x7fc8f00b82e0 secure :-1 s=THROTTLE_DONE pgs=755 cs=0 l=1 rx=0x7fc8e0001fe0 tx=0x7fc8f0060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:25.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ef7fe700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f00ba0d0 0x7fc8f00b82e0 secure :-1 s=THROTTLE_DONE pgs=755 cs=0 l=1 rx=0x7fc8e0001fe0 tx=0x7fc8f0060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:25.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ed7fa700 1 -- 172.21.15.63:0/2004211140 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e000ce10 con 0x7fc8f00ba0d0 2020-05-18T21:29:25.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8f65e5700 1 -- 172.21.15.63:0/2004211140 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f00b4fc0 con 0x7fc8f00ba0d0 2020-05-18T21:29:25.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ed7fa700 1 -- 172.21.15.63:0/2004211140 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8e000e370 con 0x7fc8f00ba0d0 2020-05-18T21:29:25.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8f65e5700 1 -- 172.21.15.63:0/2004211140 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f0157530 con 0x7fc8f00ba0d0 2020-05-18T21:29:25.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ef7fe700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f00ba0d0 0x7fc8f00b82e0 secure :-1 s=THROTTLE_DONE pgs=755 cs=0 l=1 rx=0x7fc8e0001fe0 tx=0x7fc8f0060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:25.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8f65e5700 1 -- 172.21.15.63:0/2004211140 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f00569e0 con 0x7fc8f00ba0d0 2020-05-18T21:29:25.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ed7fa700 1 -- 172.21.15.63:0/2004211140 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc8e0010350 con 0x7fc8f00ba0d0 2020-05-18T21:29:25.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ef7fe700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f00ba0d0 0x7fc8f00b82e0 secure :-1 s=THROTTLE_DONE pgs=755 cs=0 l=1 rx=0x7fc8e0001fe0 tx=0x7fc8f0060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:25.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.729+0000 7fc8ed7fa700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc8d404f8e0 0x7fc8d4051da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:25.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.733+0000 7fc8ed7fa700 1 -- 172.21.15.63:0/2004211140 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc8e0063930 con 0x7fc8f00ba0d0 2020-05-18T21:29:25.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.733+0000 7fc8effff700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc8d404f8e0 0x7fc8d4051da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:25.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.733+0000 7fc8effff700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc8d404f8e0 0x7fc8d4051da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc8f0066360 tx=0x7fc8d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:25.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.733+0000 7fc8effff700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc8d404f8e0 0x7fc8d4051da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc8f0066360 tx=0x7fc8d8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:25.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.733+0000 7fc8effff700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc8d404f8e0 0x7fc8d4051da0 secure :-1 s=READY pgs=305 cs=0 l=1 rx=0x7fc8f0066360 tx=0x7fc8d8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:25.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.737+0000 7fc8ef7fe700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f00ba0d0 0x7fc8f00b82e0 secure :-1 s=THROTTLE_DONE pgs=755 cs=0 l=1 rx=0x7fc8e0001fe0 tx=0x7fc8f0060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:25.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.737+0000 7fc8ed7fa700 1 -- 172.21.15.63:0/2004211140 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc8e003dc60 con 0x7fc8f00ba0d0 2020-05-18T21:29:25.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.877+0000 7fc8f65e5700 1 -- 172.21.15.63:0/2004211140 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8f00692c0 con 0x7fc8f00ba0d0 2020-05-18T21:29:25.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.881+0000 7fc8ef7fe700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f00ba0d0 0x7fc8f00b82e0 secure :-1 s=THROTTLE_DONE pgs=755 cs=0 l=1 rx=0x7fc8e0001fe0 tx=0x7fc8f0060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:25.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.881+0000 7fc8ed7fa700 1 -- 172.21.15.63:0/2004211140 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2141 (secure 0 0 0) 0x7fc8e0041280 con 0x7fc8f00ba0d0 2020-05-18T21:29:25.886 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:25.886 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/3895568247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3895568247},{"type":"v1","addr":"172.21.15.63:6833","nonce":3895568247}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:24.694515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6319":{"gid":6319,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/400120989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":400120989},{"type":"v1","addr":"172.21.15.155:6835","nonce":400120989}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:25.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.881+0000 7fc8f65e5700 1 -- 172.21.15.63:0/2004211140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc8d404f8e0 msgr2=0x7fc8d4051da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:25.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.881+0000 7fc8f65e5700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc8d404f8e0 0x7fc8d4051da0 secure :-1 s=READY pgs=305 cs=0 l=1 rx=0x7fc8f0066360 tx=0x7fc8d8007a80).stop 2020-05-18T21:29:25.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.881+0000 7fc8f65e5700 1 -- 172.21.15.63:0/2004211140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f00ba0d0 msgr2=0x7fc8f00b82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:25.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.881+0000 7fc8f65e5700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f00ba0d0 0x7fc8f00b82e0 secure :-1 s=READY pgs=755 cs=0 l=1 rx=0x7fc8e0001fe0 tx=0x7fc8f0060a60).stop 2020-05-18T21:29:25.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.881+0000 7fc8f65e5700 1 -- 172.21.15.63:0/2004211140 shutdown_connections 2020-05-18T21:29:25.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.881+0000 7fc8f65e5700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc8d404f8e0 0x7fc8d4051da0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:25.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.881+0000 7fc8f65e5700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f00ba0d0 0x7fc8f00b82e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:25.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.881+0000 7fc8f65e5700 1 --2- 172.21.15.63:0/2004211140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8f009f000 0x7fc8f00b64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:25.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.881+0000 7fc8f65e5700 1 -- 172.21.15.63:0/2004211140 >> 172.21.15.63:0/2004211140 conn(0x7fc8f005a7c0 msgr2=0x7fc8f0069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:25.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.881+0000 7fc8f65e5700 1 -- 172.21.15.63:0/2004211140 shutdown_connections 2020-05-18T21:29:25.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:25.881+0000 7fc8f65e5700 1 -- 172.21.15.63:0/2004211140 wait complete. 2020-05-18T21:29:25.890 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 34 2020-05-18T21:29:26.100 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:29:10.174981+0000', 'modified': '2020-05-18T21:29:24.694515+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 62, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6319}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6319': {'gid': 6319, 'name': 'b', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.155:6835/400120989', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 400120989}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 400120989}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:29:26.100 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:29:26.101 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:29:26.204 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:29:26.205 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:29:26.205 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2020-05-18T21:29:26.205 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 6319, 2020-05-18T21:29:26.206 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:29:26.206 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:29:26.206 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 5.524491018, 2020-05-18T21:29:26.206 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 34, 2020-05-18T21:29:26.206 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 63, 2020-05-18T21:29:26.207 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 63, 2020-05-18T21:29:26.207 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 6.4831300150000004 2020-05-18T21:29:26.207 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:29:26.213 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 6319, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.524491018, "mdsmap_epoch": 34, "osdmap_epoch": 63, "osdmap_epoch_barrier": 63, "uptime": 6.4831300150000004 } 2020-05-18T21:29:26.214 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:29:26.214 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:29:26.215 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:29:26.215 INFO:teuthology.orchestra.run.smithi063:> mount_path = "/home/ubuntu/cephtest/mnt.0" 2020-05-18T21:29:26.216 INFO:teuthology.orchestra.run.smithi063:> subdir = "delete_me" 2020-05-18T21:29:26.216 INFO:teuthology.orchestra.run.smithi063:> size_unit = 1024 2020-05-18T21:29:26.216 INFO:teuthology.orchestra.run.smithi063:> file_multiplier = 200 2020-05-18T21:29:26.217 INFO:teuthology.orchestra.run.smithi063:> os.mkdir(os.path.join(mount_path, subdir)) 2020-05-18T21:29:26.217 INFO:teuthology.orchestra.run.smithi063:> for i in range(0, file_multiplier): 2020-05-18T21:29:26.218 INFO:teuthology.orchestra.run.smithi063:> for size in range(0, 16*size_unit, size_unit): 2020-05-18T21:29:26.218 INFO:teuthology.orchestra.run.smithi063:> filename = "{0}_{1}.bin".format(i, size // size_unit) 2020-05-18T21:29:26.218 INFO:teuthology.orchestra.run.smithi063:> with open(os.path.join(mount_path, subdir, filename), '"'"'w'"'"') as f: 2020-05-18T21:29:26.219 INFO:teuthology.orchestra.run.smithi063:> f.write(size * '"'"'x'"'"') 2020-05-18T21:29:26.219 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:29:29.150 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:29:29.153 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:29:39.508 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get mds_max_purge_ops 2020-05-18T21:29:39.510 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rm -rf delete_me) 2020-05-18T21:29:39.609 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:29:39.609 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_purge_ops": "100000000" 2020-05-18T21:29:39.609 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:29:39.618 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_max_purge_ops": "100000000" } 2020-05-18T21:29:39.619 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get mds_max_purge_files 2020-05-18T21:29:39.715 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:29:39.715 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_purge_files": "6" 2020-05-18T21:29:39.716 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:29:39.726 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_max_purge_files": "6" } 2020-05-18T21:29:39.726 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:39.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f288093b700 1 Processor -- start 2020-05-18T21:29:39.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f288093b700 1 -- start start 2020-05-18T21:29:39.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f288093b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f287c0ba910 0x7f287c0ad260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:39.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f288093b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287c0adb00 con 0x7f287c141430 2020-05-18T21:29:39.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f288093b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287c0adda0 con 0x7f287c143e10 2020-05-18T21:29:39.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f288093b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0ae040 con 0x7f287c0ba910 2020-05-18T21:29:39.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f287b59e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f287c141430 0x7f287c12c830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58780/0 (socket says 172.21.15.63:58780) 2020-05-18T21:29:39.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f287b59e700 1 -- 172.21.15.63:0/2046052546 learned_addr learned my addr 172.21.15.63:0/2046052546 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:39.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f287ad9d700 1 --2- 172.21.15.63:0/2046052546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f287c0ba910 0x7f287c0ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:39.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f2879d9b700 1 -- 172.21.15.63:0/2046052546 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625789485 0 0) 0x7f287c0adb00 con 0x7f287c141430 2020-05-18T21:29:39.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f2879d9b700 1 -- 172.21.15.63:0/2046052546 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f285c003270 con 0x7f287c141430 2020-05-18T21:29:39.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f2879d9b700 1 -- 172.21.15.63:0/2046052546 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371177689 0 0) 0x7f287c0adda0 con 0x7f287c143e10 2020-05-18T21:29:39.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f2879d9b700 1 -- 172.21.15.63:0/2046052546 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f287c0adb00 con 0x7f287c143e10 2020-05-18T21:29:39.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f287ad9d700 1 -- 172.21.15.63:0/2046052546 >> v1:172.21.15.155:6789/0 conn(0x7f287c143e10 legacy=0x7f287c140d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:39.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f287ad9d700 1 -- 172.21.15.63:0/2046052546 >> v1:172.21.15.63:6789/0 conn(0x7f287c141430 legacy=0x7f287c12c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:39.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f287ad9d700 1 -- 172.21.15.63:0/2046052546 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c0bacf0 con 0x7f287c0ba910 2020-05-18T21:29:39.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f287ad9d700 1 --2- 172.21.15.63:0/2046052546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f287c0ba910 0x7f287c0ad260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f286c002f70 tx=0x7f286c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:39.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f287ad9d700 1 --2- 172.21.15.63:0/2046052546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f287c0ba910 0x7f287c0ad260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f286c002f70 tx=0x7f286c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:39.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f287ad9d700 1 --2- 172.21.15.63:0/2046052546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f287c0ba910 0x7f287c0ad260 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7f286c002f70 tx=0x7f286c008920).ready entity=mon.2 client_cookie=f7acbceafc9ead1e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:39.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f287ad9d700 1 --2- 172.21.15.63:0/2046052546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f287c0ba910 0x7f287c0ad260 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f286c002f70 tx=0x7f286c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:39.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f2879d9b700 1 -- 172.21.15.63:0/2046052546 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286c008e80 con 0x7f287c0ba910 2020-05-18T21:29:39.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f287ad9d700 1 --2- 172.21.15.63:0/2046052546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f287c0ba910 0x7f287c0ad260 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f286c002f70 tx=0x7f286c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:39.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f287ad9d700 1 --2- 172.21.15.63:0/2046052546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f287c0ba910 0x7f287c0ad260 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f286c002f70 tx=0x7f286c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:39.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f2879d9b700 1 -- 172.21.15.63:0/2046052546 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c011580 con 0x7f287c0ba910 2020-05-18T21:29:39.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f2879d9b700 1 -- 172.21.15.63:0/2046052546 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286c011960 con 0x7f287c0ba910 2020-05-18T21:29:39.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f288093b700 1 -- 172.21.15.63:0/2046052546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f287c0ba910 msgr2=0x7f287c0ad260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:39.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.833+0000 7f288093b700 1 --2- 172.21.15.63:0/2046052546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f287c0ba910 0x7f287c0ad260 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7f286c002f70 tx=0x7f286c008920).stop 2020-05-18T21:29:39.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.837+0000 7f288093b700 1 -- 172.21.15.63:0/2046052546 shutdown_connections 2020-05-18T21:29:39.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.837+0000 7f288093b700 1 --2- 172.21.15.63:0/2046052546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f287c0ba910 0x7f287c0ad260 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:39.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.837+0000 7f288093b700 1 -- 172.21.15.63:0/2046052546 >> 172.21.15.63:0/2046052546 conn(0x7f287c061450 msgr2=0x7f287c061830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:39.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.837+0000 7f288093b700 1 -- 172.21.15.63:0/2046052546 shutdown_connections 2020-05-18T21:29:39.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.837+0000 7f288093b700 1 -- 172.21.15.63:0/2046052546 wait complete. 2020-05-18T21:29:39.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.837+0000 7f288093b700 1 Processor -- start 2020-05-18T21:29:39.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.837+0000 7f288093b700 1 -- start start 2020-05-18T21:29:39.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.837+0000 7f288093b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f287c0ba910 0x7f287c060760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:39.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.837+0000 7f288093b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287c0b6450 con 0x7f287c141430 2020-05-18T21:29:39.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.837+0000 7f288093b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287c157840 con 0x7f287c143e10 2020-05-18T21:29:39.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.837+0000 7f288093b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c156b00 con 0x7f287c0ba910 2020-05-18T21:29:39.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.837+0000 7f287a59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f287c141430 0x7f287c1563f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58784/0 (socket says 172.21.15.63:58784) 2020-05-18T21:29:39.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.837+0000 7f287ad9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f287c0ba910 0x7f287c060760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:39.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.837+0000 7f287a59c700 1 -- 172.21.15.63:0/2011418013 learned_addr learned my addr 172.21.15.63:0/2011418013 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:39.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.837+0000 7f2873fff700 1 -- 172.21.15.63:0/2011418013 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254732939 0 0) 0x7f287c0b6450 con 0x7f287c141430 2020-05-18T21:29:39.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.837+0000 7f2873fff700 1 -- 172.21.15.63:0/2011418013 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2860002fe0 con 0x7f287c141430 2020-05-18T21:29:39.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.837+0000 7f2873fff700 1 -- 172.21.15.63:0/2011418013 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245366034 0 0) 0x7f287c157840 con 0x7f287c143e10 2020-05-18T21:29:39.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.837+0000 7f287ad9d700 1 -- 172.21.15.63:0/2011418013 >> v1:172.21.15.155:6789/0 conn(0x7f287c143e10 legacy=0x7f287c05eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:39.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.837+0000 7f287ad9d700 1 -- 172.21.15.63:0/2011418013 >> v1:172.21.15.63:6789/0 conn(0x7f287c141430 legacy=0x7f287c1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:39.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.841+0000 7f287ad9d700 1 -- 172.21.15.63:0/2011418013 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c157ae0 con 0x7f287c0ba910 2020-05-18T21:29:39.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.841+0000 7f287ad9d700 1 --2- 172.21.15.63:0/2011418013 >> v2:172.21.15.63:3300/0 conn(0x7f287c0ba910 0x7f287c060760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f286c002f70 tx=0x7f287c0bae80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:39.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.841+0000 7f287ad9d700 1 --2- 172.21.15.63:0/2011418013 >> v2:172.21.15.63:3300/0 conn(0x7f287c0ba910 0x7f287c060760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f286c002f70 tx=0x7f287c0bae80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:39.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.841+0000 7f287ad9d700 1 --2- 172.21.15.63:0/2011418013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f287c0ba910 0x7f287c060760 secure :-1 s=READY pgs=758 cs=0 l=1 rx=0x7f286c002f70 tx=0x7f287c0bae80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:39.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.841+0000 7f287ad9d700 1 --2- 172.21.15.63:0/2011418013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f287c0ba910 0x7f287c060760 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7f286c002f70 tx=0x7f287c0bae80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:39.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.841+0000 7f287ad9d700 1 --2- 172.21.15.63:0/2011418013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f287c0ba910 0x7f287c060760 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7f286c002f70 tx=0x7f287c0bae80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:39.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.841+0000 7f2873fff700 1 -- 172.21.15.63:0/2011418013 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286c011910 con 0x7f287c0ba910 2020-05-18T21:29:39.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.841+0000 7f287ad9d700 1 --2- 172.21.15.63:0/2011418013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f287c0ba910 0x7f287c060760 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7f286c002f70 tx=0x7f287c0bae80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:39.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.841+0000 7f2873fff700 1 -- 172.21.15.63:0/2011418013 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c007170 con 0x7f287c0ba910 2020-05-18T21:29:39.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.841+0000 7f2873fff700 1 -- 172.21.15.63:0/2011418013 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286c0074d0 con 0x7f287c0ba910 2020-05-18T21:29:39.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.841+0000 7f288093b700 1 -- 172.21.15.63:0/2011418013 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c05f280 con 0x7f287c0ba910 2020-05-18T21:29:39.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.841+0000 7f288093b700 1 -- 172.21.15.63:0/2011418013 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c154a50 con 0x7f287c0ba910 2020-05-18T21:29:39.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.841+0000 7f288093b700 1 -- 172.21.15.63:0/2011418013 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c0569e0 con 0x7f287c0ba910 2020-05-18T21:29:39.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.841+0000 7f287ad9d700 1 --2- 172.21.15.63:0/2011418013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f287c0ba910 0x7f287c060760 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7f286c002f70 tx=0x7f287c0bae80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:39.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.841+0000 7f2873fff700 1 -- 172.21.15.63:0/2011418013 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f286c005700 con 0x7f287c0ba910 2020-05-18T21:29:39.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.841+0000 7f287ad9d700 1 --2- 172.21.15.63:0/2011418013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f287c0ba910 0x7f287c060760 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7f286c002f70 tx=0x7f287c0bae80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:39.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.841+0000 7f2873fff700 1 --2- 172.21.15.63:0/2011418013 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f286004fcf0 0x7f28600521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:39.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.841+0000 7f2873fff700 1 -- 172.21.15.63:0/2011418013 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f286c064720 con 0x7f287c0ba910 2020-05-18T21:29:39.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.845+0000 7f287a59c700 1 --2- 172.21.15.63:0/2011418013 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f286004fcf0 0x7f28600521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:39.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.845+0000 7f287a59c700 1 --2- 172.21.15.63:0/2011418013 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f286004fcf0 0x7f28600521b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f28640012c0 tx=0x7f2864002990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:39.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.845+0000 7f287a59c700 1 --2- 172.21.15.63:0/2011418013 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f286004fcf0 0x7f28600521b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f28640012c0 tx=0x7f2864002990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:39.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.845+0000 7f287a59c700 1 --2- 172.21.15.63:0/2011418013 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f286004fcf0 0x7f28600521b0 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7f28640012c0 tx=0x7f2864002990).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:39.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.849+0000 7f287ad9d700 1 --2- 172.21.15.63:0/2011418013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f287c0ba910 0x7f287c060760 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7f286c002f70 tx=0x7f287c0bae80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:39.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:39.849+0000 7f2873fff700 1 -- 172.21.15.63:0/2011418013 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f286c03ea50 con 0x7f287c0ba910 2020-05-18T21:29:40.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:40.001+0000 7f288093b700 1 -- 172.21.15.63:0/2011418013 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f287c065820 con 0x7f287c0ba910 2020-05-18T21:29:40.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:40.001+0000 7f287ad9d700 1 --2- 172.21.15.63:0/2011418013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f287c0ba910 0x7f287c060760 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7f286c002f70 tx=0x7f287c0bae80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:40.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:40.001+0000 7f2873fff700 1 -- 172.21.15.63:0/2011418013 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f286c042070 con 0x7f287c0ba910 2020-05-18T21:29:40.007 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:40.007 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/3895568247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3895568247},{"type":"v1","addr":"172.21.15.63:6833","nonce":3895568247}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:24.694515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6319":{"gid":6319,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/400120989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":400120989},{"type":"v1","addr":"172.21.15.155:6835","nonce":400120989}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:40.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:40.005+0000 7f288093b700 1 -- 172.21.15.63:0/2011418013 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f286004fcf0 msgr2=0x7f28600521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:40.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:40.005+0000 7f288093b700 1 --2- 172.21.15.63:0/2011418013 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f286004fcf0 0x7f28600521b0 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7f28640012c0 tx=0x7f2864002990).stop 2020-05-18T21:29:40.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:40.005+0000 7f288093b700 1 -- 172.21.15.63:0/2011418013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f287c0ba910 msgr2=0x7f287c060760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:40.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:40.005+0000 7f288093b700 1 --2- 172.21.15.63:0/2011418013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f287c0ba910 0x7f287c060760 secure :-1 s=READY pgs=758 cs=0 l=1 rx=0x7f286c002f70 tx=0x7f287c0bae80).stop 2020-05-18T21:29:40.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:40.005+0000 7f288093b700 1 -- 172.21.15.63:0/2011418013 shutdown_connections 2020-05-18T21:29:40.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:40.005+0000 7f288093b700 1 --2- 172.21.15.63:0/2011418013 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f286004fcf0 0x7f28600521b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:40.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:40.005+0000 7f288093b700 1 --2- 172.21.15.63:0/2011418013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f287c0ba910 0x7f287c060760 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:40.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:40.005+0000 7f288093b700 1 -- 172.21.15.63:0/2011418013 >> 172.21.15.63:0/2011418013 conn(0x7f287c061450 msgr2=0x7f287c13f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:40.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:40.005+0000 7f288093b700 1 -- 172.21.15.63:0/2011418013 shutdown_connections 2020-05-18T21:29:40.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:40.005+0000 7f288093b700 1 -- 172.21.15.63:0/2011418013 wait complete. 2020-05-18T21:29:40.016 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 34 2020-05-18T21:29:40.022 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2020-05-18T21:29:40.128 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:29:40.129 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2020-05-18T21:29:40.129 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 56, 2020-05-18T21:29:40.129 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 58, 2020-05-18T21:29:40.129 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 21821, 2020-05-18T21:29:40.129 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 6405990, 2020-05-18T21:29:40.130 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 7, 2020-05-18T21:29:40.130 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 1, 2020-05-18T21:29:40.130 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.040495049, 2020-05-18T21:29:40.131 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.027970806, 2020-05-18T21:29:40.131 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.003243035, 2020-05-18T21:29:40.131 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.006690016, 2020-05-18T21:29:40.131 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:40.131 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 57, 2020-05-18T21:29:40.132 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.011074600, 2020-05-18T21:29:40.132 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000194291 2020-05-18T21:29:40.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.132 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:40.133 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.133 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.133 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.133 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:40.134 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.134 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2020-05-18T21:29:40.134 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 32, 2020-05-18T21:29:40.134 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 36, 2020-05-18T21:29:40.134 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 9991, 2020-05-18T21:29:40.135 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 302938, 2020-05-18T21:29:40.135 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 5, 2020-05-18T21:29:40.135 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 2, 2020-05-18T21:29:40.135 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.008476587, 2020-05-18T21:29:40.135 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.002411045, 2020-05-18T21:29:40.135 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.004534082, 2020-05-18T21:29:40.136 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.001012836, 2020-05-18T21:29:40.136 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:40.136 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 36, 2020-05-18T21:29:40.137 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.006935468, 2020-05-18T21:29:40.137 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000192651 2020-05-18T21:29:40.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.137 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:40.137 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.138 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.138 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.138 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:40.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.138 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2020-05-18T21:29:40.139 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 5472, 2020-05-18T21:29:40.139 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 11797, 2020-05-18T21:29:40.139 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 1668772, 2020-05-18T21:29:40.139 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 10307468, 2020-05-18T21:29:40.139 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 4, 2020-05-18T21:29:40.139 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 2, 2020-05-18T21:29:40.140 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.754473434, 2020-05-18T21:29:40.140 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.337318394, 2020-05-18T21:29:40.140 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.473802665, 2020-05-18T21:29:40.140 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.006222584, 2020-05-18T21:29:40.140 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:40.141 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 11797, 2020-05-18T21:29:40.141 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.266463094, 2020-05-18T21:29:40.141 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000022587 2020-05-18T21:29:40.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.142 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:40.142 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 16767, 2020-05-18T21:29:40.142 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.004743611, 2020-05-18T21:29:40.142 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000282 2020-05-18T21:29:40.142 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:40.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.143 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2020-05-18T21:29:40.143 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2020-05-18T21:29:40.143 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2020-05-18T21:29:40.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.143 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2020-05-18T21:29:40.144 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:40.144 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:40.144 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 160, 2020-05-18T21:29:40.144 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 1.713011903, 2020-05-18T21:29:40.144 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.010706324 2020-05-18T21:29:40.145 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:40.145 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.145 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2020-05-18T21:29:40.145 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:40.145 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:40.146 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 4, 2020-05-18T21:29:40.146 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000116871, 2020-05-18T21:29:40.146 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000029217 2020-05-18T21:29:40.146 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:40.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.146 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2020-05-18T21:29:40.147 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 3256, 2020-05-18T21:29:40.147 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 3254, 2020-05-18T21:29:40.147 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2020-05-18T21:29:40.147 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3254, 2020-05-18T21:29:40.147 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 5.852420628, 2020-05-18T21:29:40.148 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001798531 2020-05-18T21:29:40.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.148 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 0, 2020-05-18T21:29:40.148 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch": 12, 2020-05-18T21:29:40.148 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 73, 2020-05-18T21:29:40.149 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 9, 2020-05-18T21:29:40.149 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 0, 2020-05-18T21:29:40.149 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 3211, 2020-05-18T21:29:40.149 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 0, 2020-05-18T21:29:40.149 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 3211, 2020-05-18T21:29:40.149 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 0, 2020-05-18T21:29:40.150 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 3211, 2020-05-18T21:29:40.150 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 0, 2020-05-18T21:29:40.150 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 3202, 2020-05-18T21:29:40.150 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 3202, 2020-05-18T21:29:40.150 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 2, 2020-05-18T21:29:40.151 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 3266, 2020-05-18T21:29:40.151 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 3255, 2020-05-18T21:29:40.151 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 0, 2020-05-18T21:29:40.151 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 0, 2020-05-18T21:29:40.151 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2020-05-18T21:29:40.152 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2020-05-18T21:29:40.152 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 0, 2020-05-18T21:29:40.152 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 297800, 2020-05-18T21:29:40.152 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2020-05-18T21:29:40.153 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 0, 2020-05-18T21:29:40.153 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 0, 2020-05-18T21:29:40.153 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 0, 2020-05-18T21:29:40.154 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 0, 2020-05-18T21:29:40.154 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2020-05-18T21:29:40.154 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 0, 2020-05-18T21:29:40.154 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2020-05-18T21:29:40.154 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 2155, 2020-05-18T21:29:40.155 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 6703104, 2020-05-18T21:29:40.155 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 0 2020-05-18T21:29:40.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.155 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:29:40.155 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 0, 2020-05-18T21:29:40.156 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 0, 2020-05-18T21:29:40.156 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:29:40.156 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 0, 2020-05-18T21:29:40.156 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 0, 2020-05-18T21:29:40.156 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2020-05-18T21:29:40.156 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2020-05-18T21:29:40.157 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2020-05-18T21:29:40.157 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:29:40.157 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:29:40.157 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2020-05-18T21:29:40.157 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2020-05-18T21:29:40.158 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:29:40.158 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 0, 2020-05-18T21:29:40.158 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2020-05-18T21:29:40.158 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 9, 2020-05-18T21:29:40.159 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2020-05-18T21:29:40.159 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2020-05-18T21:29:40.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.159 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2020-05-18T21:29:40.159 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 5307, 2020-05-18T21:29:40.160 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 0, 2020-05-18T21:29:40.160 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 0, 2020-05-18T21:29:40.160 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 5309, 2020-05-18T21:29:40.160 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 0, 2020-05-18T21:29:40.160 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 0, 2020-05-18T21:29:40.161 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 6, 2020-05-18T21:29:40.161 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 0, 2020-05-18T21:29:40.161 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 0, 2020-05-18T21:29:40.162 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 7, 2020-05-18T21:29:40.162 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 0, 2020-05-18T21:29:40.162 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 0, 2020-05-18T21:29:40.162 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 4194304, 2020-05-18T21:29:40.163 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 14313501, 2020-05-18T21:29:40.163 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 4195196, 2020-05-18T21:29:40.163 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2020-05-18T21:29:40.163 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 28, 2020-05-18T21:29:40.163 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.172790830, 2020-05-18T21:29:40.164 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.006171101 2020-05-18T21:29:40.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.164 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 2 2020-05-18T21:29:40.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.164 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2020-05-18T21:29:40.164 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 3214, 2020-05-18T21:29:40.165 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 3214, 2020-05-18T21:29:40.165 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 0, 2020-05-18T21:29:40.165 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 76, 2020-05-18T21:29:40.165 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 85, 2020-05-18T21:29:40.166 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 9, 2020-05-18T21:29:40.166 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 3211, 2020-05-18T21:29:40.166 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 3211, 2020-05-18T21:29:40.166 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 0, 2020-05-18T21:29:40.166 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 3202, 2020-05-18T21:29:40.166 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 3202, 2020-05-18T21:29:40.167 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 0, 2020-05-18T21:29:40.167 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 77264, 2020-05-18T21:29:40.167 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 331932 2020-05-18T21:29:40.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.167 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2020-05-18T21:29:40.168 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 3317, 2020-05-18T21:29:40.168 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 0, 2020-05-18T21:29:40.168 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 3256, 2020-05-18T21:29:40.168 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 2, 2020-05-18T21:29:40.168 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_slave_request": 0, 2020-05-18T21:29:40.168 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2020-05-18T21:29:40.169 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3200, 2020-05-18T21:29:40.169 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 5.456048806, 2020-05-18T21:29:40.169 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001705015 2020-05-18T21:29:40.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.169 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2020-05-18T21:29:40.170 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2, 2020-05-18T21:29:40.170 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.078760379, 2020-05-18T21:29:40.170 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.039380189 2020-05-18T21:29:40.170 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.170 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2020-05-18T21:29:40.171 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.171 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.171 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.171 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2020-05-18T21:29:40.172 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.172 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.172 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.173 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2020-05-18T21:29:40.173 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.173 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.173 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.174 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2020-05-18T21:29:40.175 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.175 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.175 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.176 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2020-05-18T21:29:40.176 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.176 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.176 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.177 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2020-05-18T21:29:40.177 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.177 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.177 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.178 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2020-05-18T21:29:40.178 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.178 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.178 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.179 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.179 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2020-05-18T21:29:40.179 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.179 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.179 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.179 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.180 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2020-05-18T21:29:40.180 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.180 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.180 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.181 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2020-05-18T21:29:40.181 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1, 2020-05-18T21:29:40.181 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.006614312, 2020-05-18T21:29:40.181 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.006614312 2020-05-18T21:29:40.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.181 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2020-05-18T21:29:40.182 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.182 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.182 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.182 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2020-05-18T21:29:40.183 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.183 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.183 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.183 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2020-05-18T21:29:40.184 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.184 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.184 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.184 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2020-05-18T21:29:40.184 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 51, 2020-05-18T21:29:40.185 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.310997131, 2020-05-18T21:29:40.185 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.006097982 2020-05-18T21:29:40.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.185 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2020-05-18T21:29:40.185 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.186 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.186 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.186 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2020-05-18T21:29:40.187 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.187 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.187 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.187 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.187 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2020-05-18T21:29:40.187 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.188 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.188 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.188 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2020-05-18T21:29:40.188 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.189 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.189 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.189 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.189 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2020-05-18T21:29:40.189 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.190 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.190 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.190 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2020-05-18T21:29:40.190 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.190 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.191 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.191 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.191 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2020-05-18T21:29:40.191 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.191 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.192 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.192 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2020-05-18T21:29:40.192 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.192 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.192 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.193 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2020-05-18T21:29:40.193 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.193 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.193 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.194 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.194 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2020-05-18T21:29:40.194 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.194 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.194 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.194 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.195 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2020-05-18T21:29:40.195 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.195 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.195 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.195 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.196 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2020-05-18T21:29:40.196 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.196 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.196 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.196 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.197 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0 2020-05-18T21:29:40.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.197 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2020-05-18T21:29:40.197 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 1, 2020-05-18T21:29:40.197 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 1, 2020-05-18T21:29:40.197 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 0, 2020-05-18T21:29:40.198 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 1, 2020-05-18T21:29:40.198 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2020-05-18T21:29:40.198 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 2991, 2020-05-18T21:29:40.198 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 2991, 2020-05-18T21:29:40.198 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 548 2020-05-18T21:29:40.199 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.199 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2020-05-18T21:29:40.199 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2020-05-18T21:29:40.199 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2020-05-18T21:29:40.199 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2020-05-18T21:29:40.199 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2020-05-18T21:29:40.200 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2020-05-18T21:29:40.200 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2020-05-18T21:29:40.200 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2020-05-18T21:29:40.200 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2020-05-18T21:29:40.200 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2020-05-18T21:29:40.201 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2020-05-18T21:29:40.201 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2020-05-18T21:29:40.201 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2020-05-18T21:29:40.201 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2020-05-18T21:29:40.201 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2020-05-18T21:29:40.202 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2020-05-18T21:29:40.202 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2020-05-18T21:29:40.202 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2020-05-18T21:29:40.202 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2020-05-18T21:29:40.203 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2020-05-18T21:29:40.203 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2020-05-18T21:29:40.203 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 171452, 2020-05-18T21:29:40.203 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 320, 2020-05-18T21:29:40.203 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2020-05-18T21:29:40.203 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2020-05-18T21:29:40.204 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2020-05-18T21:29:40.204 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2020-05-18T21:29:40.204 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2020-05-18T21:29:40.204 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2020-05-18T21:29:40.204 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2020-05-18T21:29:40.205 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2020-05-18T21:29:40.205 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 6128, 2020-05-18T21:29:40.205 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 93, 2020-05-18T21:29:40.205 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2020-05-18T21:29:40.205 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2020-05-18T21:29:40.205 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2020-05-18T21:29:40.206 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2020-05-18T21:29:40.206 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 10136248, 2020-05-18T21:29:40.206 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 57962, 2020-05-18T21:29:40.206 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2020-05-18T21:29:40.206 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2020-05-18T21:29:40.207 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2020-05-18T21:29:40.207 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2020-05-18T21:29:40.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.207 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2020-05-18T21:29:40.207 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 0, 2020-05-18T21:29:40.207 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2020-05-18T21:29:40.208 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 150, 2020-05-18T21:29:40.208 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 11061536, 2020-05-18T21:29:40.208 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 0, 2020-05-18T21:29:40.208 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 150, 2020-05-18T21:29:40.208 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 150, 2020-05-18T21:29:40.209 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 26, 2020-05-18T21:29:40.209 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 124, 2020-05-18T21:29:40.209 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2020-05-18T21:29:40.209 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2020-05-18T21:29:40.209 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 2, 2020-05-18T21:29:40.209 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 0, 2020-05-18T21:29:40.210 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 8, 2020-05-18T21:29:40.210 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 28, 2020-05-18T21:29:40.210 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 2, 2020-05-18T21:29:40.210 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2020-05-18T21:29:40.210 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2020-05-18T21:29:40.211 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 1, 2020-05-18T21:29:40.211 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 1, 2020-05-18T21:29:40.211 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 15, 2020-05-18T21:29:40.211 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2020-05-18T21:29:40.211 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2020-05-18T21:29:40.211 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2020-05-18T21:29:40.212 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 14, 2020-05-18T21:29:40.212 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 0, 2020-05-18T21:29:40.212 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2020-05-18T21:29:40.212 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2020-05-18T21:29:40.212 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2020-05-18T21:29:40.213 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2020-05-18T21:29:40.213 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2020-05-18T21:29:40.213 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2020-05-18T21:29:40.213 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2020-05-18T21:29:40.213 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2020-05-18T21:29:40.213 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2020-05-18T21:29:40.214 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 0, 2020-05-18T21:29:40.214 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2020-05-18T21:29:40.214 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2020-05-18T21:29:40.214 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2020-05-18T21:29:40.214 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2020-05-18T21:29:40.215 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2020-05-18T21:29:40.215 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2020-05-18T21:29:40.215 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2020-05-18T21:29:40.215 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2020-05-18T21:29:40.215 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2020-05-18T21:29:40.216 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2020-05-18T21:29:40.216 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2020-05-18T21:29:40.216 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2020-05-18T21:29:40.216 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2020-05-18T21:29:40.216 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2020-05-18T21:29:40.216 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2020-05-18T21:29:40.217 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2020-05-18T21:29:40.217 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 0, 2020-05-18T21:29:40.217 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2020-05-18T21:29:40.217 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 0, 2020-05-18T21:29:40.217 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 6, 2020-05-18T21:29:40.218 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 6, 2020-05-18T21:29:40.218 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2020-05-18T21:29:40.218 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2020-05-18T21:29:40.218 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 152, 2020-05-18T21:29:40.218 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 28, 2020-05-18T21:29:40.218 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 3 2020-05-18T21:29:40.219 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.219 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2020-05-18T21:29:40.219 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 0, 2020-05-18T21:29:40.219 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2020-05-18T21:29:40.219 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2020-05-18T21:29:40.220 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2020-05-18T21:29:40.220 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.220 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2020-05-18T21:29:40.220 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 0, 2020-05-18T21:29:40.220 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 0, 2020-05-18T21:29:40.220 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 0, 2020-05-18T21:29:40.221 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 0, 2020-05-18T21:29:40.221 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 0, 2020-05-18T21:29:40.221 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 0 2020-05-18T21:29:40.221 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.221 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-05-18T21:29:40.222 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 153, 2020-05-18T21:29:40.222 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:40.222 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:40.222 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 5554, 2020-05-18T21:29:40.223 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 1287688, 2020-05-18T21:29:40.223 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:40.223 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 5554, 2020-05-18T21:29:40.223 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:40.223 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:40.224 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 5553, 2020-05-18T21:29:40.224 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 1287535, 2020-05-18T21:29:40.224 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:40.224 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.224 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.224 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.225 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:40.225 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.225 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2020-05-18T21:29:40.225 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:40.225 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:40.226 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:40.226 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:40.226 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:40.226 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:40.226 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:40.226 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 150, 2020-05-18T21:29:40.227 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 11062642, 2020-05-18T21:29:40.227 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 122, 2020-05-18T21:29:40.227 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 11062642, 2020-05-18T21:29:40.227 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:40.227 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.228 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.228 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.228 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:40.228 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.229 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2020-05-18T21:29:40.229 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:40.229 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2020-05-18T21:29:40.229 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:40.229 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:40.230 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:40.230 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:40.230 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:40.230 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 150, 2020-05-18T21:29:40.230 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 150, 2020-05-18T21:29:40.230 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 150, 2020-05-18T21:29:40.231 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 150, 2020-05-18T21:29:40.231 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:40.231 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.232 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.232 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.232 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:40.232 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.232 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2020-05-18T21:29:40.233 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:40.233 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:40.233 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:40.233 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:40.233 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:40.233 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:40.234 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:40.234 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:40.234 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:40.234 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 0, 2020-05-18T21:29:40.234 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 0, 2020-05-18T21:29:40.235 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:40.235 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.235 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.235 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.235 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:40.235 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:40.236 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x558953fdfd60": { 2020-05-18T21:29:40.236 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:40.236 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:40.236 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:40.236 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 5307, 2020-05-18T21:29:40.237 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 10117867, 2020-05-18T21:29:40.237 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:40.237 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 5307, 2020-05-18T21:29:40.238 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:40.238 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:40.238 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 28, 2020-05-18T21:29:40.238 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 10117867, 2020-05-18T21:29:40.238 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:40.238 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:40.239 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:40.239 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:40.239 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:40.239 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:40.239 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:29:40.241 INFO:tasks.cephfs.filesystem:_json_asok output: { "AsyncMessenger::Worker-0": { "msgr_recv_messages": 56, "msgr_send_messages": 58, "msgr_recv_bytes": 21821, "msgr_send_bytes": 6405990, "msgr_created_connections": 7, "msgr_active_connections": 1, "msgr_running_total_time": 0.040495049, "msgr_running_send_time": 0.027970806, "msgr_running_recv_time": 0.003243035, "msgr_running_fast_dispatch_time": 0.006690016, "msgr_send_messages_queue_lat": { "avgcount": 57, "sum": 0.011074600, "avgtime": 0.000194291 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-1": { "msgr_recv_messages": 32, "msgr_send_messages": 36, "msgr_recv_bytes": 9991, "msgr_send_bytes": 302938, "msgr_created_connections": 5, "msgr_active_connections": 2, "msgr_running_total_time": 0.008476587, "msgr_running_send_time": 0.002411045, "msgr_running_recv_time": 0.004534082, "msgr_running_fast_dispatch_time": 0.001012836, "msgr_send_messages_queue_lat": { "avgcount": 36, "sum": 0.006935468, "avgtime": 0.000192651 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-2": { "msgr_recv_messages": 5472, "msgr_send_messages": 11797, "msgr_recv_bytes": 1668772, "msgr_send_bytes": 10307468, "msgr_created_connections": 4, "msgr_active_connections": 2, "msgr_running_total_time": 0.754473434, "msgr_running_send_time": 0.337318394, "msgr_running_recv_time": 0.473802665, "msgr_running_fast_dispatch_time": 0.006222584, "msgr_send_messages_queue_lat": { "avgcount": 11797, "sum": 0.266463094, "avgtime": 0.000022587 }, "msgr_handle_ack_lat": { "avgcount": 16767, "sum": 0.004743611, "avgtime": 0.000000282 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "queue_len": 0, "complete_latency": { "avgcount": 160, "sum": 1.713011903, "avgtime": 0.010706324 } }, "finisher-PurgeQueue": { "queue_len": 0, "complete_latency": { "avgcount": 4, "sum": 0.000116871, "avgtime": 0.000029217 } }, "mds": { "request": 3256, "reply": 3254, "reply_latency": { "avgcount": 3254, "sum": 5.852420628, "avgtime": 0.001798531 }, "forward": 0, "dir_fetch": 12, "dir_commit": 73, "dir_split": 9, "dir_merge": 0, "inodes": 3211, "inodes_top": 0, "inodes_bottom": 3211, "inodes_pin_tail": 0, "inodes_pinned": 3211, "inodes_expired": 0, "inodes_with_caps": 3202, "caps": 3202, "subtrees": 2, "traverse": 3266, "traverse_hit": 3255, "traverse_forward": 0, "traverse_discover": 0, "traverse_dir_fetch": 0, "traverse_remote_ino": 0, "traverse_lock": 0, "load_cent": 297800, "q": 0, "exported": 0, "exported_inodes": 0, "imported": 0, "imported_inodes": 0, "openino_dir_fetch": 0, "openino_backtrace_fetch": 0, "openino_peer_discover": 0, "root_rfiles": 2155, "root_rbytes": 6703104, "root_rsnaps": 0 }, "mds_cache": { "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "strays_created": 0, "strays_enqueued": 0, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 9, "ireq_fragstats": 0, "ireq_inodestats": 0 }, "mds_log": { "evadd": 5307, "evex": 0, "evtrm": 0, "ev": 5309, "evexg": 0, "evexd": 0, "segadd": 6, "segex": 0, "segtrm": 0, "seg": 7, "segexg": 0, "segexd": 0, "expos": 4194304, "wrpos": 14313501, "rdpos": 4195196, "jlat": { "avgcount": 28, "sum": 0.172790830, "avgtime": 0.006171101 }, "replayed": 2 }, "mds_mem": { "ino": 3214, "ino+": 3214, "ino-": 0, "dir": 76, "dir+": 85, "dir-": 9, "dn": 3211, "dn+": 3211, "dn-": 0, "cap": 3202, "cap+": 3202, "cap-": 0, "rss": 77264, "heap": 331932 }, "mds_server": { "dispatch_client_request": 3317, "dispatch_server_request": 0, "handle_client_request": 3256, "handle_client_session": 2, "handle_slave_request": 0, "req_create_latency": { "avgcount": 3200, "sum": 5.456048806, "avgtime": 0.001705015 }, "req_getattr_latency": { "avgcount": 2, "sum": 0.078760379, "avgtime": 0.039380189 }, "req_getfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_link_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookup_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookuphash_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupino_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupname_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupparent_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lssnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mkdir_latency": { "avgcount": 1, "sum": 0.006614312, "avgtime": 0.006614312 }, "req_mknod_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mksnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_open_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_readdir_latency": { "avgcount": 51, "sum": 0.310997131, "avgtime": 0.006097982 }, "req_rename_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_renamesnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmdir_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setdirlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_symlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_unlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "cap_revoke_eviction": 0 }, "mds_sessions": { "session_count": 1, "session_add": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 2991, "average_load": 2991, "avg_session_uptime": 548 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "buffer_anon_bytes": 171452, "buffer_anon_items": 320, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6128, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 10136248, "mds_co_items": 57962, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "op_active": 0, "op_laggy": 0, "op_send": 150, "op_send_bytes": 11061536, "op_resend": 0, "op_reply": 150, "op": 150, "op_r": 26, "op_w": 124, "op_rmw": 0, "op_pg": 0, "osdop_stat": 2, "osdop_create": 0, "osdop_read": 8, "osdop_write": 28, "osdop_writefull": 2, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 1, "osdop_truncate": 1, "osdop_delete": 15, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 14, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 6, "osd_session_open": 6, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 152, "omap_rd": 28, "omap_del": 3 }, "oft": { "omap_total_objs": 0, "omap_total_kv_pairs": 0, "omap_total_updates": 0, "omap_total_removes": 0 }, "purge_queue": { "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executed": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "val": 153, "max": 104857600, "get_started": 0, "get": 5554, "get_sum": 1287688, "get_or_fail_fail": 0, "get_or_fail_success": 5554, "take": 0, "take_sum": 0, "put": 5553, "put_sum": 1287535, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_bytes": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 150, "take_sum": 11062642, "put": 122, "put_sum": 11062642, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_ops": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 150, "take_sum": 150, "put": 150, "put_sum": 150, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle": { "val": 0, "max": 3758096384, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle-0x558953fdfd60": { "val": 0, "max": 3758096384, "get_started": 0, "get": 5307, "get_sum": 10117867, "get_or_fail_fail": 0, "get_or_fail_success": 5307, "take": 0, "take_sum": 0, "put": 28, "put_sum": 10117867, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } 2020-05-18T21:29:40.242 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/0, 0/0 2020-05-18T21:29:41.243 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:41.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.361+0000 7fa83ca4c700 1 Processor -- start 2020-05-18T21:29:41.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.361+0000 7fa83ca4c700 1 -- start start 2020-05-18T21:29:41.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.361+0000 7fa83ca4c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa838142880 0x7fa8380ae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:41.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.361+0000 7fa83ca4c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8380ae850 con 0x7fa8380add00 2020-05-18T21:29:41.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.361+0000 7fa83ca4c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8380aeaf0 con 0x7fa8380b6290 2020-05-18T21:29:41.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.361+0000 7fa83ca4c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8380b3210 con 0x7fa838142880 2020-05-18T21:29:41.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.361+0000 7fa82e59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa8380add00 0x7fa8380b42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58792/0 (socket says 172.21.15.63:58792) 2020-05-18T21:29:41.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.361+0000 7fa83759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa838142880 0x7fa8380ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:41.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.361+0000 7fa82e59c700 1 -- 172.21.15.63:0/2266675449 learned_addr learned my addr 172.21.15.63:0/2266675449 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:41.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.361+0000 7fa83659c700 1 -- 172.21.15.63:0/2266675449 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1248503977 0 0) 0x7fa8380ae850 con 0x7fa8380add00 2020-05-18T21:29:41.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.361+0000 7fa83659c700 1 -- 172.21.15.63:0/2266675449 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa818003270 con 0x7fa8380add00 2020-05-18T21:29:41.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.361+0000 7fa83659c700 1 -- 172.21.15.63:0/2266675449 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671215646 0 0) 0x7fa8380aeaf0 con 0x7fa8380b6290 2020-05-18T21:29:41.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.365+0000 7fa83759e700 1 -- 172.21.15.63:0/2266675449 >> v1:172.21.15.155:6789/0 conn(0x7fa8380b6290 legacy=0x7fa838142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:41.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.365+0000 7fa83759e700 1 -- 172.21.15.63:0/2266675449 >> v1:172.21.15.63:6789/0 conn(0x7fa8380add00 legacy=0x7fa8380b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:41.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.365+0000 7fa83759e700 1 -- 172.21.15.63:0/2266675449 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8380aed90 con 0x7fa838142880 2020-05-18T21:29:41.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.365+0000 7fa83759e700 1 --2- 172.21.15.63:0/2266675449 >> v2:172.21.15.63:3300/0 conn(0x7fa838142880 0x7fa8380ae220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa8300032f0 tx=0x7fa830007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:41.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.365+0000 7fa83759e700 1 --2- 172.21.15.63:0/2266675449 >> v2:172.21.15.63:3300/0 conn(0x7fa838142880 0x7fa8380ae220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa8300032f0 tx=0x7fa830007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:41.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.365+0000 7fa83759e700 1 --2- 172.21.15.63:0/2266675449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa838142880 0x7fa8380ae220 secure :-1 s=READY pgs=760 cs=0 l=1 rx=0x7fa8300032f0 tx=0x7fa830007e00).ready entity=mon.0 client_cookie=1868418067a80b55 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:41.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.365+0000 7fa83759e700 1 --2- 172.21.15.63:0/2266675449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa838142880 0x7fa8380ae220 secure :-1 s=THROTTLE_DONE pgs=760 cs=0 l=1 rx=0x7fa8300032f0 tx=0x7fa830007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:41.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.365+0000 7fa83659c700 1 -- 172.21.15.63:0/2266675449 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa830013e80 con 0x7fa838142880 2020-05-18T21:29:41.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.365+0000 7fa83759e700 1 --2- 172.21.15.63:0/2266675449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa838142880 0x7fa8380ae220 secure :-1 s=THROTTLE_DONE pgs=760 cs=0 l=1 rx=0x7fa8300032f0 tx=0x7fa830007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:41.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.365+0000 7fa83659c700 1 -- 172.21.15.63:0/2266675449 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83000a370 con 0x7fa838142880 2020-05-18T21:29:41.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.365+0000 7fa83759e700 1 --2- 172.21.15.63:0/2266675449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa838142880 0x7fa8380ae220 secure :-1 s=THROTTLE_DONE pgs=760 cs=0 l=1 rx=0x7fa8300032f0 tx=0x7fa830007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:41.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.365+0000 7fa83659c700 1 -- 172.21.15.63:0/2266675449 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa83000a710 con 0x7fa838142880 2020-05-18T21:29:41.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.365+0000 7fa83ca4c700 1 -- 172.21.15.63:0/2266675449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa838142880 msgr2=0x7fa8380ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:41.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.365+0000 7fa83ca4c700 1 --2- 172.21.15.63:0/2266675449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa838142880 0x7fa8380ae220 secure :-1 s=READY pgs=760 cs=0 l=1 rx=0x7fa8300032f0 tx=0x7fa830007e00).stop 2020-05-18T21:29:41.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.365+0000 7fa83ca4c700 1 -- 172.21.15.63:0/2266675449 shutdown_connections 2020-05-18T21:29:41.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.365+0000 7fa83ca4c700 1 --2- 172.21.15.63:0/2266675449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa838142880 0x7fa8380ae220 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:41.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.365+0000 7fa83ca4c700 1 -- 172.21.15.63:0/2266675449 >> 172.21.15.63:0/2266675449 conn(0x7fa8380b9870 msgr2=0x7fa8380b5840 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:41.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.365+0000 7fa83ca4c700 1 -- 172.21.15.63:0/2266675449 shutdown_connections 2020-05-18T21:29:41.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.365+0000 7fa83ca4c700 1 -- 172.21.15.63:0/2266675449 wait complete. 2020-05-18T21:29:41.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa83ca4c700 1 Processor -- start 2020-05-18T21:29:41.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa83ca4c700 1 -- start start 2020-05-18T21:29:41.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa83ca4c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa8380add00 0x7fa8380b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:41.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa83ca4c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa8380b6290 0x7fa8380660c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:41.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa83ca4c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa838142880 0x7fa83813e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:41.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa83ca4c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa838066520 con 0x7fa8380add00 2020-05-18T21:29:41.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa83ca4c700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa838145eb0 con 0x7fa8380b6290 2020-05-18T21:29:41.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa83ca4c700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa838146650 con 0x7fa838142880 2020-05-18T21:29:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa836d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa8380add00 0x7fa8380b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa836d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa8380add00 0x7fa8380b01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56608/0 (socket says 172.21.15.63:56608) 2020-05-18T21:29:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa836d9d700 1 -- 172.21.15.63:0/852901874 learned_addr learned my addr 172.21.15.63:0/852901874 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa82e59c700 1 --2- 172.21.15.63:0/852901874 >> v2:172.21.15.155:3300/0 conn(0x7fa8380b6290 0x7fa8380660c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:41.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa83759e700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa838142880 0x7fa83813e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:41.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa836d9d700 1 -- 172.21.15.63:0/852901874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa838142880 msgr2=0x7fa83813e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:41.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa836d9d700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa838142880 0x7fa83813e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:41.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa836d9d700 1 -- 172.21.15.63:0/852901874 >> v2:172.21.15.155:3300/0 conn(0x7fa8380b6290 msgr2=0x7fa8380660c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:41.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa836d9d700 1 --2- 172.21.15.63:0/852901874 >> v2:172.21.15.155:3300/0 conn(0x7fa8380b6290 0x7fa8380660c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:41.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa836d9d700 1 -- 172.21.15.63:0/852901874 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa838145b00 con 0x7fa8380add00 2020-05-18T21:29:41.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa836d9d700 1 --2- 172.21.15.63:0/852901874 >> v2:172.21.15.63:3300/0 conn(0x7fa8380add00 0x7fa8380b01b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa828000bc0 tx=0x7fa82800c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:41.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa836d9d700 1 --2- 172.21.15.63:0/852901874 >> v2:172.21.15.63:3300/0 conn(0x7fa8380add00 0x7fa8380b01b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa828000bc0 tx=0x7fa82800c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:41.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa836d9d700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8380add00 0x7fa8380b01b0 secure :-1 s=READY pgs=761 cs=0 l=1 rx=0x7fa828000bc0 tx=0x7fa82800c520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:41.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa836d9d700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8380add00 0x7fa8380b01b0 secure :-1 s=THROTTLE_DONE pgs=761 cs=0 l=1 rx=0x7fa828000bc0 tx=0x7fa82800c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:41.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa836d9d700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8380add00 0x7fa8380b01b0 secure :-1 s=THROTTLE_DONE pgs=761 cs=0 l=1 rx=0x7fa828000bc0 tx=0x7fa82800c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:41.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa834d99700 1 -- 172.21.15.63:0/852901874 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa82800cc60 con 0x7fa8380add00 2020-05-18T21:29:41.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa836d9d700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8380add00 0x7fa8380b01b0 secure :-1 s=THROTTLE_DONE pgs=761 cs=0 l=1 rx=0x7fa828000bc0 tx=0x7fa82800c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:41.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa834d99700 1 -- 172.21.15.63:0/852901874 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82800cdc0 con 0x7fa8380add00 2020-05-18T21:29:41.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa83ca4c700 1 -- 172.21.15.63:0/852901874 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8380b2910 con 0x7fa8380add00 2020-05-18T21:29:41.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa834d99700 1 -- 172.21.15.63:0/852901874 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa828011180 con 0x7fa8380add00 2020-05-18T21:29:41.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.369+0000 7fa83ca4c700 1 -- 172.21.15.63:0/852901874 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa838146d10 con 0x7fa8380add00 2020-05-18T21:29:41.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.373+0000 7fa836d9d700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8380add00 0x7fa8380b01b0 secure :-1 s=THROTTLE_DONE pgs=761 cs=0 l=1 rx=0x7fa828000bc0 tx=0x7fa82800c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:41.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.373+0000 7fa83ca4c700 1 -- 172.21.15.63:0/852901874 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8381460b0 con 0x7fa8380add00 2020-05-18T21:29:41.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.373+0000 7fa834d99700 1 -- 172.21.15.63:0/852901874 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa828006520 con 0x7fa8380add00 2020-05-18T21:29:41.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.373+0000 7fa836d9d700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8380add00 0x7fa8380b01b0 secure :-1 s=THROTTLE_DONE pgs=761 cs=0 l=1 rx=0x7fa828000bc0 tx=0x7fa82800c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:41.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.373+0000 7fa834d99700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa81c04fa10 0x7fa81c051ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:41.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.373+0000 7fa834d99700 1 -- 172.21.15.63:0/852901874 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa828063720 con 0x7fa8380add00 2020-05-18T21:29:41.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.373+0000 7fa82e59c700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa81c04fa10 0x7fa81c051ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:41.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.373+0000 7fa82e59c700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa81c04fa10 0x7fa81c051ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa820001110 tx=0x7fa820001da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:41.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.373+0000 7fa82e59c700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa81c04fa10 0x7fa81c051ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa820001110 tx=0x7fa820001da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:41.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.373+0000 7fa82e59c700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa81c04fa10 0x7fa81c051ed0 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7fa820001110 tx=0x7fa820001da0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:41.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.377+0000 7fa836d9d700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8380add00 0x7fa8380b01b0 secure :-1 s=THROTTLE_DONE pgs=761 cs=0 l=1 rx=0x7fa828000bc0 tx=0x7fa82800c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:41.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.377+0000 7fa834d99700 1 -- 172.21.15.63:0/852901874 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa82803dab0 con 0x7fa8380add00 2020-05-18T21:29:41.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.537+0000 7fa83ca4c700 1 -- 172.21.15.63:0/852901874 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8380569e0 con 0x7fa8380add00 2020-05-18T21:29:41.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.537+0000 7fa836d9d700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8380add00 0x7fa8380b01b0 secure :-1 s=THROTTLE_DONE pgs=761 cs=0 l=1 rx=0x7fa828000bc0 tx=0x7fa82800c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:41.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.537+0000 7fa834d99700 1 -- 172.21.15.63:0/852901874 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2141 (secure 0 0 0) 0x7fa8280410d0 con 0x7fa8380add00 2020-05-18T21:29:41.543 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:41.543 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/3895568247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3895568247},{"type":"v1","addr":"172.21.15.63:6833","nonce":3895568247}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:24.694515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6319":{"gid":6319,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/400120989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":400120989},{"type":"v1","addr":"172.21.15.155:6835","nonce":400120989}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:41.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.537+0000 7fa83ca4c700 1 -- 172.21.15.63:0/852901874 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa81c04fa10 msgr2=0x7fa81c051ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:41.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.537+0000 7fa83ca4c700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa81c04fa10 0x7fa81c051ed0 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7fa820001110 tx=0x7fa820001da0).stop 2020-05-18T21:29:41.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.537+0000 7fa83ca4c700 1 -- 172.21.15.63:0/852901874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8380add00 msgr2=0x7fa8380b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:41.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.537+0000 7fa83ca4c700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8380add00 0x7fa8380b01b0 secure :-1 s=READY pgs=761 cs=0 l=1 rx=0x7fa828000bc0 tx=0x7fa82800c520).stop 2020-05-18T21:29:41.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.537+0000 7fa83ca4c700 1 -- 172.21.15.63:0/852901874 shutdown_connections 2020-05-18T21:29:41.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.537+0000 7fa83ca4c700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa81c04fa10 0x7fa81c051ed0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:41.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.537+0000 7fa83ca4c700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa838142880 0x7fa83813e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:41.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.537+0000 7fa83ca4c700 1 --2- 172.21.15.63:0/852901874 >> v2:172.21.15.155:3300/0 conn(0x7fa8380b6290 0x7fa8380660c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:41.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.537+0000 7fa83ca4c700 1 --2- 172.21.15.63:0/852901874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8380add00 0x7fa8380b01b0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:41.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.537+0000 7fa83ca4c700 1 -- 172.21.15.63:0/852901874 >> 172.21.15.63:0/852901874 conn(0x7fa8380b9870 msgr2=0x7fa83805eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:41.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.537+0000 7fa83ca4c700 1 -- 172.21.15.63:0/852901874 shutdown_connections 2020-05-18T21:29:41.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:41.537+0000 7fa83ca4c700 1 -- 172.21.15.63:0/852901874 wait complete. 2020-05-18T21:29:41.547 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 34 2020-05-18T21:29:41.554 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2020-05-18T21:29:41.666 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:29:41.667 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2020-05-18T21:29:41.667 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 56, 2020-05-18T21:29:41.667 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 58, 2020-05-18T21:29:41.668 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 21821, 2020-05-18T21:29:41.668 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 6405990, 2020-05-18T21:29:41.668 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 7, 2020-05-18T21:29:41.668 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 1, 2020-05-18T21:29:41.668 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.040495049, 2020-05-18T21:29:41.669 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.027970806, 2020-05-18T21:29:41.669 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.003243035, 2020-05-18T21:29:41.669 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.006690016, 2020-05-18T21:29:41.669 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:41.669 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 57, 2020-05-18T21:29:41.670 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.011074600, 2020-05-18T21:29:41.670 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000194291 2020-05-18T21:29:41.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.670 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:41.670 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.671 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.671 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.671 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:41.671 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.671 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2020-05-18T21:29:41.672 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 32, 2020-05-18T21:29:41.672 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 37, 2020-05-18T21:29:41.672 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 9991, 2020-05-18T21:29:41.672 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 304522, 2020-05-18T21:29:41.673 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 5, 2020-05-18T21:29:41.673 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 2, 2020-05-18T21:29:41.673 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.008579851, 2020-05-18T21:29:41.673 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.002496552, 2020-05-18T21:29:41.673 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.004534082, 2020-05-18T21:29:41.674 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.001012836, 2020-05-18T21:29:41.674 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:41.674 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 37, 2020-05-18T21:29:41.674 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.007009651, 2020-05-18T21:29:41.675 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000189450 2020-05-18T21:29:41.675 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.675 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:41.675 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.675 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.676 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.676 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:41.676 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.676 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2020-05-18T21:29:41.676 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 6482, 2020-05-18T21:29:41.677 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 12393, 2020-05-18T21:29:41.685 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 1991735, 2020-05-18T21:29:41.685 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 10859791, 2020-05-18T21:29:41.685 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 4, 2020-05-18T21:29:41.685 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 2, 2020-05-18T21:29:41.686 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.836016613, 2020-05-18T21:29:41.686 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.370758516, 2020-05-18T21:29:41.686 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.539542466, 2020-05-18T21:29:41.686 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.006222584, 2020-05-18T21:29:41.686 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:41.687 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 12393, 2020-05-18T21:29:41.687 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.284650982, 2020-05-18T21:29:41.687 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000022968 2020-05-18T21:29:41.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.687 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:41.688 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 18370, 2020-05-18T21:29:41.688 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.005094397, 2020-05-18T21:29:41.688 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000277 2020-05-18T21:29:41.688 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:41.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.689 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2020-05-18T21:29:41.689 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2020-05-18T21:29:41.689 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2020-05-18T21:29:41.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.690 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2020-05-18T21:29:41.690 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:41.690 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:41.691 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 160, 2020-05-18T21:29:41.691 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 1.713011903, 2020-05-18T21:29:41.691 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.010706324 2020-05-18T21:29:41.691 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:41.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.692 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2020-05-18T21:29:41.692 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:41.692 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:41.692 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 4, 2020-05-18T21:29:41.693 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000116871, 2020-05-18T21:29:41.693 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000029217 2020-05-18T21:29:41.693 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:41.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.693 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2020-05-18T21:29:41.694 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 3694, 2020-05-18T21:29:41.694 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 3691, 2020-05-18T21:29:41.694 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2020-05-18T21:29:41.694 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3691, 2020-05-18T21:29:41.695 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 6.686022158, 2020-05-18T21:29:41.695 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001811439 2020-05-18T21:29:41.695 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.695 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 0, 2020-05-18T21:29:41.695 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch": 12, 2020-05-18T21:29:41.696 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 73, 2020-05-18T21:29:41.696 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 9, 2020-05-18T21:29:41.696 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 0, 2020-05-18T21:29:41.696 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 3211, 2020-05-18T21:29:41.696 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 0, 2020-05-18T21:29:41.697 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 3211, 2020-05-18T21:29:41.697 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 0, 2020-05-18T21:29:41.697 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 3211, 2020-05-18T21:29:41.697 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 0, 2020-05-18T21:29:41.697 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 3202, 2020-05-18T21:29:41.698 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 3202, 2020-05-18T21:29:41.698 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 2, 2020-05-18T21:29:41.698 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 3704, 2020-05-18T21:29:41.698 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 3693, 2020-05-18T21:29:41.698 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 0, 2020-05-18T21:29:41.699 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 0, 2020-05-18T21:29:41.699 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2020-05-18T21:29:41.699 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2020-05-18T21:29:41.699 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 0, 2020-05-18T21:29:41.699 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 297800, 2020-05-18T21:29:41.699 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2020-05-18T21:29:41.700 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 0, 2020-05-18T21:29:41.700 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 0, 2020-05-18T21:29:41.700 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 0, 2020-05-18T21:29:41.700 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 0, 2020-05-18T21:29:41.701 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2020-05-18T21:29:41.701 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 0, 2020-05-18T21:29:41.701 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2020-05-18T21:29:41.701 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 2155, 2020-05-18T21:29:41.701 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 6703104, 2020-05-18T21:29:41.701 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 0 2020-05-18T21:29:41.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.702 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:29:41.702 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 421, 2020-05-18T21:29:41.702 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 0, 2020-05-18T21:29:41.702 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:29:41.703 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 421, 2020-05-18T21:29:41.703 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 0, 2020-05-18T21:29:41.703 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2020-05-18T21:29:41.703 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2020-05-18T21:29:41.703 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2020-05-18T21:29:41.704 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:29:41.704 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:29:41.704 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2020-05-18T21:29:41.704 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2020-05-18T21:29:41.704 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:29:41.704 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 0, 2020-05-18T21:29:41.705 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2020-05-18T21:29:41.705 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 9, 2020-05-18T21:29:41.705 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2020-05-18T21:29:41.705 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2020-05-18T21:29:41.705 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.706 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2020-05-18T21:29:41.706 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 6285, 2020-05-18T21:29:41.706 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 0, 2020-05-18T21:29:41.706 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 0, 2020-05-18T21:29:41.706 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 6287, 2020-05-18T21:29:41.706 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 0, 2020-05-18T21:29:41.707 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 0, 2020-05-18T21:29:41.707 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 7, 2020-05-18T21:29:41.707 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 0, 2020-05-18T21:29:41.707 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 0, 2020-05-18T21:29:41.707 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 8, 2020-05-18T21:29:41.708 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 0, 2020-05-18T21:29:41.708 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 0, 2020-05-18T21:29:41.708 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 4194304, 2020-05-18T21:29:41.708 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 16683031, 2020-05-18T21:29:41.708 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 4195196, 2020-05-18T21:29:41.709 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2020-05-18T21:29:41.709 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 28, 2020-05-18T21:29:41.709 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.172790830, 2020-05-18T21:29:41.709 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.006171101 2020-05-18T21:29:41.709 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.709 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 2 2020-05-18T21:29:41.710 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.710 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2020-05-18T21:29:41.710 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 3214, 2020-05-18T21:29:41.710 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 3214, 2020-05-18T21:29:41.710 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 0, 2020-05-18T21:29:41.711 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 76, 2020-05-18T21:29:41.711 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 85, 2020-05-18T21:29:41.711 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 9, 2020-05-18T21:29:41.711 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 3632, 2020-05-18T21:29:41.711 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 3632, 2020-05-18T21:29:41.711 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 0, 2020-05-18T21:29:41.712 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 3202, 2020-05-18T21:29:41.712 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 3202, 2020-05-18T21:29:41.712 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 0, 2020-05-18T21:29:41.712 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 77264, 2020-05-18T21:29:41.712 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 331932 2020-05-18T21:29:41.713 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.713 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2020-05-18T21:29:41.713 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 3771, 2020-05-18T21:29:41.713 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 0, 2020-05-18T21:29:41.713 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 3694, 2020-05-18T21:29:41.713 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 2, 2020-05-18T21:29:41.714 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_slave_request": 0, 2020-05-18T21:29:41.714 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2020-05-18T21:29:41.714 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3200, 2020-05-18T21:29:41.714 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 5.456048806, 2020-05-18T21:29:41.714 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001705015 2020-05-18T21:29:41.715 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.715 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2020-05-18T21:29:41.715 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2, 2020-05-18T21:29:41.715 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.078760379, 2020-05-18T21:29:41.715 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.039380189 2020-05-18T21:29:41.716 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.716 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2020-05-18T21:29:41.716 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.716 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.717 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.717 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2020-05-18T21:29:41.717 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.717 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.717 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.718 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.718 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2020-05-18T21:29:41.718 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.718 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.718 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.719 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.719 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2020-05-18T21:29:41.719 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.719 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.719 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.719 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.720 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2020-05-18T21:29:41.720 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.720 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.720 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.721 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2020-05-18T21:29:41.721 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.721 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.721 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.721 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.722 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2020-05-18T21:29:41.722 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.722 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.722 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.722 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.722 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2020-05-18T21:29:41.723 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.723 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.723 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.723 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.723 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2020-05-18T21:29:41.724 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.724 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.724 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.724 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.724 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2020-05-18T21:29:41.724 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1, 2020-05-18T21:29:41.725 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.006614312, 2020-05-18T21:29:41.725 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.006614312 2020-05-18T21:29:41.725 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.725 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2020-05-18T21:29:41.725 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.726 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.726 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.726 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.726 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2020-05-18T21:29:41.726 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.726 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.727 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.727 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.727 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2020-05-18T21:29:41.727 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.727 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.728 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.728 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.728 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2020-05-18T21:29:41.728 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 67, 2020-05-18T21:29:41.728 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.349282571, 2020-05-18T21:29:41.728 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.005213172 2020-05-18T21:29:41.729 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.729 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2020-05-18T21:29:41.729 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.729 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.729 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.730 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.730 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2020-05-18T21:29:41.730 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.730 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.730 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.731 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.731 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2020-05-18T21:29:41.731 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.731 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.731 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.731 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.732 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2020-05-18T21:29:41.732 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.732 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.732 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.732 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.733 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2020-05-18T21:29:41.733 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.733 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.733 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.733 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.734 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2020-05-18T21:29:41.734 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.734 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.734 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.734 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.734 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2020-05-18T21:29:41.735 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.735 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.735 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.735 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2020-05-18T21:29:41.736 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.736 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.736 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.736 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.736 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2020-05-18T21:29:41.736 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.737 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.737 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.737 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2020-05-18T21:29:41.737 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.738 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.738 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.738 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.738 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2020-05-18T21:29:41.739 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.739 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.739 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.739 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.740 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2020-05-18T21:29:41.740 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 421, 2020-05-18T21:29:41.740 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.795316090, 2020-05-18T21:29:41.740 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001889111 2020-05-18T21:29:41.740 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.741 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0 2020-05-18T21:29:41.741 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.741 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2020-05-18T21:29:41.741 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 1, 2020-05-18T21:29:41.741 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 1, 2020-05-18T21:29:41.741 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 0, 2020-05-18T21:29:41.742 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 1, 2020-05-18T21:29:41.742 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2020-05-18T21:29:41.742 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 3371, 2020-05-18T21:29:41.742 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 3371, 2020-05-18T21:29:41.742 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 548 2020-05-18T21:29:41.743 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.743 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2020-05-18T21:29:41.743 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2020-05-18T21:29:41.743 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2020-05-18T21:29:41.743 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2020-05-18T21:29:41.744 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2020-05-18T21:29:41.744 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2020-05-18T21:29:41.744 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2020-05-18T21:29:41.744 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2020-05-18T21:29:41.744 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2020-05-18T21:29:41.744 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2020-05-18T21:29:41.745 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2020-05-18T21:29:41.745 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2020-05-18T21:29:41.745 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2020-05-18T21:29:41.745 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2020-05-18T21:29:41.745 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2020-05-18T21:29:41.746 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2020-05-18T21:29:41.746 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2020-05-18T21:29:41.746 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2020-05-18T21:29:41.746 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2020-05-18T21:29:41.746 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2020-05-18T21:29:41.746 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2020-05-18T21:29:41.747 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 171452, 2020-05-18T21:29:41.747 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 320, 2020-05-18T21:29:41.747 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2020-05-18T21:29:41.747 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2020-05-18T21:29:41.747 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2020-05-18T21:29:41.748 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2020-05-18T21:29:41.748 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2020-05-18T21:29:41.748 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2020-05-18T21:29:41.748 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2020-05-18T21:29:41.748 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2020-05-18T21:29:41.749 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 6128, 2020-05-18T21:29:41.749 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 93, 2020-05-18T21:29:41.749 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2020-05-18T21:29:41.749 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2020-05-18T21:29:41.749 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2020-05-18T21:29:41.749 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2020-05-18T21:29:41.750 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 10136248, 2020-05-18T21:29:41.750 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 57962, 2020-05-18T21:29:41.750 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2020-05-18T21:29:41.750 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2020-05-18T21:29:41.750 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2020-05-18T21:29:41.751 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2020-05-18T21:29:41.751 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.751 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2020-05-18T21:29:41.751 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 0, 2020-05-18T21:29:41.751 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2020-05-18T21:29:41.751 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 150, 2020-05-18T21:29:41.752 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 11061536, 2020-05-18T21:29:41.752 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 0, 2020-05-18T21:29:41.752 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 150, 2020-05-18T21:29:41.752 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 150, 2020-05-18T21:29:41.752 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 26, 2020-05-18T21:29:41.753 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 124, 2020-05-18T21:29:41.753 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2020-05-18T21:29:41.753 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2020-05-18T21:29:41.753 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 2, 2020-05-18T21:29:41.753 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 0, 2020-05-18T21:29:41.753 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 8, 2020-05-18T21:29:41.754 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 28, 2020-05-18T21:29:41.754 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 2, 2020-05-18T21:29:41.754 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2020-05-18T21:29:41.754 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2020-05-18T21:29:41.754 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 1, 2020-05-18T21:29:41.755 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 1, 2020-05-18T21:29:41.755 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 15, 2020-05-18T21:29:41.755 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2020-05-18T21:29:41.755 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2020-05-18T21:29:41.755 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2020-05-18T21:29:41.756 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 14, 2020-05-18T21:29:41.756 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 0, 2020-05-18T21:29:41.756 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2020-05-18T21:29:41.756 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2020-05-18T21:29:41.756 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2020-05-18T21:29:41.756 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2020-05-18T21:29:41.757 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2020-05-18T21:29:41.757 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2020-05-18T21:29:41.757 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2020-05-18T21:29:41.757 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2020-05-18T21:29:41.757 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2020-05-18T21:29:41.758 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 0, 2020-05-18T21:29:41.758 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2020-05-18T21:29:41.758 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2020-05-18T21:29:41.758 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2020-05-18T21:29:41.758 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2020-05-18T21:29:41.758 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2020-05-18T21:29:41.759 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2020-05-18T21:29:41.759 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2020-05-18T21:29:41.759 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2020-05-18T21:29:41.759 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2020-05-18T21:29:41.759 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2020-05-18T21:29:41.760 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2020-05-18T21:29:41.760 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2020-05-18T21:29:41.760 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2020-05-18T21:29:41.760 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2020-05-18T21:29:41.760 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2020-05-18T21:29:41.760 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2020-05-18T21:29:41.761 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 0, 2020-05-18T21:29:41.761 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2020-05-18T21:29:41.761 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 0, 2020-05-18T21:29:41.761 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 6, 2020-05-18T21:29:41.761 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 6, 2020-05-18T21:29:41.762 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2020-05-18T21:29:41.762 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2020-05-18T21:29:41.762 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 152, 2020-05-18T21:29:41.762 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 28, 2020-05-18T21:29:41.762 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 3 2020-05-18T21:29:41.763 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.763 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2020-05-18T21:29:41.763 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 0, 2020-05-18T21:29:41.763 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2020-05-18T21:29:41.763 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2020-05-18T21:29:41.763 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2020-05-18T21:29:41.764 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.764 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2020-05-18T21:29:41.764 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 0, 2020-05-18T21:29:41.764 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 0, 2020-05-18T21:29:41.764 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 0, 2020-05-18T21:29:41.765 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 0, 2020-05-18T21:29:41.765 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 0, 2020-05-18T21:29:41.765 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 0 2020-05-18T21:29:41.765 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.765 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-05-18T21:29:41.765 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 240, 2020-05-18T21:29:41.766 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:41.766 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:41.766 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 6563, 2020-05-18T21:29:41.766 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 1535758, 2020-05-18T21:29:41.766 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:41.767 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 6563, 2020-05-18T21:29:41.767 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:41.767 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:41.767 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 6562, 2020-05-18T21:29:41.767 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 1535518, 2020-05-18T21:29:41.767 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:41.768 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.768 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.768 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.768 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:41.768 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.769 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2020-05-18T21:29:41.769 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:41.769 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:41.769 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:41.769 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:41.770 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:41.770 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:41.770 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:41.770 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 150, 2020-05-18T21:29:41.770 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 11062642, 2020-05-18T21:29:41.770 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 122, 2020-05-18T21:29:41.771 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 11062642, 2020-05-18T21:29:41.771 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:41.771 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.771 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.771 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.772 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:41.772 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.772 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2020-05-18T21:29:41.772 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:41.772 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2020-05-18T21:29:41.772 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:41.773 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:41.773 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:41.773 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:41.773 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:41.773 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 150, 2020-05-18T21:29:41.774 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 150, 2020-05-18T21:29:41.774 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 150, 2020-05-18T21:29:41.774 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 150, 2020-05-18T21:29:41.774 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:41.774 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.775 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.775 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.775 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:41.775 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.776 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2020-05-18T21:29:41.776 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:41.776 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:41.776 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:41.776 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:41.777 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:41.777 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:41.777 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:41.777 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:41.777 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:41.777 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 0, 2020-05-18T21:29:41.778 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 0, 2020-05-18T21:29:41.778 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:41.778 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.778 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.778 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.779 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:41.779 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:41.779 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x558953fdfd60": { 2020-05-18T21:29:41.779 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 2369530, 2020-05-18T21:29:41.779 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:41.779 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:41.780 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 6285, 2020-05-18T21:29:41.780 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 12487397, 2020-05-18T21:29:41.780 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:41.780 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 6285, 2020-05-18T21:29:41.780 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:41.781 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:41.781 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 28, 2020-05-18T21:29:41.781 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 10117867, 2020-05-18T21:29:41.781 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:41.781 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:41.782 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:41.782 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:41.782 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:41.782 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:41.782 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:29:41.784 INFO:tasks.cephfs.filesystem:_json_asok output: { "AsyncMessenger::Worker-0": { "msgr_recv_messages": 56, "msgr_send_messages": 58, "msgr_recv_bytes": 21821, "msgr_send_bytes": 6405990, "msgr_created_connections": 7, "msgr_active_connections": 1, "msgr_running_total_time": 0.040495049, "msgr_running_send_time": 0.027970806, "msgr_running_recv_time": 0.003243035, "msgr_running_fast_dispatch_time": 0.006690016, "msgr_send_messages_queue_lat": { "avgcount": 57, "sum": 0.011074600, "avgtime": 0.000194291 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-1": { "msgr_recv_messages": 32, "msgr_send_messages": 37, "msgr_recv_bytes": 9991, "msgr_send_bytes": 304522, "msgr_created_connections": 5, "msgr_active_connections": 2, "msgr_running_total_time": 0.008579851, "msgr_running_send_time": 0.002496552, "msgr_running_recv_time": 0.004534082, "msgr_running_fast_dispatch_time": 0.001012836, "msgr_send_messages_queue_lat": { "avgcount": 37, "sum": 0.007009651, "avgtime": 0.000189450 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-2": { "msgr_recv_messages": 6482, "msgr_send_messages": 12393, "msgr_recv_bytes": 1991735, "msgr_send_bytes": 10859791, "msgr_created_connections": 4, "msgr_active_connections": 2, "msgr_running_total_time": 0.836016613, "msgr_running_send_time": 0.370758516, "msgr_running_recv_time": 0.539542466, "msgr_running_fast_dispatch_time": 0.006222584, "msgr_send_messages_queue_lat": { "avgcount": 12393, "sum": 0.284650982, "avgtime": 0.000022968 }, "msgr_handle_ack_lat": { "avgcount": 18370, "sum": 0.005094397, "avgtime": 0.000000277 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "queue_len": 0, "complete_latency": { "avgcount": 160, "sum": 1.713011903, "avgtime": 0.010706324 } }, "finisher-PurgeQueue": { "queue_len": 0, "complete_latency": { "avgcount": 4, "sum": 0.000116871, "avgtime": 0.000029217 } }, "mds": { "request": 3694, "reply": 3691, "reply_latency": { "avgcount": 3691, "sum": 6.686022158, "avgtime": 0.001811439 }, "forward": 0, "dir_fetch": 12, "dir_commit": 73, "dir_split": 9, "dir_merge": 0, "inodes": 3211, "inodes_top": 0, "inodes_bottom": 3211, "inodes_pin_tail": 0, "inodes_pinned": 3211, "inodes_expired": 0, "inodes_with_caps": 3202, "caps": 3202, "subtrees": 2, "traverse": 3704, "traverse_hit": 3693, "traverse_forward": 0, "traverse_discover": 0, "traverse_dir_fetch": 0, "traverse_remote_ino": 0, "traverse_lock": 0, "load_cent": 297800, "q": 0, "exported": 0, "exported_inodes": 0, "imported": 0, "imported_inodes": 0, "openino_dir_fetch": 0, "openino_backtrace_fetch": 0, "openino_peer_discover": 0, "root_rfiles": 2155, "root_rbytes": 6703104, "root_rsnaps": 0 }, "mds_cache": { "num_strays": 421, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "strays_created": 421, "strays_enqueued": 0, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 9, "ireq_fragstats": 0, "ireq_inodestats": 0 }, "mds_log": { "evadd": 6285, "evex": 0, "evtrm": 0, "ev": 6287, "evexg": 0, "evexd": 0, "segadd": 7, "segex": 0, "segtrm": 0, "seg": 8, "segexg": 0, "segexd": 0, "expos": 4194304, "wrpos": 16683031, "rdpos": 4195196, "jlat": { "avgcount": 28, "sum": 0.172790830, "avgtime": 0.006171101 }, "replayed": 2 }, "mds_mem": { "ino": 3214, "ino+": 3214, "ino-": 0, "dir": 76, "dir+": 85, "dir-": 9, "dn": 3632, "dn+": 3632, "dn-": 0, "cap": 3202, "cap+": 3202, "cap-": 0, "rss": 77264, "heap": 331932 }, "mds_server": { "dispatch_client_request": 3771, "dispatch_server_request": 0, "handle_client_request": 3694, "handle_client_session": 2, "handle_slave_request": 0, "req_create_latency": { "avgcount": 3200, "sum": 5.456048806, "avgtime": 0.001705015 }, "req_getattr_latency": { "avgcount": 2, "sum": 0.078760379, "avgtime": 0.039380189 }, "req_getfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_link_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookup_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookuphash_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupino_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupname_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupparent_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lssnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mkdir_latency": { "avgcount": 1, "sum": 0.006614312, "avgtime": 0.006614312 }, "req_mknod_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mksnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_open_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_readdir_latency": { "avgcount": 67, "sum": 0.349282571, "avgtime": 0.005213172 }, "req_rename_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_renamesnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmdir_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setdirlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_symlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_unlink_latency": { "avgcount": 421, "sum": 0.795316090, "avgtime": 0.001889111 }, "cap_revoke_eviction": 0 }, "mds_sessions": { "session_count": 1, "session_add": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 3371, "average_load": 3371, "avg_session_uptime": 548 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "buffer_anon_bytes": 171452, "buffer_anon_items": 320, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6128, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 10136248, "mds_co_items": 57962, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "op_active": 0, "op_laggy": 0, "op_send": 150, "op_send_bytes": 11061536, "op_resend": 0, "op_reply": 150, "op": 150, "op_r": 26, "op_w": 124, "op_rmw": 0, "op_pg": 0, "osdop_stat": 2, "osdop_create": 0, "osdop_read": 8, "osdop_write": 28, "osdop_writefull": 2, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 1, "osdop_truncate": 1, "osdop_delete": 15, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 14, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 6, "osd_session_open": 6, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 152, "omap_rd": 28, "omap_del": 3 }, "oft": { "omap_total_objs": 0, "omap_total_kv_pairs": 0, "omap_total_updates": 0, "omap_total_removes": 0 }, "purge_queue": { "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executed": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "val": 240, "max": 104857600, "get_started": 0, "get": 6563, "get_sum": 1535758, "get_or_fail_fail": 0, "get_or_fail_success": 6563, "take": 0, "take_sum": 0, "put": 6562, "put_sum": 1535518, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_bytes": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 150, "take_sum": 11062642, "put": 122, "put_sum": 11062642, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_ops": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 150, "take_sum": 150, "put": 150, "put_sum": 150, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle": { "val": 0, "max": 3758096384, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle-0x558953fdfd60": { "val": 2369530, "max": 3758096384, "get_started": 0, "get": 6285, "get_sum": 12487397, "get_or_fail_fail": 0, "get_or_fail_success": 6285, "take": 0, "take_sum": 0, "put": 28, "put_sum": 10117867, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } 2020-05-18T21:29:41.785 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/421, 0/421 2020-05-18T21:29:42.787 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:42.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e15ef5700 1 Processor -- start 2020-05-18T21:29:42.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e15ef5700 1 -- start start 2020-05-18T21:29:42.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e15ef5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e10142b30 0x7f0e100b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:42.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e15ef5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0e1009df70 0x7f0e1009e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:42.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e15ef5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e100b5500 con 0x7f0e10066400 2020-05-18T21:29:42.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e15ef5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e10147080 con 0x7f0e1009df70 2020-05-18T21:29:42.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e15ef5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e10147320 con 0x7f0e10142b30 2020-05-18T21:29:42.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e156f4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0e1009df70 0x7f0e1009e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:42.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e156f4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0e1009df70 0x7f0e1009e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56620/0 (socket says 172.21.15.63:56620) 2020-05-18T21:29:42.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e156f4700 1 -- 172.21.15.63:0/342798669 learned_addr learned my addr 172.21.15.63:0/342798669 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:42.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e14ef3700 1 --1- 172.21.15.63:0/342798669 >> v1:172.21.15.155:6789/0 conn(0x7f0e10066400 0x7f0e10142420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:57120/0 (socket says 172.21.15.63:57120) 2020-05-18T21:29:42.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e0ffff700 1 --2- 172.21.15.63:0/342798669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e10142b30 0x7f0e100b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:42.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e156f4700 1 -- 172.21.15.63:0/342798669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e10142b30 msgr2=0x7f0e100b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:42.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e156f4700 1 --2- 172.21.15.63:0/342798669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e10142b30 0x7f0e100b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:42.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e156f4700 1 -- 172.21.15.63:0/342798669 >> v1:172.21.15.155:6789/0 conn(0x7f0e10066400 legacy=0x7f0e10142420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:42.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e156f4700 1 -- 172.21.15.63:0/342798669 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e100667e0 con 0x7f0e1009df70 2020-05-18T21:29:42.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e156f4700 1 --2- 172.21.15.63:0/342798669 >> v2:172.21.15.63:3300/0 conn(0x7f0e1009df70 0x7f0e1009e3f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0e00002f70 tx=0x7f0e00007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:42.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e156f4700 1 --2- 172.21.15.63:0/342798669 >> v2:172.21.15.63:3300/0 conn(0x7f0e1009df70 0x7f0e1009e3f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0e00002f70 tx=0x7f0e00007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:42.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e156f4700 1 --2- 172.21.15.63:0/342798669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e1009df70 0x7f0e1009e3f0 secure :-1 s=READY pgs=762 cs=0 l=1 rx=0x7f0e00002f70 tx=0x7f0e00007a80).ready entity=mon.0 client_cookie=cdaadc6c6232a051 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:42.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e156f4700 1 --2- 172.21.15.63:0/342798669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e1009df70 0x7f0e1009e3f0 secure :-1 s=THROTTLE_DONE pgs=762 cs=0 l=1 rx=0x7f0e00002f70 tx=0x7f0e00007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:42.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e0f7fe700 1 -- 172.21.15.63:0/342798669 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e00008e50 con 0x7f0e1009df70 2020-05-18T21:29:42.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e156f4700 1 --2- 172.21.15.63:0/342798669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e1009df70 0x7f0e1009e3f0 secure :-1 s=THROTTLE_DONE pgs=762 cs=0 l=1 rx=0x7f0e00002f70 tx=0x7f0e00007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:42.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e156f4700 1 --2- 172.21.15.63:0/342798669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e1009df70 0x7f0e1009e3f0 secure :-1 s=THROTTLE_DONE pgs=762 cs=0 l=1 rx=0x7f0e00002f70 tx=0x7f0e00007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:42.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e0f7fe700 1 -- 172.21.15.63:0/342798669 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e00010750 con 0x7f0e1009df70 2020-05-18T21:29:42.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e0f7fe700 1 -- 172.21.15.63:0/342798669 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e00010b70 con 0x7f0e1009df70 2020-05-18T21:29:42.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e15ef5700 1 -- 172.21.15.63:0/342798669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e1009df70 msgr2=0x7f0e1009e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:42.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e15ef5700 1 --2- 172.21.15.63:0/342798669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e1009df70 0x7f0e1009e3f0 secure :-1 s=READY pgs=762 cs=0 l=1 rx=0x7f0e00002f70 tx=0x7f0e00007a80).stop 2020-05-18T21:29:42.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e15ef5700 1 -- 172.21.15.63:0/342798669 shutdown_connections 2020-05-18T21:29:42.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e15ef5700 1 --2- 172.21.15.63:0/342798669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e1009df70 0x7f0e1009e3f0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:42.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e15ef5700 1 --2- 172.21.15.63:0/342798669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e10142b30 0x7f0e100b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:42.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e15ef5700 1 -- 172.21.15.63:0/342798669 >> 172.21.15.63:0/342798669 conn(0x7f0e100b9620 msgr2=0x7f0e100b9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:42.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e15ef5700 1 -- 172.21.15.63:0/342798669 shutdown_connections 2020-05-18T21:29:42.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.901+0000 7f0e15ef5700 1 -- 172.21.15.63:0/342798669 wait complete. 2020-05-18T21:29:42.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e15ef5700 1 Processor -- start 2020-05-18T21:29:42.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e15ef5700 1 -- start start 2020-05-18T21:29:42.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e15ef5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0e10066400 0x7f0e10141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:42.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e15ef5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e101410c0 con 0x7f0e1009df70 2020-05-18T21:29:42.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e15ef5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e10063b70 con 0x7f0e10142b30 2020-05-18T21:29:42.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e15ef5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e100638d0 con 0x7f0e10066400 2020-05-18T21:29:42.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e0ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0e1009df70 0x7f0e10065510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58812/0 (socket says 172.21.15.63:58812) 2020-05-18T21:29:42.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e14ef3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0e10066400 0x7f0e10141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:42.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e0ffff700 1 -- 172.21.15.63:0/3062558654 learned_addr learned my addr 172.21.15.63:0/3062558654 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:42.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e14ef3700 1 -- 172.21.15.63:0/3062558654 >> v1:172.21.15.155:6789/0 conn(0x7f0e10142b30 legacy=0x7f0e100b8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:42.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e14ef3700 1 -- 172.21.15.63:0/3062558654 >> v1:172.21.15.63:6789/0 conn(0x7f0e1009df70 legacy=0x7f0e10065510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:42.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e0dffb700 1 -- 172.21.15.63:0/3062558654 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109121405 0 0) 0x7f0e10063b70 con 0x7f0e10142b30 2020-05-18T21:29:42.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e14ef3700 1 -- 172.21.15.63:0/3062558654 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e101402f0 con 0x7f0e10066400 2020-05-18T21:29:42.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e14ef3700 1 --2- 172.21.15.63:0/3062558654 >> v2:172.21.15.155:3300/0 conn(0x7f0e10066400 0x7f0e10141520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0e10061bd0 tx=0x7f0e1006ac80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:42.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e14ef3700 1 --2- 172.21.15.63:0/3062558654 >> v2:172.21.15.155:3300/0 conn(0x7f0e10066400 0x7f0e10141520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0e10061bd0 tx=0x7f0e1006ac80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:42.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e14ef3700 1 --2- 172.21.15.63:0/3062558654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e10066400 0x7f0e10141520 secure :-1 s=READY pgs=542 cs=0 l=1 rx=0x7f0e10061bd0 tx=0x7f0e1006ac80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:42.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e14ef3700 1 --2- 172.21.15.63:0/3062558654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e10066400 0x7f0e10141520 secure :-1 s=THROTTLE_DONE pgs=542 cs=0 l=1 rx=0x7f0e10061bd0 tx=0x7f0e1006ac80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:42.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e14ef3700 1 --2- 172.21.15.63:0/3062558654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e10066400 0x7f0e10141520 secure :-1 s=THROTTLE_DONE pgs=542 cs=0 l=1 rx=0x7f0e10061bd0 tx=0x7f0e1006ac80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:42.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e14ef3700 1 --2- 172.21.15.63:0/3062558654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e10066400 0x7f0e10141520 secure :-1 s=THROTTLE_DONE pgs=542 cs=0 l=1 rx=0x7f0e10061bd0 tx=0x7f0e1006ac80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:42.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e0dffb700 1 -- 172.21.15.63:0/3062558654 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e08010280 con 0x7f0e10066400 2020-05-18T21:29:42.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e0dffb700 1 -- 172.21.15.63:0/3062558654 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e080103e0 con 0x7f0e10066400 2020-05-18T21:29:42.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e0dffb700 1 -- 172.21.15.63:0/3062558654 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e080107c0 con 0x7f0e10066400 2020-05-18T21:29:42.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e15ef5700 1 -- 172.21.15.63:0/3062558654 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e10065c20 con 0x7f0e10066400 2020-05-18T21:29:42.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.905+0000 7f0e15ef5700 1 -- 172.21.15.63:0/3062558654 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e10143130 con 0x7f0e10066400 2020-05-18T21:29:42.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.909+0000 7f0e14ef3700 1 --2- 172.21.15.63:0/3062558654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e10066400 0x7f0e10141520 secure :-1 s=THROTTLE_DONE pgs=542 cs=0 l=1 rx=0x7f0e10061bd0 tx=0x7f0e1006ac80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:42.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.909+0000 7f0e0dffb700 1 -- 172.21.15.63:0/3062558654 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0e08005870 con 0x7f0e10066400 2020-05-18T21:29:42.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.909+0000 7f0e14ef3700 1 --2- 172.21.15.63:0/3062558654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e10066400 0x7f0e10141520 secure :-1 s=THROTTLE_DONE pgs=542 cs=0 l=1 rx=0x7f0e10061bd0 tx=0x7f0e1006ac80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:42.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.909+0000 7f0e0dffb700 1 --2- 172.21.15.63:0/3062558654 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0df004f970 0x7f0df0051e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:42.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.909+0000 7f0e0dffb700 1 -- 172.21.15.63:0/3062558654 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0e080100c0 con 0x7f0e10066400 2020-05-18T21:29:42.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.909+0000 7f0e15ef5700 1 -- 172.21.15.63:0/3062558654 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e100569e0 con 0x7f0e10066400 2020-05-18T21:29:42.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.909+0000 7f0e0ffff700 1 --2- 172.21.15.63:0/3062558654 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0df004f970 0x7f0df0051e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:42.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.909+0000 7f0e0ffff700 1 --2- 172.21.15.63:0/3062558654 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0df004f970 0x7f0df0051e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0e10065190 tx=0x7f0e0400c860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:42.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.913+0000 7f0e0ffff700 1 --2- 172.21.15.63:0/3062558654 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0df004f970 0x7f0df0051e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0e10065190 tx=0x7f0e0400c860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:42.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.913+0000 7f0e0ffff700 1 --2- 172.21.15.63:0/3062558654 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0df004f970 0x7f0df0051e30 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7f0e10065190 tx=0x7f0e0400c860).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:42.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.917+0000 7f0e14ef3700 1 --2- 172.21.15.63:0/3062558654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e10066400 0x7f0e10141520 secure :-1 s=THROTTLE_DONE pgs=542 cs=0 l=1 rx=0x7f0e10061bd0 tx=0x7f0e1006ac80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:42.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:42.917+0000 7f0e0dffb700 1 -- 172.21.15.63:0/3062558654 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f0e0803e240 con 0x7f0e10066400 2020-05-18T21:29:43.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:43.105+0000 7f0e15ef5700 1 -- 172.21.15.63:0/3062558654 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e1005e910 con 0x7f0e10066400 2020-05-18T21:29:43.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:43.105+0000 7f0e14ef3700 1 --2- 172.21.15.63:0/3062558654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e10066400 0x7f0e10141520 secure :-1 s=THROTTLE_DONE pgs=542 cs=0 l=1 rx=0x7f0e10061bd0 tx=0x7f0e1006ac80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:43.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:43.105+0000 7f0e0dffb700 1 -- 172.21.15.63:0/3062558654 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f0e08041860 con 0x7f0e10066400 2020-05-18T21:29:43.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:43.105+0000 7f0e15ef5700 1 -- 172.21.15.63:0/3062558654 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0df004f970 msgr2=0x7f0df0051e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:43.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:43.105+0000 7f0e15ef5700 1 --2- 172.21.15.63:0/3062558654 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0df004f970 0x7f0df0051e30 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7f0e10065190 tx=0x7f0e0400c860).stop 2020-05-18T21:29:43.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:43.105+0000 7f0e15ef5700 1 -- 172.21.15.63:0/3062558654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e10066400 msgr2=0x7f0e10141520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:43.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:43.105+0000 7f0e15ef5700 1 --2- 172.21.15.63:0/3062558654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e10066400 0x7f0e10141520 secure :-1 s=READY pgs=542 cs=0 l=1 rx=0x7f0e10061bd0 tx=0x7f0e1006ac80).stop 2020-05-18T21:29:43.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:43.105+0000 7f0e15ef5700 1 -- 172.21.15.63:0/3062558654 shutdown_connections 2020-05-18T21:29:43.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:43.105+0000 7f0e15ef5700 1 --2- 172.21.15.63:0/3062558654 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0df004f970 0x7f0df0051e30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:43.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:43.105+0000 7f0e15ef5700 1 --2- 172.21.15.63:0/3062558654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e10066400 0x7f0e10141520 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:43.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:43.105+0000 7f0e15ef5700 1 -- 172.21.15.63:0/3062558654 >> 172.21.15.63:0/3062558654 conn(0x7f0e100b9620 msgr2=0x7f0e1005ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:43.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:43.105+0000 7f0e15ef5700 1 -- 172.21.15.63:0/3062558654 shutdown_connections 2020-05-18T21:29:43.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:43.105+0000 7f0e15ef5700 1 -- 172.21.15.63:0/3062558654 wait complete. 2020-05-18T21:29:43.120 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 34 2020-05-18T21:29:43.121 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:43.121 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/3895568247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3895568247},{"type":"v1","addr":"172.21.15.63:6833","nonce":3895568247}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:24.694515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6319":{"gid":6319,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/400120989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":400120989},{"type":"v1","addr":"172.21.15.155:6835","nonce":400120989}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:43.125 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2020-05-18T21:29:43.245 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:29:43.245 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2020-05-18T21:29:43.245 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 391, 2020-05-18T21:29:43.245 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 393, 2020-05-18T21:29:43.246 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 146711, 2020-05-18T21:29:43.246 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 9021730, 2020-05-18T21:29:43.246 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 7, 2020-05-18T21:29:43.246 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 1, 2020-05-18T21:29:43.246 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.073518362, 2020-05-18T21:29:43.247 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.045641213, 2020-05-18T21:29:43.247 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.008637019, 2020-05-18T21:29:43.247 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.015099661, 2020-05-18T21:29:43.247 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:43.247 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 392, 2020-05-18T21:29:43.248 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.034011650, 2020-05-18T21:29:43.248 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000086764 2020-05-18T21:29:43.248 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.248 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:43.248 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.249 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.249 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.249 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:43.249 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.249 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2020-05-18T21:29:43.250 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 157, 2020-05-18T21:29:43.250 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 162, 2020-05-18T21:29:43.251 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 39733, 2020-05-18T21:29:43.251 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 344389, 2020-05-18T21:29:43.251 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 6, 2020-05-18T21:29:43.251 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 3, 2020-05-18T21:29:43.252 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.017483902, 2020-05-18T21:29:43.252 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.005504432, 2020-05-18T21:29:43.252 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.007052219, 2020-05-18T21:29:43.253 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.003719151, 2020-05-18T21:29:43.253 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:43.253 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 162, 2020-05-18T21:29:43.253 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.012382213, 2020-05-18T21:29:43.253 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000076433 2020-05-18T21:29:43.254 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.254 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:43.254 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.254 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.254 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.254 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:43.255 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.255 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2020-05-18T21:29:43.255 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 7271, 2020-05-18T21:29:43.255 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 14394, 2020-05-18T21:29:43.255 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 2222523, 2020-05-18T21:29:43.256 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 11515672, 2020-05-18T21:29:43.256 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 4, 2020-05-18T21:29:43.256 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 2, 2020-05-18T21:29:43.256 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.940092828, 2020-05-18T21:29:43.256 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.417685535, 2020-05-18T21:29:43.257 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.603817702, 2020-05-18T21:29:43.257 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.006368372, 2020-05-18T21:29:43.257 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:43.257 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 14394, 2020-05-18T21:29:43.257 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.336791560, 2020-05-18T21:29:43.257 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000023398 2020-05-18T21:29:43.258 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.258 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:43.258 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 20664, 2020-05-18T21:29:43.258 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.005675887, 2020-05-18T21:29:43.258 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000274 2020-05-18T21:29:43.259 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:43.259 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.259 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2020-05-18T21:29:43.259 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2020-05-18T21:29:43.259 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2020-05-18T21:29:43.260 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.260 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2020-05-18T21:29:43.260 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:43.260 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:43.261 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 163, 2020-05-18T21:29:43.261 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 2.064633443, 2020-05-18T21:29:43.261 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.012666462 2020-05-18T21:29:43.261 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:43.261 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.261 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2020-05-18T21:29:43.262 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:43.262 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:43.262 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 427, 2020-05-18T21:29:43.262 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.092873141, 2020-05-18T21:29:43.262 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000217501 2020-05-18T21:29:43.263 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:43.263 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.263 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2020-05-18T21:29:43.263 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 4081, 2020-05-18T21:29:43.263 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 4078, 2020-05-18T21:29:43.263 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2020-05-18T21:29:43.264 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 4078, 2020-05-18T21:29:43.264 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 7.733489755, 2020-05-18T21:29:43.264 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001896392 2020-05-18T21:29:43.264 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.264 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 0, 2020-05-18T21:29:43.265 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch": 12, 2020-05-18T21:29:43.265 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 73, 2020-05-18T21:29:43.265 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 9, 2020-05-18T21:29:43.265 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 0, 2020-05-18T21:29:43.265 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 3211, 2020-05-18T21:29:43.266 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 0, 2020-05-18T21:29:43.266 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 3211, 2020-05-18T21:29:43.266 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 0, 2020-05-18T21:29:43.266 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 3211, 2020-05-18T21:29:43.266 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 0, 2020-05-18T21:29:43.266 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 2945, 2020-05-18T21:29:43.267 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 2945, 2020-05-18T21:29:43.267 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 2, 2020-05-18T21:29:43.267 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 4091, 2020-05-18T21:29:43.267 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 4080, 2020-05-18T21:29:43.267 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 0, 2020-05-18T21:29:43.268 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 0, 2020-05-18T21:29:43.268 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2020-05-18T21:29:43.268 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2020-05-18T21:29:43.268 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 0, 2020-05-18T21:29:43.268 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 297800, 2020-05-18T21:29:43.268 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2020-05-18T21:29:43.269 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 0, 2020-05-18T21:29:43.269 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 0, 2020-05-18T21:29:43.269 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 0, 2020-05-18T21:29:43.269 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 0, 2020-05-18T21:29:43.269 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2020-05-18T21:29:43.270 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 0, 2020-05-18T21:29:43.270 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2020-05-18T21:29:43.270 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 2155, 2020-05-18T21:29:43.271 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 6703104, 2020-05-18T21:29:43.271 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 0 2020-05-18T21:29:43.271 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.271 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:29:43.271 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 361, 2020-05-18T21:29:43.272 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 0, 2020-05-18T21:29:43.272 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:29:43.272 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 809, 2020-05-18T21:29:43.272 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 448, 2020-05-18T21:29:43.272 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2020-05-18T21:29:43.273 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2020-05-18T21:29:43.273 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2020-05-18T21:29:43.273 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:29:43.273 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:29:43.273 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2020-05-18T21:29:43.274 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2020-05-18T21:29:43.274 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:29:43.274 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 0, 2020-05-18T21:29:43.274 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2020-05-18T21:29:43.274 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 9, 2020-05-18T21:29:43.274 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2020-05-18T21:29:43.275 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2020-05-18T21:29:43.275 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.275 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2020-05-18T21:29:43.275 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 7387, 2020-05-18T21:29:43.275 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 0, 2020-05-18T21:29:43.276 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 0, 2020-05-18T21:29:43.276 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 7389, 2020-05-18T21:29:43.276 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 0, 2020-05-18T21:29:43.276 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 0, 2020-05-18T21:29:43.276 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 9, 2020-05-18T21:29:43.276 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 0, 2020-05-18T21:29:43.277 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 0, 2020-05-18T21:29:43.277 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 10, 2020-05-18T21:29:43.277 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 0, 2020-05-18T21:29:43.277 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 0, 2020-05-18T21:29:43.277 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 4194304, 2020-05-18T21:29:43.278 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 18664091, 2020-05-18T21:29:43.278 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 4195196, 2020-05-18T21:29:43.278 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2020-05-18T21:29:43.278 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 29, 2020-05-18T21:29:43.278 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.194196633, 2020-05-18T21:29:43.279 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.006696435 2020-05-18T21:29:43.279 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.279 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 2 2020-05-18T21:29:43.279 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.279 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2020-05-18T21:29:43.279 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 3214, 2020-05-18T21:29:43.280 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 3214, 2020-05-18T21:29:43.280 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 0, 2020-05-18T21:29:43.280 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 76, 2020-05-18T21:29:43.280 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 85, 2020-05-18T21:29:43.280 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 9, 2020-05-18T21:29:43.281 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 4019, 2020-05-18T21:29:43.281 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 4019, 2020-05-18T21:29:43.281 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 0, 2020-05-18T21:29:43.281 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 2754, 2020-05-18T21:29:43.281 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 3202, 2020-05-18T21:29:43.281 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 448, 2020-05-18T21:29:43.282 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 79656, 2020-05-18T21:29:43.282 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 331932 2020-05-18T21:29:43.282 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.282 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2020-05-18T21:29:43.282 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 4158, 2020-05-18T21:29:43.283 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 0, 2020-05-18T21:29:43.283 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 4081, 2020-05-18T21:29:43.283 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 2, 2020-05-18T21:29:43.283 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_slave_request": 0, 2020-05-18T21:29:43.283 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2020-05-18T21:29:43.283 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3200, 2020-05-18T21:29:43.284 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 5.456048806, 2020-05-18T21:29:43.284 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001705015 2020-05-18T21:29:43.284 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.284 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2020-05-18T21:29:43.284 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2, 2020-05-18T21:29:43.285 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.078760379, 2020-05-18T21:29:43.285 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.039380189 2020-05-18T21:29:43.285 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.285 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2020-05-18T21:29:43.285 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.285 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.286 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.286 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.286 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2020-05-18T21:29:43.286 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.286 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.287 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.287 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.287 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2020-05-18T21:29:43.287 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.287 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.288 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.288 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.288 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2020-05-18T21:29:43.288 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.289 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.289 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.289 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.289 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2020-05-18T21:29:43.289 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.289 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.290 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.290 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.290 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2020-05-18T21:29:43.290 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.290 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.291 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.291 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.291 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2020-05-18T21:29:43.291 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.292 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.292 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.292 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.292 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2020-05-18T21:29:43.292 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.293 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.293 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.293 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.293 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2020-05-18T21:29:43.293 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.294 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.294 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.294 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.294 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2020-05-18T21:29:43.294 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1, 2020-05-18T21:29:43.294 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.006614312, 2020-05-18T21:29:43.295 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.006614312 2020-05-18T21:29:43.295 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.295 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2020-05-18T21:29:43.295 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.295 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.296 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.296 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.296 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2020-05-18T21:29:43.296 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.297 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.297 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.297 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.297 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2020-05-18T21:29:43.297 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.298 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.298 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.298 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.298 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2020-05-18T21:29:43.298 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 67, 2020-05-18T21:29:43.298 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.349282571, 2020-05-18T21:29:43.299 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.005213172 2020-05-18T21:29:43.299 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.299 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2020-05-18T21:29:43.299 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.299 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.300 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.300 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.300 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2020-05-18T21:29:43.300 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.300 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.301 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.301 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.301 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2020-05-18T21:29:43.301 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.301 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.302 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.302 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.302 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2020-05-18T21:29:43.302 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.303 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.303 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.303 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.304 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2020-05-18T21:29:43.304 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.304 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.304 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.305 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.305 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2020-05-18T21:29:43.305 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.305 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.305 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.306 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.306 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2020-05-18T21:29:43.306 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.306 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.307 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.307 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.307 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2020-05-18T21:29:43.307 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.307 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.308 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.308 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.308 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2020-05-18T21:29:43.308 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.308 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.308 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.309 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.309 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2020-05-18T21:29:43.309 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.309 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.309 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.310 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.310 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2020-05-18T21:29:43.310 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.310 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.310 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.310 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.311 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2020-05-18T21:29:43.311 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 808, 2020-05-18T21:29:43.311 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 1.842783687, 2020-05-18T21:29:43.311 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.002280672 2020-05-18T21:29:43.311 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.312 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0 2020-05-18T21:29:43.312 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.312 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2020-05-18T21:29:43.312 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 1, 2020-05-18T21:29:43.312 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 1, 2020-05-18T21:29:43.313 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 0, 2020-05-18T21:29:43.313 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 1, 2020-05-18T21:29:43.313 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2020-05-18T21:29:43.313 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 3695, 2020-05-18T21:29:43.313 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 3695, 2020-05-18T21:29:43.320 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 548 2020-05-18T21:29:43.320 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.320 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2020-05-18T21:29:43.321 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2020-05-18T21:29:43.321 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2020-05-18T21:29:43.322 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2020-05-18T21:29:43.322 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2020-05-18T21:29:43.322 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2020-05-18T21:29:43.322 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2020-05-18T21:29:43.323 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2020-05-18T21:29:43.323 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2020-05-18T21:29:43.323 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2020-05-18T21:29:43.324 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2020-05-18T21:29:43.324 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2020-05-18T21:29:43.324 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2020-05-18T21:29:43.324 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2020-05-18T21:29:43.325 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2020-05-18T21:29:43.325 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2020-05-18T21:29:43.325 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2020-05-18T21:29:43.326 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2020-05-18T21:29:43.326 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2020-05-18T21:29:43.326 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2020-05-18T21:29:43.327 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2020-05-18T21:29:43.327 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 171452, 2020-05-18T21:29:43.327 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 320, 2020-05-18T21:29:43.327 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2020-05-18T21:29:43.328 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2020-05-18T21:29:43.328 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2020-05-18T21:29:43.328 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2020-05-18T21:29:43.328 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2020-05-18T21:29:43.329 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2020-05-18T21:29:43.329 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2020-05-18T21:29:43.329 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2020-05-18T21:29:43.329 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 6128, 2020-05-18T21:29:43.330 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 93, 2020-05-18T21:29:43.330 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2020-05-18T21:29:43.330 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2020-05-18T21:29:43.331 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2020-05-18T21:29:43.331 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2020-05-18T21:29:43.331 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 10136248, 2020-05-18T21:29:43.332 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 57962, 2020-05-18T21:29:43.332 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2020-05-18T21:29:43.332 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2020-05-18T21:29:43.332 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2020-05-18T21:29:43.333 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2020-05-18T21:29:43.333 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.333 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2020-05-18T21:29:43.333 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 0, 2020-05-18T21:29:43.335 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2020-05-18T21:29:43.336 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 614, 2020-05-18T21:29:43.336 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 13570679, 2020-05-18T21:29:43.336 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 0, 2020-05-18T21:29:43.336 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 614, 2020-05-18T21:29:43.337 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 614, 2020-05-18T21:29:43.337 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 29, 2020-05-18T21:29:43.337 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 585, 2020-05-18T21:29:43.337 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2020-05-18T21:29:43.337 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2020-05-18T21:29:43.338 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 2, 2020-05-18T21:29:43.338 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 0, 2020-05-18T21:29:43.338 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 11, 2020-05-18T21:29:43.338 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 32, 2020-05-18T21:29:43.338 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 4, 2020-05-18T21:29:43.339 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2020-05-18T21:29:43.339 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2020-05-18T21:29:43.339 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 1, 2020-05-18T21:29:43.339 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 1, 2020-05-18T21:29:43.339 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 470, 2020-05-18T21:29:43.339 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2020-05-18T21:29:43.340 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2020-05-18T21:29:43.340 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2020-05-18T21:29:43.340 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 14, 2020-05-18T21:29:43.340 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 0, 2020-05-18T21:29:43.340 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2020-05-18T21:29:43.341 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2020-05-18T21:29:43.341 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2020-05-18T21:29:43.341 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2020-05-18T21:29:43.342 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2020-05-18T21:29:43.342 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2020-05-18T21:29:43.342 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2020-05-18T21:29:43.342 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2020-05-18T21:29:43.342 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2020-05-18T21:29:43.343 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 0, 2020-05-18T21:29:43.343 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2020-05-18T21:29:43.343 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2020-05-18T21:29:43.343 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2020-05-18T21:29:43.343 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2020-05-18T21:29:43.343 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2020-05-18T21:29:43.344 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2020-05-18T21:29:43.344 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2020-05-18T21:29:43.344 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2020-05-18T21:29:43.344 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2020-05-18T21:29:43.344 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2020-05-18T21:29:43.345 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2020-05-18T21:29:43.345 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2020-05-18T21:29:43.345 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2020-05-18T21:29:43.345 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2020-05-18T21:29:43.345 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2020-05-18T21:29:43.345 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2020-05-18T21:29:43.348 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 0, 2020-05-18T21:29:43.348 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2020-05-18T21:29:43.348 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 0, 2020-05-18T21:29:43.348 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 7, 2020-05-18T21:29:43.349 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 7, 2020-05-18T21:29:43.349 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2020-05-18T21:29:43.349 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2020-05-18T21:29:43.349 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 152, 2020-05-18T21:29:43.349 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 28, 2020-05-18T21:29:43.349 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 3 2020-05-18T21:29:43.350 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.350 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2020-05-18T21:29:43.350 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 0, 2020-05-18T21:29:43.350 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2020-05-18T21:29:43.350 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2020-05-18T21:29:43.351 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2020-05-18T21:29:43.351 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.351 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2020-05-18T21:29:43.351 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 0, 2020-05-18T21:29:43.352 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 12, 2020-05-18T21:29:43.352 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 0, 2020-05-18T21:29:43.352 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 6, 2020-05-18T21:29:43.352 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 448, 2020-05-18T21:29:43.352 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 0 2020-05-18T21:29:43.353 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.353 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-05-18T21:29:43.353 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 241, 2020-05-18T21:29:43.353 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:43.354 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:43.354 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 7812, 2020-05-18T21:29:43.354 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 1828752, 2020-05-18T21:29:43.354 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:43.354 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 7812, 2020-05-18T21:29:43.354 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:43.355 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:43.355 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 7811, 2020-05-18T21:29:43.355 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 1828511, 2020-05-18T21:29:43.355 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:43.355 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.356 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.356 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.356 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:43.356 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.357 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2020-05-18T21:29:43.357 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:43.357 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:43.357 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:43.357 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:43.357 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:43.358 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:43.358 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:43.358 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 614, 2020-05-18T21:29:43.358 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 13617033, 2020-05-18T21:29:43.358 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 131, 2020-05-18T21:29:43.359 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 13617033, 2020-05-18T21:29:43.359 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:43.359 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.359 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.359 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.359 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:43.360 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.360 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2020-05-18T21:29:43.360 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:43.360 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2020-05-18T21:29:43.360 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:43.360 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:43.361 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:43.361 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:43.361 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:43.361 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 614, 2020-05-18T21:29:43.362 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 614, 2020-05-18T21:29:43.362 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 614, 2020-05-18T21:29:43.362 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 614, 2020-05-18T21:29:43.362 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:43.362 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.363 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.363 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.363 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:43.363 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.363 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2020-05-18T21:29:43.363 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:43.364 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:43.364 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:43.364 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 448, 2020-05-18T21:29:43.364 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 45248, 2020-05-18T21:29:43.364 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:43.365 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 448, 2020-05-18T21:29:43.365 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:43.365 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:43.365 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 3, 2020-05-18T21:29:43.365 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 45248, 2020-05-18T21:29:43.365 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:43.366 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.366 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.366 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.366 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:43.366 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:43.367 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x558953fdfd60": { 2020-05-18T21:29:43.367 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 1886875, 2020-05-18T21:29:43.367 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:43.367 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:43.367 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 7387, 2020-05-18T21:29:43.367 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 14468457, 2020-05-18T21:29:43.368 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:43.368 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 7387, 2020-05-18T21:29:43.368 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:43.368 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:43.368 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 29, 2020-05-18T21:29:43.369 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 12581582, 2020-05-18T21:29:43.369 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:43.369 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:43.369 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:43.369 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:43.369 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:43.370 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:43.370 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:29:43.371 INFO:tasks.cephfs.filesystem:_json_asok output: { "AsyncMessenger::Worker-0": { "msgr_recv_messages": 391, "msgr_send_messages": 393, "msgr_recv_bytes": 146711, "msgr_send_bytes": 9021730, "msgr_created_connections": 7, "msgr_active_connections": 1, "msgr_running_total_time": 0.073518362, "msgr_running_send_time": 0.045641213, "msgr_running_recv_time": 0.008637019, "msgr_running_fast_dispatch_time": 0.015099661, "msgr_send_messages_queue_lat": { "avgcount": 392, "sum": 0.034011650, "avgtime": 0.000086764 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-1": { "msgr_recv_messages": 157, "msgr_send_messages": 162, "msgr_recv_bytes": 39733, "msgr_send_bytes": 344389, "msgr_created_connections": 6, "msgr_active_connections": 3, "msgr_running_total_time": 0.017483902, "msgr_running_send_time": 0.005504432, "msgr_running_recv_time": 0.007052219, "msgr_running_fast_dispatch_time": 0.003719151, "msgr_send_messages_queue_lat": { "avgcount": 162, "sum": 0.012382213, "avgtime": 0.000076433 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-2": { "msgr_recv_messages": 7271, "msgr_send_messages": 14394, "msgr_recv_bytes": 2222523, "msgr_send_bytes": 11515672, "msgr_created_connections": 4, "msgr_active_connections": 2, "msgr_running_total_time": 0.940092828, "msgr_running_send_time": 0.417685535, "msgr_running_recv_time": 0.603817702, "msgr_running_fast_dispatch_time": 0.006368372, "msgr_send_messages_queue_lat": { "avgcount": 14394, "sum": 0.336791560, "avgtime": 0.000023398 }, "msgr_handle_ack_lat": { "avgcount": 20664, "sum": 0.005675887, "avgtime": 0.000000274 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "queue_len": 0, "complete_latency": { "avgcount": 163, "sum": 2.064633443, "avgtime": 0.012666462 } }, "finisher-PurgeQueue": { "queue_len": 0, "complete_latency": { "avgcount": 427, "sum": 0.092873141, "avgtime": 0.000217501 } }, "mds": { "request": 4081, "reply": 4078, "reply_latency": { "avgcount": 4078, "sum": 7.733489755, "avgtime": 0.001896392 }, "forward": 0, "dir_fetch": 12, "dir_commit": 73, "dir_split": 9, "dir_merge": 0, "inodes": 3211, "inodes_top": 0, "inodes_bottom": 3211, "inodes_pin_tail": 0, "inodes_pinned": 3211, "inodes_expired": 0, "inodes_with_caps": 2945, "caps": 2945, "subtrees": 2, "traverse": 4091, "traverse_hit": 4080, "traverse_forward": 0, "traverse_discover": 0, "traverse_dir_fetch": 0, "traverse_remote_ino": 0, "traverse_lock": 0, "load_cent": 297800, "q": 0, "exported": 0, "exported_inodes": 0, "imported": 0, "imported_inodes": 0, "openino_dir_fetch": 0, "openino_backtrace_fetch": 0, "openino_peer_discover": 0, "root_rfiles": 2155, "root_rbytes": 6703104, "root_rsnaps": 0 }, "mds_cache": { "num_strays": 361, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "strays_created": 809, "strays_enqueued": 448, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 9, "ireq_fragstats": 0, "ireq_inodestats": 0 }, "mds_log": { "evadd": 7387, "evex": 0, "evtrm": 0, "ev": 7389, "evexg": 0, "evexd": 0, "segadd": 9, "segex": 0, "segtrm": 0, "seg": 10, "segexg": 0, "segexd": 0, "expos": 4194304, "wrpos": 18664091, "rdpos": 4195196, "jlat": { "avgcount": 29, "sum": 0.194196633, "avgtime": 0.006696435 }, "replayed": 2 }, "mds_mem": { "ino": 3214, "ino+": 3214, "ino-": 0, "dir": 76, "dir+": 85, "dir-": 9, "dn": 4019, "dn+": 4019, "dn-": 0, "cap": 2754, "cap+": 3202, "cap-": 448, "rss": 79656, "heap": 331932 }, "mds_server": { "dispatch_client_request": 4158, "dispatch_server_request": 0, "handle_client_request": 4081, "handle_client_session": 2, "handle_slave_request": 0, "req_create_latency": { "avgcount": 3200, "sum": 5.456048806, "avgtime": 0.001705015 }, "req_getattr_latency": { "avgcount": 2, "sum": 0.078760379, "avgtime": 0.039380189 }, "req_getfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_link_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookup_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookuphash_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupino_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupname_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupparent_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lssnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mkdir_latency": { "avgcount": 1, "sum": 0.006614312, "avgtime": 0.006614312 }, "req_mknod_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mksnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_open_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_readdir_latency": { "avgcount": 67, "sum": 0.349282571, "avgtime": 0.005213172 }, "req_rename_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_renamesnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmdir_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setdirlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_symlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_unlink_latency": { "avgcount": 808, "sum": 1.842783687, "avgtime": 0.002280672 }, "cap_revoke_eviction": 0 }, "mds_sessions": { "session_count": 1, "session_add": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 3695, "average_load": 3695, "avg_session_uptime": 548 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "buffer_anon_bytes": 171452, "buffer_anon_items": 320, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6128, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 10136248, "mds_co_items": 57962, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "op_active": 0, "op_laggy": 0, "op_send": 614, "op_send_bytes": 13570679, "op_resend": 0, "op_reply": 614, "op": 614, "op_r": 29, "op_w": 585, "op_rmw": 0, "op_pg": 0, "osdop_stat": 2, "osdop_create": 0, "osdop_read": 11, "osdop_write": 32, "osdop_writefull": 4, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 1, "osdop_truncate": 1, "osdop_delete": 470, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 14, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 7, "osd_session_open": 7, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 152, "omap_rd": 28, "omap_del": 3 }, "oft": { "omap_total_objs": 0, "omap_total_kv_pairs": 0, "omap_total_updates": 0, "omap_total_removes": 0 }, "purge_queue": { "pq_executing_ops": 0, "pq_executing_ops_high_water": 12, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executed": 448, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "val": 241, "max": 104857600, "get_started": 0, "get": 7812, "get_sum": 1828752, "get_or_fail_fail": 0, "get_or_fail_success": 7812, "take": 0, "take_sum": 0, "put": 7811, "put_sum": 1828511, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_bytes": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 614, "take_sum": 13617033, "put": 131, "put_sum": 13617033, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_ops": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 614, "take_sum": 614, "put": 614, "put_sum": 614, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle": { "val": 0, "max": 3758096384, "get_started": 0, "get": 448, "get_sum": 45248, "get_or_fail_fail": 0, "get_or_fail_success": 448, "take": 0, "take_sum": 0, "put": 3, "put_sum": 45248, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle-0x558953fdfd60": { "val": 1886875, "max": 3758096384, "get_started": 0, "get": 7387, "get_sum": 14468457, "get_or_fail_fail": 0, "get_or_fail_success": 7387, "take": 0, "take_sum": 0, "put": 29, "put_sum": 12581582, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } 2020-05-18T21:29:43.373 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/361, 448/809 2020-05-18T21:29:44.374 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:44.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.481+0000 7f8d008f7700 1 Processor -- start 2020-05-18T21:29:44.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.481+0000 7f8d008f7700 1 -- start start 2020-05-18T21:29:44.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8d008f7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8cfc0b8d00 0x7f8cfc0ae490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:44.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8d008f7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cfc062450 0x7f8cfc149be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:44.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8d008f7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cfc14a4d0 con 0x7f8cfc14a040 2020-05-18T21:29:44.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8d008f7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cfc0b4b40 con 0x7f8cfc0b8d00 2020-05-18T21:29:44.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8d008f7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc14b120 con 0x7f8cfc062450 2020-05-18T21:29:44.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8cfa59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8cfc0b8d00 0x7f8cfc0ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:44.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8cfa59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8cfc0b8d00 0x7f8cfc0ae490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56630/0 (socket says 172.21.15.63:56630) 2020-05-18T21:29:44.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8cfa59c700 1 -- 172.21.15.63:0/3593098769 learned_addr learned my addr 172.21.15.63:0/3593098769 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:44.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8cf9d9b700 1 --2- 172.21.15.63:0/3593098769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cfc062450 0x7f8cfc149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:44.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8cf959a700 1 -- 172.21.15.63:0/3593098769 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267731770 0 0) 0x7f8cf4001110 con 0x7f8cfc14a040 2020-05-18T21:29:44.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8cf959a700 1 -- 172.21.15.63:0/3593098769 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cdc003270 con 0x7f8cfc14a040 2020-05-18T21:29:44.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8cfa59c700 1 -- 172.21.15.63:0/3593098769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cfc062450 msgr2=0x7f8cfc149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:44.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8cfa59c700 1 --2- 172.21.15.63:0/3593098769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cfc062450 0x7f8cfc149be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:44.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8cfa59c700 1 -- 172.21.15.63:0/3593098769 >> v1:172.21.15.155:6789/0 conn(0x7f8cfc14a040 legacy=0x7f8cfc0b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:44.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8cfa59c700 1 -- 172.21.15.63:0/3593098769 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc14b3c0 con 0x7f8cfc0b8d00 2020-05-18T21:29:44.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8cfa59c700 1 --2- 172.21.15.63:0/3593098769 >> v2:172.21.15.63:3300/0 conn(0x7f8cfc0b8d00 0x7f8cfc0ae490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8cec0032f0 tx=0x7f8cec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:44.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8cfa59c700 1 --2- 172.21.15.63:0/3593098769 >> v2:172.21.15.63:3300/0 conn(0x7f8cfc0b8d00 0x7f8cfc0ae490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8cec0032f0 tx=0x7f8cec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:44.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8cfa59c700 1 --2- 172.21.15.63:0/3593098769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cfc0b8d00 0x7f8cfc0ae490 secure :-1 s=READY pgs=764 cs=0 l=1 rx=0x7f8cec0032f0 tx=0x7f8cec007e00).ready entity=mon.0 client_cookie=281786c1a0c2a4db server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:44.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8cfa59c700 1 --2- 172.21.15.63:0/3593098769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cfc0b8d00 0x7f8cfc0ae490 secure :-1 s=THROTTLE_DONE pgs=764 cs=0 l=1 rx=0x7f8cec0032f0 tx=0x7f8cec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:44.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8cf959a700 1 -- 172.21.15.63:0/3593098769 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cec011c60 con 0x7f8cfc0b8d00 2020-05-18T21:29:44.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8cfa59c700 1 --2- 172.21.15.63:0/3593098769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cfc0b8d00 0x7f8cfc0ae490 secure :-1 s=THROTTLE_DONE pgs=764 cs=0 l=1 rx=0x7f8cec0032f0 tx=0x7f8cec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:44.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8cf959a700 1 -- 172.21.15.63:0/3593098769 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec011dc0 con 0x7f8cfc0b8d00 2020-05-18T21:29:44.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8cfa59c700 1 --2- 172.21.15.63:0/3593098769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cfc0b8d00 0x7f8cfc0ae490 secure :-1 s=THROTTLE_DONE pgs=764 cs=0 l=1 rx=0x7f8cec0032f0 tx=0x7f8cec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:44.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8cf959a700 1 -- 172.21.15.63:0/3593098769 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cec00a370 con 0x7f8cfc0b8d00 2020-05-18T21:29:44.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8d008f7700 1 -- 172.21.15.63:0/3593098769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cfc0b8d00 msgr2=0x7f8cfc0ae490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:44.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8d008f7700 1 --2- 172.21.15.63:0/3593098769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cfc0b8d00 0x7f8cfc0ae490 secure :-1 s=READY pgs=764 cs=0 l=1 rx=0x7f8cec0032f0 tx=0x7f8cec007e00).stop 2020-05-18T21:29:44.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8d008f7700 1 -- 172.21.15.63:0/3593098769 shutdown_connections 2020-05-18T21:29:44.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8d008f7700 1 --2- 172.21.15.63:0/3593098769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cfc062450 0x7f8cfc149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:44.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8d008f7700 1 --2- 172.21.15.63:0/3593098769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cfc0b8d00 0x7f8cfc0ae490 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:44.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8d008f7700 1 -- 172.21.15.63:0/3593098769 >> 172.21.15.63:0/3593098769 conn(0x7f8cfc05a7c0 msgr2=0x7f8cfc05aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:44.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8d008f7700 1 -- 172.21.15.63:0/3593098769 shutdown_connections 2020-05-18T21:29:44.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.485+0000 7f8d008f7700 1 -- 172.21.15.63:0/3593098769 wait complete. 2020-05-18T21:29:44.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.489+0000 7f8d008f7700 1 Processor -- start 2020-05-18T21:29:44.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.489+0000 7f8d008f7700 1 -- start start 2020-05-18T21:29:44.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.489+0000 7f8d008f7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8cfc062450 0x7f8cfc0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:44.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.489+0000 7f8d008f7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cfc0b8d00 0x7f8cfc062930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:44.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.489+0000 7f8d008f7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8cfc14a040 0x7f8cfc0afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:44.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.489+0000 7f8d008f7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cfc062d90 con 0x7f8cfc062450 2020-05-18T21:29:44.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.489+0000 7f8d008f7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cfc065700 con 0x7f8cfc14a040 2020-05-18T21:29:44.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.489+0000 7f8d008f7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc0b02b0 con 0x7f8cfc0b8d00 2020-05-18T21:29:44.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.489+0000 7f8cfa59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8cfc062450 0x7f8cfc0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:44.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.489+0000 7f8cfa59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8cfc062450 0x7f8cfc0b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56636/0 (socket says 172.21.15.63:56636) 2020-05-18T21:29:44.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.489+0000 7f8cfa59c700 1 -- 172.21.15.63:0/104703501 learned_addr learned my addr 172.21.15.63:0/104703501 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:44.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.489+0000 7f8cfad9d700 1 --2- 172.21.15.63:0/104703501 >> v2:172.21.15.155:3300/0 conn(0x7f8cfc14a040 0x7f8cfc0afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:44.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.489+0000 7f8cf9d9b700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cfc0b8d00 0x7f8cfc062930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:44.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8cfa59c700 1 -- 172.21.15.63:0/104703501 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cfc0b8d00 msgr2=0x7f8cfc062930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:44.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8cfa59c700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cfc0b8d00 0x7f8cfc062930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:44.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8cfa59c700 1 -- 172.21.15.63:0/104703501 >> v2:172.21.15.155:3300/0 conn(0x7f8cfc14a040 msgr2=0x7f8cfc0afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:44.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8cfa59c700 1 --2- 172.21.15.63:0/104703501 >> v2:172.21.15.155:3300/0 conn(0x7f8cfc14a040 0x7f8cfc0afe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:44.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8cfa59c700 1 -- 172.21.15.63:0/104703501 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc062f90 con 0x7f8cfc062450 2020-05-18T21:29:44.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8cfad9d700 1 --2- 172.21.15.63:0/104703501 >> v2:172.21.15.155:3300/0 conn(0x7f8cfc14a040 0x7f8cfc0afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:29:44.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8cfa59c700 1 --2- 172.21.15.63:0/104703501 >> v2:172.21.15.63:3300/0 conn(0x7f8cfc062450 0x7f8cfc0b2620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8cec0032f0 tx=0x7f8cec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:44.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8cfa59c700 1 --2- 172.21.15.63:0/104703501 >> v2:172.21.15.63:3300/0 conn(0x7f8cfc062450 0x7f8cfc0b2620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8cec0032f0 tx=0x7f8cec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:44.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8cfa59c700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cfc062450 0x7f8cfc0b2620 secure :-1 s=READY pgs=765 cs=0 l=1 rx=0x7f8cec0032f0 tx=0x7f8cec007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:44.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8cfa59c700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cfc062450 0x7f8cfc0b2620 secure :-1 s=THROTTLE_DONE pgs=765 cs=0 l=1 rx=0x7f8cec0032f0 tx=0x7f8cec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:44.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8cfa59c700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cfc062450 0x7f8cfc0b2620 secure :-1 s=THROTTLE_DONE pgs=765 cs=0 l=1 rx=0x7f8cec0032f0 tx=0x7f8cec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:44.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8cf37fe700 1 -- 172.21.15.63:0/104703501 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cec005a80 con 0x7f8cfc062450 2020-05-18T21:29:44.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8cfa59c700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cfc062450 0x7f8cfc0b2620 secure :-1 s=THROTTLE_DONE pgs=765 cs=0 l=1 rx=0x7f8cec0032f0 tx=0x7f8cec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:44.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8cf37fe700 1 -- 172.21.15.63:0/104703501 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec005be0 con 0x7f8cfc062450 2020-05-18T21:29:44.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8d008f7700 1 -- 172.21.15.63:0/104703501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cfc063230 con 0x7f8cfc062450 2020-05-18T21:29:44.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8cf37fe700 1 -- 172.21.15.63:0/104703501 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cec007170 con 0x7f8cfc062450 2020-05-18T21:29:44.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8d008f7700 1 -- 172.21.15.63:0/104703501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cfc097ed0 con 0x7f8cfc062450 2020-05-18T21:29:44.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8cfa59c700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cfc062450 0x7f8cfc0b2620 secure :-1 s=THROTTLE_DONE pgs=765 cs=0 l=1 rx=0x7f8cec0032f0 tx=0x7f8cec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:44.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8d008f7700 1 -- 172.21.15.63:0/104703501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cfc0569e0 con 0x7f8cfc062450 2020-05-18T21:29:44.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8cf37fe700 1 -- 172.21.15.63:0/104703501 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8cec0073e0 con 0x7f8cfc062450 2020-05-18T21:29:44.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.493+0000 7f8cfa59c700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cfc062450 0x7f8cfc0b2620 secure :-1 s=THROTTLE_DONE pgs=765 cs=0 l=1 rx=0x7f8cec0032f0 tx=0x7f8cec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:44.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.497+0000 7f8cf37fe700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8ce004fa50 0x7f8ce0051f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:44.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.497+0000 7f8cf37fe700 1 -- 172.21.15.63:0/104703501 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8cec064880 con 0x7f8cfc062450 2020-05-18T21:29:44.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.497+0000 7f8cf9d9b700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8ce004fa50 0x7f8ce0051f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:44.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.497+0000 7f8cf9d9b700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8ce004fa50 0x7f8ce0051f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ce4002f70 tx=0x7f8ce4002f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:44.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.497+0000 7f8cf9d9b700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8ce004fa50 0x7f8ce0051f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ce4002f70 tx=0x7f8ce4002f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:44.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.497+0000 7f8cf9d9b700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8ce004fa50 0x7f8ce0051f10 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7f8ce4002f70 tx=0x7f8ce4002f10).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:44.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.505+0000 7f8cfa59c700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cfc062450 0x7f8cfc0b2620 secure :-1 s=THROTTLE_DONE pgs=765 cs=0 l=1 rx=0x7f8cec0032f0 tx=0x7f8cec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:44.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.505+0000 7f8cf37fe700 1 -- 172.21.15.63:0/104703501 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f8cec03ec70 con 0x7f8cfc062450 2020-05-18T21:29:44.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.665+0000 7f8d008f7700 1 -- 172.21.15.63:0/104703501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8cfc0ae3c0 con 0x7f8cfc062450 2020-05-18T21:29:44.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.665+0000 7f8cfa59c700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cfc062450 0x7f8cfc0b2620 secure :-1 s=THROTTLE_DONE pgs=765 cs=0 l=1 rx=0x7f8cec0032f0 tx=0x7f8cec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:44.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.665+0000 7f8cf37fe700 1 -- 172.21.15.63:0/104703501 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f8cec007c60 con 0x7f8cfc062450 2020-05-18T21:29:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:44.672 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/3895568247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3895568247},{"type":"v1","addr":"172.21.15.63:6833","nonce":3895568247}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:24.694515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6319":{"gid":6319,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/400120989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":400120989},{"type":"v1","addr":"172.21.15.155:6835","nonce":400120989}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:44.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.669+0000 7f8d008f7700 1 -- 172.21.15.63:0/104703501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8ce004fa50 msgr2=0x7f8ce0051f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:44.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.669+0000 7f8d008f7700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8ce004fa50 0x7f8ce0051f10 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7f8ce4002f70 tx=0x7f8ce4002f10).stop 2020-05-18T21:29:44.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.669+0000 7f8d008f7700 1 -- 172.21.15.63:0/104703501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cfc062450 msgr2=0x7f8cfc0b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:44.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.669+0000 7f8d008f7700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cfc062450 0x7f8cfc0b2620 secure :-1 s=READY pgs=765 cs=0 l=1 rx=0x7f8cec0032f0 tx=0x7f8cec007e00).stop 2020-05-18T21:29:44.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.669+0000 7f8d008f7700 1 -- 172.21.15.63:0/104703501 shutdown_connections 2020-05-18T21:29:44.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.669+0000 7f8d008f7700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8ce004fa50 0x7f8ce0051f10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:44.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.669+0000 7f8d008f7700 1 --2- 172.21.15.63:0/104703501 >> v2:172.21.15.155:3300/0 conn(0x7f8cfc14a040 0x7f8cfc0afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:44.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.669+0000 7f8d008f7700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cfc0b8d00 0x7f8cfc062930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:44.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.669+0000 7f8d008f7700 1 --2- 172.21.15.63:0/104703501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cfc062450 0x7f8cfc0b2620 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:44.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.669+0000 7f8d008f7700 1 -- 172.21.15.63:0/104703501 >> 172.21.15.63:0/104703501 conn(0x7f8cfc05a7c0 msgr2=0x7f8cfc061830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:44.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.669+0000 7f8d008f7700 1 -- 172.21.15.63:0/104703501 shutdown_connections 2020-05-18T21:29:44.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:44.669+0000 7f8d008f7700 1 -- 172.21.15.63:0/104703501 wait complete. 2020-05-18T21:29:44.676 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 34 2020-05-18T21:29:44.684 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2020-05-18T21:29:44.794 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:29:44.794 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2020-05-18T21:29:44.794 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 392, 2020-05-18T21:29:44.794 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 394, 2020-05-18T21:29:44.795 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 147029, 2020-05-18T21:29:44.795 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 9039415, 2020-05-18T21:29:44.795 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 7, 2020-05-18T21:29:44.795 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 1, 2020-05-18T21:29:44.795 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.073656094, 2020-05-18T21:29:44.796 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.045692171, 2020-05-18T21:29:44.796 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.008664287, 2020-05-18T21:29:44.796 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.015144741, 2020-05-18T21:29:44.797 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:44.797 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 393, 2020-05-18T21:29:44.797 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.034067489, 2020-05-18T21:29:44.797 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000086685 2020-05-18T21:29:44.797 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.798 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:44.798 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.798 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.798 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.799 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:44.799 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.799 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2020-05-18T21:29:44.799 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 158, 2020-05-18T21:29:44.799 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 163, 2020-05-18T21:29:44.800 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 39963, 2020-05-18T21:29:44.800 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 4199643, 2020-05-18T21:29:44.800 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 6, 2020-05-18T21:29:44.800 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 3, 2020-05-18T21:29:44.800 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.034346169, 2020-05-18T21:29:44.800 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.020323859, 2020-05-18T21:29:44.801 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.007071964, 2020-05-18T21:29:44.801 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.005732447, 2020-05-18T21:29:44.801 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:44.801 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 163, 2020-05-18T21:29:44.801 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.013490317, 2020-05-18T21:29:44.802 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000082762 2020-05-18T21:29:44.802 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.802 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:44.802 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.802 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.803 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.803 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:44.803 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.803 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2020-05-18T21:29:44.803 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 8045, 2020-05-18T21:29:44.803 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 14947, 2020-05-18T21:29:44.804 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 2468940, 2020-05-18T21:29:44.804 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 11784942, 2020-05-18T21:29:44.804 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 4, 2020-05-18T21:29:44.804 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 2, 2020-05-18T21:29:44.804 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 1.022372559, 2020-05-18T21:29:44.805 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.449213766, 2020-05-18T21:29:44.805 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.672372461, 2020-05-18T21:29:44.805 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.006393402, 2020-05-18T21:29:44.805 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:44.805 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 14947, 2020-05-18T21:29:44.805 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.364733259, 2020-05-18T21:29:44.806 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000024401 2020-05-18T21:29:44.806 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.806 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:44.806 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 21961, 2020-05-18T21:29:44.807 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.006041176, 2020-05-18T21:29:44.807 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000275 2020-05-18T21:29:44.807 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:44.807 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.808 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2020-05-18T21:29:44.808 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2020-05-18T21:29:44.808 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2020-05-18T21:29:44.808 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.808 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2020-05-18T21:29:44.808 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 1823, 2020-05-18T21:29:44.809 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:44.809 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 165, 2020-05-18T21:29:44.809 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 2.065667199, 2020-05-18T21:29:44.809 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.012519195 2020-05-18T21:29:44.809 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:44.810 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.810 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2020-05-18T21:29:44.810 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:44.810 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:44.810 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 427, 2020-05-18T21:29:44.810 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.092873141, 2020-05-18T21:29:44.811 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000217501 2020-05-18T21:29:44.811 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:44.811 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.811 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2020-05-18T21:29:44.811 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 4538, 2020-05-18T21:29:44.812 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 4536, 2020-05-18T21:29:44.812 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2020-05-18T21:29:44.812 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 4536, 2020-05-18T21:29:44.812 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 8.556690559, 2020-05-18T21:29:44.812 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001886395 2020-05-18T21:29:44.812 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.813 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 0, 2020-05-18T21:29:44.813 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch": 12, 2020-05-18T21:29:44.813 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 73, 2020-05-18T21:29:44.814 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 9, 2020-05-18T21:29:44.814 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 0, 2020-05-18T21:29:44.814 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 3211, 2020-05-18T21:29:44.815 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 0, 2020-05-18T21:29:44.815 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 3211, 2020-05-18T21:29:44.815 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 0, 2020-05-18T21:29:44.815 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 3211, 2020-05-18T21:29:44.815 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 0, 2020-05-18T21:29:44.816 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 2754, 2020-05-18T21:29:44.816 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 2754, 2020-05-18T21:29:44.816 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 2, 2020-05-18T21:29:44.816 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 4548, 2020-05-18T21:29:44.817 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 4537, 2020-05-18T21:29:44.817 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 0, 2020-05-18T21:29:44.817 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 0, 2020-05-18T21:29:44.817 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2020-05-18T21:29:44.817 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2020-05-18T21:29:44.818 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 0, 2020-05-18T21:29:44.818 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 297800, 2020-05-18T21:29:44.818 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2020-05-18T21:29:44.818 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 0, 2020-05-18T21:29:44.818 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 0, 2020-05-18T21:29:44.819 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 0, 2020-05-18T21:29:44.819 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 0, 2020-05-18T21:29:44.819 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2020-05-18T21:29:44.819 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 0, 2020-05-18T21:29:44.819 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2020-05-18T21:29:44.819 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 2155, 2020-05-18T21:29:44.820 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 6703104, 2020-05-18T21:29:44.820 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 0 2020-05-18T21:29:44.820 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.820 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:29:44.820 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 818, 2020-05-18T21:29:44.821 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 0, 2020-05-18T21:29:44.821 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:29:44.821 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 1266, 2020-05-18T21:29:44.821 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 448, 2020-05-18T21:29:44.821 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2020-05-18T21:29:44.821 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2020-05-18T21:29:44.822 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2020-05-18T21:29:44.822 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:29:44.822 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:29:44.822 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2020-05-18T21:29:44.822 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2020-05-18T21:29:44.823 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:29:44.823 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 0, 2020-05-18T21:29:44.823 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2020-05-18T21:29:44.823 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 9, 2020-05-18T21:29:44.823 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2020-05-18T21:29:44.823 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2020-05-18T21:29:44.824 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.824 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2020-05-18T21:29:44.824 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 8155, 2020-05-18T21:29:44.824 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 0, 2020-05-18T21:29:44.824 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 0, 2020-05-18T21:29:44.825 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 8157, 2020-05-18T21:29:44.825 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 0, 2020-05-18T21:29:44.825 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 0, 2020-05-18T21:29:44.825 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 9, 2020-05-18T21:29:44.825 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 0, 2020-05-18T21:29:44.825 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 0, 2020-05-18T21:29:44.826 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 10, 2020-05-18T21:29:44.826 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 0, 2020-05-18T21:29:44.826 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 0, 2020-05-18T21:29:44.826 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 4194304, 2020-05-18T21:29:44.826 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 20678895, 2020-05-18T21:29:44.827 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 4195196, 2020-05-18T21:29:44.827 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2020-05-18T21:29:44.827 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 30, 2020-05-18T21:29:44.827 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.234234628, 2020-05-18T21:29:44.827 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.007807820 2020-05-18T21:29:44.827 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.828 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 2 2020-05-18T21:29:44.828 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.828 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2020-05-18T21:29:44.828 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 3214, 2020-05-18T21:29:44.828 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 3214, 2020-05-18T21:29:44.828 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 0, 2020-05-18T21:29:44.829 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 76, 2020-05-18T21:29:44.829 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 85, 2020-05-18T21:29:44.829 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 9, 2020-05-18T21:29:44.829 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 4477, 2020-05-18T21:29:44.829 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 4477, 2020-05-18T21:29:44.830 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 0, 2020-05-18T21:29:44.830 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 2754, 2020-05-18T21:29:44.830 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 3202, 2020-05-18T21:29:44.830 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 448, 2020-05-18T21:29:44.831 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 93120, 2020-05-18T21:29:44.831 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 331932 2020-05-18T21:29:44.831 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.831 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2020-05-18T21:29:44.831 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 4615, 2020-05-18T21:29:44.832 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 0, 2020-05-18T21:29:44.832 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 4538, 2020-05-18T21:29:44.832 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 2, 2020-05-18T21:29:44.832 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_slave_request": 0, 2020-05-18T21:29:44.832 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2020-05-18T21:29:44.833 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3200, 2020-05-18T21:29:44.833 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 5.456048806, 2020-05-18T21:29:44.833 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001705015 2020-05-18T21:29:44.833 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.833 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2020-05-18T21:29:44.833 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2, 2020-05-18T21:29:44.834 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.078760379, 2020-05-18T21:29:44.834 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.039380189 2020-05-18T21:29:44.834 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.834 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2020-05-18T21:29:44.834 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.835 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.835 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.835 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.835 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2020-05-18T21:29:44.835 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.835 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.836 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.836 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.836 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2020-05-18T21:29:44.836 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.836 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.837 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.837 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.837 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2020-05-18T21:29:44.837 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.837 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.837 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.838 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.838 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2020-05-18T21:29:44.838 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.838 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.838 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.839 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.839 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2020-05-18T21:29:44.839 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.839 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.839 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.839 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.840 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2020-05-18T21:29:44.840 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.840 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.840 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.840 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.840 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2020-05-18T21:29:44.841 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.841 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.841 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.841 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.841 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2020-05-18T21:29:44.842 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.842 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.842 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.842 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.842 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2020-05-18T21:29:44.843 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1, 2020-05-18T21:29:44.843 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.006614312, 2020-05-18T21:29:44.843 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.006614312 2020-05-18T21:29:44.843 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.844 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2020-05-18T21:29:44.844 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.844 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.844 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.844 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.844 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2020-05-18T21:29:44.845 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.845 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.845 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.845 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.845 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2020-05-18T21:29:44.846 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.846 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.846 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.846 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.846 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2020-05-18T21:29:44.846 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 67, 2020-05-18T21:29:44.847 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.349282571, 2020-05-18T21:29:44.847 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.005213172 2020-05-18T21:29:44.847 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.847 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2020-05-18T21:29:44.847 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.848 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.848 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.848 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.849 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2020-05-18T21:29:44.849 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.849 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.849 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.849 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.849 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2020-05-18T21:29:44.850 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.850 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.850 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.850 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.850 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2020-05-18T21:29:44.851 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.851 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.851 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.851 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.851 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2020-05-18T21:29:44.851 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.852 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.852 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.852 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.852 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2020-05-18T21:29:44.852 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.853 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.853 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.853 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.853 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2020-05-18T21:29:44.853 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.853 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.854 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.854 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.854 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2020-05-18T21:29:44.854 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.854 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.855 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.855 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.855 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2020-05-18T21:29:44.855 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.855 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.855 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.856 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.856 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2020-05-18T21:29:44.856 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.856 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.856 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.858 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.858 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2020-05-18T21:29:44.858 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.858 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.858 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.859 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.859 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2020-05-18T21:29:44.859 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1266, 2020-05-18T21:29:44.859 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 2.665984491, 2020-05-18T21:29:44.859 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.002105832 2020-05-18T21:29:44.860 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.860 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0 2020-05-18T21:29:44.860 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.860 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2020-05-18T21:29:44.860 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 1, 2020-05-18T21:29:44.861 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 1, 2020-05-18T21:29:44.861 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 0, 2020-05-18T21:29:44.861 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 1, 2020-05-18T21:29:44.861 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2020-05-18T21:29:44.861 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 4084, 2020-05-18T21:29:44.862 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 4084, 2020-05-18T21:29:44.862 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 553 2020-05-18T21:29:44.862 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.862 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2020-05-18T21:29:44.862 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2020-05-18T21:29:44.863 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2020-05-18T21:29:44.863 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2020-05-18T21:29:44.863 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2020-05-18T21:29:44.863 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2020-05-18T21:29:44.863 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2020-05-18T21:29:44.864 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2020-05-18T21:29:44.864 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2020-05-18T21:29:44.864 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2020-05-18T21:29:44.864 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2020-05-18T21:29:44.864 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2020-05-18T21:29:44.865 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2020-05-18T21:29:44.865 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2020-05-18T21:29:44.865 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2020-05-18T21:29:44.865 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2020-05-18T21:29:44.865 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2020-05-18T21:29:44.866 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2020-05-18T21:29:44.866 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2020-05-18T21:29:44.866 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2020-05-18T21:29:44.866 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2020-05-18T21:29:44.866 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 26830624, 2020-05-18T21:29:44.867 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 7520, 2020-05-18T21:29:44.867 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2020-05-18T21:29:44.867 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2020-05-18T21:29:44.867 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2020-05-18T21:29:44.867 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2020-05-18T21:29:44.868 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2020-05-18T21:29:44.868 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2020-05-18T21:29:44.868 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2020-05-18T21:29:44.868 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2020-05-18T21:29:44.868 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 6128, 2020-05-18T21:29:44.869 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 93, 2020-05-18T21:29:44.869 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2020-05-18T21:29:44.869 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2020-05-18T21:29:44.869 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2020-05-18T21:29:44.869 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2020-05-18T21:29:44.870 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 13493326, 2020-05-18T21:29:44.870 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 120816, 2020-05-18T21:29:44.870 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2020-05-18T21:29:44.870 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2020-05-18T21:29:44.870 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2020-05-18T21:29:44.870 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2020-05-18T21:29:44.871 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.871 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2020-05-18T21:29:44.871 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 0, 2020-05-18T21:29:44.871 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2020-05-18T21:29:44.871 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 616, 2020-05-18T21:29:44.872 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 17442916, 2020-05-18T21:29:44.872 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 0, 2020-05-18T21:29:44.872 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 616, 2020-05-18T21:29:44.872 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 616, 2020-05-18T21:29:44.872 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 29, 2020-05-18T21:29:44.873 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 587, 2020-05-18T21:29:44.873 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2020-05-18T21:29:44.873 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2020-05-18T21:29:44.873 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 2, 2020-05-18T21:29:44.873 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 0, 2020-05-18T21:29:44.874 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 11, 2020-05-18T21:29:44.874 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 33, 2020-05-18T21:29:44.874 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 4, 2020-05-18T21:29:44.874 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2020-05-18T21:29:44.874 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2020-05-18T21:29:44.875 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 1, 2020-05-18T21:29:44.875 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 1, 2020-05-18T21:29:44.875 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 470, 2020-05-18T21:29:44.875 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2020-05-18T21:29:44.875 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2020-05-18T21:29:44.876 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2020-05-18T21:29:44.876 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 14, 2020-05-18T21:29:44.876 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 0, 2020-05-18T21:29:44.876 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2020-05-18T21:29:44.876 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2020-05-18T21:29:44.876 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2020-05-18T21:29:44.877 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2020-05-18T21:29:44.877 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2020-05-18T21:29:44.877 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2020-05-18T21:29:44.877 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2020-05-18T21:29:44.877 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2020-05-18T21:29:44.878 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2020-05-18T21:29:44.878 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 0, 2020-05-18T21:29:44.878 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2020-05-18T21:29:44.878 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2020-05-18T21:29:44.878 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2020-05-18T21:29:44.879 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2020-05-18T21:29:44.879 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2020-05-18T21:29:44.879 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2020-05-18T21:29:44.879 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2020-05-18T21:29:44.879 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2020-05-18T21:29:44.880 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2020-05-18T21:29:44.880 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2020-05-18T21:29:44.880 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2020-05-18T21:29:44.880 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2020-05-18T21:29:44.880 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2020-05-18T21:29:44.881 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2020-05-18T21:29:44.881 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2020-05-18T21:29:44.881 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2020-05-18T21:29:44.881 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 0, 2020-05-18T21:29:44.881 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2020-05-18T21:29:44.882 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 0, 2020-05-18T21:29:44.882 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 7, 2020-05-18T21:29:44.882 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 7, 2020-05-18T21:29:44.882 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2020-05-18T21:29:44.882 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2020-05-18T21:29:44.883 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 154, 2020-05-18T21:29:44.883 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 28, 2020-05-18T21:29:44.883 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 4 2020-05-18T21:29:44.883 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.883 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2020-05-18T21:29:44.883 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 0, 2020-05-18T21:29:44.884 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2020-05-18T21:29:44.884 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2020-05-18T21:29:44.884 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2020-05-18T21:29:44.884 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.884 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2020-05-18T21:29:44.885 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 0, 2020-05-18T21:29:44.885 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 12, 2020-05-18T21:29:44.885 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 0, 2020-05-18T21:29:44.885 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 6, 2020-05-18T21:29:44.886 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 448, 2020-05-18T21:29:44.886 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 0 2020-05-18T21:29:44.886 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.886 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-05-18T21:29:44.886 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 889, 2020-05-18T21:29:44.887 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:44.887 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:44.887 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 8589, 2020-05-18T21:29:44.888 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 2018349, 2020-05-18T21:29:44.888 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:44.888 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 8589, 2020-05-18T21:29:44.888 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:44.888 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:44.889 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 8582, 2020-05-18T21:29:44.889 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 2017460, 2020-05-18T21:29:44.889 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:44.889 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.890 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.890 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.890 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:44.890 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.891 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2020-05-18T21:29:44.891 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:44.891 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:44.891 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:44.891 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:44.891 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:44.892 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:44.892 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:44.892 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 616, 2020-05-18T21:29:44.892 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 17489270, 2020-05-18T21:29:44.893 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 133, 2020-05-18T21:29:44.893 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 17489270, 2020-05-18T21:29:44.893 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:44.893 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.894 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.894 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.894 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:44.894 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.894 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2020-05-18T21:29:44.895 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:44.895 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2020-05-18T21:29:44.895 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:44.895 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:44.895 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:44.896 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:44.896 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:44.896 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 616, 2020-05-18T21:29:44.896 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 616, 2020-05-18T21:29:44.896 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 616, 2020-05-18T21:29:44.897 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 616, 2020-05-18T21:29:44.897 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:44.897 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.897 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.898 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.898 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:44.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.898 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2020-05-18T21:29:44.898 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:44.898 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:44.899 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:44.899 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 448, 2020-05-18T21:29:44.899 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 45248, 2020-05-18T21:29:44.899 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:44.899 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 448, 2020-05-18T21:29:44.900 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:44.900 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:44.900 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 3, 2020-05-18T21:29:44.900 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 45248, 2020-05-18T21:29:44.900 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:44.901 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.901 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.901 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.901 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:44.901 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:44.902 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x558953fdfd60": { 2020-05-18T21:29:44.902 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 46736, 2020-05-18T21:29:44.902 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:44.902 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:44.902 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 8155, 2020-05-18T21:29:44.903 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 16483261, 2020-05-18T21:29:44.904 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:44.904 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 8155, 2020-05-18T21:29:44.904 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:44.904 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:44.904 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 30, 2020-05-18T21:29:44.905 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 16436525, 2020-05-18T21:29:44.905 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:44.905 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:44.905 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:44.905 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:44.906 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:44.906 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:44.906 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:29:44.907 INFO:tasks.cephfs.filesystem:_json_asok output: { "AsyncMessenger::Worker-0": { "msgr_recv_messages": 392, "msgr_send_messages": 394, "msgr_recv_bytes": 147029, "msgr_send_bytes": 9039415, "msgr_created_connections": 7, "msgr_active_connections": 1, "msgr_running_total_time": 0.073656094, "msgr_running_send_time": 0.045692171, "msgr_running_recv_time": 0.008664287, "msgr_running_fast_dispatch_time": 0.015144741, "msgr_send_messages_queue_lat": { "avgcount": 393, "sum": 0.034067489, "avgtime": 0.000086685 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-1": { "msgr_recv_messages": 158, "msgr_send_messages": 163, "msgr_recv_bytes": 39963, "msgr_send_bytes": 4199643, "msgr_created_connections": 6, "msgr_active_connections": 3, "msgr_running_total_time": 0.034346169, "msgr_running_send_time": 0.020323859, "msgr_running_recv_time": 0.007071964, "msgr_running_fast_dispatch_time": 0.005732447, "msgr_send_messages_queue_lat": { "avgcount": 163, "sum": 0.013490317, "avgtime": 0.000082762 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-2": { "msgr_recv_messages": 8045, "msgr_send_messages": 14947, "msgr_recv_bytes": 2468940, "msgr_send_bytes": 11784942, "msgr_created_connections": 4, "msgr_active_connections": 2, "msgr_running_total_time": 1.022372559, "msgr_running_send_time": 0.449213766, "msgr_running_recv_time": 0.672372461, "msgr_running_fast_dispatch_time": 0.006393402, "msgr_send_messages_queue_lat": { "avgcount": 14947, "sum": 0.364733259, "avgtime": 0.000024401 }, "msgr_handle_ack_lat": { "avgcount": 21961, "sum": 0.006041176, "avgtime": 0.000000275 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "queue_len": 1823, "complete_latency": { "avgcount": 165, "sum": 2.065667199, "avgtime": 0.012519195 } }, "finisher-PurgeQueue": { "queue_len": 0, "complete_latency": { "avgcount": 427, "sum": 0.092873141, "avgtime": 0.000217501 } }, "mds": { "request": 4538, "reply": 4536, "reply_latency": { "avgcount": 4536, "sum": 8.556690559, "avgtime": 0.001886395 }, "forward": 0, "dir_fetch": 12, "dir_commit": 73, "dir_split": 9, "dir_merge": 0, "inodes": 3211, "inodes_top": 0, "inodes_bottom": 3211, "inodes_pin_tail": 0, "inodes_pinned": 3211, "inodes_expired": 0, "inodes_with_caps": 2754, "caps": 2754, "subtrees": 2, "traverse": 4548, "traverse_hit": 4537, "traverse_forward": 0, "traverse_discover": 0, "traverse_dir_fetch": 0, "traverse_remote_ino": 0, "traverse_lock": 0, "load_cent": 297800, "q": 0, "exported": 0, "exported_inodes": 0, "imported": 0, "imported_inodes": 0, "openino_dir_fetch": 0, "openino_backtrace_fetch": 0, "openino_peer_discover": 0, "root_rfiles": 2155, "root_rbytes": 6703104, "root_rsnaps": 0 }, "mds_cache": { "num_strays": 818, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "strays_created": 1266, "strays_enqueued": 448, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 9, "ireq_fragstats": 0, "ireq_inodestats": 0 }, "mds_log": { "evadd": 8155, "evex": 0, "evtrm": 0, "ev": 8157, "evexg": 0, "evexd": 0, "segadd": 9, "segex": 0, "segtrm": 0, "seg": 10, "segexg": 0, "segexd": 0, "expos": 4194304, "wrpos": 20678895, "rdpos": 4195196, "jlat": { "avgcount": 30, "sum": 0.234234628, "avgtime": 0.007807820 }, "replayed": 2 }, "mds_mem": { "ino": 3214, "ino+": 3214, "ino-": 0, "dir": 76, "dir+": 85, "dir-": 9, "dn": 4477, "dn+": 4477, "dn-": 0, "cap": 2754, "cap+": 3202, "cap-": 448, "rss": 93120, "heap": 331932 }, "mds_server": { "dispatch_client_request": 4615, "dispatch_server_request": 0, "handle_client_request": 4538, "handle_client_session": 2, "handle_slave_request": 0, "req_create_latency": { "avgcount": 3200, "sum": 5.456048806, "avgtime": 0.001705015 }, "req_getattr_latency": { "avgcount": 2, "sum": 0.078760379, "avgtime": 0.039380189 }, "req_getfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_link_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookup_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookuphash_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupino_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupname_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupparent_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lssnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mkdir_latency": { "avgcount": 1, "sum": 0.006614312, "avgtime": 0.006614312 }, "req_mknod_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mksnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_open_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_readdir_latency": { "avgcount": 67, "sum": 0.349282571, "avgtime": 0.005213172 }, "req_rename_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_renamesnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmdir_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setdirlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_symlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_unlink_latency": { "avgcount": 1266, "sum": 2.665984491, "avgtime": 0.002105832 }, "cap_revoke_eviction": 0 }, "mds_sessions": { "session_count": 1, "session_add": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 4084, "average_load": 4084, "avg_session_uptime": 553 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "buffer_anon_bytes": 26830624, "buffer_anon_items": 7520, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6128, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 13493326, "mds_co_items": 120816, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "op_active": 0, "op_laggy": 0, "op_send": 616, "op_send_bytes": 17442916, "op_resend": 0, "op_reply": 616, "op": 616, "op_r": 29, "op_w": 587, "op_rmw": 0, "op_pg": 0, "osdop_stat": 2, "osdop_create": 0, "osdop_read": 11, "osdop_write": 33, "osdop_writefull": 4, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 1, "osdop_truncate": 1, "osdop_delete": 470, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 14, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 7, "osd_session_open": 7, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 154, "omap_rd": 28, "omap_del": 4 }, "oft": { "omap_total_objs": 0, "omap_total_kv_pairs": 0, "omap_total_updates": 0, "omap_total_removes": 0 }, "purge_queue": { "pq_executing_ops": 0, "pq_executing_ops_high_water": 12, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executed": 448, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "val": 889, "max": 104857600, "get_started": 0, "get": 8589, "get_sum": 2018349, "get_or_fail_fail": 0, "get_or_fail_success": 8589, "take": 0, "take_sum": 0, "put": 8582, "put_sum": 2017460, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_bytes": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 616, "take_sum": 17489270, "put": 133, "put_sum": 17489270, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_ops": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 616, "take_sum": 616, "put": 616, "put_sum": 616, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle": { "val": 0, "max": 3758096384, "get_started": 0, "get": 448, "get_sum": 45248, "get_or_fail_fail": 0, "get_or_fail_success": 448, "take": 0, "take_sum": 0, "put": 3, "put_sum": 45248, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle-0x558953fdfd60": { "val": 46736, "max": 3758096384, "get_started": 0, "get": 8155, "get_sum": 16483261, "get_or_fail_fail": 0, "get_or_fail_success": 8155, "take": 0, "take_sum": 0, "put": 30, "put_sum": 16436525, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } 2020-05-18T21:29:44.908 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/818, 448/1266 2020-05-18T21:29:45.910 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:46.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.021+0000 7ff920b43700 1 Processor -- start 2020-05-18T21:29:46.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.021+0000 7ff920b43700 1 -- start start 2020-05-18T21:29:46.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.021+0000 7ff920b43700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff91c145c60 0x7ff91c065f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:46.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.021+0000 7ff920b43700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff91c0ba0d0 0x7ff91c09f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:46.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.021+0000 7ff920b43700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff91c0b94c0 con 0x7ff91c0bca20 2020-05-18T21:29:46.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.021+0000 7ff920b43700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91c146040 con 0x7ff91c145c60 2020-05-18T21:29:46.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.021+0000 7ff920b43700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c0b96f0 con 0x7ff91c0ba0d0 2020-05-18T21:29:46.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff91a59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff91c145c60 0x7ff91c065f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:46.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff91a59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff91c145c60 0x7ff91c065f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:43260/0 (socket says 172.21.15.63:43260) 2020-05-18T21:29:46.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff91a59c700 1 -- 172.21.15.63:0/2793491613 learned_addr learned my addr 172.21.15.63:0/2793491613 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:46.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff91ad9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff91c0bca20 0x7ff91c09dde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58836/0 (socket says 172.21.15.63:58836) 2020-05-18T21:29:46.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff919d9b700 1 --2- 172.21.15.63:0/2793491613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff91c0ba0d0 0x7ff91c09f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:46.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff91a59c700 1 -- 172.21.15.63:0/2793491613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff91c0ba0d0 msgr2=0x7ff91c09f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:46.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff91a59c700 1 --2- 172.21.15.63:0/2793491613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff91c0ba0d0 0x7ff91c09f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:46.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff91a59c700 1 -- 172.21.15.63:0/2793491613 >> v1:172.21.15.63:6789/0 conn(0x7ff91c0bca20 legacy=0x7ff91c09dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:46.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff91a59c700 1 -- 172.21.15.63:0/2793491613 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c0b9990 con 0x7ff91c145c60 2020-05-18T21:29:46.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff919d9b700 1 --2- 172.21.15.63:0/2793491613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff91c0ba0d0 0x7ff91c09f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:29:46.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff91a59c700 1 --2- 172.21.15.63:0/2793491613 >> v2:172.21.15.155:3300/0 conn(0x7ff91c145c60 0x7ff91c065f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff91c0ba4b0 tx=0x7ff910008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:46.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff91a59c700 1 --2- 172.21.15.63:0/2793491613 >> v2:172.21.15.155:3300/0 conn(0x7ff91c145c60 0x7ff91c065f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff91c0ba4b0 tx=0x7ff910008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:46.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff91a59c700 1 --2- 172.21.15.63:0/2793491613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff91c145c60 0x7ff91c065f00 secure :-1 s=READY pgs=544 cs=0 l=1 rx=0x7ff91c0ba4b0 tx=0x7ff910008920).ready entity=mon.1 client_cookie=f883378c7b5ec529 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:46.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff91a59c700 1 --2- 172.21.15.63:0/2793491613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff91c145c60 0x7ff91c065f00 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7ff91c0ba4b0 tx=0x7ff910008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:46.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff91a59c700 1 --2- 172.21.15.63:0/2793491613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff91c145c60 0x7ff91c065f00 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7ff91c0ba4b0 tx=0x7ff910008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:46.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff91a59c700 1 --2- 172.21.15.63:0/2793491613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff91c145c60 0x7ff91c065f00 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7ff91c0ba4b0 tx=0x7ff910008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:46.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff91959a700 1 -- 172.21.15.63:0/2793491613 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff910008e60 con 0x7ff91c145c60 2020-05-18T21:29:46.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff91959a700 1 -- 172.21.15.63:0/2793491613 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff910011850 con 0x7ff91c145c60 2020-05-18T21:29:46.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff91959a700 1 -- 172.21.15.63:0/2793491613 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff910011bb0 con 0x7ff91c145c60 2020-05-18T21:29:46.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff920b43700 1 -- 172.21.15.63:0/2793491613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff91c145c60 msgr2=0x7ff91c065f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:46.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff920b43700 1 --2- 172.21.15.63:0/2793491613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff91c145c60 0x7ff91c065f00 secure :-1 s=READY pgs=544 cs=0 l=1 rx=0x7ff91c0ba4b0 tx=0x7ff910008920).stop 2020-05-18T21:29:46.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff920b43700 1 -- 172.21.15.63:0/2793491613 shutdown_connections 2020-05-18T21:29:46.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff920b43700 1 --2- 172.21.15.63:0/2793491613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff91c0ba0d0 0x7ff91c09f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:46.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff920b43700 1 --2- 172.21.15.63:0/2793491613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff91c145c60 0x7ff91c065f00 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:46.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff920b43700 1 -- 172.21.15.63:0/2793491613 >> 172.21.15.63:0/2793491613 conn(0x7ff91c05a7c0 msgr2=0x7ff91c05aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:46.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.025+0000 7ff920b43700 1 -- 172.21.15.63:0/2793491613 shutdown_connections 2020-05-18T21:29:46.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff920b43700 1 -- 172.21.15.63:0/2793491613 wait complete. 2020-05-18T21:29:46.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff920b43700 1 Processor -- start 2020-05-18T21:29:46.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff920b43700 1 -- start start 2020-05-18T21:29:46.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff920b43700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff91c0ba0d0 0x7ff91c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:46.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff920b43700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff91c0bca20 0x7ff91c0b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:46.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff920b43700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff91c0a2b70 con 0x7ff91c145c60 2020-05-18T21:29:46.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff920b43700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91c1412b0 con 0x7ff91c0bca20 2020-05-18T21:29:46.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff920b43700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c141550 con 0x7ff91c0ba0d0 2020-05-18T21:29:46.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff91ad9d700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7ff91c145c60 0x7ff91c137ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:57154/0 (socket says 172.21.15.63:57154) 2020-05-18T21:29:46.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff91ad9d700 1 -- 172.21.15.63:0/4248430313 learned_addr learned my addr 172.21.15.63:0/4248430313 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:46.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff919d9b700 1 --2- 172.21.15.63:0/4248430313 >> v2:172.21.15.63:3300/0 conn(0x7ff91c0bca20 0x7ff91c0b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:46.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff91a59c700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff91c0ba0d0 0x7ff91c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:46.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff919d9b700 1 -- 172.21.15.63:0/4248430313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff91c0ba0d0 msgr2=0x7ff91c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:46.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff919d9b700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff91c0ba0d0 0x7ff91c0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:46.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff919d9b700 1 -- 172.21.15.63:0/4248430313 >> v1:172.21.15.155:6789/0 conn(0x7ff91c145c60 legacy=0x7ff91c137ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:46.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff919d9b700 1 -- 172.21.15.63:0/4248430313 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c1417f0 con 0x7ff91c0bca20 2020-05-18T21:29:46.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff919d9b700 1 --2- 172.21.15.63:0/4248430313 >> v2:172.21.15.63:3300/0 conn(0x7ff91c0bca20 0x7ff91c0b4bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff90c002f70 tx=0x7ff91c060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:46.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff919d9b700 1 --2- 172.21.15.63:0/4248430313 >> v2:172.21.15.63:3300/0 conn(0x7ff91c0bca20 0x7ff91c0b4bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff90c002f70 tx=0x7ff91c060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:46.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff919d9b700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff91c0bca20 0x7ff91c0b4bc0 secure :-1 s=READY pgs=767 cs=0 l=1 rx=0x7ff90c002f70 tx=0x7ff91c060a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:46.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff919d9b700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff91c0bca20 0x7ff91c0b4bc0 secure :-1 s=THROTTLE_DONE pgs=767 cs=0 l=1 rx=0x7ff90c002f70 tx=0x7ff91c060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:46.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff919d9b700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff91c0bca20 0x7ff91c0b4bc0 secure :-1 s=THROTTLE_DONE pgs=767 cs=0 l=1 rx=0x7ff90c002f70 tx=0x7ff91c060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:46.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff90b7fe700 1 -- 172.21.15.63:0/4248430313 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff90c007180 con 0x7ff91c0bca20 2020-05-18T21:29:46.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff919d9b700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff91c0bca20 0x7ff91c0b4bc0 secure :-1 s=THROTTLE_DONE pgs=767 cs=0 l=1 rx=0x7ff90c002f70 tx=0x7ff91c060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:46.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff90b7fe700 1 -- 172.21.15.63:0/4248430313 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90c0072e0 con 0x7ff91c0bca20 2020-05-18T21:29:46.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff920b43700 1 -- 172.21.15.63:0/4248430313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff91c1385d0 con 0x7ff91c0bca20 2020-05-18T21:29:46.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.029+0000 7ff90b7fe700 1 -- 172.21.15.63:0/4248430313 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff90c00e200 con 0x7ff91c0bca20 2020-05-18T21:29:46.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.033+0000 7ff920b43700 1 -- 172.21.15.63:0/4248430313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff91c0a13f0 con 0x7ff91c0bca20 2020-05-18T21:29:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.033+0000 7ff919d9b700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff91c0bca20 0x7ff91c0b4bc0 secure :-1 s=THROTTLE_DONE pgs=767 cs=0 l=1 rx=0x7ff90c002f70 tx=0x7ff91c060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.033+0000 7ff90b7fe700 1 -- 172.21.15.63:0/4248430313 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff90c00e470 con 0x7ff91c0bca20 2020-05-18T21:29:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.033+0000 7ff919d9b700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff91c0bca20 0x7ff91c0b4bc0 secure :-1 s=THROTTLE_DONE pgs=767 cs=0 l=1 rx=0x7ff90c002f70 tx=0x7ff91c060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.033+0000 7ff90b7fe700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8f804fab0 0x7ff8f8051f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.033+0000 7ff90b7fe700 1 -- 172.21.15.63:0/4248430313 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff90c063c10 con 0x7ff91c0bca20 2020-05-18T21:29:46.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.033+0000 7ff91a59c700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8f804fab0 0x7ff8f8051f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:46.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.033+0000 7ff920b43700 1 -- 172.21.15.63:0/4248430313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff91c0569e0 con 0x7ff91c0bca20 2020-05-18T21:29:46.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.033+0000 7ff91a59c700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8f804fab0 0x7ff8f8051f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff91c0ba4b0 tx=0x7ff91c0bd880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:46.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.037+0000 7ff91a59c700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8f804fab0 0x7ff8f8051f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff91c0ba4b0 tx=0x7ff91c0bd880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:46.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.037+0000 7ff91a59c700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8f804fab0 0x7ff8f8051f70 secure :-1 s=READY pgs=310 cs=0 l=1 rx=0x7ff91c0ba4b0 tx=0x7ff91c0bd880).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:46.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.041+0000 7ff919d9b700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff91c0bca20 0x7ff91c0b4bc0 secure :-1 s=THROTTLE_DONE pgs=767 cs=0 l=1 rx=0x7ff90c002f70 tx=0x7ff91c060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:46.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.041+0000 7ff90b7fe700 1 -- 172.21.15.63:0/4248430313 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff90c03de60 con 0x7ff91c0bca20 2020-05-18T21:29:46.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.261+0000 7ff920b43700 1 -- 172.21.15.63:0/4248430313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff91c0692c0 con 0x7ff91c0bca20 2020-05-18T21:29:46.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.261+0000 7ff919d9b700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff91c0bca20 0x7ff91c0b4bc0 secure :-1 s=THROTTLE_DONE pgs=767 cs=0 l=1 rx=0x7ff90c002f70 tx=0x7ff91c060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:46.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.261+0000 7ff90b7fe700 1 -- 172.21.15.63:0/4248430313 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2141 (secure 0 0 0) 0x7ff90c041480 con 0x7ff91c0bca20 2020-05-18T21:29:46.269 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:46.269 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/3895568247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3895568247},{"type":"v1","addr":"172.21.15.63:6833","nonce":3895568247}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:24.694515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6319":{"gid":6319,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/400120989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":400120989},{"type":"v1","addr":"172.21.15.155:6835","nonce":400120989}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:46.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.265+0000 7ff920b43700 1 -- 172.21.15.63:0/4248430313 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8f804fab0 msgr2=0x7ff8f8051f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:46.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.265+0000 7ff920b43700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8f804fab0 0x7ff8f8051f70 secure :-1 s=READY pgs=310 cs=0 l=1 rx=0x7ff91c0ba4b0 tx=0x7ff91c0bd880).stop 2020-05-18T21:29:46.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.265+0000 7ff920b43700 1 -- 172.21.15.63:0/4248430313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff91c0bca20 msgr2=0x7ff91c0b4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:46.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.265+0000 7ff920b43700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff91c0bca20 0x7ff91c0b4bc0 secure :-1 s=READY pgs=767 cs=0 l=1 rx=0x7ff90c002f70 tx=0x7ff91c060a60).stop 2020-05-18T21:29:46.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.265+0000 7ff920b43700 1 -- 172.21.15.63:0/4248430313 shutdown_connections 2020-05-18T21:29:46.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.265+0000 7ff920b43700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8f804fab0 0x7ff8f8051f70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:46.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.265+0000 7ff920b43700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff91c0bca20 0x7ff91c0b4bc0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:46.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.265+0000 7ff920b43700 1 --2- 172.21.15.63:0/4248430313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff91c0ba0d0 0x7ff91c0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:46.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.265+0000 7ff920b43700 1 -- 172.21.15.63:0/4248430313 >> 172.21.15.63:0/4248430313 conn(0x7ff91c05a7c0 msgr2=0x7ff91c0663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:46.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.265+0000 7ff920b43700 1 -- 172.21.15.63:0/4248430313 shutdown_connections 2020-05-18T21:29:46.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:46.265+0000 7ff920b43700 1 -- 172.21.15.63:0/4248430313 wait complete. 2020-05-18T21:29:46.273 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 34 2020-05-18T21:29:46.283 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2020-05-18T21:29:46.378 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:29:46.379 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2020-05-18T21:29:46.379 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 1009, 2020-05-18T21:29:46.379 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 1011, 2020-05-18T21:29:46.379 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 376942, 2020-05-18T21:29:46.379 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 9319305, 2020-05-18T21:29:46.380 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 7, 2020-05-18T21:29:46.380 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 1, 2020-05-18T21:29:46.380 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.112723078, 2020-05-18T21:29:46.380 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.059285939, 2020-05-18T21:29:46.380 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.017914172, 2020-05-18T21:29:46.380 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.028521716, 2020-05-18T21:29:46.381 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:46.381 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1010, 2020-05-18T21:29:46.381 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.051361478, 2020-05-18T21:29:46.381 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000050852 2020-05-18T21:29:46.381 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.382 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:46.382 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.382 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.382 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.382 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:46.383 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.383 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2020-05-18T21:29:46.383 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 374, 2020-05-18T21:29:46.388 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 380, 2020-05-18T21:29:46.388 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 91347, 2020-05-18T21:29:46.388 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 4609468, 2020-05-18T21:29:46.389 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 6, 2020-05-18T21:29:46.389 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 3, 2020-05-18T21:29:46.389 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.050461914, 2020-05-18T21:29:46.389 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.026572253, 2020-05-18T21:29:46.389 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.010780232, 2020-05-18T21:29:46.390 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.010785229, 2020-05-18T21:29:46.390 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:46.390 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 380, 2020-05-18T21:29:46.390 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.020705996, 2020-05-18T21:29:46.390 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000054489 2020-05-18T21:29:46.391 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.391 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:46.391 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.391 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.391 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.391 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:46.392 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.392 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2020-05-18T21:29:46.392 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 8485, 2020-05-18T21:29:46.392 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 17683, 2020-05-18T21:29:46.392 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 2608443, 2020-05-18T21:29:46.393 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 12589056, 2020-05-18T21:29:46.393 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 4, 2020-05-18T21:29:46.393 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 2, 2020-05-18T21:29:46.393 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 1.125352733, 2020-05-18T21:29:46.393 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.499603690, 2020-05-18T21:29:46.393 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.722712455, 2020-05-18T21:29:46.394 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.006413910, 2020-05-18T21:29:46.394 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:46.394 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 17683, 2020-05-18T21:29:46.394 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.434838678, 2020-05-18T21:29:46.394 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000024590 2020-05-18T21:29:46.395 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.395 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:46.395 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 24220, 2020-05-18T21:29:46.395 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.006782537, 2020-05-18T21:29:46.396 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000280 2020-05-18T21:29:46.396 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:46.396 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.396 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2020-05-18T21:29:46.396 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2020-05-18T21:29:46.396 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2020-05-18T21:29:46.397 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.397 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2020-05-18T21:29:46.397 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:46.397 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:46.397 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 173, 2020-05-18T21:29:46.398 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 2.696900304, 2020-05-18T21:29:46.398 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.015589019 2020-05-18T21:29:46.398 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:46.398 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.398 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2020-05-18T21:29:46.399 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:46.399 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:46.399 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1188, 2020-05-18T21:29:46.399 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.229574158, 2020-05-18T21:29:46.399 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000193244 2020-05-18T21:29:46.399 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:46.400 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.400 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2020-05-18T21:29:46.400 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 4900, 2020-05-18T21:29:46.400 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 4897, 2020-05-18T21:29:46.400 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2020-05-18T21:29:46.401 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 4897, 2020-05-18T21:29:46.401 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 9.731635737, 2020-05-18T21:29:46.401 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001987264 2020-05-18T21:29:46.401 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.402 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 0, 2020-05-18T21:29:46.402 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch": 12, 2020-05-18T21:29:46.402 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 73, 2020-05-18T21:29:46.402 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 9, 2020-05-18T21:29:46.402 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 0, 2020-05-18T21:29:46.403 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 2763, 2020-05-18T21:29:46.403 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 0, 2020-05-18T21:29:46.403 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 2763, 2020-05-18T21:29:46.403 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 0, 2020-05-18T21:29:46.403 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 2763, 2020-05-18T21:29:46.403 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 0, 2020-05-18T21:29:46.404 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 1931, 2020-05-18T21:29:46.404 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1931, 2020-05-18T21:29:46.404 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 2, 2020-05-18T21:29:46.404 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 4910, 2020-05-18T21:29:46.404 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 4899, 2020-05-18T21:29:46.405 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 0, 2020-05-18T21:29:46.405 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 0, 2020-05-18T21:29:46.405 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2020-05-18T21:29:46.405 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2020-05-18T21:29:46.405 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 0, 2020-05-18T21:29:46.405 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 297800, 2020-05-18T21:29:46.406 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2020-05-18T21:29:46.406 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 0, 2020-05-18T21:29:46.406 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 0, 2020-05-18T21:29:46.406 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 0, 2020-05-18T21:29:46.406 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 0, 2020-05-18T21:29:46.407 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2020-05-18T21:29:46.407 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 0, 2020-05-18T21:29:46.407 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2020-05-18T21:29:46.407 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 1929, 2020-05-18T21:29:46.407 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 14896128, 2020-05-18T21:29:46.408 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 0 2020-05-18T21:29:46.408 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.408 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:29:46.408 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 357, 2020-05-18T21:29:46.408 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 0, 2020-05-18T21:29:46.409 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:29:46.409 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 1628, 2020-05-18T21:29:46.409 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 1271, 2020-05-18T21:29:46.409 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2020-05-18T21:29:46.409 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2020-05-18T21:29:46.410 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2020-05-18T21:29:46.410 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:29:46.410 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:29:46.410 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2020-05-18T21:29:46.410 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2020-05-18T21:29:46.411 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:29:46.411 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 0, 2020-05-18T21:29:46.411 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2020-05-18T21:29:46.411 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 9, 2020-05-18T21:29:46.411 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2020-05-18T21:29:46.411 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2020-05-18T21:29:46.412 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.412 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2020-05-18T21:29:46.412 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 9343, 2020-05-18T21:29:46.412 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 0, 2020-05-18T21:29:46.412 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 0, 2020-05-18T21:29:46.413 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 9345, 2020-05-18T21:29:46.413 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 0, 2020-05-18T21:29:46.413 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 0, 2020-05-18T21:29:46.413 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 11, 2020-05-18T21:29:46.413 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 0, 2020-05-18T21:29:46.413 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 0, 2020-05-18T21:29:46.414 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 12, 2020-05-18T21:29:46.414 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 0, 2020-05-18T21:29:46.414 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 0, 2020-05-18T21:29:46.414 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 4194304, 2020-05-18T21:29:46.414 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 22305197, 2020-05-18T21:29:46.415 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 4195196, 2020-05-18T21:29:46.415 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2020-05-18T21:29:46.415 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 33, 2020-05-18T21:29:46.415 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.251090358, 2020-05-18T21:29:46.415 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.007608798 2020-05-18T21:29:46.415 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.416 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 2 2020-05-18T21:29:46.416 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.416 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2020-05-18T21:29:46.416 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 2766, 2020-05-18T21:29:46.416 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 3214, 2020-05-18T21:29:46.417 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 448, 2020-05-18T21:29:46.417 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 76, 2020-05-18T21:29:46.417 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 85, 2020-05-18T21:29:46.417 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 9, 2020-05-18T21:29:46.417 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 4390, 2020-05-18T21:29:46.417 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 4838, 2020-05-18T21:29:46.418 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 448, 2020-05-18T21:29:46.418 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 1931, 2020-05-18T21:29:46.418 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 3202, 2020-05-18T21:29:46.418 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 1271, 2020-05-18T21:29:46.418 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 95348, 2020-05-18T21:29:46.419 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 331932 2020-05-18T21:29:46.419 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.419 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2020-05-18T21:29:46.419 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 4977, 2020-05-18T21:29:46.419 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 0, 2020-05-18T21:29:46.419 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 4900, 2020-05-18T21:29:46.420 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 2, 2020-05-18T21:29:46.420 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_slave_request": 0, 2020-05-18T21:29:46.420 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2020-05-18T21:29:46.420 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3200, 2020-05-18T21:29:46.420 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 5.456048806, 2020-05-18T21:29:46.421 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001705015 2020-05-18T21:29:46.421 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.421 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2020-05-18T21:29:46.421 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2, 2020-05-18T21:29:46.421 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.078760379, 2020-05-18T21:29:46.421 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.039380189 2020-05-18T21:29:46.422 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.422 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2020-05-18T21:29:46.422 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.422 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.422 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.423 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.423 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2020-05-18T21:29:46.423 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.423 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.423 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.423 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.424 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2020-05-18T21:29:46.424 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.424 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.424 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.424 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2020-05-18T21:29:46.425 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.425 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.425 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.425 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.425 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2020-05-18T21:29:46.426 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.426 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.426 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.426 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.426 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2020-05-18T21:29:46.426 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.427 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.427 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.427 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2020-05-18T21:29:46.427 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.428 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.428 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.428 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2020-05-18T21:29:46.428 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.428 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.429 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.429 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.429 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2020-05-18T21:29:46.429 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.429 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.430 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.430 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2020-05-18T21:29:46.430 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1, 2020-05-18T21:29:46.430 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.006614312, 2020-05-18T21:29:46.430 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.006614312 2020-05-18T21:29:46.431 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.431 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2020-05-18T21:29:46.431 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.431 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.431 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.432 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2020-05-18T21:29:46.432 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.432 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.432 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.433 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2020-05-18T21:29:46.433 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.433 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.433 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.433 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.434 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2020-05-18T21:29:46.434 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 67, 2020-05-18T21:29:46.434 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.349282571, 2020-05-18T21:29:46.434 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.005213172 2020-05-18T21:29:46.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.434 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2020-05-18T21:29:46.435 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.435 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.435 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.435 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2020-05-18T21:29:46.435 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.436 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.436 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.436 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2020-05-18T21:29:46.436 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.437 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.437 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.437 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.437 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2020-05-18T21:29:46.437 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.437 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.438 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.438 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2020-05-18T21:29:46.438 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.438 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.439 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.439 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2020-05-18T21:29:46.439 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.439 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.439 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.440 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2020-05-18T21:29:46.440 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.440 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.440 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.441 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2020-05-18T21:29:46.441 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.441 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.441 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.442 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2020-05-18T21:29:46.442 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.442 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.442 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.443 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2020-05-18T21:29:46.443 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.443 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.443 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.444 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2020-05-18T21:29:46.444 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.444 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.444 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.445 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2020-05-18T21:29:46.445 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1628, 2020-05-18T21:29:46.445 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 3.841915214, 2020-05-18T21:29:46.446 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.002359898 2020-05-18T21:29:46.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.446 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0 2020-05-18T21:29:46.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.446 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2020-05-18T21:29:46.447 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 1, 2020-05-18T21:29:46.447 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 1, 2020-05-18T21:29:46.447 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 0, 2020-05-18T21:29:46.448 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 1, 2020-05-18T21:29:46.448 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2020-05-18T21:29:46.448 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 4369, 2020-05-18T21:29:46.448 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 4369, 2020-05-18T21:29:46.449 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 553 2020-05-18T21:29:46.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.449 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2020-05-18T21:29:46.449 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2020-05-18T21:29:46.449 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2020-05-18T21:29:46.450 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2020-05-18T21:29:46.450 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2020-05-18T21:29:46.450 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2020-05-18T21:29:46.450 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2020-05-18T21:29:46.451 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2020-05-18T21:29:46.451 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2020-05-18T21:29:46.451 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2020-05-18T21:29:46.451 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2020-05-18T21:29:46.451 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2020-05-18T21:29:46.451 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2020-05-18T21:29:46.452 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2020-05-18T21:29:46.452 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2020-05-18T21:29:46.452 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2020-05-18T21:29:46.452 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2020-05-18T21:29:46.452 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2020-05-18T21:29:46.453 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2020-05-18T21:29:46.454 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2020-05-18T21:29:46.454 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2020-05-18T21:29:46.454 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 26830624, 2020-05-18T21:29:46.454 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 7520, 2020-05-18T21:29:46.455 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2020-05-18T21:29:46.455 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2020-05-18T21:29:46.455 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2020-05-18T21:29:46.455 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2020-05-18T21:29:46.455 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2020-05-18T21:29:46.456 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2020-05-18T21:29:46.456 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2020-05-18T21:29:46.456 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2020-05-18T21:29:46.456 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 6128, 2020-05-18T21:29:46.456 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 93, 2020-05-18T21:29:46.457 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2020-05-18T21:29:46.457 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2020-05-18T21:29:46.457 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2020-05-18T21:29:46.457 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2020-05-18T21:29:46.458 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 13493326, 2020-05-18T21:29:46.458 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 120816, 2020-05-18T21:29:46.458 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2020-05-18T21:29:46.458 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2020-05-18T21:29:46.459 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2020-05-18T21:29:46.459 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2020-05-18T21:29:46.459 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.460 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2020-05-18T21:29:46.460 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 0, 2020-05-18T21:29:46.460 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2020-05-18T21:29:46.461 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 1450, 2020-05-18T21:29:46.461 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 17865490, 2020-05-18T21:29:46.461 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 0, 2020-05-18T21:29:46.462 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 1450, 2020-05-18T21:29:46.462 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 1450, 2020-05-18T21:29:46.462 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 32, 2020-05-18T21:29:46.463 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 1418, 2020-05-18T21:29:46.463 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2020-05-18T21:29:46.463 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2020-05-18T21:29:46.464 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 2, 2020-05-18T21:29:46.464 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 0, 2020-05-18T21:29:46.464 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 14, 2020-05-18T21:29:46.465 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 39, 2020-05-18T21:29:46.465 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 5, 2020-05-18T21:29:46.465 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2020-05-18T21:29:46.465 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2020-05-18T21:29:46.466 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 1, 2020-05-18T21:29:46.466 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 1, 2020-05-18T21:29:46.466 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 1294, 2020-05-18T21:29:46.467 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2020-05-18T21:29:46.467 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2020-05-18T21:29:46.467 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2020-05-18T21:29:46.468 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 14, 2020-05-18T21:29:46.468 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 0, 2020-05-18T21:29:46.469 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2020-05-18T21:29:46.469 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2020-05-18T21:29:46.469 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2020-05-18T21:29:46.470 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2020-05-18T21:29:46.470 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2020-05-18T21:29:46.470 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2020-05-18T21:29:46.471 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2020-05-18T21:29:46.471 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2020-05-18T21:29:46.471 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2020-05-18T21:29:46.472 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 0, 2020-05-18T21:29:46.472 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2020-05-18T21:29:46.472 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2020-05-18T21:29:46.473 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2020-05-18T21:29:46.473 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2020-05-18T21:29:46.473 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2020-05-18T21:29:46.474 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2020-05-18T21:29:46.474 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2020-05-18T21:29:46.474 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2020-05-18T21:29:46.475 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2020-05-18T21:29:46.475 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2020-05-18T21:29:46.475 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2020-05-18T21:29:46.476 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2020-05-18T21:29:46.476 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2020-05-18T21:29:46.476 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2020-05-18T21:29:46.477 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2020-05-18T21:29:46.477 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2020-05-18T21:29:46.478 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 0, 2020-05-18T21:29:46.478 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2020-05-18T21:29:46.478 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 0, 2020-05-18T21:29:46.479 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 7, 2020-05-18T21:29:46.479 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 7, 2020-05-18T21:29:46.479 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2020-05-18T21:29:46.480 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2020-05-18T21:29:46.480 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 154, 2020-05-18T21:29:46.480 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 28, 2020-05-18T21:29:46.481 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 4 2020-05-18T21:29:46.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.481 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2020-05-18T21:29:46.482 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 0, 2020-05-18T21:29:46.482 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2020-05-18T21:29:46.482 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2020-05-18T21:29:46.483 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2020-05-18T21:29:46.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.483 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2020-05-18T21:29:46.484 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 0, 2020-05-18T21:29:46.484 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 12, 2020-05-18T21:29:46.484 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 0, 2020-05-18T21:29:46.485 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 6, 2020-05-18T21:29:46.485 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 1271, 2020-05-18T21:29:46.485 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 0 2020-05-18T21:29:46.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.486 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-05-18T21:29:46.486 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:46.487 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:46.487 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:46.487 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 9861, 2020-05-18T21:29:46.488 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 2344891, 2020-05-18T21:29:46.488 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:46.488 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 9861, 2020-05-18T21:29:46.489 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:46.489 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:46.489 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 9861, 2020-05-18T21:29:46.490 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 2344891, 2020-05-18T21:29:46.490 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:46.490 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.491 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.491 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.491 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:46.492 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.492 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2020-05-18T21:29:46.492 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:46.493 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:46.493 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:46.493 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:46.494 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:46.494 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:46.494 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:46.494 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 1450, 2020-05-18T21:29:46.495 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 17994967, 2020-05-18T21:29:46.495 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 143, 2020-05-18T21:29:46.495 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 17994967, 2020-05-18T21:29:46.495 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:46.496 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.496 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.496 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.496 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:46.497 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.498 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2020-05-18T21:29:46.498 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:46.498 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2020-05-18T21:29:46.498 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:46.499 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:46.499 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:46.499 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:46.499 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:46.500 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 1450, 2020-05-18T21:29:46.500 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 1450, 2020-05-18T21:29:46.500 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 1450, 2020-05-18T21:29:46.500 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 1450, 2020-05-18T21:29:46.500 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:46.500 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.501 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.501 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.501 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:46.501 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.501 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2020-05-18T21:29:46.502 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:46.502 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:46.502 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:46.502 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 1271, 2020-05-18T21:29:46.503 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 128371, 2020-05-18T21:29:46.503 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:46.503 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 1271, 2020-05-18T21:29:46.503 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:46.504 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:46.504 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 6, 2020-05-18T21:29:46.504 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 128371, 2020-05-18T21:29:46.504 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:46.504 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.504 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.505 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.505 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:46.505 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:46.505 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x558953fdfd60": { 2020-05-18T21:29:46.505 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 1336795, 2020-05-18T21:29:46.506 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:46.506 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:46.506 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 9344, 2020-05-18T21:29:46.506 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 18112681, 2020-05-18T21:29:46.506 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:46.507 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 9344, 2020-05-18T21:29:46.507 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:46.507 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:46.507 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 33, 2020-05-18T21:29:46.507 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 16775886, 2020-05-18T21:29:46.507 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:46.508 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:46.508 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:46.508 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:46.508 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:46.508 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:46.509 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:29:46.510 INFO:tasks.cephfs.filesystem:_json_asok output: { "AsyncMessenger::Worker-0": { "msgr_recv_messages": 1009, "msgr_send_messages": 1011, "msgr_recv_bytes": 376942, "msgr_send_bytes": 9319305, "msgr_created_connections": 7, "msgr_active_connections": 1, "msgr_running_total_time": 0.112723078, "msgr_running_send_time": 0.059285939, "msgr_running_recv_time": 0.017914172, "msgr_running_fast_dispatch_time": 0.028521716, "msgr_send_messages_queue_lat": { "avgcount": 1010, "sum": 0.051361478, "avgtime": 0.000050852 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-1": { "msgr_recv_messages": 374, "msgr_send_messages": 380, "msgr_recv_bytes": 91347, "msgr_send_bytes": 4609468, "msgr_created_connections": 6, "msgr_active_connections": 3, "msgr_running_total_time": 0.050461914, "msgr_running_send_time": 0.026572253, "msgr_running_recv_time": 0.010780232, "msgr_running_fast_dispatch_time": 0.010785229, "msgr_send_messages_queue_lat": { "avgcount": 380, "sum": 0.020705996, "avgtime": 0.000054489 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-2": { "msgr_recv_messages": 8485, "msgr_send_messages": 17683, "msgr_recv_bytes": 2608443, "msgr_send_bytes": 12589056, "msgr_created_connections": 4, "msgr_active_connections": 2, "msgr_running_total_time": 1.125352733, "msgr_running_send_time": 0.499603690, "msgr_running_recv_time": 0.722712455, "msgr_running_fast_dispatch_time": 0.006413910, "msgr_send_messages_queue_lat": { "avgcount": 17683, "sum": 0.434838678, "avgtime": 0.000024590 }, "msgr_handle_ack_lat": { "avgcount": 24220, "sum": 0.006782537, "avgtime": 0.000000280 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "queue_len": 0, "complete_latency": { "avgcount": 173, "sum": 2.696900304, "avgtime": 0.015589019 } }, "finisher-PurgeQueue": { "queue_len": 0, "complete_latency": { "avgcount": 1188, "sum": 0.229574158, "avgtime": 0.000193244 } }, "mds": { "request": 4900, "reply": 4897, "reply_latency": { "avgcount": 4897, "sum": 9.731635737, "avgtime": 0.001987264 }, "forward": 0, "dir_fetch": 12, "dir_commit": 73, "dir_split": 9, "dir_merge": 0, "inodes": 2763, "inodes_top": 0, "inodes_bottom": 2763, "inodes_pin_tail": 0, "inodes_pinned": 2763, "inodes_expired": 0, "inodes_with_caps": 1931, "caps": 1931, "subtrees": 2, "traverse": 4910, "traverse_hit": 4899, "traverse_forward": 0, "traverse_discover": 0, "traverse_dir_fetch": 0, "traverse_remote_ino": 0, "traverse_lock": 0, "load_cent": 297800, "q": 0, "exported": 0, "exported_inodes": 0, "imported": 0, "imported_inodes": 0, "openino_dir_fetch": 0, "openino_backtrace_fetch": 0, "openino_peer_discover": 0, "root_rfiles": 1929, "root_rbytes": 14896128, "root_rsnaps": 0 }, "mds_cache": { "num_strays": 357, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "strays_created": 1628, "strays_enqueued": 1271, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 9, "ireq_fragstats": 0, "ireq_inodestats": 0 }, "mds_log": { "evadd": 9343, "evex": 0, "evtrm": 0, "ev": 9345, "evexg": 0, "evexd": 0, "segadd": 11, "segex": 0, "segtrm": 0, "seg": 12, "segexg": 0, "segexd": 0, "expos": 4194304, "wrpos": 22305197, "rdpos": 4195196, "jlat": { "avgcount": 33, "sum": 0.251090358, "avgtime": 0.007608798 }, "replayed": 2 }, "mds_mem": { "ino": 2766, "ino+": 3214, "ino-": 448, "dir": 76, "dir+": 85, "dir-": 9, "dn": 4390, "dn+": 4838, "dn-": 448, "cap": 1931, "cap+": 3202, "cap-": 1271, "rss": 95348, "heap": 331932 }, "mds_server": { "dispatch_client_request": 4977, "dispatch_server_request": 0, "handle_client_request": 4900, "handle_client_session": 2, "handle_slave_request": 0, "req_create_latency": { "avgcount": 3200, "sum": 5.456048806, "avgtime": 0.001705015 }, "req_getattr_latency": { "avgcount": 2, "sum": 0.078760379, "avgtime": 0.039380189 }, "req_getfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_link_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookup_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookuphash_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupino_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupname_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupparent_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lssnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mkdir_latency": { "avgcount": 1, "sum": 0.006614312, "avgtime": 0.006614312 }, "req_mknod_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mksnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_open_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_readdir_latency": { "avgcount": 67, "sum": 0.349282571, "avgtime": 0.005213172 }, "req_rename_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_renamesnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmdir_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setdirlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_symlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_unlink_latency": { "avgcount": 1628, "sum": 3.841915214, "avgtime": 0.002359898 }, "cap_revoke_eviction": 0 }, "mds_sessions": { "session_count": 1, "session_add": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 4369, "average_load": 4369, "avg_session_uptime": 553 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "buffer_anon_bytes": 26830624, "buffer_anon_items": 7520, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6128, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 13493326, "mds_co_items": 120816, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "op_active": 0, "op_laggy": 0, "op_send": 1450, "op_send_bytes": 17865490, "op_resend": 0, "op_reply": 1450, "op": 1450, "op_r": 32, "op_w": 1418, "op_rmw": 0, "op_pg": 0, "osdop_stat": 2, "osdop_create": 0, "osdop_read": 14, "osdop_write": 39, "osdop_writefull": 5, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 1, "osdop_truncate": 1, "osdop_delete": 1294, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 14, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 7, "osd_session_open": 7, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 154, "omap_rd": 28, "omap_del": 4 }, "oft": { "omap_total_objs": 0, "omap_total_kv_pairs": 0, "omap_total_updates": 0, "omap_total_removes": 0 }, "purge_queue": { "pq_executing_ops": 0, "pq_executing_ops_high_water": 12, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executed": 1271, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "val": 0, "max": 104857600, "get_started": 0, "get": 9861, "get_sum": 2344891, "get_or_fail_fail": 0, "get_or_fail_success": 9861, "take": 0, "take_sum": 0, "put": 9861, "put_sum": 2344891, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_bytes": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 1450, "take_sum": 17994967, "put": 143, "put_sum": 17994967, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_ops": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 1450, "take_sum": 1450, "put": 1450, "put_sum": 1450, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle": { "val": 0, "max": 3758096384, "get_started": 0, "get": 1271, "get_sum": 128371, "get_or_fail_fail": 0, "get_or_fail_success": 1271, "take": 0, "take_sum": 0, "put": 6, "put_sum": 128371, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle-0x558953fdfd60": { "val": 1336795, "max": 3758096384, "get_started": 0, "get": 9344, "get_sum": 18112681, "get_or_fail_fail": 0, "get_or_fail_success": 9344, "take": 0, "take_sum": 0, "put": 33, "put_sum": 16775886, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } 2020-05-18T21:29:46.511 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/357, 1271/1628 2020-05-18T21:29:47.512 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.617+0000 7f9d1b59e700 1 Processor -- start 2020-05-18T21:29:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.617+0000 7f9d1b59e700 1 -- start start 2020-05-18T21:29:47.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9d1c1402a0 0x7f9d1c05bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:47.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1b59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d1c09ee70 con 0x7f9d1c0b5f50 2020-05-18T21:29:47.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1b59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d1c09d830 con 0x7f9d1c143710 2020-05-18T21:29:47.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1b59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d1c09dad0 con 0x7f9d1c1402a0 2020-05-18T21:29:47.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9d1c1402a0 0x7f9d1c05bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:47.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1ad9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9d1c0b5f50 0x7f9d1c09c320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58850/0 (socket says 172.21.15.63:58850) 2020-05-18T21:29:47.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1ad9d700 1 -- 172.21.15.63:0/3032473634 learned_addr learned my addr 172.21.15.63:0/3032473634 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:47.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1a59c700 1 -- 172.21.15.63:0/3032473634 >> v1:172.21.15.155:6789/0 conn(0x7f9d1c143710 legacy=0x7f9d1c09df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:47.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1a59c700 1 -- 172.21.15.63:0/3032473634 >> v1:172.21.15.63:6789/0 conn(0x7f9d1c0b5f50 legacy=0x7f9d1c09c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:47.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d19d9b700 1 -- 172.21.15.63:0/3032473634 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428838724 0 0) 0x7f9d1c09ee70 con 0x7f9d1c0b5f50 2020-05-18T21:29:47.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1a59c700 1 -- 172.21.15.63:0/3032473634 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c140680 con 0x7f9d1c1402a0 2020-05-18T21:29:47.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1a59c700 1 --2- 172.21.15.63:0/3032473634 >> v2:172.21.15.63:3300/0 conn(0x7f9d1c1402a0 0x7f9d1c05bff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9d0c002f70 tx=0x7f9d0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:47.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1a59c700 1 --2- 172.21.15.63:0/3032473634 >> v2:172.21.15.63:3300/0 conn(0x7f9d1c1402a0 0x7f9d1c05bff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9d0c002f70 tx=0x7f9d0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:47.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1a59c700 1 --2- 172.21.15.63:0/3032473634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1c1402a0 0x7f9d1c05bff0 secure :-1 s=READY pgs=769 cs=0 l=1 rx=0x7f9d0c002f70 tx=0x7f9d0c007a80).ready entity=mon.0 client_cookie=eb169f7088246b4c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:47.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1a59c700 1 --2- 172.21.15.63:0/3032473634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1c1402a0 0x7f9d1c05bff0 secure :-1 s=THROTTLE_DONE pgs=769 cs=0 l=1 rx=0x7f9d0c002f70 tx=0x7f9d0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:47.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d19d9b700 1 -- 172.21.15.63:0/3032473634 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d0c008e80 con 0x7f9d1c1402a0 2020-05-18T21:29:47.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1a59c700 1 --2- 172.21.15.63:0/3032473634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1c1402a0 0x7f9d1c05bff0 secure :-1 s=THROTTLE_DONE pgs=769 cs=0 l=1 rx=0x7f9d0c002f70 tx=0x7f9d0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:47.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d19d9b700 1 -- 172.21.15.63:0/3032473634 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c0116a0 con 0x7f9d1c1402a0 2020-05-18T21:29:47.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1a59c700 1 --2- 172.21.15.63:0/3032473634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1c1402a0 0x7f9d1c05bff0 secure :-1 s=THROTTLE_DONE pgs=769 cs=0 l=1 rx=0x7f9d0c002f70 tx=0x7f9d0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:47.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d19d9b700 1 -- 172.21.15.63:0/3032473634 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d0c011ac0 con 0x7f9d1c1402a0 2020-05-18T21:29:47.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1b59e700 1 -- 172.21.15.63:0/3032473634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1c1402a0 msgr2=0x7f9d1c05bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:47.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1b59e700 1 --2- 172.21.15.63:0/3032473634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1c1402a0 0x7f9d1c05bff0 secure :-1 s=READY pgs=769 cs=0 l=1 rx=0x7f9d0c002f70 tx=0x7f9d0c007a80).stop 2020-05-18T21:29:47.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1b59e700 1 -- 172.21.15.63:0/3032473634 shutdown_connections 2020-05-18T21:29:47.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1b59e700 1 --2- 172.21.15.63:0/3032473634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1c1402a0 0x7f9d1c05bff0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:47.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1b59e700 1 -- 172.21.15.63:0/3032473634 >> 172.21.15.63:0/3032473634 conn(0x7f9d1c0b9870 msgr2=0x7f9d1c0b5840 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:47.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1b59e700 1 -- 172.21.15.63:0/3032473634 shutdown_connections 2020-05-18T21:29:47.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.621+0000 7f9d1b59e700 1 -- 172.21.15.63:0/3032473634 wait complete. 2020-05-18T21:29:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d1b59e700 1 Processor -- start 2020-05-18T21:29:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d1b59e700 1 -- start start 2020-05-18T21:29:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d1b59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9d1c0b5f50 0x7f9d1c146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d1b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9d1c1402a0 0x7f9d1c0b2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d1b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d1c143710 0x7f9d1c154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d1b59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d1c144900 con 0x7f9d1c1402a0 2020-05-18T21:29:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d1b59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d1c0b27a0 con 0x7f9d1c0b5f50 2020-05-18T21:29:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d1b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c1551f0 con 0x7f9d1c143710 2020-05-18T21:29:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d11d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9d1c1402a0 0x7f9d1c0b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:47.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d11d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9d1c1402a0 0x7f9d1c0b2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56666/0 (socket says 172.21.15.63:56666) 2020-05-18T21:29:47.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d11d9b700 1 -- 172.21.15.63:0/3625035639 learned_addr learned my addr 172.21.15.63:0/3625035639 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:47.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d1a59c700 1 --2- 172.21.15.63:0/3625035639 >> v2:172.21.15.155:3300/0 conn(0x7f9d1c0b5f50 0x7f9d1c146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:47.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d1ad9d700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d1c143710 0x7f9d1c154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:47.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d11d9b700 1 -- 172.21.15.63:0/3625035639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d1c143710 msgr2=0x7f9d1c154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:47.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d11d9b700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d1c143710 0x7f9d1c154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:47.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d11d9b700 1 -- 172.21.15.63:0/3625035639 >> v2:172.21.15.155:3300/0 conn(0x7f9d1c0b5f50 msgr2=0x7f9d1c146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:47.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d11d9b700 1 --2- 172.21.15.63:0/3625035639 >> v2:172.21.15.155:3300/0 conn(0x7f9d1c0b5f50 0x7f9d1c146650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:47.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d11d9b700 1 -- 172.21.15.63:0/3625035639 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c155490 con 0x7f9d1c1402a0 2020-05-18T21:29:47.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d11d9b700 1 --2- 172.21.15.63:0/3625035639 >> v2:172.21.15.63:3300/0 conn(0x7f9d1c1402a0 0x7f9d1c0b2340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9d1c09de50 tx=0x7f9d040013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:47.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d11d9b700 1 --2- 172.21.15.63:0/3625035639 >> v2:172.21.15.63:3300/0 conn(0x7f9d1c1402a0 0x7f9d1c0b2340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9d1c09de50 tx=0x7f9d040013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:47.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.625+0000 7f9d11d9b700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1c1402a0 0x7f9d1c0b2340 secure :-1 s=READY pgs=770 cs=0 l=1 rx=0x7f9d1c09de50 tx=0x7f9d040013f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:47.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.629+0000 7f9d11d9b700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1c1402a0 0x7f9d1c0b2340 secure :-1 s=THROTTLE_DONE pgs=770 cs=0 l=1 rx=0x7f9d1c09de50 tx=0x7f9d040013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:47.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.629+0000 7f9d11d9b700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1c1402a0 0x7f9d1c0b2340 secure :-1 s=THROTTLE_DONE pgs=770 cs=0 l=1 rx=0x7f9d1c09de50 tx=0x7f9d040013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:47.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.629+0000 7f9d13fff700 1 -- 172.21.15.63:0/3625035639 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d0400cc60 con 0x7f9d1c1402a0 2020-05-18T21:29:47.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.629+0000 7f9d11d9b700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1c1402a0 0x7f9d1c0b2340 secure :-1 s=THROTTLE_DONE pgs=770 cs=0 l=1 rx=0x7f9d1c09de50 tx=0x7f9d040013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:47.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.629+0000 7f9d13fff700 1 -- 172.21.15.63:0/3625035639 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0400cdc0 con 0x7f9d1c1402a0 2020-05-18T21:29:47.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.629+0000 7f9d13fff700 1 -- 172.21.15.63:0/3625035639 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d040110b0 con 0x7f9d1c1402a0 2020-05-18T21:29:47.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.629+0000 7f9d1b59e700 1 -- 172.21.15.63:0/3625035639 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1c155730 con 0x7f9d1c1402a0 2020-05-18T21:29:47.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.629+0000 7f9d1b59e700 1 -- 172.21.15.63:0/3625035639 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1c13f050 con 0x7f9d1c1402a0 2020-05-18T21:29:47.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.629+0000 7f9d11d9b700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1c1402a0 0x7f9d1c0b2340 secure :-1 s=THROTTLE_DONE pgs=770 cs=0 l=1 rx=0x7f9d1c09de50 tx=0x7f9d040013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:47.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.629+0000 7f9d1b59e700 1 -- 172.21.15.63:0/3625035639 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1c1558f0 con 0x7f9d1c1402a0 2020-05-18T21:29:47.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.629+0000 7f9d13fff700 1 -- 172.21.15.63:0/3625035639 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9d04006520 con 0x7f9d1c1402a0 2020-05-18T21:29:47.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.629+0000 7f9d11d9b700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1c1402a0 0x7f9d1c0b2340 secure :-1 s=THROTTLE_DONE pgs=770 cs=0 l=1 rx=0x7f9d1c09de50 tx=0x7f9d040013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:47.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.629+0000 7f9d13fff700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9d0004f9f0 0x7f9d00051eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:47.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.629+0000 7f9d13fff700 1 -- 172.21.15.63:0/3625035639 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9d04063700 con 0x7f9d1c1402a0 2020-05-18T21:29:47.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.629+0000 7f9d1a59c700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9d0004f9f0 0x7f9d00051eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:47.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.633+0000 7f9d1a59c700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9d0004f9f0 0x7f9d00051eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9d0c002f70 tx=0x7f9d0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:47.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.633+0000 7f9d1a59c700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9d0004f9f0 0x7f9d00051eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9d0c002f70 tx=0x7f9d0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:47.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.633+0000 7f9d1a59c700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9d0004f9f0 0x7f9d00051eb0 secure :-1 s=READY pgs=311 cs=0 l=1 rx=0x7f9d0c002f70 tx=0x7f9d0c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:47.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.637+0000 7f9d11d9b700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1c1402a0 0x7f9d1c0b2340 secure :-1 s=THROTTLE_DONE pgs=770 cs=0 l=1 rx=0x7f9d1c09de50 tx=0x7f9d040013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:47.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.637+0000 7f9d13fff700 1 -- 172.21.15.63:0/3625035639 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9d0403da30 con 0x7f9d1c1402a0 2020-05-18T21:29:47.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.789+0000 7f9d1b59e700 1 -- 172.21.15.63:0/3625035639 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d1c0569e0 con 0x7f9d1c1402a0 2020-05-18T21:29:47.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.789+0000 7f9d11d9b700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1c1402a0 0x7f9d1c0b2340 secure :-1 s=THROTTLE_DONE pgs=770 cs=0 l=1 rx=0x7f9d1c09de50 tx=0x7f9d040013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:47.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.789+0000 7f9d13fff700 1 -- 172.21.15.63:0/3625035639 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f9d04041050 con 0x7f9d1c1402a0 2020-05-18T21:29:47.794 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:47.794 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/3895568247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3895568247},{"type":"v1","addr":"172.21.15.63:6833","nonce":3895568247}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:24.694515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6319":{"gid":6319,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/400120989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":400120989},{"type":"v1","addr":"172.21.15.155:6835","nonce":400120989}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:47.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.793+0000 7f9d1b59e700 1 -- 172.21.15.63:0/3625035639 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9d0004f9f0 msgr2=0x7f9d00051eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:47.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.793+0000 7f9d1b59e700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9d0004f9f0 0x7f9d00051eb0 secure :-1 s=READY pgs=311 cs=0 l=1 rx=0x7f9d0c002f70 tx=0x7f9d0c007a80).stop 2020-05-18T21:29:47.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.793+0000 7f9d1b59e700 1 -- 172.21.15.63:0/3625035639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1c1402a0 msgr2=0x7f9d1c0b2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:47.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.793+0000 7f9d1b59e700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1c1402a0 0x7f9d1c0b2340 secure :-1 s=READY pgs=770 cs=0 l=1 rx=0x7f9d1c09de50 tx=0x7f9d040013f0).stop 2020-05-18T21:29:47.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.793+0000 7f9d1b59e700 1 -- 172.21.15.63:0/3625035639 shutdown_connections 2020-05-18T21:29:47.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.793+0000 7f9d1b59e700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9d0004f9f0 0x7f9d00051eb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:47.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.793+0000 7f9d1b59e700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d1c143710 0x7f9d1c154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:47.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.793+0000 7f9d1b59e700 1 --2- 172.21.15.63:0/3625035639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1c1402a0 0x7f9d1c0b2340 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:47.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.793+0000 7f9d1b59e700 1 --2- 172.21.15.63:0/3625035639 >> v2:172.21.15.155:3300/0 conn(0x7f9d1c0b5f50 0x7f9d1c146650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:47.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.793+0000 7f9d1b59e700 1 -- 172.21.15.63:0/3625035639 >> 172.21.15.63:0/3625035639 conn(0x7f9d1c0b9870 msgr2=0x7f9d1c09c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:47.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.793+0000 7f9d1b59e700 1 -- 172.21.15.63:0/3625035639 shutdown_connections 2020-05-18T21:29:47.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:47.793+0000 7f9d1b59e700 1 -- 172.21.15.63:0/3625035639 wait complete. 2020-05-18T21:29:47.800 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 34 2020-05-18T21:29:47.812 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2020-05-18T21:29:47.929 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:29:47.929 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2020-05-18T21:29:47.930 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 1176, 2020-05-18T21:29:47.930 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 1183, 2020-05-18T21:29:47.930 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 467799, 2020-05-18T21:29:47.930 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 9425284, 2020-05-18T21:29:47.930 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 7, 2020-05-18T21:29:47.931 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 1, 2020-05-18T21:29:47.931 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.126133559, 2020-05-18T21:29:47.931 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.063794575, 2020-05-18T21:29:47.931 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.020883125, 2020-05-18T21:29:47.932 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.032565858, 2020-05-18T21:29:47.932 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:47.932 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1182, 2020-05-18T21:29:47.932 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.060172199, 2020-05-18T21:29:47.932 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000050907 2020-05-18T21:29:47.933 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.933 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:47.933 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.933 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.933 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.933 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:47.934 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.934 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2020-05-18T21:29:47.934 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 427, 2020-05-18T21:29:47.934 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 434, 2020-05-18T21:29:47.934 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 103945, 2020-05-18T21:29:47.935 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 5031780, 2020-05-18T21:29:47.935 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 6, 2020-05-18T21:29:47.935 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 3, 2020-05-18T21:29:47.935 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.065522505, 2020-05-18T21:29:47.935 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.037207427, 2020-05-18T21:29:47.935 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.011738839, 2020-05-18T21:29:47.936 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.013876324, 2020-05-18T21:29:47.936 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:47.936 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 434, 2020-05-18T21:29:47.936 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.024217377, 2020-05-18T21:29:47.936 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000055800 2020-05-18T21:29:47.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.937 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:47.937 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.937 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.937 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.937 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:47.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.938 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2020-05-18T21:29:47.938 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 8882, 2020-05-18T21:29:47.938 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 18919, 2020-05-18T21:29:47.938 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 2744894, 2020-05-18T21:29:47.939 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 13021595, 2020-05-18T21:29:47.939 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 4, 2020-05-18T21:29:47.939 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 2, 2020-05-18T21:29:47.939 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 1.204349252, 2020-05-18T21:29:47.939 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.534325273, 2020-05-18T21:29:47.939 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.773742642, 2020-05-18T21:29:47.940 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.006479137, 2020-05-18T21:29:47.940 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:47.940 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 18919, 2020-05-18T21:29:47.940 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.480642794, 2020-05-18T21:29:47.940 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000025405 2020-05-18T21:29:47.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.941 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:47.941 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 25423, 2020-05-18T21:29:47.941 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.007196775, 2020-05-18T21:29:47.941 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000283 2020-05-18T21:29:47.941 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:47.942 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.942 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2020-05-18T21:29:47.942 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2020-05-18T21:29:47.942 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2020-05-18T21:29:47.942 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.943 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2020-05-18T21:29:47.943 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:47.943 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:47.943 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 178, 2020-05-18T21:29:47.943 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 3.051591839, 2020-05-18T21:29:47.943 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.017143774 2020-05-18T21:29:47.944 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:47.944 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.944 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2020-05-18T21:29:47.944 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:47.944 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:47.945 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1391, 2020-05-18T21:29:47.945 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.353535144, 2020-05-18T21:29:47.945 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000254158 2020-05-18T21:29:47.945 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:47.945 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.945 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2020-05-18T21:29:47.946 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 5292, 2020-05-18T21:29:47.946 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 5290, 2020-05-18T21:29:47.946 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2020-05-18T21:29:47.946 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 5290, 2020-05-18T21:29:47.946 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 10.701269130, 2020-05-18T21:29:47.947 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.002022924 2020-05-18T21:29:47.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.947 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 0, 2020-05-18T21:29:47.947 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch": 12, 2020-05-18T21:29:47.948 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 74, 2020-05-18T21:29:47.948 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 9, 2020-05-18T21:29:47.948 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 0, 2020-05-18T21:29:47.948 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 1853, 2020-05-18T21:29:47.948 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 0, 2020-05-18T21:29:47.949 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 1853, 2020-05-18T21:29:47.949 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 0, 2020-05-18T21:29:47.949 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 1853, 2020-05-18T21:29:47.949 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 1594, 2020-05-18T21:29:47.949 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 1844, 2020-05-18T21:29:47.949 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1844, 2020-05-18T21:29:47.950 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 2, 2020-05-18T21:29:47.950 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 5302, 2020-05-18T21:29:47.950 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 5291, 2020-05-18T21:29:47.950 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 0, 2020-05-18T21:29:47.950 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 0, 2020-05-18T21:29:47.951 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2020-05-18T21:29:47.951 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2020-05-18T21:29:47.951 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 0, 2020-05-18T21:29:47.951 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 297800, 2020-05-18T21:29:47.951 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2020-05-18T21:29:47.951 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 0, 2020-05-18T21:29:47.952 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 0, 2020-05-18T21:29:47.952 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 0, 2020-05-18T21:29:47.952 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 0, 2020-05-18T21:29:47.952 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2020-05-18T21:29:47.952 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 0, 2020-05-18T21:29:47.953 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2020-05-18T21:29:47.953 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 1929, 2020-05-18T21:29:47.953 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 14896128, 2020-05-18T21:29:47.953 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 0 2020-05-18T21:29:47.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.954 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:29:47.954 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 242, 2020-05-18T21:29:47.954 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 0, 2020-05-18T21:29:47.954 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:29:47.955 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 2020, 2020-05-18T21:29:47.955 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 1778, 2020-05-18T21:29:47.955 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2020-05-18T21:29:47.955 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2020-05-18T21:29:47.956 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2020-05-18T21:29:47.956 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:29:47.956 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:29:47.956 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2020-05-18T21:29:47.956 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2020-05-18T21:29:47.957 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:29:47.957 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 0, 2020-05-18T21:29:47.957 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2020-05-18T21:29:47.957 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 10, 2020-05-18T21:29:47.957 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2020-05-18T21:29:47.958 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2020-05-18T21:29:47.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.958 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2020-05-18T21:29:47.958 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 10245, 2020-05-18T21:29:47.958 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 0, 2020-05-18T21:29:47.958 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 0, 2020-05-18T21:29:47.959 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 10247, 2020-05-18T21:29:47.959 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 0, 2020-05-18T21:29:47.959 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 0, 2020-05-18T21:29:47.959 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 11, 2020-05-18T21:29:47.959 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 0, 2020-05-18T21:29:47.960 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 0, 2020-05-18T21:29:47.960 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 12, 2020-05-18T21:29:47.960 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 0, 2020-05-18T21:29:47.960 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 0, 2020-05-18T21:29:47.960 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 4194304, 2020-05-18T21:29:47.961 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 23848099, 2020-05-18T21:29:47.961 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 4195196, 2020-05-18T21:29:47.961 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2020-05-18T21:29:47.961 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 35, 2020-05-18T21:29:47.961 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.283421444, 2020-05-18T21:29:47.962 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.008097755 2020-05-18T21:29:47.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.962 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 2 2020-05-18T21:29:47.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.963 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2020-05-18T21:29:47.963 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1856, 2020-05-18T21:29:47.963 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 3214, 2020-05-18T21:29:47.963 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 1358, 2020-05-18T21:29:47.963 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 45, 2020-05-18T21:29:47.963 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 86, 2020-05-18T21:29:47.964 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 41, 2020-05-18T21:29:47.964 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 2279, 2020-05-18T21:29:47.964 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 5231, 2020-05-18T21:29:47.964 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 2952, 2020-05-18T21:29:47.964 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 1424, 2020-05-18T21:29:47.965 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 3202, 2020-05-18T21:29:47.965 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 1778, 2020-05-18T21:29:47.965 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 95612, 2020-05-18T21:29:47.965 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 331932 2020-05-18T21:29:47.965 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.965 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2020-05-18T21:29:47.966 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 5369, 2020-05-18T21:29:47.966 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 0, 2020-05-18T21:29:47.966 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 5292, 2020-05-18T21:29:47.966 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 2, 2020-05-18T21:29:47.966 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_slave_request": 0, 2020-05-18T21:29:47.967 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2020-05-18T21:29:47.967 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3200, 2020-05-18T21:29:47.967 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 5.456048806, 2020-05-18T21:29:47.967 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001705015 2020-05-18T21:29:47.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.967 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2020-05-18T21:29:47.968 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2, 2020-05-18T21:29:47.968 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.078760379, 2020-05-18T21:29:47.968 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.039380189 2020-05-18T21:29:47.968 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.968 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2020-05-18T21:29:47.969 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.969 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.969 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.969 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.969 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2020-05-18T21:29:47.969 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.970 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.970 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.970 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.970 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2020-05-18T21:29:47.970 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.971 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.971 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.971 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.971 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2020-05-18T21:29:47.971 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.971 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.972 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.972 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.972 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2020-05-18T21:29:47.972 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.973 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.973 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.973 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2020-05-18T21:29:47.973 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.974 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.974 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.974 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2020-05-18T21:29:47.974 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.975 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.975 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.975 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.975 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2020-05-18T21:29:47.975 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.975 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.976 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.976 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.976 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2020-05-18T21:29:47.976 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.976 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.977 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.977 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.977 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2020-05-18T21:29:47.977 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1, 2020-05-18T21:29:47.977 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.006614312, 2020-05-18T21:29:47.977 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.006614312 2020-05-18T21:29:47.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.978 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2020-05-18T21:29:47.978 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.978 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.978 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.979 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.979 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2020-05-18T21:29:47.979 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.979 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.979 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.979 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.980 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2020-05-18T21:29:47.980 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.980 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.980 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.980 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.980 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2020-05-18T21:29:47.981 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 67, 2020-05-18T21:29:47.981 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.349282571, 2020-05-18T21:29:47.981 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.005213172 2020-05-18T21:29:47.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.981 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2020-05-18T21:29:47.982 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.982 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.982 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.982 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.982 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2020-05-18T21:29:47.982 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.983 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.983 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.983 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.983 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2020-05-18T21:29:47.983 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.984 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.984 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.984 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.984 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2020-05-18T21:29:47.985 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.985 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.985 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.985 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2020-05-18T21:29:47.986 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.986 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.986 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.986 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2020-05-18T21:29:47.986 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.987 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.987 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.987 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.987 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2020-05-18T21:29:47.988 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.988 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.988 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.988 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2020-05-18T21:29:47.989 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.989 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.989 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.989 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.990 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2020-05-18T21:29:47.990 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.990 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.990 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.990 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2020-05-18T21:29:47.991 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.991 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.991 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.991 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.991 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2020-05-18T21:29:47.992 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:47.992 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:47.992 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:47.992 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.992 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2020-05-18T21:29:47.992 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2020, 2020-05-18T21:29:47.993 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 4.810563062, 2020-05-18T21:29:47.993 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.002381466 2020-05-18T21:29:47.993 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.993 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0 2020-05-18T21:29:47.993 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.994 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2020-05-18T21:29:47.994 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 1, 2020-05-18T21:29:47.994 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 1, 2020-05-18T21:29:47.994 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 0, 2020-05-18T21:29:47.994 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 1, 2020-05-18T21:29:47.995 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2020-05-18T21:29:47.995 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 4680, 2020-05-18T21:29:47.995 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 4680, 2020-05-18T21:29:47.995 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 553 2020-05-18T21:29:47.995 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:47.995 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2020-05-18T21:29:47.996 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2020-05-18T21:29:47.996 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2020-05-18T21:29:47.996 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2020-05-18T21:29:47.996 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2020-05-18T21:29:47.996 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2020-05-18T21:29:47.997 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2020-05-18T21:29:47.997 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2020-05-18T21:29:47.997 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2020-05-18T21:29:47.997 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2020-05-18T21:29:47.997 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2020-05-18T21:29:47.997 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2020-05-18T21:29:47.998 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2020-05-18T21:29:47.998 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2020-05-18T21:29:47.998 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2020-05-18T21:29:47.998 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2020-05-18T21:29:47.998 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2020-05-18T21:29:47.999 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2020-05-18T21:29:47.999 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2020-05-18T21:29:47.999 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2020-05-18T21:29:47.999 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2020-05-18T21:29:47.999 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 26830624, 2020-05-18T21:29:47.999 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 7520, 2020-05-18T21:29:48.000 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2020-05-18T21:29:48.000 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2020-05-18T21:29:48.000 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2020-05-18T21:29:48.000 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2020-05-18T21:29:48.000 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2020-05-18T21:29:48.001 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2020-05-18T21:29:48.001 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2020-05-18T21:29:48.001 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2020-05-18T21:29:48.002 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 6128, 2020-05-18T21:29:48.002 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 93, 2020-05-18T21:29:48.002 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2020-05-18T21:29:48.002 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2020-05-18T21:29:48.002 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2020-05-18T21:29:48.003 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2020-05-18T21:29:48.003 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 13493326, 2020-05-18T21:29:48.003 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 120816, 2020-05-18T21:29:48.003 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2020-05-18T21:29:48.003 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2020-05-18T21:29:48.004 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2020-05-18T21:29:48.004 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2020-05-18T21:29:48.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:48.004 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2020-05-18T21:29:48.004 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 5, 2020-05-18T21:29:48.005 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2020-05-18T21:29:48.005 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 1678, 2020-05-18T21:29:48.005 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 19813019, 2020-05-18T21:29:48.005 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 0, 2020-05-18T21:29:48.005 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 1673, 2020-05-18T21:29:48.005 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 1678, 2020-05-18T21:29:48.006 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 38, 2020-05-18T21:29:48.006 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 1640, 2020-05-18T21:29:48.006 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2020-05-18T21:29:48.006 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2020-05-18T21:29:48.006 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 2, 2020-05-18T21:29:48.007 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 0, 2020-05-18T21:29:48.007 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 20, 2020-05-18T21:29:48.007 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 47, 2020-05-18T21:29:48.007 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 6, 2020-05-18T21:29:48.007 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2020-05-18T21:29:48.008 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2020-05-18T21:29:48.008 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 1, 2020-05-18T21:29:48.008 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 1, 2020-05-18T21:29:48.008 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 1506, 2020-05-18T21:29:48.009 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2020-05-18T21:29:48.009 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2020-05-18T21:29:48.009 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2020-05-18T21:29:48.009 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 14, 2020-05-18T21:29:48.010 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 0, 2020-05-18T21:29:48.010 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2020-05-18T21:29:48.010 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2020-05-18T21:29:48.010 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2020-05-18T21:29:48.010 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2020-05-18T21:29:48.011 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2020-05-18T21:29:48.011 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2020-05-18T21:29:48.011 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2020-05-18T21:29:48.011 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2020-05-18T21:29:48.011 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2020-05-18T21:29:48.011 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 0, 2020-05-18T21:29:48.012 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2020-05-18T21:29:48.012 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2020-05-18T21:29:48.012 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2020-05-18T21:29:48.012 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2020-05-18T21:29:48.012 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2020-05-18T21:29:48.013 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2020-05-18T21:29:48.013 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2020-05-18T21:29:48.013 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2020-05-18T21:29:48.013 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2020-05-18T21:29:48.013 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2020-05-18T21:29:48.014 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2020-05-18T21:29:48.014 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2020-05-18T21:29:48.014 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2020-05-18T21:29:48.014 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2020-05-18T21:29:48.015 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2020-05-18T21:29:48.015 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2020-05-18T21:29:48.015 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 0, 2020-05-18T21:29:48.015 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2020-05-18T21:29:48.015 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 0, 2020-05-18T21:29:48.015 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 7, 2020-05-18T21:29:48.016 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 7, 2020-05-18T21:29:48.016 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2020-05-18T21:29:48.016 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2020-05-18T21:29:48.016 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 155, 2020-05-18T21:29:48.016 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 28, 2020-05-18T21:29:48.017 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 5 2020-05-18T21:29:48.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:48.017 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2020-05-18T21:29:48.017 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 0, 2020-05-18T21:29:48.017 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2020-05-18T21:29:48.018 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2020-05-18T21:29:48.018 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2020-05-18T21:29:48.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:48.018 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2020-05-18T21:29:48.018 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 10, 2020-05-18T21:29:48.018 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 12, 2020-05-18T21:29:48.019 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 5, 2020-05-18T21:29:48.019 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 6, 2020-05-18T21:29:48.019 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 1478, 2020-05-18T21:29:48.019 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 301 2020-05-18T21:29:48.019 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:48.020 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-05-18T21:29:48.020 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 240, 2020-05-18T21:29:48.020 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:48.020 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:48.020 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 10480, 2020-05-18T21:29:48.021 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 2539543, 2020-05-18T21:29:48.021 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:48.021 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 10480, 2020-05-18T21:29:48.021 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:48.021 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:48.022 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 10479, 2020-05-18T21:29:48.022 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 2539303, 2020-05-18T21:29:48.022 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:48.022 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:48.022 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:48.022 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:48.023 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:48.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:48.023 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2020-05-18T21:29:48.023 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:48.023 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:48.024 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:48.024 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:48.024 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:48.024 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:48.024 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:48.024 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 1679, 2020-05-18T21:29:48.025 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 19993703, 2020-05-18T21:29:48.025 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 159, 2020-05-18T21:29:48.025 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 19993703, 2020-05-18T21:29:48.025 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:48.026 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:48.026 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:48.026 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:48.026 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:48.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:48.027 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2020-05-18T21:29:48.027 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 6, 2020-05-18T21:29:48.027 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2020-05-18T21:29:48.027 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:48.028 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:48.028 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:48.028 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:48.028 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:48.028 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 1679, 2020-05-18T21:29:48.029 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 1679, 2020-05-18T21:29:48.029 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 1673, 2020-05-18T21:29:48.029 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 1673, 2020-05-18T21:29:48.029 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:48.029 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:48.030 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:48.030 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:48.030 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:48.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:48.030 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2020-05-18T21:29:48.030 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:48.031 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:48.031 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:48.031 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 1778, 2020-05-18T21:29:48.031 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 179578, 2020-05-18T21:29:48.031 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:48.032 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 1778, 2020-05-18T21:29:48.032 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:48.032 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:48.032 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 12, 2020-05-18T21:29:48.032 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 179578, 2020-05-18T21:29:48.033 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:48.033 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:48.033 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:48.033 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:48.033 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:48.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:48.034 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x558953fdfd60": { 2020-05-18T21:29:48.034 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 1009045, 2020-05-18T21:29:48.034 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:48.034 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:48.034 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 10245, 2020-05-18T21:29:48.035 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 19652465, 2020-05-18T21:29:48.035 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:48.035 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 10245, 2020-05-18T21:29:48.035 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:48.035 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:48.036 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 35, 2020-05-18T21:29:48.036 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 18643420, 2020-05-18T21:29:48.036 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:48.036 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:48.036 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:48.036 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:48.037 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:48.037 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:48.037 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:29:48.038 INFO:tasks.cephfs.filesystem:_json_asok output: { "AsyncMessenger::Worker-0": { "msgr_recv_messages": 1176, "msgr_send_messages": 1183, "msgr_recv_bytes": 467799, "msgr_send_bytes": 9425284, "msgr_created_connections": 7, "msgr_active_connections": 1, "msgr_running_total_time": 0.126133559, "msgr_running_send_time": 0.063794575, "msgr_running_recv_time": 0.020883125, "msgr_running_fast_dispatch_time": 0.032565858, "msgr_send_messages_queue_lat": { "avgcount": 1182, "sum": 0.060172199, "avgtime": 0.000050907 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-1": { "msgr_recv_messages": 427, "msgr_send_messages": 434, "msgr_recv_bytes": 103945, "msgr_send_bytes": 5031780, "msgr_created_connections": 6, "msgr_active_connections": 3, "msgr_running_total_time": 0.065522505, "msgr_running_send_time": 0.037207427, "msgr_running_recv_time": 0.011738839, "msgr_running_fast_dispatch_time": 0.013876324, "msgr_send_messages_queue_lat": { "avgcount": 434, "sum": 0.024217377, "avgtime": 0.000055800 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-2": { "msgr_recv_messages": 8882, "msgr_send_messages": 18919, "msgr_recv_bytes": 2744894, "msgr_send_bytes": 13021595, "msgr_created_connections": 4, "msgr_active_connections": 2, "msgr_running_total_time": 1.204349252, "msgr_running_send_time": 0.534325273, "msgr_running_recv_time": 0.773742642, "msgr_running_fast_dispatch_time": 0.006479137, "msgr_send_messages_queue_lat": { "avgcount": 18919, "sum": 0.480642794, "avgtime": 0.000025405 }, "msgr_handle_ack_lat": { "avgcount": 25423, "sum": 0.007196775, "avgtime": 0.000000283 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "queue_len": 0, "complete_latency": { "avgcount": 178, "sum": 3.051591839, "avgtime": 0.017143774 } }, "finisher-PurgeQueue": { "queue_len": 0, "complete_latency": { "avgcount": 1391, "sum": 0.353535144, "avgtime": 0.000254158 } }, "mds": { "request": 5292, "reply": 5290, "reply_latency": { "avgcount": 5290, "sum": 10.701269130, "avgtime": 0.002022924 }, "forward": 0, "dir_fetch": 12, "dir_commit": 74, "dir_split": 9, "dir_merge": 0, "inodes": 1853, "inodes_top": 0, "inodes_bottom": 1853, "inodes_pin_tail": 0, "inodes_pinned": 1853, "inodes_expired": 1594, "inodes_with_caps": 1844, "caps": 1844, "subtrees": 2, "traverse": 5302, "traverse_hit": 5291, "traverse_forward": 0, "traverse_discover": 0, "traverse_dir_fetch": 0, "traverse_remote_ino": 0, "traverse_lock": 0, "load_cent": 297800, "q": 0, "exported": 0, "exported_inodes": 0, "imported": 0, "imported_inodes": 0, "openino_dir_fetch": 0, "openino_backtrace_fetch": 0, "openino_peer_discover": 0, "root_rfiles": 1929, "root_rbytes": 14896128, "root_rsnaps": 0 }, "mds_cache": { "num_strays": 242, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "strays_created": 2020, "strays_enqueued": 1778, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 10, "ireq_fragstats": 0, "ireq_inodestats": 0 }, "mds_log": { "evadd": 10245, "evex": 0, "evtrm": 0, "ev": 10247, "evexg": 0, "evexd": 0, "segadd": 11, "segex": 0, "segtrm": 0, "seg": 12, "segexg": 0, "segexd": 0, "expos": 4194304, "wrpos": 23848099, "rdpos": 4195196, "jlat": { "avgcount": 35, "sum": 0.283421444, "avgtime": 0.008097755 }, "replayed": 2 }, "mds_mem": { "ino": 1856, "ino+": 3214, "ino-": 1358, "dir": 45, "dir+": 86, "dir-": 41, "dn": 2279, "dn+": 5231, "dn-": 2952, "cap": 1424, "cap+": 3202, "cap-": 1778, "rss": 95612, "heap": 331932 }, "mds_server": { "dispatch_client_request": 5369, "dispatch_server_request": 0, "handle_client_request": 5292, "handle_client_session": 2, "handle_slave_request": 0, "req_create_latency": { "avgcount": 3200, "sum": 5.456048806, "avgtime": 0.001705015 }, "req_getattr_latency": { "avgcount": 2, "sum": 0.078760379, "avgtime": 0.039380189 }, "req_getfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_link_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookup_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookuphash_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupino_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupname_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupparent_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lssnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mkdir_latency": { "avgcount": 1, "sum": 0.006614312, "avgtime": 0.006614312 }, "req_mknod_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mksnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_open_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_readdir_latency": { "avgcount": 67, "sum": 0.349282571, "avgtime": 0.005213172 }, "req_rename_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_renamesnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmdir_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setdirlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_symlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_unlink_latency": { "avgcount": 2020, "sum": 4.810563062, "avgtime": 0.002381466 }, "cap_revoke_eviction": 0 }, "mds_sessions": { "session_count": 1, "session_add": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 4680, "average_load": 4680, "avg_session_uptime": 553 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "buffer_anon_bytes": 26830624, "buffer_anon_items": 7520, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6128, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 13493326, "mds_co_items": 120816, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "op_active": 5, "op_laggy": 0, "op_send": 1678, "op_send_bytes": 19813019, "op_resend": 0, "op_reply": 1673, "op": 1678, "op_r": 38, "op_w": 1640, "op_rmw": 0, "op_pg": 0, "osdop_stat": 2, "osdop_create": 0, "osdop_read": 20, "osdop_write": 47, "osdop_writefull": 6, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 1, "osdop_truncate": 1, "osdop_delete": 1506, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 14, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 7, "osd_session_open": 7, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 155, "omap_rd": 28, "omap_del": 5 }, "oft": { "omap_total_objs": 0, "omap_total_kv_pairs": 0, "omap_total_updates": 0, "omap_total_removes": 0 }, "purge_queue": { "pq_executing_ops": 10, "pq_executing_ops_high_water": 12, "pq_executing": 5, "pq_executing_high_water": 6, "pq_executed": 1478, "pq_item_in_journal": 301 }, "throttle-msgr_dispatch_throttler-mds": { "val": 240, "max": 104857600, "get_started": 0, "get": 10480, "get_sum": 2539543, "get_or_fail_fail": 0, "get_or_fail_success": 10480, "take": 0, "take_sum": 0, "put": 10479, "put_sum": 2539303, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_bytes": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 1679, "take_sum": 19993703, "put": 159, "put_sum": 19993703, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_ops": { "val": 6, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 1679, "take_sum": 1679, "put": 1673, "put_sum": 1673, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle": { "val": 0, "max": 3758096384, "get_started": 0, "get": 1778, "get_sum": 179578, "get_or_fail_fail": 0, "get_or_fail_success": 1778, "take": 0, "take_sum": 0, "put": 12, "put_sum": 179578, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle-0x558953fdfd60": { "val": 1009045, "max": 3758096384, "get_started": 0, "get": 10245, "get_sum": 19652465, "get_or_fail_fail": 0, "get_or_fail_success": 10245, "take": 0, "take_sum": 0, "put": 35, "put_sum": 18643420, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } 2020-05-18T21:29:48.039 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 5/242, 1478/2020 2020-05-18T21:29:49.044 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:49.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.149+0000 7f9a1bfff700 1 Processor -- start 2020-05-18T21:29:49.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.149+0000 7f9a1bfff700 1 -- start start 2020-05-18T21:29:49.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9a1c0b9da0 0x7f9a1c0b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:49.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a1c05f6a0 0x7f9a1c146500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:49.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1bfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1c0b7250 con 0x7f9a1c05eb50 2020-05-18T21:29:49.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1c0b74f0 con 0x7f9a1c0b9da0 2020-05-18T21:29:49.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1c0b7790 con 0x7f9a1c05f6a0 2020-05-18T21:29:49.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9a1c0b9da0 0x7f9a1c0b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:49.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1b7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a1c05f6a0 0x7f9a1c146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:49.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9a1c0b9da0 0x7f9a1c0b7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56676/0 (socket says 172.21.15.63:56676) 2020-05-18T21:29:49.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1affd700 1 -- 172.21.15.63:0/3606453711 learned_addr learned my addr 172.21.15.63:0/3606453711 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:49.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a19ffb700 1 -- 172.21.15.63:0/3606453711 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829425878 0 0) 0x7f9a1c0b7250 con 0x7f9a1c05eb50 2020-05-18T21:29:49.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1affd700 1 -- 172.21.15.63:0/3606453711 >> v2:172.21.15.155:3300/0 conn(0x7f9a1c05f6a0 msgr2=0x7f9a1c146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:49.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1affd700 1 --2- 172.21.15.63:0/3606453711 >> v2:172.21.15.155:3300/0 conn(0x7f9a1c05f6a0 0x7f9a1c146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:49.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1affd700 1 -- 172.21.15.63:0/3606453711 >> v1:172.21.15.155:6789/0 conn(0x7f9a1c05eb50 legacy=0x7f9a1c05ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:49.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1affd700 1 -- 172.21.15.63:0/3606453711 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c0b7a30 con 0x7f9a1c0b9da0 2020-05-18T21:29:49.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1affd700 1 --2- 172.21.15.63:0/3606453711 >> v2:172.21.15.63:3300/0 conn(0x7f9a1c0b9da0 0x7f9a1c0b7ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9a0c002f70 tx=0x7f9a0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:49.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1affd700 1 --2- 172.21.15.63:0/3606453711 >> v2:172.21.15.63:3300/0 conn(0x7f9a1c0b9da0 0x7f9a1c0b7ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9a0c002f70 tx=0x7f9a0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:49.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1affd700 1 --2- 172.21.15.63:0/3606453711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c0b9da0 0x7f9a1c0b7ed0 secure :-1 s=READY pgs=771 cs=0 l=1 rx=0x7f9a0c002f70 tx=0x7f9a0c007a80).ready entity=mon.0 client_cookie=64bc4074f3683065 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:49.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1affd700 1 --2- 172.21.15.63:0/3606453711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c0b9da0 0x7f9a1c0b7ed0 secure :-1 s=THROTTLE_DONE pgs=771 cs=0 l=1 rx=0x7f9a0c002f70 tx=0x7f9a0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:49.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a19ffb700 1 -- 172.21.15.63:0/3606453711 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a0c0116b0 con 0x7f9a1c0b9da0 2020-05-18T21:29:49.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1affd700 1 --2- 172.21.15.63:0/3606453711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c0b9da0 0x7f9a1c0b7ed0 secure :-1 s=THROTTLE_DONE pgs=771 cs=0 l=1 rx=0x7f9a0c002f70 tx=0x7f9a0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:49.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1affd700 1 --2- 172.21.15.63:0/3606453711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c0b9da0 0x7f9a1c0b7ed0 secure :-1 s=THROTTLE_DONE pgs=771 cs=0 l=1 rx=0x7f9a0c002f70 tx=0x7f9a0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:49.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a19ffb700 1 -- 172.21.15.63:0/3606453711 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0c011810 con 0x7f9a1c0b9da0 2020-05-18T21:29:49.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1bfff700 1 -- 172.21.15.63:0/3606453711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c0b9da0 msgr2=0x7f9a1c0b7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:49.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1bfff700 1 --2- 172.21.15.63:0/3606453711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c0b9da0 0x7f9a1c0b7ed0 secure :-1 s=READY pgs=771 cs=0 l=1 rx=0x7f9a0c002f70 tx=0x7f9a0c007a80).stop 2020-05-18T21:29:49.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a19ffb700 1 -- 172.21.15.63:0/3606453711 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a0c011bf0 con 0x7f9a1c0b9da0 2020-05-18T21:29:49.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1bfff700 1 -- 172.21.15.63:0/3606453711 shutdown_connections 2020-05-18T21:29:49.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1bfff700 1 --2- 172.21.15.63:0/3606453711 >> v2:172.21.15.155:3300/0 conn(0x7f9a1c05f6a0 0x7f9a1c146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:49.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1bfff700 1 --2- 172.21.15.63:0/3606453711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c0b9da0 0x7f9a1c0b7ed0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:49.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1bfff700 1 -- 172.21.15.63:0/3606453711 >> 172.21.15.63:0/3606453711 conn(0x7f9a1c0bd340 msgr2=0x7f9a1c0b9350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:49.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1bfff700 1 -- 172.21.15.63:0/3606453711 shutdown_connections 2020-05-18T21:29:49.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1bfff700 1 -- 172.21.15.63:0/3606453711 wait complete. 2020-05-18T21:29:49.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1bfff700 1 Processor -- start 2020-05-18T21:29:49.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.153+0000 7f9a1bfff700 1 -- start start 2020-05-18T21:29:49.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9a1c05f6a0 0x7f9a1c0b6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:49.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a1c0b9da0 0x7f9a1c157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:49.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1bfff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1c0b6a20 con 0x7f9a1c05eb50 2020-05-18T21:29:49.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1c157c90 con 0x7f9a1c05f6a0 2020-05-18T21:29:49.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1c0b3d40 con 0x7f9a1c0b9da0 2020-05-18T21:29:49.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1a7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9a1c05f6a0 0x7f9a1c0b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:49.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1a7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9a1c05f6a0 0x7f9a1c0b6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56680/0 (socket says 172.21.15.63:56680) 2020-05-18T21:29:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1a7fc700 1 -- 172.21.15.63:0/4278627078 learned_addr learned my addr 172.21.15.63:0/4278627078 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1affd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9a1c05eb50 0x7f9a1c1403c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58866/0 (socket says 172.21.15.63:58866) 2020-05-18T21:29:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1b7fe700 1 --2- 172.21.15.63:0/4278627078 >> v2:172.21.15.155:3300/0 conn(0x7f9a1c0b9da0 0x7f9a1c157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1a7fc700 1 -- 172.21.15.63:0/4278627078 >> v2:172.21.15.155:3300/0 conn(0x7f9a1c0b9da0 msgr2=0x7f9a1c157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1a7fc700 1 --2- 172.21.15.63:0/4278627078 >> v2:172.21.15.155:3300/0 conn(0x7f9a1c0b9da0 0x7f9a1c157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:49.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1a7fc700 1 -- 172.21.15.63:0/4278627078 >> v1:172.21.15.63:6789/0 conn(0x7f9a1c05eb50 legacy=0x7f9a1c1403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:49.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1a7fc700 1 -- 172.21.15.63:0/4278627078 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c0b6cc0 con 0x7f9a1c05f6a0 2020-05-18T21:29:49.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1a7fc700 1 --2- 172.21.15.63:0/4278627078 >> v2:172.21.15.63:3300/0 conn(0x7f9a1c05f6a0 0x7f9a1c0b6330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a10000bc0 tx=0x7f9a1000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:49.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1a7fc700 1 --2- 172.21.15.63:0/4278627078 >> v2:172.21.15.63:3300/0 conn(0x7f9a1c05f6a0 0x7f9a1c0b6330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a10000bc0 tx=0x7f9a1000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:49.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1a7fc700 1 --2- 172.21.15.63:0/4278627078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c05f6a0 0x7f9a1c0b6330 secure :-1 s=READY pgs=773 cs=0 l=1 rx=0x7f9a10000bc0 tx=0x7f9a1000c4a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:49.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1a7fc700 1 --2- 172.21.15.63:0/4278627078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c05f6a0 0x7f9a1c0b6330 secure :-1 s=THROTTLE_DONE pgs=773 cs=0 l=1 rx=0x7f9a10000bc0 tx=0x7f9a1000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:49.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1a7fc700 1 --2- 172.21.15.63:0/4278627078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c05f6a0 0x7f9a1c0b6330 secure :-1 s=THROTTLE_DONE pgs=773 cs=0 l=1 rx=0x7f9a10000bc0 tx=0x7f9a1000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:49.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1a7fc700 1 --2- 172.21.15.63:0/4278627078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c05f6a0 0x7f9a1c0b6330 secure :-1 s=THROTTLE_DONE pgs=773 cs=0 l=1 rx=0x7f9a10000bc0 tx=0x7f9a1000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:49.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a0bfff700 1 -- 172.21.15.63:0/4278627078 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a1000cc60 con 0x7f9a1c05f6a0 2020-05-18T21:29:49.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a0bfff700 1 -- 172.21.15.63:0/4278627078 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1000cdc0 con 0x7f9a1c05f6a0 2020-05-18T21:29:49.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a0bfff700 1 -- 172.21.15.63:0/4278627078 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a10012220 con 0x7f9a1c05f6a0 2020-05-18T21:29:49.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1bfff700 1 -- 172.21.15.63:0/4278627078 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1c0a0070 con 0x7f9a1c05f6a0 2020-05-18T21:29:49.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1bfff700 1 -- 172.21.15.63:0/4278627078 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1c1485a0 con 0x7f9a1c05f6a0 2020-05-18T21:29:49.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1a7fc700 1 --2- 172.21.15.63:0/4278627078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c05f6a0 0x7f9a1c0b6330 secure :-1 s=THROTTLE_DONE pgs=773 cs=0 l=1 rx=0x7f9a10000bc0 tx=0x7f9a1000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:49.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1bfff700 1 -- 172.21.15.63:0/4278627078 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1c148a50 con 0x7f9a1c05f6a0 2020-05-18T21:29:49.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a0bfff700 1 -- 172.21.15.63:0/4278627078 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9a10006520 con 0x7f9a1c05f6a0 2020-05-18T21:29:49.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.157+0000 7f9a1a7fc700 1 --2- 172.21.15.63:0/4278627078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c05f6a0 0x7f9a1c0b6330 secure :-1 s=THROTTLE_DONE pgs=773 cs=0 l=1 rx=0x7f9a10000bc0 tx=0x7f9a1000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:49.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.161+0000 7f9a0bfff700 1 --2- 172.21.15.63:0/4278627078 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f99f804fa60 0x7f99f8051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:49.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.161+0000 7f9a0bfff700 1 -- 172.21.15.63:0/4278627078 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9a100637c0 con 0x7f9a1c05f6a0 2020-05-18T21:29:49.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.161+0000 7f9a1affd700 1 --2- 172.21.15.63:0/4278627078 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f99f804fa60 0x7f99f8051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:49.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.161+0000 7f9a1affd700 1 --2- 172.21.15.63:0/4278627078 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f99f804fa60 0x7f99f8051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a1c09fe30 tx=0x7f9a0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:49.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.161+0000 7f9a1affd700 1 --2- 172.21.15.63:0/4278627078 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f99f804fa60 0x7f99f8051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a1c09fe30 tx=0x7f9a0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:49.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.161+0000 7f9a1affd700 1 --2- 172.21.15.63:0/4278627078 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f99f804fa60 0x7f99f8051f20 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7f9a1c09fe30 tx=0x7f9a0c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:49.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.165+0000 7f9a1a7fc700 1 --2- 172.21.15.63:0/4278627078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c05f6a0 0x7f9a1c0b6330 secure :-1 s=THROTTLE_DONE pgs=773 cs=0 l=1 rx=0x7f9a10000bc0 tx=0x7f9a1000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:49.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.165+0000 7f9a0bfff700 1 -- 172.21.15.63:0/4278627078 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9a1003db50 con 0x7f9a1c05f6a0 2020-05-18T21:29:49.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.329+0000 7f9a1bfff700 1 -- 172.21.15.63:0/4278627078 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a1c0b6e50 con 0x7f9a1c05f6a0 2020-05-18T21:29:49.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.333+0000 7f9a1a7fc700 1 --2- 172.21.15.63:0/4278627078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c05f6a0 0x7f9a1c0b6330 secure :-1 s=THROTTLE_DONE pgs=773 cs=0 l=1 rx=0x7f9a10000bc0 tx=0x7f9a1000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:49.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.333+0000 7f9a0bfff700 1 -- 172.21.15.63:0/4278627078 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f9a10041170 con 0x7f9a1c05f6a0 2020-05-18T21:29:49.337 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:49.338 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/3895568247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3895568247},{"type":"v1","addr":"172.21.15.63:6833","nonce":3895568247}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:24.694515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6319":{"gid":6319,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/400120989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":400120989},{"type":"v1","addr":"172.21.15.155:6835","nonce":400120989}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:49.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.333+0000 7f9a1bfff700 1 -- 172.21.15.63:0/4278627078 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f99f804fa60 msgr2=0x7f99f8051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:49.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.333+0000 7f9a1bfff700 1 --2- 172.21.15.63:0/4278627078 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f99f804fa60 0x7f99f8051f20 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7f9a1c09fe30 tx=0x7f9a0c007a80).stop 2020-05-18T21:29:49.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.333+0000 7f9a1bfff700 1 -- 172.21.15.63:0/4278627078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c05f6a0 msgr2=0x7f9a1c0b6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:49.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.333+0000 7f9a1bfff700 1 --2- 172.21.15.63:0/4278627078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c05f6a0 0x7f9a1c0b6330 secure :-1 s=READY pgs=773 cs=0 l=1 rx=0x7f9a10000bc0 tx=0x7f9a1000c4a0).stop 2020-05-18T21:29:49.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.333+0000 7f9a1bfff700 1 -- 172.21.15.63:0/4278627078 shutdown_connections 2020-05-18T21:29:49.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.333+0000 7f9a1bfff700 1 --2- 172.21.15.63:0/4278627078 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f99f804fa60 0x7f99f8051f20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:49.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.333+0000 7f9a1bfff700 1 --2- 172.21.15.63:0/4278627078 >> v2:172.21.15.155:3300/0 conn(0x7f9a1c0b9da0 0x7f9a1c157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:49.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.333+0000 7f9a1bfff700 1 --2- 172.21.15.63:0/4278627078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a1c05f6a0 0x7f9a1c0b6330 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:49.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.333+0000 7f9a1bfff700 1 -- 172.21.15.63:0/4278627078 >> 172.21.15.63:0/4278627078 conn(0x7f9a1c0bd340 msgr2=0x7f9a1c05aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:49.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.333+0000 7f9a1bfff700 1 -- 172.21.15.63:0/4278627078 shutdown_connections 2020-05-18T21:29:49.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:49.333+0000 7f9a1bfff700 1 -- 172.21.15.63:0/4278627078 wait complete. 2020-05-18T21:29:49.341 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 34 2020-05-18T21:29:49.349 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2020-05-18T21:29:49.461 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:29:49.461 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2020-05-18T21:29:49.462 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 1415, 2020-05-18T21:29:49.462 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 1417, 2020-05-18T21:29:49.462 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 524681, 2020-05-18T21:29:49.462 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 9499930, 2020-05-18T21:29:49.463 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 7, 2020-05-18T21:29:49.463 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 1, 2020-05-18T21:29:49.463 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.140060267, 2020-05-18T21:29:49.463 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.068222854, 2020-05-18T21:29:49.463 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.024487156, 2020-05-18T21:29:49.464 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.037213008, 2020-05-18T21:29:49.464 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:49.464 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1416, 2020-05-18T21:29:49.464 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.072608746, 2020-05-18T21:29:49.464 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000051277 2020-05-18T21:29:49.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.465 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:49.465 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.465 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.465 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.465 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:49.466 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.466 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2020-05-18T21:29:49.466 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 513, 2020-05-18T21:29:49.466 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 519, 2020-05-18T21:29:49.466 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 124397, 2020-05-18T21:29:49.467 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 6746625, 2020-05-18T21:29:49.467 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 6, 2020-05-18T21:29:49.467 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 3, 2020-05-18T21:29:49.467 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.082833588, 2020-05-18T21:29:49.467 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.049377270, 2020-05-18T21:29:49.467 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.013207751, 2020-05-18T21:29:49.468 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.017126280, 2020-05-18T21:29:49.468 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:49.468 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 519, 2020-05-18T21:29:49.468 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.035827796, 2020-05-18T21:29:49.468 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000069032 2020-05-18T21:29:49.469 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.469 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:49.469 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.469 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.469 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.469 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:49.470 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.470 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2020-05-18T21:29:49.470 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 9372, 2020-05-18T21:29:49.470 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 19953, 2020-05-18T21:29:49.470 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 2898301, 2020-05-18T21:29:49.471 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 13407169, 2020-05-18T21:29:49.471 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 4, 2020-05-18T21:29:49.471 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 2, 2020-05-18T21:29:49.471 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 1.288158395, 2020-05-18T21:29:49.471 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.569654687, 2020-05-18T21:29:49.471 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.831228559, 2020-05-18T21:29:49.472 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.007466336, 2020-05-18T21:29:49.472 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:49.472 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 19953, 2020-05-18T21:29:49.472 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.559579661, 2020-05-18T21:29:49.472 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000028044 2020-05-18T21:29:49.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.473 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:49.473 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 26652, 2020-05-18T21:29:49.473 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.007589864, 2020-05-18T21:29:49.473 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000284 2020-05-18T21:29:49.473 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:49.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.474 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2020-05-18T21:29:49.474 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2020-05-18T21:29:49.474 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2020-05-18T21:29:49.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.475 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2020-05-18T21:29:49.475 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 1087, 2020-05-18T21:29:49.475 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:49.475 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 179, 2020-05-18T21:29:49.475 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 3.051978900, 2020-05-18T21:29:49.475 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.017050161 2020-05-18T21:29:49.476 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:49.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.476 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2020-05-18T21:29:49.476 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:49.476 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:49.476 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1677, 2020-05-18T21:29:49.477 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.370826056, 2020-05-18T21:29:49.477 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000221124 2020-05-18T21:29:49.477 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:49.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.477 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2020-05-18T21:29:49.478 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 5771, 2020-05-18T21:29:49.478 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 5769, 2020-05-18T21:29:49.478 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2020-05-18T21:29:49.478 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 5769, 2020-05-18T21:29:49.478 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 11.559574597, 2020-05-18T21:29:49.478 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.002003739 2020-05-18T21:29:49.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.479 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 0, 2020-05-18T21:29:49.479 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch": 12, 2020-05-18T21:29:49.479 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 74, 2020-05-18T21:29:49.479 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 9, 2020-05-18T21:29:49.480 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 0, 2020-05-18T21:29:49.480 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 1433, 2020-05-18T21:29:49.480 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 0, 2020-05-18T21:29:49.480 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 1433, 2020-05-18T21:29:49.480 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 0, 2020-05-18T21:29:49.480 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 1433, 2020-05-18T21:29:49.481 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 1594, 2020-05-18T21:29:49.481 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 1424, 2020-05-18T21:29:49.481 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1424, 2020-05-18T21:29:49.481 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 2, 2020-05-18T21:29:49.481 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 5781, 2020-05-18T21:29:49.482 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 5770, 2020-05-18T21:29:49.482 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 0, 2020-05-18T21:29:49.482 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 0, 2020-05-18T21:29:49.482 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2020-05-18T21:29:49.482 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2020-05-18T21:29:49.482 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 0, 2020-05-18T21:29:49.483 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 297800, 2020-05-18T21:29:49.483 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2020-05-18T21:29:49.483 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 0, 2020-05-18T21:29:49.483 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 0, 2020-05-18T21:29:49.483 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 0, 2020-05-18T21:29:49.484 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 0, 2020-05-18T21:29:49.484 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2020-05-18T21:29:49.484 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 0, 2020-05-18T21:29:49.484 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2020-05-18T21:29:49.484 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 1929, 2020-05-18T21:29:49.484 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 14896128, 2020-05-18T21:29:49.485 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 0 2020-05-18T21:29:49.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.485 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:29:49.485 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 721, 2020-05-18T21:29:49.485 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 0, 2020-05-18T21:29:49.486 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:29:49.486 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 2499, 2020-05-18T21:29:49.486 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 1778, 2020-05-18T21:29:49.486 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2020-05-18T21:29:49.486 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2020-05-18T21:29:49.486 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2020-05-18T21:29:49.487 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:29:49.487 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:29:49.487 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2020-05-18T21:29:49.487 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2020-05-18T21:29:49.487 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:29:49.490 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 0, 2020-05-18T21:29:49.490 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2020-05-18T21:29:49.490 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 10, 2020-05-18T21:29:49.491 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2020-05-18T21:29:49.491 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2020-05-18T21:29:49.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.491 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2020-05-18T21:29:49.491 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 10726, 2020-05-18T21:29:49.492 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 0, 2020-05-18T21:29:49.492 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 0, 2020-05-18T21:29:49.492 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 10728, 2020-05-18T21:29:49.492 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 0, 2020-05-18T21:29:49.492 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 0, 2020-05-18T21:29:49.492 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 13, 2020-05-18T21:29:49.493 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 0, 2020-05-18T21:29:49.493 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 0, 2020-05-18T21:29:49.493 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 14, 2020-05-18T21:29:49.493 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 0, 2020-05-18T21:29:49.493 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 0, 2020-05-18T21:29:49.494 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 4194304, 2020-05-18T21:29:49.494 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 25347189, 2020-05-18T21:29:49.494 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 4195196, 2020-05-18T21:29:49.494 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2020-05-18T21:29:49.494 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 36, 2020-05-18T21:29:49.494 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.313923794, 2020-05-18T21:29:49.495 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.008720105 2020-05-18T21:29:49.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.495 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 2 2020-05-18T21:29:49.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.495 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2020-05-18T21:29:49.496 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1436, 2020-05-18T21:29:49.496 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 3214, 2020-05-18T21:29:49.496 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 1778, 2020-05-18T21:29:49.496 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 45, 2020-05-18T21:29:49.496 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 86, 2020-05-18T21:29:49.496 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 41, 2020-05-18T21:29:49.497 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 2338, 2020-05-18T21:29:49.497 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 5710, 2020-05-18T21:29:49.497 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 3372, 2020-05-18T21:29:49.497 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 1424, 2020-05-18T21:29:49.497 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 3202, 2020-05-18T21:29:49.498 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 1778, 2020-05-18T21:29:49.498 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 95612, 2020-05-18T21:29:49.498 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 331932 2020-05-18T21:29:49.498 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.498 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2020-05-18T21:29:49.498 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 5848, 2020-05-18T21:29:49.499 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 0, 2020-05-18T21:29:49.499 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 5771, 2020-05-18T21:29:49.499 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 2, 2020-05-18T21:29:49.499 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_slave_request": 0, 2020-05-18T21:29:49.499 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2020-05-18T21:29:49.500 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3200, 2020-05-18T21:29:49.500 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 5.456048806, 2020-05-18T21:29:49.500 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001705015 2020-05-18T21:29:49.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.500 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2020-05-18T21:29:49.500 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2, 2020-05-18T21:29:49.501 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.078760379, 2020-05-18T21:29:49.501 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.039380189 2020-05-18T21:29:49.501 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.501 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2020-05-18T21:29:49.501 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.502 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.502 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.502 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.502 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2020-05-18T21:29:49.502 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.502 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.503 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.503 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2020-05-18T21:29:49.503 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.503 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.504 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.504 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.504 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2020-05-18T21:29:49.504 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.504 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.504 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.505 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.505 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2020-05-18T21:29:49.505 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.505 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.505 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.506 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.506 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2020-05-18T21:29:49.506 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.506 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.506 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.506 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.507 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2020-05-18T21:29:49.507 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.507 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.507 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.507 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2020-05-18T21:29:49.508 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.508 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.508 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.508 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.508 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2020-05-18T21:29:49.509 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.509 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.509 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.509 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2020-05-18T21:29:49.510 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1, 2020-05-18T21:29:49.510 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.006614312, 2020-05-18T21:29:49.510 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.006614312 2020-05-18T21:29:49.510 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.511 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2020-05-18T21:29:49.511 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.511 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.511 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.512 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2020-05-18T21:29:49.512 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.512 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.512 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.512 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.512 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2020-05-18T21:29:49.513 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.513 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.513 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.513 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2020-05-18T21:29:49.514 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 67, 2020-05-18T21:29:49.514 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.349282571, 2020-05-18T21:29:49.514 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.005213172 2020-05-18T21:29:49.514 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.514 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2020-05-18T21:29:49.514 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.515 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.515 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.515 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2020-05-18T21:29:49.516 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.516 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.516 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.516 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.516 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2020-05-18T21:29:49.517 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.517 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.517 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.517 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.517 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2020-05-18T21:29:49.518 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.518 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.518 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.518 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.518 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2020-05-18T21:29:49.519 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.519 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.519 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.519 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.519 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2020-05-18T21:29:49.519 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.520 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.520 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.520 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.520 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2020-05-18T21:29:49.520 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.520 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.521 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.521 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.521 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2020-05-18T21:29:49.521 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.521 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.522 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.522 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.522 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2020-05-18T21:29:49.522 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.522 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.522 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.523 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2020-05-18T21:29:49.523 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.523 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.523 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.524 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.524 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2020-05-18T21:29:49.524 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.524 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.524 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.524 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.525 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2020-05-18T21:29:49.525 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2499, 2020-05-18T21:29:49.525 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 5.668868529, 2020-05-18T21:29:49.525 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.002268454 2020-05-18T21:29:49.525 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.526 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0 2020-05-18T21:29:49.526 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.526 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2020-05-18T21:29:49.526 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 1, 2020-05-18T21:29:49.526 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 1, 2020-05-18T21:29:49.527 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 0, 2020-05-18T21:29:49.527 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 1, 2020-05-18T21:29:49.527 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2020-05-18T21:29:49.527 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 5072, 2020-05-18T21:29:49.528 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 5072, 2020-05-18T21:29:49.528 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 553 2020-05-18T21:29:49.528 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.528 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2020-05-18T21:29:49.528 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2020-05-18T21:29:49.528 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2020-05-18T21:29:49.529 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2020-05-18T21:29:49.529 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2020-05-18T21:29:49.529 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2020-05-18T21:29:49.529 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2020-05-18T21:29:49.529 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2020-05-18T21:29:49.530 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2020-05-18T21:29:49.530 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2020-05-18T21:29:49.530 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2020-05-18T21:29:49.530 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2020-05-18T21:29:49.530 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2020-05-18T21:29:49.530 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2020-05-18T21:29:49.531 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2020-05-18T21:29:49.531 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2020-05-18T21:29:49.531 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2020-05-18T21:29:49.531 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2020-05-18T21:29:49.531 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2020-05-18T21:29:49.532 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2020-05-18T21:29:49.532 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2020-05-18T21:29:49.532 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 26830624, 2020-05-18T21:29:49.532 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 7520, 2020-05-18T21:29:49.532 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2020-05-18T21:29:49.533 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2020-05-18T21:29:49.533 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2020-05-18T21:29:49.533 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2020-05-18T21:29:49.533 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2020-05-18T21:29:49.533 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2020-05-18T21:29:49.534 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2020-05-18T21:29:49.534 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2020-05-18T21:29:49.534 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 6128, 2020-05-18T21:29:49.534 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 93, 2020-05-18T21:29:49.534 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2020-05-18T21:29:49.535 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2020-05-18T21:29:49.535 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2020-05-18T21:29:49.535 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2020-05-18T21:29:49.535 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 13493326, 2020-05-18T21:29:49.535 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 120816, 2020-05-18T21:29:49.535 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2020-05-18T21:29:49.536 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2020-05-18T21:29:49.536 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2020-05-18T21:29:49.536 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2020-05-18T21:29:49.536 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.536 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2020-05-18T21:29:49.537 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 0, 2020-05-18T21:29:49.537 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2020-05-18T21:29:49.537 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 2008, 2020-05-18T21:29:49.537 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 22139879, 2020-05-18T21:29:49.537 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 0, 2020-05-18T21:29:49.537 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 2008, 2020-05-18T21:29:49.538 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 2008, 2020-05-18T21:29:49.538 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 38, 2020-05-18T21:29:49.538 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 1970, 2020-05-18T21:29:49.538 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2020-05-18T21:29:49.538 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2020-05-18T21:29:49.539 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 2, 2020-05-18T21:29:49.539 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 0, 2020-05-18T21:29:49.539 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 20, 2020-05-18T21:29:49.539 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 48, 2020-05-18T21:29:49.539 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 7, 2020-05-18T21:29:49.539 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2020-05-18T21:29:49.540 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2020-05-18T21:29:49.540 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 1, 2020-05-18T21:29:49.540 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 1, 2020-05-18T21:29:49.540 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 1834, 2020-05-18T21:29:49.540 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2020-05-18T21:29:49.541 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2020-05-18T21:29:49.541 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2020-05-18T21:29:49.541 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 14, 2020-05-18T21:29:49.541 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 0, 2020-05-18T21:29:49.542 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2020-05-18T21:29:49.542 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2020-05-18T21:29:49.542 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2020-05-18T21:29:49.542 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2020-05-18T21:29:49.542 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2020-05-18T21:29:49.542 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2020-05-18T21:29:49.543 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2020-05-18T21:29:49.543 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2020-05-18T21:29:49.543 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2020-05-18T21:29:49.543 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 0, 2020-05-18T21:29:49.543 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2020-05-18T21:29:49.544 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2020-05-18T21:29:49.544 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2020-05-18T21:29:49.544 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2020-05-18T21:29:49.544 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2020-05-18T21:29:49.544 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2020-05-18T21:29:49.544 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2020-05-18T21:29:49.545 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2020-05-18T21:29:49.545 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2020-05-18T21:29:49.545 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2020-05-18T21:29:49.545 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2020-05-18T21:29:49.545 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2020-05-18T21:29:49.546 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2020-05-18T21:29:49.546 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2020-05-18T21:29:49.546 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2020-05-18T21:29:49.546 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2020-05-18T21:29:49.546 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 0, 2020-05-18T21:29:49.546 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2020-05-18T21:29:49.547 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 0, 2020-05-18T21:29:49.547 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 7, 2020-05-18T21:29:49.547 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 7, 2020-05-18T21:29:49.547 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2020-05-18T21:29:49.547 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2020-05-18T21:29:49.547 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 155, 2020-05-18T21:29:49.548 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 28, 2020-05-18T21:29:49.548 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 5 2020-05-18T21:29:49.548 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.548 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2020-05-18T21:29:49.548 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 0, 2020-05-18T21:29:49.549 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2020-05-18T21:29:49.549 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2020-05-18T21:29:49.549 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2020-05-18T21:29:49.549 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.549 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2020-05-18T21:29:49.549 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 0, 2020-05-18T21:29:49.550 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 12, 2020-05-18T21:29:49.550 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 0, 2020-05-18T21:29:49.550 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 6, 2020-05-18T21:29:49.550 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 1778, 2020-05-18T21:29:49.550 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 0 2020-05-18T21:29:49.551 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.551 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-05-18T21:29:49.551 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 242, 2020-05-18T21:29:49.551 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:49.551 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:49.552 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 11294, 2020-05-18T21:29:49.552 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 2709812, 2020-05-18T21:29:49.552 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:49.552 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 11294, 2020-05-18T21:29:49.552 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:49.552 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:49.553 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 11293, 2020-05-18T21:29:49.553 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 2709570, 2020-05-18T21:29:49.553 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:49.553 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.553 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.554 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.554 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:49.554 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.554 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2020-05-18T21:29:49.554 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:49.554 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:49.555 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:49.555 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:49.555 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:49.555 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:49.555 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:49.556 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 2008, 2020-05-18T21:29:49.556 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 22320563, 2020-05-18T21:29:49.556 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 161, 2020-05-18T21:29:49.556 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 22320563, 2020-05-18T21:29:49.556 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:49.556 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.557 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.557 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.557 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:49.557 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.557 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2020-05-18T21:29:49.558 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:49.559 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2020-05-18T21:29:49.559 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:49.559 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:49.559 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:49.560 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:49.560 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:49.560 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 2008, 2020-05-18T21:29:49.560 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 2008, 2020-05-18T21:29:49.560 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 2008, 2020-05-18T21:29:49.561 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 2008, 2020-05-18T21:29:49.561 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:49.561 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.561 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.561 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.561 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:49.562 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.562 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2020-05-18T21:29:49.562 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:49.562 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:49.562 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:49.563 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 1778, 2020-05-18T21:29:49.563 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 179578, 2020-05-18T21:29:49.563 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:49.563 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 1778, 2020-05-18T21:29:49.563 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:49.564 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:49.564 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 12, 2020-05-18T21:29:49.564 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 179578, 2020-05-18T21:29:49.564 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:49.564 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.565 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.565 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.565 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:49.565 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:49.565 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x558953fdfd60": { 2020-05-18T21:29:49.565 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 181365, 2020-05-18T21:29:49.566 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:49.566 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:49.566 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 10726, 2020-05-18T21:29:49.566 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 21151555, 2020-05-18T21:29:49.566 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:49.567 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 10726, 2020-05-18T21:29:49.567 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:49.567 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:49.567 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 36, 2020-05-18T21:29:49.567 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 20970190, 2020-05-18T21:29:49.568 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:49.568 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:49.568 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:49.568 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:49.568 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:49.568 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:49.569 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:29:49.570 INFO:tasks.cephfs.filesystem:_json_asok output: { "AsyncMessenger::Worker-0": { "msgr_recv_messages": 1415, "msgr_send_messages": 1417, "msgr_recv_bytes": 524681, "msgr_send_bytes": 9499930, "msgr_created_connections": 7, "msgr_active_connections": 1, "msgr_running_total_time": 0.140060267, "msgr_running_send_time": 0.068222854, "msgr_running_recv_time": 0.024487156, "msgr_running_fast_dispatch_time": 0.037213008, "msgr_send_messages_queue_lat": { "avgcount": 1416, "sum": 0.072608746, "avgtime": 0.000051277 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-1": { "msgr_recv_messages": 513, "msgr_send_messages": 519, "msgr_recv_bytes": 124397, "msgr_send_bytes": 6746625, "msgr_created_connections": 6, "msgr_active_connections": 3, "msgr_running_total_time": 0.082833588, "msgr_running_send_time": 0.049377270, "msgr_running_recv_time": 0.013207751, "msgr_running_fast_dispatch_time": 0.017126280, "msgr_send_messages_queue_lat": { "avgcount": 519, "sum": 0.035827796, "avgtime": 0.000069032 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-2": { "msgr_recv_messages": 9372, "msgr_send_messages": 19953, "msgr_recv_bytes": 2898301, "msgr_send_bytes": 13407169, "msgr_created_connections": 4, "msgr_active_connections": 2, "msgr_running_total_time": 1.288158395, "msgr_running_send_time": 0.569654687, "msgr_running_recv_time": 0.831228559, "msgr_running_fast_dispatch_time": 0.007466336, "msgr_send_messages_queue_lat": { "avgcount": 19953, "sum": 0.559579661, "avgtime": 0.000028044 }, "msgr_handle_ack_lat": { "avgcount": 26652, "sum": 0.007589864, "avgtime": 0.000000284 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "queue_len": 1087, "complete_latency": { "avgcount": 179, "sum": 3.051978900, "avgtime": 0.017050161 } }, "finisher-PurgeQueue": { "queue_len": 0, "complete_latency": { "avgcount": 1677, "sum": 0.370826056, "avgtime": 0.000221124 } }, "mds": { "request": 5771, "reply": 5769, "reply_latency": { "avgcount": 5769, "sum": 11.559574597, "avgtime": 0.002003739 }, "forward": 0, "dir_fetch": 12, "dir_commit": 74, "dir_split": 9, "dir_merge": 0, "inodes": 1433, "inodes_top": 0, "inodes_bottom": 1433, "inodes_pin_tail": 0, "inodes_pinned": 1433, "inodes_expired": 1594, "inodes_with_caps": 1424, "caps": 1424, "subtrees": 2, "traverse": 5781, "traverse_hit": 5770, "traverse_forward": 0, "traverse_discover": 0, "traverse_dir_fetch": 0, "traverse_remote_ino": 0, "traverse_lock": 0, "load_cent": 297800, "q": 0, "exported": 0, "exported_inodes": 0, "imported": 0, "imported_inodes": 0, "openino_dir_fetch": 0, "openino_backtrace_fetch": 0, "openino_peer_discover": 0, "root_rfiles": 1929, "root_rbytes": 14896128, "root_rsnaps": 0 }, "mds_cache": { "num_strays": 721, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "strays_created": 2499, "strays_enqueued": 1778, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 10, "ireq_fragstats": 0, "ireq_inodestats": 0 }, "mds_log": { "evadd": 10726, "evex": 0, "evtrm": 0, "ev": 10728, "evexg": 0, "evexd": 0, "segadd": 13, "segex": 0, "segtrm": 0, "seg": 14, "segexg": 0, "segexd": 0, "expos": 4194304, "wrpos": 25347189, "rdpos": 4195196, "jlat": { "avgcount": 36, "sum": 0.313923794, "avgtime": 0.008720105 }, "replayed": 2 }, "mds_mem": { "ino": 1436, "ino+": 3214, "ino-": 1778, "dir": 45, "dir+": 86, "dir-": 41, "dn": 2338, "dn+": 5710, "dn-": 3372, "cap": 1424, "cap+": 3202, "cap-": 1778, "rss": 95612, "heap": 331932 }, "mds_server": { "dispatch_client_request": 5848, "dispatch_server_request": 0, "handle_client_request": 5771, "handle_client_session": 2, "handle_slave_request": 0, "req_create_latency": { "avgcount": 3200, "sum": 5.456048806, "avgtime": 0.001705015 }, "req_getattr_latency": { "avgcount": 2, "sum": 0.078760379, "avgtime": 0.039380189 }, "req_getfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_link_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookup_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookuphash_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupino_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupname_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupparent_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lssnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mkdir_latency": { "avgcount": 1, "sum": 0.006614312, "avgtime": 0.006614312 }, "req_mknod_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mksnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_open_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_readdir_latency": { "avgcount": 67, "sum": 0.349282571, "avgtime": 0.005213172 }, "req_rename_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_renamesnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmdir_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setdirlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_symlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_unlink_latency": { "avgcount": 2499, "sum": 5.668868529, "avgtime": 0.002268454 }, "cap_revoke_eviction": 0 }, "mds_sessions": { "session_count": 1, "session_add": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 5072, "average_load": 5072, "avg_session_uptime": 553 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "buffer_anon_bytes": 26830624, "buffer_anon_items": 7520, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6128, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 13493326, "mds_co_items": 120816, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "op_active": 0, "op_laggy": 0, "op_send": 2008, "op_send_bytes": 22139879, "op_resend": 0, "op_reply": 2008, "op": 2008, "op_r": 38, "op_w": 1970, "op_rmw": 0, "op_pg": 0, "osdop_stat": 2, "osdop_create": 0, "osdop_read": 20, "osdop_write": 48, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 1, "osdop_truncate": 1, "osdop_delete": 1834, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 14, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 7, "osd_session_open": 7, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 155, "omap_rd": 28, "omap_del": 5 }, "oft": { "omap_total_objs": 0, "omap_total_kv_pairs": 0, "omap_total_updates": 0, "omap_total_removes": 0 }, "purge_queue": { "pq_executing_ops": 0, "pq_executing_ops_high_water": 12, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executed": 1778, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "val": 242, "max": 104857600, "get_started": 0, "get": 11294, "get_sum": 2709812, "get_or_fail_fail": 0, "get_or_fail_success": 11294, "take": 0, "take_sum": 0, "put": 11293, "put_sum": 2709570, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_bytes": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 2008, "take_sum": 22320563, "put": 161, "put_sum": 22320563, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_ops": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 2008, "take_sum": 2008, "put": 2008, "put_sum": 2008, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle": { "val": 0, "max": 3758096384, "get_started": 0, "get": 1778, "get_sum": 179578, "get_or_fail_fail": 0, "get_or_fail_success": 1778, "take": 0, "take_sum": 0, "put": 12, "put_sum": 179578, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle-0x558953fdfd60": { "val": 181365, "max": 3758096384, "get_started": 0, "get": 10726, "get_sum": 21151555, "get_or_fail_fail": 0, "get_or_fail_success": 10726, "take": 0, "take_sum": 0, "put": 36, "put_sum": 20970190, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } 2020-05-18T21:29:49.571 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/721, 1778/2499 2020-05-18T21:29:50.572 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:50.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.685+0000 7fd9fc5ae700 1 Processor -- start 2020-05-18T21:29:50.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.685+0000 7fd9fc5ae700 1 -- start start 2020-05-18T21:29:50.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.685+0000 7fd9fc5ae700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd9f40b9120 0x7fd9f40b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:50.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.685+0000 7fd9fc5ae700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f4149740 con 0x7fd9f414a350 2020-05-18T21:29:50.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.685+0000 7fd9fc5ae700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f4149970 con 0x7fd9f40b3af0 2020-05-18T21:29:50.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.685+0000 7fd9fc5ae700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f4149c10 con 0x7fd9f40b9120 2020-05-18T21:29:50.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.685+0000 7fd9fa34a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd9f40b9120 0x7fd9f40b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:50.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.685+0000 7fd9f9b49700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd9f414a350 0x7fd9f412bd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58874/0 (socket says 172.21.15.63:58874) 2020-05-18T21:29:50.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.685+0000 7fd9f9b49700 1 -- 172.21.15.63:0/31382036 learned_addr learned my addr 172.21.15.63:0/31382036 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:50.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.685+0000 7fd9fab4b700 1 --1- 172.21.15.63:0/31382036 >> v1:172.21.15.155:6789/0 conn(0x7fd9f40b3af0 0x7fd9f40ad7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:57194/0 (socket says 172.21.15.63:57194) 2020-05-18T21:29:50.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.685+0000 7fd9fa34a700 1 -- 172.21.15.63:0/31382036 >> v1:172.21.15.155:6789/0 conn(0x7fd9f40b3af0 legacy=0x7fd9f40ad7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:50.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.685+0000 7fd9fa34a700 1 -- 172.21.15.63:0/31382036 >> v1:172.21.15.63:6789/0 conn(0x7fd9f414a350 legacy=0x7fd9f412bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:50.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.685+0000 7fd9fa34a700 1 -- 172.21.15.63:0/31382036 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f4149eb0 con 0x7fd9f40b9120 2020-05-18T21:29:50.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.685+0000 7fd9fa34a700 1 --2- 172.21.15.63:0/31382036 >> v2:172.21.15.63:3300/0 conn(0x7fd9f40b9120 0x7fd9f40b30f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd9e8002f70 tx=0x7fd9e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:50.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.689+0000 7fd9fa34a700 1 --2- 172.21.15.63:0/31382036 >> v2:172.21.15.63:3300/0 conn(0x7fd9f40b9120 0x7fd9f40b30f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd9e8002f70 tx=0x7fd9e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:50.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.689+0000 7fd9fa34a700 1 --2- 172.21.15.63:0/31382036 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f40b9120 0x7fd9f40b30f0 secure :-1 s=READY pgs=775 cs=0 l=1 rx=0x7fd9e8002f70 tx=0x7fd9e8007a80).ready entity=mon.0 client_cookie=6cee98db953239ee server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:50.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.689+0000 7fd9fa34a700 1 --2- 172.21.15.63:0/31382036 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f40b9120 0x7fd9f40b30f0 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7fd9e8002f70 tx=0x7fd9e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:50.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.689+0000 7fd9f9348700 1 -- 172.21.15.63:0/31382036 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9e8008e80 con 0x7fd9f40b9120 2020-05-18T21:29:50.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.689+0000 7fd9fa34a700 1 --2- 172.21.15.63:0/31382036 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f40b9120 0x7fd9f40b30f0 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7fd9e8002f70 tx=0x7fd9e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:50.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.689+0000 7fd9fa34a700 1 --2- 172.21.15.63:0/31382036 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f40b9120 0x7fd9f40b30f0 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7fd9e8002f70 tx=0x7fd9e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:50.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.689+0000 7fd9f9348700 1 -- 172.21.15.63:0/31382036 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e80116a0 con 0x7fd9f40b9120 2020-05-18T21:29:50.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.689+0000 7fd9f9348700 1 -- 172.21.15.63:0/31382036 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9e8011ac0 con 0x7fd9f40b9120 2020-05-18T21:29:50.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.689+0000 7fd9fc5ae700 1 -- 172.21.15.63:0/31382036 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f40b9120 msgr2=0x7fd9f40b30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:50.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.689+0000 7fd9fc5ae700 1 --2- 172.21.15.63:0/31382036 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f40b9120 0x7fd9f40b30f0 secure :-1 s=READY pgs=775 cs=0 l=1 rx=0x7fd9e8002f70 tx=0x7fd9e8007a80).stop 2020-05-18T21:29:50.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.689+0000 7fd9fc5ae700 1 -- 172.21.15.63:0/31382036 shutdown_connections 2020-05-18T21:29:50.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.689+0000 7fd9fc5ae700 1 --2- 172.21.15.63:0/31382036 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f40b9120 0x7fd9f40b30f0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:50.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.689+0000 7fd9fc5ae700 1 -- 172.21.15.63:0/31382036 >> 172.21.15.63:0/31382036 conn(0x7fd9f405b290 msgr2=0x7fd9f40b86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:50.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.689+0000 7fd9fc5ae700 1 -- 172.21.15.63:0/31382036 shutdown_connections 2020-05-18T21:29:50.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.689+0000 7fd9fc5ae700 1 -- 172.21.15.63:0/31382036 wait complete. 2020-05-18T21:29:50.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.689+0000 7fd9fc5ae700 1 Processor -- start 2020-05-18T21:29:50.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.693+0000 7fd9fc5ae700 1 -- start start 2020-05-18T21:29:50.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.693+0000 7fd9fc5ae700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9f40b3af0 0x7fd9f4147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:50.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.693+0000 7fd9fc5ae700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f4153ce0 con 0x7fd9f414a350 2020-05-18T21:29:50.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.693+0000 7fd9fc5ae700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f4157400 con 0x7fd9f40b9120 2020-05-18T21:29:50.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.693+0000 7fd9fc5ae700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f41576a0 con 0x7fd9f40b3af0 2020-05-18T21:29:50.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.693+0000 7fd9fab4b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd9f414a350 0x7fd9f4128d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58884/0 (socket says 172.21.15.63:58884) 2020-05-18T21:29:50.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.693+0000 7fd9fab4b700 1 -- 172.21.15.63:0/3484223999 learned_addr learned my addr 172.21.15.63:0/3484223999 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:50.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.693+0000 7fd9fa34a700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9f40b3af0 0x7fd9f4147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:50.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.693+0000 7fd9e77fe700 1 -- 172.21.15.63:0/3484223999 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459790522 0 0) 0x7fd9f4153ce0 con 0x7fd9f414a350 2020-05-18T21:29:50.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.693+0000 7fd9e77fe700 1 -- 172.21.15.63:0/3484223999 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9d4002fe0 con 0x7fd9f414a350 2020-05-18T21:29:50.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.693+0000 7fd9e77fe700 1 -- 172.21.15.63:0/3484223999 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3695765469 0 0) 0x7fd9f4157400 con 0x7fd9f40b9120 2020-05-18T21:29:50.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.693+0000 7fd9e77fe700 1 -- 172.21.15.63:0/3484223999 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9f4153ce0 con 0x7fd9f40b9120 2020-05-18T21:29:50.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.693+0000 7fd9fa34a700 1 -- 172.21.15.63:0/3484223999 >> v1:172.21.15.155:6789/0 conn(0x7fd9f40b9120 legacy=0x7fd9f4147e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:50.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.693+0000 7fd9fa34a700 1 -- 172.21.15.63:0/3484223999 >> v1:172.21.15.63:6789/0 conn(0x7fd9f414a350 legacy=0x7fd9f4128d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:50.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.693+0000 7fd9fa34a700 1 -- 172.21.15.63:0/3484223999 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f40aeba0 con 0x7fd9f40b3af0 2020-05-18T21:29:50.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.693+0000 7fd9fa34a700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9f40b3af0 0x7fd9f4147990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd9e8002f70 tx=0x7fd9e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:50.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.693+0000 7fd9fa34a700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9f40b3af0 0x7fd9f4147990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd9e8002f70 tx=0x7fd9e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:50.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.693+0000 7fd9fa34a700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9f40b3af0 0x7fd9f4147990 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7fd9e8002f70 tx=0x7fd9e8007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:50.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.693+0000 7fd9fa34a700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9f40b3af0 0x7fd9f4147990 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fd9e8002f70 tx=0x7fd9e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:50.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.697+0000 7fd9e77fe700 1 -- 172.21.15.63:0/3484223999 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9e8007360 con 0x7fd9f40b3af0 2020-05-18T21:29:50.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.697+0000 7fd9fa34a700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9f40b3af0 0x7fd9f4147990 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fd9e8002f70 tx=0x7fd9e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:50.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.697+0000 7fd9e77fe700 1 -- 172.21.15.63:0/3484223999 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e80074c0 con 0x7fd9f40b3af0 2020-05-18T21:29:50.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.697+0000 7fd9fc5ae700 1 -- 172.21.15.63:0/3484223999 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f4148540 con 0x7fd9f40b3af0 2020-05-18T21:29:50.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.697+0000 7fd9fa34a700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9f40b3af0 0x7fd9f4147990 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fd9e8002f70 tx=0x7fd9e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:50.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.697+0000 7fd9e77fe700 1 -- 172.21.15.63:0/3484223999 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9e8007630 con 0x7fd9f40b3af0 2020-05-18T21:29:50.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.697+0000 7fd9fc5ae700 1 -- 172.21.15.63:0/3484223999 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f41295e0 con 0x7fd9f40b3af0 2020-05-18T21:29:50.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.697+0000 7fd9fa34a700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9f40b3af0 0x7fd9f4147990 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fd9e8002f70 tx=0x7fd9e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:50.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.697+0000 7fd9e77fe700 1 -- 172.21.15.63:0/3484223999 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd9e80058f0 con 0x7fd9f40b3af0 2020-05-18T21:29:50.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.697+0000 7fd9fa34a700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9f40b3af0 0x7fd9f4147990 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fd9e8002f70 tx=0x7fd9e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:50.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.697+0000 7fd9fc5ae700 1 -- 172.21.15.63:0/3484223999 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f40569e0 con 0x7fd9f40b3af0 2020-05-18T21:29:50.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.697+0000 7fd9e77fe700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd9d404feb0 0x7fd9d4052370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:50.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.697+0000 7fd9e77fe700 1 -- 172.21.15.63:0/3484223999 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd9e8064330 con 0x7fd9f40b3af0 2020-05-18T21:29:50.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.697+0000 7fd9f9b49700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd9d404feb0 0x7fd9d4052370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:50.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.697+0000 7fd9f9b49700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd9d404feb0 0x7fd9d4052370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd9f0001040 tx=0x7fd9f00015d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:50.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.697+0000 7fd9f9b49700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd9d404feb0 0x7fd9d4052370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd9f0001040 tx=0x7fd9f00015d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:50.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.697+0000 7fd9f9b49700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd9d404feb0 0x7fd9d4052370 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7fd9f0001040 tx=0x7fd9f00015d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:50.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.705+0000 7fd9fa34a700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9f40b3af0 0x7fd9f4147990 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fd9e8002f70 tx=0x7fd9e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:50.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.705+0000 7fd9e77fe700 1 -- 172.21.15.63:0/3484223999 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd9e803e7e0 con 0x7fd9f40b3af0 2020-05-18T21:29:50.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.857+0000 7fd9fc5ae700 1 -- 172.21.15.63:0/3484223999 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9f412f310 con 0x7fd9f40b3af0 2020-05-18T21:29:50.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.861+0000 7fd9fa34a700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9f40b3af0 0x7fd9f4147990 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fd9e8002f70 tx=0x7fd9e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:50.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.861+0000 7fd9e77fe700 1 -- 172.21.15.63:0/3484223999 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2141 (secure 0 0 0) 0x7fd9e8041e00 con 0x7fd9f40b3af0 2020-05-18T21:29:50.866 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:50.867 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/3895568247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3895568247},{"type":"v1","addr":"172.21.15.63:6833","nonce":3895568247}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:24.694515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6319":{"gid":6319,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/400120989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":400120989},{"type":"v1","addr":"172.21.15.155:6835","nonce":400120989}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:50.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.861+0000 7fd9fc5ae700 1 -- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd9d404feb0 msgr2=0x7fd9d4052370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:50.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.861+0000 7fd9fc5ae700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd9d404feb0 0x7fd9d4052370 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7fd9f0001040 tx=0x7fd9f00015d0).stop 2020-05-18T21:29:50.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.861+0000 7fd9fc5ae700 1 -- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9f40b3af0 msgr2=0x7fd9f4147990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:50.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.861+0000 7fd9fc5ae700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9f40b3af0 0x7fd9f4147990 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7fd9e8002f70 tx=0x7fd9e8007a80).stop 2020-05-18T21:29:50.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.861+0000 7fd9fc5ae700 1 -- 172.21.15.63:0/3484223999 shutdown_connections 2020-05-18T21:29:50.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.861+0000 7fd9fc5ae700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd9d404feb0 0x7fd9d4052370 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:50.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.861+0000 7fd9fc5ae700 1 --2- 172.21.15.63:0/3484223999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9f40b3af0 0x7fd9f4147990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:50.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.861+0000 7fd9fc5ae700 1 -- 172.21.15.63:0/3484223999 >> 172.21.15.63:0/3484223999 conn(0x7fd9f405b290 msgr2=0x7fd9f40b6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:50.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.861+0000 7fd9fc5ae700 1 -- 172.21.15.63:0/3484223999 shutdown_connections 2020-05-18T21:29:50.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:50.861+0000 7fd9fc5ae700 1 -- 172.21.15.63:0/3484223999 wait complete. 2020-05-18T21:29:50.872 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 34 2020-05-18T21:29:50.878 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2020-05-18T21:29:51.008 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:29:51.009 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2020-05-18T21:29:51.009 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 1830, 2020-05-18T21:29:51.009 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 1837, 2020-05-18T21:29:51.010 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 699127, 2020-05-18T21:29:51.010 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 9986991, 2020-05-18T21:29:51.010 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 7, 2020-05-18T21:29:51.010 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 1, 2020-05-18T21:29:51.010 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.169740591, 2020-05-18T21:29:51.011 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.078752252, 2020-05-18T21:29:51.011 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.031151570, 2020-05-18T21:29:51.011 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.046517239, 2020-05-18T21:29:51.011 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:51.011 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1836, 2020-05-18T21:29:51.012 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.091778741, 2020-05-18T21:29:51.012 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000049988 2020-05-18T21:29:51.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.012 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:51.012 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.012 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.013 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.013 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:51.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.013 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2020-05-18T21:29:51.014 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 640, 2020-05-18T21:29:51.014 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 648, 2020-05-18T21:29:51.014 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 154623, 2020-05-18T21:29:51.014 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 6789041, 2020-05-18T21:29:51.014 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 6, 2020-05-18T21:29:51.015 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 3, 2020-05-18T21:29:51.015 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.092173749, 2020-05-18T21:29:51.015 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.052625793, 2020-05-18T21:29:51.015 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.015418891, 2020-05-18T21:29:51.015 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.020184326, 2020-05-18T21:29:51.015 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:51.016 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 648, 2020-05-18T21:29:51.016 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.041922706, 2020-05-18T21:29:51.016 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000064695 2020-05-18T21:29:51.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.016 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:51.017 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.017 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.017 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.017 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:51.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.017 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2020-05-18T21:29:51.018 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 9821, 2020-05-18T21:29:51.018 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 21355, 2020-05-18T21:29:51.018 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 3057108, 2020-05-18T21:29:51.018 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 13865861, 2020-05-18T21:29:51.018 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 4, 2020-05-18T21:29:51.019 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 2, 2020-05-18T21:29:51.019 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 1.366428462, 2020-05-18T21:29:51.019 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.604927040, 2020-05-18T21:29:51.019 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.881140135, 2020-05-18T21:29:51.019 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.007487481, 2020-05-18T21:29:51.020 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:51.020 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 21355, 2020-05-18T21:29:51.020 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.607408780, 2020-05-18T21:29:51.020 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000028443 2020-05-18T21:29:51.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.021 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:51.021 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 28014, 2020-05-18T21:29:51.021 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.007981501, 2020-05-18T21:29:51.021 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000284 2020-05-18T21:29:51.021 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:51.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.022 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2020-05-18T21:29:51.022 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2020-05-18T21:29:51.022 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2020-05-18T21:29:51.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.023 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2020-05-18T21:29:51.023 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:51.023 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:51.023 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 185, 2020-05-18T21:29:51.023 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 3.620247856, 2020-05-18T21:29:51.024 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.019568907 2020-05-18T21:29:51.024 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:51.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.024 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2020-05-18T21:29:51.024 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:51.025 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:51.025 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2170, 2020-05-18T21:29:51.025 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.495725084, 2020-05-18T21:29:51.025 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000228444 2020-05-18T21:29:51.025 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:51.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.026 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2020-05-18T21:29:51.026 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 6217, 2020-05-18T21:29:51.026 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 6214, 2020-05-18T21:29:51.026 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2020-05-18T21:29:51.027 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 6214, 2020-05-18T21:29:51.027 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 12.528768773, 2020-05-18T21:29:51.027 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.002016216 2020-05-18T21:29:51.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.027 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 0, 2020-05-18T21:29:51.027 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch": 12, 2020-05-18T21:29:51.028 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 74, 2020-05-18T21:29:51.028 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 9, 2020-05-18T21:29:51.028 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 1, 2020-05-18T21:29:51.028 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 1433, 2020-05-18T21:29:51.028 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 0, 2020-05-18T21:29:51.028 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 1433, 2020-05-18T21:29:51.029 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 0, 2020-05-18T21:29:51.029 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 1433, 2020-05-18T21:29:51.029 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 1594, 2020-05-18T21:29:51.029 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 1094, 2020-05-18T21:29:51.029 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1094, 2020-05-18T21:29:51.030 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 2, 2020-05-18T21:29:51.030 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 6227, 2020-05-18T21:29:51.030 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 6216, 2020-05-18T21:29:51.030 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 0, 2020-05-18T21:29:51.030 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 0, 2020-05-18T21:29:51.031 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2020-05-18T21:29:51.031 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2020-05-18T21:29:51.031 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 0, 2020-05-18T21:29:51.031 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 657556, 2020-05-18T21:29:51.031 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2020-05-18T21:29:51.031 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 0, 2020-05-18T21:29:51.032 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 0, 2020-05-18T21:29:51.032 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 0, 2020-05-18T21:29:51.032 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 0, 2020-05-18T21:29:51.032 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2020-05-18T21:29:51.032 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 0, 2020-05-18T21:29:51.033 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2020-05-18T21:29:51.033 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 1929, 2020-05-18T21:29:51.033 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 14896128, 2020-05-18T21:29:51.033 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 0 2020-05-18T21:29:51.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.034 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:29:51.034 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 417, 2020-05-18T21:29:51.034 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 0, 2020-05-18T21:29:51.034 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:29:51.034 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 2945, 2020-05-18T21:29:51.035 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 2528, 2020-05-18T21:29:51.035 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2020-05-18T21:29:51.035 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2020-05-18T21:29:51.035 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2020-05-18T21:29:51.035 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:29:51.036 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:29:51.036 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2020-05-18T21:29:51.036 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2020-05-18T21:29:51.036 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:29:51.036 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 0, 2020-05-18T21:29:51.037 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2020-05-18T21:29:51.037 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 10, 2020-05-18T21:29:51.037 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2020-05-18T21:29:51.037 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2020-05-18T21:29:51.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.038 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2020-05-18T21:29:51.038 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 11924, 2020-05-18T21:29:51.038 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 0, 2020-05-18T21:29:51.038 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 0, 2020-05-18T21:29:51.038 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 11926, 2020-05-18T21:29:51.038 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 0, 2020-05-18T21:29:51.039 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 0, 2020-05-18T21:29:51.039 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 14, 2020-05-18T21:29:51.039 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 0, 2020-05-18T21:29:51.039 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 0, 2020-05-18T21:29:51.039 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 15, 2020-05-18T21:29:51.040 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 0, 2020-05-18T21:29:51.040 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 0, 2020-05-18T21:29:51.040 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 4194304, 2020-05-18T21:29:51.040 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 27195815, 2020-05-18T21:29:51.040 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 4195196, 2020-05-18T21:29:51.041 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2020-05-18T21:29:51.041 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 38, 2020-05-18T21:29:51.041 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.330515519, 2020-05-18T21:29:51.041 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.008697776 2020-05-18T21:29:51.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.041 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 2 2020-05-18T21:29:51.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.042 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2020-05-18T21:29:51.042 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1436, 2020-05-18T21:29:51.042 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 3214, 2020-05-18T21:29:51.043 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 1778, 2020-05-18T21:29:51.043 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 45, 2020-05-18T21:29:51.043 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 86, 2020-05-18T21:29:51.043 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 41, 2020-05-18T21:29:51.043 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 2783, 2020-05-18T21:29:51.044 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 6155, 2020-05-18T21:29:51.044 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 3372, 2020-05-18T21:29:51.044 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 674, 2020-05-18T21:29:51.044 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 3202, 2020-05-18T21:29:51.044 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 2528, 2020-05-18T21:29:51.044 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 78152, 2020-05-18T21:29:51.045 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 331932 2020-05-18T21:29:51.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.045 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2020-05-18T21:29:51.045 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 6294, 2020-05-18T21:29:51.045 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 0, 2020-05-18T21:29:51.046 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 6217, 2020-05-18T21:29:51.046 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 2, 2020-05-18T21:29:51.046 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_slave_request": 0, 2020-05-18T21:29:51.046 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2020-05-18T21:29:51.046 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3200, 2020-05-18T21:29:51.046 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 5.456048806, 2020-05-18T21:29:51.047 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001705015 2020-05-18T21:29:51.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.047 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2020-05-18T21:29:51.047 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2, 2020-05-18T21:29:51.047 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.078760379, 2020-05-18T21:29:51.048 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.039380189 2020-05-18T21:29:51.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.048 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2020-05-18T21:29:51.048 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.048 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.048 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.049 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2020-05-18T21:29:51.049 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.049 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.049 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.050 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2020-05-18T21:29:51.050 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.050 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.050 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.051 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2020-05-18T21:29:51.051 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.051 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.051 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.052 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2020-05-18T21:29:51.052 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.052 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.052 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.053 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2020-05-18T21:29:51.053 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.053 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.053 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.054 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2020-05-18T21:29:51.054 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.054 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.054 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.055 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2020-05-18T21:29:51.055 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.055 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.055 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.055 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2020-05-18T21:29:51.056 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.056 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.056 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.056 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2020-05-18T21:29:51.056 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1, 2020-05-18T21:29:51.057 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.006614312, 2020-05-18T21:29:51.057 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.006614312 2020-05-18T21:29:51.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.057 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2020-05-18T21:29:51.057 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.058 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.058 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.058 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2020-05-18T21:29:51.058 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.058 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.059 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.059 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2020-05-18T21:29:51.059 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.059 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.060 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.060 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.060 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2020-05-18T21:29:51.060 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 67, 2020-05-18T21:29:51.060 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.349282571, 2020-05-18T21:29:51.060 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.005213172 2020-05-18T21:29:51.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.061 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2020-05-18T21:29:51.061 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.061 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.061 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.062 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2020-05-18T21:29:51.062 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.062 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.063 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.063 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2020-05-18T21:29:51.063 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.063 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.064 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.064 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2020-05-18T21:29:51.064 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.064 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.065 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.065 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2020-05-18T21:29:51.065 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.065 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.066 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.066 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2020-05-18T21:29:51.066 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.066 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.067 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.067 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2020-05-18T21:29:51.067 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.067 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.068 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.068 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2020-05-18T21:29:51.068 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.069 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.069 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.069 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2020-05-18T21:29:51.070 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.070 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.070 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.070 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2020-05-18T21:29:51.071 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.071 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.071 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.072 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2020-05-18T21:29:51.072 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.072 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.072 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.073 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2020-05-18T21:29:51.073 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2944, 2020-05-18T21:29:51.073 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 6.638062705, 2020-05-18T21:29:51.073 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.002254776 2020-05-18T21:29:51.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.074 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0 2020-05-18T21:29:51.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.074 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2020-05-18T21:29:51.074 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 1, 2020-05-18T21:29:51.074 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 1, 2020-05-18T21:29:51.075 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 0, 2020-05-18T21:29:51.075 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 1, 2020-05-18T21:29:51.075 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2020-05-18T21:29:51.075 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 5424, 2020-05-18T21:29:51.075 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 5424, 2020-05-18T21:29:51.075 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 558 2020-05-18T21:29:51.076 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.076 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2020-05-18T21:29:51.076 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 120, 2020-05-18T21:29:51.076 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 120, 2020-05-18T21:29:51.076 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2020-05-18T21:29:51.077 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2020-05-18T21:29:51.077 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2020-05-18T21:29:51.077 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2020-05-18T21:29:51.077 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2020-05-18T21:29:51.077 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2020-05-18T21:29:51.078 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2020-05-18T21:29:51.078 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2020-05-18T21:29:51.078 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2020-05-18T21:29:51.078 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2020-05-18T21:29:51.078 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2020-05-18T21:29:51.079 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2020-05-18T21:29:51.079 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2020-05-18T21:29:51.079 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2020-05-18T21:29:51.079 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2020-05-18T21:29:51.079 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2020-05-18T21:29:51.080 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2020-05-18T21:29:51.080 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2020-05-18T21:29:51.080 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 1830554, 2020-05-18T21:29:51.080 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 595, 2020-05-18T21:29:51.080 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2020-05-18T21:29:51.081 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2020-05-18T21:29:51.081 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2020-05-18T21:29:51.081 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2020-05-18T21:29:51.081 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2020-05-18T21:29:51.082 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2020-05-18T21:29:51.082 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2020-05-18T21:29:51.082 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2020-05-18T21:29:51.082 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 6128, 2020-05-18T21:29:51.082 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 93, 2020-05-18T21:29:51.083 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2020-05-18T21:29:51.083 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2020-05-18T21:29:51.083 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2020-05-18T21:29:51.083 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2020-05-18T21:29:51.084 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 4986614, 2020-05-18T21:29:51.084 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 58290, 2020-05-18T21:29:51.084 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2020-05-18T21:29:51.084 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2020-05-18T21:29:51.084 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2020-05-18T21:29:51.084 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2020-05-18T21:29:51.085 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.085 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2020-05-18T21:29:51.085 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 6, 2020-05-18T21:29:51.085 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2020-05-18T21:29:51.085 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 2557, 2020-05-18T21:29:51.086 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 22493128, 2020-05-18T21:29:51.086 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 0, 2020-05-18T21:29:51.086 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 2551, 2020-05-18T21:29:51.086 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 2557, 2020-05-18T21:29:51.086 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 44, 2020-05-18T21:29:51.086 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 2513, 2020-05-18T21:29:51.087 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2020-05-18T21:29:51.087 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2020-05-18T21:29:51.087 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 2, 2020-05-18T21:29:51.087 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 0, 2020-05-18T21:29:51.087 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 26, 2020-05-18T21:29:51.087 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 56, 2020-05-18T21:29:51.088 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 8, 2020-05-18T21:29:51.088 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2020-05-18T21:29:51.088 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2020-05-18T21:29:51.088 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 1, 2020-05-18T21:29:51.088 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 1, 2020-05-18T21:29:51.089 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 2367, 2020-05-18T21:29:51.089 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2020-05-18T21:29:51.089 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2020-05-18T21:29:51.089 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2020-05-18T21:29:51.089 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 14, 2020-05-18T21:29:51.090 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 0, 2020-05-18T21:29:51.090 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2020-05-18T21:29:51.090 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2020-05-18T21:29:51.090 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2020-05-18T21:29:51.090 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2020-05-18T21:29:51.091 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2020-05-18T21:29:51.091 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2020-05-18T21:29:51.091 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2020-05-18T21:29:51.091 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2020-05-18T21:29:51.091 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2020-05-18T21:29:51.092 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 0, 2020-05-18T21:29:51.092 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2020-05-18T21:29:51.092 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2020-05-18T21:29:51.092 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2020-05-18T21:29:51.093 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2020-05-18T21:29:51.093 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2020-05-18T21:29:51.093 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2020-05-18T21:29:51.093 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2020-05-18T21:29:51.093 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2020-05-18T21:29:51.093 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2020-05-18T21:29:51.094 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2020-05-18T21:29:51.094 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2020-05-18T21:29:51.094 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2020-05-18T21:29:51.094 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2020-05-18T21:29:51.094 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2020-05-18T21:29:51.095 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2020-05-18T21:29:51.095 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2020-05-18T21:29:51.095 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 0, 2020-05-18T21:29:51.095 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2020-05-18T21:29:51.095 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 0, 2020-05-18T21:29:51.096 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 7, 2020-05-18T21:29:51.096 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 7, 2020-05-18T21:29:51.096 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2020-05-18T21:29:51.096 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2020-05-18T21:29:51.096 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 157, 2020-05-18T21:29:51.096 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 28, 2020-05-18T21:29:51.097 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 5 2020-05-18T21:29:51.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.097 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2020-05-18T21:29:51.097 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 0, 2020-05-18T21:29:51.097 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2020-05-18T21:29:51.098 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2020-05-18T21:29:51.098 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2020-05-18T21:29:51.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.098 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2020-05-18T21:29:51.098 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 12, 2020-05-18T21:29:51.099 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 12, 2020-05-18T21:29:51.099 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 6, 2020-05-18T21:29:51.099 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 6, 2020-05-18T21:29:51.099 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 2305, 2020-05-18T21:29:51.099 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 223 2020-05-18T21:29:51.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.100 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-05-18T21:29:51.100 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 240, 2020-05-18T21:29:51.100 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:51.100 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:51.100 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 12284, 2020-05-18T21:29:51.101 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 2999715, 2020-05-18T21:29:51.101 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:51.101 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 12284, 2020-05-18T21:29:51.101 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:51.102 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:51.102 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 12283, 2020-05-18T21:29:51.102 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 2999475, 2020-05-18T21:29:51.102 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:51.102 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.102 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.103 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.103 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:51.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.103 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2020-05-18T21:29:51.103 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:51.104 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:51.104 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:51.104 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:51.104 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:51.104 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:51.104 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:51.105 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 2557, 2020-05-18T21:29:51.105 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 22749562, 2020-05-18T21:29:51.105 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 177, 2020-05-18T21:29:51.105 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 22749562, 2020-05-18T21:29:51.105 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:51.106 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.106 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.106 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.106 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:51.106 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.106 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2020-05-18T21:29:51.107 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 6, 2020-05-18T21:29:51.107 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2020-05-18T21:29:51.107 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:51.107 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:51.107 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:51.108 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:51.108 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:51.108 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 2557, 2020-05-18T21:29:51.108 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 2557, 2020-05-18T21:29:51.108 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 2551, 2020-05-18T21:29:51.108 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 2551, 2020-05-18T21:29:51.109 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:51.109 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.109 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.109 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.109 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:51.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.110 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2020-05-18T21:29:51.110 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:51.110 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:51.110 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:51.111 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 2528, 2020-05-18T21:29:51.111 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 255328, 2020-05-18T21:29:51.111 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:51.111 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 2528, 2020-05-18T21:29:51.111 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:51.111 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:51.112 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 18, 2020-05-18T21:29:51.112 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 255328, 2020-05-18T21:29:51.112 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:51.112 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.112 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.113 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.113 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:51.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:51.113 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x558953fdfd60": { 2020-05-18T21:29:51.113 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 1752845, 2020-05-18T21:29:51.114 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:51.114 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:51.114 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 11924, 2020-05-18T21:29:51.114 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 23000181, 2020-05-18T21:29:51.114 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:51.115 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 11924, 2020-05-18T21:29:51.115 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:51.115 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:51.115 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 38, 2020-05-18T21:29:51.115 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 21247336, 2020-05-18T21:29:51.116 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:51.116 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:51.116 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:51.116 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:51.116 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:51.116 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:51.117 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:29:51.118 INFO:tasks.cephfs.filesystem:_json_asok output: { "AsyncMessenger::Worker-0": { "msgr_recv_messages": 1830, "msgr_send_messages": 1837, "msgr_recv_bytes": 699127, "msgr_send_bytes": 9986991, "msgr_created_connections": 7, "msgr_active_connections": 1, "msgr_running_total_time": 0.169740591, "msgr_running_send_time": 0.078752252, "msgr_running_recv_time": 0.031151570, "msgr_running_fast_dispatch_time": 0.046517239, "msgr_send_messages_queue_lat": { "avgcount": 1836, "sum": 0.091778741, "avgtime": 0.000049988 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-1": { "msgr_recv_messages": 640, "msgr_send_messages": 648, "msgr_recv_bytes": 154623, "msgr_send_bytes": 6789041, "msgr_created_connections": 6, "msgr_active_connections": 3, "msgr_running_total_time": 0.092173749, "msgr_running_send_time": 0.052625793, "msgr_running_recv_time": 0.015418891, "msgr_running_fast_dispatch_time": 0.020184326, "msgr_send_messages_queue_lat": { "avgcount": 648, "sum": 0.041922706, "avgtime": 0.000064695 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-2": { "msgr_recv_messages": 9821, "msgr_send_messages": 21355, "msgr_recv_bytes": 3057108, "msgr_send_bytes": 13865861, "msgr_created_connections": 4, "msgr_active_connections": 2, "msgr_running_total_time": 1.366428462, "msgr_running_send_time": 0.604927040, "msgr_running_recv_time": 0.881140135, "msgr_running_fast_dispatch_time": 0.007487481, "msgr_send_messages_queue_lat": { "avgcount": 21355, "sum": 0.607408780, "avgtime": 0.000028443 }, "msgr_handle_ack_lat": { "avgcount": 28014, "sum": 0.007981501, "avgtime": 0.000000284 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "queue_len": 0, "complete_latency": { "avgcount": 185, "sum": 3.620247856, "avgtime": 0.019568907 } }, "finisher-PurgeQueue": { "queue_len": 0, "complete_latency": { "avgcount": 2170, "sum": 0.495725084, "avgtime": 0.000228444 } }, "mds": { "request": 6217, "reply": 6214, "reply_latency": { "avgcount": 6214, "sum": 12.528768773, "avgtime": 0.002016216 }, "forward": 0, "dir_fetch": 12, "dir_commit": 74, "dir_split": 9, "dir_merge": 1, "inodes": 1433, "inodes_top": 0, "inodes_bottom": 1433, "inodes_pin_tail": 0, "inodes_pinned": 1433, "inodes_expired": 1594, "inodes_with_caps": 1094, "caps": 1094, "subtrees": 2, "traverse": 6227, "traverse_hit": 6216, "traverse_forward": 0, "traverse_discover": 0, "traverse_dir_fetch": 0, "traverse_remote_ino": 0, "traverse_lock": 0, "load_cent": 657556, "q": 0, "exported": 0, "exported_inodes": 0, "imported": 0, "imported_inodes": 0, "openino_dir_fetch": 0, "openino_backtrace_fetch": 0, "openino_peer_discover": 0, "root_rfiles": 1929, "root_rbytes": 14896128, "root_rsnaps": 0 }, "mds_cache": { "num_strays": 417, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "strays_created": 2945, "strays_enqueued": 2528, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 10, "ireq_fragstats": 0, "ireq_inodestats": 0 }, "mds_log": { "evadd": 11924, "evex": 0, "evtrm": 0, "ev": 11926, "evexg": 0, "evexd": 0, "segadd": 14, "segex": 0, "segtrm": 0, "seg": 15, "segexg": 0, "segexd": 0, "expos": 4194304, "wrpos": 27195815, "rdpos": 4195196, "jlat": { "avgcount": 38, "sum": 0.330515519, "avgtime": 0.008697776 }, "replayed": 2 }, "mds_mem": { "ino": 1436, "ino+": 3214, "ino-": 1778, "dir": 45, "dir+": 86, "dir-": 41, "dn": 2783, "dn+": 6155, "dn-": 3372, "cap": 674, "cap+": 3202, "cap-": 2528, "rss": 78152, "heap": 331932 }, "mds_server": { "dispatch_client_request": 6294, "dispatch_server_request": 0, "handle_client_request": 6217, "handle_client_session": 2, "handle_slave_request": 0, "req_create_latency": { "avgcount": 3200, "sum": 5.456048806, "avgtime": 0.001705015 }, "req_getattr_latency": { "avgcount": 2, "sum": 0.078760379, "avgtime": 0.039380189 }, "req_getfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_link_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookup_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookuphash_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupino_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupname_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupparent_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lssnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mkdir_latency": { "avgcount": 1, "sum": 0.006614312, "avgtime": 0.006614312 }, "req_mknod_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mksnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_open_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_readdir_latency": { "avgcount": 67, "sum": 0.349282571, "avgtime": 0.005213172 }, "req_rename_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_renamesnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmdir_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setdirlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_symlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_unlink_latency": { "avgcount": 2944, "sum": 6.638062705, "avgtime": 0.002254776 }, "cap_revoke_eviction": 0 }, "mds_sessions": { "session_count": 1, "session_add": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 5424, "average_load": 5424, "avg_session_uptime": 558 }, "mempool": { "bloom_filter_bytes": 120, "bloom_filter_items": 120, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "buffer_anon_bytes": 1830554, "buffer_anon_items": 595, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6128, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 4986614, "mds_co_items": 58290, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "op_active": 6, "op_laggy": 0, "op_send": 2557, "op_send_bytes": 22493128, "op_resend": 0, "op_reply": 2551, "op": 2557, "op_r": 44, "op_w": 2513, "op_rmw": 0, "op_pg": 0, "osdop_stat": 2, "osdop_create": 0, "osdop_read": 26, "osdop_write": 56, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 1, "osdop_truncate": 1, "osdop_delete": 2367, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 14, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 7, "osd_session_open": 7, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 157, "omap_rd": 28, "omap_del": 5 }, "oft": { "omap_total_objs": 0, "omap_total_kv_pairs": 0, "omap_total_updates": 0, "omap_total_removes": 0 }, "purge_queue": { "pq_executing_ops": 12, "pq_executing_ops_high_water": 12, "pq_executing": 6, "pq_executing_high_water": 6, "pq_executed": 2305, "pq_item_in_journal": 223 }, "throttle-msgr_dispatch_throttler-mds": { "val": 240, "max": 104857600, "get_started": 0, "get": 12284, "get_sum": 2999715, "get_or_fail_fail": 0, "get_or_fail_success": 12284, "take": 0, "take_sum": 0, "put": 12283, "put_sum": 2999475, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_bytes": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 2557, "take_sum": 22749562, "put": 177, "put_sum": 22749562, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_ops": { "val": 6, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 2557, "take_sum": 2557, "put": 2551, "put_sum": 2551, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle": { "val": 0, "max": 3758096384, "get_started": 0, "get": 2528, "get_sum": 255328, "get_or_fail_fail": 0, "get_or_fail_success": 2528, "take": 0, "take_sum": 0, "put": 18, "put_sum": 255328, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle-0x558953fdfd60": { "val": 1752845, "max": 3758096384, "get_started": 0, "get": 11924, "get_sum": 23000181, "get_or_fail_fail": 0, "get_or_fail_success": 11924, "take": 0, "take_sum": 0, "put": 38, "put_sum": 21247336, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } 2020-05-18T21:29:51.119 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 6/417, 2305/2945 2020-05-18T21:29:52.124 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:52.194 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:52.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f038064b700 1 Processor -- start 2020-05-18T21:29:52.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f038064b700 1 -- start start 2020-05-18T21:29:52.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f038064b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f03780ba0d0 0x7f0378065f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:52.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f038064b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f037809f000 0x7f03780b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:52.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f038064b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03780b94c0 con 0x7f0378145c60 2020-05-18T21:29:52.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f038064b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0378146040 con 0x7f03780ba0d0 2020-05-18T21:29:52.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f038064b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03780b96f0 con 0x7f037809f000 2020-05-18T21:29:52.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037ebe8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f037809f000 0x7f03780b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:52.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037dbe6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f03780ba0d0 0x7f0378065f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:52.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037e3e7700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f0378145c60 0x7f03780bca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:57204/0 (socket says 172.21.15.63:57204) 2020-05-18T21:29:52.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037e3e7700 1 -- 172.21.15.63:0/2505851361 learned_addr learned my addr 172.21.15.63:0/2505851361 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:52.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037dbe6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f03780ba0d0 0x7f0378065f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:43318/0 (socket says 172.21.15.63:43318) 2020-05-18T21:29:52.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037ebe8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f037809f000 0x7f03780b80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:47406/0 (socket says 172.21.15.63:47406) 2020-05-18T21:29:52.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037d3e5700 1 -- 172.21.15.63:0/2505851361 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569586479 0 0) 0x7f03780b94c0 con 0x7f0378145c60 2020-05-18T21:29:52.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037d3e5700 1 -- 172.21.15.63:0/2505851361 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0364003270 con 0x7f0378145c60 2020-05-18T21:29:52.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037dbe6700 1 -- 172.21.15.63:0/2505851361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f037809f000 msgr2=0x7f03780b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:52.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037dbe6700 1 --2- 172.21.15.63:0/2505851361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f037809f000 0x7f03780b80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:52.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037dbe6700 1 -- 172.21.15.63:0/2505851361 >> v1:172.21.15.155:6789/0 conn(0x7f0378145c60 legacy=0x7f03780bca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:52.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037dbe6700 1 -- 172.21.15.63:0/2505851361 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03780b9990 con 0x7f03780ba0d0 2020-05-18T21:29:52.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037ebe8700 1 --2- 172.21.15.63:0/2505851361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f037809f000 0x7f03780b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:29:52.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037dbe6700 1 --2- 172.21.15.63:0/2505851361 >> v2:172.21.15.155:3300/0 conn(0x7f03780ba0d0 0x7f0378065f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f036c002f70 tx=0x7f0378060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037dbe6700 1 --2- 172.21.15.63:0/2505851361 >> v2:172.21.15.155:3300/0 conn(0x7f03780ba0d0 0x7f0378065f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f036c002f70 tx=0x7f0378060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037dbe6700 1 --2- 172.21.15.63:0/2505851361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03780ba0d0 0x7f0378065f00 secure :-1 s=READY pgs=551 cs=0 l=1 rx=0x7f036c002f70 tx=0x7f0378060a60).ready entity=mon.1 client_cookie=4e6d509e1bdb7eb7 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:52.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037dbe6700 1 --2- 172.21.15.63:0/2505851361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03780ba0d0 0x7f0378065f00 secure :-1 s=THROTTLE_DONE pgs=551 cs=0 l=1 rx=0x7f036c002f70 tx=0x7f0378060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037d3e5700 1 -- 172.21.15.63:0/2505851361 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f036c008e80 con 0x7f03780ba0d0 2020-05-18T21:29:52.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037dbe6700 1 --2- 172.21.15.63:0/2505851361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03780ba0d0 0x7f0378065f00 secure :-1 s=THROTTLE_DONE pgs=551 cs=0 l=1 rx=0x7f036c002f70 tx=0x7f0378060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037dbe6700 1 --2- 172.21.15.63:0/2505851361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03780ba0d0 0x7f0378065f00 secure :-1 s=THROTTLE_DONE pgs=551 cs=0 l=1 rx=0x7f036c002f70 tx=0x7f0378060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037d3e5700 1 -- 172.21.15.63:0/2505851361 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c011540 con 0x7f03780ba0d0 2020-05-18T21:29:52.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f037d3e5700 1 -- 172.21.15.63:0/2505851361 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f036c011920 con 0x7f03780ba0d0 2020-05-18T21:29:52.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f038064b700 1 -- 172.21.15.63:0/2505851361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03780ba0d0 msgr2=0x7f0378065f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:52.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.237+0000 7f038064b700 1 --2- 172.21.15.63:0/2505851361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03780ba0d0 0x7f0378065f00 secure :-1 s=READY pgs=551 cs=0 l=1 rx=0x7f036c002f70 tx=0x7f0378060a60).stop 2020-05-18T21:29:52.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.241+0000 7f038064b700 1 -- 172.21.15.63:0/2505851361 shutdown_connections 2020-05-18T21:29:52.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.241+0000 7f038064b700 1 --2- 172.21.15.63:0/2505851361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f037809f000 0x7f03780b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:52.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.241+0000 7f038064b700 1 --2- 172.21.15.63:0/2505851361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03780ba0d0 0x7f0378065f00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:52.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.241+0000 7f038064b700 1 -- 172.21.15.63:0/2505851361 >> 172.21.15.63:0/2505851361 conn(0x7f037805a7c0 msgr2=0x7f037805aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:52.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.241+0000 7f038064b700 1 -- 172.21.15.63:0/2505851361 shutdown_connections 2020-05-18T21:29:52.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.241+0000 7f038064b700 1 -- 172.21.15.63:0/2505851361 wait complete. 2020-05-18T21:29:52.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.241+0000 7f038064b700 1 Processor -- start 2020-05-18T21:29:52.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.241+0000 7f038064b700 1 -- start start 2020-05-18T21:29:52.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.241+0000 7f038064b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f037809f000 0x7f03780b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:52.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.241+0000 7f038064b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f03780ba0d0 0x7f03780a2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:52.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.241+0000 7f038064b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03780a25c0 con 0x7f0378145c60 2020-05-18T21:29:52.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.241+0000 7f038064b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0378157ac0 con 0x7f037809f000 2020-05-18T21:29:52.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.241+0000 7f038064b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0378153730 con 0x7f03780ba0d0 2020-05-18T21:29:52.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.241+0000 7f037e3e7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f037809f000 0x7f03780b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:52.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f037e3e7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f037809f000 0x7f03780b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56706/0 (socket says 172.21.15.63:56706) 2020-05-18T21:29:52.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f037e3e7700 1 -- 172.21.15.63:0/3103574074 learned_addr learned my addr 172.21.15.63:0/3103574074 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:52.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f037dbe6700 1 --2- 172.21.15.63:0/3103574074 >> v2:172.21.15.155:3300/0 conn(0x7f03780ba0d0 0x7f03780a2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:52.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f037e3e7700 1 -- 172.21.15.63:0/3103574074 >> v2:172.21.15.155:3300/0 conn(0x7f03780ba0d0 msgr2=0x7f03780a2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:52.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f037e3e7700 1 --2- 172.21.15.63:0/3103574074 >> v2:172.21.15.155:3300/0 conn(0x7f03780ba0d0 0x7f03780a2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:52.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f037e3e7700 1 -- 172.21.15.63:0/3103574074 >> v1:172.21.15.155:6789/0 conn(0x7f0378145c60 legacy=0x7f0378153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:52.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f037e3e7700 1 -- 172.21.15.63:0/3103574074 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03781545b0 con 0x7f037809f000 2020-05-18T21:29:52.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f037dbe6700 1 --2- 172.21.15.63:0/3103574074 >> v2:172.21.15.155:3300/0 conn(0x7f03780ba0d0 0x7f03780a2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:29:52.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f037e3e7700 1 --2- 172.21.15.63:0/3103574074 >> v2:172.21.15.63:3300/0 conn(0x7f037809f000 0x7f03780b2d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0368001490 tx=0x7f0368001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f037e3e7700 1 --2- 172.21.15.63:0/3103574074 >> v2:172.21.15.63:3300/0 conn(0x7f037809f000 0x7f03780b2d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0368001490 tx=0x7f0368001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f037e3e7700 1 --2- 172.21.15.63:0/3103574074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f037809f000 0x7f03780b2d70 secure :-1 s=READY pgs=777 cs=0 l=1 rx=0x7f0368001490 tx=0x7f0368001780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:52.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f037e3e7700 1 --2- 172.21.15.63:0/3103574074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f037809f000 0x7f03780b2d70 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f0368001490 tx=0x7f0368001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f037e3e7700 1 --2- 172.21.15.63:0/3103574074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f037809f000 0x7f03780b2d70 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f0368001490 tx=0x7f0368001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f03777fe700 1 -- 172.21.15.63:0/3103574074 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0368010470 con 0x7f037809f000 2020-05-18T21:29:52.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f037e3e7700 1 --2- 172.21.15.63:0/3103574074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f037809f000 0x7f03780b2d70 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f0368001490 tx=0x7f0368001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f03777fe700 1 -- 172.21.15.63:0/3103574074 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03680105d0 con 0x7f037809f000 2020-05-18T21:29:52.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f038064b700 1 -- 172.21.15.63:0/3103574074 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0378157740 con 0x7f037809f000 2020-05-18T21:29:52.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f03777fe700 1 -- 172.21.15.63:0/3103574074 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0368012470 con 0x7f037809f000 2020-05-18T21:29:52.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f038064b700 1 -- 172.21.15.63:0/3103574074 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03780b55b0 con 0x7f037809f000 2020-05-18T21:29:52.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f037e3e7700 1 --2- 172.21.15.63:0/3103574074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f037809f000 0x7f03780b2d70 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f0368001490 tx=0x7f0368001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f038064b700 1 -- 172.21.15.63:0/3103574074 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0378153870 con 0x7f037809f000 2020-05-18T21:29:52.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f03777fe700 1 -- 172.21.15.63:0/3103574074 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f03680059a0 con 0x7f037809f000 2020-05-18T21:29:52.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f037e3e7700 1 --2- 172.21.15.63:0/3103574074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f037809f000 0x7f03780b2d70 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f0368001490 tx=0x7f0368001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f03777fe700 1 --2- 172.21.15.63:0/3103574074 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f035804fa60 0x7f0358051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:52.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f03777fe700 1 -- 172.21.15.63:0/3103574074 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f03680100c0 con 0x7f037809f000 2020-05-18T21:29:52.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.245+0000 7f037dbe6700 1 --2- 172.21.15.63:0/3103574074 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f035804fa60 0x7f0358051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:52.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.249+0000 7f037dbe6700 1 --2- 172.21.15.63:0/3103574074 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f035804fa60 0x7f0358051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f036c002f70 tx=0x7f0378060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.249+0000 7f037dbe6700 1 --2- 172.21.15.63:0/3103574074 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f035804fa60 0x7f0358051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f036c002f70 tx=0x7f0378060a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.249+0000 7f037dbe6700 1 --2- 172.21.15.63:0/3103574074 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f035804fa60 0x7f0358051f20 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7f036c002f70 tx=0x7f0378060a60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:52.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.253+0000 7f037e3e7700 1 --2- 172.21.15.63:0/3103574074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f037809f000 0x7f03780b2d70 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f0368001490 tx=0x7f0368001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.253+0000 7f03777fe700 1 -- 172.21.15.63:0/3103574074 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f036803e0d0 con 0x7f037809f000 2020-05-18T21:29:52.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.285+0000 7fc1f9cc5700 1 Processor -- start 2020-05-18T21:29:52.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.285+0000 7fc1f9cc5700 1 -- start start 2020-05-18T21:29:52.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.285+0000 7fc1f9cc5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1f4145b60 0x7fc1f409ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:52.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.285+0000 7fc1f9cc5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc1f40b4860 0x7fc1f405fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:52.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.285+0000 7fc1f9cc5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f40b43b0 con 0x7fc1f405ffe0 2020-05-18T21:29:52.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.285+0000 7fc1f9cc5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f405f6e0 con 0x7fc1f40b4860 2020-05-18T21:29:52.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.285+0000 7fc1f9cc5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f4145f40 con 0x7fc1f4145b60 2020-05-18T21:29:52.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.285+0000 7fc1f2ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc1f40b4860 0x7fc1f405fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:52.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.285+0000 7fc1f3fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc1f405ffe0 0x7fc1f40b38b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58902/0 (socket says 172.21.15.63:58902) 2020-05-18T21:29:52.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.285+0000 7fc1f3fff700 1 -- 172.21.15.63:0/2659819484 learned_addr learned my addr 172.21.15.63:0/2659819484 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:52.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.285+0000 7fc1f37fe700 1 --2- 172.21.15.63:0/2659819484 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1f4145b60 0x7fc1f409ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:52.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f2ffd700 1 -- 172.21.15.63:0/2659819484 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1f4145b60 msgr2=0x7fc1f409ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:52.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f2ffd700 1 --2- 172.21.15.63:0/2659819484 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1f4145b60 0x7fc1f409ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:52.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f2ffd700 1 -- 172.21.15.63:0/2659819484 >> v1:172.21.15.63:6789/0 conn(0x7fc1f405ffe0 legacy=0x7fc1f40b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:52.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f2ffd700 1 -- 172.21.15.63:0/2659819484 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f405bc90 con 0x7fc1f40b4860 2020-05-18T21:29:52.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f2ffd700 1 --2- 172.21.15.63:0/2659819484 >> v2:172.21.15.63:3300/0 conn(0x7fc1f40b4860 0x7fc1f405fb80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc1e8002f70 tx=0x7fc1e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f2ffd700 1 --2- 172.21.15.63:0/2659819484 >> v2:172.21.15.63:3300/0 conn(0x7fc1f40b4860 0x7fc1f405fb80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc1e8002f70 tx=0x7fc1e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f2ffd700 1 --2- 172.21.15.63:0/2659819484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1f40b4860 0x7fc1f405fb80 secure :-1 s=READY pgs=779 cs=0 l=1 rx=0x7fc1e8002f70 tx=0x7fc1e8007a80).ready entity=mon.0 client_cookie=5211f0a4e755597a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:52.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f2ffd700 1 --2- 172.21.15.63:0/2659819484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1f40b4860 0x7fc1f405fb80 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7fc1e8002f70 tx=0x7fc1e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f27fc700 1 -- 172.21.15.63:0/2659819484 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1e8008e80 con 0x7fc1f40b4860 2020-05-18T21:29:52.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f2ffd700 1 --2- 172.21.15.63:0/2659819484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1f40b4860 0x7fc1f405fb80 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7fc1e8002f70 tx=0x7fc1e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f2ffd700 1 --2- 172.21.15.63:0/2659819484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1f40b4860 0x7fc1f405fb80 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7fc1e8002f70 tx=0x7fc1e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f27fc700 1 -- 172.21.15.63:0/2659819484 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e80115f0 con 0x7fc1f40b4860 2020-05-18T21:29:52.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f27fc700 1 -- 172.21.15.63:0/2659819484 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1e8011a10 con 0x7fc1f40b4860 2020-05-18T21:29:52.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f9cc5700 1 -- 172.21.15.63:0/2659819484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1f40b4860 msgr2=0x7fc1f405fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:52.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f9cc5700 1 --2- 172.21.15.63:0/2659819484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1f40b4860 0x7fc1f405fb80 secure :-1 s=READY pgs=779 cs=0 l=1 rx=0x7fc1e8002f70 tx=0x7fc1e8007a80).stop 2020-05-18T21:29:52.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f9cc5700 1 -- 172.21.15.63:0/2659819484 shutdown_connections 2020-05-18T21:29:52.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f9cc5700 1 --2- 172.21.15.63:0/2659819484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1f40b4860 0x7fc1f405fb80 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:52.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f9cc5700 1 --2- 172.21.15.63:0/2659819484 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1f4145b60 0x7fc1f409ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:52.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f9cc5700 1 -- 172.21.15.63:0/2659819484 >> 172.21.15.63:0/2659819484 conn(0x7fc1f40b59b0 msgr2=0x7fc1f40b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:52.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f9cc5700 1 -- 172.21.15.63:0/2659819484 shutdown_connections 2020-05-18T21:29:52.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f9cc5700 1 -- 172.21.15.63:0/2659819484 wait complete. 2020-05-18T21:29:52.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f9cc5700 1 Processor -- start 2020-05-18T21:29:52.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.289+0000 7fc1f9cc5700 1 -- start start 2020-05-18T21:29:52.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f9cc5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc1f405ffe0 0x7fc1f40af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:52.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f9cc5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f4154f80 con 0x7fc1f4145b60 2020-05-18T21:29:52.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f9cc5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f4155220 con 0x7fc1f40b4860 2020-05-18T21:29:52.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f9cc5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f4154d70 con 0x7fc1f405ffe0 2020-05-18T21:29:52.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f37fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc1f405ffe0 0x7fc1f40af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:52.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f3fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc1f4145b60 0x7fc1f41556c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58910/0 (socket says 172.21.15.63:58910) 2020-05-18T21:29:52.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f3fff700 1 -- 172.21.15.63:0/3533258761 learned_addr learned my addr 172.21.15.63:0/3533258761 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:52.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f0ff9700 1 -- 172.21.15.63:0/3533258761 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845877260 0 0) 0x7fc1f4154f80 con 0x7fc1f4145b60 2020-05-18T21:29:52.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f37fe700 1 -- 172.21.15.63:0/3533258761 >> v1:172.21.15.155:6789/0 conn(0x7fc1f40b4860 legacy=0x7fc1f4140340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:52.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f37fe700 1 -- 172.21.15.63:0/3533258761 >> v1:172.21.15.63:6789/0 conn(0x7fc1f4145b60 legacy=0x7fc1f41556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:52.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f37fe700 1 -- 172.21.15.63:0/3533258761 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f40b08d0 con 0x7fc1f405ffe0 2020-05-18T21:29:52.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f37fe700 1 --2- 172.21.15.63:0/3533258761 >> v2:172.21.15.63:3300/0 conn(0x7fc1f405ffe0 0x7fc1f40af850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc1e4002f70 tx=0x7fc1e4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f37fe700 1 --2- 172.21.15.63:0/3533258761 >> v2:172.21.15.63:3300/0 conn(0x7fc1f405ffe0 0x7fc1f40af850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc1e4002f70 tx=0x7fc1e4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f37fe700 1 --2- 172.21.15.63:0/3533258761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1f405ffe0 0x7fc1f40af850 secure :-1 s=READY pgs=781 cs=0 l=1 rx=0x7fc1e4002f70 tx=0x7fc1e4010c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:52.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f37fe700 1 --2- 172.21.15.63:0/3533258761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1f405ffe0 0x7fc1f40af850 secure :-1 s=THROTTLE_DONE pgs=781 cs=0 l=1 rx=0x7fc1e4002f70 tx=0x7fc1e4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f37fe700 1 --2- 172.21.15.63:0/3533258761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1f405ffe0 0x7fc1f40af850 secure :-1 s=THROTTLE_DONE pgs=781 cs=0 l=1 rx=0x7fc1e4002f70 tx=0x7fc1e4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f0ff9700 1 -- 172.21.15.63:0/3533258761 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1e4007550 con 0x7fc1f405ffe0 2020-05-18T21:29:52.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f37fe700 1 --2- 172.21.15.63:0/3533258761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1f405ffe0 0x7fc1f40af850 secure :-1 s=THROTTLE_DONE pgs=781 cs=0 l=1 rx=0x7fc1e4002f70 tx=0x7fc1e4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f0ff9700 1 -- 172.21.15.63:0/3533258761 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e4012740 con 0x7fc1f405ffe0 2020-05-18T21:29:52.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f9cc5700 1 -- 172.21.15.63:0/3533258761 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f4154840 con 0x7fc1f405ffe0 2020-05-18T21:29:52.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f0ff9700 1 -- 172.21.15.63:0/3533258761 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1e4012ae0 con 0x7fc1f405ffe0 2020-05-18T21:29:52.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f9cc5700 1 -- 172.21.15.63:0/3533258761 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f4140c70 con 0x7fc1f405ffe0 2020-05-18T21:29:52.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f37fe700 1 --2- 172.21.15.63:0/3533258761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1f405ffe0 0x7fc1f40af850 secure :-1 s=THROTTLE_DONE pgs=781 cs=0 l=1 rx=0x7fc1e4002f70 tx=0x7fc1e4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f9cc5700 1 -- 172.21.15.63:0/3533258761 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f40569e0 con 0x7fc1f405ffe0 2020-05-18T21:29:52.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f0ff9700 1 -- 172.21.15.63:0/3533258761 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc1e4012d50 con 0x7fc1f405ffe0 2020-05-18T21:29:52.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.293+0000 7fc1f37fe700 1 --2- 172.21.15.63:0/3533258761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1f405ffe0 0x7fc1f40af850 secure :-1 s=THROTTLE_DONE pgs=781 cs=0 l=1 rx=0x7fc1e4002f70 tx=0x7fc1e4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.297+0000 7fc1f0ff9700 1 --2- 172.21.15.63:0/3533258761 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1d404f920 0x7fc1d4051de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:52.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.297+0000 7fc1f0ff9700 1 -- 172.21.15.63:0/3533258761 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc1e40640a0 con 0x7fc1f405ffe0 2020-05-18T21:29:52.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.297+0000 7fc1f2ffd700 1 --2- 172.21.15.63:0/3533258761 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1d404f920 0x7fc1d4051de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:52.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.297+0000 7fc1f2ffd700 1 --2- 172.21.15.63:0/3533258761 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1d404f920 0x7fc1d4051de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc1f4148e00 tx=0x7fc1e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.297+0000 7fc1f2ffd700 1 --2- 172.21.15.63:0/3533258761 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1d404f920 0x7fc1d4051de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc1f4148e00 tx=0x7fc1e8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.297+0000 7fc1f2ffd700 1 --2- 172.21.15.63:0/3533258761 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1d404f920 0x7fc1d4051de0 secure :-1 s=READY pgs=315 cs=0 l=1 rx=0x7fc1f4148e00 tx=0x7fc1e8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:52.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.301+0000 7fc1f37fe700 1 --2- 172.21.15.63:0/3533258761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1f405ffe0 0x7fc1f40af850 secure :-1 s=THROTTLE_DONE pgs=781 cs=0 l=1 rx=0x7fc1e4002f70 tx=0x7fc1e4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.301+0000 7fc1f0ff9700 1 -- 172.21.15.63:0/3533258761 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc1e403e430 con 0x7fc1f405ffe0 2020-05-18T21:29:52.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.401+0000 7f038064b700 1 -- 172.21.15.63:0/3103574074 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03781578d0 con 0x7f037809f000 2020-05-18T21:29:52.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.401+0000 7f037e3e7700 1 --2- 172.21.15.63:0/3103574074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f037809f000 0x7f03780b2d70 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f0368001490 tx=0x7f0368001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.401+0000 7f03777fe700 1 -- 172.21.15.63:0/3103574074 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f03680416f0 con 0x7f037809f000 2020-05-18T21:29:52.407 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:52.408 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/3895568247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3895568247},{"type":"v1","addr":"172.21.15.63:6833","nonce":3895568247}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:24.694515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6319":{"gid":6319,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/400120989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":400120989},{"type":"v1","addr":"172.21.15.155:6835","nonce":400120989}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:52.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.401+0000 7f038064b700 1 -- 172.21.15.63:0/3103574074 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f035804fa60 msgr2=0x7f0358051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:52.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.401+0000 7f038064b700 1 --2- 172.21.15.63:0/3103574074 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f035804fa60 0x7f0358051f20 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7f036c002f70 tx=0x7f0378060a60).stop 2020-05-18T21:29:52.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.401+0000 7f038064b700 1 -- 172.21.15.63:0/3103574074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f037809f000 msgr2=0x7f03780b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:52.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.401+0000 7f038064b700 1 --2- 172.21.15.63:0/3103574074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f037809f000 0x7f03780b2d70 secure :-1 s=READY pgs=777 cs=0 l=1 rx=0x7f0368001490 tx=0x7f0368001780).stop 2020-05-18T21:29:52.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.405+0000 7f038064b700 1 -- 172.21.15.63:0/3103574074 shutdown_connections 2020-05-18T21:29:52.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.405+0000 7f038064b700 1 --2- 172.21.15.63:0/3103574074 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f035804fa60 0x7f0358051f20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:52.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.405+0000 7f038064b700 1 --2- 172.21.15.63:0/3103574074 >> v2:172.21.15.155:3300/0 conn(0x7f03780ba0d0 0x7f03780a2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:52.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.405+0000 7f038064b700 1 --2- 172.21.15.63:0/3103574074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f037809f000 0x7f03780b2d70 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:52.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.405+0000 7f038064b700 1 -- 172.21.15.63:0/3103574074 >> 172.21.15.63:0/3103574074 conn(0x7f037805a7c0 msgr2=0x7f0378143330 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:52.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.405+0000 7f038064b700 1 -- 172.21.15.63:0/3103574074 shutdown_connections 2020-05-18T21:29:52.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.405+0000 7f038064b700 1 -- 172.21.15.63:0/3103574074 wait complete. 2020-05-18T21:29:52.411 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 34 2020-05-18T21:29:52.419 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2020-05-18T21:29:52.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.449+0000 7fc1f9cc5700 1 -- 172.21.15.63:0/3533258761 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1f4155420 con 0x7fc1f405ffe0 2020-05-18T21:29:52.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.449+0000 7fc1f37fe700 1 --2- 172.21.15.63:0/3533258761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1f405ffe0 0x7fc1f40af850 secure :-1 s=THROTTLE_DONE pgs=781 cs=0 l=1 rx=0x7fc1e4002f70 tx=0x7fc1e4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:52.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.449+0000 7fc1f0ff9700 1 -- 172.21.15.63:0/3533258761 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2141 (secure 0 0 0) 0x7fc1e4041a50 con 0x7fc1f405ffe0 2020-05-18T21:29:52.454 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:52.454 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/3895568247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3895568247},{"type":"v1","addr":"172.21.15.63:6833","nonce":3895568247}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:24.694515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6319":{"gid":6319,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/400120989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":400120989},{"type":"v1","addr":"172.21.15.155:6835","nonce":400120989}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:52.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.449+0000 7fc1f9cc5700 1 -- 172.21.15.63:0/3533258761 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1d404f920 msgr2=0x7fc1d4051de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:52.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.449+0000 7fc1f9cc5700 1 --2- 172.21.15.63:0/3533258761 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1d404f920 0x7fc1d4051de0 secure :-1 s=READY pgs=315 cs=0 l=1 rx=0x7fc1f4148e00 tx=0x7fc1e8007a80).stop 2020-05-18T21:29:52.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.449+0000 7fc1f9cc5700 1 -- 172.21.15.63:0/3533258761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1f405ffe0 msgr2=0x7fc1f40af850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:52.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.449+0000 7fc1f9cc5700 1 --2- 172.21.15.63:0/3533258761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1f405ffe0 0x7fc1f40af850 secure :-1 s=READY pgs=781 cs=0 l=1 rx=0x7fc1e4002f70 tx=0x7fc1e4010c80).stop 2020-05-18T21:29:52.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.449+0000 7fc1f9cc5700 1 -- 172.21.15.63:0/3533258761 shutdown_connections 2020-05-18T21:29:52.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.449+0000 7fc1f9cc5700 1 --2- 172.21.15.63:0/3533258761 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1d404f920 0x7fc1d4051de0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:52.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.449+0000 7fc1f9cc5700 1 --2- 172.21.15.63:0/3533258761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1f405ffe0 0x7fc1f40af850 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:52.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.449+0000 7fc1f9cc5700 1 -- 172.21.15.63:0/3533258761 >> 172.21.15.63:0/3533258761 conn(0x7fc1f40b59b0 msgr2=0x7fc1f405eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:52.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.449+0000 7fc1f9cc5700 1 -- 172.21.15.63:0/3533258761 shutdown_connections 2020-05-18T21:29:52.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:52.449+0000 7fc1f9cc5700 1 -- 172.21.15.63:0/3533258761 wait complete. 2020-05-18T21:29:52.457 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 34 2020-05-18T21:29:52.466 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok flush journal 2020-05-18T21:29:52.545 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:29:52.545 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2020-05-18T21:29:52.545 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 2005, 2020-05-18T21:29:52.546 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 2007, 2020-05-18T21:29:52.546 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 740795, 2020-05-18T21:29:52.546 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 10360151, 2020-05-18T21:29:52.546 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 7, 2020-05-18T21:29:52.546 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 1, 2020-05-18T21:29:52.547 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.193166453, 2020-05-18T21:29:52.547 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.093649941, 2020-05-18T21:29:52.547 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.033726039, 2020-05-18T21:29:52.547 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.051694115, 2020-05-18T21:29:52.547 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:52.548 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2006, 2020-05-18T21:29:52.548 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.097299964, 2020-05-18T21:29:52.548 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000048504 2020-05-18T21:29:52.548 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.548 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:52.549 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.549 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.549 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.549 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:52.549 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.550 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2020-05-18T21:29:52.550 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 692, 2020-05-18T21:29:52.550 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 699, 2020-05-18T21:29:52.550 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 166999, 2020-05-18T21:29:52.550 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 6805310, 2020-05-18T21:29:52.551 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 6, 2020-05-18T21:29:52.551 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 3, 2020-05-18T21:29:52.551 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.096293584, 2020-05-18T21:29:52.551 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.053798316, 2020-05-18T21:29:52.551 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.016308451, 2020-05-18T21:29:52.552 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.021993384, 2020-05-18T21:29:52.552 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:52.552 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 699, 2020-05-18T21:29:52.552 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.044512262, 2020-05-18T21:29:52.552 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000063679 2020-05-18T21:29:52.553 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.553 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:52.553 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.553 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.554 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.554 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:52.554 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.554 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2020-05-18T21:29:52.554 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 10083, 2020-05-18T21:29:52.555 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 22964, 2020-05-18T21:29:52.555 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 3155357, 2020-05-18T21:29:52.555 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 14315027, 2020-05-18T21:29:52.555 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 4, 2020-05-18T21:29:52.555 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 2, 2020-05-18T21:29:52.555 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 1.426445053, 2020-05-18T21:29:52.556 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.633369730, 2020-05-18T21:29:52.556 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.915730902, 2020-05-18T21:29:52.556 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.007541843, 2020-05-18T21:29:52.556 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:52.556 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 22964, 2020-05-18T21:29:52.557 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.643991446, 2020-05-18T21:29:52.557 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000028043 2020-05-18T21:29:52.557 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.557 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:52.557 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 29221, 2020-05-18T21:29:52.557 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.008301795, 2020-05-18T21:29:52.558 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000284 2020-05-18T21:29:52.558 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:52.558 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.558 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2020-05-18T21:29:52.558 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2020-05-18T21:29:52.559 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2020-05-18T21:29:52.559 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.559 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2020-05-18T21:29:52.559 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:52.559 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:52.559 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 192, 2020-05-18T21:29:52.560 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 4.011226262, 2020-05-18T21:29:52.560 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.020891803 2020-05-18T21:29:52.560 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:52.560 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.560 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2020-05-18T21:29:52.561 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:52.561 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:52.561 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2377, 2020-05-18T21:29:52.561 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.506667548, 2020-05-18T21:29:52.561 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000213154 2020-05-18T21:29:52.561 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:52.562 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.562 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2020-05-18T21:29:52.562 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 6473, 2020-05-18T21:29:52.562 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 6471, 2020-05-18T21:29:52.562 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2020-05-18T21:29:52.563 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 6471, 2020-05-18T21:29:52.563 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 13.349465730, 2020-05-18T21:29:52.563 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.002062967 2020-05-18T21:29:52.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.563 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 0, 2020-05-18T21:29:52.564 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch": 12, 2020-05-18T21:29:52.564 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 75, 2020-05-18T21:29:52.564 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 9, 2020-05-18T21:29:52.564 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 1, 2020-05-18T21:29:52.564 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 683, 2020-05-18T21:29:52.564 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 0, 2020-05-18T21:29:52.565 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 683, 2020-05-18T21:29:52.565 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 0, 2020-05-18T21:29:52.565 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 683, 2020-05-18T21:29:52.565 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 1594, 2020-05-18T21:29:52.565 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 674, 2020-05-18T21:29:52.566 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 674, 2020-05-18T21:29:52.566 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 2, 2020-05-18T21:29:52.566 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 6483, 2020-05-18T21:29:52.566 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 6472, 2020-05-18T21:29:52.566 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 0, 2020-05-18T21:29:52.566 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 0, 2020-05-18T21:29:52.567 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2020-05-18T21:29:52.567 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2020-05-18T21:29:52.567 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 0, 2020-05-18T21:29:52.567 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 657556, 2020-05-18T21:29:52.567 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2020-05-18T21:29:52.568 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 0, 2020-05-18T21:29:52.568 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 0, 2020-05-18T21:29:52.568 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 0, 2020-05-18T21:29:52.568 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 0, 2020-05-18T21:29:52.568 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2020-05-18T21:29:52.569 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 0, 2020-05-18T21:29:52.569 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2020-05-18T21:29:52.569 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 0, 2020-05-18T21:29:52.569 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 0, 2020-05-18T21:29:52.569 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 0 2020-05-18T21:29:52.570 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.570 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:29:52.570 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 673, 2020-05-18T21:29:52.570 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 672, 2020-05-18T21:29:52.570 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:29:52.571 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 3201, 2020-05-18T21:29:52.571 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 2528, 2020-05-18T21:29:52.571 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2020-05-18T21:29:52.571 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2020-05-18T21:29:52.571 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2020-05-18T21:29:52.572 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:29:52.572 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:29:52.572 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2020-05-18T21:29:52.572 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2020-05-18T21:29:52.572 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:29:52.572 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 0, 2020-05-18T21:29:52.573 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2020-05-18T21:29:52.573 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 11, 2020-05-18T21:29:52.573 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2020-05-18T21:29:52.573 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2020-05-18T21:29:52.574 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.574 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2020-05-18T21:29:52.574 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 12184, 2020-05-18T21:29:52.574 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 0, 2020-05-18T21:29:52.575 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 0, 2020-05-18T21:29:52.575 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 12186, 2020-05-18T21:29:52.575 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 0, 2020-05-18T21:29:52.575 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 0, 2020-05-18T21:29:52.575 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 14, 2020-05-18T21:29:52.576 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 0, 2020-05-18T21:29:52.576 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 0, 2020-05-18T21:29:52.576 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 15, 2020-05-18T21:29:52.576 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 0, 2020-05-18T21:29:52.577 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 0, 2020-05-18T21:29:52.577 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 4194304, 2020-05-18T21:29:52.577 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 28011406, 2020-05-18T21:29:52.577 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 4195196, 2020-05-18T21:29:52.577 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2020-05-18T21:29:52.578 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 41, 2020-05-18T21:29:52.578 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.380895197, 2020-05-18T21:29:52.578 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.009290126 2020-05-18T21:29:52.578 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.578 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 2 2020-05-18T21:29:52.579 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.579 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2020-05-18T21:29:52.579 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 686, 2020-05-18T21:29:52.579 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 3214, 2020-05-18T21:29:52.580 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 2528, 2020-05-18T21:29:52.580 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 13, 2020-05-18T21:29:52.580 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 87, 2020-05-18T21:29:52.580 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 74, 2020-05-18T21:29:52.580 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 2290, 2020-05-18T21:29:52.581 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 6412, 2020-05-18T21:29:52.581 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 4122, 2020-05-18T21:29:52.581 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 1, 2020-05-18T21:29:52.581 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 3202, 2020-05-18T21:29:52.582 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 3201, 2020-05-18T21:29:52.582 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 87392, 2020-05-18T21:29:52.582 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 331932 2020-05-18T21:29:52.582 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.582 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2020-05-18T21:29:52.583 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 6553, 2020-05-18T21:29:52.583 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 0, 2020-05-18T21:29:52.583 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 6473, 2020-05-18T21:29:52.583 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 2, 2020-05-18T21:29:52.583 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_slave_request": 0, 2020-05-18T21:29:52.583 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2020-05-18T21:29:52.584 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3200, 2020-05-18T21:29:52.584 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 5.456048806, 2020-05-18T21:29:52.584 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001705015 2020-05-18T21:29:52.584 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.584 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2020-05-18T21:29:52.585 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2, 2020-05-18T21:29:52.585 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.078760379, 2020-05-18T21:29:52.585 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.039380189 2020-05-18T21:29:52.585 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.585 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2020-05-18T21:29:52.585 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.586 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.586 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.586 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.586 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2020-05-18T21:29:52.586 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.587 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.587 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.587 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2020-05-18T21:29:52.587 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.588 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.588 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.588 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.588 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2020-05-18T21:29:52.588 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.589 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.589 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.589 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2020-05-18T21:29:52.590 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.590 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.590 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.590 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.590 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2020-05-18T21:29:52.590 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.591 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.591 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.591 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.591 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2020-05-18T21:29:52.591 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.592 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.592 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.592 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.592 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2020-05-18T21:29:52.592 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.592 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.593 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.593 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2020-05-18T21:29:52.593 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.593 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.594 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.594 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.594 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2020-05-18T21:29:52.595 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1, 2020-05-18T21:29:52.595 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.006614312, 2020-05-18T21:29:52.595 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.006614312 2020-05-18T21:29:52.595 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.595 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2020-05-18T21:29:52.595 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.596 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.596 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.596 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.596 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2020-05-18T21:29:52.596 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.597 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.597 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.597 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.597 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2020-05-18T21:29:52.597 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.598 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.598 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.598 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.598 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2020-05-18T21:29:52.598 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 67, 2020-05-18T21:29:52.598 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.349282571, 2020-05-18T21:29:52.599 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.005213172 2020-05-18T21:29:52.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.599 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2020-05-18T21:29:52.599 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.599 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.599 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.600 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.600 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2020-05-18T21:29:52.600 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.600 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.600 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.601 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.601 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2020-05-18T21:29:52.601 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1, 2020-05-18T21:29:52.601 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.410237985, 2020-05-18T21:29:52.601 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.410237985 2020-05-18T21:29:52.602 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.602 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2020-05-18T21:29:52.602 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.602 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.602 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.603 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.603 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2020-05-18T21:29:52.603 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.603 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.603 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.604 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.604 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2020-05-18T21:29:52.604 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.604 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.604 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.605 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.605 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2020-05-18T21:29:52.605 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.605 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.605 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.606 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.606 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2020-05-18T21:29:52.606 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.606 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.606 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.607 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.607 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2020-05-18T21:29:52.607 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.607 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.607 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.607 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.608 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2020-05-18T21:29:52.608 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.608 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.608 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.609 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.609 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2020-05-18T21:29:52.609 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.609 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.609 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.609 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.610 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2020-05-18T21:29:52.610 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3200, 2020-05-18T21:29:52.610 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 7.048521677, 2020-05-18T21:29:52.610 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.002202663 2020-05-18T21:29:52.610 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.611 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0 2020-05-18T21:29:52.611 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.611 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2020-05-18T21:29:52.611 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 1, 2020-05-18T21:29:52.611 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 1, 2020-05-18T21:29:52.612 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 0, 2020-05-18T21:29:52.612 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 1, 2020-05-18T21:29:52.612 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2020-05-18T21:29:52.612 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 5605, 2020-05-18T21:29:52.612 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 5605, 2020-05-18T21:29:52.613 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 558 2020-05-18T21:29:52.613 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.613 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2020-05-18T21:29:52.613 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 120, 2020-05-18T21:29:52.614 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 120, 2020-05-18T21:29:52.614 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2020-05-18T21:29:52.614 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2020-05-18T21:29:52.614 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2020-05-18T21:29:52.614 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2020-05-18T21:29:52.614 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2020-05-18T21:29:52.615 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2020-05-18T21:29:52.615 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2020-05-18T21:29:52.615 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2020-05-18T21:29:52.615 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2020-05-18T21:29:52.615 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2020-05-18T21:29:52.616 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2020-05-18T21:29:52.616 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2020-05-18T21:29:52.616 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2020-05-18T21:29:52.616 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2020-05-18T21:29:52.616 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2020-05-18T21:29:52.617 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2020-05-18T21:29:52.617 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2020-05-18T21:29:52.617 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2020-05-18T21:29:52.617 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 1830554, 2020-05-18T21:29:52.617 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 595, 2020-05-18T21:29:52.618 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2020-05-18T21:29:52.618 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2020-05-18T21:29:52.618 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2020-05-18T21:29:52.618 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2020-05-18T21:29:52.618 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2020-05-18T21:29:52.618 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2020-05-18T21:29:52.619 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2020-05-18T21:29:52.619 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2020-05-18T21:29:52.619 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 6128, 2020-05-18T21:29:52.619 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 93, 2020-05-18T21:29:52.619 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2020-05-18T21:29:52.620 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2020-05-18T21:29:52.620 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2020-05-18T21:29:52.620 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2020-05-18T21:29:52.620 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 4986614, 2020-05-18T21:29:52.620 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 58290, 2020-05-18T21:29:52.621 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2020-05-18T21:29:52.621 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2020-05-18T21:29:52.621 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2020-05-18T21:29:52.622 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2020-05-18T21:29:52.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.622 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2020-05-18T21:29:52.622 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 0, 2020-05-18T21:29:52.623 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2020-05-18T21:29:52.623 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 2779, 2020-05-18T21:29:52.623 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 25090363, 2020-05-18T21:29:52.623 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 0, 2020-05-18T21:29:52.623 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 2779, 2020-05-18T21:29:52.623 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 2779, 2020-05-18T21:29:52.624 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 44, 2020-05-18T21:29:52.624 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 2735, 2020-05-18T21:29:52.624 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2020-05-18T21:29:52.624 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2020-05-18T21:29:52.624 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 2, 2020-05-18T21:29:52.625 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 0, 2020-05-18T21:29:52.625 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 26, 2020-05-18T21:29:52.625 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 59, 2020-05-18T21:29:52.625 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 9, 2020-05-18T21:29:52.625 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2020-05-18T21:29:52.625 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2020-05-18T21:29:52.626 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 1, 2020-05-18T21:29:52.626 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 1, 2020-05-18T21:29:52.626 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 2584, 2020-05-18T21:29:52.626 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2020-05-18T21:29:52.626 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2020-05-18T21:29:52.627 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2020-05-18T21:29:52.627 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 14, 2020-05-18T21:29:52.627 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 0, 2020-05-18T21:29:52.627 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2020-05-18T21:29:52.628 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2020-05-18T21:29:52.628 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2020-05-18T21:29:52.628 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2020-05-18T21:29:52.628 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2020-05-18T21:29:52.628 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2020-05-18T21:29:52.629 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2020-05-18T21:29:52.629 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2020-05-18T21:29:52.629 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2020-05-18T21:29:52.629 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 0, 2020-05-18T21:29:52.629 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2020-05-18T21:29:52.630 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2020-05-18T21:29:52.630 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2020-05-18T21:29:52.630 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2020-05-18T21:29:52.630 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2020-05-18T21:29:52.630 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2020-05-18T21:29:52.630 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2020-05-18T21:29:52.631 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2020-05-18T21:29:52.631 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2020-05-18T21:29:52.631 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2020-05-18T21:29:52.631 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2020-05-18T21:29:52.631 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2020-05-18T21:29:52.632 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2020-05-18T21:29:52.632 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2020-05-18T21:29:52.632 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2020-05-18T21:29:52.632 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2020-05-18T21:29:52.632 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 0, 2020-05-18T21:29:52.632 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2020-05-18T21:29:52.633 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 0, 2020-05-18T21:29:52.633 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 7, 2020-05-18T21:29:52.633 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 7, 2020-05-18T21:29:52.633 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2020-05-18T21:29:52.633 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2020-05-18T21:29:52.634 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 158, 2020-05-18T21:29:52.634 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 28, 2020-05-18T21:29:52.634 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 6 2020-05-18T21:29:52.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.634 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2020-05-18T21:29:52.634 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 0, 2020-05-18T21:29:52.635 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2020-05-18T21:29:52.635 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2020-05-18T21:29:52.635 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2020-05-18T21:29:52.635 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.635 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2020-05-18T21:29:52.636 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 0, 2020-05-18T21:29:52.636 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 12, 2020-05-18T21:29:52.636 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 0, 2020-05-18T21:29:52.636 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 6, 2020-05-18T21:29:52.636 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 2528, 2020-05-18T21:29:52.638 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 0 2020-05-18T21:29:52.638 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.638 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-05-18T21:29:52.638 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:52.638 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:52.639 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:52.639 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 12773, 2020-05-18T21:29:52.639 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 3115822, 2020-05-18T21:29:52.639 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:52.639 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 12773, 2020-05-18T21:29:52.639 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:52.640 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:52.640 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 12773, 2020-05-18T21:29:52.640 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 3115822, 2020-05-18T21:29:52.640 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:52.640 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.641 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.641 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.641 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:52.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.641 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2020-05-18T21:29:52.642 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:52.642 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:52.642 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:52.642 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:52.642 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:52.642 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:52.643 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:52.643 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 2779, 2020-05-18T21:29:52.643 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 25346797, 2020-05-18T21:29:52.643 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 182, 2020-05-18T21:29:52.643 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 25346797, 2020-05-18T21:29:52.644 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:52.644 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.644 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.644 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.644 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:52.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.645 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2020-05-18T21:29:52.645 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:52.645 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2020-05-18T21:29:52.645 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:52.645 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:52.646 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:52.646 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:52.646 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:52.646 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 2779, 2020-05-18T21:29:52.646 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 2779, 2020-05-18T21:29:52.646 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 2779, 2020-05-18T21:29:52.647 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 2779, 2020-05-18T21:29:52.647 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:52.647 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.647 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.647 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.648 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:52.648 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.648 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2020-05-18T21:29:52.648 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:52.648 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:52.648 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:52.649 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 2528, 2020-05-18T21:29:52.649 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 255328, 2020-05-18T21:29:52.649 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:52.649 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 2528, 2020-05-18T21:29:52.649 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:52.650 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:52.650 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 18, 2020-05-18T21:29:52.650 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 255328, 2020-05-18T21:29:52.650 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:52.650 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.650 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.651 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.651 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:52.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:52.651 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x558953fdfd60": { 2020-05-18T21:29:52.651 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 189, 2020-05-18T21:29:52.652 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:52.652 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:52.652 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 12184, 2020-05-18T21:29:52.652 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 23815772, 2020-05-18T21:29:52.652 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:52.652 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 12184, 2020-05-18T21:29:52.653 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:52.653 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:52.653 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 41, 2020-05-18T21:29:52.653 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 23815583, 2020-05-18T21:29:52.653 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:52.654 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:52.654 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:52.654 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:52.654 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:52.654 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:52.655 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:29:52.656 INFO:tasks.cephfs.filesystem:_json_asok output: { "AsyncMessenger::Worker-0": { "msgr_recv_messages": 2005, "msgr_send_messages": 2007, "msgr_recv_bytes": 740795, "msgr_send_bytes": 10360151, "msgr_created_connections": 7, "msgr_active_connections": 1, "msgr_running_total_time": 0.193166453, "msgr_running_send_time": 0.093649941, "msgr_running_recv_time": 0.033726039, "msgr_running_fast_dispatch_time": 0.051694115, "msgr_send_messages_queue_lat": { "avgcount": 2006, "sum": 0.097299964, "avgtime": 0.000048504 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-1": { "msgr_recv_messages": 692, "msgr_send_messages": 699, "msgr_recv_bytes": 166999, "msgr_send_bytes": 6805310, "msgr_created_connections": 6, "msgr_active_connections": 3, "msgr_running_total_time": 0.096293584, "msgr_running_send_time": 0.053798316, "msgr_running_recv_time": 0.016308451, "msgr_running_fast_dispatch_time": 0.021993384, "msgr_send_messages_queue_lat": { "avgcount": 699, "sum": 0.044512262, "avgtime": 0.000063679 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-2": { "msgr_recv_messages": 10083, "msgr_send_messages": 22964, "msgr_recv_bytes": 3155357, "msgr_send_bytes": 14315027, "msgr_created_connections": 4, "msgr_active_connections": 2, "msgr_running_total_time": 1.426445053, "msgr_running_send_time": 0.633369730, "msgr_running_recv_time": 0.915730902, "msgr_running_fast_dispatch_time": 0.007541843, "msgr_send_messages_queue_lat": { "avgcount": 22964, "sum": 0.643991446, "avgtime": 0.000028043 }, "msgr_handle_ack_lat": { "avgcount": 29221, "sum": 0.008301795, "avgtime": 0.000000284 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "queue_len": 0, "complete_latency": { "avgcount": 192, "sum": 4.011226262, "avgtime": 0.020891803 } }, "finisher-PurgeQueue": { "queue_len": 0, "complete_latency": { "avgcount": 2377, "sum": 0.506667548, "avgtime": 0.000213154 } }, "mds": { "request": 6473, "reply": 6471, "reply_latency": { "avgcount": 6471, "sum": 13.349465730, "avgtime": 0.002062967 }, "forward": 0, "dir_fetch": 12, "dir_commit": 75, "dir_split": 9, "dir_merge": 1, "inodes": 683, "inodes_top": 0, "inodes_bottom": 683, "inodes_pin_tail": 0, "inodes_pinned": 683, "inodes_expired": 1594, "inodes_with_caps": 674, "caps": 674, "subtrees": 2, "traverse": 6483, "traverse_hit": 6472, "traverse_forward": 0, "traverse_discover": 0, "traverse_dir_fetch": 0, "traverse_remote_ino": 0, "traverse_lock": 0, "load_cent": 657556, "q": 0, "exported": 0, "exported_inodes": 0, "imported": 0, "imported_inodes": 0, "openino_dir_fetch": 0, "openino_backtrace_fetch": 0, "openino_peer_discover": 0, "root_rfiles": 0, "root_rbytes": 0, "root_rsnaps": 0 }, "mds_cache": { "num_strays": 673, "num_strays_delayed": 672, "num_strays_enqueuing": 0, "strays_created": 3201, "strays_enqueued": 2528, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 11, "ireq_fragstats": 0, "ireq_inodestats": 0 }, "mds_log": { "evadd": 12184, "evex": 0, "evtrm": 0, "ev": 12186, "evexg": 0, "evexd": 0, "segadd": 14, "segex": 0, "segtrm": 0, "seg": 15, "segexg": 0, "segexd": 0, "expos": 4194304, "wrpos": 28011406, "rdpos": 4195196, "jlat": { "avgcount": 41, "sum": 0.380895197, "avgtime": 0.009290126 }, "replayed": 2 }, "mds_mem": { "ino": 686, "ino+": 3214, "ino-": 2528, "dir": 13, "dir+": 87, "dir-": 74, "dn": 2290, "dn+": 6412, "dn-": 4122, "cap": 1, "cap+": 3202, "cap-": 3201, "rss": 87392, "heap": 331932 }, "mds_server": { "dispatch_client_request": 6553, "dispatch_server_request": 0, "handle_client_request": 6473, "handle_client_session": 2, "handle_slave_request": 0, "req_create_latency": { "avgcount": 3200, "sum": 5.456048806, "avgtime": 0.001705015 }, "req_getattr_latency": { "avgcount": 2, "sum": 0.078760379, "avgtime": 0.039380189 }, "req_getfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_link_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookup_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookuphash_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupino_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupname_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupparent_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lssnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mkdir_latency": { "avgcount": 1, "sum": 0.006614312, "avgtime": 0.006614312 }, "req_mknod_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mksnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_open_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_readdir_latency": { "avgcount": 67, "sum": 0.349282571, "avgtime": 0.005213172 }, "req_rename_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_renamesnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmdir_latency": { "avgcount": 1, "sum": 0.410237985, "avgtime": 0.410237985 }, "req_rmsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setdirlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_symlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_unlink_latency": { "avgcount": 3200, "sum": 7.048521677, "avgtime": 0.002202663 }, "cap_revoke_eviction": 0 }, "mds_sessions": { "session_count": 1, "session_add": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 5605, "average_load": 5605, "avg_session_uptime": 558 }, "mempool": { "bloom_filter_bytes": 120, "bloom_filter_items": 120, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "buffer_anon_bytes": 1830554, "buffer_anon_items": 595, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6128, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 4986614, "mds_co_items": 58290, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "op_active": 0, "op_laggy": 0, "op_send": 2779, "op_send_bytes": 25090363, "op_resend": 0, "op_reply": 2779, "op": 2779, "op_r": 44, "op_w": 2735, "op_rmw": 0, "op_pg": 0, "osdop_stat": 2, "osdop_create": 0, "osdop_read": 26, "osdop_write": 59, "osdop_writefull": 9, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 1, "osdop_truncate": 1, "osdop_delete": 2584, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 14, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 7, "osd_session_open": 7, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 158, "omap_rd": 28, "omap_del": 6 }, "oft": { "omap_total_objs": 0, "omap_total_kv_pairs": 0, "omap_total_updates": 0, "omap_total_removes": 0 }, "purge_queue": { "pq_executing_ops": 0, "pq_executing_ops_high_water": 12, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executed": 2528, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "val": 0, "max": 104857600, "get_started": 0, "get": 12773, "get_sum": 3115822, "get_or_fail_fail": 0, "get_or_fail_success": 12773, "take": 0, "take_sum": 0, "put": 12773, "put_sum": 3115822, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_bytes": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 2779, "take_sum": 25346797, "put": 182, "put_sum": 25346797, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_ops": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 2779, "take_sum": 2779, "put": 2779, "put_sum": 2779, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle": { "val": 0, "max": 3758096384, "get_started": 0, "get": 2528, "get_sum": 255328, "get_or_fail_fail": 0, "get_or_fail_success": 2528, "take": 0, "take_sum": 0, "put": 18, "put_sum": 255328, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle-0x558953fdfd60": { "val": 189, "max": 3758096384, "get_started": 0, "get": 12184, "get_sum": 23815772, "get_or_fail_fail": 0, "get_or_fail_success": 12184, "take": 0, "take_sum": 0, "put": 41, "put_sum": 23815583, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } 2020-05-18T21:29:52.657 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/673, 2528/3201 2020-05-18T21:29:52.799 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:29:52.800 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "", 2020-05-18T21:29:52.800 INFO:teuthology.orchestra.run.smithi155.stdout: "return_code": 0 2020-05-18T21:29:52.800 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:29:52.809 INFO:tasks.cephfs.filesystem:_json_asok output: { "message": "", "return_code": 0 } 2020-05-18T21:29:53.658 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:53.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.761+0000 7f2a01895700 1 Processor -- start 2020-05-18T21:29:53.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.761+0000 7f2a01895700 1 -- start start 2020-05-18T21:29:53.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f2a01895700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f29fc0b8960 0x7f29fc0b7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:53.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f2a01895700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29fc05eed0 con 0x7f29fc0b9f50 2020-05-18T21:29:53.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f2a01895700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29fc05f170 con 0x7f29fc12efc0 2020-05-18T21:29:53.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f2a01895700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29fc05f410 con 0x7f29fc0b8960 2020-05-18T21:29:53.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f29fa7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f29fc0b8960 0x7f29fc0b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:53.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f29fa7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f29fc0b8960 0x7f29fc0b7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56728/0 (socket says 172.21.15.63:56728) 2020-05-18T21:29:53.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f29fa7fc700 1 -- 172.21.15.63:0/3255544497 learned_addr learned my addr 172.21.15.63:0/3255544497 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:53.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f29faffd700 1 --1- 172.21.15.63:0/3255544497 >> v1:172.21.15.63:6789/0 conn(0x7f29fc0b9f50 0x7f29fc05f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58914/0 (socket says 172.21.15.63:58914) 2020-05-18T21:29:53.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f29fa7fc700 1 -- 172.21.15.63:0/3255544497 >> v1:172.21.15.155:6789/0 conn(0x7f29fc12efc0 legacy=0x7f29fc12f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:53.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f29fa7fc700 1 -- 172.21.15.63:0/3255544497 >> v1:172.21.15.63:6789/0 conn(0x7f29fc0b9f50 legacy=0x7f29fc05f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:53.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f29f9ffb700 1 -- 172.21.15.63:0/3255544497 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467585203 0 0) 0x7f29fc05eed0 con 0x7f29fc0b9f50 2020-05-18T21:29:53.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f29fa7fc700 1 -- 172.21.15.63:0/3255544497 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc0ba330 con 0x7f29fc0b8960 2020-05-18T21:29:53.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f29fa7fc700 1 --2- 172.21.15.63:0/3255544497 >> v2:172.21.15.63:3300/0 conn(0x7f29fc0b8960 0x7f29fc0b7100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f29ec002f70 tx=0x7f29ec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:53.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f29fa7fc700 1 --2- 172.21.15.63:0/3255544497 >> v2:172.21.15.63:3300/0 conn(0x7f29fc0b8960 0x7f29fc0b7100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f29ec002f70 tx=0x7f29ec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:53.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f29fa7fc700 1 --2- 172.21.15.63:0/3255544497 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29fc0b8960 0x7f29fc0b7100 secure :-1 s=READY pgs=783 cs=0 l=1 rx=0x7f29ec002f70 tx=0x7f29ec007a80).ready entity=mon.0 client_cookie=36fc1edc68ac7cf0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:53.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f29fa7fc700 1 --2- 172.21.15.63:0/3255544497 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29fc0b8960 0x7f29fc0b7100 secure :-1 s=THROTTLE_DONE pgs=783 cs=0 l=1 rx=0x7f29ec002f70 tx=0x7f29ec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:53.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f29f9ffb700 1 -- 172.21.15.63:0/3255544497 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29ec011760 con 0x7f29fc0b8960 2020-05-18T21:29:53.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f29fa7fc700 1 --2- 172.21.15.63:0/3255544497 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29fc0b8960 0x7f29fc0b7100 secure :-1 s=THROTTLE_DONE pgs=783 cs=0 l=1 rx=0x7f29ec002f70 tx=0x7f29ec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:53.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f29f9ffb700 1 -- 172.21.15.63:0/3255544497 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ec0118c0 con 0x7f29fc0b8960 2020-05-18T21:29:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f29fa7fc700 1 --2- 172.21.15.63:0/3255544497 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29fc0b8960 0x7f29fc0b7100 secure :-1 s=THROTTLE_DONE pgs=783 cs=0 l=1 rx=0x7f29ec002f70 tx=0x7f29ec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f29f9ffb700 1 -- 172.21.15.63:0/3255544497 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29ec011ce0 con 0x7f29fc0b8960 2020-05-18T21:29:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f2a01895700 1 -- 172.21.15.63:0/3255544497 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29fc0b8960 msgr2=0x7f29fc0b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f2a01895700 1 --2- 172.21.15.63:0/3255544497 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29fc0b8960 0x7f29fc0b7100 secure :-1 s=READY pgs=783 cs=0 l=1 rx=0x7f29ec002f70 tx=0x7f29ec007a80).stop 2020-05-18T21:29:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f2a01895700 1 -- 172.21.15.63:0/3255544497 shutdown_connections 2020-05-18T21:29:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f2a01895700 1 --2- 172.21.15.63:0/3255544497 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29fc0b8960 0x7f29fc0b7100 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f2a01895700 1 -- 172.21.15.63:0/3255544497 >> 172.21.15.63:0/3255544497 conn(0x7f29fc0bd4f0 msgr2=0x7f29fc0b9500 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f2a01895700 1 -- 172.21.15.63:0/3255544497 shutdown_connections 2020-05-18T21:29:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.765+0000 7f2a01895700 1 -- 172.21.15.63:0/3255544497 wait complete. 2020-05-18T21:29:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f2a01895700 1 Processor -- start 2020-05-18T21:29:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f2a01895700 1 -- start start 2020-05-18T21:29:53.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f2a01895700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f29fc0b8960 0x7f29fc0b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:53.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f2a01895700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29fc0b2850 con 0x7f29fc12efc0 2020-05-18T21:29:53.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f2a01895700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29fc0b2af0 con 0x7f29fc0b9f50 2020-05-18T21:29:53.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f2a01895700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29fc0b2d90 con 0x7f29fc0b8960 2020-05-18T21:29:53.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f29fb7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f29fc12efc0 0x7f29fc0b6a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58924/0 (socket says 172.21.15.63:58924) 2020-05-18T21:29:53.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f29fb7fe700 1 -- 172.21.15.63:0/2811349062 learned_addr learned my addr 172.21.15.63:0/2811349062 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:53.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f29faffd700 1 --2- 172.21.15.63:0/2811349062 >> v2:172.21.15.155:3300/0 conn(0x7f29fc0b8960 0x7f29fc0b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:53.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f29ebfff700 1 -- 172.21.15.63:0/2811349062 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190738148 0 0) 0x7f29fc0b2850 con 0x7f29fc12efc0 2020-05-18T21:29:53.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f29ebfff700 1 -- 172.21.15.63:0/2811349062 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29d8002fe0 con 0x7f29fc12efc0 2020-05-18T21:29:53.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f29ebfff700 1 -- 172.21.15.63:0/2811349062 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2624726981 0 0) 0x7f29d8002fe0 con 0x7f29fc12efc0 2020-05-18T21:29:53.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f29ebfff700 1 -- 172.21.15.63:0/2811349062 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f29fc0b2850 con 0x7f29fc12efc0 2020-05-18T21:29:53.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f29ebfff700 1 -- 172.21.15.63:0/2811349062 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f29f4001c70 con 0x7f29fc12efc0 2020-05-18T21:29:53.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f29faffd700 1 -- 172.21.15.63:0/2811349062 >> v1:172.21.15.155:6789/0 conn(0x7f29fc0b9f50 legacy=0x7f29fc0b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:53.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f29faffd700 1 -- 172.21.15.63:0/2811349062 >> v1:172.21.15.63:6789/0 conn(0x7f29fc12efc0 legacy=0x7f29fc0b6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:53.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f29faffd700 1 -- 172.21.15.63:0/2811349062 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc0b09b0 con 0x7f29fc0b8960 2020-05-18T21:29:53.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f29faffd700 1 --2- 172.21.15.63:0/2811349062 >> v2:172.21.15.155:3300/0 conn(0x7f29fc0b8960 0x7f29fc0b30c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f29ec007f10 tx=0x7f29fc068190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:53.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f29faffd700 1 --2- 172.21.15.63:0/2811349062 >> v2:172.21.15.155:3300/0 conn(0x7f29fc0b8960 0x7f29fc0b30c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f29ec007f10 tx=0x7f29fc068190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:53.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.769+0000 7f29faffd700 1 --2- 172.21.15.63:0/2811349062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29fc0b8960 0x7f29fc0b30c0 secure :-1 s=READY pgs=556 cs=0 l=1 rx=0x7f29ec007f10 tx=0x7f29fc068190).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:53.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.773+0000 7f29faffd700 1 --2- 172.21.15.63:0/2811349062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29fc0b8960 0x7f29fc0b30c0 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7f29ec007f10 tx=0x7f29fc068190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:53.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.773+0000 7f29ebfff700 1 -- 172.21.15.63:0/2811349062 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29f000c840 con 0x7f29fc0b8960 2020-05-18T21:29:53.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.773+0000 7f29faffd700 1 --2- 172.21.15.63:0/2811349062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29fc0b8960 0x7f29fc0b30c0 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7f29ec007f10 tx=0x7f29fc068190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:53.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.773+0000 7f29faffd700 1 --2- 172.21.15.63:0/2811349062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29fc0b8960 0x7f29fc0b30c0 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7f29ec007f10 tx=0x7f29fc068190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:53.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.773+0000 7f29ebfff700 1 -- 172.21.15.63:0/2811349062 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f000c9a0 con 0x7f29fc0b8960 2020-05-18T21:29:53.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.773+0000 7f2a01895700 1 -- 172.21.15.63:0/2811349062 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29fc0af770 con 0x7f29fc0b8960 2020-05-18T21:29:53.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.773+0000 7f29ebfff700 1 -- 172.21.15.63:0/2811349062 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29f000cd40 con 0x7f29fc0b8960 2020-05-18T21:29:53.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.773+0000 7f2a01895700 1 -- 172.21.15.63:0/2811349062 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29fc0b7360 con 0x7f29fc0b8960 2020-05-18T21:29:53.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.773+0000 7f29faffd700 1 --2- 172.21.15.63:0/2811349062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29fc0b8960 0x7f29fc0b30c0 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7f29ec007f10 tx=0x7f29fc068190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:53.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.773+0000 7f2a01895700 1 -- 172.21.15.63:0/2811349062 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29fc0569e0 con 0x7f29fc0b8960 2020-05-18T21:29:53.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.773+0000 7f29ebfff700 1 -- 172.21.15.63:0/2811349062 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f29f00054f0 con 0x7f29fc0b8960 2020-05-18T21:29:53.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.773+0000 7f29faffd700 1 --2- 172.21.15.63:0/2811349062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29fc0b8960 0x7f29fc0b30c0 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7f29ec007f10 tx=0x7f29fc068190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:53.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.773+0000 7f29ebfff700 1 --2- 172.21.15.63:0/2811349062 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29d804ffb0 0x7f29d8052470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:53.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.773+0000 7f29ebfff700 1 -- 172.21.15.63:0/2811349062 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f29f00100c0 con 0x7f29fc0b8960 2020-05-18T21:29:53.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.773+0000 7f29fa7fc700 1 --2- 172.21.15.63:0/2811349062 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29d804ffb0 0x7f29d8052470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:53.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.773+0000 7f29fa7fc700 1 --2- 172.21.15.63:0/2811349062 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29d804ffb0 0x7f29d8052470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f29ec008500 tx=0x7f29ec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:53.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.777+0000 7f29fa7fc700 1 --2- 172.21.15.63:0/2811349062 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29d804ffb0 0x7f29d8052470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f29ec008500 tx=0x7f29ec007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:53.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.777+0000 7f29fa7fc700 1 --2- 172.21.15.63:0/2811349062 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29d804ffb0 0x7f29d8052470 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7f29ec008500 tx=0x7f29ec007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:53.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.781+0000 7f29faffd700 1 --2- 172.21.15.63:0/2811349062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29fc0b8960 0x7f29fc0b30c0 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7f29ec007f10 tx=0x7f29fc068190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:53.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.781+0000 7f29ebfff700 1 -- 172.21.15.63:0/2811349062 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f29f003d8d0 con 0x7f29fc0b8960 2020-05-18T21:29:53.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.937+0000 7f2a01895700 1 -- 172.21.15.63:0/2811349062 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29fc05e490 con 0x7f29fc0b8960 2020-05-18T21:29:53.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.937+0000 7f29faffd700 1 --2- 172.21.15.63:0/2811349062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29fc0b8960 0x7f29fc0b30c0 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7f29ec007f10 tx=0x7f29fc068190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:53.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.937+0000 7f29ebfff700 1 -- 172.21.15.63:0/2811349062 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f29f0040ef0 con 0x7f29fc0b8960 2020-05-18T21:29:53.944 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:53.944 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/3895568247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3895568247},{"type":"v1","addr":"172.21.15.63:6833","nonce":3895568247}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:24.694515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6319":{"gid":6319,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/400120989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":400120989},{"type":"v1","addr":"172.21.15.155:6835","nonce":400120989}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:53.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.941+0000 7f2a01895700 1 -- 172.21.15.63:0/2811349062 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29d804ffb0 msgr2=0x7f29d8052470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:53.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.941+0000 7f2a01895700 1 --2- 172.21.15.63:0/2811349062 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29d804ffb0 0x7f29d8052470 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7f29ec008500 tx=0x7f29ec007a80).stop 2020-05-18T21:29:53.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.941+0000 7f2a01895700 1 -- 172.21.15.63:0/2811349062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29fc0b8960 msgr2=0x7f29fc0b30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:53.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.941+0000 7f2a01895700 1 --2- 172.21.15.63:0/2811349062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29fc0b8960 0x7f29fc0b30c0 secure :-1 s=READY pgs=556 cs=0 l=1 rx=0x7f29ec007f10 tx=0x7f29fc068190).stop 2020-05-18T21:29:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.941+0000 7f2a01895700 1 -- 172.21.15.63:0/2811349062 shutdown_connections 2020-05-18T21:29:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.941+0000 7f2a01895700 1 --2- 172.21.15.63:0/2811349062 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29d804ffb0 0x7f29d8052470 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.941+0000 7f2a01895700 1 --2- 172.21.15.63:0/2811349062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29fc0b8960 0x7f29fc0b30c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.941+0000 7f2a01895700 1 -- 172.21.15.63:0/2811349062 >> 172.21.15.63:0/2811349062 conn(0x7f29fc0bd4f0 msgr2=0x7f29fc0661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.941+0000 7f2a01895700 1 -- 172.21.15.63:0/2811349062 shutdown_connections 2020-05-18T21:29:53.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:53.941+0000 7f2a01895700 1 -- 172.21.15.63:0/2811349062 wait complete. 2020-05-18T21:29:53.949 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 34 2020-05-18T21:29:53.957 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2020-05-18T21:29:54.059 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:29:54.059 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2020-05-18T21:29:54.059 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 3028, 2020-05-18T21:29:54.059 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 3030, 2020-05-18T21:29:54.060 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 1094512, 2020-05-18T21:29:54.060 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 11076529, 2020-05-18T21:29:54.060 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 7, 2020-05-18T21:29:54.060 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 1, 2020-05-18T21:29:54.060 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.252658408, 2020-05-18T21:29:54.061 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.113195877, 2020-05-18T21:29:54.061 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.044749942, 2020-05-18T21:29:54.061 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.070180004, 2020-05-18T21:29:54.061 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:54.061 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3029, 2020-05-18T21:29:54.062 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.231630328, 2020-05-18T21:29:54.062 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000076470 2020-05-18T21:29:54.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.062 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:54.062 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.063 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.063 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.063 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.063 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2020-05-18T21:29:54.064 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 1066, 2020-05-18T21:29:54.064 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 1073, 2020-05-18T21:29:54.064 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 271161, 2020-05-18T21:29:54.064 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 6964706, 2020-05-18T21:29:54.064 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 6, 2020-05-18T21:29:54.064 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 3, 2020-05-18T21:29:54.065 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.120245160, 2020-05-18T21:29:54.065 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.061944213, 2020-05-18T21:29:54.065 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.022145768, 2020-05-18T21:29:54.065 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.029954098, 2020-05-18T21:29:54.065 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:54.066 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1073, 2020-05-18T21:29:54.066 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.078933561, 2020-05-18T21:29:54.066 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000073563 2020-05-18T21:29:54.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.066 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:54.066 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.067 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.067 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.067 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.067 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2020-05-18T21:29:54.068 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 10109, 2020-05-18T21:29:54.068 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 22990, 2020-05-18T21:29:54.068 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 3161915, 2020-05-18T21:29:54.068 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 14476598, 2020-05-18T21:29:54.068 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 4, 2020-05-18T21:29:54.069 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 2, 2020-05-18T21:29:54.069 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 1.429213587, 2020-05-18T21:29:54.069 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.634211043, 2020-05-18T21:29:54.069 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.916017356, 2020-05-18T21:29:54.070 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.009110489, 2020-05-18T21:29:54.070 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:54.070 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 22990, 2020-05-18T21:29:54.070 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.671566734, 2020-05-18T21:29:54.071 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000029211 2020-05-18T21:29:54.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.071 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:54.071 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 29221, 2020-05-18T21:29:54.072 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.008301795, 2020-05-18T21:29:54.072 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000284 2020-05-18T21:29:54.072 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.072 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2020-05-18T21:29:54.073 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2020-05-18T21:29:54.073 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2020-05-18T21:29:54.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.073 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2020-05-18T21:29:54.073 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:54.074 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:54.074 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 374, 2020-05-18T21:29:54.074 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 4.131018651, 2020-05-18T21:29:54.074 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.011045504 2020-05-18T21:29:54.074 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.075 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2020-05-18T21:29:54.075 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:54.075 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:54.075 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3025, 2020-05-18T21:29:54.075 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.596077949, 2020-05-18T21:29:54.076 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000197050 2020-05-18T21:29:54.076 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.076 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.076 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2020-05-18T21:29:54.076 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 6473, 2020-05-18T21:29:54.077 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 6471, 2020-05-18T21:29:54.077 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2020-05-18T21:29:54.077 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 6471, 2020-05-18T21:29:54.077 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 13.349465730, 2020-05-18T21:29:54.077 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.002062967 2020-05-18T21:29:54.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.078 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 0, 2020-05-18T21:29:54.078 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch": 12, 2020-05-18T21:29:54.078 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 87, 2020-05-18T21:29:54.078 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 9, 2020-05-18T21:29:54.078 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 2, 2020-05-18T21:29:54.079 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 683, 2020-05-18T21:29:54.079 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 0, 2020-05-18T21:29:54.079 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 683, 2020-05-18T21:29:54.079 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 0, 2020-05-18T21:29:54.079 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 683, 2020-05-18T21:29:54.079 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 1594, 2020-05-18T21:29:54.080 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 674, 2020-05-18T21:29:54.080 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 674, 2020-05-18T21:29:54.080 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 2, 2020-05-18T21:29:54.080 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 6483, 2020-05-18T21:29:54.080 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 6472, 2020-05-18T21:29:54.080 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 0, 2020-05-18T21:29:54.081 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 0, 2020-05-18T21:29:54.081 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2020-05-18T21:29:54.081 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2020-05-18T21:29:54.081 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 0, 2020-05-18T21:29:54.081 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 657556, 2020-05-18T21:29:54.082 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2020-05-18T21:29:54.082 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 0, 2020-05-18T21:29:54.082 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 0, 2020-05-18T21:29:54.082 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 0, 2020-05-18T21:29:54.082 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 0, 2020-05-18T21:29:54.082 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2020-05-18T21:29:54.083 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 0, 2020-05-18T21:29:54.083 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2020-05-18T21:29:54.083 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 0, 2020-05-18T21:29:54.083 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 0, 2020-05-18T21:29:54.083 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 0 2020-05-18T21:29:54.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.084 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:29:54.084 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 0, 2020-05-18T21:29:54.084 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 0, 2020-05-18T21:29:54.084 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:29:54.084 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 3201, 2020-05-18T21:29:54.085 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 3201, 2020-05-18T21:29:54.085 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2020-05-18T21:29:54.085 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2020-05-18T21:29:54.085 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2020-05-18T21:29:54.085 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:29:54.086 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:29:54.086 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2020-05-18T21:29:54.086 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2020-05-18T21:29:54.086 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:29:54.086 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 0, 2020-05-18T21:29:54.086 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2020-05-18T21:29:54.087 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 11, 2020-05-18T21:29:54.087 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2020-05-18T21:29:54.087 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2020-05-18T21:29:54.087 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.087 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2020-05-18T21:29:54.087 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 12860, 2020-05-18T21:29:54.088 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 12186, 2020-05-18T21:29:54.088 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 12186, 2020-05-18T21:29:54.088 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 676, 2020-05-18T21:29:54.088 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 0, 2020-05-18T21:29:54.088 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 12186, 2020-05-18T21:29:54.089 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 15, 2020-05-18T21:29:54.089 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 15, 2020-05-18T21:29:54.089 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 15, 2020-05-18T21:29:54.089 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 16, 2020-05-18T21:29:54.089 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 0, 2020-05-18T21:29:54.089 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 15, 2020-05-18T21:29:54.090 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 28011406, 2020-05-18T21:29:54.090 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 28418356, 2020-05-18T21:29:54.090 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 4195196, 2020-05-18T21:29:54.090 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2020-05-18T21:29:54.090 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 43, 2020-05-18T21:29:54.091 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.430468146, 2020-05-18T21:29:54.091 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.010010887 2020-05-18T21:29:54.091 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.091 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 2 2020-05-18T21:29:54.091 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.091 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2020-05-18T21:29:54.092 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 686, 2020-05-18T21:29:54.092 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 3214, 2020-05-18T21:29:54.092 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 2528, 2020-05-18T21:29:54.092 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 12, 2020-05-18T21:29:54.092 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 87, 2020-05-18T21:29:54.092 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 75, 2020-05-18T21:29:54.093 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 684, 2020-05-18T21:29:54.093 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 6412, 2020-05-18T21:29:54.093 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 5728, 2020-05-18T21:29:54.093 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 1, 2020-05-18T21:29:54.093 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 3202, 2020-05-18T21:29:54.094 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 3201, 2020-05-18T21:29:54.094 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 88712, 2020-05-18T21:29:54.094 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 331932 2020-05-18T21:29:54.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.094 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2020-05-18T21:29:54.094 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 6553, 2020-05-18T21:29:54.095 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 0, 2020-05-18T21:29:54.095 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 6473, 2020-05-18T21:29:54.095 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 2, 2020-05-18T21:29:54.095 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_slave_request": 0, 2020-05-18T21:29:54.095 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2020-05-18T21:29:54.096 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3200, 2020-05-18T21:29:54.096 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 5.456048806, 2020-05-18T21:29:54.096 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001705015 2020-05-18T21:29:54.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.096 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2020-05-18T21:29:54.096 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2, 2020-05-18T21:29:54.097 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.078760379, 2020-05-18T21:29:54.097 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.039380189 2020-05-18T21:29:54.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.097 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2020-05-18T21:29:54.098 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.098 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.098 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.098 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2020-05-18T21:29:54.099 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.099 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.099 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.099 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2020-05-18T21:29:54.099 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.100 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.100 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.100 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.100 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2020-05-18T21:29:54.100 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.100 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.101 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.101 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2020-05-18T21:29:54.101 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.101 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.102 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.102 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2020-05-18T21:29:54.102 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.102 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.102 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.103 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2020-05-18T21:29:54.103 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.103 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.103 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.104 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.104 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2020-05-18T21:29:54.104 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.104 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.104 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.104 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.105 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2020-05-18T21:29:54.105 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.105 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.105 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.105 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2020-05-18T21:29:54.106 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1, 2020-05-18T21:29:54.106 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.006614312, 2020-05-18T21:29:54.106 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.006614312 2020-05-18T21:29:54.106 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.106 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2020-05-18T21:29:54.107 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.107 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.107 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.107 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2020-05-18T21:29:54.107 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.108 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.108 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.108 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.108 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2020-05-18T21:29:54.108 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.108 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.109 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.109 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.109 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2020-05-18T21:29:54.109 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 67, 2020-05-18T21:29:54.109 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.349282571, 2020-05-18T21:29:54.110 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.005213172 2020-05-18T21:29:54.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.110 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2020-05-18T21:29:54.110 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.110 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.110 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.111 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2020-05-18T21:29:54.111 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.111 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.111 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.112 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.112 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2020-05-18T21:29:54.112 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1, 2020-05-18T21:29:54.112 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.410237985, 2020-05-18T21:29:54.112 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.410237985 2020-05-18T21:29:54.112 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.113 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2020-05-18T21:29:54.113 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.113 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.113 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.114 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2020-05-18T21:29:54.114 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.114 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.114 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.114 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2020-05-18T21:29:54.115 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.115 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.115 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.115 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2020-05-18T21:29:54.116 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.116 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.116 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.116 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2020-05-18T21:29:54.116 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.117 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.117 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.117 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2020-05-18T21:29:54.117 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.118 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.118 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.118 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.118 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2020-05-18T21:29:54.118 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.118 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.119 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.119 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.119 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2020-05-18T21:29:54.119 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.120 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.120 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.120 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2020-05-18T21:29:54.120 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3200, 2020-05-18T21:29:54.121 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 7.048521677, 2020-05-18T21:29:54.121 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.002202663 2020-05-18T21:29:54.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.121 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0 2020-05-18T21:29:54.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.121 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2020-05-18T21:29:54.122 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 1, 2020-05-18T21:29:54.122 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 1, 2020-05-18T21:29:54.122 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 0, 2020-05-18T21:29:54.122 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 1, 2020-05-18T21:29:54.122 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2020-05-18T21:29:54.123 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 5605, 2020-05-18T21:29:54.123 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 5605, 2020-05-18T21:29:54.123 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 558 2020-05-18T21:29:54.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.123 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2020-05-18T21:29:54.123 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 120, 2020-05-18T21:29:54.124 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 120, 2020-05-18T21:29:54.124 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2020-05-18T21:29:54.124 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2020-05-18T21:29:54.124 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2020-05-18T21:29:54.124 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2020-05-18T21:29:54.125 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2020-05-18T21:29:54.125 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2020-05-18T21:29:54.125 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2020-05-18T21:29:54.125 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2020-05-18T21:29:54.125 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2020-05-18T21:29:54.125 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2020-05-18T21:29:54.126 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2020-05-18T21:29:54.126 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2020-05-18T21:29:54.126 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2020-05-18T21:29:54.126 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2020-05-18T21:29:54.126 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2020-05-18T21:29:54.127 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2020-05-18T21:29:54.127 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2020-05-18T21:29:54.127 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2020-05-18T21:29:54.127 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 1830554, 2020-05-18T21:29:54.127 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 595, 2020-05-18T21:29:54.127 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2020-05-18T21:29:54.128 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2020-05-18T21:29:54.128 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2020-05-18T21:29:54.128 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2020-05-18T21:29:54.128 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2020-05-18T21:29:54.128 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2020-05-18T21:29:54.128 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2020-05-18T21:29:54.129 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2020-05-18T21:29:54.129 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 6128, 2020-05-18T21:29:54.129 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 93, 2020-05-18T21:29:54.129 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2020-05-18T21:29:54.129 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2020-05-18T21:29:54.130 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2020-05-18T21:29:54.130 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2020-05-18T21:29:54.130 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 4986614, 2020-05-18T21:29:54.130 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 58290, 2020-05-18T21:29:54.130 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2020-05-18T21:29:54.130 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2020-05-18T21:29:54.131 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2020-05-18T21:29:54.131 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2020-05-18T21:29:54.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.131 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2020-05-18T21:29:54.131 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 0, 2020-05-18T21:29:54.132 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2020-05-18T21:29:54.132 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 4202, 2020-05-18T21:29:54.132 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 25621517, 2020-05-18T21:29:54.132 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 0, 2020-05-18T21:29:54.132 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 4202, 2020-05-18T21:29:54.132 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 4202, 2020-05-18T21:29:54.133 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 47, 2020-05-18T21:29:54.133 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 4155, 2020-05-18T21:29:54.133 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2020-05-18T21:29:54.133 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2020-05-18T21:29:54.133 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 12, 2020-05-18T21:29:54.133 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 684, 2020-05-18T21:29:54.134 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 29, 2020-05-18T21:29:54.134 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 64, 2020-05-18T21:29:54.134 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 15, 2020-05-18T21:29:54.134 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2020-05-18T21:29:54.134 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2020-05-18T21:29:54.135 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 1, 2020-05-18T21:29:54.135 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 1, 2020-05-18T21:29:54.135 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 3295, 2020-05-18T21:29:54.135 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2020-05-18T21:29:54.135 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2020-05-18T21:29:54.135 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2020-05-18T21:29:54.136 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 14, 2020-05-18T21:29:54.136 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 1368, 2020-05-18T21:29:54.136 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2020-05-18T21:29:54.136 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2020-05-18T21:29:54.136 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2020-05-18T21:29:54.137 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2020-05-18T21:29:54.137 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2020-05-18T21:29:54.137 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2020-05-18T21:29:54.137 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2020-05-18T21:29:54.137 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2020-05-18T21:29:54.137 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2020-05-18T21:29:54.138 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 0, 2020-05-18T21:29:54.138 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2020-05-18T21:29:54.138 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2020-05-18T21:29:54.138 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2020-05-18T21:29:54.138 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2020-05-18T21:29:54.138 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2020-05-18T21:29:54.139 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2020-05-18T21:29:54.139 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2020-05-18T21:29:54.139 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2020-05-18T21:29:54.139 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2020-05-18T21:29:54.139 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2020-05-18T21:29:54.140 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2020-05-18T21:29:54.140 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2020-05-18T21:29:54.140 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2020-05-18T21:29:54.140 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2020-05-18T21:29:54.140 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2020-05-18T21:29:54.140 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2020-05-18T21:29:54.141 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 0, 2020-05-18T21:29:54.141 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2020-05-18T21:29:54.141 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 0, 2020-05-18T21:29:54.141 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 7, 2020-05-18T21:29:54.141 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 7, 2020-05-18T21:29:54.142 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2020-05-18T21:29:54.142 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2020-05-18T21:29:54.142 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 176, 2020-05-18T21:29:54.142 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 28, 2020-05-18T21:29:54.142 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 8 2020-05-18T21:29:54.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.143 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2020-05-18T21:29:54.143 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 0, 2020-05-18T21:29:54.143 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2020-05-18T21:29:54.143 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2020-05-18T21:29:54.143 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2020-05-18T21:29:54.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.144 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2020-05-18T21:29:54.144 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 0, 2020-05-18T21:29:54.144 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 12, 2020-05-18T21:29:54.148 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 0, 2020-05-18T21:29:54.149 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 6, 2020-05-18T21:29:54.149 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 3201, 2020-05-18T21:29:54.149 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 0 2020-05-18T21:29:54.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.149 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-05-18T21:29:54.149 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:54.150 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:54.150 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:54.150 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 14196, 2020-05-18T21:29:54.150 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 3474957, 2020-05-18T21:29:54.150 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:54.151 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 14196, 2020-05-18T21:29:54.151 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:54.151 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:54.151 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 14196, 2020-05-18T21:29:54.151 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 3474957, 2020-05-18T21:29:54.151 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:54.152 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.152 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.152 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.152 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.153 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2020-05-18T21:29:54.153 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:54.153 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:54.153 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:54.154 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:54.154 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:54.154 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:54.154 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:54.154 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 4202, 2020-05-18T21:29:54.155 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 25945924, 2020-05-18T21:29:54.155 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 894, 2020-05-18T21:29:54.155 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 25945924, 2020-05-18T21:29:54.155 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:54.155 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.155 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.156 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.156 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.156 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2020-05-18T21:29:54.156 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:54.156 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2020-05-18T21:29:54.157 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:54.157 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:54.157 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:54.157 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:54.157 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:54.158 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 4202, 2020-05-18T21:29:54.158 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 4202, 2020-05-18T21:29:54.158 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 4202, 2020-05-18T21:29:54.158 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 4202, 2020-05-18T21:29:54.158 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:54.158 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.159 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.159 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.159 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.159 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2020-05-18T21:29:54.160 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:54.160 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:54.160 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:54.160 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 3201, 2020-05-18T21:29:54.160 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 323301, 2020-05-18T21:29:54.160 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:54.161 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 3201, 2020-05-18T21:29:54.161 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:54.161 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:54.161 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 21, 2020-05-18T21:29:54.161 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 323301, 2020-05-18T21:29:54.162 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:54.162 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.162 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.162 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.162 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.162 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.163 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x558953fdfd60": { 2020-05-18T21:29:54.163 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 404962, 2020-05-18T21:29:54.163 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:54.163 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:54.163 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 12860, 2020-05-18T21:29:54.163 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 24222722, 2020-05-18T21:29:54.164 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:54.164 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 12860, 2020-05-18T21:29:54.164 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:54.164 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:54.164 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 43, 2020-05-18T21:29:54.165 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 23817760, 2020-05-18T21:29:54.165 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:54.165 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.165 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.165 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.165 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.166 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.166 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:29:54.167 INFO:tasks.cephfs.filesystem:_json_asok output: { "AsyncMessenger::Worker-0": { "msgr_recv_messages": 3028, "msgr_send_messages": 3030, "msgr_recv_bytes": 1094512, "msgr_send_bytes": 11076529, "msgr_created_connections": 7, "msgr_active_connections": 1, "msgr_running_total_time": 0.252658408, "msgr_running_send_time": 0.113195877, "msgr_running_recv_time": 0.044749942, "msgr_running_fast_dispatch_time": 0.070180004, "msgr_send_messages_queue_lat": { "avgcount": 3029, "sum": 0.231630328, "avgtime": 0.000076470 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-1": { "msgr_recv_messages": 1066, "msgr_send_messages": 1073, "msgr_recv_bytes": 271161, "msgr_send_bytes": 6964706, "msgr_created_connections": 6, "msgr_active_connections": 3, "msgr_running_total_time": 0.120245160, "msgr_running_send_time": 0.061944213, "msgr_running_recv_time": 0.022145768, "msgr_running_fast_dispatch_time": 0.029954098, "msgr_send_messages_queue_lat": { "avgcount": 1073, "sum": 0.078933561, "avgtime": 0.000073563 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-2": { "msgr_recv_messages": 10109, "msgr_send_messages": 22990, "msgr_recv_bytes": 3161915, "msgr_send_bytes": 14476598, "msgr_created_connections": 4, "msgr_active_connections": 2, "msgr_running_total_time": 1.429213587, "msgr_running_send_time": 0.634211043, "msgr_running_recv_time": 0.916017356, "msgr_running_fast_dispatch_time": 0.009110489, "msgr_send_messages_queue_lat": { "avgcount": 22990, "sum": 0.671566734, "avgtime": 0.000029211 }, "msgr_handle_ack_lat": { "avgcount": 29221, "sum": 0.008301795, "avgtime": 0.000000284 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "queue_len": 0, "complete_latency": { "avgcount": 374, "sum": 4.131018651, "avgtime": 0.011045504 } }, "finisher-PurgeQueue": { "queue_len": 0, "complete_latency": { "avgcount": 3025, "sum": 0.596077949, "avgtime": 0.000197050 } }, "mds": { "request": 6473, "reply": 6471, "reply_latency": { "avgcount": 6471, "sum": 13.349465730, "avgtime": 0.002062967 }, "forward": 0, "dir_fetch": 12, "dir_commit": 87, "dir_split": 9, "dir_merge": 2, "inodes": 683, "inodes_top": 0, "inodes_bottom": 683, "inodes_pin_tail": 0, "inodes_pinned": 683, "inodes_expired": 1594, "inodes_with_caps": 674, "caps": 674, "subtrees": 2, "traverse": 6483, "traverse_hit": 6472, "traverse_forward": 0, "traverse_discover": 0, "traverse_dir_fetch": 0, "traverse_remote_ino": 0, "traverse_lock": 0, "load_cent": 657556, "q": 0, "exported": 0, "exported_inodes": 0, "imported": 0, "imported_inodes": 0, "openino_dir_fetch": 0, "openino_backtrace_fetch": 0, "openino_peer_discover": 0, "root_rfiles": 0, "root_rbytes": 0, "root_rsnaps": 0 }, "mds_cache": { "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "strays_created": 3201, "strays_enqueued": 3201, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 11, "ireq_fragstats": 0, "ireq_inodestats": 0 }, "mds_log": { "evadd": 12860, "evex": 12186, "evtrm": 12186, "ev": 676, "evexg": 0, "evexd": 12186, "segadd": 15, "segex": 15, "segtrm": 15, "seg": 16, "segexg": 0, "segexd": 15, "expos": 28011406, "wrpos": 28418356, "rdpos": 4195196, "jlat": { "avgcount": 43, "sum": 0.430468146, "avgtime": 0.010010887 }, "replayed": 2 }, "mds_mem": { "ino": 686, "ino+": 3214, "ino-": 2528, "dir": 12, "dir+": 87, "dir-": 75, "dn": 684, "dn+": 6412, "dn-": 5728, "cap": 1, "cap+": 3202, "cap-": 3201, "rss": 88712, "heap": 331932 }, "mds_server": { "dispatch_client_request": 6553, "dispatch_server_request": 0, "handle_client_request": 6473, "handle_client_session": 2, "handle_slave_request": 0, "req_create_latency": { "avgcount": 3200, "sum": 5.456048806, "avgtime": 0.001705015 }, "req_getattr_latency": { "avgcount": 2, "sum": 0.078760379, "avgtime": 0.039380189 }, "req_getfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_link_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookup_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookuphash_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupino_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupname_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupparent_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lssnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mkdir_latency": { "avgcount": 1, "sum": 0.006614312, "avgtime": 0.006614312 }, "req_mknod_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mksnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_open_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_readdir_latency": { "avgcount": 67, "sum": 0.349282571, "avgtime": 0.005213172 }, "req_rename_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_renamesnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmdir_latency": { "avgcount": 1, "sum": 0.410237985, "avgtime": 0.410237985 }, "req_rmsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setdirlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_symlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_unlink_latency": { "avgcount": 3200, "sum": 7.048521677, "avgtime": 0.002202663 }, "cap_revoke_eviction": 0 }, "mds_sessions": { "session_count": 1, "session_add": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 5605, "average_load": 5605, "avg_session_uptime": 558 }, "mempool": { "bloom_filter_bytes": 120, "bloom_filter_items": 120, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "buffer_anon_bytes": 1830554, "buffer_anon_items": 595, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6128, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 4986614, "mds_co_items": 58290, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "op_active": 0, "op_laggy": 0, "op_send": 4202, "op_send_bytes": 25621517, "op_resend": 0, "op_reply": 4202, "op": 4202, "op_r": 47, "op_w": 4155, "op_rmw": 0, "op_pg": 0, "osdop_stat": 12, "osdop_create": 684, "osdop_read": 29, "osdop_write": 64, "osdop_writefull": 15, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 1, "osdop_truncate": 1, "osdop_delete": 3295, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 14, "osdop_setxattr": 1368, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 7, "osd_session_open": 7, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 176, "omap_rd": 28, "omap_del": 8 }, "oft": { "omap_total_objs": 0, "omap_total_kv_pairs": 0, "omap_total_updates": 0, "omap_total_removes": 0 }, "purge_queue": { "pq_executing_ops": 0, "pq_executing_ops_high_water": 12, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executed": 3201, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "val": 0, "max": 104857600, "get_started": 0, "get": 14196, "get_sum": 3474957, "get_or_fail_fail": 0, "get_or_fail_success": 14196, "take": 0, "take_sum": 0, "put": 14196, "put_sum": 3474957, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_bytes": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 4202, "take_sum": 25945924, "put": 894, "put_sum": 25945924, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_ops": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 4202, "take_sum": 4202, "put": 4202, "put_sum": 4202, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle": { "val": 0, "max": 3758096384, "get_started": 0, "get": 3201, "get_sum": 323301, "get_or_fail_fail": 0, "get_or_fail_success": 3201, "take": 0, "take_sum": 0, "put": 21, "put_sum": 323301, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle-0x558953fdfd60": { "val": 404962, "max": 3758096384, "get_started": 0, "get": 12860, "get_sum": 24222722, "get_or_fail_fail": 0, "get_or_fail_success": 12860, "take": 0, "take_sum": 0, "put": 43, "put_sum": 23817760, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } 2020-05-18T21:29:54.168 INFO:tasks.cephfs.test_strays:Complete purge in 9 seconds 2020-05-18T21:29:54.169 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:54.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.273+0000 7fe20540d700 1 Processor -- start 2020-05-18T21:29:54.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.273+0000 7fe20540d700 1 -- start start 2020-05-18T21:29:54.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe20540d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe200147480 0x7fe20005a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:54.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe20540d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe2000ad460 0x7fe2000ad880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:54.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe20540d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20005ac20 con 0x7fe2000b5160 2020-05-18T21:29:54.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe20540d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe200066eb0 con 0x7fe2000ad460 2020-05-18T21:29:54.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe20540d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe20005ae60 con 0x7fe200147480 2020-05-18T21:29:54.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1feffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe2000b5160 0x7fe20012cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58928/0 (socket says 172.21.15.63:58928) 2020-05-18T21:29:54.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1ff7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe2000ad460 0x7fe2000ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:54.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1feffd700 1 -- 172.21.15.63:0/2862526360 learned_addr learned my addr 172.21.15.63:0/2862526360 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:54.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1fe7fc700 1 --2- 172.21.15.63:0/2862526360 >> v2:172.21.15.155:3300/0 conn(0x7fe200147480 0x7fe20005a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:54.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1fdffb700 1 -- 172.21.15.63:0/2862526360 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232199810 0 0) 0x7fe1f0001290 con 0x7fe2000b5160 2020-05-18T21:29:54.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1fdffb700 1 -- 172.21.15.63:0/2862526360 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1e4003270 con 0x7fe2000b5160 2020-05-18T21:29:54.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1ff7fe700 1 -- 172.21.15.63:0/2862526360 >> v2:172.21.15.155:3300/0 conn(0x7fe200147480 msgr2=0x7fe20005a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:54.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1ff7fe700 1 --2- 172.21.15.63:0/2862526360 >> v2:172.21.15.155:3300/0 conn(0x7fe200147480 0x7fe20005a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:54.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1ff7fe700 1 -- 172.21.15.63:0/2862526360 >> v1:172.21.15.63:6789/0 conn(0x7fe2000b5160 legacy=0x7fe20012cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:54.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1fdffb700 1 -- 172.21.15.63:0/2862526360 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 384761243 0 0) 0x7fe1e4003270 con 0x7fe2000b5160 2020-05-18T21:29:54.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1ff7fe700 1 -- 172.21.15.63:0/2862526360 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20005b100 con 0x7fe2000ad460 2020-05-18T21:29:54.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1ff7fe700 1 --2- 172.21.15.63:0/2862526360 >> v2:172.21.15.63:3300/0 conn(0x7fe2000ad460 0x7fe2000ad880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe1f0001bc0 tx=0x7fe1f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:54.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1ff7fe700 1 --2- 172.21.15.63:0/2862526360 >> v2:172.21.15.63:3300/0 conn(0x7fe2000ad460 0x7fe2000ad880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe1f0001bc0 tx=0x7fe1f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:54.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1ff7fe700 1 --2- 172.21.15.63:0/2862526360 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2000ad460 0x7fe2000ad880 secure :-1 s=READY pgs=786 cs=0 l=1 rx=0x7fe1f0001bc0 tx=0x7fe1f8007e00).ready entity=mon.0 client_cookie=cdf5f2ce645b3ef2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:54.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1ff7fe700 1 --2- 172.21.15.63:0/2862526360 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2000ad460 0x7fe2000ad880 secure :-1 s=THROTTLE_DONE pgs=786 cs=0 l=1 rx=0x7fe1f0001bc0 tx=0x7fe1f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:54.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1fdffb700 1 -- 172.21.15.63:0/2862526360 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1f0001a20 con 0x7fe2000ad460 2020-05-18T21:29:54.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1ff7fe700 1 --2- 172.21.15.63:0/2862526360 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2000ad460 0x7fe2000ad880 secure :-1 s=THROTTLE_DONE pgs=786 cs=0 l=1 rx=0x7fe1f0001bc0 tx=0x7fe1f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:54.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1ff7fe700 1 --2- 172.21.15.63:0/2862526360 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2000ad460 0x7fe2000ad880 secure :-1 s=THROTTLE_DONE pgs=786 cs=0 l=1 rx=0x7fe1f0001bc0 tx=0x7fe1f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:54.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1fdffb700 1 -- 172.21.15.63:0/2862526360 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f8010a50 con 0x7fe2000ad460 2020-05-18T21:29:54.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe1fdffb700 1 -- 172.21.15.63:0/2862526360 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1f8010df0 con 0x7fe2000ad460 2020-05-18T21:29:54.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe20540d700 1 -- 172.21.15.63:0/2862526360 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2000ad460 msgr2=0x7fe2000ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:54.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe20540d700 1 --2- 172.21.15.63:0/2862526360 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2000ad460 0x7fe2000ad880 secure :-1 s=READY pgs=786 cs=0 l=1 rx=0x7fe1f0001bc0 tx=0x7fe1f8007e00).stop 2020-05-18T21:29:54.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe20540d700 1 -- 172.21.15.63:0/2862526360 shutdown_connections 2020-05-18T21:29:54.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe20540d700 1 --2- 172.21.15.63:0/2862526360 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2000ad460 0x7fe2000ad880 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:54.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe20540d700 1 --2- 172.21.15.63:0/2862526360 >> v2:172.21.15.155:3300/0 conn(0x7fe200147480 0x7fe20005a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:54.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe20540d700 1 -- 172.21.15.63:0/2862526360 >> 172.21.15.63:0/2862526360 conn(0x7fe2000b8630 msgr2=0x7fe2000b8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:54.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe20540d700 1 -- 172.21.15.63:0/2862526360 shutdown_connections 2020-05-18T21:29:54.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.277+0000 7fe20540d700 1 -- 172.21.15.63:0/2862526360 wait complete. 2020-05-18T21:29:54.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe20540d700 1 Processor -- start 2020-05-18T21:29:54.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe20540d700 1 -- start start 2020-05-18T21:29:54.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe20540d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000ad460 0x7fe20014d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:54.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe20540d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe200123e50 con 0x7fe2000b5160 2020-05-18T21:29:54.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe20540d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2001236e0 con 0x7fe200147480 2020-05-18T21:29:54.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe20540d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20014d580 con 0x7fe2000ad460 2020-05-18T21:29:54.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe1fe7fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe2000b5160 0x7fe20014b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58934/0 (socket says 172.21.15.63:58934) 2020-05-18T21:29:54.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe1fe7fc700 1 -- 172.21.15.63:0/537597669 learned_addr learned my addr 172.21.15.63:0/537597669 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:54.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe1feffd700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000ad460 0x7fe20014d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:54.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe1effff700 1 -- 172.21.15.63:0/537597669 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800952717 0 0) 0x7fe200123e50 con 0x7fe2000b5160 2020-05-18T21:29:54.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe1effff700 1 -- 172.21.15.63:0/537597669 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1dc002fe0 con 0x7fe2000b5160 2020-05-18T21:29:54.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe1effff700 1 -- 172.21.15.63:0/537597669 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1316904125 0 0) 0x7fe2001236e0 con 0x7fe200147480 2020-05-18T21:29:54.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe1effff700 1 -- 172.21.15.63:0/537597669 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe200123e50 con 0x7fe200147480 2020-05-18T21:29:54.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe1effff700 1 -- 172.21.15.63:0/537597669 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2478120168 0 0) 0x7fe1dc002fe0 con 0x7fe2000b5160 2020-05-18T21:29:54.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe1feffd700 1 -- 172.21.15.63:0/537597669 >> v1:172.21.15.155:6789/0 conn(0x7fe200147480 legacy=0x7fe200149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:54.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe1feffd700 1 -- 172.21.15.63:0/537597669 >> v1:172.21.15.63:6789/0 conn(0x7fe2000b5160 legacy=0x7fe20014b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:54.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe1feffd700 1 -- 172.21.15.63:0/537597669 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe200120b10 con 0x7fe2000ad460 2020-05-18T21:29:54.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe1feffd700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000ad460 0x7fe20014d120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe1f4001670 tx=0x7fe20005fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:54.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe1feffd700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000ad460 0x7fe20014d120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe1f4001670 tx=0x7fe20005fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:54.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.281+0000 7fe1feffd700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000ad460 0x7fe20014d120 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7fe1f4001670 tx=0x7fe20005fbd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:54.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.285+0000 7fe1feffd700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000ad460 0x7fe20014d120 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fe1f4001670 tx=0x7fe20005fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:54.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.285+0000 7fe1effff700 1 -- 172.21.15.63:0/537597669 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1f40014d0 con 0x7fe2000ad460 2020-05-18T21:29:54.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.285+0000 7fe1feffd700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000ad460 0x7fe20014d120 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fe1f4001670 tx=0x7fe20005fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:54.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.285+0000 7fe1feffd700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000ad460 0x7fe20014d120 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fe1f4001670 tx=0x7fe20005fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:54.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.285+0000 7fe1effff700 1 -- 172.21.15.63:0/537597669 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f000c860 con 0x7fe2000ad460 2020-05-18T21:29:54.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.285+0000 7fe20540d700 1 -- 172.21.15.63:0/537597669 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe200123910 con 0x7fe2000ad460 2020-05-18T21:29:54.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.285+0000 7fe1effff700 1 -- 172.21.15.63:0/537597669 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1f000cbc0 con 0x7fe2000ad460 2020-05-18T21:29:54.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.285+0000 7fe20540d700 1 -- 172.21.15.63:0/537597669 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20014a440 con 0x7fe2000ad460 2020-05-18T21:29:54.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.285+0000 7fe1feffd700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000ad460 0x7fe20014d120 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fe1f4001670 tx=0x7fe20005fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:54.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.285+0000 7fe20540d700 1 -- 172.21.15.63:0/537597669 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20014d6f0 con 0x7fe2000ad460 2020-05-18T21:29:54.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.285+0000 7fe1effff700 1 -- 172.21.15.63:0/537597669 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe1f00054f0 con 0x7fe2000ad460 2020-05-18T21:29:54.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.285+0000 7fe1feffd700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000ad460 0x7fe20014d120 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fe1f4001670 tx=0x7fe20005fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:54.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.285+0000 7fe1effff700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe1dc04fe60 0x7fe1dc052320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:54.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.285+0000 7fe1effff700 1 -- 172.21.15.63:0/537597669 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe1f00100c0 con 0x7fe2000ad460 2020-05-18T21:29:54.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.285+0000 7fe1fe7fc700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe1dc04fe60 0x7fe1dc052320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:54.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.289+0000 7fe1fe7fc700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe1dc04fe60 0x7fe1dc052320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe1f4001630 tx=0x7fe1f4001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:54.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.289+0000 7fe1fe7fc700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe1dc04fe60 0x7fe1dc052320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe1f4001630 tx=0x7fe1f4001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:54.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.289+0000 7fe1fe7fc700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe1dc04fe60 0x7fe1dc052320 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7fe1f4001630 tx=0x7fe1f4001890).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:54.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.297+0000 7fe1feffd700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000ad460 0x7fe20014d120 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fe1f4001670 tx=0x7fe20005fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:54.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.297+0000 7fe1effff700 1 -- 172.21.15.63:0/537597669 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe1f003d7b0 con 0x7fe2000ad460 2020-05-18T21:29:54.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.449+0000 7fe20540d700 1 -- 172.21.15.63:0/537597669 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe20005ac20 con 0x7fe2000ad460 2020-05-18T21:29:54.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.449+0000 7fe1feffd700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000ad460 0x7fe20014d120 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fe1f4001670 tx=0x7fe20005fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:54.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.449+0000 7fe1effff700 1 -- 172.21.15.63:0/537597669 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2141 (secure 0 0 0) 0x7fe20005ac20 con 0x7fe2000ad460 2020-05-18T21:29:54.457 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:54.457 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/3895568247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3895568247},{"type":"v1","addr":"172.21.15.63:6833","nonce":3895568247}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:24.694515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6319":{"gid":6319,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/400120989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":400120989},{"type":"v1","addr":"172.21.15.155:6835","nonce":400120989}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:54.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.453+0000 7fe20540d700 1 -- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe1dc04fe60 msgr2=0x7fe1dc052320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:54.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.453+0000 7fe20540d700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe1dc04fe60 0x7fe1dc052320 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7fe1f4001630 tx=0x7fe1f4001890).stop 2020-05-18T21:29:54.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.453+0000 7fe20540d700 1 -- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000ad460 msgr2=0x7fe20014d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:54.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.453+0000 7fe20540d700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000ad460 0x7fe20014d120 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7fe1f4001670 tx=0x7fe20005fbd0).stop 2020-05-18T21:29:54.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.453+0000 7fe20540d700 1 -- 172.21.15.63:0/537597669 shutdown_connections 2020-05-18T21:29:54.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.453+0000 7fe20540d700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe1dc04fe60 0x7fe1dc052320 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:54.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.453+0000 7fe20540d700 1 --2- 172.21.15.63:0/537597669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000ad460 0x7fe20014d120 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:54.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.453+0000 7fe20540d700 1 -- 172.21.15.63:0/537597669 >> 172.21.15.63:0/537597669 conn(0x7fe2000b8630 msgr2=0x7fe2000b7980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:54.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.453+0000 7fe20540d700 1 -- 172.21.15.63:0/537597669 shutdown_connections 2020-05-18T21:29:54.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:54.453+0000 7fe20540d700 1 -- 172.21.15.63:0/537597669 wait complete. 2020-05-18T21:29:54.461 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 34 2020-05-18T21:29:54.469 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2020-05-18T21:29:54.574 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:29:54.574 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2020-05-18T21:29:54.575 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 3028, 2020-05-18T21:29:54.575 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 3030, 2020-05-18T21:29:54.575 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 1094512, 2020-05-18T21:29:54.575 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 11076529, 2020-05-18T21:29:54.575 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 7, 2020-05-18T21:29:54.575 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 1, 2020-05-18T21:29:54.576 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.252658408, 2020-05-18T21:29:54.576 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.113195877, 2020-05-18T21:29:54.576 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.044749942, 2020-05-18T21:29:54.576 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.070180004, 2020-05-18T21:29:54.576 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:54.577 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3029, 2020-05-18T21:29:54.577 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.231630328, 2020-05-18T21:29:54.577 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000076470 2020-05-18T21:29:54.578 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.578 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:54.578 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.578 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.579 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.579 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.579 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.579 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2020-05-18T21:29:54.579 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 1066, 2020-05-18T21:29:54.580 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 1073, 2020-05-18T21:29:54.580 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 271161, 2020-05-18T21:29:54.580 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 6964706, 2020-05-18T21:29:54.580 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 6, 2020-05-18T21:29:54.580 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 3, 2020-05-18T21:29:54.581 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.120245160, 2020-05-18T21:29:54.581 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.061944213, 2020-05-18T21:29:54.581 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.022145768, 2020-05-18T21:29:54.581 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.029954098, 2020-05-18T21:29:54.581 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:54.581 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1073, 2020-05-18T21:29:54.582 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.078933561, 2020-05-18T21:29:54.582 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000073563 2020-05-18T21:29:54.582 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.582 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:54.582 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.583 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.583 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.583 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.583 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.583 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2020-05-18T21:29:54.583 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 10109, 2020-05-18T21:29:54.584 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 22990, 2020-05-18T21:29:54.584 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 3161915, 2020-05-18T21:29:54.584 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 14476598, 2020-05-18T21:29:54.584 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 4, 2020-05-18T21:29:54.584 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 2, 2020-05-18T21:29:54.585 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 1.429213587, 2020-05-18T21:29:54.585 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.634211043, 2020-05-18T21:29:54.585 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.916017356, 2020-05-18T21:29:54.585 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.009110489, 2020-05-18T21:29:54.585 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:29:54.585 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 22990, 2020-05-18T21:29:54.586 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.671566734, 2020-05-18T21:29:54.586 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000029211 2020-05-18T21:29:54.586 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.586 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:29:54.586 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 29221, 2020-05-18T21:29:54.587 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.008301795, 2020-05-18T21:29:54.587 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000284 2020-05-18T21:29:54.587 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.587 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2020-05-18T21:29:54.587 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2020-05-18T21:29:54.588 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2020-05-18T21:29:54.588 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.588 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2020-05-18T21:29:54.588 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:54.588 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:54.589 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 374, 2020-05-18T21:29:54.589 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 4.131018651, 2020-05-18T21:29:54.589 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.011045504 2020-05-18T21:29:54.589 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.589 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2020-05-18T21:29:54.590 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2020-05-18T21:29:54.590 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2020-05-18T21:29:54.590 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3025, 2020-05-18T21:29:54.590 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.596077949, 2020-05-18T21:29:54.590 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000197050 2020-05-18T21:29:54.591 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.591 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.591 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2020-05-18T21:29:54.591 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 6473, 2020-05-18T21:29:54.591 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 6471, 2020-05-18T21:29:54.591 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2020-05-18T21:29:54.592 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 6471, 2020-05-18T21:29:54.592 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 13.349465730, 2020-05-18T21:29:54.592 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.002062967 2020-05-18T21:29:54.592 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.592 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 0, 2020-05-18T21:29:54.593 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch": 12, 2020-05-18T21:29:54.593 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 87, 2020-05-18T21:29:54.593 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 9, 2020-05-18T21:29:54.593 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 2, 2020-05-18T21:29:54.593 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 683, 2020-05-18T21:29:54.593 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 0, 2020-05-18T21:29:54.594 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 683, 2020-05-18T21:29:54.594 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 0, 2020-05-18T21:29:54.594 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 683, 2020-05-18T21:29:54.594 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 1594, 2020-05-18T21:29:54.594 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 674, 2020-05-18T21:29:54.595 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 674, 2020-05-18T21:29:54.595 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 2, 2020-05-18T21:29:54.595 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 6483, 2020-05-18T21:29:54.595 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 6472, 2020-05-18T21:29:54.595 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 0, 2020-05-18T21:29:54.595 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 0, 2020-05-18T21:29:54.596 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2020-05-18T21:29:54.596 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2020-05-18T21:29:54.596 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 0, 2020-05-18T21:29:54.596 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 657556, 2020-05-18T21:29:54.596 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2020-05-18T21:29:54.596 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 0, 2020-05-18T21:29:54.597 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 0, 2020-05-18T21:29:54.597 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 0, 2020-05-18T21:29:54.597 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 0, 2020-05-18T21:29:54.597 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2020-05-18T21:29:54.597 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 0, 2020-05-18T21:29:54.598 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2020-05-18T21:29:54.598 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 0, 2020-05-18T21:29:54.598 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 0, 2020-05-18T21:29:54.598 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 0 2020-05-18T21:29:54.598 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.598 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:29:54.599 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 0, 2020-05-18T21:29:54.599 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 0, 2020-05-18T21:29:54.599 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:29:54.599 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 3201, 2020-05-18T21:29:54.599 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 3201, 2020-05-18T21:29:54.600 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2020-05-18T21:29:54.600 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2020-05-18T21:29:54.600 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2020-05-18T21:29:54.600 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:29:54.601 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:29:54.601 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2020-05-18T21:29:54.601 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2020-05-18T21:29:54.601 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:29:54.601 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 0, 2020-05-18T21:29:54.601 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2020-05-18T21:29:54.602 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 11, 2020-05-18T21:29:54.602 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2020-05-18T21:29:54.602 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2020-05-18T21:29:54.602 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.602 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2020-05-18T21:29:54.603 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 12860, 2020-05-18T21:29:54.603 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 12186, 2020-05-18T21:29:54.603 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 12186, 2020-05-18T21:29:54.603 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 676, 2020-05-18T21:29:54.603 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 0, 2020-05-18T21:29:54.603 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 12186, 2020-05-18T21:29:54.604 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 15, 2020-05-18T21:29:54.604 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 15, 2020-05-18T21:29:54.604 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 15, 2020-05-18T21:29:54.604 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 16, 2020-05-18T21:29:54.604 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 0, 2020-05-18T21:29:54.605 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 15, 2020-05-18T21:29:54.605 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 28011406, 2020-05-18T21:29:54.605 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 28418356, 2020-05-18T21:29:54.605 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 4195196, 2020-05-18T21:29:54.606 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2020-05-18T21:29:54.606 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 43, 2020-05-18T21:29:54.606 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.430468146, 2020-05-18T21:29:54.606 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.010010887 2020-05-18T21:29:54.606 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.606 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 2 2020-05-18T21:29:54.607 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.607 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2020-05-18T21:29:54.607 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 686, 2020-05-18T21:29:54.607 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 3214, 2020-05-18T21:29:54.607 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 2528, 2020-05-18T21:29:54.608 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 12, 2020-05-18T21:29:54.608 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 87, 2020-05-18T21:29:54.608 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 75, 2020-05-18T21:29:54.608 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 684, 2020-05-18T21:29:54.608 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 6412, 2020-05-18T21:29:54.608 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 5728, 2020-05-18T21:29:54.609 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 1, 2020-05-18T21:29:54.609 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 3202, 2020-05-18T21:29:54.609 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 3201, 2020-05-18T21:29:54.609 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 88712, 2020-05-18T21:29:54.609 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 331932 2020-05-18T21:29:54.610 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.610 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2020-05-18T21:29:54.610 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 6553, 2020-05-18T21:29:54.610 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 0, 2020-05-18T21:29:54.610 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 6473, 2020-05-18T21:29:54.610 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 2, 2020-05-18T21:29:54.611 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_slave_request": 0, 2020-05-18T21:29:54.611 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2020-05-18T21:29:54.611 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3200, 2020-05-18T21:29:54.611 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 5.456048806, 2020-05-18T21:29:54.611 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001705015 2020-05-18T21:29:54.611 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.612 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2020-05-18T21:29:54.612 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2, 2020-05-18T21:29:54.612 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.078760379, 2020-05-18T21:29:54.612 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.039380189 2020-05-18T21:29:54.612 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.613 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2020-05-18T21:29:54.613 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.613 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.613 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.613 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.613 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2020-05-18T21:29:54.614 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.614 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.614 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.614 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.614 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2020-05-18T21:29:54.615 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.615 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.615 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.615 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2020-05-18T21:29:54.615 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.616 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.616 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.616 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.616 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2020-05-18T21:29:54.616 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.617 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.617 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.617 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2020-05-18T21:29:54.617 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.617 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.618 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.618 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.618 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2020-05-18T21:29:54.618 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.618 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.619 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.619 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2020-05-18T21:29:54.619 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.619 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.619 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.620 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.620 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2020-05-18T21:29:54.620 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.620 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.620 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.621 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2020-05-18T21:29:54.621 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1, 2020-05-18T21:29:54.621 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.006614312, 2020-05-18T21:29:54.621 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.006614312 2020-05-18T21:29:54.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.622 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2020-05-18T21:29:54.622 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.622 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.622 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.623 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.623 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2020-05-18T21:29:54.623 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.623 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.623 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.623 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.624 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2020-05-18T21:29:54.624 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.624 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.624 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.625 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2020-05-18T21:29:54.625 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 67, 2020-05-18T21:29:54.625 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.349282571, 2020-05-18T21:29:54.625 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.005213172 2020-05-18T21:29:54.626 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.626 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2020-05-18T21:29:54.626 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.626 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.626 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.626 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.627 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2020-05-18T21:29:54.627 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.627 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.627 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.627 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.627 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2020-05-18T21:29:54.628 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1, 2020-05-18T21:29:54.628 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.410237985, 2020-05-18T21:29:54.628 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.410237985 2020-05-18T21:29:54.628 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.628 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2020-05-18T21:29:54.629 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.629 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.629 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.629 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.629 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2020-05-18T21:29:54.630 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.630 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.630 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.630 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.630 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2020-05-18T21:29:54.630 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.631 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.631 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.631 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2020-05-18T21:29:54.631 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.632 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.632 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.632 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.632 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2020-05-18T21:29:54.632 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.632 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.633 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.633 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.633 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2020-05-18T21:29:54.633 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.633 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.634 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.634 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2020-05-18T21:29:54.634 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.634 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.634 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.635 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.635 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2020-05-18T21:29:54.635 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.635 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.635 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.635 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.636 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2020-05-18T21:29:54.636 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3200, 2020-05-18T21:29:54.636 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 7.048521677, 2020-05-18T21:29:54.636 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.002202663 2020-05-18T21:29:54.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.637 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0 2020-05-18T21:29:54.637 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.637 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2020-05-18T21:29:54.637 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 1, 2020-05-18T21:29:54.637 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 1, 2020-05-18T21:29:54.637 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 0, 2020-05-18T21:29:54.638 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 1, 2020-05-18T21:29:54.638 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2020-05-18T21:29:54.638 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 5605, 2020-05-18T21:29:54.638 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 5605, 2020-05-18T21:29:54.638 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 558 2020-05-18T21:29:54.639 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.639 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2020-05-18T21:29:54.639 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 120, 2020-05-18T21:29:54.639 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 120, 2020-05-18T21:29:54.639 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2020-05-18T21:29:54.639 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2020-05-18T21:29:54.640 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2020-05-18T21:29:54.640 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2020-05-18T21:29:54.640 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2020-05-18T21:29:54.640 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2020-05-18T21:29:54.640 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2020-05-18T21:29:54.641 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2020-05-18T21:29:54.641 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2020-05-18T21:29:54.641 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2020-05-18T21:29:54.641 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2020-05-18T21:29:54.641 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2020-05-18T21:29:54.641 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2020-05-18T21:29:54.642 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2020-05-18T21:29:54.642 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2020-05-18T21:29:54.642 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2020-05-18T21:29:54.642 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2020-05-18T21:29:54.642 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2020-05-18T21:29:54.643 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 1830554, 2020-05-18T21:29:54.643 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 595, 2020-05-18T21:29:54.643 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2020-05-18T21:29:54.643 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2020-05-18T21:29:54.643 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2020-05-18T21:29:54.643 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2020-05-18T21:29:54.644 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2020-05-18T21:29:54.644 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2020-05-18T21:29:54.644 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2020-05-18T21:29:54.644 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2020-05-18T21:29:54.644 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 6128, 2020-05-18T21:29:54.645 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 93, 2020-05-18T21:29:54.645 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2020-05-18T21:29:54.645 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2020-05-18T21:29:54.645 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2020-05-18T21:29:54.645 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2020-05-18T21:29:54.645 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 4986614, 2020-05-18T21:29:54.646 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 58290, 2020-05-18T21:29:54.646 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2020-05-18T21:29:54.646 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2020-05-18T21:29:54.646 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2020-05-18T21:29:54.646 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2020-05-18T21:29:54.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.647 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2020-05-18T21:29:54.647 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 0, 2020-05-18T21:29:54.647 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2020-05-18T21:29:54.647 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 4202, 2020-05-18T21:29:54.647 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 25621517, 2020-05-18T21:29:54.648 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 0, 2020-05-18T21:29:54.648 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 4202, 2020-05-18T21:29:54.648 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 4202, 2020-05-18T21:29:54.648 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 47, 2020-05-18T21:29:54.648 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 4155, 2020-05-18T21:29:54.649 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2020-05-18T21:29:54.649 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2020-05-18T21:29:54.649 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 12, 2020-05-18T21:29:54.649 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 684, 2020-05-18T21:29:54.649 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 29, 2020-05-18T21:29:54.649 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 64, 2020-05-18T21:29:54.650 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 15, 2020-05-18T21:29:54.650 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2020-05-18T21:29:54.650 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2020-05-18T21:29:54.650 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 1, 2020-05-18T21:29:54.650 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 1, 2020-05-18T21:29:54.651 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 3295, 2020-05-18T21:29:54.651 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2020-05-18T21:29:54.651 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2020-05-18T21:29:54.651 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2020-05-18T21:29:54.651 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 14, 2020-05-18T21:29:54.652 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 1368, 2020-05-18T21:29:54.652 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2020-05-18T21:29:54.652 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2020-05-18T21:29:54.652 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2020-05-18T21:29:54.652 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2020-05-18T21:29:54.653 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2020-05-18T21:29:54.653 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2020-05-18T21:29:54.653 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2020-05-18T21:29:54.653 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2020-05-18T21:29:54.653 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2020-05-18T21:29:54.654 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 0, 2020-05-18T21:29:54.654 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2020-05-18T21:29:54.654 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2020-05-18T21:29:54.654 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2020-05-18T21:29:54.654 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2020-05-18T21:29:54.654 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2020-05-18T21:29:54.655 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2020-05-18T21:29:54.655 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2020-05-18T21:29:54.655 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2020-05-18T21:29:54.655 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2020-05-18T21:29:54.655 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2020-05-18T21:29:54.655 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2020-05-18T21:29:54.656 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2020-05-18T21:29:54.656 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2020-05-18T21:29:54.656 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2020-05-18T21:29:54.656 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2020-05-18T21:29:54.656 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2020-05-18T21:29:54.657 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 0, 2020-05-18T21:29:54.657 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2020-05-18T21:29:54.657 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 0, 2020-05-18T21:29:54.657 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 7, 2020-05-18T21:29:54.658 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 7, 2020-05-18T21:29:54.658 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2020-05-18T21:29:54.658 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2020-05-18T21:29:54.658 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 176, 2020-05-18T21:29:54.658 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 28, 2020-05-18T21:29:54.658 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 8 2020-05-18T21:29:54.659 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.659 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2020-05-18T21:29:54.659 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 0, 2020-05-18T21:29:54.659 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2020-05-18T21:29:54.659 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2020-05-18T21:29:54.660 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2020-05-18T21:29:54.660 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.660 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2020-05-18T21:29:54.660 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 0, 2020-05-18T21:29:54.660 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 12, 2020-05-18T21:29:54.660 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 0, 2020-05-18T21:29:54.661 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 6, 2020-05-18T21:29:54.661 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 3201, 2020-05-18T21:29:54.661 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 0 2020-05-18T21:29:54.661 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.661 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-05-18T21:29:54.662 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:54.662 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:54.662 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:54.662 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 14196, 2020-05-18T21:29:54.663 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 3474957, 2020-05-18T21:29:54.663 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:54.663 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 14196, 2020-05-18T21:29:54.663 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:54.663 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:54.663 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 14196, 2020-05-18T21:29:54.664 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 3474957, 2020-05-18T21:29:54.664 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:54.664 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.664 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.664 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.664 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.665 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.665 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2020-05-18T21:29:54.665 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:54.665 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2020-05-18T21:29:54.665 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:54.666 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:54.666 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:54.666 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:54.666 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:54.666 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 4202, 2020-05-18T21:29:54.666 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 25945924, 2020-05-18T21:29:54.667 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 894, 2020-05-18T21:29:54.667 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 25945924, 2020-05-18T21:29:54.667 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:54.667 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.667 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.667 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.668 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.668 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.668 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2020-05-18T21:29:54.668 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:54.668 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2020-05-18T21:29:54.669 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:54.669 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2020-05-18T21:29:54.669 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2020-05-18T21:29:54.669 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:54.669 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2020-05-18T21:29:54.669 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 4202, 2020-05-18T21:29:54.670 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 4202, 2020-05-18T21:29:54.670 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 4202, 2020-05-18T21:29:54.670 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 4202, 2020-05-18T21:29:54.670 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:54.670 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.671 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.671 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.671 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.671 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.671 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2020-05-18T21:29:54.671 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2020-05-18T21:29:54.672 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:54.672 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:54.672 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 3201, 2020-05-18T21:29:54.672 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 323301, 2020-05-18T21:29:54.672 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:54.673 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 3201, 2020-05-18T21:29:54.673 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:54.673 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:54.673 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 21, 2020-05-18T21:29:54.673 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 323301, 2020-05-18T21:29:54.673 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:54.674 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.674 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.674 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.674 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.674 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:29:54.674 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x558953fdfd60": { 2020-05-18T21:29:54.675 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 404962, 2020-05-18T21:29:54.675 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2020-05-18T21:29:54.675 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2020-05-18T21:29:54.675 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 12860, 2020-05-18T21:29:54.675 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 24222722, 2020-05-18T21:29:54.676 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2020-05-18T21:29:54.676 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 12860, 2020-05-18T21:29:54.676 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2020-05-18T21:29:54.676 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2020-05-18T21:29:54.676 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 43, 2020-05-18T21:29:54.676 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 23817760, 2020-05-18T21:29:54.677 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2020-05-18T21:29:54.677 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2020-05-18T21:29:54.677 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2020-05-18T21:29:54.677 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2020-05-18T21:29:54.677 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.678 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:29:54.678 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:29:54.680 INFO:tasks.cephfs.filesystem:_json_asok output: { "AsyncMessenger::Worker-0": { "msgr_recv_messages": 3028, "msgr_send_messages": 3030, "msgr_recv_bytes": 1094512, "msgr_send_bytes": 11076529, "msgr_created_connections": 7, "msgr_active_connections": 1, "msgr_running_total_time": 0.252658408, "msgr_running_send_time": 0.113195877, "msgr_running_recv_time": 0.044749942, "msgr_running_fast_dispatch_time": 0.070180004, "msgr_send_messages_queue_lat": { "avgcount": 3029, "sum": 0.231630328, "avgtime": 0.000076470 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-1": { "msgr_recv_messages": 1066, "msgr_send_messages": 1073, "msgr_recv_bytes": 271161, "msgr_send_bytes": 6964706, "msgr_created_connections": 6, "msgr_active_connections": 3, "msgr_running_total_time": 0.120245160, "msgr_running_send_time": 0.061944213, "msgr_running_recv_time": 0.022145768, "msgr_running_fast_dispatch_time": 0.029954098, "msgr_send_messages_queue_lat": { "avgcount": 1073, "sum": 0.078933561, "avgtime": 0.000073563 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-2": { "msgr_recv_messages": 10109, "msgr_send_messages": 22990, "msgr_recv_bytes": 3161915, "msgr_send_bytes": 14476598, "msgr_created_connections": 4, "msgr_active_connections": 2, "msgr_running_total_time": 1.429213587, "msgr_running_send_time": 0.634211043, "msgr_running_recv_time": 0.916017356, "msgr_running_fast_dispatch_time": 0.009110489, "msgr_send_messages_queue_lat": { "avgcount": 22990, "sum": 0.671566734, "avgtime": 0.000029211 }, "msgr_handle_ack_lat": { "avgcount": 29221, "sum": 0.008301795, "avgtime": 0.000000284 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "queue_len": 0, "complete_latency": { "avgcount": 374, "sum": 4.131018651, "avgtime": 0.011045504 } }, "finisher-PurgeQueue": { "queue_len": 0, "complete_latency": { "avgcount": 3025, "sum": 0.596077949, "avgtime": 0.000197050 } }, "mds": { "request": 6473, "reply": 6471, "reply_latency": { "avgcount": 6471, "sum": 13.349465730, "avgtime": 0.002062967 }, "forward": 0, "dir_fetch": 12, "dir_commit": 87, "dir_split": 9, "dir_merge": 2, "inodes": 683, "inodes_top": 0, "inodes_bottom": 683, "inodes_pin_tail": 0, "inodes_pinned": 683, "inodes_expired": 1594, "inodes_with_caps": 674, "caps": 674, "subtrees": 2, "traverse": 6483, "traverse_hit": 6472, "traverse_forward": 0, "traverse_discover": 0, "traverse_dir_fetch": 0, "traverse_remote_ino": 0, "traverse_lock": 0, "load_cent": 657556, "q": 0, "exported": 0, "exported_inodes": 0, "imported": 0, "imported_inodes": 0, "openino_dir_fetch": 0, "openino_backtrace_fetch": 0, "openino_peer_discover": 0, "root_rfiles": 0, "root_rbytes": 0, "root_rsnaps": 0 }, "mds_cache": { "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "strays_created": 3201, "strays_enqueued": 3201, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 11, "ireq_fragstats": 0, "ireq_inodestats": 0 }, "mds_log": { "evadd": 12860, "evex": 12186, "evtrm": 12186, "ev": 676, "evexg": 0, "evexd": 12186, "segadd": 15, "segex": 15, "segtrm": 15, "seg": 16, "segexg": 0, "segexd": 15, "expos": 28011406, "wrpos": 28418356, "rdpos": 4195196, "jlat": { "avgcount": 43, "sum": 0.430468146, "avgtime": 0.010010887 }, "replayed": 2 }, "mds_mem": { "ino": 686, "ino+": 3214, "ino-": 2528, "dir": 12, "dir+": 87, "dir-": 75, "dn": 684, "dn+": 6412, "dn-": 5728, "cap": 1, "cap+": 3202, "cap-": 3201, "rss": 88712, "heap": 331932 }, "mds_server": { "dispatch_client_request": 6553, "dispatch_server_request": 0, "handle_client_request": 6473, "handle_client_session": 2, "handle_slave_request": 0, "req_create_latency": { "avgcount": 3200, "sum": 5.456048806, "avgtime": 0.001705015 }, "req_getattr_latency": { "avgcount": 2, "sum": 0.078760379, "avgtime": 0.039380189 }, "req_getfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_link_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookup_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookuphash_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupino_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupname_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupparent_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lssnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mkdir_latency": { "avgcount": 1, "sum": 0.006614312, "avgtime": 0.006614312 }, "req_mknod_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mksnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_open_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_readdir_latency": { "avgcount": 67, "sum": 0.349282571, "avgtime": 0.005213172 }, "req_rename_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_renamesnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmdir_latency": { "avgcount": 1, "sum": 0.410237985, "avgtime": 0.410237985 }, "req_rmsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setdirlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_symlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_unlink_latency": { "avgcount": 3200, "sum": 7.048521677, "avgtime": 0.002202663 }, "cap_revoke_eviction": 0 }, "mds_sessions": { "session_count": 1, "session_add": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 5605, "average_load": 5605, "avg_session_uptime": 558 }, "mempool": { "bloom_filter_bytes": 120, "bloom_filter_items": 120, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "buffer_anon_bytes": 1830554, "buffer_anon_items": 595, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6128, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 4986614, "mds_co_items": 58290, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "op_active": 0, "op_laggy": 0, "op_send": 4202, "op_send_bytes": 25621517, "op_resend": 0, "op_reply": 4202, "op": 4202, "op_r": 47, "op_w": 4155, "op_rmw": 0, "op_pg": 0, "osdop_stat": 12, "osdop_create": 684, "osdop_read": 29, "osdop_write": 64, "osdop_writefull": 15, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 1, "osdop_truncate": 1, "osdop_delete": 3295, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 14, "osdop_setxattr": 1368, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 7, "osd_session_open": 7, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 176, "omap_rd": 28, "omap_del": 8 }, "oft": { "omap_total_objs": 0, "omap_total_kv_pairs": 0, "omap_total_updates": 0, "omap_total_removes": 0 }, "purge_queue": { "pq_executing_ops": 0, "pq_executing_ops_high_water": 12, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executed": 3201, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "val": 0, "max": 104857600, "get_started": 0, "get": 14196, "get_sum": 3474957, "get_or_fail_fail": 0, "get_or_fail_success": 14196, "take": 0, "take_sum": 0, "put": 14196, "put_sum": 3474957, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_bytes": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 4202, "take_sum": 25945924, "put": 894, "put_sum": 25945924, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_ops": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 4202, "take_sum": 4202, "put": 4202, "put_sum": 4202, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle": { "val": 0, "max": 3758096384, "get_started": 0, "get": 3201, "get_sum": 323301, "get_or_fail_fail": 0, "get_or_fail_success": 3201, "take": 0, "take_sum": 0, "put": 21, "put_sum": 323301, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle-0x558953fdfd60": { "val": 404962, "max": 3758096384, "get_started": 0, "get": 12860, "get_sum": 24222722, "get_or_fail_fail": 0, "get_or_fail_success": 12860, "take": 0, "take_sum": 0, "put": 43, "put_sum": 23817760, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } 2020-05-18T21:29:54.681 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:29:54.681 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:29:54.702 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:29:54.719 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:29:54.720 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:29:54.721 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:29:54.721 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:29:54.761 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[22155]: fuse finished with error 0 and tester_r 0 2020-05-18T21:29:54.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:54.763 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:29:54.769 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:29:54.769 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:29:54.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:54.770 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.1 down' 2020-05-18T21:29:54.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:54.788 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.1' 2020-05-18T21:29:54.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:54.859 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:29:54.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:54.877 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:29:54.883 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:29:54.884 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:29:54.884 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:29:54.884 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:29:54.884 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:29:54.884 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:29:54.885 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:29:54.885 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:54.885 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:29:54.885 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:54.885 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:29:54.886 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:54.886 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:29:54.886 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:54.886 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:29:54.887 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42648sec preferred_lft 42648sec 2020-05-18T21:29:54.887 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:29:54.887 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:29:54.887 INFO:teuthology.orchestra.run.smithi063.stdout:17: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-05-18T21:29:54.887 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:54.888 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:29:54.888 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:29:54.888 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::c4d1:72ff:fe6a:1767/64 scope link 2020-05-18T21:29:54.888 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:29:54.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:54.889 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:29:54.906 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:29:54.906 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:29:54.906 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:29:54.907 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:54.907 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:29:54.907 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:54.907 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:29:54.907 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:54.907 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:29:54.908 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:54.908 INFO:teuthology.orchestra.run.smithi063.stdout:17: ceph-brx: mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:29:54.908 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:54.909 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:29:54.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:54.910 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:29:54.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:54.998 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:29:55.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:55.111 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:29:55.120 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:29:55.120 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:29:55.120 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:29:55.121 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:29:55.121 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:29:55.121 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:29:55.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:55.122 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:29:55.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:55.141 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:29:55.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:55.154 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:29:55.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:55.218 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:29:55.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:55.226 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:29:55.232 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-05-18T21:29:55.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:29:55.233 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-05-18T21:29:55.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:55.234 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:29:55.240 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:29:55.241 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:29:55.241 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:29:55.241 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:29:55.241 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:29:55.242 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:29:55.242 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:29:55.242 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:55.242 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:29:55.242 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:55.242 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:29:55.243 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:55.243 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:29:55.243 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:55.243 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:29:55.243 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42647sec preferred_lft 42647sec 2020-05-18T21:29:55.244 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:29:55.244 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:29:55.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:55.245 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:29:55.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:55.252 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:29:55.259 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2020-05-18T21:29:55.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:29:55.260 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-05-18T21:29:55.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:55.261 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:29:55.309 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:29:55.310 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:29:55.310 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:29:55.310 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:29:55.310 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:29:55.310 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:29:55.311 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:29:55.311 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:55.311 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:29:55.311 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:55.311 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:29:55.311 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:55.312 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:29:55.312 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:55.312 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:29:55.312 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42652sec preferred_lft 42652sec 2020-05-18T21:29:55.312 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:29:55.313 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:29:55.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:55.313 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:29:55.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:55.321 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:29:55.328 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2020-05-18T21:29:55.328 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:29:55.329 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-05-18T21:29:55.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:55.330 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:29:55.377 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:29:55.377 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:29:55.378 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:29:55.378 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:29:55.378 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:29:55.378 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:29:55.378 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:29:55.379 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:55.379 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:29:55.379 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:55.379 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:29:55.379 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:55.380 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:29:55.380 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:29:55.380 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:29:55.380 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42652sec preferred_lft 42652sec 2020-05-18T21:29:55.380 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:29:55.380 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:29:55.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:29:55.381 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:29:55.389 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:29:55.392 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:29:55.427 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2020-05-18T21:29:55.428 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2020-05-18T21:29:55.428 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:29:55.428 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2020-05-18T21:29:55.429 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.429 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2020-05-18T21:29:55.429 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.429 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2020-05-18T21:29:55.429 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.430 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2020-05-18T21:29:55.430 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2020-05-18T21:29:55.430 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.430 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2020-05-18T21:29:55.430 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2020-05-18T21:29:55.431 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.431 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:29:55.431 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2020-05-18T21:29:55.431 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.432 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:29:55.432 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:29:55.432 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.432 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2020-05-18T21:29:55.432 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2020-05-18T21:29:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2020-05-18T21:29:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:29:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:29:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2020-05-18T21:29:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:29:55.434 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2020-05-18T21:29:55.434 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:29:55.434 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:29:55.434 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2020-05-18T21:29:55.434 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.435 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:29:55.435 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.435 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2020-05-18T21:29:55.435 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.435 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2020-05-18T21:29:55.435 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.436 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2020-05-18T21:29:55.436 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2020-05-18T21:29:55.436 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:29:55.436 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:29:55.436 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.437 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2020-05-18T21:29:55.437 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2020-05-18T21:29:55.437 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.437 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2020-05-18T21:29:55.437 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2020-05-18T21:29:55.437 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.438 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2020-05-18T21:29:55.438 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2020-05-18T21:29:55.438 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.438 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2020-05-18T21:29:55.438 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2020-05-18T21:29:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2020-05-18T21:29:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2020-05-18T21:29:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2020-05-18T21:29:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:29:55.440 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.440 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2020-05-18T21:29:55.440 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.440 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2020-05-18T21:29:55.440 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:29:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2020-05-18T21:29:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2020-05-18T21:29:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2020-05-18T21:29:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2020-05-18T21:29:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2020-05-18T21:29:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2020-05-18T21:29:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2020-05-18T21:29:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2020-05-18T21:29:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2020-05-18T21:29:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2020-05-18T21:29:55.443 INFO:teuthology.orchestra.run.smithi063.stdout: debug filestore = 20 2020-05-18T21:29:55.443 INFO:teuthology.orchestra.run.smithi063.stdout: debug journal = 20 2020-05-18T21:29:55.443 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 20 2020-05-18T21:29:55.443 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 25 2020-05-18T21:29:55.443 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2020-05-18T21:29:55.444 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:29:55.444 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2020-05-18T21:29:55.444 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:29:55.444 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:29:55.444 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2020-05-18T21:29:55.444 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:29:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.445 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2020-05-18T21:29:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2020-05-18T21:29:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:29:55.446 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:29:55.446 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:55.446 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:55.446 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2020-05-18T21:29:55.446 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.446 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2020-05-18T21:29:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:29:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2020-05-18T21:29:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:29:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2020-05-18T21:29:55.448 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2020-05-18T21:29:55.448 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:55.448 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2020-05-18T21:29:55.448 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2020-05-18T21:29:55.449 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:55.450 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2020-05-18T21:29:55.450 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.451 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2020-05-18T21:29:55.451 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2020-05-18T21:29:55.452 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2020-05-18T21:29:55.452 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2020-05-18T21:29:55.452 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:29:55.452 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:29:55.452 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2020-05-18T21:29:55.453 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2020-05-18T21:29:55.453 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:55.453 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2020-05-18T21:29:55.453 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2020-05-18T21:29:55.453 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2020-05-18T21:29:55.454 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2020-05-18T21:29:55.454 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2020-05-18T21:29:55.454 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2020-05-18T21:29:55.454 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2020-05-18T21:29:55.454 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2020-05-18T21:29:55.454 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:55.455 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal frag = True 2020-05-18T21:29:55.455 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal fragment size max = 10000 2020-05-18T21:29:55.455 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal merge size = 5 2020-05-18T21:29:55.455 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split bits = 3 2020-05-18T21:29:55.455 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split size = 100 2020-05-18T21:29:55.456 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2020-05-18T21:29:55.456 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2020-05-18T21:29:55.456 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2020-05-18T21:29:55.456 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2020-05-18T21:29:55.456 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:29:55.457 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_files = 6 2020-05-18T21:29:55.457 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_ops = 100000000 2020-05-18T21:29:55.458 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2020-05-18T21:29:55.458 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2020-05-18T21:29:55.458 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:29:55.459 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2020-05-18T21:29:55.459 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.459 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2020-05-18T21:29:55.459 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.459 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2020-05-18T21:29:55.460 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.460 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2020-05-18T21:29:55.460 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2020-05-18T21:29:55.460 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.460 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2020-05-18T21:29:55.460 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2020-05-18T21:29:55.461 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.461 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:29:55.461 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2020-05-18T21:29:55.461 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.461 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:29:55.462 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:29:55.462 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.462 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2020-05-18T21:29:55.462 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.462 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2020-05-18T21:29:55.462 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2020-05-18T21:29:55.463 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:29:55.463 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:29:55.463 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2020-05-18T21:29:55.463 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:29:55.463 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2020-05-18T21:29:55.464 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:29:55.464 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:29:55.464 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2020-05-18T21:29:55.464 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.464 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:29:55.464 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.465 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2020-05-18T21:29:55.465 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.465 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2020-05-18T21:29:55.465 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.465 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2020-05-18T21:29:55.466 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2020-05-18T21:29:55.466 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:29:55.466 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:29:55.466 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.466 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2020-05-18T21:29:55.466 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2020-05-18T21:29:55.467 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.467 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2020-05-18T21:29:55.467 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2020-05-18T21:29:55.467 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.467 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2020-05-18T21:29:55.468 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2020-05-18T21:29:55.468 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.468 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2020-05-18T21:29:55.468 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2020-05-18T21:29:55.468 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2020-05-18T21:29:55.468 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.469 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2020-05-18T21:29:55.469 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2020-05-18T21:29:55.469 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.469 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:29:55.469 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.470 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2020-05-18T21:29:55.470 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.470 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2020-05-18T21:29:55.470 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.470 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:29:55.470 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2020-05-18T21:29:55.471 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.471 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2020-05-18T21:29:55.471 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2020-05-18T21:29:55.471 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2020-05-18T21:29:55.471 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2020-05-18T21:29:55.471 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2020-05-18T21:29:55.472 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2020-05-18T21:29:55.472 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2020-05-18T21:29:55.472 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2020-05-18T21:29:55.472 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2020-05-18T21:29:55.472 INFO:teuthology.orchestra.run.smithi155.stdout: debug filestore = 20 2020-05-18T21:29:55.473 INFO:teuthology.orchestra.run.smithi155.stdout: debug journal = 20 2020-05-18T21:29:55.473 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 20 2020-05-18T21:29:55.473 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 25 2020-05-18T21:29:55.473 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2020-05-18T21:29:55.473 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:29:55.473 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2020-05-18T21:29:55.474 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:29:55.474 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:29:55.474 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2020-05-18T21:29:55.474 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:29:55.474 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.475 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2020-05-18T21:29:55.475 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:55.475 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2020-05-18T21:29:55.475 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:29:55.475 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:29:55.475 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:55.476 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:55.476 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2020-05-18T21:29:55.476 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.476 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2020-05-18T21:29:55.476 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:55.476 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:29:55.477 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2020-05-18T21:29:55.477 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:29:55.477 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2020-05-18T21:29:55.477 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2020-05-18T21:29:55.477 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:55.478 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2020-05-18T21:29:55.478 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2020-05-18T21:29:55.478 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:55.478 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2020-05-18T21:29:55.478 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.478 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2020-05-18T21:29:55.479 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2020-05-18T21:29:55.479 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2020-05-18T21:29:55.479 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2020-05-18T21:29:55.479 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:29:55.479 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:29:55.480 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2020-05-18T21:29:55.480 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2020-05-18T21:29:55.480 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:55.480 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2020-05-18T21:29:55.480 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2020-05-18T21:29:55.480 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2020-05-18T21:29:55.481 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2020-05-18T21:29:55.481 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2020-05-18T21:29:55.481 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2020-05-18T21:29:55.481 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2020-05-18T21:29:55.481 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2020-05-18T21:29:55.482 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:55.482 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal frag = True 2020-05-18T21:29:55.482 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2020-05-18T21:29:55.482 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2020-05-18T21:29:55.482 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2020-05-18T21:29:55.482 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2020-05-18T21:29:55.483 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2020-05-18T21:29:55.483 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2020-05-18T21:29:55.483 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2020-05-18T21:29:55.483 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2020-05-18T21:29:55.483 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:29:55.483 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_files = 6 2020-05-18T21:29:55.484 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_ops = 100000000 2020-05-18T21:29:55.518 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:29:55.520 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:29:55.571 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2020-05-18T21:29:55.571 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2020-05-18T21:29:55.572 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:29:55.572 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2020-05-18T21:29:55.572 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.572 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2020-05-18T21:29:55.572 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.572 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2020-05-18T21:29:55.573 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.573 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2020-05-18T21:29:55.573 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2020-05-18T21:29:55.573 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.573 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2020-05-18T21:29:55.574 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2020-05-18T21:29:55.574 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.574 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:29:55.574 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2020-05-18T21:29:55.574 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.574 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:29:55.575 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:29:55.575 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.575 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2020-05-18T21:29:55.575 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.575 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2020-05-18T21:29:55.576 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2020-05-18T21:29:55.576 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:29:55.576 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:29:55.576 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2020-05-18T21:29:55.576 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:29:55.576 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2020-05-18T21:29:55.577 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:29:55.577 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:29:55.577 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2020-05-18T21:29:55.577 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.577 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:29:55.578 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.578 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2020-05-18T21:29:55.578 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.578 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2020-05-18T21:29:55.578 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.578 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2020-05-18T21:29:55.579 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2020-05-18T21:29:55.579 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:29:55.579 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:29:55.579 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.579 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2020-05-18T21:29:55.580 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2020-05-18T21:29:55.580 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.580 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2020-05-18T21:29:55.580 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2020-05-18T21:29:55.580 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.580 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2020-05-18T21:29:55.581 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2020-05-18T21:29:55.581 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.581 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2020-05-18T21:29:55.581 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2020-05-18T21:29:55.581 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2020-05-18T21:29:55.582 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.582 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2020-05-18T21:29:55.582 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2020-05-18T21:29:55.582 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.582 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:29:55.582 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.583 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2020-05-18T21:29:55.583 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.583 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2020-05-18T21:29:55.583 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.583 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:29:55.583 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2020-05-18T21:29:55.584 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.584 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2020-05-18T21:29:55.584 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2020-05-18T21:29:55.584 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2020-05-18T21:29:55.584 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2020-05-18T21:29:55.585 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2020-05-18T21:29:55.585 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2020-05-18T21:29:55.585 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2020-05-18T21:29:55.585 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2020-05-18T21:29:55.597 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2020-05-18T21:29:55.597 INFO:teuthology.orchestra.run.smithi063.stdout: debug filestore = 20 2020-05-18T21:29:55.597 INFO:teuthology.orchestra.run.smithi063.stdout: debug journal = 20 2020-05-18T21:29:55.597 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 20 2020-05-18T21:29:55.597 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 25 2020-05-18T21:29:55.598 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2020-05-18T21:29:55.598 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:29:55.598 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2020-05-18T21:29:55.598 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:29:55.598 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:29:55.598 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2020-05-18T21:29:55.599 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:29:55.599 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.599 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2020-05-18T21:29:55.599 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:55.599 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2020-05-18T21:29:55.600 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:29:55.600 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:29:55.600 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:55.600 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:55.600 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2020-05-18T21:29:55.600 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.601 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2020-05-18T21:29:55.601 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:55.601 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:29:55.601 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2020-05-18T21:29:55.601 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:29:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2020-05-18T21:29:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2020-05-18T21:29:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2020-05-18T21:29:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2020-05-18T21:29:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:55.603 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2020-05-18T21:29:55.603 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.603 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2020-05-18T21:29:55.603 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2020-05-18T21:29:55.603 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2020-05-18T21:29:55.604 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2020-05-18T21:29:55.604 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:29:55.604 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:29:55.604 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2020-05-18T21:29:55.604 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2020-05-18T21:29:55.604 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:55.605 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2020-05-18T21:29:55.605 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2020-05-18T21:29:55.605 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2020-05-18T21:29:55.605 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2020-05-18T21:29:55.605 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2020-05-18T21:29:55.605 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2020-05-18T21:29:55.606 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2020-05-18T21:29:55.606 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2020-05-18T21:29:55.606 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:55.606 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal frag = True 2020-05-18T21:29:55.607 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal fragment size max = 10000 2020-05-18T21:29:55.607 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal merge size = 5 2020-05-18T21:29:55.607 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split bits = 3 2020-05-18T21:29:55.607 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split size = 100 2020-05-18T21:29:55.608 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2020-05-18T21:29:55.608 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2020-05-18T21:29:55.608 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2020-05-18T21:29:55.608 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2020-05-18T21:29:55.608 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:29:55.608 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_files = 6 2020-05-18T21:29:55.610 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2020-05-18T21:29:55.610 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2020-05-18T21:29:55.610 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:29:55.611 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2020-05-18T21:29:55.611 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.611 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2020-05-18T21:29:55.611 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.611 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2020-05-18T21:29:55.612 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.612 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2020-05-18T21:29:55.612 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2020-05-18T21:29:55.612 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.612 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2020-05-18T21:29:55.612 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2020-05-18T21:29:55.613 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.613 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:29:55.613 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2020-05-18T21:29:55.613 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.613 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:29:55.614 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:29:55.614 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.614 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2020-05-18T21:29:55.614 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.614 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2020-05-18T21:29:55.614 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2020-05-18T21:29:55.615 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:29:55.615 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:29:55.615 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2020-05-18T21:29:55.615 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:29:55.615 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2020-05-18T21:29:55.616 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:29:55.616 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:29:55.616 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2020-05-18T21:29:55.616 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.616 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:29:55.616 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.617 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2020-05-18T21:29:55.617 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.617 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2020-05-18T21:29:55.617 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.617 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2020-05-18T21:29:55.618 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2020-05-18T21:29:55.618 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:29:55.618 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:29:55.618 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.618 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2020-05-18T21:29:55.618 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2020-05-18T21:29:55.619 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.619 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2020-05-18T21:29:55.619 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2020-05-18T21:29:55.619 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.619 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2020-05-18T21:29:55.620 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2020-05-18T21:29:55.620 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.620 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2020-05-18T21:29:55.620 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2020-05-18T21:29:55.620 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2020-05-18T21:29:55.620 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.621 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2020-05-18T21:29:55.621 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2020-05-18T21:29:55.621 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.621 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:29:55.621 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.622 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2020-05-18T21:29:55.622 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.622 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2020-05-18T21:29:55.622 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.622 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:29:55.622 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2020-05-18T21:29:55.623 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.623 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2020-05-18T21:29:55.623 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2020-05-18T21:29:55.623 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2020-05-18T21:29:55.623 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2020-05-18T21:29:55.623 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2020-05-18T21:29:55.624 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2020-05-18T21:29:55.624 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2020-05-18T21:29:55.624 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2020-05-18T21:29:55.624 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2020-05-18T21:29:55.624 INFO:teuthology.orchestra.run.smithi155.stdout: debug filestore = 20 2020-05-18T21:29:55.625 INFO:teuthology.orchestra.run.smithi155.stdout: debug journal = 20 2020-05-18T21:29:55.625 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 20 2020-05-18T21:29:55.625 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 25 2020-05-18T21:29:55.625 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2020-05-18T21:29:55.625 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:29:55.625 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2020-05-18T21:29:55.626 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:29:55.626 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:29:55.626 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2020-05-18T21:29:55.626 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:29:55.626 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.627 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2020-05-18T21:29:55.627 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:55.627 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2020-05-18T21:29:55.627 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:29:55.627 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:29:55.627 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:55.628 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:55.628 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2020-05-18T21:29:55.628 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.628 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2020-05-18T21:29:55.628 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:55.629 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:29:55.629 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2020-05-18T21:29:55.629 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:29:55.629 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2020-05-18T21:29:55.629 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2020-05-18T21:29:55.629 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:55.630 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2020-05-18T21:29:55.630 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2020-05-18T21:29:55.630 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:55.630 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2020-05-18T21:29:55.631 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.631 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2020-05-18T21:29:55.631 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2020-05-18T21:29:55.631 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2020-05-18T21:29:55.631 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2020-05-18T21:29:55.631 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:29:55.632 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:29:55.632 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2020-05-18T21:29:55.632 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2020-05-18T21:29:55.632 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:55.632 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2020-05-18T21:29:55.633 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2020-05-18T21:29:55.633 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2020-05-18T21:29:55.633 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2020-05-18T21:29:55.633 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2020-05-18T21:29:55.634 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2020-05-18T21:29:55.634 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2020-05-18T21:29:55.634 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2020-05-18T21:29:55.634 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:55.634 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal frag = True 2020-05-18T21:29:55.634 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2020-05-18T21:29:55.635 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2020-05-18T21:29:55.635 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2020-05-18T21:29:55.635 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2020-05-18T21:29:55.635 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2020-05-18T21:29:55.635 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2020-05-18T21:29:55.636 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2020-05-18T21:29:55.636 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2020-05-18T21:29:55.636 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:29:55.636 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_files = 6 2020-05-18T21:29:55.637 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:29:55.640 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:29:55.676 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2020-05-18T21:29:55.676 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2020-05-18T21:29:55.676 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:29:55.677 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2020-05-18T21:29:55.677 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.677 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2020-05-18T21:29:55.677 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.677 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2020-05-18T21:29:55.678 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.678 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2020-05-18T21:29:55.678 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2020-05-18T21:29:55.678 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.678 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2020-05-18T21:29:55.678 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2020-05-18T21:29:55.679 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.679 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:29:55.679 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2020-05-18T21:29:55.679 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.679 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:29:55.680 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:29:55.680 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.680 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2020-05-18T21:29:55.680 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.680 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2020-05-18T21:29:55.680 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2020-05-18T21:29:55.681 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:29:55.681 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:29:55.681 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2020-05-18T21:29:55.681 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:29:55.681 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2020-05-18T21:29:55.682 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:29:55.682 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:29:55.682 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2020-05-18T21:29:55.682 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.682 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:29:55.682 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.683 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2020-05-18T21:29:55.683 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.683 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2020-05-18T21:29:55.683 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.683 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2020-05-18T21:29:55.684 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2020-05-18T21:29:55.684 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:29:55.684 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:29:55.684 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.684 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2020-05-18T21:29:55.684 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2020-05-18T21:29:55.685 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.685 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2020-05-18T21:29:55.685 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2020-05-18T21:29:55.685 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.685 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2020-05-18T21:29:55.686 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2020-05-18T21:29:55.686 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.686 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2020-05-18T21:29:55.686 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2020-05-18T21:29:55.686 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2020-05-18T21:29:55.686 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.687 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2020-05-18T21:29:55.687 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2020-05-18T21:29:55.687 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.687 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:29:55.688 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.688 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2020-05-18T21:29:55.688 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.688 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2020-05-18T21:29:55.689 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.689 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:29:55.689 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2020-05-18T21:29:55.690 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.690 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2020-05-18T21:29:55.690 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2020-05-18T21:29:55.690 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2020-05-18T21:29:55.690 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2020-05-18T21:29:55.690 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2020-05-18T21:29:55.691 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2020-05-18T21:29:55.691 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2020-05-18T21:29:55.691 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2020-05-18T21:29:55.691 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2020-05-18T21:29:55.691 INFO:teuthology.orchestra.run.smithi155.stdout: debug filestore = 20 2020-05-18T21:29:55.692 INFO:teuthology.orchestra.run.smithi155.stdout: debug journal = 20 2020-05-18T21:29:55.692 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 20 2020-05-18T21:29:55.692 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 25 2020-05-18T21:29:55.692 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2020-05-18T21:29:55.692 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:29:55.692 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2020-05-18T21:29:55.693 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:29:55.693 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:29:55.693 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2020-05-18T21:29:55.693 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:29:55.693 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.694 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2020-05-18T21:29:55.694 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:55.694 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2020-05-18T21:29:55.694 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:29:55.694 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:29:55.694 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:55.695 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:55.695 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2020-05-18T21:29:55.695 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.695 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2020-05-18T21:29:55.695 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:55.696 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:29:55.696 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2020-05-18T21:29:55.696 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:29:55.696 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2020-05-18T21:29:55.696 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2020-05-18T21:29:55.696 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:55.697 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2020-05-18T21:29:55.697 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2020-05-18T21:29:55.697 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:55.697 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2020-05-18T21:29:55.697 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:29:55.698 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2020-05-18T21:29:55.698 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2020-05-18T21:29:55.698 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2020-05-18T21:29:55.698 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2020-05-18T21:29:55.698 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:29:55.698 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:29:55.699 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2020-05-18T21:29:55.699 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2020-05-18T21:29:55.699 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:55.699 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2020-05-18T21:29:55.699 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2020-05-18T21:29:55.700 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2020-05-18T21:29:55.700 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2020-05-18T21:29:55.700 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2020-05-18T21:29:55.700 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2020-05-18T21:29:55.700 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2020-05-18T21:29:55.700 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2020-05-18T21:29:55.701 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:29:55.701 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal frag = True 2020-05-18T21:29:55.701 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2020-05-18T21:29:55.701 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2020-05-18T21:29:55.701 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2020-05-18T21:29:55.702 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2020-05-18T21:29:55.702 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2020-05-18T21:29:55.702 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2020-05-18T21:29:55.702 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2020-05-18T21:29:55.702 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2020-05-18T21:29:55.702 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:29:55.704 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2020-05-18T21:29:55.704 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2020-05-18T21:29:55.704 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:29:55.704 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2020-05-18T21:29:55.705 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.705 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2020-05-18T21:29:55.705 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.705 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2020-05-18T21:29:55.705 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.706 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2020-05-18T21:29:55.706 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2020-05-18T21:29:55.706 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.706 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2020-05-18T21:29:55.706 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2020-05-18T21:29:55.707 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.707 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:29:55.707 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2020-05-18T21:29:55.708 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.708 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:29:55.708 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:29:55.708 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2020-05-18T21:29:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2020-05-18T21:29:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2020-05-18T21:29:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:29:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:29:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2020-05-18T21:29:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:29:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2020-05-18T21:29:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:29:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:29:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2020-05-18T21:29:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:29:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2020-05-18T21:29:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.712 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2020-05-18T21:29:55.712 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.712 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2020-05-18T21:29:55.712 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2020-05-18T21:29:55.712 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:29:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:29:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.713 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2020-05-18T21:29:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2020-05-18T21:29:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2020-05-18T21:29:55.714 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2020-05-18T21:29:55.714 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.714 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2020-05-18T21:29:55.714 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2020-05-18T21:29:55.714 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.714 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2020-05-18T21:29:55.715 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2020-05-18T21:29:55.715 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2020-05-18T21:29:55.715 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.715 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2020-05-18T21:29:55.715 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2020-05-18T21:29:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:29:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2020-05-18T21:29:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2020-05-18T21:29:55.717 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.717 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:29:55.717 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2020-05-18T21:29:55.717 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.717 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2020-05-18T21:29:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2020-05-18T21:29:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2020-05-18T21:29:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2020-05-18T21:29:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2020-05-18T21:29:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2020-05-18T21:29:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2020-05-18T21:29:55.719 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2020-05-18T21:29:55.719 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2020-05-18T21:29:55.719 INFO:teuthology.orchestra.run.smithi063.stdout: debug filestore = 20 2020-05-18T21:29:55.719 INFO:teuthology.orchestra.run.smithi063.stdout: debug journal = 20 2020-05-18T21:29:55.719 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 20 2020-05-18T21:29:55.719 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 25 2020-05-18T21:29:55.720 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2020-05-18T21:29:55.720 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:29:55.720 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2020-05-18T21:29:55.720 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:29:55.720 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:29:55.721 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2020-05-18T21:29:55.721 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:29:55.721 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.721 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2020-05-18T21:29:55.721 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:55.721 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2020-05-18T21:29:55.722 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:29:55.722 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:29:55.722 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:55.722 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:55.722 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2020-05-18T21:29:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.723 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2020-05-18T21:29:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:29:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2020-05-18T21:29:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:29:55.724 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2020-05-18T21:29:55.724 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2020-05-18T21:29:55.724 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:29:55.724 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2020-05-18T21:29:55.724 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2020-05-18T21:29:55.724 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:29:55.725 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2020-05-18T21:29:55.725 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:55.725 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2020-05-18T21:29:55.725 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2020-05-18T21:29:55.725 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2020-05-18T21:29:55.726 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2020-05-18T21:29:55.726 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:29:55.726 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:29:55.726 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2020-05-18T21:29:55.726 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2020-05-18T21:29:55.726 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:55.727 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2020-05-18T21:29:55.727 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2020-05-18T21:29:55.727 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2020-05-18T21:29:55.727 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2020-05-18T21:29:55.727 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2020-05-18T21:29:55.728 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2020-05-18T21:29:55.728 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2020-05-18T21:29:55.728 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2020-05-18T21:29:55.728 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:29:55.728 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal frag = True 2020-05-18T21:29:55.728 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal fragment size max = 10000 2020-05-18T21:29:55.729 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal merge size = 5 2020-05-18T21:29:55.729 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split bits = 3 2020-05-18T21:29:55.729 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split size = 100 2020-05-18T21:29:55.729 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2020-05-18T21:29:55.729 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2020-05-18T21:29:55.730 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2020-05-18T21:29:55.731 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2020-05-18T21:29:55.731 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:29:55.731 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_strays.TestStrays.test_files_throttle' 2020-05-18T21:29:55.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1ef66700 1 Processor -- start 2020-05-18T21:29:55.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1ef66700 1 -- start start 2020-05-18T21:29:55.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1ef66700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc181435d0 0x7fdc18063ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:55.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1ef66700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdc18147140 0x7fdc1805edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:55.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1ef66700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc181480a0 con 0x7fdc1805f230 2020-05-18T21:29:55.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1ef66700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc181476c0 con 0x7fdc18147140 2020-05-18T21:29:55.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1ef66700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc18147960 con 0x7fdc181435d0 2020-05-18T21:29:55.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1e765700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdc1805f230 0x7fdc180b8200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58944/0 (socket says 172.21.15.63:58944) 2020-05-18T21:29:55.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1e765700 1 -- 172.21.15.63:0/3832272566 learned_addr learned my addr 172.21.15.63:0/3832272566 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:55.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1d763700 1 --2- 172.21.15.63:0/3832272566 >> v2:172.21.15.155:3300/0 conn(0x7fdc18147140 0x7fdc1805edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:55.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1df64700 1 --2- 172.21.15.63:0/3832272566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc181435d0 0x7fdc18063ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:55.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1cf62700 1 -- 172.21.15.63:0/3832272566 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581687505 0 0) 0x7fdc181480a0 con 0x7fdc1805f230 2020-05-18T21:29:55.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1cf62700 1 -- 172.21.15.63:0/3832272566 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc00003270 con 0x7fdc1805f230 2020-05-18T21:29:55.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1d763700 1 -- 172.21.15.63:0/3832272566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc181435d0 msgr2=0x7fdc18063ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:55.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1d763700 1 --2- 172.21.15.63:0/3832272566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc181435d0 0x7fdc18063ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:55.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1d763700 1 -- 172.21.15.63:0/3832272566 >> v1:172.21.15.63:6789/0 conn(0x7fdc1805f230 legacy=0x7fdc180b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:55.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1d763700 1 -- 172.21.15.63:0/3832272566 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc18147c00 con 0x7fdc18147140 2020-05-18T21:29:55.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1d763700 1 --2- 172.21.15.63:0/3832272566 >> v2:172.21.15.155:3300/0 conn(0x7fdc18147140 0x7fdc1805edd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdc14002f70 tx=0x7fdc14007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:55.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1d763700 1 --2- 172.21.15.63:0/3832272566 >> v2:172.21.15.155:3300/0 conn(0x7fdc18147140 0x7fdc1805edd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdc14002f70 tx=0x7fdc14007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:55.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1d763700 1 --2- 172.21.15.63:0/3832272566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc18147140 0x7fdc1805edd0 secure :-1 s=READY pgs=558 cs=0 l=1 rx=0x7fdc14002f70 tx=0x7fdc14007a80).ready entity=mon.1 client_cookie=a16599c5a5113655 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:55.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1d763700 1 --2- 172.21.15.63:0/3832272566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc18147140 0x7fdc1805edd0 secure :-1 s=THROTTLE_DONE pgs=558 cs=0 l=1 rx=0x7fdc14002f70 tx=0x7fdc14007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:55.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1cf62700 1 -- 172.21.15.63:0/3832272566 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc14008e80 con 0x7fdc18147140 2020-05-18T21:29:55.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1d763700 1 --2- 172.21.15.63:0/3832272566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc18147140 0x7fdc1805edd0 secure :-1 s=THROTTLE_DONE pgs=558 cs=0 l=1 rx=0x7fdc14002f70 tx=0x7fdc14007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:55.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1d763700 1 --2- 172.21.15.63:0/3832272566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc18147140 0x7fdc1805edd0 secure :-1 s=THROTTLE_DONE pgs=558 cs=0 l=1 rx=0x7fdc14002f70 tx=0x7fdc14007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:55.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1cf62700 1 -- 172.21.15.63:0/3832272566 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc14011540 con 0x7fdc18147140 2020-05-18T21:29:55.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1cf62700 1 -- 172.21.15.63:0/3832272566 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc14011960 con 0x7fdc18147140 2020-05-18T21:29:55.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1ef66700 1 -- 172.21.15.63:0/3832272566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc18147140 msgr2=0x7fdc1805edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:55.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.853+0000 7fdc1ef66700 1 --2- 172.21.15.63:0/3832272566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc18147140 0x7fdc1805edd0 secure :-1 s=READY pgs=558 cs=0 l=1 rx=0x7fdc14002f70 tx=0x7fdc14007a80).stop 2020-05-18T21:29:55.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.857+0000 7fdc1ef66700 1 -- 172.21.15.63:0/3832272566 shutdown_connections 2020-05-18T21:29:55.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.857+0000 7fdc1ef66700 1 --2- 172.21.15.63:0/3832272566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc18147140 0x7fdc1805edd0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:55.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.857+0000 7fdc1ef66700 1 --2- 172.21.15.63:0/3832272566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc181435d0 0x7fdc18063ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:55.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.857+0000 7fdc1ef66700 1 -- 172.21.15.63:0/3832272566 >> 172.21.15.63:0/3832272566 conn(0x7fdc18069fc0 msgr2=0x7fdc1806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:55.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.857+0000 7fdc1ef66700 1 -- 172.21.15.63:0/3832272566 shutdown_connections 2020-05-18T21:29:55.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.857+0000 7fdc1ef66700 1 -- 172.21.15.63:0/3832272566 wait complete. 2020-05-18T21:29:55.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.857+0000 7fdc1ef66700 1 Processor -- start 2020-05-18T21:29:55.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.857+0000 7fdc1ef66700 1 -- start start 2020-05-18T21:29:55.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.857+0000 7fdc1ef66700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc1805f230 0x7fdc1813f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:55.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.857+0000 7fdc1ef66700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdc181435d0 0x7fdc180aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:55.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.857+0000 7fdc1ef66700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdc18147140 0x7fdc180ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:55.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.857+0000 7fdc1ef66700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc180ae330 con 0x7fdc18147140 2020-05-18T21:29:55.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.857+0000 7fdc1ef66700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc180ae5d0 con 0x7fdc181435d0 2020-05-18T21:29:55.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.857+0000 7fdc1ef66700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc180ae870 con 0x7fdc1805f230 2020-05-18T21:29:55.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1e765700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdc18147140 0x7fdc180ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:55.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1e765700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdc18147140 0x7fdc180ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56762/0 (socket says 172.21.15.63:56762) 2020-05-18T21:29:55.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1e765700 1 -- 172.21.15.63:0/3612882434 learned_addr learned my addr 172.21.15.63:0/3612882434 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:55.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1d763700 1 --2- 172.21.15.63:0/3612882434 >> v2:172.21.15.155:3300/0 conn(0x7fdc181435d0 0x7fdc180aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:55.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1df64700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc1805f230 0x7fdc1813f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:55.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1e765700 1 -- 172.21.15.63:0/3612882434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc1805f230 msgr2=0x7fdc1813f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:55.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1e765700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc1805f230 0x7fdc1813f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:55.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1e765700 1 -- 172.21.15.63:0/3612882434 >> v2:172.21.15.155:3300/0 conn(0x7fdc181435d0 msgr2=0x7fdc180aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:55.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1e765700 1 --2- 172.21.15.63:0/3612882434 >> v2:172.21.15.155:3300/0 conn(0x7fdc181435d0 0x7fdc180aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:55.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1e765700 1 -- 172.21.15.63:0/3612882434 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc180af170 con 0x7fdc18147140 2020-05-18T21:29:55.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1df64700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc1805f230 0x7fdc1813f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:29:55.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1e765700 1 --2- 172.21.15.63:0/3612882434 >> v2:172.21.15.63:3300/0 conn(0x7fdc18147140 0x7fdc180ad9b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdc10001490 tx=0x7fdc10010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:55.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1e765700 1 --2- 172.21.15.63:0/3612882434 >> v2:172.21.15.63:3300/0 conn(0x7fdc18147140 0x7fdc180ad9b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdc10001490 tx=0x7fdc10010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:55.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1e765700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc18147140 0x7fdc180ad9b0 secure :-1 s=READY pgs=789 cs=0 l=1 rx=0x7fdc10001490 tx=0x7fdc10010cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:55.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1e765700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc18147140 0x7fdc180ad9b0 secure :-1 s=THROTTLE_DONE pgs=789 cs=0 l=1 rx=0x7fdc10001490 tx=0x7fdc10010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:55.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc06ffd700 1 -- 172.21.15.63:0/3612882434 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc10005e90 con 0x7fdc18147140 2020-05-18T21:29:55.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1e765700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc18147140 0x7fdc180ad9b0 secure :-1 s=THROTTLE_DONE pgs=789 cs=0 l=1 rx=0x7fdc10001490 tx=0x7fdc10010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:55.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc06ffd700 1 -- 172.21.15.63:0/3612882434 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc10012560 con 0x7fdc18147140 2020-05-18T21:29:55.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1e765700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc18147140 0x7fdc180ad9b0 secure :-1 s=THROTTLE_DONE pgs=789 cs=0 l=1 rx=0x7fdc10001490 tx=0x7fdc10010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:55.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc06ffd700 1 -- 172.21.15.63:0/3612882434 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc10012980 con 0x7fdc18147140 2020-05-18T21:29:55.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1ef66700 1 -- 172.21.15.63:0/3612882434 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc181469d0 con 0x7fdc18147140 2020-05-18T21:29:55.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1ef66700 1 -- 172.21.15.63:0/3612882434 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc180ae030 con 0x7fdc18147140 2020-05-18T21:29:55.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1e765700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc18147140 0x7fdc180ad9b0 secure :-1 s=THROTTLE_DONE pgs=789 cs=0 l=1 rx=0x7fdc10001490 tx=0x7fdc10010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:55.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1ef66700 1 -- 172.21.15.63:0/3612882434 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc180aea70 con 0x7fdc18147140 2020-05-18T21:29:55.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc06ffd700 1 -- 172.21.15.63:0/3612882434 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fdc10012c00 con 0x7fdc18147140 2020-05-18T21:29:55.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc1e765700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc18147140 0x7fdc180ad9b0 secure :-1 s=THROTTLE_DONE pgs=789 cs=0 l=1 rx=0x7fdc10001490 tx=0x7fdc10010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:55.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc06ffd700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbf804f9e0 0x7fdbf8051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:55.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.861+0000 7fdc06ffd700 1 -- 172.21.15.63:0/3612882434 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fdc100090c0 con 0x7fdc18147140 2020-05-18T21:29:55.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.865+0000 7fdc1df64700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbf804f9e0 0x7fdbf8051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:55.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.865+0000 7fdc1df64700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbf804f9e0 0x7fdbf8051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdc08002f70 tx=0x7fdc08007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:55.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.865+0000 7fdc1df64700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbf804f9e0 0x7fdbf8051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdc08002f70 tx=0x7fdc08007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:55.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.865+0000 7fdc1df64700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbf804f9e0 0x7fdbf8051ea0 secure :-1 s=READY pgs=318 cs=0 l=1 rx=0x7fdc08002f70 tx=0x7fdc08007720).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:55.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.873+0000 7fdc1e765700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc18147140 0x7fdc180ad9b0 secure :-1 s=THROTTLE_DONE pgs=789 cs=0 l=1 rx=0x7fdc10001490 tx=0x7fdc10010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:55.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:55.873+0000 7fdc06ffd700 1 -- 172.21.15.63:0/3612882434 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fdc180aea70 con 0x7fdc18147140 2020-05-18T21:29:56.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:56.025+0000 7fdc1ef66700 1 -- 172.21.15.63:0/3612882434 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_files_throttle"]} v 0) v1 -- 0x7fdc180aea70 con 0x7fdc18147140 2020-05-18T21:29:56.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:56.861+0000 7fdc1e765700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc18147140 0x7fdc180ad9b0 secure :-1 s=READY pgs=789 cs=0 l=1 rx=0x7fdc10001490 tx=0x7fdc10010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:56.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:56.953+0000 7fdc1e765700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc18147140 0x7fdc180ad9b0 secure :-1 s=THROTTLE_DONE pgs=789 cs=0 l=1 rx=0x7fdc10001490 tx=0x7fdc10010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:56.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:56.953+0000 7fdc06ffd700 1 -- 172.21.15.63:0/3612882434 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_files_throttle"]}]=0 v173) v1 ==== 134+0+0 (secure 0 0 0) 0x7fdc180aea70 con 0x7fdc18147140 2020-05-18T21:29:56.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:56.957+0000 7fdc1ef66700 1 -- 172.21.15.63:0/3612882434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbf804f9e0 msgr2=0x7fdbf8051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:56.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:56.957+0000 7fdc1ef66700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbf804f9e0 0x7fdbf8051ea0 secure :-1 s=READY pgs=318 cs=0 l=1 rx=0x7fdc08002f70 tx=0x7fdc08007720).stop 2020-05-18T21:29:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:56.957+0000 7fdc1ef66700 1 -- 172.21.15.63:0/3612882434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc18147140 msgr2=0x7fdc180ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:56.957+0000 7fdc1ef66700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc18147140 0x7fdc180ad9b0 secure :-1 s=READY pgs=789 cs=0 l=1 rx=0x7fdc10001490 tx=0x7fdc10010cd0).stop 2020-05-18T21:29:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:56.957+0000 7fdc1ef66700 1 -- 172.21.15.63:0/3612882434 shutdown_connections 2020-05-18T21:29:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:56.957+0000 7fdc1ef66700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbf804f9e0 0x7fdbf8051ea0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:56.957+0000 7fdc1ef66700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc18147140 0x7fdc180ad9b0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:56.957+0000 7fdc1ef66700 1 --2- 172.21.15.63:0/3612882434 >> v2:172.21.15.155:3300/0 conn(0x7fdc181435d0 0x7fdc180aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:56.957+0000 7fdc1ef66700 1 --2- 172.21.15.63:0/3612882434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc1805f230 0x7fdc1813f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:56.957+0000 7fdc1ef66700 1 -- 172.21.15.63:0/3612882434 >> 172.21.15.63:0/3612882434 conn(0x7fdc18069fc0 msgr2=0x7fdc18140e10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:56.957+0000 7fdc1ef66700 1 -- 172.21.15.63:0/3612882434 shutdown_connections 2020-05-18T21:29:56.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:56.957+0000 7fdc1ef66700 1 -- 172.21.15.63:0/3612882434 wait complete. 2020-05-18T21:29:56.980 INFO:tasks.cephfs_test_runner:test_files_throttle (tasks.cephfs.test_strays.TestStrays) ... ok 2020-05-18T21:29:56.981 INFO:tasks.cephfs_test_runner:Starting test: test_hardlink_reintegration (tasks.cephfs.test_strays.TestStrays) 2020-05-18T21:29:56.981 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_strays.TestStrays.test_hardlink_reintegration' 2020-05-18T21:29:57.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f19455a5700 1 Processor -- start 2020-05-18T21:29:57.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f19455a5700 1 -- start start 2020-05-18T21:29:57.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f19455a5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f19400659d0 0x7f1940062120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:57.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f19455a5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f194013ff30 0x7f19401403c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:57.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f19455a5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1940143700 con 0x7f19400b6c50 2020-05-18T21:29:57.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f19455a5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19401439a0 con 0x7f194013ff30 2020-05-18T21:29:57.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f19455a5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1940143c40 con 0x7f19400659d0 2020-05-18T21:29:57.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f193f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f194013ff30 0x7f19401403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:57.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f193f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f194013ff30 0x7f19401403c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56768/0 (socket says 172.21.15.63:56768) 2020-05-18T21:29:57.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f193f7fe700 1 -- 172.21.15.63:0/2427065332 learned_addr learned my addr 172.21.15.63:0/2427065332 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:57.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f193e7fc700 1 --2- 172.21.15.63:0/2427065332 >> v2:172.21.15.155:3300/0 conn(0x7f19400659d0 0x7f1940062120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:57.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f193f7fe700 1 -- 172.21.15.63:0/2427065332 >> v2:172.21.15.155:3300/0 conn(0x7f19400659d0 msgr2=0x7f1940062120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:57.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f193f7fe700 1 --2- 172.21.15.63:0/2427065332 >> v2:172.21.15.155:3300/0 conn(0x7f19400659d0 0x7f1940062120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:57.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f193f7fe700 1 -- 172.21.15.63:0/2427065332 >> v1:172.21.15.155:6789/0 conn(0x7f19400b6c50 legacy=0x7f1940142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:57.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f193f7fe700 1 -- 172.21.15.63:0/2427065332 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1940140820 con 0x7f194013ff30 2020-05-18T21:29:57.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f193e7fc700 1 --2- 172.21.15.63:0/2427065332 >> v2:172.21.15.155:3300/0 conn(0x7f19400659d0 0x7f1940062120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:29:57.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f193f7fe700 1 --2- 172.21.15.63:0/2427065332 >> v2:172.21.15.63:3300/0 conn(0x7f194013ff30 0x7f19401403c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f19380032f0 tx=0x7f1938007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:57.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f193f7fe700 1 --2- 172.21.15.63:0/2427065332 >> v2:172.21.15.63:3300/0 conn(0x7f194013ff30 0x7f19401403c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f19380032f0 tx=0x7f1938007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:57.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f193f7fe700 1 --2- 172.21.15.63:0/2427065332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f194013ff30 0x7f19401403c0 secure :-1 s=READY pgs=790 cs=0 l=1 rx=0x7f19380032f0 tx=0x7f1938007e00).ready entity=mon.0 client_cookie=286c539b1e1b35d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:57.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f193f7fe700 1 --2- 172.21.15.63:0/2427065332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f194013ff30 0x7f19401403c0 secure :-1 s=THROTTLE_DONE pgs=790 cs=0 l=1 rx=0x7f19380032f0 tx=0x7f1938007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:57.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f193f7fe700 1 --2- 172.21.15.63:0/2427065332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f194013ff30 0x7f19401403c0 secure :-1 s=THROTTLE_DONE pgs=790 cs=0 l=1 rx=0x7f19380032f0 tx=0x7f1938007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:57.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f193f7fe700 1 --2- 172.21.15.63:0/2427065332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f194013ff30 0x7f19401403c0 secure :-1 s=THROTTLE_DONE pgs=790 cs=0 l=1 rx=0x7f19380032f0 tx=0x7f1938007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:57.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f193dffb700 1 -- 172.21.15.63:0/2427065332 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1938011d10 con 0x7f194013ff30 2020-05-18T21:29:57.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f193dffb700 1 -- 172.21.15.63:0/2427065332 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1938011e70 con 0x7f194013ff30 2020-05-18T21:29:57.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f193dffb700 1 -- 172.21.15.63:0/2427065332 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f193800a370 con 0x7f194013ff30 2020-05-18T21:29:57.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f19455a5700 1 -- 172.21.15.63:0/2427065332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f194013ff30 msgr2=0x7f19401403c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:57.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.085+0000 7f19455a5700 1 --2- 172.21.15.63:0/2427065332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f194013ff30 0x7f19401403c0 secure :-1 s=READY pgs=790 cs=0 l=1 rx=0x7f19380032f0 tx=0x7f1938007e00).stop 2020-05-18T21:29:57.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.089+0000 7f19455a5700 1 -- 172.21.15.63:0/2427065332 shutdown_connections 2020-05-18T21:29:57.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.089+0000 7f19455a5700 1 --2- 172.21.15.63:0/2427065332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f194013ff30 0x7f19401403c0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:57.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.089+0000 7f19455a5700 1 --2- 172.21.15.63:0/2427065332 >> v2:172.21.15.155:3300/0 conn(0x7f19400659d0 0x7f1940062120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:57.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.089+0000 7f19455a5700 1 -- 172.21.15.63:0/2427065332 >> 172.21.15.63:0/2427065332 conn(0x7f194005b290 msgr2=0x7f19400b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:57.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.089+0000 7f19455a5700 1 -- 172.21.15.63:0/2427065332 shutdown_connections 2020-05-18T21:29:57.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.089+0000 7f19455a5700 1 -- 172.21.15.63:0/2427065332 wait complete. 2020-05-18T21:29:57.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.089+0000 7f19455a5700 1 Processor -- start 2020-05-18T21:29:57.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.089+0000 7f19455a5700 1 -- start start 2020-05-18T21:29:57.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.089+0000 7f19455a5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f19400b6c50 0x7f1940144040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:57.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.089+0000 7f19455a5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194013f000 con 0x7f194013ff30 2020-05-18T21:29:57.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.089+0000 7f19455a5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194013f2a0 con 0x7f19400659d0 2020-05-18T21:29:57.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.089+0000 7f19455a5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194013f540 con 0x7f19400b6c50 2020-05-18T21:29:57.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.089+0000 7f193f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f194013ff30 0x7f194013da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58964/0 (socket says 172.21.15.63:58964) 2020-05-18T21:29:57.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.089+0000 7f193f7fe700 1 -- 172.21.15.63:0/3426913127 learned_addr learned my addr 172.21.15.63:0/3426913127 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:57.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.089+0000 7f193e7fc700 1 --2- 172.21.15.63:0/3426913127 >> v2:172.21.15.155:3300/0 conn(0x7f19400b6c50 0x7f1940144040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:57.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.089+0000 7f1937fff700 1 -- 172.21.15.63:0/3426913127 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230577218 0 0) 0x7f194013f000 con 0x7f194013ff30 2020-05-18T21:29:57.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.089+0000 7f1937fff700 1 -- 172.21.15.63:0/3426913127 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1924002fe0 con 0x7f194013ff30 2020-05-18T21:29:57.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.093+0000 7f1937fff700 1 -- 172.21.15.63:0/3426913127 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071992558 0 0) 0x7f194013f2a0 con 0x7f19400659d0 2020-05-18T21:29:57.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.093+0000 7f193e7fc700 1 -- 172.21.15.63:0/3426913127 >> v1:172.21.15.155:6789/0 conn(0x7f19400659d0 legacy=0x7f19400b8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:57.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.093+0000 7f193e7fc700 1 -- 172.21.15.63:0/3426913127 >> v1:172.21.15.63:6789/0 conn(0x7f194013ff30 legacy=0x7f194013da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:57.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.093+0000 7f193e7fc700 1 -- 172.21.15.63:0/3426913127 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194013f7e0 con 0x7f19400b6c50 2020-05-18T21:29:57.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.093+0000 7f193e7fc700 1 --2- 172.21.15.63:0/3426913127 >> v2:172.21.15.155:3300/0 conn(0x7f19400b6c50 0x7f1940144040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1938008b20 tx=0x7f1930010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:57.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.093+0000 7f193e7fc700 1 --2- 172.21.15.63:0/3426913127 >> v2:172.21.15.155:3300/0 conn(0x7f19400b6c50 0x7f1940144040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1938008b20 tx=0x7f1930010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:57.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.093+0000 7f193e7fc700 1 --2- 172.21.15.63:0/3426913127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19400b6c50 0x7f1940144040 secure :-1 s=READY pgs=561 cs=0 l=1 rx=0x7f1938008b20 tx=0x7f1930010de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:57.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.093+0000 7f193e7fc700 1 --2- 172.21.15.63:0/3426913127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19400b6c50 0x7f1940144040 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7f1938008b20 tx=0x7f1930010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:57.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.093+0000 7f1937fff700 1 -- 172.21.15.63:0/3426913127 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1938008980 con 0x7f19400b6c50 2020-05-18T21:29:57.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.093+0000 7f193e7fc700 1 --2- 172.21.15.63:0/3426913127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19400b6c50 0x7f1940144040 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7f1938008b20 tx=0x7f1930010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:57.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.093+0000 7f1937fff700 1 -- 172.21.15.63:0/3426913127 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193000c790 con 0x7f19400b6c50 2020-05-18T21:29:57.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.093+0000 7f193e7fc700 1 --2- 172.21.15.63:0/3426913127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19400b6c50 0x7f1940144040 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7f1938008b20 tx=0x7f1930010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:57.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.093+0000 7f19455a5700 1 -- 172.21.15.63:0/3426913127 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19401444a0 con 0x7f19400b6c50 2020-05-18T21:29:57.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.093+0000 7f1937fff700 1 -- 172.21.15.63:0/3426913127 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f193000caf0 con 0x7f19400b6c50 2020-05-18T21:29:57.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.093+0000 7f19455a5700 1 -- 172.21.15.63:0/3426913127 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19400b1600 con 0x7f19400b6c50 2020-05-18T21:29:57.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.093+0000 7f19455a5700 1 -- 172.21.15.63:0/3426913127 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194013f970 con 0x7f19400b6c50 2020-05-18T21:29:57.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.093+0000 7f193e7fc700 1 --2- 172.21.15.63:0/3426913127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19400b6c50 0x7f1940144040 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7f1938008b20 tx=0x7f1930010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:57.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.093+0000 7f1937fff700 1 -- 172.21.15.63:0/3426913127 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f193000ccf0 con 0x7f19400b6c50 2020-05-18T21:29:57.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.093+0000 7f193e7fc700 1 --2- 172.21.15.63:0/3426913127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19400b6c50 0x7f1940144040 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7f1938008b20 tx=0x7f1930010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:57.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.097+0000 7f1937fff700 1 --2- 172.21.15.63:0/3426913127 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f192404fca0 0x7f1924052160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:57.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.097+0000 7f1937fff700 1 -- 172.21.15.63:0/3426913127 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f19300638f0 con 0x7f19400b6c50 2020-05-18T21:29:57.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.097+0000 7f193effd700 1 --2- 172.21.15.63:0/3426913127 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f192404fca0 0x7f1924052160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:57.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.097+0000 7f193effd700 1 --2- 172.21.15.63:0/3426913127 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f192404fca0 0x7f1924052160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f19280021b0 tx=0x7f1928002760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:57.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.097+0000 7f193effd700 1 --2- 172.21.15.63:0/3426913127 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f192404fca0 0x7f1924052160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f19280021b0 tx=0x7f1928002760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:57.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.097+0000 7f193effd700 1 --2- 172.21.15.63:0/3426913127 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f192404fca0 0x7f1924052160 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f19280021b0 tx=0x7f1928002760).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:57.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.105+0000 7f193e7fc700 1 --2- 172.21.15.63:0/3426913127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19400b6c50 0x7f1940144040 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7f1938008b20 tx=0x7f1930010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:57.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.105+0000 7f1937fff700 1 -- 172.21.15.63:0/3426913127 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f193003dc20 con 0x7f19400b6c50 2020-05-18T21:29:57.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.261+0000 7f19455a5700 1 -- 172.21.15.63:0/3426913127 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_hardlink_reintegration"]} v 0) v1 -- 0x7f19400569e0 con 0x7f19400b6c50 2020-05-18T21:29:57.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.965+0000 7f193e7fc700 1 --2- 172.21.15.63:0/3426913127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19400b6c50 0x7f1940144040 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7f1938008b20 tx=0x7f1930010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:57.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.965+0000 7f1937fff700 1 -- 172.21.15.63:0/3426913127 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_hardlink_reintegration"]}]=0 v174) v1 ==== 145+0+0 (secure 0 0 0) 0x7f1930041240 con 0x7f19400b6c50 2020-05-18T21:29:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.969+0000 7f19455a5700 1 -- 172.21.15.63:0/3426913127 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f192404fca0 msgr2=0x7f1924052160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.969+0000 7f19455a5700 1 --2- 172.21.15.63:0/3426913127 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f192404fca0 0x7f1924052160 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f19280021b0 tx=0x7f1928002760).stop 2020-05-18T21:29:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.969+0000 7f19455a5700 1 -- 172.21.15.63:0/3426913127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19400b6c50 msgr2=0x7f1940144040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.969+0000 7f19455a5700 1 --2- 172.21.15.63:0/3426913127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19400b6c50 0x7f1940144040 secure :-1 s=READY pgs=561 cs=0 l=1 rx=0x7f1938008b20 tx=0x7f1930010de0).stop 2020-05-18T21:29:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.969+0000 7f19455a5700 1 -- 172.21.15.63:0/3426913127 shutdown_connections 2020-05-18T21:29:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.969+0000 7f19455a5700 1 --2- 172.21.15.63:0/3426913127 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f192404fca0 0x7f1924052160 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.969+0000 7f19455a5700 1 --2- 172.21.15.63:0/3426913127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19400b6c50 0x7f1940144040 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.969+0000 7f19455a5700 1 -- 172.21.15.63:0/3426913127 >> 172.21.15.63:0/3426913127 conn(0x7f194005b290 msgr2=0x7f194006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:57.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.969+0000 7f19455a5700 1 -- 172.21.15.63:0/3426913127 shutdown_connections 2020-05-18T21:29:57.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:57.969+0000 7f19455a5700 1 -- 172.21.15.63:0/3426913127 wait complete. 2020-05-18T21:29:57.987 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:29:57.987 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:29:58.004 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:29:58.025 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:29:58.025 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-05-18T21:29:58.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.153+0000 7fd8bf181700 1 Processor -- start 2020-05-18T21:29:58.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.153+0000 7fd8bf181700 1 -- start start 2020-05-18T21:29:58.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bf181700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd8b8061670 0x7fd8b81506d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:58.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bf181700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b80b2d70 con 0x7fd8b8145f40 2020-05-18T21:29:58.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bf181700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b8146e60 con 0x7fd8b8060b90 2020-05-18T21:29:58.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bf181700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b8146480 con 0x7fd8b8061670 2020-05-18T21:29:58.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bd71e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd8b8061670 0x7fd8b81506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:58.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8b7fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd8b8145f40 0x7fd8b8149e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58968/0 (socket says 172.21.15.63:58968) 2020-05-18T21:29:58.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8b7fff700 1 -- 172.21.15.63:0/1388630578 learned_addr learned my addr 172.21.15.63:0/1388630578 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:58.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8b77fe700 1 -- 172.21.15.63:0/1388630578 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700954956 0 0) 0x7fd8b80b2d70 con 0x7fd8b8145f40 2020-05-18T21:29:58.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8b77fe700 1 -- 172.21.15.63:0/1388630578 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd898003270 con 0x7fd8b8145f40 2020-05-18T21:29:58.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bd71e700 1 -- 172.21.15.63:0/1388630578 >> v1:172.21.15.155:6789/0 conn(0x7fd8b8060b90 legacy=0x7fd8b8149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bd71e700 1 -- 172.21.15.63:0/1388630578 >> v1:172.21.15.63:6789/0 conn(0x7fd8b8145f40 legacy=0x7fd8b8149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8b77fe700 1 -- 172.21.15.63:0/1388630578 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72590414 0 0) 0x7fd8b8146e60 con 0x7fd8b8060b90 2020-05-18T21:29:58.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bd71e700 1 -- 172.21.15.63:0/1388630578 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b8146720 con 0x7fd8b8061670 2020-05-18T21:29:58.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bd71e700 1 --2- 172.21.15.63:0/1388630578 >> v2:172.21.15.63:3300/0 conn(0x7fd8b8061670 0x7fd8b81506d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd8a00018b0 tx=0x7fd8b0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bd71e700 1 --2- 172.21.15.63:0/1388630578 >> v2:172.21.15.63:3300/0 conn(0x7fd8b8061670 0x7fd8b81506d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd8a00018b0 tx=0x7fd8b0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bd71e700 1 --2- 172.21.15.63:0/1388630578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8b8061670 0x7fd8b81506d0 secure :-1 s=READY pgs=793 cs=0 l=1 rx=0x7fd8a00018b0 tx=0x7fd8b0008ca0).ready entity=mon.0 client_cookie=4d904d64c35222b5 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:58.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bd71e700 1 --2- 172.21.15.63:0/1388630578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8b8061670 0x7fd8b81506d0 secure :-1 s=THROTTLE_DONE pgs=793 cs=0 l=1 rx=0x7fd8a00018b0 tx=0x7fd8b0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8b77fe700 1 -- 172.21.15.63:0/1388630578 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a0001710 con 0x7fd8b8061670 2020-05-18T21:29:58.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bd71e700 1 --2- 172.21.15.63:0/1388630578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8b8061670 0x7fd8b81506d0 secure :-1 s=THROTTLE_DONE pgs=793 cs=0 l=1 rx=0x7fd8a00018b0 tx=0x7fd8b0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bd71e700 1 --2- 172.21.15.63:0/1388630578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8b8061670 0x7fd8b81506d0 secure :-1 s=THROTTLE_DONE pgs=793 cs=0 l=1 rx=0x7fd8a00018b0 tx=0x7fd8b0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8b77fe700 1 -- 172.21.15.63:0/1388630578 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b0011980 con 0x7fd8b8061670 2020-05-18T21:29:58.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8b77fe700 1 -- 172.21.15.63:0/1388630578 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8b0011ce0 con 0x7fd8b8061670 2020-05-18T21:29:58.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bf181700 1 -- 172.21.15.63:0/1388630578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8b8061670 msgr2=0x7fd8b81506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bf181700 1 --2- 172.21.15.63:0/1388630578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8b8061670 0x7fd8b81506d0 secure :-1 s=READY pgs=793 cs=0 l=1 rx=0x7fd8a00018b0 tx=0x7fd8b0008ca0).stop 2020-05-18T21:29:58.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bf181700 1 -- 172.21.15.63:0/1388630578 shutdown_connections 2020-05-18T21:29:58.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bf181700 1 --2- 172.21.15.63:0/1388630578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8b8061670 0x7fd8b81506d0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:58.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bf181700 1 -- 172.21.15.63:0/1388630578 >> 172.21.15.63:0/1388630578 conn(0x7fd8b80b83d0 msgr2=0x7fd8b80b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:58.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bf181700 1 -- 172.21.15.63:0/1388630578 shutdown_connections 2020-05-18T21:29:58.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.157+0000 7fd8bf181700 1 -- 172.21.15.63:0/1388630578 wait complete. 2020-05-18T21:29:58.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8bf181700 1 Processor -- start 2020-05-18T21:29:58.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8bf181700 1 -- start start 2020-05-18T21:29:58.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8bf181700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd8b8060b90 0x7fd8b8061e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:58.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8bf181700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd8b8061670 0x7fd8b8142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:58.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8bf181700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b80658f0 con 0x7fd8b8145f40 2020-05-18T21:29:58.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8bf181700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b8064aa0 con 0x7fd8b8061670 2020-05-18T21:29:58.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8bf181700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b8143280 con 0x7fd8b8060b90 2020-05-18T21:29:58.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8b7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd8b8061670 0x7fd8b8142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:58.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8bd71e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd8b8145f40 0x7fd8b80651e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58978/0 (socket says 172.21.15.63:58978) 2020-05-18T21:29:58.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8bd71e700 1 -- 172.21.15.63:0/3792312861 learned_addr learned my addr 172.21.15.63:0/3792312861 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:58.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8bcf1d700 1 --2- 172.21.15.63:0/3792312861 >> v2:172.21.15.155:3300/0 conn(0x7fd8b8060b90 0x7fd8b8061e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:58.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8b5ffb700 1 -- 172.21.15.63:0/3792312861 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754442649 0 0) 0x7fd8b80658f0 con 0x7fd8b8145f40 2020-05-18T21:29:58.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8b5ffb700 1 -- 172.21.15.63:0/3792312861 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd89c002fe0 con 0x7fd8b8145f40 2020-05-18T21:29:58.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8b5ffb700 1 -- 172.21.15.63:0/3792312861 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 29768639 0 0) 0x7fd89c002fe0 con 0x7fd8b8145f40 2020-05-18T21:29:58.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8b7fff700 1 -- 172.21.15.63:0/3792312861 >> v2:172.21.15.155:3300/0 conn(0x7fd8b8060b90 msgr2=0x7fd8b8061e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8b7fff700 1 --2- 172.21.15.63:0/3792312861 >> v2:172.21.15.155:3300/0 conn(0x7fd8b8060b90 0x7fd8b8061e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:58.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8b7fff700 1 -- 172.21.15.63:0/3792312861 >> v1:172.21.15.63:6789/0 conn(0x7fd8b8145f40 legacy=0x7fd8b80651e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8b7fff700 1 -- 172.21.15.63:0/3792312861 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b8153a70 con 0x7fd8b8061670 2020-05-18T21:29:58.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8b7fff700 1 --2- 172.21.15.63:0/3792312861 >> v2:172.21.15.63:3300/0 conn(0x7fd8b8061670 0x7fd8b8142b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd8b0008bc0 tx=0x7fd8a0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8b7fff700 1 --2- 172.21.15.63:0/3792312861 >> v2:172.21.15.63:3300/0 conn(0x7fd8b8061670 0x7fd8b8142b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd8b0008bc0 tx=0x7fd8a0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.161+0000 7fd8b7fff700 1 --2- 172.21.15.63:0/3792312861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8b8061670 0x7fd8b8142b50 secure :-1 s=READY pgs=795 cs=0 l=1 rx=0x7fd8b0008bc0 tx=0x7fd8a0010be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:58.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.165+0000 7fd8b7fff700 1 --2- 172.21.15.63:0/3792312861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8b8061670 0x7fd8b8142b50 secure :-1 s=THROTTLE_DONE pgs=795 cs=0 l=1 rx=0x7fd8b0008bc0 tx=0x7fd8a0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.165+0000 7fd8b5ffb700 1 -- 172.21.15.63:0/3792312861 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8b0008a20 con 0x7fd8b8061670 2020-05-18T21:29:58.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.165+0000 7fd8b7fff700 1 --2- 172.21.15.63:0/3792312861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8b8061670 0x7fd8b8142b50 secure :-1 s=THROTTLE_DONE pgs=795 cs=0 l=1 rx=0x7fd8b0008bc0 tx=0x7fd8a0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.165+0000 7fd8b7fff700 1 --2- 172.21.15.63:0/3792312861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8b8061670 0x7fd8b8142b50 secure :-1 s=THROTTLE_DONE pgs=795 cs=0 l=1 rx=0x7fd8b0008bc0 tx=0x7fd8a0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.165+0000 7fd8b5ffb700 1 -- 172.21.15.63:0/3792312861 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a000c7a0 con 0x7fd8b8061670 2020-05-18T21:29:58.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.165+0000 7fd8bf181700 1 -- 172.21.15.63:0/3792312861 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b8153cc0 con 0x7fd8b8061670 2020-05-18T21:29:58.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.165+0000 7fd8b5ffb700 1 -- 172.21.15.63:0/3792312861 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a000cb00 con 0x7fd8b8061670 2020-05-18T21:29:58.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.165+0000 7fd8bf181700 1 -- 172.21.15.63:0/3792312861 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b81481b0 con 0x7fd8b8061670 2020-05-18T21:29:58.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.165+0000 7fd8bf181700 1 -- 172.21.15.63:0/3792312861 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b8148800 con 0x7fd8b8061670 2020-05-18T21:29:58.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.165+0000 7fd8b7fff700 1 --2- 172.21.15.63:0/3792312861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8b8061670 0x7fd8b8142b50 secure :-1 s=THROTTLE_DONE pgs=795 cs=0 l=1 rx=0x7fd8b0008bc0 tx=0x7fd8a0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.165+0000 7fd8b5ffb700 1 -- 172.21.15.63:0/3792312861 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd8a000cd00 con 0x7fd8b8061670 2020-05-18T21:29:58.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.165+0000 7fd8b7fff700 1 --2- 172.21.15.63:0/3792312861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8b8061670 0x7fd8b8142b50 secure :-1 s=THROTTLE_DONE pgs=795 cs=0 l=1 rx=0x7fd8b0008bc0 tx=0x7fd8a0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.165+0000 7fd8b5ffb700 1 --2- 172.21.15.63:0/3792312861 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd89c04fcf0 0x7fd89c0521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:58.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.165+0000 7fd8b5ffb700 1 -- 172.21.15.63:0/3792312861 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd8a00633a0 con 0x7fd8b8061670 2020-05-18T21:29:58.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.165+0000 7fd8bcf1d700 1 --2- 172.21.15.63:0/3792312861 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd89c04fcf0 0x7fd89c0521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:58.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.165+0000 7fd8bcf1d700 1 --2- 172.21.15.63:0/3792312861 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd89c04fcf0 0x7fd89c0521b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd8a8000bc0 tx=0x7fd8a80039a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.165+0000 7fd8bcf1d700 1 --2- 172.21.15.63:0/3792312861 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd89c04fcf0 0x7fd89c0521b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd8a8000bc0 tx=0x7fd8a80039a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.165+0000 7fd8bcf1d700 1 --2- 172.21.15.63:0/3792312861 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd89c04fcf0 0x7fd89c0521b0 secure :-1 s=READY pgs=320 cs=0 l=1 rx=0x7fd8a8000bc0 tx=0x7fd8a80039a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:58.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.173+0000 7fd8b7fff700 1 --2- 172.21.15.63:0/3792312861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8b8061670 0x7fd8b8142b50 secure :-1 s=THROTTLE_DONE pgs=795 cs=0 l=1 rx=0x7fd8b0008bc0 tx=0x7fd8a0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.173+0000 7fd8b5ffb700 1 -- 172.21.15.63:0/3792312861 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd8a003d730 con 0x7fd8b8061670 2020-05-18T21:29:58.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.293+0000 7fd8bf181700 1 -- 172.21.15.63:0/3792312861 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd8b8064be0 con 0x7fd8b8061670 2020-05-18T21:29:58.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.293+0000 7fd8b7fff700 1 --2- 172.21.15.63:0/3792312861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8b8061670 0x7fd8b8142b50 secure :-1 s=THROTTLE_DONE pgs=795 cs=0 l=1 rx=0x7fd8b0008bc0 tx=0x7fd8a0010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.293+0000 7fd8b5ffb700 1 -- 172.21.15.63:0/3792312861 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v63) v1 ==== 81+0+33855 (secure 0 0 0) 0x7fd8a0040d50 con 0x7fd8b8061670 2020-05-18T21:29:58.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.297+0000 7fd8bf181700 1 -- 172.21.15.63:0/3792312861 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd89c04fcf0 msgr2=0x7fd89c0521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.297+0000 7fd8bf181700 1 --2- 172.21.15.63:0/3792312861 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd89c04fcf0 0x7fd89c0521b0 secure :-1 s=READY pgs=320 cs=0 l=1 rx=0x7fd8a8000bc0 tx=0x7fd8a80039a0).stop 2020-05-18T21:29:58.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.297+0000 7fd8bf181700 1 -- 172.21.15.63:0/3792312861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8b8061670 msgr2=0x7fd8b8142b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.297+0000 7fd8bf181700 1 --2- 172.21.15.63:0/3792312861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8b8061670 0x7fd8b8142b50 secure :-1 s=READY pgs=795 cs=0 l=1 rx=0x7fd8b0008bc0 tx=0x7fd8a0010be0).stop 2020-05-18T21:29:58.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.297+0000 7fd8bf181700 1 -- 172.21.15.63:0/3792312861 shutdown_connections 2020-05-18T21:29:58.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.297+0000 7fd8bf181700 1 --2- 172.21.15.63:0/3792312861 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd89c04fcf0 0x7fd89c0521b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:58.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.297+0000 7fd8bf181700 1 --2- 172.21.15.63:0/3792312861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8b8061670 0x7fd8b8142b50 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:58.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.297+0000 7fd8bf181700 1 --2- 172.21.15.63:0/3792312861 >> v2:172.21.15.155:3300/0 conn(0x7fd8b8060b90 0x7fd8b8061e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:58.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.297+0000 7fd8bf181700 1 -- 172.21.15.63:0/3792312861 >> 172.21.15.63:0/3792312861 conn(0x7fd8b80b83d0 msgr2=0x7fd8b813fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:58.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.297+0000 7fd8bf181700 1 -- 172.21.15.63:0/3792312861 shutdown_connections 2020-05-18T21:29:58.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.297+0000 7fd8bf181700 1 -- 172.21.15.63:0/3792312861 wait complete. 2020-05-18T21:29:58.308 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:58.309 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:29:58.309 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 63, 2020-05-18T21:29:58.309 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:29:58.310 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2020-05-18T21:26:28.798650+0000", 2020-05-18T21:29:58.310 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2020-05-18T21:29:18.656153+0000", 2020-05-18T21:29:58.310 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:29:58.311 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:29:58.311 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-05-18T21:29:58.312 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5799936, 2020-05-18T21:29:58.312 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2020-05-18T21:29:58.313 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2020-05-18T21:29:58.313 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2020-05-18T21:29:58.313 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2020-05-18T21:29:58.314 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2020-05-18T21:29:58.314 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:29:58.314 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 4, 2020-05-18T21:29:58.315 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2020-05-18T21:29:58.315 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-05-18T21:29:58.315 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2020-05-18T21:29:58.316 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2020-05-18T21:29:58.316 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 12, 2020-05-18T21:29:58.316 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 8, 2020-05-18T21:29:58.316 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2020-05-18T21:29:58.317 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "jewel", 2020-05-18T21:29:58.317 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "pacific", 2020-05-18T21:29:58.317 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:29:58.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.318 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2020-05-18T21:29:58.318 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "device_health_metrics", 2020-05-18T21:29:58.319 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:33.080792+0000", 2020-05-18T21:29:58.319 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:29:58.319 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:29:58.319 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:29:58.320 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:29:58.320 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:29:58.320 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:29:58.320 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:29:58.321 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:29:58.321 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2020-05-18T21:29:58.322 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2020-05-18T21:29:58.322 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2020-05-18T21:29:58.323 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2020-05-18T21:29:58.323 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2020-05-18T21:29:58.323 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:29:58.324 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:29:58.324 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:29:58.324 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:29:58.324 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:29:58.325 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:29:58.325 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:29:58.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.326 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "15", 2020-05-18T21:29:58.326 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:29:58.326 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:29:58.326 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:29:58.327 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:29:58.327 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:29:58.327 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:29:58.328 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:29:58.328 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:29:58.328 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:29:58.328 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:29:58.329 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:29:58.329 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:29:58.329 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:29:58.330 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:29:58.330 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:29:58.330 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:29:58.330 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:29:58.331 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:29:58.331 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:29:58.331 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:29:58.331 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:29:58.332 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:29:58.332 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:29:58.332 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:29:58.332 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:29:58.333 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:29:58.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.333 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:29:58.334 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:29:58.334 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:29:58.334 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:29:58.335 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:29:58.335 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:29:58.335 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:29:58.336 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:29:58.336 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:29:58.336 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:29:58.336 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:29:58.337 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:29:58.337 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2020-05-18T21:29:58.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.337 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:29:58.338 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_devicehealth": {} 2020-05-18T21:29:58.338 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.339 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2020-05-18T21:29:58.339 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2020-05-18T21:29:58.339 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:40.149370+0000", 2020-05-18T21:29:58.339 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:29:58.340 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:29:58.340 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:29:58.340 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:29:58.340 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:29:58.341 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:29:58.341 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:29:58.341 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:29:58.341 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:29:58.342 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:29:58.342 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:29:58.342 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:29:58.342 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:29:58.343 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:29:58.343 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:29:58.343 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:29:58.344 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:29:58.344 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:29:58.344 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:29:58.344 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:29:58.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.345 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2020-05-18T21:29:58.345 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:29:58.346 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:29:58.346 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:29:58.346 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:29:58.346 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:29:58.347 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:29:58.347 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:29:58.347 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:29:58.347 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:29:58.348 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:29:58.348 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:29:58.348 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:29:58.349 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:29:58.349 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:29:58.349 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:29:58.349 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:29:58.350 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:29:58.350 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:29:58.350 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:29:58.351 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:29:58.351 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:29:58.351 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:29:58.351 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:29:58.352 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:29:58.352 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:29:58.352 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:29:58.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.353 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:29:58.353 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:29:58.353 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:29:58.354 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:29:58.354 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:29:58.354 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:29:58.354 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:29:58.355 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:29:58.355 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:29:58.355 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:29:58.356 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:29:58.356 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:29:58.356 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:29:58.356 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2020-05-18T21:29:58.357 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.358 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 11, 2020-05-18T21:29:58.358 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2020-05-18T21:29:58.358 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:29:08.544924+0000", 2020-05-18T21:29:58.359 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:29:58.359 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:29:58.359 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:29:58.360 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:29:58.360 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:29:58.360 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:29:58.360 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:29:58.361 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:29:58.361 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:29:58.361 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:29:58.362 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:29:58.362 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:29:58.362 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:29:58.363 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:29:58.363 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:29:58.363 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:29:58.363 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:29:58.364 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:29:58.364 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:29:58.364 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:29:58.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.365 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "60", 2020-05-18T21:29:58.365 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:29:58.365 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:29:58.366 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:29:58.366 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:29:58.366 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:29:58.366 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:29:58.367 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:29:58.367 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:29:58.367 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:29:58.367 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:29:58.368 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:29:58.368 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:29:58.368 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:29:58.368 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:29:58.369 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:29:58.369 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:29:58.369 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:29:58.370 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:29:58.370 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:29:58.370 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:29:58.371 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:29:58.371 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:29:58.371 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:29:58.372 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:29:58.372 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:29:58.372 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:29:58.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.373 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:29:58.373 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:29:58.373 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:29:58.374 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:29:58.374 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:29:58.374 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:29:58.374 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:29:58.375 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:29:58.375 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:29:58.375 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:29:58.376 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:29:58.376 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:29:58.376 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2020-05-18T21:29:58.377 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2020-05-18T21:29:58.377 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2020-05-18T21:29:58.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.378 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:29:58.378 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:29:58.378 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2020-05-18T21:29:58.378 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.379 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.379 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 12, 2020-05-18T21:29:58.380 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2020-05-18T21:29:58.380 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:29:09.178610+0000", 2020-05-18T21:29:58.380 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:29:58.380 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:29:58.381 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:29:58.381 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:29:58.381 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:29:58.382 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:29:58.382 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:29:58.382 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:29:58.382 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:29:58.383 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:29:58.383 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:29:58.383 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:29:58.384 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:29:58.384 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:29:58.384 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:29:58.385 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:29:58.385 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:29:58.386 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:29:58.386 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:29:58.386 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:29:58.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.387 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "61", 2020-05-18T21:29:58.387 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:29:58.388 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:29:58.388 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:29:58.388 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:29:58.388 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:29:58.389 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:29:58.389 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:29:58.389 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:29:58.390 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:29:58.390 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:29:58.390 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:29:58.391 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:29:58.391 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:29:58.391 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:29:58.391 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:29:58.392 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:29:58.392 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:29:58.392 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:29:58.392 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:29:58.393 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:29:58.393 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:29:58.393 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:29:58.393 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:29:58.394 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:29:58.394 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:29:58.394 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:29:58.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.395 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:29:58.395 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:29:58.395 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:29:58.396 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:29:58.396 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:29:58.396 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:29:58.397 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:29:58.397 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:29:58.397 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:29:58.398 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:29:58.398 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:29:58.398 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:29:58.399 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:29:58.399 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:29:58.400 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2020-05-18T21:29:58.400 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.400 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.401 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.401 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:29:58.402 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2020-05-18T21:29:58.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.402 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:29:58.403 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "c6ae0fbf-604c-4e8d-b1b8-6038821420e3", 2020-05-18T21:29:58.403 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:29:58.403 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:29:58.404 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:29:58.404 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:29:58.404 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:29:58.405 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:29:58.405 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:29:58.405 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 59, 2020-05-18T21:29:58.405 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:29:58.406 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:29:58.406 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:29:58.406 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.407 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.407 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2020-05-18T21:29:58.408 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:29:58.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.409 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.409 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2020-05-18T21:29:58.410 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:29:58.410 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.410 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.411 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:29:58.411 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.412 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.412 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.412 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6802", 2020-05-18T21:29:58.413 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:29:58.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.414 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.414 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6803", 2020-05-18T21:29:58.415 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:29:58.415 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.415 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.416 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:29:58.416 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.416 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.417 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6806", 2020-05-18T21:29:58.417 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:29:58.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.417 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.418 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6807", 2020-05-18T21:29:58.418 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:29:58.418 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.419 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.419 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:29:58.420 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.421 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.421 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6804", 2020-05-18T21:29:58.421 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:29:58.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.422 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.422 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.422 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6805", 2020-05-18T21:29:58.423 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:29:58.423 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.423 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.424 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6801/12803", 2020-05-18T21:29:58.424 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6803/12803", 2020-05-18T21:29:58.424 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6807/12803", 2020-05-18T21:29:58.424 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6805/12803", 2020-05-18T21:29:58.424 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:29:58.425 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:29:58.425 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:29:58.425 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.426 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:29:58.426 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6", 2020-05-18T21:29:58.426 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:29:58.426 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:29:58.426 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:29:58.426 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:29:58.427 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:29:58.427 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:29:58.427 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:29:58.427 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 59, 2020-05-18T21:29:58.427 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:29:58.428 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:29:58.428 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:29:58.428 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.428 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.428 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6808", 2020-05-18T21:29:58.429 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:29:58.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.429 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.429 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6809", 2020-05-18T21:29:58.430 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:29:58.430 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.430 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.430 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:29:58.431 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.431 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.431 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6810", 2020-05-18T21:29:58.431 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:29:58.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.432 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.432 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6811", 2020-05-18T21:29:58.432 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:29:58.432 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.433 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.433 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:29:58.433 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.433 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.434 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6815", 2020-05-18T21:29:58.434 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:29:58.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.434 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.435 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6817", 2020-05-18T21:29:58.435 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:29:58.435 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.436 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.436 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:29:58.436 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.437 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.437 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6812", 2020-05-18T21:29:58.437 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:29:58.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.438 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.438 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6813", 2020-05-18T21:29:58.438 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:29:58.438 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.439 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.439 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6809/12804", 2020-05-18T21:29:58.439 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6811/12804", 2020-05-18T21:29:58.439 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6817/12804", 2020-05-18T21:29:58.439 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6813/12804", 2020-05-18T21:29:58.440 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:29:58.440 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:29:58.440 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:29:58.440 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.441 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:29:58.441 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "ec8d9fa9-dae9-45f6-b286-735ab3801c27", 2020-05-18T21:29:58.441 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:29:58.441 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:29:58.441 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:29:58.442 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:29:58.442 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:29:58.442 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:29:58.442 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:29:58.442 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 58, 2020-05-18T21:29:58.443 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:29:58.443 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:29:58.443 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:29:58.443 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.443 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.444 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6822", 2020-05-18T21:29:58.444 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:29:58.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.444 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.445 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6824", 2020-05-18T21:29:58.445 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:29:58.445 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.445 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.446 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:29:58.446 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.446 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.446 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6826", 2020-05-18T21:29:58.447 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:29:58.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.447 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.447 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6827", 2020-05-18T21:29:58.448 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:29:58.448 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.448 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.449 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:29:58.449 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.449 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.449 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6830", 2020-05-18T21:29:58.449 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:29:58.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.450 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.450 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6831", 2020-05-18T21:29:58.450 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:29:58.451 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.451 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.451 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:29:58.451 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.452 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.452 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6828", 2020-05-18T21:29:58.452 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:29:58.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.453 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.453 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6829", 2020-05-18T21:29:58.453 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:29:58.453 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.453 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.454 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6824/12806", 2020-05-18T21:29:58.454 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6827/12806", 2020-05-18T21:29:58.454 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6831/12806", 2020-05-18T21:29:58.454 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6829/12806", 2020-05-18T21:29:58.454 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:29:58.455 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:29:58.455 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:29:58.455 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.455 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:29:58.456 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "1030fedf-adad-4e79-b839-59385d4d7d2a", 2020-05-18T21:29:58.456 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:29:58.456 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:29:58.456 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:29:58.456 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:29:58.457 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:29:58.457 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:29:58.457 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:29:58.457 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 46, 2020-05-18T21:29:58.457 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:29:58.458 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:29:58.458 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:29:58.458 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.458 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.458 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6814", 2020-05-18T21:29:58.459 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:29:58.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.459 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.459 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6816", 2020-05-18T21:29:58.460 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:29:58.460 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.460 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.460 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:29:58.460 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.461 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.461 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6818", 2020-05-18T21:29:58.461 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:29:58.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.462 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.462 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6819", 2020-05-18T21:29:58.462 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:29:58.462 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.462 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.463 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:29:58.463 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.463 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.464 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6823", 2020-05-18T21:29:58.464 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:29:58.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.465 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.465 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6825", 2020-05-18T21:29:58.465 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:29:58.465 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.465 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.466 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:29:58.466 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.466 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.466 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6820", 2020-05-18T21:29:58.467 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:29:58.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.467 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.467 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6821", 2020-05-18T21:29:58.468 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:29:58.468 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.468 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.468 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6816/12805", 2020-05-18T21:29:58.468 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6819/12805", 2020-05-18T21:29:58.469 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6825/12805", 2020-05-18T21:29:58.469 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6821/12805", 2020-05-18T21:29:58.469 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:29:58.469 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:29:58.469 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:29:58.470 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.470 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:29:58.470 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "8ad15a9b-97b4-4002-b1d4-7292e09b4ef6", 2020-05-18T21:29:58.470 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:29:58.471 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:29:58.471 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:29:58.471 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:29:58.471 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:29:58.471 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:29:58.472 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:29:58.472 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 59, 2020-05-18T21:29:58.472 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:29:58.472 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:29:58.472 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:29:58.472 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.473 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.473 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6800", 2020-05-18T21:29:58.473 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:29:58.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.474 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.474 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6801", 2020-05-18T21:29:58.474 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:29:58.474 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.474 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.475 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:29:58.475 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.475 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.476 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6802", 2020-05-18T21:29:58.476 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:29:58.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.476 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.476 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6803", 2020-05-18T21:29:58.477 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:29:58.477 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.477 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.477 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:29:58.478 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.478 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.478 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6806", 2020-05-18T21:29:58.478 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:29:58.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.479 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.479 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6807", 2020-05-18T21:29:58.479 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:29:58.479 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.480 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.480 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:29:58.480 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.480 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.481 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6804", 2020-05-18T21:29:58.481 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:29:58.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.481 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.482 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6805", 2020-05-18T21:29:58.482 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:29:58.482 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.482 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.483 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6801/13023", 2020-05-18T21:29:58.483 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6803/13023", 2020-05-18T21:29:58.483 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6807/13023", 2020-05-18T21:29:58.483 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6805/13023", 2020-05-18T21:29:58.484 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:29:58.484 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:29:58.484 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:29:58.484 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.485 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:29:58.485 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0dce88f8-b984-43e1-95e2-4132171102d2", 2020-05-18T21:29:58.485 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:29:58.485 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:29:58.485 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:29:58.486 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:29:58.486 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:29:58.486 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:29:58.486 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:29:58.486 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 58, 2020-05-18T21:29:58.486 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:29:58.487 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:29:58.487 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:29:58.487 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.487 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.488 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6808", 2020-05-18T21:29:58.488 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:29:58.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.488 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.488 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6809", 2020-05-18T21:29:58.489 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:29:58.489 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.489 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.489 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:29:58.490 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.490 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.490 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6810", 2020-05-18T21:29:58.490 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:29:58.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.491 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.491 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6811", 2020-05-18T21:29:58.491 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:29:58.491 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.492 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.492 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:29:58.492 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.493 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.493 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6814", 2020-05-18T21:29:58.493 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:29:58.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.494 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.494 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6816", 2020-05-18T21:29:58.494 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:29:58.494 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.495 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.495 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:29:58.495 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.495 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.496 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6812", 2020-05-18T21:29:58.496 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:29:58.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.496 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.497 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6813", 2020-05-18T21:29:58.497 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:29:58.497 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.497 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.497 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6809/13024", 2020-05-18T21:29:58.498 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6811/13024", 2020-05-18T21:29:58.498 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6816/13024", 2020-05-18T21:29:58.498 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6813/13024", 2020-05-18T21:29:58.498 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:29:58.498 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:29:58.499 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:29:58.499 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.499 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:29:58.499 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "e1bc92f8-3692-4483-b0fb-905c94fa1469", 2020-05-18T21:29:58.500 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:29:58.500 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:29:58.500 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:29:58.500 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:29:58.500 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:29:58.501 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:29:58.501 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:29:58.501 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 59, 2020-05-18T21:29:58.501 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:29:58.501 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:29:58.501 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:29:58.502 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.502 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.502 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6815", 2020-05-18T21:29:58.502 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:29:58.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.503 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.503 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6817", 2020-05-18T21:29:58.503 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:29:58.503 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.504 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.504 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:29:58.504 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.505 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.505 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6818", 2020-05-18T21:29:58.505 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:29:58.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.506 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.506 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6819", 2020-05-18T21:29:58.506 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:29:58.506 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.506 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.507 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:29:58.507 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.507 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.507 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6822", 2020-05-18T21:29:58.507 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:29:58.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.508 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.508 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6824", 2020-05-18T21:29:58.508 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:29:58.509 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.509 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.509 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:29:58.509 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.510 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.510 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6820", 2020-05-18T21:29:58.510 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:29:58.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.511 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.511 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6821", 2020-05-18T21:29:58.511 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:29:58.511 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.512 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.512 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6817/13025", 2020-05-18T21:29:58.512 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6819/13025", 2020-05-18T21:29:58.512 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6824/13025", 2020-05-18T21:29:58.513 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6821/13025", 2020-05-18T21:29:58.513 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:29:58.513 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:29:58.514 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:29:58.514 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.515 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:29:58.515 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "b76e000c-a078-48c4-9e1e-34d286a9992c", 2020-05-18T21:29:58.515 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:29:58.515 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:29:58.515 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:29:58.515 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:29:58.516 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:29:58.517 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:29:58.517 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:29:58.517 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 58, 2020-05-18T21:29:58.517 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:29:58.518 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:29:58.518 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:29:58.518 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.518 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.518 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6823", 2020-05-18T21:29:58.519 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:29:58.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.519 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.519 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6825", 2020-05-18T21:29:58.520 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:29:58.520 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.520 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.520 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:29:58.521 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.521 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.521 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6826", 2020-05-18T21:29:58.521 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:29:58.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.522 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.522 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6827", 2020-05-18T21:29:58.522 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:29:58.522 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.523 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.523 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:29:58.523 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.524 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.524 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6830", 2020-05-18T21:29:58.524 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:29:58.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.524 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.525 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6831", 2020-05-18T21:29:58.525 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:29:58.525 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.525 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.526 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:29:58.526 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:29:58.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.526 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:29:58.526 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6828", 2020-05-18T21:29:58.526 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:29:58.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.527 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:29:58.527 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6829", 2020-05-18T21:29:58.527 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:29:58.528 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.528 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.528 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6825/13026", 2020-05-18T21:29:58.528 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6827/13026", 2020-05-18T21:29:58.528 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6831/13026", 2020-05-18T21:29:58.529 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6829/13026", 2020-05-18T21:29:58.529 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:29:58.529 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:29:58.529 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:29:58.529 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:29:58.530 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.530 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:29:58.530 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2020-05-18T21:29:58.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.530 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:29:58.531 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:29:58.531 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:29:58.531 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:29:58.531 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:29:58.531 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:29:58.531 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.281434+0000", 2020-05-18T21:29:58.532 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:29:58.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.532 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:29:58.532 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:29:58.533 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:29:58.533 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:29:58.533 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:29:58.533 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:29:58.533 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.608518+0000", 2020-05-18T21:29:58.534 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:29:58.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.534 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:29:58.534 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:29:58.535 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:29:58.535 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:29:58.535 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:29:58.535 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:29:58.535 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.582386+0000", 2020-05-18T21:29:58.536 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:29:58.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.536 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:29:58.536 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:29:58.537 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:29:58.537 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:29:58.537 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:29:58.537 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:29:58.537 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.573488+0000", 2020-05-18T21:29:58.538 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:29:58.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.538 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:29:58.538 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:29:58.538 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:29:58.539 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:29:58.539 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:29:58.539 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:29:58.539 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.604174+0000", 2020-05-18T21:29:58.539 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:29:58.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.540 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:29:58.540 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:29:58.540 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:29:58.540 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:29:58.541 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:29:58.541 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:29:58.541 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.371004+0000", 2020-05-18T21:29:58.541 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:29:58.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.542 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:29:58.542 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:29:58.542 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:29:58.542 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:29:58.542 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:29:58.543 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:29:58.543 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.593070+0000", 2020-05-18T21:29:58.543 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:29:58.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:29:58.544 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:29:58.544 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:29:58.544 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:29:58.544 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:29:58.544 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:29:58.545 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:29:58.545 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.667677+0000", 2020-05-18T21:29:58.545 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:29:58.545 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.545 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:29:58.545 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2020-05-18T21:29:58.546 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2020-05-18T21:29:58.546 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2020-05-18T21:29:58.546 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2020-05-18T21:29:58.546 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklist": { 2020-05-18T21:29:58.546 INFO:teuthology.orchestra.run.smithi063.stdout: "172.21.15.155:6835/3117563034": "2020-05-19T21:29:18.642141+0000", 2020-05-18T21:29:58.547 INFO:teuthology.orchestra.run.smithi063.stdout: "172.21.15.155:6834/3117563034": "2020-05-19T21:29:18.642141+0000" 2020-05-18T21:29:58.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.547 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2020-05-18T21:29:58.547 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2020-05-18T21:29:58.547 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2020-05-18T21:29:58.547 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2020-05-18T21:29:58.548 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2020-05-18T21:29:58.548 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2020-05-18T21:29:58.548 INFO:teuthology.orchestra.run.smithi063.stdout: "ruleset-failure-domain": "osd", 2020-05-18T21:29:58.548 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2020-05-18T21:29:58.548 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:29:58.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:29:58.549 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2020-05-18T21:29:58.549 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2020-05-18T21:29:58.549 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2020-05-18T21:29:58.549 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2020-05-18T21:29:58.549 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {} 2020-05-18T21:29:58.550 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:29:58.551 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:29:58.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.657+0000 7fafcf59e700 1 Processor -- start 2020-05-18T21:29:58.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcf59e700 1 -- start start 2020-05-18T21:29:58.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcf59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fafd00b45f0 0x7fafd00632f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:58.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcf59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd0145790 con 0x7fafd0145ed0 2020-05-18T21:29:58.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcf59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd0145a30 con 0x7fafd00658a0 2020-05-18T21:29:58.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcf59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd0065c80 con 0x7fafd00b45f0 2020-05-18T21:29:58.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafced9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fafd0145ed0 0x7fafd0142190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58986/0 (socket says 172.21.15.63:58986) 2020-05-18T21:29:58.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafced9d700 1 -- 172.21.15.63:0/320302533 learned_addr learned my addr 172.21.15.63:0/320302533 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:58.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcdd9b700 1 --2- 172.21.15.63:0/320302533 >> v2:172.21.15.155:3300/0 conn(0x7fafd00b45f0 0x7fafd00632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:58.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcd59a700 1 -- 172.21.15.63:0/320302533 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989614336 0 0) 0x7fafd0145790 con 0x7fafd0145ed0 2020-05-18T21:29:58.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcd59a700 1 -- 172.21.15.63:0/320302533 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafb0003270 con 0x7fafd0145ed0 2020-05-18T21:29:58.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcd59a700 1 -- 172.21.15.63:0/320302533 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041383911 0 0) 0x7fafd0145a30 con 0x7fafd00658a0 2020-05-18T21:29:58.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcd59a700 1 -- 172.21.15.63:0/320302533 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafd0145790 con 0x7fafd00658a0 2020-05-18T21:29:58.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcdd9b700 1 -- 172.21.15.63:0/320302533 >> v1:172.21.15.155:6789/0 conn(0x7fafd00658a0 legacy=0x7fafd00b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcdd9b700 1 -- 172.21.15.63:0/320302533 >> v1:172.21.15.63:6789/0 conn(0x7fafd0145ed0 legacy=0x7fafd0142190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcdd9b700 1 -- 172.21.15.63:0/320302533 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd00b8910 con 0x7fafd00b45f0 2020-05-18T21:29:58.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcdd9b700 1 --2- 172.21.15.63:0/320302533 >> v2:172.21.15.155:3300/0 conn(0x7fafd00b45f0 0x7fafd00632f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fafc0002f70 tx=0x7fafc0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcdd9b700 1 --2- 172.21.15.63:0/320302533 >> v2:172.21.15.155:3300/0 conn(0x7fafd00b45f0 0x7fafd00632f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fafc0002f70 tx=0x7fafc0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcdd9b700 1 --2- 172.21.15.63:0/320302533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafd00b45f0 0x7fafd00632f0 secure :-1 s=READY pgs=564 cs=0 l=1 rx=0x7fafc0002f70 tx=0x7fafc0007a80).ready entity=mon.1 client_cookie=751f5dd468169d4f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:58.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcdd9b700 1 --2- 172.21.15.63:0/320302533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafd00b45f0 0x7fafd00632f0 secure :-1 s=THROTTLE_DONE pgs=564 cs=0 l=1 rx=0x7fafc0002f70 tx=0x7fafc0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcd59a700 1 -- 172.21.15.63:0/320302533 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafc0008e80 con 0x7fafd00b45f0 2020-05-18T21:29:58.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcdd9b700 1 --2- 172.21.15.63:0/320302533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafd00b45f0 0x7fafd00632f0 secure :-1 s=THROTTLE_DONE pgs=564 cs=0 l=1 rx=0x7fafc0002f70 tx=0x7fafc0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcd59a700 1 -- 172.21.15.63:0/320302533 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc0011540 con 0x7fafd00b45f0 2020-05-18T21:29:58.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcdd9b700 1 --2- 172.21.15.63:0/320302533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafd00b45f0 0x7fafd00632f0 secure :-1 s=THROTTLE_DONE pgs=564 cs=0 l=1 rx=0x7fafc0002f70 tx=0x7fafc0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcd59a700 1 -- 172.21.15.63:0/320302533 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafc00118a0 con 0x7fafd00b45f0 2020-05-18T21:29:58.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcf59e700 1 -- 172.21.15.63:0/320302533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafd00b45f0 msgr2=0x7fafd00632f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcf59e700 1 --2- 172.21.15.63:0/320302533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafd00b45f0 0x7fafd00632f0 secure :-1 s=READY pgs=564 cs=0 l=1 rx=0x7fafc0002f70 tx=0x7fafc0007a80).stop 2020-05-18T21:29:58.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcf59e700 1 -- 172.21.15.63:0/320302533 shutdown_connections 2020-05-18T21:29:58.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcf59e700 1 --2- 172.21.15.63:0/320302533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafd00b45f0 0x7fafd00632f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:58.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcf59e700 1 -- 172.21.15.63:0/320302533 >> 172.21.15.63:0/320302533 conn(0x7fafd0069fc0 msgr2=0x7fafd006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:58.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcf59e700 1 -- 172.21.15.63:0/320302533 shutdown_connections 2020-05-18T21:29:58.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.661+0000 7fafcf59e700 1 -- 172.21.15.63:0/320302533 wait complete. 2020-05-18T21:29:58.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.665+0000 7fafcf59e700 1 Processor -- start 2020-05-18T21:29:58.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.665+0000 7fafcf59e700 1 -- start start 2020-05-18T21:29:58.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafcf59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fafd0145ed0 0x7fafd013baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:58.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafcf59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd013c2a0 con 0x7fafd00658a0 2020-05-18T21:29:58.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafcf59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd013fc60 con 0x7fafd00b45f0 2020-05-18T21:29:58.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafcf59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd013c090 con 0x7fafd0145ed0 2020-05-18T21:29:58.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafce59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fafd00658a0 0x7fafd0130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58988/0 (socket says 172.21.15.63:58988) 2020-05-18T21:29:58.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafce59c700 1 -- 172.21.15.63:0/292357614 learned_addr learned my addr 172.21.15.63:0/292357614 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:58.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafced9d700 1 --2- 172.21.15.63:0/292357614 >> v2:172.21.15.155:3300/0 conn(0x7fafd0145ed0 0x7fafd013baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:58.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142209312 0 0) 0x7fafd013c2a0 con 0x7fafd00658a0 2020-05-18T21:29:58.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafb4002fe0 con 0x7fafd00658a0 2020-05-18T21:29:58.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812441294 0 0) 0x7fafd013fc60 con 0x7fafd00b45f0 2020-05-18T21:29:58.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafd013c2a0 con 0x7fafd00b45f0 2020-05-18T21:29:58.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1298623826 0 0) 0x7fafb4002fe0 con 0x7fafd00658a0 2020-05-18T21:29:58.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fafd013fc60 con 0x7fafd00658a0 2020-05-18T21:29:58.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fafb80019c0 con 0x7fafd00658a0 2020-05-18T21:29:58.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 >> v2:172.21.15.155:3300/0 conn(0x7fafd0145ed0 msgr2=0x7fafd013baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 --2- 172.21.15.63:0/292357614 >> v2:172.21.15.155:3300/0 conn(0x7fafd0145ed0 0x7fafd013baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:58.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 >> v1:172.21.15.155:6789/0 conn(0x7fafd00b45f0 legacy=0x7fafd0140100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 >> v1:172.21.15.63:6789/0 conn(0x7fafd00658a0 legacy=0x7fafd0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafb4004c40 0x7fafb4005040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:58.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafb4003880 0x7fafb4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:58.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fafb4004160 0x7fafb400b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:58.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd013c090 con 0x7fafb4004c40 2020-05-18T21:29:58.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb400bbc0 con 0x7fafb4003880 2020-05-18T21:29:58.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb400bd00 con 0x7fafb4004160 2020-05-18T21:29:58.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafce59c700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafb4004c40 0x7fafb4005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:58.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafcdd9b700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafb4003880 0x7fafb4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:58.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafced9d700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fafb4004160 0x7fafb400b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:58.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafce59c700 1 -- 172.21.15.63:0/292357614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fafb4004160 msgr2=0x7fafb400b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafce59c700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fafb4004160 0x7fafb400b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:58.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafce59c700 1 -- 172.21.15.63:0/292357614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafb4003880 msgr2=0x7fafb4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafce59c700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafb4003880 0x7fafb4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:58.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafce59c700 1 -- 172.21.15.63:0/292357614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd01312b0 con 0x7fafb4004c40 2020-05-18T21:29:58.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafcf59e700 1 -- 172.21.15.63:0/292357614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd0141b20 con 0x7fafb4004c40 2020-05-18T21:29:58.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafce59c700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafb4004c40 0x7fafb4005040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fafb4003390 tx=0x7fafb8011350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafced9d700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fafb4004160 0x7fafb400b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:29:58.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafcf59e700 1 -- 172.21.15.63:0/292357614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd01409b0 con 0x7fafb4004c40 2020-05-18T21:29:58.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafced9d700 1 -- 172.21.15.63:0/292357614 reap_dead start 2020-05-18T21:29:58.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafce59c700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafb4004c40 0x7fafb4005040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fafb4003390 tx=0x7fafb8011350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafce59c700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafb4004c40 0x7fafb4005040 secure :-1 s=READY pgs=798 cs=0 l=1 rx=0x7fafb4003390 tx=0x7fafb8011350).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:58.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafce59c700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafb4004c40 0x7fafb4005040 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7fafb4003390 tx=0x7fafb8011350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafce59c700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafb4004c40 0x7fafb4005040 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7fafb4003390 tx=0x7fafb8011350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafce59c700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafb4004c40 0x7fafb4005040 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7fafb4003390 tx=0x7fafb8011350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafb800eba0 con 0x7fafb4004c40 2020-05-18T21:29:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb800ed00 con 0x7fafb4004c40 2020-05-18T21:29:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafb8010360 con 0x7fafb4004c40 2020-05-18T21:29:58.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafce59c700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafb4004c40 0x7fafb4005040 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7fafb4003390 tx=0x7fafb8011350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.669+0000 7fafcf59e700 1 -- 172.21.15.63:0/292357614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa8003380 con 0x7fafb4004c40 2020-05-18T21:29:58.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.673+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fafb80104c0 con 0x7fafb4004c40 2020-05-18T21:29:58.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.673+0000 7fafce59c700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafb4004c40 0x7fafb4005040 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7fafb4003390 tx=0x7fafb8011350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.673+0000 7fafc77fe700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fafb4053b10 0x7fafb4055fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:58.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.673+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fafb8063d70 con 0x7fafb4004c40 2020-05-18T21:29:58.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.673+0000 7fafcdd9b700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fafb4053b10 0x7fafb4055fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:58.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.673+0000 7fafcdd9b700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fafb4053b10 0x7fafb4055fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fafc0008500 tx=0x7fafc0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.673+0000 7fafcdd9b700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fafb4053b10 0x7fafb4055fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fafc0008500 tx=0x7fafc0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.673+0000 7fafcdd9b700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fafb4053b10 0x7fafb4055fd0 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7fafc0008500 tx=0x7fafc0007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:58.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.677+0000 7fafce59c700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafb4004c40 0x7fafb4005040 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7fafb4003390 tx=0x7fafb8011350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.677+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fafb803e180 con 0x7fafb4004c40 2020-05-18T21:29:58.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.829+0000 7fafcf59e700 1 -- 172.21.15.63:0/292357614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fafa8003720 con 0x7fafb4004c40 2020-05-18T21:29:58.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.829+0000 7fafce59c700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafb4004c40 0x7fafb4005040 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7fafb4003390 tx=0x7fafb8011350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.829+0000 7fafc77fe700 1 -- 172.21.15.63:0/292357614 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2141 (secure 0 0 0) 0x7fafb8041780 con 0x7fafb4004c40 2020-05-18T21:29:58.836 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:29:58.836 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/3895568247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3895568247},{"type":"v1","addr":"172.21.15.63:6833","nonce":3895568247}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:24.694515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6319":{"gid":6319,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/400120989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":400120989},{"type":"v1","addr":"172.21.15.155:6835","nonce":400120989}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:29:58.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.833+0000 7fafcf59e700 1 -- 172.21.15.63:0/292357614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fafb4053b10 msgr2=0x7fafb4055fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.833+0000 7fafcf59e700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fafb4053b10 0x7fafb4055fd0 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7fafc0008500 tx=0x7fafc0007a80).stop 2020-05-18T21:29:58.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.833+0000 7fafcf59e700 1 -- 172.21.15.63:0/292357614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafb4004c40 msgr2=0x7fafb4005040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.833+0000 7fafcf59e700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafb4004c40 0x7fafb4005040 secure :-1 s=READY pgs=798 cs=0 l=1 rx=0x7fafb4003390 tx=0x7fafb8011350).stop 2020-05-18T21:29:58.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.833+0000 7fafcf59e700 1 -- 172.21.15.63:0/292357614 shutdown_connections 2020-05-18T21:29:58.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.833+0000 7fafcf59e700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fafb4053b10 0x7fafb4055fd0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:58.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.833+0000 7fafcf59e700 1 --2- 172.21.15.63:0/292357614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafb4004c40 0x7fafb4005040 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:58.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.833+0000 7fafcf59e700 1 -- 172.21.15.63:0/292357614 >> 172.21.15.63:0/292357614 conn(0x7fafd0069fc0 msgr2=0x7fafd0061ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:58.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.833+0000 7fafcf59e700 1 -- 172.21.15.63:0/292357614 shutdown_connections 2020-05-18T21:29:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.833+0000 7fafcf59e700 1 -- 172.21.15.63:0/292357614 wait complete. 2020-05-18T21:29:58.840 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 34 2020-05-18T21:29:58.849 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-05-18T21:29:58.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.949+0000 7f0eb5636700 1 Processor -- start 2020-05-18T21:29:58.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.949+0000 7f0eb5636700 1 -- start start 2020-05-18T21:29:58.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.949+0000 7f0eb5636700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0eb009e8d0 0x7f0eb0099ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:58.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.949+0000 7f0eb5636700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb005f140 0x7f0eb014e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:29:58.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.949+0000 7f0eb5636700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb005f960 con 0x7f0eb00b6170 2020-05-18T21:29:58.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.949+0000 7f0eb5636700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb005f5b0 con 0x7f0eb009e8d0 2020-05-18T21:29:58.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.949+0000 7f0eb5636700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb005fc00 con 0x7f0eb005f140 2020-05-18T21:29:58.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.949+0000 7f0eae7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0eb009e8d0 0x7f0eb0099ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:58.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.949+0000 7f0eae7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0eb009e8d0 0x7f0eb0099ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56814/0 (socket says 172.21.15.63:56814) 2020-05-18T21:29:58.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.949+0000 7f0eae7fc700 1 -- 172.21.15.63:0/4099510750 learned_addr learned my addr 172.21.15.63:0/4099510750 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:29:58.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.949+0000 7f0eaf7fe700 1 --2- 172.21.15.63:0/4099510750 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb005f140 0x7f0eb014e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:58.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.949+0000 7f0eae7fc700 1 -- 172.21.15.63:0/4099510750 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb005f140 msgr2=0x7f0eb014e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:29:58.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.949+0000 7f0eae7fc700 1 --2- 172.21.15.63:0/4099510750 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb005f140 0x7f0eb014e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:58.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.949+0000 7f0eae7fc700 1 -- 172.21.15.63:0/4099510750 >> v1:172.21.15.155:6789/0 conn(0x7f0eb00b6170 legacy=0x7f0eb009e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.949+0000 7f0eae7fc700 1 -- 172.21.15.63:0/4099510750 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb005fea0 con 0x7f0eb009e8d0 2020-05-18T21:29:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.949+0000 7f0eae7fc700 1 --2- 172.21.15.63:0/4099510750 >> v2:172.21.15.63:3300/0 conn(0x7f0eb009e8d0 0x7f0eb0099ca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0e98002f70 tx=0x7f0e98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.949+0000 7f0eae7fc700 1 --2- 172.21.15.63:0/4099510750 >> v2:172.21.15.63:3300/0 conn(0x7f0eb009e8d0 0x7f0eb0099ca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0e98002f70 tx=0x7f0e98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.953+0000 7f0eae7fc700 1 --2- 172.21.15.63:0/4099510750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb009e8d0 0x7f0eb0099ca0 secure :-1 s=READY pgs=799 cs=0 l=1 rx=0x7f0e98002f70 tx=0x7f0e98007a80).ready entity=mon.0 client_cookie=22c5fcfcddb0fd74 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.953+0000 7f0eae7fc700 1 --2- 172.21.15.63:0/4099510750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb009e8d0 0x7f0eb0099ca0 secure :-1 s=THROTTLE_DONE pgs=799 cs=0 l=1 rx=0x7f0e98002f70 tx=0x7f0e98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.953+0000 7f0eae7fc700 1 --2- 172.21.15.63:0/4099510750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb009e8d0 0x7f0eb0099ca0 secure :-1 s=THROTTLE_DONE pgs=799 cs=0 l=1 rx=0x7f0e98002f70 tx=0x7f0e98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.953+0000 7f0eadffb700 1 -- 172.21.15.63:0/4099510750 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e980116b0 con 0x7f0eb009e8d0 2020-05-18T21:29:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.953+0000 7f0eae7fc700 1 --2- 172.21.15.63:0/4099510750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb009e8d0 0x7f0eb0099ca0 secure :-1 s=THROTTLE_DONE pgs=799 cs=0 l=1 rx=0x7f0e98002f70 tx=0x7f0e98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.953+0000 7f0eadffb700 1 -- 172.21.15.63:0/4099510750 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e98011810 con 0x7f0eb009e8d0 2020-05-18T21:29:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.953+0000 7f0eadffb700 1 -- 172.21.15.63:0/4099510750 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e98011c30 con 0x7f0eb009e8d0 2020-05-18T21:29:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.953+0000 7f0eb5636700 1 -- 172.21.15.63:0/4099510750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb009e8d0 msgr2=0x7f0eb0099ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.953+0000 7f0eb5636700 1 --2- 172.21.15.63:0/4099510750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb009e8d0 0x7f0eb0099ca0 secure :-1 s=READY pgs=799 cs=0 l=1 rx=0x7f0e98002f70 tx=0x7f0e98007a80).stop 2020-05-18T21:29:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.953+0000 7f0eb5636700 1 -- 172.21.15.63:0/4099510750 shutdown_connections 2020-05-18T21:29:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.953+0000 7f0eb5636700 1 --2- 172.21.15.63:0/4099510750 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb005f140 0x7f0eb014e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:29:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.953+0000 7f0eb5636700 1 --2- 172.21.15.63:0/4099510750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb009e8d0 0x7f0eb0099ca0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:58.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.953+0000 7f0eb5636700 1 -- 172.21.15.63:0/4099510750 >> 172.21.15.63:0/4099510750 conn(0x7f0eb00b9750 msgr2=0x7f0eb00b5720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:58.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.953+0000 7f0eb5636700 1 -- 172.21.15.63:0/4099510750 shutdown_connections 2020-05-18T21:29:58.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.953+0000 7f0eb5636700 1 -- 172.21.15.63:0/4099510750 wait complete. 2020-05-18T21:29:58.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.953+0000 7f0eb5636700 1 Processor -- start 2020-05-18T21:29:58.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.953+0000 7f0eb5636700 1 -- start start 2020-05-18T21:29:58.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0eb5636700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb009e8d0 0x7f0eb0141840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:58.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0eb5636700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb0144130 con 0x7f0eb00b6170 2020-05-18T21:29:58.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0eb5636700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb01496a0 con 0x7f0eb005f140 2020-05-18T21:29:58.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0eb5636700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb0143e90 con 0x7f0eb009e8d0 2020-05-18T21:29:58.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0eaf7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0eb00b6170 0x7f0eb013f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59012/0 (socket says 172.21.15.63:59012) 2020-05-18T21:29:58.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0eaf7fe700 1 -- 172.21.15.63:0/1635679198 learned_addr learned my addr 172.21.15.63:0/1635679198 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:29:58.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0eae7fc700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb009e8d0 0x7f0eb0141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:58.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0ea7fff700 1 -- 172.21.15.63:0/1635679198 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208063813 0 0) 0x7f0eb0144130 con 0x7f0eb00b6170 2020-05-18T21:29:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0ea7fff700 1 -- 172.21.15.63:0/1635679198 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e94002fe0 con 0x7f0eb00b6170 2020-05-18T21:29:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0ea7fff700 1 -- 172.21.15.63:0/1635679198 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622018181 0 0) 0x7f0eb01496a0 con 0x7f0eb005f140 2020-05-18T21:29:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0ea7fff700 1 -- 172.21.15.63:0/1635679198 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eb0144130 con 0x7f0eb005f140 2020-05-18T21:29:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0eae7fc700 1 -- 172.21.15.63:0/1635679198 >> v1:172.21.15.155:6789/0 conn(0x7f0eb005f140 legacy=0x7f0eb0148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0eae7fc700 1 -- 172.21.15.63:0/1635679198 >> v1:172.21.15.63:6789/0 conn(0x7f0eb00b6170 legacy=0x7f0eb013f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:58.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0eae7fc700 1 -- 172.21.15.63:0/1635679198 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb0142340 con 0x7f0eb009e8d0 2020-05-18T21:29:58.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0eae7fc700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb009e8d0 0x7f0eb0141840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0e98002f70 tx=0x7f0e98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0eae7fc700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb009e8d0 0x7f0eb0141840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0e98002f70 tx=0x7f0e98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0eae7fc700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb009e8d0 0x7f0eb0141840 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f0e98002f70 tx=0x7f0e98007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:58.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0eae7fc700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb009e8d0 0x7f0eb0141840 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f0e98002f70 tx=0x7f0e98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0ea7fff700 1 -- 172.21.15.63:0/1635679198 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e98010250 con 0x7f0eb009e8d0 2020-05-18T21:29:58.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0eae7fc700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb009e8d0 0x7f0eb0141840 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f0e98002f70 tx=0x7f0e98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0ea7fff700 1 -- 172.21.15.63:0/1635679198 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e98007170 con 0x7f0eb009e8d0 2020-05-18T21:29:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0eae7fc700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb009e8d0 0x7f0eb0141840 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f0e98002f70 tx=0x7f0e98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0eb5636700 1 -- 172.21.15.63:0/1635679198 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb0143b80 con 0x7f0eb009e8d0 2020-05-18T21:29:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0ea7fff700 1 -- 172.21.15.63:0/1635679198 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e980074d0 con 0x7f0eb009e8d0 2020-05-18T21:29:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.957+0000 7f0eb5636700 1 -- 172.21.15.63:0/1635679198 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb0147cf0 con 0x7f0eb009e8d0 2020-05-18T21:29:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.961+0000 7f0eae7fc700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb009e8d0 0x7f0eb0141840 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f0e98002f70 tx=0x7f0e98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.961+0000 7f0eb5636700 1 -- 172.21.15.63:0/1635679198 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb00569e0 con 0x7f0eb009e8d0 2020-05-18T21:29:58.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.961+0000 7f0ea7fff700 1 -- 172.21.15.63:0/1635679198 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0e98005700 con 0x7f0eb009e8d0 2020-05-18T21:29:58.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.961+0000 7f0eae7fc700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb009e8d0 0x7f0eb0141840 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f0e98002f70 tx=0x7f0e98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.961+0000 7f0ea7fff700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9404feb0 0x7f0e94052370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:29:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.961+0000 7f0ea7fff700 1 -- 172.21.15.63:0/1635679198 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0e980642c0 con 0x7f0eb009e8d0 2020-05-18T21:29:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.961+0000 7f0eaeffd700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9404feb0 0x7f0e94052370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:29:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.961+0000 7f0eaeffd700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9404feb0 0x7f0e94052370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ea0001020 tx=0x7f0ea0002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.961+0000 7f0eaeffd700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9404feb0 0x7f0e94052370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ea0001020 tx=0x7f0ea0002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.961+0000 7f0eaeffd700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9404feb0 0x7f0e94052370 secure :-1 s=READY pgs=322 cs=0 l=1 rx=0x7f0ea0001020 tx=0x7f0ea0002740).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:29:58.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.969+0000 7f0eae7fc700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb009e8d0 0x7f0eb0141840 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f0e98002f70 tx=0x7f0e98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:58.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:58.969+0000 7f0ea7fff700 1 -- 172.21.15.63:0/1635679198 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f0e9803e6b0 con 0x7f0eb009e8d0 2020-05-18T21:29:59.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:59.117+0000 7f0eb5636700 1 -- 172.21.15.63:0/1635679198 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0eb005c060 con 0x7f0eb009e8d0 2020-05-18T21:29:59.200 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:29:59.203 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:29:59.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:59.957+0000 7f0eae7fc700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb009e8d0 0x7f0eb0141840 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f0e98002f70 tx=0x7f0e98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:59.968 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:29:59.961+0000 7fdb4592c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:29:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:59.981+0000 7f0eae7fc700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb009e8d0 0x7f0eb0141840 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f0e98002f70 tx=0x7f0e98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:29:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:59.981+0000 7f0ea7fff700 1 -- 172.21.15.63:0/1635679198 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0e98041cd0 con 0x7f0eb009e8d0 2020-05-18T21:29:59.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:59.981+0000 7f0eb5636700 1 -- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9404feb0 msgr2=0x7f0e94052370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:59.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:59.981+0000 7f0eb5636700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9404feb0 0x7f0e94052370 secure :-1 s=READY pgs=322 cs=0 l=1 rx=0x7f0ea0001020 tx=0x7f0ea0002740).stop 2020-05-18T21:29:59.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:59.981+0000 7f0eb5636700 1 -- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb009e8d0 msgr2=0x7f0eb0141840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:29:59.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:59.981+0000 7f0eb5636700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb009e8d0 0x7f0eb0141840 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f0e98002f70 tx=0x7f0e98007a80).stop 2020-05-18T21:29:59.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:59.981+0000 7f0eb5636700 1 -- 172.21.15.63:0/1635679198 shutdown_connections 2020-05-18T21:29:59.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:59.981+0000 7f0eb5636700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9404feb0 0x7f0e94052370 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:59.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:59.981+0000 7f0eb5636700 1 --2- 172.21.15.63:0/1635679198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb009e8d0 0x7f0eb0141840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:29:59.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:59.981+0000 7f0eb5636700 1 -- 172.21.15.63:0/1635679198 >> 172.21.15.63:0/1635679198 conn(0x7f0eb00b9750 msgr2=0x7f0eb014df40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:29:59.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:59.985+0000 7f0eb5636700 1 -- 172.21.15.63:0/1635679198 shutdown_connections 2020-05-18T21:29:59.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:29:59.985+0000 7f0eb5636700 1 -- 172.21.15.63:0/1635679198 wait complete. 2020-05-18T21:29:59.991 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-05-18T21:30:00.004 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:30:00.029 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:30:00.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.109+0000 7fd8abfff700 1 Processor -- start 2020-05-18T21:30:00.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.109+0000 7fd8abfff700 1 -- start start 2020-05-18T21:30:00.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8abfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8ac0b6500 0x7fd8ac144200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:00.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8abfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd8ac062150 0x7fd8ac0625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:00.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8abfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8ac065050 con 0x7fd8ac069f10 2020-05-18T21:30:00.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8abfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8ac144660 con 0x7fd8ac062150 2020-05-18T21:30:00.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8abfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac147320 con 0x7fd8ac0b6500 2020-05-18T21:30:00.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8aaffd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd8ac069f10 0x7fd8ac061a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:57332/0 (socket says 172.21.15.63:57332) 2020-05-18T21:30:00.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8aaffd700 1 -- 172.21.15.63:0/692724098 learned_addr learned my addr 172.21.15.63:0/692724098 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:00.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8aa7fc700 1 --2- 172.21.15.63:0/692724098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8ac0b6500 0x7fd8ac144200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:00.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8ab7fe700 1 --2- 172.21.15.63:0/692724098 >> v2:172.21.15.155:3300/0 conn(0x7fd8ac062150 0x7fd8ac0625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:00.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8a9ffb700 1 -- 172.21.15.63:0/692724098 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967445998 0 0) 0x7fd8ac065050 con 0x7fd8ac069f10 2020-05-18T21:30:00.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8a9ffb700 1 -- 172.21.15.63:0/692724098 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd890003270 con 0x7fd8ac069f10 2020-05-18T21:30:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8ab7fe700 1 -- 172.21.15.63:0/692724098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8ac0b6500 msgr2=0x7fd8ac144200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:00.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8ab7fe700 1 --2- 172.21.15.63:0/692724098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8ac0b6500 0x7fd8ac144200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:00.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8ab7fe700 1 -- 172.21.15.63:0/692724098 >> v1:172.21.15.155:6789/0 conn(0x7fd8ac069f10 legacy=0x7fd8ac061a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:00.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8ab7fe700 1 -- 172.21.15.63:0/692724098 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac06a2f0 con 0x7fd8ac062150 2020-05-18T21:30:00.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8aa7fc700 1 --2- 172.21.15.63:0/692724098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8ac0b6500 0x7fd8ac144200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:30:00.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8ab7fe700 1 --2- 172.21.15.63:0/692724098 >> v2:172.21.15.155:3300/0 conn(0x7fd8ac062150 0x7fd8ac0625e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd8a40032f0 tx=0x7fd8a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8ab7fe700 1 --2- 172.21.15.63:0/692724098 >> v2:172.21.15.155:3300/0 conn(0x7fd8ac062150 0x7fd8ac0625e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd8a40032f0 tx=0x7fd8a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8ab7fe700 1 --2- 172.21.15.63:0/692724098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8ac062150 0x7fd8ac0625e0 secure :-1 s=READY pgs=572 cs=0 l=1 rx=0x7fd8a40032f0 tx=0x7fd8a4007e00).ready entity=mon.1 client_cookie=ef1d7a3134102c92 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:00.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8ab7fe700 1 --2- 172.21.15.63:0/692724098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8ac062150 0x7fd8ac0625e0 secure :-1 s=THROTTLE_DONE pgs=572 cs=0 l=1 rx=0x7fd8a40032f0 tx=0x7fd8a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8a9ffb700 1 -- 172.21.15.63:0/692724098 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a4011db0 con 0x7fd8ac062150 2020-05-18T21:30:00.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8ab7fe700 1 --2- 172.21.15.63:0/692724098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8ac062150 0x7fd8ac0625e0 secure :-1 s=THROTTLE_DONE pgs=572 cs=0 l=1 rx=0x7fd8a40032f0 tx=0x7fd8a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8ab7fe700 1 --2- 172.21.15.63:0/692724098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8ac062150 0x7fd8ac0625e0 secure :-1 s=THROTTLE_DONE pgs=572 cs=0 l=1 rx=0x7fd8a40032f0 tx=0x7fd8a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8a9ffb700 1 -- 172.21.15.63:0/692724098 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a400a180 con 0x7fd8ac062150 2020-05-18T21:30:00.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8a9ffb700 1 -- 172.21.15.63:0/692724098 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a400a5a0 con 0x7fd8ac062150 2020-05-18T21:30:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8abfff700 1 -- 172.21.15.63:0/692724098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8ac062150 msgr2=0x7fd8ac0625e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8abfff700 1 --2- 172.21.15.63:0/692724098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8ac062150 0x7fd8ac0625e0 secure :-1 s=READY pgs=572 cs=0 l=1 rx=0x7fd8a40032f0 tx=0x7fd8a4007e00).stop 2020-05-18T21:30:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8abfff700 1 -- 172.21.15.63:0/692724098 shutdown_connections 2020-05-18T21:30:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8abfff700 1 --2- 172.21.15.63:0/692724098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8ac062150 0x7fd8ac0625e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8abfff700 1 --2- 172.21.15.63:0/692724098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8ac0b6500 0x7fd8ac144200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:00.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8abfff700 1 -- 172.21.15.63:0/692724098 >> 172.21.15.63:0/692724098 conn(0x7fd8ac066d00 msgr2=0x7fd8ac05a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:00.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.113+0000 7fd8abfff700 1 -- 172.21.15.63:0/692724098 shutdown_connections 2020-05-18T21:30:00.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.117+0000 7fd8abfff700 1 -- 172.21.15.63:0/692724098 wait complete. 2020-05-18T21:30:00.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.117+0000 7fd8abfff700 1 Processor -- start 2020-05-18T21:30:00.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.117+0000 7fd8abfff700 1 -- start start 2020-05-18T21:30:00.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8abfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd8ac069f10 0x7fd8ac142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:00.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8abfff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8ac0b13a0 con 0x7fd8ac0b6500 2020-05-18T21:30:00.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8abfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8ac1448b0 con 0x7fd8ac062150 2020-05-18T21:30:00.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8abfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8ac144b50 con 0x7fd8ac069f10 2020-05-18T21:30:00.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8aaffd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd8ac062150 0x7fd8ac13ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:57338/0 (socket says 172.21.15.63:57338) 2020-05-18T21:30:00.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8aaffd700 1 -- 172.21.15.63:0/257391317 learned_addr learned my addr 172.21.15.63:0/257391317 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:00.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8ab7fe700 1 --1- 172.21.15.63:0/257391317 >> v1:172.21.15.63:6789/0 conn(0x7fd8ac0b6500 0x7fd8ac144ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59024/0 (socket says 172.21.15.63:59024) 2020-05-18T21:30:00.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8aa7fc700 1 --2- 172.21.15.63:0/257391317 >> v2:172.21.15.155:3300/0 conn(0x7fd8ac069f10 0x7fd8ac142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:00.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd89bfff700 1 -- 172.21.15.63:0/257391317 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112550595 0 0) 0x7fd8ac1448b0 con 0x7fd8ac062150 2020-05-18T21:30:00.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd89bfff700 1 -- 172.21.15.63:0/257391317 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd888002fe0 con 0x7fd8ac062150 2020-05-18T21:30:00.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd89bfff700 1 -- 172.21.15.63:0/257391317 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705819063 0 0) 0x7fd8ac0b13a0 con 0x7fd8ac0b6500 2020-05-18T21:30:00.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd89bfff700 1 -- 172.21.15.63:0/257391317 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8ac1448b0 con 0x7fd8ac0b6500 2020-05-18T21:30:00.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8aa7fc700 1 -- 172.21.15.63:0/257391317 >> v1:172.21.15.155:6789/0 conn(0x7fd8ac062150 legacy=0x7fd8ac13ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:00.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8aa7fc700 1 -- 172.21.15.63:0/257391317 >> v1:172.21.15.63:6789/0 conn(0x7fd8ac0b6500 legacy=0x7fd8ac144ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:00.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8aa7fc700 1 -- 172.21.15.63:0/257391317 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac13d120 con 0x7fd8ac069f10 2020-05-18T21:30:00.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8aa7fc700 1 --2- 172.21.15.63:0/257391317 >> v2:172.21.15.155:3300/0 conn(0x7fd8ac069f10 0x7fd8ac142890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd8a0002f70 tx=0x7fd8a0010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8aa7fc700 1 --2- 172.21.15.63:0/257391317 >> v2:172.21.15.155:3300/0 conn(0x7fd8ac069f10 0x7fd8ac142890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd8a0002f70 tx=0x7fd8a0010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8aa7fc700 1 --2- 172.21.15.63:0/257391317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8ac069f10 0x7fd8ac142890 secure :-1 s=READY pgs=574 cs=0 l=1 rx=0x7fd8a0002f70 tx=0x7fd8a0010e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:00.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8aa7fc700 1 --2- 172.21.15.63:0/257391317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8ac069f10 0x7fd8ac142890 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7fd8a0002f70 tx=0x7fd8a0010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd89bfff700 1 -- 172.21.15.63:0/257391317 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a000c980 con 0x7fd8ac069f10 2020-05-18T21:30:00.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8aa7fc700 1 --2- 172.21.15.63:0/257391317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8ac069f10 0x7fd8ac142890 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7fd8a0002f70 tx=0x7fd8a0010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8aa7fc700 1 --2- 172.21.15.63:0/257391317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8ac069f10 0x7fd8ac142890 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7fd8a0002f70 tx=0x7fd8a0010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd89bfff700 1 -- 172.21.15.63:0/257391317 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a000cae0 con 0x7fd8ac069f10 2020-05-18T21:30:00.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8abfff700 1 -- 172.21.15.63:0/257391317 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8ac0b0d00 con 0x7fd8ac069f10 2020-05-18T21:30:00.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd89bfff700 1 -- 172.21.15.63:0/257391317 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a000e580 con 0x7fd8ac069f10 2020-05-18T21:30:00.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8abfff700 1 -- 172.21.15.63:0/257391317 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8ac1410b0 con 0x7fd8ac069f10 2020-05-18T21:30:00.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.121+0000 7fd8aa7fc700 1 --2- 172.21.15.63:0/257391317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8ac069f10 0x7fd8ac142890 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7fd8a0002f70 tx=0x7fd8a0010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.125+0000 7fd8abfff700 1 -- 172.21.15.63:0/257391317 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8ac141560 con 0x7fd8ac069f10 2020-05-18T21:30:00.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.125+0000 7fd8aa7fc700 1 --2- 172.21.15.63:0/257391317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8ac069f10 0x7fd8ac142890 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7fd8a0002f70 tx=0x7fd8a0010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.125+0000 7fd89bfff700 1 -- 172.21.15.63:0/257391317 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd8a00101a0 con 0x7fd8ac069f10 2020-05-18T21:30:00.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.125+0000 7fd89bfff700 1 --2- 172.21.15.63:0/257391317 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd88804fed0 0x7fd888052390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:00.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.125+0000 7fd89bfff700 1 -- 172.21.15.63:0/257391317 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fd8a00640f0 con 0x7fd8ac069f10 2020-05-18T21:30:00.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.125+0000 7fd8aaffd700 1 --2- 172.21.15.63:0/257391317 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd88804fed0 0x7fd888052390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:00.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.125+0000 7fd8aaffd700 1 --2- 172.21.15.63:0/257391317 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd88804fed0 0x7fd888052390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd89c001150 tx=0x7fd89c001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.125+0000 7fd8aaffd700 1 --2- 172.21.15.63:0/257391317 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd88804fed0 0x7fd888052390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd89c001150 tx=0x7fd89c001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.125+0000 7fd8aaffd700 1 --2- 172.21.15.63:0/257391317 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd88804fed0 0x7fd888052390 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7fd89c001150 tx=0x7fd89c001700).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:00.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.133+0000 7fd8aa7fc700 1 --2- 172.21.15.63:0/257391317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8ac069f10 0x7fd8ac142890 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7fd8a0002f70 tx=0x7fd8a0010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.133+0000 7fd89bfff700 1 -- 172.21.15.63:0/257391317 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd8a003e440 con 0x7fd8ac069f10 2020-05-18T21:30:00.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.285+0000 7fd8abfff700 1 -- 172.21.15.63:0/257391317 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8ac0b11b0 con 0x7fd8ac069f10 2020-05-18T21:30:00.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.285+0000 7fd8aa7fc700 1 --2- 172.21.15.63:0/257391317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8ac069f10 0x7fd8ac142890 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7fd8a0002f70 tx=0x7fd8a0010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.285+0000 7fd89bfff700 1 -- 172.21.15.63:0/257391317 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+1779 (secure 0 0 0) 0x7fd8a0041a60 con 0x7fd8ac069f10 2020-05-18T21:30:00.292 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:00.292 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/3895568247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3895568247},{"type":"v1","addr":"172.21.15.63:6833","nonce":3895568247}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":35,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:29:10.174981+0000","modified":"2020-05-18T21:29:59.967434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":64,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-05-18T21:30:00.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.289+0000 7fd8abfff700 1 -- 172.21.15.63:0/257391317 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd88804fed0 msgr2=0x7fd888052390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:00.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.289+0000 7fd8abfff700 1 --2- 172.21.15.63:0/257391317 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd88804fed0 0x7fd888052390 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7fd89c001150 tx=0x7fd89c001700).stop 2020-05-18T21:30:00.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.289+0000 7fd8abfff700 1 -- 172.21.15.63:0/257391317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8ac069f10 msgr2=0x7fd8ac142890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:00.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.289+0000 7fd8abfff700 1 --2- 172.21.15.63:0/257391317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8ac069f10 0x7fd8ac142890 secure :-1 s=READY pgs=574 cs=0 l=1 rx=0x7fd8a0002f70 tx=0x7fd8a0010e20).stop 2020-05-18T21:30:00.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.289+0000 7fd8abfff700 1 -- 172.21.15.63:0/257391317 shutdown_connections 2020-05-18T21:30:00.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.289+0000 7fd8abfff700 1 --2- 172.21.15.63:0/257391317 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd88804fed0 0x7fd888052390 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:00.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.289+0000 7fd8abfff700 1 --2- 172.21.15.63:0/257391317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8ac069f10 0x7fd8ac142890 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:00.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.289+0000 7fd8abfff700 1 -- 172.21.15.63:0/257391317 >> 172.21.15.63:0/257391317 conn(0x7fd8ac066d00 msgr2=0x7fd8ac13eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:00.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.289+0000 7fd8abfff700 1 -- 172.21.15.63:0/257391317 shutdown_connections 2020-05-18T21:30:00.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.289+0000 7fd8abfff700 1 -- 172.21.15.63:0/257391317 wait complete. 2020-05-18T21:30:00.296 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 35 2020-05-18T21:30:00.305 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-05-18T21:30:00.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.409+0000 7f71c48eb700 1 Processor -- start 2020-05-18T21:30:00.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.409+0000 7f71c48eb700 1 -- start start 2020-05-18T21:30:00.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.409+0000 7f71c48eb700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f71c00610b0 0x7f71c00b7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:00.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.409+0000 7f71c48eb700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f71c0145da0 0x7f71c01461f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:00.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.409+0000 7f71c48eb700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c0060430 con 0x7f71c00b93f0 2020-05-18T21:30:00.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.409+0000 7f71c48eb700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c00606d0 con 0x7f71c00610b0 2020-05-18T21:30:00.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.409+0000 7f71c48eb700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c0060970 con 0x7f71c0145da0 2020-05-18T21:30:00.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.409+0000 7f71be59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f71c00610b0 0x7f71c00b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:00.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71be59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f71c00610b0 0x7f71c00b7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56844/0 (socket says 172.21.15.63:56844) 2020-05-18T21:30:00.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71be59c700 1 -- 172.21.15.63:0/3309272676 learned_addr learned my addr 172.21.15.63:0/3309272676 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:00.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71bf59e700 1 --2- 172.21.15.63:0/3309272676 >> v2:172.21.15.155:3300/0 conn(0x7f71c0145da0 0x7f71c01461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:00.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71be59c700 1 -- 172.21.15.63:0/3309272676 >> v2:172.21.15.155:3300/0 conn(0x7f71c0145da0 msgr2=0x7f71c01461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:00.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71be59c700 1 --2- 172.21.15.63:0/3309272676 >> v2:172.21.15.155:3300/0 conn(0x7f71c0145da0 0x7f71c01461f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:00.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71be59c700 1 -- 172.21.15.63:0/3309272676 >> v1:172.21.15.155:6789/0 conn(0x7f71c00b93f0 legacy=0x7f71c00b7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:00.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71be59c700 1 -- 172.21.15.63:0/3309272676 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c0060c10 con 0x7f71c00610b0 2020-05-18T21:30:00.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71be59c700 1 --2- 172.21.15.63:0/3309272676 >> v2:172.21.15.63:3300/0 conn(0x7f71c00610b0 0x7f71c00b7730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f71b0002f70 tx=0x7f71b0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71be59c700 1 --2- 172.21.15.63:0/3309272676 >> v2:172.21.15.63:3300/0 conn(0x7f71c00610b0 0x7f71c00b7730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f71b0002f70 tx=0x7f71b0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71be59c700 1 --2- 172.21.15.63:0/3309272676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71c00610b0 0x7f71c00b7730 secure :-1 s=READY pgs=802 cs=0 l=1 rx=0x7f71b0002f70 tx=0x7f71b0007a80).ready entity=mon.0 client_cookie=f443166defe2927c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:00.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71be59c700 1 --2- 172.21.15.63:0/3309272676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71c00610b0 0x7f71c00b7730 secure :-1 s=THROTTLE_DONE pgs=802 cs=0 l=1 rx=0x7f71b0002f70 tx=0x7f71b0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71be59c700 1 --2- 172.21.15.63:0/3309272676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71c00610b0 0x7f71c00b7730 secure :-1 s=THROTTLE_DONE pgs=802 cs=0 l=1 rx=0x7f71b0002f70 tx=0x7f71b0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71bdd9b700 1 -- 172.21.15.63:0/3309272676 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71b0011760 con 0x7f71c00610b0 2020-05-18T21:30:00.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71be59c700 1 --2- 172.21.15.63:0/3309272676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71c00610b0 0x7f71c00b7730 secure :-1 s=THROTTLE_DONE pgs=802 cs=0 l=1 rx=0x7f71b0002f70 tx=0x7f71b0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71bdd9b700 1 -- 172.21.15.63:0/3309272676 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b00118c0 con 0x7f71c00610b0 2020-05-18T21:30:00.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71bdd9b700 1 -- 172.21.15.63:0/3309272676 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71b0011ce0 con 0x7f71c00610b0 2020-05-18T21:30:00.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71c48eb700 1 -- 172.21.15.63:0/3309272676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71c00610b0 msgr2=0x7f71c00b7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:00.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71c48eb700 1 --2- 172.21.15.63:0/3309272676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71c00610b0 0x7f71c00b7730 secure :-1 s=READY pgs=802 cs=0 l=1 rx=0x7f71b0002f70 tx=0x7f71b0007a80).stop 2020-05-18T21:30:00.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71c48eb700 1 -- 172.21.15.63:0/3309272676 shutdown_connections 2020-05-18T21:30:00.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71c48eb700 1 --2- 172.21.15.63:0/3309272676 >> v2:172.21.15.155:3300/0 conn(0x7f71c0145da0 0x7f71c01461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:00.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71c48eb700 1 --2- 172.21.15.63:0/3309272676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71c00610b0 0x7f71c00b7730 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:00.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71c48eb700 1 -- 172.21.15.63:0/3309272676 >> 172.21.15.63:0/3309272676 conn(0x7f71c0069b70 msgr2=0x7f71c0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:00.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71c48eb700 1 -- 172.21.15.63:0/3309272676 shutdown_connections 2020-05-18T21:30:00.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.413+0000 7f71c48eb700 1 -- 172.21.15.63:0/3309272676 wait complete. 2020-05-18T21:30:00.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.417+0000 7f71c48eb700 1 Processor -- start 2020-05-18T21:30:00.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.417+0000 7f71c48eb700 1 -- start start 2020-05-18T21:30:00.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.417+0000 7f71c48eb700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f71c00610b0 0x7f71c0149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:00.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.417+0000 7f71c48eb700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c01572b0 con 0x7f71c00b93f0 2020-05-18T21:30:00.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.417+0000 7f71c48eb700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c01424f0 con 0x7f71c0145da0 2020-05-18T21:30:00.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.417+0000 7f71c48eb700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c0145080 con 0x7f71c00610b0 2020-05-18T21:30:00.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.417+0000 7f71be59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f71c00b93f0 0x7f71c0141110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59038/0 (socket says 172.21.15.63:59038) 2020-05-18T21:30:00.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.417+0000 7f71be59c700 1 -- 172.21.15.63:0/1101521548 learned_addr learned my addr 172.21.15.63:0/1101521548 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:00.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.417+0000 7f71bed9d700 1 --2- 172.21.15.63:0/1101521548 >> v2:172.21.15.155:3300/0 conn(0x7f71c00610b0 0x7f71c0149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:00.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.417+0000 7f71b7fff700 1 -- 172.21.15.63:0/1101521548 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875618508 0 0) 0x7f71c01572b0 con 0x7f71c00b93f0 2020-05-18T21:30:00.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.417+0000 7f71b7fff700 1 -- 172.21.15.63:0/1101521548 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71a4002fe0 con 0x7f71c00b93f0 2020-05-18T21:30:00.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.417+0000 7f71b7fff700 1 -- 172.21.15.63:0/1101521548 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2740175057 0 0) 0x7f71a4002fe0 con 0x7f71c00b93f0 2020-05-18T21:30:00.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.417+0000 7f71bed9d700 1 -- 172.21.15.63:0/1101521548 >> v1:172.21.15.155:6789/0 conn(0x7f71c0145da0 legacy=0x7f71c0147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:00.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.417+0000 7f71bed9d700 1 -- 172.21.15.63:0/1101521548 >> v1:172.21.15.63:6789/0 conn(0x7f71c00b93f0 legacy=0x7f71c0141110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:00.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.417+0000 7f71bed9d700 1 -- 172.21.15.63:0/1101521548 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c0144de0 con 0x7f71c00610b0 2020-05-18T21:30:00.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.417+0000 7f71bed9d700 1 --2- 172.21.15.63:0/1101521548 >> v2:172.21.15.155:3300/0 conn(0x7f71c00610b0 0x7f71c0149520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f71b00087c0 tx=0x7f71a80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.417+0000 7f71bed9d700 1 --2- 172.21.15.63:0/1101521548 >> v2:172.21.15.155:3300/0 conn(0x7f71c00610b0 0x7f71c0149520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f71b00087c0 tx=0x7f71a80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.417+0000 7f71bed9d700 1 --2- 172.21.15.63:0/1101521548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71c00610b0 0x7f71c0149520 secure :-1 s=READY pgs=577 cs=0 l=1 rx=0x7f71b00087c0 tx=0x7f71a80108c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:00.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.421+0000 7f71bed9d700 1 --2- 172.21.15.63:0/1101521548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71c00610b0 0x7f71c0149520 secure :-1 s=THROTTLE_DONE pgs=577 cs=0 l=1 rx=0x7f71b00087c0 tx=0x7f71a80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.421+0000 7f71b7fff700 1 -- 172.21.15.63:0/1101521548 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71b0008620 con 0x7f71c00610b0 2020-05-18T21:30:00.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.421+0000 7f71bed9d700 1 --2- 172.21.15.63:0/1101521548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71c00610b0 0x7f71c0149520 secure :-1 s=THROTTLE_DONE pgs=577 cs=0 l=1 rx=0x7f71b00087c0 tx=0x7f71a80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.421+0000 7f71bed9d700 1 --2- 172.21.15.63:0/1101521548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71c00610b0 0x7f71c0149520 secure :-1 s=THROTTLE_DONE pgs=577 cs=0 l=1 rx=0x7f71b00087c0 tx=0x7f71a80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.421+0000 7f71c48eb700 1 -- 172.21.15.63:0/1101521548 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c0147a80 con 0x7f71c00610b0 2020-05-18T21:30:00.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.421+0000 7f71b7fff700 1 -- 172.21.15.63:0/1101521548 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a8006b00 con 0x7f71c00610b0 2020-05-18T21:30:00.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.421+0000 7f71b7fff700 1 -- 172.21.15.63:0/1101521548 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71a8006ea0 con 0x7f71c00610b0 2020-05-18T21:30:00.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.421+0000 7f71c48eb700 1 -- 172.21.15.63:0/1101521548 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c0141f80 con 0x7f71c00610b0 2020-05-18T21:30:00.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.421+0000 7f71c48eb700 1 -- 172.21.15.63:0/1101521548 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c01570f0 con 0x7f71c00610b0 2020-05-18T21:30:00.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.421+0000 7f71bed9d700 1 --2- 172.21.15.63:0/1101521548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71c00610b0 0x7f71c0149520 secure :-1 s=THROTTLE_DONE pgs=577 cs=0 l=1 rx=0x7f71b00087c0 tx=0x7f71a80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.421+0000 7f71b7fff700 1 -- 172.21.15.63:0/1101521548 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f71a800a2b0 con 0x7f71c00610b0 2020-05-18T21:30:00.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.421+0000 7f71bed9d700 1 --2- 172.21.15.63:0/1101521548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71c00610b0 0x7f71c0149520 secure :-1 s=THROTTLE_DONE pgs=577 cs=0 l=1 rx=0x7f71b00087c0 tx=0x7f71a80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.421+0000 7f71b7fff700 1 --2- 172.21.15.63:0/1101521548 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71a404fd20 0x7f71a40521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:00.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.421+0000 7f71b7fff700 1 -- 172.21.15.63:0/1101521548 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f71a80637b0 con 0x7f71c00610b0 2020-05-18T21:30:00.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.421+0000 7f71be59c700 1 --2- 172.21.15.63:0/1101521548 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71a404fd20 0x7f71a40521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:00.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.425+0000 7f71be59c700 1 --2- 172.21.15.63:0/1101521548 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71a404fd20 0x7f71a40521e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f71b0008890 tx=0x7f71b0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.425+0000 7f71be59c700 1 --2- 172.21.15.63:0/1101521548 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71a404fd20 0x7f71a40521e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f71b0008890 tx=0x7f71b0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.425+0000 7f71be59c700 1 --2- 172.21.15.63:0/1101521548 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71a404fd20 0x7f71a40521e0 secure :-1 s=READY pgs=324 cs=0 l=1 rx=0x7f71b0008890 tx=0x7f71b0007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:00.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.429+0000 7f71bed9d700 1 --2- 172.21.15.63:0/1101521548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71c00610b0 0x7f71c0149520 secure :-1 s=THROTTLE_DONE pgs=577 cs=0 l=1 rx=0x7f71b00087c0 tx=0x7f71a80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.429+0000 7f71b7fff700 1 -- 172.21.15.63:0/1101521548 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f71a803dae0 con 0x7f71c00610b0 2020-05-18T21:30:00.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.581+0000 7f71c48eb700 1 -- 172.21.15.63:0/1101521548 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f71c00569e0 con 0x7f71c00610b0 2020-05-18T21:30:00.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.981+0000 7f71bed9d700 1 --2- 172.21.15.63:0/1101521548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71c00610b0 0x7f71c0149520 secure :-1 s=THROTTLE_DONE pgs=577 cs=0 l=1 rx=0x7f71b00087c0 tx=0x7f71a80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:00.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.981+0000 7f71b7fff700 1 -- 172.21.15.63:0/1101521548 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) v1 ==== 104+0+0 (secure 0 0 0) 0x7f71a8041100 con 0x7f71c00610b0 2020-05-18T21:30:00.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.985+0000 7f71c48eb700 1 -- 172.21.15.63:0/1101521548 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71a404fd20 msgr2=0x7f71a40521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:00.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.985+0000 7f71c48eb700 1 --2- 172.21.15.63:0/1101521548 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71a404fd20 0x7f71a40521e0 secure :-1 s=READY pgs=324 cs=0 l=1 rx=0x7f71b0008890 tx=0x7f71b0007a80).stop 2020-05-18T21:30:00.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.985+0000 7f71c48eb700 1 -- 172.21.15.63:0/1101521548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71c00610b0 msgr2=0x7f71c0149520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:00.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.985+0000 7f71c48eb700 1 --2- 172.21.15.63:0/1101521548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71c00610b0 0x7f71c0149520 secure :-1 s=READY pgs=577 cs=0 l=1 rx=0x7f71b00087c0 tx=0x7f71a80108c0).stop 2020-05-18T21:30:00.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.985+0000 7f71c48eb700 1 -- 172.21.15.63:0/1101521548 shutdown_connections 2020-05-18T21:30:00.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.985+0000 7f71c48eb700 1 --2- 172.21.15.63:0/1101521548 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71a404fd20 0x7f71a40521e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:00.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.985+0000 7f71c48eb700 1 --2- 172.21.15.63:0/1101521548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71c00610b0 0x7f71c0149520 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:00.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.985+0000 7f71c48eb700 1 -- 172.21.15.63:0/1101521548 >> 172.21.15.63:0/1101521548 conn(0x7f71c0069b70 msgr2=0x7f71c0145520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:00.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.985+0000 7f71c48eb700 1 -- 172.21.15.63:0/1101521548 shutdown_connections 2020-05-18T21:30:00.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:00.985+0000 7f71c48eb700 1 -- 172.21.15.63:0/1101521548 wait complete. 2020-05-18T21:30:01.006 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-05-18T21:30:01.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f3251344700 1 Processor -- start 2020-05-18T21:30:01.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f3251344700 1 -- start start 2020-05-18T21:30:01.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f3251344700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f324c0b54f0 0x7f324c0adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:01.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f3251344700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f324c0b0260 0x7f324c0b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:01.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f3251344700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324c0adf60 con 0x7f324c143a70 2020-05-18T21:30:01.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f3251344700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324c0b4db0 con 0x7f324c0b54f0 2020-05-18T21:30:01.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f3251344700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324c0b5050 con 0x7f324c0b0260 2020-05-18T21:30:01.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f324b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f324c0b54f0 0x7f324c0adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:01.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f324bfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f324c143a70 0x7f324c0ad3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59044/0 (socket says 172.21.15.63:59044) 2020-05-18T21:30:01.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f324bfff700 1 -- 172.21.15.63:0/1745174914 learned_addr learned my addr 172.21.15.63:0/1745174914 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:01.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f3250b43700 1 --2- 172.21.15.63:0/1745174914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f324c0b0260 0x7f324c0b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:01.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f324b7fe700 1 -- 172.21.15.63:0/1745174914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f324c0b0260 msgr2=0x7f324c0b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:01.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f324b7fe700 1 --2- 172.21.15.63:0/1745174914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f324c0b0260 0x7f324c0b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:01.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f324b7fe700 1 -- 172.21.15.63:0/1745174914 >> v1:172.21.15.63:6789/0 conn(0x7f324c143a70 legacy=0x7f324c0ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:01.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f324affd700 1 -- 172.21.15.63:0/1745174914 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682714147 0 0) 0x7f324c0adf60 con 0x7f324c143a70 2020-05-18T21:30:01.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f324b7fe700 1 -- 172.21.15.63:0/1745174914 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c0ae400 con 0x7f324c0b54f0 2020-05-18T21:30:01.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f3250b43700 1 --2- 172.21.15.63:0/1745174914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f324c0b0260 0x7f324c0b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:30:01.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f324b7fe700 1 --2- 172.21.15.63:0/1745174914 >> v2:172.21.15.63:3300/0 conn(0x7f324c0b54f0 0x7f324c0adb00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3234002f70 tx=0x7f3234007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:01.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f324b7fe700 1 --2- 172.21.15.63:0/1745174914 >> v2:172.21.15.63:3300/0 conn(0x7f324c0b54f0 0x7f324c0adb00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3234002f70 tx=0x7f3234007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:01.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f324b7fe700 1 --2- 172.21.15.63:0/1745174914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f324c0b54f0 0x7f324c0adb00 secure :-1 s=READY pgs=805 cs=0 l=1 rx=0x7f3234002f70 tx=0x7f3234007a80).ready entity=mon.0 client_cookie=25f9bb8045235d40 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:01.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f324b7fe700 1 --2- 172.21.15.63:0/1745174914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f324c0b54f0 0x7f324c0adb00 secure :-1 s=THROTTLE_DONE pgs=805 cs=0 l=1 rx=0x7f3234002f70 tx=0x7f3234007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:01.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f324affd700 1 -- 172.21.15.63:0/1745174914 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3234008e50 con 0x7f324c0b54f0 2020-05-18T21:30:01.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f324b7fe700 1 --2- 172.21.15.63:0/1745174914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f324c0b54f0 0x7f324c0adb00 secure :-1 s=THROTTLE_DONE pgs=805 cs=0 l=1 rx=0x7f3234002f70 tx=0x7f3234007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:01.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f324affd700 1 -- 172.21.15.63:0/1745174914 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32340116a0 con 0x7f324c0b54f0 2020-05-18T21:30:01.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f324b7fe700 1 --2- 172.21.15.63:0/1745174914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f324c0b54f0 0x7f324c0adb00 secure :-1 s=THROTTLE_DONE pgs=805 cs=0 l=1 rx=0x7f3234002f70 tx=0x7f3234007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:01.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f3251344700 1 -- 172.21.15.63:0/1745174914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f324c0b54f0 msgr2=0x7f324c0adb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:01.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f324affd700 1 -- 172.21.15.63:0/1745174914 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3234011a00 con 0x7f324c0b54f0 2020-05-18T21:30:01.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.117+0000 7f3251344700 1 --2- 172.21.15.63:0/1745174914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f324c0b54f0 0x7f324c0adb00 secure :-1 s=READY pgs=805 cs=0 l=1 rx=0x7f3234002f70 tx=0x7f3234007a80).stop 2020-05-18T21:30:01.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.121+0000 7f3251344700 1 -- 172.21.15.63:0/1745174914 shutdown_connections 2020-05-18T21:30:01.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.121+0000 7f3251344700 1 --2- 172.21.15.63:0/1745174914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f324c0b0260 0x7f324c0b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:01.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.121+0000 7f3251344700 1 --2- 172.21.15.63:0/1745174914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f324c0b54f0 0x7f324c0adb00 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:01.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.121+0000 7f3251344700 1 -- 172.21.15.63:0/1745174914 >> 172.21.15.63:0/1745174914 conn(0x7f324c05fb90 msgr2=0x7f324c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:01.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.121+0000 7f3251344700 1 -- 172.21.15.63:0/1745174914 shutdown_connections 2020-05-18T21:30:01.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.121+0000 7f3251344700 1 -- 172.21.15.63:0/1745174914 wait complete. 2020-05-18T21:30:01.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.121+0000 7f3251344700 1 Processor -- start 2020-05-18T21:30:01.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.121+0000 7f3251344700 1 -- start start 2020-05-18T21:30:01.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f3251344700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f324c0b0260 0x7f324c1473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:01.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f3251344700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324c138d80 con 0x7f324c0b54f0 2020-05-18T21:30:01.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f3251344700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324c1478c0 con 0x7f324c143a70 2020-05-18T21:30:01.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f324b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f324c0b54f0 0x7f324c064b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59050/0 (socket says 172.21.15.63:59050) 2020-05-18T21:30:01.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f324b7fe700 1 -- 172.21.15.63:0/1291034728 learned_addr learned my addr 172.21.15.63:0/1291034728 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:01.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f3251344700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324c139310 con 0x7f324c0b0260 2020-05-18T21:30:01.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421899393 0 0) 0x7f324c138d80 con 0x7f324c0b54f0 2020-05-18T21:30:01.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f324bfff700 1 --2- 172.21.15.63:0/1291034728 >> v2:172.21.15.155:3300/0 conn(0x7f324c0b0260 0x7f324c1473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:01.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3230002fe0 con 0x7f324c0b54f0 2020-05-18T21:30:01.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467852290 0 0) 0x7f324c1478c0 con 0x7f324c143a70 2020-05-18T21:30:01.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f324c138d80 con 0x7f324c143a70 2020-05-18T21:30:01.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3843012592 0 0) 0x7f3230002fe0 con 0x7f324c0b54f0 2020-05-18T21:30:01.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f324c1478c0 con 0x7f324c0b54f0 2020-05-18T21:30:01.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f3234008e50 con 0x7f324c0b54f0 2020-05-18T21:30:01.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 >> v2:172.21.15.155:3300/0 conn(0x7f324c0b0260 msgr2=0x7f324c1473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:01.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 --2- 172.21.15.63:0/1291034728 >> v2:172.21.15.155:3300/0 conn(0x7f324c0b0260 0x7f324c1473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:01.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 >> v1:172.21.15.155:6789/0 conn(0x7f324c143a70 legacy=0x7f324c0615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:01.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 >> v1:172.21.15.63:6789/0 conn(0x7f324c0b54f0 legacy=0x7f324c064b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:01.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3230004bf0 0x7f3230004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:01.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3230003b30 0x7f3230003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:01.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3230004410 0x7f323000b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:01.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c139310 con 0x7f3230004bf0 2020-05-18T21:30:01.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323000bbc0 con 0x7f3230004410 2020-05-18T21:30:01.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323000bd00 con 0x7f3230003b30 2020-05-18T21:30:01.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f324bfff700 1 --2- 172.21.15.63:0/1291034728 >> v2:172.21.15.155:3300/0 conn(0x7f324c0b0260 0x7f324c1473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:30:01.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f324bfff700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3230004bf0 0x7f3230004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:01.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f324b7fe700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3230003b30 0x7f3230003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:01.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f3250b43700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3230004410 0x7f323000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:01.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f324bfff700 1 -- 172.21.15.63:0/1291034728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3230003b30 msgr2=0x7f3230003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:01.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f324bfff700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3230003b30 0x7f3230003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:01.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f324bfff700 1 -- 172.21.15.63:0/1291034728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3230004410 msgr2=0x7f323000b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:01.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f324bfff700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3230004410 0x7f323000b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:01.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f324bfff700 1 -- 172.21.15.63:0/1291034728 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c1397b0 con 0x7f3230004bf0 2020-05-18T21:30:01.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f3251344700 1 -- 172.21.15.63:0/1291034728 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f324c1388d0 con 0x7f3230004bf0 2020-05-18T21:30:01.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f324bfff700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3230004bf0 0x7f3230004ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f323c000bc0 tx=0x7f323c0110a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:01.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f3250b43700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3230004410 0x7f323000b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:30:01.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f3250b43700 1 -- 172.21.15.63:0/1291034728 reap_dead start 2020-05-18T21:30:01.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f324b7fe700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3230003b30 0x7f3230003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:30:01.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f3251344700 1 -- 172.21.15.63:0/1291034728 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f324c1473b0 con 0x7f3230004bf0 2020-05-18T21:30:01.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f324bfff700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3230004bf0 0x7f3230004ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f323c000bc0 tx=0x7f323c0110a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:01.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f324bfff700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3230004bf0 0x7f3230004ff0 secure :-1 s=READY pgs=807 cs=0 l=1 rx=0x7f323c000bc0 tx=0x7f323c0110a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:01.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f324bfff700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3230004bf0 0x7f3230004ff0 secure :-1 s=THROTTLE_DONE pgs=807 cs=0 l=1 rx=0x7f323c000bc0 tx=0x7f323c0110a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:01.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f324bfff700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3230004bf0 0x7f3230004ff0 secure :-1 s=THROTTLE_DONE pgs=807 cs=0 l=1 rx=0x7f323c000bc0 tx=0x7f323c0110a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:01.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f323c0100c0 con 0x7f3230004bf0 2020-05-18T21:30:01.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f324bfff700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3230004bf0 0x7f3230004ff0 secure :-1 s=THROTTLE_DONE pgs=807 cs=0 l=1 rx=0x7f323c000bc0 tx=0x7f323c0110a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:01.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323c010220 con 0x7f3230004bf0 2020-05-18T21:30:01.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.125+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f323c010580 con 0x7f3230004bf0 2020-05-18T21:30:01.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.129+0000 7f324bfff700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3230004bf0 0x7f3230004ff0 secure :-1 s=THROTTLE_DONE pgs=807 cs=0 l=1 rx=0x7f323c000bc0 tx=0x7f323c0110a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:01.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.129+0000 7f3251344700 1 -- 172.21.15.63:0/1291034728 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3224003380 con 0x7f3230004bf0 2020-05-18T21:30:01.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.129+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f323c012740 con 0x7f3230004bf0 2020-05-18T21:30:01.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.129+0000 7f324bfff700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3230004bf0 0x7f3230004ff0 secure :-1 s=THROTTLE_DONE pgs=807 cs=0 l=1 rx=0x7f323c000bc0 tx=0x7f323c0110a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:01.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.129+0000 7f32497fa700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3230053a90 0x7f3230055f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:01.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.129+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f323c063780 con 0x7f3230004bf0 2020-05-18T21:30:01.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.129+0000 7f324b7fe700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3230053a90 0x7f3230055f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:01.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.129+0000 7f324b7fe700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3230053a90 0x7f3230055f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3234010240 tx=0x7f3234007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:01.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.129+0000 7f324b7fe700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3230053a90 0x7f3230055f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3234010240 tx=0x7f3234007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:01.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.129+0000 7f324b7fe700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3230053a90 0x7f3230055f50 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7f3234010240 tx=0x7f3234007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:01.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.133+0000 7f324bfff700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3230004bf0 0x7f3230004ff0 secure :-1 s=THROTTLE_DONE pgs=807 cs=0 l=1 rx=0x7f323c000bc0 tx=0x7f323c0110a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:01.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.133+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f323c03db10 con 0x7f3230004bf0 2020-05-18T21:30:01.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.249+0000 7f3251344700 1 -- 172.21.15.63:0/1291034728 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f32240022c0 con 0x7f3230004bf0 2020-05-18T21:30:02.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.997+0000 7f324bfff700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3230004bf0 0x7f3230004ff0 secure :-1 s=THROTTLE_DONE pgs=807 cs=0 l=1 rx=0x7f323c000bc0 tx=0x7f323c0110a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:02.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:01.997+0000 7f32497fa700 1 -- 172.21.15.63:0/1291034728 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v65) v1 ==== 185+0+0 (secure 0 0 0) 0x7f323c041130 con 0x7f3230004bf0 2020-05-18T21:30:02.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.005+0000 7f3251344700 1 -- 172.21.15.63:0/1291034728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3230053a90 msgr2=0x7f3230055f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:02.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.005+0000 7f3251344700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3230053a90 0x7f3230055f50 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7f3234010240 tx=0x7f3234007a80).stop 2020-05-18T21:30:02.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.005+0000 7f3251344700 1 -- 172.21.15.63:0/1291034728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3230004bf0 msgr2=0x7f3230004ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:02.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.005+0000 7f3251344700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3230004bf0 0x7f3230004ff0 secure :-1 s=READY pgs=807 cs=0 l=1 rx=0x7f323c000bc0 tx=0x7f323c0110a0).stop 2020-05-18T21:30:02.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.009+0000 7f3251344700 1 -- 172.21.15.63:0/1291034728 shutdown_connections 2020-05-18T21:30:02.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.009+0000 7f3251344700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3230053a90 0x7f3230055f50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:02.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.009+0000 7f3251344700 1 --2- 172.21.15.63:0/1291034728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3230004bf0 0x7f3230004ff0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.009+0000 7f3251344700 1 -- 172.21.15.63:0/1291034728 >> 172.21.15.63:0/1291034728 conn(0x7f324c05fb90 msgr2=0x7f324c0b6100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.009+0000 7f3251344700 1 -- 172.21.15.63:0/1291034728 shutdown_connections 2020-05-18T21:30:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.009+0000 7f3251344700 1 -- 172.21.15.63:0/1291034728 wait complete. 2020-05-18T21:30:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2020-05-18T21:30:02.027 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-05-18T21:30:02.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.129+0000 7f63ba8c3700 1 Processor -- start 2020-05-18T21:30:02.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.129+0000 7f63ba8c3700 1 -- start start 2020-05-18T21:30:02.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63ba8c3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f63b4143630 0x7f63b4060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:02.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63ba8c3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b4145e30 0x7f63b412e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:02.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63ba8c3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b4146420 con 0x7f63b40bc8d0 2020-05-18T21:30:02.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63ba8c3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b4146e00 con 0x7f63b4143630 2020-05-18T21:30:02.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63ba8c3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b41466c0 con 0x7f63b4145e30 2020-05-18T21:30:02.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63b98c1700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f63b40bc8d0 0x7f63b4142f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59064/0 (socket says 172.21.15.63:59064) 2020-05-18T21:30:02.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63b98c1700 1 -- 172.21.15.63:0/2416066747 learned_addr learned my addr 172.21.15.63:0/2416066747 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:02.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63b90c0700 1 --2- 172.21.15.63:0/2416066747 >> v2:172.21.15.155:3300/0 conn(0x7f63b4143630 0x7f63b4060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:02.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63ba0c2700 1 --2- 172.21.15.63:0/2416066747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b4145e30 0x7f63b412e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:02.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63b88bf700 1 -- 172.21.15.63:0/2416066747 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183339203 0 0) 0x7f63b4146420 con 0x7f63b40bc8d0 2020-05-18T21:30:02.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63b88bf700 1 -- 172.21.15.63:0/2416066747 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f639c003270 con 0x7f63b40bc8d0 2020-05-18T21:30:02.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63b88bf700 1 -- 172.21.15.63:0/2416066747 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2871541300 0 0) 0x7f639c003270 con 0x7f63b40bc8d0 2020-05-18T21:30:02.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63b90c0700 1 -- 172.21.15.63:0/2416066747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b4145e30 msgr2=0x7f63b412e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:02.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63b90c0700 1 --2- 172.21.15.63:0/2416066747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b4145e30 0x7f63b412e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:02.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63b90c0700 1 -- 172.21.15.63:0/2416066747 >> v1:172.21.15.63:6789/0 conn(0x7f63b40bc8d0 legacy=0x7f63b4142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:02.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63b90c0700 1 -- 172.21.15.63:0/2416066747 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b4146960 con 0x7f63b4143630 2020-05-18T21:30:02.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63b90c0700 1 --2- 172.21.15.63:0/2416066747 >> v2:172.21.15.155:3300/0 conn(0x7f63b4143630 0x7f63b4060b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f63b0002f70 tx=0x7f63b4061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:02.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63b90c0700 1 --2- 172.21.15.63:0/2416066747 >> v2:172.21.15.155:3300/0 conn(0x7f63b4143630 0x7f63b4060b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f63b0002f70 tx=0x7f63b4061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:02.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63b90c0700 1 --2- 172.21.15.63:0/2416066747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63b4143630 0x7f63b4060b00 secure :-1 s=READY pgs=579 cs=0 l=1 rx=0x7f63b0002f70 tx=0x7f63b4061d60).ready entity=mon.1 client_cookie=11e16456017f56da server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:02.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63b90c0700 1 --2- 172.21.15.63:0/2416066747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63b4143630 0x7f63b4060b00 secure :-1 s=THROTTLE_DONE pgs=579 cs=0 l=1 rx=0x7f63b0002f70 tx=0x7f63b4061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:02.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63b88bf700 1 -- 172.21.15.63:0/2416066747 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63b0008e80 con 0x7f63b4143630 2020-05-18T21:30:02.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63b90c0700 1 --2- 172.21.15.63:0/2416066747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63b4143630 0x7f63b4060b00 secure :-1 s=THROTTLE_DONE pgs=579 cs=0 l=1 rx=0x7f63b0002f70 tx=0x7f63b4061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:02.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63b88bf700 1 -- 172.21.15.63:0/2416066747 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b0011540 con 0x7f63b4143630 2020-05-18T21:30:02.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63b90c0700 1 --2- 172.21.15.63:0/2416066747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63b4143630 0x7f63b4060b00 secure :-1 s=THROTTLE_DONE pgs=579 cs=0 l=1 rx=0x7f63b0002f70 tx=0x7f63b4061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:02.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63b88bf700 1 -- 172.21.15.63:0/2416066747 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63b00118a0 con 0x7f63b4143630 2020-05-18T21:30:02.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63ba8c3700 1 -- 172.21.15.63:0/2416066747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63b4143630 msgr2=0x7f63b4060b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:02.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63ba8c3700 1 --2- 172.21.15.63:0/2416066747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63b4143630 0x7f63b4060b00 secure :-1 s=READY pgs=579 cs=0 l=1 rx=0x7f63b0002f70 tx=0x7f63b4061d60).stop 2020-05-18T21:30:02.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63ba8c3700 1 -- 172.21.15.63:0/2416066747 shutdown_connections 2020-05-18T21:30:02.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63ba8c3700 1 --2- 172.21.15.63:0/2416066747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b4145e30 0x7f63b412e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:02.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63ba8c3700 1 --2- 172.21.15.63:0/2416066747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63b4143630 0x7f63b4060b00 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:02.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63ba8c3700 1 -- 172.21.15.63:0/2416066747 >> 172.21.15.63:0/2416066747 conn(0x7f63b405f3b0 msgr2=0x7f63b405f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:02.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63ba8c3700 1 -- 172.21.15.63:0/2416066747 shutdown_connections 2020-05-18T21:30:02.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.133+0000 7f63ba8c3700 1 -- 172.21.15.63:0/2416066747 wait complete. 2020-05-18T21:30:02.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63ba8c3700 1 Processor -- start 2020-05-18T21:30:02.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63ba8c3700 1 -- start start 2020-05-18T21:30:02.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63ba8c3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b40bc8d0 0x7f63b40acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:02.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63ba8c3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f63b4143630 0x7f63b4148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:02.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63ba8c3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b4146fe0 con 0x7f63b4145e30 2020-05-18T21:30:02.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63ba8c3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b40b48d0 con 0x7f63b4143630 2020-05-18T21:30:02.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63ba8c3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b40ad300 con 0x7f63b40bc8d0 2020-05-18T21:30:02.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63b90c0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f63b4143630 0x7f63b4148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:02.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63b90c0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f63b4143630 0x7f63b4148170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56884/0 (socket says 172.21.15.63:56884) 2020-05-18T21:30:02.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63b90c0700 1 -- 172.21.15.63:0/1073703795 learned_addr learned my addr 172.21.15.63:0/1073703795 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:02.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63b98c1700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b40bc8d0 0x7f63b40acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:02.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63b90c0700 1 -- 172.21.15.63:0/1073703795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b40bc8d0 msgr2=0x7f63b40acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:02.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63b90c0700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b40bc8d0 0x7f63b40acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:02.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63b90c0700 1 -- 172.21.15.63:0/1073703795 >> v1:172.21.15.155:6789/0 conn(0x7f63b4145e30 legacy=0x7f63b40b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:02.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63b90c0700 1 -- 172.21.15.63:0/1073703795 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b40b5fb0 con 0x7f63b4143630 2020-05-18T21:30:02.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63b90c0700 1 --2- 172.21.15.63:0/1073703795 >> v2:172.21.15.63:3300/0 conn(0x7f63b4143630 0x7f63b4148170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f63b0002f70 tx=0x7f63b4061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:02.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63b90c0700 1 --2- 172.21.15.63:0/1073703795 >> v2:172.21.15.63:3300/0 conn(0x7f63b4143630 0x7f63b4148170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f63b0002f70 tx=0x7f63b4061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:02.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63b90c0700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63b4143630 0x7f63b4148170 secure :-1 s=READY pgs=809 cs=0 l=1 rx=0x7f63b0002f70 tx=0x7f63b4061d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:02.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63b90c0700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63b4143630 0x7f63b4148170 secure :-1 s=THROTTLE_DONE pgs=809 cs=0 l=1 rx=0x7f63b0002f70 tx=0x7f63b4061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:02.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63b90c0700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63b4143630 0x7f63b4148170 secure :-1 s=THROTTLE_DONE pgs=809 cs=0 l=1 rx=0x7f63b0002f70 tx=0x7f63b4061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:02.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63a6ffd700 1 -- 172.21.15.63:0/1073703795 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63b0007170 con 0x7f63b4143630 2020-05-18T21:30:02.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63b90c0700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63b4143630 0x7f63b4148170 secure :-1 s=THROTTLE_DONE pgs=809 cs=0 l=1 rx=0x7f63b0002f70 tx=0x7f63b4061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:02.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63a6ffd700 1 -- 172.21.15.63:0/1073703795 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b00072d0 con 0x7f63b4143630 2020-05-18T21:30:02.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63ba8c3700 1 -- 172.21.15.63:0/1073703795 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b41485d0 con 0x7f63b4143630 2020-05-18T21:30:02.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63a6ffd700 1 -- 172.21.15.63:0/1073703795 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63b0005700 con 0x7f63b4143630 2020-05-18T21:30:02.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.137+0000 7f63ba8c3700 1 -- 172.21.15.63:0/1073703795 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b4153830 con 0x7f63b4143630 2020-05-18T21:30:02.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.141+0000 7f63b90c0700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63b4143630 0x7f63b4148170 secure :-1 s=THROTTLE_DONE pgs=809 cs=0 l=1 rx=0x7f63b0002f70 tx=0x7f63b4061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:02.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.141+0000 7f63ba8c3700 1 -- 172.21.15.63:0/1073703795 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b40ad150 con 0x7f63b4143630 2020-05-18T21:30:02.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.141+0000 7f63a6ffd700 1 -- 172.21.15.63:0/1073703795 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f63b0005970 con 0x7f63b4143630 2020-05-18T21:30:02.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.141+0000 7f63b90c0700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63b4143630 0x7f63b4148170 secure :-1 s=THROTTLE_DONE pgs=809 cs=0 l=1 rx=0x7f63b0002f70 tx=0x7f63b4061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:02.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.141+0000 7f63a6ffd700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f639404f9c0 0x7f6394051e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:02.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.141+0000 7f63a6ffd700 1 -- 172.21.15.63:0/1073703795 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5807+0+0 (secure 0 0 0) 0x7f63b0064480 con 0x7f63b4143630 2020-05-18T21:30:02.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.141+0000 7f63b98c1700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f639404f9c0 0x7f6394051e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:02.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.141+0000 7f63b98c1700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f639404f9c0 0x7f6394051e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f63a8000bc0 tx=0x7f63a8001a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:02.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.141+0000 7f63b98c1700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f639404f9c0 0x7f6394051e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f63a8000bc0 tx=0x7f63a8001a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:02.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.141+0000 7f63b98c1700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f639404f9c0 0x7f6394051e80 secure :-1 s=READY pgs=327 cs=0 l=1 rx=0x7f63a8000bc0 tx=0x7f63a8001a50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:02.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.149+0000 7f63b90c0700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63b4143630 0x7f63b4148170 secure :-1 s=THROTTLE_DONE pgs=809 cs=0 l=1 rx=0x7f63b0002f70 tx=0x7f63b4061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:02.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.149+0000 7f63a6ffd700 1 -- 172.21.15.63:0/1073703795 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f63b003e930 con 0x7f63b4143630 2020-05-18T21:30:02.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:02.269+0000 7f63ba8c3700 1 -- 172.21.15.63:0/1073703795 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f63b4147170 con 0x7f63b4143630 2020-05-18T21:30:03.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.009+0000 7f63b90c0700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63b4143630 0x7f63b4148170 secure :-1 s=THROTTLE_DONE pgs=809 cs=0 l=1 rx=0x7f63b0002f70 tx=0x7f63b4061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:03.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.009+0000 7f63a6ffd700 1 -- 172.21.15.63:0/1073703795 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v66) v1 ==== 173+0+0 (secure 0 0 0) 0x7f63b0041f50 con 0x7f63b4143630 2020-05-18T21:30:03.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.017+0000 7f63ba8c3700 1 -- 172.21.15.63:0/1073703795 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f639404f9c0 msgr2=0x7f6394051e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:03.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.017+0000 7f63ba8c3700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f639404f9c0 0x7f6394051e80 secure :-1 s=READY pgs=327 cs=0 l=1 rx=0x7f63a8000bc0 tx=0x7f63a8001a50).stop 2020-05-18T21:30:03.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.017+0000 7f63ba8c3700 1 -- 172.21.15.63:0/1073703795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63b4143630 msgr2=0x7f63b4148170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:03.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.017+0000 7f63ba8c3700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63b4143630 0x7f63b4148170 secure :-1 s=READY pgs=809 cs=0 l=1 rx=0x7f63b0002f70 tx=0x7f63b4061d60).stop 2020-05-18T21:30:03.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.021+0000 7f63ba8c3700 1 -- 172.21.15.63:0/1073703795 shutdown_connections 2020-05-18T21:30:03.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.021+0000 7f63ba8c3700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f639404f9c0 0x7f6394051e80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:03.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.021+0000 7f63ba8c3700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63b4143630 0x7f63b4148170 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:03.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.021+0000 7f63ba8c3700 1 --2- 172.21.15.63:0/1073703795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b40bc8d0 0x7f63b40acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:03.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.021+0000 7f63ba8c3700 1 -- 172.21.15.63:0/1073703795 >> 172.21.15.63:0/1073703795 conn(0x7f63b405f3b0 msgr2=0x7f63b40ba810 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:03.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.021+0000 7f63ba8c3700 1 -- 172.21.15.63:0/1073703795 shutdown_connections 2020-05-18T21:30:03.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.021+0000 7f63ba8c3700 1 -- 172.21.15.63:0/1073703795 wait complete. 2020-05-18T21:30:03.027 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2020-05-18T21:30:03.038 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:30:03.038 INFO:tasks.ceph.mds.a:Stopping old one... 2020-05-18T21:30:03.038 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:30:03.039 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:30:03.039 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:30:03.039 INFO:tasks.ceph.mds.b:Stopping old one... 2020-05-18T21:30:03.040 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:30:03.040 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:30:03.047 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:30:03.048 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:30:03.049 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:30:03.050 DEBUG:teuthology.parallel:result is None 2020-05-18T21:30:03.054 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:30:03.054 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:30:03.058 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:30:03.058 DEBUG:teuthology.parallel:result is None 2020-05-18T21:30:03.059 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-05-18T21:30:03.124 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:30:03.126 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:30:03.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.161+0000 7f6cf7f87700 1 Processor -- start 2020-05-18T21:30:03.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.161+0000 7f6cf7f87700 1 -- start start 2020-05-18T21:30:03.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.161+0000 7f6cf7f87700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6cf00b6170 0x7f6cf0146300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:03.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.161+0000 7f6cf7f87700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6cf0142900 0x7f6cf009dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:03.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.161+0000 7f6cf7f87700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf0146c10 con 0x7f6cf0146760 2020-05-18T21:30:03.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.161+0000 7f6cf7f87700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf0146eb0 con 0x7f6cf00b6170 2020-05-18T21:30:03.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.161+0000 7f6cf7f87700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf0147150 con 0x7f6cf0142900 2020-05-18T21:30:03.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.161+0000 7f6cf5522700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6cf0146760 0x7f6cf01421f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59092/0 (socket says 172.21.15.63:59092) 2020-05-18T21:30:03.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.161+0000 7f6cf5522700 1 -- 172.21.15.63:0/1652136323 learned_addr learned my addr 172.21.15.63:0/1652136323 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:03.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.161+0000 7f6cf6524700 1 --2- 172.21.15.63:0/1652136323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6cf0142900 0x7f6cf009dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.161+0000 7f6cf5d23700 1 --2- 172.21.15.63:0/1652136323 >> v2:172.21.15.155:3300/0 conn(0x7f6cf00b6170 0x7f6cf0146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.161+0000 7f6cf4d21700 1 -- 172.21.15.63:0/1652136323 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2858879971 0 0) 0x7f6cf0146c10 con 0x7f6cf0146760 2020-05-18T21:30:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.161+0000 7f6cf4d21700 1 -- 172.21.15.63:0/1652136323 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cdc003270 con 0x7f6cf0146760 2020-05-18T21:30:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf5d23700 1 -- 172.21.15.63:0/1652136323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6cf0142900 msgr2=0x7f6cf009dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf5d23700 1 --2- 172.21.15.63:0/1652136323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6cf0142900 0x7f6cf009dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:03.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf5d23700 1 -- 172.21.15.63:0/1652136323 >> v1:172.21.15.63:6789/0 conn(0x7f6cf0146760 legacy=0x7f6cf01421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:03.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf5d23700 1 -- 172.21.15.63:0/1652136323 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf00b6550 con 0x7f6cf00b6170 2020-05-18T21:30:03.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf6524700 1 --2- 172.21.15.63:0/1652136323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6cf0142900 0x7f6cf009dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:30:03.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf5d23700 1 --2- 172.21.15.63:0/1652136323 >> v2:172.21.15.155:3300/0 conn(0x7f6cf00b6170 0x7f6cf0146300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ce4002f70 tx=0x7f6ce4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:03.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf5d23700 1 --2- 172.21.15.63:0/1652136323 >> v2:172.21.15.155:3300/0 conn(0x7f6cf00b6170 0x7f6cf0146300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ce4002f70 tx=0x7f6ce4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:03.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf5d23700 1 --2- 172.21.15.63:0/1652136323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cf00b6170 0x7f6cf0146300 secure :-1 s=READY pgs=583 cs=0 l=1 rx=0x7f6ce4002f70 tx=0x7f6ce4007a80).ready entity=mon.1 client_cookie=6d06d7270414de5a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:03.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf5d23700 1 --2- 172.21.15.63:0/1652136323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cf00b6170 0x7f6cf0146300 secure :-1 s=THROTTLE_DONE pgs=583 cs=0 l=1 rx=0x7f6ce4002f70 tx=0x7f6ce4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:03.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf5d23700 1 --2- 172.21.15.63:0/1652136323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cf00b6170 0x7f6cf0146300 secure :-1 s=THROTTLE_DONE pgs=583 cs=0 l=1 rx=0x7f6ce4002f70 tx=0x7f6ce4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:03.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf4d21700 1 -- 172.21.15.63:0/1652136323 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ce4008e80 con 0x7f6cf00b6170 2020-05-18T21:30:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf5d23700 1 --2- 172.21.15.63:0/1652136323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cf00b6170 0x7f6cf0146300 secure :-1 s=THROTTLE_DONE pgs=583 cs=0 l=1 rx=0x7f6ce4002f70 tx=0x7f6ce4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf4d21700 1 -- 172.21.15.63:0/1652136323 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce4011540 con 0x7f6cf00b6170 2020-05-18T21:30:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf4d21700 1 -- 172.21.15.63:0/1652136323 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ce4011960 con 0x7f6cf00b6170 2020-05-18T21:30:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf7f87700 1 -- 172.21.15.63:0/1652136323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cf00b6170 msgr2=0x7f6cf0146300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf7f87700 1 --2- 172.21.15.63:0/1652136323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cf00b6170 0x7f6cf0146300 secure :-1 s=READY pgs=583 cs=0 l=1 rx=0x7f6ce4002f70 tx=0x7f6ce4007a80).stop 2020-05-18T21:30:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf7f87700 1 -- 172.21.15.63:0/1652136323 shutdown_connections 2020-05-18T21:30:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf7f87700 1 --2- 172.21.15.63:0/1652136323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6cf0142900 0x7f6cf009dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf7f87700 1 --2- 172.21.15.63:0/1652136323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cf00b6170 0x7f6cf0146300 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf7f87700 1 -- 172.21.15.63:0/1652136323 >> 172.21.15.63:0/1652136323 conn(0x7f6cf00b9750 msgr2=0x7f6cf00b5720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:03.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf7f87700 1 -- 172.21.15.63:0/1652136323 shutdown_connections 2020-05-18T21:30:03.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf7f87700 1 -- 172.21.15.63:0/1652136323 wait complete. 2020-05-18T21:30:03.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf7f87700 1 Processor -- start 2020-05-18T21:30:03.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf7f87700 1 -- start start 2020-05-18T21:30:03.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf7f87700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6cf00b6170 0x7f6cf01538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:03.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf7f87700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf0062e30 con 0x7f6cf0142900 2020-05-18T21:30:03.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf7f87700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf00630d0 con 0x7f6cf0146760 2020-05-18T21:30:03.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf7f87700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf0063370 con 0x7f6cf00b6170 2020-05-18T21:30:03.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.165+0000 7f6cf5d23700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6cf00b6170 0x7f6cf01538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:03.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf5522700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6cf0142900 0x7f6cf013cdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59098/0 (socket says 172.21.15.63:59098) 2020-05-18T21:30:03.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf5d23700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6cf00b6170 0x7f6cf01538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56908/0 (socket says 172.21.15.63:56908) 2020-05-18T21:30:03.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf5522700 1 -- 172.21.15.63:0/2302226982 learned_addr learned my addr 172.21.15.63:0/2302226982 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:03.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf5d23700 1 -- 172.21.15.63:0/2302226982 >> v1:172.21.15.155:6789/0 conn(0x7f6cf0146760 legacy=0x7f6cf013f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:03.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf5d23700 1 -- 172.21.15.63:0/2302226982 >> v1:172.21.15.63:6789/0 conn(0x7f6cf0142900 legacy=0x7f6cf013cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:03.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6ceeffd700 1 -- 172.21.15.63:0/2302226982 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133996110 0 0) 0x7f6cf0062e30 con 0x7f6cf0142900 2020-05-18T21:30:03.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf5d23700 1 -- 172.21.15.63:0/2302226982 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf0063810 con 0x7f6cf00b6170 2020-05-18T21:30:03.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf5d23700 1 --2- 172.21.15.63:0/2302226982 >> v2:172.21.15.63:3300/0 conn(0x7f6cf00b6170 0x7f6cf01538c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ce4002f70 tx=0x7f6ce4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:03.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf5d23700 1 --2- 172.21.15.63:0/2302226982 >> v2:172.21.15.63:3300/0 conn(0x7f6cf00b6170 0x7f6cf01538c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ce4002f70 tx=0x7f6ce4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:03.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf5d23700 1 --2- 172.21.15.63:0/2302226982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cf00b6170 0x7f6cf01538c0 secure :-1 s=READY pgs=815 cs=0 l=1 rx=0x7f6ce4002f70 tx=0x7f6ce4007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:03.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf5d23700 1 --2- 172.21.15.63:0/2302226982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cf00b6170 0x7f6cf01538c0 secure :-1 s=THROTTLE_DONE pgs=815 cs=0 l=1 rx=0x7f6ce4002f70 tx=0x7f6ce4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:03.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6ceeffd700 1 -- 172.21.15.63:0/2302226982 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ce40100e0 con 0x7f6cf00b6170 2020-05-18T21:30:03.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf5d23700 1 --2- 172.21.15.63:0/2302226982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cf00b6170 0x7f6cf01538c0 secure :-1 s=THROTTLE_DONE pgs=815 cs=0 l=1 rx=0x7f6ce4002f70 tx=0x7f6ce4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:03.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf7f87700 1 -- 172.21.15.63:0/2302226982 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf013d4c0 con 0x7f6cf00b6170 2020-05-18T21:30:03.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6ceeffd700 1 -- 172.21.15.63:0/2302226982 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce40119e0 con 0x7f6cf00b6170 2020-05-18T21:30:03.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf5d23700 1 --2- 172.21.15.63:0/2302226982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cf00b6170 0x7f6cf01538c0 secure :-1 s=THROTTLE_DONE pgs=815 cs=0 l=1 rx=0x7f6ce4002f70 tx=0x7f6ce4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:03.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6ceeffd700 1 -- 172.21.15.63:0/2302226982 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ce40058f0 con 0x7f6cf00b6170 2020-05-18T21:30:03.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf7f87700 1 -- 172.21.15.63:0/2302226982 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf013d7d0 con 0x7f6cf00b6170 2020-05-18T21:30:03.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf5d23700 1 --2- 172.21.15.63:0/2302226982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cf00b6170 0x7f6cf01538c0 secure :-1 s=THROTTLE_DONE pgs=815 cs=0 l=1 rx=0x7f6ce4002f70 tx=0x7f6ce4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:03.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf7f87700 1 -- 172.21.15.63:0/2302226982 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf00569e0 con 0x7f6cf00b6170 2020-05-18T21:30:03.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6ceeffd700 1 -- 172.21.15.63:0/2302226982 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6ce4005af0 con 0x7f6cf00b6170 2020-05-18T21:30:03.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf5d23700 1 --2- 172.21.15.63:0/2302226982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cf00b6170 0x7f6cf01538c0 secure :-1 s=THROTTLE_DONE pgs=815 cs=0 l=1 rx=0x7f6ce4002f70 tx=0x7f6ce4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:03.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6ceeffd700 1 --2- 172.21.15.63:0/2302226982 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6cd004f810 0x7f6cd0051cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:03.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6ceeffd700 1 -- 172.21.15.63:0/2302226982 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5425+0+0 (secure 0 0 0) 0x7f6ce4066020 con 0x7f6cf00b6170 2020-05-18T21:30:03.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf5522700 1 --2- 172.21.15.63:0/2302226982 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6cd004f810 0x7f6cd0051cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:03.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf5522700 1 --2- 172.21.15.63:0/2302226982 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6cd004f810 0x7f6cd0051cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ce00016d0 tx=0x7f6ce0001ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:03.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf5522700 1 --2- 172.21.15.63:0/2302226982 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6cd004f810 0x7f6cd0051cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ce00016d0 tx=0x7f6ce0001ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:03.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.169+0000 7f6cf5522700 1 --2- 172.21.15.63:0/2302226982 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6cd004f810 0x7f6cd0051cd0 secure :-1 s=READY pgs=328 cs=0 l=1 rx=0x7f6ce00016d0 tx=0x7f6ce0001ad0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:03.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.177+0000 7f6cf5d23700 1 --2- 172.21.15.63:0/2302226982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cf00b6170 0x7f6cf01538c0 secure :-1 s=THROTTLE_DONE pgs=815 cs=0 l=1 rx=0x7f6ce4002f70 tx=0x7f6ce4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:03.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.177+0000 7f6ceeffd700 1 -- 172.21.15.63:0/2302226982 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6ce4040410 con 0x7f6cf00b6170 2020-05-18T21:30:03.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:03.301+0000 7f6cf7f87700 1 -- 172.21.15.63:0/2302226982 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f6cf009cc80 con 0x7f6cf00b6170 2020-05-18T21:30:04.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.153+0000 7f6cf5d23700 1 --2- 172.21.15.63:0/2302226982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cf00b6170 0x7f6cf01538c0 secure :-1 s=THROTTLE_DONE pgs=815 cs=0 l=1 rx=0x7f6ce4002f70 tx=0x7f6ce4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.157+0000 7f6ceeffd700 1 -- 172.21.15.63:0/2302226982 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v69) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6ce4043a30 con 0x7f6cf00b6170 2020-05-18T21:30:04.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.157+0000 7f6cf7f87700 1 -- 172.21.15.63:0/2302226982 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6cd004f810 msgr2=0x7f6cd0051cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:04.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.157+0000 7f6cf7f87700 1 --2- 172.21.15.63:0/2302226982 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6cd004f810 0x7f6cd0051cd0 secure :-1 s=READY pgs=328 cs=0 l=1 rx=0x7f6ce00016d0 tx=0x7f6ce0001ad0).stop 2020-05-18T21:30:04.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.157+0000 7f6cf7f87700 1 -- 172.21.15.63:0/2302226982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cf00b6170 msgr2=0x7f6cf01538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:04.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.157+0000 7f6cf7f87700 1 --2- 172.21.15.63:0/2302226982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cf00b6170 0x7f6cf01538c0 secure :-1 s=READY pgs=815 cs=0 l=1 rx=0x7f6ce4002f70 tx=0x7f6ce4007a80).stop 2020-05-18T21:30:04.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.161+0000 7f6cf7f87700 1 -- 172.21.15.63:0/2302226982 shutdown_connections 2020-05-18T21:30:04.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.161+0000 7f6cf7f87700 1 --2- 172.21.15.63:0/2302226982 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6cd004f810 0x7f6cd0051cd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:04.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.161+0000 7f6cf7f87700 1 --2- 172.21.15.63:0/2302226982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cf00b6170 0x7f6cf01538c0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:04.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.161+0000 7f6cf7f87700 1 -- 172.21.15.63:0/2302226982 >> 172.21.15.63:0/2302226982 conn(0x7f6cf00b9750 msgr2=0x7f6cf0098650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:04.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.161+0000 7f6cf7f87700 1 -- 172.21.15.63:0/2302226982 shutdown_connections 2020-05-18T21:30:04.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.161+0000 7f6cf7f87700 1 -- 172.21.15.63:0/2302226982 wait complete. 2020-05-18T21:30:04.167 INFO:teuthology.orchestra.run.smithi063.stderr: removed all blacklist entries 2020-05-18T21:30:04.178 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-05-18T21:30:04.179 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-05-18T21:30:04.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.281+0000 7f955a047700 1 Processor -- start 2020-05-18T21:30:04.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.281+0000 7f955a047700 1 -- start start 2020-05-18T21:30:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f955a047700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bbcd0 0x7f95540afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f955a047700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f95540b0280 0x7f955412efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:04.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f955a047700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95540af980 con 0x7f95540bb5e0 2020-05-18T21:30:04.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f955a047700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95540af770 con 0x7f95540b0280 2020-05-18T21:30:04.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f955a047700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95540bb9c0 con 0x7f95540bbcd0 2020-05-18T21:30:04.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f95537fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f95540bb5e0 0x7f95540acee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59106/0 (socket says 172.21.15.63:59106) 2020-05-18T21:30:04.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f95537fe700 1 -- 172.21.15.63:0/2250396607 learned_addr learned my addr 172.21.15.63:0/2250396607 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:04.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f9552ffd700 1 --2- 172.21.15.63:0/2250396607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bbcd0 0x7f95540afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:04.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f9553fff700 1 --2- 172.21.15.63:0/2250396607 >> v2:172.21.15.155:3300/0 conn(0x7f95540b0280 0x7f955412efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:04.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f95527fc700 1 -- 172.21.15.63:0/2250396607 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537053085 0 0) 0x7f95540af980 con 0x7f95540bb5e0 2020-05-18T21:30:04.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f95527fc700 1 -- 172.21.15.63:0/2250396607 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9540003270 con 0x7f95540bb5e0 2020-05-18T21:30:04.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f9552ffd700 1 -- 172.21.15.63:0/2250396607 >> v2:172.21.15.155:3300/0 conn(0x7f95540b0280 msgr2=0x7f955412efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:04.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f9552ffd700 1 --2- 172.21.15.63:0/2250396607 >> v2:172.21.15.155:3300/0 conn(0x7f95540b0280 0x7f955412efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f9552ffd700 1 -- 172.21.15.63:0/2250396607 >> v1:172.21.15.63:6789/0 conn(0x7f95540bb5e0 legacy=0x7f95540acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f9552ffd700 1 -- 172.21.15.63:0/2250396607 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95540af3d0 con 0x7f95540bbcd0 2020-05-18T21:30:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f9552ffd700 1 --2- 172.21.15.63:0/2250396607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bbcd0 0x7f95540afe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9544002f70 tx=0x7f9544007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f9552ffd700 1 --2- 172.21.15.63:0/2250396607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bbcd0 0x7f95540afe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9544002f70 tx=0x7f9544007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f9552ffd700 1 --2- 172.21.15.63:0/2250396607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bbcd0 0x7f95540afe20 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f9544002f70 tx=0x7f9544007a80).ready entity=mon.2 client_cookie=5df35b16aff6809e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f9552ffd700 1 --2- 172.21.15.63:0/2250396607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bbcd0 0x7f95540afe20 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f9544002f70 tx=0x7f9544007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f95527fc700 1 -- 172.21.15.63:0/2250396607 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9544008e80 con 0x7f95540bbcd0 2020-05-18T21:30:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f9552ffd700 1 --2- 172.21.15.63:0/2250396607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bbcd0 0x7f95540afe20 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f9544002f70 tx=0x7f9544007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f95527fc700 1 -- 172.21.15.63:0/2250396607 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9544011540 con 0x7f95540bbcd0 2020-05-18T21:30:04.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f9552ffd700 1 --2- 172.21.15.63:0/2250396607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bbcd0 0x7f95540afe20 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f9544002f70 tx=0x7f9544007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f955a047700 1 -- 172.21.15.63:0/2250396607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bbcd0 msgr2=0x7f95540afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:04.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f95527fc700 1 -- 172.21.15.63:0/2250396607 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9544011920 con 0x7f95540bbcd0 2020-05-18T21:30:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f955a047700 1 --2- 172.21.15.63:0/2250396607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bbcd0 0x7f95540afe20 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f9544002f70 tx=0x7f9544007a80).stop 2020-05-18T21:30:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f955a047700 1 -- 172.21.15.63:0/2250396607 shutdown_connections 2020-05-18T21:30:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f955a047700 1 --2- 172.21.15.63:0/2250396607 >> v2:172.21.15.155:3300/0 conn(0x7f95540b0280 0x7f955412efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f955a047700 1 --2- 172.21.15.63:0/2250396607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bbcd0 0x7f95540afe20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f955a047700 1 -- 172.21.15.63:0/2250396607 >> 172.21.15.63:0/2250396607 conn(0x7f9554069b70 msgr2=0x7f9554069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f955a047700 1 -- 172.21.15.63:0/2250396607 shutdown_connections 2020-05-18T21:30:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.285+0000 7f955a047700 1 -- 172.21.15.63:0/2250396607 wait complete. 2020-05-18T21:30:04.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.289+0000 7f955a047700 1 Processor -- start 2020-05-18T21:30:04.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.289+0000 7f955a047700 1 -- start start 2020-05-18T21:30:04.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.289+0000 7f955a047700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bb5e0 0x7f95540b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:04.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.289+0000 7f955a047700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95540b8870 con 0x7f95540b0280 2020-05-18T21:30:04.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f955a047700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95540b8b10 con 0x7f95540bbcd0 2020-05-18T21:30:04.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f955a047700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95540b8680 con 0x7f95540bb5e0 2020-05-18T21:30:04.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f95537fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f95540b0280 0x7f955412ef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59112/0 (socket says 172.21.15.63:59112) 2020-05-18T21:30:04.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f95537fe700 1 -- 172.21.15.63:0/20631545 learned_addr learned my addr 172.21.15.63:0/20631545 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:04.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f9552ffd700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bb5e0 0x7f95540b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:04.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f9550ff9700 1 -- 172.21.15.63:0/20631545 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735647444 0 0) 0x7f95540b8870 con 0x7f95540b0280 2020-05-18T21:30:04.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f9550ff9700 1 -- 172.21.15.63:0/20631545 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9534002fe0 con 0x7f95540b0280 2020-05-18T21:30:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f9550ff9700 1 -- 172.21.15.63:0/20631545 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516365611 0 0) 0x7f95540b8b10 con 0x7f95540bbcd0 2020-05-18T21:30:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f9550ff9700 1 -- 172.21.15.63:0/20631545 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95540b8870 con 0x7f95540bbcd0 2020-05-18T21:30:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f9552ffd700 1 -- 172.21.15.63:0/20631545 >> v1:172.21.15.155:6789/0 conn(0x7f95540bbcd0 legacy=0x7f95540b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f9552ffd700 1 -- 172.21.15.63:0/20631545 >> v1:172.21.15.63:6789/0 conn(0x7f95540b0280 legacy=0x7f955412ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f9552ffd700 1 -- 172.21.15.63:0/20631545 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95540b3f70 con 0x7f95540bb5e0 2020-05-18T21:30:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f9552ffd700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bb5e0 0x7f95540b6d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9544002f70 tx=0x7f9544007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f9552ffd700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bb5e0 0x7f95540b6d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9544002f70 tx=0x7f9544007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f9552ffd700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bb5e0 0x7f95540b6d30 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f9544002f70 tx=0x7f9544007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f9552ffd700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bb5e0 0x7f95540b6d30 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f9544002f70 tx=0x7f9544007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f9550ff9700 1 -- 172.21.15.63:0/20631545 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9544011940 con 0x7f95540bb5e0 2020-05-18T21:30:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f9552ffd700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bb5e0 0x7f95540b6d30 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f9544002f70 tx=0x7f9544007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f9552ffd700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bb5e0 0x7f95540b6d30 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f9544002f70 tx=0x7f9544007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f9550ff9700 1 -- 172.21.15.63:0/20631545 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9544007170 con 0x7f95540bb5e0 2020-05-18T21:30:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f955a047700 1 -- 172.21.15.63:0/20631545 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95540b5f50 con 0x7f95540bb5e0 2020-05-18T21:30:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f9550ff9700 1 -- 172.21.15.63:0/20631545 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95440074d0 con 0x7f95540bb5e0 2020-05-18T21:30:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f955a047700 1 -- 172.21.15.63:0/20631545 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9554153d10 con 0x7f95540bb5e0 2020-05-18T21:30:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f9552ffd700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bb5e0 0x7f95540b6d30 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f9544002f70 tx=0x7f9544007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.293+0000 7f955a047700 1 -- 172.21.15.63:0/20631545 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95540b8ca0 con 0x7f95540bb5e0 2020-05-18T21:30:04.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.297+0000 7f9550ff9700 1 -- 172.21.15.63:0/20631545 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9544005700 con 0x7f95540bb5e0 2020-05-18T21:30:04.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.297+0000 7f9552ffd700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bb5e0 0x7f95540b6d30 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f9544002f70 tx=0x7f9544007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.297+0000 7f9550ff9700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f953404ff00 0x7f95340523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:04.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.297+0000 7f9550ff9700 1 -- 172.21.15.63:0/20631545 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9544064300 con 0x7f95540bb5e0 2020-05-18T21:30:04.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.297+0000 7f95537fe700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f953404ff00 0x7f95340523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:04.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.297+0000 7f95537fe700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f953404ff00 0x7f95340523c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9548001150 tx=0x7f9548001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.297+0000 7f95537fe700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f953404ff00 0x7f95340523c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9548001150 tx=0x7f9548001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.297+0000 7f95537fe700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f953404ff00 0x7f95340523c0 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7f9548001150 tx=0x7f9548001720).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:04.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.305+0000 7f9552ffd700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bb5e0 0x7f95540b6d30 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f9544002f70 tx=0x7f9544007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.305+0000 7f9550ff9700 1 -- 172.21.15.63:0/20631545 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f954403e750 con 0x7f95540bb5e0 2020-05-18T21:30:04.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.461+0000 7f955a047700 1 -- 172.21.15.63:0/20631545 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f95540569e0 con 0x7f95540bb5e0 2020-05-18T21:30:04.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.461+0000 7f9552ffd700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bb5e0 0x7f95540b6d30 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f9544002f70 tx=0x7f9544007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.461+0000 7f9550ff9700 1 -- 172.21.15.63:0/20631545 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) v1 ==== 80+0+4513 (secure 0 0 0) 0x7f9544041d70 con 0x7f95540bb5e0 2020-05-18T21:30:04.468 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:04.469 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:30:04.469 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_dump": [ 2020-05-18T21:30:04.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:04.470 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.a", 2020-05-18T21:30:04.470 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJekJyyLRAAfB5XJCsXTAmZdkFOaQrokg==", 2020-05-18T21:30:04.470 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:30:04.470 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:30:04.470 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:30:04.471 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:30:04.471 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:30:04.471 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:04.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:04.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:04.471 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.b", 2020-05-18T21:30:04.472 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeSVE8MRAAEEytuzLtcQMC+1uQ/yh8eA==", 2020-05-18T21:30:04.472 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:30:04.472 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:30:04.472 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:30:04.472 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:30:04.473 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:30:04.473 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:04.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:04.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:04.473 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.0", 2020-05-18T21:30:04.474 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBq/cJeIn7mJhAArx+YEdVbsfXXNOLWdaAgWw==", 2020-05-18T21:30:04.474 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:30:04.474 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:30:04.474 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:30:04.474 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:30:04.474 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:04.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:04.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:04.475 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.1", 2020-05-18T21:30:04.475 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBt/cJelHywCRAAFyQ3sPEE0RTSy4tKfsDfyw==", 2020-05-18T21:30:04.475 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:30:04.476 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:30:04.476 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:30:04.476 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:30:04.476 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:04.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:04.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:04.477 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.2", 2020-05-18T21:30:04.477 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBv/cJecexDLBAAxhlFq20MBkKvDjuM1yi8XQ==", 2020-05-18T21:30:04.477 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:30:04.477 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:30:04.477 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:30:04.478 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:30:04.478 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:04.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:04.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:04.478 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.3", 2020-05-18T21:30:04.479 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBy/cJe9IqwDxAAMg1In7bIITDcOZljzzTpDQ==", 2020-05-18T21:30:04.479 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:30:04.479 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:30:04.479 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:30:04.479 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:30:04.479 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:04.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:04.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:04.480 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.4", 2020-05-18T21:30:04.480 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB3/cJeLXgxFhAA/kMVV5hCRny2uXKvvbu8Og==", 2020-05-18T21:30:04.480 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:30:04.481 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:30:04.481 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:30:04.481 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:30:04.481 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:04.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:04.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:04.482 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.5", 2020-05-18T21:30:04.482 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB5/cJeucpsNRAAjGh+6yUC8Fji9PE4COi/Eg==", 2020-05-18T21:30:04.482 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:30:04.482 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:30:04.482 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:30:04.483 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:30:04.483 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:04.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:04.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:04.483 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.6", 2020-05-18T21:30:04.484 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB8/cJelSPpGhAAXobGqH9qaW1VZfEpH8bUbQ==", 2020-05-18T21:30:04.484 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:30:04.484 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:30:04.484 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:30:04.484 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:30:04.484 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:04.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:04.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:04.485 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.7", 2020-05-18T21:30:04.485 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB+/cJeUIl5OBAAPd8H8ohOWZw9ubO7uCB6zg==", 2020-05-18T21:30:04.485 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:30:04.486 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:30:04.486 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:30:04.486 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:30:04.486 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:04.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:04.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:04.487 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.0", 2020-05-18T21:30:04.487 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeap3RNhAAi2vKpsKtzSL1Uuqm8pWYJQ==", 2020-05-18T21:30:04.487 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:30:04.487 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:30:04.487 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:30:04.488 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:30:04.488 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:04.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:04.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:04.488 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.1", 2020-05-18T21:30:04.488 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJeekrQABAA5TmzWOt24C6hgZw/WTj5dw==", 2020-05-18T21:30:04.489 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:30:04.489 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:30:04.489 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:30:04.489 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:30:04.489 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:04.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:04.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:04.490 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.2", 2020-05-18T21:30:04.490 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJehSnFAxAAXUZwqNTXqAApEB3nXs4u6g==", 2020-05-18T21:30:04.490 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:30:04.491 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:30:04.491 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:30:04.491 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:30:04.491 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:04.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:04.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:04.492 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.3", 2020-05-18T21:30:04.492 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJe2HdDBhAA07y5pn/bKKa9TBbZFvIh9g==", 2020-05-18T21:30:04.492 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:30:04.492 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:30:04.492 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:30:04.493 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:30:04.494 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:04.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:04.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:04.495 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.admin", 2020-05-18T21:30:04.495 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJe/K4fGRAA+rP3BYuWiyx/fKmQ3bV6Lw==", 2020-05-18T21:30:04.495 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:30:04.496 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:30:04.496 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:30:04.496 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:30:04.497 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:30:04.497 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:04.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:04.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:04.498 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.x", 2020-05-18T21:30:04.498 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJemmqEKhAAe5ySRz8Id0ug4matQwL0uw==", 2020-05-18T21:30:04.498 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:30:04.498 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:30:04.498 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:30:04.499 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:30:04.499 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:04.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:04.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:04.500 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.y", 2020-05-18T21:30:04.500 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeF/BNJhAAi/vrldC6qoWJWnSHpE3ung==", 2020-05-18T21:30:04.500 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:30:04.500 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:30:04.500 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:30:04.501 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:30:04.501 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:04.501 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:04.501 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:30:04.501 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:30:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.465+0000 7f955a047700 1 -- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f953404ff00 msgr2=0x7f95340523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.465+0000 7f955a047700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f953404ff00 0x7f95340523c0 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7f9548001150 tx=0x7f9548001720).stop 2020-05-18T21:30:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.465+0000 7f955a047700 1 -- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bb5e0 msgr2=0x7f95540b6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.465+0000 7f955a047700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bb5e0 0x7f95540b6d30 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f9544002f70 tx=0x7f9544007a80).stop 2020-05-18T21:30:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.465+0000 7f955a047700 1 -- 172.21.15.63:0/20631545 shutdown_connections 2020-05-18T21:30:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.465+0000 7f955a047700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f953404ff00 0x7f95340523c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.465+0000 7f955a047700 1 --2- 172.21.15.63:0/20631545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95540bb5e0 0x7f95540b6d30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.465+0000 7f955a047700 1 -- 172.21.15.63:0/20631545 >> 172.21.15.63:0/20631545 conn(0x7f9554069b70 msgr2=0x7f9554069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.465+0000 7f955a047700 1 -- 172.21.15.63:0/20631545 shutdown_connections 2020-05-18T21:30:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.465+0000 7f955a047700 1 -- 172.21.15.63:0/20631545 wait complete. 2020-05-18T21:30:04.505 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:30:04.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.605+0000 7f9a5dd14700 1 Processor -- start 2020-05-18T21:30:04.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.605+0000 7f9a5dd14700 1 -- start start 2020-05-18T21:30:04.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a5dd14700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a58060b90 0x7f9a580615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:04.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a5dd14700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5814d960 con 0x7f9a5814e570 2020-05-18T21:30:04.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a5dd14700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5814db90 con 0x7f9a580b2860 2020-05-18T21:30:04.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a5dd14700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a58066210 con 0x7f9a58060b90 2020-05-18T21:30:04.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a57fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9a5814e570 0x7f9a5814a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59124/0 (socket says 172.21.15.63:59124) 2020-05-18T21:30:04.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a57fff700 1 -- 172.21.15.63:0/1555834894 learned_addr learned my addr 172.21.15.63:0/1555834894 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:04.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a577fe700 1 --2- 172.21.15.63:0/1555834894 >> v2:172.21.15.155:3300/0 conn(0x7f9a58060b90 0x7f9a580615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:04.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a567fc700 1 -- 172.21.15.63:0/1555834894 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561477905 0 0) 0x7f9a5814d960 con 0x7f9a5814e570 2020-05-18T21:30:04.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a567fc700 1 -- 172.21.15.63:0/1555834894 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a38003270 con 0x7f9a5814e570 2020-05-18T21:30:04.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a567fc700 1 -- 172.21.15.63:0/1555834894 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629993386 0 0) 0x7f9a5814db90 con 0x7f9a580b2860 2020-05-18T21:30:04.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a567fc700 1 -- 172.21.15.63:0/1555834894 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a5814d960 con 0x7f9a580b2860 2020-05-18T21:30:04.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a577fe700 1 -- 172.21.15.63:0/1555834894 >> v1:172.21.15.155:6789/0 conn(0x7f9a580b2860 legacy=0x7f9a58144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:04.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a577fe700 1 -- 172.21.15.63:0/1555834894 >> v1:172.21.15.63:6789/0 conn(0x7f9a5814e570 legacy=0x7f9a5814a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:04.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a577fe700 1 -- 172.21.15.63:0/1555834894 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5814de30 con 0x7f9a58060b90 2020-05-18T21:30:04.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a577fe700 1 --2- 172.21.15.63:0/1555834894 >> v2:172.21.15.155:3300/0 conn(0x7f9a58060b90 0x7f9a580615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9a58062dc0 tx=0x7f9a48008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a577fe700 1 --2- 172.21.15.63:0/1555834894 >> v2:172.21.15.155:3300/0 conn(0x7f9a58060b90 0x7f9a580615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9a58062dc0 tx=0x7f9a48008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a577fe700 1 --2- 172.21.15.63:0/1555834894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a58060b90 0x7f9a580615e0 secure :-1 s=READY pgs=587 cs=0 l=1 rx=0x7f9a58062dc0 tx=0x7f9a48008920).ready entity=mon.1 client_cookie=1ee5ec02963c2337 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:04.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a577fe700 1 --2- 172.21.15.63:0/1555834894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a58060b90 0x7f9a580615e0 secure :-1 s=THROTTLE_DONE pgs=587 cs=0 l=1 rx=0x7f9a58062dc0 tx=0x7f9a48008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a567fc700 1 -- 172.21.15.63:0/1555834894 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a48008e80 con 0x7f9a58060b90 2020-05-18T21:30:04.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a577fe700 1 --2- 172.21.15.63:0/1555834894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a58060b90 0x7f9a580615e0 secure :-1 s=THROTTLE_DONE pgs=587 cs=0 l=1 rx=0x7f9a58062dc0 tx=0x7f9a48008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a577fe700 1 --2- 172.21.15.63:0/1555834894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a58060b90 0x7f9a580615e0 secure :-1 s=THROTTLE_DONE pgs=587 cs=0 l=1 rx=0x7f9a58062dc0 tx=0x7f9a48008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a567fc700 1 -- 172.21.15.63:0/1555834894 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a48011540 con 0x7f9a58060b90 2020-05-18T21:30:04.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a567fc700 1 -- 172.21.15.63:0/1555834894 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a48011920 con 0x7f9a58060b90 2020-05-18T21:30:04.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a5dd14700 1 -- 172.21.15.63:0/1555834894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a58060b90 msgr2=0x7f9a580615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:04.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a5dd14700 1 --2- 172.21.15.63:0/1555834894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a58060b90 0x7f9a580615e0 secure :-1 s=READY pgs=587 cs=0 l=1 rx=0x7f9a58062dc0 tx=0x7f9a48008920).stop 2020-05-18T21:30:04.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a5dd14700 1 -- 172.21.15.63:0/1555834894 shutdown_connections 2020-05-18T21:30:04.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a5dd14700 1 --2- 172.21.15.63:0/1555834894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a58060b90 0x7f9a580615e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:04.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a5dd14700 1 -- 172.21.15.63:0/1555834894 >> 172.21.15.63:0/1555834894 conn(0x7f9a580b83d0 msgr2=0x7f9a580b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:04.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a5dd14700 1 -- 172.21.15.63:0/1555834894 shutdown_connections 2020-05-18T21:30:04.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.609+0000 7f9a5dd14700 1 -- 172.21.15.63:0/1555834894 wait complete. 2020-05-18T21:30:04.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.613+0000 7f9a5dd14700 1 Processor -- start 2020-05-18T21:30:04.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.613+0000 7f9a5dd14700 1 -- start start 2020-05-18T21:30:04.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.613+0000 7f9a5dd14700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a580b2860 0x7f9a58149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:04.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.613+0000 7f9a5dd14700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a5814e570 0x7f9a58149960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:04.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.613+0000 7f9a5dd14700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a580ad350 con 0x7f9a58060b90 2020-05-18T21:30:04.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.613+0000 7f9a5dd14700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a58157710 con 0x7f9a580b2860 2020-05-18T21:30:04.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.613+0000 7f9a5dd14700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a58149dc0 con 0x7f9a5814e570 2020-05-18T21:30:04.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a56ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a580b2860 0x7f9a58149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:04.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a56ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a580b2860 0x7f9a58149500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:43556/0 (socket says 172.21.15.63:43556) 2020-05-18T21:30:04.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a56ffd700 1 -- 172.21.15.63:0/2306200125 learned_addr learned my addr 172.21.15.63:0/2306200125 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:04.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a57fff700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a5814e570 0x7f9a58149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:04.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a56ffd700 1 -- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a5814e570 msgr2=0x7f9a58149960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:04.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a56ffd700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a5814e570 0x7f9a58149960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:04.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a56ffd700 1 -- 172.21.15.63:0/2306200125 >> v1:172.21.15.155:6789/0 conn(0x7f9a58060b90 legacy=0x7f9a580651d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:04.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a54ff9700 1 -- 172.21.15.63:0/2306200125 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217128813 0 0) 0x7f9a580ad350 con 0x7f9a58060b90 2020-05-18T21:30:04.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a56ffd700 1 -- 172.21.15.63:0/2306200125 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a58157900 con 0x7f9a580b2860 2020-05-18T21:30:04.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a56ffd700 1 --2- 172.21.15.63:0/2306200125 >> v2:172.21.15.155:3300/0 conn(0x7f9a580b2860 0x7f9a58149500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a40001110 tx=0x7f9a40002ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a56ffd700 1 --2- 172.21.15.63:0/2306200125 >> v2:172.21.15.155:3300/0 conn(0x7f9a580b2860 0x7f9a58149500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a40001110 tx=0x7f9a40002ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a56ffd700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a580b2860 0x7f9a58149500 secure :-1 s=READY pgs=589 cs=0 l=1 rx=0x7f9a40001110 tx=0x7f9a40002ea0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:04.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a56ffd700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a580b2860 0x7f9a58149500 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f9a40001110 tx=0x7f9a40002ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a56ffd700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a580b2860 0x7f9a58149500 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f9a40001110 tx=0x7f9a40002ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a54ff9700 1 -- 172.21.15.63:0/2306200125 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a4000cc60 con 0x7f9a580b2860 2020-05-18T21:30:04.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a56ffd700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a580b2860 0x7f9a58149500 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f9a40001110 tx=0x7f9a40002ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a54ff9700 1 -- 172.21.15.63:0/2306200125 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4000cdc0 con 0x7f9a580b2860 2020-05-18T21:30:04.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a5dd14700 1 -- 172.21.15.63:0/2306200125 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a580658e0 con 0x7f9a580b2860 2020-05-18T21:30:04.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a54ff9700 1 -- 172.21.15.63:0/2306200125 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a4000e370 con 0x7f9a580b2860 2020-05-18T21:30:04.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a5dd14700 1 -- 172.21.15.63:0/2306200125 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a580ace60 con 0x7f9a580b2860 2020-05-18T21:30:04.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a5dd14700 1 -- 172.21.15.63:0/2306200125 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a580ad170 con 0x7f9a580b2860 2020-05-18T21:30:04.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.617+0000 7f9a56ffd700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a580b2860 0x7f9a58149500 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f9a40001110 tx=0x7f9a40002ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.621+0000 7f9a54ff9700 1 -- 172.21.15.63:0/2306200125 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9a40006520 con 0x7f9a580b2860 2020-05-18T21:30:04.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.621+0000 7f9a56ffd700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a580b2860 0x7f9a58149500 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f9a40001110 tx=0x7f9a40002ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.621+0000 7f9a54ff9700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a3c04f8b0 0x7f9a3c051d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:04.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.621+0000 7f9a54ff9700 1 -- 172.21.15.63:0/2306200125 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9a40063b10 con 0x7f9a580b2860 2020-05-18T21:30:04.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.621+0000 7f9a577fe700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a3c04f8b0 0x7f9a3c051d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.621+0000 7f9a577fe700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a3c04f8b0 0x7f9a3c051d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a48000bc0 tx=0x7f9a5805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.621+0000 7f9a577fe700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a3c04f8b0 0x7f9a3c051d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a48000bc0 tx=0x7f9a5805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.621+0000 7f9a577fe700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a3c04f8b0 0x7f9a3c051d70 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f9a48000bc0 tx=0x7f9a5805fa60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:04.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.629+0000 7f9a56ffd700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a580b2860 0x7f9a58149500 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f9a40001110 tx=0x7f9a40002ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.629+0000 7f9a54ff9700 1 -- 172.21.15.63:0/2306200125 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9a4003de40 con 0x7f9a580b2860 2020-05-18T21:30:04.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.745+0000 7f9a5dd14700 1 -- 172.21.15.63:0/2306200125 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a58157a90 con 0x7f9a580b2860 2020-05-18T21:30:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.749+0000 7f9a56ffd700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a580b2860 0x7f9a58149500 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f9a40001110 tx=0x7f9a40002ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.749+0000 7f9a54ff9700 1 -- 172.21.15.63:0/2306200125 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+13233 (secure 0 0 0) 0x7f9a40041460 con 0x7f9a580b2860 2020-05-18T21:30:04.753 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:04.754 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":69,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:30:04.151509+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:30:04.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.749+0000 7f9a5dd14700 1 -- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a3c04f8b0 msgr2=0x7f9a3c051d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:04.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.749+0000 7f9a5dd14700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a3c04f8b0 0x7f9a3c051d70 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f9a48000bc0 tx=0x7f9a5805fa60).stop 2020-05-18T21:30:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.749+0000 7f9a5dd14700 1 -- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a580b2860 msgr2=0x7f9a58149500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.749+0000 7f9a5dd14700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a580b2860 0x7f9a58149500 secure :-1 s=READY pgs=589 cs=0 l=1 rx=0x7f9a40001110 tx=0x7f9a40002ea0).stop 2020-05-18T21:30:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.749+0000 7f9a5dd14700 1 -- 172.21.15.63:0/2306200125 shutdown_connections 2020-05-18T21:30:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.749+0000 7f9a5dd14700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a3c04f8b0 0x7f9a3c051d70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.749+0000 7f9a5dd14700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a5814e570 0x7f9a58149960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:04.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.749+0000 7f9a5dd14700 1 --2- 172.21.15.63:0/2306200125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a580b2860 0x7f9a58149500 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:04.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.749+0000 7f9a5dd14700 1 -- 172.21.15.63:0/2306200125 >> 172.21.15.63:0/2306200125 conn(0x7f9a580b83d0 msgr2=0x7f9a580b7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:04.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.749+0000 7f9a5dd14700 1 -- 172.21.15.63:0/2306200125 shutdown_connections 2020-05-18T21:30:04.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.749+0000 7f9a5dd14700 1 -- 172.21.15.63:0/2306200125 wait complete. 2020-05-18T21:30:04.773 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-05-18T21:30:04.774 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:30:04.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.881+0000 7f9794a9a700 1 Processor -- start 2020-05-18T21:30:04.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.881+0000 7f9794a9a700 1 -- start start 2020-05-18T21:30:04.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.881+0000 7f9794a9a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f979005ef00 0x7f9790149310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:04.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.881+0000 7f9794a9a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f97900b3540 0x7f9790145c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:04.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.881+0000 7f9794a9a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97901464c0 con 0x7f97900b3df0 2020-05-18T21:30:04.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.881+0000 7f9794a9a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9790146760 con 0x7f97900b3540 2020-05-18T21:30:04.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.881+0000 7f9794a9a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9790146a00 con 0x7f979005ef00 2020-05-18T21:30:04.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.881+0000 7f978ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f97900b3df0 0x7f97900613a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59134/0 (socket says 172.21.15.63:59134) 2020-05-18T21:30:04.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.881+0000 7f978ffff700 1 -- 172.21.15.63:0/4138799541 learned_addr learned my addr 172.21.15.63:0/4138799541 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:04.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.881+0000 7f978effd700 1 --2- 172.21.15.63:0/4138799541 >> v2:172.21.15.63:3300/0 conn(0x7f97900b3540 0x7f9790145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:04.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.881+0000 7f978f7fe700 1 --2- 172.21.15.63:0/4138799541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f979005ef00 0x7f9790149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:04.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.881+0000 7f978e7fc700 1 -- 172.21.15.63:0/4138799541 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213644595 0 0) 0x7f97901464c0 con 0x7f97900b3df0 2020-05-18T21:30:04.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f978e7fc700 1 -- 172.21.15.63:0/4138799541 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9774003270 con 0x7f97900b3df0 2020-05-18T21:30:04.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f978effd700 1 -- 172.21.15.63:0/4138799541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f979005ef00 msgr2=0x7f9790149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:04.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f978effd700 1 --2- 172.21.15.63:0/4138799541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f979005ef00 0x7f9790149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:04.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f978effd700 1 -- 172.21.15.63:0/4138799541 >> v1:172.21.15.63:6789/0 conn(0x7f97900b3df0 legacy=0x7f97900613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:04.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f978effd700 1 -- 172.21.15.63:0/4138799541 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979005f2e0 con 0x7f97900b3540 2020-05-18T21:30:04.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f978effd700 1 --2- 172.21.15.63:0/4138799541 >> v2:172.21.15.63:3300/0 conn(0x7f97900b3540 0x7f9790145c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9778002f70 tx=0x7f9778007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f978effd700 1 --2- 172.21.15.63:0/4138799541 >> v2:172.21.15.63:3300/0 conn(0x7f97900b3540 0x7f9790145c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9778002f70 tx=0x7f9778007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f978effd700 1 --2- 172.21.15.63:0/4138799541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97900b3540 0x7f9790145c90 secure :-1 s=READY pgs=820 cs=0 l=1 rx=0x7f9778002f70 tx=0x7f9778007a80).ready entity=mon.0 client_cookie=d4d372163883e8cd server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:04.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f978effd700 1 --2- 172.21.15.63:0/4138799541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97900b3540 0x7f9790145c90 secure :-1 s=THROTTLE_DONE pgs=820 cs=0 l=1 rx=0x7f9778002f70 tx=0x7f9778007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f978e7fc700 1 -- 172.21.15.63:0/4138799541 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9778008e80 con 0x7f97900b3540 2020-05-18T21:30:04.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f978effd700 1 --2- 172.21.15.63:0/4138799541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97900b3540 0x7f9790145c90 secure :-1 s=THROTTLE_DONE pgs=820 cs=0 l=1 rx=0x7f9778002f70 tx=0x7f9778007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f978effd700 1 --2- 172.21.15.63:0/4138799541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97900b3540 0x7f9790145c90 secure :-1 s=THROTTLE_DONE pgs=820 cs=0 l=1 rx=0x7f9778002f70 tx=0x7f9778007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f978e7fc700 1 -- 172.21.15.63:0/4138799541 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9778011540 con 0x7f97900b3540 2020-05-18T21:30:04.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f978e7fc700 1 -- 172.21.15.63:0/4138799541 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9778011960 con 0x7f97900b3540 2020-05-18T21:30:04.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f9794a9a700 1 -- 172.21.15.63:0/4138799541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97900b3540 msgr2=0x7f9790145c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:04.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f9794a9a700 1 --2- 172.21.15.63:0/4138799541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97900b3540 0x7f9790145c90 secure :-1 s=READY pgs=820 cs=0 l=1 rx=0x7f9778002f70 tx=0x7f9778007a80).stop 2020-05-18T21:30:04.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f9794a9a700 1 -- 172.21.15.63:0/4138799541 shutdown_connections 2020-05-18T21:30:04.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f9794a9a700 1 --2- 172.21.15.63:0/4138799541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97900b3540 0x7f9790145c90 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:04.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f9794a9a700 1 --2- 172.21.15.63:0/4138799541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f979005ef00 0x7f9790149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:04.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f9794a9a700 1 -- 172.21.15.63:0/4138799541 >> 172.21.15.63:0/4138799541 conn(0x7f97900b8b10 msgr2=0x7f97900b8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:04.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f9794a9a700 1 -- 172.21.15.63:0/4138799541 shutdown_connections 2020-05-18T21:30:04.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f9794a9a700 1 -- 172.21.15.63:0/4138799541 wait complete. 2020-05-18T21:30:04.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f9794a9a700 1 Processor -- start 2020-05-18T21:30:04.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f9794a9a700 1 -- start start 2020-05-18T21:30:04.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f9794a9a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f97900b3df0 0x7f979009d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:04.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f9794a9a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979009a050 con 0x7f979005ef00 2020-05-18T21:30:04.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f9794a9a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979009a2f0 con 0x7f97900b3540 2020-05-18T21:30:04.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f9794a9a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9790099e60 con 0x7f97900b3df0 2020-05-18T21:30:04.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f978ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f97900b3df0 0x7f979009d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:04.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f978f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f979005ef00 0x7f9790099750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59140/0 (socket says 172.21.15.63:59140) 2020-05-18T21:30:04.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f978ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f97900b3df0 0x7f979009d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56956/0 (socket says 172.21.15.63:56956) 2020-05-18T21:30:04.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.885+0000 7f978f7fe700 1 -- 172.21.15.63:0/3286197698 learned_addr learned my addr 172.21.15.63:0/3286197698 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:04.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f978ffff700 1 -- 172.21.15.63:0/3286197698 >> v1:172.21.15.155:6789/0 conn(0x7f97900b3540 legacy=0x7f97900b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:04.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f978cff9700 1 -- 172.21.15.63:0/3286197698 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909878668 0 0) 0x7f979009a2f0 con 0x7f97900b3540 2020-05-18T21:30:04.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f978ffff700 1 -- 172.21.15.63:0/3286197698 >> v1:172.21.15.63:6789/0 conn(0x7f979005ef00 legacy=0x7f9790099750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:04.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f978ffff700 1 -- 172.21.15.63:0/3286197698 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979009a590 con 0x7f97900b3df0 2020-05-18T21:30:04.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f978ffff700 1 --2- 172.21.15.63:0/3286197698 >> v2:172.21.15.63:3300/0 conn(0x7f97900b3df0 0x7f979009d000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f97880032f0 tx=0x7f9780010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f978ffff700 1 --2- 172.21.15.63:0/3286197698 >> v2:172.21.15.63:3300/0 conn(0x7f97900b3df0 0x7f979009d000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f97880032f0 tx=0x7f9780010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f978ffff700 1 --2- 172.21.15.63:0/3286197698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97900b3df0 0x7f979009d000 secure :-1 s=READY pgs=822 cs=0 l=1 rx=0x7f97880032f0 tx=0x7f9780010960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:04.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f978ffff700 1 --2- 172.21.15.63:0/3286197698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97900b3df0 0x7f979009d000 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7f97880032f0 tx=0x7f9780010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f978ffff700 1 --2- 172.21.15.63:0/3286197698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97900b3df0 0x7f979009d000 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7f97880032f0 tx=0x7f9780010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f978ffff700 1 --2- 172.21.15.63:0/3286197698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97900b3df0 0x7f979009d000 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7f97880032f0 tx=0x7f9780010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f978cff9700 1 -- 172.21.15.63:0/3286197698 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9780005d00 con 0x7f97900b3df0 2020-05-18T21:30:04.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f978cff9700 1 -- 172.21.15.63:0/3286197698 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9780005e60 con 0x7f97900b3df0 2020-05-18T21:30:04.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f9794a9a700 1 -- 172.21.15.63:0/3286197698 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97900b0ac0 con 0x7f97900b3df0 2020-05-18T21:30:04.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f978cff9700 1 -- 172.21.15.63:0/3286197698 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97800062c0 con 0x7f97900b3df0 2020-05-18T21:30:04.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f9794a9a700 1 -- 172.21.15.63:0/3286197698 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979009e720 con 0x7f97900b3df0 2020-05-18T21:30:04.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f9794a9a700 1 -- 172.21.15.63:0/3286197698 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979009a720 con 0x7f97900b3df0 2020-05-18T21:30:04.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f978ffff700 1 --2- 172.21.15.63:0/3286197698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97900b3df0 0x7f979009d000 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7f97880032f0 tx=0x7f9780010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f978cff9700 1 -- 172.21.15.63:0/3286197698 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9780006530 con 0x7f97900b3df0 2020-05-18T21:30:04.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f978ffff700 1 --2- 172.21.15.63:0/3286197698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97900b3df0 0x7f979009d000 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7f97880032f0 tx=0x7f9780010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f978cff9700 1 --2- 172.21.15.63:0/3286197698 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f976804f8d0 0x7f9768051d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:04.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f978cff9700 1 -- 172.21.15.63:0/3286197698 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f97800090c0 con 0x7f97900b3df0 2020-05-18T21:30:04.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.889+0000 7f978f7fe700 1 --2- 172.21.15.63:0/3286197698 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f976804f8d0 0x7f9768051d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:04.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.893+0000 7f978f7fe700 1 --2- 172.21.15.63:0/3286197698 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f976804f8d0 0x7f9768051d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9788008360 tx=0x7f9788009450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.893+0000 7f978f7fe700 1 --2- 172.21.15.63:0/3286197698 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f976804f8d0 0x7f9768051d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9788008360 tx=0x7f9788009450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.893+0000 7f978f7fe700 1 --2- 172.21.15.63:0/3286197698 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f976804f8d0 0x7f9768051d90 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7f9788008360 tx=0x7f9788009450).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:04.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.897+0000 7f978ffff700 1 --2- 172.21.15.63:0/3286197698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97900b3df0 0x7f979009d000 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7f97880032f0 tx=0x7f9780010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:04.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:04.897+0000 7f978cff9700 1 -- 172.21.15.63:0/3286197698 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f978003e0e0 con 0x7f97900b3df0 2020-05-18T21:30:05.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.013+0000 7f9794a9a700 1 -- 172.21.15.63:0/3286197698 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f97900569e0 con 0x7f97900b3df0 2020-05-18T21:30:05.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.013+0000 7f978ffff700 1 --2- 172.21.15.63:0/3286197698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97900b3df0 0x7f979009d000 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7f97880032f0 tx=0x7f9780010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.013+0000 7f978cff9700 1 -- 172.21.15.63:0/3286197698 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v69) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9780041700 con 0x7f97900b3df0 2020-05-18T21:30:05.020 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:30:05.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.017+0000 7f9794a9a700 1 -- 172.21.15.63:0/3286197698 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f976804f8d0 msgr2=0x7f9768051d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:05.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.017+0000 7f9794a9a700 1 --2- 172.21.15.63:0/3286197698 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f976804f8d0 0x7f9768051d90 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7f9788008360 tx=0x7f9788009450).stop 2020-05-18T21:30:05.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.017+0000 7f9794a9a700 1 -- 172.21.15.63:0/3286197698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97900b3df0 msgr2=0x7f979009d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:05.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.017+0000 7f9794a9a700 1 --2- 172.21.15.63:0/3286197698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97900b3df0 0x7f979009d000 secure :-1 s=READY pgs=822 cs=0 l=1 rx=0x7f97880032f0 tx=0x7f9780010960).stop 2020-05-18T21:30:05.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.017+0000 7f9794a9a700 1 -- 172.21.15.63:0/3286197698 shutdown_connections 2020-05-18T21:30:05.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.017+0000 7f9794a9a700 1 --2- 172.21.15.63:0/3286197698 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f976804f8d0 0x7f9768051d90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:05.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.017+0000 7f9794a9a700 1 --2- 172.21.15.63:0/3286197698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97900b3df0 0x7f979009d000 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:05.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.017+0000 7f9794a9a700 1 -- 172.21.15.63:0/3286197698 >> 172.21.15.63:0/3286197698 conn(0x7f97900b8b10 msgr2=0x7f97900b55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:05.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.017+0000 7f9794a9a700 1 -- 172.21.15.63:0/3286197698 shutdown_connections 2020-05-18T21:30:05.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.017+0000 7f9794a9a700 1 -- 172.21.15.63:0/3286197698 wait complete. 2020-05-18T21:30:05.037 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:30:05.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.141+0000 7f6291613700 1 Processor -- start 2020-05-18T21:30:05.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.141+0000 7f6291613700 1 -- start start 2020-05-18T21:30:05.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.141+0000 7f6291613700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f628c06a630 0x7f628c0adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:05.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.141+0000 7f6291613700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f628c0b4450 0x7f628c0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:05.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.141+0000 7f6291613700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f628c0b3790 con 0x7f628c149d50 2020-05-18T21:30:05.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.141+0000 7f6291613700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628c0b3f30 con 0x7f628c0b4450 2020-05-18T21:30:05.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.141+0000 7f6291613700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628c0b39f0 con 0x7f628c06a630 2020-05-18T21:30:05.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.141+0000 7f628bfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f628c149d50 0x7f628c0ad3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59148/0 (socket says 172.21.15.63:59148) 2020-05-18T21:30:05.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.141+0000 7f628bfff700 1 -- 172.21.15.63:0/3925864045 learned_addr learned my addr 172.21.15.63:0/3925864045 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:05.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.141+0000 7f628b7fe700 1 --2- 172.21.15.63:0/3925864045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f628c06a630 0x7f628c0adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:05.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.141+0000 7f6290e12700 1 --2- 172.21.15.63:0/3925864045 >> v2:172.21.15.155:3300/0 conn(0x7f628c0b4450 0x7f628c0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:05.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.141+0000 7f628affd700 1 -- 172.21.15.63:0/3925864045 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2027181908 0 0) 0x7f628c0b3790 con 0x7f628c149d50 2020-05-18T21:30:05.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.141+0000 7f628affd700 1 -- 172.21.15.63:0/3925864045 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6270003270 con 0x7f628c149d50 2020-05-18T21:30:05.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.141+0000 7f628b7fe700 1 -- 172.21.15.63:0/3925864045 >> v2:172.21.15.155:3300/0 conn(0x7f628c0b4450 msgr2=0x7f628c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:05.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.141+0000 7f628b7fe700 1 --2- 172.21.15.63:0/3925864045 >> v2:172.21.15.155:3300/0 conn(0x7f628c0b4450 0x7f628c0b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:05.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.141+0000 7f628b7fe700 1 -- 172.21.15.63:0/3925864045 >> v1:172.21.15.63:6789/0 conn(0x7f628c149d50 legacy=0x7f628c0ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:05.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.141+0000 7f628b7fe700 1 -- 172.21.15.63:0/3925864045 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c0b3c90 con 0x7f628c06a630 2020-05-18T21:30:05.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.145+0000 7f628b7fe700 1 --2- 172.21.15.63:0/3925864045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f628c06a630 0x7f628c0adb00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6274002f70 tx=0x7f6274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.145+0000 7f628b7fe700 1 --2- 172.21.15.63:0/3925864045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f628c06a630 0x7f628c0adb00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6274002f70 tx=0x7f6274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.145+0000 7f628b7fe700 1 --2- 172.21.15.63:0/3925864045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f628c06a630 0x7f628c0adb00 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f6274002f70 tx=0x7f6274007a80).ready entity=mon.2 client_cookie=6528f868b4f6f7b7 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:05.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.145+0000 7f628b7fe700 1 --2- 172.21.15.63:0/3925864045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f628c06a630 0x7f628c0adb00 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f6274002f70 tx=0x7f6274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.145+0000 7f628affd700 1 -- 172.21.15.63:0/3925864045 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6274008d70 con 0x7f628c06a630 2020-05-18T21:30:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.145+0000 7f628b7fe700 1 --2- 172.21.15.63:0/3925864045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f628c06a630 0x7f628c0adb00 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f6274002f70 tx=0x7f6274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.145+0000 7f628affd700 1 -- 172.21.15.63:0/3925864045 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62740116e0 con 0x7f628c06a630 2020-05-18T21:30:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.145+0000 7f628b7fe700 1 --2- 172.21.15.63:0/3925864045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f628c06a630 0x7f628c0adb00 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f6274002f70 tx=0x7f6274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.145+0000 7f628affd700 1 -- 172.21.15.63:0/3925864045 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6274011b00 con 0x7f628c06a630 2020-05-18T21:30:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.145+0000 7f6291613700 1 -- 172.21.15.63:0/3925864045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f628c06a630 msgr2=0x7f628c0adb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.145+0000 7f6291613700 1 --2- 172.21.15.63:0/3925864045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f628c06a630 0x7f628c0adb00 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f6274002f70 tx=0x7f6274007a80).stop 2020-05-18T21:30:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.145+0000 7f6291613700 1 -- 172.21.15.63:0/3925864045 shutdown_connections 2020-05-18T21:30:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.145+0000 7f6291613700 1 --2- 172.21.15.63:0/3925864045 >> v2:172.21.15.155:3300/0 conn(0x7f628c0b4450 0x7f628c0b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.145+0000 7f6291613700 1 --2- 172.21.15.63:0/3925864045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f628c06a630 0x7f628c0adb00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.145+0000 7f6291613700 1 -- 172.21.15.63:0/3925864045 >> 172.21.15.63:0/3925864045 conn(0x7f628c05fb90 msgr2=0x7f628c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.145+0000 7f6291613700 1 -- 172.21.15.63:0/3925864045 shutdown_connections 2020-05-18T21:30:05.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.145+0000 7f6291613700 1 -- 172.21.15.63:0/3925864045 wait complete. 2020-05-18T21:30:05.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.149+0000 7f6291613700 1 Processor -- start 2020-05-18T21:30:05.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.149+0000 7f6291613700 1 -- start start 2020-05-18T21:30:05.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.149+0000 7f6291613700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f628c0b4450 0x7f628c0b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:05.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.149+0000 7f6291613700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f628c14cc50 con 0x7f628c149d50 2020-05-18T21:30:05.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.149+0000 7f6291613700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f628c14cef0 con 0x7f628c06a630 2020-05-18T21:30:05.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.149+0000 7f6291613700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628c14c980 con 0x7f628c0b4450 2020-05-18T21:30:05.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.149+0000 7f6290e12700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f628c149d50 0x7f628c146220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59156/0 (socket says 172.21.15.63:59156) 2020-05-18T21:30:05.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.149+0000 7f6290e12700 1 -- 172.21.15.63:0/2431437880 learned_addr learned my addr 172.21.15.63:0/2431437880 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:05.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.149+0000 7f628b7fe700 1 --2- 172.21.15.63:0/2431437880 >> v2:172.21.15.155:3300/0 conn(0x7f628c0b4450 0x7f628c0b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:05.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.149+0000 7f62897fa700 1 -- 172.21.15.63:0/2431437880 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3575075627 0 0) 0x7f628c14cc50 con 0x7f628c149d50 2020-05-18T21:30:05.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.149+0000 7f62897fa700 1 -- 172.21.15.63:0/2431437880 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6264002fe0 con 0x7f628c149d50 2020-05-18T21:30:05.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.149+0000 7f628b7fe700 1 -- 172.21.15.63:0/2431437880 >> v1:172.21.15.155:6789/0 conn(0x7f628c06a630 legacy=0x7f628c061ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:05.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.149+0000 7f628b7fe700 1 -- 172.21.15.63:0/2431437880 >> v1:172.21.15.63:6789/0 conn(0x7f628c149d50 legacy=0x7f628c146220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:05.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.149+0000 7f628b7fe700 1 -- 172.21.15.63:0/2431437880 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c0623b0 con 0x7f628c0b4450 2020-05-18T21:30:05.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.149+0000 7f628b7fe700 1 --2- 172.21.15.63:0/2431437880 >> v2:172.21.15.155:3300/0 conn(0x7f628c0b4450 0x7f628c0b1b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6274002f70 tx=0x7f6274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.149+0000 7f628b7fe700 1 --2- 172.21.15.63:0/2431437880 >> v2:172.21.15.155:3300/0 conn(0x7f628c0b4450 0x7f628c0b1b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6274002f70 tx=0x7f6274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.149+0000 7f628b7fe700 1 --2- 172.21.15.63:0/2431437880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f628c0b4450 0x7f628c0b1b60 secure :-1 s=READY pgs=592 cs=0 l=1 rx=0x7f6274002f70 tx=0x7f6274007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:05.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.149+0000 7f628b7fe700 1 --2- 172.21.15.63:0/2431437880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f628c0b4450 0x7f628c0b1b60 secure :-1 s=THROTTLE_DONE pgs=592 cs=0 l=1 rx=0x7f6274002f70 tx=0x7f6274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.149+0000 7f62897fa700 1 -- 172.21.15.63:0/2431437880 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f627400f6c0 con 0x7f628c0b4450 2020-05-18T21:30:05.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.153+0000 7f628b7fe700 1 --2- 172.21.15.63:0/2431437880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f628c0b4450 0x7f628c0b1b60 secure :-1 s=THROTTLE_DONE pgs=592 cs=0 l=1 rx=0x7f6274002f70 tx=0x7f6274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.153+0000 7f628b7fe700 1 --2- 172.21.15.63:0/2431437880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f628c0b4450 0x7f628c0b1b60 secure :-1 s=THROTTLE_DONE pgs=592 cs=0 l=1 rx=0x7f6274002f70 tx=0x7f6274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.153+0000 7f62897fa700 1 -- 172.21.15.63:0/2431437880 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627400f820 con 0x7f628c0b4450 2020-05-18T21:30:05.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.153+0000 7f6291613700 1 -- 172.21.15.63:0/2431437880 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f628c146930 con 0x7f628c0b4450 2020-05-18T21:30:05.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.153+0000 7f62897fa700 1 -- 172.21.15.63:0/2431437880 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6274007360 con 0x7f628c0b4450 2020-05-18T21:30:05.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.153+0000 7f6291613700 1 -- 172.21.15.63:0/2431437880 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628c0b07b0 con 0x7f628c0b4450 2020-05-18T21:30:05.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.153+0000 7f628b7fe700 1 --2- 172.21.15.63:0/2431437880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f628c0b4450 0x7f628c0b1b60 secure :-1 s=THROTTLE_DONE pgs=592 cs=0 l=1 rx=0x7f6274002f70 tx=0x7f6274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.153+0000 7f6291613700 1 -- 172.21.15.63:0/2431437880 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628c14cac0 con 0x7f628c0b4450 2020-05-18T21:30:05.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.153+0000 7f62897fa700 1 -- 172.21.15.63:0/2431437880 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6274005700 con 0x7f628c0b4450 2020-05-18T21:30:05.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.153+0000 7f628b7fe700 1 --2- 172.21.15.63:0/2431437880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f628c0b4450 0x7f628c0b1b60 secure :-1 s=THROTTLE_DONE pgs=592 cs=0 l=1 rx=0x7f6274002f70 tx=0x7f6274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.153+0000 7f62897fa700 1 --2- 172.21.15.63:0/2431437880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f626404fd80 0x7f6264052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:05.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.153+0000 7f62897fa700 1 -- 172.21.15.63:0/2431437880 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6274064670 con 0x7f628c0b4450 2020-05-18T21:30:05.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.153+0000 7f628bfff700 1 --2- 172.21.15.63:0/2431437880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f626404fd80 0x7f6264052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:05.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.153+0000 7f628bfff700 1 --2- 172.21.15.63:0/2431437880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f626404fd80 0x7f6264052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f628c14f030 tx=0x7f627c0014b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.157+0000 7f628bfff700 1 --2- 172.21.15.63:0/2431437880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f626404fd80 0x7f6264052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f628c14f030 tx=0x7f627c0014b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.157+0000 7f628bfff700 1 --2- 172.21.15.63:0/2431437880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f626404fd80 0x7f6264052240 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7f628c14f030 tx=0x7f627c0014b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:05.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.161+0000 7f628b7fe700 1 --2- 172.21.15.63:0/2431437880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f628c0b4450 0x7f628c0b1b60 secure :-1 s=THROTTLE_DONE pgs=592 cs=0 l=1 rx=0x7f6274002f70 tx=0x7f6274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.161+0000 7f62897fa700 1 -- 172.21.15.63:0/2431437880 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f627403eae0 con 0x7f628c0b4450 2020-05-18T21:30:05.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.281+0000 7f6291613700 1 -- 172.21.15.63:0/2431437880 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f628c0af340 con 0x7f628c0b4450 2020-05-18T21:30:05.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.281+0000 7f628b7fe700 1 --2- 172.21.15.63:0/2431437880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f628c0b4450 0x7f628c0b1b60 secure :-1 s=THROTTLE_DONE pgs=592 cs=0 l=1 rx=0x7f6274002f70 tx=0x7f6274007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.281+0000 7f62897fa700 1 -- 172.21.15.63:0/2431437880 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v69) v1 ==== 92+0+10 (secure 0 0 0) 0x7f628c0af340 con 0x7f628c0b4450 2020-05-18T21:30:05.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.281+0000 7f6291613700 1 -- 172.21.15.63:0/2431437880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f626404fd80 msgr2=0x7f6264052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:05.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.281+0000 7f6291613700 1 --2- 172.21.15.63:0/2431437880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f626404fd80 0x7f6264052240 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7f628c14f030 tx=0x7f627c0014b0).stop 2020-05-18T21:30:05.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.281+0000 7f6291613700 1 -- 172.21.15.63:0/2431437880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f628c0b4450 msgr2=0x7f628c0b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:05.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.281+0000 7f6291613700 1 --2- 172.21.15.63:0/2431437880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f628c0b4450 0x7f628c0b1b60 secure :-1 s=READY pgs=592 cs=0 l=1 rx=0x7f6274002f70 tx=0x7f6274007a80).stop 2020-05-18T21:30:05.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.281+0000 7f6291613700 1 -- 172.21.15.63:0/2431437880 shutdown_connections 2020-05-18T21:30:05.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.281+0000 7f6291613700 1 --2- 172.21.15.63:0/2431437880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f626404fd80 0x7f6264052240 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:05.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.281+0000 7f6291613700 1 --2- 172.21.15.63:0/2431437880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f628c0b4450 0x7f628c0b1b60 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:05.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.281+0000 7f6291613700 1 -- 172.21.15.63:0/2431437880 >> 172.21.15.63:0/2431437880 conn(0x7f628c05fb90 msgr2=0x7f628c05be30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:05.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.281+0000 7f6291613700 1 -- 172.21.15.63:0/2431437880 shutdown_connections 2020-05-18T21:30:05.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.281+0000 7f6291613700 1 -- 172.21.15.63:0/2431437880 wait complete. 2020-05-18T21:30:05.750 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:30:05.751 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-05-18T21:30:05.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.857+0000 7f372752f700 1 Processor -- start 2020-05-18T21:30:05.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.857+0000 7f372752f700 1 -- start start 2020-05-18T21:30:05.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f372752f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f372005f110 0x7f37200b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:05.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f372752f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3720064fd0 0x7f372014d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:05.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f372752f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f372014a330 con 0x7f372014aa70 2020-05-18T21:30:05.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f372752f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f372014a140 con 0x7f3720064fd0 2020-05-18T21:30:05.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f372752f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3720065460 con 0x7f372005f110 2020-05-18T21:30:05.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f3726d2e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3720064fd0 0x7f372014d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:05.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f3726d2e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3720064fd0 0x7f372014d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56976/0 (socket says 172.21.15.63:56976) 2020-05-18T21:30:05.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f3726d2e700 1 -- 172.21.15.63:0/757112348 learned_addr learned my addr 172.21.15.63:0/757112348 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:05.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f372652d700 1 --2- 172.21.15.63:0/757112348 >> v2:172.21.15.155:3300/0 conn(0x7f372005f110 0x7f37200b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:05.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f3726d2e700 1 -- 172.21.15.63:0/757112348 >> v2:172.21.15.155:3300/0 conn(0x7f372005f110 msgr2=0x7f37200b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:05.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f3726d2e700 1 --2- 172.21.15.63:0/757112348 >> v2:172.21.15.155:3300/0 conn(0x7f372005f110 0x7f37200b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:05.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f3726d2e700 1 -- 172.21.15.63:0/757112348 >> v1:172.21.15.155:6789/0 conn(0x7f372014aa70 legacy=0x7f37200648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:05.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f3726d2e700 1 -- 172.21.15.63:0/757112348 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372014a5d0 con 0x7f3720064fd0 2020-05-18T21:30:05.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f3726d2e700 1 --2- 172.21.15.63:0/757112348 >> v2:172.21.15.63:3300/0 conn(0x7f3720064fd0 0x7f372014d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3720063f10 tx=0x7f3710008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f3726d2e700 1 --2- 172.21.15.63:0/757112348 >> v2:172.21.15.63:3300/0 conn(0x7f3720064fd0 0x7f372014d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3720063f10 tx=0x7f3710008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f3726d2e700 1 --2- 172.21.15.63:0/757112348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3720064fd0 0x7f372014d710 secure :-1 s=READY pgs=825 cs=0 l=1 rx=0x7f3720063f10 tx=0x7f3710008920).ready entity=mon.0 client_cookie=7644ec1574bd0046 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:05.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f3726d2e700 1 --2- 172.21.15.63:0/757112348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3720064fd0 0x7f372014d710 secure :-1 s=THROTTLE_DONE pgs=825 cs=0 l=1 rx=0x7f3720063f10 tx=0x7f3710008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f372552b700 1 -- 172.21.15.63:0/757112348 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3710011760 con 0x7f3720064fd0 2020-05-18T21:30:05.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f3726d2e700 1 --2- 172.21.15.63:0/757112348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3720064fd0 0x7f372014d710 secure :-1 s=THROTTLE_DONE pgs=825 cs=0 l=1 rx=0x7f3720063f10 tx=0x7f3710008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f3726d2e700 1 --2- 172.21.15.63:0/757112348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3720064fd0 0x7f372014d710 secure :-1 s=THROTTLE_DONE pgs=825 cs=0 l=1 rx=0x7f3720063f10 tx=0x7f3710008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f372552b700 1 -- 172.21.15.63:0/757112348 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37100118c0 con 0x7f3720064fd0 2020-05-18T21:30:05.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f372552b700 1 -- 172.21.15.63:0/757112348 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3710011ce0 con 0x7f3720064fd0 2020-05-18T21:30:05.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f372752f700 1 -- 172.21.15.63:0/757112348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3720064fd0 msgr2=0x7f372014d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:05.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f372752f700 1 --2- 172.21.15.63:0/757112348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3720064fd0 0x7f372014d710 secure :-1 s=READY pgs=825 cs=0 l=1 rx=0x7f3720063f10 tx=0x7f3710008920).stop 2020-05-18T21:30:05.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f372752f700 1 -- 172.21.15.63:0/757112348 shutdown_connections 2020-05-18T21:30:05.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f372752f700 1 --2- 172.21.15.63:0/757112348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3720064fd0 0x7f372014d710 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:05.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f372752f700 1 --2- 172.21.15.63:0/757112348 >> v2:172.21.15.155:3300/0 conn(0x7f372005f110 0x7f37200b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:05.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f372752f700 1 -- 172.21.15.63:0/757112348 >> 172.21.15.63:0/757112348 conn(0x7f3720069fc0 msgr2=0x7f372006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:05.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f372752f700 1 -- 172.21.15.63:0/757112348 shutdown_connections 2020-05-18T21:30:05.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f372752f700 1 -- 172.21.15.63:0/757112348 wait complete. 2020-05-18T21:30:05.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.861+0000 7f372752f700 1 Processor -- start 2020-05-18T21:30:05.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f372752f700 1 -- start start 2020-05-18T21:30:05.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f372752f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3720064fd0 0x7f3720141e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:05.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f372752f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f372014aa70 0x7f372015ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:05.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f372752f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3720146e20 con 0x7f372005f110 2020-05-18T21:30:05.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f372752f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37201417e0 con 0x7f3720064fd0 2020-05-18T21:30:05.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f372752f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37200b8110 con 0x7f372014aa70 2020-05-18T21:30:05.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f3725d2c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3720064fd0 0x7f3720141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:05.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f3726d2e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f372014aa70 0x7f372015ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:05.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f3725d2c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3720064fd0 0x7f3720141e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56984/0 (socket says 172.21.15.63:56984) 2020-05-18T21:30:05.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f3725d2c700 1 -- 172.21.15.63:0/674950448 learned_addr learned my addr 172.21.15.63:0/674950448 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:05.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f3725d2c700 1 -- 172.21.15.63:0/674950448 >> v2:172.21.15.155:3300/0 conn(0x7f372014aa70 msgr2=0x7f372015ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:05.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f3725d2c700 1 --2- 172.21.15.63:0/674950448 >> v2:172.21.15.155:3300/0 conn(0x7f372014aa70 0x7f372015ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:05.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f3725d2c700 1 -- 172.21.15.63:0/674950448 >> v1:172.21.15.155:6789/0 conn(0x7f372005f110 legacy=0x7f3720156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:05.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f3725d2c700 1 -- 172.21.15.63:0/674950448 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3720147560 con 0x7f3720064fd0 2020-05-18T21:30:05.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f3726d2e700 1 --2- 172.21.15.63:0/674950448 >> v2:172.21.15.155:3300/0 conn(0x7f372014aa70 0x7f372015ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:30:05.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f3725d2c700 1 --2- 172.21.15.63:0/674950448 >> v2:172.21.15.63:3300/0 conn(0x7f3720064fd0 0x7f3720141e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3720060a90 tx=0x7f371400c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f3725d2c700 1 --2- 172.21.15.63:0/674950448 >> v2:172.21.15.63:3300/0 conn(0x7f3720064fd0 0x7f3720141e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3720060a90 tx=0x7f371400c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f3725d2c700 1 --2- 172.21.15.63:0/674950448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3720064fd0 0x7f3720141e40 secure :-1 s=READY pgs=826 cs=0 l=1 rx=0x7f3720060a90 tx=0x7f371400c480).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:05.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f3725d2c700 1 --2- 172.21.15.63:0/674950448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3720064fd0 0x7f3720141e40 secure :-1 s=THROTTLE_DONE pgs=826 cs=0 l=1 rx=0x7f3720060a90 tx=0x7f371400c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f3725d2c700 1 --2- 172.21.15.63:0/674950448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3720064fd0 0x7f3720141e40 secure :-1 s=THROTTLE_DONE pgs=826 cs=0 l=1 rx=0x7f3720060a90 tx=0x7f371400c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f371f7fe700 1 -- 172.21.15.63:0/674950448 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f371400cc40 con 0x7f3720064fd0 2020-05-18T21:30:05.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f3725d2c700 1 --2- 172.21.15.63:0/674950448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3720064fd0 0x7f3720141e40 secure :-1 s=THROTTLE_DONE pgs=826 cs=0 l=1 rx=0x7f3720060a90 tx=0x7f371400c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f371f7fe700 1 -- 172.21.15.63:0/674950448 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371400cda0 con 0x7f3720064fd0 2020-05-18T21:30:05.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f372752f700 1 -- 172.21.15.63:0/674950448 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3720157210 con 0x7f3720064fd0 2020-05-18T21:30:05.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f371f7fe700 1 -- 172.21.15.63:0/674950448 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3714012260 con 0x7f3720064fd0 2020-05-18T21:30:05.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.865+0000 7f372752f700 1 -- 172.21.15.63:0/674950448 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372015b490 con 0x7f3720064fd0 2020-05-18T21:30:05.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.869+0000 7f3725d2c700 1 --2- 172.21.15.63:0/674950448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3720064fd0 0x7f3720141e40 secure :-1 s=THROTTLE_DONE pgs=826 cs=0 l=1 rx=0x7f3720060a90 tx=0x7f371400c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.869+0000 7f372752f700 1 -- 172.21.15.63:0/674950448 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37200569e0 con 0x7f3720064fd0 2020-05-18T21:30:05.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.869+0000 7f371f7fe700 1 -- 172.21.15.63:0/674950448 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3714006520 con 0x7f3720064fd0 2020-05-18T21:30:05.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.869+0000 7f3725d2c700 1 --2- 172.21.15.63:0/674950448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3720064fd0 0x7f3720141e40 secure :-1 s=THROTTLE_DONE pgs=826 cs=0 l=1 rx=0x7f3720060a90 tx=0x7f371400c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.869+0000 7f371f7fe700 1 --2- 172.21.15.63:0/674950448 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f370004fa30 0x7f3700051ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:05.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.869+0000 7f371f7fe700 1 -- 172.21.15.63:0/674950448 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f37140637d0 con 0x7f3720064fd0 2020-05-18T21:30:05.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.869+0000 7f372652d700 1 --2- 172.21.15.63:0/674950448 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f370004fa30 0x7f3700051ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:05.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.869+0000 7f372652d700 1 --2- 172.21.15.63:0/674950448 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f370004fa30 0x7f3700051ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3720142ad0 tx=0x7f37180090d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.869+0000 7f372652d700 1 --2- 172.21.15.63:0/674950448 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f370004fa30 0x7f3700051ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3720142ad0 tx=0x7f37180090d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.869+0000 7f372652d700 1 --2- 172.21.15.63:0/674950448 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f370004fa30 0x7f3700051ef0 secure :-1 s=READY pgs=335 cs=0 l=1 rx=0x7f3720142ad0 tx=0x7f37180090d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:05.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.873+0000 7f3725d2c700 1 --2- 172.21.15.63:0/674950448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3720064fd0 0x7f3720141e40 secure :-1 s=THROTTLE_DONE pgs=826 cs=0 l=1 rx=0x7f3720060a90 tx=0x7f371400c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:05.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.873+0000 7f371f7fe700 1 -- 172.21.15.63:0/674950448 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f371403db60 con 0x7f3720064fd0 2020-05-18T21:30:05.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.993+0000 7f372752f700 1 -- 172.21.15.63:0/674950448 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f37200625f0 con 0x7f3720064fd0 2020-05-18T21:30:06.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.993+0000 7f3725d2c700 1 --2- 172.21.15.63:0/674950448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3720064fd0 0x7f3720141e40 secure :-1 s=THROTTLE_DONE pgs=826 cs=0 l=1 rx=0x7f3720060a90 tx=0x7f371400c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:06.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.993+0000 7f371f7fe700 1 -- 172.21.15.63:0/674950448 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) v1 ==== 84+0+143 (secure 0 0 0) 0x7f3714041180 con 0x7f3720064fd0 2020-05-18T21:30:06.000 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:06.001 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:30:06.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:06.001 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2020-05-18T21:30:06.001 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "device_health_metrics" 2020-05-18T21:30:06.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:06.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:06.002 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 2, 2020-05-18T21:30:06.002 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "rbd" 2020-05-18T21:30:06.002 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:06.002 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:30:06.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.997+0000 7f372752f700 1 -- 172.21.15.63:0/674950448 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f370004fa30 msgr2=0x7f3700051ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:06.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.997+0000 7f372752f700 1 --2- 172.21.15.63:0/674950448 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f370004fa30 0x7f3700051ef0 secure :-1 s=READY pgs=335 cs=0 l=1 rx=0x7f3720142ad0 tx=0x7f37180090d0).stop 2020-05-18T21:30:06.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.997+0000 7f372752f700 1 -- 172.21.15.63:0/674950448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3720064fd0 msgr2=0x7f3720141e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:06.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.997+0000 7f372752f700 1 --2- 172.21.15.63:0/674950448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3720064fd0 0x7f3720141e40 secure :-1 s=READY pgs=826 cs=0 l=1 rx=0x7f3720060a90 tx=0x7f371400c480).stop 2020-05-18T21:30:06.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.997+0000 7f372752f700 1 -- 172.21.15.63:0/674950448 shutdown_connections 2020-05-18T21:30:06.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.997+0000 7f372752f700 1 --2- 172.21.15.63:0/674950448 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f370004fa30 0x7f3700051ef0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:06.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.997+0000 7f372752f700 1 --2- 172.21.15.63:0/674950448 >> v2:172.21.15.155:3300/0 conn(0x7f372014aa70 0x7f372015ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:06.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.997+0000 7f372752f700 1 --2- 172.21.15.63:0/674950448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3720064fd0 0x7f3720141e40 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:06.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.997+0000 7f372752f700 1 -- 172.21.15.63:0/674950448 >> 172.21.15.63:0/674950448 conn(0x7f3720069fc0 msgr2=0x7f372014c620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:06.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.997+0000 7f372752f700 1 -- 172.21.15.63:0/674950448 shutdown_connections 2020-05-18T21:30:06.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:05.997+0000 7f372752f700 1 -- 172.21.15.63:0/674950448 wait complete. 2020-05-18T21:30:06.013 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-05-18T21:30:06.014 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-05-18T21:30:06.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.109+0000 7f6c4b59e700 1 Processor -- start 2020-05-18T21:30:06.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.109+0000 7f6c4b59e700 1 -- start start 2020-05-18T21:30:06.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4c143630 0x7f6c4c060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:06.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6c4c145e30 0x7f6c4c12e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:06.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4b59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c4c146420 con 0x7f6c4c0bc8d0 2020-05-18T21:30:06.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4b59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4c146e00 con 0x7f6c4c145e30 2020-05-18T21:30:06.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c1466c0 con 0x7f6c4c143630 2020-05-18T21:30:06.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4ad9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6c4c145e30 0x7f6c4c12e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:06.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4a59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6c4c0bc8d0 0x7f6c4c142f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59176/0 (socket says 172.21.15.63:59176) 2020-05-18T21:30:06.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4a59c700 1 -- 172.21.15.63:0/3959468101 learned_addr learned my addr 172.21.15.63:0/3959468101 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:06.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4ad9d700 1 --2- 172.21.15.63:0/3959468101 >> v2:172.21.15.63:3300/0 conn(0x7f6c4c145e30 0x7f6c4c12e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56992/0 (socket says 172.21.15.63:56992) 2020-05-18T21:30:06.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c49d9b700 1 --2- 172.21.15.63:0/3959468101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4c143630 0x7f6c4c060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:06.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4ad9d700 1 -- 172.21.15.63:0/3959468101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4c143630 msgr2=0x7f6c4c060b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:06.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4ad9d700 1 --2- 172.21.15.63:0/3959468101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4c143630 0x7f6c4c060b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:06.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4ad9d700 1 -- 172.21.15.63:0/3959468101 >> v1:172.21.15.63:6789/0 conn(0x7f6c4c0bc8d0 legacy=0x7f6c4c142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:06.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4959a700 1 -- 172.21.15.63:0/3959468101 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036908761 0 0) 0x7f6c4c146420 con 0x7f6c4c0bc8d0 2020-05-18T21:30:06.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4ad9d700 1 -- 172.21.15.63:0/3959468101 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c146960 con 0x7f6c4c145e30 2020-05-18T21:30:06.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4ad9d700 1 --2- 172.21.15.63:0/3959468101 >> v2:172.21.15.63:3300/0 conn(0x7f6c4c145e30 0x7f6c4c12e770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6c440032f0 tx=0x7f6c44007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:06.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4ad9d700 1 --2- 172.21.15.63:0/3959468101 >> v2:172.21.15.63:3300/0 conn(0x7f6c4c145e30 0x7f6c4c12e770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6c440032f0 tx=0x7f6c44007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:06.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4ad9d700 1 --2- 172.21.15.63:0/3959468101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c4c145e30 0x7f6c4c12e770 secure :-1 s=READY pgs=828 cs=0 l=1 rx=0x7f6c440032f0 tx=0x7f6c44007e00).ready entity=mon.0 client_cookie=12eeda6c32d0bc4a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:06.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4ad9d700 1 --2- 172.21.15.63:0/3959468101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c4c145e30 0x7f6c4c12e770 secure :-1 s=THROTTLE_DONE pgs=828 cs=0 l=1 rx=0x7f6c440032f0 tx=0x7f6c44007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:06.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4959a700 1 -- 172.21.15.63:0/3959468101 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c44011e60 con 0x7f6c4c145e30 2020-05-18T21:30:06.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4ad9d700 1 --2- 172.21.15.63:0/3959468101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c4c145e30 0x7f6c4c12e770 secure :-1 s=THROTTLE_DONE pgs=828 cs=0 l=1 rx=0x7f6c440032f0 tx=0x7f6c44007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:06.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4ad9d700 1 --2- 172.21.15.63:0/3959468101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c4c145e30 0x7f6c4c12e770 secure :-1 s=THROTTLE_DONE pgs=828 cs=0 l=1 rx=0x7f6c440032f0 tx=0x7f6c44007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:06.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4959a700 1 -- 172.21.15.63:0/3959468101 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4400a180 con 0x7f6c4c145e30 2020-05-18T21:30:06.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4959a700 1 -- 172.21.15.63:0/3959468101 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c4400a520 con 0x7f6c4c145e30 2020-05-18T21:30:06.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4b59e700 1 -- 172.21.15.63:0/3959468101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c4c145e30 msgr2=0x7f6c4c12e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:06.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4b59e700 1 --2- 172.21.15.63:0/3959468101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c4c145e30 0x7f6c4c12e770 secure :-1 s=READY pgs=828 cs=0 l=1 rx=0x7f6c440032f0 tx=0x7f6c44007e00).stop 2020-05-18T21:30:06.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4b59e700 1 -- 172.21.15.63:0/3959468101 shutdown_connections 2020-05-18T21:30:06.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4b59e700 1 --2- 172.21.15.63:0/3959468101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c4c145e30 0x7f6c4c12e770 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:06.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4b59e700 1 --2- 172.21.15.63:0/3959468101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4c143630 0x7f6c4c060b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:06.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4b59e700 1 -- 172.21.15.63:0/3959468101 >> 172.21.15.63:0/3959468101 conn(0x7f6c4c05f3b0 msgr2=0x7f6c4c05f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:06.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4b59e700 1 -- 172.21.15.63:0/3959468101 shutdown_connections 2020-05-18T21:30:06.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.113+0000 7f6c4b59e700 1 -- 172.21.15.63:0/3959468101 wait complete. 2020-05-18T21:30:06.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4b59e700 1 Processor -- start 2020-05-18T21:30:06.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4b59e700 1 -- start start 2020-05-18T21:30:06.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6c4c0bc8d0 0x7f6c4c0af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:06.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4c143630 0x7f6c4c0aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:06.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4b59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c4c0ace80 con 0x7f6c4c145e30 2020-05-18T21:30:06.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4b59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4c153fb0 con 0x7f6c4c0bc8d0 2020-05-18T21:30:06.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c0ae950 con 0x7f6c4c143630 2020-05-18T21:30:06.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6c4c0bc8d0 0x7f6c4c0af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:06.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6c4c0bc8d0 0x7f6c4c0af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56994/0 (socket says 172.21.15.63:56994) 2020-05-18T21:30:06.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4a59c700 1 -- 172.21.15.63:0/2479570686 learned_addr learned my addr 172.21.15.63:0/2479570686 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:06.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c49d9b700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4c143630 0x7f6c4c0aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:06.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4a59c700 1 -- 172.21.15.63:0/2479570686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4c143630 msgr2=0x7f6c4c0aca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:06.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4a59c700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4c143630 0x7f6c4c0aca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:06.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4a59c700 1 -- 172.21.15.63:0/2479570686 >> v1:172.21.15.155:6789/0 conn(0x7f6c4c145e30 legacy=0x7f6c4c0b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:06.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4a59c700 1 -- 172.21.15.63:0/2479570686 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c0aebf0 con 0x7f6c4c0bc8d0 2020-05-18T21:30:06.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4a59c700 1 --2- 172.21.15.63:0/2479570686 >> v2:172.21.15.63:3300/0 conn(0x7f6c4c0bc8d0 0x7f6c4c0af330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6c40000bc0 tx=0x7f6c40010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:06.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4a59c700 1 --2- 172.21.15.63:0/2479570686 >> v2:172.21.15.63:3300/0 conn(0x7f6c4c0bc8d0 0x7f6c4c0af330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6c40000bc0 tx=0x7f6c40010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:06.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4a59c700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c4c0bc8d0 0x7f6c4c0af330 secure :-1 s=READY pgs=829 cs=0 l=1 rx=0x7f6c40000bc0 tx=0x7f6c40010a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:06.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4a59c700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c4c0bc8d0 0x7f6c4c0af330 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f6c40000bc0 tx=0x7f6c40010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:06.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c3b7fe700 1 -- 172.21.15.63:0/2479570686 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c40005ce0 con 0x7f6c4c0bc8d0 2020-05-18T21:30:06.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4a59c700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c4c0bc8d0 0x7f6c4c0af330 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f6c40000bc0 tx=0x7f6c40010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:06.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4a59c700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c4c0bc8d0 0x7f6c4c0af330 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f6c40000bc0 tx=0x7f6c40010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:06.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c3b7fe700 1 -- 172.21.15.63:0/2479570686 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c40005e40 con 0x7f6c4c0bc8d0 2020-05-18T21:30:06.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4b59e700 1 -- 172.21.15.63:0/2479570686 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c0aee90 con 0x7f6c4c0bc8d0 2020-05-18T21:30:06.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c3b7fe700 1 -- 172.21.15.63:0/2479570686 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c400122e0 con 0x7f6c4c0bc8d0 2020-05-18T21:30:06.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.117+0000 7f6c4b59e700 1 -- 172.21.15.63:0/2479570686 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4c0ae560 con 0x7f6c4c0bc8d0 2020-05-18T21:30:06.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.121+0000 7f6c4a59c700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c4c0bc8d0 0x7f6c4c0af330 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f6c40000bc0 tx=0x7f6c40010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:06.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.121+0000 7f6c4b59e700 1 -- 172.21.15.63:0/2479570686 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4c0569e0 con 0x7f6c4c0bc8d0 2020-05-18T21:30:06.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.121+0000 7f6c3b7fe700 1 -- 172.21.15.63:0/2479570686 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6c40012510 con 0x7f6c4c0bc8d0 2020-05-18T21:30:06.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.121+0000 7f6c4a59c700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c4c0bc8d0 0x7f6c4c0af330 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f6c40000bc0 tx=0x7f6c40010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:06.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.121+0000 7f6c3b7fe700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c2804f9b0 0x7f6c28051e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:06.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.121+0000 7f6c3b7fe700 1 -- 172.21.15.63:0/2479570686 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6c400090c0 con 0x7f6c4c0bc8d0 2020-05-18T21:30:06.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.121+0000 7f6c49d9b700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c2804f9b0 0x7f6c28051e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:06.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.121+0000 7f6c49d9b700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c2804f9b0 0x7f6c28051e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6c3c002f70 tx=0x7f6c4c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:06.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.121+0000 7f6c49d9b700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c2804f9b0 0x7f6c28051e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6c3c002f70 tx=0x7f6c4c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:06.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.121+0000 7f6c49d9b700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c2804f9b0 0x7f6c28051e70 secure :-1 s=READY pgs=336 cs=0 l=1 rx=0x7f6c3c002f70 tx=0x7f6c4c061d60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:06.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.129+0000 7f6c4a59c700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c4c0bc8d0 0x7f6c4c0af330 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f6c40000bc0 tx=0x7f6c40010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:06.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.129+0000 7f6c3b7fe700 1 -- 172.21.15.63:0/2479570686 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6c4003e3d0 con 0x7f6c4c0bc8d0 2020-05-18T21:30:06.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:06.245+0000 7f6c4b59e700 1 -- 172.21.15.63:0/2479570686 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f6c4c0008d0 con 0x7f6c4c0bc8d0 2020-05-18T21:30:07.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.049+0000 7f6c4a59c700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c4c0bc8d0 0x7f6c4c0af330 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f6c40000bc0 tx=0x7f6c40010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:07.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.049+0000 7f6c3b7fe700 1 -- 172.21.15.63:0/2479570686 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v70) v1 ==== 133+0+0 (secure 0 0 0) 0x7f6c400419f0 con 0x7f6c4c0bc8d0 2020-05-18T21:30:07.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.049+0000 7f6c4b59e700 1 -- 172.21.15.63:0/2479570686 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c2804f9b0 msgr2=0x7f6c28051e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:07.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.049+0000 7f6c4b59e700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c2804f9b0 0x7f6c28051e70 secure :-1 s=READY pgs=336 cs=0 l=1 rx=0x7f6c3c002f70 tx=0x7f6c4c061d60).stop 2020-05-18T21:30:07.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.049+0000 7f6c4b59e700 1 -- 172.21.15.63:0/2479570686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c4c0bc8d0 msgr2=0x7f6c4c0af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:07.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.049+0000 7f6c4b59e700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c4c0bc8d0 0x7f6c4c0af330 secure :-1 s=READY pgs=829 cs=0 l=1 rx=0x7f6c40000bc0 tx=0x7f6c40010a50).stop 2020-05-18T21:30:07.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.049+0000 7f6c4b59e700 1 -- 172.21.15.63:0/2479570686 shutdown_connections 2020-05-18T21:30:07.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.049+0000 7f6c4b59e700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6c2804f9b0 0x7f6c28051e70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:07.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.049+0000 7f6c4b59e700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4c143630 0x7f6c4c0aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:07.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.049+0000 7f6c4b59e700 1 --2- 172.21.15.63:0/2479570686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c4c0bc8d0 0x7f6c4c0af330 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:07.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.049+0000 7f6c4b59e700 1 -- 172.21.15.63:0/2479570686 >> 172.21.15.63:0/2479570686 conn(0x7f6c4c05f3b0 msgr2=0x7f6c4c0b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:07.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.049+0000 7f6c4b59e700 1 -- 172.21.15.63:0/2479570686 shutdown_connections 2020-05-18T21:30:07.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.053+0000 7f6c4b59e700 1 -- 172.21.15.63:0/2479570686 wait complete. 2020-05-18T21:30:07.064 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2020-05-18T21:30:07.072 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-05-18T21:30:07.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.185+0000 7f351759e700 1 Processor -- start 2020-05-18T21:30:07.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.185+0000 7f351759e700 1 -- start start 2020-05-18T21:30:07.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.185+0000 7f351759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f35180b68d0 0x7f35181469b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:07.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.185+0000 7f351759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f35180b99d0 0x7f3518149d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:07.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.185+0000 7f351759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3518145fd0 con 0x7f35180b8ed0 2020-05-18T21:30:07.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.185+0000 7f351759e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3518146270 con 0x7f35180b68d0 2020-05-18T21:30:07.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.185+0000 7f351759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3518146510 con 0x7f35180b99d0 2020-05-18T21:30:07.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.185+0000 7f351659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f35180b68d0 0x7f35181469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:07.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.185+0000 7f351659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f35180b68d0 0x7f35181469b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57002/0 (socket says 172.21.15.63:57002) 2020-05-18T21:30:07.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.185+0000 7f351659c700 1 -- 172.21.15.63:0/4069974362 learned_addr learned my addr 172.21.15.63:0/4069974362 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:07.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.185+0000 7f3515d9b700 1 --2- 172.21.15.63:0/4069974362 >> v2:172.21.15.155:3300/0 conn(0x7f35180b99d0 0x7f3518149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:07.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f3515d9b700 1 -- 172.21.15.63:0/4069974362 >> v2:172.21.15.63:3300/0 conn(0x7f35180b68d0 msgr2=0x7f35181469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:07.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f3515d9b700 1 --2- 172.21.15.63:0/4069974362 >> v2:172.21.15.63:3300/0 conn(0x7f35180b68d0 0x7f35181469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:07.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f3515d9b700 1 -- 172.21.15.63:0/4069974362 >> v1:172.21.15.155:6789/0 conn(0x7f35180b8ed0 legacy=0x7f3518060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:07.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f3515d9b700 1 -- 172.21.15.63:0/4069974362 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35180b6cb0 con 0x7f35180b99d0 2020-05-18T21:30:07.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f351659c700 1 --2- 172.21.15.63:0/4069974362 >> v2:172.21.15.63:3300/0 conn(0x7f35180b68d0 0x7f35181469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:30:07.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f3515d9b700 1 --2- 172.21.15.63:0/4069974362 >> v2:172.21.15.155:3300/0 conn(0x7f35180b99d0 0x7f3518149d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3508002f70 tx=0x7f3508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:07.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f3515d9b700 1 --2- 172.21.15.63:0/4069974362 >> v2:172.21.15.155:3300/0 conn(0x7f35180b99d0 0x7f3518149d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3508002f70 tx=0x7f3508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:07.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f3515d9b700 1 --2- 172.21.15.63:0/4069974362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35180b99d0 0x7f3518149d40 secure :-1 s=READY pgs=597 cs=0 l=1 rx=0x7f3508002f70 tx=0x7f3508007a80).ready entity=mon.1 client_cookie=85a08944c6a80fe9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:07.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f3515d9b700 1 --2- 172.21.15.63:0/4069974362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35180b99d0 0x7f3518149d40 secure :-1 s=THROTTLE_DONE pgs=597 cs=0 l=1 rx=0x7f3508002f70 tx=0x7f3508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:07.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f3515d9b700 1 --2- 172.21.15.63:0/4069974362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35180b99d0 0x7f3518149d40 secure :-1 s=THROTTLE_DONE pgs=597 cs=0 l=1 rx=0x7f3508002f70 tx=0x7f3508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:07.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f351559a700 1 -- 172.21.15.63:0/4069974362 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35080115f0 con 0x7f35180b99d0 2020-05-18T21:30:07.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f3515d9b700 1 --2- 172.21.15.63:0/4069974362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35180b99d0 0x7f3518149d40 secure :-1 s=THROTTLE_DONE pgs=597 cs=0 l=1 rx=0x7f3508002f70 tx=0x7f3508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:07.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f351559a700 1 -- 172.21.15.63:0/4069974362 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3508011750 con 0x7f35180b99d0 2020-05-18T21:30:07.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f351559a700 1 -- 172.21.15.63:0/4069974362 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3508011b70 con 0x7f35180b99d0 2020-05-18T21:30:07.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f351759e700 1 -- 172.21.15.63:0/4069974362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35180b99d0 msgr2=0x7f3518149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:07.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f351759e700 1 --2- 172.21.15.63:0/4069974362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35180b99d0 0x7f3518149d40 secure :-1 s=READY pgs=597 cs=0 l=1 rx=0x7f3508002f70 tx=0x7f3508007a80).stop 2020-05-18T21:30:07.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f351759e700 1 -- 172.21.15.63:0/4069974362 shutdown_connections 2020-05-18T21:30:07.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f351759e700 1 --2- 172.21.15.63:0/4069974362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35180b99d0 0x7f3518149d40 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:07.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f351759e700 1 --2- 172.21.15.63:0/4069974362 >> v2:172.21.15.63:3300/0 conn(0x7f35180b68d0 0x7f35181469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:07.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f351759e700 1 -- 172.21.15.63:0/4069974362 >> 172.21.15.63:0/4069974362 conn(0x7f3518069b70 msgr2=0x7f3518069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:07.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f351759e700 1 -- 172.21.15.63:0/4069974362 shutdown_connections 2020-05-18T21:30:07.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f351759e700 1 -- 172.21.15.63:0/4069974362 wait complete. 2020-05-18T21:30:07.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f351759e700 1 Processor -- start 2020-05-18T21:30:07.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f351759e700 1 -- start start 2020-05-18T21:30:07.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f351759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35180b8ed0 0x7f35181542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:07.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f351759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f35180b99d0 0x7f351813e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:07.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f351759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3518141790 con 0x7f35180b68d0 2020-05-18T21:30:07.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f351759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3518141a30 con 0x7f35180b99d0 2020-05-18T21:30:07.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.189+0000 7f351759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35181430a0 con 0x7f35180b8ed0 2020-05-18T21:30:07.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f3515d9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35180b8ed0 0x7f35181542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:07.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f3515d9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35180b8ed0 0x7f35181542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:47712/0 (socket says 172.21.15.63:47712) 2020-05-18T21:30:07.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f3515d9b700 1 -- 172.21.15.63:0/2318621403 learned_addr learned my addr 172.21.15.63:0/2318621403 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:07.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f3516d9d700 1 --2- 172.21.15.63:0/2318621403 >> v2:172.21.15.155:3300/0 conn(0x7f35180b99d0 0x7f351813e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:07.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f350f7fe700 1 -- 172.21.15.63:0/2318621403 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121112277 0 0) 0x7f3518141790 con 0x7f35180b68d0 2020-05-18T21:30:07.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f350f7fe700 1 -- 172.21.15.63:0/2318621403 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34fc002fe0 con 0x7f35180b68d0 2020-05-18T21:30:07.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f3515d9b700 1 -- 172.21.15.63:0/2318621403 >> v2:172.21.15.155:3300/0 conn(0x7f35180b99d0 msgr2=0x7f351813e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:07.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f3515d9b700 1 --2- 172.21.15.63:0/2318621403 >> v2:172.21.15.155:3300/0 conn(0x7f35180b99d0 0x7f351813e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:07.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f3515d9b700 1 -- 172.21.15.63:0/2318621403 >> v1:172.21.15.155:6789/0 conn(0x7f35180b68d0 legacy=0x7f351813da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:07.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f3515d9b700 1 -- 172.21.15.63:0/2318621403 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3518143210 con 0x7f35180b8ed0 2020-05-18T21:30:07.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f3515d9b700 1 --2- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35180b8ed0 0x7f35181542a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3508002f70 tx=0x7f3508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:07.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f3515d9b700 1 --2- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35180b8ed0 0x7f35181542a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3508002f70 tx=0x7f3508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:07.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f3515d9b700 1 --2- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35180b8ed0 0x7f35181542a0 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f3508002f70 tx=0x7f3508007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:07.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f3515d9b700 1 --2- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35180b8ed0 0x7f35181542a0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f3508002f70 tx=0x7f3508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:07.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f350f7fe700 1 -- 172.21.15.63:0/2318621403 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35080086f0 con 0x7f35180b8ed0 2020-05-18T21:30:07.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f3515d9b700 1 --2- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35180b8ed0 0x7f35181542a0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f3508002f70 tx=0x7f3508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:07.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f351759e700 1 -- 172.21.15.63:0/2318621403 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3518143460 con 0x7f35180b8ed0 2020-05-18T21:30:07.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f350f7fe700 1 -- 172.21.15.63:0/2318621403 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3508007170 con 0x7f35180b8ed0 2020-05-18T21:30:07.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f3515d9b700 1 --2- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35180b8ed0 0x7f35181542a0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f3508002f70 tx=0x7f3508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:07.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f350f7fe700 1 -- 172.21.15.63:0/2318621403 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3508007510 con 0x7f35180b8ed0 2020-05-18T21:30:07.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f351759e700 1 -- 172.21.15.63:0/2318621403 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3518144b20 con 0x7f35180b8ed0 2020-05-18T21:30:07.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f3515d9b700 1 --2- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35180b8ed0 0x7f35181542a0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f3508002f70 tx=0x7f3508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:07.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f351759e700 1 -- 172.21.15.63:0/2318621403 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3518143710 con 0x7f35180b8ed0 2020-05-18T21:30:07.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f350f7fe700 1 -- 172.21.15.63:0/2318621403 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f35080080e0 con 0x7f35180b8ed0 2020-05-18T21:30:07.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f3515d9b700 1 --2- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35180b8ed0 0x7f35181542a0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f3508002f70 tx=0x7f3508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:07.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f350f7fe700 1 --2- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f34fc04fd30 0x7f34fc0521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:07.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.193+0000 7f350f7fe700 1 -- 172.21.15.63:0/2318621403 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f3508063f50 con 0x7f35180b8ed0 2020-05-18T21:30:07.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.197+0000 7f351659c700 1 --2- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f34fc04fd30 0x7f34fc0521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:07.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.197+0000 7f351659c700 1 --2- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f34fc04fd30 0x7f34fc0521f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3500007760 tx=0x7f3500009b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:07.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.197+0000 7f351659c700 1 --2- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f34fc04fd30 0x7f34fc0521f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3500007760 tx=0x7f3500009b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:07.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.197+0000 7f351659c700 1 --2- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f34fc04fd30 0x7f34fc0521f0 secure :-1 s=READY pgs=337 cs=0 l=1 rx=0x7f3500007760 tx=0x7f3500009b30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:07.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.205+0000 7f3515d9b700 1 --2- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35180b8ed0 0x7f35181542a0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f3508002f70 tx=0x7f3508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:07.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.205+0000 7f350f7fe700 1 -- 172.21.15.63:0/2318621403 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f350803e400 con 0x7f35180b8ed0 2020-05-18T21:30:07.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:07.325+0000 7f351759e700 1 -- 172.21.15.63:0/2318621403 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f35180569e0 con 0x7f35180b8ed0 2020-05-18T21:30:08.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.053+0000 7f3515d9b700 1 --2- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35180b8ed0 0x7f35181542a0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f3508002f70 tx=0x7f3508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.053+0000 7f350f7fe700 1 -- 172.21.15.63:0/2318621403 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v71) v1 ==== 125+0+0 (secure 0 0 0) 0x7f3508041a20 con 0x7f35180b8ed0 2020-05-18T21:30:08.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.061+0000 7f351759e700 1 -- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f34fc04fd30 msgr2=0x7f34fc0521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.061+0000 7f351759e700 1 --2- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f34fc04fd30 0x7f34fc0521f0 secure :-1 s=READY pgs=337 cs=0 l=1 rx=0x7f3500007760 tx=0x7f3500009b30).stop 2020-05-18T21:30:08.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.061+0000 7f351759e700 1 -- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35180b8ed0 msgr2=0x7f35181542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.061+0000 7f351759e700 1 --2- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35180b8ed0 0x7f35181542a0 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f3508002f70 tx=0x7f3508007a80).stop 2020-05-18T21:30:08.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.061+0000 7f351759e700 1 -- 172.21.15.63:0/2318621403 shutdown_connections 2020-05-18T21:30:08.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.061+0000 7f351759e700 1 --2- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f34fc04fd30 0x7f34fc0521f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:08.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.061+0000 7f351759e700 1 --2- 172.21.15.63:0/2318621403 >> v2:172.21.15.155:3300/0 conn(0x7f35180b99d0 0x7f351813e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:08.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.061+0000 7f351759e700 1 --2- 172.21.15.63:0/2318621403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35180b8ed0 0x7f35181542a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:08.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.061+0000 7f351759e700 1 -- 172.21.15.63:0/2318621403 >> 172.21.15.63:0/2318621403 conn(0x7f3518069b70 msgr2=0x7f35180b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:08.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.065+0000 7f351759e700 1 -- 172.21.15.63:0/2318621403 shutdown_connections 2020-05-18T21:30:08.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.065+0000 7f351759e700 1 -- 172.21.15.63:0/2318621403 wait complete. 2020-05-18T21:30:08.071 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2020-05-18T21:30:08.085 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-05-18T21:30:08.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.189+0000 7f4b108b0700 1 Processor -- start 2020-05-18T21:30:08.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.189+0000 7f4b108b0700 1 -- start start 2020-05-18T21:30:08.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b108b0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4b0c0b95a0 0x7f4b0c0aef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:08.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b108b0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c1461d0 0x7f4b0c146610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:08.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b108b0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4b0c0b40a0 0x7f4b0c0b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:08.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b108b0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0c05fb20 con 0x7f4b0c0b95a0 2020-05-18T21:30:08.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b108b0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0c145a90 con 0x7f4b0c0b40a0 2020-05-18T21:30:08.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b108b0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c145d30 con 0x7f4b0c1461d0 2020-05-18T21:30:08.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b0ad9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4b0c0b95a0 0x7f4b0c0aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:08.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b0ad9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4b0c0b95a0 0x7f4b0c0aef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57016/0 (socket says 172.21.15.63:57016) 2020-05-18T21:30:08.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b0ad9d700 1 -- 172.21.15.63:0/282434164 learned_addr learned my addr 172.21.15.63:0/282434164 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:08.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b0a59c700 1 --2- 172.21.15.63:0/282434164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c1461d0 0x7f4b0c146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:08.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b0b59e700 1 --2- 172.21.15.63:0/282434164 >> v2:172.21.15.155:3300/0 conn(0x7f4b0c0b40a0 0x7f4b0c0b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:08.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b0ad9d700 1 -- 172.21.15.63:0/282434164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c1461d0 msgr2=0x7f4b0c146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:08.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b0ad9d700 1 --2- 172.21.15.63:0/282434164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c1461d0 0x7f4b0c146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:08.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b0ad9d700 1 -- 172.21.15.63:0/282434164 >> v2:172.21.15.155:3300/0 conn(0x7f4b0c0b40a0 msgr2=0x7f4b0c0b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:08.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b0ad9d700 1 --2- 172.21.15.63:0/282434164 >> v2:172.21.15.155:3300/0 conn(0x7f4b0c0b40a0 0x7f4b0c0b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:08.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b0ad9d700 1 -- 172.21.15.63:0/282434164 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c0b9980 con 0x7f4b0c0b95a0 2020-05-18T21:30:08.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b0ad9d700 1 --2- 172.21.15.63:0/282434164 >> v2:172.21.15.63:3300/0 conn(0x7f4b0c0b95a0 0x7f4b0c0aef50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4afc002f70 tx=0x7f4afc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b0ad9d700 1 --2- 172.21.15.63:0/282434164 >> v2:172.21.15.63:3300/0 conn(0x7f4b0c0b95a0 0x7f4b0c0aef50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4afc002f70 tx=0x7f4afc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b0ad9d700 1 --2- 172.21.15.63:0/282434164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b0c0b95a0 0x7f4b0c0aef50 secure :-1 s=READY pgs=830 cs=0 l=1 rx=0x7f4afc002f70 tx=0x7f4afc007a80).ready entity=mon.0 client_cookie=52b453bfaefc8f49 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:08.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b0ad9d700 1 --2- 172.21.15.63:0/282434164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b0c0b95a0 0x7f4b0c0aef50 secure :-1 s=THROTTLE_DONE pgs=830 cs=0 l=1 rx=0x7f4afc002f70 tx=0x7f4afc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b0ad9d700 1 --2- 172.21.15.63:0/282434164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b0c0b95a0 0x7f4b0c0aef50 secure :-1 s=THROTTLE_DONE pgs=830 cs=0 l=1 rx=0x7f4afc002f70 tx=0x7f4afc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b09d9b700 1 -- 172.21.15.63:0/282434164 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4afc009e80 con 0x7f4b0c0b95a0 2020-05-18T21:30:08.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b0ad9d700 1 --2- 172.21.15.63:0/282434164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b0c0b95a0 0x7f4b0c0aef50 secure :-1 s=THROTTLE_DONE pgs=830 cs=0 l=1 rx=0x7f4afc002f70 tx=0x7f4afc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b09d9b700 1 -- 172.21.15.63:0/282434164 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc012900 con 0x7f4b0c0b95a0 2020-05-18T21:30:08.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b09d9b700 1 -- 172.21.15.63:0/282434164 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4afc012d20 con 0x7f4b0c0b95a0 2020-05-18T21:30:08.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b108b0700 1 -- 172.21.15.63:0/282434164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b0c0b95a0 msgr2=0x7f4b0c0aef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b108b0700 1 --2- 172.21.15.63:0/282434164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b0c0b95a0 0x7f4b0c0aef50 secure :-1 s=READY pgs=830 cs=0 l=1 rx=0x7f4afc002f70 tx=0x7f4afc007a80).stop 2020-05-18T21:30:08.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b108b0700 1 -- 172.21.15.63:0/282434164 shutdown_connections 2020-05-18T21:30:08.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b108b0700 1 --2- 172.21.15.63:0/282434164 >> v2:172.21.15.155:3300/0 conn(0x7f4b0c0b40a0 0x7f4b0c0b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:08.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b108b0700 1 --2- 172.21.15.63:0/282434164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c1461d0 0x7f4b0c146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:08.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b108b0700 1 --2- 172.21.15.63:0/282434164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b0c0b95a0 0x7f4b0c0aef50 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:08.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b108b0700 1 -- 172.21.15.63:0/282434164 >> 172.21.15.63:0/282434164 conn(0x7f4b0c06a640 msgr2=0x7f4b0c0b8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:08.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b108b0700 1 -- 172.21.15.63:0/282434164 shutdown_connections 2020-05-18T21:30:08.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.193+0000 7f4b108b0700 1 -- 172.21.15.63:0/282434164 wait complete. 2020-05-18T21:30:08.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b108b0700 1 Processor -- start 2020-05-18T21:30:08.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b108b0700 1 -- start start 2020-05-18T21:30:08.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b108b0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0b95a0 0x7f4b0c156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:08.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b108b0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4b0c1461d0 0x7f4b0c143b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:08.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b108b0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0c0b2230 con 0x7f4b0c0b40a0 2020-05-18T21:30:08.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b108b0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0c062ec0 con 0x7f4b0c1461d0 2020-05-18T21:30:08.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b108b0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c063160 con 0x7f4b0c0b95a0 2020-05-18T21:30:08.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b0a59c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0b95a0 0x7f4b0c156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:08.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b0ad9d700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f4b0c0b40a0 0x7f4b0c063b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:57526/0 (socket says 172.21.15.63:57526) 2020-05-18T21:30:08.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b0a59c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0b95a0 0x7f4b0c156800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:47726/0 (socket says 172.21.15.63:47726) 2020-05-18T21:30:08.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b0ad9d700 1 -- 172.21.15.63:0/3672365079 learned_addr learned my addr 172.21.15.63:0/3672365079 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:08.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b0b59e700 1 --2- 172.21.15.63:0/3672365079 >> v2:172.21.15.155:3300/0 conn(0x7f4b0c1461d0 0x7f4b0c143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:08.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b0a59c700 1 -- 172.21.15.63:0/3672365079 >> v2:172.21.15.155:3300/0 conn(0x7f4b0c1461d0 msgr2=0x7f4b0c143b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b0a59c700 1 --2- 172.21.15.63:0/3672365079 >> v2:172.21.15.155:3300/0 conn(0x7f4b0c1461d0 0x7f4b0c143b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:08.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b0a59c700 1 -- 172.21.15.63:0/3672365079 >> v1:172.21.15.155:6789/0 conn(0x7f4b0c0b40a0 legacy=0x7f4b0c063b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b0a59c700 1 -- 172.21.15.63:0/3672365079 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c063400 con 0x7f4b0c0b95a0 2020-05-18T21:30:08.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b0a59c700 1 --2- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0b95a0 0x7f4b0c156800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4b00002f70 tx=0x7f4b00010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b0a59c700 1 --2- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0b95a0 0x7f4b0c156800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4b00002f70 tx=0x7f4b00010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b0a59c700 1 --2- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0b95a0 0x7f4b0c156800 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f4b00002f70 tx=0x7f4b00010bb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:08.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b0a59c700 1 --2- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0b95a0 0x7f4b0c156800 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f4b00002f70 tx=0x7f4b00010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4afbfff700 1 -- 172.21.15.63:0/3672365079 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b00007550 con 0x7f4b0c0b95a0 2020-05-18T21:30:08.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b0a59c700 1 --2- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0b95a0 0x7f4b0c156800 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f4b00002f70 tx=0x7f4b00010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b0a59c700 1 --2- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0b95a0 0x7f4b0c156800 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f4b00002f70 tx=0x7f4b00010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4afbfff700 1 -- 172.21.15.63:0/3672365079 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b00005700 con 0x7f4b0c0b95a0 2020-05-18T21:30:08.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b108b0700 1 -- 172.21.15.63:0/3672365079 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0c0636a0 con 0x7f4b0c0b95a0 2020-05-18T21:30:08.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4afbfff700 1 -- 172.21.15.63:0/3672365079 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b00005ae0 con 0x7f4b0c0b95a0 2020-05-18T21:30:08.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.197+0000 7f4b108b0700 1 -- 172.21.15.63:0/3672365079 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0c0afb90 con 0x7f4b0c0b95a0 2020-05-18T21:30:08.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.201+0000 7f4b0a59c700 1 --2- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0b95a0 0x7f4b0c156800 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f4b00002f70 tx=0x7f4b00010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.201+0000 7f4b108b0700 1 -- 172.21.15.63:0/3672365079 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0c0569e0 con 0x7f4b0c0b95a0 2020-05-18T21:30:08.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.201+0000 7f4afbfff700 1 -- 172.21.15.63:0/3672365079 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4b00005d20 con 0x7f4b0c0b95a0 2020-05-18T21:30:08.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.201+0000 7f4b0a59c700 1 --2- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0b95a0 0x7f4b0c156800 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f4b00002f70 tx=0x7f4b00010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.201+0000 7f4afbfff700 1 --2- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4ae804f920 0x7f4ae8051de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:08.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.201+0000 7f4afbfff700 1 -- 172.21.15.63:0/3672365079 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f4b00063fd0 con 0x7f4b0c0b95a0 2020-05-18T21:30:08.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.201+0000 7f4b0ad9d700 1 --2- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4ae804f920 0x7f4ae8051de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:08.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.201+0000 7f4b0ad9d700 1 --2- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4ae804f920 0x7f4ae8051de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4b0c09cf90 tx=0x7f4afc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.201+0000 7f4b0ad9d700 1 --2- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4ae804f920 0x7f4ae8051de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4b0c09cf90 tx=0x7f4afc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.201+0000 7f4b0ad9d700 1 --2- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4ae804f920 0x7f4ae8051de0 secure :-1 s=READY pgs=338 cs=0 l=1 rx=0x7f4b0c09cf90 tx=0x7f4afc007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:08.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.209+0000 7f4b0a59c700 1 --2- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0b95a0 0x7f4b0c156800 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f4b00002f70 tx=0x7f4b00010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.209+0000 7f4afbfff700 1 -- 172.21.15.63:0/3672365079 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f4b0003e300 con 0x7f4b0c0b95a0 2020-05-18T21:30:08.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.357+0000 7f4b108b0700 1 -- 172.21.15.63:0/3672365079 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f4b0c066470 con 0x7f4b0c0b95a0 2020-05-18T21:30:08.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.369+0000 7f4b0a59c700 1 --2- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0b95a0 0x7f4b0c156800 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f4b00002f70 tx=0x7f4b00010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.369+0000 7f4afbfff700 1 -- 172.21.15.63:0/3672365079 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 13 and data pool 14 v38) v1 ==== 189+0+0 (secure 0 0 0) 0x7f4b00041920 con 0x7f4b0c0b95a0 2020-05-18T21:30:08.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.373+0000 7f4b108b0700 1 -- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4ae804f920 msgr2=0x7f4ae8051de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.373+0000 7f4b108b0700 1 --2- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4ae804f920 0x7f4ae8051de0 secure :-1 s=READY pgs=338 cs=0 l=1 rx=0x7f4b0c09cf90 tx=0x7f4afc007a80).stop 2020-05-18T21:30:08.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.373+0000 7f4b108b0700 1 -- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0b95a0 msgr2=0x7f4b0c156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.373+0000 7f4b108b0700 1 --2- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0b95a0 0x7f4b0c156800 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f4b00002f70 tx=0x7f4b00010bb0).stop 2020-05-18T21:30:08.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.373+0000 7f4b108b0700 1 -- 172.21.15.63:0/3672365079 shutdown_connections 2020-05-18T21:30:08.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.373+0000 7f4b108b0700 1 --2- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4ae804f920 0x7f4ae8051de0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:08.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.373+0000 7f4b108b0700 1 --2- 172.21.15.63:0/3672365079 >> v2:172.21.15.155:3300/0 conn(0x7f4b0c1461d0 0x7f4b0c143b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:08.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.373+0000 7f4b108b0700 1 --2- 172.21.15.63:0/3672365079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0b95a0 0x7f4b0c156800 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0x7f4b00002f70 tx=0x7f4b00010bb0).stop 2020-05-18T21:30:08.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.373+0000 7f4b108b0700 1 -- 172.21.15.63:0/3672365079 >> 172.21.15.63:0/3672365079 conn(0x7f4b0c06a640 msgr2=0x7f4b0c061030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:08.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.373+0000 7f4b108b0700 1 -- 172.21.15.63:0/3672365079 shutdown_connections 2020-05-18T21:30:08.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.377+0000 7f4b108b0700 1 -- 172.21.15.63:0/3672365079 wait complete. 2020-05-18T21:30:08.382 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 13 and data pool 14 2020-05-18T21:30:08.394 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:30:08.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb9d3c700 1 Processor -- start 2020-05-18T21:30:08.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb9d3c700 1 -- start start 2020-05-18T21:30:08.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb9d3c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdcb4061500 0x7fdcb4065e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:08.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb9d3c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdcb4142c90 0x7fdcb40649d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:08.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb9d3c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb4146850 con 0x7fdcb4143110 2020-05-18T21:30:08.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb9d3c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb413c9c0 con 0x7fdcb4142c90 2020-05-18T21:30:08.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb9d3c700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb4142550 con 0x7fdcb4061500 2020-05-18T21:30:08.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcabfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdcb4142c90 0x7fdcb40649d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:08.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcabfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdcb4142c90 0x7fdcb40649d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57030/0 (socket says 172.21.15.63:57030) 2020-05-18T21:30:08.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcabfff700 1 -- 172.21.15.63:0/2875325202 learned_addr learned my addr 172.21.15.63:0/2875325202 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:08.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb37fe700 1 --2- 172.21.15.63:0/2875325202 >> v2:172.21.15.155:3300/0 conn(0x7fdcb4061500 0x7fdcb4065e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:08.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcabfff700 1 -- 172.21.15.63:0/2875325202 >> v2:172.21.15.155:3300/0 conn(0x7fdcb4061500 msgr2=0x7fdcb4065e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:08.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcabfff700 1 --2- 172.21.15.63:0/2875325202 >> v2:172.21.15.155:3300/0 conn(0x7fdcb4061500 0x7fdcb4065e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:08.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb2ffd700 1 -- 172.21.15.63:0/2875325202 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875564656 0 0) 0x7fdcb4146850 con 0x7fdcb4143110 2020-05-18T21:30:08.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcabfff700 1 -- 172.21.15.63:0/2875325202 >> v1:172.21.15.155:6789/0 conn(0x7fdcb4143110 legacy=0x7fdcb4064e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcabfff700 1 -- 172.21.15.63:0/2875325202 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb41427f0 con 0x7fdcb4142c90 2020-05-18T21:30:08.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcabfff700 1 --2- 172.21.15.63:0/2875325202 >> v2:172.21.15.63:3300/0 conn(0x7fdcb4142c90 0x7fdcb40649d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdc9c002f70 tx=0x7fdc9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcabfff700 1 --2- 172.21.15.63:0/2875325202 >> v2:172.21.15.63:3300/0 conn(0x7fdcb4142c90 0x7fdcb40649d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdc9c002f70 tx=0x7fdc9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcabfff700 1 --2- 172.21.15.63:0/2875325202 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb4142c90 0x7fdcb40649d0 secure :-1 s=READY pgs=831 cs=0 l=1 rx=0x7fdc9c002f70 tx=0x7fdc9c007a80).ready entity=mon.0 client_cookie=8cf354414277c58 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:08.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcabfff700 1 --2- 172.21.15.63:0/2875325202 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb4142c90 0x7fdcb40649d0 secure :-1 s=THROTTLE_DONE pgs=831 cs=0 l=1 rx=0x7fdc9c002f70 tx=0x7fdc9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb2ffd700 1 -- 172.21.15.63:0/2875325202 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc9c0127c0 con 0x7fdcb4142c90 2020-05-18T21:30:08.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcabfff700 1 --2- 172.21.15.63:0/2875325202 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb4142c90 0x7fdcb40649d0 secure :-1 s=THROTTLE_DONE pgs=831 cs=0 l=1 rx=0x7fdc9c002f70 tx=0x7fdc9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb2ffd700 1 -- 172.21.15.63:0/2875325202 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c012920 con 0x7fdcb4142c90 2020-05-18T21:30:08.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcabfff700 1 --2- 172.21.15.63:0/2875325202 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb4142c90 0x7fdcb40649d0 secure :-1 s=THROTTLE_DONE pgs=831 cs=0 l=1 rx=0x7fdc9c002f70 tx=0x7fdc9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb2ffd700 1 -- 172.21.15.63:0/2875325202 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc9c012d00 con 0x7fdcb4142c90 2020-05-18T21:30:08.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb9d3c700 1 -- 172.21.15.63:0/2875325202 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb4142c90 msgr2=0x7fdcb40649d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb9d3c700 1 --2- 172.21.15.63:0/2875325202 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb4142c90 0x7fdcb40649d0 secure :-1 s=READY pgs=831 cs=0 l=1 rx=0x7fdc9c002f70 tx=0x7fdc9c007a80).stop 2020-05-18T21:30:08.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb9d3c700 1 -- 172.21.15.63:0/2875325202 shutdown_connections 2020-05-18T21:30:08.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb9d3c700 1 --2- 172.21.15.63:0/2875325202 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb4142c90 0x7fdcb40649d0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:08.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb9d3c700 1 --2- 172.21.15.63:0/2875325202 >> v2:172.21.15.155:3300/0 conn(0x7fdcb4061500 0x7fdcb4065e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:08.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb9d3c700 1 -- 172.21.15.63:0/2875325202 >> 172.21.15.63:0/2875325202 conn(0x7fdcb40b83d0 msgr2=0x7fdcb40b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:08.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb9d3c700 1 -- 172.21.15.63:0/2875325202 shutdown_connections 2020-05-18T21:30:08.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.485+0000 7fdcb9d3c700 1 -- 172.21.15.63:0/2875325202 wait complete. 2020-05-18T21:30:08.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.489+0000 7fdcb9d3c700 1 Processor -- start 2020-05-18T21:30:08.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.489+0000 7fdcb9d3c700 1 -- start start 2020-05-18T21:30:08.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.489+0000 7fdcb9d3c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdcb4142c90 0x7fdcb4152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:08.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.489+0000 7fdcb9d3c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb413a910 con 0x7fdcb4143110 2020-05-18T21:30:08.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcb9d3c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb40b6e60 con 0x7fdcb4061500 2020-05-18T21:30:08.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcb9d3c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb40b7a10 con 0x7fdcb4142c90 2020-05-18T21:30:08.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcabfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdcb4142c90 0x7fdcb4152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:08.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcb3fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdcb4143110 0x7fdcb4133fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59228/0 (socket says 172.21.15.63:59228) 2020-05-18T21:30:08.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcb3fff700 1 -- 172.21.15.63:0/3019132295 learned_addr learned my addr 172.21.15.63:0/3019132295 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:08.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcabfff700 1 -- 172.21.15.63:0/3019132295 >> v1:172.21.15.155:6789/0 conn(0x7fdcb4061500 legacy=0x7fdcb40b7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcabfff700 1 -- 172.21.15.63:0/3019132295 >> v1:172.21.15.63:6789/0 conn(0x7fdcb4143110 legacy=0x7fdcb4133fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcb17fa700 1 -- 172.21.15.63:0/3019132295 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730081494 0 0) 0x7fdcb413a910 con 0x7fdcb4143110 2020-05-18T21:30:08.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcabfff700 1 -- 172.21.15.63:0/3019132295 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb41435e0 con 0x7fdcb4142c90 2020-05-18T21:30:08.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcabfff700 1 --2- 172.21.15.63:0/3019132295 >> v2:172.21.15.63:3300/0 conn(0x7fdcb4142c90 0x7fdcb4152980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdc9c002f70 tx=0x7fdc9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcabfff700 1 --2- 172.21.15.63:0/3019132295 >> v2:172.21.15.63:3300/0 conn(0x7fdcb4142c90 0x7fdcb4152980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdc9c002f70 tx=0x7fdc9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcabfff700 1 --2- 172.21.15.63:0/3019132295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb4142c90 0x7fdcb4152980 secure :-1 s=READY pgs=833 cs=0 l=1 rx=0x7fdc9c002f70 tx=0x7fdc9c007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:08.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcabfff700 1 --2- 172.21.15.63:0/3019132295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb4142c90 0x7fdcb4152980 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7fdc9c002f70 tx=0x7fdc9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcabfff700 1 --2- 172.21.15.63:0/3019132295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb4142c90 0x7fdcb4152980 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7fdc9c002f70 tx=0x7fdc9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcb17fa700 1 -- 172.21.15.63:0/3019132295 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc9c012a80 con 0x7fdcb4142c90 2020-05-18T21:30:08.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcabfff700 1 --2- 172.21.15.63:0/3019132295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb4142c90 0x7fdcb4152980 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7fdc9c002f70 tx=0x7fdc9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcb17fa700 1 -- 172.21.15.63:0/3019132295 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c012be0 con 0x7fdcb4142c90 2020-05-18T21:30:08.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcb9d3c700 1 -- 172.21.15.63:0/3019132295 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb413a470 con 0x7fdcb4142c90 2020-05-18T21:30:08.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcb17fa700 1 -- 172.21.15.63:0/3019132295 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc9c012dd0 con 0x7fdcb4142c90 2020-05-18T21:30:08.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcb9d3c700 1 -- 172.21.15.63:0/3019132295 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb41348f0 con 0x7fdcb4142c90 2020-05-18T21:30:08.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcabfff700 1 --2- 172.21.15.63:0/3019132295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb4142c90 0x7fdcb4152980 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7fdc9c002f70 tx=0x7fdc9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcb9d3c700 1 -- 172.21.15.63:0/3019132295 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb413a780 con 0x7fdcb4142c90 2020-05-18T21:30:08.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcb17fa700 1 -- 172.21.15.63:0/3019132295 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fdc9c0071a0 con 0x7fdcb4142c90 2020-05-18T21:30:08.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.493+0000 7fdcabfff700 1 --2- 172.21.15.63:0/3019132295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb4142c90 0x7fdcb4152980 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7fdc9c002f70 tx=0x7fdc9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.497+0000 7fdcb17fa700 1 --2- 172.21.15.63:0/3019132295 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdc9804f860 0x7fdc98051d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:08.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.497+0000 7fdcb17fa700 1 -- 172.21.15.63:0/3019132295 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdc9c066460 con 0x7fdcb4142c90 2020-05-18T21:30:08.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.497+0000 7fdcb37fe700 1 --2- 172.21.15.63:0/3019132295 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdc9804f860 0x7fdc98051d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:08.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.497+0000 7fdcb37fe700 1 --2- 172.21.15.63:0/3019132295 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdc9804f860 0x7fdc98051d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdcb4065850 tx=0x7fdca4007740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.497+0000 7fdcb37fe700 1 --2- 172.21.15.63:0/3019132295 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdc9804f860 0x7fdc98051d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdcb4065850 tx=0x7fdca4007740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.497+0000 7fdcb37fe700 1 --2- 172.21.15.63:0/3019132295 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdc9804f860 0x7fdc98051d20 secure :-1 s=READY pgs=339 cs=0 l=1 rx=0x7fdcb4065850 tx=0x7fdca4007740).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:08.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.501+0000 7fdcabfff700 1 --2- 172.21.15.63:0/3019132295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb4142c90 0x7fdcb4152980 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7fdc9c002f70 tx=0x7fdc9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.501+0000 7fdcb17fa700 1 -- 172.21.15.63:0/3019132295 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fdc9c040910 con 0x7fdcb4142c90 2020-05-18T21:30:08.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.617+0000 7fdcb9d3c700 1 -- 172.21.15.63:0/3019132295 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcb413ab10 con 0x7fdcb4142c90 2020-05-18T21:30:08.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.621+0000 7fdcabfff700 1 --2- 172.21.15.63:0/3019132295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb4142c90 0x7fdcb4152980 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7fdc9c002f70 tx=0x7fdc9c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.621+0000 7fdcb17fa700 1 -- 172.21.15.63:0/3019132295 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16105 (secure 0 0 0) 0x7fdc9c043f30 con 0x7fdcb4142c90 2020-05-18T21:30:08.627 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:08.628 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":72,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:30:08.364827+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:30:06.278977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2020-05-18T21:30:07.362909+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:30:08.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.621+0000 7fdcb9d3c700 1 -- 172.21.15.63:0/3019132295 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdc9804f860 msgr2=0x7fdc98051d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.621+0000 7fdcb9d3c700 1 --2- 172.21.15.63:0/3019132295 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdc9804f860 0x7fdc98051d20 secure :-1 s=READY pgs=339 cs=0 l=1 rx=0x7fdcb4065850 tx=0x7fdca4007740).stop 2020-05-18T21:30:08.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.621+0000 7fdcb9d3c700 1 -- 172.21.15.63:0/3019132295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb4142c90 msgr2=0x7fdcb4152980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.621+0000 7fdcb9d3c700 1 --2- 172.21.15.63:0/3019132295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb4142c90 0x7fdcb4152980 secure :-1 s=READY pgs=833 cs=0 l=1 rx=0x7fdc9c002f70 tx=0x7fdc9c007a80).stop 2020-05-18T21:30:08.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.625+0000 7fdcb9d3c700 1 -- 172.21.15.63:0/3019132295 shutdown_connections 2020-05-18T21:30:08.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.625+0000 7fdcb9d3c700 1 --2- 172.21.15.63:0/3019132295 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdc9804f860 0x7fdc98051d20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:08.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.625+0000 7fdcb9d3c700 1 --2- 172.21.15.63:0/3019132295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb4142c90 0x7fdcb4152980 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:08.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.625+0000 7fdcb9d3c700 1 -- 172.21.15.63:0/3019132295 >> 172.21.15.63:0/3019132295 conn(0x7fdcb40b83d0 msgr2=0x7fdcb40b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:08.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.625+0000 7fdcb9d3c700 1 -- 172.21.15.63:0/3019132295 shutdown_connections 2020-05-18T21:30:08.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.625+0000 7fdcb9d3c700 1 -- 172.21.15.63:0/3019132295 wait complete. 2020-05-18T21:30:08.640 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:30:08.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f85a5261700 1 Processor -- start 2020-05-18T21:30:08.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f85a5261700 1 -- start start 2020-05-18T21:30:08.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f85a5261700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85a00b2860 0x7f85a00615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:08.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f85a5261700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a014d960 con 0x7f85a0060b90 2020-05-18T21:30:08.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f85a5261700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a014db90 con 0x7f85a014e570 2020-05-18T21:30:08.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f85a5261700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a0066210 con 0x7f85a00b2860 2020-05-18T21:30:08.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f859e7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85a00b2860 0x7f85a00615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:08.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f859e7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85a00b2860 0x7f85a00615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57044/0 (socket says 172.21.15.63:57044) 2020-05-18T21:30:08.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f859e7fc700 1 -- 172.21.15.63:0/901849725 learned_addr learned my addr 172.21.15.63:0/901849725 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:08.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f859effd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f85a0060b90 0x7f85a0144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59232/0 (socket says 172.21.15.63:59232) 2020-05-18T21:30:08.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f859e7fc700 1 -- 172.21.15.63:0/901849725 >> v1:172.21.15.155:6789/0 conn(0x7f85a014e570 legacy=0x7f85a014a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f859e7fc700 1 -- 172.21.15.63:0/901849725 >> v1:172.21.15.63:6789/0 conn(0x7f85a0060b90 legacy=0x7f85a0144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f859e7fc700 1 -- 172.21.15.63:0/901849725 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a014de30 con 0x7f85a00b2860 2020-05-18T21:30:08.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f859e7fc700 1 --2- 172.21.15.63:0/901849725 >> v2:172.21.15.63:3300/0 conn(0x7f85a00b2860 0x7f85a00615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8594002f70 tx=0x7f8594007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f859e7fc700 1 --2- 172.21.15.63:0/901849725 >> v2:172.21.15.63:3300/0 conn(0x7f85a00b2860 0x7f85a00615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8594002f70 tx=0x7f8594007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f859e7fc700 1 --2- 172.21.15.63:0/901849725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a00b2860 0x7f85a00615e0 secure :-1 s=READY pgs=835 cs=0 l=1 rx=0x7f8594002f70 tx=0x7f8594007a80).ready entity=mon.0 client_cookie=d0f561cb77fcce27 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:08.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f859e7fc700 1 --2- 172.21.15.63:0/901849725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a00b2860 0x7f85a00615e0 secure :-1 s=THROTTLE_DONE pgs=835 cs=0 l=1 rx=0x7f8594002f70 tx=0x7f8594007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f859e7fc700 1 --2- 172.21.15.63:0/901849725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a00b2860 0x7f85a00615e0 secure :-1 s=THROTTLE_DONE pgs=835 cs=0 l=1 rx=0x7f8594002f70 tx=0x7f8594007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f859dffb700 1 -- 172.21.15.63:0/901849725 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8594011760 con 0x7f85a00b2860 2020-05-18T21:30:08.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f859e7fc700 1 --2- 172.21.15.63:0/901849725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a00b2860 0x7f85a00615e0 secure :-1 s=THROTTLE_DONE pgs=835 cs=0 l=1 rx=0x7f8594002f70 tx=0x7f8594007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f859dffb700 1 -- 172.21.15.63:0/901849725 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85940118c0 con 0x7f85a00b2860 2020-05-18T21:30:08.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f859dffb700 1 -- 172.21.15.63:0/901849725 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8594011ce0 con 0x7f85a00b2860 2020-05-18T21:30:08.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f85a5261700 1 -- 172.21.15.63:0/901849725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a00b2860 msgr2=0x7f85a00615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.733+0000 7f85a5261700 1 --2- 172.21.15.63:0/901849725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a00b2860 0x7f85a00615e0 secure :-1 s=READY pgs=835 cs=0 l=1 rx=0x7f8594002f70 tx=0x7f8594007a80).stop 2020-05-18T21:30:08.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.737+0000 7f85a5261700 1 -- 172.21.15.63:0/901849725 shutdown_connections 2020-05-18T21:30:08.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.737+0000 7f85a5261700 1 --2- 172.21.15.63:0/901849725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a00b2860 0x7f85a00615e0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:08.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.737+0000 7f85a5261700 1 -- 172.21.15.63:0/901849725 >> 172.21.15.63:0/901849725 conn(0x7f85a00b83d0 msgr2=0x7f85a00b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:08.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.737+0000 7f85a5261700 1 -- 172.21.15.63:0/901849725 shutdown_connections 2020-05-18T21:30:08.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.737+0000 7f85a5261700 1 -- 172.21.15.63:0/901849725 wait complete. 2020-05-18T21:30:08.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.737+0000 7f85a5261700 1 Processor -- start 2020-05-18T21:30:08.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.737+0000 7f85a5261700 1 -- start start 2020-05-18T21:30:08.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.737+0000 7f85a5261700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85a0060b90 0x7f85a0147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:08.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.737+0000 7f85a5261700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85a00b2860 0x7f85a0146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:08.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.737+0000 7f85a5261700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f85a014e570 0x7f85a0147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:08.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.737+0000 7f85a5261700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a0145e70 con 0x7f85a0060b90 2020-05-18T21:30:08.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.737+0000 7f85a5261700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a0147480 con 0x7f85a014e570 2020-05-18T21:30:08.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.737+0000 7f85a5261700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a0146640 con 0x7f85a00b2860 2020-05-18T21:30:08.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.737+0000 7f859effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85a0060b90 0x7f85a0147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:08.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.737+0000 7f859effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85a0060b90 0x7f85a0147de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57050/0 (socket says 172.21.15.63:57050) 2020-05-18T21:30:08.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f859effd700 1 -- 172.21.15.63:0/493232354 learned_addr learned my addr 172.21.15.63:0/493232354 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:08.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f859e7fc700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85a00b2860 0x7f85a0146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:08.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f859f7fe700 1 --2- 172.21.15.63:0/493232354 >> v2:172.21.15.155:3300/0 conn(0x7f85a014e570 0x7f85a0147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f859effd700 1 -- 172.21.15.63:0/493232354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85a00b2860 msgr2=0x7f85a0146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f859effd700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85a00b2860 0x7f85a0146010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f859effd700 1 -- 172.21.15.63:0/493232354 >> v2:172.21.15.155:3300/0 conn(0x7f85a014e570 msgr2=0x7f85a0147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f859effd700 1 --2- 172.21.15.63:0/493232354 >> v2:172.21.15.155:3300/0 conn(0x7f85a014e570 0x7f85a0147020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f859effd700 1 -- 172.21.15.63:0/493232354 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a01468e0 con 0x7f85a0060b90 2020-05-18T21:30:08.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f859effd700 1 --2- 172.21.15.63:0/493232354 >> v2:172.21.15.63:3300/0 conn(0x7f85a0060b90 0x7f85a0147de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f85a0067d20 tx=0x7f8590010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f859effd700 1 --2- 172.21.15.63:0/493232354 >> v2:172.21.15.63:3300/0 conn(0x7f85a0060b90 0x7f85a0147de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f85a0067d20 tx=0x7f8590010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f859effd700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a0060b90 0x7f85a0147de0 secure :-1 s=READY pgs=836 cs=0 l=1 rx=0x7f85a0067d20 tx=0x7f8590010930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:08.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f859effd700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a0060b90 0x7f85a0147de0 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7f85a0067d20 tx=0x7f8590010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f858ffff700 1 -- 172.21.15.63:0/493232354 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8590011590 con 0x7f85a0060b90 2020-05-18T21:30:08.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f859effd700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a0060b90 0x7f85a0147de0 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7f85a0067d20 tx=0x7f8590010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f85a5261700 1 -- 172.21.15.63:0/493232354 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a0146b80 con 0x7f85a0060b90 2020-05-18T21:30:08.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f858ffff700 1 -- 172.21.15.63:0/493232354 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85900116f0 con 0x7f85a0060b90 2020-05-18T21:30:08.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f859effd700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a0060b90 0x7f85a0147de0 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7f85a0067d20 tx=0x7f8590010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f858ffff700 1 -- 172.21.15.63:0/493232354 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8590011b10 con 0x7f85a0060b90 2020-05-18T21:30:08.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f85a5261700 1 -- 172.21.15.63:0/493232354 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a0064a40 con 0x7f85a0060b90 2020-05-18T21:30:08.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f859effd700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a0060b90 0x7f85a0147de0 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7f85a0067d20 tx=0x7f8590010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f85a5261700 1 -- 172.21.15.63:0/493232354 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a00569e0 con 0x7f85a0060b90 2020-05-18T21:30:08.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.741+0000 7f858ffff700 1 -- 172.21.15.63:0/493232354 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f859000b370 con 0x7f85a0060b90 2020-05-18T21:30:08.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.745+0000 7f859effd700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a0060b90 0x7f85a0147de0 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7f85a0067d20 tx=0x7f8590010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.745+0000 7f858ffff700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f857c04fa90 0x7f857c051f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:08.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.745+0000 7f858ffff700 1 -- 172.21.15.63:0/493232354 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8590063e50 con 0x7f85a0060b90 2020-05-18T21:30:08.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.745+0000 7f859e7fc700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f857c04fa90 0x7f857c051f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:08.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.745+0000 7f859e7fc700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f857c04fa90 0x7f857c051f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8594002f70 tx=0x7f8594007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.745+0000 7f859e7fc700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f857c04fa90 0x7f857c051f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8594002f70 tx=0x7f8594007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.745+0000 7f859e7fc700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f857c04fa90 0x7f857c051f50 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7f8594002f70 tx=0x7f8594007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:08.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.749+0000 7f859effd700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a0060b90 0x7f85a0147de0 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7f85a0067d20 tx=0x7f8590010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.749+0000 7f858ffff700 1 -- 172.21.15.63:0/493232354 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f859003e180 con 0x7f85a0060b90 2020-05-18T21:30:08.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.869+0000 7f85a5261700 1 -- 172.21.15.63:0/493232354 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85a00008d0 con 0x7f85a0060b90 2020-05-18T21:30:08.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.869+0000 7f859effd700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a0060b90 0x7f85a0147de0 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7f85a0067d20 tx=0x7f8590010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:08.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.869+0000 7f858ffff700 1 -- 172.21.15.63:0/493232354 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16105 (secure 0 0 0) 0x7f85900417a0 con 0x7f85a0060b90 2020-05-18T21:30:08.876 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:08.876 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":72,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:30:08.364827+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:30:06.278977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2020-05-18T21:30:07.362909+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:30:08.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.873+0000 7f85a5261700 1 -- 172.21.15.63:0/493232354 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f857c04fa90 msgr2=0x7f857c051f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.873+0000 7f85a5261700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f857c04fa90 0x7f857c051f50 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7f8594002f70 tx=0x7f8594007a80).stop 2020-05-18T21:30:08.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.873+0000 7f85a5261700 1 -- 172.21.15.63:0/493232354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a0060b90 msgr2=0x7f85a0147de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:08.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.873+0000 7f85a5261700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a0060b90 0x7f85a0147de0 secure :-1 s=READY pgs=836 cs=0 l=1 rx=0x7f85a0067d20 tx=0x7f8590010930).stop 2020-05-18T21:30:08.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.873+0000 7f85a5261700 1 -- 172.21.15.63:0/493232354 shutdown_connections 2020-05-18T21:30:08.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.873+0000 7f85a5261700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f857c04fa90 0x7f857c051f50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:08.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.873+0000 7f85a5261700 1 --2- 172.21.15.63:0/493232354 >> v2:172.21.15.155:3300/0 conn(0x7f85a014e570 0x7f85a0147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:08.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.873+0000 7f85a5261700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85a00b2860 0x7f85a0146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:08.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.873+0000 7f85a5261700 1 --2- 172.21.15.63:0/493232354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a0060b90 0x7f85a0147de0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:08.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.873+0000 7f85a5261700 1 -- 172.21.15.63:0/493232354 >> 172.21.15.63:0/493232354 conn(0x7f85a00b83d0 msgr2=0x7f85a00b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:08.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.873+0000 7f85a5261700 1 -- 172.21.15.63:0/493232354 shutdown_connections 2020-05-18T21:30:08.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:08.873+0000 7f85a5261700 1 -- 172.21.15.63:0/493232354 wait complete. 2020-05-18T21:30:08.893 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-05-18T21:30:09.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.009+0000 7f9c7e192700 1 Processor -- start 2020-05-18T21:30:09.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.009+0000 7f9c7e192700 1 -- start start 2020-05-18T21:30:09.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.009+0000 7f9c7e192700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c78143630 0x7f9c78060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:09.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.009+0000 7f9c7e192700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c78146420 con 0x7f9c780bc8d0 2020-05-18T21:30:09.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.009+0000 7f9c7e192700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c781466c0 con 0x7f9c78145e30 2020-05-18T21:30:09.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.009+0000 7f9c7e192700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c78146e00 con 0x7f9c78143630 2020-05-18T21:30:09.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7c98f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c78143630 0x7f9c78060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:09.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7c98f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c78143630 0x7f9c78060b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57060/0 (socket says 172.21.15.63:57060) 2020-05-18T21:30:09.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7d190700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9c780bc8d0 0x7f9c78142f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59246/0 (socket says 172.21.15.63:59246) 2020-05-18T21:30:09.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7c98f700 1 -- 172.21.15.63:0/3461103660 learned_addr learned my addr 172.21.15.63:0/3461103660 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:09.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7c98f700 1 -- 172.21.15.63:0/3461103660 >> v1:172.21.15.155:6789/0 conn(0x7f9c78145e30 legacy=0x7f9c7812e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:09.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c6bfff700 1 -- 172.21.15.63:0/3461103660 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697359253 0 0) 0x7f9c78146420 con 0x7f9c780bc8d0 2020-05-18T21:30:09.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7c98f700 1 -- 172.21.15.63:0/3461103660 >> v1:172.21.15.63:6789/0 conn(0x7f9c780bc8d0 legacy=0x7f9c78142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:09.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7c98f700 1 -- 172.21.15.63:0/3461103660 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c78146960 con 0x7f9c78143630 2020-05-18T21:30:09.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7c98f700 1 --2- 172.21.15.63:0/3461103660 >> v2:172.21.15.63:3300/0 conn(0x7f9c78143630 0x7f9c78060b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9c700013c0 tx=0x7f9c78061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:09.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7c98f700 1 --2- 172.21.15.63:0/3461103660 >> v2:172.21.15.63:3300/0 conn(0x7f9c78143630 0x7f9c78060b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9c700013c0 tx=0x7f9c78061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:09.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7c98f700 1 --2- 172.21.15.63:0/3461103660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c78143630 0x7f9c78060b00 secure :-1 s=READY pgs=838 cs=0 l=1 rx=0x7f9c700013c0 tx=0x7f9c78061d60).ready entity=mon.0 client_cookie=fe84104ba687712d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:09.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7c98f700 1 --2- 172.21.15.63:0/3461103660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c78143630 0x7f9c78060b00 secure :-1 s=THROTTLE_DONE pgs=838 cs=0 l=1 rx=0x7f9c700013c0 tx=0x7f9c78061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:09.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7c98f700 1 --2- 172.21.15.63:0/3461103660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c78143630 0x7f9c78060b00 secure :-1 s=THROTTLE_DONE pgs=838 cs=0 l=1 rx=0x7f9c700013c0 tx=0x7f9c78061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:09.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c6bfff700 1 -- 172.21.15.63:0/3461103660 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c6c008e50 con 0x7f9c78143630 2020-05-18T21:30:09.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7c98f700 1 --2- 172.21.15.63:0/3461103660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c78143630 0x7f9c78060b00 secure :-1 s=THROTTLE_DONE pgs=838 cs=0 l=1 rx=0x7f9c700013c0 tx=0x7f9c78061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:09.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c6bfff700 1 -- 172.21.15.63:0/3461103660 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c0107f0 con 0x7f9c78143630 2020-05-18T21:30:09.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c6bfff700 1 -- 172.21.15.63:0/3461103660 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c6c010bd0 con 0x7f9c78143630 2020-05-18T21:30:09.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7e192700 1 -- 172.21.15.63:0/3461103660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c78143630 msgr2=0x7f9c78060b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7e192700 1 --2- 172.21.15.63:0/3461103660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c78143630 0x7f9c78060b00 secure :-1 s=READY pgs=838 cs=0 l=1 rx=0x7f9c700013c0 tx=0x7f9c78061d60).stop 2020-05-18T21:30:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7e192700 1 -- 172.21.15.63:0/3461103660 shutdown_connections 2020-05-18T21:30:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7e192700 1 --2- 172.21.15.63:0/3461103660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c78143630 0x7f9c78060b00 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7e192700 1 -- 172.21.15.63:0/3461103660 >> 172.21.15.63:0/3461103660 conn(0x7f9c7805f3b0 msgr2=0x7f9c7805f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7e192700 1 -- 172.21.15.63:0/3461103660 shutdown_connections 2020-05-18T21:30:09.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.013+0000 7f9c7e192700 1 -- 172.21.15.63:0/3461103660 wait complete. 2020-05-18T21:30:09.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7e192700 1 Processor -- start 2020-05-18T21:30:09.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7e192700 1 -- start start 2020-05-18T21:30:09.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7e192700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c780bc8d0 0x7f9c780acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:09.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7e192700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c780aedd0 con 0x7f9c78143630 2020-05-18T21:30:09.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7e192700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c780acf20 con 0x7f9c78145e30 2020-05-18T21:30:09.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7e192700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c780af040 con 0x7f9c780bc8d0 2020-05-18T21:30:09.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7c98f700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9c78143630 0x7f9c780ae6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59254/0 (socket says 172.21.15.63:59254) 2020-05-18T21:30:09.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7c98f700 1 -- 172.21.15.63:0/1831911341 learned_addr learned my addr 172.21.15.63:0/1831911341 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:09.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7d190700 1 --2- 172.21.15.63:0/1831911341 >> v2:172.21.15.155:3300/0 conn(0x7f9c780bc8d0 0x7f9c780acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:09.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c6a7fc700 1 -- 172.21.15.63:0/1831911341 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005774783 0 0) 0x7f9c780aedd0 con 0x7f9c78143630 2020-05-18T21:30:09.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c6a7fc700 1 -- 172.21.15.63:0/1831911341 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c58002fe0 con 0x7f9c78143630 2020-05-18T21:30:09.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c6a7fc700 1 -- 172.21.15.63:0/1831911341 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1905932867 0 0) 0x7f9c58002fe0 con 0x7f9c78143630 2020-05-18T21:30:09.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7d190700 1 -- 172.21.15.63:0/1831911341 >> v1:172.21.15.155:6789/0 conn(0x7f9c78145e30 legacy=0x7f9c78153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:09.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7d190700 1 -- 172.21.15.63:0/1831911341 >> v1:172.21.15.63:6789/0 conn(0x7f9c78143630 legacy=0x7f9c780ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:09.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7d190700 1 -- 172.21.15.63:0/1831911341 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c780af2e0 con 0x7f9c780bc8d0 2020-05-18T21:30:09.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7d190700 1 --2- 172.21.15.63:0/1831911341 >> v2:172.21.15.155:3300/0 conn(0x7f9c780bc8d0 0x7f9c780acac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c6c008890 tx=0x7f9c740108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:09.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7d190700 1 --2- 172.21.15.63:0/1831911341 >> v2:172.21.15.155:3300/0 conn(0x7f9c780bc8d0 0x7f9c780acac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c6c008890 tx=0x7f9c740108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:09.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7d190700 1 --2- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c780bc8d0 0x7f9c780acac0 secure :-1 s=READY pgs=605 cs=0 l=1 rx=0x7f9c6c008890 tx=0x7f9c740108e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:09.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7d190700 1 --2- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c780bc8d0 0x7f9c780acac0 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7f9c6c008890 tx=0x7f9c740108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:09.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c6a7fc700 1 -- 172.21.15.63:0/1831911341 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c6c0086f0 con 0x7f9c780bc8d0 2020-05-18T21:30:09.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7d190700 1 --2- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c780bc8d0 0x7f9c780acac0 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7f9c6c008890 tx=0x7f9c740108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:09.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7d190700 1 --2- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c780bc8d0 0x7f9c780acac0 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7f9c6c008890 tx=0x7f9c740108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:09.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c6a7fc700 1 -- 172.21.15.63:0/1831911341 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c740111f0 con 0x7f9c780bc8d0 2020-05-18T21:30:09.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7e192700 1 -- 172.21.15.63:0/1831911341 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c780af580 con 0x7f9c780bc8d0 2020-05-18T21:30:09.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c6a7fc700 1 -- 172.21.15.63:0/1831911341 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c74011550 con 0x7f9c780bc8d0 2020-05-18T21:30:09.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.017+0000 7f9c7e192700 1 -- 172.21.15.63:0/1831911341 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c781535e0 con 0x7f9c780bc8d0 2020-05-18T21:30:09.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.021+0000 7f9c7e192700 1 -- 172.21.15.63:0/1831911341 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c780569e0 con 0x7f9c780bc8d0 2020-05-18T21:30:09.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.021+0000 7f9c7d190700 1 --2- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c780bc8d0 0x7f9c780acac0 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7f9c6c008890 tx=0x7f9c740108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:09.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.021+0000 7f9c6a7fc700 1 -- 172.21.15.63:0/1831911341 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9c740117c0 con 0x7f9c780bc8d0 2020-05-18T21:30:09.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.021+0000 7f9c7d190700 1 --2- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c780bc8d0 0x7f9c780acac0 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7f9c6c008890 tx=0x7f9c740108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:09.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.021+0000 7f9c6a7fc700 1 --2- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5804fcf0 0x7f9c580521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:09.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.021+0000 7f9c6a7fc700 1 -- 172.21.15.63:0/1831911341 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9c740636e0 con 0x7f9c780bc8d0 2020-05-18T21:30:09.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.021+0000 7f9c7c98f700 1 --2- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5804fcf0 0x7f9c580521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:09.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.021+0000 7f9c7c98f700 1 --2- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5804fcf0 0x7f9c580521b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c6c008850 tx=0x7f9c78061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:09.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.021+0000 7f9c7c98f700 1 --2- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5804fcf0 0x7f9c580521b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c6c008850 tx=0x7f9c78061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:09.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.021+0000 7f9c7c98f700 1 --2- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5804fcf0 0x7f9c580521b0 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7f9c6c008850 tx=0x7f9c78061d60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:09.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.029+0000 7f9c7d190700 1 --2- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c780bc8d0 0x7f9c780acac0 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7f9c6c008890 tx=0x7f9c740108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:09.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.029+0000 7f9c6a7fc700 1 -- 172.21.15.63:0/1831911341 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9c7403da70 con 0x7f9c780bc8d0 2020-05-18T21:30:09.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:09.185+0000 7f9c7e192700 1 -- 172.21.15.63:0/1831911341 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9c780b8710 con 0x7f9c780bc8d0 2020-05-18T21:30:10.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.017+0000 7f9c7d190700 1 --2- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c780bc8d0 0x7f9c780acac0 secure :-1 s=READY pgs=605 cs=0 l=1 rx=0x7f9c6c008890 tx=0x7f9c740108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.077+0000 7f9c7d190700 1 --2- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c780bc8d0 0x7f9c780acac0 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7f9c6c008890 tx=0x7f9c740108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.077+0000 7f9c6a7fc700 1 -- 172.21.15.63:0/1831911341 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v40) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9c74041090 con 0x7f9c780bc8d0 2020-05-18T21:30:10.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.081+0000 7f9c7e192700 1 -- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5804fcf0 msgr2=0x7f9c580521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.081+0000 7f9c7e192700 1 --2- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5804fcf0 0x7f9c580521b0 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7f9c6c008850 tx=0x7f9c78061d60).stop 2020-05-18T21:30:10.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.081+0000 7f9c7e192700 1 -- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c780bc8d0 msgr2=0x7f9c780acac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.081+0000 7f9c7e192700 1 --2- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c780bc8d0 0x7f9c780acac0 secure :-1 s=READY pgs=605 cs=0 l=1 rx=0x7f9c6c008890 tx=0x7f9c740108e0).stop 2020-05-18T21:30:10.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.081+0000 7f9c7e192700 1 -- 172.21.15.63:0/1831911341 shutdown_connections 2020-05-18T21:30:10.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.081+0000 7f9c7e192700 1 --2- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5804fcf0 0x7f9c580521b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:10.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.081+0000 7f9c7e192700 1 --2- 172.21.15.63:0/1831911341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c780bc8d0 0x7f9c780acac0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:10.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.081+0000 7f9c7e192700 1 -- 172.21.15.63:0/1831911341 >> 172.21.15.63:0/1831911341 conn(0x7f9c7805f3b0 msgr2=0x7f9c7812ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:10.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.081+0000 7f9c7e192700 1 -- 172.21.15.63:0/1831911341 shutdown_connections 2020-05-18T21:30:10.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.081+0000 7f9c7e192700 1 -- 172.21.15.63:0/1831911341 wait complete. 2020-05-18T21:30:10.104 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:30:10.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.221+0000 7fadf2c55700 1 Processor -- start 2020-05-18T21:30:10.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.221+0000 7fadf2c55700 1 -- start start 2020-05-18T21:30:10.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.221+0000 7fadf2c55700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fadec13de20 0x7fadec0b6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:10.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.221+0000 7fadf2c55700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fadec144810 0x7fadec06a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:10.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadf2c55700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec0b4f60 0x7fadec0b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:10.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadf2c55700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadec069b70 con 0x7fadec144810 2020-05-18T21:30:10.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadf2c55700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadec069e10 con 0x7fadec13de20 2020-05-18T21:30:10.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadf2c55700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec06a0b0 con 0x7fadec0b4f60 2020-05-18T21:30:10.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadebfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fadec144810 0x7fadec06a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:10.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadebfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fadec144810 0x7fadec06a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57074/0 (socket says 172.21.15.63:57074) 2020-05-18T21:30:10.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadebfff700 1 -- 172.21.15.63:0/3863906974 learned_addr learned my addr 172.21.15.63:0/3863906974 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:10.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadf11f2700 1 --2- 172.21.15.63:0/3863906974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec0b4f60 0x7fadec0b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:10.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadf09f1700 1 --2- 172.21.15.63:0/3863906974 >> v2:172.21.15.155:3300/0 conn(0x7fadec13de20 0x7fadec0b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:10.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadebfff700 1 -- 172.21.15.63:0/3863906974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec0b4f60 msgr2=0x7fadec0b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:10.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadebfff700 1 --2- 172.21.15.63:0/3863906974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec0b4f60 0x7fadec0b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:10.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadebfff700 1 -- 172.21.15.63:0/3863906974 >> v2:172.21.15.155:3300/0 conn(0x7fadec13de20 msgr2=0x7fadec0b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:10.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadebfff700 1 --2- 172.21.15.63:0/3863906974 >> v2:172.21.15.155:3300/0 conn(0x7fadec13de20 0x7fadec0b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:10.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadebfff700 1 -- 172.21.15.63:0/3863906974 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec144c50 con 0x7fadec144810 2020-05-18T21:30:10.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadebfff700 1 --2- 172.21.15.63:0/3863906974 >> v2:172.21.15.63:3300/0 conn(0x7fadec144810 0x7fadec06a550 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fadd8002f70 tx=0x7fadd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadebfff700 1 --2- 172.21.15.63:0/3863906974 >> v2:172.21.15.63:3300/0 conn(0x7fadec144810 0x7fadec06a550 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fadd8002f70 tx=0x7fadd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadebfff700 1 --2- 172.21.15.63:0/3863906974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadec144810 0x7fadec06a550 secure :-1 s=READY pgs=840 cs=0 l=1 rx=0x7fadd8002f70 tx=0x7fadd8007a80).ready entity=mon.0 client_cookie=fb754a69b4ff94b6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:10.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadebfff700 1 --2- 172.21.15.63:0/3863906974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadec144810 0x7fadec06a550 secure :-1 s=THROTTLE_DONE pgs=840 cs=0 l=1 rx=0x7fadd8002f70 tx=0x7fadd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadeb7fe700 1 -- 172.21.15.63:0/3863906974 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadd8011600 con 0x7fadec144810 2020-05-18T21:30:10.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadebfff700 1 --2- 172.21.15.63:0/3863906974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadec144810 0x7fadec06a550 secure :-1 s=THROTTLE_DONE pgs=840 cs=0 l=1 rx=0x7fadd8002f70 tx=0x7fadd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadebfff700 1 --2- 172.21.15.63:0/3863906974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadec144810 0x7fadec06a550 secure :-1 s=THROTTLE_DONE pgs=840 cs=0 l=1 rx=0x7fadd8002f70 tx=0x7fadd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadeb7fe700 1 -- 172.21.15.63:0/3863906974 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd8011760 con 0x7fadec144810 2020-05-18T21:30:10.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadeb7fe700 1 -- 172.21.15.63:0/3863906974 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadd8011b80 con 0x7fadec144810 2020-05-18T21:30:10.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadf2c55700 1 -- 172.21.15.63:0/3863906974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadec144810 msgr2=0x7fadec06a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadf2c55700 1 --2- 172.21.15.63:0/3863906974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadec144810 0x7fadec06a550 secure :-1 s=READY pgs=840 cs=0 l=1 rx=0x7fadd8002f70 tx=0x7fadd8007a80).stop 2020-05-18T21:30:10.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadf2c55700 1 -- 172.21.15.63:0/3863906974 shutdown_connections 2020-05-18T21:30:10.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadf2c55700 1 --2- 172.21.15.63:0/3863906974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec0b4f60 0x7fadec0b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:10.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadf2c55700 1 --2- 172.21.15.63:0/3863906974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadec144810 0x7fadec06a550 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:10.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadf2c55700 1 --2- 172.21.15.63:0/3863906974 >> v2:172.21.15.155:3300/0 conn(0x7fadec13de20 0x7fadec0b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:10.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadf2c55700 1 -- 172.21.15.63:0/3863906974 >> 172.21.15.63:0/3863906974 conn(0x7fadec0ba5c0 msgr2=0x7fadec0ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:10.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadf2c55700 1 -- 172.21.15.63:0/3863906974 shutdown_connections 2020-05-18T21:30:10.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.225+0000 7fadf2c55700 1 -- 172.21.15.63:0/3863906974 wait complete. 2020-05-18T21:30:10.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.229+0000 7fadf2c55700 1 Processor -- start 2020-05-18T21:30:10.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.229+0000 7fadf2c55700 1 -- start start 2020-05-18T21:30:10.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.229+0000 7fadf2c55700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec13de20 0x7fadec140b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:10.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.229+0000 7fadf2c55700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadec0b2690 con 0x7fadec0b4f60 2020-05-18T21:30:10.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.229+0000 7fadf2c55700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadec13e4e0 con 0x7fadec144810 2020-05-18T21:30:10.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.229+0000 7fadf2c55700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec146a90 con 0x7fadec13de20 2020-05-18T21:30:10.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.229+0000 7fadf09f1700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fadec0b4f60 0x7fadec13bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59266/0 (socket says 172.21.15.63:59266) 2020-05-18T21:30:10.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.229+0000 7fadf09f1700 1 -- 172.21.15.63:0/4243563631 learned_addr learned my addr 172.21.15.63:0/4243563631 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:10.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.229+0000 7fadebfff700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec13de20 0x7fadec140b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:10.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.229+0000 7fade9ffb700 1 -- 172.21.15.63:0/4243563631 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009183663 0 0) 0x7fadec0b2690 con 0x7fadec0b4f60 2020-05-18T21:30:10.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.229+0000 7fade9ffb700 1 -- 172.21.15.63:0/4243563631 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadd4002fe0 con 0x7fadec0b4f60 2020-05-18T21:30:10.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.229+0000 7fade9ffb700 1 -- 172.21.15.63:0/4243563631 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275933169 0 0) 0x7fadec13e4e0 con 0x7fadec144810 2020-05-18T21:30:10.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.229+0000 7fade9ffb700 1 -- 172.21.15.63:0/4243563631 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadec0b2690 con 0x7fadec144810 2020-05-18T21:30:10.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.229+0000 7fadebfff700 1 -- 172.21.15.63:0/4243563631 >> v1:172.21.15.155:6789/0 conn(0x7fadec144810 legacy=0x7fadec0b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.229+0000 7fadebfff700 1 -- 172.21.15.63:0/4243563631 >> v1:172.21.15.63:6789/0 conn(0x7fadec0b4f60 legacy=0x7fadec13bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.229+0000 7fadebfff700 1 -- 172.21.15.63:0/4243563631 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec0b28c0 con 0x7fadec13de20 2020-05-18T21:30:10.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.229+0000 7fadebfff700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec13de20 0x7fadec140b10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fadd8002f70 tx=0x7fadd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.233+0000 7fadebfff700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec13de20 0x7fadec140b10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fadd8002f70 tx=0x7fadd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.233+0000 7fadebfff700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec13de20 0x7fadec140b10 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7fadd8002f70 tx=0x7fadd8007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:10.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.233+0000 7fadebfff700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec13de20 0x7fadec140b10 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fadd8002f70 tx=0x7fadd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.233+0000 7fade9ffb700 1 -- 172.21.15.63:0/4243563631 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadd8008770 con 0x7fadec13de20 2020-05-18T21:30:10.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.233+0000 7fadf2c55700 1 -- 172.21.15.63:0/4243563631 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadec13c690 con 0x7fadec13de20 2020-05-18T21:30:10.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.233+0000 7fadebfff700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec13de20 0x7fadec140b10 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fadd8002f70 tx=0x7fadd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.233+0000 7fadebfff700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec13de20 0x7fadec140b10 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fadd8002f70 tx=0x7fadd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.233+0000 7fade9ffb700 1 -- 172.21.15.63:0/4243563631 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd8007170 con 0x7fadec13de20 2020-05-18T21:30:10.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.233+0000 7fade9ffb700 1 -- 172.21.15.63:0/4243563631 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadd8007510 con 0x7fadec13de20 2020-05-18T21:30:10.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.233+0000 7fadf2c55700 1 -- 172.21.15.63:0/4243563631 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadec146670 con 0x7fadec13de20 2020-05-18T21:30:10.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.233+0000 7fadebfff700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec13de20 0x7fadec140b10 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fadd8002f70 tx=0x7fadd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.233+0000 7fadf2c55700 1 -- 172.21.15.63:0/4243563631 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadec146bd0 con 0x7fadec13de20 2020-05-18T21:30:10.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.233+0000 7fade9ffb700 1 -- 172.21.15.63:0/4243563631 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fadd8005700 con 0x7fadec13de20 2020-05-18T21:30:10.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.233+0000 7fadebfff700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec13de20 0x7fadec140b10 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fadd8002f70 tx=0x7fadd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.233+0000 7fade9ffb700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fadd404fe30 0x7fadd40522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:10.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.233+0000 7fade9ffb700 1 -- 172.21.15.63:0/4243563631 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fadd8064210 con 0x7fadec13de20 2020-05-18T21:30:10.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.233+0000 7fadf09f1700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fadd404fe30 0x7fadd40522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:10.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.237+0000 7fadf09f1700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fadd404fe30 0x7fadd40522f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fade0002f70 tx=0x7fade00090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.237+0000 7fadf09f1700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fadd404fe30 0x7fadd40522f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fade0002f70 tx=0x7fade00090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.237+0000 7fadf09f1700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fadd404fe30 0x7fadd40522f0 secure :-1 s=READY pgs=342 cs=0 l=1 rx=0x7fade0002f70 tx=0x7fade00090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:10.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.245+0000 7fadebfff700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec13de20 0x7fadec140b10 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fadd8002f70 tx=0x7fadd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.245+0000 7fade9ffb700 1 -- 172.21.15.63:0/4243563631 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fadd803e660 con 0x7fadec13de20 2020-05-18T21:30:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.393+0000 7fadf2c55700 1 -- 172.21.15.63:0/4243563631 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadec0b2a50 con 0x7fadec13de20 2020-05-18T21:30:10.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.393+0000 7fadebfff700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec13de20 0x7fadec140b10 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fadd8002f70 tx=0x7fadd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.393+0000 7fade9ffb700 1 -- 172.21.15.63:0/4243563631 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+2137 (secure 0 0 0) 0x7fadd8041c80 con 0x7fadec13de20 2020-05-18T21:30:10.398 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:10.399 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":40,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5336,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/129631814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":129631814},{"type":"v1","addr":"172.21.15.63:6833","nonce":129631814}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":37}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:10.069167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5339},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5339":{"gid":5339,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/802454809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":802454809},{"type":"v1","addr":"172.21.15.155:6835","nonce":802454809}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:30:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.397+0000 7fadf2c55700 1 -- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fadd404fe30 msgr2=0x7fadd40522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.397+0000 7fadf2c55700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fadd404fe30 0x7fadd40522f0 secure :-1 s=READY pgs=342 cs=0 l=1 rx=0x7fade0002f70 tx=0x7fade00090f0).stop 2020-05-18T21:30:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.397+0000 7fadf2c55700 1 -- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec13de20 msgr2=0x7fadec140b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.397+0000 7fadf2c55700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec13de20 0x7fadec140b10 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7fadd8002f70 tx=0x7fadd8007a80).stop 2020-05-18T21:30:10.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.397+0000 7fadf2c55700 1 -- 172.21.15.63:0/4243563631 shutdown_connections 2020-05-18T21:30:10.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.397+0000 7fadf2c55700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fadd404fe30 0x7fadd40522f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:10.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.397+0000 7fadf2c55700 1 --2- 172.21.15.63:0/4243563631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadec13de20 0x7fadec140b10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:10.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.397+0000 7fadf2c55700 1 -- 172.21.15.63:0/4243563631 >> 172.21.15.63:0/4243563631 conn(0x7fadec0ba5c0 msgr2=0x7fadec0b7060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:10.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.397+0000 7fadf2c55700 1 -- 172.21.15.63:0/4243563631 shutdown_connections 2020-05-18T21:30:10.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.397+0000 7fadf2c55700 1 -- 172.21.15.63:0/4243563631 wait complete. 2020-05-18T21:30:10.403 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 40 2020-05-18T21:30:10.417 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:30:10.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.513+0000 7fd2cbfff700 1 Processor -- start 2020-05-18T21:30:10.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.513+0000 7fd2cbfff700 1 -- start start 2020-05-18T21:30:10.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cbfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd2cc05f110 0x7fd2cc0acea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:10.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cbfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd2cc13c710 0x7fd2cc13cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:10.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cbfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2cc13cfa0 con 0x7fd2cc0659d0 2020-05-18T21:30:10.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cbfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2cc0b4af0 con 0x7fd2cc13c710 2020-05-18T21:30:10.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cbfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2cc1460e0 con 0x7fd2cc05f110 2020-05-18T21:30:10.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cb7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd2cc13c710 0x7fd2cc13cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:10.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cb7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd2cc13c710 0x7fd2cc13cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57090/0 (socket says 172.21.15.63:57090) 2020-05-18T21:30:10.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cb7fe700 1 -- 172.21.15.63:0/2759123960 learned_addr learned my addr 172.21.15.63:0/2759123960 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:10.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2caffd700 1 --2- 172.21.15.63:0/2759123960 >> v2:172.21.15.155:3300/0 conn(0x7fd2cc05f110 0x7fd2cc0acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:10.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cb7fe700 1 -- 172.21.15.63:0/2759123960 >> v2:172.21.15.155:3300/0 conn(0x7fd2cc05f110 msgr2=0x7fd2cc0acea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:10.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cb7fe700 1 --2- 172.21.15.63:0/2759123960 >> v2:172.21.15.155:3300/0 conn(0x7fd2cc05f110 0x7fd2cc0acea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:10.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cb7fe700 1 -- 172.21.15.63:0/2759123960 >> v1:172.21.15.155:6789/0 conn(0x7fd2cc0659d0 legacy=0x7fd2cc146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cb7fe700 1 -- 172.21.15.63:0/2759123960 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2cc146380 con 0x7fd2cc13c710 2020-05-18T21:30:10.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cb7fe700 1 --2- 172.21.15.63:0/2759123960 >> v2:172.21.15.63:3300/0 conn(0x7fd2cc13c710 0x7fd2cc13cb40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd2c40032f0 tx=0x7fd2c4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cb7fe700 1 --2- 172.21.15.63:0/2759123960 >> v2:172.21.15.63:3300/0 conn(0x7fd2cc13c710 0x7fd2cc13cb40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd2c40032f0 tx=0x7fd2c4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cb7fe700 1 --2- 172.21.15.63:0/2759123960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2cc13c710 0x7fd2cc13cb40 secure :-1 s=READY pgs=842 cs=0 l=1 rx=0x7fd2c40032f0 tx=0x7fd2c4007e00).ready entity=mon.0 client_cookie=95d52fff6734942 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:10.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cb7fe700 1 --2- 172.21.15.63:0/2759123960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2cc13c710 0x7fd2cc13cb40 secure :-1 s=THROTTLE_DONE pgs=842 cs=0 l=1 rx=0x7fd2c40032f0 tx=0x7fd2c4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2ca7fc700 1 -- 172.21.15.63:0/2759123960 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c4011dc0 con 0x7fd2cc13c710 2020-05-18T21:30:10.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cb7fe700 1 --2- 172.21.15.63:0/2759123960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2cc13c710 0x7fd2cc13cb40 secure :-1 s=THROTTLE_DONE pgs=842 cs=0 l=1 rx=0x7fd2c40032f0 tx=0x7fd2c4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cb7fe700 1 --2- 172.21.15.63:0/2759123960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2cc13c710 0x7fd2cc13cb40 secure :-1 s=THROTTLE_DONE pgs=842 cs=0 l=1 rx=0x7fd2c40032f0 tx=0x7fd2c4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2ca7fc700 1 -- 172.21.15.63:0/2759123960 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c400a180 con 0x7fd2cc13c710 2020-05-18T21:30:10.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2ca7fc700 1 -- 172.21.15.63:0/2759123960 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c400a5a0 con 0x7fd2cc13c710 2020-05-18T21:30:10.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cbfff700 1 -- 172.21.15.63:0/2759123960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2cc13c710 msgr2=0x7fd2cc13cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cbfff700 1 --2- 172.21.15.63:0/2759123960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2cc13c710 0x7fd2cc13cb40 secure :-1 s=READY pgs=842 cs=0 l=1 rx=0x7fd2c40032f0 tx=0x7fd2c4007e00).stop 2020-05-18T21:30:10.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cbfff700 1 -- 172.21.15.63:0/2759123960 shutdown_connections 2020-05-18T21:30:10.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cbfff700 1 --2- 172.21.15.63:0/2759123960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2cc13c710 0x7fd2cc13cb40 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:10.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cbfff700 1 --2- 172.21.15.63:0/2759123960 >> v2:172.21.15.155:3300/0 conn(0x7fd2cc05f110 0x7fd2cc0acea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:10.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cbfff700 1 -- 172.21.15.63:0/2759123960 >> 172.21.15.63:0/2759123960 conn(0x7fd2cc069fc0 msgr2=0x7fd2cc06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:10.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cbfff700 1 -- 172.21.15.63:0/2759123960 shutdown_connections 2020-05-18T21:30:10.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cbfff700 1 -- 172.21.15.63:0/2759123960 wait complete. 2020-05-18T21:30:10.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.517+0000 7fd2cbfff700 1 Processor -- start 2020-05-18T21:30:10.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2cbfff700 1 -- start start 2020-05-18T21:30:10.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2cbfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd2cc05f110 0x7fd2cc1418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:10.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2cbfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2cc13c710 0x7fd2cc147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:10.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2cbfff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2cc134590 con 0x7fd2cc0659d0 2020-05-18T21:30:10.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2cbfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2cc140e20 con 0x7fd2cc05f110 2020-05-18T21:30:10.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2cbfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc1410c0 con 0x7fd2cc13c710 2020-05-18T21:30:10.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2caffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd2cc05f110 0x7fd2cc1418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:10.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2caffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd2cc05f110 0x7fd2cc1418c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57092/0 (socket says 172.21.15.63:57092) 2020-05-18T21:30:10.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2caffd700 1 -- 172.21.15.63:0/988223499 learned_addr learned my addr 172.21.15.63:0/988223499 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:10.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2cb7fe700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2cc13c710 0x7fd2cc147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:10.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2caffd700 1 -- 172.21.15.63:0/988223499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2cc13c710 msgr2=0x7fd2cc147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2caffd700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2cc13c710 0x7fd2cc147180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:10.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2caffd700 1 -- 172.21.15.63:0/988223499 >> v1:172.21.15.63:6789/0 conn(0x7fd2cc0659d0 legacy=0x7fd2cc133e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2caffd700 1 -- 172.21.15.63:0/988223499 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2cc143950 con 0x7fd2cc05f110 2020-05-18T21:30:10.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2caffd700 1 --2- 172.21.15.63:0/988223499 >> v2:172.21.15.63:3300/0 conn(0x7fd2cc05f110 0x7fd2cc1418c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2bc002f70 tx=0x7fd2bc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2caffd700 1 --2- 172.21.15.63:0/988223499 >> v2:172.21.15.63:3300/0 conn(0x7fd2cc05f110 0x7fd2cc1418c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2bc002f70 tx=0x7fd2bc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2caffd700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2cc05f110 0x7fd2cc1418c0 secure :-1 s=READY pgs=844 cs=0 l=1 rx=0x7fd2bc002f70 tx=0x7fd2bc010c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:10.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2caffd700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2cc05f110 0x7fd2cc1418c0 secure :-1 s=THROTTLE_DONE pgs=844 cs=0 l=1 rx=0x7fd2bc002f70 tx=0x7fd2bc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2c8ff9700 1 -- 172.21.15.63:0/988223499 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2bc012b10 con 0x7fd2cc05f110 2020-05-18T21:30:10.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2caffd700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2cc05f110 0x7fd2cc1418c0 secure :-1 s=THROTTLE_DONE pgs=844 cs=0 l=1 rx=0x7fd2bc002f70 tx=0x7fd2bc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2c8ff9700 1 -- 172.21.15.63:0/988223499 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc012c70 con 0x7fd2cc05f110 2020-05-18T21:30:10.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2caffd700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2cc05f110 0x7fd2cc1418c0 secure :-1 s=THROTTLE_DONE pgs=844 cs=0 l=1 rx=0x7fd2bc002f70 tx=0x7fd2bc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2cbfff700 1 -- 172.21.15.63:0/988223499 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2cc143440 con 0x7fd2cc05f110 2020-05-18T21:30:10.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2c8ff9700 1 -- 172.21.15.63:0/988223499 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2bc012e20 con 0x7fd2cc05f110 2020-05-18T21:30:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.521+0000 7fd2cbfff700 1 -- 172.21.15.63:0/988223499 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2cc1475e0 con 0x7fd2cc05f110 2020-05-18T21:30:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.525+0000 7fd2caffd700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2cc05f110 0x7fd2cc1418c0 secure :-1 s=THROTTLE_DONE pgs=844 cs=0 l=1 rx=0x7fd2bc002f70 tx=0x7fd2bc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.525+0000 7fd2cbfff700 1 -- 172.21.15.63:0/988223499 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2cc143630 con 0x7fd2cc05f110 2020-05-18T21:30:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.525+0000 7fd2c8ff9700 1 -- 172.21.15.63:0/988223499 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd2bc007190 con 0x7fd2cc05f110 2020-05-18T21:30:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.525+0000 7fd2caffd700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2cc05f110 0x7fd2cc1418c0 secure :-1 s=THROTTLE_DONE pgs=844 cs=0 l=1 rx=0x7fd2bc002f70 tx=0x7fd2bc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.525+0000 7fd2c8ff9700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd2b004f950 0x7fd2b0051e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.525+0000 7fd2c8ff9700 1 -- 172.21.15.63:0/988223499 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd2bc0641f0 con 0x7fd2cc05f110 2020-05-18T21:30:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.525+0000 7fd2c3fff700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd2b004f950 0x7fd2b0051e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.525+0000 7fd2c3fff700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd2b004f950 0x7fd2b0051e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2cc062440 tx=0x7fd2b4002610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.525+0000 7fd2c3fff700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd2b004f950 0x7fd2b0051e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2cc062440 tx=0x7fd2b4002610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.525+0000 7fd2c3fff700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd2b004f950 0x7fd2b0051e10 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7fd2cc062440 tx=0x7fd2b4002610).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:10.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.529+0000 7fd2caffd700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2cc05f110 0x7fd2cc1418c0 secure :-1 s=THROTTLE_DONE pgs=844 cs=0 l=1 rx=0x7fd2bc002f70 tx=0x7fd2bc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.529+0000 7fd2c8ff9700 1 -- 172.21.15.63:0/988223499 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd2bc03e580 con 0x7fd2cc05f110 2020-05-18T21:30:10.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.645+0000 7fd2cbfff700 1 -- 172.21.15.63:0/988223499 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2cc0569e0 con 0x7fd2cc05f110 2020-05-18T21:30:10.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.649+0000 7fd2caffd700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2cc05f110 0x7fd2cc1418c0 secure :-1 s=THROTTLE_DONE pgs=844 cs=0 l=1 rx=0x7fd2bc002f70 tx=0x7fd2bc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.649+0000 7fd2c8ff9700 1 -- 172.21.15.63:0/988223499 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+16092 (secure 0 0 0) 0x7fd2bc041ba0 con 0x7fd2cc05f110 2020-05-18T21:30:10.655 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:10.655 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":73,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:30:09.367810+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:30:06.278977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2020-05-18T21:30:07.362909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:30:10.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.649+0000 7fd2cbfff700 1 -- 172.21.15.63:0/988223499 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd2b004f950 msgr2=0x7fd2b0051e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.649+0000 7fd2cbfff700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd2b004f950 0x7fd2b0051e10 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7fd2cc062440 tx=0x7fd2b4002610).stop 2020-05-18T21:30:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.649+0000 7fd2cbfff700 1 -- 172.21.15.63:0/988223499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2cc05f110 msgr2=0x7fd2cc1418c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.649+0000 7fd2cbfff700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2cc05f110 0x7fd2cc1418c0 secure :-1 s=READY pgs=844 cs=0 l=1 rx=0x7fd2bc002f70 tx=0x7fd2bc010c70).stop 2020-05-18T21:30:10.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.649+0000 7fd2cbfff700 1 -- 172.21.15.63:0/988223499 shutdown_connections 2020-05-18T21:30:10.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.649+0000 7fd2cbfff700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd2b004f950 0x7fd2b0051e10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:10.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.649+0000 7fd2cbfff700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2cc13c710 0x7fd2cc147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:10.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.649+0000 7fd2cbfff700 1 --2- 172.21.15.63:0/988223499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2cc05f110 0x7fd2cc1418c0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:10.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.649+0000 7fd2cbfff700 1 -- 172.21.15.63:0/988223499 >> 172.21.15.63:0/988223499 conn(0x7fd2cc069fc0 msgr2=0x7fd2cc063eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:10.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.649+0000 7fd2cbfff700 1 -- 172.21.15.63:0/988223499 shutdown_connections 2020-05-18T21:30:10.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.649+0000 7fd2cbfff700 1 -- 172.21.15.63:0/988223499 wait complete. 2020-05-18T21:30:10.668 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:30:10.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe3293f9700 1 Processor -- start 2020-05-18T21:30:10.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe3293f9700 1 -- start start 2020-05-18T21:30:10.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe3293f9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3240b6410 0x7fe3240b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe3293f9700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe324025500 con 0x7fe3240b5cb0 2020-05-18T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe3293f9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe324064ee0 con 0x7fe324151bc0 2020-05-18T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe3293f9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240b67f0 con 0x7fe3240b6410 2020-05-18T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe323fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe3240b5cb0 0x7fe324061af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59290/0 (socket says 172.21.15.63:59290) 2020-05-18T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe323fff700 1 -- 172.21.15.63:0/3184211342 learned_addr learned my addr 172.21.15.63:0/3184211342 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe328bf8700 1 --2- 172.21.15.63:0/3184211342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3240b6410 0x7fe3240b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe3237fe700 1 -- 172.21.15.63:0/3184211342 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994510831 0 0) 0x7fe324025500 con 0x7fe3240b5cb0 2020-05-18T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe3237fe700 1 -- 172.21.15.63:0/3184211342 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe30c003270 con 0x7fe3240b5cb0 2020-05-18T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe3237fe700 1 -- 172.21.15.63:0/3184211342 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688868274 0 0) 0x7fe324064ee0 con 0x7fe324151bc0 2020-05-18T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe328bf8700 1 -- 172.21.15.63:0/3184211342 >> v1:172.21.15.155:6789/0 conn(0x7fe324151bc0 legacy=0x7fe324152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe328bf8700 1 -- 172.21.15.63:0/3184211342 >> v1:172.21.15.63:6789/0 conn(0x7fe3240b5cb0 legacy=0x7fe324061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe328bf8700 1 -- 172.21.15.63:0/3184211342 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe324025180 con 0x7fe3240b6410 2020-05-18T21:30:10.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe328bf8700 1 --2- 172.21.15.63:0/3184211342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3240b6410 0x7fe3240b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe3140032f0 tx=0x7fe314008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe328bf8700 1 --2- 172.21.15.63:0/3184211342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3240b6410 0x7fe3240b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe3140032f0 tx=0x7fe314008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe328bf8700 1 --2- 172.21.15.63:0/3184211342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3240b6410 0x7fe3240b6cd0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7fe3140032f0 tx=0x7fe314008ca0).ready entity=mon.2 client_cookie=3b909ad9b70b116a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:10.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe328bf8700 1 --2- 172.21.15.63:0/3184211342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3240b6410 0x7fe3240b6cd0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7fe3140032f0 tx=0x7fe314008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe3237fe700 1 -- 172.21.15.63:0/3184211342 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe314011ea0 con 0x7fe3240b6410 2020-05-18T21:30:10.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.785+0000 7fe328bf8700 1 --2- 172.21.15.63:0/3184211342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3240b6410 0x7fe3240b6cd0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7fe3140032f0 tx=0x7fe314008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.789+0000 7fe3237fe700 1 -- 172.21.15.63:0/3184211342 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31400a180 con 0x7fe3240b6410 2020-05-18T21:30:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.789+0000 7fe3293f9700 1 -- 172.21.15.63:0/3184211342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3240b6410 msgr2=0x7fe3240b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.789+0000 7fe328bf8700 1 --2- 172.21.15.63:0/3184211342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3240b6410 0x7fe3240b6cd0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7fe3140032f0 tx=0x7fe314008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.789+0000 7fe3237fe700 1 -- 172.21.15.63:0/3184211342 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe31400a4e0 con 0x7fe3240b6410 2020-05-18T21:30:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.789+0000 7fe3293f9700 1 --2- 172.21.15.63:0/3184211342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3240b6410 0x7fe3240b6cd0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7fe3140032f0 tx=0x7fe314008ca0).stop 2020-05-18T21:30:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.789+0000 7fe3293f9700 1 -- 172.21.15.63:0/3184211342 shutdown_connections 2020-05-18T21:30:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.789+0000 7fe3293f9700 1 --2- 172.21.15.63:0/3184211342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3240b6410 0x7fe3240b6cd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.789+0000 7fe3293f9700 1 -- 172.21.15.63:0/3184211342 >> 172.21.15.63:0/3184211342 conn(0x7fe324069b70 msgr2=0x7fe324069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.789+0000 7fe3293f9700 1 -- 172.21.15.63:0/3184211342 shutdown_connections 2020-05-18T21:30:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.789+0000 7fe3293f9700 1 -- 172.21.15.63:0/3184211342 wait complete. 2020-05-18T21:30:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.789+0000 7fe3293f9700 1 Processor -- start 2020-05-18T21:30:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.789+0000 7fe3293f9700 1 -- start start 2020-05-18T21:30:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe3293f9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe3240b6410 0x7fe3240b7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe3293f9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe324151bc0 0x7fe324128ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe3293f9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3240b8230 con 0x7fe3240b5cb0 2020-05-18T21:30:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe3293f9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3240b84d0 con 0x7fe3240b6410 2020-05-18T21:30:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe3293f9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3240b8770 con 0x7fe324151bc0 2020-05-18T21:30:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe323fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe3240b6410 0x7fe3240b7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe32a65b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe324151bc0 0x7fe324128ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe328bf8700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fe3240b5cb0 0x7fe324139620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:57610/0 (socket says 172.21.15.63:57610) 2020-05-18T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe323fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe3240b6410 0x7fe3240b7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57108/0 (socket says 172.21.15.63:57108) 2020-05-18T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe328bf8700 1 -- 172.21.15.63:0/1020821826 learned_addr learned my addr 172.21.15.63:0/1020821826 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe323fff700 1 -- 172.21.15.63:0/1020821826 >> v2:172.21.15.155:3300/0 conn(0x7fe324151bc0 msgr2=0x7fe324128ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe323fff700 1 --2- 172.21.15.63:0/1020821826 >> v2:172.21.15.155:3300/0 conn(0x7fe324151bc0 0x7fe324128ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe323fff700 1 -- 172.21.15.63:0/1020821826 >> v1:172.21.15.155:6789/0 conn(0x7fe3240b5cb0 legacy=0x7fe324139620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe323fff700 1 -- 172.21.15.63:0/1020821826 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe324139d30 con 0x7fe3240b6410 2020-05-18T21:30:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe323fff700 1 --2- 172.21.15.63:0/1020821826 >> v2:172.21.15.63:3300/0 conn(0x7fe3240b6410 0x7fe3240b7b90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe318001110 tx=0x7fe318010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe323fff700 1 --2- 172.21.15.63:0/1020821826 >> v2:172.21.15.63:3300/0 conn(0x7fe3240b6410 0x7fe3240b7b90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe318001110 tx=0x7fe318010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe323fff700 1 --2- 172.21.15.63:0/1020821826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3240b6410 0x7fe3240b7b90 secure :-1 s=READY pgs=846 cs=0 l=1 rx=0x7fe318001110 tx=0x7fe318010930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:10.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe323fff700 1 --2- 172.21.15.63:0/1020821826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3240b6410 0x7fe3240b7b90 secure :-1 s=THROTTLE_DONE pgs=846 cs=0 l=1 rx=0x7fe318001110 tx=0x7fe318010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe323fff700 1 --2- 172.21.15.63:0/1020821826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3240b6410 0x7fe3240b7b90 secure :-1 s=THROTTLE_DONE pgs=846 cs=0 l=1 rx=0x7fe318001110 tx=0x7fe318010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe3217fa700 1 -- 172.21.15.63:0/1020821826 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe318005d00 con 0x7fe3240b6410 2020-05-18T21:30:10.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe323fff700 1 --2- 172.21.15.63:0/1020821826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3240b6410 0x7fe3240b7b90 secure :-1 s=THROTTLE_DONE pgs=846 cs=0 l=1 rx=0x7fe318001110 tx=0x7fe318010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe3217fa700 1 -- 172.21.15.63:0/1020821826 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe318005e60 con 0x7fe3240b6410 2020-05-18T21:30:10.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe3293f9700 1 -- 172.21.15.63:0/1020821826 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe324139f20 con 0x7fe3240b6410 2020-05-18T21:30:10.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe3217fa700 1 -- 172.21.15.63:0/1020821826 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3180062c0 con 0x7fe3240b6410 2020-05-18T21:30:10.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.793+0000 7fe3293f9700 1 -- 172.21.15.63:0/1020821826 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe324129320 con 0x7fe3240b6410 2020-05-18T21:30:10.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.797+0000 7fe323fff700 1 --2- 172.21.15.63:0/1020821826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3240b6410 0x7fe3240b7b90 secure :-1 s=THROTTLE_DONE pgs=846 cs=0 l=1 rx=0x7fe318001110 tx=0x7fe318010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.797+0000 7fe3293f9700 1 -- 172.21.15.63:0/1020821826 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3240b8080 con 0x7fe3240b6410 2020-05-18T21:30:10.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.797+0000 7fe3217fa700 1 -- 172.21.15.63:0/1020821826 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe318006530 con 0x7fe3240b6410 2020-05-18T21:30:10.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.797+0000 7fe323fff700 1 --2- 172.21.15.63:0/1020821826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3240b6410 0x7fe3240b7b90 secure :-1 s=THROTTLE_DONE pgs=846 cs=0 l=1 rx=0x7fe318001110 tx=0x7fe318010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.797+0000 7fe3217fa700 1 --2- 172.21.15.63:0/1020821826 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe30404f9d0 0x7fe304051e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:10.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.797+0000 7fe3217fa700 1 -- 172.21.15.63:0/1020821826 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe3180090c0 con 0x7fe3240b6410 2020-05-18T21:30:10.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.797+0000 7fe328bf8700 1 --2- 172.21.15.63:0/1020821826 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe30404f9d0 0x7fe304051e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:10.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.797+0000 7fe328bf8700 1 --2- 172.21.15.63:0/1020821826 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe30404f9d0 0x7fe304051e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe324135d20 tx=0x7fe324025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.797+0000 7fe328bf8700 1 --2- 172.21.15.63:0/1020821826 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe30404f9d0 0x7fe304051e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe324135d20 tx=0x7fe324025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.797+0000 7fe328bf8700 1 --2- 172.21.15.63:0/1020821826 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe30404f9d0 0x7fe304051e90 secure :-1 s=READY pgs=344 cs=0 l=1 rx=0x7fe324135d20 tx=0x7fe324025310).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:10.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.805+0000 7fe323fff700 1 --2- 172.21.15.63:0/1020821826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3240b6410 0x7fe3240b7b90 secure :-1 s=THROTTLE_DONE pgs=846 cs=0 l=1 rx=0x7fe318001110 tx=0x7fe318010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.805+0000 7fe3217fa700 1 -- 172.21.15.63:0/1020821826 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe31803e0a0 con 0x7fe3240b6410 2020-05-18T21:30:10.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.957+0000 7fe3293f9700 1 -- 172.21.15.63:0/1020821826 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fe3240569e0 con 0x7fe3240b6410 2020-05-18T21:30:10.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.965+0000 7fe323fff700 1 --2- 172.21.15.63:0/1020821826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3240b6410 0x7fe3240b7b90 secure :-1 s=THROTTLE_DONE pgs=846 cs=0 l=1 rx=0x7fe318001110 tx=0x7fe318010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:10.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.965+0000 7fe3217fa700 1 -- 172.21.15.63:0/1020821826 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v27) v1 ==== 184+0+0 (secure 0 0 0) 0x7fe3180416c0 con 0x7fe3240b6410 2020-05-18T21:30:10.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.965+0000 7fe3293f9700 1 -- 172.21.15.63:0/1020821826 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe30404f9d0 msgr2=0x7fe304051e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.965+0000 7fe3293f9700 1 --2- 172.21.15.63:0/1020821826 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe30404f9d0 0x7fe304051e90 secure :-1 s=READY pgs=344 cs=0 l=1 rx=0x7fe324135d20 tx=0x7fe324025310).stop 2020-05-18T21:30:10.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.965+0000 7fe3293f9700 1 -- 172.21.15.63:0/1020821826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3240b6410 msgr2=0x7fe3240b7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:10.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.965+0000 7fe3293f9700 1 --2- 172.21.15.63:0/1020821826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3240b6410 0x7fe3240b7b90 secure :-1 s=READY pgs=846 cs=0 l=1 rx=0x7fe318001110 tx=0x7fe318010930).stop 2020-05-18T21:30:10.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.965+0000 7fe3293f9700 1 -- 172.21.15.63:0/1020821826 shutdown_connections 2020-05-18T21:30:10.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.965+0000 7fe3293f9700 1 --2- 172.21.15.63:0/1020821826 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe30404f9d0 0x7fe304051e90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:10.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.965+0000 7fe3293f9700 1 --2- 172.21.15.63:0/1020821826 >> v2:172.21.15.155:3300/0 conn(0x7fe324151bc0 0x7fe324128ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:10.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.965+0000 7fe3293f9700 1 --2- 172.21.15.63:0/1020821826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3240b6410 0x7fe3240b7b90 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:10.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.965+0000 7fe3293f9700 1 -- 172.21.15.63:0/1020821826 >> 172.21.15.63:0/1020821826 conn(0x7fe324069b70 msgr2=0x7fe32407fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:10.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.965+0000 7fe3293f9700 1 -- 172.21.15.63:0/1020821826 shutdown_connections 2020-05-18T21:30:10.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:10.965+0000 7fe3293f9700 1 -- 172.21.15.63:0/1020821826 wait complete. 2020-05-18T21:30:10.975 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.0 2020-05-18T21:30:10.987 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:30:11.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df8370700 1 Processor -- start 2020-05-18T21:30:11.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df8370700 1 -- start start 2020-05-18T21:30:11.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df8370700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7df00b8c30 0x7f7df01566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:11.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df8370700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7df0157260 0x7f7df015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:11.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df8370700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df0065a70 con 0x7f7df00ad070 2020-05-18T21:30:11.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df8370700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df00801d0 con 0x7f7df0157260 2020-05-18T21:30:11.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df8370700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df00b5ae0 con 0x7f7df00b8c30 2020-05-18T21:30:11.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df610c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7df00ad070 0x7f7df0156b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59304/0 (socket says 172.21.15.63:59304) 2020-05-18T21:30:11.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df610c700 1 -- 172.21.15.63:0/204816128 learned_addr learned my addr 172.21.15.63:0/204816128 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:11.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df710e700 1 --2- 172.21.15.63:0/204816128 >> v2:172.21.15.63:3300/0 conn(0x7f7df0157260 0x7f7df015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:11.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df590b700 1 -- 172.21.15.63:0/204816128 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215635482 0 0) 0x7f7df0065a70 con 0x7f7df00ad070 2020-05-18T21:30:11.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df690d700 1 --2- 172.21.15.63:0/204816128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7df00b8c30 0x7f7df01566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:11.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df590b700 1 -- 172.21.15.63:0/204816128 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dd8003270 con 0x7f7df00ad070 2020-05-18T21:30:11.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df710e700 1 -- 172.21.15.63:0/204816128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7df00b8c30 msgr2=0x7f7df01566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:11.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df710e700 1 --2- 172.21.15.63:0/204816128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7df00b8c30 0x7f7df01566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:11.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df710e700 1 -- 172.21.15.63:0/204816128 >> v1:172.21.15.63:6789/0 conn(0x7f7df00ad070 legacy=0x7f7df0156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df710e700 1 -- 172.21.15.63:0/204816128 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df00b9010 con 0x7f7df0157260 2020-05-18T21:30:11.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df690d700 1 --2- 172.21.15.63:0/204816128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7df00b8c30 0x7f7df01566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:30:11.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df710e700 1 --2- 172.21.15.63:0/204816128 >> v2:172.21.15.63:3300/0 conn(0x7f7df0157260 0x7f7df015c9c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7dec0032f0 tx=0x7f7dec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df710e700 1 --2- 172.21.15.63:0/204816128 >> v2:172.21.15.63:3300/0 conn(0x7f7df0157260 0x7f7df015c9c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7dec0032f0 tx=0x7f7dec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.097+0000 7f7df710e700 1 --2- 172.21.15.63:0/204816128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7df0157260 0x7f7df015c9c0 secure :-1 s=READY pgs=848 cs=0 l=1 rx=0x7f7dec0032f0 tx=0x7f7dec007e00).ready entity=mon.0 client_cookie=39702749fe86f79b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:11.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.101+0000 7f7df710e700 1 --2- 172.21.15.63:0/204816128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7df0157260 0x7f7df015c9c0 secure :-1 s=THROTTLE_DONE pgs=848 cs=0 l=1 rx=0x7f7dec0032f0 tx=0x7f7dec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.101+0000 7f7df710e700 1 --2- 172.21.15.63:0/204816128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7df0157260 0x7f7df015c9c0 secure :-1 s=THROTTLE_DONE pgs=848 cs=0 l=1 rx=0x7f7dec0032f0 tx=0x7f7dec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.101+0000 7f7df590b700 1 -- 172.21.15.63:0/204816128 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dec011e60 con 0x7f7df0157260 2020-05-18T21:30:11.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.101+0000 7f7df710e700 1 --2- 172.21.15.63:0/204816128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7df0157260 0x7f7df015c9c0 secure :-1 s=THROTTLE_DONE pgs=848 cs=0 l=1 rx=0x7f7dec0032f0 tx=0x7f7dec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.101+0000 7f7df590b700 1 -- 172.21.15.63:0/204816128 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec00a180 con 0x7f7df0157260 2020-05-18T21:30:11.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.101+0000 7f7df590b700 1 -- 172.21.15.63:0/204816128 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dec00a560 con 0x7f7df0157260 2020-05-18T21:30:11.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.101+0000 7f7df8370700 1 -- 172.21.15.63:0/204816128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7df0157260 msgr2=0x7f7df015c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.101+0000 7f7df8370700 1 --2- 172.21.15.63:0/204816128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7df0157260 0x7f7df015c9c0 secure :-1 s=READY pgs=848 cs=0 l=1 rx=0x7f7dec0032f0 tx=0x7f7dec007e00).stop 2020-05-18T21:30:11.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.101+0000 7f7df8370700 1 -- 172.21.15.63:0/204816128 shutdown_connections 2020-05-18T21:30:11.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.101+0000 7f7df8370700 1 --2- 172.21.15.63:0/204816128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7df0157260 0x7f7df015c9c0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:11.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.101+0000 7f7df8370700 1 --2- 172.21.15.63:0/204816128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7df00b8c30 0x7f7df01566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:11.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.101+0000 7f7df8370700 1 -- 172.21.15.63:0/204816128 >> 172.21.15.63:0/204816128 conn(0x7f7df006a640 msgr2=0x7f7df00b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:11.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.101+0000 7f7df8370700 1 -- 172.21.15.63:0/204816128 shutdown_connections 2020-05-18T21:30:11.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.101+0000 7f7df8370700 1 -- 172.21.15.63:0/204816128 wait complete. 2020-05-18T21:30:11.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.101+0000 7f7df8370700 1 Processor -- start 2020-05-18T21:30:11.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.101+0000 7f7df8370700 1 -- start start 2020-05-18T21:30:11.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7df8370700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7df00b8c30 0x7f7df00717d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:11.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7df8370700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df0073130 con 0x7f7df00ad070 2020-05-18T21:30:11.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7df8370700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df00733d0 con 0x7f7df0157260 2020-05-18T21:30:11.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7df8370700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df007fae0 con 0x7f7df00b8c30 2020-05-18T21:30:11.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7df690d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7df00ad070 0x7f7df0073870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59308/0 (socket says 172.21.15.63:59308) 2020-05-18T21:30:11.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7df690d700 1 -- 172.21.15.63:0/3409626946 learned_addr learned my addr 172.21.15.63:0/3409626946 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:11.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7df610c700 1 --2- 172.21.15.63:0/3409626946 >> v2:172.21.15.155:3300/0 conn(0x7f7df00b8c30 0x7f7df00717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:11.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252239427 0 0) 0x7f7df0073130 con 0x7f7df00ad070 2020-05-18T21:30:11.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dd0003270 con 0x7f7df00ad070 2020-05-18T21:30:11.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071400841 0 0) 0x7f7df00733d0 con 0x7f7df0157260 2020-05-18T21:30:11.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df0073130 con 0x7f7df0157260 2020-05-18T21:30:11.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3259072501 0 0) 0x7f7dd0003270 con 0x7f7df00ad070 2020-05-18T21:30:11.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7df00733d0 con 0x7f7df00ad070 2020-05-18T21:30:11.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f7de0002540 con 0x7f7df00ad070 2020-05-18T21:30:11.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 >> v2:172.21.15.155:3300/0 conn(0x7f7df00b8c30 msgr2=0x7f7df00717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7de77fe700 1 --2- 172.21.15.63:0/3409626946 >> v2:172.21.15.155:3300/0 conn(0x7f7df00b8c30 0x7f7df00717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:11.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 >> v1:172.21.15.155:6789/0 conn(0x7f7df0157260 legacy=0x7f7df006f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 >> v1:172.21.15.63:6789/0 conn(0x7f7df00ad070 legacy=0x7f7df0073870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7de77fe700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd00039a0 0x7f7dd0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:11.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7de77fe700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7dd0004510 0x7f7dd0004950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7de77fe700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dd0004db0 0x7f7dd000b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd000bbc0 con 0x7f7dd0004510 2020-05-18T21:30:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd000bd00 con 0x7f7dd00039a0 2020-05-18T21:30:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd000be40 con 0x7f7dd0004db0 2020-05-18T21:30:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7df610c700 1 --2- 172.21.15.63:0/3409626946 >> v2:172.21.15.155:3300/0 conn(0x7f7df00b8c30 0x7f7df00717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:30:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7df690d700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd00039a0 0x7f7dd0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7df610c700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7dd0004510 0x7f7dd0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.105+0000 7f7df710e700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dd0004db0 0x7f7dd000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7df690d700 1 -- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dd0004db0 msgr2=0x7f7dd000b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7df690d700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dd0004db0 0x7f7dd000b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:11.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7df690d700 1 -- 172.21.15.63:0/3409626946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7dd0004510 msgr2=0x7f7dd0004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7df690d700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7dd0004510 0x7f7dd0004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:11.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7df690d700 1 -- 172.21.15.63:0/3409626946 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df0073f80 con 0x7f7dd00039a0 2020-05-18T21:30:11.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7df8370700 1 -- 172.21.15.63:0/3409626946 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df006fc90 con 0x7f7dd00039a0 2020-05-18T21:30:11.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7df710e700 1 -- 172.21.15.63:0/3409626946 reap_dead start 2020-05-18T21:30:11.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7df610c700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7dd0004510 0x7f7dd0004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:30:11.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7df690d700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd00039a0 0x7f7dd0003dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7de0002310 tx=0x7f7dd00054c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7df8370700 1 -- 172.21.15.63:0/3409626946 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df0122660 con 0x7f7dd00039a0 2020-05-18T21:30:11.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7df690d700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd00039a0 0x7f7dd0003dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7de0002310 tx=0x7f7dd00054c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7df690d700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd00039a0 0x7f7dd0003dc0 secure :-1 s=READY pgs=611 cs=0 l=1 rx=0x7f7de0002310 tx=0x7f7dd00054c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:11.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7df690d700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd00039a0 0x7f7dd0003dc0 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7f7de0002310 tx=0x7f7dd00054c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7de00058f0 con 0x7f7dd00039a0 2020-05-18T21:30:11.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7df690d700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd00039a0 0x7f7dd0003dc0 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7f7de0002310 tx=0x7f7dd00054c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de0005a50 con 0x7f7dd00039a0 2020-05-18T21:30:11.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7df690d700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd00039a0 0x7f7dd0003dc0 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7f7de0002310 tx=0x7f7dd00054c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7de0005e30 con 0x7f7dd00039a0 2020-05-18T21:30:11.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7df8370700 1 -- 172.21.15.63:0/3409626946 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dcc003380 con 0x7f7dd00039a0 2020-05-18T21:30:11.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7df690d700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd00039a0 0x7f7dd0003dc0 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7f7de0002310 tx=0x7f7dd00054c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7de000b280 con 0x7f7dd00039a0 2020-05-18T21:30:11.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7df690d700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd00039a0 0x7f7dd0003dc0 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7f7de0002310 tx=0x7f7dd00054c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7de77fe700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7dd0053b90 0x7f7dd0056050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:11.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7de0064320 con 0x7f7dd00039a0 2020-05-18T21:30:11.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.109+0000 7f7df610c700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7dd0053b90 0x7f7dd0056050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:11.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.113+0000 7f7df610c700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7dd0053b90 0x7f7dd0056050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7de8001110 tx=0x7f7de8001940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.113+0000 7f7df610c700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7dd0053b90 0x7f7dd0056050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7de8001110 tx=0x7f7de8001940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.113+0000 7f7df610c700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7dd0053b90 0x7f7dd0056050 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7f7de8001110 tx=0x7f7de8001940).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:11.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.117+0000 7f7df690d700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd00039a0 0x7f7dd0003dc0 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7f7de0002310 tx=0x7f7dd00054c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.117+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f7de003e6b0 con 0x7f7dd00039a0 2020-05-18T21:30:11.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.273+0000 7f7df8370700 1 -- 172.21.15.63:0/3409626946 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7dcc0022c0 con 0x7f7dd00039a0 2020-05-18T21:30:11.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.281+0000 7f7df690d700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd00039a0 0x7f7dd0003dc0 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7f7de0002310 tx=0x7f7dd00054c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.281+0000 7f7de77fe700 1 -- 172.21.15.63:0/3409626946 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v28) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7de0041cd0 con 0x7f7dd00039a0 2020-05-18T21:30:11.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.281+0000 7f7df8370700 1 -- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7dd0053b90 msgr2=0x7f7dd0056050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.281+0000 7f7df8370700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7dd0053b90 0x7f7dd0056050 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7f7de8001110 tx=0x7f7de8001940).stop 2020-05-18T21:30:11.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.281+0000 7f7df8370700 1 -- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd00039a0 msgr2=0x7f7dd0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.281+0000 7f7df8370700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd00039a0 0x7f7dd0003dc0 secure :-1 s=READY pgs=611 cs=0 l=1 rx=0x7f7de0002310 tx=0x7f7dd00054c0).stop 2020-05-18T21:30:11.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.281+0000 7f7df8370700 1 -- 172.21.15.63:0/3409626946 shutdown_connections 2020-05-18T21:30:11.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.281+0000 7f7df8370700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7dd0053b90 0x7f7dd0056050 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.281+0000 7f7df8370700 1 --2- 172.21.15.63:0/3409626946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dd00039a0 0x7f7dd0003dc0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.281+0000 7f7df8370700 1 -- 172.21.15.63:0/3409626946 >> 172.21.15.63:0/3409626946 conn(0x7f7df006a640 msgr2=0x7f7df00b7700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.285+0000 7f7df8370700 1 -- 172.21.15.63:0/3409626946 shutdown_connections 2020-05-18T21:30:11.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.285+0000 7f7df8370700 1 -- 172.21.15.63:0/3409626946 wait complete. 2020-05-18T21:30:11.292 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.1 2020-05-18T21:30:11.302 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:30:11.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30ed85a700 1 Processor -- start 2020-05-18T21:30:11.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30ed85a700 1 -- start start 2020-05-18T21:30:11.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30ed85a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f30e80b5cb0 0x7f30e80b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:11.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30ed85a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e8025500 con 0x7f30e8151bc0 2020-05-18T21:30:11.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30ed85a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e8064ee0 con 0x7f30e80b6410 2020-05-18T21:30:11.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30ed85a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e80b67f0 con 0x7f30e80b5cb0 2020-05-18T21:30:11.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30eeabc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f30e8151bc0 0x7f30e8152030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59326/0 (socket says 172.21.15.63:59326) 2020-05-18T21:30:11.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30eeabc700 1 -- 172.21.15.63:0/537074826 learned_addr learned my addr 172.21.15.63:0/537074826 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:11.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30ec858700 1 --2- 172.21.15.63:0/537074826 >> v2:172.21.15.155:3300/0 conn(0x7f30e80b5cb0 0x7f30e80b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:11.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30e7fff700 1 -- 172.21.15.63:0/537074826 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956816871 0 0) 0x7f30e8025500 con 0x7f30e8151bc0 2020-05-18T21:30:11.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30e7fff700 1 -- 172.21.15.63:0/537074826 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30d0003270 con 0x7f30e8151bc0 2020-05-18T21:30:11.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30e7fff700 1 -- 172.21.15.63:0/537074826 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649594751 0 0) 0x7f30e8064ee0 con 0x7f30e80b6410 2020-05-18T21:30:11.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30e7fff700 1 -- 172.21.15.63:0/537074826 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30e8025500 con 0x7f30e80b6410 2020-05-18T21:30:11.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30ec858700 1 -- 172.21.15.63:0/537074826 >> v1:172.21.15.155:6789/0 conn(0x7f30e80b6410 legacy=0x7f30e8061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30ec858700 1 -- 172.21.15.63:0/537074826 >> v1:172.21.15.63:6789/0 conn(0x7f30e8151bc0 legacy=0x7f30e8152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30e7fff700 1 -- 172.21.15.63:0/537074826 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1064729988 0 0) 0x7f30d0003270 con 0x7f30e8151bc0 2020-05-18T21:30:11.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30ec858700 1 -- 172.21.15.63:0/537074826 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e8025180 con 0x7f30e80b5cb0 2020-05-18T21:30:11.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30ec858700 1 --2- 172.21.15.63:0/537074826 >> v2:172.21.15.155:3300/0 conn(0x7f30e80b5cb0 0x7f30e80b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f30d8001110 tx=0x7f30dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30ec858700 1 --2- 172.21.15.63:0/537074826 >> v2:172.21.15.155:3300/0 conn(0x7f30e80b5cb0 0x7f30e80b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f30d8001110 tx=0x7f30dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30ec858700 1 --2- 172.21.15.63:0/537074826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30e80b5cb0 0x7f30e80b6cd0 secure :-1 s=READY pgs=613 cs=0 l=1 rx=0x7f30d8001110 tx=0x7f30dc007a80).ready entity=mon.1 client_cookie=5084de964450b432 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:11.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30ec858700 1 --2- 172.21.15.63:0/537074826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30e80b5cb0 0x7f30e80b6cd0 secure :-1 s=THROTTLE_DONE pgs=613 cs=0 l=1 rx=0x7f30d8001110 tx=0x7f30dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30e7fff700 1 -- 172.21.15.63:0/537074826 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30d8001710 con 0x7f30e80b5cb0 2020-05-18T21:30:11.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30ec858700 1 --2- 172.21.15.63:0/537074826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30e80b5cb0 0x7f30e80b6cd0 secure :-1 s=THROTTLE_DONE pgs=613 cs=0 l=1 rx=0x7f30d8001110 tx=0x7f30dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30ec858700 1 --2- 172.21.15.63:0/537074826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30e80b5cb0 0x7f30e80b6cd0 secure :-1 s=THROTTLE_DONE pgs=613 cs=0 l=1 rx=0x7f30d8001110 tx=0x7f30dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30e7fff700 1 -- 172.21.15.63:0/537074826 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30dc008e40 con 0x7f30e80b5cb0 2020-05-18T21:30:11.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30e7fff700 1 -- 172.21.15.63:0/537074826 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30dc011440 con 0x7f30e80b5cb0 2020-05-18T21:30:11.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30ed85a700 1 -- 172.21.15.63:0/537074826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30e80b5cb0 msgr2=0x7f30e80b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.413+0000 7f30ed85a700 1 --2- 172.21.15.63:0/537074826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30e80b5cb0 0x7f30e80b6cd0 secure :-1 s=READY pgs=613 cs=0 l=1 rx=0x7f30d8001110 tx=0x7f30dc007a80).stop 2020-05-18T21:30:11.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.417+0000 7f30ed85a700 1 -- 172.21.15.63:0/537074826 shutdown_connections 2020-05-18T21:30:11.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.417+0000 7f30ed85a700 1 --2- 172.21.15.63:0/537074826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30e80b5cb0 0x7f30e80b6cd0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:11.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.417+0000 7f30ed85a700 1 -- 172.21.15.63:0/537074826 >> 172.21.15.63:0/537074826 conn(0x7f30e8069b70 msgr2=0x7f30e8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:11.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.417+0000 7f30ed85a700 1 -- 172.21.15.63:0/537074826 shutdown_connections 2020-05-18T21:30:11.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.417+0000 7f30ed85a700 1 -- 172.21.15.63:0/537074826 wait complete. 2020-05-18T21:30:11.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.417+0000 7f30ed85a700 1 Processor -- start 2020-05-18T21:30:11.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.417+0000 7f30ed85a700 1 -- start start 2020-05-18T21:30:11.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.417+0000 7f30ed85a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f30e80b5cb0 0x7f30e8065650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:11.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.417+0000 7f30ed85a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f30e8151bc0 0x7f30e81350f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:11.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.417+0000 7f30ed85a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e8065ab0 con 0x7f30e80b6410 2020-05-18T21:30:11.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.417+0000 7f30ed85a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e8154f60 con 0x7f30e80b5cb0 2020-05-18T21:30:11.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.417+0000 7f30ed85a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e807fc30 con 0x7f30e8151bc0 2020-05-18T21:30:11.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.417+0000 7f30ed059700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f30e80b5cb0 0x7f30e8065650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:11.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.417+0000 7f30ed059700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f30e80b5cb0 0x7f30e8065650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57140/0 (socket says 172.21.15.63:57140) 2020-05-18T21:30:11.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30ed059700 1 -- 172.21.15.63:0/830041499 learned_addr learned my addr 172.21.15.63:0/830041499 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:11.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.417+0000 7f30ec858700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f30e80b6410 0x7f30e8139c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59330/0 (socket says 172.21.15.63:59330) 2020-05-18T21:30:11.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30eeabc700 1 --2- 172.21.15.63:0/830041499 >> v2:172.21.15.155:3300/0 conn(0x7f30e8151bc0 0x7f30e81350f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:11.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30ed059700 1 -- 172.21.15.63:0/830041499 >> v2:172.21.15.155:3300/0 conn(0x7f30e8151bc0 msgr2=0x7f30e81350f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30ed059700 1 --2- 172.21.15.63:0/830041499 >> v2:172.21.15.155:3300/0 conn(0x7f30e8151bc0 0x7f30e81350f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:11.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30ed059700 1 -- 172.21.15.63:0/830041499 >> v1:172.21.15.63:6789/0 conn(0x7f30e80b6410 legacy=0x7f30e8139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30e5ffb700 1 -- 172.21.15.63:0/830041499 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725996320 0 0) 0x7f30e8065ab0 con 0x7f30e80b6410 2020-05-18T21:30:11.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30ed059700 1 -- 172.21.15.63:0/830041499 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e807fed0 con 0x7f30e80b5cb0 2020-05-18T21:30:11.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30ed059700 1 --2- 172.21.15.63:0/830041499 >> v2:172.21.15.63:3300/0 conn(0x7f30e80b5cb0 0x7f30e8065650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f30e0001550 tx=0x7f30e0002850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30ed059700 1 --2- 172.21.15.63:0/830041499 >> v2:172.21.15.63:3300/0 conn(0x7f30e80b5cb0 0x7f30e8065650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f30e0001550 tx=0x7f30e0002850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30ed059700 1 --2- 172.21.15.63:0/830041499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30e80b5cb0 0x7f30e8065650 secure :-1 s=READY pgs=852 cs=0 l=1 rx=0x7f30e0001550 tx=0x7f30e0002850).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:11.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30ed059700 1 --2- 172.21.15.63:0/830041499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30e80b5cb0 0x7f30e8065650 secure :-1 s=THROTTLE_DONE pgs=852 cs=0 l=1 rx=0x7f30e0001550 tx=0x7f30e0002850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30e5ffb700 1 -- 172.21.15.63:0/830041499 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30e000cce0 con 0x7f30e80b5cb0 2020-05-18T21:30:11.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30ed059700 1 --2- 172.21.15.63:0/830041499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30e80b5cb0 0x7f30e8065650 secure :-1 s=THROTTLE_DONE pgs=852 cs=0 l=1 rx=0x7f30e0001550 tx=0x7f30e0002850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30ed059700 1 --2- 172.21.15.63:0/830041499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30e80b5cb0 0x7f30e8065650 secure :-1 s=THROTTLE_DONE pgs=852 cs=0 l=1 rx=0x7f30e0001550 tx=0x7f30e0002850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30e5ffb700 1 -- 172.21.15.63:0/830041499 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e000ce80 con 0x7f30e80b5cb0 2020-05-18T21:30:11.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30ed85a700 1 -- 172.21.15.63:0/830041499 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e8080170 con 0x7f30e80b5cb0 2020-05-18T21:30:11.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30e5ffb700 1 -- 172.21.15.63:0/830041499 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30e00129b0 con 0x7f30e80b5cb0 2020-05-18T21:30:11.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30ed85a700 1 -- 172.21.15.63:0/830041499 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e80b54c0 con 0x7f30e80b5cb0 2020-05-18T21:30:11.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30ed059700 1 --2- 172.21.15.63:0/830041499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30e80b5cb0 0x7f30e8065650 secure :-1 s=THROTTLE_DONE pgs=852 cs=0 l=1 rx=0x7f30e0001550 tx=0x7f30e0002850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30ed85a700 1 -- 172.21.15.63:0/830041499 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e8080370 con 0x7f30e80b5cb0 2020-05-18T21:30:11.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30e5ffb700 1 -- 172.21.15.63:0/830041499 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f30e0012c20 con 0x7f30e80b5cb0 2020-05-18T21:30:11.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30ed059700 1 --2- 172.21.15.63:0/830041499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30e80b5cb0 0x7f30e8065650 secure :-1 s=THROTTLE_DONE pgs=852 cs=0 l=1 rx=0x7f30e0001550 tx=0x7f30e0002850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30e5ffb700 1 --2- 172.21.15.63:0/830041499 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f30c804f920 0x7f30c8051de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:11.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.421+0000 7f30e5ffb700 1 -- 172.21.15.63:0/830041499 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f30e00642a0 con 0x7f30e80b5cb0 2020-05-18T21:30:11.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.425+0000 7f30ec858700 1 --2- 172.21.15.63:0/830041499 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f30c804f920 0x7f30c8051de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:11.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.425+0000 7f30ec858700 1 --2- 172.21.15.63:0/830041499 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f30c804f920 0x7f30c8051de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f30dc008320 tx=0x7f30dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.425+0000 7f30ec858700 1 --2- 172.21.15.63:0/830041499 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f30c804f920 0x7f30c8051de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f30dc008320 tx=0x7f30dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.425+0000 7f30ec858700 1 --2- 172.21.15.63:0/830041499 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f30c804f920 0x7f30c8051de0 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7f30dc008320 tx=0x7f30dc007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:11.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.425+0000 7f30ed059700 1 --2- 172.21.15.63:0/830041499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30e80b5cb0 0x7f30e8065650 secure :-1 s=THROTTLE_DONE pgs=852 cs=0 l=1 rx=0x7f30e0001550 tx=0x7f30e0002850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.425+0000 7f30e5ffb700 1 -- 172.21.15.63:0/830041499 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f30e8080370 con 0x7f30e80b5cb0 2020-05-18T21:30:11.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.577+0000 7f30ed85a700 1 -- 172.21.15.63:0/830041499 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f30e8080370 con 0x7f30e80b5cb0 2020-05-18T21:30:11.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.585+0000 7f30ed059700 1 --2- 172.21.15.63:0/830041499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30e80b5cb0 0x7f30e8065650 secure :-1 s=THROTTLE_DONE pgs=852 cs=0 l=1 rx=0x7f30e0001550 tx=0x7f30e0002850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.585+0000 7f30e5ffb700 1 -- 172.21.15.63:0/830041499 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v29) v1 ==== 184+0+0 (secure 0 0 0) 0x7f30e8080370 con 0x7f30e80b5cb0 2020-05-18T21:30:11.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.585+0000 7f30ed85a700 1 -- 172.21.15.63:0/830041499 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f30c804f920 msgr2=0x7f30c8051de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.585+0000 7f30ed85a700 1 --2- 172.21.15.63:0/830041499 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f30c804f920 0x7f30c8051de0 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7f30dc008320 tx=0x7f30dc007a80).stop 2020-05-18T21:30:11.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.585+0000 7f30ed85a700 1 -- 172.21.15.63:0/830041499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30e80b5cb0 msgr2=0x7f30e8065650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.585+0000 7f30ed85a700 1 --2- 172.21.15.63:0/830041499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30e80b5cb0 0x7f30e8065650 secure :-1 s=READY pgs=852 cs=0 l=1 rx=0x7f30e0001550 tx=0x7f30e0002850).stop 2020-05-18T21:30:11.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.585+0000 7f30ed85a700 1 -- 172.21.15.63:0/830041499 shutdown_connections 2020-05-18T21:30:11.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.585+0000 7f30ed85a700 1 --2- 172.21.15.63:0/830041499 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f30c804f920 0x7f30c8051de0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:11.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.585+0000 7f30ed85a700 1 --2- 172.21.15.63:0/830041499 >> v2:172.21.15.155:3300/0 conn(0x7f30e8151bc0 0x7f30e81350f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:11.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.585+0000 7f30ed85a700 1 --2- 172.21.15.63:0/830041499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30e80b5cb0 0x7f30e8065650 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:11.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.585+0000 7f30ed85a700 1 -- 172.21.15.63:0/830041499 >> 172.21.15.63:0/830041499 conn(0x7f30e8069b70 msgr2=0x7f30e8069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:11.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.585+0000 7f30ed85a700 1 -- 172.21.15.63:0/830041499 shutdown_connections 2020-05-18T21:30:11.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.585+0000 7f30ed85a700 1 -- 172.21.15.63:0/830041499 wait complete. 2020-05-18T21:30:11.596 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.2 2020-05-18T21:30:11.604 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:30:11.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa26bfff700 1 Processor -- start 2020-05-18T21:30:11.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa26bfff700 1 -- start start 2020-05-18T21:30:11.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa26bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa26c0b5cb0 0x7fa26c0b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:11.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa26bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa26c151bc0 0x7fa26c152030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:11.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa26bfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26c025500 con 0x7fa26c0b6410 2020-05-18T21:30:11.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa26bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26c064ee0 con 0x7fa26c0b5cb0 2020-05-18T21:30:11.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa26bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26c0b67f0 con 0x7fa26c151bc0 2020-05-18T21:30:11.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa26affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa26c0b5cb0 0x7fa26c0b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:11.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa26affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa26c0b5cb0 0x7fa26c0b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57150/0 (socket says 172.21.15.63:57150) 2020-05-18T21:30:11.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa26affd700 1 -- 172.21.15.63:0/988234139 learned_addr learned my addr 172.21.15.63:0/988234139 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:11.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa271609700 1 --2- 172.21.15.63:0/988234139 >> v2:172.21.15.155:3300/0 conn(0x7fa26c151bc0 0x7fa26c152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:11.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa26affd700 1 -- 172.21.15.63:0/988234139 >> v2:172.21.15.155:3300/0 conn(0x7fa26c151bc0 msgr2=0x7fa26c152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:11.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa26affd700 1 --2- 172.21.15.63:0/988234139 >> v2:172.21.15.155:3300/0 conn(0x7fa26c151bc0 0x7fa26c152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:11.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa26affd700 1 -- 172.21.15.63:0/988234139 >> v1:172.21.15.155:6789/0 conn(0x7fa26c0b6410 legacy=0x7fa26c061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa26affd700 1 -- 172.21.15.63:0/988234139 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c025180 con 0x7fa26c0b5cb0 2020-05-18T21:30:11.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa26affd700 1 --2- 172.21.15.63:0/988234139 >> v2:172.21.15.63:3300/0 conn(0x7fa26c0b5cb0 0x7fa26c0b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa254002f70 tx=0x7fa254007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa26affd700 1 --2- 172.21.15.63:0/988234139 >> v2:172.21.15.63:3300/0 conn(0x7fa26c0b5cb0 0x7fa26c0b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa254002f70 tx=0x7fa254007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa26affd700 1 --2- 172.21.15.63:0/988234139 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c0b5cb0 0x7fa26c0b6cd0 secure :-1 s=READY pgs=853 cs=0 l=1 rx=0x7fa254002f70 tx=0x7fa254007a80).ready entity=mon.0 client_cookie=3d2657384bb7e1db server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:11.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa26affd700 1 --2- 172.21.15.63:0/988234139 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c0b5cb0 0x7fa26c0b6cd0 secure :-1 s=THROTTLE_DONE pgs=853 cs=0 l=1 rx=0x7fa254002f70 tx=0x7fa254007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.717+0000 7fa26a7fc700 1 -- 172.21.15.63:0/988234139 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2540116b0 con 0x7fa26c0b5cb0 2020-05-18T21:30:11.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.721+0000 7fa26affd700 1 --2- 172.21.15.63:0/988234139 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c0b5cb0 0x7fa26c0b6cd0 secure :-1 s=THROTTLE_DONE pgs=853 cs=0 l=1 rx=0x7fa254002f70 tx=0x7fa254007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.721+0000 7fa26a7fc700 1 -- 172.21.15.63:0/988234139 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa254011810 con 0x7fa26c0b5cb0 2020-05-18T21:30:11.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.721+0000 7fa26affd700 1 --2- 172.21.15.63:0/988234139 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c0b5cb0 0x7fa26c0b6cd0 secure :-1 s=THROTTLE_DONE pgs=853 cs=0 l=1 rx=0x7fa254002f70 tx=0x7fa254007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.721+0000 7fa26a7fc700 1 -- 172.21.15.63:0/988234139 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa254011c30 con 0x7fa26c0b5cb0 2020-05-18T21:30:11.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.721+0000 7fa26bfff700 1 -- 172.21.15.63:0/988234139 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c0b5cb0 msgr2=0x7fa26c0b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.721+0000 7fa26bfff700 1 --2- 172.21.15.63:0/988234139 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c0b5cb0 0x7fa26c0b6cd0 secure :-1 s=READY pgs=853 cs=0 l=1 rx=0x7fa254002f70 tx=0x7fa254007a80).stop 2020-05-18T21:30:11.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.721+0000 7fa26bfff700 1 -- 172.21.15.63:0/988234139 shutdown_connections 2020-05-18T21:30:11.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.721+0000 7fa26bfff700 1 --2- 172.21.15.63:0/988234139 >> v2:172.21.15.155:3300/0 conn(0x7fa26c151bc0 0x7fa26c152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:11.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.721+0000 7fa26bfff700 1 --2- 172.21.15.63:0/988234139 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c0b5cb0 0x7fa26c0b6cd0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:11.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.721+0000 7fa26bfff700 1 -- 172.21.15.63:0/988234139 >> 172.21.15.63:0/988234139 conn(0x7fa26c069b70 msgr2=0x7fa26c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:11.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.721+0000 7fa26bfff700 1 -- 172.21.15.63:0/988234139 shutdown_connections 2020-05-18T21:30:11.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.721+0000 7fa26bfff700 1 -- 172.21.15.63:0/988234139 wait complete. 2020-05-18T21:30:11.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.721+0000 7fa26bfff700 1 Processor -- start 2020-05-18T21:30:11.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa26bfff700 1 -- start start 2020-05-18T21:30:11.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa26bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa26c0b5cb0 0x7fa26c07ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:11.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa26bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa26c0b6410 0x7fa26c0b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:11.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa26bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa26c151bc0 0x7fa26c075db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:11.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa26bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26c080360 con 0x7fa26c151bc0 2020-05-18T21:30:11.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa26bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26c075670 con 0x7fa26c0b6410 2020-05-18T21:30:11.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa26bfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c075910 con 0x7fa26c0b5cb0 2020-05-18T21:30:11.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa271609700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa26c151bc0 0x7fa26c075db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:11.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa271609700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa26c151bc0 0x7fa26c075db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57158/0 (socket says 172.21.15.63:57158) 2020-05-18T21:30:11.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa271609700 1 -- 172.21.15.63:0/3584464642 learned_addr learned my addr 172.21.15.63:0/3584464642 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:11.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa26affd700 1 --2- 172.21.15.63:0/3584464642 >> v2:172.21.15.155:3300/0 conn(0x7fa26c0b6410 0x7fa26c0b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:11.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa26b7fe700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa26c0b5cb0 0x7fa26c07ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:11.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa271609700 1 -- 172.21.15.63:0/3584464642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa26c0b5cb0 msgr2=0x7fa26c07ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa271609700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa26c0b5cb0 0x7fa26c07ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:11.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa271609700 1 -- 172.21.15.63:0/3584464642 >> v2:172.21.15.155:3300/0 conn(0x7fa26c0b6410 msgr2=0x7fa26c0b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa271609700 1 --2- 172.21.15.63:0/3584464642 >> v2:172.21.15.155:3300/0 conn(0x7fa26c0b6410 0x7fa26c0b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:11.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa271609700 1 -- 172.21.15.63:0/3584464642 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c075360 con 0x7fa26c151bc0 2020-05-18T21:30:11.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa271609700 1 --2- 172.21.15.63:0/3584464642 >> v2:172.21.15.63:3300/0 conn(0x7fa26c151bc0 0x7fa26c075db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa271609700 1 --2- 172.21.15.63:0/3584464642 >> v2:172.21.15.63:3300/0 conn(0x7fa26c151bc0 0x7fa26c075db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa271609700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c151bc0 0x7fa26c075db0 secure :-1 s=READY pgs=854 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:11.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa271609700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c151bc0 0x7fa26c075db0 secure :-1 s=THROTTLE_DONE pgs=854 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa263fff700 1 -- 172.21.15.63:0/3584464642 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa264007550 con 0x7fa26c151bc0 2020-05-18T21:30:11.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa271609700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c151bc0 0x7fa26c075db0 secure :-1 s=THROTTLE_DONE pgs=854 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa271609700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c151bc0 0x7fa26c075db0 secure :-1 s=THROTTLE_DONE pgs=854 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa263fff700 1 -- 172.21.15.63:0/3584464642 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa264005700 con 0x7fa26c151bc0 2020-05-18T21:30:11.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa26bfff700 1 -- 172.21.15.63:0/3584464642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26c0b29e0 con 0x7fa26c151bc0 2020-05-18T21:30:11.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa263fff700 1 -- 172.21.15.63:0/3584464642 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa264005ae0 con 0x7fa26c151bc0 2020-05-18T21:30:11.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.725+0000 7fa26bfff700 1 -- 172.21.15.63:0/3584464642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa26c065560 con 0x7fa26c151bc0 2020-05-18T21:30:11.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.729+0000 7fa271609700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c151bc0 0x7fa26c075db0 secure :-1 s=THROTTLE_DONE pgs=854 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.729+0000 7fa26bfff700 1 -- 172.21.15.63:0/3584464642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa26c076550 con 0x7fa26c151bc0 2020-05-18T21:30:11.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.729+0000 7fa263fff700 1 -- 172.21.15.63:0/3584464642 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa264005d50 con 0x7fa26c151bc0 2020-05-18T21:30:11.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.729+0000 7fa271609700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c151bc0 0x7fa26c075db0 secure :-1 s=THROTTLE_DONE pgs=854 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.729+0000 7fa263fff700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa25004fb10 0x7fa250051fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:11.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.729+0000 7fa263fff700 1 -- 172.21.15.63:0/3584464642 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa264063bd0 con 0x7fa26c151bc0 2020-05-18T21:30:11.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.729+0000 7fa26b7fe700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa25004fb10 0x7fa250051fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:11.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.729+0000 7fa26b7fe700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa25004fb10 0x7fa250051fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa26c025b40 tx=0x7fa25c0041e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.729+0000 7fa26b7fe700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa25004fb10 0x7fa250051fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa26c025b40 tx=0x7fa25c0041e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.729+0000 7fa26b7fe700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa25004fb10 0x7fa250051fd0 secure :-1 s=READY pgs=347 cs=0 l=1 rx=0x7fa26c025b40 tx=0x7fa25c0041e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:11.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.733+0000 7fa271609700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c151bc0 0x7fa26c075db0 secure :-1 s=THROTTLE_DONE pgs=854 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.733+0000 7fa263fff700 1 -- 172.21.15.63:0/3584464642 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa26c076550 con 0x7fa26c151bc0 2020-05-18T21:30:11.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.885+0000 7fa26bfff700 1 -- 172.21.15.63:0/3584464642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa26c076550 con 0x7fa26c151bc0 2020-05-18T21:30:11.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.893+0000 7fa271609700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c151bc0 0x7fa26c075db0 secure :-1 s=THROTTLE_DONE pgs=854 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:11.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.893+0000 7fa263fff700 1 -- 172.21.15.63:0/3584464642 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v30) v1 ==== 184+0+0 (secure 0 0 0) 0x7fa26c076550 con 0x7fa26c151bc0 2020-05-18T21:30:11.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.893+0000 7fa26bfff700 1 -- 172.21.15.63:0/3584464642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa25004fb10 msgr2=0x7fa250051fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.893+0000 7fa26bfff700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa25004fb10 0x7fa250051fd0 secure :-1 s=READY pgs=347 cs=0 l=1 rx=0x7fa26c025b40 tx=0x7fa25c0041e0).stop 2020-05-18T21:30:11.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.893+0000 7fa26bfff700 1 -- 172.21.15.63:0/3584464642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c151bc0 msgr2=0x7fa26c075db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:11.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.893+0000 7fa26bfff700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c151bc0 0x7fa26c075db0 secure :-1 s=READY pgs=854 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bf0).stop 2020-05-18T21:30:11.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.893+0000 7fa26bfff700 1 -- 172.21.15.63:0/3584464642 shutdown_connections 2020-05-18T21:30:11.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.893+0000 7fa26bfff700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa25004fb10 0x7fa250051fd0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:11.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.893+0000 7fa26bfff700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa26c151bc0 0x7fa26c075db0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:11.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.893+0000 7fa26bfff700 1 --2- 172.21.15.63:0/3584464642 >> v2:172.21.15.155:3300/0 conn(0x7fa26c0b6410 0x7fa26c0b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:11.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.893+0000 7fa26bfff700 1 --2- 172.21.15.63:0/3584464642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa26c0b5cb0 0x7fa26c07ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:11.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.893+0000 7fa26bfff700 1 -- 172.21.15.63:0/3584464642 >> 172.21.15.63:0/3584464642 conn(0x7fa26c069b70 msgr2=0x7fa26c151210 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:11.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.893+0000 7fa26bfff700 1 -- 172.21.15.63:0/3584464642 shutdown_connections 2020-05-18T21:30:11.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:11.897+0000 7fa26bfff700 1 -- 172.21.15.63:0/3584464642 wait complete. 2020-05-18T21:30:11.903 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.3 2020-05-18T21:30:11.913 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:30:12.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.005+0000 7f14f4bcd700 1 Processor -- start 2020-05-18T21:30:12.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.005+0000 7f14f4bcd700 1 -- start start 2020-05-18T21:30:12.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14f4bcd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f14f0064fd0 0x7f14f014d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:12.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14f4bcd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f014a330 con 0x7f14f00b4760 2020-05-18T21:30:12.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14f4bcd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f014a5d0 con 0x7f14f005f110 2020-05-18T21:30:12.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14f4bcd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f014a140 con 0x7f14f0064fd0 2020-05-18T21:30:12.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14effff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f14f0064fd0 0x7f14f014d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:12.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14eeffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f14f00b4760 0x7f14f00648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59350/0 (socket says 172.21.15.63:59350) 2020-05-18T21:30:12.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14eeffd700 1 -- 172.21.15.63:0/4242162082 learned_addr learned my addr 172.21.15.63:0/4242162082 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:12.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14effff700 1 -- 172.21.15.63:0/4242162082 >> v1:172.21.15.155:6789/0 conn(0x7f14f005f110 legacy=0x7f14f014aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14effff700 1 -- 172.21.15.63:0/4242162082 >> v1:172.21.15.63:6789/0 conn(0x7f14f00b4760 legacy=0x7f14f00648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14ee7fc700 1 -- 172.21.15.63:0/4242162082 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2811881826 0 0) 0x7f14f014a330 con 0x7f14f00b4760 2020-05-18T21:30:12.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14effff700 1 -- 172.21.15.63:0/4242162082 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f0063430 con 0x7f14f0064fd0 2020-05-18T21:30:12.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14effff700 1 --2- 172.21.15.63:0/4242162082 >> v2:172.21.15.63:3300/0 conn(0x7f14f0064fd0 0x7f14f014d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f14e80032f0 tx=0x7f14e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14effff700 1 --2- 172.21.15.63:0/4242162082 >> v2:172.21.15.63:3300/0 conn(0x7f14f0064fd0 0x7f14f014d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f14e80032f0 tx=0x7f14e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14effff700 1 --2- 172.21.15.63:0/4242162082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f0064fd0 0x7f14f014d710 secure :-1 s=READY pgs=856 cs=0 l=1 rx=0x7f14e80032f0 tx=0x7f14e8007e00).ready entity=mon.0 client_cookie=6ce4057ca8ba036d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:12.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14effff700 1 --2- 172.21.15.63:0/4242162082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f0064fd0 0x7f14f014d710 secure :-1 s=THROTTLE_DONE pgs=856 cs=0 l=1 rx=0x7f14e80032f0 tx=0x7f14e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14ee7fc700 1 -- 172.21.15.63:0/4242162082 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14e800a180 con 0x7f14f0064fd0 2020-05-18T21:30:12.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14effff700 1 --2- 172.21.15.63:0/4242162082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f0064fd0 0x7f14f014d710 secure :-1 s=THROTTLE_DONE pgs=856 cs=0 l=1 rx=0x7f14e80032f0 tx=0x7f14e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14effff700 1 --2- 172.21.15.63:0/4242162082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f0064fd0 0x7f14f014d710 secure :-1 s=THROTTLE_DONE pgs=856 cs=0 l=1 rx=0x7f14e80032f0 tx=0x7f14e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14ee7fc700 1 -- 172.21.15.63:0/4242162082 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e800a2e0 con 0x7f14f0064fd0 2020-05-18T21:30:12.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14ee7fc700 1 -- 172.21.15.63:0/4242162082 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14e800a700 con 0x7f14f0064fd0 2020-05-18T21:30:12.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14f4bcd700 1 -- 172.21.15.63:0/4242162082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f0064fd0 msgr2=0x7f14f014d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14f4bcd700 1 --2- 172.21.15.63:0/4242162082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f0064fd0 0x7f14f014d710 secure :-1 s=READY pgs=856 cs=0 l=1 rx=0x7f14e80032f0 tx=0x7f14e8007e00).stop 2020-05-18T21:30:12.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14f4bcd700 1 -- 172.21.15.63:0/4242162082 shutdown_connections 2020-05-18T21:30:12.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14f4bcd700 1 --2- 172.21.15.63:0/4242162082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f0064fd0 0x7f14f014d710 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:12.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14f4bcd700 1 -- 172.21.15.63:0/4242162082 >> 172.21.15.63:0/4242162082 conn(0x7f14f0069fc0 msgr2=0x7f14f006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:12.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14f4bcd700 1 -- 172.21.15.63:0/4242162082 shutdown_connections 2020-05-18T21:30:12.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14f4bcd700 1 -- 172.21.15.63:0/4242162082 wait complete. 2020-05-18T21:30:12.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14f4bcd700 1 Processor -- start 2020-05-18T21:30:12.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.009+0000 7f14f4bcd700 1 -- start start 2020-05-18T21:30:12.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14f4bcd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f14f0064fd0 0x7f14f0146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:12.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14f4bcd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f14f00b4760 0x7f14f0140e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:12.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14f4bcd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f0141770 con 0x7f14f005f110 2020-05-18T21:30:12.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14f4bcd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f0147b00 con 0x7f14f00b4760 2020-05-18T21:30:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14f4bcd700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f01474b0 con 0x7f14f0064fd0 2020-05-18T21:30:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14effff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f14f00b4760 0x7f14f0140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14effff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f14f00b4760 0x7f14f0140e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57172/0 (socket says 172.21.15.63:57172) 2020-05-18T21:30:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14effff700 1 -- 172.21.15.63:0/1612205474 learned_addr learned my addr 172.21.15.63:0/1612205474 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:12.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14eeffd700 1 --2- 172.21.15.63:0/1612205474 >> v2:172.21.15.155:3300/0 conn(0x7f14f0064fd0 0x7f14f0146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:12.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14effff700 1 -- 172.21.15.63:0/1612205474 >> v2:172.21.15.155:3300/0 conn(0x7f14f0064fd0 msgr2=0x7f14f0146ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14effff700 1 --2- 172.21.15.63:0/1612205474 >> v2:172.21.15.155:3300/0 conn(0x7f14f0064fd0 0x7f14f0146ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:12.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14effff700 1 -- 172.21.15.63:0/1612205474 >> v1:172.21.15.155:6789/0 conn(0x7f14f005f110 legacy=0x7f14f015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14effff700 1 -- 172.21.15.63:0/1612205474 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f0147d10 con 0x7f14f00b4760 2020-05-18T21:30:12.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14effff700 1 --2- 172.21.15.63:0/1612205474 >> v2:172.21.15.63:3300/0 conn(0x7f14f00b4760 0x7f14f0140e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f14e80032f0 tx=0x7f14e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14effff700 1 --2- 172.21.15.63:0/1612205474 >> v2:172.21.15.63:3300/0 conn(0x7f14f00b4760 0x7f14f0140e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f14e80032f0 tx=0x7f14e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14effff700 1 --2- 172.21.15.63:0/1612205474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f00b4760 0x7f14f0140e70 secure :-1 s=READY pgs=857 cs=0 l=1 rx=0x7f14e80032f0 tx=0x7f14e8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:12.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14effff700 1 --2- 172.21.15.63:0/1612205474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f00b4760 0x7f14f0140e70 secure :-1 s=THROTTLE_DONE pgs=857 cs=0 l=1 rx=0x7f14e80032f0 tx=0x7f14e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14ecff9700 1 -- 172.21.15.63:0/1612205474 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14e80115c0 con 0x7f14f00b4760 2020-05-18T21:30:12.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14effff700 1 --2- 172.21.15.63:0/1612205474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f00b4760 0x7f14f0140e70 secure :-1 s=THROTTLE_DONE pgs=857 cs=0 l=1 rx=0x7f14e80032f0 tx=0x7f14e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14effff700 1 --2- 172.21.15.63:0/1612205474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f00b4760 0x7f14f0140e70 secure :-1 s=THROTTLE_DONE pgs=857 cs=0 l=1 rx=0x7f14e80032f0 tx=0x7f14e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14ecff9700 1 -- 172.21.15.63:0/1612205474 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e8005a80 con 0x7f14f00b4760 2020-05-18T21:30:12.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14f4bcd700 1 -- 172.21.15.63:0/1612205474 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f0147f40 con 0x7f14f00b4760 2020-05-18T21:30:12.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14ecff9700 1 -- 172.21.15.63:0/1612205474 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14e8005e60 con 0x7f14f00b4760 2020-05-18T21:30:12.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14f4bcd700 1 -- 172.21.15.63:0/1612205474 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f015b2e0 con 0x7f14f00b4760 2020-05-18T21:30:12.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14effff700 1 --2- 172.21.15.63:0/1612205474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f00b4760 0x7f14f0140e70 secure :-1 s=THROTTLE_DONE pgs=857 cs=0 l=1 rx=0x7f14e80032f0 tx=0x7f14e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.013+0000 7f14f4bcd700 1 -- 172.21.15.63:0/1612205474 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f00569e0 con 0x7f14f00b4760 2020-05-18T21:30:12.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.017+0000 7f14ecff9700 1 -- 172.21.15.63:0/1612205474 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f14e80106c0 con 0x7f14f00b4760 2020-05-18T21:30:12.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.017+0000 7f14effff700 1 --2- 172.21.15.63:0/1612205474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f00b4760 0x7f14f0140e70 secure :-1 s=THROTTLE_DONE pgs=857 cs=0 l=1 rx=0x7f14e80032f0 tx=0x7f14e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.017+0000 7f14ecff9700 1 --2- 172.21.15.63:0/1612205474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14d004f960 0x7f14d0051e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:12.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.017+0000 7f14ecff9700 1 -- 172.21.15.63:0/1612205474 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f14e8064ab0 con 0x7f14f00b4760 2020-05-18T21:30:12.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.017+0000 7f14ef7fe700 1 --2- 172.21.15.63:0/1612205474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14d004f960 0x7f14d0051e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:12.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.017+0000 7f14ef7fe700 1 --2- 172.21.15.63:0/1612205474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14d004f960 0x7f14d0051e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f14f0146380 tx=0x7f14e4002570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.017+0000 7f14ef7fe700 1 --2- 172.21.15.63:0/1612205474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14d004f960 0x7f14d0051e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f14f0146380 tx=0x7f14e4002570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.017+0000 7f14ef7fe700 1 --2- 172.21.15.63:0/1612205474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14d004f960 0x7f14d0051e20 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f14f0146380 tx=0x7f14e4002570).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:12.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.021+0000 7f14effff700 1 --2- 172.21.15.63:0/1612205474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f00b4760 0x7f14f0140e70 secure :-1 s=THROTTLE_DONE pgs=857 cs=0 l=1 rx=0x7f14e80032f0 tx=0x7f14e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.021+0000 7f14ecff9700 1 -- 172.21.15.63:0/1612205474 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f14e803ef00 con 0x7f14f00b4760 2020-05-18T21:30:12.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.177+0000 7f14f4bcd700 1 -- 172.21.15.63:0/1612205474 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14f00625f0 con 0x7f14f00b4760 2020-05-18T21:30:12.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.177+0000 7f14effff700 1 --2- 172.21.15.63:0/1612205474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f00b4760 0x7f14f0140e70 secure :-1 s=THROTTLE_DONE pgs=857 cs=0 l=1 rx=0x7f14e80032f0 tx=0x7f14e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.177+0000 7f14ecff9700 1 -- 172.21.15.63:0/1612205474 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f14e8042520 con 0x7f14f00b4760 2020-05-18T21:30:12.183 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:12.183 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":40,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5336,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/129631814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":129631814},{"type":"v1","addr":"172.21.15.63:6833","nonce":129631814}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":37}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:10.069167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5339},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5339":{"gid":5339,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/802454809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":802454809},{"type":"v1","addr":"172.21.15.155:6835","nonce":802454809}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:30:12.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.177+0000 7f14f4bcd700 1 -- 172.21.15.63:0/1612205474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14d004f960 msgr2=0x7f14d0051e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.177+0000 7f14f4bcd700 1 --2- 172.21.15.63:0/1612205474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14d004f960 0x7f14d0051e20 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f14f0146380 tx=0x7f14e4002570).stop 2020-05-18T21:30:12.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.177+0000 7f14f4bcd700 1 -- 172.21.15.63:0/1612205474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f00b4760 msgr2=0x7f14f0140e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.177+0000 7f14f4bcd700 1 --2- 172.21.15.63:0/1612205474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f00b4760 0x7f14f0140e70 secure :-1 s=READY pgs=857 cs=0 l=1 rx=0x7f14e80032f0 tx=0x7f14e8007e00).stop 2020-05-18T21:30:12.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.177+0000 7f14f4bcd700 1 -- 172.21.15.63:0/1612205474 shutdown_connections 2020-05-18T21:30:12.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.177+0000 7f14f4bcd700 1 --2- 172.21.15.63:0/1612205474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14d004f960 0x7f14d0051e20 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:12.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.177+0000 7f14f4bcd700 1 --2- 172.21.15.63:0/1612205474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f00b4760 0x7f14f0140e70 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:12.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.177+0000 7f14f4bcd700 1 --2- 172.21.15.63:0/1612205474 >> v2:172.21.15.155:3300/0 conn(0x7f14f0064fd0 0x7f14f0146ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:12.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.177+0000 7f14f4bcd700 1 -- 172.21.15.63:0/1612205474 >> 172.21.15.63:0/1612205474 conn(0x7f14f0069fc0 msgr2=0x7f14f00b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:12.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.177+0000 7f14f4bcd700 1 -- 172.21.15.63:0/1612205474 shutdown_connections 2020-05-18T21:30:12.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.177+0000 7f14f4bcd700 1 -- 172.21.15.63:0/1612205474 wait complete. 2020-05-18T21:30:12.187 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 40 2020-05-18T21:30:12.398 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:30:08.365002+0000', 'modified': '2020-05-18T21:30:10.069167+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5339}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5339': {'gid': 5339, 'name': 'b', 'rank': 0, 'incarnation': 38, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6835/802454809', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 802454809}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 802454809}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:30:12.399 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:30:12.399 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:30:12.506 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:30:12.506 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:30:12.507 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2020-05-18T21:30:12.507 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 5339, 2020-05-18T21:30:12.507 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:30:12.507 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:30:12.507 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 4.1352397139999999, 2020-05-18T21:30:12.508 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 40, 2020-05-18T21:30:12.508 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 73, 2020-05-18T21:30:12.508 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 73, 2020-05-18T21:30:12.508 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 9.3770147470000005 2020-05-18T21:30:12.508 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:30:12.514 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 5339, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.1352397139999999, "mdsmap_epoch": 40, "osdmap_epoch": 73, "osdmap_epoch_barrier": 73, "uptime": 9.3770147470000005 } 2020-05-18T21:30:12.515 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:30:12.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.621+0000 7f222b143700 1 Processor -- start 2020-05-18T21:30:12.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.621+0000 7f222b143700 1 -- start start 2020-05-18T21:30:12.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.621+0000 7f222b143700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f22240b4760 0x7f22240648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:12.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.621+0000 7f222b143700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222414a330 con 0x7f2224064d20 2020-05-18T21:30:12.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.621+0000 7f222b143700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222414a5d0 con 0x7f222405f110 2020-05-18T21:30:12.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.621+0000 7f222b143700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f222414a140 con 0x7f22240b4760 2020-05-18T21:30:12.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.621+0000 7f222a942700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2224064d20 0x7f222414d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59366/0 (socket says 172.21.15.63:59366) 2020-05-18T21:30:12.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.621+0000 7f2229940700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f22240b4760 0x7f22240648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:12.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.621+0000 7f222a942700 1 -- 172.21.15.63:0/4150078736 learned_addr learned my addr 172.21.15.63:0/4150078736 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:12.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f222913f700 1 -- 172.21.15.63:0/4150078736 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925705163 0 0) 0x7f222414a330 con 0x7f2224064d20 2020-05-18T21:30:12.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f222913f700 1 -- 172.21.15.63:0/4150078736 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f220c003270 con 0x7f2224064d20 2020-05-18T21:30:12.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f222913f700 1 -- 172.21.15.63:0/4150078736 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815590126 0 0) 0x7f222414a5d0 con 0x7f222405f110 2020-05-18T21:30:12.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f222913f700 1 -- 172.21.15.63:0/4150078736 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f222414a330 con 0x7f222405f110 2020-05-18T21:30:12.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f2229940700 1 -- 172.21.15.63:0/4150078736 >> v1:172.21.15.155:6789/0 conn(0x7f222405f110 legacy=0x7f222414aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f2229940700 1 -- 172.21.15.63:0/4150078736 >> v1:172.21.15.63:6789/0 conn(0x7f2224064d20 legacy=0x7f222414d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f2229940700 1 -- 172.21.15.63:0/4150078736 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2224063430 con 0x7f22240b4760 2020-05-18T21:30:12.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f2229940700 1 --2- 172.21.15.63:0/4150078736 >> v2:172.21.15.63:3300/0 conn(0x7f22240b4760 0x7f22240648c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2214002f70 tx=0x7f2214007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f2229940700 1 --2- 172.21.15.63:0/4150078736 >> v2:172.21.15.63:3300/0 conn(0x7f22240b4760 0x7f22240648c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2214002f70 tx=0x7f2214007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f2229940700 1 --2- 172.21.15.63:0/4150078736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22240b4760 0x7f22240648c0 secure :-1 s=READY pgs=859 cs=0 l=1 rx=0x7f2214002f70 tx=0x7f2214007a80).ready entity=mon.0 client_cookie=daf8fe2db60e7466 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:12.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f2229940700 1 --2- 172.21.15.63:0/4150078736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22240b4760 0x7f22240648c0 secure :-1 s=THROTTLE_DONE pgs=859 cs=0 l=1 rx=0x7f2214002f70 tx=0x7f2214007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f222913f700 1 -- 172.21.15.63:0/4150078736 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2214008e80 con 0x7f22240b4760 2020-05-18T21:30:12.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f2229940700 1 --2- 172.21.15.63:0/4150078736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22240b4760 0x7f22240648c0 secure :-1 s=THROTTLE_DONE pgs=859 cs=0 l=1 rx=0x7f2214002f70 tx=0x7f2214007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f2229940700 1 --2- 172.21.15.63:0/4150078736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22240b4760 0x7f22240648c0 secure :-1 s=THROTTLE_DONE pgs=859 cs=0 l=1 rx=0x7f2214002f70 tx=0x7f2214007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f222913f700 1 -- 172.21.15.63:0/4150078736 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2214011540 con 0x7f22240b4760 2020-05-18T21:30:12.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f222913f700 1 -- 172.21.15.63:0/4150078736 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22140118a0 con 0x7f22240b4760 2020-05-18T21:30:12.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f222b143700 1 -- 172.21.15.63:0/4150078736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22240b4760 msgr2=0x7f22240648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f222b143700 1 --2- 172.21.15.63:0/4150078736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22240b4760 0x7f22240648c0 secure :-1 s=READY pgs=859 cs=0 l=1 rx=0x7f2214002f70 tx=0x7f2214007a80).stop 2020-05-18T21:30:12.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f222b143700 1 -- 172.21.15.63:0/4150078736 shutdown_connections 2020-05-18T21:30:12.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f222b143700 1 --2- 172.21.15.63:0/4150078736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22240b4760 0x7f22240648c0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:12.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f222b143700 1 -- 172.21.15.63:0/4150078736 >> 172.21.15.63:0/4150078736 conn(0x7f2224069fc0 msgr2=0x7f222406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:12.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f222b143700 1 -- 172.21.15.63:0/4150078736 shutdown_connections 2020-05-18T21:30:12.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f222b143700 1 -- 172.21.15.63:0/4150078736 wait complete. 2020-05-18T21:30:12.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f222b143700 1 Processor -- start 2020-05-18T21:30:12.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.625+0000 7f222b143700 1 -- start start 2020-05-18T21:30:12.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222b143700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f222405f110 0x7f22240b8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:12.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222b143700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2224064d20 0x7f22240b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:12.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222b143700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2224145f90 con 0x7f22240b4760 2020-05-18T21:30:12.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222b143700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2224146230 con 0x7f222405f110 2020-05-18T21:30:12.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222b143700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2224147510 con 0x7f2224064d20 2020-05-18T21:30:12.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222a942700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f22240b4760 0x7f22241454b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59374/0 (socket says 172.21.15.63:59374) 2020-05-18T21:30:12.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222a942700 1 -- 172.21.15.63:0/335378267 learned_addr learned my addr 172.21.15.63:0/335378267 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:12.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f2229940700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2224064d20 0x7f22240b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:12.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222a141700 1 --2- 172.21.15.63:0/335378267 >> v2:172.21.15.155:3300/0 conn(0x7f222405f110 0x7f22240b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:12.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f22137fe700 1 -- 172.21.15.63:0/335378267 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611369619 0 0) 0x7f2224145f90 con 0x7f22240b4760 2020-05-18T21:30:12.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f22137fe700 1 -- 172.21.15.63:0/335378267 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2204002fe0 con 0x7f22240b4760 2020-05-18T21:30:12.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f22137fe700 1 -- 172.21.15.63:0/335378267 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3039217837 0 0) 0x7f2204002fe0 con 0x7f22240b4760 2020-05-18T21:30:12.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f22137fe700 1 -- 172.21.15.63:0/335378267 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2224145f90 con 0x7f22240b4760 2020-05-18T21:30:12.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f22137fe700 1 -- 172.21.15.63:0/335378267 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f221c001c80 con 0x7f22240b4760 2020-05-18T21:30:12.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f22137fe700 1 -- 172.21.15.63:0/335378267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2224064d20 msgr2=0x7f22240b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f22137fe700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2224064d20 0x7f22240b6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:12.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f22137fe700 1 -- 172.21.15.63:0/335378267 >> v2:172.21.15.155:3300/0 conn(0x7f222405f110 msgr2=0x7f22240b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f22137fe700 1 --2- 172.21.15.63:0/335378267 >> v2:172.21.15.155:3300/0 conn(0x7f222405f110 0x7f22240b8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:12.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f22137fe700 1 -- 172.21.15.63:0/335378267 >> v1:172.21.15.63:6789/0 conn(0x7f22240b4760 legacy=0x7f22241454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f22137fe700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2204004b50 0x7f2204004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:12.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f22137fe700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22040039a0 0x7f2204003e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:12.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f22137fe700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2204004280 0x7f220400b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:12.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f22137fe700 1 -- 172.21.15.63:0/335378267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2224146230 con 0x7f2204004280 2020-05-18T21:30:12.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f22137fe700 1 -- 172.21.15.63:0/335378267 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2224147510 con 0x7f2204004b50 2020-05-18T21:30:12.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f22137fe700 1 -- 172.21.15.63:0/335378267 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22040047b0 con 0x7f22040039a0 2020-05-18T21:30:12.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f2229940700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2224064d20 0x7f22240b6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:30:12.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222a141700 1 --2- 172.21.15.63:0/335378267 >> v2:172.21.15.155:3300/0 conn(0x7f222405f110 0x7f22240b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:30:12.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222a942700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2204004280 0x7f220400b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:12.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f2229940700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22040039a0 0x7f2204003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:12.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222a141700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2204004b50 0x7f2204004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:12.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222a942700 1 -- 172.21.15.63:0/335378267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22040039a0 msgr2=0x7f2204003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222a942700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22040039a0 0x7f2204003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:12.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222a942700 1 -- 172.21.15.63:0/335378267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2204004b50 msgr2=0x7f2204004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222a942700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2204004b50 0x7f2204004f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:12.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222a942700 1 -- 172.21.15.63:0/335378267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2224145bc0 con 0x7f2204004280 2020-05-18T21:30:12.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222b143700 1 -- 172.21.15.63:0/335378267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22240b6170 con 0x7f2204004280 2020-05-18T21:30:12.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222a942700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2204004280 0x7f220400b760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f221c0014d0 tx=0x7f221c011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222b143700 1 -- 172.21.15.63:0/335378267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22240b6620 con 0x7f2204004280 2020-05-18T21:30:12.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222a942700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2204004280 0x7f220400b760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f221c0014d0 tx=0x7f221c011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222a942700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2204004280 0x7f220400b760 secure :-1 s=READY pgs=861 cs=0 l=1 rx=0x7f221c0014d0 tx=0x7f221c011780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:12.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222a942700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2204004280 0x7f220400b760 secure :-1 s=THROTTLE_DONE pgs=861 cs=0 l=1 rx=0x7f221c0014d0 tx=0x7f221c011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222a942700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2204004280 0x7f220400b760 secure :-1 s=THROTTLE_DONE pgs=861 cs=0 l=1 rx=0x7f221c0014d0 tx=0x7f221c011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f22137fe700 1 -- 172.21.15.63:0/335378267 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f221c005d60 con 0x7f2204004280 2020-05-18T21:30:12.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f222a942700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2204004280 0x7f220400b760 secure :-1 s=THROTTLE_DONE pgs=861 cs=0 l=1 rx=0x7f221c0014d0 tx=0x7f221c011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f22137fe700 1 -- 172.21.15.63:0/335378267 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221c00e180 con 0x7f2204004280 2020-05-18T21:30:12.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.629+0000 7f22137fe700 1 -- 172.21.15.63:0/335378267 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f221c00e560 con 0x7f2204004280 2020-05-18T21:30:12.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.633+0000 7f222b143700 1 -- 172.21.15.63:0/335378267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2200003380 con 0x7f2204004280 2020-05-18T21:30:12.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.633+0000 7f222a942700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2204004280 0x7f220400b760 secure :-1 s=THROTTLE_DONE pgs=861 cs=0 l=1 rx=0x7f221c0014d0 tx=0x7f221c011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.633+0000 7f22137fe700 1 -- 172.21.15.63:0/335378267 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f221c00e6c0 con 0x7f2204004280 2020-05-18T21:30:12.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.633+0000 7f222a942700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2204004280 0x7f220400b760 secure :-1 s=THROTTLE_DONE pgs=861 cs=0 l=1 rx=0x7f221c0014d0 tx=0x7f221c011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.633+0000 7f22137fe700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2204058120 0x7f220405a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:12.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.633+0000 7f22137fe700 1 -- 172.21.15.63:0/335378267 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f221c064730 con 0x7f2204004280 2020-05-18T21:30:12.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.633+0000 7f222a141700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2204058120 0x7f220405a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:12.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.633+0000 7f222a141700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2204058120 0x7f220405a5e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2220001110 tx=0x7f2220009630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.633+0000 7f222a141700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2204058120 0x7f220405a5e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2220001110 tx=0x7f2220009630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.637+0000 7f222a141700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2204058120 0x7f220405a5e0 secure :-1 s=READY pgs=349 cs=0 l=1 rx=0x7f2220001110 tx=0x7f2220009630).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:12.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.641+0000 7f222a942700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2204004280 0x7f220400b760 secure :-1 s=THROTTLE_DONE pgs=861 cs=0 l=1 rx=0x7f221c0014d0 tx=0x7f221c011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.641+0000 7f22137fe700 1 -- 172.21.15.63:0/335378267 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f221c03eb20 con 0x7f2204004280 2020-05-18T21:30:12.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.757+0000 7f222b143700 1 -- 172.21.15.63:0/335378267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2200002210 con 0x7f2204004280 2020-05-18T21:30:12.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.761+0000 7f222a942700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2204004280 0x7f220400b760 secure :-1 s=THROTTLE_DONE pgs=861 cs=0 l=1 rx=0x7f221c0014d0 tx=0x7f221c011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.761+0000 7f22137fe700 1 -- 172.21.15.63:0/335378267 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+16092 (secure 0 0 0) 0x7f221c042140 con 0x7f2204004280 2020-05-18T21:30:12.765 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:12.766 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":73,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:30:09.367810+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:30:06.278977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2020-05-18T21:30:07.362909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:30:12.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.761+0000 7f222b143700 1 -- 172.21.15.63:0/335378267 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2204058120 msgr2=0x7f220405a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.761+0000 7f222b143700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2204058120 0x7f220405a5e0 secure :-1 s=READY pgs=349 cs=0 l=1 rx=0x7f2220001110 tx=0x7f2220009630).stop 2020-05-18T21:30:12.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.761+0000 7f222b143700 1 -- 172.21.15.63:0/335378267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2204004280 msgr2=0x7f220400b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.761+0000 7f222b143700 1 --2- 172.21.15.63:0/335378267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2204004280 0x7f220400b760 secure :-1 s=READY pgs=861 cs=0 l=1 rx=0x7f221c0014d0 tx=0x7f221c011780).stop 2020-05-18T21:30:12.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.761+0000 7f222a942700 1 -- 172.21.15.63:0/335378267 reap_dead start 2020-05-18T21:30:12.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.761+0000 7f222a942700 1 -- 172.21.15.63:0/335378267 reap_dead start 2020-05-18T21:30:12.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.761+0000 7f222b143700 1 -- 172.21.15.63:0/335378267 shutdown_connections 2020-05-18T21:30:12.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.761+0000 7f222b143700 1 -- 172.21.15.63:0/335378267 >> 172.21.15.63:0/335378267 conn(0x7f2224069fc0 msgr2=0x7f222406a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:12.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.761+0000 7f222b143700 1 -- 172.21.15.63:0/335378267 shutdown_connections 2020-05-18T21:30:12.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.761+0000 7f222b143700 1 -- 172.21.15.63:0/335378267 wait complete. 2020-05-18T21:30:12.778 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:30:06.278977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:30:07.362909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:30:12.779 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:30:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.881+0000 7f43c5dd7700 1 Processor -- start 2020-05-18T21:30:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.881+0000 7f43c5dd7700 1 -- start start 2020-05-18T21:30:12.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43c5dd7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f43c00b8ed0 0x7f43c0064860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:12.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43c5dd7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c00b4b00 con 0x7f43c00b50b0 2020-05-18T21:30:12.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43c5dd7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c00622f0 con 0x7f43c0064cc0 2020-05-18T21:30:12.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43c5dd7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c0065ec0 con 0x7f43c00b8ed0 2020-05-18T21:30:12.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43bf7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f43c00b50b0 0x7f43c0061be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59384/0 (socket says 172.21.15.63:59384) 2020-05-18T21:30:12.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43bf7fe700 1 -- 172.21.15.63:0/2028652699 learned_addr learned my addr 172.21.15.63:0/2028652699 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:12.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43beffd700 1 --2- 172.21.15.63:0/2028652699 >> v2:172.21.15.155:3300/0 conn(0x7f43c00b8ed0 0x7f43c0064860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:12.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43be7fc700 1 -- 172.21.15.63:0/2028652699 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763904583 0 0) 0x7f43b0001290 con 0x7f43c00b50b0 2020-05-18T21:30:12.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43be7fc700 1 -- 172.21.15.63:0/2028652699 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43a4003270 con 0x7f43c00b50b0 2020-05-18T21:30:12.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43beffd700 1 -- 172.21.15.63:0/2028652699 >> v1:172.21.15.155:6789/0 conn(0x7f43c0064cc0 legacy=0x7f43c0149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43beffd700 1 -- 172.21.15.63:0/2028652699 >> v1:172.21.15.63:6789/0 conn(0x7f43c00b50b0 legacy=0x7f43c0061be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43be7fc700 1 -- 172.21.15.63:0/2028652699 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4104026631 0 0) 0x7f43a4003270 con 0x7f43c00b50b0 2020-05-18T21:30:12.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43beffd700 1 -- 172.21.15.63:0/2028652699 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c0066160 con 0x7f43c00b8ed0 2020-05-18T21:30:12.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43beffd700 1 --2- 172.21.15.63:0/2028652699 >> v2:172.21.15.155:3300/0 conn(0x7f43c00b8ed0 0x7f43c0064860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f43b0001bc0 tx=0x7f43a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43beffd700 1 --2- 172.21.15.63:0/2028652699 >> v2:172.21.15.155:3300/0 conn(0x7f43c00b8ed0 0x7f43c0064860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f43b0001bc0 tx=0x7f43a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43beffd700 1 --2- 172.21.15.63:0/2028652699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43c00b8ed0 0x7f43c0064860 secure :-1 s=READY pgs=619 cs=0 l=1 rx=0x7f43b0001bc0 tx=0x7f43a8007a80).ready entity=mon.1 client_cookie=525b734e1a71999f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:12.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43beffd700 1 --2- 172.21.15.63:0/2028652699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43c00b8ed0 0x7f43c0064860 secure :-1 s=THROTTLE_DONE pgs=619 cs=0 l=1 rx=0x7f43b0001bc0 tx=0x7f43a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43be7fc700 1 -- 172.21.15.63:0/2028652699 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43b0001a20 con 0x7f43c00b8ed0 2020-05-18T21:30:12.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43beffd700 1 --2- 172.21.15.63:0/2028652699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43c00b8ed0 0x7f43c0064860 secure :-1 s=THROTTLE_DONE pgs=619 cs=0 l=1 rx=0x7f43b0001bc0 tx=0x7f43a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43be7fc700 1 -- 172.21.15.63:0/2028652699 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a8008e40 con 0x7f43c00b8ed0 2020-05-18T21:30:12.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43c5dd7700 1 -- 172.21.15.63:0/2028652699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43c00b8ed0 msgr2=0x7f43c0064860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43beffd700 1 --2- 172.21.15.63:0/2028652699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43c00b8ed0 0x7f43c0064860 secure :-1 s=THROTTLE_DONE pgs=619 cs=0 l=1 rx=0x7f43b0001bc0 tx=0x7f43a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43be7fc700 1 -- 172.21.15.63:0/2028652699 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43a80114f0 con 0x7f43c00b8ed0 2020-05-18T21:30:12.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43c5dd7700 1 --2- 172.21.15.63:0/2028652699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43c00b8ed0 0x7f43c0064860 secure :-1 s=READY pgs=619 cs=0 l=1 rx=0x7f43b0001bc0 tx=0x7f43a8007a80).stop 2020-05-18T21:30:12.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43c5dd7700 1 -- 172.21.15.63:0/2028652699 shutdown_connections 2020-05-18T21:30:12.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43c5dd7700 1 --2- 172.21.15.63:0/2028652699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43c00b8ed0 0x7f43c0064860 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:12.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43c5dd7700 1 -- 172.21.15.63:0/2028652699 >> 172.21.15.63:0/2028652699 conn(0x7f43c00b83b0 msgr2=0x7f43c00b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:12.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43c5dd7700 1 -- 172.21.15.63:0/2028652699 shutdown_connections 2020-05-18T21:30:12.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.885+0000 7f43c5dd7700 1 -- 172.21.15.63:0/2028652699 wait complete. 2020-05-18T21:30:12.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.889+0000 7f43c5dd7700 1 Processor -- start 2020-05-18T21:30:12.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.889+0000 7f43c5dd7700 1 -- start start 2020-05-18T21:30:12.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.889+0000 7f43c5dd7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f43c00b8ed0 0x7f43c00b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:12.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.889+0000 7f43c5dd7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c0158100 con 0x7f43c00b50b0 2020-05-18T21:30:12.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.889+0000 7f43c5dd7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c01583a0 con 0x7f43c0064cc0 2020-05-18T21:30:12.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.889+0000 7f43c5dd7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c0158640 con 0x7f43c00b8ed0 2020-05-18T21:30:12.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.889+0000 7f43beffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f43c00b50b0 0x7f43c00ad3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59392/0 (socket says 172.21.15.63:59392) 2020-05-18T21:30:12.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.889+0000 7f43beffd700 1 -- 172.21.15.63:0/3588969705 learned_addr learned my addr 172.21.15.63:0/3588969705 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:12.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.889+0000 7f43bffff700 1 --2- 172.21.15.63:0/3588969705 >> v2:172.21.15.155:3300/0 conn(0x7f43c00b8ed0 0x7f43c00b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:12.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.889+0000 7f43bcff9700 1 -- 172.21.15.63:0/3588969705 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618830661 0 0) 0x7f43c0158100 con 0x7f43c00b50b0 2020-05-18T21:30:12.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.889+0000 7f43bcff9700 1 -- 172.21.15.63:0/3588969705 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4398002fe0 con 0x7f43c00b50b0 2020-05-18T21:30:12.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.889+0000 7f43bcff9700 1 -- 172.21.15.63:0/3588969705 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379990200 0 0) 0x7f43c01583a0 con 0x7f43c0064cc0 2020-05-18T21:30:12.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.889+0000 7f43bcff9700 1 -- 172.21.15.63:0/3588969705 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43c0158100 con 0x7f43c0064cc0 2020-05-18T21:30:12.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.889+0000 7f43bffff700 1 -- 172.21.15.63:0/3588969705 >> v1:172.21.15.155:6789/0 conn(0x7f43c0064cc0 legacy=0x7f43c01478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.889+0000 7f43bffff700 1 -- 172.21.15.63:0/3588969705 >> v1:172.21.15.63:6789/0 conn(0x7f43c00b50b0 legacy=0x7f43c00ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:12.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.889+0000 7f43bffff700 1 -- 172.21.15.63:0/3588969705 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c00b1fa0 con 0x7f43c00b8ed0 2020-05-18T21:30:12.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.889+0000 7f43bffff700 1 --2- 172.21.15.63:0/3588969705 >> v2:172.21.15.155:3300/0 conn(0x7f43c00b8ed0 0x7f43c00b0870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43c0043ce0 tx=0x7f43b8010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.889+0000 7f43bffff700 1 --2- 172.21.15.63:0/3588969705 >> v2:172.21.15.155:3300/0 conn(0x7f43c00b8ed0 0x7f43c00b0870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43c0043ce0 tx=0x7f43b8010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.889+0000 7f43bffff700 1 --2- 172.21.15.63:0/3588969705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43c00b8ed0 0x7f43c00b0870 secure :-1 s=READY pgs=621 cs=0 l=1 rx=0x7f43c0043ce0 tx=0x7f43b8010be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:12.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.893+0000 7f43bffff700 1 --2- 172.21.15.63:0/3588969705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43c00b8ed0 0x7f43c00b0870 secure :-1 s=THROTTLE_DONE pgs=621 cs=0 l=1 rx=0x7f43c0043ce0 tx=0x7f43b8010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.893+0000 7f43bcff9700 1 -- 172.21.15.63:0/3588969705 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43b8002280 con 0x7f43c00b8ed0 2020-05-18T21:30:12.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.893+0000 7f43bffff700 1 --2- 172.21.15.63:0/3588969705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43c00b8ed0 0x7f43c00b0870 secure :-1 s=THROTTLE_DONE pgs=621 cs=0 l=1 rx=0x7f43c0043ce0 tx=0x7f43b8010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.893+0000 7f43c5dd7700 1 -- 172.21.15.63:0/3588969705 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c0148000 con 0x7f43c00b8ed0 2020-05-18T21:30:12.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.893+0000 7f43bcff9700 1 -- 172.21.15.63:0/3588969705 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b80023e0 con 0x7f43c00b8ed0 2020-05-18T21:30:12.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.893+0000 7f43bffff700 1 --2- 172.21.15.63:0/3588969705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43c00b8ed0 0x7f43c00b0870 secure :-1 s=THROTTLE_DONE pgs=621 cs=0 l=1 rx=0x7f43c0043ce0 tx=0x7f43b8010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.893+0000 7f43bcff9700 1 -- 172.21.15.63:0/3588969705 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43b80027c0 con 0x7f43c00b8ed0 2020-05-18T21:30:12.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.893+0000 7f43c5dd7700 1 -- 172.21.15.63:0/3588969705 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c0157c80 con 0x7f43c00b8ed0 2020-05-18T21:30:12.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.893+0000 7f43bffff700 1 --2- 172.21.15.63:0/3588969705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43c00b8ed0 0x7f43c00b0870 secure :-1 s=THROTTLE_DONE pgs=621 cs=0 l=1 rx=0x7f43c0043ce0 tx=0x7f43b8010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.893+0000 7f43c5dd7700 1 -- 172.21.15.63:0/3588969705 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c00569e0 con 0x7f43c00b8ed0 2020-05-18T21:30:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.893+0000 7f43bcff9700 1 -- 172.21.15.63:0/3588969705 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f43b8002a40 con 0x7f43c00b8ed0 2020-05-18T21:30:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.893+0000 7f43bffff700 1 --2- 172.21.15.63:0/3588969705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43c00b8ed0 0x7f43c00b0870 secure :-1 s=THROTTLE_DONE pgs=621 cs=0 l=1 rx=0x7f43c0043ce0 tx=0x7f43b8010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.893+0000 7f43bcff9700 1 --2- 172.21.15.63:0/3588969705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f439804fe30 0x7f43980522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.893+0000 7f43bcff9700 1 -- 172.21.15.63:0/3588969705 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f43b80640e0 con 0x7f43c00b8ed0 2020-05-18T21:30:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.893+0000 7f43bf7fe700 1 --2- 172.21.15.63:0/3588969705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f439804fe30 0x7f43980522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:12.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.897+0000 7f43bf7fe700 1 --2- 172.21.15.63:0/3588969705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f439804fe30 0x7f43980522f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43c01490b0 tx=0x7f43c005b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.897+0000 7f43bf7fe700 1 --2- 172.21.15.63:0/3588969705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f439804fe30 0x7f43980522f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43c01490b0 tx=0x7f43c005b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.897+0000 7f43bf7fe700 1 --2- 172.21.15.63:0/3588969705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f439804fe30 0x7f43980522f0 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f43c01490b0 tx=0x7f43c005b560).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:12.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.905+0000 7f43bffff700 1 --2- 172.21.15.63:0/3588969705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43c00b8ed0 0x7f43c00b0870 secure :-1 s=THROTTLE_DONE pgs=621 cs=0 l=1 rx=0x7f43c0043ce0 tx=0x7f43b8010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:12.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:12.905+0000 7f43bcff9700 1 -- 172.21.15.63:0/3588969705 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f43b803e470 con 0x7f43c00b8ed0 2020-05-18T21:30:13.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.021+0000 7f43c5dd7700 1 -- 172.21.15.63:0/3588969705 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f43c0066810 con 0x7f43c00b8ed0 2020-05-18T21:30:13.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.021+0000 7f43bffff700 1 --2- 172.21.15.63:0/3588969705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43c00b8ed0 0x7f43c00b0870 secure :-1 s=THROTTLE_DONE pgs=621 cs=0 l=1 rx=0x7f43c0043ce0 tx=0x7f43b8010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.026 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:30:13.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.021+0000 7f43bcff9700 1 -- 172.21.15.63:0/3588969705 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v73) v1 ==== 110+0+10 (secure 0 0 0) 0x7f43b8041a90 con 0x7f43c00b8ed0 2020-05-18T21:30:13.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.021+0000 7f43c5dd7700 1 -- 172.21.15.63:0/3588969705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f439804fe30 msgr2=0x7f43980522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.021+0000 7f43c5dd7700 1 --2- 172.21.15.63:0/3588969705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f439804fe30 0x7f43980522f0 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f43c01490b0 tx=0x7f43c005b560).stop 2020-05-18T21:30:13.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.021+0000 7f43c5dd7700 1 -- 172.21.15.63:0/3588969705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43c00b8ed0 msgr2=0x7f43c00b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.021+0000 7f43c5dd7700 1 --2- 172.21.15.63:0/3588969705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43c00b8ed0 0x7f43c00b0870 secure :-1 s=READY pgs=621 cs=0 l=1 rx=0x7f43c0043ce0 tx=0x7f43b8010be0).stop 2020-05-18T21:30:13.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.025+0000 7f43c5dd7700 1 -- 172.21.15.63:0/3588969705 shutdown_connections 2020-05-18T21:30:13.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.025+0000 7f43c5dd7700 1 --2- 172.21.15.63:0/3588969705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f439804fe30 0x7f43980522f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:13.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.025+0000 7f43c5dd7700 1 --2- 172.21.15.63:0/3588969705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43c00b8ed0 0x7f43c00b0870 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:13.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.025+0000 7f43c5dd7700 1 -- 172.21.15.63:0/3588969705 >> 172.21.15.63:0/3588969705 conn(0x7f43c00b83b0 msgr2=0x7f43c01451a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:13.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.025+0000 7f43c5dd7700 1 -- 172.21.15.63:0/3588969705 shutdown_connections 2020-05-18T21:30:13.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.025+0000 7f43c5dd7700 1 -- 172.21.15.63:0/3588969705 wait complete. 2020-05-18T21:30:13.043 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:30:13.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.145+0000 7f5911b36700 1 Processor -- start 2020-05-18T21:30:13.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.145+0000 7f5911b36700 1 -- start start 2020-05-18T21:30:13.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f5911b36700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f590c0b8630 0x7f590c0b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:13.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f5911b36700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f590c0b42b0 0x7f590c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:13.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f5911b36700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f590c060660 con 0x7f590c0b9500 2020-05-18T21:30:13.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f5911b36700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590c0b4ba0 con 0x7f590c0b8630 2020-05-18T21:30:13.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f5911b36700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590c060890 con 0x7f590c0b42b0 2020-05-18T21:30:13.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f590affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f590c0b8630 0x7f590c0b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f590affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f590c0b8630 0x7f590c0b6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57212/0 (socket says 172.21.15.63:57212) 2020-05-18T21:30:13.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f590affd700 1 -- 172.21.15.63:0/3595149043 learned_addr learned my addr 172.21.15.63:0/3595149043 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:13.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f590b7fe700 1 --1- 172.21.15.63:0/3595149043 >> v1:172.21.15.63:6789/0 conn(0x7f590c0b9500 0x7f590c061270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59398/0 (socket says 172.21.15.63:59398) 2020-05-18T21:30:13.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f590bfff700 1 --2- 172.21.15.63:0/3595149043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f590c0b42b0 0x7f590c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f590affd700 1 -- 172.21.15.63:0/3595149043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f590c0b42b0 msgr2=0x7f590c0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:13.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f590affd700 1 --2- 172.21.15.63:0/3595149043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f590c0b42b0 0x7f590c0b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:13.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f590affd700 1 -- 172.21.15.63:0/3595149043 >> v1:172.21.15.63:6789/0 conn(0x7f590c0b9500 legacy=0x7f590c061270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f590affd700 1 -- 172.21.15.63:0/3595149043 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c060b30 con 0x7f590c0b8630 2020-05-18T21:30:13.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f590bfff700 1 --2- 172.21.15.63:0/3595149043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f590c0b42b0 0x7f590c0b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:30:13.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f590affd700 1 --2- 172.21.15.63:0/3595149043 >> v2:172.21.15.63:3300/0 conn(0x7f590c0b8630 0x7f590c0b6d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5900002f70 tx=0x7f5900007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f590affd700 1 --2- 172.21.15.63:0/3595149043 >> v2:172.21.15.63:3300/0 conn(0x7f590c0b8630 0x7f590c0b6d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5900002f70 tx=0x7f5900007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f590affd700 1 --2- 172.21.15.63:0/3595149043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f590c0b8630 0x7f590c0b6d90 secure :-1 s=READY pgs=865 cs=0 l=1 rx=0x7f5900002f70 tx=0x7f5900007a80).ready entity=mon.0 client_cookie=86c19db407ad498 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:13.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f590affd700 1 --2- 172.21.15.63:0/3595149043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f590c0b8630 0x7f590c0b6d90 secure :-1 s=THROTTLE_DONE pgs=865 cs=0 l=1 rx=0x7f5900002f70 tx=0x7f5900007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f590affd700 1 --2- 172.21.15.63:0/3595149043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f590c0b8630 0x7f590c0b6d90 secure :-1 s=THROTTLE_DONE pgs=865 cs=0 l=1 rx=0x7f5900002f70 tx=0x7f5900007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f590a7fc700 1 -- 172.21.15.63:0/3595149043 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5900011760 con 0x7f590c0b8630 2020-05-18T21:30:13.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f590affd700 1 --2- 172.21.15.63:0/3595149043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f590c0b8630 0x7f590c0b6d90 secure :-1 s=THROTTLE_DONE pgs=865 cs=0 l=1 rx=0x7f5900002f70 tx=0x7f5900007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f590a7fc700 1 -- 172.21.15.63:0/3595149043 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59000118c0 con 0x7f590c0b8630 2020-05-18T21:30:13.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f590a7fc700 1 -- 172.21.15.63:0/3595149043 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5900011ce0 con 0x7f590c0b8630 2020-05-18T21:30:13.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f5911b36700 1 -- 172.21.15.63:0/3595149043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f590c0b8630 msgr2=0x7f590c0b6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f5911b36700 1 --2- 172.21.15.63:0/3595149043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f590c0b8630 0x7f590c0b6d90 secure :-1 s=READY pgs=865 cs=0 l=1 rx=0x7f5900002f70 tx=0x7f5900007a80).stop 2020-05-18T21:30:13.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f5911b36700 1 -- 172.21.15.63:0/3595149043 shutdown_connections 2020-05-18T21:30:13.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f5911b36700 1 --2- 172.21.15.63:0/3595149043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f590c0b42b0 0x7f590c0b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:13.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f5911b36700 1 --2- 172.21.15.63:0/3595149043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f590c0b8630 0x7f590c0b6d90 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:13.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f5911b36700 1 -- 172.21.15.63:0/3595149043 >> 172.21.15.63:0/3595149043 conn(0x7f590c069b70 msgr2=0x7f590c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:13.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f5911b36700 1 -- 172.21.15.63:0/3595149043 shutdown_connections 2020-05-18T21:30:13.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.149+0000 7f5911b36700 1 -- 172.21.15.63:0/3595149043 wait complete. 2020-05-18T21:30:13.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.153+0000 7f5911b36700 1 Processor -- start 2020-05-18T21:30:13.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.153+0000 7f5911b36700 1 -- start start 2020-05-18T21:30:13.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.153+0000 7f5911b36700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f590c0b8630 0x7f590c0ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:13.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.153+0000 7f5911b36700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f590c0b9500 0x7f590c157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:13.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.153+0000 7f5911b36700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f590c14a9b0 con 0x7f590c0b42b0 2020-05-18T21:30:13.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.153+0000 7f5911b36700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590c1578f0 con 0x7f590c0b8630 2020-05-18T21:30:13.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.153+0000 7f5911b36700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590c156ab0 con 0x7f590c0b9500 2020-05-18T21:30:13.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.153+0000 7f590affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f590c0b8630 0x7f590c0ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.153+0000 7f590b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f590c0b42b0 0x7f590c12dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59404/0 (socket says 172.21.15.63:59404) 2020-05-18T21:30:13.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.153+0000 7f590b7fe700 1 -- 172.21.15.63:0/3572385921 learned_addr learned my addr 172.21.15.63:0/3572385921 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:13.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.153+0000 7f590bfff700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f590c0b9500 0x7f590c157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.153+0000 7f5908ff9700 1 -- 172.21.15.63:0/3572385921 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3890764416 0 0) 0x7f590c14a9b0 con 0x7f590c0b42b0 2020-05-18T21:30:13.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.153+0000 7f5908ff9700 1 -- 172.21.15.63:0/3572385921 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58ec002fe0 con 0x7f590c0b42b0 2020-05-18T21:30:13.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f590affd700 1 -- 172.21.15.63:0/3572385921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f590c0b9500 msgr2=0x7f590c157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f590affd700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f590c0b9500 0x7f590c157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:13.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f590affd700 1 -- 172.21.15.63:0/3572385921 >> v1:172.21.15.63:6789/0 conn(0x7f590c0b42b0 legacy=0x7f590c12dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f590affd700 1 -- 172.21.15.63:0/3572385921 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c156d50 con 0x7f590c0b8630 2020-05-18T21:30:13.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f590affd700 1 --2- 172.21.15.63:0/3572385921 >> v2:172.21.15.63:3300/0 conn(0x7f590c0b8630 0x7f590c0ac4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5900002f70 tx=0x7f5900007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f590affd700 1 --2- 172.21.15.63:0/3572385921 >> v2:172.21.15.63:3300/0 conn(0x7f590c0b8630 0x7f590c0ac4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5900002f70 tx=0x7f5900007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f590affd700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f590c0b8630 0x7f590c0ac4d0 secure :-1 s=READY pgs=867 cs=0 l=1 rx=0x7f5900002f70 tx=0x7f5900007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:13.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f590affd700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f590c0b8630 0x7f590c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=867 cs=0 l=1 rx=0x7f5900002f70 tx=0x7f5900007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f5908ff9700 1 -- 172.21.15.63:0/3572385921 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5900011d30 con 0x7f590c0b8630 2020-05-18T21:30:13.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f590affd700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f590c0b8630 0x7f590c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=867 cs=0 l=1 rx=0x7f5900002f70 tx=0x7f5900007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f590affd700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f590c0b8630 0x7f590c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=867 cs=0 l=1 rx=0x7f5900002f70 tx=0x7f5900007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f5908ff9700 1 -- 172.21.15.63:0/3572385921 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5900007360 con 0x7f590c0b8630 2020-05-18T21:30:13.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f5911b36700 1 -- 172.21.15.63:0/3572385921 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590c156ff0 con 0x7f590c0b8630 2020-05-18T21:30:13.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f5908ff9700 1 -- 172.21.15.63:0/3572385921 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5900005700 con 0x7f590c0b8630 2020-05-18T21:30:13.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f5911b36700 1 -- 172.21.15.63:0/3572385921 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590c0b35a0 con 0x7f590c0b8630 2020-05-18T21:30:13.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f590affd700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f590c0b8630 0x7f590c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=867 cs=0 l=1 rx=0x7f5900002f70 tx=0x7f5900007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f5911b36700 1 -- 172.21.15.63:0/3572385921 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590c157180 con 0x7f590c0b8630 2020-05-18T21:30:13.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f5908ff9700 1 -- 172.21.15.63:0/3572385921 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5900005860 con 0x7f590c0b8630 2020-05-18T21:30:13.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f590affd700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f590c0b8630 0x7f590c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=867 cs=0 l=1 rx=0x7f5900002f70 tx=0x7f5900007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f5908ff9700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f58ec04fdd0 0x7f58ec052290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:13.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f5908ff9700 1 -- 172.21.15.63:0/3572385921 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f59000644d0 con 0x7f590c0b8630 2020-05-18T21:30:13.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.157+0000 7f590b7fe700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f58ec04fdd0 0x7f58ec052290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.161+0000 7f590b7fe700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f58ec04fdd0 0x7f58ec052290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58fc000f30 tx=0x7f58fc0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.161+0000 7f590b7fe700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f58ec04fdd0 0x7f58ec052290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58fc000f30 tx=0x7f58fc0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.161+0000 7f590b7fe700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f58ec04fdd0 0x7f58ec052290 secure :-1 s=READY pgs=351 cs=0 l=1 rx=0x7f58fc000f30 tx=0x7f58fc0017a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:13.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.165+0000 7f590affd700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f590c0b8630 0x7f590c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=867 cs=0 l=1 rx=0x7f5900002f70 tx=0x7f5900007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.165+0000 7f5908ff9700 1 -- 172.21.15.63:0/3572385921 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f590003e8c0 con 0x7f590c0b8630 2020-05-18T21:30:13.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.285+0000 7f5911b36700 1 -- 172.21.15.63:0/3572385921 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f590c0569e0 con 0x7f590c0b8630 2020-05-18T21:30:13.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.285+0000 7f590affd700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f590c0b8630 0x7f590c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=867 cs=0 l=1 rx=0x7f5900002f70 tx=0x7f5900007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.285+0000 7f5908ff9700 1 -- 172.21.15.63:0/3572385921 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v73) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5900041ee0 con 0x7f590c0b8630 2020-05-18T21:30:13.290 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:30:13.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.285+0000 7f5911b36700 1 -- 172.21.15.63:0/3572385921 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f58ec04fdd0 msgr2=0x7f58ec052290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.285+0000 7f5911b36700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f58ec04fdd0 0x7f58ec052290 secure :-1 s=READY pgs=351 cs=0 l=1 rx=0x7f58fc000f30 tx=0x7f58fc0017a0).stop 2020-05-18T21:30:13.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.285+0000 7f5911b36700 1 -- 172.21.15.63:0/3572385921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f590c0b8630 msgr2=0x7f590c0ac4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.285+0000 7f5911b36700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f590c0b8630 0x7f590c0ac4d0 secure :-1 s=READY pgs=867 cs=0 l=1 rx=0x7f5900002f70 tx=0x7f5900007a80).stop 2020-05-18T21:30:13.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.285+0000 7f5911b36700 1 -- 172.21.15.63:0/3572385921 shutdown_connections 2020-05-18T21:30:13.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.285+0000 7f5911b36700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f58ec04fdd0 0x7f58ec052290 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:13.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.285+0000 7f5911b36700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f590c0b9500 0x7f590c157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:13.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.285+0000 7f5911b36700 1 --2- 172.21.15.63:0/3572385921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f590c0b8630 0x7f590c0ac4d0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:13.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.285+0000 7f5911b36700 1 -- 172.21.15.63:0/3572385921 >> 172.21.15.63:0/3572385921 conn(0x7f590c069b70 msgr2=0x7f590c0b7270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:13.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.285+0000 7f5911b36700 1 -- 172.21.15.63:0/3572385921 shutdown_connections 2020-05-18T21:30:13.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.285+0000 7f5911b36700 1 -- 172.21.15.63:0/3572385921 wait complete. 2020-05-18T21:30:13.307 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:30:13.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd60260d700 1 Processor -- start 2020-05-18T21:30:13.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd60260d700 1 -- start start 2020-05-18T21:30:13.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd60260d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc06a490 0x7fd5fc0653f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:13.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd60260d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd5fc060e10 0x7fd5fc061260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:13.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd60260d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5fc065a50 con 0x7fd5fc0b4f60 2020-05-18T21:30:13.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd60260d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5fc065850 con 0x7fd5fc060e10 2020-05-18T21:30:13.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd60260d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5fc0606d0 con 0x7fd5fc06a490 2020-05-18T21:30:13.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd601e0c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd5fc060e10 0x7fd5fc061260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd601e0c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd5fc060e10 0x7fd5fc061260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57228/0 (socket says 172.21.15.63:57228) 2020-05-18T21:30:13.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd601e0c700 1 -- 172.21.15.63:0/3495572439 learned_addr learned my addr 172.21.15.63:0/3495572439 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:13.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd600e0a700 1 --2- 172.21.15.63:0/3495572439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc06a490 0x7fd5fc0653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd601e0c700 1 -- 172.21.15.63:0/3495572439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc06a490 msgr2=0x7fd5fc0653f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:13.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd601e0c700 1 --2- 172.21.15.63:0/3495572439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc06a490 0x7fd5fc0653f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:13.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd601e0c700 1 -- 172.21.15.63:0/3495572439 >> v1:172.21.15.155:6789/0 conn(0x7fd5fc0b4f60 legacy=0x7fd5fc129880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd601e0c700 1 -- 172.21.15.63:0/3495572439 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc060970 con 0x7fd5fc060e10 2020-05-18T21:30:13.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd601e0c700 1 --2- 172.21.15.63:0/3495572439 >> v2:172.21.15.63:3300/0 conn(0x7fd5fc060e10 0x7fd5fc061260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd5f40032f0 tx=0x7fd5f4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd601e0c700 1 --2- 172.21.15.63:0/3495572439 >> v2:172.21.15.63:3300/0 conn(0x7fd5fc060e10 0x7fd5fc061260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd5f40032f0 tx=0x7fd5f4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd601e0c700 1 --2- 172.21.15.63:0/3495572439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5fc060e10 0x7fd5fc061260 secure :-1 s=READY pgs=868 cs=0 l=1 rx=0x7fd5f40032f0 tx=0x7fd5f4007e00).ready entity=mon.0 client_cookie=d89dc256d81020d5 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:13.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd601e0c700 1 --2- 172.21.15.63:0/3495572439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5fc060e10 0x7fd5fc061260 secure :-1 s=THROTTLE_DONE pgs=868 cs=0 l=1 rx=0x7fd5f40032f0 tx=0x7fd5f4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd5ebfff700 1 -- 172.21.15.63:0/3495572439 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f4011dc0 con 0x7fd5fc060e10 2020-05-18T21:30:13.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd601e0c700 1 --2- 172.21.15.63:0/3495572439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5fc060e10 0x7fd5fc061260 secure :-1 s=THROTTLE_DONE pgs=868 cs=0 l=1 rx=0x7fd5f40032f0 tx=0x7fd5f4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd601e0c700 1 --2- 172.21.15.63:0/3495572439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5fc060e10 0x7fd5fc061260 secure :-1 s=THROTTLE_DONE pgs=868 cs=0 l=1 rx=0x7fd5f40032f0 tx=0x7fd5f4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd5ebfff700 1 -- 172.21.15.63:0/3495572439 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f400a180 con 0x7fd5fc060e10 2020-05-18T21:30:13.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd5ebfff700 1 -- 172.21.15.63:0/3495572439 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f400a5a0 con 0x7fd5fc060e10 2020-05-18T21:30:13.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd60260d700 1 -- 172.21.15.63:0/3495572439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5fc060e10 msgr2=0x7fd5fc061260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.413+0000 7fd60260d700 1 --2- 172.21.15.63:0/3495572439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5fc060e10 0x7fd5fc061260 secure :-1 s=READY pgs=868 cs=0 l=1 rx=0x7fd5f40032f0 tx=0x7fd5f4007e00).stop 2020-05-18T21:30:13.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd60260d700 1 -- 172.21.15.63:0/3495572439 shutdown_connections 2020-05-18T21:30:13.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd60260d700 1 --2- 172.21.15.63:0/3495572439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5fc060e10 0x7fd5fc061260 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:13.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd60260d700 1 --2- 172.21.15.63:0/3495572439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc06a490 0x7fd5fc0653f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:13.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd60260d700 1 -- 172.21.15.63:0/3495572439 >> 172.21.15.63:0/3495572439 conn(0x7fd5fc05fbd0 msgr2=0x7fd5fc069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:13.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd60260d700 1 -- 172.21.15.63:0/3495572439 shutdown_connections 2020-05-18T21:30:13.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd60260d700 1 -- 172.21.15.63:0/3495572439 wait complete. 2020-05-18T21:30:13.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd60260d700 1 Processor -- start 2020-05-18T21:30:13.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd60260d700 1 -- start start 2020-05-18T21:30:13.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd60260d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc0b4f60 0x7fd5fc0b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:13.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd60260d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5fc1424d0 con 0x7fd5fc060e10 2020-05-18T21:30:13.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd60260d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5fc142770 con 0x7fd5fc06a490 2020-05-18T21:30:13.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd60260d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5fc1422f0 con 0x7fd5fc0b4f60 2020-05-18T21:30:13.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd60160b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd5fc060e10 0x7fd5fc1267e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59418/0 (socket says 172.21.15.63:59418) 2020-05-18T21:30:13.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd60160b700 1 -- 172.21.15.63:0/3206281568 learned_addr learned my addr 172.21.15.63:0/3206281568 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:13.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd601e0c700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc0b4f60 0x7fd5fc0b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd5ea7fc700 1 -- 172.21.15.63:0/3206281568 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968218975 0 0) 0x7fd5fc1424d0 con 0x7fd5fc060e10 2020-05-18T21:30:13.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd5ea7fc700 1 -- 172.21.15.63:0/3206281568 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5dc002fe0 con 0x7fd5fc060e10 2020-05-18T21:30:13.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd5ea7fc700 1 -- 172.21.15.63:0/3206281568 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477202069 0 0) 0x7fd5fc142770 con 0x7fd5fc06a490 2020-05-18T21:30:13.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd5ea7fc700 1 -- 172.21.15.63:0/3206281568 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5fc1424d0 con 0x7fd5fc06a490 2020-05-18T21:30:13.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd601e0c700 1 -- 172.21.15.63:0/3206281568 >> v1:172.21.15.155:6789/0 conn(0x7fd5fc06a490 legacy=0x7fd5fc0b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd601e0c700 1 -- 172.21.15.63:0/3206281568 >> v1:172.21.15.63:6789/0 conn(0x7fd5fc060e10 legacy=0x7fd5fc1267e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.417+0000 7fd601e0c700 1 -- 172.21.15.63:0/3206281568 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc126ef0 con 0x7fd5fc0b4f60 2020-05-18T21:30:13.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.421+0000 7fd601e0c700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc0b4f60 0x7fd5fc0b2040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd5f40032f0 tx=0x7fd5f4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.421+0000 7fd601e0c700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc0b4f60 0x7fd5fc0b2040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd5f40032f0 tx=0x7fd5f4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.421+0000 7fd601e0c700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc0b4f60 0x7fd5fc0b2040 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7fd5f40032f0 tx=0x7fd5f4007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:13.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.421+0000 7fd601e0c700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc0b4f60 0x7fd5fc0b2040 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fd5f40032f0 tx=0x7fd5f4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.421+0000 7fd5ea7fc700 1 -- 172.21.15.63:0/3206281568 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f4011ea0 con 0x7fd5fc0b4f60 2020-05-18T21:30:13.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.421+0000 7fd601e0c700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc0b4f60 0x7fd5fc0b2040 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fd5f40032f0 tx=0x7fd5f4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.421+0000 7fd5ea7fc700 1 -- 172.21.15.63:0/3206281568 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f4010680 con 0x7fd5fc0b4f60 2020-05-18T21:30:13.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.421+0000 7fd601e0c700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc0b4f60 0x7fd5fc0b2040 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fd5f40032f0 tx=0x7fd5f4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.421+0000 7fd60260d700 1 -- 172.21.15.63:0/3206281568 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5fc127140 con 0x7fd5fc0b4f60 2020-05-18T21:30:13.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.421+0000 7fd5ea7fc700 1 -- 172.21.15.63:0/3206281568 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f4005e60 con 0x7fd5fc0b4f60 2020-05-18T21:30:13.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.421+0000 7fd60260d700 1 -- 172.21.15.63:0/3206281568 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5fc140070 con 0x7fd5fc0b4f60 2020-05-18T21:30:13.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.421+0000 7fd601e0c700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc0b4f60 0x7fd5fc0b2040 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fd5f40032f0 tx=0x7fd5f4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.421+0000 7fd60260d700 1 -- 172.21.15.63:0/3206281568 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5fc0569e0 con 0x7fd5fc0b4f60 2020-05-18T21:30:13.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.421+0000 7fd5ea7fc700 1 -- 172.21.15.63:0/3206281568 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd5f4007170 con 0x7fd5fc0b4f60 2020-05-18T21:30:13.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.421+0000 7fd601e0c700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc0b4f60 0x7fd5fc0b2040 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fd5f40032f0 tx=0x7fd5f4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.421+0000 7fd5ea7fc700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd5dc04fe60 0x7fd5dc052320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:13.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.421+0000 7fd5ea7fc700 1 -- 172.21.15.63:0/3206281568 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd5f40648a0 con 0x7fd5fc0b4f60 2020-05-18T21:30:13.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.425+0000 7fd60160b700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd5dc04fe60 0x7fd5dc052320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.425+0000 7fd60160b700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd5dc04fe60 0x7fd5dc052320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd5f8001110 tx=0x7fd5f8001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.425+0000 7fd60160b700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd5dc04fe60 0x7fd5dc052320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd5f8001110 tx=0x7fd5f8001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.425+0000 7fd60160b700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd5dc04fe60 0x7fd5dc052320 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7fd5f8001110 tx=0x7fd5f8001800).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:13.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.429+0000 7fd601e0c700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc0b4f60 0x7fd5fc0b2040 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fd5f40032f0 tx=0x7fd5f4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.429+0000 7fd5ea7fc700 1 -- 172.21.15.63:0/3206281568 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd5f403ed50 con 0x7fd5fc0b4f60 2020-05-18T21:30:13.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.553+0000 7fd60260d700 1 -- 172.21.15.63:0/3206281568 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd5fc142900 con 0x7fd5fc0b4f60 2020-05-18T21:30:13.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.553+0000 7fd601e0c700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc0b4f60 0x7fd5fc0b2040 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fd5f40032f0 tx=0x7fd5f4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.553+0000 7fd5ea7fc700 1 -- 172.21.15.63:0/3206281568 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd5f4042370 con 0x7fd5fc0b4f60 2020-05-18T21:30:13.559 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:30:13.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.557+0000 7fd60260d700 1 -- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd5dc04fe60 msgr2=0x7fd5dc052320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.557+0000 7fd60260d700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd5dc04fe60 0x7fd5dc052320 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7fd5f8001110 tx=0x7fd5f8001800).stop 2020-05-18T21:30:13.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.557+0000 7fd60260d700 1 -- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc0b4f60 msgr2=0x7fd5fc0b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.557+0000 7fd60260d700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc0b4f60 0x7fd5fc0b2040 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7fd5f40032f0 tx=0x7fd5f4007e00).stop 2020-05-18T21:30:13.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.557+0000 7fd60260d700 1 -- 172.21.15.63:0/3206281568 shutdown_connections 2020-05-18T21:30:13.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.557+0000 7fd60260d700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd5dc04fe60 0x7fd5dc052320 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:13.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.557+0000 7fd60260d700 1 --2- 172.21.15.63:0/3206281568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc0b4f60 0x7fd5fc0b2040 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:13.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.557+0000 7fd60260d700 1 -- 172.21.15.63:0/3206281568 >> 172.21.15.63:0/3206281568 conn(0x7fd5fc05fbd0 msgr2=0x7fd5fc061cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:13.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.557+0000 7fd60260d700 1 -- 172.21.15.63:0/3206281568 shutdown_connections 2020-05-18T21:30:13.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.557+0000 7fd60260d700 1 -- 172.21.15.63:0/3206281568 wait complete. 2020-05-18T21:30:13.577 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:30:13.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.681+0000 7f51a4fc0700 1 Processor -- start 2020-05-18T21:30:13.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.681+0000 7f51a4fc0700 1 -- start start 2020-05-18T21:30:13.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f51a4fc0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f51a0143820 0x7f51a00986f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:13.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f51a4fc0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f51a0142ba0 0x7f51a00b9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:13.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f51a4fc0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a00b96c0 0x7f51a005ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:13.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f51a4fc0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a00b48f0 con 0x7f51a0142ba0 2020-05-18T21:30:13.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f51a4fc0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a00b4b90 con 0x7f51a0143820 2020-05-18T21:30:13.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f51a4fc0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00b4e30 con 0x7f51a00b96c0 2020-05-18T21:30:13.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f5197fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f51a0142ba0 0x7f51a00b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f5197fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f51a0142ba0 0x7f51a00b9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57240/0 (socket says 172.21.15.63:57240) 2020-05-18T21:30:13.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f5197fff700 1 -- 172.21.15.63:0/3311154084 learned_addr learned my addr 172.21.15.63:0/3311154084 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:13.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f519ffff700 1 --2- 172.21.15.63:0/3311154084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a00b96c0 0x7f51a005ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f5197fff700 1 -- 172.21.15.63:0/3311154084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a00b96c0 msgr2=0x7f51a005ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:13.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f519f7fe700 1 --2- 172.21.15.63:0/3311154084 >> v2:172.21.15.155:3300/0 conn(0x7f51a0143820 0x7f51a00986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f5197fff700 1 --2- 172.21.15.63:0/3311154084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a00b96c0 0x7f51a005ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:13.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f5197fff700 1 -- 172.21.15.63:0/3311154084 >> v2:172.21.15.155:3300/0 conn(0x7f51a0143820 msgr2=0x7f51a00986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:13.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f5197fff700 1 --2- 172.21.15.63:0/3311154084 >> v2:172.21.15.155:3300/0 conn(0x7f51a0143820 0x7f51a00986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:13.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f5197fff700 1 -- 172.21.15.63:0/3311154084 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a00b50d0 con 0x7f51a0142ba0 2020-05-18T21:30:13.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f519ffff700 1 --2- 172.21.15.63:0/3311154084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a00b96c0 0x7f51a005ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:30:13.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f519f7fe700 1 --2- 172.21.15.63:0/3311154084 >> v2:172.21.15.155:3300/0 conn(0x7f51a0143820 0x7f51a00986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:30:13.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f5197fff700 1 --2- 172.21.15.63:0/3311154084 >> v2:172.21.15.63:3300/0 conn(0x7f51a0142ba0 0x7f51a00b9260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5188002f70 tx=0x7f5188007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f5197fff700 1 --2- 172.21.15.63:0/3311154084 >> v2:172.21.15.63:3300/0 conn(0x7f51a0142ba0 0x7f51a00b9260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5188002f70 tx=0x7f5188007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f5197fff700 1 --2- 172.21.15.63:0/3311154084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51a0142ba0 0x7f51a00b9260 secure :-1 s=READY pgs=870 cs=0 l=1 rx=0x7f5188002f70 tx=0x7f5188007a80).ready entity=mon.0 client_cookie=e6577e725b02a15c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:13.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f5197fff700 1 --2- 172.21.15.63:0/3311154084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51a0142ba0 0x7f51a00b9260 secure :-1 s=THROTTLE_DONE pgs=870 cs=0 l=1 rx=0x7f5188002f70 tx=0x7f5188007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f5197fff700 1 --2- 172.21.15.63:0/3311154084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51a0142ba0 0x7f51a00b9260 secure :-1 s=THROTTLE_DONE pgs=870 cs=0 l=1 rx=0x7f5188002f70 tx=0x7f5188007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f519effd700 1 -- 172.21.15.63:0/3311154084 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5188011760 con 0x7f51a0142ba0 2020-05-18T21:30:13.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f5197fff700 1 --2- 172.21.15.63:0/3311154084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51a0142ba0 0x7f51a00b9260 secure :-1 s=THROTTLE_DONE pgs=870 cs=0 l=1 rx=0x7f5188002f70 tx=0x7f5188007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f519effd700 1 -- 172.21.15.63:0/3311154084 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51880118c0 con 0x7f51a0142ba0 2020-05-18T21:30:13.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f519effd700 1 -- 172.21.15.63:0/3311154084 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5188011ce0 con 0x7f51a0142ba0 2020-05-18T21:30:13.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f51a4fc0700 1 -- 172.21.15.63:0/3311154084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51a0142ba0 msgr2=0x7f51a00b9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f51a4fc0700 1 --2- 172.21.15.63:0/3311154084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51a0142ba0 0x7f51a00b9260 secure :-1 s=READY pgs=870 cs=0 l=1 rx=0x7f5188002f70 tx=0x7f5188007a80).stop 2020-05-18T21:30:13.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f51a4fc0700 1 -- 172.21.15.63:0/3311154084 shutdown_connections 2020-05-18T21:30:13.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f51a4fc0700 1 --2- 172.21.15.63:0/3311154084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a00b96c0 0x7f51a005ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:13.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f51a4fc0700 1 --2- 172.21.15.63:0/3311154084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51a0142ba0 0x7f51a00b9260 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:13.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f51a4fc0700 1 --2- 172.21.15.63:0/3311154084 >> v2:172.21.15.155:3300/0 conn(0x7f51a0143820 0x7f51a00986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:13.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f51a4fc0700 1 -- 172.21.15.63:0/3311154084 >> 172.21.15.63:0/3311154084 conn(0x7f51a006a640 msgr2=0x7f51a00b8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:13.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f51a4fc0700 1 -- 172.21.15.63:0/3311154084 shutdown_connections 2020-05-18T21:30:13.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.685+0000 7f51a4fc0700 1 -- 172.21.15.63:0/3311154084 wait complete. 2020-05-18T21:30:13.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f51a4fc0700 1 Processor -- start 2020-05-18T21:30:13.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f51a4fc0700 1 -- start start 2020-05-18T21:30:13.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f51a4fc0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a0143820 0x7f51a00637d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:13.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f51a4fc0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a0145780 con 0x7f51a00b96c0 2020-05-18T21:30:13.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f51a4fc0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a0145a20 con 0x7f51a0142ba0 2020-05-18T21:30:13.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f51a4fc0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a0145cc0 con 0x7f51a0143820 2020-05-18T21:30:13.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f51a00b96c0 0x7f51a00630c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59432/0 (socket says 172.21.15.63:59432) 2020-05-18T21:30:13.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519f7fe700 1 -- 172.21.15.63:0/357688255 learned_addr learned my addr 172.21.15.63:0/357688255 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:13.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519ffff700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a0143820 0x7f51a00637d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519d7fa700 1 -- 172.21.15.63:0/357688255 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291978872 0 0) 0x7f51a0145780 con 0x7f51a00b96c0 2020-05-18T21:30:13.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519d7fa700 1 -- 172.21.15.63:0/357688255 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5184002fe0 con 0x7f51a00b96c0 2020-05-18T21:30:13.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519d7fa700 1 -- 172.21.15.63:0/357688255 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790970148 0 0) 0x7f51a0145a20 con 0x7f51a0142ba0 2020-05-18T21:30:13.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519d7fa700 1 -- 172.21.15.63:0/357688255 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51a0145780 con 0x7f51a0142ba0 2020-05-18T21:30:13.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519d7fa700 1 -- 172.21.15.63:0/357688255 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2636444970 0 0) 0x7f5184002fe0 con 0x7f51a00b96c0 2020-05-18T21:30:13.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519d7fa700 1 -- 172.21.15.63:0/357688255 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f51a0145a20 con 0x7f51a00b96c0 2020-05-18T21:30:13.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519d7fa700 1 -- 172.21.15.63:0/357688255 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f5190002690 con 0x7f51a00b96c0 2020-05-18T21:30:13.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519ffff700 1 -- 172.21.15.63:0/357688255 >> v1:172.21.15.155:6789/0 conn(0x7f51a0142ba0 legacy=0x7f51a01518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519ffff700 1 -- 172.21.15.63:0/357688255 >> v1:172.21.15.63:6789/0 conn(0x7f51a00b96c0 legacy=0x7f51a00630c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519ffff700 1 -- 172.21.15.63:0/357688255 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a0145330 con 0x7f51a0143820 2020-05-18T21:30:13.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519ffff700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a0143820 0x7f51a00637d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51980032f0 tx=0x7f5198010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519ffff700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a0143820 0x7f51a00637d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51980032f0 tx=0x7f5198010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519ffff700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a0143820 0x7f51a00637d0 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f51980032f0 tx=0x7f5198010d40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:13.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519ffff700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a0143820 0x7f51a00637d0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f51980032f0 tx=0x7f5198010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519d7fa700 1 -- 172.21.15.63:0/357688255 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51980103b0 con 0x7f51a0143820 2020-05-18T21:30:13.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519ffff700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a0143820 0x7f51a00637d0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f51980032f0 tx=0x7f5198010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519ffff700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a0143820 0x7f51a00637d0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f51980032f0 tx=0x7f5198010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519d7fa700 1 -- 172.21.15.63:0/357688255 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519800e7c0 con 0x7f51a0143820 2020-05-18T21:30:13.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f51a4fc0700 1 -- 172.21.15.63:0/357688255 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a00628e0 con 0x7f51a0143820 2020-05-18T21:30:13.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f519d7fa700 1 -- 172.21.15.63:0/357688255 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f519800eb20 con 0x7f51a0143820 2020-05-18T21:30:13.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.689+0000 7f51a4fc0700 1 -- 172.21.15.63:0/357688255 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a00b1fe0 con 0x7f51a0143820 2020-05-18T21:30:13.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.693+0000 7f519ffff700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a0143820 0x7f51a00637d0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f51980032f0 tx=0x7f5198010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.693+0000 7f51a4fc0700 1 -- 172.21.15.63:0/357688255 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a0145e80 con 0x7f51a0143820 2020-05-18T21:30:13.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.693+0000 7f519d7fa700 1 -- 172.21.15.63:0/357688255 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f519800ed60 con 0x7f51a0143820 2020-05-18T21:30:13.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.693+0000 7f519ffff700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a0143820 0x7f51a00637d0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f51980032f0 tx=0x7f5198010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.693+0000 7f519d7fa700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51840500e0 0x7f51840525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:13.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.693+0000 7f519d7fa700 1 -- 172.21.15.63:0/357688255 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5198063a70 con 0x7f51a0143820 2020-05-18T21:30:13.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.693+0000 7f519f7fe700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51840500e0 0x7f51840525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.693+0000 7f519f7fe700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51840500e0 0x7f51840525a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5190002460 tx=0x7f5190002c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.693+0000 7f519f7fe700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51840500e0 0x7f51840525a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5190002460 tx=0x7f5190002c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.693+0000 7f519f7fe700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51840500e0 0x7f51840525a0 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7f5190002460 tx=0x7f5190002c50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:13.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.701+0000 7f519ffff700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a0143820 0x7f51a00637d0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f51980032f0 tx=0x7f5198010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.701+0000 7f519d7fa700 1 -- 172.21.15.63:0/357688255 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f519803de00 con 0x7f51a0143820 2020-05-18T21:30:13.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.817+0000 7f51a4fc0700 1 -- 172.21.15.63:0/357688255 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f51a00569e0 con 0x7f51a0143820 2020-05-18T21:30:13.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.821+0000 7f519ffff700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a0143820 0x7f51a00637d0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f51980032f0 tx=0x7f5198010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.821+0000 7f519d7fa700 1 -- 172.21.15.63:0/357688255 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5198041420 con 0x7f51a0143820 2020-05-18T21:30:13.826 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:30:13.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.821+0000 7f51a4fc0700 1 -- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51840500e0 msgr2=0x7f51840525a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.821+0000 7f51a4fc0700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51840500e0 0x7f51840525a0 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7f5190002460 tx=0x7f5190002c50).stop 2020-05-18T21:30:13.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.821+0000 7f51a4fc0700 1 -- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a0143820 msgr2=0x7f51a00637d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.821+0000 7f51a4fc0700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a0143820 0x7f51a00637d0 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f51980032f0 tx=0x7f5198010d40).stop 2020-05-18T21:30:13.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.821+0000 7f51a4fc0700 1 -- 172.21.15.63:0/357688255 shutdown_connections 2020-05-18T21:30:13.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.821+0000 7f51a4fc0700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51840500e0 0x7f51840525a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:13.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.821+0000 7f51a4fc0700 1 --2- 172.21.15.63:0/357688255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51a0143820 0x7f51a00637d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:13.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.821+0000 7f51a4fc0700 1 -- 172.21.15.63:0/357688255 >> 172.21.15.63:0/357688255 conn(0x7f51a006a640 msgr2=0x7f51a0098f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:13.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.821+0000 7f51a4fc0700 1 -- 172.21.15.63:0/357688255 shutdown_connections 2020-05-18T21:30:13.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.821+0000 7f51a4fc0700 1 -- 172.21.15.63:0/357688255 wait complete. 2020-05-18T21:30:13.838 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:30:13.839 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:30:13.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc0089d6700 1 Processor -- start 2020-05-18T21:30:13.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc0089d6700 1 -- start start 2020-05-18T21:30:13.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc0089d6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc0040bb5e0 0x7fc0040acee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:13.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc0089d6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0040af980 con 0x7fc0040bbcd0 2020-05-18T21:30:13.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc0089d6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0040b0530 con 0x7fc00412efd0 2020-05-18T21:30:13.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc0089d6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0040af7a0 con 0x7fc0040bb5e0 2020-05-18T21:30:13.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc001d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc0040bbcd0 0x7fc0040afe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59442/0 (socket says 172.21.15.63:59442) 2020-05-18T21:30:13.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc001d9b700 1 -- 172.21.15.63:0/231232750 learned_addr learned my addr 172.21.15.63:0/231232750 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:13.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc00259c700 1 --2- 172.21.15.63:0/231232750 >> v2:172.21.15.155:3300/0 conn(0x7fc0040bb5e0 0x7fc0040acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc00159a700 1 -- 172.21.15.63:0/231232750 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245254786 0 0) 0x7fc0040af980 con 0x7fc0040bbcd0 2020-05-18T21:30:13.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc00159a700 1 -- 172.21.15.63:0/231232750 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfe8003270 con 0x7fc0040bbcd0 2020-05-18T21:30:13.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc00259c700 1 -- 172.21.15.63:0/231232750 >> v1:172.21.15.155:6789/0 conn(0x7fc00412efd0 legacy=0x7fc004145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc00259c700 1 -- 172.21.15.63:0/231232750 >> v1:172.21.15.63:6789/0 conn(0x7fc0040bbcd0 legacy=0x7fc0040afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc00259c700 1 -- 172.21.15.63:0/231232750 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0040bb9c0 con 0x7fc0040bb5e0 2020-05-18T21:30:13.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc00259c700 1 --2- 172.21.15.63:0/231232750 >> v2:172.21.15.155:3300/0 conn(0x7fc0040bb5e0 0x7fc0040acee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbffc001110 tx=0x7fbff4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc00259c700 1 --2- 172.21.15.63:0/231232750 >> v2:172.21.15.155:3300/0 conn(0x7fc0040bb5e0 0x7fc0040acee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbffc001110 tx=0x7fbff4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc00259c700 1 --2- 172.21.15.63:0/231232750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0040bb5e0 0x7fc0040acee0 secure :-1 s=READY pgs=626 cs=0 l=1 rx=0x7fbffc001110 tx=0x7fbff4007e00).ready entity=mon.1 client_cookie=f320adaa0053fcaa server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:13.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc00259c700 1 --2- 172.21.15.63:0/231232750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0040bb5e0 0x7fc0040acee0 secure :-1 s=THROTTLE_DONE pgs=626 cs=0 l=1 rx=0x7fbffc001110 tx=0x7fbff4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc00159a700 1 -- 172.21.15.63:0/231232750 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbff4010de0 con 0x7fc0040bb5e0 2020-05-18T21:30:13.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc00259c700 1 --2- 172.21.15.63:0/231232750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0040bb5e0 0x7fc0040acee0 secure :-1 s=THROTTLE_DONE pgs=626 cs=0 l=1 rx=0x7fbffc001110 tx=0x7fbff4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc00159a700 1 -- 172.21.15.63:0/231232750 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff40110d0 con 0x7fc0040bb5e0 2020-05-18T21:30:13.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc00259c700 1 --2- 172.21.15.63:0/231232750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0040bb5e0 0x7fc0040acee0 secure :-1 s=THROTTLE_DONE pgs=626 cs=0 l=1 rx=0x7fbffc001110 tx=0x7fbff4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc00159a700 1 -- 172.21.15.63:0/231232750 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbff40114b0 con 0x7fc0040bb5e0 2020-05-18T21:30:13.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc0089d6700 1 -- 172.21.15.63:0/231232750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0040bb5e0 msgr2=0x7fc0040acee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.933+0000 7fc0089d6700 1 --2- 172.21.15.63:0/231232750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0040bb5e0 0x7fc0040acee0 secure :-1 s=READY pgs=626 cs=0 l=1 rx=0x7fbffc001110 tx=0x7fbff4007e00).stop 2020-05-18T21:30:13.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.937+0000 7fc0089d6700 1 -- 172.21.15.63:0/231232750 shutdown_connections 2020-05-18T21:30:13.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.937+0000 7fc0089d6700 1 --2- 172.21.15.63:0/231232750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0040bb5e0 0x7fc0040acee0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:13.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.937+0000 7fc0089d6700 1 -- 172.21.15.63:0/231232750 >> 172.21.15.63:0/231232750 conn(0x7fc004069b70 msgr2=0x7fc004069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:13.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.937+0000 7fc0089d6700 1 -- 172.21.15.63:0/231232750 shutdown_connections 2020-05-18T21:30:13.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.937+0000 7fc0089d6700 1 -- 172.21.15.63:0/231232750 wait complete. 2020-05-18T21:30:13.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.937+0000 7fc0089d6700 1 Processor -- start 2020-05-18T21:30:13.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.937+0000 7fc0089d6700 1 -- start start 2020-05-18T21:30:13.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.937+0000 7fc0089d6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc00412efd0 0x7fc0040b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:13.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.937+0000 7fc0089d6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0040b8af0 con 0x7fc0040bbcd0 2020-05-18T21:30:13.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.937+0000 7fc0089d6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0040b4a50 con 0x7fc0040bb5e0 2020-05-18T21:30:13.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.937+0000 7fc0089d6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0040b4cf0 con 0x7fc00412efd0 2020-05-18T21:30:13.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.937+0000 7fc001d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc0040bbcd0 0x7fc004156da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59446/0 (socket says 172.21.15.63:59446) 2020-05-18T21:30:13.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.937+0000 7fc001d9b700 1 -- 172.21.15.63:0/1691716662 learned_addr learned my addr 172.21.15.63:0/1691716662 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:13.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc002d9d700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc00412efd0 0x7fc0040b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2149933003 0 0) 0x7fc0040b8af0 con 0x7fc0040bbcd0 2020-05-18T21:30:13.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfdc002fe0 con 0x7fc0040bbcd0 2020-05-18T21:30:13.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334270393 0 0) 0x7fc0040b4a50 con 0x7fc0040bb5e0 2020-05-18T21:30:13.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0040b8af0 con 0x7fc0040bb5e0 2020-05-18T21:30:13.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 80809364 0 0) 0x7fbfdc002fe0 con 0x7fc0040bbcd0 2020-05-18T21:30:13.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc0040b4a50 con 0x7fc0040bbcd0 2020-05-18T21:30:13.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fbfec0019c0 con 0x7fc0040bbcd0 2020-05-18T21:30:13.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc00412efd0 msgr2=0x7fc0040b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc00412efd0 0x7fc0040b7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:13.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 >> v1:172.21.15.155:6789/0 conn(0x7fc0040bb5e0 legacy=0x7fc00412df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 >> v1:172.21.15.63:6789/0 conn(0x7fc0040bbcd0 legacy=0x7fc004156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc00412efd0 0x7fbfdc004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:13.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfdc005050 0x7fbfdc003b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:13.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfdc003f90 0x7fbfdc0043d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:13.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0040b4cf0 con 0x7fbfdc005050 2020-05-18T21:30:13.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc004830 con 0x7fbfdc003f90 2020-05-18T21:30:13.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc0049f0 con 0x7fc00412efd0 2020-05-18T21:30:13.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc001d9b700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfdc005050 0x7fbfdc003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc00259c700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc00412efd0 0x7fbfdc004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc002d9d700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfdc003f90 0x7fbfdc0043d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc001d9b700 1 -- 172.21.15.63:0/1691716662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc00412efd0 msgr2=0x7fbfdc004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc001d9b700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc00412efd0 0x7fbfdc004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:13.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc001d9b700 1 -- 172.21.15.63:0/1691716662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfdc003f90 msgr2=0x7fbfdc0043d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:13.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc001d9b700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfdc003f90 0x7fbfdc0043d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:13.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc001d9b700 1 -- 172.21.15.63:0/1691716662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0040b4f90 con 0x7fbfdc005050 2020-05-18T21:30:13.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc0089d6700 1 -- 172.21.15.63:0/1691716662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00412e630 con 0x7fbfdc005050 2020-05-18T21:30:13.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc001d9b700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfdc005050 0x7fbfdc003b30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbfec001000 tx=0x7fbfec0114b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc0089d6700 1 -- 172.21.15.63:0/1691716662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc004157650 con 0x7fbfdc005050 2020-05-18T21:30:13.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc001d9b700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfdc005050 0x7fbfdc003b30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbfec001000 tx=0x7fbfec0114b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc001d9b700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfdc005050 0x7fbfdc003b30 secure :-1 s=READY pgs=874 cs=0 l=1 rx=0x7fbfec001000 tx=0x7fbfec0114b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:13.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc001d9b700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfdc005050 0x7fbfdc003b30 secure :-1 s=THROTTLE_DONE pgs=874 cs=0 l=1 rx=0x7fbfec001000 tx=0x7fbfec0114b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfec00b080 con 0x7fbfdc005050 2020-05-18T21:30:13.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc001d9b700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfdc005050 0x7fbfdc003b30 secure :-1 s=THROTTLE_DONE pgs=874 cs=0 l=1 rx=0x7fbfec001000 tx=0x7fbfec0114b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc001d9b700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfdc005050 0x7fbfdc003b30 secure :-1 s=THROTTLE_DONE pgs=874 cs=0 l=1 rx=0x7fbfec001000 tx=0x7fbfec0114b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec00b1e0 con 0x7fbfdc005050 2020-05-18T21:30:13.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfec00b540 con 0x7fbfdc005050 2020-05-18T21:30:13.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc0089d6700 1 -- 172.21.15.63:0/1691716662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe0003380 con 0x7fbfdc005050 2020-05-18T21:30:13.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc001d9b700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfdc005050 0x7fbfdc003b30 secure :-1 s=THROTTLE_DONE pgs=874 cs=0 l=1 rx=0x7fbfec001000 tx=0x7fbfec0114b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fbfec00a6d0 con 0x7fbfdc005050 2020-05-18T21:30:13.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.941+0000 7fc001d9b700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfdc005050 0x7fbfdc003b30 secure :-1 s=THROTTLE_DONE pgs=874 cs=0 l=1 rx=0x7fbfec001000 tx=0x7fbfec0114b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.945+0000 7fbffb7fe700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbfdc057e70 0x7fbfdc05a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:13.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.945+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbfec063ea0 con 0x7fbfdc005050 2020-05-18T21:30:13.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.945+0000 7fc00259c700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbfdc057e70 0x7fbfdc05a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:13.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.945+0000 7fc00259c700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbfdc057e70 0x7fbfdc05a330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbff4008880 tx=0x7fbff4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.945+0000 7fc00259c700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbfdc057e70 0x7fbfdc05a330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbff4008880 tx=0x7fbff4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.945+0000 7fc00259c700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbfdc057e70 0x7fbfdc05a330 secure :-1 s=READY pgs=354 cs=0 l=1 rx=0x7fbff4008880 tx=0x7fbff4007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:13.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.949+0000 7fc001d9b700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfdc005050 0x7fbfdc003b30 secure :-1 s=THROTTLE_DONE pgs=874 cs=0 l=1 rx=0x7fbfec001000 tx=0x7fbfec0114b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:13.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:13.949+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fbfec03e290 con 0x7fbfdc005050 2020-05-18T21:30:14.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:14.097+0000 7fc0089d6700 1 -- 172.21.15.63:0/1691716662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbfe0003720 con 0x7fbfdc005050 2020-05-18T21:30:14.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:14.097+0000 7fc001d9b700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfdc005050 0x7fbfdc003b30 secure :-1 s=THROTTLE_DONE pgs=874 cs=0 l=1 rx=0x7fbfec001000 tx=0x7fbfec0114b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:14.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:14.097+0000 7fbffb7fe700 1 -- 172.21.15.63:0/1691716662 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+2137 (secure 0 0 0) 0x7fbfec0418b0 con 0x7fbfdc005050 2020-05-18T21:30:14.104 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:14.104 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":40,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5336,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/129631814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":129631814},{"type":"v1","addr":"172.21.15.63:6833","nonce":129631814}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":37}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:10.069167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5339},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5339":{"gid":5339,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/802454809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":802454809},{"type":"v1","addr":"172.21.15.155:6835","nonce":802454809}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:30:14.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:14.101+0000 7fc0089d6700 1 -- 172.21.15.63:0/1691716662 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbfdc057e70 msgr2=0x7fbfdc05a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:14.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:14.101+0000 7fc0089d6700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbfdc057e70 0x7fbfdc05a330 secure :-1 s=READY pgs=354 cs=0 l=1 rx=0x7fbff4008880 tx=0x7fbff4007e00).stop 2020-05-18T21:30:14.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:14.101+0000 7fc0089d6700 1 -- 172.21.15.63:0/1691716662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfdc005050 msgr2=0x7fbfdc003b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:14.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:14.101+0000 7fc0089d6700 1 --2- 172.21.15.63:0/1691716662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbfdc005050 0x7fbfdc003b30 secure :-1 s=READY pgs=874 cs=0 l=1 rx=0x7fbfec001000 tx=0x7fbfec0114b0).stop 2020-05-18T21:30:14.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:14.101+0000 7fc002d9d700 1 -- 172.21.15.63:0/1691716662 reap_dead start 2020-05-18T21:30:14.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:14.101+0000 7fc0089d6700 1 -- 172.21.15.63:0/1691716662 shutdown_connections 2020-05-18T21:30:14.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:14.101+0000 7fc0089d6700 1 -- 172.21.15.63:0/1691716662 >> 172.21.15.63:0/1691716662 conn(0x7fc004069b70 msgr2=0x7fc0040acf80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:14.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:14.101+0000 7fc0089d6700 1 -- 172.21.15.63:0/1691716662 shutdown_connections 2020-05-18T21:30:14.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:14.101+0000 7fc0089d6700 1 -- 172.21.15.63:0/1691716662 wait complete. 2020-05-18T21:30:14.107 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 40 2020-05-18T21:30:14.322 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:30:08.365002+0000', 'modified': '2020-05-18T21:30:10.069167+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5339}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5339': {'gid': 5339, 'name': 'b', 'rank': 0, 'incarnation': 38, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6835/802454809', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 802454809}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 802454809}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:30:14.323 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:30:14.324 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:30:14.429 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:30:14.429 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:30:14.429 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2020-05-18T21:30:14.430 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 5339, 2020-05-18T21:30:14.430 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:30:14.430 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:30:14.430 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 6.0582780080000003, 2020-05-18T21:30:14.430 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 40, 2020-05-18T21:30:14.431 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 73, 2020-05-18T21:30:14.431 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 73, 2020-05-18T21:30:14.431 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 11.300050138 2020-05-18T21:30:14.431 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:30:14.446 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 5339, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.0582780080000003, "mdsmap_epoch": 40, "osdmap_epoch": 73, "osdmap_epoch_barrier": 73, "uptime": 11.300050138 } 2020-05-18T21:30:14.447 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:30:14.448 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:30:14.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.449 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:30:14.458 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:30:14.458 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:30:14.458 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:30:14.459 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:30:14.459 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:30:14.459 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:30:14.459 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:30:14.459 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:30:14.460 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:30:14.460 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:30:14.460 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:30:14.460 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:30:14.460 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:30:14.460 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:30:14.461 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:30:14.461 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42628sec preferred_lft 42628sec 2020-05-18T21:30:14.461 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:30:14.461 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:30:14.462 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:30:14.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.462 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:30:14.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.519 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:30:14.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.533 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:30:14.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.550 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:30:14.562 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:30:14.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.564 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:30:14.613 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:30:14.613 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:30:14.613 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:30:14.614 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:30:14.614 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:30:14.614 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:30:14.614 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:30:14.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.616 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:30:14.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.631 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:30:14.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.643 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:30:14.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.701 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:30:14.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.710 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:30:14.716 INFO:teuthology.orchestra.run.smithi063.stdout:nsid 0 2020-05-18T21:30:14.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.717 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:30:14.722 INFO:teuthology.orchestra.run.smithi063.stdout:nsid 0 2020-05-18T21:30:14.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.723 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:30:14.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.786 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 1' 2020-05-18T21:30:14.804 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-05-18T21:30:14.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.805 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.1' 2020-05-18T21:30:14.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.823 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:30:14.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.883 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-05-18T21:30:14.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.901 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-05-18T21:30:14.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.919 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-05-18T21:30:14.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:14.981 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.1 up' 2020-05-18T21:30:15.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:15.002 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.1 master ceph-brx' 2020-05-18T21:30:15.020 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-05-18T21:30:15.020 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-05-18T21:30:15.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:15.021 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:30:15.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:15.029 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:30:15.088 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:30:15.088 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:30:15.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:15.090 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:30:15.094 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:30:15.095 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:30:15.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:15.098 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:30:15.116 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:30:15.117 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:30:15.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:15.118 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:30:15.175 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2020-05-18T21:30:15.169+0000 7f3e128e5080 -1 init, newargv = 0x55b62e1f4530 newargc=9ceph-fuse[ 2020-05-18T21:30:15.176 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:24013]: starting ceph client 2020-05-18T21:30:15.185 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[24013]: starting fuse 2020-05-18T21:30:16.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:16.230 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:30:16.248 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:30:16.249 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:30:16.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:16.250 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:30:16.298 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:30:16.299 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:30:16.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:16.300 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:30:16.300 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:30:16.301 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:30:16.301 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:30:16.302 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:30:16.302 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:30:16.302 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:30:16.303 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:30:16.303 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:30:16.304 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:30:16.304 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:30:16.304 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:30:16.305 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:30:16.305 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:30:16.306 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:30:16.306 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:30:16.307 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:30:16.307 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:30:16.307 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:30:16.308 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:30:16.308 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:30:16.309 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:30:16.309 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:30:16.355 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.24013.asok 2020-05-18T21:30:16.360 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.24013.asok 2020-05-18T21:30:16.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:16.361 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.24013.asok status 2020-05-18T21:30:16.451 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:30:16.451 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:30:16.451 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:30:16.451 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:30:16.452 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:30:16.452 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:30:16.452 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:30:16.452 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "24013", 2020-05-18T21:30:16.452 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:30:16.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:16.453 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:30:16.453 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:30:16.453 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 6783, 2020-05-18T21:30:16.453 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:30:16.454 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:30:16.454 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:30:16.454 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 6783 2020-05-18T21:30:16.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:16.454 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:30:16.454 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:30:16.455 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:30:16.455 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2268538809 2020-05-18T21:30:16.455 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:16.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:16.455 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:30:16.456 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:30:16.456 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:30:16.456 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2268538809 2020-05-18T21:30:16.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:16.456 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.6783 192.168.0.1:0/2268538809", 2020-05-18T21:30:16.457 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/2268538809", 2020-05-18T21:30:16.457 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:30:16.457 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 40, 2020-05-18T21:30:16.457 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 73, 2020-05-18T21:30:16.457 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:30:16.457 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:30:16.458 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:30:16.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:16.460 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:30:16.460 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:30:16.466 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:30:16.467 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-05-18T21:30:16.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:16.468 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:30:16.484 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir dir_1) 2020-05-18T21:30:16.513 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo dd if=/dev/urandom of=dir_1/file_a bs=1M conv=fdatasync count=8 seek=0) 2020-05-18T21:30:16.704 INFO:teuthology.orchestra.run.smithi063.stderr:8+0 records in 2020-05-18T21:30:16.705 INFO:teuthology.orchestra.run.smithi063.stderr:8+0 records out 2020-05-18T21:30:16.705 INFO:teuthology.orchestra.run.smithi063.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.12603 s, 66.6 MB/s 2020-05-18T21:30:16.707 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:30:16.708 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:30:16.708 INFO:teuthology.orchestra.run.smithi063:> import stat 2020-05-18T21:30:16.709 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:30:16.709 INFO:teuthology.orchestra.run.smithi063:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_1/file_a").st_ino) 2020-05-18T21:30:16.710 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:30:16.790 INFO:teuthology.orchestra.run.smithi063.stdout:1099511627777 2020-05-18T21:30:16.980 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir dir_2) 2020-05-18T21:30:17.003 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo ln dir_1/file_a dir_2/file_b) 2020-05-18T21:30:17.077 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:30:17.077 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:30:17.078 INFO:teuthology.orchestra.run.smithi063:> import stat 2020-05-18T21:30:17.078 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:30:17.079 INFO:teuthology.orchestra.run.smithi063:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_2/file_b").st_ino) 2020-05-18T21:30:17.079 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:30:17.158 INFO:teuthology.orchestra.run.smithi063.stdout:1099511627777 2020-05-18T21:30:17.350 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:30:17.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.449+0000 7f506759e700 1 Processor -- start 2020-05-18T21:30:17.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.449+0000 7f506759e700 1 -- start start 2020-05-18T21:30:17.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5068145250 0x7f506809c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:17.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5068061b00 con 0x7f506809cb50 2020-05-18T21:30:17.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506809d320 con 0x7f50680623c0 2020-05-18T21:30:17.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50680634b0 con 0x7f5068145250 2020-05-18T21:30:17.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f5065d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f506809cb50 0x7f50680b5510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59476/0 (socket says 172.21.15.63:59476) 2020-05-18T21:30:17.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f5065d9b700 1 -- 172.21.15.63:0/2267094781 learned_addr learned my addr 172.21.15.63:0/2267094781 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:17.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506659c700 1 --2- 172.21.15.63:0/2267094781 >> v2:172.21.15.155:3300/0 conn(0x7f5068145250 0x7f506809c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:17.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 -- 172.21.15.63:0/2267094781 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538313952 0 0) 0x7f5068061b00 con 0x7f506809cb50 2020-05-18T21:30:17.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 -- 172.21.15.63:0/2267094781 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5048003270 con 0x7f506809cb50 2020-05-18T21:30:17.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 -- 172.21.15.63:0/2267094781 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834059824 0 0) 0x7f506809d320 con 0x7f50680623c0 2020-05-18T21:30:17.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 -- 172.21.15.63:0/2267094781 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5068061b00 con 0x7f50680623c0 2020-05-18T21:30:17.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 -- 172.21.15.63:0/2267094781 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2113200308 0 0) 0x7f5048003270 con 0x7f506809cb50 2020-05-18T21:30:17.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 -- 172.21.15.63:0/2267094781 >> v2:172.21.15.155:3300/0 conn(0x7f5068145250 msgr2=0x7f506809c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:17.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 --2- 172.21.15.63:0/2267094781 >> v2:172.21.15.155:3300/0 conn(0x7f5068145250 0x7f506809c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:17.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 -- 172.21.15.63:0/2267094781 >> v1:172.21.15.155:6789/0 conn(0x7f50680623c0 legacy=0x7f5068062870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:17.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 -- 172.21.15.63:0/2267094781 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5068145630 con 0x7f506809cb50 2020-05-18T21:30:17.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 -- 172.21.15.63:0/2267094781 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f5050001710 con 0x7f506809cb50 2020-05-18T21:30:17.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 -- 172.21.15.63:0/2267094781 >> v1:172.21.15.63:6789/0 conn(0x7f506809cb50 legacy=0x7f50680b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:17.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 --2- 172.21.15.63:0/2267094781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50480038f0 0x7f5048003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:17.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 --2- 172.21.15.63:0/2267094781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5048004510 0x7f5048004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:17.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 --2- 172.21.15.63:0/2267094781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5048004df0 0x7f504800b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:17.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 -- 172.21.15.63:0/2267094781 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50480053b0 con 0x7f50480038f0 2020-05-18T21:30:17.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506659c700 1 --2- 172.21.15.63:0/2267094781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50480038f0 0x7f5048003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:17.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 -- 172.21.15.63:0/2267094781 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504800bbc0 con 0x7f5048004df0 2020-05-18T21:30:17.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 -- 172.21.15.63:0/2267094781 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504800bd80 con 0x7f5048004510 2020-05-18T21:30:17.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f5065d9b700 1 --2- 172.21.15.63:0/2267094781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5048004510 0x7f5048004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:17.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f5066d9d700 1 --2- 172.21.15.63:0/2267094781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5048004df0 0x7f504800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:17.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506659c700 1 -- 172.21.15.63:0/2267094781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5048004510 msgr2=0x7f5048004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:17.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506659c700 1 --2- 172.21.15.63:0/2267094781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5048004510 0x7f5048004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:17.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506659c700 1 -- 172.21.15.63:0/2267094781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5048004df0 msgr2=0x7f504800b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:17.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506659c700 1 --2- 172.21.15.63:0/2267094781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5048004df0 0x7f504800b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:17.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506659c700 1 -- 172.21.15.63:0/2267094781 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5048003270 con 0x7f50480038f0 2020-05-18T21:30:17.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f5066d9d700 1 -- 172.21.15.63:0/2267094781 reap_dead start 2020-05-18T21:30:17.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506659c700 1 --2- 172.21.15.63:0/2267094781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50480038f0 0x7f5048003cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5058002f70 tx=0x7f5058011170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506659c700 1 --2- 172.21.15.63:0/2267094781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50480038f0 0x7f5048003cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5058002f70 tx=0x7f5058011170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506659c700 1 --2- 172.21.15.63:0/2267094781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50480038f0 0x7f5048003cf0 secure :-1 s=READY pgs=878 cs=0 l=1 rx=0x7f5058002f70 tx=0x7f5058011170).ready entity=mon.0 client_cookie=da65cc3eb8f4b7b9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:17.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506659c700 1 --2- 172.21.15.63:0/2267094781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50480038f0 0x7f5048003cf0 secure :-1 s=THROTTLE_DONE pgs=878 cs=0 l=1 rx=0x7f5058002f70 tx=0x7f5058011170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 -- 172.21.15.63:0/2267094781 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5058008990 con 0x7f50480038f0 2020-05-18T21:30:17.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506659c700 1 --2- 172.21.15.63:0/2267094781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50480038f0 0x7f5048003cf0 secure :-1 s=THROTTLE_DONE pgs=878 cs=0 l=1 rx=0x7f5058002f70 tx=0x7f5058011170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506659c700 1 --2- 172.21.15.63:0/2267094781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50480038f0 0x7f5048003cf0 secure :-1 s=THROTTLE_DONE pgs=878 cs=0 l=1 rx=0x7f5058002f70 tx=0x7f5058011170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 -- 172.21.15.63:0/2267094781 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5058008af0 con 0x7f50480038f0 2020-05-18T21:30:17.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506559a700 1 -- 172.21.15.63:0/2267094781 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5058008e50 con 0x7f50480038f0 2020-05-18T21:30:17.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506759e700 1 -- 172.21.15.63:0/2267094781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50480038f0 msgr2=0x7f5048003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:17.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.453+0000 7f506759e700 1 --2- 172.21.15.63:0/2267094781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50480038f0 0x7f5048003cf0 secure :-1 s=READY pgs=878 cs=0 l=1 rx=0x7f5058002f70 tx=0x7f5058011170).stop 2020-05-18T21:30:17.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.457+0000 7f506759e700 1 -- 172.21.15.63:0/2267094781 shutdown_connections 2020-05-18T21:30:17.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.457+0000 7f506759e700 1 --2- 172.21.15.63:0/2267094781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50480038f0 0x7f5048003cf0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:17.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.457+0000 7f506759e700 1 -- 172.21.15.63:0/2267094781 >> 172.21.15.63:0/2267094781 conn(0x7f506805a7c0 msgr2=0x7f506805aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:17.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.457+0000 7f506759e700 1 -- 172.21.15.63:0/2267094781 shutdown_connections 2020-05-18T21:30:17.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.457+0000 7f506759e700 1 -- 172.21.15.63:0/2267094781 wait complete. 2020-05-18T21:30:17.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.457+0000 7f506759e700 1 Processor -- start 2020-05-18T21:30:17.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.457+0000 7f506759e700 1 -- start start 2020-05-18T21:30:17.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.457+0000 7f506759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f50480038f0 0x7f506808f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:17.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.457+0000 7f506759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5068143e20 0x7f5068144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:17.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.457+0000 7f506759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5068091070 con 0x7f5068090bf0 2020-05-18T21:30:17.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.457+0000 7f506759e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5068156dd0 con 0x7f5068143e20 2020-05-18T21:30:17.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.457+0000 7f506759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506808fb10 con 0x7f50480038f0 2020-05-18T21:30:17.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f5065d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5068090bf0 0x7f50681566c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59490/0 (socket says 172.21.15.63:59490) 2020-05-18T21:30:17.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f5065d9b700 1 -- 172.21.15.63:0/284594746 learned_addr learned my addr 172.21.15.63:0/284594746 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:17.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f5066d9d700 1 --2- 172.21.15.63:0/284594746 >> v2:172.21.15.63:3300/0 conn(0x7f5068143e20 0x7f5068144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:17.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f506659c700 1 --2- 172.21.15.63:0/284594746 >> v2:172.21.15.155:3300/0 conn(0x7f50480038f0 0x7f506808f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:17.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f5066d9d700 1 -- 172.21.15.63:0/284594746 >> v2:172.21.15.155:3300/0 conn(0x7f50480038f0 msgr2=0x7f506808f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:17.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f5066d9d700 1 --2- 172.21.15.63:0/284594746 >> v2:172.21.15.155:3300/0 conn(0x7f50480038f0 0x7f506808f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:17.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f5066d9d700 1 -- 172.21.15.63:0/284594746 >> v1:172.21.15.63:6789/0 conn(0x7f5068090bf0 legacy=0x7f50681566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:17.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f505f7fe700 1 -- 172.21.15.63:0/284594746 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243325927 0 0) 0x7f5068145630 con 0x7f5068090bf0 2020-05-18T21:30:17.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f5066d9d700 1 -- 172.21.15.63:0/284594746 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5068156fd0 con 0x7f5068143e20 2020-05-18T21:30:17.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f5066d9d700 1 --2- 172.21.15.63:0/284594746 >> v2:172.21.15.63:3300/0 conn(0x7f5068143e20 0x7f5068144290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f506809eb70 tx=0x7f50600109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f5066d9d700 1 --2- 172.21.15.63:0/284594746 >> v2:172.21.15.63:3300/0 conn(0x7f5068143e20 0x7f5068144290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f506809eb70 tx=0x7f50600109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f5066d9d700 1 --2- 172.21.15.63:0/284594746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5068143e20 0x7f5068144290 secure :-1 s=READY pgs=880 cs=0 l=1 rx=0x7f506809eb70 tx=0x7f50600109c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:17.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f5066d9d700 1 --2- 172.21.15.63:0/284594746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5068143e20 0x7f5068144290 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f506809eb70 tx=0x7f50600109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f5066d9d700 1 --2- 172.21.15.63:0/284594746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5068143e20 0x7f5068144290 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f506809eb70 tx=0x7f50600109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f505f7fe700 1 -- 172.21.15.63:0/284594746 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5060006e80 con 0x7f5068143e20 2020-05-18T21:30:17.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f5066d9d700 1 --2- 172.21.15.63:0/284594746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5068143e20 0x7f5068144290 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f506809eb70 tx=0x7f50600109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f505f7fe700 1 -- 172.21.15.63:0/284594746 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5060001bb0 con 0x7f5068143e20 2020-05-18T21:30:17.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f506759e700 1 -- 172.21.15.63:0/284594746 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5068157270 con 0x7f5068143e20 2020-05-18T21:30:17.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f505f7fe700 1 -- 172.21.15.63:0/284594746 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5060010f30 con 0x7f5068143e20 2020-05-18T21:30:17.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f506759e700 1 -- 172.21.15.63:0/284594746 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5068091d70 con 0x7f5068143e20 2020-05-18T21:30:17.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f5066d9d700 1 --2- 172.21.15.63:0/284594746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5068143e20 0x7f5068144290 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f506809eb70 tx=0x7f50600109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f506759e700 1 -- 172.21.15.63:0/284594746 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50680569e0 con 0x7f5068143e20 2020-05-18T21:30:17.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f505f7fe700 1 -- 172.21.15.63:0/284594746 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f506000b2c0 con 0x7f5068143e20 2020-05-18T21:30:17.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.461+0000 7f5066d9d700 1 --2- 172.21.15.63:0/284594746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5068143e20 0x7f5068144290 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f506809eb70 tx=0x7f50600109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.465+0000 7f505f7fe700 1 --2- 172.21.15.63:0/284594746 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f504c04f910 0x7f504c051dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:17.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.465+0000 7f505f7fe700 1 -- 172.21.15.63:0/284594746 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5060063890 con 0x7f5068143e20 2020-05-18T21:30:17.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.465+0000 7f506659c700 1 --2- 172.21.15.63:0/284594746 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f504c04f910 0x7f504c051dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:17.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.465+0000 7f506659c700 1 --2- 172.21.15.63:0/284594746 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f504c04f910 0x7f504c051dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5058002f70 tx=0x7f5058011170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.465+0000 7f506659c700 1 --2- 172.21.15.63:0/284594746 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f504c04f910 0x7f504c051dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5058002f70 tx=0x7f5058011170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.465+0000 7f506659c700 1 --2- 172.21.15.63:0/284594746 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f504c04f910 0x7f504c051dd0 secure :-1 s=READY pgs=355 cs=0 l=1 rx=0x7f5058002f70 tx=0x7f5058011170).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:17.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.469+0000 7f5066d9d700 1 --2- 172.21.15.63:0/284594746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5068143e20 0x7f5068144290 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f506809eb70 tx=0x7f50600109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.469+0000 7f505f7fe700 1 -- 172.21.15.63:0/284594746 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f506003dc20 con 0x7f5068143e20 2020-05-18T21:30:17.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.621+0000 7f506759e700 1 -- 172.21.15.63:0/284594746 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50680008d0 con 0x7f5068143e20 2020-05-18T21:30:17.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.621+0000 7f5066d9d700 1 --2- 172.21.15.63:0/284594746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5068143e20 0x7f5068144290 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f506809eb70 tx=0x7f50600109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.621+0000 7f505f7fe700 1 -- 172.21.15.63:0/284594746 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f5060041240 con 0x7f5068143e20 2020-05-18T21:30:17.627 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:17.627 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":40,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5336,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/129631814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":129631814},{"type":"v1","addr":"172.21.15.63:6833","nonce":129631814}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":37}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:10.069167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5339},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5339":{"gid":5339,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/802454809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":802454809},{"type":"v1","addr":"172.21.15.155:6835","nonce":802454809}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:30:17.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.621+0000 7f506759e700 1 -- 172.21.15.63:0/284594746 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f504c04f910 msgr2=0x7f504c051dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:17.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.621+0000 7f506759e700 1 --2- 172.21.15.63:0/284594746 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f504c04f910 0x7f504c051dd0 secure :-1 s=READY pgs=355 cs=0 l=1 rx=0x7f5058002f70 tx=0x7f5058011170).stop 2020-05-18T21:30:17.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.621+0000 7f506759e700 1 -- 172.21.15.63:0/284594746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5068143e20 msgr2=0x7f5068144290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:17.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.621+0000 7f506759e700 1 --2- 172.21.15.63:0/284594746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5068143e20 0x7f5068144290 secure :-1 s=READY pgs=880 cs=0 l=1 rx=0x7f506809eb70 tx=0x7f50600109c0).stop 2020-05-18T21:30:17.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.621+0000 7f506759e700 1 -- 172.21.15.63:0/284594746 shutdown_connections 2020-05-18T21:30:17.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.621+0000 7f506759e700 1 --2- 172.21.15.63:0/284594746 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f504c04f910 0x7f504c051dd0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:17.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.621+0000 7f506759e700 1 --2- 172.21.15.63:0/284594746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5068143e20 0x7f5068144290 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:17.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.621+0000 7f506759e700 1 --2- 172.21.15.63:0/284594746 >> v2:172.21.15.155:3300/0 conn(0x7f50480038f0 0x7f506808f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:17.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.621+0000 7f506759e700 1 -- 172.21.15.63:0/284594746 >> 172.21.15.63:0/284594746 conn(0x7f506805a7c0 msgr2=0x7f5068066b40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:17.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.625+0000 7f506759e700 1 -- 172.21.15.63:0/284594746 shutdown_connections 2020-05-18T21:30:17.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.625+0000 7f506759e700 1 -- 172.21.15.63:0/284594746 wait complete. 2020-05-18T21:30:17.631 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 40 2020-05-18T21:30:17.640 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok flush journal 2020-05-18T21:30:17.763 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:30:17.763 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "", 2020-05-18T21:30:17.763 INFO:teuthology.orchestra.run.smithi155.stdout: "return_code": 0 2020-05-18T21:30:17.763 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:30:17.772 INFO:tasks.cephfs.filesystem:_json_asok output: { "message": "", "return_code": 0 } 2020-05-18T21:30:17.773 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_data getxattr 10000000001.00000000 parent 2020-05-18T21:30:17.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.801+0000 7fca83cacb80 1 Processor -- start 2020-05-18T21:30:17.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.801+0000 7fca83cacb80 1 -- start start 2020-05-18T21:30:17.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca83cacb80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55aa95461390 0x55aa954626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:17.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca83cacb80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x55aa95480570 0x55aa9550fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:17.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca83cacb80 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55aa953e04b0 con 0x55aa95506e70 2020-05-18T21:30:17.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca83cacb80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x55aa953cc110 con 0x55aa95461390 2020-05-18T21:30:17.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca83cacb80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x55aa953bca40 con 0x55aa95480570 2020-05-18T21:30:17.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca820ef700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55aa95461390 0x55aa954626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:17.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca820ef700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55aa95461390 0x55aa954626c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57314/0 (socket says 172.21.15.63:57314) 2020-05-18T21:30:17.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca820ef700 1 -- 172.21.15.63:0/97365966 learned_addr learned my addr 172.21.15.63:0/97365966 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:17.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca818ee700 1 --2- 172.21.15.63:0/97365966 >> v2:172.21.15.155:3300/0 conn(0x55aa95480570 0x55aa9550fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:17.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca7bfff700 1 -- 172.21.15.63:0/97365966 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296894363 0 0) 0x55aa953e04b0 con 0x55aa95506e70 2020-05-18T21:30:17.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca820ef700 1 -- 172.21.15.63:0/97365966 >> v2:172.21.15.155:3300/0 conn(0x55aa95480570 msgr2=0x55aa9550fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:17.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca820ef700 1 --2- 172.21.15.63:0/97365966 >> v2:172.21.15.155:3300/0 conn(0x55aa95480570 0x55aa9550fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:17.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca820ef700 1 -- 172.21.15.63:0/97365966 >> v1:172.21.15.155:6789/0 conn(0x55aa95506e70 legacy=0x55aa95517b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:17.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca820ef700 1 -- 172.21.15.63:0/97365966 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa953c0460 con 0x55aa95461390 2020-05-18T21:30:17.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca820ef700 1 --2- 172.21.15.63:0/97365966 >> v2:172.21.15.63:3300/0 conn(0x55aa95461390 0x55aa954626c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fca740030b0 tx=0x7fca7400a8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca820ef700 1 --2- 172.21.15.63:0/97365966 >> v2:172.21.15.63:3300/0 conn(0x55aa95461390 0x55aa954626c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fca740030b0 tx=0x7fca7400a8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca820ef700 1 --2- 172.21.15.63:0/97365966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa95461390 0x55aa954626c0 secure :-1 s=READY pgs=883 cs=0 l=1 rx=0x7fca740030b0 tx=0x7fca7400a8f0).ready entity=mon.0 client_cookie=2a8ecad0df10425e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:17.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca820ef700 1 --2- 172.21.15.63:0/97365966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa95461390 0x55aa954626c0 secure :-1 s=THROTTLE_DONE pgs=883 cs=0 l=1 rx=0x7fca740030b0 tx=0x7fca7400a8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca7bfff700 1 -- 172.21.15.63:0/97365966 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca74004a70 con 0x55aa95461390 2020-05-18T21:30:17.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca820ef700 1 --2- 172.21.15.63:0/97365966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa95461390 0x55aa954626c0 secure :-1 s=THROTTLE_DONE pgs=883 cs=0 l=1 rx=0x7fca740030b0 tx=0x7fca7400a8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca820ef700 1 --2- 172.21.15.63:0/97365966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa95461390 0x55aa954626c0 secure :-1 s=THROTTLE_DONE pgs=883 cs=0 l=1 rx=0x7fca740030b0 tx=0x7fca7400a8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca7bfff700 1 -- 172.21.15.63:0/97365966 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca74004bd0 con 0x55aa95461390 2020-05-18T21:30:17.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca7bfff700 1 -- 172.21.15.63:0/97365966 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca7400c170 con 0x55aa95461390 2020-05-18T21:30:17.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca83cacb80 1 -- 172.21.15.63:0/97365966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa95461390 msgr2=0x55aa954626c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:17.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.805+0000 7fca83cacb80 1 --2- 172.21.15.63:0/97365966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa95461390 0x55aa954626c0 secure :-1 s=READY pgs=883 cs=0 l=1 rx=0x7fca740030b0 tx=0x7fca7400a8f0).stop 2020-05-18T21:30:17.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.809+0000 7fca83cacb80 1 -- 172.21.15.63:0/97365966 shutdown_connections 2020-05-18T21:30:17.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.809+0000 7fca83cacb80 1 --2- 172.21.15.63:0/97365966 >> v2:172.21.15.155:3300/0 conn(0x55aa95480570 0x55aa9550fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:17.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.809+0000 7fca83cacb80 1 --2- 172.21.15.63:0/97365966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa95461390 0x55aa954626c0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:17.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.809+0000 7fca83cacb80 1 -- 172.21.15.63:0/97365966 >> 172.21.15.63:0/97365966 conn(0x55aa95481640 msgr2=0x55aa9543f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:17.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.809+0000 7fca83cacb80 1 -- 172.21.15.63:0/97365966 shutdown_connections 2020-05-18T21:30:17.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.809+0000 7fca83cacb80 1 -- 172.21.15.63:0/97365966 wait complete. 2020-05-18T21:30:17.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.809+0000 7fca83cacb80 1 Processor -- start 2020-05-18T21:30:17.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.809+0000 7fca83cacb80 1 -- start start 2020-05-18T21:30:17.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.809+0000 7fca83cacb80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aa95480570 0x55aa9547e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:17.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.809+0000 7fca83cacb80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55aa95506e70 0x55aa95465920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:17.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.809+0000 7fca83cacb80 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55aa9547eb70 con 0x55aa95461390 2020-05-18T21:30:17.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.809+0000 7fca83cacb80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x55aa95506190 con 0x55aa95506e70 2020-05-18T21:30:17.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.809+0000 7fca83cacb80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa95505e20 con 0x55aa95480570 2020-05-18T21:30:17.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca828f0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55aa95506e70 0x55aa95465920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:17.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca828f0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55aa95506e70 0x55aa95465920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57324/0 (socket says 172.21.15.63:57324) 2020-05-18T21:30:17.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca820ef700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x55aa95461390 0x55aa95509c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:57824/0 (socket says 172.21.15.63:57824) 2020-05-18T21:30:17.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca818ee700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aa95480570 0x55aa9547e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:17.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca828f0700 1 -- 172.21.15.63:0/2909100176 learned_addr learned my addr 172.21.15.63:0/2909100176 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:17.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca828f0700 1 -- 172.21.15.63:0/2909100176 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aa95480570 msgr2=0x55aa9547e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:17.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca7b7fe700 1 -- 172.21.15.63:0/2909100176 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443969909 0 0) 0x55aa9547eb70 con 0x55aa95461390 2020-05-18T21:30:17.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca828f0700 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aa95480570 0x55aa9547e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:17.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca828f0700 1 -- 172.21.15.63:0/2909100176 >> v1:172.21.15.155:6789/0 conn(0x55aa95461390 legacy=0x55aa95509c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:17.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca828f0700 1 -- 172.21.15.63:0/2909100176 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa95505f60 con 0x55aa95506e70 2020-05-18T21:30:17.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca818ee700 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aa95480570 0x55aa9547e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:30:17.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca828f0700 1 --2- 172.21.15.63:0/2909100176 >> v2:172.21.15.63:3300/0 conn(0x55aa95506e70 0x55aa95465920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca7c006e30 tx=0x7fca7c0069a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca828f0700 1 --2- 172.21.15.63:0/2909100176 >> v2:172.21.15.63:3300/0 conn(0x55aa95506e70 0x55aa95465920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca7c006e30 tx=0x7fca7c0069a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca828f0700 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa95506e70 0x55aa95465920 secure :-1 s=READY pgs=884 cs=0 l=1 rx=0x7fca7c006e30 tx=0x7fca7c0069a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:17.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca828f0700 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa95506e70 0x55aa95465920 secure :-1 s=THROTTLE_DONE pgs=884 cs=0 l=1 rx=0x7fca7c006e30 tx=0x7fca7c0069a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca828f0700 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa95506e70 0x55aa95465920 secure :-1 s=THROTTLE_DONE pgs=884 cs=0 l=1 rx=0x7fca7c006e30 tx=0x7fca7c0069a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca828f0700 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa95506e70 0x55aa95465920 secure :-1 s=THROTTLE_DONE pgs=884 cs=0 l=1 rx=0x7fca7c006e30 tx=0x7fca7c0069a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca7b7fe700 1 -- 172.21.15.63:0/2909100176 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca7c010d50 con 0x55aa95506e70 2020-05-18T21:30:17.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca7b7fe700 1 -- 172.21.15.63:0/2909100176 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c006170 con 0x55aa95506e70 2020-05-18T21:30:17.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca83cacb80 1 -- 172.21.15.63:0/2909100176 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55aa95462340 con 0x55aa95506e70 2020-05-18T21:30:17.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca7b7fe700 1 -- 172.21.15.63:0/2909100176 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca7c006550 con 0x55aa95506e70 2020-05-18T21:30:17.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca83cacb80 1 -- 172.21.15.63:0/2909100176 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aa9547e910 con 0x55aa95506e70 2020-05-18T21:30:17.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca828f0700 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa95506e70 0x55aa95465920 secure :-1 s=THROTTLE_DONE pgs=884 cs=0 l=1 rx=0x7fca7c006e30 tx=0x7fca7c0069a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca7b7fe700 1 -- 172.21.15.63:0/2909100176 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fca7c004620 con 0x55aa95506e70 2020-05-18T21:30:17.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca828f0700 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa95506e70 0x55aa95465920 secure :-1 s=THROTTLE_DONE pgs=884 cs=0 l=1 rx=0x7fca7c006e30 tx=0x7fca7c0069a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca7b7fe700 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca6404e460 0x7fca64050920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:17.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.813+0000 7fca7b7fe700 1 -- 172.21.15.63:0/2909100176 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fca7c0635d0 con 0x55aa95506e70 2020-05-18T21:30:17.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca820ef700 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca6404e460 0x7fca64050920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:17.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca83cacb80 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x55aa95466290 0x55aa95527dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:17.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca83cacb80 1 -- 172.21.15.63:0/2909100176 --> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] -- osd_op(unknown.0.0:1 14.7 14:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected e73) v8 -- 0x55aa95528220 con 0x55aa95466290 2020-05-18T21:30:17.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca820ef700 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca6404e460 0x7fca64050920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca74009fb0 tx=0x7fca7400a8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca818ee700 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x55aa95466290 0x55aa95527dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:17.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca820ef700 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca6404e460 0x7fca64050920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca74009fb0 tx=0x7fca7400a8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:17.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca820ef700 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca6404e460 0x7fca64050920 secure :-1 s=READY pgs=356 cs=0 l=1 rx=0x7fca74009fb0 tx=0x7fca7400a8f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:17.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca818ee700 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x55aa95466290 0x55aa95527dc0 crc :-1 s=READY pgs=19 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:17.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca818ee700 1 -- 172.21.15.63:0/2909100176 <== osd.5 v2:172.21.15.155:6808/13024 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (93) out=93b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+93 (crc 0 0 0) 0x7fca6c00a8c0 con 0x55aa95466290 2020-05-18T21:30:17.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca83cacb80 1 -- 172.21.15.63:0/2909100176 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x55aa95466290 msgr2=0x55aa95527dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:17.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca83cacb80 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x55aa95466290 0x55aa95527dc0 crc :-1 s=READY pgs=19 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:17.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca83cacb80 1 -- 172.21.15.63:0/2909100176 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca6404e460 msgr2=0x7fca64050920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:17.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca83cacb80 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca6404e460 0x7fca64050920 secure :-1 s=READY pgs=356 cs=0 l=1 rx=0x7fca74009fb0 tx=0x7fca7400a8f0).stop 2020-05-18T21:30:17.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca83cacb80 1 -- 172.21.15.63:0/2909100176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa95506e70 msgr2=0x55aa95465920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:17.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca83cacb80 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa95506e70 0x55aa95465920 secure :-1 s=READY pgs=884 cs=0 l=1 rx=0x7fca7c006e30 tx=0x7fca7c0069a0).stop 2020-05-18T21:30:17.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca828f0700 1 -- 172.21.15.63:0/2909100176 reap_dead start 2020-05-18T21:30:17.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca83cacb80 1 -- 172.21.15.63:0/2909100176 shutdown_connections 2020-05-18T21:30:17.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca83cacb80 1 --2- 172.21.15.63:0/2909100176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa95506e70 0x55aa95465920 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:17.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca83cacb80 1 -- 172.21.15.63:0/2909100176 >> 172.21.15.63:0/2909100176 conn(0x55aa95481640 msgr2=0x55aa95461770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:17.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca83cacb80 1 -- 172.21.15.63:0/2909100176 shutdown_connections 2020-05-18T21:30:17.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:17.817+0000 7fca83cacb80 1 -- 172.21.15.63:0/2909100176 wait complete. 2020-05-18T21:30:17.834 INFO:teuthology.orchestra.run.smithi063.stdout:Wfile_a 2020-05-18T21:30:17.834 INFO:teuthology.orchestra.run.smithi063.stdout:dir_1 2020-05-18T21:30:17.835 INFO:teuthology.orchestra.run.smithi063:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2020-05-18T21:30:17.880 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:30:17.881 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1099511627777, 2020-05-18T21:30:17.881 INFO:teuthology.orchestra.run.smithi063.stdout: "ancestors": [ 2020-05-18T21:30:17.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:17.881 INFO:teuthology.orchestra.run.smithi063.stdout: "dirino": 1099511627776, 2020-05-18T21:30:17.882 INFO:teuthology.orchestra.run.smithi063.stdout: "dname": "file_a", 2020-05-18T21:30:17.882 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 10 2020-05-18T21:30:17.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:17.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:30:17.882 INFO:teuthology.orchestra.run.smithi063.stdout: "dirino": 1, 2020-05-18T21:30:17.883 INFO:teuthology.orchestra.run.smithi063.stdout: "dname": "dir_1", 2020-05-18T21:30:17.883 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 17 2020-05-18T21:30:17.883 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:17.883 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:30:17.883 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 14, 2020-05-18T21:30:17.883 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [] 2020-05-18T21:30:17.884 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:30:17.884 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:17.888 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:30:17.888 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:30:17.889 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:30:17.905 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[24013]: fuse finished with error 0 and tester_r 0 2020-05-18T21:30:17.908 INFO:teuthology.orchestra.run:waiting for 900 2020-05-18T21:30:17.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:17.974 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:30:17.980 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:30:17.980 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:30:17.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:17.981 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.1 down' 2020-05-18T21:30:18.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:18.047 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.1' 2020-05-18T21:30:18.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:18.131 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:30:18.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:18.150 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:30:18.198 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:30:18.199 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:30:18.199 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:30:18.199 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:30:18.200 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:30:18.200 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:30:18.200 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:30:18.200 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:30:18.201 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:30:18.201 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:30:18.201 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:30:18.201 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:30:18.201 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:30:18.202 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:30:18.202 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:30:18.202 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42624sec preferred_lft 42624sec 2020-05-18T21:30:18.202 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:30:18.202 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:30:18.202 INFO:teuthology.orchestra.run.smithi063.stdout:19: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-05-18T21:30:18.203 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:30:18.203 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:30:18.203 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:30:18.203 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::f4ee:bfff:fe91:f0a2/64 scope link 2020-05-18T21:30:18.203 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:30:18.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:18.204 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:30:18.221 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:30:18.222 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:30:18.222 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:30:18.222 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:30:18.222 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:30:18.223 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:30:18.223 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:30:18.223 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:30:18.223 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:30:18.223 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:30:18.223 INFO:teuthology.orchestra.run.smithi063.stdout:19: ceph-brx: mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:30:18.224 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:30:18.225 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:30:18.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:18.225 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:30:18.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:18.247 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:30:18.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:18.419 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:30:18.428 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:30:18.428 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:30:18.429 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:30:18.429 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:30:18.429 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:30:18.429 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:30:18.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:18.431 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:30:18.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:18.449 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:30:18.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:18.469 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:30:18.530 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:30:18.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f7217700 1 Processor -- start 2020-05-18T21:30:18.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f7217700 1 -- start start 2020-05-18T21:30:18.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f7217700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa7f0060b90 0x7fa7f00615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:18.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f7217700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f014d960 con 0x7fa7f00b2860 2020-05-18T21:30:18.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f7217700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f014db90 con 0x7fa7f014e570 2020-05-18T21:30:18.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f7217700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f0066210 con 0x7fa7f0060b90 2020-05-18T21:30:18.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f4fb3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa7f0060b90 0x7fa7f00615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:18.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7e7fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa7f00b2860 0x7fa7f0144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59518/0 (socket says 172.21.15.63:59518) 2020-05-18T21:30:18.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7e7fff700 1 -- 172.21.15.63:0/3759497072 learned_addr learned my addr 172.21.15.63:0/3759497072 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:18.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f4fb3700 1 -- 172.21.15.63:0/3759497072 >> v1:172.21.15.155:6789/0 conn(0x7fa7f014e570 legacy=0x7fa7f014a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:18.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f4fb3700 1 -- 172.21.15.63:0/3759497072 >> v1:172.21.15.63:6789/0 conn(0x7fa7f00b2860 legacy=0x7fa7f0144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:18.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f4fb3700 1 -- 172.21.15.63:0/3759497072 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f014de30 con 0x7fa7f0060b90 2020-05-18T21:30:18.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7e77fe700 1 -- 172.21.15.63:0/3759497072 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704842987 0 0) 0x7fa7f014d960 con 0x7fa7f00b2860 2020-05-18T21:30:18.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f4fb3700 1 --2- 172.21.15.63:0/3759497072 >> v2:172.21.15.63:3300/0 conn(0x7fa7f0060b90 0x7fa7f00615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa7f0062dc0 tx=0x7fa7ec008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:18.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f4fb3700 1 --2- 172.21.15.63:0/3759497072 >> v2:172.21.15.63:3300/0 conn(0x7fa7f0060b90 0x7fa7f00615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa7f0062dc0 tx=0x7fa7ec008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:18.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f4fb3700 1 --2- 172.21.15.63:0/3759497072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7f0060b90 0x7fa7f00615e0 secure :-1 s=READY pgs=886 cs=0 l=1 rx=0x7fa7f0062dc0 tx=0x7fa7ec008920).ready entity=mon.0 client_cookie=f8a4a76c2148bc0c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:18.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f4fb3700 1 --2- 172.21.15.63:0/3759497072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7f0060b90 0x7fa7f00615e0 secure :-1 s=THROTTLE_DONE pgs=886 cs=0 l=1 rx=0x7fa7f0062dc0 tx=0x7fa7ec008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:18.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7e77fe700 1 -- 172.21.15.63:0/3759497072 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7ec008e80 con 0x7fa7f0060b90 2020-05-18T21:30:18.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f4fb3700 1 --2- 172.21.15.63:0/3759497072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7f0060b90 0x7fa7f00615e0 secure :-1 s=THROTTLE_DONE pgs=886 cs=0 l=1 rx=0x7fa7f0062dc0 tx=0x7fa7ec008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:18.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f4fb3700 1 --2- 172.21.15.63:0/3759497072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7f0060b90 0x7fa7f00615e0 secure :-1 s=THROTTLE_DONE pgs=886 cs=0 l=1 rx=0x7fa7f0062dc0 tx=0x7fa7ec008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:18.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7e77fe700 1 -- 172.21.15.63:0/3759497072 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec011660 con 0x7fa7f0060b90 2020-05-18T21:30:18.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7e77fe700 1 -- 172.21.15.63:0/3759497072 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7ec011a00 con 0x7fa7f0060b90 2020-05-18T21:30:18.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f7217700 1 -- 172.21.15.63:0/3759497072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7f0060b90 msgr2=0x7fa7f00615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:18.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f7217700 1 --2- 172.21.15.63:0/3759497072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7f0060b90 0x7fa7f00615e0 secure :-1 s=READY pgs=886 cs=0 l=1 rx=0x7fa7f0062dc0 tx=0x7fa7ec008920).stop 2020-05-18T21:30:18.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f7217700 1 -- 172.21.15.63:0/3759497072 shutdown_connections 2020-05-18T21:30:18.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f7217700 1 --2- 172.21.15.63:0/3759497072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7f0060b90 0x7fa7f00615e0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:18.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f7217700 1 -- 172.21.15.63:0/3759497072 >> 172.21.15.63:0/3759497072 conn(0x7fa7f00b83d0 msgr2=0x7fa7f00b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:18.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f7217700 1 -- 172.21.15.63:0/3759497072 shutdown_connections 2020-05-18T21:30:18.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.629+0000 7fa7f7217700 1 -- 172.21.15.63:0/3759497072 wait complete. 2020-05-18T21:30:18.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.633+0000 7fa7f7217700 1 Processor -- start 2020-05-18T21:30:18.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.633+0000 7fa7f7217700 1 -- start start 2020-05-18T21:30:18.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.633+0000 7fa7f7217700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7f014e570 0x7fa7f00b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:18.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.633+0000 7fa7f7217700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f015b6a0 con 0x7fa7f0060b90 2020-05-18T21:30:18.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.633+0000 7fa7f7217700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f015b940 con 0x7fa7f00b2860 2020-05-18T21:30:18.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.633+0000 7fa7f7217700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f015b4c0 con 0x7fa7f014e570 2020-05-18T21:30:18.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.633+0000 7fa7f4fb3700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa7f0060b90 0x7fa7f0119fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59524/0 (socket says 172.21.15.63:59524) 2020-05-18T21:30:18.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.633+0000 7fa7f4fb3700 1 -- 172.21.15.63:0/4246670593 learned_addr learned my addr 172.21.15.63:0/4246670593 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:18.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.633+0000 7fa7f57b4700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7f014e570 0x7fa7f00b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:18.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.633+0000 7fa7e5ffb700 1 -- 172.21.15.63:0/4246670593 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996453413 0 0) 0x7fa7f015b6a0 con 0x7fa7f0060b90 2020-05-18T21:30:18.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.633+0000 7fa7e5ffb700 1 -- 172.21.15.63:0/4246670593 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7d0002fe0 con 0x7fa7f0060b90 2020-05-18T21:30:18.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.633+0000 7fa7e5ffb700 1 -- 172.21.15.63:0/4246670593 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180341975 0 0) 0x7fa7f015b940 con 0x7fa7f00b2860 2020-05-18T21:30:18.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.633+0000 7fa7e5ffb700 1 -- 172.21.15.63:0/4246670593 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f015b6a0 con 0x7fa7f00b2860 2020-05-18T21:30:18.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.633+0000 7fa7f57b4700 1 -- 172.21.15.63:0/4246670593 >> v1:172.21.15.155:6789/0 conn(0x7fa7f00b2860 legacy=0x7fa7f01576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:18.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.633+0000 7fa7f57b4700 1 -- 172.21.15.63:0/4246670593 >> v1:172.21.15.63:6789/0 conn(0x7fa7f0060b90 legacy=0x7fa7f0119fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:18.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.633+0000 7fa7f57b4700 1 -- 172.21.15.63:0/4246670593 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f00ae5d0 con 0x7fa7f014e570 2020-05-18T21:30:18.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.633+0000 7fa7f57b4700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7f014e570 0x7fa7f00b0a90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7e8002310 tx=0x7fa7e8010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:18.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7f57b4700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7f014e570 0x7fa7f00b0a90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7e8002310 tx=0x7fa7e8010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:18.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7f57b4700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7f014e570 0x7fa7f00b0a90 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7fa7e8002310 tx=0x7fa7e8010be0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:18.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7f57b4700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7f014e570 0x7fa7f00b0a90 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fa7e8002310 tx=0x7fa7e8010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:18.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7e5ffb700 1 -- 172.21.15.63:0/4246670593 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7e8012200 con 0x7fa7f014e570 2020-05-18T21:30:18.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7f57b4700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7f014e570 0x7fa7f00b0a90 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fa7e8002310 tx=0x7fa7e8010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:18.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7f7217700 1 -- 172.21.15.63:0/4246670593 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f011a6e0 con 0x7fa7f014e570 2020-05-18T21:30:18.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7f57b4700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7f014e570 0x7fa7f00b0a90 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fa7e8002310 tx=0x7fa7e8010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:18.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7e5ffb700 1 -- 172.21.15.63:0/4246670593 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e8012360 con 0x7fa7f014e570 2020-05-18T21:30:18.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7e5ffb700 1 -- 172.21.15.63:0/4246670593 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7e8012740 con 0x7fa7f014e570 2020-05-18T21:30:18.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7f7217700 1 -- 172.21.15.63:0/4246670593 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f00b3250 con 0x7fa7f014e570 2020-05-18T21:30:18.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7f57b4700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7f014e570 0x7fa7f00b0a90 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fa7e8002310 tx=0x7fa7e8010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:18.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7f7217700 1 -- 172.21.15.63:0/4246670593 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f011a8d0 con 0x7fa7f014e570 2020-05-18T21:30:18.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7e5ffb700 1 -- 172.21.15.63:0/4246670593 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa7e80129c0 con 0x7fa7f014e570 2020-05-18T21:30:18.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7f57b4700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7f014e570 0x7fa7f00b0a90 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fa7e8002310 tx=0x7fa7e8010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:18.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7e5ffb700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa7d004fed0 0x7fa7d0052390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:18.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7e5ffb700 1 -- 172.21.15.63:0/4246670593 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa7e80640a0 con 0x7fa7f014e570 2020-05-18T21:30:18.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7f4fb3700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa7d004fed0 0x7fa7d0052390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:18.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7f4fb3700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa7d004fed0 0x7fa7d0052390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7ec010240 tx=0x7fa7f005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:18.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7f4fb3700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa7d004fed0 0x7fa7d0052390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7ec010240 tx=0x7fa7f005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:18.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.637+0000 7fa7f4fb3700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa7d004fed0 0x7fa7d0052390 secure :-1 s=READY pgs=357 cs=0 l=1 rx=0x7fa7ec010240 tx=0x7fa7f005fa60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:18.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.645+0000 7fa7f57b4700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7f014e570 0x7fa7f00b0a90 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fa7e8002310 tx=0x7fa7e8010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:18.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.645+0000 7fa7e5ffb700 1 -- 172.21.15.63:0/4246670593 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa7e803e430 con 0x7fa7f014e570 2020-05-18T21:30:18.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.793+0000 7fa7f7217700 1 -- 172.21.15.63:0/4246670593 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7f015bad0 con 0x7fa7f014e570 2020-05-18T21:30:18.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.793+0000 7fa7f57b4700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7f014e570 0x7fa7f00b0a90 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fa7e8002310 tx=0x7fa7e8010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:18.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.793+0000 7fa7e5ffb700 1 -- 172.21.15.63:0/4246670593 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+2137 (secure 0 0 0) 0x7fa7e8041a50 con 0x7fa7f014e570 2020-05-18T21:30:18.798 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:18.798 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":40,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5336,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/129631814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":129631814},{"type":"v1","addr":"172.21.15.63:6833","nonce":129631814}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":37}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:10.069167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5339},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5339":{"gid":5339,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/802454809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":802454809},{"type":"v1","addr":"172.21.15.155:6835","nonce":802454809}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:30:18.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.797+0000 7fa7f7217700 1 -- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa7d004fed0 msgr2=0x7fa7d0052390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:18.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.797+0000 7fa7f7217700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa7d004fed0 0x7fa7d0052390 secure :-1 s=READY pgs=357 cs=0 l=1 rx=0x7fa7ec010240 tx=0x7fa7f005fa60).stop 2020-05-18T21:30:18.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.797+0000 7fa7f7217700 1 -- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7f014e570 msgr2=0x7fa7f00b0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:18.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.797+0000 7fa7f7217700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7f014e570 0x7fa7f00b0a90 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7fa7e8002310 tx=0x7fa7e8010be0).stop 2020-05-18T21:30:18.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.797+0000 7fa7f7217700 1 -- 172.21.15.63:0/4246670593 shutdown_connections 2020-05-18T21:30:18.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.797+0000 7fa7f7217700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa7d004fed0 0x7fa7d0052390 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:18.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.797+0000 7fa7f7217700 1 --2- 172.21.15.63:0/4246670593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7f014e570 0x7fa7f00b0a90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:18.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.797+0000 7fa7f7217700 1 -- 172.21.15.63:0/4246670593 >> 172.21.15.63:0/4246670593 conn(0x7fa7f00b83d0 msgr2=0x7fa7f00b4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:18.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.797+0000 7fa7f7217700 1 -- 172.21.15.63:0/4246670593 shutdown_connections 2020-05-18T21:30:18.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:18.797+0000 7fa7f7217700 1 -- 172.21.15.63:0/4246670593 wait complete. 2020-05-18T21:30:18.803 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 40 2020-05-18T21:30:18.816 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok flush journal 2020-05-18T21:30:18.933 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:30:18.934 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "", 2020-05-18T21:30:18.934 INFO:teuthology.orchestra.run.smithi155.stdout: "return_code": 0 2020-05-18T21:30:18.934 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:30:18.943 INFO:tasks.cephfs.filesystem:_json_asok output: { "message": "", "return_code": 0 } 2020-05-18T21:30:18.944 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:30:18.945 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:30:18.945 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:30:18.945 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:30:18.959 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:30:18.959 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail b 2020-05-18T21:30:18.961 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:30:18.961 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail a 2020-05-18T21:30:19.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.061+0000 7f5af0893700 1 Processor -- start 2020-05-18T21:30:19.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.061+0000 7f5af0893700 1 -- start start 2020-05-18T21:30:19.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.061+0000 7f5af0893700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5aec0b9150 0x7f5aec0ba0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:19.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.061+0000 7f5af0893700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aec12e800 0x7f5aec12ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:19.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.061+0000 7f5af0893700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aec146d00 con 0x7f5aec142f30 2020-05-18T21:30:19.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.061+0000 7f5af0893700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aec147260 con 0x7f5aec0b9150 2020-05-18T21:30:19.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.061+0000 7f5af0893700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec0b9530 con 0x7f5aec12e800 2020-05-18T21:30:19.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.061+0000 7f5aea59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5aec0b9150 0x7f5aec0ba0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:19.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.061+0000 7f5aea59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5aec0b9150 0x7f5aec0ba0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57344/0 (socket says 172.21.15.63:57344) 2020-05-18T21:30:19.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.061+0000 7f5aea59c700 1 -- 172.21.15.63:0/3156127326 learned_addr learned my addr 172.21.15.63:0/3156127326 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:19.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5aead9d700 1 --2- 172.21.15.63:0/3156127326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aec12e800 0x7f5aec12ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:19.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5aea59c700 1 -- 172.21.15.63:0/3156127326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aec12e800 msgr2=0x7f5aec12ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:19.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5aea59c700 1 --2- 172.21.15.63:0/3156127326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aec12e800 0x7f5aec12ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:19.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5aea59c700 1 -- 172.21.15.63:0/3156127326 >> v1:172.21.15.155:6789/0 conn(0x7f5aec142f30 legacy=0x7f5aec1433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:19.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5aea59c700 1 -- 172.21.15.63:0/3156127326 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec146940 con 0x7f5aec0b9150 2020-05-18T21:30:19.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5aea59c700 1 --2- 172.21.15.63:0/3156127326 >> v2:172.21.15.63:3300/0 conn(0x7f5aec0b9150 0x7f5aec0ba0b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5adc002f70 tx=0x7f5adc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5aea59c700 1 --2- 172.21.15.63:0/3156127326 >> v2:172.21.15.63:3300/0 conn(0x7f5aec0b9150 0x7f5aec0ba0b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5adc002f70 tx=0x7f5adc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5aea59c700 1 --2- 172.21.15.63:0/3156127326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aec0b9150 0x7f5aec0ba0b0 secure :-1 s=READY pgs=888 cs=0 l=1 rx=0x7f5adc002f70 tx=0x7f5adc007a80).ready entity=mon.0 client_cookie=a569abf8638e548c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:19.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5aea59c700 1 --2- 172.21.15.63:0/3156127326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aec0b9150 0x7f5aec0ba0b0 secure :-1 s=THROTTLE_DONE pgs=888 cs=0 l=1 rx=0x7f5adc002f70 tx=0x7f5adc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5ae959a700 1 -- 172.21.15.63:0/3156127326 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5adc011760 con 0x7f5aec0b9150 2020-05-18T21:30:19.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5aea59c700 1 --2- 172.21.15.63:0/3156127326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aec0b9150 0x7f5aec0ba0b0 secure :-1 s=THROTTLE_DONE pgs=888 cs=0 l=1 rx=0x7f5adc002f70 tx=0x7f5adc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5aea59c700 1 --2- 172.21.15.63:0/3156127326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aec0b9150 0x7f5aec0ba0b0 secure :-1 s=THROTTLE_DONE pgs=888 cs=0 l=1 rx=0x7f5adc002f70 tx=0x7f5adc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5ae959a700 1 -- 172.21.15.63:0/3156127326 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5adc0118c0 con 0x7f5aec0b9150 2020-05-18T21:30:19.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5ae959a700 1 -- 172.21.15.63:0/3156127326 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5adc011ce0 con 0x7f5aec0b9150 2020-05-18T21:30:19.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5af0893700 1 -- 172.21.15.63:0/3156127326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aec0b9150 msgr2=0x7f5aec0ba0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:19.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5af0893700 1 --2- 172.21.15.63:0/3156127326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aec0b9150 0x7f5aec0ba0b0 secure :-1 s=READY pgs=888 cs=0 l=1 rx=0x7f5adc002f70 tx=0x7f5adc007a80).stop 2020-05-18T21:30:19.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5af0893700 1 -- 172.21.15.63:0/3156127326 shutdown_connections 2020-05-18T21:30:19.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5af0893700 1 --2- 172.21.15.63:0/3156127326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aec12e800 0x7f5aec12ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:19.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5af0893700 1 --2- 172.21.15.63:0/3156127326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aec0b9150 0x7f5aec0ba0b0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:19.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5af0893700 1 -- 172.21.15.63:0/3156127326 >> 172.21.15.63:0/3156127326 conn(0x7f5aec05f510 msgr2=0x7f5aec069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:19.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5af0893700 1 -- 172.21.15.63:0/3156127326 shutdown_connections 2020-05-18T21:30:19.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5af0893700 1 -- 172.21.15.63:0/3156127326 wait complete. 2020-05-18T21:30:19.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.065+0000 7f5af0893700 1 Processor -- start 2020-05-18T21:30:19.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5af0893700 1 -- start start 2020-05-18T21:30:19.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5af0893700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aec0b9150 0x7f5aec144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:19.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5af0893700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5aec12e800 0x7f5aec1437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:19.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5af0893700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aec12b8f0 con 0x7f5aec142f30 2020-05-18T21:30:19.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5af0893700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aec12bb90 con 0x7f5aec12e800 2020-05-18T21:30:19.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5af0893700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec12be30 con 0x7f5aec0b9150 2020-05-18T21:30:19.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5ae9d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5aec12e800 0x7f5aec1437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:19.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5ae9d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5aec12e800 0x7f5aec1437a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57352/0 (socket says 172.21.15.63:57352) 2020-05-18T21:30:19.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5ae9d9b700 1 -- 172.21.15.63:0/1635397744 learned_addr learned my addr 172.21.15.63:0/1635397744 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:19.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5aea59c700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aec0b9150 0x7f5aec144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:19.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5ae9d9b700 1 -- 172.21.15.63:0/1635397744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aec0b9150 msgr2=0x7f5aec144ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:19.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5ae9d9b700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aec0b9150 0x7f5aec144ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:19.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5ae9d9b700 1 -- 172.21.15.63:0/1635397744 >> v1:172.21.15.155:6789/0 conn(0x7f5aec142f30 legacy=0x7f5aec12c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:19.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5ae9d9b700 1 -- 172.21.15.63:0/1635397744 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec12c9e0 con 0x7f5aec12e800 2020-05-18T21:30:19.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5ae9d9b700 1 --2- 172.21.15.63:0/1635397744 >> v2:172.21.15.63:3300/0 conn(0x7f5aec12e800 0x7f5aec1437a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5aec0618b0 tx=0x7f5ae000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5ae9d9b700 1 --2- 172.21.15.63:0/1635397744 >> v2:172.21.15.63:3300/0 conn(0x7f5aec12e800 0x7f5aec1437a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5aec0618b0 tx=0x7f5ae000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5ae9d9b700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aec12e800 0x7f5aec1437a0 secure :-1 s=READY pgs=889 cs=0 l=1 rx=0x7f5aec0618b0 tx=0x7f5ae000c4a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:19.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5ae9d9b700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aec12e800 0x7f5aec1437a0 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f5aec0618b0 tx=0x7f5ae000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5adb7fe700 1 -- 172.21.15.63:0/1635397744 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ae000cc60 con 0x7f5aec12e800 2020-05-18T21:30:19.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5ae9d9b700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aec12e800 0x7f5aec1437a0 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f5aec0618b0 tx=0x7f5ae000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5adb7fe700 1 -- 172.21.15.63:0/1635397744 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae000cdc0 con 0x7f5aec12e800 2020-05-18T21:30:19.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5af0893700 1 -- 172.21.15.63:0/1635397744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aec0ad0b0 con 0x7f5aec12e800 2020-05-18T21:30:19.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5ae9d9b700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aec12e800 0x7f5aec1437a0 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f5aec0618b0 tx=0x7f5ae000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5adb7fe700 1 -- 172.21.15.63:0/1635397744 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ae0012260 con 0x7f5aec12e800 2020-05-18T21:30:19.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5af0893700 1 -- 172.21.15.63:0/1635397744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aec12b5f0 con 0x7f5aec12e800 2020-05-18T21:30:19.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5ae9d9b700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aec12e800 0x7f5aec1437a0 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f5aec0618b0 tx=0x7f5ae000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.069+0000 7f5af0893700 1 -- 172.21.15.63:0/1635397744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aec0569e0 con 0x7f5aec12e800 2020-05-18T21:30:19.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.073+0000 7f5adb7fe700 1 -- 172.21.15.63:0/1635397744 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5ae0006520 con 0x7f5aec12e800 2020-05-18T21:30:19.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.073+0000 7f5ae9d9b700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aec12e800 0x7f5aec1437a0 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f5aec0618b0 tx=0x7f5ae000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.073+0000 7f5adb7fe700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ac804fa00 0x7f5ac8051ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:19.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.073+0000 7f5adb7fe700 1 -- 172.21.15.63:0/1635397744 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5ae0063840 con 0x7f5aec12e800 2020-05-18T21:30:19.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.073+0000 7f5aea59c700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ac804fa00 0x7f5ac8051ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:19.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.073+0000 7f5aea59c700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ac804fa00 0x7f5ac8051ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5adc002f70 tx=0x7f5adc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.073+0000 7f5aea59c700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ac804fa00 0x7f5ac8051ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5adc002f70 tx=0x7f5adc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.073+0000 7f5aea59c700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ac804fa00 0x7f5ac8051ec0 secure :-1 s=READY pgs=358 cs=0 l=1 rx=0x7f5adc002f70 tx=0x7f5adc007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:19.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.077+0000 7f5ae9d9b700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aec12e800 0x7f5aec1437a0 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f5aec0618b0 tx=0x7f5ae000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.077+0000 7f5adb7fe700 1 -- 172.21.15.63:0/1635397744 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f5ae003dbd0 con 0x7f5aec12e800 2020-05-18T21:30:19.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.101+0000 7f903dc4d700 1 Processor -- start 2020-05-18T21:30:19.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903dc4d700 1 -- start start 2020-05-18T21:30:19.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903dc4d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9038146d60 0x7f903809df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:19.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903dc4d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9038143d60 0x7f90381441c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:19.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903dc4d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9038147310 0x7f90381477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:19.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903dc4d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9038144f90 con 0x7f9038143d60 2020-05-18T21:30:19.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903dc4d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9038144c90 con 0x7f9038147310 2020-05-18T21:30:19.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903dc4d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90381449f0 con 0x7f9038146d60 2020-05-18T21:30:19.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f9037fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9038143d60 0x7f90381441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:19.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903cc4b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9038146d60 0x7f903809df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:19.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903d44c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9038147310 0x7f90381477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:19.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f9037fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9038143d60 0x7f90381441c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57360/0 (socket says 172.21.15.63:57360) 2020-05-18T21:30:19.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f9037fff700 1 -- 172.21.15.63:0/1542910261 learned_addr learned my addr 172.21.15.63:0/1542910261 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:19.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903cc4b700 1 -- 172.21.15.63:0/1542910261 >> v2:172.21.15.155:3300/0 conn(0x7f9038147310 msgr2=0x7f90381477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:19.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903cc4b700 1 --2- 172.21.15.63:0/1542910261 >> v2:172.21.15.155:3300/0 conn(0x7f9038147310 0x7f90381477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:19.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903cc4b700 1 -- 172.21.15.63:0/1542910261 >> v2:172.21.15.63:3300/0 conn(0x7f9038143d60 msgr2=0x7f90381441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:19.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903cc4b700 1 --2- 172.21.15.63:0/1542910261 >> v2:172.21.15.63:3300/0 conn(0x7f9038143d60 0x7f90381441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:19.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903cc4b700 1 -- 172.21.15.63:0/1542910261 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903805f6e0 con 0x7f9038146d60 2020-05-18T21:30:19.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903cc4b700 1 --2- 172.21.15.63:0/1542910261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9038146d60 0x7f903809df50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f903809e4e0 tx=0x7f902c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903cc4b700 1 --2- 172.21.15.63:0/1542910261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9038146d60 0x7f903809df50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f903809e4e0 tx=0x7f902c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903cc4b700 1 --2- 172.21.15.63:0/1542910261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9038146d60 0x7f903809df50 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f903809e4e0 tx=0x7f902c008920).ready entity=mon.2 client_cookie=d18a444352e9ad70 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:19.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903cc4b700 1 --2- 172.21.15.63:0/1542910261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9038146d60 0x7f903809df50 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f903809e4e0 tx=0x7f902c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f90377fe700 1 -- 172.21.15.63:0/1542910261 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f902c008d70 con 0x7f9038146d60 2020-05-18T21:30:19.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903cc4b700 1 --2- 172.21.15.63:0/1542910261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9038146d60 0x7f903809df50 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f903809e4e0 tx=0x7f902c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903cc4b700 1 --2- 172.21.15.63:0/1542910261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9038146d60 0x7f903809df50 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f903809e4e0 tx=0x7f902c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f90377fe700 1 -- 172.21.15.63:0/1542910261 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c0116e0 con 0x7f9038146d60 2020-05-18T21:30:19.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f90377fe700 1 -- 172.21.15.63:0/1542910261 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f902c011ac0 con 0x7f9038146d60 2020-05-18T21:30:19.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903dc4d700 1 -- 172.21.15.63:0/1542910261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9038146d60 msgr2=0x7f903809df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:19.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903dc4d700 1 --2- 172.21.15.63:0/1542910261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9038146d60 0x7f903809df50 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f903809e4e0 tx=0x7f902c008920).stop 2020-05-18T21:30:19.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903dc4d700 1 -- 172.21.15.63:0/1542910261 shutdown_connections 2020-05-18T21:30:19.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903dc4d700 1 --2- 172.21.15.63:0/1542910261 >> v2:172.21.15.155:3300/0 conn(0x7f9038147310 0x7f90381477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:19.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903dc4d700 1 --2- 172.21.15.63:0/1542910261 >> v2:172.21.15.63:3300/0 conn(0x7f9038143d60 0x7f90381441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:19.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903dc4d700 1 --2- 172.21.15.63:0/1542910261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9038146d60 0x7f903809df50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:19.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903dc4d700 1 -- 172.21.15.63:0/1542910261 >> 172.21.15.63:0/1542910261 conn(0x7f90380b9630 msgr2=0x7f90380b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:19.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.105+0000 7f903dc4d700 1 -- 172.21.15.63:0/1542910261 shutdown_connections 2020-05-18T21:30:19.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f903dc4d700 1 -- 172.21.15.63:0/1542910261 wait complete. 2020-05-18T21:30:19.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f903dc4d700 1 Processor -- start 2020-05-18T21:30:19.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f903dc4d700 1 -- start start 2020-05-18T21:30:19.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f903dc4d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9038143d60 0x7f90380b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:19.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f903dc4d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9038156b70 con 0x7f9038147310 2020-05-18T21:30:19.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f903dc4d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90380b17c0 con 0x7f9038146d60 2020-05-18T21:30:19.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f903dc4d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90380b3e40 con 0x7f9038143d60 2020-05-18T21:30:19.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f903d44c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9038147310 0x7f90380b10b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59556/0 (socket says 172.21.15.63:59556) 2020-05-18T21:30:19.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f903d44c700 1 -- 172.21.15.63:0/3418129444 learned_addr learned my addr 172.21.15.63:0/3418129444 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:19.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f903cc4b700 1 --2- 172.21.15.63:0/3418129444 >> v2:172.21.15.155:3300/0 conn(0x7f9038143d60 0x7f90380b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:19.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f9035ffb700 1 -- 172.21.15.63:0/3418129444 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394460197 0 0) 0x7f9038156b70 con 0x7f9038147310 2020-05-18T21:30:19.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f9035ffb700 1 -- 172.21.15.63:0/3418129444 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9020002fe0 con 0x7f9038147310 2020-05-18T21:30:19.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f9035ffb700 1 -- 172.21.15.63:0/3418129444 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1927681841 0 0) 0x7f9020002fe0 con 0x7f9038147310 2020-05-18T21:30:19.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f9035ffb700 1 -- 172.21.15.63:0/3418129444 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9038156b70 con 0x7f9038147310 2020-05-18T21:30:19.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f9035ffb700 1 -- 172.21.15.63:0/3418129444 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f9030001850 con 0x7f9038147310 2020-05-18T21:30:19.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f903cc4b700 1 -- 172.21.15.63:0/3418129444 >> v1:172.21.15.155:6789/0 conn(0x7f9038146d60 legacy=0x7f90380b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:19.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f903cc4b700 1 -- 172.21.15.63:0/3418129444 >> v1:172.21.15.63:6789/0 conn(0x7f9038147310 legacy=0x7f90380b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:19.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f903cc4b700 1 -- 172.21.15.63:0/3418129444 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9038156da0 con 0x7f9038143d60 2020-05-18T21:30:19.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f903cc4b700 1 --2- 172.21.15.63:0/3418129444 >> v2:172.21.15.155:3300/0 conn(0x7f9038143d60 0x7f90380b4890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9024002f30 tx=0x7f9038066fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f903cc4b700 1 --2- 172.21.15.63:0/3418129444 >> v2:172.21.15.155:3300/0 conn(0x7f9038143d60 0x7f90380b4890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9024002f30 tx=0x7f9038066fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f903cc4b700 1 --2- 172.21.15.63:0/3418129444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9038143d60 0x7f90380b4890 secure :-1 s=READY pgs=638 cs=0 l=1 rx=0x7f9024002f30 tx=0x7f9038066fa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:19.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f903cc4b700 1 --2- 172.21.15.63:0/3418129444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9038143d60 0x7f90380b4890 secure :-1 s=THROTTLE_DONE pgs=638 cs=0 l=1 rx=0x7f9024002f30 tx=0x7f9038066fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f9035ffb700 1 -- 172.21.15.63:0/3418129444 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f902c010100 con 0x7f9038143d60 2020-05-18T21:30:19.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f903cc4b700 1 --2- 172.21.15.63:0/3418129444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9038143d60 0x7f90380b4890 secure :-1 s=THROTTLE_DONE pgs=638 cs=0 l=1 rx=0x7f9024002f30 tx=0x7f9038066fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f903cc4b700 1 --2- 172.21.15.63:0/3418129444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9038143d60 0x7f90380b4890 secure :-1 s=THROTTLE_DONE pgs=638 cs=0 l=1 rx=0x7f9024002f30 tx=0x7f9038066fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.109+0000 7f9035ffb700 1 -- 172.21.15.63:0/3418129444 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c007360 con 0x7f9038143d60 2020-05-18T21:30:19.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.113+0000 7f903dc4d700 1 -- 172.21.15.63:0/3418129444 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90380b3b40 con 0x7f9038143d60 2020-05-18T21:30:19.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.113+0000 7f9035ffb700 1 -- 172.21.15.63:0/3418129444 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f902c005700 con 0x7f9038143d60 2020-05-18T21:30:19.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.113+0000 7f903dc4d700 1 -- 172.21.15.63:0/3418129444 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90380b2670 con 0x7f9038143d60 2020-05-18T21:30:19.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.113+0000 7f903dc4d700 1 -- 172.21.15.63:0/3418129444 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90380569e0 con 0x7f9038143d60 2020-05-18T21:30:19.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.113+0000 7f903cc4b700 1 --2- 172.21.15.63:0/3418129444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9038143d60 0x7f90380b4890 secure :-1 s=THROTTLE_DONE pgs=638 cs=0 l=1 rx=0x7f9024002f30 tx=0x7f9038066fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.113+0000 7f9035ffb700 1 -- 172.21.15.63:0/3418129444 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f902c005900 con 0x7f9038143d60 2020-05-18T21:30:19.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.113+0000 7f903cc4b700 1 --2- 172.21.15.63:0/3418129444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9038143d60 0x7f90380b4890 secure :-1 s=THROTTLE_DONE pgs=638 cs=0 l=1 rx=0x7f9024002f30 tx=0x7f9038066fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.113+0000 7f9035ffb700 1 --2- 172.21.15.63:0/3418129444 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f902004ffb0 0x7f9020052470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:19.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.113+0000 7f9035ffb700 1 -- 172.21.15.63:0/3418129444 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f902c064480 con 0x7f9038143d60 2020-05-18T21:30:19.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.113+0000 7f9037fff700 1 --2- 172.21.15.63:0/3418129444 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f902004ffb0 0x7f9020052470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:19.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.113+0000 7f9037fff700 1 --2- 172.21.15.63:0/3418129444 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f902004ffb0 0x7f9020052470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9024007960 tx=0x7f9024007740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.113+0000 7f9037fff700 1 --2- 172.21.15.63:0/3418129444 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f902004ffb0 0x7f9020052470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9024007960 tx=0x7f9024007740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.113+0000 7f9037fff700 1 --2- 172.21.15.63:0/3418129444 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f902004ffb0 0x7f9020052470 secure :-1 s=READY pgs=359 cs=0 l=1 rx=0x7f9024007960 tx=0x7f9024007740).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:19.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.121+0000 7f903cc4b700 1 --2- 172.21.15.63:0/3418129444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9038143d60 0x7f90380b4890 secure :-1 s=THROTTLE_DONE pgs=638 cs=0 l=1 rx=0x7f9024002f30 tx=0x7f9038066fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.121+0000 7f9035ffb700 1 -- 172.21.15.63:0/3418129444 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f902c03e930 con 0x7f9038143d60 2020-05-18T21:30:19.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.233+0000 7f5af0893700 1 -- 172.21.15.63:0/1635397744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f5aec0b89a0 con 0x7f5aec12e800 2020-05-18T21:30:19.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.277+0000 7f903dc4d700 1 -- 172.21.15.63:0/3418129444 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f903809b820 con 0x7f9038143d60 2020-05-18T21:30:19.624 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:30:19.621+0000 7fdb4592c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:30:19.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.625+0000 7f5ae9d9b700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aec12e800 0x7f5aec1437a0 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f5aec0618b0 tx=0x7f5ae000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.625+0000 7f5adb7fe700 1 -- 172.21.15.63:0/1635397744 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5339 v41) v1 ==== 95+0+0 (secure 0 0 0) 0x7f5ae00411f0 con 0x7f5aec12e800 2020-05-18T21:30:19.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.629+0000 7f903cc4b700 1 --2- 172.21.15.63:0/3418129444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9038143d60 0x7f90380b4890 secure :-1 s=THROTTLE_DONE pgs=638 cs=0 l=1 rx=0x7f9024002f30 tx=0x7f9038066fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.629+0000 7f9035ffb700 1 -- 172.21.15.63:0/3418129444 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 5336 v41) v1 ==== 95+0+0 (secure 0 0 0) 0x7f902c041f50 con 0x7f9038143d60 2020-05-18T21:30:19.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.629+0000 7f5af0893700 1 -- 172.21.15.63:0/1635397744 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ac804fa00 msgr2=0x7f5ac8051ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:19.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.629+0000 7f5af0893700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ac804fa00 0x7f5ac8051ec0 secure :-1 s=READY pgs=358 cs=0 l=1 rx=0x7f5adc002f70 tx=0x7f5adc007a80).stop 2020-05-18T21:30:19.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.629+0000 7f5af0893700 1 -- 172.21.15.63:0/1635397744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aec12e800 msgr2=0x7f5aec1437a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:19.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.629+0000 7f5af0893700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aec12e800 0x7f5aec1437a0 secure :-1 s=READY pgs=889 cs=0 l=1 rx=0x7f5aec0618b0 tx=0x7f5ae000c4a0).stop 2020-05-18T21:30:19.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.629+0000 7f5af0893700 1 -- 172.21.15.63:0/1635397744 shutdown_connections 2020-05-18T21:30:19.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.629+0000 7f5af0893700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ac804fa00 0x7f5ac8051ec0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:19.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.629+0000 7f5af0893700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5aec12e800 0x7f5aec1437a0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:19.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.629+0000 7f5af0893700 1 --2- 172.21.15.63:0/1635397744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aec0b9150 0x7f5aec144ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:19.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.629+0000 7f5af0893700 1 -- 172.21.15.63:0/1635397744 >> 172.21.15.63:0/1635397744 conn(0x7f5aec05f510 msgr2=0x7f5aec147620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:19.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.629+0000 7f5af0893700 1 -- 172.21.15.63:0/1635397744 shutdown_connections 2020-05-18T21:30:19.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.629+0000 7f5af0893700 1 -- 172.21.15.63:0/1635397744 wait complete. 2020-05-18T21:30:19.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.633+0000 7f903dc4d700 1 -- 172.21.15.63:0/3418129444 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f902004ffb0 msgr2=0x7f9020052470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:19.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.633+0000 7f903dc4d700 1 --2- 172.21.15.63:0/3418129444 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f902004ffb0 0x7f9020052470 secure :-1 s=READY pgs=359 cs=0 l=1 rx=0x7f9024007960 tx=0x7f9024007740).stop 2020-05-18T21:30:19.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.633+0000 7f903dc4d700 1 -- 172.21.15.63:0/3418129444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9038143d60 msgr2=0x7f90380b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:19.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.633+0000 7f903dc4d700 1 --2- 172.21.15.63:0/3418129444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9038143d60 0x7f90380b4890 secure :-1 s=READY pgs=638 cs=0 l=1 rx=0x7f9024002f30 tx=0x7f9038066fa0).stop 2020-05-18T21:30:19.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.633+0000 7f903dc4d700 1 -- 172.21.15.63:0/3418129444 shutdown_connections 2020-05-18T21:30:19.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.633+0000 7f903dc4d700 1 --2- 172.21.15.63:0/3418129444 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f902004ffb0 0x7f9020052470 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:19.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.633+0000 7f903dc4d700 1 --2- 172.21.15.63:0/3418129444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9038143d60 0x7f90380b4890 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:19.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.633+0000 7f903dc4d700 1 -- 172.21.15.63:0/3418129444 >> 172.21.15.63:0/3418129444 conn(0x7f90380b9630 msgr2=0x7f9038143070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:19.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.633+0000 7f903dc4d700 1 -- 172.21.15.63:0/3418129444 shutdown_connections 2020-05-18T21:30:19.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.633+0000 7f903dc4d700 1 -- 172.21.15.63:0/3418129444 wait complete. 2020-05-18T21:30:19.641 INFO:teuthology.orchestra.run.smithi063.stderr:failed mds gid 5336 2020-05-18T21:30:19.641 INFO:teuthology.orchestra.run.smithi063.stderr:failed mds gid 5339 2020-05-18T21:30:19.653 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:30:19.654 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:30:19.655 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:30:19.655 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:30:19.657 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:30:19.658 DEBUG:teuthology.parallel:result is None 2020-05-18T21:30:19.659 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:30:19.659 DEBUG:teuthology.parallel:result is None 2020-05-18T21:30:19.659 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:30:19.727 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:30:19.732 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:30:19.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.749+0000 7f46f51f1700 1 Processor -- start 2020-05-18T21:30:19.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.749+0000 7f46f51f1700 1 -- start start 2020-05-18T21:30:19.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46f51f1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f46f00b8e20 0x7f46f005b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:19.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46f51f1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 0x7f46f0145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:19.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46f51f1700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f00b51f0 con 0x7f46f0146020 2020-05-18T21:30:19.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46effff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f46f00b8e20 0x7f46f005b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:19.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46f51f1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f01428d0 con 0x7f46f00b8e20 2020-05-18T21:30:19.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46f51f1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f0142b70 con 0x7f46f0145760 2020-05-18T21:30:19.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46effff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f46f00b8e20 0x7f46f005b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57382/0 (socket says 172.21.15.63:57382) 2020-05-18T21:30:19.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46effff700 1 -- 172.21.15.63:0/2883203898 learned_addr learned my addr 172.21.15.63:0/2883203898 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:19.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46ef7fe700 1 --2- 172.21.15.63:0/2883203898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 0x7f46f0145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:19.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46effff700 1 -- 172.21.15.63:0/2883203898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 msgr2=0x7f46f0145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:19.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46effff700 1 --2- 172.21.15.63:0/2883203898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 0x7f46f0145bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:19.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46eeffd700 1 -- 172.21.15.63:0/2883203898 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539566632 0 0) 0x7f46f00b51f0 con 0x7f46f0146020 2020-05-18T21:30:19.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46effff700 1 -- 172.21.15.63:0/2883203898 >> v1:172.21.15.63:6789/0 conn(0x7f46f0146020 legacy=0x7f46f0141780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:19.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46effff700 1 -- 172.21.15.63:0/2883203898 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f0142e10 con 0x7f46f00b8e20 2020-05-18T21:30:19.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46effff700 1 --2- 172.21.15.63:0/2883203898 >> v2:172.21.15.63:3300/0 conn(0x7f46f00b8e20 0x7f46f005b2b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f46e0002f70 tx=0x7f46e0009a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46ef7fe700 1 --2- 172.21.15.63:0/2883203898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 0x7f46f0145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:30:19.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46effff700 1 --2- 172.21.15.63:0/2883203898 >> v2:172.21.15.63:3300/0 conn(0x7f46f00b8e20 0x7f46f005b2b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f46e0002f70 tx=0x7f46e0009a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46effff700 1 --2- 172.21.15.63:0/2883203898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46f00b8e20 0x7f46f005b2b0 secure :-1 s=READY pgs=896 cs=0 l=1 rx=0x7f46e0002f70 tx=0x7f46e0009a80).ready entity=mon.0 client_cookie=11b8356fe2981634 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:19.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46effff700 1 --2- 172.21.15.63:0/2883203898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46f00b8e20 0x7f46f005b2b0 secure :-1 s=THROTTLE_DONE pgs=896 cs=0 l=1 rx=0x7f46e0002f70 tx=0x7f46e0009a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46eeffd700 1 -- 172.21.15.63:0/2883203898 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46e000d180 con 0x7f46f00b8e20 2020-05-18T21:30:19.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46effff700 1 --2- 172.21.15.63:0/2883203898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46f00b8e20 0x7f46f005b2b0 secure :-1 s=THROTTLE_DONE pgs=896 cs=0 l=1 rx=0x7f46e0002f70 tx=0x7f46e0009a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46effff700 1 --2- 172.21.15.63:0/2883203898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46f00b8e20 0x7f46f005b2b0 secure :-1 s=THROTTLE_DONE pgs=896 cs=0 l=1 rx=0x7f46e0002f70 tx=0x7f46e0009a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46eeffd700 1 -- 172.21.15.63:0/2883203898 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e000d2e0 con 0x7f46f00b8e20 2020-05-18T21:30:19.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46eeffd700 1 -- 172.21.15.63:0/2883203898 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46e000d6c0 con 0x7f46f00b8e20 2020-05-18T21:30:19.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46f51f1700 1 -- 172.21.15.63:0/2883203898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46f00b8e20 msgr2=0x7f46f005b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:19.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.753+0000 7f46f51f1700 1 --2- 172.21.15.63:0/2883203898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46f00b8e20 0x7f46f005b2b0 secure :-1 s=READY pgs=896 cs=0 l=1 rx=0x7f46e0002f70 tx=0x7f46e0009a80).stop 2020-05-18T21:30:19.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.757+0000 7f46f51f1700 1 -- 172.21.15.63:0/2883203898 shutdown_connections 2020-05-18T21:30:19.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.757+0000 7f46f51f1700 1 --2- 172.21.15.63:0/2883203898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 0x7f46f0145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:19.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.757+0000 7f46f51f1700 1 --2- 172.21.15.63:0/2883203898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46f00b8e20 0x7f46f005b2b0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:19.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.757+0000 7f46f51f1700 1 -- 172.21.15.63:0/2883203898 >> 172.21.15.63:0/2883203898 conn(0x7f46f005f630 msgr2=0x7f46f005a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:19.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.757+0000 7f46f51f1700 1 -- 172.21.15.63:0/2883203898 shutdown_connections 2020-05-18T21:30:19.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.757+0000 7f46f51f1700 1 -- 172.21.15.63:0/2883203898 wait complete. 2020-05-18T21:30:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.757+0000 7f46f51f1700 1 Processor -- start 2020-05-18T21:30:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.757+0000 7f46f51f1700 1 -- start start 2020-05-18T21:30:19.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.757+0000 7f46f51f1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 0x7f46f0064170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:19.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.757+0000 7f46f51f1700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f01532d0 con 0x7f46f00b8e20 2020-05-18T21:30:19.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.757+0000 7f46f51f1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f0061030 con 0x7f46f0146020 2020-05-18T21:30:19.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.757+0000 7f46f51f1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f00612d0 con 0x7f46f0145760 2020-05-18T21:30:19.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.757+0000 7f46effff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f46f00b8e20 0x7f46f0061770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59576/0 (socket says 172.21.15.63:59576) 2020-05-18T21:30:19.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.757+0000 7f46effff700 1 -- 172.21.15.63:0/1554329785 learned_addr learned my addr 172.21.15.63:0/1554329785 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:19.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.757+0000 7f46ef7fe700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 0x7f46f0064170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:19.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ed7fa700 1 -- 172.21.15.63:0/1554329785 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866816787 0 0) 0x7f46f01532d0 con 0x7f46f00b8e20 2020-05-18T21:30:19.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ed7fa700 1 -- 172.21.15.63:0/1554329785 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46d0002fe0 con 0x7f46f00b8e20 2020-05-18T21:30:19.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ed7fa700 1 -- 172.21.15.63:0/1554329785 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575250731 0 0) 0x7f46f0061030 con 0x7f46f0146020 2020-05-18T21:30:19.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ed7fa700 1 -- 172.21.15.63:0/1554329785 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46f01532d0 con 0x7f46f0146020 2020-05-18T21:30:19.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ed7fa700 1 -- 172.21.15.63:0/1554329785 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 909428375 0 0) 0x7f46d0002fe0 con 0x7f46f00b8e20 2020-05-18T21:30:19.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ed7fa700 1 -- 172.21.15.63:0/1554329785 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f46f0061030 con 0x7f46f00b8e20 2020-05-18T21:30:19.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ed7fa700 1 -- 172.21.15.63:0/1554329785 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f46e0013d60 con 0x7f46f00b8e20 2020-05-18T21:30:19.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ef7fe700 1 -- 172.21.15.63:0/1554329785 >> v1:172.21.15.155:6789/0 conn(0x7f46f0146020 legacy=0x7f46f0062ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:19.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ef7fe700 1 -- 172.21.15.63:0/1554329785 >> v1:172.21.15.63:6789/0 conn(0x7f46f00b8e20 legacy=0x7f46f0061770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:19.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ef7fe700 1 -- 172.21.15.63:0/1554329785 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f0061e80 con 0x7f46f0145760 2020-05-18T21:30:19.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ef7fe700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 0x7f46f0064170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f46e4002f70 tx=0x7f46e4010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ef7fe700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 0x7f46f0064170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f46e4002f70 tx=0x7f46e4010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ef7fe700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 0x7f46f0064170 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f46e4002f70 tx=0x7f46e4010ad0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:19.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ef7fe700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 0x7f46f0064170 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f46e4002f70 tx=0x7f46e4010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ed7fa700 1 -- 172.21.15.63:0/1554329785 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46e4007560 con 0x7f46f0145760 2020-05-18T21:30:19.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ef7fe700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 0x7f46f0064170 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f46e4002f70 tx=0x7f46e4010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ed7fa700 1 -- 172.21.15.63:0/1554329785 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e40057f0 con 0x7f46f0145760 2020-05-18T21:30:19.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ef7fe700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 0x7f46f0064170 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f46e4002f70 tx=0x7f46e4010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46f51f1700 1 -- 172.21.15.63:0/1554329785 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f0064960 con 0x7f46f0145760 2020-05-18T21:30:19.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ed7fa700 1 -- 172.21.15.63:0/1554329785 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46e4005b50 con 0x7f46f0145760 2020-05-18T21:30:19.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46f51f1700 1 -- 172.21.15.63:0/1554329785 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f00633f0 con 0x7f46f0145760 2020-05-18T21:30:19.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46f51f1700 1 -- 172.21.15.63:0/1554329785 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f00614a0 con 0x7f46f0145760 2020-05-18T21:30:19.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ef7fe700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 0x7f46f0064170 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f46e4002f70 tx=0x7f46e4010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ef7fe700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 0x7f46f0064170 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f46e4002f70 tx=0x7f46e4010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.761+0000 7f46ed7fa700 1 -- 172.21.15.63:0/1554329785 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f46e400a290 con 0x7f46f0145760 2020-05-18T21:30:19.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.765+0000 7f46ed7fa700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f46d00500e0 0x7f46d00525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:19.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.765+0000 7f46ed7fa700 1 -- 172.21.15.63:0/1554329785 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f46e400a0d0 con 0x7f46f0145760 2020-05-18T21:30:19.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.765+0000 7f46effff700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f46d00500e0 0x7f46d00525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:19.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.765+0000 7f46effff700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f46d00500e0 0x7f46d00525a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f46e0012510 tx=0x7f46e0009a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.765+0000 7f46effff700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f46d00500e0 0x7f46d00525a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f46e0012510 tx=0x7f46e0009a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.765+0000 7f46effff700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f46d00500e0 0x7f46d00525a0 secure :-1 s=READY pgs=360 cs=0 l=1 rx=0x7f46e0012510 tx=0x7f46e0009a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:19.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.773+0000 7f46ef7fe700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 0x7f46f0064170 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f46e4002f70 tx=0x7f46e4010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.773+0000 7f46ed7fa700 1 -- 172.21.15.63:0/1554329785 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f46e403dc90 con 0x7f46f0145760 2020-05-18T21:30:19.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.921+0000 7f46f51f1700 1 -- 172.21.15.63:0/1554329785 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46f00569e0 con 0x7f46f0145760 2020-05-18T21:30:19.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.921+0000 7f46ef7fe700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 0x7f46f0064170 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f46e4002f70 tx=0x7f46e4010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:19.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.925+0000 7f46ed7fa700 1 -- 172.21.15.63:0/1554329785 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+1427 (secure 0 0 0) 0x7f46e40412b0 con 0x7f46f0145760 2020-05-18T21:30:19.929 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:19.929 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":41,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:19.623793+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:30:19.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.925+0000 7f46f51f1700 1 -- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f46d00500e0 msgr2=0x7f46d00525a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:19.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.925+0000 7f46f51f1700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f46d00500e0 0x7f46d00525a0 secure :-1 s=READY pgs=360 cs=0 l=1 rx=0x7f46e0012510 tx=0x7f46e0009a80).stop 2020-05-18T21:30:19.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.925+0000 7f46f51f1700 1 -- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 msgr2=0x7f46f0064170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:19.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.925+0000 7f46f51f1700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 0x7f46f0064170 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f46e4002f70 tx=0x7f46e4010ad0).stop 2020-05-18T21:30:19.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.925+0000 7f46f51f1700 1 -- 172.21.15.63:0/1554329785 shutdown_connections 2020-05-18T21:30:19.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.925+0000 7f46f51f1700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f46d00500e0 0x7f46d00525a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:19.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.925+0000 7f46f51f1700 1 --2- 172.21.15.63:0/1554329785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46f0145760 0x7f46f0064170 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:19.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.925+0000 7f46f51f1700 1 -- 172.21.15.63:0/1554329785 >> 172.21.15.63:0/1554329785 conn(0x7f46f005f630 msgr2=0x7f46f0141fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:19.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.925+0000 7f46f51f1700 1 -- 172.21.15.63:0/1554329785 shutdown_connections 2020-05-18T21:30:19.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:19.925+0000 7f46f51f1700 1 -- 172.21.15.63:0/1554329785 wait complete. 2020-05-18T21:30:19.933 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 41 2020-05-18T21:30:20.148 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:30:08.365002+0000', 'modified': '2020-05-18T21:30:19.623793+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 74, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:30:20.148 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2020-05-18T21:30:21.150 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:30:21.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf42a2a700 1 Processor -- start 2020-05-18T21:30:21.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf42a2a700 1 -- start start 2020-05-18T21:30:21.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf42a2a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf3c060b90 0x7fcf3c0b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:21.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf42a2a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcf3c146c90 0x7fcf3c0624a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:21.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf42a2a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3c061870 con 0x7fcf3c062900 2020-05-18T21:30:21.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf42a2a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c061d60 con 0x7fcf3c146c90 2020-05-18T21:30:21.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf42a2a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c062000 con 0x7fcf3c060b90 2020-05-18T21:30:21.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf3bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf3c060b90 0x7fcf3c0b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:21.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf3b7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcf3c146c90 0x7fcf3c0624a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:21.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf40fc7700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fcf3c062900 0x7fcf3c0b2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:57916/0 (socket says 172.21.15.63:57916) 2020-05-18T21:30:21.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf40fc7700 1 -- 172.21.15.63:0/3820534074 learned_addr learned my addr 172.21.15.63:0/3820534074 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:21.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf3b7fe700 1 -- 172.21.15.63:0/3820534074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf3c060b90 msgr2=0x7fcf3c0b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:21.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf3b7fe700 1 --2- 172.21.15.63:0/3820534074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf3c060b90 0x7fcf3c0b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:21.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf3b7fe700 1 -- 172.21.15.63:0/3820534074 >> v1:172.21.15.155:6789/0 conn(0x7fcf3c062900 legacy=0x7fcf3c0b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:21.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf3b7fe700 1 -- 172.21.15.63:0/3820534074 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c147210 con 0x7fcf3c146c90 2020-05-18T21:30:21.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf3b7fe700 1 --2- 172.21.15.63:0/3820534074 >> v2:172.21.15.155:3300/0 conn(0x7fcf3c146c90 0x7fcf3c0624a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcf30002f70 tx=0x7fcf30007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:21.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf3b7fe700 1 --2- 172.21.15.63:0/3820534074 >> v2:172.21.15.155:3300/0 conn(0x7fcf3c146c90 0x7fcf3c0624a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcf30002f70 tx=0x7fcf30007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:21.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf3b7fe700 1 --2- 172.21.15.63:0/3820534074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf3c146c90 0x7fcf3c0624a0 secure :-1 s=READY pgs=644 cs=0 l=1 rx=0x7fcf30002f70 tx=0x7fcf30007a80).ready entity=mon.1 client_cookie=a1416a61165b15a3 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:21.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf3b7fe700 1 --2- 172.21.15.63:0/3820534074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf3c146c90 0x7fcf3c0624a0 secure :-1 s=THROTTLE_DONE pgs=644 cs=0 l=1 rx=0x7fcf30002f70 tx=0x7fcf30007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:21.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf3affd700 1 -- 172.21.15.63:0/3820534074 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf30008d70 con 0x7fcf3c146c90 2020-05-18T21:30:21.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf3b7fe700 1 --2- 172.21.15.63:0/3820534074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf3c146c90 0x7fcf3c0624a0 secure :-1 s=THROTTLE_DONE pgs=644 cs=0 l=1 rx=0x7fcf30002f70 tx=0x7fcf30007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:21.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf3b7fe700 1 --2- 172.21.15.63:0/3820534074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf3c146c90 0x7fcf3c0624a0 secure :-1 s=THROTTLE_DONE pgs=644 cs=0 l=1 rx=0x7fcf30002f70 tx=0x7fcf30007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:21.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf3affd700 1 -- 172.21.15.63:0/3820534074 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf30011790 con 0x7fcf3c146c90 2020-05-18T21:30:21.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf3affd700 1 -- 172.21.15.63:0/3820534074 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf30011bb0 con 0x7fcf3c146c90 2020-05-18T21:30:21.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf42a2a700 1 -- 172.21.15.63:0/3820534074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf3c146c90 msgr2=0x7fcf3c0624a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:21.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf42a2a700 1 --2- 172.21.15.63:0/3820534074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf3c146c90 0x7fcf3c0624a0 secure :-1 s=READY pgs=644 cs=0 l=1 rx=0x7fcf30002f70 tx=0x7fcf30007a80).stop 2020-05-18T21:30:21.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf42a2a700 1 -- 172.21.15.63:0/3820534074 shutdown_connections 2020-05-18T21:30:21.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf42a2a700 1 --2- 172.21.15.63:0/3820534074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf3c146c90 0x7fcf3c0624a0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:21.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.257+0000 7fcf42a2a700 1 --2- 172.21.15.63:0/3820534074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf3c060b90 0x7fcf3c0b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:21.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.261+0000 7fcf42a2a700 1 -- 172.21.15.63:0/3820534074 >> 172.21.15.63:0/3820534074 conn(0x7fcf3c0b83d0 msgr2=0x7fcf3c0b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:21.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.261+0000 7fcf42a2a700 1 -- 172.21.15.63:0/3820534074 shutdown_connections 2020-05-18T21:30:21.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.261+0000 7fcf42a2a700 1 -- 172.21.15.63:0/3820534074 wait complete. 2020-05-18T21:30:21.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.261+0000 7fcf42a2a700 1 Processor -- start 2020-05-18T21:30:21.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.261+0000 7fcf42a2a700 1 -- start start 2020-05-18T21:30:21.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf42a2a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf3c060b90 0x7fcf3c144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:21.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf42a2a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcf3c146c90 0x7fcf3c1367e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:21.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf42a2a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3c1437f0 con 0x7fcf3c062900 2020-05-18T21:30:21.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf42a2a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c0ad040 con 0x7fcf3c146c90 2020-05-18T21:30:21.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf42a2a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c0ad2e0 con 0x7fcf3c060b90 2020-05-18T21:30:21.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf3bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf3c060b90 0x7fcf3c144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:21.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf3b7fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fcf3c062900 0x7fcf3c1360d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:57920/0 (socket says 172.21.15.63:57920) 2020-05-18T21:30:21.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf40fc7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcf3c146c90 0x7fcf3c1367e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:21.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf3b7fe700 1 -- 172.21.15.63:0/1353375076 learned_addr learned my addr 172.21.15.63:0/1353375076 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:21.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf40fc7700 1 -- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf3c060b90 msgr2=0x7fcf3c144b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:21.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf40fc7700 1 --2- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf3c060b90 0x7fcf3c144b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:21.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf40fc7700 1 -- 172.21.15.63:0/1353375076 >> v1:172.21.15.155:6789/0 conn(0x7fcf3c062900 legacy=0x7fcf3c1360d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:21.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf40fc7700 1 -- 172.21.15.63:0/1353375076 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c138650 con 0x7fcf3c146c90 2020-05-18T21:30:21.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf40fc7700 1 --2- 172.21.15.63:0/1353375076 >> v2:172.21.15.155:3300/0 conn(0x7fcf3c146c90 0x7fcf3c1367e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcf3c0607d0 tx=0x7fcf34010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:21.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf40fc7700 1 --2- 172.21.15.63:0/1353375076 >> v2:172.21.15.155:3300/0 conn(0x7fcf3c146c90 0x7fcf3c1367e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcf3c0607d0 tx=0x7fcf34010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:21.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf40fc7700 1 --2- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf3c146c90 0x7fcf3c1367e0 secure :-1 s=READY pgs=646 cs=0 l=1 rx=0x7fcf3c0607d0 tx=0x7fcf34010bf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:21.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf40fc7700 1 --2- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf3c146c90 0x7fcf3c1367e0 secure :-1 s=THROTTLE_DONE pgs=646 cs=0 l=1 rx=0x7fcf3c0607d0 tx=0x7fcf34010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:21.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf397fa700 1 -- 172.21.15.63:0/1353375076 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf34005e30 con 0x7fcf3c146c90 2020-05-18T21:30:21.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf40fc7700 1 --2- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf3c146c90 0x7fcf3c1367e0 secure :-1 s=THROTTLE_DONE pgs=646 cs=0 l=1 rx=0x7fcf3c0607d0 tx=0x7fcf34010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:21.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf397fa700 1 -- 172.21.15.63:0/1353375076 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf34012480 con 0x7fcf3c146c90 2020-05-18T21:30:21.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf42a2a700 1 -- 172.21.15.63:0/1353375076 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3c0ac8f0 con 0x7fcf3c146c90 2020-05-18T21:30:21.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf40fc7700 1 --2- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf3c146c90 0x7fcf3c1367e0 secure :-1 s=THROTTLE_DONE pgs=646 cs=0 l=1 rx=0x7fcf3c0607d0 tx=0x7fcf34010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:21.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf397fa700 1 -- 172.21.15.63:0/1353375076 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf34012860 con 0x7fcf3c146c90 2020-05-18T21:30:21.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf42a2a700 1 -- 172.21.15.63:0/1353375076 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3c0acda0 con 0x7fcf3c146c90 2020-05-18T21:30:21.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf40fc7700 1 --2- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf3c146c90 0x7fcf3c1367e0 secure :-1 s=THROTTLE_DONE pgs=646 cs=0 l=1 rx=0x7fcf3c0607d0 tx=0x7fcf34010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:21.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.265+0000 7fcf42a2a700 1 -- 172.21.15.63:0/1353375076 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3c0ad4b0 con 0x7fcf3c146c90 2020-05-18T21:30:21.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.269+0000 7fcf40fc7700 1 --2- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf3c146c90 0x7fcf3c1367e0 secure :-1 s=THROTTLE_DONE pgs=646 cs=0 l=1 rx=0x7fcf3c0607d0 tx=0x7fcf34010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:21.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.269+0000 7fcf397fa700 1 -- 172.21.15.63:0/1353375076 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fcf34012ae0 con 0x7fcf3c146c90 2020-05-18T21:30:21.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.269+0000 7fcf397fa700 1 --2- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcf1c04fa50 0x7fcf1c051f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:21.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.269+0000 7fcf397fa700 1 -- 172.21.15.63:0/1353375076 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fcf340090c0 con 0x7fcf3c146c90 2020-05-18T21:30:21.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.269+0000 7fcf3bfff700 1 --2- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcf1c04fa50 0x7fcf1c051f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:21.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.269+0000 7fcf3bfff700 1 --2- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcf1c04fa50 0x7fcf1c051f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcf2c002f70 tx=0x7fcf2c00d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:21.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.269+0000 7fcf3bfff700 1 --2- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcf1c04fa50 0x7fcf1c051f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcf2c002f70 tx=0x7fcf2c00d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:21.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.269+0000 7fcf3bfff700 1 --2- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcf1c04fa50 0x7fcf1c051f10 secure :-1 s=READY pgs=362 cs=0 l=1 rx=0x7fcf2c002f70 tx=0x7fcf2c00d8f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:21.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.277+0000 7fcf40fc7700 1 --2- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf3c146c90 0x7fcf3c1367e0 secure :-1 s=THROTTLE_DONE pgs=646 cs=0 l=1 rx=0x7fcf3c0607d0 tx=0x7fcf34010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:21.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.277+0000 7fcf397fa700 1 -- 172.21.15.63:0/1353375076 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fcf3403e600 con 0x7fcf3c146c90 2020-05-18T21:30:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.425+0000 7fcf42a2a700 1 -- 172.21.15.63:0/1353375076 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf3c138840 con 0x7fcf3c146c90 2020-05-18T21:30:21.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.425+0000 7fcf40fc7700 1 --2- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf3c146c90 0x7fcf3c1367e0 secure :-1 s=THROTTLE_DONE pgs=646 cs=0 l=1 rx=0x7fcf3c0607d0 tx=0x7fcf34010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:21.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.425+0000 7fcf397fa700 1 -- 172.21.15.63:0/1353375076 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+1789 (secure 0 0 0) 0x7fcf34041c20 con 0x7fcf3c146c90 2020-05-18T21:30:21.430 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:21.430 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":43,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:20.642106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:replay","state_seq":1,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:30:21.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.425+0000 7fcf42a2a700 1 -- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcf1c04fa50 msgr2=0x7fcf1c051f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:21.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.425+0000 7fcf42a2a700 1 --2- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcf1c04fa50 0x7fcf1c051f10 secure :-1 s=READY pgs=362 cs=0 l=1 rx=0x7fcf2c002f70 tx=0x7fcf2c00d8f0).stop 2020-05-18T21:30:21.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.425+0000 7fcf42a2a700 1 -- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf3c146c90 msgr2=0x7fcf3c1367e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:21.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.425+0000 7fcf42a2a700 1 --2- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf3c146c90 0x7fcf3c1367e0 secure :-1 s=READY pgs=646 cs=0 l=1 rx=0x7fcf3c0607d0 tx=0x7fcf34010bf0).stop 2020-05-18T21:30:21.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.425+0000 7fcf42a2a700 1 -- 172.21.15.63:0/1353375076 shutdown_connections 2020-05-18T21:30:21.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.425+0000 7fcf42a2a700 1 --2- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcf1c04fa50 0x7fcf1c051f10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:21.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.425+0000 7fcf42a2a700 1 --2- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf3c146c90 0x7fcf3c1367e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:21.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.425+0000 7fcf42a2a700 1 --2- 172.21.15.63:0/1353375076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf3c060b90 0x7fcf3c144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:21.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.425+0000 7fcf42a2a700 1 -- 172.21.15.63:0/1353375076 >> 172.21.15.63:0/1353375076 conn(0x7fcf3c0b83d0 msgr2=0x7fcf3c0653e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:21.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.425+0000 7fcf42a2a700 1 -- 172.21.15.63:0/1353375076 shutdown_connections 2020-05-18T21:30:21.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:21.425+0000 7fcf42a2a700 1 -- 172.21.15.63:0/1353375076 wait complete. 2020-05-18T21:30:21.434 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 43 2020-05-18T21:30:21.644 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:30:08.365002+0000', 'modified': '2020-05-18T21:30:20.642106+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 74, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6834}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6834': {'gid': 6834, 'name': 'a', 'rank': 0, 'incarnation': 43, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.63:6833/2372263796', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 2372263796}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 2372263796}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:30:21.645 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6834:up:replay 2020-05-18T21:30:22.647 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:30:22.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e359e700 1 Processor -- start 2020-05-18T21:30:22.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e359e700 1 -- start start 2020-05-18T21:30:22.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e359e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb7e40b4760 0x7fb7e40648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:22.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e359e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb7e4064d20 0x7fb7e414d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:22.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e414a330 con 0x7fb7e405f110 2020-05-18T21:30:22.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e359e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e414a140 con 0x7fb7e4064d20 2020-05-18T21:30:22.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e359e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e414a5d0 con 0x7fb7e40b4760 2020-05-18T21:30:22.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e2d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb7e4064d20 0x7fb7e414d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:22.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e2d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb7e4064d20 0x7fb7e414d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57426/0 (socket says 172.21.15.63:57426) 2020-05-18T21:30:22.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e2d9d700 1 -- 172.21.15.63:0/3970233253 learned_addr learned my addr 172.21.15.63:0/3970233253 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:22.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e1d9b700 1 --2- 172.21.15.63:0/3970233253 >> v2:172.21.15.155:3300/0 conn(0x7fb7e40b4760 0x7fb7e40648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:22.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e2d9d700 1 -- 172.21.15.63:0/3970233253 >> v2:172.21.15.155:3300/0 conn(0x7fb7e40b4760 msgr2=0x7fb7e40648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:22.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e2d9d700 1 --2- 172.21.15.63:0/3970233253 >> v2:172.21.15.155:3300/0 conn(0x7fb7e40b4760 0x7fb7e40648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:22.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e2d9d700 1 -- 172.21.15.63:0/3970233253 >> v1:172.21.15.155:6789/0 conn(0x7fb7e405f110 legacy=0x7fb7e414aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:22.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e2d9d700 1 -- 172.21.15.63:0/3970233253 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e4063430 con 0x7fb7e4064d20 2020-05-18T21:30:22.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e2d9d700 1 --2- 172.21.15.63:0/3970233253 >> v2:172.21.15.63:3300/0 conn(0x7fb7e4064d20 0x7fb7e414d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb7dc0032f0 tx=0x7fb7dc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:22.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e2d9d700 1 --2- 172.21.15.63:0/3970233253 >> v2:172.21.15.63:3300/0 conn(0x7fb7e4064d20 0x7fb7e414d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb7dc0032f0 tx=0x7fb7dc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:22.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e2d9d700 1 --2- 172.21.15.63:0/3970233253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7e4064d20 0x7fb7e414d710 secure :-1 s=READY pgs=898 cs=0 l=1 rx=0x7fb7dc0032f0 tx=0x7fb7dc007e00).ready entity=mon.0 client_cookie=7bef805761e9a72a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:22.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e2d9d700 1 --2- 172.21.15.63:0/3970233253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7e4064d20 0x7fb7e414d710 secure :-1 s=THROTTLE_DONE pgs=898 cs=0 l=1 rx=0x7fb7dc0032f0 tx=0x7fb7dc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:22.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e2d9d700 1 --2- 172.21.15.63:0/3970233253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7e4064d20 0x7fb7e414d710 secure :-1 s=THROTTLE_DONE pgs=898 cs=0 l=1 rx=0x7fb7dc0032f0 tx=0x7fb7dc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:22.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e159a700 1 -- 172.21.15.63:0/3970233253 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7dc011dc0 con 0x7fb7e4064d20 2020-05-18T21:30:22.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e2d9d700 1 --2- 172.21.15.63:0/3970233253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7e4064d20 0x7fb7e414d710 secure :-1 s=THROTTLE_DONE pgs=898 cs=0 l=1 rx=0x7fb7dc0032f0 tx=0x7fb7dc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:22.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e159a700 1 -- 172.21.15.63:0/3970233253 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7dc00a180 con 0x7fb7e4064d20 2020-05-18T21:30:22.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e159a700 1 -- 172.21.15.63:0/3970233253 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7dc00a5a0 con 0x7fb7e4064d20 2020-05-18T21:30:22.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e359e700 1 -- 172.21.15.63:0/3970233253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7e4064d20 msgr2=0x7fb7e414d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:22.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e359e700 1 --2- 172.21.15.63:0/3970233253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7e4064d20 0x7fb7e414d710 secure :-1 s=READY pgs=898 cs=0 l=1 rx=0x7fb7dc0032f0 tx=0x7fb7dc007e00).stop 2020-05-18T21:30:22.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e359e700 1 -- 172.21.15.63:0/3970233253 shutdown_connections 2020-05-18T21:30:22.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e359e700 1 --2- 172.21.15.63:0/3970233253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7e4064d20 0x7fb7e414d710 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:22.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e359e700 1 --2- 172.21.15.63:0/3970233253 >> v2:172.21.15.155:3300/0 conn(0x7fb7e40b4760 0x7fb7e40648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:22.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e359e700 1 -- 172.21.15.63:0/3970233253 >> 172.21.15.63:0/3970233253 conn(0x7fb7e4069fc0 msgr2=0x7fb7e406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:22.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e359e700 1 -- 172.21.15.63:0/3970233253 shutdown_connections 2020-05-18T21:30:22.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.757+0000 7fb7e359e700 1 -- 172.21.15.63:0/3970233253 wait complete. 2020-05-18T21:30:22.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.761+0000 7fb7e359e700 1 Processor -- start 2020-05-18T21:30:22.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.761+0000 7fb7e359e700 1 -- start start 2020-05-18T21:30:22.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.761+0000 7fb7e359e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb7e405f110 0x7fb7e40b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:22.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.761+0000 7fb7e359e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb7e40b4760 0x7fb7e414b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:22.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.761+0000 7fb7e359e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e41422b0 con 0x7fb7e4064d20 2020-05-18T21:30:22.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.761+0000 7fb7e359e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e414ba10 con 0x7fb7e405f110 2020-05-18T21:30:22.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.761+0000 7fb7e359e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e414cdc0 con 0x7fb7e40b4760 2020-05-18T21:30:22.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.761+0000 7fb7e259c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb7e405f110 0x7fb7e40b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:22.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.761+0000 7fb7e1d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb7e4064d20 0x7fb7e4140c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59618/0 (socket says 172.21.15.63:59618) 2020-05-18T21:30:22.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.761+0000 7fb7e1d9b700 1 -- 172.21.15.63:0/2122615880 learned_addr learned my addr 172.21.15.63:0/2122615880 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:22.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.761+0000 7fb7e2d9d700 1 --2- 172.21.15.63:0/2122615880 >> v2:172.21.15.155:3300/0 conn(0x7fb7e40b4760 0x7fb7e414b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:22.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.761+0000 7fb7e259c700 1 -- 172.21.15.63:0/2122615880 >> v2:172.21.15.155:3300/0 conn(0x7fb7e40b4760 msgr2=0x7fb7e414b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:22.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.761+0000 7fb7db7fe700 1 -- 172.21.15.63:0/2122615880 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065041163 0 0) 0x7fb7e41422b0 con 0x7fb7e4064d20 2020-05-18T21:30:22.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.761+0000 7fb7e259c700 1 --2- 172.21.15.63:0/2122615880 >> v2:172.21.15.155:3300/0 conn(0x7fb7e40b4760 0x7fb7e414b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:22.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.761+0000 7fb7e259c700 1 -- 172.21.15.63:0/2122615880 >> v1:172.21.15.63:6789/0 conn(0x7fb7e4064d20 legacy=0x7fb7e4140c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:22.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.761+0000 7fb7e259c700 1 -- 172.21.15.63:0/2122615880 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e414d060 con 0x7fb7e405f110 2020-05-18T21:30:22.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.761+0000 7fb7e259c700 1 --2- 172.21.15.63:0/2122615880 >> v2:172.21.15.63:3300/0 conn(0x7fb7e405f110 0x7fb7e40b3ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb7e40625b0 tx=0x7fb7d40108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:22.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.765+0000 7fb7e259c700 1 --2- 172.21.15.63:0/2122615880 >> v2:172.21.15.63:3300/0 conn(0x7fb7e405f110 0x7fb7e40b3ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb7e40625b0 tx=0x7fb7d40108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:22.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.765+0000 7fb7e259c700 1 --2- 172.21.15.63:0/2122615880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7e405f110 0x7fb7e40b3ad0 secure :-1 s=READY pgs=900 cs=0 l=1 rx=0x7fb7e40625b0 tx=0x7fb7d40108c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:22.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.765+0000 7fb7e259c700 1 --2- 172.21.15.63:0/2122615880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7e405f110 0x7fb7e40b3ad0 secure :-1 s=THROTTLE_DONE pgs=900 cs=0 l=1 rx=0x7fb7e40625b0 tx=0x7fb7d40108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:22.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.765+0000 7fb7db7fe700 1 -- 172.21.15.63:0/2122615880 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7d4006c00 con 0x7fb7e405f110 2020-05-18T21:30:22.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.765+0000 7fb7e259c700 1 --2- 172.21.15.63:0/2122615880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7e405f110 0x7fb7e40b3ad0 secure :-1 s=THROTTLE_DONE pgs=900 cs=0 l=1 rx=0x7fb7e40625b0 tx=0x7fb7d40108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:22.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.765+0000 7fb7e259c700 1 --2- 172.21.15.63:0/2122615880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7e405f110 0x7fb7e40b3ad0 secure :-1 s=THROTTLE_DONE pgs=900 cs=0 l=1 rx=0x7fb7e40625b0 tx=0x7fb7d40108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:22.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.765+0000 7fb7db7fe700 1 -- 172.21.15.63:0/2122615880 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d4006da0 con 0x7fb7e405f110 2020-05-18T21:30:22.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.765+0000 7fb7e359e700 1 -- 172.21.15.63:0/2122615880 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e40b42c0 con 0x7fb7e405f110 2020-05-18T21:30:22.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.765+0000 7fb7db7fe700 1 -- 172.21.15.63:0/2122615880 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7d40110e0 con 0x7fb7e405f110 2020-05-18T21:30:22.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.765+0000 7fb7e359e700 1 -- 172.21.15.63:0/2122615880 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e4141610 con 0x7fb7e405f110 2020-05-18T21:30:22.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.765+0000 7fb7e259c700 1 --2- 172.21.15.63:0/2122615880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7e405f110 0x7fb7e40b3ad0 secure :-1 s=THROTTLE_DONE pgs=900 cs=0 l=1 rx=0x7fb7e40625b0 tx=0x7fb7d40108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:22.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.765+0000 7fb7e359e700 1 -- 172.21.15.63:0/2122615880 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e4142460 con 0x7fb7e405f110 2020-05-18T21:30:22.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.765+0000 7fb7db7fe700 1 -- 172.21.15.63:0/2122615880 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb7d4011350 con 0x7fb7e405f110 2020-05-18T21:30:22.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.765+0000 7fb7e259c700 1 --2- 172.21.15.63:0/2122615880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7e405f110 0x7fb7e40b3ad0 secure :-1 s=THROTTLE_DONE pgs=900 cs=0 l=1 rx=0x7fb7e40625b0 tx=0x7fb7d40108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:22.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.765+0000 7fb7db7fe700 1 --2- 172.21.15.63:0/2122615880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb7c804f8a0 0x7fb7c8051d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:22.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.765+0000 7fb7db7fe700 1 -- 172.21.15.63:0/2122615880 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb7d4063b70 con 0x7fb7e405f110 2020-05-18T21:30:22.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.769+0000 7fb7e1d9b700 1 --2- 172.21.15.63:0/2122615880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb7c804f8a0 0x7fb7c8051d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:22.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.769+0000 7fb7e1d9b700 1 --2- 172.21.15.63:0/2122615880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb7c804f8a0 0x7fb7c8051d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb7cc007a80 tx=0x7fb7cc002440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:22.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.769+0000 7fb7e1d9b700 1 --2- 172.21.15.63:0/2122615880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb7c804f8a0 0x7fb7c8051d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb7cc007a80 tx=0x7fb7cc002440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:22.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.769+0000 7fb7e1d9b700 1 --2- 172.21.15.63:0/2122615880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb7c804f8a0 0x7fb7c8051d60 secure :-1 s=READY pgs=363 cs=0 l=1 rx=0x7fb7cc007a80 tx=0x7fb7cc002440).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:22.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.773+0000 7fb7e259c700 1 --2- 172.21.15.63:0/2122615880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7e405f110 0x7fb7e40b3ad0 secure :-1 s=THROTTLE_DONE pgs=900 cs=0 l=1 rx=0x7fb7e40625b0 tx=0x7fb7d40108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:22.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.773+0000 7fb7db7fe700 1 -- 172.21.15.63:0/2122615880 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb7d403dea0 con 0x7fb7e405f110 2020-05-18T21:30:22.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.925+0000 7fb7e359e700 1 -- 172.21.15.63:0/2122615880 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7e40569e0 con 0x7fb7e405f110 2020-05-18T21:30:22.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.925+0000 7fb7e259c700 1 --2- 172.21.15.63:0/2122615880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7e405f110 0x7fb7e40b3ad0 secure :-1 s=THROTTLE_DONE pgs=900 cs=0 l=1 rx=0x7fb7e40625b0 tx=0x7fb7d40108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:22.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.925+0000 7fb7db7fe700 1 -- 172.21.15.63:0/2122615880 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+1789 (secure 0 0 0) 0x7fb7d40414c0 con 0x7fb7e405f110 2020-05-18T21:30:22.933 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:22.933 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:22.656914+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:30:22.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.929+0000 7fb7e359e700 1 -- 172.21.15.63:0/2122615880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb7c804f8a0 msgr2=0x7fb7c8051d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:22.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.929+0000 7fb7e359e700 1 --2- 172.21.15.63:0/2122615880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb7c804f8a0 0x7fb7c8051d60 secure :-1 s=READY pgs=363 cs=0 l=1 rx=0x7fb7cc007a80 tx=0x7fb7cc002440).stop 2020-05-18T21:30:22.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.929+0000 7fb7e359e700 1 -- 172.21.15.63:0/2122615880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7e405f110 msgr2=0x7fb7e40b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:22.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.929+0000 7fb7e359e700 1 --2- 172.21.15.63:0/2122615880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7e405f110 0x7fb7e40b3ad0 secure :-1 s=READY pgs=900 cs=0 l=1 rx=0x7fb7e40625b0 tx=0x7fb7d40108c0).stop 2020-05-18T21:30:22.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.929+0000 7fb7e359e700 1 -- 172.21.15.63:0/2122615880 shutdown_connections 2020-05-18T21:30:22.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.929+0000 7fb7e359e700 1 --2- 172.21.15.63:0/2122615880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb7c804f8a0 0x7fb7c8051d60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:22.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.929+0000 7fb7e359e700 1 --2- 172.21.15.63:0/2122615880 >> v2:172.21.15.155:3300/0 conn(0x7fb7e40b4760 0x7fb7e414b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:22.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.929+0000 7fb7e359e700 1 --2- 172.21.15.63:0/2122615880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7e405f110 0x7fb7e40b3ad0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:22.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.929+0000 7fb7e359e700 1 -- 172.21.15.63:0/2122615880 >> 172.21.15.63:0/2122615880 conn(0x7fb7e4069fc0 msgr2=0x7fb7e40b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:22.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.929+0000 7fb7e359e700 1 -- 172.21.15.63:0/2122615880 shutdown_connections 2020-05-18T21:30:22.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:22.929+0000 7fb7e359e700 1 -- 172.21.15.63:0/2122615880 wait complete. 2020-05-18T21:30:22.938 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 45 2020-05-18T21:30:23.154 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:30:08.365002+0000', 'modified': '2020-05-18T21:30:22.656914+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 74, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6834}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6834': {'gid': 6834, 'name': 'a', 'rank': 0, 'incarnation': 43, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.63:6833/2372263796', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 2372263796}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 2372263796}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:30:23.155 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6834:up:rejoin 2020-05-18T21:30:24.156 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:30:24.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48effff700 1 Processor -- start 2020-05-18T21:30:24.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48effff700 1 -- start start 2020-05-18T21:30:24.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48effff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f005f110 0x7f48f00b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:24.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48effff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f48f0064fd0 0x7f48f014d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:24.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48effff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f014a330 con 0x7f48f014aa70 2020-05-18T21:30:24.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48effff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f014a140 con 0x7f48f0064fd0 2020-05-18T21:30:24.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48effff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f0065460 con 0x7f48f005f110 2020-05-18T21:30:24.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48ef7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f48f0064fd0 0x7f48f014d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:24.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48eeffd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f005f110 0x7f48f00b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:24.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48ef7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f48f0064fd0 0x7f48f014d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57440/0 (socket says 172.21.15.63:57440) 2020-05-18T21:30:24.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48ef7fe700 1 -- 172.21.15.63:0/135843816 learned_addr learned my addr 172.21.15.63:0/135843816 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:24.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48ee7fc700 1 --1- 172.21.15.63:0/135843816 >> v1:172.21.15.155:6789/0 conn(0x7f48f014aa70 0x7f48f00648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:57942/0 (socket says 172.21.15.63:57942) 2020-05-18T21:30:24.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48edffb700 1 -- 172.21.15.63:0/135843816 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763749648 0 0) 0x7f48f014a330 con 0x7f48f014aa70 2020-05-18T21:30:24.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48ef7fe700 1 -- 172.21.15.63:0/135843816 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f005f110 msgr2=0x7f48f00b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:24.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48ef7fe700 1 --2- 172.21.15.63:0/135843816 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f005f110 0x7f48f00b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:24.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48ef7fe700 1 -- 172.21.15.63:0/135843816 >> v1:172.21.15.155:6789/0 conn(0x7f48f014aa70 legacy=0x7f48f00648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:24.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48ef7fe700 1 -- 172.21.15.63:0/135843816 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f014a5d0 con 0x7f48f0064fd0 2020-05-18T21:30:24.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48ef7fe700 1 --2- 172.21.15.63:0/135843816 >> v2:172.21.15.63:3300/0 conn(0x7f48f0064fd0 0x7f48f014d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f48f0063c70 tx=0x7f48e0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48ef7fe700 1 --2- 172.21.15.63:0/135843816 >> v2:172.21.15.63:3300/0 conn(0x7f48f0064fd0 0x7f48f014d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f48f0063c70 tx=0x7f48e0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48ef7fe700 1 --2- 172.21.15.63:0/135843816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48f0064fd0 0x7f48f014d710 secure :-1 s=READY pgs=901 cs=0 l=1 rx=0x7f48f0063c70 tx=0x7f48e0008920).ready entity=mon.0 client_cookie=9568420c89f1e1e9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:24.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48ef7fe700 1 --2- 172.21.15.63:0/135843816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48f0064fd0 0x7f48f014d710 secure :-1 s=THROTTLE_DONE pgs=901 cs=0 l=1 rx=0x7f48f0063c70 tx=0x7f48e0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.265+0000 7f48edffb700 1 -- 172.21.15.63:0/135843816 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48e00116b0 con 0x7f48f0064fd0 2020-05-18T21:30:24.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48ef7fe700 1 --2- 172.21.15.63:0/135843816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48f0064fd0 0x7f48f014d710 secure :-1 s=THROTTLE_DONE pgs=901 cs=0 l=1 rx=0x7f48f0063c70 tx=0x7f48e0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48edffb700 1 -- 172.21.15.63:0/135843816 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e0011810 con 0x7f48f0064fd0 2020-05-18T21:30:24.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48effff700 1 -- 172.21.15.63:0/135843816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48f0064fd0 msgr2=0x7f48f014d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:24.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48effff700 1 --2- 172.21.15.63:0/135843816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48f0064fd0 0x7f48f014d710 secure :-1 s=READY pgs=901 cs=0 l=1 rx=0x7f48f0063c70 tx=0x7f48e0008920).stop 2020-05-18T21:30:24.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48effff700 1 -- 172.21.15.63:0/135843816 shutdown_connections 2020-05-18T21:30:24.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48effff700 1 --2- 172.21.15.63:0/135843816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48f0064fd0 0x7f48f014d710 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:24.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48effff700 1 --2- 172.21.15.63:0/135843816 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f005f110 0x7f48f00b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:24.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48effff700 1 -- 172.21.15.63:0/135843816 >> 172.21.15.63:0/135843816 conn(0x7f48f0069fc0 msgr2=0x7f48f006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:24.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48effff700 1 -- 172.21.15.63:0/135843816 shutdown_connections 2020-05-18T21:30:24.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48effff700 1 -- 172.21.15.63:0/135843816 wait complete. 2020-05-18T21:30:24.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48effff700 1 Processor -- start 2020-05-18T21:30:24.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48effff700 1 -- start start 2020-05-18T21:30:24.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48effff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f48f005f110 0x7f48f0139340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:24.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48effff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0064fd0 0x7f48f01397a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:24.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48effff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f48f014aa70 0x7f48f0146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:24.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48effff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f0139c00 con 0x7f48f005f110 2020-05-18T21:30:24.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48effff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f00b6c50 con 0x7f48f014aa70 2020-05-18T21:30:24.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48effff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f00b6ef0 con 0x7f48f0064fd0 2020-05-18T21:30:24.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48eeffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f48f005f110 0x7f48f0139340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:24.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48eeffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f48f005f110 0x7f48f0139340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57442/0 (socket says 172.21.15.63:57442) 2020-05-18T21:30:24.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48eeffd700 1 -- 172.21.15.63:0/1767917810 learned_addr learned my addr 172.21.15.63:0/1767917810 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:24.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48ee7fc700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0064fd0 0x7f48f01397a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:24.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48ef7fe700 1 --2- 172.21.15.63:0/1767917810 >> v2:172.21.15.155:3300/0 conn(0x7f48f014aa70 0x7f48f0146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:24.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.269+0000 7f48eeffd700 1 -- 172.21.15.63:0/1767917810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0064fd0 msgr2=0x7f48f01397a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:24.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48eeffd700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0064fd0 0x7f48f01397a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:24.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48eeffd700 1 -- 172.21.15.63:0/1767917810 >> v2:172.21.15.155:3300/0 conn(0x7f48f014aa70 msgr2=0x7f48f0146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:24.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48eeffd700 1 --2- 172.21.15.63:0/1767917810 >> v2:172.21.15.155:3300/0 conn(0x7f48f014aa70 0x7f48f0146190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:24.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48eeffd700 1 -- 172.21.15.63:0/1767917810 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f00b7190 con 0x7f48f005f110 2020-05-18T21:30:24.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48eeffd700 1 --2- 172.21.15.63:0/1767917810 >> v2:172.21.15.63:3300/0 conn(0x7f48f005f110 0x7f48f0139340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f48e80030b0 tx=0x7f48e8010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48eeffd700 1 --2- 172.21.15.63:0/1767917810 >> v2:172.21.15.63:3300/0 conn(0x7f48f005f110 0x7f48f0139340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f48e80030b0 tx=0x7f48e8010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48eeffd700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48f005f110 0x7f48f0139340 secure :-1 s=READY pgs=902 cs=0 l=1 rx=0x7f48e80030b0 tx=0x7f48e8010cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:24.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48eeffd700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48f005f110 0x7f48f0139340 secure :-1 s=THROTTLE_DONE pgs=902 cs=0 l=1 rx=0x7f48e80030b0 tx=0x7f48e8010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48e7fff700 1 -- 172.21.15.63:0/1767917810 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48e8007180 con 0x7f48f005f110 2020-05-18T21:30:24.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48eeffd700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48f005f110 0x7f48f0139340 secure :-1 s=THROTTLE_DONE pgs=902 cs=0 l=1 rx=0x7f48e80030b0 tx=0x7f48e8010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48eeffd700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48f005f110 0x7f48f0139340 secure :-1 s=THROTTLE_DONE pgs=902 cs=0 l=1 rx=0x7f48e80030b0 tx=0x7f48e8010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48e7fff700 1 -- 172.21.15.63:0/1767917810 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e80072e0 con 0x7f48f005f110 2020-05-18T21:30:24.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48e7fff700 1 -- 172.21.15.63:0/1767917810 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48e8012280 con 0x7f48f005f110 2020-05-18T21:30:24.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48effff700 1 -- 172.21.15.63:0/1767917810 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f00b7430 con 0x7f48f005f110 2020-05-18T21:30:24.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48effff700 1 -- 172.21.15.63:0/1767917810 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f0146810 con 0x7f48f005f110 2020-05-18T21:30:24.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48effff700 1 -- 172.21.15.63:0/1767917810 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f00569e0 con 0x7f48f005f110 2020-05-18T21:30:24.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48eeffd700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48f005f110 0x7f48f0139340 secure :-1 s=THROTTLE_DONE pgs=902 cs=0 l=1 rx=0x7f48e80030b0 tx=0x7f48e8010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48e7fff700 1 -- 172.21.15.63:0/1767917810 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f48e80124f0 con 0x7f48f005f110 2020-05-18T21:30:24.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48eeffd700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48f005f110 0x7f48f0139340 secure :-1 s=THROTTLE_DONE pgs=902 cs=0 l=1 rx=0x7f48e80030b0 tx=0x7f48e8010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48e7fff700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48c804fb10 0x7f48c8051fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:24.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48e7fff700 1 -- 172.21.15.63:0/1767917810 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f48e8064070 con 0x7f48f005f110 2020-05-18T21:30:24.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.273+0000 7f48ee7fc700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48c804fb10 0x7f48c8051fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:24.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.277+0000 7f48ee7fc700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48c804fb10 0x7f48c8051fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f48d8000f40 tx=0x7f48d800ccc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.277+0000 7f48ee7fc700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48c804fb10 0x7f48c8051fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f48d8000f40 tx=0x7f48d800ccc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.277+0000 7f48ee7fc700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48c804fb10 0x7f48c8051fd0 secure :-1 s=READY pgs=364 cs=0 l=1 rx=0x7f48d8000f40 tx=0x7f48d800ccc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:24.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.281+0000 7f48eeffd700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48f005f110 0x7f48f0139340 secure :-1 s=THROTTLE_DONE pgs=902 cs=0 l=1 rx=0x7f48e80030b0 tx=0x7f48e8010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.281+0000 7f48e7fff700 1 -- 172.21.15.63:0/1767917810 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f48e803e3a0 con 0x7f48f005f110 2020-05-18T21:30:24.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.429+0000 7f48effff700 1 -- 172.21.15.63:0/1767917810 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48f006a8c0 con 0x7f48f005f110 2020-05-18T21:30:24.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.433+0000 7f48eeffd700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48f005f110 0x7f48f0139340 secure :-1 s=THROTTLE_DONE pgs=902 cs=0 l=1 rx=0x7f48e80030b0 tx=0x7f48e8010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.433+0000 7f48e7fff700 1 -- 172.21.15.63:0/1767917810 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+1789 (secure 0 0 0) 0x7f48e80419c0 con 0x7f48f005f110 2020-05-18T21:30:24.437 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:24.438 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:30:24.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.433+0000 7f48effff700 1 -- 172.21.15.63:0/1767917810 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48c804fb10 msgr2=0x7f48c8051fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:24.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.433+0000 7f48effff700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48c804fb10 0x7f48c8051fd0 secure :-1 s=READY pgs=364 cs=0 l=1 rx=0x7f48d8000f40 tx=0x7f48d800ccc0).stop 2020-05-18T21:30:24.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.433+0000 7f48effff700 1 -- 172.21.15.63:0/1767917810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48f005f110 msgr2=0x7f48f0139340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:24.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.433+0000 7f48effff700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48f005f110 0x7f48f0139340 secure :-1 s=READY pgs=902 cs=0 l=1 rx=0x7f48e80030b0 tx=0x7f48e8010cd0).stop 2020-05-18T21:30:24.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.433+0000 7f48effff700 1 -- 172.21.15.63:0/1767917810 shutdown_connections 2020-05-18T21:30:24.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.433+0000 7f48effff700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48c804fb10 0x7f48c8051fd0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:24.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.433+0000 7f48effff700 1 --2- 172.21.15.63:0/1767917810 >> v2:172.21.15.155:3300/0 conn(0x7f48f014aa70 0x7f48f0146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:24.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.433+0000 7f48effff700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0064fd0 0x7f48f01397a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:24.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.433+0000 7f48effff700 1 --2- 172.21.15.63:0/1767917810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48f005f110 0x7f48f0139340 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:24.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.433+0000 7f48effff700 1 -- 172.21.15.63:0/1767917810 >> 172.21.15.63:0/1767917810 conn(0x7f48f0069fc0 msgr2=0x7f48f00b51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:24.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.433+0000 7f48effff700 1 -- 172.21.15.63:0/1767917810 shutdown_connections 2020-05-18T21:30:24.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.433+0000 7f48effff700 1 -- 172.21.15.63:0/1767917810 wait complete. 2020-05-18T21:30:24.442 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 46 2020-05-18T21:30:24.652 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:30:08.365002+0000', 'modified': '2020-05-18T21:30:23.668863+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 74, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6834}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6834': {'gid': 6834, 'name': 'a', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.63:6833/2372263796', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 2372263796}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 2372263796}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:30:24.652 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:30:24.653 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:30:24.763 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:30:24.763 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:30:24.764 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:30:24.764 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 6834, 2020-05-18T21:30:24.764 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:30:24.764 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:30:24.764 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 4.1127461429999999, 2020-05-18T21:30:24.765 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 46, 2020-05-18T21:30:24.765 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 75, 2020-05-18T21:30:24.765 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 75, 2020-05-18T21:30:24.765 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 5.0346964710000002 2020-05-18T21:30:24.766 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:30:24.772 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 6834, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.1127461429999999, "mdsmap_epoch": 46, "osdmap_epoch": 75, "osdmap_epoch_barrier": 75, "uptime": 5.0346964710000002 } 2020-05-18T21:30:24.773 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:30:24.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04d4ee0700 1 Processor -- start 2020-05-18T21:30:24.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04d4ee0700 1 -- start start 2020-05-18T21:30:24.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04d4ee0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f04d00b93f0 0x7f04d0145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:24.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04d4ee0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f04d01435a0 0x7f04d0060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:24.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04d4ee0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d00b7020 con 0x7f04d00b7ca0 2020-05-18T21:30:24.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04d4ee0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d00b72c0 con 0x7f04d00b93f0 2020-05-18T21:30:24.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04d4ee0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d00b7560 con 0x7f04d01435a0 2020-05-18T21:30:24.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04ceffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f04d00b7ca0 0x7f04d0142e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59638/0 (socket says 172.21.15.63:59638) 2020-05-18T21:30:24.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04ceffd700 1 -- 172.21.15.63:0/2013831044 learned_addr learned my addr 172.21.15.63:0/2013831044 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:24.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04cf7fe700 1 --2- 172.21.15.63:0/2013831044 >> v2:172.21.15.63:3300/0 conn(0x7f04d00b93f0 0x7f04d0145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:24.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04cffff700 1 --2- 172.21.15.63:0/2013831044 >> v2:172.21.15.155:3300/0 conn(0x7f04d01435a0 0x7f04d0060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:24.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04ce7fc700 1 -- 172.21.15.63:0/2013831044 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229737154 0 0) 0x7f04d00b7020 con 0x7f04d00b7ca0 2020-05-18T21:30:24.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04ce7fc700 1 -- 172.21.15.63:0/2013831044 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04b4003270 con 0x7f04d00b7ca0 2020-05-18T21:30:24.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04ce7fc700 1 -- 172.21.15.63:0/2013831044 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 252643177 0 0) 0x7f04b4003270 con 0x7f04d00b7ca0 2020-05-18T21:30:24.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04ce7fc700 1 -- 172.21.15.63:0/2013831044 >> v2:172.21.15.155:3300/0 conn(0x7f04d01435a0 msgr2=0x7f04d0060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:24.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04ce7fc700 1 --2- 172.21.15.63:0/2013831044 >> v2:172.21.15.155:3300/0 conn(0x7f04d01435a0 0x7f04d0060430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:24.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04ce7fc700 1 -- 172.21.15.63:0/2013831044 >> v2:172.21.15.63:3300/0 conn(0x7f04d00b93f0 msgr2=0x7f04d0145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:24.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04ce7fc700 1 --2- 172.21.15.63:0/2013831044 >> v2:172.21.15.63:3300/0 conn(0x7f04d00b93f0 0x7f04d0145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:24.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04ce7fc700 1 -- 172.21.15.63:0/2013831044 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d00b7800 con 0x7f04d00b7ca0 2020-05-18T21:30:24.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04ce7fc700 1 -- 172.21.15.63:0/2013831044 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f04b8001710 con 0x7f04d00b7ca0 2020-05-18T21:30:24.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04cf7fe700 1 --2- 172.21.15.63:0/2013831044 >> v2:172.21.15.63:3300/0 conn(0x7f04d00b93f0 0x7f04d0145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:30:24.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04ce7fc700 1 -- 172.21.15.63:0/2013831044 >> v1:172.21.15.63:6789/0 conn(0x7f04d00b7ca0 legacy=0x7f04d0142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:24.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04ce7fc700 1 --2- 172.21.15.63:0/2013831044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04b4003760 0x7f04b4003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:24.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04ce7fc700 1 --2- 172.21.15.63:0/2013831044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04b4004510 0x7f04b4004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:24.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04ce7fc700 1 --2- 172.21.15.63:0/2013831044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04b4004df0 0x7f04b400b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:24.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04ce7fc700 1 -- 172.21.15.63:0/2013831044 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00b72c0 con 0x7f04b4003760 2020-05-18T21:30:24.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04ce7fc700 1 -- 172.21.15.63:0/2013831044 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00b7560 con 0x7f04b4004510 2020-05-18T21:30:24.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04ce7fc700 1 -- 172.21.15.63:0/2013831044 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b4004280 con 0x7f04b4004df0 2020-05-18T21:30:24.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04cf7fe700 1 --2- 172.21.15.63:0/2013831044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04b4003760 0x7f04b4003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:24.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04ceffd700 1 --2- 172.21.15.63:0/2013831044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04b4004510 0x7f04b4004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:24.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.877+0000 7f04cffff700 1 --2- 172.21.15.63:0/2013831044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04b4004df0 0x7f04b400b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:24.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04ceffd700 1 -- 172.21.15.63:0/2013831044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04b4004df0 msgr2=0x7f04b400b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:24.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04ceffd700 1 --2- 172.21.15.63:0/2013831044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04b4004df0 0x7f04b400b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:24.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04ceffd700 1 -- 172.21.15.63:0/2013831044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04b4003760 msgr2=0x7f04b4003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:24.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04ceffd700 1 --2- 172.21.15.63:0/2013831044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04b4003760 0x7f04b4003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:24.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04ceffd700 1 -- 172.21.15.63:0/2013831044 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b4003270 con 0x7f04b4004510 2020-05-18T21:30:24.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04cffff700 1 --2- 172.21.15.63:0/2013831044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04b4004df0 0x7f04b400b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:30:24.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04ceffd700 1 --2- 172.21.15.63:0/2013831044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04b4004510 0x7f04b4004990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f04b40054e0 tx=0x7f04b800c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04cffff700 1 -- 172.21.15.63:0/2013831044 reap_dead start 2020-05-18T21:30:24.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04ceffd700 1 --2- 172.21.15.63:0/2013831044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04b4004510 0x7f04b4004990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f04b40054e0 tx=0x7f04b800c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04ceffd700 1 --2- 172.21.15.63:0/2013831044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04b4004510 0x7f04b4004990 secure :-1 s=READY pgs=649 cs=0 l=1 rx=0x7f04b40054e0 tx=0x7f04b800c380).ready entity=mon.1 client_cookie=3e443ca6eac3c071 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:24.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04ceffd700 1 --2- 172.21.15.63:0/2013831044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04b4004510 0x7f04b4004990 secure :-1 s=THROTTLE_DONE pgs=649 cs=0 l=1 rx=0x7f04b40054e0 tx=0x7f04b800c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04ce7fc700 1 -- 172.21.15.63:0/2013831044 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04b800e370 con 0x7f04b4004510 2020-05-18T21:30:24.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04ceffd700 1 --2- 172.21.15.63:0/2013831044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04b4004510 0x7f04b4004990 secure :-1 s=THROTTLE_DONE pgs=649 cs=0 l=1 rx=0x7f04b40054e0 tx=0x7f04b800c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04ceffd700 1 --2- 172.21.15.63:0/2013831044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04b4004510 0x7f04b4004990 secure :-1 s=THROTTLE_DONE pgs=649 cs=0 l=1 rx=0x7f04b40054e0 tx=0x7f04b800c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04ce7fc700 1 -- 172.21.15.63:0/2013831044 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b800e4d0 con 0x7f04b4004510 2020-05-18T21:30:24.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04ce7fc700 1 -- 172.21.15.63:0/2013831044 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04b80100c0 con 0x7f04b4004510 2020-05-18T21:30:24.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04d4ee0700 1 -- 172.21.15.63:0/2013831044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04b4004510 msgr2=0x7f04b4004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:24.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04d4ee0700 1 --2- 172.21.15.63:0/2013831044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04b4004510 0x7f04b4004990 secure :-1 s=READY pgs=649 cs=0 l=1 rx=0x7f04b40054e0 tx=0x7f04b800c380).stop 2020-05-18T21:30:24.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04d4ee0700 1 -- 172.21.15.63:0/2013831044 shutdown_connections 2020-05-18T21:30:24.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04d4ee0700 1 --2- 172.21.15.63:0/2013831044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04b4004510 0x7f04b4004990 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:24.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04d4ee0700 1 -- 172.21.15.63:0/2013831044 >> 172.21.15.63:0/2013831044 conn(0x7f04d0069b70 msgr2=0x7f04d0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:24.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04d4ee0700 1 -- 172.21.15.63:0/2013831044 shutdown_connections 2020-05-18T21:30:24.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04d4ee0700 1 -- 172.21.15.63:0/2013831044 wait complete. 2020-05-18T21:30:24.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04d4ee0700 1 Processor -- start 2020-05-18T21:30:24.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.881+0000 7f04d4ee0700 1 -- start start 2020-05-18T21:30:24.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04d4ee0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04d01576c0 0x7f04d014a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:24.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04d4ee0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d014a760 con 0x7f04b4004510 2020-05-18T21:30:24.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04d4ee0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d01498f0 con 0x7f04d014a2d0 2020-05-18T21:30:24.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04d4ee0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d0149b90 con 0x7f04d01576c0 2020-05-18T21:30:24.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04cf7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f04b4004510 0x7f04d00bcd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59650/0 (socket says 172.21.15.63:59650) 2020-05-18T21:30:24.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04cf7fe700 1 -- 172.21.15.63:0/1849434674 learned_addr learned my addr 172.21.15.63:0/1849434674 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:24.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04cffff700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04d01576c0 0x7f04d014a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:24.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409309368 0 0) 0x7f04d014a760 con 0x7f04b4004510 2020-05-18T21:30:24.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04a8002fe0 con 0x7f04b4004510 2020-05-18T21:30:24.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198436850 0 0) 0x7f04d01498f0 con 0x7f04d014a2d0 2020-05-18T21:30:24.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04d014a760 con 0x7f04d014a2d0 2020-05-18T21:30:24.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2996216224 0 0) 0x7f04a8002fe0 con 0x7f04b4004510 2020-05-18T21:30:24.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f04d01498f0 con 0x7f04b4004510 2020-05-18T21:30:24.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f04c00014d0 con 0x7f04b4004510 2020-05-18T21:30:24.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04d01576c0 msgr2=0x7f04d014a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:24.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04d01576c0 0x7f04d014a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:24.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 >> v1:172.21.15.155:6789/0 conn(0x7f04d014a2d0 legacy=0x7f04d013d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:24.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 >> v1:172.21.15.63:6789/0 conn(0x7f04b4004510 legacy=0x7f04d00bcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:24.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a8004bf0 0x7f04a8004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:24.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04d01576c0 0x7f04a8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:24.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04a8003f90 0x7f04a8004410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:24.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d0149b90 con 0x7f04a8003f90 2020-05-18T21:30:24.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a8004870 con 0x7f04a8004bf0 2020-05-18T21:30:24.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a800b760 con 0x7f04d01576c0 2020-05-18T21:30:24.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04cffff700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04a8003f90 0x7f04a8004410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:24.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ceffd700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04d01576c0 0x7f04a8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:24.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04cf7fe700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a8004bf0 0x7f04a8004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:24.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04cffff700 1 -- 172.21.15.63:0/1849434674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04d01576c0 msgr2=0x7f04a8003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:24.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04cffff700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04d01576c0 0x7f04a8003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:24.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04cffff700 1 -- 172.21.15.63:0/1849434674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a8004bf0 msgr2=0x7f04a8004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:24.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04cffff700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a8004bf0 0x7f04a8004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:24.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04cffff700 1 -- 172.21.15.63:0/1849434674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d0149e30 con 0x7f04a8003f90 2020-05-18T21:30:24.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04d4ee0700 1 -- 172.21.15.63:0/1849434674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d0157b50 con 0x7f04a8003f90 2020-05-18T21:30:24.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04cffff700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04a8003f90 0x7f04a8004410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f04b8001110 tx=0x7f04c80112b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04d4ee0700 1 -- 172.21.15.63:0/1849434674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d013dff0 con 0x7f04a8003f90 2020-05-18T21:30:24.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04cffff700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04a8003f90 0x7f04a8004410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f04b8001110 tx=0x7f04c80112b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04cffff700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04a8003f90 0x7f04a8004410 secure :-1 s=READY pgs=905 cs=0 l=1 rx=0x7f04b8001110 tx=0x7f04c80112b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:24.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04cffff700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04a8003f90 0x7f04a8004410 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7f04b8001110 tx=0x7f04c80112b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04cffff700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04a8003f90 0x7f04a8004410 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7f04b8001110 tx=0x7f04c80112b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04cffff700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04a8003f90 0x7f04a8004410 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7f04b8001110 tx=0x7f04c80112b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04c8005a80 con 0x7f04a8003f90 2020-05-18T21:30:24.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c8005be0 con 0x7f04a8003f90 2020-05-18T21:30:24.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04c80089a0 con 0x7f04a8003f90 2020-05-18T21:30:24.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.885+0000 7f04d4ee0700 1 -- 172.21.15.63:0/1849434674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04ac003380 con 0x7f04a8003f90 2020-05-18T21:30:24.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.889+0000 7f04cffff700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04a8003f90 0x7f04a8004410 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7f04b8001110 tx=0x7f04c80112b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.889+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f04c8008b00 con 0x7f04a8003f90 2020-05-18T21:30:24.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.889+0000 7f04cffff700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04a8003f90 0x7f04a8004410 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7f04b8001110 tx=0x7f04c80112b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.889+0000 7f04ccff9700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f04a8057e10 0x7f04a805a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:24.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.889+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f04c8063d70 con 0x7f04a8003f90 2020-05-18T21:30:24.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.889+0000 7f04cf7fe700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f04a8057e10 0x7f04a805a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:24.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.889+0000 7f04cf7fe700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f04a8057e10 0x7f04a805a2d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f04c0002f70 tx=0x7f04c0001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.889+0000 7f04cf7fe700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f04a8057e10 0x7f04a805a2d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f04c0002f70 tx=0x7f04c0001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.889+0000 7f04cf7fe700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f04a8057e10 0x7f04a805a2d0 secure :-1 s=READY pgs=366 cs=0 l=1 rx=0x7f04c0002f70 tx=0x7f04c0001700).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:24.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.893+0000 7f04cffff700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04a8003f90 0x7f04a8004410 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7f04b8001110 tx=0x7f04c80112b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:24.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:24.893+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f04c803e160 con 0x7f04a8003f90 2020-05-18T21:30:25.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.013+0000 7f04d4ee0700 1 -- 172.21.15.63:0/1849434674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04ac002210 con 0x7f04a8003f90 2020-05-18T21:30:25.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.013+0000 7f04cffff700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04a8003f90 0x7f04a8004410 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7f04b8001110 tx=0x7f04c80112b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.013+0000 7f04ccff9700 1 -- 172.21.15.63:0/1849434674 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16221 (secure 0 0 0) 0x7f04c8041780 con 0x7f04a8003f90 2020-05-18T21:30:25.020 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:25.020 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":75,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:30:19.282601+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:30:06.278977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2020-05-18T21:30:07.362909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.155:6835/802454809":"2020-05-19T21:30:19.236593+0000","172.21.15.155:6834/802454809":"2020-05-19T21:30:19.236593+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:30:25.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.017+0000 7f04d4ee0700 1 -- 172.21.15.63:0/1849434674 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f04a8057e10 msgr2=0x7f04a805a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.017+0000 7f04d4ee0700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f04a8057e10 0x7f04a805a2d0 secure :-1 s=READY pgs=366 cs=0 l=1 rx=0x7f04c0002f70 tx=0x7f04c0001700).stop 2020-05-18T21:30:25.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.017+0000 7f04d4ee0700 1 -- 172.21.15.63:0/1849434674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04a8003f90 msgr2=0x7f04a8004410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.017+0000 7f04d4ee0700 1 --2- 172.21.15.63:0/1849434674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04a8003f90 0x7f04a8004410 secure :-1 s=READY pgs=905 cs=0 l=1 rx=0x7f04b8001110 tx=0x7f04c80112b0).stop 2020-05-18T21:30:25.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.017+0000 7f04cffff700 1 -- 172.21.15.63:0/1849434674 reap_dead start 2020-05-18T21:30:25.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.017+0000 7f04cffff700 1 -- 172.21.15.63:0/1849434674 reap_dead start 2020-05-18T21:30:25.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.017+0000 7f04d4ee0700 1 -- 172.21.15.63:0/1849434674 shutdown_connections 2020-05-18T21:30:25.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.017+0000 7f04d4ee0700 1 -- 172.21.15.63:0/1849434674 >> 172.21.15.63:0/1849434674 conn(0x7f04d0069b70 msgr2=0x7f04d0060da0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:25.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.017+0000 7f04d4ee0700 1 -- 172.21.15.63:0/1849434674 shutdown_connections 2020-05-18T21:30:25.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.017+0000 7f04d4ee0700 1 -- 172.21.15.63:0/1849434674 wait complete. 2020-05-18T21:30:25.033 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:30:06.278977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:30:07.362909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:30:25.034 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:30:25.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cda25d700 1 Processor -- start 2020-05-18T21:30:25.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cda25d700 1 -- start start 2020-05-18T21:30:25.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cda25d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cd40b6d70 0x7f1cd4145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:25.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cda25d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd4143810 con 0x7f1cd40b7bf0 2020-05-18T21:30:25.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cda25d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd40b7210 con 0x7f1cd4143430 2020-05-18T21:30:25.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cda25d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd40b74b0 con 0x7f1cd40b6d70 2020-05-18T21:30:25.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd3fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1cd40b7bf0 0x7f1cd40b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59668/0 (socket says 172.21.15.63:59668) 2020-05-18T21:30:25.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd3fff700 1 -- 172.21.15.63:0/4195383751 learned_addr learned my addr 172.21.15.63:0/4195383751 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:25.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1ccaffd700 1 --2- 172.21.15.63:0/4195383751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cd40b6d70 0x7f1cd4145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd2ffd700 1 -- 172.21.15.63:0/4195383751 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036813780 0 0) 0x7f1cd4143810 con 0x7f1cd40b7bf0 2020-05-18T21:30:25.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd2ffd700 1 -- 172.21.15.63:0/4195383751 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cb4003270 con 0x7f1cd40b7bf0 2020-05-18T21:30:25.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd2ffd700 1 -- 172.21.15.63:0/4195383751 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307154626 0 0) 0x7f1cd40b7210 con 0x7f1cd4143430 2020-05-18T21:30:25.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd2ffd700 1 -- 172.21.15.63:0/4195383751 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cd4143810 con 0x7f1cd4143430 2020-05-18T21:30:25.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd2ffd700 1 -- 172.21.15.63:0/4195383751 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4153857656 0 0) 0x7f1cb4003270 con 0x7f1cd40b7bf0 2020-05-18T21:30:25.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd2ffd700 1 -- 172.21.15.63:0/4195383751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cd40b6d70 msgr2=0x7f1cd4145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:25.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd2ffd700 1 --2- 172.21.15.63:0/4195383751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cd40b6d70 0x7f1cd4145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:25.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd2ffd700 1 -- 172.21.15.63:0/4195383751 >> v1:172.21.15.155:6789/0 conn(0x7f1cd4143430 legacy=0x7f1cd40b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd2ffd700 1 -- 172.21.15.63:0/4195383751 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd40b7750 con 0x7f1cd40b7bf0 2020-05-18T21:30:25.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd2ffd700 1 -- 172.21.15.63:0/4195383751 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f1ccc001a90 con 0x7f1cd40b7bf0 2020-05-18T21:30:25.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd2ffd700 1 -- 172.21.15.63:0/4195383751 >> v1:172.21.15.63:6789/0 conn(0x7f1cd40b7bf0 legacy=0x7f1cd40b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd2ffd700 1 --2- 172.21.15.63:0/4195383751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cd40b6d70 0x7f1cb4003920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:25.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd2ffd700 1 --2- 172.21.15.63:0/4195383751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cb4003d80 0x7f1cb4004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:25.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd2ffd700 1 --2- 172.21.15.63:0/4195383751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cb4004970 0x7f1cb4004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:25.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd2ffd700 1 -- 172.21.15.63:0/4195383751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd40b74b0 con 0x7f1cb4004970 2020-05-18T21:30:25.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd2ffd700 1 -- 172.21.15.63:0/4195383751 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb4005250 con 0x7f1cb4003d80 2020-05-18T21:30:25.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd2ffd700 1 -- 172.21.15.63:0/4195383751 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb400b760 con 0x7f1cd40b6d70 2020-05-18T21:30:25.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd3fff700 1 --2- 172.21.15.63:0/4195383751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cb4004970 0x7f1cb4004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1cd37fe700 1 --2- 172.21.15.63:0/4195383751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cd40b6d70 0x7f1cb4003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.141+0000 7f1ccaffd700 1 --2- 172.21.15.63:0/4195383751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cb4003d80 0x7f1cb4004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cd3fff700 1 -- 172.21.15.63:0/4195383751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cd40b6d70 msgr2=0x7f1cb4003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:25.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cd3fff700 1 --2- 172.21.15.63:0/4195383751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cd40b6d70 0x7f1cb4003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:25.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cd3fff700 1 -- 172.21.15.63:0/4195383751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cb4003d80 msgr2=0x7f1cb4004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:25.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cd3fff700 1 --2- 172.21.15.63:0/4195383751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cb4003d80 0x7f1cb4004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:25.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cd3fff700 1 -- 172.21.15.63:0/4195383751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb4003270 con 0x7f1cb4004970 2020-05-18T21:30:25.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cd37fe700 1 --2- 172.21.15.63:0/4195383751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cd40b6d70 0x7f1cb4003920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:30:25.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cd3fff700 1 --2- 172.21.15.63:0/4195383751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cb4004970 0x7f1cb4004df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1ccc001860 tx=0x7f1cd40605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cd3fff700 1 --2- 172.21.15.63:0/4195383751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cb4004970 0x7f1cb4004df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1ccc001860 tx=0x7f1cd40605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cd3fff700 1 --2- 172.21.15.63:0/4195383751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cb4004970 0x7f1cb4004df0 secure :-1 s=READY pgs=907 cs=0 l=1 rx=0x7f1ccc001860 tx=0x7f1cd40605c0).ready entity=mon.0 client_cookie=2df16cdcd27f414f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:25.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cd3fff700 1 --2- 172.21.15.63:0/4195383751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cb4004970 0x7f1cb4004df0 secure :-1 s=THROTTLE_DONE pgs=907 cs=0 l=1 rx=0x7f1ccc001860 tx=0x7f1cd40605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cd3fff700 1 --2- 172.21.15.63:0/4195383751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cb4004970 0x7f1cb4004df0 secure :-1 s=THROTTLE_DONE pgs=907 cs=0 l=1 rx=0x7f1ccc001860 tx=0x7f1cd40605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cd2ffd700 1 -- 172.21.15.63:0/4195383751 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ccc00e560 con 0x7f1cb4004970 2020-05-18T21:30:25.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cd3fff700 1 --2- 172.21.15.63:0/4195383751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cb4004970 0x7f1cb4004df0 secure :-1 s=THROTTLE_DONE pgs=907 cs=0 l=1 rx=0x7f1ccc001860 tx=0x7f1cd40605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cd2ffd700 1 -- 172.21.15.63:0/4195383751 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ccc00e6c0 con 0x7f1cb4004970 2020-05-18T21:30:25.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cd2ffd700 1 -- 172.21.15.63:0/4195383751 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ccc0100c0 con 0x7f1cb4004970 2020-05-18T21:30:25.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cda25d700 1 -- 172.21.15.63:0/4195383751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cb4004970 msgr2=0x7f1cb4004df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cda25d700 1 --2- 172.21.15.63:0/4195383751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cb4004970 0x7f1cb4004df0 secure :-1 s=READY pgs=907 cs=0 l=1 rx=0x7f1ccc001860 tx=0x7f1cd40605c0).stop 2020-05-18T21:30:25.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cd3fff700 1 -- 172.21.15.63:0/4195383751 reap_dead start 2020-05-18T21:30:25.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cda25d700 1 -- 172.21.15.63:0/4195383751 shutdown_connections 2020-05-18T21:30:25.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cda25d700 1 -- 172.21.15.63:0/4195383751 >> 172.21.15.63:0/4195383751 conn(0x7f1cd4069b70 msgr2=0x7f1cd4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:25.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cda25d700 1 -- 172.21.15.63:0/4195383751 shutdown_connections 2020-05-18T21:30:25.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cda25d700 1 -- 172.21.15.63:0/4195383751 wait complete. 2020-05-18T21:30:25.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cda25d700 1 Processor -- start 2020-05-18T21:30:25.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.145+0000 7f1cda25d700 1 -- start start 2020-05-18T21:30:25.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1cda25d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1cd4144cb0 0x7f1cd41482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:25.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1cda25d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1cd4146a80 0x7f1cd4153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:25.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1cda25d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd4140540 con 0x7f1cd413e280 2020-05-18T21:30:25.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1cda25d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd4153a60 con 0x7f1cd4146a80 2020-05-18T21:30:25.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1cda25d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd4140770 con 0x7f1cd4144cb0 2020-05-18T21:30:25.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1ccaffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1cd4146a80 0x7f1cd4153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1cd3fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1cd413e280 0x7f1cd413e6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59678/0 (socket says 172.21.15.63:59678) 2020-05-18T21:30:25.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1cd37fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1cd4144cb0 0x7f1cd41482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1cd3fff700 1 -- 172.21.15.63:0/2241402614 learned_addr learned my addr 172.21.15.63:0/2241402614 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:25.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1ccaffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1cd4146a80 0x7f1cd4153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57492/0 (socket says 172.21.15.63:57492) 2020-05-18T21:30:25.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1cd17fa700 1 -- 172.21.15.63:0/2241402614 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221835853 0 0) 0x7f1cd4140540 con 0x7f1cd413e280 2020-05-18T21:30:25.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1ccaffd700 1 -- 172.21.15.63:0/2241402614 >> v2:172.21.15.155:3300/0 conn(0x7f1cd4144cb0 msgr2=0x7f1cd41482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1ccaffd700 1 --2- 172.21.15.63:0/2241402614 >> v2:172.21.15.155:3300/0 conn(0x7f1cd4144cb0 0x7f1cd41482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1ccaffd700 1 -- 172.21.15.63:0/2241402614 >> v1:172.21.15.63:6789/0 conn(0x7f1cd413e280 legacy=0x7f1cd413e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1ccaffd700 1 -- 172.21.15.63:0/2241402614 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd4145090 con 0x7f1cd4146a80 2020-05-18T21:30:25.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1ccaffd700 1 --2- 172.21.15.63:0/2241402614 >> v2:172.21.15.63:3300/0 conn(0x7f1cd4146a80 0x7f1cd4153600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1cbc002f70 tx=0x7f1cd405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1ccaffd700 1 --2- 172.21.15.63:0/2241402614 >> v2:172.21.15.63:3300/0 conn(0x7f1cd4146a80 0x7f1cd4153600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1cbc002f70 tx=0x7f1cd405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1ccaffd700 1 --2- 172.21.15.63:0/2241402614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4146a80 0x7f1cd4153600 secure :-1 s=READY pgs=909 cs=0 l=1 rx=0x7f1cbc002f70 tx=0x7f1cd405ab60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:25.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1ccaffd700 1 --2- 172.21.15.63:0/2241402614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4146a80 0x7f1cd4153600 secure :-1 s=THROTTLE_DONE pgs=909 cs=0 l=1 rx=0x7f1cbc002f70 tx=0x7f1cd405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1cd17fa700 1 -- 172.21.15.63:0/2241402614 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cbc005de0 con 0x7f1cd4146a80 2020-05-18T21:30:25.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1ccaffd700 1 --2- 172.21.15.63:0/2241402614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4146a80 0x7f1cd4153600 secure :-1 s=THROTTLE_DONE pgs=909 cs=0 l=1 rx=0x7f1cbc002f70 tx=0x7f1cd405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1ccaffd700 1 --2- 172.21.15.63:0/2241402614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4146a80 0x7f1cd4153600 secure :-1 s=THROTTLE_DONE pgs=909 cs=0 l=1 rx=0x7f1cbc002f70 tx=0x7f1cd405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1cd17fa700 1 -- 172.21.15.63:0/2241402614 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc007180 con 0x7f1cd4146a80 2020-05-18T21:30:25.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1cda25d700 1 -- 172.21.15.63:0/2241402614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd41499a0 con 0x7f1cd4146a80 2020-05-18T21:30:25.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1cd17fa700 1 -- 172.21.15.63:0/2241402614 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cbc0074e0 con 0x7f1cd4146a80 2020-05-18T21:30:25.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1cda25d700 1 -- 172.21.15.63:0/2241402614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd4156df0 con 0x7f1cd4146a80 2020-05-18T21:30:25.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1ccaffd700 1 --2- 172.21.15.63:0/2241402614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4146a80 0x7f1cd4153600 secure :-1 s=THROTTLE_DONE pgs=909 cs=0 l=1 rx=0x7f1cbc002f70 tx=0x7f1cd405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.149+0000 7f1cda25d700 1 -- 172.21.15.63:0/2241402614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd40569e0 con 0x7f1cd4146a80 2020-05-18T21:30:25.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.153+0000 7f1cd17fa700 1 -- 172.21.15.63:0/2241402614 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1cbc008460 con 0x7f1cd4146a80 2020-05-18T21:30:25.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.153+0000 7f1ccaffd700 1 --2- 172.21.15.63:0/2241402614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4146a80 0x7f1cd4153600 secure :-1 s=THROTTLE_DONE pgs=909 cs=0 l=1 rx=0x7f1cbc002f70 tx=0x7f1cd405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.153+0000 7f1cd17fa700 1 --2- 172.21.15.63:0/2241402614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cb804f850 0x7f1cb8051d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:25.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.153+0000 7f1cd17fa700 1 -- 172.21.15.63:0/2241402614 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1cbc063ae0 con 0x7f1cd4146a80 2020-05-18T21:30:25.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.153+0000 7f1cd37fe700 1 --2- 172.21.15.63:0/2241402614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cb804f850 0x7f1cb8051d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.153+0000 7f1cd37fe700 1 --2- 172.21.15.63:0/2241402614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cb804f850 0x7f1cb8051d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1cc4001110 tx=0x7f1cc400ed70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.153+0000 7f1cd37fe700 1 --2- 172.21.15.63:0/2241402614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cb804f850 0x7f1cb8051d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1cc4001110 tx=0x7f1cc400ed70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.153+0000 7f1cd37fe700 1 --2- 172.21.15.63:0/2241402614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cb804f850 0x7f1cb8051d10 secure :-1 s=READY pgs=367 cs=0 l=1 rx=0x7f1cc4001110 tx=0x7f1cc400ed70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:25.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.157+0000 7f1ccaffd700 1 --2- 172.21.15.63:0/2241402614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4146a80 0x7f1cd4153600 secure :-1 s=THROTTLE_DONE pgs=909 cs=0 l=1 rx=0x7f1cbc002f70 tx=0x7f1cd405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.157+0000 7f1cd17fa700 1 -- 172.21.15.63:0/2241402614 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f1cbc03de10 con 0x7f1cd4146a80 2020-05-18T21:30:25.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.277+0000 7f1cda25d700 1 -- 172.21.15.63:0/2241402614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1cd40b87b0 con 0x7f1cd4146a80 2020-05-18T21:30:25.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.277+0000 7f1ccaffd700 1 --2- 172.21.15.63:0/2241402614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4146a80 0x7f1cd4153600 secure :-1 s=THROTTLE_DONE pgs=909 cs=0 l=1 rx=0x7f1cbc002f70 tx=0x7f1cd405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.277+0000 7f1cd17fa700 1 -- 172.21.15.63:0/2241402614 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v75) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1cbc041430 con 0x7f1cd4146a80 2020-05-18T21:30:25.283 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:30:25.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.277+0000 7f1cda25d700 1 -- 172.21.15.63:0/2241402614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cb804f850 msgr2=0x7f1cb8051d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.277+0000 7f1cda25d700 1 --2- 172.21.15.63:0/2241402614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cb804f850 0x7f1cb8051d10 secure :-1 s=READY pgs=367 cs=0 l=1 rx=0x7f1cc4001110 tx=0x7f1cc400ed70).stop 2020-05-18T21:30:25.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.281+0000 7f1cda25d700 1 -- 172.21.15.63:0/2241402614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4146a80 msgr2=0x7f1cd4153600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.281+0000 7f1cda25d700 1 --2- 172.21.15.63:0/2241402614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4146a80 0x7f1cd4153600 secure :-1 s=READY pgs=909 cs=0 l=1 rx=0x7f1cbc002f70 tx=0x7f1cd405ab60).stop 2020-05-18T21:30:25.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.281+0000 7f1cda25d700 1 -- 172.21.15.63:0/2241402614 shutdown_connections 2020-05-18T21:30:25.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.281+0000 7f1cda25d700 1 --2- 172.21.15.63:0/2241402614 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cb804f850 0x7f1cb8051d10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.281+0000 7f1cda25d700 1 --2- 172.21.15.63:0/2241402614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4146a80 0x7f1cd4153600 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.281+0000 7f1cda25d700 1 --2- 172.21.15.63:0/2241402614 >> v2:172.21.15.155:3300/0 conn(0x7f1cd4144cb0 0x7f1cd41482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.281+0000 7f1cda25d700 1 -- 172.21.15.63:0/2241402614 >> 172.21.15.63:0/2241402614 conn(0x7f1cd4069b70 msgr2=0x7f1cd4061070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:25.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.281+0000 7f1cda25d700 1 -- 172.21.15.63:0/2241402614 shutdown_connections 2020-05-18T21:30:25.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.281+0000 7f1cda25d700 1 -- 172.21.15.63:0/2241402614 wait complete. 2020-05-18T21:30:25.295 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:30:25.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.397+0000 7f637759e700 1 Processor -- start 2020-05-18T21:30:25.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.397+0000 7f637759e700 1 -- start start 2020-05-18T21:30:25.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f637806a630 0x7f63780adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:25.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f63780b4450 0x7f63780b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:25.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63780b3790 con 0x7f6378149d50 2020-05-18T21:30:25.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637759e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63780b39f0 con 0x7f63780b4450 2020-05-18T21:30:25.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63780b3c90 con 0x7f637806a630 2020-05-18T21:30:25.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637659c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6378149d50 0x7f63780ad3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59684/0 (socket says 172.21.15.63:59684) 2020-05-18T21:30:25.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637659c700 1 -- 172.21.15.63:0/2892224547 learned_addr learned my addr 172.21.15.63:0/2892224547 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:25.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f6376d9d700 1 --2- 172.21.15.63:0/2892224547 >> v2:172.21.15.63:3300/0 conn(0x7f63780b4450 0x7f63780b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f6375d9b700 1 --2- 172.21.15.63:0/2892224547 >> v2:172.21.15.155:3300/0 conn(0x7f637806a630 0x7f63780adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637559a700 1 -- 172.21.15.63:0/2892224547 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120360230 0 0) 0x7f63780b3790 con 0x7f6378149d50 2020-05-18T21:30:25.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637559a700 1 -- 172.21.15.63:0/2892224547 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6358003270 con 0x7f6378149d50 2020-05-18T21:30:25.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f6376d9d700 1 -- 172.21.15.63:0/2892224547 >> v2:172.21.15.155:3300/0 conn(0x7f637806a630 msgr2=0x7f63780adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:25.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f6376d9d700 1 --2- 172.21.15.63:0/2892224547 >> v2:172.21.15.155:3300/0 conn(0x7f637806a630 0x7f63780adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:25.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f6376d9d700 1 -- 172.21.15.63:0/2892224547 >> v1:172.21.15.63:6789/0 conn(0x7f6378149d50 legacy=0x7f63780ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637559a700 1 -- 172.21.15.63:0/2892224547 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3711501134 0 0) 0x7f6358003270 con 0x7f6378149d50 2020-05-18T21:30:25.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f6376d9d700 1 -- 172.21.15.63:0/2892224547 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63780adf60 con 0x7f63780b4450 2020-05-18T21:30:25.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f6375d9b700 1 --2- 172.21.15.63:0/2892224547 >> v2:172.21.15.155:3300/0 conn(0x7f637806a630 0x7f63780adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:30:25.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f6376d9d700 1 --2- 172.21.15.63:0/2892224547 >> v2:172.21.15.63:3300/0 conn(0x7f63780b4450 0x7f63780b4900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6370002f70 tx=0x7f6370007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f6376d9d700 1 --2- 172.21.15.63:0/2892224547 >> v2:172.21.15.63:3300/0 conn(0x7f63780b4450 0x7f63780b4900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6370002f70 tx=0x7f6370007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f6376d9d700 1 --2- 172.21.15.63:0/2892224547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63780b4450 0x7f63780b4900 secure :-1 s=READY pgs=911 cs=0 l=1 rx=0x7f6370002f70 tx=0x7f6370007a80).ready entity=mon.0 client_cookie=d45246a9f9f4d56b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:25.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f6376d9d700 1 --2- 172.21.15.63:0/2892224547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63780b4450 0x7f63780b4900 secure :-1 s=THROTTLE_DONE pgs=911 cs=0 l=1 rx=0x7f6370002f70 tx=0x7f6370007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f6376d9d700 1 --2- 172.21.15.63:0/2892224547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63780b4450 0x7f63780b4900 secure :-1 s=THROTTLE_DONE pgs=911 cs=0 l=1 rx=0x7f6370002f70 tx=0x7f6370007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637559a700 1 -- 172.21.15.63:0/2892224547 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6370008d40 con 0x7f63780b4450 2020-05-18T21:30:25.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f6376d9d700 1 --2- 172.21.15.63:0/2892224547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63780b4450 0x7f63780b4900 secure :-1 s=THROTTLE_DONE pgs=911 cs=0 l=1 rx=0x7f6370002f70 tx=0x7f6370007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637559a700 1 -- 172.21.15.63:0/2892224547 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63700116e0 con 0x7f63780b4450 2020-05-18T21:30:25.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637559a700 1 -- 172.21.15.63:0/2892224547 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6370008ea0 con 0x7f63780b4450 2020-05-18T21:30:25.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637759e700 1 -- 172.21.15.63:0/2892224547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63780b4450 msgr2=0x7f63780b4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637759e700 1 --2- 172.21.15.63:0/2892224547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63780b4450 0x7f63780b4900 secure :-1 s=READY pgs=911 cs=0 l=1 rx=0x7f6370002f70 tx=0x7f6370007a80).stop 2020-05-18T21:30:25.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637759e700 1 -- 172.21.15.63:0/2892224547 shutdown_connections 2020-05-18T21:30:25.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637759e700 1 --2- 172.21.15.63:0/2892224547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63780b4450 0x7f63780b4900 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637759e700 1 --2- 172.21.15.63:0/2892224547 >> v2:172.21.15.155:3300/0 conn(0x7f637806a630 0x7f63780adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:25.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637759e700 1 -- 172.21.15.63:0/2892224547 >> 172.21.15.63:0/2892224547 conn(0x7f637805fb90 msgr2=0x7f6378069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:25.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637759e700 1 -- 172.21.15.63:0/2892224547 shutdown_connections 2020-05-18T21:30:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.401+0000 7f637759e700 1 -- 172.21.15.63:0/2892224547 wait complete. 2020-05-18T21:30:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f637759e700 1 Processor -- start 2020-05-18T21:30:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f637759e700 1 -- start start 2020-05-18T21:30:25.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f637759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f637806a630 0x7f6378146820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:25.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f637759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f63780b4450 0x7f63780b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:25.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f637759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63780627a0 con 0x7f6378149d50 2020-05-18T21:30:25.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f637759e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63780b16b0 con 0x7f63780b4450 2020-05-18T21:30:25.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f637759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6378157c30 con 0x7f637806a630 2020-05-18T21:30:25.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f6375d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f63780b4450 0x7f63780b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f6375d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f63780b4450 0x7f63780b11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57504/0 (socket says 172.21.15.63:57504) 2020-05-18T21:30:25.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f6375d9b700 1 -- 172.21.15.63:0/3604759916 learned_addr learned my addr 172.21.15.63:0/3604759916 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:25.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f637659c700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f637806a630 0x7f6378146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f6375d9b700 1 -- 172.21.15.63:0/3604759916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f637806a630 msgr2=0x7f6378146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f6375d9b700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f637806a630 0x7f6378146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f6375d9b700 1 -- 172.21.15.63:0/3604759916 >> v1:172.21.15.155:6789/0 conn(0x7f6378149d50 legacy=0x7f63781580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f6375d9b700 1 -- 172.21.15.63:0/3604759916 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63781587e0 con 0x7f63780b4450 2020-05-18T21:30:25.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f6375d9b700 1 --2- 172.21.15.63:0/3604759916 >> v2:172.21.15.63:3300/0 conn(0x7f63780b4450 0x7f63780b11c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f63600032b0 tx=0x7f6360011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f6375d9b700 1 --2- 172.21.15.63:0/3604759916 >> v2:172.21.15.63:3300/0 conn(0x7f63780b4450 0x7f63780b11c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f63600032b0 tx=0x7f6360011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f6375d9b700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63780b4450 0x7f63780b11c0 secure :-1 s=READY pgs=912 cs=0 l=1 rx=0x7f63600032b0 tx=0x7f6360011320).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:25.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f6375d9b700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63780b4450 0x7f63780b11c0 secure :-1 s=THROTTLE_DONE pgs=912 cs=0 l=1 rx=0x7f63600032b0 tx=0x7f6360011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f6375d9b700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63780b4450 0x7f63780b11c0 secure :-1 s=THROTTLE_DONE pgs=912 cs=0 l=1 rx=0x7f63600032b0 tx=0x7f6360011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f636f7fe700 1 -- 172.21.15.63:0/3604759916 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6360012b70 con 0x7f63780b4450 2020-05-18T21:30:25.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f6375d9b700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63780b4450 0x7f63780b11c0 secure :-1 s=THROTTLE_DONE pgs=912 cs=0 l=1 rx=0x7f63600032b0 tx=0x7f6360011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f636f7fe700 1 -- 172.21.15.63:0/3604759916 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6360012cd0 con 0x7f63780b4450 2020-05-18T21:30:25.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f637759e700 1 -- 172.21.15.63:0/3604759916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6378157920 con 0x7f63780b4450 2020-05-18T21:30:25.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f636f7fe700 1 -- 172.21.15.63:0/3604759916 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f636000eb20 con 0x7f63780b4450 2020-05-18T21:30:25.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.405+0000 7f637759e700 1 -- 172.21.15.63:0/3604759916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6378062370 con 0x7f63780b4450 2020-05-18T21:30:25.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.409+0000 7f6375d9b700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63780b4450 0x7f63780b11c0 secure :-1 s=THROTTLE_DONE pgs=912 cs=0 l=1 rx=0x7f63600032b0 tx=0x7f6360011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.409+0000 7f637759e700 1 -- 172.21.15.63:0/3604759916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63780569e0 con 0x7f63780b4450 2020-05-18T21:30:25.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.409+0000 7f636f7fe700 1 -- 172.21.15.63:0/3604759916 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f63600101a0 con 0x7f63780b4450 2020-05-18T21:30:25.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.409+0000 7f6375d9b700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63780b4450 0x7f63780b11c0 secure :-1 s=THROTTLE_DONE pgs=912 cs=0 l=1 rx=0x7f63600032b0 tx=0x7f6360011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.409+0000 7f636f7fe700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f635c04fb30 0x7f635c051ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:25.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.409+0000 7f636f7fe700 1 -- 172.21.15.63:0/3604759916 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6360063f60 con 0x7f63780b4450 2020-05-18T21:30:25.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.409+0000 7f637659c700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f635c04fb30 0x7f635c051ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.409+0000 7f637659c700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f635c04fb30 0x7f635c051ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6368000bc0 tx=0x7f6368001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.409+0000 7f637659c700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f635c04fb30 0x7f635c051ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6368000bc0 tx=0x7f6368001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.409+0000 7f637659c700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f635c04fb30 0x7f635c051ff0 secure :-1 s=READY pgs=368 cs=0 l=1 rx=0x7f6368000bc0 tx=0x7f6368001820).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:25.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.413+0000 7f6375d9b700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63780b4450 0x7f63780b11c0 secure :-1 s=THROTTLE_DONE pgs=912 cs=0 l=1 rx=0x7f63600032b0 tx=0x7f6360011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.413+0000 7f636f7fe700 1 -- 172.21.15.63:0/3604759916 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f636003e290 con 0x7f63780b4450 2020-05-18T21:30:25.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.529+0000 7f637759e700 1 -- 172.21.15.63:0/3604759916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6378066690 con 0x7f63780b4450 2020-05-18T21:30:25.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.529+0000 7f6375d9b700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63780b4450 0x7f63780b11c0 secure :-1 s=THROTTLE_DONE pgs=912 cs=0 l=1 rx=0x7f63600032b0 tx=0x7f6360011320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.529+0000 7f636f7fe700 1 -- 172.21.15.63:0/3604759916 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v75) v1 ==== 92+0+10 (secure 0 0 0) 0x7f63600418b0 con 0x7f63780b4450 2020-05-18T21:30:25.535 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:30:25.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.529+0000 7f637759e700 1 -- 172.21.15.63:0/3604759916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f635c04fb30 msgr2=0x7f635c051ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.529+0000 7f637759e700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f635c04fb30 0x7f635c051ff0 secure :-1 s=READY pgs=368 cs=0 l=1 rx=0x7f6368000bc0 tx=0x7f6368001820).stop 2020-05-18T21:30:25.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.529+0000 7f637759e700 1 -- 172.21.15.63:0/3604759916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63780b4450 msgr2=0x7f63780b11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.529+0000 7f637759e700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63780b4450 0x7f63780b11c0 secure :-1 s=READY pgs=912 cs=0 l=1 rx=0x7f63600032b0 tx=0x7f6360011320).stop 2020-05-18T21:30:25.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.529+0000 7f637759e700 1 -- 172.21.15.63:0/3604759916 shutdown_connections 2020-05-18T21:30:25.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.529+0000 7f637759e700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f635c04fb30 0x7f635c051ff0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.529+0000 7f637759e700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63780b4450 0x7f63780b11c0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.529+0000 7f637759e700 1 --2- 172.21.15.63:0/3604759916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f637806a630 0x7f6378146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.529+0000 7f637759e700 1 -- 172.21.15.63:0/3604759916 >> 172.21.15.63:0/3604759916 conn(0x7f637805fb90 msgr2=0x7f6378060620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:25.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.533+0000 7f637759e700 1 -- 172.21.15.63:0/3604759916 shutdown_connections 2020-05-18T21:30:25.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.533+0000 7f637759e700 1 -- 172.21.15.63:0/3604759916 wait complete. 2020-05-18T21:30:25.548 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:30:25.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.649+0000 7f3fe7c98700 1 Processor -- start 2020-05-18T21:30:25.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.649+0000 7f3fe7c98700 1 -- start start 2020-05-18T21:30:25.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe7c98700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3fe00b4e80 0x7f3fe00b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:25.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe7c98700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe00b5260 0x7f3fe00adb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:25.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe7c98700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe0064bd0 con 0x7f3fe00adf90 2020-05-18T21:30:25.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe7c98700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe00b56a0 con 0x7f3fe00b4e80 2020-05-18T21:30:25.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe7c98700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe0064e00 con 0x7f3fe00b5260 2020-05-18T21:30:25.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe6235700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3fe00adf90 0x7f3fe005ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59702/0 (socket says 172.21.15.63:59702) 2020-05-18T21:30:25.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe6235700 1 -- 172.21.15.63:0/1138783186 learned_addr learned my addr 172.21.15.63:0/1138783186 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:25.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe5a34700 1 --2- 172.21.15.63:0/1138783186 >> v2:172.21.15.63:3300/0 conn(0x7f3fe00b4e80 0x7f3fe00b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1138783186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe00b5260 0x7f3fe00adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe4a32700 1 -- 172.21.15.63:0/1138783186 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440475481 0 0) 0x7f3fe0064bd0 con 0x7f3fe00adf90 2020-05-18T21:30:25.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe4a32700 1 -- 172.21.15.63:0/1138783186 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fc8003270 con 0x7f3fe00adf90 2020-05-18T21:30:25.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe5233700 1 -- 172.21.15.63:0/1138783186 >> v2:172.21.15.63:3300/0 conn(0x7f3fe00b4e80 msgr2=0x7f3fe00b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:25.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1138783186 >> v2:172.21.15.63:3300/0 conn(0x7f3fe00b4e80 0x7f3fe00b8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:25.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe5233700 1 -- 172.21.15.63:0/1138783186 >> v1:172.21.15.63:6789/0 conn(0x7f3fe00adf90 legacy=0x7f3fe005ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe4a32700 1 -- 172.21.15.63:0/1138783186 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1557674463 0 0) 0x7f3fc8003270 con 0x7f3fe00adf90 2020-05-18T21:30:25.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe5233700 1 -- 172.21.15.63:0/1138783186 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe00ad3f0 con 0x7f3fe00b5260 2020-05-18T21:30:25.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe5a34700 1 --2- 172.21.15.63:0/1138783186 >> v2:172.21.15.63:3300/0 conn(0x7f3fe00b4e80 0x7f3fe00b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:30:25.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1138783186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe00b5260 0x7f3fe00adb30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3fd8001c30 tx=0x7f3fd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1138783186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe00b5260 0x7f3fe00adb30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3fd8001c30 tx=0x7f3fd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1138783186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe00b5260 0x7f3fe00adb30 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f3fd8001c30 tx=0x7f3fd0007a80).ready entity=mon.2 client_cookie=99e62879c3408aac server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:25.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1138783186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe00b5260 0x7f3fe00adb30 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f3fd8001c30 tx=0x7f3fd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe4a32700 1 -- 172.21.15.63:0/1138783186 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fd8001a90 con 0x7f3fe00b5260 2020-05-18T21:30:25.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1138783186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe00b5260 0x7f3fe00adb30 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f3fd8001c30 tx=0x7f3fd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1138783186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe00b5260 0x7f3fe00adb30 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f3fd8001c30 tx=0x7f3fd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe4a32700 1 -- 172.21.15.63:0/1138783186 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd0008e40 con 0x7f3fe00b5260 2020-05-18T21:30:25.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe4a32700 1 -- 172.21.15.63:0/1138783186 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fd0011440 con 0x7f3fe00b5260 2020-05-18T21:30:25.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe7c98700 1 -- 172.21.15.63:0/1138783186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe00b5260 msgr2=0x7f3fe00adb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe7c98700 1 --2- 172.21.15.63:0/1138783186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe00b5260 0x7f3fe00adb30 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f3fd8001c30 tx=0x7f3fd0007a80).stop 2020-05-18T21:30:25.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe7c98700 1 -- 172.21.15.63:0/1138783186 shutdown_connections 2020-05-18T21:30:25.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe7c98700 1 --2- 172.21.15.63:0/1138783186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe00b5260 0x7f3fe00adb30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe7c98700 1 --2- 172.21.15.63:0/1138783186 >> v2:172.21.15.63:3300/0 conn(0x7f3fe00b4e80 0x7f3fe00b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:25.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe7c98700 1 -- 172.21.15.63:0/1138783186 >> 172.21.15.63:0/1138783186 conn(0x7f3fe00b83b0 msgr2=0x7f3fe00b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:25.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe7c98700 1 -- 172.21.15.63:0/1138783186 shutdown_connections 2020-05-18T21:30:25.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.653+0000 7f3fe7c98700 1 -- 172.21.15.63:0/1138783186 wait complete. 2020-05-18T21:30:25.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe7c98700 1 Processor -- start 2020-05-18T21:30:25.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe7c98700 1 -- start start 2020-05-18T21:30:25.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe7c98700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe00adf90 0x7f3fe0135700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:25.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe7c98700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3fe00b4e80 0x7f3fe0061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:25.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe7c98700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3fe00b5260 0x7f3fe0145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:25.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe7c98700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe0135570 con 0x7f3fe00b4e80 2020-05-18T21:30:25.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe7c98700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe0136120 con 0x7f3fe00b5260 2020-05-18T21:30:25.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe7c98700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe0135e80 con 0x7f3fe00adf90 2020-05-18T21:30:25.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe5233700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3fe00b4e80 0x7f3fe0061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe5233700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3fe00b4e80 0x7f3fe0061be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57518/0 (socket says 172.21.15.63:57518) 2020-05-18T21:30:25.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe5233700 1 -- 172.21.15.63:0/1410050241 learned_addr learned my addr 172.21.15.63:0/1410050241 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:25.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe5a34700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe00adf90 0x7f3fe0135700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe6235700 1 --2- 172.21.15.63:0/1410050241 >> v2:172.21.15.155:3300/0 conn(0x7f3fe00b5260 0x7f3fe0145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe5233700 1 -- 172.21.15.63:0/1410050241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe00adf90 msgr2=0x7f3fe0135700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe00adf90 0x7f3fe0135700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe5233700 1 -- 172.21.15.63:0/1410050241 >> v2:172.21.15.155:3300/0 conn(0x7f3fe00b5260 msgr2=0x7f3fe0145400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1410050241 >> v2:172.21.15.155:3300/0 conn(0x7f3fe00b5260 0x7f3fe0145400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe5233700 1 -- 172.21.15.63:0/1410050241 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe0112d60 con 0x7f3fe00b4e80 2020-05-18T21:30:25.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe6235700 1 --2- 172.21.15.63:0/1410050241 >> v2:172.21.15.155:3300/0 conn(0x7f3fe00b5260 0x7f3fe0145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:30:25.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1410050241 >> v2:172.21.15.63:3300/0 conn(0x7f3fe00b4e80 0x7f3fe0061be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3fd8001c30 tx=0x7f3fd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1410050241 >> v2:172.21.15.63:3300/0 conn(0x7f3fe00b4e80 0x7f3fe0061be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3fd8001c30 tx=0x7f3fd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3fe00b4e80 0x7f3fe0061be0 secure :-1 s=READY pgs=914 cs=0 l=1 rx=0x7f3fd8001c30 tx=0x7f3fd0007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:25.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3fe00b4e80 0x7f3fe0061be0 secure :-1 s=THROTTLE_DONE pgs=914 cs=0 l=1 rx=0x7f3fd8001c30 tx=0x7f3fd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fceffd700 1 -- 172.21.15.63:0/1410050241 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fd0011ca0 con 0x7f3fe00b4e80 2020-05-18T21:30:25.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3fe00b4e80 0x7f3fe0061be0 secure :-1 s=THROTTLE_DONE pgs=914 cs=0 l=1 rx=0x7f3fd8001c30 tx=0x7f3fd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3fe00b4e80 0x7f3fe0061be0 secure :-1 s=THROTTLE_DONE pgs=914 cs=0 l=1 rx=0x7f3fd8001c30 tx=0x7f3fd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fceffd700 1 -- 172.21.15.63:0/1410050241 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd0011e00 con 0x7f3fe00b4e80 2020-05-18T21:30:25.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe7c98700 1 -- 172.21.15.63:0/1410050241 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe0135b60 con 0x7f3fe00b4e80 2020-05-18T21:30:25.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fceffd700 1 -- 172.21.15.63:0/1410050241 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fd0007360 con 0x7f3fe00b4e80 2020-05-18T21:30:25.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.657+0000 7f3fe7c98700 1 -- 172.21.15.63:0/1410050241 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe0145860 con 0x7f3fe00b4e80 2020-05-18T21:30:25.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.661+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3fe00b4e80 0x7f3fe0061be0 secure :-1 s=THROTTLE_DONE pgs=914 cs=0 l=1 rx=0x7f3fd8001c30 tx=0x7f3fd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.661+0000 7f3fe7c98700 1 -- 172.21.15.63:0/1410050241 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe0112ef0 con 0x7f3fe00b4e80 2020-05-18T21:30:25.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.661+0000 7f3fceffd700 1 -- 172.21.15.63:0/1410050241 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3fd0005700 con 0x7f3fe00b4e80 2020-05-18T21:30:25.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.661+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3fe00b4e80 0x7f3fe0061be0 secure :-1 s=THROTTLE_DONE pgs=914 cs=0 l=1 rx=0x7f3fd8001c30 tx=0x7f3fd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.661+0000 7f3fceffd700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3fc004fa10 0x7f3fc0051ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:25.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.661+0000 7f3fceffd700 1 -- 172.21.15.63:0/1410050241 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f3fd0064460 con 0x7f3fe00b4e80 2020-05-18T21:30:25.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.661+0000 7f3fe5a34700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3fc004fa10 0x7f3fc0051ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.661+0000 7f3fe5a34700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3fc004fa10 0x7f3fc0051ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3fdc002f70 tx=0x7f3fdc008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.661+0000 7f3fe5a34700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3fc004fa10 0x7f3fc0051ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3fdc002f70 tx=0x7f3fdc008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.661+0000 7f3fe5a34700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3fc004fa10 0x7f3fc0051ed0 secure :-1 s=READY pgs=369 cs=0 l=1 rx=0x7f3fdc002f70 tx=0x7f3fdc008020).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:25.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.669+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3fe00b4e80 0x7f3fe0061be0 secure :-1 s=THROTTLE_DONE pgs=914 cs=0 l=1 rx=0x7f3fd8001c30 tx=0x7f3fd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.669+0000 7f3fceffd700 1 -- 172.21.15.63:0/1410050241 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3fd003e7f0 con 0x7f3fe00b4e80 2020-05-18T21:30:25.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.785+0000 7f3fe7c98700 1 -- 172.21.15.63:0/1410050241 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3fe0135cf0 con 0x7f3fe00b4e80 2020-05-18T21:30:25.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.785+0000 7f3fe5233700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3fe00b4e80 0x7f3fe0061be0 secure :-1 s=THROTTLE_DONE pgs=914 cs=0 l=1 rx=0x7f3fd8001c30 tx=0x7f3fd0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.785+0000 7f3fceffd700 1 -- 172.21.15.63:0/1410050241 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3fd0041e10 con 0x7f3fe00b4e80 2020-05-18T21:30:25.790 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:30:25.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.785+0000 7f3fe7c98700 1 -- 172.21.15.63:0/1410050241 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3fc004fa10 msgr2=0x7f3fc0051ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.785+0000 7f3fe7c98700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3fc004fa10 0x7f3fc0051ed0 secure :-1 s=READY pgs=369 cs=0 l=1 rx=0x7f3fdc002f70 tx=0x7f3fdc008020).stop 2020-05-18T21:30:25.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.785+0000 7f3fe7c98700 1 -- 172.21.15.63:0/1410050241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3fe00b4e80 msgr2=0x7f3fe0061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.785+0000 7f3fe7c98700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3fe00b4e80 0x7f3fe0061be0 secure :-1 s=READY pgs=914 cs=0 l=1 rx=0x7f3fd8001c30 tx=0x7f3fd0007a80).stop 2020-05-18T21:30:25.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.785+0000 7f3fe7c98700 1 -- 172.21.15.63:0/1410050241 shutdown_connections 2020-05-18T21:30:25.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.785+0000 7f3fe7c98700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3fc004fa10 0x7f3fc0051ed0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.785+0000 7f3fe7c98700 1 --2- 172.21.15.63:0/1410050241 >> v2:172.21.15.155:3300/0 conn(0x7f3fe00b5260 0x7f3fe0145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.785+0000 7f3fe7c98700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3fe00b4e80 0x7f3fe0061be0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.785+0000 7f3fe7c98700 1 --2- 172.21.15.63:0/1410050241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fe00adf90 0x7f3fe0135700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.785+0000 7f3fe7c98700 1 -- 172.21.15.63:0/1410050241 >> 172.21.15.63:0/1410050241 conn(0x7f3fe00b83b0 msgr2=0x7f3fe00b6320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:25.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.785+0000 7f3fe7c98700 1 -- 172.21.15.63:0/1410050241 shutdown_connections 2020-05-18T21:30:25.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.785+0000 7f3fe7c98700 1 -- 172.21.15.63:0/1410050241 wait complete. 2020-05-18T21:30:25.802 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:30:25.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.901+0000 7fd96f528700 1 Processor -- start 2020-05-18T21:30:25.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.901+0000 7fd96f528700 1 -- start start 2020-05-18T21:30:25.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96f528700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd968145790 0x7fd968065dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:25.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96f528700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd968145b70 0x7fd968061030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:25.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96f528700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9681461b0 con 0x7fd9680b4890 2020-05-18T21:30:25.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96f528700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9681466f0 con 0x7fd968145790 2020-05-18T21:30:25.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96f528700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd968146450 con 0x7fd968145b70 2020-05-18T21:30:25.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96e526700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd968145790 0x7fd968065dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96e526700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd968145790 0x7fd968065dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57526/0 (socket says 172.21.15.63:57526) 2020-05-18T21:30:25.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96e526700 1 -- 172.21.15.63:0/1953356172 learned_addr learned my addr 172.21.15.63:0/1953356172 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:25.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96dd25700 1 --2- 172.21.15.63:0/1953356172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd968145b70 0x7fd968061030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96d524700 1 -- 172.21.15.63:0/1953356172 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742700596 0 0) 0x7fd9681461b0 con 0x7fd9680b4890 2020-05-18T21:30:25.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96e526700 1 -- 172.21.15.63:0/1953356172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd968145b70 msgr2=0x7fd968061030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:25.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96e526700 1 --2- 172.21.15.63:0/1953356172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd968145b70 0x7fd968061030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:25.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96e526700 1 -- 172.21.15.63:0/1953356172 >> v1:172.21.15.155:6789/0 conn(0x7fd9680b4890 legacy=0x7fd9680ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96e526700 1 -- 172.21.15.63:0/1953356172 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd968061490 con 0x7fd968145790 2020-05-18T21:30:25.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96e526700 1 --2- 172.21.15.63:0/1953356172 >> v2:172.21.15.63:3300/0 conn(0x7fd968145790 0x7fd968065dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd964002f70 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96e526700 1 --2- 172.21.15.63:0/1953356172 >> v2:172.21.15.63:3300/0 conn(0x7fd968145790 0x7fd968065dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd964002f70 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96e526700 1 --2- 172.21.15.63:0/1953356172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd968145790 0x7fd968065dc0 secure :-1 s=READY pgs=915 cs=0 l=1 rx=0x7fd964002f70 tx=0x7fd964007a80).ready entity=mon.0 client_cookie=babfeaf6b0b91d26 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:25.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96e526700 1 --2- 172.21.15.63:0/1953356172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd968145790 0x7fd968065dc0 secure :-1 s=THROTTLE_DONE pgs=915 cs=0 l=1 rx=0x7fd964002f70 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96e526700 1 --2- 172.21.15.63:0/1953356172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd968145790 0x7fd968065dc0 secure :-1 s=THROTTLE_DONE pgs=915 cs=0 l=1 rx=0x7fd964002f70 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96d524700 1 -- 172.21.15.63:0/1953356172 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9640116b0 con 0x7fd968145790 2020-05-18T21:30:25.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96e526700 1 --2- 172.21.15.63:0/1953356172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd968145790 0x7fd968065dc0 secure :-1 s=THROTTLE_DONE pgs=915 cs=0 l=1 rx=0x7fd964002f70 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96d524700 1 -- 172.21.15.63:0/1953356172 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd964011810 con 0x7fd968145790 2020-05-18T21:30:25.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96d524700 1 -- 172.21.15.63:0/1953356172 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd964011bf0 con 0x7fd968145790 2020-05-18T21:30:25.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96f528700 1 -- 172.21.15.63:0/1953356172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd968145790 msgr2=0x7fd968065dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96f528700 1 --2- 172.21.15.63:0/1953356172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd968145790 0x7fd968065dc0 secure :-1 s=READY pgs=915 cs=0 l=1 rx=0x7fd964002f70 tx=0x7fd964007a80).stop 2020-05-18T21:30:25.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96f528700 1 -- 172.21.15.63:0/1953356172 shutdown_connections 2020-05-18T21:30:25.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96f528700 1 --2- 172.21.15.63:0/1953356172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd968145b70 0x7fd968061030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:25.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96f528700 1 --2- 172.21.15.63:0/1953356172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd968145790 0x7fd968065dc0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96f528700 1 -- 172.21.15.63:0/1953356172 >> 172.21.15.63:0/1953356172 conn(0x7fd96805fb90 msgr2=0x7fd968069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:25.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96f528700 1 -- 172.21.15.63:0/1953356172 shutdown_connections 2020-05-18T21:30:25.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.905+0000 7fd96f528700 1 -- 172.21.15.63:0/1953356172 wait complete. 2020-05-18T21:30:25.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96f528700 1 Processor -- start 2020-05-18T21:30:25.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96f528700 1 -- start start 2020-05-18T21:30:25.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96f528700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd9680b4890 0x7fd9681569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:25.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96f528700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9681449b0 con 0x7fd968145790 2020-05-18T21:30:25.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96f528700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd968144c50 con 0x7fd968145b70 2020-05-18T21:30:25.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96f528700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9681429c0 con 0x7fd9680b4890 2020-05-18T21:30:25.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96dd25700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd968145790 0x7fd96813ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59718/0 (socket says 172.21.15.63:59718) 2020-05-18T21:30:25.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96dd25700 1 -- 172.21.15.63:0/417698670 learned_addr learned my addr 172.21.15.63:0/417698670 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:25.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96e526700 1 --2- 172.21.15.63:0/417698670 >> v2:172.21.15.63:3300/0 conn(0x7fd9680b4890 0x7fd9681569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd95b7fe700 1 -- 172.21.15.63:0/417698670 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2778059909 0 0) 0x7fd9681449b0 con 0x7fd968145790 2020-05-18T21:30:25.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd95b7fe700 1 -- 172.21.15.63:0/417698670 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd948002fe0 con 0x7fd968145790 2020-05-18T21:30:25.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd95b7fe700 1 -- 172.21.15.63:0/417698670 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1724016332 0 0) 0x7fd948002fe0 con 0x7fd968145790 2020-05-18T21:30:25.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd95b7fe700 1 -- 172.21.15.63:0/417698670 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd9681449b0 con 0x7fd968145790 2020-05-18T21:30:25.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd95b7fe700 1 -- 172.21.15.63:0/417698670 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fd95c001850 con 0x7fd968145790 2020-05-18T21:30:25.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd95b7fe700 1 -- 172.21.15.63:0/417698670 >> v2:172.21.15.63:3300/0 conn(0x7fd9680b4890 msgr2=0x7fd9681569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd95b7fe700 1 --2- 172.21.15.63:0/417698670 >> v2:172.21.15.63:3300/0 conn(0x7fd9680b4890 0x7fd9681569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd95b7fe700 1 -- 172.21.15.63:0/417698670 >> v1:172.21.15.155:6789/0 conn(0x7fd968145b70 legacy=0x7fd968140b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd95b7fe700 1 -- 172.21.15.63:0/417698670 >> v1:172.21.15.63:6789/0 conn(0x7fd968145790 legacy=0x7fd96813ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd95b7fe700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd948004a80 0x7fd948004e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:25.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd95b7fe700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9480039a0 0x7fd948003de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:25.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd95b7fe700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd948004240 0x7fd94800b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:25.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd95b7fe700 1 -- 172.21.15.63:0/417698670 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9681429c0 con 0x7fd948004a80 2020-05-18T21:30:25.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd95b7fe700 1 -- 172.21.15.63:0/417698670 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94800bbc0 con 0x7fd9480039a0 2020-05-18T21:30:25.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd95b7fe700 1 -- 172.21.15.63:0/417698670 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94800bd00 con 0x7fd948004240 2020-05-18T21:30:25.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96e526700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd948004a80 0x7fd948004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96dd25700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9480039a0 0x7fd948003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96ed27700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd948004240 0x7fd94800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96e526700 1 -- 172.21.15.63:0/417698670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd948004240 msgr2=0x7fd94800b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96e526700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd948004240 0x7fd94800b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96e526700 1 -- 172.21.15.63:0/417698670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9480039a0 msgr2=0x7fd948003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:25.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96e526700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9480039a0 0x7fd948003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:25.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96e526700 1 -- 172.21.15.63:0/417698670 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96813f2f0 con 0x7fd948004a80 2020-05-18T21:30:25.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96ed27700 1 -- 172.21.15.63:0/417698670 reap_dead start 2020-05-18T21:30:25.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96f528700 1 -- 172.21.15.63:0/417698670 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96813f540 con 0x7fd948004a80 2020-05-18T21:30:25.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96dd25700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9480039a0 0x7fd948003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:30:25.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96f528700 1 -- 172.21.15.63:0/417698670 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd968140360 con 0x7fd948004a80 2020-05-18T21:30:25.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.909+0000 7fd96e526700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd948004a80 0x7fd948004e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd964002f70 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.913+0000 7fd96e526700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd948004a80 0x7fd948004e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd964002f70 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.913+0000 7fd96e526700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd948004a80 0x7fd948004e80 secure :-1 s=READY pgs=917 cs=0 l=1 rx=0x7fd964002f70 tx=0x7fd964007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:25.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.913+0000 7fd96e526700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd948004a80 0x7fd948004e80 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7fd964002f70 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.913+0000 7fd95b7fe700 1 -- 172.21.15.63:0/417698670 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd964011c80 con 0x7fd948004a80 2020-05-18T21:30:25.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.913+0000 7fd96e526700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd948004a80 0x7fd948004e80 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7fd964002f70 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.913+0000 7fd96e526700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd948004a80 0x7fd948004e80 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7fd964002f70 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.913+0000 7fd95b7fe700 1 -- 172.21.15.63:0/417698670 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd964007360 con 0x7fd948004a80 2020-05-18T21:30:25.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.913+0000 7fd95b7fe700 1 -- 172.21.15.63:0/417698670 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd964005700 con 0x7fd948004a80 2020-05-18T21:30:25.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.913+0000 7fd96f528700 1 -- 172.21.15.63:0/417698670 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd944003380 con 0x7fd948004a80 2020-05-18T21:30:25.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.913+0000 7fd96e526700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd948004a80 0x7fd948004e80 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7fd964002f70 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.913+0000 7fd95b7fe700 1 -- 172.21.15.63:0/417698670 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd964005860 con 0x7fd948004a80 2020-05-18T21:30:25.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.913+0000 7fd96e526700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd948004a80 0x7fd948004e80 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7fd964002f70 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.913+0000 7fd95b7fe700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd9480539d0 0x7fd948055e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:25.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.913+0000 7fd95b7fe700 1 -- 172.21.15.63:0/417698670 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd964064310 con 0x7fd948004a80 2020-05-18T21:30:25.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.913+0000 7fd96dd25700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd9480539d0 0x7fd948055e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:25.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.913+0000 7fd96dd25700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd9480539d0 0x7fd948055e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd95c008360 tx=0x7fd95c00d9d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.917+0000 7fd96dd25700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd9480539d0 0x7fd948055e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd95c008360 tx=0x7fd95c00d9d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.917+0000 7fd96dd25700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd9480539d0 0x7fd948055e90 secure :-1 s=READY pgs=370 cs=0 l=1 rx=0x7fd95c008360 tx=0x7fd95c00d9d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:25.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.917+0000 7fd96e526700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd948004a80 0x7fd948004e80 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7fd964002f70 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:25.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:25.917+0000 7fd95b7fe700 1 -- 172.21.15.63:0/417698670 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd96403e7c0 con 0x7fd948004a80 2020-05-18T21:30:26.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.037+0000 7fd96f528700 1 -- 172.21.15.63:0/417698670 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd944002240 con 0x7fd948004a80 2020-05-18T21:30:26.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.037+0000 7fd96e526700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd948004a80 0x7fd948004e80 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7fd964002f70 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:26.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.037+0000 7fd95b7fe700 1 -- 172.21.15.63:0/417698670 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd964041de0 con 0x7fd948004a80 2020-05-18T21:30:26.042 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:30:26.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.037+0000 7fd96f528700 1 -- 172.21.15.63:0/417698670 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd9480539d0 msgr2=0x7fd948055e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:26.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.037+0000 7fd96f528700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd9480539d0 0x7fd948055e90 secure :-1 s=READY pgs=370 cs=0 l=1 rx=0x7fd95c008360 tx=0x7fd95c00d9d0).stop 2020-05-18T21:30:26.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.037+0000 7fd96f528700 1 -- 172.21.15.63:0/417698670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd948004a80 msgr2=0x7fd948004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:26.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.037+0000 7fd96f528700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd948004a80 0x7fd948004e80 secure :-1 s=READY pgs=917 cs=0 l=1 rx=0x7fd964002f70 tx=0x7fd964007a80).stop 2020-05-18T21:30:26.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.037+0000 7fd96f528700 1 -- 172.21.15.63:0/417698670 shutdown_connections 2020-05-18T21:30:26.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.037+0000 7fd96f528700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd9480539d0 0x7fd948055e90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:26.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.037+0000 7fd96f528700 1 --2- 172.21.15.63:0/417698670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd948004a80 0x7fd948004e80 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:26.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.037+0000 7fd96f528700 1 -- 172.21.15.63:0/417698670 >> 172.21.15.63:0/417698670 conn(0x7fd96805fb90 msgr2=0x7fd9680b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:26.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.037+0000 7fd96f528700 1 -- 172.21.15.63:0/417698670 shutdown_connections 2020-05-18T21:30:26.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.037+0000 7fd96f528700 1 -- 172.21.15.63:0/417698670 wait complete. 2020-05-18T21:30:26.055 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:30:26.056 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:30:26.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.149+0000 7f865cc15700 1 Processor -- start 2020-05-18T21:30:26.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.149+0000 7f865cc15700 1 -- start start 2020-05-18T21:30:26.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.149+0000 7f865cc15700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8658144320 0x7f86580b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:26.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.149+0000 7f865cc15700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8658144700 0x7f8658063160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:26.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.149+0000 7f865cc15700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86580b7fc0 con 0x7f86580635c0 2020-05-18T21:30:26.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.149+0000 7f865cc15700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8658144bf0 con 0x7f8658144700 2020-05-18T21:30:26.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.149+0000 7f865cc15700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8658062a20 con 0x7f8658144320 2020-05-18T21:30:26.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.149+0000 7f8655d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8658144700 0x7f8658063160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:26.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.149+0000 7f8655d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8658144700 0x7f8658063160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57544/0 (socket says 172.21.15.63:57544) 2020-05-18T21:30:26.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.149+0000 7f8655d9b700 1 -- 172.21.15.63:0/3313975444 learned_addr learned my addr 172.21.15.63:0/3313975444 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:26.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.149+0000 7f865659c700 1 --2- 172.21.15.63:0/3313975444 >> v2:172.21.15.155:3300/0 conn(0x7f8658144320 0x7f86580b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:26.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.149+0000 7f8655d9b700 1 -- 172.21.15.63:0/3313975444 >> v2:172.21.15.155:3300/0 conn(0x7f8658144320 msgr2=0x7f86580b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:26.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.149+0000 7f8655d9b700 1 --2- 172.21.15.63:0/3313975444 >> v2:172.21.15.155:3300/0 conn(0x7f8658144320 0x7f86580b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:26.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.149+0000 7f8655d9b700 1 -- 172.21.15.63:0/3313975444 >> v1:172.21.15.63:6789/0 conn(0x7f86580635c0 legacy=0x7f8658069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:26.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.149+0000 7f865559a700 1 -- 172.21.15.63:0/3313975444 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219041911 0 0) 0x7f86580b7fc0 con 0x7f86580635c0 2020-05-18T21:30:26.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.149+0000 7f8655d9b700 1 -- 172.21.15.63:0/3313975444 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8658062cc0 con 0x7f8658144700 2020-05-18T21:30:26.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.149+0000 7f8655d9b700 1 --2- 172.21.15.63:0/3313975444 >> v2:172.21.15.63:3300/0 conn(0x7f8658144700 0x7f8658063160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8648002f70 tx=0x7f8648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:26.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.153+0000 7f8655d9b700 1 --2- 172.21.15.63:0/3313975444 >> v2:172.21.15.63:3300/0 conn(0x7f8658144700 0x7f8658063160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8648002f70 tx=0x7f8648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:26.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.153+0000 7f8655d9b700 1 --2- 172.21.15.63:0/3313975444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8658144700 0x7f8658063160 secure :-1 s=READY pgs=919 cs=0 l=1 rx=0x7f8648002f70 tx=0x7f8648007a80).ready entity=mon.0 client_cookie=6cf7c875cb35ca7b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:26.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.153+0000 7f8655d9b700 1 --2- 172.21.15.63:0/3313975444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8658144700 0x7f8658063160 secure :-1 s=THROTTLE_DONE pgs=919 cs=0 l=1 rx=0x7f8648002f70 tx=0x7f8648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:26.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.153+0000 7f865559a700 1 -- 172.21.15.63:0/3313975444 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86480116b0 con 0x7f8658144700 2020-05-18T21:30:26.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.153+0000 7f8655d9b700 1 --2- 172.21.15.63:0/3313975444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8658144700 0x7f8658063160 secure :-1 s=THROTTLE_DONE pgs=919 cs=0 l=1 rx=0x7f8648002f70 tx=0x7f8648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:26.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.153+0000 7f865559a700 1 -- 172.21.15.63:0/3313975444 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8648011810 con 0x7f8658144700 2020-05-18T21:30:26.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.153+0000 7f8655d9b700 1 --2- 172.21.15.63:0/3313975444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8658144700 0x7f8658063160 secure :-1 s=THROTTLE_DONE pgs=919 cs=0 l=1 rx=0x7f8648002f70 tx=0x7f8648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:26.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.153+0000 7f865cc15700 1 -- 172.21.15.63:0/3313975444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8658144700 msgr2=0x7f8658063160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:26.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.153+0000 7f865559a700 1 -- 172.21.15.63:0/3313975444 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8648011bf0 con 0x7f8658144700 2020-05-18T21:30:26.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.153+0000 7f865cc15700 1 --2- 172.21.15.63:0/3313975444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8658144700 0x7f8658063160 secure :-1 s=READY pgs=919 cs=0 l=1 rx=0x7f8648002f70 tx=0x7f8648007a80).stop 2020-05-18T21:30:26.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.153+0000 7f865cc15700 1 -- 172.21.15.63:0/3313975444 shutdown_connections 2020-05-18T21:30:26.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.153+0000 7f865cc15700 1 --2- 172.21.15.63:0/3313975444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8658144700 0x7f8658063160 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:26.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.153+0000 7f865cc15700 1 --2- 172.21.15.63:0/3313975444 >> v2:172.21.15.155:3300/0 conn(0x7f8658144320 0x7f86580b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:26.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.153+0000 7f865cc15700 1 -- 172.21.15.63:0/3313975444 >> 172.21.15.63:0/3313975444 conn(0x7f865805f040 msgr2=0x7f865805f450 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:26.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.153+0000 7f865cc15700 1 -- 172.21.15.63:0/3313975444 shutdown_connections 2020-05-18T21:30:26.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.153+0000 7f865cc15700 1 -- 172.21.15.63:0/3313975444 wait complete. 2020-05-18T21:30:26.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.153+0000 7f865cc15700 1 Processor -- start 2020-05-18T21:30:26.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f865cc15700 1 -- start start 2020-05-18T21:30:26.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f865cc15700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f86580635c0 0x7f865813e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:26.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f865cc15700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865813e840 con 0x7f8658144700 2020-05-18T21:30:26.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f865cc15700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86580b2b40 con 0x7f8658144320 2020-05-18T21:30:26.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f865cc15700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86580b2de0 con 0x7f86580635c0 2020-05-18T21:30:26.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f865659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f86580635c0 0x7f865813e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:26.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f865659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f86580635c0 0x7f865813e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57550/0 (socket says 172.21.15.63:57550) 2020-05-18T21:30:26.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f865659c700 1 -- 172.21.15.63:0/3335783400 learned_addr learned my addr 172.21.15.63:0/3335783400 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:26.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f865659c700 1 -- 172.21.15.63:0/3335783400 >> v1:172.21.15.155:6789/0 conn(0x7f8658144320 legacy=0x7f8658140070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:26.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f865659c700 1 -- 172.21.15.63:0/3335783400 >> v1:172.21.15.63:6789/0 conn(0x7f8658144700 legacy=0x7f8658153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:26.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f865659c700 1 -- 172.21.15.63:0/3335783400 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86580b3080 con 0x7f86580635c0 2020-05-18T21:30:26.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f865659c700 1 --2- 172.21.15.63:0/3335783400 >> v2:172.21.15.63:3300/0 conn(0x7f86580635c0 0x7f865813e370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8658061ea0 tx=0x7f864c010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:26.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f865659c700 1 --2- 172.21.15.63:0/3335783400 >> v2:172.21.15.63:3300/0 conn(0x7f86580635c0 0x7f865813e370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8658061ea0 tx=0x7f864c010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:26.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f865659c700 1 --2- 172.21.15.63:0/3335783400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86580635c0 0x7f865813e370 secure :-1 s=READY pgs=920 cs=0 l=1 rx=0x7f8658061ea0 tx=0x7f864c010d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:26.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f865659c700 1 --2- 172.21.15.63:0/3335783400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86580635c0 0x7f865813e370 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7f8658061ea0 tx=0x7f864c010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:26.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f865659c700 1 --2- 172.21.15.63:0/3335783400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86580635c0 0x7f865813e370 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7f8658061ea0 tx=0x7f864c010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:26.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f865659c700 1 --2- 172.21.15.63:0/3335783400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86580635c0 0x7f865813e370 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7f8658061ea0 tx=0x7f864c010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:26.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f86477fe700 1 -- 172.21.15.63:0/3335783400 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f864c007180 con 0x7f86580635c0 2020-05-18T21:30:26.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f86477fe700 1 -- 172.21.15.63:0/3335783400 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c0072e0 con 0x7f86580635c0 2020-05-18T21:30:26.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f865cc15700 1 -- 172.21.15.63:0/3335783400 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86580b3320 con 0x7f86580635c0 2020-05-18T21:30:26.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f86477fe700 1 -- 172.21.15.63:0/3335783400 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f864c0123d0 con 0x7f86580635c0 2020-05-18T21:30:26.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.157+0000 7f865cc15700 1 -- 172.21.15.63:0/3335783400 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8658140780 con 0x7f86580635c0 2020-05-18T21:30:26.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.161+0000 7f865659c700 1 --2- 172.21.15.63:0/3335783400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86580635c0 0x7f865813e370 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7f8658061ea0 tx=0x7f864c010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:26.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.161+0000 7f865cc15700 1 -- 172.21.15.63:0/3335783400 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86580b0c20 con 0x7f86580635c0 2020-05-18T21:30:26.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.161+0000 7f86477fe700 1 -- 172.21.15.63:0/3335783400 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f864c012530 con 0x7f86580635c0 2020-05-18T21:30:26.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.161+0000 7f865659c700 1 --2- 172.21.15.63:0/3335783400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86580635c0 0x7f865813e370 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7f8658061ea0 tx=0x7f864c010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:26.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.161+0000 7f86477fe700 1 --2- 172.21.15.63:0/3335783400 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f863404fbb0 0x7f8634052070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:26.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.161+0000 7f86477fe700 1 -- 172.21.15.63:0/3335783400 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f864c0644b0 con 0x7f86580635c0 2020-05-18T21:30:26.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.161+0000 7f8655d9b700 1 --2- 172.21.15.63:0/3335783400 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f863404fbb0 0x7f8634052070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:26.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.161+0000 7f8655d9b700 1 --2- 172.21.15.63:0/3335783400 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f863404fbb0 0x7f8634052070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8658061f40 tx=0x7f8648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:26.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.161+0000 7f8655d9b700 1 --2- 172.21.15.63:0/3335783400 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f863404fbb0 0x7f8634052070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8658061f40 tx=0x7f8648007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:26.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.161+0000 7f8655d9b700 1 --2- 172.21.15.63:0/3335783400 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f863404fbb0 0x7f8634052070 secure :-1 s=READY pgs=371 cs=0 l=1 rx=0x7f8658061f40 tx=0x7f8648007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:26.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.169+0000 7f865659c700 1 --2- 172.21.15.63:0/3335783400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86580635c0 0x7f865813e370 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7f8658061ea0 tx=0x7f864c010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:26.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.169+0000 7f86477fe700 1 -- 172.21.15.63:0/3335783400 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f86580b0c20 con 0x7f86580635c0 2020-05-18T21:30:26.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.309+0000 7f865cc15700 1 -- 172.21.15.63:0/3335783400 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86580b0c20 con 0x7f86580635c0 2020-05-18T21:30:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.309+0000 7f865659c700 1 --2- 172.21.15.63:0/3335783400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86580635c0 0x7f865813e370 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7f8658061ea0 tx=0x7f864c010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.309+0000 7f86477fe700 1 -- 172.21.15.63:0/3335783400 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7f86580b0c20 con 0x7f86580635c0 2020-05-18T21:30:26.316 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:26.316 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:30:26.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.313+0000 7f865cc15700 1 -- 172.21.15.63:0/3335783400 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f863404fbb0 msgr2=0x7f8634052070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:26.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.313+0000 7f865cc15700 1 --2- 172.21.15.63:0/3335783400 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f863404fbb0 0x7f8634052070 secure :-1 s=READY pgs=371 cs=0 l=1 rx=0x7f8658061f40 tx=0x7f8648007a80).stop 2020-05-18T21:30:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.313+0000 7f865cc15700 1 -- 172.21.15.63:0/3335783400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86580635c0 msgr2=0x7f865813e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.313+0000 7f865cc15700 1 --2- 172.21.15.63:0/3335783400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86580635c0 0x7f865813e370 secure :-1 s=READY pgs=920 cs=0 l=1 rx=0x7f8658061ea0 tx=0x7f864c010d80).stop 2020-05-18T21:30:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.313+0000 7f865cc15700 1 -- 172.21.15.63:0/3335783400 shutdown_connections 2020-05-18T21:30:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.313+0000 7f865cc15700 1 --2- 172.21.15.63:0/3335783400 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f863404fbb0 0x7f8634052070 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.313+0000 7f865cc15700 1 --2- 172.21.15.63:0/3335783400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86580635c0 0x7f865813e370 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.313+0000 7f865cc15700 1 -- 172.21.15.63:0/3335783400 >> 172.21.15.63:0/3335783400 conn(0x7f865805f040 msgr2=0x7f86580ba5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.313+0000 7f865cc15700 1 -- 172.21.15.63:0/3335783400 shutdown_connections 2020-05-18T21:30:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:26.313+0000 7f865cc15700 1 -- 172.21.15.63:0/3335783400 wait complete. 2020-05-18T21:30:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:30:26.529 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:30:08.365002+0000', 'modified': '2020-05-18T21:30:23.668863+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 74, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6834}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6834': {'gid': 6834, 'name': 'a', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.63:6833/2372263796', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 2372263796}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 2372263796}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:30:26.530 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:30:26.531 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:30:26.638 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:30:26.639 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:30:26.639 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:30:26.639 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 6834, 2020-05-18T21:30:26.639 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:30:26.639 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:30:26.640 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 5.9881068769999999, 2020-05-18T21:30:26.640 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 46, 2020-05-18T21:30:26.640 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 75, 2020-05-18T21:30:26.640 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 75, 2020-05-18T21:30:26.640 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 6.9100580479999998 2020-05-18T21:30:26.641 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:30:26.654 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 6834, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.9881068769999999, "mdsmap_epoch": 46, "osdmap_epoch": 75, "osdmap_epoch_barrier": 75, "uptime": 6.9100580479999998 } 2020-05-18T21:30:26.655 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:30:26.655 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:30:26.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:26.656 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:30:26.664 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:30:26.665 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:30:26.665 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:30:26.665 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:30:26.665 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:30:26.666 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:30:26.666 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:30:26.666 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:30:26.666 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:30:26.666 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:30:26.667 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:30:26.667 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:30:26.667 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:30:26.667 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:30:26.667 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:30:26.667 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42616sec preferred_lft 42616sec 2020-05-18T21:30:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:30:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:30:26.668 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:30:26.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:26.669 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:30:26.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:26.689 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:30:26.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:26.702 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:30:26.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:26.765 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:30:26.780 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:30:26.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:26.782 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:30:26.832 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:30:26.833 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:30:26.833 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:30:26.833 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:30:26.833 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:30:26.834 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:30:26.834 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:30:26.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:26.835 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:30:26.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:26.859 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:30:26.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:26.879 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:30:26.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:26.939 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:30:26.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:26.947 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:30:26.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:26.953 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:30:26.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:26.970 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-05-18T21:30:26.987 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-05-18T21:30:26.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:26.988 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-05-18T21:30:27.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:27.047 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:30:27.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:27.065 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-05-18T21:30:27.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:27.080 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-05-18T21:30:27.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:27.145 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-05-18T21:30:27.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:27.160 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 up' 2020-05-18T21:30:27.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:30:27.175 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.0 master ceph-brx' 2020-05-18T21:30:27.233 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-05-18T21:30:27.234 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-05-18T21:30:27.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:27.235 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:30:27.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:27.243 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:30:27.260 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:30:27.261 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:30:27.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:27.262 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:30:27.310 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:30:27.311 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:30:27.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:27.314 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:30:27.330 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:30:27.331 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:30:27.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:27.333 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:30:27.392 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2020-05-18T21:30:27.385+0000 7fb5f20a8080 -1 init, newargv = 0x562e9e363530 newargc=9 2020-05-18T21:30:27.392 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[24648]: starting ceph client 2020-05-18T21:30:27.402 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[24648]: starting fuse 2020-05-18T21:30:28.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:28.480 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:30:28.498 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:30:28.500 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:30:28.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:28.501 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:30:28.547 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:30:28.547 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:30:28.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:28.548 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:30:28.549 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:30:28.549 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:30:28.550 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:30:28.550 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:30:28.551 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:30:28.551 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:30:28.551 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:30:28.552 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:30:28.552 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:30:28.553 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:30:28.553 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:30:28.554 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:30:28.554 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:30:28.554 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:30:28.555 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:30:28.555 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:30:28.556 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:30:28.556 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:30:28.556 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:30:28.557 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:30:28.557 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:30:28.558 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:30:28.603 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.24648.asok 2020-05-18T21:30:28.608 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.24648.asok 2020-05-18T21:30:28.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:28.609 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.24648.asok status 2020-05-18T21:30:28.700 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:30:28.700 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:30:28.701 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:30:28.701 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:30:28.701 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:30:28.701 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:30:28.702 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:30:28.702 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "24648", 2020-05-18T21:30:28.702 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:30:28.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:28.702 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:30:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:30:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 6936, 2020-05-18T21:30:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:30:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:30:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:30:28.704 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 6936 2020-05-18T21:30:28.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:28.704 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:30:28.704 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:30:28.704 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:30:28.704 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2654939773 2020-05-18T21:30:28.705 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:28.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:28.705 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:30:28.705 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:30:28.705 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:30:28.706 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2654939773 2020-05-18T21:30:28.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:30:28.706 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.6936 192.168.0.1:0/2654939773", 2020-05-18T21:30:28.706 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/2654939773", 2020-05-18T21:30:28.707 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:30:28.707 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 46, 2020-05-18T21:30:28.707 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 75, 2020-05-18T21:30:28.707 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:30:28.707 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:30:28.708 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:30:28.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:28.710 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:30:28.711 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:30:28.717 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:30:28.718 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-05-18T21:30:28.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:30:28.719 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:30:28.737 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rm -f dir_1/file_a) 2020-05-18T21:30:28.766 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:30:28.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.869+0000 7f461e9d2700 1 Processor -- start 2020-05-18T21:30:28.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.869+0000 7f461e9d2700 1 -- start start 2020-05-18T21:30:28.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f461e9d2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f46180b2860 0x7f46180615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:28.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f461e9d2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f461814e570 0x7f461814a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:28.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f461e9d2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461814d960 con 0x7f4618060b90 2020-05-18T21:30:28.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f461e9d2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4618066210 con 0x7f46180b2860 2020-05-18T21:30:28.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f461e9d2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461814db90 con 0x7f461814e570 2020-05-18T21:30:28.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f46177fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f46180b2860 0x7f46180615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:28.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f46177fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f46180b2860 0x7f46180615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57572/0 (socket says 172.21.15.63:57572) 2020-05-18T21:30:28.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f46177fe700 1 -- 172.21.15.63:0/1647321749 learned_addr learned my addr 172.21.15.63:0/1647321749 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:28.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f461cf6f700 1 --2- 172.21.15.63:0/1647321749 >> v2:172.21.15.155:3300/0 conn(0x7f461814e570 0x7f461814a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:28.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f46177fe700 1 -- 172.21.15.63:0/1647321749 >> v2:172.21.15.155:3300/0 conn(0x7f461814e570 msgr2=0x7f461814a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:28.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f46177fe700 1 --2- 172.21.15.63:0/1647321749 >> v2:172.21.15.155:3300/0 conn(0x7f461814e570 0x7f461814a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:28.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f46177fe700 1 -- 172.21.15.63:0/1647321749 >> v1:172.21.15.155:6789/0 conn(0x7f4618060b90 legacy=0x7f4618144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:28.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f46177fe700 1 -- 172.21.15.63:0/1647321749 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461814de30 con 0x7f46180b2860 2020-05-18T21:30:28.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f46177fe700 1 --2- 172.21.15.63:0/1647321749 >> v2:172.21.15.63:3300/0 conn(0x7f46180b2860 0x7f46180615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4608002f70 tx=0x7f4608007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:28.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f46177fe700 1 --2- 172.21.15.63:0/1647321749 >> v2:172.21.15.63:3300/0 conn(0x7f46180b2860 0x7f46180615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4608002f70 tx=0x7f4608007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:28.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f46177fe700 1 --2- 172.21.15.63:0/1647321749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46180b2860 0x7f46180615e0 secure :-1 s=READY pgs=924 cs=0 l=1 rx=0x7f4608002f70 tx=0x7f4608007a80).ready entity=mon.0 client_cookie=188b9acf8893494f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:28.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f46177fe700 1 --2- 172.21.15.63:0/1647321749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46180b2860 0x7f46180615e0 secure :-1 s=THROTTLE_DONE pgs=924 cs=0 l=1 rx=0x7f4608002f70 tx=0x7f4608007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:28.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f4616ffd700 1 -- 172.21.15.63:0/1647321749 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4608011760 con 0x7f46180b2860 2020-05-18T21:30:28.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f46177fe700 1 --2- 172.21.15.63:0/1647321749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46180b2860 0x7f46180615e0 secure :-1 s=THROTTLE_DONE pgs=924 cs=0 l=1 rx=0x7f4608002f70 tx=0x7f4608007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:28.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f4616ffd700 1 -- 172.21.15.63:0/1647321749 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46080118c0 con 0x7f46180b2860 2020-05-18T21:30:28.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f46177fe700 1 --2- 172.21.15.63:0/1647321749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46180b2860 0x7f46180615e0 secure :-1 s=THROTTLE_DONE pgs=924 cs=0 l=1 rx=0x7f4608002f70 tx=0x7f4608007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:28.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f4616ffd700 1 -- 172.21.15.63:0/1647321749 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4608011ce0 con 0x7f46180b2860 2020-05-18T21:30:28.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f461e9d2700 1 -- 172.21.15.63:0/1647321749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46180b2860 msgr2=0x7f46180615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:28.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f461e9d2700 1 --2- 172.21.15.63:0/1647321749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46180b2860 0x7f46180615e0 secure :-1 s=READY pgs=924 cs=0 l=1 rx=0x7f4608002f70 tx=0x7f4608007a80).stop 2020-05-18T21:30:28.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f461e9d2700 1 -- 172.21.15.63:0/1647321749 shutdown_connections 2020-05-18T21:30:28.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f461e9d2700 1 --2- 172.21.15.63:0/1647321749 >> v2:172.21.15.155:3300/0 conn(0x7f461814e570 0x7f461814a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:28.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f461e9d2700 1 --2- 172.21.15.63:0/1647321749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46180b2860 0x7f46180615e0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:28.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f461e9d2700 1 -- 172.21.15.63:0/1647321749 >> 172.21.15.63:0/1647321749 conn(0x7f46180b83d0 msgr2=0x7f46180b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:28.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f461e9d2700 1 -- 172.21.15.63:0/1647321749 shutdown_connections 2020-05-18T21:30:28.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.873+0000 7f461e9d2700 1 -- 172.21.15.63:0/1647321749 wait complete. 2020-05-18T21:30:28.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f461e9d2700 1 Processor -- start 2020-05-18T21:30:28.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f461e9d2700 1 -- start start 2020-05-18T21:30:28.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f461e9d2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f461814e570 0x7f4618149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:28.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f461e9d2700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4618146400 con 0x7f4618060b90 2020-05-18T21:30:28.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f461e9d2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46181466a0 con 0x7f46180b2860 2020-05-18T21:30:28.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f461e9d2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4618146940 con 0x7f461814e570 2020-05-18T21:30:28.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f4617fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4618060b90 0x7f4618157ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59766/0 (socket says 172.21.15.63:59766) 2020-05-18T21:30:28.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f4617fff700 1 -- 172.21.15.63:0/335920855 learned_addr learned my addr 172.21.15.63:0/335920855 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:28.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f461cf6f700 1 --2- 172.21.15.63:0/335920855 >> v2:172.21.15.63:3300/0 conn(0x7f461814e570 0x7f4618149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:28.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f46157fa700 1 -- 172.21.15.63:0/335920855 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968052998 0 0) 0x7f4618146400 con 0x7f4618060b90 2020-05-18T21:30:28.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f46157fa700 1 -- 172.21.15.63:0/335920855 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45fc002fe0 con 0x7f4618060b90 2020-05-18T21:30:28.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f461cf6f700 1 -- 172.21.15.63:0/335920855 >> v1:172.21.15.155:6789/0 conn(0x7f46180b2860 legacy=0x7f4618143650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:28.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f46157fa700 1 -- 172.21.15.63:0/335920855 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382042971 0 0) 0x7f46181466a0 con 0x7f46180b2860 2020-05-18T21:30:28.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f461cf6f700 1 -- 172.21.15.63:0/335920855 >> v1:172.21.15.63:6789/0 conn(0x7f4618060b90 legacy=0x7f4618157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:28.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f461cf6f700 1 -- 172.21.15.63:0/335920855 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4618146be0 con 0x7f461814e570 2020-05-18T21:30:28.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f461cf6f700 1 --2- 172.21.15.63:0/335920855 >> v2:172.21.15.63:3300/0 conn(0x7f461814e570 0x7f4618149bd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f46100032f0 tx=0x7f4610010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:28.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f461cf6f700 1 --2- 172.21.15.63:0/335920855 >> v2:172.21.15.63:3300/0 conn(0x7f461814e570 0x7f4618149bd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f46100032f0 tx=0x7f4610010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:28.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f461cf6f700 1 --2- 172.21.15.63:0/335920855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461814e570 0x7f4618149bd0 secure :-1 s=READY pgs=926 cs=0 l=1 rx=0x7f46100032f0 tx=0x7f4610010e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:28.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f461cf6f700 1 --2- 172.21.15.63:0/335920855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461814e570 0x7f4618149bd0 secure :-1 s=THROTTLE_DONE pgs=926 cs=0 l=1 rx=0x7f46100032f0 tx=0x7f4610010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:28.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f461cf6f700 1 --2- 172.21.15.63:0/335920855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461814e570 0x7f4618149bd0 secure :-1 s=THROTTLE_DONE pgs=926 cs=0 l=1 rx=0x7f46100032f0 tx=0x7f4610010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:28.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f461cf6f700 1 --2- 172.21.15.63:0/335920855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461814e570 0x7f4618149bd0 secure :-1 s=THROTTLE_DONE pgs=926 cs=0 l=1 rx=0x7f46100032f0 tx=0x7f4610010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:28.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f46157fa700 1 -- 172.21.15.63:0/335920855 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4610005e60 con 0x7f461814e570 2020-05-18T21:30:28.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.877+0000 7f46157fa700 1 -- 172.21.15.63:0/335920855 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4610012990 con 0x7f461814e570 2020-05-18T21:30:28.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.881+0000 7f461e9d2700 1 -- 172.21.15.63:0/335920855 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46181581f0 con 0x7f461814e570 2020-05-18T21:30:28.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.881+0000 7f46157fa700 1 -- 172.21.15.63:0/335920855 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4610012cf0 con 0x7f461814e570 2020-05-18T21:30:28.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.881+0000 7f461e9d2700 1 -- 172.21.15.63:0/335920855 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46181487d0 con 0x7f461814e570 2020-05-18T21:30:28.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.881+0000 7f461e9d2700 1 -- 172.21.15.63:0/335920855 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4618146d70 con 0x7f461814e570 2020-05-18T21:30:28.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.881+0000 7f461cf6f700 1 --2- 172.21.15.63:0/335920855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461814e570 0x7f4618149bd0 secure :-1 s=THROTTLE_DONE pgs=926 cs=0 l=1 rx=0x7f46100032f0 tx=0x7f4610010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:28.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.881+0000 7f46157fa700 1 -- 172.21.15.63:0/335920855 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4610010190 con 0x7f461814e570 2020-05-18T21:30:28.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.881+0000 7f461cf6f700 1 --2- 172.21.15.63:0/335920855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461814e570 0x7f4618149bd0 secure :-1 s=THROTTLE_DONE pgs=926 cs=0 l=1 rx=0x7f46100032f0 tx=0x7f4610010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:28.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.881+0000 7f46157fa700 1 --2- 172.21.15.63:0/335920855 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f45fc04fdb0 0x7f45fc052270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:28.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.881+0000 7f46157fa700 1 -- 172.21.15.63:0/335920855 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f4610063dc0 con 0x7f461814e570 2020-05-18T21:30:28.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.881+0000 7f4617fff700 1 --2- 172.21.15.63:0/335920855 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f45fc04fdb0 0x7f45fc052270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:28.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.885+0000 7f4617fff700 1 --2- 172.21.15.63:0/335920855 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f45fc04fdb0 0x7f45fc052270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4600001110 tx=0x7f4600001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:28.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.885+0000 7f4617fff700 1 --2- 172.21.15.63:0/335920855 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f45fc04fdb0 0x7f45fc052270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4600001110 tx=0x7f4600001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:28.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.885+0000 7f4617fff700 1 --2- 172.21.15.63:0/335920855 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f45fc04fdb0 0x7f45fc052270 secure :-1 s=READY pgs=372 cs=0 l=1 rx=0x7f4600001110 tx=0x7f4600001800).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:28.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.889+0000 7f461cf6f700 1 --2- 172.21.15.63:0/335920855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461814e570 0x7f4618149bd0 secure :-1 s=THROTTLE_DONE pgs=926 cs=0 l=1 rx=0x7f46100032f0 tx=0x7f4610010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:28.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:28.889+0000 7f46157fa700 1 -- 172.21.15.63:0/335920855 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f461003e150 con 0x7f461814e570 2020-05-18T21:30:29.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.037+0000 7f461e9d2700 1 -- 172.21.15.63:0/335920855 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46180569e0 con 0x7f461814e570 2020-05-18T21:30:29.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.037+0000 7f461cf6f700 1 --2- 172.21.15.63:0/335920855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461814e570 0x7f4618149bd0 secure :-1 s=THROTTLE_DONE pgs=926 cs=0 l=1 rx=0x7f46100032f0 tx=0x7f4610010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:29.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.037+0000 7f46157fa700 1 -- 172.21.15.63:0/335920855 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7f4610041770 con 0x7f461814e570 2020-05-18T21:30:29.043 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:29.043 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:30:29.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.037+0000 7f461e9d2700 1 -- 172.21.15.63:0/335920855 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f45fc04fdb0 msgr2=0x7f45fc052270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:29.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.037+0000 7f461e9d2700 1 --2- 172.21.15.63:0/335920855 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f45fc04fdb0 0x7f45fc052270 secure :-1 s=READY pgs=372 cs=0 l=1 rx=0x7f4600001110 tx=0x7f4600001800).stop 2020-05-18T21:30:29.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.037+0000 7f461e9d2700 1 -- 172.21.15.63:0/335920855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461814e570 msgr2=0x7f4618149bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:29.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.037+0000 7f461e9d2700 1 --2- 172.21.15.63:0/335920855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461814e570 0x7f4618149bd0 secure :-1 s=READY pgs=926 cs=0 l=1 rx=0x7f46100032f0 tx=0x7f4610010e80).stop 2020-05-18T21:30:29.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.037+0000 7f461e9d2700 1 -- 172.21.15.63:0/335920855 shutdown_connections 2020-05-18T21:30:29.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.037+0000 7f461e9d2700 1 --2- 172.21.15.63:0/335920855 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f45fc04fdb0 0x7f45fc052270 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:29.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.037+0000 7f461e9d2700 1 --2- 172.21.15.63:0/335920855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461814e570 0x7f4618149bd0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:29.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.037+0000 7f461e9d2700 1 -- 172.21.15.63:0/335920855 >> 172.21.15.63:0/335920855 conn(0x7f46180b83d0 msgr2=0x7f46181442a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:29.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.037+0000 7f461e9d2700 1 -- 172.21.15.63:0/335920855 shutdown_connections 2020-05-18T21:30:29.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.037+0000 7f461e9d2700 1 -- 172.21.15.63:0/335920855 wait complete. 2020-05-18T21:30:29.046 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:30:29.055 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache num_strays 2020-05-18T21:30:29.149 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:30:29.149 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:30:29.150 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays": 1 2020-05-18T21:30:29.150 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:29.150 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:30:29.157 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "num_strays": 1 } } 2020-05-18T21:30:29.158 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:30:29.242 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:30:29.244 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:30:29.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.249+0000 7fa282052700 1 Processor -- start 2020-05-18T21:30:29.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.249+0000 7fa282052700 1 -- start start 2020-05-18T21:30:29.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa282052700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27c0b4f60 0x7fa27c149f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:29.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa282052700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa27c0637b0 con 0x7fa27c0b5c00 2020-05-18T21:30:29.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa282052700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa27c063a50 con 0x7fa27c146110 2020-05-18T21:30:29.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa282052700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0bb4a0 con 0x7fa27c0b4f60 2020-05-18T21:30:29.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa27c0b5c00 0x7fa27c0b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59774/0 (socket says 172.21.15.63:59774) 2020-05-18T21:30:29.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27b7fe700 1 -- 172.21.15.63:0/131561284 learned_addr learned my addr 172.21.15.63:0/131561284 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:29.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27affd700 1 --2- 172.21.15.63:0/131561284 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27c0b4f60 0x7fa27c149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:29.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27a7fc700 1 -- 172.21.15.63:0/131561284 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846697128 0 0) 0x7fa27c0637b0 con 0x7fa27c0b5c00 2020-05-18T21:30:29.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27a7fc700 1 -- 172.21.15.63:0/131561284 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa25c003270 con 0x7fa27c0b5c00 2020-05-18T21:30:29.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27a7fc700 1 -- 172.21.15.63:0/131561284 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1497508124 0 0) 0x7fa25c003270 con 0x7fa27c0b5c00 2020-05-18T21:30:29.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27a7fc700 1 -- 172.21.15.63:0/131561284 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27c0b4f60 msgr2=0x7fa27c149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:29.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27a7fc700 1 --2- 172.21.15.63:0/131561284 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27c0b4f60 0x7fa27c149f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:29.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27a7fc700 1 -- 172.21.15.63:0/131561284 >> v1:172.21.15.155:6789/0 conn(0x7fa27c146110 legacy=0x7fa27c146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:29.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27a7fc700 1 -- 172.21.15.63:0/131561284 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c063200 con 0x7fa27c0b5c00 2020-05-18T21:30:29.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27a7fc700 1 -- 172.21.15.63:0/131561284 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fa274001730 con 0x7fa27c0b5c00 2020-05-18T21:30:29.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27a7fc700 1 -- 172.21.15.63:0/131561284 >> v1:172.21.15.63:6789/0 conn(0x7fa27c0b5c00 legacy=0x7fa27c0b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:29.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27a7fc700 1 --2- 172.21.15.63:0/131561284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa25c003790 0x7fa25c003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:29.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27a7fc700 1 --2- 172.21.15.63:0/131561284 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27c0b4f60 0x7fa25c004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:29.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27a7fc700 1 --2- 172.21.15.63:0/131561284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa25c004970 0x7fa25c004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:29.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27a7fc700 1 -- 172.21.15.63:0/131561284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0bb4a0 con 0x7fa25c004970 2020-05-18T21:30:29.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27a7fc700 1 -- 172.21.15.63:0/131561284 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c005340 con 0x7fa25c003790 2020-05-18T21:30:29.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27a7fc700 1 -- 172.21.15.63:0/131561284 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c004160 con 0x7fa27c0b4f60 2020-05-18T21:30:29.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27bfff700 1 --2- 172.21.15.63:0/131561284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa25c004970 0x7fa25c004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:29.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27b7fe700 1 --2- 172.21.15.63:0/131561284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa25c003790 0x7fa25c003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:29.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27affd700 1 --2- 172.21.15.63:0/131561284 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27c0b4f60 0x7fa25c004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:29.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27bfff700 1 -- 172.21.15.63:0/131561284 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27c0b4f60 msgr2=0x7fa25c004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:29.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27bfff700 1 --2- 172.21.15.63:0/131561284 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27c0b4f60 0x7fa25c004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:29.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27bfff700 1 -- 172.21.15.63:0/131561284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa25c003790 msgr2=0x7fa25c003bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:29.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27bfff700 1 --2- 172.21.15.63:0/131561284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa25c003790 0x7fa25c003bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:29.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27bfff700 1 -- 172.21.15.63:0/131561284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c003270 con 0x7fa25c004970 2020-05-18T21:30:29.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27bfff700 1 --2- 172.21.15.63:0/131561284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa25c004970 0x7fa25c004df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa27c06abc0 tx=0x7fa26c010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:29.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27bfff700 1 --2- 172.21.15.63:0/131561284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa25c004970 0x7fa25c004df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa27c06abc0 tx=0x7fa26c010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:29.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27bfff700 1 --2- 172.21.15.63:0/131561284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa25c004970 0x7fa25c004df0 secure :-1 s=READY pgs=928 cs=0 l=1 rx=0x7fa27c06abc0 tx=0x7fa26c010160).ready entity=mon.0 client_cookie=730a746e1a9bb00b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:29.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27bfff700 1 --2- 172.21.15.63:0/131561284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa25c004970 0x7fa25c004df0 secure :-1 s=THROTTLE_DONE pgs=928 cs=0 l=1 rx=0x7fa27c06abc0 tx=0x7fa26c010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:29.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27a7fc700 1 -- 172.21.15.63:0/131561284 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa26c006c80 con 0x7fa25c004970 2020-05-18T21:30:29.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27bfff700 1 --2- 172.21.15.63:0/131561284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa25c004970 0x7fa25c004df0 secure :-1 s=THROTTLE_DONE pgs=928 cs=0 l=1 rx=0x7fa27c06abc0 tx=0x7fa26c010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:29.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27bfff700 1 --2- 172.21.15.63:0/131561284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa25c004970 0x7fa25c004df0 secure :-1 s=THROTTLE_DONE pgs=928 cs=0 l=1 rx=0x7fa27c06abc0 tx=0x7fa26c010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:29.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27a7fc700 1 -- 172.21.15.63:0/131561284 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26c006e20 con 0x7fa25c004970 2020-05-18T21:30:29.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27a7fc700 1 -- 172.21.15.63:0/131561284 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa26c002770 con 0x7fa25c004970 2020-05-18T21:30:29.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa282052700 1 -- 172.21.15.63:0/131561284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa25c004970 msgr2=0x7fa25c004df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:29.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa282052700 1 --2- 172.21.15.63:0/131561284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa25c004970 0x7fa25c004df0 secure :-1 s=READY pgs=928 cs=0 l=1 rx=0x7fa27c06abc0 tx=0x7fa26c010160).stop 2020-05-18T21:30:29.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa27bfff700 1 -- 172.21.15.63:0/131561284 reap_dead start 2020-05-18T21:30:29.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa282052700 1 -- 172.21.15.63:0/131561284 shutdown_connections 2020-05-18T21:30:29.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa282052700 1 -- 172.21.15.63:0/131561284 >> 172.21.15.63:0/131561284 conn(0x7fa27c0ba5c0 msgr2=0x7fa27c0ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:29.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa282052700 1 -- 172.21.15.63:0/131561284 shutdown_connections 2020-05-18T21:30:29.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.253+0000 7fa282052700 1 -- 172.21.15.63:0/131561284 wait complete. 2020-05-18T21:30:29.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa282052700 1 Processor -- start 2020-05-18T21:30:29.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa282052700 1 -- start start 2020-05-18T21:30:29.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa282052700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa27c1568a0 0x7fa27c0b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:29.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa282052700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27c1530a0 0x7fa27c153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:29.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa282052700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa27c1467b0 con 0x7fa27c152cc0 2020-05-18T21:30:29.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa282052700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa27c146a30 con 0x7fa27c1568a0 2020-05-18T21:30:29.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa282052700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c156e20 con 0x7fa27c1530a0 2020-05-18T21:30:29.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa27affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa27c1568a0 0x7fa27c0b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:29.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa27affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa27c1568a0 0x7fa27c0b1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57602/0 (socket says 172.21.15.63:57602) 2020-05-18T21:30:29.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa27affd700 1 -- 172.21.15.63:0/1352070631 learned_addr learned my addr 172.21.15.63:0/1352070631 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:29.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa27bfff700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27c1530a0 0x7fa27c153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:29.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa27affd700 1 -- 172.21.15.63:0/1352070631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27c1530a0 msgr2=0x7fa27c153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:29.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa27affd700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27c1530a0 0x7fa27c153530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:29.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa27affd700 1 -- 172.21.15.63:0/1352070631 >> v1:172.21.15.155:6789/0 conn(0x7fa27c152cc0 legacy=0x7fa27c145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:29.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa27affd700 1 -- 172.21.15.63:0/1352070631 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c1570c0 con 0x7fa27c1568a0 2020-05-18T21:30:29.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa27affd700 1 --2- 172.21.15.63:0/1352070631 >> v2:172.21.15.63:3300/0 conn(0x7fa27c1568a0 0x7fa27c0b1700 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:29.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa27affd700 1 --2- 172.21.15.63:0/1352070631 >> v2:172.21.15.63:3300/0 conn(0x7fa27c1568a0 0x7fa27c0b1700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:29.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa27affd700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa27c1568a0 0x7fa27c0b1700 secure :-1 s=READY pgs=929 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:29.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa27affd700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa27c1568a0 0x7fa27c0b1700 secure :-1 s=THROTTLE_DONE pgs=929 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:29.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa27affd700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa27c1568a0 0x7fa27c0b1700 secure :-1 s=THROTTLE_DONE pgs=929 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:29.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa27affd700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa27c1568a0 0x7fa27c0b1700 secure :-1 s=THROTTLE_DONE pgs=929 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:29.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa278ff9700 1 -- 172.21.15.63:0/1352070631 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa264007550 con 0x7fa27c1568a0 2020-05-18T21:30:29.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa278ff9700 1 -- 172.21.15.63:0/1352070631 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa264005700 con 0x7fa27c1568a0 2020-05-18T21:30:29.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa282052700 1 -- 172.21.15.63:0/1352070631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa27c157360 con 0x7fa27c1568a0 2020-05-18T21:30:29.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa278ff9700 1 -- 172.21.15.63:0/1352070631 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa264005ae0 con 0x7fa27c1568a0 2020-05-18T21:30:29.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa282052700 1 -- 172.21.15.63:0/1352070631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27c153990 con 0x7fa27c1568a0 2020-05-18T21:30:29.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa27affd700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa27c1568a0 0x7fa27c0b1700 secure :-1 s=THROTTLE_DONE pgs=929 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:29.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa282052700 1 -- 172.21.15.63:0/1352070631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa27c1574f0 con 0x7fa27c1568a0 2020-05-18T21:30:29.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa278ff9700 1 -- 172.21.15.63:0/1352070631 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa26400f0b0 con 0x7fa27c1568a0 2020-05-18T21:30:29.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.257+0000 7fa27affd700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa27c1568a0 0x7fa27c0b1700 secure :-1 s=THROTTLE_DONE pgs=929 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:29.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.261+0000 7fa278ff9700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa26004f950 0x7fa260051e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:29.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.261+0000 7fa278ff9700 1 -- 172.21.15.63:0/1352070631 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa264063c90 con 0x7fa27c1568a0 2020-05-18T21:30:29.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.261+0000 7fa27b7fe700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa26004f950 0x7fa260051e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:29.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.261+0000 7fa27b7fe700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa26004f950 0x7fa260051e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa27c0650d0 tx=0x7fa27c05ead0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:29.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.261+0000 7fa27b7fe700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa26004f950 0x7fa260051e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa27c0650d0 tx=0x7fa27c05ead0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:29.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.261+0000 7fa27b7fe700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa26004f950 0x7fa260051e10 secure :-1 s=READY pgs=373 cs=0 l=1 rx=0x7fa27c0650d0 tx=0x7fa27c05ead0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:29.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.265+0000 7fa27affd700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa27c1568a0 0x7fa27c0b1700 secure :-1 s=THROTTLE_DONE pgs=929 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:29.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.265+0000 7fa278ff9700 1 -- 172.21.15.63:0/1352070631 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa26403dfc0 con 0x7fa27c1568a0 2020-05-18T21:30:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.409+0000 7fa282052700 1 -- 172.21.15.63:0/1352070631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa27c0569e0 con 0x7fa27c1568a0 2020-05-18T21:30:29.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.413+0000 7fa27affd700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa27c1568a0 0x7fa27c0b1700 secure :-1 s=THROTTLE_DONE pgs=929 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:29.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.413+0000 7fa278ff9700 1 -- 172.21.15.63:0/1352070631 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7fa2640415e0 con 0x7fa27c1568a0 2020-05-18T21:30:29.418 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:29.418 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:30:29.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.413+0000 7fa282052700 1 -- 172.21.15.63:0/1352070631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa26004f950 msgr2=0x7fa260051e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:29.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.413+0000 7fa282052700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa26004f950 0x7fa260051e10 secure :-1 s=READY pgs=373 cs=0 l=1 rx=0x7fa27c0650d0 tx=0x7fa27c05ead0).stop 2020-05-18T21:30:29.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.413+0000 7fa282052700 1 -- 172.21.15.63:0/1352070631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa27c1568a0 msgr2=0x7fa27c0b1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:29.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.413+0000 7fa282052700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa27c1568a0 0x7fa27c0b1700 secure :-1 s=READY pgs=929 cs=0 l=1 rx=0x7fa264002f70 tx=0x7fa264010bd0).stop 2020-05-18T21:30:29.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.413+0000 7fa282052700 1 -- 172.21.15.63:0/1352070631 shutdown_connections 2020-05-18T21:30:29.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.413+0000 7fa282052700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa26004f950 0x7fa260051e10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:29.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.413+0000 7fa282052700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa27c1530a0 0x7fa27c153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:29.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.413+0000 7fa282052700 1 --2- 172.21.15.63:0/1352070631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa27c1568a0 0x7fa27c0b1700 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:29.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.413+0000 7fa282052700 1 -- 172.21.15.63:0/1352070631 >> 172.21.15.63:0/1352070631 conn(0x7fa27c0ba5c0 msgr2=0x7fa27c0606d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:29.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.413+0000 7fa282052700 1 -- 172.21.15.63:0/1352070631 shutdown_connections 2020-05-18T21:30:29.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:29.413+0000 7fa282052700 1 -- 172.21.15.63:0/1352070631 wait complete. 2020-05-18T21:30:29.422 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:30:29.430 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_created 2020-05-18T21:30:29.528 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:30:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:30:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_created": 1 2020-05-18T21:30:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:30:29.529 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:30:29.536 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_created": 1 } } 2020-05-18T21:30:59.292 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:30:59.296 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:30:59.537 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_data ls 2020-05-18T21:30:59.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.565+0000 7fc69c304b80 1 Processor -- start 2020-05-18T21:30:59.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.565+0000 7fc69c304b80 1 -- start start 2020-05-18T21:30:59.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.565+0000 7fc69c304b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x55ffaa639390 0x55ffaa657070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:59.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.565+0000 7fc69c304b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ffaa6dee70 0x55ffaa63df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:59.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.565+0000 7fc69c304b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55ffaa5b84b0 con 0x55ffaa658570 2020-05-18T21:30:59.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.565+0000 7fc69c304b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ffaa5a4110 con 0x55ffaa639390 2020-05-18T21:30:59.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.565+0000 7fc69c304b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ffaa594a40 con 0x55ffaa6dee70 2020-05-18T21:30:59.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.565+0000 7fc699f46700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x55ffaa658570 0x55ffaa6efbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59802/0 (socket says 172.21.15.63:59802) 2020-05-18T21:30:59.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.565+0000 7fc699f46700 1 -- 172.21.15.63:0/155905531 learned_addr learned my addr 172.21.15.63:0/155905531 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:59.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.565+0000 7fc69af48700 1 --2- 172.21.15.63:0/155905531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ffaa6dee70 0x55ffaa63df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:59.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69a747700 1 --2- 172.21.15.63:0/155905531 >> v2:172.21.15.155:3300/0 conn(0x55ffaa639390 0x55ffaa657070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:59.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc693fff700 1 -- 172.21.15.63:0/155905531 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471869529 0 0) 0x55ffaa5b84b0 con 0x55ffaa658570 2020-05-18T21:30:59.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc693fff700 1 -- 172.21.15.63:0/155905531 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc67c002020 con 0x55ffaa658570 2020-05-18T21:30:59.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69af48700 1 -- 172.21.15.63:0/155905531 >> v2:172.21.15.155:3300/0 conn(0x55ffaa639390 msgr2=0x55ffaa657070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:59.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69af48700 1 --2- 172.21.15.63:0/155905531 >> v2:172.21.15.155:3300/0 conn(0x55ffaa639390 0x55ffaa657070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:59.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69af48700 1 -- 172.21.15.63:0/155905531 >> v1:172.21.15.63:6789/0 conn(0x55ffaa658570 legacy=0x55ffaa6efbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:59.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69af48700 1 -- 172.21.15.63:0/155905531 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffaa598460 con 0x55ffaa6dee70 2020-05-18T21:30:59.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69a747700 1 --2- 172.21.15.63:0/155905531 >> v2:172.21.15.155:3300/0 conn(0x55ffaa639390 0x55ffaa657070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:30:59.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69af48700 1 --2- 172.21.15.63:0/155905531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ffaa6dee70 0x55ffaa63df50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc6940032f0 tx=0x7fc69400ab90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69af48700 1 --2- 172.21.15.63:0/155905531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ffaa6dee70 0x55ffaa63df50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc6940032f0 tx=0x7fc69400ab90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69af48700 1 --2- 172.21.15.63:0/155905531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ffaa6dee70 0x55ffaa63df50 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7fc6940032f0 tx=0x7fc69400ab90).ready entity=mon.2 client_cookie=9f5d796766277d6e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:59.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69af48700 1 --2- 172.21.15.63:0/155905531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ffaa6dee70 0x55ffaa63df50 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fc6940032f0 tx=0x7fc69400ab90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc693fff700 1 -- 172.21.15.63:0/155905531 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc694010800 con 0x55ffaa6dee70 2020-05-18T21:30:59.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69af48700 1 --2- 172.21.15.63:0/155905531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ffaa6dee70 0x55ffaa63df50 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fc6940032f0 tx=0x7fc69400ab90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc693fff700 1 -- 172.21.15.63:0/155905531 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc694010960 con 0x55ffaa6dee70 2020-05-18T21:30:59.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69af48700 1 --2- 172.21.15.63:0/155905531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ffaa6dee70 0x55ffaa63df50 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fc6940032f0 tx=0x7fc69400ab90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69c304b80 1 -- 172.21.15.63:0/155905531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ffaa6dee70 msgr2=0x55ffaa63df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:59.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc693fff700 1 -- 172.21.15.63:0/155905531 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc694010cc0 con 0x55ffaa6dee70 2020-05-18T21:30:59.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69c304b80 1 --2- 172.21.15.63:0/155905531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ffaa6dee70 0x55ffaa63df50 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7fc6940032f0 tx=0x7fc69400ab90).stop 2020-05-18T21:30:59.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69c304b80 1 -- 172.21.15.63:0/155905531 shutdown_connections 2020-05-18T21:30:59.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69c304b80 1 --2- 172.21.15.63:0/155905531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ffaa6dee70 0x55ffaa63df50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:59.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69c304b80 1 --2- 172.21.15.63:0/155905531 >> v2:172.21.15.155:3300/0 conn(0x55ffaa639390 0x55ffaa657070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:59.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69c304b80 1 -- 172.21.15.63:0/155905531 >> 172.21.15.63:0/155905531 conn(0x55ffaa659640 msgr2=0x55ffaa6e79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:59.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69c304b80 1 -- 172.21.15.63:0/155905531 shutdown_connections 2020-05-18T21:30:59.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.569+0000 7fc69c304b80 1 -- 172.21.15.63:0/155905531 wait complete. 2020-05-18T21:30:59.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.573+0000 7fc69c304b80 1 Processor -- start 2020-05-18T21:30:59.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.573+0000 7fc69c304b80 1 -- start start 2020-05-18T21:30:59.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.573+0000 7fc69c304b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ffaa639390 0x55ffaa6ed610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:59.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.573+0000 7fc69c304b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55ffaa658570 0x55ffaa6562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:59.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.573+0000 7fc69c304b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55ffaa654c90 con 0x55ffaa6dee70 2020-05-18T21:30:59.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.573+0000 7fc69c304b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ffaa6de2d0 con 0x55ffaa658570 2020-05-18T21:30:59.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.573+0000 7fc69c304b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ffaa653eb0 con 0x55ffaa639390 2020-05-18T21:30:59.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.573+0000 7fc69af48700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x55ffaa6dee70 0x55ffaa6ee4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59810/0 (socket says 172.21.15.63:59810) 2020-05-18T21:30:59.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.573+0000 7fc69af48700 1 -- 172.21.15.63:0/3113015511 learned_addr learned my addr 172.21.15.63:0/3113015511 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:30:59.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.573+0000 7fc699f46700 1 --2- 172.21.15.63:0/3113015511 >> v2:172.21.15.63:3300/0 conn(0x55ffaa658570 0x55ffaa6562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:59.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.573+0000 7fc69a747700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ffaa639390 0x55ffaa6ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:59.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.573+0000 7fc6937fe700 1 -- 172.21.15.63:0/3113015511 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884007272 0 0) 0x55ffaa654c90 con 0x55ffaa6dee70 2020-05-18T21:30:59.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.573+0000 7fc6937fe700 1 -- 172.21.15.63:0/3113015511 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc67c002260 con 0x55ffaa6dee70 2020-05-18T21:30:59.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.573+0000 7fc699f46700 1 -- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ffaa639390 msgr2=0x55ffaa6ed610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:59.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.573+0000 7fc699f46700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ffaa639390 0x55ffaa6ed610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:59.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.573+0000 7fc699f46700 1 -- 172.21.15.63:0/3113015511 >> v1:172.21.15.63:6789/0 conn(0x55ffaa6dee70 legacy=0x55ffaa6ee4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:59.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.573+0000 7fc6937fe700 1 -- 172.21.15.63:0/3113015511 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1497976012 0 0) 0x7fc67c002260 con 0x55ffaa6dee70 2020-05-18T21:30:59.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.573+0000 7fc699f46700 1 -- 172.21.15.63:0/3113015511 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffaa6de570 con 0x55ffaa658570 2020-05-18T21:30:59.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.573+0000 7fc699f46700 1 --2- 172.21.15.63:0/3113015511 >> v2:172.21.15.63:3300/0 conn(0x55ffaa658570 0x55ffaa6562e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc684001250 tx=0x7fc68400f800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.577+0000 7fc699f46700 1 --2- 172.21.15.63:0/3113015511 >> v2:172.21.15.63:3300/0 conn(0x55ffaa658570 0x55ffaa6562e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc684001250 tx=0x7fc68400f800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.577+0000 7fc699f46700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ffaa658570 0x55ffaa6562e0 secure :-1 s=READY pgs=933 cs=0 l=1 rx=0x7fc684001250 tx=0x7fc68400f800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:59.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.577+0000 7fc699f46700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ffaa658570 0x55ffaa6562e0 secure :-1 s=THROTTLE_DONE pgs=933 cs=0 l=1 rx=0x7fc684001250 tx=0x7fc68400f800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.577+0000 7fc6937fe700 1 -- 172.21.15.63:0/3113015511 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc68400d640 con 0x55ffaa658570 2020-05-18T21:30:59.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.577+0000 7fc699f46700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ffaa658570 0x55ffaa6562e0 secure :-1 s=THROTTLE_DONE pgs=933 cs=0 l=1 rx=0x7fc684001250 tx=0x7fc68400f800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.577+0000 7fc699f46700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ffaa658570 0x55ffaa6562e0 secure :-1 s=THROTTLE_DONE pgs=933 cs=0 l=1 rx=0x7fc684001250 tx=0x7fc68400f800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.577+0000 7fc6937fe700 1 -- 172.21.15.63:0/3113015511 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68400d7a0 con 0x55ffaa658570 2020-05-18T21:30:59.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.577+0000 7fc6937fe700 1 -- 172.21.15.63:0/3113015511 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc68400db40 con 0x55ffaa658570 2020-05-18T21:30:59.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.577+0000 7fc69c304b80 1 -- 172.21.15.63:0/3113015511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ffaa656b90 con 0x55ffaa658570 2020-05-18T21:30:59.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.577+0000 7fc69c304b80 1 -- 172.21.15.63:0/3113015511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ffaa6568f0 con 0x55ffaa658570 2020-05-18T21:30:59.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.577+0000 7fc699f46700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ffaa658570 0x55ffaa6562e0 secure :-1 s=THROTTLE_DONE pgs=933 cs=0 l=1 rx=0x7fc684001250 tx=0x7fc68400f800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.577+0000 7fc6937fe700 1 -- 172.21.15.63:0/3113015511 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc68400e080 con 0x55ffaa658570 2020-05-18T21:30:59.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.577+0000 7fc699f46700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ffaa658570 0x55ffaa6562e0 secure :-1 s=THROTTLE_DONE pgs=933 cs=0 l=1 rx=0x7fc684001250 tx=0x7fc68400f800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.577+0000 7fc6937fe700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc67c04ec00 0x7fc67c0510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:59.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.577+0000 7fc6937fe700 1 -- 172.21.15.63:0/3113015511 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc684062620 con 0x55ffaa658570 2020-05-18T21:30:59.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.577+0000 7fc69a747700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc67c04ec00 0x7fc67c0510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:59.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.577+0000 7fc69c304b80 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x55ffaa6fdc90 0x55ffaa700080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:59.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.577+0000 7fc69c304b80 1 -- 172.21.15.63:0/3113015511 --> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] -- osd_op(unknown.0.0:1 14.0 14:00000000::::head [pgnls start_epoch 75 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e75) v8 -- 0x55ffaa7004e0 con 0x55ffaa6fdc90 2020-05-18T21:30:59.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.581+0000 7fc69a747700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc67c04ec00 0x7fc67c0510c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc6840018d0 tx=0x7fc68c002f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.581+0000 7fc69af48700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x55ffaa6fdc90 0x55ffaa700080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:59.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.581+0000 7fc69a747700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc67c04ec00 0x7fc67c0510c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc6840018d0 tx=0x7fc68c002f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.581+0000 7fc69a747700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc67c04ec00 0x7fc67c0510c0 secure :-1 s=READY pgs=374 cs=0 l=1 rx=0x7fc6840018d0 tx=0x7fc68c002f50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:59.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.581+0000 7fc69af48700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x55ffaa6fdc90 0x55ffaa700080 crc :-1 s=READY pgs=12 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:59.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.581+0000 7fc69af48700 1 -- 172.21.15.63:0/3113015511 <== osd.2 v2:172.21.15.63:6822/12806 1 ==== osd_op_reply(1 [pgnls start_epoch 75 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc694010c10 con 0x55ffaa6fdc90 2020-05-18T21:30:59.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.581+0000 7fc69af48700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7fc694004b30 0x7fc69400c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:59.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.581+0000 7fc69af48700 1 -- 172.21.15.63:0/3113015511 --> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] -- osd_op(unknown.0.0:2 14.4 14:20000000::::head [pgnls start_epoch 75 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e75) v8 -- 0x55ffaa7004e0 con 0x7fc694004b30 2020-05-18T21:30:59.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.581+0000 7fc69a747700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7fc694004b30 0x7fc69400c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:59.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.581+0000 7fc69a747700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7fc694004b30 0x7fc69400c1f0 crc :-1 s=READY pgs=18 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:59.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.585+0000 7fc69a747700 1 -- 172.21.15.63:0/3113015511 <== osd.6 v2:172.21.15.155:6815/13025 1 ==== osd_op_reply(2 [pgnls start_epoch 75 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc68c0079e0 con 0x7fc694004b30 2020-05-18T21:30:59.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.585+0000 7fc69a747700 1 -- 172.21.15.63:0/3113015511 --> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] -- osd_op(unknown.0.0:3 14.2 14:40000000::::head [pgnls start_epoch 75 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e75) v8 -- 0x55ffaa7004e0 con 0x7fc694004b30 2020-05-18T21:30:59.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.585+0000 7fc69a747700 1 -- 172.21.15.63:0/3113015511 <== osd.6 v2:172.21.15.155:6815/13025 2 ==== osd_op_reply(3 [pgnls start_epoch 75 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc68c0079e0 con 0x7fc694004b30 2020-05-18T21:30:59.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.585+0000 7fc69a747700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7fc68c00c890 0x7fc68c00a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:59.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.585+0000 7fc69a747700 1 -- 172.21.15.63:0/3113015511 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- osd_op(unknown.0.0:4 14.6 14:60000000::::head [pgnls start_epoch 75 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e75) v8 -- 0x55ffaa7004e0 con 0x7fc68c00c890 2020-05-18T21:30:59.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.585+0000 7fc699f46700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7fc68c00c890 0x7fc68c00a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:59.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.585+0000 7fc699f46700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7fc68c00c890 0x7fc68c00a270 crc :-1 s=READY pgs=22 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:59.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.589+0000 7fc699f46700 1 -- 172.21.15.63:0/3113015511 <== osd.0 v2:172.21.15.63:6800/12803 1 ==== osd_op_reply(4 [pgnls start_epoch 75 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc68400ddb0 con 0x7fc68c00c890 2020-05-18T21:30:59.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.589+0000 7fc699f46700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fc68403fbc0 0x7fc68403f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:59.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.589+0000 7fc699f46700 1 -- 172.21.15.63:0/3113015511 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- osd_op(unknown.0.0:5 14.1 14:80000000::::head [pgnls start_epoch 75 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e75) v8 -- 0x55ffaa7004e0 con 0x7fc68403fbc0 2020-05-18T21:30:59.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.589+0000 7fc69af48700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fc68403fbc0 0x7fc68403f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:59.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.589+0000 7fc69af48700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fc68403fbc0 0x7fc68403f630 crc :-1 s=READY pgs=16 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:59.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.589+0000 7fc69af48700 1 -- 172.21.15.63:0/3113015511 <== osd.3 v2:172.21.15.63:6814/12805 1 ==== osd_op_reply(5 [pgnls start_epoch 75 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc694010c10 con 0x7fc68403fbc0 2020-05-18T21:30:59.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.589+0000 7fc69af48700 1 -- 172.21.15.63:0/3113015511 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- osd_op(unknown.0.0:6 14.5 14:a0000000::::head [pgnls start_epoch 75 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e75) v8 -- 0x55ffaa7004e0 con 0x7fc68c00c890 2020-05-18T21:30:59.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.593+0000 7fc699f46700 1 -- 172.21.15.63:0/3113015511 <== osd.0 v2:172.21.15.63:6800/12803 2 ==== osd_op_reply(6 [pgnls start_epoch 75 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc68400ddb0 con 0x7fc68c00c890 2020-05-18T21:30:59.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.593+0000 7fc699f46700 1 -- 172.21.15.63:0/3113015511 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- osd_op(unknown.0.0:7 14.3 14:c0000000::::head [pgnls start_epoch 75 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e75) v8 -- 0x55ffaa7004e0 con 0x7fc68c00c890 2020-05-18T21:30:59.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.593+0000 7fc699f46700 1 -- 172.21.15.63:0/3113015511 <== osd.0 v2:172.21.15.63:6800/12803 3 ==== osd_op_reply(7 [pgnls start_epoch 75 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc68400ddb0 con 0x7fc68c00c890 2020-05-18T21:30:59.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.593+0000 7fc699f46700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7fc68403ed30 0x7fc68403f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:59.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.593+0000 7fc699f46700 1 -- 172.21.15.63:0/3113015511 --> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] -- osd_op(unknown.0.0:8 14.7 14:e0000000::::head [pgnls start_epoch 75 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e75) v8 -- 0x55ffaa7004e0 con 0x7fc68403ed30 2020-05-18T21:30:59.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.593+0000 7fc69a747700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7fc68403ed30 0x7fc68403f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:59.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.593+0000 7fc69a747700 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7fc68403ed30 0x7fc68403f170 crc :-1 s=READY pgs=21 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:59.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69a747700 1 -- 172.21.15.63:0/3113015511 <== osd.5 v2:172.21.15.155:6808/13024 1 ==== osd_op_reply(8 [pgnls start_epoch 75 out=113b] v73'4 uv4 ondisk = 1) v8 ==== 144+0+113 (crc 0 0 0) 0x7fc68c0079e0 con 0x7fc68403ed30 2020-05-18T21:30:59.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 -- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7fc68c00c890 msgr2=0x7fc68c00a270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:59.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7fc68c00c890 0x7fc68c00a270 crc :-1 s=READY pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:59.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 -- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x55ffaa6fdc90 msgr2=0x55ffaa700080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:59.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x55ffaa6fdc90 0x55ffaa700080 crc :-1 s=READY pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:59.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 -- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fc68403fbc0 msgr2=0x7fc68403f630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:59.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fc68403fbc0 0x7fc68403f630 crc :-1 s=READY pgs=16 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:59.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 -- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7fc68403ed30 msgr2=0x7fc68403f170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:59.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7fc68403ed30 0x7fc68403f170 crc :-1 s=READY pgs=21 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:59.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 -- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7fc694004b30 msgr2=0x7fc69400c1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:59.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7fc694004b30 0x7fc69400c1f0 crc :-1 s=READY pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:59.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69af48700 1 -- 172.21.15.63:0/3113015511 reap_dead start 2020-05-18T21:30:59.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69af48700 1 -- 172.21.15.63:0/3113015511 reap_dead start 2020-05-18T21:30:59.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 -- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc67c04ec00 msgr2=0x7fc67c0510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:59.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc67c04ec00 0x7fc67c0510c0 secure :-1 s=READY pgs=374 cs=0 l=1 rx=0x7fc6840018d0 tx=0x7fc68c002f50).stop 2020-05-18T21:30:59.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 -- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ffaa658570 msgr2=0x55ffaa6562e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:59.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ffaa658570 0x55ffaa6562e0 secure :-1 s=READY pgs=933 cs=0 l=1 rx=0x7fc684001250 tx=0x7fc68400f800).stop 2020-05-18T21:30:59.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 -- 172.21.15.63:0/3113015511 shutdown_connections 2020-05-18T21:30:59.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc67c04ec00 0x7fc67c0510c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:59.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 --2- 172.21.15.63:0/3113015511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ffaa658570 0x55ffaa6562e0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:59.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 -- 172.21.15.63:0/3113015511 >> 172.21.15.63:0/3113015511 conn(0x55ffaa659640 msgr2=0x55ffaa63cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:59.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 -- 172.21.15.63:0/3113015511 shutdown_connections 2020-05-18T21:30:59.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.597+0000 7fc69c304b80 1 -- 172.21.15.63:0/3113015511 wait complete. 2020-05-18T21:30:59.637 INFO:teuthology.orchestra.run.smithi063.stdout:10000000001.00000000 2020-05-18T21:30:59.637 INFO:teuthology.orchestra.run.smithi063.stdout:10000000001.00000001 2020-05-18T21:30:59.637 INFO:tasks.cephfs.filesystem:All objects for ino 1099511627777 size 8388608 found 2020-05-18T21:30:59.638 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:30:59.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.745+0000 7fcd342f7700 1 Processor -- start 2020-05-18T21:30:59.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.745+0000 7fcd342f7700 1 -- start start 2020-05-18T21:30:59.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.745+0000 7fcd342f7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcd2c06a640 0x7fcd2c0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:59.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.745+0000 7fcd342f7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcd2c09c130 0x7fcd2c09c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:30:59.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.745+0000 7fcd342f7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2c0b5750 con 0x7fcd2c09e7f0 2020-05-18T21:30:59.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.745+0000 7fcd342f7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2c0b59f0 con 0x7fcd2c06a640 2020-05-18T21:30:59.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.745+0000 7fcd342f7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2c0b5c90 con 0x7fcd2c09c130 2020-05-18T21:30:59.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd31892700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcd2c06a640 0x7fcd2c0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:59.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd32894700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcd2c09c130 0x7fcd2c09c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:59.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd31892700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcd2c06a640 0x7fcd2c0b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57638/0 (socket says 172.21.15.63:57638) 2020-05-18T21:30:59.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd31892700 1 -- 172.21.15.63:0/1811623512 learned_addr learned my addr 172.21.15.63:0/1811623512 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:59.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd32093700 1 --1- 172.21.15.63:0/1811623512 >> v1:172.21.15.155:6789/0 conn(0x7fcd2c09e7f0 0x7fcd2c141ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:58140/0 (socket says 172.21.15.63:58140) 2020-05-18T21:30:59.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd31892700 1 -- 172.21.15.63:0/1811623512 >> v2:172.21.15.155:3300/0 conn(0x7fcd2c09c130 msgr2=0x7fcd2c09c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:30:59.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd31892700 1 --2- 172.21.15.63:0/1811623512 >> v2:172.21.15.155:3300/0 conn(0x7fcd2c09c130 0x7fcd2c09c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:59.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd31892700 1 -- 172.21.15.63:0/1811623512 >> v1:172.21.15.155:6789/0 conn(0x7fcd2c09e7f0 legacy=0x7fcd2c141ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:59.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd31892700 1 -- 172.21.15.63:0/1811623512 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c0b54a0 con 0x7fcd2c06a640 2020-05-18T21:30:59.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd31892700 1 --2- 172.21.15.63:0/1811623512 >> v2:172.21.15.63:3300/0 conn(0x7fcd2c06a640 0x7fcd2c0b5040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcd1c002f70 tx=0x7fcd1c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd31892700 1 --2- 172.21.15.63:0/1811623512 >> v2:172.21.15.63:3300/0 conn(0x7fcd2c06a640 0x7fcd2c0b5040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcd1c002f70 tx=0x7fcd1c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd31892700 1 --2- 172.21.15.63:0/1811623512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd2c06a640 0x7fcd2c0b5040 secure :-1 s=READY pgs=934 cs=0 l=1 rx=0x7fcd1c002f70 tx=0x7fcd1c007a80).ready entity=mon.0 client_cookie=6382a2fe9d2d0762 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:59.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd31892700 1 --2- 172.21.15.63:0/1811623512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd2c06a640 0x7fcd2c0b5040 secure :-1 s=THROTTLE_DONE pgs=934 cs=0 l=1 rx=0x7fcd1c002f70 tx=0x7fcd1c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd31091700 1 -- 172.21.15.63:0/1811623512 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd1c0116b0 con 0x7fcd2c06a640 2020-05-18T21:30:59.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd31892700 1 --2- 172.21.15.63:0/1811623512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd2c06a640 0x7fcd2c0b5040 secure :-1 s=THROTTLE_DONE pgs=934 cs=0 l=1 rx=0x7fcd1c002f70 tx=0x7fcd1c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd31892700 1 --2- 172.21.15.63:0/1811623512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd2c06a640 0x7fcd2c0b5040 secure :-1 s=THROTTLE_DONE pgs=934 cs=0 l=1 rx=0x7fcd1c002f70 tx=0x7fcd1c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd31091700 1 -- 172.21.15.63:0/1811623512 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c011810 con 0x7fcd2c06a640 2020-05-18T21:30:59.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd31091700 1 -- 172.21.15.63:0/1811623512 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd1c011c30 con 0x7fcd2c06a640 2020-05-18T21:30:59.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd342f7700 1 -- 172.21.15.63:0/1811623512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd2c06a640 msgr2=0x7fcd2c0b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:59.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd342f7700 1 --2- 172.21.15.63:0/1811623512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd2c06a640 0x7fcd2c0b5040 secure :-1 s=READY pgs=934 cs=0 l=1 rx=0x7fcd1c002f70 tx=0x7fcd1c007a80).stop 2020-05-18T21:30:59.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd342f7700 1 -- 172.21.15.63:0/1811623512 shutdown_connections 2020-05-18T21:30:59.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd342f7700 1 --2- 172.21.15.63:0/1811623512 >> v2:172.21.15.155:3300/0 conn(0x7fcd2c09c130 0x7fcd2c09c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:30:59.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd342f7700 1 --2- 172.21.15.63:0/1811623512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd2c06a640 0x7fcd2c0b5040 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:59.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd342f7700 1 -- 172.21.15.63:0/1811623512 >> 172.21.15.63:0/1811623512 conn(0x7fcd2c05b240 msgr2=0x7fcd2c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:59.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd342f7700 1 -- 172.21.15.63:0/1811623512 shutdown_connections 2020-05-18T21:30:59.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.749+0000 7fcd342f7700 1 -- 172.21.15.63:0/1811623512 wait complete. 2020-05-18T21:30:59.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd342f7700 1 Processor -- start 2020-05-18T21:30:59.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd342f7700 1 -- start start 2020-05-18T21:30:59.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd342f7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcd2c06a640 0x7fcd2c0b88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:59.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd342f7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcd2c09c130 0x7fcd2c152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:59.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd342f7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd2c09e7f0 0x7fcd2c156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:59.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd342f7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2c154560 con 0x7fcd2c06a640 2020-05-18T21:30:59.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd342f7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2c0b9310 con 0x7fcd2c09c130 2020-05-18T21:30:59.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd342f7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c153e60 con 0x7fcd2c09e7f0 2020-05-18T21:30:59.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd32093700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcd2c06a640 0x7fcd2c0b88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:59.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd32093700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcd2c06a640 0x7fcd2c0b88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57642/0 (socket says 172.21.15.63:57642) 2020-05-18T21:30:59.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd32093700 1 -- 172.21.15.63:0/4181635374 learned_addr learned my addr 172.21.15.63:0/4181635374 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:30:59.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd31892700 1 --2- 172.21.15.63:0/4181635374 >> v2:172.21.15.155:3300/0 conn(0x7fcd2c09c130 0x7fcd2c152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:59.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd32894700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd2c09e7f0 0x7fcd2c156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:59.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd32093700 1 -- 172.21.15.63:0/4181635374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd2c09e7f0 msgr2=0x7fcd2c156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:59.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd32093700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd2c09e7f0 0x7fcd2c156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:59.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd32093700 1 -- 172.21.15.63:0/4181635374 >> v2:172.21.15.155:3300/0 conn(0x7fcd2c09c130 msgr2=0x7fcd2c152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:59.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd32093700 1 --2- 172.21.15.63:0/4181635374 >> v2:172.21.15.155:3300/0 conn(0x7fcd2c09c130 0x7fcd2c152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:59.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd32093700 1 -- 172.21.15.63:0/4181635374 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c1540c0 con 0x7fcd2c06a640 2020-05-18T21:30:59.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd32093700 1 --2- 172.21.15.63:0/4181635374 >> v2:172.21.15.63:3300/0 conn(0x7fcd2c06a640 0x7fcd2c0b88a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcd28001040 tx=0x7fcd280109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd32093700 1 --2- 172.21.15.63:0/4181635374 >> v2:172.21.15.63:3300/0 conn(0x7fcd2c06a640 0x7fcd2c0b88a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcd28001040 tx=0x7fcd280109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd32093700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd2c06a640 0x7fcd2c0b88a0 secure :-1 s=READY pgs=935 cs=0 l=1 rx=0x7fcd28001040 tx=0x7fcd280109f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:59.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd32093700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd2c06a640 0x7fcd2c0b88a0 secure :-1 s=THROTTLE_DONE pgs=935 cs=0 l=1 rx=0x7fcd28001040 tx=0x7fcd280109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd32093700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd2c06a640 0x7fcd2c0b88a0 secure :-1 s=THROTTLE_DONE pgs=935 cs=0 l=1 rx=0x7fcd28001040 tx=0x7fcd280109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd32093700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd2c06a640 0x7fcd2c0b88a0 secure :-1 s=THROTTLE_DONE pgs=935 cs=0 l=1 rx=0x7fcd28001040 tx=0x7fcd280109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd1b7fe700 1 -- 172.21.15.63:0/4181635374 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd280115d0 con 0x7fcd2c06a640 2020-05-18T21:30:59.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd1b7fe700 1 -- 172.21.15.63:0/4181635374 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd28011730 con 0x7fcd2c06a640 2020-05-18T21:30:59.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd342f7700 1 -- 172.21.15.63:0/4181635374 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2c157810 con 0x7fcd2c06a640 2020-05-18T21:30:59.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.753+0000 7fcd1b7fe700 1 -- 172.21.15.63:0/4181635374 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd28011b10 con 0x7fcd2c06a640 2020-05-18T21:30:59.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.757+0000 7fcd342f7700 1 -- 172.21.15.63:0/4181635374 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2c156f90 con 0x7fcd2c06a640 2020-05-18T21:30:59.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.757+0000 7fcd32093700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd2c06a640 0x7fcd2c0b88a0 secure :-1 s=THROTTLE_DONE pgs=935 cs=0 l=1 rx=0x7fcd28001040 tx=0x7fcd280109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.757+0000 7fcd342f7700 1 -- 172.21.15.63:0/4181635374 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2c154270 con 0x7fcd2c06a640 2020-05-18T21:30:59.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.757+0000 7fcd1b7fe700 1 -- 172.21.15.63:0/4181635374 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fcd280071a0 con 0x7fcd2c06a640 2020-05-18T21:30:59.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.757+0000 7fcd32093700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd2c06a640 0x7fcd2c0b88a0 secure :-1 s=THROTTLE_DONE pgs=935 cs=0 l=1 rx=0x7fcd28001040 tx=0x7fcd280109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.757+0000 7fcd1b7fe700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcd0c04fa20 0x7fcd0c051ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:30:59.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.757+0000 7fcd1b7fe700 1 -- 172.21.15.63:0/4181635374 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fcd280637c0 con 0x7fcd2c06a640 2020-05-18T21:30:59.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.757+0000 7fcd31892700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcd0c04fa20 0x7fcd0c051ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:30:59.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.757+0000 7fcd31892700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcd0c04fa20 0x7fcd0c051ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcd1c002f70 tx=0x7fcd1c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.757+0000 7fcd31892700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcd0c04fa20 0x7fcd0c051ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcd1c002f70 tx=0x7fcd1c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.757+0000 7fcd31892700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcd0c04fa20 0x7fcd0c051ee0 secure :-1 s=READY pgs=375 cs=0 l=1 rx=0x7fcd1c002f70 tx=0x7fcd1c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:30:59.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.761+0000 7fcd32093700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd2c06a640 0x7fcd2c0b88a0 secure :-1 s=THROTTLE_DONE pgs=935 cs=0 l=1 rx=0x7fcd28001040 tx=0x7fcd280109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.761+0000 7fcd1b7fe700 1 -- 172.21.15.63:0/4181635374 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fcd2803db50 con 0x7fcd2c06a640 2020-05-18T21:30:59.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.909+0000 7fcd342f7700 1 -- 172.21.15.63:0/4181635374 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd2c0569e0 con 0x7fcd2c06a640 2020-05-18T21:30:59.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.909+0000 7fcd32093700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd2c06a640 0x7fcd2c0b88a0 secure :-1 s=THROTTLE_DONE pgs=935 cs=0 l=1 rx=0x7fcd28001040 tx=0x7fcd280109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:30:59.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.909+0000 7fcd1b7fe700 1 -- 172.21.15.63:0/4181635374 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7fcd28041170 con 0x7fcd2c06a640 2020-05-18T21:30:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:30:59.915 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:30:59.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.909+0000 7fcd342f7700 1 -- 172.21.15.63:0/4181635374 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcd0c04fa20 msgr2=0x7fcd0c051ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:59.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.913+0000 7fcd342f7700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcd0c04fa20 0x7fcd0c051ee0 secure :-1 s=READY pgs=375 cs=0 l=1 rx=0x7fcd1c002f70 tx=0x7fcd1c007a80).stop 2020-05-18T21:30:59.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.913+0000 7fcd342f7700 1 -- 172.21.15.63:0/4181635374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd2c06a640 msgr2=0x7fcd2c0b88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:30:59.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.913+0000 7fcd342f7700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd2c06a640 0x7fcd2c0b88a0 secure :-1 s=READY pgs=935 cs=0 l=1 rx=0x7fcd28001040 tx=0x7fcd280109f0).stop 2020-05-18T21:30:59.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.913+0000 7fcd342f7700 1 -- 172.21.15.63:0/4181635374 shutdown_connections 2020-05-18T21:30:59.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.913+0000 7fcd342f7700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcd0c04fa20 0x7fcd0c051ee0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:59.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.913+0000 7fcd342f7700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd2c09e7f0 0x7fcd2c156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:59.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.913+0000 7fcd342f7700 1 --2- 172.21.15.63:0/4181635374 >> v2:172.21.15.155:3300/0 conn(0x7fcd2c09c130 0x7fcd2c152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:59.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.913+0000 7fcd342f7700 1 --2- 172.21.15.63:0/4181635374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd2c06a640 0x7fcd2c0b88a0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:30:59.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.913+0000 7fcd342f7700 1 -- 172.21.15.63:0/4181635374 >> 172.21.15.63:0/4181635374 conn(0x7fcd2c05b240 msgr2=0x7fcd2c0610e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:30:59.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.913+0000 7fcd342f7700 1 -- 172.21.15.63:0/4181635374 shutdown_connections 2020-05-18T21:30:59.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:30:59.913+0000 7fcd342f7700 1 -- 172.21.15.63:0/4181635374 wait complete. 2020-05-18T21:30:59.919 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:30:59.927 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_enqueued 2020-05-18T21:31:00.032 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:00.033 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:31:00.033 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 0 2020-05-18T21:31:00.033 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:00.033 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:00.041 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_enqueued": 0 } } 2020-05-18T21:31:00.041 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:00.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.133+0000 7f556461a700 1 Processor -- start 2020-05-18T21:31:00.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.133+0000 7f556461a700 1 -- start start 2020-05-18T21:31:00.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.133+0000 7f556461a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f555c0b8640 0x7f555c065a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:00.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.133+0000 7f556461a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f555c14a180 0x7f555c0b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:00.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.133+0000 7f556461a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555c0af1b0 con 0x7f555c0acdc0 2020-05-18T21:31:00.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.133+0000 7f556461a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555c0ae7d0 con 0x7f555c0b8640 2020-05-18T21:31:00.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.133+0000 7f556461a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555c0aea70 con 0x7f555c14a180 2020-05-18T21:31:00.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.133+0000 7f5561bb5700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f555c0acdc0 0x7f555c149a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59838/0 (socket says 172.21.15.63:59838) 2020-05-18T21:31:00.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.133+0000 7f5561bb5700 1 -- 172.21.15.63:0/764780231 learned_addr learned my addr 172.21.15.63:0/764780231 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:00.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.133+0000 7f55623b6700 1 --2- 172.21.15.63:0/764780231 >> v2:172.21.15.63:3300/0 conn(0x7f555c0b8640 0x7f555c065a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:00.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.133+0000 7f5562bb7700 1 --2- 172.21.15.63:0/764780231 >> v2:172.21.15.155:3300/0 conn(0x7f555c14a180 0x7f555c0b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:00.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f55613b4700 1 -- 172.21.15.63:0/764780231 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102688385 0 0) 0x7f555c0af1b0 con 0x7f555c0acdc0 2020-05-18T21:31:00.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f55613b4700 1 -- 172.21.15.63:0/764780231 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5544003270 con 0x7f555c0acdc0 2020-05-18T21:31:00.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f55623b6700 1 -- 172.21.15.63:0/764780231 >> v2:172.21.15.155:3300/0 conn(0x7f555c14a180 msgr2=0x7f555c0b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:00.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f55623b6700 1 --2- 172.21.15.63:0/764780231 >> v2:172.21.15.155:3300/0 conn(0x7f555c14a180 0x7f555c0b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:00.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f55623b6700 1 -- 172.21.15.63:0/764780231 >> v1:172.21.15.63:6789/0 conn(0x7f555c0acdc0 legacy=0x7f555c149a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f55623b6700 1 -- 172.21.15.63:0/764780231 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555c0aed10 con 0x7f555c0b8640 2020-05-18T21:31:00.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f5562bb7700 1 --2- 172.21.15.63:0/764780231 >> v2:172.21.15.155:3300/0 conn(0x7f555c14a180 0x7f555c0b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:31:00.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f55623b6700 1 --2- 172.21.15.63:0/764780231 >> v2:172.21.15.63:3300/0 conn(0x7f555c0b8640 0x7f555c065a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f554c002f70 tx=0x7f554c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f55623b6700 1 --2- 172.21.15.63:0/764780231 >> v2:172.21.15.63:3300/0 conn(0x7f555c0b8640 0x7f555c065a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f554c002f70 tx=0x7f554c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f55623b6700 1 --2- 172.21.15.63:0/764780231 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f555c0b8640 0x7f555c065a10 secure :-1 s=READY pgs=937 cs=0 l=1 rx=0x7f554c002f70 tx=0x7f554c007a80).ready entity=mon.0 client_cookie=53b6958aa14e7600 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:00.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f55623b6700 1 --2- 172.21.15.63:0/764780231 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f555c0b8640 0x7f555c065a10 secure :-1 s=THROTTLE_DONE pgs=937 cs=0 l=1 rx=0x7f554c002f70 tx=0x7f554c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f55613b4700 1 -- 172.21.15.63:0/764780231 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f554c008e50 con 0x7f555c0b8640 2020-05-18T21:31:00.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f55623b6700 1 --2- 172.21.15.63:0/764780231 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f555c0b8640 0x7f555c065a10 secure :-1 s=THROTTLE_DONE pgs=937 cs=0 l=1 rx=0x7f554c002f70 tx=0x7f554c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f55613b4700 1 -- 172.21.15.63:0/764780231 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c011540 con 0x7f555c0b8640 2020-05-18T21:31:00.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f55623b6700 1 --2- 172.21.15.63:0/764780231 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f555c0b8640 0x7f555c065a10 secure :-1 s=THROTTLE_DONE pgs=937 cs=0 l=1 rx=0x7f554c002f70 tx=0x7f554c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f556461a700 1 -- 172.21.15.63:0/764780231 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f555c0b8640 msgr2=0x7f555c065a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f55613b4700 1 -- 172.21.15.63:0/764780231 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f554c011960 con 0x7f555c0b8640 2020-05-18T21:31:00.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f556461a700 1 --2- 172.21.15.63:0/764780231 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f555c0b8640 0x7f555c065a10 secure :-1 s=READY pgs=937 cs=0 l=1 rx=0x7f554c002f70 tx=0x7f554c007a80).stop 2020-05-18T21:31:00.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f556461a700 1 -- 172.21.15.63:0/764780231 shutdown_connections 2020-05-18T21:31:00.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f556461a700 1 --2- 172.21.15.63:0/764780231 >> v2:172.21.15.155:3300/0 conn(0x7f555c14a180 0x7f555c0b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:00.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f556461a700 1 --2- 172.21.15.63:0/764780231 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f555c0b8640 0x7f555c065a10 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:00.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f556461a700 1 -- 172.21.15.63:0/764780231 >> 172.21.15.63:0/764780231 conn(0x7f555c05edd0 msgr2=0x7f555c05f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:00.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f556461a700 1 -- 172.21.15.63:0/764780231 shutdown_connections 2020-05-18T21:31:00.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.137+0000 7f556461a700 1 -- 172.21.15.63:0/764780231 wait complete. 2020-05-18T21:31:00.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f556461a700 1 Processor -- start 2020-05-18T21:31:00.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f556461a700 1 -- start start 2020-05-18T21:31:00.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f556461a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f555c0acdc0 0x7f555c14a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:00.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f556461a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f555c0b8640 0x7f555c0b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:00.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f556461a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555c14b8a0 con 0x7f555c14a180 2020-05-18T21:31:00.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f556461a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555c0b1780 con 0x7f555c0b8640 2020-05-18T21:31:00.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f556461a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555c0b4b20 con 0x7f555c0acdc0 2020-05-18T21:31:00.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f5562bb7700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f555c14a180 0x7f555c143390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59846/0 (socket says 172.21.15.63:59846) 2020-05-18T21:31:00.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f5562bb7700 1 -- 172.21.15.63:0/2737338197 learned_addr learned my addr 172.21.15.63:0/2737338197 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:00.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f5561bb5700 1 --2- 172.21.15.63:0/2737338197 >> v2:172.21.15.155:3300/0 conn(0x7f555c0b8640 0x7f555c0b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:00.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f55623b6700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f555c0acdc0 0x7f555c14a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:00.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f554b7fe700 1 -- 172.21.15.63:0/2737338197 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109640346 0 0) 0x7f555c14b8a0 con 0x7f555c14a180 2020-05-18T21:31:00.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f554b7fe700 1 -- 172.21.15.63:0/2737338197 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f553c002fe0 con 0x7f555c14a180 2020-05-18T21:31:00.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f554b7fe700 1 -- 172.21.15.63:0/2737338197 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2143455083 0 0) 0x7f553c002fe0 con 0x7f555c14a180 2020-05-18T21:31:00.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f554b7fe700 1 -- 172.21.15.63:0/2737338197 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f555c14b8a0 con 0x7f555c14a180 2020-05-18T21:31:00.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f554b7fe700 1 -- 172.21.15.63:0/2737338197 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f5554001850 con 0x7f555c14a180 2020-05-18T21:31:00.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f554b7fe700 1 -- 172.21.15.63:0/2737338197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f555c0acdc0 msgr2=0x7f555c14a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f554b7fe700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f555c0acdc0 0x7f555c14a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:00.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f554b7fe700 1 -- 172.21.15.63:0/2737338197 >> v2:172.21.15.155:3300/0 conn(0x7f555c0b8640 msgr2=0x7f555c0b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f554b7fe700 1 --2- 172.21.15.63:0/2737338197 >> v2:172.21.15.155:3300/0 conn(0x7f555c0b8640 0x7f555c0b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:00.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f554b7fe700 1 -- 172.21.15.63:0/2737338197 >> v1:172.21.15.63:6789/0 conn(0x7f555c14a180 legacy=0x7f555c143390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f554b7fe700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f553c004a80 0x7f553c004ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:00.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f554b7fe700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f553c0039a0 0x7f553c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:00.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f554b7fe700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f553c004280 0x7f553c00b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:00.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f554b7fe700 1 -- 172.21.15.63:0/2737338197 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c0b1780 con 0x7f553c0039a0 2020-05-18T21:31:00.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f554b7fe700 1 -- 172.21.15.63:0/2737338197 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c0b4b20 con 0x7f553c004280 2020-05-18T21:31:00.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f554b7fe700 1 -- 172.21.15.63:0/2737338197 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553c004830 con 0x7f553c004a80 2020-05-18T21:31:00.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f5561bb5700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f553c0039a0 0x7f553c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:00.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f55623b6700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f553c004a80 0x7f553c004ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:00.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f5562bb7700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f553c004280 0x7f553c00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:00.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f5561bb5700 1 -- 172.21.15.63:0/2737338197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f553c004a80 msgr2=0x7f553c004ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f5561bb5700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f553c004a80 0x7f553c004ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:00.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f5561bb5700 1 -- 172.21.15.63:0/2737338197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f553c004280 msgr2=0x7f553c00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f5561bb5700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f553c004280 0x7f553c00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:00.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f5561bb5700 1 -- 172.21.15.63:0/2737338197 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555c14b600 con 0x7f553c0039a0 2020-05-18T21:31:00.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f556461a700 1 -- 172.21.15.63:0/2737338197 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555c14cdb0 con 0x7f553c0039a0 2020-05-18T21:31:00.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f556461a700 1 -- 172.21.15.63:0/2737338197 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555c143c40 con 0x7f553c0039a0 2020-05-18T21:31:00.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f5561bb5700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f553c0039a0 0x7f553c003e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5558001110 tx=0x7f555800c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f5561bb5700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f553c0039a0 0x7f553c003e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5558001110 tx=0x7f555800c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f5561bb5700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f553c0039a0 0x7f553c003e20 secure :-1 s=READY pgs=939 cs=0 l=1 rx=0x7f5558001110 tx=0x7f555800c600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:00.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f5561bb5700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f553c0039a0 0x7f553c003e20 secure :-1 s=THROTTLE_DONE pgs=939 cs=0 l=1 rx=0x7f5558001110 tx=0x7f555800c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f554b7fe700 1 -- 172.21.15.63:0/2737338197 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f555800c670 con 0x7f553c0039a0 2020-05-18T21:31:00.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f5561bb5700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f553c0039a0 0x7f553c003e20 secure :-1 s=THROTTLE_DONE pgs=939 cs=0 l=1 rx=0x7f5558001110 tx=0x7f555800c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f554b7fe700 1 -- 172.21.15.63:0/2737338197 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555800c7d0 con 0x7f553c0039a0 2020-05-18T21:31:00.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f5561bb5700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f553c0039a0 0x7f553c003e20 secure :-1 s=THROTTLE_DONE pgs=939 cs=0 l=1 rx=0x7f5558001110 tx=0x7f555800c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.141+0000 7f554b7fe700 1 -- 172.21.15.63:0/2737338197 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f555800cb30 con 0x7f553c0039a0 2020-05-18T21:31:00.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.145+0000 7f556461a700 1 -- 172.21.15.63:0/2737338197 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5538003380 con 0x7f553c0039a0 2020-05-18T21:31:00.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.145+0000 7f5561bb5700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f553c0039a0 0x7f553c003e20 secure :-1 s=THROTTLE_DONE pgs=939 cs=0 l=1 rx=0x7f5558001110 tx=0x7f555800c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.145+0000 7f554b7fe700 1 -- 172.21.15.63:0/2737338197 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f555800cc90 con 0x7f553c0039a0 2020-05-18T21:31:00.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.145+0000 7f5561bb5700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f553c0039a0 0x7f553c003e20 secure :-1 s=THROTTLE_DONE pgs=939 cs=0 l=1 rx=0x7f5558001110 tx=0x7f555800c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.145+0000 7f554b7fe700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f553c0581a0 0x7f553c05a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:00.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.145+0000 7f554b7fe700 1 -- 172.21.15.63:0/2737338197 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f5558063bf0 con 0x7f553c0039a0 2020-05-18T21:31:00.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.145+0000 7f55623b6700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f553c0581a0 0x7f553c05a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:00.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.145+0000 7f55623b6700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f553c0581a0 0x7f553c05a660 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f554c002f70 tx=0x7f554c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.145+0000 7f55623b6700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f553c0581a0 0x7f553c05a660 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f554c002f70 tx=0x7f554c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.145+0000 7f55623b6700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f553c0581a0 0x7f553c05a660 secure :-1 s=READY pgs=376 cs=0 l=1 rx=0x7f554c002f70 tx=0x7f554c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:00.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.153+0000 7f5561bb5700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f553c0039a0 0x7f553c003e20 secure :-1 s=THROTTLE_DONE pgs=939 cs=0 l=1 rx=0x7f5558001110 tx=0x7f555800c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.153+0000 7f554b7fe700 1 -- 172.21.15.63:0/2737338197 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f555803df20 con 0x7f553c0039a0 2020-05-18T21:31:00.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.301+0000 7f556461a700 1 -- 172.21.15.63:0/2737338197 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5538003720 con 0x7f553c0039a0 2020-05-18T21:31:00.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.301+0000 7f5561bb5700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f553c0039a0 0x7f553c003e20 secure :-1 s=THROTTLE_DONE pgs=939 cs=0 l=1 rx=0x7f5558001110 tx=0x7f555800c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.301+0000 7f554b7fe700 1 -- 172.21.15.63:0/2737338197 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7f5558041540 con 0x7f553c0039a0 2020-05-18T21:31:00.307 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:00.307 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:31:00.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.301+0000 7f556461a700 1 -- 172.21.15.63:0/2737338197 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f553c0581a0 msgr2=0x7f553c05a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.301+0000 7f556461a700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f553c0581a0 0x7f553c05a660 secure :-1 s=READY pgs=376 cs=0 l=1 rx=0x7f554c002f70 tx=0x7f554c007a80).stop 2020-05-18T21:31:00.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.301+0000 7f5562bb7700 1 -- 172.21.15.63:0/2737338197 reap_dead start 2020-05-18T21:31:00.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.301+0000 7f556461a700 1 -- 172.21.15.63:0/2737338197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f553c0039a0 msgr2=0x7f553c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.301+0000 7f556461a700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f553c0039a0 0x7f553c003e20 secure :-1 s=READY pgs=939 cs=0 l=1 rx=0x7f5558001110 tx=0x7f555800c600).stop 2020-05-18T21:31:00.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.301+0000 7f556461a700 1 -- 172.21.15.63:0/2737338197 shutdown_connections 2020-05-18T21:31:00.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.301+0000 7f556461a700 1 --2- 172.21.15.63:0/2737338197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f553c0039a0 0x7f553c003e20 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:00.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.301+0000 7f556461a700 1 -- 172.21.15.63:0/2737338197 >> 172.21.15.63:0/2737338197 conn(0x7f555c05edd0 msgr2=0x7f555c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:00.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.301+0000 7f556461a700 1 -- 172.21.15.63:0/2737338197 shutdown_connections 2020-05-18T21:31:00.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.301+0000 7f556461a700 1 -- 172.21.15.63:0/2737338197 wait complete. 2020-05-18T21:31:00.310 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:31:00.318 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush journal 2020-05-18T21:31:00.436 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:00.437 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "", 2020-05-18T21:31:00.437 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0 2020-05-18T21:31:00.437 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:00.446 INFO:tasks.cephfs.filesystem:_json_asok output: { "message": "", "return_code": 0 } 2020-05-18T21:31:00.447 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_data getxattr 10000000001.00000000 parent 2020-05-18T21:31:00.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.469+0000 7f6668161b80 1 Processor -- start 2020-05-18T21:31:00.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.469+0000 7f6668161b80 1 -- start start 2020-05-18T21:31:00.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.469+0000 7f6668161b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c250025680 0x55c24ff97000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:00.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.469+0000 7f6668161b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x55c250025a60 0x55c24ff96980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:00.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.469+0000 7f6668161b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55c24fef54b0 con 0x55c24ff79670 2020-05-18T21:31:00.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.469+0000 7f6668161b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c24fee1110 con 0x55c250025a60 2020-05-18T21:31:00.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.469+0000 7f6668161b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c24fed1a40 con 0x55c250025680 2020-05-18T21:31:00.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.469+0000 7f66665a4700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x55c24ff79670 0x55c25002cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59864/0 (socket says 172.21.15.63:59864) 2020-05-18T21:31:00.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.469+0000 7f66665a4700 1 -- 172.21.15.63:0/635874820 learned_addr learned my addr 172.21.15.63:0/635874820 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:00.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.469+0000 7f6666da5700 1 --2- 172.21.15.63:0/635874820 >> v2:172.21.15.155:3300/0 conn(0x55c250025a60 0x55c24ff96980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:00.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.469+0000 7f6665da3700 1 --2- 172.21.15.63:0/635874820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c250025680 0x55c24ff97000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:00.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.469+0000 7f665ffff700 1 -- 172.21.15.63:0/635874820 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56749825 0 0) 0x55c24fef54b0 con 0x55c24ff79670 2020-05-18T21:31:00.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.469+0000 7f665ffff700 1 -- 172.21.15.63:0/635874820 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6648002020 con 0x55c24ff79670 2020-05-18T21:31:00.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.469+0000 7f6666da5700 1 -- 172.21.15.63:0/635874820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c250025680 msgr2=0x55c24ff97000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:00.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.469+0000 7f665ffff700 1 -- 172.21.15.63:0/635874820 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 692312777 0 0) 0x7f6648002020 con 0x55c24ff79670 2020-05-18T21:31:00.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.469+0000 7f6666da5700 1 --2- 172.21.15.63:0/635874820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c250025680 0x55c24ff97000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:00.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.469+0000 7f6666da5700 1 -- 172.21.15.63:0/635874820 >> v1:172.21.15.63:6789/0 conn(0x55c24ff79670 legacy=0x55c25002cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6666da5700 1 -- 172.21.15.63:0/635874820 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c24fed5460 con 0x55c250025a60 2020-05-18T21:31:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6666da5700 1 --2- 172.21.15.63:0/635874820 >> v2:172.21.15.155:3300/0 conn(0x55c250025a60 0x55c24ff96980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f66580014d0 tx=0x7f6660002220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6666da5700 1 --2- 172.21.15.63:0/635874820 >> v2:172.21.15.155:3300/0 conn(0x55c250025a60 0x55c24ff96980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f66580014d0 tx=0x7f6660002220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6666da5700 1 --2- 172.21.15.63:0/635874820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c250025a60 0x55c24ff96980 secure :-1 s=READY pgs=663 cs=0 l=1 rx=0x7f66580014d0 tx=0x7f6660002220).ready entity=mon.1 client_cookie=4c7b569eb8fb7a5d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6666da5700 1 --2- 172.21.15.63:0/635874820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c250025a60 0x55c24ff96980 secure :-1 s=THROTTLE_DONE pgs=663 cs=0 l=1 rx=0x7f66580014d0 tx=0x7f6660002220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6666da5700 1 --2- 172.21.15.63:0/635874820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c250025a60 0x55c24ff96980 secure :-1 s=THROTTLE_DONE pgs=663 cs=0 l=1 rx=0x7f66580014d0 tx=0x7f6660002220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f665ffff700 1 -- 172.21.15.63:0/635874820 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6658001330 con 0x55c250025a60 2020-05-18T21:31:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6666da5700 1 --2- 172.21.15.63:0/635874820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c250025a60 0x55c24ff96980 secure :-1 s=THROTTLE_DONE pgs=663 cs=0 l=1 rx=0x7f66580014d0 tx=0x7f6660002220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f665ffff700 1 -- 172.21.15.63:0/635874820 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6660004a30 con 0x55c250025a60 2020-05-18T21:31:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f665ffff700 1 -- 172.21.15.63:0/635874820 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6660004d90 con 0x55c250025a60 2020-05-18T21:31:00.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6668161b80 1 -- 172.21.15.63:0/635874820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c250025a60 msgr2=0x55c24ff96980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6668161b80 1 --2- 172.21.15.63:0/635874820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c250025a60 0x55c24ff96980 secure :-1 s=READY pgs=663 cs=0 l=1 rx=0x7f66580014d0 tx=0x7f6660002220).stop 2020-05-18T21:31:00.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6668161b80 1 -- 172.21.15.63:0/635874820 shutdown_connections 2020-05-18T21:31:00.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6668161b80 1 --2- 172.21.15.63:0/635874820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c250025a60 0x55c24ff96980 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:00.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6668161b80 1 --2- 172.21.15.63:0/635874820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c250025680 0x55c24ff97000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:00.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6668161b80 1 -- 172.21.15.63:0/635874820 >> 172.21.15.63:0/635874820 conn(0x55c24ff98850 msgr2=0x55c24ff96270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:00.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6668161b80 1 -- 172.21.15.63:0/635874820 shutdown_connections 2020-05-18T21:31:00.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6668161b80 1 -- 172.21.15.63:0/635874820 wait complete. 2020-05-18T21:31:00.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6668161b80 1 Processor -- start 2020-05-18T21:31:00.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6668161b80 1 -- start start 2020-05-18T21:31:00.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6668161b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55c24ff79670 0x55c24ff96780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:00.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6668161b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c250025680 0x55c25001d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:00.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6668161b80 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55c250026680 con 0x55c250025a60 2020-05-18T21:31:00.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6668161b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c250026470 con 0x55c24ff79670 2020-05-18T21:31:00.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6668161b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c250026920 con 0x55c250025680 2020-05-18T21:31:00.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f66665a4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55c24ff79670 0x55c24ff96780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:00.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f66665a4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55c24ff79670 0x55c24ff96780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57682/0 (socket says 172.21.15.63:57682) 2020-05-18T21:31:00.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f66665a4700 1 -- 172.21.15.63:0/3716431165 learned_addr learned my addr 172.21.15.63:0/3716431165 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:00.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f6665da3700 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c250025680 0x55c25001d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:00.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f665f7fe700 1 -- 172.21.15.63:0/3716431165 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756625622 0 0) 0x55c250026680 con 0x55c250025a60 2020-05-18T21:31:00.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f665f7fe700 1 -- 172.21.15.63:0/3716431165 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6648001ce0 con 0x55c250025a60 2020-05-18T21:31:00.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f66665a4700 1 -- 172.21.15.63:0/3716431165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c250025680 msgr2=0x55c25001d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f66665a4700 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c250025680 0x55c25001d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:00.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f66665a4700 1 -- 172.21.15.63:0/3716431165 >> v1:172.21.15.155:6789/0 conn(0x55c250025a60 legacy=0x55c25001aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f66665a4700 1 -- 172.21.15.63:0/3716431165 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c25001da80 con 0x55c24ff79670 2020-05-18T21:31:00.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f66665a4700 1 --2- 172.21.15.63:0/3716431165 >> v2:172.21.15.63:3300/0 conn(0x55c24ff79670 0x55c24ff96780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6658006ab0 tx=0x7f665800fac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f66665a4700 1 --2- 172.21.15.63:0/3716431165 >> v2:172.21.15.63:3300/0 conn(0x55c24ff79670 0x55c24ff96780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6658006ab0 tx=0x7f665800fac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.473+0000 7f66665a4700 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c24ff79670 0x55c24ff96780 secure :-1 s=READY pgs=942 cs=0 l=1 rx=0x7f6658006ab0 tx=0x7f665800fac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:00.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f66665a4700 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c24ff79670 0x55c24ff96780 secure :-1 s=THROTTLE_DONE pgs=942 cs=0 l=1 rx=0x7f6658006ab0 tx=0x7f665800fac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f665f7fe700 1 -- 172.21.15.63:0/3716431165 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6658004690 con 0x55c24ff79670 2020-05-18T21:31:00.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f66665a4700 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c24ff79670 0x55c24ff96780 secure :-1 s=THROTTLE_DONE pgs=942 cs=0 l=1 rx=0x7f6658006ab0 tx=0x7f665800fac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f665f7fe700 1 -- 172.21.15.63:0/3716431165 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66580047f0 con 0x55c24ff79670 2020-05-18T21:31:00.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f66665a4700 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c24ff79670 0x55c24ff96780 secure :-1 s=THROTTLE_DONE pgs=942 cs=0 l=1 rx=0x7f6658006ab0 tx=0x7f665800fac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f6668161b80 1 -- 172.21.15.63:0/3716431165 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c250026dc0 con 0x55c24ff79670 2020-05-18T21:31:00.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f665f7fe700 1 -- 172.21.15.63:0/3716431165 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6658004bd0 con 0x55c24ff79670 2020-05-18T21:31:00.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f6668161b80 1 -- 172.21.15.63:0/3716431165 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c250027250 con 0x55c24ff79670 2020-05-18T21:31:00.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f66665a4700 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c24ff79670 0x55c24ff96780 secure :-1 s=THROTTLE_DONE pgs=942 cs=0 l=1 rx=0x7f6658006ab0 tx=0x7f665800fac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f665f7fe700 1 -- 172.21.15.63:0/3716431165 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f665800b0b0 con 0x55c24ff79670 2020-05-18T21:31:00.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f66665a4700 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c24ff79670 0x55c24ff96780 secure :-1 s=THROTTLE_DONE pgs=942 cs=0 l=1 rx=0x7f6658006ab0 tx=0x7f665800fac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f665f7fe700 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f664804ea70 0x7f6648050f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:00.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f665f7fe700 1 -- 172.21.15.63:0/3716431165 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6658062a40 con 0x55c24ff79670 2020-05-18T21:31:00.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f6668161b80 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x55c2500240b0 0x55c25003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:00.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f6665da3700 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f664804ea70 0x7f6648050f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:00.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f6668161b80 1 -- 172.21.15.63:0/3716431165 --> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] -- osd_op(unknown.0.0:1 14.7 14:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected e75) v8 -- 0x55c25001b8e0 con 0x55c2500240b0 2020-05-18T21:31:00.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f6665da3700 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f664804ea70 0x7f6648050f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6650002f70 tx=0x7f6650006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f6666da5700 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x55c2500240b0 0x55c25003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:00.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f6665da3700 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f664804ea70 0x7f6648050f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6650002f70 tx=0x7f6650006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.477+0000 7f6665da3700 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f664804ea70 0x7f6648050f30 secure :-1 s=READY pgs=377 cs=0 l=1 rx=0x7f6650002f70 tx=0x7f6650006620).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:00.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.481+0000 7f6666da5700 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x55c2500240b0 0x55c25003d690 crc :-1 s=READY pgs=22 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:00.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.481+0000 7f6666da5700 1 -- 172.21.15.63:0/3716431165 <== osd.5 v2:172.21.15.155:6808/13024 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (99) out=99b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+99 (crc 0 0 0) 0x7f6660004950 con 0x55c2500240b0 2020-05-18T21:31:00.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.481+0000 7f6668161b80 1 -- 172.21.15.63:0/3716431165 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x55c2500240b0 msgr2=0x55c25003d690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.481+0000 7f6668161b80 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x55c2500240b0 0x55c25003d690 crc :-1 s=READY pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:00.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.481+0000 7f6668161b80 1 -- 172.21.15.63:0/3716431165 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f664804ea70 msgr2=0x7f6648050f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.481+0000 7f6668161b80 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f664804ea70 0x7f6648050f30 secure :-1 s=READY pgs=377 cs=0 l=1 rx=0x7f6650002f70 tx=0x7f6650006620).stop 2020-05-18T21:31:00.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.481+0000 7f6668161b80 1 -- 172.21.15.63:0/3716431165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c24ff79670 msgr2=0x55c24ff96780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.481+0000 7f6668161b80 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c24ff79670 0x55c24ff96780 secure :-1 s=READY pgs=942 cs=0 l=1 rx=0x7f6658006ab0 tx=0x7f665800fac0).stop 2020-05-18T21:31:00.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.481+0000 7f6666da5700 1 -- 172.21.15.63:0/3716431165 reap_dead start 2020-05-18T21:31:00.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.481+0000 7f6668161b80 1 -- 172.21.15.63:0/3716431165 shutdown_connections 2020-05-18T21:31:00.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.481+0000 7f6668161b80 1 --2- 172.21.15.63:0/3716431165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c24ff79670 0x55c24ff96780 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:00.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.481+0000 7f6668161b80 1 -- 172.21.15.63:0/3716431165 >> 172.21.15.63:0/3716431165 conn(0x55c24ff98850 msgr2=0x55c24ff7a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:00.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.481+0000 7f6668161b80 1 -- 172.21.15.63:0/3716431165 shutdown_connections 2020-05-18T21:31:00.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.481+0000 7f6668161b80 1 -- 172.21.15.63:0/3716431165 wait complete. 2020-05-18T21:31:00.500 INFO:teuthology.orchestra.run.smithi063.stdout:] 10000000001 stray0 2020-05-18T21:31:00.500 INFO:teuthology.orchestra.run.smithi063:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2020-05-18T21:31:00.563 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:00.563 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1099511627777, 2020-05-18T21:31:00.563 INFO:teuthology.orchestra.run.smithi063.stdout: "ancestors": [ 2020-05-18T21:31:00.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:00.564 INFO:teuthology.orchestra.run.smithi063.stdout: "dirino": 1536, 2020-05-18T21:31:00.564 INFO:teuthology.orchestra.run.smithi063.stdout: "dname": "10000000001", 2020-05-18T21:31:00.564 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 11 2020-05-18T21:31:00.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:00.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:00.565 INFO:teuthology.orchestra.run.smithi063.stdout: "dirino": 256, 2020-05-18T21:31:00.565 INFO:teuthology.orchestra.run.smithi063.stdout: "dname": "stray0", 2020-05-18T21:31:00.565 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 5 2020-05-18T21:31:00.565 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:00.565 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:00.566 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 14, 2020-05-18T21:31:00.566 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [] 2020-05-18T21:31:00.566 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:00.566 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:00.567 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:00.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f9e9e0700 1 Processor -- start 2020-05-18T21:31:00.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f9e9e0700 1 -- start start 2020-05-18T21:31:00.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f9e9e0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f9805f1b0 0x7f9f98144920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:00.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f9e9e0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9f98061160 0x7f9f980b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:00.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f9e9e0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f980615a0 con 0x7f9f980b31e0 2020-05-18T21:31:00.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f9e9e0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f98061800 con 0x7f9f98061160 2020-05-18T21:31:00.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f9e9e0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f980b4f20 con 0x7f9f9805f1b0 2020-05-18T21:31:00.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f9cf7d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9f980b31e0 0x7f9f980b53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59884/0 (socket says 172.21.15.63:59884) 2020-05-18T21:31:00.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f9cf7d700 1 -- 172.21.15.63:0/1389050244 learned_addr learned my addr 172.21.15.63:0/1389050244 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:00.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f97fff700 1 --2- 172.21.15.63:0/1389050244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f9805f1b0 0x7f9f98144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:00.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f8f7fe700 1 --2- 172.21.15.63:0/1389050244 >> v2:172.21.15.155:3300/0 conn(0x7f9f98061160 0x7f9f980b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:00.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f977fe700 1 -- 172.21.15.63:0/1389050244 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402009606 0 0) 0x7f9f980615a0 con 0x7f9f980b31e0 2020-05-18T21:31:00.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f977fe700 1 -- 172.21.15.63:0/1389050244 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f78003270 con 0x7f9f980b31e0 2020-05-18T21:31:00.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f8f7fe700 1 -- 172.21.15.63:0/1389050244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f9805f1b0 msgr2=0x7f9f98144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:00.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f8f7fe700 1 --2- 172.21.15.63:0/1389050244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f9805f1b0 0x7f9f98144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:00.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f8f7fe700 1 -- 172.21.15.63:0/1389050244 >> v1:172.21.15.63:6789/0 conn(0x7f9f980b31e0 legacy=0x7f9f980b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f8f7fe700 1 -- 172.21.15.63:0/1389050244 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9805f590 con 0x7f9f98061160 2020-05-18T21:31:00.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f8f7fe700 1 --2- 172.21.15.63:0/1389050244 >> v2:172.21.15.155:3300/0 conn(0x7f9f98061160 0x7f9f980b2d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9f80002f70 tx=0x7f9f80007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f8f7fe700 1 --2- 172.21.15.63:0/1389050244 >> v2:172.21.15.155:3300/0 conn(0x7f9f98061160 0x7f9f980b2d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9f80002f70 tx=0x7f9f80007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f8f7fe700 1 --2- 172.21.15.63:0/1389050244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f98061160 0x7f9f980b2d80 secure :-1 s=READY pgs=665 cs=0 l=1 rx=0x7f9f80002f70 tx=0x7f9f80007a80).ready entity=mon.1 client_cookie=dda73eaca7961b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:00.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f8f7fe700 1 --2- 172.21.15.63:0/1389050244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f98061160 0x7f9f980b2d80 secure :-1 s=THROTTLE_DONE pgs=665 cs=0 l=1 rx=0x7f9f80002f70 tx=0x7f9f80007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f977fe700 1 -- 172.21.15.63:0/1389050244 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f80008e80 con 0x7f9f98061160 2020-05-18T21:31:00.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f8f7fe700 1 --2- 172.21.15.63:0/1389050244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f98061160 0x7f9f980b2d80 secure :-1 s=THROTTLE_DONE pgs=665 cs=0 l=1 rx=0x7f9f80002f70 tx=0x7f9f80007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f977fe700 1 -- 172.21.15.63:0/1389050244 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f80011540 con 0x7f9f98061160 2020-05-18T21:31:00.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f8f7fe700 1 --2- 172.21.15.63:0/1389050244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f98061160 0x7f9f980b2d80 secure :-1 s=THROTTLE_DONE pgs=665 cs=0 l=1 rx=0x7f9f80002f70 tx=0x7f9f80007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f977fe700 1 -- 172.21.15.63:0/1389050244 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f80011920 con 0x7f9f98061160 2020-05-18T21:31:00.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f9e9e0700 1 -- 172.21.15.63:0/1389050244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f98061160 msgr2=0x7f9f980b2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.677+0000 7f9f9e9e0700 1 --2- 172.21.15.63:0/1389050244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f98061160 0x7f9f980b2d80 secure :-1 s=READY pgs=665 cs=0 l=1 rx=0x7f9f80002f70 tx=0x7f9f80007a80).stop 2020-05-18T21:31:00.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.681+0000 7f9f9e9e0700 1 -- 172.21.15.63:0/1389050244 shutdown_connections 2020-05-18T21:31:00.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.681+0000 7f9f9e9e0700 1 --2- 172.21.15.63:0/1389050244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f98061160 0x7f9f980b2d80 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:00.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.681+0000 7f9f9e9e0700 1 --2- 172.21.15.63:0/1389050244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f9805f1b0 0x7f9f98144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:00.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.681+0000 7f9f9e9e0700 1 -- 172.21.15.63:0/1389050244 >> 172.21.15.63:0/1389050244 conn(0x7f9f98069fc0 msgr2=0x7f9f9806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:00.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.681+0000 7f9f9e9e0700 1 -- 172.21.15.63:0/1389050244 shutdown_connections 2020-05-18T21:31:00.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.681+0000 7f9f9e9e0700 1 -- 172.21.15.63:0/1389050244 wait complete. 2020-05-18T21:31:00.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.681+0000 7f9f9e9e0700 1 Processor -- start 2020-05-18T21:31:00.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.681+0000 7f9f9e9e0700 1 -- start start 2020-05-18T21:31:00.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.681+0000 7f9f9e9e0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f98061160 0x7f9f981463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:00.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.681+0000 7f9f9e9e0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9f980b31e0 0x7f9f9812bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:00.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.681+0000 7f9f9e9e0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f98146830 con 0x7f9f9805f1b0 2020-05-18T21:31:00.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.681+0000 7f9f9e9e0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f980af600 con 0x7f9f980b31e0 2020-05-18T21:31:00.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.681+0000 7f9f9e9e0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f980af8a0 con 0x7f9f98061160 2020-05-18T21:31:00.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.681+0000 7f9f9cf7d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9f980b31e0 0x7f9f9812bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:00.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.681+0000 7f9f9cf7d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9f980b31e0 0x7f9f9812bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:44318/0 (socket says 172.21.15.63:44318) 2020-05-18T21:31:00.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.681+0000 7f9f97fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f9f9805f1b0 0x7f9f980affe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:58202/0 (socket says 172.21.15.63:58202) 2020-05-18T21:31:00.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.681+0000 7f9f9cf7d700 1 -- 172.21.15.63:0/1923916765 learned_addr learned my addr 172.21.15.63:0/1923916765 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:00.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.681+0000 7f9f8f7fe700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f98061160 0x7f9f981463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:00.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f9cf7d700 1 -- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f98061160 msgr2=0x7f9f981463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f9cf7d700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f98061160 0x7f9f981463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:00.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f9cf7d700 1 -- 172.21.15.63:0/1923916765 >> v1:172.21.15.155:6789/0 conn(0x7f9f9805f1b0 legacy=0x7f9f980affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f95ffb700 1 -- 172.21.15.63:0/1923916765 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342060788 0 0) 0x7f9f98146830 con 0x7f9f9805f1b0 2020-05-18T21:31:00.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f9cf7d700 1 -- 172.21.15.63:0/1923916765 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f980afb40 con 0x7f9f980b31e0 2020-05-18T21:31:00.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f9cf7d700 1 --2- 172.21.15.63:0/1923916765 >> v2:172.21.15.155:3300/0 conn(0x7f9f980b31e0 0x7f9f9812bc70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9f90001490 tx=0x7f9f90010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f9cf7d700 1 --2- 172.21.15.63:0/1923916765 >> v2:172.21.15.155:3300/0 conn(0x7f9f980b31e0 0x7f9f9812bc70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9f90001490 tx=0x7f9f90010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f9cf7d700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f980b31e0 0x7f9f9812bc70 secure :-1 s=READY pgs=667 cs=0 l=1 rx=0x7f9f90001490 tx=0x7f9f90010cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:00.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f9cf7d700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f980b31e0 0x7f9f9812bc70 secure :-1 s=THROTTLE_DONE pgs=667 cs=0 l=1 rx=0x7f9f90001490 tx=0x7f9f90010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f95ffb700 1 -- 172.21.15.63:0/1923916765 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f90005e90 con 0x7f9f980b31e0 2020-05-18T21:31:00.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f9cf7d700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f980b31e0 0x7f9f9812bc70 secure :-1 s=THROTTLE_DONE pgs=667 cs=0 l=1 rx=0x7f9f90001490 tx=0x7f9f90010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f95ffb700 1 -- 172.21.15.63:0/1923916765 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f90012570 con 0x7f9f980b31e0 2020-05-18T21:31:00.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f9e9e0700 1 -- 172.21.15.63:0/1923916765 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9812c0d0 con 0x7f9f980b31e0 2020-05-18T21:31:00.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f9cf7d700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f980b31e0 0x7f9f9812bc70 secure :-1 s=THROTTLE_DONE pgs=667 cs=0 l=1 rx=0x7f9f90001490 tx=0x7f9f90010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f95ffb700 1 -- 172.21.15.63:0/1923916765 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f900128d0 con 0x7f9f980b31e0 2020-05-18T21:31:00.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f9e9e0700 1 -- 172.21.15.63:0/1923916765 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9812c5d0 con 0x7f9f980b31e0 2020-05-18T21:31:00.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f9cf7d700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f980b31e0 0x7f9f9812bc70 secure :-1 s=THROTTLE_DONE pgs=667 cs=0 l=1 rx=0x7f9f90001490 tx=0x7f9f90010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f9e9e0700 1 -- 172.21.15.63:0/1923916765 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f980569e0 con 0x7f9f980b31e0 2020-05-18T21:31:00.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f95ffb700 1 -- 172.21.15.63:0/1923916765 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9f90012ad0 con 0x7f9f980b31e0 2020-05-18T21:31:00.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.685+0000 7f9f9cf7d700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f980b31e0 0x7f9f9812bc70 secure :-1 s=THROTTLE_DONE pgs=667 cs=0 l=1 rx=0x7f9f90001490 tx=0x7f9f90010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.689+0000 7f9f95ffb700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9f7c04f860 0x7f9f7c051d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:00.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.689+0000 7f9f95ffb700 1 -- 172.21.15.63:0/1923916765 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9f900090c0 con 0x7f9f980b31e0 2020-05-18T21:31:00.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.689+0000 7f9f97fff700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9f7c04f860 0x7f9f7c051d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:00.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.689+0000 7f9f97fff700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9f7c04f860 0x7f9f7c051d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9f88007960 tx=0x7f9f98067990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.689+0000 7f9f97fff700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9f7c04f860 0x7f9f7c051d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9f88007960 tx=0x7f9f98067990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.689+0000 7f9f97fff700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9f7c04f860 0x7f9f7c051d20 secure :-1 s=READY pgs=378 cs=0 l=1 rx=0x7f9f88007960 tx=0x7f9f98067990).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:00.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.697+0000 7f9f9cf7d700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f980b31e0 0x7f9f9812bc70 secure :-1 s=THROTTLE_DONE pgs=667 cs=0 l=1 rx=0x7f9f90001490 tx=0x7f9f90010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.697+0000 7f9f95ffb700 1 -- 172.21.15.63:0/1923916765 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9f9003e7e0 con 0x7f9f980b31e0 2020-05-18T21:31:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.845+0000 7f9f9e9e0700 1 -- 172.21.15.63:0/1923916765 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f9805f910 con 0x7f9f980b31e0 2020-05-18T21:31:00.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.845+0000 7f9f9cf7d700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f980b31e0 0x7f9f9812bc70 secure :-1 s=THROTTLE_DONE pgs=667 cs=0 l=1 rx=0x7f9f90001490 tx=0x7f9f90010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:00.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.849+0000 7f9f95ffb700 1 -- 172.21.15.63:0/1923916765 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7f9f90041e00 con 0x7f9f980b31e0 2020-05-18T21:31:00.852 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:00.853 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:31:00.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.849+0000 7f9f9e9e0700 1 -- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9f7c04f860 msgr2=0x7f9f7c051d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.849+0000 7f9f9e9e0700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9f7c04f860 0x7f9f7c051d20 secure :-1 s=READY pgs=378 cs=0 l=1 rx=0x7f9f88007960 tx=0x7f9f98067990).stop 2020-05-18T21:31:00.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.849+0000 7f9f9e9e0700 1 -- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f980b31e0 msgr2=0x7f9f9812bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:00.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.849+0000 7f9f9e9e0700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f980b31e0 0x7f9f9812bc70 secure :-1 s=READY pgs=667 cs=0 l=1 rx=0x7f9f90001490 tx=0x7f9f90010cb0).stop 2020-05-18T21:31:00.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.849+0000 7f9f9e9e0700 1 -- 172.21.15.63:0/1923916765 shutdown_connections 2020-05-18T21:31:00.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.849+0000 7f9f9e9e0700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9f7c04f860 0x7f9f7c051d20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:00.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.849+0000 7f9f9e9e0700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f980b31e0 0x7f9f9812bc70 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:00.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.849+0000 7f9f9e9e0700 1 --2- 172.21.15.63:0/1923916765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f98061160 0x7f9f981463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:00.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.849+0000 7f9f9e9e0700 1 -- 172.21.15.63:0/1923916765 >> 172.21.15.63:0/1923916765 conn(0x7f9f98069fc0 msgr2=0x7f9f98144e10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:00.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.853+0000 7f9f9e9e0700 1 -- 172.21.15.63:0/1923916765 shutdown_connections 2020-05-18T21:31:00.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:00.853+0000 7f9f9e9e0700 1 -- 172.21.15.63:0/1923916765 wait complete. 2020-05-18T21:31:00.858 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:31:00.872 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_reintegrated 2020-05-18T21:31:00.977 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:00.977 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:31:00.978 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_reintegrated": 0 2020-05-18T21:31:00.978 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:00.978 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:00.983 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_reintegrated": 0 } } 2020-05-18T21:31:00.984 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mv dir_2/file_b dir_2/file_c) 2020-05-18T21:31:01.027 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:01.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.173+0000 7fb254b2a700 1 Processor -- start 2020-05-18T21:31:01.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.173+0000 7fb254b2a700 1 -- start start 2020-05-18T21:31:01.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.173+0000 7fb254b2a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb2501456f0 0x7fb250145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:01.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.173+0000 7fb254b2a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb2500b5300 0x7fb2500b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:01.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.173+0000 7fb254b2a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb250061d90 con 0x7fb2500b2ec0 2020-05-18T21:31:01.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb254b2a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb25013cfe0 con 0x7fb2500b5300 2020-05-18T21:31:01.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb254b2a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb250099e40 con 0x7fb2501456f0 2020-05-18T21:31:01.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb24ed9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb2500b5300 0x7fb2500b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:01.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb24ed9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb2500b5300 0x7fb2500b57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57710/0 (socket says 172.21.15.63:57710) 2020-05-18T21:31:01.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb24e59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb2501456f0 0x7fb250145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:01.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb24ed9d700 1 -- 172.21.15.63:0/4052071089 learned_addr learned my addr 172.21.15.63:0/4052071089 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:01.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb24ed9d700 1 -- 172.21.15.63:0/4052071089 >> v2:172.21.15.155:3300/0 conn(0x7fb2501456f0 msgr2=0x7fb250145ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:01.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb24ed9d700 1 --2- 172.21.15.63:0/4052071089 >> v2:172.21.15.155:3300/0 conn(0x7fb2501456f0 0x7fb250145ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:01.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb24ed9d700 1 -- 172.21.15.63:0/4052071089 >> v1:172.21.15.155:6789/0 conn(0x7fb2500b2ec0 legacy=0x7fb250143c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:01.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb24ed9d700 1 -- 172.21.15.63:0/4052071089 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb250061aa0 con 0x7fb2500b5300 2020-05-18T21:31:01.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb24ed9d700 1 --2- 172.21.15.63:0/4052071089 >> v2:172.21.15.63:3300/0 conn(0x7fb2500b5300 0x7fb2500b57b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb250099bd0 tx=0x7fb248007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb24ed9d700 1 --2- 172.21.15.63:0/4052071089 >> v2:172.21.15.63:3300/0 conn(0x7fb2500b5300 0x7fb2500b57b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb250099bd0 tx=0x7fb248007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb24ed9d700 1 --2- 172.21.15.63:0/4052071089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2500b5300 0x7fb2500b57b0 secure :-1 s=READY pgs=944 cs=0 l=1 rx=0x7fb250099bd0 tx=0x7fb248007e00).ready entity=mon.0 client_cookie=1ea13434585055bf server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:01.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb24ed9d700 1 --2- 172.21.15.63:0/4052071089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2500b5300 0x7fb2500b57b0 secure :-1 s=THROTTLE_DONE pgs=944 cs=0 l=1 rx=0x7fb250099bd0 tx=0x7fb248007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb24ed9d700 1 --2- 172.21.15.63:0/4052071089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2500b5300 0x7fb2500b57b0 secure :-1 s=THROTTLE_DONE pgs=944 cs=0 l=1 rx=0x7fb250099bd0 tx=0x7fb248007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb24d59a700 1 -- 172.21.15.63:0/4052071089 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb248011cd0 con 0x7fb2500b5300 2020-05-18T21:31:01.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb24ed9d700 1 --2- 172.21.15.63:0/4052071089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2500b5300 0x7fb2500b57b0 secure :-1 s=THROTTLE_DONE pgs=944 cs=0 l=1 rx=0x7fb250099bd0 tx=0x7fb248007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb24d59a700 1 -- 172.21.15.63:0/4052071089 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb248011e30 con 0x7fb2500b5300 2020-05-18T21:31:01.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb24d59a700 1 -- 172.21.15.63:0/4052071089 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb24800a370 con 0x7fb2500b5300 2020-05-18T21:31:01.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb254b2a700 1 -- 172.21.15.63:0/4052071089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2500b5300 msgr2=0x7fb2500b57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:01.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb254b2a700 1 --2- 172.21.15.63:0/4052071089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2500b5300 0x7fb2500b57b0 secure :-1 s=READY pgs=944 cs=0 l=1 rx=0x7fb250099bd0 tx=0x7fb248007e00).stop 2020-05-18T21:31:01.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb254b2a700 1 -- 172.21.15.63:0/4052071089 shutdown_connections 2020-05-18T21:31:01.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb254b2a700 1 --2- 172.21.15.63:0/4052071089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2500b5300 0x7fb2500b57b0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:01.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb254b2a700 1 --2- 172.21.15.63:0/4052071089 >> v2:172.21.15.155:3300/0 conn(0x7fb2501456f0 0x7fb250145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:01.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb254b2a700 1 -- 172.21.15.63:0/4052071089 >> 172.21.15.63:0/4052071089 conn(0x7fb25005a7c0 msgr2=0x7fb25005aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:01.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb254b2a700 1 -- 172.21.15.63:0/4052071089 shutdown_connections 2020-05-18T21:31:01.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.177+0000 7fb254b2a700 1 -- 172.21.15.63:0/4052071089 wait complete. 2020-05-18T21:31:01.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb254b2a700 1 Processor -- start 2020-05-18T21:31:01.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb254b2a700 1 -- start start 2020-05-18T21:31:01.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb254b2a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb2500b2ec0 0x7fb25009ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:01.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb254b2a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb2500b5300 0x7fb250063110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:01.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb254b2a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2501456f0 0x7fb25013c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:01.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb254b2a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb25013c5b0 con 0x7fb2500b2ec0 2020-05-18T21:31:01.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb254b2a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb250063700 con 0x7fb2500b5300 2020-05-18T21:31:01.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb254b2a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2500639a0 con 0x7fb2501456f0 2020-05-18T21:31:01.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb24e59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb2500b2ec0 0x7fb25009ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:01.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb24e59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb2500b2ec0 0x7fb25009ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57712/0 (socket says 172.21.15.63:57712) 2020-05-18T21:31:01.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb24e59c700 1 -- 172.21.15.63:0/3112488964 learned_addr learned my addr 172.21.15.63:0/3112488964 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:01.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb24dd9b700 1 --2- 172.21.15.63:0/3112488964 >> v2:172.21.15.155:3300/0 conn(0x7fb2500b5300 0x7fb250063110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:01.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb24ed9d700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2501456f0 0x7fb25013c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:01.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb24e59c700 1 -- 172.21.15.63:0/3112488964 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2501456f0 msgr2=0x7fb25013c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:01.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb24e59c700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2501456f0 0x7fb25013c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:01.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb24e59c700 1 -- 172.21.15.63:0/3112488964 >> v2:172.21.15.155:3300/0 conn(0x7fb2500b5300 msgr2=0x7fb250063110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:01.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb24e59c700 1 --2- 172.21.15.63:0/3112488964 >> v2:172.21.15.155:3300/0 conn(0x7fb2500b5300 0x7fb250063110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:01.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb24e59c700 1 -- 172.21.15.63:0/3112488964 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb250063c40 con 0x7fb2500b2ec0 2020-05-18T21:31:01.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb24dd9b700 1 --2- 172.21.15.63:0/3112488964 >> v2:172.21.15.155:3300/0 conn(0x7fb2500b5300 0x7fb250063110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:31:01.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb24e59c700 1 --2- 172.21.15.63:0/3112488964 >> v2:172.21.15.63:3300/0 conn(0x7fb2500b2ec0 0x7fb25009ddd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb2400030b0 tx=0x7fb240010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb24e59c700 1 --2- 172.21.15.63:0/3112488964 >> v2:172.21.15.63:3300/0 conn(0x7fb2500b2ec0 0x7fb25009ddd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb2400030b0 tx=0x7fb240010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb24e59c700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2500b2ec0 0x7fb25009ddd0 secure :-1 s=READY pgs=945 cs=0 l=1 rx=0x7fb2400030b0 tx=0x7fb240010d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:01.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb24e59c700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2500b2ec0 0x7fb25009ddd0 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7fb2400030b0 tx=0x7fb240010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb24e59c700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2500b2ec0 0x7fb25009ddd0 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7fb2400030b0 tx=0x7fb240010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb23f7fe700 1 -- 172.21.15.63:0/3112488964 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb240007180 con 0x7fb2500b2ec0 2020-05-18T21:31:01.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb24e59c700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2500b2ec0 0x7fb25009ddd0 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7fb2400030b0 tx=0x7fb240010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb23f7fe700 1 -- 172.21.15.63:0/3112488964 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2400072e0 con 0x7fb2500b2ec0 2020-05-18T21:31:01.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb254b2a700 1 -- 172.21.15.63:0/3112488964 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb25013a4a0 con 0x7fb2500b2ec0 2020-05-18T21:31:01.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb23f7fe700 1 -- 172.21.15.63:0/3112488964 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2400123e0 con 0x7fb2500b2ec0 2020-05-18T21:31:01.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb254b2a700 1 -- 172.21.15.63:0/3112488964 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb250138e90 con 0x7fb2500b2ec0 2020-05-18T21:31:01.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.181+0000 7fb24e59c700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2500b2ec0 0x7fb25009ddd0 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7fb2400030b0 tx=0x7fb240010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.185+0000 7fb254b2a700 1 -- 172.21.15.63:0/3112488964 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2500569e0 con 0x7fb2500b2ec0 2020-05-18T21:31:01.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.185+0000 7fb23f7fe700 1 -- 172.21.15.63:0/3112488964 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb240012650 con 0x7fb2500b2ec0 2020-05-18T21:31:01.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.185+0000 7fb24e59c700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2500b2ec0 0x7fb25009ddd0 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7fb2400030b0 tx=0x7fb240010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.185+0000 7fb23f7fe700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb22c04f9f0 0x7fb22c051eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:01.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.185+0000 7fb23f7fe700 1 -- 172.21.15.63:0/3112488964 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb2400643b0 con 0x7fb2500b2ec0 2020-05-18T21:31:01.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.185+0000 7fb24dd9b700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb22c04f9f0 0x7fb22c051eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:01.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.185+0000 7fb24dd9b700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb22c04f9f0 0x7fb22c051eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb250099c10 tx=0x7fb244001870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.185+0000 7fb24dd9b700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb22c04f9f0 0x7fb22c051eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb250099c10 tx=0x7fb244001870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.185+0000 7fb24dd9b700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb22c04f9f0 0x7fb22c051eb0 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7fb250099c10 tx=0x7fb244001870).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:01.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.189+0000 7fb24e59c700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2500b2ec0 0x7fb25009ddd0 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7fb2400030b0 tx=0x7fb240010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.189+0000 7fb23f7fe700 1 -- 172.21.15.63:0/3112488964 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb24003e6e0 con 0x7fb2500b2ec0 2020-05-18T21:31:01.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.337+0000 7fb254b2a700 1 -- 172.21.15.63:0/3112488964 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb25009afc0 con 0x7fb2500b2ec0 2020-05-18T21:31:01.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.337+0000 7fb24e59c700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2500b2ec0 0x7fb25009ddd0 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7fb2400030b0 tx=0x7fb240010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.337+0000 7fb23f7fe700 1 -- 172.21.15.63:0/3112488964 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7fb240041d00 con 0x7fb2500b2ec0 2020-05-18T21:31:01.344 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:01.344 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:31:01.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.341+0000 7fb254b2a700 1 -- 172.21.15.63:0/3112488964 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb22c04f9f0 msgr2=0x7fb22c051eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:01.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.341+0000 7fb254b2a700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb22c04f9f0 0x7fb22c051eb0 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7fb250099c10 tx=0x7fb244001870).stop 2020-05-18T21:31:01.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.341+0000 7fb254b2a700 1 -- 172.21.15.63:0/3112488964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2500b2ec0 msgr2=0x7fb25009ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:01.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.341+0000 7fb254b2a700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2500b2ec0 0x7fb25009ddd0 secure :-1 s=READY pgs=945 cs=0 l=1 rx=0x7fb2400030b0 tx=0x7fb240010d80).stop 2020-05-18T21:31:01.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.341+0000 7fb254b2a700 1 -- 172.21.15.63:0/3112488964 shutdown_connections 2020-05-18T21:31:01.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.341+0000 7fb254b2a700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb22c04f9f0 0x7fb22c051eb0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:01.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.341+0000 7fb254b2a700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2501456f0 0x7fb25013c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:01.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.341+0000 7fb254b2a700 1 --2- 172.21.15.63:0/3112488964 >> v2:172.21.15.155:3300/0 conn(0x7fb2500b5300 0x7fb250063110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:01.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.341+0000 7fb254b2a700 1 --2- 172.21.15.63:0/3112488964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2500b2ec0 0x7fb25009ddd0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:01.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.341+0000 7fb254b2a700 1 -- 172.21.15.63:0/3112488964 >> 172.21.15.63:0/3112488964 conn(0x7fb25005a7c0 msgr2=0x7fb250144ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:01.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.341+0000 7fb254b2a700 1 -- 172.21.15.63:0/3112488964 shutdown_connections 2020-05-18T21:31:01.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.341+0000 7fb254b2a700 1 -- 172.21.15.63:0/3112488964 wait complete. 2020-05-18T21:31:01.348 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:31:01.361 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache num_strays 2020-05-18T21:31:01.459 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:01.459 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:31:01.459 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays": 0 2020-05-18T21:31:01.460 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:01.460 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:01.467 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "num_strays": 0 } } 2020-05-18T21:31:01.468 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:01.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.565+0000 7fd4c3471700 1 Processor -- start 2020-05-18T21:31:01.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.565+0000 7fd4c3471700 1 -- start start 2020-05-18T21:31:01.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.565+0000 7fd4c3471700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd4bc1435d0 0x7fd4bc063ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:01.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.565+0000 7fd4c3471700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd4bc147140 0x7fd4bc05edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:01.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.565+0000 7fd4c3471700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc1480a0 con 0x7fd4bc05f230 2020-05-18T21:31:01.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.565+0000 7fd4c3471700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc1476c0 con 0x7fd4bc1435d0 2020-05-18T21:31:01.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.565+0000 7fd4c3471700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc147960 con 0x7fd4bc147140 2020-05-18T21:31:01.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.565+0000 7fd4c246f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd4bc1435d0 0x7fd4bc063ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:01.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.565+0000 7fd4c2c70700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd4bc05f230 0x7fd4bc0b8200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59912/0 (socket says 172.21.15.63:59912) 2020-05-18T21:31:01.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.565+0000 7fd4c246f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd4bc1435d0 0x7fd4bc063ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57722/0 (socket says 172.21.15.63:57722) 2020-05-18T21:31:01.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.565+0000 7fd4c2c70700 1 -- 172.21.15.63:0/420272022 learned_addr learned my addr 172.21.15.63:0/420272022 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:01.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.565+0000 7fd4c1c6e700 1 --2- 172.21.15.63:0/420272022 >> v2:172.21.15.155:3300/0 conn(0x7fd4bc147140 0x7fd4bc05edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:01.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c246f700 1 -- 172.21.15.63:0/420272022 >> v2:172.21.15.155:3300/0 conn(0x7fd4bc147140 msgr2=0x7fd4bc05edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:01.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c246f700 1 --2- 172.21.15.63:0/420272022 >> v2:172.21.15.155:3300/0 conn(0x7fd4bc147140 0x7fd4bc05edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:01.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c246f700 1 -- 172.21.15.63:0/420272022 >> v1:172.21.15.63:6789/0 conn(0x7fd4bc05f230 legacy=0x7fd4bc0b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:01.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c246f700 1 -- 172.21.15.63:0/420272022 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc147c00 con 0x7fd4bc1435d0 2020-05-18T21:31:01.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c246f700 1 --2- 172.21.15.63:0/420272022 >> v2:172.21.15.63:3300/0 conn(0x7fd4bc1435d0 0x7fd4bc063ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd4b8002f70 tx=0x7fd4b8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c246f700 1 --2- 172.21.15.63:0/420272022 >> v2:172.21.15.63:3300/0 conn(0x7fd4bc1435d0 0x7fd4bc063ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd4b8002f70 tx=0x7fd4b8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c246f700 1 --2- 172.21.15.63:0/420272022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4bc1435d0 0x7fd4bc063ce0 secure :-1 s=READY pgs=947 cs=0 l=1 rx=0x7fd4b8002f70 tx=0x7fd4b8007a80).ready entity=mon.0 client_cookie=422a009d1e75ced9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:01.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c246f700 1 --2- 172.21.15.63:0/420272022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4bc1435d0 0x7fd4bc063ce0 secure :-1 s=THROTTLE_DONE pgs=947 cs=0 l=1 rx=0x7fd4b8002f70 tx=0x7fd4b8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c146d700 1 -- 172.21.15.63:0/420272022 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4b8008e50 con 0x7fd4bc1435d0 2020-05-18T21:31:01.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c246f700 1 --2- 172.21.15.63:0/420272022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4bc1435d0 0x7fd4bc063ce0 secure :-1 s=THROTTLE_DONE pgs=947 cs=0 l=1 rx=0x7fd4b8002f70 tx=0x7fd4b8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c146d700 1 -- 172.21.15.63:0/420272022 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b80115f0 con 0x7fd4bc1435d0 2020-05-18T21:31:01.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c246f700 1 --2- 172.21.15.63:0/420272022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4bc1435d0 0x7fd4bc063ce0 secure :-1 s=THROTTLE_DONE pgs=947 cs=0 l=1 rx=0x7fd4b8002f70 tx=0x7fd4b8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c146d700 1 -- 172.21.15.63:0/420272022 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4b8011a10 con 0x7fd4bc1435d0 2020-05-18T21:31:01.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c3471700 1 -- 172.21.15.63:0/420272022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4bc1435d0 msgr2=0x7fd4bc063ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:01.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c3471700 1 --2- 172.21.15.63:0/420272022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4bc1435d0 0x7fd4bc063ce0 secure :-1 s=READY pgs=947 cs=0 l=1 rx=0x7fd4b8002f70 tx=0x7fd4b8007a80).stop 2020-05-18T21:31:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c3471700 1 -- 172.21.15.63:0/420272022 shutdown_connections 2020-05-18T21:31:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c3471700 1 --2- 172.21.15.63:0/420272022 >> v2:172.21.15.155:3300/0 conn(0x7fd4bc147140 0x7fd4bc05edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:01.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c3471700 1 --2- 172.21.15.63:0/420272022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4bc1435d0 0x7fd4bc063ce0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:01.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c3471700 1 -- 172.21.15.63:0/420272022 >> 172.21.15.63:0/420272022 conn(0x7fd4bc069fc0 msgr2=0x7fd4bc06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:01.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c3471700 1 -- 172.21.15.63:0/420272022 shutdown_connections 2020-05-18T21:31:01.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.569+0000 7fd4c3471700 1 -- 172.21.15.63:0/420272022 wait complete. 2020-05-18T21:31:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4c3471700 1 Processor -- start 2020-05-18T21:31:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4c3471700 1 -- start start 2020-05-18T21:31:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4c3471700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd4bc1435d0 0x7fd4bc13dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4c3471700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd4bc147140 0x7fd4bc146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4c3471700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc13e030 con 0x7fd4bc05f230 2020-05-18T21:31:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4c3471700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc144bc0 con 0x7fd4bc147140 2020-05-18T21:31:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4c3471700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc1441e0 con 0x7fd4bc1435d0 2020-05-18T21:31:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4c246f700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd4bc05f230 0x7fd4bc1439b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59914/0 (socket says 172.21.15.63:59914) 2020-05-18T21:31:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4c246f700 1 -- 172.21.15.63:0/1749858768 learned_addr learned my addr 172.21.15.63:0/1749858768 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4c2c70700 1 --2- 172.21.15.63:0/1749858768 >> v2:172.21.15.63:3300/0 conn(0x7fd4bc147140 0x7fd4bc146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:01.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4c1c6e700 1 --2- 172.21.15.63:0/1749858768 >> v2:172.21.15.155:3300/0 conn(0x7fd4bc1435d0 0x7fd4bc13dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:01.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4ab7fe700 1 -- 172.21.15.63:0/1749858768 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430365472 0 0) 0x7fd4bc13e030 con 0x7fd4bc05f230 2020-05-18T21:31:01.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4ab7fe700 1 -- 172.21.15.63:0/1749858768 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd49c002fe0 con 0x7fd4bc05f230 2020-05-18T21:31:01.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4c2c70700 1 -- 172.21.15.63:0/1749858768 >> v2:172.21.15.155:3300/0 conn(0x7fd4bc1435d0 msgr2=0x7fd4bc13dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:01.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4c2c70700 1 --2- 172.21.15.63:0/1749858768 >> v2:172.21.15.155:3300/0 conn(0x7fd4bc1435d0 0x7fd4bc13dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4c2c70700 1 -- 172.21.15.63:0/1749858768 >> v1:172.21.15.63:6789/0 conn(0x7fd4bc05f230 legacy=0x7fd4bc1439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4c2c70700 1 -- 172.21.15.63:0/1749858768 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc144480 con 0x7fd4bc147140 2020-05-18T21:31:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4c2c70700 1 --2- 172.21.15.63:0/1749858768 >> v2:172.21.15.63:3300/0 conn(0x7fd4bc147140 0x7fd4bc146000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4bc0b5d40 tx=0x7fd4b4010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4c2c70700 1 --2- 172.21.15.63:0/1749858768 >> v2:172.21.15.63:3300/0 conn(0x7fd4bc147140 0x7fd4bc146000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4bc0b5d40 tx=0x7fd4b4010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.573+0000 7fd4c2c70700 1 --2- 172.21.15.63:0/1749858768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4bc147140 0x7fd4bc146000 secure :-1 s=READY pgs=949 cs=0 l=1 rx=0x7fd4bc0b5d40 tx=0x7fd4b4010bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:01.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.577+0000 7fd4c2c70700 1 --2- 172.21.15.63:0/1749858768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4bc147140 0x7fd4bc146000 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7fd4bc0b5d40 tx=0x7fd4b4010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.577+0000 7fd4ab7fe700 1 -- 172.21.15.63:0/1749858768 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4b4005e30 con 0x7fd4bc147140 2020-05-18T21:31:01.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.577+0000 7fd4c2c70700 1 --2- 172.21.15.63:0/1749858768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4bc147140 0x7fd4bc146000 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7fd4bc0b5d40 tx=0x7fd4b4010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.577+0000 7fd4c2c70700 1 --2- 172.21.15.63:0/1749858768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4bc147140 0x7fd4bc146000 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7fd4bc0b5d40 tx=0x7fd4b4010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.577+0000 7fd4ab7fe700 1 -- 172.21.15.63:0/1749858768 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b4012390 con 0x7fd4bc147140 2020-05-18T21:31:01.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.577+0000 7fd4c3471700 1 -- 172.21.15.63:0/1749858768 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4bc144720 con 0x7fd4bc147140 2020-05-18T21:31:01.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.577+0000 7fd4ab7fe700 1 -- 172.21.15.63:0/1749858768 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4b40127b0 con 0x7fd4bc147140 2020-05-18T21:31:01.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.577+0000 7fd4c3471700 1 -- 172.21.15.63:0/1749858768 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4bc151280 con 0x7fd4bc147140 2020-05-18T21:31:01.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.577+0000 7fd4c2c70700 1 --2- 172.21.15.63:0/1749858768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4bc147140 0x7fd4bc146000 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7fd4bc0b5d40 tx=0x7fd4b4010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.577+0000 7fd4c3471700 1 -- 172.21.15.63:0/1749858768 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4bc1468f0 con 0x7fd4bc147140 2020-05-18T21:31:01.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.577+0000 7fd4ab7fe700 1 -- 172.21.15.63:0/1749858768 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd4b4012a20 con 0x7fd4bc147140 2020-05-18T21:31:01.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.577+0000 7fd4c2c70700 1 --2- 172.21.15.63:0/1749858768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4bc147140 0x7fd4bc146000 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7fd4bc0b5d40 tx=0x7fd4b4010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.577+0000 7fd4ab7fe700 1 --2- 172.21.15.63:0/1749858768 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd49c04fdd0 0x7fd49c052290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:01.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.577+0000 7fd4ab7fe700 1 -- 172.21.15.63:0/1749858768 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd4b40090c0 con 0x7fd4bc147140 2020-05-18T21:31:01.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.577+0000 7fd4c246f700 1 --2- 172.21.15.63:0/1749858768 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd49c04fdd0 0x7fd49c052290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:01.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.577+0000 7fd4c246f700 1 --2- 172.21.15.63:0/1749858768 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd49c04fdd0 0x7fd49c052290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4b8008920 tx=0x7fd4b8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.577+0000 7fd4c246f700 1 --2- 172.21.15.63:0/1749858768 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd49c04fdd0 0x7fd49c052290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4b8008920 tx=0x7fd4b8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.577+0000 7fd4c246f700 1 --2- 172.21.15.63:0/1749858768 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd49c04fdd0 0x7fd49c052290 secure :-1 s=READY pgs=380 cs=0 l=1 rx=0x7fd4b8008920 tx=0x7fd4b8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:01.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.585+0000 7fd4c2c70700 1 --2- 172.21.15.63:0/1749858768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4bc147140 0x7fd4bc146000 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7fd4bc0b5d40 tx=0x7fd4b4010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:01.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.585+0000 7fd4ab7fe700 1 -- 172.21.15.63:0/1749858768 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd4b403e3f0 con 0x7fd4bc147140 2020-05-18T21:31:01.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.737+0000 7fd4c3471700 1 -- 172.21.15.63:0/1749858768 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4bc0569e0 con 0x7fd4bc147140 2020-05-18T21:31:02.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.741+0000 7fd4c2c70700 1 --2- 172.21.15.63:0/1749858768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4bc147140 0x7fd4bc146000 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7fd4bc0b5d40 tx=0x7fd4b4010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:02.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.741+0000 7fd4ab7fe700 1 -- 172.21.15.63:0/1749858768 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7fd4b4041a10 con 0x7fd4bc147140 2020-05-18T21:31:02.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.741+0000 7fd4c3471700 1 -- 172.21.15.63:0/1749858768 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd49c04fdd0 msgr2=0x7fd49c052290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:02.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.741+0000 7fd4c3471700 1 --2- 172.21.15.63:0/1749858768 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd49c04fdd0 0x7fd49c052290 secure :-1 s=READY pgs=380 cs=0 l=1 rx=0x7fd4b8008920 tx=0x7fd4b8007a80).stop 2020-05-18T21:31:02.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.741+0000 7fd4c3471700 1 -- 172.21.15.63:0/1749858768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4bc147140 msgr2=0x7fd4bc146000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:02.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.741+0000 7fd4c3471700 1 --2- 172.21.15.63:0/1749858768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4bc147140 0x7fd4bc146000 secure :-1 s=READY pgs=949 cs=0 l=1 rx=0x7fd4bc0b5d40 tx=0x7fd4b4010bb0).stop 2020-05-18T21:31:02.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.741+0000 7fd4c3471700 1 -- 172.21.15.63:0/1749858768 shutdown_connections 2020-05-18T21:31:02.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.741+0000 7fd4c3471700 1 --2- 172.21.15.63:0/1749858768 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd49c04fdd0 0x7fd49c052290 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:02.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.741+0000 7fd4c3471700 1 --2- 172.21.15.63:0/1749858768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4bc147140 0x7fd4bc146000 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:02.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.741+0000 7fd4c3471700 1 --2- 172.21.15.63:0/1749858768 >> v2:172.21.15.155:3300/0 conn(0x7fd4bc1435d0 0x7fd4bc13dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:02.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.741+0000 7fd4c3471700 1 -- 172.21.15.63:0/1749858768 >> 172.21.15.63:0/1749858768 conn(0x7fd4bc069fc0 msgr2=0x7fd4bc13f660 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:02.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.741+0000 7fd4c3471700 1 -- 172.21.15.63:0/1749858768 shutdown_connections 2020-05-18T21:31:02.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:01.741+0000 7fd4c3471700 1 -- 172.21.15.63:0/1749858768 wait complete. 2020-05-18T21:31:02.432 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:31:02.433 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:02.433 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:31:02.433 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_reintegrated 2020-05-18T21:31:02.542 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:02.542 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:31:02.543 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_reintegrated": 1 2020-05-18T21:31:02.543 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:02.543 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:02.551 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_reintegrated": 1 } } 2020-05-18T21:31:02.552 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:02.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086359e700 1 Processor -- start 2020-05-18T21:31:02.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086359e700 1 -- start start 2020-05-18T21:31:02.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086359e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f086405f110 0x7f08640b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:02.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086359e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f086414aa70 0x7f08640648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:02.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086359e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086414a330 con 0x7f0864064d20 2020-05-18T21:31:02.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086359e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086414a140 con 0x7f086405f110 2020-05-18T21:31:02.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086359e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086414a5d0 con 0x7f086414aa70 2020-05-18T21:31:02.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086259c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f086405f110 0x7f08640b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:02.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f0862d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0864064d20 0x7f086414d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59926/0 (socket says 172.21.15.63:59926) 2020-05-18T21:31:02.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f0862d9d700 1 -- 172.21.15.63:0/1738217448 learned_addr learned my addr 172.21.15.63:0/1738217448 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:02.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f0861d9b700 1 --2- 172.21.15.63:0/1738217448 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f086414aa70 0x7f08640648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:02.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086259c700 1 -- 172.21.15.63:0/1738217448 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f086414aa70 msgr2=0x7f08640648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:02.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086259c700 1 --2- 172.21.15.63:0/1738217448 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f086414aa70 0x7f08640648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:02.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086259c700 1 -- 172.21.15.63:0/1738217448 >> v1:172.21.15.63:6789/0 conn(0x7f0864064d20 legacy=0x7f086414d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:02.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086259c700 1 -- 172.21.15.63:0/1738217448 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0864063430 con 0x7f086405f110 2020-05-18T21:31:02.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086259c700 1 --2- 172.21.15.63:0/1738217448 >> v2:172.21.15.63:3300/0 conn(0x7f086405f110 0x7f08640b4760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0864063c70 tx=0x7f0858008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:02.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086259c700 1 --2- 172.21.15.63:0/1738217448 >> v2:172.21.15.63:3300/0 conn(0x7f086405f110 0x7f08640b4760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0864063c70 tx=0x7f0858008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:02.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086259c700 1 --2- 172.21.15.63:0/1738217448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f086405f110 0x7f08640b4760 secure :-1 s=READY pgs=951 cs=0 l=1 rx=0x7f0864063c70 tx=0x7f0858008920).ready entity=mon.0 client_cookie=3915f4f33cb226be server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:02.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086259c700 1 --2- 172.21.15.63:0/1738217448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f086405f110 0x7f08640b4760 secure :-1 s=THROTTLE_DONE pgs=951 cs=0 l=1 rx=0x7f0864063c70 tx=0x7f0858008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:02.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086259c700 1 --2- 172.21.15.63:0/1738217448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f086405f110 0x7f08640b4760 secure :-1 s=THROTTLE_DONE pgs=951 cs=0 l=1 rx=0x7f0864063c70 tx=0x7f0858008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:02.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086159a700 1 -- 172.21.15.63:0/1738217448 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0858008e80 con 0x7f086405f110 2020-05-18T21:31:02.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086259c700 1 --2- 172.21.15.63:0/1738217448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f086405f110 0x7f08640b4760 secure :-1 s=THROTTLE_DONE pgs=951 cs=0 l=1 rx=0x7f0864063c70 tx=0x7f0858008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:02.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086159a700 1 -- 172.21.15.63:0/1738217448 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08580115f0 con 0x7f086405f110 2020-05-18T21:31:02.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086159a700 1 -- 172.21.15.63:0/1738217448 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0858011a10 con 0x7f086405f110 2020-05-18T21:31:02.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086359e700 1 -- 172.21.15.63:0/1738217448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f086405f110 msgr2=0x7f08640b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:02.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.653+0000 7f086359e700 1 --2- 172.21.15.63:0/1738217448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f086405f110 0x7f08640b4760 secure :-1 s=READY pgs=951 cs=0 l=1 rx=0x7f0864063c70 tx=0x7f0858008920).stop 2020-05-18T21:31:02.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.657+0000 7f086359e700 1 -- 172.21.15.63:0/1738217448 shutdown_connections 2020-05-18T21:31:02.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.657+0000 7f086359e700 1 --2- 172.21.15.63:0/1738217448 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f086414aa70 0x7f08640648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:02.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.657+0000 7f086359e700 1 --2- 172.21.15.63:0/1738217448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f086405f110 0x7f08640b4760 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:02.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.657+0000 7f086359e700 1 -- 172.21.15.63:0/1738217448 >> 172.21.15.63:0/1738217448 conn(0x7f0864069fc0 msgr2=0x7f086406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:02.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.657+0000 7f086359e700 1 -- 172.21.15.63:0/1738217448 shutdown_connections 2020-05-18T21:31:02.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.657+0000 7f086359e700 1 -- 172.21.15.63:0/1738217448 wait complete. 2020-05-18T21:31:02.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.657+0000 7f086359e700 1 Processor -- start 2020-05-18T21:31:02.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.657+0000 7f086359e700 1 -- start start 2020-05-18T21:31:02.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f086359e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f086405f110 0x7f08640ad470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:02.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f086359e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0864064d20 0x7f08641575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:02.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f086359e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f086414aa70 0x7f0864157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:02.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f086359e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086414aef0 con 0x7f0864064d20 2020-05-18T21:31:02.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f086359e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0864146cc0 con 0x7f086414aa70 2020-05-18T21:31:02.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f086359e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0864144790 con 0x7f086405f110 2020-05-18T21:31:02.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f0861d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0864064d20 0x7f08641575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:02.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f0861d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0864064d20 0x7f08641575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57742/0 (socket says 172.21.15.63:57742) 2020-05-18T21:31:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f0861d9b700 1 -- 172.21.15.63:0/2318979273 learned_addr learned my addr 172.21.15.63:0/2318979273 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f0862d9d700 1 --2- 172.21.15.63:0/2318979273 >> v2:172.21.15.155:3300/0 conn(0x7f086414aa70 0x7f0864157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f086259c700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f086405f110 0x7f08640ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f0861d9b700 1 -- 172.21.15.63:0/2318979273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f086405f110 msgr2=0x7f08640ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f0861d9b700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f086405f110 0x7f08640ad470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f0861d9b700 1 -- 172.21.15.63:0/2318979273 >> v2:172.21.15.155:3300/0 conn(0x7f086414aa70 msgr2=0x7f0864157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f0861d9b700 1 --2- 172.21.15.63:0/2318979273 >> v2:172.21.15.155:3300/0 conn(0x7f086414aa70 0x7f0864157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f0861d9b700 1 -- 172.21.15.63:0/2318979273 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08640adcb0 con 0x7f0864064d20 2020-05-18T21:31:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f0861d9b700 1 --2- 172.21.15.63:0/2318979273 >> v2:172.21.15.63:3300/0 conn(0x7f0864064d20 0x7f08641575f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0854003430 tx=0x7f0854011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f0861d9b700 1 --2- 172.21.15.63:0/2318979273 >> v2:172.21.15.63:3300/0 conn(0x7f0864064d20 0x7f08641575f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0854003430 tx=0x7f0854011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f0861d9b700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0864064d20 0x7f08641575f0 secure :-1 s=READY pgs=952 cs=0 l=1 rx=0x7f0854003430 tx=0x7f0854011090).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:02.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f0861d9b700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0864064d20 0x7f08641575f0 secure :-1 s=THROTTLE_DONE pgs=952 cs=0 l=1 rx=0x7f0854003430 tx=0x7f0854011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:02.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f08537fe700 1 -- 172.21.15.63:0/2318979273 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0854005e70 con 0x7f0864064d20 2020-05-18T21:31:02.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f0861d9b700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0864064d20 0x7f08641575f0 secure :-1 s=THROTTLE_DONE pgs=952 cs=0 l=1 rx=0x7f0854003430 tx=0x7f0854011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:02.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f0861d9b700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0864064d20 0x7f08641575f0 secure :-1 s=THROTTLE_DONE pgs=952 cs=0 l=1 rx=0x7f0854003430 tx=0x7f0854011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:02.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f08537fe700 1 -- 172.21.15.63:0/2318979273 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0854007560 con 0x7f0864064d20 2020-05-18T21:31:02.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f08537fe700 1 -- 172.21.15.63:0/2318979273 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0854012600 con 0x7f0864064d20 2020-05-18T21:31:02.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f086359e700 1 -- 172.21.15.63:0/2318979273 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086414b120 con 0x7f0864064d20 2020-05-18T21:31:02.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.661+0000 7f086359e700 1 -- 172.21.15.63:0/2318979273 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0864157eb0 con 0x7f0864064d20 2020-05-18T21:31:02.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.665+0000 7f0861d9b700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0864064d20 0x7f08641575f0 secure :-1 s=THROTTLE_DONE pgs=952 cs=0 l=1 rx=0x7f0854003430 tx=0x7f0854011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:02.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.665+0000 7f086359e700 1 -- 172.21.15.63:0/2318979273 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08640adaf0 con 0x7f0864064d20 2020-05-18T21:31:02.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.665+0000 7f08537fe700 1 -- 172.21.15.63:0/2318979273 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f085400e1a0 con 0x7f0864064d20 2020-05-18T21:31:02.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.665+0000 7f0861d9b700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0864064d20 0x7f08641575f0 secure :-1 s=THROTTLE_DONE pgs=952 cs=0 l=1 rx=0x7f0854003430 tx=0x7f0854011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:02.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.665+0000 7f08537fe700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f084004f9e0 0x7f0840051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:02.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.665+0000 7f08537fe700 1 -- 172.21.15.63:0/2318979273 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0854063d00 con 0x7f0864064d20 2020-05-18T21:31:02.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.665+0000 7f086259c700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f084004f9e0 0x7f0840051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:02.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.665+0000 7f086259c700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f084004f9e0 0x7f0840051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0864063c70 tx=0x7f08640635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:02.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.665+0000 7f086259c700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f084004f9e0 0x7f0840051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0864063c70 tx=0x7f08640635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:02.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.665+0000 7f086259c700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f084004f9e0 0x7f0840051ea0 secure :-1 s=READY pgs=381 cs=0 l=1 rx=0x7f0864063c70 tx=0x7f08640635c0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:02.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.669+0000 7f0861d9b700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0864064d20 0x7f08641575f0 secure :-1 s=THROTTLE_DONE pgs=952 cs=0 l=1 rx=0x7f0854003430 tx=0x7f0854011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:02.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.669+0000 7f08537fe700 1 -- 172.21.15.63:0/2318979273 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f085403e030 con 0x7f0864064d20 2020-05-18T21:31:02.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.813+0000 7f086359e700 1 -- 172.21.15.63:0/2318979273 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08641584d0 con 0x7f0864064d20 2020-05-18T21:31:02.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.817+0000 7f0861d9b700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0864064d20 0x7f08641575f0 secure :-1 s=THROTTLE_DONE pgs=952 cs=0 l=1 rx=0x7f0854003430 tx=0x7f0854011090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:02.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.817+0000 7f08537fe700 1 -- 172.21.15.63:0/2318979273 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7f0854041650 con 0x7f0864064d20 2020-05-18T21:31:02.821 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:02.821 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:31:02.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.817+0000 7f086359e700 1 -- 172.21.15.63:0/2318979273 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f084004f9e0 msgr2=0x7f0840051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:02.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.817+0000 7f086359e700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f084004f9e0 0x7f0840051ea0 secure :-1 s=READY pgs=381 cs=0 l=1 rx=0x7f0864063c70 tx=0x7f08640635c0).stop 2020-05-18T21:31:02.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.817+0000 7f086359e700 1 -- 172.21.15.63:0/2318979273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0864064d20 msgr2=0x7f08641575f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:02.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.817+0000 7f086359e700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0864064d20 0x7f08641575f0 secure :-1 s=READY pgs=952 cs=0 l=1 rx=0x7f0854003430 tx=0x7f0854011090).stop 2020-05-18T21:31:02.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.817+0000 7f086359e700 1 -- 172.21.15.63:0/2318979273 shutdown_connections 2020-05-18T21:31:02.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.817+0000 7f086359e700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f084004f9e0 0x7f0840051ea0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:02.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.817+0000 7f086359e700 1 --2- 172.21.15.63:0/2318979273 >> v2:172.21.15.155:3300/0 conn(0x7f086414aa70 0x7f0864157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:02.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.817+0000 7f086359e700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0864064d20 0x7f08641575f0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:02.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.817+0000 7f086359e700 1 --2- 172.21.15.63:0/2318979273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f086405f110 0x7f08640ad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:02.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.817+0000 7f086359e700 1 -- 172.21.15.63:0/2318979273 >> 172.21.15.63:0/2318979273 conn(0x7f0864069fc0 msgr2=0x7f08640b72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:02.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.817+0000 7f086359e700 1 -- 172.21.15.63:0/2318979273 shutdown_connections 2020-05-18T21:31:02.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.817+0000 7f086359e700 1 -- 172.21.15.63:0/2318979273 wait complete. 2020-05-18T21:31:02.825 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:31:02.833 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush journal 2020-05-18T21:31:02.951 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:02.952 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "", 2020-05-18T21:31:02.952 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0 2020-05-18T21:31:02.952 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:02.963 INFO:tasks.cephfs.filesystem:_json_asok output: { "message": "", "return_code": 0 } 2020-05-18T21:31:02.963 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_data getxattr 10000000001.00000000 parent 2020-05-18T21:31:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.989+0000 7f05865cab80 1 Processor -- start 2020-05-18T21:31:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.989+0000 7f05865cab80 1 -- start start 2020-05-18T21:31:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f05865cab80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56177ab11a60 0x56177ab0c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f05865cab80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x56177a9e14b0 con 0x56177ab11ea0 2020-05-18T21:31:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f05865cab80 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x56177a9c1460 con 0x56177ab11680 2020-05-18T21:31:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f05865cab80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x56177a9cd110 con 0x56177ab11a60 2020-05-18T21:31:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f058520e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x56177ab11ea0 0x56177ab0df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59946/0 (socket says 172.21.15.63:59946) 2020-05-18T21:31:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f058520e700 1 -- 172.21.15.63:0/4220224012 learned_addr learned my addr 172.21.15.63:0/4220224012 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f058420c700 1 --2- 172.21.15.63:0/4220224012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56177ab11a60 0x56177ab0c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:02.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f0582a09700 1 -- 172.21.15.63:0/4220224012 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968234742 0 0) 0x56177a9e14b0 con 0x56177ab11ea0 2020-05-18T21:31:02.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f0582a09700 1 -- 172.21.15.63:0/4220224012 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0564002020 con 0x56177ab11ea0 2020-05-18T21:31:03.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f0582a09700 1 -- 172.21.15.63:0/4220224012 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910028257 0 0) 0x56177a9c1460 con 0x56177ab11680 2020-05-18T21:31:03.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f0582a09700 1 -- 172.21.15.63:0/4220224012 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x56177a9e14b0 con 0x56177ab11680 2020-05-18T21:31:03.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f0582a09700 1 -- 172.21.15.63:0/4220224012 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 977740447 0 0) 0x7f0564002020 con 0x56177ab11ea0 2020-05-18T21:31:03.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f058420c700 1 -- 172.21.15.63:0/4220224012 >> v1:172.21.15.155:6789/0 conn(0x56177ab11680 legacy=0x56177ab0d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:03.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f058420c700 1 -- 172.21.15.63:0/4220224012 >> v1:172.21.15.63:6789/0 conn(0x56177ab11ea0 legacy=0x56177ab0df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:03.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f058420c700 1 -- 172.21.15.63:0/4220224012 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56177ab0e650 con 0x56177ab11a60 2020-05-18T21:31:03.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f058420c700 1 --2- 172.21.15.63:0/4220224012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56177ab11a60 0x56177ab0c9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f057c0032f0 tx=0x7f056c00e7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f058420c700 1 --2- 172.21.15.63:0/4220224012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56177ab11a60 0x56177ab0c9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f057c0032f0 tx=0x7f056c00e7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f058420c700 1 --2- 172.21.15.63:0/4220224012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56177ab11a60 0x56177ab0c9e0 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f057c0032f0 tx=0x7f056c00e7c0).ready entity=mon.2 client_cookie=c08a6195f7f30bb3 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f058420c700 1 --2- 172.21.15.63:0/4220224012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56177ab11a60 0x56177ab0c9e0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f057c0032f0 tx=0x7f056c00e7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f0582a09700 1 -- 172.21.15.63:0/4220224012 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f057c001740 con 0x56177ab11a60 2020-05-18T21:31:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f058420c700 1 --2- 172.21.15.63:0/4220224012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56177ab11a60 0x56177ab0c9e0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f057c0032f0 tx=0x7f056c00e7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f058420c700 1 --2- 172.21.15.63:0/4220224012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56177ab11a60 0x56177ab0c9e0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f057c0032f0 tx=0x7f056c00e7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f0582a09700 1 -- 172.21.15.63:0/4220224012 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c0054c0 con 0x56177ab11a60 2020-05-18T21:31:03.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f0582a09700 1 -- 172.21.15.63:0/4220224012 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f056c005860 con 0x56177ab11a60 2020-05-18T21:31:03.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f05865cab80 1 -- 172.21.15.63:0/4220224012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56177ab11a60 msgr2=0x56177ab0c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:03.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f05865cab80 1 --2- 172.21.15.63:0/4220224012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56177ab11a60 0x56177ab0c9e0 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f057c0032f0 tx=0x7f056c00e7c0).stop 2020-05-18T21:31:03.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f05865cab80 1 -- 172.21.15.63:0/4220224012 shutdown_connections 2020-05-18T21:31:03.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f05865cab80 1 --2- 172.21.15.63:0/4220224012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56177ab11a60 0x56177ab0c9e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:03.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f05865cab80 1 -- 172.21.15.63:0/4220224012 >> 172.21.15.63:0/4220224012 conn(0x56177aa84850 msgr2=0x56177ab0d070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:03.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f05865cab80 1 -- 172.21.15.63:0/4220224012 shutdown_connections 2020-05-18T21:31:03.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.993+0000 7f05865cab80 1 -- 172.21.15.63:0/4220224012 wait complete. 2020-05-18T21:31:03.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f05865cab80 1 Processor -- start 2020-05-18T21:31:03.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f05865cab80 1 -- start start 2020-05-18T21:31:03.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f05865cab80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56177ab11a60 0x56177ab0d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:03.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f05865cab80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x56177ab11ea0 0x56177ab0de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:03.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f05865cab80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x56177aa7b820 con 0x56177ab11680 2020-05-18T21:31:03.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f05865cab80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x56177a9bda40 con 0x56177ab11ea0 2020-05-18T21:31:03.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f05865cab80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x56177aa7b630 con 0x56177ab11a60 2020-05-18T21:31:03.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f0584a0d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x56177ab11680 0x56177ab079e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59948/0 (socket says 172.21.15.63:59948) 2020-05-18T21:31:03.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f0584a0d700 1 -- 172.21.15.63:0/586910887 learned_addr learned my addr 172.21.15.63:0/586910887 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:03.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f058520e700 1 --2- 172.21.15.63:0/586910887 >> v2:172.21.15.155:3300/0 conn(0x56177ab11ea0 0x56177ab0de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:03.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f058420c700 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56177ab11a60 0x56177ab0d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:03.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f0582208700 1 -- 172.21.15.63:0/586910887 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766826792 0 0) 0x56177aa7b820 con 0x56177ab11680 2020-05-18T21:31:03.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f0582208700 1 -- 172.21.15.63:0/586910887 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0564002020 con 0x56177ab11680 2020-05-18T21:31:03.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f0582208700 1 -- 172.21.15.63:0/586910887 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2420439161 0 0) 0x7f0564002020 con 0x56177ab11680 2020-05-18T21:31:03.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f0582208700 1 -- 172.21.15.63:0/586910887 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x56177aa7b820 con 0x56177ab11680 2020-05-18T21:31:03.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f0582208700 1 -- 172.21.15.63:0/586910887 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f0574006460 con 0x56177ab11680 2020-05-18T21:31:03.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f058520e700 1 -- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56177ab11a60 msgr2=0x56177ab0d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:03.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f058520e700 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56177ab11a60 0x56177ab0d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:03.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f058520e700 1 -- 172.21.15.63:0/586910887 >> v1:172.21.15.63:6789/0 conn(0x56177ab11680 legacy=0x56177ab079e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:03.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f058520e700 1 -- 172.21.15.63:0/586910887 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56177aa65880 con 0x56177ab11ea0 2020-05-18T21:31:03.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f058520e700 1 --2- 172.21.15.63:0/586910887 >> v2:172.21.15.155:3300/0 conn(0x56177ab11ea0 0x56177ab0de00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f057c0069c0 tx=0x7f057c00fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f058520e700 1 --2- 172.21.15.63:0/586910887 >> v2:172.21.15.155:3300/0 conn(0x56177ab11ea0 0x56177ab0de00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f057c0069c0 tx=0x7f057c00fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f058520e700 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56177ab11ea0 0x56177ab0de00 secure :-1 s=READY pgs=671 cs=0 l=1 rx=0x7f057c0069c0 tx=0x7f057c00fd40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:03.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f058520e700 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56177ab11ea0 0x56177ab0de00 secure :-1 s=THROTTLE_DONE pgs=671 cs=0 l=1 rx=0x7f057c0069c0 tx=0x7f057c00fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f0582208700 1 -- 172.21.15.63:0/586910887 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f057c004800 con 0x56177ab11ea0 2020-05-18T21:31:03.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f058520e700 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56177ab11ea0 0x56177ab0de00 secure :-1 s=THROTTLE_DONE pgs=671 cs=0 l=1 rx=0x7f057c0069c0 tx=0x7f057c00fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f05865cab80 1 -- 172.21.15.63:0/586910887 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56177ab0b630 con 0x56177ab11ea0 2020-05-18T21:31:03.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f058520e700 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56177ab11ea0 0x56177ab0de00 secure :-1 s=THROTTLE_DONE pgs=671 cs=0 l=1 rx=0x7f057c0069c0 tx=0x7f057c00fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f0582208700 1 -- 172.21.15.63:0/586910887 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c004960 con 0x56177ab11ea0 2020-05-18T21:31:03.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f0582208700 1 -- 172.21.15.63:0/586910887 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f057c004d40 con 0x56177ab11ea0 2020-05-18T21:31:03.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:02.997+0000 7f05865cab80 1 -- 172.21.15.63:0/586910887 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56177ab080f0 con 0x56177ab11ea0 2020-05-18T21:31:03.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.001+0000 7f058520e700 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56177ab11ea0 0x56177ab0de00 secure :-1 s=THROTTLE_DONE pgs=671 cs=0 l=1 rx=0x7f057c0069c0 tx=0x7f057c00fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.001+0000 7f0582208700 1 -- 172.21.15.63:0/586910887 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f057c0112b0 con 0x56177ab11ea0 2020-05-18T21:31:03.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.001+0000 7f058520e700 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56177ab11ea0 0x56177ab0de00 secure :-1 s=THROTTLE_DONE pgs=671 cs=0 l=1 rx=0x7f057c0069c0 tx=0x7f057c00fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.001+0000 7f0582208700 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f056404eec0 0x7f0564051380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:03.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.001+0000 7f0582208700 1 -- 172.21.15.63:0/586910887 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f057c062a90 con 0x56177ab11ea0 2020-05-18T21:31:03.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.001+0000 7f05865cab80 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x56177ab26da0 0x56177ab29190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:03.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.001+0000 7f05865cab80 1 -- 172.21.15.63:0/586910887 --> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] -- osd_op(unknown.0.0:1 14.7 14:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected e75) v8 -- 0x56177ab295f0 con 0x56177ab26da0 2020-05-18T21:31:03.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.001+0000 7f0584a0d700 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f056404eec0 0x7f0564051380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:03.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.001+0000 7f058420c700 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x56177ab26da0 0x56177ab29190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:03.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.001+0000 7f0584a0d700 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f056404eec0 0x7f0564051380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0574006f00 tx=0x7f0574006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.001+0000 7f0584a0d700 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f056404eec0 0x7f0564051380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0574006f00 tx=0x7f0574006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.001+0000 7f0584a0d700 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f056404eec0 0x7f0564051380 secure :-1 s=READY pgs=382 cs=0 l=1 rx=0x7f0574006f00 tx=0x7f0574006620).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:03.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.001+0000 7f058420c700 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x56177ab26da0 0x56177ab29190 crc :-1 s=READY pgs=23 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:03.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.001+0000 7f058420c700 1 -- 172.21.15.63:0/586910887 <== osd.5 v2:172.21.15.155:6808/13024 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (93) out=93b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+93 (crc 0 0 0) 0x7f056c0053d0 con 0x56177ab26da0 2020-05-18T21:31:03.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.001+0000 7f05865cab80 1 -- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x56177ab26da0 msgr2=0x56177ab29190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:03.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.001+0000 7f05865cab80 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x56177ab26da0 0x56177ab29190 crc :-1 s=READY pgs=23 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:03.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.005+0000 7f05865cab80 1 -- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f056404eec0 msgr2=0x7f0564051380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:03.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.005+0000 7f05865cab80 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f056404eec0 0x7f0564051380 secure :-1 s=READY pgs=382 cs=0 l=1 rx=0x7f0574006f00 tx=0x7f0574006620).stop 2020-05-18T21:31:03.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.005+0000 7f05865cab80 1 -- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56177ab11ea0 msgr2=0x56177ab0de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:03.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.005+0000 7f05865cab80 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56177ab11ea0 0x56177ab0de00 secure :-1 s=READY pgs=671 cs=0 l=1 rx=0x7f057c0069c0 tx=0x7f057c00fd40).stop 2020-05-18T21:31:03.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.005+0000 7f058520e700 1 -- 172.21.15.63:0/586910887 reap_dead start 2020-05-18T21:31:03.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.005+0000 7f05865cab80 1 -- 172.21.15.63:0/586910887 shutdown_connections 2020-05-18T21:31:03.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.005+0000 7f05865cab80 1 --2- 172.21.15.63:0/586910887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56177ab11ea0 0x56177ab0de00 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:03.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.005+0000 7f05865cab80 1 -- 172.21.15.63:0/586910887 >> 172.21.15.63:0/586910887 conn(0x56177aa84850 msgr2=0x56177ab0d070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:03.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.005+0000 7f05865cab80 1 -- 172.21.15.63:0/586910887 shutdown_connections 2020-05-18T21:31:03.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.005+0000 7f05865cab80 1 -- 172.21.15.63:0/586910887 wait complete. 2020-05-18T21:31:03.022 INFO:teuthology.orchestra.run.smithi063.stdout:W�file_cdir_2 2020-05-18T21:31:03.023 INFO:teuthology.orchestra.run.smithi063:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2020-05-18T21:31:03.068 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:03.068 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1099511627777, 2020-05-18T21:31:03.069 INFO:teuthology.orchestra.run.smithi063.stdout: "ancestors": [ 2020-05-18T21:31:03.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:03.069 INFO:teuthology.orchestra.run.smithi063.stdout: "dirino": 1099511628278, 2020-05-18T21:31:03.069 INFO:teuthology.orchestra.run.smithi063.stdout: "dname": "file_c", 2020-05-18T21:31:03.069 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 15 2020-05-18T21:31:03.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:03.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:03.070 INFO:teuthology.orchestra.run.smithi063.stdout: "dirino": 1, 2020-05-18T21:31:03.070 INFO:teuthology.orchestra.run.smithi063.stdout: "dname": "dir_2", 2020-05-18T21:31:03.070 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 31 2020-05-18T21:31:03.070 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:03.071 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:03.071 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 14, 2020-05-18T21:31:03.071 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [] 2020-05-18T21:31:03.071 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:03.071 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:03.073 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo ln dir_2/file_c dir_2/file_d) 2020-05-18T21:31:03.110 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rm -f dir_2/file_c) 2020-05-18T21:31:03.138 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:03.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a3ab03700 1 Processor -- start 2020-05-18T21:31:03.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a3ab03700 1 -- start start 2020-05-18T21:31:03.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a3ab03700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9a3405bda0 0x7f9a34142f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:03.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a3ab03700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3412ba80 0x7f9a3412bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:03.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a3ab03700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3405ab40 con 0x7f9a340652b0 2020-05-18T21:31:03.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a3ab03700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a340b6a10 con 0x7f9a3405bda0 2020-05-18T21:31:03.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a3ab03700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3405ade0 con 0x7f9a3412ba80 2020-05-18T21:31:03.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a33fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9a3405bda0 0x7f9a34142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:03.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a3889f700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9a340652b0 0x7f9a341400d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59958/0 (socket says 172.21.15.63:59958) 2020-05-18T21:31:03.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a3889f700 1 -- 172.21.15.63:0/3761302828 learned_addr learned my addr 172.21.15.63:0/3761302828 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:03.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a390a0700 1 --2- 172.21.15.63:0/3761302828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3412ba80 0x7f9a3412bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:03.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a337fe700 1 -- 172.21.15.63:0/3761302828 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766297016 0 0) 0x7f9a3405ab40 con 0x7f9a340652b0 2020-05-18T21:31:03.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a337fe700 1 -- 172.21.15.63:0/3761302828 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a20003270 con 0x7f9a340652b0 2020-05-18T21:31:03.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a33fff700 1 -- 172.21.15.63:0/3761302828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3412ba80 msgr2=0x7f9a3412bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:03.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a33fff700 1 --2- 172.21.15.63:0/3761302828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3412ba80 0x7f9a3412bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:03.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a33fff700 1 -- 172.21.15.63:0/3761302828 >> v1:172.21.15.63:6789/0 conn(0x7f9a340652b0 legacy=0x7f9a341400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:03.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a33fff700 1 -- 172.21.15.63:0/3761302828 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3405b080 con 0x7f9a3405bda0 2020-05-18T21:31:03.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a33fff700 1 --2- 172.21.15.63:0/3761302828 >> v2:172.21.15.63:3300/0 conn(0x7f9a3405bda0 0x7f9a34142f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9a28002f70 tx=0x7f9a28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a33fff700 1 --2- 172.21.15.63:0/3761302828 >> v2:172.21.15.63:3300/0 conn(0x7f9a3405bda0 0x7f9a34142f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9a28002f70 tx=0x7f9a28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a33fff700 1 --2- 172.21.15.63:0/3761302828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a3405bda0 0x7f9a34142f30 secure :-1 s=READY pgs=957 cs=0 l=1 rx=0x7f9a28002f70 tx=0x7f9a28007a80).ready entity=mon.0 client_cookie=74bc986cc085967f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:03.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a33fff700 1 --2- 172.21.15.63:0/3761302828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a3405bda0 0x7f9a34142f30 secure :-1 s=THROTTLE_DONE pgs=957 cs=0 l=1 rx=0x7f9a28002f70 tx=0x7f9a28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a337fe700 1 -- 172.21.15.63:0/3761302828 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a28008e80 con 0x7f9a3405bda0 2020-05-18T21:31:03.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a33fff700 1 --2- 172.21.15.63:0/3761302828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a3405bda0 0x7f9a34142f30 secure :-1 s=THROTTLE_DONE pgs=957 cs=0 l=1 rx=0x7f9a28002f70 tx=0x7f9a28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a33fff700 1 --2- 172.21.15.63:0/3761302828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a3405bda0 0x7f9a34142f30 secure :-1 s=THROTTLE_DONE pgs=957 cs=0 l=1 rx=0x7f9a28002f70 tx=0x7f9a28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a337fe700 1 -- 172.21.15.63:0/3761302828 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a28013750 con 0x7f9a3405bda0 2020-05-18T21:31:03.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a337fe700 1 -- 172.21.15.63:0/3761302828 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a28013b70 con 0x7f9a3405bda0 2020-05-18T21:31:03.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a3ab03700 1 -- 172.21.15.63:0/3761302828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a3405bda0 msgr2=0x7f9a34142f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:03.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.285+0000 7f9a3ab03700 1 --2- 172.21.15.63:0/3761302828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a3405bda0 0x7f9a34142f30 secure :-1 s=READY pgs=957 cs=0 l=1 rx=0x7f9a28002f70 tx=0x7f9a28007a80).stop 2020-05-18T21:31:03.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.289+0000 7f9a3ab03700 1 -- 172.21.15.63:0/3761302828 shutdown_connections 2020-05-18T21:31:03.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.289+0000 7f9a3ab03700 1 --2- 172.21.15.63:0/3761302828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3412ba80 0x7f9a3412bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:03.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.289+0000 7f9a3ab03700 1 --2- 172.21.15.63:0/3761302828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a3405bda0 0x7f9a34142f30 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:03.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.289+0000 7f9a3ab03700 1 -- 172.21.15.63:0/3761302828 >> 172.21.15.63:0/3761302828 conn(0x7f9a34066ed0 msgr2=0x7f9a340b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:03.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.289+0000 7f9a3ab03700 1 -- 172.21.15.63:0/3761302828 shutdown_connections 2020-05-18T21:31:03.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.289+0000 7f9a3ab03700 1 -- 172.21.15.63:0/3761302828 wait complete. 2020-05-18T21:31:03.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.289+0000 7f9a3ab03700 1 Processor -- start 2020-05-18T21:31:03.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.289+0000 7f9a3ab03700 1 -- start start 2020-05-18T21:31:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a3ab03700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9a340652b0 0x7f9a3406a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a3ab03700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3412ba80 0x7f9a341405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a3ab03700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3406a820 con 0x7f9a3405bda0 2020-05-18T21:31:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a3ab03700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a34141f00 con 0x7f9a340652b0 2020-05-18T21:31:03.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a3ab03700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a341421a0 con 0x7f9a3412ba80 2020-05-18T21:31:03.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a33fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9a340652b0 0x7f9a3406a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:03.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a3889f700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9a3405bda0 0x7f9a3413fea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59964/0 (socket says 172.21.15.63:59964) 2020-05-18T21:31:03.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a3889f700 1 -- 172.21.15.63:0/432950654 learned_addr learned my addr 172.21.15.63:0/432950654 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:03.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a390a0700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3412ba80 0x7f9a341405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:03.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a33fff700 1 -- 172.21.15.63:0/432950654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3412ba80 msgr2=0x7f9a341405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:03.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a33fff700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3412ba80 0x7f9a341405b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:03.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a33fff700 1 -- 172.21.15.63:0/432950654 >> v1:172.21.15.63:6789/0 conn(0x7f9a3405bda0 legacy=0x7f9a3413fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:03.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a31ffb700 1 -- 172.21.15.63:0/432950654 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013664560 0 0) 0x7f9a3406a820 con 0x7f9a3405bda0 2020-05-18T21:31:03.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a33fff700 1 -- 172.21.15.63:0/432950654 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a34129130 con 0x7f9a340652b0 2020-05-18T21:31:03.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a390a0700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3412ba80 0x7f9a341405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:31:03.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a33fff700 1 --2- 172.21.15.63:0/432950654 >> v2:172.21.15.63:3300/0 conn(0x7f9a340652b0 0x7f9a3406a3c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a28002f70 tx=0x7f9a28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a33fff700 1 --2- 172.21.15.63:0/432950654 >> v2:172.21.15.63:3300/0 conn(0x7f9a340652b0 0x7f9a3406a3c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a28002f70 tx=0x7f9a28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a33fff700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a340652b0 0x7f9a3406a3c0 secure :-1 s=READY pgs=959 cs=0 l=1 rx=0x7f9a28002f70 tx=0x7f9a28007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:03.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a33fff700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a340652b0 0x7f9a3406a3c0 secure :-1 s=THROTTLE_DONE pgs=959 cs=0 l=1 rx=0x7f9a28002f70 tx=0x7f9a28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a31ffb700 1 -- 172.21.15.63:0/432950654 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a28007170 con 0x7f9a340652b0 2020-05-18T21:31:03.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a33fff700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a340652b0 0x7f9a3406a3c0 secure :-1 s=THROTTLE_DONE pgs=959 cs=0 l=1 rx=0x7f9a28002f70 tx=0x7f9a28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a31ffb700 1 -- 172.21.15.63:0/432950654 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a280072d0 con 0x7f9a340652b0 2020-05-18T21:31:03.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a33fff700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a340652b0 0x7f9a3406a3c0 secure :-1 s=THROTTLE_DONE pgs=959 cs=0 l=1 rx=0x7f9a28002f70 tx=0x7f9a28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a3ab03700 1 -- 172.21.15.63:0/432950654 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a340ac5b0 con 0x7f9a340652b0 2020-05-18T21:31:03.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a31ffb700 1 -- 172.21.15.63:0/432950654 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a28005700 con 0x7f9a340652b0 2020-05-18T21:31:03.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.293+0000 7f9a3ab03700 1 -- 172.21.15.63:0/432950654 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a34140c30 con 0x7f9a340652b0 2020-05-18T21:31:03.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.297+0000 7f9a33fff700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a340652b0 0x7f9a3406a3c0 secure :-1 s=THROTTLE_DONE pgs=959 cs=0 l=1 rx=0x7f9a28002f70 tx=0x7f9a28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.297+0000 7f9a3ab03700 1 -- 172.21.15.63:0/432950654 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a34141d60 con 0x7f9a340652b0 2020-05-18T21:31:03.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.297+0000 7f9a31ffb700 1 -- 172.21.15.63:0/432950654 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9a28005900 con 0x7f9a340652b0 2020-05-18T21:31:03.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.297+0000 7f9a33fff700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a340652b0 0x7f9a3406a3c0 secure :-1 s=THROTTLE_DONE pgs=959 cs=0 l=1 rx=0x7f9a28002f70 tx=0x7f9a28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.297+0000 7f9a31ffb700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a1404f890 0x7f9a14051d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:03.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.297+0000 7f9a31ffb700 1 -- 172.21.15.63:0/432950654 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9a28066440 con 0x7f9a340652b0 2020-05-18T21:31:03.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.297+0000 7f9a3889f700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a1404f890 0x7f9a14051d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:03.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.297+0000 7f9a3889f700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a1404f890 0x7f9a14051d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a24001210 tx=0x7f9a24001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.297+0000 7f9a3889f700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a1404f890 0x7f9a14051d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a24001210 tx=0x7f9a24001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.297+0000 7f9a3889f700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a1404f890 0x7f9a14051d50 secure :-1 s=READY pgs=383 cs=0 l=1 rx=0x7f9a24001210 tx=0x7f9a24001720).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:03.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.305+0000 7f9a33fff700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a340652b0 0x7f9a3406a3c0 secure :-1 s=THROTTLE_DONE pgs=959 cs=0 l=1 rx=0x7f9a28002f70 tx=0x7f9a28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.305+0000 7f9a31ffb700 1 -- 172.21.15.63:0/432950654 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9a34141d60 con 0x7f9a340652b0 2020-05-18T21:31:03.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.457+0000 7f9a3ab03700 1 -- 172.21.15.63:0/432950654 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a34141d60 con 0x7f9a340652b0 2020-05-18T21:31:03.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.457+0000 7f9a33fff700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a340652b0 0x7f9a3406a3c0 secure :-1 s=THROTTLE_DONE pgs=959 cs=0 l=1 rx=0x7f9a28002f70 tx=0x7f9a28007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:03.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.457+0000 7f9a31ffb700 1 -- 172.21.15.63:0/432950654 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7f9a34141d60 con 0x7f9a340652b0 2020-05-18T21:31:03.464 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:03.464 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:31:03.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.461+0000 7f9a3ab03700 1 -- 172.21.15.63:0/432950654 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a1404f890 msgr2=0x7f9a14051d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:03.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.461+0000 7f9a3ab03700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a1404f890 0x7f9a14051d50 secure :-1 s=READY pgs=383 cs=0 l=1 rx=0x7f9a24001210 tx=0x7f9a24001720).stop 2020-05-18T21:31:03.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.461+0000 7f9a3ab03700 1 -- 172.21.15.63:0/432950654 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a340652b0 msgr2=0x7f9a3406a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:03.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.461+0000 7f9a3ab03700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a340652b0 0x7f9a3406a3c0 secure :-1 s=READY pgs=959 cs=0 l=1 rx=0x7f9a28002f70 tx=0x7f9a28007a80).stop 2020-05-18T21:31:03.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.461+0000 7f9a3ab03700 1 -- 172.21.15.63:0/432950654 shutdown_connections 2020-05-18T21:31:03.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.461+0000 7f9a3ab03700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a1404f890 0x7f9a14051d50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:03.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.461+0000 7f9a3ab03700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a3412ba80 0x7f9a341405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:03.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.461+0000 7f9a3ab03700 1 --2- 172.21.15.63:0/432950654 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a340652b0 0x7f9a3406a3c0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:03.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.461+0000 7f9a3ab03700 1 -- 172.21.15.63:0/432950654 >> 172.21.15.63:0/432950654 conn(0x7f9a34066ed0 msgr2=0x7f9a340b9480 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:03.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.461+0000 7f9a3ab03700 1 -- 172.21.15.63:0/432950654 shutdown_connections 2020-05-18T21:31:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:03.461+0000 7f9a3ab03700 1 -- 172.21.15.63:0/432950654 wait complete. 2020-05-18T21:31:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:31:03.477 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache num_strays 2020-05-18T21:31:03.577 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:03.577 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:31:03.578 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays": 1 2020-05-18T21:31:03.578 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:03.578 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:03.585 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "num_strays": 1 } } 2020-05-18T21:31:03.586 DEBUG:tasks.ceph_test_case:wait_until_equal: 1 != 0, waiting (timeout=60)... 2020-05-18T21:31:08.587 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:08.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.697+0000 7f3a083d7700 1 Processor -- start 2020-05-18T21:31:08.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.697+0000 7f3a083d7700 1 -- start start 2020-05-18T21:31:08.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a083d7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3a000b8640 0x7f3a00065a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:08.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a083d7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3a000acdc0 0x7f3a00149a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:08.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a083d7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a00149ed0 0x7f3a0014dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:08.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a083d7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a000af1b0 con 0x7f3a000acdc0 2020-05-18T21:31:08.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a083d7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a000ae7d0 con 0x7f3a000b8640 2020-05-18T21:31:08.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a083d7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a000aea70 con 0x7f3a00149ed0 2020-05-18T21:31:08.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a05972700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3a000acdc0 0x7f3a00149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:08.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a05972700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3a000acdc0 0x7f3a00149a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57786/0 (socket says 172.21.15.63:57786) 2020-05-18T21:31:08.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a05972700 1 -- 172.21.15.63:0/483647483 learned_addr learned my addr 172.21.15.63:0/483647483 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:08.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a06173700 1 --2- 172.21.15.63:0/483647483 >> v2:172.21.15.155:3300/0 conn(0x7f3a000b8640 0x7f3a00065a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:08.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a06974700 1 --2- 172.21.15.63:0/483647483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a00149ed0 0x7f3a0014dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:08.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a05972700 1 -- 172.21.15.63:0/483647483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a00149ed0 msgr2=0x7f3a0014dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:08.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a05972700 1 --2- 172.21.15.63:0/483647483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a00149ed0 0x7f3a0014dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:08.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a05972700 1 -- 172.21.15.63:0/483647483 >> v2:172.21.15.155:3300/0 conn(0x7f3a000b8640 msgr2=0x7f3a00065a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:08.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a05972700 1 --2- 172.21.15.63:0/483647483 >> v2:172.21.15.155:3300/0 conn(0x7f3a000b8640 0x7f3a00065a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:08.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a05972700 1 -- 172.21.15.63:0/483647483 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a000aed10 con 0x7f3a000acdc0 2020-05-18T21:31:08.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a05972700 1 --2- 172.21.15.63:0/483647483 >> v2:172.21.15.63:3300/0 conn(0x7f3a000acdc0 0x7f3a00149a70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f39f4002f70 tx=0x7f39f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:08.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a05972700 1 --2- 172.21.15.63:0/483647483 >> v2:172.21.15.63:3300/0 conn(0x7f3a000acdc0 0x7f3a00149a70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f39f4002f70 tx=0x7f39f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:08.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a05972700 1 --2- 172.21.15.63:0/483647483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a000acdc0 0x7f3a00149a70 secure :-1 s=READY pgs=960 cs=0 l=1 rx=0x7f39f4002f70 tx=0x7f39f4007a80).ready entity=mon.0 client_cookie=d8b4248952c85b05 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:08.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a05972700 1 --2- 172.21.15.63:0/483647483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a000acdc0 0x7f3a00149a70 secure :-1 s=THROTTLE_DONE pgs=960 cs=0 l=1 rx=0x7f39f4002f70 tx=0x7f39f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:08.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a05171700 1 -- 172.21.15.63:0/483647483 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f4011600 con 0x7f3a000acdc0 2020-05-18T21:31:08.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a05972700 1 --2- 172.21.15.63:0/483647483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a000acdc0 0x7f3a00149a70 secure :-1 s=THROTTLE_DONE pgs=960 cs=0 l=1 rx=0x7f39f4002f70 tx=0x7f39f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:08.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a05171700 1 -- 172.21.15.63:0/483647483 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f4011760 con 0x7f3a000acdc0 2020-05-18T21:31:08.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a05972700 1 --2- 172.21.15.63:0/483647483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a000acdc0 0x7f3a00149a70 secure :-1 s=THROTTLE_DONE pgs=960 cs=0 l=1 rx=0x7f39f4002f70 tx=0x7f39f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:08.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a083d7700 1 -- 172.21.15.63:0/483647483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a000acdc0 msgr2=0x7f3a00149a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:08.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a083d7700 1 --2- 172.21.15.63:0/483647483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a000acdc0 0x7f3a00149a70 secure :-1 s=READY pgs=960 cs=0 l=1 rx=0x7f39f4002f70 tx=0x7f39f4007a80).stop 2020-05-18T21:31:08.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a05171700 1 -- 172.21.15.63:0/483647483 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f4011b80 con 0x7f3a000acdc0 2020-05-18T21:31:08.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a083d7700 1 -- 172.21.15.63:0/483647483 shutdown_connections 2020-05-18T21:31:08.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a083d7700 1 --2- 172.21.15.63:0/483647483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a00149ed0 0x7f3a0014dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:08.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a083d7700 1 --2- 172.21.15.63:0/483647483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a000acdc0 0x7f3a00149a70 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:08.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a083d7700 1 --2- 172.21.15.63:0/483647483 >> v2:172.21.15.155:3300/0 conn(0x7f3a000b8640 0x7f3a00065a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:08.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a083d7700 1 -- 172.21.15.63:0/483647483 >> 172.21.15.63:0/483647483 conn(0x7f3a0005edd0 msgr2=0x7f3a0005f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:08.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a083d7700 1 -- 172.21.15.63:0/483647483 shutdown_connections 2020-05-18T21:31:08.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.701+0000 7f3a083d7700 1 -- 172.21.15.63:0/483647483 wait complete. 2020-05-18T21:31:08.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a083d7700 1 Processor -- start 2020-05-18T21:31:08.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a083d7700 1 -- start start 2020-05-18T21:31:08.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a083d7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3a000b8640 0x7f3a000b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:08.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a083d7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0015bd00 con 0x7f3a000acdc0 2020-05-18T21:31:08.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a083d7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0015b7f0 con 0x7f3a00149ed0 2020-05-18T21:31:08.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a083d7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0015ba60 con 0x7f3a000b8640 2020-05-18T21:31:08.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a06173700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3a000acdc0 0x7f3a0014cdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59978/0 (socket says 172.21.15.63:59978) 2020-05-18T21:31:08.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a06173700 1 -- 172.21.15.63:0/903197181 learned_addr learned my addr 172.21.15.63:0/903197181 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:08.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a05972700 1 --2- 172.21.15.63:0/903197181 >> v2:172.21.15.155:3300/0 conn(0x7f3a000b8640 0x7f3a000b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:08.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f39ff7fe700 1 -- 172.21.15.63:0/903197181 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837841720 0 0) 0x7f3a0015bd00 con 0x7f3a000acdc0 2020-05-18T21:31:08.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f39ff7fe700 1 -- 172.21.15.63:0/903197181 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39e0002fe0 con 0x7f3a000acdc0 2020-05-18T21:31:08.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a05972700 1 -- 172.21.15.63:0/903197181 >> v1:172.21.15.155:6789/0 conn(0x7f3a00149ed0 legacy=0x7f3a00156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:08.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a05972700 1 -- 172.21.15.63:0/903197181 >> v1:172.21.15.63:6789/0 conn(0x7f3a000acdc0 legacy=0x7f3a0014cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:08.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a05972700 1 -- 172.21.15.63:0/903197181 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a001579d0 con 0x7f3a000b8640 2020-05-18T21:31:08.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a05972700 1 --2- 172.21.15.63:0/903197181 >> v2:172.21.15.155:3300/0 conn(0x7f3a000b8640 0x7f3a000b0940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f39f4002f70 tx=0x7f39f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:08.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a05972700 1 --2- 172.21.15.63:0/903197181 >> v2:172.21.15.155:3300/0 conn(0x7f3a000b8640 0x7f3a000b0940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f39f4002f70 tx=0x7f39f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:08.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a05972700 1 --2- 172.21.15.63:0/903197181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a000b8640 0x7f3a000b0940 secure :-1 s=READY pgs=673 cs=0 l=1 rx=0x7f39f4002f70 tx=0x7f39f4007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:08.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a05972700 1 --2- 172.21.15.63:0/903197181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a000b8640 0x7f3a000b0940 secure :-1 s=THROTTLE_DONE pgs=673 cs=0 l=1 rx=0x7f39f4002f70 tx=0x7f39f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:08.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f39ff7fe700 1 -- 172.21.15.63:0/903197181 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f4011c00 con 0x7f3a000b8640 2020-05-18T21:31:08.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a083d7700 1 -- 172.21.15.63:0/903197181 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a0014d500 con 0x7f3a000b8640 2020-05-18T21:31:08.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a05972700 1 --2- 172.21.15.63:0/903197181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a000b8640 0x7f3a000b0940 secure :-1 s=THROTTLE_DONE pgs=673 cs=0 l=1 rx=0x7f39f4002f70 tx=0x7f39f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:08.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a05972700 1 --2- 172.21.15.63:0/903197181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a000b8640 0x7f3a000b0940 secure :-1 s=THROTTLE_DONE pgs=673 cs=0 l=1 rx=0x7f39f4002f70 tx=0x7f39f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:08.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f39ff7fe700 1 -- 172.21.15.63:0/903197181 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f4007360 con 0x7f3a000b8640 2020-05-18T21:31:08.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f39ff7fe700 1 -- 172.21.15.63:0/903197181 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f4005700 con 0x7f3a000b8640 2020-05-18T21:31:08.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.705+0000 7f3a083d7700 1 -- 172.21.15.63:0/903197181 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a00157760 con 0x7f3a000b8640 2020-05-18T21:31:08.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.709+0000 7f3a05972700 1 --2- 172.21.15.63:0/903197181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a000b8640 0x7f3a000b0940 secure :-1 s=THROTTLE_DONE pgs=673 cs=0 l=1 rx=0x7f39f4002f70 tx=0x7f39f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:08.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.709+0000 7f3a083d7700 1 -- 172.21.15.63:0/903197181 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a00157b60 con 0x7f3a000b8640 2020-05-18T21:31:08.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.709+0000 7f39ff7fe700 1 -- 172.21.15.63:0/903197181 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f39f4005900 con 0x7f3a000b8640 2020-05-18T21:31:08.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.709+0000 7f3a05972700 1 --2- 172.21.15.63:0/903197181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a000b8640 0x7f3a000b0940 secure :-1 s=THROTTLE_DONE pgs=673 cs=0 l=1 rx=0x7f39f4002f70 tx=0x7f39f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:08.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.709+0000 7f39ff7fe700 1 --2- 172.21.15.63:0/903197181 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f39e004fca0 0x7f39e0052160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:08.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.709+0000 7f39ff7fe700 1 -- 172.21.15.63:0/903197181 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f39f4064460 con 0x7f3a000b8640 2020-05-18T21:31:08.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.709+0000 7f3a06173700 1 --2- 172.21.15.63:0/903197181 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f39e004fca0 0x7f39e0052160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:08.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.709+0000 7f3a06173700 1 --2- 172.21.15.63:0/903197181 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f39e004fca0 0x7f39e0052160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f39f80032f0 tx=0x7f39f8009470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:08.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.709+0000 7f3a06173700 1 --2- 172.21.15.63:0/903197181 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f39e004fca0 0x7f39e0052160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f39f80032f0 tx=0x7f39f8009470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:08.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.709+0000 7f3a06173700 1 --2- 172.21.15.63:0/903197181 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f39e004fca0 0x7f39e0052160 secure :-1 s=READY pgs=384 cs=0 l=1 rx=0x7f39f80032f0 tx=0x7f39f8009470).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:08.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.717+0000 7f3a05972700 1 --2- 172.21.15.63:0/903197181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a000b8640 0x7f3a000b0940 secure :-1 s=THROTTLE_DONE pgs=673 cs=0 l=1 rx=0x7f39f4002f70 tx=0x7f39f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:08.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.717+0000 7f39ff7fe700 1 -- 172.21.15.63:0/903197181 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f39f403e8b0 con 0x7f3a000b8640 2020-05-18T21:31:08.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.869+0000 7f3a083d7700 1 -- 172.21.15.63:0/903197181 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a000569e0 con 0x7f3a000b8640 2020-05-18T21:31:08.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.869+0000 7f3a05972700 1 --2- 172.21.15.63:0/903197181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a000b8640 0x7f3a000b0940 secure :-1 s=THROTTLE_DONE pgs=673 cs=0 l=1 rx=0x7f39f4002f70 tx=0x7f39f4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:08.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.869+0000 7f39ff7fe700 1 -- 172.21.15.63:0/903197181 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7f39f4041ed0 con 0x7f3a000b8640 2020-05-18T21:31:08.875 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:08.876 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:31:08.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.873+0000 7f3a083d7700 1 -- 172.21.15.63:0/903197181 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f39e004fca0 msgr2=0x7f39e0052160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:08.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.873+0000 7f3a083d7700 1 --2- 172.21.15.63:0/903197181 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f39e004fca0 0x7f39e0052160 secure :-1 s=READY pgs=384 cs=0 l=1 rx=0x7f39f80032f0 tx=0x7f39f8009470).stop 2020-05-18T21:31:08.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.873+0000 7f3a083d7700 1 -- 172.21.15.63:0/903197181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a000b8640 msgr2=0x7f3a000b0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:08.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.873+0000 7f3a083d7700 1 --2- 172.21.15.63:0/903197181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a000b8640 0x7f3a000b0940 secure :-1 s=READY pgs=673 cs=0 l=1 rx=0x7f39f4002f70 tx=0x7f39f4007a80).stop 2020-05-18T21:31:08.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.873+0000 7f3a083d7700 1 -- 172.21.15.63:0/903197181 shutdown_connections 2020-05-18T21:31:08.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.873+0000 7f3a083d7700 1 --2- 172.21.15.63:0/903197181 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f39e004fca0 0x7f39e0052160 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:08.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.873+0000 7f3a083d7700 1 --2- 172.21.15.63:0/903197181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a000b8640 0x7f3a000b0940 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:08.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.873+0000 7f3a083d7700 1 -- 172.21.15.63:0/903197181 >> 172.21.15.63:0/903197181 conn(0x7f3a0005edd0 msgr2=0x7f3a000b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:08.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.873+0000 7f3a083d7700 1 -- 172.21.15.63:0/903197181 shutdown_connections 2020-05-18T21:31:08.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:08.873+0000 7f3a083d7700 1 -- 172.21.15.63:0/903197181 wait complete. 2020-05-18T21:31:08.879 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:31:08.888 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache num_strays 2020-05-18T21:31:08.985 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:31:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays": 0 2020-05-18T21:31:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:08.986 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:08.993 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "num_strays": 0 } } 2020-05-18T21:31:08.994 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:09.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6b0c76700 1 Processor -- start 2020-05-18T21:31:09.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6b0c76700 1 -- start start 2020-05-18T21:31:09.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6b0c76700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6ac063ce0 0x7fd6ac147140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:09.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6b0c76700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6ac0ad180 0x7fd6ac0ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:09.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6b0c76700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ac1476c0 con 0x7fd6ac1435d0 2020-05-18T21:31:09.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6b0c76700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ac147960 con 0x7fd6ac0ad180 2020-05-18T21:31:09.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6b0c76700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac147c00 con 0x7fd6ac063ce0 2020-05-18T21:31:09.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6abfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6ac0ad180 0x7fd6ac0ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:09.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6abfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6ac0ad180 0x7fd6ac0ad5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57802/0 (socket says 172.21.15.63:57802) 2020-05-18T21:31:09.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6abfff700 1 -- 172.21.15.63:0/298549941 learned_addr learned my addr 172.21.15.63:0/298549941 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:09.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6aaffd700 1 --2- 172.21.15.63:0/298549941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6ac063ce0 0x7fd6ac147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:09.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6abfff700 1 -- 172.21.15.63:0/298549941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6ac063ce0 msgr2=0x7fd6ac147140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:09.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6abfff700 1 --2- 172.21.15.63:0/298549941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6ac063ce0 0x7fd6ac147140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:09.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6abfff700 1 -- 172.21.15.63:0/298549941 >> v1:172.21.15.63:6789/0 conn(0x7fd6ac1435d0 legacy=0x7fd6ac05edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6abfff700 1 -- 172.21.15.63:0/298549941 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac05f4e0 con 0x7fd6ac0ad180 2020-05-18T21:31:09.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6abfff700 1 --2- 172.21.15.63:0/298549941 >> v2:172.21.15.63:3300/0 conn(0x7fd6ac0ad180 0x7fd6ac0ad5f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd6a40032f0 tx=0x7fd6a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6abfff700 1 --2- 172.21.15.63:0/298549941 >> v2:172.21.15.63:3300/0 conn(0x7fd6ac0ad180 0x7fd6ac0ad5f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd6a40032f0 tx=0x7fd6a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6abfff700 1 --2- 172.21.15.63:0/298549941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ac0ad180 0x7fd6ac0ad5f0 secure :-1 s=READY pgs=963 cs=0 l=1 rx=0x7fd6a40032f0 tx=0x7fd6a4007e00).ready entity=mon.0 client_cookie=f6c149033c3fb4c2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:09.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6abfff700 1 --2- 172.21.15.63:0/298549941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ac0ad180 0x7fd6ac0ad5f0 secure :-1 s=THROTTLE_DONE pgs=963 cs=0 l=1 rx=0x7fd6a40032f0 tx=0x7fd6a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6abfff700 1 --2- 172.21.15.63:0/298549941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ac0ad180 0x7fd6ac0ad5f0 secure :-1 s=THROTTLE_DONE pgs=963 cs=0 l=1 rx=0x7fd6a40032f0 tx=0x7fd6a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6abfff700 1 --2- 172.21.15.63:0/298549941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ac0ad180 0x7fd6ac0ad5f0 secure :-1 s=THROTTLE_DONE pgs=963 cs=0 l=1 rx=0x7fd6a40032f0 tx=0x7fd6a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6aa7fc700 1 -- 172.21.15.63:0/298549941 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a4011dc0 con 0x7fd6ac0ad180 2020-05-18T21:31:09.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6aa7fc700 1 -- 172.21.15.63:0/298549941 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a400a180 con 0x7fd6ac0ad180 2020-05-18T21:31:09.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6b0c76700 1 -- 172.21.15.63:0/298549941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ac0ad180 msgr2=0x7fd6ac0ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6b0c76700 1 --2- 172.21.15.63:0/298549941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ac0ad180 0x7fd6ac0ad5f0 secure :-1 s=READY pgs=963 cs=0 l=1 rx=0x7fd6a40032f0 tx=0x7fd6a4007e00).stop 2020-05-18T21:31:09.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.089+0000 7fd6aa7fc700 1 -- 172.21.15.63:0/298549941 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a400a5a0 con 0x7fd6ac0ad180 2020-05-18T21:31:09.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6b0c76700 1 -- 172.21.15.63:0/298549941 shutdown_connections 2020-05-18T21:31:09.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6b0c76700 1 --2- 172.21.15.63:0/298549941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ac0ad180 0x7fd6ac0ad5f0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:09.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6b0c76700 1 --2- 172.21.15.63:0/298549941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6ac063ce0 0x7fd6ac147140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:09.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6b0c76700 1 -- 172.21.15.63:0/298549941 >> 172.21.15.63:0/298549941 conn(0x7fd6ac069fc0 msgr2=0x7fd6ac06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:09.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6b0c76700 1 -- 172.21.15.63:0/298549941 shutdown_connections 2020-05-18T21:31:09.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6b0c76700 1 -- 172.21.15.63:0/298549941 wait complete. 2020-05-18T21:31:09.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6b0c76700 1 Processor -- start 2020-05-18T21:31:09.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6b0c76700 1 -- start start 2020-05-18T21:31:09.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6b0c76700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6ac063ce0 0x7fd6ac062540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:09.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6b0c76700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6ac0ad180 0x7fd6ac13e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:09.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6b0c76700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd6ac1435d0 0x7fd6ac157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:09.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6b0c76700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ac0618c0 con 0x7fd6ac0ad180 2020-05-18T21:31:09.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6b0c76700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ac061b60 con 0x7fd6ac1435d0 2020-05-18T21:31:09.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6b0c76700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac061e00 con 0x7fd6ac063ce0 2020-05-18T21:31:09.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6aaffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6ac0ad180 0x7fd6ac13e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:09.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6ab7fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6ac063ce0 0x7fd6ac062540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:09.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6aaffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6ac0ad180 0x7fd6ac13e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57808/0 (socket says 172.21.15.63:57808) 2020-05-18T21:31:09.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6aaffd700 1 -- 172.21.15.63:0/3827113619 learned_addr learned my addr 172.21.15.63:0/3827113619 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:09.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6abfff700 1 --2- 172.21.15.63:0/3827113619 >> v2:172.21.15.155:3300/0 conn(0x7fd6ac1435d0 0x7fd6ac157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:09.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6aaffd700 1 -- 172.21.15.63:0/3827113619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6ac063ce0 msgr2=0x7fd6ac062540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6aaffd700 1 --2- 172.21.15.63:0/3827113619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6ac063ce0 0x7fd6ac062540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:09.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6aaffd700 1 -- 172.21.15.63:0/3827113619 >> v2:172.21.15.155:3300/0 conn(0x7fd6ac1435d0 msgr2=0x7fd6ac157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6aaffd700 1 --2- 172.21.15.63:0/3827113619 >> v2:172.21.15.155:3300/0 conn(0x7fd6ac1435d0 0x7fd6ac157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:09.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6aaffd700 1 -- 172.21.15.63:0/3827113619 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac0620a0 con 0x7fd6ac0ad180 2020-05-18T21:31:09.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6aaffd700 1 --2- 172.21.15.63:0/3827113619 >> v2:172.21.15.63:3300/0 conn(0x7fd6ac0ad180 0x7fd6ac13e080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6940030b0 tx=0x7fd694010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6aaffd700 1 --2- 172.21.15.63:0/3827113619 >> v2:172.21.15.63:3300/0 conn(0x7fd6ac0ad180 0x7fd6ac13e080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6940030b0 tx=0x7fd694010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.093+0000 7fd6aaffd700 1 --2- 172.21.15.63:0/3827113619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ac0ad180 0x7fd6ac13e080 secure :-1 s=READY pgs=964 cs=0 l=1 rx=0x7fd6940030b0 tx=0x7fd694010cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:09.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.097+0000 7fd6aaffd700 1 --2- 172.21.15.63:0/3827113619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ac0ad180 0x7fd6ac13e080 secure :-1 s=THROTTLE_DONE pgs=964 cs=0 l=1 rx=0x7fd6940030b0 tx=0x7fd694010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.097+0000 7fd6aaffd700 1 --2- 172.21.15.63:0/3827113619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ac0ad180 0x7fd6ac13e080 secure :-1 s=THROTTLE_DONE pgs=964 cs=0 l=1 rx=0x7fd6940030b0 tx=0x7fd694010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.097+0000 7fd6a8ff9700 1 -- 172.21.15.63:0/3827113619 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd694012820 con 0x7fd6ac0ad180 2020-05-18T21:31:09.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.097+0000 7fd6aaffd700 1 --2- 172.21.15.63:0/3827113619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ac0ad180 0x7fd6ac13e080 secure :-1 s=THROTTLE_DONE pgs=964 cs=0 l=1 rx=0x7fd6940030b0 tx=0x7fd694010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.097+0000 7fd6a8ff9700 1 -- 172.21.15.63:0/3827113619 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd694012980 con 0x7fd6ac0ad180 2020-05-18T21:31:09.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.097+0000 7fd6b0c76700 1 -- 172.21.15.63:0/3827113619 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ac157670 con 0x7fd6ac0ad180 2020-05-18T21:31:09.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.097+0000 7fd6a8ff9700 1 -- 172.21.15.63:0/3827113619 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd694012d60 con 0x7fd6ac0ad180 2020-05-18T21:31:09.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.097+0000 7fd6b0c76700 1 -- 172.21.15.63:0/3827113619 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ac13c040 con 0x7fd6ac0ad180 2020-05-18T21:31:09.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.097+0000 7fd6b0c76700 1 -- 172.21.15.63:0/3827113619 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ac0569e0 con 0x7fd6ac0ad180 2020-05-18T21:31:09.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.097+0000 7fd6aaffd700 1 --2- 172.21.15.63:0/3827113619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ac0ad180 0x7fd6ac13e080 secure :-1 s=THROTTLE_DONE pgs=964 cs=0 l=1 rx=0x7fd6940030b0 tx=0x7fd694010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.097+0000 7fd6aaffd700 1 --2- 172.21.15.63:0/3827113619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ac0ad180 0x7fd6ac13e080 secure :-1 s=THROTTLE_DONE pgs=964 cs=0 l=1 rx=0x7fd6940030b0 tx=0x7fd694010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.097+0000 7fd6a8ff9700 1 -- 172.21.15.63:0/3827113619 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd694007190 con 0x7fd6ac0ad180 2020-05-18T21:31:09.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.097+0000 7fd6a8ff9700 1 --2- 172.21.15.63:0/3827113619 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd69004fac0 0x7fd690051f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:09.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.097+0000 7fd6a8ff9700 1 -- 172.21.15.63:0/3827113619 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd694063c80 con 0x7fd6ac0ad180 2020-05-18T21:31:09.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.097+0000 7fd6ab7fe700 1 --2- 172.21.15.63:0/3827113619 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd69004fac0 0x7fd690051f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:09.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.097+0000 7fd6ab7fe700 1 --2- 172.21.15.63:0/3827113619 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd69004fac0 0x7fd690051f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6ac147f80 tx=0x7fd69c003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.097+0000 7fd6ab7fe700 1 --2- 172.21.15.63:0/3827113619 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd69004fac0 0x7fd690051f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6ac147f80 tx=0x7fd69c003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.097+0000 7fd6ab7fe700 1 --2- 172.21.15.63:0/3827113619 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd69004fac0 0x7fd690051f80 secure :-1 s=READY pgs=385 cs=0 l=1 rx=0x7fd6ac147f80 tx=0x7fd69c003e60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:09.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.101+0000 7fd6aaffd700 1 --2- 172.21.15.63:0/3827113619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ac0ad180 0x7fd6ac13e080 secure :-1 s=THROTTLE_DONE pgs=964 cs=0 l=1 rx=0x7fd6940030b0 tx=0x7fd694010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.101+0000 7fd6a8ff9700 1 -- 172.21.15.63:0/3827113619 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd69403df70 con 0x7fd6ac0ad180 2020-05-18T21:31:09.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.249+0000 7fd6b0c76700 1 -- 172.21.15.63:0/3827113619 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6ac0604a0 con 0x7fd6ac0ad180 2020-05-18T21:31:09.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.249+0000 7fd6aaffd700 1 --2- 172.21.15.63:0/3827113619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ac0ad180 0x7fd6ac13e080 secure :-1 s=THROTTLE_DONE pgs=964 cs=0 l=1 rx=0x7fd6940030b0 tx=0x7fd694010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.249+0000 7fd6a8ff9700 1 -- 172.21.15.63:0/3827113619 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7fd694041590 con 0x7fd6ac0ad180 2020-05-18T21:31:09.255 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:09.255 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:31:09.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.253+0000 7fd6b0c76700 1 -- 172.21.15.63:0/3827113619 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd69004fac0 msgr2=0x7fd690051f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.253+0000 7fd6b0c76700 1 --2- 172.21.15.63:0/3827113619 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd69004fac0 0x7fd690051f80 secure :-1 s=READY pgs=385 cs=0 l=1 rx=0x7fd6ac147f80 tx=0x7fd69c003e60).stop 2020-05-18T21:31:09.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.253+0000 7fd6b0c76700 1 -- 172.21.15.63:0/3827113619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ac0ad180 msgr2=0x7fd6ac13e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.253+0000 7fd6b0c76700 1 --2- 172.21.15.63:0/3827113619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ac0ad180 0x7fd6ac13e080 secure :-1 s=READY pgs=964 cs=0 l=1 rx=0x7fd6940030b0 tx=0x7fd694010cd0).stop 2020-05-18T21:31:09.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.253+0000 7fd6b0c76700 1 -- 172.21.15.63:0/3827113619 shutdown_connections 2020-05-18T21:31:09.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.253+0000 7fd6b0c76700 1 --2- 172.21.15.63:0/3827113619 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd69004fac0 0x7fd690051f80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:09.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.253+0000 7fd6b0c76700 1 --2- 172.21.15.63:0/3827113619 >> v2:172.21.15.155:3300/0 conn(0x7fd6ac1435d0 0x7fd6ac157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:09.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.253+0000 7fd6b0c76700 1 --2- 172.21.15.63:0/3827113619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ac0ad180 0x7fd6ac13e080 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:09.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.253+0000 7fd6b0c76700 1 --2- 172.21.15.63:0/3827113619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6ac063ce0 0x7fd6ac062540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.253+0000 7fd6b0c76700 1 -- 172.21.15.63:0/3827113619 >> 172.21.15.63:0/3827113619 conn(0x7fd6ac069fc0 msgr2=0x7fd6ac065130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.253+0000 7fd6b0c76700 1 -- 172.21.15.63:0/3827113619 shutdown_connections 2020-05-18T21:31:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.253+0000 7fd6b0c76700 1 -- 172.21.15.63:0/3827113619 wait complete. 2020-05-18T21:31:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:31:09.267 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_reintegrated 2020-05-18T21:31:09.361 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:31:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_reintegrated": 3 2020-05-18T21:31:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:09.362 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:09.369 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_reintegrated": 3 } } 2020-05-18T21:31:09.370 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:09.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0ebb31c700 1 Processor -- start 2020-05-18T21:31:09.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0ebb31c700 1 -- start start 2020-05-18T21:31:09.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0ebb31c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0eb40615e0 0x7f0eb414e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:09.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0ebb31c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb414d960 con 0x7f0eb4060b90 2020-05-18T21:31:09.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0ebb31c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb414db90 con 0x7f0eb40b2860 2020-05-18T21:31:09.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0ebb31c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb4066210 con 0x7f0eb40615e0 2020-05-18T21:31:09.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0eb98b9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0eb40615e0 0x7f0eb414e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:09.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0eb98b9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0eb40615e0 0x7f0eb414e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57814/0 (socket says 172.21.15.63:57814) 2020-05-18T21:31:09.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0eb90b8700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0eb4060b90 0x7f0eb4144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60000/0 (socket says 172.21.15.63:60000) 2020-05-18T21:31:09.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0eb98b9700 1 -- 172.21.15.63:0/2545335674 learned_addr learned my addr 172.21.15.63:0/2545335674 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:09.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0eb98b9700 1 -- 172.21.15.63:0/2545335674 >> v1:172.21.15.155:6789/0 conn(0x7f0eb40b2860 legacy=0x7f0eb414a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:09.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0eb98b9700 1 -- 172.21.15.63:0/2545335674 >> v1:172.21.15.63:6789/0 conn(0x7f0eb4060b90 legacy=0x7f0eb4144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0eb98b9700 1 -- 172.21.15.63:0/2545335674 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb414de30 con 0x7f0eb40615e0 2020-05-18T21:31:09.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0eb98b9700 1 --2- 172.21.15.63:0/2545335674 >> v2:172.21.15.63:3300/0 conn(0x7f0eb40615e0 0x7f0eb414e570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0eac0032f0 tx=0x7f0eac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0eb98b9700 1 --2- 172.21.15.63:0/2545335674 >> v2:172.21.15.63:3300/0 conn(0x7f0eb40615e0 0x7f0eb414e570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0eac0032f0 tx=0x7f0eac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0eb98b9700 1 --2- 172.21.15.63:0/2545335674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb40615e0 0x7f0eb414e570 secure :-1 s=READY pgs=966 cs=0 l=1 rx=0x7f0eac0032f0 tx=0x7f0eac007e00).ready entity=mon.0 client_cookie=2e9ceb63c5d0ea05 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:09.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0eb98b9700 1 --2- 172.21.15.63:0/2545335674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb40615e0 0x7f0eb414e570 secure :-1 s=THROTTLE_DONE pgs=966 cs=0 l=1 rx=0x7f0eac0032f0 tx=0x7f0eac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0eb98b9700 1 --2- 172.21.15.63:0/2545335674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb40615e0 0x7f0eb414e570 secure :-1 s=THROTTLE_DONE pgs=966 cs=0 l=1 rx=0x7f0eac0032f0 tx=0x7f0eac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0eabfff700 1 -- 172.21.15.63:0/2545335674 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eac011dc0 con 0x7f0eb40615e0 2020-05-18T21:31:09.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0eb98b9700 1 --2- 172.21.15.63:0/2545335674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb40615e0 0x7f0eb414e570 secure :-1 s=THROTTLE_DONE pgs=966 cs=0 l=1 rx=0x7f0eac0032f0 tx=0x7f0eac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0eabfff700 1 -- 172.21.15.63:0/2545335674 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac00a180 con 0x7f0eb40615e0 2020-05-18T21:31:09.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0eabfff700 1 -- 172.21.15.63:0/2545335674 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eac00a5a0 con 0x7f0eb40615e0 2020-05-18T21:31:09.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0ebb31c700 1 -- 172.21.15.63:0/2545335674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb40615e0 msgr2=0x7f0eb414e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0ebb31c700 1 --2- 172.21.15.63:0/2545335674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb40615e0 0x7f0eb414e570 secure :-1 s=READY pgs=966 cs=0 l=1 rx=0x7f0eac0032f0 tx=0x7f0eac007e00).stop 2020-05-18T21:31:09.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0ebb31c700 1 -- 172.21.15.63:0/2545335674 shutdown_connections 2020-05-18T21:31:09.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0ebb31c700 1 --2- 172.21.15.63:0/2545335674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb40615e0 0x7f0eb414e570 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:09.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0ebb31c700 1 -- 172.21.15.63:0/2545335674 >> 172.21.15.63:0/2545335674 conn(0x7f0eb40b83d0 msgr2=0x7f0eb40b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:09.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0ebb31c700 1 -- 172.21.15.63:0/2545335674 shutdown_connections 2020-05-18T21:31:09.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.465+0000 7f0ebb31c700 1 -- 172.21.15.63:0/2545335674 wait complete. 2020-05-18T21:31:09.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.469+0000 7f0ebb31c700 1 Processor -- start 2020-05-18T21:31:09.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.469+0000 7f0ebb31c700 1 -- start start 2020-05-18T21:31:09.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.469+0000 7f0ebb31c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0eb4060b90 0x7f0eb414c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:09.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.469+0000 7f0ebb31c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb40b2860 0x7f0eb40b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:09.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.469+0000 7f0ebb31c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb4147d10 con 0x7f0eb40615e0 2020-05-18T21:31:09.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.469+0000 7f0ebb31c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb414bf50 con 0x7f0eb4060b90 2020-05-18T21:31:09.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.469+0000 7f0ebb31c700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb414c1f0 con 0x7f0eb40b2860 2020-05-18T21:31:09.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.469+0000 7f0eb90b8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0eb4060b90 0x7f0eb414c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:09.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eb90b8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0eb4060b90 0x7f0eb414c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57816/0 (socket says 172.21.15.63:57816) 2020-05-18T21:31:09.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eb90b8700 1 -- 172.21.15.63:0/1579739477 learned_addr learned my addr 172.21.15.63:0/1579739477 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:09.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eb98b9700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb40b2860 0x7f0eb40b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:09.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eb90b8700 1 -- 172.21.15.63:0/1579739477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb40b2860 msgr2=0x7f0eb40b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eb90b8700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb40b2860 0x7f0eb40b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:09.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eb90b8700 1 -- 172.21.15.63:0/1579739477 >> v1:172.21.15.155:6789/0 conn(0x7f0eb40615e0 legacy=0x7f0eb4147400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eaa7fc700 1 -- 172.21.15.63:0/1579739477 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818393854 0 0) 0x7f0eb4147d10 con 0x7f0eb40615e0 2020-05-18T21:31:09.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eb90b8700 1 -- 172.21.15.63:0/1579739477 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb414cd50 con 0x7f0eb4060b90 2020-05-18T21:31:09.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eb98b9700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb40b2860 0x7f0eb40b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:31:09.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eb90b8700 1 --2- 172.21.15.63:0/1579739477 >> v2:172.21.15.63:3300/0 conn(0x7f0eb4060b90 0x7f0eb414c690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0eb4067d20 tx=0x7f0eb00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eb90b8700 1 --2- 172.21.15.63:0/1579739477 >> v2:172.21.15.63:3300/0 conn(0x7f0eb4060b90 0x7f0eb414c690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0eb4067d20 tx=0x7f0eb00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eb90b8700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb4060b90 0x7f0eb414c690 secure :-1 s=READY pgs=967 cs=0 l=1 rx=0x7f0eb4067d20 tx=0x7f0eb00109e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:09.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eb90b8700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb4060b90 0x7f0eb414c690 secure :-1 s=THROTTLE_DONE pgs=967 cs=0 l=1 rx=0x7f0eb4067d20 tx=0x7f0eb00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eaa7fc700 1 -- 172.21.15.63:0/1579739477 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eb0004910 con 0x7f0eb4060b90 2020-05-18T21:31:09.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eb90b8700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb4060b90 0x7f0eb414c690 secure :-1 s=THROTTLE_DONE pgs=967 cs=0 l=1 rx=0x7f0eb4067d20 tx=0x7f0eb00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eb90b8700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb4060b90 0x7f0eb414c690 secure :-1 s=THROTTLE_DONE pgs=967 cs=0 l=1 rx=0x7f0eb4067d20 tx=0x7f0eb00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eaa7fc700 1 -- 172.21.15.63:0/1579739477 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb0004a70 con 0x7f0eb4060b90 2020-05-18T21:31:09.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0ebb31c700 1 -- 172.21.15.63:0/1579739477 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb4143210 con 0x7f0eb4060b90 2020-05-18T21:31:09.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eaa7fc700 1 -- 172.21.15.63:0/1579739477 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eb0004e50 con 0x7f0eb4060b90 2020-05-18T21:31:09.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0ebb31c700 1 -- 172.21.15.63:0/1579739477 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb41436c0 con 0x7f0eb4060b90 2020-05-18T21:31:09.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eb90b8700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb4060b90 0x7f0eb414c690 secure :-1 s=THROTTLE_DONE pgs=967 cs=0 l=1 rx=0x7f0eb4067d20 tx=0x7f0eb00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0ebb31c700 1 -- 172.21.15.63:0/1579739477 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb40569e0 con 0x7f0eb4060b90 2020-05-18T21:31:09.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eaa7fc700 1 -- 172.21.15.63:0/1579739477 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0eb00123b0 con 0x7f0eb4060b90 2020-05-18T21:31:09.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eb90b8700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb4060b90 0x7f0eb414c690 secure :-1 s=THROTTLE_DONE pgs=967 cs=0 l=1 rx=0x7f0eb4067d20 tx=0x7f0eb00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eaa7fc700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9c04f890 0x7f0e9c051d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:09.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eaa7fc700 1 -- 172.21.15.63:0/1579739477 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0eb0063bd0 con 0x7f0eb4060b90 2020-05-18T21:31:09.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.473+0000 7f0eb88b7700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9c04f890 0x7f0e9c051d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:09.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.477+0000 7f0eb88b7700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9c04f890 0x7f0e9c051d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ea4002270 tx=0x7f0ea4002750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.477+0000 7f0eb88b7700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9c04f890 0x7f0e9c051d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ea4002270 tx=0x7f0ea4002750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.477+0000 7f0eb88b7700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9c04f890 0x7f0e9c051d50 secure :-1 s=READY pgs=386 cs=0 l=1 rx=0x7f0ea4002270 tx=0x7f0ea4002750).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:09.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.481+0000 7f0eb90b8700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb4060b90 0x7f0eb414c690 secure :-1 s=THROTTLE_DONE pgs=967 cs=0 l=1 rx=0x7f0eb4067d20 tx=0x7f0eb00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.481+0000 7f0eaa7fc700 1 -- 172.21.15.63:0/1579739477 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f0eb003df60 con 0x7f0eb4060b90 2020-05-18T21:31:09.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.629+0000 7f0ebb31c700 1 -- 172.21.15.63:0/1579739477 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0eb414cee0 con 0x7f0eb4060b90 2020-05-18T21:31:09.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.633+0000 7f0eb90b8700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb4060b90 0x7f0eb414c690 secure :-1 s=THROTTLE_DONE pgs=967 cs=0 l=1 rx=0x7f0eb4067d20 tx=0x7f0eb00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.633+0000 7f0eaa7fc700 1 -- 172.21.15.63:0/1579739477 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7f0eb0041580 con 0x7f0eb4060b90 2020-05-18T21:31:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:09.637 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:31:09.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.633+0000 7f0ebb31c700 1 -- 172.21.15.63:0/1579739477 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9c04f890 msgr2=0x7f0e9c051d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.633+0000 7f0ebb31c700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9c04f890 0x7f0e9c051d50 secure :-1 s=READY pgs=386 cs=0 l=1 rx=0x7f0ea4002270 tx=0x7f0ea4002750).stop 2020-05-18T21:31:09.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.633+0000 7f0ebb31c700 1 -- 172.21.15.63:0/1579739477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb4060b90 msgr2=0x7f0eb414c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.633+0000 7f0ebb31c700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb4060b90 0x7f0eb414c690 secure :-1 s=READY pgs=967 cs=0 l=1 rx=0x7f0eb4067d20 tx=0x7f0eb00109e0).stop 2020-05-18T21:31:09.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.633+0000 7f0ebb31c700 1 -- 172.21.15.63:0/1579739477 shutdown_connections 2020-05-18T21:31:09.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.633+0000 7f0ebb31c700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0e9c04f890 0x7f0e9c051d50 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:09.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.633+0000 7f0ebb31c700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb40b2860 0x7f0eb40b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:09.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.633+0000 7f0ebb31c700 1 --2- 172.21.15.63:0/1579739477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb4060b90 0x7f0eb414c690 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:09.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.633+0000 7f0ebb31c700 1 -- 172.21.15.63:0/1579739477 >> 172.21.15.63:0/1579739477 conn(0x7f0eb40b83d0 msgr2=0x7f0eb414acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:09.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.633+0000 7f0ebb31c700 1 -- 172.21.15.63:0/1579739477 shutdown_connections 2020-05-18T21:31:09.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.633+0000 7f0ebb31c700 1 -- 172.21.15.63:0/1579739477 wait complete. 2020-05-18T21:31:09.641 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:31:09.650 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush journal 2020-05-18T21:31:09.764 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:09.765 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "", 2020-05-18T21:31:09.766 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0 2020-05-18T21:31:09.766 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:09.776 INFO:tasks.cephfs.filesystem:_json_asok output: { "message": "", "return_code": 0 } 2020-05-18T21:31:09.777 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_data getxattr 10000000001.00000000 parent 2020-05-18T21:31:09.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.805+0000 7f0479389b80 1 Processor -- start 2020-05-18T21:31:09.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.805+0000 7f0479389b80 1 -- start start 2020-05-18T21:31:09.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.805+0000 7f0479389b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x55de1f5369c0 0x55de1f533440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:09.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.805+0000 7f0479389b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55de1f3e9460 con 0x55de1f4a8c40 2020-05-18T21:31:09.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.805+0000 7f0479389b80 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55de1f536da0 con 0x55de1f539680 2020-05-18T21:31:09.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.805+0000 7f0479389b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x55de1f415800 con 0x55de1f5369c0 2020-05-18T21:31:09.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.805+0000 7f04777cc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x55de1f4a8c40 0x55de1f532d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60018/0 (socket says 172.21.15.63:60018) 2020-05-18T21:31:09.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.805+0000 7f04777cc700 1 -- 172.21.15.63:0/1434004178 learned_addr learned my addr 172.21.15.63:0/1434004178 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:09.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.805+0000 7f0476fcb700 1 --2- 172.21.15.63:0/1434004178 >> v2:172.21.15.155:3300/0 conn(0x55de1f5369c0 0x55de1f533440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:09.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.805+0000 7f04757c8700 1 -- 172.21.15.63:0/1434004178 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609525791 0 0) 0x55de1f3e9460 con 0x55de1f4a8c40 2020-05-18T21:31:09.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.805+0000 7f04757c8700 1 -- 172.21.15.63:0/1434004178 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0458002020 con 0x55de1f4a8c40 2020-05-18T21:31:09.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.805+0000 7f0476fcb700 1 -- 172.21.15.63:0/1434004178 >> v1:172.21.15.155:6789/0 conn(0x55de1f539680 legacy=0x55de1f53dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.805+0000 7f0476fcb700 1 -- 172.21.15.63:0/1434004178 >> v1:172.21.15.63:6789/0 conn(0x55de1f4a8c40 legacy=0x55de1f532d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.805+0000 7f0476fcb700 1 -- 172.21.15.63:0/1434004178 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de1f537040 con 0x55de1f5369c0 2020-05-18T21:31:09.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.805+0000 7f0476fcb700 1 --2- 172.21.15.63:0/1434004178 >> v2:172.21.15.155:3300/0 conn(0x55de1f5369c0 0x55de1f533440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f04600018f0 tx=0x7f046000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0476fcb700 1 --2- 172.21.15.63:0/1434004178 >> v2:172.21.15.155:3300/0 conn(0x55de1f5369c0 0x55de1f533440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f04600018f0 tx=0x7f046000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0476fcb700 1 --2- 172.21.15.63:0/1434004178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de1f5369c0 0x55de1f533440 secure :-1 s=READY pgs=678 cs=0 l=1 rx=0x7f04600018f0 tx=0x7f046000ab00).ready entity=mon.1 client_cookie=4f4a6e6402026cd6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:09.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0476fcb700 1 --2- 172.21.15.63:0/1434004178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de1f5369c0 0x55de1f533440 secure :-1 s=THROTTLE_DONE pgs=678 cs=0 l=1 rx=0x7f04600018f0 tx=0x7f046000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f04757c8700 1 -- 172.21.15.63:0/1434004178 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f046000b830 con 0x55de1f5369c0 2020-05-18T21:31:09.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0476fcb700 1 --2- 172.21.15.63:0/1434004178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de1f5369c0 0x55de1f533440 secure :-1 s=THROTTLE_DONE pgs=678 cs=0 l=1 rx=0x7f04600018f0 tx=0x7f046000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0476fcb700 1 --2- 172.21.15.63:0/1434004178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de1f5369c0 0x55de1f533440 secure :-1 s=THROTTLE_DONE pgs=678 cs=0 l=1 rx=0x7f04600018f0 tx=0x7f046000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f04757c8700 1 -- 172.21.15.63:0/1434004178 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046000b990 con 0x55de1f5369c0 2020-05-18T21:31:09.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f04757c8700 1 -- 172.21.15.63:0/1434004178 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f046000bcf0 con 0x55de1f5369c0 2020-05-18T21:31:09.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0479389b80 1 -- 172.21.15.63:0/1434004178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de1f5369c0 msgr2=0x55de1f533440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0479389b80 1 --2- 172.21.15.63:0/1434004178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de1f5369c0 0x55de1f533440 secure :-1 s=READY pgs=678 cs=0 l=1 rx=0x7f04600018f0 tx=0x7f046000ab00).stop 2020-05-18T21:31:09.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0479389b80 1 -- 172.21.15.63:0/1434004178 shutdown_connections 2020-05-18T21:31:09.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0479389b80 1 --2- 172.21.15.63:0/1434004178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de1f5369c0 0x55de1f533440 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:09.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0479389b80 1 -- 172.21.15.63:0/1434004178 >> 172.21.15.63:0/1434004178 conn(0x55de1f4ac850 msgr2=0x55de1f48c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:09.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0479389b80 1 -- 172.21.15.63:0/1434004178 shutdown_connections 2020-05-18T21:31:09.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0479389b80 1 -- 172.21.15.63:0/1434004178 wait complete. 2020-05-18T21:31:09.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0479389b80 1 Processor -- start 2020-05-18T21:31:09.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0479389b80 1 -- start start 2020-05-18T21:31:09.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0479389b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x55de1f4a8c40 0x55de1f48d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:09.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0479389b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55de1f5369c0 0x55de1f53c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:09.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0479389b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55de1f539680 0x55de1f4a8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:09.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0479389b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x55de1f3f5110 con 0x55de1f539680 2020-05-18T21:31:09.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0479389b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x55de1f3e5a40 con 0x55de1f4a8c40 2020-05-18T21:31:09.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.809+0000 7f0479389b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de1f532cc0 con 0x55de1f5369c0 2020-05-18T21:31:09.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0477fcd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55de1f539680 0x55de1f4a8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:09.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0477fcd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55de1f539680 0x55de1f4a8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57840/0 (socket says 172.21.15.63:57840) 2020-05-18T21:31:09.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0477fcd700 1 -- 172.21.15.63:0/3511254394 learned_addr learned my addr 172.21.15.63:0/3511254394 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:09.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f04777cc700 1 --2- 172.21.15.63:0/3511254394 >> v2:172.21.15.155:3300/0 conn(0x55de1f4a8c40 0x55de1f48d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:09.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0476fcb700 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55de1f5369c0 0x55de1f53c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:09.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0476fcb700 1 -- 172.21.15.63:0/3511254394 >> v2:172.21.15.155:3300/0 conn(0x55de1f4a8c40 msgr2=0x55de1f48d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0476fcb700 1 --2- 172.21.15.63:0/3511254394 >> v2:172.21.15.155:3300/0 conn(0x55de1f4a8c40 0x55de1f48d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:09.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0476fcb700 1 -- 172.21.15.63:0/3511254394 >> v2:172.21.15.63:3300/0 conn(0x55de1f539680 msgr2=0x55de1f4a8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0476fcb700 1 --2- 172.21.15.63:0/3511254394 >> v2:172.21.15.63:3300/0 conn(0x55de1f539680 0x55de1f4a8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:09.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0476fcb700 1 -- 172.21.15.63:0/3511254394 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de1f532fe0 con 0x55de1f5369c0 2020-05-18T21:31:09.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0476fcb700 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55de1f5369c0 0x55de1f53c0b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x55de1f53cea0 tx=0x7f046000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0476fcb700 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55de1f5369c0 0x55de1f53c0b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x55de1f53cea0 tx=0x7f046000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0476fcb700 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55de1f5369c0 0x55de1f53c0b0 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x55de1f53cea0 tx=0x7f046000ab00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:09.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0476fcb700 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55de1f5369c0 0x55de1f53c0b0 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x55de1f53cea0 tx=0x7f046000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0474fc7700 1 -- 172.21.15.63:0/3511254394 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f046000be80 con 0x55de1f5369c0 2020-05-18T21:31:09.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0476fcb700 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55de1f5369c0 0x55de1f53c0b0 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x55de1f53cea0 tx=0x7f046000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0474fc7700 1 -- 172.21.15.63:0/3511254394 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0460015400 con 0x55de1f5369c0 2020-05-18T21:31:09.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0476fcb700 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55de1f5369c0 0x55de1f53c0b0 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x55de1f53cea0 tx=0x7f046000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0474fc7700 1 -- 172.21.15.63:0/3511254394 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0460015760 con 0x55de1f5369c0 2020-05-18T21:31:09.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0479389b80 1 -- 172.21.15.63:0/3511254394 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55de1f533280 con 0x55de1f5369c0 2020-05-18T21:31:09.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0479389b80 1 -- 172.21.15.63:0/3511254394 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de1f4a86e0 con 0x55de1f5369c0 2020-05-18T21:31:09.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0476fcb700 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55de1f5369c0 0x55de1f53c0b0 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x55de1f53cea0 tx=0x7f046000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0474fc7700 1 -- 172.21.15.63:0/3511254394 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f046000e080 con 0x55de1f5369c0 2020-05-18T21:31:09.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0476fcb700 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55de1f5369c0 0x55de1f53c0b0 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x55de1f53cea0 tx=0x7f046000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0474fc7700 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f045804e780 0x7f0458050c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:09.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0474fc7700 1 -- 172.21.15.63:0/3511254394 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0460063e10 con 0x55de1f5369c0 2020-05-18T21:31:09.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0479389b80 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x55de1f533ed0 0x55de1f544360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:09.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f04777cc700 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f045804e780 0x7f0458050c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:09.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.813+0000 7f0479389b80 1 -- 172.21.15.63:0/3511254394 --> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] -- osd_op(unknown.0.0:1 14.7 14:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected e75) v8 -- 0x55de1f468c30 con 0x55de1f533ed0 2020-05-18T21:31:09.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.817+0000 7f04777cc700 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f045804e780 0x7f0458050c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0468001110 tx=0x7f0468002ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.817+0000 7f0477fcd700 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x55de1f533ed0 0x55de1f544360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:09.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.817+0000 7f04777cc700 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f045804e780 0x7f0458050c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0468001110 tx=0x7f0468002ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:09.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.817+0000 7f04777cc700 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f045804e780 0x7f0458050c40 secure :-1 s=READY pgs=387 cs=0 l=1 rx=0x7f0468001110 tx=0x7f0468002ad0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:09.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.817+0000 7f0477fcd700 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x55de1f533ed0 0x55de1f544360 crc :-1 s=READY pgs=24 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:09.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.817+0000 7f0477fcd700 1 -- 172.21.15.63:0/3511254394 <== osd.5 v2:172.21.15.155:6808/13024 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (93) out=93b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+93 (crc 0 0 0) 0x7f04700075a0 con 0x55de1f533ed0 2020-05-18T21:31:09.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.817+0000 7f0479389b80 1 -- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x55de1f533ed0 msgr2=0x55de1f544360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.817+0000 7f0479389b80 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x55de1f533ed0 0x55de1f544360 crc :-1 s=READY pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:09.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.817+0000 7f0479389b80 1 -- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f045804e780 msgr2=0x7f0458050c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.817+0000 7f0479389b80 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f045804e780 0x7f0458050c40 secure :-1 s=READY pgs=387 cs=0 l=1 rx=0x7f0468001110 tx=0x7f0468002ad0).stop 2020-05-18T21:31:09.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.817+0000 7f0479389b80 1 -- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55de1f5369c0 msgr2=0x55de1f53c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:09.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.817+0000 7f0479389b80 1 --2- 172.21.15.63:0/3511254394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55de1f5369c0 0x55de1f53c0b0 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x55de1f53cea0 tx=0x7f046000ab00).stop 2020-05-18T21:31:09.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.817+0000 7f0477fcd700 1 -- 172.21.15.63:0/3511254394 reap_dead start 2020-05-18T21:31:09.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.817+0000 7f0479389b80 1 -- 172.21.15.63:0/3511254394 shutdown_connections 2020-05-18T21:31:09.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.817+0000 7f0479389b80 1 -- 172.21.15.63:0/3511254394 >> 172.21.15.63:0/3511254394 conn(0x55de1f4ac850 msgr2=0x55de1f48c600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:09.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.817+0000 7f0479389b80 1 -- 172.21.15.63:0/3511254394 shutdown_connections 2020-05-18T21:31:09.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:09.817+0000 7f0479389b80 1 -- 172.21.15.63:0/3511254394 wait complete. 2020-05-18T21:31:09.834 INFO:teuthology.orchestra.run.smithi063.stdout:W�file_ddir_2* 2020-05-18T21:31:09.835 INFO:teuthology.orchestra.run.smithi063:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2020-05-18T21:31:09.906 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:09.906 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1099511627777, 2020-05-18T21:31:09.906 INFO:teuthology.orchestra.run.smithi063.stdout: "ancestors": [ 2020-05-18T21:31:09.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:09.907 INFO:teuthology.orchestra.run.smithi063.stdout: "dirino": 1099511628278, 2020-05-18T21:31:09.907 INFO:teuthology.orchestra.run.smithi063.stdout: "dname": "file_d", 2020-05-18T21:31:09.907 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 25 2020-05-18T21:31:09.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:09.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:09.909 INFO:teuthology.orchestra.run.smithi063.stdout: "dirino": 1, 2020-05-18T21:31:09.909 INFO:teuthology.orchestra.run.smithi063.stdout: "dname": "dir_2", 2020-05-18T21:31:09.910 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 42 2020-05-18T21:31:09.910 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:09.910 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:09.910 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 14, 2020-05-18T21:31:09.910 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [] 2020-05-18T21:31:09.911 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:09.911 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:09.915 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rm -f dir_2/file_d) 2020-05-18T21:31:09.940 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:10.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.041+0000 7fcb07500700 1 Processor -- start 2020-05-18T21:31:10.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.041+0000 7fcb07500700 1 -- start start 2020-05-18T21:31:10.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb07500700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcb001435d0 0x7fcb00063ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:10.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb07500700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcb000ad180 0x7fcb000ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:10.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb07500700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb001476c0 con 0x7fcb00147140 2020-05-18T21:31:10.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb07500700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb00148130 con 0x7fcb001435d0 2020-05-18T21:31:10.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb07500700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb00147960 con 0x7fcb000ad180 2020-05-18T21:31:10.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb064fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcb001435d0 0x7fcb00063ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:10.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb05cfd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcb00147140 0x7fcb0005edd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60036/0 (socket says 172.21.15.63:60036) 2020-05-18T21:31:10.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb05cfd700 1 -- 172.21.15.63:0/2919391585 learned_addr learned my addr 172.21.15.63:0/2919391585 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:10.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb06cff700 1 --2- 172.21.15.63:0/2919391585 >> v2:172.21.15.155:3300/0 conn(0x7fcb000ad180 0x7fcb000ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:10.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb054fc700 1 -- 172.21.15.63:0/2919391585 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706515675 0 0) 0x7fcb001476c0 con 0x7fcb00147140 2020-05-18T21:31:10.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb054fc700 1 -- 172.21.15.63:0/2919391585 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcae8003270 con 0x7fcb00147140 2020-05-18T21:31:10.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb054fc700 1 -- 172.21.15.63:0/2919391585 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2249537285 0 0) 0x7fcae8003270 con 0x7fcb00147140 2020-05-18T21:31:10.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb054fc700 1 -- 172.21.15.63:0/2919391585 >> v2:172.21.15.155:3300/0 conn(0x7fcb000ad180 msgr2=0x7fcb000ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:10.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb054fc700 1 --2- 172.21.15.63:0/2919391585 >> v2:172.21.15.155:3300/0 conn(0x7fcb000ad180 0x7fcb000ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:10.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb054fc700 1 -- 172.21.15.63:0/2919391585 >> v2:172.21.15.63:3300/0 conn(0x7fcb001435d0 msgr2=0x7fcb00063ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:10.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb054fc700 1 --2- 172.21.15.63:0/2919391585 >> v2:172.21.15.63:3300/0 conn(0x7fcb001435d0 0x7fcb00063ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:10.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb054fc700 1 -- 172.21.15.63:0/2919391585 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb00147c00 con 0x7fcb00147140 2020-05-18T21:31:10.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb054fc700 1 -- 172.21.15.63:0/2919391585 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fcaf0001710 con 0x7fcb00147140 2020-05-18T21:31:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb054fc700 1 -- 172.21.15.63:0/2919391585 >> v1:172.21.15.63:6789/0 conn(0x7fcb00147140 legacy=0x7fcb0005edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb054fc700 1 --2- 172.21.15.63:0/2919391585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcae8003760 0x7fcae8003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb054fc700 1 --2- 172.21.15.63:0/2919391585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcae8004510 0x7fcae8004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb054fc700 1 --2- 172.21.15.63:0/2919391585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcae800fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb054fc700 1 -- 172.21.15.63:0/2919391585 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb00147960 con 0x7fcae8004510 2020-05-18T21:31:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb054fc700 1 -- 172.21.15.63:0/2919391585 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae8004200 con 0x7fcae8003760 2020-05-18T21:31:10.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb054fc700 1 -- 172.21.15.63:0/2919391585 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae800ffd0 con 0x7fcae8004df0 2020-05-18T21:31:10.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb064fe700 1 --2- 172.21.15.63:0/2919391585 >> v2:172.21.15.63:3300/0 conn(0x7fcb001435d0 0x7fcb00063ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:31:10.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb06cff700 1 --2- 172.21.15.63:0/2919391585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcae800fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:10.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb064fe700 1 --2- 172.21.15.63:0/2919391585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcae8003760 0x7fcae8003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:10.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb05cfd700 1 --2- 172.21.15.63:0/2919391585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcae8004510 0x7fcae8004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:10.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb06cff700 1 -- 172.21.15.63:0/2919391585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcae8003760 msgr2=0x7fcae8003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:10.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb06cff700 1 --2- 172.21.15.63:0/2919391585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcae8003760 0x7fcae8003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:10.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb06cff700 1 -- 172.21.15.63:0/2919391585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcae8004510 msgr2=0x7fcae8004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:10.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb06cff700 1 --2- 172.21.15.63:0/2919391585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcae8004510 0x7fcae8004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:10.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb06cff700 1 -- 172.21.15.63:0/2919391585 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae8003270 con 0x7fcae8004df0 2020-05-18T21:31:10.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb05cfd700 1 --2- 172.21.15.63:0/2919391585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcae8004510 0x7fcae8004990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:31:10.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb06cff700 1 --2- 172.21.15.63:0/2919391585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcae800fb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcae80054e0 tx=0x7fcaf8010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:10.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb06cff700 1 -- 172.21.15.63:0/2919391585 reap_dead start 2020-05-18T21:31:10.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb06cff700 1 --2- 172.21.15.63:0/2919391585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcae800fb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcae80054e0 tx=0x7fcaf8010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:10.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb06cff700 1 --2- 172.21.15.63:0/2919391585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcae800fb70 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7fcae80054e0 tx=0x7fcaf8010410).ready entity=mon.2 client_cookie=d9e99450846d80c8 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:10.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb06cff700 1 --2- 172.21.15.63:0/2919391585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcae800fb70 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7fcae80054e0 tx=0x7fcaf8010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:10.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb054fc700 1 -- 172.21.15.63:0/2919391585 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaf8005c70 con 0x7fcae8004df0 2020-05-18T21:31:10.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb06cff700 1 --2- 172.21.15.63:0/2919391585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcae800fb70 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7fcae80054e0 tx=0x7fcaf8010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb054fc700 1 -- 172.21.15.63:0/2919391585 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf8005dd0 con 0x7fcae8004df0 2020-05-18T21:31:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb06cff700 1 --2- 172.21.15.63:0/2919391585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcae800fb70 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7fcae80054e0 tx=0x7fcaf8010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb054fc700 1 -- 172.21.15.63:0/2919391585 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaf80112c0 con 0x7fcae8004df0 2020-05-18T21:31:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb07500700 1 -- 172.21.15.63:0/2919391585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 msgr2=0x7fcae800fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.045+0000 7fcb07500700 1 --2- 172.21.15.63:0/2919391585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcae800fb70 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7fcae80054e0 tx=0x7fcaf8010410).stop 2020-05-18T21:31:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.049+0000 7fcb07500700 1 -- 172.21.15.63:0/2919391585 shutdown_connections 2020-05-18T21:31:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.049+0000 7fcb07500700 1 --2- 172.21.15.63:0/2919391585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcae800fb70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.049+0000 7fcb07500700 1 -- 172.21.15.63:0/2919391585 >> 172.21.15.63:0/2919391585 conn(0x7fcb00069fc0 msgr2=0x7fcb0006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.049+0000 7fcb07500700 1 -- 172.21.15.63:0/2919391585 shutdown_connections 2020-05-18T21:31:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.049+0000 7fcb07500700 1 -- 172.21.15.63:0/2919391585 wait complete. 2020-05-18T21:31:10.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.049+0000 7fcb07500700 1 Processor -- start 2020-05-18T21:31:10.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb07500700 1 -- start start 2020-05-18T21:31:10.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb07500700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcb001460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:10.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb07500700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcb00144d60 0x7fcb0013b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:10.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb07500700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0013e940 con 0x7fcb0013e4e0 2020-05-18T21:31:10.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb07500700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb00145470 con 0x7fcb00144d60 2020-05-18T21:31:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb07500700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb00145710 con 0x7fcae8004df0 2020-05-18T21:31:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb064fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcb001460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb064fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcb001460d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:48560/0 (socket says 172.21.15.63:48560) 2020-05-18T21:31:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb064fe700 1 -- 172.21.15.63:0/1950251197 learned_addr learned my addr 172.21.15.63:0/1950251197 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb06cff700 1 --2- 172.21.15.63:0/1950251197 >> v2:172.21.15.155:3300/0 conn(0x7fcb00144d60 0x7fcb0013b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb064fe700 1 -- 172.21.15.63:0/1950251197 >> v2:172.21.15.155:3300/0 conn(0x7fcb00144d60 msgr2=0x7fcb0013b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb064fe700 1 --2- 172.21.15.63:0/1950251197 >> v2:172.21.15.155:3300/0 conn(0x7fcb00144d60 0x7fcb0013b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb064fe700 1 -- 172.21.15.63:0/1950251197 >> v1:172.21.15.155:6789/0 conn(0x7fcb0013e4e0 legacy=0x7fcb0013ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb064fe700 1 -- 172.21.15.63:0/1950251197 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb001459b0 con 0x7fcae8004df0 2020-05-18T21:31:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb064fe700 1 --2- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcb001460d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcafc002f70 tx=0x7fcafc0092c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb064fe700 1 --2- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcb001460d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcafc002f70 tx=0x7fcafc0092c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb064fe700 1 --2- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcb001460d0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7fcafc002f70 tx=0x7fcafc0092c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb064fe700 1 --2- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcb001460d0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fcafc002f70 tx=0x7fcafc0092c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcaef7fe700 1 -- 172.21.15.63:0/1950251197 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcafc00ca70 con 0x7fcae8004df0 2020-05-18T21:31:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb07500700 1 -- 172.21.15.63:0/1950251197 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb001451d0 con 0x7fcae8004df0 2020-05-18T21:31:10.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb064fe700 1 --2- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcb001460d0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fcafc002f70 tx=0x7fcafc0092c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:10.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb064fe700 1 --2- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcb001460d0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fcafc002f70 tx=0x7fcafc0092c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:10.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcaef7fe700 1 -- 172.21.15.63:0/1950251197 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc00cbd0 con 0x7fcae8004df0 2020-05-18T21:31:10.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcaef7fe700 1 -- 172.21.15.63:0/1950251197 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcafc005700 con 0x7fcae8004df0 2020-05-18T21:31:10.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.053+0000 7fcb07500700 1 -- 172.21.15.63:0/1950251197 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0013b510 con 0x7fcae8004df0 2020-05-18T21:31:10.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.057+0000 7fcb064fe700 1 --2- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcb001460d0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fcafc002f70 tx=0x7fcafc0092c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:10.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.057+0000 7fcb07500700 1 -- 172.21.15.63:0/1950251197 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb000569e0 con 0x7fcae8004df0 2020-05-18T21:31:10.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.057+0000 7fcaef7fe700 1 -- 172.21.15.63:0/1950251197 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fcafc0071a0 con 0x7fcae8004df0 2020-05-18T21:31:10.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.057+0000 7fcb064fe700 1 --2- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcb001460d0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fcafc002f70 tx=0x7fcafc0092c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:10.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.057+0000 7fcaef7fe700 1 --2- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcae004f990 0x7fcae0051e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:10.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.057+0000 7fcaef7fe700 1 -- 172.21.15.63:0/1950251197 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fcafc0641d0 con 0x7fcae8004df0 2020-05-18T21:31:10.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.057+0000 7fcb05cfd700 1 --2- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcae004f990 0x7fcae0051e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:10.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.057+0000 7fcb05cfd700 1 --2- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcae004f990 0x7fcae0051e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcb00145d30 tx=0x7fcb000b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:10.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.057+0000 7fcb05cfd700 1 --2- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcae004f990 0x7fcae0051e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcb00145d30 tx=0x7fcb000b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:10.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.057+0000 7fcb05cfd700 1 --2- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcae004f990 0x7fcae0051e50 secure :-1 s=READY pgs=388 cs=0 l=1 rx=0x7fcb00145d30 tx=0x7fcb000b4cd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:10.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.069+0000 7fcb064fe700 1 --2- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcb001460d0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fcafc002f70 tx=0x7fcafc0092c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:10.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.069+0000 7fcaef7fe700 1 -- 172.21.15.63:0/1950251197 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fcafc03e500 con 0x7fcae8004df0 2020-05-18T21:31:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.213+0000 7fcb07500700 1 -- 172.21.15.63:0/1950251197 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb000008d0 con 0x7fcae8004df0 2020-05-18T21:31:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.217+0000 7fcb064fe700 1 --2- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcb001460d0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fcafc002f70 tx=0x7fcafc0092c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:10.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.217+0000 7fcaef7fe700 1 -- 172.21.15.63:0/1950251197 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7fcafc041b20 con 0x7fcae8004df0 2020-05-18T21:31:10.221 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:10.221 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:31:10.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.217+0000 7fcb07500700 1 -- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcae004f990 msgr2=0x7fcae0051e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:10.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.217+0000 7fcb07500700 1 --2- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcae004f990 0x7fcae0051e50 secure :-1 s=READY pgs=388 cs=0 l=1 rx=0x7fcb00145d30 tx=0x7fcb000b4cd0).stop 2020-05-18T21:31:10.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.217+0000 7fcb07500700 1 -- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 msgr2=0x7fcb001460d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:10.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.217+0000 7fcb07500700 1 --2- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcb001460d0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7fcafc002f70 tx=0x7fcafc0092c0).stop 2020-05-18T21:31:10.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.217+0000 7fcb07500700 1 -- 172.21.15.63:0/1950251197 shutdown_connections 2020-05-18T21:31:10.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.217+0000 7fcb07500700 1 --2- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcae004f990 0x7fcae0051e50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:10.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.217+0000 7fcb07500700 1 --2- 172.21.15.63:0/1950251197 >> v2:172.21.15.155:3300/0 conn(0x7fcb00144d60 0x7fcb0013b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:10.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.217+0000 7fcb07500700 1 --2- 172.21.15.63:0/1950251197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcae8004df0 0x7fcb001460d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:10.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.217+0000 7fcb07500700 1 -- 172.21.15.63:0/1950251197 >> 172.21.15.63:0/1950251197 conn(0x7fcb00069fc0 msgr2=0x7fcb0006a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:10.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.217+0000 7fcb07500700 1 -- 172.21.15.63:0/1950251197 shutdown_connections 2020-05-18T21:31:10.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:10.217+0000 7fcb07500700 1 -- 172.21.15.63:0/1950251197 wait complete. 2020-05-18T21:31:10.226 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:31:10.236 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_enqueued 2020-05-18T21:31:10.334 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:10.334 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:31:10.334 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 0 2020-05-18T21:31:10.335 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:10.335 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:10.342 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_enqueued": 0 } } 2020-05-18T21:31:10.343 DEBUG:tasks.ceph_test_case:wait_until_equal: 0 != 1, waiting (timeout=60)... 2020-05-18T21:31:15.344 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:15.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82dcc61700 1 Processor -- start 2020-05-18T21:31:15.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82dcc61700 1 -- start start 2020-05-18T21:31:15.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82dcc61700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82d80b4760 0x7f82d80648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:15.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82dcc61700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f82d8064d20 0x7f82d814d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:15.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82dcc61700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d814a330 con 0x7f82d805f110 2020-05-18T21:31:15.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82dcc61700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d814a140 con 0x7f82d8064d20 2020-05-18T21:31:15.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82dcc61700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d814a5d0 con 0x7f82d80b4760 2020-05-18T21:31:15.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f82d8064d20 0x7f82d814d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:15.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d6ffd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82d80b4760 0x7f82d80648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:15.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f82d8064d20 0x7f82d814d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57870/0 (socket says 172.21.15.63:57870) 2020-05-18T21:31:15.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d6ffd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82d80b4760 0x7f82d80648c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:48570/0 (socket says 172.21.15.63:48570) 2020-05-18T21:31:15.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d77fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f82d805f110 0x7f82d814aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:58370/0 (socket says 172.21.15.63:58370) 2020-05-18T21:31:15.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d7fff700 1 -- 172.21.15.63:0/3619757417 learned_addr learned my addr 172.21.15.63:0/3619757417 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:15.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d7fff700 1 -- 172.21.15.63:0/3619757417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82d80b4760 msgr2=0x7f82d80648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:15.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d7fff700 1 --2- 172.21.15.63:0/3619757417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82d80b4760 0x7f82d80648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:15.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d7fff700 1 -- 172.21.15.63:0/3619757417 >> v1:172.21.15.155:6789/0 conn(0x7f82d805f110 legacy=0x7f82d814aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:15.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d67fc700 1 -- 172.21.15.63:0/3619757417 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557170291 0 0) 0x7f82d814a330 con 0x7f82d805f110 2020-05-18T21:31:15.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d7fff700 1 -- 172.21.15.63:0/3619757417 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d8063430 con 0x7f82d8064d20 2020-05-18T21:31:15.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d7fff700 1 --2- 172.21.15.63:0/3619757417 >> v2:172.21.15.63:3300/0 conn(0x7f82d8064d20 0x7f82d814d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f82d8060a90 tx=0x7f82d0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d7fff700 1 --2- 172.21.15.63:0/3619757417 >> v2:172.21.15.63:3300/0 conn(0x7f82d8064d20 0x7f82d814d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f82d8060a90 tx=0x7f82d0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d7fff700 1 --2- 172.21.15.63:0/3619757417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82d8064d20 0x7f82d814d710 secure :-1 s=READY pgs=971 cs=0 l=1 rx=0x7f82d8060a90 tx=0x7f82d0008920).ready entity=mon.0 client_cookie=a7cc87b82a951c7f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:15.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d7fff700 1 --2- 172.21.15.63:0/3619757417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82d8064d20 0x7f82d814d710 secure :-1 s=THROTTLE_DONE pgs=971 cs=0 l=1 rx=0x7f82d8060a90 tx=0x7f82d0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d67fc700 1 -- 172.21.15.63:0/3619757417 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82d00116b0 con 0x7f82d8064d20 2020-05-18T21:31:15.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d7fff700 1 --2- 172.21.15.63:0/3619757417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82d8064d20 0x7f82d814d710 secure :-1 s=THROTTLE_DONE pgs=971 cs=0 l=1 rx=0x7f82d8060a90 tx=0x7f82d0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d67fc700 1 -- 172.21.15.63:0/3619757417 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d0011810 con 0x7f82d8064d20 2020-05-18T21:31:15.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d7fff700 1 --2- 172.21.15.63:0/3619757417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82d8064d20 0x7f82d814d710 secure :-1 s=THROTTLE_DONE pgs=971 cs=0 l=1 rx=0x7f82d8060a90 tx=0x7f82d0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82d67fc700 1 -- 172.21.15.63:0/3619757417 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82d0011bf0 con 0x7f82d8064d20 2020-05-18T21:31:15.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82dcc61700 1 -- 172.21.15.63:0/3619757417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82d8064d20 msgr2=0x7f82d814d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:15.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82dcc61700 1 --2- 172.21.15.63:0/3619757417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82d8064d20 0x7f82d814d710 secure :-1 s=READY pgs=971 cs=0 l=1 rx=0x7f82d8060a90 tx=0x7f82d0008920).stop 2020-05-18T21:31:15.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82dcc61700 1 -- 172.21.15.63:0/3619757417 shutdown_connections 2020-05-18T21:31:15.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82dcc61700 1 --2- 172.21.15.63:0/3619757417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82d8064d20 0x7f82d814d710 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:15.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82dcc61700 1 --2- 172.21.15.63:0/3619757417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82d80b4760 0x7f82d80648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:15.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.449+0000 7f82dcc61700 1 -- 172.21.15.63:0/3619757417 >> 172.21.15.63:0/3619757417 conn(0x7f82d8069fc0 msgr2=0x7f82d806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:15.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.453+0000 7f82dcc61700 1 -- 172.21.15.63:0/3619757417 shutdown_connections 2020-05-18T21:31:15.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.453+0000 7f82dcc61700 1 -- 172.21.15.63:0/3619757417 wait complete. 2020-05-18T21:31:15.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.453+0000 7f82dcc61700 1 Processor -- start 2020-05-18T21:31:15.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.453+0000 7f82dcc61700 1 -- start start 2020-05-18T21:31:15.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82dcc61700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f82d805f110 0x7f82d815b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:15.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82dcc61700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d8142b80 con 0x7f82d80b4760 2020-05-18T21:31:15.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82dcc61700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d8142640 con 0x7f82d8064d20 2020-05-18T21:31:15.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82dcc61700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d81428e0 con 0x7f82d805f110 2020-05-18T21:31:15.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d7fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f82d80b4760 0x7f82d8143840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60064/0 (socket says 172.21.15.63:60064) 2020-05-18T21:31:15.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d7fff700 1 -- 172.21.15.63:0/109326236 learned_addr learned my addr 172.21.15.63:0/109326236 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:15.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d77fe700 1 --2- 172.21.15.63:0/109326236 >> v2:172.21.15.155:3300/0 conn(0x7f82d805f110 0x7f82d815b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:15.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d4ff9700 1 -- 172.21.15.63:0/109326236 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941004337 0 0) 0x7f82d8142b80 con 0x7f82d80b4760 2020-05-18T21:31:15.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d4ff9700 1 -- 172.21.15.63:0/109326236 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82bc002fe0 con 0x7f82d80b4760 2020-05-18T21:31:15.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d4ff9700 1 -- 172.21.15.63:0/109326236 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874453341 0 0) 0x7f82d8142640 con 0x7f82d8064d20 2020-05-18T21:31:15.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d4ff9700 1 -- 172.21.15.63:0/109326236 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82d8142b80 con 0x7f82d8064d20 2020-05-18T21:31:15.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d4ff9700 1 -- 172.21.15.63:0/109326236 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3432097690 0 0) 0x7f82bc002fe0 con 0x7f82d80b4760 2020-05-18T21:31:15.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d77fe700 1 -- 172.21.15.63:0/109326236 >> v1:172.21.15.155:6789/0 conn(0x7f82d8064d20 legacy=0x7f82d8156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:15.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d77fe700 1 -- 172.21.15.63:0/109326236 >> v1:172.21.15.63:6789/0 conn(0x7f82d80b4760 legacy=0x7f82d8143840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:15.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d77fe700 1 -- 172.21.15.63:0/109326236 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d8143f50 con 0x7f82d805f110 2020-05-18T21:31:15.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d77fe700 1 --2- 172.21.15.63:0/109326236 >> v2:172.21.15.155:3300/0 conn(0x7f82d805f110 0x7f82d815b600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f82d0008320 tx=0x7f82c00108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d77fe700 1 --2- 172.21.15.63:0/109326236 >> v2:172.21.15.155:3300/0 conn(0x7f82d805f110 0x7f82d815b600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f82d0008320 tx=0x7f82c00108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d77fe700 1 --2- 172.21.15.63:0/109326236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d805f110 0x7f82d815b600 secure :-1 s=READY pgs=682 cs=0 l=1 rx=0x7f82d0008320 tx=0x7f82c00108e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:15.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d77fe700 1 --2- 172.21.15.63:0/109326236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d805f110 0x7f82d815b600 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f82d0008320 tx=0x7f82c00108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d4ff9700 1 -- 172.21.15.63:0/109326236 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82d0002f70 con 0x7f82d805f110 2020-05-18T21:31:15.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d77fe700 1 --2- 172.21.15.63:0/109326236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d805f110 0x7f82d815b600 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f82d0008320 tx=0x7f82c00108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d4ff9700 1 -- 172.21.15.63:0/109326236 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c0011210 con 0x7f82d805f110 2020-05-18T21:31:15.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d77fe700 1 --2- 172.21.15.63:0/109326236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d805f110 0x7f82d815b600 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f82d0008320 tx=0x7f82c00108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82dcc61700 1 -- 172.21.15.63:0/109326236 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d8141ec0 con 0x7f82d805f110 2020-05-18T21:31:15.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d4ff9700 1 -- 172.21.15.63:0/109326236 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82c0011570 con 0x7f82d805f110 2020-05-18T21:31:15.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82dcc61700 1 -- 172.21.15.63:0/109326236 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d8142340 con 0x7f82d805f110 2020-05-18T21:31:15.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.457+0000 7f82d77fe700 1 --2- 172.21.15.63:0/109326236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d805f110 0x7f82d815b600 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f82d0008320 tx=0x7f82c00108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.461+0000 7f82dcc61700 1 -- 172.21.15.63:0/109326236 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d80569e0 con 0x7f82d805f110 2020-05-18T21:31:15.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.461+0000 7f82d77fe700 1 --2- 172.21.15.63:0/109326236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d805f110 0x7f82d815b600 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f82d0008320 tx=0x7f82c00108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.461+0000 7f82d4ff9700 1 -- 172.21.15.63:0/109326236 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f82c0011770 con 0x7f82d805f110 2020-05-18T21:31:15.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.461+0000 7f82d4ff9700 1 --2- 172.21.15.63:0/109326236 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f82bc04fe60 0x7f82bc052320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:15.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.461+0000 7f82d4ff9700 1 -- 172.21.15.63:0/109326236 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f82c00639b0 con 0x7f82d805f110 2020-05-18T21:31:15.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.461+0000 7f82d6ffd700 1 --2- 172.21.15.63:0/109326236 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f82bc04fe60 0x7f82bc052320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:15.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.461+0000 7f82d6ffd700 1 --2- 172.21.15.63:0/109326236 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f82bc04fe60 0x7f82bc052320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f82c80032b0 tx=0x7f82c8009c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.461+0000 7f82d6ffd700 1 --2- 172.21.15.63:0/109326236 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f82bc04fe60 0x7f82bc052320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f82c80032b0 tx=0x7f82c8009c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.461+0000 7f82d6ffd700 1 --2- 172.21.15.63:0/109326236 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f82bc04fe60 0x7f82bc052320 secure :-1 s=READY pgs=389 cs=0 l=1 rx=0x7f82c80032b0 tx=0x7f82c8009c70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:15.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.469+0000 7f82d77fe700 1 --2- 172.21.15.63:0/109326236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d805f110 0x7f82d815b600 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f82d0008320 tx=0x7f82c00108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.469+0000 7f82d4ff9700 1 -- 172.21.15.63:0/109326236 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f82c003dd60 con 0x7f82d805f110 2020-05-18T21:31:15.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.617+0000 7f82dcc61700 1 -- 172.21.15.63:0/109326236 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82d80625f0 con 0x7f82d805f110 2020-05-18T21:31:15.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.621+0000 7f82d77fe700 1 --2- 172.21.15.63:0/109326236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d805f110 0x7f82d815b600 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f82d0008320 tx=0x7f82c00108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.621+0000 7f82d4ff9700 1 -- 172.21.15.63:0/109326236 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7f82c0041380 con 0x7f82d805f110 2020-05-18T21:31:15.625 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:15.626 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:31:15.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.621+0000 7f82dcc61700 1 -- 172.21.15.63:0/109326236 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f82bc04fe60 msgr2=0x7f82bc052320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:15.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.621+0000 7f82dcc61700 1 --2- 172.21.15.63:0/109326236 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f82bc04fe60 0x7f82bc052320 secure :-1 s=READY pgs=389 cs=0 l=1 rx=0x7f82c80032b0 tx=0x7f82c8009c70).stop 2020-05-18T21:31:15.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.621+0000 7f82dcc61700 1 -- 172.21.15.63:0/109326236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d805f110 msgr2=0x7f82d815b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:15.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.621+0000 7f82dcc61700 1 --2- 172.21.15.63:0/109326236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d805f110 0x7f82d815b600 secure :-1 s=READY pgs=682 cs=0 l=1 rx=0x7f82d0008320 tx=0x7f82c00108e0).stop 2020-05-18T21:31:15.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.621+0000 7f82dcc61700 1 -- 172.21.15.63:0/109326236 shutdown_connections 2020-05-18T21:31:15.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.621+0000 7f82dcc61700 1 --2- 172.21.15.63:0/109326236 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f82bc04fe60 0x7f82bc052320 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:15.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.621+0000 7f82dcc61700 1 --2- 172.21.15.63:0/109326236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d805f110 0x7f82d815b600 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:15.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.621+0000 7f82dcc61700 1 -- 172.21.15.63:0/109326236 >> 172.21.15.63:0/109326236 conn(0x7f82d8069fc0 msgr2=0x7f82d805c280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:15.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.621+0000 7f82dcc61700 1 -- 172.21.15.63:0/109326236 shutdown_connections 2020-05-18T21:31:15.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.621+0000 7f82dcc61700 1 -- 172.21.15.63:0/109326236 wait complete. 2020-05-18T21:31:15.629 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:31:15.638 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_enqueued 2020-05-18T21:31:15.733 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:15.733 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:31:15.733 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 1 2020-05-18T21:31:15.733 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:15.734 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:15.741 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_enqueued": 1 } } 2020-05-18T21:31:15.742 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:15.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd9c1f5700 1 Processor -- start 2020-05-18T21:31:15.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd9c1f5700 1 -- start start 2020-05-18T21:31:15.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd9c1f5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbd9405bda0 0x7fbd94142f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:15.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd9c1f5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd9412ba80 0x7fbd9412bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:15.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd9c1f5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd9405ab40 con 0x7fbd940652b0 2020-05-18T21:31:15.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd9c1f5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd940b6a10 con 0x7fbd9405bda0 2020-05-18T21:31:15.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd9c1f5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9405ade0 con 0x7fbd9412ba80 2020-05-18T21:31:15.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd99790700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbd9405bda0 0x7fbd94142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:15.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd99790700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbd9405bda0 0x7fbd94142f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57882/0 (socket says 172.21.15.63:57882) 2020-05-18T21:31:15.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd99790700 1 -- 172.21.15.63:0/2902369708 learned_addr learned my addr 172.21.15.63:0/2902369708 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:15.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd9a792700 1 --2- 172.21.15.63:0/2902369708 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd9412ba80 0x7fbd9412bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:15.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd99790700 1 -- 172.21.15.63:0/2902369708 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd9412ba80 msgr2=0x7fbd9412bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:15.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd99790700 1 --2- 172.21.15.63:0/2902369708 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd9412ba80 0x7fbd9412bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:15.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd99790700 1 -- 172.21.15.63:0/2902369708 >> v1:172.21.15.155:6789/0 conn(0x7fbd940652b0 legacy=0x7fbd941400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:15.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd99790700 1 -- 172.21.15.63:0/2902369708 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9405b080 con 0x7fbd9405bda0 2020-05-18T21:31:15.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd99790700 1 --2- 172.21.15.63:0/2902369708 >> v2:172.21.15.63:3300/0 conn(0x7fbd9405bda0 0x7fbd94142f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbd900032f0 tx=0x7fbd90007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd99790700 1 --2- 172.21.15.63:0/2902369708 >> v2:172.21.15.63:3300/0 conn(0x7fbd9405bda0 0x7fbd94142f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbd900032f0 tx=0x7fbd90007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd99790700 1 --2- 172.21.15.63:0/2902369708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9405bda0 0x7fbd94142f30 secure :-1 s=READY pgs=973 cs=0 l=1 rx=0x7fbd900032f0 tx=0x7fbd90007e00).ready entity=mon.0 client_cookie=bd630201e8a86a08 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:15.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd99790700 1 --2- 172.21.15.63:0/2902369708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9405bda0 0x7fbd94142f30 secure :-1 s=THROTTLE_DONE pgs=973 cs=0 l=1 rx=0x7fbd900032f0 tx=0x7fbd90007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd99790700 1 --2- 172.21.15.63:0/2902369708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9405bda0 0x7fbd94142f30 secure :-1 s=THROTTLE_DONE pgs=973 cs=0 l=1 rx=0x7fbd900032f0 tx=0x7fbd90007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd98f8f700 1 -- 172.21.15.63:0/2902369708 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd90011dc0 con 0x7fbd9405bda0 2020-05-18T21:31:15.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd99790700 1 --2- 172.21.15.63:0/2902369708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9405bda0 0x7fbd94142f30 secure :-1 s=THROTTLE_DONE pgs=973 cs=0 l=1 rx=0x7fbd900032f0 tx=0x7fbd90007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd98f8f700 1 -- 172.21.15.63:0/2902369708 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9000a180 con 0x7fbd9405bda0 2020-05-18T21:31:15.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd98f8f700 1 -- 172.21.15.63:0/2902369708 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd9000a5a0 con 0x7fbd9405bda0 2020-05-18T21:31:15.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd9c1f5700 1 -- 172.21.15.63:0/2902369708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9405bda0 msgr2=0x7fbd94142f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:15.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd9c1f5700 1 --2- 172.21.15.63:0/2902369708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9405bda0 0x7fbd94142f30 secure :-1 s=READY pgs=973 cs=0 l=1 rx=0x7fbd900032f0 tx=0x7fbd90007e00).stop 2020-05-18T21:31:15.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd9c1f5700 1 -- 172.21.15.63:0/2902369708 shutdown_connections 2020-05-18T21:31:15.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd9c1f5700 1 --2- 172.21.15.63:0/2902369708 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd9412ba80 0x7fbd9412bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:15.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd9c1f5700 1 --2- 172.21.15.63:0/2902369708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9405bda0 0x7fbd94142f30 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:15.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd9c1f5700 1 -- 172.21.15.63:0/2902369708 >> 172.21.15.63:0/2902369708 conn(0x7fbd94066ed0 msgr2=0x7fbd940b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:15.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd9c1f5700 1 -- 172.21.15.63:0/2902369708 shutdown_connections 2020-05-18T21:31:15.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.841+0000 7fbd9c1f5700 1 -- 172.21.15.63:0/2902369708 wait complete. 2020-05-18T21:31:15.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.845+0000 7fbd9c1f5700 1 Processor -- start 2020-05-18T21:31:15.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.845+0000 7fbd9c1f5700 1 -- start start 2020-05-18T21:31:15.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd9c1f5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbd9405bda0 0x7fbd94128160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:15.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd9c1f5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbd940652b0 0x7fbd941285c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:15.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd9c1f5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd940ae860 con 0x7fbd9412ba80 2020-05-18T21:31:15.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd9c1f5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd940aeb00 con 0x7fbd9405bda0 2020-05-18T21:31:15.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd9c1f5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd94063b40 con 0x7fbd940652b0 2020-05-18T21:31:15.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd99f91700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbd9405bda0 0x7fbd94128160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:15.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd99f91700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbd9405bda0 0x7fbd94128160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57886/0 (socket says 172.21.15.63:57886) 2020-05-18T21:31:15.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd99f91700 1 -- 172.21.15.63:0/2607882208 learned_addr learned my addr 172.21.15.63:0/2607882208 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:15.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd99790700 1 --2- 172.21.15.63:0/2607882208 >> v2:172.21.15.155:3300/0 conn(0x7fbd940652b0 0x7fbd941285c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:15.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd99f91700 1 -- 172.21.15.63:0/2607882208 >> v2:172.21.15.155:3300/0 conn(0x7fbd940652b0 msgr2=0x7fbd941285c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:15.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd99f91700 1 --2- 172.21.15.63:0/2607882208 >> v2:172.21.15.155:3300/0 conn(0x7fbd940652b0 0x7fbd941285c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:15.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd99f91700 1 -- 172.21.15.63:0/2607882208 >> v1:172.21.15.155:6789/0 conn(0x7fbd9412ba80 legacy=0x7fbd940addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:15.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd99f91700 1 -- 172.21.15.63:0/2607882208 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd940ae500 con 0x7fbd9405bda0 2020-05-18T21:31:15.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd99f91700 1 --2- 172.21.15.63:0/2607882208 >> v2:172.21.15.63:3300/0 conn(0x7fbd9405bda0 0x7fbd94128160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd940616c0 tx=0x7fbd8400c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd99f91700 1 --2- 172.21.15.63:0/2607882208 >> v2:172.21.15.63:3300/0 conn(0x7fbd9405bda0 0x7fbd94128160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd940616c0 tx=0x7fbd8400c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd99f91700 1 --2- 172.21.15.63:0/2607882208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9405bda0 0x7fbd94128160 secure :-1 s=READY pgs=974 cs=0 l=1 rx=0x7fbd940616c0 tx=0x7fbd8400c480).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:15.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd99f91700 1 --2- 172.21.15.63:0/2607882208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9405bda0 0x7fbd94128160 secure :-1 s=THROTTLE_DONE pgs=974 cs=0 l=1 rx=0x7fbd940616c0 tx=0x7fbd8400c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd99f91700 1 --2- 172.21.15.63:0/2607882208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9405bda0 0x7fbd94128160 secure :-1 s=THROTTLE_DONE pgs=974 cs=0 l=1 rx=0x7fbd940616c0 tx=0x7fbd8400c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd99f91700 1 --2- 172.21.15.63:0/2607882208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9405bda0 0x7fbd94128160 secure :-1 s=THROTTLE_DONE pgs=974 cs=0 l=1 rx=0x7fbd940616c0 tx=0x7fbd8400c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd82ffd700 1 -- 172.21.15.63:0/2607882208 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd8400cc40 con 0x7fbd9405bda0 2020-05-18T21:31:15.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd82ffd700 1 -- 172.21.15.63:0/2607882208 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8400cda0 con 0x7fbd9405bda0 2020-05-18T21:31:15.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd9c1f5700 1 -- 172.21.15.63:0/2607882208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd941409b0 con 0x7fbd9405bda0 2020-05-18T21:31:15.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd82ffd700 1 -- 172.21.15.63:0/2607882208 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd84012220 con 0x7fbd9405bda0 2020-05-18T21:31:15.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd9c1f5700 1 -- 172.21.15.63:0/2607882208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd94142130 con 0x7fbd9405bda0 2020-05-18T21:31:15.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd99f91700 1 --2- 172.21.15.63:0/2607882208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9405bda0 0x7fbd94128160 secure :-1 s=THROTTLE_DONE pgs=974 cs=0 l=1 rx=0x7fbd940616c0 tx=0x7fbd8400c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.849+0000 7fbd9c1f5700 1 -- 172.21.15.63:0/2607882208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd940aec40 con 0x7fbd9405bda0 2020-05-18T21:31:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.853+0000 7fbd82ffd700 1 -- 172.21.15.63:0/2607882208 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fbd84006520 con 0x7fbd9405bda0 2020-05-18T21:31:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.853+0000 7fbd99f91700 1 --2- 172.21.15.63:0/2607882208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9405bda0 0x7fbd94128160 secure :-1 s=THROTTLE_DONE pgs=974 cs=0 l=1 rx=0x7fbd940616c0 tx=0x7fbd8400c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.853+0000 7fbd82ffd700 1 --2- 172.21.15.63:0/2607882208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbd7404fa90 0x7fbd74051f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.853+0000 7fbd82ffd700 1 -- 172.21.15.63:0/2607882208 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fbd840636e0 con 0x7fbd9405bda0 2020-05-18T21:31:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.853+0000 7fbd99790700 1 --2- 172.21.15.63:0/2607882208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbd7404fa90 0x7fbd74051f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.853+0000 7fbd99790700 1 --2- 172.21.15.63:0/2607882208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbd7404fa90 0x7fbd74051f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd900032f0 tx=0x7fbd90007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.853+0000 7fbd99790700 1 --2- 172.21.15.63:0/2607882208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbd7404fa90 0x7fbd74051f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd900032f0 tx=0x7fbd90007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.853+0000 7fbd99790700 1 --2- 172.21.15.63:0/2607882208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbd7404fa90 0x7fbd74051f50 secure :-1 s=READY pgs=390 cs=0 l=1 rx=0x7fbd900032f0 tx=0x7fbd90007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:15.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.857+0000 7fbd99f91700 1 --2- 172.21.15.63:0/2607882208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9405bda0 0x7fbd94128160 secure :-1 s=THROTTLE_DONE pgs=974 cs=0 l=1 rx=0x7fbd940616c0 tx=0x7fbd8400c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:15.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:15.857+0000 7fbd82ffd700 1 -- 172.21.15.63:0/2607882208 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fbd8403dad0 con 0x7fbd9405bda0 2020-05-18T21:31:16.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.005+0000 7fbd9c1f5700 1 -- 172.21.15.63:0/2607882208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd940569e0 con 0x7fbd9405bda0 2020-05-18T21:31:16.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.005+0000 7fbd99f91700 1 --2- 172.21.15.63:0/2607882208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9405bda0 0x7fbd94128160 secure :-1 s=THROTTLE_DONE pgs=974 cs=0 l=1 rx=0x7fbd940616c0 tx=0x7fbd8400c480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.005+0000 7fbd82ffd700 1 -- 172.21.15.63:0/2607882208 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7fbd840410f0 con 0x7fbd9405bda0 2020-05-18T21:31:16.012 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:16.012 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:31:16.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.009+0000 7fbd9c1f5700 1 -- 172.21.15.63:0/2607882208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbd7404fa90 msgr2=0x7fbd74051f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.009+0000 7fbd9c1f5700 1 --2- 172.21.15.63:0/2607882208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbd7404fa90 0x7fbd74051f50 secure :-1 s=READY pgs=390 cs=0 l=1 rx=0x7fbd900032f0 tx=0x7fbd90007e00).stop 2020-05-18T21:31:16.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.009+0000 7fbd9c1f5700 1 -- 172.21.15.63:0/2607882208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9405bda0 msgr2=0x7fbd94128160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.009+0000 7fbd9c1f5700 1 --2- 172.21.15.63:0/2607882208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9405bda0 0x7fbd94128160 secure :-1 s=READY pgs=974 cs=0 l=1 rx=0x7fbd940616c0 tx=0x7fbd8400c480).stop 2020-05-18T21:31:16.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.009+0000 7fbd9c1f5700 1 -- 172.21.15.63:0/2607882208 shutdown_connections 2020-05-18T21:31:16.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.009+0000 7fbd9c1f5700 1 --2- 172.21.15.63:0/2607882208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbd7404fa90 0x7fbd74051f50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.009+0000 7fbd9c1f5700 1 --2- 172.21.15.63:0/2607882208 >> v2:172.21.15.155:3300/0 conn(0x7fbd940652b0 0x7fbd941285c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.009+0000 7fbd9c1f5700 1 --2- 172.21.15.63:0/2607882208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9405bda0 0x7fbd94128160 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.009+0000 7fbd9c1f5700 1 -- 172.21.15.63:0/2607882208 >> 172.21.15.63:0/2607882208 conn(0x7fbd94066ed0 msgr2=0x7fbd94062450 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:16.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.009+0000 7fbd9c1f5700 1 -- 172.21.15.63:0/2607882208 shutdown_connections 2020-05-18T21:31:16.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.009+0000 7fbd9c1f5700 1 -- 172.21.15.63:0/2607882208 wait complete. 2020-05-18T21:31:16.016 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:31:16.024 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump purge_queue pq_executed 2020-05-18T21:31:16.123 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:16.123 INFO:teuthology.orchestra.run.smithi063.stdout: "purge_queue": { 2020-05-18T21:31:16.124 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executed": 1 2020-05-18T21:31:16.124 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:16.124 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:16.132 INFO:tasks.cephfs.filesystem:_json_asok output: { "purge_queue": { "pq_executed": 1 } } 2020-05-18T21:31:16.133 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:16.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.229+0000 7ff0e0dd0700 1 Processor -- start 2020-05-18T21:31:16.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.229+0000 7ff0e0dd0700 1 -- start start 2020-05-18T21:31:16.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.229+0000 7ff0e0dd0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff0dc0b93f0 0x7ff0dc145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:16.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.229+0000 7ff0e0dd0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff0dc1435a0 0x7ff0dc060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:16.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.229+0000 7ff0e0dd0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0dc0b7020 con 0x7ff0dc0b7ca0 2020-05-18T21:31:16.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.229+0000 7ff0e0dd0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc0b72c0 con 0x7ff0dc1435a0 2020-05-18T21:31:16.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.229+0000 7ff0e0dd0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc0b7560 con 0x7ff0dc0b93f0 2020-05-18T21:31:16.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.229+0000 7ff0dbfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff0dc1435a0 0x7ff0dc060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.229+0000 7ff0daffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff0dc0b7ca0 0x7ff0dc142e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60082/0 (socket says 172.21.15.63:60082) 2020-05-18T21:31:16.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.229+0000 7ff0daffd700 1 -- 172.21.15.63:0/247618011 learned_addr learned my addr 172.21.15.63:0/247618011 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:16.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.229+0000 7ff0db7fe700 1 --2- 172.21.15.63:0/247618011 >> v2:172.21.15.155:3300/0 conn(0x7ff0dc0b93f0 0x7ff0dc145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.229+0000 7ff0dbfff700 1 -- 172.21.15.63:0/247618011 >> v2:172.21.15.155:3300/0 conn(0x7ff0dc0b93f0 msgr2=0x7ff0dc145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:16.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.229+0000 7ff0dbfff700 1 --2- 172.21.15.63:0/247618011 >> v2:172.21.15.155:3300/0 conn(0x7ff0dc0b93f0 0x7ff0dc145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:16.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.229+0000 7ff0dbfff700 1 -- 172.21.15.63:0/247618011 >> v1:172.21.15.63:6789/0 conn(0x7ff0dc0b7ca0 legacy=0x7ff0dc142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.229+0000 7ff0dbfff700 1 -- 172.21.15.63:0/247618011 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc0b7800 con 0x7ff0dc1435a0 2020-05-18T21:31:16.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.229+0000 7ff0db7fe700 1 --2- 172.21.15.63:0/247618011 >> v2:172.21.15.155:3300/0 conn(0x7ff0dc0b93f0 0x7ff0dc145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:31:16.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0dbfff700 1 --2- 172.21.15.63:0/247618011 >> v2:172.21.15.63:3300/0 conn(0x7ff0dc1435a0 0x7ff0dc060430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff0d40032f0 tx=0x7ff0d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0dbfff700 1 --2- 172.21.15.63:0/247618011 >> v2:172.21.15.63:3300/0 conn(0x7ff0dc1435a0 0x7ff0dc060430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff0d40032f0 tx=0x7ff0d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0dbfff700 1 --2- 172.21.15.63:0/247618011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0dc1435a0 0x7ff0dc060430 secure :-1 s=READY pgs=976 cs=0 l=1 rx=0x7ff0d40032f0 tx=0x7ff0d4007e00).ready entity=mon.0 client_cookie=9b610ea79492ee6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:16.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0dbfff700 1 --2- 172.21.15.63:0/247618011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0dc1435a0 0x7ff0dc060430 secure :-1 s=THROTTLE_DONE pgs=976 cs=0 l=1 rx=0x7ff0d40032f0 tx=0x7ff0d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0dbfff700 1 --2- 172.21.15.63:0/247618011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0dc1435a0 0x7ff0dc060430 secure :-1 s=THROTTLE_DONE pgs=976 cs=0 l=1 rx=0x7ff0d40032f0 tx=0x7ff0d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0da7fc700 1 -- 172.21.15.63:0/247618011 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0d400a180 con 0x7ff0dc1435a0 2020-05-18T21:31:16.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0dbfff700 1 --2- 172.21.15.63:0/247618011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0dc1435a0 0x7ff0dc060430 secure :-1 s=THROTTLE_DONE pgs=976 cs=0 l=1 rx=0x7ff0d40032f0 tx=0x7ff0d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0da7fc700 1 -- 172.21.15.63:0/247618011 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d400a2e0 con 0x7ff0dc1435a0 2020-05-18T21:31:16.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0da7fc700 1 -- 172.21.15.63:0/247618011 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0d400a700 con 0x7ff0dc1435a0 2020-05-18T21:31:16.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0e0dd0700 1 -- 172.21.15.63:0/247618011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0dc1435a0 msgr2=0x7ff0dc060430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0e0dd0700 1 --2- 172.21.15.63:0/247618011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0dc1435a0 0x7ff0dc060430 secure :-1 s=READY pgs=976 cs=0 l=1 rx=0x7ff0d40032f0 tx=0x7ff0d4007e00).stop 2020-05-18T21:31:16.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0e0dd0700 1 -- 172.21.15.63:0/247618011 shutdown_connections 2020-05-18T21:31:16.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0e0dd0700 1 --2- 172.21.15.63:0/247618011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0dc1435a0 0x7ff0dc060430 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0e0dd0700 1 --2- 172.21.15.63:0/247618011 >> v2:172.21.15.155:3300/0 conn(0x7ff0dc0b93f0 0x7ff0dc145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:16.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0e0dd0700 1 -- 172.21.15.63:0/247618011 >> 172.21.15.63:0/247618011 conn(0x7ff0dc069b70 msgr2=0x7ff0dc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:16.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0e0dd0700 1 -- 172.21.15.63:0/247618011 shutdown_connections 2020-05-18T21:31:16.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0e0dd0700 1 -- 172.21.15.63:0/247618011 wait complete. 2020-05-18T21:31:16.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0e0dd0700 1 Processor -- start 2020-05-18T21:31:16.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0e0dd0700 1 -- start start 2020-05-18T21:31:16.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0e0dd0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff0dc0b93f0 0x7ff0dc142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:16.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0e0dd0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff0dc1435a0 0x7ff0dc0b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:16.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0e0dd0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0dc0b5a10 con 0x7ff0dc0b7ca0 2020-05-18T21:31:16.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0e0dd0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc13c070 con 0x7ff0dc0b93f0 2020-05-18T21:31:16.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0e0dd0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc13af80 con 0x7ff0dc1435a0 2020-05-18T21:31:16.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.233+0000 7ff0daffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff0dc0b93f0 0x7ff0dc142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0daffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff0dc0b93f0 0x7ff0dc142130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57902/0 (socket says 172.21.15.63:57902) 2020-05-18T21:31:16.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0daffd700 1 -- 172.21.15.63:0/2635698945 learned_addr learned my addr 172.21.15.63:0/2635698945 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:16.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0dbfff700 1 --2- 172.21.15.63:0/2635698945 >> v2:172.21.15.155:3300/0 conn(0x7ff0dc1435a0 0x7ff0dc0b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0daffd700 1 -- 172.21.15.63:0/2635698945 >> v2:172.21.15.155:3300/0 conn(0x7ff0dc1435a0 msgr2=0x7ff0dc0b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0daffd700 1 --2- 172.21.15.63:0/2635698945 >> v2:172.21.15.155:3300/0 conn(0x7ff0dc1435a0 0x7ff0dc0b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0daffd700 1 -- 172.21.15.63:0/2635698945 >> v1:172.21.15.155:6789/0 conn(0x7ff0dc0b7ca0 legacy=0x7ff0dc13b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0daffd700 1 -- 172.21.15.63:0/2635698945 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc13b220 con 0x7ff0dc0b93f0 2020-05-18T21:31:16.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0daffd700 1 --2- 172.21.15.63:0/2635698945 >> v2:172.21.15.63:3300/0 conn(0x7ff0dc0b93f0 0x7ff0dc142130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff0dc06ab40 tx=0x7ff0d00013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0daffd700 1 --2- 172.21.15.63:0/2635698945 >> v2:172.21.15.63:3300/0 conn(0x7ff0dc0b93f0 0x7ff0dc142130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff0dc06ab40 tx=0x7ff0d00013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0daffd700 1 --2- 172.21.15.63:0/2635698945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0dc0b93f0 0x7ff0dc142130 secure :-1 s=READY pgs=977 cs=0 l=1 rx=0x7ff0dc06ab40 tx=0x7ff0d00013e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:16.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0daffd700 1 --2- 172.21.15.63:0/2635698945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0dc0b93f0 0x7ff0dc142130 secure :-1 s=THROTTLE_DONE pgs=977 cs=0 l=1 rx=0x7ff0dc06ab40 tx=0x7ff0d00013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0d8ff9700 1 -- 172.21.15.63:0/2635698945 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0d0010510 con 0x7ff0dc0b93f0 2020-05-18T21:31:16.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0daffd700 1 --2- 172.21.15.63:0/2635698945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0dc0b93f0 0x7ff0dc142130 secure :-1 s=THROTTLE_DONE pgs=977 cs=0 l=1 rx=0x7ff0dc06ab40 tx=0x7ff0d00013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0daffd700 1 --2- 172.21.15.63:0/2635698945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0dc0b93f0 0x7ff0dc142130 secure :-1 s=THROTTLE_DONE pgs=977 cs=0 l=1 rx=0x7ff0dc06ab40 tx=0x7ff0d00013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0d8ff9700 1 -- 172.21.15.63:0/2635698945 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d000cb80 con 0x7ff0dc0b93f0 2020-05-18T21:31:16.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0e0dd0700 1 -- 172.21.15.63:0/2635698945 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0dc13b520 con 0x7ff0dc0b93f0 2020-05-18T21:31:16.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0d8ff9700 1 -- 172.21.15.63:0/2635698945 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0d000d0d0 con 0x7ff0dc0b93f0 2020-05-18T21:31:16.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0e0dd0700 1 -- 172.21.15.63:0/2635698945 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0dc157bd0 con 0x7ff0dc0b93f0 2020-05-18T21:31:16.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0daffd700 1 --2- 172.21.15.63:0/2635698945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0dc0b93f0 0x7ff0dc142130 secure :-1 s=THROTTLE_DONE pgs=977 cs=0 l=1 rx=0x7ff0dc06ab40 tx=0x7ff0d00013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0d8ff9700 1 -- 172.21.15.63:0/2635698945 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff0d0005600 con 0x7ff0dc0b93f0 2020-05-18T21:31:16.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0daffd700 1 --2- 172.21.15.63:0/2635698945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0dc0b93f0 0x7ff0dc142130 secure :-1 s=THROTTLE_DONE pgs=977 cs=0 l=1 rx=0x7ff0dc06ab40 tx=0x7ff0d00013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0e0dd0700 1 -- 172.21.15.63:0/2635698945 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0dc0569e0 con 0x7ff0dc0b93f0 2020-05-18T21:31:16.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0d8ff9700 1 --2- 172.21.15.63:0/2635698945 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff0bc04f9e0 0x7ff0bc051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:16.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0d8ff9700 1 -- 172.21.15.63:0/2635698945 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff0d00100c0 con 0x7ff0dc0b93f0 2020-05-18T21:31:16.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.237+0000 7ff0db7fe700 1 --2- 172.21.15.63:0/2635698945 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff0bc04f9e0 0x7ff0bc051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.241+0000 7ff0db7fe700 1 --2- 172.21.15.63:0/2635698945 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff0bc04f9e0 0x7ff0bc051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff0dc141a40 tx=0x7ff0cc008db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.241+0000 7ff0db7fe700 1 --2- 172.21.15.63:0/2635698945 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff0bc04f9e0 0x7ff0bc051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff0dc141a40 tx=0x7ff0cc008db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.241+0000 7ff0db7fe700 1 --2- 172.21.15.63:0/2635698945 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff0bc04f9e0 0x7ff0bc051ea0 secure :-1 s=READY pgs=391 cs=0 l=1 rx=0x7ff0dc141a40 tx=0x7ff0cc008db0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:16.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.245+0000 7ff0daffd700 1 --2- 172.21.15.63:0/2635698945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0dc0b93f0 0x7ff0dc142130 secure :-1 s=THROTTLE_DONE pgs=977 cs=0 l=1 rx=0x7ff0dc06ab40 tx=0x7ff0d00013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.245+0000 7ff0d8ff9700 1 -- 172.21.15.63:0/2635698945 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff0d003da10 con 0x7ff0dc0b93f0 2020-05-18T21:31:16.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.393+0000 7ff0e0dd0700 1 -- 172.21.15.63:0/2635698945 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0dc0b6600 con 0x7ff0dc0b93f0 2020-05-18T21:31:16.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.393+0000 7ff0daffd700 1 --2- 172.21.15.63:0/2635698945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0dc0b93f0 0x7ff0dc142130 secure :-1 s=THROTTLE_DONE pgs=977 cs=0 l=1 rx=0x7ff0dc06ab40 tx=0x7ff0d00013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.393+0000 7ff0d8ff9700 1 -- 172.21.15.63:0/2635698945 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7ff0d0041030 con 0x7ff0dc0b93f0 2020-05-18T21:31:16.399 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:16.399 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:31:16.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.397+0000 7ff0e0dd0700 1 -- 172.21.15.63:0/2635698945 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff0bc04f9e0 msgr2=0x7ff0bc051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.397+0000 7ff0e0dd0700 1 --2- 172.21.15.63:0/2635698945 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff0bc04f9e0 0x7ff0bc051ea0 secure :-1 s=READY pgs=391 cs=0 l=1 rx=0x7ff0dc141a40 tx=0x7ff0cc008db0).stop 2020-05-18T21:31:16.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.397+0000 7ff0e0dd0700 1 -- 172.21.15.63:0/2635698945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0dc0b93f0 msgr2=0x7ff0dc142130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.397+0000 7ff0e0dd0700 1 --2- 172.21.15.63:0/2635698945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0dc0b93f0 0x7ff0dc142130 secure :-1 s=READY pgs=977 cs=0 l=1 rx=0x7ff0dc06ab40 tx=0x7ff0d00013e0).stop 2020-05-18T21:31:16.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.397+0000 7ff0e0dd0700 1 -- 172.21.15.63:0/2635698945 shutdown_connections 2020-05-18T21:31:16.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.397+0000 7ff0e0dd0700 1 --2- 172.21.15.63:0/2635698945 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff0bc04f9e0 0x7ff0bc051ea0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.397+0000 7ff0e0dd0700 1 --2- 172.21.15.63:0/2635698945 >> v2:172.21.15.155:3300/0 conn(0x7ff0dc1435a0 0x7ff0dc0b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.397+0000 7ff0e0dd0700 1 --2- 172.21.15.63:0/2635698945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0dc0b93f0 0x7ff0dc142130 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.397+0000 7ff0e0dd0700 1 -- 172.21.15.63:0/2635698945 >> 172.21.15.63:0/2635698945 conn(0x7ff0dc069b70 msgr2=0x7ff0dc061290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:16.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.397+0000 7ff0e0dd0700 1 -- 172.21.15.63:0/2635698945 shutdown_connections 2020-05-18T21:31:16.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.397+0000 7ff0e0dd0700 1 -- 172.21.15.63:0/2635698945 wait complete. 2020-05-18T21:31:16.404 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:31:16.417 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache 2020-05-18T21:31:16.514 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:16.515 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:31:16.515 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays": 0, 2020-05-18T21:31:16.515 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_delayed": 0, 2020-05-18T21:31:16.515 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:31:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_created": 3, 2020-05-18T21:31:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 1, 2020-05-18T21:31:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_reintegrated": 3, 2020-05-18T21:31:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_migrated": 0, 2020-05-18T21:31:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_processing": 0, 2020-05-18T21:31:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:31:16.517 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:31:16.517 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_started": 0, 2020-05-18T21:31:16.517 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_completed": 0, 2020-05-18T21:31:16.517 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:31:16.517 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_exportdir": 0, 2020-05-18T21:31:16.518 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_flush": 0, 2020-05-18T21:31:16.518 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragmentdir": 0, 2020-05-18T21:31:16.518 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragstats": 0, 2020-05-18T21:31:16.518 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_inodestats": 0 2020-05-18T21:31:16.518 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:16.519 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:16.523 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "strays_created": 3, "strays_enqueued": 1, "strays_reintegrated": 3, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0 } } 2020-05-18T21:31:16.523 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:16.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf189ad700 1 Processor -- start 2020-05-18T21:31:16.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf189ad700 1 -- start start 2020-05-18T21:31:16.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf189ad700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf14149d90 0x7fbf14066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:16.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf189ad700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbf1406a280 0x7fbf140b5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:16.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf189ad700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbf140b5ad0 0x7fbf140b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:16.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf189ad700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf140b79c0 con 0x7fbf140b5ad0 2020-05-18T21:31:16.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf189ad700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf140b7e90 con 0x7fbf1406a280 2020-05-18T21:31:16.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf189ad700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf140b7bf0 con 0x7fbf14149d90 2020-05-18T21:31:16.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf12d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbf140b5ad0 0x7fbf140b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf12d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbf140b5ad0 0x7fbf140b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57908/0 (socket says 172.21.15.63:57908) 2020-05-18T21:31:16.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf12d9d700 1 -- 172.21.15.63:0/4054855406 learned_addr learned my addr 172.21.15.63:0/4054855406 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:16.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf1259c700 1 --2- 172.21.15.63:0/4054855406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf14149d90 0x7fbf14066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf11d9b700 1 --2- 172.21.15.63:0/4054855406 >> v2:172.21.15.155:3300/0 conn(0x7fbf1406a280 0x7fbf140b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf12d9d700 1 -- 172.21.15.63:0/4054855406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf14149d90 msgr2=0x7fbf14066f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:16.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf12d9d700 1 --2- 172.21.15.63:0/4054855406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf14149d90 0x7fbf14066f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:16.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf12d9d700 1 -- 172.21.15.63:0/4054855406 >> v2:172.21.15.155:3300/0 conn(0x7fbf1406a280 msgr2=0x7fbf140b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:16.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf12d9d700 1 --2- 172.21.15.63:0/4054855406 >> v2:172.21.15.155:3300/0 conn(0x7fbf1406a280 0x7fbf140b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:16.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf12d9d700 1 -- 172.21.15.63:0/4054855406 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf14061c00 con 0x7fbf140b5ad0 2020-05-18T21:31:16.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf1259c700 1 --2- 172.21.15.63:0/4054855406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf14149d90 0x7fbf14066f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:31:16.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf11d9b700 1 --2- 172.21.15.63:0/4054855406 >> v2:172.21.15.155:3300/0 conn(0x7fbf1406a280 0x7fbf140b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:31:16.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf12d9d700 1 --2- 172.21.15.63:0/4054855406 >> v2:172.21.15.63:3300/0 conn(0x7fbf140b5ad0 0x7fbf140b67a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbf0c002f70 tx=0x7fbf0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf12d9d700 1 --2- 172.21.15.63:0/4054855406 >> v2:172.21.15.63:3300/0 conn(0x7fbf140b5ad0 0x7fbf140b67a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbf0c002f70 tx=0x7fbf0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf12d9d700 1 --2- 172.21.15.63:0/4054855406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf140b5ad0 0x7fbf140b67a0 secure :-1 s=READY pgs=978 cs=0 l=1 rx=0x7fbf0c002f70 tx=0x7fbf0c007a80).ready entity=mon.0 client_cookie=db13801d4e35923c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:16.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf12d9d700 1 --2- 172.21.15.63:0/4054855406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf140b5ad0 0x7fbf140b67a0 secure :-1 s=THROTTLE_DONE pgs=978 cs=0 l=1 rx=0x7fbf0c002f70 tx=0x7fbf0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf1159a700 1 -- 172.21.15.63:0/4054855406 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf0c011760 con 0x7fbf140b5ad0 2020-05-18T21:31:16.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf12d9d700 1 --2- 172.21.15.63:0/4054855406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf140b5ad0 0x7fbf140b67a0 secure :-1 s=THROTTLE_DONE pgs=978 cs=0 l=1 rx=0x7fbf0c002f70 tx=0x7fbf0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf1159a700 1 -- 172.21.15.63:0/4054855406 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0118c0 con 0x7fbf140b5ad0 2020-05-18T21:31:16.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf12d9d700 1 --2- 172.21.15.63:0/4054855406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf140b5ad0 0x7fbf140b67a0 secure :-1 s=THROTTLE_DONE pgs=978 cs=0 l=1 rx=0x7fbf0c002f70 tx=0x7fbf0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf1159a700 1 -- 172.21.15.63:0/4054855406 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf0c011ce0 con 0x7fbf140b5ad0 2020-05-18T21:31:16.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf189ad700 1 -- 172.21.15.63:0/4054855406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf140b5ad0 msgr2=0x7fbf140b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.621+0000 7fbf189ad700 1 --2- 172.21.15.63:0/4054855406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf140b5ad0 0x7fbf140b67a0 secure :-1 s=READY pgs=978 cs=0 l=1 rx=0x7fbf0c002f70 tx=0x7fbf0c007a80).stop 2020-05-18T21:31:16.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.625+0000 7fbf189ad700 1 -- 172.21.15.63:0/4054855406 shutdown_connections 2020-05-18T21:31:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.625+0000 7fbf189ad700 1 --2- 172.21.15.63:0/4054855406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf140b5ad0 0x7fbf140b67a0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.625+0000 7fbf189ad700 1 --2- 172.21.15.63:0/4054855406 >> v2:172.21.15.155:3300/0 conn(0x7fbf1406a280 0x7fbf140b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.625+0000 7fbf189ad700 1 --2- 172.21.15.63:0/4054855406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf14149d90 0x7fbf14066f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.625+0000 7fbf189ad700 1 -- 172.21.15.63:0/4054855406 >> 172.21.15.63:0/4054855406 conn(0x7fbf1405b240 msgr2=0x7fbf14069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.625+0000 7fbf189ad700 1 -- 172.21.15.63:0/4054855406 shutdown_connections 2020-05-18T21:31:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.625+0000 7fbf189ad700 1 -- 172.21.15.63:0/4054855406 wait complete. 2020-05-18T21:31:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.625+0000 7fbf189ad700 1 Processor -- start 2020-05-18T21:31:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.625+0000 7fbf189ad700 1 -- start start 2020-05-18T21:31:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.625+0000 7fbf189ad700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbf14149d90 0x7fbf1415b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.625+0000 7fbf189ad700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf14157a40 con 0x7fbf140b5ad0 2020-05-18T21:31:16.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.625+0000 7fbf189ad700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf14157ce0 con 0x7fbf1406a280 2020-05-18T21:31:16.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.625+0000 7fbf189ad700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf14157f80 con 0x7fbf14149d90 2020-05-18T21:31:16.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.625+0000 7fbf11d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbf140b5ad0 0x7fbf14157250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60104/0 (socket says 172.21.15.63:60104) 2020-05-18T21:31:16.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.625+0000 7fbf11d9b700 1 -- 172.21.15.63:0/2610620744 learned_addr learned my addr 172.21.15.63:0/2610620744 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf12d9d700 1 --2- 172.21.15.63:0/2610620744 >> v2:172.21.15.155:3300/0 conn(0x7fbf14149d90 0x7fbf1415b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf0b7fe700 1 -- 172.21.15.63:0/2610620744 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671486039 0 0) 0x7fbf14157a40 con 0x7fbf140b5ad0 2020-05-18T21:31:16.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf0b7fe700 1 -- 172.21.15.63:0/2610620744 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeec002fe0 con 0x7fbf140b5ad0 2020-05-18T21:31:16.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf0b7fe700 1 -- 172.21.15.63:0/2610620744 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 204690461 0 0) 0x7fbeec002fe0 con 0x7fbf140b5ad0 2020-05-18T21:31:16.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf0b7fe700 1 -- 172.21.15.63:0/2610620744 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbf14157a40 con 0x7fbf140b5ad0 2020-05-18T21:31:16.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf0b7fe700 1 -- 172.21.15.63:0/2610620744 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fbefc002710 con 0x7fbf140b5ad0 2020-05-18T21:31:16.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf0b7fe700 1 -- 172.21.15.63:0/2610620744 >> v2:172.21.15.155:3300/0 conn(0x7fbf14149d90 msgr2=0x7fbf1415b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf0b7fe700 1 --2- 172.21.15.63:0/2610620744 >> v2:172.21.15.155:3300/0 conn(0x7fbf14149d90 0x7fbf1415b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf0b7fe700 1 -- 172.21.15.63:0/2610620744 >> v1:172.21.15.155:6789/0 conn(0x7fbf1406a280 legacy=0x7fbf14156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf0b7fe700 1 -- 172.21.15.63:0/2610620744 >> v1:172.21.15.63:6789/0 conn(0x7fbf140b5ad0 legacy=0x7fbf14157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf0b7fe700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeec004a80 0x7fbeec004e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:16.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf0b7fe700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeec0039a0 0x7fbeec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf0b7fe700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbeec004240 0x7fbeec00b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf0b7fe700 1 -- 172.21.15.63:0/2610620744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf14157f80 con 0x7fbeec0039a0 2020-05-18T21:31:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf0b7fe700 1 -- 172.21.15.63:0/2610620744 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec004850 con 0x7fbeec004240 2020-05-18T21:31:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf0b7fe700 1 -- 172.21.15.63:0/2610620744 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec00bc40 con 0x7fbeec004a80 2020-05-18T21:31:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf12d9d700 1 --2- 172.21.15.63:0/2610620744 >> v2:172.21.15.155:3300/0 conn(0x7fbf14149d90 0x7fbf1415b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:31:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf11d9b700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeec0039a0 0x7fbeec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf1259c700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeec004a80 0x7fbeec004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf12d9d700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbeec004240 0x7fbeec00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf11d9b700 1 -- 172.21.15.63:0/2610620744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeec004a80 msgr2=0x7fbeec004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf11d9b700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeec004a80 0x7fbeec004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf11d9b700 1 -- 172.21.15.63:0/2610620744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbeec004240 msgr2=0x7fbeec00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf11d9b700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbeec004240 0x7fbeec00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf11d9b700 1 -- 172.21.15.63:0/2610620744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf140b20a0 con 0x7fbeec0039a0 2020-05-18T21:31:16.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf189ad700 1 -- 172.21.15.63:0/2610620744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf14158420 con 0x7fbeec0039a0 2020-05-18T21:31:16.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf11d9b700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeec0039a0 0x7fbeec003de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbefc0024a0 tx=0x7fbefc0116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf12d9d700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbeec004240 0x7fbeec00b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:31:16.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf12d9d700 1 -- 172.21.15.63:0/2610620744 reap_dead start 2020-05-18T21:31:16.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf11d9b700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeec0039a0 0x7fbeec003de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbefc0024a0 tx=0x7fbefc0116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf189ad700 1 -- 172.21.15.63:0/2610620744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1415b780 con 0x7fbeec0039a0 2020-05-18T21:31:16.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf11d9b700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeec0039a0 0x7fbeec003de0 secure :-1 s=READY pgs=980 cs=0 l=1 rx=0x7fbefc0024a0 tx=0x7fbefc0116c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:16.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf11d9b700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeec0039a0 0x7fbeec003de0 secure :-1 s=THROTTLE_DONE pgs=980 cs=0 l=1 rx=0x7fbefc0024a0 tx=0x7fbefc0116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf11d9b700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeec0039a0 0x7fbeec003de0 secure :-1 s=THROTTLE_DONE pgs=980 cs=0 l=1 rx=0x7fbefc0024a0 tx=0x7fbefc0116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf11d9b700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeec0039a0 0x7fbeec003de0 secure :-1 s=THROTTLE_DONE pgs=980 cs=0 l=1 rx=0x7fbefc0024a0 tx=0x7fbefc0116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf0b7fe700 1 -- 172.21.15.63:0/2610620744 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbefc007180 con 0x7fbeec0039a0 2020-05-18T21:31:16.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf0b7fe700 1 -- 172.21.15.63:0/2610620744 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbefc0072e0 con 0x7fbeec0039a0 2020-05-18T21:31:16.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf0b7fe700 1 -- 172.21.15.63:0/2610620744 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbefc007a10 con 0x7fbeec0039a0 2020-05-18T21:31:16.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf11d9b700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeec0039a0 0x7fbeec003de0 secure :-1 s=THROTTLE_DONE pgs=980 cs=0 l=1 rx=0x7fbefc0024a0 tx=0x7fbefc0116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf189ad700 1 -- 172.21.15.63:0/2610620744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef0003380 con 0x7fbeec0039a0 2020-05-18T21:31:16.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf0b7fe700 1 -- 172.21.15.63:0/2610620744 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fbefc007b70 con 0x7fbeec0039a0 2020-05-18T21:31:16.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.629+0000 7fbf11d9b700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeec0039a0 0x7fbeec003de0 secure :-1 s=THROTTLE_DONE pgs=980 cs=0 l=1 rx=0x7fbefc0024a0 tx=0x7fbefc0116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.633+0000 7fbf0b7fe700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbeec053a50 0x7fbeec055f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:16.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.633+0000 7fbf0b7fe700 1 -- 172.21.15.63:0/2610620744 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fbefc064740 con 0x7fbeec0039a0 2020-05-18T21:31:16.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.633+0000 7fbf1259c700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbeec053a50 0x7fbeec055f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.633+0000 7fbf1259c700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbeec053a50 0x7fbeec055f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf14158300 tx=0x7fbf04003330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.633+0000 7fbf1259c700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbeec053a50 0x7fbeec055f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf14158300 tx=0x7fbf04003330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.633+0000 7fbf1259c700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbeec053a50 0x7fbeec055f10 secure :-1 s=READY pgs=392 cs=0 l=1 rx=0x7fbf14158300 tx=0x7fbf04003330).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:16.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.637+0000 7fbf11d9b700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeec0039a0 0x7fbeec003de0 secure :-1 s=THROTTLE_DONE pgs=980 cs=0 l=1 rx=0x7fbefc0024a0 tx=0x7fbefc0116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.637+0000 7fbf0b7fe700 1 -- 172.21.15.63:0/2610620744 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fbefc03ead0 con 0x7fbeec0039a0 2020-05-18T21:31:16.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.781+0000 7fbf189ad700 1 -- 172.21.15.63:0/2610620744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbef0003720 con 0x7fbeec0039a0 2020-05-18T21:31:16.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.781+0000 7fbf11d9b700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeec0039a0 0x7fbeec003de0 secure :-1 s=THROTTLE_DONE pgs=980 cs=0 l=1 rx=0x7fbefc0024a0 tx=0x7fbefc0116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.781+0000 7fbf0b7fe700 1 -- 172.21.15.63:0/2610620744 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7fbefc0420f0 con 0x7fbeec0039a0 2020-05-18T21:31:16.787 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:16.787 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:31:16.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.785+0000 7fbf189ad700 1 -- 172.21.15.63:0/2610620744 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbeec053a50 msgr2=0x7fbeec055f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.785+0000 7fbf189ad700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbeec053a50 0x7fbeec055f10 secure :-1 s=READY pgs=392 cs=0 l=1 rx=0x7fbf14158300 tx=0x7fbf04003330).stop 2020-05-18T21:31:16.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.785+0000 7fbf189ad700 1 -- 172.21.15.63:0/2610620744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeec0039a0 msgr2=0x7fbeec003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.785+0000 7fbf189ad700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeec0039a0 0x7fbeec003de0 secure :-1 s=READY pgs=980 cs=0 l=1 rx=0x7fbefc0024a0 tx=0x7fbefc0116c0).stop 2020-05-18T21:31:16.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.785+0000 7fbf189ad700 1 -- 172.21.15.63:0/2610620744 shutdown_connections 2020-05-18T21:31:16.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.785+0000 7fbf189ad700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbeec053a50 0x7fbeec055f10 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.785+0000 7fbf189ad700 1 --2- 172.21.15.63:0/2610620744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeec0039a0 0x7fbeec003de0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.785+0000 7fbf189ad700 1 -- 172.21.15.63:0/2610620744 >> 172.21.15.63:0/2610620744 conn(0x7fbf1405b240 msgr2=0x7fbf14148a30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:16.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.785+0000 7fbf189ad700 1 -- 172.21.15.63:0/2610620744 shutdown_connections 2020-05-18T21:31:16.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.785+0000 7fbf189ad700 1 -- 172.21.15.63:0/2610620744 wait complete. 2020-05-18T21:31:16.791 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:31:16.802 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump purge_queue 2020-05-18T21:31:16.904 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:16.904 INFO:teuthology.orchestra.run.smithi063.stdout: "purge_queue": { 2020-05-18T21:31:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops": 0, 2020-05-18T21:31:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops_high_water": 3, 2020-05-18T21:31:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing": 0, 2020-05-18T21:31:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_high_water": 1, 2020-05-18T21:31:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executed": 1, 2020-05-18T21:31:16.906 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_item_in_journal": 0 2020-05-18T21:31:16.906 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:16.906 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:16.912 INFO:tasks.cephfs.filesystem:_json_asok output: { "purge_queue": { "pq_executing_ops": 0, "pq_executing_ops_high_water": 3, "pq_executing": 0, "pq_executing_high_water": 1, "pq_executed": 1, "pq_item_in_journal": 0 } } 2020-05-18T21:31:16.915 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_data ls 2020-05-18T21:31:16.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.937+0000 7f7d8101db80 1 Processor -- start 2020-05-18T21:31:16.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.937+0000 7f7d8101db80 1 -- start start 2020-05-18T21:31:16.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.937+0000 7f7d8101db80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x560efa76c670 0x560efa789ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:16.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.937+0000 7f7d8101db80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x560efa818a60 0x560efa819ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:16.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.937+0000 7f7d8101db80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x560efa6e84b0 con 0x560efa818680 2020-05-18T21:31:16.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.937+0000 7f7d8101db80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x560efa6d4110 con 0x560efa818a60 2020-05-18T21:31:16.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.937+0000 7f7d8101db80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x560efa6c4a40 con 0x560efa76c670 2020-05-18T21:31:16.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.937+0000 7f7d7ec5f700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x560efa818680 0x560efa81c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60122/0 (socket says 172.21.15.63:60122) 2020-05-18T21:31:16.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.937+0000 7f7d7ec5f700 1 -- 172.21.15.63:0/4239930905 learned_addr learned my addr 172.21.15.63:0/4239930905 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:16.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.937+0000 7f7d7f460700 1 --2- 172.21.15.63:0/4239930905 >> v2:172.21.15.155:3300/0 conn(0x560efa76c670 0x560efa789ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.937+0000 7f7d7fc61700 1 --2- 172.21.15.63:0/4239930905 >> v2:172.21.15.63:3300/0 conn(0x560efa818a60 0x560efa819ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.937+0000 7f7d7f460700 1 -- 172.21.15.63:0/4239930905 >> v2:172.21.15.63:3300/0 conn(0x560efa818a60 msgr2=0x560efa819ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:16.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d7f460700 1 --2- 172.21.15.63:0/4239930905 >> v2:172.21.15.63:3300/0 conn(0x560efa818a60 0x560efa819ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:16.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d7f460700 1 -- 172.21.15.63:0/4239930905 >> v1:172.21.15.63:6789/0 conn(0x560efa818680 legacy=0x560efa81c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.937+0000 7f7d7d45c700 1 -- 172.21.15.63:0/4239930905 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663695823 0 0) 0x560efa6e84b0 con 0x560efa818680 2020-05-18T21:31:16.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d7f460700 1 -- 172.21.15.63:0/4239930905 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560efa6c8460 con 0x560efa76c670 2020-05-18T21:31:16.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d7f460700 1 --2- 172.21.15.63:0/4239930905 >> v2:172.21.15.155:3300/0 conn(0x560efa76c670 0x560efa789ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7d70002f70 tx=0x7f7d700066a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d7f460700 1 --2- 172.21.15.63:0/4239930905 >> v2:172.21.15.155:3300/0 conn(0x560efa76c670 0x560efa789ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7d70002f70 tx=0x7f7d700066a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d7f460700 1 --2- 172.21.15.63:0/4239930905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560efa76c670 0x560efa789ff0 secure :-1 s=READY pgs=687 cs=0 l=1 rx=0x7f7d70002f70 tx=0x7f7d700066a0).ready entity=mon.1 client_cookie=e705ad97af7c7366 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:16.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d7f460700 1 --2- 172.21.15.63:0/4239930905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560efa76c670 0x560efa789ff0 secure :-1 s=THROTTLE_DONE pgs=687 cs=0 l=1 rx=0x7f7d70002f70 tx=0x7f7d700066a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d7d45c700 1 -- 172.21.15.63:0/4239930905 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d70004a70 con 0x560efa76c670 2020-05-18T21:31:16.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d7f460700 1 --2- 172.21.15.63:0/4239930905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560efa76c670 0x560efa789ff0 secure :-1 s=THROTTLE_DONE pgs=687 cs=0 l=1 rx=0x7f7d70002f70 tx=0x7f7d700066a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d7f460700 1 --2- 172.21.15.63:0/4239930905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560efa76c670 0x560efa789ff0 secure :-1 s=THROTTLE_DONE pgs=687 cs=0 l=1 rx=0x7f7d70002f70 tx=0x7f7d700066a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d7d45c700 1 -- 172.21.15.63:0/4239930905 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d70004bd0 con 0x560efa76c670 2020-05-18T21:31:16.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d7d45c700 1 -- 172.21.15.63:0/4239930905 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d7000e170 con 0x560efa76c670 2020-05-18T21:31:16.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d8101db80 1 -- 172.21.15.63:0/4239930905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560efa76c670 msgr2=0x560efa789ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d8101db80 1 --2- 172.21.15.63:0/4239930905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560efa76c670 0x560efa789ff0 secure :-1 s=READY pgs=687 cs=0 l=1 rx=0x7f7d70002f70 tx=0x7f7d700066a0).stop 2020-05-18T21:31:16.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d8101db80 1 -- 172.21.15.63:0/4239930905 shutdown_connections 2020-05-18T21:31:16.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d8101db80 1 --2- 172.21.15.63:0/4239930905 >> v2:172.21.15.63:3300/0 conn(0x560efa818a60 0x560efa819ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:16.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d8101db80 1 --2- 172.21.15.63:0/4239930905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560efa76c670 0x560efa789ff0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d8101db80 1 -- 172.21.15.63:0/4239930905 >> 172.21.15.63:0/4239930905 conn(0x560efa78b850 msgr2=0x560efa78ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:16.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d8101db80 1 -- 172.21.15.63:0/4239930905 shutdown_connections 2020-05-18T21:31:16.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.941+0000 7f7d8101db80 1 -- 172.21.15.63:0/4239930905 wait complete. 2020-05-18T21:31:16.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d8101db80 1 Processor -- start 2020-05-18T21:31:16.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d8101db80 1 -- start start 2020-05-18T21:31:16.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d8101db80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560efa76c670 0x560efa80fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:16.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d8101db80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x560efa8170c0 con 0x560efa818a60 2020-05-18T21:31:16.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d8101db80 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x560efa8143d0 con 0x560efa818680 2020-05-18T21:31:16.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d8101db80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x560efa814670 con 0x560efa76c670 2020-05-18T21:31:16.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7fc61700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x560efa818a60 0x560efa81c140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60130/0 (socket says 172.21.15.63:60130) 2020-05-18T21:31:16.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7fc61700 1 -- 172.21.15.63:0/2771086812 learned_addr learned my addr 172.21.15.63:0/2771086812 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:16.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7f460700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560efa76c670 0x560efa80fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7cc5b700 1 -- 172.21.15.63:0/2771086812 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780877806 0 0) 0x560efa8170c0 con 0x560efa818a60 2020-05-18T21:31:16.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7cc5b700 1 -- 172.21.15.63:0/2771086812 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d60002020 con 0x560efa818a60 2020-05-18T21:31:16.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7cc5b700 1 -- 172.21.15.63:0/2771086812 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053098032 0 0) 0x560efa8143d0 con 0x560efa818680 2020-05-18T21:31:16.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7cc5b700 1 -- 172.21.15.63:0/2771086812 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x560efa8170c0 con 0x560efa818680 2020-05-18T21:31:16.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7cc5b700 1 -- 172.21.15.63:0/2771086812 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2005711740 0 0) 0x7f7d60002020 con 0x560efa818a60 2020-05-18T21:31:16.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7cc5b700 1 -- 172.21.15.63:0/2771086812 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x560efa8143d0 con 0x560efa818a60 2020-05-18T21:31:16.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7cc5b700 1 -- 172.21.15.63:0/2771086812 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f7d78003450 con 0x560efa818a60 2020-05-18T21:31:16.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7cc5b700 1 -- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560efa76c670 msgr2=0x560efa80fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7cc5b700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560efa76c670 0x560efa80fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7cc5b700 1 -- 172.21.15.63:0/2771086812 >> v1:172.21.15.155:6789/0 conn(0x560efa818680 legacy=0x560efa80e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7cc5b700 1 -- 172.21.15.63:0/2771086812 >> v1:172.21.15.63:6789/0 conn(0x560efa818a60 legacy=0x560efa81c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7cc5b700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560efa76c670 0x7f7d60003800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:16.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7cc5b700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d60003c60 0x7f7d600027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:16.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7cc5b700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d60002c30 0x7f7d600030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:16.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7cc5b700 1 -- 172.21.15.63:0/2771086812 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x560efa814670 con 0x7f7d60003c60 2020-05-18T21:31:16.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7cc5b700 1 -- 172.21.15.63:0/2771086812 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d60003510 con 0x7f7d60002c30 2020-05-18T21:31:16.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7cc5b700 1 -- 172.21.15.63:0/2771086812 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6000a470 con 0x560efa76c670 2020-05-18T21:31:16.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7ec5f700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d60003c60 0x7f7d600027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7f460700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560efa76c670 0x7f7d60003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7fc61700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d60002c30 0x7f7d600030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7ec5f700 1 -- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560efa76c670 msgr2=0x7f7d60003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7ec5f700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560efa76c670 0x7f7d60003800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7ec5f700 1 -- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d60002c30 msgr2=0x7f7d600030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7ec5f700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d60002c30 0x7f7d600030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d7ec5f700 1 -- 172.21.15.63:0/2771086812 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560efa814910 con 0x7f7d60003c60 2020-05-18T21:31:16.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.945+0000 7f7d8101db80 1 -- 172.21.15.63:0/2771086812 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560efa814050 con 0x7f7d60003c60 2020-05-18T21:31:16.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7ec5f700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d60003c60 0x7f7d600027d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d68006ec0 tx=0x560efa7494c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7fc61700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d60002c30 0x7f7d600030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:31:16.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d8101db80 1 -- 172.21.15.63:0/2771086812 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560efa817700 con 0x7f7d60003c60 2020-05-18T21:31:16.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7ec5f700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d60003c60 0x7f7d600027d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d68006ec0 tx=0x560efa7494c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7ec5f700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d60003c60 0x7f7d600027d0 secure :-1 s=READY pgs=985 cs=0 l=1 rx=0x7f7d68006ec0 tx=0x560efa7494c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:16.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7ec5f700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d60003c60 0x7f7d600027d0 secure :-1 s=THROTTLE_DONE pgs=985 cs=0 l=1 rx=0x7f7d68006ec0 tx=0x560efa7494c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7cc5b700 1 -- 172.21.15.63:0/2771086812 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d68005e00 con 0x7f7d60003c60 2020-05-18T21:31:16.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7ec5f700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d60003c60 0x7f7d600027d0 secure :-1 s=THROTTLE_DONE pgs=985 cs=0 l=1 rx=0x7f7d68006ec0 tx=0x560efa7494c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7ec5f700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d60003c60 0x7f7d600027d0 secure :-1 s=THROTTLE_DONE pgs=985 cs=0 l=1 rx=0x7f7d68006ec0 tx=0x560efa7494c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7cc5b700 1 -- 172.21.15.63:0/2771086812 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d68005f60 con 0x7f7d60003c60 2020-05-18T21:31:16.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7cc5b700 1 -- 172.21.15.63:0/2771086812 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d68007530 con 0x7f7d60003c60 2020-05-18T21:31:16.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7ec5f700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d60003c60 0x7f7d600027d0 secure :-1 s=THROTTLE_DONE pgs=985 cs=0 l=1 rx=0x7f7d68006ec0 tx=0x560efa7494c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7cc5b700 1 -- 172.21.15.63:0/2771086812 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7d68007690 con 0x7f7d60003c60 2020-05-18T21:31:16.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7ec5f700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d60003c60 0x7f7d600027d0 secure :-1 s=THROTTLE_DONE pgs=985 cs=0 l=1 rx=0x7f7d68006ec0 tx=0x560efa7494c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7cc5b700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7d60056a60 0x7f7d60058f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:16.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7cc5b700 1 -- 172.21.15.63:0/2771086812 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f7d68062a90 con 0x7f7d60003c60 2020-05-18T21:31:16.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d8101db80 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x560efa81c850 0x560efa81cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:16.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d8101db80 1 -- 172.21.15.63:0/2771086812 --> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] -- osd_op(unknown.0.0:1 14.0 14:00000000::::head [pgnls start_epoch 75 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e75) v8 -- 0x560efa810190 con 0x560efa81c850 2020-05-18T21:31:16.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7f460700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7d60056a60 0x7f7d60058f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7fc61700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x560efa81c850 0x560efa81cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7f460700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7d60056a60 0x7f7d60058f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d70002f70 tx=0x7f7d700066a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7f460700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7d60056a60 0x7f7d60058f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d70002f70 tx=0x7f7d700066a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:16.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7f460700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7d60056a60 0x7f7d60058f20 secure :-1 s=READY pgs=393 cs=0 l=1 rx=0x7f7d70002f70 tx=0x7f7d700066a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:16.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.949+0000 7f7d7fc61700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x560efa81c850 0x560efa81cc30 crc :-1 s=READY pgs=13 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:16.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.953+0000 7f7d7fc61700 1 -- 172.21.15.63:0/2771086812 <== osd.2 v2:172.21.15.63:6822/12806 1 ==== osd_op_reply(1 [pgnls start_epoch 75 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7d78003ef0 con 0x560efa81c850 2020-05-18T21:31:16.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.953+0000 7f7d7fc61700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f7d780049f0 0x7f7d78008060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:16.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.953+0000 7f7d7fc61700 1 -- 172.21.15.63:0/2771086812 --> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] -- osd_op(unknown.0.0:2 14.4 14:20000000::::head [pgnls start_epoch 75 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e75) v8 -- 0x560efa810190 con 0x7f7d780049f0 2020-05-18T21:31:16.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.953+0000 7f7d7f460700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f7d780049f0 0x7f7d78008060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.953+0000 7f7d7f460700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f7d780049f0 0x7f7d78008060 crc :-1 s=READY pgs=19 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:16.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.953+0000 7f7d7f460700 1 -- 172.21.15.63:0/2771086812 <== osd.6 v2:172.21.15.155:6815/13025 1 ==== osd_op_reply(2 [pgnls start_epoch 75 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7d70013070 con 0x7f7d780049f0 2020-05-18T21:31:16.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.953+0000 7f7d7f460700 1 -- 172.21.15.63:0/2771086812 --> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] -- osd_op(unknown.0.0:3 14.2 14:40000000::::head [pgnls start_epoch 75 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e75) v8 -- 0x560efa810190 con 0x7f7d780049f0 2020-05-18T21:31:16.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.953+0000 7f7d7f460700 1 -- 172.21.15.63:0/2771086812 <== osd.6 v2:172.21.15.155:6815/13025 2 ==== osd_op_reply(3 [pgnls start_epoch 75 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7d70013070 con 0x7f7d780049f0 2020-05-18T21:31:16.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.953+0000 7f7d7f460700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f7d700090b0 0x7f7d70012390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:16.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.953+0000 7f7d7f460700 1 -- 172.21.15.63:0/2771086812 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- osd_op(unknown.0.0:4 14.6 14:60000000::::head [pgnls start_epoch 75 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e75) v8 -- 0x560efa810190 con 0x7f7d700090b0 2020-05-18T21:31:16.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.957+0000 7f7d7ec5f700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f7d700090b0 0x7f7d70012390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.957+0000 7f7d7ec5f700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f7d700090b0 0x7f7d70012390 crc :-1 s=READY pgs=23 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:16.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.957+0000 7f7d7ec5f700 1 -- 172.21.15.63:0/2771086812 <== osd.0 v2:172.21.15.63:6800/12803 1 ==== osd_op_reply(4 [pgnls start_epoch 75 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7d6803ef40 con 0x7f7d700090b0 2020-05-18T21:31:16.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.957+0000 7f7d7ec5f700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7f7d68040090 0x7f7d6803fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:16.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.957+0000 7f7d7ec5f700 1 -- 172.21.15.63:0/2771086812 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- osd_op(unknown.0.0:5 14.1 14:80000000::::head [pgnls start_epoch 75 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e75) v8 -- 0x560efa810190 con 0x7f7d68040090 2020-05-18T21:31:16.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.957+0000 7f7d7fc61700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7f7d68040090 0x7f7d6803fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.957+0000 7f7d7fc61700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7f7d68040090 0x7f7d6803fb00 crc :-1 s=READY pgs=17 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:16.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.957+0000 7f7d7fc61700 1 -- 172.21.15.63:0/2771086812 <== osd.3 v2:172.21.15.63:6814/12805 1 ==== osd_op_reply(5 [pgnls start_epoch 75 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7d78003ef0 con 0x7f7d68040090 2020-05-18T21:31:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.957+0000 7f7d7fc61700 1 -- 172.21.15.63:0/2771086812 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- osd_op(unknown.0.0:6 14.5 14:a0000000::::head [pgnls start_epoch 75 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e75) v8 -- 0x560efa810190 con 0x7f7d700090b0 2020-05-18T21:31:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.957+0000 7f7d7ec5f700 1 -- 172.21.15.63:0/2771086812 <== osd.0 v2:172.21.15.63:6800/12803 2 ==== osd_op_reply(6 [pgnls start_epoch 75 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7d6803ef40 con 0x7f7d700090b0 2020-05-18T21:31:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.957+0000 7f7d7ec5f700 1 -- 172.21.15.63:0/2771086812 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- osd_op(unknown.0.0:7 14.3 14:c0000000::::head [pgnls start_epoch 75 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e75) v8 -- 0x560efa810190 con 0x7f7d700090b0 2020-05-18T21:31:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d7ec5f700 1 -- 172.21.15.63:0/2771086812 <== osd.0 v2:172.21.15.63:6800/12803 3 ==== osd_op_reply(7 [pgnls start_epoch 75 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7d6803ef40 con 0x7f7d700090b0 2020-05-18T21:31:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d7ec5f700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f7d6801d880 0x7f7d6803c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:16.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d7ec5f700 1 -- 172.21.15.63:0/2771086812 --> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] -- osd_op(unknown.0.0:8 14.7 14:e0000000::::head [pgnls start_epoch 75 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e75) v8 -- 0x560efa810190 con 0x7f7d6801d880 2020-05-18T21:31:16.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d7f460700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f7d6801d880 0x7f7d6803c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:16.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d7f460700 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f7d6801d880 0x7f7d6803c0b0 crc :-1 s=READY pgs=25 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:16.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d7f460700 1 -- 172.21.15.63:0/2771086812 <== osd.5 v2:172.21.15.155:6808/13024 1 ==== osd_op_reply(8 [pgnls start_epoch 75 out=49b] v75'9 uv9 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7d70013070 con 0x7f7d6801d880 2020-05-18T21:31:16.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d8101db80 1 -- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f7d700090b0 msgr2=0x7f7d70012390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d8101db80 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f7d700090b0 0x7f7d70012390 crc :-1 s=READY pgs=23 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d8101db80 1 -- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x560efa81c850 msgr2=0x560efa81cc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d7fc61700 1 -- 172.21.15.63:0/2771086812 reap_dead start 2020-05-18T21:31:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d8101db80 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x560efa81c850 0x560efa81cc30 crc :-1 s=READY pgs=13 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d8101db80 1 -- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7f7d68040090 msgr2=0x7f7d6803fb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d8101db80 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7f7d68040090 0x7f7d6803fb00 crc :-1 s=READY pgs=17 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d8101db80 1 -- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f7d6801d880 msgr2=0x7f7d6803c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d8101db80 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f7d6801d880 0x7f7d6803c0b0 crc :-1 s=READY pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d8101db80 1 -- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f7d780049f0 msgr2=0x7f7d78008060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d8101db80 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f7d780049f0 0x7f7d78008060 crc :-1 s=READY pgs=19 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d8101db80 1 -- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7d60056a60 msgr2=0x7f7d60058f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d8101db80 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7d60056a60 0x7f7d60058f20 secure :-1 s=READY pgs=393 cs=0 l=1 rx=0x7f7d70002f70 tx=0x7f7d700066a0).stop 2020-05-18T21:31:16.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d8101db80 1 -- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d60003c60 msgr2=0x7f7d600027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:16.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d8101db80 1 --2- 172.21.15.63:0/2771086812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d60003c60 0x7f7d600027d0 secure :-1 s=READY pgs=985 cs=0 l=1 rx=0x7f7d68006ec0 tx=0x560efa7494c0).stop 2020-05-18T21:31:16.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d7fc61700 1 -- 172.21.15.63:0/2771086812 reap_dead start 2020-05-18T21:31:16.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d8101db80 1 -- 172.21.15.63:0/2771086812 shutdown_connections 2020-05-18T21:31:16.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d8101db80 1 -- 172.21.15.63:0/2771086812 >> 172.21.15.63:0/2771086812 conn(0x560efa78b850 msgr2=0x560efa78ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:16.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d8101db80 1 -- 172.21.15.63:0/2771086812 shutdown_connections 2020-05-18T21:31:16.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:16.961+0000 7f7d8101db80 1 -- 172.21.15.63:0/2771086812 wait complete. 2020-05-18T21:31:16.984 INFO:tasks.cephfs.filesystem:All objects for ino 1099511627777 size 8388608 are absent 2020-05-18T21:31:16.984 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:17.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.089+0000 7f6d697a4700 1 Processor -- start 2020-05-18T21:31:17.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.089+0000 7f6d697a4700 1 -- start start 2020-05-18T21:31:17.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.089+0000 7f6d697a4700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d64063ce0 0x7f6d64147140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:17.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.089+0000 7f6d697a4700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d641476c0 con 0x7f6d641435d0 2020-05-18T21:31:17.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.089+0000 7f6d697a4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d64147960 con 0x7f6d640ad180 2020-05-18T21:31:17.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.089+0000 7f6d697a4700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d64147c00 con 0x7f6d64063ce0 2020-05-18T21:31:17.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d63fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6d641435d0 0x7f6d6405edd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60152/0 (socket says 172.21.15.63:60152) 2020-05-18T21:31:17.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d63fff700 1 -- 172.21.15.63:0/1851362921 learned_addr learned my addr 172.21.15.63:0/1851362921 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:17.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d637fe700 1 --2- 172.21.15.63:0/1851362921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d64063ce0 0x7f6d64147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:17.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d62ffd700 1 -- 172.21.15.63:0/1851362921 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041999447 0 0) 0x7f6d641476c0 con 0x7f6d641435d0 2020-05-18T21:31:17.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d62ffd700 1 -- 172.21.15.63:0/1851362921 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d50003270 con 0x7f6d641435d0 2020-05-18T21:31:17.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d62ffd700 1 -- 172.21.15.63:0/1851362921 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727889247 0 0) 0x7f6d64147960 con 0x7f6d640ad180 2020-05-18T21:31:17.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d62ffd700 1 -- 172.21.15.63:0/1851362921 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d641476c0 con 0x7f6d640ad180 2020-05-18T21:31:17.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d637fe700 1 -- 172.21.15.63:0/1851362921 >> v1:172.21.15.155:6789/0 conn(0x7f6d640ad180 legacy=0x7f6d640ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:17.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d637fe700 1 -- 172.21.15.63:0/1851362921 >> v1:172.21.15.63:6789/0 conn(0x7f6d641435d0 legacy=0x7f6d6405edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:17.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d637fe700 1 -- 172.21.15.63:0/1851362921 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6405f4e0 con 0x7f6d64063ce0 2020-05-18T21:31:17.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d637fe700 1 --2- 172.21.15.63:0/1851362921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d64063ce0 0x7f6d64147140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6d58002f70 tx=0x7f6d58008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d637fe700 1 --2- 172.21.15.63:0/1851362921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d64063ce0 0x7f6d64147140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6d58002f70 tx=0x7f6d58008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d637fe700 1 --2- 172.21.15.63:0/1851362921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d64063ce0 0x7f6d64147140 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d58008920).ready entity=mon.2 client_cookie=5ed312e16bb0907 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:17.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d637fe700 1 --2- 172.21.15.63:0/1851362921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d64063ce0 0x7f6d64147140 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d58008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d62ffd700 1 -- 172.21.15.63:0/1851362921 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d58008e80 con 0x7f6d64063ce0 2020-05-18T21:31:17.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d637fe700 1 --2- 172.21.15.63:0/1851362921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d64063ce0 0x7f6d64147140 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d58008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d637fe700 1 --2- 172.21.15.63:0/1851362921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d64063ce0 0x7f6d64147140 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d58008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d62ffd700 1 -- 172.21.15.63:0/1851362921 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d58011580 con 0x7f6d64063ce0 2020-05-18T21:31:17.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d62ffd700 1 -- 172.21.15.63:0/1851362921 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d58011960 con 0x7f6d64063ce0 2020-05-18T21:31:17.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d697a4700 1 -- 172.21.15.63:0/1851362921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d64063ce0 msgr2=0x7f6d64147140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:17.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d697a4700 1 --2- 172.21.15.63:0/1851362921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d64063ce0 0x7f6d64147140 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d58008920).stop 2020-05-18T21:31:17.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d697a4700 1 -- 172.21.15.63:0/1851362921 shutdown_connections 2020-05-18T21:31:17.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d697a4700 1 --2- 172.21.15.63:0/1851362921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d64063ce0 0x7f6d64147140 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:17.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d697a4700 1 -- 172.21.15.63:0/1851362921 >> 172.21.15.63:0/1851362921 conn(0x7f6d64069fc0 msgr2=0x7f6d6406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:17.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d697a4700 1 -- 172.21.15.63:0/1851362921 shutdown_connections 2020-05-18T21:31:17.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.093+0000 7f6d697a4700 1 -- 172.21.15.63:0/1851362921 wait complete. 2020-05-18T21:31:17.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.097+0000 7f6d697a4700 1 Processor -- start 2020-05-18T21:31:17.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.097+0000 7f6d697a4700 1 -- start start 2020-05-18T21:31:17.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.097+0000 7f6d697a4700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d64063ce0 0x7f6d6413df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:17.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.097+0000 7f6d697a4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6d640ad180 0x7f6d64150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:17.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.097+0000 7f6d697a4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6413e380 con 0x7f6d641435d0 2020-05-18T21:31:17.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.097+0000 7f6d697a4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d64151890 con 0x7f6d640ad180 2020-05-18T21:31:17.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.097+0000 7f6d697a4700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d64151b30 con 0x7f6d64063ce0 2020-05-18T21:31:17.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.097+0000 7f6d637fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6d640ad180 0x7f6d64150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:17.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.097+0000 7f6d637fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6d640ad180 0x7f6d64150ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57970/0 (socket says 172.21.15.63:57970) 2020-05-18T21:31:17.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.097+0000 7f6d637fe700 1 -- 172.21.15.63:0/4103695663 learned_addr learned my addr 172.21.15.63:0/4103695663 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:17.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.097+0000 7f6d63fff700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d64063ce0 0x7f6d6413df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:17.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.097+0000 7f6d637fe700 1 -- 172.21.15.63:0/4103695663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d64063ce0 msgr2=0x7f6d6413df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:17.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.097+0000 7f6d637fe700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d64063ce0 0x7f6d6413df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:17.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.097+0000 7f6d637fe700 1 -- 172.21.15.63:0/4103695663 >> v1:172.21.15.155:6789/0 conn(0x7f6d641435d0 legacy=0x7f6d64154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:17.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.097+0000 7f6d637fe700 1 -- 172.21.15.63:0/4103695663 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d64151dd0 con 0x7f6d640ad180 2020-05-18T21:31:17.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.097+0000 7f6d637fe700 1 --2- 172.21.15.63:0/4103695663 >> v2:172.21.15.63:3300/0 conn(0x7f6d640ad180 0x7f6d64150ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d640b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.097+0000 7f6d637fe700 1 --2- 172.21.15.63:0/4103695663 >> v2:172.21.15.63:3300/0 conn(0x7f6d640ad180 0x7f6d64150ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d640b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.097+0000 7f6d637fe700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d640ad180 0x7f6d64150ea0 secure :-1 s=READY pgs=987 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d640b4cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:17.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.101+0000 7f6d637fe700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d640ad180 0x7f6d64150ea0 secure :-1 s=THROTTLE_DONE pgs=987 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d640b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.101+0000 7f6d617fa700 1 -- 172.21.15.63:0/4103695663 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d58007170 con 0x7f6d640ad180 2020-05-18T21:31:17.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.101+0000 7f6d637fe700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d640ad180 0x7f6d64150ea0 secure :-1 s=THROTTLE_DONE pgs=987 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d640b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.101+0000 7f6d637fe700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d640ad180 0x7f6d64150ea0 secure :-1 s=THROTTLE_DONE pgs=987 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d640b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.101+0000 7f6d617fa700 1 -- 172.21.15.63:0/4103695663 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d580072d0 con 0x7f6d640ad180 2020-05-18T21:31:17.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.101+0000 7f6d697a4700 1 -- 172.21.15.63:0/4103695663 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d64154670 con 0x7f6d640ad180 2020-05-18T21:31:17.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.101+0000 7f6d617fa700 1 -- 172.21.15.63:0/4103695663 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d58005700 con 0x7f6d640ad180 2020-05-18T21:31:17.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.101+0000 7f6d697a4700 1 -- 172.21.15.63:0/4103695663 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d64151300 con 0x7f6d640ad180 2020-05-18T21:31:17.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.101+0000 7f6d637fe700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d640ad180 0x7f6d64150ea0 secure :-1 s=THROTTLE_DONE pgs=987 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d640b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.101+0000 7f6d697a4700 1 -- 172.21.15.63:0/4103695663 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d640569e0 con 0x7f6d640ad180 2020-05-18T21:31:17.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.101+0000 7f6d617fa700 1 -- 172.21.15.63:0/4103695663 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6d580058f0 con 0x7f6d640ad180 2020-05-18T21:31:17.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.101+0000 7f6d637fe700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d640ad180 0x7f6d64150ea0 secure :-1 s=THROTTLE_DONE pgs=987 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d640b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.101+0000 7f6d617fa700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d4404f990 0x7f6d44051e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:17.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.101+0000 7f6d617fa700 1 -- 172.21.15.63:0/4103695663 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6d58064790 con 0x7f6d640ad180 2020-05-18T21:31:17.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.101+0000 7f6d63fff700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d4404f990 0x7f6d44051e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:17.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.101+0000 7f6d63fff700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d4404f990 0x7f6d44051e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6d54001110 tx=0x7f6d540017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.101+0000 7f6d63fff700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d4404f990 0x7f6d44051e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6d54001110 tx=0x7f6d540017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.101+0000 7f6d63fff700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d4404f990 0x7f6d44051e50 secure :-1 s=READY pgs=394 cs=0 l=1 rx=0x7f6d54001110 tx=0x7f6d540017b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:17.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.105+0000 7f6d637fe700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d640ad180 0x7f6d64150ea0 secure :-1 s=THROTTLE_DONE pgs=987 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d640b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.105+0000 7f6d617fa700 1 -- 172.21.15.63:0/4103695663 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6d5803ec40 con 0x7f6d640ad180 2020-05-18T21:31:17.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.261+0000 7f6d697a4700 1 -- 172.21.15.63:0/4103695663 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d640008d0 con 0x7f6d640ad180 2020-05-18T21:31:17.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.261+0000 7f6d637fe700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d640ad180 0x7f6d64150ea0 secure :-1 s=THROTTLE_DONE pgs=987 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d640b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.261+0000 7f6d617fa700 1 -- 172.21.15.63:0/4103695663 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7f6d58042260 con 0x7f6d640ad180 2020-05-18T21:31:17.265 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:17.266 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:31:17.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.261+0000 7f6d697a4700 1 -- 172.21.15.63:0/4103695663 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d4404f990 msgr2=0x7f6d44051e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:17.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.261+0000 7f6d697a4700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d4404f990 0x7f6d44051e50 secure :-1 s=READY pgs=394 cs=0 l=1 rx=0x7f6d54001110 tx=0x7f6d540017b0).stop 2020-05-18T21:31:17.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.261+0000 7f6d697a4700 1 -- 172.21.15.63:0/4103695663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d640ad180 msgr2=0x7f6d64150ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:17.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.261+0000 7f6d697a4700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d640ad180 0x7f6d64150ea0 secure :-1 s=READY pgs=987 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d640b4cd0).stop 2020-05-18T21:31:17.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.261+0000 7f6d697a4700 1 -- 172.21.15.63:0/4103695663 shutdown_connections 2020-05-18T21:31:17.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.261+0000 7f6d697a4700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d4404f990 0x7f6d44051e50 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:17.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.261+0000 7f6d697a4700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d640ad180 0x7f6d64150ea0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:17.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.261+0000 7f6d697a4700 1 --2- 172.21.15.63:0/4103695663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d64063ce0 0x7f6d6413df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:17.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.261+0000 7f6d697a4700 1 -- 172.21.15.63:0/4103695663 >> 172.21.15.63:0/4103695663 conn(0x7f6d64069fc0 msgr2=0x7f6d6413f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:17.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.265+0000 7f6d697a4700 1 -- 172.21.15.63:0/4103695663 shutdown_connections 2020-05-18T21:31:17.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.265+0000 7f6d697a4700 1 -- 172.21.15.63:0/4103695663 wait complete. 2020-05-18T21:31:17.270 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:31:17.279 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_created 2020-05-18T21:31:17.377 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:17.377 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:31:17.377 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_created": 3 2020-05-18T21:31:17.378 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:17.378 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:17.385 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_created": 3 } } 2020-05-18T21:31:17.386 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:17.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f754b973700 1 Processor -- start 2020-05-18T21:31:17.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f754b973700 1 -- start start 2020-05-18T21:31:17.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f754b973700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f754413de20 0x7f75440b6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:17.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f754b973700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f75440b4f60 0x7f75440b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:17.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f754b973700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7544069b70 con 0x7f7544144810 2020-05-18T21:31:17.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f754b973700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7544069e10 con 0x7f75440b4f60 2020-05-18T21:31:17.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f754b973700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754406a0b0 con 0x7f754413de20 2020-05-18T21:31:17.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f7549f10700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f75440b4f60 0x7f75440b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:17.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f7549f10700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f75440b4f60 0x7f75440b53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57980/0 (socket says 172.21.15.63:57980) 2020-05-18T21:31:17.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f7549f10700 1 -- 172.21.15.63:0/3509414622 learned_addr learned my addr 172.21.15.63:0/3509414622 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:17.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f754970f700 1 --2- 172.21.15.63:0/3509414622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f754413de20 0x7f75440b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:17.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f7549f10700 1 -- 172.21.15.63:0/3509414622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f754413de20 msgr2=0x7f75440b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:17.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f7549f10700 1 --2- 172.21.15.63:0/3509414622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f754413de20 0x7f75440b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:17.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f7549f10700 1 -- 172.21.15.63:0/3509414622 >> v1:172.21.15.155:6789/0 conn(0x7f7544144810 legacy=0x7f754406a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:17.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f753bfff700 1 -- 172.21.15.63:0/3509414622 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297121815 0 0) 0x7f7544069b70 con 0x7f7544144810 2020-05-18T21:31:17.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f7549f10700 1 -- 172.21.15.63:0/3509414622 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7544144c50 con 0x7f75440b4f60 2020-05-18T21:31:17.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f7549f10700 1 --2- 172.21.15.63:0/3509414622 >> v2:172.21.15.63:3300/0 conn(0x7f75440b4f60 0x7f75440b53f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f753c002f70 tx=0x7f753c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f7549f10700 1 --2- 172.21.15.63:0/3509414622 >> v2:172.21.15.63:3300/0 conn(0x7f75440b4f60 0x7f75440b53f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f753c002f70 tx=0x7f753c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f7549f10700 1 --2- 172.21.15.63:0/3509414622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75440b4f60 0x7f75440b53f0 secure :-1 s=READY pgs=988 cs=0 l=1 rx=0x7f753c002f70 tx=0x7f753c007a80).ready entity=mon.0 client_cookie=287113160d747324 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:17.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f7549f10700 1 --2- 172.21.15.63:0/3509414622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75440b4f60 0x7f75440b53f0 secure :-1 s=THROTTLE_DONE pgs=988 cs=0 l=1 rx=0x7f753c002f70 tx=0x7f753c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f753bfff700 1 -- 172.21.15.63:0/3509414622 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f753c0116b0 con 0x7f75440b4f60 2020-05-18T21:31:17.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f7549f10700 1 --2- 172.21.15.63:0/3509414622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75440b4f60 0x7f75440b53f0 secure :-1 s=THROTTLE_DONE pgs=988 cs=0 l=1 rx=0x7f753c002f70 tx=0x7f753c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f753bfff700 1 -- 172.21.15.63:0/3509414622 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753c011810 con 0x7f75440b4f60 2020-05-18T21:31:17.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f7549f10700 1 --2- 172.21.15.63:0/3509414622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75440b4f60 0x7f75440b53f0 secure :-1 s=THROTTLE_DONE pgs=988 cs=0 l=1 rx=0x7f753c002f70 tx=0x7f753c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f754b973700 1 -- 172.21.15.63:0/3509414622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75440b4f60 msgr2=0x7f75440b53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:17.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f753bfff700 1 -- 172.21.15.63:0/3509414622 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f753c011bf0 con 0x7f75440b4f60 2020-05-18T21:31:17.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.485+0000 7f754b973700 1 --2- 172.21.15.63:0/3509414622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75440b4f60 0x7f75440b53f0 secure :-1 s=READY pgs=988 cs=0 l=1 rx=0x7f753c002f70 tx=0x7f753c007a80).stop 2020-05-18T21:31:17.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754b973700 1 -- 172.21.15.63:0/3509414622 shutdown_connections 2020-05-18T21:31:17.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754b973700 1 --2- 172.21.15.63:0/3509414622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75440b4f60 0x7f75440b53f0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:17.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754b973700 1 --2- 172.21.15.63:0/3509414622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f754413de20 0x7f75440b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:17.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754b973700 1 -- 172.21.15.63:0/3509414622 >> 172.21.15.63:0/3509414622 conn(0x7f75440ba5c0 msgr2=0x7f75440ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:17.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754b973700 1 -- 172.21.15.63:0/3509414622 shutdown_connections 2020-05-18T21:31:17.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754b973700 1 -- 172.21.15.63:0/3509414622 wait complete. 2020-05-18T21:31:17.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754b973700 1 Processor -- start 2020-05-18T21:31:17.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754b973700 1 -- start start 2020-05-18T21:31:17.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754b973700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f75440b4f60 0x7f75441405d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:17.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754b973700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7544144810 0x7f754413f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:17.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754b973700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75440b3730 con 0x7f754413de20 2020-05-18T21:31:17.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754b973700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7544147530 con 0x7f75440b4f60 2020-05-18T21:31:17.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754b973700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75440b39d0 con 0x7f7544144810 2020-05-18T21:31:17.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754970f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f75440b4f60 0x7f75441405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:17.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754970f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f75440b4f60 0x7f75441405d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57982/0 (socket says 172.21.15.63:57982) 2020-05-18T21:31:17.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754970f700 1 -- 172.21.15.63:0/2324834861 learned_addr learned my addr 172.21.15.63:0/2324834861 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:17.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f7549f10700 1 --2- 172.21.15.63:0/2324834861 >> v2:172.21.15.155:3300/0 conn(0x7f7544144810 0x7f754413f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:17.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754970f700 1 -- 172.21.15.63:0/2324834861 >> v2:172.21.15.155:3300/0 conn(0x7f7544144810 msgr2=0x7f754413f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:17.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754970f700 1 --2- 172.21.15.63:0/2324834861 >> v2:172.21.15.155:3300/0 conn(0x7f7544144810 0x7f754413f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:17.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754970f700 1 -- 172.21.15.63:0/2324834861 >> v1:172.21.15.155:6789/0 conn(0x7f754413de20 legacy=0x7f754413efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:17.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754970f700 1 -- 172.21.15.63:0/2324834861 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754413fb30 con 0x7f75440b4f60 2020-05-18T21:31:17.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f7549f10700 1 --2- 172.21.15.63:0/2324834861 >> v2:172.21.15.155:3300/0 conn(0x7f7544144810 0x7f754413f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:31:17.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754970f700 1 --2- 172.21.15.63:0/2324834861 >> v2:172.21.15.63:3300/0 conn(0x7f75440b4f60 0x7f75441405d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7540003430 tx=0x7f7540011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754970f700 1 --2- 172.21.15.63:0/2324834861 >> v2:172.21.15.63:3300/0 conn(0x7f75440b4f60 0x7f75441405d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7540003430 tx=0x7f7540011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754970f700 1 --2- 172.21.15.63:0/2324834861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75440b4f60 0x7f75441405d0 secure :-1 s=READY pgs=989 cs=0 l=1 rx=0x7f7540003430 tx=0x7f7540011100).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:17.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.489+0000 7f754970f700 1 --2- 172.21.15.63:0/2324834861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75440b4f60 0x7f75441405d0 secure :-1 s=THROTTLE_DONE pgs=989 cs=0 l=1 rx=0x7f7540003430 tx=0x7f7540011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.493+0000 7f753a7fc700 1 -- 172.21.15.63:0/2324834861 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7540005e70 con 0x7f75440b4f60 2020-05-18T21:31:17.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.493+0000 7f754970f700 1 --2- 172.21.15.63:0/2324834861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75440b4f60 0x7f75441405d0 secure :-1 s=THROTTLE_DONE pgs=989 cs=0 l=1 rx=0x7f7540003430 tx=0x7f7540011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.493+0000 7f754970f700 1 --2- 172.21.15.63:0/2324834861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75440b4f60 0x7f75441405d0 secure :-1 s=THROTTLE_DONE pgs=989 cs=0 l=1 rx=0x7f7540003430 tx=0x7f7540011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.493+0000 7f753a7fc700 1 -- 172.21.15.63:0/2324834861 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7540012b40 con 0x7f75440b4f60 2020-05-18T21:31:17.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.493+0000 7f754b973700 1 -- 172.21.15.63:0/2324834861 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7544144f30 con 0x7f75440b4f60 2020-05-18T21:31:17.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.493+0000 7f753a7fc700 1 -- 172.21.15.63:0/2324834861 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7540007180 con 0x7f75440b4f60 2020-05-18T21:31:17.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.493+0000 7f754b973700 1 -- 172.21.15.63:0/2324834861 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75440b4090 con 0x7f75440b4f60 2020-05-18T21:31:17.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.493+0000 7f754970f700 1 --2- 172.21.15.63:0/2324834861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75440b4f60 0x7f75441405d0 secure :-1 s=THROTTLE_DONE pgs=989 cs=0 l=1 rx=0x7f7540003430 tx=0x7f7540011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.493+0000 7f754b973700 1 -- 172.21.15.63:0/2324834861 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75440b43a0 con 0x7f75440b4f60 2020-05-18T21:31:17.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.493+0000 7f753a7fc700 1 -- 172.21.15.63:0/2324834861 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f754000e1a0 con 0x7f75440b4f60 2020-05-18T21:31:17.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.493+0000 7f754970f700 1 --2- 172.21.15.63:0/2324834861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75440b4f60 0x7f75441405d0 secure :-1 s=THROTTLE_DONE pgs=989 cs=0 l=1 rx=0x7f7540003430 tx=0x7f7540011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.493+0000 7f753a7fc700 1 --2- 172.21.15.63:0/2324834861 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f752404f9e0 0x7f7524051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:17.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.493+0000 7f753a7fc700 1 -- 172.21.15.63:0/2324834861 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f7540063de0 con 0x7f75440b4f60 2020-05-18T21:31:17.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.493+0000 7f7548f0e700 1 --2- 172.21.15.63:0/2324834861 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f752404f9e0 0x7f7524051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:17.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.493+0000 7f7548f0e700 1 --2- 172.21.15.63:0/2324834861 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f752404f9e0 0x7f7524051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7544131840 tx=0x7f75340025e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.493+0000 7f7548f0e700 1 --2- 172.21.15.63:0/2324834861 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f752404f9e0 0x7f7524051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7544131840 tx=0x7f75340025e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.493+0000 7f7548f0e700 1 --2- 172.21.15.63:0/2324834861 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f752404f9e0 0x7f7524051ea0 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7f7544131840 tx=0x7f75340025e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:17.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.497+0000 7f754970f700 1 --2- 172.21.15.63:0/2324834861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75440b4f60 0x7f75441405d0 secure :-1 s=THROTTLE_DONE pgs=989 cs=0 l=1 rx=0x7f7540003430 tx=0x7f7540011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.497+0000 7f753a7fc700 1 -- 172.21.15.63:0/2324834861 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f754003e110 con 0x7f75440b4f60 2020-05-18T21:31:17.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.645+0000 7f754b973700 1 -- 172.21.15.63:0/2324834861 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75440569e0 con 0x7f75440b4f60 2020-05-18T21:31:17.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.645+0000 7f754970f700 1 --2- 172.21.15.63:0/2324834861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75440b4f60 0x7f75441405d0 secure :-1 s=THROTTLE_DONE pgs=989 cs=0 l=1 rx=0x7f7540003430 tx=0x7f7540011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:17.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.645+0000 7f753a7fc700 1 -- 172.21.15.63:0/2324834861 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7f7540041730 con 0x7f75440b4f60 2020-05-18T21:31:17.651 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:17.651 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:31:17.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.649+0000 7f754b973700 1 -- 172.21.15.63:0/2324834861 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f752404f9e0 msgr2=0x7f7524051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:17.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.649+0000 7f754b973700 1 --2- 172.21.15.63:0/2324834861 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f752404f9e0 0x7f7524051ea0 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7f7544131840 tx=0x7f75340025e0).stop 2020-05-18T21:31:17.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.649+0000 7f754b973700 1 -- 172.21.15.63:0/2324834861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75440b4f60 msgr2=0x7f75441405d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:17.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.649+0000 7f754b973700 1 --2- 172.21.15.63:0/2324834861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75440b4f60 0x7f75441405d0 secure :-1 s=READY pgs=989 cs=0 l=1 rx=0x7f7540003430 tx=0x7f7540011100).stop 2020-05-18T21:31:17.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.649+0000 7f754b973700 1 -- 172.21.15.63:0/2324834861 shutdown_connections 2020-05-18T21:31:17.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.649+0000 7f754b973700 1 --2- 172.21.15.63:0/2324834861 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f752404f9e0 0x7f7524051ea0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:17.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.649+0000 7f754b973700 1 --2- 172.21.15.63:0/2324834861 >> v2:172.21.15.155:3300/0 conn(0x7f7544144810 0x7f754413f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:17.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.649+0000 7f754b973700 1 --2- 172.21.15.63:0/2324834861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75440b4f60 0x7f75441405d0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:17.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.649+0000 7f754b973700 1 -- 172.21.15.63:0/2324834861 >> 172.21.15.63:0/2324834861 conn(0x7f75440ba5c0 msgr2=0x7f754405c240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:17.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.649+0000 7f754b973700 1 -- 172.21.15.63:0/2324834861 shutdown_connections 2020-05-18T21:31:17.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:17.649+0000 7f754b973700 1 -- 172.21.15.63:0/2324834861 wait complete. 2020-05-18T21:31:17.656 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:31:17.669 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_enqueued 2020-05-18T21:31:17.765 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:17.765 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:31:17.766 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 1 2020-05-18T21:31:17.766 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:17.766 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:17.774 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_enqueued": 1 } } 2020-05-18T21:31:17.774 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:31:17.775 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:31:17.788 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:31:17.806 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:31:17.807 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:31:17.807 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:31:17.807 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:31:17.822 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[24648]: fuse finished with error 0 and tester_r 0 2020-05-18T21:31:17.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:17.825 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:31:17.901 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:31:17.902 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:31:17.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:17.903 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 down' 2020-05-18T21:31:17.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:17.931 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.0' 2020-05-18T21:31:17.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:17.990 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:31:18.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:18.011 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:31:18.016 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:31:18.016 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:31:18.016 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:31:18.016 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:18.017 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:31:18.017 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:18.017 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:31:18.017 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.017 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:31:18.018 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.018 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:31:18.018 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.018 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:31:18.018 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.019 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:31:18.019 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42565sec preferred_lft 42565sec 2020-05-18T21:31:18.019 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:31:18.019 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:18.019 INFO:teuthology.orchestra.run.smithi063.stdout:21: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-05-18T21:31:18.020 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.020 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:31:18.020 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:18.020 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::20d7:adff:feef:7a8f/64 scope link 2020-05-18T21:31:18.020 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:18.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:18.021 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:31:18.040 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:31:18.040 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:31:18.040 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:31:18.040 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.041 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:31:18.041 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.041 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:31:18.041 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.041 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:31:18.042 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.042 INFO:teuthology.orchestra.run.smithi063.stdout:21: ceph-brx: mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:31:18.042 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.043 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:31:18.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:18.044 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:31:18.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:18.066 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:31:18.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:18.242 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:31:18.251 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:31:18.251 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:31:18.252 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:31:18.252 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:31:18.252 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:31:18.252 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:31:18.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:18.254 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:31:18.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:18.273 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:31:18.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:18.290 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:31:18.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:18.309 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:31:18.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:18.359 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:31:18.366 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-05-18T21:31:18.366 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:31:18.367 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-05-18T21:31:18.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:18.368 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:31:18.374 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:31:18.374 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:31:18.374 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:31:18.374 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:18.375 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:31:18.375 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:18.375 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:31:18.375 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.375 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:31:18.375 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.376 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:31:18.376 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.376 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:31:18.376 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.376 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:31:18.377 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42564sec preferred_lft 42564sec 2020-05-18T21:31:18.377 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:31:18.377 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:18.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:18.378 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:31:18.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:18.427 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:31:18.434 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2020-05-18T21:31:18.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:31:18.435 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-05-18T21:31:18.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:18.436 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:31:18.443 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:31:18.444 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:31:18.444 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:31:18.444 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:18.444 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:31:18.444 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:18.445 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:31:18.445 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.445 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:31:18.445 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.445 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:31:18.446 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.446 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:31:18.446 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.446 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:31:18.446 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42569sec preferred_lft 42569sec 2020-05-18T21:31:18.447 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:31:18.447 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:18.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:18.448 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:31:18.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:18.492 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:31:18.498 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2020-05-18T21:31:18.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:31:18.500 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-05-18T21:31:18.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:18.501 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:31:18.507 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:31:18.507 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:31:18.507 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:31:18.507 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:18.508 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:31:18.508 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:18.508 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:31:18.508 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.508 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:31:18.509 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.509 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:31:18.509 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.509 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:31:18.509 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:18.510 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:31:18.510 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42568sec preferred_lft 42568sec 2020-05-18T21:31:18.510 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:31:18.510 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:18.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:18.511 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:31:18.555 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_strays.TestStrays.test_hardlink_reintegration' 2020-05-18T21:31:18.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.661+0000 7efbf5927700 1 Processor -- start 2020-05-18T21:31:18.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.661+0000 7efbf5927700 1 -- start start 2020-05-18T21:31:18.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbf5927700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efbf00b5800 0x7efbf00b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:18.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbf5927700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efbf00b2450 0x7efbf00b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:18.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbf5927700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf0145950 con 0x7efbf00b2d10 2020-05-18T21:31:18.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbf5927700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbf00b6070 con 0x7efbf00b5800 2020-05-18T21:31:18.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbf5927700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf0145bf0 con 0x7efbf00b2450 2020-05-18T21:31:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbeeffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efbf00b5800 0x7efbf00b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbeeffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efbf00b5800 0x7efbf00b4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57990/0 (socket says 172.21.15.63:57990) 2020-05-18T21:31:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbeeffd700 1 -- 172.21.15.63:0/2486551192 learned_addr learned my addr 172.21.15.63:0/2486551192 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbe7fff700 1 --2- 172.21.15.63:0/2486551192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efbf00b2450 0x7efbf00b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:18.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbeeffd700 1 -- 172.21.15.63:0/2486551192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efbf00b2450 msgr2=0x7efbf00b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:18.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbeeffd700 1 --2- 172.21.15.63:0/2486551192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efbf00b2450 0x7efbf00b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbeeffd700 1 -- 172.21.15.63:0/2486551192 >> v1:172.21.15.155:6789/0 conn(0x7efbf00b2d10 legacy=0x7efbf00afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbeeffd700 1 -- 172.21.15.63:0/2486551192 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf0145e90 con 0x7efbf00b5800 2020-05-18T21:31:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbe7fff700 1 --2- 172.21.15.63:0/2486551192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efbf00b2450 0x7efbf00b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:31:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbeeffd700 1 --2- 172.21.15.63:0/2486551192 >> v2:172.21.15.63:3300/0 conn(0x7efbf00b5800 0x7efbf00b4680 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efbf00b2360 tx=0x7efbe0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:18.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbeeffd700 1 --2- 172.21.15.63:0/2486551192 >> v2:172.21.15.63:3300/0 conn(0x7efbf00b5800 0x7efbf00b4680 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efbf00b2360 tx=0x7efbe0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:18.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbeeffd700 1 --2- 172.21.15.63:0/2486551192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efbf00b5800 0x7efbf00b4680 secure :-1 s=READY pgs=990 cs=0 l=1 rx=0x7efbf00b2360 tx=0x7efbe0008920).ready entity=mon.0 client_cookie=16feeb8298343476 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:18.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbeeffd700 1 --2- 172.21.15.63:0/2486551192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efbf00b5800 0x7efbf00b4680 secure :-1 s=THROTTLE_DONE pgs=990 cs=0 l=1 rx=0x7efbf00b2360 tx=0x7efbe0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:18.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbee7fc700 1 -- 172.21.15.63:0/2486551192 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbe0013970 con 0x7efbf00b5800 2020-05-18T21:31:18.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbeeffd700 1 --2- 172.21.15.63:0/2486551192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efbf00b5800 0x7efbf00b4680 secure :-1 s=THROTTLE_DONE pgs=990 cs=0 l=1 rx=0x7efbf00b2360 tx=0x7efbe0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:18.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbee7fc700 1 -- 172.21.15.63:0/2486551192 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe0013ad0 con 0x7efbf00b5800 2020-05-18T21:31:18.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbeeffd700 1 --2- 172.21.15.63:0/2486551192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efbf00b5800 0x7efbf00b4680 secure :-1 s=THROTTLE_DONE pgs=990 cs=0 l=1 rx=0x7efbf00b2360 tx=0x7efbe0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:18.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbee7fc700 1 -- 172.21.15.63:0/2486551192 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbe000a180 con 0x7efbf00b5800 2020-05-18T21:31:18.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbf5927700 1 -- 172.21.15.63:0/2486551192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efbf00b5800 msgr2=0x7efbf00b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:18.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbf5927700 1 --2- 172.21.15.63:0/2486551192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efbf00b5800 0x7efbf00b4680 secure :-1 s=READY pgs=990 cs=0 l=1 rx=0x7efbf00b2360 tx=0x7efbe0008920).stop 2020-05-18T21:31:18.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbf5927700 1 -- 172.21.15.63:0/2486551192 shutdown_connections 2020-05-18T21:31:18.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbf5927700 1 --2- 172.21.15.63:0/2486551192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efbf00b2450 0x7efbf00b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:18.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbf5927700 1 --2- 172.21.15.63:0/2486551192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efbf00b5800 0x7efbf00b4680 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:18.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbf5927700 1 -- 172.21.15.63:0/2486551192 >> 172.21.15.63:0/2486551192 conn(0x7efbf0069b70 msgr2=0x7efbf0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:18.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbf5927700 1 -- 172.21.15.63:0/2486551192 shutdown_connections 2020-05-18T21:31:18.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.665+0000 7efbf5927700 1 -- 172.21.15.63:0/2486551192 wait complete. 2020-05-18T21:31:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbf5927700 1 Processor -- start 2020-05-18T21:31:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbf5927700 1 -- start start 2020-05-18T21:31:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbf5927700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efbf00b2450 0x7efbf00620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbf5927700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efbf00b2d10 0x7efbf0142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:18.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbf5927700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf0152b20 con 0x7efbf00b5800 2020-05-18T21:31:18.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbf5927700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbf0152d50 con 0x7efbf00b2450 2020-05-18T21:31:18.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbf5927700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf01430b0 con 0x7efbf00b2d10 2020-05-18T21:31:18.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbef7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efbf00b5800 0x7efbf00b8da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60188/0 (socket says 172.21.15.63:60188) 2020-05-18T21:31:18.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbef7fe700 1 -- 172.21.15.63:0/63459659 learned_addr learned my addr 172.21.15.63:0/63459659 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:18.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbeeffd700 1 --2- 172.21.15.63:0/63459659 >> v2:172.21.15.155:3300/0 conn(0x7efbf00b2450 0x7efbf00620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:18.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbe7fff700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efbf00b2d10 0x7efbf0142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:18.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbecff9700 1 -- 172.21.15.63:0/63459659 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765071039 0 0) 0x7efbf0152b20 con 0x7efbf00b5800 2020-05-18T21:31:18.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbecff9700 1 -- 172.21.15.63:0/63459659 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbd4002fe0 con 0x7efbf00b5800 2020-05-18T21:31:18.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbecff9700 1 -- 172.21.15.63:0/63459659 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2871275297 0 0) 0x7efbd4002fe0 con 0x7efbf00b5800 2020-05-18T21:31:18.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbecff9700 1 -- 172.21.15.63:0/63459659 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efbf0152b20 con 0x7efbf00b5800 2020-05-18T21:31:18.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbecff9700 1 -- 172.21.15.63:0/63459659 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7efbe8001d00 con 0x7efbf00b5800 2020-05-18T21:31:18.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbeeffd700 1 -- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efbf00b2d10 msgr2=0x7efbf0142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:18.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbeeffd700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efbf00b2d10 0x7efbf0142c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:18.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbeeffd700 1 -- 172.21.15.63:0/63459659 >> v1:172.21.15.63:6789/0 conn(0x7efbf00b5800 legacy=0x7efbf00b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:18.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbeeffd700 1 -- 172.21.15.63:0/63459659 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf00aed90 con 0x7efbf00b2450 2020-05-18T21:31:18.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbeeffd700 1 --2- 172.21.15.63:0/63459659 >> v2:172.21.15.155:3300/0 conn(0x7efbf00b2450 0x7efbf00620f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efbf00b2360 tx=0x7efbe0013720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:18.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbe7fff700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efbf00b2d10 0x7efbf0142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:31:18.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbeeffd700 1 --2- 172.21.15.63:0/63459659 >> v2:172.21.15.155:3300/0 conn(0x7efbf00b2450 0x7efbf00620f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efbf00b2360 tx=0x7efbe0013720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:18.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.669+0000 7efbeeffd700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf00b2450 0x7efbf00620f0 secure :-1 s=READY pgs=694 cs=0 l=1 rx=0x7efbf00b2360 tx=0x7efbe0013720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:18.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.673+0000 7efbeeffd700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf00b2450 0x7efbf00620f0 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7efbf00b2360 tx=0x7efbe0013720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:18.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.673+0000 7efbecff9700 1 -- 172.21.15.63:0/63459659 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbe0013c80 con 0x7efbf00b2450 2020-05-18T21:31:18.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.673+0000 7efbeeffd700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf00b2450 0x7efbf00620f0 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7efbf00b2360 tx=0x7efbe0013720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:18.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.673+0000 7efbeeffd700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf00b2450 0x7efbf00620f0 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7efbf00b2360 tx=0x7efbe0013720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:18.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.673+0000 7efbf5927700 1 -- 172.21.15.63:0/63459659 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf00b94b0 con 0x7efbf00b2450 2020-05-18T21:31:18.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.673+0000 7efbecff9700 1 -- 172.21.15.63:0/63459659 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe0013de0 con 0x7efbf00b2450 2020-05-18T21:31:18.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.673+0000 7efbecff9700 1 -- 172.21.15.63:0/63459659 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbe0007360 con 0x7efbf00b2450 2020-05-18T21:31:18.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.673+0000 7efbf5927700 1 -- 172.21.15.63:0/63459659 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf00ae960 con 0x7efbf00b2450 2020-05-18T21:31:18.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.673+0000 7efbeeffd700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf00b2450 0x7efbf00620f0 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7efbf00b2360 tx=0x7efbe0013720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:18.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.673+0000 7efbecff9700 1 -- 172.21.15.63:0/63459659 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7efbe0005700 con 0x7efbf00b2450 2020-05-18T21:31:18.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.673+0000 7efbeeffd700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf00b2450 0x7efbf00620f0 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7efbf00b2360 tx=0x7efbe0013720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:18.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.673+0000 7efbf5927700 1 -- 172.21.15.63:0/63459659 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf00569e0 con 0x7efbf00b2450 2020-05-18T21:31:18.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.673+0000 7efbecff9700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efbd4050040 0x7efbd4052500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:18.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.673+0000 7efbecff9700 1 -- 172.21.15.63:0/63459659 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7efbe0066240 con 0x7efbf00b2450 2020-05-18T21:31:18.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.673+0000 7efbe7fff700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efbd4050040 0x7efbd4052500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:18.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.673+0000 7efbe7fff700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efbd4050040 0x7efbd4052500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efbd8002f70 tx=0x7efbd8007cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:18.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.673+0000 7efbe7fff700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efbd4050040 0x7efbd4052500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efbd8002f70 tx=0x7efbd8007cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:18.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.673+0000 7efbe7fff700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efbd4050040 0x7efbd4052500 secure :-1 s=READY pgs=396 cs=0 l=1 rx=0x7efbd8002f70 tx=0x7efbd8007cb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:18.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.685+0000 7efbeeffd700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf00b2450 0x7efbf00620f0 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7efbf00b2360 tx=0x7efbe0013720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:18.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.685+0000 7efbecff9700 1 -- 172.21.15.63:0/63459659 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7efbe0040630 con 0x7efbf00b2450 2020-05-18T21:31:18.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:18.841+0000 7efbf5927700 1 -- 172.21.15.63:0/63459659 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_hardlink_reintegration"]} v 0) v1 -- 0x7efbf006a930 con 0x7efbf00b2450 2020-05-18T21:31:19.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.653+0000 7efbeeffd700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf00b2450 0x7efbf00620f0 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7efbf00b2360 tx=0x7efbe0013720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:19.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.653+0000 7efbecff9700 1 -- 172.21.15.63:0/63459659 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_hardlink_reintegration"]}]=0 v232) v1 ==== 142+0+0 (secure 0 0 0) 0x7efbe0043c50 con 0x7efbf00b2450 2020-05-18T21:31:19.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.653+0000 7efbf5927700 1 -- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efbd4050040 msgr2=0x7efbd4052500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:19.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.653+0000 7efbf5927700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efbd4050040 0x7efbd4052500 secure :-1 s=READY pgs=396 cs=0 l=1 rx=0x7efbd8002f70 tx=0x7efbd8007cb0).stop 2020-05-18T21:31:19.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.657+0000 7efbf5927700 1 -- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf00b2450 msgr2=0x7efbf00620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:19.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.657+0000 7efbf5927700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf00b2450 0x7efbf00620f0 secure :-1 s=READY pgs=694 cs=0 l=1 rx=0x7efbf00b2360 tx=0x7efbe0013720).stop 2020-05-18T21:31:19.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.657+0000 7efbf5927700 1 -- 172.21.15.63:0/63459659 shutdown_connections 2020-05-18T21:31:19.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.657+0000 7efbf5927700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efbd4050040 0x7efbd4052500 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:19.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.657+0000 7efbf5927700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efbf00b2d10 0x7efbf0142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:19.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.657+0000 7efbf5927700 1 --2- 172.21.15.63:0/63459659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf00b2450 0x7efbf00620f0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:19.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.657+0000 7efbf5927700 1 -- 172.21.15.63:0/63459659 >> 172.21.15.63:0/63459659 conn(0x7efbf0069b70 msgr2=0x7efbf00b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:19.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.657+0000 7efbf5927700 1 -- 172.21.15.63:0/63459659 shutdown_connections 2020-05-18T21:31:19.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.657+0000 7efbf5927700 1 -- 172.21.15.63:0/63459659 wait complete. 2020-05-18T21:31:19.678 INFO:tasks.cephfs_test_runner:test_hardlink_reintegration (tasks.cephfs.test_strays.TestStrays) ... ok 2020-05-18T21:31:19.678 INFO:tasks.cephfs_test_runner:Starting test: test_migration_on_shutdown (tasks.cephfs.test_strays.TestStrays) 2020-05-18T21:31:19.679 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_strays.TestStrays.test_migration_on_shutdown' 2020-05-18T21:31:19.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d75177700 1 Processor -- start 2020-05-18T21:31:19.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d75177700 1 -- start start 2020-05-18T21:31:19.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d75177700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6d700b9350 0x7f6d700b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:19.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d75177700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d7014a0d0 0x7f6d70145340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:19.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d75177700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d70149990 con 0x7f6d701457a0 2020-05-18T21:31:19.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d75177700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d701497a0 con 0x7f6d700b9350 2020-05-18T21:31:19.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d75177700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d70149c30 con 0x7f6d7014a0d0 2020-05-18T21:31:19.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d6ed9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6d700b9350 0x7f6d700b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:19.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d6ed9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6d700b9350 0x7f6d700b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58004/0 (socket says 172.21.15.63:58004) 2020-05-18T21:31:19.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d6ed9d700 1 -- 172.21.15.63:0/1832197513 learned_addr learned my addr 172.21.15.63:0/1832197513 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:19.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d6e59c700 1 --2- 172.21.15.63:0/1832197513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d7014a0d0 0x7f6d70145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:19.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d6ed9d700 1 -- 172.21.15.63:0/1832197513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d7014a0d0 msgr2=0x7f6d70145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:19.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d6ed9d700 1 --2- 172.21.15.63:0/1832197513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d7014a0d0 0x7f6d70145340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:19.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d6ed9d700 1 -- 172.21.15.63:0/1832197513 >> v1:172.21.15.155:6789/0 conn(0x7f6d701457a0 legacy=0x7f6d70069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:19.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d6ed9d700 1 -- 172.21.15.63:0/1832197513 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d70145c50 con 0x7f6d700b9350 2020-05-18T21:31:19.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d6ed9d700 1 --2- 172.21.15.63:0/1832197513 >> v2:172.21.15.63:3300/0 conn(0x7f6d700b9350 0x7f6d700b85a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6d58002f70 tx=0x7f6d58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:19.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d6ed9d700 1 --2- 172.21.15.63:0/1832197513 >> v2:172.21.15.63:3300/0 conn(0x7f6d700b9350 0x7f6d700b85a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6d58002f70 tx=0x7f6d58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:19.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d6ed9d700 1 --2- 172.21.15.63:0/1832197513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d700b9350 0x7f6d700b85a0 secure :-1 s=READY pgs=992 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d58007a80).ready entity=mon.0 client_cookie=fb67f7fbdff776dc server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:19.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d6ed9d700 1 --2- 172.21.15.63:0/1832197513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d700b9350 0x7f6d700b85a0 secure :-1 s=THROTTLE_DONE pgs=992 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:19.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d6ed9d700 1 --2- 172.21.15.63:0/1832197513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d700b9350 0x7f6d700b85a0 secure :-1 s=THROTTLE_DONE pgs=992 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:19.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d6ed9d700 1 --2- 172.21.15.63:0/1832197513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d700b9350 0x7f6d700b85a0 secure :-1 s=THROTTLE_DONE pgs=992 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:19.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d6dd9b700 1 -- 172.21.15.63:0/1832197513 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d58011760 con 0x7f6d700b9350 2020-05-18T21:31:19.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d6dd9b700 1 -- 172.21.15.63:0/1832197513 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d580118c0 con 0x7f6d700b9350 2020-05-18T21:31:19.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d75177700 1 -- 172.21.15.63:0/1832197513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d700b9350 msgr2=0x7f6d700b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:19.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d75177700 1 --2- 172.21.15.63:0/1832197513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d700b9350 0x7f6d700b85a0 secure :-1 s=READY pgs=992 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d58007a80).stop 2020-05-18T21:31:19.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d6dd9b700 1 -- 172.21.15.63:0/1832197513 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d58011ce0 con 0x7f6d700b9350 2020-05-18T21:31:19.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d75177700 1 -- 172.21.15.63:0/1832197513 shutdown_connections 2020-05-18T21:31:19.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d75177700 1 --2- 172.21.15.63:0/1832197513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d7014a0d0 0x7f6d70145340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:19.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d75177700 1 --2- 172.21.15.63:0/1832197513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d700b9350 0x7f6d700b85a0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:19.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d75177700 1 -- 172.21.15.63:0/1832197513 >> 172.21.15.63:0/1832197513 conn(0x7f6d7005f210 msgr2=0x7f6d70066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:19.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d75177700 1 -- 172.21.15.63:0/1832197513 shutdown_connections 2020-05-18T21:31:19.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.785+0000 7f6d75177700 1 -- 172.21.15.63:0/1832197513 wait complete. 2020-05-18T21:31:19.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.789+0000 7f6d75177700 1 Processor -- start 2020-05-18T21:31:19.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.789+0000 7f6d75177700 1 -- start start 2020-05-18T21:31:19.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.789+0000 7f6d75177700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d700b9350 0x7f6d70152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:19.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.789+0000 7f6d75177700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6d7014a0d0 0x7f6d701415e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:19.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.789+0000 7f6d75177700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d700b2f60 con 0x7f6d701457a0 2020-05-18T21:31:19.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.789+0000 7f6d75177700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d70136b90 con 0x7f6d7014a0d0 2020-05-18T21:31:19.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.789+0000 7f6d75177700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d70153240 con 0x7f6d700b9350 2020-05-18T21:31:19.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.789+0000 7f6d6ed9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d700b9350 0x7f6d70152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:19.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.789+0000 7f6d6f59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6d7014a0d0 0x7f6d701415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:19.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.789+0000 7f6d6e59c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f6d701457a0 0x7f6d70140ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:58516/0 (socket says 172.21.15.63:58516) 2020-05-18T21:31:19.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.789+0000 7f6d6e59c700 1 -- 172.21.15.63:0/1292080037 learned_addr learned my addr 172.21.15.63:0/1292080037 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:19.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.789+0000 7f6d67fff700 1 -- 172.21.15.63:0/1292080037 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546619765 0 0) 0x7f6d700b2f60 con 0x7f6d701457a0 2020-05-18T21:31:19.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.789+0000 7f6d67fff700 1 -- 172.21.15.63:0/1292080037 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d54002fe0 con 0x7f6d701457a0 2020-05-18T21:31:19.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d6f59e700 1 -- 172.21.15.63:0/1292080037 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d700b9350 msgr2=0x7f6d70152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:19.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d6f59e700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d700b9350 0x7f6d70152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:19.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d6f59e700 1 -- 172.21.15.63:0/1292080037 >> v1:172.21.15.155:6789/0 conn(0x7f6d701457a0 legacy=0x7f6d70140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:19.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d6f59e700 1 -- 172.21.15.63:0/1292080037 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d700b3200 con 0x7f6d7014a0d0 2020-05-18T21:31:19.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d6ed9d700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d700b9350 0x7f6d70152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:31:19.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d6f59e700 1 --2- 172.21.15.63:0/1292080037 >> v2:172.21.15.63:3300/0 conn(0x7f6d7014a0d0 0x7f6d701415e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6d7014a4b0 tx=0x7f6d60010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:19.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d6f59e700 1 --2- 172.21.15.63:0/1292080037 >> v2:172.21.15.63:3300/0 conn(0x7f6d7014a0d0 0x7f6d701415e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6d7014a4b0 tx=0x7f6d60010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:19.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d6f59e700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d7014a0d0 0x7f6d701415e0 secure :-1 s=READY pgs=993 cs=0 l=1 rx=0x7f6d7014a4b0 tx=0x7f6d60010860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:19.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d6f59e700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d7014a0d0 0x7f6d701415e0 secure :-1 s=THROTTLE_DONE pgs=993 cs=0 l=1 rx=0x7f6d7014a4b0 tx=0x7f6d60010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:19.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d6f59e700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d7014a0d0 0x7f6d701415e0 secure :-1 s=THROTTLE_DONE pgs=993 cs=0 l=1 rx=0x7f6d7014a4b0 tx=0x7f6d60010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:19.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d67fff700 1 -- 172.21.15.63:0/1292080037 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d60006c00 con 0x7f6d7014a0d0 2020-05-18T21:31:19.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d6f59e700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d7014a0d0 0x7f6d701415e0 secure :-1 s=THROTTLE_DONE pgs=993 cs=0 l=1 rx=0x7f6d7014a4b0 tx=0x7f6d60010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:19.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d67fff700 1 -- 172.21.15.63:0/1292080037 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d60006d60 con 0x7f6d7014a0d0 2020-05-18T21:31:19.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d67fff700 1 -- 172.21.15.63:0/1292080037 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d60010fd0 con 0x7f6d7014a0d0 2020-05-18T21:31:19.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d75177700 1 -- 172.21.15.63:0/1292080037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d700b34a0 con 0x7f6d7014a0d0 2020-05-18T21:31:19.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d75177700 1 -- 172.21.15.63:0/1292080037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d70141c40 con 0x7f6d7014a0d0 2020-05-18T21:31:19.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d6f59e700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d7014a0d0 0x7f6d701415e0 secure :-1 s=THROTTLE_DONE pgs=993 cs=0 l=1 rx=0x7f6d7014a4b0 tx=0x7f6d60010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:19.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d75177700 1 -- 172.21.15.63:0/1292080037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d700569e0 con 0x7f6d7014a0d0 2020-05-18T21:31:19.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d67fff700 1 -- 172.21.15.63:0/1292080037 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6d60011240 con 0x7f6d7014a0d0 2020-05-18T21:31:19.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d6f59e700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d7014a0d0 0x7f6d701415e0 secure :-1 s=THROTTLE_DONE pgs=993 cs=0 l=1 rx=0x7f6d7014a4b0 tx=0x7f6d60010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:19.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.793+0000 7f6d67fff700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d5404fdd0 0x7f6d54052290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:19.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.797+0000 7f6d67fff700 1 -- 172.21.15.63:0/1292080037 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6d60063bd0 con 0x7f6d7014a0d0 2020-05-18T21:31:19.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.797+0000 7f6d6ed9d700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d5404fdd0 0x7f6d54052290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:19.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.797+0000 7f6d6ed9d700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d5404fdd0 0x7f6d54052290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:19.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.797+0000 7f6d6ed9d700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d5404fdd0 0x7f6d54052290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d58007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:19.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.797+0000 7f6d6ed9d700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d5404fdd0 0x7f6d54052290 secure :-1 s=READY pgs=397 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d58007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:19.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.805+0000 7f6d6f59e700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d7014a0d0 0x7f6d701415e0 secure :-1 s=THROTTLE_DONE pgs=993 cs=0 l=1 rx=0x7f6d7014a4b0 tx=0x7f6d60010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:19.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.805+0000 7f6d67fff700 1 -- 172.21.15.63:0/1292080037 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6d6003df00 con 0x7f6d7014a0d0 2020-05-18T21:31:19.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:19.965+0000 7f6d75177700 1 -- 172.21.15.63:0/1292080037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_migration_on_shutdown"]} v 0) v1 -- 0x7f6d700618e0 con 0x7f6d7014a0d0 2020-05-18T21:31:20.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.653+0000 7f6d6f59e700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d7014a0d0 0x7f6d701415e0 secure :-1 s=THROTTLE_DONE pgs=993 cs=0 l=1 rx=0x7f6d7014a4b0 tx=0x7f6d60010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:20.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.653+0000 7f6d67fff700 1 -- 172.21.15.63:0/1292080037 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_migration_on_shutdown"]}]=0 v233) v1 ==== 144+0+0 (secure 0 0 0) 0x7f6d60041520 con 0x7f6d7014a0d0 2020-05-18T21:31:20.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.657+0000 7f6d75177700 1 -- 172.21.15.63:0/1292080037 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d5404fdd0 msgr2=0x7f6d54052290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:20.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.657+0000 7f6d75177700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d5404fdd0 0x7f6d54052290 secure :-1 s=READY pgs=397 cs=0 l=1 rx=0x7f6d58002f70 tx=0x7f6d58007a80).stop 2020-05-18T21:31:20.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.657+0000 7f6d75177700 1 -- 172.21.15.63:0/1292080037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d7014a0d0 msgr2=0x7f6d701415e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:20.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.657+0000 7f6d75177700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d7014a0d0 0x7f6d701415e0 secure :-1 s=READY pgs=993 cs=0 l=1 rx=0x7f6d7014a4b0 tx=0x7f6d60010860).stop 2020-05-18T21:31:20.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.657+0000 7f6d75177700 1 -- 172.21.15.63:0/1292080037 shutdown_connections 2020-05-18T21:31:20.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.657+0000 7f6d75177700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d5404fdd0 0x7f6d54052290 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:20.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.657+0000 7f6d75177700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d7014a0d0 0x7f6d701415e0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:20.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.657+0000 7f6d75177700 1 --2- 172.21.15.63:0/1292080037 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d700b9350 0x7f6d70152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:20.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.657+0000 7f6d75177700 1 -- 172.21.15.63:0/1292080037 >> 172.21.15.63:0/1292080037 conn(0x7f6d7005f210 msgr2=0x7f6d70069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:20.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.657+0000 7f6d75177700 1 -- 172.21.15.63:0/1292080037 shutdown_connections 2020-05-18T21:31:20.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.657+0000 7f6d75177700 1 -- 172.21.15.63:0/1292080037 wait complete. 2020-05-18T21:31:20.679 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:31:20.680 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:31:20.701 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:31:20.721 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:31:20.722 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-05-18T21:31:20.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.825+0000 7ffa09cec700 1 Processor -- start 2020-05-18T21:31:20.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.825+0000 7ffa09cec700 1 -- start start 2020-05-18T21:31:20.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.825+0000 7ffa09cec700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffa04061d80 0x7ffa04065130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:20.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.825+0000 7ffa09cec700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffa04142bf0 0x7ffa040ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:20.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.825+0000 7ffa09cec700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa040ac930 0x7ffa040acd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:20.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.825+0000 7ffa09cec700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa04143090 con 0x7ffa04142bf0 2020-05-18T21:31:20.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.825+0000 7ffa09cec700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa04143330 con 0x7ffa04061d80 2020-05-18T21:31:20.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.825+0000 7ffa09cec700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa041435d0 con 0x7ffa040ac930 2020-05-18T21:31:20.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.825+0000 7ffa03fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffa04142bf0 0x7ffa040ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:20.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.825+0000 7ffa03fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffa04142bf0 0x7ffa040ac4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58018/0 (socket says 172.21.15.63:58018) 2020-05-18T21:31:20.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.825+0000 7ffa03fff700 1 -- 172.21.15.63:0/1584809236 learned_addr learned my addr 172.21.15.63:0/1584809236 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:20.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa08cea700 1 --2- 172.21.15.63:0/1584809236 >> v2:172.21.15.155:3300/0 conn(0x7ffa04061d80 0x7ffa04065130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:20.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa094eb700 1 --2- 172.21.15.63:0/1584809236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa040ac930 0x7ffa040acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:20.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa03fff700 1 -- 172.21.15.63:0/1584809236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa040ac930 msgr2=0x7ffa040acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:20.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa03fff700 1 --2- 172.21.15.63:0/1584809236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa040ac930 0x7ffa040acd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:20.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa03fff700 1 -- 172.21.15.63:0/1584809236 >> v2:172.21.15.155:3300/0 conn(0x7ffa04061d80 msgr2=0x7ffa04065130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:20.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa03fff700 1 --2- 172.21.15.63:0/1584809236 >> v2:172.21.15.155:3300/0 conn(0x7ffa04061d80 0x7ffa04065130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:20.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa03fff700 1 -- 172.21.15.63:0/1584809236 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa04062160 con 0x7ffa04142bf0 2020-05-18T21:31:20.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa094eb700 1 --2- 172.21.15.63:0/1584809236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa040ac930 0x7ffa040acd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:31:20.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa03fff700 1 --2- 172.21.15.63:0/1584809236 >> v2:172.21.15.63:3300/0 conn(0x7ffa04142bf0 0x7ffa040ac4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff9f0002f70 tx=0x7ff9f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:20.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa03fff700 1 --2- 172.21.15.63:0/1584809236 >> v2:172.21.15.63:3300/0 conn(0x7ffa04142bf0 0x7ffa040ac4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff9f0002f70 tx=0x7ff9f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:20.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa03fff700 1 --2- 172.21.15.63:0/1584809236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa04142bf0 0x7ffa040ac4d0 secure :-1 s=READY pgs=994 cs=0 l=1 rx=0x7ff9f0002f70 tx=0x7ff9f0007a80).ready entity=mon.0 client_cookie=cd4556aad167f17a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:20.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa03fff700 1 --2- 172.21.15.63:0/1584809236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa04142bf0 0x7ffa040ac4d0 secure :-1 s=THROTTLE_DONE pgs=994 cs=0 l=1 rx=0x7ff9f0002f70 tx=0x7ff9f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:20.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa037fe700 1 -- 172.21.15.63:0/1584809236 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f0008e60 con 0x7ffa04142bf0 2020-05-18T21:31:20.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa03fff700 1 --2- 172.21.15.63:0/1584809236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa04142bf0 0x7ffa040ac4d0 secure :-1 s=THROTTLE_DONE pgs=994 cs=0 l=1 rx=0x7ff9f0002f70 tx=0x7ff9f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:20.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa037fe700 1 -- 172.21.15.63:0/1584809236 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f0011950 con 0x7ffa04142bf0 2020-05-18T21:31:20.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa03fff700 1 --2- 172.21.15.63:0/1584809236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa04142bf0 0x7ffa040ac4d0 secure :-1 s=THROTTLE_DONE pgs=994 cs=0 l=1 rx=0x7ff9f0002f70 tx=0x7ff9f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:20.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa037fe700 1 -- 172.21.15.63:0/1584809236 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f0011d30 con 0x7ffa04142bf0 2020-05-18T21:31:20.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa09cec700 1 -- 172.21.15.63:0/1584809236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa04142bf0 msgr2=0x7ffa040ac4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:20.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa09cec700 1 --2- 172.21.15.63:0/1584809236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa04142bf0 0x7ffa040ac4d0 secure :-1 s=READY pgs=994 cs=0 l=1 rx=0x7ff9f0002f70 tx=0x7ff9f0007a80).stop 2020-05-18T21:31:20.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa09cec700 1 -- 172.21.15.63:0/1584809236 shutdown_connections 2020-05-18T21:31:20.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa09cec700 1 --2- 172.21.15.63:0/1584809236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa040ac930 0x7ffa040acd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:20.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa09cec700 1 --2- 172.21.15.63:0/1584809236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa04142bf0 0x7ffa040ac4d0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:20.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa09cec700 1 --2- 172.21.15.63:0/1584809236 >> v2:172.21.15.155:3300/0 conn(0x7ffa04061d80 0x7ffa04065130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:20.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa09cec700 1 -- 172.21.15.63:0/1584809236 >> 172.21.15.63:0/1584809236 conn(0x7ffa04066d00 msgr2=0x7ffa0405a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:20.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa09cec700 1 -- 172.21.15.63:0/1584809236 shutdown_connections 2020-05-18T21:31:20.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.829+0000 7ffa09cec700 1 -- 172.21.15.63:0/1584809236 wait complete. 2020-05-18T21:31:20.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa09cec700 1 Processor -- start 2020-05-18T21:31:20.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa09cec700 1 -- start start 2020-05-18T21:31:20.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa09cec700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffa040ac930 0x7ffa041416c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:20.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa09cec700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa040ae520 con 0x7ffa04061d80 2020-05-18T21:31:20.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa09cec700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0414b8e0 con 0x7ffa04142bf0 2020-05-18T21:31:20.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa09cec700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa04148be0 con 0x7ffa040ac930 2020-05-18T21:31:20.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa03fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffa040ac930 0x7ffa041416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:20.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa03fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffa040ac930 0x7ffa041416c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58026/0 (socket says 172.21.15.63:58026) 2020-05-18T21:31:20.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa03fff700 1 -- 172.21.15.63:0/2257788341 learned_addr learned my addr 172.21.15.63:0/2257788341 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:20.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa03fff700 1 -- 172.21.15.63:0/2257788341 >> v1:172.21.15.155:6789/0 conn(0x7ffa04142bf0 legacy=0x7ffa041484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:20.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa03fff700 1 -- 172.21.15.63:0/2257788341 >> v1:172.21.15.63:6789/0 conn(0x7ffa04061d80 legacy=0x7ffa04147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:20.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa03fff700 1 -- 172.21.15.63:0/2257788341 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0414b640 con 0x7ffa040ac930 2020-05-18T21:31:20.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa03fff700 1 --2- 172.21.15.63:0/2257788341 >> v2:172.21.15.63:3300/0 conn(0x7ffa040ac930 0x7ffa041416c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff9f8002f30 tx=0x7ff9f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:20.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa03fff700 1 --2- 172.21.15.63:0/2257788341 >> v2:172.21.15.63:3300/0 conn(0x7ffa040ac930 0x7ffa041416c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff9f8002f30 tx=0x7ff9f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:20.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa03fff700 1 --2- 172.21.15.63:0/2257788341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa040ac930 0x7ffa041416c0 secure :-1 s=READY pgs=996 cs=0 l=1 rx=0x7ff9f8002f30 tx=0x7ff9f0007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:20.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa03fff700 1 --2- 172.21.15.63:0/2257788341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa040ac930 0x7ffa041416c0 secure :-1 s=THROTTLE_DONE pgs=996 cs=0 l=1 rx=0x7ff9f8002f30 tx=0x7ff9f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:20.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa03fff700 1 --2- 172.21.15.63:0/2257788341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa040ac930 0x7ffa041416c0 secure :-1 s=THROTTLE_DONE pgs=996 cs=0 l=1 rx=0x7ff9f8002f30 tx=0x7ff9f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:20.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa01ffb700 1 -- 172.21.15.63:0/2257788341 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f0008e60 con 0x7ffa040ac930 2020-05-18T21:31:20.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa03fff700 1 --2- 172.21.15.63:0/2257788341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa040ac930 0x7ffa041416c0 secure :-1 s=THROTTLE_DONE pgs=996 cs=0 l=1 rx=0x7ff9f8002f30 tx=0x7ff9f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:20.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa01ffb700 1 -- 172.21.15.63:0/2257788341 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f0007360 con 0x7ffa040ac930 2020-05-18T21:31:20.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa09cec700 1 -- 172.21.15.63:0/2257788341 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa04149690 con 0x7ffa040ac930 2020-05-18T21:31:20.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.833+0000 7ffa01ffb700 1 -- 172.21.15.63:0/2257788341 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f0005700 con 0x7ffa040ac930 2020-05-18T21:31:20.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.837+0000 7ffa09cec700 1 -- 172.21.15.63:0/2257788341 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0414a900 con 0x7ffa040ac930 2020-05-18T21:31:20.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.837+0000 7ffa03fff700 1 --2- 172.21.15.63:0/2257788341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa040ac930 0x7ffa041416c0 secure :-1 s=THROTTLE_DONE pgs=996 cs=0 l=1 rx=0x7ff9f8002f30 tx=0x7ff9f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:20.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.837+0000 7ffa09cec700 1 -- 172.21.15.63:0/2257788341 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa040569e0 con 0x7ffa040ac930 2020-05-18T21:31:20.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.837+0000 7ffa01ffb700 1 -- 172.21.15.63:0/2257788341 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff9f0005970 con 0x7ffa040ac930 2020-05-18T21:31:20.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.837+0000 7ffa03fff700 1 --2- 172.21.15.63:0/2257788341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa040ac930 0x7ffa041416c0 secure :-1 s=THROTTLE_DONE pgs=996 cs=0 l=1 rx=0x7ff9f8002f30 tx=0x7ff9f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:20.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.837+0000 7ffa01ffb700 1 --2- 172.21.15.63:0/2257788341 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff9ec04fa20 0x7ff9ec051ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:20.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.837+0000 7ffa01ffb700 1 -- 172.21.15.63:0/2257788341 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff9f0064200 con 0x7ffa040ac930 2020-05-18T21:31:20.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.837+0000 7ffa08cea700 1 --2- 172.21.15.63:0/2257788341 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff9ec04fa20 0x7ff9ec051ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:20.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.837+0000 7ffa08cea700 1 --2- 172.21.15.63:0/2257788341 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff9ec04fa20 0x7ff9ec051ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff9f8007a80 tx=0x7ff9f8008040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:20.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.837+0000 7ffa08cea700 1 --2- 172.21.15.63:0/2257788341 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff9ec04fa20 0x7ff9ec051ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff9f8007a80 tx=0x7ff9f8008040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:20.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.837+0000 7ffa08cea700 1 --2- 172.21.15.63:0/2257788341 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff9ec04fa20 0x7ff9ec051ee0 secure :-1 s=READY pgs=398 cs=0 l=1 rx=0x7ff9f8007a80 tx=0x7ff9f8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:20.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.841+0000 7ffa03fff700 1 --2- 172.21.15.63:0/2257788341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa040ac930 0x7ffa041416c0 secure :-1 s=THROTTLE_DONE pgs=996 cs=0 l=1 rx=0x7ff9f8002f30 tx=0x7ff9f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:20.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.841+0000 7ffa01ffb700 1 -- 172.21.15.63:0/2257788341 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff9f003e6b0 con 0x7ffa040ac930 2020-05-18T21:31:20.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.961+0000 7ffa09cec700 1 -- 172.21.15.63:0/2257788341 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ffa040ae6b0 con 0x7ffa040ac930 2020-05-18T21:31:20.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.965+0000 7ffa03fff700 1 --2- 172.21.15.63:0/2257788341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa040ac930 0x7ffa041416c0 secure :-1 s=THROTTLE_DONE pgs=996 cs=0 l=1 rx=0x7ff9f8002f30 tx=0x7ff9f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:20.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.965+0000 7ffa01ffb700 1 -- 172.21.15.63:0/2257788341 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v75) v1 ==== 81+0+33853 (secure 0 0 0) 0x7ff9f0041cd0 con 0x7ffa040ac930 2020-05-18T21:31:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:20.971 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 75, 2020-05-18T21:31:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:31:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2020-05-18T21:26:28.798650+0000", 2020-05-18T21:31:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2020-05-18T21:30:19.282601+0000", 2020-05-18T21:31:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:31:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:31:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-05-18T21:31:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5799936, 2020-05-18T21:31:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2020-05-18T21:31:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2020-05-18T21:31:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2020-05-18T21:31:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2020-05-18T21:31:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2020-05-18T21:31:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 4, 2020-05-18T21:31:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2020-05-18T21:31:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-05-18T21:31:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2020-05-18T21:31:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2020-05-18T21:31:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 14, 2020-05-18T21:31:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 8, 2020-05-18T21:31:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2020-05-18T21:31:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "jewel", 2020-05-18T21:31:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "pacific", 2020-05-18T21:31:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:31:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2020-05-18T21:31:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "device_health_metrics", 2020-05-18T21:31:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:33.080792+0000", 2020-05-18T21:31:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:31:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:31:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:31:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:31:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:31:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:31:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:31:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:31:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2020-05-18T21:31:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2020-05-18T21:31:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2020-05-18T21:31:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2020-05-18T21:31:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2020-05-18T21:31:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:31:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:31:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:31:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:31:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:31:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:31:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:31:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "15", 2020-05-18T21:31:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:31:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:31:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:31:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:31:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:31:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:31:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:31:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:31:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:31:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:31:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:31:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:31:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:31:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:31:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:31:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:31:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:31:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:31:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:31:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:31:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:31:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:31:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:31:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:31:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:31:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:31:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:31:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:31:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:31:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:31:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:31:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:31:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:31:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:31:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:31:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:31:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:31:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:31:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2020-05-18T21:31:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:31:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_devicehealth": {} 2020-05-18T21:31:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:20.990 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2020-05-18T21:31:20.990 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2020-05-18T21:31:20.990 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:40.149370+0000", 2020-05-18T21:31:20.990 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:31:20.990 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:31:20.990 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:31:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:31:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:31:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:31:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:31:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:31:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:31:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:31:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:31:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:31:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:31:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:31:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:31:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:31:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:31:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:31:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:31:20.994 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:31:20.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:20.994 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2020-05-18T21:31:20.994 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:31:20.994 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:31:20.995 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:31:20.995 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:31:20.995 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:31:20.995 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:31:20.995 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:31:20.995 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:31:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:31:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:31:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:31:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:31:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:31:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:31:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:31:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:31:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:31:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:31:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:31:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:31:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:31:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:31:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:31:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:31:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:31:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:31:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:31:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:31:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:31:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:31:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:31:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:31:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:31:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:31:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:31:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:31:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:31:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:31:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:31:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2020-05-18T21:31:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 13, 2020-05-18T21:31:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2020-05-18T21:31:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:30:06.278977+0000", 2020-05-18T21:31:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:31:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:31:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:31:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:31:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:31:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:31:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:31:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:31:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:31:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:31:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:31:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:31:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:31:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:31:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:31:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:31:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:31:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:31:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:31:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:31:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "72", 2020-05-18T21:31:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:31:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:31:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:31:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:31:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:31:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:31:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:31:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:31:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:31:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:31:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:31:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:31:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:31:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:31:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:31:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:31:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:31:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:31:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:31:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:31:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:31:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:31:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:31:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:31:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:31:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:31:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:31:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:31:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:31:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:31:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:31:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:31:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:31:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:31:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:31:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:31:21.014 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:31:21.014 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:31:21.014 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2020-05-18T21:31:21.014 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2020-05-18T21:31:21.014 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2020-05-18T21:31:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:31:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:31:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2020-05-18T21:31:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 14, 2020-05-18T21:31:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2020-05-18T21:31:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:30:07.362909+0000", 2020-05-18T21:31:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:31:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:31:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:31:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:31:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:31:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:31:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:31:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:31:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:31:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:31:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:31:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:31:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:31:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:31:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:31:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:31:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:31:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:31:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:31:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:31:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "73", 2020-05-18T21:31:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:31:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:31:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:31:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:31:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:31:21.022 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:31:21.022 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:31:21.022 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:31:21.022 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:31:21.022 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:31:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:31:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:31:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:31:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:31:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:31:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:31:21.024 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:31:21.024 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:31:21.024 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:31:21.024 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:31:21.024 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:31:21.025 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:31:21.025 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:31:21.025 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:31:21.025 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:31:21.025 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:31:21.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.026 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:31:21.026 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:31:21.026 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:31:21.026 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:31:21.026 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:31:21.027 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:31:21.027 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:31:21.027 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:31:21.027 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:31:21.027 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:31:21.028 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:31:21.028 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:31:21.028 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:31:21.028 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:31:21.028 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2020-05-18T21:31:21.028 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.029 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.029 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.029 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:21.029 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2020-05-18T21:31:21.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.030 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:31:21.030 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "c6ae0fbf-604c-4e8d-b1b8-6038821420e3", 2020-05-18T21:31:21.030 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:31:21.030 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:31:21.030 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:31:21.031 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:31:21.031 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:31:21.031 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:31:21.031 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:31:21.031 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 71, 2020-05-18T21:31:21.031 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:31:21.032 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:31:21.032 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:31:21.032 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.032 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.033 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2020-05-18T21:31:21.033 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:31:21.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.033 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.033 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2020-05-18T21:31:21.034 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:31:21.034 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.034 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.034 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:31:21.035 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.035 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.035 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6802", 2020-05-18T21:31:21.035 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:31:21.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.036 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.036 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6803", 2020-05-18T21:31:21.036 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:31:21.036 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.037 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.037 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:31:21.037 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.038 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.038 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6806", 2020-05-18T21:31:21.038 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:31:21.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.039 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.040 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6807", 2020-05-18T21:31:21.040 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:31:21.040 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.040 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.041 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:31:21.041 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.041 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.042 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6804", 2020-05-18T21:31:21.042 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:31:21.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.042 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.043 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6805", 2020-05-18T21:31:21.043 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:31:21.043 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.043 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.044 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6801/12803", 2020-05-18T21:31:21.044 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6803/12803", 2020-05-18T21:31:21.044 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6807/12803", 2020-05-18T21:31:21.044 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6805/12803", 2020-05-18T21:31:21.044 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:31:21.045 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:31:21.045 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:31:21.045 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.046 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:31:21.046 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6", 2020-05-18T21:31:21.046 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:31:21.046 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:31:21.046 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:31:21.046 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:31:21.047 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:31:21.047 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:31:21.047 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:31:21.047 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 59, 2020-05-18T21:31:21.047 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:31:21.048 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:31:21.048 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:31:21.048 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.048 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.049 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6808", 2020-05-18T21:31:21.049 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:31:21.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.049 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.049 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6809", 2020-05-18T21:31:21.050 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:31:21.050 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.050 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.050 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:31:21.051 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.051 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.051 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6810", 2020-05-18T21:31:21.051 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:31:21.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.052 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.052 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6811", 2020-05-18T21:31:21.052 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:31:21.052 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.053 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.053 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:31:21.053 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.054 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.054 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6815", 2020-05-18T21:31:21.054 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:31:21.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.054 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.055 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6817", 2020-05-18T21:31:21.055 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:31:21.055 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.055 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.056 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:31:21.056 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.056 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.056 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6812", 2020-05-18T21:31:21.056 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:31:21.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.057 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.057 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6813", 2020-05-18T21:31:21.057 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:31:21.058 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.058 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.058 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6809/12804", 2020-05-18T21:31:21.058 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6811/12804", 2020-05-18T21:31:21.059 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6817/12804", 2020-05-18T21:31:21.059 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6813/12804", 2020-05-18T21:31:21.059 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:31:21.059 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:31:21.059 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:31:21.059 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.060 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:31:21.060 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "ec8d9fa9-dae9-45f6-b286-735ab3801c27", 2020-05-18T21:31:21.060 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:31:21.061 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:31:21.061 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:31:21.061 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:31:21.061 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:31:21.061 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:31:21.061 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:31:21.062 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 71, 2020-05-18T21:31:21.062 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:31:21.062 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:31:21.062 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:31:21.062 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.063 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.063 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6822", 2020-05-18T21:31:21.063 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:31:21.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.064 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.064 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6824", 2020-05-18T21:31:21.064 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:31:21.064 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.065 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.065 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:31:21.065 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.066 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.066 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6826", 2020-05-18T21:31:21.066 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:31:21.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.066 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.067 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6827", 2020-05-18T21:31:21.067 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:31:21.067 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.067 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.068 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:31:21.068 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.068 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.068 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6830", 2020-05-18T21:31:21.069 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:31:21.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.069 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.069 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6831", 2020-05-18T21:31:21.069 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:31:21.070 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.070 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.070 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:31:21.070 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.071 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.071 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6828", 2020-05-18T21:31:21.071 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:31:21.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.072 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.072 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6829", 2020-05-18T21:31:21.072 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:31:21.072 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.072 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.073 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6824/12806", 2020-05-18T21:31:21.073 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6827/12806", 2020-05-18T21:31:21.073 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6831/12806", 2020-05-18T21:31:21.073 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6829/12806", 2020-05-18T21:31:21.074 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:31:21.074 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:31:21.074 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:31:21.074 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.075 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:31:21.075 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "1030fedf-adad-4e79-b839-59385d4d7d2a", 2020-05-18T21:31:21.075 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:31:21.075 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:31:21.075 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:31:21.076 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:31:21.076 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:31:21.076 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:31:21.076 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:31:21.076 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 71, 2020-05-18T21:31:21.076 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:31:21.077 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:31:21.077 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:31:21.077 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.077 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.078 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6814", 2020-05-18T21:31:21.078 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:31:21.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.078 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.079 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6816", 2020-05-18T21:31:21.079 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:31:21.079 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.079 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.079 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:31:21.080 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.080 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.080 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6818", 2020-05-18T21:31:21.080 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:31:21.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.081 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.081 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6819", 2020-05-18T21:31:21.081 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:31:21.081 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.082 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.082 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:31:21.082 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.083 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.083 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6823", 2020-05-18T21:31:21.083 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:31:21.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.083 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.084 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6825", 2020-05-18T21:31:21.084 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:31:21.084 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.084 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.085 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:31:21.085 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.085 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.085 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6820", 2020-05-18T21:31:21.085 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:31:21.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.086 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.086 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6821", 2020-05-18T21:31:21.086 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:31:21.087 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.087 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.087 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6816/12805", 2020-05-18T21:31:21.087 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6819/12805", 2020-05-18T21:31:21.087 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6825/12805", 2020-05-18T21:31:21.088 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6821/12805", 2020-05-18T21:31:21.088 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:31:21.088 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:31:21.088 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:31:21.088 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.089 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:31:21.089 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "8ad15a9b-97b4-4002-b1d4-7292e09b4ef6", 2020-05-18T21:31:21.089 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:31:21.090 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:31:21.090 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:31:21.090 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:31:21.090 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:31:21.090 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:31:21.090 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:31:21.091 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 70, 2020-05-18T21:31:21.091 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:31:21.091 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:31:21.091 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:31:21.091 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.092 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.092 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6800", 2020-05-18T21:31:21.092 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:31:21.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.093 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.093 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6801", 2020-05-18T21:31:21.093 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:31:21.093 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.093 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.094 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:31:21.094 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.094 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.094 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6802", 2020-05-18T21:31:21.095 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:31:21.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.095 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.095 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6803", 2020-05-18T21:31:21.096 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:31:21.096 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.096 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.096 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:31:21.096 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.097 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.097 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6806", 2020-05-18T21:31:21.097 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:31:21.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.098 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.098 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6807", 2020-05-18T21:31:21.098 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:31:21.098 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.099 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.099 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:31:21.099 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.099 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.100 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6804", 2020-05-18T21:31:21.100 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:31:21.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.100 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.101 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6805", 2020-05-18T21:31:21.101 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:31:21.101 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.101 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.101 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6801/13023", 2020-05-18T21:31:21.102 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6803/13023", 2020-05-18T21:31:21.102 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6807/13023", 2020-05-18T21:31:21.102 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6805/13023", 2020-05-18T21:31:21.102 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:31:21.102 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:31:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:31:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:31:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0dce88f8-b984-43e1-95e2-4132171102d2", 2020-05-18T21:31:21.104 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:31:21.104 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:31:21.104 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:31:21.104 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:31:21.104 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:31:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:31:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:31:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 71, 2020-05-18T21:31:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:31:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:31:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:31:21.106 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.106 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.106 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6808", 2020-05-18T21:31:21.106 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:31:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6809", 2020-05-18T21:31:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:31:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:31:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.109 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.109 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6810", 2020-05-18T21:31:21.109 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:31:21.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.110 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.110 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6811", 2020-05-18T21:31:21.110 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:31:21.110 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.110 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:31:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6814", 2020-05-18T21:31:21.112 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:31:21.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.112 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.112 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6816", 2020-05-18T21:31:21.113 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:31:21.113 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.113 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.113 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:31:21.114 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.114 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.114 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6812", 2020-05-18T21:31:21.114 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:31:21.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.115 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.115 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6813", 2020-05-18T21:31:21.115 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:31:21.115 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.116 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.116 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6809/13024", 2020-05-18T21:31:21.116 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6811/13024", 2020-05-18T21:31:21.116 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6816/13024", 2020-05-18T21:31:21.116 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6813/13024", 2020-05-18T21:31:21.117 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:31:21.117 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:31:21.117 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:31:21.117 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.118 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:31:21.118 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "e1bc92f8-3692-4483-b0fb-905c94fa1469", 2020-05-18T21:31:21.118 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:31:21.118 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:31:21.118 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:31:21.119 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:31:21.119 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:31:21.119 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:31:21.119 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:31:21.119 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 71, 2020-05-18T21:31:21.120 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:31:21.120 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:31:21.120 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:31:21.120 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.121 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.121 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6815", 2020-05-18T21:31:21.121 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:31:21.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.121 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.122 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6817", 2020-05-18T21:31:21.122 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:31:21.122 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.122 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.123 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:31:21.123 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.123 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.123 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6818", 2020-05-18T21:31:21.123 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:31:21.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.124 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.124 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6819", 2020-05-18T21:31:21.124 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:31:21.125 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.125 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.125 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:31:21.125 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.126 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.126 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6822", 2020-05-18T21:31:21.126 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:31:21.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.127 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.127 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6824", 2020-05-18T21:31:21.127 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:31:21.127 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.127 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.128 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:31:21.128 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.128 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.128 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6820", 2020-05-18T21:31:21.129 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:31:21.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.129 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.129 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6821", 2020-05-18T21:31:21.130 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:31:21.130 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.130 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.130 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6817/13025", 2020-05-18T21:31:21.131 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6819/13025", 2020-05-18T21:31:21.131 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6824/13025", 2020-05-18T21:31:21.131 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6821/13025", 2020-05-18T21:31:21.131 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:31:21.131 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:31:21.131 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:31:21.132 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.132 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:31:21.132 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "b76e000c-a078-48c4-9e1e-34d286a9992c", 2020-05-18T21:31:21.133 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:31:21.133 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:31:21.133 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:31:21.133 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:31:21.133 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:31:21.133 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:31:21.134 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:31:21.134 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 70, 2020-05-18T21:31:21.134 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:31:21.134 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:31:21.134 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:31:21.135 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.135 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.135 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6823", 2020-05-18T21:31:21.135 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:31:21.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.136 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.136 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6825", 2020-05-18T21:31:21.136 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:31:21.136 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.137 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.137 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:31:21.137 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.138 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.138 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6826", 2020-05-18T21:31:21.138 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:31:21.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.138 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.139 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6827", 2020-05-18T21:31:21.139 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:31:21.139 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.140 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.140 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:31:21.140 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.141 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.141 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6830", 2020-05-18T21:31:21.141 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:31:21.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.141 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.142 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6831", 2020-05-18T21:31:21.142 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:31:21.142 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.142 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.143 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:31:21.143 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:31:21.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.143 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:31:21.143 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6828", 2020-05-18T21:31:21.144 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:31:21.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.144 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:21.144 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6829", 2020-05-18T21:31:21.144 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:31:21.145 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.145 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.145 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6825/13026", 2020-05-18T21:31:21.145 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6827/13026", 2020-05-18T21:31:21.146 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6831/13026", 2020-05-18T21:31:21.146 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6829/13026", 2020-05-18T21:31:21.146 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:31:21.146 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:31:21.146 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:31:21.146 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:21.147 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.147 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:21.147 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2020-05-18T21:31:21.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.147 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:31:21.148 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:31:21.148 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:31:21.148 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:31:21.148 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:31:21.148 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:31:21.148 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.281434+0000", 2020-05-18T21:31:21.149 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:31:21.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.149 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:31:21.149 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:31:21.150 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:31:21.150 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:31:21.150 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:31:21.150 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:31:21.150 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.608518+0000", 2020-05-18T21:31:21.151 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:31:21.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.151 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:31:21.151 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:31:21.151 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:31:21.152 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:31:21.152 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:31:21.152 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:31:21.152 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.582386+0000", 2020-05-18T21:31:21.152 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:31:21.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.153 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:31:21.153 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:31:21.153 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:31:21.153 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:31:21.154 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:31:21.154 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:31:21.154 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.573488+0000", 2020-05-18T21:31:21.154 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:31:21.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.155 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:31:21.155 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:31:21.155 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:31:21.155 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:31:21.156 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:31:21.156 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:31:21.156 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.604174+0000", 2020-05-18T21:31:21.156 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:31:21.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.157 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:31:21.157 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:31:21.157 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:31:21.157 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:31:21.157 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:31:21.158 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:31:21.158 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.371004+0000", 2020-05-18T21:31:21.158 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:31:21.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.158 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:31:21.159 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:31:21.159 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:31:21.159 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:31:21.159 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:31:21.159 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:31:21.160 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.593070+0000", 2020-05-18T21:31:21.160 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:31:21.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.160 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:21.160 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:31:21.160 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:31:21.161 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:31:21.161 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:31:21.161 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:31:21.161 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:31:21.161 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.667677+0000", 2020-05-18T21:31:21.162 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:31:21.162 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.162 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:21.162 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2020-05-18T21:31:21.162 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2020-05-18T21:31:21.163 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2020-05-18T21:31:21.163 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2020-05-18T21:31:21.163 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklist": { 2020-05-18T21:31:21.163 INFO:teuthology.orchestra.run.smithi063.stdout: "172.21.15.155:6835/802454809": "2020-05-19T21:30:19.236593+0000", 2020-05-18T21:31:21.163 INFO:teuthology.orchestra.run.smithi063.stdout: "172.21.15.155:6834/802454809": "2020-05-19T21:30:19.236593+0000" 2020-05-18T21:31:21.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.164 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2020-05-18T21:31:21.164 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2020-05-18T21:31:21.164 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2020-05-18T21:31:21.164 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2020-05-18T21:31:21.164 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2020-05-18T21:31:21.165 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2020-05-18T21:31:21.165 INFO:teuthology.orchestra.run.smithi063.stdout: "ruleset-failure-domain": "osd", 2020-05-18T21:31:21.165 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2020-05-18T21:31:21.165 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:21.165 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:21.165 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2020-05-18T21:31:21.166 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2020-05-18T21:31:21.166 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2020-05-18T21:31:21.166 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2020-05-18T21:31:21.166 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {} 2020-05-18T21:31:21.166 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:21.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.969+0000 7ffa09cec700 1 -- 172.21.15.63:0/2257788341 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff9ec04fa20 msgr2=0x7ff9ec051ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:21.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.969+0000 7ffa09cec700 1 --2- 172.21.15.63:0/2257788341 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff9ec04fa20 0x7ff9ec051ee0 secure :-1 s=READY pgs=398 cs=0 l=1 rx=0x7ff9f8007a80 tx=0x7ff9f8008040).stop 2020-05-18T21:31:21.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.969+0000 7ffa09cec700 1 -- 172.21.15.63:0/2257788341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa040ac930 msgr2=0x7ffa041416c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:21.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.969+0000 7ffa09cec700 1 --2- 172.21.15.63:0/2257788341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa040ac930 0x7ffa041416c0 secure :-1 s=READY pgs=996 cs=0 l=1 rx=0x7ff9f8002f30 tx=0x7ff9f0007a80).stop 2020-05-18T21:31:21.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.969+0000 7ffa09cec700 1 -- 172.21.15.63:0/2257788341 shutdown_connections 2020-05-18T21:31:21.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.969+0000 7ffa09cec700 1 --2- 172.21.15.63:0/2257788341 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff9ec04fa20 0x7ff9ec051ee0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:21.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.969+0000 7ffa09cec700 1 --2- 172.21.15.63:0/2257788341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa040ac930 0x7ffa041416c0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:21.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.969+0000 7ffa09cec700 1 -- 172.21.15.63:0/2257788341 >> 172.21.15.63:0/2257788341 conn(0x7ffa04066d00 msgr2=0x7ffa040b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:21.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.969+0000 7ffa09cec700 1 -- 172.21.15.63:0/2257788341 shutdown_connections 2020-05-18T21:31:21.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:20.969+0000 7ffa09cec700 1 -- 172.21.15.63:0/2257788341 wait complete. 2020-05-18T21:31:21.171 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:21.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.277+0000 7f5cb39d6700 1 Processor -- start 2020-05-18T21:31:21.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.277+0000 7f5cb39d6700 1 -- start start 2020-05-18T21:31:21.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5cb39d6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5cac0bb5e0 0x7f5cac0acee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:21.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5cb39d6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cac0af980 con 0x7f5cac0bbcd0 2020-05-18T21:31:21.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5cb39d6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cac0b0530 con 0x7f5cac12efd0 2020-05-18T21:31:21.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5cb39d6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cac0af7a0 con 0x7f5cac0bb5e0 2020-05-18T21:31:21.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5cb1772700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5cac0bb5e0 0x7f5cac0acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:21.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5cb0f71700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5cac0bbcd0 0x7f5cac0afe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60220/0 (socket says 172.21.15.63:60220) 2020-05-18T21:31:21.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5cb0f71700 1 -- 172.21.15.63:0/1987570721 learned_addr learned my addr 172.21.15.63:0/1987570721 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:21.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5cb1772700 1 -- 172.21.15.63:0/1987570721 >> v1:172.21.15.155:6789/0 conn(0x7f5cac12efd0 legacy=0x7f5cac145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:21.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5cb1772700 1 -- 172.21.15.63:0/1987570721 >> v1:172.21.15.63:6789/0 conn(0x7f5cac0bbcd0 legacy=0x7f5cac0afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:21.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5cb1772700 1 -- 172.21.15.63:0/1987570721 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac0bb9c0 con 0x7f5cac0bb5e0 2020-05-18T21:31:21.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5c9bfff700 1 -- 172.21.15.63:0/1987570721 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4268591459 0 0) 0x7f5cac0af980 con 0x7f5cac0bbcd0 2020-05-18T21:31:21.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5cb1772700 1 --2- 172.21.15.63:0/1987570721 >> v2:172.21.15.63:3300/0 conn(0x7f5cac0bb5e0 0x7f5cac0acee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5ca8002f70 tx=0x7f5ca8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5cb1772700 1 --2- 172.21.15.63:0/1987570721 >> v2:172.21.15.63:3300/0 conn(0x7f5cac0bb5e0 0x7f5cac0acee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5ca8002f70 tx=0x7f5ca8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5cb1772700 1 --2- 172.21.15.63:0/1987570721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cac0bb5e0 0x7f5cac0acee0 secure :-1 s=READY pgs=998 cs=0 l=1 rx=0x7f5ca8002f70 tx=0x7f5ca8007a80).ready entity=mon.0 client_cookie=8606d84d3eac4247 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5cb1772700 1 --2- 172.21.15.63:0/1987570721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cac0bb5e0 0x7f5cac0acee0 secure :-1 s=THROTTLE_DONE pgs=998 cs=0 l=1 rx=0x7f5ca8002f70 tx=0x7f5ca8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5c9bfff700 1 -- 172.21.15.63:0/1987570721 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ca8008e80 con 0x7f5cac0bb5e0 2020-05-18T21:31:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5cb1772700 1 --2- 172.21.15.63:0/1987570721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cac0bb5e0 0x7f5cac0acee0 secure :-1 s=THROTTLE_DONE pgs=998 cs=0 l=1 rx=0x7f5ca8002f70 tx=0x7f5ca8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5cb1772700 1 --2- 172.21.15.63:0/1987570721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cac0bb5e0 0x7f5cac0acee0 secure :-1 s=THROTTLE_DONE pgs=998 cs=0 l=1 rx=0x7f5ca8002f70 tx=0x7f5ca8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5c9bfff700 1 -- 172.21.15.63:0/1987570721 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca80116a0 con 0x7f5cac0bb5e0 2020-05-18T21:31:21.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5c9bfff700 1 -- 172.21.15.63:0/1987570721 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ca8011ac0 con 0x7f5cac0bb5e0 2020-05-18T21:31:21.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5cb39d6700 1 -- 172.21.15.63:0/1987570721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cac0bb5e0 msgr2=0x7f5cac0acee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:21.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.281+0000 7f5cb39d6700 1 --2- 172.21.15.63:0/1987570721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cac0bb5e0 0x7f5cac0acee0 secure :-1 s=READY pgs=998 cs=0 l=1 rx=0x7f5ca8002f70 tx=0x7f5ca8007a80).stop 2020-05-18T21:31:21.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.285+0000 7f5cb39d6700 1 -- 172.21.15.63:0/1987570721 shutdown_connections 2020-05-18T21:31:21.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.285+0000 7f5cb39d6700 1 --2- 172.21.15.63:0/1987570721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cac0bb5e0 0x7f5cac0acee0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:21.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.285+0000 7f5cb39d6700 1 -- 172.21.15.63:0/1987570721 >> 172.21.15.63:0/1987570721 conn(0x7f5cac069b70 msgr2=0x7f5cac069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:21.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.285+0000 7f5cb39d6700 1 -- 172.21.15.63:0/1987570721 shutdown_connections 2020-05-18T21:31:21.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.285+0000 7f5cb39d6700 1 -- 172.21.15.63:0/1987570721 wait complete. 2020-05-18T21:31:21.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.285+0000 7f5cb39d6700 1 Processor -- start 2020-05-18T21:31:21.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.285+0000 7f5cb39d6700 1 -- start start 2020-05-18T21:31:21.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.285+0000 7f5cb39d6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cac0bb5e0 0x7f5cac0b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:21.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.285+0000 7f5cb39d6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5cac0bbcd0 0x7f5cac12e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:21.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.285+0000 7f5cb39d6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cac0b4910 con 0x7f5cac12efd0 2020-05-18T21:31:21.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.285+0000 7f5cb39d6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cac0b8560 con 0x7f5cac0bbcd0 2020-05-18T21:31:21.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.285+0000 7f5cb39d6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac0b4bb0 con 0x7f5cac0bb5e0 2020-05-18T21:31:21.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.285+0000 7f5cb0f71700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5cac0bbcd0 0x7f5cac12e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:21.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.285+0000 7f5cb1772700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cac0bb5e0 0x7f5cac0b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:21.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.285+0000 7f5cb1f73700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5cac12efd0 0x7f5cac156990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60230/0 (socket says 172.21.15.63:60230) 2020-05-18T21:31:21.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5cb1f73700 1 -- 172.21.15.63:0/985937000 learned_addr learned my addr 172.21.15.63:0/985937000 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:21.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5cb0f71700 1 -- 172.21.15.63:0/985937000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cac0bb5e0 msgr2=0x7f5cac0b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:21.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5cb0f71700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cac0bb5e0 0x7f5cac0b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:21.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5cb0f71700 1 -- 172.21.15.63:0/985937000 >> v1:172.21.15.63:6789/0 conn(0x7f5cac12efd0 legacy=0x7f5cac156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:21.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5c9a7fc700 1 -- 172.21.15.63:0/985937000 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122634095 0 0) 0x7f5cac0b4910 con 0x7f5cac12efd0 2020-05-18T21:31:21.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5cb0f71700 1 -- 172.21.15.63:0/985937000 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac0b4e50 con 0x7f5cac0bbcd0 2020-05-18T21:31:21.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5cb1772700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cac0bb5e0 0x7f5cac0b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:31:21.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5cb0f71700 1 --2- 172.21.15.63:0/985937000 >> v2:172.21.15.63:3300/0 conn(0x7f5cac0bbcd0 0x7f5cac12e1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5c9c000bc0 tx=0x7f5c9c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5cb0f71700 1 --2- 172.21.15.63:0/985937000 >> v2:172.21.15.63:3300/0 conn(0x7f5cac0bbcd0 0x7f5cac12e1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5c9c000bc0 tx=0x7f5c9c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5cb0f71700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cac0bbcd0 0x7f5cac12e1f0 secure :-1 s=READY pgs=1000 cs=0 l=1 rx=0x7f5c9c000bc0 tx=0x7f5c9c010900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:21.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5cb0f71700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cac0bbcd0 0x7f5cac12e1f0 secure :-1 s=THROTTLE_DONE pgs=1000 cs=0 l=1 rx=0x7f5c9c000bc0 tx=0x7f5c9c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5c9a7fc700 1 -- 172.21.15.63:0/985937000 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c9c005ce0 con 0x7f5cac0bbcd0 2020-05-18T21:31:21.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5cb0f71700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cac0bbcd0 0x7f5cac12e1f0 secure :-1 s=THROTTLE_DONE pgs=1000 cs=0 l=1 rx=0x7f5c9c000bc0 tx=0x7f5c9c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5cb0f71700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cac0bbcd0 0x7f5cac12e1f0 secure :-1 s=THROTTLE_DONE pgs=1000 cs=0 l=1 rx=0x7f5c9c000bc0 tx=0x7f5c9c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5c9a7fc700 1 -- 172.21.15.63:0/985937000 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c005e40 con 0x7f5cac0bbcd0 2020-05-18T21:31:21.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5cb39d6700 1 -- 172.21.15.63:0/985937000 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cac12e650 con 0x7f5cac0bbcd0 2020-05-18T21:31:21.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5c9a7fc700 1 -- 172.21.15.63:0/985937000 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c9c0062c0 con 0x7f5cac0bbcd0 2020-05-18T21:31:21.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5cb39d6700 1 -- 172.21.15.63:0/985937000 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cac1572c0 con 0x7f5cac0bbcd0 2020-05-18T21:31:21.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5cb0f71700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cac0bbcd0 0x7f5cac12e1f0 secure :-1 s=THROTTLE_DONE pgs=1000 cs=0 l=1 rx=0x7f5c9c000bc0 tx=0x7f5c9c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5cb39d6700 1 -- 172.21.15.63:0/985937000 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cac0b4740 con 0x7f5cac0bbcd0 2020-05-18T21:31:21.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5c9a7fc700 1 -- 172.21.15.63:0/985937000 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5c9c006540 con 0x7f5cac0bbcd0 2020-05-18T21:31:21.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5cb0f71700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cac0bbcd0 0x7f5cac12e1f0 secure :-1 s=THROTTLE_DONE pgs=1000 cs=0 l=1 rx=0x7f5c9c000bc0 tx=0x7f5c9c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5c9a7fc700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5c8c04f830 0x7f5c8c051cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.289+0000 7f5c9a7fc700 1 -- 172.21.15.63:0/985937000 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f5c9c0090c0 con 0x7f5cac0bbcd0 2020-05-18T21:31:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.293+0000 7f5cb1772700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5c8c04f830 0x7f5c8c051cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.293+0000 7f5cb1772700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5c8c04f830 0x7f5c8c051cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5ca8002f70 tx=0x7f5ca8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.293+0000 7f5cb1772700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5c8c04f830 0x7f5c8c051cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5ca8002f70 tx=0x7f5ca8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.293+0000 7f5cb1772700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5c8c04f830 0x7f5c8c051cf0 secure :-1 s=READY pgs=399 cs=0 l=1 rx=0x7f5ca8002f70 tx=0x7f5ca8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.297+0000 7f5cb0f71700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cac0bbcd0 0x7f5cac12e1f0 secure :-1 s=THROTTLE_DONE pgs=1000 cs=0 l=1 rx=0x7f5c9c000bc0 tx=0x7f5c9c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.297+0000 7f5c9a7fc700 1 -- 172.21.15.63:0/985937000 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f5c9c03e0a0 con 0x7f5cac0bbcd0 2020-05-18T21:31:21.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.453+0000 7f5cb39d6700 1 -- 172.21.15.63:0/985937000 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cac0569e0 con 0x7f5cac0bbcd0 2020-05-18T21:31:21.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.453+0000 7f5cb0f71700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cac0bbcd0 0x7f5cac12e1f0 secure :-1 s=THROTTLE_DONE pgs=1000 cs=0 l=1 rx=0x7f5c9c000bc0 tx=0x7f5c9c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.453+0000 7f5c9a7fc700 1 -- 172.21.15.63:0/985937000 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2144 (secure 0 0 0) 0x7f5c9c0416c0 con 0x7f5cac0bbcd0 2020-05-18T21:31:21.459 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:21.459 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:30:23.668863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6834},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6834":{"gid":6834,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6833/2372263796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2372263796},{"type":"v1","addr":"172.21.15.63:6833","nonce":2372263796}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:31:21.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.453+0000 7f5cb39d6700 1 -- 172.21.15.63:0/985937000 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5c8c04f830 msgr2=0x7f5c8c051cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:21.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.453+0000 7f5cb39d6700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5c8c04f830 0x7f5c8c051cf0 secure :-1 s=READY pgs=399 cs=0 l=1 rx=0x7f5ca8002f70 tx=0x7f5ca8007a80).stop 2020-05-18T21:31:21.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.453+0000 7f5cb39d6700 1 -- 172.21.15.63:0/985937000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cac0bbcd0 msgr2=0x7f5cac12e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:21.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.453+0000 7f5cb39d6700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cac0bbcd0 0x7f5cac12e1f0 secure :-1 s=READY pgs=1000 cs=0 l=1 rx=0x7f5c9c000bc0 tx=0x7f5c9c010900).stop 2020-05-18T21:31:21.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.453+0000 7f5cb39d6700 1 -- 172.21.15.63:0/985937000 shutdown_connections 2020-05-18T21:31:21.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.453+0000 7f5cb39d6700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5c8c04f830 0x7f5c8c051cf0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:21.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.453+0000 7f5cb39d6700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cac0bbcd0 0x7f5cac12e1f0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:21.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.453+0000 7f5cb39d6700 1 --2- 172.21.15.63:0/985937000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cac0bb5e0 0x7f5cac0b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:21.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.453+0000 7f5cb39d6700 1 -- 172.21.15.63:0/985937000 >> 172.21.15.63:0/985937000 conn(0x7f5cac069b70 msgr2=0x7f5cac060590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:21.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.453+0000 7f5cb39d6700 1 -- 172.21.15.63:0/985937000 shutdown_connections 2020-05-18T21:31:21.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.453+0000 7f5cb39d6700 1 -- 172.21.15.63:0/985937000 wait complete. 2020-05-18T21:31:21.463 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 47 2020-05-18T21:31:21.471 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-05-18T21:31:21.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.565+0000 7f8c05026700 1 Processor -- start 2020-05-18T21:31:21.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.565+0000 7f8c05026700 1 -- start start 2020-05-18T21:31:21.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8c05026700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c0005f860 0x7f8c000af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:21.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8c05026700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8c000b8ff0 0x7f8c0013c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:21.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8c05026700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c00065ee0 con 0x7f8c0013c530 2020-05-18T21:31:21.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8c05026700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0005f3a0 con 0x7f8c000b8ff0 2020-05-18T21:31:21.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8c05026700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c000ad3f0 con 0x7f8c0005f860 2020-05-18T21:31:21.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8bfe59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8c000b8ff0 0x7f8c0013c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8bfe59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8c000b8ff0 0x7f8c0013c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58046/0 (socket says 172.21.15.63:58046) 2020-05-18T21:31:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8bfe59c700 1 -- 172.21.15.63:0/3434875368 learned_addr learned my addr 172.21.15.63:0/3434875368 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8bfed9d700 1 --2- 172.21.15.63:0/3434875368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c0005f860 0x7f8c000af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:21.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8bfe59c700 1 -- 172.21.15.63:0/3434875368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c0005f860 msgr2=0x7f8c000af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:21.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8bfe59c700 1 --2- 172.21.15.63:0/3434875368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c0005f860 0x7f8c000af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:21.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8bfe59c700 1 -- 172.21.15.63:0/3434875368 >> v1:172.21.15.155:6789/0 conn(0x7f8c0013c530 legacy=0x7f8c0005ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:21.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8bfe59c700 1 -- 172.21.15.63:0/3434875368 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0013c9e0 con 0x7f8c000b8ff0 2020-05-18T21:31:21.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8bfdd9b700 1 -- 172.21.15.63:0/3434875368 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350494621 0 0) 0x7f8c00065ee0 con 0x7f8c0013c530 2020-05-18T21:31:21.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8bfe59c700 1 --2- 172.21.15.63:0/3434875368 >> v2:172.21.15.63:3300/0 conn(0x7f8c000b8ff0 0x7f8c0013c0d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8bf4002f70 tx=0x7f8bf4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8bfe59c700 1 --2- 172.21.15.63:0/3434875368 >> v2:172.21.15.63:3300/0 conn(0x7f8c000b8ff0 0x7f8c0013c0d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8bf4002f70 tx=0x7f8bf4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8bfe59c700 1 --2- 172.21.15.63:0/3434875368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c000b8ff0 0x7f8c0013c0d0 secure :-1 s=READY pgs=1001 cs=0 l=1 rx=0x7f8bf4002f70 tx=0x7f8bf4007a80).ready entity=mon.0 client_cookie=67d8a52a6126308d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8bfe59c700 1 --2- 172.21.15.63:0/3434875368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c000b8ff0 0x7f8c0013c0d0 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f8bf4002f70 tx=0x7f8bf4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8bfe59c700 1 --2- 172.21.15.63:0/3434875368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c000b8ff0 0x7f8c0013c0d0 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f8bf4002f70 tx=0x7f8bf4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8bfdd9b700 1 -- 172.21.15.63:0/3434875368 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bf40116b0 con 0x7f8c000b8ff0 2020-05-18T21:31:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8bfe59c700 1 --2- 172.21.15.63:0/3434875368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c000b8ff0 0x7f8c0013c0d0 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f8bf4002f70 tx=0x7f8bf4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8bfdd9b700 1 -- 172.21.15.63:0/3434875368 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf4011810 con 0x7f8c000b8ff0 2020-05-18T21:31:21.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8bfdd9b700 1 -- 172.21.15.63:0/3434875368 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bf4011bf0 con 0x7f8c000b8ff0 2020-05-18T21:31:21.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8c05026700 1 -- 172.21.15.63:0/3434875368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c000b8ff0 msgr2=0x7f8c0013c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:21.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8c05026700 1 --2- 172.21.15.63:0/3434875368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c000b8ff0 0x7f8c0013c0d0 secure :-1 s=READY pgs=1001 cs=0 l=1 rx=0x7f8bf4002f70 tx=0x7f8bf4007a80).stop 2020-05-18T21:31:21.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8c05026700 1 -- 172.21.15.63:0/3434875368 shutdown_connections 2020-05-18T21:31:21.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8c05026700 1 --2- 172.21.15.63:0/3434875368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c000b8ff0 0x7f8c0013c0d0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:21.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8c05026700 1 --2- 172.21.15.63:0/3434875368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c0005f860 0x7f8c000af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:21.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8c05026700 1 -- 172.21.15.63:0/3434875368 >> 172.21.15.63:0/3434875368 conn(0x7f8c000b83f0 msgr2=0x7f8c000b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:21.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8c05026700 1 -- 172.21.15.63:0/3434875368 shutdown_connections 2020-05-18T21:31:21.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.569+0000 7f8c05026700 1 -- 172.21.15.63:0/3434875368 wait complete. 2020-05-18T21:31:21.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8c05026700 1 Processor -- start 2020-05-18T21:31:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8c05026700 1 -- start start 2020-05-18T21:31:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8c05026700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8c0005f860 0x7f8c00142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8c05026700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8c000b8ff0 0x7f8c00156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8c05026700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c00157af0 con 0x7f8c0013c530 2020-05-18T21:31:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8c05026700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c00157110 con 0x7f8c0005f860 2020-05-18T21:31:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8c05026700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c001573b0 con 0x7f8c000b8ff0 2020-05-18T21:31:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8bfed9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8c0005f860 0x7f8c00142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8bfed9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8c0005f860 0x7f8c00142cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58052/0 (socket says 172.21.15.63:58052) 2020-05-18T21:31:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8bfed9d700 1 -- 172.21.15.63:0/1773316370 learned_addr learned my addr 172.21.15.63:0/1773316370 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8bfe59c700 1 --2- 172.21.15.63:0/1773316370 >> v2:172.21.15.155:3300/0 conn(0x7f8c000b8ff0 0x7f8c00156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:21.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8bfed9d700 1 -- 172.21.15.63:0/1773316370 >> v2:172.21.15.155:3300/0 conn(0x7f8c000b8ff0 msgr2=0x7f8c00156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:21.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8bfed9d700 1 --2- 172.21.15.63:0/1773316370 >> v2:172.21.15.155:3300/0 conn(0x7f8c000b8ff0 0x7f8c00156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:21.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8bfed9d700 1 -- 172.21.15.63:0/1773316370 >> v1:172.21.15.155:6789/0 conn(0x7f8c0013c530 legacy=0x7f8c00137bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:21.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8bfed9d700 1 -- 172.21.15.63:0/1773316370 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c00145f40 con 0x7f8c0005f860 2020-05-18T21:31:21.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8bfed9d700 1 --2- 172.21.15.63:0/1773316370 >> v2:172.21.15.63:3300/0 conn(0x7f8c0005f860 0x7f8c00142cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8bf00030b0 tx=0x7f8bf0010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8bfed9d700 1 --2- 172.21.15.63:0/1773316370 >> v2:172.21.15.63:3300/0 conn(0x7f8c0005f860 0x7f8c00142cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8bf00030b0 tx=0x7f8bf0010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8bfed9d700 1 --2- 172.21.15.63:0/1773316370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c0005f860 0x7f8c00142cf0 secure :-1 s=READY pgs=1002 cs=0 l=1 rx=0x7f8bf00030b0 tx=0x7f8bf0010cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:21.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8bfed9d700 1 --2- 172.21.15.63:0/1773316370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c0005f860 0x7f8c00142cf0 secure :-1 s=THROTTLE_DONE pgs=1002 cs=0 l=1 rx=0x7f8bf00030b0 tx=0x7f8bf0010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8beffff700 1 -- 172.21.15.63:0/1773316370 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bf0007180 con 0x7f8c0005f860 2020-05-18T21:31:21.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8bfed9d700 1 --2- 172.21.15.63:0/1773316370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c0005f860 0x7f8c00142cf0 secure :-1 s=THROTTLE_DONE pgs=1002 cs=0 l=1 rx=0x7f8bf00030b0 tx=0x7f8bf0010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8beffff700 1 -- 172.21.15.63:0/1773316370 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf00072e0 con 0x7f8c0005f860 2020-05-18T21:31:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8bfed9d700 1 --2- 172.21.15.63:0/1773316370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c0005f860 0x7f8c00142cf0 secure :-1 s=THROTTLE_DONE pgs=1002 cs=0 l=1 rx=0x7f8bf00030b0 tx=0x7f8bf0010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8c05026700 1 -- 172.21.15.63:0/1773316370 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c001382d0 con 0x7f8c0005f860 2020-05-18T21:31:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8beffff700 1 -- 172.21.15.63:0/1773316370 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bf0012330 con 0x7f8c0005f860 2020-05-18T21:31:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.573+0000 7f8c05026700 1 -- 172.21.15.63:0/1773316370 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c00064c50 con 0x7f8c0005f860 2020-05-18T21:31:21.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.577+0000 7f8bfed9d700 1 --2- 172.21.15.63:0/1773316370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c0005f860 0x7f8c00142cf0 secure :-1 s=THROTTLE_DONE pgs=1002 cs=0 l=1 rx=0x7f8bf00030b0 tx=0x7f8bf0010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.577+0000 7f8beffff700 1 -- 172.21.15.63:0/1773316370 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8bf0012570 con 0x7f8c0005f860 2020-05-18T21:31:21.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.577+0000 7f8bfed9d700 1 --2- 172.21.15.63:0/1773316370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c0005f860 0x7f8c00142cf0 secure :-1 s=THROTTLE_DONE pgs=1002 cs=0 l=1 rx=0x7f8bf00030b0 tx=0x7f8bf0010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.577+0000 7f8c05026700 1 -- 172.21.15.63:0/1773316370 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c00064f60 con 0x7f8c0005f860 2020-05-18T21:31:21.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.577+0000 7f8beffff700 1 --2- 172.21.15.63:0/1773316370 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8bdc04f990 0x7f8bdc051e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:21.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.577+0000 7f8beffff700 1 -- 172.21.15.63:0/1773316370 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8bf00642a0 con 0x7f8c0005f860 2020-05-18T21:31:21.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.577+0000 7f8bfe59c700 1 --2- 172.21.15.63:0/1773316370 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8bdc04f990 0x7f8bdc051e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:21.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.577+0000 7f8bfe59c700 1 --2- 172.21.15.63:0/1773316370 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8bdc04f990 0x7f8bdc051e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8bf4002f70 tx=0x7f8bf4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.577+0000 7f8bfe59c700 1 --2- 172.21.15.63:0/1773316370 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8bdc04f990 0x7f8bdc051e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8bf4002f70 tx=0x7f8bf4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.577+0000 7f8bfe59c700 1 --2- 172.21.15.63:0/1773316370 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8bdc04f990 0x7f8bdc051e50 secure :-1 s=READY pgs=400 cs=0 l=1 rx=0x7f8bf4002f70 tx=0x7f8bf4007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:21.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.585+0000 7f8bfed9d700 1 --2- 172.21.15.63:0/1773316370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c0005f860 0x7f8c00142cf0 secure :-1 s=THROTTLE_DONE pgs=1002 cs=0 l=1 rx=0x7f8bf00030b0 tx=0x7f8bf0010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:21.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.585+0000 7f8beffff700 1 -- 172.21.15.63:0/1773316370 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f8bf003e630 con 0x7f8c0005f860 2020-05-18T21:31:21.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:21.737+0000 7f8c05026700 1 -- 172.21.15.63:0/1773316370 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8c000569e0 con 0x7f8c0005f860 2020-05-18T21:31:22.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.573+0000 7f8bfed9d700 1 --2- 172.21.15.63:0/1773316370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c0005f860 0x7f8c00142cf0 secure :-1 s=READY pgs=1002 cs=0 l=1 rx=0x7f8bf00030b0 tx=0x7f8bf0010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:22.668 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:31:22.661+0000 7fdb4592c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:31:22.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.677+0000 7f8bfed9d700 1 --2- 172.21.15.63:0/1773316370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c0005f860 0x7f8c00142cf0 secure :-1 s=THROTTLE_DONE pgs=1002 cs=0 l=1 rx=0x7f8bf00030b0 tx=0x7f8bf0010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:22.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.677+0000 7f8beffff700 1 -- 172.21.15.63:0/1773316370 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8bf0041c50 con 0x7f8c0005f860 2020-05-18T21:31:22.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.681+0000 7f8c05026700 1 -- 172.21.15.63:0/1773316370 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8bdc04f990 msgr2=0x7f8bdc051e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:22.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.681+0000 7f8c05026700 1 --2- 172.21.15.63:0/1773316370 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8bdc04f990 0x7f8bdc051e50 secure :-1 s=READY pgs=400 cs=0 l=1 rx=0x7f8bf4002f70 tx=0x7f8bf4007a80).stop 2020-05-18T21:31:22.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.681+0000 7f8c05026700 1 -- 172.21.15.63:0/1773316370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c0005f860 msgr2=0x7f8c00142cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:22.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.681+0000 7f8c05026700 1 --2- 172.21.15.63:0/1773316370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c0005f860 0x7f8c00142cf0 secure :-1 s=READY pgs=1002 cs=0 l=1 rx=0x7f8bf00030b0 tx=0x7f8bf0010cd0).stop 2020-05-18T21:31:22.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.681+0000 7f8c05026700 1 -- 172.21.15.63:0/1773316370 shutdown_connections 2020-05-18T21:31:22.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.681+0000 7f8c05026700 1 --2- 172.21.15.63:0/1773316370 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8bdc04f990 0x7f8bdc051e50 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:22.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.681+0000 7f8c05026700 1 --2- 172.21.15.63:0/1773316370 >> v2:172.21.15.155:3300/0 conn(0x7f8c000b8ff0 0x7f8c00156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:22.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.681+0000 7f8c05026700 1 --2- 172.21.15.63:0/1773316370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c0005f860 0x7f8c00142cf0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:22.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.681+0000 7f8c05026700 1 -- 172.21.15.63:0/1773316370 >> 172.21.15.63:0/1773316370 conn(0x7f8c000b83f0 msgr2=0x7f8c000b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:22.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.681+0000 7f8c05026700 1 -- 172.21.15.63:0/1773316370 shutdown_connections 2020-05-18T21:31:22.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.681+0000 7f8c05026700 1 -- 172.21.15.63:0/1773316370 wait complete. 2020-05-18T21:31:22.687 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-05-18T21:31:22.700 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:22.719 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:31:22.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.801+0000 7f9c10fd6700 1 Processor -- start 2020-05-18T21:31:22.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.801+0000 7f9c10fd6700 1 -- start start 2020-05-18T21:31:22.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.801+0000 7f9c10fd6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c0c09e7f0 0x7f9c0c06a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:22.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.801+0000 7f9c10fd6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c0c0b5040 0x7f9c0c141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:22.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.801+0000 7f9c10fd6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0c0b5750 con 0x7f9c0c141f20 2020-05-18T21:31:22.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.801+0000 7f9c10fd6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0c142390 con 0x7f9c0c0b5040 2020-05-18T21:31:22.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.801+0000 7f9c10fd6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c0b59f0 con 0x7f9c0c09e7f0 2020-05-18T21:31:22.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c0a59c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c0c09e7f0 0x7f9c0c06a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:22.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c09d9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c0c0b5040 0x7f9c0c141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:22.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c0a59c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c0c09e7f0 0x7f9c0c06a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:48774/0 (socket says 172.21.15.63:48774) 2020-05-18T21:31:22.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c0ad9d700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f9c0c141f20 0x7f9c0c0610e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:58580/0 (socket says 172.21.15.63:58580) 2020-05-18T21:31:22.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c0a59c700 1 -- 172.21.15.63:0/178958419 learned_addr learned my addr 172.21.15.63:0/178958419 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:22.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c09d9b700 1 -- 172.21.15.63:0/178958419 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c0c09e7f0 msgr2=0x7f9c0c06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:22.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c09d9b700 1 --2- 172.21.15.63:0/178958419 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c0c09e7f0 0x7f9c0c06a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:22.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c09d9b700 1 -- 172.21.15.63:0/178958419 >> v1:172.21.15.155:6789/0 conn(0x7f9c0c141f20 legacy=0x7f9c0c0610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:22.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c09d9b700 1 -- 172.21.15.63:0/178958419 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c0b5c90 con 0x7f9c0c0b5040 2020-05-18T21:31:22.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c0959a700 1 -- 172.21.15.63:0/178958419 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007282710 0 0) 0x7f9c0c0b5750 con 0x7f9c0c141f20 2020-05-18T21:31:22.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c0a59c700 1 --2- 172.21.15.63:0/178958419 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c0c09e7f0 0x7f9c0c06a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:31:22.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c09d9b700 1 --2- 172.21.15.63:0/178958419 >> v2:172.21.15.155:3300/0 conn(0x7f9c0c0b5040 0x7f9c0c141ac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9c00002f70 tx=0x7f9c00007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:22.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c09d9b700 1 --2- 172.21.15.63:0/178958419 >> v2:172.21.15.155:3300/0 conn(0x7f9c0c0b5040 0x7f9c0c141ac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9c00002f70 tx=0x7f9c00007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:22.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c09d9b700 1 --2- 172.21.15.63:0/178958419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c0c0b5040 0x7f9c0c141ac0 secure :-1 s=READY pgs=702 cs=0 l=1 rx=0x7f9c00002f70 tx=0x7f9c00007a80).ready entity=mon.1 client_cookie=c40eafcbb0374ceb server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:22.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c09d9b700 1 --2- 172.21.15.63:0/178958419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c0c0b5040 0x7f9c0c141ac0 secure :-1 s=THROTTLE_DONE pgs=702 cs=0 l=1 rx=0x7f9c00002f70 tx=0x7f9c00007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:22.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c0959a700 1 -- 172.21.15.63:0/178958419 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c00008e80 con 0x7f9c0c0b5040 2020-05-18T21:31:22.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c09d9b700 1 --2- 172.21.15.63:0/178958419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c0c0b5040 0x7f9c0c141ac0 secure :-1 s=THROTTLE_DONE pgs=702 cs=0 l=1 rx=0x7f9c00002f70 tx=0x7f9c00007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:22.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c09d9b700 1 --2- 172.21.15.63:0/178958419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c0c0b5040 0x7f9c0c141ac0 secure :-1 s=THROTTLE_DONE pgs=702 cs=0 l=1 rx=0x7f9c00002f70 tx=0x7f9c00007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:22.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c0959a700 1 -- 172.21.15.63:0/178958419 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c000115f0 con 0x7f9c0c0b5040 2020-05-18T21:31:22.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c0959a700 1 -- 172.21.15.63:0/178958419 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c000119d0 con 0x7f9c0c0b5040 2020-05-18T21:31:22.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c10fd6700 1 -- 172.21.15.63:0/178958419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c0c0b5040 msgr2=0x7f9c0c141ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:22.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c10fd6700 1 --2- 172.21.15.63:0/178958419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c0c0b5040 0x7f9c0c141ac0 secure :-1 s=READY pgs=702 cs=0 l=1 rx=0x7f9c00002f70 tx=0x7f9c00007a80).stop 2020-05-18T21:31:22.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c10fd6700 1 -- 172.21.15.63:0/178958419 shutdown_connections 2020-05-18T21:31:22.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c10fd6700 1 --2- 172.21.15.63:0/178958419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c0c0b5040 0x7f9c0c141ac0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:22.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c10fd6700 1 --2- 172.21.15.63:0/178958419 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c0c09e7f0 0x7f9c0c06a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:22.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c10fd6700 1 -- 172.21.15.63:0/178958419 >> 172.21.15.63:0/178958419 conn(0x7f9c0c05b240 msgr2=0x7f9c0c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:22.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c10fd6700 1 -- 172.21.15.63:0/178958419 shutdown_connections 2020-05-18T21:31:22.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.805+0000 7f9c10fd6700 1 -- 172.21.15.63:0/178958419 wait complete. 2020-05-18T21:31:22.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c10fd6700 1 Processor -- start 2020-05-18T21:31:22.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c10fd6700 1 -- start start 2020-05-18T21:31:22.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c10fd6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c0c09e7f0 0x7f9c0c0b93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:22.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c10fd6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c0c0b5040 0x7f9c0c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:22.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c10fd6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0c09abc0 con 0x7f9c0c141f20 2020-05-18T21:31:22.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c10fd6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0c0b29c0 con 0x7f9c0c09e7f0 2020-05-18T21:31:22.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c10fd6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c156740 con 0x7f9c0c0b5040 2020-05-18T21:31:22.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c0a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c0c09e7f0 0x7f9c0c0b93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:22.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c0ad9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9c0c141f20 0x7f9c0c153090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60270/0 (socket says 172.21.15.63:60270) 2020-05-18T21:31:22.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c0ad9d700 1 -- 172.21.15.63:0/578820397 learned_addr learned my addr 172.21.15.63:0/578820397 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:22.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c09d9b700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c0c0b5040 0x7f9c0c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:22.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c0a59c700 1 -- 172.21.15.63:0/578820397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c0c0b5040 msgr2=0x7f9c0c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:22.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c0a59c700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c0c0b5040 0x7f9c0c0b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:22.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c0a59c700 1 -- 172.21.15.63:0/578820397 >> v1:172.21.15.63:6789/0 conn(0x7f9c0c141f20 legacy=0x7f9c0c153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:22.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9bfb7fe700 1 -- 172.21.15.63:0/578820397 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662767939 0 0) 0x7f9c0c09abc0 con 0x7f9c0c141f20 2020-05-18T21:31:22.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c0a59c700 1 -- 172.21.15.63:0/578820397 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c09ae60 con 0x7f9c0c09e7f0 2020-05-18T21:31:22.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c0a59c700 1 --2- 172.21.15.63:0/578820397 >> v2:172.21.15.63:3300/0 conn(0x7f9c0c09e7f0 0x7f9c0c0b93b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9bfc002f70 tx=0x7f9bfc010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:22.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c0a59c700 1 --2- 172.21.15.63:0/578820397 >> v2:172.21.15.63:3300/0 conn(0x7f9c0c09e7f0 0x7f9c0c0b93b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9bfc002f70 tx=0x7f9bfc010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:22.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c0a59c700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c09e7f0 0x7f9c0c0b93b0 secure :-1 s=READY pgs=1007 cs=0 l=1 rx=0x7f9bfc002f70 tx=0x7f9bfc010db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:22.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c0a59c700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c09e7f0 0x7f9c0c0b93b0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7f9bfc002f70 tx=0x7f9bfc010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:22.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9bfb7fe700 1 -- 172.21.15.63:0/578820397 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bfc007560 con 0x7f9c0c09e7f0 2020-05-18T21:31:22.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c0a59c700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c09e7f0 0x7f9c0c0b93b0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7f9bfc002f70 tx=0x7f9bfc010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:22.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9bfb7fe700 1 -- 172.21.15.63:0/578820397 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bfc005a00 con 0x7f9c0c09e7f0 2020-05-18T21:31:22.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c0a59c700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c09e7f0 0x7f9c0c0b93b0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7f9bfc002f70 tx=0x7f9bfc010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:22.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c10fd6700 1 -- 172.21.15.63:0/578820397 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0c1537a0 con 0x7f9c0c09e7f0 2020-05-18T21:31:22.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9bfb7fe700 1 -- 172.21.15.63:0/578820397 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bfc005da0 con 0x7f9c0c09e7f0 2020-05-18T21:31:22.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.809+0000 7f9c10fd6700 1 -- 172.21.15.63:0/578820397 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0c0b15d0 con 0x7f9c0c09e7f0 2020-05-18T21:31:22.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.813+0000 7f9c0a59c700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c09e7f0 0x7f9c0c0b93b0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7f9bfc002f70 tx=0x7f9bfc010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:22.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.813+0000 7f9c10fd6700 1 -- 172.21.15.63:0/578820397 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0c0569e0 con 0x7f9c0c09e7f0 2020-05-18T21:31:22.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.813+0000 7f9bfb7fe700 1 -- 172.21.15.63:0/578820397 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9bfc009490 con 0x7f9c0c09e7f0 2020-05-18T21:31:22.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.813+0000 7f9c0a59c700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c09e7f0 0x7f9c0c0b93b0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7f9bfc002f70 tx=0x7f9bfc010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:22.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.813+0000 7f9bfb7fe700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9be804f7d0 0x7f9be8051c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:22.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.813+0000 7f9bfb7fe700 1 -- 172.21.15.63:0/578820397 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f9bfc063db0 con 0x7f9c0c09e7f0 2020-05-18T21:31:22.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.813+0000 7f9c09d9b700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9be804f7d0 0x7f9be8051c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:22.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.817+0000 7f9c09d9b700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9be804f7d0 0x7f9be8051c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c00002f70 tx=0x7f9c00007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:22.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.817+0000 7f9c09d9b700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9be804f7d0 0x7f9be8051c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c00002f70 tx=0x7f9c00007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:22.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.817+0000 7f9c09d9b700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9be804f7d0 0x7f9be8051c90 secure :-1 s=READY pgs=401 cs=0 l=1 rx=0x7f9c00002f70 tx=0x7f9c00007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:22.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.821+0000 7f9c0a59c700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c09e7f0 0x7f9c0c0b93b0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7f9bfc002f70 tx=0x7f9bfc010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:22.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.821+0000 7f9bfb7fe700 1 -- 172.21.15.63:0/578820397 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9bfc03e140 con 0x7f9c0c09e7f0 2020-05-18T21:31:22.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.973+0000 7f9c10fd6700 1 -- 172.21.15.63:0/578820397 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c0c1568b0 con 0x7f9c0c09e7f0 2020-05-18T21:31:22.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.973+0000 7f9c0a59c700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c09e7f0 0x7f9c0c0b93b0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7f9bfc002f70 tx=0x7f9bfc010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:22.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.973+0000 7f9bfb7fe700 1 -- 172.21.15.63:0/578820397 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+1782 (secure 0 0 0) 0x7f9bfc041760 con 0x7f9c0c09e7f0 2020-05-18T21:31:22.978 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:22.978 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/4229036043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4229036043},{"type":"v1","addr":"172.21.15.155:6835","nonce":4229036043}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":48,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:30:08.365002+0000","modified":"2020-05-18T21:31:22.667479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-05-18T21:31:22.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.973+0000 7f9c10fd6700 1 -- 172.21.15.63:0/578820397 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9be804f7d0 msgr2=0x7f9be8051c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:22.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.973+0000 7f9c10fd6700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9be804f7d0 0x7f9be8051c90 secure :-1 s=READY pgs=401 cs=0 l=1 rx=0x7f9c00002f70 tx=0x7f9c00007a80).stop 2020-05-18T21:31:22.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.973+0000 7f9c10fd6700 1 -- 172.21.15.63:0/578820397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c09e7f0 msgr2=0x7f9c0c0b93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:22.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.973+0000 7f9c10fd6700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c09e7f0 0x7f9c0c0b93b0 secure :-1 s=READY pgs=1007 cs=0 l=1 rx=0x7f9bfc002f70 tx=0x7f9bfc010db0).stop 2020-05-18T21:31:22.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.973+0000 7f9c10fd6700 1 -- 172.21.15.63:0/578820397 shutdown_connections 2020-05-18T21:31:22.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.973+0000 7f9c10fd6700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9be804f7d0 0x7f9be8051c90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:22.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.973+0000 7f9c10fd6700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c0c0b5040 0x7f9c0c0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:22.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.973+0000 7f9c10fd6700 1 --2- 172.21.15.63:0/578820397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c09e7f0 0x7f9c0c0b93b0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:22.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.973+0000 7f9c10fd6700 1 -- 172.21.15.63:0/578820397 >> 172.21.15.63:0/578820397 conn(0x7f9c0c05b240 msgr2=0x7f9c0c066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:22.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.973+0000 7f9c10fd6700 1 -- 172.21.15.63:0/578820397 shutdown_connections 2020-05-18T21:31:22.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:22.973+0000 7f9c10fd6700 1 -- 172.21.15.63:0/578820397 wait complete. 2020-05-18T21:31:22.982 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 48 2020-05-18T21:31:22.990 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-05-18T21:31:23.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f7996850700 1 Processor -- start 2020-05-18T21:31:23.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f7996850700 1 -- start start 2020-05-18T21:31:23.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f7996850700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f79901440a0 0x7f7990061130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:23.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f7996850700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f799014d690 0x7f799014dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:23.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f7996850700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7990063360 con 0x7f799014df30 2020-05-18T21:31:23.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f7996850700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799014e3e0 con 0x7f799014d690 2020-05-18T21:31:23.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f7996850700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7990063600 con 0x7f79901440a0 2020-05-18T21:31:23.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f799504d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f799014d690 0x7f799014dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:23.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f799504d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f799014d690 0x7f799014dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58088/0 (socket says 172.21.15.63:58088) 2020-05-18T21:31:23.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f799504d700 1 -- 172.21.15.63:0/2294440210 learned_addr learned my addr 172.21.15.63:0/2294440210 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:23.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f799584e700 1 --2- 172.21.15.63:0/2294440210 >> v2:172.21.15.155:3300/0 conn(0x7f79901440a0 0x7f7990061130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:23.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f799504d700 1 -- 172.21.15.63:0/2294440210 >> v2:172.21.15.155:3300/0 conn(0x7f79901440a0 msgr2=0x7f7990061130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:23.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f799504d700 1 --2- 172.21.15.63:0/2294440210 >> v2:172.21.15.155:3300/0 conn(0x7f79901440a0 0x7f7990061130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:23.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f799504d700 1 -- 172.21.15.63:0/2294440210 >> v1:172.21.15.155:6789/0 conn(0x7f799014df30 legacy=0x7f799014a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:23.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f799504d700 1 -- 172.21.15.63:0/2294440210 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79900638a0 con 0x7f799014d690 2020-05-18T21:31:23.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f799504d700 1 --2- 172.21.15.63:0/2294440210 >> v2:172.21.15.63:3300/0 conn(0x7f799014d690 0x7f799014dad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f79880032f0 tx=0x7f7988007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f799504d700 1 --2- 172.21.15.63:0/2294440210 >> v2:172.21.15.63:3300/0 conn(0x7f799014d690 0x7f799014dad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f79880032f0 tx=0x7f7988007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f799504d700 1 --2- 172.21.15.63:0/2294440210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f799014d690 0x7f799014dad0 secure :-1 s=READY pgs=1008 cs=0 l=1 rx=0x7f79880032f0 tx=0x7f7988007e00).ready entity=mon.0 client_cookie=b9a68a4a62eae4a8 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:23.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f799504d700 1 --2- 172.21.15.63:0/2294440210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f799014d690 0x7f799014dad0 secure :-1 s=THROTTLE_DONE pgs=1008 cs=0 l=1 rx=0x7f79880032f0 tx=0x7f7988007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f799484c700 1 -- 172.21.15.63:0/2294440210 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7988010e60 con 0x7f799014d690 2020-05-18T21:31:23.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f799504d700 1 --2- 172.21.15.63:0/2294440210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f799014d690 0x7f799014dad0 secure :-1 s=THROTTLE_DONE pgs=1008 cs=0 l=1 rx=0x7f79880032f0 tx=0x7f7988007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f799484c700 1 -- 172.21.15.63:0/2294440210 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79880112c0 con 0x7f799014d690 2020-05-18T21:31:23.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f799504d700 1 --2- 172.21.15.63:0/2294440210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f799014d690 0x7f799014dad0 secure :-1 s=THROTTLE_DONE pgs=1008 cs=0 l=1 rx=0x7f79880032f0 tx=0x7f7988007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f799484c700 1 -- 172.21.15.63:0/2294440210 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79880116a0 con 0x7f799014d690 2020-05-18T21:31:23.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f7996850700 1 -- 172.21.15.63:0/2294440210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f799014d690 msgr2=0x7f799014dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:23.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f7996850700 1 --2- 172.21.15.63:0/2294440210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f799014d690 0x7f799014dad0 secure :-1 s=READY pgs=1008 cs=0 l=1 rx=0x7f79880032f0 tx=0x7f7988007e00).stop 2020-05-18T21:31:23.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f7996850700 1 -- 172.21.15.63:0/2294440210 shutdown_connections 2020-05-18T21:31:23.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f7996850700 1 --2- 172.21.15.63:0/2294440210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f799014d690 0x7f799014dad0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:23.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f7996850700 1 --2- 172.21.15.63:0/2294440210 >> v2:172.21.15.155:3300/0 conn(0x7f79901440a0 0x7f7990061130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:23.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f7996850700 1 -- 172.21.15.63:0/2294440210 >> 172.21.15.63:0/2294440210 conn(0x7f7990069b70 msgr2=0x7f7990069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:23.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f7996850700 1 -- 172.21.15.63:0/2294440210 shutdown_connections 2020-05-18T21:31:23.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.089+0000 7f7996850700 1 -- 172.21.15.63:0/2294440210 wait complete. 2020-05-18T21:31:23.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.093+0000 7f7996850700 1 Processor -- start 2020-05-18T21:31:23.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.093+0000 7f7996850700 1 -- start start 2020-05-18T21:31:23.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.093+0000 7f7996850700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f79901440a0 0x7f79900ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:23.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.093+0000 7f7996850700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79900acc70 con 0x7f799014df30 2020-05-18T21:31:23.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.093+0000 7f7996850700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799015ad00 con 0x7f799014d690 2020-05-18T21:31:23.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.093+0000 7f7996850700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799015afa0 con 0x7f79901440a0 2020-05-18T21:31:23.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.093+0000 7f799604f700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f799014df30 0x7f7990157420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60282/0 (socket says 172.21.15.63:60282) 2020-05-18T21:31:23.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.093+0000 7f799604f700 1 -- 172.21.15.63:0/2387719234 learned_addr learned my addr 172.21.15.63:0/2387719234 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:23.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.093+0000 7f799584e700 1 --2- 172.21.15.63:0/2387719234 >> v2:172.21.15.63:3300/0 conn(0x7f79901440a0 0x7f79900ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:23.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.093+0000 7f7982ffd700 1 -- 172.21.15.63:0/2387719234 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549793918 0 0) 0x7f79900acc70 con 0x7f799014df30 2020-05-18T21:31:23.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.093+0000 7f7982ffd700 1 -- 172.21.15.63:0/2387719234 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7978002fe0 con 0x7f799014df30 2020-05-18T21:31:23.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f7982ffd700 1 -- 172.21.15.63:0/2387719234 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736507895 0 0) 0x7f799015ad00 con 0x7f799014d690 2020-05-18T21:31:23.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f799584e700 1 -- 172.21.15.63:0/2387719234 >> v1:172.21.15.155:6789/0 conn(0x7f799014d690 legacy=0x7f7990148e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:23.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f799584e700 1 -- 172.21.15.63:0/2387719234 >> v1:172.21.15.63:6789/0 conn(0x7f799014df30 legacy=0x7f7990157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:23.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f799584e700 1 -- 172.21.15.63:0/2387719234 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799015b240 con 0x7f79901440a0 2020-05-18T21:31:23.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f799584e700 1 --2- 172.21.15.63:0/2387719234 >> v2:172.21.15.63:3300/0 conn(0x7f79901440a0 0x7f79900ac810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7984001600 tx=0x7f798c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f799584e700 1 --2- 172.21.15.63:0/2387719234 >> v2:172.21.15.63:3300/0 conn(0x7f79901440a0 0x7f79900ac810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7984001600 tx=0x7f798c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f799584e700 1 --2- 172.21.15.63:0/2387719234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79901440a0 0x7f79900ac810 secure :-1 s=READY pgs=1010 cs=0 l=1 rx=0x7f7984001600 tx=0x7f798c010b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:23.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f799584e700 1 --2- 172.21.15.63:0/2387719234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79901440a0 0x7f79900ac810 secure :-1 s=THROTTLE_DONE pgs=1010 cs=0 l=1 rx=0x7f7984001600 tx=0x7f798c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f7982ffd700 1 -- 172.21.15.63:0/2387719234 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f798c007180 con 0x7f79901440a0 2020-05-18T21:31:23.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f799584e700 1 --2- 172.21.15.63:0/2387719234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79901440a0 0x7f79900ac810 secure :-1 s=THROTTLE_DONE pgs=1010 cs=0 l=1 rx=0x7f7984001600 tx=0x7f798c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f799584e700 1 --2- 172.21.15.63:0/2387719234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79901440a0 0x7f79900ac810 secure :-1 s=THROTTLE_DONE pgs=1010 cs=0 l=1 rx=0x7f7984001600 tx=0x7f798c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f7982ffd700 1 -- 172.21.15.63:0/2387719234 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c0072e0 con 0x7f79901440a0 2020-05-18T21:31:23.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f7982ffd700 1 -- 172.21.15.63:0/2387719234 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f798c007640 con 0x7f79901440a0 2020-05-18T21:31:23.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f7996850700 1 -- 172.21.15.63:0/2387719234 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799015a9f0 con 0x7f79901440a0 2020-05-18T21:31:23.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f7996850700 1 -- 172.21.15.63:0/2387719234 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7990149550 con 0x7f79901440a0 2020-05-18T21:31:23.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f799584e700 1 --2- 172.21.15.63:0/2387719234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79901440a0 0x7f79900ac810 secure :-1 s=THROTTLE_DONE pgs=1010 cs=0 l=1 rx=0x7f7984001600 tx=0x7f798c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f7996850700 1 -- 172.21.15.63:0/2387719234 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799015b3d0 con 0x7f79901440a0 2020-05-18T21:31:23.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f7982ffd700 1 -- 172.21.15.63:0/2387719234 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f798c00e220 con 0x7f79901440a0 2020-05-18T21:31:23.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f799584e700 1 --2- 172.21.15.63:0/2387719234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79901440a0 0x7f79900ac810 secure :-1 s=THROTTLE_DONE pgs=1010 cs=0 l=1 rx=0x7f7984001600 tx=0x7f798c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f7982ffd700 1 --2- 172.21.15.63:0/2387719234 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f797804fca0 0x7f7978052160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:23.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f7982ffd700 1 -- 172.21.15.63:0/2387719234 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f798c063d50 con 0x7f79901440a0 2020-05-18T21:31:23.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f799504d700 1 --2- 172.21.15.63:0/2387719234 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f797804fca0 0x7f7978052160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:23.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f799504d700 1 --2- 172.21.15.63:0/2387719234 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f797804fca0 0x7f7978052160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79880086e0 tx=0x7f7988007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f799504d700 1 --2- 172.21.15.63:0/2387719234 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f797804fca0 0x7f7978052160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79880086e0 tx=0x7f7988007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.097+0000 7f799504d700 1 --2- 172.21.15.63:0/2387719234 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f797804fca0 0x7f7978052160 secure :-1 s=READY pgs=402 cs=0 l=1 rx=0x7f79880086e0 tx=0x7f7988007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:23.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.105+0000 7f799584e700 1 --2- 172.21.15.63:0/2387719234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79901440a0 0x7f79900ac810 secure :-1 s=THROTTLE_DONE pgs=1010 cs=0 l=1 rx=0x7f7984001600 tx=0x7f798c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.105+0000 7f7982ffd700 1 -- 172.21.15.63:0/2387719234 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f798c03e080 con 0x7f79901440a0 2020-05-18T21:31:23.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.253+0000 7f7996850700 1 -- 172.21.15.63:0/2387719234 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f79900569e0 con 0x7f79901440a0 2020-05-18T21:31:23.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.681+0000 7f799584e700 1 --2- 172.21.15.63:0/2387719234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79901440a0 0x7f79900ac810 secure :-1 s=THROTTLE_DONE pgs=1010 cs=0 l=1 rx=0x7f7984001600 tx=0x7f798c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.681+0000 7f7982ffd700 1 -- 172.21.15.63:0/2387719234 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) v1 ==== 104+0+0 (secure 0 0 0) 0x7f798c0416a0 con 0x7f79901440a0 2020-05-18T21:31:23.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.685+0000 7f7996850700 1 -- 172.21.15.63:0/2387719234 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f797804fca0 msgr2=0x7f7978052160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:23.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.685+0000 7f7996850700 1 --2- 172.21.15.63:0/2387719234 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f797804fca0 0x7f7978052160 secure :-1 s=READY pgs=402 cs=0 l=1 rx=0x7f79880086e0 tx=0x7f7988007e00).stop 2020-05-18T21:31:23.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.685+0000 7f7996850700 1 -- 172.21.15.63:0/2387719234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79901440a0 msgr2=0x7f79900ac810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:23.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.685+0000 7f7996850700 1 --2- 172.21.15.63:0/2387719234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79901440a0 0x7f79900ac810 secure :-1 s=READY pgs=1010 cs=0 l=1 rx=0x7f7984001600 tx=0x7f798c010b90).stop 2020-05-18T21:31:23.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.685+0000 7f7996850700 1 -- 172.21.15.63:0/2387719234 shutdown_connections 2020-05-18T21:31:23.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.685+0000 7f7996850700 1 --2- 172.21.15.63:0/2387719234 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f797804fca0 0x7f7978052160 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:23.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.685+0000 7f7996850700 1 --2- 172.21.15.63:0/2387719234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79901440a0 0x7f79900ac810 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:23.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.685+0000 7f7996850700 1 -- 172.21.15.63:0/2387719234 >> 172.21.15.63:0/2387719234 conn(0x7f7990069b70 msgr2=0x7f799014c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:23.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.685+0000 7f7996850700 1 -- 172.21.15.63:0/2387719234 shutdown_connections 2020-05-18T21:31:23.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.685+0000 7f7996850700 1 -- 172.21.15.63:0/2387719234 wait complete. 2020-05-18T21:31:23.706 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-05-18T21:31:23.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.817+0000 7fe376ed8700 1 Processor -- start 2020-05-18T21:31:23.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.817+0000 7fe376ed8700 1 -- start start 2020-05-18T21:31:23.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.817+0000 7fe376ed8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe3700b6d90 0x7fe37012ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:23.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.817+0000 7fe376ed8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe370060890 con 0x7fe3700b8630 2020-05-18T21:31:23.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.817+0000 7fe376ed8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe370060b30 con 0x7fe3700b9500 2020-05-18T21:31:23.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.817+0000 7fe376ed8700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe370060dd0 con 0x7fe3700b6d90 2020-05-18T21:31:23.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.817+0000 7fe375475700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe3700b6d90 0x7fe37012ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:23.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.817+0000 7fe367fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe3700b8630 0x7fe3700b42b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60292/0 (socket says 172.21.15.63:60292) 2020-05-18T21:31:23.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe367fff700 1 -- 172.21.15.63:0/1189992725 learned_addr learned my addr 172.21.15.63:0/1189992725 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:23.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe3677fe700 1 -- 172.21.15.63:0/1189992725 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855738465 0 0) 0x7fe370060890 con 0x7fe3700b8630 2020-05-18T21:31:23.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe3677fe700 1 -- 172.21.15.63:0/1189992725 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe35c003270 con 0x7fe3700b8630 2020-05-18T21:31:23.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe375475700 1 -- 172.21.15.63:0/1189992725 >> v1:172.21.15.155:6789/0 conn(0x7fe3700b9500 legacy=0x7fe370061270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:23.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe375475700 1 -- 172.21.15.63:0/1189992725 >> v1:172.21.15.63:6789/0 conn(0x7fe3700b8630 legacy=0x7fe3700b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:23.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe375475700 1 -- 172.21.15.63:0/1189992725 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3700b98e0 con 0x7fe3700b6d90 2020-05-18T21:31:23.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe375475700 1 --2- 172.21.15.63:0/1189992725 >> v2:172.21.15.63:3300/0 conn(0x7fe3700b6d90 0x7fe37012ed60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe3700b8000 tx=0x7fe368008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe375475700 1 --2- 172.21.15.63:0/1189992725 >> v2:172.21.15.63:3300/0 conn(0x7fe3700b6d90 0x7fe37012ed60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe3700b8000 tx=0x7fe368008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe375475700 1 --2- 172.21.15.63:0/1189992725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3700b6d90 0x7fe37012ed60 secure :-1 s=READY pgs=1012 cs=0 l=1 rx=0x7fe3700b8000 tx=0x7fe368008ca0).ready entity=mon.0 client_cookie=ca3ac9cf0a46a2c3 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:23.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe375475700 1 --2- 172.21.15.63:0/1189992725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3700b6d90 0x7fe37012ed60 secure :-1 s=THROTTLE_DONE pgs=1012 cs=0 l=1 rx=0x7fe3700b8000 tx=0x7fe368008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe3677fe700 1 -- 172.21.15.63:0/1189992725 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe368011e60 con 0x7fe3700b6d90 2020-05-18T21:31:23.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe375475700 1 --2- 172.21.15.63:0/1189992725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3700b6d90 0x7fe37012ed60 secure :-1 s=THROTTLE_DONE pgs=1012 cs=0 l=1 rx=0x7fe3700b8000 tx=0x7fe368008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe375475700 1 --2- 172.21.15.63:0/1189992725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3700b6d90 0x7fe37012ed60 secure :-1 s=THROTTLE_DONE pgs=1012 cs=0 l=1 rx=0x7fe3700b8000 tx=0x7fe368008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe3677fe700 1 -- 172.21.15.63:0/1189992725 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36800a180 con 0x7fe3700b6d90 2020-05-18T21:31:23.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe3677fe700 1 -- 172.21.15.63:0/1189992725 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe36800a520 con 0x7fe3700b6d90 2020-05-18T21:31:23.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe376ed8700 1 -- 172.21.15.63:0/1189992725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3700b6d90 msgr2=0x7fe37012ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:23.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe376ed8700 1 --2- 172.21.15.63:0/1189992725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3700b6d90 0x7fe37012ed60 secure :-1 s=READY pgs=1012 cs=0 l=1 rx=0x7fe3700b8000 tx=0x7fe368008ca0).stop 2020-05-18T21:31:23.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe376ed8700 1 -- 172.21.15.63:0/1189992725 shutdown_connections 2020-05-18T21:31:23.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe376ed8700 1 --2- 172.21.15.63:0/1189992725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3700b6d90 0x7fe37012ed60 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:23.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe376ed8700 1 -- 172.21.15.63:0/1189992725 >> 172.21.15.63:0/1189992725 conn(0x7fe370069b70 msgr2=0x7fe370069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:23.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe376ed8700 1 -- 172.21.15.63:0/1189992725 shutdown_connections 2020-05-18T21:31:23.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.821+0000 7fe376ed8700 1 -- 172.21.15.63:0/1189992725 wait complete. 2020-05-18T21:31:23.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.825+0000 7fe376ed8700 1 Processor -- start 2020-05-18T21:31:23.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.825+0000 7fe376ed8700 1 -- start start 2020-05-18T21:31:23.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.825+0000 7fe376ed8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3700b6d90 0x7fe37012d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:23.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.825+0000 7fe376ed8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe3700b9500 0x7fe370131b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:23.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.825+0000 7fe376ed8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37012f6d0 con 0x7fe3700b8630 2020-05-18T21:31:23.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.825+0000 7fe376ed8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37012f970 con 0x7fe3700b9500 2020-05-18T21:31:23.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.825+0000 7fe376ed8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe370131fe0 con 0x7fe3700b6d90 2020-05-18T21:31:23.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.825+0000 7fe375475700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe3700b9500 0x7fe370131b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:23.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.825+0000 7fe374c74700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3700b6d90 0x7fe37012d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:23.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.825+0000 7fe375475700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe3700b9500 0x7fe370131b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:44728/0 (socket says 172.21.15.63:44728) 2020-05-18T21:31:23.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.825+0000 7fe375475700 1 -- 172.21.15.63:0/1348115618 learned_addr learned my addr 172.21.15.63:0/1348115618 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:23.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe375475700 1 -- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3700b6d90 msgr2=0x7fe37012d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:23.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe375475700 1 --2- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3700b6d90 0x7fe37012d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:23.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe375475700 1 -- 172.21.15.63:0/1348115618 >> v1:172.21.15.155:6789/0 conn(0x7fe3700b8630 legacy=0x7fe3701530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:23.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe375475700 1 -- 172.21.15.63:0/1348115618 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3700b2f20 con 0x7fe3700b9500 2020-05-18T21:31:23.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe375475700 1 --2- 172.21.15.63:0/1348115618 >> v2:172.21.15.155:3300/0 conn(0x7fe3700b9500 0x7fe370131b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe3700b8000 tx=0x7fe3700b9a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe375475700 1 --2- 172.21.15.63:0/1348115618 >> v2:172.21.15.155:3300/0 conn(0x7fe3700b9500 0x7fe370131b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe3700b8000 tx=0x7fe3700b9a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe375475700 1 --2- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3700b9500 0x7fe370131b80 secure :-1 s=READY pgs=707 cs=0 l=1 rx=0x7fe3700b8000 tx=0x7fe3700b9a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:23.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe375475700 1 --2- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3700b9500 0x7fe370131b80 secure :-1 s=THROTTLE_DONE pgs=707 cs=0 l=1 rx=0x7fe3700b8000 tx=0x7fe3700b9a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe365ffb700 1 -- 172.21.15.63:0/1348115618 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3680115c0 con 0x7fe3700b9500 2020-05-18T21:31:23.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe375475700 1 --2- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3700b9500 0x7fe370131b80 secure :-1 s=THROTTLE_DONE pgs=707 cs=0 l=1 rx=0x7fe3700b8000 tx=0x7fe3700b9a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe375475700 1 --2- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3700b9500 0x7fe370131b80 secure :-1 s=THROTTLE_DONE pgs=707 cs=0 l=1 rx=0x7fe3700b8000 tx=0x7fe3700b9a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe365ffb700 1 -- 172.21.15.63:0/1348115618 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe368005a80 con 0x7fe3700b9500 2020-05-18T21:31:23.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe376ed8700 1 -- 172.21.15.63:0/1348115618 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3701537b0 con 0x7fe3700b9500 2020-05-18T21:31:23.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe365ffb700 1 -- 172.21.15.63:0/1348115618 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe368005ea0 con 0x7fe3700b9500 2020-05-18T21:31:23.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe376ed8700 1 -- 172.21.15.63:0/1348115618 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe370153ce0 con 0x7fe3700b9500 2020-05-18T21:31:23.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe375475700 1 --2- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3700b9500 0x7fe370131b80 secure :-1 s=THROTTLE_DONE pgs=707 cs=0 l=1 rx=0x7fe3700b8000 tx=0x7fe3700b9a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe376ed8700 1 -- 172.21.15.63:0/1348115618 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3700b3170 con 0x7fe3700b9500 2020-05-18T21:31:23.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe375475700 1 --2- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3700b9500 0x7fe370131b80 secure :-1 s=THROTTLE_DONE pgs=707 cs=0 l=1 rx=0x7fe3700b8000 tx=0x7fe3700b9a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe365ffb700 1 -- 172.21.15.63:0/1348115618 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe368010610 con 0x7fe3700b9500 2020-05-18T21:31:23.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe365ffb700 1 --2- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe35004f9e0 0x7fe350051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:23.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.829+0000 7fe365ffb700 1 -- 172.21.15.63:0/1348115618 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fe3680648b0 con 0x7fe3700b9500 2020-05-18T21:31:23.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.833+0000 7fe374c74700 1 --2- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe35004f9e0 0x7fe350051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:23.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.833+0000 7fe374c74700 1 --2- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe35004f9e0 0x7fe350051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe370043320 tx=0x7fe36c003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.833+0000 7fe374c74700 1 --2- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe35004f9e0 0x7fe350051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe370043320 tx=0x7fe36c003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.833+0000 7fe374c74700 1 --2- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe35004f9e0 0x7fe350051ea0 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7fe370043320 tx=0x7fe36c003e60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:23.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.841+0000 7fe375475700 1 --2- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3700b9500 0x7fe370131b80 secure :-1 s=THROTTLE_DONE pgs=707 cs=0 l=1 rx=0x7fe3700b8000 tx=0x7fe3700b9a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:23.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.841+0000 7fe365ffb700 1 -- 172.21.15.63:0/1348115618 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe36803ec60 con 0x7fe3700b9500 2020-05-18T21:31:23.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:23.961+0000 7fe376ed8700 1 -- 172.21.15.63:0/1348115618 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe3700569e0 con 0x7fe3700b9500 2020-05-18T21:31:24.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.737+0000 7fe375475700 1 --2- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3700b9500 0x7fe370131b80 secure :-1 s=THROTTLE_DONE pgs=707 cs=0 l=1 rx=0x7fe3700b8000 tx=0x7fe3700b9a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:24.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.737+0000 7fe365ffb700 1 -- 172.21.15.63:0/1348115618 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) v1 ==== 185+0+0 (secure 0 0 0) 0x7fe368042280 con 0x7fe3700b9500 2020-05-18T21:31:24.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.741+0000 7fe376ed8700 1 -- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe35004f9e0 msgr2=0x7fe350051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:24.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.741+0000 7fe376ed8700 1 --2- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe35004f9e0 0x7fe350051ea0 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7fe370043320 tx=0x7fe36c003e60).stop 2020-05-18T21:31:24.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.741+0000 7fe376ed8700 1 -- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3700b9500 msgr2=0x7fe370131b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:24.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.741+0000 7fe376ed8700 1 --2- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3700b9500 0x7fe370131b80 secure :-1 s=READY pgs=707 cs=0 l=1 rx=0x7fe3700b8000 tx=0x7fe3700b9a70).stop 2020-05-18T21:31:24.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.741+0000 7fe376ed8700 1 -- 172.21.15.63:0/1348115618 shutdown_connections 2020-05-18T21:31:24.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.741+0000 7fe376ed8700 1 --2- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe35004f9e0 0x7fe350051ea0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:24.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.741+0000 7fe376ed8700 1 --2- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3700b9500 0x7fe370131b80 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:24.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.741+0000 7fe376ed8700 1 --2- 172.21.15.63:0/1348115618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3700b6d90 0x7fe37012d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:24.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.741+0000 7fe376ed8700 1 -- 172.21.15.63:0/1348115618 >> 172.21.15.63:0/1348115618 conn(0x7fe370069b70 msgr2=0x7fe3700b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:24.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.741+0000 7fe376ed8700 1 -- 172.21.15.63:0/1348115618 shutdown_connections 2020-05-18T21:31:24.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.741+0000 7fe376ed8700 1 -- 172.21.15.63:0/1348115618 wait complete. 2020-05-18T21:31:24.747 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2020-05-18T21:31:24.758 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-05-18T21:31:24.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.869+0000 7f61cca04700 1 Processor -- start 2020-05-18T21:31:24.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.869+0000 7f61cca04700 1 -- start start 2020-05-18T21:31:24.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.869+0000 7f61cca04700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61c80b5a20 0x7f61c80b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:24.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.869+0000 7f61cca04700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f61c80b4970 0x7f61c813f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:24.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.869+0000 7f61cca04700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c8146350 con 0x7f61c813f8f0 2020-05-18T21:31:24.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.869+0000 7f61cca04700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c8143340 con 0x7f61c80b4970 2020-05-18T21:31:24.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.869+0000 7f61cca04700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c80662d0 con 0x7f61c80b5a20 2020-05-18T21:31:24.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.869+0000 7f61c6d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f61c813f8f0 0x7f61c805ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60306/0 (socket says 172.21.15.63:60306) 2020-05-18T21:31:24.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.869+0000 7f61c6d9d700 1 -- 172.21.15.63:0/3684837208 learned_addr learned my addr 172.21.15.63:0/3684837208 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:24.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.869+0000 7f61c5d9b700 1 --2- 172.21.15.63:0/3684837208 >> v2:172.21.15.63:3300/0 conn(0x7f61c80b4970 0x7f61c813f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:24.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.869+0000 7f61c659c700 1 --2- 172.21.15.63:0/3684837208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61c80b5a20 0x7f61c80b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:24.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c559a700 1 -- 172.21.15.63:0/3684837208 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994512356 0 0) 0x7f61c8146350 con 0x7f61c813f8f0 2020-05-18T21:31:24.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c559a700 1 -- 172.21.15.63:0/3684837208 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61a8003270 con 0x7f61c813f8f0 2020-05-18T21:31:24.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c559a700 1 -- 172.21.15.63:0/3684837208 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1311413259 0 0) 0x7f61a8003270 con 0x7f61c813f8f0 2020-05-18T21:31:24.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c559a700 1 -- 172.21.15.63:0/3684837208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61c80b5a20 msgr2=0x7f61c80b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:24.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c559a700 1 --2- 172.21.15.63:0/3684837208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61c80b5a20 0x7f61c80b8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:24.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c559a700 1 -- 172.21.15.63:0/3684837208 >> v2:172.21.15.63:3300/0 conn(0x7f61c80b4970 msgr2=0x7f61c813f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:24.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c559a700 1 --2- 172.21.15.63:0/3684837208 >> v2:172.21.15.63:3300/0 conn(0x7f61c80b4970 0x7f61c813f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:24.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c559a700 1 -- 172.21.15.63:0/3684837208 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c8146820 con 0x7f61c813f8f0 2020-05-18T21:31:24.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c559a700 1 -- 172.21.15.63:0/3684837208 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f61c0001a90 con 0x7f61c813f8f0 2020-05-18T21:31:24.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c5d9b700 1 --2- 172.21.15.63:0/3684837208 >> v2:172.21.15.63:3300/0 conn(0x7f61c80b4970 0x7f61c813f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:31:24.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c559a700 1 -- 172.21.15.63:0/3684837208 >> v1:172.21.15.63:6789/0 conn(0x7f61c813f8f0 legacy=0x7f61c805ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:24.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c559a700 1 --2- 172.21.15.63:0/3684837208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61a8003760 0x7f61a8003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:24.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c559a700 1 --2- 172.21.15.63:0/3684837208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61c80b5a20 0x7f61a8004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:24.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c559a700 1 --2- 172.21.15.63:0/3684837208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a8004970 0x7f61a8004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:24.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c559a700 1 -- 172.21.15.63:0/3684837208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c8143340 con 0x7f61a8003760 2020-05-18T21:31:24.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c559a700 1 -- 172.21.15.63:0/3684837208 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c80662d0 con 0x7f61a8004970 2020-05-18T21:31:24.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c559a700 1 -- 172.21.15.63:0/3684837208 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a80053c0 con 0x7f61c80b5a20 2020-05-18T21:31:24.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c659c700 1 --2- 172.21.15.63:0/3684837208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61a8003760 0x7f61a8003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:24.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c5d9b700 1 --2- 172.21.15.63:0/3684837208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61c80b5a20 0x7f61a8004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:24.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c6d9d700 1 --2- 172.21.15.63:0/3684837208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a8004970 0x7f61a8004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:24.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c659c700 1 -- 172.21.15.63:0/3684837208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61c80b5a20 msgr2=0x7f61a8004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:24.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c659c700 1 --2- 172.21.15.63:0/3684837208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61c80b5a20 0x7f61a8004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:24.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c659c700 1 -- 172.21.15.63:0/3684837208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a8004970 msgr2=0x7f61a8004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:24.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c659c700 1 --2- 172.21.15.63:0/3684837208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a8004970 0x7f61a8004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:24.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c659c700 1 -- 172.21.15.63:0/3684837208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a8003270 con 0x7f61a8003760 2020-05-18T21:31:24.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c5d9b700 1 --2- 172.21.15.63:0/3684837208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61c80b5a20 0x7f61a8004510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:31:24.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c659c700 1 --2- 172.21.15.63:0/3684837208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61a8003760 0x7f61a8003b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f61b8002f70 tx=0x7f61c805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:24.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c659c700 1 --2- 172.21.15.63:0/3684837208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61a8003760 0x7f61a8003b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f61b8002f70 tx=0x7f61c805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:24.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c659c700 1 --2- 172.21.15.63:0/3684837208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61a8003760 0x7f61a8003b80 secure :-1 s=READY pgs=1014 cs=0 l=1 rx=0x7f61b8002f70 tx=0x7f61c805b560).ready entity=mon.0 client_cookie=4c06dd757d50bac server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:24.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c659c700 1 --2- 172.21.15.63:0/3684837208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61a8003760 0x7f61a8003b80 secure :-1 s=THROTTLE_DONE pgs=1014 cs=0 l=1 rx=0x7f61b8002f70 tx=0x7f61c805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:24.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c559a700 1 -- 172.21.15.63:0/3684837208 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61b8010d90 con 0x7f61a8003760 2020-05-18T21:31:24.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c659c700 1 --2- 172.21.15.63:0/3684837208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61a8003760 0x7f61a8003b80 secure :-1 s=THROTTLE_DONE pgs=1014 cs=0 l=1 rx=0x7f61b8002f70 tx=0x7f61c805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:24.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c659c700 1 --2- 172.21.15.63:0/3684837208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61a8003760 0x7f61a8003b80 secure :-1 s=THROTTLE_DONE pgs=1014 cs=0 l=1 rx=0x7f61b8002f70 tx=0x7f61c805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:24.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c559a700 1 -- 172.21.15.63:0/3684837208 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b8008990 con 0x7f61a8003760 2020-05-18T21:31:24.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c559a700 1 -- 172.21.15.63:0/3684837208 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61b8008d30 con 0x7f61a8003760 2020-05-18T21:31:24.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61cca04700 1 -- 172.21.15.63:0/3684837208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61a8003760 msgr2=0x7f61a8003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:24.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61cca04700 1 --2- 172.21.15.63:0/3684837208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61a8003760 0x7f61a8003b80 secure :-1 s=READY pgs=1014 cs=0 l=1 rx=0x7f61b8002f70 tx=0x7f61c805b560).stop 2020-05-18T21:31:24.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61c6d9d700 1 -- 172.21.15.63:0/3684837208 reap_dead start 2020-05-18T21:31:24.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61cca04700 1 -- 172.21.15.63:0/3684837208 shutdown_connections 2020-05-18T21:31:24.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61cca04700 1 -- 172.21.15.63:0/3684837208 >> 172.21.15.63:0/3684837208 conn(0x7f61c80b83b0 msgr2=0x7f61c80b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:24.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61cca04700 1 -- 172.21.15.63:0/3684837208 shutdown_connections 2020-05-18T21:31:24.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.873+0000 7f61cca04700 1 -- 172.21.15.63:0/3684837208 wait complete. 2020-05-18T21:31:24.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61cca04700 1 Processor -- start 2020-05-18T21:31:24.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61cca04700 1 -- start start 2020-05-18T21:31:24.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61cca04700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f61c81474c0 0x7f61c8147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:24.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61cca04700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c813ea50 con 0x7f61c8156d70 2020-05-18T21:31:24.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61cca04700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c8142550 con 0x7f61c8156990 2020-05-18T21:31:24.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61cca04700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c8142780 con 0x7f61c81474c0 2020-05-18T21:31:24.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61c5d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f61c81474c0 0x7f61c8147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:24.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61c6d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f61c8156d70 0x7f61c8143480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60320/0 (socket says 172.21.15.63:60320) 2020-05-18T21:31:24.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61c6d9d700 1 -- 172.21.15.63:0/3789590048 learned_addr learned my addr 172.21.15.63:0/3789590048 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:24.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61c5d9b700 1 -- 172.21.15.63:0/3789590048 >> v1:172.21.15.155:6789/0 conn(0x7f61c8156990 legacy=0x7f61c8144bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:24.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61c5d9b700 1 -- 172.21.15.63:0/3789590048 >> v1:172.21.15.63:6789/0 conn(0x7f61c8156d70 legacy=0x7f61c8143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:24.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61c5d9b700 1 -- 172.21.15.63:0/3789590048 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c8142a20 con 0x7f61c81474c0 2020-05-18T21:31:24.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61c5d9b700 1 --2- 172.21.15.63:0/3789590048 >> v2:172.21.15.63:3300/0 conn(0x7f61c81474c0 0x7f61c8147c10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f61b0002f70 tx=0x7f61b0010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:24.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61c5d9b700 1 --2- 172.21.15.63:0/3789590048 >> v2:172.21.15.63:3300/0 conn(0x7f61c81474c0 0x7f61c8147c10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f61b0002f70 tx=0x7f61b0010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:24.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61c5d9b700 1 --2- 172.21.15.63:0/3789590048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61c81474c0 0x7f61c8147c10 secure :-1 s=READY pgs=1016 cs=0 l=1 rx=0x7f61b0002f70 tx=0x7f61b0010ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:24.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61c5d9b700 1 --2- 172.21.15.63:0/3789590048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61c81474c0 0x7f61c8147c10 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7f61b0002f70 tx=0x7f61b0010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:24.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61bf7fe700 1 -- 172.21.15.63:0/3789590048 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61b0007550 con 0x7f61c81474c0 2020-05-18T21:31:24.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61c5d9b700 1 --2- 172.21.15.63:0/3789590048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61c81474c0 0x7f61c8147c10 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7f61b0002f70 tx=0x7f61b0010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:24.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61cca04700 1 -- 172.21.15.63:0/3789590048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c8157510 con 0x7f61c81474c0 2020-05-18T21:31:24.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61bf7fe700 1 -- 172.21.15.63:0/3789590048 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b00128f0 con 0x7f61c81474c0 2020-05-18T21:31:24.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61c5d9b700 1 --2- 172.21.15.63:0/3789590048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61c81474c0 0x7f61c8147c10 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7f61b0002f70 tx=0x7f61b0010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:24.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61bf7fe700 1 -- 172.21.15.63:0/3789590048 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61b0012cd0 con 0x7f61c81474c0 2020-05-18T21:31:24.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61cca04700 1 -- 172.21.15.63:0/3789590048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c8143d30 con 0x7f61c81474c0 2020-05-18T21:31:24.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.877+0000 7f61c5d9b700 1 --2- 172.21.15.63:0/3789590048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61c81474c0 0x7f61c8147c10 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7f61b0002f70 tx=0x7f61b0010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:24.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.881+0000 7f61cca04700 1 -- 172.21.15.63:0/3789590048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c8157180 con 0x7f61c81474c0 2020-05-18T21:31:24.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.881+0000 7f61bf7fe700 1 -- 172.21.15.63:0/3789590048 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f61b0010190 con 0x7f61c81474c0 2020-05-18T21:31:24.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.881+0000 7f61c5d9b700 1 --2- 172.21.15.63:0/3789590048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61c81474c0 0x7f61c8147c10 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7f61b0002f70 tx=0x7f61b0010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:24.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.881+0000 7f61bf7fe700 1 --2- 172.21.15.63:0/3789590048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f61ac04fa30 0x7f61ac051ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:24.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.881+0000 7f61bf7fe700 1 -- 172.21.15.63:0/3789590048 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5807+0+0 (secure 0 0 0) 0x7f61b0063f50 con 0x7f61c81474c0 2020-05-18T21:31:24.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.881+0000 7f61c659c700 1 --2- 172.21.15.63:0/3789590048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f61ac04fa30 0x7f61ac051ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:24.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.881+0000 7f61c659c700 1 --2- 172.21.15.63:0/3789590048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f61ac04fa30 0x7f61ac051ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f61c8147930 tx=0x7f61c805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:24.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.881+0000 7f61c659c700 1 --2- 172.21.15.63:0/3789590048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f61ac04fa30 0x7f61ac051ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f61c8147930 tx=0x7f61c805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:24.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.881+0000 7f61c659c700 1 --2- 172.21.15.63:0/3789590048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f61ac04fa30 0x7f61ac051ef0 secure :-1 s=READY pgs=405 cs=0 l=1 rx=0x7f61c8147930 tx=0x7f61c805b560).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:24.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.885+0000 7f61c5d9b700 1 --2- 172.21.15.63:0/3789590048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61c81474c0 0x7f61c8147c10 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7f61b0002f70 tx=0x7f61b0010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:24.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:24.885+0000 7f61bf7fe700 1 -- 172.21.15.63:0/3789590048 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f61b003e2e0 con 0x7f61c81474c0 2020-05-18T21:31:25.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.001+0000 7f61cca04700 1 -- 172.21.15.63:0/3789590048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f61c80569e0 con 0x7f61c81474c0 2020-05-18T21:31:25.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.745+0000 7f61c5d9b700 1 --2- 172.21.15.63:0/3789590048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61c81474c0 0x7f61c8147c10 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7f61b0002f70 tx=0x7f61b0010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:25.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.745+0000 7f61bf7fe700 1 -- 172.21.15.63:0/3789590048 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) v1 ==== 173+0+0 (secure 0 0 0) 0x7f61b0041900 con 0x7f61c81474c0 2020-05-18T21:31:25.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.745+0000 7f61cca04700 1 -- 172.21.15.63:0/3789590048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f61ac04fa30 msgr2=0x7f61ac051ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:25.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.745+0000 7f61cca04700 1 --2- 172.21.15.63:0/3789590048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f61ac04fa30 0x7f61ac051ef0 secure :-1 s=READY pgs=405 cs=0 l=1 rx=0x7f61c8147930 tx=0x7f61c805b560).stop 2020-05-18T21:31:25.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.745+0000 7f61cca04700 1 -- 172.21.15.63:0/3789590048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61c81474c0 msgr2=0x7f61c8147c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:25.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.745+0000 7f61cca04700 1 --2- 172.21.15.63:0/3789590048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61c81474c0 0x7f61c8147c10 secure :-1 s=READY pgs=1016 cs=0 l=1 rx=0x7f61b0002f70 tx=0x7f61b0010ea0).stop 2020-05-18T21:31:25.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.749+0000 7f61cca04700 1 -- 172.21.15.63:0/3789590048 shutdown_connections 2020-05-18T21:31:25.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.749+0000 7f61cca04700 1 --2- 172.21.15.63:0/3789590048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f61ac04fa30 0x7f61ac051ef0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:25.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.749+0000 7f61cca04700 1 --2- 172.21.15.63:0/3789590048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61c81474c0 0x7f61c8147c10 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:25.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.749+0000 7f61cca04700 1 -- 172.21.15.63:0/3789590048 >> 172.21.15.63:0/3789590048 conn(0x7f61c80b83b0 msgr2=0x7f61c80b3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:25.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.749+0000 7f61cca04700 1 -- 172.21.15.63:0/3789590048 shutdown_connections 2020-05-18T21:31:25.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.749+0000 7f61cca04700 1 -- 172.21.15.63:0/3789590048 wait complete. 2020-05-18T21:31:25.754 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2020-05-18T21:31:25.766 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:31:25.767 INFO:tasks.ceph.mds.a:Stopping old one... 2020-05-18T21:31:25.767 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:31:25.768 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:31:25.768 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:31:25.768 INFO:tasks.ceph.mds.b:Stopping old one... 2020-05-18T21:31:25.769 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:31:25.769 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:31:25.779 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:31:25.780 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:31:25.781 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:31:25.781 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:31:25.783 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:31:25.784 DEBUG:teuthology.parallel:result is None 2020-05-18T21:31:25.826 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:31:25.826 DEBUG:teuthology.parallel:result is None 2020-05-18T21:31:25.827 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-05-18T21:31:25.862 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:31:25.903 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:31:25.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85ea70700 1 Processor -- start 2020-05-18T21:31:25.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85ea70700 1 -- start start 2020-05-18T21:31:25.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85ea70700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb8580ba170 0x7fb8580b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:25.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85ea70700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858145850 0x7fb858145c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:25.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85ea70700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8581460f0 con 0x7fb858069b70 2020-05-18T21:31:25.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85ea70700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8580b1b20 con 0x7fb8580ba170 2020-05-18T21:31:25.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85ea70700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb858149b00 con 0x7fb858145850 2020-05-18T21:31:25.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85c80c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb8580ba170 0x7fb8580b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:25.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85d00d700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fb858069b70 0x7fb858069fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:58654/0 (socket says 172.21.15.63:58654) 2020-05-18T21:31:25.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85d00d700 1 -- 172.21.15.63:0/3629535588 learned_addr learned my addr 172.21.15.63:0/3629535588 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:25.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb857fff700 1 --2- 172.21.15.63:0/3629535588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858145850 0x7fb858145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:25.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85c80c700 1 -- 172.21.15.63:0/3629535588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858145850 msgr2=0x7fb858145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:25.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85c80c700 1 --2- 172.21.15.63:0/3629535588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858145850 0x7fb858145c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:25.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb8577fe700 1 -- 172.21.15.63:0/3629535588 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3633227768 0 0) 0x7fb8581460f0 con 0x7fb858069b70 2020-05-18T21:31:25.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85c80c700 1 -- 172.21.15.63:0/3629535588 >> v1:172.21.15.155:6789/0 conn(0x7fb858069b70 legacy=0x7fb858069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:25.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85c80c700 1 -- 172.21.15.63:0/3629535588 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858149da0 con 0x7fb8580ba170 2020-05-18T21:31:25.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85c80c700 1 --2- 172.21.15.63:0/3629535588 >> v2:172.21.15.155:3300/0 conn(0x7fb8580ba170 0x7fb8580b4bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb8500032f0 tx=0x7fb850007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:25.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85c80c700 1 --2- 172.21.15.63:0/3629535588 >> v2:172.21.15.155:3300/0 conn(0x7fb8580ba170 0x7fb8580b4bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb8500032f0 tx=0x7fb850007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:25.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85c80c700 1 --2- 172.21.15.63:0/3629535588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8580ba170 0x7fb8580b4bb0 secure :-1 s=READY pgs=713 cs=0 l=1 rx=0x7fb8500032f0 tx=0x7fb850007e00).ready entity=mon.1 client_cookie=2fa7da07ab1790d9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:25.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85c80c700 1 --2- 172.21.15.63:0/3629535588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8580ba170 0x7fb8580b4bb0 secure :-1 s=THROTTLE_DONE pgs=713 cs=0 l=1 rx=0x7fb8500032f0 tx=0x7fb850007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:25.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb8577fe700 1 -- 172.21.15.63:0/3629535588 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb850011e60 con 0x7fb8580ba170 2020-05-18T21:31:25.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85c80c700 1 --2- 172.21.15.63:0/3629535588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8580ba170 0x7fb8580b4bb0 secure :-1 s=THROTTLE_DONE pgs=713 cs=0 l=1 rx=0x7fb8500032f0 tx=0x7fb850007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:25.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85c80c700 1 --2- 172.21.15.63:0/3629535588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8580ba170 0x7fb8580b4bb0 secure :-1 s=THROTTLE_DONE pgs=713 cs=0 l=1 rx=0x7fb8500032f0 tx=0x7fb850007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:25.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb8577fe700 1 -- 172.21.15.63:0/3629535588 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85000a180 con 0x7fb8580ba170 2020-05-18T21:31:25.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb8577fe700 1 -- 172.21.15.63:0/3629535588 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb85000a520 con 0x7fb8580ba170 2020-05-18T21:31:25.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85ea70700 1 -- 172.21.15.63:0/3629535588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8580ba170 msgr2=0x7fb8580b4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:25.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85ea70700 1 --2- 172.21.15.63:0/3629535588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8580ba170 0x7fb8580b4bb0 secure :-1 s=READY pgs=713 cs=0 l=1 rx=0x7fb8500032f0 tx=0x7fb850007e00).stop 2020-05-18T21:31:25.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85ea70700 1 -- 172.21.15.63:0/3629535588 shutdown_connections 2020-05-18T21:31:25.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85ea70700 1 --2- 172.21.15.63:0/3629535588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858145850 0x7fb858145c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:25.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85ea70700 1 --2- 172.21.15.63:0/3629535588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8580ba170 0x7fb8580b4bb0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:25.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85ea70700 1 -- 172.21.15.63:0/3629535588 >> 172.21.15.63:0/3629535588 conn(0x7fb85805b170 msgr2=0x7fb8580b9720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:25.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85ea70700 1 -- 172.21.15.63:0/3629535588 shutdown_connections 2020-05-18T21:31:25.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.929+0000 7fb85ea70700 1 -- 172.21.15.63:0/3629535588 wait complete. 2020-05-18T21:31:25.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.933+0000 7fb85ea70700 1 Processor -- start 2020-05-18T21:31:25.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.933+0000 7fb85ea70700 1 -- start start 2020-05-18T21:31:25.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85ea70700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858069b70 0x7fb8580659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:25.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85ea70700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb858145850 0x7fb858147a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:25.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85ea70700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8581436e0 con 0x7fb8580ba170 2020-05-18T21:31:25.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85ea70700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb858147ee0 con 0x7fb858145850 2020-05-18T21:31:25.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85ea70700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb858064fa0 con 0x7fb858069b70 2020-05-18T21:31:25.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85d00d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb858145850 0x7fb858147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:25.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85c80c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858069b70 0x7fb8580659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:25.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb857fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fb8580ba170 0x7fb85813fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:58660/0 (socket says 172.21.15.63:58660) 2020-05-18T21:31:25.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85c80c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858069b70 0x7fb8580659e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:48856/0 (socket says 172.21.15.63:48856) 2020-05-18T21:31:25.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85c80c700 1 -- 172.21.15.63:0/2886726551 learned_addr learned my addr 172.21.15.63:0/2886726551 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:25.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85c80c700 1 -- 172.21.15.63:0/2886726551 >> v2:172.21.15.155:3300/0 conn(0x7fb858145850 msgr2=0x7fb858147a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:25.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb855ffb700 1 -- 172.21.15.63:0/2886726551 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313077181 0 0) 0x7fb8581436e0 con 0x7fb8580ba170 2020-05-18T21:31:25.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85c80c700 1 --2- 172.21.15.63:0/2886726551 >> v2:172.21.15.155:3300/0 conn(0x7fb858145850 0x7fb858147a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:25.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85c80c700 1 -- 172.21.15.63:0/2886726551 >> v1:172.21.15.155:6789/0 conn(0x7fb8580ba170 legacy=0x7fb85813fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:25.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85c80c700 1 -- 172.21.15.63:0/2886726551 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858065240 con 0x7fb858069b70 2020-05-18T21:31:25.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85c80c700 1 --2- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858069b70 0x7fb8580659e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb8500032f0 tx=0x7fb850007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85c80c700 1 --2- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858069b70 0x7fb8580659e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb8500032f0 tx=0x7fb850007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85c80c700 1 --2- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858069b70 0x7fb8580659e0 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7fb8500032f0 tx=0x7fb850007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85c80c700 1 --2- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858069b70 0x7fb8580659e0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fb8500032f0 tx=0x7fb850007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85c80c700 1 --2- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858069b70 0x7fb8580659e0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fb8500032f0 tx=0x7fb850007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb855ffb700 1 -- 172.21.15.63:0/2886726551 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb850005c70 con 0x7fb858069b70 2020-05-18T21:31:25.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85c80c700 1 --2- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858069b70 0x7fb8580659e0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fb8500032f0 tx=0x7fb850007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:25.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb855ffb700 1 -- 172.21.15.63:0/2886726551 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb850005dd0 con 0x7fb858069b70 2020-05-18T21:31:25.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85ea70700 1 -- 172.21.15.63:0/2886726551 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb858064c90 con 0x7fb858069b70 2020-05-18T21:31:25.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb855ffb700 1 -- 172.21.15.63:0/2886726551 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb850007360 con 0x7fb858069b70 2020-05-18T21:31:25.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85ea70700 1 -- 172.21.15.63:0/2886726551 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb858141dc0 con 0x7fb858069b70 2020-05-18T21:31:25.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85c80c700 1 --2- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858069b70 0x7fb8580659e0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fb8500032f0 tx=0x7fb850007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:25.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.937+0000 7fb85ea70700 1 -- 172.21.15.63:0/2886726551 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8580569e0 con 0x7fb858069b70 2020-05-18T21:31:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.941+0000 7fb855ffb700 1 -- 172.21.15.63:0/2886726551 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb8500075d0 con 0x7fb858069b70 2020-05-18T21:31:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.941+0000 7fb85c80c700 1 --2- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858069b70 0x7fb8580659e0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fb8500032f0 tx=0x7fb850007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.941+0000 7fb855ffb700 1 --2- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb83804f8e0 0x7fb838051da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.941+0000 7fb855ffb700 1 -- 172.21.15.63:0/2886726551 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5425+0+0 (secure 0 0 0) 0x7fb850064ba0 con 0x7fb858069b70 2020-05-18T21:31:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.941+0000 7fb857fff700 1 --2- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb83804f8e0 0x7fb838051da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.941+0000 7fb857fff700 1 --2- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb83804f8e0 0x7fb838051da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb848007960 tx=0x7fb848009940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.941+0000 7fb857fff700 1 --2- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb83804f8e0 0x7fb838051da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb848007960 tx=0x7fb848009940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.941+0000 7fb857fff700 1 --2- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb83804f8e0 0x7fb838051da0 secure :-1 s=READY pgs=406 cs=0 l=1 rx=0x7fb848007960 tx=0x7fb848009940).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.945+0000 7fb85c80c700 1 --2- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858069b70 0x7fb8580659e0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fb8500032f0 tx=0x7fb850007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:25.945+0000 7fb855ffb700 1 -- 172.21.15.63:0/2886726551 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb85003eff0 con 0x7fb858069b70 2020-05-18T21:31:26.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:26.073+0000 7fb85ea70700 1 -- 172.21.15.63:0/2886726551 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fb8580b3b00 con 0x7fb858069b70 2020-05-18T21:31:26.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:26.929+0000 7fb85c80c700 1 --2- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858069b70 0x7fb8580659e0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fb8500032f0 tx=0x7fb850007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:26.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:26.929+0000 7fb855ffb700 1 -- 172.21.15.63:0/2886726551 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v80) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb850042610 con 0x7fb858069b70 2020-05-18T21:31:26.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:26.933+0000 7fb85ea70700 1 -- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb83804f8e0 msgr2=0x7fb838051da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:26.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:26.933+0000 7fb85ea70700 1 --2- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb83804f8e0 0x7fb838051da0 secure :-1 s=READY pgs=406 cs=0 l=1 rx=0x7fb848007960 tx=0x7fb848009940).stop 2020-05-18T21:31:26.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:26.933+0000 7fb85ea70700 1 -- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858069b70 msgr2=0x7fb8580659e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:26.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:26.933+0000 7fb85ea70700 1 --2- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858069b70 0x7fb8580659e0 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7fb8500032f0 tx=0x7fb850007e00).stop 2020-05-18T21:31:26.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:26.933+0000 7fb85ea70700 1 -- 172.21.15.63:0/2886726551 shutdown_connections 2020-05-18T21:31:26.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:26.933+0000 7fb85ea70700 1 --2- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb83804f8e0 0x7fb838051da0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:26.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:26.933+0000 7fb85ea70700 1 --2- 172.21.15.63:0/2886726551 >> v2:172.21.15.155:3300/0 conn(0x7fb858145850 0x7fb858147a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:26.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:26.933+0000 7fb85ea70700 1 --2- 172.21.15.63:0/2886726551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb858069b70 0x7fb8580659e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:26.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:26.933+0000 7fb85ea70700 1 -- 172.21.15.63:0/2886726551 >> 172.21.15.63:0/2886726551 conn(0x7fb85805b170 msgr2=0x7fb8580b6150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:26.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:26.933+0000 7fb85ea70700 1 -- 172.21.15.63:0/2886726551 shutdown_connections 2020-05-18T21:31:26.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:26.933+0000 7fb85ea70700 1 -- 172.21.15.63:0/2886726551 wait complete. 2020-05-18T21:31:26.941 INFO:teuthology.orchestra.run.smithi063.stderr: removed all blacklist entries 2020-05-18T21:31:26.954 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-05-18T21:31:26.955 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-05-18T21:31:27.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82fcfa4700 1 Processor -- start 2020-05-18T21:31:27.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82fcfa4700 1 -- start start 2020-05-18T21:31:27.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82fcfa4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f82f805f110 0x7f82f80b2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:27.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82fcfa4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f82f80b81b0 0x7f82f812ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:27.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82fcfa4700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f812bec0 0x7f82f8149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:27.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82fcfa4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f80b8650 con 0x7f82f805f110 2020-05-18T21:31:27.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82fcfa4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f80b88f0 con 0x7f82f80b81b0 2020-05-18T21:31:27.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82fcfa4700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f80b8b90 con 0x7f82f812bec0 2020-05-18T21:31:27.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82f77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f82f805f110 0x7f82f80b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82f77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f82f805f110 0x7f82f80b2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58166/0 (socket says 172.21.15.63:58166) 2020-05-18T21:31:27.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82f77fe700 1 -- 172.21.15.63:0/2941769585 learned_addr learned my addr 172.21.15.63:0/2941769585 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:27.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82f7fff700 1 --2- 172.21.15.63:0/2941769585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f812bec0 0x7f82f8149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82effff700 1 --2- 172.21.15.63:0/2941769585 >> v2:172.21.15.155:3300/0 conn(0x7f82f80b81b0 0x7f82f812ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82f77fe700 1 -- 172.21.15.63:0/2941769585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f812bec0 msgr2=0x7f82f8149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:27.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82f77fe700 1 --2- 172.21.15.63:0/2941769585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f812bec0 0x7f82f8149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:27.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82f77fe700 1 -- 172.21.15.63:0/2941769585 >> v2:172.21.15.155:3300/0 conn(0x7f82f80b81b0 msgr2=0x7f82f812ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:27.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82f77fe700 1 --2- 172.21.15.63:0/2941769585 >> v2:172.21.15.155:3300/0 conn(0x7f82f80b81b0 0x7f82f812ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:27.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82f77fe700 1 -- 172.21.15.63:0/2941769585 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f80b9030 con 0x7f82f805f110 2020-05-18T21:31:27.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82f77fe700 1 --2- 172.21.15.63:0/2941769585 >> v2:172.21.15.63:3300/0 conn(0x7f82f805f110 0x7f82f80b2940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f82e0002f70 tx=0x7f82e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82f77fe700 1 --2- 172.21.15.63:0/2941769585 >> v2:172.21.15.63:3300/0 conn(0x7f82f805f110 0x7f82f80b2940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f82e0002f70 tx=0x7f82e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82f77fe700 1 --2- 172.21.15.63:0/2941769585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f805f110 0x7f82f80b2940 secure :-1 s=READY pgs=1023 cs=0 l=1 rx=0x7f82e0002f70 tx=0x7f82e0007a80).ready entity=mon.0 client_cookie=c991ee4ff126bc5 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:27.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82f77fe700 1 --2- 172.21.15.63:0/2941769585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f805f110 0x7f82f80b2940 secure :-1 s=THROTTLE_DONE pgs=1023 cs=0 l=1 rx=0x7f82e0002f70 tx=0x7f82e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82f6ffd700 1 -- 172.21.15.63:0/2941769585 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82e0011600 con 0x7f82f805f110 2020-05-18T21:31:27.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82f77fe700 1 --2- 172.21.15.63:0/2941769585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f805f110 0x7f82f80b2940 secure :-1 s=THROTTLE_DONE pgs=1023 cs=0 l=1 rx=0x7f82e0002f70 tx=0x7f82e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82f6ffd700 1 -- 172.21.15.63:0/2941769585 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e0011760 con 0x7f82f805f110 2020-05-18T21:31:27.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82f77fe700 1 --2- 172.21.15.63:0/2941769585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f805f110 0x7f82f80b2940 secure :-1 s=THROTTLE_DONE pgs=1023 cs=0 l=1 rx=0x7f82e0002f70 tx=0x7f82e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82fcfa4700 1 -- 172.21.15.63:0/2941769585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f805f110 msgr2=0x7f82f80b2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82f6ffd700 1 -- 172.21.15.63:0/2941769585 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82e0011b80 con 0x7f82f805f110 2020-05-18T21:31:27.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.101+0000 7f82fcfa4700 1 --2- 172.21.15.63:0/2941769585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f805f110 0x7f82f80b2940 secure :-1 s=READY pgs=1023 cs=0 l=1 rx=0x7f82e0002f70 tx=0x7f82e0007a80).stop 2020-05-18T21:31:27.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.105+0000 7f82fcfa4700 1 -- 172.21.15.63:0/2941769585 shutdown_connections 2020-05-18T21:31:27.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.105+0000 7f82fcfa4700 1 --2- 172.21.15.63:0/2941769585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f812bec0 0x7f82f8149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:27.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.105+0000 7f82fcfa4700 1 --2- 172.21.15.63:0/2941769585 >> v2:172.21.15.155:3300/0 conn(0x7f82f80b81b0 0x7f82f812ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:27.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.105+0000 7f82fcfa4700 1 --2- 172.21.15.63:0/2941769585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f805f110 0x7f82f80b2940 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:27.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.105+0000 7f82fcfa4700 1 -- 172.21.15.63:0/2941769585 >> 172.21.15.63:0/2941769585 conn(0x7f82f8069fc0 msgr2=0x7f82f806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:27.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.105+0000 7f82fcfa4700 1 -- 172.21.15.63:0/2941769585 shutdown_connections 2020-05-18T21:31:27.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.105+0000 7f82fcfa4700 1 -- 172.21.15.63:0/2941769585 wait complete. 2020-05-18T21:31:27.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.105+0000 7f82fcfa4700 1 Processor -- start 2020-05-18T21:31:27.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.105+0000 7f82fcfa4700 1 -- start start 2020-05-18T21:31:27.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.105+0000 7f82fcfa4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f82f805f110 0x7f82f8146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:27.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.105+0000 7f82fcfa4700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f80b81b0 0x7f82f8149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:27.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.105+0000 7f82fcfa4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f8154360 con 0x7f82f812bec0 2020-05-18T21:31:27.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.105+0000 7f82fcfa4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f814a0f0 con 0x7f82f805f110 2020-05-18T21:31:27.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.105+0000 7f82fcfa4700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f80619b0 con 0x7f82f80b81b0 2020-05-18T21:31:27.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f82f805f110 0x7f82f8146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f82f805f110 0x7f82f8146b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58168/0 (socket says 172.21.15.63:58168) 2020-05-18T21:31:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f77fe700 1 -- 172.21.15.63:0/3262026978 learned_addr learned my addr 172.21.15.63:0/3262026978 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82effff700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f80b81b0 0x7f82f8149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f77fe700 1 -- 172.21.15.63:0/3262026978 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f80b81b0 msgr2=0x7f82f8149c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f77fe700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f80b81b0 0x7f82f8149c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f77fe700 1 -- 172.21.15.63:0/3262026978 >> v1:172.21.15.155:6789/0 conn(0x7f82f812bec0 legacy=0x7f82f80620f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f77fe700 1 -- 172.21.15.63:0/3262026978 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f8062800 con 0x7f82f805f110 2020-05-18T21:31:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f77fe700 1 --2- 172.21.15.63:0/3262026978 >> v2:172.21.15.63:3300/0 conn(0x7f82f805f110 0x7f82f8146b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f82f814a840 tx=0x7f82e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f77fe700 1 --2- 172.21.15.63:0/3262026978 >> v2:172.21.15.63:3300/0 conn(0x7f82f805f110 0x7f82f8146b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f82f814a840 tx=0x7f82e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f77fe700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f805f110 0x7f82f8146b80 secure :-1 s=READY pgs=1024 cs=0 l=1 rx=0x7f82f814a840 tx=0x7f82e0007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f77fe700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f805f110 0x7f82f8146b80 secure :-1 s=THROTTLE_DONE pgs=1024 cs=0 l=1 rx=0x7f82f814a840 tx=0x7f82e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f77fe700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f805f110 0x7f82f8146b80 secure :-1 s=THROTTLE_DONE pgs=1024 cs=0 l=1 rx=0x7f82f814a840 tx=0x7f82e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f57fa700 1 -- 172.21.15.63:0/3262026978 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82e0007360 con 0x7f82f805f110 2020-05-18T21:31:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f77fe700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f805f110 0x7f82f8146b80 secure :-1 s=THROTTLE_DONE pgs=1024 cs=0 l=1 rx=0x7f82f814a840 tx=0x7f82e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f57fa700 1 -- 172.21.15.63:0/3262026978 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e00074c0 con 0x7f82f805f110 2020-05-18T21:31:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82fcfa4700 1 -- 172.21.15.63:0/3262026978 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f8147480 con 0x7f82f805f110 2020-05-18T21:31:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f57fa700 1 -- 172.21.15.63:0/3262026978 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82e00058f0 con 0x7f82f805f110 2020-05-18T21:31:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82fcfa4700 1 -- 172.21.15.63:0/3262026978 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f8154030 con 0x7f82f805f110 2020-05-18T21:31:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f77fe700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f805f110 0x7f82f8146b80 secure :-1 s=THROTTLE_DONE pgs=1024 cs=0 l=1 rx=0x7f82f814a840 tx=0x7f82e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82fcfa4700 1 -- 172.21.15.63:0/3262026978 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f8061b20 con 0x7f82f805f110 2020-05-18T21:31:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f57fa700 1 -- 172.21.15.63:0/3262026978 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f82e0005b60 con 0x7f82f805f110 2020-05-18T21:31:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f77fe700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f805f110 0x7f82f8146b80 secure :-1 s=THROTTLE_DONE pgs=1024 cs=0 l=1 rx=0x7f82f814a840 tx=0x7f82e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f57fa700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f82dc04fae0 0x7f82dc051fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82f57fa700 1 -- 172.21.15.63:0/3262026978 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f82e00642f0 con 0x7f82f805f110 2020-05-18T21:31:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.109+0000 7f82effff700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f82dc04fae0 0x7f82dc051fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.113+0000 7f82effff700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f82dc04fae0 0x7f82dc051fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f82e8002f70 tx=0x7f82e80090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.113+0000 7f82effff700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f82dc04fae0 0x7f82dc051fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f82e8002f70 tx=0x7f82e80090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.113+0000 7f82effff700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f82dc04fae0 0x7f82dc051fa0 secure :-1 s=READY pgs=408 cs=0 l=1 rx=0x7f82e8002f70 tx=0x7f82e80090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:27.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.117+0000 7f82f77fe700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f805f110 0x7f82f8146b80 secure :-1 s=THROTTLE_DONE pgs=1024 cs=0 l=1 rx=0x7f82f814a840 tx=0x7f82e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.117+0000 7f82f57fa700 1 -- 172.21.15.63:0/3262026978 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f82f8061b20 con 0x7f82f805f110 2020-05-18T21:31:27.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.273+0000 7f82fcfa4700 1 -- 172.21.15.63:0/3262026978 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f82f8061b20 con 0x7f82f805f110 2020-05-18T21:31:27.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.273+0000 7f82f77fe700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f805f110 0x7f82f8146b80 secure :-1 s=THROTTLE_DONE pgs=1024 cs=0 l=1 rx=0x7f82f814a840 tx=0x7f82e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.273+0000 7f82f57fa700 1 -- 172.21.15.63:0/3262026978 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v30) v1 ==== 80+0+4513 (secure 0 0 0) 0x7f82f8061b20 con 0x7f82f805f110 2020-05-18T21:31:27.277 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:27.278 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:27.278 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_dump": [ 2020-05-18T21:31:27.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:27.278 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.a", 2020-05-18T21:31:27.278 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJekJyyLRAAfB5XJCsXTAmZdkFOaQrokg==", 2020-05-18T21:31:27.279 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:31:27.279 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:31:27.279 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:31:27.279 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:31:27.279 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:31:27.280 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:27.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:27.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:27.280 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.b", 2020-05-18T21:31:27.280 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeSVE8MRAAEEytuzLtcQMC+1uQ/yh8eA==", 2020-05-18T21:31:27.280 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:31:27.281 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:31:27.281 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:31:27.281 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:31:27.281 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:31:27.281 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:27.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:27.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:27.282 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.0", 2020-05-18T21:31:27.282 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBq/cJeIn7mJhAArx+YEdVbsfXXNOLWdaAgWw==", 2020-05-18T21:31:27.282 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:31:27.283 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:31:27.283 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:31:27.283 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:31:27.283 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:27.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:27.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:27.284 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.1", 2020-05-18T21:31:27.284 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBt/cJelHywCRAAFyQ3sPEE0RTSy4tKfsDfyw==", 2020-05-18T21:31:27.284 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:31:27.284 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:31:27.284 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:31:27.285 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:31:27.285 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:27.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:27.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:27.285 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.2", 2020-05-18T21:31:27.286 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBv/cJecexDLBAAxhlFq20MBkKvDjuM1yi8XQ==", 2020-05-18T21:31:27.286 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:31:27.286 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:31:27.286 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:31:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:31:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.3", 2020-05-18T21:31:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBy/cJe9IqwDxAAMg1In7bIITDcOZljzzTpDQ==", 2020-05-18T21:31:27.288 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:31:27.288 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:31:27.288 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:31:27.288 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:31:27.288 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:27.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:27.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:27.289 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.4", 2020-05-18T21:31:27.289 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB3/cJeLXgxFhAA/kMVV5hCRny2uXKvvbu8Og==", 2020-05-18T21:31:27.289 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:31:27.290 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:31:27.290 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:31:27.290 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:31:27.290 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:27.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:27.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:27.291 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.5", 2020-05-18T21:31:27.291 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB5/cJeucpsNRAAjGh+6yUC8Fji9PE4COi/Eg==", 2020-05-18T21:31:27.291 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:31:27.292 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:31:27.292 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:31:27.292 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:31:27.292 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:27.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:27.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:27.293 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.6", 2020-05-18T21:31:27.293 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB8/cJelSPpGhAAXobGqH9qaW1VZfEpH8bUbQ==", 2020-05-18T21:31:27.293 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:31:27.293 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:31:27.294 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:31:27.294 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:31:27.294 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:27.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:27.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:27.295 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.7", 2020-05-18T21:31:27.295 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB+/cJeUIl5OBAAPd8H8ohOWZw9ubO7uCB6zg==", 2020-05-18T21:31:27.295 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:31:27.295 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:31:27.295 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:31:27.296 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:31:27.296 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:27.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:27.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:27.296 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.0", 2020-05-18T21:31:27.297 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeap3RNhAAi2vKpsKtzSL1Uuqm8pWYJQ==", 2020-05-18T21:31:27.297 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:31:27.297 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:31:27.297 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:31:27.297 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:31:27.297 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:27.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:27.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:27.298 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.1", 2020-05-18T21:31:27.298 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJeekrQABAA5TmzWOt24C6hgZw/WTj5dw==", 2020-05-18T21:31:27.298 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:31:27.299 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:31:27.299 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:31:27.299 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:31:27.299 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:27.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:27.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:27.300 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.2", 2020-05-18T21:31:27.300 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJehSnFAxAAXUZwqNTXqAApEB3nXs4u6g==", 2020-05-18T21:31:27.300 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:31:27.300 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:31:27.300 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:31:27.301 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:31:27.301 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:27.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:27.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:27.301 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.3", 2020-05-18T21:31:27.302 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJe2HdDBhAA07y5pn/bKKa9TBbZFvIh9g==", 2020-05-18T21:31:27.302 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:31:27.302 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:31:27.302 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:31:27.302 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:31:27.303 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:27.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:27.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:27.303 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.admin", 2020-05-18T21:31:27.303 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJe/K4fGRAA+rP3BYuWiyx/fKmQ3bV6Lw==", 2020-05-18T21:31:27.304 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:31:27.304 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:31:27.304 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:31:27.304 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:31:27.304 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:31:27.304 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:27.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:27.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:27.305 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.x", 2020-05-18T21:31:27.305 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJemmqEKhAAe5ySRz8Id0ug4matQwL0uw==", 2020-05-18T21:31:27.305 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:31:27.306 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:31:27.306 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:31:27.306 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:31:27.306 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:27.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:27.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:27.307 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.y", 2020-05-18T21:31:27.307 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeF/BNJhAAi/vrldC6qoWJWnSHpE3ung==", 2020-05-18T21:31:27.307 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:31:27.307 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:31:27.307 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:31:27.308 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:31:27.308 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:27.308 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:27.308 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:27.308 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:27.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.273+0000 7f82fcfa4700 1 -- 172.21.15.63:0/3262026978 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f82dc04fae0 msgr2=0x7f82dc051fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.273+0000 7f82fcfa4700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f82dc04fae0 0x7f82dc051fa0 secure :-1 s=READY pgs=408 cs=0 l=1 rx=0x7f82e8002f70 tx=0x7f82e80090f0).stop 2020-05-18T21:31:27.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.273+0000 7f82fcfa4700 1 -- 172.21.15.63:0/3262026978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f805f110 msgr2=0x7f82f8146b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.273+0000 7f82fcfa4700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f805f110 0x7f82f8146b80 secure :-1 s=READY pgs=1024 cs=0 l=1 rx=0x7f82f814a840 tx=0x7f82e0007a80).stop 2020-05-18T21:31:27.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.273+0000 7f82fcfa4700 1 -- 172.21.15.63:0/3262026978 shutdown_connections 2020-05-18T21:31:27.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.273+0000 7f82fcfa4700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f82dc04fae0 0x7f82dc051fa0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:27.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.273+0000 7f82fcfa4700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f80b81b0 0x7f82f8149c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:27.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.273+0000 7f82fcfa4700 1 --2- 172.21.15.63:0/3262026978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f805f110 0x7f82f8146b80 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:27.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.273+0000 7f82fcfa4700 1 -- 172.21.15.63:0/3262026978 >> 172.21.15.63:0/3262026978 conn(0x7f82f8069fc0 msgr2=0x7f82f806a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:27.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.273+0000 7f82fcfa4700 1 -- 172.21.15.63:0/3262026978 shutdown_connections 2020-05-18T21:31:27.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.273+0000 7f82fcfa4700 1 -- 172.21.15.63:0/3262026978 wait complete. 2020-05-18T21:31:27.313 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:31:27.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.421+0000 7f3d94721700 1 Processor -- start 2020-05-18T21:31:27.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.421+0000 7f3d94721700 1 -- start start 2020-05-18T21:31:27.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d94721700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3d8c0bb5e0 0x7f3d8c0acee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:27.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d94721700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8c0bbcd0 0x7f3d8c0afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:27.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d94721700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8c0af980 con 0x7f3d8c0b0280 2020-05-18T21:31:27.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d94721700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8c0af770 con 0x7f3d8c0bb5e0 2020-05-18T21:31:27.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d94721700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0bb9c0 con 0x7f3d8c0bbcd0 2020-05-18T21:31:27.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d924bd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3d8c0bb5e0 0x7f3d8c0acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d91cbc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8c0bbcd0 0x7f3d8c0afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d91cbc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8c0bbcd0 0x7f3d8c0afe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:48878/0 (socket says 172.21.15.63:48878) 2020-05-18T21:31:27.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d91cbc700 1 -- 172.21.15.63:0/975361380 learned_addr learned my addr 172.21.15.63:0/975361380 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:27.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d92cbe700 1 --1- 172.21.15.63:0/975361380 >> v1:172.21.15.155:6789/0 conn(0x7f3d8c0b0280 0x7f3d8c12efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:58684/0 (socket says 172.21.15.63:58684) 2020-05-18T21:31:27.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d91cbc700 1 -- 172.21.15.63:0/975361380 >> v2:172.21.15.155:3300/0 conn(0x7f3d8c0bb5e0 msgr2=0x7f3d8c0acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:27.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d91cbc700 1 --2- 172.21.15.63:0/975361380 >> v2:172.21.15.155:3300/0 conn(0x7f3d8c0bb5e0 0x7f3d8c0acee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:27.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d91cbc700 1 -- 172.21.15.63:0/975361380 >> v1:172.21.15.155:6789/0 conn(0x7f3d8c0b0280 legacy=0x7f3d8c12efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d91cbc700 1 -- 172.21.15.63:0/975361380 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c0af3d0 con 0x7f3d8c0bbcd0 2020-05-18T21:31:27.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d91cbc700 1 --2- 172.21.15.63:0/975361380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8c0bbcd0 0x7f3d8c0afe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3d800032f0 tx=0x7f3d80007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d91cbc700 1 --2- 172.21.15.63:0/975361380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8c0bbcd0 0x7f3d8c0afe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3d800032f0 tx=0x7f3d80007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d91cbc700 1 --2- 172.21.15.63:0/975361380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8c0bbcd0 0x7f3d8c0afe20 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f3d800032f0 tx=0x7f3d80007e00).ready entity=mon.2 client_cookie=42e29b3c4af1de8c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:27.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d91cbc700 1 --2- 172.21.15.63:0/975361380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8c0bbcd0 0x7f3d8c0afe20 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f3d800032f0 tx=0x7f3d80007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d914bb700 1 -- 172.21.15.63:0/975361380 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d80011d10 con 0x7f3d8c0bbcd0 2020-05-18T21:31:27.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d91cbc700 1 --2- 172.21.15.63:0/975361380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8c0bbcd0 0x7f3d8c0afe20 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f3d800032f0 tx=0x7f3d80007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d91cbc700 1 --2- 172.21.15.63:0/975361380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8c0bbcd0 0x7f3d8c0afe20 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f3d800032f0 tx=0x7f3d80007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d914bb700 1 -- 172.21.15.63:0/975361380 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d80011e70 con 0x7f3d8c0bbcd0 2020-05-18T21:31:27.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d914bb700 1 -- 172.21.15.63:0/975361380 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d8000a370 con 0x7f3d8c0bbcd0 2020-05-18T21:31:27.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d94721700 1 -- 172.21.15.63:0/975361380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8c0bbcd0 msgr2=0x7f3d8c0afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d94721700 1 --2- 172.21.15.63:0/975361380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8c0bbcd0 0x7f3d8c0afe20 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f3d800032f0 tx=0x7f3d80007e00).stop 2020-05-18T21:31:27.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d94721700 1 -- 172.21.15.63:0/975361380 shutdown_connections 2020-05-18T21:31:27.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d94721700 1 --2- 172.21.15.63:0/975361380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8c0bbcd0 0x7f3d8c0afe20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:27.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d94721700 1 --2- 172.21.15.63:0/975361380 >> v2:172.21.15.155:3300/0 conn(0x7f3d8c0bb5e0 0x7f3d8c0acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:27.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d94721700 1 -- 172.21.15.63:0/975361380 >> 172.21.15.63:0/975361380 conn(0x7f3d8c069b70 msgr2=0x7f3d8c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:27.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d94721700 1 -- 172.21.15.63:0/975361380 shutdown_connections 2020-05-18T21:31:27.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.425+0000 7f3d94721700 1 -- 172.21.15.63:0/975361380 wait complete. 2020-05-18T21:31:27.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d94721700 1 Processor -- start 2020-05-18T21:31:27.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d94721700 1 -- start start 2020-05-18T21:31:27.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d94721700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3d8c0b0280 0x7f3d8c0b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:27.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d94721700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8c0bbcd0 0x7f3d8c0ba240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:27.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d94721700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8c1533a0 con 0x7f3d8c0bb5e0 2020-05-18T21:31:27.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d94721700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8c0ba6a0 con 0x7f3d8c0b0280 2020-05-18T21:31:27.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d94721700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c157660 con 0x7f3d8c0bbcd0 2020-05-18T21:31:27.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d924bd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3d8c0b0280 0x7f3d8c0b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d924bd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3d8c0b0280 0x7f3d8c0b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58182/0 (socket says 172.21.15.63:58182) 2020-05-18T21:31:27.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d924bd700 1 -- 172.21.15.63:0/2701234437 learned_addr learned my addr 172.21.15.63:0/2701234437 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:27.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d92cbe700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8c0bbcd0 0x7f3d8c0ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d924bd700 1 -- 172.21.15.63:0/2701234437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8c0bbcd0 msgr2=0x7f3d8c0ba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d8b7fe700 1 -- 172.21.15.63:0/2701234437 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 108507229 0 0) 0x7f3d8c1533a0 con 0x7f3d8c0bb5e0 2020-05-18T21:31:27.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d924bd700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8c0bbcd0 0x7f3d8c0ba240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:27.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d924bd700 1 -- 172.21.15.63:0/2701234437 >> v1:172.21.15.63:6789/0 conn(0x7f3d8c0bb5e0 legacy=0x7f3d8c0b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d924bd700 1 -- 172.21.15.63:0/2701234437 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c1535d0 con 0x7f3d8c0b0280 2020-05-18T21:31:27.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d924bd700 1 --2- 172.21.15.63:0/2701234437 >> v2:172.21.15.63:3300/0 conn(0x7f3d8c0b0280 0x7f3d8c0b45e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3d7c0030b0 tx=0x7f3d7c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d924bd700 1 --2- 172.21.15.63:0/2701234437 >> v2:172.21.15.63:3300/0 conn(0x7f3d8c0b0280 0x7f3d8c0b45e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3d7c0030b0 tx=0x7f3d7c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d924bd700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d8c0b0280 0x7f3d8c0b45e0 secure :-1 s=READY pgs=1026 cs=0 l=1 rx=0x7f3d7c0030b0 tx=0x7f3d7c010cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:27.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d924bd700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d8c0b0280 0x7f3d8c0b45e0 secure :-1 s=THROTTLE_DONE pgs=1026 cs=0 l=1 rx=0x7f3d7c0030b0 tx=0x7f3d7c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d924bd700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d8c0b0280 0x7f3d8c0b45e0 secure :-1 s=THROTTLE_DONE pgs=1026 cs=0 l=1 rx=0x7f3d7c0030b0 tx=0x7f3d7c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d924bd700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d8c0b0280 0x7f3d8c0b45e0 secure :-1 s=THROTTLE_DONE pgs=1026 cs=0 l=1 rx=0x7f3d7c0030b0 tx=0x7f3d7c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d8b7fe700 1 -- 172.21.15.63:0/2701234437 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d7c007180 con 0x7f3d8c0b0280 2020-05-18T21:31:27.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d8b7fe700 1 -- 172.21.15.63:0/2701234437 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7c0072e0 con 0x7f3d8c0b0280 2020-05-18T21:31:27.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d94721700 1 -- 172.21.15.63:0/2701234437 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8c0b68e0 con 0x7f3d8c0b0280 2020-05-18T21:31:27.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d8b7fe700 1 -- 172.21.15.63:0/2701234437 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d7c012360 con 0x7f3d8c0b0280 2020-05-18T21:31:27.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.429+0000 7f3d94721700 1 -- 172.21.15.63:0/2701234437 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8c0b2780 con 0x7f3d8c0b0280 2020-05-18T21:31:27.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.433+0000 7f3d924bd700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d8c0b0280 0x7f3d8c0b45e0 secure :-1 s=THROTTLE_DONE pgs=1026 cs=0 l=1 rx=0x7f3d7c0030b0 tx=0x7f3d7c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.433+0000 7f3d94721700 1 -- 172.21.15.63:0/2701234437 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8c0569e0 con 0x7f3d8c0b0280 2020-05-18T21:31:27.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.433+0000 7f3d8b7fe700 1 -- 172.21.15.63:0/2701234437 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3d7c0124c0 con 0x7f3d8c0b0280 2020-05-18T21:31:27.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.433+0000 7f3d924bd700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d8c0b0280 0x7f3d8c0b45e0 secure :-1 s=THROTTLE_DONE pgs=1026 cs=0 l=1 rx=0x7f3d7c0030b0 tx=0x7f3d7c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.433+0000 7f3d8b7fe700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3d6c04f900 0x7f3d6c051dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:27.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.433+0000 7f3d8b7fe700 1 -- 172.21.15.63:0/2701234437 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3d7c064180 con 0x7f3d8c0b0280 2020-05-18T21:31:27.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.433+0000 7f3d91cbc700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3d6c04f900 0x7f3d6c051dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.433+0000 7f3d91cbc700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3d6c04f900 0x7f3d6c051dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3d80008880 tx=0x7f3d80007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.433+0000 7f3d91cbc700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3d6c04f900 0x7f3d6c051dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3d80008880 tx=0x7f3d80007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.433+0000 7f3d91cbc700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3d6c04f900 0x7f3d6c051dc0 secure :-1 s=READY pgs=409 cs=0 l=1 rx=0x7f3d80008880 tx=0x7f3d80007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:27.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.437+0000 7f3d924bd700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d8c0b0280 0x7f3d8c0b45e0 secure :-1 s=THROTTLE_DONE pgs=1026 cs=0 l=1 rx=0x7f3d7c0030b0 tx=0x7f3d7c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.437+0000 7f3d8b7fe700 1 -- 172.21.15.63:0/2701234437 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3d7c03e4b0 con 0x7f3d8c0b0280 2020-05-18T21:31:27.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.557+0000 7f3d94721700 1 -- 172.21.15.63:0/2701234437 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d8c0008d0 con 0x7f3d8c0b0280 2020-05-18T21:31:27.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.557+0000 7f3d924bd700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d8c0b0280 0x7f3d8c0b45e0 secure :-1 s=THROTTLE_DONE pgs=1026 cs=0 l=1 rx=0x7f3d7c0030b0 tx=0x7f3d7c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.557+0000 7f3d8b7fe700 1 -- 172.21.15.63:0/2701234437 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+13233 (secure 0 0 0) 0x7f3d7c0430e0 con 0x7f3d8c0b0280 2020-05-18T21:31:27.565 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:27.566 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":80,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:31:26.923601+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:31:27.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.561+0000 7f3d94721700 1 -- 172.21.15.63:0/2701234437 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3d6c04f900 msgr2=0x7f3d6c051dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.561+0000 7f3d94721700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3d6c04f900 0x7f3d6c051dc0 secure :-1 s=READY pgs=409 cs=0 l=1 rx=0x7f3d80008880 tx=0x7f3d80007e00).stop 2020-05-18T21:31:27.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.561+0000 7f3d94721700 1 -- 172.21.15.63:0/2701234437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d8c0b0280 msgr2=0x7f3d8c0b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.561+0000 7f3d94721700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d8c0b0280 0x7f3d8c0b45e0 secure :-1 s=READY pgs=1026 cs=0 l=1 rx=0x7f3d7c0030b0 tx=0x7f3d7c010cd0).stop 2020-05-18T21:31:27.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.561+0000 7f3d94721700 1 -- 172.21.15.63:0/2701234437 shutdown_connections 2020-05-18T21:31:27.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.561+0000 7f3d94721700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3d6c04f900 0x7f3d6c051dc0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:27.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.561+0000 7f3d94721700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8c0bbcd0 0x7f3d8c0ba240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:27.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.561+0000 7f3d94721700 1 --2- 172.21.15.63:0/2701234437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d8c0b0280 0x7f3d8c0b45e0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:27.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.561+0000 7f3d94721700 1 -- 172.21.15.63:0/2701234437 >> 172.21.15.63:0/2701234437 conn(0x7f3d8c069b70 msgr2=0x7f3d8c12dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:27.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.561+0000 7f3d94721700 1 -- 172.21.15.63:0/2701234437 shutdown_connections 2020-05-18T21:31:27.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.561+0000 7f3d94721700 1 -- 172.21.15.63:0/2701234437 wait complete. 2020-05-18T21:31:27.575 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-05-18T21:31:27.576 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:31:27.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25ab191700 1 Processor -- start 2020-05-18T21:31:27.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25ab191700 1 -- start start 2020-05-18T21:31:27.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25ab191700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f25a40b6d70 0x7f25a4145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:27.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25ab191700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f25a40b7bf0 0x7f25a40b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:27.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25ab191700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a4143810 con 0x7f25a4143430 2020-05-18T21:31:27.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25ab191700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a40b7210 con 0x7f25a40b6d70 2020-05-18T21:31:27.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25ab191700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a40b74b0 con 0x7f25a40b7bf0 2020-05-18T21:31:27.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25a3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f25a40b6d70 0x7f25a4145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25a3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f25a40b6d70 0x7f25a4145dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58192/0 (socket says 172.21.15.63:58192) 2020-05-18T21:31:27.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25a3fff700 1 -- 172.21.15.63:0/235245351 learned_addr learned my addr 172.21.15.63:0/235245351 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:27.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25a972e700 1 --2- 172.21.15.63:0/235245351 >> v2:172.21.15.155:3300/0 conn(0x7f25a40b7bf0 0x7f25a40b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25a3fff700 1 -- 172.21.15.63:0/235245351 >> v2:172.21.15.155:3300/0 conn(0x7f25a40b7bf0 msgr2=0x7f25a40b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:27.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25a3fff700 1 --2- 172.21.15.63:0/235245351 >> v2:172.21.15.155:3300/0 conn(0x7f25a40b7bf0 0x7f25a40b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:27.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25a3fff700 1 -- 172.21.15.63:0/235245351 >> v1:172.21.15.155:6789/0 conn(0x7f25a4143430 legacy=0x7f25a40b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:27.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25a3fff700 1 -- 172.21.15.63:0/235245351 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a40b7750 con 0x7f25a40b6d70 2020-05-18T21:31:27.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25a972e700 1 --2- 172.21.15.63:0/235245351 >> v2:172.21.15.155:3300/0 conn(0x7f25a40b7bf0 0x7f25a40b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:31:27.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25a3fff700 1 --2- 172.21.15.63:0/235245351 >> v2:172.21.15.63:3300/0 conn(0x7f25a40b6d70 0x7f25a4145dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2590002f70 tx=0x7f25a405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25a3fff700 1 --2- 172.21.15.63:0/235245351 >> v2:172.21.15.63:3300/0 conn(0x7f25a40b6d70 0x7f25a4145dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2590002f70 tx=0x7f25a405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25a3fff700 1 --2- 172.21.15.63:0/235245351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25a40b6d70 0x7f25a4145dd0 secure :-1 s=READY pgs=1027 cs=0 l=1 rx=0x7f2590002f70 tx=0x7f25a405ab60).ready entity=mon.0 client_cookie=bd93c977ecd37456 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:27.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25a3fff700 1 --2- 172.21.15.63:0/235245351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25a40b6d70 0x7f25a4145dd0 secure :-1 s=THROTTLE_DONE pgs=1027 cs=0 l=1 rx=0x7f2590002f70 tx=0x7f25a405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25a3fff700 1 --2- 172.21.15.63:0/235245351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25a40b6d70 0x7f25a4145dd0 secure :-1 s=THROTTLE_DONE pgs=1027 cs=0 l=1 rx=0x7f2590002f70 tx=0x7f25a405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25a37fe700 1 -- 172.21.15.63:0/235245351 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2590011760 con 0x7f25a40b6d70 2020-05-18T21:31:27.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25a3fff700 1 --2- 172.21.15.63:0/235245351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25a40b6d70 0x7f25a4145dd0 secure :-1 s=THROTTLE_DONE pgs=1027 cs=0 l=1 rx=0x7f2590002f70 tx=0x7f25a405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25a37fe700 1 -- 172.21.15.63:0/235245351 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25900118c0 con 0x7f25a40b6d70 2020-05-18T21:31:27.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25a37fe700 1 -- 172.21.15.63:0/235245351 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2590011ce0 con 0x7f25a40b6d70 2020-05-18T21:31:27.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25ab191700 1 -- 172.21.15.63:0/235245351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25a40b6d70 msgr2=0x7f25a4145dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25ab191700 1 --2- 172.21.15.63:0/235245351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25a40b6d70 0x7f25a4145dd0 secure :-1 s=READY pgs=1027 cs=0 l=1 rx=0x7f2590002f70 tx=0x7f25a405ab60).stop 2020-05-18T21:31:27.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25ab191700 1 -- 172.21.15.63:0/235245351 shutdown_connections 2020-05-18T21:31:27.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25ab191700 1 --2- 172.21.15.63:0/235245351 >> v2:172.21.15.155:3300/0 conn(0x7f25a40b7bf0 0x7f25a40b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:27.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25ab191700 1 --2- 172.21.15.63:0/235245351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25a40b6d70 0x7f25a4145dd0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:27.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25ab191700 1 -- 172.21.15.63:0/235245351 >> 172.21.15.63:0/235245351 conn(0x7f25a4069b70 msgr2=0x7f25a4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:27.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25ab191700 1 -- 172.21.15.63:0/235245351 shutdown_connections 2020-05-18T21:31:27.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.685+0000 7f25ab191700 1 -- 172.21.15.63:0/235245351 wait complete. 2020-05-18T21:31:27.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25ab191700 1 Processor -- start 2020-05-18T21:31:27.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25ab191700 1 -- start start 2020-05-18T21:31:27.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25ab191700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25a40b6d70 0x7f25a4149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:27.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25ab191700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f25a4143430 0x7f25a4149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:27.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25ab191700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a4141c30 con 0x7f25a40b7bf0 2020-05-18T21:31:27.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25ab191700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a4141990 con 0x7f25a4143430 2020-05-18T21:31:27.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25ab191700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a41576d0 con 0x7f25a40b6d70 2020-05-18T21:31:27.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a3fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f25a40b7bf0 0x7f25a413fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60386/0 (socket says 172.21.15.63:60386) 2020-05-18T21:31:27.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a3fff700 1 -- 172.21.15.63:0/1414685287 learned_addr learned my addr 172.21.15.63:0/1414685287 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:27.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a972e700 1 --2- 172.21.15.63:0/1414685287 >> v2:172.21.15.155:3300/0 conn(0x7f25a4143430 0x7f25a4149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a8f2d700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25a40b6d70 0x7f25a4149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a1ffb700 1 -- 172.21.15.63:0/1414685287 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403114059 0 0) 0x7f25a4141c30 con 0x7f25a40b7bf0 2020-05-18T21:31:27.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a1ffb700 1 -- 172.21.15.63:0/1414685287 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f258c002fe0 con 0x7f25a40b7bf0 2020-05-18T21:31:27.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a1ffb700 1 -- 172.21.15.63:0/1414685287 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2092875343 0 0) 0x7f258c002fe0 con 0x7f25a40b7bf0 2020-05-18T21:31:27.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a1ffb700 1 -- 172.21.15.63:0/1414685287 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f25a4141c30 con 0x7f25a40b7bf0 2020-05-18T21:31:27.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a1ffb700 1 -- 172.21.15.63:0/1414685287 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f2590008670 con 0x7f25a40b7bf0 2020-05-18T21:31:27.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a1ffb700 1 -- 172.21.15.63:0/1414685287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25a40b6d70 msgr2=0x7f25a4149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a1ffb700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25a40b6d70 0x7f25a4149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:27.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a1ffb700 1 -- 172.21.15.63:0/1414685287 >> v2:172.21.15.155:3300/0 conn(0x7f25a4143430 msgr2=0x7f25a4149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a1ffb700 1 --2- 172.21.15.63:0/1414685287 >> v2:172.21.15.155:3300/0 conn(0x7f25a4143430 0x7f25a4149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:27.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a1ffb700 1 -- 172.21.15.63:0/1414685287 >> v1:172.21.15.63:6789/0 conn(0x7f25a40b7bf0 legacy=0x7f25a413fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a1ffb700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c004a80 0x7f258c004e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:27.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a1ffb700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f258c0039a0 0x7f258c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:27.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a1ffb700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f258c004280 0x7f258c00b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:27.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a1ffb700 1 -- 172.21.15.63:0/1414685287 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a4141990 con 0x7f258c004a80 2020-05-18T21:31:27.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a1ffb700 1 -- 172.21.15.63:0/1414685287 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a41576d0 con 0x7f258c0039a0 2020-05-18T21:31:27.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a1ffb700 1 -- 172.21.15.63:0/1414685287 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258c004870 con 0x7f258c004280 2020-05-18T21:31:27.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a8f2d700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25a40b6d70 0x7f25a4149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:31:27.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.689+0000 7f25a972e700 1 --2- 172.21.15.63:0/1414685287 >> v2:172.21.15.155:3300/0 conn(0x7f25a4143430 0x7f25a4149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:31:27.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a8f2d700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c004a80 0x7f258c004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a3fff700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f258c0039a0 0x7f258c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a972e700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f258c004280 0x7f258c00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a8f2d700 1 -- 172.21.15.63:0/1414685287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f258c004280 msgr2=0x7f258c00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a8f2d700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f258c004280 0x7f258c00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:27.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a8f2d700 1 -- 172.21.15.63:0/1414685287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f258c0039a0 msgr2=0x7f258c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a8f2d700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f258c0039a0 0x7f258c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:27.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a8f2d700 1 -- 172.21.15.63:0/1414685287 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a4148590 con 0x7f258c004a80 2020-05-18T21:31:27.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25ab191700 1 -- 172.21.15.63:0/1414685287 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a4140170 con 0x7f258c004a80 2020-05-18T21:31:27.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a8f2d700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c004a80 0x7f258c004e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f25a40b7ad0 tx=0x7f2598001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a8f2d700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c004a80 0x7f258c004e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f25a40b7ad0 tx=0x7f2598001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a8f2d700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c004a80 0x7f258c004e60 secure :-1 s=READY pgs=1029 cs=0 l=1 rx=0x7f25a40b7ad0 tx=0x7f2598001de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:27.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25ab191700 1 -- 172.21.15.63:0/1414685287 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a4141660 con 0x7f258c004a80 2020-05-18T21:31:27.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a8f2d700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c004a80 0x7f258c004e60 secure :-1 s=THROTTLE_DONE pgs=1029 cs=0 l=1 rx=0x7f25a40b7ad0 tx=0x7f2598001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a8f2d700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c004a80 0x7f258c004e60 secure :-1 s=THROTTLE_DONE pgs=1029 cs=0 l=1 rx=0x7f25a40b7ad0 tx=0x7f2598001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a8f2d700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c004a80 0x7f258c004e60 secure :-1 s=THROTTLE_DONE pgs=1029 cs=0 l=1 rx=0x7f25a40b7ad0 tx=0x7f2598001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a1ffb700 1 -- 172.21.15.63:0/1414685287 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25980069a0 con 0x7f258c004a80 2020-05-18T21:31:27.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a1ffb700 1 -- 172.21.15.63:0/1414685287 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2598006b00 con 0x7f258c004a80 2020-05-18T21:31:27.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a1ffb700 1 -- 172.21.15.63:0/1414685287 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2598006e60 con 0x7f258c004a80 2020-05-18T21:31:27.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a8f2d700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c004a80 0x7f258c004e60 secure :-1 s=THROTTLE_DONE pgs=1029 cs=0 l=1 rx=0x7f25a40b7ad0 tx=0x7f2598001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25ab191700 1 -- 172.21.15.63:0/1414685287 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2580003380 con 0x7f258c004a80 2020-05-18T21:31:27.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a1ffb700 1 -- 172.21.15.63:0/1414685287 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2598012130 con 0x7f258c004a80 2020-05-18T21:31:27.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a8f2d700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c004a80 0x7f258c004e60 secure :-1 s=THROTTLE_DONE pgs=1029 cs=0 l=1 rx=0x7f25a40b7ad0 tx=0x7f2598001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a1ffb700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f258c0580f0 0x7f258c05a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:27.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a1ffb700 1 -- 172.21.15.63:0/1414685287 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f2598063410 con 0x7f258c004a80 2020-05-18T21:31:27.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a3fff700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f258c0580f0 0x7f258c05a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a3fff700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f258c0580f0 0x7f258c05a5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2590010300 tx=0x7f25a405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a3fff700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f258c0580f0 0x7f258c05a5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2590010300 tx=0x7f25a405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.693+0000 7f25a3fff700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f258c0580f0 0x7f258c05a5b0 secure :-1 s=READY pgs=410 cs=0 l=1 rx=0x7f2590010300 tx=0x7f25a405ab60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:27.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.701+0000 7f25a8f2d700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c004a80 0x7f258c004e60 secure :-1 s=THROTTLE_DONE pgs=1029 cs=0 l=1 rx=0x7f25a40b7ad0 tx=0x7f2598001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.701+0000 7f25a1ffb700 1 -- 172.21.15.63:0/1414685287 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f259803d7a0 con 0x7f258c004a80 2020-05-18T21:31:27.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.817+0000 7f25ab191700 1 -- 172.21.15.63:0/1414685287 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2580002260 con 0x7f258c004a80 2020-05-18T21:31:27.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.817+0000 7f25a8f2d700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c004a80 0x7f258c004e60 secure :-1 s=THROTTLE_DONE pgs=1029 cs=0 l=1 rx=0x7f25a40b7ad0 tx=0x7f2598001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.817+0000 7f25a1ffb700 1 -- 172.21.15.63:0/1414685287 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v80) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2598040dc0 con 0x7f258c004a80 2020-05-18T21:31:27.822 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:31:27.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.821+0000 7f25ab191700 1 -- 172.21.15.63:0/1414685287 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f258c0580f0 msgr2=0x7f258c05a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.821+0000 7f25ab191700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f258c0580f0 0x7f258c05a5b0 secure :-1 s=READY pgs=410 cs=0 l=1 rx=0x7f2590010300 tx=0x7f25a405ab60).stop 2020-05-18T21:31:27.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.821+0000 7f25ab191700 1 -- 172.21.15.63:0/1414685287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c004a80 msgr2=0x7f258c004e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.821+0000 7f25ab191700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c004a80 0x7f258c004e60 secure :-1 s=READY pgs=1029 cs=0 l=1 rx=0x7f25a40b7ad0 tx=0x7f2598001de0).stop 2020-05-18T21:31:27.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.821+0000 7f25a972e700 1 -- 172.21.15.63:0/1414685287 reap_dead start 2020-05-18T21:31:27.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.821+0000 7f25ab191700 1 -- 172.21.15.63:0/1414685287 shutdown_connections 2020-05-18T21:31:27.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.821+0000 7f25ab191700 1 --2- 172.21.15.63:0/1414685287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c004a80 0x7f258c004e60 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:27.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.821+0000 7f25ab191700 1 -- 172.21.15.63:0/1414685287 >> 172.21.15.63:0/1414685287 conn(0x7f25a4069b70 msgr2=0x7f25a40b5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:27.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.821+0000 7f25ab191700 1 -- 172.21.15.63:0/1414685287 shutdown_connections 2020-05-18T21:31:27.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.821+0000 7f25ab191700 1 -- 172.21.15.63:0/1414685287 wait complete. 2020-05-18T21:31:27.841 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:31:27.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.937+0000 7fb51f2b3700 1 Processor -- start 2020-05-18T21:31:27.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.937+0000 7fb51f2b3700 1 -- start start 2020-05-18T21:31:27.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51f2b3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb518149d50 0x7fb51806a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:27.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51f2b3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb5180ad3f0 0x7fb5180ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:27.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51f2b3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5180b3790 con 0x7fb5180adcc0 2020-05-18T21:31:27.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51f2b3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5180b39f0 con 0x7fb518149d50 2020-05-18T21:31:27.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51f2b3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5180b3c90 con 0x7fb5180ad3f0 2020-05-18T21:31:27.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51e2b1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb518149d50 0x7fb51806a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51e2b1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb518149d50 0x7fb51806a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58210/0 (socket says 172.21.15.63:58210) 2020-05-18T21:31:27.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51e2b1700 1 -- 172.21.15.63:0/120976149 learned_addr learned my addr 172.21.15.63:0/120976149 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:27.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51dab0700 1 --2- 172.21.15.63:0/120976149 >> v2:172.21.15.155:3300/0 conn(0x7fb5180ad3f0 0x7fb5180ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51e2b1700 1 -- 172.21.15.63:0/120976149 >> v2:172.21.15.155:3300/0 conn(0x7fb5180ad3f0 msgr2=0x7fb5180ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:27.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51e2b1700 1 --2- 172.21.15.63:0/120976149 >> v2:172.21.15.155:3300/0 conn(0x7fb5180ad3f0 0x7fb5180ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:27.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51e2b1700 1 -- 172.21.15.63:0/120976149 >> v1:172.21.15.155:6789/0 conn(0x7fb5180adcc0 legacy=0x7fb518060660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51e2b1700 1 -- 172.21.15.63:0/120976149 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5180ae400 con 0x7fb518149d50 2020-05-18T21:31:27.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51e2b1700 1 --2- 172.21.15.63:0/120976149 >> v2:172.21.15.63:3300/0 conn(0x7fb518149d50 0x7fb51806a630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51e2b1700 1 --2- 172.21.15.63:0/120976149 >> v2:172.21.15.63:3300/0 conn(0x7fb518149d50 0x7fb51806a630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51e2b1700 1 --2- 172.21.15.63:0/120976149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb518149d50 0x7fb51806a630 secure :-1 s=READY pgs=1030 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).ready entity=mon.0 client_cookie=51a4661b39c6f0cb server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:27.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51e2b1700 1 --2- 172.21.15.63:0/120976149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb518149d50 0x7fb51806a630 secure :-1 s=THROTTLE_DONE pgs=1030 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51d2af700 1 -- 172.21.15.63:0/120976149 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb508008e50 con 0x7fb518149d50 2020-05-18T21:31:27.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51e2b1700 1 --2- 172.21.15.63:0/120976149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb518149d50 0x7fb51806a630 secure :-1 s=THROTTLE_DONE pgs=1030 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51e2b1700 1 --2- 172.21.15.63:0/120976149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb518149d50 0x7fb51806a630 secure :-1 s=THROTTLE_DONE pgs=1030 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51d2af700 1 -- 172.21.15.63:0/120976149 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb508010800 con 0x7fb518149d50 2020-05-18T21:31:27.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51d2af700 1 -- 172.21.15.63:0/120976149 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb508010ba0 con 0x7fb518149d50 2020-05-18T21:31:27.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51f2b3700 1 -- 172.21.15.63:0/120976149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb518149d50 msgr2=0x7fb51806a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51f2b3700 1 --2- 172.21.15.63:0/120976149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb518149d50 0x7fb51806a630 secure :-1 s=READY pgs=1030 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).stop 2020-05-18T21:31:27.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51f2b3700 1 -- 172.21.15.63:0/120976149 shutdown_connections 2020-05-18T21:31:27.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51f2b3700 1 --2- 172.21.15.63:0/120976149 >> v2:172.21.15.155:3300/0 conn(0x7fb5180ad3f0 0x7fb5180ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:27.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51f2b3700 1 --2- 172.21.15.63:0/120976149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb518149d50 0x7fb51806a630 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:27.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51f2b3700 1 -- 172.21.15.63:0/120976149 >> 172.21.15.63:0/120976149 conn(0x7fb51805fb90 msgr2=0x7fb518069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:27.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51f2b3700 1 -- 172.21.15.63:0/120976149 shutdown_connections 2020-05-18T21:31:27.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.941+0000 7fb51f2b3700 1 -- 172.21.15.63:0/120976149 wait complete. 2020-05-18T21:31:27.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51f2b3700 1 Processor -- start 2020-05-18T21:31:27.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51f2b3700 1 -- start start 2020-05-18T21:31:27.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51f2b3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb5180ad3f0 0x7fb518145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:27.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51f2b3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb518149d50 0x7fb5180b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:27.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51f2b3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5180b11c0 con 0x7fb5180adcc0 2020-05-18T21:31:27.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51f2b3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb518142fe0 con 0x7fb5180ad3f0 2020-05-18T21:31:27.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51f2b3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5181443e0 con 0x7fb518149d50 2020-05-18T21:31:27.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51dab0700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb5180adcc0 0x7fb518142470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60402/0 (socket says 172.21.15.63:60402) 2020-05-18T21:31:27.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51dab0700 1 -- 172.21.15.63:0/1093987054 learned_addr learned my addr 172.21.15.63:0/1093987054 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:27.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51e2b1700 1 --2- 172.21.15.63:0/1093987054 >> v2:172.21.15.63:3300/0 conn(0x7fb5180ad3f0 0x7fb518145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51eab2700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb518149d50 0x7fb5180b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb5177fe700 1 -- 172.21.15.63:0/1093987054 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571778164 0 0) 0x7fb5180b11c0 con 0x7fb5180adcc0 2020-05-18T21:31:27.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51e2b1700 1 -- 172.21.15.63:0/1093987054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb518149d50 msgr2=0x7fb5180b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51e2b1700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb518149d50 0x7fb5180b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:27.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51e2b1700 1 -- 172.21.15.63:0/1093987054 >> v1:172.21.15.63:6789/0 conn(0x7fb5180adcc0 legacy=0x7fb518142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:27.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51e2b1700 1 -- 172.21.15.63:0/1093987054 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5181462c0 con 0x7fb5180ad3f0 2020-05-18T21:31:27.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51eab2700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb518149d50 0x7fb5180b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:31:27.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51e2b1700 1 --2- 172.21.15.63:0/1093987054 >> v2:172.21.15.63:3300/0 conn(0x7fb5180ad3f0 0x7fb518145d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51e2b1700 1 --2- 172.21.15.63:0/1093987054 >> v2:172.21.15.63:3300/0 conn(0x7fb5180ad3f0 0x7fb518145d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51e2b1700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5180ad3f0 0x7fb518145d20 secure :-1 s=READY pgs=1032 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:27.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51e2b1700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5180ad3f0 0x7fb518145d20 secure :-1 s=THROTTLE_DONE pgs=1032 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb5177fe700 1 -- 172.21.15.63:0/1093987054 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb508010320 con 0x7fb5180ad3f0 2020-05-18T21:31:27.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51e2b1700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5180ad3f0 0x7fb518145d20 secure :-1 s=THROTTLE_DONE pgs=1032 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51e2b1700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5180ad3f0 0x7fb518145d20 secure :-1 s=THROTTLE_DONE pgs=1032 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb5177fe700 1 -- 172.21.15.63:0/1093987054 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50800f780 con 0x7fb5180ad3f0 2020-05-18T21:31:27.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51f2b3700 1 -- 172.21.15.63:0/1093987054 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb518146560 con 0x7fb5180ad3f0 2020-05-18T21:31:27.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb5177fe700 1 -- 172.21.15.63:0/1093987054 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb508007370 con 0x7fb5180ad3f0 2020-05-18T21:31:27.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.945+0000 7fb51f2b3700 1 -- 172.21.15.63:0/1093987054 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb518142b80 con 0x7fb5180ad3f0 2020-05-18T21:31:27.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.949+0000 7fb51e2b1700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5180ad3f0 0x7fb518145d20 secure :-1 s=THROTTLE_DONE pgs=1032 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.949+0000 7fb5177fe700 1 -- 172.21.15.63:0/1093987054 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb508005700 con 0x7fb5180ad3f0 2020-05-18T21:31:27.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.949+0000 7fb51e2b1700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5180ad3f0 0x7fb518145d20 secure :-1 s=THROTTLE_DONE pgs=1032 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.949+0000 7fb51f2b3700 1 -- 172.21.15.63:0/1093987054 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb518143130 con 0x7fb5180ad3f0 2020-05-18T21:31:27.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.949+0000 7fb5177fe700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4f804fa70 0x7fb4f8051f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:27.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.949+0000 7fb5177fe700 1 -- 172.21.15.63:0/1093987054 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb508063ae0 con 0x7fb5180ad3f0 2020-05-18T21:31:27.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.949+0000 7fb51dab0700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4f804fa70 0x7fb4f8051f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:27.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.949+0000 7fb51dab0700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4f804fa70 0x7fb4f8051f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb50c007a80 tx=0x7fb50c002390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.949+0000 7fb51dab0700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4f804fa70 0x7fb4f8051f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb50c007a80 tx=0x7fb50c002390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.949+0000 7fb51dab0700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4f804fa70 0x7fb4f8051f30 secure :-1 s=READY pgs=411 cs=0 l=1 rx=0x7fb50c007a80 tx=0x7fb50c002390).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:27.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.961+0000 7fb51e2b1700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5180ad3f0 0x7fb518145d20 secure :-1 s=THROTTLE_DONE pgs=1032 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:27.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:27.961+0000 7fb5177fe700 1 -- 172.21.15.63:0/1093987054 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb518143130 con 0x7fb5180ad3f0 2020-05-18T21:31:28.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.077+0000 7fb51f2b3700 1 -- 172.21.15.63:0/1093987054 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb518143130 con 0x7fb5180ad3f0 2020-05-18T21:31:28.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.077+0000 7fb51e2b1700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5180ad3f0 0x7fb518145d20 secure :-1 s=THROTTLE_DONE pgs=1032 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.077+0000 7fb5177fe700 1 -- 172.21.15.63:0/1093987054 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v80) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb518143130 con 0x7fb5180ad3f0 2020-05-18T21:31:28.083 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:31:28.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.081+0000 7fb51f2b3700 1 -- 172.21.15.63:0/1093987054 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4f804fa70 msgr2=0x7fb4f8051f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:28.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.081+0000 7fb51f2b3700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4f804fa70 0x7fb4f8051f30 secure :-1 s=READY pgs=411 cs=0 l=1 rx=0x7fb50c007a80 tx=0x7fb50c002390).stop 2020-05-18T21:31:28.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.081+0000 7fb51f2b3700 1 -- 172.21.15.63:0/1093987054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5180ad3f0 msgr2=0x7fb518145d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:28.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.081+0000 7fb51f2b3700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5180ad3f0 0x7fb518145d20 secure :-1 s=READY pgs=1032 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).stop 2020-05-18T21:31:28.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.081+0000 7fb51f2b3700 1 -- 172.21.15.63:0/1093987054 shutdown_connections 2020-05-18T21:31:28.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.081+0000 7fb51f2b3700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4f804fa70 0x7fb4f8051f30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:28.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.081+0000 7fb51f2b3700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb518149d50 0x7fb5180b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:28.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.081+0000 7fb51f2b3700 1 --2- 172.21.15.63:0/1093987054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5180ad3f0 0x7fb518145d20 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:28.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.081+0000 7fb51f2b3700 1 -- 172.21.15.63:0/1093987054 >> 172.21.15.63:0/1093987054 conn(0x7fb51805fb90 msgr2=0x7fb5180b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:28.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.081+0000 7fb51f2b3700 1 -- 172.21.15.63:0/1093987054 shutdown_connections 2020-05-18T21:31:28.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.081+0000 7fb51f2b3700 1 -- 172.21.15.63:0/1093987054 wait complete. 2020-05-18T21:31:28.095 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-05-18T21:31:28.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde35539700 1 Processor -- start 2020-05-18T21:31:28.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde35539700 1 -- start start 2020-05-18T21:31:28.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde35539700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fde30061840 0x7fde3014ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:28.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde35539700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fde30061c20 0x7fde30069b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:28.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde35539700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30069fd0 0x7fde3006a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:28.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde35539700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde3014a6f0 con 0x7fde30061c20 2020-05-18T21:31:28.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde35539700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde3014a990 con 0x7fde30061840 2020-05-18T21:31:28.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde35539700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3014a3e0 con 0x7fde30069fd0 2020-05-18T21:31:28.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde2e7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fde30061c20 0x7fde30069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:28.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde2e7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fde30061c20 0x7fde30069b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58226/0 (socket says 172.21.15.63:58226) 2020-05-18T21:31:28.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde2e7fc700 1 -- 172.21.15.63:0/1013579222 learned_addr learned my addr 172.21.15.63:0/1013579222 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:28.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde2effd700 1 --2- 172.21.15.63:0/1013579222 >> v2:172.21.15.155:3300/0 conn(0x7fde30061840 0x7fde3014ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:28.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde2f7fe700 1 --2- 172.21.15.63:0/1013579222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30069fd0 0x7fde3006a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:28.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde2e7fc700 1 -- 172.21.15.63:0/1013579222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30069fd0 msgr2=0x7fde3006a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:28.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde2e7fc700 1 --2- 172.21.15.63:0/1013579222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30069fd0 0x7fde3006a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:28.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde2e7fc700 1 -- 172.21.15.63:0/1013579222 >> v2:172.21.15.155:3300/0 conn(0x7fde30061840 msgr2=0x7fde3014ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:28.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde2e7fc700 1 --2- 172.21.15.63:0/1013579222 >> v2:172.21.15.155:3300/0 conn(0x7fde30061840 0x7fde3014ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:28.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde2e7fc700 1 -- 172.21.15.63:0/1013579222 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3014b290 con 0x7fde30061c20 2020-05-18T21:31:28.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde2e7fc700 1 --2- 172.21.15.63:0/1013579222 >> v2:172.21.15.63:3300/0 conn(0x7fde30061c20 0x7fde30069b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fde18002f70 tx=0x7fde18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde2e7fc700 1 --2- 172.21.15.63:0/1013579222 >> v2:172.21.15.63:3300/0 conn(0x7fde30061c20 0x7fde30069b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fde18002f70 tx=0x7fde18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde2e7fc700 1 --2- 172.21.15.63:0/1013579222 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde30061c20 0x7fde30069b70 secure :-1 s=READY pgs=1033 cs=0 l=1 rx=0x7fde18002f70 tx=0x7fde18007a80).ready entity=mon.0 client_cookie=b5f331108a6a6818 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:28.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde2e7fc700 1 --2- 172.21.15.63:0/1013579222 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde30061c20 0x7fde30069b70 secure :-1 s=THROTTLE_DONE pgs=1033 cs=0 l=1 rx=0x7fde18002f70 tx=0x7fde18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde2e7fc700 1 --2- 172.21.15.63:0/1013579222 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde30061c20 0x7fde30069b70 secure :-1 s=THROTTLE_DONE pgs=1033 cs=0 l=1 rx=0x7fde18002f70 tx=0x7fde18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde2dffb700 1 -- 172.21.15.63:0/1013579222 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde18011600 con 0x7fde30061c20 2020-05-18T21:31:28.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde2e7fc700 1 --2- 172.21.15.63:0/1013579222 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde30061c20 0x7fde30069b70 secure :-1 s=THROTTLE_DONE pgs=1033 cs=0 l=1 rx=0x7fde18002f70 tx=0x7fde18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde2dffb700 1 -- 172.21.15.63:0/1013579222 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde18011760 con 0x7fde30061c20 2020-05-18T21:31:28.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde2dffb700 1 -- 172.21.15.63:0/1013579222 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde18011b80 con 0x7fde30061c20 2020-05-18T21:31:28.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde35539700 1 -- 172.21.15.63:0/1013579222 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde30061c20 msgr2=0x7fde30069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:28.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.189+0000 7fde35539700 1 --2- 172.21.15.63:0/1013579222 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde30061c20 0x7fde30069b70 secure :-1 s=READY pgs=1033 cs=0 l=1 rx=0x7fde18002f70 tx=0x7fde18007a80).stop 2020-05-18T21:31:28.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.193+0000 7fde35539700 1 -- 172.21.15.63:0/1013579222 shutdown_connections 2020-05-18T21:31:28.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.193+0000 7fde35539700 1 --2- 172.21.15.63:0/1013579222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30069fd0 0x7fde3006a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:28.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.193+0000 7fde35539700 1 --2- 172.21.15.63:0/1013579222 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde30061c20 0x7fde30069b70 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:28.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.193+0000 7fde35539700 1 --2- 172.21.15.63:0/1013579222 >> v2:172.21.15.155:3300/0 conn(0x7fde30061840 0x7fde3014ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:28.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.193+0000 7fde35539700 1 -- 172.21.15.63:0/1013579222 >> 172.21.15.63:0/1013579222 conn(0x7fde300ba5c0 msgr2=0x7fde300ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:28.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.193+0000 7fde35539700 1 -- 172.21.15.63:0/1013579222 shutdown_connections 2020-05-18T21:31:28.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.193+0000 7fde35539700 1 -- 172.21.15.63:0/1013579222 wait complete. 2020-05-18T21:31:28.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.193+0000 7fde35539700 1 Processor -- start 2020-05-18T21:31:28.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.193+0000 7fde35539700 1 -- start start 2020-05-18T21:31:28.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.193+0000 7fde35539700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30061840 0x7fde300b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:28.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.193+0000 7fde35539700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde300b4300 con 0x7fde30069fd0 2020-05-18T21:31:28.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.193+0000 7fde35539700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde300b45a0 con 0x7fde30061c20 2020-05-18T21:31:28.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.193+0000 7fde35539700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde301585c0 con 0x7fde30061840 2020-05-18T21:31:28.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde2f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fde30069fd0 0x7fde30157eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60420/0 (socket says 172.21.15.63:60420) 2020-05-18T21:31:28.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde2f7fe700 1 -- 172.21.15.63:0/211077171 learned_addr learned my addr 172.21.15.63:0/211077171 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:28.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde2effd700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30061840 0x7fde300b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:28.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde27fff700 1 -- 172.21.15.63:0/211077171 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1664122824 0 0) 0x7fde300b4300 con 0x7fde30069fd0 2020-05-18T21:31:28.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde27fff700 1 -- 172.21.15.63:0/211077171 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde08002fe0 con 0x7fde30069fd0 2020-05-18T21:31:28.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde27fff700 1 -- 172.21.15.63:0/211077171 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230659019 0 0) 0x7fde300b45a0 con 0x7fde30061c20 2020-05-18T21:31:28.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde2effd700 1 -- 172.21.15.63:0/211077171 >> v1:172.21.15.155:6789/0 conn(0x7fde30061c20 legacy=0x7fde301577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:28.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde2effd700 1 -- 172.21.15.63:0/211077171 >> v1:172.21.15.63:6789/0 conn(0x7fde30069fd0 legacy=0x7fde30157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:28.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde2effd700 1 -- 172.21.15.63:0/211077171 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde30141950 con 0x7fde30061840 2020-05-18T21:31:28.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde2effd700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30061840 0x7fde300b3980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fde200032f0 tx=0x7fde20010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde2effd700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30061840 0x7fde300b3980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fde200032f0 tx=0x7fde20010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde2effd700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30061840 0x7fde300b3980 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7fde200032f0 tx=0x7fde20010f80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:28.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde2effd700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30061840 0x7fde300b3980 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7fde200032f0 tx=0x7fde20010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde27fff700 1 -- 172.21.15.63:0/211077171 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde20005a80 con 0x7fde30061840 2020-05-18T21:31:28.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde2effd700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30061840 0x7fde300b3980 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7fde200032f0 tx=0x7fde20010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde2effd700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30061840 0x7fde300b3980 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7fde200032f0 tx=0x7fde20010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde27fff700 1 -- 172.21.15.63:0/211077171 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde20005be0 con 0x7fde30061840 2020-05-18T21:31:28.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde35539700 1 -- 172.21.15.63:0/211077171 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde30143010 con 0x7fde30061840 2020-05-18T21:31:28.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde27fff700 1 -- 172.21.15.63:0/211077171 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde20012a40 con 0x7fde30061840 2020-05-18T21:31:28.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde35539700 1 -- 172.21.15.63:0/211077171 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde300b3de0 con 0x7fde30061840 2020-05-18T21:31:28.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde2effd700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30061840 0x7fde300b3980 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7fde200032f0 tx=0x7fde20010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde35539700 1 -- 172.21.15.63:0/211077171 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde30141d60 con 0x7fde30061840 2020-05-18T21:31:28.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde2effd700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30061840 0x7fde300b3980 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7fde200032f0 tx=0x7fde20010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.197+0000 7fde27fff700 1 -- 172.21.15.63:0/211077171 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fde20012c40 con 0x7fde30061840 2020-05-18T21:31:28.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.201+0000 7fde27fff700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde0804fce0 0x7fde080521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:28.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.201+0000 7fde27fff700 1 -- 172.21.15.63:0/211077171 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fde20063b80 con 0x7fde30061840 2020-05-18T21:31:28.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.201+0000 7fde2e7fc700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde0804fce0 0x7fde080521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:28.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.201+0000 7fde2e7fc700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde0804fce0 0x7fde080521a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fde18008500 tx=0x7fde18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.201+0000 7fde2e7fc700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde0804fce0 0x7fde080521a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fde18008500 tx=0x7fde18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.201+0000 7fde2e7fc700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde0804fce0 0x7fde080521a0 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7fde18008500 tx=0x7fde18007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:28.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.209+0000 7fde2effd700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30061840 0x7fde300b3980 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7fde200032f0 tx=0x7fde20010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.209+0000 7fde27fff700 1 -- 172.21.15.63:0/211077171 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fde30141d60 con 0x7fde30061840 2020-05-18T21:31:28.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.329+0000 7fde35539700 1 -- 172.21.15.63:0/211077171 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fde30141d60 con 0x7fde30061840 2020-05-18T21:31:28.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.329+0000 7fde2effd700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30061840 0x7fde300b3980 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7fde200032f0 tx=0x7fde20010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.329+0000 7fde27fff700 1 -- 172.21.15.63:0/211077171 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) v1 ==== 84+0+143 (secure 0 0 0) 0x7fde30141d60 con 0x7fde30061840 2020-05-18T21:31:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:28.335 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:31:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2020-05-18T21:31:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "device_health_metrics" 2020-05-18T21:31:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 2, 2020-05-18T21:31:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "rbd" 2020-05-18T21:31:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:28.338 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:31:28.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.333+0000 7fde35539700 1 -- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde0804fce0 msgr2=0x7fde080521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:28.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.333+0000 7fde35539700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde0804fce0 0x7fde080521a0 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7fde18008500 tx=0x7fde18007a80).stop 2020-05-18T21:31:28.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.333+0000 7fde35539700 1 -- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30061840 msgr2=0x7fde300b3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:28.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.333+0000 7fde35539700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30061840 0x7fde300b3980 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7fde200032f0 tx=0x7fde20010f80).stop 2020-05-18T21:31:28.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.333+0000 7fde35539700 1 -- 172.21.15.63:0/211077171 shutdown_connections 2020-05-18T21:31:28.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.333+0000 7fde35539700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde0804fce0 0x7fde080521a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:28.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.333+0000 7fde35539700 1 --2- 172.21.15.63:0/211077171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde30061840 0x7fde300b3980 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:28.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.333+0000 7fde35539700 1 -- 172.21.15.63:0/211077171 >> 172.21.15.63:0/211077171 conn(0x7fde300ba5c0 msgr2=0x7fde30063340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:28.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.333+0000 7fde35539700 1 -- 172.21.15.63:0/211077171 shutdown_connections 2020-05-18T21:31:28.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.333+0000 7fde35539700 1 -- 172.21.15.63:0/211077171 wait complete. 2020-05-18T21:31:28.352 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-05-18T21:31:28.353 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-05-18T21:31:28.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.457+0000 7f5804efe700 1 Processor -- start 2020-05-18T21:31:28.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.457+0000 7f5804efe700 1 -- start start 2020-05-18T21:31:28.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.457+0000 7f5804efe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f58000b7bf0 0x7f5800145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:28.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f5804efe700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5800143810 con 0x7f5800143430 2020-05-18T21:31:28.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f5804efe700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58000b7210 con 0x7f58000b6d70 2020-05-18T21:31:28.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f5804efe700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58000b74b0 con 0x7f58000b7bf0 2020-05-18T21:31:28.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f57fe59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5800143430 0x7f58000b9160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60424/0 (socket says 172.21.15.63:60424) 2020-05-18T21:31:28.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f57fe59c700 1 -- 172.21.15.63:0/3685368199 learned_addr learned my addr 172.21.15.63:0/3685368199 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:28.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f57fed9d700 1 --2- 172.21.15.63:0/3685368199 >> v2:172.21.15.155:3300/0 conn(0x7f58000b7bf0 0x7f5800145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:28.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f57fd59a700 1 -- 172.21.15.63:0/3685368199 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3562291090 0 0) 0x7f5800143810 con 0x7f5800143430 2020-05-18T21:31:28.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f57fd59a700 1 -- 172.21.15.63:0/3685368199 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57e4003270 con 0x7f5800143430 2020-05-18T21:31:28.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f57fed9d700 1 -- 172.21.15.63:0/3685368199 >> v1:172.21.15.155:6789/0 conn(0x7f58000b6d70 legacy=0x7f58000b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:28.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f57fed9d700 1 -- 172.21.15.63:0/3685368199 >> v1:172.21.15.63:6789/0 conn(0x7f5800143430 legacy=0x7f58000b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:28.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f57fed9d700 1 -- 172.21.15.63:0/3685368199 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58000b7750 con 0x7f58000b7bf0 2020-05-18T21:31:28.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f57fed9d700 1 --2- 172.21.15.63:0/3685368199 >> v2:172.21.15.155:3300/0 conn(0x7f58000b7bf0 0x7f5800145dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f57f80032f0 tx=0x7f57f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f57fed9d700 1 --2- 172.21.15.63:0/3685368199 >> v2:172.21.15.155:3300/0 conn(0x7f58000b7bf0 0x7f5800145dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f57f80032f0 tx=0x7f57f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f57fed9d700 1 --2- 172.21.15.63:0/3685368199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58000b7bf0 0x7f5800145dd0 secure :-1 s=READY pgs=721 cs=0 l=1 rx=0x7f57f80032f0 tx=0x7f57f8007e00).ready entity=mon.1 client_cookie=1231deefc77f95b1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:28.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f57fed9d700 1 --2- 172.21.15.63:0/3685368199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58000b7bf0 0x7f5800145dd0 secure :-1 s=THROTTLE_DONE pgs=721 cs=0 l=1 rx=0x7f57f80032f0 tx=0x7f57f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f57fd59a700 1 -- 172.21.15.63:0/3685368199 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57f8011e60 con 0x7f58000b7bf0 2020-05-18T21:31:28.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f57fed9d700 1 --2- 172.21.15.63:0/3685368199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58000b7bf0 0x7f5800145dd0 secure :-1 s=THROTTLE_DONE pgs=721 cs=0 l=1 rx=0x7f57f80032f0 tx=0x7f57f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f57fd59a700 1 -- 172.21.15.63:0/3685368199 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f800a180 con 0x7f58000b7bf0 2020-05-18T21:31:28.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f57fed9d700 1 --2- 172.21.15.63:0/3685368199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58000b7bf0 0x7f5800145dd0 secure :-1 s=THROTTLE_DONE pgs=721 cs=0 l=1 rx=0x7f57f80032f0 tx=0x7f57f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f57fd59a700 1 -- 172.21.15.63:0/3685368199 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57f800a4e0 con 0x7f58000b7bf0 2020-05-18T21:31:28.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f5804efe700 1 -- 172.21.15.63:0/3685368199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58000b7bf0 msgr2=0x7f5800145dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:28.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f5804efe700 1 --2- 172.21.15.63:0/3685368199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58000b7bf0 0x7f5800145dd0 secure :-1 s=READY pgs=721 cs=0 l=1 rx=0x7f57f80032f0 tx=0x7f57f8007e00).stop 2020-05-18T21:31:28.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f5804efe700 1 -- 172.21.15.63:0/3685368199 shutdown_connections 2020-05-18T21:31:28.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f5804efe700 1 --2- 172.21.15.63:0/3685368199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58000b7bf0 0x7f5800145dd0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:28.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f5804efe700 1 -- 172.21.15.63:0/3685368199 >> 172.21.15.63:0/3685368199 conn(0x7f5800069b70 msgr2=0x7f5800069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:28.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f5804efe700 1 -- 172.21.15.63:0/3685368199 shutdown_connections 2020-05-18T21:31:28.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.461+0000 7f5804efe700 1 -- 172.21.15.63:0/3685368199 wait complete. 2020-05-18T21:31:28.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f5804efe700 1 Processor -- start 2020-05-18T21:31:28.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f5804efe700 1 -- start start 2020-05-18T21:31:28.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f5804efe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f58000b6d70 0x7f5800149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:28.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f5804efe700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5800141bd0 con 0x7f58000b7bf0 2020-05-18T21:31:28.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f5804efe700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58001469b0 con 0x7f5800143430 2020-05-18T21:31:28.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f5804efe700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580013fc10 con 0x7f58000b6d70 2020-05-18T21:31:28.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f57fdd9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f58000b7bf0 0x7f58001537d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60430/0 (socket says 172.21.15.63:60430) 2020-05-18T21:31:28.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f57fdd9b700 1 -- 172.21.15.63:0/2655112147 learned_addr learned my addr 172.21.15.63:0/2655112147 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:28.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f57fe59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f58000b6d70 0x7f5800149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:28.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f57ef7fe700 1 -- 172.21.15.63:0/2655112147 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812082165 0 0) 0x7f5800141bd0 con 0x7f58000b7bf0 2020-05-18T21:31:28.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f57ef7fe700 1 -- 172.21.15.63:0/2655112147 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57dc002fe0 con 0x7f58000b7bf0 2020-05-18T21:31:28.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f57ef7fe700 1 -- 172.21.15.63:0/2655112147 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 361916107 0 0) 0x7f58001469b0 con 0x7f5800143430 2020-05-18T21:31:28.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f57ef7fe700 1 -- 172.21.15.63:0/2655112147 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5800141bd0 con 0x7f5800143430 2020-05-18T21:31:28.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f57fe59c700 1 -- 172.21.15.63:0/2655112147 >> v1:172.21.15.155:6789/0 conn(0x7f5800143430 legacy=0x7f580013e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:28.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f57fe59c700 1 -- 172.21.15.63:0/2655112147 >> v1:172.21.15.63:6789/0 conn(0x7f58000b7bf0 legacy=0x7f58001537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:28.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f57fe59c700 1 -- 172.21.15.63:0/2655112147 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580013fd50 con 0x7f58000b6d70 2020-05-18T21:31:28.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f57fe59c700 1 --2- 172.21.15.63:0/2655112147 >> v2:172.21.15.63:3300/0 conn(0x7f58000b6d70 0x7f5800149d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57f4001110 tx=0x7f57f40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f57fe59c700 1 --2- 172.21.15.63:0/2655112147 >> v2:172.21.15.63:3300/0 conn(0x7f58000b6d70 0x7f5800149d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57f4001110 tx=0x7f57f40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f57fe59c700 1 --2- 172.21.15.63:0/2655112147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58000b6d70 0x7f5800149d00 secure :-1 s=READY pgs=1037 cs=0 l=1 rx=0x7f57f4001110 tx=0x7f57f40108f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:28.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f57fe59c700 1 --2- 172.21.15.63:0/2655112147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58000b6d70 0x7f5800149d00 secure :-1 s=THROTTLE_DONE pgs=1037 cs=0 l=1 rx=0x7f57f4001110 tx=0x7f57f40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f57ef7fe700 1 -- 172.21.15.63:0/2655112147 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57f4005d00 con 0x7f58000b6d70 2020-05-18T21:31:28.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f57fe59c700 1 --2- 172.21.15.63:0/2655112147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58000b6d70 0x7f5800149d00 secure :-1 s=THROTTLE_DONE pgs=1037 cs=0 l=1 rx=0x7f57f4001110 tx=0x7f57f40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f57ef7fe700 1 -- 172.21.15.63:0/2655112147 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f4005e60 con 0x7f58000b6d70 2020-05-18T21:31:28.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f57fe59c700 1 --2- 172.21.15.63:0/2655112147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58000b6d70 0x7f5800149d00 secure :-1 s=THROTTLE_DONE pgs=1037 cs=0 l=1 rx=0x7f57f4001110 tx=0x7f57f40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f57ef7fe700 1 -- 172.21.15.63:0/2655112147 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57f40062c0 con 0x7f58000b6d70 2020-05-18T21:31:28.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f5804efe700 1 -- 172.21.15.63:0/2655112147 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5800141850 con 0x7f58000b6d70 2020-05-18T21:31:28.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.465+0000 7f5804efe700 1 -- 172.21.15.63:0/2655112147 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f580013ef30 con 0x7f58000b6d70 2020-05-18T21:31:28.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.469+0000 7f5804efe700 1 -- 172.21.15.63:0/2655112147 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f580013f3e0 con 0x7f58000b6d70 2020-05-18T21:31:28.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.469+0000 7f57fe59c700 1 --2- 172.21.15.63:0/2655112147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58000b6d70 0x7f5800149d00 secure :-1 s=THROTTLE_DONE pgs=1037 cs=0 l=1 rx=0x7f57f4001110 tx=0x7f57f40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.469+0000 7f57ef7fe700 1 -- 172.21.15.63:0/2655112147 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f57f4006470 con 0x7f58000b6d70 2020-05-18T21:31:28.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.469+0000 7f57fe59c700 1 --2- 172.21.15.63:0/2655112147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58000b6d70 0x7f5800149d00 secure :-1 s=THROTTLE_DONE pgs=1037 cs=0 l=1 rx=0x7f57f4001110 tx=0x7f57f40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.469+0000 7f57ef7fe700 1 --2- 172.21.15.63:0/2655112147 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f57dc04fe80 0x7f57dc052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:28.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.469+0000 7f57ef7fe700 1 -- 172.21.15.63:0/2655112147 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f57f40090c0 con 0x7f58000b6d70 2020-05-18T21:31:28.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.469+0000 7f57fdd9b700 1 --2- 172.21.15.63:0/2655112147 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f57dc04fe80 0x7f57dc052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:28.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.469+0000 7f57fdd9b700 1 --2- 172.21.15.63:0/2655112147 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f57dc04fe80 0x7f57dc052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57f00011f0 tx=0x7f580005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.469+0000 7f57fdd9b700 1 --2- 172.21.15.63:0/2655112147 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f57dc04fe80 0x7f57dc052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57f00011f0 tx=0x7f580005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.469+0000 7f57fdd9b700 1 --2- 172.21.15.63:0/2655112147 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f57dc04fe80 0x7f57dc052340 secure :-1 s=READY pgs=413 cs=0 l=1 rx=0x7f57f00011f0 tx=0x7f580005ab60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:28.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.477+0000 7f57fe59c700 1 --2- 172.21.15.63:0/2655112147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58000b6d70 0x7f5800149d00 secure :-1 s=THROTTLE_DONE pgs=1037 cs=0 l=1 rx=0x7f57f4001110 tx=0x7f57f40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.477+0000 7f57ef7fe700 1 -- 172.21.15.63:0/2655112147 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f57f403ded0 con 0x7f58000b6d70 2020-05-18T21:31:28.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.593+0000 7f5804efe700 1 -- 172.21.15.63:0/2655112147 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f580013fd50 con 0x7f58000b6d70 2020-05-18T21:31:28.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.933+0000 7f57fe59c700 1 --2- 172.21.15.63:0/2655112147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58000b6d70 0x7f5800149d00 secure :-1 s=THROTTLE_DONE pgs=1037 cs=0 l=1 rx=0x7f57f4001110 tx=0x7f57f40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:28.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.933+0000 7f57ef7fe700 1 -- 172.21.15.63:0/2655112147 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v81) v1 ==== 133+0+0 (secure 0 0 0) 0x7f580013fd50 con 0x7f58000b6d70 2020-05-18T21:31:28.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.937+0000 7f5804efe700 1 -- 172.21.15.63:0/2655112147 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f57dc04fe80 msgr2=0x7f57dc052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:28.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.937+0000 7f5804efe700 1 --2- 172.21.15.63:0/2655112147 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f57dc04fe80 0x7f57dc052340 secure :-1 s=READY pgs=413 cs=0 l=1 rx=0x7f57f00011f0 tx=0x7f580005ab60).stop 2020-05-18T21:31:28.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.937+0000 7f5804efe700 1 -- 172.21.15.63:0/2655112147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58000b6d70 msgr2=0x7f5800149d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:28.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.937+0000 7f5804efe700 1 --2- 172.21.15.63:0/2655112147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58000b6d70 0x7f5800149d00 secure :-1 s=READY pgs=1037 cs=0 l=1 rx=0x7f57f4001110 tx=0x7f57f40108f0).stop 2020-05-18T21:31:28.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.941+0000 7f5804efe700 1 -- 172.21.15.63:0/2655112147 shutdown_connections 2020-05-18T21:31:28.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.941+0000 7f5804efe700 1 --2- 172.21.15.63:0/2655112147 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f57dc04fe80 0x7f57dc052340 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:28.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.941+0000 7f5804efe700 1 --2- 172.21.15.63:0/2655112147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58000b6d70 0x7f5800149d00 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:28.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.941+0000 7f5804efe700 1 -- 172.21.15.63:0/2655112147 >> 172.21.15.63:0/2655112147 conn(0x7f5800069b70 msgr2=0x7f58000b6230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:28.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.941+0000 7f5804efe700 1 -- 172.21.15.63:0/2655112147 shutdown_connections 2020-05-18T21:31:28.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:28.941+0000 7f5804efe700 1 -- 172.21.15.63:0/2655112147 wait complete. 2020-05-18T21:31:28.946 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2020-05-18T21:31:28.959 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-05-18T21:31:29.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.065+0000 7f5ea4640700 1 Processor -- start 2020-05-18T21:31:29.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.065+0000 7f5ea4640700 1 -- start start 2020-05-18T21:31:29.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea4640700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5e9c0b67f0 0x7f5e9c1477f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:29.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea4640700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9c147d10 con 0x7f5e9c062da0 2020-05-18T21:31:29.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea4640700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9c147fb0 con 0x7f5e9c147390 2020-05-18T21:31:29.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea4640700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e9c063180 con 0x7f5e9c0b67f0 2020-05-18T21:31:29.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea23dc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5e9c062da0 0x7f5e9c143c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60438/0 (socket says 172.21.15.63:60438) 2020-05-18T21:31:29.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea23dc700 1 -- 172.21.15.63:0/3765823906 learned_addr learned my addr 172.21.15.63:0/3765823906 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:29.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea2bdd700 1 --2- 172.21.15.63:0/3765823906 >> v2:172.21.15.155:3300/0 conn(0x7f5e9c0b67f0 0x7f5e9c1477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:29.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea13da700 1 -- 172.21.15.63:0/3765823906 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327515684 0 0) 0x7f5e9c147d10 con 0x7f5e9c062da0 2020-05-18T21:31:29.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea13da700 1 -- 172.21.15.63:0/3765823906 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e84003270 con 0x7f5e9c062da0 2020-05-18T21:31:29.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea2bdd700 1 -- 172.21.15.63:0/3765823906 >> v1:172.21.15.155:6789/0 conn(0x7f5e9c147390 legacy=0x7f5e9c0b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:29.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea2bdd700 1 -- 172.21.15.63:0/3765823906 >> v1:172.21.15.63:6789/0 conn(0x7f5e9c062da0 legacy=0x7f5e9c143c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:29.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea2bdd700 1 -- 172.21.15.63:0/3765823906 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c063970 con 0x7f5e9c0b67f0 2020-05-18T21:31:29.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea2bdd700 1 --2- 172.21.15.63:0/3765823906 >> v2:172.21.15.155:3300/0 conn(0x7f5e9c0b67f0 0x7f5e9c1477f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5e940032f0 tx=0x7f5e94007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:29.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea2bdd700 1 --2- 172.21.15.63:0/3765823906 >> v2:172.21.15.155:3300/0 conn(0x7f5e9c0b67f0 0x7f5e9c1477f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5e940032f0 tx=0x7f5e94007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:29.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea2bdd700 1 --2- 172.21.15.63:0/3765823906 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e9c0b67f0 0x7f5e9c1477f0 secure :-1 s=READY pgs=724 cs=0 l=1 rx=0x7f5e940032f0 tx=0x7f5e94007e00).ready entity=mon.1 client_cookie=ceda25e4ec7687dd server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:29.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea2bdd700 1 --2- 172.21.15.63:0/3765823906 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e9c0b67f0 0x7f5e9c1477f0 secure :-1 s=THROTTLE_DONE pgs=724 cs=0 l=1 rx=0x7f5e940032f0 tx=0x7f5e94007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:29.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea13da700 1 -- 172.21.15.63:0/3765823906 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e94011e60 con 0x7f5e9c0b67f0 2020-05-18T21:31:29.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea2bdd700 1 --2- 172.21.15.63:0/3765823906 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e9c0b67f0 0x7f5e9c1477f0 secure :-1 s=THROTTLE_DONE pgs=724 cs=0 l=1 rx=0x7f5e940032f0 tx=0x7f5e94007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:29.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea13da700 1 -- 172.21.15.63:0/3765823906 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9400a180 con 0x7f5e9c0b67f0 2020-05-18T21:31:29.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea2bdd700 1 --2- 172.21.15.63:0/3765823906 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e9c0b67f0 0x7f5e9c1477f0 secure :-1 s=THROTTLE_DONE pgs=724 cs=0 l=1 rx=0x7f5e940032f0 tx=0x7f5e94007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:29.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea13da700 1 -- 172.21.15.63:0/3765823906 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e9400a4e0 con 0x7f5e9c0b67f0 2020-05-18T21:31:29.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea4640700 1 -- 172.21.15.63:0/3765823906 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e9c0b67f0 msgr2=0x7f5e9c1477f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:29.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.069+0000 7f5ea4640700 1 --2- 172.21.15.63:0/3765823906 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e9c0b67f0 0x7f5e9c1477f0 secure :-1 s=READY pgs=724 cs=0 l=1 rx=0x7f5e940032f0 tx=0x7f5e94007e00).stop 2020-05-18T21:31:29.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.073+0000 7f5ea4640700 1 -- 172.21.15.63:0/3765823906 shutdown_connections 2020-05-18T21:31:29.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.073+0000 7f5ea4640700 1 --2- 172.21.15.63:0/3765823906 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e9c0b67f0 0x7f5e9c1477f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:29.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.073+0000 7f5ea4640700 1 -- 172.21.15.63:0/3765823906 >> 172.21.15.63:0/3765823906 conn(0x7f5e9c0b70a0 msgr2=0x7f5e9c0b74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:29.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.073+0000 7f5ea4640700 1 -- 172.21.15.63:0/3765823906 shutdown_connections 2020-05-18T21:31:29.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.073+0000 7f5ea4640700 1 -- 172.21.15.63:0/3765823906 wait complete. 2020-05-18T21:31:29.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.073+0000 7f5ea4640700 1 Processor -- start 2020-05-18T21:31:29.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.073+0000 7f5ea4640700 1 -- start start 2020-05-18T21:31:29.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.073+0000 7f5ea4640700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e9c132f40 0x7f5e9c09d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:29.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.073+0000 7f5ea4640700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9c09fcd0 con 0x7f5e9c062da0 2020-05-18T21:31:29.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.073+0000 7f5ea4640700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9c13e3d0 con 0x7f5e9c147390 2020-05-18T21:31:29.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.073+0000 7f5ea4640700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c13e670 con 0x7f5e9c132f40 2020-05-18T21:31:29.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.073+0000 7f5ea23dc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5e9c062da0 0x7f5e9c132830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60444/0 (socket says 172.21.15.63:60444) 2020-05-18T21:31:29.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.073+0000 7f5ea23dc700 1 -- 172.21.15.63:0/1718990306 learned_addr learned my addr 172.21.15.63:0/1718990306 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:29.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.073+0000 7f5ea2bdd700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e9c132f40 0x7f5e9c09d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:29.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.073+0000 7f5e8b7fe700 1 -- 172.21.15.63:0/1718990306 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62902210 0 0) 0x7f5e9c09fcd0 con 0x7f5e9c062da0 2020-05-18T21:31:29.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5e8b7fe700 1 -- 172.21.15.63:0/1718990306 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e7c002fe0 con 0x7f5e9c062da0 2020-05-18T21:31:29.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5e8b7fe700 1 -- 172.21.15.63:0/1718990306 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448655536 0 0) 0x7f5e9c13e3d0 con 0x7f5e9c147390 2020-05-18T21:31:29.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5e8b7fe700 1 -- 172.21.15.63:0/1718990306 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e9c09fcd0 con 0x7f5e9c147390 2020-05-18T21:31:29.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5ea2bdd700 1 -- 172.21.15.63:0/1718990306 >> v1:172.21.15.155:6789/0 conn(0x7f5e9c147390 legacy=0x7f5e9c13eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:29.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5ea2bdd700 1 -- 172.21.15.63:0/1718990306 >> v1:172.21.15.63:6789/0 conn(0x7f5e9c062da0 legacy=0x7f5e9c132830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:29.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5ea2bdd700 1 -- 172.21.15.63:0/1718990306 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c09f630 con 0x7f5e9c132f40 2020-05-18T21:31:29.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5ea2bdd700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e9c132f40 0x7f5e9c09d9c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e940032f0 tx=0x7f5e94007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:29.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5ea2bdd700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e9c132f40 0x7f5e9c09d9c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e940032f0 tx=0x7f5e94007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:29.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5ea2bdd700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e9c132f40 0x7f5e9c09d9c0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f5e940032f0 tx=0x7f5e94007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:29.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5ea2bdd700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e9c132f40 0x7f5e9c09d9c0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f5e940032f0 tx=0x7f5e94007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:29.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5e8b7fe700 1 -- 172.21.15.63:0/1718990306 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e94008aa0 con 0x7f5e9c132f40 2020-05-18T21:31:29.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5ea2bdd700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e9c132f40 0x7f5e9c09d9c0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f5e940032f0 tx=0x7f5e94007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:29.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5ea2bdd700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e9c132f40 0x7f5e9c09d9c0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f5e940032f0 tx=0x7f5e94007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:29.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5e8b7fe700 1 -- 172.21.15.63:0/1718990306 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9400ae50 con 0x7f5e9c132f40 2020-05-18T21:31:29.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5ea4640700 1 -- 172.21.15.63:0/1718990306 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9c09f8e0 con 0x7f5e9c132f40 2020-05-18T21:31:29.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5e8b7fe700 1 -- 172.21.15.63:0/1718990306 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e94005e60 con 0x7f5e9c132f40 2020-05-18T21:31:29.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5ea4640700 1 -- 172.21.15.63:0/1718990306 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9c146230 con 0x7f5e9c132f40 2020-05-18T21:31:29.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5ea2bdd700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e9c132f40 0x7f5e9c09d9c0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f5e940032f0 tx=0x7f5e94007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:29.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5ea4640700 1 -- 172.21.15.63:0/1718990306 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e9c146540 con 0x7f5e9c132f40 2020-05-18T21:31:29.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5e8b7fe700 1 -- 172.21.15.63:0/1718990306 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5e9400f5b0 con 0x7f5e9c132f40 2020-05-18T21:31:29.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.077+0000 7f5ea2bdd700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e9c132f40 0x7f5e9c09d9c0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f5e940032f0 tx=0x7f5e94007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:29.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.081+0000 7f5e8b7fe700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e7c04fe80 0x7f5e7c052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:29.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.081+0000 7f5e8b7fe700 1 -- 172.21.15.63:0/1718990306 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f5e940649f0 con 0x7f5e9c132f40 2020-05-18T21:31:29.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.081+0000 7f5ea23dc700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e7c04fe80 0x7f5e7c052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:29.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.081+0000 7f5ea23dc700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e7c04fe80 0x7f5e7c052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e98000f50 tx=0x7f5e980016c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:29.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.081+0000 7f5ea23dc700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e7c04fe80 0x7f5e7c052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e98000f50 tx=0x7f5e980016c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:29.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.081+0000 7f5ea23dc700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e7c04fe80 0x7f5e7c052340 secure :-1 s=READY pgs=414 cs=0 l=1 rx=0x7f5e98000f50 tx=0x7f5e980016c0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:29.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.089+0000 7f5ea2bdd700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e9c132f40 0x7f5e9c09d9c0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f5e940032f0 tx=0x7f5e94007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:29.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.089+0000 7f5e8b7fe700 1 -- 172.21.15.63:0/1718990306 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f5e9403eea0 con 0x7f5e9c132f40 2020-05-18T21:31:29.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.205+0000 7f5ea4640700 1 -- 172.21.15.63:0/1718990306 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f5e9c0569e0 con 0x7f5e9c132f40 2020-05-18T21:31:29.357 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:31:29.360 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:31:29.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.913+0000 7f5ea2bdd700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e9c132f40 0x7f5e9c09d9c0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f5e940032f0 tx=0x7f5e94007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:29.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.913+0000 7f5e8b7fe700 1 -- 172.21.15.63:0/1718990306 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v82) v1 ==== 125+0+0 (secure 0 0 0) 0x7f5e940424c0 con 0x7f5e9c132f40 2020-05-18T21:31:29.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.917+0000 7f5ea4640700 1 -- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e7c04fe80 msgr2=0x7f5e7c052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:29.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.917+0000 7f5ea4640700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e7c04fe80 0x7f5e7c052340 secure :-1 s=READY pgs=414 cs=0 l=1 rx=0x7f5e98000f50 tx=0x7f5e980016c0).stop 2020-05-18T21:31:29.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.917+0000 7f5ea4640700 1 -- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e9c132f40 msgr2=0x7f5e9c09d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:29.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.917+0000 7f5ea4640700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e9c132f40 0x7f5e9c09d9c0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f5e940032f0 tx=0x7f5e94007e00).stop 2020-05-18T21:31:29.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.921+0000 7f5ea4640700 1 -- 172.21.15.63:0/1718990306 shutdown_connections 2020-05-18T21:31:29.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.921+0000 7f5ea4640700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e7c04fe80 0x7f5e7c052340 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:29.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.921+0000 7f5ea4640700 1 --2- 172.21.15.63:0/1718990306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e9c132f40 0x7f5e9c09d9c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:29.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.921+0000 7f5ea4640700 1 -- 172.21.15.63:0/1718990306 >> 172.21.15.63:0/1718990306 conn(0x7f5e9c0b70a0 msgr2=0x7f5e9c064bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:29.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.921+0000 7f5ea4640700 1 -- 172.21.15.63:0/1718990306 shutdown_connections 2020-05-18T21:31:29.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:29.921+0000 7f5ea4640700 1 -- 172.21.15.63:0/1718990306 wait complete. 2020-05-18T21:31:29.926 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2020-05-18T21:31:29.937 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-05-18T21:31:30.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.033+0000 7f31fff77700 1 Processor -- start 2020-05-18T21:31:30.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.033+0000 7f31fff77700 1 -- start start 2020-05-18T21:31:30.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fff77700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31f80b6230 0x7f31f8146310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:30.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fff77700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f80b55d0 con 0x7f31f8141930 2020-05-18T21:31:30.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fff77700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f806a990 con 0x7f31f8141d90 2020-05-18T21:31:30.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fff77700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f80b3930 con 0x7f31f80b6230 2020-05-18T21:31:30.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fd512700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f31f8141930 0x7f31f8069b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60456/0 (socket says 172.21.15.63:60456) 2020-05-18T21:31:30.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fd512700 1 -- 172.21.15.63:0/3765306796 learned_addr learned my addr 172.21.15.63:0/3765306796 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:30.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fdd13700 1 --2- 172.21.15.63:0/3765306796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31f80b6230 0x7f31f8146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 -- 172.21.15.63:0/3765306796 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271498042 0 0) 0x7f31f80b55d0 con 0x7f31f8141930 2020-05-18T21:31:30.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 -- 172.21.15.63:0/3765306796 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31e0003270 con 0x7f31f8141930 2020-05-18T21:31:30.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 -- 172.21.15.63:0/3765306796 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307023809 0 0) 0x7f31f806a990 con 0x7f31f8141d90 2020-05-18T21:31:30.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 -- 172.21.15.63:0/3765306796 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31f80b55d0 con 0x7f31f8141d90 2020-05-18T21:31:30.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 -- 172.21.15.63:0/3765306796 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1781507463 0 0) 0x7f31e0003270 con 0x7f31f8141930 2020-05-18T21:31:30.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 -- 172.21.15.63:0/3765306796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31f80b6230 msgr2=0x7f31f8146310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:30.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 --2- 172.21.15.63:0/3765306796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31f80b6230 0x7f31f8146310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:30.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 -- 172.21.15.63:0/3765306796 >> v1:172.21.15.155:6789/0 conn(0x7f31f8141d90 legacy=0x7f31f806a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 -- 172.21.15.63:0/3765306796 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f80b3bd0 con 0x7f31f8141930 2020-05-18T21:31:30.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 -- 172.21.15.63:0/3765306796 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f31e8001710 con 0x7f31f8141930 2020-05-18T21:31:30.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 -- 172.21.15.63:0/3765306796 >> v1:172.21.15.63:6789/0 conn(0x7f31f8141930 legacy=0x7f31f8069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 --2- 172.21.15.63:0/3765306796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31e0003920 0x7f31e0003d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:30.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 --2- 172.21.15.63:0/3765306796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31f80b6230 0x7f31e0004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:30.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 --2- 172.21.15.63:0/3765306796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e0004970 0x7f31e0004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:30.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 -- 172.21.15.63:0/3765306796 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f80b3930 con 0x7f31e0003920 2020-05-18T21:31:30.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 -- 172.21.15.63:0/3765306796 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e0005250 con 0x7f31e0004970 2020-05-18T21:31:30.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 -- 172.21.15.63:0/3765306796 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e0005730 con 0x7f31f80b6230 2020-05-18T21:31:30.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fdd13700 1 --2- 172.21.15.63:0/3765306796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31e0003920 0x7f31e0003d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fd512700 1 --2- 172.21.15.63:0/3765306796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31f80b6230 0x7f31e0004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fe514700 1 --2- 172.21.15.63:0/3765306796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e0004970 0x7f31e0004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fdd13700 1 -- 172.21.15.63:0/3765306796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31f80b6230 msgr2=0x7f31e0004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:30.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fdd13700 1 --2- 172.21.15.63:0/3765306796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31f80b6230 0x7f31e0004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:30.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fdd13700 1 -- 172.21.15.63:0/3765306796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e0004970 msgr2=0x7f31e0004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:30.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fdd13700 1 --2- 172.21.15.63:0/3765306796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e0004970 0x7f31e0004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:30.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fdd13700 1 -- 172.21.15.63:0/3765306796 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e0003270 con 0x7f31e0003920 2020-05-18T21:31:30.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fdd13700 1 --2- 172.21.15.63:0/3765306796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31e0003920 0x7f31e0003d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f31f4002f70 tx=0x7f31f4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fdd13700 1 --2- 172.21.15.63:0/3765306796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31e0003920 0x7f31e0003d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f31f4002f70 tx=0x7f31f4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fdd13700 1 --2- 172.21.15.63:0/3765306796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31e0003920 0x7f31e0003d20 secure :-1 s=READY pgs=1041 cs=0 l=1 rx=0x7f31f4002f70 tx=0x7f31f4010060).ready entity=mon.0 client_cookie=478f5f370d2bfae6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:30.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fdd13700 1 --2- 172.21.15.63:0/3765306796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31e0003920 0x7f31e0003d20 secure :-1 s=THROTTLE_DONE pgs=1041 cs=0 l=1 rx=0x7f31f4002f70 tx=0x7f31f4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 -- 172.21.15.63:0/3765306796 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31f4008d70 con 0x7f31e0003920 2020-05-18T21:31:30.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fdd13700 1 --2- 172.21.15.63:0/3765306796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31e0003920 0x7f31e0003d20 secure :-1 s=THROTTLE_DONE pgs=1041 cs=0 l=1 rx=0x7f31f4002f70 tx=0x7f31f4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 -- 172.21.15.63:0/3765306796 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f4010910 con 0x7f31e0003920 2020-05-18T21:31:30.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fdd13700 1 --2- 172.21.15.63:0/3765306796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31e0003920 0x7f31e0003d20 secure :-1 s=THROTTLE_DONE pgs=1041 cs=0 l=1 rx=0x7f31f4002f70 tx=0x7f31f4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fff77700 1 -- 172.21.15.63:0/3765306796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31e0003920 msgr2=0x7f31e0003d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fcd11700 1 -- 172.21.15.63:0/3765306796 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31f4010cb0 con 0x7f31e0003920 2020-05-18T21:31:30.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fff77700 1 --2- 172.21.15.63:0/3765306796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31e0003920 0x7f31e0003d20 secure :-1 s=READY pgs=1041 cs=0 l=1 rx=0x7f31f4002f70 tx=0x7f31f4010060).stop 2020-05-18T21:31:30.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fe514700 1 -- 172.21.15.63:0/3765306796 reap_dead start 2020-05-18T21:31:30.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fff77700 1 -- 172.21.15.63:0/3765306796 shutdown_connections 2020-05-18T21:31:30.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fff77700 1 -- 172.21.15.63:0/3765306796 >> 172.21.15.63:0/3765306796 conn(0x7f31f80b9770 msgr2=0x7f31f80b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:30.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fff77700 1 -- 172.21.15.63:0/3765306796 shutdown_connections 2020-05-18T21:31:30.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.037+0000 7f31fff77700 1 -- 172.21.15.63:0/3765306796 wait complete. 2020-05-18T21:31:30.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31fff77700 1 Processor -- start 2020-05-18T21:31:30.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31fff77700 1 -- start start 2020-05-18T21:31:30.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31fff77700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f31f809e040 0x7f31f809b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:30.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31fff77700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f31f814f0d0 0x7f31f814f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:30.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31fff77700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f8062b80 con 0x7f31f809e420 2020-05-18T21:31:30.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31fff77700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f8062e20 con 0x7f31f814f0d0 2020-05-18T21:31:30.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31fff77700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f8062870 con 0x7f31f809e040 2020-05-18T21:31:30.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31fd512700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f31f809e420 0x7f31f80632c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60468/0 (socket says 172.21.15.63:60468) 2020-05-18T21:31:30.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31fd512700 1 -- 172.21.15.63:0/1572617226 learned_addr learned my addr 172.21.15.63:0/1572617226 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:30.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31fe514700 1 --2- 172.21.15.63:0/1572617226 >> v2:172.21.15.63:3300/0 conn(0x7f31f814f0d0 0x7f31f814f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31fdd13700 1 --2- 172.21.15.63:0/1572617226 >> v2:172.21.15.155:3300/0 conn(0x7f31f809e040 0x7f31f809b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31e6ffd700 1 -- 172.21.15.63:0/1572617226 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355480005 0 0) 0x7f31f8062b80 con 0x7f31f809e420 2020-05-18T21:31:30.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31e6ffd700 1 -- 172.21.15.63:0/1572617226 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31d8002fe0 con 0x7f31f809e420 2020-05-18T21:31:30.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31fe514700 1 -- 172.21.15.63:0/1572617226 >> v2:172.21.15.155:3300/0 conn(0x7f31f809e040 msgr2=0x7f31f809b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31fe514700 1 --2- 172.21.15.63:0/1572617226 >> v2:172.21.15.155:3300/0 conn(0x7f31f809e040 0x7f31f809b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:30.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31fe514700 1 -- 172.21.15.63:0/1572617226 >> v1:172.21.15.63:6789/0 conn(0x7f31f809e420 legacy=0x7f31f80632c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31fe514700 1 -- 172.21.15.63:0/1572617226 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f8061380 con 0x7f31f814f0d0 2020-05-18T21:31:30.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31fe514700 1 --2- 172.21.15.63:0/1572617226 >> v2:172.21.15.63:3300/0 conn(0x7f31f814f0d0 0x7f31f814f880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f31f80b6e10 tx=0x7f31f0004250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31fe514700 1 --2- 172.21.15.63:0/1572617226 >> v2:172.21.15.63:3300/0 conn(0x7f31f814f0d0 0x7f31f814f880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f31f80b6e10 tx=0x7f31f0004250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.041+0000 7f31fe514700 1 --2- 172.21.15.63:0/1572617226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31f814f0d0 0x7f31f814f880 secure :-1 s=READY pgs=1043 cs=0 l=1 rx=0x7f31f80b6e10 tx=0x7f31f0004250).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:30.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.045+0000 7f31fe514700 1 --2- 172.21.15.63:0/1572617226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31f814f0d0 0x7f31f814f880 secure :-1 s=THROTTLE_DONE pgs=1043 cs=0 l=1 rx=0x7f31f80b6e10 tx=0x7f31f0004250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.045+0000 7f31e6ffd700 1 -- 172.21.15.63:0/1572617226 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31f0003560 con 0x7f31f814f0d0 2020-05-18T21:31:30.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.045+0000 7f31fe514700 1 --2- 172.21.15.63:0/1572617226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31f814f0d0 0x7f31f814f880 secure :-1 s=THROTTLE_DONE pgs=1043 cs=0 l=1 rx=0x7f31f80b6e10 tx=0x7f31f0004250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.045+0000 7f31e6ffd700 1 -- 172.21.15.63:0/1572617226 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f00036c0 con 0x7f31f814f0d0 2020-05-18T21:31:30.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.045+0000 7f31fe514700 1 --2- 172.21.15.63:0/1572617226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31f814f0d0 0x7f31f814f880 secure :-1 s=THROTTLE_DONE pgs=1043 cs=0 l=1 rx=0x7f31f80b6e10 tx=0x7f31f0004250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.045+0000 7f31fff77700 1 -- 172.21.15.63:0/1572617226 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f814fce0 con 0x7f31f814f0d0 2020-05-18T21:31:30.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.045+0000 7f31e6ffd700 1 -- 172.21.15.63:0/1572617226 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31f0003aa0 con 0x7f31f814f0d0 2020-05-18T21:31:30.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.045+0000 7f31fff77700 1 -- 172.21.15.63:0/1572617226 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f81502a0 con 0x7f31f814f0d0 2020-05-18T21:31:30.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.045+0000 7f31fe514700 1 --2- 172.21.15.63:0/1572617226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31f814f0d0 0x7f31f814f880 secure :-1 s=THROTTLE_DONE pgs=1043 cs=0 l=1 rx=0x7f31f80b6e10 tx=0x7f31f0004250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.045+0000 7f31fff77700 1 -- 172.21.15.63:0/1572617226 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f80629e0 con 0x7f31f814f0d0 2020-05-18T21:31:30.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.045+0000 7f31e6ffd700 1 -- 172.21.15.63:0/1572617226 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f31f0003c00 con 0x7f31f814f0d0 2020-05-18T21:31:30.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.045+0000 7f31fe514700 1 --2- 172.21.15.63:0/1572617226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31f814f0d0 0x7f31f814f880 secure :-1 s=THROTTLE_DONE pgs=1043 cs=0 l=1 rx=0x7f31f80b6e10 tx=0x7f31f0004250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.045+0000 7f31e6ffd700 1 --2- 172.21.15.63:0/1572617226 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f31d804fd40 0x7f31d8052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:30.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.045+0000 7f31e6ffd700 1 -- 172.21.15.63:0/1572617226 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f31f0063540 con 0x7f31f814f0d0 2020-05-18T21:31:30.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.045+0000 7f31fdd13700 1 --2- 172.21.15.63:0/1572617226 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f31d804fd40 0x7f31d8052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.049+0000 7f31fdd13700 1 --2- 172.21.15.63:0/1572617226 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f31d804fd40 0x7f31d8052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f31f4002f70 tx=0x7f31f4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.049+0000 7f31fdd13700 1 --2- 172.21.15.63:0/1572617226 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f31d804fd40 0x7f31d8052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f31f4002f70 tx=0x7f31f4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.049+0000 7f31fdd13700 1 --2- 172.21.15.63:0/1572617226 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f31d804fd40 0x7f31d8052200 secure :-1 s=READY pgs=416 cs=0 l=1 rx=0x7f31f4002f70 tx=0x7f31f4010060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:30.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.053+0000 7f31fe514700 1 --2- 172.21.15.63:0/1572617226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31f814f0d0 0x7f31f814f880 secure :-1 s=THROTTLE_DONE pgs=1043 cs=0 l=1 rx=0x7f31f80b6e10 tx=0x7f31f0004250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.053+0000 7f31e6ffd700 1 -- 172.21.15.63:0/1572617226 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f31f80629e0 con 0x7f31f814f0d0 2020-05-18T21:31:30.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.205+0000 7f31fff77700 1 -- 172.21.15.63:0/1572617226 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f31f80629e0 con 0x7f31f814f0d0 2020-05-18T21:31:30.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.209+0000 7f31fe514700 1 --2- 172.21.15.63:0/1572617226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31f814f0d0 0x7f31f814f880 secure :-1 s=THROTTLE_DONE pgs=1043 cs=0 l=1 rx=0x7f31f80b6e10 tx=0x7f31f0004250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.209+0000 7f31e6ffd700 1 -- 172.21.15.63:0/1572617226 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 15 and data pool 16 v52) v1 ==== 189+0+0 (secure 0 0 0) 0x7f31f80629e0 con 0x7f31f814f0d0 2020-05-18T21:31:30.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.217+0000 7f31fff77700 1 -- 172.21.15.63:0/1572617226 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f31d804fd40 msgr2=0x7f31d8052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.217+0000 7f31fff77700 1 --2- 172.21.15.63:0/1572617226 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f31d804fd40 0x7f31d8052200 secure :-1 s=READY pgs=416 cs=0 l=1 rx=0x7f31f4002f70 tx=0x7f31f4010060).stop 2020-05-18T21:31:30.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.217+0000 7f31fff77700 1 -- 172.21.15.63:0/1572617226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31f814f0d0 msgr2=0x7f31f814f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.217+0000 7f31fff77700 1 --2- 172.21.15.63:0/1572617226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31f814f0d0 0x7f31f814f880 secure :-1 s=READY pgs=1043 cs=0 l=1 rx=0x7f31f80b6e10 tx=0x7f31f0004250).stop 2020-05-18T21:31:30.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.217+0000 7f31fff77700 1 -- 172.21.15.63:0/1572617226 shutdown_connections 2020-05-18T21:31:30.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.217+0000 7f31fff77700 1 --2- 172.21.15.63:0/1572617226 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f31d804fd40 0x7f31d8052200 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:30.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.217+0000 7f31fff77700 1 --2- 172.21.15.63:0/1572617226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31f814f0d0 0x7f31f814f880 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:30.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.217+0000 7f31fff77700 1 --2- 172.21.15.63:0/1572617226 >> v2:172.21.15.155:3300/0 conn(0x7f31f809e040 0x7f31f809b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:30.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.217+0000 7f31fff77700 1 -- 172.21.15.63:0/1572617226 >> 172.21.15.63:0/1572617226 conn(0x7f31f80b9770 msgr2=0x7f31f80b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:30.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.217+0000 7f31fff77700 1 -- 172.21.15.63:0/1572617226 shutdown_connections 2020-05-18T21:31:30.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.217+0000 7f31fff77700 1 -- 172.21.15.63:0/1572617226 wait complete. 2020-05-18T21:31:30.236 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 15 and data pool 16 2020-05-18T21:31:30.245 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:31:30.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.333+0000 7f7bf8bd0700 1 Processor -- start 2020-05-18T21:31:30.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.333+0000 7f7bf8bd0700 1 -- start start 2020-05-18T21:31:30.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf8bd0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bf4060b90 0x7f7bf4145f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:30.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf8bd0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7bf4149e80 0x7f7bf40b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:30.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf8bd0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf4146e60 con 0x7f7bf4061670 2020-05-18T21:31:30.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf8bd0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf4146480 con 0x7f7bf4149e80 2020-05-18T21:31:30.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf8bd0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4146720 con 0x7f7bf4060b90 2020-05-18T21:31:30.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf2d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7bf4149e80 0x7f7bf40b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf2d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7bf4149e80 0x7f7bf40b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58290/0 (socket says 172.21.15.63:58290) 2020-05-18T21:31:30.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf2d9d700 1 -- 172.21.15.63:0/3098681076 learned_addr learned my addr 172.21.15.63:0/3098681076 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:30.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf259c700 1 --2- 172.21.15.63:0/3098681076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bf4060b90 0x7f7bf4145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf2d9d700 1 -- 172.21.15.63:0/3098681076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bf4060b90 msgr2=0x7f7bf4145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:30.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf2d9d700 1 --2- 172.21.15.63:0/3098681076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bf4060b90 0x7f7bf4145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:30.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf2d9d700 1 -- 172.21.15.63:0/3098681076 >> v1:172.21.15.155:6789/0 conn(0x7f7bf4061670 legacy=0x7f7bf4149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf159a700 1 -- 172.21.15.63:0/3098681076 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967359047 0 0) 0x7f7bf4146e60 con 0x7f7bf4061670 2020-05-18T21:31:30.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf2d9d700 1 -- 172.21.15.63:0/3098681076 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf41469c0 con 0x7f7bf4149e80 2020-05-18T21:31:30.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf2d9d700 1 --2- 172.21.15.63:0/3098681076 >> v2:172.21.15.63:3300/0 conn(0x7f7bf4149e80 0x7f7bf40b1b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7bec0032f0 tx=0x7f7bec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf2d9d700 1 --2- 172.21.15.63:0/3098681076 >> v2:172.21.15.63:3300/0 conn(0x7f7bf4149e80 0x7f7bf40b1b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7bec0032f0 tx=0x7f7bec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf2d9d700 1 --2- 172.21.15.63:0/3098681076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bf4149e80 0x7f7bf40b1b40 secure :-1 s=READY pgs=1044 cs=0 l=1 rx=0x7f7bec0032f0 tx=0x7f7bec007e00).ready entity=mon.0 client_cookie=ce6e93364151246 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:30.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf2d9d700 1 --2- 172.21.15.63:0/3098681076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bf4149e80 0x7f7bf40b1b40 secure :-1 s=THROTTLE_DONE pgs=1044 cs=0 l=1 rx=0x7f7bec0032f0 tx=0x7f7bec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf159a700 1 -- 172.21.15.63:0/3098681076 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bec011d10 con 0x7f7bf4149e80 2020-05-18T21:31:30.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf2d9d700 1 --2- 172.21.15.63:0/3098681076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bf4149e80 0x7f7bf40b1b40 secure :-1 s=THROTTLE_DONE pgs=1044 cs=0 l=1 rx=0x7f7bec0032f0 tx=0x7f7bec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf159a700 1 -- 172.21.15.63:0/3098681076 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bec011e70 con 0x7f7bf4149e80 2020-05-18T21:31:30.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf2d9d700 1 --2- 172.21.15.63:0/3098681076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bf4149e80 0x7f7bf40b1b40 secure :-1 s=THROTTLE_DONE pgs=1044 cs=0 l=1 rx=0x7f7bec0032f0 tx=0x7f7bec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf159a700 1 -- 172.21.15.63:0/3098681076 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bec00a370 con 0x7f7bf4149e80 2020-05-18T21:31:30.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf8bd0700 1 -- 172.21.15.63:0/3098681076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bf4149e80 msgr2=0x7f7bf40b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf8bd0700 1 --2- 172.21.15.63:0/3098681076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bf4149e80 0x7f7bf40b1b40 secure :-1 s=READY pgs=1044 cs=0 l=1 rx=0x7f7bec0032f0 tx=0x7f7bec007e00).stop 2020-05-18T21:31:30.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf8bd0700 1 -- 172.21.15.63:0/3098681076 shutdown_connections 2020-05-18T21:31:30.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf8bd0700 1 --2- 172.21.15.63:0/3098681076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bf4149e80 0x7f7bf40b1b40 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:30.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf8bd0700 1 --2- 172.21.15.63:0/3098681076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bf4060b90 0x7f7bf4145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:30.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf8bd0700 1 -- 172.21.15.63:0/3098681076 >> 172.21.15.63:0/3098681076 conn(0x7f7bf40b83d0 msgr2=0x7f7bf40b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:30.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf8bd0700 1 -- 172.21.15.63:0/3098681076 shutdown_connections 2020-05-18T21:31:30.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.337+0000 7f7bf8bd0700 1 -- 172.21.15.63:0/3098681076 wait complete. 2020-05-18T21:31:30.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.341+0000 7f7bf8bd0700 1 Processor -- start 2020-05-18T21:31:30.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.341+0000 7f7bf8bd0700 1 -- start start 2020-05-18T21:31:30.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.341+0000 7f7bf8bd0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7bf4060b90 0x7f7bf40b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:30.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.341+0000 7f7bf8bd0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bf4061670 0x7f7bf40aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:30.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.341+0000 7f7bf8bd0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf4064830 con 0x7f7bf4149e80 2020-05-18T21:31:30.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.341+0000 7f7bf8bd0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf40af720 con 0x7f7bf4060b90 2020-05-18T21:31:30.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.341+0000 7f7bf8bd0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf40af9c0 con 0x7f7bf4061670 2020-05-18T21:31:30.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.341+0000 7f7bf2d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7bf4149e80 0x7f7bf4157c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60484/0 (socket says 172.21.15.63:60484) 2020-05-18T21:31:30.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.341+0000 7f7bf2d9d700 1 -- 172.21.15.63:0/3315320212 learned_addr learned my addr 172.21.15.63:0/3315320212 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:30.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.341+0000 7f7bf259c700 1 --2- 172.21.15.63:0/3315320212 >> v2:172.21.15.155:3300/0 conn(0x7f7bf4060b90 0x7f7bf40b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.341+0000 7f7bf1d9b700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bf4061670 0x7f7bf40aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.341+0000 7f7be37fe700 1 -- 172.21.15.63:0/3315320212 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243556680 0 0) 0x7f7bf4064830 con 0x7f7bf4149e80 2020-05-18T21:31:30.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.341+0000 7f7be37fe700 1 -- 172.21.15.63:0/3315320212 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bd0002fe0 con 0x7f7bf4149e80 2020-05-18T21:31:30.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.341+0000 7f7bf259c700 1 -- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bf4061670 msgr2=0x7f7bf40aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.341+0000 7f7bf259c700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bf4061670 0x7f7bf40aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:30.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.341+0000 7f7bf259c700 1 -- 172.21.15.63:0/3315320212 >> v1:172.21.15.63:6789/0 conn(0x7f7bf4149e80 legacy=0x7f7bf4157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.341+0000 7f7bf259c700 1 -- 172.21.15.63:0/3315320212 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf4063ce0 con 0x7f7bf4060b90 2020-05-18T21:31:30.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.341+0000 7f7bf1d9b700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bf4061670 0x7f7bf40aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:31:30.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.341+0000 7f7bf259c700 1 --2- 172.21.15.63:0/3315320212 >> v2:172.21.15.155:3300/0 conn(0x7f7bf4060b90 0x7f7bf40b58a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7be4002f70 tx=0x7f7be4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.345+0000 7f7bf259c700 1 --2- 172.21.15.63:0/3315320212 >> v2:172.21.15.155:3300/0 conn(0x7f7bf4060b90 0x7f7bf40b58a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7be4002f70 tx=0x7f7be4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.345+0000 7f7bf259c700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf4060b90 0x7f7bf40b58a0 secure :-1 s=READY pgs=728 cs=0 l=1 rx=0x7f7be4002f70 tx=0x7f7be4010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:30.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.345+0000 7f7bf259c700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf4060b90 0x7f7bf40b58a0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f7be4002f70 tx=0x7f7be4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.345+0000 7f7be37fe700 1 -- 172.21.15.63:0/3315320212 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7be4007550 con 0x7f7bf4060b90 2020-05-18T21:31:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.345+0000 7f7bf259c700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf4060b90 0x7f7bf40b58a0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f7be4002f70 tx=0x7f7be4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.345+0000 7f7bf259c700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf4060b90 0x7f7bf40b58a0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f7be4002f70 tx=0x7f7be4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.345+0000 7f7be37fe700 1 -- 172.21.15.63:0/3315320212 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be4005700 con 0x7f7bf4060b90 2020-05-18T21:31:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.345+0000 7f7bf8bd0700 1 -- 172.21.15.63:0/3315320212 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf4157710 con 0x7f7bf4060b90 2020-05-18T21:31:30.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.345+0000 7f7be37fe700 1 -- 172.21.15.63:0/3315320212 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7be4005aa0 con 0x7f7bf4060b90 2020-05-18T21:31:30.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.345+0000 7f7bf8bd0700 1 -- 172.21.15.63:0/3315320212 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf4158510 con 0x7f7bf4060b90 2020-05-18T21:31:30.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.345+0000 7f7bf8bd0700 1 -- 172.21.15.63:0/3315320212 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf40569e0 con 0x7f7bf4060b90 2020-05-18T21:31:30.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.345+0000 7f7bf259c700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf4060b90 0x7f7bf40b58a0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f7be4002f70 tx=0x7f7be4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.345+0000 7f7be37fe700 1 -- 172.21.15.63:0/3315320212 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7be4005ca0 con 0x7f7bf4060b90 2020-05-18T21:31:30.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.345+0000 7f7bf259c700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf4060b90 0x7f7bf40b58a0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f7be4002f70 tx=0x7f7be4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.345+0000 7f7be37fe700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7bd004fe10 0x7f7bd00522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:30.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.349+0000 7f7be37fe700 1 -- 172.21.15.63:0/3315320212 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7be4063d10 con 0x7f7bf4060b90 2020-05-18T21:31:30.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.349+0000 7f7bf1d9b700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7bd004fe10 0x7f7bd00522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.349+0000 7f7bf1d9b700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7bd004fe10 0x7f7bd00522d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7be8000bc0 tx=0x7f7be800cc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.349+0000 7f7bf1d9b700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7bd004fe10 0x7f7bd00522d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7be8000bc0 tx=0x7f7be800cc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.349+0000 7f7bf1d9b700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7bd004fe10 0x7f7bd00522d0 secure :-1 s=READY pgs=417 cs=0 l=1 rx=0x7f7be8000bc0 tx=0x7f7be800cc70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:30.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.357+0000 7f7bf259c700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf4060b90 0x7f7bf40b58a0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f7be4002f70 tx=0x7f7be4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.357+0000 7f7be37fe700 1 -- 172.21.15.63:0/3315320212 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f7be403e0a0 con 0x7f7bf4060b90 2020-05-18T21:31:30.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.473+0000 7f7bf8bd0700 1 -- 172.21.15.63:0/3315320212 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bf40008d0 con 0x7f7bf4060b90 2020-05-18T21:31:30.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.473+0000 7f7bf259c700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf4060b90 0x7f7bf40b58a0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f7be4002f70 tx=0x7f7be4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.473+0000 7f7be37fe700 1 -- 172.21.15.63:0/3315320212 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16105 (secure 0 0 0) 0x7f7be40416c0 con 0x7f7bf4060b90 2020-05-18T21:31:30.480 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:30.481 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":83,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:31:30.209549+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:31:28.631738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2020-05-18T21:31:29.243969+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:31:30.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.477+0000 7f7bf8bd0700 1 -- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7bd004fe10 msgr2=0x7f7bd00522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.477+0000 7f7bf8bd0700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7bd004fe10 0x7f7bd00522d0 secure :-1 s=READY pgs=417 cs=0 l=1 rx=0x7f7be8000bc0 tx=0x7f7be800cc70).stop 2020-05-18T21:31:30.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.477+0000 7f7bf8bd0700 1 -- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf4060b90 msgr2=0x7f7bf40b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.477+0000 7f7bf8bd0700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf4060b90 0x7f7bf40b58a0 secure :-1 s=READY pgs=728 cs=0 l=1 rx=0x7f7be4002f70 tx=0x7f7be4010bd0).stop 2020-05-18T21:31:30.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.477+0000 7f7bf8bd0700 1 -- 172.21.15.63:0/3315320212 shutdown_connections 2020-05-18T21:31:30.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.477+0000 7f7bf8bd0700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7bd004fe10 0x7f7bd00522d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:30.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.477+0000 7f7bf8bd0700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bf4061670 0x7f7bf40aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:30.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.477+0000 7f7bf8bd0700 1 --2- 172.21.15.63:0/3315320212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf4060b90 0x7f7bf40b58a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:30.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.477+0000 7f7bf8bd0700 1 -- 172.21.15.63:0/3315320212 >> 172.21.15.63:0/3315320212 conn(0x7f7bf40b83d0 msgr2=0x7f7bf413faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:30.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.477+0000 7f7bf8bd0700 1 -- 172.21.15.63:0/3315320212 shutdown_connections 2020-05-18T21:31:30.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.477+0000 7f7bf8bd0700 1 -- 172.21.15.63:0/3315320212 wait complete. 2020-05-18T21:31:30.498 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:31:30.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b42715700 1 Processor -- start 2020-05-18T21:31:30.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b42715700 1 -- start start 2020-05-18T21:31:30.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b42715700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7b3c0b4760 0x7f7b3c0648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:30.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b42715700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7b3c064d20 0x7f7b3c14d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:30.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b42715700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b3c14a330 con 0x7f7b3c05f110 2020-05-18T21:31:30.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b42715700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3c14a140 con 0x7f7b3c064d20 2020-05-18T21:31:30.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b42715700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3c14a5d0 con 0x7f7b3c0b4760 2020-05-18T21:31:30.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b41f14700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7b3c064d20 0x7f7b3c14d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b41f14700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7b3c064d20 0x7f7b3c14d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58304/0 (socket says 172.21.15.63:58304) 2020-05-18T21:31:30.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b41f14700 1 -- 172.21.15.63:0/619394935 learned_addr learned my addr 172.21.15.63:0/619394935 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:30.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b40f12700 1 --2- 172.21.15.63:0/619394935 >> v2:172.21.15.155:3300/0 conn(0x7f7b3c0b4760 0x7f7b3c0648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b41f14700 1 -- 172.21.15.63:0/619394935 >> v2:172.21.15.155:3300/0 conn(0x7f7b3c0b4760 msgr2=0x7f7b3c0648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:30.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b41f14700 1 --2- 172.21.15.63:0/619394935 >> v2:172.21.15.155:3300/0 conn(0x7f7b3c0b4760 0x7f7b3c0648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:30.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b41f14700 1 -- 172.21.15.63:0/619394935 >> v1:172.21.15.155:6789/0 conn(0x7f7b3c05f110 legacy=0x7f7b3c14aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b41f14700 1 -- 172.21.15.63:0/619394935 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c063430 con 0x7f7b3c064d20 2020-05-18T21:31:30.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b41f14700 1 --2- 172.21.15.63:0/619394935 >> v2:172.21.15.63:3300/0 conn(0x7f7b3c064d20 0x7f7b3c14d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7b2c002f70 tx=0x7f7b2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b41f14700 1 --2- 172.21.15.63:0/619394935 >> v2:172.21.15.63:3300/0 conn(0x7f7b3c064d20 0x7f7b3c14d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7b2c002f70 tx=0x7f7b2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b41f14700 1 --2- 172.21.15.63:0/619394935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b3c064d20 0x7f7b3c14d710 secure :-1 s=READY pgs=1046 cs=0 l=1 rx=0x7f7b2c002f70 tx=0x7f7b2c007a80).ready entity=mon.0 client_cookie=4bfb8da0b031666e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:30.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b41f14700 1 --2- 172.21.15.63:0/619394935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b3c064d20 0x7f7b3c14d710 secure :-1 s=THROTTLE_DONE pgs=1046 cs=0 l=1 rx=0x7f7b2c002f70 tx=0x7f7b2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b3bfff700 1 -- 172.21.15.63:0/619394935 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b2c0116b0 con 0x7f7b3c064d20 2020-05-18T21:31:30.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b41f14700 1 --2- 172.21.15.63:0/619394935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b3c064d20 0x7f7b3c14d710 secure :-1 s=THROTTLE_DONE pgs=1046 cs=0 l=1 rx=0x7f7b2c002f70 tx=0x7f7b2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b41f14700 1 --2- 172.21.15.63:0/619394935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b3c064d20 0x7f7b3c14d710 secure :-1 s=THROTTLE_DONE pgs=1046 cs=0 l=1 rx=0x7f7b2c002f70 tx=0x7f7b2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b3bfff700 1 -- 172.21.15.63:0/619394935 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2c011810 con 0x7f7b3c064d20 2020-05-18T21:31:30.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b42715700 1 -- 172.21.15.63:0/619394935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b3c064d20 msgr2=0x7f7b3c14d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b42715700 1 --2- 172.21.15.63:0/619394935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b3c064d20 0x7f7b3c14d710 secure :-1 s=READY pgs=1046 cs=0 l=1 rx=0x7f7b2c002f70 tx=0x7f7b2c007a80).stop 2020-05-18T21:31:30.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.597+0000 7f7b3bfff700 1 -- 172.21.15.63:0/619394935 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b2c011c30 con 0x7f7b3c064d20 2020-05-18T21:31:30.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b42715700 1 -- 172.21.15.63:0/619394935 shutdown_connections 2020-05-18T21:31:30.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b42715700 1 --2- 172.21.15.63:0/619394935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b3c064d20 0x7f7b3c14d710 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:30.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b42715700 1 --2- 172.21.15.63:0/619394935 >> v2:172.21.15.155:3300/0 conn(0x7f7b3c0b4760 0x7f7b3c0648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:30.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b42715700 1 -- 172.21.15.63:0/619394935 >> 172.21.15.63:0/619394935 conn(0x7f7b3c069fc0 msgr2=0x7f7b3c06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:30.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b42715700 1 -- 172.21.15.63:0/619394935 shutdown_connections 2020-05-18T21:31:30.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b42715700 1 -- 172.21.15.63:0/619394935 wait complete. 2020-05-18T21:31:30.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b42715700 1 Processor -- start 2020-05-18T21:31:30.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b42715700 1 -- start start 2020-05-18T21:31:30.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b42715700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7b3c064d20 0x7f7b3c13cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:30.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b42715700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7b3c0b4760 0x7f7b3c13f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:30.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b42715700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b3c13d0d0 con 0x7f7b3c05f110 2020-05-18T21:31:30.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b42715700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3c13fda0 con 0x7f7b3c0b4760 2020-05-18T21:31:30.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b42715700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3c14b5f0 con 0x7f7b3c064d20 2020-05-18T21:31:30.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b41f14700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7b3c0b4760 0x7f7b3c13f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b41f14700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7b3c0b4760 0x7f7b3c13f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58310/0 (socket says 172.21.15.63:58310) 2020-05-18T21:31:30.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b40f12700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7b3c064d20 0x7f7b3c13cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b41f14700 1 -- 172.21.15.63:0/343233821 learned_addr learned my addr 172.21.15.63:0/343233821 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:30.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b41f14700 1 -- 172.21.15.63:0/343233821 >> v2:172.21.15.155:3300/0 conn(0x7f7b3c064d20 msgr2=0x7f7b3c13cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b41f14700 1 --2- 172.21.15.63:0/343233821 >> v2:172.21.15.155:3300/0 conn(0x7f7b3c064d20 0x7f7b3c13cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:30.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b41f14700 1 -- 172.21.15.63:0/343233821 >> v1:172.21.15.155:6789/0 conn(0x7f7b3c05f110 legacy=0x7f7b3c146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b41f14700 1 -- 172.21.15.63:0/343233821 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c14b890 con 0x7f7b3c0b4760 2020-05-18T21:31:30.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b41f14700 1 --2- 172.21.15.63:0/343233821 >> v2:172.21.15.63:3300/0 conn(0x7f7b3c0b4760 0x7f7b3c13f940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b2c002f70 tx=0x7f7b2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b41f14700 1 --2- 172.21.15.63:0/343233821 >> v2:172.21.15.63:3300/0 conn(0x7f7b3c0b4760 0x7f7b3c13f940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b2c002f70 tx=0x7f7b2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b41f14700 1 --2- 172.21.15.63:0/343233821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b3c0b4760 0x7f7b3c13f940 secure :-1 s=READY pgs=1047 cs=0 l=1 rx=0x7f7b2c002f70 tx=0x7f7b2c007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:30.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b41f14700 1 --2- 172.21.15.63:0/343233821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b3c0b4760 0x7f7b3c13f940 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7f7b2c002f70 tx=0x7f7b2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b3a7fc700 1 -- 172.21.15.63:0/343233821 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b2c011cf0 con 0x7f7b3c0b4760 2020-05-18T21:31:30.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b41f14700 1 --2- 172.21.15.63:0/343233821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b3c0b4760 0x7f7b3c13f940 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7f7b2c002f70 tx=0x7f7b2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b41f14700 1 --2- 172.21.15.63:0/343233821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b3c0b4760 0x7f7b3c13f940 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7f7b2c002f70 tx=0x7f7b2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b3a7fc700 1 -- 172.21.15.63:0/343233821 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2c00f960 con 0x7f7b3c0b4760 2020-05-18T21:31:30.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b42715700 1 -- 172.21.15.63:0/343233821 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b3c14bb30 con 0x7f7b3c0b4760 2020-05-18T21:31:30.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b3a7fc700 1 -- 172.21.15.63:0/343233821 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b2c005ae0 con 0x7f7b3c0b4760 2020-05-18T21:31:30.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.601+0000 7f7b42715700 1 -- 172.21.15.63:0/343233821 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3c1461d0 con 0x7f7b3c0b4760 2020-05-18T21:31:30.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.605+0000 7f7b41f14700 1 --2- 172.21.15.63:0/343233821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b3c0b4760 0x7f7b3c13f940 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7f7b2c002f70 tx=0x7f7b2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.605+0000 7f7b42715700 1 -- 172.21.15.63:0/343233821 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b3c0569e0 con 0x7f7b3c0b4760 2020-05-18T21:31:30.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.605+0000 7f7b3a7fc700 1 -- 172.21.15.63:0/343233821 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7b2c005d10 con 0x7f7b3c0b4760 2020-05-18T21:31:30.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.605+0000 7f7b41f14700 1 --2- 172.21.15.63:0/343233821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b3c0b4760 0x7f7b3c13f940 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7f7b2c002f70 tx=0x7f7b2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.605+0000 7f7b3a7fc700 1 --2- 172.21.15.63:0/343233821 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b1c04fb20 0x7f7b1c051fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:30.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.605+0000 7f7b3a7fc700 1 -- 172.21.15.63:0/343233821 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7b2c064460 con 0x7f7b3c0b4760 2020-05-18T21:31:30.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.605+0000 7f7b41713700 1 --2- 172.21.15.63:0/343233821 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b1c04fb20 0x7f7b1c051fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.605+0000 7f7b41713700 1 --2- 172.21.15.63:0/343233821 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b1c04fb20 0x7f7b1c051fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b3c149aa0 tx=0x7f7b300025a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.605+0000 7f7b41713700 1 --2- 172.21.15.63:0/343233821 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b1c04fb20 0x7f7b1c051fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b3c149aa0 tx=0x7f7b300025a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.605+0000 7f7b41713700 1 --2- 172.21.15.63:0/343233821 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b1c04fb20 0x7f7b1c051fe0 secure :-1 s=READY pgs=418 cs=0 l=1 rx=0x7f7b3c149aa0 tx=0x7f7b300025a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:30.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.609+0000 7f7b41f14700 1 --2- 172.21.15.63:0/343233821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b3c0b4760 0x7f7b3c13f940 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7f7b2c002f70 tx=0x7f7b2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.609+0000 7f7b3a7fc700 1 -- 172.21.15.63:0/343233821 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f7b2c03e8b0 con 0x7f7b3c0b4760 2020-05-18T21:31:30.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.729+0000 7f7b42715700 1 -- 172.21.15.63:0/343233821 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b3c13d8c0 con 0x7f7b3c0b4760 2020-05-18T21:31:30.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.729+0000 7f7b41f14700 1 --2- 172.21.15.63:0/343233821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b3c0b4760 0x7f7b3c13f940 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7f7b2c002f70 tx=0x7f7b2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.729+0000 7f7b3a7fc700 1 -- 172.21.15.63:0/343233821 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16105 (secure 0 0 0) 0x7f7b2c041ed0 con 0x7f7b3c0b4760 2020-05-18T21:31:30.736 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:30.736 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":83,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:31:30.209549+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:31:28.631738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2020-05-18T21:31:29.243969+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:31:30.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.733+0000 7f7b42715700 1 -- 172.21.15.63:0/343233821 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b1c04fb20 msgr2=0x7f7b1c051fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.733+0000 7f7b42715700 1 --2- 172.21.15.63:0/343233821 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b1c04fb20 0x7f7b1c051fe0 secure :-1 s=READY pgs=418 cs=0 l=1 rx=0x7f7b3c149aa0 tx=0x7f7b300025a0).stop 2020-05-18T21:31:30.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.733+0000 7f7b42715700 1 -- 172.21.15.63:0/343233821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b3c0b4760 msgr2=0x7f7b3c13f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.733+0000 7f7b42715700 1 --2- 172.21.15.63:0/343233821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b3c0b4760 0x7f7b3c13f940 secure :-1 s=READY pgs=1047 cs=0 l=1 rx=0x7f7b2c002f70 tx=0x7f7b2c007a80).stop 2020-05-18T21:31:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.733+0000 7f7b42715700 1 -- 172.21.15.63:0/343233821 shutdown_connections 2020-05-18T21:31:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.733+0000 7f7b42715700 1 --2- 172.21.15.63:0/343233821 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b1c04fb20 0x7f7b1c051fe0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.733+0000 7f7b42715700 1 --2- 172.21.15.63:0/343233821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b3c0b4760 0x7f7b3c13f940 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.733+0000 7f7b42715700 1 --2- 172.21.15.63:0/343233821 >> v2:172.21.15.155:3300/0 conn(0x7f7b3c064d20 0x7f7b3c13cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.733+0000 7f7b42715700 1 -- 172.21.15.63:0/343233821 >> 172.21.15.63:0/343233821 conn(0x7f7b3c069fc0 msgr2=0x7f7b3c143ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:30.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.733+0000 7f7b42715700 1 -- 172.21.15.63:0/343233821 shutdown_connections 2020-05-18T21:31:30.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.733+0000 7f7b42715700 1 -- 172.21.15.63:0/343233821 wait complete. 2020-05-18T21:31:30.749 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-05-18T21:31:30.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.861+0000 7f5b9df93700 1 Processor -- start 2020-05-18T21:31:30.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.861+0000 7f5b9df93700 1 -- start start 2020-05-18T21:31:30.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.861+0000 7f5b9df93700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5b9805ef60 0x7f5b980ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:30.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.861+0000 7f5b9df93700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b9805f340 con 0x7f5b980b3540 2020-05-18T21:31:30.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.861+0000 7f5b9df93700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b981464a0 con 0x7f5b980b3f30 2020-05-18T21:31:30.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.861+0000 7f5b9df93700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b981462a0 con 0x7f5b9805ef60 2020-05-18T21:31:30.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.861+0000 7f5b9cf91700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5b9805ef60 0x7f5b980ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.861+0000 7f5b97fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5b980b3540 0x7f5b98145b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60504/0 (socket says 172.21.15.63:60504) 2020-05-18T21:31:30.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.861+0000 7f5b97fff700 1 -- 172.21.15.63:0/483441106 learned_addr learned my addr 172.21.15.63:0/483441106 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:30.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b9cf91700 1 -- 172.21.15.63:0/483441106 >> v1:172.21.15.155:6789/0 conn(0x7f5b980b3f30 legacy=0x7f5b981492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b9cf91700 1 -- 172.21.15.63:0/483441106 >> v1:172.21.15.63:6789/0 conn(0x7f5b980b3540 legacy=0x7f5b98145b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b9cf91700 1 -- 172.21.15.63:0/483441106 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b98146740 con 0x7f5b9805ef60 2020-05-18T21:31:30.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b9cf91700 1 --2- 172.21.15.63:0/483441106 >> v2:172.21.15.63:3300/0 conn(0x7f5b9805ef60 0x7f5b980ada70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5b8c002f70 tx=0x7f5b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b9cf91700 1 --2- 172.21.15.63:0/483441106 >> v2:172.21.15.63:3300/0 conn(0x7f5b9805ef60 0x7f5b980ada70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5b8c002f70 tx=0x7f5b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b9cf91700 1 --2- 172.21.15.63:0/483441106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9805ef60 0x7f5b980ada70 secure :-1 s=READY pgs=1049 cs=0 l=1 rx=0x7f5b8c002f70 tx=0x7f5b8c007a80).ready entity=mon.0 client_cookie=80599572f162207 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:30.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b9cf91700 1 --2- 172.21.15.63:0/483441106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9805ef60 0x7f5b980ada70 secure :-1 s=THROTTLE_DONE pgs=1049 cs=0 l=1 rx=0x7f5b8c002f70 tx=0x7f5b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b9cf91700 1 --2- 172.21.15.63:0/483441106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9805ef60 0x7f5b980ada70 secure :-1 s=THROTTLE_DONE pgs=1049 cs=0 l=1 rx=0x7f5b8c002f70 tx=0x7f5b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b977fe700 1 -- 172.21.15.63:0/483441106 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b8c008e80 con 0x7f5b9805ef60 2020-05-18T21:31:30.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b9cf91700 1 --2- 172.21.15.63:0/483441106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9805ef60 0x7f5b980ada70 secure :-1 s=THROTTLE_DONE pgs=1049 cs=0 l=1 rx=0x7f5b8c002f70 tx=0x7f5b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b977fe700 1 -- 172.21.15.63:0/483441106 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8c0116a0 con 0x7f5b9805ef60 2020-05-18T21:31:30.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b9df93700 1 -- 172.21.15.63:0/483441106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9805ef60 msgr2=0x7f5b980ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b977fe700 1 -- 172.21.15.63:0/483441106 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b8c011ac0 con 0x7f5b9805ef60 2020-05-18T21:31:30.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b9df93700 1 --2- 172.21.15.63:0/483441106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9805ef60 0x7f5b980ada70 secure :-1 s=READY pgs=1049 cs=0 l=1 rx=0x7f5b8c002f70 tx=0x7f5b8c007a80).stop 2020-05-18T21:31:30.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b9df93700 1 -- 172.21.15.63:0/483441106 shutdown_connections 2020-05-18T21:31:30.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b9df93700 1 --2- 172.21.15.63:0/483441106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9805ef60 0x7f5b980ada70 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:30.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b9df93700 1 -- 172.21.15.63:0/483441106 >> 172.21.15.63:0/483441106 conn(0x7f5b980b8b10 msgr2=0x7f5b980b8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:30.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b9df93700 1 -- 172.21.15.63:0/483441106 shutdown_connections 2020-05-18T21:31:30.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b9df93700 1 -- 172.21.15.63:0/483441106 wait complete. 2020-05-18T21:31:30.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b9df93700 1 Processor -- start 2020-05-18T21:31:30.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.865+0000 7f5b9df93700 1 -- start start 2020-05-18T21:31:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9df93700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5b9805ef60 0x7f5b980b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9df93700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b980b3f30 0x7f5b98148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9df93700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b981485c0 con 0x7f5b98099070 2020-05-18T21:31:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9df93700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b98099eb0 con 0x7f5b9805ef60 2020-05-18T21:31:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9df93700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9809a150 con 0x7f5b980b3f30 2020-05-18T21:31:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9cf91700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5b9805ef60 0x7f5b980b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9d792700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5b98099070 0x7f5b981408b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60512/0 (socket says 172.21.15.63:60512) 2020-05-18T21:31:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9d792700 1 -- 172.21.15.63:0/1785133328 learned_addr learned my addr 172.21.15.63:0/1785133328 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b97fff700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b980b3f30 0x7f5b98148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b95ffb700 1 -- 172.21.15.63:0/1785133328 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131689630 0 0) 0x7f5b981485c0 con 0x7f5b98099070 2020-05-18T21:31:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9cf91700 1 -- 172.21.15.63:0/1785133328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b980b3f30 msgr2=0x7f5b98148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9cf91700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b980b3f30 0x7f5b98148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9cf91700 1 -- 172.21.15.63:0/1785133328 >> v1:172.21.15.63:6789/0 conn(0x7f5b98099070 legacy=0x7f5b981408b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9cf91700 1 -- 172.21.15.63:0/1785133328 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b98098bd0 con 0x7f5b9805ef60 2020-05-18T21:31:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9cf91700 1 --2- 172.21.15.63:0/1785133328 >> v2:172.21.15.63:3300/0 conn(0x7f5b9805ef60 0x7f5b980b24a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5b8c002f70 tx=0x7f5b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9cf91700 1 --2- 172.21.15.63:0/1785133328 >> v2:172.21.15.63:3300/0 conn(0x7f5b9805ef60 0x7f5b980b24a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5b8c002f70 tx=0x7f5b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9cf91700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9805ef60 0x7f5b980b24a0 secure :-1 s=READY pgs=1051 cs=0 l=1 rx=0x7f5b8c002f70 tx=0x7f5b8c007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:30.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9cf91700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9805ef60 0x7f5b980b24a0 secure :-1 s=THROTTLE_DONE pgs=1051 cs=0 l=1 rx=0x7f5b8c002f70 tx=0x7f5b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b95ffb700 1 -- 172.21.15.63:0/1785133328 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b8c007360 con 0x7f5b9805ef60 2020-05-18T21:31:30.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9df93700 1 -- 172.21.15.63:0/1785133328 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b98099b30 con 0x7f5b9805ef60 2020-05-18T21:31:30.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9cf91700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9805ef60 0x7f5b980b24a0 secure :-1 s=THROTTLE_DONE pgs=1051 cs=0 l=1 rx=0x7f5b8c002f70 tx=0x7f5b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b95ffb700 1 -- 172.21.15.63:0/1785133328 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8c0074c0 con 0x7f5b9805ef60 2020-05-18T21:31:30.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9cf91700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9805ef60 0x7f5b980b24a0 secure :-1 s=THROTTLE_DONE pgs=1051 cs=0 l=1 rx=0x7f5b8c002f70 tx=0x7f5b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9df93700 1 -- 172.21.15.63:0/1785133328 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b980988f0 con 0x7f5b9805ef60 2020-05-18T21:31:30.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b95ffb700 1 -- 172.21.15.63:0/1785133328 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b8c0058f0 con 0x7f5b9805ef60 2020-05-18T21:31:30.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9df93700 1 -- 172.21.15.63:0/1785133328 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b980569e0 con 0x7f5b9805ef60 2020-05-18T21:31:30.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9cf91700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9805ef60 0x7f5b980b24a0 secure :-1 s=THROTTLE_DONE pgs=1051 cs=0 l=1 rx=0x7f5b8c002f70 tx=0x7f5b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b95ffb700 1 -- 172.21.15.63:0/1785133328 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5b8c005af0 con 0x7f5b9805ef60 2020-05-18T21:31:30.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.869+0000 7f5b9cf91700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9805ef60 0x7f5b980b24a0 secure :-1 s=THROTTLE_DONE pgs=1051 cs=0 l=1 rx=0x7f5b8c002f70 tx=0x7f5b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.873+0000 7f5b95ffb700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5b8004f910 0x7f5b80051dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:30.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.873+0000 7f5b95ffb700 1 -- 172.21.15.63:0/1785133328 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5b8c0647c0 con 0x7f5b9805ef60 2020-05-18T21:31:30.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.873+0000 7f5b97fff700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5b8004f910 0x7f5b80051dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:30.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.873+0000 7f5b97fff700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5b8004f910 0x7f5b80051dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5b9806ad40 tx=0x7f5b84001e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.873+0000 7f5b97fff700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5b8004f910 0x7f5b80051dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5b9806ad40 tx=0x7f5b84001e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.873+0000 7f5b97fff700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5b8004f910 0x7f5b80051dd0 secure :-1 s=READY pgs=419 cs=0 l=1 rx=0x7f5b9806ad40 tx=0x7f5b84001e50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:30.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.877+0000 7f5b9cf91700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9805ef60 0x7f5b980b24a0 secure :-1 s=THROTTLE_DONE pgs=1051 cs=0 l=1 rx=0x7f5b8c002f70 tx=0x7f5b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:30.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:30.877+0000 7f5b95ffb700 1 -- 172.21.15.63:0/1785133328 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f5b8c03ebb0 con 0x7f5b9805ef60 2020-05-18T21:31:31.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.025+0000 7f5b9df93700 1 -- 172.21.15.63:0/1785133328 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5b98098dd0 con 0x7f5b9805ef60 2020-05-18T21:31:31.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.217+0000 7f5b9cf91700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9805ef60 0x7f5b980b24a0 secure :-1 s=THROTTLE_DONE pgs=1051 cs=0 l=1 rx=0x7f5b8c002f70 tx=0x7f5b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.217+0000 7f5b95ffb700 1 -- 172.21.15.63:0/1785133328 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v53) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5b8c0421d0 con 0x7f5b9805ef60 2020-05-18T21:31:31.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.221+0000 7f5b9df93700 1 -- 172.21.15.63:0/1785133328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5b8004f910 msgr2=0x7f5b80051dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:31.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.221+0000 7f5b9df93700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5b8004f910 0x7f5b80051dd0 secure :-1 s=READY pgs=419 cs=0 l=1 rx=0x7f5b9806ad40 tx=0x7f5b84001e50).stop 2020-05-18T21:31:31.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.221+0000 7f5b9df93700 1 -- 172.21.15.63:0/1785133328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9805ef60 msgr2=0x7f5b980b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:31.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.221+0000 7f5b9df93700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9805ef60 0x7f5b980b24a0 secure :-1 s=READY pgs=1051 cs=0 l=1 rx=0x7f5b8c002f70 tx=0x7f5b8c007a80).stop 2020-05-18T21:31:31.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.221+0000 7f5b9df93700 1 -- 172.21.15.63:0/1785133328 shutdown_connections 2020-05-18T21:31:31.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.221+0000 7f5b9df93700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5b8004f910 0x7f5b80051dd0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:31.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.221+0000 7f5b9df93700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b980b3f30 0x7f5b98148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:31.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.221+0000 7f5b9df93700 1 --2- 172.21.15.63:0/1785133328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9805ef60 0x7f5b980b24a0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:31.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.221+0000 7f5b9df93700 1 -- 172.21.15.63:0/1785133328 >> 172.21.15.63:0/1785133328 conn(0x7f5b980b8b10 msgr2=0x7f5b98060fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:31.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.221+0000 7f5b9df93700 1 -- 172.21.15.63:0/1785133328 shutdown_connections 2020-05-18T21:31:31.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.221+0000 7f5b9df93700 1 -- 172.21.15.63:0/1785133328 wait complete. 2020-05-18T21:31:31.242 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:31.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.345+0000 7fb973648700 1 Processor -- start 2020-05-18T21:31:31.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.345+0000 7fb973648700 1 -- start start 2020-05-18T21:31:31.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb973648700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb96c060b90 0x7fb96c0b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:31.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb973648700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb96c146c90 0x7fb96c0624a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:31.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb973648700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96c061870 con 0x7fb96c062900 2020-05-18T21:31:31.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb973648700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96c061d60 con 0x7fb96c060b90 2020-05-18T21:31:31.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb973648700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96c062000 con 0x7fb96c146c90 2020-05-18T21:31:31.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb9713e4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb96c060b90 0x7fb96c0b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:31.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb9713e4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb96c060b90 0x7fb96c0b3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58328/0 (socket says 172.21.15.63:58328) 2020-05-18T21:31:31.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb9713e4700 1 -- 172.21.15.63:0/3365345448 learned_addr learned my addr 172.21.15.63:0/3365345448 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:31.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb970be3700 1 --2- 172.21.15.63:0/3365345448 >> v2:172.21.15.155:3300/0 conn(0x7fb96c146c90 0x7fb96c0624a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:31.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb9713e4700 1 -- 172.21.15.63:0/3365345448 >> v2:172.21.15.155:3300/0 conn(0x7fb96c146c90 msgr2=0x7fb96c0624a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:31.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb9713e4700 1 --2- 172.21.15.63:0/3365345448 >> v2:172.21.15.155:3300/0 conn(0x7fb96c146c90 0x7fb96c0624a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:31.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb9713e4700 1 -- 172.21.15.63:0/3365345448 >> v1:172.21.15.155:6789/0 conn(0x7fb96c062900 legacy=0x7fb96c0b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:31.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb9713e4700 1 -- 172.21.15.63:0/3365345448 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c147210 con 0x7fb96c060b90 2020-05-18T21:31:31.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb9713e4700 1 --2- 172.21.15.63:0/3365345448 >> v2:172.21.15.63:3300/0 conn(0x7fb96c060b90 0x7fb96c0b3f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb968002f70 tx=0x7fb968007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb9713e4700 1 --2- 172.21.15.63:0/3365345448 >> v2:172.21.15.63:3300/0 conn(0x7fb96c060b90 0x7fb96c0b3f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb968002f70 tx=0x7fb968007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb9713e4700 1 --2- 172.21.15.63:0/3365345448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c060b90 0x7fb96c0b3f70 secure :-1 s=READY pgs=1052 cs=0 l=1 rx=0x7fb968002f70 tx=0x7fb968007a80).ready entity=mon.0 client_cookie=d2c533265630e551 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:31.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb9713e4700 1 --2- 172.21.15.63:0/3365345448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c060b90 0x7fb96c0b3f70 secure :-1 s=THROTTLE_DONE pgs=1052 cs=0 l=1 rx=0x7fb968002f70 tx=0x7fb968007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb9713e4700 1 --2- 172.21.15.63:0/3365345448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c060b90 0x7fb96c0b3f70 secure :-1 s=THROTTLE_DONE pgs=1052 cs=0 l=1 rx=0x7fb968002f70 tx=0x7fb968007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb963fff700 1 -- 172.21.15.63:0/3365345448 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb968008e50 con 0x7fb96c060b90 2020-05-18T21:31:31.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb9713e4700 1 --2- 172.21.15.63:0/3365345448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c060b90 0x7fb96c0b3f70 secure :-1 s=THROTTLE_DONE pgs=1052 cs=0 l=1 rx=0x7fb968002f70 tx=0x7fb968007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb963fff700 1 -- 172.21.15.63:0/3365345448 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb968010750 con 0x7fb96c060b90 2020-05-18T21:31:31.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb963fff700 1 -- 172.21.15.63:0/3365345448 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb968010b70 con 0x7fb96c060b90 2020-05-18T21:31:31.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb973648700 1 -- 172.21.15.63:0/3365345448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c060b90 msgr2=0x7fb96c0b3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:31.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb973648700 1 --2- 172.21.15.63:0/3365345448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c060b90 0x7fb96c0b3f70 secure :-1 s=READY pgs=1052 cs=0 l=1 rx=0x7fb968002f70 tx=0x7fb968007a80).stop 2020-05-18T21:31:31.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb973648700 1 -- 172.21.15.63:0/3365345448 shutdown_connections 2020-05-18T21:31:31.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb973648700 1 --2- 172.21.15.63:0/3365345448 >> v2:172.21.15.155:3300/0 conn(0x7fb96c146c90 0x7fb96c0624a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:31.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb973648700 1 --2- 172.21.15.63:0/3365345448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c060b90 0x7fb96c0b3f70 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:31.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb973648700 1 -- 172.21.15.63:0/3365345448 >> 172.21.15.63:0/3365345448 conn(0x7fb96c0b83d0 msgr2=0x7fb96c0b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:31.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb973648700 1 -- 172.21.15.63:0/3365345448 shutdown_connections 2020-05-18T21:31:31.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.349+0000 7fb973648700 1 -- 172.21.15.63:0/3365345448 wait complete. 2020-05-18T21:31:31.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.353+0000 7fb973648700 1 Processor -- start 2020-05-18T21:31:31.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.353+0000 7fb973648700 1 -- start start 2020-05-18T21:31:31.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.353+0000 7fb973648700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb96c062900 0x7fb96c0addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:31.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.353+0000 7fb973648700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96c154f40 con 0x7fb96c146c90 2020-05-18T21:31:31.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.353+0000 7fb973648700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96c155170 con 0x7fb96c060b90 2020-05-18T21:31:31.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.353+0000 7fb973648700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96c151070 con 0x7fb96c062900 2020-05-18T21:31:31.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.353+0000 7fb971be5700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb96c146c90 0x7fb96c1504f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60526/0 (socket says 172.21.15.63:60526) 2020-05-18T21:31:31.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.353+0000 7fb971be5700 1 -- 172.21.15.63:0/2624160379 learned_addr learned my addr 172.21.15.63:0/2624160379 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:31.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.353+0000 7fb970be3700 1 --2- 172.21.15.63:0/2624160379 >> v2:172.21.15.155:3300/0 conn(0x7fb96c062900 0x7fb96c0addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:31.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.353+0000 7fb9627fc700 1 -- 172.21.15.63:0/2624160379 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638377633 0 0) 0x7fb96c154f40 con 0x7fb96c146c90 2020-05-18T21:31:31.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.353+0000 7fb9627fc700 1 -- 172.21.15.63:0/2624160379 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb954002fe0 con 0x7fb96c146c90 2020-05-18T21:31:31.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.353+0000 7fb9627fc700 1 -- 172.21.15.63:0/2624160379 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306254336 0 0) 0x7fb96c155170 con 0x7fb96c060b90 2020-05-18T21:31:31.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.353+0000 7fb9627fc700 1 -- 172.21.15.63:0/2624160379 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb96c154f40 con 0x7fb96c060b90 2020-05-18T21:31:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.357+0000 7fb970be3700 1 -- 172.21.15.63:0/2624160379 >> v1:172.21.15.155:6789/0 conn(0x7fb96c060b90 legacy=0x7fb96c0af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.357+0000 7fb970be3700 1 -- 172.21.15.63:0/2624160379 >> v1:172.21.15.63:6789/0 conn(0x7fb96c146c90 legacy=0x7fb96c1504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.357+0000 7fb970be3700 1 -- 172.21.15.63:0/2624160379 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c0b0080 con 0x7fb96c062900 2020-05-18T21:31:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.357+0000 7fb970be3700 1 --2- 172.21.15.63:0/2624160379 >> v2:172.21.15.155:3300/0 conn(0x7fb96c062900 0x7fb96c0addf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb95c002f70 tx=0x7fb95c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.357+0000 7fb970be3700 1 --2- 172.21.15.63:0/2624160379 >> v2:172.21.15.155:3300/0 conn(0x7fb96c062900 0x7fb96c0addf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb95c002f70 tx=0x7fb95c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.357+0000 7fb970be3700 1 --2- 172.21.15.63:0/2624160379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb96c062900 0x7fb96c0addf0 secure :-1 s=READY pgs=734 cs=0 l=1 rx=0x7fb95c002f70 tx=0x7fb95c010c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.357+0000 7fb970be3700 1 --2- 172.21.15.63:0/2624160379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb96c062900 0x7fb96c0addf0 secure :-1 s=THROTTLE_DONE pgs=734 cs=0 l=1 rx=0x7fb95c002f70 tx=0x7fb95c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.357+0000 7fb9627fc700 1 -- 172.21.15.63:0/2624160379 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb95c008ea0 con 0x7fb96c062900 2020-05-18T21:31:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.357+0000 7fb970be3700 1 --2- 172.21.15.63:0/2624160379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb96c062900 0x7fb96c0addf0 secure :-1 s=THROTTLE_DONE pgs=734 cs=0 l=1 rx=0x7fb95c002f70 tx=0x7fb95c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.357+0000 7fb973648700 1 -- 172.21.15.63:0/2624160379 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96c150c00 con 0x7fb96c062900 2020-05-18T21:31:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.357+0000 7fb970be3700 1 --2- 172.21.15.63:0/2624160379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb96c062900 0x7fb96c0addf0 secure :-1 s=THROTTLE_DONE pgs=734 cs=0 l=1 rx=0x7fb95c002f70 tx=0x7fb95c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.357+0000 7fb9627fc700 1 -- 172.21.15.63:0/2624160379 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c012400 con 0x7fb96c062900 2020-05-18T21:31:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.357+0000 7fb9627fc700 1 -- 172.21.15.63:0/2624160379 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb95c012760 con 0x7fb96c062900 2020-05-18T21:31:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.357+0000 7fb973648700 1 -- 172.21.15.63:0/2624160379 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96c0ae580 con 0x7fb96c062900 2020-05-18T21:31:31.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.357+0000 7fb970be3700 1 --2- 172.21.15.63:0/2624160379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb96c062900 0x7fb96c0addf0 secure :-1 s=THROTTLE_DONE pgs=734 cs=0 l=1 rx=0x7fb95c002f70 tx=0x7fb95c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.357+0000 7fb973648700 1 -- 172.21.15.63:0/2624160379 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb96c150eb0 con 0x7fb96c062900 2020-05-18T21:31:31.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.357+0000 7fb9627fc700 1 -- 172.21.15.63:0/2624160379 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb95c012910 con 0x7fb96c062900 2020-05-18T21:31:31.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.357+0000 7fb970be3700 1 --2- 172.21.15.63:0/2624160379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb96c062900 0x7fb96c0addf0 secure :-1 s=THROTTLE_DONE pgs=734 cs=0 l=1 rx=0x7fb95c002f70 tx=0x7fb95c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.361+0000 7fb9627fc700 1 --2- 172.21.15.63:0/2624160379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb95404fe80 0x7fb954052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:31.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.361+0000 7fb9627fc700 1 -- 172.21.15.63:0/2624160379 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb95c064130 con 0x7fb96c062900 2020-05-18T21:31:31.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.361+0000 7fb9713e4700 1 --2- 172.21.15.63:0/2624160379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb95404fe80 0x7fb954052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:31.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.361+0000 7fb9713e4700 1 --2- 172.21.15.63:0/2624160379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb95404fe80 0x7fb954052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb968008500 tx=0x7fb968007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.361+0000 7fb9713e4700 1 --2- 172.21.15.63:0/2624160379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb95404fe80 0x7fb954052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb968008500 tx=0x7fb968007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.361+0000 7fb9713e4700 1 --2- 172.21.15.63:0/2624160379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb95404fe80 0x7fb954052340 secure :-1 s=READY pgs=420 cs=0 l=1 rx=0x7fb968008500 tx=0x7fb968007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:31.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.369+0000 7fb970be3700 1 --2- 172.21.15.63:0/2624160379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb96c062900 0x7fb96c0addf0 secure :-1 s=THROTTLE_DONE pgs=734 cs=0 l=1 rx=0x7fb95c002f70 tx=0x7fb95c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.369+0000 7fb9627fc700 1 -- 172.21.15.63:0/2624160379 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb95c03e460 con 0x7fb96c062900 2020-05-18T21:31:31.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.525+0000 7fb973648700 1 -- 172.21.15.63:0/2624160379 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb96c0569e0 con 0x7fb96c062900 2020-05-18T21:31:31.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.525+0000 7fb970be3700 1 --2- 172.21.15.63:0/2624160379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb96c062900 0x7fb96c0addf0 secure :-1 s=THROTTLE_DONE pgs=734 cs=0 l=1 rx=0x7fb95c002f70 tx=0x7fb95c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.525+0000 7fb9627fc700 1 -- 172.21.15.63:0/2624160379 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+2137 (secure 0 0 0) 0x7fb95c041a80 con 0x7fb96c062900 2020-05-18T21:31:31.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.529+0000 7fb973648700 1 -- 172.21.15.63:0/2624160379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb95404fe80 msgr2=0x7fb954052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:31.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.529+0000 7fb973648700 1 --2- 172.21.15.63:0/2624160379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb95404fe80 0x7fb954052340 secure :-1 s=READY pgs=420 cs=0 l=1 rx=0x7fb968008500 tx=0x7fb968007a80).stop 2020-05-18T21:31:31.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.529+0000 7fb973648700 1 -- 172.21.15.63:0/2624160379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb96c062900 msgr2=0x7fb96c0addf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:31.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.529+0000 7fb973648700 1 --2- 172.21.15.63:0/2624160379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb96c062900 0x7fb96c0addf0 secure :-1 s=READY pgs=734 cs=0 l=1 rx=0x7fb95c002f70 tx=0x7fb95c010c20).stop 2020-05-18T21:31:31.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.529+0000 7fb973648700 1 -- 172.21.15.63:0/2624160379 shutdown_connections 2020-05-18T21:31:31.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.529+0000 7fb973648700 1 --2- 172.21.15.63:0/2624160379 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb95404fe80 0x7fb954052340 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:31.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.529+0000 7fb973648700 1 --2- 172.21.15.63:0/2624160379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb96c062900 0x7fb96c0addf0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:31.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.529+0000 7fb973648700 1 -- 172.21.15.63:0/2624160379 >> 172.21.15.63:0/2624160379 conn(0x7fb96c0b83d0 msgr2=0x7fb96c1411a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:31.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.529+0000 7fb973648700 1 -- 172.21.15.63:0/2624160379 shutdown_connections 2020-05-18T21:31:31.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.529+0000 7fb973648700 1 -- 172.21.15.63:0/2624160379 wait complete. 2020-05-18T21:31:31.555 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 53 2020-05-18T21:31:31.555 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:31.555 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":53,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/249786226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":249786226},{"type":"v1","addr":"172.21.15.63:6833","nonce":249786226}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":51}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:31:31.212807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7242":{"gid":7242,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/578144386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":578144386},{"type":"v1","addr":"172.21.15.155:6835","nonce":578144386}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:31:31.556 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:31:31.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.653+0000 7fedb0df5700 1 Processor -- start 2020-05-18T21:31:31.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.653+0000 7fedb0df5700 1 -- start start 2020-05-18T21:31:31.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.653+0000 7fedb0df5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedac0bbcd0 0x7fedac0afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:31.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.653+0000 7fedb0df5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac0af980 con 0x7fedac0bb5e0 2020-05-18T21:31:31.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.653+0000 7fedb0df5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac0bb9c0 con 0x7fedac0b0280 2020-05-18T21:31:31.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.653+0000 7fedb0df5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0af770 con 0x7fedac0bbcd0 2020-05-18T21:31:31.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.653+0000 7fedaa59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fedac0bb5e0 0x7fedac0acee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60530/0 (socket says 172.21.15.63:60530) 2020-05-18T21:31:31.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.653+0000 7fedaa59c700 1 -- 172.21.15.63:0/2333586259 learned_addr learned my addr 172.21.15.63:0/2333586259 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:31.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.653+0000 7feda9d9b700 1 --2- 172.21.15.63:0/2333586259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedac0bbcd0 0x7fedac0afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:31.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.653+0000 7feda959a700 1 -- 172.21.15.63:0/2333586259 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834870565 0 0) 0x7fedac0af980 con 0x7fedac0bb5e0 2020-05-18T21:31:31.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7feda959a700 1 -- 172.21.15.63:0/2333586259 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed90003270 con 0x7fedac0bb5e0 2020-05-18T21:31:31.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7feda959a700 1 -- 172.21.15.63:0/2333586259 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085622738 0 0) 0x7fedac0bb9c0 con 0x7fedac0b0280 2020-05-18T21:31:31.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7feda959a700 1 -- 172.21.15.63:0/2333586259 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedac0af980 con 0x7fedac0b0280 2020-05-18T21:31:31.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7feda959a700 1 -- 172.21.15.63:0/2333586259 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3692591487 0 0) 0x7fed90003270 con 0x7fedac0bb5e0 2020-05-18T21:31:31.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7feda959a700 1 -- 172.21.15.63:0/2333586259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedac0bbcd0 msgr2=0x7fedac0afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:31.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7feda959a700 1 --2- 172.21.15.63:0/2333586259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedac0bbcd0 0x7fedac0afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:31.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7feda959a700 1 -- 172.21.15.63:0/2333586259 >> v1:172.21.15.155:6789/0 conn(0x7fedac0b0280 legacy=0x7fedac12efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:31.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7feda959a700 1 -- 172.21.15.63:0/2333586259 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac0af3d0 con 0x7fedac0bb5e0 2020-05-18T21:31:31.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7feda959a700 1 -- 172.21.15.63:0/2333586259 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fed9c001730 con 0x7fedac0bb5e0 2020-05-18T21:31:31.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7feda959a700 1 -- 172.21.15.63:0/2333586259 >> v1:172.21.15.63:6789/0 conn(0x7fedac0bb5e0 legacy=0x7fedac0acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:31.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7feda959a700 1 --2- 172.21.15.63:0/2333586259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed90003920 0x7fed90003d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:31.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7feda959a700 1 --2- 172.21.15.63:0/2333586259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedac0bbcd0 0x7fed90004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:31.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7feda959a700 1 --2- 172.21.15.63:0/2333586259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed90004970 0x7fed90004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:31.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7feda959a700 1 -- 172.21.15.63:0/2333586259 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0af770 con 0x7fed90003920 2020-05-18T21:31:31.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7feda959a700 1 -- 172.21.15.63:0/2333586259 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed90005250 con 0x7fed90004970 2020-05-18T21:31:31.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7feda959a700 1 -- 172.21.15.63:0/2333586259 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9000b760 con 0x7fedac0bbcd0 2020-05-18T21:31:31.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedaa59c700 1 --2- 172.21.15.63:0/2333586259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed90003920 0x7fed90003d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:31.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedaad9d700 1 --2- 172.21.15.63:0/2333586259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed90004970 0x7fed90004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:31.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedaa59c700 1 -- 172.21.15.63:0/2333586259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedac0bbcd0 msgr2=0x7fed90004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:31.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedaa59c700 1 --2- 172.21.15.63:0/2333586259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedac0bbcd0 0x7fed90004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:31.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedaa59c700 1 -- 172.21.15.63:0/2333586259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed90004970 msgr2=0x7fed90004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:31.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedaa59c700 1 --2- 172.21.15.63:0/2333586259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed90004970 0x7fed90004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:31.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedaa59c700 1 -- 172.21.15.63:0/2333586259 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed90003270 con 0x7fed90003920 2020-05-18T21:31:31.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedaa59c700 1 --2- 172.21.15.63:0/2333586259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed90003920 0x7fed90003d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fed9c001500 tx=0x7fedac0af560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedaa59c700 1 --2- 172.21.15.63:0/2333586259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed90003920 0x7fed90003d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fed9c001500 tx=0x7fedac0af560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedaa59c700 1 --2- 172.21.15.63:0/2333586259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed90003920 0x7fed90003d20 secure :-1 s=READY pgs=1055 cs=0 l=1 rx=0x7fed9c001500 tx=0x7fedac0af560).ready entity=mon.0 client_cookie=5940c3c970ea16e5 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:31.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedaa59c700 1 --2- 172.21.15.63:0/2333586259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed90003920 0x7fed90003d20 secure :-1 s=THROTTLE_DONE pgs=1055 cs=0 l=1 rx=0x7fed9c001500 tx=0x7fedac0af560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedaa59c700 1 --2- 172.21.15.63:0/2333586259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed90003920 0x7fed90003d20 secure :-1 s=THROTTLE_DONE pgs=1055 cs=0 l=1 rx=0x7fed9c001500 tx=0x7fedac0af560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7feda959a700 1 -- 172.21.15.63:0/2333586259 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed9c010370 con 0x7fed90003920 2020-05-18T21:31:31.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedaa59c700 1 --2- 172.21.15.63:0/2333586259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed90003920 0x7fed90003d20 secure :-1 s=THROTTLE_DONE pgs=1055 cs=0 l=1 rx=0x7fed9c001500 tx=0x7fedac0af560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7feda959a700 1 -- 172.21.15.63:0/2333586259 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c0104d0 con 0x7fed90003920 2020-05-18T21:31:31.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7feda959a700 1 -- 172.21.15.63:0/2333586259 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed9c010870 con 0x7fed90003920 2020-05-18T21:31:31.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedb0df5700 1 -- 172.21.15.63:0/2333586259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed90003920 msgr2=0x7fed90003d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:31.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedb0df5700 1 --2- 172.21.15.63:0/2333586259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed90003920 0x7fed90003d20 secure :-1 s=READY pgs=1055 cs=0 l=1 rx=0x7fed9c001500 tx=0x7fedac0af560).stop 2020-05-18T21:31:31.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedaad9d700 1 -- 172.21.15.63:0/2333586259 reap_dead start 2020-05-18T21:31:31.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedb0df5700 1 -- 172.21.15.63:0/2333586259 shutdown_connections 2020-05-18T21:31:31.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedb0df5700 1 -- 172.21.15.63:0/2333586259 >> 172.21.15.63:0/2333586259 conn(0x7fedac069b70 msgr2=0x7fedac069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:31.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedb0df5700 1 -- 172.21.15.63:0/2333586259 shutdown_connections 2020-05-18T21:31:31.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedb0df5700 1 -- 172.21.15.63:0/2333586259 wait complete. 2020-05-18T21:31:31.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedb0df5700 1 Processor -- start 2020-05-18T21:31:31.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.657+0000 7fedb0df5700 1 -- start start 2020-05-18T21:31:31.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fedb0df5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fedac12c600 0x7fedac1168e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:31.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fedb0df5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac0b8d10 con 0x7fedac153e40 2020-05-18T21:31:31.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fedb0df5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac0b6600 con 0x7fedac147ea0 2020-05-18T21:31:31.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fedb0df5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedac148280 con 0x7fedac12c600 2020-05-18T21:31:31.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7feda9d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fedac153e40 0x7fedac156a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60544/0 (socket says 172.21.15.63:60544) 2020-05-18T21:31:31.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7feda9d9b700 1 -- 172.21.15.63:0/3892013481 learned_addr learned my addr 172.21.15.63:0/3892013481 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:31.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fedaad9d700 1 --2- 172.21.15.63:0/3892013481 >> v2:172.21.15.63:3300/0 conn(0x7fedac12c600 0x7fedac1168e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:31.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fed9b7fe700 1 -- 172.21.15.63:0/3892013481 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349528776 0 0) 0x7fedac0b8d10 con 0x7fedac153e40 2020-05-18T21:31:31.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fed9b7fe700 1 -- 172.21.15.63:0/3892013481 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed88002fe0 con 0x7fedac153e40 2020-05-18T21:31:31.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fedaad9d700 1 -- 172.21.15.63:0/3892013481 >> v1:172.21.15.155:6789/0 conn(0x7fedac147ea0 legacy=0x7fedac0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:31.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fedaad9d700 1 -- 172.21.15.63:0/3892013481 >> v1:172.21.15.63:6789/0 conn(0x7fedac153e40 legacy=0x7fedac156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:31.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fedaad9d700 1 -- 172.21.15.63:0/3892013481 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac0b68a0 con 0x7fedac12c600 2020-05-18T21:31:31.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fedaad9d700 1 --2- 172.21.15.63:0/3892013481 >> v2:172.21.15.63:3300/0 conn(0x7fedac12c600 0x7fedac1168e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fedac0bd8f0 tx=0x7feda4010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fedaad9d700 1 --2- 172.21.15.63:0/3892013481 >> v2:172.21.15.63:3300/0 conn(0x7fedac12c600 0x7fedac1168e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fedac0bd8f0 tx=0x7feda4010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fedaad9d700 1 --2- 172.21.15.63:0/3892013481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedac12c600 0x7fedac1168e0 secure :-1 s=READY pgs=1057 cs=0 l=1 rx=0x7fedac0bd8f0 tx=0x7feda4010bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:31.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fedaad9d700 1 --2- 172.21.15.63:0/3892013481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedac12c600 0x7fedac1168e0 secure :-1 s=THROTTLE_DONE pgs=1057 cs=0 l=1 rx=0x7fedac0bd8f0 tx=0x7feda4010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fed9b7fe700 1 -- 172.21.15.63:0/3892013481 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feda4012080 con 0x7fedac12c600 2020-05-18T21:31:31.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fedaad9d700 1 --2- 172.21.15.63:0/3892013481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedac12c600 0x7fedac1168e0 secure :-1 s=THROTTLE_DONE pgs=1057 cs=0 l=1 rx=0x7fedac0bd8f0 tx=0x7feda4010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fedaad9d700 1 --2- 172.21.15.63:0/3892013481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedac12c600 0x7fedac1168e0 secure :-1 s=THROTTLE_DONE pgs=1057 cs=0 l=1 rx=0x7fedac0bd8f0 tx=0x7feda4010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fed9b7fe700 1 -- 172.21.15.63:0/3892013481 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda4013070 con 0x7fedac12c600 2020-05-18T21:31:31.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fedb0df5700 1 -- 172.21.15.63:0/3892013481 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedac0b4050 con 0x7fedac12c600 2020-05-18T21:31:31.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fed9b7fe700 1 -- 172.21.15.63:0/3892013481 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feda40125c0 con 0x7fedac12c600 2020-05-18T21:31:31.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fedb0df5700 1 -- 172.21.15.63:0/3892013481 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedac157300 con 0x7fedac12c600 2020-05-18T21:31:31.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.661+0000 7fedaad9d700 1 --2- 172.21.15.63:0/3892013481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedac12c600 0x7fedac1168e0 secure :-1 s=THROTTLE_DONE pgs=1057 cs=0 l=1 rx=0x7fedac0bd8f0 tx=0x7feda4010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.665+0000 7fedb0df5700 1 -- 172.21.15.63:0/3892013481 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedac0b6a50 con 0x7fedac12c600 2020-05-18T21:31:31.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.665+0000 7fed9b7fe700 1 -- 172.21.15.63:0/3892013481 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7feda4012720 con 0x7fedac12c600 2020-05-18T21:31:31.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.665+0000 7fedaad9d700 1 --2- 172.21.15.63:0/3892013481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedac12c600 0x7fedac1168e0 secure :-1 s=THROTTLE_DONE pgs=1057 cs=0 l=1 rx=0x7fedac0bd8f0 tx=0x7feda4010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.665+0000 7fed9b7fe700 1 --2- 172.21.15.63:0/3892013481 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fed8804fd80 0x7fed88052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:31.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.665+0000 7fed9b7fe700 1 -- 172.21.15.63:0/3892013481 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6073+0+0 (secure 0 0 0) 0x7feda40635b0 con 0x7fedac12c600 2020-05-18T21:31:31.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.665+0000 7fedaa59c700 1 --2- 172.21.15.63:0/3892013481 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fed8804fd80 0x7fed88052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:31.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.665+0000 7fedaa59c700 1 --2- 172.21.15.63:0/3892013481 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fed8804fd80 0x7fed88052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fedac0b47b0 tx=0x7fedac0af560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.665+0000 7fedaa59c700 1 --2- 172.21.15.63:0/3892013481 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fed8804fd80 0x7fed88052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fedac0b47b0 tx=0x7fedac0af560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.665+0000 7fedaa59c700 1 --2- 172.21.15.63:0/3892013481 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fed8804fd80 0x7fed88052240 secure :-1 s=READY pgs=421 cs=0 l=1 rx=0x7fedac0b47b0 tx=0x7fedac0af560).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:31.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.669+0000 7fedaad9d700 1 --2- 172.21.15.63:0/3892013481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedac12c600 0x7fedac1168e0 secure :-1 s=THROTTLE_DONE pgs=1057 cs=0 l=1 rx=0x7fedac0bd8f0 tx=0x7feda4010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.669+0000 7fed9b7fe700 1 -- 172.21.15.63:0/3892013481 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7feda403da60 con 0x7fedac12c600 2020-05-18T21:31:31.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.785+0000 7fedb0df5700 1 -- 172.21.15.63:0/3892013481 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fedac0569e0 con 0x7fedac12c600 2020-05-18T21:31:31.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.785+0000 7fedaad9d700 1 --2- 172.21.15.63:0/3892013481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedac12c600 0x7fedac1168e0 secure :-1 s=THROTTLE_DONE pgs=1057 cs=0 l=1 rx=0x7fedac0bd8f0 tx=0x7feda4010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.785+0000 7fed9b7fe700 1 -- 172.21.15.63:0/3892013481 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16092 (secure 0 0 0) 0x7feda4041080 con 0x7fedac12c600 2020-05-18T21:31:31.793 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:31.794 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":84,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:31:31.213604+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:31:28.631738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2020-05-18T21:31:29.243969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:31:31.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.789+0000 7fedb0df5700 1 -- 172.21.15.63:0/3892013481 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fed8804fd80 msgr2=0x7fed88052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:31.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.789+0000 7fedb0df5700 1 --2- 172.21.15.63:0/3892013481 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fed8804fd80 0x7fed88052240 secure :-1 s=READY pgs=421 cs=0 l=1 rx=0x7fedac0b47b0 tx=0x7fedac0af560).stop 2020-05-18T21:31:31.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.789+0000 7fedb0df5700 1 -- 172.21.15.63:0/3892013481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedac12c600 msgr2=0x7fedac1168e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:31.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.789+0000 7fedb0df5700 1 --2- 172.21.15.63:0/3892013481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedac12c600 0x7fedac1168e0 secure :-1 s=READY pgs=1057 cs=0 l=1 rx=0x7fedac0bd8f0 tx=0x7feda4010bc0).stop 2020-05-18T21:31:31.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.789+0000 7fedb0df5700 1 -- 172.21.15.63:0/3892013481 shutdown_connections 2020-05-18T21:31:31.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.789+0000 7fedb0df5700 1 --2- 172.21.15.63:0/3892013481 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fed8804fd80 0x7fed88052240 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:31.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.789+0000 7fedb0df5700 1 --2- 172.21.15.63:0/3892013481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedac12c600 0x7fedac1168e0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:31.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.789+0000 7fedb0df5700 1 -- 172.21.15.63:0/3892013481 >> 172.21.15.63:0/3892013481 conn(0x7fedac069b70 msgr2=0x7fedac148580 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:31.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.789+0000 7fedb0df5700 1 -- 172.21.15.63:0/3892013481 shutdown_connections 2020-05-18T21:31:31.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.789+0000 7fedb0df5700 1 -- 172.21.15.63:0/3892013481 wait complete. 2020-05-18T21:31:31.805 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:31:31.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.913+0000 7f73e7d86700 1 Processor -- start 2020-05-18T21:31:31.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.913+0000 7f73e7d86700 1 -- start start 2020-05-18T21:31:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.913+0000 7f73e7d86700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f73e00b8c30 0x7f73e01566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.913+0000 7f73e7d86700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e0065a70 con 0x7f73e0157260 2020-05-18T21:31:31.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.913+0000 7f73e7d86700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e00b9010 con 0x7f73e00ad070 2020-05-18T21:31:31.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.913+0000 7f73e7d86700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e00801d0 con 0x7f73e00b8c30 2020-05-18T21:31:31.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.913+0000 7f73e6323700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f73e00b8c30 0x7f73e01566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:31.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.913+0000 7f73e6323700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f73e00b8c30 0x7f73e01566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58362/0 (socket says 172.21.15.63:58362) 2020-05-18T21:31:31.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.913+0000 7f73e6323700 1 -- 172.21.15.63:0/975814643 learned_addr learned my addr 172.21.15.63:0/975814643 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:31.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.913+0000 7f73e6b24700 1 --1- 172.21.15.63:0/975814643 >> v1:172.21.15.63:6789/0 conn(0x7f73e0157260 0x7f73e015c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60552/0 (socket says 172.21.15.63:60552) 2020-05-18T21:31:31.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.913+0000 7f73e6323700 1 -- 172.21.15.63:0/975814643 >> v1:172.21.15.155:6789/0 conn(0x7f73e00ad070 legacy=0x7f73e0156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:31.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.913+0000 7f73e6323700 1 -- 172.21.15.63:0/975814643 >> v1:172.21.15.63:6789/0 conn(0x7f73e0157260 legacy=0x7f73e015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:31.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.913+0000 7f73e6323700 1 -- 172.21.15.63:0/975814643 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e005bf00 con 0x7f73e00b8c30 2020-05-18T21:31:31.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.913+0000 7f73e5321700 1 -- 172.21.15.63:0/975814643 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756677240 0 0) 0x7f73e0065a70 con 0x7f73e0157260 2020-05-18T21:31:31.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.913+0000 7f73e6323700 1 --2- 172.21.15.63:0/975814643 >> v2:172.21.15.63:3300/0 conn(0x7f73e00b8c30 0x7f73e01566f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f73e0069440 tx=0x7f73dc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e6323700 1 --2- 172.21.15.63:0/975814643 >> v2:172.21.15.63:3300/0 conn(0x7f73e00b8c30 0x7f73e01566f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f73e0069440 tx=0x7f73dc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e6323700 1 --2- 172.21.15.63:0/975814643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73e00b8c30 0x7f73e01566f0 secure :-1 s=READY pgs=1059 cs=0 l=1 rx=0x7f73e0069440 tx=0x7f73dc007e00).ready entity=mon.0 client_cookie=a195ac0fcc525dea server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:31.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e6323700 1 --2- 172.21.15.63:0/975814643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73e00b8c30 0x7f73e01566f0 secure :-1 s=THROTTLE_DONE pgs=1059 cs=0 l=1 rx=0x7f73e0069440 tx=0x7f73dc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e5321700 1 -- 172.21.15.63:0/975814643 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73dc011d80 con 0x7f73e00b8c30 2020-05-18T21:31:31.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e6323700 1 --2- 172.21.15.63:0/975814643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73e00b8c30 0x7f73e01566f0 secure :-1 s=THROTTLE_DONE pgs=1059 cs=0 l=1 rx=0x7f73e0069440 tx=0x7f73dc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e6323700 1 --2- 172.21.15.63:0/975814643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73e00b8c30 0x7f73e01566f0 secure :-1 s=THROTTLE_DONE pgs=1059 cs=0 l=1 rx=0x7f73e0069440 tx=0x7f73dc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e5321700 1 -- 172.21.15.63:0/975814643 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc00a180 con 0x7f73e00b8c30 2020-05-18T21:31:31.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e5321700 1 -- 172.21.15.63:0/975814643 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73dc00a520 con 0x7f73e00b8c30 2020-05-18T21:31:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e7d86700 1 -- 172.21.15.63:0/975814643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73e00b8c30 msgr2=0x7f73e01566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e7d86700 1 --2- 172.21.15.63:0/975814643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73e00b8c30 0x7f73e01566f0 secure :-1 s=READY pgs=1059 cs=0 l=1 rx=0x7f73e0069440 tx=0x7f73dc007e00).stop 2020-05-18T21:31:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e7d86700 1 -- 172.21.15.63:0/975814643 shutdown_connections 2020-05-18T21:31:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e7d86700 1 --2- 172.21.15.63:0/975814643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73e00b8c30 0x7f73e01566f0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e7d86700 1 -- 172.21.15.63:0/975814643 >> 172.21.15.63:0/975814643 conn(0x7f73e006a640 msgr2=0x7f73e00b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e7d86700 1 -- 172.21.15.63:0/975814643 shutdown_connections 2020-05-18T21:31:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e7d86700 1 -- 172.21.15.63:0/975814643 wait complete. 2020-05-18T21:31:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e7d86700 1 Processor -- start 2020-05-18T21:31:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e7d86700 1 -- start start 2020-05-18T21:31:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e7d86700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f73e00ad070 0x7f73e0063550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e7d86700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f73e0157260 0x7f73e0159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e7d86700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e015a050 con 0x7f73e00b8c30 2020-05-18T21:31:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e7d86700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e00639b0 con 0x7f73e0157260 2020-05-18T21:31:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.917+0000 7f73e7d86700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e0157db0 con 0x7f73e00ad070 2020-05-18T21:31:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73e6b24700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f73e0157260 0x7f73e0159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73e5b22700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f73e00b8c30 0x7f73e015c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60558/0 (socket says 172.21.15.63:60558) 2020-05-18T21:31:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73e5b22700 1 -- 172.21.15.63:0/843030128 learned_addr learned my addr 172.21.15.63:0/843030128 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73e6323700 1 --2- 172.21.15.63:0/843030128 >> v2:172.21.15.155:3300/0 conn(0x7f73e00ad070 0x7f73e0063550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73e6b24700 1 -- 172.21.15.63:0/843030128 >> v2:172.21.15.155:3300/0 conn(0x7f73e00ad070 msgr2=0x7f73e0063550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73d6ffd700 1 -- 172.21.15.63:0/843030128 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602813089 0 0) 0x7f73e015a050 con 0x7f73e00b8c30 2020-05-18T21:31:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73e6b24700 1 --2- 172.21.15.63:0/843030128 >> v2:172.21.15.155:3300/0 conn(0x7f73e00ad070 0x7f73e0063550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73e6b24700 1 -- 172.21.15.63:0/843030128 >> v1:172.21.15.63:6789/0 conn(0x7f73e00b8c30 legacy=0x7f73e015c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73e6b24700 1 -- 172.21.15.63:0/843030128 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e0158050 con 0x7f73e0157260 2020-05-18T21:31:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73e6b24700 1 --2- 172.21.15.63:0/843030128 >> v2:172.21.15.63:3300/0 conn(0x7f73e0157260 0x7f73e0159bf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f73d8000bc0 tx=0x7f73d8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73e6b24700 1 --2- 172.21.15.63:0/843030128 >> v2:172.21.15.63:3300/0 conn(0x7f73e0157260 0x7f73e0159bf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f73d8000bc0 tx=0x7f73d8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73e6b24700 1 --2- 172.21.15.63:0/843030128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73e0157260 0x7f73e0159bf0 secure :-1 s=READY pgs=1061 cs=0 l=1 rx=0x7f73d8000bc0 tx=0x7f73d8010880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73e6b24700 1 --2- 172.21.15.63:0/843030128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73e0157260 0x7f73e0159bf0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7f73d8000bc0 tx=0x7f73d8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73d6ffd700 1 -- 172.21.15.63:0/843030128 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d8011590 con 0x7f73e0157260 2020-05-18T21:31:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73e6b24700 1 --2- 172.21.15.63:0/843030128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73e0157260 0x7f73e0159bf0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7f73d8000bc0 tx=0x7f73d8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73d6ffd700 1 -- 172.21.15.63:0/843030128 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d80116f0 con 0x7f73e0157260 2020-05-18T21:31:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73e6b24700 1 --2- 172.21.15.63:0/843030128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73e0157260 0x7f73e0159bf0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7f73d8000bc0 tx=0x7f73d8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73e7d86700 1 -- 172.21.15.63:0/843030128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e01582f0 con 0x7f73e0157260 2020-05-18T21:31:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73d6ffd700 1 -- 172.21.15.63:0/843030128 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d8011ad0 con 0x7f73e0157260 2020-05-18T21:31:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73e7d86700 1 -- 172.21.15.63:0/843030128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e0158790 con 0x7f73e0157260 2020-05-18T21:31:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73e6b24700 1 --2- 172.21.15.63:0/843030128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73e0157260 0x7f73e0159bf0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7f73d8000bc0 tx=0x7f73d8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73e7d86700 1 -- 172.21.15.63:0/843030128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e01584b0 con 0x7f73e0157260 2020-05-18T21:31:31.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73d6ffd700 1 -- 172.21.15.63:0/843030128 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f73d800b370 con 0x7f73e0157260 2020-05-18T21:31:31.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.921+0000 7f73e6b24700 1 --2- 172.21.15.63:0/843030128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73e0157260 0x7f73e0159bf0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7f73d8000bc0 tx=0x7f73d8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.925+0000 7f73d6ffd700 1 --2- 172.21.15.63:0/843030128 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f73c804f7d0 0x7f73c8051c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:31.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.925+0000 7f73d6ffd700 1 -- 172.21.15.63:0/843030128 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f73d8063d80 con 0x7f73e0157260 2020-05-18T21:31:31.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.925+0000 7f73e6323700 1 --2- 172.21.15.63:0/843030128 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f73c804f7d0 0x7f73c8051c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:31.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.925+0000 7f73e6323700 1 --2- 172.21.15.63:0/843030128 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f73c804f7d0 0x7f73c8051c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f73e0069440 tx=0x7f73dc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.925+0000 7f73e6323700 1 --2- 172.21.15.63:0/843030128 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f73c804f7d0 0x7f73c8051c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f73e0069440 tx=0x7f73dc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.925+0000 7f73e6323700 1 --2- 172.21.15.63:0/843030128 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f73c804f7d0 0x7f73c8051c90 secure :-1 s=READY pgs=422 cs=0 l=1 rx=0x7f73e0069440 tx=0x7f73dc007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:31.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.933+0000 7f73e6b24700 1 --2- 172.21.15.63:0/843030128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73e0157260 0x7f73e0159bf0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7f73d8000bc0 tx=0x7f73d8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:31.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:31.933+0000 7f73d6ffd700 1 -- 172.21.15.63:0/843030128 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f73d803e110 con 0x7f73e0157260 2020-05-18T21:31:32.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.081+0000 7f73e7d86700 1 -- 172.21.15.63:0/843030128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f73e00569e0 con 0x7f73e0157260 2020-05-18T21:31:32.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.089+0000 7f73e6b24700 1 --2- 172.21.15.63:0/843030128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73e0157260 0x7f73e0159bf0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7f73d8000bc0 tx=0x7f73d8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.089+0000 7f73d6ffd700 1 -- 172.21.15.63:0/843030128 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v31) v1 ==== 184+0+0 (secure 0 0 0) 0x7f73d8041730 con 0x7f73e0157260 2020-05-18T21:31:32.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.089+0000 7f73e7d86700 1 -- 172.21.15.63:0/843030128 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f73c804f7d0 msgr2=0x7f73c8051c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:32.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.089+0000 7f73e7d86700 1 --2- 172.21.15.63:0/843030128 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f73c804f7d0 0x7f73c8051c90 secure :-1 s=READY pgs=422 cs=0 l=1 rx=0x7f73e0069440 tx=0x7f73dc007e00).stop 2020-05-18T21:31:32.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.089+0000 7f73e7d86700 1 -- 172.21.15.63:0/843030128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73e0157260 msgr2=0x7f73e0159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:32.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.089+0000 7f73e7d86700 1 --2- 172.21.15.63:0/843030128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73e0157260 0x7f73e0159bf0 secure :-1 s=READY pgs=1061 cs=0 l=1 rx=0x7f73d8000bc0 tx=0x7f73d8010880).stop 2020-05-18T21:31:32.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.093+0000 7f73e7d86700 1 -- 172.21.15.63:0/843030128 shutdown_connections 2020-05-18T21:31:32.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.093+0000 7f73e7d86700 1 --2- 172.21.15.63:0/843030128 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f73c804f7d0 0x7f73c8051c90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:32.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.093+0000 7f73e7d86700 1 --2- 172.21.15.63:0/843030128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73e0157260 0x7f73e0159bf0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:32.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.093+0000 7f73e7d86700 1 --2- 172.21.15.63:0/843030128 >> v2:172.21.15.155:3300/0 conn(0x7f73e00ad070 0x7f73e0063550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:32.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.093+0000 7f73e7d86700 1 -- 172.21.15.63:0/843030128 >> 172.21.15.63:0/843030128 conn(0x7f73e006a640 msgr2=0x7f73e00b70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:32.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.093+0000 7f73e7d86700 1 -- 172.21.15.63:0/843030128 shutdown_connections 2020-05-18T21:31:32.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.093+0000 7f73e7d86700 1 -- 172.21.15.63:0/843030128 wait complete. 2020-05-18T21:31:32.098 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.0 2020-05-18T21:31:32.112 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:31:32.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5c2a3700 1 Processor -- start 2020-05-18T21:31:32.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5c2a3700 1 -- start start 2020-05-18T21:31:32.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5c2a3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c540b8c30 0x7f1c541566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:32.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5c2a3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1c540ad070 0x7f1c54156b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:32.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5c2a3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c54065a70 con 0x7f1c54156fb0 2020-05-18T21:31:32.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5c2a3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c540801d0 con 0x7f1c540b8c30 2020-05-18T21:31:32.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5c2a3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c540b5ae0 con 0x7f1c540ad070 2020-05-18T21:31:32.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5a840700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c540b8c30 0x7f1c541566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:32.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5a840700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c540b8c30 0x7f1c541566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58376/0 (socket says 172.21.15.63:58376) 2020-05-18T21:31:32.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5a840700 1 -- 172.21.15.63:0/2776259869 learned_addr learned my addr 172.21.15.63:0/2776259869 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:32.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5a03f700 1 --2- 172.21.15.63:0/2776259869 >> v2:172.21.15.155:3300/0 conn(0x7f1c540ad070 0x7f1c54156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:32.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5a840700 1 -- 172.21.15.63:0/2776259869 >> v2:172.21.15.155:3300/0 conn(0x7f1c540ad070 msgr2=0x7f1c54156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:32.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5a840700 1 --2- 172.21.15.63:0/2776259869 >> v2:172.21.15.155:3300/0 conn(0x7f1c540ad070 0x7f1c54156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:32.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5a840700 1 -- 172.21.15.63:0/2776259869 >> v1:172.21.15.155:6789/0 conn(0x7f1c54156fb0 legacy=0x7f1c5415b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:32.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5a840700 1 -- 172.21.15.63:0/2776259869 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c540b9010 con 0x7f1c540b8c30 2020-05-18T21:31:32.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5a840700 1 --2- 172.21.15.63:0/2776259869 >> v2:172.21.15.63:3300/0 conn(0x7f1c540b8c30 0x7f1c541566f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1c50002f70 tx=0x7f1c50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5a840700 1 --2- 172.21.15.63:0/2776259869 >> v2:172.21.15.63:3300/0 conn(0x7f1c540b8c30 0x7f1c541566f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1c50002f70 tx=0x7f1c50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5a840700 1 --2- 172.21.15.63:0/2776259869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c540b8c30 0x7f1c541566f0 secure :-1 s=READY pgs=1062 cs=0 l=1 rx=0x7f1c50002f70 tx=0x7f1c50007a80).ready entity=mon.0 client_cookie=1750fd102ee8f1d7 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:32.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5a840700 1 --2- 172.21.15.63:0/2776259869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c540b8c30 0x7f1c541566f0 secure :-1 s=THROTTLE_DONE pgs=1062 cs=0 l=1 rx=0x7f1c50002f70 tx=0x7f1c50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5a840700 1 --2- 172.21.15.63:0/2776259869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c540b8c30 0x7f1c541566f0 secure :-1 s=THROTTLE_DONE pgs=1062 cs=0 l=1 rx=0x7f1c50002f70 tx=0x7f1c50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5a840700 1 --2- 172.21.15.63:0/2776259869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c540b8c30 0x7f1c541566f0 secure :-1 s=THROTTLE_DONE pgs=1062 cs=0 l=1 rx=0x7f1c50002f70 tx=0x7f1c50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.217+0000 7f1c5983e700 1 -- 172.21.15.63:0/2776259869 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c500116b0 con 0x7f1c540b8c30 2020-05-18T21:31:32.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.221+0000 7f1c5983e700 1 -- 172.21.15.63:0/2776259869 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c50011810 con 0x7f1c540b8c30 2020-05-18T21:31:32.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.221+0000 7f1c5983e700 1 -- 172.21.15.63:0/2776259869 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c50011c30 con 0x7f1c540b8c30 2020-05-18T21:31:32.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.221+0000 7f1c5c2a3700 1 -- 172.21.15.63:0/2776259869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c540b8c30 msgr2=0x7f1c541566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:32.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.221+0000 7f1c5c2a3700 1 --2- 172.21.15.63:0/2776259869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c540b8c30 0x7f1c541566f0 secure :-1 s=READY pgs=1062 cs=0 l=1 rx=0x7f1c50002f70 tx=0x7f1c50007a80).stop 2020-05-18T21:31:32.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.221+0000 7f1c5c2a3700 1 -- 172.21.15.63:0/2776259869 shutdown_connections 2020-05-18T21:31:32.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.221+0000 7f1c5c2a3700 1 --2- 172.21.15.63:0/2776259869 >> v2:172.21.15.155:3300/0 conn(0x7f1c540ad070 0x7f1c54156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:32.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.221+0000 7f1c5c2a3700 1 --2- 172.21.15.63:0/2776259869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c540b8c30 0x7f1c541566f0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:32.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.221+0000 7f1c5c2a3700 1 -- 172.21.15.63:0/2776259869 >> 172.21.15.63:0/2776259869 conn(0x7f1c5406a640 msgr2=0x7f1c540b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:32.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.221+0000 7f1c5c2a3700 1 -- 172.21.15.63:0/2776259869 shutdown_connections 2020-05-18T21:31:32.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.221+0000 7f1c5c2a3700 1 -- 172.21.15.63:0/2776259869 wait complete. 2020-05-18T21:31:32.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.221+0000 7f1c5c2a3700 1 Processor -- start 2020-05-18T21:31:32.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.221+0000 7f1c5c2a3700 1 -- start start 2020-05-18T21:31:32.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5c2a3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c540ad070 0x7f1c54158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:32.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5c2a3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c54156fb0 0x7f1c5415c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:32.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5c2a3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c54143e30 con 0x7f1c540b8c30 2020-05-18T21:31:32.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5c2a3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c541440d0 con 0x7f1c540ad070 2020-05-18T21:31:32.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5c2a3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c54144370 con 0x7f1c54156fb0 2020-05-18T21:31:32.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5a840700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c540ad070 0x7f1c54158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:32.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5a840700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c540ad070 0x7f1c54158260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58382/0 (socket says 172.21.15.63:58382) 2020-05-18T21:31:32.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5a840700 1 -- 172.21.15.63:0/3223860860 learned_addr learned my addr 172.21.15.63:0/3223860860 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:32.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5b041700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c54156fb0 0x7f1c5415c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:32.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c4b7fe700 1 -- 172.21.15.63:0/3223860860 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174030038 0 0) 0x7f1c54143e30 con 0x7f1c540b8c30 2020-05-18T21:31:32.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5a840700 1 -- 172.21.15.63:0/3223860860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c54156fb0 msgr2=0x7f1c5415c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:32.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5a840700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c54156fb0 0x7f1c5415c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:32.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5a840700 1 -- 172.21.15.63:0/3223860860 >> v1:172.21.15.155:6789/0 conn(0x7f1c540b8c30 legacy=0x7f1c54061540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:32.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5a840700 1 -- 172.21.15.63:0/3223860860 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c54144610 con 0x7f1c540ad070 2020-05-18T21:31:32.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5a840700 1 --2- 172.21.15.63:0/3223860860 >> v2:172.21.15.63:3300/0 conn(0x7f1c540ad070 0x7f1c54158260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c50002f70 tx=0x7f1c50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5a840700 1 --2- 172.21.15.63:0/3223860860 >> v2:172.21.15.63:3300/0 conn(0x7f1c540ad070 0x7f1c54158260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c50002f70 tx=0x7f1c50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5a840700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c540ad070 0x7f1c54158260 secure :-1 s=READY pgs=1063 cs=0 l=1 rx=0x7f1c50002f70 tx=0x7f1c50007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:32.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5a840700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c540ad070 0x7f1c54158260 secure :-1 s=THROTTLE_DONE pgs=1063 cs=0 l=1 rx=0x7f1c50002f70 tx=0x7f1c50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c4b7fe700 1 -- 172.21.15.63:0/3223860860 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c50010250 con 0x7f1c540ad070 2020-05-18T21:31:32.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5a840700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c540ad070 0x7f1c54158260 secure :-1 s=THROTTLE_DONE pgs=1063 cs=0 l=1 rx=0x7f1c50002f70 tx=0x7f1c50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5a840700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c540ad070 0x7f1c54158260 secure :-1 s=THROTTLE_DONE pgs=1063 cs=0 l=1 rx=0x7f1c50002f70 tx=0x7f1c50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c4b7fe700 1 -- 172.21.15.63:0/3223860860 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c50011cb0 con 0x7f1c540ad070 2020-05-18T21:31:32.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5c2a3700 1 -- 172.21.15.63:0/3223860860 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c54061c50 con 0x7f1c540ad070 2020-05-18T21:31:32.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c4b7fe700 1 -- 172.21.15.63:0/3223860860 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c50007550 con 0x7f1c540ad070 2020-05-18T21:31:32.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5c2a3700 1 -- 172.21.15.63:0/3223860860 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c54144c50 con 0x7f1c540ad070 2020-05-18T21:31:32.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5a840700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c540ad070 0x7f1c54158260 secure :-1 s=THROTTLE_DONE pgs=1063 cs=0 l=1 rx=0x7f1c50002f70 tx=0x7f1c50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.225+0000 7f1c5c2a3700 1 -- 172.21.15.63:0/3223860860 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c541447a0 con 0x7f1c540ad070 2020-05-18T21:31:32.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.229+0000 7f1c4b7fe700 1 -- 172.21.15.63:0/3223860860 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1c50005700 con 0x7f1c540ad070 2020-05-18T21:31:32.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.229+0000 7f1c5a840700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c540ad070 0x7f1c54158260 secure :-1 s=THROTTLE_DONE pgs=1063 cs=0 l=1 rx=0x7f1c50002f70 tx=0x7f1c50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.229+0000 7f1c4b7fe700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c3c04f8a0 0x7f1c3c051d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:32.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.229+0000 7f1c4b7fe700 1 -- 172.21.15.63:0/3223860860 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1c50064370 con 0x7f1c540ad070 2020-05-18T21:31:32.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.229+0000 7f1c5a03f700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c3c04f8a0 0x7f1c3c051d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:32.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.229+0000 7f1c5a03f700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c3c04f8a0 0x7f1c3c051d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c440030b0 tx=0x7f1c44009940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.229+0000 7f1c5a03f700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c3c04f8a0 0x7f1c3c051d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c440030b0 tx=0x7f1c44009940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.229+0000 7f1c5a03f700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c3c04f8a0 0x7f1c3c051d60 secure :-1 s=READY pgs=423 cs=0 l=1 rx=0x7f1c440030b0 tx=0x7f1c44009940).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:32.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.233+0000 7f1c5a840700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c540ad070 0x7f1c54158260 secure :-1 s=THROTTLE_DONE pgs=1063 cs=0 l=1 rx=0x7f1c50002f70 tx=0x7f1c50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.233+0000 7f1c4b7fe700 1 -- 172.21.15.63:0/3223860860 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f1c5003e760 con 0x7f1c540ad070 2020-05-18T21:31:32.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.385+0000 7f1c5c2a3700 1 -- 172.21.15.63:0/3223860860 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1c540569e0 con 0x7f1c540ad070 2020-05-18T21:31:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.393+0000 7f1c5a840700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c540ad070 0x7f1c54158260 secure :-1 s=THROTTLE_DONE pgs=1063 cs=0 l=1 rx=0x7f1c50002f70 tx=0x7f1c50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.393+0000 7f1c4b7fe700 1 -- 172.21.15.63:0/3223860860 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v32) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1c50041d80 con 0x7f1c540ad070 2020-05-18T21:31:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.393+0000 7f1c5c2a3700 1 -- 172.21.15.63:0/3223860860 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c3c04f8a0 msgr2=0x7f1c3c051d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.393+0000 7f1c5c2a3700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c3c04f8a0 0x7f1c3c051d60 secure :-1 s=READY pgs=423 cs=0 l=1 rx=0x7f1c440030b0 tx=0x7f1c44009940).stop 2020-05-18T21:31:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.393+0000 7f1c5c2a3700 1 -- 172.21.15.63:0/3223860860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c540ad070 msgr2=0x7f1c54158260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.393+0000 7f1c5c2a3700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c540ad070 0x7f1c54158260 secure :-1 s=READY pgs=1063 cs=0 l=1 rx=0x7f1c50002f70 tx=0x7f1c50007a80).stop 2020-05-18T21:31:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.393+0000 7f1c5c2a3700 1 -- 172.21.15.63:0/3223860860 shutdown_connections 2020-05-18T21:31:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.393+0000 7f1c5c2a3700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1c3c04f8a0 0x7f1c3c051d60 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.393+0000 7f1c5c2a3700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c54156fb0 0x7f1c5415c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.393+0000 7f1c5c2a3700 1 --2- 172.21.15.63:0/3223860860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c540ad070 0x7f1c54158260 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.393+0000 7f1c5c2a3700 1 -- 172.21.15.63:0/3223860860 >> 172.21.15.63:0/3223860860 conn(0x7f1c5406a640 msgr2=0x7f1c5405f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.393+0000 7f1c5c2a3700 1 -- 172.21.15.63:0/3223860860 shutdown_connections 2020-05-18T21:31:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.393+0000 7f1c5c2a3700 1 -- 172.21.15.63:0/3223860860 wait complete. 2020-05-18T21:31:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.1 2020-05-18T21:31:32.411 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:31:32.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a9cb86700 1 Processor -- start 2020-05-18T21:31:32.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a9cb86700 1 -- start start 2020-05-18T21:31:32.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a9cb86700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a980b6410 0x7f1a980b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:32.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a9cb86700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1a980b5cb0 0x7f1a98061af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:32.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a9cb86700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a98025500 con 0x7f1a98151bc0 2020-05-18T21:31:32.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a9cb86700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a98064ee0 con 0x7f1a980b5cb0 2020-05-18T21:31:32.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a9cb86700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a980b67f0 con 0x7f1a980b6410 2020-05-18T21:31:32.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a8f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1a980b5cb0 0x7f1a98061af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:32.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a8f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1a980b5cb0 0x7f1a98061af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58392/0 (socket says 172.21.15.63:58392) 2020-05-18T21:31:32.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a8f7fe700 1 -- 172.21.15.63:0/914100718 learned_addr learned my addr 172.21.15.63:0/914100718 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:32.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a97fff700 1 --2- 172.21.15.63:0/914100718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a980b6410 0x7f1a980b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:32.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a8f7fe700 1 -- 172.21.15.63:0/914100718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a980b6410 msgr2=0x7f1a980b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:32.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a8f7fe700 1 --2- 172.21.15.63:0/914100718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a980b6410 0x7f1a980b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:32.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a8f7fe700 1 -- 172.21.15.63:0/914100718 >> v1:172.21.15.155:6789/0 conn(0x7f1a98151bc0 legacy=0x7f1a98152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:32.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a8f7fe700 1 -- 172.21.15.63:0/914100718 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a98025180 con 0x7f1a980b5cb0 2020-05-18T21:31:32.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a8f7fe700 1 --2- 172.21.15.63:0/914100718 >> v2:172.21.15.63:3300/0 conn(0x7f1a980b5cb0 0x7f1a98061af0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1a80002f70 tx=0x7f1a80007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a8f7fe700 1 --2- 172.21.15.63:0/914100718 >> v2:172.21.15.63:3300/0 conn(0x7f1a980b5cb0 0x7f1a98061af0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1a80002f70 tx=0x7f1a80007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a8f7fe700 1 --2- 172.21.15.63:0/914100718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a980b5cb0 0x7f1a98061af0 secure :-1 s=READY pgs=1064 cs=0 l=1 rx=0x7f1a80002f70 tx=0x7f1a80007a80).ready entity=mon.0 client_cookie=91652b064c452410 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:32.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a8f7fe700 1 --2- 172.21.15.63:0/914100718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a980b5cb0 0x7f1a98061af0 secure :-1 s=THROTTLE_DONE pgs=1064 cs=0 l=1 rx=0x7f1a80002f70 tx=0x7f1a80007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a8f7fe700 1 --2- 172.21.15.63:0/914100718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a980b5cb0 0x7f1a98061af0 secure :-1 s=THROTTLE_DONE pgs=1064 cs=0 l=1 rx=0x7f1a80002f70 tx=0x7f1a80007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a8f7fe700 1 --2- 172.21.15.63:0/914100718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a980b5cb0 0x7f1a98061af0 secure :-1 s=THROTTLE_DONE pgs=1064 cs=0 l=1 rx=0x7f1a80002f70 tx=0x7f1a80007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a977fe700 1 -- 172.21.15.63:0/914100718 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a800116b0 con 0x7f1a980b5cb0 2020-05-18T21:31:32.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a977fe700 1 -- 172.21.15.63:0/914100718 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a80011810 con 0x7f1a980b5cb0 2020-05-18T21:31:32.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a977fe700 1 -- 172.21.15.63:0/914100718 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a80011c30 con 0x7f1a980b5cb0 2020-05-18T21:31:32.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a9cb86700 1 -- 172.21.15.63:0/914100718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a980b5cb0 msgr2=0x7f1a98061af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:32.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a9cb86700 1 --2- 172.21.15.63:0/914100718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a980b5cb0 0x7f1a98061af0 secure :-1 s=READY pgs=1064 cs=0 l=1 rx=0x7f1a80002f70 tx=0x7f1a80007a80).stop 2020-05-18T21:31:32.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a9cb86700 1 -- 172.21.15.63:0/914100718 shutdown_connections 2020-05-18T21:31:32.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a9cb86700 1 --2- 172.21.15.63:0/914100718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a980b5cb0 0x7f1a98061af0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:32.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a9cb86700 1 --2- 172.21.15.63:0/914100718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a980b6410 0x7f1a980b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:32.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.525+0000 7f1a9cb86700 1 -- 172.21.15.63:0/914100718 >> 172.21.15.63:0/914100718 conn(0x7f1a98069b70 msgr2=0x7f1a98069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:32.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a9cb86700 1 -- 172.21.15.63:0/914100718 shutdown_connections 2020-05-18T21:31:32.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a9cb86700 1 -- 172.21.15.63:0/914100718 wait complete. 2020-05-18T21:31:32.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a9cb86700 1 Processor -- start 2020-05-18T21:31:32.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a9cb86700 1 -- start start 2020-05-18T21:31:32.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a9cb86700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1a980b5cb0 0x7f1a98152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:32.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a9cb86700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1a980b6410 0x7f1a980b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:32.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a9cb86700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a98151bc0 0x7f1a98065650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:32.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a9cb86700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a98138130 con 0x7f1a980b5cb0 2020-05-18T21:31:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a9cb86700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a98153760 con 0x7f1a980b6410 2020-05-18T21:31:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a9cb86700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a98065ab0 con 0x7f1a98151bc0 2020-05-18T21:31:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a97fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1a980b5cb0 0x7f1a98152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a97fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1a980b5cb0 0x7f1a98152410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58396/0 (socket says 172.21.15.63:58396) 2020-05-18T21:31:32.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a97fff700 1 -- 172.21.15.63:0/1594835839 learned_addr learned my addr 172.21.15.63:0/1594835839 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:32.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a8f7fe700 1 --2- 172.21.15.63:0/1594835839 >> v2:172.21.15.155:3300/0 conn(0x7f1a980b6410 0x7f1a980b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:32.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a9dde8700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a98151bc0 0x7f1a98065650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:32.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a97fff700 1 -- 172.21.15.63:0/1594835839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a98151bc0 msgr2=0x7f1a98065650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:32.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a97fff700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a98151bc0 0x7f1a98065650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:32.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a97fff700 1 -- 172.21.15.63:0/1594835839 >> v2:172.21.15.155:3300/0 conn(0x7f1a980b6410 msgr2=0x7f1a980b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:32.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a97fff700 1 --2- 172.21.15.63:0/1594835839 >> v2:172.21.15.155:3300/0 conn(0x7f1a980b6410 0x7f1a980b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:32.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a97fff700 1 -- 172.21.15.63:0/1594835839 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a980b46b0 con 0x7f1a980b5cb0 2020-05-18T21:31:32.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.529+0000 7f1a8f7fe700 1 --2- 172.21.15.63:0/1594835839 >> v2:172.21.15.155:3300/0 conn(0x7f1a980b6410 0x7f1a980b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:31:32.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.533+0000 7f1a97fff700 1 --2- 172.21.15.63:0/1594835839 >> v2:172.21.15.63:3300/0 conn(0x7f1a980b5cb0 0x7f1a98152410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1a880030b0 tx=0x7f1a88010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.533+0000 7f1a97fff700 1 --2- 172.21.15.63:0/1594835839 >> v2:172.21.15.63:3300/0 conn(0x7f1a980b5cb0 0x7f1a98152410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1a880030b0 tx=0x7f1a88010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.533+0000 7f1a97fff700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a980b5cb0 0x7f1a98152410 secure :-1 s=READY pgs=1065 cs=0 l=1 rx=0x7f1a880030b0 tx=0x7f1a88010cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:32.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.533+0000 7f1a97fff700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a980b5cb0 0x7f1a98152410 secure :-1 s=THROTTLE_DONE pgs=1065 cs=0 l=1 rx=0x7f1a880030b0 tx=0x7f1a88010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.533+0000 7f1a97fff700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a980b5cb0 0x7f1a98152410 secure :-1 s=THROTTLE_DONE pgs=1065 cs=0 l=1 rx=0x7f1a880030b0 tx=0x7f1a88010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.533+0000 7f1a957fa700 1 -- 172.21.15.63:0/1594835839 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a88007180 con 0x7f1a980b5cb0 2020-05-18T21:31:32.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.533+0000 7f1a97fff700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a980b5cb0 0x7f1a98152410 secure :-1 s=THROTTLE_DONE pgs=1065 cs=0 l=1 rx=0x7f1a880030b0 tx=0x7f1a88010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.533+0000 7f1a957fa700 1 -- 172.21.15.63:0/1594835839 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a880072e0 con 0x7f1a980b5cb0 2020-05-18T21:31:32.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.533+0000 7f1a9cb86700 1 -- 172.21.15.63:0/1594835839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a98138360 con 0x7f1a980b5cb0 2020-05-18T21:31:32.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.533+0000 7f1a957fa700 1 -- 172.21.15.63:0/1594835839 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a88012280 con 0x7f1a980b5cb0 2020-05-18T21:31:32.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.533+0000 7f1a9cb86700 1 -- 172.21.15.63:0/1594835839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a981389a0 con 0x7f1a980b5cb0 2020-05-18T21:31:32.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.533+0000 7f1a97fff700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a980b5cb0 0x7f1a98152410 secure :-1 s=THROTTLE_DONE pgs=1065 cs=0 l=1 rx=0x7f1a880030b0 tx=0x7f1a88010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.533+0000 7f1a9cb86700 1 -- 172.21.15.63:0/1594835839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a98139040 con 0x7f1a980b5cb0 2020-05-18T21:31:32.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.533+0000 7f1a957fa700 1 -- 172.21.15.63:0/1594835839 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1a880124f0 con 0x7f1a980b5cb0 2020-05-18T21:31:32.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.533+0000 7f1a97fff700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a980b5cb0 0x7f1a98152410 secure :-1 s=THROTTLE_DONE pgs=1065 cs=0 l=1 rx=0x7f1a880030b0 tx=0x7f1a88010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.533+0000 7f1a957fa700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1a7c04fae0 0x7f1a7c051fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:32.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.533+0000 7f1a957fa700 1 -- 172.21.15.63:0/1594835839 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1a88064050 con 0x7f1a980b5cb0 2020-05-18T21:31:32.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.533+0000 7f1a8f7fe700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1a7c04fae0 0x7f1a7c051fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:32.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.537+0000 7f1a8f7fe700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1a7c04fae0 0x7f1a7c051fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1a80002f70 tx=0x7f1a80007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.537+0000 7f1a8f7fe700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1a7c04fae0 0x7f1a7c051fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1a80002f70 tx=0x7f1a80007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.537+0000 7f1a8f7fe700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1a7c04fae0 0x7f1a7c051fa0 secure :-1 s=READY pgs=424 cs=0 l=1 rx=0x7f1a80002f70 tx=0x7f1a80007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:32.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.541+0000 7f1a97fff700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a980b5cb0 0x7f1a98152410 secure :-1 s=THROTTLE_DONE pgs=1065 cs=0 l=1 rx=0x7f1a880030b0 tx=0x7f1a88010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.541+0000 7f1a957fa700 1 -- 172.21.15.63:0/1594835839 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f1a8803e380 con 0x7f1a980b5cb0 2020-05-18T21:31:32.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.689+0000 7f1a9cb86700 1 -- 172.21.15.63:0/1594835839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1a980569e0 con 0x7f1a980b5cb0 2020-05-18T21:31:32.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.697+0000 7f1a97fff700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a980b5cb0 0x7f1a98152410 secure :-1 s=THROTTLE_DONE pgs=1065 cs=0 l=1 rx=0x7f1a880030b0 tx=0x7f1a88010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.697+0000 7f1a957fa700 1 -- 172.21.15.63:0/1594835839 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v33) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1a880419a0 con 0x7f1a980b5cb0 2020-05-18T21:31:32.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.701+0000 7f1a9cb86700 1 -- 172.21.15.63:0/1594835839 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1a7c04fae0 msgr2=0x7f1a7c051fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:32.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.701+0000 7f1a9cb86700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1a7c04fae0 0x7f1a7c051fa0 secure :-1 s=READY pgs=424 cs=0 l=1 rx=0x7f1a80002f70 tx=0x7f1a80007a80).stop 2020-05-18T21:31:32.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.701+0000 7f1a9cb86700 1 -- 172.21.15.63:0/1594835839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a980b5cb0 msgr2=0x7f1a98152410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:32.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.701+0000 7f1a9cb86700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a980b5cb0 0x7f1a98152410 secure :-1 s=READY pgs=1065 cs=0 l=1 rx=0x7f1a880030b0 tx=0x7f1a88010cd0).stop 2020-05-18T21:31:32.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.701+0000 7f1a9cb86700 1 -- 172.21.15.63:0/1594835839 shutdown_connections 2020-05-18T21:31:32.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.701+0000 7f1a9cb86700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1a7c04fae0 0x7f1a7c051fa0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:32.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.701+0000 7f1a9cb86700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a98151bc0 0x7f1a98065650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:32.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.701+0000 7f1a9cb86700 1 --2- 172.21.15.63:0/1594835839 >> v2:172.21.15.155:3300/0 conn(0x7f1a980b6410 0x7f1a980b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:32.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.701+0000 7f1a9cb86700 1 --2- 172.21.15.63:0/1594835839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a980b5cb0 0x7f1a98152410 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:32.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.701+0000 7f1a9cb86700 1 -- 172.21.15.63:0/1594835839 >> 172.21.15.63:0/1594835839 conn(0x7f1a98069b70 msgr2=0x7f1a980b7160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:32.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.701+0000 7f1a9cb86700 1 -- 172.21.15.63:0/1594835839 shutdown_connections 2020-05-18T21:31:32.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.701+0000 7f1a9cb86700 1 -- 172.21.15.63:0/1594835839 wait complete. 2020-05-18T21:31:32.707 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.2 2020-05-18T21:31:32.716 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:31:32.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4ce0e5700 1 Processor -- start 2020-05-18T21:31:32.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4ce0e5700 1 -- start start 2020-05-18T21:31:32.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4ce0e5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd4c80b6410 0x7fd4c80b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4ce0e5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd4c8151bc0 0x7fd4c8152030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4ce0e5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c8025500 con 0x7fd4c80b5cb0 2020-05-18T21:31:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4ce0e5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c8064ee0 con 0x7fd4c80b6410 2020-05-18T21:31:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4ce0e5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c80b67f0 con 0x7fd4c8151bc0 2020-05-18T21:31:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4cd8e4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd4c80b6410 0x7fd4c80b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4cd8e4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd4c80b6410 0x7fd4c80b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58404/0 (socket says 172.21.15.63:58404) 2020-05-18T21:31:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4cd8e4700 1 -- 172.21.15.63:0/716745544 learned_addr learned my addr 172.21.15.63:0/716745544 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4cf347700 1 --2- 172.21.15.63:0/716745544 >> v2:172.21.15.155:3300/0 conn(0x7fd4c8151bc0 0x7fd4c8152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4cd8e4700 1 -- 172.21.15.63:0/716745544 >> v2:172.21.15.155:3300/0 conn(0x7fd4c8151bc0 msgr2=0x7fd4c8152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4cd8e4700 1 --2- 172.21.15.63:0/716745544 >> v2:172.21.15.155:3300/0 conn(0x7fd4c8151bc0 0x7fd4c8152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4cd8e4700 1 -- 172.21.15.63:0/716745544 >> v1:172.21.15.155:6789/0 conn(0x7fd4c80b5cb0 legacy=0x7fd4c8061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4cd8e4700 1 -- 172.21.15.63:0/716745544 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c8025180 con 0x7fd4c80b6410 2020-05-18T21:31:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4cf347700 1 --2- 172.21.15.63:0/716745544 >> v2:172.21.15.155:3300/0 conn(0x7fd4c8151bc0 0x7fd4c8152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:31:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4cd8e4700 1 --2- 172.21.15.63:0/716745544 >> v2:172.21.15.63:3300/0 conn(0x7fd4c80b6410 0x7fd4c80b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd4c4002f70 tx=0x7fd4c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4cd8e4700 1 --2- 172.21.15.63:0/716745544 >> v2:172.21.15.63:3300/0 conn(0x7fd4c80b6410 0x7fd4c80b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd4c4002f70 tx=0x7fd4c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4cd8e4700 1 --2- 172.21.15.63:0/716745544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4c80b6410 0x7fd4c80b6cd0 secure :-1 s=READY pgs=1066 cs=0 l=1 rx=0x7fd4c4002f70 tx=0x7fd4c4007a80).ready entity=mon.0 client_cookie=dabcf6896ccb111b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:32.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4cd8e4700 1 --2- 172.21.15.63:0/716745544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4c80b6410 0x7fd4c80b6cd0 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7fd4c4002f70 tx=0x7fd4c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4cd8e4700 1 --2- 172.21.15.63:0/716745544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4c80b6410 0x7fd4c80b6cd0 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7fd4c4002f70 tx=0x7fd4c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4cc8e2700 1 -- 172.21.15.63:0/716745544 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4c40116b0 con 0x7fd4c80b6410 2020-05-18T21:31:32.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4cd8e4700 1 --2- 172.21.15.63:0/716745544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4c80b6410 0x7fd4c80b6cd0 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7fd4c4002f70 tx=0x7fd4c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4cc8e2700 1 -- 172.21.15.63:0/716745544 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c4011810 con 0x7fd4c80b6410 2020-05-18T21:31:32.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4cc8e2700 1 -- 172.21.15.63:0/716745544 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4c4011c30 con 0x7fd4c80b6410 2020-05-18T21:31:32.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4ce0e5700 1 -- 172.21.15.63:0/716745544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4c80b6410 msgr2=0x7fd4c80b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:32.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.829+0000 7fd4ce0e5700 1 --2- 172.21.15.63:0/716745544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4c80b6410 0x7fd4c80b6cd0 secure :-1 s=READY pgs=1066 cs=0 l=1 rx=0x7fd4c4002f70 tx=0x7fd4c4007a80).stop 2020-05-18T21:31:32.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.833+0000 7fd4ce0e5700 1 -- 172.21.15.63:0/716745544 shutdown_connections 2020-05-18T21:31:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.833+0000 7fd4ce0e5700 1 --2- 172.21.15.63:0/716745544 >> v2:172.21.15.155:3300/0 conn(0x7fd4c8151bc0 0x7fd4c8152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.833+0000 7fd4ce0e5700 1 --2- 172.21.15.63:0/716745544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4c80b6410 0x7fd4c80b6cd0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.833+0000 7fd4ce0e5700 1 -- 172.21.15.63:0/716745544 >> 172.21.15.63:0/716745544 conn(0x7fd4c8069b70 msgr2=0x7fd4c8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.833+0000 7fd4ce0e5700 1 -- 172.21.15.63:0/716745544 shutdown_connections 2020-05-18T21:31:32.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.833+0000 7fd4ce0e5700 1 -- 172.21.15.63:0/716745544 wait complete. 2020-05-18T21:31:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.833+0000 7fd4ce0e5700 1 Processor -- start 2020-05-18T21:31:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.833+0000 7fd4ce0e5700 1 -- start start 2020-05-18T21:31:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4ce0e5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd4c80b5cb0 0x7fd4c80b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4ce0e5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd4c8151bc0 0x7fd4c81300c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4ce0e5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c813cb90 con 0x7fd4c80b6410 2020-05-18T21:31:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4ce0e5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c8152e10 con 0x7fd4c80b5cb0 2020-05-18T21:31:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4ce0e5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c807f210 con 0x7fd4c8151bc0 2020-05-18T21:31:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4cd8e4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd4c80b5cb0 0x7fd4c80b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4cd8e4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd4c80b5cb0 0x7fd4c80b2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58410/0 (socket says 172.21.15.63:58410) 2020-05-18T21:31:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4cd8e4700 1 -- 172.21.15.63:0/1027331047 learned_addr learned my addr 172.21.15.63:0/1027331047 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4cf347700 1 --2- 172.21.15.63:0/1027331047 >> v2:172.21.15.155:3300/0 conn(0x7fd4c8151bc0 0x7fd4c81300c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4cd8e4700 1 -- 172.21.15.63:0/1027331047 >> v2:172.21.15.155:3300/0 conn(0x7fd4c8151bc0 msgr2=0x7fd4c81300c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4cd8e4700 1 --2- 172.21.15.63:0/1027331047 >> v2:172.21.15.155:3300/0 conn(0x7fd4c8151bc0 0x7fd4c81300c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4cd8e4700 1 -- 172.21.15.63:0/1027331047 >> v1:172.21.15.155:6789/0 conn(0x7fd4c80b6410 legacy=0x7fd4c806f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4cd8e4700 1 -- 172.21.15.63:0/1027331047 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c807f4b0 con 0x7fd4c80b5cb0 2020-05-18T21:31:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4cd8e4700 1 --2- 172.21.15.63:0/1027331047 >> v2:172.21.15.63:3300/0 conn(0x7fd4c80b5cb0 0x7fd4c80b2d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4c4002f70 tx=0x7fd4c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4cd8e4700 1 --2- 172.21.15.63:0/1027331047 >> v2:172.21.15.63:3300/0 conn(0x7fd4c80b5cb0 0x7fd4c80b2d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4c4002f70 tx=0x7fd4c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4cd8e4700 1 --2- 172.21.15.63:0/1027331047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4c80b5cb0 0x7fd4c80b2d00 secure :-1 s=READY pgs=1067 cs=0 l=1 rx=0x7fd4c4002f70 tx=0x7fd4c4007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4cd8e4700 1 --2- 172.21.15.63:0/1027331047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4c80b5cb0 0x7fd4c80b2d00 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7fd4c4002f70 tx=0x7fd4c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4cd8e4700 1 --2- 172.21.15.63:0/1027331047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4c80b5cb0 0x7fd4c80b2d00 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7fd4c4002f70 tx=0x7fd4c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4cd8e4700 1 --2- 172.21.15.63:0/1027331047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4c80b5cb0 0x7fd4c80b2d00 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7fd4c4002f70 tx=0x7fd4c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4be7fc700 1 -- 172.21.15.63:0/1027331047 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4c4010250 con 0x7fd4c80b5cb0 2020-05-18T21:31:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4be7fc700 1 -- 172.21.15.63:0/1027331047 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c4007360 con 0x7fd4c80b5cb0 2020-05-18T21:31:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4ce0e5700 1 -- 172.21.15.63:0/1027331047 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c806fc90 con 0x7fd4c80b5cb0 2020-05-18T21:31:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4be7fc700 1 -- 172.21.15.63:0/1027331047 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4c4005700 con 0x7fd4c80b5cb0 2020-05-18T21:31:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4ce0e5700 1 -- 172.21.15.63:0/1027331047 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c80b36a0 con 0x7fd4c80b5cb0 2020-05-18T21:31:32.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4cd8e4700 1 --2- 172.21.15.63:0/1027331047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4c80b5cb0 0x7fd4c80b2d00 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7fd4c4002f70 tx=0x7fd4c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4ce0e5700 1 -- 172.21.15.63:0/1027331047 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c807f640 con 0x7fd4c80b5cb0 2020-05-18T21:31:32.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4be7fc700 1 -- 172.21.15.63:0/1027331047 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd4c4005970 con 0x7fd4c80b5cb0 2020-05-18T21:31:32.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.837+0000 7fd4cd8e4700 1 --2- 172.21.15.63:0/1027331047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4c80b5cb0 0x7fd4c80b2d00 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7fd4c4002f70 tx=0x7fd4c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.841+0000 7fd4be7fc700 1 --2- 172.21.15.63:0/1027331047 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4b004f9f0 0x7fd4b0051eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:32.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.841+0000 7fd4be7fc700 1 -- 172.21.15.63:0/1027331047 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd4c4064180 con 0x7fd4c80b5cb0 2020-05-18T21:31:32.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.841+0000 7fd4cd0e3700 1 --2- 172.21.15.63:0/1027331047 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4b004f9f0 0x7fd4b0051eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:32.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.841+0000 7fd4cd0e3700 1 --2- 172.21.15.63:0/1027331047 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4b004f9f0 0x7fd4b0051eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4c8130890 tx=0x7fd4b8002580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.841+0000 7fd4cd0e3700 1 --2- 172.21.15.63:0/1027331047 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4b004f9f0 0x7fd4b0051eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4c8130890 tx=0x7fd4b8002580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.841+0000 7fd4cd0e3700 1 --2- 172.21.15.63:0/1027331047 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4b004f9f0 0x7fd4b0051eb0 secure :-1 s=READY pgs=425 cs=0 l=1 rx=0x7fd4c8130890 tx=0x7fd4b8002580).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:32.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.845+0000 7fd4cd8e4700 1 --2- 172.21.15.63:0/1027331047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4c80b5cb0 0x7fd4c80b2d00 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7fd4c4002f70 tx=0x7fd4c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:32.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.845+0000 7fd4be7fc700 1 -- 172.21.15.63:0/1027331047 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd4c403e5d0 con 0x7fd4c80b5cb0 2020-05-18T21:31:33.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:32.997+0000 7fd4ce0e5700 1 -- 172.21.15.63:0/1027331047 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd4c80569e0 con 0x7fd4c80b5cb0 2020-05-18T21:31:33.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.005+0000 7fd4cd8e4700 1 --2- 172.21.15.63:0/1027331047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4c80b5cb0 0x7fd4c80b2d00 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7fd4c4002f70 tx=0x7fd4c4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.005+0000 7fd4be7fc700 1 -- 172.21.15.63:0/1027331047 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v34) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd4c4041bf0 con 0x7fd4c80b5cb0 2020-05-18T21:31:33.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.009+0000 7fd4ce0e5700 1 -- 172.21.15.63:0/1027331047 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4b004f9f0 msgr2=0x7fd4b0051eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:33.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.009+0000 7fd4ce0e5700 1 --2- 172.21.15.63:0/1027331047 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4b004f9f0 0x7fd4b0051eb0 secure :-1 s=READY pgs=425 cs=0 l=1 rx=0x7fd4c8130890 tx=0x7fd4b8002580).stop 2020-05-18T21:31:33.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.009+0000 7fd4ce0e5700 1 -- 172.21.15.63:0/1027331047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4c80b5cb0 msgr2=0x7fd4c80b2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:33.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.009+0000 7fd4ce0e5700 1 --2- 172.21.15.63:0/1027331047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4c80b5cb0 0x7fd4c80b2d00 secure :-1 s=READY pgs=1067 cs=0 l=1 rx=0x7fd4c4002f70 tx=0x7fd4c4007a80).stop 2020-05-18T21:31:33.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.009+0000 7fd4ce0e5700 1 -- 172.21.15.63:0/1027331047 shutdown_connections 2020-05-18T21:31:33.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.009+0000 7fd4ce0e5700 1 --2- 172.21.15.63:0/1027331047 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4b004f9f0 0x7fd4b0051eb0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:33.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.009+0000 7fd4ce0e5700 1 --2- 172.21.15.63:0/1027331047 >> v2:172.21.15.155:3300/0 conn(0x7fd4c8151bc0 0x7fd4c81300c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:33.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.009+0000 7fd4ce0e5700 1 --2- 172.21.15.63:0/1027331047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4c80b5cb0 0x7fd4c80b2d00 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:33.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.009+0000 7fd4ce0e5700 1 -- 172.21.15.63:0/1027331047 >> 172.21.15.63:0/1027331047 conn(0x7fd4c8069b70 msgr2=0x7fd4c8061af0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:33.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.009+0000 7fd4ce0e5700 1 -- 172.21.15.63:0/1027331047 shutdown_connections 2020-05-18T21:31:33.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.009+0000 7fd4ce0e5700 1 -- 172.21.15.63:0/1027331047 wait complete. 2020-05-18T21:31:33.015 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.3 2020-05-18T21:31:33.028 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:33.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.121+0000 7fb52e436700 1 Processor -- start 2020-05-18T21:31:33.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.121+0000 7fb52e436700 1 -- start start 2020-05-18T21:31:33.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.121+0000 7fb52e436700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b6180 0x7fb528144810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:33.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.121+0000 7fb52e436700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb5280b4f60 0x7fb5280b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:33.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.121+0000 7fb52e436700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb528069b70 con 0x7fb52813de20 2020-05-18T21:31:33.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.121+0000 7fb52e436700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb528069e10 con 0x7fb5280b4f60 2020-05-18T21:31:33.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.121+0000 7fb52e436700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb52806a0b0 con 0x7fb5280b6180 2020-05-18T21:31:33.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.121+0000 7fb5277fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b6180 0x7fb528144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:33.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.121+0000 7fb52c9d3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb5280b4f60 0x7fb5280b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:33.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.121+0000 7fb5277fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b6180 0x7fb528144810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:49122/0 (socket says 172.21.15.63:49122) 2020-05-18T21:31:33.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.121+0000 7fb5277fe700 1 -- 172.21.15.63:0/4195627382 learned_addr learned my addr 172.21.15.63:0/4195627382 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:33.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb5277fe700 1 -- 172.21.15.63:0/4195627382 >> v2:172.21.15.155:3300/0 conn(0x7fb5280b4f60 msgr2=0x7fb5280b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:33.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb5277fe700 1 --2- 172.21.15.63:0/4195627382 >> v2:172.21.15.155:3300/0 conn(0x7fb5280b4f60 0x7fb5280b53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:33.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb5277fe700 1 -- 172.21.15.63:0/4195627382 >> v1:172.21.15.155:6789/0 conn(0x7fb52813de20 legacy=0x7fb52806a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:33.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb5277fe700 1 -- 172.21.15.63:0/4195627382 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb528144c70 con 0x7fb5280b6180 2020-05-18T21:31:33.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb5277fe700 1 --2- 172.21.15.63:0/4195627382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b6180 0x7fb528144810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb51c002f70 tx=0x7fb51c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb5277fe700 1 --2- 172.21.15.63:0/4195627382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b6180 0x7fb528144810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb51c002f70 tx=0x7fb51c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb5277fe700 1 --2- 172.21.15.63:0/4195627382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b6180 0x7fb528144810 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7fb51c002f70 tx=0x7fb51c007a80).ready entity=mon.2 client_cookie=b7a111c480a979d9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:33.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb5277fe700 1 --2- 172.21.15.63:0/4195627382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b6180 0x7fb528144810 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7fb51c002f70 tx=0x7fb51c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb526ffd700 1 -- 172.21.15.63:0/4195627382 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb51c0116b0 con 0x7fb5280b6180 2020-05-18T21:31:33.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb5277fe700 1 --2- 172.21.15.63:0/4195627382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b6180 0x7fb528144810 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7fb51c002f70 tx=0x7fb51c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb5277fe700 1 --2- 172.21.15.63:0/4195627382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b6180 0x7fb528144810 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7fb51c002f70 tx=0x7fb51c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb526ffd700 1 -- 172.21.15.63:0/4195627382 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51c011810 con 0x7fb5280b6180 2020-05-18T21:31:33.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb526ffd700 1 -- 172.21.15.63:0/4195627382 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb51c011c30 con 0x7fb5280b6180 2020-05-18T21:31:33.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb52e436700 1 -- 172.21.15.63:0/4195627382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b6180 msgr2=0x7fb528144810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:33.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb52e436700 1 --2- 172.21.15.63:0/4195627382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b6180 0x7fb528144810 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7fb51c002f70 tx=0x7fb51c007a80).stop 2020-05-18T21:31:33.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb52e436700 1 -- 172.21.15.63:0/4195627382 shutdown_connections 2020-05-18T21:31:33.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb52e436700 1 --2- 172.21.15.63:0/4195627382 >> v2:172.21.15.155:3300/0 conn(0x7fb5280b4f60 0x7fb5280b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:33.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb52e436700 1 --2- 172.21.15.63:0/4195627382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b6180 0x7fb528144810 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:33.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb52e436700 1 -- 172.21.15.63:0/4195627382 >> 172.21.15.63:0/4195627382 conn(0x7fb5280ba5c0 msgr2=0x7fb5280ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:33.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb52e436700 1 -- 172.21.15.63:0/4195627382 shutdown_connections 2020-05-18T21:31:33.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.125+0000 7fb52e436700 1 -- 172.21.15.63:0/4195627382 wait complete. 2020-05-18T21:31:33.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb52e436700 1 Processor -- start 2020-05-18T21:31:33.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb52e436700 1 -- start start 2020-05-18T21:31:33.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb52e436700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b4f60 0x7fb5281465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:33.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb52e436700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb528146da0 con 0x7fb5280b6180 2020-05-18T21:31:33.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb52e436700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb528147040 con 0x7fb52813de20 2020-05-18T21:31:33.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb52e436700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb528146b90 con 0x7fb5280b4f60 2020-05-18T21:31:33.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb5277fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb5280b6180 0x7fb52813c830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60612/0 (socket says 172.21.15.63:60612) 2020-05-18T21:31:33.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb5277fe700 1 -- 172.21.15.63:0/1496213279 learned_addr learned my addr 172.21.15.63:0/1496213279 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:33.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb527fff700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b4f60 0x7fb5281465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:33.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb5257fa700 1 -- 172.21.15.63:0/1496213279 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073188217 0 0) 0x7fb528146da0 con 0x7fb5280b6180 2020-05-18T21:31:33.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb5257fa700 1 -- 172.21.15.63:0/1496213279 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb508002fe0 con 0x7fb5280b6180 2020-05-18T21:31:33.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb5257fa700 1 -- 172.21.15.63:0/1496213279 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333062088 0 0) 0x7fb528147040 con 0x7fb52813de20 2020-05-18T21:31:33.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb5257fa700 1 -- 172.21.15.63:0/1496213279 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb528146da0 con 0x7fb52813de20 2020-05-18T21:31:33.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb5257fa700 1 -- 172.21.15.63:0/1496213279 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 429226468 0 0) 0x7fb508002fe0 con 0x7fb5280b6180 2020-05-18T21:31:33.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb5257fa700 1 -- 172.21.15.63:0/1496213279 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb528147040 con 0x7fb5280b6180 2020-05-18T21:31:33.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb5257fa700 1 -- 172.21.15.63:0/1496213279 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fb51c008600 con 0x7fb5280b6180 2020-05-18T21:31:33.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb527fff700 1 -- 172.21.15.63:0/1496213279 >> v1:172.21.15.155:6789/0 conn(0x7fb52813de20 legacy=0x7fb52813f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:33.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb527fff700 1 -- 172.21.15.63:0/1496213279 >> v1:172.21.15.63:6789/0 conn(0x7fb5280b6180 legacy=0x7fb52813c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:33.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb527fff700 1 -- 172.21.15.63:0/1496213279 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb528141040 con 0x7fb5280b4f60 2020-05-18T21:31:33.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb527fff700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b4f60 0x7fb5281465f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb5280bb2a0 tx=0x7fb5180108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb527fff700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b4f60 0x7fb5281465f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb5280bb2a0 tx=0x7fb5180108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb527fff700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b4f60 0x7fb5281465f0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7fb5280bb2a0 tx=0x7fb5180108f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:33.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb527fff700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b4f60 0x7fb5281465f0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fb5280bb2a0 tx=0x7fb5180108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb5257fa700 1 -- 172.21.15.63:0/1496213279 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5180069f0 con 0x7fb5280b4f60 2020-05-18T21:31:33.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb527fff700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b4f60 0x7fb5281465f0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fb5280bb2a0 tx=0x7fb5180108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb527fff700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b4f60 0x7fb5281465f0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fb5280bb2a0 tx=0x7fb5180108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb5257fa700 1 -- 172.21.15.63:0/1496213279 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb518011e90 con 0x7fb5280b4f60 2020-05-18T21:31:33.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb52e436700 1 -- 172.21.15.63:0/1496213279 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5281474e0 con 0x7fb5280b4f60 2020-05-18T21:31:33.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb5257fa700 1 -- 172.21.15.63:0/1496213279 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb518006d40 con 0x7fb5280b4f60 2020-05-18T21:31:33.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.129+0000 7fb52e436700 1 -- 172.21.15.63:0/1496213279 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb52813d0e0 con 0x7fb5280b4f60 2020-05-18T21:31:33.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.133+0000 7fb527fff700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b4f60 0x7fb5281465f0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fb5280bb2a0 tx=0x7fb5180108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.133+0000 7fb5257fa700 1 -- 172.21.15.63:0/1496213279 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb51800a2b0 con 0x7fb5280b4f60 2020-05-18T21:31:33.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.133+0000 7fb527fff700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b4f60 0x7fb5281465f0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fb5280bb2a0 tx=0x7fb5180108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.133+0000 7fb52e436700 1 -- 172.21.15.63:0/1496213279 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb528154e70 con 0x7fb5280b4f60 2020-05-18T21:31:33.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.133+0000 7fb5257fa700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb5080500e0 0x7fb5080525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:33.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.133+0000 7fb5257fa700 1 -- 172.21.15.63:0/1496213279 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb518063650 con 0x7fb5280b4f60 2020-05-18T21:31:33.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.133+0000 7fb5277fe700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb5080500e0 0x7fb5080525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:33.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.133+0000 7fb5277fe700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb5080500e0 0x7fb5080525a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb51c010250 tx=0x7fb51c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.133+0000 7fb5277fe700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb5080500e0 0x7fb5080525a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb51c010250 tx=0x7fb51c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.133+0000 7fb5277fe700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb5080500e0 0x7fb5080525a0 secure :-1 s=READY pgs=426 cs=0 l=1 rx=0x7fb51c010250 tx=0x7fb51c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:33.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.141+0000 7fb527fff700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b4f60 0x7fb5281465f0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fb5280bb2a0 tx=0x7fb5180108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.141+0000 7fb5257fa700 1 -- 172.21.15.63:0/1496213279 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb528154e70 con 0x7fb5280b4f60 2020-05-18T21:31:33.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.289+0000 7fb52e436700 1 -- 172.21.15.63:0/1496213279 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb528154e70 con 0x7fb5280b4f60 2020-05-18T21:31:33.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.289+0000 7fb527fff700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b4f60 0x7fb5281465f0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fb5280bb2a0 tx=0x7fb5180108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.289+0000 7fb5257fa700 1 -- 172.21.15.63:0/1496213279 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+2137 (secure 0 0 0) 0x7fb528154e70 con 0x7fb5280b4f60 2020-05-18T21:31:33.294 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:33.294 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":53,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/249786226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":249786226},{"type":"v1","addr":"172.21.15.63:6833","nonce":249786226}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":51}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:31:31.212807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7242":{"gid":7242,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/578144386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":578144386},{"type":"v1","addr":"172.21.15.155:6835","nonce":578144386}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:31:33.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.289+0000 7fb52e436700 1 -- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb5080500e0 msgr2=0x7fb5080525a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:33.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.289+0000 7fb52e436700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb5080500e0 0x7fb5080525a0 secure :-1 s=READY pgs=426 cs=0 l=1 rx=0x7fb51c010250 tx=0x7fb51c007a80).stop 2020-05-18T21:31:33.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.289+0000 7fb52e436700 1 -- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b4f60 msgr2=0x7fb5281465f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:33.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.289+0000 7fb52e436700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b4f60 0x7fb5281465f0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7fb5280bb2a0 tx=0x7fb5180108f0).stop 2020-05-18T21:31:33.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.289+0000 7fb52e436700 1 -- 172.21.15.63:0/1496213279 shutdown_connections 2020-05-18T21:31:33.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.289+0000 7fb52e436700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb5080500e0 0x7fb5080525a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:33.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.289+0000 7fb52e436700 1 --2- 172.21.15.63:0/1496213279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5280b4f60 0x7fb5281465f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:33.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.289+0000 7fb52e436700 1 -- 172.21.15.63:0/1496213279 >> 172.21.15.63:0/1496213279 conn(0x7fb5280ba5c0 msgr2=0x7fb5280629a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.289+0000 7fb52e436700 1 -- 172.21.15.63:0/1496213279 shutdown_connections 2020-05-18T21:31:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.289+0000 7fb52e436700 1 -- 172.21.15.63:0/1496213279 wait complete. 2020-05-18T21:31:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 53 2020-05-18T21:31:33.508 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:31:31.212807+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7242}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7242': {'gid': 7242, 'name': 'b', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6835/578144386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 578144386}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 578144386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:31:33.509 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:31:33.510 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:31:33.618 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:31:33.619 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:31:33.619 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2020-05-18T21:31:33.619 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 7242, 2020-05-18T21:31:33.619 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:31:33.619 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:31:33.620 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 3.4047874280000001, 2020-05-18T21:31:33.620 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 53, 2020-05-18T21:31:33.620 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 84, 2020-05-18T21:31:33.620 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 83, 2020-05-18T21:31:33.620 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 7.7128427960000003 2020-05-18T21:31:33.621 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:31:33.627 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 7242, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.4047874280000001, "mdsmap_epoch": 53, "osdmap_epoch": 84, "osdmap_epoch_barrier": 83, "uptime": 7.7128427960000003 } 2020-05-18T21:31:33.628 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:31:33.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.733+0000 7f5b9ea44700 1 Processor -- start 2020-05-18T21:31:33.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.733+0000 7f5b9ea44700 1 -- start start 2020-05-18T21:31:33.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b9ea44700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5b980610e0 0x7f5b9809bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:33.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b9ea44700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b9809af20 con 0x7f5b980b8f10 2020-05-18T21:31:33.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b9ea44700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b980b3000 con 0x7f5b9809b620 2020-05-18T21:31:33.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b9ea44700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9809b180 con 0x7f5b980610e0 2020-05-18T21:31:33.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b97fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5b980b8f10 0x7f5b98143230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60620/0 (socket says 172.21.15.63:60620) 2020-05-18T21:31:33.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b97fff700 1 -- 172.21.15.63:0/4063459538 learned_addr learned my addr 172.21.15.63:0/4063459538 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:33.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b9cfe1700 1 --2- 172.21.15.63:0/4063459538 >> v2:172.21.15.63:3300/0 conn(0x7f5b980610e0 0x7f5b9809bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:33.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b9cfe1700 1 -- 172.21.15.63:0/4063459538 >> v1:172.21.15.155:6789/0 conn(0x7f5b9809b620 legacy=0x7f5b981471d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:33.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b9cfe1700 1 -- 172.21.15.63:0/4063459538 >> v1:172.21.15.63:6789/0 conn(0x7f5b980b8f10 legacy=0x7f5b98143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:33.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b9cfe1700 1 -- 172.21.15.63:0/4063459538 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b98061660 con 0x7f5b980610e0 2020-05-18T21:31:33.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b9cfe1700 1 --2- 172.21.15.63:0/4063459538 >> v2:172.21.15.63:3300/0 conn(0x7f5b980610e0 0x7f5b9809bd20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5b80001110 tx=0x7f5b90007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b9cfe1700 1 --2- 172.21.15.63:0/4063459538 >> v2:172.21.15.63:3300/0 conn(0x7f5b980610e0 0x7f5b9809bd20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5b80001110 tx=0x7f5b90007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b9cfe1700 1 --2- 172.21.15.63:0/4063459538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b980610e0 0x7f5b9809bd20 secure :-1 s=READY pgs=1070 cs=0 l=1 rx=0x7f5b80001110 tx=0x7f5b90007e00).ready entity=mon.0 client_cookie=6dddb37834ee01a0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:33.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b9cfe1700 1 --2- 172.21.15.63:0/4063459538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b980610e0 0x7f5b9809bd20 secure :-1 s=THROTTLE_DONE pgs=1070 cs=0 l=1 rx=0x7f5b80001110 tx=0x7f5b90007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b977fe700 1 -- 172.21.15.63:0/4063459538 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b90010e90 con 0x7f5b980610e0 2020-05-18T21:31:33.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b9cfe1700 1 --2- 172.21.15.63:0/4063459538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b980610e0 0x7f5b9809bd20 secure :-1 s=THROTTLE_DONE pgs=1070 cs=0 l=1 rx=0x7f5b80001110 tx=0x7f5b90007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b9cfe1700 1 --2- 172.21.15.63:0/4063459538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b980610e0 0x7f5b9809bd20 secure :-1 s=THROTTLE_DONE pgs=1070 cs=0 l=1 rx=0x7f5b80001110 tx=0x7f5b90007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b977fe700 1 -- 172.21.15.63:0/4063459538 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b900110d0 con 0x7f5b980610e0 2020-05-18T21:31:33.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b977fe700 1 -- 172.21.15.63:0/4063459538 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b900114b0 con 0x7f5b980610e0 2020-05-18T21:31:33.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b9ea44700 1 -- 172.21.15.63:0/4063459538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b980610e0 msgr2=0x7f5b9809bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:33.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.737+0000 7f5b9ea44700 1 --2- 172.21.15.63:0/4063459538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b980610e0 0x7f5b9809bd20 secure :-1 s=READY pgs=1070 cs=0 l=1 rx=0x7f5b80001110 tx=0x7f5b90007e00).stop 2020-05-18T21:31:33.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.741+0000 7f5b9ea44700 1 -- 172.21.15.63:0/4063459538 shutdown_connections 2020-05-18T21:31:33.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.741+0000 7f5b9ea44700 1 --2- 172.21.15.63:0/4063459538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b980610e0 0x7f5b9809bd20 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:33.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.741+0000 7f5b9ea44700 1 -- 172.21.15.63:0/4063459538 >> 172.21.15.63:0/4063459538 conn(0x7f5b9805a7c0 msgr2=0x7f5b9805aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:33.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.741+0000 7f5b9ea44700 1 -- 172.21.15.63:0/4063459538 shutdown_connections 2020-05-18T21:31:33.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.741+0000 7f5b9ea44700 1 -- 172.21.15.63:0/4063459538 wait complete. 2020-05-18T21:31:33.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.741+0000 7f5b9ea44700 1 Processor -- start 2020-05-18T21:31:33.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.741+0000 7f5b9ea44700 1 -- start start 2020-05-18T21:31:33.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.741+0000 7f5b9ea44700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5b980610e0 0x7f5b980b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:33.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.741+0000 7f5b9ea44700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5b980b8f10 0x7f5b98090ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:33.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.741+0000 7f5b9ea44700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b98091100 con 0x7f5b9809b620 2020-05-18T21:31:33.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.741+0000 7f5b9ea44700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b980913a0 con 0x7f5b980610e0 2020-05-18T21:31:33.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.741+0000 7f5b9ea44700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9808f000 con 0x7f5b980b8f10 2020-05-18T21:31:33.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.741+0000 7f5b97fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5b980610e0 0x7f5b980b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:33.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.741+0000 7f5b8ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5b9809b620 0x7f5b98154780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60626/0 (socket says 172.21.15.63:60626) 2020-05-18T21:31:33.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.741+0000 7f5b8ffff700 1 -- 172.21.15.63:0/2041853923 learned_addr learned my addr 172.21.15.63:0/2041853923 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:33.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.741+0000 7f5b97fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5b980610e0 0x7f5b980b0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58440/0 (socket says 172.21.15.63:58440) 2020-05-18T21:31:33.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.741+0000 7f5b9cfe1700 1 --2- 172.21.15.63:0/2041853923 >> v2:172.21.15.155:3300/0 conn(0x7f5b980b8f10 0x7f5b98090ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:33.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b97fff700 1 -- 172.21.15.63:0/2041853923 >> v2:172.21.15.155:3300/0 conn(0x7f5b980b8f10 msgr2=0x7f5b98090ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:33.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b97fff700 1 --2- 172.21.15.63:0/2041853923 >> v2:172.21.15.155:3300/0 conn(0x7f5b980b8f10 0x7f5b98090ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:33.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b95ffb700 1 -- 172.21.15.63:0/2041853923 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222065968 0 0) 0x7f5b98091100 con 0x7f5b9809b620 2020-05-18T21:31:33.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b97fff700 1 -- 172.21.15.63:0/2041853923 >> v1:172.21.15.63:6789/0 conn(0x7f5b9809b620 legacy=0x7f5b98154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:33.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b97fff700 1 -- 172.21.15.63:0/2041853923 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b980b1ed0 con 0x7f5b980610e0 2020-05-18T21:31:33.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b97fff700 1 --2- 172.21.15.63:0/2041853923 >> v2:172.21.15.63:3300/0 conn(0x7f5b980610e0 0x7f5b980b0960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5b9809ba70 tx=0x7f5b880108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b97fff700 1 --2- 172.21.15.63:0/2041853923 >> v2:172.21.15.63:3300/0 conn(0x7f5b980610e0 0x7f5b980b0960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5b9809ba70 tx=0x7f5b880108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b97fff700 1 --2- 172.21.15.63:0/2041853923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b980610e0 0x7f5b980b0960 secure :-1 s=READY pgs=1072 cs=0 l=1 rx=0x7f5b9809ba70 tx=0x7f5b880108b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b97fff700 1 --2- 172.21.15.63:0/2041853923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b980610e0 0x7f5b980b0960 secure :-1 s=THROTTLE_DONE pgs=1072 cs=0 l=1 rx=0x7f5b9809ba70 tx=0x7f5b880108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b97fff700 1 --2- 172.21.15.63:0/2041853923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b980610e0 0x7f5b980b0960 secure :-1 s=THROTTLE_DONE pgs=1072 cs=0 l=1 rx=0x7f5b9809ba70 tx=0x7f5b880108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b95ffb700 1 -- 172.21.15.63:0/2041853923 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b88005ce0 con 0x7f5b980610e0 2020-05-18T21:31:33.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b97fff700 1 --2- 172.21.15.63:0/2041853923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b980610e0 0x7f5b980b0960 secure :-1 s=THROTTLE_DONE pgs=1072 cs=0 l=1 rx=0x7f5b9809ba70 tx=0x7f5b880108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b95ffb700 1 -- 172.21.15.63:0/2041853923 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b88005e40 con 0x7f5b980610e0 2020-05-18T21:31:33.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b9ea44700 1 -- 172.21.15.63:0/2041853923 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b980b2120 con 0x7f5b980610e0 2020-05-18T21:31:33.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b95ffb700 1 -- 172.21.15.63:0/2041853923 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b880062c0 con 0x7f5b980610e0 2020-05-18T21:31:33.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b9ea44700 1 -- 172.21.15.63:0/2041853923 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b98155030 con 0x7f5b980610e0 2020-05-18T21:31:33.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b97fff700 1 --2- 172.21.15.63:0/2041853923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b980610e0 0x7f5b980b0960 secure :-1 s=THROTTLE_DONE pgs=1072 cs=0 l=1 rx=0x7f5b9809ba70 tx=0x7f5b880108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b9ea44700 1 -- 172.21.15.63:0/2041853923 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b98090f40 con 0x7f5b980610e0 2020-05-18T21:31:33.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b95ffb700 1 -- 172.21.15.63:0/2041853923 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5b880064f0 con 0x7f5b980610e0 2020-05-18T21:31:33.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b97fff700 1 --2- 172.21.15.63:0/2041853923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b980610e0 0x7f5b980b0960 secure :-1 s=THROTTLE_DONE pgs=1072 cs=0 l=1 rx=0x7f5b9809ba70 tx=0x7f5b880108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.745+0000 7f5b95ffb700 1 --2- 172.21.15.63:0/2041853923 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5b7c04f840 0x7f5b7c051d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:33.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.749+0000 7f5b95ffb700 1 -- 172.21.15.63:0/2041853923 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5b880090c0 con 0x7f5b980610e0 2020-05-18T21:31:33.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.749+0000 7f5b8ffff700 1 --2- 172.21.15.63:0/2041853923 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5b7c04f840 0x7f5b7c051d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:33.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.749+0000 7f5b8ffff700 1 --2- 172.21.15.63:0/2041853923 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5b7c04f840 0x7f5b7c051d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5b800014e0 tx=0x7f5b8000c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.749+0000 7f5b8ffff700 1 --2- 172.21.15.63:0/2041853923 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5b7c04f840 0x7f5b7c051d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5b800014e0 tx=0x7f5b8000c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.749+0000 7f5b8ffff700 1 --2- 172.21.15.63:0/2041853923 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5b7c04f840 0x7f5b7c051d00 secure :-1 s=READY pgs=427 cs=0 l=1 rx=0x7f5b800014e0 tx=0x7f5b8000c910).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:33.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.757+0000 7f5b97fff700 1 --2- 172.21.15.63:0/2041853923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b980610e0 0x7f5b980b0960 secure :-1 s=THROTTLE_DONE pgs=1072 cs=0 l=1 rx=0x7f5b9809ba70 tx=0x7f5b880108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.757+0000 7f5b95ffb700 1 -- 172.21.15.63:0/2041853923 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f5b8803e060 con 0x7f5b980610e0 2020-05-18T21:31:33.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.873+0000 7f5b9ea44700 1 -- 172.21.15.63:0/2041853923 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b980569e0 con 0x7f5b980610e0 2020-05-18T21:31:33.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.873+0000 7f5b97fff700 1 --2- 172.21.15.63:0/2041853923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b980610e0 0x7f5b980b0960 secure :-1 s=THROTTLE_DONE pgs=1072 cs=0 l=1 rx=0x7f5b9809ba70 tx=0x7f5b880108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:33.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.873+0000 7f5b95ffb700 1 -- 172.21.15.63:0/2041853923 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16092 (secure 0 0 0) 0x7f5b88041680 con 0x7f5b980610e0 2020-05-18T21:31:33.880 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:33.880 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":84,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:31:31.213604+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:31:28.631738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2020-05-18T21:31:29.243969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:31:33.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.877+0000 7f5b9ea44700 1 -- 172.21.15.63:0/2041853923 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5b7c04f840 msgr2=0x7f5b7c051d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:33.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.877+0000 7f5b9ea44700 1 --2- 172.21.15.63:0/2041853923 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5b7c04f840 0x7f5b7c051d00 secure :-1 s=READY pgs=427 cs=0 l=1 rx=0x7f5b800014e0 tx=0x7f5b8000c910).stop 2020-05-18T21:31:33.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.877+0000 7f5b9ea44700 1 -- 172.21.15.63:0/2041853923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b980610e0 msgr2=0x7f5b980b0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:33.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.877+0000 7f5b9ea44700 1 --2- 172.21.15.63:0/2041853923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b980610e0 0x7f5b980b0960 secure :-1 s=READY pgs=1072 cs=0 l=1 rx=0x7f5b9809ba70 tx=0x7f5b880108b0).stop 2020-05-18T21:31:33.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.877+0000 7f5b9ea44700 1 -- 172.21.15.63:0/2041853923 shutdown_connections 2020-05-18T21:31:33.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.877+0000 7f5b9ea44700 1 --2- 172.21.15.63:0/2041853923 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5b7c04f840 0x7f5b7c051d00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:33.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.877+0000 7f5b9ea44700 1 --2- 172.21.15.63:0/2041853923 >> v2:172.21.15.155:3300/0 conn(0x7f5b980b8f10 0x7f5b98090ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:33.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.877+0000 7f5b9ea44700 1 --2- 172.21.15.63:0/2041853923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b980610e0 0x7f5b980b0960 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:33.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.877+0000 7f5b9ea44700 1 -- 172.21.15.63:0/2041853923 >> 172.21.15.63:0/2041853923 conn(0x7f5b9805a7c0 msgr2=0x7f5b9805c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:33.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.877+0000 7f5b9ea44700 1 -- 172.21.15.63:0/2041853923 shutdown_connections 2020-05-18T21:31:33.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.877+0000 7f5b9ea44700 1 -- 172.21.15.63:0/2041853923 wait complete. 2020-05-18T21:31:33.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:31:28.631738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:31:29.243969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:31:33.894 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:31:34.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.997+0000 7f5e8591b700 1 Processor -- start 2020-05-18T21:31:34.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:33.997+0000 7f5e8591b700 1 -- start start 2020-05-18T21:31:34.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e8591b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5e80143430 0x7f5e80145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:34.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e8591b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e800b7bf0 0x7f5e800b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:34.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e8591b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e80143810 con 0x7f5e800b6d70 2020-05-18T21:31:34.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e8591b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e800b7210 con 0x7f5e80143430 2020-05-18T21:31:34.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e8591b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800b74b0 con 0x7f5e800b7bf0 2020-05-18T21:31:34.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e7effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5e80143430 0x7f5e80145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:34.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e7effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5e80143430 0x7f5e80145dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58446/0 (socket says 172.21.15.63:58446) 2020-05-18T21:31:34.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e7effd700 1 -- 172.21.15.63:0/940585358 learned_addr learned my addr 172.21.15.63:0/940585358 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:34.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e7f7fe700 1 --2- 172.21.15.63:0/940585358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e800b7bf0 0x7f5e800b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:34.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e7effd700 1 -- 172.21.15.63:0/940585358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e800b7bf0 msgr2=0x7f5e800b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:34.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e7effd700 1 --2- 172.21.15.63:0/940585358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e800b7bf0 0x7f5e800b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:34.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e7effd700 1 -- 172.21.15.63:0/940585358 >> v1:172.21.15.155:6789/0 conn(0x7f5e800b6d70 legacy=0x7f5e800b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e7effd700 1 -- 172.21.15.63:0/940585358 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e800b7750 con 0x7f5e80143430 2020-05-18T21:31:34.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e7effd700 1 --2- 172.21.15.63:0/940585358 >> v2:172.21.15.63:3300/0 conn(0x7f5e80143430 0x7f5e80145dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5e70002f70 tx=0x7f5e70007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e7effd700 1 --2- 172.21.15.63:0/940585358 >> v2:172.21.15.63:3300/0 conn(0x7f5e80143430 0x7f5e80145dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5e70002f70 tx=0x7f5e70007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e7effd700 1 --2- 172.21.15.63:0/940585358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e80143430 0x7f5e80145dd0 secure :-1 s=READY pgs=1073 cs=0 l=1 rx=0x7f5e70002f70 tx=0x7f5e70007a80).ready entity=mon.0 client_cookie=866fdb42198a7c85 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:34.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e7effd700 1 --2- 172.21.15.63:0/940585358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e80143430 0x7f5e80145dd0 secure :-1 s=THROTTLE_DONE pgs=1073 cs=0 l=1 rx=0x7f5e70002f70 tx=0x7f5e70007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e7dffb700 1 -- 172.21.15.63:0/940585358 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e700116b0 con 0x7f5e80143430 2020-05-18T21:31:34.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e7effd700 1 --2- 172.21.15.63:0/940585358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e80143430 0x7f5e80145dd0 secure :-1 s=THROTTLE_DONE pgs=1073 cs=0 l=1 rx=0x7f5e70002f70 tx=0x7f5e70007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e7effd700 1 --2- 172.21.15.63:0/940585358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e80143430 0x7f5e80145dd0 secure :-1 s=THROTTLE_DONE pgs=1073 cs=0 l=1 rx=0x7f5e70002f70 tx=0x7f5e70007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e7dffb700 1 -- 172.21.15.63:0/940585358 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e70011810 con 0x7f5e80143430 2020-05-18T21:31:34.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e7dffb700 1 -- 172.21.15.63:0/940585358 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e70011c30 con 0x7f5e80143430 2020-05-18T21:31:34.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e8591b700 1 -- 172.21.15.63:0/940585358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e80143430 msgr2=0x7f5e80145dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e8591b700 1 --2- 172.21.15.63:0/940585358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e80143430 0x7f5e80145dd0 secure :-1 s=READY pgs=1073 cs=0 l=1 rx=0x7f5e70002f70 tx=0x7f5e70007a80).stop 2020-05-18T21:31:34.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e8591b700 1 -- 172.21.15.63:0/940585358 shutdown_connections 2020-05-18T21:31:34.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e8591b700 1 --2- 172.21.15.63:0/940585358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e800b7bf0 0x7f5e800b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:34.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e8591b700 1 --2- 172.21.15.63:0/940585358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e80143430 0x7f5e80145dd0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:34.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e8591b700 1 -- 172.21.15.63:0/940585358 >> 172.21.15.63:0/940585358 conn(0x7f5e80069b70 msgr2=0x7f5e80069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:34.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e8591b700 1 -- 172.21.15.63:0/940585358 shutdown_connections 2020-05-18T21:31:34.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e8591b700 1 -- 172.21.15.63:0/940585358 wait complete. 2020-05-18T21:31:34.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e8591b700 1 Processor -- start 2020-05-18T21:31:34.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.001+0000 7f5e8591b700 1 -- start start 2020-05-18T21:31:34.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e8591b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e800b7bf0 0x7f5e8014a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:34.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e8591b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5e80143430 0x7f5e800ad260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:34.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e8591b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e800affb0 con 0x7f5e800b6d70 2020-05-18T21:31:34.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e8591b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e800afd10 con 0x7f5e80143430 2020-05-18T21:31:34.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e8591b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800acdc0 con 0x7f5e800b7bf0 2020-05-18T21:31:34.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e7effd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5e800b6d70 0x7f5e80141ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60640/0 (socket says 172.21.15.63:60640) 2020-05-18T21:31:34.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e7effd700 1 -- 172.21.15.63:0/2612853464 learned_addr learned my addr 172.21.15.63:0/2612853464 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:34.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e7e7fc700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e800b7bf0 0x7f5e8014a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:34.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e7f7fe700 1 --2- 172.21.15.63:0/2612853464 >> v2:172.21.15.155:3300/0 conn(0x7f5e80143430 0x7f5e800ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:34.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e77fff700 1 -- 172.21.15.63:0/2612853464 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447541511 0 0) 0x7f5e800affb0 con 0x7f5e800b6d70 2020-05-18T21:31:34.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e77fff700 1 -- 172.21.15.63:0/2612853464 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e64002fe0 con 0x7f5e800b6d70 2020-05-18T21:31:34.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e77fff700 1 -- 172.21.15.63:0/2612853464 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3398224184 0 0) 0x7f5e64002fe0 con 0x7f5e800b6d70 2020-05-18T21:31:34.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e77fff700 1 -- 172.21.15.63:0/2612853464 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5e800affb0 con 0x7f5e800b6d70 2020-05-18T21:31:34.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e77fff700 1 -- 172.21.15.63:0/2612853464 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f5e70011ea0 con 0x7f5e800b6d70 2020-05-18T21:31:34.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e7f7fe700 1 -- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e800b7bf0 msgr2=0x7f5e8014a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e7f7fe700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e800b7bf0 0x7f5e8014a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:34.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e7f7fe700 1 -- 172.21.15.63:0/2612853464 >> v1:172.21.15.63:6789/0 conn(0x7f5e800b6d70 legacy=0x7f5e80141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e7f7fe700 1 -- 172.21.15.63:0/2612853464 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e80149ce0 con 0x7f5e80143430 2020-05-18T21:31:34.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e7e7fc700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e800b7bf0 0x7f5e8014a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:31:34.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e7f7fe700 1 --2- 172.21.15.63:0/2612853464 >> v2:172.21.15.155:3300/0 conn(0x7f5e80143430 0x7f5e800ad260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e780032f0 tx=0x7f5e78010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e7f7fe700 1 --2- 172.21.15.63:0/2612853464 >> v2:172.21.15.155:3300/0 conn(0x7f5e80143430 0x7f5e800ad260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e780032f0 tx=0x7f5e78010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.005+0000 7f5e7f7fe700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e80143430 0x7f5e800ad260 secure :-1 s=READY pgs=747 cs=0 l=1 rx=0x7f5e780032f0 tx=0x7f5e78010f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:34.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.009+0000 7f5e7f7fe700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e80143430 0x7f5e800ad260 secure :-1 s=THROTTLE_DONE pgs=747 cs=0 l=1 rx=0x7f5e780032f0 tx=0x7f5e78010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.009+0000 7f5e7f7fe700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e80143430 0x7f5e800ad260 secure :-1 s=THROTTLE_DONE pgs=747 cs=0 l=1 rx=0x7f5e780032f0 tx=0x7f5e78010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.009+0000 7f5e77fff700 1 -- 172.21.15.63:0/2612853464 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e78005a80 con 0x7f5e80143430 2020-05-18T21:31:34.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.009+0000 7f5e7f7fe700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e80143430 0x7f5e800ad260 secure :-1 s=THROTTLE_DONE pgs=747 cs=0 l=1 rx=0x7f5e780032f0 tx=0x7f5e78010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.009+0000 7f5e77fff700 1 -- 172.21.15.63:0/2612853464 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e78005be0 con 0x7f5e80143430 2020-05-18T21:31:34.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.009+0000 7f5e8591b700 1 -- 172.21.15.63:0/2612853464 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e801425b0 con 0x7f5e80143430 2020-05-18T21:31:34.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.009+0000 7f5e77fff700 1 -- 172.21.15.63:0/2612853464 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e7800c730 con 0x7f5e80143430 2020-05-18T21:31:34.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.009+0000 7f5e8591b700 1 -- 172.21.15.63:0/2612853464 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e800afa50 con 0x7f5e80143430 2020-05-18T21:31:34.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.009+0000 7f5e7f7fe700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e80143430 0x7f5e800ad260 secure :-1 s=THROTTLE_DONE pgs=747 cs=0 l=1 rx=0x7f5e780032f0 tx=0x7f5e78010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.013+0000 7f5e8591b700 1 -- 172.21.15.63:0/2612853464 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e800569e0 con 0x7f5e80143430 2020-05-18T21:31:34.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.013+0000 7f5e7f7fe700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e80143430 0x7f5e800ad260 secure :-1 s=THROTTLE_DONE pgs=747 cs=0 l=1 rx=0x7f5e780032f0 tx=0x7f5e78010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.013+0000 7f5e77fff700 1 -- 172.21.15.63:0/2612853464 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5e7800c920 con 0x7f5e80143430 2020-05-18T21:31:34.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.013+0000 7f5e77fff700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e64050130 0x7f5e640525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:34.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.013+0000 7f5e77fff700 1 -- 172.21.15.63:0/2612853464 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5e780636c0 con 0x7f5e80143430 2020-05-18T21:31:34.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.013+0000 7f5e7effd700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e64050130 0x7f5e640525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:34.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.013+0000 7f5e7effd700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e64050130 0x7f5e640525f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e70008340 tx=0x7f5e70007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.013+0000 7f5e7effd700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e64050130 0x7f5e640525f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e70008340 tx=0x7f5e70007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.013+0000 7f5e7effd700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e64050130 0x7f5e640525f0 secure :-1 s=READY pgs=428 cs=0 l=1 rx=0x7f5e70008340 tx=0x7f5e70007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:34.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.017+0000 7f5e7f7fe700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e80143430 0x7f5e800ad260 secure :-1 s=THROTTLE_DONE pgs=747 cs=0 l=1 rx=0x7f5e780032f0 tx=0x7f5e78010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.017+0000 7f5e77fff700 1 -- 172.21.15.63:0/2612853464 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f5e7803da10 con 0x7f5e80143430 2020-05-18T21:31:34.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.137+0000 7f5e8591b700 1 -- 172.21.15.63:0/2612853464 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5e800acf30 con 0x7f5e80143430 2020-05-18T21:31:34.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.141+0000 7f5e7f7fe700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e80143430 0x7f5e800ad260 secure :-1 s=THROTTLE_DONE pgs=747 cs=0 l=1 rx=0x7f5e780032f0 tx=0x7f5e78010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.141+0000 7f5e77fff700 1 -- 172.21.15.63:0/2612853464 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v84) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5e78041030 con 0x7f5e80143430 2020-05-18T21:31:34.145 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:31:34.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.141+0000 7f5e8591b700 1 -- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e64050130 msgr2=0x7f5e640525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.141+0000 7f5e8591b700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e64050130 0x7f5e640525f0 secure :-1 s=READY pgs=428 cs=0 l=1 rx=0x7f5e70008340 tx=0x7f5e70007a80).stop 2020-05-18T21:31:34.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.141+0000 7f5e8591b700 1 -- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e80143430 msgr2=0x7f5e800ad260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.141+0000 7f5e8591b700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e80143430 0x7f5e800ad260 secure :-1 s=READY pgs=747 cs=0 l=1 rx=0x7f5e780032f0 tx=0x7f5e78010f00).stop 2020-05-18T21:31:34.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.141+0000 7f5e8591b700 1 -- 172.21.15.63:0/2612853464 shutdown_connections 2020-05-18T21:31:34.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.141+0000 7f5e8591b700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e64050130 0x7f5e640525f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:34.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.141+0000 7f5e8591b700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e80143430 0x7f5e800ad260 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:34.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.141+0000 7f5e8591b700 1 --2- 172.21.15.63:0/2612853464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e800b7bf0 0x7f5e8014a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:34.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.141+0000 7f5e8591b700 1 -- 172.21.15.63:0/2612853464 >> 172.21.15.63:0/2612853464 conn(0x7f5e80069b70 msgr2=0x7f5e800b6060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:34.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.141+0000 7f5e8591b700 1 -- 172.21.15.63:0/2612853464 shutdown_connections 2020-05-18T21:31:34.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.141+0000 7f5e8591b700 1 -- 172.21.15.63:0/2612853464 wait complete. 2020-05-18T21:31:34.157 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:31:34.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.265+0000 7fc8594cf700 1 Processor -- start 2020-05-18T21:31:34.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.265+0000 7fc8594cf700 1 -- start start 2020-05-18T21:31:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.265+0000 7fc8594cf700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc8540b68d0 0x7fc8541469b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.265+0000 7fc8594cf700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8540b99d0 0x7fc854149d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.265+0000 7fc8594cf700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc8540b8ed0 0x7fc8540b9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.265+0000 7fc8594cf700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc854145d80 con 0x7fc8540b8ed0 2020-05-18T21:31:34.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.265+0000 7fc8594cf700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc854145fd0 con 0x7fc8540b68d0 2020-05-18T21:31:34.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.265+0000 7fc8594cf700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc854146270 con 0x7fc8540b99d0 2020-05-18T21:31:34.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc858cce700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc8540b8ed0 0x7fc8540b9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:34.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc8537fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8540b99d0 0x7fc854149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:34.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc858cce700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc8540b8ed0 0x7fc8540b9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58464/0 (socket says 172.21.15.63:58464) 2020-05-18T21:31:34.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc858cce700 1 -- 172.21.15.63:0/3679675593 learned_addr learned my addr 172.21.15.63:0/3679675593 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:34.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc853fff700 1 --2- 172.21.15.63:0/3679675593 >> v2:172.21.15.155:3300/0 conn(0x7fc8540b68d0 0x7fc8541469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:34.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc858cce700 1 -- 172.21.15.63:0/3679675593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8540b99d0 msgr2=0x7fc854149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:34.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc858cce700 1 --2- 172.21.15.63:0/3679675593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8540b99d0 0x7fc854149d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:34.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc858cce700 1 -- 172.21.15.63:0/3679675593 >> v2:172.21.15.155:3300/0 conn(0x7fc8540b68d0 msgr2=0x7fc8541469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:34.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc858cce700 1 --2- 172.21.15.63:0/3679675593 >> v2:172.21.15.155:3300/0 conn(0x7fc8540b68d0 0x7fc8541469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:34.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc858cce700 1 -- 172.21.15.63:0/3679675593 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc854146510 con 0x7fc8540b8ed0 2020-05-18T21:31:34.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc858cce700 1 --2- 172.21.15.63:0/3679675593 >> v2:172.21.15.63:3300/0 conn(0x7fc8540b8ed0 0x7fc8540b9380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc8540b8c90 tx=0x7fc84c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc858cce700 1 --2- 172.21.15.63:0/3679675593 >> v2:172.21.15.63:3300/0 conn(0x7fc8540b8ed0 0x7fc8540b9380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc8540b8c90 tx=0x7fc84c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc858cce700 1 --2- 172.21.15.63:0/3679675593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8540b8ed0 0x7fc8540b9380 secure :-1 s=READY pgs=1075 cs=0 l=1 rx=0x7fc8540b8c90 tx=0x7fc84c007e00).ready entity=mon.0 client_cookie=230205a227782e09 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:34.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc858cce700 1 --2- 172.21.15.63:0/3679675593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8540b8ed0 0x7fc8540b9380 secure :-1 s=THROTTLE_DONE pgs=1075 cs=0 l=1 rx=0x7fc8540b8c90 tx=0x7fc84c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc858cce700 1 --2- 172.21.15.63:0/3679675593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8540b8ed0 0x7fc8540b9380 secure :-1 s=THROTTLE_DONE pgs=1075 cs=0 l=1 rx=0x7fc8540b8c90 tx=0x7fc84c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc858cce700 1 --2- 172.21.15.63:0/3679675593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8540b8ed0 0x7fc8540b9380 secure :-1 s=THROTTLE_DONE pgs=1075 cs=0 l=1 rx=0x7fc8540b8c90 tx=0x7fc84c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc852ffd700 1 -- 172.21.15.63:0/3679675593 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc84c011cd0 con 0x7fc8540b8ed0 2020-05-18T21:31:34.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc852ffd700 1 -- 172.21.15.63:0/3679675593 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c011e30 con 0x7fc8540b8ed0 2020-05-18T21:31:34.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc852ffd700 1 -- 172.21.15.63:0/3679675593 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc84c00a370 con 0x7fc8540b8ed0 2020-05-18T21:31:34.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc8594cf700 1 -- 172.21.15.63:0/3679675593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8540b8ed0 msgr2=0x7fc8540b9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc8594cf700 1 --2- 172.21.15.63:0/3679675593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8540b8ed0 0x7fc8540b9380 secure :-1 s=READY pgs=1075 cs=0 l=1 rx=0x7fc8540b8c90 tx=0x7fc84c007e00).stop 2020-05-18T21:31:34.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc8594cf700 1 -- 172.21.15.63:0/3679675593 shutdown_connections 2020-05-18T21:31:34.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc8594cf700 1 --2- 172.21.15.63:0/3679675593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8540b8ed0 0x7fc8540b9380 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:34.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc8594cf700 1 --2- 172.21.15.63:0/3679675593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8540b99d0 0x7fc854149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:34.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc8594cf700 1 --2- 172.21.15.63:0/3679675593 >> v2:172.21.15.155:3300/0 conn(0x7fc8540b68d0 0x7fc8541469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc8594cf700 1 -- 172.21.15.63:0/3679675593 >> 172.21.15.63:0/3679675593 conn(0x7fc854069b70 msgr2=0x7fc854069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc8594cf700 1 -- 172.21.15.63:0/3679675593 shutdown_connections 2020-05-18T21:31:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc8594cf700 1 -- 172.21.15.63:0/3679675593 wait complete. 2020-05-18T21:31:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc8594cf700 1 Processor -- start 2020-05-18T21:31:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.269+0000 7fc8594cf700 1 -- start start 2020-05-18T21:31:34.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc8594cf700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8540b8ed0 0x7fc854143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:34.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc8594cf700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc8540b99d0 0x7fc8540bc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:34.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc8594cf700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8540bc770 con 0x7fc8540b68d0 2020-05-18T21:31:34.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc8594cf700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8541538b0 con 0x7fc8540b99d0 2020-05-18T21:31:34.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc8594cf700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc854153b50 con 0x7fc8540b8ed0 2020-05-18T21:31:34.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc858cce700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc8540b99d0 0x7fc8540bc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:34.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc858cce700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc8540b99d0 0x7fc8540bc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58470/0 (socket says 172.21.15.63:58470) 2020-05-18T21:31:34.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc858cce700 1 -- 172.21.15.63:0/267418873 learned_addr learned my addr 172.21.15.63:0/267418873 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:34.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc8537fe700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8540b8ed0 0x7fc854143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:34.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc858cce700 1 -- 172.21.15.63:0/267418873 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8540b8ed0 msgr2=0x7fc854143700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc858cce700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8540b8ed0 0x7fc854143700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:34.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc858cce700 1 -- 172.21.15.63:0/267418873 >> v1:172.21.15.155:6789/0 conn(0x7fc8540b68d0 legacy=0x7fc8541530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc8517fa700 1 -- 172.21.15.63:0/267418873 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350089829 0 0) 0x7fc8540bc770 con 0x7fc8540b68d0 2020-05-18T21:31:34.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc858cce700 1 -- 172.21.15.63:0/267418873 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc854153df0 con 0x7fc8540b99d0 2020-05-18T21:31:34.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc858cce700 1 --2- 172.21.15.63:0/267418873 >> v2:172.21.15.63:3300/0 conn(0x7fc8540b99d0 0x7fc8540bc310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc8540b8c90 tx=0x7fc84c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc858cce700 1 --2- 172.21.15.63:0/267418873 >> v2:172.21.15.63:3300/0 conn(0x7fc8540b99d0 0x7fc8540bc310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc8540b8c90 tx=0x7fc84c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc858cce700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8540b99d0 0x7fc8540bc310 secure :-1 s=READY pgs=1076 cs=0 l=1 rx=0x7fc8540b8c90 tx=0x7fc84c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:34.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc858cce700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8540b99d0 0x7fc8540bc310 secure :-1 s=THROTTLE_DONE pgs=1076 cs=0 l=1 rx=0x7fc8540b8c90 tx=0x7fc84c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc858cce700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8540b99d0 0x7fc8540bc310 secure :-1 s=THROTTLE_DONE pgs=1076 cs=0 l=1 rx=0x7fc8540b8c90 tx=0x7fc84c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc858cce700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8540b99d0 0x7fc8540bc310 secure :-1 s=THROTTLE_DONE pgs=1076 cs=0 l=1 rx=0x7fc8540b8c90 tx=0x7fc84c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc8517fa700 1 -- 172.21.15.63:0/267418873 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc84c00fcd0 con 0x7fc8540b99d0 2020-05-18T21:31:34.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc8517fa700 1 -- 172.21.15.63:0/267418873 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c0114d0 con 0x7fc8540b99d0 2020-05-18T21:31:34.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc8594cf700 1 -- 172.21.15.63:0/267418873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc85413c8b0 con 0x7fc8540b99d0 2020-05-18T21:31:34.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc8517fa700 1 -- 172.21.15.63:0/267418873 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc84c011640 con 0x7fc8540b99d0 2020-05-18T21:31:34.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.273+0000 7fc8594cf700 1 -- 172.21.15.63:0/267418873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85413cd30 con 0x7fc8540b99d0 2020-05-18T21:31:34.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.277+0000 7fc858cce700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8540b99d0 0x7fc8540bc310 secure :-1 s=THROTTLE_DONE pgs=1076 cs=0 l=1 rx=0x7fc8540b8c90 tx=0x7fc84c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.277+0000 7fc8517fa700 1 -- 172.21.15.63:0/267418873 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc84c005c70 con 0x7fc8540b99d0 2020-05-18T21:31:34.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.277+0000 7fc858cce700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8540b99d0 0x7fc8540bc310 secure :-1 s=THROTTLE_DONE pgs=1076 cs=0 l=1 rx=0x7fc8540b8c90 tx=0x7fc84c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.277+0000 7fc8594cf700 1 -- 172.21.15.63:0/267418873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8540569e0 con 0x7fc8540b99d0 2020-05-18T21:31:34.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.277+0000 7fc8517fa700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc83404f920 0x7fc834051de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:34.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.277+0000 7fc8517fa700 1 -- 172.21.15.63:0/267418873 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc84c064400 con 0x7fc8540b99d0 2020-05-18T21:31:34.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.277+0000 7fc853fff700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc83404f920 0x7fc834051de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:34.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.277+0000 7fc853fff700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc83404f920 0x7fc834051de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc8480030b0 tx=0x7fc848008050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.277+0000 7fc853fff700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc83404f920 0x7fc834051de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc8480030b0 tx=0x7fc848008050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.277+0000 7fc853fff700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc83404f920 0x7fc834051de0 secure :-1 s=READY pgs=429 cs=0 l=1 rx=0x7fc8480030b0 tx=0x7fc848008050).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:34.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.285+0000 7fc858cce700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8540b99d0 0x7fc8540bc310 secure :-1 s=THROTTLE_DONE pgs=1076 cs=0 l=1 rx=0x7fc8540b8c90 tx=0x7fc84c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.285+0000 7fc8517fa700 1 -- 172.21.15.63:0/267418873 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc84c03e850 con 0x7fc8540b99d0 2020-05-18T21:31:34.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.401+0000 7fc8594cf700 1 -- 172.21.15.63:0/267418873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc8540b6370 con 0x7fc8540b99d0 2020-05-18T21:31:34.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.401+0000 7fc858cce700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8540b99d0 0x7fc8540bc310 secure :-1 s=THROTTLE_DONE pgs=1076 cs=0 l=1 rx=0x7fc8540b8c90 tx=0x7fc84c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.401+0000 7fc8517fa700 1 -- 172.21.15.63:0/267418873 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc84c041e70 con 0x7fc8540b99d0 2020-05-18T21:31:34.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.405+0000 7fc8594cf700 1 -- 172.21.15.63:0/267418873 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc83404f920 msgr2=0x7fc834051de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.405+0000 7fc8594cf700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc83404f920 0x7fc834051de0 secure :-1 s=READY pgs=429 cs=0 l=1 rx=0x7fc8480030b0 tx=0x7fc848008050).stop 2020-05-18T21:31:34.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.405+0000 7fc8594cf700 1 -- 172.21.15.63:0/267418873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8540b99d0 msgr2=0x7fc8540bc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.405+0000 7fc8594cf700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8540b99d0 0x7fc8540bc310 secure :-1 s=READY pgs=1076 cs=0 l=1 rx=0x7fc8540b8c90 tx=0x7fc84c007e00).stop 2020-05-18T21:31:34.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.405+0000 7fc8594cf700 1 -- 172.21.15.63:0/267418873 shutdown_connections 2020-05-18T21:31:34.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.405+0000 7fc8594cf700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc83404f920 0x7fc834051de0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:34.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.405+0000 7fc8594cf700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8540b99d0 0x7fc8540bc310 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:34.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.405+0000 7fc8594cf700 1 --2- 172.21.15.63:0/267418873 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8540b8ed0 0x7fc854143700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:34.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.405+0000 7fc8594cf700 1 -- 172.21.15.63:0/267418873 >> 172.21.15.63:0/267418873 conn(0x7fc854069b70 msgr2=0x7fc8540b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:34.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.405+0000 7fc8594cf700 1 -- 172.21.15.63:0/267418873 shutdown_connections 2020-05-18T21:31:34.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.405+0000 7fc8594cf700 1 -- 172.21.15.63:0/267418873 wait complete. 2020-05-18T21:31:34.411 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:31:34.420 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:31:34.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.525+0000 7f9c72459700 1 Processor -- start 2020-05-18T21:31:34.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.525+0000 7f9c72459700 1 -- start start 2020-05-18T21:31:34.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.525+0000 7f9c72459700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c6c061180 0x7f9c6c06a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:34.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.525+0000 7f9c72459700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c06a7d0 con 0x7f9c6c0b2eb0 2020-05-18T21:31:34.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.525+0000 7f9c72459700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c0b2a10 con 0x7f9c6c0b4f40 2020-05-18T21:31:34.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.525+0000 7f9c72459700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6c0b5320 con 0x7f9c6c061180 2020-05-18T21:31:34.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.525+0000 7f9c71c58700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9c6c0b2eb0 0x7f9c6c0b3320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60666/0 (socket says 172.21.15.63:60666) 2020-05-18T21:31:34.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.525+0000 7f9c70c56700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c6c061180 0x7f9c6c06a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:34.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.525+0000 7f9c71c58700 1 -- 172.21.15.63:0/4006381019 learned_addr learned my addr 172.21.15.63:0/4006381019 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:34.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.525+0000 7f9c70c56700 1 -- 172.21.15.63:0/4006381019 >> v1:172.21.15.155:6789/0 conn(0x7f9c6c0b4f40 legacy=0x7f9c6c132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.525+0000 7f9c70c56700 1 -- 172.21.15.63:0/4006381019 >> v1:172.21.15.63:6789/0 conn(0x7f9c6c0b2eb0 legacy=0x7f9c6c0b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.525+0000 7f9c70c56700 1 -- 172.21.15.63:0/4006381019 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c1337f0 con 0x7f9c6c061180 2020-05-18T21:31:34.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.525+0000 7f9c5ffff700 1 -- 172.21.15.63:0/4006381019 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476182671 0 0) 0x7f9c6c06a7d0 con 0x7f9c6c0b2eb0 2020-05-18T21:31:34.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.525+0000 7f9c70c56700 1 --2- 172.21.15.63:0/4006381019 >> v2:172.21.15.63:3300/0 conn(0x7f9c6c061180 0x7f9c6c06a2c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9c60002f70 tx=0x7f9c60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.525+0000 7f9c70c56700 1 --2- 172.21.15.63:0/4006381019 >> v2:172.21.15.63:3300/0 conn(0x7f9c6c061180 0x7f9c6c06a2c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9c60002f70 tx=0x7f9c60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.525+0000 7f9c70c56700 1 --2- 172.21.15.63:0/4006381019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c061180 0x7f9c6c06a2c0 secure :-1 s=READY pgs=1078 cs=0 l=1 rx=0x7f9c60002f70 tx=0x7f9c60007a80).ready entity=mon.0 client_cookie=6da53fe8c17a2b6b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:34.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.525+0000 7f9c70c56700 1 --2- 172.21.15.63:0/4006381019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c061180 0x7f9c6c06a2c0 secure :-1 s=THROTTLE_DONE pgs=1078 cs=0 l=1 rx=0x7f9c60002f70 tx=0x7f9c60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.529+0000 7f9c5ffff700 1 -- 172.21.15.63:0/4006381019 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c60008e80 con 0x7f9c6c061180 2020-05-18T21:31:34.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.529+0000 7f9c70c56700 1 --2- 172.21.15.63:0/4006381019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c061180 0x7f9c6c06a2c0 secure :-1 s=THROTTLE_DONE pgs=1078 cs=0 l=1 rx=0x7f9c60002f70 tx=0x7f9c60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.529+0000 7f9c70c56700 1 --2- 172.21.15.63:0/4006381019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c061180 0x7f9c6c06a2c0 secure :-1 s=THROTTLE_DONE pgs=1078 cs=0 l=1 rx=0x7f9c60002f70 tx=0x7f9c60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.529+0000 7f9c5ffff700 1 -- 172.21.15.63:0/4006381019 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c600116a0 con 0x7f9c6c061180 2020-05-18T21:31:34.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.529+0000 7f9c5ffff700 1 -- 172.21.15.63:0/4006381019 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c60011ac0 con 0x7f9c6c061180 2020-05-18T21:31:34.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.529+0000 7f9c72459700 1 -- 172.21.15.63:0/4006381019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c061180 msgr2=0x7f9c6c06a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.529+0000 7f9c72459700 1 --2- 172.21.15.63:0/4006381019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c061180 0x7f9c6c06a2c0 secure :-1 s=READY pgs=1078 cs=0 l=1 rx=0x7f9c60002f70 tx=0x7f9c60007a80).stop 2020-05-18T21:31:34.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.529+0000 7f9c72459700 1 -- 172.21.15.63:0/4006381019 shutdown_connections 2020-05-18T21:31:34.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.529+0000 7f9c72459700 1 --2- 172.21.15.63:0/4006381019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c061180 0x7f9c6c06a2c0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:34.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.529+0000 7f9c72459700 1 -- 172.21.15.63:0/4006381019 >> 172.21.15.63:0/4006381019 conn(0x7f9c6c05fbd0 msgr2=0x7f9c6c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:34.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.529+0000 7f9c72459700 1 -- 172.21.15.63:0/4006381019 shutdown_connections 2020-05-18T21:31:34.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.529+0000 7f9c72459700 1 -- 172.21.15.63:0/4006381019 wait complete. 2020-05-18T21:31:34.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.529+0000 7f9c72459700 1 Processor -- start 2020-05-18T21:31:34.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c72459700 1 -- start start 2020-05-18T21:31:34.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c72459700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c6c0b2eb0 0x7f9c6c14a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:34.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c72459700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c6c0b4f40 0x7f9c6c157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:34.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c72459700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c157950 con 0x7f9c6c061180 2020-05-18T21:31:34.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c72459700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6c12ecf0 con 0x7f9c6c0b4f40 2020-05-18T21:31:34.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c72459700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6c157bf0 con 0x7f9c6c0b2eb0 2020-05-18T21:31:34.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c71c58700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c6c0b4f40 0x7f9c6c157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:34.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c70c56700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c6c0b2eb0 0x7f9c6c14a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:34.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c71c58700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c6c0b4f40 0x7f9c6c157330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58484/0 (socket says 172.21.15.63:58484) 2020-05-18T21:31:34.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c71c58700 1 -- 172.21.15.63:0/876867572 learned_addr learned my addr 172.21.15.63:0/876867572 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:34.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c70c56700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c6c0b2eb0 0x7f9c6c14a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:45098/0 (socket says 172.21.15.63:45098) 2020-05-18T21:31:34.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c71c58700 1 -- 172.21.15.63:0/876867572 >> v2:172.21.15.155:3300/0 conn(0x7f9c6c0b2eb0 msgr2=0x7f9c6c14a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c71c58700 1 --2- 172.21.15.63:0/876867572 >> v2:172.21.15.155:3300/0 conn(0x7f9c6c0b2eb0 0x7f9c6c14a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:34.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c71c58700 1 -- 172.21.15.63:0/876867572 >> v1:172.21.15.155:6789/0 conn(0x7f9c6c061180 legacy=0x7f9c6c14dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c71c58700 1 -- 172.21.15.63:0/876867572 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c157e90 con 0x7f9c6c0b4f40 2020-05-18T21:31:34.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c71c58700 1 --2- 172.21.15.63:0/876867572 >> v2:172.21.15.63:3300/0 conn(0x7f9c6c0b4f40 0x7f9c6c157330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c64001250 tx=0x7f9c64010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c71c58700 1 --2- 172.21.15.63:0/876867572 >> v2:172.21.15.63:3300/0 conn(0x7f9c6c0b4f40 0x7f9c6c157330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c64001250 tx=0x7f9c64010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c71c58700 1 --2- 172.21.15.63:0/876867572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c0b4f40 0x7f9c6c157330 secure :-1 s=READY pgs=1079 cs=0 l=1 rx=0x7f9c64001250 tx=0x7f9c64010ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:34.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c71c58700 1 --2- 172.21.15.63:0/876867572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c0b4f40 0x7f9c6c157330 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f9c64001250 tx=0x7f9c64010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c71c58700 1 --2- 172.21.15.63:0/876867572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c0b4f40 0x7f9c6c157330 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f9c64001250 tx=0x7f9c64010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c71c58700 1 --2- 172.21.15.63:0/876867572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c0b4f40 0x7f9c6c157330 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f9c64001250 tx=0x7f9c64010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c5e7fc700 1 -- 172.21.15.63:0/876867572 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c64005e70 con 0x7f9c6c0b4f40 2020-05-18T21:31:34.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c5e7fc700 1 -- 172.21.15.63:0/876867572 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c64012570 con 0x7f9c6c0b4f40 2020-05-18T21:31:34.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c72459700 1 -- 172.21.15.63:0/876867572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6c148870 con 0x7f9c6c0b4f40 2020-05-18T21:31:34.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c5e7fc700 1 -- 172.21.15.63:0/876867572 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c64012950 con 0x7f9c6c0b4f40 2020-05-18T21:31:34.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.533+0000 7f9c72459700 1 -- 172.21.15.63:0/876867572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6c148d40 con 0x7f9c6c0b4f40 2020-05-18T21:31:34.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.537+0000 7f9c71c58700 1 --2- 172.21.15.63:0/876867572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c0b4f40 0x7f9c6c157330 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f9c64001250 tx=0x7f9c64010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.537+0000 7f9c72459700 1 -- 172.21.15.63:0/876867572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6c157790 con 0x7f9c6c0b4f40 2020-05-18T21:31:34.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.537+0000 7f9c5e7fc700 1 -- 172.21.15.63:0/876867572 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9c64012bc0 con 0x7f9c6c0b4f40 2020-05-18T21:31:34.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.537+0000 7f9c71c58700 1 --2- 172.21.15.63:0/876867572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c0b4f40 0x7f9c6c157330 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f9c64001250 tx=0x7f9c64010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.537+0000 7f9c5e7fc700 1 --2- 172.21.15.63:0/876867572 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5404fa60 0x7f9c54051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:34.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.537+0000 7f9c5e7fc700 1 -- 172.21.15.63:0/876867572 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9c640090c0 con 0x7f9c6c0b4f40 2020-05-18T21:31:34.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.537+0000 7f9c71457700 1 --2- 172.21.15.63:0/876867572 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5404fa60 0x7f9c54051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:34.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.537+0000 7f9c71457700 1 --2- 172.21.15.63:0/876867572 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5404fa60 0x7f9c54051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c6c14b960 tx=0x7f9c68002560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.537+0000 7f9c71457700 1 --2- 172.21.15.63:0/876867572 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5404fa60 0x7f9c54051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c6c14b960 tx=0x7f9c68002560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.537+0000 7f9c71457700 1 --2- 172.21.15.63:0/876867572 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5404fa60 0x7f9c54051f20 secure :-1 s=READY pgs=430 cs=0 l=1 rx=0x7f9c6c14b960 tx=0x7f9c68002560).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:34.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.545+0000 7f9c71c58700 1 --2- 172.21.15.63:0/876867572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c0b4f40 0x7f9c6c157330 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f9c64001250 tx=0x7f9c64010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.545+0000 7f9c5e7fc700 1 -- 172.21.15.63:0/876867572 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9c6403e8e0 con 0x7f9c6c0b4f40 2020-05-18T21:31:34.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.661+0000 7f9c72459700 1 -- 172.21.15.63:0/876867572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9c6c0569e0 con 0x7f9c6c0b4f40 2020-05-18T21:31:34.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.661+0000 7f9c71c58700 1 --2- 172.21.15.63:0/876867572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c0b4f40 0x7f9c6c157330 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f9c64001250 tx=0x7f9c64010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.661+0000 7f9c5e7fc700 1 -- 172.21.15.63:0/876867572 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+10 (secure 0 0 0) 0x7f9c64041f00 con 0x7f9c6c0b4f40 2020-05-18T21:31:34.668 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:31:34.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.665+0000 7f9c72459700 1 -- 172.21.15.63:0/876867572 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5404fa60 msgr2=0x7f9c54051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.665+0000 7f9c72459700 1 --2- 172.21.15.63:0/876867572 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5404fa60 0x7f9c54051f20 secure :-1 s=READY pgs=430 cs=0 l=1 rx=0x7f9c6c14b960 tx=0x7f9c68002560).stop 2020-05-18T21:31:34.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.665+0000 7f9c72459700 1 -- 172.21.15.63:0/876867572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c0b4f40 msgr2=0x7f9c6c157330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.665+0000 7f9c72459700 1 --2- 172.21.15.63:0/876867572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c0b4f40 0x7f9c6c157330 secure :-1 s=READY pgs=1079 cs=0 l=1 rx=0x7f9c64001250 tx=0x7f9c64010ce0).stop 2020-05-18T21:31:34.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.665+0000 7f9c72459700 1 -- 172.21.15.63:0/876867572 shutdown_connections 2020-05-18T21:31:34.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.665+0000 7f9c72459700 1 --2- 172.21.15.63:0/876867572 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5404fa60 0x7f9c54051f20 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:34.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.665+0000 7f9c72459700 1 --2- 172.21.15.63:0/876867572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c0b4f40 0x7f9c6c157330 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:34.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.665+0000 7f9c72459700 1 --2- 172.21.15.63:0/876867572 >> v2:172.21.15.155:3300/0 conn(0x7f9c6c0b2eb0 0x7f9c6c14a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:34.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.665+0000 7f9c72459700 1 -- 172.21.15.63:0/876867572 >> 172.21.15.63:0/876867572 conn(0x7f9c6c05fbd0 msgr2=0x7f9c6c0b6220 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:34.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.665+0000 7f9c72459700 1 -- 172.21.15.63:0/876867572 shutdown_connections 2020-05-18T21:31:34.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.665+0000 7f9c72459700 1 -- 172.21.15.63:0/876867572 wait complete. 2020-05-18T21:31:34.680 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:31:34.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b4a7df700 1 Processor -- start 2020-05-18T21:31:34.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b4a7df700 1 -- start start 2020-05-18T21:31:34.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b4a7df700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b440b58e0 0x7f3b4405ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:34.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b4a7df700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b44149990 0x7f3b44149e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:34.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b4a7df700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4405ff60 con 0x7f3b440b49b0 2020-05-18T21:31:34.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b4a7df700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b440655f0 con 0x7f3b440b58e0 2020-05-18T21:31:34.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b4a7df700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b44065890 con 0x7f3b44149990 2020-05-18T21:31:34.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b43fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b440b58e0 0x7f3b4405ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:34.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b3b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3b440b49b0 0x7f3b440640e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60678/0 (socket says 172.21.15.63:60678) 2020-05-18T21:31:34.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b3b7fe700 1 -- 172.21.15.63:0/4177057534 learned_addr learned my addr 172.21.15.63:0/4177057534 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:34.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b48d7c700 1 --2- 172.21.15.63:0/4177057534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b44149990 0x7f3b44149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:34.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b437fe700 1 -- 172.21.15.63:0/4177057534 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160014896 0 0) 0x7f3b4405ff60 con 0x7f3b440b49b0 2020-05-18T21:31:34.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b437fe700 1 -- 172.21.15.63:0/4177057534 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b24003270 con 0x7f3b440b49b0 2020-05-18T21:31:34.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b43fff700 1 -- 172.21.15.63:0/4177057534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b44149990 msgr2=0x7f3b44149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:34.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b43fff700 1 --2- 172.21.15.63:0/4177057534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b44149990 0x7f3b44149e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:34.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b43fff700 1 -- 172.21.15.63:0/4177057534 >> v1:172.21.15.63:6789/0 conn(0x7f3b440b49b0 legacy=0x7f3b440640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b43fff700 1 -- 172.21.15.63:0/4177057534 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b44061cf0 con 0x7f3b440b58e0 2020-05-18T21:31:34.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b43fff700 1 --2- 172.21.15.63:0/4177057534 >> v2:172.21.15.63:3300/0 conn(0x7f3b440b58e0 0x7f3b4405ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3b34002f70 tx=0x7f3b34007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b43fff700 1 --2- 172.21.15.63:0/4177057534 >> v2:172.21.15.63:3300/0 conn(0x7f3b440b58e0 0x7f3b4405ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3b34002f70 tx=0x7f3b34007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b43fff700 1 --2- 172.21.15.63:0/4177057534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b440b58e0 0x7f3b4405ed50 secure :-1 s=READY pgs=1081 cs=0 l=1 rx=0x7f3b34002f70 tx=0x7f3b34007a80).ready entity=mon.0 client_cookie=58f01551104ffe3d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:34.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b43fff700 1 --2- 172.21.15.63:0/4177057534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b440b58e0 0x7f3b4405ed50 secure :-1 s=THROTTLE_DONE pgs=1081 cs=0 l=1 rx=0x7f3b34002f70 tx=0x7f3b34007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b437fe700 1 -- 172.21.15.63:0/4177057534 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b34008e80 con 0x7f3b440b58e0 2020-05-18T21:31:34.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b43fff700 1 --2- 172.21.15.63:0/4177057534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b440b58e0 0x7f3b4405ed50 secure :-1 s=THROTTLE_DONE pgs=1081 cs=0 l=1 rx=0x7f3b34002f70 tx=0x7f3b34007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b437fe700 1 -- 172.21.15.63:0/4177057534 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b34011540 con 0x7f3b440b58e0 2020-05-18T21:31:34.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b43fff700 1 --2- 172.21.15.63:0/4177057534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b440b58e0 0x7f3b4405ed50 secure :-1 s=THROTTLE_DONE pgs=1081 cs=0 l=1 rx=0x7f3b34002f70 tx=0x7f3b34007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b437fe700 1 -- 172.21.15.63:0/4177057534 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b34011960 con 0x7f3b440b58e0 2020-05-18T21:31:34.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b4a7df700 1 -- 172.21.15.63:0/4177057534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b440b58e0 msgr2=0x7f3b4405ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.781+0000 7f3b4a7df700 1 --2- 172.21.15.63:0/4177057534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b440b58e0 0x7f3b4405ed50 secure :-1 s=READY pgs=1081 cs=0 l=1 rx=0x7f3b34002f70 tx=0x7f3b34007a80).stop 2020-05-18T21:31:34.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.785+0000 7f3b4a7df700 1 -- 172.21.15.63:0/4177057534 shutdown_connections 2020-05-18T21:31:34.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.785+0000 7f3b4a7df700 1 --2- 172.21.15.63:0/4177057534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b44149990 0x7f3b44149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:34.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.785+0000 7f3b4a7df700 1 --2- 172.21.15.63:0/4177057534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b440b58e0 0x7f3b4405ed50 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:34.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.785+0000 7f3b4a7df700 1 -- 172.21.15.63:0/4177057534 >> 172.21.15.63:0/4177057534 conn(0x7f3b440b8ec0 msgr2=0x7f3b440b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:34.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.785+0000 7f3b4a7df700 1 -- 172.21.15.63:0/4177057534 shutdown_connections 2020-05-18T21:31:34.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.785+0000 7f3b4a7df700 1 -- 172.21.15.63:0/4177057534 wait complete. 2020-05-18T21:31:34.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.785+0000 7f3b4a7df700 1 Processor -- start 2020-05-18T21:31:34.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.785+0000 7f3b4a7df700 1 -- start start 2020-05-18T21:31:34.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b4a7df700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b44149990 0x7f3b440af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:34.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b4a7df700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4415be50 con 0x7f3b440b58e0 2020-05-18T21:31:34.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b4a7df700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b440adf90 con 0x7f3b440b49b0 2020-05-18T21:31:34.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b4a7df700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4414bda0 con 0x7f3b44149990 2020-05-18T21:31:34.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b48d7c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b44149990 0x7f3b440af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:34.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b48d7c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b44149990 0x7f3b440af340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58498/0 (socket says 172.21.15.63:58498) 2020-05-18T21:31:34.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b3b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3b440b58e0 0x7f3b44145280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60684/0 (socket says 172.21.15.63:60684) 2020-05-18T21:31:34.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b48d7c700 1 -- 172.21.15.63:0/1584836695 learned_addr learned my addr 172.21.15.63:0/1584836695 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:34.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b48d7c700 1 -- 172.21.15.63:0/1584836695 >> v1:172.21.15.155:6789/0 conn(0x7f3b440b49b0 legacy=0x7f3b4415b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b41ffb700 1 -- 172.21.15.63:0/1584836695 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933762736 0 0) 0x7f3b4415be50 con 0x7f3b440b58e0 2020-05-18T21:31:34.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b48d7c700 1 -- 172.21.15.63:0/1584836695 >> v1:172.21.15.63:6789/0 conn(0x7f3b440b58e0 legacy=0x7f3b44145280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b48d7c700 1 -- 172.21.15.63:0/1584836695 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b440ae230 con 0x7f3b44149990 2020-05-18T21:31:34.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b48d7c700 1 --2- 172.21.15.63:0/1584836695 >> v2:172.21.15.63:3300/0 conn(0x7f3b44149990 0x7f3b440af340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b3c0032f0 tx=0x7f3b3c011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b48d7c700 1 --2- 172.21.15.63:0/1584836695 >> v2:172.21.15.63:3300/0 conn(0x7f3b44149990 0x7f3b440af340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b3c0032f0 tx=0x7f3b3c011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b48d7c700 1 --2- 172.21.15.63:0/1584836695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b44149990 0x7f3b440af340 secure :-1 s=READY pgs=1083 cs=0 l=1 rx=0x7f3b3c0032f0 tx=0x7f3b3c011060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:34.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b48d7c700 1 --2- 172.21.15.63:0/1584836695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b44149990 0x7f3b440af340 secure :-1 s=THROTTLE_DONE pgs=1083 cs=0 l=1 rx=0x7f3b3c0032f0 tx=0x7f3b3c011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b48d7c700 1 --2- 172.21.15.63:0/1584836695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b44149990 0x7f3b440af340 secure :-1 s=THROTTLE_DONE pgs=1083 cs=0 l=1 rx=0x7f3b3c0032f0 tx=0x7f3b3c011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b41ffb700 1 -- 172.21.15.63:0/1584836695 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b3c012af0 con 0x7f3b44149990 2020-05-18T21:31:34.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b48d7c700 1 --2- 172.21.15.63:0/1584836695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b44149990 0x7f3b440af340 secure :-1 s=THROTTLE_DONE pgs=1083 cs=0 l=1 rx=0x7f3b3c0032f0 tx=0x7f3b3c011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b41ffb700 1 -- 172.21.15.63:0/1584836695 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c012c50 con 0x7f3b44149990 2020-05-18T21:31:34.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b4a7df700 1 -- 172.21.15.63:0/1584836695 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b440ae730 con 0x7f3b44149990 2020-05-18T21:31:34.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b41ffb700 1 -- 172.21.15.63:0/1584836695 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b3c012e40 con 0x7f3b44149990 2020-05-18T21:31:34.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b4a7df700 1 -- 172.21.15.63:0/1584836695 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b4415bbf0 con 0x7f3b44149990 2020-05-18T21:31:34.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b48d7c700 1 --2- 172.21.15.63:0/1584836695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b44149990 0x7f3b440af340 secure :-1 s=THROTTLE_DONE pgs=1083 cs=0 l=1 rx=0x7f3b3c0032f0 tx=0x7f3b3c011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.789+0000 7f3b4a7df700 1 -- 172.21.15.63:0/1584836695 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b440569e0 con 0x7f3b44149990 2020-05-18T21:31:34.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.793+0000 7f3b41ffb700 1 -- 172.21.15.63:0/1584836695 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3b3c005cc0 con 0x7f3b44149990 2020-05-18T21:31:34.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.793+0000 7f3b48d7c700 1 --2- 172.21.15.63:0/1584836695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b44149990 0x7f3b440af340 secure :-1 s=THROTTLE_DONE pgs=1083 cs=0 l=1 rx=0x7f3b3c0032f0 tx=0x7f3b3c011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.793+0000 7f3b41ffb700 1 --2- 172.21.15.63:0/1584836695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b2804f8f0 0x7f3b28051db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:34.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.793+0000 7f3b41ffb700 1 -- 172.21.15.63:0/1584836695 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3b3c063d00 con 0x7f3b44149990 2020-05-18T21:31:34.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.793+0000 7f3b43fff700 1 --2- 172.21.15.63:0/1584836695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b2804f8f0 0x7f3b28051db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:34.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.793+0000 7f3b43fff700 1 --2- 172.21.15.63:0/1584836695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b2804f8f0 0x7f3b28051db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b440b09f0 tx=0x7f3b34007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.793+0000 7f3b43fff700 1 --2- 172.21.15.63:0/1584836695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b2804f8f0 0x7f3b28051db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b440b09f0 tx=0x7f3b34007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.793+0000 7f3b43fff700 1 --2- 172.21.15.63:0/1584836695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b2804f8f0 0x7f3b28051db0 secure :-1 s=READY pgs=431 cs=0 l=1 rx=0x7f3b440b09f0 tx=0x7f3b34007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:34.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.797+0000 7f3b48d7c700 1 --2- 172.21.15.63:0/1584836695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b44149990 0x7f3b440af340 secure :-1 s=THROTTLE_DONE pgs=1083 cs=0 l=1 rx=0x7f3b3c0032f0 tx=0x7f3b3c011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.797+0000 7f3b41ffb700 1 -- 172.21.15.63:0/1584836695 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3b3c03e150 con 0x7f3b44149990 2020-05-18T21:31:34.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.913+0000 7f3b4a7df700 1 -- 172.21.15.63:0/1584836695 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b4405b400 con 0x7f3b44149990 2020-05-18T21:31:34.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.917+0000 7f3b48d7c700 1 --2- 172.21.15.63:0/1584836695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b44149990 0x7f3b440af340 secure :-1 s=THROTTLE_DONE pgs=1083 cs=0 l=1 rx=0x7f3b3c0032f0 tx=0x7f3b3c011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:34.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.917+0000 7f3b41ffb700 1 -- 172.21.15.63:0/1584836695 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3b3c041770 con 0x7f3b44149990 2020-05-18T21:31:34.921 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:31:34.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.917+0000 7f3b4a7df700 1 -- 172.21.15.63:0/1584836695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b2804f8f0 msgr2=0x7f3b28051db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.917+0000 7f3b4a7df700 1 --2- 172.21.15.63:0/1584836695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b2804f8f0 0x7f3b28051db0 secure :-1 s=READY pgs=431 cs=0 l=1 rx=0x7f3b440b09f0 tx=0x7f3b34007a80).stop 2020-05-18T21:31:34.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.917+0000 7f3b4a7df700 1 -- 172.21.15.63:0/1584836695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b44149990 msgr2=0x7f3b440af340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:34.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.917+0000 7f3b4a7df700 1 --2- 172.21.15.63:0/1584836695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b44149990 0x7f3b440af340 secure :-1 s=READY pgs=1083 cs=0 l=1 rx=0x7f3b3c0032f0 tx=0x7f3b3c011060).stop 2020-05-18T21:31:34.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.917+0000 7f3b4a7df700 1 -- 172.21.15.63:0/1584836695 shutdown_connections 2020-05-18T21:31:34.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.917+0000 7f3b4a7df700 1 --2- 172.21.15.63:0/1584836695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b2804f8f0 0x7f3b28051db0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:34.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.917+0000 7f3b4a7df700 1 --2- 172.21.15.63:0/1584836695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b44149990 0x7f3b440af340 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:34.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.917+0000 7f3b4a7df700 1 -- 172.21.15.63:0/1584836695 >> 172.21.15.63:0/1584836695 conn(0x7f3b440b8ec0 msgr2=0x7f3b4405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:34.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.917+0000 7f3b4a7df700 1 -- 172.21.15.63:0/1584836695 shutdown_connections 2020-05-18T21:31:34.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:34.917+0000 7f3b4a7df700 1 -- 172.21.15.63:0/1584836695 wait complete. 2020-05-18T21:31:34.934 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:31:34.934 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:35.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a9adc700 1 Processor -- start 2020-05-18T21:31:35.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a9adc700 1 -- start start 2020-05-18T21:31:35.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a9adc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe7a405f110 0x7fe7a40b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:35.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a9adc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7a414aa70 0x7fe7a40648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:35.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a9adc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a414a330 con 0x7fe7a4064d20 2020-05-18T21:31:35.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a9adc700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a414a140 con 0x7fe7a405f110 2020-05-18T21:31:35.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a9adc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a414a5d0 con 0x7fe7a414aa70 2020-05-18T21:31:35.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a3fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7a414aa70 0x7fe7a40648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:35.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a3fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7a414aa70 0x7fe7a40648c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:49204/0 (socket says 172.21.15.63:49204) 2020-05-18T21:31:35.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a3fff700 1 -- 172.21.15.63:0/206093368 learned_addr learned my addr 172.21.15.63:0/206093368 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:35.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a8ada700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe7a405f110 0x7fe7a40b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:35.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a3fff700 1 -- 172.21.15.63:0/206093368 >> v2:172.21.15.155:3300/0 conn(0x7fe7a405f110 msgr2=0x7fe7a40b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:35.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a3fff700 1 --2- 172.21.15.63:0/206093368 >> v2:172.21.15.155:3300/0 conn(0x7fe7a405f110 0x7fe7a40b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:35.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a3fff700 1 -- 172.21.15.63:0/206093368 >> v1:172.21.15.155:6789/0 conn(0x7fe7a4064d20 legacy=0x7fe7a414d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:35.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a3fff700 1 -- 172.21.15.63:0/206093368 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a4063430 con 0x7fe7a414aa70 2020-05-18T21:31:35.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a3fff700 1 --2- 172.21.15.63:0/206093368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7a414aa70 0x7fe7a40648c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe7a4063c70 tx=0x7fe794008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:35.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a3fff700 1 --2- 172.21.15.63:0/206093368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7a414aa70 0x7fe7a40648c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe7a4063c70 tx=0x7fe794008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:35.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a3fff700 1 --2- 172.21.15.63:0/206093368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7a414aa70 0x7fe7a40648c0 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fe7a4063c70 tx=0x7fe794008920).ready entity=mon.2 client_cookie=54e16739e0fbe26e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:35.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a3fff700 1 --2- 172.21.15.63:0/206093368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7a414aa70 0x7fe7a40648c0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fe7a4063c70 tx=0x7fe794008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:35.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a37fe700 1 -- 172.21.15.63:0/206093368 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7940116b0 con 0x7fe7a414aa70 2020-05-18T21:31:35.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a3fff700 1 --2- 172.21.15.63:0/206093368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7a414aa70 0x7fe7a40648c0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fe7a4063c70 tx=0x7fe794008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:35.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a3fff700 1 --2- 172.21.15.63:0/206093368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7a414aa70 0x7fe7a40648c0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fe7a4063c70 tx=0x7fe794008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:35.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a37fe700 1 -- 172.21.15.63:0/206093368 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe794011810 con 0x7fe7a414aa70 2020-05-18T21:31:35.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a37fe700 1 -- 172.21.15.63:0/206093368 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe794011c30 con 0x7fe7a414aa70 2020-05-18T21:31:35.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a9adc700 1 -- 172.21.15.63:0/206093368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7a414aa70 msgr2=0x7fe7a40648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:35.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a9adc700 1 --2- 172.21.15.63:0/206093368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7a414aa70 0x7fe7a40648c0 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fe7a4063c70 tx=0x7fe794008920).stop 2020-05-18T21:31:35.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a9adc700 1 -- 172.21.15.63:0/206093368 shutdown_connections 2020-05-18T21:31:35.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a9adc700 1 --2- 172.21.15.63:0/206093368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7a414aa70 0x7fe7a40648c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:35.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a9adc700 1 --2- 172.21.15.63:0/206093368 >> v2:172.21.15.155:3300/0 conn(0x7fe7a405f110 0x7fe7a40b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:35.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a9adc700 1 -- 172.21.15.63:0/206093368 >> 172.21.15.63:0/206093368 conn(0x7fe7a4069fc0 msgr2=0x7fe7a406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:35.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.029+0000 7fe7a9adc700 1 -- 172.21.15.63:0/206093368 shutdown_connections 2020-05-18T21:31:35.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.033+0000 7fe7a9adc700 1 -- 172.21.15.63:0/206093368 wait complete. 2020-05-18T21:31:35.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.033+0000 7fe7a9adc700 1 Processor -- start 2020-05-18T21:31:35.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.033+0000 7fe7a9adc700 1 -- start start 2020-05-18T21:31:35.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a9adc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe7a405f110 0x7fe7a413f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:35.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a9adc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7a4064d20 0x7fe7a413f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:35.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a9adc700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a41430e0 con 0x7fe7a414aa70 2020-05-18T21:31:35.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a9adc700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a4142ed0 con 0x7fe7a405f110 2020-05-18T21:31:35.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a9adc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a4143380 con 0x7fe7a4064d20 2020-05-18T21:31:35.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a8ada700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe7a405f110 0x7fe7a413f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:35.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a8ada700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe7a405f110 0x7fe7a413f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58508/0 (socket says 172.21.15.63:58508) 2020-05-18T21:31:35.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a8ada700 1 -- 172.21.15.63:0/4191615227 learned_addr learned my addr 172.21.15.63:0/4191615227 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:35.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a3fff700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7a4064d20 0x7fe7a413f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:35.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a8ada700 1 -- 172.21.15.63:0/4191615227 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7a4064d20 msgr2=0x7fe7a413f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:35.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a8ada700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7a4064d20 0x7fe7a413f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:35.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a8ada700 1 -- 172.21.15.63:0/4191615227 >> v1:172.21.15.63:6789/0 conn(0x7fe7a414aa70 legacy=0x7fe7a4135140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:35.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a1ffb700 1 -- 172.21.15.63:0/4191615227 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682703712 0 0) 0x7fe7a41430e0 con 0x7fe7a414aa70 2020-05-18T21:31:35.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a8ada700 1 -- 172.21.15.63:0/4191615227 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a413fb60 con 0x7fe7a405f110 2020-05-18T21:31:35.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a8ada700 1 --2- 172.21.15.63:0/4191615227 >> v2:172.21.15.63:3300/0 conn(0x7fe7a405f110 0x7fe7a413f2a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe7980030b0 tx=0x7fe798010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:35.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a8ada700 1 --2- 172.21.15.63:0/4191615227 >> v2:172.21.15.63:3300/0 conn(0x7fe7a405f110 0x7fe7a413f2a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe7980030b0 tx=0x7fe798010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:35.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a8ada700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7a405f110 0x7fe7a413f2a0 secure :-1 s=READY pgs=1085 cs=0 l=1 rx=0x7fe7980030b0 tx=0x7fe798010cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:35.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a8ada700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7a405f110 0x7fe7a413f2a0 secure :-1 s=THROTTLE_DONE pgs=1085 cs=0 l=1 rx=0x7fe7980030b0 tx=0x7fe798010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:35.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a1ffb700 1 -- 172.21.15.63:0/4191615227 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe798007180 con 0x7fe7a405f110 2020-05-18T21:31:35.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a8ada700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7a405f110 0x7fe7a413f2a0 secure :-1 s=THROTTLE_DONE pgs=1085 cs=0 l=1 rx=0x7fe7980030b0 tx=0x7fe798010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:35.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a8ada700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7a405f110 0x7fe7a413f2a0 secure :-1 s=THROTTLE_DONE pgs=1085 cs=0 l=1 rx=0x7fe7980030b0 tx=0x7fe798010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:35.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a1ffb700 1 -- 172.21.15.63:0/4191615227 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7980072e0 con 0x7fe7a405f110 2020-05-18T21:31:35.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a9adc700 1 -- 172.21.15.63:0/4191615227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a41473e0 con 0x7fe7a405f110 2020-05-18T21:31:35.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a1ffb700 1 -- 172.21.15.63:0/4191615227 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe798012360 con 0x7fe7a405f110 2020-05-18T21:31:35.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a9adc700 1 -- 172.21.15.63:0/4191615227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a4135850 con 0x7fe7a405f110 2020-05-18T21:31:35.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a8ada700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7a405f110 0x7fe7a413f2a0 secure :-1 s=THROTTLE_DONE pgs=1085 cs=0 l=1 rx=0x7fe7980030b0 tx=0x7fe798010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:35.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a9adc700 1 -- 172.21.15.63:0/4191615227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a4142c30 con 0x7fe7a405f110 2020-05-18T21:31:35.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a1ffb700 1 -- 172.21.15.63:0/4191615227 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe7980125d0 con 0x7fe7a405f110 2020-05-18T21:31:35.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.037+0000 7fe7a8ada700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7a405f110 0x7fe7a413f2a0 secure :-1 s=THROTTLE_DONE pgs=1085 cs=0 l=1 rx=0x7fe7980030b0 tx=0x7fe798010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:35.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.041+0000 7fe7a1ffb700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe78404f8e0 0x7fe784051da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:35.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.041+0000 7fe7a1ffb700 1 -- 172.21.15.63:0/4191615227 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe798064120 con 0x7fe7a405f110 2020-05-18T21:31:35.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.041+0000 7fe7a3fff700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe78404f8e0 0x7fe784051da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:35.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.041+0000 7fe7a3fff700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe78404f8e0 0x7fe784051da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe7a4063c70 tx=0x7fe7a40635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:35.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.041+0000 7fe7a3fff700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe78404f8e0 0x7fe784051da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe7a4063c70 tx=0x7fe7a40635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:35.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.041+0000 7fe7a3fff700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe78404f8e0 0x7fe784051da0 secure :-1 s=READY pgs=432 cs=0 l=1 rx=0x7fe7a4063c70 tx=0x7fe7a40635c0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:35.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.045+0000 7fe7a8ada700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7a405f110 0x7fe7a413f2a0 secure :-1 s=THROTTLE_DONE pgs=1085 cs=0 l=1 rx=0x7fe7980030b0 tx=0x7fe798010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:35.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.045+0000 7fe7a1ffb700 1 -- 172.21.15.63:0/4191615227 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe79803e4b0 con 0x7fe7a405f110 2020-05-18T21:31:35.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.193+0000 7fe7a9adc700 1 -- 172.21.15.63:0/4191615227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7a40569e0 con 0x7fe7a405f110 2020-05-18T21:31:35.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.197+0000 7fe7a8ada700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7a405f110 0x7fe7a413f2a0 secure :-1 s=THROTTLE_DONE pgs=1085 cs=0 l=1 rx=0x7fe7980030b0 tx=0x7fe798010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:35.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.197+0000 7fe7a1ffb700 1 -- 172.21.15.63:0/4191615227 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+2137 (secure 0 0 0) 0x7fe798041ad0 con 0x7fe7a405f110 2020-05-18T21:31:35.201 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:35.201 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":53,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/249786226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":249786226},{"type":"v1","addr":"172.21.15.63:6833","nonce":249786226}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":51}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:31:31.212807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7242":{"gid":7242,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/578144386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":578144386},{"type":"v1","addr":"172.21.15.155:6835","nonce":578144386}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:31:35.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.197+0000 7fe7a9adc700 1 -- 172.21.15.63:0/4191615227 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe78404f8e0 msgr2=0x7fe784051da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:35.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.197+0000 7fe7a9adc700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe78404f8e0 0x7fe784051da0 secure :-1 s=READY pgs=432 cs=0 l=1 rx=0x7fe7a4063c70 tx=0x7fe7a40635c0).stop 2020-05-18T21:31:35.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.197+0000 7fe7a9adc700 1 -- 172.21.15.63:0/4191615227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7a405f110 msgr2=0x7fe7a413f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:35.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.197+0000 7fe7a9adc700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7a405f110 0x7fe7a413f2a0 secure :-1 s=READY pgs=1085 cs=0 l=1 rx=0x7fe7980030b0 tx=0x7fe798010cd0).stop 2020-05-18T21:31:35.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.197+0000 7fe7a9adc700 1 -- 172.21.15.63:0/4191615227 shutdown_connections 2020-05-18T21:31:35.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.197+0000 7fe7a9adc700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe78404f8e0 0x7fe784051da0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:35.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.197+0000 7fe7a9adc700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7a4064d20 0x7fe7a413f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:35.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.197+0000 7fe7a9adc700 1 --2- 172.21.15.63:0/4191615227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7a405f110 0x7fe7a413f2a0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:35.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.197+0000 7fe7a9adc700 1 -- 172.21.15.63:0/4191615227 >> 172.21.15.63:0/4191615227 conn(0x7fe7a4069fc0 msgr2=0x7fe7a414d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:35.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.197+0000 7fe7a9adc700 1 -- 172.21.15.63:0/4191615227 shutdown_connections 2020-05-18T21:31:35.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:35.197+0000 7fe7a9adc700 1 -- 172.21.15.63:0/4191615227 wait complete. 2020-05-18T21:31:35.205 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 53 2020-05-18T21:31:35.415 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:31:31.212807+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7242}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7242': {'gid': 7242, 'name': 'b', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6835/578144386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 578144386}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 578144386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:31:35.416 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:31:35.416 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:31:35.538 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:31:35.539 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:31:35.539 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2020-05-18T21:31:35.539 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 7242, 2020-05-18T21:31:35.540 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:31:35.540 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:31:35.540 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 5.3248877429999997, 2020-05-18T21:31:35.540 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 53, 2020-05-18T21:31:35.540 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 84, 2020-05-18T21:31:35.541 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 83, 2020-05-18T21:31:35.541 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 9.6329451240000008 2020-05-18T21:31:35.541 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:31:35.548 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 7242, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.3248877429999997, "mdsmap_epoch": 53, "osdmap_epoch": 84, "osdmap_epoch_barrier": 83, "uptime": 9.6329451240000008 } 2020-05-18T21:31:35.548 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:31:35.549 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:31:35.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:35.550 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:31:35.565 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:31:35.566 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:31:35.566 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:31:35.566 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:35.566 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:31:35.566 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:35.567 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:31:35.567 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:35.567 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:31:35.567 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:35.567 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:31:35.568 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:35.568 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:31:35.568 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:35.568 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:31:35.568 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42547sec preferred_lft 42547sec 2020-05-18T21:31:35.569 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:31:35.569 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:35.569 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:31:35.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:35.570 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:31:35.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:35.641 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:31:35.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:35.662 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:31:35.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:35.730 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:31:35.747 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:31:35.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:35.749 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:31:35.800 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:31:35.801 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:31:35.801 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:31:35.803 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:31:35.803 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:31:35.803 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:31:35.803 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:31:35.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:35.804 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:31:35.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:35.825 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:31:35.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:35.839 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:31:35.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:35.900 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:31:35.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:35.907 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:31:35.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:35.956 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:31:35.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:35.976 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-05-18T21:31:36.037 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-05-18T21:31:36.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:36.038 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-05-18T21:31:36.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:36.055 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:31:36.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:36.076 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-05-18T21:31:36.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:36.145 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-05-18T21:31:36.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:36.160 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-05-18T21:31:36.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:36.175 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 up' 2020-05-18T21:31:36.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:36.234 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.0 master ceph-brx' 2020-05-18T21:31:36.253 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-05-18T21:31:36.253 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-05-18T21:31:36.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:31:36.254 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:31:36.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:31:36.261 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:31:36.318 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:31:36.319 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:31:36.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:31:36.320 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:31:36.327 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:31:36.328 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:31:36.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:31:36.331 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:31:36.345 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:31:36.346 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:31:36.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:31:36.347 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:31:36.415 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2020-05-18T21:31:36.409+0000 7fdb0641a080 -1 init, newargv = 0x557c7a3b0530 newargc=9 2020-05-18T21:31:36.416 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[26642]: starting ceph client 2020-05-18T21:31:36.426 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[26642]: starting fuse 2020-05-18T21:31:37.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:31:37.497 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:31:37.515 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:31:37.516 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:31:37.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:31:37.518 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:31:37.566 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:31:37.567 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:31:37.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:31:37.568 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:31:37.568 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:31:37.569 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:31:37.569 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:31:37.570 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:31:37.570 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:31:37.571 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:31:37.571 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:31:37.572 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:31:37.572 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:31:37.573 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:31:37.573 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:31:37.574 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:31:37.574 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:31:37.574 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:31:37.575 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:31:37.575 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:31:37.576 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:31:37.576 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:31:37.577 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:31:37.577 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:31:37.577 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:31:37.578 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:31:37.624 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.26642.asok 2020-05-18T21:31:37.628 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.26642.asok 2020-05-18T21:31:37.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:31:37.630 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.26642.asok status 2020-05-18T21:31:37.719 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:37.719 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:31:37.719 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:31:37.719 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:31:37.720 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:31:37.720 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:31:37.720 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:31:37.720 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "26642", 2020-05-18T21:31:37.721 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:31:37.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:37.721 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:31:37.721 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:31:37.722 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 7434, 2020-05-18T21:31:37.722 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:31:37.722 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:31:37.722 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:31:37.722 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 7434 2020-05-18T21:31:37.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:37.723 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:31:37.723 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:37.723 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:31:37.723 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3861080366 2020-05-18T21:31:37.724 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:37.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:37.724 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:31:37.724 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:31:37.724 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:31:37.724 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3861080366 2020-05-18T21:31:37.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:37.735 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.7434 192.168.0.1:0/3861080366", 2020-05-18T21:31:37.736 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/3861080366", 2020-05-18T21:31:37.736 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:31:37.736 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 53, 2020-05-18T21:31:37.736 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 84, 2020-05-18T21:31:37.736 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:31:37.736 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:31:37.737 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:37.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:31:37.738 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:31:37.739 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:31:37.747 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:31:37.748 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-05-18T21:31:37.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:31:37.749 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:31:37.766 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs max_mds 2 2020-05-18T21:31:37.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.873+0000 7fb32a716700 1 Processor -- start 2020-05-18T21:31:37.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.873+0000 7fb32a716700 1 -- start start 2020-05-18T21:31:37.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb32a716700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb324061180 0x7fb32406a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:37.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb32a716700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b2eb0 0x7fb3240b3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:37.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb32a716700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb32406a7d0 con 0x7fb3240b4f40 2020-05-18T21:31:37.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb32a716700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3240b2a10 con 0x7fb324061180 2020-05-18T21:31:37.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb32a716700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3240b5320 con 0x7fb3240b2eb0 2020-05-18T21:31:37.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb329714700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb3240b4f40 0x7fb324132360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60718/0 (socket says 172.21.15.63:60718) 2020-05-18T21:31:37.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb329714700 1 -- 172.21.15.63:0/2427075806 learned_addr learned my addr 172.21.15.63:0/2427075806 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:37.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb328f13700 1 --2- 172.21.15.63:0/2427075806 >> v2:172.21.15.63:3300/0 conn(0x7fb324061180 0x7fb32406a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:37.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb329f15700 1 --2- 172.21.15.63:0/2427075806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b2eb0 0x7fb3240b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:37.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb31bfff700 1 -- 172.21.15.63:0/2427075806 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662249650 0 0) 0x7fb32406a7d0 con 0x7fb3240b4f40 2020-05-18T21:31:37.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb31bfff700 1 -- 172.21.15.63:0/2427075806 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb308003270 con 0x7fb3240b4f40 2020-05-18T21:31:37.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb328f13700 1 -- 172.21.15.63:0/2427075806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b2eb0 msgr2=0x7fb3240b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:37.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb328f13700 1 --2- 172.21.15.63:0/2427075806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b2eb0 0x7fb3240b3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:37.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb328f13700 1 -- 172.21.15.63:0/2427075806 >> v1:172.21.15.63:6789/0 conn(0x7fb3240b4f40 legacy=0x7fb324132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:37.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb328f13700 1 -- 172.21.15.63:0/2427075806 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3241337f0 con 0x7fb324061180 2020-05-18T21:31:37.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb328f13700 1 --2- 172.21.15.63:0/2427075806 >> v2:172.21.15.63:3300/0 conn(0x7fb324061180 0x7fb32406a2c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb314002f70 tx=0x7fb314007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:37.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb328f13700 1 --2- 172.21.15.63:0/2427075806 >> v2:172.21.15.63:3300/0 conn(0x7fb324061180 0x7fb32406a2c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb314002f70 tx=0x7fb314007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:37.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb328f13700 1 --2- 172.21.15.63:0/2427075806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb324061180 0x7fb32406a2c0 secure :-1 s=READY pgs=1090 cs=0 l=1 rx=0x7fb314002f70 tx=0x7fb314007a80).ready entity=mon.0 client_cookie=6deaa9995aa04bdd server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:37.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb328f13700 1 --2- 172.21.15.63:0/2427075806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb324061180 0x7fb32406a2c0 secure :-1 s=THROTTLE_DONE pgs=1090 cs=0 l=1 rx=0x7fb314002f70 tx=0x7fb314007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:37.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb328f13700 1 --2- 172.21.15.63:0/2427075806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb324061180 0x7fb32406a2c0 secure :-1 s=THROTTLE_DONE pgs=1090 cs=0 l=1 rx=0x7fb314002f70 tx=0x7fb314007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:37.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb31bfff700 1 -- 172.21.15.63:0/2427075806 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb314008e80 con 0x7fb324061180 2020-05-18T21:31:37.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb328f13700 1 --2- 172.21.15.63:0/2427075806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb324061180 0x7fb32406a2c0 secure :-1 s=THROTTLE_DONE pgs=1090 cs=0 l=1 rx=0x7fb314002f70 tx=0x7fb314007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:37.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb31bfff700 1 -- 172.21.15.63:0/2427075806 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3140115f0 con 0x7fb324061180 2020-05-18T21:31:37.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb31bfff700 1 -- 172.21.15.63:0/2427075806 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb314011a10 con 0x7fb324061180 2020-05-18T21:31:37.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb32a716700 1 -- 172.21.15.63:0/2427075806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb324061180 msgr2=0x7fb32406a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:37.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb32a716700 1 --2- 172.21.15.63:0/2427075806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb324061180 0x7fb32406a2c0 secure :-1 s=READY pgs=1090 cs=0 l=1 rx=0x7fb314002f70 tx=0x7fb314007a80).stop 2020-05-18T21:31:37.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb32a716700 1 -- 172.21.15.63:0/2427075806 shutdown_connections 2020-05-18T21:31:37.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb32a716700 1 --2- 172.21.15.63:0/2427075806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b2eb0 0x7fb3240b3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:37.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb32a716700 1 --2- 172.21.15.63:0/2427075806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb324061180 0x7fb32406a2c0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:37.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb32a716700 1 -- 172.21.15.63:0/2427075806 >> 172.21.15.63:0/2427075806 conn(0x7fb32405fbd0 msgr2=0x7fb324069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:37.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb32a716700 1 -- 172.21.15.63:0/2427075806 shutdown_connections 2020-05-18T21:31:37.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.877+0000 7fb32a716700 1 -- 172.21.15.63:0/2427075806 wait complete. 2020-05-18T21:31:37.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb32a716700 1 Processor -- start 2020-05-18T21:31:37.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb32a716700 1 -- start start 2020-05-18T21:31:37.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb32a716700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b2eb0 0x7fb32414db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:37.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb32a716700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb3240b4f40 0x7fb3240ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:37.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb32a716700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb324157590 con 0x7fb324061180 2020-05-18T21:31:37.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb32a716700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb324157830 con 0x7fb3240b4f40 2020-05-18T21:31:37.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb32a716700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3240ac930 con 0x7fb3240b2eb0 2020-05-18T21:31:37.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb329714700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb324061180 0x7fb324157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60724/0 (socket says 172.21.15.63:60724) 2020-05-18T21:31:37.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb329714700 1 -- 172.21.15.63:0/3056219927 learned_addr learned my addr 172.21.15.63:0/3056219927 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:37.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb328f13700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b2eb0 0x7fb32414db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:37.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb329f15700 1 --2- 172.21.15.63:0/3056219927 >> v2:172.21.15.155:3300/0 conn(0x7fb3240b4f40 0x7fb3240ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:37.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb31a7fc700 1 -- 172.21.15.63:0/3056219927 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487261422 0 0) 0x7fb324157590 con 0x7fb324061180 2020-05-18T21:31:37.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb31a7fc700 1 -- 172.21.15.63:0/3056219927 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb30c002fe0 con 0x7fb324061180 2020-05-18T21:31:37.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb31a7fc700 1 -- 172.21.15.63:0/3056219927 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2809282490 0 0) 0x7fb30c002fe0 con 0x7fb324061180 2020-05-18T21:31:37.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb31a7fc700 1 -- 172.21.15.63:0/3056219927 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb324157590 con 0x7fb324061180 2020-05-18T21:31:37.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb31a7fc700 1 -- 172.21.15.63:0/3056219927 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fb3200018c0 con 0x7fb324061180 2020-05-18T21:31:37.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb31a7fc700 1 -- 172.21.15.63:0/3056219927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b2eb0 msgr2=0x7fb32414db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:37.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb31a7fc700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b2eb0 0x7fb32414db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:37.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb31a7fc700 1 -- 172.21.15.63:0/3056219927 >> v2:172.21.15.155:3300/0 conn(0x7fb3240b4f40 msgr2=0x7fb3240ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:37.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb31a7fc700 1 --2- 172.21.15.63:0/3056219927 >> v2:172.21.15.155:3300/0 conn(0x7fb3240b4f40 0x7fb3240ac4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:37.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb31a7fc700 1 -- 172.21.15.63:0/3056219927 >> v1:172.21.15.63:6789/0 conn(0x7fb324061180 legacy=0x7fb324157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:37.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb31a7fc700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b2eb0 0x7fb30c004a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:37.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb31a7fc700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb30c004ee0 0x7fb30c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:37.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb31a7fc700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb30c003e00 0x7fb30c004280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:37.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb31a7fc700 1 -- 172.21.15.63:0/3056219927 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb324157830 con 0x7fb30c003e00 2020-05-18T21:31:37.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb31a7fc700 1 -- 172.21.15.63:0/3056219927 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3240ac930 con 0x7fb30c004ee0 2020-05-18T21:31:37.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb31a7fc700 1 -- 172.21.15.63:0/3056219927 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c0053f0 con 0x7fb3240b2eb0 2020-05-18T21:31:37.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb329f15700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb30c003e00 0x7fb30c004280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:37.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb329714700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b2eb0 0x7fb30c004a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:37.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.881+0000 7fb328f13700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb30c004ee0 0x7fb30c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:37.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb329f15700 1 -- 172.21.15.63:0/3056219927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b2eb0 msgr2=0x7fb30c004a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:37.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb329f15700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b2eb0 0x7fb30c004a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:37.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb329f15700 1 -- 172.21.15.63:0/3056219927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb30c004ee0 msgr2=0x7fb30c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:37.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb329f15700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb30c004ee0 0x7fb30c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:37.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb329f15700 1 -- 172.21.15.63:0/3056219927 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb324157220 con 0x7fb30c003e00 2020-05-18T21:31:37.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb32a716700 1 -- 172.21.15.63:0/3056219927 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3240657e0 con 0x7fb30c003e00 2020-05-18T21:31:37.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb329f15700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb30c003e00 0x7fb30c004280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb31c0032f0 tx=0x7fb31c0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:37.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb32a716700 1 -- 172.21.15.63:0/3056219927 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32414dda0 con 0x7fb30c003e00 2020-05-18T21:31:37.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb329f15700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb30c003e00 0x7fb30c004280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb31c0032f0 tx=0x7fb31c0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:37.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb329f15700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb30c003e00 0x7fb30c004280 secure :-1 s=READY pgs=1092 cs=0 l=1 rx=0x7fb31c0032f0 tx=0x7fb31c0111b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:37.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb329f15700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb30c003e00 0x7fb30c004280 secure :-1 s=THROTTLE_DONE pgs=1092 cs=0 l=1 rx=0x7fb31c0032f0 tx=0x7fb31c0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:37.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb329f15700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb30c003e00 0x7fb30c004280 secure :-1 s=THROTTLE_DONE pgs=1092 cs=0 l=1 rx=0x7fb31c0032f0 tx=0x7fb31c0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:37.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb31a7fc700 1 -- 172.21.15.63:0/3056219927 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb31c011a30 con 0x7fb30c003e00 2020-05-18T21:31:37.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb329f15700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb30c003e00 0x7fb30c004280 secure :-1 s=THROTTLE_DONE pgs=1092 cs=0 l=1 rx=0x7fb31c0032f0 tx=0x7fb31c0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:37.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb31a7fc700 1 -- 172.21.15.63:0/3056219927 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c011b90 con 0x7fb30c003e00 2020-05-18T21:31:37.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb31a7fc700 1 -- 172.21.15.63:0/3056219927 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb31c006080 con 0x7fb30c003e00 2020-05-18T21:31:37.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb329f15700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb30c003e00 0x7fb30c004280 secure :-1 s=THROTTLE_DONE pgs=1092 cs=0 l=1 rx=0x7fb31c0032f0 tx=0x7fb31c0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:37.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb31a7fc700 1 -- 172.21.15.63:0/3056219927 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb31c0061e0 con 0x7fb30c003e00 2020-05-18T21:31:37.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb329f15700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb30c003e00 0x7fb30c004280 secure :-1 s=THROTTLE_DONE pgs=1092 cs=0 l=1 rx=0x7fb31c0032f0 tx=0x7fb31c0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:37.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb32a716700 1 -- 172.21.15.63:0/3056219927 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb300003380 con 0x7fb30c003e00 2020-05-18T21:31:37.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb31a7fc700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb30c057a80 0x7fb30c059f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:37.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb31a7fc700 1 -- 172.21.15.63:0/3056219927 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb31c0640f0 con 0x7fb30c003e00 2020-05-18T21:31:37.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb329714700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb30c057a80 0x7fb30c059f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:37.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.885+0000 7fb329714700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb30c057a80 0x7fb30c059f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb320005580 tx=0x7fb320005620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:37.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.889+0000 7fb329714700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb30c057a80 0x7fb30c059f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb320005580 tx=0x7fb320005620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:37.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.889+0000 7fb329714700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb30c057a80 0x7fb30c059f40 secure :-1 s=READY pgs=433 cs=0 l=1 rx=0x7fb320005580 tx=0x7fb320005620).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:37.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.893+0000 7fb329f15700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb30c003e00 0x7fb30c004280 secure :-1 s=THROTTLE_DONE pgs=1092 cs=0 l=1 rx=0x7fb31c0032f0 tx=0x7fb31c0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:37.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:37.893+0000 7fb31a7fc700 1 -- 172.21.15.63:0/3056219927 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb31c03e540 con 0x7fb30c003e00 2020-05-18T21:31:38.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.045+0000 7fb32a716700 1 -- 172.21.15.63:0/3056219927 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fb300002240 con 0x7fb30c003e00 2020-05-18T21:31:38.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.169+0000 7fb329f15700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb30c003e00 0x7fb30c004280 secure :-1 s=THROTTLE_DONE pgs=1092 cs=0 l=1 rx=0x7fb31c0032f0 tx=0x7fb31c0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:38.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.169+0000 7fb31a7fc700 1 -- 172.21.15.63:0/3056219927 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v54) v1 ==== 105+0+0 (secure 0 0 0) 0x7fb31c041b60 con 0x7fb30c003e00 2020-05-18T21:31:38.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.173+0000 7fb32a716700 1 -- 172.21.15.63:0/3056219927 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb30c057a80 msgr2=0x7fb30c059f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:38.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.173+0000 7fb32a716700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb30c057a80 0x7fb30c059f40 secure :-1 s=READY pgs=433 cs=0 l=1 rx=0x7fb320005580 tx=0x7fb320005620).stop 2020-05-18T21:31:38.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.173+0000 7fb32a716700 1 -- 172.21.15.63:0/3056219927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb30c003e00 msgr2=0x7fb30c004280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:38.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.173+0000 7fb32a716700 1 --2- 172.21.15.63:0/3056219927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb30c003e00 0x7fb30c004280 secure :-1 s=READY pgs=1092 cs=0 l=1 rx=0x7fb31c0032f0 tx=0x7fb31c0111b0).stop 2020-05-18T21:31:38.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.173+0000 7fb329f15700 1 -- 172.21.15.63:0/3056219927 reap_dead start 2020-05-18T21:31:38.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.173+0000 7fb329f15700 1 -- 172.21.15.63:0/3056219927 reap_dead start 2020-05-18T21:31:38.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.173+0000 7fb32a716700 1 -- 172.21.15.63:0/3056219927 shutdown_connections 2020-05-18T21:31:38.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.173+0000 7fb32a716700 1 -- 172.21.15.63:0/3056219927 >> 172.21.15.63:0/3056219927 conn(0x7fb32405fbd0 msgr2=0x7fb3241306d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:38.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.173+0000 7fb32a716700 1 -- 172.21.15.63:0/3056219927 shutdown_connections 2020-05-18T21:31:38.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.173+0000 7fb32a716700 1 -- 172.21.15.63:0/3056219927 wait complete. 2020-05-18T21:31:38.197 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:38.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.285+0000 7fc1cffff700 1 Processor -- start 2020-05-18T21:31:38.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.285+0000 7fc1cffff700 1 -- start start 2020-05-18T21:31:38.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc1d0143690 0x7fc1d0146b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:38.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d0146180 con 0x7fc1d005b160 2020-05-18T21:31:38.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d0146420 con 0x7fc1d0066200 2020-05-18T21:31:38.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cffff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d0146fc0 con 0x7fc1d0143690 2020-05-18T21:31:38.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cf7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc1d0143690 0x7fc1d0146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:38.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1ce7fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc1d005b160 0x7fc1d00b3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60750/0 (socket says 172.21.15.63:60750) 2020-05-18T21:31:38.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1ce7fc700 1 -- 172.21.15.63:0/2304843638 learned_addr learned my addr 172.21.15.63:0/2304843638 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:38.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cf7fe700 1 -- 172.21.15.63:0/2304843638 >> v1:172.21.15.155:6789/0 conn(0x7fc1d0066200 legacy=0x7fc1d0142f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:38.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cf7fe700 1 -- 172.21.15.63:0/2304843638 >> v1:172.21.15.63:6789/0 conn(0x7fc1d005b160 legacy=0x7fc1d00b3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:38.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cdffb700 1 -- 172.21.15.63:0/2304843638 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904885167 0 0) 0x7fc1d0146180 con 0x7fc1d005b160 2020-05-18T21:31:38.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cf7fe700 1 -- 172.21.15.63:0/2304843638 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d01466c0 con 0x7fc1d0143690 2020-05-18T21:31:38.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cf7fe700 1 --2- 172.21.15.63:0/2304843638 >> v2:172.21.15.63:3300/0 conn(0x7fc1d0143690 0x7fc1d0146b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc1c80032f0 tx=0x7fc1c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:38.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cf7fe700 1 --2- 172.21.15.63:0/2304843638 >> v2:172.21.15.63:3300/0 conn(0x7fc1d0143690 0x7fc1d0146b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc1c80032f0 tx=0x7fc1c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:38.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cf7fe700 1 --2- 172.21.15.63:0/2304843638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1d0143690 0x7fc1d0146b60 secure :-1 s=READY pgs=1094 cs=0 l=1 rx=0x7fc1c80032f0 tx=0x7fc1c8007e00).ready entity=mon.0 client_cookie=885a85833c7ef846 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:38.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cf7fe700 1 --2- 172.21.15.63:0/2304843638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1d0143690 0x7fc1d0146b60 secure :-1 s=THROTTLE_DONE pgs=1094 cs=0 l=1 rx=0x7fc1c80032f0 tx=0x7fc1c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:38.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cdffb700 1 -- 172.21.15.63:0/2304843638 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1c800a180 con 0x7fc1d0143690 2020-05-18T21:31:38.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cf7fe700 1 --2- 172.21.15.63:0/2304843638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1d0143690 0x7fc1d0146b60 secure :-1 s=THROTTLE_DONE pgs=1094 cs=0 l=1 rx=0x7fc1c80032f0 tx=0x7fc1c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:38.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cdffb700 1 -- 172.21.15.63:0/2304843638 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c800a2e0 con 0x7fc1d0143690 2020-05-18T21:31:38.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cf7fe700 1 --2- 172.21.15.63:0/2304843638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1d0143690 0x7fc1d0146b60 secure :-1 s=THROTTLE_DONE pgs=1094 cs=0 l=1 rx=0x7fc1c80032f0 tx=0x7fc1c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:38.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cdffb700 1 -- 172.21.15.63:0/2304843638 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1c800a700 con 0x7fc1d0143690 2020-05-18T21:31:38.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cffff700 1 -- 172.21.15.63:0/2304843638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1d0143690 msgr2=0x7fc1d0146b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:38.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cffff700 1 --2- 172.21.15.63:0/2304843638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1d0143690 0x7fc1d0146b60 secure :-1 s=READY pgs=1094 cs=0 l=1 rx=0x7fc1c80032f0 tx=0x7fc1c8007e00).stop 2020-05-18T21:31:38.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cffff700 1 -- 172.21.15.63:0/2304843638 shutdown_connections 2020-05-18T21:31:38.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cffff700 1 --2- 172.21.15.63:0/2304843638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1d0143690 0x7fc1d0146b60 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:38.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cffff700 1 -- 172.21.15.63:0/2304843638 >> 172.21.15.63:0/2304843638 conn(0x7fc1d0066d00 msgr2=0x7fc1d00b9590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:38.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cffff700 1 -- 172.21.15.63:0/2304843638 shutdown_connections 2020-05-18T21:31:38.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.289+0000 7fc1cffff700 1 -- 172.21.15.63:0/2304843638 wait complete. 2020-05-18T21:31:38.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.293+0000 7fc1cffff700 1 Processor -- start 2020-05-18T21:31:38.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.293+0000 7fc1cffff700 1 -- start start 2020-05-18T21:31:38.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.293+0000 7fc1cffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0143690 0x7fc1d012e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:38.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.293+0000 7fc1cffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d0153690 con 0x7fc1d0066200 2020-05-18T21:31:38.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.293+0000 7fc1cffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d00b2560 con 0x7fc1d005b160 2020-05-18T21:31:38.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.293+0000 7fc1cffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d00b2aa0 con 0x7fc1d0143690 2020-05-18T21:31:38.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.293+0000 7fc1ce7fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc1d0066200 0x7fc1d00acc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60756/0 (socket says 172.21.15.63:60756) 2020-05-18T21:31:38.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.293+0000 7fc1ce7fc700 1 -- 172.21.15.63:0/2505105388 learned_addr learned my addr 172.21.15.63:0/2505105388 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:38.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.293+0000 7fc1cf7fe700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0143690 0x7fc1d012e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:38.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.293+0000 7fc1bffff700 1 -- 172.21.15.63:0/2505105388 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39363345 0 0) 0x7fc1d0153690 con 0x7fc1d0066200 2020-05-18T21:31:38.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.293+0000 7fc1bffff700 1 -- 172.21.15.63:0/2505105388 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1ac002fe0 con 0x7fc1d0066200 2020-05-18T21:31:38.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.293+0000 7fc1bffff700 1 -- 172.21.15.63:0/2505105388 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525040578 0 0) 0x7fc1d00b2560 con 0x7fc1d005b160 2020-05-18T21:31:38.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.293+0000 7fc1bffff700 1 -- 172.21.15.63:0/2505105388 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1d0153690 con 0x7fc1d005b160 2020-05-18T21:31:38.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.293+0000 7fc1cf7fe700 1 -- 172.21.15.63:0/2505105388 >> v1:172.21.15.155:6789/0 conn(0x7fc1d005b160 legacy=0x7fc1d0153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:38.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.293+0000 7fc1cf7fe700 1 -- 172.21.15.63:0/2505105388 >> v1:172.21.15.63:6789/0 conn(0x7fc1d0066200 legacy=0x7fc1d00acc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:38.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.293+0000 7fc1cf7fe700 1 -- 172.21.15.63:0/2505105388 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d00b2800 con 0x7fc1d0143690 2020-05-18T21:31:38.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.293+0000 7fc1cf7fe700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0143690 0x7fc1d012e4f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc1c80032f0 tx=0x7fc1c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:38.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.297+0000 7fc1cf7fe700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0143690 0x7fc1d012e4f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc1c80032f0 tx=0x7fc1c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:38.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.297+0000 7fc1cf7fe700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0143690 0x7fc1d012e4f0 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7fc1c80032f0 tx=0x7fc1c8007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:38.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.297+0000 7fc1cf7fe700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0143690 0x7fc1d012e4f0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fc1c80032f0 tx=0x7fc1c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:38.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.297+0000 7fc1bffff700 1 -- 172.21.15.63:0/2505105388 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1c8005c70 con 0x7fc1d0143690 2020-05-18T21:31:38.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.297+0000 7fc1cf7fe700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0143690 0x7fc1d012e4f0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fc1c80032f0 tx=0x7fc1c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:38.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.297+0000 7fc1bffff700 1 -- 172.21.15.63:0/2505105388 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c8005dd0 con 0x7fc1d0143690 2020-05-18T21:31:38.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.297+0000 7fc1cf7fe700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0143690 0x7fc1d012e4f0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fc1c80032f0 tx=0x7fc1c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:38.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.297+0000 7fc1cffff700 1 -- 172.21.15.63:0/2505105388 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d0154200 con 0x7fc1d0143690 2020-05-18T21:31:38.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.297+0000 7fc1bffff700 1 -- 172.21.15.63:0/2505105388 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1c800f7a0 con 0x7fc1d0143690 2020-05-18T21:31:38.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.297+0000 7fc1cffff700 1 -- 172.21.15.63:0/2505105388 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d00ad4f0 con 0x7fc1d0143690 2020-05-18T21:31:38.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.297+0000 7fc1cffff700 1 -- 172.21.15.63:0/2505105388 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d00569e0 con 0x7fc1d0143690 2020-05-18T21:31:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.297+0000 7fc1cf7fe700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0143690 0x7fc1d012e4f0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fc1c80032f0 tx=0x7fc1c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.297+0000 7fc1bffff700 1 -- 172.21.15.63:0/2505105388 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc1c800f9a0 con 0x7fc1d0143690 2020-05-18T21:31:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.297+0000 7fc1cf7fe700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0143690 0x7fc1d012e4f0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fc1c80032f0 tx=0x7fc1c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.297+0000 7fc1bffff700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1ac04fea0 0x7fc1ac052360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.297+0000 7fc1bffff700 1 -- 172.21.15.63:0/2505105388 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc1c8064c80 con 0x7fc1d0143690 2020-05-18T21:31:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.297+0000 7fc1ceffd700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1ac04fea0 0x7fc1ac052360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.301+0000 7fc1ceffd700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1ac04fea0 0x7fc1ac052360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc1c0001040 tx=0x7fc1c00026f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.301+0000 7fc1ceffd700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1ac04fea0 0x7fc1ac052360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc1c0001040 tx=0x7fc1c00026f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.301+0000 7fc1ceffd700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1ac04fea0 0x7fc1ac052360 secure :-1 s=READY pgs=434 cs=0 l=1 rx=0x7fc1c0001040 tx=0x7fc1c00026f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:38.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.305+0000 7fc1cf7fe700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0143690 0x7fc1d012e4f0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fc1c80032f0 tx=0x7fc1c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:38.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.305+0000 7fc1bffff700 1 -- 172.21.15.63:0/2505105388 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc1c803f070 con 0x7fc1d0143690 2020-05-18T21:31:38.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.461+0000 7fc1cffff700 1 -- 172.21.15.63:0/2505105388 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1d00ad4f0 con 0x7fc1d0143690 2020-05-18T21:31:38.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.461+0000 7fc1cf7fe700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0143690 0x7fc1d012e4f0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fc1c80032f0 tx=0x7fc1c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:38.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.461+0000 7fc1bffff700 1 -- 172.21.15.63:0/2505105388 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+2154 (secure 0 0 0) 0x7fc1d00ad4f0 con 0x7fc1d0143690 2020-05-18T21:31:38.467 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:38.467 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:31:38.174653+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7242,"mds_1":7236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7236":{"gid":7236,"name":"a","rank":1,"incarnation":55,"state":"up:creating","state_seq":2,"addr":"172.21.15.63:6833/249786226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":249786226},{"type":"v1","addr":"172.21.15.63:6833","nonce":249786226}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_7242":{"gid":7242,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/578144386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":578144386},{"type":"v1","addr":"172.21.15.155:6835","nonce":578144386}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:31:38.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.465+0000 7fc1cffff700 1 -- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1ac04fea0 msgr2=0x7fc1ac052360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:38.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.465+0000 7fc1cffff700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1ac04fea0 0x7fc1ac052360 secure :-1 s=READY pgs=434 cs=0 l=1 rx=0x7fc1c0001040 tx=0x7fc1c00026f0).stop 2020-05-18T21:31:38.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.465+0000 7fc1cffff700 1 -- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0143690 msgr2=0x7fc1d012e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:38.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.465+0000 7fc1cffff700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0143690 0x7fc1d012e4f0 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7fc1c80032f0 tx=0x7fc1c8007e00).stop 2020-05-18T21:31:38.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.465+0000 7fc1cffff700 1 -- 172.21.15.63:0/2505105388 shutdown_connections 2020-05-18T21:31:38.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.465+0000 7fc1cffff700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc1ac04fea0 0x7fc1ac052360 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:38.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.465+0000 7fc1cffff700 1 --2- 172.21.15.63:0/2505105388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0143690 0x7fc1d012e4f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:38.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.465+0000 7fc1cffff700 1 -- 172.21.15.63:0/2505105388 >> 172.21.15.63:0/2505105388 conn(0x7fc1d0066d00 msgr2=0x7fc1d012f030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:38.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.465+0000 7fc1cffff700 1 -- 172.21.15.63:0/2505105388 shutdown_connections 2020-05-18T21:31:38.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:38.465+0000 7fc1cffff700 1 -- 172.21.15.63:0/2505105388 wait complete. 2020-05-18T21:31:38.472 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 55 2020-05-18T21:31:38.482 DEBUG:tasks.ceph_test_case:wait_until_equal: 1 != 2, waiting (timeout=30)... 2020-05-18T21:31:43.484 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:43.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.589+0000 7f5cd7a12700 1 Processor -- start 2020-05-18T21:31:43.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd7a12700 1 -- start start 2020-05-18T21:31:43.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd7a12700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5cd0060b90 0x7f5cd00b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:43.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd7a12700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0146c90 0x7f5cd00624a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:43.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd7a12700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd0061870 con 0x7f5cd0062900 2020-05-18T21:31:43.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd7a12700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd0061d60 con 0x7f5cd0060b90 2020-05-18T21:31:43.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd7a12700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd0062000 con 0x7f5cd0146c90 2020-05-18T21:31:43.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd57ae700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5cd0060b90 0x7f5cd00b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:43.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd5faf700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5cd0062900 0x7f5cd00b2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60768/0 (socket says 172.21.15.63:60768) 2020-05-18T21:31:43.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd5faf700 1 -- 172.21.15.63:0/4123932656 learned_addr learned my addr 172.21.15.63:0/4123932656 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:43.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd4fad700 1 --2- 172.21.15.63:0/4123932656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0146c90 0x7f5cd00624a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:43.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cc3fff700 1 -- 172.21.15.63:0/4123932656 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421475966 0 0) 0x7f5cd0061870 con 0x7f5cd0062900 2020-05-18T21:31:43.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cc3fff700 1 -- 172.21.15.63:0/4123932656 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cb8003270 con 0x7f5cd0062900 2020-05-18T21:31:43.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd57ae700 1 -- 172.21.15.63:0/4123932656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0146c90 msgr2=0x7f5cd00624a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:43.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd57ae700 1 --2- 172.21.15.63:0/4123932656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0146c90 0x7f5cd00624a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:43.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd57ae700 1 -- 172.21.15.63:0/4123932656 >> v1:172.21.15.63:6789/0 conn(0x7f5cd0062900 legacy=0x7f5cd00b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:43.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd57ae700 1 -- 172.21.15.63:0/4123932656 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd0147210 con 0x7f5cd0060b90 2020-05-18T21:31:43.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd4fad700 1 --2- 172.21.15.63:0/4123932656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0146c90 0x7f5cd00624a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:31:43.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd57ae700 1 --2- 172.21.15.63:0/4123932656 >> v2:172.21.15.63:3300/0 conn(0x7f5cd0060b90 0x7f5cd00b3f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5cc4002f70 tx=0x7f5cc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd57ae700 1 --2- 172.21.15.63:0/4123932656 >> v2:172.21.15.63:3300/0 conn(0x7f5cd0060b90 0x7f5cd00b3f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5cc4002f70 tx=0x7f5cc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd57ae700 1 --2- 172.21.15.63:0/4123932656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cd0060b90 0x7f5cd00b3f70 secure :-1 s=READY pgs=1097 cs=0 l=1 rx=0x7f5cc4002f70 tx=0x7f5cc4007a80).ready entity=mon.0 client_cookie=1a8263dce2cb51ba server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:43.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd57ae700 1 --2- 172.21.15.63:0/4123932656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cd0060b90 0x7f5cd00b3f70 secure :-1 s=THROTTLE_DONE pgs=1097 cs=0 l=1 rx=0x7f5cc4002f70 tx=0x7f5cc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd57ae700 1 --2- 172.21.15.63:0/4123932656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cd0060b90 0x7f5cd00b3f70 secure :-1 s=THROTTLE_DONE pgs=1097 cs=0 l=1 rx=0x7f5cc4002f70 tx=0x7f5cc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cc3fff700 1 -- 172.21.15.63:0/4123932656 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cc4008d70 con 0x7f5cd0060b90 2020-05-18T21:31:43.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd57ae700 1 --2- 172.21.15.63:0/4123932656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cd0060b90 0x7f5cd00b3f70 secure :-1 s=THROTTLE_DONE pgs=1097 cs=0 l=1 rx=0x7f5cc4002f70 tx=0x7f5cc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cc3fff700 1 -- 172.21.15.63:0/4123932656 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc40116e0 con 0x7f5cd0060b90 2020-05-18T21:31:43.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cc3fff700 1 -- 172.21.15.63:0/4123932656 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cc4011b00 con 0x7f5cd0060b90 2020-05-18T21:31:43.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd7a12700 1 -- 172.21.15.63:0/4123932656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cd0060b90 msgr2=0x7f5cd00b3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:43.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.593+0000 7f5cd7a12700 1 --2- 172.21.15.63:0/4123932656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cd0060b90 0x7f5cd00b3f70 secure :-1 s=READY pgs=1097 cs=0 l=1 rx=0x7f5cc4002f70 tx=0x7f5cc4007a80).stop 2020-05-18T21:31:43.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.597+0000 7f5cd7a12700 1 -- 172.21.15.63:0/4123932656 shutdown_connections 2020-05-18T21:31:43.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.597+0000 7f5cd7a12700 1 --2- 172.21.15.63:0/4123932656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0146c90 0x7f5cd00624a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:43.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.597+0000 7f5cd7a12700 1 --2- 172.21.15.63:0/4123932656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cd0060b90 0x7f5cd00b3f70 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:43.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.597+0000 7f5cd7a12700 1 -- 172.21.15.63:0/4123932656 >> 172.21.15.63:0/4123932656 conn(0x7f5cd00b83d0 msgr2=0x7f5cd00b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:43.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.597+0000 7f5cd7a12700 1 -- 172.21.15.63:0/4123932656 shutdown_connections 2020-05-18T21:31:43.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.597+0000 7f5cd7a12700 1 -- 172.21.15.63:0/4123932656 wait complete. 2020-05-18T21:31:43.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.597+0000 7f5cd7a12700 1 Processor -- start 2020-05-18T21:31:43.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.597+0000 7f5cd7a12700 1 -- start start 2020-05-18T21:31:43.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd7a12700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0060b90 0x7f5cd0142de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:43.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd7a12700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5cd0146c90 0x7f5cd0065da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:43.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd7a12700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd0066200 con 0x7f5cd0062900 2020-05-18T21:31:43.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd7a12700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd0141c80 con 0x7f5cd0146c90 2020-05-18T21:31:43.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd7a12700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd01419e0 con 0x7f5cd0060b90 2020-05-18T21:31:43.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd4fad700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5cd0062900 0x7f5cd0150640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60772/0 (socket says 172.21.15.63:60772) 2020-05-18T21:31:43.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd4fad700 1 -- 172.21.15.63:0/387052283 learned_addr learned my addr 172.21.15.63:0/387052283 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:43.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd57ae700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0060b90 0x7f5cd0142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:43.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd5faf700 1 --2- 172.21.15.63:0/387052283 >> v2:172.21.15.155:3300/0 conn(0x7f5cd0146c90 0x7f5cd0065da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:43.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cc27fc700 1 -- 172.21.15.63:0/387052283 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909913719 0 0) 0x7f5cd0066200 con 0x7f5cd0062900 2020-05-18T21:31:43.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cc27fc700 1 -- 172.21.15.63:0/387052283 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cb0002fe0 con 0x7f5cd0062900 2020-05-18T21:31:43.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd57ae700 1 -- 172.21.15.63:0/387052283 >> v2:172.21.15.155:3300/0 conn(0x7f5cd0146c90 msgr2=0x7f5cd0065da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:43.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd57ae700 1 --2- 172.21.15.63:0/387052283 >> v2:172.21.15.155:3300/0 conn(0x7f5cd0146c90 0x7f5cd0065da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:43.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd57ae700 1 -- 172.21.15.63:0/387052283 >> v1:172.21.15.63:6789/0 conn(0x7f5cd0062900 legacy=0x7f5cd0150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:43.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd57ae700 1 -- 172.21.15.63:0/387052283 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd01446c0 con 0x7f5cd0060b90 2020-05-18T21:31:43.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd57ae700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0060b90 0x7f5cd0142de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5cc4002f70 tx=0x7f5cc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd57ae700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0060b90 0x7f5cd0142de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5cc4002f70 tx=0x7f5cc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd57ae700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0060b90 0x7f5cd0142de0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7f5cc4002f70 tx=0x7f5cc4007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:43.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd57ae700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0060b90 0x7f5cd0142de0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f5cc4002f70 tx=0x7f5cc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cc27fc700 1 -- 172.21.15.63:0/387052283 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cc400f640 con 0x7f5cd0060b90 2020-05-18T21:31:43.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd57ae700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0060b90 0x7f5cd0142de0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f5cc4002f70 tx=0x7f5cc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cc27fc700 1 -- 172.21.15.63:0/387052283 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc400f7a0 con 0x7f5cd0060b90 2020-05-18T21:31:43.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd57ae700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0060b90 0x7f5cd0142de0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f5cc4002f70 tx=0x7f5cc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd7a12700 1 -- 172.21.15.63:0/387052283 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd01421b0 con 0x7f5cd0060b90 2020-05-18T21:31:43.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cc27fc700 1 -- 172.21.15.63:0/387052283 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cc4007360 con 0x7f5cd0060b90 2020-05-18T21:31:43.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.601+0000 7f5cd7a12700 1 -- 172.21.15.63:0/387052283 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd01417b0 con 0x7f5cd0060b90 2020-05-18T21:31:43.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.605+0000 7f5cd57ae700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0060b90 0x7f5cd0142de0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f5cc4002f70 tx=0x7f5cc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.605+0000 7f5cd7a12700 1 -- 172.21.15.63:0/387052283 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd00569e0 con 0x7f5cd0060b90 2020-05-18T21:31:43.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.605+0000 7f5cc27fc700 1 -- 172.21.15.63:0/387052283 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5cc4005700 con 0x7f5cd0060b90 2020-05-18T21:31:43.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.605+0000 7f5cd57ae700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0060b90 0x7f5cd0142de0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f5cc4002f70 tx=0x7f5cc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.605+0000 7f5cc27fc700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5cb004fd40 0x7f5cb0052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:43.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.605+0000 7f5cc27fc700 1 -- 172.21.15.63:0/387052283 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5cc4064340 con 0x7f5cd0060b90 2020-05-18T21:31:43.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.605+0000 7f5cd4fad700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5cb004fd40 0x7f5cb0052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:43.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.605+0000 7f5cd4fad700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5cb004fd40 0x7f5cb0052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5ccc0032f0 tx=0x7f5ccc008400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.605+0000 7f5cd4fad700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5cb004fd40 0x7f5cb0052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5ccc0032f0 tx=0x7f5ccc008400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.605+0000 7f5cd4fad700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5cb004fd40 0x7f5cb0052200 secure :-1 s=READY pgs=435 cs=0 l=1 rx=0x7f5ccc0032f0 tx=0x7f5ccc008400).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:43.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.613+0000 7f5cd57ae700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0060b90 0x7f5cd0142de0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f5cc4002f70 tx=0x7f5cc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.617+0000 7f5cc27fc700 1 -- 172.21.15.63:0/387052283 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f5cc403e7f0 con 0x7f5cd0060b90 2020-05-18T21:31:43.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.769+0000 7f5cd7a12700 1 -- 172.21.15.63:0/387052283 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cd005c780 con 0x7f5cd0060b90 2020-05-18T21:31:43.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.769+0000 7f5cd57ae700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0060b90 0x7f5cd0142de0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f5cc4002f70 tx=0x7f5cc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.769+0000 7f5cc27fc700 1 -- 172.21.15.63:0/387052283 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+2152 (secure 0 0 0) 0x7f5cc4041e10 con 0x7f5cd0060b90 2020-05-18T21:31:43.776 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:43.776 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:31:39.177963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7242,"mds_1":7236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7236":{"gid":7236,"name":"a","rank":1,"incarnation":55,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6833/249786226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":249786226},{"type":"v1","addr":"172.21.15.63:6833","nonce":249786226}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_7242":{"gid":7242,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/578144386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":578144386},{"type":"v1","addr":"172.21.15.155:6835","nonce":578144386}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:31:43.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.773+0000 7f5cd7a12700 1 -- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5cb004fd40 msgr2=0x7f5cb0052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:43.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.773+0000 7f5cd7a12700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5cb004fd40 0x7f5cb0052200 secure :-1 s=READY pgs=435 cs=0 l=1 rx=0x7f5ccc0032f0 tx=0x7f5ccc008400).stop 2020-05-18T21:31:43.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.773+0000 7f5cd7a12700 1 -- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0060b90 msgr2=0x7f5cd0142de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:43.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.773+0000 7f5cd7a12700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0060b90 0x7f5cd0142de0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7f5cc4002f70 tx=0x7f5cc4007a80).stop 2020-05-18T21:31:43.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.773+0000 7f5cd7a12700 1 -- 172.21.15.63:0/387052283 shutdown_connections 2020-05-18T21:31:43.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.773+0000 7f5cd7a12700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5cb004fd40 0x7f5cb0052200 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:43.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.773+0000 7f5cd7a12700 1 --2- 172.21.15.63:0/387052283 >> v2:172.21.15.155:3300/0 conn(0x7f5cd0146c90 0x7f5cd0065da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:43.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.773+0000 7f5cd7a12700 1 --2- 172.21.15.63:0/387052283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cd0060b90 0x7f5cd0142de0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:43.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.773+0000 7f5cd7a12700 1 -- 172.21.15.63:0/387052283 >> 172.21.15.63:0/387052283 conn(0x7f5cd00b83d0 msgr2=0x7f5cd00640a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:43.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.773+0000 7f5cd7a12700 1 -- 172.21.15.63:0/387052283 shutdown_connections 2020-05-18T21:31:43.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.773+0000 7f5cd7a12700 1 -- 172.21.15.63:0/387052283 wait complete. 2020-05-18T21:31:43.781 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 56 2020-05-18T21:31:43.796 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:43.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.889+0000 7fb3e1ddd700 1 Processor -- start 2020-05-18T21:31:43.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.889+0000 7fb3e1ddd700 1 -- start start 2020-05-18T21:31:43.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3e1ddd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb3dc069eb0 0x7fb3dc146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:43.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3e1ddd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3dc05ac50 0x7fb3dc062140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:43.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3e1ddd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc061ce0 con 0x7fb3dc05a7c0 2020-05-18T21:31:43.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3e1ddd700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc05c120 con 0x7fb3dc069eb0 2020-05-18T21:31:43.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3e1ddd700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc05be80 con 0x7fb3dc05ac50 2020-05-18T21:31:43.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3daffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb3dc05a7c0 0x7fb3dc13fdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60778/0 (socket says 172.21.15.63:60778) 2020-05-18T21:31:43.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3daffd700 1 -- 172.21.15.63:0/3274211199 learned_addr learned my addr 172.21.15.63:0/3274211199 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:43.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3dbfff700 1 --2- 172.21.15.63:0/3274211199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3dc05ac50 0x7fb3dc062140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:43.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3db7fe700 1 --2- 172.21.15.63:0/3274211199 >> v2:172.21.15.155:3300/0 conn(0x7fb3dc069eb0 0x7fb3dc146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:43.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3da7fc700 1 -- 172.21.15.63:0/3274211199 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993366010 0 0) 0x7fb3dc061ce0 con 0x7fb3dc05a7c0 2020-05-18T21:31:43.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3da7fc700 1 -- 172.21.15.63:0/3274211199 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3c8003270 con 0x7fb3dc05a7c0 2020-05-18T21:31:43.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3dbfff700 1 -- 172.21.15.63:0/3274211199 >> v2:172.21.15.155:3300/0 conn(0x7fb3dc069eb0 msgr2=0x7fb3dc146ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:43.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3dbfff700 1 --2- 172.21.15.63:0/3274211199 >> v2:172.21.15.155:3300/0 conn(0x7fb3dc069eb0 0x7fb3dc146ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:43.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3dbfff700 1 -- 172.21.15.63:0/3274211199 >> v1:172.21.15.63:6789/0 conn(0x7fb3dc05a7c0 legacy=0x7fb3dc13fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:43.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3dbfff700 1 -- 172.21.15.63:0/3274211199 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc06a290 con 0x7fb3dc05ac50 2020-05-18T21:31:43.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3db7fe700 1 --2- 172.21.15.63:0/3274211199 >> v2:172.21.15.155:3300/0 conn(0x7fb3dc069eb0 0x7fb3dc146ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:31:43.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3dbfff700 1 --2- 172.21.15.63:0/3274211199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3dc05ac50 0x7fb3dc062140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb3cc0018b0 tx=0x7fb3d4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3dbfff700 1 --2- 172.21.15.63:0/3274211199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3dc05ac50 0x7fb3dc062140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb3cc0018b0 tx=0x7fb3d4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3dbfff700 1 --2- 172.21.15.63:0/3274211199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3dc05ac50 0x7fb3dc062140 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7fb3cc0018b0 tx=0x7fb3d4008ca0).ready entity=mon.2 client_cookie=aaccaae81aa0db73 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:43.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3dbfff700 1 --2- 172.21.15.63:0/3274211199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3dc05ac50 0x7fb3dc062140 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7fb3cc0018b0 tx=0x7fb3d4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3da7fc700 1 -- 172.21.15.63:0/3274211199 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3cc001710 con 0x7fb3dc05ac50 2020-05-18T21:31:43.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3dbfff700 1 --2- 172.21.15.63:0/3274211199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3dc05ac50 0x7fb3dc062140 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7fb3cc0018b0 tx=0x7fb3d4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3dbfff700 1 --2- 172.21.15.63:0/3274211199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3dc05ac50 0x7fb3dc062140 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7fb3cc0018b0 tx=0x7fb3d4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3da7fc700 1 -- 172.21.15.63:0/3274211199 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d40118d0 con 0x7fb3dc05ac50 2020-05-18T21:31:43.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3da7fc700 1 -- 172.21.15.63:0/3274211199 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3d4011c30 con 0x7fb3dc05ac50 2020-05-18T21:31:43.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3e1ddd700 1 -- 172.21.15.63:0/3274211199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3dc05ac50 msgr2=0x7fb3dc062140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:43.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3e1ddd700 1 --2- 172.21.15.63:0/3274211199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3dc05ac50 0x7fb3dc062140 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7fb3cc0018b0 tx=0x7fb3d4008ca0).stop 2020-05-18T21:31:43.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3e1ddd700 1 -- 172.21.15.63:0/3274211199 shutdown_connections 2020-05-18T21:31:43.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3e1ddd700 1 --2- 172.21.15.63:0/3274211199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3dc05ac50 0x7fb3dc062140 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:43.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3e1ddd700 1 --2- 172.21.15.63:0/3274211199 >> v2:172.21.15.155:3300/0 conn(0x7fb3dc069eb0 0x7fb3dc146ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:43.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3e1ddd700 1 -- 172.21.15.63:0/3274211199 >> 172.21.15.63:0/3274211199 conn(0x7fb3dc0b9700 msgr2=0x7fb3dc0b9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:43.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3e1ddd700 1 -- 172.21.15.63:0/3274211199 shutdown_connections 2020-05-18T21:31:43.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.893+0000 7fb3e1ddd700 1 -- 172.21.15.63:0/3274211199 wait complete. 2020-05-18T21:31:43.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3e1ddd700 1 Processor -- start 2020-05-18T21:31:43.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3e1ddd700 1 -- start start 2020-05-18T21:31:43.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3e1ddd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb3dc05a7c0 0x7fb3dc147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:43.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3e1ddd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb3dc069eb0 0x7fb3dc12c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:43.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3e1ddd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc1489f0 con 0x7fb3dc05ac50 2020-05-18T21:31:43.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3e1ddd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc148c20 con 0x7fb3dc069eb0 2020-05-18T21:31:43.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3e1ddd700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc148ec0 con 0x7fb3dc05a7c0 2020-05-18T21:31:43.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3dbfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb3dc069eb0 0x7fb3dc12c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:43.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3dbfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb3dc069eb0 0x7fb3dc12c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58600/0 (socket says 172.21.15.63:58600) 2020-05-18T21:31:43.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3dbfff700 1 -- 172.21.15.63:0/952989705 learned_addr learned my addr 172.21.15.63:0/952989705 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:43.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3db7fe700 1 --2- 172.21.15.63:0/952989705 >> v2:172.21.15.155:3300/0 conn(0x7fb3dc05a7c0 0x7fb3dc147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:43.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3dbfff700 1 -- 172.21.15.63:0/952989705 >> v2:172.21.15.155:3300/0 conn(0x7fb3dc05a7c0 msgr2=0x7fb3dc147ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:43.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3dbfff700 1 --2- 172.21.15.63:0/952989705 >> v2:172.21.15.155:3300/0 conn(0x7fb3dc05a7c0 0x7fb3dc147ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:43.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3dbfff700 1 -- 172.21.15.63:0/952989705 >> v1:172.21.15.63:6789/0 conn(0x7fb3dc05ac50 legacy=0x7fb3dc1451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:43.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3dbfff700 1 -- 172.21.15.63:0/952989705 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc149160 con 0x7fb3dc069eb0 2020-05-18T21:31:43.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3d8ff9700 1 -- 172.21.15.63:0/952989705 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017045461 0 0) 0x7fb3dc1489f0 con 0x7fb3dc05ac50 2020-05-18T21:31:43.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3dbfff700 1 --2- 172.21.15.63:0/952989705 >> v2:172.21.15.63:3300/0 conn(0x7fb3dc069eb0 0x7fb3dc12c0e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb3dc0b55a0 tx=0x7fb3dc06a420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3dbfff700 1 --2- 172.21.15.63:0/952989705 >> v2:172.21.15.63:3300/0 conn(0x7fb3dc069eb0 0x7fb3dc12c0e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb3dc0b55a0 tx=0x7fb3dc06a420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3dbfff700 1 --2- 172.21.15.63:0/952989705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc069eb0 0x7fb3dc12c0e0 secure :-1 s=READY pgs=1101 cs=0 l=1 rx=0x7fb3dc0b55a0 tx=0x7fb3dc06a420).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:43.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3dbfff700 1 --2- 172.21.15.63:0/952989705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc069eb0 0x7fb3dc12c0e0 secure :-1 s=THROTTLE_DONE pgs=1101 cs=0 l=1 rx=0x7fb3dc0b55a0 tx=0x7fb3dc06a420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3d8ff9700 1 -- 172.21.15.63:0/952989705 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3d40112c0 con 0x7fb3dc069eb0 2020-05-18T21:31:43.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3dbfff700 1 --2- 172.21.15.63:0/952989705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc069eb0 0x7fb3dc12c0e0 secure :-1 s=THROTTLE_DONE pgs=1101 cs=0 l=1 rx=0x7fb3dc0b55a0 tx=0x7fb3dc06a420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3e1ddd700 1 -- 172.21.15.63:0/952989705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc1458e0 con 0x7fb3dc069eb0 2020-05-18T21:31:43.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3dbfff700 1 --2- 172.21.15.63:0/952989705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc069eb0 0x7fb3dc12c0e0 secure :-1 s=THROTTLE_DONE pgs=1101 cs=0 l=1 rx=0x7fb3dc0b55a0 tx=0x7fb3dc06a420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3d8ff9700 1 -- 172.21.15.63:0/952989705 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d4005a80 con 0x7fb3dc069eb0 2020-05-18T21:31:43.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3d8ff9700 1 -- 172.21.15.63:0/952989705 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3d4005e60 con 0x7fb3dc069eb0 2020-05-18T21:31:43.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.897+0000 7fb3e1ddd700 1 -- 172.21.15.63:0/952989705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc12c6e0 con 0x7fb3dc069eb0 2020-05-18T21:31:43.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.901+0000 7fb3e1ddd700 1 -- 172.21.15.63:0/952989705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc0569e0 con 0x7fb3dc069eb0 2020-05-18T21:31:43.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.901+0000 7fb3dbfff700 1 --2- 172.21.15.63:0/952989705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc069eb0 0x7fb3dc12c0e0 secure :-1 s=THROTTLE_DONE pgs=1101 cs=0 l=1 rx=0x7fb3dc0b55a0 tx=0x7fb3dc06a420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.901+0000 7fb3d8ff9700 1 -- 172.21.15.63:0/952989705 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb3d4007180 con 0x7fb3dc069eb0 2020-05-18T21:31:43.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.901+0000 7fb3dbfff700 1 --2- 172.21.15.63:0/952989705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc069eb0 0x7fb3dc12c0e0 secure :-1 s=THROTTLE_DONE pgs=1101 cs=0 l=1 rx=0x7fb3dc0b55a0 tx=0x7fb3dc06a420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.901+0000 7fb3d8ff9700 1 --2- 172.21.15.63:0/952989705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb3bc04f850 0x7fb3bc051d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:43.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.901+0000 7fb3d8ff9700 1 -- 172.21.15.63:0/952989705 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb3d4064280 con 0x7fb3dc069eb0 2020-05-18T21:31:43.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.901+0000 7fb3db7fe700 1 --2- 172.21.15.63:0/952989705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb3bc04f850 0x7fb3bc051d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:43.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.901+0000 7fb3db7fe700 1 --2- 172.21.15.63:0/952989705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb3bc04f850 0x7fb3bc051d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb3d0002f70 tx=0x7fb3d000ebc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.901+0000 7fb3db7fe700 1 --2- 172.21.15.63:0/952989705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb3bc04f850 0x7fb3bc051d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb3d0002f70 tx=0x7fb3d000ebc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.901+0000 7fb3db7fe700 1 --2- 172.21.15.63:0/952989705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb3bc04f850 0x7fb3bc051d10 secure :-1 s=READY pgs=436 cs=0 l=1 rx=0x7fb3d0002f70 tx=0x7fb3d000ebc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:43.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.905+0000 7fb3dbfff700 1 --2- 172.21.15.63:0/952989705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc069eb0 0x7fb3dc12c0e0 secure :-1 s=THROTTLE_DONE pgs=1101 cs=0 l=1 rx=0x7fb3dc0b55a0 tx=0x7fb3dc06a420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:43.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:43.905+0000 7fb3d8ff9700 1 -- 172.21.15.63:0/952989705 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb3d403e610 con 0x7fb3dc069eb0 2020-05-18T21:31:44.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:44.053+0000 7fb3e1ddd700 1 -- 172.21.15.63:0/952989705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3dc063e40 con 0x7fb3dc069eb0 2020-05-18T21:31:44.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:44.053+0000 7fb3dbfff700 1 --2- 172.21.15.63:0/952989705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc069eb0 0x7fb3dc12c0e0 secure :-1 s=THROTTLE_DONE pgs=1101 cs=0 l=1 rx=0x7fb3dc0b55a0 tx=0x7fb3dc06a420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:44.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:44.053+0000 7fb3d8ff9700 1 -- 172.21.15.63:0/952989705 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+2152 (secure 0 0 0) 0x7fb3d4041c30 con 0x7fb3dc069eb0 2020-05-18T21:31:44.059 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:44.059 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:31:39.177963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7242,"mds_1":7236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7236":{"gid":7236,"name":"a","rank":1,"incarnation":55,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6833/249786226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":249786226},{"type":"v1","addr":"172.21.15.63:6833","nonce":249786226}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_7242":{"gid":7242,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/578144386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":578144386},{"type":"v1","addr":"172.21.15.155:6835","nonce":578144386}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:31:44.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:44.057+0000 7fb3e1ddd700 1 -- 172.21.15.63:0/952989705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb3bc04f850 msgr2=0x7fb3bc051d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:44.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:44.057+0000 7fb3e1ddd700 1 --2- 172.21.15.63:0/952989705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb3bc04f850 0x7fb3bc051d10 secure :-1 s=READY pgs=436 cs=0 l=1 rx=0x7fb3d0002f70 tx=0x7fb3d000ebc0).stop 2020-05-18T21:31:44.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:44.057+0000 7fb3e1ddd700 1 -- 172.21.15.63:0/952989705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc069eb0 msgr2=0x7fb3dc12c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:44.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:44.057+0000 7fb3e1ddd700 1 --2- 172.21.15.63:0/952989705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc069eb0 0x7fb3dc12c0e0 secure :-1 s=READY pgs=1101 cs=0 l=1 rx=0x7fb3dc0b55a0 tx=0x7fb3dc06a420).stop 2020-05-18T21:31:44.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:44.057+0000 7fb3e1ddd700 1 -- 172.21.15.63:0/952989705 shutdown_connections 2020-05-18T21:31:44.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:44.057+0000 7fb3e1ddd700 1 --2- 172.21.15.63:0/952989705 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb3bc04f850 0x7fb3bc051d10 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:44.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:44.057+0000 7fb3e1ddd700 1 --2- 172.21.15.63:0/952989705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc069eb0 0x7fb3dc12c0e0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:44.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:44.057+0000 7fb3e1ddd700 1 --2- 172.21.15.63:0/952989705 >> v2:172.21.15.155:3300/0 conn(0x7fb3dc05a7c0 0x7fb3dc147ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:44.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:44.057+0000 7fb3e1ddd700 1 -- 172.21.15.63:0/952989705 >> 172.21.15.63:0/952989705 conn(0x7fb3dc0b9700 msgr2=0x7fb3dc064e40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:44.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:44.057+0000 7fb3e1ddd700 1 -- 172.21.15.63:0/952989705 shutdown_connections 2020-05-18T21:31:44.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:44.057+0000 7fb3e1ddd700 1 -- 172.21.15.63:0/952989705 wait complete. 2020-05-18T21:31:44.064 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 56 2020-05-18T21:31:44.072 INFO:tasks.cephfs.test_strays:Ranks 0 and 1 are b and a 2020-05-18T21:31:44.072 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir dir_1 dir_2) 2020-05-18T21:31:44.105 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo touch dir_1/original) 2020-05-18T21:31:44.176 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo ln dir_1/original dir_2/linkto) 2020-05-18T21:31:44.199 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:31:44.200 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:31:44.200 INFO:teuthology.orchestra.run.smithi063:> import stat 2020-05-18T21:31:44.200 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:31:44.201 INFO:teuthology.orchestra.run.smithi063:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_1/original").st_ino) 2020-05-18T21:31:44.201 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:31:44.280 INFO:teuthology.orchestra.run.smithi063.stdout:1099511627778 2020-05-18T21:31:44.469 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.pin -v 1 dir_1) 2020-05-18T21:31:44.498 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok dump cache 2020-05-18T21:31:44.649 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:31:44.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.649 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1, 2020-05-18T21:31:44.649 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:44.650 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:44.101697+0000", 2020-05-18T21:31:44.650 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:30.216980+0000", 2020-05-18T21:31:44.650 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 17407, 2020-05-18T21:31:44.650 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:44.650 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:44.651 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:44.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.652 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:44.652 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 4194304, 2020-05-18T21:31:44.652 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 1, 2020-05-18T21:31:44.652 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 4194304, 2020-05-18T21:31:44.653 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": 16, 2020-05-18T21:31:44.653 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:44.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.653 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:44.653 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:44.101697+0000", 2020-05-18T21:31:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:44.655 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:44.656 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.656 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:44.101697+0000", 2020-05-18T21:31:44.656 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:44.656 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 2, 2020-05-18T21:31:44.656 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 2 2020-05-18T21:31:44.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.657 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:44.657 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.657 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.657 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.657 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:37.764196+0000" 2020-05-18T21:31:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.658 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.659 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.659 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.659 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.659 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:30.216980+0000" 2020-05-18T21:31:44.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 5, 2020-05-18T21:31:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:44.660 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:44.661 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:44.661 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:44.661 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:44.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.661 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:44.662 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:44.662 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:44.662 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:44.663 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:44.663 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:44.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.663 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:44.663 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": false, 2020-05-18T21:31:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.664 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: 0, 2020-05-18T21:31:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 1 2020-05-18T21:31:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": 0, 2020-05-18T21:31:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 0 2020-05-18T21:31:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 0, 2020-05-18T21:31:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:44.667 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:44.668 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:44.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.669 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:44.669 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:44.669 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:44.669 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": { 2020-05-18T21:31:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "mix", 2020-05-18T21:31:44.670 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:44.671 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:44.671 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:44.671 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:44.671 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:44.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [], 2020-05-18T21:31:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:44.672 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:44.673 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:44.673 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [] 2020-05-18T21:31:44.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.673 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 3, 2020-05-18T21:31:44.674 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:44.674 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.184087+0000", 2020-05-18T21:31:44.674 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.184087+0000", 2020-05-18T21:31:44.674 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16877, 2020-05-18T21:31:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:44.675 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:44.676 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:44.676 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:44.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.676 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:44.676 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:44.677 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:44.677 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:44.677 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:44.677 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:44.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:44.678 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:44.679 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.184087+0000", 2020-05-18T21:31:44.679 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:44.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:44.679 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:44.679 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:44.680 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.681 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.682 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.682 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.682 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.682 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.184087+0000" 2020-05-18T21:31:44.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.682 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:44.683 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.683 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.683 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.683 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.683 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.184087+0000" 2020-05-18T21:31:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:44.684 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:44.685 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:44.685 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:44.685 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:44.685 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:44.685 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:44.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.686 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:44.686 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:44.686 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:44.686 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:44.686 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:44.687 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.688 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: -2, 2020-05-18T21:31:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": {}, 2020-05-18T21:31:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 0, 2020-05-18T21:31:44.690 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:44.691 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:44.691 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:44.691 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:44.691 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:44.691 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:44.692 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:44.692 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:44.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.692 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:44.693 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:44.694 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.695 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:44.695 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:44.695 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:44.695 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:44.695 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [] 2020-05-18T21:31:44.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.696 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1552, 2020-05-18T21:31:44.696 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:44.696 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181913+0000", 2020-05-18T21:31:44.696 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181913+0000", 2020-05-18T21:31:44.697 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:44.697 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:44.697 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:44.697 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:44.697 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:44.699 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:44.700 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:44.700 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:44.700 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:44.700 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:44.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.701 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:44.701 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:44.701 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:44.702 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:44.702 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:44.702 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:44.702 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181913+0000", 2020-05-18T21:31:44.702 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:44.703 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.704 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:44.704 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:44.704 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:44.704 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:44.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.705 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.706 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181913+0000" 2020-05-18T21:31:44.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.706 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:44.706 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.706 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181913+0000" 2020-05-18T21:31:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.707 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:44.708 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:44.710 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:44.710 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:44.710 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:44.710 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:44.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.711 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.712 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.712 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.712 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:44.712 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.713 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.713 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.713 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.713 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:44.714 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:44.718 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:44.718 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:44.718 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:44.718 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:44.718 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:44.718 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:44.719 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:44.720 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:44.720 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:44.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.720 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray6", 2020-05-18T21:31:44.720 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x610", 2020-05-18T21:31:44.721 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:44.721 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:44.721 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:44.721 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:44.721 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:44.722 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.724 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.724 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:44.724 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.724 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.724 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.725 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.725 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.726 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.726 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.726 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:44.726 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:44.726 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:44.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.727 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:44.727 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:44.727 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:44.727 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:44.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.728 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1551, 2020-05-18T21:31:44.728 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:44.728 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181638+0000", 2020-05-18T21:31:44.728 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181638+0000", 2020-05-18T21:31:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:44.729 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:44.730 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:44.730 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:44.730 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:44.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.730 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:44.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.732 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:44.732 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:44.732 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:44.732 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:44.732 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181638+0000", 2020-05-18T21:31:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:44.733 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:44.734 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:44.734 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:44.734 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.734 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:44.734 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:44.735 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:44.735 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:44.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.735 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.736 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181638+0000" 2020-05-18T21:31:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.737 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181638+0000" 2020-05-18T21:31:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:44.738 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:44.739 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:44.739 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:44.739 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:44.739 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:44.739 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:44.740 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:44.740 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:44.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.740 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:44.740 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:44.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.742 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:44.742 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:44.742 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:44.742 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.743 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.744 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.745 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.745 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.745 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:44.745 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:44.745 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:44.746 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:44.747 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:44.748 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:44.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.748 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:44.748 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:44.748 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:44.748 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:44.750 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.750 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:44.750 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:44.750 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.750 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:44.750 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:44.751 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:44.751 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:44.751 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:44.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.751 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray5", 2020-05-18T21:31:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60f", 2020-05-18T21:31:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:44.752 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:44.753 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:44.753 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:44.753 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.753 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:44.753 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:44.754 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.754 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.754 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.754 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.754 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.755 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.755 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:44.755 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.755 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.755 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.756 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.756 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.756 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.756 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.756 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:44.757 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:44.758 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:44.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.758 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1555, 2020-05-18T21:31:44.758 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.182880+0000", 2020-05-18T21:31:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.182880+0000", 2020-05-18T21:31:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:44.759 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:44.762 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:44.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.762 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:44.762 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:44.763 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:44.763 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:44.763 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:44.763 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.182880+0000", 2020-05-18T21:31:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:44.764 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:44.765 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:44.765 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.765 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:44.765 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:44.765 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.766 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.767 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.767 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.767 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:44.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.767 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.768 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:44.769 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:44.770 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:44.770 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:44.770 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:44.770 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:44.770 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:44.771 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.773 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.774 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:44.774 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.774 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.774 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.775 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.775 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.775 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.775 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:44.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.777 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:44.777 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:44.777 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:44.777 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:44.777 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.778 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:44.779 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:44.779 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:44.779 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:44.779 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:44.779 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:44.780 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:44.781 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.781 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:44.781 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:44.781 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:44.781 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray9", 2020-05-18T21:31:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x613", 2020-05-18T21:31:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:44.782 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:44.783 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:44.783 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:44.783 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:44.783 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:44.783 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.784 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.785 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.785 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.785 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.785 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.786 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.787 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.787 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.787 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:44.787 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:44.787 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:44.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.789 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.789 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1550, 2020-05-18T21:31:44.789 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:44.789 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181349+0000", 2020-05-18T21:31:44.789 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181349+0000", 2020-05-18T21:31:44.790 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:44.790 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:44.790 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:44.790 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:44.790 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:44.790 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.791 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:44.792 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:44.792 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:44.792 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:44.792 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:44.792 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:44.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:44.793 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181349+0000", 2020-05-18T21:31:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:44.794 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:44.795 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:44.795 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:44.795 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.795 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:44.795 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.796 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.797 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.797 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.797 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.797 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181349+0000" 2020-05-18T21:31:44.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.798 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:44.798 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.798 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.798 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.798 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.798 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181349+0000" 2020-05-18T21:31:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:44.799 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:44.800 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:44.800 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:44.800 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:44.800 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:44.800 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:44.800 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:44.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.801 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:44.801 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:44.801 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:44.801 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:44.802 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:44.802 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:44.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.803 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:44.803 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:44.803 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.804 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.805 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.805 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:44.805 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.805 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.805 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.806 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.806 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.806 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.806 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:44.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:44.808 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:44.809 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:44.809 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:44.809 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:44.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.809 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:44.810 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:44.811 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:44.811 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:44.811 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.811 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:44.811 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:44.812 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray4", 2020-05-18T21:31:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60e", 2020-05-18T21:31:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:44.813 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:44.814 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:44.814 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:44.814 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:44.814 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:44.814 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:44.814 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.815 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:44.816 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.817 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.817 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.817 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.817 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:44.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.820 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1554, 2020-05-18T21:31:44.820 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:44.820 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.182533+0000", 2020-05-18T21:31:44.820 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.182533+0000", 2020-05-18T21:31:44.820 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:44.821 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:44.821 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:44.821 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:44.821 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:44.821 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:44.822 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:44.822 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:44.822 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:44.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.822 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:44.823 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:44.823 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:44.823 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:44.823 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:44.823 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:44.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.824 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:44.824 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:44.824 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:44.824 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:44.824 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.182533+0000", 2020-05-18T21:31:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:44.825 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:44.826 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:44.826 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:44.826 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:44.826 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.827 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:44.827 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:44.827 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:44.827 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:44.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.828 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.829 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182533+0000" 2020-05-18T21:31:44.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.829 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:44.829 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.829 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.830 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.830 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.830 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.830 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182533+0000" 2020-05-18T21:31:44.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.830 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:44.831 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:44.831 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:44.831 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:44.831 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:44.831 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:44.832 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:44.832 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:44.832 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:44.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.832 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:44.832 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:44.833 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:44.833 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:44.833 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:44.833 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:44.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.834 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:44.834 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:44.834 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:44.834 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.834 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:44.835 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.836 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.836 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.836 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.836 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:44.838 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:44.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.838 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:44.838 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:44.838 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:44.839 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:44.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.840 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:44.840 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:44.840 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:44.840 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:44.841 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.842 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:44.842 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:44.842 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.842 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:44.842 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray8", 2020-05-18T21:31:44.843 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x612", 2020-05-18T21:31:44.844 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:44.844 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:44.844 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:44.844 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:44.844 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:44.845 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.846 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.846 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.846 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.846 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:44.848 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1553, 2020-05-18T21:31:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:44.850 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.182214+0000", 2020-05-18T21:31:44.851 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.182214+0000", 2020-05-18T21:31:44.851 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:44.851 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:44.851 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:44.851 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:44.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:44.854 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:44.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.854 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:44.854 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:44.854 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:44.854 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.182214+0000", 2020-05-18T21:31:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:44.855 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.856 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:44.857 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:44.857 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:44.857 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:44.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.857 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.858 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182214+0000" 2020-05-18T21:31:44.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.859 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:44.859 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.859 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.859 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182214+0000" 2020-05-18T21:31:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:44.860 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:44.861 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:44.862 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:44.862 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:44.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.862 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:44.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.864 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:44.864 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:44.864 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:44.864 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.864 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.864 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.865 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.865 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.865 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:44.865 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.866 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.866 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.866 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.866 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.866 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:44.867 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:44.868 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:44.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.870 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:44.870 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:44.870 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:44.870 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:44.870 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:44.871 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:44.871 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:44.871 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:44.871 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:44.876 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.876 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:44.876 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:44.876 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.877 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:44.877 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:44.877 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:44.877 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:44.877 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:44.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray7", 2020-05-18T21:31:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x611", 2020-05-18T21:31:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.879 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:44.880 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:44.880 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.880 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.880 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.880 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.881 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.882 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.882 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.882 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.882 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:44.883 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:44.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.884 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:44.884 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:44.884 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:44.884 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:44.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.885 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1549, 2020-05-18T21:31:44.885 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:44.885 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181046+0000", 2020-05-18T21:31:44.885 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181046+0000", 2020-05-18T21:31:44.886 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:44.886 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:44.886 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:44.886 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:44.886 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:44.887 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:44.887 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:44.887 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:44.887 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:44.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.887 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:44.888 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:44.888 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:44.888 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:44.888 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:44.888 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:44.889 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:44.890 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:44.890 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181046+0000", 2020-05-18T21:31:44.890 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:44.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:44.890 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:44.891 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:44.892 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:44.892 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:44.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:44.892 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181046+0000" 2020-05-18T21:31:44.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.894 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:44.894 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181046+0000" 2020-05-18T21:31:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.899 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.900 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:44.902 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:44.902 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:44.902 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:44.902 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:44.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.903 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:44.903 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:44.903 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:44.903 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:44.903 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:44.903 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.904 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:44.906 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:44.906 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:44.906 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.906 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:44.906 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:44.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.908 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray3", 2020-05-18T21:31:44.908 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60d", 2020-05-18T21:31:44.908 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:44.908 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:44.909 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.910 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:44.910 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:44.910 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.910 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.910 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:44.911 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.912 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:44.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.915 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1548, 2020-05-18T21:31:44.915 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:44.915 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.180788+0000", 2020-05-18T21:31:44.915 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.180788+0000", 2020-05-18T21:31:44.915 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:44.916 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:44.917 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:44.917 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:44.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.917 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:44.917 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.918 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:44.919 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:44.919 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:44.919 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:44.919 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:44.919 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.180788+0000", 2020-05-18T21:31:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:44.920 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:44.921 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:44.921 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.921 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:44.921 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:44.921 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.922 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180788+0000" 2020-05-18T21:31:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:44.923 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.924 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.924 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.924 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.924 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.924 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180788+0000" 2020-05-18T21:31:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:44.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.927 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:44.927 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:44.927 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:44.927 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:44.928 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:44.928 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:44.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.928 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:44.928 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.929 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.930 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.930 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:44.930 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.930 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.930 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.931 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.931 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.931 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.931 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.931 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:44.932 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:44.932 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:44.932 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:44.932 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:44.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:44.933 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:44.934 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:44.934 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:44.934 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:44.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.934 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:44.935 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:44.937 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:44.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.938 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray2", 2020-05-18T21:31:44.938 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60c", 2020-05-18T21:31:44.938 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:44.938 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:44.938 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.939 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:44.940 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:44.940 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.940 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.940 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.940 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.941 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.942 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.942 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.942 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.942 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.943 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:44.944 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:44.944 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:44.944 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:44.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.945 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1547, 2020-05-18T21:31:44.945 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:44.945 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.180496+0000", 2020-05-18T21:31:44.945 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.180496+0000", 2020-05-18T21:31:44.945 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:44.945 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:44.946 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:44.946 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:44.946 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:44.946 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:44.946 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:44.947 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:44.948 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:44.948 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:44.948 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:44.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.948 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:44.949 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:44.949 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:44.949 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:44.949 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:44.949 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:44.949 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.180496+0000", 2020-05-18T21:31:44.950 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:44.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:44.950 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:44.950 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:44.950 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:44.951 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.952 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.953 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.953 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180496+0000" 2020-05-18T21:31:44.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.953 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:44.953 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180496+0000" 2020-05-18T21:31:44.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.955 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:44.955 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:44.955 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:44.955 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:44.955 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.956 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:44.957 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:44.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.958 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:44.958 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:44.958 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:44.958 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.958 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.959 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.959 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.959 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.959 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.960 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.961 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.961 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.961 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:44.961 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:44.961 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:44.962 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:44.962 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:44.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.962 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:44.963 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:44.963 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:44.963 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:44.963 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:44.963 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:44.964 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:44.965 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:44.965 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:44.965 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:44.965 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:44.965 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.967 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:44.967 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:44.967 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:44.967 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:44.967 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray1", 2020-05-18T21:31:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60b", 2020-05-18T21:31:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:44.968 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:44.969 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.970 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:44.970 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:44.970 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.970 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.970 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.970 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:44.971 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.972 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.973 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.973 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:44.973 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:44.973 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:44.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1546, 2020-05-18T21:31:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.180117+0000", 2020-05-18T21:31:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.180117+0000", 2020-05-18T21:31:44.975 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:44.976 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:44.978 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:44.978 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:44.978 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:44.978 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:44.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.978 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:44.979 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.180117+0000", 2020-05-18T21:31:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:44.980 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:44.981 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.982 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180117+0000" 2020-05-18T21:31:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:44.984 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:44.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:44.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:44.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180117+0000" 2020-05-18T21:31:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:44.985 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:44.986 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:44.986 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:44.986 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:44.986 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:44.986 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:44.987 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:44.988 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:44.988 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:44.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.988 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:44.988 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:44.989 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:44.989 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:44.989 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:44.989 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:44.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.990 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:44.990 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:44.990 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:44.990 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:44.990 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.990 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:44.991 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:44.992 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:44.992 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:44.992 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:44.992 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:44.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:44.993 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:44.994 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:44.994 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:44.994 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:44.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:44.994 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:44.995 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:44.996 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:44.997 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:44.997 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:44.997 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:44.997 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:44.997 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:44.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:44.998 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray0", 2020-05-18T21:31:44.998 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60a", 2020-05-18T21:31:44.998 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:44.998 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:44.998 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:44.999 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:45.000 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:45.002 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:45.002 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:45.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.002 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.002 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:45.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 257, 2020-05-18T21:31:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.179986+0000", 2020-05-18T21:31:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.179986+0000", 2020-05-18T21:31:45.005 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:45.006 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:45.006 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:45.006 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:45.006 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:45.006 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:45.007 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:45.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:45.009 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:45.010 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.179986+0000", 2020-05-18T21:31:45.010 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:45.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:45.010 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:45.010 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:45.011 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 10, 2020-05-18T21:31:45.012 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:45.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.012 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:45.012 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:45.012 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 11, 2020-05-18T21:31:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.013 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:45.014 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:45.014 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:45.014 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:45.014 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 11, 2020-05-18T21:31:45.014 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:45.014 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:45.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.015 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:45.015 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:45.015 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:45.015 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:45.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.017 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:45.017 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:45.017 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:45.017 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:45.017 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:45.018 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:45.019 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:45.019 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:45.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.019 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:45.019 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:45.020 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:45.020 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:45.020 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:45.020 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:45.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.020 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1 2020-05-18T21:31:45.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.022 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:45.022 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:45.022 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:45.022 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:45.022 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:45.028 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:45.028 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:45.028 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:45.029 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:45.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.029 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:45.029 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:45.029 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:45.030 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:45.031 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:45.032 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:45.032 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:45.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:45.032 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1", 2020-05-18T21:31:45.032 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x101", 2020-05-18T21:31:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:45.033 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:45.034 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "1", 2020-05-18T21:31:45.034 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:45.034 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:45.034 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:45.034 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:45.035 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:45.036 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:45.036 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:45.036 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:45.036 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:45.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.037 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.037 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:45.037 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:45.037 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:45.037 INFO:teuthology.orchestra.run.smithi063.stdout: "child": 1, 2020-05-18T21:31:45.037 INFO:teuthology.orchestra.run.smithi063.stdout: "subtree": 1, 2020-05-18T21:31:45.038 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:45.038 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:45.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.038 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 2, 2020-05-18T21:31:45.038 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [ 2020-05-18T21:31:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray6", 2020-05-18T21:31:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:45.039 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1552, 2020-05-18T21:31:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:45.040 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:45.041 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:45.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.042 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:45.042 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:45.042 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:45.042 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:45.042 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:45.043 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:45.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.043 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.043 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:45.043 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:45.044 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:45.044 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:45.044 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:45.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.044 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:45.044 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:45.045 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:45.045 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:45.045 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:45.045 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:45.045 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:45.045 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:45.046 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:45.046 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:45.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.046 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:45.046 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:45.047 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:45.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:45.047 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray7", 2020-05-18T21:31:45.047 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:45.047 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:45.048 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:45.048 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:45.048 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:45.048 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:45.048 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:45.048 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1553, 2020-05-18T21:31:45.049 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:45.049 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:45.049 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:45.049 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.049 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:45.050 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:45.050 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:45.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.050 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:45.050 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:45.050 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:45.051 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:45.051 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:45.051 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:45.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.051 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.052 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:45.052 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:45.052 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:45.052 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:45.052 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:45.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.053 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:45.053 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:45.053 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:45.053 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:45.053 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:45.054 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:45.054 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:45.054 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:45.054 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:45.054 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:45.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.055 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:45.055 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:45.055 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:45.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:45.056 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray0", 2020-05-18T21:31:45.056 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:45.056 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:45.056 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:45.056 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:45.056 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:45.057 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:45.057 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:45.057 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1546, 2020-05-18T21:31:45.057 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:45.057 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:45.058 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:45.058 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.058 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:45.058 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:45.058 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:45.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.059 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:45.059 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:45.059 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:45.059 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:45.059 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:45.059 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:45.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.060 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.060 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:45.060 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:45.060 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:45.061 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:45.061 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:45.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.061 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:45.061 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:45.061 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:45.062 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:45.062 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:45.062 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:45.062 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:45.062 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:45.063 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:45.063 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:45.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.063 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:45.064 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:45.064 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:45.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:45.064 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray9", 2020-05-18T21:31:45.064 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:45.065 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:45.065 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:45.065 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:45.065 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:45.065 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:45.066 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:45.066 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1555, 2020-05-18T21:31:45.066 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:45.066 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:45.066 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:45.066 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.067 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:45.067 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:45.067 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:45.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.067 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:45.068 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:45.068 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:45.068 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:45.068 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:45.068 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:45.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.069 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.069 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:45.069 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:45.069 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:45.069 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:45.070 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:45.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.070 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:45.070 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:45.070 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:45.070 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:45.071 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:45.071 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:45.071 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:45.071 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:45.071 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:45.071 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:45.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.072 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:45.072 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:45.072 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:45.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:45.073 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray5", 2020-05-18T21:31:45.073 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:45.073 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:45.073 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:45.073 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:45.074 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:45.074 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:45.074 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:45.074 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1551, 2020-05-18T21:31:45.074 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:45.075 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:45.075 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:45.075 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.075 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:45.075 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:45.075 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:45.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.076 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:45.076 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:45.076 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:45.076 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:45.077 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:45.077 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:45.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.077 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.077 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:45.077 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:45.078 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:45.078 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:45.078 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:45.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.078 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:45.079 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:45.079 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:45.079 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:45.079 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:45.079 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:45.079 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:45.080 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:45.080 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:45.080 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:45.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.080 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:45.080 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:45.081 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:45.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:45.081 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray2", 2020-05-18T21:31:45.081 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:45.082 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:45.082 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:45.082 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:45.082 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:45.082 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:45.082 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:45.083 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1548, 2020-05-18T21:31:45.083 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:45.083 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:45.083 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:45.083 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.084 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:45.084 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:45.084 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:45.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.085 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:45.085 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:45.085 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:45.085 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:45.085 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:45.085 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:45.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.086 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.086 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:45.086 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:45.086 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:45.087 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:45.087 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:45.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.087 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:45.087 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:45.087 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:45.088 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:45.088 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:45.088 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:45.088 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:45.088 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:45.089 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:45.089 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:45.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.089 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:45.089 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:45.089 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:45.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:45.090 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray1", 2020-05-18T21:31:45.090 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:45.090 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:45.090 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:45.091 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:45.091 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:45.091 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:45.091 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:45.091 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1547, 2020-05-18T21:31:45.092 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:45.092 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:45.092 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:45.092 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.092 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:45.092 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:45.093 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:45.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.093 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:45.093 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:45.093 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:45.094 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:45.094 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:45.094 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:45.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.094 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.095 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:45.095 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:45.095 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:45.095 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:45.095 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:45.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.096 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:45.096 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:45.096 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:45.096 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:45.096 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:45.097 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:45.097 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:45.097 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:45.097 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:45.097 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:45.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.098 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:45.098 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:45.098 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:45.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:45.099 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray8", 2020-05-18T21:31:45.099 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:45.099 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:45.099 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:45.099 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:45.099 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:45.100 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:45.100 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:45.100 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1554, 2020-05-18T21:31:45.100 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:45.100 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:45.101 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:45.101 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.101 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:45.101 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:45.101 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:45.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.102 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:45.102 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:45.102 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:45.102 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:45.102 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:45.103 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:45.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.103 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.103 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:45.103 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:45.103 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:45.104 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:45.104 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:45.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.104 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:45.104 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:45.105 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:45.105 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:45.105 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:45.105 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:45.105 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:45.105 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:45.106 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:45.106 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:45.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.106 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:45.106 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:45.106 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:45.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:45.107 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray3", 2020-05-18T21:31:45.107 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:45.107 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:45.108 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:45.108 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:45.108 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:45.108 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:45.108 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:45.108 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1549, 2020-05-18T21:31:45.109 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:45.109 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:45.109 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:45.109 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.109 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:45.110 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:45.110 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:45.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.110 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:45.110 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:45.110 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:45.111 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:45.111 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:45.111 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:45.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.111 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.111 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:45.112 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:45.112 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:45.112 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:45.112 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:45.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.113 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:45.113 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:45.113 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:45.113 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:45.113 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:45.113 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:45.114 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:45.114 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:45.114 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:45.114 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:45.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.115 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:45.115 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:45.115 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:45.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:45.115 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray4", 2020-05-18T21:31:45.116 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:45.116 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:45.116 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:45.116 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:45.116 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:45.116 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:45.117 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:45.117 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1550, 2020-05-18T21:31:45.117 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:45.117 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:45.117 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:45.118 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.118 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:45.118 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:45.118 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:45.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.118 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:45.119 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:45.119 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:45.119 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:45.119 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:45.119 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:45.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.120 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:45.120 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:45.120 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:45.120 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:45.120 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:45.121 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:45.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.121 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:45.121 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:45.121 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:45.121 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:45.122 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:45.122 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:45.122 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:45.122 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:45.122 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:45.123 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:45.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:45.123 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:45.123 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:45.123 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:45.123 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:45.124 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:45.124 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:45.124 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:45.124 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:45.124 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:31:45.126 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "ino": 1, "rdev": 0, "ctime": "2020-05-18T21:31:44.101697+0000", "btime": "2020-05-18T21:31:30.216980+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 16, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:44.101697+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:31:44.101697+0000", "num_files": 0, "num_subdirs": 2, "change_attr": 2 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:37.764196+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:30.216980+0000" }, "version": 5, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "dirfrag": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 3, "rdev": 0, "ctime": "2020-05-18T21:31:38.184087+0000", "btime": "2020-05-18T21:31:38.184087+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.184087+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.184087+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.184087+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ -2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": {}, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1552, "rdev": 0, "ctime": "2020-05-18T21:31:38.181913+0000", "btime": "2020-05-18T21:31:38.181913+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181913+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181913+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181913+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray6", "dirfrag": "0x610", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1551, "rdev": 0, "ctime": "2020-05-18T21:31:38.181638+0000", "btime": "2020-05-18T21:31:38.181638+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181638+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181638+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181638+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray5", "dirfrag": "0x60f", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1555, "rdev": 0, "ctime": "2020-05-18T21:31:38.182880+0000", "btime": "2020-05-18T21:31:38.182880+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.182880+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray9", "dirfrag": "0x613", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1550, "rdev": 0, "ctime": "2020-05-18T21:31:38.181349+0000", "btime": "2020-05-18T21:31:38.181349+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181349+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181349+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181349+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray4", "dirfrag": "0x60e", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1554, "rdev": 0, "ctime": "2020-05-18T21:31:38.182533+0000", "btime": "2020-05-18T21:31:38.182533+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.182533+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182533+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182533+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray8", "dirfrag": "0x612", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1553, "rdev": 0, "ctime": "2020-05-18T21:31:38.182214+0000", "btime": "2020-05-18T21:31:38.182214+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.182214+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182214+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182214+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray7", "dirfrag": "0x611", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1549, "rdev": 0, "ctime": "2020-05-18T21:31:38.181046+0000", "btime": "2020-05-18T21:31:38.181046+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181046+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181046+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181046+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray3", "dirfrag": "0x60d", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1548, "rdev": 0, "ctime": "2020-05-18T21:31:38.180788+0000", "btime": "2020-05-18T21:31:38.180788+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.180788+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180788+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180788+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray2", "dirfrag": "0x60c", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1547, "rdev": 0, "ctime": "2020-05-18T21:31:38.180496+0000", "btime": "2020-05-18T21:31:38.180496+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.180496+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180496+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180496+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray1", "dirfrag": "0x60b", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1546, "rdev": 0, "ctime": "2020-05-18T21:31:38.180117+0000", "btime": "2020-05-18T21:31:38.180117+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.180117+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180117+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180117+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray0", "dirfrag": "0x60a", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 257, "rdev": 0, "ctime": "2020-05-18T21:31:38.179986+0000", "btime": "2020-05-18T21:31:38.179986+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.179986+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 10, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "1", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2, "dentries": [ { "path": "stray6", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1552, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray7", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1553, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray0", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1546, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray9", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1555, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray5", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1551, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray2", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1548, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray1", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1547, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray8", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1554, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray3", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1549, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray4", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1550, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] } ] } ] } ] 2020-05-18T21:31:46.129 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok dump cache 2020-05-18T21:31:46.243 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:31:46.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.244 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1, 2020-05-18T21:31:46.244 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:46.244 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:44.101697+0000", 2020-05-18T21:31:46.244 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:30.216980+0000", 2020-05-18T21:31:46.244 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 17407, 2020-05-18T21:31:46.245 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:46.245 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:46.245 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:46.245 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:46.245 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:46.246 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:46.246 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:46.246 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:46.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.246 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:46.247 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 4194304, 2020-05-18T21:31:46.247 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 1, 2020-05-18T21:31:46.247 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 4194304, 2020-05-18T21:31:46.247 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": 16, 2020-05-18T21:31:46.247 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:46.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.248 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:46.248 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:46.248 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:46.248 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:46.248 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:46.249 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:46.249 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:44.101697+0000", 2020-05-18T21:31:46.249 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:46.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:46.249 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:46.250 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:46.250 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:46.250 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:46.250 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.250 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:44.101697+0000", 2020-05-18T21:31:46.250 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:46.251 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 2, 2020-05-18T21:31:46.251 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 2 2020-05-18T21:31:46.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.251 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:46.251 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.252 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.252 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.252 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.252 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.252 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:37.764196+0000" 2020-05-18T21:31:46.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.253 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:46.253 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.253 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.253 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.253 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.254 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.254 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:30.216980+0000" 2020-05-18T21:31:46.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.254 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 5, 2020-05-18T21:31:46.254 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:46.255 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:46.255 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:46.255 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:46.255 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:46.255 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:46.255 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:46.256 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:46.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.256 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:46.256 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:46.256 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:46.257 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:46.257 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:46.257 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:46.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.257 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:46.257 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:46.258 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:46.258 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": false, 2020-05-18T21:31:46.258 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.258 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.259 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.259 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.259 INFO:teuthology.orchestra.run.smithi063.stdout: 0, 2020-05-18T21:31:46.259 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.259 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.259 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 1 2020-05-18T21:31:46.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.260 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.260 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.260 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.261 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.261 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": 0, 2020-05-18T21:31:46.261 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 0 2020-05-18T21:31:46.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.262 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 0, 2020-05-18T21:31:46.262 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.262 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.262 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.262 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.263 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.263 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.263 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.263 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.263 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:46.264 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:46.264 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:46.264 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:46.264 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:46.264 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:46.265 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": { 2020-05-18T21:31:46.265 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.265 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "mix", 2020-05-18T21:31:46.265 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.265 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.266 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.266 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.266 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.266 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:46.266 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:46.267 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [], 2020-05-18T21:31:46.267 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:46.267 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:46.267 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:46.267 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:46.268 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [] 2020-05-18T21:31:46.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.268 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 3, 2020-05-18T21:31:46.268 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:46.268 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.184087+0000", 2020-05-18T21:31:46.269 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.184087+0000", 2020-05-18T21:31:46.269 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16877, 2020-05-18T21:31:46.269 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:46.269 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:46.269 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:46.270 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:46.270 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:46.270 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:46.270 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:46.270 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:46.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.271 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:46.271 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:46.271 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:46.271 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:46.272 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:46.272 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:46.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.272 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:46.273 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:46.273 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:46.273 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:46.273 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:46.273 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:46.274 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.184087+0000", 2020-05-18T21:31:46.274 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:46.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:46.274 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:46.274 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:46.274 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:46.275 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:46.275 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.275 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:46.275 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:46.275 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.184087+0000" 2020-05-18T21:31:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.279 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.184087+0000" 2020-05-18T21:31:46.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.279 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:46.279 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:46.279 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:46.279 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:46.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.281 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:46.281 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:46.281 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:46.282 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:46.282 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:46.282 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:46.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: -2, 2020-05-18T21:31:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": {}, 2020-05-18T21:31:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 0, 2020-05-18T21:31:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.287 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.287 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.287 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.287 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.287 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:46.289 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:46.289 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:46.289 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:46.289 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:46.289 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:46.291 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [] 2020-05-18T21:31:46.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.291 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1552, 2020-05-18T21:31:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181913+0000", 2020-05-18T21:31:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181913+0000", 2020-05-18T21:31:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:46.293 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:46.293 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:46.293 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:46.293 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:46.294 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:46.294 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:46.294 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:46.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.294 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:46.295 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:46.295 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:46.295 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:46.295 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:46.295 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181913+0000", 2020-05-18T21:31:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:46.298 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:46.298 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:46.298 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:46.304 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.304 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:46.306 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:46.306 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:46.306 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:46.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181913+0000" 2020-05-18T21:31:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181913+0000" 2020-05-18T21:31:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:46.318 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.318 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.318 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.318 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.318 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:46.320 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:46.320 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:46.320 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:46.320 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:46.320 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:46.321 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:46.321 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:46.321 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.321 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.321 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray6", 2020-05-18T21:31:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x610", 2020-05-18T21:31:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:46.324 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:46.324 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:46.324 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:46.324 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:46.325 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:46.325 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.325 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.325 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:46.326 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.326 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.326 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.326 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.326 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.327 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.327 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.327 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.327 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.327 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.328 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.328 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.328 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.328 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.328 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:46.329 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:46.329 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.329 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.329 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:46.330 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:46.330 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.330 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1551, 2020-05-18T21:31:46.330 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:46.331 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181638+0000", 2020-05-18T21:31:46.331 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181638+0000", 2020-05-18T21:31:46.331 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:46.331 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:46.331 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:46.332 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:46.332 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:46.332 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:46.332 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:46.332 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:46.332 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:46.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.333 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:46.333 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:46.333 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:46.333 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:46.334 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:46.334 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:46.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.335 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:46.335 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:46.335 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:46.335 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:46.336 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:46.336 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:46.336 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181638+0000", 2020-05-18T21:31:46.336 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:46.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:46.337 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:46.337 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:46.337 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:46.337 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:46.337 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.337 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:46.338 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:46.338 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:46.338 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:46.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.338 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:46.339 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.339 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.339 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.339 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.339 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.339 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181638+0000" 2020-05-18T21:31:46.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.340 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:46.340 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.340 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.340 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.341 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.341 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.341 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181638+0000" 2020-05-18T21:31:46.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.341 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:46.342 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:46.342 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:46.342 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:46.342 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:46.342 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:46.342 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:46.343 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:46.343 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:46.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.343 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:46.343 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:46.344 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:46.344 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:46.344 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:46.344 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:46.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.345 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:46.345 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:46.345 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:46.345 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.345 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.346 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.346 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.346 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.346 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.347 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.347 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.347 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.347 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.347 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.348 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.348 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.348 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:46.348 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:46.348 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:46.349 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:46.349 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.349 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:46.349 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.349 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.350 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.350 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.350 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.350 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.350 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.351 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.351 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:46.351 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:46.351 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:46.351 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:46.352 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:46.352 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:46.352 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:46.352 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:46.352 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:46.353 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.353 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.353 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:46.353 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.353 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:46.354 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:46.354 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:46.354 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:46.354 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:46.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.355 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray5", 2020-05-18T21:31:46.355 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60f", 2020-05-18T21:31:46.355 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:46.355 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:46.355 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:46.356 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:46.356 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:46.356 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:46.356 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:46.356 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.357 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.357 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:46.357 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.357 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.357 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.357 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.358 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.358 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.358 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.358 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.359 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.359 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.359 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.359 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.359 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.360 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.360 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:46.360 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:46.360 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.361 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.361 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:46.361 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:46.361 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.362 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1555, 2020-05-18T21:31:46.362 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:46.362 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.182880+0000", 2020-05-18T21:31:46.362 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.182880+0000", 2020-05-18T21:31:46.363 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:46.363 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:46.363 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:46.363 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:46.363 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:46.364 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:46.364 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:46.364 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:46.364 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:46.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.364 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:46.365 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:46.365 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:46.365 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:46.365 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:46.366 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:46.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.366 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:46.366 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:46.366 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:46.367 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:46.367 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:46.367 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:46.367 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.182880+0000", 2020-05-18T21:31:46.367 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:46.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:46.368 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:46.368 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:46.368 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:46.368 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:46.368 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.369 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:46.369 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:46.369 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:46.369 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:46.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.369 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:46.370 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.370 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.370 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.370 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.370 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.371 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:46.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.371 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:46.371 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.371 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.372 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.372 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.372 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.372 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:46.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.372 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:46.373 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:46.373 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:46.373 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:46.373 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:46.374 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:46.374 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:46.374 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:46.374 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:46.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.375 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:46.375 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:46.375 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:46.375 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:46.376 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:46.376 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:46.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.376 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:46.376 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:46.377 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:46.377 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.377 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.377 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.377 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.378 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.378 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.378 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.378 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.378 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.379 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.379 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.379 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.379 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.379 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:46.380 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:46.380 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:46.380 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:46.380 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.381 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:46.381 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.381 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.381 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.381 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.381 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.382 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.382 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.382 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.383 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:46.383 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:46.383 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:46.383 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:46.383 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:46.384 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:46.384 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:46.384 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:46.384 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:46.384 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.385 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.385 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:46.385 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.385 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:46.386 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:46.386 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:46.386 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:46.386 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:46.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.386 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray9", 2020-05-18T21:31:46.387 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x613", 2020-05-18T21:31:46.387 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:46.387 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:46.387 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:46.387 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:46.388 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:46.388 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:46.388 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:46.388 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.388 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.388 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:46.389 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.389 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.389 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.389 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.390 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.390 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.390 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.390 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.390 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.391 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.391 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.391 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.391 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.391 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.392 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:46.392 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:46.392 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.392 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.393 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:46.393 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:46.393 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.393 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1550, 2020-05-18T21:31:46.394 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:46.394 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181349+0000", 2020-05-18T21:31:46.394 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181349+0000", 2020-05-18T21:31:46.394 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:46.395 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:46.395 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:46.395 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:46.395 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:46.396 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:46.396 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:46.396 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:46.396 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:46.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.397 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:46.397 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:46.397 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:46.397 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:46.397 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:46.398 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:46.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.398 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:46.398 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:46.398 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:46.398 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:46.399 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:46.399 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:46.399 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181349+0000", 2020-05-18T21:31:46.399 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:46.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:46.400 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:46.400 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:46.400 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:46.400 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:46.400 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.400 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:46.401 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:46.401 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:46.401 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:46.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.401 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:46.402 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.402 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.402 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.402 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.402 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.402 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181349+0000" 2020-05-18T21:31:46.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.403 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:46.403 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.403 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.403 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.404 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.404 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.404 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181349+0000" 2020-05-18T21:31:46.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.404 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:46.405 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:46.405 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:46.405 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:46.405 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:46.405 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:46.405 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:46.406 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:46.406 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:46.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.406 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:46.407 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:46.407 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:46.407 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:46.407 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:46.407 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:46.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.408 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:46.408 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:46.408 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:46.408 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.408 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.409 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.409 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.409 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.409 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.409 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.410 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.410 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.410 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.410 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.411 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.411 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.411 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:46.411 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:46.411 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:46.411 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:46.412 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.412 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:46.412 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.412 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.413 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.413 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.413 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.413 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.413 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.413 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.414 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:46.414 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:46.414 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:46.414 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:46.415 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:46.415 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:46.415 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:46.415 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:46.415 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:46.415 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.416 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.416 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:46.416 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.416 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:46.416 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:46.417 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:46.417 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:46.417 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:46.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.417 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray4", 2020-05-18T21:31:46.417 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60e", 2020-05-18T21:31:46.418 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:46.418 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:46.418 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:46.418 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:46.418 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:46.419 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:46.419 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:46.419 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.419 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.419 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:46.419 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.420 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.420 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.420 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.420 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.421 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.421 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.421 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.421 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.421 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.422 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.422 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.422 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.422 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.422 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:46.423 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:46.423 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.423 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.423 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:46.423 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:46.424 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.424 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1554, 2020-05-18T21:31:46.424 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:46.425 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.182533+0000", 2020-05-18T21:31:46.425 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.182533+0000", 2020-05-18T21:31:46.425 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:46.425 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:46.425 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:46.425 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:46.426 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:46.426 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:46.426 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:46.426 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:46.427 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:46.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.427 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:46.427 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:46.427 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:46.427 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:46.428 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:46.428 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:46.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.428 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:46.428 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:46.429 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:46.429 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:46.429 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:46.429 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:46.429 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.182533+0000", 2020-05-18T21:31:46.430 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:46.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:46.430 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:46.430 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:46.430 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:46.430 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:46.431 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.431 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:46.431 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:46.431 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:46.431 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:46.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.432 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:46.432 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.432 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.432 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.432 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.433 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.433 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182533+0000" 2020-05-18T21:31:46.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.433 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:46.433 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.434 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.434 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.434 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.434 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.434 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182533+0000" 2020-05-18T21:31:46.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.435 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:46.435 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:46.435 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:46.436 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:46.436 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:46.436 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:46.436 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:46.436 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:46.436 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:46.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.437 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:46.437 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:46.437 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:46.437 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:46.438 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:46.438 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:46.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.438 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:46.438 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:46.439 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:46.439 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.439 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.439 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.439 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.440 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.440 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.440 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.440 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.440 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.441 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.441 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.441 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.441 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.441 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:46.442 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:46.442 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:46.442 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:46.442 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.443 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:46.443 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.443 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.443 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.443 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.443 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.444 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.444 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.444 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.444 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:46.445 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:46.445 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:46.445 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:46.445 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:46.445 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:46.445 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:46.446 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:46.446 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:46.446 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.446 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.446 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:46.447 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.447 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:46.447 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:46.447 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:46.447 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:46.447 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:46.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.448 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray8", 2020-05-18T21:31:46.448 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x612", 2020-05-18T21:31:46.448 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:46.448 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:46.449 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:46.449 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:46.449 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:46.449 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:46.449 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:46.449 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.450 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.450 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:46.450 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.450 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.450 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.451 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.451 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.451 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.451 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.451 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.452 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.452 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.452 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.452 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.453 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.453 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.453 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:46.453 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:46.453 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.454 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.454 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:46.454 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:46.454 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.455 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1553, 2020-05-18T21:31:46.455 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:46.455 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.182214+0000", 2020-05-18T21:31:46.455 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.182214+0000", 2020-05-18T21:31:46.455 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:46.456 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:46.456 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:46.456 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:46.456 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:46.456 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:46.457 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:46.457 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:46.457 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:46.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.457 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:46.457 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:46.458 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:46.458 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:46.458 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:46.458 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:46.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.459 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:46.459 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:46.459 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:46.459 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:46.459 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:46.459 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:46.460 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.182214+0000", 2020-05-18T21:31:46.460 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:46.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:46.460 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:46.460 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:46.461 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:46.461 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:46.461 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.461 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:46.461 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:46.462 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:46.462 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:46.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.462 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:46.462 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.462 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.463 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.463 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.463 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.463 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182214+0000" 2020-05-18T21:31:46.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.464 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:46.464 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.464 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.464 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.464 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.465 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.465 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182214+0000" 2020-05-18T21:31:46.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.465 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:46.465 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:46.466 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:46.466 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:46.466 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:46.466 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:46.466 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:46.466 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:46.467 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:46.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.467 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:46.467 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:46.467 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:46.468 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:46.468 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:46.468 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:46.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.468 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:46.469 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:46.469 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:46.469 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.469 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.469 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.470 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.470 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.470 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.470 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.470 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.471 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.471 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.471 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.471 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.471 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.472 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:46.472 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:46.472 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:46.472 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:46.472 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.473 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:46.473 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.473 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.473 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.474 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.474 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.474 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.474 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.474 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.475 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:46.475 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:46.475 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:46.475 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:46.475 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:46.476 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:46.476 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:46.476 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:46.476 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:46.476 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.477 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.477 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:46.477 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.477 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:46.477 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:46.477 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:46.478 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:46.478 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:46.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.478 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray7", 2020-05-18T21:31:46.478 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x611", 2020-05-18T21:31:46.479 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:46.479 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:46.479 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:46.479 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:46.479 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:46.479 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:46.480 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:46.480 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.480 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.480 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:46.480 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.481 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.481 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.481 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.481 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.481 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.482 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.482 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.482 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.482 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.483 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.483 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.483 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.483 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.484 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:46.484 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:46.484 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.484 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.484 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:46.485 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:46.485 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.485 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1549, 2020-05-18T21:31:46.486 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:46.486 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181046+0000", 2020-05-18T21:31:46.486 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181046+0000", 2020-05-18T21:31:46.486 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:46.486 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:46.486 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:46.487 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:46.487 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:46.487 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:46.487 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:46.487 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:46.488 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:46.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.488 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:46.488 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:46.488 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:46.489 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:46.489 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:46.489 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:46.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.489 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:46.489 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:46.490 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:46.490 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:46.490 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:46.490 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:46.490 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181046+0000", 2020-05-18T21:31:46.491 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:46.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:46.491 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:46.491 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:46.491 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:46.491 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:46.492 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.492 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:46.492 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:46.492 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:46.492 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:46.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.493 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:46.493 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.493 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.493 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.493 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.494 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.494 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181046+0000" 2020-05-18T21:31:46.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.494 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:46.494 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.495 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.495 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.495 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.495 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.496 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181046+0000" 2020-05-18T21:31:46.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.496 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:46.496 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:46.496 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:46.497 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:46.497 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:46.497 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:46.497 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:46.497 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:46.497 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:46.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.498 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:46.498 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:46.498 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:46.498 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:46.499 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:46.499 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:46.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.499 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:46.499 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:46.499 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:46.500 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.500 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.500 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.500 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.501 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.501 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.501 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.501 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.501 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.502 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.502 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.502 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.502 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.502 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:46.503 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:46.503 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:46.503 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:46.503 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.503 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:46.504 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.504 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.504 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.504 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.504 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.505 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.505 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.505 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.505 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:46.506 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:46.506 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:46.506 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:46.506 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:46.506 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:46.507 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:46.507 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:46.507 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:46.507 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.507 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.508 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:46.508 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.508 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:46.508 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:46.508 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:46.508 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:46.509 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:46.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.509 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray3", 2020-05-18T21:31:46.509 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60d", 2020-05-18T21:31:46.509 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:46.510 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:46.510 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:46.510 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:46.510 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:46.510 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:46.510 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:46.511 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.511 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.511 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:46.511 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.511 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.512 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.512 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.512 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.512 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.512 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.513 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.513 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.513 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.513 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.514 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.514 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.514 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.514 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:46.514 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:46.514 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.515 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.515 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:46.515 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:46.515 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.516 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1548, 2020-05-18T21:31:46.516 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:46.516 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.180788+0000", 2020-05-18T21:31:46.516 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.180788+0000", 2020-05-18T21:31:46.517 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:46.517 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:46.517 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:46.517 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:46.517 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:46.518 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:46.518 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:46.518 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:46.518 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:46.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.518 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:46.519 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:46.519 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:46.519 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:46.519 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:46.519 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:46.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.520 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:46.520 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:46.520 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:46.520 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:46.520 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:46.521 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:46.521 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.180788+0000", 2020-05-18T21:31:46.521 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:46.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:46.521 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:46.522 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:46.522 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:46.522 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:46.522 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.522 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:46.522 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:46.523 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:46.523 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:46.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.523 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:46.523 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.524 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.524 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.524 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.524 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.524 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180788+0000" 2020-05-18T21:31:46.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.525 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:46.525 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.525 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.525 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.525 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.526 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.526 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180788+0000" 2020-05-18T21:31:46.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.526 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:46.526 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:46.527 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:46.527 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:46.527 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:46.527 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:46.527 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:46.528 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:46.528 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:46.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.528 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:46.528 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:46.529 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:46.529 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:46.529 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:46.529 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:46.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.529 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:46.530 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:46.530 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:46.530 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.530 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.530 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.531 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.531 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.531 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.531 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.531 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.532 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.532 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.532 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.532 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.533 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.533 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:46.533 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:46.533 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:46.533 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:46.533 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.534 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:46.534 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.534 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.534 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.535 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.535 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.535 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.535 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.536 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.536 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:46.536 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:46.536 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:46.537 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:46.537 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:46.537 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:46.537 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:46.537 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:46.538 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:46.538 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.538 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.538 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:46.538 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.538 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:46.539 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:46.539 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:46.539 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:46.539 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:46.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.539 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray2", 2020-05-18T21:31:46.540 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60c", 2020-05-18T21:31:46.540 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:46.540 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:46.540 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:46.540 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:46.541 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:46.541 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:46.541 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:46.541 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.541 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.542 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:46.542 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.542 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.542 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.542 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.543 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.543 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.543 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.543 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.543 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.544 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.544 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.544 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.544 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.544 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.545 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:46.545 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:46.545 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.545 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.546 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:46.546 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:46.546 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.546 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1547, 2020-05-18T21:31:46.547 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:46.547 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.180496+0000", 2020-05-18T21:31:46.547 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.180496+0000", 2020-05-18T21:31:46.547 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:46.547 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:46.548 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:46.548 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:46.548 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:46.548 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:46.548 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:46.548 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:46.549 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:46.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.549 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:46.549 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:46.549 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:46.550 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:46.550 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:46.550 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:46.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.550 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:46.550 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:46.551 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:46.551 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:46.551 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:46.551 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:46.551 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.180496+0000", 2020-05-18T21:31:46.552 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:46.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:46.552 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:46.552 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:46.552 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:46.552 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:46.553 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.553 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:46.553 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:46.553 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:46.553 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:46.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.554 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:46.554 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.554 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.554 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.554 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.555 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.555 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180496+0000" 2020-05-18T21:31:46.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.555 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:46.555 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.556 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.556 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.556 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.556 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.556 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180496+0000" 2020-05-18T21:31:46.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.557 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:46.557 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:46.557 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:46.557 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:46.557 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:46.558 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:46.558 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:46.558 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:46.558 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:46.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.558 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:46.559 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:46.559 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:46.559 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:46.559 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:46.559 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:46.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.560 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:46.560 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:46.560 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:46.560 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.560 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.561 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.561 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.561 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.561 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.562 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.562 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.562 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.562 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.562 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.563 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.563 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.563 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:46.563 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:46.563 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:46.564 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:46.564 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.564 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:46.565 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.565 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.565 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.565 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.565 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.565 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.566 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.566 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.566 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:46.566 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:46.567 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:46.567 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:46.567 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:46.567 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:46.567 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:46.567 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:46.568 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:46.568 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.568 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.568 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:46.568 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.569 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:46.569 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:46.569 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:46.569 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:46.569 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:46.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.570 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray1", 2020-05-18T21:31:46.570 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60b", 2020-05-18T21:31:46.570 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:46.570 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:46.570 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:46.571 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:46.571 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:46.571 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:46.571 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:46.571 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.571 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.572 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:46.572 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.572 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.572 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.572 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.573 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.573 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.573 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.573 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.573 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.574 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.574 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.574 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.575 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.575 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.575 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:46.575 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:46.575 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.576 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.576 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:46.576 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:46.576 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.577 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1546, 2020-05-18T21:31:46.577 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:46.577 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.180117+0000", 2020-05-18T21:31:46.577 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.180117+0000", 2020-05-18T21:31:46.578 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:46.578 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:46.578 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:46.578 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:46.578 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:46.578 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:46.579 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:46.579 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:46.579 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:46.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.579 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:46.580 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:46.580 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:46.580 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:46.580 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:46.580 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:46.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.581 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:46.581 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:46.581 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:46.581 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:46.581 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:46.582 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:46.582 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.180117+0000", 2020-05-18T21:31:46.582 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:46.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:46.582 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:46.582 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:46.583 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:46.583 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:46.583 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.583 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:46.583 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:46.584 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:46.584 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:46.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.584 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:46.585 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.585 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.585 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.585 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.585 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.586 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180117+0000" 2020-05-18T21:31:46.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.586 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:46.586 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.586 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.586 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.587 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:46.587 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.587 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180117+0000" 2020-05-18T21:31:46.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.587 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:46.588 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:46.588 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:46.588 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:46.588 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:46.588 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:46.588 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:46.589 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:46.589 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:46.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.589 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:46.589 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:46.590 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:46.590 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:46.590 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:46.590 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:46.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.590 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:46.591 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:46.591 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:46.591 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.591 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.591 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.592 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.592 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.592 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.592 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.592 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.593 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.593 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.593 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.593 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.594 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.594 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:46.594 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:46.594 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:46.594 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:46.595 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.595 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:46.595 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.595 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.595 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.596 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.596 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.596 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.596 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.597 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.597 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:46.597 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:46.597 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:46.598 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:46.598 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:46.598 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:46.598 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:46.598 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:46.598 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:46.599 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.599 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.599 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:46.599 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.599 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:46.599 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:46.600 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:46.600 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:46.600 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:46.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.600 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray0", 2020-05-18T21:31:46.601 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60a", 2020-05-18T21:31:46.601 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:46.601 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:46.601 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:46.601 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:46.601 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:46.602 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:46.602 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:46.602 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.602 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.602 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:46.603 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.603 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.603 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.603 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.604 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.604 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.604 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.604 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.604 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.604 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.605 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.605 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.605 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.605 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.606 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:46.606 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:46.606 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.606 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.606 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:46.607 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:46.607 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.608 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 257, 2020-05-18T21:31:46.608 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:46.608 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.179986+0000", 2020-05-18T21:31:46.608 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.179986+0000", 2020-05-18T21:31:46.608 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:46.609 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:46.609 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:46.609 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:46.609 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:46.609 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:46.609 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:46.610 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:46.610 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:46.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.610 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:46.610 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:46.611 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:46.611 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:46.611 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:46.611 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:46.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.611 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:46.612 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:46.612 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:46.613 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:46.613 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:46.613 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:46.613 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.179986+0000", 2020-05-18T21:31:46.614 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:46.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:46.614 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:46.614 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:46.614 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:46.615 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:46.615 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.615 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:46.615 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:46.615 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 10, 2020-05-18T21:31:46.615 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:46.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.616 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:46.616 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.616 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.616 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.617 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 11, 2020-05-18T21:31:46.617 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.617 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:46.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.617 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:46.618 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.618 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:46.618 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:46.618 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 11, 2020-05-18T21:31:46.618 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:46.618 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:46.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.619 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:46.619 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:46.619 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:46.619 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:46.620 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:46.620 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:46.620 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:46.620 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:46.620 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:46.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.621 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:46.621 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:46.621 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:46.621 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:46.621 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:46.622 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:46.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.622 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:46.622 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:46.622 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:46.622 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.623 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.623 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.623 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.623 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.624 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.624 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.624 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.624 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.625 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.625 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.625 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.626 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.626 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1 2020-05-18T21:31:46.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.626 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.626 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.627 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.627 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.627 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.627 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.627 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.628 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.628 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.628 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:46.628 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:46.629 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:46.629 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:46.629 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:46.629 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:46.629 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:46.630 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:46.630 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:46.630 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.630 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:46.630 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.630 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:46.631 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:46.631 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:46.631 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:46.631 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:46.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.632 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1", 2020-05-18T21:31:46.632 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x101", 2020-05-18T21:31:46.632 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:46.632 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:46.632 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:46.632 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:46.633 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:46.633 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:46.633 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "1", 2020-05-18T21:31:46.633 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.633 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:46.634 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:46.634 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.634 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.634 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.634 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.635 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.635 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.635 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.635 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.635 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.636 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.636 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.636 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.636 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.636 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.637 INFO:teuthology.orchestra.run.smithi063.stdout: "child": 1, 2020-05-18T21:31:46.637 INFO:teuthology.orchestra.run.smithi063.stdout: "subtree": 1, 2020-05-18T21:31:46.637 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:46.637 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:46.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.638 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 2, 2020-05-18T21:31:46.638 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [ 2020-05-18T21:31:46.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.638 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray6", 2020-05-18T21:31:46.638 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:46.638 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:46.639 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:46.639 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:46.639 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:46.639 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:46.639 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:46.640 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1552, 2020-05-18T21:31:46.640 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:46.640 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.640 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:46.640 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.640 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.641 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.641 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.641 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.641 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.642 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.642 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.642 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.642 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.643 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.643 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.643 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.643 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.643 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:46.644 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:46.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.644 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.644 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:46.644 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.645 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.645 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.645 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.645 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.645 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.646 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.646 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.646 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.646 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:46.646 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.647 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray7", 2020-05-18T21:31:46.647 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:46.647 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:46.648 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:46.648 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:46.648 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:46.648 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:46.648 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:46.648 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1553, 2020-05-18T21:31:46.649 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:46.649 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.649 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:46.649 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.649 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.650 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.650 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.650 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.650 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.650 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.651 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.651 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.651 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.651 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.651 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.652 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.652 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.652 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:46.652 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:46.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.653 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.653 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:46.653 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.653 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.653 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.654 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.654 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.654 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.654 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.654 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.655 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.655 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:46.655 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.656 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray0", 2020-05-18T21:31:46.656 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:46.656 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:46.656 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:46.656 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:46.656 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:46.657 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:46.657 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:46.657 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1546, 2020-05-18T21:31:46.657 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:46.657 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.658 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:46.658 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.658 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.658 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.658 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.659 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.659 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.659 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.659 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.659 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.660 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.660 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.660 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.660 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.660 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.661 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:46.661 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:46.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.661 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.661 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:46.662 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.662 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.662 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.662 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.662 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.662 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.663 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.663 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.663 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.663 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:46.664 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.664 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray9", 2020-05-18T21:31:46.664 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:46.664 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:46.665 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:46.665 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:46.665 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:46.665 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:46.665 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:46.666 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1555, 2020-05-18T21:31:46.666 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:46.666 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.666 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:46.666 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.666 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.667 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.667 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.667 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.667 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.668 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.668 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.668 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.668 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.669 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.669 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.669 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.669 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.669 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:46.670 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:46.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.670 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.670 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:46.671 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.671 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.671 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.671 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.671 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.671 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.672 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.672 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.672 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.672 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:46.673 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.673 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray5", 2020-05-18T21:31:46.673 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:46.673 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:46.674 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:46.674 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:46.674 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:46.674 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:46.674 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:46.675 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1551, 2020-05-18T21:31:46.675 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:46.675 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.675 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:46.675 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.675 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.676 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.676 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.676 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.676 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.677 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.677 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.677 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.677 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.677 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.678 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.678 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.678 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.678 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:46.678 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:46.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.679 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.679 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:46.679 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.679 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.679 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.680 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.680 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.680 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.680 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.680 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.681 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.681 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:46.681 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.682 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray2", 2020-05-18T21:31:46.682 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:46.682 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:46.682 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:46.682 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:46.683 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:46.683 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:46.683 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:46.683 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1548, 2020-05-18T21:31:46.684 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:46.684 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.684 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:46.684 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.684 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.684 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.685 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.685 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.685 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.685 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.686 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.686 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.686 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.686 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.686 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.687 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.687 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.687 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:46.687 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:46.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.688 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.688 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:46.688 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.688 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.688 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.688 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.689 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.689 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.689 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.689 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.690 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.690 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:46.690 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.691 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray1", 2020-05-18T21:31:46.691 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:46.691 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:46.691 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:46.691 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:46.691 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:46.692 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:46.692 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:46.692 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1547, 2020-05-18T21:31:46.692 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:46.692 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.693 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:46.693 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.693 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.693 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.693 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.694 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.694 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.694 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.694 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.695 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.695 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.695 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.695 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.696 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.696 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.696 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:46.696 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:46.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.696 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.697 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:46.697 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.697 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.697 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.697 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.698 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.698 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.698 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.698 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.699 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.699 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:46.699 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.699 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray8", 2020-05-18T21:31:46.700 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:46.700 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:46.700 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:46.700 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:46.700 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:46.701 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:46.701 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:46.701 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1554, 2020-05-18T21:31:46.701 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:46.701 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.701 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:46.702 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.702 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.702 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.702 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.703 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.703 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.703 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.703 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.703 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.703 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.704 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.704 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.704 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.704 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.705 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:46.705 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:46.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.705 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.705 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:46.706 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.706 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.706 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.712 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.712 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.712 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.713 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.713 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.713 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.713 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:46.713 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.714 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray3", 2020-05-18T21:31:46.714 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:46.714 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:46.715 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:46.715 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:46.715 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:46.715 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:46.715 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:46.715 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1549, 2020-05-18T21:31:46.716 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:46.716 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.716 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:46.716 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.716 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.717 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.717 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.717 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.717 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.718 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.718 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.718 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.718 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.718 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.719 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.719 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.719 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.719 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:46.719 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:46.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.720 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.720 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:46.720 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.720 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.720 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.721 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.721 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.721 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.721 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.721 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.722 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.722 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:46.722 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:46.723 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray4", 2020-05-18T21:31:46.723 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:46.723 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:46.723 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:46.723 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:46.723 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:46.724 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:46.724 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:46.724 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1550, 2020-05-18T21:31:46.724 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:46.724 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:46.725 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:46.725 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.725 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:46.726 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:46.726 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:46.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.726 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:46.726 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:46.728 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:46.728 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:46.728 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:46.728 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:46.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.729 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:46.729 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:46.729 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:46.729 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:46.729 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:46.730 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:46.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.730 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:46.730 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:46.730 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:46.731 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:46.731 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:46.731 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:46.731 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:46.731 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:46.731 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:46.732 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:46.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:46.732 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:46.732 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:46.732 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.733 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:46.733 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.733 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:46.733 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:46.733 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:46.733 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:31:46.735 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "ino": 1, "rdev": 0, "ctime": "2020-05-18T21:31:44.101697+0000", "btime": "2020-05-18T21:31:30.216980+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 16, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:44.101697+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:31:44.101697+0000", "num_files": 0, "num_subdirs": 2, "change_attr": 2 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:37.764196+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:30.216980+0000" }, "version": 5, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "dirfrag": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 3, "rdev": 0, "ctime": "2020-05-18T21:31:38.184087+0000", "btime": "2020-05-18T21:31:38.184087+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.184087+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.184087+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.184087+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ -2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": {}, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1552, "rdev": 0, "ctime": "2020-05-18T21:31:38.181913+0000", "btime": "2020-05-18T21:31:38.181913+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181913+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181913+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181913+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray6", "dirfrag": "0x610", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1551, "rdev": 0, "ctime": "2020-05-18T21:31:38.181638+0000", "btime": "2020-05-18T21:31:38.181638+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181638+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181638+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181638+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray5", "dirfrag": "0x60f", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1555, "rdev": 0, "ctime": "2020-05-18T21:31:38.182880+0000", "btime": "2020-05-18T21:31:38.182880+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.182880+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray9", "dirfrag": "0x613", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1550, "rdev": 0, "ctime": "2020-05-18T21:31:38.181349+0000", "btime": "2020-05-18T21:31:38.181349+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181349+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181349+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181349+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray4", "dirfrag": "0x60e", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1554, "rdev": 0, "ctime": "2020-05-18T21:31:38.182533+0000", "btime": "2020-05-18T21:31:38.182533+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.182533+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182533+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182533+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray8", "dirfrag": "0x612", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1553, "rdev": 0, "ctime": "2020-05-18T21:31:38.182214+0000", "btime": "2020-05-18T21:31:38.182214+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.182214+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182214+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182214+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray7", "dirfrag": "0x611", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1549, "rdev": 0, "ctime": "2020-05-18T21:31:38.181046+0000", "btime": "2020-05-18T21:31:38.181046+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181046+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181046+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181046+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray3", "dirfrag": "0x60d", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1548, "rdev": 0, "ctime": "2020-05-18T21:31:38.180788+0000", "btime": "2020-05-18T21:31:38.180788+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.180788+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180788+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180788+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray2", "dirfrag": "0x60c", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1547, "rdev": 0, "ctime": "2020-05-18T21:31:38.180496+0000", "btime": "2020-05-18T21:31:38.180496+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.180496+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180496+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180496+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray1", "dirfrag": "0x60b", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1546, "rdev": 0, "ctime": "2020-05-18T21:31:38.180117+0000", "btime": "2020-05-18T21:31:38.180117+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.180117+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180117+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180117+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray0", "dirfrag": "0x60a", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 257, "rdev": 0, "ctime": "2020-05-18T21:31:38.179986+0000", "btime": "2020-05-18T21:31:38.179986+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.179986+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 10, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "1", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2, "dentries": [ { "path": "stray6", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1552, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray7", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1553, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray0", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1546, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray9", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1555, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray5", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1551, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray2", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1548, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray1", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1547, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray8", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1554, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray3", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1549, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray4", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1550, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] } ] } ] } ] 2020-05-18T21:31:47.740 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok dump cache 2020-05-18T21:31:47.849 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:31:47.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:47.850 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1, 2020-05-18T21:31:47.850 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:47.850 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:44.101697+0000", 2020-05-18T21:31:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:30.216980+0000", 2020-05-18T21:31:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 17407, 2020-05-18T21:31:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:47.853 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:47.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.853 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 4194304, 2020-05-18T21:31:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 1, 2020-05-18T21:31:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 4194304, 2020-05-18T21:31:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": 16, 2020-05-18T21:31:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:44.101697+0000", 2020-05-18T21:31:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:44.101697+0000", 2020-05-18T21:31:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 2, 2020-05-18T21:31:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 2 2020-05-18T21:31:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:37.764196+0000" 2020-05-18T21:31:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:47.861 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:47.861 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:30.216980+0000" 2020-05-18T21:31:47.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.861 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 5, 2020-05-18T21:31:47.861 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:47.861 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:47.862 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:47.862 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:47.862 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:47.862 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:47.862 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:47.864 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:47.864 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:47.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.864 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:47.864 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": false, 2020-05-18T21:31:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:47.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.866 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:47.866 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:47.867 INFO:teuthology.orchestra.run.smithi063.stdout: 0, 2020-05-18T21:31:47.867 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:47.867 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 1 2020-05-18T21:31:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:47.869 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:47.869 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:47.869 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": 0, 2020-05-18T21:31:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 0 2020-05-18T21:31:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 0, 2020-05-18T21:31:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": { 2020-05-18T21:31:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:47.874 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "mix", 2020-05-18T21:31:47.874 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:47.874 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:47.874 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:47.874 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:47.875 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:47.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.875 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:47.875 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [], 2020-05-18T21:31:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [] 2020-05-18T21:31:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 3, 2020-05-18T21:31:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.184087+0000", 2020-05-18T21:31:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.184087+0000", 2020-05-18T21:31:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16877, 2020-05-18T21:31:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:47.879 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:47.879 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:47.879 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:47.879 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:47.879 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.184087+0000", 2020-05-18T21:31:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:47.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:47.883 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:47.883 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:47.883 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:47.883 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:47.890 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:47.890 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:47.890 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.184087+0000" 2020-05-18T21:31:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.184087+0000" 2020-05-18T21:31:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:47.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.898 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:47.898 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:47.898 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:47.898 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: -2, 2020-05-18T21:31:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": {}, 2020-05-18T21:31:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 0, 2020-05-18T21:31:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:47.906 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:47.906 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [] 2020-05-18T21:31:47.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1552, 2020-05-18T21:31:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181913+0000", 2020-05-18T21:31:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181913+0000", 2020-05-18T21:31:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.911 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:47.911 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:47.911 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:47.911 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:47.912 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:47.912 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:47.912 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181913+0000", 2020-05-18T21:31:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:47.915 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:47.915 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:47.915 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:47.918 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181913+0000" 2020-05-18T21:31:47.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.918 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:47.918 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181913+0000" 2020-05-18T21:31:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:47.935 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:47.936 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:47.936 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:47.936 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:47.936 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:47.936 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:47.937 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:47.937 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:47.937 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:47.937 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:47.938 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:47.938 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:47.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:47.938 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray6", 2020-05-18T21:31:47.938 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x610", 2020-05-18T21:31:47.938 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:47.939 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:47.939 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:47.939 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:47.939 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:47.939 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:47.940 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:47.940 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:47.940 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:47.940 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:47.940 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:47.941 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:47.941 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:47.941 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:47.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.941 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:47.942 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:47.942 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:47.942 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:47.942 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:47.942 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:47.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.943 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:47.943 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:47.943 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:47.943 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:47.944 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:47.944 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:47.944 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:47.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.944 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:47.945 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:47.945 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:47.945 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:47.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:47.946 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1551, 2020-05-18T21:31:47.946 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:47.946 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181638+0000", 2020-05-18T21:31:47.946 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181638+0000", 2020-05-18T21:31:47.947 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:47.947 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:47.947 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:47.947 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:47.947 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:47.948 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:47.948 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:47.948 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:47.948 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:47.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.949 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:47.949 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:47.949 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:47.949 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:47.949 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:47.951 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:47.951 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:47.951 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181638+0000", 2020-05-18T21:31:47.951 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:47.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:47.952 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:47.952 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:47.952 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:47.952 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:47.952 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:47.952 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:47.953 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:47.953 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:47.953 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:47.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.953 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181638+0000" 2020-05-18T21:31:47.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.955 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:47.955 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:47.955 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:47.955 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:47.956 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:47.956 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:47.956 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181638+0000" 2020-05-18T21:31:47.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.956 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:47.956 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:47.958 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:47.958 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:47.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.958 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:47.958 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:47.958 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:47.959 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:47.959 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:47.959 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:47.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.959 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.961 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:47.961 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:47.961 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:47.961 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:47.961 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:47.963 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:47.963 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:47.963 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:47.963 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:47.963 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:47.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.964 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:47.964 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:47.964 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:47.964 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:47.964 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:47.965 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:47.965 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:47.965 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:47.965 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:47.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.965 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:47.966 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:47.966 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:47.966 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:47.966 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:47.966 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:47.967 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:47.967 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:47.967 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:47.967 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:47.967 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:47.967 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:47.968 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:47.968 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:47.968 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:47.968 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:47.968 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray5", 2020-05-18T21:31:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60f", 2020-05-18T21:31:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:47.972 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:47.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.972 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:47.972 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:47.972 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:47.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.975 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:47.975 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:47.975 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:47.975 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:47.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:47.976 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1555, 2020-05-18T21:31:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.182880+0000", 2020-05-18T21:31:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.182880+0000", 2020-05-18T21:31:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:47.978 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:47.978 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:47.978 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:47.978 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:47.978 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:47.980 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:47.980 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:47.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.980 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:47.980 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.182880+0000", 2020-05-18T21:31:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:47.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:47.982 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:47.982 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:47.982 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:47.982 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:47.984 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:47.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:47.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:47.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:47.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:47.985 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:47.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.985 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:47.985 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:47.986 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:47.986 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:47.986 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:47.986 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:47.986 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:47.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.987 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:47.987 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:47.987 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:47.987 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.989 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:47.989 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:47.989 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:47.989 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:47.989 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:47.990 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:47.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.990 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:47.990 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:47.990 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:47.991 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:47.991 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:47.991 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:47.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.991 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:47.991 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.993 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:47.993 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:47.993 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:47.993 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:47.993 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:47.994 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:47.994 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:47.994 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:47.994 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:47.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.995 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:47.995 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:47.995 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:47.995 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:47.995 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:47.996 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:47.996 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:47.996 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:47.996 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:47.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:47.997 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:47.997 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:47.997 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:47.997 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:47.997 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:47.998 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:47.998 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:47.998 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:47.998 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:47.998 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:47.998 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray9", 2020-05-18T21:31:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x613", 2020-05-18T21:31:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:48.001 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:48.001 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:48.001 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:48.001 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:48.001 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.003 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.003 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.003 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.003 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.005 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.005 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.005 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.005 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:48.005 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1550, 2020-05-18T21:31:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181349+0000", 2020-05-18T21:31:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181349+0000", 2020-05-18T21:31:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:48.009 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:48.009 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:48.009 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:48.009 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:48.011 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:48.011 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:48.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.011 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:48.011 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181349+0000", 2020-05-18T21:31:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:48.014 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.014 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:48.014 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:48.014 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:48.014 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:48.016 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:48.016 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181349+0000" 2020-05-18T21:31:48.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.017 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:48.017 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.017 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:48.017 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181349+0000" 2020-05-18T21:31:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:48.019 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:48.019 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:48.019 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:48.019 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:48.019 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:48.020 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:48.020 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:48.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.020 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:48.020 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:48.020 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:48.021 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:48.021 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:48.021 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:48.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.021 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:48.022 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:48.022 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:48.022 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.022 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.023 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.023 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.024 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.024 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.024 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.024 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.025 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.025 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.025 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.026 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.026 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.026 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:48.028 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:48.028 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:48.028 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:48.028 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:48.028 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:48.030 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:48.030 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:48.030 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:48.030 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:48.030 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:48.031 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:48.031 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:48.032 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.032 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:48.032 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:48.032 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.034 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray4", 2020-05-18T21:31:48.034 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60e", 2020-05-18T21:31:48.034 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:48.034 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:48.034 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:48.035 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:48.035 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:48.035 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:48.035 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:48.035 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.036 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:48.036 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:48.036 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.036 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.037 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.037 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.037 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.037 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.037 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.038 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.038 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.038 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.038 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.039 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.039 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.039 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.039 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:48.039 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:48.040 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:48.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.040 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:48.040 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:48.040 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:48.040 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.041 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1554, 2020-05-18T21:31:48.041 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:48.041 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.182533+0000", 2020-05-18T21:31:48.042 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.182533+0000", 2020-05-18T21:31:48.042 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:48.042 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:48.042 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:48.042 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:48.043 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:48.043 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:48.043 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:48.043 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:48.043 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:48.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.044 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:48.044 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:48.044 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:48.044 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:48.045 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:48.045 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:48.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.045 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:48.045 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:48.046 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:48.046 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:48.046 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:48.046 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:48.046 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.182533+0000", 2020-05-18T21:31:48.047 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:48.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:48.047 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:48.048 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:48.048 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:48.048 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:48.048 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.049 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:48.049 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:48.049 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:48.049 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:48.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.050 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:48.050 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.050 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:48.050 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:48.050 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:48.050 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:48.051 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182533+0000" 2020-05-18T21:31:48.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.051 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:48.051 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.051 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:48.052 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:48.052 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:48.052 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:48.052 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182533+0000" 2020-05-18T21:31:48.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.052 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:48.053 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:48.053 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:48.053 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:48.053 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:48.053 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:48.054 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:48.054 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:48.054 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:48.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.054 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:48.054 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:48.055 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:48.055 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:48.055 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:48.055 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:48.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.056 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:48.056 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:48.056 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:48.056 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.056 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.056 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.057 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.057 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.057 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.057 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.058 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.058 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.058 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.058 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.058 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.059 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.059 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:48.059 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:48.059 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:48.059 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:48.060 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:48.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.060 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:48.060 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:48.060 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:48.060 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:48.061 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:48.061 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:48.061 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:48.061 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:48.061 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:48.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.062 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:48.062 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:48.062 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:48.062 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:48.062 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:48.063 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:48.063 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:48.063 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:48.063 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:48.063 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.064 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:48.064 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:48.064 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.064 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:48.064 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:48.064 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:48.065 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:48.065 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:48.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.065 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray8", 2020-05-18T21:31:48.065 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x612", 2020-05-18T21:31:48.066 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:48.066 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:48.066 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:48.066 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:48.066 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:48.067 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:48.067 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:48.067 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.067 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:48.067 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:48.067 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.068 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.068 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.068 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.068 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.069 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.069 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.069 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.069 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.069 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.070 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.070 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.070 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.070 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.070 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:48.071 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:48.071 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:48.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.071 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:48.071 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:48.071 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:48.072 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.072 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1553, 2020-05-18T21:31:48.073 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:48.073 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.182214+0000", 2020-05-18T21:31:48.073 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.182214+0000", 2020-05-18T21:31:48.073 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:48.073 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:48.074 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:48.074 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:48.074 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:48.074 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:48.074 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:48.075 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:48.075 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:48.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.075 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:48.075 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:48.075 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:48.076 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:48.076 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:48.076 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:48.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.077 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:48.077 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:48.077 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:48.077 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:48.077 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:48.078 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:48.078 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.182214+0000", 2020-05-18T21:31:48.078 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:48.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:48.079 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:48.079 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:48.080 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:48.080 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:48.080 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.080 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:48.081 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:48.081 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:48.081 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:48.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.082 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:48.082 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.082 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:48.082 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:48.083 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:48.083 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:48.083 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182214+0000" 2020-05-18T21:31:48.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.083 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:48.083 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.084 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:48.084 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:48.084 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:48.084 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:48.084 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182214+0000" 2020-05-18T21:31:48.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.085 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:48.085 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:48.085 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:48.085 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:48.085 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:48.086 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:48.086 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:48.086 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:48.086 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:48.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.087 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:48.087 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:48.087 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:48.087 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:48.088 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:48.088 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:48.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.088 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:48.088 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:48.089 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:48.089 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.089 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.089 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.089 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.090 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.090 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.090 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.090 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.090 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.091 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.091 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.091 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.091 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.092 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:48.092 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:48.092 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:48.092 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:48.092 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:48.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.093 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:48.093 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:48.093 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:48.093 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:48.094 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:48.094 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:48.094 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:48.094 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:48.094 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:48.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.095 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:48.095 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:48.095 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:48.095 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:48.095 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:48.096 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:48.096 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:48.096 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:48.096 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:48.096 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.097 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:48.097 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:48.097 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.097 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:48.097 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:48.098 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:48.098 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:48.098 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:48.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.098 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray7", 2020-05-18T21:31:48.099 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x611", 2020-05-18T21:31:48.099 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:48.099 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:48.099 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:48.099 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:48.099 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:48.100 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:48.100 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:48.100 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.100 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:48.100 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:48.101 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.101 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.101 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.101 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.101 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.102 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.102 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.102 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.102 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.102 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.103 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.103 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.103 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.103 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.103 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:48.104 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:48.104 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:48.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.104 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:48.104 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:48.105 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:48.105 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.105 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1549, 2020-05-18T21:31:48.105 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:48.106 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181046+0000", 2020-05-18T21:31:48.106 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181046+0000", 2020-05-18T21:31:48.106 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:48.106 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:48.106 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:48.107 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:48.107 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:48.107 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:48.107 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:48.107 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:48.107 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:48.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.108 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:48.108 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:48.108 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:48.108 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:48.109 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:48.109 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:48.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.109 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:48.109 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:48.110 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:48.110 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:48.110 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:48.110 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:48.111 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181046+0000", 2020-05-18T21:31:48.111 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:48.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:48.111 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:48.111 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:48.111 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:48.112 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:48.112 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.112 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:48.112 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:48.112 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:48.113 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:48.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.113 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:48.113 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.113 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:48.113 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:48.114 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:48.114 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:48.114 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181046+0000" 2020-05-18T21:31:48.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.114 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:48.115 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.115 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:48.115 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:48.115 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:48.115 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:48.115 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181046+0000" 2020-05-18T21:31:48.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.116 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:48.116 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:48.116 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:48.116 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:48.117 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:48.117 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:48.117 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:48.117 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:48.117 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:48.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.118 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:48.118 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:48.118 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:48.118 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:48.119 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:48.119 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:48.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.119 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:48.119 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:48.119 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:48.120 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.120 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.120 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.120 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.121 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.121 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.121 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.121 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.121 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.122 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.122 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.122 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.122 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.122 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:48.123 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:48.123 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:48.123 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:48.123 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:48.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.123 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:48.124 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:48.124 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:48.124 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:48.124 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:48.124 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:48.125 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:48.125 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:48.125 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:48.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.125 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:48.125 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:48.126 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:48.126 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:48.126 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:48.126 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:48.126 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:48.127 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:48.127 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:48.127 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.128 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:48.128 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:48.128 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.128 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:48.129 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:48.129 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:48.129 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:48.130 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:48.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.130 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray3", 2020-05-18T21:31:48.131 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60d", 2020-05-18T21:31:48.131 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:48.131 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:48.131 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:48.132 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:48.132 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:48.132 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:48.132 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:48.132 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.133 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:48.133 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:48.133 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.133 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.133 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.134 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.134 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.134 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.134 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.135 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.135 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.135 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.135 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.135 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.136 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.136 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.136 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:48.136 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:48.137 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:48.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.137 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:48.137 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:48.137 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:48.138 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.138 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1548, 2020-05-18T21:31:48.138 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:48.139 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.180788+0000", 2020-05-18T21:31:48.139 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.180788+0000", 2020-05-18T21:31:48.139 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:48.139 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:48.139 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:48.140 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:48.140 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:48.140 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:48.140 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:48.140 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:48.140 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:48.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.141 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:48.141 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:48.141 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:48.141 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:48.142 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:48.142 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:48.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.142 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:48.142 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:48.143 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:48.143 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:48.143 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:48.143 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:48.143 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.180788+0000", 2020-05-18T21:31:48.144 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:48.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:48.144 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:48.144 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:48.144 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:48.145 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:48.145 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.145 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:48.145 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:48.145 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:48.146 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:48.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.146 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:48.146 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.146 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:48.147 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:48.147 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:48.147 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:48.147 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180788+0000" 2020-05-18T21:31:48.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.148 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:48.148 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.148 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:48.148 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:48.148 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:48.149 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:48.149 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180788+0000" 2020-05-18T21:31:48.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.149 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:48.150 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:48.150 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:48.150 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:48.150 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:48.150 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:48.150 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:48.151 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:48.151 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:48.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.151 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:48.151 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:48.152 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:48.152 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:48.152 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:48.152 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:48.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.152 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:48.153 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:48.153 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:48.153 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.153 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.153 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.154 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.154 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.154 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.155 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.155 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.155 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.155 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.156 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.156 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.156 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.156 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:48.156 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:48.156 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:48.157 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:48.157 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:48.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.157 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:48.157 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:48.158 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:48.158 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:48.158 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:48.158 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:48.159 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:48.159 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:48.159 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:48.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.160 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:48.160 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:48.160 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:48.160 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:48.160 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:48.160 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:48.161 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:48.161 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:48.161 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:48.161 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.162 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:48.162 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:48.162 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.162 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:48.162 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:48.162 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:48.163 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:48.163 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:48.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.163 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray2", 2020-05-18T21:31:48.163 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60c", 2020-05-18T21:31:48.164 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:48.164 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:48.164 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:48.164 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:48.164 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:48.164 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:48.165 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:48.165 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.165 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:48.165 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:48.165 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.165 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.166 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.166 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.166 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.166 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.167 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.167 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.167 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.167 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.167 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.168 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.168 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.168 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.168 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:48.168 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:48.169 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:48.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.169 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:48.169 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:48.169 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:48.170 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.170 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1547, 2020-05-18T21:31:48.170 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:48.170 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.180496+0000", 2020-05-18T21:31:48.171 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.180496+0000", 2020-05-18T21:31:48.171 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:48.171 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:48.171 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:48.171 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:48.172 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:48.172 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:48.172 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:48.172 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:48.172 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:48.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.173 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:48.173 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:48.173 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:48.174 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:48.174 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:48.174 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:48.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.174 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:48.175 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:48.175 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:48.175 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:48.176 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:48.176 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:48.176 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.180496+0000", 2020-05-18T21:31:48.177 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:48.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:48.177 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:48.177 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:48.178 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:48.178 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:48.178 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.179 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:48.179 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:48.179 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:48.179 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:48.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.180 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:48.180 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.180 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:48.180 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:48.180 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:48.181 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:48.181 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180496+0000" 2020-05-18T21:31:48.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.181 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:48.181 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.182 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:48.182 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:48.182 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:48.182 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:48.182 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180496+0000" 2020-05-18T21:31:48.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.183 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:48.183 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:48.183 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:48.183 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:48.183 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:48.184 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:48.184 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:48.184 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:48.184 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:48.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.184 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:48.185 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:48.185 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:48.185 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:48.185 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:48.185 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:48.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.186 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:48.186 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:48.186 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:48.186 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.187 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.187 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.187 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.187 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.188 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.188 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.188 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.188 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.189 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.189 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.189 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.189 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.189 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:48.190 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:48.191 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:48.191 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:48.191 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:48.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.192 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:48.192 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:48.192 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:48.192 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:48.193 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:48.193 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:48.193 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:48.193 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:48.193 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:48.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.194 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:48.194 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:48.194 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:48.194 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:48.195 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:48.195 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:48.195 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:48.195 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:48.195 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:48.195 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.196 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:48.196 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:48.196 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.196 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:48.196 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:48.197 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:48.197 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:48.197 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:48.197 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.197 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray1", 2020-05-18T21:31:48.197 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60b", 2020-05-18T21:31:48.198 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:48.198 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:48.198 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:48.198 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:48.198 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:48.199 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:48.199 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:48.199 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.199 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:48.199 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:48.199 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.200 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.200 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.200 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.200 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.201 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.201 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.201 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.201 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.201 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.202 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.202 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.202 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.202 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.202 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:48.203 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:48.203 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:48.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.203 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:48.203 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:48.203 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:48.204 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.204 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1546, 2020-05-18T21:31:48.204 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:48.205 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.180117+0000", 2020-05-18T21:31:48.205 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.180117+0000", 2020-05-18T21:31:48.205 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:48.205 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:48.205 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:48.206 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:48.206 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:48.206 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:48.206 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:48.206 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:48.206 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:48.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.207 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:48.207 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:48.207 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:48.207 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:48.208 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:48.208 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:48.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.208 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:48.208 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:48.208 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:48.209 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:48.209 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:48.209 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:48.209 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.180117+0000", 2020-05-18T21:31:48.209 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:48.210 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:48.210 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:48.210 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:48.210 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:48.210 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:48.210 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.211 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:48.211 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:48.211 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:48.211 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:48.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.211 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:48.212 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.212 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:48.212 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:48.212 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:48.212 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:48.213 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180117+0000" 2020-05-18T21:31:48.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.213 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:48.213 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.213 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:48.213 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:48.214 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:48.214 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:48.214 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180117+0000" 2020-05-18T21:31:48.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.214 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:48.215 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:48.215 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:48.215 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:48.215 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:48.215 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:48.215 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:48.216 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:48.216 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:48.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.216 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:48.216 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:48.217 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:48.217 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:48.217 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:48.217 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:48.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.217 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:48.218 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:48.218 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:48.218 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.218 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.218 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.219 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.219 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.220 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.220 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.220 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.221 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.221 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.221 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.221 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.222 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.222 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:48.222 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:48.222 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:48.222 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:48.222 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:48.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.223 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:48.223 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:48.223 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:48.223 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:48.224 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:48.224 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:48.224 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:48.224 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:48.224 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:48.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.225 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:48.225 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:48.225 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:48.225 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:48.225 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:48.226 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:48.226 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:48.226 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:48.226 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:48.226 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.227 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:48.227 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:48.227 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.227 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:48.227 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:48.228 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:48.228 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:48.228 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:48.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.229 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray0", 2020-05-18T21:31:48.229 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60a", 2020-05-18T21:31:48.229 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:48.229 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:48.229 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:48.230 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:48.230 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:48.230 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:48.230 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:48.231 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.231 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:48.231 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:48.231 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.231 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.232 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.232 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.232 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.232 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.232 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.233 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.233 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.233 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.233 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.234 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.234 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.234 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.234 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:48.234 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:48.234 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:48.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.235 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:48.235 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:48.235 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:48.235 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.236 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 257, 2020-05-18T21:31:48.236 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:48.236 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.179986+0000", 2020-05-18T21:31:48.237 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.179986+0000", 2020-05-18T21:31:48.237 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:48.237 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:48.237 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:48.237 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:48.237 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:48.238 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:48.238 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:48.238 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:48.238 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:48.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.239 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:48.239 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:48.239 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:48.239 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:48.240 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:48.240 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:48.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.240 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:48.240 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:48.241 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:48.241 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:48.241 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:48.241 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:48.241 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.179986+0000", 2020-05-18T21:31:48.242 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:48.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:48.242 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:48.242 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:48.242 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:48.243 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:48.243 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.243 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:48.243 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:48.243 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 10, 2020-05-18T21:31:48.243 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:48.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.244 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:48.244 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.244 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:48.244 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:48.245 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 11, 2020-05-18T21:31:48.245 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:48.245 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:48.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.245 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:48.245 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.246 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:48.246 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:48.246 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 11, 2020-05-18T21:31:48.246 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:48.246 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:48.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.247 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:48.247 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:48.247 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:48.247 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:48.247 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:48.248 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:48.248 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:48.248 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:48.248 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:48.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.249 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:48.249 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:48.249 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:48.249 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:48.249 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:48.250 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:48.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.250 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:48.250 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:48.251 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:48.251 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.251 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.251 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.252 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.252 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.252 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.252 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.252 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.253 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.253 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.253 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.253 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.253 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.254 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1 2020-05-18T21:31:48.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.254 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:48.254 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:48.254 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:48.255 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:48.255 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:48.255 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:48.255 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:48.255 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:48.255 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:48.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.256 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:48.256 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:48.256 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:48.256 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:48.257 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:48.257 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:48.257 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:48.257 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:48.257 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:48.258 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.258 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:48.258 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.258 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:48.258 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:48.258 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:48.259 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:48.259 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:48.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.259 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1", 2020-05-18T21:31:48.259 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x101", 2020-05-18T21:31:48.260 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:48.260 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:48.260 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:48.260 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:48.260 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:48.260 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:48.261 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "1", 2020-05-18T21:31:48.261 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.261 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:48.261 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:48.261 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.262 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.262 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.262 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.262 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.263 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.263 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.263 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.263 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.263 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.264 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.264 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.264 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.264 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.265 INFO:teuthology.orchestra.run.smithi063.stdout: "child": 1, 2020-05-18T21:31:48.265 INFO:teuthology.orchestra.run.smithi063.stdout: "subtree": 1, 2020-05-18T21:31:48.265 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:48.265 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:48.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.265 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 2, 2020-05-18T21:31:48.266 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [ 2020-05-18T21:31:48.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.266 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray6", 2020-05-18T21:31:48.266 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:48.266 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:48.267 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:48.267 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:48.267 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:48.267 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:48.267 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:48.267 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1552, 2020-05-18T21:31:48.268 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:48.268 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.268 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:48.268 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.268 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.269 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.269 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.269 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.269 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.269 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.270 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.270 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.270 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.270 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.271 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.271 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.271 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.271 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:48.271 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:48.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.272 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:48.272 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:48.272 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:48.272 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:48.272 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:48.273 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:48.273 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:48.273 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:48.273 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:48.273 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:48.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.274 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.274 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:48.274 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.275 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray7", 2020-05-18T21:31:48.275 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:48.275 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:48.275 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:48.275 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:48.276 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:48.276 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:48.276 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:48.276 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1553, 2020-05-18T21:31:48.276 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:48.276 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.277 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:48.277 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.277 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.277 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.277 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.278 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.278 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.278 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.278 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.278 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.279 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.279 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.279 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.279 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.280 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.280 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:48.280 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:48.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.280 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:48.280 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:48.281 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:48.281 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:48.281 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:48.281 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:48.281 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:48.282 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:48.282 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:48.282 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:48.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.282 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.283 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:48.283 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.283 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray0", 2020-05-18T21:31:48.284 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:48.284 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:48.284 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:48.284 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:48.284 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:48.285 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:48.285 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:48.285 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1546, 2020-05-18T21:31:48.285 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:48.285 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.286 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:48.286 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.286 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.286 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.286 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.287 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.287 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.287 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.287 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.287 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.288 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.288 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.288 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.288 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.288 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.289 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:48.289 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:48.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.289 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:48.289 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:48.290 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:48.290 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:48.290 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:48.290 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:48.290 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:48.291 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:48.291 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:48.291 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:48.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.291 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.291 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:48.292 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.292 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray9", 2020-05-18T21:31:48.292 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:48.293 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:48.293 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:48.293 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:48.293 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:48.293 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:48.293 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:48.294 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1555, 2020-05-18T21:31:48.294 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:48.294 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.294 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:48.294 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.295 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.295 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.295 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.295 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.295 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.296 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.296 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.296 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.296 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.297 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.297 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.297 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.297 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.297 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:48.297 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:48.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.298 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:48.298 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:48.298 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:48.298 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:48.299 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:48.299 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:48.299 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:48.299 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:48.299 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:48.299 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:48.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.300 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.300 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:48.300 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.301 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray5", 2020-05-18T21:31:48.301 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:48.301 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:48.301 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:48.301 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:48.302 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:48.302 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:48.302 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:48.302 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1551, 2020-05-18T21:31:48.302 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:48.303 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.303 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:48.303 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.303 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.303 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.303 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.304 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.304 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.304 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.304 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.305 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.305 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.305 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.305 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.305 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.306 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.306 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:48.306 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:48.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.306 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:48.307 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:48.307 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:48.307 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:48.307 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:48.307 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:48.307 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:48.308 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:48.308 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:48.308 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:48.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.308 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.309 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:48.309 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.309 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray2", 2020-05-18T21:31:48.309 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:48.310 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:48.310 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:48.310 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:48.310 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:48.310 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:48.311 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:48.311 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1548, 2020-05-18T21:31:48.311 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:48.311 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.311 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:48.311 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.312 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.312 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.312 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.312 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.313 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.313 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.313 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.313 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.313 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.314 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.314 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.314 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.314 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.314 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:48.315 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:48.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.315 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:48.315 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:48.315 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:48.315 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:48.316 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:48.316 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:48.316 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:48.316 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:48.316 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:48.317 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:48.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.317 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.317 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:48.317 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.318 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray1", 2020-05-18T21:31:48.318 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:48.318 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:48.318 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:48.319 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:48.319 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:48.319 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:48.319 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:48.319 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1547, 2020-05-18T21:31:48.320 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:48.320 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.320 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:48.320 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.321 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.321 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.321 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.321 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.322 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.322 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.322 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.322 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.322 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.323 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.323 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.323 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.323 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.323 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:48.324 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:48.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.324 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:48.324 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:48.324 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:48.325 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:48.325 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:48.325 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:48.325 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:48.325 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:48.326 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:48.326 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:48.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.326 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.326 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:48.326 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.327 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray8", 2020-05-18T21:31:48.327 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:48.327 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:48.328 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:48.328 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:48.328 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:48.328 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:48.329 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:48.329 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1554, 2020-05-18T21:31:48.329 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:48.329 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.329 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:48.329 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.330 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.330 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.330 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.330 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.331 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.331 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.331 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.331 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.332 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.332 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.332 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.332 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.332 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.333 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:48.333 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:48.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.333 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:48.333 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:48.334 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:48.334 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:48.334 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:48.334 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:48.334 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:48.335 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:48.335 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:48.335 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:48.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.335 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.335 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:48.336 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.336 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray3", 2020-05-18T21:31:48.336 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:48.337 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:48.337 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:48.337 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:48.337 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:48.337 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:48.337 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:48.338 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1549, 2020-05-18T21:31:48.343 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:48.344 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.344 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:48.344 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.344 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.344 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.345 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.345 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.345 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.345 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.346 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.346 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.346 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.346 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.347 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.347 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.347 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.347 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:48.347 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:48.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.348 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:48.348 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:48.348 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:48.348 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:48.348 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:48.348 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:48.349 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:48.349 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:48.349 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:48.349 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:48.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.350 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.350 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:48.350 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:48.351 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray4", 2020-05-18T21:31:48.351 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:48.351 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:48.351 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:48.351 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:48.352 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:48.352 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:48.352 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:48.352 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1550, 2020-05-18T21:31:48.352 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:48.352 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:48.353 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:48.353 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.353 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:48.353 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:48.353 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:48.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.354 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:48.354 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:48.354 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:48.354 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:48.355 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:48.355 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:48.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.355 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:48.355 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:48.355 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:48.356 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:48.356 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:48.356 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:48.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.356 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:48.357 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:48.357 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:48.357 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:48.357 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:48.357 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:48.357 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:48.358 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:48.358 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:48.358 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:48.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:48.358 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:48.359 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:48.359 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.359 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:48.359 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.359 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:48.359 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:48.360 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:48.360 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:31:48.361 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "ino": 1, "rdev": 0, "ctime": "2020-05-18T21:31:44.101697+0000", "btime": "2020-05-18T21:31:30.216980+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 16, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:44.101697+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:31:44.101697+0000", "num_files": 0, "num_subdirs": 2, "change_attr": 2 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:37.764196+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:30.216980+0000" }, "version": 5, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "dirfrag": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 3, "rdev": 0, "ctime": "2020-05-18T21:31:38.184087+0000", "btime": "2020-05-18T21:31:38.184087+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.184087+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.184087+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.184087+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ -2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": {}, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1552, "rdev": 0, "ctime": "2020-05-18T21:31:38.181913+0000", "btime": "2020-05-18T21:31:38.181913+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181913+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181913+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181913+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray6", "dirfrag": "0x610", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1551, "rdev": 0, "ctime": "2020-05-18T21:31:38.181638+0000", "btime": "2020-05-18T21:31:38.181638+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181638+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181638+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181638+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray5", "dirfrag": "0x60f", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1555, "rdev": 0, "ctime": "2020-05-18T21:31:38.182880+0000", "btime": "2020-05-18T21:31:38.182880+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.182880+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray9", "dirfrag": "0x613", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1550, "rdev": 0, "ctime": "2020-05-18T21:31:38.181349+0000", "btime": "2020-05-18T21:31:38.181349+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181349+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181349+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181349+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray4", "dirfrag": "0x60e", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1554, "rdev": 0, "ctime": "2020-05-18T21:31:38.182533+0000", "btime": "2020-05-18T21:31:38.182533+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.182533+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182533+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182533+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray8", "dirfrag": "0x612", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1553, "rdev": 0, "ctime": "2020-05-18T21:31:38.182214+0000", "btime": "2020-05-18T21:31:38.182214+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.182214+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182214+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182214+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray7", "dirfrag": "0x611", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1549, "rdev": 0, "ctime": "2020-05-18T21:31:38.181046+0000", "btime": "2020-05-18T21:31:38.181046+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181046+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181046+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181046+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray3", "dirfrag": "0x60d", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1548, "rdev": 0, "ctime": "2020-05-18T21:31:38.180788+0000", "btime": "2020-05-18T21:31:38.180788+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.180788+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180788+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180788+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray2", "dirfrag": "0x60c", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1547, "rdev": 0, "ctime": "2020-05-18T21:31:38.180496+0000", "btime": "2020-05-18T21:31:38.180496+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.180496+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180496+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180496+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray1", "dirfrag": "0x60b", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1546, "rdev": 0, "ctime": "2020-05-18T21:31:38.180117+0000", "btime": "2020-05-18T21:31:38.180117+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.180117+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180117+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180117+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray0", "dirfrag": "0x60a", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 257, "rdev": 0, "ctime": "2020-05-18T21:31:38.179986+0000", "btime": "2020-05-18T21:31:38.179986+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.179986+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 10, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "1", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2, "dentries": [ { "path": "stray6", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1552, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray7", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1553, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray0", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1546, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray9", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1555, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray5", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1551, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray2", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1548, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray1", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1547, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray8", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1554, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray3", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1549, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray4", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1550, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] } ] } ] } ] 2020-05-18T21:31:49.365 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok dump cache 2020-05-18T21:31:49.473 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:31:49.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.474 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1, 2020-05-18T21:31:49.474 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:49.474 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:44.101697+0000", 2020-05-18T21:31:49.474 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:30.216980+0000", 2020-05-18T21:31:49.475 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 17407, 2020-05-18T21:31:49.475 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:49.475 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:49.475 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:49.475 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:49.476 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:49.476 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:49.476 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:49.476 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:49.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.477 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:49.477 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 4194304, 2020-05-18T21:31:49.477 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 1, 2020-05-18T21:31:49.477 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 4194304, 2020-05-18T21:31:49.477 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": 16, 2020-05-18T21:31:49.478 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:49.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.478 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:49.478 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:49.478 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:49.478 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:49.479 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:49.479 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:49.479 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:44.101697+0000", 2020-05-18T21:31:49.479 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:49.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:49.480 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:49.480 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:49.480 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:49.480 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:49.480 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.481 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:44.101697+0000", 2020-05-18T21:31:49.481 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:49.481 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 2, 2020-05-18T21:31:49.481 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 2 2020-05-18T21:31:49.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.482 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:49.482 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.482 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.482 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.483 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.483 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.483 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:37.764196+0000" 2020-05-18T21:31:49.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.483 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:49.483 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.484 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.484 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.484 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.484 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.484 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:30.216980+0000" 2020-05-18T21:31:49.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.485 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 5, 2020-05-18T21:31:49.485 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:49.485 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:49.485 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:49.486 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:49.486 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:49.486 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:49.486 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:49.486 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:49.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.487 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:49.487 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:49.487 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:49.487 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:49.487 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:49.488 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:49.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.488 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:49.488 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:49.488 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:49.488 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": false, 2020-05-18T21:31:49.489 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.489 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.489 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.489 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.490 INFO:teuthology.orchestra.run.smithi063.stdout: 0, 2020-05-18T21:31:49.490 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.490 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.490 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 1 2020-05-18T21:31:49.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.491 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.491 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.491 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.491 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.491 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": 0, 2020-05-18T21:31:49.491 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 0 2020-05-18T21:31:49.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.492 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 0, 2020-05-18T21:31:49.492 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.492 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.492 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.493 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.493 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.493 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.493 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.493 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.494 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:49.494 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:49.494 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:49.494 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:49.495 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:49.495 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:49.495 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": { 2020-05-18T21:31:49.495 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.495 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "mix", 2020-05-18T21:31:49.496 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.496 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.496 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.496 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.496 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.497 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:49.497 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:49.497 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [], 2020-05-18T21:31:49.497 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:49.498 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:49.498 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:49.498 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:49.498 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [] 2020-05-18T21:31:49.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.499 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 3, 2020-05-18T21:31:49.499 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:49.499 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.184087+0000", 2020-05-18T21:31:49.499 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.184087+0000", 2020-05-18T21:31:49.499 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16877, 2020-05-18T21:31:49.500 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:49.500 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:49.500 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:49.500 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:49.500 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:49.500 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:49.501 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:49.501 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:49.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.501 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:49.501 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:49.502 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:49.502 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:49.502 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:49.502 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:49.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.503 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:49.503 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:49.503 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:49.503 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:49.503 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:49.503 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:49.504 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.184087+0000", 2020-05-18T21:31:49.504 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:49.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:49.504 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:49.504 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:49.505 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:49.505 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:49.505 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.505 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:49.505 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:49.505 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:49.506 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:49.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.506 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:49.506 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.506 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.507 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.507 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.507 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.507 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.184087+0000" 2020-05-18T21:31:49.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.507 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:49.508 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.508 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.508 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.509 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.509 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.509 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.184087+0000" 2020-05-18T21:31:49.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.509 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:49.509 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:49.510 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:49.510 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:49.510 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:49.510 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:49.510 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:49.511 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:49.511 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:49.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.511 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:49.511 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:49.511 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:49.512 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:49.512 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:49.512 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:49.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.512 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:49.513 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:49.513 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:49.513 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.513 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.513 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.514 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.514 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.514 INFO:teuthology.orchestra.run.smithi063.stdout: -2, 2020-05-18T21:31:49.514 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.514 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.515 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.515 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.515 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.515 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.516 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": {}, 2020-05-18T21:31:49.516 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 0, 2020-05-18T21:31:49.516 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.516 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.516 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.516 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.517 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.517 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.517 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.517 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.518 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:49.518 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:49.518 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:49.518 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:49.518 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:49.518 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:49.519 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:49.519 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:49.519 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:49.519 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.519 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:49.520 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.520 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:49.520 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:49.520 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:49.520 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:49.520 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [] 2020-05-18T21:31:49.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.521 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1552, 2020-05-18T21:31:49.521 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:49.521 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181913+0000", 2020-05-18T21:31:49.522 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181913+0000", 2020-05-18T21:31:49.522 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:49.522 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:49.522 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:49.522 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:49.523 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:49.523 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:49.523 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:49.523 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:49.523 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:49.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.524 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:49.524 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:49.524 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:49.524 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:49.524 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:49.525 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:49.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.525 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:49.525 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:49.525 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:49.526 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:49.526 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:49.526 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:49.526 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181913+0000", 2020-05-18T21:31:49.526 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:49.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:49.527 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:49.527 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:49.527 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:49.527 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:49.527 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.528 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:49.528 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:49.528 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:49.528 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:49.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.529 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:49.530 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.530 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.530 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.530 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.530 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.531 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181913+0000" 2020-05-18T21:31:49.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.531 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:49.531 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.531 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.532 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.532 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.532 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.532 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181913+0000" 2020-05-18T21:31:49.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.532 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:49.533 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:49.533 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:49.533 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:49.533 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:49.533 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:49.534 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:49.534 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:49.534 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:49.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.534 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:49.535 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:49.535 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:49.535 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:49.535 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:49.535 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:49.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.536 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:49.536 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:49.536 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:49.537 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.537 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.537 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.537 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.537 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.538 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.538 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.538 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.538 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.539 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.539 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.539 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.539 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.539 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:49.539 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:49.540 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:49.540 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:49.540 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.540 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:49.541 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.541 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.541 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.541 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.541 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.542 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.542 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.542 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.542 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:49.542 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:49.543 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:49.543 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:49.543 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:49.543 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:49.543 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:49.544 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:49.544 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:49.544 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.544 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.544 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:49.544 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.545 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:49.545 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:49.545 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:49.545 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:49.545 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:49.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.546 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray6", 2020-05-18T21:31:49.546 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x610", 2020-05-18T21:31:49.546 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:49.546 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:49.546 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:49.547 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:49.547 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:49.547 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:49.547 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:49.547 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.548 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.548 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:49.548 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.548 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.548 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.548 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.549 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.549 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.549 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.549 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.550 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.550 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.550 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.550 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.550 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.551 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.551 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:49.551 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:49.551 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.552 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.552 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:49.552 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:49.552 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.553 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1551, 2020-05-18T21:31:49.553 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:49.553 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181638+0000", 2020-05-18T21:31:49.553 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181638+0000", 2020-05-18T21:31:49.553 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:49.554 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:49.554 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:49.554 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:49.554 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:49.554 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:49.555 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:49.555 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:49.555 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:49.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.556 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:49.556 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:49.556 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:49.556 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:49.556 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:49.557 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:49.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.557 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:49.557 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:49.557 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:49.557 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:49.558 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:49.558 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:49.558 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181638+0000", 2020-05-18T21:31:49.558 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:49.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:49.559 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:49.559 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:49.559 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:49.559 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:49.559 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.559 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:49.560 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:49.560 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:49.562 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:49.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.562 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:49.562 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.562 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.563 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.563 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.563 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.563 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181638+0000" 2020-05-18T21:31:49.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.564 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:49.564 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.564 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.564 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.564 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.564 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.565 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181638+0000" 2020-05-18T21:31:49.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.565 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:49.565 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:49.565 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:49.566 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:49.566 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:49.566 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:49.566 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:49.566 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:49.566 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:49.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.567 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:49.567 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:49.567 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:49.567 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:49.568 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:49.568 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:49.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.568 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:49.568 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:49.568 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:49.569 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.569 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.569 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.569 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.570 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.570 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.570 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.570 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.570 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.571 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.571 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.571 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.571 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.571 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:49.571 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:49.572 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:49.572 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:49.572 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.572 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:49.573 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.573 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.573 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.573 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.573 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.573 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.574 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.574 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.574 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:49.574 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:49.575 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:49.575 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:49.575 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:49.575 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:49.575 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:49.575 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:49.576 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:49.576 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.576 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.576 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:49.576 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.577 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:49.577 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:49.577 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:49.577 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:49.577 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:49.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.578 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray5", 2020-05-18T21:31:49.578 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60f", 2020-05-18T21:31:49.578 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:49.578 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:49.578 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:49.578 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:49.579 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:49.579 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:49.579 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:49.579 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.579 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.580 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:49.580 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.580 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.580 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.580 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.581 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.581 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.581 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.581 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.581 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.582 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.582 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.582 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.582 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.582 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.583 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:49.583 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:49.583 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.583 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.583 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:49.584 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:49.584 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.584 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1555, 2020-05-18T21:31:49.585 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:49.585 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.182880+0000", 2020-05-18T21:31:49.585 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.182880+0000", 2020-05-18T21:31:49.585 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:49.585 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:49.585 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:49.586 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:49.586 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:49.586 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:49.586 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:49.586 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:49.587 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:49.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.587 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:49.587 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:49.587 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:49.587 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:49.588 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:49.588 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:49.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.588 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:49.588 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:49.589 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:49.589 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:49.589 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:49.589 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:49.589 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.182880+0000", 2020-05-18T21:31:49.589 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:49.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:49.590 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:49.590 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:49.590 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:49.590 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:49.590 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.591 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:49.591 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:49.591 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:49.591 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:49.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.592 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:49.592 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.592 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.592 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.592 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.592 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.593 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:49.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.593 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:49.593 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.593 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.594 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.594 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.594 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.594 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:49.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.595 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:49.595 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:49.595 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:49.595 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:49.595 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:49.595 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:49.596 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:49.596 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:49.596 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:49.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.596 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:49.597 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:49.597 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:49.597 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:49.597 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:49.597 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:49.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.598 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:49.598 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:49.598 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:49.598 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.598 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.599 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.599 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.599 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.599 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.599 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.600 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.600 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.600 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.600 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.600 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.601 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.601 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:49.601 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:49.601 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:49.601 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:49.602 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.602 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:49.602 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.602 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.602 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.603 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.603 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.603 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.603 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.603 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.604 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:49.604 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:49.604 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:49.604 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:49.604 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:49.605 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:49.605 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:49.605 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:49.605 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:49.605 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.606 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.606 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:49.606 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.606 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:49.606 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:49.606 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:49.607 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:49.607 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:49.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.607 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray9", 2020-05-18T21:31:49.607 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x613", 2020-05-18T21:31:49.608 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:49.608 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:49.608 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:49.608 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:49.608 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:49.608 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:49.609 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:49.609 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.609 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.609 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:49.609 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.609 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.610 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.610 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.610 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.610 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.611 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.611 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.611 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.611 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.611 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.612 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.612 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.612 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.612 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:49.612 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:49.613 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.613 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.613 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:49.613 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:49.613 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.614 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1550, 2020-05-18T21:31:49.614 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:49.614 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181349+0000", 2020-05-18T21:31:49.615 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181349+0000", 2020-05-18T21:31:49.615 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:49.615 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:49.615 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:49.615 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:49.615 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:49.616 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:49.616 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:49.616 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:49.616 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:49.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.617 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:49.617 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:49.617 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:49.617 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:49.617 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:49.617 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:49.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.618 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:49.618 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:49.618 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:49.618 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:49.619 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:49.619 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:49.619 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181349+0000", 2020-05-18T21:31:49.619 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:49.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:49.619 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:49.620 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:49.620 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:49.620 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:49.620 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.620 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:49.620 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:49.621 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:49.621 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:49.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.621 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:49.621 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.622 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.622 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.622 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.622 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.622 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181349+0000" 2020-05-18T21:31:49.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.623 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:49.623 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.623 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.623 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.623 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.624 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.624 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181349+0000" 2020-05-18T21:31:49.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.624 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:49.624 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:49.624 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:49.625 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:49.625 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:49.625 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:49.625 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:49.625 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:49.626 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:49.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.626 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:49.626 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:49.626 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:49.626 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:49.627 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:49.627 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:49.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.627 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:49.627 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:49.628 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:49.628 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.628 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.628 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.628 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.629 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.629 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.629 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.629 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.629 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.630 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.630 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.630 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.630 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.630 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:49.631 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:49.631 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:49.631 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:49.631 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.632 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:49.632 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.632 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.632 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.632 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.632 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.633 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.633 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.633 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.633 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:49.634 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:49.634 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:49.634 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:49.634 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:49.634 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:49.634 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:49.635 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:49.635 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:49.635 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.635 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.635 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:49.636 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.636 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:49.636 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:49.636 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:49.636 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:49.636 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:49.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.637 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray4", 2020-05-18T21:31:49.637 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60e", 2020-05-18T21:31:49.637 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:49.637 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:49.638 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:49.638 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:49.638 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:49.638 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:49.638 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:49.638 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.639 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.639 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:49.639 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.639 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.639 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.639 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.640 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.640 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.640 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.640 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.641 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.641 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.641 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.641 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.641 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.642 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.642 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:49.642 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:49.642 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.643 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.643 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:49.643 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:49.643 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.644 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1554, 2020-05-18T21:31:49.644 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:49.644 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.182533+0000", 2020-05-18T21:31:49.644 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.182533+0000", 2020-05-18T21:31:49.644 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:49.644 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:49.645 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:49.645 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:49.645 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:49.645 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:49.645 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:49.646 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:49.646 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:49.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.646 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:49.646 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:49.646 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:49.647 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:49.647 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:49.647 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:49.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.647 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:49.648 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:49.648 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:49.648 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:49.648 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:49.648 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:49.648 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.182533+0000", 2020-05-18T21:31:49.649 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:49.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:49.649 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:49.649 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:49.649 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:49.650 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:49.650 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.650 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:49.650 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:49.650 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:49.650 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:49.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.651 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:49.651 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.651 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.651 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.652 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.652 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.652 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182533+0000" 2020-05-18T21:31:49.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.652 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:49.652 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.653 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.653 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.653 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.653 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.653 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182533+0000" 2020-05-18T21:31:49.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.654 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:49.654 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:49.654 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:49.654 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:49.654 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:49.655 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:49.655 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:49.655 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:49.655 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:49.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.656 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:49.656 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:49.656 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:49.656 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:49.656 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:49.656 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:49.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.657 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:49.657 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:49.657 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:49.657 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.658 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.658 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.658 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.658 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.658 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.659 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.659 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.659 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.659 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.659 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.660 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.660 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.660 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:49.660 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:49.660 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:49.661 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:49.661 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.661 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:49.661 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.661 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.662 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.662 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.662 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.662 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.662 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.663 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.663 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:49.663 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:49.663 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:49.663 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:49.664 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:49.664 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:49.664 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:49.664 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:49.664 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:49.664 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.665 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.665 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:49.665 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.665 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:49.665 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:49.666 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:49.666 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:49.666 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:49.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.666 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray8", 2020-05-18T21:31:49.666 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x612", 2020-05-18T21:31:49.667 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:49.667 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:49.667 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:49.667 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:49.667 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:49.668 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:49.668 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:49.668 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.668 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.668 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:49.668 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.669 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.669 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.669 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.669 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.670 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.670 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.670 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.670 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.670 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.671 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.671 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.671 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.671 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.671 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:49.671 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:49.672 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.672 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.672 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:49.672 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:49.673 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.673 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1553, 2020-05-18T21:31:49.673 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:49.673 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.182214+0000", 2020-05-18T21:31:49.674 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.182214+0000", 2020-05-18T21:31:49.674 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:49.674 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:49.674 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:49.674 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:49.675 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:49.675 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:49.675 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:49.675 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:49.675 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:49.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.676 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:49.676 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:49.676 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:49.676 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:49.676 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:49.677 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:49.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.677 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:49.677 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:49.677 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:49.677 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:49.678 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:49.678 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:49.678 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.182214+0000", 2020-05-18T21:31:49.678 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:49.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:49.678 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:49.679 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:49.679 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:49.679 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:49.679 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.679 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:49.680 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:49.680 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:49.680 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:49.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.680 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:49.680 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.681 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.681 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.681 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.681 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.681 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182214+0000" 2020-05-18T21:31:49.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.682 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:49.682 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.682 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.682 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.682 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.683 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.683 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182214+0000" 2020-05-18T21:31:49.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.683 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:49.683 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:49.684 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:49.684 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:49.684 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:49.684 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:49.684 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:49.684 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:49.685 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:49.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.685 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:49.685 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:49.685 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:49.686 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:49.686 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:49.686 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:49.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.686 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:49.686 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:49.687 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:49.687 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.687 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.687 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.687 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.688 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.688 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.688 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.688 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.688 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.689 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.689 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.689 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.689 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.689 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:49.690 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:49.690 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:49.690 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:49.690 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.691 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:49.691 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.691 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.691 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.691 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.691 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.692 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.692 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.692 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.692 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:49.692 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:49.693 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:49.693 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:49.693 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:49.693 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:49.693 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:49.694 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:49.694 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:49.694 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.694 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.694 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:49.694 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.695 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:49.695 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:49.695 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:49.695 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:49.695 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:49.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.696 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray7", 2020-05-18T21:31:49.696 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x611", 2020-05-18T21:31:49.696 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:49.696 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:49.696 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:49.697 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:49.697 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:49.697 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:49.697 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:49.697 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.697 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.698 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:49.698 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.698 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.698 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.698 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.699 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.699 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.699 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.699 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.699 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.700 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.700 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.700 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.700 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.701 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.701 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:49.701 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:49.701 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.701 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.702 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:49.702 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:49.702 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.702 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1549, 2020-05-18T21:31:49.703 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:49.703 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181046+0000", 2020-05-18T21:31:49.703 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181046+0000", 2020-05-18T21:31:49.703 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:49.703 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:49.704 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:49.704 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:49.704 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:49.704 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:49.704 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:49.705 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:49.705 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:49.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.705 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:49.705 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:49.705 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:49.706 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:49.706 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:49.706 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:49.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.706 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:49.707 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:49.707 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:49.707 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:49.707 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:49.707 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:49.707 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181046+0000", 2020-05-18T21:31:49.708 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:49.708 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:49.708 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:49.708 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:49.708 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:49.708 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:49.709 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.709 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:49.709 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:49.709 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:49.709 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:49.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.710 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:49.710 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.710 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.710 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.710 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.711 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.711 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181046+0000" 2020-05-18T21:31:49.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.711 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:49.711 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.712 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.712 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.712 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.712 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.712 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181046+0000" 2020-05-18T21:31:49.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.713 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:49.713 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:49.713 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:49.713 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:49.713 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:49.714 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:49.714 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:49.714 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:49.714 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:49.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.714 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:49.715 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:49.715 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:49.715 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:49.715 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:49.715 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:49.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.716 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:49.716 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:49.716 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:49.716 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.716 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.717 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.717 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.717 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.717 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.717 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.718 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.718 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.718 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.718 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.719 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.719 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.719 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:49.719 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:49.719 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:49.719 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:49.720 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.720 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:49.720 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.720 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.720 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.721 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.721 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.721 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.721 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.721 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.722 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:49.722 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:49.722 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:49.722 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:49.722 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:49.723 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:49.723 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:49.723 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:49.723 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:49.723 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.724 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.724 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:49.724 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.724 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:49.724 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:49.724 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:49.725 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:49.725 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:49.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.725 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray3", 2020-05-18T21:31:49.725 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60d", 2020-05-18T21:31:49.725 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:49.726 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:49.726 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:49.726 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:49.726 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:49.726 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:49.727 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:49.727 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.727 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.727 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:49.727 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.727 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.728 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.728 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.728 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.728 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.729 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.729 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.729 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.729 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.729 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.730 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.730 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.730 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.730 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:49.730 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:49.731 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.731 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.731 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:49.731 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:49.731 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.732 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1548, 2020-05-18T21:31:49.732 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:49.732 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.180788+0000", 2020-05-18T21:31:49.732 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.180788+0000", 2020-05-18T21:31:49.733 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:49.733 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:49.733 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:49.733 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:49.733 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:49.734 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:49.734 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:49.734 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:49.734 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:49.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.734 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:49.735 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:49.735 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:49.735 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:49.735 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:49.735 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:49.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.736 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:49.736 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:49.736 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:49.736 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:49.736 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:49.737 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:49.737 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.180788+0000", 2020-05-18T21:31:49.737 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:49.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:49.737 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:49.738 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:49.738 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:49.738 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:49.738 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.738 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:49.738 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:49.739 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:49.739 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:49.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.739 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:49.739 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.739 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.740 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.740 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.740 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.740 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180788+0000" 2020-05-18T21:31:49.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.741 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:49.741 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.741 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.741 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.741 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.741 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.742 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180788+0000" 2020-05-18T21:31:49.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.742 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:49.742 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:49.742 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:49.743 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:49.743 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:49.743 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:49.743 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:49.743 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:49.743 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:49.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.744 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:49.744 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:49.744 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:49.744 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:49.744 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:49.745 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:49.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.745 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:49.745 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:49.745 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:49.746 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.746 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.746 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.746 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.746 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.747 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.747 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.747 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.747 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.748 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.748 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.748 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.748 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.748 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:49.748 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:49.749 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:49.749 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:49.749 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.749 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:49.749 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.750 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.750 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.750 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.750 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.750 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.751 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.751 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.751 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:49.751 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:49.751 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:49.752 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:49.752 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:49.752 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:49.752 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:49.752 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:49.752 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:49.753 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.753 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.753 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:49.753 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.753 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:49.754 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:49.754 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:49.754 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:49.754 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:49.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.754 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray2", 2020-05-18T21:31:49.755 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60c", 2020-05-18T21:31:49.755 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:49.755 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:49.755 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:49.755 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:49.756 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:49.756 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:49.756 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:49.756 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.756 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.756 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:49.757 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.757 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.757 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.757 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.757 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.758 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.758 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.758 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.758 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.758 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.759 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.759 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.759 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.759 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.759 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:49.760 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:49.760 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.760 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.760 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:49.761 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:49.761 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.761 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1547, 2020-05-18T21:31:49.761 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:49.762 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.180496+0000", 2020-05-18T21:31:49.762 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.180496+0000", 2020-05-18T21:31:49.762 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:49.762 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:49.762 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:49.763 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:49.763 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:49.763 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:49.763 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:49.763 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:49.763 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:49.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.764 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:49.764 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:49.764 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:49.764 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:49.765 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:49.765 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:49.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.765 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:49.765 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:49.765 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:49.766 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:49.766 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:49.766 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:49.766 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.180496+0000", 2020-05-18T21:31:49.766 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:49.767 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:49.767 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:49.767 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:49.767 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:49.767 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:49.767 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.768 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:49.768 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:49.768 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:49.768 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:49.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.768 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:49.769 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.769 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.769 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.769 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.769 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.770 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180496+0000" 2020-05-18T21:31:49.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.770 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:49.770 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.770 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.770 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.771 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.771 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.771 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180496+0000" 2020-05-18T21:31:49.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.771 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:49.772 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:49.772 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:49.772 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:49.772 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:49.772 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:49.772 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:49.773 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:49.773 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:49.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.773 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:49.773 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:49.774 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:49.774 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:49.774 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:49.774 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:49.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.774 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:49.775 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:49.775 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:49.775 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.775 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.775 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.776 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.776 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.776 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.776 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.776 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.777 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.777 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.777 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.777 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.778 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.778 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:49.778 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:49.778 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:49.778 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:49.778 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.779 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.779 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:49.779 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.779 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.779 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.779 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.780 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.780 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.780 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.780 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.781 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:49.781 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:49.781 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:49.781 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:49.781 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:49.781 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:49.782 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:49.782 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:49.782 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:49.782 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.782 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.783 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:49.783 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.783 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:49.783 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:49.783 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:49.783 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:49.784 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:49.784 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.784 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray1", 2020-05-18T21:31:49.784 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60b", 2020-05-18T21:31:49.784 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:49.785 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:49.785 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:49.785 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:49.785 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:49.785 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:49.785 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:49.786 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.786 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.786 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:49.786 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.786 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.787 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.787 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.787 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.787 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.787 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.787 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.788 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.788 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.788 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.788 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.789 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.789 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.789 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.789 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:49.789 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:49.789 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.790 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.790 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:49.790 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:49.790 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.791 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1546, 2020-05-18T21:31:49.791 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:49.791 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.180117+0000", 2020-05-18T21:31:49.791 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.180117+0000", 2020-05-18T21:31:49.792 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:49.792 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:49.792 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:49.792 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:49.792 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:49.793 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:49.793 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:49.793 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:49.793 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:49.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.793 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:49.794 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:49.794 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:49.794 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:49.794 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:49.794 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:49.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.795 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:49.795 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:49.795 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:49.795 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:49.795 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:49.796 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:49.796 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.180117+0000", 2020-05-18T21:31:49.796 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:49.796 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:49.796 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:49.797 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:49.797 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:49.797 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:49.797 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.797 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:49.797 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:49.798 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:49.798 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:49.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.798 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:49.798 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.799 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.799 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.799 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.799 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.799 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180117+0000" 2020-05-18T21:31:49.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.800 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:49.800 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.800 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.800 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.800 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:49.801 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.801 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180117+0000" 2020-05-18T21:31:49.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.801 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:49.801 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:49.801 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:49.802 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:49.802 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:49.802 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:49.802 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:49.802 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:49.802 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:49.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.803 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:49.803 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:49.803 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:49.803 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:49.804 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:49.804 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:49.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.804 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:49.804 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:49.804 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:49.805 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.805 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.805 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.805 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.806 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.806 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.806 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.806 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.806 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.807 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.807 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.807 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.807 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.807 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:49.808 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:49.808 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:49.808 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:49.808 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.808 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:49.809 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.809 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.809 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.809 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.809 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.809 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.810 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.810 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.810 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:49.810 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:49.811 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:49.811 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:49.811 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:49.811 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:49.811 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:49.811 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:49.812 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:49.812 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.812 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.812 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:49.812 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.813 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:49.813 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:49.813 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:49.813 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:49.813 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:49.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.814 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray0", 2020-05-18T21:31:49.814 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60a", 2020-05-18T21:31:49.814 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:49.814 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:49.814 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:49.814 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:49.815 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:49.815 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:49.815 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:49.815 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.815 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.816 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:49.816 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.816 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.816 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.816 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.817 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.817 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.817 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.817 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.817 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.818 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.818 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.818 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.818 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.818 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.819 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:49.819 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:49.819 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.819 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.820 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:49.820 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:49.820 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.820 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 257, 2020-05-18T21:31:49.821 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:49.821 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.179986+0000", 2020-05-18T21:31:49.821 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.179986+0000", 2020-05-18T21:31:49.821 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:49.821 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:49.822 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:49.822 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:49.822 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:49.822 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:49.822 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:49.822 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:49.823 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:49.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.823 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:49.823 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:49.823 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:49.823 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:49.824 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:49.824 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:49.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.824 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:49.824 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:49.825 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:49.825 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:49.825 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:49.825 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:49.825 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.179986+0000", 2020-05-18T21:31:49.825 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:49.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:49.826 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:49.826 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:49.826 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:49.826 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:49.827 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.827 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:49.827 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:49.827 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 10, 2020-05-18T21:31:49.827 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:49.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.828 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:49.828 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.828 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.828 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.828 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 11, 2020-05-18T21:31:49.829 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.829 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:49.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.829 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:49.829 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.829 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:49.830 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:49.830 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 11, 2020-05-18T21:31:49.830 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:49.830 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:49.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.831 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:49.831 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:49.831 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:49.831 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:49.831 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:49.831 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:49.832 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:49.832 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:49.832 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:49.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.832 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:49.832 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:49.833 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:49.833 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:49.833 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:49.833 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:49.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.834 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:49.834 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:49.834 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:49.834 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.834 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.834 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.835 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.835 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.835 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.835 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.836 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.836 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.836 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.836 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.836 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.837 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.837 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1 2020-05-18T21:31:49.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.837 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.837 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.837 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.838 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.838 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.838 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.838 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.838 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.839 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.839 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:49.839 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:49.839 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:49.839 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:49.840 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:49.840 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:49.840 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:49.840 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:49.840 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:49.841 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.841 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:49.841 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.841 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:49.841 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:49.841 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:49.842 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:49.842 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:49.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.842 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1", 2020-05-18T21:31:49.842 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x101", 2020-05-18T21:31:49.843 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:49.843 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:49.843 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:49.843 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:49.843 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:49.843 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:49.844 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "1", 2020-05-18T21:31:49.844 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.844 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:49.844 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:49.844 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.844 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.845 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.845 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.845 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.845 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.846 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.846 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.846 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.846 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.846 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.847 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.847 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.847 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.847 INFO:teuthology.orchestra.run.smithi063.stdout: "child": 1, 2020-05-18T21:31:49.847 INFO:teuthology.orchestra.run.smithi063.stdout: "subtree": 1, 2020-05-18T21:31:49.848 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:49.848 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:49.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.848 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 2, 2020-05-18T21:31:49.848 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [ 2020-05-18T21:31:49.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.849 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray6", 2020-05-18T21:31:49.849 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:49.849 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:49.849 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:49.849 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:49.850 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:49.850 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:49.850 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:49.850 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1552, 2020-05-18T21:31:49.850 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:49.850 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.851 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:49.851 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.851 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.851 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.851 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.852 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.852 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.852 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.852 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.852 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.853 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.853 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.853 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.853 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.853 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.854 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:49.854 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:49.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.854 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.854 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:49.855 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.855 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.855 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.855 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.855 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.855 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.856 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.856 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.856 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.856 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:49.856 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.857 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray7", 2020-05-18T21:31:49.857 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:49.857 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:49.858 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:49.858 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:49.858 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:49.858 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:49.858 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:49.858 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1553, 2020-05-18T21:31:49.859 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:49.859 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.859 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:49.859 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.859 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.860 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.860 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.860 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.860 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.860 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.861 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.861 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.861 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.861 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.861 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.862 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.862 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.862 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:49.862 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:49.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.863 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.863 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:49.863 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.863 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.863 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.863 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.864 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.864 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.864 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.864 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.865 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.865 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:49.865 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.865 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray0", 2020-05-18T21:31:49.866 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:49.866 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:49.866 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:49.866 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:49.866 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:49.867 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:49.867 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:49.867 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1546, 2020-05-18T21:31:49.867 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:49.867 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.867 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:49.868 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.868 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.868 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.868 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.868 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.869 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.869 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.869 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.869 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.869 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.870 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.870 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.870 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.870 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.870 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:49.871 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:49.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.871 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.871 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:49.871 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.872 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.872 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.872 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.872 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.872 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.872 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.873 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.873 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.873 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:49.873 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.874 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray9", 2020-05-18T21:31:49.874 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:49.874 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:49.874 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:49.875 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:49.875 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:49.875 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:49.875 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:49.875 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1555, 2020-05-18T21:31:49.875 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:49.876 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.876 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:49.876 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.876 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.876 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.877 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.877 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.877 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.877 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.877 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.878 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.878 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.878 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.878 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.879 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.879 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.879 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:49.879 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:49.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.879 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.880 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:49.880 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.880 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.880 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.880 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.880 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.881 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.881 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.881 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.881 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.882 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:49.882 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.882 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray5", 2020-05-18T21:31:49.882 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:49.883 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:49.883 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:49.883 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:49.883 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:49.883 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:49.884 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:49.884 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1551, 2020-05-18T21:31:49.884 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:49.884 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.884 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:49.884 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.885 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.885 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.885 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.885 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.885 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.886 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.886 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.886 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.886 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.887 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.887 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.887 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.887 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.887 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:49.887 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:49.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.888 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.888 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:49.888 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.888 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.889 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.889 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.889 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.889 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.889 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.889 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.890 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.890 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:49.890 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.891 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray2", 2020-05-18T21:31:49.891 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:49.891 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:49.891 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:49.891 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:49.892 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:49.892 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:49.892 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:49.892 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1548, 2020-05-18T21:31:49.892 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:49.892 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.893 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:49.893 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.893 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.893 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.893 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.894 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.894 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.894 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.894 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.894 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.895 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.895 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.895 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.895 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.896 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.896 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:49.896 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:49.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.896 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.896 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:49.897 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.897 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.897 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.897 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.897 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.897 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.898 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.898 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.898 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.898 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:49.899 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.899 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray1", 2020-05-18T21:31:49.899 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:49.899 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:49.900 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:49.900 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:49.900 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:49.900 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:49.900 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:49.901 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1547, 2020-05-18T21:31:49.901 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:49.901 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.901 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:49.901 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.902 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.902 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.902 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.902 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.902 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.903 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.903 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.903 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.903 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.904 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.904 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.904 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.904 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.904 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:49.904 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:49.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.905 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.905 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:49.905 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.905 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.906 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.906 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.906 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.906 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.906 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.906 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.907 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.907 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:49.907 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.908 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray8", 2020-05-18T21:31:49.908 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:49.908 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:49.908 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:49.908 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:49.909 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:49.909 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:49.909 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:49.909 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1554, 2020-05-18T21:31:49.909 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:49.909 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.910 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:49.910 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.910 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.910 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.910 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.911 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.911 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.911 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.911 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.911 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.912 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.912 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.912 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.912 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.912 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.913 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:49.913 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:49.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.913 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.913 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:49.914 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.914 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.914 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.914 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.914 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.914 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.915 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.915 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.915 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.915 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:49.916 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.916 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray3", 2020-05-18T21:31:49.916 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:49.916 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:49.917 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:49.917 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:49.917 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:49.917 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:49.917 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:49.918 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1549, 2020-05-18T21:31:49.918 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:49.918 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.918 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:49.918 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.918 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.919 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.919 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.919 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.919 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.919 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.920 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.920 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.920 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.920 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.921 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.921 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.921 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.921 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:49.921 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:49.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.922 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.922 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:49.922 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.922 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.922 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.922 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.923 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.923 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.923 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.923 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.924 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.924 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:49.924 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:49.924 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray4", 2020-05-18T21:31:49.925 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:49.925 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:49.925 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:49.925 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:49.925 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:49.926 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:49.926 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:49.926 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1550, 2020-05-18T21:31:49.926 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:49.926 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:49.926 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:49.927 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.927 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:49.927 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:49.927 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:49.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.927 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:49.928 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:49.928 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:49.928 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:49.928 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:49.928 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:49.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.929 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:49.929 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:49.929 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:49.929 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:49.929 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:49.930 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:49.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.930 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:49.930 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:49.930 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:49.931 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:49.931 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:49.931 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:49.931 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:49.931 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:49.931 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:49.932 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:49.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:49.932 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:49.932 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:49.932 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.932 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:49.933 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.933 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:49.933 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:49.933 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:49.933 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:31:49.935 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "ino": 1, "rdev": 0, "ctime": "2020-05-18T21:31:44.101697+0000", "btime": "2020-05-18T21:31:30.216980+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 16, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:44.101697+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:31:44.101697+0000", "num_files": 0, "num_subdirs": 2, "change_attr": 2 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:37.764196+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:30.216980+0000" }, "version": 5, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "dirfrag": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 3, "rdev": 0, "ctime": "2020-05-18T21:31:38.184087+0000", "btime": "2020-05-18T21:31:38.184087+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.184087+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.184087+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.184087+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ -2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": {}, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1552, "rdev": 0, "ctime": "2020-05-18T21:31:38.181913+0000", "btime": "2020-05-18T21:31:38.181913+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181913+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181913+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181913+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray6", "dirfrag": "0x610", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1551, "rdev": 0, "ctime": "2020-05-18T21:31:38.181638+0000", "btime": "2020-05-18T21:31:38.181638+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181638+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181638+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181638+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray5", "dirfrag": "0x60f", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1555, "rdev": 0, "ctime": "2020-05-18T21:31:38.182880+0000", "btime": "2020-05-18T21:31:38.182880+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.182880+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray9", "dirfrag": "0x613", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1550, "rdev": 0, "ctime": "2020-05-18T21:31:38.181349+0000", "btime": "2020-05-18T21:31:38.181349+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181349+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181349+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181349+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray4", "dirfrag": "0x60e", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1554, "rdev": 0, "ctime": "2020-05-18T21:31:38.182533+0000", "btime": "2020-05-18T21:31:38.182533+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.182533+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182533+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182533+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray8", "dirfrag": "0x612", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1553, "rdev": 0, "ctime": "2020-05-18T21:31:38.182214+0000", "btime": "2020-05-18T21:31:38.182214+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.182214+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182214+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182214+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray7", "dirfrag": "0x611", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1549, "rdev": 0, "ctime": "2020-05-18T21:31:38.181046+0000", "btime": "2020-05-18T21:31:38.181046+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181046+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181046+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181046+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray3", "dirfrag": "0x60d", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1548, "rdev": 0, "ctime": "2020-05-18T21:31:38.180788+0000", "btime": "2020-05-18T21:31:38.180788+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.180788+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180788+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180788+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray2", "dirfrag": "0x60c", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1547, "rdev": 0, "ctime": "2020-05-18T21:31:38.180496+0000", "btime": "2020-05-18T21:31:38.180496+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.180496+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180496+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180496+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray1", "dirfrag": "0x60b", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1546, "rdev": 0, "ctime": "2020-05-18T21:31:38.180117+0000", "btime": "2020-05-18T21:31:38.180117+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.180117+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180117+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180117+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray0", "dirfrag": "0x60a", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 257, "rdev": 0, "ctime": "2020-05-18T21:31:38.179986+0000", "btime": "2020-05-18T21:31:38.179986+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.179986+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 10, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "1", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2, "dentries": [ { "path": "stray6", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1552, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray7", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1553, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray0", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1546, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray9", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1555, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray5", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1551, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray2", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1548, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray1", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1547, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray8", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1554, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray3", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1549, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray4", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1550, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] } ] } ] } ] 2020-05-18T21:31:50.938 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok dump cache 2020-05-18T21:31:51.047 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:31:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1099511627778, 2020-05-18T21:31:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:44.193835+0000", 2020-05-18T21:31:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:44.171298+0000", 2020-05-18T21:31:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 33188, 2020-05-18T21:31:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 2, 2020-05-18T21:31:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 0, 2020-05-18T21:31:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 4194304, 2020-05-18T21:31:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 1, 2020-05-18T21:31:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 4194304, 2020-05-18T21:31:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": 16, 2020-05-18T21:31:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 1, 2020-05-18T21:31:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:44.169786+0000", 2020-05-18T21:31:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "2020-05-18T21:31:44.169786+0000", 2020-05-18T21:31:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 1, 2020-05-18T21:31:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 2, 2020-05-18T21:31:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 1, 2020-05-18T21:31:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 0, 2020-05-18T21:31:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:44.193835+0000" 2020-05-18T21:31:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 1, 2020-05-18T21:31:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 0, 2020-05-18T21:31:51.058 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.058 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:44.193835+0000" 2020-05-18T21:31:51.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.058 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 6, 2020-05-18T21:31:51.058 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 2, 2020-05-18T21:31:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:51.060 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:51.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.060 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:51.060 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:51.060 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": { 2020-05-18T21:31:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: "0": 1 2020-05-18T21:31:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.064 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.064 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.064 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.064 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.065 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.065 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.065 INFO:teuthology.orchestra.run.smithi063.stdout: "importingcaps": 0, 2020-05-18T21:31:51.065 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": 1, 2020-05-18T21:31:51.065 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 1, 2020-05-18T21:31:51.065 INFO:teuthology.orchestra.run.smithi063.stdout: "replicated": 1, 2020-05-18T21:31:51.066 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 1 2020-05-18T21:31:51.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.066 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 4, 2020-05-18T21:31:51.066 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.066 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": { 2020-05-18T21:31:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.070 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.070 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.070 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.070 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.075 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:51.075 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty", 2020-05-18T21:31:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent", 2020-05-18T21:31:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtypool" 2020-05-18T21:31:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [ 2020-05-18T21:31:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: "client_id": 7434, 2020-05-18T21:31:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: "pending": "pAsLsXsFscr", 2020-05-18T21:31:51.078 INFO:teuthology.orchestra.run.smithi063.stdout: "issued": "pAsLsXsFscr", 2020-05-18T21:31:51.078 INFO:teuthology.orchestra.run.smithi063.stdout: "wanted": "-", 2020-05-18T21:31:51.078 INFO:teuthology.orchestra.run.smithi063.stdout: "last_sent": 1 2020-05-18T21:31:51.078 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.078 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [] 2020-05-18T21:31:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1547, 2020-05-18T21:31:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.180496+0000", 2020-05-18T21:31:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.180496+0000", 2020-05-18T21:31:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.180496+0000", 2020-05-18T21:31:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:51.086 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:51.086 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.086 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:51.086 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:51.086 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180496+0000" 2020-05-18T21:31:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180496+0000" 2020-05-18T21:31:51.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.090 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:51.090 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:51.090 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:51.090 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.094 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.094 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.094 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.094 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.096 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.096 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.096 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.096 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:51.096 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.098 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.098 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.098 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.098 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.098 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:51.100 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:51.100 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:51.100 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:51.100 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:51.100 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray1", 2020-05-18T21:31:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60b", 2020-05-18T21:31:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:51.104 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:51.104 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:51.104 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:51.104 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.104 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.106 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.106 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.106 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.106 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.106 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.108 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:51.108 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:51.108 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.108 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1548, 2020-05-18T21:31:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.180788+0000", 2020-05-18T21:31:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.180788+0000", 2020-05-18T21:31:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:51.113 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:51.113 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:51.113 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:51.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.113 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.180788+0000", 2020-05-18T21:31:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180788+0000" 2020-05-18T21:31:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180788+0000" 2020-05-18T21:31:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.122 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:51.122 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:51.122 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:51.122 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:51.122 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.124 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.124 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.124 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.124 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.125 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.125 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.125 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.125 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.125 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:51.130 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:51.130 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:51.130 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:51.130 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:51.130 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray2", 2020-05-18T21:31:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60c", 2020-05-18T21:31:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:51.134 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:51.134 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:51.134 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:51.134 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.134 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.135 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:51.135 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.135 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.135 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.135 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.136 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.136 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.136 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.136 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.136 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.136 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.137 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.137 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.137 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.137 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.138 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:51.138 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:51.138 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.138 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.138 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:51.139 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.139 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.139 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1546, 2020-05-18T21:31:51.140 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:51.140 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.180117+0000", 2020-05-18T21:31:51.140 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.180117+0000", 2020-05-18T21:31:51.140 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:51.140 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:51.140 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:51.141 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:51.141 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:51.141 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:51.141 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:51.141 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:51.142 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:51.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.142 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:51.142 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:51.142 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:51.142 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:51.143 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:51.143 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:51.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.143 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:51.143 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:51.144 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:51.144 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:51.144 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:51.144 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:51.144 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.180117+0000", 2020-05-18T21:31:51.144 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:51.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:51.145 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:51.145 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:51.145 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:51.145 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:51.146 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.146 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:51.146 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:51.146 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:51.146 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:51.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.147 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:51.147 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.147 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.147 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.147 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.148 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.148 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180117+0000" 2020-05-18T21:31:51.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.148 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:51.148 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.148 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.149 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.149 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.149 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.149 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.180117+0000" 2020-05-18T21:31:51.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.149 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:51.150 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:51.150 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:51.150 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:51.150 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:51.150 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:51.151 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:51.151 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:51.151 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:51.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.151 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:51.151 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:51.152 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:51.152 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:51.152 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:51.152 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:51.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.153 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:51.153 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:51.153 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:51.153 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.153 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.153 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.154 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.154 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.154 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.154 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.155 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.155 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.155 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.155 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.155 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.156 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.156 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:51.156 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:51.156 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:51.156 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:51.156 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.157 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:51.157 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.157 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.157 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.158 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.158 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.158 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.158 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.158 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.159 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:51.159 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:51.159 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:51.159 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:51.159 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:51.160 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:51.160 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:51.160 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:51.160 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:51.160 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.160 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.161 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:51.161 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.161 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:51.161 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:51.161 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:51.161 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:51.162 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:51.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.162 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray0", 2020-05-18T21:31:51.162 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60a", 2020-05-18T21:31:51.162 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:51.163 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:51.163 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:51.163 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:51.163 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:51.163 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:51.163 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:51.164 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.164 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.164 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:51.164 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.164 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.164 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.165 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.165 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.165 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.165 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.165 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.166 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.166 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.166 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.166 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.167 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.167 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.167 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.167 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:51.167 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:51.167 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.168 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.168 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:51.168 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.168 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.169 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1549, 2020-05-18T21:31:51.169 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:51.169 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181046+0000", 2020-05-18T21:31:51.169 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181046+0000", 2020-05-18T21:31:51.170 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:51.170 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:51.170 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:51.170 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:51.170 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:51.171 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:51.171 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:51.171 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:51.171 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:51.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.171 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:51.172 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:51.172 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:51.172 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:51.172 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:51.172 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:51.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.173 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:51.173 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:51.173 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:51.173 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:51.173 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:51.174 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:51.174 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181046+0000", 2020-05-18T21:31:51.174 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:51.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:51.174 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:51.174 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:51.175 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:51.175 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:51.175 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.175 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:51.175 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:51.176 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:51.176 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:51.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.176 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:51.176 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.176 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.177 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.177 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.177 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.177 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181046+0000" 2020-05-18T21:31:51.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.178 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:51.178 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.178 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.178 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.178 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.178 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.179 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181046+0000" 2020-05-18T21:31:51.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.179 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:51.179 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:51.179 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:51.180 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:51.180 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:51.180 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:51.180 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:51.180 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:51.180 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:51.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.181 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:51.181 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:51.181 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:51.181 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:51.182 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:51.182 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:51.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.182 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:51.182 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:51.182 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:51.183 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.183 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.183 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.183 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.183 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.184 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.184 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.184 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.184 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.185 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.185 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.185 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.185 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.185 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:51.186 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:51.186 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:51.186 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:51.186 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.186 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:51.187 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.187 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.187 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.187 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.187 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.187 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.188 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.188 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.188 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:51.188 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:51.189 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:51.189 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:51.189 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:51.189 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:51.189 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:51.189 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:51.190 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:51.190 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.190 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.190 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:51.190 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.191 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:51.191 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:51.191 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:51.191 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:51.191 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:51.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.192 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray3", 2020-05-18T21:31:51.192 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60d", 2020-05-18T21:31:51.192 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:51.192 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:51.192 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:51.192 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:51.193 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:51.193 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:51.193 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:51.193 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.193 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.194 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:51.194 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.194 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.194 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.194 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.195 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.195 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.195 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.195 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.195 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.196 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.196 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.196 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.196 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.196 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.197 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:51.197 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:51.197 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.197 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.198 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:51.198 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.198 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.198 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1553, 2020-05-18T21:31:51.199 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:51.199 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.182214+0000", 2020-05-18T21:31:51.199 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.182214+0000", 2020-05-18T21:31:51.199 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:51.199 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:51.199 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:51.200 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:51.200 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:51.200 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:51.200 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:51.200 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:51.201 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:51.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.201 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:51.201 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:51.201 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:51.202 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:51.202 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:51.202 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:51.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.202 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:51.202 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:51.203 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:51.203 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:51.203 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:51.203 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:51.203 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.182214+0000", 2020-05-18T21:31:51.203 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:51.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:51.204 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:51.204 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:51.204 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:51.204 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:51.205 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.205 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:51.205 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:51.205 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:51.205 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:51.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.206 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:51.206 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.206 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.206 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.206 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.207 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.207 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182214+0000" 2020-05-18T21:31:51.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.207 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:51.207 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.207 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.208 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.208 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.208 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.208 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182214+0000" 2020-05-18T21:31:51.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.208 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:51.209 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:51.209 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:51.209 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:51.209 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:51.209 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:51.210 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:51.210 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:51.210 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:51.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.210 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:51.211 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:51.211 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:51.211 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:51.211 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:51.211 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:51.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.212 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:51.212 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:51.212 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:51.212 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.212 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.212 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.213 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.213 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.213 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.213 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.214 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.214 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.214 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.214 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.214 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.215 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.215 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:51.215 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:51.215 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:51.215 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:51.216 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.216 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:51.216 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.216 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.216 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.217 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.217 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.217 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.217 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.217 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.218 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:51.218 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:51.218 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:51.218 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:51.218 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:51.219 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:51.219 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:51.219 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:51.219 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:51.219 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.219 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.220 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:51.220 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.220 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:51.220 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:51.220 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:51.221 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:51.221 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:51.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.221 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray7", 2020-05-18T21:31:51.221 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x611", 2020-05-18T21:31:51.221 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:51.222 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:51.222 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:51.222 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:51.222 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:51.222 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:51.223 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:51.223 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.223 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.223 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:51.223 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.223 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.224 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.224 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.224 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.224 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.225 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.225 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.225 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.225 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.225 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.226 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.226 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.226 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.226 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:51.226 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:51.227 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.227 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.227 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:51.227 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.227 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.228 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1554, 2020-05-18T21:31:51.228 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:51.228 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.182533+0000", 2020-05-18T21:31:51.229 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.182533+0000", 2020-05-18T21:31:51.229 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:51.229 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:51.229 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:51.229 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:51.229 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:51.230 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:51.230 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:51.230 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:51.230 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:51.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.231 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:51.231 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:51.231 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:51.231 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:51.231 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:51.231 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:51.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.232 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:51.232 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:51.232 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:51.232 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:51.233 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:51.233 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:51.233 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.182533+0000", 2020-05-18T21:31:51.233 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:51.233 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:51.233 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:51.234 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:51.234 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:51.234 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:51.234 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.234 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:51.235 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:51.235 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:51.235 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:51.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.235 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:51.235 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.236 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.236 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.236 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.236 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.236 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182533+0000" 2020-05-18T21:31:51.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.237 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:51.237 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.237 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.237 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.237 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.238 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.238 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182533+0000" 2020-05-18T21:31:51.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.238 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:51.238 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:51.238 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:51.239 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:51.239 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:51.239 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:51.239 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:51.239 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:51.240 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:51.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.240 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:51.240 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:51.240 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:51.240 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:51.241 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:51.241 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:51.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.241 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:51.241 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:51.241 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:51.242 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.242 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.242 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.242 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.243 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.243 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.243 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.243 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.243 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.244 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.244 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.244 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.244 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.244 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:51.245 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:51.245 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:51.245 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:51.245 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.245 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:51.246 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.246 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.246 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.246 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.246 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.247 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.247 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.247 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.247 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:51.247 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:51.248 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:51.248 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:51.248 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:51.248 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:51.248 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:51.248 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:51.249 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:51.249 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.249 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.249 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:51.249 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.250 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:51.250 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:51.250 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:51.250 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:51.250 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:51.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.251 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray8", 2020-05-18T21:31:51.251 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x612", 2020-05-18T21:31:51.251 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:51.251 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:51.251 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:51.252 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:51.252 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:51.252 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:51.252 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:51.252 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.252 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.253 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:51.253 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.253 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.253 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.253 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.254 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.254 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.254 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.254 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.254 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.255 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.255 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.255 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.255 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.255 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.256 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:51.256 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:51.256 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.256 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.256 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:51.257 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.257 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.257 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1550, 2020-05-18T21:31:51.258 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:51.258 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181349+0000", 2020-05-18T21:31:51.258 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181349+0000", 2020-05-18T21:31:51.258 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:51.258 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:51.258 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:51.259 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:51.259 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:51.259 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:51.259 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:51.259 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:51.260 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:51.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.260 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:51.260 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:51.260 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:51.260 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:51.261 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:51.261 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:51.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.261 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:51.261 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:51.262 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:51.262 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:51.262 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:51.262 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:51.262 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181349+0000", 2020-05-18T21:31:51.262 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:51.263 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:51.263 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:51.263 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:51.263 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:51.263 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:51.264 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.264 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:51.264 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:51.264 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:51.264 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:51.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.265 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:51.265 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.265 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.265 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.265 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.266 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.266 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181349+0000" 2020-05-18T21:31:51.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.266 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:51.266 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.266 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.267 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.267 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.267 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.267 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181349+0000" 2020-05-18T21:31:51.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.268 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:51.268 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:51.268 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:51.268 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:51.268 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:51.268 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:51.269 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:51.269 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:51.269 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:51.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.269 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:51.270 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:51.270 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:51.270 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:51.270 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:51.270 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:51.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.271 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:51.271 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:51.271 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:51.271 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.271 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.271 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.272 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.272 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.272 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.272 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.273 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.273 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.273 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.273 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.273 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.274 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.274 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:51.274 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:51.274 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:51.274 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:51.275 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.275 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:51.275 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.275 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.275 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.276 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.276 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.276 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.276 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.276 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.277 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:51.277 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:51.277 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:51.277 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:51.277 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:51.278 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:51.278 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:51.278 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:51.278 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:51.278 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.279 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.279 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:51.279 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.279 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:51.279 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:51.279 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:51.280 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:51.280 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:51.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.280 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray4", 2020-05-18T21:31:51.280 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60e", 2020-05-18T21:31:51.281 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:51.281 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:51.281 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:51.281 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:51.281 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:51.281 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:51.282 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:51.282 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.282 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.282 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:51.282 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.283 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.283 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.283 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.283 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.283 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.284 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.284 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.284 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.284 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.285 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.285 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.285 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.285 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.285 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:51.285 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:51.286 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.286 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.286 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:51.286 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.287 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.287 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1555, 2020-05-18T21:31:51.287 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:51.287 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.182880+0000", 2020-05-18T21:31:51.288 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.182880+0000", 2020-05-18T21:31:51.288 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:51.288 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:51.288 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:51.288 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:51.289 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:51.289 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:51.289 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:51.289 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:51.289 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:51.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.290 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:51.290 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:51.290 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:51.290 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:51.290 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:51.291 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:51.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.291 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:51.291 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:51.291 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:51.291 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:51.292 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:51.292 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:51.292 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.182880+0000", 2020-05-18T21:31:51.292 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:51.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:51.293 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:51.293 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:51.293 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:51.293 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:51.293 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.293 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:51.294 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:51.294 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:51.294 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:51.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.294 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:51.294 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.295 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.295 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.295 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.295 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.295 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:51.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.296 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:51.296 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.296 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.296 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.296 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.297 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.297 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:51.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.297 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:51.297 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:51.298 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:51.298 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:51.298 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:51.298 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:51.298 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:51.298 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:51.299 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:51.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.299 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:51.299 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:51.299 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:51.300 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:51.300 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:51.300 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:51.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.300 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:51.300 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:51.301 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:51.301 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.301 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.301 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.302 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.302 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.302 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.302 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.302 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.302 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.303 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.303 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.303 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.303 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.303 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:51.304 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:51.304 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:51.304 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:51.304 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.305 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:51.305 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.305 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.305 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.305 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.305 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.306 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.306 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.306 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.306 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:51.307 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:51.307 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:51.307 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:51.307 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:51.307 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:51.307 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:51.308 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:51.308 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:51.308 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.308 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.308 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:51.309 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.309 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:51.309 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:51.309 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:51.309 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:51.309 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:51.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.310 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray9", 2020-05-18T21:31:51.310 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x613", 2020-05-18T21:31:51.310 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:51.310 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:51.310 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:51.311 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:51.311 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:51.311 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:51.311 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:51.311 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.312 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.312 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:51.312 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.312 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.312 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.312 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.313 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.313 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.313 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.313 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.315 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.315 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.315 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.316 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.316 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.316 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.316 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:51.317 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:51.317 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.317 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.318 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:51.318 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.318 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.319 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1551, 2020-05-18T21:31:51.319 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:51.319 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181638+0000", 2020-05-18T21:31:51.320 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181638+0000", 2020-05-18T21:31:51.320 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:51.320 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:51.320 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:51.321 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:51.321 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:51.321 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:51.321 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:51.322 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:51.322 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:51.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.322 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:51.323 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:51.323 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:51.323 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:51.323 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:51.324 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:51.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.324 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:51.324 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:51.325 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:51.325 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:51.325 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:51.325 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:51.326 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181638+0000", 2020-05-18T21:31:51.326 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:51.326 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:51.326 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:51.327 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:51.327 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:51.327 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:51.327 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.327 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:51.328 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:51.328 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:51.328 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:51.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.329 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:51.329 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.329 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.329 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.330 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.330 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.330 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181638+0000" 2020-05-18T21:31:51.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.330 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:51.331 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.331 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.331 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.331 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.332 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.332 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181638+0000" 2020-05-18T21:31:51.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.332 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:51.333 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:51.333 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:51.333 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:51.333 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:51.333 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:51.334 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:51.334 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:51.334 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:51.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.335 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:51.335 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:51.335 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:51.336 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:51.336 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:51.336 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:51.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.336 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:51.337 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:51.337 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:51.337 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.337 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.338 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.338 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.338 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.339 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.339 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.339 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.339 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.340 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.340 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.340 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.340 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.341 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:51.341 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:51.341 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:51.341 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:51.342 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.342 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:51.342 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.343 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.343 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.343 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.343 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.343 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.344 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.344 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.344 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:51.345 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:51.345 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:51.345 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:51.346 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:51.346 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:51.346 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:51.346 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:51.347 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:51.347 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.347 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.348 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:51.348 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.348 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:51.349 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:51.349 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:51.349 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:51.350 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:51.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.350 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray5", 2020-05-18T21:31:51.350 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x60f", 2020-05-18T21:31:51.351 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:51.351 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:51.351 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:51.351 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:51.351 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:51.352 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:51.352 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:51.352 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.352 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.353 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:51.353 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.353 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.353 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.354 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.354 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.354 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.355 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.355 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.355 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.355 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.356 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.356 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.356 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.356 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.357 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:51.357 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:51.357 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.358 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.358 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:51.358 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.358 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.359 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1552, 2020-05-18T21:31:51.359 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:51.359 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.181913+0000", 2020-05-18T21:31:51.360 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.181913+0000", 2020-05-18T21:31:51.360 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:51.360 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:51.360 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:51.360 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:51.361 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:51.361 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:51.361 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:51.361 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:51.362 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:51.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.362 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:51.363 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:51.363 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:51.363 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:51.363 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:51.364 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:51.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.364 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:51.364 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:51.365 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:51.365 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:51.365 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:51.365 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:51.365 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.181913+0000", 2020-05-18T21:31:51.366 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:51.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:51.366 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:51.366 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:51.367 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:51.367 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:51.367 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.367 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:51.368 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:51.368 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:51.368 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:51.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.369 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:51.369 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.369 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.369 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.369 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.370 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.370 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181913+0000" 2020-05-18T21:31:51.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.370 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:51.371 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.371 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.371 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.371 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.372 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.372 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.181913+0000" 2020-05-18T21:31:51.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.372 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:51.372 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:51.373 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:51.373 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:51.373 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:51.373 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:51.374 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:51.374 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:51.374 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:51.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.374 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:51.375 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:51.375 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:51.375 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:51.375 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:51.376 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:51.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.376 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:51.377 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:51.377 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:51.378 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.378 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.378 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.378 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.379 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.379 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.379 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.380 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.380 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.380 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.381 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.381 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.381 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.382 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:51.382 INFO:teuthology.orchestra.run.smithi063.stdout: "stickydirs": 1, 2020-05-18T21:31:51.382 INFO:teuthology.orchestra.run.smithi063.stdout: "stray": 1, 2020-05-18T21:31:51.383 INFO:teuthology.orchestra.run.smithi063.stdout: "dirtyparent": 0, 2020-05-18T21:31:51.383 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.383 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:51.384 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.384 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.384 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.384 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.384 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.385 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.385 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.385 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.386 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:51.387 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:51.387 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:51.387 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:51.388 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:51.388 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:51.388 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:51.388 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:51.388 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:51.389 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.389 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.389 INFO:teuthology.orchestra.run.smithi063.stdout: "straypinned" 2020-05-18T21:31:51.389 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.390 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:51.390 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:51.390 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:51.390 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:51.390 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:51.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.391 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1/stray6", 2020-05-18T21:31:51.391 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x610", 2020-05-18T21:31:51.391 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:51.392 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:51.392 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:51.392 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:51.392 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:51.392 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:51.393 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "", 2020-05-18T21:31:51.393 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.393 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.393 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:51.394 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.394 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.394 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.394 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.395 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.395 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.395 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.396 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.396 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.396 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.396 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.397 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.397 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.397 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.397 INFO:teuthology.orchestra.run.smithi063.stdout: "sticky": 1, 2020-05-18T21:31:51.398 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:51.398 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.398 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.399 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [] 2020-05-18T21:31:51.399 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.399 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.400 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1099511627776, 2020-05-18T21:31:51.400 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:51.400 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:44.486441+0000", 2020-05-18T21:31:51.400 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:44.091087+0000", 2020-05-18T21:31:51.401 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16877, 2020-05-18T21:31:51.401 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:51.401 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:51.401 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:51.402 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:51.402 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:51.402 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:51.402 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:51.402 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:51.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.403 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:51.403 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:51.403 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:51.404 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:51.404 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:51.404 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:51.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.404 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:51.405 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:51.405 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 1, 2020-05-18T21:31:51.405 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:51.405 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:51.406 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:51.406 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:44.171298+0000", 2020-05-18T21:31:51.406 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "2020-05-18T21:31:44.091087+0000", 2020-05-18T21:31:51.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:51.407 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 2, 2020-05-18T21:31:51.407 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": 1, 2020-05-18T21:31:51.407 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:51.407 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:51.407 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.408 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:44.171298+0000", 2020-05-18T21:31:51.408 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 1, 2020-05-18T21:31:51.408 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:51.408 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 1 2020-05-18T21:31:51.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.409 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:51.409 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.409 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.410 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 1, 2020-05-18T21:31:51.410 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.410 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.410 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:44.486441+0000" 2020-05-18T21:31:51.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.411 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:51.411 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.411 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.412 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 1, 2020-05-18T21:31:51.412 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.412 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.413 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:44.486441+0000" 2020-05-18T21:31:51.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.414 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 14, 2020-05-18T21:31:51.414 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:51.414 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:51.414 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 2, 2020-05-18T21:31:51.415 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:51.415 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:51.415 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:51.415 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:51.416 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:51.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.416 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:51.416 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:51.417 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:51.417 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:51.417 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:51.417 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:51.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.418 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:51.418 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:51.418 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:51.418 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": false, 2020-05-18T21:31:51.419 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.419 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.419 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.420 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.420 INFO:teuthology.orchestra.run.smithi063.stdout: 0, 2020-05-18T21:31:51.420 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.420 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.420 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 1 2020-05-18T21:31:51.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.421 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.421 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.421 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.422 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.422 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": 0, 2020-05-18T21:31:51.422 INFO:teuthology.orchestra.run.smithi063.stdout: "importing": 0, 2020-05-18T21:31:51.422 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1 2020-05-18T21:31:51.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.423 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.423 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.424 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.424 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.424 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.425 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.425 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.425 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.426 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.426 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:51.426 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:51.426 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:51.427 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": { 2020-05-18T21:31:51.427 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.427 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "mix", 2020-05-18T21:31:51.428 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.428 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.428 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.429 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.429 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.430 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:51.430 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:51.430 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": { 2020-05-18T21:31:51.430 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.431 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "mix", 2020-05-18T21:31:51.431 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.431 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.431 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.432 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.432 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.432 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:51.433 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:51.433 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [], 2020-05-18T21:31:51.433 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:51.433 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:51.433 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:51.434 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:51.434 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:51.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.434 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/dir_1", 2020-05-18T21:31:51.435 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x10000000000", 2020-05-18T21:31:51.435 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:51.435 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "7", 2020-05-18T21:31:51.435 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "7", 2020-05-18T21:31:51.436 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "0", 2020-05-18T21:31:51.436 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "0", 2020-05-18T21:31:51.436 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:51.437 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "1", 2020-05-18T21:31:51.437 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.437 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.437 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty", 2020-05-18T21:31:51.438 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:51.438 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.438 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.438 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.439 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": { 2020-05-18T21:31:51.439 INFO:teuthology.orchestra.run.smithi063.stdout: "0": 1 2020-05-18T21:31:51.439 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.440 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.440 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.440 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.440 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.441 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.441 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.441 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.442 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.442 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.442 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.442 INFO:teuthology.orchestra.run.smithi063.stdout: "ptrwaiter": 0, 2020-05-18T21:31:51.442 INFO:teuthology.orchestra.run.smithi063.stdout: "child": 1, 2020-05-18T21:31:51.443 INFO:teuthology.orchestra.run.smithi063.stdout: "frozen": 0, 2020-05-18T21:31:51.443 INFO:teuthology.orchestra.run.smithi063.stdout: "subtree": 1, 2020-05-18T21:31:51.443 INFO:teuthology.orchestra.run.smithi063.stdout: "importing": 0, 2020-05-18T21:31:51.443 INFO:teuthology.orchestra.run.smithi063.stdout: "replicated": 1, 2020-05-18T21:31:51.444 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 1 2020-05-18T21:31:51.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.444 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 4, 2020-05-18T21:31:51.444 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [ 2020-05-18T21:31:51.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.445 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "dir_1/original", 2020-05-18T21:31:51.445 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 1, 2020-05-18T21:31:51.445 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:51.446 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:51.446 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:51.446 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:51.446 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:51.446 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:51.447 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1099511627778, 2020-05-18T21:31:51.447 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:51.447 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 6, 2020-05-18T21:31:51.447 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 6, 2020-05-18T21:31:51.448 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.448 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.448 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.449 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": { 2020-05-18T21:31:51.449 INFO:teuthology.orchestra.run.smithi063.stdout: "0": 1 2020-05-18T21:31:51.449 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.450 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.450 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.450 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.450 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.451 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.451 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.451 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.452 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.452 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.452 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.452 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:51.452 INFO:teuthology.orchestra.run.smithi063.stdout: "replicated": 1, 2020-05-18T21:31:51.453 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 1 2020-05-18T21:31:51.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.453 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 3, 2020-05-18T21:31:51.453 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:51.454 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.454 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.454 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.454 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.455 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.455 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.455 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.455 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.456 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.456 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.456 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty" 2020-05-18T21:31:51.456 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.457 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.457 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.457 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.457 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.458 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 3, 2020-05-18T21:31:51.458 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:51.458 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.184087+0000", 2020-05-18T21:31:51.459 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.184087+0000", 2020-05-18T21:31:51.459 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16877, 2020-05-18T21:31:51.459 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:51.459 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:51.459 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:51.460 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:51.460 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:51.460 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:51.460 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:51.461 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:51.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.461 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:51.461 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:51.461 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:51.462 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:51.462 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:51.462 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:51.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.463 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:51.463 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:51.463 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:51.464 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:51.464 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:51.464 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:51.464 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.184087+0000", 2020-05-18T21:31:51.465 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:51.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:51.465 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:51.465 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:51.465 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:51.466 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:51.466 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.466 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:51.466 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:51.467 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 0, 2020-05-18T21:31:51.467 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:51.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.467 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:51.467 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.468 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.468 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.468 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.469 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.469 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.184087+0000" 2020-05-18T21:31:51.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.470 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:51.470 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.470 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.470 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.471 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.471 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.471 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.184087+0000" 2020-05-18T21:31:51.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.472 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:51.472 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:51.472 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:51.472 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:51.472 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:51.473 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:51.473 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:51.473 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:51.473 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:51.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.474 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:51.474 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:51.474 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:51.475 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:51.475 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:51.475 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:51.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.475 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:51.476 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:51.476 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:51.476 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.476 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.477 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.477 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.478 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.478 INFO:teuthology.orchestra.run.smithi063.stdout: -2, 2020-05-18T21:31:51.478 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.478 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.478 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.479 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.479 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.479 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.480 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": {}, 2020-05-18T21:31:51.480 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 0, 2020-05-18T21:31:51.480 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.480 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.480 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.481 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.481 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.481 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.482 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.482 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.482 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:51.482 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:51.483 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:51.483 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:51.483 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:51.483 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:51.484 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:51.484 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:51.484 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:51.484 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.485 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:51.485 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.485 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:51.485 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:51.485 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:51.486 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:51.486 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [] 2020-05-18T21:31:51.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.487 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 257, 2020-05-18T21:31:51.487 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:51.487 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:38.179986+0000", 2020-05-18T21:31:51.487 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:38.179986+0000", 2020-05-18T21:31:51.488 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 16704, 2020-05-18T21:31:51.488 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:51.488 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:51.488 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:51.489 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:51.489 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:51.489 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:51.489 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:51.489 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:51.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.490 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:51.490 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 0, 2020-05-18T21:31:51.490 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 0, 2020-05-18T21:31:51.491 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 0, 2020-05-18T21:31:51.491 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": -1, 2020-05-18T21:31:51.491 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:51.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.491 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:51.492 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:51.492 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:51.492 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:51.492 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:51.493 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:51.493 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:38.179986+0000", 2020-05-18T21:31:51.493 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:51.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:51.493 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:51.494 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:51.494 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:51.494 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:51.494 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.495 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "0.000000", 2020-05-18T21:31:51.495 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:51.495 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 10, 2020-05-18T21:31:51.495 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0 2020-05-18T21:31:51.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.496 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:51.496 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.496 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.496 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.497 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 11, 2020-05-18T21:31:51.497 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.497 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:51.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.497 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:51.498 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.498 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.498 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.498 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 11, 2020-05-18T21:31:51.499 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.499 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:38.182880+0000" 2020-05-18T21:31:51.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.499 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:51.500 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:51.500 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:51.500 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:51.500 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:51.501 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:51.501 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:51.501 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:51.501 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:51.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.502 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:51.502 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:51.502 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:51.502 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:51.503 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:51.503 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:51.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.503 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:51.504 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:51.504 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:51.504 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.504 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.504 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.505 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.505 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.505 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.506 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.506 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.506 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.507 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.507 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.507 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.507 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.507 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1 2020-05-18T21:31:51.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.508 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.508 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.508 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.508 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.509 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.509 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.509 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.509 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.510 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.510 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:51.510 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:51.511 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:51.511 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:51.511 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:51.511 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:51.511 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": {}, 2020-05-18T21:31:51.512 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:51.512 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:51.512 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.513 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:51.513 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.514 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:51.514 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:51.514 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:51.515 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:51.515 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:51.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.515 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "~mds1", 2020-05-18T21:31:51.515 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x101", 2020-05-18T21:31:51.516 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:51.516 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "1", 2020-05-18T21:31:51.516 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "1", 2020-05-18T21:31:51.516 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "1", 2020-05-18T21:31:51.516 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "1", 2020-05-18T21:31:51.516 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": false, 2020-05-18T21:31:51.517 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "1", 2020-05-18T21:31:51.517 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.517 INFO:teuthology.orchestra.run.smithi063.stdout: "auth", 2020-05-18T21:31:51.517 INFO:teuthology.orchestra.run.smithi063.stdout: "complete" 2020-05-18T21:31:51.517 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.518 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.518 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.518 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.518 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.518 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.519 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.519 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.519 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.519 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.520 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.520 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.520 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.520 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.521 INFO:teuthology.orchestra.run.smithi063.stdout: "child": 1, 2020-05-18T21:31:51.521 INFO:teuthology.orchestra.run.smithi063.stdout: "subtree": 1, 2020-05-18T21:31:51.521 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0, 2020-05-18T21:31:51.521 INFO:teuthology.orchestra.run.smithi063.stdout: "authpin": 0 2020-05-18T21:31:51.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.522 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 2, 2020-05-18T21:31:51.522 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [ 2020-05-18T21:31:51.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.522 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray6", 2020-05-18T21:31:51.522 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:51.523 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:51.523 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:51.523 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:51.523 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:51.523 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:51.524 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:51.524 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1552, 2020-05-18T21:31:51.524 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:51.524 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.524 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:51.524 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.525 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.525 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.525 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.525 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.526 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.526 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.526 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.526 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.527 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.527 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.527 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.528 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.528 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.528 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:51.528 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:51.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.529 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.529 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:51.529 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.529 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.529 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.530 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.530 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.530 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.530 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.530 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.531 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.531 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:51.531 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.532 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray7", 2020-05-18T21:31:51.532 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:51.532 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:51.532 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:51.532 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:51.532 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:51.533 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:51.533 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:51.533 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1553, 2020-05-18T21:31:51.533 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:51.533 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.534 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:51.534 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.534 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.534 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.534 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.535 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.535 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.535 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.535 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.535 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.536 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.536 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.536 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.536 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.537 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.537 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:51.537 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:51.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.537 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.537 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:51.538 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.538 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.538 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.538 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.538 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.539 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.539 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.539 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.539 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.539 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:51.540 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.540 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray0", 2020-05-18T21:31:51.540 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:51.541 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:51.541 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:51.541 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:51.541 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:51.541 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:51.542 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:51.542 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1546, 2020-05-18T21:31:51.542 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:51.542 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.542 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:51.542 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.543 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.543 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.543 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.543 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.544 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.544 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.544 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.544 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.544 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.545 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.545 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.545 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.545 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.546 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:51.546 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:51.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.546 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.546 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:51.546 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.547 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.547 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.547 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.547 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.547 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.548 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.548 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.548 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.548 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:51.549 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.549 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray9", 2020-05-18T21:31:51.550 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:51.550 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:51.550 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:51.550 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:51.550 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:51.551 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:51.551 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:51.551 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1555, 2020-05-18T21:31:51.551 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:51.551 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.552 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:51.552 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.552 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.552 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.552 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.553 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.553 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.553 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.553 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.554 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.554 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.554 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.554 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.554 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.555 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.555 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:51.555 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:51.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.555 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.556 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:51.556 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.556 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.556 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.556 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.556 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.557 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.557 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.557 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.557 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.558 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:51.558 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.558 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray5", 2020-05-18T21:31:51.558 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:51.559 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:51.559 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:51.559 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:51.559 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:51.559 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:51.560 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:51.560 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1551, 2020-05-18T21:31:51.560 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:51.560 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.561 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:51.561 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.561 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.561 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.561 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.562 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.562 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.562 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.562 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.563 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.563 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.563 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.563 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.563 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.564 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.564 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:51.564 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:51.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.564 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.565 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:51.565 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.565 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.565 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.565 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.565 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.566 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.566 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.566 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.566 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.567 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:51.567 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.567 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray2", 2020-05-18T21:31:51.567 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:51.568 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:51.568 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:51.568 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:51.568 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:51.568 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:51.568 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:51.569 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1548, 2020-05-18T21:31:51.569 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:51.569 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.569 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:51.569 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.570 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.570 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.570 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.570 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.570 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.571 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.571 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.571 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.571 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.572 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.572 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.572 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.572 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.572 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:51.573 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:51.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.573 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.573 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:51.573 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.574 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.574 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.574 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.574 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.574 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.575 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.575 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.575 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.575 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:51.575 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.576 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray1", 2020-05-18T21:31:51.576 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:51.576 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:51.577 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:51.577 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:51.577 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:51.577 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:51.577 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:51.577 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1547, 2020-05-18T21:31:51.578 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:51.578 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.578 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:51.578 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.578 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.579 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.579 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.579 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.579 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.579 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.580 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.580 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.580 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.580 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.581 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.581 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.581 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.581 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:51.581 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:51.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.582 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.582 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:51.582 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.582 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.583 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.583 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.583 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.583 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.583 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.584 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.584 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.584 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:51.584 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.585 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray8", 2020-05-18T21:31:51.585 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:51.585 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:51.586 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:51.586 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:51.586 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:51.586 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:51.587 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:51.587 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1554, 2020-05-18T21:31:51.587 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:51.587 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.587 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:51.588 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.588 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.588 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.588 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.589 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.589 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.589 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.589 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.590 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.590 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.590 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.590 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.591 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.591 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.591 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:51.591 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:51.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.592 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.592 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:51.592 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.592 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.592 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.593 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.593 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.593 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.593 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.593 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.594 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.594 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:51.594 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.595 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray3", 2020-05-18T21:31:51.595 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:51.595 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:51.595 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:51.595 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:51.596 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:51.596 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:51.596 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:51.596 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1549, 2020-05-18T21:31:51.596 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:51.596 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.597 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:51.597 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.597 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.597 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.597 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.598 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.598 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.598 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.598 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.598 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.599 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.599 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.599 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.599 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.600 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.600 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:51.600 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:51.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.600 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.600 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:51.601 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.601 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.601 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.601 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.601 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.602 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.602 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.602 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.607 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.607 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:51.608 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.608 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "stray4", 2020-05-18T21:31:51.608 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 257, 2020-05-18T21:31:51.609 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:51.609 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:51.609 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:51.609 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:51.609 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:51.609 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:51.610 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1550, 2020-05-18T21:31:51.610 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:51.610 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.610 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:51.610 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.611 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": true, 2020-05-18T21:31:51.611 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.611 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.611 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.612 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.612 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2020-05-18T21:31:51.612 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.612 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.612 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 0 2020-05-18T21:31:51.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.613 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.613 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.613 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.613 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.614 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1, 2020-05-18T21:31:51.614 INFO:teuthology.orchestra.run.smithi063.stdout: "dirty": 0 2020-05-18T21:31:51.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.614 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.614 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:51.614 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.615 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.615 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.615 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.615 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.615 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.616 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.616 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.616 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [ 2020-05-18T21:31:51.616 INFO:teuthology.orchestra.run.smithi063.stdout: "auth" 2020-05-18T21:31:51.616 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.617 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.617 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.617 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.617 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.618 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1, 2020-05-18T21:31:51.618 INFO:teuthology.orchestra.run.smithi063.stdout: "rdev": 0, 2020-05-18T21:31:51.618 INFO:teuthology.orchestra.run.smithi063.stdout: "ctime": "2020-05-18T21:31:44.101697+0000", 2020-05-18T21:31:51.618 INFO:teuthology.orchestra.run.smithi063.stdout: "btime": "2020-05-18T21:31:30.216980+0000", 2020-05-18T21:31:51.619 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": 17407, 2020-05-18T21:31:51.619 INFO:teuthology.orchestra.run.smithi063.stdout: "uid": 0, 2020-05-18T21:31:51.619 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 0, 2020-05-18T21:31:51.619 INFO:teuthology.orchestra.run.smithi063.stdout: "nlink": 1, 2020-05-18T21:31:51.619 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_layout": { 2020-05-18T21:31:51.619 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_hash": 2, 2020-05-18T21:31:51.620 INFO:teuthology.orchestra.run.smithi063.stdout: "unused1": 0, 2020-05-18T21:31:51.620 INFO:teuthology.orchestra.run.smithi063.stdout: "unused2": 0, 2020-05-18T21:31:51.620 INFO:teuthology.orchestra.run.smithi063.stdout: "unused3": 0 2020-05-18T21:31:51.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.620 INFO:teuthology.orchestra.run.smithi063.stdout: "layout": { 2020-05-18T21:31:51.621 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_unit": 4194304, 2020-05-18T21:31:51.621 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_count": 1, 2020-05-18T21:31:51.621 INFO:teuthology.orchestra.run.smithi063.stdout: "object_size": 4194304, 2020-05-18T21:31:51.621 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_id": 16, 2020-05-18T21:31:51.622 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ns": "" 2020-05-18T21:31:51.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.622 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [], 2020-05-18T21:31:51.622 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 0, 2020-05-18T21:31:51.623 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_seq": 0, 2020-05-18T21:31:51.623 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:31:51.623 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_from": 0, 2020-05-18T21:31:51.623 INFO:teuthology.orchestra.run.smithi063.stdout: "truncate_pending": 0, 2020-05-18T21:31:51.623 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:44.101697+0000", 2020-05-18T21:31:51.623 INFO:teuthology.orchestra.run.smithi063.stdout: "atime": "0.000000", 2020-05-18T21:31:51.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time_warp_seq": 0, 2020-05-18T21:31:51.624 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 0, 2020-05-18T21:31:51.624 INFO:teuthology.orchestra.run.smithi063.stdout: "export_pin": -1, 2020-05-18T21:31:51.624 INFO:teuthology.orchestra.run.smithi063.stdout: "client_ranges": [], 2020-05-18T21:31:51.624 INFO:teuthology.orchestra.run.smithi063.stdout: "dirstat": { 2020-05-18T21:31:51.625 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.625 INFO:teuthology.orchestra.run.smithi063.stdout: "mtime": "2020-05-18T21:31:44.101697+0000", 2020-05-18T21:31:51.625 INFO:teuthology.orchestra.run.smithi063.stdout: "num_files": 0, 2020-05-18T21:31:51.625 INFO:teuthology.orchestra.run.smithi063.stdout: "num_subdirs": 2, 2020-05-18T21:31:51.625 INFO:teuthology.orchestra.run.smithi063.stdout: "change_attr": 2 2020-05-18T21:31:51.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.626 INFO:teuthology.orchestra.run.smithi063.stdout: "rstat": { 2020-05-18T21:31:51.626 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 1, 2020-05-18T21:31:51.626 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.626 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 1, 2020-05-18T21:31:51.626 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 3, 2020-05-18T21:31:51.627 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.627 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:44.486441+0000" 2020-05-18T21:31:51.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.627 INFO:teuthology.orchestra.run.smithi063.stdout: "accounted_rstat": { 2020-05-18T21:31:51.628 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.628 INFO:teuthology.orchestra.run.smithi063.stdout: "rbytes": 0, 2020-05-18T21:31:51.628 INFO:teuthology.orchestra.run.smithi063.stdout: "rfiles": 0, 2020-05-18T21:31:51.628 INFO:teuthology.orchestra.run.smithi063.stdout: "rsubdirs": 1, 2020-05-18T21:31:51.629 INFO:teuthology.orchestra.run.smithi063.stdout: "rsnaps": 0, 2020-05-18T21:31:51.629 INFO:teuthology.orchestra.run.smithi063.stdout: "rctime": "2020-05-18T21:31:30.216980+0000" 2020-05-18T21:31:51.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.629 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 7, 2020-05-18T21:31:51.630 INFO:teuthology.orchestra.run.smithi063.stdout: "file_data_version": 0, 2020-05-18T21:31:51.630 INFO:teuthology.orchestra.run.smithi063.stdout: "xattr_version": 1, 2020-05-18T21:31:51.630 INFO:teuthology.orchestra.run.smithi063.stdout: "backtrace_version": 0, 2020-05-18T21:31:51.630 INFO:teuthology.orchestra.run.smithi063.stdout: "stray_prior_path": "", 2020-05-18T21:31:51.630 INFO:teuthology.orchestra.run.smithi063.stdout: "max_size_ever": 0, 2020-05-18T21:31:51.630 INFO:teuthology.orchestra.run.smithi063.stdout: "quota": { 2020-05-18T21:31:51.631 INFO:teuthology.orchestra.run.smithi063.stdout: "max_bytes": 0, 2020-05-18T21:31:51.631 INFO:teuthology.orchestra.run.smithi063.stdout: "max_files": 0 2020-05-18T21:31:51.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.631 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:31:51.631 INFO:teuthology.orchestra.run.smithi063.stdout: "last_scrub_version": 0, 2020-05-18T21:31:51.632 INFO:teuthology.orchestra.run.smithi063.stdout: "symlink": "", 2020-05-18T21:31:51.632 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrs": [], 2020-05-18T21:31:51.632 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtree": { 2020-05-18T21:31:51.632 INFO:teuthology.orchestra.run.smithi063.stdout: "splits": [] 2020-05-18T21:31:51.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.633 INFO:teuthology.orchestra.run.smithi063.stdout: "old_inodes": [], 2020-05-18T21:31:51.633 INFO:teuthology.orchestra.run.smithi063.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:31:51.633 INFO:teuthology.orchestra.run.smithi063.stdout: "damage_flags": 0, 2020-05-18T21:31:51.633 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": false, 2020-05-18T21:31:51.633 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.633 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.634 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.634 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.634 INFO:teuthology.orchestra.run.smithi063.stdout: 0, 2020-05-18T21:31:51.634 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.635 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.635 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 1 2020-05-18T21:31:51.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.635 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.635 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.635 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.636 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.636 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": 0, 2020-05-18T21:31:51.636 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": 1, 2020-05-18T21:31:51.636 INFO:teuthology.orchestra.run.smithi063.stdout: "dirwaiter": 0, 2020-05-18T21:31:51.636 INFO:teuthology.orchestra.run.smithi063.stdout: "discoverbase": 0 2020-05-18T21:31:51.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.637 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.637 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.637 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.637 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.637 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.638 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.638 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.638 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.638 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.639 INFO:teuthology.orchestra.run.smithi063.stdout: "authlock": {}, 2020-05-18T21:31:51.639 INFO:teuthology.orchestra.run.smithi063.stdout: "linklock": {}, 2020-05-18T21:31:51.639 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfragtreelock": {}, 2020-05-18T21:31:51.639 INFO:teuthology.orchestra.run.smithi063.stdout: "filelock": {}, 2020-05-18T21:31:51.639 INFO:teuthology.orchestra.run.smithi063.stdout: "xattrlock": {}, 2020-05-18T21:31:51.639 INFO:teuthology.orchestra.run.smithi063.stdout: "snaplock": {}, 2020-05-18T21:31:51.640 INFO:teuthology.orchestra.run.smithi063.stdout: "nestlock": { 2020-05-18T21:31:51.640 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.640 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "mix", 2020-05-18T21:31:51.640 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.640 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.641 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.641 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.641 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.641 INFO:teuthology.orchestra.run.smithi063.stdout: "flocklock": {}, 2020-05-18T21:31:51.642 INFO:teuthology.orchestra.run.smithi063.stdout: "policylock": {}, 2020-05-18T21:31:51.642 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [], 2020-05-18T21:31:51.642 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps": [], 2020-05-18T21:31:51.642 INFO:teuthology.orchestra.run.smithi063.stdout: "loner": -1, 2020-05-18T21:31:51.642 INFO:teuthology.orchestra.run.smithi063.stdout: "want_loner": -1, 2020-05-18T21:31:51.642 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_caps_wanted": [], 2020-05-18T21:31:51.643 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrags": [ 2020-05-18T21:31:51.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.643 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "", 2020-05-18T21:31:51.643 INFO:teuthology.orchestra.run.smithi063.stdout: "dirfrag": "0x1", 2020-05-18T21:31:51.643 INFO:teuthology.orchestra.run.smithi063.stdout: "snapid_first": 2, 2020-05-18T21:31:51.644 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": "0", 2020-05-18T21:31:51.644 INFO:teuthology.orchestra.run.smithi063.stdout: "version": "16", 2020-05-18T21:31:51.644 INFO:teuthology.orchestra.run.smithi063.stdout: "committing_version": "0", 2020-05-18T21:31:51.644 INFO:teuthology.orchestra.run.smithi063.stdout: "committed_version": "0", 2020-05-18T21:31:51.644 INFO:teuthology.orchestra.run.smithi063.stdout: "is_rep": true, 2020-05-18T21:31:51.644 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_auth": "0", 2020-05-18T21:31:51.645 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [], 2020-05-18T21:31:51.645 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": false, 2020-05-18T21:31:51.645 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.645 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.646 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.646 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.646 INFO:teuthology.orchestra.run.smithi063.stdout: 0, 2020-05-18T21:31:51.646 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.646 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.647 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 1 2020-05-18T21:31:51.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.647 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.647 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.647 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.648 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.648 INFO:teuthology.orchestra.run.smithi063.stdout: "child": 1, 2020-05-18T21:31:51.648 INFO:teuthology.orchestra.run.smithi063.stdout: "subtree": 1 2020-05-18T21:31:51.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.648 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 2, 2020-05-18T21:31:51.649 INFO:teuthology.orchestra.run.smithi063.stdout: "dentries": [ 2020-05-18T21:31:51.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:31:51.649 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "dir_1", 2020-05-18T21:31:51.649 INFO:teuthology.orchestra.run.smithi063.stdout: "path_ino": 1, 2020-05-18T21:31:51.649 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_first": 2, 2020-05-18T21:31:51.650 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:31:51.650 INFO:teuthology.orchestra.run.smithi063.stdout: "is_primary": true, 2020-05-18T21:31:51.650 INFO:teuthology.orchestra.run.smithi063.stdout: "is_remote": false, 2020-05-18T21:31:51.650 INFO:teuthology.orchestra.run.smithi063.stdout: "is_null": false, 2020-05-18T21:31:51.651 INFO:teuthology.orchestra.run.smithi063.stdout: "is_new": false, 2020-05-18T21:31:51.651 INFO:teuthology.orchestra.run.smithi063.stdout: "inode": 1099511627776, 2020-05-18T21:31:51.651 INFO:teuthology.orchestra.run.smithi063.stdout: "remote_type": "", 2020-05-18T21:31:51.651 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 0, 2020-05-18T21:31:51.651 INFO:teuthology.orchestra.run.smithi063.stdout: "projected_version": 0, 2020-05-18T21:31:51.651 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.652 INFO:teuthology.orchestra.run.smithi063.stdout: "is_auth": false, 2020-05-18T21:31:51.652 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_state": { 2020-05-18T21:31:51.652 INFO:teuthology.orchestra.run.smithi063.stdout: "replicas": {} 2020-05-18T21:31:51.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.652 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_state": { 2020-05-18T21:31:51.653 INFO:teuthology.orchestra.run.smithi063.stdout: "authority": [ 2020-05-18T21:31:51.653 INFO:teuthology.orchestra.run.smithi063.stdout: 0, 2020-05-18T21:31:51.653 INFO:teuthology.orchestra.run.smithi063.stdout: -2 2020-05-18T21:31:51.653 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:31:51.653 INFO:teuthology.orchestra.run.smithi063.stdout: "replica_nonce": 1 2020-05-18T21:31:51.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.654 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_pins": 0, 2020-05-18T21:31:51.654 INFO:teuthology.orchestra.run.smithi063.stdout: "is_frozen": false, 2020-05-18T21:31:51.654 INFO:teuthology.orchestra.run.smithi063.stdout: "is_freezing": false, 2020-05-18T21:31:51.654 INFO:teuthology.orchestra.run.smithi063.stdout: "pins": { 2020-05-18T21:31:51.655 INFO:teuthology.orchestra.run.smithi063.stdout: "inodepin": 1 2020-05-18T21:31:51.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.655 INFO:teuthology.orchestra.run.smithi063.stdout: "nref": 1, 2020-05-18T21:31:51.655 INFO:teuthology.orchestra.run.smithi063.stdout: "lock": {}, 2020-05-18T21:31:51.655 INFO:teuthology.orchestra.run.smithi063.stdout: "versionlock": { 2020-05-18T21:31:51.655 INFO:teuthology.orchestra.run.smithi063.stdout: "gather_set": [], 2020-05-18T21:31:51.656 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "lock", 2020-05-18T21:31:51.656 INFO:teuthology.orchestra.run.smithi063.stdout: "is_leased": false, 2020-05-18T21:31:51.656 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rdlocks": 0, 2020-05-18T21:31:51.656 INFO:teuthology.orchestra.run.smithi063.stdout: "num_wrlocks": 0, 2020-05-18T21:31:51.656 INFO:teuthology.orchestra.run.smithi063.stdout: "num_xlocks": 0, 2020-05-18T21:31:51.657 INFO:teuthology.orchestra.run.smithi063.stdout: "xlock_by": {} 2020-05-18T21:31:51.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:31:51.657 INFO:teuthology.orchestra.run.smithi063.stdout: "states": [] 2020-05-18T21:31:51.657 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.657 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.657 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.658 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:31:51.658 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:31:51.658 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:31:51.659 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "ino": 1099511627778, "rdev": 0, "ctime": "2020-05-18T21:31:44.193835+0000", "btime": "2020-05-18T21:31:44.171298+0000", "mode": 33188, "uid": 0, "gid": 0, "nlink": 2, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 16, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:44.169786+0000", "atime": "2020-05-18T21:31:44.169786+0000", "time_warp_seq": 1, "change_attr": 2, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:31:44.193835+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:31:44.193835+0000" }, "version": 6, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 2, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": { "0": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "importingcaps": 0, "caps": 1, "dirtyparent": 1, "replicated": 1, "dirty": 1 }, "nref": 4, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 7434, "pending": "pAsLsXsFscr", "issued": "pAsLsXsFscr", "wanted": "-", "last_sent": 1 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1547, "rdev": 0, "ctime": "2020-05-18T21:31:38.180496+0000", "btime": "2020-05-18T21:31:38.180496+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.180496+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180496+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180496+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray1", "dirfrag": "0x60b", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1548, "rdev": 0, "ctime": "2020-05-18T21:31:38.180788+0000", "btime": "2020-05-18T21:31:38.180788+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.180788+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180788+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180788+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray2", "dirfrag": "0x60c", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1546, "rdev": 0, "ctime": "2020-05-18T21:31:38.180117+0000", "btime": "2020-05-18T21:31:38.180117+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.180117+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180117+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.180117+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray0", "dirfrag": "0x60a", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1549, "rdev": 0, "ctime": "2020-05-18T21:31:38.181046+0000", "btime": "2020-05-18T21:31:38.181046+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181046+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181046+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181046+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray3", "dirfrag": "0x60d", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1553, "rdev": 0, "ctime": "2020-05-18T21:31:38.182214+0000", "btime": "2020-05-18T21:31:38.182214+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.182214+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182214+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182214+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray7", "dirfrag": "0x611", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1554, "rdev": 0, "ctime": "2020-05-18T21:31:38.182533+0000", "btime": "2020-05-18T21:31:38.182533+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.182533+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182533+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182533+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray8", "dirfrag": "0x612", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1550, "rdev": 0, "ctime": "2020-05-18T21:31:38.181349+0000", "btime": "2020-05-18T21:31:38.181349+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181349+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181349+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181349+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray4", "dirfrag": "0x60e", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1555, "rdev": 0, "ctime": "2020-05-18T21:31:38.182880+0000", "btime": "2020-05-18T21:31:38.182880+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.182880+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray9", "dirfrag": "0x613", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1551, "rdev": 0, "ctime": "2020-05-18T21:31:38.181638+0000", "btime": "2020-05-18T21:31:38.181638+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181638+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181638+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181638+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray5", "dirfrag": "0x60f", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1552, "rdev": 0, "ctime": "2020-05-18T21:31:38.181913+0000", "btime": "2020-05-18T21:31:38.181913+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.181913+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181913+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.181913+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1, "dirtyparent": 0, "authpin": 0 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray6", "dirfrag": "0x610", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 0, "authpin": 0 }, "nref": 1, "dentries": [] } ] }, { "ino": 1099511627776, "rdev": 0, "ctime": "2020-05-18T21:31:44.486441+0000", "btime": "2020-05-18T21:31:44.091087+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:44.171298+0000", "atime": "2020-05-18T21:31:44.091087+0000", "time_warp_seq": 0, "change_attr": 2, "export_pin": 1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:31:44.171298+0000", "num_files": 1, "num_subdirs": 0, "change_attr": 1 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 1, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:44.486441+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 1, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:44.486441+0000" }, "version": 14, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 2, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "importing": 0, "dirfrag": 1 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "/dir_1", "dirfrag": "0x10000000000", "snapid_first": 2, "projected_version": "7", "version": "7", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1 }, "nref": 4, "dentries": [ { "path": "dir_1/original", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511627778, "remote_type": "", "version": 6, "projected_version": 6, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": { "0": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "replicated": 1, "dirty": 1 }, "nref": 3, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth", "dirty" ] } ] } ] }, { "ino": 3, "rdev": 0, "ctime": "2020-05-18T21:31:38.184087+0000", "btime": "2020-05-18T21:31:38.184087+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.184087+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.184087+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.184087+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ -2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": {}, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 257, "rdev": 0, "ctime": "2020-05-18T21:31:38.179986+0000", "btime": "2020-05-18T21:31:38.179986+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:38.179986+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 10, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:31:38.182880+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "1", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2, "dentries": [ { "path": "stray6", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1552, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray7", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1553, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray0", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1546, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray9", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1555, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray5", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1551, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray2", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1548, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray1", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1547, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray8", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1554, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray3", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1549, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray4", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1550, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "dirty": 0 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] } ] } ] }, { "ino": 1, "rdev": 0, "ctime": "2020-05-18T21:31:44.101697+0000", "btime": "2020-05-18T21:31:30.216980+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 16, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:44.101697+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:31:44.101697+0000", "num_files": 0, "num_subdirs": 2, "change_attr": 2 }, "rstat": { "version": 1, "rbytes": 0, "rfiles": 1, "rsubdirs": 3, "rsnaps": 0, "rctime": "2020-05-18T21:31:44.486441+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:31:30.216980+0000" }, "version": 7, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "dirfrag": 1, "dirwaiter": 0, "discoverbase": 0 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "0", "version": "16", "committing_version": "0", "committed_version": "0", "is_rep": true, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1 }, "nref": 2, "dentries": [ { "path": "dir_1", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511627776, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [] } ] } ] } ] 2020-05-18T21:31:51.662 DEBUG:tasks.cephfs.test_strays:Found ino in cache: { "ino": 1099511627778, "rdev": 0, "ctime": "2020-05-18T21:31:44.193835+0000", "btime": "2020-05-18T21:31:44.171298+0000", "mode": 33188, "uid": 0, "gid": 0, "nlink": 2, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 16, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:31:44.169786+0000", "atime": "2020-05-18T21:31:44.169786+0000", "time_warp_seq": 1, "change_attr": 2, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:31:44.193835+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:31:44.193835+0000" }, "version": 6, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 2, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": { "0": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "importingcaps": 0, "caps": 1, "dirtyparent": 1, "replicated": 1, "dirty": 1 }, "nref": 4, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 7434, "pending": "pAsLsXsFscr", "issued": "pAsLsXsFscr", "wanted": "-", "last_sent": 1 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] } 2020-05-18T21:31:51.663 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:31:51.663 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:31:51.664 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:31:51.680 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[26642]: fuse finished with error 0 and tester_r 0 2020-05-18T21:31:51.683 INFO:teuthology.orchestra.run:waiting for 900 2020-05-18T21:31:57.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:57.787 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:31:57.795 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:31:57.796 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:31:57.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:57.797 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 down' 2020-05-18T21:31:57.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:57.823 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.0' 2020-05-18T21:31:57.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:57.902 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:31:57.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:57.921 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:31:57.927 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:31:57.927 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:31:57.927 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:31:57.927 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:57.928 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:31:57.928 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:57.928 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:31:57.928 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:57.928 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:31:57.929 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:57.929 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:31:57.929 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:57.929 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:31:57.929 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:57.930 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:31:57.930 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42525sec preferred_lft 42525sec 2020-05-18T21:31:57.930 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:31:57.930 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:57.930 INFO:teuthology.orchestra.run.smithi063.stdout:23: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-05-18T21:31:57.931 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:57.931 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:31:57.931 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:57.931 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::cfd:baff:fe6e:beac/64 scope link 2020-05-18T21:31:57.931 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:31:57.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:57.932 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:31:57.947 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:31:57.948 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:31:57.948 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:31:57.948 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:57.948 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:31:57.948 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:57.949 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:31:57.949 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:57.949 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:31:57.949 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:57.950 INFO:teuthology.orchestra.run.smithi063.stdout:23: ceph-brx: mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:31:57.950 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:31:57.951 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:31:57.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:57.952 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:31:57.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:57.973 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:31:58.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:58.151 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:31:58.161 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:31:58.161 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:31:58.162 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:31:58.162 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:31:58.162 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:31:58.162 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:31:58.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:58.163 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:31:58.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:58.180 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:31:58.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:31:58.242 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:31:58.262 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok flush journal 2020-05-18T21:31:58.383 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:31:58.383 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "", 2020-05-18T21:31:58.384 INFO:teuthology.orchestra.run.smithi155.stdout: "return_code": 0 2020-05-18T21:31:58.384 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:31:58.394 INFO:tasks.cephfs.filesystem:_json_asok output: { "message": "", "return_code": 0 } 2020-05-18T21:31:58.395 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush journal 2020-05-18T21:31:58.512 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:31:58.513 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "", 2020-05-18T21:31:58.513 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0 2020-05-18T21:31:58.513 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:31:58.523 INFO:tasks.cephfs.filesystem:_json_asok output: { "message": "", "return_code": 0 } 2020-05-18T21:31:58.524 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:31:58.525 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:31:58.525 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:31:58.525 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:31:58.538 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:31:58.538 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail a 2020-05-18T21:31:58.542 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:31:58.542 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail b 2020-05-18T21:31:58.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.633+0000 7f1505305700 1 Processor -- start 2020-05-18T21:31:58.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f1505305700 1 -- start start 2020-05-18T21:31:58.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f1505305700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15000b6170 0x7f1500099ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:58.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f1505305700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f150005f140 0x7f150014e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:58.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f1505305700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f150009e1c0 0x7f150009e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:58.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f1505305700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f150005f580 con 0x7f150005f140 2020-05-18T21:31:58.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f1505305700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f150005f960 con 0x7f150009e1c0 2020-05-18T21:31:58.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f1505305700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150005fc00 con 0x7f15000b6170 2020-05-18T21:31:58.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14f7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f150005f140 0x7f150014e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:58.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14f7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f150005f140 0x7f150014e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58610/0 (socket says 172.21.15.63:58610) 2020-05-18T21:31:58.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14f7fff700 1 -- 172.21.15.63:0/704966538 learned_addr learned my addr 172.21.15.63:0/704966538 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:31:58.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14feffd700 1 --2- 172.21.15.63:0/704966538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15000b6170 0x7f1500099ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:58.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14ff7fe700 1 --2- 172.21.15.63:0/704966538 >> v2:172.21.15.155:3300/0 conn(0x7f150009e1c0 0x7f150009e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:58.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14ff7fe700 1 -- 172.21.15.63:0/704966538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15000b6170 msgr2=0x7f1500099ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:58.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14ff7fe700 1 --2- 172.21.15.63:0/704966538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15000b6170 0x7f1500099ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:58.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14ff7fe700 1 -- 172.21.15.63:0/704966538 >> v2:172.21.15.63:3300/0 conn(0x7f150005f140 msgr2=0x7f150014e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:58.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14ff7fe700 1 --2- 172.21.15.63:0/704966538 >> v2:172.21.15.63:3300/0 conn(0x7f150005f140 0x7f150014e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:58.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14ff7fe700 1 -- 172.21.15.63:0/704966538 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150005fea0 con 0x7f150009e1c0 2020-05-18T21:31:58.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14feffd700 1 --2- 172.21.15.63:0/704966538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15000b6170 0x7f1500099ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:31:58.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14ff7fe700 1 --2- 172.21.15.63:0/704966538 >> v2:172.21.15.155:3300/0 conn(0x7f150009e1c0 0x7f150009e5f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f14f80032f0 tx=0x7f14f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14ff7fe700 1 --2- 172.21.15.63:0/704966538 >> v2:172.21.15.155:3300/0 conn(0x7f150009e1c0 0x7f150009e5f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f14f80032f0 tx=0x7f14f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14ff7fe700 1 --2- 172.21.15.63:0/704966538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f150009e1c0 0x7f150009e5f0 secure :-1 s=READY pgs=757 cs=0 l=1 rx=0x7f14f80032f0 tx=0x7f14f8007e00).ready entity=mon.1 client_cookie=b749953e22a6a71e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:58.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14ff7fe700 1 --2- 172.21.15.63:0/704966538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f150009e1c0 0x7f150009e5f0 secure :-1 s=THROTTLE_DONE pgs=757 cs=0 l=1 rx=0x7f14f80032f0 tx=0x7f14f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14fe7fc700 1 -- 172.21.15.63:0/704966538 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14f8011db0 con 0x7f150009e1c0 2020-05-18T21:31:58.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14ff7fe700 1 --2- 172.21.15.63:0/704966538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f150009e1c0 0x7f150009e5f0 secure :-1 s=THROTTLE_DONE pgs=757 cs=0 l=1 rx=0x7f14f80032f0 tx=0x7f14f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14fe7fc700 1 -- 172.21.15.63:0/704966538 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f800a180 con 0x7f150009e1c0 2020-05-18T21:31:58.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14ff7fe700 1 --2- 172.21.15.63:0/704966538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f150009e1c0 0x7f150009e5f0 secure :-1 s=THROTTLE_DONE pgs=757 cs=0 l=1 rx=0x7f14f80032f0 tx=0x7f14f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f14fe7fc700 1 -- 172.21.15.63:0/704966538 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14f800a5a0 con 0x7f150009e1c0 2020-05-18T21:31:58.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f1505305700 1 -- 172.21.15.63:0/704966538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f150009e1c0 msgr2=0x7f150009e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:58.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f1505305700 1 --2- 172.21.15.63:0/704966538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f150009e1c0 0x7f150009e5f0 secure :-1 s=READY pgs=757 cs=0 l=1 rx=0x7f14f80032f0 tx=0x7f14f8007e00).stop 2020-05-18T21:31:58.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f1505305700 1 -- 172.21.15.63:0/704966538 shutdown_connections 2020-05-18T21:31:58.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f1505305700 1 --2- 172.21.15.63:0/704966538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f150009e1c0 0x7f150009e5f0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:58.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f1505305700 1 --2- 172.21.15.63:0/704966538 >> v2:172.21.15.63:3300/0 conn(0x7f150005f140 0x7f150014e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:58.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f1505305700 1 --2- 172.21.15.63:0/704966538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15000b6170 0x7f1500099ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:58.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f1505305700 1 -- 172.21.15.63:0/704966538 >> 172.21.15.63:0/704966538 conn(0x7f15000b9750 msgr2=0x7f15000b5720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:58.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f1505305700 1 -- 172.21.15.63:0/704966538 shutdown_connections 2020-05-18T21:31:58.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f1505305700 1 -- 172.21.15.63:0/704966538 wait complete. 2020-05-18T21:31:58.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f3faa558700 1 Processor -- start 2020-05-18T21:31:58.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.637+0000 7f3faa558700 1 -- start start 2020-05-18T21:31:58.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3faa558700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa41426c0 0x7f3fa40b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:58.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3faa558700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3fa40b5160 0x7f3fa414c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:58.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3faa558700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa409ccf0 con 0x7f3fa409e6c0 2020-05-18T21:31:58.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3faa558700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa409cf90 con 0x7f3fa40b5160 2020-05-18T21:31:58.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3faa558700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa409eaa0 con 0x7f3fa41426c0 2020-05-18T21:31:58.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3fa8d55700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa41426c0 0x7f3fa40b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:58.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3fa9556700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f3fa409e6c0 0x7f3fa4141fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:59116/0 (socket says 172.21.15.63:59116) 2020-05-18T21:31:58.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3fa9556700 1 -- 172.21.15.63:0/2333241820 learned_addr learned my addr 172.21.15.63:0/2333241820 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:58.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3fa9d57700 1 --2- 172.21.15.63:0/2333241820 >> v2:172.21.15.155:3300/0 conn(0x7f3fa40b5160 0x7f3fa414c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:58.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3fa8d55700 1 -- 172.21.15.63:0/2333241820 >> v2:172.21.15.155:3300/0 conn(0x7f3fa40b5160 msgr2=0x7f3fa414c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:58.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/2333241820 >> v2:172.21.15.155:3300/0 conn(0x7f3fa40b5160 0x7f3fa414c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:58.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3fa8d55700 1 -- 172.21.15.63:0/2333241820 >> v1:172.21.15.155:6789/0 conn(0x7f3fa409e6c0 legacy=0x7f3fa4141fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:58.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3fa8d55700 1 -- 172.21.15.63:0/2333241820 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa4066370 con 0x7f3fa41426c0 2020-05-18T21:31:58.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/2333241820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa41426c0 0x7f3fa40b4480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3fa0002f70 tx=0x7f3fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/2333241820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa41426c0 0x7f3fa40b4480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3fa0002f70 tx=0x7f3fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/2333241820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa41426c0 0x7f3fa40b4480 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7f3fa0002f70 tx=0x7f3fa0007a80).ready entity=mon.2 client_cookie=f4334a82d5f85f7e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:58.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/2333241820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa41426c0 0x7f3fa40b4480 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7f3fa0002f70 tx=0x7f3fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3f97fff700 1 -- 172.21.15.63:0/2333241820 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fa0008e80 con 0x7f3fa41426c0 2020-05-18T21:31:58.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/2333241820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa41426c0 0x7f3fa40b4480 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7f3fa0002f70 tx=0x7f3fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3f97fff700 1 -- 172.21.15.63:0/2333241820 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa00115f0 con 0x7f3fa41426c0 2020-05-18T21:31:58.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/2333241820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa41426c0 0x7f3fa40b4480 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7f3fa0002f70 tx=0x7f3fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3faa558700 1 -- 172.21.15.63:0/2333241820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa41426c0 msgr2=0x7f3fa40b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:58.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3f97fff700 1 -- 172.21.15.63:0/2333241820 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fa0011a10 con 0x7f3fa41426c0 2020-05-18T21:31:58.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3faa558700 1 --2- 172.21.15.63:0/2333241820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa41426c0 0x7f3fa40b4480 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7f3fa0002f70 tx=0x7f3fa0007a80).stop 2020-05-18T21:31:58.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3faa558700 1 -- 172.21.15.63:0/2333241820 shutdown_connections 2020-05-18T21:31:58.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3faa558700 1 --2- 172.21.15.63:0/2333241820 >> v2:172.21.15.155:3300/0 conn(0x7f3fa40b5160 0x7f3fa414c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:58.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3faa558700 1 --2- 172.21.15.63:0/2333241820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa41426c0 0x7f3fa40b4480 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:58.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3faa558700 1 -- 172.21.15.63:0/2333241820 >> 172.21.15.63:0/2333241820 conn(0x7f3fa40b9630 msgr2=0x7f3fa40b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:58.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3faa558700 1 -- 172.21.15.63:0/2333241820 shutdown_connections 2020-05-18T21:31:58.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f3faa558700 1 -- 172.21.15.63:0/2333241820 wait complete. 2020-05-18T21:31:58.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f3faa558700 1 Processor -- start 2020-05-18T21:31:58.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f3faa558700 1 -- start start 2020-05-18T21:31:58.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f3faa558700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3fa40b5160 0x7f3fa4138040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:58.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f3faa558700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3fa41426c0 0x7f3fa41362c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:58.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f3faa558700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa413d200 con 0x7f3fa409e6c0 2020-05-18T21:31:58.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f3faa558700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa413d4a0 con 0x7f3fa41426c0 2020-05-18T21:31:58.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f3faa558700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa413d740 con 0x7f3fa40b5160 2020-05-18T21:31:58.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f3fa9556700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3fa409e6c0 0x7f3fa4135bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60814/0 (socket says 172.21.15.63:60814) 2020-05-18T21:31:58.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f3fa9556700 1 -- 172.21.15.63:0/4017487650 learned_addr learned my addr 172.21.15.63:0/4017487650 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:58.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f3fa9d57700 1 --2- 172.21.15.63:0/4017487650 >> v2:172.21.15.63:3300/0 conn(0x7f3fa41426c0 0x7f3fa41362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:58.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/4017487650 >> v2:172.21.15.155:3300/0 conn(0x7f3fa40b5160 0x7f3fa4138040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:58.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f3fa9d57700 1 -- 172.21.15.63:0/4017487650 >> v2:172.21.15.155:3300/0 conn(0x7f3fa40b5160 msgr2=0x7f3fa4138040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:58.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f3fa9d57700 1 --2- 172.21.15.63:0/4017487650 >> v2:172.21.15.155:3300/0 conn(0x7f3fa40b5160 0x7f3fa4138040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:58.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f3fa9d57700 1 -- 172.21.15.63:0/4017487650 >> v1:172.21.15.63:6789/0 conn(0x7f3fa409e6c0 legacy=0x7f3fa4135bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:58.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f3fa9d57700 1 -- 172.21.15.63:0/4017487650 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa413ce10 con 0x7f3fa41426c0 2020-05-18T21:31:58.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f3fa9d57700 1 --2- 172.21.15.63:0/4017487650 >> v2:172.21.15.63:3300/0 conn(0x7f3fa41426c0 0x7f3fa41362c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3f98002f70 tx=0x7f3f98010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f3fa9d57700 1 --2- 172.21.15.63:0/4017487650 >> v2:172.21.15.63:3300/0 conn(0x7f3fa41426c0 0x7f3fa41362c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3f98002f70 tx=0x7f3f98010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f3fa9d57700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3fa41426c0 0x7f3fa41362c0 secure :-1 s=READY pgs=1105 cs=0 l=1 rx=0x7f3f98002f70 tx=0x7f3f98010b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:58.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f3fa9d57700 1 -- 172.21.15.63:0/4017487650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3fa41426c0 msgr2=0x7f3fa41362c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-05-18T21:31:58.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f3fa9d57700 1 -- 172.21.15.63:0/4017487650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3fa41426c0 msgr2=0x7f3fa41362c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-05-18T21:31:58.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f3fa9d57700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3fa41426c0 0x7f3fa41362c0 secure :-1 s=READY pgs=1105 cs=0 l=1 rx=0x7f3f98002f70 tx=0x7f3f98010b80).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-05-18T21:31:58.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f3fa9d57700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3fa41426c0 0x7f3fa41362c0 secure :-1 s=READY pgs=1105 cs=0 l=1 rx=0x7f3f98002f70 tx=0x7f3f98010b80).stop 2020-05-18T21:31:58.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f3f967fc700 1 -- 172.21.15.63:0/4017487650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3fa41426c0 msgr2=0x7f3fa41362c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-05-18T21:31:58.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f3f967fc700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3fa41426c0 0x7f3fa41362c0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:58.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f3f967fc700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f8c006fd0 0x7f3f8c009490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:58.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f3f967fc700 1 -- 172.21.15.63:0/4017487650 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8c009a90 con 0x7f3f8c003400 2020-05-18T21:31:58.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f3f967fc700 1 -- 172.21.15.63:0/4017487650 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c00ac50 con 0x7f3f8c006fd0 2020-05-18T21:31:58.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f8c006fd0 0x7f3f8c009490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:58.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.653+0000 7f3fa8d55700 1 -- 172.21.15.63:0/4017487650 >> v1:172.21.15.155:6789/0 conn(0x7f3f8c003400 legacy=0x7f3f8c0057f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:58.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.653+0000 7f3fa8d55700 1 -- 172.21.15.63:0/4017487650 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c00aed0 con 0x7f3f8c006fd0 2020-05-18T21:31:58.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.653+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f8c006fd0 0x7f3f8c009490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3fa0002f70 tx=0x7f3fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.653+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f8c006fd0 0x7f3f8c009490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3fa0002f70 tx=0x7f3fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.653+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f8c006fd0 0x7f3f8c009490 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f3fa0002f70 tx=0x7f3fa0007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:58.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f1505305700 1 Processor -- start 2020-05-18T21:31:58.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f1505305700 1 -- start start 2020-05-18T21:31:58.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f1505305700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f150005f140 0x7f1500147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:58.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f1505305700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f15000b6170 0x7f1500140810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:58.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f1505305700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1500149500 con 0x7f150009e1c0 2020-05-18T21:31:58.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f1505305700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15001497a0 con 0x7f150005f140 2020-05-18T21:31:58.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f1505305700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1500149a40 con 0x7f15000b6170 2020-05-18T21:31:58.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f14feffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f150005f140 0x7f1500147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:58.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f14f7fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f150009e1c0 0x7f1500140100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60808/0 (socket says 172.21.15.63:60808) 2020-05-18T21:31:58.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f14f7fff700 1 -- 172.21.15.63:0/3325539930 learned_addr learned my addr 172.21.15.63:0/3325539930 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:58.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f14ff7fe700 1 --2- 172.21.15.63:0/3325539930 >> v2:172.21.15.155:3300/0 conn(0x7f15000b6170 0x7f1500140810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:58.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f14feffd700 1 -- 172.21.15.63:0/3325539930 >> v2:172.21.15.155:3300/0 conn(0x7f15000b6170 msgr2=0x7f1500140810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:58.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f14feffd700 1 --2- 172.21.15.63:0/3325539930 >> v2:172.21.15.155:3300/0 conn(0x7f15000b6170 0x7f1500140810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:58.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f14fcff9700 1 -- 172.21.15.63:0/3325539930 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077305459 0 0) 0x7f1500149500 con 0x7f150009e1c0 2020-05-18T21:31:58.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f14feffd700 1 -- 172.21.15.63:0/3325539930 >> v1:172.21.15.63:6789/0 conn(0x7f150009e1c0 legacy=0x7f1500140100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:58.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f14feffd700 1 -- 172.21.15.63:0/3325539930 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1500144a90 con 0x7f150005f140 2020-05-18T21:31:58.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f14ff7fe700 1 --2- 172.21.15.63:0/3325539930 >> v2:172.21.15.155:3300/0 conn(0x7f15000b6170 0x7f1500140810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:31:58.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f14feffd700 1 --2- 172.21.15.63:0/3325539930 >> v2:172.21.15.63:3300/0 conn(0x7f150005f140 0x7f1500147fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f14f0002f70 tx=0x7f14f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f14feffd700 1 --2- 172.21.15.63:0/3325539930 >> v2:172.21.15.63:3300/0 conn(0x7f150005f140 0x7f1500147fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f14f0002f70 tx=0x7f14f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f14feffd700 1 --2- 172.21.15.63:0/3325539930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f150005f140 0x7f1500147fb0 secure :-1 s=READY pgs=1103 cs=0 l=1 rx=0x7f14f0002f70 tx=0x7f14f0010de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:58.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f14feffd700 1 --2- 172.21.15.63:0/3325539930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f150005f140 0x7f1500147fb0 secure :-1 s=THROTTLE_DONE pgs=1103 cs=0 l=1 rx=0x7f14f0002f70 tx=0x7f14f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f14fcff9700 1 -- 172.21.15.63:0/3325539930 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14f0007560 con 0x7f150005f140 2020-05-18T21:31:58.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f14feffd700 1 --2- 172.21.15.63:0/3325539930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f150005f140 0x7f1500147fb0 secure :-1 s=THROTTLE_DONE pgs=1103 cs=0 l=1 rx=0x7f14f0002f70 tx=0x7f14f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f14feffd700 1 --2- 172.21.15.63:0/3325539930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f150005f140 0x7f1500147fb0 secure :-1 s=THROTTLE_DONE pgs=1103 cs=0 l=1 rx=0x7f14f0002f70 tx=0x7f14f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f14fcff9700 1 -- 172.21.15.63:0/3325539930 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f0005a00 con 0x7f150005f140 2020-05-18T21:31:58.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f1505305700 1 -- 172.21.15.63:0/3325539930 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1500144c80 con 0x7f150005f140 2020-05-18T21:31:58.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f14fcff9700 1 -- 172.21.15.63:0/3325539930 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14f0005da0 con 0x7f150005f140 2020-05-18T21:31:58.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.641+0000 7f1505305700 1 -- 172.21.15.63:0/3325539930 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15001490f0 con 0x7f150005f140 2020-05-18T21:31:58.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f14feffd700 1 --2- 172.21.15.63:0/3325539930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f150005f140 0x7f1500147fb0 secure :-1 s=THROTTLE_DONE pgs=1103 cs=0 l=1 rx=0x7f14f0002f70 tx=0x7f14f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f14fcff9700 1 -- 172.21.15.63:0/3325539930 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f14f0012480 con 0x7f150005f140 2020-05-18T21:31:58.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f14feffd700 1 --2- 172.21.15.63:0/3325539930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f150005f140 0x7f1500147fb0 secure :-1 s=THROTTLE_DONE pgs=1103 cs=0 l=1 rx=0x7f14f0002f70 tx=0x7f14f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f14fcff9700 1 --2- 172.21.15.63:0/3325539930 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14e404f8e0 0x7f14e4051da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:58.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f14fcff9700 1 -- 172.21.15.63:0/3325539930 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f14f0063d90 con 0x7f150005f140 2020-05-18T21:31:58.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f1505305700 1 -- 172.21.15.63:0/3325539930 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15000b8490 con 0x7f150005f140 2020-05-18T21:31:58.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f14f7fff700 1 --2- 172.21.15.63:0/3325539930 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14e404f8e0 0x7f14e4051da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:58.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f14f7fff700 1 --2- 172.21.15.63:0/3325539930 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14e404f8e0 0x7f14e4051da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f14e8007ad0 tx=0x7f14e80090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f14f7fff700 1 --2- 172.21.15.63:0/3325539930 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14e404f8e0 0x7f14e4051da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f14e8007ad0 tx=0x7f14e80090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.645+0000 7f14f7fff700 1 --2- 172.21.15.63:0/3325539930 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14e404f8e0 0x7f14e4051da0 secure :-1 s=READY pgs=437 cs=0 l=1 rx=0x7f14e8007ad0 tx=0x7f14e80090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:58.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f14feffd700 1 --2- 172.21.15.63:0/3325539930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f150005f140 0x7f1500147fb0 secure :-1 s=THROTTLE_DONE pgs=1103 cs=0 l=1 rx=0x7f14f0002f70 tx=0x7f14f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.649+0000 7f14fcff9700 1 -- 172.21.15.63:0/3325539930 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f14f003e0c0 con 0x7f150005f140 2020-05-18T21:31:58.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.657+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f8c006fd0 0x7f3f8c009490 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f3fa0002f70 tx=0x7f3fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.657+0000 7f3f967fc700 1 -- 172.21.15.63:0/4017487650 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fa0007360 con 0x7f3f8c006fd0 2020-05-18T21:31:58.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.657+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f8c006fd0 0x7f3f8c009490 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f3fa0002f70 tx=0x7f3fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.657+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f8c006fd0 0x7f3f8c009490 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f3fa0002f70 tx=0x7f3fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.657+0000 7f3f967fc700 1 -- 172.21.15.63:0/4017487650 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa00074c0 con 0x7f3f8c006fd0 2020-05-18T21:31:58.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.657+0000 7f3faa558700 1 -- 172.21.15.63:0/4017487650 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa4136830 con 0x7f3f8c006fd0 2020-05-18T21:31:58.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.657+0000 7f3f967fc700 1 -- 172.21.15.63:0/4017487650 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fa0007630 con 0x7f3f8c006fd0 2020-05-18T21:31:58.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.657+0000 7f3faa558700 1 -- 172.21.15.63:0/4017487650 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa413de00 con 0x7f3f8c006fd0 2020-05-18T21:31:58.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.657+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f8c006fd0 0x7f3f8c009490 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f3fa0002f70 tx=0x7f3fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.657+0000 7f3faa558700 1 -- 172.21.15.63:0/4017487650 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa413d060 con 0x7f3f8c006fd0 2020-05-18T21:31:58.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.657+0000 7f3f967fc700 1 -- 172.21.15.63:0/4017487650 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3fa00058f0 con 0x7f3f8c006fd0 2020-05-18T21:31:58.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.657+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f8c006fd0 0x7f3f8c009490 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f3fa0002f70 tx=0x7f3fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.657+0000 7f3f967fc700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3f8c05aaa0 0x7f3f8c05cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:58.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.657+0000 7f3f967fc700 1 -- 172.21.15.63:0/4017487650 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3fa0064790 con 0x7f3f8c006fd0 2020-05-18T21:31:58.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.661+0000 7f3fa9556700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3f8c05aaa0 0x7f3f8c05cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:58.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.661+0000 7f3fa9556700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3f8c05aaa0 0x7f3f8c05cf60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3fa4060a40 tx=0x7f3f9c0018b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.661+0000 7f3fa9556700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3f8c05aaa0 0x7f3f8c05cf60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3fa4060a40 tx=0x7f3f9c0018b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.661+0000 7f3fa9556700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3f8c05aaa0 0x7f3f8c05cf60 secure :-1 s=READY pgs=438 cs=0 l=1 rx=0x7f3fa4060a40 tx=0x7f3f9c0018b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:58.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.665+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f8c006fd0 0x7f3f8c009490 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f3fa0002f70 tx=0x7f3fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:58.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.665+0000 7f3f967fc700 1 -- 172.21.15.63:0/4017487650 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3fa413d060 con 0x7f3f8c006fd0 2020-05-18T21:31:58.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.805+0000 7f1505305700 1 -- 172.21.15.63:0/3325539930 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f15000569e0 con 0x7f150005f140 2020-05-18T21:31:58.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:58.821+0000 7f3faa558700 1 -- 172.21.15.63:0/4017487650 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f3fa413d060 con 0x7f3f8c006fd0 2020-05-18T21:31:59.435 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:31:59.438 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:31:59.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.641+0000 7f14feffd700 1 --2- 172.21.15.63:0/3325539930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f150005f140 0x7f1500147fb0 secure :-1 s=READY pgs=1103 cs=0 l=1 rx=0x7f14f0002f70 tx=0x7f14f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.649+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f8c006fd0 0x7f3f8c009490 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f3fa0002f70 tx=0x7f3fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.657 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:31:59.653+0000 7fdb4592c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:31:59.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.669+0000 7f14feffd700 1 --2- 172.21.15.63:0/3325539930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f150005f140 0x7f1500147fb0 secure :-1 s=THROTTLE_DONE pgs=1103 cs=0 l=1 rx=0x7f14f0002f70 tx=0x7f14f0010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.669+0000 7f14fcff9700 1 -- 172.21.15.63:0/3325539930 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 7242 v58) v1 ==== 95+0+0 (secure 0 0 0) 0x7f14f00416e0 con 0x7f150005f140 2020-05-18T21:31:59.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.669+0000 7f3fa8d55700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f8c006fd0 0x7f3f8c009490 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f3fa0002f70 tx=0x7f3fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.669+0000 7f3f967fc700 1 -- 172.21.15.63:0/4017487650 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7236 v58) v1 ==== 95+0+0 (secure 0 0 0) 0x7f3fa413d060 con 0x7f3f8c006fd0 2020-05-18T21:31:59.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f3faa558700 1 -- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3f8c05aaa0 msgr2=0x7f3f8c05cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:59.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f3faa558700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3f8c05aaa0 0x7f3f8c05cf60 secure :-1 s=READY pgs=438 cs=0 l=1 rx=0x7f3fa4060a40 tx=0x7f3f9c0018b0).stop 2020-05-18T21:31:59.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f3faa558700 1 -- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f8c006fd0 msgr2=0x7f3f8c009490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:59.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f3faa558700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f8c006fd0 0x7f3f8c009490 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f3fa0002f70 tx=0x7f3fa0007a80).stop 2020-05-18T21:31:59.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f3fa9d57700 1 -- 172.21.15.63:0/4017487650 reap_dead start 2020-05-18T21:31:59.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f3fa9d57700 1 -- 172.21.15.63:0/4017487650 reap_dead start 2020-05-18T21:31:59.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f3faa558700 1 -- 172.21.15.63:0/4017487650 shutdown_connections 2020-05-18T21:31:59.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f3faa558700 1 --2- 172.21.15.63:0/4017487650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3fa41426c0 0x7f3fa41362c0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:59.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f3faa558700 1 -- 172.21.15.63:0/4017487650 >> 172.21.15.63:0/4017487650 conn(0x7f3fa40b9630 msgr2=0x7f3fa409c110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:59.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f3faa558700 1 -- 172.21.15.63:0/4017487650 shutdown_connections 2020-05-18T21:31:59.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f3faa558700 1 -- 172.21.15.63:0/4017487650 wait complete. 2020-05-18T21:31:59.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f1505305700 1 -- 172.21.15.63:0/3325539930 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14e404f8e0 msgr2=0x7f14e4051da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:59.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f1505305700 1 --2- 172.21.15.63:0/3325539930 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14e404f8e0 0x7f14e4051da0 secure :-1 s=READY pgs=437 cs=0 l=1 rx=0x7f14e8007ad0 tx=0x7f14e80090f0).stop 2020-05-18T21:31:59.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f1505305700 1 -- 172.21.15.63:0/3325539930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f150005f140 msgr2=0x7f1500147fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:59.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f1505305700 1 --2- 172.21.15.63:0/3325539930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f150005f140 0x7f1500147fb0 secure :-1 s=READY pgs=1103 cs=0 l=1 rx=0x7f14f0002f70 tx=0x7f14f0010de0).stop 2020-05-18T21:31:59.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f1505305700 1 -- 172.21.15.63:0/3325539930 shutdown_connections 2020-05-18T21:31:59.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f1505305700 1 --2- 172.21.15.63:0/3325539930 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14e404f8e0 0x7f14e4051da0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:59.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f1505305700 1 --2- 172.21.15.63:0/3325539930 >> v2:172.21.15.155:3300/0 conn(0x7f15000b6170 0x7f1500140810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:59.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f1505305700 1 --2- 172.21.15.63:0/3325539930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f150005f140 0x7f1500147fb0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:59.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f1505305700 1 -- 172.21.15.63:0/3325539930 >> 172.21.15.63:0/3325539930 conn(0x7f15000b9750 msgr2=0x7f1500069be0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:59.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f1505305700 1 -- 172.21.15.63:0/3325539930 shutdown_connections 2020-05-18T21:31:59.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.673+0000 7f1505305700 1 -- 172.21.15.63:0/3325539930 wait complete. 2020-05-18T21:31:59.682 INFO:teuthology.orchestra.run.smithi063.stderr:failed mds gid 7236 2020-05-18T21:31:59.683 INFO:teuthology.orchestra.run.smithi063.stderr:failed mds gid 7242 2020-05-18T21:31:59.697 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:31:59.697 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:31:59.698 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:31:59.698 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:31:59.701 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:31:59.701 DEBUG:teuthology.parallel:result is None 2020-05-18T21:31:59.702 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:31:59.703 DEBUG:teuthology.parallel:result is None 2020-05-18T21:31:59.703 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:31:59.772 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:31:59.776 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:31:59.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.801+0000 7f6681b03700 1 Processor -- start 2020-05-18T21:31:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.801+0000 7f6681b03700 1 -- start start 2020-05-18T21:31:59.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.801+0000 7f6681b03700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f667c0b5860 0x7f667c149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:59.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.801+0000 7f6681b03700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f667c09e360 0x7f667c09e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:31:59.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.801+0000 7f6681b03700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c061140 con 0x7f667c09c9f0 2020-05-18T21:31:59.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.801+0000 7f6681b03700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c09ec10 con 0x7f667c09e360 2020-05-18T21:31:59.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.801+0000 7f6681b03700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c062230 con 0x7f667c0b5860 2020-05-18T21:31:59.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.801+0000 7f667bfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f667c09c9f0 0x7f667c061b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60840/0 (socket says 172.21.15.63:60840) 2020-05-18T21:31:59.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.801+0000 7f667bfff700 1 -- 172.21.15.63:0/863721838 learned_addr learned my addr 172.21.15.63:0/863721838 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:59.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.801+0000 7f6681302700 1 --2- 172.21.15.63:0/863721838 >> v2:172.21.15.63:3300/0 conn(0x7f667c09e360 0x7f667c09e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:59.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.801+0000 7f6680b01700 1 --2- 172.21.15.63:0/863721838 >> v2:172.21.15.155:3300/0 conn(0x7f667c0b5860 0x7f667c149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:59.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f667b7fe700 1 -- 172.21.15.63:0/863721838 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442213056 0 0) 0x7f667c061140 con 0x7f667c09c9f0 2020-05-18T21:31:59.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f667b7fe700 1 -- 172.21.15.63:0/863721838 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6668003270 con 0x7f667c09c9f0 2020-05-18T21:31:59.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681302700 1 -- 172.21.15.63:0/863721838 >> v2:172.21.15.155:3300/0 conn(0x7f667c0b5860 msgr2=0x7f667c149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:31:59.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681302700 1 --2- 172.21.15.63:0/863721838 >> v2:172.21.15.155:3300/0 conn(0x7f667c0b5860 0x7f667c149cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:59.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681302700 1 -- 172.21.15.63:0/863721838 >> v1:172.21.15.63:6789/0 conn(0x7f667c09c9f0 legacy=0x7f667c061b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:59.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681302700 1 -- 172.21.15.63:0/863721838 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c0613e0 con 0x7f667c09e360 2020-05-18T21:31:59.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681302700 1 --2- 172.21.15.63:0/863721838 >> v2:172.21.15.63:3300/0 conn(0x7f667c09e360 0x7f667c09e7b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f666c002f70 tx=0x7f666c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681302700 1 --2- 172.21.15.63:0/863721838 >> v2:172.21.15.63:3300/0 conn(0x7f667c09e360 0x7f667c09e7b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f666c002f70 tx=0x7f666c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681302700 1 --2- 172.21.15.63:0/863721838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f667c09e360 0x7f667c09e7b0 secure :-1 s=READY pgs=1112 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).ready entity=mon.0 client_cookie=84f1a35b14731d37 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:59.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681302700 1 --2- 172.21.15.63:0/863721838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f667c09e360 0x7f667c09e7b0 secure :-1 s=THROTTLE_DONE pgs=1112 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f667b7fe700 1 -- 172.21.15.63:0/863721838 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f666c008e50 con 0x7f667c09e360 2020-05-18T21:31:59.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681302700 1 --2- 172.21.15.63:0/863721838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f667c09e360 0x7f667c09e7b0 secure :-1 s=THROTTLE_DONE pgs=1112 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681302700 1 --2- 172.21.15.63:0/863721838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f667c09e360 0x7f667c09e7b0 secure :-1 s=THROTTLE_DONE pgs=1112 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f667b7fe700 1 -- 172.21.15.63:0/863721838 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c011540 con 0x7f667c09e360 2020-05-18T21:31:59.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f667b7fe700 1 -- 172.21.15.63:0/863721838 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f666c011960 con 0x7f667c09e360 2020-05-18T21:31:59.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681b03700 1 -- 172.21.15.63:0/863721838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f667c09e360 msgr2=0x7f667c09e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:59.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681b03700 1 --2- 172.21.15.63:0/863721838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f667c09e360 0x7f667c09e7b0 secure :-1 s=READY pgs=1112 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).stop 2020-05-18T21:31:59.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681b03700 1 -- 172.21.15.63:0/863721838 shutdown_connections 2020-05-18T21:31:59.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681b03700 1 --2- 172.21.15.63:0/863721838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f667c09e360 0x7f667c09e7b0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:59.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681b03700 1 --2- 172.21.15.63:0/863721838 >> v2:172.21.15.155:3300/0 conn(0x7f667c0b5860 0x7f667c149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:31:59.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681b03700 1 -- 172.21.15.63:0/863721838 >> 172.21.15.63:0/863721838 conn(0x7f667c05a7c0 msgr2=0x7f667c05aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:59.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681b03700 1 -- 172.21.15.63:0/863721838 shutdown_connections 2020-05-18T21:31:59.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681b03700 1 -- 172.21.15.63:0/863721838 wait complete. 2020-05-18T21:31:59.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681b03700 1 Processor -- start 2020-05-18T21:31:59.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.805+0000 7f6681b03700 1 -- start start 2020-05-18T21:31:59.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6681b03700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f667c09e360 0x7f667c065100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:59.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6681b03700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c157290 con 0x7f667c09c9f0 2020-05-18T21:31:59.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6681b03700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c154050 con 0x7f667c0b5860 2020-05-18T21:31:59.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6681b03700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c1542f0 con 0x7f667c09e360 2020-05-18T21:31:59.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6680b01700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f667c09c9f0 0x7f667c0643a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60844/0 (socket says 172.21.15.63:60844) 2020-05-18T21:31:59.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6680b01700 1 -- 172.21.15.63:0/1565335247 learned_addr learned my addr 172.21.15.63:0/1565335247 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:31:59.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f667bfff700 1 --2- 172.21.15.63:0/1565335247 >> v2:172.21.15.155:3300/0 conn(0x7f667c09e360 0x7f667c065100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:59.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6679ffb700 1 -- 172.21.15.63:0/1565335247 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276248786 0 0) 0x7f667c157290 con 0x7f667c09c9f0 2020-05-18T21:31:59.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6679ffb700 1 -- 172.21.15.63:0/1565335247 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f665c002fe0 con 0x7f667c09c9f0 2020-05-18T21:31:59.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6679ffb700 1 -- 172.21.15.63:0/1565335247 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2414633274 0 0) 0x7f665c002fe0 con 0x7f667c09c9f0 2020-05-18T21:31:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6679ffb700 1 -- 172.21.15.63:0/1565335247 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f667c157290 con 0x7f667c09c9f0 2020-05-18T21:31:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6679ffb700 1 -- 172.21.15.63:0/1565335247 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f6674001850 con 0x7f667c09c9f0 2020-05-18T21:31:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6679ffb700 1 -- 172.21.15.63:0/1565335247 >> v2:172.21.15.155:3300/0 conn(0x7f667c09e360 msgr2=0x7f667c065100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6679ffb700 1 --2- 172.21.15.63:0/1565335247 >> v2:172.21.15.155:3300/0 conn(0x7f667c09e360 0x7f667c065100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6679ffb700 1 -- 172.21.15.63:0/1565335247 >> v1:172.21.15.155:6789/0 conn(0x7f667c0b5860 legacy=0x7f667c154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:59.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6679ffb700 1 -- 172.21.15.63:0/1565335247 >> v1:172.21.15.63:6789/0 conn(0x7f667c09c9f0 legacy=0x7f667c0643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:59.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6679ffb700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f665c004a80 0x7f665c004e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:59.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6679ffb700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f665c005310 0x7f665c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:59.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6679ffb700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f665c004000 0x7f665c004480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:59.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6679ffb700 1 -- 172.21.15.63:0/1565335247 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c1542f0 con 0x7f665c005310 2020-05-18T21:31:59.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6679ffb700 1 -- 172.21.15.63:0/1565335247 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c00b920 con 0x7f665c004a80 2020-05-18T21:31:59.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6679ffb700 1 -- 172.21.15.63:0/1565335247 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665c00bae0 con 0x7f665c004000 2020-05-18T21:31:59.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f667bfff700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f665c005310 0x7f665c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:59.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6680b01700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f665c004a80 0x7f665c004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:59.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6681302700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f665c004000 0x7f665c004480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:59.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f667bfff700 1 -- 172.21.15.63:0/1565335247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f665c004000 msgr2=0x7f665c004480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:59.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f667bfff700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f665c004000 0x7f665c004480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:59.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f667bfff700 1 -- 172.21.15.63:0/1565335247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f665c004a80 msgr2=0x7f665c004e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:59.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f667bfff700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f665c004a80 0x7f665c004e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:59.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f667bfff700 1 -- 172.21.15.63:0/1565335247 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c0658f0 con 0x7f665c005310 2020-05-18T21:31:59.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6681302700 1 -- 172.21.15.63:0/1565335247 reap_dead start 2020-05-18T21:31:59.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6681b03700 1 -- 172.21.15.63:0/1565335247 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667c156db0 con 0x7f665c005310 2020-05-18T21:31:59.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f667bfff700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f665c005310 0x7f665c003a00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6670001110 tx=0x7f6670010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6681b03700 1 -- 172.21.15.63:0/1565335247 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667c157060 con 0x7f665c005310 2020-05-18T21:31:59.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f667bfff700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f665c005310 0x7f665c003a00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6670001110 tx=0x7f6670010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f667bfff700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f665c005310 0x7f665c003a00 secure :-1 s=READY pgs=1114 cs=0 l=1 rx=0x7f6670001110 tx=0x7f6670010db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:59.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f667bfff700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f665c005310 0x7f665c003a00 secure :-1 s=THROTTLE_DONE pgs=1114 cs=0 l=1 rx=0x7f6670001110 tx=0x7f6670010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6679ffb700 1 -- 172.21.15.63:0/1565335247 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f667000c670 con 0x7f665c005310 2020-05-18T21:31:59.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f667bfff700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f665c005310 0x7f665c003a00 secure :-1 s=THROTTLE_DONE pgs=1114 cs=0 l=1 rx=0x7f6670001110 tx=0x7f6670010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f667bfff700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f665c005310 0x7f665c003a00 secure :-1 s=THROTTLE_DONE pgs=1114 cs=0 l=1 rx=0x7f6670001110 tx=0x7f6670010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6679ffb700 1 -- 172.21.15.63:0/1565335247 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667000c7d0 con 0x7f665c005310 2020-05-18T21:31:59.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6679ffb700 1 -- 172.21.15.63:0/1565335247 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f667000cbb0 con 0x7f665c005310 2020-05-18T21:31:59.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f667bfff700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f665c005310 0x7f665c003a00 secure :-1 s=THROTTLE_DONE pgs=1114 cs=0 l=1 rx=0x7f6670001110 tx=0x7f6670010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.809+0000 7f6681b03700 1 -- 172.21.15.63:0/1565335247 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6658003380 con 0x7f665c005310 2020-05-18T21:31:59.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.813+0000 7f6679ffb700 1 -- 172.21.15.63:0/1565335247 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f667000cd10 con 0x7f665c005310 2020-05-18T21:31:59.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.813+0000 7f667bfff700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f665c005310 0x7f665c003a00 secure :-1 s=THROTTLE_DONE pgs=1114 cs=0 l=1 rx=0x7f6670001110 tx=0x7f6670010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.813+0000 7f6679ffb700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f665c0538a0 0x7f665c055d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:31:59.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.813+0000 7f6679ffb700 1 -- 172.21.15.63:0/1565335247 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f6670063c90 con 0x7f665c005310 2020-05-18T21:31:59.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.813+0000 7f6680b01700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f665c0538a0 0x7f665c055d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:31:59.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.813+0000 7f6680b01700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f665c0538a0 0x7f665c055d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6674007e00 tx=0x7f66740021f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.813+0000 7f6680b01700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f665c0538a0 0x7f665c055d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6674007e00 tx=0x7f66740021f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.813+0000 7f6680b01700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f665c0538a0 0x7f665c055d60 secure :-1 s=READY pgs=439 cs=0 l=1 rx=0x7f6674007e00 tx=0x7f66740021f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:31:59.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.821+0000 7f667bfff700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f665c005310 0x7f665c003a00 secure :-1 s=THROTTLE_DONE pgs=1114 cs=0 l=1 rx=0x7f6670001110 tx=0x7f6670010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.821+0000 7f6679ffb700 1 -- 172.21.15.63:0/1565335247 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6670067e60 con 0x7f665c005310 2020-05-18T21:31:59.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.969+0000 7f6681b03700 1 -- 172.21.15.63:0/1565335247 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6658003720 con 0x7f665c005310 2020-05-18T21:31:59.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.973+0000 7f667bfff700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f665c005310 0x7f665c003a00 secure :-1 s=THROTTLE_DONE pgs=1114 cs=0 l=1 rx=0x7f6670001110 tx=0x7f6670010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:31:59.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.973+0000 7f6679ffb700 1 -- 172.21.15.63:0/1565335247 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+1431 (secure 0 0 0) 0x7f667003e140 con 0x7f665c005310 2020-05-18T21:31:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:31:59.978 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:31:59.657403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:31:59.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.973+0000 7f6681b03700 1 -- 172.21.15.63:0/1565335247 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f665c0538a0 msgr2=0x7f665c055d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:59.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.973+0000 7f6681b03700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f665c0538a0 0x7f665c055d60 secure :-1 s=READY pgs=439 cs=0 l=1 rx=0x7f6674007e00 tx=0x7f66740021f0).stop 2020-05-18T21:31:59.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.973+0000 7f6681b03700 1 -- 172.21.15.63:0/1565335247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f665c005310 msgr2=0x7f665c003a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:31:59.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.973+0000 7f6681b03700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f665c005310 0x7f665c003a00 secure :-1 s=READY pgs=1114 cs=0 l=1 rx=0x7f6670001110 tx=0x7f6670010db0).stop 2020-05-18T21:31:59.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.973+0000 7f6681b03700 1 -- 172.21.15.63:0/1565335247 shutdown_connections 2020-05-18T21:31:59.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.973+0000 7f6681b03700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f665c0538a0 0x7f665c055d60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:59.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.973+0000 7f6681b03700 1 --2- 172.21.15.63:0/1565335247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f665c005310 0x7f665c003a00 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:31:59.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.973+0000 7f6681b03700 1 -- 172.21.15.63:0/1565335247 >> 172.21.15.63:0/1565335247 conn(0x7f667c05a7c0 msgr2=0x7f667c061a40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:31:59.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.973+0000 7f6681b03700 1 -- 172.21.15.63:0/1565335247 shutdown_connections 2020-05-18T21:31:59.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:31:59.973+0000 7f6681b03700 1 -- 172.21.15.63:0/1565335247 wait complete. 2020-05-18T21:31:59.981 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 58 2020-05-18T21:32:00.192 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:31:59.657403+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {}, 'failed': [0, 1], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:00.193 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/2 2020-05-18T21:32:01.195 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:01.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.433+0000 7fba3e8ed700 1 Processor -- start 2020-05-18T21:32:01.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.433+0000 7fba3e8ed700 1 -- start start 2020-05-18T21:32:01.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.433+0000 7fba3e8ed700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba3805f110 0x7fba380b2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:01.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.433+0000 7fba3e8ed700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fba38145d50 0x7fba38146200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:01.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.433+0000 7fba3e8ed700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba380b8650 con 0x7fba380b81b0 2020-05-18T21:32:01.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.433+0000 7fba3e8ed700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba380b88f0 con 0x7fba38145d50 2020-05-18T21:32:01.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.433+0000 7fba3e8ed700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba380b8b90 con 0x7fba3805f110 2020-05-18T21:32:01.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.433+0000 7fba3d8eb700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba3805f110 0x7fba380b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:01.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.433+0000 7fba3e0ec700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fba38145d50 0x7fba38146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:01.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.433+0000 7fba3e0ec700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fba38145d50 0x7fba38146200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:45290/0 (socket says 172.21.15.63:45290) 2020-05-18T21:32:01.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.433+0000 7fba3e0ec700 1 -- 172.21.15.63:0/3636714155 learned_addr learned my addr 172.21.15.63:0/3636714155 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:01.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.433+0000 7fba3d0ea700 1 --1- 172.21.15.63:0/3636714155 >> v1:172.21.15.155:6789/0 conn(0x7fba380b81b0 0x7fba3812ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:59174/0 (socket says 172.21.15.63:59174) 2020-05-18T21:32:01.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.433+0000 7fba3c8e9700 1 -- 172.21.15.63:0/3636714155 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498444362 0 0) 0x7fba380b8650 con 0x7fba380b81b0 2020-05-18T21:32:01.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.433+0000 7fba3c8e9700 1 -- 172.21.15.63:0/3636714155 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba20003270 con 0x7fba380b81b0 2020-05-18T21:32:01.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3e0ec700 1 -- 172.21.15.63:0/3636714155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba3805f110 msgr2=0x7fba380b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:01.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3e0ec700 1 --2- 172.21.15.63:0/3636714155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba3805f110 0x7fba380b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:01.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3e0ec700 1 -- 172.21.15.63:0/3636714155 >> v1:172.21.15.155:6789/0 conn(0x7fba380b81b0 legacy=0x7fba3812ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:01.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3e0ec700 1 -- 172.21.15.63:0/3636714155 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba380b9030 con 0x7fba38145d50 2020-05-18T21:32:01.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3d8eb700 1 --2- 172.21.15.63:0/3636714155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba3805f110 0x7fba380b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:01.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3e0ec700 1 --2- 172.21.15.63:0/3636714155 >> v2:172.21.15.155:3300/0 conn(0x7fba38145d50 0x7fba38146200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fba300032f0 tx=0x7fba30007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:01.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3e0ec700 1 --2- 172.21.15.63:0/3636714155 >> v2:172.21.15.155:3300/0 conn(0x7fba38145d50 0x7fba38146200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fba300032f0 tx=0x7fba30007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:01.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3e0ec700 1 --2- 172.21.15.63:0/3636714155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba38145d50 0x7fba38146200 secure :-1 s=READY pgs=764 cs=0 l=1 rx=0x7fba300032f0 tx=0x7fba30007e00).ready entity=mon.1 client_cookie=85ccac0ee937be20 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:01.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3e0ec700 1 --2- 172.21.15.63:0/3636714155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba38145d50 0x7fba38146200 secure :-1 s=THROTTLE_DONE pgs=764 cs=0 l=1 rx=0x7fba300032f0 tx=0x7fba30007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:01.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3c8e9700 1 -- 172.21.15.63:0/3636714155 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba30011c60 con 0x7fba38145d50 2020-05-18T21:32:01.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3e0ec700 1 --2- 172.21.15.63:0/3636714155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba38145d50 0x7fba38146200 secure :-1 s=THROTTLE_DONE pgs=764 cs=0 l=1 rx=0x7fba300032f0 tx=0x7fba30007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:01.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3c8e9700 1 -- 172.21.15.63:0/3636714155 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba30011dc0 con 0x7fba38145d50 2020-05-18T21:32:01.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3e0ec700 1 --2- 172.21.15.63:0/3636714155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba38145d50 0x7fba38146200 secure :-1 s=THROTTLE_DONE pgs=764 cs=0 l=1 rx=0x7fba300032f0 tx=0x7fba30007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:01.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3c8e9700 1 -- 172.21.15.63:0/3636714155 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba3000a370 con 0x7fba38145d50 2020-05-18T21:32:01.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3e8ed700 1 -- 172.21.15.63:0/3636714155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba38145d50 msgr2=0x7fba38146200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:01.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3e8ed700 1 --2- 172.21.15.63:0/3636714155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba38145d50 0x7fba38146200 secure :-1 s=READY pgs=764 cs=0 l=1 rx=0x7fba300032f0 tx=0x7fba30007e00).stop 2020-05-18T21:32:01.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3e8ed700 1 -- 172.21.15.63:0/3636714155 shutdown_connections 2020-05-18T21:32:01.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3e8ed700 1 --2- 172.21.15.63:0/3636714155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba38145d50 0x7fba38146200 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:01.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3e8ed700 1 --2- 172.21.15.63:0/3636714155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba3805f110 0x7fba380b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:01.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3e8ed700 1 -- 172.21.15.63:0/3636714155 >> 172.21.15.63:0/3636714155 conn(0x7fba38069fc0 msgr2=0x7fba3806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:01.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3e8ed700 1 -- 172.21.15.63:0/3636714155 shutdown_connections 2020-05-18T21:32:01.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.437+0000 7fba3e8ed700 1 -- 172.21.15.63:0/3636714155 wait complete. 2020-05-18T21:32:01.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e8ed700 1 Processor -- start 2020-05-18T21:32:01.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e8ed700 1 -- start start 2020-05-18T21:32:01.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e8ed700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fba38145d50 0x7fba380645b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:01.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e8ed700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba38064b70 con 0x7fba3805f110 2020-05-18T21:32:01.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e8ed700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba38148960 con 0x7fba380b81b0 2020-05-18T21:32:01.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e8ed700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba38062960 con 0x7fba38145d50 2020-05-18T21:32:01.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e0ec700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fba38145d50 0x7fba380645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:01.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3d8eb700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fba3805f110 0x7fba38148b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60864/0 (socket says 172.21.15.63:60864) 2020-05-18T21:32:01.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e0ec700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fba38145d50 0x7fba380645b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58680/0 (socket says 172.21.15.63:58680) 2020-05-18T21:32:01.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3d8eb700 1 -- 172.21.15.63:0/3860298828 learned_addr learned my addr 172.21.15.63:0/3860298828 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:01.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e0ec700 1 -- 172.21.15.63:0/3860298828 >> v1:172.21.15.155:6789/0 conn(0x7fba380b81b0 legacy=0x7fba381474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:01.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba26ffd700 1 -- 172.21.15.63:0/3860298828 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955767501 0 0) 0x7fba38064b70 con 0x7fba3805f110 2020-05-18T21:32:01.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e0ec700 1 -- 172.21.15.63:0/3860298828 >> v1:172.21.15.63:6789/0 conn(0x7fba3805f110 legacy=0x7fba38148b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:01.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e0ec700 1 -- 172.21.15.63:0/3860298828 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba38062c00 con 0x7fba38145d50 2020-05-18T21:32:01.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e0ec700 1 --2- 172.21.15.63:0/3860298828 >> v2:172.21.15.63:3300/0 conn(0x7fba38145d50 0x7fba380645b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fba34000ed0 tx=0x7fba30007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:01.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e0ec700 1 --2- 172.21.15.63:0/3860298828 >> v2:172.21.15.63:3300/0 conn(0x7fba38145d50 0x7fba380645b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fba34000ed0 tx=0x7fba30007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:01.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e0ec700 1 --2- 172.21.15.63:0/3860298828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba38145d50 0x7fba380645b0 secure :-1 s=READY pgs=1116 cs=0 l=1 rx=0x7fba34000ed0 tx=0x7fba30007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:01.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e0ec700 1 --2- 172.21.15.63:0/3860298828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba38145d50 0x7fba380645b0 secure :-1 s=THROTTLE_DONE pgs=1116 cs=0 l=1 rx=0x7fba34000ed0 tx=0x7fba30007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:01.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba26ffd700 1 -- 172.21.15.63:0/3860298828 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba30005a80 con 0x7fba38145d50 2020-05-18T21:32:01.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e0ec700 1 --2- 172.21.15.63:0/3860298828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba38145d50 0x7fba380645b0 secure :-1 s=THROTTLE_DONE pgs=1116 cs=0 l=1 rx=0x7fba34000ed0 tx=0x7fba30007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:01.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba26ffd700 1 -- 172.21.15.63:0/3860298828 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba30005be0 con 0x7fba38145d50 2020-05-18T21:32:01.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e8ed700 1 -- 172.21.15.63:0/3860298828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba38149270 con 0x7fba38145d50 2020-05-18T21:32:01.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e0ec700 1 --2- 172.21.15.63:0/3860298828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba38145d50 0x7fba380645b0 secure :-1 s=THROTTLE_DONE pgs=1116 cs=0 l=1 rx=0x7fba34000ed0 tx=0x7fba30007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:01.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba26ffd700 1 -- 172.21.15.63:0/3860298828 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba30007170 con 0x7fba38145d50 2020-05-18T21:32:01.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e8ed700 1 -- 172.21.15.63:0/3860298828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba38147d90 con 0x7fba38145d50 2020-05-18T21:32:01.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.441+0000 7fba3e0ec700 1 --2- 172.21.15.63:0/3860298828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba38145d50 0x7fba380645b0 secure :-1 s=THROTTLE_DONE pgs=1116 cs=0 l=1 rx=0x7fba34000ed0 tx=0x7fba30007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:01.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.445+0000 7fba26ffd700 1 -- 172.21.15.63:0/3860298828 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fba30008460 con 0x7fba38145d50 2020-05-18T21:32:01.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.445+0000 7fba3e0ec700 1 --2- 172.21.15.63:0/3860298828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba38145d50 0x7fba380645b0 secure :-1 s=THROTTLE_DONE pgs=1116 cs=0 l=1 rx=0x7fba34000ed0 tx=0x7fba30007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:01.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.445+0000 7fba3e8ed700 1 -- 172.21.15.63:0/3860298828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba380569e0 con 0x7fba38145d50 2020-05-18T21:32:01.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.445+0000 7fba26ffd700 1 --2- 172.21.15.63:0/3860298828 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fba1804f910 0x7fba18051dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:01.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.445+0000 7fba26ffd700 1 -- 172.21.15.63:0/3860298828 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fba30064470 con 0x7fba38145d50 2020-05-18T21:32:01.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.445+0000 7fba3d8eb700 1 --2- 172.21.15.63:0/3860298828 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fba1804f910 0x7fba18051dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:01.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.445+0000 7fba3d8eb700 1 --2- 172.21.15.63:0/3860298828 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fba1804f910 0x7fba18051dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fba28007ac0 tx=0x7fba28009450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:01.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.445+0000 7fba3d8eb700 1 --2- 172.21.15.63:0/3860298828 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fba1804f910 0x7fba18051dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fba28007ac0 tx=0x7fba28009450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:01.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.445+0000 7fba3d8eb700 1 --2- 172.21.15.63:0/3860298828 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fba1804f910 0x7fba18051dd0 secure :-1 s=READY pgs=440 cs=0 l=1 rx=0x7fba28007ac0 tx=0x7fba28009450).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:01.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.449+0000 7fba3e0ec700 1 --2- 172.21.15.63:0/3860298828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba38145d50 0x7fba380645b0 secure :-1 s=THROTTLE_DONE pgs=1116 cs=0 l=1 rx=0x7fba34000ed0 tx=0x7fba30007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:01.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.449+0000 7fba26ffd700 1 -- 172.21.15.63:0/3860298828 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fba3003e920 con 0x7fba38145d50 2020-05-18T21:32:01.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.597+0000 7fba3e8ed700 1 -- 172.21.15.63:0/3860298828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba3814a1a0 con 0x7fba38145d50 2020-05-18T21:32:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.597+0000 7fba3e0ec700 1 --2- 172.21.15.63:0/3860298828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba38145d50 0x7fba380645b0 secure :-1 s=THROTTLE_DONE pgs=1116 cs=0 l=1 rx=0x7fba34000ed0 tx=0x7fba30007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.597+0000 7fba26ffd700 1 -- 172.21.15.63:0/3860298828 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+1431 (secure 0 0 0) 0x7fba30041f40 con 0x7fba38145d50 2020-05-18T21:32:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.601+0000 7fba3e8ed700 1 -- 172.21.15.63:0/3860298828 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fba1804f910 msgr2=0x7fba18051dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.601+0000 7fba3e8ed700 1 --2- 172.21.15.63:0/3860298828 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fba1804f910 0x7fba18051dd0 secure :-1 s=READY pgs=440 cs=0 l=1 rx=0x7fba28007ac0 tx=0x7fba28009450).stop 2020-05-18T21:32:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.601+0000 7fba3e8ed700 1 -- 172.21.15.63:0/3860298828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba38145d50 msgr2=0x7fba380645b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.601+0000 7fba3e8ed700 1 --2- 172.21.15.63:0/3860298828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba38145d50 0x7fba380645b0 secure :-1 s=READY pgs=1116 cs=0 l=1 rx=0x7fba34000ed0 tx=0x7fba30007e00).stop 2020-05-18T21:32:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.601+0000 7fba3e8ed700 1 -- 172.21.15.63:0/3860298828 shutdown_connections 2020-05-18T21:32:01.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.601+0000 7fba3e8ed700 1 --2- 172.21.15.63:0/3860298828 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fba1804f910 0x7fba18051dd0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:01.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.601+0000 7fba3e8ed700 1 --2- 172.21.15.63:0/3860298828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba38145d50 0x7fba380645b0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:01.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.601+0000 7fba3e8ed700 1 -- 172.21.15.63:0/3860298828 >> 172.21.15.63:0/3860298828 conn(0x7fba38069fc0 msgr2=0x7fba380b6170 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:01.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.601+0000 7fba3e8ed700 1 -- 172.21.15.63:0/3860298828 shutdown_connections 2020-05-18T21:32:01.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:01.601+0000 7fba3e8ed700 1 -- 172.21.15.63:0/3860298828 wait complete. 2020-05-18T21:32:01.612 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 58 2020-05-18T21:32:01.612 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:01.612 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:31:59.657403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:01.818 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:31:59.657403+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {}, 'failed': [0, 1], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:01.818 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/2 2020-05-18T21:32:02.820 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:02.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.929+0000 7f8ce658b700 1 Processor -- start 2020-05-18T21:32:02.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.929+0000 7f8ce658b700 1 -- start start 2020-05-18T21:32:02.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.929+0000 7f8ce658b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ce0060b90 0x7f8ce0147e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:02.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.929+0000 7f8ce658b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8ce012a0e0 0x7f8ce00650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:02.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.929+0000 7f8ce658b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce0144240 con 0x7f8ce0143da0 2020-05-18T21:32:02.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.929+0000 7f8ce658b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce01444e0 con 0x7f8ce012a0e0 2020-05-18T21:32:02.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.929+0000 7f8ce658b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce0144780 con 0x7f8ce0060b90 2020-05-18T21:32:02.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce4b28700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8ce012a0e0 0x7f8ce00650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:02.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8cdf7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8ce0143da0 0x7f8ce01299d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60872/0 (socket says 172.21.15.63:60872) 2020-05-18T21:32:02.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8cdf7fe700 1 -- 172.21.15.63:0/546439359 learned_addr learned my addr 172.21.15.63:0/546439359 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:02.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8cdffff700 1 --2- 172.21.15.63:0/546439359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ce0060b90 0x7f8ce0147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:02.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce4b28700 1 -- 172.21.15.63:0/546439359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ce0060b90 msgr2=0x7f8ce0147e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:02.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce4b28700 1 --2- 172.21.15.63:0/546439359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ce0060b90 0x7f8ce0147e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:02.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce4b28700 1 -- 172.21.15.63:0/546439359 >> v1:172.21.15.63:6789/0 conn(0x7f8ce0143da0 legacy=0x7f8ce01299d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:02.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce4b28700 1 -- 172.21.15.63:0/546439359 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce0144c20 con 0x7f8ce012a0e0 2020-05-18T21:32:02.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8cdeffd700 1 -- 172.21.15.63:0/546439359 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249824544 0 0) 0x7f8ce0144240 con 0x7f8ce0143da0 2020-05-18T21:32:02.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce4b28700 1 --2- 172.21.15.63:0/546439359 >> v2:172.21.15.63:3300/0 conn(0x7f8ce012a0e0 0x7f8ce00650c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8cd80032f0 tx=0x7f8cd8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:02.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce4b28700 1 --2- 172.21.15.63:0/546439359 >> v2:172.21.15.63:3300/0 conn(0x7f8ce012a0e0 0x7f8ce00650c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8cd80032f0 tx=0x7f8cd8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:02.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce4b28700 1 --2- 172.21.15.63:0/546439359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ce012a0e0 0x7f8ce00650c0 secure :-1 s=READY pgs=1118 cs=0 l=1 rx=0x7f8cd80032f0 tx=0x7f8cd8007e00).ready entity=mon.0 client_cookie=6fcea0e90e137948 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:02.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce4b28700 1 --2- 172.21.15.63:0/546439359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ce012a0e0 0x7f8ce00650c0 secure :-1 s=THROTTLE_DONE pgs=1118 cs=0 l=1 rx=0x7f8cd80032f0 tx=0x7f8cd8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:02.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8cdeffd700 1 -- 172.21.15.63:0/546439359 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cd800a180 con 0x7f8ce012a0e0 2020-05-18T21:32:02.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce4b28700 1 --2- 172.21.15.63:0/546439359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ce012a0e0 0x7f8ce00650c0 secure :-1 s=THROTTLE_DONE pgs=1118 cs=0 l=1 rx=0x7f8cd80032f0 tx=0x7f8cd8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:02.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8cdeffd700 1 -- 172.21.15.63:0/546439359 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd800a2e0 con 0x7f8ce012a0e0 2020-05-18T21:32:02.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce4b28700 1 --2- 172.21.15.63:0/546439359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ce012a0e0 0x7f8ce00650c0 secure :-1 s=THROTTLE_DONE pgs=1118 cs=0 l=1 rx=0x7f8cd80032f0 tx=0x7f8cd8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:02.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce658b700 1 -- 172.21.15.63:0/546439359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ce012a0e0 msgr2=0x7f8ce00650c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:02.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8cdeffd700 1 -- 172.21.15.63:0/546439359 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cd800a6c0 con 0x7f8ce012a0e0 2020-05-18T21:32:02.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce658b700 1 --2- 172.21.15.63:0/546439359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ce012a0e0 0x7f8ce00650c0 secure :-1 s=READY pgs=1118 cs=0 l=1 rx=0x7f8cd80032f0 tx=0x7f8cd8007e00).stop 2020-05-18T21:32:02.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce658b700 1 -- 172.21.15.63:0/546439359 shutdown_connections 2020-05-18T21:32:02.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce658b700 1 --2- 172.21.15.63:0/546439359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ce012a0e0 0x7f8ce00650c0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:02.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce658b700 1 --2- 172.21.15.63:0/546439359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ce0060b90 0x7f8ce0147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:02.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce658b700 1 -- 172.21.15.63:0/546439359 >> 172.21.15.63:0/546439359 conn(0x7f8ce00b83d0 msgr2=0x7f8ce00b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:02.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce658b700 1 -- 172.21.15.63:0/546439359 shutdown_connections 2020-05-18T21:32:02.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce658b700 1 -- 172.21.15.63:0/546439359 wait complete. 2020-05-18T21:32:02.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce658b700 1 Processor -- start 2020-05-18T21:32:02.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.933+0000 7f8ce658b700 1 -- start start 2020-05-18T21:32:02.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8ce658b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8ce0060b90 0x7f8ce012c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:02.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8ce658b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce01520e0 con 0x7f8ce0143da0 2020-05-18T21:32:02.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8ce658b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce00ad400 con 0x7f8ce012a0e0 2020-05-18T21:32:02.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8ce658b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce012c9e0 con 0x7f8ce0060b90 2020-05-18T21:32:02.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8ce4b28700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8ce0143da0 0x7f8ce0127740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60878/0 (socket says 172.21.15.63:60878) 2020-05-18T21:32:02.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8ce4b28700 1 -- 172.21.15.63:0/2971280926 learned_addr learned my addr 172.21.15.63:0/2971280926 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:02.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdffff700 1 --2- 172.21.15.63:0/2971280926 >> v2:172.21.15.155:3300/0 conn(0x7f8ce0060b90 0x7f8ce012c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:02.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdd7fa700 1 -- 172.21.15.63:0/2971280926 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012579687 0 0) 0x7f8ce01520e0 con 0x7f8ce0143da0 2020-05-18T21:32:02.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdd7fa700 1 -- 172.21.15.63:0/2971280926 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cc4002fe0 con 0x7f8ce0143da0 2020-05-18T21:32:02.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdd7fa700 1 -- 172.21.15.63:0/2971280926 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797012418 0 0) 0x7f8ce00ad400 con 0x7f8ce012a0e0 2020-05-18T21:32:02.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdd7fa700 1 -- 172.21.15.63:0/2971280926 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ce01520e0 con 0x7f8ce012a0e0 2020-05-18T21:32:02.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdd7fa700 1 -- 172.21.15.63:0/2971280926 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1902332566 0 0) 0x7f8cc4002fe0 con 0x7f8ce0143da0 2020-05-18T21:32:02.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdd7fa700 1 -- 172.21.15.63:0/2971280926 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8ce00ad400 con 0x7f8ce0143da0 2020-05-18T21:32:02.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdd7fa700 1 -- 172.21.15.63:0/2971280926 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f8cd80089a0 con 0x7f8ce0143da0 2020-05-18T21:32:02.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdffff700 1 -- 172.21.15.63:0/2971280926 >> v1:172.21.15.155:6789/0 conn(0x7f8ce012a0e0 legacy=0x7f8ce00accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:02.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdffff700 1 -- 172.21.15.63:0/2971280926 >> v1:172.21.15.63:6789/0 conn(0x7f8ce0143da0 legacy=0x7f8ce0127740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:02.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdffff700 1 -- 172.21.15.63:0/2971280926 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce00ad630 con 0x7f8ce0060b90 2020-05-18T21:32:02.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdffff700 1 --2- 172.21.15.63:0/2971280926 >> v2:172.21.15.155:3300/0 conn(0x7f8ce0060b90 0x7f8ce012c560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8cd0002f70 tx=0x7f8cd0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:02.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdffff700 1 --2- 172.21.15.63:0/2971280926 >> v2:172.21.15.155:3300/0 conn(0x7f8ce0060b90 0x7f8ce012c560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8cd0002f70 tx=0x7f8cd0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:02.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdffff700 1 --2- 172.21.15.63:0/2971280926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ce0060b90 0x7f8ce012c560 secure :-1 s=READY pgs=767 cs=0 l=1 rx=0x7f8cd0002f70 tx=0x7f8cd0010bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:02.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdffff700 1 --2- 172.21.15.63:0/2971280926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ce0060b90 0x7f8ce012c560 secure :-1 s=THROTTLE_DONE pgs=767 cs=0 l=1 rx=0x7f8cd0002f70 tx=0x7f8cd0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:02.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdd7fa700 1 -- 172.21.15.63:0/2971280926 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cd0007560 con 0x7f8ce0060b90 2020-05-18T21:32:02.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdffff700 1 --2- 172.21.15.63:0/2971280926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ce0060b90 0x7f8ce012c560 secure :-1 s=THROTTLE_DONE pgs=767 cs=0 l=1 rx=0x7f8cd0002f70 tx=0x7f8cd0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:02.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdffff700 1 --2- 172.21.15.63:0/2971280926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ce0060b90 0x7f8ce012c560 secure :-1 s=THROTTLE_DONE pgs=767 cs=0 l=1 rx=0x7f8cd0002f70 tx=0x7f8cd0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:02.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdd7fa700 1 -- 172.21.15.63:0/2971280926 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd0005930 con 0x7f8ce0060b90 2020-05-18T21:32:02.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8ce658b700 1 -- 172.21.15.63:0/2971280926 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce00ad930 con 0x7f8ce0060b90 2020-05-18T21:32:02.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8cdd7fa700 1 -- 172.21.15.63:0/2971280926 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cd0005c90 con 0x7f8ce0060b90 2020-05-18T21:32:02.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.937+0000 7f8ce658b700 1 -- 172.21.15.63:0/2971280926 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce0127e50 con 0x7f8ce0060b90 2020-05-18T21:32:02.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.941+0000 7f8cdffff700 1 --2- 172.21.15.63:0/2971280926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ce0060b90 0x7f8ce012c560 secure :-1 s=THROTTLE_DONE pgs=767 cs=0 l=1 rx=0x7f8cd0002f70 tx=0x7f8cd0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:02.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.941+0000 7f8ce658b700 1 -- 172.21.15.63:0/2971280926 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce00569e0 con 0x7f8ce0060b90 2020-05-18T21:32:02.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.941+0000 7f8cdd7fa700 1 -- 172.21.15.63:0/2971280926 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8cd000e240 con 0x7f8ce0060b90 2020-05-18T21:32:02.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.941+0000 7f8cdffff700 1 --2- 172.21.15.63:0/2971280926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ce0060b90 0x7f8ce012c560 secure :-1 s=THROTTLE_DONE pgs=767 cs=0 l=1 rx=0x7f8cd0002f70 tx=0x7f8cd0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:02.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.941+0000 7f8cdd7fa700 1 --2- 172.21.15.63:0/2971280926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8cc40501b0 0x7f8cc4052670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:02.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.941+0000 7f8cdd7fa700 1 -- 172.21.15.63:0/2971280926 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f8cd0063960 con 0x7f8ce0060b90 2020-05-18T21:32:02.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.941+0000 7f8cdf7fe700 1 --2- 172.21.15.63:0/2971280926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8cc40501b0 0x7f8cc4052670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:02.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.941+0000 7f8cdf7fe700 1 --2- 172.21.15.63:0/2971280926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8cc40501b0 0x7f8cc4052670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8cc8001070 tx=0x7f8cc8001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:02.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.941+0000 7f8cdf7fe700 1 --2- 172.21.15.63:0/2971280926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8cc40501b0 0x7f8cc4052670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8cc8001070 tx=0x7f8cc8001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:02.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.941+0000 7f8cdf7fe700 1 --2- 172.21.15.63:0/2971280926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8cc40501b0 0x7f8cc4052670 secure :-1 s=READY pgs=441 cs=0 l=1 rx=0x7f8cc8001070 tx=0x7f8cc8001710).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:02.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.949+0000 7f8cdffff700 1 --2- 172.21.15.63:0/2971280926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ce0060b90 0x7f8ce012c560 secure :-1 s=THROTTLE_DONE pgs=767 cs=0 l=1 rx=0x7f8cd0002f70 tx=0x7f8cd0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:02.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:02.949+0000 7f8cdd7fa700 1 -- 172.21.15.63:0/2971280926 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f8cd003dcf0 con 0x7f8ce0060b90 2020-05-18T21:32:03.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:03.097+0000 7f8ce658b700 1 -- 172.21.15.63:0/2971280926 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ce0143b80 con 0x7f8ce0060b90 2020-05-18T21:32:03.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:03.101+0000 7f8cdffff700 1 --2- 172.21.15.63:0/2971280926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ce0060b90 0x7f8ce012c560 secure :-1 s=THROTTLE_DONE pgs=767 cs=0 l=1 rx=0x7f8cd0002f70 tx=0x7f8cd0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:03.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:03.101+0000 7f8cdd7fa700 1 -- 172.21.15.63:0/2971280926 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+1431 (secure 0 0 0) 0x7f8cd0041310 con 0x7f8ce0060b90 2020-05-18T21:32:03.105 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:03.105 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:31:59.657403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:03.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:03.101+0000 7f8ce658b700 1 -- 172.21.15.63:0/2971280926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8cc40501b0 msgr2=0x7f8cc4052670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:03.101+0000 7f8ce658b700 1 --2- 172.21.15.63:0/2971280926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8cc40501b0 0x7f8cc4052670 secure :-1 s=READY pgs=441 cs=0 l=1 rx=0x7f8cc8001070 tx=0x7f8cc8001710).stop 2020-05-18T21:32:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:03.101+0000 7f8ce658b700 1 -- 172.21.15.63:0/2971280926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ce0060b90 msgr2=0x7f8ce012c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:03.101+0000 7f8ce658b700 1 --2- 172.21.15.63:0/2971280926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ce0060b90 0x7f8ce012c560 secure :-1 s=READY pgs=767 cs=0 l=1 rx=0x7f8cd0002f70 tx=0x7f8cd0010bb0).stop 2020-05-18T21:32:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:03.105+0000 7f8ce658b700 1 -- 172.21.15.63:0/2971280926 shutdown_connections 2020-05-18T21:32:03.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:03.105+0000 7f8ce658b700 1 --2- 172.21.15.63:0/2971280926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8cc40501b0 0x7f8cc4052670 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:03.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:03.105+0000 7f8ce658b700 1 --2- 172.21.15.63:0/2971280926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ce0060b90 0x7f8ce012c560 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:03.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:03.105+0000 7f8ce658b700 1 -- 172.21.15.63:0/2971280926 >> 172.21.15.63:0/2971280926 conn(0x7f8ce00b83d0 msgr2=0x7f8ce0069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:03.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:03.105+0000 7f8ce658b700 1 -- 172.21.15.63:0/2971280926 shutdown_connections 2020-05-18T21:32:03.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:03.105+0000 7f8ce658b700 1 -- 172.21.15.63:0/2971280926 wait complete. 2020-05-18T21:32:03.110 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 58 2020-05-18T21:32:03.325 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:31:59.657403+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {}, 'failed': [0, 1], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:03.325 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/2 2020-05-18T21:32:04.327 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:04.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.433+0000 7f8d3ec40700 1 Processor -- start 2020-05-18T21:32:04.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.433+0000 7f8d3ec40700 1 -- start start 2020-05-18T21:32:04.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d3ec40700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38060b90 0x7f8d38145f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:04.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d3ec40700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8d38061670 0x7f8d38149770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d3ec40700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d38149bd0 0x7f8d3814a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d3ec40700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d380b2d70 con 0x7f8d38061670 2020-05-18T21:32:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d3ec40700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d38146e60 con 0x7f8d38149bd0 2020-05-18T21:32:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d3ec40700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d38146480 con 0x7f8d38060b90 2020-05-18T21:32:04.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d37fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8d38061670 0x7f8d38149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:04.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d37fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8d38061670 0x7f8d38149770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58698/0 (socket says 172.21.15.63:58698) 2020-05-18T21:32:04.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d37fff700 1 -- 172.21.15.63:0/2486107259 learned_addr learned my addr 172.21.15.63:0/2486107259 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:04.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d3d1dd700 1 --2- 172.21.15.63:0/2486107259 >> v2:172.21.15.155:3300/0 conn(0x7f8d38149bd0 0x7f8d3814a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:04.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d3c9dc700 1 --2- 172.21.15.63:0/2486107259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38060b90 0x7f8d38145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:04.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d37fff700 1 -- 172.21.15.63:0/2486107259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38060b90 msgr2=0x7f8d38145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:04.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d37fff700 1 --2- 172.21.15.63:0/2486107259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38060b90 0x7f8d38145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:04.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d37fff700 1 -- 172.21.15.63:0/2486107259 >> v2:172.21.15.155:3300/0 conn(0x7f8d38149bd0 msgr2=0x7f8d3814a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:04.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d37fff700 1 --2- 172.21.15.63:0/2486107259 >> v2:172.21.15.155:3300/0 conn(0x7f8d38149bd0 0x7f8d3814a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:04.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d37fff700 1 -- 172.21.15.63:0/2486107259 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d38146720 con 0x7f8d38061670 2020-05-18T21:32:04.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d37fff700 1 --2- 172.21.15.63:0/2486107259 >> v2:172.21.15.63:3300/0 conn(0x7f8d38061670 0x7f8d38149770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8d20002f70 tx=0x7f8d20007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:04.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d37fff700 1 --2- 172.21.15.63:0/2486107259 >> v2:172.21.15.63:3300/0 conn(0x7f8d38061670 0x7f8d38149770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8d20002f70 tx=0x7f8d20007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:04.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d37fff700 1 --2- 172.21.15.63:0/2486107259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d38061670 0x7f8d38149770 secure :-1 s=READY pgs=1120 cs=0 l=1 rx=0x7f8d20002f70 tx=0x7f8d20007a80).ready entity=mon.0 client_cookie=8c467d5b9e886a61 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:04.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d37fff700 1 --2- 172.21.15.63:0/2486107259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d38061670 0x7f8d38149770 secure :-1 s=THROTTLE_DONE pgs=1120 cs=0 l=1 rx=0x7f8d20002f70 tx=0x7f8d20007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:04.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d377fe700 1 -- 172.21.15.63:0/2486107259 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d20011600 con 0x7f8d38061670 2020-05-18T21:32:04.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d37fff700 1 --2- 172.21.15.63:0/2486107259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d38061670 0x7f8d38149770 secure :-1 s=THROTTLE_DONE pgs=1120 cs=0 l=1 rx=0x7f8d20002f70 tx=0x7f8d20007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:04.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d37fff700 1 --2- 172.21.15.63:0/2486107259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d38061670 0x7f8d38149770 secure :-1 s=THROTTLE_DONE pgs=1120 cs=0 l=1 rx=0x7f8d20002f70 tx=0x7f8d20007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:04.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d377fe700 1 -- 172.21.15.63:0/2486107259 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d20011760 con 0x7f8d38061670 2020-05-18T21:32:04.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d377fe700 1 -- 172.21.15.63:0/2486107259 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d20011b80 con 0x7f8d38061670 2020-05-18T21:32:04.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d3ec40700 1 -- 172.21.15.63:0/2486107259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d38061670 msgr2=0x7f8d38149770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:04.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d3ec40700 1 --2- 172.21.15.63:0/2486107259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d38061670 0x7f8d38149770 secure :-1 s=READY pgs=1120 cs=0 l=1 rx=0x7f8d20002f70 tx=0x7f8d20007a80).stop 2020-05-18T21:32:04.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d3ec40700 1 -- 172.21.15.63:0/2486107259 shutdown_connections 2020-05-18T21:32:04.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d3ec40700 1 --2- 172.21.15.63:0/2486107259 >> v2:172.21.15.155:3300/0 conn(0x7f8d38149bd0 0x7f8d3814a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:04.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d3ec40700 1 --2- 172.21.15.63:0/2486107259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d38061670 0x7f8d38149770 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:04.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d3ec40700 1 --2- 172.21.15.63:0/2486107259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38060b90 0x7f8d38145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:04.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d3ec40700 1 -- 172.21.15.63:0/2486107259 >> 172.21.15.63:0/2486107259 conn(0x7f8d380b83d0 msgr2=0x7f8d380b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:04.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d3ec40700 1 -- 172.21.15.63:0/2486107259 shutdown_connections 2020-05-18T21:32:04.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.437+0000 7f8d3ec40700 1 -- 172.21.15.63:0/2486107259 wait complete. 2020-05-18T21:32:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.441+0000 7f8d3ec40700 1 Processor -- start 2020-05-18T21:32:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.441+0000 7f8d3ec40700 1 -- start start 2020-05-18T21:32:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.441+0000 7f8d3ec40700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38149bd0 0x7f8d38144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.441+0000 7f8d3ec40700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d38144230 con 0x7f8d38060b90 2020-05-18T21:32:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.441+0000 7f8d3ec40700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d381444d0 con 0x7f8d38061670 2020-05-18T21:32:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.441+0000 7f8d3ec40700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d38143f20 con 0x7f8d38149bd0 2020-05-18T21:32:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.441+0000 7f8d3c9dc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8d38060b90 0x7f8d38140950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60892/0 (socket says 172.21.15.63:60892) 2020-05-18T21:32:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.441+0000 7f8d3c9dc700 1 -- 172.21.15.63:0/2343262969 learned_addr learned my addr 172.21.15.63:0/2343262969 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.441+0000 7f8d3d1dd700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38149bd0 0x7f8d38144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.441+0000 7f8d35ffb700 1 -- 172.21.15.63:0/2343262969 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128716819 0 0) 0x7f8d38144230 con 0x7f8d38060b90 2020-05-18T21:32:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.441+0000 7f8d35ffb700 1 -- 172.21.15.63:0/2343262969 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d1c002fe0 con 0x7f8d38060b90 2020-05-18T21:32:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.441+0000 7f8d35ffb700 1 -- 172.21.15.63:0/2343262969 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790325504 0 0) 0x7f8d381444d0 con 0x7f8d38061670 2020-05-18T21:32:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.441+0000 7f8d35ffb700 1 -- 172.21.15.63:0/2343262969 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d38144230 con 0x7f8d38061670 2020-05-18T21:32:04.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.441+0000 7f8d35ffb700 1 -- 172.21.15.63:0/2343262969 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2369754110 0 0) 0x7f8d1c002fe0 con 0x7f8d38060b90 2020-05-18T21:32:04.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.441+0000 7f8d35ffb700 1 -- 172.21.15.63:0/2343262969 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8d381444d0 con 0x7f8d38060b90 2020-05-18T21:32:04.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.441+0000 7f8d35ffb700 1 -- 172.21.15.63:0/2343262969 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f8d280014d0 con 0x7f8d38060b90 2020-05-18T21:32:04.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.441+0000 7f8d3d1dd700 1 -- 172.21.15.63:0/2343262969 >> v1:172.21.15.155:6789/0 conn(0x7f8d38061670 legacy=0x7f8d38142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:04.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.441+0000 7f8d3d1dd700 1 -- 172.21.15.63:0/2343262969 >> v1:172.21.15.63:6789/0 conn(0x7f8d38060b90 legacy=0x7f8d38140950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:04.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.445+0000 7f8d3d1dd700 1 -- 172.21.15.63:0/2343262969 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d38141060 con 0x7f8d38149bd0 2020-05-18T21:32:04.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.445+0000 7f8d3d1dd700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38149bd0 0x7f8d38144c10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d300032f0 tx=0x7f8d30010f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:04.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.445+0000 7f8d3d1dd700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38149bd0 0x7f8d38144c10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d300032f0 tx=0x7f8d30010f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:04.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.445+0000 7f8d3d1dd700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38149bd0 0x7f8d38144c10 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f8d300032f0 tx=0x7f8d30010f50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:04.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.445+0000 7f8d3d1dd700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38149bd0 0x7f8d38144c10 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f8d300032f0 tx=0x7f8d30010f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:04.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.445+0000 7f8d35ffb700 1 -- 172.21.15.63:0/2343262969 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d30012ab0 con 0x7f8d38149bd0 2020-05-18T21:32:04.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.445+0000 7f8d3d1dd700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38149bd0 0x7f8d38144c10 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f8d300032f0 tx=0x7f8d30010f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:04.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.445+0000 7f8d3d1dd700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38149bd0 0x7f8d38144c10 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f8d300032f0 tx=0x7f8d30010f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:04.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.445+0000 7f8d35ffb700 1 -- 172.21.15.63:0/2343262969 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d30012c10 con 0x7f8d38149bd0 2020-05-18T21:32:04.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.445+0000 7f8d3ec40700 1 -- 172.21.15.63:0/2343262969 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d38141460 con 0x7f8d38149bd0 2020-05-18T21:32:04.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.445+0000 7f8d35ffb700 1 -- 172.21.15.63:0/2343262969 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d3000a180 con 0x7f8d38149bd0 2020-05-18T21:32:04.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.445+0000 7f8d3ec40700 1 -- 172.21.15.63:0/2343262969 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d38064200 con 0x7f8d38149bd0 2020-05-18T21:32:04.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.445+0000 7f8d3d1dd700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38149bd0 0x7f8d38144c10 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f8d300032f0 tx=0x7f8d30010f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:04.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.445+0000 7f8d3ec40700 1 -- 172.21.15.63:0/2343262969 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d38144060 con 0x7f8d38149bd0 2020-05-18T21:32:04.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.445+0000 7f8d35ffb700 1 -- 172.21.15.63:0/2343262969 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8d3000a3f0 con 0x7f8d38149bd0 2020-05-18T21:32:04.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.445+0000 7f8d3d1dd700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38149bd0 0x7f8d38144c10 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f8d300032f0 tx=0x7f8d30010f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:04.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.445+0000 7f8d35ffb700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d1c050130 0x7f8d1c0525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:04.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.449+0000 7f8d35ffb700 1 -- 172.21.15.63:0/2343262969 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f8d30064100 con 0x7f8d38149bd0 2020-05-18T21:32:04.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.449+0000 7f8d3c9dc700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d1c050130 0x7f8d1c0525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:04.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.449+0000 7f8d3c9dc700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d1c050130 0x7f8d1c0525f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d28007b10 tx=0x7f8d280018a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:04.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.449+0000 7f8d3c9dc700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d1c050130 0x7f8d1c0525f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d28007b10 tx=0x7f8d280018a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:04.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.449+0000 7f8d3c9dc700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d1c050130 0x7f8d1c0525f0 secure :-1 s=READY pgs=442 cs=0 l=1 rx=0x7f8d28007b10 tx=0x7f8d280018a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:04.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.457+0000 7f8d3d1dd700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38149bd0 0x7f8d38144c10 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f8d300032f0 tx=0x7f8d30010f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:04.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.457+0000 7f8d35ffb700 1 -- 172.21.15.63:0/2343262969 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f8d3003e430 con 0x7f8d38149bd0 2020-05-18T21:32:04.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.605+0000 7f8d3ec40700 1 -- 172.21.15.63:0/2343262969 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d380569e0 con 0x7f8d38149bd0 2020-05-18T21:32:04.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.609+0000 7f8d3d1dd700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38149bd0 0x7f8d38144c10 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f8d300032f0 tx=0x7f8d30010f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:04.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.609+0000 7f8d35ffb700 1 -- 172.21.15.63:0/2343262969 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+1431 (secure 0 0 0) 0x7f8d30041a50 con 0x7f8d38149bd0 2020-05-18T21:32:04.612 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:04.613 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:31:59.657403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:04.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.609+0000 7f8d3ec40700 1 -- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d1c050130 msgr2=0x7f8d1c0525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:04.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.609+0000 7f8d3ec40700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d1c050130 0x7f8d1c0525f0 secure :-1 s=READY pgs=442 cs=0 l=1 rx=0x7f8d28007b10 tx=0x7f8d280018a0).stop 2020-05-18T21:32:04.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.609+0000 7f8d3ec40700 1 -- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38149bd0 msgr2=0x7f8d38144c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:04.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.609+0000 7f8d3ec40700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38149bd0 0x7f8d38144c10 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f8d300032f0 tx=0x7f8d30010f50).stop 2020-05-18T21:32:04.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.609+0000 7f8d3ec40700 1 -- 172.21.15.63:0/2343262969 shutdown_connections 2020-05-18T21:32:04.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.609+0000 7f8d3ec40700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d1c050130 0x7f8d1c0525f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:04.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.609+0000 7f8d3ec40700 1 --2- 172.21.15.63:0/2343262969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d38149bd0 0x7f8d38144c10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:04.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.609+0000 7f8d3ec40700 1 -- 172.21.15.63:0/2343262969 >> 172.21.15.63:0/2343262969 conn(0x7f8d380b83d0 msgr2=0x7f8d380b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:04.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.609+0000 7f8d3ec40700 1 -- 172.21.15.63:0/2343262969 shutdown_connections 2020-05-18T21:32:04.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:04.609+0000 7f8d3ec40700 1 -- 172.21.15.63:0/2343262969 wait complete. 2020-05-18T21:32:04.617 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 58 2020-05-18T21:32:04.828 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:31:59.657403+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {}, 'failed': [0, 1], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:04.828 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/2 2020-05-18T21:32:05.830 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:05.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd39b91700 1 Processor -- start 2020-05-18T21:32:05.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd39b91700 1 -- start start 2020-05-18T21:32:05.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd39b91700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdd340bb5e0 0x7fdd340acee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:05.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd39b91700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdd3412efd0 0x7fdd3412f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:05.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd39b91700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd340af6e0 con 0x7fdd340bbcd0 2020-05-18T21:32:05.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd39b91700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd340af980 con 0x7fdd340bb5e0 2020-05-18T21:32:05.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd39b91700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd340b0530 con 0x7fdd3412efd0 2020-05-18T21:32:05.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd337fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdd340bb5e0 0x7fdd340acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:05.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd337fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdd340bb5e0 0x7fdd340acee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58726/0 (socket says 172.21.15.63:58726) 2020-05-18T21:32:05.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd337fe700 1 -- 172.21.15.63:0/2794207399 learned_addr learned my addr 172.21.15.63:0/2794207399 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:05.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd33fff700 1 --2- 172.21.15.63:0/2794207399 >> v2:172.21.15.155:3300/0 conn(0x7fdd3412efd0 0x7fdd3412f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:05.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd327fc700 1 -- 172.21.15.63:0/2794207399 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020906882 0 0) 0x7fdd340af6e0 con 0x7fdd340bbcd0 2020-05-18T21:32:05.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd327fc700 1 -- 172.21.15.63:0/2794207399 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd14003270 con 0x7fdd340bbcd0 2020-05-18T21:32:05.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd337fe700 1 -- 172.21.15.63:0/2794207399 >> v2:172.21.15.155:3300/0 conn(0x7fdd3412efd0 msgr2=0x7fdd3412f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:05.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd337fe700 1 --2- 172.21.15.63:0/2794207399 >> v2:172.21.15.155:3300/0 conn(0x7fdd3412efd0 0x7fdd3412f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:05.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd337fe700 1 -- 172.21.15.63:0/2794207399 >> v1:172.21.15.155:6789/0 conn(0x7fdd340bbcd0 legacy=0x7fdd340afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:05.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd337fe700 1 -- 172.21.15.63:0/2794207399 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd340bb9c0 con 0x7fdd340bb5e0 2020-05-18T21:32:05.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd337fe700 1 --2- 172.21.15.63:0/2794207399 >> v2:172.21.15.63:3300/0 conn(0x7fdd340bb5e0 0x7fdd340acee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdd2c0032f0 tx=0x7fdd2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:05.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd337fe700 1 --2- 172.21.15.63:0/2794207399 >> v2:172.21.15.63:3300/0 conn(0x7fdd340bb5e0 0x7fdd340acee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdd2c0032f0 tx=0x7fdd2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:05.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd337fe700 1 --2- 172.21.15.63:0/2794207399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd340bb5e0 0x7fdd340acee0 secure :-1 s=READY pgs=1122 cs=0 l=1 rx=0x7fdd2c0032f0 tx=0x7fdd2c007e00).ready entity=mon.0 client_cookie=b560c4b5f2a4c5d9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:05.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd337fe700 1 --2- 172.21.15.63:0/2794207399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd340bb5e0 0x7fdd340acee0 secure :-1 s=THROTTLE_DONE pgs=1122 cs=0 l=1 rx=0x7fdd2c0032f0 tx=0x7fdd2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:05.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd337fe700 1 --2- 172.21.15.63:0/2794207399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd340bb5e0 0x7fdd340acee0 secure :-1 s=THROTTLE_DONE pgs=1122 cs=0 l=1 rx=0x7fdd2c0032f0 tx=0x7fdd2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:05.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd327fc700 1 -- 172.21.15.63:0/2794207399 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd2c011c60 con 0x7fdd340bb5e0 2020-05-18T21:32:05.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd337fe700 1 --2- 172.21.15.63:0/2794207399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd340bb5e0 0x7fdd340acee0 secure :-1 s=THROTTLE_DONE pgs=1122 cs=0 l=1 rx=0x7fdd2c0032f0 tx=0x7fdd2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:05.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd327fc700 1 -- 172.21.15.63:0/2794207399 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2c011dc0 con 0x7fdd340bb5e0 2020-05-18T21:32:05.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd327fc700 1 -- 172.21.15.63:0/2794207399 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd2c00a370 con 0x7fdd340bb5e0 2020-05-18T21:32:05.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd39b91700 1 -- 172.21.15.63:0/2794207399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd340bb5e0 msgr2=0x7fdd340acee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:05.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.937+0000 7fdd39b91700 1 --2- 172.21.15.63:0/2794207399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd340bb5e0 0x7fdd340acee0 secure :-1 s=READY pgs=1122 cs=0 l=1 rx=0x7fdd2c0032f0 tx=0x7fdd2c007e00).stop 2020-05-18T21:32:05.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd39b91700 1 -- 172.21.15.63:0/2794207399 shutdown_connections 2020-05-18T21:32:05.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd39b91700 1 --2- 172.21.15.63:0/2794207399 >> v2:172.21.15.155:3300/0 conn(0x7fdd3412efd0 0x7fdd3412f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:05.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd39b91700 1 --2- 172.21.15.63:0/2794207399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd340bb5e0 0x7fdd340acee0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:05.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd39b91700 1 -- 172.21.15.63:0/2794207399 >> 172.21.15.63:0/2794207399 conn(0x7fdd34069b70 msgr2=0x7fdd34069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:05.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd39b91700 1 -- 172.21.15.63:0/2794207399 shutdown_connections 2020-05-18T21:32:05.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd39b91700 1 -- 172.21.15.63:0/2794207399 wait complete. 2020-05-18T21:32:05.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd39b91700 1 Processor -- start 2020-05-18T21:32:05.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd39b91700 1 -- start start 2020-05-18T21:32:05.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd39b91700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdd340bb5e0 0x7fdd340b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:05.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd39b91700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdd340bbcd0 0x7fdd340b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:05.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd39b91700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd340b7620 con 0x7fdd3412efd0 2020-05-18T21:32:05.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd39b91700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd340b78c0 con 0x7fdd340bbcd0 2020-05-18T21:32:05.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd39b91700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd340b3130 con 0x7fdd340bb5e0 2020-05-18T21:32:05.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd33fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdd3412efd0 0x7fdd340b5030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60922/0 (socket says 172.21.15.63:60922) 2020-05-18T21:32:05.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd33fff700 1 -- 172.21.15.63:0/2257022245 learned_addr learned my addr 172.21.15.63:0/2257022245 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:05.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd32ffd700 1 --2- 172.21.15.63:0/2257022245 >> v2:172.21.15.63:3300/0 conn(0x7fdd340bbcd0 0x7fdd340b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:05.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd337fe700 1 --2- 172.21.15.63:0/2257022245 >> v2:172.21.15.155:3300/0 conn(0x7fdd340bb5e0 0x7fdd340b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:05.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd30ff9700 1 -- 172.21.15.63:0/2257022245 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95242734 0 0) 0x7fdd340b7620 con 0x7fdd3412efd0 2020-05-18T21:32:05.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd30ff9700 1 -- 172.21.15.63:0/2257022245 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd18002fe0 con 0x7fdd3412efd0 2020-05-18T21:32:05.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd32ffd700 1 -- 172.21.15.63:0/2257022245 >> v2:172.21.15.155:3300/0 conn(0x7fdd340bb5e0 msgr2=0x7fdd340b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:05.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd32ffd700 1 --2- 172.21.15.63:0/2257022245 >> v2:172.21.15.155:3300/0 conn(0x7fdd340bb5e0 0x7fdd340b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:05.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd32ffd700 1 -- 172.21.15.63:0/2257022245 >> v1:172.21.15.63:6789/0 conn(0x7fdd3412efd0 legacy=0x7fdd340b5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:05.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd30ff9700 1 -- 172.21.15.63:0/2257022245 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 288074278 0 0) 0x7fdd18002fe0 con 0x7fdd3412efd0 2020-05-18T21:32:05.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd32ffd700 1 -- 172.21.15.63:0/2257022245 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd340b7360 con 0x7fdd340bbcd0 2020-05-18T21:32:05.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.941+0000 7fdd32ffd700 1 --2- 172.21.15.63:0/2257022245 >> v2:172.21.15.63:3300/0 conn(0x7fdd340bbcd0 0x7fdd340b3a30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd24001670 tx=0x7fdd1c002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:05.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd32ffd700 1 --2- 172.21.15.63:0/2257022245 >> v2:172.21.15.63:3300/0 conn(0x7fdd340bbcd0 0x7fdd340b3a30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd24001670 tx=0x7fdd1c002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:05.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd32ffd700 1 --2- 172.21.15.63:0/2257022245 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd340bbcd0 0x7fdd340b3a30 secure :-1 s=READY pgs=1124 cs=0 l=1 rx=0x7fdd24001670 tx=0x7fdd1c002eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:05.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd32ffd700 1 --2- 172.21.15.63:0/2257022245 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd340bbcd0 0x7fdd340b3a30 secure :-1 s=THROTTLE_DONE pgs=1124 cs=0 l=1 rx=0x7fdd24001670 tx=0x7fdd1c002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:05.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd30ff9700 1 -- 172.21.15.63:0/2257022245 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd240014d0 con 0x7fdd340bbcd0 2020-05-18T21:32:05.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd32ffd700 1 --2- 172.21.15.63:0/2257022245 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd340bbcd0 0x7fdd340b3a30 secure :-1 s=THROTTLE_DONE pgs=1124 cs=0 l=1 rx=0x7fdd24001670 tx=0x7fdd1c002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:05.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd32ffd700 1 --2- 172.21.15.63:0/2257022245 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd340bbcd0 0x7fdd340b3a30 secure :-1 s=THROTTLE_DONE pgs=1124 cs=0 l=1 rx=0x7fdd24001670 tx=0x7fdd1c002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:05.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd30ff9700 1 -- 172.21.15.63:0/2257022245 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1c00ca70 con 0x7fdd340bbcd0 2020-05-18T21:32:05.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd39b91700 1 -- 172.21.15.63:0/2257022245 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd340b7010 con 0x7fdd340bbcd0 2020-05-18T21:32:05.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd30ff9700 1 -- 172.21.15.63:0/2257022245 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1c00ce50 con 0x7fdd340bbcd0 2020-05-18T21:32:05.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd39b91700 1 -- 172.21.15.63:0/2257022245 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd34147a00 con 0x7fdd340bbcd0 2020-05-18T21:32:05.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd32ffd700 1 --2- 172.21.15.63:0/2257022245 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd340bbcd0 0x7fdd340b3a30 secure :-1 s=THROTTLE_DONE pgs=1124 cs=0 l=1 rx=0x7fdd24001670 tx=0x7fdd1c002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:05.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd32ffd700 1 --2- 172.21.15.63:0/2257022245 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd340bbcd0 0x7fdd340b3a30 secure :-1 s=THROTTLE_DONE pgs=1124 cs=0 l=1 rx=0x7fdd24001670 tx=0x7fdd1c002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:05.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd30ff9700 1 -- 172.21.15.63:0/2257022245 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fdd1c006520 con 0x7fdd340bbcd0 2020-05-18T21:32:05.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd39b91700 1 -- 172.21.15.63:0/2257022245 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd340569e0 con 0x7fdd340bbcd0 2020-05-18T21:32:05.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd30ff9700 1 --2- 172.21.15.63:0/2257022245 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd1804fc80 0x7fdd18052140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:05.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd30ff9700 1 -- 172.21.15.63:0/2257022245 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fdd1c0635b0 con 0x7fdd340bbcd0 2020-05-18T21:32:05.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd337fe700 1 --2- 172.21.15.63:0/2257022245 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd1804fc80 0x7fdd18052140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:05.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd337fe700 1 --2- 172.21.15.63:0/2257022245 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd1804fc80 0x7fdd18052140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd2c0032f0 tx=0x7fdd2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:05.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd337fe700 1 --2- 172.21.15.63:0/2257022245 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd1804fc80 0x7fdd18052140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd2c0032f0 tx=0x7fdd2c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:05.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.945+0000 7fdd337fe700 1 --2- 172.21.15.63:0/2257022245 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd1804fc80 0x7fdd18052140 secure :-1 s=READY pgs=445 cs=0 l=1 rx=0x7fdd2c0032f0 tx=0x7fdd2c007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:05.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.953+0000 7fdd32ffd700 1 --2- 172.21.15.63:0/2257022245 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd340bbcd0 0x7fdd340b3a30 secure :-1 s=THROTTLE_DONE pgs=1124 cs=0 l=1 rx=0x7fdd24001670 tx=0x7fdd1c002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:05.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:05.953+0000 7fdd30ff9700 1 -- 172.21.15.63:0/2257022245 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fdd1c03d8e0 con 0x7fdd340bbcd0 2020-05-18T21:32:06.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:06.105+0000 7fdd39b91700 1 -- 172.21.15.63:0/2257022245 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd3405c870 con 0x7fdd340bbcd0 2020-05-18T21:32:06.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:06.105+0000 7fdd32ffd700 1 --2- 172.21.15.63:0/2257022245 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd340bbcd0 0x7fdd340b3a30 secure :-1 s=THROTTLE_DONE pgs=1124 cs=0 l=1 rx=0x7fdd24001670 tx=0x7fdd1c002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:06.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:06.105+0000 7fdd30ff9700 1 -- 172.21.15.63:0/2257022245 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+2158 (secure 0 0 0) 0x7fdd1c040f00 con 0x7fdd340bbcd0 2020-05-18T21:32:06.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:06.109+0000 7fdd39b91700 1 -- 172.21.15.63:0/2257022245 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd1804fc80 msgr2=0x7fdd18052140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:06.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:06.109+0000 7fdd39b91700 1 --2- 172.21.15.63:0/2257022245 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd1804fc80 0x7fdd18052140 secure :-1 s=READY pgs=445 cs=0 l=1 rx=0x7fdd2c0032f0 tx=0x7fdd2c007e00).stop 2020-05-18T21:32:06.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:06.109+0000 7fdd39b91700 1 -- 172.21.15.63:0/2257022245 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd340bbcd0 msgr2=0x7fdd340b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:06.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:06.109+0000 7fdd39b91700 1 --2- 172.21.15.63:0/2257022245 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd340bbcd0 0x7fdd340b3a30 secure :-1 s=READY pgs=1124 cs=0 l=1 rx=0x7fdd24001670 tx=0x7fdd1c002eb0).stop 2020-05-18T21:32:06.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:06.109+0000 7fdd39b91700 1 -- 172.21.15.63:0/2257022245 shutdown_connections 2020-05-18T21:32:06.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:06.109+0000 7fdd39b91700 1 --2- 172.21.15.63:0/2257022245 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd1804fc80 0x7fdd18052140 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:06.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:06.109+0000 7fdd39b91700 1 --2- 172.21.15.63:0/2257022245 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd340bbcd0 0x7fdd340b3a30 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:06.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:06.109+0000 7fdd39b91700 1 --2- 172.21.15.63:0/2257022245 >> v2:172.21.15.155:3300/0 conn(0x7fdd340bb5e0 0x7fdd340b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:06.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:06.109+0000 7fdd39b91700 1 -- 172.21.15.63:0/2257022245 >> 172.21.15.63:0/2257022245 conn(0x7fdd34069b70 msgr2=0x7fdd340b8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:06.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:06.109+0000 7fdd39b91700 1 -- 172.21.15.63:0/2257022245 shutdown_connections 2020-05-18T21:32:06.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:06.109+0000 7fdd39b91700 1 -- 172.21.15.63:0/2257022245 wait complete. 2020-05-18T21:32:06.217 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 61 2020-05-18T21:32:06.217 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:06.218 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:05.671320+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:resolve","state_seq":3,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:resolve","state_seq":3,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:06.421 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:05.671320+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:resolve', 'state_seq': 3, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:resolve', 'state_seq': 3, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:06.421 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5756:up:resolve 2020-05-18T21:32:07.423 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:07.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.529+0000 7fa475238700 1 Processor -- start 2020-05-18T21:32:07.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.529+0000 7fa475238700 1 -- start start 2020-05-18T21:32:07.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa475238700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47005f110 0x7fa4700acea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:07.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa475238700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4700b4af0 con 0x7fa4700659d0 2020-05-18T21:32:07.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa475238700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4701460e0 con 0x7fa47013c710 2020-05-18T21:32:07.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa475238700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa470146380 con 0x7fa47005f110 2020-05-18T21:32:07.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa467fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa4700659d0 0x7fa470146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60930/0 (socket says 172.21.15.63:60930) 2020-05-18T21:32:07.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa467fff700 1 -- 172.21.15.63:0/3143067825 learned_addr learned my addr 172.21.15.63:0/3143067825 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:07.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46ffff700 1 --2- 172.21.15.63:0/3143067825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47005f110 0x7fa4700acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:07.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 -- 172.21.15.63:0/3143067825 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995498777 0 0) 0x7fa4700b4af0 con 0x7fa4700659d0 2020-05-18T21:32:07.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 -- 172.21.15.63:0/3143067825 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa450003270 con 0x7fa4700659d0 2020-05-18T21:32:07.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 -- 172.21.15.63:0/3143067825 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928541282 0 0) 0x7fa4701460e0 con 0x7fa47013c710 2020-05-18T21:32:07.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 -- 172.21.15.63:0/3143067825 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4700b4af0 con 0x7fa47013c710 2020-05-18T21:32:07.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 -- 172.21.15.63:0/3143067825 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1132919108 0 0) 0x7fa450003270 con 0x7fa4700659d0 2020-05-18T21:32:07.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 -- 172.21.15.63:0/3143067825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47005f110 msgr2=0x7fa4700acea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:07.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 --2- 172.21.15.63:0/3143067825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47005f110 0x7fa4700acea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:07.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 -- 172.21.15.63:0/3143067825 >> v1:172.21.15.155:6789/0 conn(0x7fa47013c710 legacy=0x7fa470142a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:07.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 -- 172.21.15.63:0/3143067825 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa470146f30 con 0x7fa4700659d0 2020-05-18T21:32:07.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 -- 172.21.15.63:0/3143067825 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fa458001710 con 0x7fa4700659d0 2020-05-18T21:32:07.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 -- 172.21.15.63:0/3143067825 >> v1:172.21.15.63:6789/0 conn(0x7fa4700659d0 legacy=0x7fa470146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:07.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 --2- 172.21.15.63:0/3143067825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47005f110 0x7fa450003920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:07.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 --2- 172.21.15.63:0/3143067825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa450003dd0 0x7fa450004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:07.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 --2- 172.21.15.63:0/3143067825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa450004970 0x7fa450004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:07.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 -- 172.21.15.63:0/3143067825 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa470146380 con 0x7fa450003dd0 2020-05-18T21:32:07.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 -- 172.21.15.63:0/3143067825 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa450005250 con 0x7fa450004970 2020-05-18T21:32:07.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 -- 172.21.15.63:0/3143067825 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4500053e0 con 0x7fa47005f110 2020-05-18T21:32:07.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa467fff700 1 --2- 172.21.15.63:0/3143067825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa450003dd0 0x7fa450004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:07.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46ffff700 1 --2- 172.21.15.63:0/3143067825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47005f110 0x7fa450003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:07.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa474a37700 1 --2- 172.21.15.63:0/3143067825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa450004970 0x7fa450004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:07.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa467fff700 1 -- 172.21.15.63:0/3143067825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47005f110 msgr2=0x7fa450003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:07.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa467fff700 1 --2- 172.21.15.63:0/3143067825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47005f110 0x7fa450003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:07.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa467fff700 1 -- 172.21.15.63:0/3143067825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa450004970 msgr2=0x7fa450004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:07.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa467fff700 1 --2- 172.21.15.63:0/3143067825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa450004970 0x7fa450004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:07.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa467fff700 1 -- 172.21.15.63:0/3143067825 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa450003270 con 0x7fa450003dd0 2020-05-18T21:32:07.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46ffff700 1 --2- 172.21.15.63:0/3143067825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47005f110 0x7fa450003920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:32:07.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa467fff700 1 --2- 172.21.15.63:0/3143067825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa450003dd0 0x7fa450004510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa4580014e0 tx=0x7fa4701470c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:07.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa467fff700 1 --2- 172.21.15.63:0/3143067825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa450003dd0 0x7fa450004510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa4580014e0 tx=0x7fa4701470c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:07.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa467fff700 1 --2- 172.21.15.63:0/3143067825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa450003dd0 0x7fa450004510 secure :-1 s=READY pgs=1126 cs=0 l=1 rx=0x7fa4580014e0 tx=0x7fa4701470c0).ready entity=mon.0 client_cookie=4134d1e6e0aee99c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:07.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa467fff700 1 --2- 172.21.15.63:0/3143067825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa450003dd0 0x7fa450004510 secure :-1 s=THROTTLE_DONE pgs=1126 cs=0 l=1 rx=0x7fa4580014e0 tx=0x7fa4701470c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:07.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 -- 172.21.15.63:0/3143067825 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa45800e180 con 0x7fa450003dd0 2020-05-18T21:32:07.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa467fff700 1 --2- 172.21.15.63:0/3143067825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa450003dd0 0x7fa450004510 secure :-1 s=THROTTLE_DONE pgs=1126 cs=0 l=1 rx=0x7fa4580014e0 tx=0x7fa4701470c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:07.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 -- 172.21.15.63:0/3143067825 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45800e2e0 con 0x7fa450003dd0 2020-05-18T21:32:07.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa467fff700 1 --2- 172.21.15.63:0/3143067825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa450003dd0 0x7fa450004510 secure :-1 s=THROTTLE_DONE pgs=1126 cs=0 l=1 rx=0x7fa4580014e0 tx=0x7fa4701470c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:07.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa46f7fe700 1 -- 172.21.15.63:0/3143067825 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4580100c0 con 0x7fa450003dd0 2020-05-18T21:32:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa475238700 1 -- 172.21.15.63:0/3143067825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa450003dd0 msgr2=0x7fa450004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa475238700 1 --2- 172.21.15.63:0/3143067825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa450003dd0 0x7fa450004510 secure :-1 s=READY pgs=1126 cs=0 l=1 rx=0x7fa4580014e0 tx=0x7fa4701470c0).stop 2020-05-18T21:32:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa474a37700 1 -- 172.21.15.63:0/3143067825 reap_dead start 2020-05-18T21:32:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa475238700 1 -- 172.21.15.63:0/3143067825 shutdown_connections 2020-05-18T21:32:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.533+0000 7fa475238700 1 -- 172.21.15.63:0/3143067825 >> 172.21.15.63:0/3143067825 conn(0x7fa470069fc0 msgr2=0x7fa47006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.537+0000 7fa475238700 1 -- 172.21.15.63:0/3143067825 shutdown_connections 2020-05-18T21:32:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.537+0000 7fa475238700 1 -- 172.21.15.63:0/3143067825 wait complete. 2020-05-18T21:32:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.537+0000 7fa475238700 1 Processor -- start 2020-05-18T21:32:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.537+0000 7fa475238700 1 -- start start 2020-05-18T21:32:07.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.537+0000 7fa475238700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4700b3680 0x7fa470153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:07.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.537+0000 7fa475238700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa4700b2ba0 0x7fa4700b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:07.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.537+0000 7fa475238700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4700b3a60 con 0x7fa4700b1c00 2020-05-18T21:32:07.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.537+0000 7fa475238700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4701388b0 con 0x7fa4700b2ba0 2020-05-18T21:32:07.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.537+0000 7fa475238700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa470153930 con 0x7fa4700b3680 2020-05-18T21:32:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.537+0000 7fa474a37700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa4700b1c00 0x7fa470156710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60944/0 (socket says 172.21.15.63:60944) 2020-05-18T21:32:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.537+0000 7fa474a37700 1 -- 172.21.15.63:0/645812892 learned_addr learned my addr 172.21.15.63:0/645812892 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.537+0000 7fa467fff700 1 --2- 172.21.15.63:0/645812892 >> v2:172.21.15.63:3300/0 conn(0x7fa4700b2ba0 0x7fa4700b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.537+0000 7fa46ffff700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4700b3680 0x7fa470153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa467fff700 1 -- 172.21.15.63:0/645812892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4700b3680 msgr2=0x7fa470153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa467fff700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4700b3680 0x7fa470153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa467fff700 1 -- 172.21.15.63:0/645812892 >> v1:172.21.15.63:6789/0 conn(0x7fa4700b1c00 legacy=0x7fa470156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa467fff700 1 -- 172.21.15.63:0/645812892 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa470153bd0 con 0x7fa4700b2ba0 2020-05-18T21:32:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa46dffb700 1 -- 172.21.15.63:0/645812892 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088992482 0 0) 0x7fa4700b3a60 con 0x7fa4700b1c00 2020-05-18T21:32:07.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa467fff700 1 --2- 172.21.15.63:0/645812892 >> v2:172.21.15.63:3300/0 conn(0x7fa4700b2ba0 0x7fa4700b17a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4580014e0 tx=0x7fa4701470c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:07.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa467fff700 1 --2- 172.21.15.63:0/645812892 >> v2:172.21.15.63:3300/0 conn(0x7fa4700b2ba0 0x7fa4700b17a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4580014e0 tx=0x7fa4701470c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:07.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa467fff700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4700b2ba0 0x7fa4700b17a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rx=0x7fa4580014e0 tx=0x7fa4701470c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:07.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa467fff700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4700b2ba0 0x7fa4700b17a0 secure :-1 s=THROTTLE_DONE pgs=1128 cs=0 l=1 rx=0x7fa4580014e0 tx=0x7fa4701470c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:07.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa46dffb700 1 -- 172.21.15.63:0/645812892 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4580102d0 con 0x7fa4700b2ba0 2020-05-18T21:32:07.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa467fff700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4700b2ba0 0x7fa4700b17a0 secure :-1 s=THROTTLE_DONE pgs=1128 cs=0 l=1 rx=0x7fa4580014e0 tx=0x7fa4701470c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:07.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa467fff700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4700b2ba0 0x7fa4700b17a0 secure :-1 s=THROTTLE_DONE pgs=1128 cs=0 l=1 rx=0x7fa4580014e0 tx=0x7fa4701470c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:07.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa46dffb700 1 -- 172.21.15.63:0/645812892 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa458010430 con 0x7fa4700b2ba0 2020-05-18T21:32:07.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa475238700 1 -- 172.21.15.63:0/645812892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa470153e70 con 0x7fa4700b2ba0 2020-05-18T21:32:07.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa46dffb700 1 -- 172.21.15.63:0/645812892 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa458010790 con 0x7fa4700b2ba0 2020-05-18T21:32:07.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa475238700 1 -- 172.21.15.63:0/645812892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa470139ff0 con 0x7fa4700b2ba0 2020-05-18T21:32:07.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa467fff700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4700b2ba0 0x7fa4700b17a0 secure :-1 s=THROTTLE_DONE pgs=1128 cs=0 l=1 rx=0x7fa4580014e0 tx=0x7fa4701470c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:07.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa475238700 1 -- 172.21.15.63:0/645812892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4700569e0 con 0x7fa4700b2ba0 2020-05-18T21:32:07.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa46dffb700 1 -- 172.21.15.63:0/645812892 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa4580045f0 con 0x7fa4700b2ba0 2020-05-18T21:32:07.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa467fff700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4700b2ba0 0x7fa4700b17a0 secure :-1 s=THROTTLE_DONE pgs=1128 cs=0 l=1 rx=0x7fa4580014e0 tx=0x7fa4701470c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:07.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.541+0000 7fa46dffb700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa45404f850 0x7fa454051d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:07.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.545+0000 7fa46dffb700 1 -- 172.21.15.63:0/645812892 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fa458064250 con 0x7fa4700b2ba0 2020-05-18T21:32:07.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.545+0000 7fa46ffff700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa45404f850 0x7fa454051d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:07.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.545+0000 7fa46ffff700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa45404f850 0x7fa454051d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa460002f70 tx=0x7fa460007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:07.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.545+0000 7fa46ffff700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa45404f850 0x7fa454051d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa460002f70 tx=0x7fa460007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:07.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.545+0000 7fa46ffff700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa45404f850 0x7fa454051d10 secure :-1 s=READY pgs=446 cs=0 l=1 rx=0x7fa460002f70 tx=0x7fa460007720).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:07.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.549+0000 7fa467fff700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4700b2ba0 0x7fa4700b17a0 secure :-1 s=THROTTLE_DONE pgs=1128 cs=0 l=1 rx=0x7fa4580014e0 tx=0x7fa4701470c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:07.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.549+0000 7fa46dffb700 1 -- 172.21.15.63:0/645812892 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa45803e5e0 con 0x7fa4700b2ba0 2020-05-18T21:32:07.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.693+0000 7fa475238700 1 -- 172.21.15.63:0/645812892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa470063700 con 0x7fa4700b2ba0 2020-05-18T21:32:07.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.697+0000 7fa467fff700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4700b2ba0 0x7fa4700b17a0 secure :-1 s=THROTTLE_DONE pgs=1128 cs=0 l=1 rx=0x7fa4580014e0 tx=0x7fa4701470c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:07.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.697+0000 7fa46dffb700 1 -- 172.21.15.63:0/645812892 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+2156 (secure 0 0 0) 0x7fa458041c00 con 0x7fa4700b2ba0 2020-05-18T21:32:07.700 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:07.700 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:07.679852+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:rejoin","state_seq":5,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:rejoin","state_seq":5,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:07.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.697+0000 7fa475238700 1 -- 172.21.15.63:0/645812892 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa45404f850 msgr2=0x7fa454051d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:07.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.697+0000 7fa475238700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa45404f850 0x7fa454051d10 secure :-1 s=READY pgs=446 cs=0 l=1 rx=0x7fa460002f70 tx=0x7fa460007720).stop 2020-05-18T21:32:07.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.697+0000 7fa475238700 1 -- 172.21.15.63:0/645812892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4700b2ba0 msgr2=0x7fa4700b17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:07.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.697+0000 7fa475238700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4700b2ba0 0x7fa4700b17a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rx=0x7fa4580014e0 tx=0x7fa4701470c0).stop 2020-05-18T21:32:07.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.697+0000 7fa475238700 1 -- 172.21.15.63:0/645812892 shutdown_connections 2020-05-18T21:32:07.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.697+0000 7fa475238700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa45404f850 0x7fa454051d10 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:07.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.697+0000 7fa475238700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4700b2ba0 0x7fa4700b17a0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:07.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.697+0000 7fa475238700 1 --2- 172.21.15.63:0/645812892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4700b3680 0x7fa470153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:07.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.697+0000 7fa475238700 1 -- 172.21.15.63:0/645812892 >> 172.21.15.63:0/645812892 conn(0x7fa470069fc0 msgr2=0x7fa4700acad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:07.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.697+0000 7fa475238700 1 -- 172.21.15.63:0/645812892 shutdown_connections 2020-05-18T21:32:07.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:07.697+0000 7fa475238700 1 -- 172.21.15.63:0/645812892 wait complete. 2020-05-18T21:32:07.704 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 63 2020-05-18T21:32:07.914 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:07.679852+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:rejoin', 'state_seq': 5, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:rejoin', 'state_seq': 5, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:07.915 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5756:up:rejoin 2020-05-18T21:32:08.917 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:09.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f6682e46700 1 Processor -- start 2020-05-18T21:32:09.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f6682e46700 1 -- start start 2020-05-18T21:32:09.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f6682e46700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f667c0bbcd0 0x7f667c0afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:09.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f6682e46700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f667c0b0280 0x7f667c12efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:09.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f6682e46700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c0af980 con 0x7f667c0bb5e0 2020-05-18T21:32:09.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f6682e46700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c0af770 con 0x7f667c0b0280 2020-05-18T21:32:09.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f6682e46700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c0bb9c0 con 0x7f667c0bbcd0 2020-05-18T21:32:09.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f6680be2700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f667c0bb5e0 0x7f667c0acee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60948/0 (socket says 172.21.15.63:60948) 2020-05-18T21:32:09.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f6680be2700 1 -- 172.21.15.63:0/929130966 learned_addr learned my addr 172.21.15.63:0/929130966 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:09.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f66813e3700 1 --2- 172.21.15.63:0/929130966 >> v2:172.21.15.63:3300/0 conn(0x7f667c0b0280 0x7f667c12efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:09.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f667bfff700 1 --2- 172.21.15.63:0/929130966 >> v2:172.21.15.155:3300/0 conn(0x7f667c0bbcd0 0x7f667c0afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:09.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f667b7fe700 1 -- 172.21.15.63:0/929130966 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222028128 0 0) 0x7f667c0af980 con 0x7f667c0bb5e0 2020-05-18T21:32:09.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f667b7fe700 1 -- 172.21.15.63:0/929130966 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f665c003270 con 0x7f667c0bb5e0 2020-05-18T21:32:09.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f66813e3700 1 -- 172.21.15.63:0/929130966 >> v2:172.21.15.155:3300/0 conn(0x7f667c0bbcd0 msgr2=0x7f667c0afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:09.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f66813e3700 1 --2- 172.21.15.63:0/929130966 >> v2:172.21.15.155:3300/0 conn(0x7f667c0bbcd0 0x7f667c0afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:09.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f66813e3700 1 -- 172.21.15.63:0/929130966 >> v1:172.21.15.63:6789/0 conn(0x7f667c0bb5e0 legacy=0x7f667c0acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:09.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f66813e3700 1 -- 172.21.15.63:0/929130966 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c0af3d0 con 0x7f667c0b0280 2020-05-18T21:32:09.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f66813e3700 1 --2- 172.21.15.63:0/929130966 >> v2:172.21.15.63:3300/0 conn(0x7f667c0b0280 0x7f667c12efd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f666c002f70 tx=0x7f666c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f66813e3700 1 --2- 172.21.15.63:0/929130966 >> v2:172.21.15.63:3300/0 conn(0x7f667c0b0280 0x7f667c12efd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f666c002f70 tx=0x7f666c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f66813e3700 1 --2- 172.21.15.63:0/929130966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f667c0b0280 0x7f667c12efd0 secure :-1 s=READY pgs=1130 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).ready entity=mon.0 client_cookie=d8cc2ade24f7aeb0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:09.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f66813e3700 1 --2- 172.21.15.63:0/929130966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f667c0b0280 0x7f667c12efd0 secure :-1 s=THROTTLE_DONE pgs=1130 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f66813e3700 1 --2- 172.21.15.63:0/929130966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f667c0b0280 0x7f667c12efd0 secure :-1 s=THROTTLE_DONE pgs=1130 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f667b7fe700 1 -- 172.21.15.63:0/929130966 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f666c008e50 con 0x7f667c0b0280 2020-05-18T21:32:09.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f66813e3700 1 --2- 172.21.15.63:0/929130966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f667c0b0280 0x7f667c12efd0 secure :-1 s=THROTTLE_DONE pgs=1130 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f667b7fe700 1 -- 172.21.15.63:0/929130966 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c011540 con 0x7f667c0b0280 2020-05-18T21:32:09.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f667b7fe700 1 -- 172.21.15.63:0/929130966 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f666c011960 con 0x7f667c0b0280 2020-05-18T21:32:09.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f6682e46700 1 -- 172.21.15.63:0/929130966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f667c0b0280 msgr2=0x7f667c12efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:09.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.025+0000 7f6682e46700 1 --2- 172.21.15.63:0/929130966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f667c0b0280 0x7f667c12efd0 secure :-1 s=READY pgs=1130 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).stop 2020-05-18T21:32:09.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.029+0000 7f6682e46700 1 -- 172.21.15.63:0/929130966 shutdown_connections 2020-05-18T21:32:09.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.029+0000 7f6682e46700 1 --2- 172.21.15.63:0/929130966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f667c0b0280 0x7f667c12efd0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:09.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.029+0000 7f6682e46700 1 --2- 172.21.15.63:0/929130966 >> v2:172.21.15.155:3300/0 conn(0x7f667c0bbcd0 0x7f667c0afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:09.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.029+0000 7f6682e46700 1 -- 172.21.15.63:0/929130966 >> 172.21.15.63:0/929130966 conn(0x7f667c069b70 msgr2=0x7f667c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:09.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.029+0000 7f6682e46700 1 -- 172.21.15.63:0/929130966 shutdown_connections 2020-05-18T21:32:09.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.029+0000 7f6682e46700 1 -- 172.21.15.63:0/929130966 wait complete. 2020-05-18T21:32:09.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.029+0000 7f6682e46700 1 Processor -- start 2020-05-18T21:32:09.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.029+0000 7f6682e46700 1 -- start start 2020-05-18T21:32:09.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f6682e46700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f667c0bb5e0 0x7f667c0b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:09.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f6682e46700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f667c0bbcd0 0x7f667c157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:09.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f6682e46700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c1574c0 con 0x7f667c0b0280 2020-05-18T21:32:09.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f6682e46700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c0b81b0 con 0x7f667c0bbcd0 2020-05-18T21:32:09.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f6682e46700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0b8450 con 0x7f667c0bb5e0 2020-05-18T21:32:09.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f667bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f667c0bb5e0 0x7f667c0b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:09.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f66813e3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f667c0bbcd0 0x7f667c157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:09.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f66813e3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f667c0bbcd0 0x7f667c157060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:45386/0 (socket says 172.21.15.63:45386) 2020-05-18T21:32:09.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f667bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f667c0bb5e0 0x7f667c0b5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:49470/0 (socket says 172.21.15.63:49470) 2020-05-18T21:32:09.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f66813e3700 1 -- 172.21.15.63:0/1318885503 learned_addr learned my addr 172.21.15.63:0/1318885503 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:09.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f6680be2700 1 --1- 172.21.15.63:0/1318885503 >> v1:172.21.15.155:6789/0 conn(0x7f667c0b0280 0x7f667c156950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:59270/0 (socket says 172.21.15.63:59270) 2020-05-18T21:32:09.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f66813e3700 1 -- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f667c0bb5e0 msgr2=0x7f667c0b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:09.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f66813e3700 1 --2- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f667c0bb5e0 0x7f667c0b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:09.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f66813e3700 1 -- 172.21.15.63:0/1318885503 >> v1:172.21.15.155:6789/0 conn(0x7f667c0b0280 legacy=0x7f667c156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:09.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f66813e3700 1 -- 172.21.15.63:0/1318885503 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c0b86f0 con 0x7f667c0bbcd0 2020-05-18T21:32:09.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f66813e3700 1 --2- 172.21.15.63:0/1318885503 >> v2:172.21.15.155:3300/0 conn(0x7f667c0bbcd0 0x7f667c157060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f66813e3700 1 --2- 172.21.15.63:0/1318885503 >> v2:172.21.15.155:3300/0 conn(0x7f667c0bbcd0 0x7f667c157060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f66813e3700 1 --2- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f667c0bbcd0 0x7f667c157060 secure :-1 s=READY pgs=772 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:09.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f66813e3700 1 --2- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f667c0bbcd0 0x7f667c157060 secure :-1 s=THROTTLE_DONE pgs=772 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f6679ffb700 1 -- 172.21.15.63:0/1318885503 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f666c011e40 con 0x7f667c0bbcd0 2020-05-18T21:32:09.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f66813e3700 1 --2- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f667c0bbcd0 0x7f667c157060 secure :-1 s=THROTTLE_DONE pgs=772 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f6682e46700 1 -- 172.21.15.63:0/1318885503 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667c0b8a90 con 0x7f667c0bbcd0 2020-05-18T21:32:09.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f6679ffb700 1 -- 172.21.15.63:0/1318885503 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c005700 con 0x7f667c0bbcd0 2020-05-18T21:32:09.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f66813e3700 1 --2- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f667c0bbcd0 0x7f667c157060 secure :-1 s=THROTTLE_DONE pgs=772 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f6679ffb700 1 -- 172.21.15.63:0/1318885503 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f666c005ab0 con 0x7f667c0bbcd0 2020-05-18T21:32:09.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.033+0000 7f6682e46700 1 -- 172.21.15.63:0/1318885503 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667c152850 con 0x7f667c0bbcd0 2020-05-18T21:32:09.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.037+0000 7f66813e3700 1 --2- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f667c0bbcd0 0x7f667c157060 secure :-1 s=THROTTLE_DONE pgs=772 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.037+0000 7f6682e46700 1 -- 172.21.15.63:0/1318885503 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667c0b4020 con 0x7f667c0bbcd0 2020-05-18T21:32:09.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.037+0000 7f6679ffb700 1 -- 172.21.15.63:0/1318885503 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f666c005c10 con 0x7f667c0bbcd0 2020-05-18T21:32:09.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.037+0000 7f66813e3700 1 --2- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f667c0bbcd0 0x7f667c157060 secure :-1 s=THROTTLE_DONE pgs=772 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.037+0000 7f6679ffb700 1 --2- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f666004fa20 0x7f6660051ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:09.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.037+0000 7f6679ffb700 1 -- 172.21.15.63:0/1318885503 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f666c064320 con 0x7f667c0bbcd0 2020-05-18T21:32:09.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.037+0000 7f6680be2700 1 --2- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f666004fa20 0x7f6660051ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:09.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.037+0000 7f6680be2700 1 --2- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f666004fa20 0x7f6660051ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f667c0b3820 tx=0x7f6664001cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.037+0000 7f6680be2700 1 --2- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f666004fa20 0x7f6660051ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f667c0b3820 tx=0x7f6664001cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.037+0000 7f6680be2700 1 --2- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f666004fa20 0x7f6660051ee0 secure :-1 s=READY pgs=447 cs=0 l=1 rx=0x7f667c0b3820 tx=0x7f6664001cb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:09.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.045+0000 7f66813e3700 1 --2- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f667c0bbcd0 0x7f667c157060 secure :-1 s=THROTTLE_DONE pgs=772 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.045+0000 7f6679ffb700 1 -- 172.21.15.63:0/1318885503 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f666c03e7d0 con 0x7f667c0bbcd0 2020-05-18T21:32:09.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.197+0000 7f6682e46700 1 -- 172.21.15.63:0/1318885503 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f667c0569e0 con 0x7f667c0bbcd0 2020-05-18T21:32:09.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.197+0000 7f66813e3700 1 --2- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f667c0bbcd0 0x7f667c157060 secure :-1 s=THROTTLE_DONE pgs=772 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.197+0000 7f6679ffb700 1 -- 172.21.15.63:0/1318885503 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+2156 (secure 0 0 0) 0x7f666c041df0 con 0x7f667c0bbcd0 2020-05-18T21:32:09.203 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:09.203 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":64,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:08.692459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:09.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.201+0000 7f6682e46700 1 -- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f666004fa20 msgr2=0x7f6660051ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:09.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.201+0000 7f6682e46700 1 --2- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f666004fa20 0x7f6660051ee0 secure :-1 s=READY pgs=447 cs=0 l=1 rx=0x7f667c0b3820 tx=0x7f6664001cb0).stop 2020-05-18T21:32:09.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.201+0000 7f6682e46700 1 -- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f667c0bbcd0 msgr2=0x7f667c157060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:09.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.201+0000 7f6682e46700 1 --2- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f667c0bbcd0 0x7f667c157060 secure :-1 s=READY pgs=772 cs=0 l=1 rx=0x7f666c002f70 tx=0x7f666c007a80).stop 2020-05-18T21:32:09.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.201+0000 7f6682e46700 1 -- 172.21.15.63:0/1318885503 shutdown_connections 2020-05-18T21:32:09.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.201+0000 7f6682e46700 1 --2- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f666004fa20 0x7f6660051ee0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:09.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.201+0000 7f6682e46700 1 --2- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f667c0bbcd0 0x7f667c157060 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:09.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.201+0000 7f6682e46700 1 --2- 172.21.15.63:0/1318885503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f667c0bb5e0 0x7f667c0b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:09.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.201+0000 7f6682e46700 1 -- 172.21.15.63:0/1318885503 >> 172.21.15.63:0/1318885503 conn(0x7f667c069b70 msgr2=0x7f667c0bd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:09.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.201+0000 7f6682e46700 1 -- 172.21.15.63:0/1318885503 shutdown_connections 2020-05-18T21:32:09.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.201+0000 7f6682e46700 1 -- 172.21.15.63:0/1318885503 wait complete. 2020-05-18T21:32:09.210 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 64 2020-05-18T21:32:09.422 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 64, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:08.692459+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:09.423 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2020-05-18T21:32:09.423 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:32:09.540 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:32:09.540 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:32:09.540 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 1, 2020-05-18T21:32:09.541 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 5756, 2020-05-18T21:32:09.541 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:32:09.541 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:32:09.541 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 4.8665501869999996, 2020-05-18T21:32:09.542 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 64, 2020-05-18T21:32:09.542 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 86, 2020-05-18T21:32:09.542 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 86, 2020-05-18T21:32:09.542 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 9.7610865669999995 2020-05-18T21:32:09.542 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:32:09.549 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 1, "id": 5756, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.8665501869999996, "mdsmap_epoch": 64, "osdmap_epoch": 86, "osdmap_epoch_barrier": 86, "uptime": 9.7610865669999995 } 2020-05-18T21:32:09.549 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:32:09.665 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:32:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:32:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:32:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 7500, 2020-05-18T21:32:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:32:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:32:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 4.9912359249999998, 2020-05-18T21:32:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 64, 2020-05-18T21:32:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 86, 2020-05-18T21:32:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 86, 2020-05-18T21:32:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 9.8925730049999991 2020-05-18T21:32:09.668 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:32:09.674 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 7500, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.9912359249999998, "mdsmap_epoch": 64, "osdmap_epoch": 86, "osdmap_epoch_barrier": 86, "uptime": 9.8925730049999991 } 2020-05-18T21:32:09.675 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36b2370700 1 Processor -- start 2020-05-18T21:32:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36b2370700 1 -- start start 2020-05-18T21:32:09.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36b2370700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f36ac144350 0x7f36ac06a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:09.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36b2370700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f36ac144730 0x7f36ac0619a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:09.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36b2370700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ac0b4dd0 con 0x7f36ac0b5670 2020-05-18T21:32:09.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36b2370700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac061260 con 0x7f36ac144350 2020-05-18T21:32:09.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36b2370700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac061500 con 0x7f36ac144730 2020-05-18T21:32:09.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36abfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f36ac144350 0x7f36ac06a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:09.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36abfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f36ac144350 0x7f36ac06a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58774/0 (socket says 172.21.15.63:58774) 2020-05-18T21:32:09.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36abfff700 1 -- 172.21.15.63:0/1921633695 learned_addr learned my addr 172.21.15.63:0/1921633695 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:09.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36a37fe700 1 --2- 172.21.15.63:0/1921633695 >> v2:172.21.15.155:3300/0 conn(0x7f36ac144730 0x7f36ac0619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:09.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36abfff700 1 -- 172.21.15.63:0/1921633695 >> v2:172.21.15.155:3300/0 conn(0x7f36ac144730 msgr2=0x7f36ac0619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:09.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36abfff700 1 --2- 172.21.15.63:0/1921633695 >> v2:172.21.15.155:3300/0 conn(0x7f36ac144730 0x7f36ac0619a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36abfff700 1 -- 172.21.15.63:0/1921633695 >> v1:172.21.15.155:6789/0 conn(0x7f36ac0b5670 legacy=0x7f36ac09c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36abfff700 1 -- 172.21.15.63:0/1921633695 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac144b90 con 0x7f36ac144350 2020-05-18T21:32:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36abfff700 1 --2- 172.21.15.63:0/1921633695 >> v2:172.21.15.63:3300/0 conn(0x7f36ac144350 0x7f36ac06a280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f369c002f70 tx=0x7f369c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36abfff700 1 --2- 172.21.15.63:0/1921633695 >> v2:172.21.15.63:3300/0 conn(0x7f36ac144350 0x7f36ac06a280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f369c002f70 tx=0x7f369c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36abfff700 1 --2- 172.21.15.63:0/1921633695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36ac144350 0x7f36ac06a280 secure :-1 s=READY pgs=1131 cs=0 l=1 rx=0x7f369c002f70 tx=0x7f369c007a80).ready entity=mon.0 client_cookie=936992e1a2b03c6f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:09.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36abfff700 1 --2- 172.21.15.63:0/1921633695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36ac144350 0x7f36ac06a280 secure :-1 s=THROTTLE_DONE pgs=1131 cs=0 l=1 rx=0x7f369c002f70 tx=0x7f369c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36abfff700 1 --2- 172.21.15.63:0/1921633695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36ac144350 0x7f36ac06a280 secure :-1 s=THROTTLE_DONE pgs=1131 cs=0 l=1 rx=0x7f369c002f70 tx=0x7f369c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36ab7fe700 1 -- 172.21.15.63:0/1921633695 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f369c011760 con 0x7f36ac144350 2020-05-18T21:32:09.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36abfff700 1 --2- 172.21.15.63:0/1921633695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36ac144350 0x7f36ac06a280 secure :-1 s=THROTTLE_DONE pgs=1131 cs=0 l=1 rx=0x7f369c002f70 tx=0x7f369c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36ab7fe700 1 -- 172.21.15.63:0/1921633695 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c0118c0 con 0x7f36ac144350 2020-05-18T21:32:09.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36ab7fe700 1 -- 172.21.15.63:0/1921633695 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f369c011ce0 con 0x7f36ac144350 2020-05-18T21:32:09.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36b2370700 1 -- 172.21.15.63:0/1921633695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36ac144350 msgr2=0x7f36ac06a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:09.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36b2370700 1 --2- 172.21.15.63:0/1921633695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36ac144350 0x7f36ac06a280 secure :-1 s=READY pgs=1131 cs=0 l=1 rx=0x7f369c002f70 tx=0x7f369c007a80).stop 2020-05-18T21:32:09.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36b2370700 1 -- 172.21.15.63:0/1921633695 shutdown_connections 2020-05-18T21:32:09.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36b2370700 1 --2- 172.21.15.63:0/1921633695 >> v2:172.21.15.155:3300/0 conn(0x7f36ac144730 0x7f36ac0619a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:09.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36b2370700 1 --2- 172.21.15.63:0/1921633695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36ac144350 0x7f36ac06a280 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:09.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36b2370700 1 -- 172.21.15.63:0/1921633695 >> 172.21.15.63:0/1921633695 conn(0x7f36ac05b240 msgr2=0x7f36ac069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:09.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36b2370700 1 -- 172.21.15.63:0/1921633695 shutdown_connections 2020-05-18T21:32:09.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.781+0000 7f36b2370700 1 -- 172.21.15.63:0/1921633695 wait complete. 2020-05-18T21:32:09.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36b2370700 1 Processor -- start 2020-05-18T21:32:09.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36b2370700 1 -- start start 2020-05-18T21:32:09.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36b2370700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f36ac0b5670 0x7f36ac0afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:09.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36b2370700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36ac144350 0x7f36ac141270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:09.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36b2370700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ac0b0b60 con 0x7f36ac144730 2020-05-18T21:32:09.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36b2370700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac0b0e00 con 0x7f36ac0b5670 2020-05-18T21:32:09.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36b2370700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac0b10a0 con 0x7f36ac144350 2020-05-18T21:32:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36abfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f36ac0b5670 0x7f36ac0afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36abfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f36ac0b5670 0x7f36ac0afc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58780/0 (socket says 172.21.15.63:58780) 2020-05-18T21:32:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36abfff700 1 -- 172.21.15.63:0/2066029511 learned_addr learned my addr 172.21.15.63:0/2066029511 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36a37fe700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36ac144350 0x7f36ac141270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36abfff700 1 -- 172.21.15.63:0/2066029511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36ac144350 msgr2=0x7f36ac141270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36abfff700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36ac144350 0x7f36ac141270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36abfff700 1 -- 172.21.15.63:0/2066029511 >> v1:172.21.15.63:6789/0 conn(0x7f36ac144730 legacy=0x7f36ac156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36abfff700 1 -- 172.21.15.63:0/2066029511 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac143f30 con 0x7f36ac0b5670 2020-05-18T21:32:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36a9ffb700 1 -- 172.21.15.63:0/2066029511 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456125499 0 0) 0x7f36ac0b0b60 con 0x7f36ac144730 2020-05-18T21:32:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36abfff700 1 --2- 172.21.15.63:0/2066029511 >> v2:172.21.15.63:3300/0 conn(0x7f36ac0b5670 0x7f36ac0afc40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f369c002f70 tx=0x7f369c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36abfff700 1 --2- 172.21.15.63:0/2066029511 >> v2:172.21.15.63:3300/0 conn(0x7f36ac0b5670 0x7f36ac0afc40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f369c002f70 tx=0x7f369c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36abfff700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36ac0b5670 0x7f36ac0afc40 secure :-1 s=READY pgs=1133 cs=0 l=1 rx=0x7f369c002f70 tx=0x7f369c007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36abfff700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36ac0b5670 0x7f36ac0afc40 secure :-1 s=THROTTLE_DONE pgs=1133 cs=0 l=1 rx=0x7f369c002f70 tx=0x7f369c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36abfff700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36ac0b5670 0x7f36ac0afc40 secure :-1 s=THROTTLE_DONE pgs=1133 cs=0 l=1 rx=0x7f369c002f70 tx=0x7f369c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36a9ffb700 1 -- 172.21.15.63:0/2066029511 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f369c010300 con 0x7f36ac0b5670 2020-05-18T21:32:09.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36abfff700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36ac0b5670 0x7f36ac0afc40 secure :-1 s=THROTTLE_DONE pgs=1133 cs=0 l=1 rx=0x7f369c002f70 tx=0x7f369c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36a9ffb700 1 -- 172.21.15.63:0/2066029511 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c007360 con 0x7f36ac0b5670 2020-05-18T21:32:09.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36a9ffb700 1 -- 172.21.15.63:0/2066029511 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f369c005700 con 0x7f36ac0b5670 2020-05-18T21:32:09.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36b2370700 1 -- 172.21.15.63:0/2066029511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ac0b1900 con 0x7f36ac0b5670 2020-05-18T21:32:09.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.785+0000 7f36b2370700 1 -- 172.21.15.63:0/2066029511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ac1573f0 con 0x7f36ac0b5670 2020-05-18T21:32:09.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.789+0000 7f36abfff700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36ac0b5670 0x7f36ac0afc40 secure :-1 s=THROTTLE_DONE pgs=1133 cs=0 l=1 rx=0x7f369c002f70 tx=0x7f369c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.789+0000 7f36a9ffb700 1 -- 172.21.15.63:0/2066029511 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f369c005970 con 0x7f36ac0b5670 2020-05-18T21:32:09.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.789+0000 7f36abfff700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36ac0b5670 0x7f36ac0afc40 secure :-1 s=THROTTLE_DONE pgs=1133 cs=0 l=1 rx=0x7f369c002f70 tx=0x7f369c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.789+0000 7f36b2370700 1 -- 172.21.15.63:0/2066029511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ac141b60 con 0x7f36ac0b5670 2020-05-18T21:32:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.789+0000 7f36a9ffb700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f369004f810 0x7f3690051cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.789+0000 7f36a9ffb700 1 -- 172.21.15.63:0/2066029511 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f369c064470 con 0x7f36ac0b5670 2020-05-18T21:32:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.789+0000 7f36a37fe700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f369004f810 0x7f3690051cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.789+0000 7f36a37fe700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f369004f810 0x7f3690051cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3694002f70 tx=0x7f3694008140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.789+0000 7f36a37fe700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f369004f810 0x7f3690051cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3694002f70 tx=0x7f3694008140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.789+0000 7f36a37fe700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f369004f810 0x7f3690051cd0 secure :-1 s=READY pgs=448 cs=0 l=1 rx=0x7f3694002f70 tx=0x7f3694008140).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.793+0000 7f36abfff700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36ac0b5670 0x7f36ac0afc40 secure :-1 s=THROTTLE_DONE pgs=1133 cs=0 l=1 rx=0x7f369c002f70 tx=0x7f369c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.793+0000 7f36a9ffb700 1 -- 172.21.15.63:0/2066029511 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f369c042350 con 0x7f36ac0b5670 2020-05-18T21:32:09.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.941+0000 7f36b2370700 1 -- 172.21.15.63:0/2066029511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36ac0569e0 con 0x7f36ac0b5670 2020-05-18T21:32:09.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.941+0000 7f36abfff700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36ac0b5670 0x7f36ac0afc40 secure :-1 s=THROTTLE_DONE pgs=1133 cs=0 l=1 rx=0x7f369c002f70 tx=0x7f369c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:09.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.941+0000 7f36a9ffb700 1 -- 172.21.15.63:0/2066029511 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+2156 (secure 0 0 0) 0x7f369c041f40 con 0x7f36ac0b5670 2020-05-18T21:32:09.947 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:09.948 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":64,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:08.692459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:09.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.945+0000 7f36b2370700 1 -- 172.21.15.63:0/2066029511 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f369004f810 msgr2=0x7f3690051cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:09.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.945+0000 7f36b2370700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f369004f810 0x7f3690051cd0 secure :-1 s=READY pgs=448 cs=0 l=1 rx=0x7f3694002f70 tx=0x7f3694008140).stop 2020-05-18T21:32:09.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.945+0000 7f36b2370700 1 -- 172.21.15.63:0/2066029511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36ac0b5670 msgr2=0x7f36ac0afc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:09.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.945+0000 7f36b2370700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36ac0b5670 0x7f36ac0afc40 secure :-1 s=READY pgs=1133 cs=0 l=1 rx=0x7f369c002f70 tx=0x7f369c007a80).stop 2020-05-18T21:32:09.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.945+0000 7f36b2370700 1 -- 172.21.15.63:0/2066029511 shutdown_connections 2020-05-18T21:32:09.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.945+0000 7f36b2370700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f369004f810 0x7f3690051cd0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:09.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.945+0000 7f36b2370700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36ac144350 0x7f36ac141270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:09.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.945+0000 7f36b2370700 1 --2- 172.21.15.63:0/2066029511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36ac0b5670 0x7f36ac0afc40 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:09.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.945+0000 7f36b2370700 1 -- 172.21.15.63:0/2066029511 >> 172.21.15.63:0/2066029511 conn(0x7f36ac05b240 msgr2=0x7f36ac14de30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:09.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.945+0000 7f36b2370700 1 -- 172.21.15.63:0/2066029511 shutdown_connections 2020-05-18T21:32:09.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:09.945+0000 7f36b2370700 1 -- 172.21.15.63:0/2066029511 wait complete. 2020-05-18T21:32:09.951 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 64 2020-05-18T21:32:09.960 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:32:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f648e3c0700 1 Processor -- start 2020-05-18T21:32:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f648e3c0700 1 -- start start 2020-05-18T21:32:10.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f648e3c0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f64880b2860 0x7f64880615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:10.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f648e3c0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f648814e570 0x7f648814a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:10.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f648e3c0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648814d960 con 0x7f6488060b90 2020-05-18T21:32:10.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f648e3c0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6488066210 con 0x7f64880b2860 2020-05-18T21:32:10.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f648e3c0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648814db90 con 0x7f648814e570 2020-05-18T21:32:10.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f64877fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f64880b2860 0x7f64880615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f6487fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6488060b90 0x7f6488144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60978/0 (socket says 172.21.15.63:60978) 2020-05-18T21:32:10.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f6487fff700 1 -- 172.21.15.63:0/4060005851 learned_addr learned my addr 172.21.15.63:0/4060005851 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:10.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f648c95d700 1 --2- 172.21.15.63:0/4060005851 >> v2:172.21.15.155:3300/0 conn(0x7f648814e570 0x7f648814a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f6486ffd700 1 -- 172.21.15.63:0/4060005851 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772634420 0 0) 0x7f648814d960 con 0x7f6488060b90 2020-05-18T21:32:10.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f6486ffd700 1 -- 172.21.15.63:0/4060005851 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6468003270 con 0x7f6488060b90 2020-05-18T21:32:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f64877fe700 1 -- 172.21.15.63:0/4060005851 >> v2:172.21.15.155:3300/0 conn(0x7f648814e570 msgr2=0x7f648814a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f64877fe700 1 --2- 172.21.15.63:0/4060005851 >> v2:172.21.15.155:3300/0 conn(0x7f648814e570 0x7f648814a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f64877fe700 1 -- 172.21.15.63:0/4060005851 >> v1:172.21.15.63:6789/0 conn(0x7f6488060b90 legacy=0x7f6488144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f64877fe700 1 -- 172.21.15.63:0/4060005851 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648814de30 con 0x7f64880b2860 2020-05-18T21:32:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f64877fe700 1 --2- 172.21.15.63:0/4060005851 >> v2:172.21.15.63:3300/0 conn(0x7f64880b2860 0x7f64880615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f64800032f0 tx=0x7f6480007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f64877fe700 1 --2- 172.21.15.63:0/4060005851 >> v2:172.21.15.63:3300/0 conn(0x7f64880b2860 0x7f64880615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f64800032f0 tx=0x7f6480007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f64877fe700 1 --2- 172.21.15.63:0/4060005851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64880b2860 0x7f64880615e0 secure :-1 s=READY pgs=1135 cs=0 l=1 rx=0x7f64800032f0 tx=0x7f6480007e00).ready entity=mon.0 client_cookie=54c997312aa524bb server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f64877fe700 1 --2- 172.21.15.63:0/4060005851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64880b2860 0x7f64880615e0 secure :-1 s=THROTTLE_DONE pgs=1135 cs=0 l=1 rx=0x7f64800032f0 tx=0x7f6480007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f6486ffd700 1 -- 172.21.15.63:0/4060005851 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6480011db0 con 0x7f64880b2860 2020-05-18T21:32:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f64877fe700 1 --2- 172.21.15.63:0/4060005851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64880b2860 0x7f64880615e0 secure :-1 s=THROTTLE_DONE pgs=1135 cs=0 l=1 rx=0x7f64800032f0 tx=0x7f6480007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f64877fe700 1 --2- 172.21.15.63:0/4060005851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64880b2860 0x7f64880615e0 secure :-1 s=THROTTLE_DONE pgs=1135 cs=0 l=1 rx=0x7f64800032f0 tx=0x7f6480007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f6486ffd700 1 -- 172.21.15.63:0/4060005851 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648000a180 con 0x7f64880b2860 2020-05-18T21:32:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f6486ffd700 1 -- 172.21.15.63:0/4060005851 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f648000a5a0 con 0x7f64880b2860 2020-05-18T21:32:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f648e3c0700 1 -- 172.21.15.63:0/4060005851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64880b2860 msgr2=0x7f64880615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.061+0000 7f648e3c0700 1 --2- 172.21.15.63:0/4060005851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64880b2860 0x7f64880615e0 secure :-1 s=READY pgs=1135 cs=0 l=1 rx=0x7f64800032f0 tx=0x7f6480007e00).stop 2020-05-18T21:32:10.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.065+0000 7f648e3c0700 1 -- 172.21.15.63:0/4060005851 shutdown_connections 2020-05-18T21:32:10.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.065+0000 7f648e3c0700 1 --2- 172.21.15.63:0/4060005851 >> v2:172.21.15.155:3300/0 conn(0x7f648814e570 0x7f648814a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:10.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.065+0000 7f648e3c0700 1 --2- 172.21.15.63:0/4060005851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64880b2860 0x7f64880615e0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:10.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.065+0000 7f648e3c0700 1 -- 172.21.15.63:0/4060005851 >> 172.21.15.63:0/4060005851 conn(0x7f64880b83d0 msgr2=0x7f64880b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:10.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.065+0000 7f648e3c0700 1 -- 172.21.15.63:0/4060005851 shutdown_connections 2020-05-18T21:32:10.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.065+0000 7f648e3c0700 1 -- 172.21.15.63:0/4060005851 wait complete. 2020-05-18T21:32:10.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.065+0000 7f648e3c0700 1 Processor -- start 2020-05-18T21:32:10.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.065+0000 7f648e3c0700 1 -- start start 2020-05-18T21:32:10.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.065+0000 7f648e3c0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6488060b90 0x7f648815b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:10.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.065+0000 7f648e3c0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f64880b2860 0x7f64880b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:10.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.065+0000 7f648e3c0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6488157ba0 con 0x7f648814e570 2020-05-18T21:32:10.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.065+0000 7f648e3c0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6488157e40 con 0x7f64880b2860 2020-05-18T21:32:10.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.065+0000 7f648e3c0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64881580e0 con 0x7f6488060b90 2020-05-18T21:32:10.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.065+0000 7f64877fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f64880b2860 0x7f64880b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.065+0000 7f648c95d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f648814e570 0x7f6488145e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:60986/0 (socket says 172.21.15.63:60986) 2020-05-18T21:32:10.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.065+0000 7f64877fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f64880b2860 0x7f64880b4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58796/0 (socket says 172.21.15.63:58796) 2020-05-18T21:32:10.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.065+0000 7f648c95d700 1 -- 172.21.15.63:0/3966223042 learned_addr learned my addr 172.21.15.63:0/3966223042 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:10.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.065+0000 7f6487fff700 1 --2- 172.21.15.63:0/3966223042 >> v2:172.21.15.155:3300/0 conn(0x7f6488060b90 0x7f648815b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f64877fe700 1 -- 172.21.15.63:0/3966223042 >> v2:172.21.15.155:3300/0 conn(0x7f6488060b90 msgr2=0x7f648815b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f64857fa700 1 -- 172.21.15.63:0/3966223042 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744541108 0 0) 0x7f6488157ba0 con 0x7f648814e570 2020-05-18T21:32:10.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f64877fe700 1 --2- 172.21.15.63:0/3966223042 >> v2:172.21.15.155:3300/0 conn(0x7f6488060b90 0x7f648815b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:10.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f64877fe700 1 -- 172.21.15.63:0/3966223042 >> v1:172.21.15.63:6789/0 conn(0x7f648814e570 legacy=0x7f6488145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f64877fe700 1 -- 172.21.15.63:0/3966223042 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6488146590 con 0x7f64880b2860 2020-05-18T21:32:10.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f64877fe700 1 --2- 172.21.15.63:0/3966223042 >> v2:172.21.15.63:3300/0 conn(0x7f64880b2860 0x7f64880b4ba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f64800032f0 tx=0x7f6480007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f64877fe700 1 --2- 172.21.15.63:0/3966223042 >> v2:172.21.15.63:3300/0 conn(0x7f64880b2860 0x7f64880b4ba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f64800032f0 tx=0x7f6480007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f64877fe700 1 --2- 172.21.15.63:0/3966223042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64880b2860 0x7f64880b4ba0 secure :-1 s=READY pgs=1137 cs=0 l=1 rx=0x7f64800032f0 tx=0x7f6480007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:10.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f64877fe700 1 --2- 172.21.15.63:0/3966223042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64880b2860 0x7f64880b4ba0 secure :-1 s=THROTTLE_DONE pgs=1137 cs=0 l=1 rx=0x7f64800032f0 tx=0x7f6480007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f64877fe700 1 --2- 172.21.15.63:0/3966223042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64880b2860 0x7f64880b4ba0 secure :-1 s=THROTTLE_DONE pgs=1137 cs=0 l=1 rx=0x7f64800032f0 tx=0x7f6480007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f64857fa700 1 -- 172.21.15.63:0/3966223042 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6480008af0 con 0x7f64880b2860 2020-05-18T21:32:10.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f64877fe700 1 --2- 172.21.15.63:0/3966223042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64880b2860 0x7f64880b4ba0 secure :-1 s=THROTTLE_DONE pgs=1137 cs=0 l=1 rx=0x7f64800032f0 tx=0x7f6480007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f64857fa700 1 -- 172.21.15.63:0/3966223042 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6480011e90 con 0x7f64880b2860 2020-05-18T21:32:10.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f64857fa700 1 -- 172.21.15.63:0/3966223042 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f648000ae80 con 0x7f64880b2860 2020-05-18T21:32:10.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f648e3c0700 1 -- 172.21.15.63:0/3966223042 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64881492d0 con 0x7f64880b2860 2020-05-18T21:32:10.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f648e3c0700 1 -- 172.21.15.63:0/3966223042 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64880b5000 con 0x7f64880b2860 2020-05-18T21:32:10.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f64877fe700 1 --2- 172.21.15.63:0/3966223042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64880b2860 0x7f64880b4ba0 secure :-1 s=THROTTLE_DONE pgs=1137 cs=0 l=1 rx=0x7f64800032f0 tx=0x7f6480007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f648e3c0700 1 -- 172.21.15.63:0/3966223042 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64881579a0 con 0x7f64880b2860 2020-05-18T21:32:10.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f64857fa700 1 -- 172.21.15.63:0/3966223042 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f648000f5b0 con 0x7f64880b2860 2020-05-18T21:32:10.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.069+0000 7f64877fe700 1 --2- 172.21.15.63:0/3966223042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64880b2860 0x7f64880b4ba0 secure :-1 s=THROTTLE_DONE pgs=1137 cs=0 l=1 rx=0x7f64800032f0 tx=0x7f6480007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.073+0000 7f64857fa700 1 --2- 172.21.15.63:0/3966223042 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f646c04f7f0 0x7f646c051cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:10.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.073+0000 7f64857fa700 1 -- 172.21.15.63:0/3966223042 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f6480064990 con 0x7f64880b2860 2020-05-18T21:32:10.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.073+0000 7f6487fff700 1 --2- 172.21.15.63:0/3966223042 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f646c04f7f0 0x7f646c051cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.073+0000 7f6487fff700 1 --2- 172.21.15.63:0/3966223042 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f646c04f7f0 0x7f646c051cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6470001110 tx=0x7f6470001d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.073+0000 7f6487fff700 1 --2- 172.21.15.63:0/3966223042 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f646c04f7f0 0x7f646c051cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6470001110 tx=0x7f6470001d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.073+0000 7f6487fff700 1 --2- 172.21.15.63:0/3966223042 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f646c04f7f0 0x7f646c051cb0 secure :-1 s=READY pgs=449 cs=0 l=1 rx=0x7f6470001110 tx=0x7f6470001d80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:10.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.077+0000 7f64877fe700 1 --2- 172.21.15.63:0/3966223042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64880b2860 0x7f64880b4ba0 secure :-1 s=THROTTLE_DONE pgs=1137 cs=0 l=1 rx=0x7f64800032f0 tx=0x7f6480007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.077+0000 7f64857fa700 1 -- 172.21.15.63:0/3966223042 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f648003ee40 con 0x7f64880b2860 2020-05-18T21:32:10.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.193+0000 7f648e3c0700 1 -- 172.21.15.63:0/3966223042 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64880569e0 con 0x7f64880b2860 2020-05-18T21:32:10.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.193+0000 7f64877fe700 1 --2- 172.21.15.63:0/3966223042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64880b2860 0x7f64880b4ba0 secure :-1 s=THROTTLE_DONE pgs=1137 cs=0 l=1 rx=0x7f64800032f0 tx=0x7f6480007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.193+0000 7f64857fa700 1 -- 172.21.15.63:0/3966223042 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16349 (secure 0 0 0) 0x7f6480005e60 con 0x7f64880b2860 2020-05-18T21:32:10.199 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:10.200 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":86,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:31:58.828986+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:31:28.631738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2020-05-18T21:31:29.243969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.63:6832/249786226":"2020-05-19T21:31:58.828935+0000","172.21.15.155:6835/578144386":"2020-05-19T21:31:58.811250+0000","172.21.15.63:6833/249786226":"2020-05-19T21:31:58.828935+0000","172.21.15.155:6834/578144386":"2020-05-19T21:31:58.811250+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:32:10.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.197+0000 7f648e3c0700 1 -- 172.21.15.63:0/3966223042 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f646c04f7f0 msgr2=0x7f646c051cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.197+0000 7f648e3c0700 1 --2- 172.21.15.63:0/3966223042 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f646c04f7f0 0x7f646c051cb0 secure :-1 s=READY pgs=449 cs=0 l=1 rx=0x7f6470001110 tx=0x7f6470001d80).stop 2020-05-18T21:32:10.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.197+0000 7f648e3c0700 1 -- 172.21.15.63:0/3966223042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64880b2860 msgr2=0x7f64880b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.197+0000 7f648e3c0700 1 --2- 172.21.15.63:0/3966223042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64880b2860 0x7f64880b4ba0 secure :-1 s=READY pgs=1137 cs=0 l=1 rx=0x7f64800032f0 tx=0x7f6480007e00).stop 2020-05-18T21:32:10.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.197+0000 7f648e3c0700 1 -- 172.21.15.63:0/3966223042 shutdown_connections 2020-05-18T21:32:10.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.197+0000 7f648e3c0700 1 --2- 172.21.15.63:0/3966223042 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f646c04f7f0 0x7f646c051cb0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:10.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.197+0000 7f648e3c0700 1 --2- 172.21.15.63:0/3966223042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64880b2860 0x7f64880b4ba0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:10.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.197+0000 7f648e3c0700 1 --2- 172.21.15.63:0/3966223042 >> v2:172.21.15.155:3300/0 conn(0x7f6488060b90 0x7f648815b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:10.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.197+0000 7f648e3c0700 1 -- 172.21.15.63:0/3966223042 >> 172.21.15.63:0/3966223042 conn(0x7f64880b83d0 msgr2=0x7f64881476a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:10.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.197+0000 7f648e3c0700 1 -- 172.21.15.63:0/3966223042 shutdown_connections 2020-05-18T21:32:10.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.197+0000 7f648e3c0700 1 -- 172.21.15.63:0/3966223042 wait complete. 2020-05-18T21:32:10.212 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:31:28.631738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:31:29.243969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:32:10.213 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:32:10.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.317+0000 7f0b75198700 1 Processor -- start 2020-05-18T21:32:10.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.317+0000 7f0b75198700 1 -- start start 2020-05-18T21:32:10.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b75198700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b68031300 0x7f0b680316e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:10.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b75198700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0b68049e80 0x7f0b68006200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:10.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b75198700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6804a2d0 con 0x7f0b680d89e0 2020-05-18T21:32:10.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b75198700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b680d9a00 con 0x7f0b68049e80 2020-05-18T21:32:10.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b75198700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680d8e20 con 0x7f0b68031300 2020-05-18T21:32:10.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b6ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b68031300 0x7f0b680316e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b74997700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0b68049e80 0x7f0b68006200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b6f7fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f0b680d89e0 0x7f0b680d26c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:59308/0 (socket says 172.21.15.63:59308) 2020-05-18T21:32:10.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b74997700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0b68049e80 0x7f0b68006200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:45422/0 (socket says 172.21.15.63:45422) 2020-05-18T21:32:10.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b6f7fe700 1 -- 172.21.15.63:0/2985114455 learned_addr learned my addr 172.21.15.63:0/2985114455 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:10.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b6ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b68031300 0x7f0b680316e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:49504/0 (socket says 172.21.15.63:49504) 2020-05-18T21:32:10.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b74997700 1 -- 172.21.15.63:0/2985114455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b68031300 msgr2=0x7f0b680316e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:10.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b74997700 1 --2- 172.21.15.63:0/2985114455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b68031300 0x7f0b680316e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:10.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b74997700 1 -- 172.21.15.63:0/2985114455 >> v1:172.21.15.155:6789/0 conn(0x7f0b680d89e0 legacy=0x7f0b680d26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b74997700 1 -- 172.21.15.63:0/2985114455 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b68005820 con 0x7f0b68049e80 2020-05-18T21:32:10.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b74997700 1 --2- 172.21.15.63:0/2985114455 >> v2:172.21.15.155:3300/0 conn(0x7f0b68049e80 0x7f0b68006200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0b70067fa0 tx=0x7f0b7005d220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b74997700 1 --2- 172.21.15.63:0/2985114455 >> v2:172.21.15.155:3300/0 conn(0x7f0b68049e80 0x7f0b68006200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0b70067fa0 tx=0x7f0b7005d220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b74997700 1 --2- 172.21.15.63:0/2985114455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b68049e80 0x7f0b68006200 secure :-1 s=READY pgs=775 cs=0 l=1 rx=0x7f0b70067fa0 tx=0x7f0b7005d220).ready entity=mon.1 client_cookie=4263e2644dbaee4 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:10.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b74997700 1 --2- 172.21.15.63:0/2985114455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b68049e80 0x7f0b68006200 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7f0b70067fa0 tx=0x7f0b7005d220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b6effd700 1 -- 172.21.15.63:0/2985114455 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b7006acf0 con 0x7f0b68049e80 2020-05-18T21:32:10.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b74997700 1 --2- 172.21.15.63:0/2985114455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b68049e80 0x7f0b68006200 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7f0b70067fa0 tx=0x7f0b7005d220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b74997700 1 --2- 172.21.15.63:0/2985114455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b68049e80 0x7f0b68006200 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7f0b70067fa0 tx=0x7f0b7005d220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b6effd700 1 -- 172.21.15.63:0/2985114455 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b700691e0 con 0x7f0b68049e80 2020-05-18T21:32:10.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b6effd700 1 -- 172.21.15.63:0/2985114455 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b7005e970 con 0x7f0b68049e80 2020-05-18T21:32:10.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b75198700 1 -- 172.21.15.63:0/2985114455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b68049e80 msgr2=0x7f0b68006200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b75198700 1 --2- 172.21.15.63:0/2985114455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b68049e80 0x7f0b68006200 secure :-1 s=READY pgs=775 cs=0 l=1 rx=0x7f0b70067fa0 tx=0x7f0b7005d220).stop 2020-05-18T21:32:10.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b75198700 1 -- 172.21.15.63:0/2985114455 shutdown_connections 2020-05-18T21:32:10.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b75198700 1 --2- 172.21.15.63:0/2985114455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b68049e80 0x7f0b68006200 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:10.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b75198700 1 --2- 172.21.15.63:0/2985114455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b68031300 0x7f0b680316e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:10.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b75198700 1 -- 172.21.15.63:0/2985114455 >> 172.21.15.63:0/2985114455 conn(0x7f0b6804f000 msgr2=0x7f0b6804f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:10.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b75198700 1 -- 172.21.15.63:0/2985114455 shutdown_connections 2020-05-18T21:32:10.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.321+0000 7f0b75198700 1 -- 172.21.15.63:0/2985114455 wait complete. 2020-05-18T21:32:10.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.325+0000 7f0b75198700 1 Processor -- start 2020-05-18T21:32:10.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.325+0000 7f0b75198700 1 -- start start 2020-05-18T21:32:10.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.325+0000 7f0b75198700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0b68049e80 0x7f0b68030340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:10.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.325+0000 7f0b75198700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b680307a0 con 0x7f0b680d89e0 2020-05-18T21:32:10.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.325+0000 7f0b75198700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b680d3740 con 0x7f0b68031300 2020-05-18T21:32:10.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.325+0000 7f0b75198700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b680462f0 con 0x7f0b68049e80 2020-05-18T21:32:10.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b74997700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0b680d89e0 0x7f0b680c8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32768/0 (socket says 172.21.15.63:32768) 2020-05-18T21:32:10.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b74997700 1 -- 172.21.15.63:0/1056695434 learned_addr learned my addr 172.21.15.63:0/1056695434 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:10.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b6f7fe700 1 --2- 172.21.15.63:0/1056695434 >> v2:172.21.15.155:3300/0 conn(0x7f0b68049e80 0x7f0b68030340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b6d7fa700 1 -- 172.21.15.63:0/1056695434 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731274388 0 0) 0x7f0b680307a0 con 0x7f0b680d89e0 2020-05-18T21:32:10.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b6d7fa700 1 -- 172.21.15.63:0/1056695434 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b58002fe0 con 0x7f0b680d89e0 2020-05-18T21:32:10.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b6d7fa700 1 -- 172.21.15.63:0/1056695434 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424889584 0 0) 0x7f0b680d3740 con 0x7f0b68031300 2020-05-18T21:32:10.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b6d7fa700 1 -- 172.21.15.63:0/1056695434 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b680307a0 con 0x7f0b68031300 2020-05-18T21:32:10.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b6d7fa700 1 -- 172.21.15.63:0/1056695434 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 607038486 0 0) 0x7f0b58002fe0 con 0x7f0b680d89e0 2020-05-18T21:32:10.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b6f7fe700 1 -- 172.21.15.63:0/1056695434 >> v1:172.21.15.155:6789/0 conn(0x7f0b68031300 legacy=0x7f0b680d2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b6f7fe700 1 -- 172.21.15.63:0/1056695434 >> v1:172.21.15.63:6789/0 conn(0x7f0b680d89e0 legacy=0x7f0b680c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b6f7fe700 1 -- 172.21.15.63:0/1056695434 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b680d39e0 con 0x7f0b68049e80 2020-05-18T21:32:10.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b6f7fe700 1 --2- 172.21.15.63:0/1056695434 >> v2:172.21.15.155:3300/0 conn(0x7f0b68049e80 0x7f0b68030340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0b680e6350 tx=0x7f0b5c0108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b6f7fe700 1 --2- 172.21.15.63:0/1056695434 >> v2:172.21.15.155:3300/0 conn(0x7f0b68049e80 0x7f0b68030340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0b680e6350 tx=0x7f0b5c0108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b6f7fe700 1 --2- 172.21.15.63:0/1056695434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b68049e80 0x7f0b68030340 secure :-1 s=READY pgs=777 cs=0 l=1 rx=0x7f0b680e6350 tx=0x7f0b5c0108d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:10.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b6f7fe700 1 --2- 172.21.15.63:0/1056695434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b68049e80 0x7f0b68030340 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f0b680e6350 tx=0x7f0b5c0108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b6d7fa700 1 -- 172.21.15.63:0/1056695434 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b7006acf0 con 0x7f0b68049e80 2020-05-18T21:32:10.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b6f7fe700 1 --2- 172.21.15.63:0/1056695434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b68049e80 0x7f0b68030340 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f0b680e6350 tx=0x7f0b5c0108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b6d7fa700 1 -- 172.21.15.63:0/1056695434 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c005af0 con 0x7f0b68049e80 2020-05-18T21:32:10.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b75198700 1 -- 172.21.15.63:0/1056695434 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b680d3fa0 con 0x7f0b68049e80 2020-05-18T21:32:10.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b6f7fe700 1 --2- 172.21.15.63:0/1056695434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b68049e80 0x7f0b68030340 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f0b680e6350 tx=0x7f0b5c0108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b6d7fa700 1 -- 172.21.15.63:0/1056695434 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b5c0060d0 con 0x7f0b68049e80 2020-05-18T21:32:10.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b75198700 1 -- 172.21.15.63:0/1056695434 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b68047890 con 0x7f0b68049e80 2020-05-18T21:32:10.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b6f7fe700 1 --2- 172.21.15.63:0/1056695434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b68049e80 0x7f0b68030340 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f0b680e6350 tx=0x7f0b5c0108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.329+0000 7f0b75198700 1 -- 172.21.15.63:0/1056695434 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b68004d80 con 0x7f0b68049e80 2020-05-18T21:32:10.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.333+0000 7f0b6d7fa700 1 -- 172.21.15.63:0/1056695434 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0b5c00a360 con 0x7f0b68049e80 2020-05-18T21:32:10.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.333+0000 7f0b6f7fe700 1 --2- 172.21.15.63:0/1056695434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b68049e80 0x7f0b68030340 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f0b680e6350 tx=0x7f0b5c0108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.333+0000 7f0b6d7fa700 1 --2- 172.21.15.63:0/1056695434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0b5804fe70 0x7f0b58052330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:10.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.333+0000 7f0b6d7fa700 1 -- 172.21.15.63:0/1056695434 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f0b5c0090c0 con 0x7f0b68049e80 2020-05-18T21:32:10.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.333+0000 7f0b6ffff700 1 --2- 172.21.15.63:0/1056695434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0b5804fe70 0x7f0b58052330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.333+0000 7f0b6ffff700 1 --2- 172.21.15.63:0/1056695434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0b5804fe70 0x7f0b58052330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0b64002f30 tx=0x7f0b640090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.333+0000 7f0b6ffff700 1 --2- 172.21.15.63:0/1056695434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0b5804fe70 0x7f0b58052330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0b64002f30 tx=0x7f0b640090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.333+0000 7f0b6ffff700 1 --2- 172.21.15.63:0/1056695434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0b5804fe70 0x7f0b58052330 secure :-1 s=READY pgs=450 cs=0 l=1 rx=0x7f0b64002f30 tx=0x7f0b640090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:10.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.341+0000 7f0b6f7fe700 1 --2- 172.21.15.63:0/1056695434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b68049e80 0x7f0b68030340 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f0b680e6350 tx=0x7f0b5c0108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.341+0000 7f0b6d7fa700 1 -- 172.21.15.63:0/1056695434 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f0b5c03dae0 con 0x7f0b68049e80 2020-05-18T21:32:10.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.457+0000 7f0b75198700 1 -- 172.21.15.63:0/1056695434 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0b68008b60 con 0x7f0b68049e80 2020-05-18T21:32:10.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.457+0000 7f0b6f7fe700 1 --2- 172.21.15.63:0/1056695434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b68049e80 0x7f0b68030340 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f0b680e6350 tx=0x7f0b5c0108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.457+0000 7f0b6d7fa700 1 -- 172.21.15.63:0/1056695434 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v86) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0b5c041100 con 0x7f0b68049e80 2020-05-18T21:32:10.462 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:32:10.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.457+0000 7f0b75198700 1 -- 172.21.15.63:0/1056695434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0b5804fe70 msgr2=0x7f0b58052330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.457+0000 7f0b75198700 1 --2- 172.21.15.63:0/1056695434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0b5804fe70 0x7f0b58052330 secure :-1 s=READY pgs=450 cs=0 l=1 rx=0x7f0b64002f30 tx=0x7f0b640090f0).stop 2020-05-18T21:32:10.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.457+0000 7f0b75198700 1 -- 172.21.15.63:0/1056695434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b68049e80 msgr2=0x7f0b68030340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.457+0000 7f0b75198700 1 --2- 172.21.15.63:0/1056695434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b68049e80 0x7f0b68030340 secure :-1 s=READY pgs=777 cs=0 l=1 rx=0x7f0b680e6350 tx=0x7f0b5c0108d0).stop 2020-05-18T21:32:10.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.461+0000 7f0b75198700 1 -- 172.21.15.63:0/1056695434 shutdown_connections 2020-05-18T21:32:10.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.461+0000 7f0b75198700 1 --2- 172.21.15.63:0/1056695434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0b5804fe70 0x7f0b58052330 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:10.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.461+0000 7f0b75198700 1 --2- 172.21.15.63:0/1056695434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b68049e80 0x7f0b68030340 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:10.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.461+0000 7f0b75198700 1 -- 172.21.15.63:0/1056695434 >> 172.21.15.63:0/1056695434 conn(0x7f0b6804f000 msgr2=0x7f0b680d5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:10.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.461+0000 7f0b75198700 1 -- 172.21.15.63:0/1056695434 shutdown_connections 2020-05-18T21:32:10.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.461+0000 7f0b75198700 1 -- 172.21.15.63:0/1056695434 wait complete. 2020-05-18T21:32:10.474 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:32:10.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.581+0000 7f238fb9f700 1 Processor -- start 2020-05-18T21:32:10.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.581+0000 7f238fb9f700 1 -- start start 2020-05-18T21:32:10.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.581+0000 7f238fb9f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23880b61d0 0x7f23880af600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:10.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.581+0000 7f238fb9f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23881499b0 con 0x7f2388149510 2020-05-18T21:32:10.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.581+0000 7f238fb9f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2388149c50 con 0x7f2388065df0 2020-05-18T21:32:10.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.581+0000 7f238fb9f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23880ae290 con 0x7f23880b61d0 2020-05-18T21:32:10.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238d13a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2388149510 0x7f23880656e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32774/0 (socket says 172.21.15.63:32774) 2020-05-18T21:32:10.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238d13a700 1 -- 172.21.15.63:0/1871344686 learned_addr learned my addr 172.21.15.63:0/1871344686 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:10.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238d93b700 1 --2- 172.21.15.63:0/1871344686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23880b61d0 0x7f23880af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238c939700 1 -- 172.21.15.63:0/1871344686 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668274424 0 0) 0x7f23881499b0 con 0x7f2388149510 2020-05-18T21:32:10.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238c939700 1 -- 172.21.15.63:0/1871344686 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2370003270 con 0x7f2388149510 2020-05-18T21:32:10.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238c939700 1 -- 172.21.15.63:0/1871344686 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452078437 0 0) 0x7f2388149c50 con 0x7f2388065df0 2020-05-18T21:32:10.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238c939700 1 -- 172.21.15.63:0/1871344686 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23881499b0 con 0x7f2388065df0 2020-05-18T21:32:10.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238d93b700 1 -- 172.21.15.63:0/1871344686 >> v1:172.21.15.155:6789/0 conn(0x7f2388065df0 legacy=0x7f23881464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238c939700 1 -- 172.21.15.63:0/1871344686 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 298420128 0 0) 0x7f2370003270 con 0x7f2388149510 2020-05-18T21:32:10.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238d93b700 1 -- 172.21.15.63:0/1871344686 >> v1:172.21.15.63:6789/0 conn(0x7f2388149510 legacy=0x7f23880656e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238d93b700 1 -- 172.21.15.63:0/1871344686 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2388149ef0 con 0x7f23880b61d0 2020-05-18T21:32:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238d93b700 1 --2- 172.21.15.63:0/1871344686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23880b61d0 0x7f23880af600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f237c001110 tx=0x7f2384008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238d93b700 1 --2- 172.21.15.63:0/1871344686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23880b61d0 0x7f23880af600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f237c001110 tx=0x7f2384008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238d93b700 1 --2- 172.21.15.63:0/1871344686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23880b61d0 0x7f23880af600 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7f237c001110 tx=0x7f2384008920).ready entity=mon.2 client_cookie=1c259548de41e0a0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238d93b700 1 --2- 172.21.15.63:0/1871344686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23880b61d0 0x7f23880af600 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f237c001110 tx=0x7f2384008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238c939700 1 -- 172.21.15.63:0/1871344686 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f237c001730 con 0x7f23880b61d0 2020-05-18T21:32:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238d93b700 1 --2- 172.21.15.63:0/1871344686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23880b61d0 0x7f23880af600 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f237c001110 tx=0x7f2384008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238c939700 1 -- 172.21.15.63:0/1871344686 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2384008e80 con 0x7f23880b61d0 2020-05-18T21:32:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238d93b700 1 --2- 172.21.15.63:0/1871344686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23880b61d0 0x7f23880af600 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f237c001110 tx=0x7f2384008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238fb9f700 1 -- 172.21.15.63:0/1871344686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23880b61d0 msgr2=0x7f23880af600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238c939700 1 -- 172.21.15.63:0/1871344686 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2384011440 con 0x7f23880b61d0 2020-05-18T21:32:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238fb9f700 1 --2- 172.21.15.63:0/1871344686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23880b61d0 0x7f23880af600 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7f237c001110 tx=0x7f2384008920).stop 2020-05-18T21:32:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238fb9f700 1 -- 172.21.15.63:0/1871344686 shutdown_connections 2020-05-18T21:32:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238fb9f700 1 --2- 172.21.15.63:0/1871344686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23880b61d0 0x7f23880af600 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238fb9f700 1 -- 172.21.15.63:0/1871344686 >> 172.21.15.63:0/1871344686 conn(0x7f23880b9770 msgr2=0x7f23880b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238fb9f700 1 -- 172.21.15.63:0/1871344686 shutdown_connections 2020-05-18T21:32:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.585+0000 7f238fb9f700 1 -- 172.21.15.63:0/1871344686 wait complete. 2020-05-18T21:32:10.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238fb9f700 1 Processor -- start 2020-05-18T21:32:10.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238fb9f700 1 -- start start 2020-05-18T21:32:10.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238fb9f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2388065df0 0x7f2388148620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:10.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238fb9f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2388149510 0x7f2388147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:10.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238fb9f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238809db30 con 0x7f23880b61d0 2020-05-18T21:32:10.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238fb9f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23881492b0 con 0x7f2388149510 2020-05-18T21:32:10.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238fb9f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2388147f20 con 0x7f2388065df0 2020-05-18T21:32:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238d13a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f23880b61d0 0x7f238809e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32780/0 (socket says 172.21.15.63:32780) 2020-05-18T21:32:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238d13a700 1 -- 172.21.15.63:0/147990525 learned_addr learned my addr 172.21.15.63:0/147990525 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238d93b700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2388065df0 0x7f2388148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238e13c700 1 --2- 172.21.15.63:0/147990525 >> v2:172.21.15.155:3300/0 conn(0x7f2388149510 0x7f2388147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f237affd700 1 -- 172.21.15.63:0/147990525 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693257640 0 0) 0x7f238809db30 con 0x7f23880b61d0 2020-05-18T21:32:10.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f237affd700 1 -- 172.21.15.63:0/147990525 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2368002fe0 con 0x7f23880b61d0 2020-05-18T21:32:10.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f237affd700 1 -- 172.21.15.63:0/147990525 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 641911312 0 0) 0x7f2368002fe0 con 0x7f23880b61d0 2020-05-18T21:32:10.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238e13c700 1 -- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2388065df0 msgr2=0x7f2388148620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238e13c700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2388065df0 0x7f2388148620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:10.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238e13c700 1 -- 172.21.15.63:0/147990525 >> v1:172.21.15.63:6789/0 conn(0x7f23880b61d0 legacy=0x7f238809e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238e13c700 1 -- 172.21.15.63:0/147990525 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238809dd90 con 0x7f2388149510 2020-05-18T21:32:10.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238e13c700 1 --2- 172.21.15.63:0/147990525 >> v2:172.21.15.155:3300/0 conn(0x7f2388149510 0x7f2388147ac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f237c0017b0 tx=0x7f2380010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238d93b700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2388065df0 0x7f2388148620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:10.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238e13c700 1 --2- 172.21.15.63:0/147990525 >> v2:172.21.15.155:3300/0 conn(0x7f2388149510 0x7f2388147ac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f237c0017b0 tx=0x7f2380010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238e13c700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2388149510 0x7f2388147ac0 secure :-1 s=READY pgs=779 cs=0 l=1 rx=0x7f237c0017b0 tx=0x7f2380010ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:10.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238e13c700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2388149510 0x7f2388147ac0 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7f237c0017b0 tx=0x7f2380010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f237affd700 1 -- 172.21.15.63:0/147990525 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f237c004530 con 0x7f2388149510 2020-05-18T21:32:10.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238fb9f700 1 -- 172.21.15.63:0/147990525 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238809e030 con 0x7f2388149510 2020-05-18T21:32:10.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.589+0000 7f238e13c700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2388149510 0x7f2388147ac0 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7f237c0017b0 tx=0x7f2380010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.593+0000 7f237affd700 1 -- 172.21.15.63:0/147990525 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238000e180 con 0x7f2388149510 2020-05-18T21:32:10.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.593+0000 7f238e13c700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2388149510 0x7f2388147ac0 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7f237c0017b0 tx=0x7f2380010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.593+0000 7f237affd700 1 -- 172.21.15.63:0/147990525 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f238000e520 con 0x7f2388149510 2020-05-18T21:32:10.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.593+0000 7f238fb9f700 1 -- 172.21.15.63:0/147990525 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23881445b0 con 0x7f2388149510 2020-05-18T21:32:10.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.593+0000 7f238e13c700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2388149510 0x7f2388147ac0 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7f237c0017b0 tx=0x7f2380010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.593+0000 7f238fb9f700 1 -- 172.21.15.63:0/147990525 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23880569e0 con 0x7f2388149510 2020-05-18T21:32:10.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.593+0000 7f237affd700 1 -- 172.21.15.63:0/147990525 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2380010350 con 0x7f2388149510 2020-05-18T21:32:10.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.593+0000 7f238e13c700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2388149510 0x7f2388147ac0 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7f237c0017b0 tx=0x7f2380010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.593+0000 7f237affd700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f236804fdc0 0x7f2368052280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:10.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.593+0000 7f237affd700 1 -- 172.21.15.63:0/147990525 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f23800637e0 con 0x7f2388149510 2020-05-18T21:32:10.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.593+0000 7f238d93b700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f236804fdc0 0x7f2368052280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.593+0000 7f238d93b700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f236804fdc0 0x7f2368052280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f237c001110 tx=0x7f23840111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.593+0000 7f238d93b700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f236804fdc0 0x7f2368052280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f237c001110 tx=0x7f23840111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.593+0000 7f238d93b700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f236804fdc0 0x7f2368052280 secure :-1 s=READY pgs=451 cs=0 l=1 rx=0x7f237c001110 tx=0x7f23840111f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:10.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.601+0000 7f238e13c700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2388149510 0x7f2388147ac0 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7f237c0017b0 tx=0x7f2380010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.601+0000 7f237affd700 1 -- 172.21.15.63:0/147990525 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f238003dbd0 con 0x7f2388149510 2020-05-18T21:32:10.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.721+0000 7f238fb9f700 1 -- 172.21.15.63:0/147990525 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f238809edc0 con 0x7f2388149510 2020-05-18T21:32:10.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.725+0000 7f238e13c700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2388149510 0x7f2388147ac0 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7f237c0017b0 tx=0x7f2380010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.725+0000 7f237affd700 1 -- 172.21.15.63:0/147990525 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v86) v1 ==== 92+0+10 (secure 0 0 0) 0x7f23800411f0 con 0x7f2388149510 2020-05-18T21:32:10.729 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:32:10.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.725+0000 7f238fb9f700 1 -- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f236804fdc0 msgr2=0x7f2368052280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.725+0000 7f238fb9f700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f236804fdc0 0x7f2368052280 secure :-1 s=READY pgs=451 cs=0 l=1 rx=0x7f237c001110 tx=0x7f23840111f0).stop 2020-05-18T21:32:10.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.725+0000 7f238fb9f700 1 -- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2388149510 msgr2=0x7f2388147ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.725+0000 7f238fb9f700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2388149510 0x7f2388147ac0 secure :-1 s=READY pgs=779 cs=0 l=1 rx=0x7f237c0017b0 tx=0x7f2380010ca0).stop 2020-05-18T21:32:10.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.725+0000 7f238fb9f700 1 -- 172.21.15.63:0/147990525 shutdown_connections 2020-05-18T21:32:10.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.725+0000 7f238fb9f700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f236804fdc0 0x7f2368052280 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:10.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.725+0000 7f238fb9f700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2388149510 0x7f2388147ac0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:10.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.725+0000 7f238fb9f700 1 --2- 172.21.15.63:0/147990525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2388065df0 0x7f2388148620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:10.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.725+0000 7f238fb9f700 1 -- 172.21.15.63:0/147990525 >> 172.21.15.63:0/147990525 conn(0x7f23880b9770 msgr2=0x7f2388141820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:10.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.725+0000 7f238fb9f700 1 -- 172.21.15.63:0/147990525 shutdown_connections 2020-05-18T21:32:10.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.725+0000 7f238fb9f700 1 -- 172.21.15.63:0/147990525 wait complete. 2020-05-18T21:32:10.747 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:32:10.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.845+0000 7fdb03fff700 1 Processor -- start 2020-05-18T21:32:10.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.845+0000 7fdb03fff700 1 -- start start 2020-05-18T21:32:10.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb03fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdb040bc8d0 0x7fdb04060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:10.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb03fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb04146420 con 0x7fdb04145e30 2020-05-18T21:32:10.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb03fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb041466c0 con 0x7fdb04143630 2020-05-18T21:32:10.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb03fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb04146e00 con 0x7fdb040bc8d0 2020-05-18T21:32:10.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb027fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdb04145e30 0x7fdb04142f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32786/0 (socket says 172.21.15.63:32786) 2020-05-18T21:32:10.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb027fc700 1 -- 172.21.15.63:0/263173559 learned_addr learned my addr 172.21.15.63:0/263173559 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:10.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb01ffb700 1 -- 172.21.15.63:0/263173559 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987449756 0 0) 0x7fdb04146420 con 0x7fdb04145e30 2020-05-18T21:32:10.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb01ffb700 1 -- 172.21.15.63:0/263173559 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdae4003270 con 0x7fdb04145e30 2020-05-18T21:32:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb02ffd700 1 --2- 172.21.15.63:0/263173559 >> v2:172.21.15.155:3300/0 conn(0x7fdb040bc8d0 0x7fdb04060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb01ffb700 1 -- 172.21.15.63:0/263173559 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4019377090 0 0) 0x7fdae4003270 con 0x7fdb04145e30 2020-05-18T21:32:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb01ffb700 1 -- 172.21.15.63:0/263173559 >> v2:172.21.15.155:3300/0 conn(0x7fdb040bc8d0 msgr2=0x7fdb04060b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb01ffb700 1 --2- 172.21.15.63:0/263173559 >> v2:172.21.15.155:3300/0 conn(0x7fdb040bc8d0 0x7fdb04060b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb01ffb700 1 -- 172.21.15.63:0/263173559 >> v1:172.21.15.155:6789/0 conn(0x7fdb04143630 legacy=0x7fdb0412e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb01ffb700 1 -- 172.21.15.63:0/263173559 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb04146960 con 0x7fdb04145e30 2020-05-18T21:32:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb01ffb700 1 -- 172.21.15.63:0/263173559 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fdaec001890 con 0x7fdb04145e30 2020-05-18T21:32:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb01ffb700 1 -- 172.21.15.63:0/263173559 >> v1:172.21.15.63:6789/0 conn(0x7fdb04145e30 legacy=0x7fdb04142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb01ffb700 1 --2- 172.21.15.63:0/263173559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdae4003760 0x7fdae4003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb01ffb700 1 --2- 172.21.15.63:0/263173559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4004510 0x7fdae4004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb01ffb700 1 --2- 172.21.15.63:0/263173559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdae4004df0 0x7fdae400b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb01ffb700 1 -- 172.21.15.63:0/263173559 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04146e00 con 0x7fdae4004510 2020-05-18T21:32:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb01ffb700 1 -- 172.21.15.63:0/263173559 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae4004200 con 0x7fdae4003760 2020-05-18T21:32:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb01ffb700 1 -- 172.21.15.63:0/263173559 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae400bbc0 con 0x7fdae4004df0 2020-05-18T21:32:10.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb027fc700 1 --2- 172.21.15.63:0/263173559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4004510 0x7fdae4004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb02ffd700 1 --2- 172.21.15.63:0/263173559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdae4003760 0x7fdae4003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb037fe700 1 --2- 172.21.15.63:0/263173559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdae4004df0 0x7fdae400b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb027fc700 1 -- 172.21.15.63:0/263173559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdae4004df0 msgr2=0x7fdae400b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:10.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb027fc700 1 --2- 172.21.15.63:0/263173559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdae4004df0 0x7fdae400b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:10.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb027fc700 1 -- 172.21.15.63:0/263173559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdae4003760 msgr2=0x7fdae4003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:10.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb027fc700 1 --2- 172.21.15.63:0/263173559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdae4003760 0x7fdae4003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:10.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb027fc700 1 -- 172.21.15.63:0/263173559 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae4003270 con 0x7fdae4004510 2020-05-18T21:32:10.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb037fe700 1 --2- 172.21.15.63:0/263173559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdae4004df0 0x7fdae400b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:32:10.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb02ffd700 1 --2- 172.21.15.63:0/263173559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdae4003760 0x7fdae4003b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:32:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb037fe700 1 -- 172.21.15.63:0/263173559 reap_dead start 2020-05-18T21:32:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb027fc700 1 --2- 172.21.15.63:0/263173559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4004510 0x7fdae4004990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdaec0015a0 tx=0x7fdb04061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb027fc700 1 --2- 172.21.15.63:0/263173559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4004510 0x7fdae4004990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdaec0015a0 tx=0x7fdb04061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb027fc700 1 --2- 172.21.15.63:0/263173559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4004510 0x7fdae4004990 secure :-1 s=READY pgs=1142 cs=0 l=1 rx=0x7fdaec0015a0 tx=0x7fdb04061d60).ready entity=mon.0 client_cookie=2baf7d296dc71a9b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb027fc700 1 --2- 172.21.15.63:0/263173559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4004510 0x7fdae4004990 secure :-1 s=THROTTLE_DONE pgs=1142 cs=0 l=1 rx=0x7fdaec0015a0 tx=0x7fdb04061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb01ffb700 1 -- 172.21.15.63:0/263173559 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaec010560 con 0x7fdae4004510 2020-05-18T21:32:10.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb027fc700 1 --2- 172.21.15.63:0/263173559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4004510 0x7fdae4004990 secure :-1 s=THROTTLE_DONE pgs=1142 cs=0 l=1 rx=0x7fdaec0015a0 tx=0x7fdb04061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb027fc700 1 --2- 172.21.15.63:0/263173559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4004510 0x7fdae4004990 secure :-1 s=THROTTLE_DONE pgs=1142 cs=0 l=1 rx=0x7fdaec0015a0 tx=0x7fdb04061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb01ffb700 1 -- 172.21.15.63:0/263173559 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec0106c0 con 0x7fdae4004510 2020-05-18T21:32:10.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb01ffb700 1 -- 172.21.15.63:0/263173559 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaec0054f0 con 0x7fdae4004510 2020-05-18T21:32:10.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb03fff700 1 -- 172.21.15.63:0/263173559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4004510 msgr2=0x7fdae4004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb03fff700 1 --2- 172.21.15.63:0/263173559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4004510 0x7fdae4004990 secure :-1 s=READY pgs=1142 cs=0 l=1 rx=0x7fdaec0015a0 tx=0x7fdb04061d60).stop 2020-05-18T21:32:10.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb03fff700 1 -- 172.21.15.63:0/263173559 shutdown_connections 2020-05-18T21:32:10.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb03fff700 1 --2- 172.21.15.63:0/263173559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4004510 0x7fdae4004990 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:10.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb03fff700 1 -- 172.21.15.63:0/263173559 >> 172.21.15.63:0/263173559 conn(0x7fdb0405f3b0 msgr2=0x7fdb0405f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:10.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb03fff700 1 -- 172.21.15.63:0/263173559 shutdown_connections 2020-05-18T21:32:10.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.849+0000 7fdb03fff700 1 -- 172.21.15.63:0/263173559 wait complete. 2020-05-18T21:32:10.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb03fff700 1 Processor -- start 2020-05-18T21:32:10.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb03fff700 1 -- start start 2020-05-18T21:32:10.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb03fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb04153d20 0x7fdb04152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:10.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb03fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdb040bb6c0 0x7fdb04154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:10.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb03fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb04150b50 con 0x7fdae4004510 2020-05-18T21:32:10.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb03fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb040bbb30 con 0x7fdb040bb6c0 2020-05-18T21:32:10.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb03fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04154830 con 0x7fdb04153d20 2020-05-18T21:32:10.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb037fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdb040bb6c0 0x7fdb04154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb027fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb04153d20 0x7fdb04152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb037fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdb040bb6c0 0x7fdb04154120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:45462/0 (socket says 172.21.15.63:45462) 2020-05-18T21:32:10.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb037fe700 1 -- 172.21.15.63:0/2856578343 learned_addr learned my addr 172.21.15.63:0/2856578343 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:10.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb037fe700 1 -- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb04153d20 msgr2=0x7fdb04152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb037fe700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb04153d20 0x7fdb04152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:10.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb037fe700 1 -- 172.21.15.63:0/2856578343 >> v1:172.21.15.155:6789/0 conn(0x7fdae4004510 legacy=0x7fdb04153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb037fe700 1 -- 172.21.15.63:0/2856578343 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb04154ad0 con 0x7fdb040bb6c0 2020-05-18T21:32:10.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb027fc700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb04153d20 0x7fdb04152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:10.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb037fe700 1 --2- 172.21.15.63:0/2856578343 >> v2:172.21.15.155:3300/0 conn(0x7fdb040bb6c0 0x7fdb04154120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdaec001660 tx=0x7fdafc010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb037fe700 1 --2- 172.21.15.63:0/2856578343 >> v2:172.21.15.155:3300/0 conn(0x7fdb040bb6c0 0x7fdb04154120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdaec001660 tx=0x7fdafc010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb037fe700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb040bb6c0 0x7fdb04154120 secure :-1 s=READY pgs=782 cs=0 l=1 rx=0x7fdaec001660 tx=0x7fdafc010bc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:10.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb037fe700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb040bb6c0 0x7fdb04154120 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fdaec001660 tx=0x7fdafc010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdafbfff700 1 -- 172.21.15.63:0/2856578343 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdafc006c80 con 0x7fdb040bb6c0 2020-05-18T21:32:10.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb037fe700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb040bb6c0 0x7fdb04154120 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fdaec001660 tx=0x7fdafc010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdafbfff700 1 -- 172.21.15.63:0/2856578343 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc013070 con 0x7fdb040bb6c0 2020-05-18T21:32:10.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb037fe700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb040bb6c0 0x7fdb04154120 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fdaec001660 tx=0x7fdafc010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb03fff700 1 -- 172.21.15.63:0/2856578343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb04154d70 con 0x7fdb040bb6c0 2020-05-18T21:32:10.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdafbfff700 1 -- 172.21.15.63:0/2856578343 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdafc002490 con 0x7fdb040bb6c0 2020-05-18T21:32:10.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.853+0000 7fdb03fff700 1 -- 172.21.15.63:0/2856578343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb04155210 con 0x7fdb040bb6c0 2020-05-18T21:32:10.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.857+0000 7fdb03fff700 1 -- 172.21.15.63:0/2856578343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb04154f00 con 0x7fdb040bb6c0 2020-05-18T21:32:10.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.857+0000 7fdb037fe700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb040bb6c0 0x7fdb04154120 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fdaec001660 tx=0x7fdafc010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.857+0000 7fdafbfff700 1 -- 172.21.15.63:0/2856578343 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fdafc0025f0 con 0x7fdb040bb6c0 2020-05-18T21:32:10.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.857+0000 7fdb037fe700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb040bb6c0 0x7fdb04154120 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fdaec001660 tx=0x7fdafc010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.857+0000 7fdafbfff700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdae804fa20 0x7fdae8051ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:10.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.857+0000 7fdafbfff700 1 -- 172.21.15.63:0/2856578343 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fdafc00b0b0 con 0x7fdb040bb6c0 2020-05-18T21:32:10.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.857+0000 7fdb02ffd700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdae804fa20 0x7fdae8051ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:10.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.857+0000 7fdb02ffd700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdae804fa20 0x7fdae8051ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb041550f0 tx=0x7fdaf4007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.857+0000 7fdb02ffd700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdae804fa20 0x7fdae8051ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb041550f0 tx=0x7fdaf4007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.857+0000 7fdb02ffd700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdae804fa20 0x7fdae8051ee0 secure :-1 s=READY pgs=452 cs=0 l=1 rx=0x7fdb041550f0 tx=0x7fdaf4007aa0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:10.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.865+0000 7fdb037fe700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb040bb6c0 0x7fdb04154120 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fdaec001660 tx=0x7fdafc010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.865+0000 7fdafbfff700 1 -- 172.21.15.63:0/2856578343 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fdafc03dfa0 con 0x7fdb040bb6c0 2020-05-18T21:32:10.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.981+0000 7fdb03fff700 1 -- 172.21.15.63:0/2856578343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdb040569e0 con 0x7fdb040bb6c0 2020-05-18T21:32:10.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.981+0000 7fdb037fe700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb040bb6c0 0x7fdb04154120 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fdaec001660 tx=0x7fdafc010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:10.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.981+0000 7fdafbfff700 1 -- 172.21.15.63:0/2856578343 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+10 (secure 0 0 0) 0x7fdafc0415c0 con 0x7fdb040bb6c0 2020-05-18T21:32:10.987 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:32:10.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.985+0000 7fdb03fff700 1 -- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdae804fa20 msgr2=0x7fdae8051ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.985+0000 7fdb03fff700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdae804fa20 0x7fdae8051ee0 secure :-1 s=READY pgs=452 cs=0 l=1 rx=0x7fdb041550f0 tx=0x7fdaf4007aa0).stop 2020-05-18T21:32:10.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.985+0000 7fdb03fff700 1 -- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb040bb6c0 msgr2=0x7fdb04154120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:10.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.985+0000 7fdb03fff700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb040bb6c0 0x7fdb04154120 secure :-1 s=READY pgs=782 cs=0 l=1 rx=0x7fdaec001660 tx=0x7fdafc010bc0).stop 2020-05-18T21:32:10.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.985+0000 7fdb03fff700 1 -- 172.21.15.63:0/2856578343 shutdown_connections 2020-05-18T21:32:10.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.985+0000 7fdb03fff700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdae804fa20 0x7fdae8051ee0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:10.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.985+0000 7fdb03fff700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb040bb6c0 0x7fdb04154120 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:10.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.985+0000 7fdb03fff700 1 --2- 172.21.15.63:0/2856578343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb04153d20 0x7fdb04152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:10.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.985+0000 7fdb03fff700 1 -- 172.21.15.63:0/2856578343 >> 172.21.15.63:0/2856578343 conn(0x7fdb0405f3b0 msgr2=0x7fdb040b9030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:10.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.985+0000 7fdb03fff700 1 -- 172.21.15.63:0/2856578343 shutdown_connections 2020-05-18T21:32:10.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:10.985+0000 7fdb03fff700 1 -- 172.21.15.63:0/2856578343 wait complete. 2020-05-18T21:32:11.007 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:32:11.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.109+0000 7f6f9ffff700 1 Processor -- start 2020-05-18T21:32:11.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.109+0000 7f6f9ffff700 1 -- start start 2020-05-18T21:32:11.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f9ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b68d0 0x7f6fa01469b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:11.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f9ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6fa00b99d0 0x7f6fa0149d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:11.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f9ffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa0145fd0 con 0x7f6fa00b8ed0 2020-05-18T21:32:11.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f9ffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa0146270 con 0x7f6fa00b99d0 2020-05-18T21:32:11.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f9ffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa0146510 con 0x7f6fa00b68d0 2020-05-18T21:32:11.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f97fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6fa00b99d0 0x7f6fa0149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:11.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f9effd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b68d0 0x7f6fa01469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:11.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f97fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6fa00b99d0 0x7f6fa0149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:45470/0 (socket says 172.21.15.63:45470) 2020-05-18T21:32:11.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f9f7fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f6fa00b8ed0 0x7f6fa0060430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:59354/0 (socket says 172.21.15.63:59354) 2020-05-18T21:32:11.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f97fff700 1 -- 172.21.15.63:0/2177471307 learned_addr learned my addr 172.21.15.63:0/2177471307 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:11.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f97fff700 1 -- 172.21.15.63:0/2177471307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b68d0 msgr2=0x7f6fa01469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:11.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f97fff700 1 --2- 172.21.15.63:0/2177471307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b68d0 0x7f6fa01469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:11.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f97fff700 1 -- 172.21.15.63:0/2177471307 >> v1:172.21.15.155:6789/0 conn(0x7f6fa00b8ed0 legacy=0x7f6fa0060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:11.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f97fff700 1 -- 172.21.15.63:0/2177471307 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa00b6cb0 con 0x7f6fa00b99d0 2020-05-18T21:32:11.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f9e7fc700 1 -- 172.21.15.63:0/2177471307 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507177241 0 0) 0x7f6fa0145fd0 con 0x7f6fa00b8ed0 2020-05-18T21:32:11.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f97fff700 1 --2- 172.21.15.63:0/2177471307 >> v2:172.21.15.155:3300/0 conn(0x7f6fa00b99d0 0x7f6fa0149d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6fa00b8c90 tx=0x7f6f88008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f97fff700 1 --2- 172.21.15.63:0/2177471307 >> v2:172.21.15.155:3300/0 conn(0x7f6fa00b99d0 0x7f6fa0149d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6fa00b8c90 tx=0x7f6f88008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f97fff700 1 --2- 172.21.15.63:0/2177471307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fa00b99d0 0x7f6fa0149d40 secure :-1 s=READY pgs=784 cs=0 l=1 rx=0x7f6fa00b8c90 tx=0x7f6f88008920).ready entity=mon.1 client_cookie=c7bf29018f40fc50 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:11.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f97fff700 1 --2- 172.21.15.63:0/2177471307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fa00b99d0 0x7f6fa0149d40 secure :-1 s=THROTTLE_DONE pgs=784 cs=0 l=1 rx=0x7f6fa00b8c90 tx=0x7f6f88008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f9e7fc700 1 -- 172.21.15.63:0/2177471307 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f880116b0 con 0x7f6fa00b99d0 2020-05-18T21:32:11.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f97fff700 1 --2- 172.21.15.63:0/2177471307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fa00b99d0 0x7f6fa0149d40 secure :-1 s=THROTTLE_DONE pgs=784 cs=0 l=1 rx=0x7f6fa00b8c90 tx=0x7f6f88008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f9e7fc700 1 -- 172.21.15.63:0/2177471307 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f88011810 con 0x7f6fa00b99d0 2020-05-18T21:32:11.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f97fff700 1 --2- 172.21.15.63:0/2177471307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fa00b99d0 0x7f6fa0149d40 secure :-1 s=THROTTLE_DONE pgs=784 cs=0 l=1 rx=0x7f6fa00b8c90 tx=0x7f6f88008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f9e7fc700 1 -- 172.21.15.63:0/2177471307 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f88011bf0 con 0x7f6fa00b99d0 2020-05-18T21:32:11.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f9ffff700 1 -- 172.21.15.63:0/2177471307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fa00b99d0 msgr2=0x7f6fa0149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:11.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f9ffff700 1 --2- 172.21.15.63:0/2177471307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fa00b99d0 0x7f6fa0149d40 secure :-1 s=READY pgs=784 cs=0 l=1 rx=0x7f6fa00b8c90 tx=0x7f6f88008920).stop 2020-05-18T21:32:11.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f9ffff700 1 -- 172.21.15.63:0/2177471307 shutdown_connections 2020-05-18T21:32:11.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f9ffff700 1 --2- 172.21.15.63:0/2177471307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fa00b99d0 0x7f6fa0149d40 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:11.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f9ffff700 1 --2- 172.21.15.63:0/2177471307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b68d0 0x7f6fa01469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f9ffff700 1 -- 172.21.15.63:0/2177471307 >> 172.21.15.63:0/2177471307 conn(0x7f6fa0069b70 msgr2=0x7f6fa0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f9ffff700 1 -- 172.21.15.63:0/2177471307 shutdown_connections 2020-05-18T21:32:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.113+0000 7f6f9ffff700 1 -- 172.21.15.63:0/2177471307 wait complete. 2020-05-18T21:32:11.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.117+0000 7f6f9ffff700 1 Processor -- start 2020-05-18T21:32:11.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.117+0000 7f6f9ffff700 1 -- start start 2020-05-18T21:32:11.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.117+0000 7f6f9ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b8ed0 0x7f6fa0145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:11.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.117+0000 7f6f9ffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa00b08d0 con 0x7f6fa00b99d0 2020-05-18T21:32:11.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.117+0000 7f6f9ffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa0153d90 con 0x7f6fa00b68d0 2020-05-18T21:32:11.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.117+0000 7f6f9ffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa00b0250 con 0x7f6fa00b8ed0 2020-05-18T21:32:11.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.117+0000 7f6f9f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6fa00b99d0 0x7f6fa00ad190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32816/0 (socket says 172.21.15.63:32816) 2020-05-18T21:32:11.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.117+0000 7f6f9f7fe700 1 -- 172.21.15.63:0/492545024 learned_addr learned my addr 172.21.15.63:0/492545024 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:11.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.117+0000 7f6f97fff700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b8ed0 0x7f6fa0145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:11.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f9cff9700 1 -- 172.21.15.63:0/492545024 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433085170 0 0) 0x7f6fa0153d90 con 0x7f6fa00b68d0 2020-05-18T21:32:11.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f9cff9700 1 -- 172.21.15.63:0/492545024 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f84002fe0 con 0x7f6fa00b68d0 2020-05-18T21:32:11.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f9cff9700 1 -- 172.21.15.63:0/492545024 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509292464 0 0) 0x7f6fa00b08d0 con 0x7f6fa00b99d0 2020-05-18T21:32:11.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f9cff9700 1 -- 172.21.15.63:0/492545024 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fa0153d90 con 0x7f6fa00b99d0 2020-05-18T21:32:11.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f97fff700 1 -- 172.21.15.63:0/492545024 >> v1:172.21.15.155:6789/0 conn(0x7f6fa00b68d0 legacy=0x7f6fa0143450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:11.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f97fff700 1 -- 172.21.15.63:0/492545024 >> v1:172.21.15.63:6789/0 conn(0x7f6fa00b99d0 legacy=0x7f6fa00ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:11.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f97fff700 1 -- 172.21.15.63:0/492545024 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa0144c70 con 0x7f6fa00b8ed0 2020-05-18T21:32:11.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f97fff700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b8ed0 0x7f6fa0145780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6fa00b8c90 tx=0x7f6fa00622c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f97fff700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b8ed0 0x7f6fa0145780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6fa00b8c90 tx=0x7f6fa00622c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f97fff700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b8ed0 0x7f6fa0145780 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f6fa00b8c90 tx=0x7f6fa00622c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:11.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f97fff700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b8ed0 0x7f6fa0145780 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f6fa00b8c90 tx=0x7f6fa00622c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f9cff9700 1 -- 172.21.15.63:0/492545024 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f88011e70 con 0x7f6fa00b8ed0 2020-05-18T21:32:11.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f97fff700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b8ed0 0x7f6fa0145780 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f6fa00b8c90 tx=0x7f6fa00622c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f9ffff700 1 -- 172.21.15.63:0/492545024 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa00b0430 con 0x7f6fa00b8ed0 2020-05-18T21:32:11.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f9cff9700 1 -- 172.21.15.63:0/492545024 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f88011c40 con 0x7f6fa00b8ed0 2020-05-18T21:32:11.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f97fff700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b8ed0 0x7f6fa0145780 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f6fa00b8c90 tx=0x7f6fa00622c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f9cff9700 1 -- 172.21.15.63:0/492545024 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f88007550 con 0x7f6fa00b8ed0 2020-05-18T21:32:11.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f9ffff700 1 -- 172.21.15.63:0/492545024 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa0143df0 con 0x7f6fa00b8ed0 2020-05-18T21:32:11.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f9ffff700 1 -- 172.21.15.63:0/492545024 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa00569e0 con 0x7f6fa00b8ed0 2020-05-18T21:32:11.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f97fff700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b8ed0 0x7f6fa0145780 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f6fa00b8c90 tx=0x7f6fa00622c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f9cff9700 1 -- 172.21.15.63:0/492545024 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6f88005700 con 0x7f6fa00b8ed0 2020-05-18T21:32:11.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.121+0000 7f6f97fff700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b8ed0 0x7f6fa0145780 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f6fa00b8c90 tx=0x7f6fa00622c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.125+0000 7f6f9cff9700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f8404feb0 0x7f6f84052370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:11.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.125+0000 7f6f9cff9700 1 -- 172.21.15.63:0/492545024 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f6f880643e0 con 0x7f6fa00b8ed0 2020-05-18T21:32:11.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.125+0000 7f6f9effd700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f8404feb0 0x7f6f84052370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:11.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.125+0000 7f6f9effd700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f8404feb0 0x7f6f84052370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f90002f30 tx=0x7f6f900090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.125+0000 7f6f9effd700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f8404feb0 0x7f6f84052370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f90002f30 tx=0x7f6f900090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.125+0000 7f6f9effd700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f8404feb0 0x7f6f84052370 secure :-1 s=READY pgs=453 cs=0 l=1 rx=0x7f6f90002f30 tx=0x7f6f900090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:11.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.129+0000 7f6f97fff700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b8ed0 0x7f6fa0145780 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f6fa00b8c90 tx=0x7f6fa00622c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.129+0000 7f6f9cff9700 1 -- 172.21.15.63:0/492545024 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6f8803e710 con 0x7f6fa00b8ed0 2020-05-18T21:32:11.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.249+0000 7f6f9ffff700 1 -- 172.21.15.63:0/492545024 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6fa00008d0 con 0x7f6fa00b8ed0 2020-05-18T21:32:11.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.249+0000 7f6f97fff700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b8ed0 0x7f6fa0145780 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f6fa00b8c90 tx=0x7f6fa00622c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.249+0000 7f6f9cff9700 1 -- 172.21.15.63:0/492545024 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+10 (secure 0 0 0) 0x7f6f88041d30 con 0x7f6fa00b8ed0 2020-05-18T21:32:11.253 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:32:11.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.253+0000 7f6f9ffff700 1 -- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f8404feb0 msgr2=0x7f6f84052370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:11.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.253+0000 7f6f9ffff700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f8404feb0 0x7f6f84052370 secure :-1 s=READY pgs=453 cs=0 l=1 rx=0x7f6f90002f30 tx=0x7f6f900090f0).stop 2020-05-18T21:32:11.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.253+0000 7f6f9ffff700 1 -- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b8ed0 msgr2=0x7f6fa0145780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:11.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.253+0000 7f6f9ffff700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b8ed0 0x7f6fa0145780 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f6fa00b8c90 tx=0x7f6fa00622c0).stop 2020-05-18T21:32:11.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.253+0000 7f6f9ffff700 1 -- 172.21.15.63:0/492545024 shutdown_connections 2020-05-18T21:32:11.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.253+0000 7f6f9ffff700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f8404feb0 0x7f6f84052370 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:11.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.253+0000 7f6f9ffff700 1 --2- 172.21.15.63:0/492545024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00b8ed0 0x7f6fa0145780 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:11.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.253+0000 7f6f9ffff700 1 -- 172.21.15.63:0/492545024 >> 172.21.15.63:0/492545024 conn(0x7f6fa0069b70 msgr2=0x7f6fa013fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:11.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.253+0000 7f6f9ffff700 1 -- 172.21.15.63:0/492545024 shutdown_connections 2020-05-18T21:32:11.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.253+0000 7f6f9ffff700 1 -- 172.21.15.63:0/492545024 wait complete. 2020-05-18T21:32:11.272 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:32:11.273 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:11.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.373+0000 7f473ffff700 1 Processor -- start 2020-05-18T21:32:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473ffff700 1 -- start start 2020-05-18T21:32:11.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f47400b93f0 0x7f4740145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:11.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f47401435a0 0x7f4740060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:11.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473ffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47400b7020 con 0x7f47400b7ca0 2020-05-18T21:32:11.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473ffff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47400b72c0 con 0x7f47400b93f0 2020-05-18T21:32:11.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473ffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47400b7560 con 0x7f47401435a0 2020-05-18T21:32:11.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f47400b93f0 0x7f4740145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:11.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f47400b93f0 0x7f4740145df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58864/0 (socket says 172.21.15.63:58864) 2020-05-18T21:32:11.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473effd700 1 -- 172.21.15.63:0/4040123583 learned_addr learned my addr 172.21.15.63:0/4040123583 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:11.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473f7fe700 1 --2- 172.21.15.63:0/4040123583 >> v2:172.21.15.155:3300/0 conn(0x7f47401435a0 0x7f4740060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:11.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473effd700 1 -- 172.21.15.63:0/4040123583 >> v2:172.21.15.155:3300/0 conn(0x7f47401435a0 msgr2=0x7f4740060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:11.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473effd700 1 --2- 172.21.15.63:0/4040123583 >> v2:172.21.15.155:3300/0 conn(0x7f47401435a0 0x7f4740060430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:11.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473effd700 1 -- 172.21.15.63:0/4040123583 >> v1:172.21.15.155:6789/0 conn(0x7f47400b7ca0 legacy=0x7f4740142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:11.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473effd700 1 -- 172.21.15.63:0/4040123583 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47400b7800 con 0x7f47400b93f0 2020-05-18T21:32:11.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473effd700 1 --2- 172.21.15.63:0/4040123583 >> v2:172.21.15.63:3300/0 conn(0x7f47400b93f0 0x7f4740145df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4730002f70 tx=0x7f4730007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473effd700 1 --2- 172.21.15.63:0/4040123583 >> v2:172.21.15.63:3300/0 conn(0x7f47400b93f0 0x7f4740145df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4730002f70 tx=0x7f4730007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473effd700 1 --2- 172.21.15.63:0/4040123583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47400b93f0 0x7f4740145df0 secure :-1 s=READY pgs=1144 cs=0 l=1 rx=0x7f4730002f70 tx=0x7f4730007a80).ready entity=mon.0 client_cookie=9c651d8cf35bdc2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:11.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473effd700 1 --2- 172.21.15.63:0/4040123583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47400b93f0 0x7f4740145df0 secure :-1 s=THROTTLE_DONE pgs=1144 cs=0 l=1 rx=0x7f4730002f70 tx=0x7f4730007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473effd700 1 --2- 172.21.15.63:0/4040123583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47400b93f0 0x7f4740145df0 secure :-1 s=THROTTLE_DONE pgs=1144 cs=0 l=1 rx=0x7f4730002f70 tx=0x7f4730007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473e7fc700 1 -- 172.21.15.63:0/4040123583 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4730011760 con 0x7f47400b93f0 2020-05-18T21:32:11.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473effd700 1 --2- 172.21.15.63:0/4040123583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47400b93f0 0x7f4740145df0 secure :-1 s=THROTTLE_DONE pgs=1144 cs=0 l=1 rx=0x7f4730002f70 tx=0x7f4730007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473e7fc700 1 -- 172.21.15.63:0/4040123583 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47300118c0 con 0x7f47400b93f0 2020-05-18T21:32:11.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473e7fc700 1 -- 172.21.15.63:0/4040123583 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4730011ce0 con 0x7f47400b93f0 2020-05-18T21:32:11.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473ffff700 1 -- 172.21.15.63:0/4040123583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47400b93f0 msgr2=0x7f4740145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:11.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.377+0000 7f473ffff700 1 --2- 172.21.15.63:0/4040123583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47400b93f0 0x7f4740145df0 secure :-1 s=READY pgs=1144 cs=0 l=1 rx=0x7f4730002f70 tx=0x7f4730007a80).stop 2020-05-18T21:32:11.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.381+0000 7f473ffff700 1 -- 172.21.15.63:0/4040123583 shutdown_connections 2020-05-18T21:32:11.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.381+0000 7f473ffff700 1 --2- 172.21.15.63:0/4040123583 >> v2:172.21.15.155:3300/0 conn(0x7f47401435a0 0x7f4740060430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:11.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.381+0000 7f473ffff700 1 --2- 172.21.15.63:0/4040123583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47400b93f0 0x7f4740145df0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:11.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.381+0000 7f473ffff700 1 -- 172.21.15.63:0/4040123583 >> 172.21.15.63:0/4040123583 conn(0x7f4740069b70 msgr2=0x7f4740069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:11.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.381+0000 7f473ffff700 1 -- 172.21.15.63:0/4040123583 shutdown_connections 2020-05-18T21:32:11.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.381+0000 7f473ffff700 1 -- 172.21.15.63:0/4040123583 wait complete. 2020-05-18T21:32:11.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.381+0000 7f473ffff700 1 Processor -- start 2020-05-18T21:32:11.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.381+0000 7f473ffff700 1 -- start start 2020-05-18T21:32:11.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.381+0000 7f473ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47400b7ca0 0x7f4740146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:11.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.381+0000 7f473ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f47400b93f0 0x7f4740144460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:11.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.381+0000 7f473ffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4740144a90 con 0x7f47401435a0 2020-05-18T21:32:11.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.381+0000 7f473ffff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4740157ed0 con 0x7f47400b93f0 2020-05-18T21:32:11.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.381+0000 7f473ffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4740146510 con 0x7f47400b7ca0 2020-05-18T21:32:11.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f473f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f47401435a0 0x7f474013f900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32830/0 (socket says 172.21.15.63:32830) 2020-05-18T21:32:11.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f473f7fe700 1 -- 172.21.15.63:0/802409640 learned_addr learned my addr 172.21.15.63:0/802409640 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:11.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f47367fc700 1 --2- 172.21.15.63:0/802409640 >> v2:172.21.15.63:3300/0 conn(0x7f47400b93f0 0x7f4740144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:11.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f473effd700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47400b7ca0 0x7f4740146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:11.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f473cff9700 1 -- 172.21.15.63:0/802409640 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033697509 0 0) 0x7f4740144a90 con 0x7f47401435a0 2020-05-18T21:32:11.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f473cff9700 1 -- 172.21.15.63:0/802409640 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4724002fe0 con 0x7f47401435a0 2020-05-18T21:32:11.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f473cff9700 1 -- 172.21.15.63:0/802409640 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 596647516 0 0) 0x7f4724002fe0 con 0x7f47401435a0 2020-05-18T21:32:11.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f473cff9700 1 -- 172.21.15.63:0/802409640 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4740144a90 con 0x7f47401435a0 2020-05-18T21:32:11.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f473cff9700 1 -- 172.21.15.63:0/802409640 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f4738001920 con 0x7f47401435a0 2020-05-18T21:32:11.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f47367fc700 1 -- 172.21.15.63:0/802409640 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47400b7ca0 msgr2=0x7f4740146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:11.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f47367fc700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47400b7ca0 0x7f4740146b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:11.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f47367fc700 1 -- 172.21.15.63:0/802409640 >> v1:172.21.15.63:6789/0 conn(0x7f47401435a0 legacy=0x7f474013f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:11.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f47367fc700 1 -- 172.21.15.63:0/802409640 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4740145860 con 0x7f47400b93f0 2020-05-18T21:32:11.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f473effd700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47400b7ca0 0x7f4740146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:11.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f47367fc700 1 --2- 172.21.15.63:0/802409640 >> v2:172.21.15.63:3300/0 conn(0x7f47400b93f0 0x7f4740144460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f474006ab40 tx=0x7f4728010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f47367fc700 1 --2- 172.21.15.63:0/802409640 >> v2:172.21.15.63:3300/0 conn(0x7f47400b93f0 0x7f4740144460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f474006ab40 tx=0x7f4728010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f47367fc700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47400b93f0 0x7f4740144460 secure :-1 s=READY pgs=1146 cs=0 l=1 rx=0x7f474006ab40 tx=0x7f4728010920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:11.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f47367fc700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47400b93f0 0x7f4740144460 secure :-1 s=THROTTLE_DONE pgs=1146 cs=0 l=1 rx=0x7f474006ab40 tx=0x7f4728010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f473cff9700 1 -- 172.21.15.63:0/802409640 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f472800cb20 con 0x7f47400b93f0 2020-05-18T21:32:11.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f47367fc700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47400b93f0 0x7f4740144460 secure :-1 s=THROTTLE_DONE pgs=1146 cs=0 l=1 rx=0x7f474006ab40 tx=0x7f4728010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f47367fc700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47400b93f0 0x7f4740144460 secure :-1 s=THROTTLE_DONE pgs=1146 cs=0 l=1 rx=0x7f474006ab40 tx=0x7f4728010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f473cff9700 1 -- 172.21.15.63:0/802409640 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4728011e90 con 0x7f47400b93f0 2020-05-18T21:32:11.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f473ffff700 1 -- 172.21.15.63:0/802409640 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4740145ab0 con 0x7f47400b93f0 2020-05-18T21:32:11.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f473cff9700 1 -- 172.21.15.63:0/802409640 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f472800ce70 con 0x7f47400b93f0 2020-05-18T21:32:11.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f473ffff700 1 -- 172.21.15.63:0/802409640 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4740156f50 con 0x7f47400b93f0 2020-05-18T21:32:11.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f47367fc700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47400b93f0 0x7f4740144460 secure :-1 s=THROTTLE_DONE pgs=1146 cs=0 l=1 rx=0x7f474006ab40 tx=0x7f4728010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f473cff9700 1 -- 172.21.15.63:0/802409640 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4728006520 con 0x7f47400b93f0 2020-05-18T21:32:11.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f47367fc700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47400b93f0 0x7f4740144460 secure :-1 s=THROTTLE_DONE pgs=1146 cs=0 l=1 rx=0x7f474006ab40 tx=0x7f4728010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.385+0000 7f473ffff700 1 -- 172.21.15.63:0/802409640 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f474005c920 con 0x7f47400b93f0 2020-05-18T21:32:11.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.389+0000 7f473cff9700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47240500f0 0x7f47240525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:11.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.389+0000 7f473cff9700 1 -- 172.21.15.63:0/802409640 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f47280631e0 con 0x7f47400b93f0 2020-05-18T21:32:11.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.389+0000 7f473effd700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47240500f0 0x7f47240525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:11.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.389+0000 7f473effd700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47240500f0 0x7f47240525b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4730002f70 tx=0x7f4730007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.389+0000 7f473effd700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47240500f0 0x7f47240525b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4730002f70 tx=0x7f4730007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.389+0000 7f473effd700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47240500f0 0x7f47240525b0 secure :-1 s=READY pgs=454 cs=0 l=1 rx=0x7f4730002f70 tx=0x7f4730007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:11.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.393+0000 7f47367fc700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47400b93f0 0x7f4740144460 secure :-1 s=THROTTLE_DONE pgs=1146 cs=0 l=1 rx=0x7f474006ab40 tx=0x7f4728010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.393+0000 7f473cff9700 1 -- 172.21.15.63:0/802409640 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f472803d570 con 0x7f47400b93f0 2020-05-18T21:32:11.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.537+0000 7f473ffff700 1 -- 172.21.15.63:0/802409640 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47401448c0 con 0x7f47400b93f0 2020-05-18T21:32:11.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.537+0000 7f47367fc700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47400b93f0 0x7f4740144460 secure :-1 s=THROTTLE_DONE pgs=1146 cs=0 l=1 rx=0x7f474006ab40 tx=0x7f4728010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:11.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.537+0000 7f473cff9700 1 -- 172.21.15.63:0/802409640 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+2156 (secure 0 0 0) 0x7f4728040b90 con 0x7f47400b93f0 2020-05-18T21:32:11.543 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:11.544 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":64,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:08.692459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:11.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.541+0000 7f473ffff700 1 -- 172.21.15.63:0/802409640 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47240500f0 msgr2=0x7f47240525b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:11.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.541+0000 7f473ffff700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47240500f0 0x7f47240525b0 secure :-1 s=READY pgs=454 cs=0 l=1 rx=0x7f4730002f70 tx=0x7f4730007a80).stop 2020-05-18T21:32:11.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.541+0000 7f473ffff700 1 -- 172.21.15.63:0/802409640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47400b93f0 msgr2=0x7f4740144460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:11.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.541+0000 7f473ffff700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47400b93f0 0x7f4740144460 secure :-1 s=READY pgs=1146 cs=0 l=1 rx=0x7f474006ab40 tx=0x7f4728010920).stop 2020-05-18T21:32:11.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.541+0000 7f473ffff700 1 -- 172.21.15.63:0/802409640 shutdown_connections 2020-05-18T21:32:11.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.541+0000 7f473ffff700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47240500f0 0x7f47240525b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:11.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.541+0000 7f473ffff700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47400b93f0 0x7f4740144460 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:11.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.541+0000 7f473ffff700 1 --2- 172.21.15.63:0/802409640 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47400b7ca0 0x7f4740146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:11.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.541+0000 7f473ffff700 1 -- 172.21.15.63:0/802409640 >> 172.21.15.63:0/802409640 conn(0x7f4740069b70 msgr2=0x7f47401477e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:11.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.541+0000 7f473ffff700 1 -- 172.21.15.63:0/802409640 shutdown_connections 2020-05-18T21:32:11.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:11.541+0000 7f473ffff700 1 -- 172.21.15.63:0/802409640 wait complete. 2020-05-18T21:32:11.547 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 64 2020-05-18T21:32:11.757 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 64, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:08.692459+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:11.758 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2020-05-18T21:32:11.759 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:32:11.859 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:32:11.859 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:32:11.860 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 1, 2020-05-18T21:32:11.860 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 5756, 2020-05-18T21:32:11.860 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:32:11.860 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:32:11.860 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 7.1857395740000003, 2020-05-18T21:32:11.861 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 64, 2020-05-18T21:32:11.861 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 86, 2020-05-18T21:32:11.861 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 86, 2020-05-18T21:32:11.861 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 12.080243101000001 2020-05-18T21:32:11.861 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:32:11.868 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 1, "id": 5756, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.1857395740000003, "mdsmap_epoch": 64, "osdmap_epoch": 86, "osdmap_epoch_barrier": 86, "uptime": 12.080243101000001 } 2020-05-18T21:32:11.869 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:32:11.974 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:32:11.975 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:32:11.975 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:32:11.975 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 7500, 2020-05-18T21:32:11.975 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:32:11.975 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:32:11.976 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 7.3002063369999997, 2020-05-18T21:32:11.976 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 64, 2020-05-18T21:32:11.976 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 86, 2020-05-18T21:32:11.976 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 86, 2020-05-18T21:32:11.976 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 12.201542654000001 2020-05-18T21:32:11.976 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:32:11.983 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 7500, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.3002063369999997, "mdsmap_epoch": 64, "osdmap_epoch": 86, "osdmap_epoch_barrier": 86, "uptime": 12.201542654000001 } 2020-05-18T21:32:11.984 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:32:11.984 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:32:11.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:11.985 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:32:11.993 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:32:11.993 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:32:11.993 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:32:11.994 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:11.994 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:32:11.994 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:11.994 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:11.994 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:11.995 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:11.995 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:11.995 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:11.995 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:11.995 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:32:11.995 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:11.996 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:32:11.996 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42511sec preferred_lft 42511sec 2020-05-18T21:32:11.996 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:32:11.996 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:11.997 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:32:11.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:11.998 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:32:12.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:12.054 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:32:12.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:12.071 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:32:12.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:12.082 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:32:12.138 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:32:12.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:12.140 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:32:12.149 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:32:12.150 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:32:12.150 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:32:12.150 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:32:12.150 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:32:12.150 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:32:12.151 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:32:12.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:12.152 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:32:12.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:12.172 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:32:12.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:12.237 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:32:12.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:12.252 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:32:12.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:12.260 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:32:12.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:12.310 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:32:12.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:12.328 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-05-18T21:32:12.342 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-05-18T21:32:12.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:12.343 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-05-18T21:32:12.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:12.358 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:32:12.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:12.424 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-05-18T21:32:12.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:12.446 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-05-18T21:32:12.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:12.508 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-05-18T21:32:12.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:12.526 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 up' 2020-05-18T21:32:12.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:12.544 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.0 master ceph-brx' 2020-05-18T21:32:12.562 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-05-18T21:32:12.562 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-05-18T21:32:12.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:32:12.563 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:32:12.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:32:12.611 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:32:12.626 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:32:12.627 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:32:12.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:32:12.628 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:32:12.635 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:32:12.635 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:32:12.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:32:12.681 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:32:12.697 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:32:12.699 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:32:12.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:32:12.700 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:32:12.766 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2020-05-18T21:32:12.761+0000 7f7007c32080 -1 init, newargv = 0x559a4aebf530 newargc=9 2020-05-18T21:32:12.766 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[27469]: starting ceph client 2020-05-18T21:32:12.783 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[27469]: starting fuse 2020-05-18T21:32:13.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:32:13.807 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:32:13.823 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:32:13.824 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:32:13.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:32:13.826 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:32:13.833 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:32:13.833 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:32:13.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:32:13.834 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:32:13.834 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:32:13.835 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:32:13.835 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:32:13.836 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:32:13.836 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:32:13.837 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:32:13.837 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:32:13.837 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:32:13.838 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:32:13.838 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:32:13.839 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:32:13.839 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:32:13.839 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:32:13.840 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:32:13.840 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:32:13.841 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:32:13.841 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:32:13.841 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:32:13.842 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:32:13.842 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:32:13.843 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:32:13.843 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:32:13.889 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.27469.asok 2020-05-18T21:32:13.894 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.27469.asok 2020-05-18T21:32:13.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:32:13.895 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.27469.asok status 2020-05-18T21:32:13.981 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:32:13.981 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:32:13.981 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:32:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:32:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:32:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:32:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:32:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "27469", 2020-05-18T21:32:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:32:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:32:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:32:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 7617, 2020-05-18T21:32:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:32:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:32:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:32:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 7617 2020-05-18T21:32:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:32:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:0", 2020-05-18T21:32:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 712715088 2020-05-18T21:32:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:32:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:0", 2020-05-18T21:32:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 712715088 2020-05-18T21:32:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.7617 172.21.15.63:0/712715088", 2020-05-18T21:32:13.987 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "172.21.15.63:0/712715088", 2020-05-18T21:32:13.987 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:32:13.987 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 64, 2020-05-18T21:32:13.987 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 86, 2020-05-18T21:32:13.987 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:32:13.988 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:32:13.988 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:32:13.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:32:13.990 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:32:13.990 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:32:13.997 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:32:13.999 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-05-18T21:32:13.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:32:14.000 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:32:14.017 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rm -f dir_1/original) 2020-05-18T21:32:14.095 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:32:14.095 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:32:14.096 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:32:14.110 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[27469]: fuse finished with error 0 and tester_r 0 2020-05-18T21:32:14.114 INFO:teuthology.orchestra.run:waiting for 900 2020-05-18T21:32:14.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:14.161 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:32:14.169 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:32:14.169 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:32:14.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:14.170 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 down' 2020-05-18T21:32:14.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:14.194 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.0' 2020-05-18T21:32:14.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:14.314 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:32:14.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:14.333 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:32:14.340 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:32:14.341 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:32:14.341 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:32:14.341 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:14.341 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:32:14.342 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:14.342 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:14.342 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:14.342 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:14.342 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:14.343 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:14.343 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:14.343 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:32:14.343 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:14.343 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:32:14.344 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42508sec preferred_lft 42508sec 2020-05-18T21:32:14.344 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:32:14.344 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:14.344 INFO:teuthology.orchestra.run.smithi063.stdout:25: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-05-18T21:32:14.344 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:14.344 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:32:14.345 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:14.345 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::388b:3eff:feb2:9a75/64 scope link 2020-05-18T21:32:14.345 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:14.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:14.346 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:32:14.364 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:32:14.364 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:32:14.365 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:32:14.365 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:14.365 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:32:14.365 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:14.365 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:32:14.366 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:14.366 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:32:14.366 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:14.366 INFO:teuthology.orchestra.run.smithi063.stdout:25: ceph-brx: mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000 2020-05-18T21:32:14.366 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:14.368 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:32:14.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:14.369 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:32:14.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:14.434 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:32:14.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:14.542 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:32:14.551 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:32:14.551 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:32:14.552 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:32:14.552 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:32:14.552 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:32:14.552 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:32:14.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:14.553 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:32:14.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:14.615 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:32:14.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:14.632 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:32:14.648 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump mds_cache strays_created 2020-05-18T21:32:14.756 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:32:14.756 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:32:14.756 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 1 2020-05-18T21:32:14.756 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:32:14.757 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:32:14.764 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_created": 1 } } 2020-05-18T21:32:14.765 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs max_mds 1 2020-05-18T21:32:14.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4ed38700 1 Processor -- start 2020-05-18T21:32:14.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4ed38700 1 -- start start 2020-05-18T21:32:14.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4ed38700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b480b3460 0x7f2b4806a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:14.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4ed38700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2b48065fe0 0x7f2b48145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:14.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4ed38700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4806a790 con 0x7f2b48069eb0 2020-05-18T21:32:14.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4ed38700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b48062420 con 0x7f2b48065fe0 2020-05-18T21:32:14.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4ed38700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b48062560 con 0x7f2b480b3460 2020-05-18T21:32:14.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4dd36700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2b48069eb0 0x7f2b4813fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32848/0 (socket says 172.21.15.63:32848) 2020-05-18T21:32:14.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4dd36700 1 -- 172.21.15.63:0/1928717526 learned_addr learned my addr 172.21.15.63:0/1928717526 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:14.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4e537700 1 --2- 172.21.15.63:0/1928717526 >> v2:172.21.15.155:3300/0 conn(0x7f2b48065fe0 0x7f2b48145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:14.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4d535700 1 --2- 172.21.15.63:0/1928717526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b480b3460 0x7f2b4806a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:14.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4cd34700 1 -- 172.21.15.63:0/1928717526 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402001183 0 0) 0x7f2b4806a790 con 0x7f2b48069eb0 2020-05-18T21:32:14.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4cd34700 1 -- 172.21.15.63:0/1928717526 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b30003270 con 0x7f2b48069eb0 2020-05-18T21:32:14.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4cd34700 1 -- 172.21.15.63:0/1928717526 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 496516414 0 0) 0x7f2b30003270 con 0x7f2b48069eb0 2020-05-18T21:32:14.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4cd34700 1 -- 172.21.15.63:0/1928717526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b480b3460 msgr2=0x7f2b4806a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:14.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4cd34700 1 --2- 172.21.15.63:0/1928717526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b480b3460 0x7f2b4806a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:14.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4cd34700 1 -- 172.21.15.63:0/1928717526 >> v2:172.21.15.155:3300/0 conn(0x7f2b48065fe0 msgr2=0x7f2b48145fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:14.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4cd34700 1 --2- 172.21.15.63:0/1928717526 >> v2:172.21.15.155:3300/0 conn(0x7f2b48065fe0 0x7f2b48145fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:14.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4cd34700 1 -- 172.21.15.63:0/1928717526 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4814a370 con 0x7f2b48069eb0 2020-05-18T21:32:14.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4cd34700 1 -- 172.21.15.63:0/1928717526 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f2b44001710 con 0x7f2b48069eb0 2020-05-18T21:32:14.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4cd34700 1 -- 172.21.15.63:0/1928717526 >> v1:172.21.15.63:6789/0 conn(0x7f2b48069eb0 legacy=0x7f2b4813fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:14.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4cd34700 1 --2- 172.21.15.63:0/1928717526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b30003760 0x7f2b30003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:14.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4cd34700 1 --2- 172.21.15.63:0/1928717526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b480b3460 0x7f2b30004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:14.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4cd34700 1 --2- 172.21.15.63:0/1928717526 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b30004970 0x7f2b30004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:14.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4cd34700 1 -- 172.21.15.63:0/1928717526 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b48062420 con 0x7f2b30004970 2020-05-18T21:32:14.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4cd34700 1 -- 172.21.15.63:0/1928717526 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b48062560 con 0x7f2b30003760 2020-05-18T21:32:14.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4cd34700 1 -- 172.21.15.63:0/1928717526 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b300053c0 con 0x7f2b480b3460 2020-05-18T21:32:14.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4e537700 1 --2- 172.21.15.63:0/1928717526 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b30004970 0x7f2b30004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:14.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4dd36700 1 --2- 172.21.15.63:0/1928717526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b30003760 0x7f2b30003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:14.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4d535700 1 --2- 172.21.15.63:0/1928717526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b480b3460 0x7f2b30004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:14.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4dd36700 1 -- 172.21.15.63:0/1928717526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b480b3460 msgr2=0x7f2b30004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:14.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4dd36700 1 --2- 172.21.15.63:0/1928717526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b480b3460 0x7f2b30004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:14.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4dd36700 1 -- 172.21.15.63:0/1928717526 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b30004970 msgr2=0x7f2b30004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:14.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4dd36700 1 --2- 172.21.15.63:0/1928717526 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b30004970 0x7f2b30004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:14.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4dd36700 1 -- 172.21.15.63:0/1928717526 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b30003270 con 0x7f2b30003760 2020-05-18T21:32:14.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4e537700 1 --2- 172.21.15.63:0/1928717526 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b30004970 0x7f2b30004df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:14.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4d535700 1 --2- 172.21.15.63:0/1928717526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b480b3460 0x7f2b30004510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:14.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4dd36700 1 --2- 172.21.15.63:0/1928717526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b30003760 0x7f2b30003b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2b44001420 tx=0x7f2b4814a500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:14.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4dd36700 1 --2- 172.21.15.63:0/1928717526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b30003760 0x7f2b30003b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2b44001420 tx=0x7f2b4814a500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:14.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.885+0000 7f2b4dd36700 1 --2- 172.21.15.63:0/1928717526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b30003760 0x7f2b30003b80 secure :-1 s=READY pgs=789 cs=0 l=1 rx=0x7f2b44001420 tx=0x7f2b4814a500).ready entity=mon.1 client_cookie=9a27fe1306959429 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:14.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.889+0000 7f2b4dd36700 1 --2- 172.21.15.63:0/1928717526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b30003760 0x7f2b30003b80 secure :-1 s=THROTTLE_DONE pgs=789 cs=0 l=1 rx=0x7f2b44001420 tx=0x7f2b4814a500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:14.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.889+0000 7f2b4cd34700 1 -- 172.21.15.63:0/1928717526 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b4400e180 con 0x7f2b30003760 2020-05-18T21:32:14.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.889+0000 7f2b4dd36700 1 --2- 172.21.15.63:0/1928717526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b30003760 0x7f2b30003b80 secure :-1 s=THROTTLE_DONE pgs=789 cs=0 l=1 rx=0x7f2b44001420 tx=0x7f2b4814a500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:14.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.889+0000 7f2b4cd34700 1 -- 172.21.15.63:0/1928717526 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4400e2e0 con 0x7f2b30003760 2020-05-18T21:32:14.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.889+0000 7f2b4dd36700 1 --2- 172.21.15.63:0/1928717526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b30003760 0x7f2b30003b80 secure :-1 s=THROTTLE_DONE pgs=789 cs=0 l=1 rx=0x7f2b44001420 tx=0x7f2b4814a500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:14.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.889+0000 7f2b4cd34700 1 -- 172.21.15.63:0/1928717526 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b4400e640 con 0x7f2b30003760 2020-05-18T21:32:14.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.889+0000 7f2b4ed38700 1 -- 172.21.15.63:0/1928717526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b30003760 msgr2=0x7f2b30003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:14.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.889+0000 7f2b4ed38700 1 --2- 172.21.15.63:0/1928717526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b30003760 0x7f2b30003b80 secure :-1 s=READY pgs=789 cs=0 l=1 rx=0x7f2b44001420 tx=0x7f2b4814a500).stop 2020-05-18T21:32:14.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.889+0000 7f2b4e537700 1 -- 172.21.15.63:0/1928717526 reap_dead start 2020-05-18T21:32:14.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.889+0000 7f2b4ed38700 1 -- 172.21.15.63:0/1928717526 shutdown_connections 2020-05-18T21:32:14.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.889+0000 7f2b4ed38700 1 -- 172.21.15.63:0/1928717526 >> 172.21.15.63:0/1928717526 conn(0x7f2b4805ebc0 msgr2=0x7f2b4805efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:14.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.889+0000 7f2b4ed38700 1 -- 172.21.15.63:0/1928717526 shutdown_connections 2020-05-18T21:32:14.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.889+0000 7f2b4ed38700 1 -- 172.21.15.63:0/1928717526 wait complete. 2020-05-18T21:32:14.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.889+0000 7f2b4ed38700 1 Processor -- start 2020-05-18T21:32:14.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b4ed38700 1 -- start start 2020-05-18T21:32:14.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b4ed38700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2b480651d0 0x7f2b48135cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:14.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b4ed38700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b48157390 con 0x7f2b4813d580 2020-05-18T21:32:14.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b4ed38700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b48153220 con 0x7f2b4813e000 2020-05-18T21:32:14.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b4ed38700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4813cf90 con 0x7f2b480651d0 2020-05-18T21:32:14.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b4e537700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2b4813d580 0x7f2b481536c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32864/0 (socket says 172.21.15.63:32864) 2020-05-18T21:32:14.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b4e537700 1 -- 172.21.15.63:0/461739161 learned_addr learned my addr 172.21.15.63:0/461739161 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:14.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b4dd36700 1 --2- 172.21.15.63:0/461739161 >> v2:172.21.15.155:3300/0 conn(0x7f2b480651d0 0x7f2b48135cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:14.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207615039 0 0) 0x7f2b48157390 con 0x7f2b4813d580 2020-05-18T21:32:14.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b28002fe0 con 0x7f2b4813d580 2020-05-18T21:32:14.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423365484 0 0) 0x7f2b48153220 con 0x7f2b4813e000 2020-05-18T21:32:14.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b48157390 con 0x7f2b4813e000 2020-05-18T21:32:14.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1145012589 0 0) 0x7f2b28002fe0 con 0x7f2b4813d580 2020-05-18T21:32:14.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2b48153220 con 0x7f2b4813d580 2020-05-18T21:32:14.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f2b40001850 con 0x7f2b4813d580 2020-05-18T21:32:14.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 >> v2:172.21.15.155:3300/0 conn(0x7f2b480651d0 msgr2=0x7f2b48135cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:14.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b36ffd700 1 --2- 172.21.15.63:0/461739161 >> v2:172.21.15.155:3300/0 conn(0x7f2b480651d0 0x7f2b48135cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:14.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 >> v1:172.21.15.155:6789/0 conn(0x7f2b4813e000 legacy=0x7f2b4813c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:14.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 >> v1:172.21.15.63:6789/0 conn(0x7f2b4813d580 legacy=0x7f2b481536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:14.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b36ffd700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b28004bf0 0x7f2b28004fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:14.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b36ffd700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b28003b30 0x7f2b28003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:14.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b36ffd700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b28004410 0x7f2b2800b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:14.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4813cf90 con 0x7f2b28003b30 2020-05-18T21:32:14.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b28004920 con 0x7f2b28004410 2020-05-18T21:32:14.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2800bbc0 con 0x7f2b28004bf0 2020-05-18T21:32:14.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b4dd36700 1 --2- 172.21.15.63:0/461739161 >> v2:172.21.15.155:3300/0 conn(0x7f2b480651d0 0x7f2b48135cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:14.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b4d535700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b28003b30 0x7f2b28003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:14.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.893+0000 7f2b4e537700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b28004410 0x7f2b2800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:14.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b4dd36700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b28004bf0 0x7f2b28004fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:14.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b4d535700 1 -- 172.21.15.63:0/461739161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b28004bf0 msgr2=0x7f2b28004fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:14.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b4d535700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b28004bf0 0x7f2b28004fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:14.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b4d535700 1 -- 172.21.15.63:0/461739161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b28004410 msgr2=0x7f2b2800b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:14.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b4d535700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b28004410 0x7f2b2800b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:14.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b4e537700 1 -- 172.21.15.63:0/461739161 reap_dead start 2020-05-18T21:32:14.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b4d535700 1 -- 172.21.15.63:0/461739161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b480655b0 con 0x7f2b28003b30 2020-05-18T21:32:14.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b4ed38700 1 -- 172.21.15.63:0/461739161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b48156fd0 con 0x7f2b28003b30 2020-05-18T21:32:14.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b4d535700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b28003b30 0x7f2b28003fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b380030b0 tx=0x7f2b28004ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:14.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b4ed38700 1 -- 172.21.15.63:0/461739161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b48135e60 con 0x7f2b28003b30 2020-05-18T21:32:14.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b4d535700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b28003b30 0x7f2b28003fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b380030b0 tx=0x7f2b28004ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:14.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b4d535700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b28003b30 0x7f2b28003fb0 secure :-1 s=READY pgs=1152 cs=0 l=1 rx=0x7f2b380030b0 tx=0x7f2b28004ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:14.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b4d535700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b28003b30 0x7f2b28003fb0 secure :-1 s=THROTTLE_DONE pgs=1152 cs=0 l=1 rx=0x7f2b380030b0 tx=0x7f2b28004ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:14.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b38011830 con 0x7f2b28003b30 2020-05-18T21:32:14.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b4d535700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b28003b30 0x7f2b28003fb0 secure :-1 s=THROTTLE_DONE pgs=1152 cs=0 l=1 rx=0x7f2b380030b0 tx=0x7f2b28004ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:14.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b4d535700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b28003b30 0x7f2b28003fb0 secure :-1 s=THROTTLE_DONE pgs=1152 cs=0 l=1 rx=0x7f2b380030b0 tx=0x7f2b28004ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:14.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b38011990 con 0x7f2b28003b30 2020-05-18T21:32:14.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b38011d30 con 0x7f2b28003b30 2020-05-18T21:32:14.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b4d535700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b28003b30 0x7f2b28003fb0 secure :-1 s=THROTTLE_DONE pgs=1152 cs=0 l=1 rx=0x7f2b380030b0 tx=0x7f2b28004ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:14.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b4ed38700 1 -- 172.21.15.63:0/461739161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b24003380 con 0x7f2b28003b30 2020-05-18T21:32:14.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2b38008730 con 0x7f2b28003b30 2020-05-18T21:32:14.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b4d535700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b28003b30 0x7f2b28003fb0 secure :-1 s=THROTTLE_DONE pgs=1152 cs=0 l=1 rx=0x7f2b380030b0 tx=0x7f2b28004ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:14.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.897+0000 7f2b36ffd700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2b280530d0 0x7f2b28055590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:14.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.901+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f2b38063a00 con 0x7f2b28003b30 2020-05-18T21:32:14.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.901+0000 7f2b4dd36700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2b280530d0 0x7f2b28055590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:14.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.901+0000 7f2b4dd36700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2b280530d0 0x7f2b28055590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b44001420 tx=0x7f2b4814a500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:14.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.901+0000 7f2b4dd36700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2b280530d0 0x7f2b28055590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b44001420 tx=0x7f2b4814a500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:14.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.901+0000 7f2b4dd36700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2b280530d0 0x7f2b28055590 secure :-1 s=READY pgs=455 cs=0 l=1 rx=0x7f2b44001420 tx=0x7f2b4814a500).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:14.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.905+0000 7f2b4d535700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b28003b30 0x7f2b28003fb0 secure :-1 s=THROTTLE_DONE pgs=1152 cs=0 l=1 rx=0x7f2b380030b0 tx=0x7f2b28004ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:14.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:14.905+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2b3803deb0 con 0x7f2b28003b30 2020-05-18T21:32:15.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.065+0000 7f2b4ed38700 1 -- 172.21.15.63:0/461739161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f2b24002240 con 0x7f2b28003b30 2020-05-18T21:32:15.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.189+0000 7f2b4d535700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b28003b30 0x7f2b28003fb0 secure :-1 s=THROTTLE_DONE pgs=1152 cs=0 l=1 rx=0x7f2b380030b0 tx=0x7f2b28004ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:15.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.189+0000 7f2b36ffd700 1 -- 172.21.15.63:0/461739161 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v65) v1 ==== 105+0+0 (secure 0 0 0) 0x7f2b380414d0 con 0x7f2b28003b30 2020-05-18T21:32:15.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.193+0000 7f2b4ed38700 1 -- 172.21.15.63:0/461739161 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2b280530d0 msgr2=0x7f2b28055590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:15.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.193+0000 7f2b4ed38700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2b280530d0 0x7f2b28055590 secure :-1 s=READY pgs=455 cs=0 l=1 rx=0x7f2b44001420 tx=0x7f2b4814a500).stop 2020-05-18T21:32:15.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.193+0000 7f2b4ed38700 1 -- 172.21.15.63:0/461739161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b28003b30 msgr2=0x7f2b28003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:15.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.193+0000 7f2b4ed38700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b28003b30 0x7f2b28003fb0 secure :-1 s=READY pgs=1152 cs=0 l=1 rx=0x7f2b380030b0 tx=0x7f2b28004ae0).stop 2020-05-18T21:32:15.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.193+0000 7f2b4ed38700 1 -- 172.21.15.63:0/461739161 shutdown_connections 2020-05-18T21:32:15.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.193+0000 7f2b4ed38700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2b280530d0 0x7f2b28055590 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:15.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.193+0000 7f2b4ed38700 1 --2- 172.21.15.63:0/461739161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b28003b30 0x7f2b28003fb0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:15.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.193+0000 7f2b4ed38700 1 -- 172.21.15.63:0/461739161 >> 172.21.15.63:0/461739161 conn(0x7f2b4805ebc0 msgr2=0x7f2b480b6140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:15.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.193+0000 7f2b4ed38700 1 -- 172.21.15.63:0/461739161 shutdown_connections 2020-05-18T21:32:15.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.193+0000 7f2b4ed38700 1 -- 172.21.15.63:0/461739161 wait complete. 2020-05-18T21:32:15.213 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:15.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968fc84700 1 Processor -- start 2020-05-18T21:32:15.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968fc84700 1 -- start start 2020-05-18T21:32:15.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968fc84700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9688064860 0x7f9688146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:15.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968fc84700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f968805ee70 0x7f968805f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:15.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968fc84700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968812bc50 con 0x7f9688060770 2020-05-18T21:32:15.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968fc84700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96880625f0 con 0x7f968805ee70 2020-05-18T21:32:15.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968fc84700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968812bef0 con 0x7f9688064860 2020-05-18T21:32:15.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968e221700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9688060770 0x7f9688060c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32874/0 (socket says 172.21.15.63:32874) 2020-05-18T21:32:15.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968e221700 1 -- 172.21.15.63:0/3571798425 learned_addr learned my addr 172.21.15.63:0/3571798425 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:15.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968d21f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f968805ee70 0x7f968805f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:15.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968da20700 1 --2- 172.21.15.63:0/3571798425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9688064860 0x7f9688146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:15.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968ca1e700 1 -- 172.21.15.63:0/3571798425 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623599812 0 0) 0x7f968812bc50 con 0x7f9688060770 2020-05-18T21:32:15.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968ca1e700 1 -- 172.21.15.63:0/3571798425 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9670003270 con 0x7f9688060770 2020-05-18T21:32:15.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968d21f700 1 -- 172.21.15.63:0/3571798425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9688064860 msgr2=0x7f9688146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:15.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968d21f700 1 --2- 172.21.15.63:0/3571798425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9688064860 0x7f9688146ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:15.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968d21f700 1 -- 172.21.15.63:0/3571798425 >> v1:172.21.15.63:6789/0 conn(0x7f9688060770 legacy=0x7f9688060c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:15.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968d21f700 1 -- 172.21.15.63:0/3571798425 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968812c190 con 0x7f968805ee70 2020-05-18T21:32:15.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968d21f700 1 --2- 172.21.15.63:0/3571798425 >> v2:172.21.15.63:3300/0 conn(0x7f968805ee70 0x7f968805f2b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9678002f70 tx=0x7f9678007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:15.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968d21f700 1 --2- 172.21.15.63:0/3571798425 >> v2:172.21.15.63:3300/0 conn(0x7f968805ee70 0x7f968805f2b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9678002f70 tx=0x7f9678007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:15.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968d21f700 1 --2- 172.21.15.63:0/3571798425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f968805ee70 0x7f968805f2b0 secure :-1 s=READY pgs=1154 cs=0 l=1 rx=0x7f9678002f70 tx=0x7f9678007a80).ready entity=mon.0 client_cookie=9992674b4f2fe765 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:15.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968d21f700 1 --2- 172.21.15.63:0/3571798425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f968805ee70 0x7f968805f2b0 secure :-1 s=THROTTLE_DONE pgs=1154 cs=0 l=1 rx=0x7f9678002f70 tx=0x7f9678007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:15.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968ca1e700 1 -- 172.21.15.63:0/3571798425 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9678008e80 con 0x7f968805ee70 2020-05-18T21:32:15.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968d21f700 1 --2- 172.21.15.63:0/3571798425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f968805ee70 0x7f968805f2b0 secure :-1 s=THROTTLE_DONE pgs=1154 cs=0 l=1 rx=0x7f9678002f70 tx=0x7f9678007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:15.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968ca1e700 1 -- 172.21.15.63:0/3571798425 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9678011540 con 0x7f968805ee70 2020-05-18T21:32:15.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968d21f700 1 --2- 172.21.15.63:0/3571798425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f968805ee70 0x7f968805f2b0 secure :-1 s=THROTTLE_DONE pgs=1154 cs=0 l=1 rx=0x7f9678002f70 tx=0x7f9678007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:15.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968ca1e700 1 -- 172.21.15.63:0/3571798425 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9678011920 con 0x7f968805ee70 2020-05-18T21:32:15.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968fc84700 1 -- 172.21.15.63:0/3571798425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f968805ee70 msgr2=0x7f968805f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:15.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.317+0000 7f968fc84700 1 --2- 172.21.15.63:0/3571798425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f968805ee70 0x7f968805f2b0 secure :-1 s=READY pgs=1154 cs=0 l=1 rx=0x7f9678002f70 tx=0x7f9678007a80).stop 2020-05-18T21:32:15.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.321+0000 7f968fc84700 1 -- 172.21.15.63:0/3571798425 shutdown_connections 2020-05-18T21:32:15.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.321+0000 7f968fc84700 1 --2- 172.21.15.63:0/3571798425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f968805ee70 0x7f968805f2b0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:15.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.321+0000 7f968fc84700 1 --2- 172.21.15.63:0/3571798425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9688064860 0x7f9688146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:15.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.321+0000 7f968fc84700 1 -- 172.21.15.63:0/3571798425 >> 172.21.15.63:0/3571798425 conn(0x7f9688069fc0 msgr2=0x7f968806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:15.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.321+0000 7f968fc84700 1 -- 172.21.15.63:0/3571798425 shutdown_connections 2020-05-18T21:32:15.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.321+0000 7f968fc84700 1 -- 172.21.15.63:0/3571798425 wait complete. 2020-05-18T21:32:15.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.321+0000 7f968fc84700 1 Processor -- start 2020-05-18T21:32:15.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.321+0000 7f968fc84700 1 -- start start 2020-05-18T21:32:15.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.321+0000 7f968fc84700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9688060770 0x7f96880acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:15.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.321+0000 7f968fc84700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96880af430 con 0x7f9688064860 2020-05-18T21:32:15.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.321+0000 7f968fc84700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9688150c30 con 0x7f968805ee70 2020-05-18T21:32:15.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.321+0000 7f968fc84700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96880b0750 con 0x7f9688060770 2020-05-18T21:32:15.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.321+0000 7f968e221700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9688064860 0x7f96880b0de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32882/0 (socket says 172.21.15.63:32882) 2020-05-18T21:32:15.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.321+0000 7f968e221700 1 -- 172.21.15.63:0/963361106 learned_addr learned my addr 172.21.15.63:0/963361106 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:15.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.321+0000 7f968d21f700 1 --2- 172.21.15.63:0/963361106 >> v2:172.21.15.155:3300/0 conn(0x7f9688060770 0x7f96880acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:15.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.321+0000 7f9676ffd700 1 -- 172.21.15.63:0/963361106 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709308570 0 0) 0x7f96880af430 con 0x7f9688064860 2020-05-18T21:32:15.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.321+0000 7f9676ffd700 1 -- 172.21.15.63:0/963361106 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9668002fe0 con 0x7f9688064860 2020-05-18T21:32:15.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f968d21f700 1 -- 172.21.15.63:0/963361106 >> v1:172.21.15.155:6789/0 conn(0x7f968805ee70 legacy=0x7f968814f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:15.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f968d21f700 1 -- 172.21.15.63:0/963361106 >> v1:172.21.15.63:6789/0 conn(0x7f9688064860 legacy=0x7f96880b0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:15.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f968d21f700 1 -- 172.21.15.63:0/963361106 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96880b0940 con 0x7f9688060770 2020-05-18T21:32:15.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f968d21f700 1 --2- 172.21.15.63:0/963361106 >> v2:172.21.15.155:3300/0 conn(0x7f9688060770 0x7f96880acff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9678002f70 tx=0x7f9678007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:15.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f968d21f700 1 --2- 172.21.15.63:0/963361106 >> v2:172.21.15.155:3300/0 conn(0x7f9688060770 0x7f96880acff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9678002f70 tx=0x7f9678007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:15.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f968d21f700 1 --2- 172.21.15.63:0/963361106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9688060770 0x7f96880acff0 secure :-1 s=READY pgs=792 cs=0 l=1 rx=0x7f9678002f70 tx=0x7f9678007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:15.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f968d21f700 1 --2- 172.21.15.63:0/963361106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9688060770 0x7f96880acff0 secure :-1 s=THROTTLE_DONE pgs=792 cs=0 l=1 rx=0x7f9678002f70 tx=0x7f9678007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:15.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f9676ffd700 1 -- 172.21.15.63:0/963361106 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9678007170 con 0x7f9688060770 2020-05-18T21:32:15.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f968d21f700 1 --2- 172.21.15.63:0/963361106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9688060770 0x7f96880acff0 secure :-1 s=THROTTLE_DONE pgs=792 cs=0 l=1 rx=0x7f9678002f70 tx=0x7f9678007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:15.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f968d21f700 1 --2- 172.21.15.63:0/963361106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9688060770 0x7f96880acff0 secure :-1 s=THROTTLE_DONE pgs=792 cs=0 l=1 rx=0x7f9678002f70 tx=0x7f9678007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:15.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f9676ffd700 1 -- 172.21.15.63:0/963361106 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96780072d0 con 0x7f9688060770 2020-05-18T21:32:15.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f968fc84700 1 -- 172.21.15.63:0/963361106 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96880ad450 con 0x7f9688060770 2020-05-18T21:32:15.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f9676ffd700 1 -- 172.21.15.63:0/963361106 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9678005700 con 0x7f9688060770 2020-05-18T21:32:15.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f968fc84700 1 -- 172.21.15.63:0/963361106 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96880acda0 con 0x7f9688060770 2020-05-18T21:32:15.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f968d21f700 1 --2- 172.21.15.63:0/963361106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9688060770 0x7f96880acff0 secure :-1 s=THROTTLE_DONE pgs=792 cs=0 l=1 rx=0x7f9678002f70 tx=0x7f9678007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:15.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f968fc84700 1 -- 172.21.15.63:0/963361106 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96880569e0 con 0x7f9688060770 2020-05-18T21:32:15.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f9676ffd700 1 -- 172.21.15.63:0/963361106 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9678005980 con 0x7f9688060770 2020-05-18T21:32:15.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f968d21f700 1 --2- 172.21.15.63:0/963361106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9688060770 0x7f96880acff0 secure :-1 s=THROTTLE_DONE pgs=792 cs=0 l=1 rx=0x7f9678002f70 tx=0x7f9678007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:15.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f9676ffd700 1 --2- 172.21.15.63:0/963361106 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f966804fce0 0x7f96680521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:15.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.325+0000 7f9676ffd700 1 -- 172.21.15.63:0/963361106 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f9678064370 con 0x7f9688060770 2020-05-18T21:32:15.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.329+0000 7f968da20700 1 --2- 172.21.15.63:0/963361106 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f966804fce0 0x7f96680521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:15.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.329+0000 7f968da20700 1 --2- 172.21.15.63:0/963361106 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f966804fce0 0x7f96680521a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96880b8d20 tx=0x7f9688067990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:15.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.329+0000 7f968da20700 1 --2- 172.21.15.63:0/963361106 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f966804fce0 0x7f96680521a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96880b8d20 tx=0x7f9688067990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:15.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.329+0000 7f968da20700 1 --2- 172.21.15.63:0/963361106 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f966804fce0 0x7f96680521a0 secure :-1 s=READY pgs=456 cs=0 l=1 rx=0x7f96880b8d20 tx=0x7f9688067990).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:15.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.337+0000 7f968d21f700 1 --2- 172.21.15.63:0/963361106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9688060770 0x7f96880acff0 secure :-1 s=THROTTLE_DONE pgs=792 cs=0 l=1 rx=0x7f9678002f70 tx=0x7f9678007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:15.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.337+0000 7f9676ffd700 1 -- 172.21.15.63:0/963361106 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f967803e820 con 0x7f9688060770 2020-05-18T21:32:15.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.485+0000 7f968fc84700 1 -- 172.21.15.63:0/963361106 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96880acda0 con 0x7f9688060770 2020-05-18T21:32:15.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.485+0000 7f968d21f700 1 --2- 172.21.15.63:0/963361106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9688060770 0x7f96880acff0 secure :-1 s=THROTTLE_DONE pgs=792 cs=0 l=1 rx=0x7f9678002f70 tx=0x7f9678007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:15.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.485+0000 7f9676ffd700 1 -- 172.21.15.63:0/963361106 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2158 (secure 0 0 0) 0x7f96880acda0 con 0x7f9688060770 2020-05-18T21:32:15.490 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:15.491 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:15.195670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:stopping","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:15.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.489+0000 7f968fc84700 1 -- 172.21.15.63:0/963361106 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f966804fce0 msgr2=0x7f96680521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:15.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.489+0000 7f968fc84700 1 --2- 172.21.15.63:0/963361106 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f966804fce0 0x7f96680521a0 secure :-1 s=READY pgs=456 cs=0 l=1 rx=0x7f96880b8d20 tx=0x7f9688067990).stop 2020-05-18T21:32:15.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.489+0000 7f968fc84700 1 -- 172.21.15.63:0/963361106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9688060770 msgr2=0x7f96880acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:15.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.489+0000 7f968fc84700 1 --2- 172.21.15.63:0/963361106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9688060770 0x7f96880acff0 secure :-1 s=READY pgs=792 cs=0 l=1 rx=0x7f9678002f70 tx=0x7f9678007a80).stop 2020-05-18T21:32:15.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.489+0000 7f968fc84700 1 -- 172.21.15.63:0/963361106 shutdown_connections 2020-05-18T21:32:15.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.489+0000 7f968fc84700 1 --2- 172.21.15.63:0/963361106 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f966804fce0 0x7f96680521a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:15.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.489+0000 7f968fc84700 1 --2- 172.21.15.63:0/963361106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9688060770 0x7f96880acff0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:15.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.489+0000 7f968fc84700 1 -- 172.21.15.63:0/963361106 >> 172.21.15.63:0/963361106 conn(0x7f9688069fc0 msgr2=0x7f968806a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:15.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.489+0000 7f968fc84700 1 -- 172.21.15.63:0/963361106 shutdown_connections 2020-05-18T21:32:15.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:15.489+0000 7f968fc84700 1 -- 172.21.15.63:0/963361106 wait complete. 2020-05-18T21:32:15.494 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 66 2020-05-18T21:32:15.705 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:15.195670+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:stopping', 'state_seq': 6, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:15.705 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5756:up:stopping 2020-05-18T21:32:16.710 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:16.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.817+0000 7ff70b9e7700 1 Processor -- start 2020-05-18T21:32:16.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff70b9e7700 1 -- start start 2020-05-18T21:32:16.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff70b9e7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff7040615e0 0x7ff70414e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:16.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff70b9e7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70414d960 con 0x7ff704060b90 2020-05-18T21:32:16.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff70b9e7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70414db90 con 0x7ff7040b2860 2020-05-18T21:32:16.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff70b9e7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff704066210 con 0x7ff7040615e0 2020-05-18T21:32:16.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff709783700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff704060b90 0x7ff704144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32890/0 (socket says 172.21.15.63:32890) 2020-05-18T21:32:16.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff709783700 1 -- 172.21.15.63:0/3999338863 learned_addr learned my addr 172.21.15.63:0/3999338863 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:16.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff709f84700 1 --2- 172.21.15.63:0/3999338863 >> v2:172.21.15.155:3300/0 conn(0x7ff7040615e0 0x7ff70414e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:16.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff6f7fff700 1 -- 172.21.15.63:0/3999338863 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52973181 0 0) 0x7ff70414d960 con 0x7ff704060b90 2020-05-18T21:32:16.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff6f7fff700 1 -- 172.21.15.63:0/3999338863 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6e8003270 con 0x7ff704060b90 2020-05-18T21:32:16.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff6f7fff700 1 -- 172.21.15.63:0/3999338863 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626382522 0 0) 0x7ff70414db90 con 0x7ff7040b2860 2020-05-18T21:32:16.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff6f7fff700 1 -- 172.21.15.63:0/3999338863 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff70414d960 con 0x7ff7040b2860 2020-05-18T21:32:16.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff709f84700 1 -- 172.21.15.63:0/3999338863 >> v1:172.21.15.155:6789/0 conn(0x7ff7040b2860 legacy=0x7ff70414a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:16.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff709f84700 1 -- 172.21.15.63:0/3999338863 >> v1:172.21.15.63:6789/0 conn(0x7ff704060b90 legacy=0x7ff704144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:16.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff709f84700 1 -- 172.21.15.63:0/3999338863 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70414de30 con 0x7ff7040615e0 2020-05-18T21:32:16.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff709f84700 1 --2- 172.21.15.63:0/3999338863 >> v2:172.21.15.155:3300/0 conn(0x7ff7040615e0 0x7ff70414e570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff6fc0032f0 tx=0x7ff6fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:16.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff709f84700 1 --2- 172.21.15.63:0/3999338863 >> v2:172.21.15.155:3300/0 conn(0x7ff7040615e0 0x7ff70414e570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff6fc0032f0 tx=0x7ff6fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:16.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff709f84700 1 --2- 172.21.15.63:0/3999338863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7040615e0 0x7ff70414e570 secure :-1 s=READY pgs=794 cs=0 l=1 rx=0x7ff6fc0032f0 tx=0x7ff6fc007e00).ready entity=mon.1 client_cookie=7bf9545e6c40863a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:16.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff709f84700 1 --2- 172.21.15.63:0/3999338863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7040615e0 0x7ff70414e570 secure :-1 s=THROTTLE_DONE pgs=794 cs=0 l=1 rx=0x7ff6fc0032f0 tx=0x7ff6fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:16.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff6f7fff700 1 -- 172.21.15.63:0/3999338863 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6fc011db0 con 0x7ff7040615e0 2020-05-18T21:32:16.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff709f84700 1 --2- 172.21.15.63:0/3999338863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7040615e0 0x7ff70414e570 secure :-1 s=THROTTLE_DONE pgs=794 cs=0 l=1 rx=0x7ff6fc0032f0 tx=0x7ff6fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:16.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff709f84700 1 --2- 172.21.15.63:0/3999338863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7040615e0 0x7ff70414e570 secure :-1 s=THROTTLE_DONE pgs=794 cs=0 l=1 rx=0x7ff6fc0032f0 tx=0x7ff6fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:16.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff6f7fff700 1 -- 172.21.15.63:0/3999338863 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc00a180 con 0x7ff7040615e0 2020-05-18T21:32:16.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff70b9e7700 1 -- 172.21.15.63:0/3999338863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7040615e0 msgr2=0x7ff70414e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:16.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff6f7fff700 1 -- 172.21.15.63:0/3999338863 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6fc00a560 con 0x7ff7040615e0 2020-05-18T21:32:16.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.821+0000 7ff70b9e7700 1 --2- 172.21.15.63:0/3999338863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7040615e0 0x7ff70414e570 secure :-1 s=READY pgs=794 cs=0 l=1 rx=0x7ff6fc0032f0 tx=0x7ff6fc007e00).stop 2020-05-18T21:32:16.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.825+0000 7ff70b9e7700 1 -- 172.21.15.63:0/3999338863 shutdown_connections 2020-05-18T21:32:16.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.825+0000 7ff70b9e7700 1 --2- 172.21.15.63:0/3999338863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7040615e0 0x7ff70414e570 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:16.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.825+0000 7ff70b9e7700 1 -- 172.21.15.63:0/3999338863 >> 172.21.15.63:0/3999338863 conn(0x7ff7040b83d0 msgr2=0x7ff7040b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:16.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.825+0000 7ff70b9e7700 1 -- 172.21.15.63:0/3999338863 shutdown_connections 2020-05-18T21:32:16.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.825+0000 7ff70b9e7700 1 -- 172.21.15.63:0/3999338863 wait complete. 2020-05-18T21:32:16.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.825+0000 7ff70b9e7700 1 Processor -- start 2020-05-18T21:32:16.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.825+0000 7ff70b9e7700 1 -- start start 2020-05-18T21:32:16.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.825+0000 7ff70b9e7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff704060b90 0x7ff704147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:16.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.825+0000 7ff70b9e7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7040b2860 0x7ff7041491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:16.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.825+0000 7ff70b9e7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff704147720 con 0x7ff7040615e0 2020-05-18T21:32:16.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.825+0000 7ff70b9e7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff70415af20 con 0x7ff704060b90 2020-05-18T21:32:16.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.825+0000 7ff70b9e7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7040acbe0 con 0x7ff7040b2860 2020-05-18T21:32:16.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.825+0000 7ff709783700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff704060b90 0x7ff704147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:16.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.825+0000 7ff709783700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff704060b90 0x7ff704147210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58938/0 (socket says 172.21.15.63:58938) 2020-05-18T21:32:16.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.825+0000 7ff709783700 1 -- 172.21.15.63:0/2691866492 learned_addr learned my addr 172.21.15.63:0/2691866492 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:16.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.825+0000 7ff709f84700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7040b2860 0x7ff7041491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:16.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff6f67fc700 1 -- 172.21.15.63:0/2691866492 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804609650 0 0) 0x7ff704147720 con 0x7ff7040615e0 2020-05-18T21:32:16.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff6f67fc700 1 -- 172.21.15.63:0/2691866492 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6ec002fe0 con 0x7ff7040615e0 2020-05-18T21:32:16.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff709783700 1 -- 172.21.15.63:0/2691866492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7040b2860 msgr2=0x7ff7041491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:16.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff709783700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7040b2860 0x7ff7041491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:16.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff709783700 1 -- 172.21.15.63:0/2691866492 >> v1:172.21.15.155:6789/0 conn(0x7ff7040615e0 legacy=0x7ff7040ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:16.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff709783700 1 -- 172.21.15.63:0/2691866492 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff704148ea0 con 0x7ff704060b90 2020-05-18T21:32:16.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff709783700 1 --2- 172.21.15.63:0/2691866492 >> v2:172.21.15.63:3300/0 conn(0x7ff704060b90 0x7ff704147210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff6f8001110 tx=0x7ff6f80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:16.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff709783700 1 --2- 172.21.15.63:0/2691866492 >> v2:172.21.15.63:3300/0 conn(0x7ff704060b90 0x7ff704147210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff6f8001110 tx=0x7ff6f80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:16.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff709783700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff704060b90 0x7ff704147210 secure :-1 s=READY pgs=1157 cs=0 l=1 rx=0x7ff6f8001110 tx=0x7ff6f80109b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:16.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff709783700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff704060b90 0x7ff704147210 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7ff6f8001110 tx=0x7ff6f80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:16.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff6f67fc700 1 -- 172.21.15.63:0/2691866492 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6f8005d00 con 0x7ff704060b90 2020-05-18T21:32:16.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff709783700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff704060b90 0x7ff704147210 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7ff6f8001110 tx=0x7ff6f80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:16.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff709783700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff704060b90 0x7ff704147210 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7ff6f8001110 tx=0x7ff6f80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:16.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff6f67fc700 1 -- 172.21.15.63:0/2691866492 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f8005e60 con 0x7ff704060b90 2020-05-18T21:32:16.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff70b9e7700 1 -- 172.21.15.63:0/2691866492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff704157350 con 0x7ff704060b90 2020-05-18T21:32:16.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff6f67fc700 1 -- 172.21.15.63:0/2691866492 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6f80062c0 con 0x7ff704060b90 2020-05-18T21:32:16.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff70b9e7700 1 -- 172.21.15.63:0/2691866492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff704144aa0 con 0x7ff704060b90 2020-05-18T21:32:16.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff70b9e7700 1 -- 172.21.15.63:0/2691866492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7040569e0 con 0x7ff704060b90 2020-05-18T21:32:16.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff709783700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff704060b90 0x7ff704147210 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7ff6f8001110 tx=0x7ff6f80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:16.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff6f67fc700 1 -- 172.21.15.63:0/2691866492 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff6f8006500 con 0x7ff704060b90 2020-05-18T21:32:16.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.829+0000 7ff709783700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff704060b90 0x7ff704147210 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7ff6f8001110 tx=0x7ff6f80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:16.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.833+0000 7ff6f67fc700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff6ec04fdb0 0x7ff6ec052270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:16.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.833+0000 7ff6f67fc700 1 -- 172.21.15.63:0/2691866492 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7ff6f80090c0 con 0x7ff704060b90 2020-05-18T21:32:16.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.833+0000 7ff708f82700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff6ec04fdb0 0x7ff6ec052270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:16.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.833+0000 7ff708f82700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff6ec04fdb0 0x7ff6ec052270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff700001350 tx=0x7ff7000027e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:16.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.833+0000 7ff708f82700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff6ec04fdb0 0x7ff6ec052270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff700001350 tx=0x7ff7000027e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:16.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.833+0000 7ff708f82700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff6ec04fdb0 0x7ff6ec052270 secure :-1 s=READY pgs=457 cs=0 l=1 rx=0x7ff700001350 tx=0x7ff7000027e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:16.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.837+0000 7ff709783700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff704060b90 0x7ff704147210 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7ff6f8001110 tx=0x7ff6f80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:16.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.837+0000 7ff6f67fc700 1 -- 172.21.15.63:0/2691866492 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff6f8067e60 con 0x7ff704060b90 2020-05-18T21:32:16.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.989+0000 7ff70b9e7700 1 -- 172.21.15.63:0/2691866492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7041478b0 con 0x7ff704060b90 2020-05-18T21:32:16.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.989+0000 7ff709783700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff704060b90 0x7ff704147210 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7ff6f8001110 tx=0x7ff6f80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:16.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.989+0000 7ff6f67fc700 1 -- 172.21.15.63:0/2691866492 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2158 (secure 0 0 0) 0x7ff6f803e080 con 0x7ff704060b90 2020-05-18T21:32:16.994 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:16.994 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:15.195670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:stopping","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:16.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.989+0000 7ff70b9e7700 1 -- 172.21.15.63:0/2691866492 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff6ec04fdb0 msgr2=0x7ff6ec052270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:16.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.989+0000 7ff70b9e7700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff6ec04fdb0 0x7ff6ec052270 secure :-1 s=READY pgs=457 cs=0 l=1 rx=0x7ff700001350 tx=0x7ff7000027e0).stop 2020-05-18T21:32:16.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.989+0000 7ff70b9e7700 1 -- 172.21.15.63:0/2691866492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff704060b90 msgr2=0x7ff704147210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:16.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.989+0000 7ff70b9e7700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff704060b90 0x7ff704147210 secure :-1 s=READY pgs=1157 cs=0 l=1 rx=0x7ff6f8001110 tx=0x7ff6f80109b0).stop 2020-05-18T21:32:16.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.993+0000 7ff70b9e7700 1 -- 172.21.15.63:0/2691866492 shutdown_connections 2020-05-18T21:32:16.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.993+0000 7ff70b9e7700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff6ec04fdb0 0x7ff6ec052270 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:16.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.993+0000 7ff70b9e7700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7040b2860 0x7ff7041491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:16.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.993+0000 7ff70b9e7700 1 --2- 172.21.15.63:0/2691866492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff704060b90 0x7ff704147210 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:16.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.993+0000 7ff70b9e7700 1 -- 172.21.15.63:0/2691866492 >> 172.21.15.63:0/2691866492 conn(0x7ff7040b83d0 msgr2=0x7ff70414ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:16.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.993+0000 7ff70b9e7700 1 -- 172.21.15.63:0/2691866492 shutdown_connections 2020-05-18T21:32:16.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:16.993+0000 7ff70b9e7700 1 -- 172.21.15.63:0/2691866492 wait complete. 2020-05-18T21:32:16.998 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 66 2020-05-18T21:32:17.208 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:15.195670+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:stopping', 'state_seq': 6, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:17.208 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5756:up:stopping 2020-05-18T21:32:18.210 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:18.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.317+0000 7fabbdf5f700 1 Processor -- start 2020-05-18T21:32:18.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.317+0000 7fabbdf5f700 1 -- start start 2020-05-18T21:32:18.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbdf5f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fabb8066200 0x7fabb805b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:18.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbdf5f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fabb8143690 0x7fabb8149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:18.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbdf5f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb8146180 con 0x7fabb8146b60 2020-05-18T21:32:18.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbdf5f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb8146420 con 0x7fabb8066200 2020-05-18T21:32:18.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbdf5f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb81466c0 con 0x7fabb8143690 2020-05-18T21:32:18.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbcf5d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fabb8066200 0x7fabb805b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:18.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbcf5d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fabb8066200 0x7fabb805b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58948/0 (socket says 172.21.15.63:58948) 2020-05-18T21:32:18.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbcf5d700 1 -- 172.21.15.63:0/2030343894 learned_addr learned my addr 172.21.15.63:0/2030343894 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:18.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbd75e700 1 --2- 172.21.15.63:0/2030343894 >> v2:172.21.15.155:3300/0 conn(0x7fabb8143690 0x7fabb8149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:18.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbcf5d700 1 -- 172.21.15.63:0/2030343894 >> v2:172.21.15.155:3300/0 conn(0x7fabb8143690 msgr2=0x7fabb8149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:18.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbcf5d700 1 --2- 172.21.15.63:0/2030343894 >> v2:172.21.15.155:3300/0 conn(0x7fabb8143690 0x7fabb8149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:18.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabb77fe700 1 -- 172.21.15.63:0/2030343894 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516813540 0 0) 0x7fabb8146180 con 0x7fabb8146b60 2020-05-18T21:32:18.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbcf5d700 1 -- 172.21.15.63:0/2030343894 >> v1:172.21.15.155:6789/0 conn(0x7fabb8146b60 legacy=0x7fabb8142f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:18.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbcf5d700 1 -- 172.21.15.63:0/2030343894 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb814a410 con 0x7fabb8066200 2020-05-18T21:32:18.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbcf5d700 1 --2- 172.21.15.63:0/2030343894 >> v2:172.21.15.63:3300/0 conn(0x7fabb8066200 0x7fabb805b160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fabac002f70 tx=0x7fabac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:18.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbcf5d700 1 --2- 172.21.15.63:0/2030343894 >> v2:172.21.15.63:3300/0 conn(0x7fabb8066200 0x7fabb805b160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fabac002f70 tx=0x7fabac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:18.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbcf5d700 1 --2- 172.21.15.63:0/2030343894 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb8066200 0x7fabb805b160 secure :-1 s=READY pgs=1158 cs=0 l=1 rx=0x7fabac002f70 tx=0x7fabac007a80).ready entity=mon.0 client_cookie=b3c4265a56562b3f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:18.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbcf5d700 1 --2- 172.21.15.63:0/2030343894 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb8066200 0x7fabb805b160 secure :-1 s=THROTTLE_DONE pgs=1158 cs=0 l=1 rx=0x7fabac002f70 tx=0x7fabac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:18.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabb77fe700 1 -- 172.21.15.63:0/2030343894 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabac0116b0 con 0x7fabb8066200 2020-05-18T21:32:18.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbcf5d700 1 --2- 172.21.15.63:0/2030343894 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb8066200 0x7fabb805b160 secure :-1 s=THROTTLE_DONE pgs=1158 cs=0 l=1 rx=0x7fabac002f70 tx=0x7fabac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:18.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabb77fe700 1 -- 172.21.15.63:0/2030343894 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac011810 con 0x7fabb8066200 2020-05-18T21:32:18.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbcf5d700 1 --2- 172.21.15.63:0/2030343894 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb8066200 0x7fabb805b160 secure :-1 s=THROTTLE_DONE pgs=1158 cs=0 l=1 rx=0x7fabac002f70 tx=0x7fabac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:18.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabb77fe700 1 -- 172.21.15.63:0/2030343894 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabac011bf0 con 0x7fabb8066200 2020-05-18T21:32:18.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbdf5f700 1 -- 172.21.15.63:0/2030343894 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb8066200 msgr2=0x7fabb805b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:18.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbdf5f700 1 --2- 172.21.15.63:0/2030343894 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb8066200 0x7fabb805b160 secure :-1 s=READY pgs=1158 cs=0 l=1 rx=0x7fabac002f70 tx=0x7fabac007a80).stop 2020-05-18T21:32:18.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbdf5f700 1 -- 172.21.15.63:0/2030343894 shutdown_connections 2020-05-18T21:32:18.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbdf5f700 1 --2- 172.21.15.63:0/2030343894 >> v2:172.21.15.155:3300/0 conn(0x7fabb8143690 0x7fabb8149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:18.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbdf5f700 1 --2- 172.21.15.63:0/2030343894 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb8066200 0x7fabb805b160 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:18.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbdf5f700 1 -- 172.21.15.63:0/2030343894 >> 172.21.15.63:0/2030343894 conn(0x7fabb8066d00 msgr2=0x7fabb80b9590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:18.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbdf5f700 1 -- 172.21.15.63:0/2030343894 shutdown_connections 2020-05-18T21:32:18.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.321+0000 7fabbdf5f700 1 -- 172.21.15.63:0/2030343894 wait complete. 2020-05-18T21:32:18.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbdf5f700 1 Processor -- start 2020-05-18T21:32:18.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbdf5f700 1 -- start start 2020-05-18T21:32:18.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbdf5f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fabb8066200 0x7fabb8149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:18.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbdf5f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb80ace30 con 0x7fabb8146b60 2020-05-18T21:32:18.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbdf5f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb8145050 con 0x7fabb8143690 2020-05-18T21:32:18.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbdf5f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb80ad060 con 0x7fabb8066200 2020-05-18T21:32:18.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbcf5d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fabb8066200 0x7fabb8149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:18.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbcf5d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fabb8066200 0x7fabb8149130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58954/0 (socket says 172.21.15.63:58954) 2020-05-18T21:32:18.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbcf5d700 1 -- 172.21.15.63:0/3562581873 learned_addr learned my addr 172.21.15.63:0/3562581873 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:18.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbd75e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fabb8146b60 0x7fabb80ad500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32912/0 (socket says 172.21.15.63:32912) 2020-05-18T21:32:18.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbcf5d700 1 -- 172.21.15.63:0/3562581873 >> v1:172.21.15.155:6789/0 conn(0x7fabb8143690 legacy=0x7fabb812be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:18.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbcf5d700 1 -- 172.21.15.63:0/3562581873 >> v1:172.21.15.63:6789/0 conn(0x7fabb8146b60 legacy=0x7fabb80ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:18.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbcf5d700 1 -- 172.21.15.63:0/3562581873 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb81452f0 con 0x7fabb8066200 2020-05-18T21:32:18.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbcf5d700 1 --2- 172.21.15.63:0/3562581873 >> v2:172.21.15.63:3300/0 conn(0x7fabb8066200 0x7fabb8149130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fabac002f70 tx=0x7fabac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:18.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbcf5d700 1 --2- 172.21.15.63:0/3562581873 >> v2:172.21.15.63:3300/0 conn(0x7fabb8066200 0x7fabb8149130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fabac002f70 tx=0x7fabac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:18.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbcf5d700 1 --2- 172.21.15.63:0/3562581873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb8066200 0x7fabb8149130 secure :-1 s=READY pgs=1160 cs=0 l=1 rx=0x7fabac002f70 tx=0x7fabac007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:18.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbcf5d700 1 --2- 172.21.15.63:0/3562581873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb8066200 0x7fabb8149130 secure :-1 s=THROTTLE_DONE pgs=1160 cs=0 l=1 rx=0x7fabac002f70 tx=0x7fabac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:18.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabb5ffb700 1 -- 172.21.15.63:0/3562581873 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabac007360 con 0x7fabb8066200 2020-05-18T21:32:18.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbcf5d700 1 --2- 172.21.15.63:0/3562581873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb8066200 0x7fabb8149130 secure :-1 s=THROTTLE_DONE pgs=1160 cs=0 l=1 rx=0x7fabac002f70 tx=0x7fabac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:18.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbcf5d700 1 --2- 172.21.15.63:0/3562581873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb8066200 0x7fabb8149130 secure :-1 s=THROTTLE_DONE pgs=1160 cs=0 l=1 rx=0x7fabac002f70 tx=0x7fabac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:18.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabb5ffb700 1 -- 172.21.15.63:0/3562581873 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac0074c0 con 0x7fabb8066200 2020-05-18T21:32:18.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.325+0000 7fabbdf5f700 1 -- 172.21.15.63:0/3562581873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb812c570 con 0x7fabb8066200 2020-05-18T21:32:18.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.329+0000 7fabb5ffb700 1 -- 172.21.15.63:0/3562581873 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabac0058f0 con 0x7fabb8066200 2020-05-18T21:32:18.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.329+0000 7fabbdf5f700 1 -- 172.21.15.63:0/3562581873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb8148ef0 con 0x7fabb8066200 2020-05-18T21:32:18.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.329+0000 7fabbcf5d700 1 --2- 172.21.15.63:0/3562581873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb8066200 0x7fabb8149130 secure :-1 s=THROTTLE_DONE pgs=1160 cs=0 l=1 rx=0x7fabac002f70 tx=0x7fabac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:18.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.329+0000 7fabb5ffb700 1 -- 172.21.15.63:0/3562581873 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fabac005a50 con 0x7fabb8066200 2020-05-18T21:32:18.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.329+0000 7fabbcf5d700 1 --2- 172.21.15.63:0/3562581873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb8066200 0x7fabb8149130 secure :-1 s=THROTTLE_DONE pgs=1160 cs=0 l=1 rx=0x7fabac002f70 tx=0x7fabac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:18.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.329+0000 7fabbdf5f700 1 -- 172.21.15.63:0/3562581873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb80ad200 con 0x7fabb8066200 2020-05-18T21:32:18.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.329+0000 7fabb5ffb700 1 --2- 172.21.15.63:0/3562581873 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faba004f990 0x7faba0051e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:18.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.329+0000 7fabb5ffb700 1 -- 172.21.15.63:0/3562581873 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fabac0644e0 con 0x7fabb8066200 2020-05-18T21:32:18.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.329+0000 7fabb7fff700 1 --2- 172.21.15.63:0/3562581873 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faba004f990 0x7faba0051e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:18.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.329+0000 7fabb7fff700 1 --2- 172.21.15.63:0/3562581873 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faba004f990 0x7faba0051e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fabb80b9070 tx=0x7faba4002650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:18.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.329+0000 7fabb7fff700 1 --2- 172.21.15.63:0/3562581873 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faba004f990 0x7faba0051e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fabb80b9070 tx=0x7faba4002650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:18.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.329+0000 7fabb7fff700 1 --2- 172.21.15.63:0/3562581873 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faba004f990 0x7faba0051e50 secure :-1 s=READY pgs=458 cs=0 l=1 rx=0x7fabb80b9070 tx=0x7faba4002650).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:18.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.337+0000 7fabbcf5d700 1 --2- 172.21.15.63:0/3562581873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb8066200 0x7fabb8149130 secure :-1 s=THROTTLE_DONE pgs=1160 cs=0 l=1 rx=0x7fabac002f70 tx=0x7fabac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:18.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.337+0000 7fabb5ffb700 1 -- 172.21.15.63:0/3562581873 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fabac03e990 con 0x7fabb8066200 2020-05-18T21:32:18.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.485+0000 7fabbdf5f700 1 -- 172.21.15.63:0/3562581873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabb80569e0 con 0x7fabb8066200 2020-05-18T21:32:18.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.485+0000 7fabbcf5d700 1 --2- 172.21.15.63:0/3562581873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb8066200 0x7fabb8149130 secure :-1 s=THROTTLE_DONE pgs=1160 cs=0 l=1 rx=0x7fabac002f70 tx=0x7fabac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:18.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.485+0000 7fabb5ffb700 1 -- 172.21.15.63:0/3562581873 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2158 (secure 0 0 0) 0x7fabac041fb0 con 0x7fabb8066200 2020-05-18T21:32:18.489 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:18.490 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:15.195670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:stopping","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:18.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.485+0000 7fabbdf5f700 1 -- 172.21.15.63:0/3562581873 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faba004f990 msgr2=0x7faba0051e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:18.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.485+0000 7fabbdf5f700 1 --2- 172.21.15.63:0/3562581873 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faba004f990 0x7faba0051e50 secure :-1 s=READY pgs=458 cs=0 l=1 rx=0x7fabb80b9070 tx=0x7faba4002650).stop 2020-05-18T21:32:18.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.485+0000 7fabbdf5f700 1 -- 172.21.15.63:0/3562581873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb8066200 msgr2=0x7fabb8149130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:18.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.485+0000 7fabbdf5f700 1 --2- 172.21.15.63:0/3562581873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb8066200 0x7fabb8149130 secure :-1 s=READY pgs=1160 cs=0 l=1 rx=0x7fabac002f70 tx=0x7fabac007a80).stop 2020-05-18T21:32:18.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.485+0000 7fabbdf5f700 1 -- 172.21.15.63:0/3562581873 shutdown_connections 2020-05-18T21:32:18.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.485+0000 7fabbdf5f700 1 --2- 172.21.15.63:0/3562581873 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faba004f990 0x7faba0051e50 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:18.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.485+0000 7fabbdf5f700 1 --2- 172.21.15.63:0/3562581873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb8066200 0x7fabb8149130 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:18.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.485+0000 7fabbdf5f700 1 -- 172.21.15.63:0/3562581873 >> 172.21.15.63:0/3562581873 conn(0x7fabb8066d00 msgr2=0x7fabb812f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:18.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.489+0000 7fabbdf5f700 1 -- 172.21.15.63:0/3562581873 shutdown_connections 2020-05-18T21:32:18.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:18.489+0000 7fabbdf5f700 1 -- 172.21.15.63:0/3562581873 wait complete. 2020-05-18T21:32:18.495 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 66 2020-05-18T21:32:18.704 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:15.195670+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:stopping', 'state_seq': 6, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:18.704 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5756:up:stopping 2020-05-18T21:32:19.705 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:19.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf966d7700 1 Processor -- start 2020-05-18T21:32:19.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf966d7700 1 -- start start 2020-05-18T21:32:19.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf966d7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf901435a0 0x7faf90060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:19.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf966d7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf900b7020 con 0x7faf90145df0 2020-05-18T21:32:19.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf966d7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf900b72c0 con 0x7faf900b93f0 2020-05-18T21:32:19.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf966d7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf900b7560 con 0x7faf901435a0 2020-05-18T21:32:19.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf94ed4700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7faf90145df0 0x7faf90142e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32918/0 (socket says 172.21.15.63:32918) 2020-05-18T21:32:19.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf94ed4700 1 -- 172.21.15.63:0/76335255 learned_addr learned my addr 172.21.15.63:0/76335255 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:19.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf95ed6700 1 --2- 172.21.15.63:0/76335255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf901435a0 0x7faf90060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:19.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf87fff700 1 -- 172.21.15.63:0/76335255 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800643007 0 0) 0x7faf900b7020 con 0x7faf90145df0 2020-05-18T21:32:19.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf87fff700 1 -- 172.21.15.63:0/76335255 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf74003270 con 0x7faf90145df0 2020-05-18T21:32:19.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf87fff700 1 -- 172.21.15.63:0/76335255 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054420793 0 0) 0x7faf900b72c0 con 0x7faf900b93f0 2020-05-18T21:32:19.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf87fff700 1 -- 172.21.15.63:0/76335255 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf900b7020 con 0x7faf900b93f0 2020-05-18T21:32:19.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf95ed6700 1 -- 172.21.15.63:0/76335255 >> v1:172.21.15.155:6789/0 conn(0x7faf900b93f0 legacy=0x7faf900b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:19.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf95ed6700 1 -- 172.21.15.63:0/76335255 >> v1:172.21.15.63:6789/0 conn(0x7faf90145df0 legacy=0x7faf90142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:19.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf95ed6700 1 -- 172.21.15.63:0/76335255 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf900b7800 con 0x7faf901435a0 2020-05-18T21:32:19.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf95ed6700 1 --2- 172.21.15.63:0/76335255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf901435a0 0x7faf90060430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faf880032f0 tx=0x7faf88008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:19.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf95ed6700 1 --2- 172.21.15.63:0/76335255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf901435a0 0x7faf90060430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faf880032f0 tx=0x7faf88008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:19.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf95ed6700 1 --2- 172.21.15.63:0/76335255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf901435a0 0x7faf90060430 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7faf880032f0 tx=0x7faf88008ca0).ready entity=mon.2 client_cookie=17ba72d6c4a99124 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:19.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf95ed6700 1 --2- 172.21.15.63:0/76335255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf901435a0 0x7faf90060430 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7faf880032f0 tx=0x7faf88008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:19.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf87fff700 1 -- 172.21.15.63:0/76335255 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf88011df0 con 0x7faf901435a0 2020-05-18T21:32:19.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.817+0000 7faf95ed6700 1 --2- 172.21.15.63:0/76335255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf901435a0 0x7faf90060430 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7faf880032f0 tx=0x7faf88008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:19.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.821+0000 7faf87fff700 1 -- 172.21.15.63:0/76335255 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8800a180 con 0x7faf901435a0 2020-05-18T21:32:19.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.821+0000 7faf95ed6700 1 --2- 172.21.15.63:0/76335255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf901435a0 0x7faf90060430 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7faf880032f0 tx=0x7faf88008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:19.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.821+0000 7faf966d7700 1 -- 172.21.15.63:0/76335255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf901435a0 msgr2=0x7faf90060430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:19.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.821+0000 7faf87fff700 1 -- 172.21.15.63:0/76335255 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf8800a560 con 0x7faf901435a0 2020-05-18T21:32:19.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.821+0000 7faf966d7700 1 --2- 172.21.15.63:0/76335255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf901435a0 0x7faf90060430 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7faf880032f0 tx=0x7faf88008ca0).stop 2020-05-18T21:32:19.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.821+0000 7faf966d7700 1 -- 172.21.15.63:0/76335255 shutdown_connections 2020-05-18T21:32:19.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.821+0000 7faf966d7700 1 --2- 172.21.15.63:0/76335255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf901435a0 0x7faf90060430 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:19.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.821+0000 7faf966d7700 1 -- 172.21.15.63:0/76335255 >> 172.21.15.63:0/76335255 conn(0x7faf90069b70 msgr2=0x7faf90069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:19.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.821+0000 7faf966d7700 1 -- 172.21.15.63:0/76335255 shutdown_connections 2020-05-18T21:32:19.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.821+0000 7faf966d7700 1 -- 172.21.15.63:0/76335255 wait complete. 2020-05-18T21:32:19.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.821+0000 7faf966d7700 1 Processor -- start 2020-05-18T21:32:19.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.821+0000 7faf966d7700 1 -- start start 2020-05-18T21:32:19.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf966d7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faf900b93f0 0x7faf900bc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:19.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf966d7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf900bca30 con 0x7faf901435a0 2020-05-18T21:32:19.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf966d7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf900badb0 con 0x7faf90145df0 2020-05-18T21:32:19.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf966d7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf900bb050 con 0x7faf900b93f0 2020-05-18T21:32:19.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf94ed4700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7faf901435a0 0x7faf900ba580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32924/0 (socket says 172.21.15.63:32924) 2020-05-18T21:32:19.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf94ed4700 1 -- 172.21.15.63:0/839099695 learned_addr learned my addr 172.21.15.63:0/839099695 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:19.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf956d5700 1 --2- 172.21.15.63:0/839099695 >> v2:172.21.15.155:3300/0 conn(0x7faf900b93f0 0x7faf900bc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:19.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf867fc700 1 -- 172.21.15.63:0/839099695 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246565266 0 0) 0x7faf900bca30 con 0x7faf901435a0 2020-05-18T21:32:19.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf867fc700 1 -- 172.21.15.63:0/839099695 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf78002fe0 con 0x7faf901435a0 2020-05-18T21:32:19.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf956d5700 1 -- 172.21.15.63:0/839099695 >> v1:172.21.15.155:6789/0 conn(0x7faf90145df0 legacy=0x7faf900bb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:19.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf867fc700 1 -- 172.21.15.63:0/839099695 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505192394 0 0) 0x7faf900badb0 con 0x7faf90145df0 2020-05-18T21:32:19.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf956d5700 1 -- 172.21.15.63:0/839099695 >> v1:172.21.15.63:6789/0 conn(0x7faf901435a0 legacy=0x7faf900ba580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:19.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf956d5700 1 -- 172.21.15.63:0/839099695 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf900bb2f0 con 0x7faf900b93f0 2020-05-18T21:32:19.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf956d5700 1 --2- 172.21.15.63:0/839099695 >> v2:172.21.15.155:3300/0 conn(0x7faf900b93f0 0x7faf900bc5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf8c001110 tx=0x7faf8c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:19.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf956d5700 1 --2- 172.21.15.63:0/839099695 >> v2:172.21.15.155:3300/0 conn(0x7faf900b93f0 0x7faf900bc5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf8c001110 tx=0x7faf8c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:19.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf956d5700 1 --2- 172.21.15.63:0/839099695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf900b93f0 0x7faf900bc5d0 secure :-1 s=READY pgs=800 cs=0 l=1 rx=0x7faf8c001110 tx=0x7faf8c0108e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:19.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf956d5700 1 --2- 172.21.15.63:0/839099695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf900b93f0 0x7faf900bc5d0 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7faf8c001110 tx=0x7faf8c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:19.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf867fc700 1 -- 172.21.15.63:0/839099695 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf8c006c00 con 0x7faf900b93f0 2020-05-18T21:32:19.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf956d5700 1 --2- 172.21.15.63:0/839099695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf900b93f0 0x7faf900bc5d0 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7faf8c001110 tx=0x7faf8c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:19.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf956d5700 1 --2- 172.21.15.63:0/839099695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf900b93f0 0x7faf900bc5d0 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7faf8c001110 tx=0x7faf8c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:19.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf867fc700 1 -- 172.21.15.63:0/839099695 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c006d60 con 0x7faf900b93f0 2020-05-18T21:32:19.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf966d7700 1 -- 172.21.15.63:0/839099695 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9013d6f0 con 0x7faf900b93f0 2020-05-18T21:32:19.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf867fc700 1 -- 172.21.15.63:0/839099695 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf8c008370 con 0x7faf900b93f0 2020-05-18T21:32:19.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.825+0000 7faf966d7700 1 -- 172.21.15.63:0/839099695 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf90139ab0 con 0x7faf900b93f0 2020-05-18T21:32:19.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.829+0000 7faf956d5700 1 --2- 172.21.15.63:0/839099695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf900b93f0 0x7faf900bc5d0 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7faf8c001110 tx=0x7faf8c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:19.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.829+0000 7faf966d7700 1 -- 172.21.15.63:0/839099695 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf900569e0 con 0x7faf900b93f0 2020-05-18T21:32:19.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.829+0000 7faf867fc700 1 -- 172.21.15.63:0/839099695 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7faf8c008630 con 0x7faf900b93f0 2020-05-18T21:32:19.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.829+0000 7faf956d5700 1 --2- 172.21.15.63:0/839099695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf900b93f0 0x7faf900bc5d0 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7faf8c001110 tx=0x7faf8c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:19.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.829+0000 7faf867fc700 1 --2- 172.21.15.63:0/839099695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf7804fc70 0x7faf78052130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:19.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.829+0000 7faf867fc700 1 -- 172.21.15.63:0/839099695 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7faf8c063c80 con 0x7faf900b93f0 2020-05-18T21:32:19.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.829+0000 7faf94ed4700 1 --2- 172.21.15.63:0/839099695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf7804fc70 0x7faf78052130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:19.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.829+0000 7faf94ed4700 1 --2- 172.21.15.63:0/839099695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf7804fc70 0x7faf78052130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf80000f30 tx=0x7faf800016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:19.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.829+0000 7faf94ed4700 1 --2- 172.21.15.63:0/839099695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf7804fc70 0x7faf78052130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf80000f30 tx=0x7faf800016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:19.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.829+0000 7faf94ed4700 1 --2- 172.21.15.63:0/839099695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf7804fc70 0x7faf78052130 secure :-1 s=READY pgs=459 cs=0 l=1 rx=0x7faf80000f30 tx=0x7faf800016e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:19.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.837+0000 7faf956d5700 1 --2- 172.21.15.63:0/839099695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf900b93f0 0x7faf900bc5d0 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7faf8c001110 tx=0x7faf8c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:19.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.837+0000 7faf867fc700 1 -- 172.21.15.63:0/839099695 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7faf8c03e010 con 0x7faf900b93f0 2020-05-18T21:32:19.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.989+0000 7faf966d7700 1 -- 172.21.15.63:0/839099695 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf90061c40 con 0x7faf900b93f0 2020-05-18T21:32:19.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.989+0000 7faf956d5700 1 --2- 172.21.15.63:0/839099695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf900b93f0 0x7faf900bc5d0 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7faf8c001110 tx=0x7faf8c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:19.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.989+0000 7faf867fc700 1 -- 172.21.15.63:0/839099695 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2158 (secure 0 0 0) 0x7faf8c041630 con 0x7faf900b93f0 2020-05-18T21:32:19.995 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:19.996 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:15.195670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:stopping","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:19.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.993+0000 7faf966d7700 1 -- 172.21.15.63:0/839099695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf7804fc70 msgr2=0x7faf78052130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:19.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.993+0000 7faf966d7700 1 --2- 172.21.15.63:0/839099695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf7804fc70 0x7faf78052130 secure :-1 s=READY pgs=459 cs=0 l=1 rx=0x7faf80000f30 tx=0x7faf800016e0).stop 2020-05-18T21:32:19.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.993+0000 7faf966d7700 1 -- 172.21.15.63:0/839099695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf900b93f0 msgr2=0x7faf900bc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:19.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.993+0000 7faf966d7700 1 --2- 172.21.15.63:0/839099695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf900b93f0 0x7faf900bc5d0 secure :-1 s=READY pgs=800 cs=0 l=1 rx=0x7faf8c001110 tx=0x7faf8c0108e0).stop 2020-05-18T21:32:19.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.993+0000 7faf966d7700 1 -- 172.21.15.63:0/839099695 shutdown_connections 2020-05-18T21:32:19.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.993+0000 7faf966d7700 1 --2- 172.21.15.63:0/839099695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf7804fc70 0x7faf78052130 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:19.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.993+0000 7faf966d7700 1 --2- 172.21.15.63:0/839099695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf900b93f0 0x7faf900bc5d0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:19.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.993+0000 7faf966d7700 1 -- 172.21.15.63:0/839099695 >> 172.21.15.63:0/839099695 conn(0x7faf90069b70 msgr2=0x7faf90069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:20.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.993+0000 7faf966d7700 1 -- 172.21.15.63:0/839099695 shutdown_connections 2020-05-18T21:32:20.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:19.993+0000 7faf966d7700 1 -- 172.21.15.63:0/839099695 wait complete. 2020-05-18T21:32:20.000 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 66 2020-05-18T21:32:20.215 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:15.195670+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:stopping', 'state_seq': 6, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:20.215 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5756:up:stopping 2020-05-18T21:32:21.216 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:21.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.325+0000 7f9b8dd3b700 1 Processor -- start 2020-05-18T21:32:21.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.325+0000 7f9b8dd3b700 1 -- start start 2020-05-18T21:32:21.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8dd3b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9b88149980 0x7f9b880b5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:21.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8dd3b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9b880b5340 0x7f9b8809e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:21.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8dd3b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8814d6b0 con 0x7f9b88149d60 2020-05-18T21:32:21.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8dd3b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8809d010 con 0x7f9b88149980 2020-05-18T21:32:21.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8dd3b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8814d910 con 0x7f9b880b5340 2020-05-18T21:32:21.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8cd39700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9b88149980 0x7f9b880b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:21.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8d53a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9b880b5340 0x7f9b8809e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:21.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8d53a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9b880b5340 0x7f9b8809e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:45594/0 (socket says 172.21.15.63:45594) 2020-05-18T21:32:21.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8d53a700 1 -- 172.21.15.63:0/826499103 learned_addr learned my addr 172.21.15.63:0/826499103 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:21.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8d53a700 1 -- 172.21.15.63:0/826499103 >> v2:172.21.15.63:3300/0 conn(0x7f9b88149980 msgr2=0x7f9b880b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:21.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8d53a700 1 --2- 172.21.15.63:0/826499103 >> v2:172.21.15.63:3300/0 conn(0x7f9b88149980 0x7f9b880b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:21.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8d53a700 1 -- 172.21.15.63:0/826499103 >> v1:172.21.15.155:6789/0 conn(0x7f9b88149d60 legacy=0x7f9b8814e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:21.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8d53a700 1 -- 172.21.15.63:0/826499103 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8814dbb0 con 0x7f9b880b5340 2020-05-18T21:32:21.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8d53a700 1 --2- 172.21.15.63:0/826499103 >> v2:172.21.15.155:3300/0 conn(0x7f9b880b5340 0x7f9b8809e360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9b800032f0 tx=0x7f9b80007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:21.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8d53a700 1 --2- 172.21.15.63:0/826499103 >> v2:172.21.15.155:3300/0 conn(0x7f9b880b5340 0x7f9b8809e360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9b800032f0 tx=0x7f9b80007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:21.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8d53a700 1 --2- 172.21.15.63:0/826499103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b880b5340 0x7f9b8809e360 secure :-1 s=READY pgs=802 cs=0 l=1 rx=0x7f9b800032f0 tx=0x7f9b80007e00).ready entity=mon.1 client_cookie=b55b8468413886ed server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:21.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8d53a700 1 --2- 172.21.15.63:0/826499103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b880b5340 0x7f9b8809e360 secure :-1 s=THROTTLE_DONE pgs=802 cs=0 l=1 rx=0x7f9b800032f0 tx=0x7f9b80007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:21.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b877fe700 1 -- 172.21.15.63:0/826499103 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b80011d10 con 0x7f9b880b5340 2020-05-18T21:32:21.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8d53a700 1 --2- 172.21.15.63:0/826499103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b880b5340 0x7f9b8809e360 secure :-1 s=THROTTLE_DONE pgs=802 cs=0 l=1 rx=0x7f9b800032f0 tx=0x7f9b80007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:21.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8d53a700 1 --2- 172.21.15.63:0/826499103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b880b5340 0x7f9b8809e360 secure :-1 s=THROTTLE_DONE pgs=802 cs=0 l=1 rx=0x7f9b800032f0 tx=0x7f9b80007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:21.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b877fe700 1 -- 172.21.15.63:0/826499103 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b80011e70 con 0x7f9b880b5340 2020-05-18T21:32:21.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b877fe700 1 -- 172.21.15.63:0/826499103 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b8000a370 con 0x7f9b880b5340 2020-05-18T21:32:21.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8dd3b700 1 -- 172.21.15.63:0/826499103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b880b5340 msgr2=0x7f9b8809e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:21.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8dd3b700 1 --2- 172.21.15.63:0/826499103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b880b5340 0x7f9b8809e360 secure :-1 s=READY pgs=802 cs=0 l=1 rx=0x7f9b800032f0 tx=0x7f9b80007e00).stop 2020-05-18T21:32:21.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8dd3b700 1 -- 172.21.15.63:0/826499103 shutdown_connections 2020-05-18T21:32:21.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8dd3b700 1 --2- 172.21.15.63:0/826499103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b880b5340 0x7f9b8809e360 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:21.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8dd3b700 1 --2- 172.21.15.63:0/826499103 >> v2:172.21.15.63:3300/0 conn(0x7f9b88149980 0x7f9b880b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:21.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8dd3b700 1 -- 172.21.15.63:0/826499103 >> 172.21.15.63:0/826499103 conn(0x7f9b8805a7c0 msgr2=0x7f9b8805aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:21.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8dd3b700 1 -- 172.21.15.63:0/826499103 shutdown_connections 2020-05-18T21:32:21.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.329+0000 7f9b8dd3b700 1 -- 172.21.15.63:0/826499103 wait complete. 2020-05-18T21:32:21.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.333+0000 7f9b8dd3b700 1 Processor -- start 2020-05-18T21:32:21.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.333+0000 7f9b8dd3b700 1 -- start start 2020-05-18T21:32:21.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.333+0000 7f9b8dd3b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9b880b5340 0x7f9b88098a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:21.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.333+0000 7f9b8dd3b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b880b7690 con 0x7f9b88149d60 2020-05-18T21:32:21.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.333+0000 7f9b8dd3b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b880b7930 con 0x7f9b88149980 2020-05-18T21:32:21.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.333+0000 7f9b8dd3b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b880b7bd0 con 0x7f9b880b5340 2020-05-18T21:32:21.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.333+0000 7f9b8d53a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9b88149d60 0x7f9b880b8070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32940/0 (socket says 172.21.15.63:32940) 2020-05-18T21:32:21.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.333+0000 7f9b8d53a700 1 -- 172.21.15.63:0/511518462 learned_addr learned my addr 172.21.15.63:0/511518462 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:21.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.333+0000 7f9b8cd39700 1 --2- 172.21.15.63:0/511518462 >> v2:172.21.15.155:3300/0 conn(0x7f9b880b5340 0x7f9b88098a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:21.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b85ffb700 1 -- 172.21.15.63:0/511518462 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893967826 0 0) 0x7f9b880b7690 con 0x7f9b88149d60 2020-05-18T21:32:21.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b85ffb700 1 -- 172.21.15.63:0/511518462 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b68002fe0 con 0x7f9b88149d60 2020-05-18T21:32:21.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b8cd39700 1 -- 172.21.15.63:0/511518462 >> v1:172.21.15.155:6789/0 conn(0x7f9b88149980 legacy=0x7f9b8813fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:21.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b85ffb700 1 -- 172.21.15.63:0/511518462 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345125953 0 0) 0x7f9b880b7930 con 0x7f9b88149980 2020-05-18T21:32:21.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b8cd39700 1 -- 172.21.15.63:0/511518462 >> v1:172.21.15.63:6789/0 conn(0x7f9b88149d60 legacy=0x7f9b880b8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:21.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b8cd39700 1 -- 172.21.15.63:0/511518462 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b880b7280 con 0x7f9b880b5340 2020-05-18T21:32:21.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b8cd39700 1 --2- 172.21.15.63:0/511518462 >> v2:172.21.15.155:3300/0 conn(0x7f9b880b5340 0x7f9b88098a70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b7c002f70 tx=0x7f9b7c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:21.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b8cd39700 1 --2- 172.21.15.63:0/511518462 >> v2:172.21.15.155:3300/0 conn(0x7f9b880b5340 0x7f9b88098a70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b7c002f70 tx=0x7f9b7c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:21.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b8cd39700 1 --2- 172.21.15.63:0/511518462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b880b5340 0x7f9b88098a70 secure :-1 s=READY pgs=804 cs=0 l=1 rx=0x7f9b7c002f70 tx=0x7f9b7c010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:21.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b8cd39700 1 --2- 172.21.15.63:0/511518462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b880b5340 0x7f9b88098a70 secure :-1 s=THROTTLE_DONE pgs=804 cs=0 l=1 rx=0x7f9b7c002f70 tx=0x7f9b7c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:21.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b85ffb700 1 -- 172.21.15.63:0/511518462 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b7c007550 con 0x7f9b880b5340 2020-05-18T21:32:21.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b8cd39700 1 --2- 172.21.15.63:0/511518462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b880b5340 0x7f9b88098a70 secure :-1 s=THROTTLE_DONE pgs=804 cs=0 l=1 rx=0x7f9b7c002f70 tx=0x7f9b7c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:21.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b8cd39700 1 --2- 172.21.15.63:0/511518462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b880b5340 0x7f9b88098a70 secure :-1 s=THROTTLE_DONE pgs=804 cs=0 l=1 rx=0x7f9b7c002f70 tx=0x7f9b7c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:21.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b85ffb700 1 -- 172.21.15.63:0/511518462 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7c005700 con 0x7f9b880b5340 2020-05-18T21:32:21.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b8dd3b700 1 -- 172.21.15.63:0/511518462 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b88099a00 con 0x7f9b880b5340 2020-05-18T21:32:21.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b85ffb700 1 -- 172.21.15.63:0/511518462 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b7c005a60 con 0x7f9b880b5340 2020-05-18T21:32:21.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b8dd3b700 1 -- 172.21.15.63:0/511518462 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b88140680 con 0x7f9b880b5340 2020-05-18T21:32:21.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b8dd3b700 1 -- 172.21.15.63:0/511518462 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b880569e0 con 0x7f9b880b5340 2020-05-18T21:32:21.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b8cd39700 1 --2- 172.21.15.63:0/511518462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b880b5340 0x7f9b88098a70 secure :-1 s=THROTTLE_DONE pgs=804 cs=0 l=1 rx=0x7f9b7c002f70 tx=0x7f9b7c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:21.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b85ffb700 1 -- 172.21.15.63:0/511518462 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9b7c005c60 con 0x7f9b880b5340 2020-05-18T21:32:21.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b8cd39700 1 --2- 172.21.15.63:0/511518462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b880b5340 0x7f9b88098a70 secure :-1 s=THROTTLE_DONE pgs=804 cs=0 l=1 rx=0x7f9b7c002f70 tx=0x7f9b7c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:21.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b85ffb700 1 --2- 172.21.15.63:0/511518462 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b6804fca0 0x7f9b68052160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:21.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b85ffb700 1 -- 172.21.15.63:0/511518462 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f9b7c063ee0 con 0x7f9b880b5340 2020-05-18T21:32:21.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.337+0000 7f9b87fff700 1 --2- 172.21.15.63:0/511518462 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b6804fca0 0x7f9b68052160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:21.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.341+0000 7f9b87fff700 1 --2- 172.21.15.63:0/511518462 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b6804fca0 0x7f9b68052160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b780021b0 tx=0x7f9b78002750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:21.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.341+0000 7f9b87fff700 1 --2- 172.21.15.63:0/511518462 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b6804fca0 0x7f9b68052160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b780021b0 tx=0x7f9b78002750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:21.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.341+0000 7f9b87fff700 1 --2- 172.21.15.63:0/511518462 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b6804fca0 0x7f9b68052160 secure :-1 s=READY pgs=460 cs=0 l=1 rx=0x7f9b780021b0 tx=0x7f9b78002750).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:21.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.349+0000 7f9b8cd39700 1 --2- 172.21.15.63:0/511518462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b880b5340 0x7f9b88098a70 secure :-1 s=THROTTLE_DONE pgs=804 cs=0 l=1 rx=0x7f9b7c002f70 tx=0x7f9b7c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:21.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.349+0000 7f9b85ffb700 1 -- 172.21.15.63:0/511518462 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9b7c03e210 con 0x7f9b880b5340 2020-05-18T21:32:21.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.501+0000 7f9b8dd3b700 1 -- 172.21.15.63:0/511518462 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b880617b0 con 0x7f9b880b5340 2020-05-18T21:32:21.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.505+0000 7f9b8cd39700 1 --2- 172.21.15.63:0/511518462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b880b5340 0x7f9b88098a70 secure :-1 s=THROTTLE_DONE pgs=804 cs=0 l=1 rx=0x7f9b7c002f70 tx=0x7f9b7c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:21.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.505+0000 7f9b85ffb700 1 -- 172.21.15.63:0/511518462 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2159 (secure 0 0 0) 0x7f9b7c041830 con 0x7f9b880b5340 2020-05-18T21:32:21.509 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:21.509 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":67,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:20.666310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:stopping","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:21.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.505+0000 7f9b8dd3b700 1 -- 172.21.15.63:0/511518462 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b6804fca0 msgr2=0x7f9b68052160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:21.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.505+0000 7f9b8dd3b700 1 --2- 172.21.15.63:0/511518462 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b6804fca0 0x7f9b68052160 secure :-1 s=READY pgs=460 cs=0 l=1 rx=0x7f9b780021b0 tx=0x7f9b78002750).stop 2020-05-18T21:32:21.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.505+0000 7f9b8dd3b700 1 -- 172.21.15.63:0/511518462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b880b5340 msgr2=0x7f9b88098a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:21.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.505+0000 7f9b8dd3b700 1 --2- 172.21.15.63:0/511518462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b880b5340 0x7f9b88098a70 secure :-1 s=READY pgs=804 cs=0 l=1 rx=0x7f9b7c002f70 tx=0x7f9b7c010bd0).stop 2020-05-18T21:32:21.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.505+0000 7f9b8dd3b700 1 -- 172.21.15.63:0/511518462 shutdown_connections 2020-05-18T21:32:21.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.505+0000 7f9b8dd3b700 1 --2- 172.21.15.63:0/511518462 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b6804fca0 0x7f9b68052160 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:21.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.505+0000 7f9b8dd3b700 1 --2- 172.21.15.63:0/511518462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b880b5340 0x7f9b88098a70 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:21.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.505+0000 7f9b8dd3b700 1 -- 172.21.15.63:0/511518462 >> 172.21.15.63:0/511518462 conn(0x7f9b8805a7c0 msgr2=0x7f9b8809c270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:21.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.505+0000 7f9b8dd3b700 1 -- 172.21.15.63:0/511518462 shutdown_connections 2020-05-18T21:32:21.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:21.505+0000 7f9b8dd3b700 1 -- 172.21.15.63:0/511518462 wait complete. 2020-05-18T21:32:21.513 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 67 2020-05-18T21:32:21.722 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:20.666310+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:stopping', 'state_seq': 6, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:21.723 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5756:up:stopping 2020-05-18T21:32:22.724 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:22.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e31087700 1 Processor -- start 2020-05-18T21:32:22.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e31087700 1 -- start start 2020-05-18T21:32:22.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e31087700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e2c060b90 0x7f3e2c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:22.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e31087700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3e2c14e570 0x7f3e2c14a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:22.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e31087700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e2c14d960 con 0x7f3e2c0b2860 2020-05-18T21:32:22.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e31087700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e2c066210 con 0x7f3e2c14e570 2020-05-18T21:32:22.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e31087700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c14db90 con 0x7f3e2c060b90 2020-05-18T21:32:22.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e2b59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3e2c14e570 0x7f3e2c14a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:22.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e2ad9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e2c060b90 0x7f3e2c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:22.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e2b59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3e2c14e570 0x7f3e2c14a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:45606/0 (socket says 172.21.15.63:45606) 2020-05-18T21:32:22.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e2b59e700 1 -- 172.21.15.63:0/3904194679 learned_addr learned my addr 172.21.15.63:0/3904194679 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:22.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e2a59c700 1 --1- 172.21.15.63:0/3904194679 >> v1:172.21.15.155:6789/0 conn(0x7f3e2c0b2860 0x7f3e2c144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:59496/0 (socket says 172.21.15.63:59496) 2020-05-18T21:32:22.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e2b59e700 1 -- 172.21.15.63:0/3904194679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e2c060b90 msgr2=0x7f3e2c0615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:22.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e2b59e700 1 --2- 172.21.15.63:0/3904194679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e2c060b90 0x7f3e2c0615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:22.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e2b59e700 1 -- 172.21.15.63:0/3904194679 >> v1:172.21.15.155:6789/0 conn(0x7f3e2c0b2860 legacy=0x7f3e2c144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:22.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e2b59e700 1 -- 172.21.15.63:0/3904194679 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2c14de30 con 0x7f3e2c14e570 2020-05-18T21:32:22.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e2ad9d700 1 --2- 172.21.15.63:0/3904194679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e2c060b90 0x7f3e2c0615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:22.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e2b59e700 1 --2- 172.21.15.63:0/3904194679 >> v2:172.21.15.155:3300/0 conn(0x7f3e2c14e570 0x7f3e2c14a390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3e1c002f70 tx=0x7f3e1c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:22.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e2b59e700 1 --2- 172.21.15.63:0/3904194679 >> v2:172.21.15.155:3300/0 conn(0x7f3e2c14e570 0x7f3e2c14a390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3e1c002f70 tx=0x7f3e1c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:22.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e2b59e700 1 --2- 172.21.15.63:0/3904194679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e2c14e570 0x7f3e2c14a390 secure :-1 s=READY pgs=806 cs=0 l=1 rx=0x7f3e1c002f70 tx=0x7f3e1c007a80).ready entity=mon.1 client_cookie=712332cc372ccf43 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:22.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e2b59e700 1 --2- 172.21.15.63:0/3904194679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e2c14e570 0x7f3e2c14a390 secure :-1 s=THROTTLE_DONE pgs=806 cs=0 l=1 rx=0x7f3e1c002f70 tx=0x7f3e1c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:22.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e2b59e700 1 --2- 172.21.15.63:0/3904194679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e2c14e570 0x7f3e2c14a390 secure :-1 s=THROTTLE_DONE pgs=806 cs=0 l=1 rx=0x7f3e1c002f70 tx=0x7f3e1c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:22.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e29d9b700 1 -- 172.21.15.63:0/3904194679 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e1c0116b0 con 0x7f3e2c14e570 2020-05-18T21:32:22.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e2b59e700 1 --2- 172.21.15.63:0/3904194679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e2c14e570 0x7f3e2c14a390 secure :-1 s=THROTTLE_DONE pgs=806 cs=0 l=1 rx=0x7f3e1c002f70 tx=0x7f3e1c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:22.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e29d9b700 1 -- 172.21.15.63:0/3904194679 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c011810 con 0x7f3e2c14e570 2020-05-18T21:32:22.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e31087700 1 -- 172.21.15.63:0/3904194679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e2c14e570 msgr2=0x7f3e2c14a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:22.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e29d9b700 1 -- 172.21.15.63:0/3904194679 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e1c011c30 con 0x7f3e2c14e570 2020-05-18T21:32:22.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.833+0000 7f3e31087700 1 --2- 172.21.15.63:0/3904194679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e2c14e570 0x7f3e2c14a390 secure :-1 s=READY pgs=806 cs=0 l=1 rx=0x7f3e1c002f70 tx=0x7f3e1c007a80).stop 2020-05-18T21:32:22.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e31087700 1 -- 172.21.15.63:0/3904194679 shutdown_connections 2020-05-18T21:32:22.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e31087700 1 --2- 172.21.15.63:0/3904194679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e2c14e570 0x7f3e2c14a390 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:22.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e31087700 1 --2- 172.21.15.63:0/3904194679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e2c060b90 0x7f3e2c0615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:22.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e31087700 1 -- 172.21.15.63:0/3904194679 >> 172.21.15.63:0/3904194679 conn(0x7f3e2c0b83d0 msgr2=0x7f3e2c0b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:22.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e31087700 1 -- 172.21.15.63:0/3904194679 shutdown_connections 2020-05-18T21:32:22.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e31087700 1 -- 172.21.15.63:0/3904194679 wait complete. 2020-05-18T21:32:22.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e31087700 1 Processor -- start 2020-05-18T21:32:22.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e31087700 1 -- start start 2020-05-18T21:32:22.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e31087700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3e2c060b90 0x7f3e2c0651b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:22.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e31087700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e2c0b2860 0x7f3e2c065610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:22.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e31087700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e2c0ad0a0 con 0x7f3e2c14e570 2020-05-18T21:32:22.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e31087700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e2c157740 con 0x7f3e2c060b90 2020-05-18T21:32:22.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e31087700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c0ad340 con 0x7f3e2c0b2860 2020-05-18T21:32:22.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e2ad9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3e2c060b90 0x7f3e2c0651b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:22.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e2ad9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3e2c060b90 0x7f3e2c0651b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58994/0 (socket says 172.21.15.63:58994) 2020-05-18T21:32:22.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e2ad9d700 1 -- 172.21.15.63:0/152714789 learned_addr learned my addr 172.21.15.63:0/152714789 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:22.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e2a59c700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e2c0b2860 0x7f3e2c065610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:22.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e2ad9d700 1 -- 172.21.15.63:0/152714789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e2c0b2860 msgr2=0x7f3e2c065610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:22.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e2ad9d700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e2c0b2860 0x7f3e2c065610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:22.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.837+0000 7f3e2ad9d700 1 -- 172.21.15.63:0/152714789 >> v1:172.21.15.63:6789/0 conn(0x7f3e2c14e570 legacy=0x7f3e2c0ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:22.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e1bfff700 1 -- 172.21.15.63:0/152714789 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282432582 0 0) 0x7f3e2c0ad0a0 con 0x7f3e2c14e570 2020-05-18T21:32:22.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e2ad9d700 1 -- 172.21.15.63:0/152714789 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2c0aedd0 con 0x7f3e2c060b90 2020-05-18T21:32:22.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e2ad9d700 1 --2- 172.21.15.63:0/152714789 >> v2:172.21.15.63:3300/0 conn(0x7f3e2c060b90 0x7f3e2c0651b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e240032b0 tx=0x7f3e24011270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:22.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e2ad9d700 1 --2- 172.21.15.63:0/152714789 >> v2:172.21.15.63:3300/0 conn(0x7f3e2c060b90 0x7f3e2c0651b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e240032b0 tx=0x7f3e24011270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:22.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e2ad9d700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e2c060b90 0x7f3e2c0651b0 secure :-1 s=READY pgs=1165 cs=0 l=1 rx=0x7f3e240032b0 tx=0x7f3e24011270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:22.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e2ad9d700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e2c060b90 0x7f3e2c0651b0 secure :-1 s=THROTTLE_DONE pgs=1165 cs=0 l=1 rx=0x7f3e240032b0 tx=0x7f3e24011270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:22.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e2ad9d700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e2c060b90 0x7f3e2c0651b0 secure :-1 s=THROTTLE_DONE pgs=1165 cs=0 l=1 rx=0x7f3e240032b0 tx=0x7f3e24011270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:22.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e1bfff700 1 -- 172.21.15.63:0/152714789 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e24005e70 con 0x7f3e2c060b90 2020-05-18T21:32:22.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e2ad9d700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e2c060b90 0x7f3e2c0651b0 secure :-1 s=THROTTLE_DONE pgs=1165 cs=0 l=1 rx=0x7f3e240032b0 tx=0x7f3e24011270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:22.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e1bfff700 1 -- 172.21.15.63:0/152714789 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2400ed10 con 0x7f3e2c060b90 2020-05-18T21:32:22.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e31087700 1 -- 172.21.15.63:0/152714789 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2c14b860 con 0x7f3e2c060b90 2020-05-18T21:32:22.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e1bfff700 1 -- 172.21.15.63:0/152714789 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e24012ac0 con 0x7f3e2c060b90 2020-05-18T21:32:22.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e31087700 1 -- 172.21.15.63:0/152714789 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2c157be0 con 0x7f3e2c060b90 2020-05-18T21:32:22.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e2ad9d700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e2c060b90 0x7f3e2c0651b0 secure :-1 s=THROTTLE_DONE pgs=1165 cs=0 l=1 rx=0x7f3e240032b0 tx=0x7f3e24011270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:22.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e31087700 1 -- 172.21.15.63:0/152714789 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e2c0ace90 con 0x7f3e2c060b90 2020-05-18T21:32:22.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e1bfff700 1 -- 172.21.15.63:0/152714789 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3e24012d30 con 0x7f3e2c060b90 2020-05-18T21:32:22.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e2ad9d700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e2c060b90 0x7f3e2c0651b0 secure :-1 s=THROTTLE_DONE pgs=1165 cs=0 l=1 rx=0x7f3e240032b0 tx=0x7f3e24011270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:22.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e1bfff700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3e0804f8e0 0x7f3e08051da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:22.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e1bfff700 1 -- 172.21.15.63:0/152714789 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f3e24063eb0 con 0x7f3e2c060b90 2020-05-18T21:32:22.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e2a59c700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3e0804f8e0 0x7f3e08051da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:22.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e2a59c700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3e0804f8e0 0x7f3e08051da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e2c060650 tx=0x7f3e20001410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:22.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e2a59c700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3e0804f8e0 0x7f3e08051da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e2c060650 tx=0x7f3e20001410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:22.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.841+0000 7f3e2a59c700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3e0804f8e0 0x7f3e08051da0 secure :-1 s=READY pgs=461 cs=0 l=1 rx=0x7f3e2c060650 tx=0x7f3e20001410).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:22.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.849+0000 7f3e2ad9d700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e2c060b90 0x7f3e2c0651b0 secure :-1 s=THROTTLE_DONE pgs=1165 cs=0 l=1 rx=0x7f3e240032b0 tx=0x7f3e24011270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:22.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.849+0000 7f3e1bfff700 1 -- 172.21.15.63:0/152714789 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3e2403e240 con 0x7f3e2c060b90 2020-05-18T21:32:23.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.997+0000 7f3e31087700 1 -- 172.21.15.63:0/152714789 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e2c14b9f0 con 0x7f3e2c060b90 2020-05-18T21:32:23.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.997+0000 7f3e2ad9d700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e2c060b90 0x7f3e2c0651b0 secure :-1 s=THROTTLE_DONE pgs=1165 cs=0 l=1 rx=0x7f3e240032b0 tx=0x7f3e24011270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:23.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:22.997+0000 7f3e1bfff700 1 -- 172.21.15.63:0/152714789 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2159 (secure 0 0 0) 0x7f3e24041860 con 0x7f3e2c060b90 2020-05-18T21:32:23.002 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:23.003 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":67,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:20.666310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:stopping","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:23.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:23.001+0000 7f3e31087700 1 -- 172.21.15.63:0/152714789 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3e0804f8e0 msgr2=0x7f3e08051da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:23.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:23.001+0000 7f3e31087700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3e0804f8e0 0x7f3e08051da0 secure :-1 s=READY pgs=461 cs=0 l=1 rx=0x7f3e2c060650 tx=0x7f3e20001410).stop 2020-05-18T21:32:23.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:23.001+0000 7f3e31087700 1 -- 172.21.15.63:0/152714789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e2c060b90 msgr2=0x7f3e2c0651b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:23.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:23.001+0000 7f3e31087700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e2c060b90 0x7f3e2c0651b0 secure :-1 s=READY pgs=1165 cs=0 l=1 rx=0x7f3e240032b0 tx=0x7f3e24011270).stop 2020-05-18T21:32:23.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:23.001+0000 7f3e31087700 1 -- 172.21.15.63:0/152714789 shutdown_connections 2020-05-18T21:32:23.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:23.001+0000 7f3e31087700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3e0804f8e0 0x7f3e08051da0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:23.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:23.001+0000 7f3e31087700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e2c0b2860 0x7f3e2c065610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:23.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:23.001+0000 7f3e31087700 1 --2- 172.21.15.63:0/152714789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e2c060b90 0x7f3e2c0651b0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:23.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:23.001+0000 7f3e31087700 1 -- 172.21.15.63:0/152714789 >> 172.21.15.63:0/152714789 conn(0x7f3e2c0b83d0 msgr2=0x7f3e2c0b5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:23.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:23.001+0000 7f3e31087700 1 -- 172.21.15.63:0/152714789 shutdown_connections 2020-05-18T21:32:23.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:23.001+0000 7f3e31087700 1 -- 172.21.15.63:0/152714789 wait complete. 2020-05-18T21:32:23.006 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 67 2020-05-18T21:32:23.221 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:20.666310+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:stopping', 'state_seq': 6, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:23.222 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5756:up:stopping 2020-05-18T21:32:24.223 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f222a9b7700 1 Processor -- start 2020-05-18T21:32:24.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f222a9b7700 1 -- start start 2020-05-18T21:32:24.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f222a9b7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f22240615e0 0x7f222414e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:24.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f222a9b7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222414d960 con 0x7f2224060b90 2020-05-18T21:32:24.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f222a9b7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222414db90 con 0x7f22240b2860 2020-05-18T21:32:24.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f222a9b7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2224066210 con 0x7f22240615e0 2020-05-18T21:32:24.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f2223fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2224060b90 0x7f2224144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32958/0 (socket says 172.21.15.63:32958) 2020-05-18T21:32:24.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f2223fff700 1 -- 172.21.15.63:0/2525690287 learned_addr learned my addr 172.21.15.63:0/2525690287 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:24.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f2228f54700 1 --2- 172.21.15.63:0/2525690287 >> v2:172.21.15.63:3300/0 conn(0x7f22240615e0 0x7f222414e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:24.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f2222ffd700 1 -- 172.21.15.63:0/2525690287 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 909447888 0 0) 0x7f222414d960 con 0x7f2224060b90 2020-05-18T21:32:24.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f2222ffd700 1 -- 172.21.15.63:0/2525690287 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2210003270 con 0x7f2224060b90 2020-05-18T21:32:24.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f2222ffd700 1 -- 172.21.15.63:0/2525690287 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 343688689 0 0) 0x7f2210003270 con 0x7f2224060b90 2020-05-18T21:32:24.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f2228f54700 1 -- 172.21.15.63:0/2525690287 >> v1:172.21.15.155:6789/0 conn(0x7f22240b2860 legacy=0x7f222414a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:24.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f2228f54700 1 -- 172.21.15.63:0/2525690287 >> v1:172.21.15.63:6789/0 conn(0x7f2224060b90 legacy=0x7f2224144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:24.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f2228f54700 1 -- 172.21.15.63:0/2525690287 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222414de30 con 0x7f22240615e0 2020-05-18T21:32:24.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f2228f54700 1 --2- 172.21.15.63:0/2525690287 >> v2:172.21.15.63:3300/0 conn(0x7f22240615e0 0x7f222414e570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f22140018b0 tx=0x7f221c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:24.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f2228f54700 1 --2- 172.21.15.63:0/2525690287 >> v2:172.21.15.63:3300/0 conn(0x7f22240615e0 0x7f222414e570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f22140018b0 tx=0x7f221c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:24.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f2228f54700 1 --2- 172.21.15.63:0/2525690287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22240615e0 0x7f222414e570 secure :-1 s=READY pgs=1167 cs=0 l=1 rx=0x7f22140018b0 tx=0x7f221c007e00).ready entity=mon.0 client_cookie=c61b101f9d16234d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:24.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f2228f54700 1 --2- 172.21.15.63:0/2525690287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22240615e0 0x7f222414e570 secure :-1 s=THROTTLE_DONE pgs=1167 cs=0 l=1 rx=0x7f22140018b0 tx=0x7f221c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:24.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f2228f54700 1 --2- 172.21.15.63:0/2525690287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22240615e0 0x7f222414e570 secure :-1 s=THROTTLE_DONE pgs=1167 cs=0 l=1 rx=0x7f22140018b0 tx=0x7f221c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:24.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f2222ffd700 1 -- 172.21.15.63:0/2525690287 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2214001710 con 0x7f22240615e0 2020-05-18T21:32:24.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f2228f54700 1 --2- 172.21.15.63:0/2525690287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22240615e0 0x7f222414e570 secure :-1 s=THROTTLE_DONE pgs=1167 cs=0 l=1 rx=0x7f22140018b0 tx=0x7f221c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:24.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f2222ffd700 1 -- 172.21.15.63:0/2525690287 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221c011c60 con 0x7f22240615e0 2020-05-18T21:32:24.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f2222ffd700 1 -- 172.21.15.63:0/2525690287 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f221c00a180 con 0x7f22240615e0 2020-05-18T21:32:24.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f222a9b7700 1 -- 172.21.15.63:0/2525690287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22240615e0 msgr2=0x7f222414e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:24.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f222a9b7700 1 --2- 172.21.15.63:0/2525690287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22240615e0 0x7f222414e570 secure :-1 s=READY pgs=1167 cs=0 l=1 rx=0x7f22140018b0 tx=0x7f221c007e00).stop 2020-05-18T21:32:24.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f222a9b7700 1 -- 172.21.15.63:0/2525690287 shutdown_connections 2020-05-18T21:32:24.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f222a9b7700 1 --2- 172.21.15.63:0/2525690287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22240615e0 0x7f222414e570 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:24.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f222a9b7700 1 -- 172.21.15.63:0/2525690287 >> 172.21.15.63:0/2525690287 conn(0x7f22240b83d0 msgr2=0x7f22240b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:24.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f222a9b7700 1 -- 172.21.15.63:0/2525690287 shutdown_connections 2020-05-18T21:32:24.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.329+0000 7f222a9b7700 1 -- 172.21.15.63:0/2525690287 wait complete. 2020-05-18T21:32:24.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f222a9b7700 1 Processor -- start 2020-05-18T21:32:24.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f222a9b7700 1 -- start start 2020-05-18T21:32:24.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f222a9b7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22240615e0 0x7f2224149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:24.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f222a9b7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222415b2c0 con 0x7f22240b2860 2020-05-18T21:32:24.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f222a9b7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222415b560 con 0x7f2224060b90 2020-05-18T21:32:24.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f222a9b7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222415b800 con 0x7f22240615e0 2020-05-18T21:32:24.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f2228f54700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f22240b2860 0x7f2224144aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32966/0 (socket says 172.21.15.63:32966) 2020-05-18T21:32:24.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f2228f54700 1 -- 172.21.15.63:0/3354992876 learned_addr learned my addr 172.21.15.63:0/3354992876 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:24.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f22237fe700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22240615e0 0x7f2224149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:24.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f22217fa700 1 -- 172.21.15.63:0/3354992876 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848378266 0 0) 0x7f222415b2c0 con 0x7f22240b2860 2020-05-18T21:32:24.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f22217fa700 1 -- 172.21.15.63:0/3354992876 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2204002fe0 con 0x7f22240b2860 2020-05-18T21:32:24.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f22217fa700 1 -- 172.21.15.63:0/3354992876 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264320606 0 0) 0x7f222415b560 con 0x7f2224060b90 2020-05-18T21:32:24.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f22217fa700 1 -- 172.21.15.63:0/3354992876 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f222415b2c0 con 0x7f2224060b90 2020-05-18T21:32:24.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f22237fe700 1 -- 172.21.15.63:0/3354992876 >> v1:172.21.15.155:6789/0 conn(0x7f2224060b90 legacy=0x7f22240b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:24.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f22237fe700 1 -- 172.21.15.63:0/3354992876 >> v1:172.21.15.63:6789/0 conn(0x7f22240b2860 legacy=0x7f2224144aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:24.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f22217fa700 1 -- 172.21.15.63:0/3354992876 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2849098452 0 0) 0x7f2204002fe0 con 0x7f22240b2860 2020-05-18T21:32:24.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f22237fe700 1 -- 172.21.15.63:0/3354992876 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22240b1f30 con 0x7f22240615e0 2020-05-18T21:32:24.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f22237fe700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22240615e0 0x7f2224149b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f221c0086a0 tx=0x7f22180109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:24.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f22237fe700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22240615e0 0x7f2224149b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f221c0086a0 tx=0x7f22180109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:24.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f22237fe700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22240615e0 0x7f2224149b70 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f221c0086a0 tx=0x7f22180109a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:24.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f22237fe700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22240615e0 0x7f2224149b70 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f221c0086a0 tx=0x7f22180109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:24.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f22217fa700 1 -- 172.21.15.63:0/3354992876 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f221c011e80 con 0x7f22240615e0 2020-05-18T21:32:24.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.333+0000 7f22237fe700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22240615e0 0x7f2224149b70 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f221c0086a0 tx=0x7f22180109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:24.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.337+0000 7f222a9b7700 1 -- 172.21.15.63:0/3354992876 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f222415ac90 con 0x7f22240615e0 2020-05-18T21:32:24.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.337+0000 7f22217fa700 1 -- 172.21.15.63:0/3354992876 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221800ca70 con 0x7f22240615e0 2020-05-18T21:32:24.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.337+0000 7f22237fe700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22240615e0 0x7f2224149b70 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f221c0086a0 tx=0x7f22180109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:24.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.337+0000 7f222a9b7700 1 -- 172.21.15.63:0/3354992876 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2224069eb0 con 0x7f22240615e0 2020-05-18T21:32:24.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.337+0000 7f22217fa700 1 -- 172.21.15.63:0/3354992876 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f221800ce20 con 0x7f22240615e0 2020-05-18T21:32:24.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.337+0000 7f222a9b7700 1 -- 172.21.15.63:0/3354992876 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222406a360 con 0x7f22240615e0 2020-05-18T21:32:24.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.337+0000 7f22237fe700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22240615e0 0x7f2224149b70 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f221c0086a0 tx=0x7f22180109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:24.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.337+0000 7f22237fe700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22240615e0 0x7f2224149b70 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f221c0086a0 tx=0x7f22180109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:24.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.337+0000 7f22217fa700 1 -- 172.21.15.63:0/3354992876 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2218006520 con 0x7f22240615e0 2020-05-18T21:32:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.337+0000 7f22217fa700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f220404fe20 0x7f22040522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.337+0000 7f22217fa700 1 -- 172.21.15.63:0/3354992876 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f22180632a0 con 0x7f22240615e0 2020-05-18T21:32:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.337+0000 7f2223fff700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f220404fe20 0x7f22040522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.337+0000 7f2223fff700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f220404fe20 0x7f22040522e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2214000ed0 tx=0x7f2214001090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:24.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.337+0000 7f2223fff700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f220404fe20 0x7f22040522e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2214000ed0 tx=0x7f2214001090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:24.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.337+0000 7f2223fff700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f220404fe20 0x7f22040522e0 secure :-1 s=READY pgs=462 cs=0 l=1 rx=0x7f2214000ed0 tx=0x7f2214001090).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:24.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.345+0000 7f22237fe700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22240615e0 0x7f2224149b70 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f221c0086a0 tx=0x7f22180109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:24.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.345+0000 7f22217fa700 1 -- 172.21.15.63:0/3354992876 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f221803d5f0 con 0x7f22240615e0 2020-05-18T21:32:24.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.493+0000 7f222a9b7700 1 -- 172.21.15.63:0/3354992876 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22240569e0 con 0x7f22240615e0 2020-05-18T21:32:24.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.493+0000 7f22237fe700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22240615e0 0x7f2224149b70 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f221c0086a0 tx=0x7f22180109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:24.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.493+0000 7f22217fa700 1 -- 172.21.15.63:0/3354992876 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2159 (secure 0 0 0) 0x7f2218040c10 con 0x7f22240615e0 2020-05-18T21:32:24.499 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:24.500 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":67,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:20.666310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:stopping","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:24.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.497+0000 7f222a9b7700 1 -- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f220404fe20 msgr2=0x7f22040522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:24.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.497+0000 7f222a9b7700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f220404fe20 0x7f22040522e0 secure :-1 s=READY pgs=462 cs=0 l=1 rx=0x7f2214000ed0 tx=0x7f2214001090).stop 2020-05-18T21:32:24.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.497+0000 7f222a9b7700 1 -- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22240615e0 msgr2=0x7f2224149b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:24.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.497+0000 7f222a9b7700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22240615e0 0x7f2224149b70 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f221c0086a0 tx=0x7f22180109a0).stop 2020-05-18T21:32:24.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.497+0000 7f222a9b7700 1 -- 172.21.15.63:0/3354992876 shutdown_connections 2020-05-18T21:32:24.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.497+0000 7f222a9b7700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f220404fe20 0x7f22040522e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:24.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.497+0000 7f222a9b7700 1 --2- 172.21.15.63:0/3354992876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22240615e0 0x7f2224149b70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:24.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.497+0000 7f222a9b7700 1 -- 172.21.15.63:0/3354992876 >> 172.21.15.63:0/3354992876 conn(0x7f22240b83d0 msgr2=0x7f222414a390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:24.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.497+0000 7f222a9b7700 1 -- 172.21.15.63:0/3354992876 shutdown_connections 2020-05-18T21:32:24.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:24.497+0000 7f222a9b7700 1 -- 172.21.15.63:0/3354992876 wait complete. 2020-05-18T21:32:24.504 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 67 2020-05-18T21:32:24.718 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:20.666310+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:stopping', 'state_seq': 6, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:24.718 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5756:up:stopping 2020-05-18T21:32:25.720 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:25.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f4565f65700 1 Processor -- start 2020-05-18T21:32:25.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f4565f65700 1 -- start start 2020-05-18T21:32:25.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f4565f65700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f45600b6180 0x7f4560144810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:25.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f4565f65700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f45600b4f60 0x7f45600b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:25.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f4565f65700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4560069b70 con 0x7f456013de20 2020-05-18T21:32:25.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f4565f65700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4560069e10 con 0x7f45600b4f60 2020-05-18T21:32:25.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f4565f65700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456006a0b0 con 0x7f45600b6180 2020-05-18T21:32:25.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f455ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f45600b4f60 0x7f45600b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:25.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f455ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f45600b4f60 0x7f45600b53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59018/0 (socket says 172.21.15.63:59018) 2020-05-18T21:32:25.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f455ffff700 1 -- 172.21.15.63:0/329309450 learned_addr learned my addr 172.21.15.63:0/329309450 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:25.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f455effd700 1 --2- 172.21.15.63:0/329309450 >> v2:172.21.15.155:3300/0 conn(0x7f45600b6180 0x7f4560144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:25.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f455ffff700 1 -- 172.21.15.63:0/329309450 >> v2:172.21.15.155:3300/0 conn(0x7f45600b6180 msgr2=0x7f4560144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:25.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f455ffff700 1 --2- 172.21.15.63:0/329309450 >> v2:172.21.15.155:3300/0 conn(0x7f45600b6180 0x7f4560144810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:25.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f455ffff700 1 -- 172.21.15.63:0/329309450 >> v1:172.21.15.63:6789/0 conn(0x7f456013de20 legacy=0x7f456006a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:25.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f455ffff700 1 -- 172.21.15.63:0/329309450 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4560144c70 con 0x7f45600b4f60 2020-05-18T21:32:25.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f455ffff700 1 --2- 172.21.15.63:0/329309450 >> v2:172.21.15.63:3300/0 conn(0x7f45600b4f60 0x7f45600b53c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4558002f70 tx=0x7f4558007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:25.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f455ffff700 1 --2- 172.21.15.63:0/329309450 >> v2:172.21.15.63:3300/0 conn(0x7f45600b4f60 0x7f45600b53c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4558002f70 tx=0x7f4558007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:25.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f455ffff700 1 --2- 172.21.15.63:0/329309450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45600b4f60 0x7f45600b53c0 secure :-1 s=READY pgs=1170 cs=0 l=1 rx=0x7f4558002f70 tx=0x7f4558007a80).ready entity=mon.0 client_cookie=4fa544099797df8a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:25.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f455ffff700 1 --2- 172.21.15.63:0/329309450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45600b4f60 0x7f45600b53c0 secure :-1 s=THROTTLE_DONE pgs=1170 cs=0 l=1 rx=0x7f4558002f70 tx=0x7f4558007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:25.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f455ffff700 1 --2- 172.21.15.63:0/329309450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45600b4f60 0x7f45600b53c0 secure :-1 s=THROTTLE_DONE pgs=1170 cs=0 l=1 rx=0x7f4558002f70 tx=0x7f4558007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:25.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f455e7fc700 1 -- 172.21.15.63:0/329309450 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4558011760 con 0x7f45600b4f60 2020-05-18T21:32:25.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f455ffff700 1 --2- 172.21.15.63:0/329309450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45600b4f60 0x7f45600b53c0 secure :-1 s=THROTTLE_DONE pgs=1170 cs=0 l=1 rx=0x7f4558002f70 tx=0x7f4558007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:25.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f455e7fc700 1 -- 172.21.15.63:0/329309450 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45580118c0 con 0x7f45600b4f60 2020-05-18T21:32:25.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f455e7fc700 1 -- 172.21.15.63:0/329309450 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4558011ce0 con 0x7f45600b4f60 2020-05-18T21:32:25.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f4565f65700 1 -- 172.21.15.63:0/329309450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45600b4f60 msgr2=0x7f45600b53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:25.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f4565f65700 1 --2- 172.21.15.63:0/329309450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45600b4f60 0x7f45600b53c0 secure :-1 s=READY pgs=1170 cs=0 l=1 rx=0x7f4558002f70 tx=0x7f4558007a80).stop 2020-05-18T21:32:25.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f4565f65700 1 -- 172.21.15.63:0/329309450 shutdown_connections 2020-05-18T21:32:25.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f4565f65700 1 --2- 172.21.15.63:0/329309450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45600b4f60 0x7f45600b53c0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:25.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f4565f65700 1 --2- 172.21.15.63:0/329309450 >> v2:172.21.15.155:3300/0 conn(0x7f45600b6180 0x7f4560144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:25.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f4565f65700 1 -- 172.21.15.63:0/329309450 >> 172.21.15.63:0/329309450 conn(0x7f45600ba5c0 msgr2=0x7f45600ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:25.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f4565f65700 1 -- 172.21.15.63:0/329309450 shutdown_connections 2020-05-18T21:32:25.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.829+0000 7f4565f65700 1 -- 172.21.15.63:0/329309450 wait complete. 2020-05-18T21:32:25.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f4565f65700 1 Processor -- start 2020-05-18T21:32:25.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f4565f65700 1 -- start start 2020-05-18T21:32:25.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f4565f65700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f45600b6180 0x7f456013cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:25.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f4565f65700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f456013de20 0x7f45600b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:25.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f4565f65700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f456013d440 con 0x7f45600b4f60 2020-05-18T21:32:25.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f4565f65700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45600b2690 con 0x7f456013de20 2020-05-18T21:32:25.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f4565f65700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456013d670 con 0x7f45600b6180 2020-05-18T21:32:25.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f455f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f45600b4f60 0x7f45600b93a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32978/0 (socket says 172.21.15.63:32978) 2020-05-18T21:32:25.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f455f7fe700 1 -- 172.21.15.63:0/1674783701 learned_addr learned my addr 172.21.15.63:0/1674783701 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:25.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f455ffff700 1 --2- 172.21.15.63:0/1674783701 >> v2:172.21.15.63:3300/0 conn(0x7f456013de20 0x7f45600b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:25.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f455effd700 1 --2- 172.21.15.63:0/1674783701 >> v2:172.21.15.155:3300/0 conn(0x7f45600b6180 0x7f456013cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:25.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f455ffff700 1 -- 172.21.15.63:0/1674783701 >> v2:172.21.15.155:3300/0 conn(0x7f45600b6180 msgr2=0x7f456013cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:25.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f455ffff700 1 --2- 172.21.15.63:0/1674783701 >> v2:172.21.15.155:3300/0 conn(0x7f45600b6180 0x7f456013cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:25.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f455ffff700 1 -- 172.21.15.63:0/1674783701 >> v1:172.21.15.63:6789/0 conn(0x7f45600b4f60 legacy=0x7f45600b93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:25.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f455ffff700 1 -- 172.21.15.63:0/1674783701 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45600b9ab0 con 0x7f456013de20 2020-05-18T21:32:25.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f455cff9700 1 -- 172.21.15.63:0/1674783701 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188880257 0 0) 0x7f456013d440 con 0x7f45600b4f60 2020-05-18T21:32:25.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f455ffff700 1 --2- 172.21.15.63:0/1674783701 >> v2:172.21.15.63:3300/0 conn(0x7f456013de20 0x7f45600b2af0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4558002f70 tx=0x7f4558007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:25.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f455ffff700 1 --2- 172.21.15.63:0/1674783701 >> v2:172.21.15.63:3300/0 conn(0x7f456013de20 0x7f45600b2af0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4558002f70 tx=0x7f4558007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:25.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f455ffff700 1 --2- 172.21.15.63:0/1674783701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f456013de20 0x7f45600b2af0 secure :-1 s=READY pgs=1172 cs=0 l=1 rx=0x7f4558002f70 tx=0x7f4558007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:25.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f455ffff700 1 --2- 172.21.15.63:0/1674783701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f456013de20 0x7f45600b2af0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7f4558002f70 tx=0x7f4558007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:25.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f455cff9700 1 -- 172.21.15.63:0/1674783701 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4558011da0 con 0x7f456013de20 2020-05-18T21:32:25.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f455ffff700 1 --2- 172.21.15.63:0/1674783701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f456013de20 0x7f45600b2af0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7f4558002f70 tx=0x7f4558007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:25.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f455ffff700 1 --2- 172.21.15.63:0/1674783701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f456013de20 0x7f45600b2af0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7f4558002f70 tx=0x7f4558007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:25.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f455cff9700 1 -- 172.21.15.63:0/1674783701 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4558007360 con 0x7f456013de20 2020-05-18T21:32:25.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f4565f65700 1 -- 172.21.15.63:0/1674783701 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45600acee0 con 0x7f456013de20 2020-05-18T21:32:25.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f455cff9700 1 -- 172.21.15.63:0/1674783701 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4558005700 con 0x7f456013de20 2020-05-18T21:32:25.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.833+0000 7f4565f65700 1 -- 172.21.15.63:0/1674783701 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4560141220 con 0x7f456013de20 2020-05-18T21:32:25.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.837+0000 7f455ffff700 1 --2- 172.21.15.63:0/1674783701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f456013de20 0x7f45600b2af0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7f4558002f70 tx=0x7f4558007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:25.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.837+0000 7f4565f65700 1 -- 172.21.15.63:0/1674783701 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45600b2830 con 0x7f456013de20 2020-05-18T21:32:25.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.837+0000 7f455cff9700 1 -- 172.21.15.63:0/1674783701 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f45580058b0 con 0x7f456013de20 2020-05-18T21:32:25.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.837+0000 7f455ffff700 1 --2- 172.21.15.63:0/1674783701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f456013de20 0x7f45600b2af0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7f4558002f70 tx=0x7f4558007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:25.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.837+0000 7f455cff9700 1 --2- 172.21.15.63:0/1674783701 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f453804f860 0x7f4538051d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:25.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.837+0000 7f455cff9700 1 -- 172.21.15.63:0/1674783701 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f4558064310 con 0x7f456013de20 2020-05-18T21:32:25.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.837+0000 7f455f7fe700 1 --2- 172.21.15.63:0/1674783701 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f453804f860 0x7f4538051d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:25.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.837+0000 7f455f7fe700 1 --2- 172.21.15.63:0/1674783701 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f453804f860 0x7f4538051d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4550001620 tx=0x7f4550001ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:25.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.837+0000 7f455f7fe700 1 --2- 172.21.15.63:0/1674783701 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f453804f860 0x7f4538051d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4550001620 tx=0x7f4550001ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:25.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.837+0000 7f455f7fe700 1 --2- 172.21.15.63:0/1674783701 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f453804f860 0x7f4538051d20 secure :-1 s=READY pgs=463 cs=0 l=1 rx=0x7f4550001620 tx=0x7f4550001ba0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:25.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.841+0000 7f455ffff700 1 --2- 172.21.15.63:0/1674783701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f456013de20 0x7f45600b2af0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7f4558002f70 tx=0x7f4558007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:25.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.841+0000 7f455cff9700 1 -- 172.21.15.63:0/1674783701 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f45600b2830 con 0x7f456013de20 2020-05-18T21:32:25.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.993+0000 7f4565f65700 1 -- 172.21.15.63:0/1674783701 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45600b27d0 con 0x7f456013de20 2020-05-18T21:32:25.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.993+0000 7f455ffff700 1 --2- 172.21.15.63:0/1674783701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f456013de20 0x7f45600b2af0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7f4558002f70 tx=0x7f4558007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:25.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.993+0000 7f455cff9700 1 -- 172.21.15.63:0/1674783701 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2159 (secure 0 0 0) 0x7f455803e7c0 con 0x7f456013de20 2020-05-18T21:32:25.997 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:25.998 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":67,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:20.666310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:stopping","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:25.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.993+0000 7f4565f65700 1 -- 172.21.15.63:0/1674783701 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f453804f860 msgr2=0x7f4538051d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:25.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.993+0000 7f4565f65700 1 --2- 172.21.15.63:0/1674783701 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f453804f860 0x7f4538051d20 secure :-1 s=READY pgs=463 cs=0 l=1 rx=0x7f4550001620 tx=0x7f4550001ba0).stop 2020-05-18T21:32:25.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.993+0000 7f4565f65700 1 -- 172.21.15.63:0/1674783701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f456013de20 msgr2=0x7f45600b2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:25.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.993+0000 7f4565f65700 1 --2- 172.21.15.63:0/1674783701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f456013de20 0x7f45600b2af0 secure :-1 s=READY pgs=1172 cs=0 l=1 rx=0x7f4558002f70 tx=0x7f4558007a80).stop 2020-05-18T21:32:25.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.993+0000 7f4565f65700 1 -- 172.21.15.63:0/1674783701 shutdown_connections 2020-05-18T21:32:26.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.993+0000 7f4565f65700 1 --2- 172.21.15.63:0/1674783701 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f453804f860 0x7f4538051d20 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:26.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.993+0000 7f4565f65700 1 --2- 172.21.15.63:0/1674783701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f456013de20 0x7f45600b2af0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:26.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.993+0000 7f4565f65700 1 --2- 172.21.15.63:0/1674783701 >> v2:172.21.15.155:3300/0 conn(0x7f45600b6180 0x7f456013cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:26.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.993+0000 7f4565f65700 1 -- 172.21.15.63:0/1674783701 >> 172.21.15.63:0/1674783701 conn(0x7f45600ba5c0 msgr2=0x7f45601439a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:26.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.993+0000 7f4565f65700 1 -- 172.21.15.63:0/1674783701 shutdown_connections 2020-05-18T21:32:26.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:25.993+0000 7f4565f65700 1 -- 172.21.15.63:0/1674783701 wait complete. 2020-05-18T21:32:26.001 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 67 2020-05-18T21:32:26.212 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:20.666310+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:stopping', 'state_seq': 6, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:26.212 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5756:up:stopping 2020-05-18T21:32:27.214 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:27.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.317+0000 7f5dc8b57700 1 Processor -- start 2020-05-18T21:32:27.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.317+0000 7f5dc8b57700 1 -- start start 2020-05-18T21:32:27.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.317+0000 7f5dc8b57700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5dc405f110 0x7f5dc40acea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:27.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.317+0000 7f5dc8b57700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5dc413c710 0x7f5dc413cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:27.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.317+0000 7f5dc8b57700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc413cfa0 con 0x7f5dc40659d0 2020-05-18T21:32:27.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.317+0000 7f5dc8b57700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc40b4af0 con 0x7f5dc413c710 2020-05-18T21:32:27.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.317+0000 7f5dc8b57700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc41460e0 con 0x7f5dc405f110 2020-05-18T21:32:27.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.317+0000 7f5dc3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5dc413c710 0x7f5dc413cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:27.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.317+0000 7f5dc3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5dc413c710 0x7f5dc413cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59034/0 (socket says 172.21.15.63:59034) 2020-05-18T21:32:27.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.317+0000 7f5dc3fff700 1 -- 172.21.15.63:0/553349525 learned_addr learned my addr 172.21.15.63:0/553349525 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:27.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc37fe700 1 --2- 172.21.15.63:0/553349525 >> v2:172.21.15.155:3300/0 conn(0x7f5dc405f110 0x7f5dc40acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:27.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc3fff700 1 -- 172.21.15.63:0/553349525 >> v2:172.21.15.155:3300/0 conn(0x7f5dc405f110 msgr2=0x7f5dc40acea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:27.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc3fff700 1 --2- 172.21.15.63:0/553349525 >> v2:172.21.15.155:3300/0 conn(0x7f5dc405f110 0x7f5dc40acea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:27.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc3fff700 1 -- 172.21.15.63:0/553349525 >> v1:172.21.15.155:6789/0 conn(0x7f5dc40659d0 legacy=0x7f5dc4146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:27.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc3fff700 1 -- 172.21.15.63:0/553349525 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc4146380 con 0x7f5dc413c710 2020-05-18T21:32:27.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc3fff700 1 --2- 172.21.15.63:0/553349525 >> v2:172.21.15.63:3300/0 conn(0x7f5dc413c710 0x7f5dc413cb40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5dbc0032f0 tx=0x7f5dbc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:27.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc3fff700 1 --2- 172.21.15.63:0/553349525 >> v2:172.21.15.63:3300/0 conn(0x7f5dc413c710 0x7f5dc413cb40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5dbc0032f0 tx=0x7f5dbc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:27.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc3fff700 1 --2- 172.21.15.63:0/553349525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc413c710 0x7f5dc413cb40 secure :-1 s=READY pgs=1173 cs=0 l=1 rx=0x7f5dbc0032f0 tx=0x7f5dbc007e00).ready entity=mon.0 client_cookie=d211e00aded3cc26 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:27.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc3fff700 1 --2- 172.21.15.63:0/553349525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc413c710 0x7f5dc413cb40 secure :-1 s=THROTTLE_DONE pgs=1173 cs=0 l=1 rx=0x7f5dbc0032f0 tx=0x7f5dbc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:27.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc2ffd700 1 -- 172.21.15.63:0/553349525 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dbc011dc0 con 0x7f5dc413c710 2020-05-18T21:32:27.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc3fff700 1 --2- 172.21.15.63:0/553349525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc413c710 0x7f5dc413cb40 secure :-1 s=THROTTLE_DONE pgs=1173 cs=0 l=1 rx=0x7f5dbc0032f0 tx=0x7f5dbc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:27.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc2ffd700 1 -- 172.21.15.63:0/553349525 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc00a180 con 0x7f5dc413c710 2020-05-18T21:32:27.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc3fff700 1 --2- 172.21.15.63:0/553349525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc413c710 0x7f5dc413cb40 secure :-1 s=THROTTLE_DONE pgs=1173 cs=0 l=1 rx=0x7f5dbc0032f0 tx=0x7f5dbc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:27.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc8b57700 1 -- 172.21.15.63:0/553349525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc413c710 msgr2=0x7f5dc413cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:27.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc2ffd700 1 -- 172.21.15.63:0/553349525 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dbc00a5a0 con 0x7f5dc413c710 2020-05-18T21:32:27.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc8b57700 1 --2- 172.21.15.63:0/553349525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc413c710 0x7f5dc413cb40 secure :-1 s=READY pgs=1173 cs=0 l=1 rx=0x7f5dbc0032f0 tx=0x7f5dbc007e00).stop 2020-05-18T21:32:27.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc8b57700 1 -- 172.21.15.63:0/553349525 shutdown_connections 2020-05-18T21:32:27.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc8b57700 1 --2- 172.21.15.63:0/553349525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5dc413c710 0x7f5dc413cb40 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:27.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc8b57700 1 --2- 172.21.15.63:0/553349525 >> v2:172.21.15.155:3300/0 conn(0x7f5dc405f110 0x7f5dc40acea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:27.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc8b57700 1 -- 172.21.15.63:0/553349525 >> 172.21.15.63:0/553349525 conn(0x7f5dc4069fc0 msgr2=0x7f5dc406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:27.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc8b57700 1 -- 172.21.15.63:0/553349525 shutdown_connections 2020-05-18T21:32:27.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc8b57700 1 -- 172.21.15.63:0/553349525 wait complete. 2020-05-18T21:32:27.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.321+0000 7f5dc8b57700 1 Processor -- start 2020-05-18T21:32:27.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dc8b57700 1 -- start start 2020-05-18T21:32:27.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dc8b57700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5dc40659d0 0x7f5dc413e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:27.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dc8b57700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc41417f0 con 0x7f5dc405f110 2020-05-18T21:32:27.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dc8b57700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc4141a90 con 0x7f5dc413c710 2020-05-18T21:32:27.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dc8b57700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc41415e0 con 0x7f5dc40659d0 2020-05-18T21:32:27.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dc37fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5dc405f110 0x7f5dc413e190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32992/0 (socket says 172.21.15.63:32992) 2020-05-18T21:32:27.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dc37fe700 1 -- 172.21.15.63:0/3674199602 learned_addr learned my addr 172.21.15.63:0/3674199602 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:27.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dbbfff700 1 --2- 172.21.15.63:0/3674199602 >> v2:172.21.15.155:3300/0 conn(0x7f5dc40659d0 0x7f5dc413e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:27.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dc17fa700 1 -- 172.21.15.63:0/3674199602 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136845733 0 0) 0x7f5dc41417f0 con 0x7f5dc405f110 2020-05-18T21:32:27.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dc17fa700 1 -- 172.21.15.63:0/3674199602 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5da8002fe0 con 0x7f5dc405f110 2020-05-18T21:32:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dbbfff700 1 -- 172.21.15.63:0/3674199602 >> v1:172.21.15.155:6789/0 conn(0x7f5dc413c710 legacy=0x7f5dc413f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dbbfff700 1 -- 172.21.15.63:0/3674199602 >> v1:172.21.15.63:6789/0 conn(0x7f5dc405f110 legacy=0x7f5dc413e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dbbfff700 1 -- 172.21.15.63:0/3674199602 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc40ad3d0 con 0x7f5dc40659d0 2020-05-18T21:32:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dbbfff700 1 --2- 172.21.15.63:0/3674199602 >> v2:172.21.15.155:3300/0 conn(0x7f5dc40659d0 0x7f5dc413e8a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5dc40ad390 tx=0x7f5dac010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:27.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dbbfff700 1 --2- 172.21.15.63:0/3674199602 >> v2:172.21.15.155:3300/0 conn(0x7f5dc40659d0 0x7f5dc413e8a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5dc40ad390 tx=0x7f5dac010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:27.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dbbfff700 1 --2- 172.21.15.63:0/3674199602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dc40659d0 0x7f5dc413e8a0 secure :-1 s=READY pgs=811 cs=0 l=1 rx=0x7f5dc40ad390 tx=0x7f5dac010920).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:27.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dbbfff700 1 --2- 172.21.15.63:0/3674199602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dc40659d0 0x7f5dc413e8a0 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f5dc40ad390 tx=0x7f5dac010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:27.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dc17fa700 1 -- 172.21.15.63:0/3674199602 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dac00cd30 con 0x7f5dc40659d0 2020-05-18T21:32:27.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dbbfff700 1 --2- 172.21.15.63:0/3674199602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dc40659d0 0x7f5dc413e8a0 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f5dc40ad390 tx=0x7f5dac010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:27.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dc8b57700 1 -- 172.21.15.63:0/3674199602 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc40ad620 con 0x7f5dc40659d0 2020-05-18T21:32:27.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dc17fa700 1 -- 172.21.15.63:0/3674199602 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dac00ce90 con 0x7f5dc40659d0 2020-05-18T21:32:27.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.325+0000 7f5dbbfff700 1 --2- 172.21.15.63:0/3674199602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dc40659d0 0x7f5dc413e8a0 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f5dc40ad390 tx=0x7f5dac010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:27.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.329+0000 7f5dc17fa700 1 -- 172.21.15.63:0/3674199602 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dac011140 con 0x7f5dc40659d0 2020-05-18T21:32:27.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.329+0000 7f5dc8b57700 1 -- 172.21.15.63:0/3674199602 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc41435d0 con 0x7f5dc40659d0 2020-05-18T21:32:27.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.329+0000 7f5dc8b57700 1 -- 172.21.15.63:0/3674199602 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc4141c20 con 0x7f5dc40659d0 2020-05-18T21:32:27.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.329+0000 7f5dbbfff700 1 --2- 172.21.15.63:0/3674199602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dc40659d0 0x7f5dc413e8a0 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f5dc40ad390 tx=0x7f5dac010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:27.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.329+0000 7f5dc17fa700 1 -- 172.21.15.63:0/3674199602 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5dac006520 con 0x7f5dc40659d0 2020-05-18T21:32:27.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.329+0000 7f5dbbfff700 1 --2- 172.21.15.63:0/3674199602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dc40659d0 0x7f5dc413e8a0 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f5dc40ad390 tx=0x7f5dac010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:27.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.329+0000 7f5dc17fa700 1 --2- 172.21.15.63:0/3674199602 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5da804fcf0 0x7f5da80521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:27.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.329+0000 7f5dc17fa700 1 -- 172.21.15.63:0/3674199602 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f5dac0636a0 con 0x7f5dc40659d0 2020-05-18T21:32:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.329+0000 7f5dc37fe700 1 --2- 172.21.15.63:0/3674199602 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5da804fcf0 0x7f5da80521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.333+0000 7f5dc37fe700 1 --2- 172.21.15.63:0/3674199602 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5da804fcf0 0x7f5da80521b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5db4002f70 tx=0x7f5db4002380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.333+0000 7f5dc37fe700 1 --2- 172.21.15.63:0/3674199602 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5da804fcf0 0x7f5da80521b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5db4002f70 tx=0x7f5db4002380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.333+0000 7f5dc37fe700 1 --2- 172.21.15.63:0/3674199602 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5da804fcf0 0x7f5da80521b0 secure :-1 s=READY pgs=464 cs=0 l=1 rx=0x7f5db4002f70 tx=0x7f5db4002380).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:27.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.341+0000 7f5dbbfff700 1 --2- 172.21.15.63:0/3674199602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dc40659d0 0x7f5dc413e8a0 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f5dc40ad390 tx=0x7f5dac010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:27.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.341+0000 7f5dc17fa700 1 -- 172.21.15.63:0/3674199602 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f5dac03da90 con 0x7f5dc40659d0 2020-05-18T21:32:27.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.493+0000 7f5dc8b57700 1 -- 172.21.15.63:0/3674199602 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5dc40569e0 con 0x7f5dc40659d0 2020-05-18T21:32:27.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.493+0000 7f5dbbfff700 1 --2- 172.21.15.63:0/3674199602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dc40659d0 0x7f5dc413e8a0 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f5dc40ad390 tx=0x7f5dac010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:27.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.493+0000 7f5dc17fa700 1 -- 172.21.15.63:0/3674199602 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2159 (secure 0 0 0) 0x7f5dac0410b0 con 0x7f5dc40659d0 2020-05-18T21:32:27.497 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:27.498 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":67,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:20.666310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:stopping","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:27.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.493+0000 7f5dc8b57700 1 -- 172.21.15.63:0/3674199602 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5da804fcf0 msgr2=0x7f5da80521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:27.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.493+0000 7f5dc8b57700 1 --2- 172.21.15.63:0/3674199602 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5da804fcf0 0x7f5da80521b0 secure :-1 s=READY pgs=464 cs=0 l=1 rx=0x7f5db4002f70 tx=0x7f5db4002380).stop 2020-05-18T21:32:27.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.493+0000 7f5dc8b57700 1 -- 172.21.15.63:0/3674199602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dc40659d0 msgr2=0x7f5dc413e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:27.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.493+0000 7f5dc8b57700 1 --2- 172.21.15.63:0/3674199602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dc40659d0 0x7f5dc413e8a0 secure :-1 s=READY pgs=811 cs=0 l=1 rx=0x7f5dc40ad390 tx=0x7f5dac010920).stop 2020-05-18T21:32:27.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.493+0000 7f5dc8b57700 1 -- 172.21.15.63:0/3674199602 shutdown_connections 2020-05-18T21:32:27.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.493+0000 7f5dc8b57700 1 --2- 172.21.15.63:0/3674199602 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5da804fcf0 0x7f5da80521b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:27.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.493+0000 7f5dc8b57700 1 --2- 172.21.15.63:0/3674199602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dc40659d0 0x7f5dc413e8a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:27.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.493+0000 7f5dc8b57700 1 -- 172.21.15.63:0/3674199602 >> 172.21.15.63:0/3674199602 conn(0x7f5dc4069fc0 msgr2=0x7f5dc4063920 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:27.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.497+0000 7f5dc8b57700 1 -- 172.21.15.63:0/3674199602 shutdown_connections 2020-05-18T21:32:27.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:27.497+0000 7f5dc8b57700 1 -- 172.21.15.63:0/3674199602 wait complete. 2020-05-18T21:32:27.501 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 67 2020-05-18T21:32:27.714 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:20.666310+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:stopping', 'state_seq': 6, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:27.715 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5756:up:stopping 2020-05-18T21:32:28.716 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:28.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd79564c700 1 Processor -- start 2020-05-18T21:32:28.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd79564c700 1 -- start start 2020-05-18T21:32:28.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd79564c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd790060b90 0x7fd7900615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:28.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd79564c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79014d960 con 0x7fd79014e570 2020-05-18T21:32:28.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd79564c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79014db90 con 0x7fd7900b2860 2020-05-18T21:32:28.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd79564c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd790066210 con 0x7fd790060b90 2020-05-18T21:32:28.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd78effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd790060b90 0x7fd7900615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:28.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd78f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd79014e570 0x7fd79014a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33002/0 (socket says 172.21.15.63:33002) 2020-05-18T21:32:28.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd78f7fe700 1 -- 172.21.15.63:0/3631136361 learned_addr learned my addr 172.21.15.63:0/3631136361 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:28.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd78effd700 1 -- 172.21.15.63:0/3631136361 >> v1:172.21.15.155:6789/0 conn(0x7fd7900b2860 legacy=0x7fd790144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:28.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd78dffb700 1 -- 172.21.15.63:0/3631136361 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151165656 0 0) 0x7fd79014db90 con 0x7fd7900b2860 2020-05-18T21:32:28.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd78effd700 1 -- 172.21.15.63:0/3631136361 >> v1:172.21.15.63:6789/0 conn(0x7fd79014e570 legacy=0x7fd79014a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:28.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd78effd700 1 -- 172.21.15.63:0/3631136361 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79014de30 con 0x7fd790060b90 2020-05-18T21:32:28.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd78effd700 1 --2- 172.21.15.63:0/3631136361 >> v2:172.21.15.63:3300/0 conn(0x7fd790060b90 0x7fd7900615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd790062dc0 tx=0x7fd780008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:28.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd78effd700 1 --2- 172.21.15.63:0/3631136361 >> v2:172.21.15.63:3300/0 conn(0x7fd790060b90 0x7fd7900615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd790062dc0 tx=0x7fd780008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:28.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd78effd700 1 --2- 172.21.15.63:0/3631136361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd790060b90 0x7fd7900615e0 secure :-1 s=READY pgs=1176 cs=0 l=1 rx=0x7fd790062dc0 tx=0x7fd780008920).ready entity=mon.0 client_cookie=45980c036c1a917f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:28.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd78effd700 1 --2- 172.21.15.63:0/3631136361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd790060b90 0x7fd7900615e0 secure :-1 s=THROTTLE_DONE pgs=1176 cs=0 l=1 rx=0x7fd790062dc0 tx=0x7fd780008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:28.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd78effd700 1 --2- 172.21.15.63:0/3631136361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd790060b90 0x7fd7900615e0 secure :-1 s=THROTTLE_DONE pgs=1176 cs=0 l=1 rx=0x7fd790062dc0 tx=0x7fd780008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:28.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd78dffb700 1 -- 172.21.15.63:0/3631136361 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd780008e80 con 0x7fd790060b90 2020-05-18T21:32:28.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd78effd700 1 --2- 172.21.15.63:0/3631136361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd790060b90 0x7fd7900615e0 secure :-1 s=THROTTLE_DONE pgs=1176 cs=0 l=1 rx=0x7fd790062dc0 tx=0x7fd780008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:28.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd78dffb700 1 -- 172.21.15.63:0/3631136361 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7800115a0 con 0x7fd790060b90 2020-05-18T21:32:28.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd78dffb700 1 -- 172.21.15.63:0/3631136361 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd780011940 con 0x7fd790060b90 2020-05-18T21:32:28.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd79564c700 1 -- 172.21.15.63:0/3631136361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd790060b90 msgr2=0x7fd7900615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:28.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd79564c700 1 --2- 172.21.15.63:0/3631136361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd790060b90 0x7fd7900615e0 secure :-1 s=READY pgs=1176 cs=0 l=1 rx=0x7fd790062dc0 tx=0x7fd780008920).stop 2020-05-18T21:32:28.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd79564c700 1 -- 172.21.15.63:0/3631136361 shutdown_connections 2020-05-18T21:32:28.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd79564c700 1 --2- 172.21.15.63:0/3631136361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd790060b90 0x7fd7900615e0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:28.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd79564c700 1 -- 172.21.15.63:0/3631136361 >> 172.21.15.63:0/3631136361 conn(0x7fd7900b83d0 msgr2=0x7fd7900b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:28.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd79564c700 1 -- 172.21.15.63:0/3631136361 shutdown_connections 2020-05-18T21:32:28.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.825+0000 7fd79564c700 1 -- 172.21.15.63:0/3631136361 wait complete. 2020-05-18T21:32:28.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd79564c700 1 Processor -- start 2020-05-18T21:32:28.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd79564c700 1 -- start start 2020-05-18T21:32:28.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd79564c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd790060b90 0x7fd7900acd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:28.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd79564c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7900b2860 0x7fd7900b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:28.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd79564c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd79014e570 0x7fd790147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:28.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd79564c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7900b7e10 con 0x7fd790060b90 2020-05-18T21:32:28.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd79564c700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd790147240 con 0x7fd79014e570 2020-05-18T21:32:28.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd79564c700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7901474e0 con 0x7fd7900b2860 2020-05-18T21:32:28.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd78effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd790060b90 0x7fd7900acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:28.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd78effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd790060b90 0x7fd7900acd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59050/0 (socket says 172.21.15.63:59050) 2020-05-18T21:32:28.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd78effd700 1 -- 172.21.15.63:0/3647003262 learned_addr learned my addr 172.21.15.63:0/3647003262 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:28.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd78f7fe700 1 --2- 172.21.15.63:0/3647003262 >> v2:172.21.15.155:3300/0 conn(0x7fd79014e570 0x7fd790147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:28.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd78e7fc700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7900b2860 0x7fd7900b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:28.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd78effd700 1 -- 172.21.15.63:0/3647003262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7900b2860 msgr2=0x7fd7900b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:28.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd78effd700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7900b2860 0x7fd7900b79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:28.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd78effd700 1 -- 172.21.15.63:0/3647003262 >> v2:172.21.15.155:3300/0 conn(0x7fd79014e570 msgr2=0x7fd790147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:28.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd78effd700 1 --2- 172.21.15.63:0/3647003262 >> v2:172.21.15.155:3300/0 conn(0x7fd79014e570 0x7fd790147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:28.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd78effd700 1 -- 172.21.15.63:0/3647003262 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7900ad560 con 0x7fd790060b90 2020-05-18T21:32:28.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd78effd700 1 --2- 172.21.15.63:0/3647003262 >> v2:172.21.15.63:3300/0 conn(0x7fd790060b90 0x7fd7900acd00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd790062dc0 tx=0x7fd79005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:28.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd78effd700 1 --2- 172.21.15.63:0/3647003262 >> v2:172.21.15.63:3300/0 conn(0x7fd790060b90 0x7fd7900acd00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd790062dc0 tx=0x7fd79005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:28.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd78effd700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd790060b90 0x7fd7900acd00 secure :-1 s=READY pgs=1177 cs=0 l=1 rx=0x7fd790062dc0 tx=0x7fd79005fa60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:28.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd78effd700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd790060b90 0x7fd7900acd00 secure :-1 s=THROTTLE_DONE pgs=1177 cs=0 l=1 rx=0x7fd790062dc0 tx=0x7fd79005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:28.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd78effd700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd790060b90 0x7fd7900acd00 secure :-1 s=THROTTLE_DONE pgs=1177 cs=0 l=1 rx=0x7fd790062dc0 tx=0x7fd79005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:28.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd787fff700 1 -- 172.21.15.63:0/3647003262 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd780011e80 con 0x7fd790060b90 2020-05-18T21:32:28.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.829+0000 7fd78effd700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd790060b90 0x7fd7900acd00 secure :-1 s=THROTTLE_DONE pgs=1177 cs=0 l=1 rx=0x7fd790062dc0 tx=0x7fd79005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:28.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.833+0000 7fd787fff700 1 -- 172.21.15.63:0/3647003262 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78000c560 con 0x7fd790060b90 2020-05-18T21:32:28.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.833+0000 7fd79564c700 1 -- 172.21.15.63:0/3647003262 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd790147de0 con 0x7fd790060b90 2020-05-18T21:32:28.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.833+0000 7fd787fff700 1 -- 172.21.15.63:0/3647003262 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd78000c940 con 0x7fd790060b90 2020-05-18T21:32:28.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.833+0000 7fd79564c700 1 -- 172.21.15.63:0/3647003262 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7900aeaf0 con 0x7fd790060b90 2020-05-18T21:32:28.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.833+0000 7fd79564c700 1 -- 172.21.15.63:0/3647003262 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7900569e0 con 0x7fd790060b90 2020-05-18T21:32:28.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.833+0000 7fd78effd700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd790060b90 0x7fd7900acd00 secure :-1 s=THROTTLE_DONE pgs=1177 cs=0 l=1 rx=0x7fd790062dc0 tx=0x7fd79005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:28.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.833+0000 7fd787fff700 1 -- 172.21.15.63:0/3647003262 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd78000cbb0 con 0x7fd790060b90 2020-05-18T21:32:28.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.833+0000 7fd78effd700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd790060b90 0x7fd7900acd00 secure :-1 s=THROTTLE_DONE pgs=1177 cs=0 l=1 rx=0x7fd790062dc0 tx=0x7fd79005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:28.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.833+0000 7fd787fff700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd77404fa50 0x7fd774051f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:28.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.833+0000 7fd787fff700 1 -- 172.21.15.63:0/3647003262 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fd7800647e0 con 0x7fd790060b90 2020-05-18T21:32:28.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.833+0000 7fd78e7fc700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd77404fa50 0x7fd774051f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:28.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.837+0000 7fd78e7fc700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd77404fa50 0x7fd774051f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd778000bc0 tx=0x7fd778001a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:28.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.837+0000 7fd78e7fc700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd77404fa50 0x7fd774051f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd778000bc0 tx=0x7fd778001a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:28.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.837+0000 7fd78e7fc700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd77404fa50 0x7fd774051f10 secure :-1 s=READY pgs=465 cs=0 l=1 rx=0x7fd778000bc0 tx=0x7fd778001a20).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:28.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.841+0000 7fd78effd700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd790060b90 0x7fd7900acd00 secure :-1 s=THROTTLE_DONE pgs=1177 cs=0 l=1 rx=0x7fd790062dc0 tx=0x7fd79005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:28.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.841+0000 7fd787fff700 1 -- 172.21.15.63:0/3647003262 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd78003ec30 con 0x7fd790060b90 2020-05-18T21:32:28.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.985+0000 7fd79564c700 1 -- 172.21.15.63:0/3647003262 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7900008d0 con 0x7fd790060b90 2020-05-18T21:32:28.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.985+0000 7fd78effd700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd790060b90 0x7fd7900acd00 secure :-1 s=THROTTLE_DONE pgs=1177 cs=0 l=1 rx=0x7fd790062dc0 tx=0x7fd79005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:28.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.985+0000 7fd787fff700 1 -- 172.21.15.63:0/3647003262 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2159 (secure 0 0 0) 0x7fd780042250 con 0x7fd790060b90 2020-05-18T21:32:28.991 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:28.991 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":67,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:20.666310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:stopping","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:28.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.985+0000 7fd79564c700 1 -- 172.21.15.63:0/3647003262 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd77404fa50 msgr2=0x7fd774051f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:28.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.985+0000 7fd79564c700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd77404fa50 0x7fd774051f10 secure :-1 s=READY pgs=465 cs=0 l=1 rx=0x7fd778000bc0 tx=0x7fd778001a20).stop 2020-05-18T21:32:28.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.985+0000 7fd79564c700 1 -- 172.21.15.63:0/3647003262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd790060b90 msgr2=0x7fd7900acd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:28.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.985+0000 7fd79564c700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd790060b90 0x7fd7900acd00 secure :-1 s=READY pgs=1177 cs=0 l=1 rx=0x7fd790062dc0 tx=0x7fd79005fa60).stop 2020-05-18T21:32:28.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.985+0000 7fd79564c700 1 -- 172.21.15.63:0/3647003262 shutdown_connections 2020-05-18T21:32:28.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.985+0000 7fd79564c700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd77404fa50 0x7fd774051f10 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:28.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.985+0000 7fd79564c700 1 --2- 172.21.15.63:0/3647003262 >> v2:172.21.15.155:3300/0 conn(0x7fd79014e570 0x7fd790147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:28.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.985+0000 7fd79564c700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7900b2860 0x7fd7900b79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:28.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.985+0000 7fd79564c700 1 --2- 172.21.15.63:0/3647003262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd790060b90 0x7fd7900acd00 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:28.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.989+0000 7fd79564c700 1 -- 172.21.15.63:0/3647003262 >> 172.21.15.63:0/3647003262 conn(0x7fd7900b83d0 msgr2=0x7fd7900648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:28.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.989+0000 7fd79564c700 1 -- 172.21.15.63:0/3647003262 shutdown_connections 2020-05-18T21:32:28.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:28.989+0000 7fd79564c700 1 -- 172.21.15.63:0/3647003262 wait complete. 2020-05-18T21:32:28.997 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 67 2020-05-18T21:32:29.203 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:20.666310+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:stopping', 'state_seq': 6, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:29.204 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5756:up:stopping 2020-05-18T21:32:29.493 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:32:29.496 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:32:30.205 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:30.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.313+0000 7f2c2759e700 1 Processor -- start 2020-05-18T21:32:30.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.313+0000 7f2c2759e700 1 -- start start 2020-05-18T21:32:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.313+0000 7f2c2759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c28152890 0x7f2c28154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.313+0000 7f2c2759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2814e530 con 0x7f2c28064940 2020-05-18T21:32:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.313+0000 7f2c2759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c28064f30 con 0x7f2c2805f110 2020-05-18T21:32:30.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.313+0000 7f2c2759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c280b5800 con 0x7f2c28152890 2020-05-18T21:32:30.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.313+0000 7f2c25d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2c28064940 0x7f2c2814de20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33014/0 (socket says 172.21.15.63:33014) 2020-05-18T21:32:30.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.313+0000 7f2c25d9b700 1 -- 172.21.15.63:0/536812431 learned_addr learned my addr 172.21.15.63:0/536812431 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:30.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.313+0000 7f2c26d9d700 1 --2- 172.21.15.63:0/536812431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c28152890 0x7f2c28154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:30.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.313+0000 7f2c2559a700 1 -- 172.21.15.63:0/536812431 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1938145848 0 0) 0x7f2c2814e530 con 0x7f2c28064940 2020-05-18T21:32:30.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.313+0000 7f2c2559a700 1 -- 172.21.15.63:0/536812431 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c08003270 con 0x7f2c28064940 2020-05-18T21:32:30.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.313+0000 7f2c2559a700 1 -- 172.21.15.63:0/536812431 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429677198 0 0) 0x7f2c28064f30 con 0x7f2c2805f110 2020-05-18T21:32:30.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c2559a700 1 -- 172.21.15.63:0/536812431 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c2814e530 con 0x7f2c2805f110 2020-05-18T21:32:30.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c26d9d700 1 -- 172.21.15.63:0/536812431 >> v1:172.21.15.155:6789/0 conn(0x7f2c2805f110 legacy=0x7f2c2814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:30.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c26d9d700 1 -- 172.21.15.63:0/536812431 >> v1:172.21.15.63:6789/0 conn(0x7f2c28064940 legacy=0x7f2c2814de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:30.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c26d9d700 1 -- 172.21.15.63:0/536812431 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c280651d0 con 0x7f2c28152890 2020-05-18T21:32:30.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c26d9d700 1 --2- 172.21.15.63:0/536812431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c28152890 0x7f2c28154c80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2c200032f0 tx=0x7f2c20008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:30.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c26d9d700 1 --2- 172.21.15.63:0/536812431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c28152890 0x7f2c28154c80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2c200032f0 tx=0x7f2c20008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:30.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c26d9d700 1 --2- 172.21.15.63:0/536812431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c28152890 0x7f2c28154c80 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f2c200032f0 tx=0x7f2c20008ca0).ready entity=mon.2 client_cookie=4d182307a2e84c58 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:30.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c26d9d700 1 --2- 172.21.15.63:0/536812431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c28152890 0x7f2c28154c80 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f2c200032f0 tx=0x7f2c20008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:30.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c2559a700 1 -- 172.21.15.63:0/536812431 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c20011df0 con 0x7f2c28152890 2020-05-18T21:32:30.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c26d9d700 1 --2- 172.21.15.63:0/536812431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c28152890 0x7f2c28154c80 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f2c200032f0 tx=0x7f2c20008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:30.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c26d9d700 1 --2- 172.21.15.63:0/536812431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c28152890 0x7f2c28154c80 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f2c200032f0 tx=0x7f2c20008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:30.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c2559a700 1 -- 172.21.15.63:0/536812431 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2000a180 con 0x7f2c28152890 2020-05-18T21:32:30.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c2559a700 1 -- 172.21.15.63:0/536812431 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c2000a4e0 con 0x7f2c28152890 2020-05-18T21:32:30.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c2759e700 1 -- 172.21.15.63:0/536812431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c28152890 msgr2=0x7f2c28154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:30.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c2759e700 1 --2- 172.21.15.63:0/536812431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c28152890 0x7f2c28154c80 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f2c200032f0 tx=0x7f2c20008ca0).stop 2020-05-18T21:32:30.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c2759e700 1 -- 172.21.15.63:0/536812431 shutdown_connections 2020-05-18T21:32:30.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c2759e700 1 --2- 172.21.15.63:0/536812431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c28152890 0x7f2c28154c80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:30.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c2759e700 1 -- 172.21.15.63:0/536812431 >> 172.21.15.63:0/536812431 conn(0x7f2c28069fc0 msgr2=0x7f2c2806a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:30.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c2759e700 1 -- 172.21.15.63:0/536812431 shutdown_connections 2020-05-18T21:32:30.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.317+0000 7f2c2759e700 1 -- 172.21.15.63:0/536812431 wait complete. 2020-05-18T21:32:30.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2759e700 1 Processor -- start 2020-05-18T21:32:30.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2759e700 1 -- start start 2020-05-18T21:32:30.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2c2805f110 0x7f2c28146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:30.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2c28152890 0x7f2c28143250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:30.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2814a530 con 0x7f2c28064940 2020-05-18T21:32:30.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2759e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2814ac20 con 0x7f2c2805f110 2020-05-18T21:32:30.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c28144130 con 0x7f2c28152890 2020-05-18T21:32:30.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2c2805f110 0x7f2c28146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:30.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2c2805f110 0x7f2c28146ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59064/0 (socket says 172.21.15.63:59064) 2020-05-18T21:32:30.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c25d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2c28064940 0x7f2c2813fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33022/0 (socket says 172.21.15.63:33022) 2020-05-18T21:32:30.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2659c700 1 -- 172.21.15.63:0/1732689095 learned_addr learned my addr 172.21.15.63:0/1732689095 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:30.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c26d9d700 1 --2- 172.21.15.63:0/1732689095 >> v2:172.21.15.155:3300/0 conn(0x7f2c28152890 0x7f2c28143250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:30.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2659c700 1 -- 172.21.15.63:0/1732689095 >> v2:172.21.15.155:3300/0 conn(0x7f2c28152890 msgr2=0x7f2c28143250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:30.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2659c700 1 --2- 172.21.15.63:0/1732689095 >> v2:172.21.15.155:3300/0 conn(0x7f2c28152890 0x7f2c28143250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:30.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c1f7fe700 1 -- 172.21.15.63:0/1732689095 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873627679 0 0) 0x7f2c2814a530 con 0x7f2c28064940 2020-05-18T21:32:30.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2659c700 1 -- 172.21.15.63:0/1732689095 >> v1:172.21.15.63:6789/0 conn(0x7f2c28064940 legacy=0x7f2c2813fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:30.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2659c700 1 -- 172.21.15.63:0/1732689095 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c281436b0 con 0x7f2c2805f110 2020-05-18T21:32:30.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2659c700 1 --2- 172.21.15.63:0/1732689095 >> v2:172.21.15.63:3300/0 conn(0x7f2c2805f110 0x7f2c28146ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2c100011d0 tx=0x7f2c100024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:30.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2659c700 1 --2- 172.21.15.63:0/1732689095 >> v2:172.21.15.63:3300/0 conn(0x7f2c2805f110 0x7f2c28146ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2c100011d0 tx=0x7f2c100024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:30.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2659c700 1 --2- 172.21.15.63:0/1732689095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c2805f110 0x7f2c28146ec0 secure :-1 s=READY pgs=1180 cs=0 l=1 rx=0x7f2c100011d0 tx=0x7f2c100024d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:30.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2659c700 1 --2- 172.21.15.63:0/1732689095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c2805f110 0x7f2c28146ec0 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f2c100011d0 tx=0x7f2c100024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:30.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c1f7fe700 1 -- 172.21.15.63:0/1732689095 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c1000c960 con 0x7f2c2805f110 2020-05-18T21:32:30.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2659c700 1 --2- 172.21.15.63:0/1732689095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c2805f110 0x7f2c28146ec0 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f2c100011d0 tx=0x7f2c100024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:30.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2659c700 1 --2- 172.21.15.63:0/1732689095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c2805f110 0x7f2c28146ec0 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f2c100011d0 tx=0x7f2c100024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:30.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c1f7fe700 1 -- 172.21.15.63:0/1732689095 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1000cb00 con 0x7f2c2805f110 2020-05-18T21:32:30.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c2759e700 1 -- 172.21.15.63:0/1732689095 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c28140530 con 0x7f2c2805f110 2020-05-18T21:32:30.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.321+0000 7f2c1f7fe700 1 -- 172.21.15.63:0/1732689095 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c10012440 con 0x7f2c2805f110 2020-05-18T21:32:30.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.325+0000 7f2c2759e700 1 -- 172.21.15.63:0/1732689095 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c281409e0 con 0x7f2c2805f110 2020-05-18T21:32:30.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.325+0000 7f2c2659c700 1 --2- 172.21.15.63:0/1732689095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c2805f110 0x7f2c28146ec0 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f2c100011d0 tx=0x7f2c100024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:30.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.325+0000 7f2c2759e700 1 -- 172.21.15.63:0/1732689095 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c280569e0 con 0x7f2c2805f110 2020-05-18T21:32:30.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.325+0000 7f2c1f7fe700 1 -- 172.21.15.63:0/1732689095 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2c100126b0 con 0x7f2c2805f110 2020-05-18T21:32:30.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.325+0000 7f2c2659c700 1 --2- 172.21.15.63:0/1732689095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c2805f110 0x7f2c28146ec0 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f2c100011d0 tx=0x7f2c100024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:30.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.325+0000 7f2c1f7fe700 1 --2- 172.21.15.63:0/1732689095 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2c0c04f8e0 0x7f2c0c051da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:30.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.325+0000 7f2c1f7fe700 1 -- 172.21.15.63:0/1732689095 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f2c10063600 con 0x7f2c2805f110 2020-05-18T21:32:30.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.325+0000 7f2c25d9b700 1 --2- 172.21.15.63:0/1732689095 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2c0c04f8e0 0x7f2c0c051da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:30.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.325+0000 7f2c25d9b700 1 --2- 172.21.15.63:0/1732689095 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2c0c04f8e0 0x7f2c0c051da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2c180010d0 tx=0x7f2c180016f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:30.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.325+0000 7f2c25d9b700 1 --2- 172.21.15.63:0/1732689095 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2c0c04f8e0 0x7f2c0c051da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2c180010d0 tx=0x7f2c180016f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:30.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.325+0000 7f2c25d9b700 1 --2- 172.21.15.63:0/1732689095 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2c0c04f8e0 0x7f2c0c051da0 secure :-1 s=READY pgs=466 cs=0 l=1 rx=0x7f2c180010d0 tx=0x7f2c180016f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:30.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.333+0000 7f2c2659c700 1 --2- 172.21.15.63:0/1732689095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c2805f110 0x7f2c28146ec0 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f2c100011d0 tx=0x7f2c100024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:30.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.333+0000 7f2c1f7fe700 1 -- 172.21.15.63:0/1732689095 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2c1003d990 con 0x7f2c2805f110 2020-05-18T21:32:30.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.481+0000 7f2c2759e700 1 -- 172.21.15.63:0/1732689095 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c2806aab0 con 0x7f2c2805f110 2020-05-18T21:32:30.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.481+0000 7f2c2659c700 1 --2- 172.21.15.63:0/1732689095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c2805f110 0x7f2c28146ec0 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f2c100011d0 tx=0x7f2c100024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:30.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.481+0000 7f2c1f7fe700 1 -- 172.21.15.63:0/1732689095 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2159 (secure 0 0 0) 0x7f2c10040fb0 con 0x7f2c2805f110 2020-05-18T21:32:30.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.481+0000 7f2c2759e700 1 -- 172.21.15.63:0/1732689095 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2c0c04f8e0 msgr2=0x7f2c0c051da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:30.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.481+0000 7f2c2759e700 1 --2- 172.21.15.63:0/1732689095 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2c0c04f8e0 0x7f2c0c051da0 secure :-1 s=READY pgs=466 cs=0 l=1 rx=0x7f2c180010d0 tx=0x7f2c180016f0).stop 2020-05-18T21:32:30.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.481+0000 7f2c2759e700 1 -- 172.21.15.63:0/1732689095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c2805f110 msgr2=0x7f2c28146ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:30.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.481+0000 7f2c2759e700 1 --2- 172.21.15.63:0/1732689095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c2805f110 0x7f2c28146ec0 secure :-1 s=READY pgs=1180 cs=0 l=1 rx=0x7f2c100011d0 tx=0x7f2c100024d0).stop 2020-05-18T21:32:30.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.481+0000 7f2c2759e700 1 -- 172.21.15.63:0/1732689095 shutdown_connections 2020-05-18T21:32:30.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.481+0000 7f2c2759e700 1 --2- 172.21.15.63:0/1732689095 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2c0c04f8e0 0x7f2c0c051da0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:30.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.481+0000 7f2c2759e700 1 --2- 172.21.15.63:0/1732689095 >> v2:172.21.15.155:3300/0 conn(0x7f2c28152890 0x7f2c28143250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:30.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.481+0000 7f2c2759e700 1 --2- 172.21.15.63:0/1732689095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c2805f110 0x7f2c28146ec0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:30.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.481+0000 7f2c2759e700 1 -- 172.21.15.63:0/1732689095 >> 172.21.15.63:0/1732689095 conn(0x7f2c28069fc0 msgr2=0x7f2c280b81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:30.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.481+0000 7f2c2759e700 1 -- 172.21.15.63:0/1732689095 shutdown_connections 2020-05-18T21:32:30.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:30.481+0000 7f2c2759e700 1 -- 172.21.15.63:0/1732689095 wait complete. 2020-05-18T21:32:30.494 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 67 2020-05-18T21:32:30.494 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:30.495 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":67,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:20.666310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:stopping","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:30.700 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:20.666310+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:stopping', 'state_seq': 6, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:30.700 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5756:up:stopping 2020-05-18T21:32:31.701 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:31.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.805+0000 7fb207add700 1 Processor -- start 2020-05-18T21:32:31.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.805+0000 7fb207add700 1 -- start start 2020-05-18T21:32:31.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb207add700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2000b5bf0 0x7fb20013ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:31.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb207add700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb200063060 con 0x7fb2001467a0 2020-05-18T21:32:31.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb207add700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2000632d0 con 0x7fb200140380 2020-05-18T21:32:31.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb207add700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb200147290 con 0x7fb2000b5bf0 2020-05-18T21:32:31.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb205879700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb2001467a0 0x7fb200146b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33028/0 (socket says 172.21.15.63:33028) 2020-05-18T21:32:31.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb205879700 1 -- 172.21.15.63:0/2730957075 learned_addr learned my addr 172.21.15.63:0/2730957075 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:31.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb205078700 1 --2- 172.21.15.63:0/2730957075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2000b5bf0 0x7fb20013ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:31.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb204877700 1 -- 172.21.15.63:0/2730957075 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140902697 0 0) 0x7fb200063060 con 0x7fb2001467a0 2020-05-18T21:32:31.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb204877700 1 -- 172.21.15.63:0/2730957075 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1e8003270 con 0x7fb2001467a0 2020-05-18T21:32:31.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb204877700 1 -- 172.21.15.63:0/2730957075 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 741384002 0 0) 0x7fb2000632d0 con 0x7fb200140380 2020-05-18T21:32:31.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb204877700 1 -- 172.21.15.63:0/2730957075 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb200063060 con 0x7fb200140380 2020-05-18T21:32:31.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb204877700 1 -- 172.21.15.63:0/2730957075 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1742808280 0 0) 0x7fb1e8003270 con 0x7fb2001467a0 2020-05-18T21:32:31.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb205078700 1 -- 172.21.15.63:0/2730957075 >> v1:172.21.15.155:6789/0 conn(0x7fb200140380 legacy=0x7fb20005a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:31.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb205078700 1 -- 172.21.15.63:0/2730957075 >> v1:172.21.15.63:6789/0 conn(0x7fb2001467a0 legacy=0x7fb200146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:31.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb205078700 1 -- 172.21.15.63:0/2730957075 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb200063570 con 0x7fb2000b5bf0 2020-05-18T21:32:31.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb205078700 1 --2- 172.21.15.63:0/2730957075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2000b5bf0 0x7fb20013ff20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb1fc001110 tx=0x7fb1f0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:31.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb205078700 1 --2- 172.21.15.63:0/2730957075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2000b5bf0 0x7fb20013ff20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb1fc001110 tx=0x7fb1f0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:31.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb205078700 1 --2- 172.21.15.63:0/2730957075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2000b5bf0 0x7fb20013ff20 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7fb1fc001110 tx=0x7fb1f0008920).ready entity=mon.2 client_cookie=ecbd1a1033037d98 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:31.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb205078700 1 --2- 172.21.15.63:0/2730957075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2000b5bf0 0x7fb20013ff20 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7fb1fc001110 tx=0x7fb1f0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:31.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb205078700 1 --2- 172.21.15.63:0/2730957075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2000b5bf0 0x7fb20013ff20 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7fb1fc001110 tx=0x7fb1f0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:31.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb204877700 1 -- 172.21.15.63:0/2730957075 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1fc001710 con 0x7fb2000b5bf0 2020-05-18T21:32:31.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb205078700 1 --2- 172.21.15.63:0/2730957075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2000b5bf0 0x7fb20013ff20 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7fb1fc001110 tx=0x7fb1f0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:31.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb204877700 1 -- 172.21.15.63:0/2730957075 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f0008e80 con 0x7fb2000b5bf0 2020-05-18T21:32:31.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb204877700 1 -- 172.21.15.63:0/2730957075 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1f0011440 con 0x7fb2000b5bf0 2020-05-18T21:32:31.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb207add700 1 -- 172.21.15.63:0/2730957075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2000b5bf0 msgr2=0x7fb20013ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:31.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.809+0000 7fb207add700 1 --2- 172.21.15.63:0/2730957075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2000b5bf0 0x7fb20013ff20 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7fb1fc001110 tx=0x7fb1f0008920).stop 2020-05-18T21:32:31.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb207add700 1 -- 172.21.15.63:0/2730957075 shutdown_connections 2020-05-18T21:32:31.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb207add700 1 --2- 172.21.15.63:0/2730957075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2000b5bf0 0x7fb20013ff20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:31.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb207add700 1 -- 172.21.15.63:0/2730957075 >> 172.21.15.63:0/2730957075 conn(0x7fb2000b9700 msgr2=0x7fb2000b9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:31.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb207add700 1 -- 172.21.15.63:0/2730957075 shutdown_connections 2020-05-18T21:32:31.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb207add700 1 -- 172.21.15.63:0/2730957075 wait complete. 2020-05-18T21:32:31.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb207add700 1 Processor -- start 2020-05-18T21:32:31.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb207add700 1 -- start start 2020-05-18T21:32:31.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb207add700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb2000b5bf0 0x7fb2000b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:31.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb207add700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb200140380 0x7fb20013aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:31.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb207add700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb200152630 con 0x7fb2001467a0 2020-05-18T21:32:31.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb207add700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20013b100 con 0x7fb2000b5bf0 2020-05-18T21:32:31.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb207add700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb200141820 con 0x7fb200140380 2020-05-18T21:32:31.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb205879700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb2000b5bf0 0x7fb2000b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:31.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb20607a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb2001467a0 0x7fb200151700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33038/0 (socket says 172.21.15.63:33038) 2020-05-18T21:32:31.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb205879700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb2000b5bf0 0x7fb2000b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59078/0 (socket says 172.21.15.63:59078) 2020-05-18T21:32:31.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb20607a700 1 -- 172.21.15.63:0/2720739961 learned_addr learned my addr 172.21.15.63:0/2720739961 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:31.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb205078700 1 --2- 172.21.15.63:0/2720739961 >> v2:172.21.15.155:3300/0 conn(0x7fb200140380 0x7fb20013aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:31.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb205879700 1 -- 172.21.15.63:0/2720739961 >> v2:172.21.15.155:3300/0 conn(0x7fb200140380 msgr2=0x7fb20013aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:31.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb205879700 1 --2- 172.21.15.63:0/2720739961 >> v2:172.21.15.155:3300/0 conn(0x7fb200140380 0x7fb20013aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:31.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb1eeffd700 1 -- 172.21.15.63:0/2720739961 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154486347 0 0) 0x7fb200152630 con 0x7fb2001467a0 2020-05-18T21:32:31.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb205879700 1 -- 172.21.15.63:0/2720739961 >> v1:172.21.15.63:6789/0 conn(0x7fb2001467a0 legacy=0x7fb200151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:31.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.813+0000 7fb205879700 1 -- 172.21.15.63:0/2720739961 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb200152390 con 0x7fb2000b5bf0 2020-05-18T21:32:31.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.817+0000 7fb205879700 1 --2- 172.21.15.63:0/2720739961 >> v2:172.21.15.63:3300/0 conn(0x7fb2000b5bf0 0x7fb2000b4b90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb1fc000fe0 tx=0x7fb1fc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:31.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.817+0000 7fb205879700 1 --2- 172.21.15.63:0/2720739961 >> v2:172.21.15.63:3300/0 conn(0x7fb2000b5bf0 0x7fb2000b4b90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb1fc000fe0 tx=0x7fb1fc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:31.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.817+0000 7fb205879700 1 --2- 172.21.15.63:0/2720739961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2000b5bf0 0x7fb2000b4b90 secure :-1 s=READY pgs=1183 cs=0 l=1 rx=0x7fb1fc000fe0 tx=0x7fb1fc010cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:31.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.817+0000 7fb205879700 1 --2- 172.21.15.63:0/2720739961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2000b5bf0 0x7fb2000b4b90 secure :-1 s=THROTTLE_DONE pgs=1183 cs=0 l=1 rx=0x7fb1fc000fe0 tx=0x7fb1fc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:31.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.817+0000 7fb1eeffd700 1 -- 172.21.15.63:0/2720739961 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1fc0129f0 con 0x7fb2000b5bf0 2020-05-18T21:32:31.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.817+0000 7fb205879700 1 --2- 172.21.15.63:0/2720739961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2000b5bf0 0x7fb2000b4b90 secure :-1 s=THROTTLE_DONE pgs=1183 cs=0 l=1 rx=0x7fb1fc000fe0 tx=0x7fb1fc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:31.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.817+0000 7fb205879700 1 --2- 172.21.15.63:0/2720739961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2000b5bf0 0x7fb2000b4b90 secure :-1 s=THROTTLE_DONE pgs=1183 cs=0 l=1 rx=0x7fb1fc000fe0 tx=0x7fb1fc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:31.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.817+0000 7fb1eeffd700 1 -- 172.21.15.63:0/2720739961 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1fc012b50 con 0x7fb2000b5bf0 2020-05-18T21:32:31.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.817+0000 7fb207add700 1 -- 172.21.15.63:0/2720739961 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2000aefa0 con 0x7fb2000b5bf0 2020-05-18T21:32:31.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.817+0000 7fb1eeffd700 1 -- 172.21.15.63:0/2720739961 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1fc00c5b0 con 0x7fb2000b5bf0 2020-05-18T21:32:31.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.817+0000 7fb207add700 1 -- 172.21.15.63:0/2720739961 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2000b50e0 con 0x7fb2000b5bf0 2020-05-18T21:32:31.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.817+0000 7fb205879700 1 --2- 172.21.15.63:0/2720739961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2000b5bf0 0x7fb2000b4b90 secure :-1 s=THROTTLE_DONE pgs=1183 cs=0 l=1 rx=0x7fb1fc000fe0 tx=0x7fb1fc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:31.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.817+0000 7fb207add700 1 -- 172.21.15.63:0/2720739961 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2000569e0 con 0x7fb2000b5bf0 2020-05-18T21:32:31.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.817+0000 7fb1eeffd700 1 -- 172.21.15.63:0/2720739961 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb1fc00c820 con 0x7fb2000b5bf0 2020-05-18T21:32:31.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.817+0000 7fb205879700 1 --2- 172.21.15.63:0/2720739961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2000b5bf0 0x7fb2000b4b90 secure :-1 s=THROTTLE_DONE pgs=1183 cs=0 l=1 rx=0x7fb1fc000fe0 tx=0x7fb1fc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:31.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.817+0000 7fb1eeffd700 1 --2- 172.21.15.63:0/2720739961 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb1e004f8b0 0x7fb1e0051d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:31.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.817+0000 7fb1eeffd700 1 -- 172.21.15.63:0/2720739961 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fb1fc063d90 con 0x7fb2000b5bf0 2020-05-18T21:32:31.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.821+0000 7fb205078700 1 --2- 172.21.15.63:0/2720739961 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb1e004f8b0 0x7fb1e0051d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:31.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.821+0000 7fb205078700 1 --2- 172.21.15.63:0/2720739961 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb1e004f8b0 0x7fb1e0051d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb1fc001110 tx=0x7fb200143e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:31.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.821+0000 7fb205078700 1 --2- 172.21.15.63:0/2720739961 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb1e004f8b0 0x7fb1e0051d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb1fc001110 tx=0x7fb200143e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:31.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.821+0000 7fb205078700 1 --2- 172.21.15.63:0/2720739961 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb1e004f8b0 0x7fb1e0051d70 secure :-1 s=READY pgs=467 cs=0 l=1 rx=0x7fb1fc001110 tx=0x7fb200143e40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:31.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.825+0000 7fb205879700 1 --2- 172.21.15.63:0/2720739961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2000b5bf0 0x7fb2000b4b90 secure :-1 s=THROTTLE_DONE pgs=1183 cs=0 l=1 rx=0x7fb1fc000fe0 tx=0x7fb1fc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:31.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.825+0000 7fb1eeffd700 1 -- 172.21.15.63:0/2720739961 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb1fc03e0c0 con 0x7fb2000b5bf0 2020-05-18T21:32:31.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.973+0000 7fb207add700 1 -- 172.21.15.63:0/2720739961 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb200063da0 con 0x7fb2000b5bf0 2020-05-18T21:32:31.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.973+0000 7fb205879700 1 --2- 172.21.15.63:0/2720739961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2000b5bf0 0x7fb2000b4b90 secure :-1 s=THROTTLE_DONE pgs=1183 cs=0 l=1 rx=0x7fb1fc000fe0 tx=0x7fb1fc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:31.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.973+0000 7fb1eeffd700 1 -- 172.21.15.63:0/2720739961 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2159 (secure 0 0 0) 0x7fb1fc0416e0 con 0x7fb2000b5bf0 2020-05-18T21:32:31.979 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:31.979 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":67,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:20.666310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:stopping","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:31.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.977+0000 7fb207add700 1 -- 172.21.15.63:0/2720739961 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb1e004f8b0 msgr2=0x7fb1e0051d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:31.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.977+0000 7fb207add700 1 --2- 172.21.15.63:0/2720739961 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb1e004f8b0 0x7fb1e0051d70 secure :-1 s=READY pgs=467 cs=0 l=1 rx=0x7fb1fc001110 tx=0x7fb200143e40).stop 2020-05-18T21:32:31.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.977+0000 7fb207add700 1 -- 172.21.15.63:0/2720739961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2000b5bf0 msgr2=0x7fb2000b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:31.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.977+0000 7fb207add700 1 --2- 172.21.15.63:0/2720739961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2000b5bf0 0x7fb2000b4b90 secure :-1 s=READY pgs=1183 cs=0 l=1 rx=0x7fb1fc000fe0 tx=0x7fb1fc010cb0).stop 2020-05-18T21:32:31.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.977+0000 7fb207add700 1 -- 172.21.15.63:0/2720739961 shutdown_connections 2020-05-18T21:32:31.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.977+0000 7fb207add700 1 --2- 172.21.15.63:0/2720739961 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb1e004f8b0 0x7fb1e0051d70 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:31.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.977+0000 7fb207add700 1 --2- 172.21.15.63:0/2720739961 >> v2:172.21.15.155:3300/0 conn(0x7fb200140380 0x7fb20013aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:31.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.977+0000 7fb207add700 1 --2- 172.21.15.63:0/2720739961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2000b5bf0 0x7fb2000b4b90 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:31.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.977+0000 7fb207add700 1 -- 172.21.15.63:0/2720739961 >> 172.21.15.63:0/2720739961 conn(0x7fb2000b9700 msgr2=0x7fb200061d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:31.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.977+0000 7fb207add700 1 -- 172.21.15.63:0/2720739961 shutdown_connections 2020-05-18T21:32:31.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:31.977+0000 7fb207add700 1 -- 172.21.15.63:0/2720739961 wait complete. 2020-05-18T21:32:31.982 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 67 2020-05-18T21:32:32.194 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:20.666310+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:stopping', 'state_seq': 6, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:32.195 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5756:up:stopping 2020-05-18T21:32:33.195 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:33.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.305+0000 7f1087fff700 1 Processor -- start 2020-05-18T21:32:33.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.305+0000 7f1087fff700 1 -- start start 2020-05-18T21:32:33.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.305+0000 7f1087fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f108805f110 0x7f10880b2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:33.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.305+0000 7f1087fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10880b81b0 0x7f108812ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:33.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.305+0000 7f1087fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1088146d60 con 0x7f108812bec0 2020-05-18T21:32:33.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.305+0000 7f1087fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10880b8650 con 0x7f108805f110 2020-05-18T21:32:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.305+0000 7f1087fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10880b88f0 con 0x7f10880b81b0 2020-05-18T21:32:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.305+0000 7f10877fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f108812bec0 0x7f1088149320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33046/0 (socket says 172.21.15.63:33046) 2020-05-18T21:32:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.305+0000 7f10877fe700 1 -- 172.21.15.63:0/3400966792 learned_addr learned my addr 172.21.15.63:0/3400966792 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.305+0000 7f1086ffd700 1 --2- 172.21.15.63:0/3400966792 >> v2:172.21.15.63:3300/0 conn(0x7f108805f110 0x7f10880b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.305+0000 7f10867fc700 1 --2- 172.21.15.63:0/3400966792 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10880b81b0 0x7f108812ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:33.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f1085ffb700 1 -- 172.21.15.63:0/3400966792 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991116737 0 0) 0x7f1080001490 con 0x7f108812bec0 2020-05-18T21:32:33.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f1085ffb700 1 -- 172.21.15.63:0/3400966792 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1068003270 con 0x7f108812bec0 2020-05-18T21:32:33.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f1085ffb700 1 -- 172.21.15.63:0/3400966792 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3010500276 0 0) 0x7f1068003270 con 0x7f108812bec0 2020-05-18T21:32:33.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f10867fc700 1 -- 172.21.15.63:0/3400966792 >> v2:172.21.15.63:3300/0 conn(0x7f108805f110 msgr2=0x7f10880b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:33.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f10867fc700 1 --2- 172.21.15.63:0/3400966792 >> v2:172.21.15.63:3300/0 conn(0x7f108805f110 0x7f10880b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:33.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f10867fc700 1 -- 172.21.15.63:0/3400966792 >> v1:172.21.15.63:6789/0 conn(0x7f108812bec0 legacy=0x7f1088149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:33.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f10867fc700 1 -- 172.21.15.63:0/3400966792 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10880b8b90 con 0x7f10880b81b0 2020-05-18T21:32:33.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f1086ffd700 1 --2- 172.21.15.63:0/3400966792 >> v2:172.21.15.63:3300/0 conn(0x7f108805f110 0x7f10880b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:33.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f10867fc700 1 --2- 172.21.15.63:0/3400966792 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10880b81b0 0x7f108812ba60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1080001dc0 tx=0x7f1078007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:33.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f10867fc700 1 --2- 172.21.15.63:0/3400966792 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10880b81b0 0x7f108812ba60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1080001dc0 tx=0x7f1078007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:33.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f10867fc700 1 --2- 172.21.15.63:0/3400966792 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10880b81b0 0x7f108812ba60 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f1080001dc0 tx=0x7f1078007a80).ready entity=mon.2 client_cookie=8ee42b301012b8e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:33.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f10867fc700 1 --2- 172.21.15.63:0/3400966792 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10880b81b0 0x7f108812ba60 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f1080001dc0 tx=0x7f1078007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:33.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f1085ffb700 1 -- 172.21.15.63:0/3400966792 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1080001c20 con 0x7f10880b81b0 2020-05-18T21:32:33.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f10867fc700 1 --2- 172.21.15.63:0/3400966792 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10880b81b0 0x7f108812ba60 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f1080001dc0 tx=0x7f1078007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:33.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f1085ffb700 1 -- 172.21.15.63:0/3400966792 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1078011250 con 0x7f10880b81b0 2020-05-18T21:32:33.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f10867fc700 1 --2- 172.21.15.63:0/3400966792 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10880b81b0 0x7f108812ba60 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f1080001dc0 tx=0x7f1078007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:33.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f1085ffb700 1 -- 172.21.15.63:0/3400966792 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10780115b0 con 0x7f10880b81b0 2020-05-18T21:32:33.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f1087fff700 1 -- 172.21.15.63:0/3400966792 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10880b81b0 msgr2=0x7f108812ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:33.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f1087fff700 1 --2- 172.21.15.63:0/3400966792 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10880b81b0 0x7f108812ba60 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f1080001dc0 tx=0x7f1078007a80).stop 2020-05-18T21:32:33.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f1087fff700 1 -- 172.21.15.63:0/3400966792 shutdown_connections 2020-05-18T21:32:33.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f1087fff700 1 --2- 172.21.15.63:0/3400966792 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10880b81b0 0x7f108812ba60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:33.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f1087fff700 1 --2- 172.21.15.63:0/3400966792 >> v2:172.21.15.63:3300/0 conn(0x7f108805f110 0x7f10880b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:33.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f1087fff700 1 -- 172.21.15.63:0/3400966792 >> 172.21.15.63:0/3400966792 conn(0x7f1088069fc0 msgr2=0x7f108806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:33.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f1087fff700 1 -- 172.21.15.63:0/3400966792 shutdown_connections 2020-05-18T21:32:33.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.309+0000 7f1087fff700 1 -- 172.21.15.63:0/3400966792 wait complete. 2020-05-18T21:32:33.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.313+0000 7f1087fff700 1 Processor -- start 2020-05-18T21:32:33.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.313+0000 7f1087fff700 1 -- start start 2020-05-18T21:32:33.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.313+0000 7f1087fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108805f110 0x7f10881496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.313+0000 7f1087fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f108812bec0 0x7f1088147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.313+0000 7f1087fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10881476a0 con 0x7f10880b81b0 2020-05-18T21:32:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.313+0000 7f1087fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1088156650 con 0x7f108812bec0 2020-05-18T21:32:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.313+0000 7f1087fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10881569b0 con 0x7f108805f110 2020-05-18T21:32:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.313+0000 7f10877fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f108812bec0 0x7f1088147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.313+0000 7f10867fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f10880b81b0 0x7f10881570f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33050/0 (socket says 172.21.15.63:33050) 2020-05-18T21:32:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.313+0000 7f10867fc700 1 -- 172.21.15.63:0/2384000251 learned_addr learned my addr 172.21.15.63:0/2384000251 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.313+0000 7f1086ffd700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108805f110 0x7f10881496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.313+0000 7f10877fe700 1 -- 172.21.15.63:0/2384000251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108805f110 msgr2=0x7f10881496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.313+0000 7f10877fe700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108805f110 0x7f10881496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.313+0000 7f10877fe700 1 -- 172.21.15.63:0/2384000251 >> v1:172.21.15.63:6789/0 conn(0x7f10880b81b0 legacy=0x7f10881570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.313+0000 7f10877fe700 1 -- 172.21.15.63:0/2384000251 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1088156c50 con 0x7f108812bec0 2020-05-18T21:32:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.313+0000 7f107ffff700 1 -- 172.21.15.63:0/2384000251 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576663615 0 0) 0x7f10881476a0 con 0x7f10880b81b0 2020-05-18T21:32:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.313+0000 7f10877fe700 1 --2- 172.21.15.63:0/2384000251 >> v2:172.21.15.63:3300/0 conn(0x7f108812bec0 0x7f1088147240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1080001e80 tx=0x7f1080010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.317+0000 7f10877fe700 1 --2- 172.21.15.63:0/2384000251 >> v2:172.21.15.63:3300/0 conn(0x7f108812bec0 0x7f1088147240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1080001e80 tx=0x7f1080010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.317+0000 7f10877fe700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108812bec0 0x7f1088147240 secure :-1 s=READY pgs=1186 cs=0 l=1 rx=0x7f1080001e80 tx=0x7f1080010f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.317+0000 7f10877fe700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108812bec0 0x7f1088147240 secure :-1 s=THROTTLE_DONE pgs=1186 cs=0 l=1 rx=0x7f1080001e80 tx=0x7f1080010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.317+0000 7f107ffff700 1 -- 172.21.15.63:0/2384000251 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f108000cce0 con 0x7f108812bec0 2020-05-18T21:32:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.317+0000 7f10877fe700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108812bec0 0x7f1088147240 secure :-1 s=THROTTLE_DONE pgs=1186 cs=0 l=1 rx=0x7f1080001e80 tx=0x7f1080010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.317+0000 7f10877fe700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108812bec0 0x7f1088147240 secure :-1 s=THROTTLE_DONE pgs=1186 cs=0 l=1 rx=0x7f1080001e80 tx=0x7f1080010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.317+0000 7f107ffff700 1 -- 172.21.15.63:0/2384000251 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108000ce40 con 0x7f108812bec0 2020-05-18T21:32:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.317+0000 7f107ffff700 1 -- 172.21.15.63:0/2384000251 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1080012af0 con 0x7f108812bec0 2020-05-18T21:32:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.317+0000 7f1087fff700 1 -- 172.21.15.63:0/2384000251 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1088157800 con 0x7f108812bec0 2020-05-18T21:32:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.317+0000 7f1087fff700 1 -- 172.21.15.63:0/2384000251 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1088063080 con 0x7f108812bec0 2020-05-18T21:32:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.317+0000 7f10877fe700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108812bec0 0x7f1088147240 secure :-1 s=THROTTLE_DONE pgs=1186 cs=0 l=1 rx=0x7f1080001e80 tx=0x7f1080010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.317+0000 7f1087fff700 1 -- 172.21.15.63:0/2384000251 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10881564b0 con 0x7f108812bec0 2020-05-18T21:32:33.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.317+0000 7f107ffff700 1 -- 172.21.15.63:0/2384000251 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1080012d30 con 0x7f108812bec0 2020-05-18T21:32:33.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.317+0000 7f10877fe700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108812bec0 0x7f1088147240 secure :-1 s=THROTTLE_DONE pgs=1186 cs=0 l=1 rx=0x7f1080001e80 tx=0x7f1080010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:33.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.317+0000 7f107ffff700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f106c04f8a0 0x7f106c051d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:33.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.317+0000 7f107ffff700 1 -- 172.21.15.63:0/2384000251 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f1080063b70 con 0x7f108812bec0 2020-05-18T21:32:33.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.317+0000 7f1086ffd700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f106c04f8a0 0x7f106c051d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:33.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.321+0000 7f1086ffd700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f106c04f8a0 0x7f106c051d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1070002f70 tx=0x7f107000ebe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:33.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.321+0000 7f1086ffd700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f106c04f8a0 0x7f106c051d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1070002f70 tx=0x7f107000ebe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:33.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.321+0000 7f1086ffd700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f106c04f8a0 0x7f106c051d60 secure :-1 s=READY pgs=468 cs=0 l=1 rx=0x7f1070002f70 tx=0x7f107000ebe0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:33.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.325+0000 7f10877fe700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108812bec0 0x7f1088147240 secure :-1 s=THROTTLE_DONE pgs=1186 cs=0 l=1 rx=0x7f1080001e80 tx=0x7f1080010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:33.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.325+0000 7f107ffff700 1 -- 172.21.15.63:0/2384000251 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f10881564b0 con 0x7f108812bec0 2020-05-18T21:32:33.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.473+0000 7f1087fff700 1 -- 172.21.15.63:0/2384000251 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10881564b0 con 0x7f108812bec0 2020-05-18T21:32:33.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.473+0000 7f10877fe700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108812bec0 0x7f1088147240 secure :-1 s=THROTTLE_DONE pgs=1186 cs=0 l=1 rx=0x7f1080001e80 tx=0x7f1080010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:33.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.473+0000 7f107ffff700 1 -- 172.21.15.63:0/2384000251 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2159 (secure 0 0 0) 0x7f10881564b0 con 0x7f108812bec0 2020-05-18T21:32:33.478 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:33.479 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":67,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:20.666310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:stopping","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:33.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.473+0000 7f1087fff700 1 -- 172.21.15.63:0/2384000251 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f106c04f8a0 msgr2=0x7f106c051d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:33.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.473+0000 7f1087fff700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f106c04f8a0 0x7f106c051d60 secure :-1 s=READY pgs=468 cs=0 l=1 rx=0x7f1070002f70 tx=0x7f107000ebe0).stop 2020-05-18T21:32:33.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.473+0000 7f1087fff700 1 -- 172.21.15.63:0/2384000251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108812bec0 msgr2=0x7f1088147240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:33.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.473+0000 7f1087fff700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108812bec0 0x7f1088147240 secure :-1 s=READY pgs=1186 cs=0 l=1 rx=0x7f1080001e80 tx=0x7f1080010f60).stop 2020-05-18T21:32:33.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.477+0000 7f1087fff700 1 -- 172.21.15.63:0/2384000251 shutdown_connections 2020-05-18T21:32:33.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.477+0000 7f1087fff700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f106c04f8a0 0x7f106c051d60 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:33.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.477+0000 7f1087fff700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f108812bec0 0x7f1088147240 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:33.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.477+0000 7f1087fff700 1 --2- 172.21.15.63:0/2384000251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108805f110 0x7f10881496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:33.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.477+0000 7f1087fff700 1 -- 172.21.15.63:0/2384000251 >> 172.21.15.63:0/2384000251 conn(0x7f1088069fc0 msgr2=0x7f1088060f50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:33.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.477+0000 7f1087fff700 1 -- 172.21.15.63:0/2384000251 shutdown_connections 2020-05-18T21:32:33.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:33.477+0000 7f1087fff700 1 -- 172.21.15.63:0/2384000251 wait complete. 2020-05-18T21:32:33.482 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 67 2020-05-18T21:32:33.692 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:20.666310+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:stopping', 'state_seq': 6, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:33.692 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5756:up:stopping 2020-05-18T21:32:34.694 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:34.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.793+0000 7fa4e0154700 1 Processor -- start 2020-05-18T21:32:34.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.793+0000 7fa4e0154700 1 -- start start 2020-05-18T21:32:34.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4e0154700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa4d8060b90 0x7fa4d8147e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:34.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4e0154700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa4d8143da0 0x7fa4d81299d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:34.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4e0154700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d8144240 con 0x7fa4d8129e30 2020-05-18T21:32:34.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4e0154700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d81444e0 con 0x7fa4d8060b90 2020-05-18T21:32:34.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4e0154700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d8144780 con 0x7fa4d8143da0 2020-05-18T21:32:34.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4ddef0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa4d8060b90 0x7fa4d8147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:34.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4ddef0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa4d8060b90 0x7fa4d8147e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59100/0 (socket says 172.21.15.63:59100) 2020-05-18T21:32:34.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4ddef0700 1 -- 172.21.15.63:0/1974081821 learned_addr learned my addr 172.21.15.63:0/1974081821 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:34.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4dd6ef700 1 --2- 172.21.15.63:0/1974081821 >> v2:172.21.15.155:3300/0 conn(0x7fa4d8143da0 0x7fa4d81299d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:34.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4ddef0700 1 -- 172.21.15.63:0/1974081821 >> v2:172.21.15.155:3300/0 conn(0x7fa4d8143da0 msgr2=0x7fa4d81299d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:34.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4ddef0700 1 --2- 172.21.15.63:0/1974081821 >> v2:172.21.15.155:3300/0 conn(0x7fa4d8143da0 0x7fa4d81299d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:34.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4ddef0700 1 -- 172.21.15.63:0/1974081821 >> v1:172.21.15.63:6789/0 conn(0x7fa4d8129e30 legacy=0x7fa4d80b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:34.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4ddef0700 1 -- 172.21.15.63:0/1974081821 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d8144c20 con 0x7fa4d8060b90 2020-05-18T21:32:34.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4dceee700 1 -- 172.21.15.63:0/1974081821 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400164239 0 0) 0x7fa4d8144240 con 0x7fa4d8129e30 2020-05-18T21:32:34.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4ddef0700 1 --2- 172.21.15.63:0/1974081821 >> v2:172.21.15.63:3300/0 conn(0x7fa4d8060b90 0x7fa4d8147e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa4d00032f0 tx=0x7fa4d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:34.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4ddef0700 1 --2- 172.21.15.63:0/1974081821 >> v2:172.21.15.63:3300/0 conn(0x7fa4d8060b90 0x7fa4d8147e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa4d00032f0 tx=0x7fa4d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:34.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4ddef0700 1 --2- 172.21.15.63:0/1974081821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4d8060b90 0x7fa4d8147e60 secure :-1 s=READY pgs=1188 cs=0 l=1 rx=0x7fa4d00032f0 tx=0x7fa4d0007e00).ready entity=mon.0 client_cookie=69d24f9d358a50e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:34.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4ddef0700 1 --2- 172.21.15.63:0/1974081821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4d8060b90 0x7fa4d8147e60 secure :-1 s=THROTTLE_DONE pgs=1188 cs=0 l=1 rx=0x7fa4d00032f0 tx=0x7fa4d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:34.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4dceee700 1 -- 172.21.15.63:0/1974081821 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d0011d10 con 0x7fa4d8060b90 2020-05-18T21:32:34.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4ddef0700 1 --2- 172.21.15.63:0/1974081821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4d8060b90 0x7fa4d8147e60 secure :-1 s=THROTTLE_DONE pgs=1188 cs=0 l=1 rx=0x7fa4d00032f0 tx=0x7fa4d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:34.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4ddef0700 1 --2- 172.21.15.63:0/1974081821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4d8060b90 0x7fa4d8147e60 secure :-1 s=THROTTLE_DONE pgs=1188 cs=0 l=1 rx=0x7fa4d00032f0 tx=0x7fa4d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:34.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4dceee700 1 -- 172.21.15.63:0/1974081821 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d0011e70 con 0x7fa4d8060b90 2020-05-18T21:32:34.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4e0154700 1 -- 172.21.15.63:0/1974081821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4d8060b90 msgr2=0x7fa4d8147e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:34.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4dceee700 1 -- 172.21.15.63:0/1974081821 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d000a370 con 0x7fa4d8060b90 2020-05-18T21:32:34.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4e0154700 1 --2- 172.21.15.63:0/1974081821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4d8060b90 0x7fa4d8147e60 secure :-1 s=READY pgs=1188 cs=0 l=1 rx=0x7fa4d00032f0 tx=0x7fa4d0007e00).stop 2020-05-18T21:32:34.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4e0154700 1 -- 172.21.15.63:0/1974081821 shutdown_connections 2020-05-18T21:32:34.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4e0154700 1 --2- 172.21.15.63:0/1974081821 >> v2:172.21.15.155:3300/0 conn(0x7fa4d8143da0 0x7fa4d81299d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:34.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4e0154700 1 --2- 172.21.15.63:0/1974081821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4d8060b90 0x7fa4d8147e60 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:34.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4e0154700 1 -- 172.21.15.63:0/1974081821 >> 172.21.15.63:0/1974081821 conn(0x7fa4d80b83d0 msgr2=0x7fa4d80b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:34.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4e0154700 1 -- 172.21.15.63:0/1974081821 shutdown_connections 2020-05-18T21:32:34.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.797+0000 7fa4e0154700 1 -- 172.21.15.63:0/1974081821 wait complete. 2020-05-18T21:32:34.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4e0154700 1 Processor -- start 2020-05-18T21:32:34.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4e0154700 1 -- start start 2020-05-18T21:32:34.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4e0154700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8143da0 0x7fa4d81434b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:34.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4e0154700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d812c9c0 con 0x7fa4d8060b90 2020-05-18T21:32:34.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4e0154700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d812cc60 con 0x7fa4d8129e30 2020-05-18T21:32:34.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4e0154700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d812cf00 con 0x7fa4d8143da0 2020-05-18T21:32:34.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4ddef0700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa4d8060b90 0x7fa4d8142da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33062/0 (socket says 172.21.15.63:33062) 2020-05-18T21:32:34.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4ddef0700 1 -- 172.21.15.63:0/1755757728 learned_addr learned my addr 172.21.15.63:0/1755757728 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:34.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4de6f1700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8143da0 0x7fa4d81434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:34.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4d6ffd700 1 -- 172.21.15.63:0/1755757728 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30108581 0 0) 0x7fa4d812c9c0 con 0x7fa4d8060b90 2020-05-18T21:32:34.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4d6ffd700 1 -- 172.21.15.63:0/1755757728 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4b8002fe0 con 0x7fa4d8060b90 2020-05-18T21:32:34.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4d6ffd700 1 -- 172.21.15.63:0/1755757728 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349703294 0 0) 0x7fa4d812cc60 con 0x7fa4d8129e30 2020-05-18T21:32:34.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4d6ffd700 1 -- 172.21.15.63:0/1755757728 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4d812c9c0 con 0x7fa4d8129e30 2020-05-18T21:32:34.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4d6ffd700 1 -- 172.21.15.63:0/1755757728 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 664600272 0 0) 0x7fa4b8002fe0 con 0x7fa4d8060b90 2020-05-18T21:32:34.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4de6f1700 1 -- 172.21.15.63:0/1755757728 >> v1:172.21.15.155:6789/0 conn(0x7fa4d8129e30 legacy=0x7fa4d80ad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:34.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4de6f1700 1 -- 172.21.15.63:0/1755757728 >> v1:172.21.15.63:6789/0 conn(0x7fa4d8060b90 legacy=0x7fa4d8142da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:34.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4de6f1700 1 -- 172.21.15.63:0/1755757728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d8128c80 con 0x7fa4d8143da0 2020-05-18T21:32:34.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4de6f1700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8143da0 0x7fa4d81434b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4cc001670 tx=0x7fa4c8010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:34.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4de6f1700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8143da0 0x7fa4d81434b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4cc001670 tx=0x7fa4c8010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:34.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4de6f1700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8143da0 0x7fa4d81434b0 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7fa4cc001670 tx=0x7fa4c8010890).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:34.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4de6f1700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8143da0 0x7fa4d81434b0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7fa4cc001670 tx=0x7fa4c8010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:34.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4d6ffd700 1 -- 172.21.15.63:0/1755757728 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d0008980 con 0x7fa4d8143da0 2020-05-18T21:32:34.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4e0154700 1 -- 172.21.15.63:0/1755757728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d812d3a0 con 0x7fa4d8143da0 2020-05-18T21:32:34.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4de6f1700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8143da0 0x7fa4d81434b0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7fa4cc001670 tx=0x7fa4c8010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:34.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4de6f1700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8143da0 0x7fa4d81434b0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7fa4cc001670 tx=0x7fa4c8010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:34.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4d6ffd700 1 -- 172.21.15.63:0/1755757728 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c8006910 con 0x7fa4d8143da0 2020-05-18T21:32:34.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4d6ffd700 1 -- 172.21.15.63:0/1755757728 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4cc0014d0 con 0x7fa4d8143da0 2020-05-18T21:32:34.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.801+0000 7fa4e0154700 1 -- 172.21.15.63:0/1755757728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d81273c0 con 0x7fa4d8143da0 2020-05-18T21:32:34.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.805+0000 7fa4de6f1700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8143da0 0x7fa4d81434b0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7fa4cc001670 tx=0x7fa4c8010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:34.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.805+0000 7fa4e0154700 1 -- 172.21.15.63:0/1755757728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d80569e0 con 0x7fa4d8143da0 2020-05-18T21:32:34.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.805+0000 7fa4d6ffd700 1 -- 172.21.15.63:0/1755757728 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa4c8006c70 con 0x7fa4d8143da0 2020-05-18T21:32:34.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.805+0000 7fa4de6f1700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8143da0 0x7fa4d81434b0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7fa4cc001670 tx=0x7fa4c8010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:34.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.805+0000 7fa4d6ffd700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa4b804fe60 0x7fa4b8052320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:34.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.805+0000 7fa4d6ffd700 1 -- 172.21.15.63:0/1755757728 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fa4c80632f0 con 0x7fa4d8143da0 2020-05-18T21:32:34.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.805+0000 7fa4ddef0700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa4b804fe60 0x7fa4b8052320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:34.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.809+0000 7fa4ddef0700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa4b804fe60 0x7fa4b8052320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4d0000f70 tx=0x7fa4d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:34.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.809+0000 7fa4ddef0700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa4b804fe60 0x7fa4b8052320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4d0000f70 tx=0x7fa4d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:34.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.809+0000 7fa4ddef0700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa4b804fe60 0x7fa4b8052320 secure :-1 s=READY pgs=469 cs=0 l=1 rx=0x7fa4d0000f70 tx=0x7fa4d0007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:34.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.817+0000 7fa4de6f1700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8143da0 0x7fa4d81434b0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7fa4cc001670 tx=0x7fa4c8010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:34.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.817+0000 7fa4d6ffd700 1 -- 172.21.15.63:0/1755757728 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa4c803d740 con 0x7fa4d8143da0 2020-05-18T21:32:34.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.969+0000 7fa4e0154700 1 -- 172.21.15.63:0/1755757728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4d8147fb0 con 0x7fa4d8143da0 2020-05-18T21:32:34.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.969+0000 7fa4de6f1700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8143da0 0x7fa4d81434b0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7fa4cc001670 tx=0x7fa4c8010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:34.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.969+0000 7fa4d6ffd700 1 -- 172.21.15.63:0/1755757728 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2159 (secure 0 0 0) 0x7fa4c8040d60 con 0x7fa4d8143da0 2020-05-18T21:32:34.975 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:34.975 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":67,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:20.666310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:stopping","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:34.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.973+0000 7fa4e0154700 1 -- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa4b804fe60 msgr2=0x7fa4b8052320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:34.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.973+0000 7fa4e0154700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa4b804fe60 0x7fa4b8052320 secure :-1 s=READY pgs=469 cs=0 l=1 rx=0x7fa4d0000f70 tx=0x7fa4d0007e00).stop 2020-05-18T21:32:34.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.973+0000 7fa4e0154700 1 -- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8143da0 msgr2=0x7fa4d81434b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:34.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.973+0000 7fa4e0154700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8143da0 0x7fa4d81434b0 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7fa4cc001670 tx=0x7fa4c8010890).stop 2020-05-18T21:32:34.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.973+0000 7fa4e0154700 1 -- 172.21.15.63:0/1755757728 shutdown_connections 2020-05-18T21:32:34.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.973+0000 7fa4e0154700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa4b804fe60 0x7fa4b8052320 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:34.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.973+0000 7fa4e0154700 1 --2- 172.21.15.63:0/1755757728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d8143da0 0x7fa4d81434b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:34.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.973+0000 7fa4e0154700 1 -- 172.21.15.63:0/1755757728 >> 172.21.15.63:0/1755757728 conn(0x7fa4d80b83d0 msgr2=0x7fa4d80659c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:34.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.973+0000 7fa4e0154700 1 -- 172.21.15.63:0/1755757728 shutdown_connections 2020-05-18T21:32:34.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:34.973+0000 7fa4e0154700 1 -- 172.21.15.63:0/1755757728 wait complete. 2020-05-18T21:32:34.979 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 67 2020-05-18T21:32:35.192 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:20.666310+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:stopping', 'state_seq': 6, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:35.193 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5756:up:stopping 2020-05-18T21:32:36.194 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:36.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed1d6fd700 1 Processor -- start 2020-05-18T21:32:36.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed1d6fd700 1 -- start start 2020-05-18T21:32:36.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed1d6fd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fed18060b90 0x7fed180615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:36.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed1d6fd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fed180b2860 0x7fed1814e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:36.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed1d6fd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed18144090 0x7fed181444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:36.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed1d6fd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed18144920 con 0x7fed18060b90 2020-05-18T21:32:36.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed1d6fd700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed18066210 con 0x7fed180b2860 2020-05-18T21:32:36.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed1d6fd700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1814d960 con 0x7fed18144090 2020-05-18T21:32:36.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed16ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fed18060b90 0x7fed180615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:36.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed16ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fed18060b90 0x7fed180615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59116/0 (socket says 172.21.15.63:59116) 2020-05-18T21:32:36.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed16ffd700 1 -- 172.21.15.63:0/510009313 learned_addr learned my addr 172.21.15.63:0/510009313 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:36.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed167fc700 1 --2- 172.21.15.63:0/510009313 >> v2:172.21.15.155:3300/0 conn(0x7fed180b2860 0x7fed1814e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:36.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed177fe700 1 --2- 172.21.15.63:0/510009313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed18144090 0x7fed181444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:36.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed16ffd700 1 -- 172.21.15.63:0/510009313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed18144090 msgr2=0x7fed181444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:36.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed16ffd700 1 --2- 172.21.15.63:0/510009313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed18144090 0x7fed181444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:36.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed16ffd700 1 -- 172.21.15.63:0/510009313 >> v2:172.21.15.155:3300/0 conn(0x7fed180b2860 msgr2=0x7fed1814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:36.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed16ffd700 1 --2- 172.21.15.63:0/510009313 >> v2:172.21.15.155:3300/0 conn(0x7fed180b2860 0x7fed1814e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:36.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed16ffd700 1 -- 172.21.15.63:0/510009313 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1814db90 con 0x7fed18060b90 2020-05-18T21:32:36.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed167fc700 1 --2- 172.21.15.63:0/510009313 >> v2:172.21.15.155:3300/0 conn(0x7fed180b2860 0x7fed1814e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:32:36.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed16ffd700 1 --2- 172.21.15.63:0/510009313 >> v2:172.21.15.63:3300/0 conn(0x7fed18060b90 0x7fed180615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fed18066350 tx=0x7fed00008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:36.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed16ffd700 1 --2- 172.21.15.63:0/510009313 >> v2:172.21.15.63:3300/0 conn(0x7fed18060b90 0x7fed180615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fed18066350 tx=0x7fed00008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:36.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed16ffd700 1 --2- 172.21.15.63:0/510009313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed18060b90 0x7fed180615e0 secure :-1 s=READY pgs=1190 cs=0 l=1 rx=0x7fed18066350 tx=0x7fed00008920).ready entity=mon.0 client_cookie=26ba96a42d06226e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:36.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed16ffd700 1 --2- 172.21.15.63:0/510009313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed18060b90 0x7fed180615e0 secure :-1 s=THROTTLE_DONE pgs=1190 cs=0 l=1 rx=0x7fed18066350 tx=0x7fed00008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:36.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed16ffd700 1 --2- 172.21.15.63:0/510009313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed18060b90 0x7fed180615e0 secure :-1 s=THROTTLE_DONE pgs=1190 cs=0 l=1 rx=0x7fed18066350 tx=0x7fed00008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:36.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed15ffb700 1 -- 172.21.15.63:0/510009313 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed00011760 con 0x7fed18060b90 2020-05-18T21:32:36.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed16ffd700 1 --2- 172.21.15.63:0/510009313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed18060b90 0x7fed180615e0 secure :-1 s=THROTTLE_DONE pgs=1190 cs=0 l=1 rx=0x7fed18066350 tx=0x7fed00008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:36.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed15ffb700 1 -- 172.21.15.63:0/510009313 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed000118c0 con 0x7fed18060b90 2020-05-18T21:32:36.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed15ffb700 1 -- 172.21.15.63:0/510009313 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed00011ce0 con 0x7fed18060b90 2020-05-18T21:32:36.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed1d6fd700 1 -- 172.21.15.63:0/510009313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed18060b90 msgr2=0x7fed180615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:36.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed1d6fd700 1 --2- 172.21.15.63:0/510009313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed18060b90 0x7fed180615e0 secure :-1 s=READY pgs=1190 cs=0 l=1 rx=0x7fed18066350 tx=0x7fed00008920).stop 2020-05-18T21:32:36.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed1d6fd700 1 -- 172.21.15.63:0/510009313 shutdown_connections 2020-05-18T21:32:36.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed1d6fd700 1 --2- 172.21.15.63:0/510009313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed18144090 0x7fed181444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:36.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed1d6fd700 1 --2- 172.21.15.63:0/510009313 >> v2:172.21.15.155:3300/0 conn(0x7fed180b2860 0x7fed1814e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:36.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed1d6fd700 1 --2- 172.21.15.63:0/510009313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed18060b90 0x7fed180615e0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:36.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.305+0000 7fed1d6fd700 1 -- 172.21.15.63:0/510009313 >> 172.21.15.63:0/510009313 conn(0x7fed180b83d0 msgr2=0x7fed180b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:36.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.309+0000 7fed1d6fd700 1 -- 172.21.15.63:0/510009313 shutdown_connections 2020-05-18T21:32:36.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.309+0000 7fed1d6fd700 1 -- 172.21.15.63:0/510009313 wait complete. 2020-05-18T21:32:36.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.309+0000 7fed1d6fd700 1 Processor -- start 2020-05-18T21:32:36.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.309+0000 7fed1d6fd700 1 -- start start 2020-05-18T21:32:36.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.309+0000 7fed1d6fd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fed18060b90 0x7fed180ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:36.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.309+0000 7fed1d6fd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed180b2860 0x7fed1815b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:36.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.309+0000 7fed1d6fd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed180acd90 con 0x7fed18144090 2020-05-18T21:32:36.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.309+0000 7fed1d6fd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed1814b840 con 0x7fed18060b90 2020-05-18T21:32:36.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.309+0000 7fed1d6fd700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed180aeea0 con 0x7fed180b2860 2020-05-18T21:32:36.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.309+0000 7fed16ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fed18060b90 0x7fed180ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:36.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.309+0000 7fed16ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fed18060b90 0x7fed180ae920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59120/0 (socket says 172.21.15.63:59120) 2020-05-18T21:32:36.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.309+0000 7fed16ffd700 1 -- 172.21.15.63:0/3256073180 learned_addr learned my addr 172.21.15.63:0/3256073180 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:36.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.309+0000 7fed167fc700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed180b2860 0x7fed1815b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:36.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.309+0000 7fed16ffd700 1 -- 172.21.15.63:0/3256073180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed180b2860 msgr2=0x7fed1815b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:36.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.309+0000 7fed0ffff700 1 -- 172.21.15.63:0/3256073180 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199896196 0 0) 0x7fed180acd90 con 0x7fed18144090 2020-05-18T21:32:36.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.309+0000 7fed16ffd700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed180b2860 0x7fed1815b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:36.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.309+0000 7fed16ffd700 1 -- 172.21.15.63:0/3256073180 >> v1:172.21.15.155:6789/0 conn(0x7fed18144090 legacy=0x7fed18140800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:36.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.309+0000 7fed16ffd700 1 -- 172.21.15.63:0/3256073180 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed18140130 con 0x7fed18060b90 2020-05-18T21:32:36.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.309+0000 7fed16ffd700 1 --2- 172.21.15.63:0/3256073180 >> v2:172.21.15.63:3300/0 conn(0x7fed18060b90 0x7fed180ae920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fed18066350 tx=0x7fed1805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:36.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.313+0000 7fed16ffd700 1 --2- 172.21.15.63:0/3256073180 >> v2:172.21.15.63:3300/0 conn(0x7fed18060b90 0x7fed180ae920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fed18066350 tx=0x7fed1805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:36.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.313+0000 7fed16ffd700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed18060b90 0x7fed180ae920 secure :-1 s=READY pgs=1191 cs=0 l=1 rx=0x7fed18066350 tx=0x7fed1805fa60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:36.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.313+0000 7fed16ffd700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed18060b90 0x7fed180ae920 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7fed18066350 tx=0x7fed1805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:36.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.313+0000 7fed0ffff700 1 -- 172.21.15.63:0/3256073180 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed00011da0 con 0x7fed18060b90 2020-05-18T21:32:36.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.313+0000 7fed16ffd700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed18060b90 0x7fed180ae920 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7fed18066350 tx=0x7fed1805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:36.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.313+0000 7fed16ffd700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed18060b90 0x7fed180ae920 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7fed18066350 tx=0x7fed1805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:36.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.313+0000 7fed0ffff700 1 -- 172.21.15.63:0/3256073180 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed00007360 con 0x7fed18060b90 2020-05-18T21:32:36.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.313+0000 7fed0ffff700 1 -- 172.21.15.63:0/3256073180 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed00005700 con 0x7fed18060b90 2020-05-18T21:32:36.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.313+0000 7fed1d6fd700 1 -- 172.21.15.63:0/3256073180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed18140360 con 0x7fed18060b90 2020-05-18T21:32:36.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.313+0000 7fed1d6fd700 1 -- 172.21.15.63:0/3256073180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1815b6e0 con 0x7fed18060b90 2020-05-18T21:32:36.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.313+0000 7fed16ffd700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed18060b90 0x7fed180ae920 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7fed18066350 tx=0x7fed1805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:36.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.313+0000 7fed1d6fd700 1 -- 172.21.15.63:0/3256073180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed180569e0 con 0x7fed18060b90 2020-05-18T21:32:36.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.313+0000 7fed0ffff700 1 -- 172.21.15.63:0/3256073180 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fed00005930 con 0x7fed18060b90 2020-05-18T21:32:36.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.313+0000 7fed16ffd700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed18060b90 0x7fed180ae920 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7fed18066350 tx=0x7fed1805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:36.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.313+0000 7fed0ffff700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fecfc04f8a0 0x7fecfc051d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:36.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.313+0000 7fed0ffff700 1 -- 172.21.15.63:0/3256073180 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fed00064570 con 0x7fed18060b90 2020-05-18T21:32:36.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.317+0000 7fed167fc700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fecfc04f8a0 0x7fecfc051d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:36.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.317+0000 7fed167fc700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fecfc04f8a0 0x7fecfc051d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fed100032f0 tx=0x7fed10008010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:36.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.317+0000 7fed167fc700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fecfc04f8a0 0x7fecfc051d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fed100032f0 tx=0x7fed10008010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:36.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.317+0000 7fed167fc700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fecfc04f8a0 0x7fecfc051d60 secure :-1 s=READY pgs=470 cs=0 l=1 rx=0x7fed100032f0 tx=0x7fed10008010).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:36.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.321+0000 7fed16ffd700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed18060b90 0x7fed180ae920 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7fed18066350 tx=0x7fed1805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:36.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.321+0000 7fed0ffff700 1 -- 172.21.15.63:0/3256073180 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fed0003e8a0 con 0x7fed18060b90 2020-05-18T21:32:36.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.473+0000 7fed1d6fd700 1 -- 172.21.15.63:0/3256073180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed181404f0 con 0x7fed18060b90 2020-05-18T21:32:36.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.473+0000 7fed16ffd700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed18060b90 0x7fed180ae920 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7fed18066350 tx=0x7fed1805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:36.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.473+0000 7fed0ffff700 1 -- 172.21.15.63:0/3256073180 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2159 (secure 0 0 0) 0x7fed00041ec0 con 0x7fed18060b90 2020-05-18T21:32:36.477 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:36.477 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":67,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:20.666310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:stopping","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:36.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.473+0000 7fed1d6fd700 1 -- 172.21.15.63:0/3256073180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fecfc04f8a0 msgr2=0x7fecfc051d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:36.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.473+0000 7fed1d6fd700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fecfc04f8a0 0x7fecfc051d60 secure :-1 s=READY pgs=470 cs=0 l=1 rx=0x7fed100032f0 tx=0x7fed10008010).stop 2020-05-18T21:32:36.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.473+0000 7fed1d6fd700 1 -- 172.21.15.63:0/3256073180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed18060b90 msgr2=0x7fed180ae920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:36.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.473+0000 7fed1d6fd700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed18060b90 0x7fed180ae920 secure :-1 s=READY pgs=1191 cs=0 l=1 rx=0x7fed18066350 tx=0x7fed1805fa60).stop 2020-05-18T21:32:36.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.473+0000 7fed1d6fd700 1 -- 172.21.15.63:0/3256073180 shutdown_connections 2020-05-18T21:32:36.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.473+0000 7fed1d6fd700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fecfc04f8a0 0x7fecfc051d60 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:36.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.473+0000 7fed1d6fd700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed180b2860 0x7fed1815b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:36.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.473+0000 7fed1d6fd700 1 --2- 172.21.15.63:0/3256073180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed18060b90 0x7fed180ae920 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:36.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.473+0000 7fed1d6fd700 1 -- 172.21.15.63:0/3256073180 >> 172.21.15.63:0/3256073180 conn(0x7fed180b83d0 msgr2=0x7fed181427d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:36.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.473+0000 7fed1d6fd700 1 -- 172.21.15.63:0/3256073180 shutdown_connections 2020-05-18T21:32:36.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:36.473+0000 7fed1d6fd700 1 -- 172.21.15.63:0/3256073180 wait complete. 2020-05-18T21:32:36.481 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 67 2020-05-18T21:32:36.691 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:20.666310+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:stopping', 'state_seq': 6, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:36.692 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5756:up:stopping 2020-05-18T21:32:37.693 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:37.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.801+0000 7fd0eedb1700 1 Processor -- start 2020-05-18T21:32:37.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.801+0000 7fd0eedb1700 1 -- start start 2020-05-18T21:32:37.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.801+0000 7fd0eedb1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd0e80658a0 0x7fd0e80b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:37.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.801+0000 7fd0eedb1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd0e8145ed0 0x7fd0e8146300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:37.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.801+0000 7fd0eedb1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e8063870 con 0x7fd0e80632f0 2020-05-18T21:32:37.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.801+0000 7fd0eedb1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e8145790 con 0x7fd0e80658a0 2020-05-18T21:32:37.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.801+0000 7fd0eedb1700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e8145a30 con 0x7fd0e8145ed0 2020-05-18T21:32:37.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.801+0000 7fd0eddaf700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd0e80658a0 0x7fd0e80b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:37.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.801+0000 7fd0eddaf700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd0e80658a0 0x7fd0e80b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59128/0 (socket says 172.21.15.63:59128) 2020-05-18T21:32:37.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.801+0000 7fd0eddaf700 1 -- 172.21.15.63:0/3490649228 learned_addr learned my addr 172.21.15.63:0/3490649228 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:37.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.801+0000 7fd0ee5b0700 1 --2- 172.21.15.63:0/3490649228 >> v2:172.21.15.155:3300/0 conn(0x7fd0e8145ed0 0x7fd0e8146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:37.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.801+0000 7fd0eddaf700 1 -- 172.21.15.63:0/3490649228 >> v2:172.21.15.155:3300/0 conn(0x7fd0e8145ed0 msgr2=0x7fd0e8146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:37.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.801+0000 7fd0eddaf700 1 --2- 172.21.15.63:0/3490649228 >> v2:172.21.15.155:3300/0 conn(0x7fd0e8145ed0 0x7fd0e8146300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:37.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.801+0000 7fd0eddaf700 1 -- 172.21.15.63:0/3490649228 >> v1:172.21.15.155:6789/0 conn(0x7fd0e80632f0 legacy=0x7fd0e80b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:37.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.801+0000 7fd0eddaf700 1 -- 172.21.15.63:0/3490649228 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e8065c80 con 0x7fd0e80658a0 2020-05-18T21:32:37.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.805+0000 7fd0eddaf700 1 --2- 172.21.15.63:0/3490649228 >> v2:172.21.15.63:3300/0 conn(0x7fd0e80658a0 0x7fd0e80b45f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd0e4002f70 tx=0x7fd0e4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:37.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.805+0000 7fd0eddaf700 1 --2- 172.21.15.63:0/3490649228 >> v2:172.21.15.63:3300/0 conn(0x7fd0e80658a0 0x7fd0e80b45f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd0e4002f70 tx=0x7fd0e4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:37.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.805+0000 7fd0eddaf700 1 --2- 172.21.15.63:0/3490649228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0e80658a0 0x7fd0e80b45f0 secure :-1 s=READY pgs=1192 cs=0 l=1 rx=0x7fd0e4002f70 tx=0x7fd0e4007a80).ready entity=mon.0 client_cookie=4331097784062e90 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:37.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.805+0000 7fd0eddaf700 1 --2- 172.21.15.63:0/3490649228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0e80658a0 0x7fd0e80b45f0 secure :-1 s=THROTTLE_DONE pgs=1192 cs=0 l=1 rx=0x7fd0e4002f70 tx=0x7fd0e4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:37.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.805+0000 7fd0eddaf700 1 --2- 172.21.15.63:0/3490649228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0e80658a0 0x7fd0e80b45f0 secure :-1 s=THROTTLE_DONE pgs=1192 cs=0 l=1 rx=0x7fd0e4002f70 tx=0x7fd0e4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:37.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.805+0000 7fd0ecdad700 1 -- 172.21.15.63:0/3490649228 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0e40116b0 con 0x7fd0e80658a0 2020-05-18T21:32:37.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.805+0000 7fd0eddaf700 1 --2- 172.21.15.63:0/3490649228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0e80658a0 0x7fd0e80b45f0 secure :-1 s=THROTTLE_DONE pgs=1192 cs=0 l=1 rx=0x7fd0e4002f70 tx=0x7fd0e4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:37.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.805+0000 7fd0ecdad700 1 -- 172.21.15.63:0/3490649228 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e4011810 con 0x7fd0e80658a0 2020-05-18T21:32:37.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.805+0000 7fd0ecdad700 1 -- 172.21.15.63:0/3490649228 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0e4011c30 con 0x7fd0e80658a0 2020-05-18T21:32:37.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.805+0000 7fd0eedb1700 1 -- 172.21.15.63:0/3490649228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0e80658a0 msgr2=0x7fd0e80b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:37.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.805+0000 7fd0eedb1700 1 --2- 172.21.15.63:0/3490649228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0e80658a0 0x7fd0e80b45f0 secure :-1 s=READY pgs=1192 cs=0 l=1 rx=0x7fd0e4002f70 tx=0x7fd0e4007a80).stop 2020-05-18T21:32:37.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.805+0000 7fd0eedb1700 1 -- 172.21.15.63:0/3490649228 shutdown_connections 2020-05-18T21:32:37.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.805+0000 7fd0eedb1700 1 --2- 172.21.15.63:0/3490649228 >> v2:172.21.15.155:3300/0 conn(0x7fd0e8145ed0 0x7fd0e8146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:37.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.805+0000 7fd0eedb1700 1 --2- 172.21.15.63:0/3490649228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0e80658a0 0x7fd0e80b45f0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:37.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.805+0000 7fd0eedb1700 1 -- 172.21.15.63:0/3490649228 >> 172.21.15.63:0/3490649228 conn(0x7fd0e8069fc0 msgr2=0x7fd0e806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:37.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.805+0000 7fd0eedb1700 1 -- 172.21.15.63:0/3490649228 shutdown_connections 2020-05-18T21:32:37.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.805+0000 7fd0eedb1700 1 -- 172.21.15.63:0/3490649228 wait complete. 2020-05-18T21:32:37.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0eedb1700 1 Processor -- start 2020-05-18T21:32:37.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0eedb1700 1 -- start start 2020-05-18T21:32:37.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0eedb1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0e80632f0 0x7fd0e80b81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:37.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0eedb1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd0e80658a0 0x7fd0e80acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:37.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0eedb1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e80b8630 con 0x7fd0e8145ed0 2020-05-18T21:32:37.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0eedb1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e80adeb0 con 0x7fd0e80658a0 2020-05-18T21:32:37.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0eedb1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e80ad4d0 con 0x7fd0e80632f0 2020-05-18T21:32:37.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0ed5ae700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd0e80658a0 0x7fd0e80acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:37.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0ed5ae700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd0e80658a0 0x7fd0e80acce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59136/0 (socket says 172.21.15.63:59136) 2020-05-18T21:32:37.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0ed5ae700 1 -- 172.21.15.63:0/1534040583 learned_addr learned my addr 172.21.15.63:0/1534040583 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:37.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0eddaf700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0e80632f0 0x7fd0e80b81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:37.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0ed5ae700 1 -- 172.21.15.63:0/1534040583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0e80632f0 msgr2=0x7fd0e80b81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:37.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0ed5ae700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0e80632f0 0x7fd0e80b81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:37.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0ed5ae700 1 -- 172.21.15.63:0/1534040583 >> v1:172.21.15.155:6789/0 conn(0x7fd0e8145ed0 legacy=0x7fd0e81528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:37.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0ed5ae700 1 -- 172.21.15.63:0/1534040583 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e80ad770 con 0x7fd0e80658a0 2020-05-18T21:32:37.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0daffd700 1 -- 172.21.15.63:0/1534040583 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221369315 0 0) 0x7fd0e80b8630 con 0x7fd0e8145ed0 2020-05-18T21:32:37.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0ed5ae700 1 --2- 172.21.15.63:0/1534040583 >> v2:172.21.15.63:3300/0 conn(0x7fd0e80658a0 0x7fd0e80acce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd0e8060380 tx=0x7fd0dc00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:37.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0ed5ae700 1 --2- 172.21.15.63:0/1534040583 >> v2:172.21.15.63:3300/0 conn(0x7fd0e80658a0 0x7fd0e80acce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd0e8060380 tx=0x7fd0dc00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:37.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0ed5ae700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0e80658a0 0x7fd0e80acce0 secure :-1 s=READY pgs=1193 cs=0 l=1 rx=0x7fd0e8060380 tx=0x7fd0dc00c4a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:37.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0ed5ae700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0e80658a0 0x7fd0e80acce0 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fd0e8060380 tx=0x7fd0dc00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:37.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0daffd700 1 -- 172.21.15.63:0/1534040583 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0dc00cc60 con 0x7fd0e80658a0 2020-05-18T21:32:37.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0ed5ae700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0e80658a0 0x7fd0e80acce0 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fd0e8060380 tx=0x7fd0dc00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:37.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0ed5ae700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0e80658a0 0x7fd0e80acce0 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fd0e8060380 tx=0x7fd0dc00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:37.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0daffd700 1 -- 172.21.15.63:0/1534040583 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0dc00cdc0 con 0x7fd0e80658a0 2020-05-18T21:32:37.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0eedb1700 1 -- 172.21.15.63:0/1534040583 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e80ada70 con 0x7fd0e80658a0 2020-05-18T21:32:37.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0daffd700 1 -- 172.21.15.63:0/1534040583 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0dc012260 con 0x7fd0e80658a0 2020-05-18T21:32:37.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.809+0000 7fd0eedb1700 1 -- 172.21.15.63:0/1534040583 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e8153200 con 0x7fd0e80658a0 2020-05-18T21:32:37.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.813+0000 7fd0ed5ae700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0e80658a0 0x7fd0e80acce0 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fd0e8060380 tx=0x7fd0dc00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:37.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.813+0000 7fd0daffd700 1 -- 172.21.15.63:0/1534040583 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd0dc006520 con 0x7fd0e80658a0 2020-05-18T21:32:37.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.813+0000 7fd0ed5ae700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0e80658a0 0x7fd0e80acce0 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fd0e8060380 tx=0x7fd0dc00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:37.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.813+0000 7fd0eedb1700 1 -- 172.21.15.63:0/1534040583 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e80ad2c0 con 0x7fd0e80658a0 2020-05-18T21:32:37.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.813+0000 7fd0daffd700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd0c804f930 0x7fd0c8051df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:37.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.813+0000 7fd0daffd700 1 -- 172.21.15.63:0/1534040583 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fd0dc063620 con 0x7fd0e80658a0 2020-05-18T21:32:37.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.813+0000 7fd0eddaf700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd0c804f930 0x7fd0c8051df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:37.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.813+0000 7fd0eddaf700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd0c804f930 0x7fd0c8051df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd0e4002f70 tx=0x7fd0e4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:37.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.813+0000 7fd0eddaf700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd0c804f930 0x7fd0c8051df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd0e4002f70 tx=0x7fd0e4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:37.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.813+0000 7fd0eddaf700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd0c804f930 0x7fd0c8051df0 secure :-1 s=READY pgs=471 cs=0 l=1 rx=0x7fd0e4002f70 tx=0x7fd0e4007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:37.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.821+0000 7fd0ed5ae700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0e80658a0 0x7fd0e80acce0 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fd0e8060380 tx=0x7fd0dc00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:37.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.821+0000 7fd0daffd700 1 -- 172.21.15.63:0/1534040583 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd0dc03dd20 con 0x7fd0e80658a0 2020-05-18T21:32:37.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.973+0000 7fd0eedb1700 1 -- 172.21.15.63:0/1534040583 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0e80569e0 con 0x7fd0e80658a0 2020-05-18T21:32:37.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.973+0000 7fd0ed5ae700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0e80658a0 0x7fd0e80acce0 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fd0e8060380 tx=0x7fd0dc00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:37.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.973+0000 7fd0daffd700 1 -- 172.21.15.63:0/1534040583 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2159 (secure 0 0 0) 0x7fd0dc040f70 con 0x7fd0e80658a0 2020-05-18T21:32:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:37.977 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":67,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:20.666310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:stopping","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:37.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.973+0000 7fd0eedb1700 1 -- 172.21.15.63:0/1534040583 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd0c804f930 msgr2=0x7fd0c8051df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:37.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.973+0000 7fd0eedb1700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd0c804f930 0x7fd0c8051df0 secure :-1 s=READY pgs=471 cs=0 l=1 rx=0x7fd0e4002f70 tx=0x7fd0e4007a80).stop 2020-05-18T21:32:37.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.973+0000 7fd0eedb1700 1 -- 172.21.15.63:0/1534040583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0e80658a0 msgr2=0x7fd0e80acce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:37.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.973+0000 7fd0eedb1700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0e80658a0 0x7fd0e80acce0 secure :-1 s=READY pgs=1193 cs=0 l=1 rx=0x7fd0e8060380 tx=0x7fd0dc00c4a0).stop 2020-05-18T21:32:37.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.973+0000 7fd0eedb1700 1 -- 172.21.15.63:0/1534040583 shutdown_connections 2020-05-18T21:32:37.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.973+0000 7fd0eedb1700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd0c804f930 0x7fd0c8051df0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:37.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.973+0000 7fd0eedb1700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0e80658a0 0x7fd0e80acce0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:37.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.973+0000 7fd0eedb1700 1 --2- 172.21.15.63:0/1534040583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0e80632f0 0x7fd0e80b81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:37.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.973+0000 7fd0eedb1700 1 -- 172.21.15.63:0/1534040583 >> 172.21.15.63:0/1534040583 conn(0x7fd0e8069fc0 msgr2=0x7fd0e8061460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:37.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.977+0000 7fd0eedb1700 1 -- 172.21.15.63:0/1534040583 shutdown_connections 2020-05-18T21:32:37.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:37.977+0000 7fd0eedb1700 1 -- 172.21.15.63:0/1534040583 wait complete. 2020-05-18T21:32:37.981 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 67 2020-05-18T21:32:38.192 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:20.666310+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:stopping', 'state_seq': 6, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:38.192 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5756:up:stopping 2020-05-18T21:32:39.194 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:39.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.301+0000 7f022f59e700 1 Processor -- start 2020-05-18T21:32:39.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.301+0000 7f022f59e700 1 -- start start 2020-05-18T21:32:39.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.301+0000 7f022f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0230063ce0 0x7f0230147140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:39.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.301+0000 7f022f59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f02300ad180 0x7f02300ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:39.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.301+0000 7f022f59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02301476c0 con 0x7f02301435d0 2020-05-18T21:32:39.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.301+0000 7f022f59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0230147960 con 0x7f02300ad180 2020-05-18T21:32:39.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.301+0000 7f022f59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0230147c00 con 0x7f0230063ce0 2020-05-18T21:32:39.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022e59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f02301435d0 0x7f023005edd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33100/0 (socket says 172.21.15.63:33100) 2020-05-18T21:32:39.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022e59c700 1 -- 172.21.15.63:0/133909600 learned_addr learned my addr 172.21.15.63:0/133909600 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:39.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022dd9b700 1 --2- 172.21.15.63:0/133909600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0230063ce0 0x7f0230147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:39.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022ed9d700 1 --2- 172.21.15.63:0/133909600 >> v2:172.21.15.155:3300/0 conn(0x7f02300ad180 0x7f02300ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:39.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022d59a700 1 -- 172.21.15.63:0/133909600 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017491152 0 0) 0x7f02301476c0 con 0x7f02301435d0 2020-05-18T21:32:39.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022d59a700 1 -- 172.21.15.63:0/133909600 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0210003270 con 0x7f02301435d0 2020-05-18T21:32:39.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022d59a700 1 -- 172.21.15.63:0/133909600 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 673671385 0 0) 0x7f0210003270 con 0x7f02301435d0 2020-05-18T21:32:39.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022d59a700 1 -- 172.21.15.63:0/133909600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0230063ce0 msgr2=0x7f0230147140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:39.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022d59a700 1 --2- 172.21.15.63:0/133909600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0230063ce0 0x7f0230147140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:39.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022d59a700 1 -- 172.21.15.63:0/133909600 >> v2:172.21.15.155:3300/0 conn(0x7f02300ad180 msgr2=0x7f02300ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:39.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022d59a700 1 --2- 172.21.15.63:0/133909600 >> v2:172.21.15.155:3300/0 conn(0x7f02300ad180 0x7f02300ad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:39.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022d59a700 1 -- 172.21.15.63:0/133909600 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023005f4e0 con 0x7f02301435d0 2020-05-18T21:32:39.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022d59a700 1 -- 172.21.15.63:0/133909600 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f0218001710 con 0x7f02301435d0 2020-05-18T21:32:39.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022d59a700 1 -- 172.21.15.63:0/133909600 >> v1:172.21.15.63:6789/0 conn(0x7f02301435d0 legacy=0x7f023005edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:39.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022d59a700 1 --2- 172.21.15.63:0/133909600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0230063ce0 0x7f0210003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:39.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022d59a700 1 --2- 172.21.15.63:0/133909600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0210003bc0 0x7f0210004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:39.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022d59a700 1 --2- 172.21.15.63:0/133909600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0210004600 0x7f0210004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:39.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022d59a700 1 -- 172.21.15.63:0/133909600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0230147960 con 0x7f0210003bc0 2020-05-18T21:32:39.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022d59a700 1 -- 172.21.15.63:0/133909600 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0230147c00 con 0x7f0210004600 2020-05-18T21:32:39.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022d59a700 1 -- 172.21.15.63:0/133909600 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0210005090 con 0x7f0230063ce0 2020-05-18T21:32:39.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022e59c700 1 --2- 172.21.15.63:0/133909600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0230063ce0 0x7f0210003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:39.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022ed9d700 1 --2- 172.21.15.63:0/133909600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0210004600 0x7f0210004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:39.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022dd9b700 1 --2- 172.21.15.63:0/133909600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0210003bc0 0x7f0210004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:39.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022dd9b700 1 -- 172.21.15.63:0/133909600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0230063ce0 msgr2=0x7f0210003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:39.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022dd9b700 1 --2- 172.21.15.63:0/133909600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0230063ce0 0x7f0210003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:39.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022dd9b700 1 -- 172.21.15.63:0/133909600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0210004600 msgr2=0x7f0210004a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:39.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022dd9b700 1 --2- 172.21.15.63:0/133909600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0210004600 0x7f0210004a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:39.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022dd9b700 1 -- 172.21.15.63:0/133909600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0210003270 con 0x7f0210003bc0 2020-05-18T21:32:39.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022e59c700 1 --2- 172.21.15.63:0/133909600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0230063ce0 0x7f0210003760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:39.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022dd9b700 1 --2- 172.21.15.63:0/133909600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0210003bc0 0x7f0210004020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0220008950 tx=0x7f0220010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:39.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022dd9b700 1 --2- 172.21.15.63:0/133909600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0210003bc0 0x7f0210004020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0220008950 tx=0x7f0220010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:39.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022dd9b700 1 --2- 172.21.15.63:0/133909600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0210003bc0 0x7f0210004020 secure :-1 s=READY pgs=1195 cs=0 l=1 rx=0x7f0220008950 tx=0x7f0220010090).ready entity=mon.0 client_cookie=6da534a63bb3e2b2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:39.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022dd9b700 1 --2- 172.21.15.63:0/133909600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0210003bc0 0x7f0210004020 secure :-1 s=THROTTLE_DONE pgs=1195 cs=0 l=1 rx=0x7f0220008950 tx=0x7f0220010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:39.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022dd9b700 1 --2- 172.21.15.63:0/133909600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0210003bc0 0x7f0210004020 secure :-1 s=THROTTLE_DONE pgs=1195 cs=0 l=1 rx=0x7f0220008950 tx=0x7f0220010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:39.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022d59a700 1 -- 172.21.15.63:0/133909600 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0220008d70 con 0x7f0210003bc0 2020-05-18T21:32:39.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022dd9b700 1 --2- 172.21.15.63:0/133909600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0210003bc0 0x7f0210004020 secure :-1 s=THROTTLE_DONE pgs=1195 cs=0 l=1 rx=0x7f0220008950 tx=0x7f0220010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:39.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022d59a700 1 -- 172.21.15.63:0/133909600 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0220010900 con 0x7f0210003bc0 2020-05-18T21:32:39.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022d59a700 1 -- 172.21.15.63:0/133909600 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0220010c60 con 0x7f0210003bc0 2020-05-18T21:32:39.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022f59e700 1 -- 172.21.15.63:0/133909600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0210003bc0 msgr2=0x7f0210004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:39.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022f59e700 1 --2- 172.21.15.63:0/133909600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0210003bc0 0x7f0210004020 secure :-1 s=READY pgs=1195 cs=0 l=1 rx=0x7f0220008950 tx=0x7f0220010090).stop 2020-05-18T21:32:39.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022ed9d700 1 -- 172.21.15.63:0/133909600 reap_dead start 2020-05-18T21:32:39.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022f59e700 1 -- 172.21.15.63:0/133909600 shutdown_connections 2020-05-18T21:32:39.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022f59e700 1 -- 172.21.15.63:0/133909600 >> 172.21.15.63:0/133909600 conn(0x7f0230069fc0 msgr2=0x7f023006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:39.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022f59e700 1 -- 172.21.15.63:0/133909600 shutdown_connections 2020-05-18T21:32:39.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.305+0000 7f022f59e700 1 -- 172.21.15.63:0/133909600 wait complete. 2020-05-18T21:32:39.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.309+0000 7f022f59e700 1 Processor -- start 2020-05-18T21:32:39.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.309+0000 7f022f59e700 1 -- start start 2020-05-18T21:32:39.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.309+0000 7f022f59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0230062d30 0x7f02300b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:39.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.309+0000 7f022f59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f02301373d0 0x7f02301536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:39.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.309+0000 7f022f59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02301452e0 con 0x7f0230134480 2020-05-18T21:32:39.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.309+0000 7f022f59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0230145510 con 0x7f0230062d30 2020-05-18T21:32:39.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.309+0000 7f022f59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02301457b0 con 0x7f02301373d0 2020-05-18T21:32:39.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.309+0000 7f022e59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0230062d30 0x7f02300b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:39.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.309+0000 7f022e59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0230062d30 0x7f02300b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59154/0 (socket says 172.21.15.63:59154) 2020-05-18T21:32:39.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.309+0000 7f022e59c700 1 -- 172.21.15.63:0/3500696501 learned_addr learned my addr 172.21.15.63:0/3500696501 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:39.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.309+0000 7f022dd9b700 1 --2- 172.21.15.63:0/3500696501 >> v2:172.21.15.155:3300/0 conn(0x7f02301373d0 0x7f02301536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:39.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.309+0000 7f022e59c700 1 -- 172.21.15.63:0/3500696501 >> v2:172.21.15.155:3300/0 conn(0x7f02301373d0 msgr2=0x7f02301536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:39.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.309+0000 7f022e59c700 1 --2- 172.21.15.63:0/3500696501 >> v2:172.21.15.155:3300/0 conn(0x7f02301373d0 0x7f02301536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:39.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.309+0000 7f022e59c700 1 -- 172.21.15.63:0/3500696501 >> v1:172.21.15.155:6789/0 conn(0x7f0230134480 legacy=0x7f0230145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:39.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.313+0000 7f022e59c700 1 -- 172.21.15.63:0/3500696501 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0230063110 con 0x7f0230062d30 2020-05-18T21:32:39.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.313+0000 7f022e59c700 1 --2- 172.21.15.63:0/3500696501 >> v2:172.21.15.63:3300/0 conn(0x7f0230062d30 0x7f02300b3f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0218001420 tx=0x7f02300b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:39.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.313+0000 7f022e59c700 1 --2- 172.21.15.63:0/3500696501 >> v2:172.21.15.63:3300/0 conn(0x7f0230062d30 0x7f02300b3f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0218001420 tx=0x7f02300b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:39.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.313+0000 7f022e59c700 1 --2- 172.21.15.63:0/3500696501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0230062d30 0x7f02300b3f60 secure :-1 s=READY pgs=1196 cs=0 l=1 rx=0x7f0218001420 tx=0x7f02300b4cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:39.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.313+0000 7f022e59c700 1 --2- 172.21.15.63:0/3500696501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0230062d30 0x7f02300b3f60 secure :-1 s=THROTTLE_DONE pgs=1196 cs=0 l=1 rx=0x7f0218001420 tx=0x7f02300b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:39.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.313+0000 7f022e59c700 1 --2- 172.21.15.63:0/3500696501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0230062d30 0x7f02300b3f60 secure :-1 s=THROTTLE_DONE pgs=1196 cs=0 l=1 rx=0x7f0218001420 tx=0x7f02300b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:39.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.313+0000 7f02277fe700 1 -- 172.21.15.63:0/3500696501 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f021800c840 con 0x7f0230062d30 2020-05-18T21:32:39.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.313+0000 7f022e59c700 1 --2- 172.21.15.63:0/3500696501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0230062d30 0x7f02300b3f60 secure :-1 s=THROTTLE_DONE pgs=1196 cs=0 l=1 rx=0x7f0218001420 tx=0x7f02300b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:39.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.313+0000 7f02277fe700 1 -- 172.21.15.63:0/3500696501 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021800c9e0 con 0x7f0230062d30 2020-05-18T21:32:39.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.313+0000 7f022f59e700 1 -- 172.21.15.63:0/3500696501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0230153b50 con 0x7f0230062d30 2020-05-18T21:32:39.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.313+0000 7f02277fe700 1 -- 172.21.15.63:0/3500696501 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f021800ce00 con 0x7f0230062d30 2020-05-18T21:32:39.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.313+0000 7f022f59e700 1 -- 172.21.15.63:0/3500696501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0230134910 con 0x7f0230062d30 2020-05-18T21:32:39.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.313+0000 7f022e59c700 1 --2- 172.21.15.63:0/3500696501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0230062d30 0x7f02300b3f60 secure :-1 s=THROTTLE_DONE pgs=1196 cs=0 l=1 rx=0x7f0218001420 tx=0x7f02300b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:39.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.313+0000 7f022f59e700 1 -- 172.21.15.63:0/3500696501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02300569e0 con 0x7f0230062d30 2020-05-18T21:32:39.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.313+0000 7f02277fe700 1 -- 172.21.15.63:0/3500696501 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f02180045f0 con 0x7f0230062d30 2020-05-18T21:32:39.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.313+0000 7f022e59c700 1 --2- 172.21.15.63:0/3500696501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0230062d30 0x7f02300b3f60 secure :-1 s=THROTTLE_DONE pgs=1196 cs=0 l=1 rx=0x7f0218001420 tx=0x7f02300b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:39.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.317+0000 7f02277fe700 1 --2- 172.21.15.63:0/3500696501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f021404fa90 0x7f0214051f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:39.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.317+0000 7f02277fe700 1 -- 172.21.15.63:0/3500696501 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f0218063d10 con 0x7f0230062d30 2020-05-18T21:32:39.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.317+0000 7f022dd9b700 1 --2- 172.21.15.63:0/3500696501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f021404fa90 0x7f0214051f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:39.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.317+0000 7f022dd9b700 1 --2- 172.21.15.63:0/3500696501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f021404fa90 0x7f0214051f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0220008950 tx=0x7f0220010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:39.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.317+0000 7f022dd9b700 1 --2- 172.21.15.63:0/3500696501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f021404fa90 0x7f0214051f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0220008950 tx=0x7f0220010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:39.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.317+0000 7f022dd9b700 1 --2- 172.21.15.63:0/3500696501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f021404fa90 0x7f0214051f50 secure :-1 s=READY pgs=472 cs=0 l=1 rx=0x7f0220008950 tx=0x7f0220010090).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:39.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.321+0000 7f022e59c700 1 --2- 172.21.15.63:0/3500696501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0230062d30 0x7f02300b3f60 secure :-1 s=THROTTLE_DONE pgs=1196 cs=0 l=1 rx=0x7f0218001420 tx=0x7f02300b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:39.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.321+0000 7f02277fe700 1 -- 172.21.15.63:0/3500696501 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f021803e0a0 con 0x7f0230062d30 2020-05-18T21:32:39.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.469+0000 7f022f59e700 1 -- 172.21.15.63:0/3500696501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02301459b0 con 0x7f0230062d30 2020-05-18T21:32:39.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.473+0000 7f022e59c700 1 --2- 172.21.15.63:0/3500696501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0230062d30 0x7f02300b3f60 secure :-1 s=THROTTLE_DONE pgs=1196 cs=0 l=1 rx=0x7f0218001420 tx=0x7f02300b4cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:39.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.473+0000 7f02277fe700 1 -- 172.21.15.63:0/3500696501 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2159 (secure 0 0 0) 0x7f02180416c0 con 0x7f0230062d30 2020-05-18T21:32:39.476 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:39.476 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":67,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:20.666310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":7500,"mds_1":5756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5756":{"gid":5756,"name":"b","rank":1,"incarnation":60,"state":"up:stopping","state_seq":6,"addr":"172.21.15.155:6835/3950521880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3950521880},{"type":"v1","addr":"172.21.15.155:6835","nonce":3950521880}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:39.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.473+0000 7f022f59e700 1 -- 172.21.15.63:0/3500696501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f021404fa90 msgr2=0x7f0214051f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:39.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.473+0000 7f022f59e700 1 --2- 172.21.15.63:0/3500696501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f021404fa90 0x7f0214051f50 secure :-1 s=READY pgs=472 cs=0 l=1 rx=0x7f0220008950 tx=0x7f0220010090).stop 2020-05-18T21:32:39.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.473+0000 7f022f59e700 1 -- 172.21.15.63:0/3500696501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0230062d30 msgr2=0x7f02300b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:39.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.473+0000 7f022f59e700 1 --2- 172.21.15.63:0/3500696501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0230062d30 0x7f02300b3f60 secure :-1 s=READY pgs=1196 cs=0 l=1 rx=0x7f0218001420 tx=0x7f02300b4cd0).stop 2020-05-18T21:32:39.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.473+0000 7f022f59e700 1 -- 172.21.15.63:0/3500696501 shutdown_connections 2020-05-18T21:32:39.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.473+0000 7f022f59e700 1 --2- 172.21.15.63:0/3500696501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f021404fa90 0x7f0214051f50 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:39.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.473+0000 7f022f59e700 1 --2- 172.21.15.63:0/3500696501 >> v2:172.21.15.155:3300/0 conn(0x7f02301373d0 0x7f02301536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:39.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.473+0000 7f022f59e700 1 --2- 172.21.15.63:0/3500696501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0230062d30 0x7f02300b3f60 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:39.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.473+0000 7f022f59e700 1 -- 172.21.15.63:0/3500696501 >> 172.21.15.63:0/3500696501 conn(0x7f0230069fc0 msgr2=0x7f02300b4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:39.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.473+0000 7f022f59e700 1 -- 172.21.15.63:0/3500696501 shutdown_connections 2020-05-18T21:32:39.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:39.473+0000 7f022f59e700 1 -- 172.21.15.63:0/3500696501 wait complete. 2020-05-18T21:32:39.481 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 67 2020-05-18T21:32:39.691 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:20.666310+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 7500, 'mds_1': 5756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5756': {'gid': 5756, 'name': 'b', 'rank': 1, 'incarnation': 60, 'state': 'up:stopping', 'state_seq': 6, 'addr': '172.21.15.155:6835/3950521880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3950521880}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3950521880}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:39.692 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5756:up:stopping 2020-05-18T21:32:40.694 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:40.728 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:32:40.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.813+0000 7f9e28c80700 1 Processor -- start 2020-05-18T21:32:40.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.813+0000 7f9e28c80700 1 -- start start 2020-05-18T21:32:40.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.813+0000 7f9e28c80700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9e2405f110 0x7f9e240b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:40.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.813+0000 7f9e28c80700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e2414aa70 0x7f9e240648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:40.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.813+0000 7f9e28c80700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9e24064d20 0x7f9e2414d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:40.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e28c80700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2414a140 con 0x7f9e24064d20 2020-05-18T21:32:40.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e28c80700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2414a330 con 0x7f9e2405f110 2020-05-18T21:32:40.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e28c80700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2414a5d0 con 0x7f9e2414aa70 2020-05-18T21:32:40.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e23fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9e24064d20 0x7f9e2414d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:40.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e23fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9e24064d20 0x7f9e2414d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59164/0 (socket says 172.21.15.63:59164) 2020-05-18T21:32:40.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e23fff700 1 -- 172.21.15.63:0/3706864786 learned_addr learned my addr 172.21.15.63:0/3706864786 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:40.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/3706864786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e2414aa70 0x7f9e240648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:40.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e237fe700 1 --2- 172.21.15.63:0/3706864786 >> v2:172.21.15.155:3300/0 conn(0x7f9e2405f110 0x7f9e240b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:40.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e22ffd700 1 -- 172.21.15.63:0/3706864786 >> v2:172.21.15.155:3300/0 conn(0x7f9e2405f110 msgr2=0x7f9e240b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:40.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/3706864786 >> v2:172.21.15.155:3300/0 conn(0x7f9e2405f110 0x7f9e240b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:40.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e22ffd700 1 -- 172.21.15.63:0/3706864786 >> v2:172.21.15.63:3300/0 conn(0x7f9e24064d20 msgr2=0x7f9e2414d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:40.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/3706864786 >> v2:172.21.15.63:3300/0 conn(0x7f9e24064d20 0x7f9e2414d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:40.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e22ffd700 1 -- 172.21.15.63:0/3706864786 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e24063430 con 0x7f9e2414aa70 2020-05-18T21:32:40.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e23fff700 1 --2- 172.21.15.63:0/3706864786 >> v2:172.21.15.63:3300/0 conn(0x7f9e24064d20 0x7f9e2414d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:40.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/3706864786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e2414aa70 0x7f9e240648c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9e24063c70 tx=0x7f9e0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:40.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/3706864786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e2414aa70 0x7f9e240648c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9e24063c70 tx=0x7f9e0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:40.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/3706864786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e2414aa70 0x7f9e240648c0 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f9e24063c70 tx=0x7f9e0c007a80).ready entity=mon.2 client_cookie=c05706c9a1a46887 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:40.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/3706864786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e2414aa70 0x7f9e240648c0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f9e24063c70 tx=0x7f9e0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:40.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e227fc700 1 -- 172.21.15.63:0/3706864786 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0c011500 con 0x7f9e2414aa70 2020-05-18T21:32:40.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/3706864786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e2414aa70 0x7f9e240648c0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f9e24063c70 tx=0x7f9e0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:40.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e227fc700 1 -- 172.21.15.63:0/3706864786 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0c011660 con 0x7f9e2414aa70 2020-05-18T21:32:40.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/3706864786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e2414aa70 0x7f9e240648c0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f9e24063c70 tx=0x7f9e0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:40.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e227fc700 1 -- 172.21.15.63:0/3706864786 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0c011a80 con 0x7f9e2414aa70 2020-05-18T21:32:40.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e28c80700 1 -- 172.21.15.63:0/3706864786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e2414aa70 msgr2=0x7f9e240648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:40.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e28c80700 1 --2- 172.21.15.63:0/3706864786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e2414aa70 0x7f9e240648c0 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f9e24063c70 tx=0x7f9e0c007a80).stop 2020-05-18T21:32:40.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e28c80700 1 -- 172.21.15.63:0/3706864786 shutdown_connections 2020-05-18T21:32:40.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e28c80700 1 --2- 172.21.15.63:0/3706864786 >> v2:172.21.15.63:3300/0 conn(0x7f9e24064d20 0x7f9e2414d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:40.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e28c80700 1 --2- 172.21.15.63:0/3706864786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e2414aa70 0x7f9e240648c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:40.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e28c80700 1 --2- 172.21.15.63:0/3706864786 >> v2:172.21.15.155:3300/0 conn(0x7f9e2405f110 0x7f9e240b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:40.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e28c80700 1 -- 172.21.15.63:0/3706864786 >> 172.21.15.63:0/3706864786 conn(0x7f9e24069fc0 msgr2=0x7f9e2406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:40.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e28c80700 1 -- 172.21.15.63:0/3706864786 shutdown_connections 2020-05-18T21:32:40.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.817+0000 7f9e28c80700 1 -- 172.21.15.63:0/3706864786 wait complete. 2020-05-18T21:32:40.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.821+0000 7f9e28c80700 1 Processor -- start 2020-05-18T21:32:40.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.821+0000 7f9e28c80700 1 -- start start 2020-05-18T21:32:40.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.821+0000 7f9e28c80700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9e24064d20 0x7f9e24132910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:40.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.821+0000 7f9e28c80700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e2414aa70 0x7f9e241410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:40.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.821+0000 7f9e28c80700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e24133030 con 0x7f9e2405f110 2020-05-18T21:32:40.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.821+0000 7f9e28c80700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e24133290 con 0x7f9e24064d20 2020-05-18T21:32:40.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.821+0000 7f9e28c80700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e24133530 con 0x7f9e2414aa70 2020-05-18T21:32:40.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e22ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9e24064d20 0x7f9e24132910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:40.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e237fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9e2405f110 0x7f9e24149600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33124/0 (socket says 172.21.15.63:33124) 2020-05-18T21:32:40.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e22ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9e24064d20 0x7f9e24132910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59170/0 (socket says 172.21.15.63:59170) 2020-05-18T21:32:40.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e237fe700 1 -- 172.21.15.63:0/4110520615 learned_addr learned my addr 172.21.15.63:0/4110520615 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:40.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e23fff700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e2414aa70 0x7f9e241410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:40.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e22ffd700 1 -- 172.21.15.63:0/4110520615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e2414aa70 msgr2=0x7f9e241410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:40.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e2414aa70 0x7f9e241410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:40.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e20ff9700 1 -- 172.21.15.63:0/4110520615 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866113515 0 0) 0x7f9e24133030 con 0x7f9e2405f110 2020-05-18T21:32:40.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e22ffd700 1 -- 172.21.15.63:0/4110520615 >> v1:172.21.15.63:6789/0 conn(0x7f9e2405f110 legacy=0x7f9e24149600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:40.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e22ffd700 1 -- 172.21.15.63:0/4110520615 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e24149d10 con 0x7f9e24064d20 2020-05-18T21:32:40.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/4110520615 >> v2:172.21.15.63:3300/0 conn(0x7f9e24064d20 0x7f9e24132910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9e24063c70 tx=0x7f9e0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:40.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/4110520615 >> v2:172.21.15.63:3300/0 conn(0x7f9e24064d20 0x7f9e24132910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9e24063c70 tx=0x7f9e0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:40.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24064d20 0x7f9e24132910 secure :-1 s=READY pgs=1198 cs=0 l=1 rx=0x7f9e24063c70 tx=0x7f9e0c007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:40.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24064d20 0x7f9e24132910 secure :-1 s=THROTTLE_DONE pgs=1198 cs=0 l=1 rx=0x7f9e24063c70 tx=0x7f9e0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:40.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e20ff9700 1 -- 172.21.15.63:0/4110520615 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0c011b70 con 0x7f9e24064d20 2020-05-18T21:32:40.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24064d20 0x7f9e24132910 secure :-1 s=THROTTLE_DONE pgs=1198 cs=0 l=1 rx=0x7f9e24063c70 tx=0x7f9e0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:40.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24064d20 0x7f9e24132910 secure :-1 s=THROTTLE_DONE pgs=1198 cs=0 l=1 rx=0x7f9e24063c70 tx=0x7f9e0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:40.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e20ff9700 1 -- 172.21.15.63:0/4110520615 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0c007170 con 0x7f9e24064d20 2020-05-18T21:32:40.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e28c80700 1 -- 172.21.15.63:0/4110520615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e24132d70 con 0x7f9e24064d20 2020-05-18T21:32:40.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e20ff9700 1 -- 172.21.15.63:0/4110520615 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0c007510 con 0x7f9e24064d20 2020-05-18T21:32:40.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e28c80700 1 -- 172.21.15.63:0/4110520615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e24141510 con 0x7f9e24064d20 2020-05-18T21:32:40.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24064d20 0x7f9e24132910 secure :-1 s=THROTTLE_DONE pgs=1198 cs=0 l=1 rx=0x7f9e24063c70 tx=0x7f9e0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:40.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.825+0000 7f9e28c80700 1 -- 172.21.15.63:0/4110520615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e240569e0 con 0x7f9e24064d20 2020-05-18T21:32:40.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.829+0000 7f9e20ff9700 1 -- 172.21.15.63:0/4110520615 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9e0c0080e0 con 0x7f9e24064d20 2020-05-18T21:32:40.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.829+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24064d20 0x7f9e24132910 secure :-1 s=THROTTLE_DONE pgs=1198 cs=0 l=1 rx=0x7f9e24063c70 tx=0x7f9e0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:40.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.829+0000 7f9e20ff9700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9dfc04f8f0 0x7f9dfc051db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:40.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.829+0000 7f9e20ff9700 1 -- 172.21.15.63:0/4110520615 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f9e0c064620 con 0x7f9e24064d20 2020-05-18T21:32:40.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.829+0000 7f9e237fe700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9dfc04f8f0 0x7f9dfc051db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:40.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.829+0000 7f9e237fe700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9dfc04f8f0 0x7f9dfc051db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9e14007e00 tx=0x7f9e14009470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:40.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.829+0000 7f9e237fe700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9dfc04f8f0 0x7f9dfc051db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9e14007e00 tx=0x7f9e14009470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:40.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.829+0000 7f9e237fe700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9dfc04f8f0 0x7f9dfc051db0 secure :-1 s=READY pgs=473 cs=0 l=1 rx=0x7f9e14007e00 tx=0x7f9e14009470).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:40.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.837+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24064d20 0x7f9e24132910 secure :-1 s=THROTTLE_DONE pgs=1198 cs=0 l=1 rx=0x7f9e24063c70 tx=0x7f9e0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:40.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.837+0000 7f9e20ff9700 1 -- 172.21.15.63:0/4110520615 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9e0c03ea10 con 0x7f9e24064d20 2020-05-18T21:32:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.989+0000 7f9e28c80700 1 -- 172.21.15.63:0/4110520615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e241336a0 con 0x7f9e24064d20 2020-05-18T21:32:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.989+0000 7f9e22ffd700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24064d20 0x7f9e24132910 secure :-1 s=THROTTLE_DONE pgs=1198 cs=0 l=1 rx=0x7f9e24063c70 tx=0x7f9e0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.989+0000 7f9e20ff9700 1 -- 172.21.15.63:0/4110520615 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+1787 (secure 0 0 0) 0x7f9e0c042030 con 0x7f9e24064d20 2020-05-18T21:32:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.989+0000 7f9e28c80700 1 -- 172.21.15.63:0/4110520615 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9dfc04f8f0 msgr2=0x7f9dfc051db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.989+0000 7f9e28c80700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9dfc04f8f0 0x7f9dfc051db0 secure :-1 s=READY pgs=473 cs=0 l=1 rx=0x7f9e14007e00 tx=0x7f9e14009470).stop 2020-05-18T21:32:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.989+0000 7f9e28c80700 1 -- 172.21.15.63:0/4110520615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24064d20 msgr2=0x7f9e24132910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:40.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.989+0000 7f9e28c80700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24064d20 0x7f9e24132910 secure :-1 s=READY pgs=1198 cs=0 l=1 rx=0x7f9e24063c70 tx=0x7f9e0c007a80).stop 2020-05-18T21:32:40.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.989+0000 7f9e28c80700 1 -- 172.21.15.63:0/4110520615 shutdown_connections 2020-05-18T21:32:40.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.989+0000 7f9e28c80700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9dfc04f8f0 0x7f9dfc051db0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:40.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.989+0000 7f9e28c80700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e2414aa70 0x7f9e241410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.989+0000 7f9e28c80700 1 --2- 172.21.15.63:0/4110520615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24064d20 0x7f9e24132910 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.989+0000 7f9e28c80700 1 -- 172.21.15.63:0/4110520615 >> 172.21.15.63:0/4110520615 conn(0x7f9e24069fc0 msgr2=0x7f9e240b4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.989+0000 7f9e28c80700 1 -- 172.21.15.63:0/4110520615 shutdown_connections 2020-05-18T21:32:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:40.989+0000 7f9e28c80700 1 -- 172.21.15.63:0/4110520615 wait complete. 2020-05-18T21:32:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 68 2020-05-18T21:32:41.001 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:41.001 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:40.680007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7500},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:41.206 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:31:30.209891+0000', 'modified': '2020-05-18T21:32:40.680007+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7500}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_7500': {'gid': 7500, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.63:6833/695559165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 695559165}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 695559165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:41.207 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:32:41.208 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:32:41.316 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:32:41.316 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:32:41.316 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:32:41.317 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 7500, 2020-05-18T21:32:41.317 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:32:41.317 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:32:41.317 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 36.641877383000001, 2020-05-18T21:32:41.317 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 68, 2020-05-18T21:32:41.318 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 86, 2020-05-18T21:32:41.318 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 86, 2020-05-18T21:32:41.318 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 41.543215596000003 2020-05-18T21:32:41.318 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:32:41.325 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 7500, "want_state": "up:active", "state": "up:active", "rank_uptime": 36.641877383000001, "mdsmap_epoch": 68, "osdmap_epoch": 86, "osdmap_epoch_barrier": 86, "uptime": 41.543215596000003 } 2020-05-18T21:32:41.326 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_created 2020-05-18T21:32:41.423 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:32:41.423 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:32:41.423 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_created": 1 2020-05-18T21:32:41.424 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:41.424 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:32:41.431 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_created": 1 } } 2020-05-18T21:32:41.432 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:32:41.432 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:32:41.452 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:32:41.469 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:32:41.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:41.471 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:32:41.500 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-05-18T21:32:41.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:32:41.502 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:32:41.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:41.503 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:32:41.510 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:32:41.510 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:32:41.511 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:32:41.511 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:41.511 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:32:41.511 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:41.511 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:41.512 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:41.512 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:41.512 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:41.512 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:41.512 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:41.513 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:32:41.513 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:41.513 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:32:41.513 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42481sec preferred_lft 42481sec 2020-05-18T21:32:41.513 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:32:41.514 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:41.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:41.514 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:32:41.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:41.522 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:32:41.568 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-05-18T21:32:41.569 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:32:41.570 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-05-18T21:32:41.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:41.571 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:32:41.579 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:32:41.579 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:32:41.579 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:32:41.580 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:41.580 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:32:41.580 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:41.580 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:41.580 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:41.581 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:41.581 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:41.581 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:41.581 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:41.582 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:32:41.582 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:41.582 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:32:41.582 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42481sec preferred_lft 42481sec 2020-05-18T21:32:41.583 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:32:41.583 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:41.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:41.584 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:32:41.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:41.592 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:32:41.598 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2020-05-18T21:32:41.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:32:41.600 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-05-18T21:32:41.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:41.601 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:32:41.651 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:32:41.652 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:32:41.652 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:32:41.652 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:41.652 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:32:41.653 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:41.653 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:41.653 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:41.653 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:41.653 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:41.654 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:41.654 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:41.654 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:32:41.654 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:41.654 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:32:41.655 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42485sec preferred_lft 42485sec 2020-05-18T21:32:41.655 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:32:41.655 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:41.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:41.656 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:32:41.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:41.665 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:32:41.715 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2020-05-18T21:32:41.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:32:41.717 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-05-18T21:32:41.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:41.718 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:32:41.724 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:32:41.724 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:32:41.724 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:32:41.724 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:41.725 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:32:41.725 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:41.725 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:41.725 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:41.725 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:41.726 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:41.726 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:41.726 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:41.726 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:32:41.726 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:41.727 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:32:41.727 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42485sec preferred_lft 42485sec 2020-05-18T21:32:41.727 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:32:41.727 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:41.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:41.728 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:32:41.734 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_strays.TestStrays.test_migration_on_shutdown' 2020-05-18T21:32:41.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56ca96700 1 Processor -- start 2020-05-18T21:32:41.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56ca96700 1 -- start start 2020-05-18T21:32:41.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56ca96700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc568147ab0 0x7fc5680614c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:41.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56ca96700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5680ad9d0 con 0x7fc568060850 2020-05-18T21:32:41.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56ca96700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5680adc70 con 0x7fc56814aeb0 2020-05-18T21:32:41.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56ca96700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc568147e90 con 0x7fc568147ab0 2020-05-18T21:32:41.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc566d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc568060850 0x7fc56814b640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33132/0 (socket says 172.21.15.63:33132) 2020-05-18T21:32:41.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc566d9d700 1 -- 172.21.15.63:0/2807588895 learned_addr learned my addr 172.21.15.63:0/2807588895 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:41.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56659c700 1 --2- 172.21.15.63:0/2807588895 >> v2:172.21.15.155:3300/0 conn(0x7fc568147ab0 0x7fc5680614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:41.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56559a700 1 -- 172.21.15.63:0/2807588895 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576728913 0 0) 0x7fc5680ad9d0 con 0x7fc568060850 2020-05-18T21:32:41.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56559a700 1 -- 172.21.15.63:0/2807588895 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc54c003270 con 0x7fc568060850 2020-05-18T21:32:41.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56659c700 1 -- 172.21.15.63:0/2807588895 >> v1:172.21.15.155:6789/0 conn(0x7fc56814aeb0 legacy=0x7fc5680ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:41.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56659c700 1 -- 172.21.15.63:0/2807588895 >> v1:172.21.15.63:6789/0 conn(0x7fc568060850 legacy=0x7fc56814b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:41.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56659c700 1 -- 172.21.15.63:0/2807588895 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5680ae820 con 0x7fc568147ab0 2020-05-18T21:32:41.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56659c700 1 --2- 172.21.15.63:0/2807588895 >> v2:172.21.15.155:3300/0 conn(0x7fc568147ab0 0x7fc5680614c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc5580032f0 tx=0x7fc558007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:41.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56659c700 1 --2- 172.21.15.63:0/2807588895 >> v2:172.21.15.155:3300/0 conn(0x7fc568147ab0 0x7fc5680614c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc5580032f0 tx=0x7fc558007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:41.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56659c700 1 --2- 172.21.15.63:0/2807588895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc568147ab0 0x7fc5680614c0 secure :-1 s=READY pgs=825 cs=0 l=1 rx=0x7fc5580032f0 tx=0x7fc558007e00).ready entity=mon.1 client_cookie=cecaeb379d08c926 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:41.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56659c700 1 --2- 172.21.15.63:0/2807588895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc568147ab0 0x7fc5680614c0 secure :-1 s=THROTTLE_DONE pgs=825 cs=0 l=1 rx=0x7fc5580032f0 tx=0x7fc558007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:41.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56559a700 1 -- 172.21.15.63:0/2807588895 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc558011e60 con 0x7fc568147ab0 2020-05-18T21:32:41.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56659c700 1 --2- 172.21.15.63:0/2807588895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc568147ab0 0x7fc5680614c0 secure :-1 s=THROTTLE_DONE pgs=825 cs=0 l=1 rx=0x7fc5580032f0 tx=0x7fc558007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:41.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56659c700 1 --2- 172.21.15.63:0/2807588895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc568147ab0 0x7fc5680614c0 secure :-1 s=THROTTLE_DONE pgs=825 cs=0 l=1 rx=0x7fc5580032f0 tx=0x7fc558007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:41.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56559a700 1 -- 172.21.15.63:0/2807588895 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55800a180 con 0x7fc568147ab0 2020-05-18T21:32:41.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56559a700 1 -- 172.21.15.63:0/2807588895 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc55800a520 con 0x7fc568147ab0 2020-05-18T21:32:41.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56ca96700 1 -- 172.21.15.63:0/2807588895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc568147ab0 msgr2=0x7fc5680614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:41.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.841+0000 7fc56ca96700 1 --2- 172.21.15.63:0/2807588895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc568147ab0 0x7fc5680614c0 secure :-1 s=READY pgs=825 cs=0 l=1 rx=0x7fc5580032f0 tx=0x7fc558007e00).stop 2020-05-18T21:32:41.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.845+0000 7fc56ca96700 1 -- 172.21.15.63:0/2807588895 shutdown_connections 2020-05-18T21:32:41.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.845+0000 7fc56ca96700 1 --2- 172.21.15.63:0/2807588895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc568147ab0 0x7fc5680614c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:41.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.845+0000 7fc56ca96700 1 -- 172.21.15.63:0/2807588895 >> 172.21.15.63:0/2807588895 conn(0x7fc568069b70 msgr2=0x7fc568069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:41.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.845+0000 7fc56ca96700 1 -- 172.21.15.63:0/2807588895 shutdown_connections 2020-05-18T21:32:41.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.845+0000 7fc56ca96700 1 -- 172.21.15.63:0/2807588895 wait complete. 2020-05-18T21:32:41.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.845+0000 7fc56ca96700 1 Processor -- start 2020-05-18T21:32:41.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.845+0000 7fc56ca96700 1 -- start start 2020-05-18T21:32:41.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc56ca96700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc568060850 0x7fc568158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:41.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc56ca96700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5680b80f0 con 0x7fc56814aeb0 2020-05-18T21:32:41.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc56ca96700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5680b8390 con 0x7fc568147ab0 2020-05-18T21:32:41.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc56ca96700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5680b8630 con 0x7fc568060850 2020-05-18T21:32:41.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc566d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc56814aeb0 0x7fc568160cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33140/0 (socket says 172.21.15.63:33140) 2020-05-18T21:32:41.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc566d9d700 1 -- 172.21.15.63:0/614209897 learned_addr learned my addr 172.21.15.63:0/614209897 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:41.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc56659c700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc568060850 0x7fc568158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:41.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc55f7fe700 1 -- 172.21.15.63:0/614209897 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 951824826 0 0) 0x7fc5680b80f0 con 0x7fc56814aeb0 2020-05-18T21:32:41.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc55f7fe700 1 -- 172.21.15.63:0/614209897 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc540002fe0 con 0x7fc56814aeb0 2020-05-18T21:32:41.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc55f7fe700 1 -- 172.21.15.63:0/614209897 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529565489 0 0) 0x7fc5680b8390 con 0x7fc568147ab0 2020-05-18T21:32:41.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc55f7fe700 1 -- 172.21.15.63:0/614209897 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5680b80f0 con 0x7fc568147ab0 2020-05-18T21:32:41.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc56659c700 1 -- 172.21.15.63:0/614209897 >> v1:172.21.15.155:6789/0 conn(0x7fc568147ab0 legacy=0x7fc5680af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:41.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc56659c700 1 -- 172.21.15.63:0/614209897 >> v1:172.21.15.63:6789/0 conn(0x7fc56814aeb0 legacy=0x7fc568160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:41.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc56659c700 1 -- 172.21.15.63:0/614209897 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5680b8ad0 con 0x7fc568060850 2020-05-18T21:32:41.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc56659c700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc568060850 0x7fc568158310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc5580032f0 tx=0x7fc558007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:41.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc56659c700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc568060850 0x7fc568158310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc5580032f0 tx=0x7fc558007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:41.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc56659c700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc568060850 0x7fc568158310 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7fc5580032f0 tx=0x7fc558007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:41.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc56659c700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc568060850 0x7fc568158310 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fc5580032f0 tx=0x7fc558007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:41.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc55f7fe700 1 -- 172.21.15.63:0/614209897 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc558005c70 con 0x7fc568060850 2020-05-18T21:32:41.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc56659c700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc568060850 0x7fc568158310 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fc5580032f0 tx=0x7fc558007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:41.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc56ca96700 1 -- 172.21.15.63:0/614209897 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc568157920 con 0x7fc568060850 2020-05-18T21:32:41.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc55f7fe700 1 -- 172.21.15.63:0/614209897 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc558005dd0 con 0x7fc568060850 2020-05-18T21:32:41.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc56659c700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc568060850 0x7fc568158310 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fc5580032f0 tx=0x7fc558007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:41.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc55f7fe700 1 -- 172.21.15.63:0/614209897 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc558007360 con 0x7fc568060850 2020-05-18T21:32:41.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.849+0000 7fc56ca96700 1 -- 172.21.15.63:0/614209897 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5680b7e30 con 0x7fc568060850 2020-05-18T21:32:41.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.853+0000 7fc56659c700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc568060850 0x7fc568158310 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fc5580032f0 tx=0x7fc558007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:41.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.853+0000 7fc56ca96700 1 -- 172.21.15.63:0/614209897 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5680569e0 con 0x7fc568060850 2020-05-18T21:32:41.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.853+0000 7fc55f7fe700 1 -- 172.21.15.63:0/614209897 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc558007560 con 0x7fc568060850 2020-05-18T21:32:41.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.853+0000 7fc56659c700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc568060850 0x7fc568158310 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fc5580032f0 tx=0x7fc558007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:41.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.853+0000 7fc55f7fe700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54004fe80 0x7fc540052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:41.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.853+0000 7fc55f7fe700 1 -- 172.21.15.63:0/614209897 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fc558064ab0 con 0x7fc568060850 2020-05-18T21:32:41.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.853+0000 7fc565d9b700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54004fe80 0x7fc540052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:41.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.853+0000 7fc565d9b700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54004fe80 0x7fc540052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc550001020 tx=0x7fc5500027f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:41.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.853+0000 7fc565d9b700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54004fe80 0x7fc540052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc550001020 tx=0x7fc5500027f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:41.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.853+0000 7fc565d9b700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54004fe80 0x7fc540052340 secure :-1 s=READY pgs=475 cs=0 l=1 rx=0x7fc550001020 tx=0x7fc5500027f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:41.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.861+0000 7fc56659c700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc568060850 0x7fc568158310 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fc5580032f0 tx=0x7fc558007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:41.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:41.861+0000 7fc55f7fe700 1 -- 172.21.15.63:0/614209897 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc55803ef60 con 0x7fc568060850 2020-05-18T21:32:42.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.017+0000 7fc56ca96700 1 -- 172.21.15.63:0/614209897 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_migration_on_shutdown"]} v 0) v1 -- 0x7fc5680b8830 con 0x7fc568060850 2020-05-18T21:32:42.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.705+0000 7fc56659c700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc568060850 0x7fc568158310 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fc5580032f0 tx=0x7fc558007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:42.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.705+0000 7fc55f7fe700 1 -- 172.21.15.63:0/614209897 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_migration_on_shutdown"]}]=0 v298) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc558042580 con 0x7fc568060850 2020-05-18T21:32:42.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.709+0000 7fc56ca96700 1 -- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54004fe80 msgr2=0x7fc540052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:42.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.709+0000 7fc56ca96700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54004fe80 0x7fc540052340 secure :-1 s=READY pgs=475 cs=0 l=1 rx=0x7fc550001020 tx=0x7fc5500027f0).stop 2020-05-18T21:32:42.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.709+0000 7fc56ca96700 1 -- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc568060850 msgr2=0x7fc568158310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:42.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.709+0000 7fc56ca96700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc568060850 0x7fc568158310 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7fc5580032f0 tx=0x7fc558007e00).stop 2020-05-18T21:32:42.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.709+0000 7fc56ca96700 1 -- 172.21.15.63:0/614209897 shutdown_connections 2020-05-18T21:32:42.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.709+0000 7fc56ca96700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54004fe80 0x7fc540052340 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:42.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.709+0000 7fc56ca96700 1 --2- 172.21.15.63:0/614209897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc568060850 0x7fc568158310 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:42.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.709+0000 7fc56ca96700 1 -- 172.21.15.63:0/614209897 >> 172.21.15.63:0/614209897 conn(0x7fc568069b70 msgr2=0x7fc568146700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:42.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.709+0000 7fc56ca96700 1 -- 172.21.15.63:0/614209897 shutdown_connections 2020-05-18T21:32:42.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.709+0000 7fc56ca96700 1 -- 172.21.15.63:0/614209897 wait complete. 2020-05-18T21:32:42.730 INFO:tasks.cephfs_test_runner:test_migration_on_shutdown (tasks.cephfs.test_strays.TestStrays) ... ok 2020-05-18T21:32:42.731 INFO:tasks.cephfs_test_runner:Starting test: test_mv_cleanup (tasks.cephfs.test_strays.TestStrays) 2020-05-18T21:32:42.732 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_strays.TestStrays.test_mv_cleanup' 2020-05-18T21:32:42.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f791eb14700 1 Processor -- start 2020-05-18T21:32:42.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f791eb14700 1 -- start start 2020-05-18T21:32:42.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f791eb14700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f79180b2860 0x7f79180615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:42.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f791eb14700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791814d960 con 0x7f791814e570 2020-05-18T21:32:42.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f791eb14700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791814db90 con 0x7f7918060b90 2020-05-18T21:32:42.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f791eb14700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7918066210 con 0x7f79180b2860 2020-05-18T21:32:42.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f791d0b1700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f791814e570 0x7f791814a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33146/0 (socket says 172.21.15.63:33146) 2020-05-18T21:32:42.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f791d0b1700 1 -- 172.21.15.63:0/2033468418 learned_addr learned my addr 172.21.15.63:0/2033468418 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:42.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f7917fff700 1 --2- 172.21.15.63:0/2033468418 >> v2:172.21.15.155:3300/0 conn(0x7f79180b2860 0x7f79180615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:42.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f79177fe700 1 -- 172.21.15.63:0/2033468418 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872893045 0 0) 0x7f791814d960 con 0x7f791814e570 2020-05-18T21:32:42.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f79177fe700 1 -- 172.21.15.63:0/2033468418 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78f8003270 con 0x7f791814e570 2020-05-18T21:32:42.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f7917fff700 1 -- 172.21.15.63:0/2033468418 >> v1:172.21.15.155:6789/0 conn(0x7f7918060b90 legacy=0x7f7918144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:42.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f7917fff700 1 -- 172.21.15.63:0/2033468418 >> v1:172.21.15.63:6789/0 conn(0x7f791814e570 legacy=0x7f791814a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:42.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f7917fff700 1 -- 172.21.15.63:0/2033468418 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791814de30 con 0x7f79180b2860 2020-05-18T21:32:42.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f7917fff700 1 --2- 172.21.15.63:0/2033468418 >> v2:172.21.15.155:3300/0 conn(0x7f79180b2860 0x7f79180615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7908002f70 tx=0x7f7908007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:42.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f7917fff700 1 --2- 172.21.15.63:0/2033468418 >> v2:172.21.15.155:3300/0 conn(0x7f79180b2860 0x7f79180615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7908002f70 tx=0x7f7908007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:42.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f7917fff700 1 --2- 172.21.15.63:0/2033468418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79180b2860 0x7f79180615e0 secure :-1 s=READY pgs=828 cs=0 l=1 rx=0x7f7908002f70 tx=0x7f7908007a80).ready entity=mon.1 client_cookie=e78a8a8d52f5f365 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:42.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f7917fff700 1 --2- 172.21.15.63:0/2033468418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79180b2860 0x7f79180615e0 secure :-1 s=THROTTLE_DONE pgs=828 cs=0 l=1 rx=0x7f7908002f70 tx=0x7f7908007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:42.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f79177fe700 1 -- 172.21.15.63:0/2033468418 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7908008e80 con 0x7f79180b2860 2020-05-18T21:32:42.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f7917fff700 1 --2- 172.21.15.63:0/2033468418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79180b2860 0x7f79180615e0 secure :-1 s=THROTTLE_DONE pgs=828 cs=0 l=1 rx=0x7f7908002f70 tx=0x7f7908007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:42.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f7917fff700 1 --2- 172.21.15.63:0/2033468418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79180b2860 0x7f79180615e0 secure :-1 s=THROTTLE_DONE pgs=828 cs=0 l=1 rx=0x7f7908002f70 tx=0x7f7908007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:42.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f79177fe700 1 -- 172.21.15.63:0/2033468418 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79080115f0 con 0x7f79180b2860 2020-05-18T21:32:42.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f79177fe700 1 -- 172.21.15.63:0/2033468418 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79080119d0 con 0x7f79180b2860 2020-05-18T21:32:42.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f791eb14700 1 -- 172.21.15.63:0/2033468418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79180b2860 msgr2=0x7f79180615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:42.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.841+0000 7f791eb14700 1 --2- 172.21.15.63:0/2033468418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79180b2860 0x7f79180615e0 secure :-1 s=READY pgs=828 cs=0 l=1 rx=0x7f7908002f70 tx=0x7f7908007a80).stop 2020-05-18T21:32:42.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.845+0000 7f791eb14700 1 -- 172.21.15.63:0/2033468418 shutdown_connections 2020-05-18T21:32:42.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.845+0000 7f791eb14700 1 --2- 172.21.15.63:0/2033468418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79180b2860 0x7f79180615e0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:42.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.845+0000 7f791eb14700 1 -- 172.21.15.63:0/2033468418 >> 172.21.15.63:0/2033468418 conn(0x7f79180b83d0 msgr2=0x7f79180b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:42.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.845+0000 7f791eb14700 1 -- 172.21.15.63:0/2033468418 shutdown_connections 2020-05-18T21:32:42.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.845+0000 7f791eb14700 1 -- 172.21.15.63:0/2033468418 wait complete. 2020-05-18T21:32:42.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.845+0000 7f791eb14700 1 Processor -- start 2020-05-18T21:32:42.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.845+0000 7f791eb14700 1 -- start start 2020-05-18T21:32:42.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.845+0000 7f791eb14700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f791814e570 0x7f7918149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:42.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.845+0000 7f791eb14700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791815b0f0 con 0x7f7918060b90 2020-05-18T21:32:42.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.845+0000 7f791eb14700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791815b390 con 0x7f79180b2860 2020-05-18T21:32:42.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.845+0000 7f791eb14700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791815b630 con 0x7f791814e570 2020-05-18T21:32:42.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.845+0000 7f791d0b1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f791814e570 0x7f7918149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:42.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.845+0000 7f791d0b1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f791814e570 0x7f7918149310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59196/0 (socket says 172.21.15.63:59196) 2020-05-18T21:32:42.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.845+0000 7f791d0b1700 1 -- 172.21.15.63:0/461706880 learned_addr learned my addr 172.21.15.63:0/461706880 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:42.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f7915ffb700 1 -- 172.21.15.63:0/461706880 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654911150 0 0) 0x7f791815b390 con 0x7f79180b2860 2020-05-18T21:32:42.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f7915ffb700 1 -- 172.21.15.63:0/461706880 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78fc002fe0 con 0x7f79180b2860 2020-05-18T21:32:42.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f791d0b1700 1 -- 172.21.15.63:0/461706880 >> v1:172.21.15.155:6789/0 conn(0x7f79180b2860 legacy=0x7f79180acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:42.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f791d0b1700 1 -- 172.21.15.63:0/461706880 >> v1:172.21.15.63:6789/0 conn(0x7f7918060b90 legacy=0x7f79181351b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:42.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f791d0b1700 1 -- 172.21.15.63:0/461706880 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79181358c0 con 0x7f791814e570 2020-05-18T21:32:42.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f791d0b1700 1 --2- 172.21.15.63:0/461706880 >> v2:172.21.15.63:3300/0 conn(0x7f791814e570 0x7f7918149310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7910001490 tx=0x7f7910010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:42.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f791d0b1700 1 --2- 172.21.15.63:0/461706880 >> v2:172.21.15.63:3300/0 conn(0x7f791814e570 0x7f7918149310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7910001490 tx=0x7f7910010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:42.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f791d0b1700 1 --2- 172.21.15.63:0/461706880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f791814e570 0x7f7918149310 secure :-1 s=READY pgs=1203 cs=0 l=1 rx=0x7f7910001490 tx=0x7f7910010cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:42.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f791d0b1700 1 --2- 172.21.15.63:0/461706880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f791814e570 0x7f7918149310 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7f7910001490 tx=0x7f7910010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:42.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f791d0b1700 1 --2- 172.21.15.63:0/461706880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f791814e570 0x7f7918149310 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7f7910001490 tx=0x7f7910010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:42.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f7915ffb700 1 -- 172.21.15.63:0/461706880 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7910012570 con 0x7f791814e570 2020-05-18T21:32:42.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f791d0b1700 1 --2- 172.21.15.63:0/461706880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f791814e570 0x7f7918149310 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7f7910001490 tx=0x7f7910010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:42.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f7915ffb700 1 -- 172.21.15.63:0/461706880 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79100126d0 con 0x7f791814e570 2020-05-18T21:32:42.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f791eb14700 1 -- 172.21.15.63:0/461706880 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7918135b70 con 0x7f791814e570 2020-05-18T21:32:42.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f7915ffb700 1 -- 172.21.15.63:0/461706880 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7910012ab0 con 0x7f791814e570 2020-05-18T21:32:42.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f791eb14700 1 -- 172.21.15.63:0/461706880 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791815bcf0 con 0x7f791814e570 2020-05-18T21:32:42.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f791d0b1700 1 --2- 172.21.15.63:0/461706880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f791814e570 0x7f7918149310 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7f7910001490 tx=0x7f7910010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:42.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f791eb14700 1 -- 172.21.15.63:0/461706880 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79180569e0 con 0x7f791814e570 2020-05-18T21:32:42.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f7915ffb700 1 -- 172.21.15.63:0/461706880 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7910012d20 con 0x7f791814e570 2020-05-18T21:32:42.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f791d0b1700 1 --2- 172.21.15.63:0/461706880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f791814e570 0x7f7918149310 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7f7910001490 tx=0x7f7910010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:42.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.849+0000 7f7915ffb700 1 --2- 172.21.15.63:0/461706880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78fc04fd40 0x7f78fc052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:42.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.853+0000 7f7915ffb700 1 -- 172.21.15.63:0/461706880 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f79100090c0 con 0x7f791814e570 2020-05-18T21:32:42.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.853+0000 7f791c8b0700 1 --2- 172.21.15.63:0/461706880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78fc04fd40 0x7f78fc052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:42.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.853+0000 7f791c8b0700 1 --2- 172.21.15.63:0/461706880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78fc04fd40 0x7f78fc052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79180b60c0 tx=0x7f79000025a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:42.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.853+0000 7f791c8b0700 1 --2- 172.21.15.63:0/461706880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78fc04fd40 0x7f78fc052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79180b60c0 tx=0x7f79000025a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:42.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.853+0000 7f791c8b0700 1 --2- 172.21.15.63:0/461706880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78fc04fd40 0x7f78fc052200 secure :-1 s=READY pgs=476 cs=0 l=1 rx=0x7f79180b60c0 tx=0x7f79000025a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:42.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.857+0000 7f791d0b1700 1 --2- 172.21.15.63:0/461706880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f791814e570 0x7f7918149310 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7f7910001490 tx=0x7f7910010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:42.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:42.857+0000 7f7915ffb700 1 -- 172.21.15.63:0/461706880 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f791003e820 con 0x7f791814e570 2020-05-18T21:32:43.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.013+0000 7f791eb14700 1 -- 172.21.15.63:0/461706880 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_mv_cleanup"]} v 0) v1 -- 0x7f791815b7a0 con 0x7f791814e570 2020-05-18T21:32:43.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.713+0000 7f791d0b1700 1 --2- 172.21.15.63:0/461706880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f791814e570 0x7f7918149310 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7f7910001490 tx=0x7f7910010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:43.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.713+0000 7f7915ffb700 1 -- 172.21.15.63:0/461706880 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_mv_cleanup"]}]=0 v299) v1 ==== 133+0+0 (secure 0 0 0) 0x7f7910041e40 con 0x7f791814e570 2020-05-18T21:32:43.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.717+0000 7f791eb14700 1 -- 172.21.15.63:0/461706880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78fc04fd40 msgr2=0x7f78fc052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:43.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.717+0000 7f791eb14700 1 --2- 172.21.15.63:0/461706880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78fc04fd40 0x7f78fc052200 secure :-1 s=READY pgs=476 cs=0 l=1 rx=0x7f79180b60c0 tx=0x7f79000025a0).stop 2020-05-18T21:32:43.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.717+0000 7f791eb14700 1 -- 172.21.15.63:0/461706880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f791814e570 msgr2=0x7f7918149310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:43.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.717+0000 7f791eb14700 1 --2- 172.21.15.63:0/461706880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f791814e570 0x7f7918149310 secure :-1 s=READY pgs=1203 cs=0 l=1 rx=0x7f7910001490 tx=0x7f7910010cb0).stop 2020-05-18T21:32:43.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.717+0000 7f791eb14700 1 -- 172.21.15.63:0/461706880 shutdown_connections 2020-05-18T21:32:43.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.717+0000 7f791eb14700 1 --2- 172.21.15.63:0/461706880 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78fc04fd40 0x7f78fc052200 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:43.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.717+0000 7f791eb14700 1 --2- 172.21.15.63:0/461706880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f791814e570 0x7f7918149310 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:43.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.717+0000 7f791eb14700 1 -- 172.21.15.63:0/461706880 >> 172.21.15.63:0/461706880 conn(0x7f79180b83d0 msgr2=0x7f79180b7790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:43.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.717+0000 7f791eb14700 1 -- 172.21.15.63:0/461706880 shutdown_connections 2020-05-18T21:32:43.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.717+0000 7f791eb14700 1 -- 172.21.15.63:0/461706880 wait complete. 2020-05-18T21:32:43.739 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:32:43.740 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:32:43.756 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:32:43.776 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:32:43.776 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-05-18T21:32:43.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.905+0000 7f0da3328700 1 Processor -- start 2020-05-18T21:32:43.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.905+0000 7f0da3328700 1 -- start start 2020-05-18T21:32:43.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da3328700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0d9c060b90 0x7f0d9c0b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:43.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da3328700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0d9c0b2d70 0x7f0d9c0b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:43.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da3328700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d9c147210 con 0x7f0d9c146c90 2020-05-18T21:32:43.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da3328700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d9c061d60 con 0x7f0d9c060b90 2020-05-18T21:32:43.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da3328700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d9c062000 con 0x7f0d9c0b2d70 2020-05-18T21:32:43.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da08c3700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0d9c146c90 0x7f0d9c0624a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33156/0 (socket says 172.21.15.63:33156) 2020-05-18T21:32:43.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da08c3700 1 -- 172.21.15.63:0/2229586759 learned_addr learned my addr 172.21.15.63:0/2229586759 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:43.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da10c4700 1 --2- 172.21.15.63:0/2229586759 >> v2:172.21.15.63:3300/0 conn(0x7f0d9c060b90 0x7f0d9c0b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:43.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da18c5700 1 --2- 172.21.15.63:0/2229586759 >> v2:172.21.15.155:3300/0 conn(0x7f0d9c0b2d70 0x7f0d9c0b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:43.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0d8bfff700 1 -- 172.21.15.63:0/2229586759 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758322127 0 0) 0x7f0d9c147210 con 0x7f0d9c146c90 2020-05-18T21:32:43.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0d8bfff700 1 -- 172.21.15.63:0/2229586759 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d84003270 con 0x7f0d9c146c90 2020-05-18T21:32:43.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da10c4700 1 -- 172.21.15.63:0/2229586759 >> v2:172.21.15.155:3300/0 conn(0x7f0d9c0b2d70 msgr2=0x7f0d9c0b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:43.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da10c4700 1 --2- 172.21.15.63:0/2229586759 >> v2:172.21.15.155:3300/0 conn(0x7f0d9c0b2d70 0x7f0d9c0b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:43.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da10c4700 1 -- 172.21.15.63:0/2229586759 >> v1:172.21.15.63:6789/0 conn(0x7f0d9c146c90 legacy=0x7f0d9c0624a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:43.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0d8bfff700 1 -- 172.21.15.63:0/2229586759 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2250813673 0 0) 0x7f0d84003270 con 0x7f0d9c146c90 2020-05-18T21:32:43.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da10c4700 1 -- 172.21.15.63:0/2229586759 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c060f70 con 0x7f0d9c060b90 2020-05-18T21:32:43.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da10c4700 1 --2- 172.21.15.63:0/2229586759 >> v2:172.21.15.63:3300/0 conn(0x7f0d9c060b90 0x7f0d9c0b3f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0d980018b0 tx=0x7f0d8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:43.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da10c4700 1 --2- 172.21.15.63:0/2229586759 >> v2:172.21.15.63:3300/0 conn(0x7f0d9c060b90 0x7f0d9c0b3f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0d980018b0 tx=0x7f0d8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:43.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da10c4700 1 --2- 172.21.15.63:0/2229586759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d9c060b90 0x7f0d9c0b3f70 secure :-1 s=READY pgs=1205 cs=0 l=1 rx=0x7f0d980018b0 tx=0x7f0d8c007a80).ready entity=mon.0 client_cookie=4cfaecf1a7c967de server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:43.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da10c4700 1 --2- 172.21.15.63:0/2229586759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d9c060b90 0x7f0d9c0b3f70 secure :-1 s=THROTTLE_DONE pgs=1205 cs=0 l=1 rx=0x7f0d980018b0 tx=0x7f0d8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:43.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0d8bfff700 1 -- 172.21.15.63:0/2229586759 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d98001710 con 0x7f0d9c060b90 2020-05-18T21:32:43.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da10c4700 1 --2- 172.21.15.63:0/2229586759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d9c060b90 0x7f0d9c0b3f70 secure :-1 s=THROTTLE_DONE pgs=1205 cs=0 l=1 rx=0x7f0d980018b0 tx=0x7f0d8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:43.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da10c4700 1 --2- 172.21.15.63:0/2229586759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d9c060b90 0x7f0d9c0b3f70 secure :-1 s=THROTTLE_DONE pgs=1205 cs=0 l=1 rx=0x7f0d980018b0 tx=0x7f0d8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:43.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0d8bfff700 1 -- 172.21.15.63:0/2229586759 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8c008b80 con 0x7f0d9c060b90 2020-05-18T21:32:43.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0d8bfff700 1 -- 172.21.15.63:0/2229586759 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d8c0113d0 con 0x7f0d9c060b90 2020-05-18T21:32:43.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da3328700 1 -- 172.21.15.63:0/2229586759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d9c060b90 msgr2=0x7f0d9c0b3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:43.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da3328700 1 --2- 172.21.15.63:0/2229586759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d9c060b90 0x7f0d9c0b3f70 secure :-1 s=READY pgs=1205 cs=0 l=1 rx=0x7f0d980018b0 tx=0x7f0d8c007a80).stop 2020-05-18T21:32:43.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da3328700 1 -- 172.21.15.63:0/2229586759 shutdown_connections 2020-05-18T21:32:43.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da3328700 1 --2- 172.21.15.63:0/2229586759 >> v2:172.21.15.155:3300/0 conn(0x7f0d9c0b2d70 0x7f0d9c0b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:43.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da3328700 1 --2- 172.21.15.63:0/2229586759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d9c060b90 0x7f0d9c0b3f70 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:43.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da3328700 1 -- 172.21.15.63:0/2229586759 >> 172.21.15.63:0/2229586759 conn(0x7f0d9c0b83d0 msgr2=0x7f0d9c0b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:43.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da3328700 1 -- 172.21.15.63:0/2229586759 shutdown_connections 2020-05-18T21:32:43.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.909+0000 7f0da3328700 1 -- 172.21.15.63:0/2229586759 wait complete. 2020-05-18T21:32:43.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da3328700 1 Processor -- start 2020-05-18T21:32:43.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da3328700 1 -- start start 2020-05-18T21:32:43.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da3328700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0d9c0b2d70 0x7f0d9c0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:43.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da3328700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0d9c146c90 0x7f0d9c154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:43.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da3328700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d9c142020 con 0x7f0d9c060b90 2020-05-18T21:32:43.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da3328700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d9c1422c0 con 0x7f0d9c0b2d70 2020-05-18T21:32:43.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da3328700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d9c142560 con 0x7f0d9c146c90 2020-05-18T21:32:43.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da08c3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0d9c0b2d70 0x7f0d9c0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:43.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da10c4700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f0d9c060b90 0x7f0d9c1544b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:59710/0 (socket says 172.21.15.63:59710) 2020-05-18T21:32:43.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da18c5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0d9c146c90 0x7f0d9c154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:43.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da08c3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0d9c0b2d70 0x7f0d9c0b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59208/0 (socket says 172.21.15.63:59208) 2020-05-18T21:32:43.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da10c4700 1 -- 172.21.15.63:0/1755568721 learned_addr learned my addr 172.21.15.63:0/1755568721 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:43.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da08c3700 1 -- 172.21.15.63:0/1755568721 >> v2:172.21.15.155:3300/0 conn(0x7f0d9c146c90 msgr2=0x7f0d9c154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:43.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da08c3700 1 --2- 172.21.15.63:0/1755568721 >> v2:172.21.15.155:3300/0 conn(0x7f0d9c146c90 0x7f0d9c154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:43.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da08c3700 1 -- 172.21.15.63:0/1755568721 >> v1:172.21.15.155:6789/0 conn(0x7f0d9c060b90 legacy=0x7f0d9c1544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:43.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da08c3700 1 -- 172.21.15.63:0/1755568721 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c142800 con 0x7f0d9c0b2d70 2020-05-18T21:32:43.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da08c3700 1 --2- 172.21.15.63:0/1755568721 >> v2:172.21.15.63:3300/0 conn(0x7f0d9c0b2d70 0x7f0d9c0b51b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0d98001970 tx=0x7f0d98010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:43.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da08c3700 1 --2- 172.21.15.63:0/1755568721 >> v2:172.21.15.63:3300/0 conn(0x7f0d9c0b2d70 0x7f0d9c0b51b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0d98001970 tx=0x7f0d98010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:43.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da08c3700 1 --2- 172.21.15.63:0/1755568721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d9c0b2d70 0x7f0d9c0b51b0 secure :-1 s=READY pgs=1206 cs=0 l=1 rx=0x7f0d98001970 tx=0x7f0d98010be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:43.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da08c3700 1 --2- 172.21.15.63:0/1755568721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d9c0b2d70 0x7f0d9c0b51b0 secure :-1 s=THROTTLE_DONE pgs=1206 cs=0 l=1 rx=0x7f0d98001970 tx=0x7f0d98010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:43.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da08c3700 1 --2- 172.21.15.63:0/1755568721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d9c0b2d70 0x7f0d9c0b51b0 secure :-1 s=THROTTLE_DONE pgs=1206 cs=0 l=1 rx=0x7f0d98001970 tx=0x7f0d98010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:43.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0d8a7fc700 1 -- 172.21.15.63:0/1755568721 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d9800c990 con 0x7f0d9c0b2d70 2020-05-18T21:32:43.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da08c3700 1 --2- 172.21.15.63:0/1755568721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d9c0b2d70 0x7f0d9c0b51b0 secure :-1 s=THROTTLE_DONE pgs=1206 cs=0 l=1 rx=0x7f0d98001970 tx=0x7f0d98010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:43.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0d8a7fc700 1 -- 172.21.15.63:0/1755568721 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9800caf0 con 0x7f0d9c0b2d70 2020-05-18T21:32:43.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da3328700 1 -- 172.21.15.63:0/1755568721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9c142ca0 con 0x7f0d9c0b2d70 2020-05-18T21:32:43.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0d8a7fc700 1 -- 172.21.15.63:0/1755568721 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d9800ce90 con 0x7f0d9c0b2d70 2020-05-18T21:32:43.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da3328700 1 -- 172.21.15.63:0/1755568721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9c0ace30 con 0x7f0d9c0b2d70 2020-05-18T21:32:43.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.913+0000 7f0da08c3700 1 --2- 172.21.15.63:0/1755568721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d9c0b2d70 0x7f0d9c0b51b0 secure :-1 s=THROTTLE_DONE pgs=1206 cs=0 l=1 rx=0x7f0d98001970 tx=0x7f0d98010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:43.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.917+0000 7f0da3328700 1 -- 172.21.15.63:0/1755568721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d9c0569e0 con 0x7f0d9c0b2d70 2020-05-18T21:32:43.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.917+0000 7f0d8a7fc700 1 -- 172.21.15.63:0/1755568721 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0d980125d0 con 0x7f0d9c0b2d70 2020-05-18T21:32:43.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.917+0000 7f0da08c3700 1 --2- 172.21.15.63:0/1755568721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d9c0b2d70 0x7f0d9c0b51b0 secure :-1 s=THROTTLE_DONE pgs=1206 cs=0 l=1 rx=0x7f0d98001970 tx=0x7f0d98010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:43.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.917+0000 7f0d8a7fc700 1 --2- 172.21.15.63:0/1755568721 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d7c04f9c0 0x7f0d7c051e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:43.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.917+0000 7f0d8a7fc700 1 -- 172.21.15.63:0/1755568721 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f0d98063c60 con 0x7f0d9c0b2d70 2020-05-18T21:32:43.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.917+0000 7f0da10c4700 1 --2- 172.21.15.63:0/1755568721 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d7c04f9c0 0x7f0d7c051e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:43.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.917+0000 7f0da10c4700 1 --2- 172.21.15.63:0/1755568721 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d7c04f9c0 0x7f0d7c051e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0d9c0b5b80 tx=0x7f0d8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:43.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.917+0000 7f0da10c4700 1 --2- 172.21.15.63:0/1755568721 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d7c04f9c0 0x7f0d7c051e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0d9c0b5b80 tx=0x7f0d8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:43.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.917+0000 7f0da10c4700 1 --2- 172.21.15.63:0/1755568721 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d7c04f9c0 0x7f0d7c051e80 secure :-1 s=READY pgs=477 cs=0 l=1 rx=0x7f0d9c0b5b80 tx=0x7f0d8c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:43.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.925+0000 7f0da08c3700 1 --2- 172.21.15.63:0/1755568721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d9c0b2d70 0x7f0d9c0b51b0 secure :-1 s=THROTTLE_DONE pgs=1206 cs=0 l=1 rx=0x7f0d98001970 tx=0x7f0d98010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:43.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:43.925+0000 7f0d8a7fc700 1 -- 172.21.15.63:0/1755568721 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f0d9803df90 con 0x7f0d9c0b2d70 2020-05-18T21:32:44.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.041+0000 7f0da3328700 1 -- 172.21.15.63:0/1755568721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0d9c0008d0 con 0x7f0d9c0b2d70 2020-05-18T21:32:44.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.045+0000 7f0da08c3700 1 --2- 172.21.15.63:0/1755568721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d9c0b2d70 0x7f0d9c0b51b0 secure :-1 s=THROTTLE_DONE pgs=1206 cs=0 l=1 rx=0x7f0d98001970 tx=0x7f0d98010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.045+0000 7f0d8a7fc700 1 -- 172.21.15.63:0/1755568721 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v86) v1 ==== 81+0+34001 (secure 0 0 0) 0x7f0d980415b0 con 0x7f0d9c0b2d70 2020-05-18T21:32:44.050 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:44.050 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:32:44.051 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 86, 2020-05-18T21:32:44.051 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:32:44.051 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2020-05-18T21:26:28.798650+0000", 2020-05-18T21:32:44.051 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2020-05-18T21:31:58.828986+0000", 2020-05-18T21:32:44.051 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:32:44.052 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:32:44.052 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-05-18T21:32:44.052 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5799936, 2020-05-18T21:32:44.052 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2020-05-18T21:32:44.052 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2020-05-18T21:32:44.053 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2020-05-18T21:32:44.053 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2020-05-18T21:32:44.053 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2020-05-18T21:32:44.053 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:32:44.053 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 4, 2020-05-18T21:32:44.060 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2020-05-18T21:32:44.060 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-05-18T21:32:44.060 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2020-05-18T21:32:44.060 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2020-05-18T21:32:44.061 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 16, 2020-05-18T21:32:44.061 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 8, 2020-05-18T21:32:44.061 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2020-05-18T21:32:44.061 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "jewel", 2020-05-18T21:32:44.061 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "pacific", 2020-05-18T21:32:44.062 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:32:44.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.062 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2020-05-18T21:32:44.062 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "device_health_metrics", 2020-05-18T21:32:44.062 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:33.080792+0000", 2020-05-18T21:32:44.063 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:32:44.063 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:32:44.063 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:32:44.063 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:32:44.063 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:32:44.064 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:32:44.064 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:32:44.064 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:32:44.064 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2020-05-18T21:32:44.064 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2020-05-18T21:32:44.064 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2020-05-18T21:32:44.065 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2020-05-18T21:32:44.065 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2020-05-18T21:32:44.065 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:32:44.065 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:32:44.065 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:32:44.066 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:32:44.066 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:32:44.066 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:32:44.066 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:32:44.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.067 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "15", 2020-05-18T21:32:44.067 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:32:44.067 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:32:44.067 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:32:44.067 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:32:44.067 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:32:44.068 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:32:44.068 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:32:44.068 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:32:44.068 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:32:44.068 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:32:44.072 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:32:44.072 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:32:44.072 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:32:44.073 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:32:44.074 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:32:44.074 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:32:44.074 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:32:44.074 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:32:44.074 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:32:44.075 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:32:44.075 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:32:44.075 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:32:44.075 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:32:44.075 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:32:44.075 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:32:44.076 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:32:44.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.076 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:32:44.076 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:32:44.076 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:32:44.077 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:32:44.077 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:32:44.077 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:32:44.077 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:32:44.077 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:32:44.078 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:32:44.078 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:32:44.078 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:32:44.078 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:32:44.079 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2020-05-18T21:32:44.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.080 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:32:44.080 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_devicehealth": {} 2020-05-18T21:32:44.080 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.080 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2020-05-18T21:32:44.081 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2020-05-18T21:32:44.081 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:40.149370+0000", 2020-05-18T21:32:44.081 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:32:44.081 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:32:44.081 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:32:44.082 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:32:44.082 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:32:44.082 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:32:44.082 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:32:44.082 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:32:44.083 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:32:44.083 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:32:44.083 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:32:44.083 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:32:44.083 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:32:44.083 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:32:44.084 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:32:44.084 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:32:44.084 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:32:44.084 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:32:44.084 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:32:44.085 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:32:44.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.085 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2020-05-18T21:32:44.085 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:32:44.085 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:32:44.086 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:32:44.086 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:32:44.086 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:32:44.086 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:32:44.086 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:32:44.087 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:32:44.087 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:32:44.087 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:32:44.087 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:32:44.087 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:32:44.087 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:32:44.088 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:32:44.088 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:32:44.088 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:32:44.088 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:32:44.088 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:32:44.089 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:32:44.089 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:32:44.089 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:32:44.089 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:32:44.089 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:32:44.089 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:32:44.090 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:32:44.090 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:32:44.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.090 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:32:44.090 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:32:44.091 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:32:44.091 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:32:44.091 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:32:44.091 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:32:44.091 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:32:44.091 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:32:44.092 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:32:44.092 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:32:44.092 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:32:44.092 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:32:44.092 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:32:44.093 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2020-05-18T21:32:44.093 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.093 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 15, 2020-05-18T21:32:44.094 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2020-05-18T21:32:44.094 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:31:28.631738+0000", 2020-05-18T21:32:44.094 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:32:44.094 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:32:44.094 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:32:44.094 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:32:44.095 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:32:44.095 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:32:44.095 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:32:44.095 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:32:44.095 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:32:44.096 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:32:44.096 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:32:44.096 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:32:44.096 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:32:44.096 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:32:44.096 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:32:44.097 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:32:44.097 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:32:44.097 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:32:44.097 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:32:44.097 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:32:44.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.098 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "83", 2020-05-18T21:32:44.098 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:32:44.098 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:32:44.098 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:32:44.099 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:32:44.099 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:32:44.099 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:32:44.099 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:32:44.099 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:32:44.100 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:32:44.100 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:32:44.100 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:32:44.100 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:32:44.100 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:32:44.101 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:32:44.101 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:32:44.101 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:32:44.101 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:32:44.101 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:32:44.101 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:32:44.102 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:32:44.102 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:32:44.102 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:32:44.102 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:32:44.102 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:32:44.103 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:32:44.103 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:32:44.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.103 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:32:44.103 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:32:44.104 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:32:44.104 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:32:44.104 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:32:44.104 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:32:44.104 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:32:44.104 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:32:44.105 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:32:44.105 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:32:44.105 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:32:44.105 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:32:44.105 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2020-05-18T21:32:44.106 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2020-05-18T21:32:44.106 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2020-05-18T21:32:44.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.106 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:32:44.106 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:32:44.106 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2020-05-18T21:32:44.107 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.107 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.107 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 16, 2020-05-18T21:32:44.108 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2020-05-18T21:32:44.108 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:31:29.243969+0000", 2020-05-18T21:32:44.108 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:32:44.108 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:32:44.108 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:32:44.108 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:32:44.109 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:32:44.109 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:32:44.109 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:32:44.109 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:32:44.109 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:32:44.110 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:32:44.110 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:32:44.110 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:32:44.110 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:32:44.110 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:32:44.111 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:32:44.111 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:32:44.111 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:32:44.111 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:32:44.111 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:32:44.111 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:32:44.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.112 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "84", 2020-05-18T21:32:44.112 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:32:44.112 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:32:44.112 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:32:44.113 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:32:44.113 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:32:44.113 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:32:44.113 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:32:44.114 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:32:44.114 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:32:44.114 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:32:44.114 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:32:44.114 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:32:44.115 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:32:44.115 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:32:44.115 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:32:44.115 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:32:44.115 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:32:44.116 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:32:44.116 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:32:44.116 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:32:44.116 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:32:44.116 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:32:44.117 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:32:44.117 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:32:44.117 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:32:44.117 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:32:44.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.118 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:32:44.118 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:32:44.118 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:32:44.118 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:32:44.118 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:32:44.119 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:32:44.119 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:32:44.119 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:32:44.119 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:32:44.119 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:32:44.119 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:32:44.120 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:32:44.120 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:32:44.120 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:32:44.120 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2020-05-18T21:32:44.120 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.121 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.121 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.121 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:32:44.121 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2020-05-18T21:32:44.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.121 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:32:44.122 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "c6ae0fbf-604c-4e8d-b1b8-6038821420e3", 2020-05-18T21:32:44.122 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:32:44.122 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:32:44.122 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:32:44.122 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:32:44.123 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:32:44.123 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:32:44.123 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:32:44.123 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 82, 2020-05-18T21:32:44.123 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:32:44.124 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:32:44.124 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:32:44.124 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.124 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.124 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2020-05-18T21:32:44.125 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:32:44.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.125 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.125 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2020-05-18T21:32:44.126 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:32:44.126 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.126 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.126 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:32:44.126 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.127 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.127 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6802", 2020-05-18T21:32:44.127 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:32:44.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.128 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.128 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6803", 2020-05-18T21:32:44.128 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:32:44.128 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.128 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.129 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:32:44.129 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.129 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.130 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6806", 2020-05-18T21:32:44.130 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:32:44.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.131 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.131 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6807", 2020-05-18T21:32:44.131 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:32:44.132 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.132 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.132 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:32:44.132 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.133 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.133 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6804", 2020-05-18T21:32:44.133 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:32:44.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.134 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.134 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6805", 2020-05-18T21:32:44.134 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:32:44.134 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.134 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.135 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6801/12803", 2020-05-18T21:32:44.135 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6803/12803", 2020-05-18T21:32:44.135 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6807/12803", 2020-05-18T21:32:44.135 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6805/12803", 2020-05-18T21:32:44.135 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:32:44.136 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:32:44.136 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:32:44.136 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.137 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:32:44.137 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6", 2020-05-18T21:32:44.137 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:32:44.137 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:32:44.137 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:32:44.138 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:32:44.138 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:32:44.138 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:32:44.138 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:32:44.138 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 81, 2020-05-18T21:32:44.139 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:32:44.139 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:32:44.139 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:32:44.139 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.140 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.140 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6808", 2020-05-18T21:32:44.140 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:32:44.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.140 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.141 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6809", 2020-05-18T21:32:44.141 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:32:44.141 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.141 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.142 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:32:44.142 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.142 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.142 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6810", 2020-05-18T21:32:44.142 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:32:44.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.143 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.143 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6811", 2020-05-18T21:32:44.143 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:32:44.144 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.144 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.144 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:32:44.144 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.145 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.145 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6815", 2020-05-18T21:32:44.145 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:32:44.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.146 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.146 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6817", 2020-05-18T21:32:44.146 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:32:44.146 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.146 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.147 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:32:44.147 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.147 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.147 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6812", 2020-05-18T21:32:44.148 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:32:44.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.148 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.148 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6813", 2020-05-18T21:32:44.149 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:32:44.149 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.149 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.149 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6809/12804", 2020-05-18T21:32:44.150 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6811/12804", 2020-05-18T21:32:44.150 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6817/12804", 2020-05-18T21:32:44.150 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6813/12804", 2020-05-18T21:32:44.150 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:32:44.150 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:32:44.151 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:32:44.151 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.151 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:32:44.151 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "ec8d9fa9-dae9-45f6-b286-735ab3801c27", 2020-05-18T21:32:44.152 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:32:44.152 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:32:44.152 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:32:44.152 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:32:44.152 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:32:44.153 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:32:44.153 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:32:44.153 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 82, 2020-05-18T21:32:44.153 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:32:44.153 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:32:44.154 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:32:44.154 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.154 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.155 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6822", 2020-05-18T21:32:44.155 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:32:44.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.156 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.156 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6824", 2020-05-18T21:32:44.156 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:32:44.156 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.156 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.157 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:32:44.157 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.157 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.157 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6826", 2020-05-18T21:32:44.158 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:32:44.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.158 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.158 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6827", 2020-05-18T21:32:44.159 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:32:44.159 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.159 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.159 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:32:44.159 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.160 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.160 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.160 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6830", 2020-05-18T21:32:44.160 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:32:44.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.161 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.161 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6831", 2020-05-18T21:32:44.161 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:32:44.161 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.162 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.162 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:32:44.162 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.162 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.163 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6828", 2020-05-18T21:32:44.163 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:32:44.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.163 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.164 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6829", 2020-05-18T21:32:44.164 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:32:44.164 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.164 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.165 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.165 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6824/12806", 2020-05-18T21:32:44.165 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6827/12806", 2020-05-18T21:32:44.165 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6831/12806", 2020-05-18T21:32:44.165 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6829/12806", 2020-05-18T21:32:44.166 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:32:44.166 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:32:44.166 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:32:44.166 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.167 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:32:44.167 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "1030fedf-adad-4e79-b839-59385d4d7d2a", 2020-05-18T21:32:44.167 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:32:44.167 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:32:44.168 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:32:44.168 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:32:44.168 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:32:44.168 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:32:44.168 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:32:44.169 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 82, 2020-05-18T21:32:44.169 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:32:44.169 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:32:44.170 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:32:44.170 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.170 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.170 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6814", 2020-05-18T21:32:44.171 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:32:44.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.171 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.171 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6816", 2020-05-18T21:32:44.171 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:32:44.172 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.172 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.172 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:32:44.172 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.173 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.173 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6818", 2020-05-18T21:32:44.173 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:32:44.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.174 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.174 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6819", 2020-05-18T21:32:44.174 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:32:44.174 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.174 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.175 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:32:44.175 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.175 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.176 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6823", 2020-05-18T21:32:44.176 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:32:44.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.176 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.176 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6825", 2020-05-18T21:32:44.177 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:32:44.177 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.177 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.177 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:32:44.178 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.178 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.178 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6820", 2020-05-18T21:32:44.178 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:32:44.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.179 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.179 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6821", 2020-05-18T21:32:44.179 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:32:44.179 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.180 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.180 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6816/12805", 2020-05-18T21:32:44.180 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6819/12805", 2020-05-18T21:32:44.181 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6825/12805", 2020-05-18T21:32:44.181 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6821/12805", 2020-05-18T21:32:44.181 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:32:44.181 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:32:44.181 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:32:44.182 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.182 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:32:44.182 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "8ad15a9b-97b4-4002-b1d4-7292e09b4ef6", 2020-05-18T21:32:44.182 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:32:44.183 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:32:44.183 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:32:44.183 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:32:44.183 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:32:44.183 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:32:44.184 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:32:44.184 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 82, 2020-05-18T21:32:44.184 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:32:44.184 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:32:44.184 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:32:44.184 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.185 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.185 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6800", 2020-05-18T21:32:44.185 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:32:44.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.186 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.186 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6801", 2020-05-18T21:32:44.186 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:32:44.187 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.187 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.187 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:32:44.187 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.188 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.188 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6802", 2020-05-18T21:32:44.188 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:32:44.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.189 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.189 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6803", 2020-05-18T21:32:44.189 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:32:44.189 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.189 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.190 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:32:44.190 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.190 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.190 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6806", 2020-05-18T21:32:44.191 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:32:44.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.191 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.191 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6807", 2020-05-18T21:32:44.192 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:32:44.192 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.192 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.192 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:32:44.192 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.193 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.193 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6804", 2020-05-18T21:32:44.193 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:32:44.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.194 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.194 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.194 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6805", 2020-05-18T21:32:44.194 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:32:44.194 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.194 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.195 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6801/13023", 2020-05-18T21:32:44.195 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6803/13023", 2020-05-18T21:32:44.195 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6807/13023", 2020-05-18T21:32:44.195 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6805/13023", 2020-05-18T21:32:44.196 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:32:44.196 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:32:44.196 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:32:44.196 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.197 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:32:44.197 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0dce88f8-b984-43e1-95e2-4132171102d2", 2020-05-18T21:32:44.197 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:32:44.197 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:32:44.197 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:32:44.198 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:32:44.198 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:32:44.198 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:32:44.198 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:32:44.198 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 82, 2020-05-18T21:32:44.199 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:32:44.199 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:32:44.199 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:32:44.199 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.200 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.200 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6808", 2020-05-18T21:32:44.200 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:32:44.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.201 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.201 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6809", 2020-05-18T21:32:44.201 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:32:44.201 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.201 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.202 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:32:44.202 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.202 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.202 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6810", 2020-05-18T21:32:44.203 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:32:44.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.203 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.203 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6811", 2020-05-18T21:32:44.204 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:32:44.204 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.204 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.204 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:32:44.205 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.205 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.205 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6814", 2020-05-18T21:32:44.205 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:32:44.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.206 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.206 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6816", 2020-05-18T21:32:44.206 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:32:44.206 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.207 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.207 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:32:44.207 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.208 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.208 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6812", 2020-05-18T21:32:44.208 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:32:44.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.209 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.209 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6813", 2020-05-18T21:32:44.209 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:32:44.209 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.209 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.210 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6809/13024", 2020-05-18T21:32:44.210 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6811/13024", 2020-05-18T21:32:44.210 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6816/13024", 2020-05-18T21:32:44.210 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6813/13024", 2020-05-18T21:32:44.210 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:32:44.211 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:32:44.211 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:32:44.211 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.211 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:32:44.212 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "e1bc92f8-3692-4483-b0fb-905c94fa1469", 2020-05-18T21:32:44.212 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:32:44.212 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:32:44.212 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:32:44.212 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:32:44.213 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:32:44.213 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:32:44.213 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:32:44.213 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 82, 2020-05-18T21:32:44.213 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:32:44.214 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:32:44.214 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:32:44.214 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.214 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.214 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6815", 2020-05-18T21:32:44.215 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:32:44.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.215 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.215 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6817", 2020-05-18T21:32:44.216 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:32:44.216 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.216 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.216 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:32:44.216 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.217 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.217 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6818", 2020-05-18T21:32:44.217 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:32:44.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.218 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.218 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6819", 2020-05-18T21:32:44.218 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:32:44.219 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.219 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.219 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:32:44.219 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.220 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.220 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6822", 2020-05-18T21:32:44.220 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:32:44.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.221 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.221 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6824", 2020-05-18T21:32:44.221 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:32:44.221 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.221 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.222 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:32:44.222 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.222 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.223 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6820", 2020-05-18T21:32:44.223 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:32:44.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.223 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.224 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6821", 2020-05-18T21:32:44.224 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:32:44.224 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.224 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.225 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6817/13025", 2020-05-18T21:32:44.225 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6819/13025", 2020-05-18T21:32:44.225 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6824/13025", 2020-05-18T21:32:44.225 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6821/13025", 2020-05-18T21:32:44.225 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:32:44.225 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:32:44.226 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:32:44.226 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.226 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:32:44.227 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "b76e000c-a078-48c4-9e1e-34d286a9992c", 2020-05-18T21:32:44.227 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:32:44.227 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:32:44.227 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:32:44.227 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:32:44.227 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:32:44.228 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:32:44.228 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:32:44.228 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 70, 2020-05-18T21:32:44.228 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:32:44.228 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:32:44.229 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:32:44.229 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.229 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.229 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6823", 2020-05-18T21:32:44.229 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:32:44.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.230 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.230 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6825", 2020-05-18T21:32:44.230 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:32:44.231 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.231 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.232 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:32:44.232 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.232 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.232 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6826", 2020-05-18T21:32:44.232 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:32:44.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.233 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.233 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6827", 2020-05-18T21:32:44.233 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:32:44.234 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.234 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.234 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:32:44.234 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6830", 2020-05-18T21:32:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:32:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.236 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.236 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6831", 2020-05-18T21:32:44.236 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:32:44.236 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.236 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.237 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:32:44.237 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:32:44.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.237 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:32:44.238 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6828", 2020-05-18T21:32:44.238 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:32:44.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.238 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:32:44.239 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6829", 2020-05-18T21:32:44.239 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:32:44.239 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.239 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.240 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6825/13026", 2020-05-18T21:32:44.240 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6827/13026", 2020-05-18T21:32:44.240 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6831/13026", 2020-05-18T21:32:44.240 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6829/13026", 2020-05-18T21:32:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:32:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:32:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:32:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:32:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2020-05-18T21:32:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:32:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:32:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:32:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:32:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:32:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:32:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.281434+0000", 2020-05-18T21:32:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:32:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.244 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:32:44.244 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:32:44.244 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:32:44.244 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:32:44.245 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:32:44.245 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:32:44.245 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.608518+0000", 2020-05-18T21:32:44.245 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:32:44.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.246 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:32:44.246 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:32:44.246 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:32:44.246 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:32:44.246 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:32:44.247 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:32:44.247 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.582386+0000", 2020-05-18T21:32:44.247 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:32:44.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:32:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:32:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:32:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:32:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:32:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:32:44.249 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.573488+0000", 2020-05-18T21:32:44.249 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:32:44.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.249 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:32:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:32:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:32:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:32:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:32:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:32:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.604174+0000", 2020-05-18T21:32:44.251 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:32:44.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.251 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:32:44.251 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:32:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:32:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:32:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:32:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:32:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.371004+0000", 2020-05-18T21:32:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:32:44.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.253 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:32:44.253 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:32:44.253 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:32:44.254 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:32:44.254 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:32:44.254 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:32:44.254 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.593070+0000", 2020-05-18T21:32:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:32:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:32:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:32:44.256 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:32:44.256 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:32:44.256 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:32:44.256 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:32:44.257 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.667677+0000", 2020-05-18T21:32:44.257 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:32:44.257 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.257 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:32:44.257 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2020-05-18T21:32:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2020-05-18T21:32:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2020-05-18T21:32:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2020-05-18T21:32:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklist": { 2020-05-18T21:32:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: "172.21.15.63:6832/249786226": "2020-05-19T21:31:58.828935+0000", 2020-05-18T21:32:44.259 INFO:teuthology.orchestra.run.smithi063.stdout: "172.21.15.155:6835/578144386": "2020-05-19T21:31:58.811250+0000", 2020-05-18T21:32:44.259 INFO:teuthology.orchestra.run.smithi063.stdout: "172.21.15.63:6833/249786226": "2020-05-19T21:31:58.828935+0000", 2020-05-18T21:32:44.259 INFO:teuthology.orchestra.run.smithi063.stdout: "172.21.15.155:6834/578144386": "2020-05-19T21:31:58.811250+0000" 2020-05-18T21:32:44.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.259 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2020-05-18T21:32:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2020-05-18T21:32:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2020-05-18T21:32:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2020-05-18T21:32:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2020-05-18T21:32:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2020-05-18T21:32:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: "ruleset-failure-domain": "osd", 2020-05-18T21:32:44.261 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2020-05-18T21:32:44.261 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:44.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:44.261 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2020-05-18T21:32:44.261 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2020-05-18T21:32:44.262 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2020-05-18T21:32:44.262 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2020-05-18T21:32:44.262 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {} 2020-05-18T21:32:44.262 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:32:44.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.045+0000 7f0da3328700 1 -- 172.21.15.63:0/1755568721 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d7c04f9c0 msgr2=0x7f0d7c051e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:44.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.045+0000 7f0da3328700 1 --2- 172.21.15.63:0/1755568721 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d7c04f9c0 0x7f0d7c051e80 secure :-1 s=READY pgs=477 cs=0 l=1 rx=0x7f0d9c0b5b80 tx=0x7f0d8c007a80).stop 2020-05-18T21:32:44.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.045+0000 7f0da3328700 1 -- 172.21.15.63:0/1755568721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d9c0b2d70 msgr2=0x7f0d9c0b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:44.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.049+0000 7f0da3328700 1 --2- 172.21.15.63:0/1755568721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d9c0b2d70 0x7f0d9c0b51b0 secure :-1 s=READY pgs=1206 cs=0 l=1 rx=0x7f0d98001970 tx=0x7f0d98010be0).stop 2020-05-18T21:32:44.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.049+0000 7f0da3328700 1 -- 172.21.15.63:0/1755568721 shutdown_connections 2020-05-18T21:32:44.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.049+0000 7f0da3328700 1 --2- 172.21.15.63:0/1755568721 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d7c04f9c0 0x7f0d7c051e80 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:44.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.049+0000 7f0da3328700 1 --2- 172.21.15.63:0/1755568721 >> v2:172.21.15.155:3300/0 conn(0x7f0d9c146c90 0x7f0d9c154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:44.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.049+0000 7f0da3328700 1 --2- 172.21.15.63:0/1755568721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d9c0b2d70 0x7f0d9c0b51b0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:44.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.049+0000 7f0da3328700 1 -- 172.21.15.63:0/1755568721 >> 172.21.15.63:0/1755568721 conn(0x7f0d9c0b83d0 msgr2=0x7f0d9c13df20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:44.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.049+0000 7f0da3328700 1 -- 172.21.15.63:0/1755568721 shutdown_connections 2020-05-18T21:32:44.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.049+0000 7f0da3328700 1 -- 172.21.15.63:0/1755568721 wait complete. 2020-05-18T21:32:44.267 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:44.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.373+0000 7fee672e3700 1 Processor -- start 2020-05-18T21:32:44.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.373+0000 7fee672e3700 1 -- start start 2020-05-18T21:32:44.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.373+0000 7fee672e3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fee60145f40 0x7fee60061670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:44.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.373+0000 7fee672e3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee60149e80 0x7fee600b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:44.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.373+0000 7fee672e3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee60146e60 con 0x7fee60060b90 2020-05-18T21:32:44.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.373+0000 7fee672e3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee60146480 con 0x7fee60145f40 2020-05-18T21:32:44.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.373+0000 7fee672e3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee60146720 con 0x7fee60149e80 2020-05-18T21:32:44.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.373+0000 7fee6487e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fee60145f40 0x7fee60061670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:44.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.373+0000 7fee6507f700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fee60060b90 0x7fee60149770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:59718/0 (socket says 172.21.15.63:59718) 2020-05-18T21:32:44.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.373+0000 7fee65880700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee60149e80 0x7fee600b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:44.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.373+0000 7fee6507f700 1 -- 172.21.15.63:0/2912233707 learned_addr learned my addr 172.21.15.63:0/2912233707 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:44.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee65880700 1 -- 172.21.15.63:0/2912233707 >> v2:172.21.15.155:3300/0 conn(0x7fee60145f40 msgr2=0x7fee60061670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:44.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee65880700 1 --2- 172.21.15.63:0/2912233707 >> v2:172.21.15.155:3300/0 conn(0x7fee60145f40 0x7fee60061670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:44.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee65880700 1 -- 172.21.15.63:0/2912233707 >> v1:172.21.15.155:6789/0 conn(0x7fee60060b90 legacy=0x7fee60149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:44.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee65880700 1 -- 172.21.15.63:0/2912233707 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee601469c0 con 0x7fee60149e80 2020-05-18T21:32:44.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee65880700 1 --2- 172.21.15.63:0/2912233707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee60149e80 0x7fee600b1b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fee580032f0 tx=0x7fee58007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee65880700 1 --2- 172.21.15.63:0/2912233707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee60149e80 0x7fee600b1b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fee580032f0 tx=0x7fee58007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee65880700 1 --2- 172.21.15.63:0/2912233707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee60149e80 0x7fee600b1b40 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7fee580032f0 tx=0x7fee58007e00).ready entity=mon.2 client_cookie=678ad18177578663 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:44.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee65880700 1 --2- 172.21.15.63:0/2912233707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee60149e80 0x7fee600b1b40 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fee580032f0 tx=0x7fee58007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee65880700 1 --2- 172.21.15.63:0/2912233707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee60149e80 0x7fee600b1b40 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fee580032f0 tx=0x7fee58007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee65880700 1 --2- 172.21.15.63:0/2912233707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee60149e80 0x7fee600b1b40 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fee580032f0 tx=0x7fee58007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee57fff700 1 -- 172.21.15.63:0/2912233707 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee58011e60 con 0x7fee60149e80 2020-05-18T21:32:44.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee57fff700 1 -- 172.21.15.63:0/2912233707 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5800a180 con 0x7fee60149e80 2020-05-18T21:32:44.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee57fff700 1 -- 172.21.15.63:0/2912233707 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee5800a560 con 0x7fee60149e80 2020-05-18T21:32:44.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee672e3700 1 -- 172.21.15.63:0/2912233707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee60149e80 msgr2=0x7fee600b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:44.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee672e3700 1 --2- 172.21.15.63:0/2912233707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee60149e80 0x7fee600b1b40 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7fee580032f0 tx=0x7fee58007e00).stop 2020-05-18T21:32:44.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee672e3700 1 -- 172.21.15.63:0/2912233707 shutdown_connections 2020-05-18T21:32:44.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee672e3700 1 --2- 172.21.15.63:0/2912233707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee60149e80 0x7fee600b1b40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:44.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee672e3700 1 --2- 172.21.15.63:0/2912233707 >> v2:172.21.15.155:3300/0 conn(0x7fee60145f40 0x7fee60061670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:44.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee672e3700 1 -- 172.21.15.63:0/2912233707 >> 172.21.15.63:0/2912233707 conn(0x7fee600b83d0 msgr2=0x7fee600b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:44.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee672e3700 1 -- 172.21.15.63:0/2912233707 shutdown_connections 2020-05-18T21:32:44.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee672e3700 1 -- 172.21.15.63:0/2912233707 wait complete. 2020-05-18T21:32:44.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee672e3700 1 Processor -- start 2020-05-18T21:32:44.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.377+0000 7fee672e3700 1 -- start start 2020-05-18T21:32:44.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee672e3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fee60145f40 0x7fee6012b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:44.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee672e3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fee60149e80 0x7fee60140590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:44.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee672e3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee60142f00 con 0x7fee60060b90 2020-05-18T21:32:44.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee672e3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee601431a0 con 0x7fee60145f40 2020-05-18T21:32:44.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee672e3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee60143440 con 0x7fee60149e80 2020-05-18T21:32:44.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee6487e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fee60145f40 0x7fee6012b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:44.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee6487e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fee60145f40 0x7fee6012b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59224/0 (socket says 172.21.15.63:59224) 2020-05-18T21:32:44.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee6487e700 1 -- 172.21.15.63:0/1994835730 learned_addr learned my addr 172.21.15.63:0/1994835730 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:44.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee65880700 1 --2- 172.21.15.63:0/1994835730 >> v2:172.21.15.155:3300/0 conn(0x7fee60149e80 0x7fee60140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:44.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee6487e700 1 -- 172.21.15.63:0/1994835730 >> v2:172.21.15.155:3300/0 conn(0x7fee60149e80 msgr2=0x7fee60140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:44.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee6487e700 1 --2- 172.21.15.63:0/1994835730 >> v2:172.21.15.155:3300/0 conn(0x7fee60149e80 0x7fee60140590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:44.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee6487e700 1 -- 172.21.15.63:0/1994835730 >> v1:172.21.15.155:6789/0 conn(0x7fee60060b90 legacy=0x7fee6012aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:44.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee6487e700 1 -- 172.21.15.63:0/1994835730 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6012c660 con 0x7fee60145f40 2020-05-18T21:32:44.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee6487e700 1 --2- 172.21.15.63:0/1994835730 >> v2:172.21.15.63:3300/0 conn(0x7fee60145f40 0x7fee6012b180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee5c0030b0 tx=0x7fee5c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee6487e700 1 --2- 172.21.15.63:0/1994835730 >> v2:172.21.15.63:3300/0 conn(0x7fee60145f40 0x7fee6012b180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee5c0030b0 tx=0x7fee5c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee6487e700 1 --2- 172.21.15.63:0/1994835730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee60145f40 0x7fee6012b180 secure :-1 s=READY pgs=1207 cs=0 l=1 rx=0x7fee5c0030b0 tx=0x7fee5c010d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:44.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee6487e700 1 --2- 172.21.15.63:0/1994835730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee60145f40 0x7fee6012b180 secure :-1 s=THROTTLE_DONE pgs=1207 cs=0 l=1 rx=0x7fee5c0030b0 tx=0x7fee5c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee567fc700 1 -- 172.21.15.63:0/1994835730 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee5c007180 con 0x7fee60145f40 2020-05-18T21:32:44.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee6487e700 1 --2- 172.21.15.63:0/1994835730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee60145f40 0x7fee6012b180 secure :-1 s=THROTTLE_DONE pgs=1207 cs=0 l=1 rx=0x7fee5c0030b0 tx=0x7fee5c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee6487e700 1 --2- 172.21.15.63:0/1994835730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee60145f40 0x7fee6012b180 secure :-1 s=THROTTLE_DONE pgs=1207 cs=0 l=1 rx=0x7fee5c0030b0 tx=0x7fee5c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee567fc700 1 -- 172.21.15.63:0/1994835730 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c0072e0 con 0x7fee60145f40 2020-05-18T21:32:44.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee672e3700 1 -- 172.21.15.63:0/1994835730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee600b7d20 con 0x7fee60145f40 2020-05-18T21:32:44.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee567fc700 1 -- 172.21.15.63:0/1994835730 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee5c012330 con 0x7fee60145f40 2020-05-18T21:32:44.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee672e3700 1 -- 172.21.15.63:0/1994835730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee600b81d0 con 0x7fee60145f40 2020-05-18T21:32:44.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee6487e700 1 --2- 172.21.15.63:0/1994835730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee60145f40 0x7fee6012b180 secure :-1 s=THROTTLE_DONE pgs=1207 cs=0 l=1 rx=0x7fee5c0030b0 tx=0x7fee5c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.381+0000 7fee672e3700 1 -- 172.21.15.63:0/1994835730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee600569e0 con 0x7fee60145f40 2020-05-18T21:32:44.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.385+0000 7fee567fc700 1 -- 172.21.15.63:0/1994835730 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fee5c010190 con 0x7fee60145f40 2020-05-18T21:32:44.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.385+0000 7fee6487e700 1 --2- 172.21.15.63:0/1994835730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee60145f40 0x7fee6012b180 secure :-1 s=THROTTLE_DONE pgs=1207 cs=0 l=1 rx=0x7fee5c0030b0 tx=0x7fee5c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.385+0000 7fee567fc700 1 --2- 172.21.15.63:0/1994835730 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee4804faf0 0x7fee48051fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:44.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.385+0000 7fee567fc700 1 -- 172.21.15.63:0/1994835730 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fee5c063f20 con 0x7fee60145f40 2020-05-18T21:32:44.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.385+0000 7fee6507f700 1 --2- 172.21.15.63:0/1994835730 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee4804faf0 0x7fee48051fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:44.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.385+0000 7fee6507f700 1 --2- 172.21.15.63:0/1994835730 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee4804faf0 0x7fee48051fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee600b8390 tx=0x7fee50001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.385+0000 7fee6507f700 1 --2- 172.21.15.63:0/1994835730 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee4804faf0 0x7fee48051fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee600b8390 tx=0x7fee50001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.385+0000 7fee6507f700 1 --2- 172.21.15.63:0/1994835730 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee4804faf0 0x7fee48051fb0 secure :-1 s=READY pgs=478 cs=0 l=1 rx=0x7fee600b8390 tx=0x7fee50001480).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:44.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.389+0000 7fee6487e700 1 --2- 172.21.15.63:0/1994835730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee60145f40 0x7fee6012b180 secure :-1 s=THROTTLE_DONE pgs=1207 cs=0 l=1 rx=0x7fee5c0030b0 tx=0x7fee5c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.389+0000 7fee567fc700 1 -- 172.21.15.63:0/1994835730 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fee5c03e2b0 con 0x7fee60145f40 2020-05-18T21:32:44.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.541+0000 7fee672e3700 1 -- 172.21.15.63:0/1994835730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee600661c0 con 0x7fee60145f40 2020-05-18T21:32:44.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.541+0000 7fee6487e700 1 --2- 172.21.15.63:0/1994835730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee60145f40 0x7fee6012b180 secure :-1 s=THROTTLE_DONE pgs=1207 cs=0 l=1 rx=0x7fee5c0030b0 tx=0x7fee5c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.541+0000 7fee567fc700 1 -- 172.21.15.63:0/1994835730 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+2142 (secure 0 0 0) 0x7fee5c0418d0 con 0x7fee60145f40 2020-05-18T21:32:44.547 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:44.548 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":69,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7603,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3212955782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3212955782},{"type":"v1","addr":"172.21.15.155:6835","nonce":3212955782}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":69}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:40.680007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7500},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_7500":{"gid":7500,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6833/695559165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":695559165},{"type":"v1","addr":"172.21.15.63:6833","nonce":695559165}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:44.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.545+0000 7fee672e3700 1 -- 172.21.15.63:0/1994835730 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee4804faf0 msgr2=0x7fee48051fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:44.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.545+0000 7fee672e3700 1 --2- 172.21.15.63:0/1994835730 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee4804faf0 0x7fee48051fb0 secure :-1 s=READY pgs=478 cs=0 l=1 rx=0x7fee600b8390 tx=0x7fee50001480).stop 2020-05-18T21:32:44.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.545+0000 7fee672e3700 1 -- 172.21.15.63:0/1994835730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee60145f40 msgr2=0x7fee6012b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:44.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.545+0000 7fee672e3700 1 --2- 172.21.15.63:0/1994835730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee60145f40 0x7fee6012b180 secure :-1 s=READY pgs=1207 cs=0 l=1 rx=0x7fee5c0030b0 tx=0x7fee5c010d10).stop 2020-05-18T21:32:44.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.545+0000 7fee672e3700 1 -- 172.21.15.63:0/1994835730 shutdown_connections 2020-05-18T21:32:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.545+0000 7fee672e3700 1 --2- 172.21.15.63:0/1994835730 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee4804faf0 0x7fee48051fb0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.545+0000 7fee672e3700 1 --2- 172.21.15.63:0/1994835730 >> v2:172.21.15.155:3300/0 conn(0x7fee60149e80 0x7fee60140590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.545+0000 7fee672e3700 1 --2- 172.21.15.63:0/1994835730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee60145f40 0x7fee6012b180 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.545+0000 7fee672e3700 1 -- 172.21.15.63:0/1994835730 >> 172.21.15.63:0/1994835730 conn(0x7fee600b83d0 msgr2=0x7fee6012ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:44.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.545+0000 7fee672e3700 1 -- 172.21.15.63:0/1994835730 shutdown_connections 2020-05-18T21:32:44.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.545+0000 7fee672e3700 1 -- 172.21.15.63:0/1994835730 wait complete. 2020-05-18T21:32:44.552 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 69 2020-05-18T21:32:44.558 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-05-18T21:32:44.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.657+0000 7f8a75b6d700 1 Processor -- start 2020-05-18T21:32:44.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.657+0000 7f8a75b6d700 1 -- start start 2020-05-18T21:32:44.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.657+0000 7f8a75b6d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8a70065ff0 0x7f8a7009dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:44.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.657+0000 7f8a75b6d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a700b03b0 con 0x7f8a700afee0 2020-05-18T21:32:44.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.657+0000 7f8a75b6d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a700b0650 con 0x7f8a7005ef00 2020-05-18T21:32:44.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.657+0000 7f8a75b6d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a700b08f0 con 0x7f8a70065ff0 2020-05-18T21:32:44.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.657+0000 7f8a6ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8a700afee0 0x7f8a70143250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33184/0 (socket says 172.21.15.63:33184) 2020-05-18T21:32:44.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.657+0000 7f8a6ffff700 1 -- 172.21.15.63:0/109585457 learned_addr learned my addr 172.21.15.63:0/109585457 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:44.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.657+0000 7f8a7536c700 1 --2- 172.21.15.63:0/109585457 >> v2:172.21.15.155:3300/0 conn(0x7f8a70065ff0 0x7f8a7009dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:44.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.657+0000 7f8a6f7fe700 1 -- 172.21.15.63:0/109585457 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520679244 0 0) 0x7f8a700b03b0 con 0x7f8a700afee0 2020-05-18T21:32:44.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.657+0000 7f8a6f7fe700 1 -- 172.21.15.63:0/109585457 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a50003270 con 0x7f8a700afee0 2020-05-18T21:32:44.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.657+0000 7f8a6f7fe700 1 -- 172.21.15.63:0/109585457 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998310428 0 0) 0x7f8a700b0650 con 0x7f8a7005ef00 2020-05-18T21:32:44.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a6f7fe700 1 -- 172.21.15.63:0/109585457 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a700b03b0 con 0x7f8a7005ef00 2020-05-18T21:32:44.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a6f7fe700 1 -- 172.21.15.63:0/109585457 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2535772014 0 0) 0x7f8a50003270 con 0x7f8a700afee0 2020-05-18T21:32:44.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a6f7fe700 1 -- 172.21.15.63:0/109585457 >> v2:172.21.15.155:3300/0 conn(0x7f8a70065ff0 msgr2=0x7f8a7009dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:44.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a6f7fe700 1 --2- 172.21.15.63:0/109585457 >> v2:172.21.15.155:3300/0 conn(0x7f8a70065ff0 0x7f8a7009dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:44.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a6f7fe700 1 -- 172.21.15.63:0/109585457 >> v1:172.21.15.155:6789/0 conn(0x7f8a7005ef00 legacy=0x7f8a700b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:44.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a6f7fe700 1 -- 172.21.15.63:0/109585457 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7005f2e0 con 0x7f8a700afee0 2020-05-18T21:32:44.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a6f7fe700 1 -- 172.21.15.63:0/109585457 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f8a58001710 con 0x7f8a700afee0 2020-05-18T21:32:44.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a6f7fe700 1 -- 172.21.15.63:0/109585457 >> v1:172.21.15.63:6789/0 conn(0x7f8a700afee0 legacy=0x7f8a70143250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:44.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a6f7fe700 1 --2- 172.21.15.63:0/109585457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a500038f0 0x7f8a50003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:44.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a6f7fe700 1 --2- 172.21.15.63:0/109585457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a50004510 0x7f8a50004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:44.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a6f7fe700 1 --2- 172.21.15.63:0/109585457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a50004df0 0x7f8a5000b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:44.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a6f7fe700 1 -- 172.21.15.63:0/109585457 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a700b08f0 con 0x7f8a500038f0 2020-05-18T21:32:44.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a6f7fe700 1 -- 172.21.15.63:0/109585457 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500053e0 con 0x7f8a50004510 2020-05-18T21:32:44.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a6f7fe700 1 -- 172.21.15.63:0/109585457 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5000bc40 con 0x7f8a50004df0 2020-05-18T21:32:44.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a74b6b700 1 --2- 172.21.15.63:0/109585457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a500038f0 0x7f8a50003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:44.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a6ffff700 1 --2- 172.21.15.63:0/109585457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a50004510 0x7f8a50004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:44.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a7536c700 1 --2- 172.21.15.63:0/109585457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a50004df0 0x7f8a5000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:44.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a74b6b700 1 -- 172.21.15.63:0/109585457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a50004df0 msgr2=0x7f8a5000b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:44.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a74b6b700 1 --2- 172.21.15.63:0/109585457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a50004df0 0x7f8a5000b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:44.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a74b6b700 1 -- 172.21.15.63:0/109585457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a50004510 msgr2=0x7f8a50004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:44.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a74b6b700 1 --2- 172.21.15.63:0/109585457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a50004510 0x7f8a50004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:44.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a74b6b700 1 -- 172.21.15.63:0/109585457 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a50003270 con 0x7f8a500038f0 2020-05-18T21:32:44.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a6ffff700 1 --2- 172.21.15.63:0/109585457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a50004510 0x7f8a50004990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:32:44.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a7536c700 1 --2- 172.21.15.63:0/109585457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a50004df0 0x7f8a5000b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:32:44.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a7536c700 1 -- 172.21.15.63:0/109585457 reap_dead start 2020-05-18T21:32:44.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a74b6b700 1 --2- 172.21.15.63:0/109585457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a500038f0 0x7f8a50003cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8a60001110 tx=0x7f8a6000ff40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a74b6b700 1 --2- 172.21.15.63:0/109585457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a500038f0 0x7f8a50003cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8a60001110 tx=0x7f8a6000ff40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a74b6b700 1 --2- 172.21.15.63:0/109585457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a500038f0 0x7f8a50003cf0 secure :-1 s=READY pgs=1209 cs=0 l=1 rx=0x7f8a60001110 tx=0x7f8a6000ff40).ready entity=mon.0 client_cookie=6f7e1ddac3bd6cea server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:44.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a74b6b700 1 --2- 172.21.15.63:0/109585457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a500038f0 0x7f8a50003cf0 secure :-1 s=THROTTLE_DONE pgs=1209 cs=0 l=1 rx=0x7f8a60001110 tx=0x7f8a6000ff40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a74b6b700 1 --2- 172.21.15.63:0/109585457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a500038f0 0x7f8a50003cf0 secure :-1 s=THROTTLE_DONE pgs=1209 cs=0 l=1 rx=0x7f8a60001110 tx=0x7f8a6000ff40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a6f7fe700 1 -- 172.21.15.63:0/109585457 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a60010c80 con 0x7f8a500038f0 2020-05-18T21:32:44.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a74b6b700 1 --2- 172.21.15.63:0/109585457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a500038f0 0x7f8a50003cf0 secure :-1 s=THROTTLE_DONE pgs=1209 cs=0 l=1 rx=0x7f8a60001110 tx=0x7f8a6000ff40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a6f7fe700 1 -- 172.21.15.63:0/109585457 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a60010de0 con 0x7f8a500038f0 2020-05-18T21:32:44.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a75b6d700 1 -- 172.21.15.63:0/109585457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a500038f0 msgr2=0x7f8a50003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:44.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a75b6d700 1 --2- 172.21.15.63:0/109585457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a500038f0 0x7f8a50003cf0 secure :-1 s=READY pgs=1209 cs=0 l=1 rx=0x7f8a60001110 tx=0x7f8a6000ff40).stop 2020-05-18T21:32:44.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a6f7fe700 1 -- 172.21.15.63:0/109585457 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a60002270 con 0x7f8a500038f0 2020-05-18T21:32:44.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a75b6d700 1 -- 172.21.15.63:0/109585457 shutdown_connections 2020-05-18T21:32:44.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a75b6d700 1 --2- 172.21.15.63:0/109585457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a500038f0 0x7f8a50003cf0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:44.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a75b6d700 1 -- 172.21.15.63:0/109585457 >> 172.21.15.63:0/109585457 conn(0x7f8a700b6f40 msgr2=0x7f8a700b7320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:44.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a75b6d700 1 -- 172.21.15.63:0/109585457 shutdown_connections 2020-05-18T21:32:44.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.661+0000 7f8a75b6d700 1 -- 172.21.15.63:0/109585457 wait complete. 2020-05-18T21:32:44.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a75b6d700 1 Processor -- start 2020-05-18T21:32:44.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a75b6d700 1 -- start start 2020-05-18T21:32:44.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a75b6d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8a701541e0 0x7f8a7009f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:44.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a75b6d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a7009f760 con 0x7f8a500038f0 2020-05-18T21:32:44.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a75b6d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a70151000 con 0x7f8a70146860 2020-05-18T21:32:44.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a75b6d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a701512a0 con 0x7f8a701541e0 2020-05-18T21:32:44.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a74b6b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8a500038f0 0x7f8a701548f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33196/0 (socket says 172.21.15.63:33196) 2020-05-18T21:32:44.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a74b6b700 1 -- 172.21.15.63:0/499754710 learned_addr learned my addr 172.21.15.63:0/499754710 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:44.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a7536c700 1 --2- 172.21.15.63:0/499754710 >> v2:172.21.15.155:3300/0 conn(0x7f8a701541e0 0x7f8a7009f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:44.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a6dffb700 1 -- 172.21.15.63:0/499754710 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074084728 0 0) 0x7f8a7009f760 con 0x7f8a500038f0 2020-05-18T21:32:44.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a6dffb700 1 -- 172.21.15.63:0/499754710 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a54002fe0 con 0x7f8a500038f0 2020-05-18T21:32:44.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a7536c700 1 -- 172.21.15.63:0/499754710 >> v1:172.21.15.155:6789/0 conn(0x7f8a70146860 legacy=0x7f8a700b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:44.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a7536c700 1 -- 172.21.15.63:0/499754710 >> v1:172.21.15.63:6789/0 conn(0x7f8a500038f0 legacy=0x7f8a701548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:44.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a6dffb700 1 -- 172.21.15.63:0/499754710 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3935130917 0 0) 0x7f8a70151000 con 0x7f8a70146860 2020-05-18T21:32:44.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a7536c700 1 -- 172.21.15.63:0/499754710 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a70151540 con 0x7f8a701541e0 2020-05-18T21:32:44.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a7536c700 1 --2- 172.21.15.63:0/499754710 >> v2:172.21.15.155:3300/0 conn(0x7f8a701541e0 0x7f8a7009f300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a600011d0 tx=0x7f8a68010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a7536c700 1 --2- 172.21.15.63:0/499754710 >> v2:172.21.15.155:3300/0 conn(0x7f8a701541e0 0x7f8a7009f300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a600011d0 tx=0x7f8a68010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a7536c700 1 --2- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a701541e0 0x7f8a7009f300 secure :-1 s=READY pgs=835 cs=0 l=1 rx=0x7f8a600011d0 tx=0x7f8a68010b50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:44.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a7536c700 1 --2- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a701541e0 0x7f8a7009f300 secure :-1 s=THROTTLE_DONE pgs=835 cs=0 l=1 rx=0x7f8a600011d0 tx=0x7f8a68010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.665+0000 7f8a6dffb700 1 -- 172.21.15.63:0/499754710 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a68005e60 con 0x7f8a701541e0 2020-05-18T21:32:44.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.669+0000 7f8a7536c700 1 --2- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a701541e0 0x7f8a7009f300 secure :-1 s=THROTTLE_DONE pgs=835 cs=0 l=1 rx=0x7f8a600011d0 tx=0x7f8a68010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.669+0000 7f8a7536c700 1 --2- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a701541e0 0x7f8a7009f300 secure :-1 s=THROTTLE_DONE pgs=835 cs=0 l=1 rx=0x7f8a600011d0 tx=0x7f8a68010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.669+0000 7f8a6dffb700 1 -- 172.21.15.63:0/499754710 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a68008440 con 0x7f8a701541e0 2020-05-18T21:32:44.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.669+0000 7f8a75b6d700 1 -- 172.21.15.63:0/499754710 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a70155000 con 0x7f8a701541e0 2020-05-18T21:32:44.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.669+0000 7f8a6dffb700 1 -- 172.21.15.63:0/499754710 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a680087a0 con 0x7f8a701541e0 2020-05-18T21:32:44.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.669+0000 7f8a75b6d700 1 -- 172.21.15.63:0/499754710 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a70150db0 con 0x7f8a701541e0 2020-05-18T21:32:44.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.669+0000 7f8a7536c700 1 --2- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a701541e0 0x7f8a7009f300 secure :-1 s=THROTTLE_DONE pgs=835 cs=0 l=1 rx=0x7f8a600011d0 tx=0x7f8a68010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.669+0000 7f8a75b6d700 1 -- 172.21.15.63:0/499754710 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a700569e0 con 0x7f8a701541e0 2020-05-18T21:32:44.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.669+0000 7f8a6dffb700 1 -- 172.21.15.63:0/499754710 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8a680089a0 con 0x7f8a701541e0 2020-05-18T21:32:44.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.669+0000 7f8a7536c700 1 --2- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a701541e0 0x7f8a7009f300 secure :-1 s=THROTTLE_DONE pgs=835 cs=0 l=1 rx=0x7f8a600011d0 tx=0x7f8a68010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.669+0000 7f8a6dffb700 1 --2- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8a5404fca0 0x7f8a54052160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:44.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.669+0000 7f8a6dffb700 1 -- 172.21.15.63:0/499754710 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f8a68063460 con 0x7f8a701541e0 2020-05-18T21:32:44.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.669+0000 7f8a74b6b700 1 --2- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8a5404fca0 0x7f8a54052160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:44.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.669+0000 7f8a74b6b700 1 --2- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8a5404fca0 0x7f8a54052160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a600012f0 tx=0x7f8a6000ff40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.669+0000 7f8a74b6b700 1 --2- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8a5404fca0 0x7f8a54052160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a600012f0 tx=0x7f8a6000ff40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.669+0000 7f8a74b6b700 1 --2- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8a5404fca0 0x7f8a54052160 secure :-1 s=READY pgs=479 cs=0 l=1 rx=0x7f8a600012f0 tx=0x7f8a6000ff40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:44.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.677+0000 7f8a7536c700 1 --2- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a701541e0 0x7f8a7009f300 secure :-1 s=THROTTLE_DONE pgs=835 cs=0 l=1 rx=0x7f8a600011d0 tx=0x7f8a68010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:44.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.677+0000 7f8a6dffb700 1 -- 172.21.15.63:0/499754710 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f8a680339c0 con 0x7f8a701541e0 2020-05-18T21:32:44.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:44.829+0000 7f8a75b6d700 1 -- 172.21.15.63:0/499754710 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8a700008d0 con 0x7f8a701541e0 2020-05-18T21:32:45.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.665+0000 7f8a7536c700 1 --2- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a701541e0 0x7f8a7009f300 secure :-1 s=READY pgs=835 cs=0 l=1 rx=0x7f8a600011d0 tx=0x7f8a68010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:45.718 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:32:45.713+0000 7fdb4592c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:32:45.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.729+0000 7f8a7536c700 1 --2- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a701541e0 0x7f8a7009f300 secure :-1 s=THROTTLE_DONE pgs=835 cs=0 l=1 rx=0x7f8a600011d0 tx=0x7f8a68010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:45.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.729+0000 7f8a6dffb700 1 -- 172.21.15.63:0/499754710 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v70) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8a68040ff0 con 0x7f8a701541e0 2020-05-18T21:32:45.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.729+0000 7f8a75b6d700 1 -- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8a5404fca0 msgr2=0x7f8a54052160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:45.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.729+0000 7f8a75b6d700 1 --2- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8a5404fca0 0x7f8a54052160 secure :-1 s=READY pgs=479 cs=0 l=1 rx=0x7f8a600012f0 tx=0x7f8a6000ff40).stop 2020-05-18T21:32:45.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.729+0000 7f8a75b6d700 1 -- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a701541e0 msgr2=0x7f8a7009f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:45.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.729+0000 7f8a75b6d700 1 --2- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a701541e0 0x7f8a7009f300 secure :-1 s=READY pgs=835 cs=0 l=1 rx=0x7f8a600011d0 tx=0x7f8a68010b50).stop 2020-05-18T21:32:45.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.733+0000 7f8a75b6d700 1 -- 172.21.15.63:0/499754710 shutdown_connections 2020-05-18T21:32:45.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.733+0000 7f8a75b6d700 1 --2- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8a5404fca0 0x7f8a54052160 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:45.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.733+0000 7f8a75b6d700 1 --2- 172.21.15.63:0/499754710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a701541e0 0x7f8a7009f300 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:45.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.733+0000 7f8a75b6d700 1 -- 172.21.15.63:0/499754710 >> 172.21.15.63:0/499754710 conn(0x7f8a700b6f40 msgr2=0x7f8a7005c160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:45.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.733+0000 7f8a75b6d700 1 -- 172.21.15.63:0/499754710 shutdown_connections 2020-05-18T21:32:45.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.733+0000 7f8a75b6d700 1 -- 172.21.15.63:0/499754710 wait complete. 2020-05-18T21:32:45.737 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-05-18T21:32:45.751 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:45.764 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:32:45.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.849+0000 7f78cf3a9700 1 Processor -- start 2020-05-18T21:32:45.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.849+0000 7f78cf3a9700 1 -- start start 2020-05-18T21:32:45.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.849+0000 7f78cf3a9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c80b93f0 0x7f78c8145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:45.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.849+0000 7f78cf3a9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f78c81435a0 0x7f78c8060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:45.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.849+0000 7f78cf3a9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c80b7020 con 0x7f78c80b7ca0 2020-05-18T21:32:45.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.849+0000 7f78cf3a9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c80b72c0 con 0x7f78c81435a0 2020-05-18T21:32:45.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.849+0000 7f78cf3a9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c80b7560 con 0x7f78c80b93f0 2020-05-18T21:32:45.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78ce3a7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c80b93f0 0x7f78c8145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:45.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78ceba8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f78c81435a0 0x7f78c8060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:45.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78ce3a7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c80b93f0 0x7f78c8145df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:49968/0 (socket says 172.21.15.63:49968) 2020-05-18T21:32:45.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78ce3a7700 1 -- 172.21.15.63:0/3173277789 learned_addr learned my addr 172.21.15.63:0/3173277789 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:45.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78ce3a7700 1 -- 172.21.15.63:0/3173277789 >> v2:172.21.15.155:3300/0 conn(0x7f78c81435a0 msgr2=0x7f78c8060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:45.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78ce3a7700 1 --2- 172.21.15.63:0/3173277789 >> v2:172.21.15.155:3300/0 conn(0x7f78c81435a0 0x7f78c8060430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:45.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78ce3a7700 1 -- 172.21.15.63:0/3173277789 >> v1:172.21.15.155:6789/0 conn(0x7f78c80b7ca0 legacy=0x7f78c8142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:45.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78ce3a7700 1 -- 172.21.15.63:0/3173277789 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c80b7800 con 0x7f78c80b93f0 2020-05-18T21:32:45.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78ce3a7700 1 --2- 172.21.15.63:0/3173277789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c80b93f0 0x7f78c8145df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f78c80b42e0 tx=0x7f78c4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:45.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78ce3a7700 1 --2- 172.21.15.63:0/3173277789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c80b93f0 0x7f78c8145df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f78c80b42e0 tx=0x7f78c4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:45.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78ce3a7700 1 --2- 172.21.15.63:0/3173277789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c80b93f0 0x7f78c8145df0 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f78c80b42e0 tx=0x7f78c4008920).ready entity=mon.2 client_cookie=d9b1f3787d0a7a1f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:45.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78ce3a7700 1 --2- 172.21.15.63:0/3173277789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c80b93f0 0x7f78c8145df0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f78c80b42e0 tx=0x7f78c4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:45.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78cd3a5700 1 -- 172.21.15.63:0/3173277789 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78c40116b0 con 0x7f78c80b93f0 2020-05-18T21:32:45.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78ce3a7700 1 --2- 172.21.15.63:0/3173277789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c80b93f0 0x7f78c8145df0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f78c80b42e0 tx=0x7f78c4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:45.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78cd3a5700 1 -- 172.21.15.63:0/3173277789 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c4011810 con 0x7f78c80b93f0 2020-05-18T21:32:45.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78ce3a7700 1 --2- 172.21.15.63:0/3173277789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c80b93f0 0x7f78c8145df0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f78c80b42e0 tx=0x7f78c4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:45.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78cd3a5700 1 -- 172.21.15.63:0/3173277789 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78c4011c30 con 0x7f78c80b93f0 2020-05-18T21:32:45.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78cf3a9700 1 -- 172.21.15.63:0/3173277789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c80b93f0 msgr2=0x7f78c8145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:45.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78cf3a9700 1 --2- 172.21.15.63:0/3173277789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c80b93f0 0x7f78c8145df0 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f78c80b42e0 tx=0x7f78c4008920).stop 2020-05-18T21:32:45.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78cf3a9700 1 -- 172.21.15.63:0/3173277789 shutdown_connections 2020-05-18T21:32:45.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78cf3a9700 1 --2- 172.21.15.63:0/3173277789 >> v2:172.21.15.155:3300/0 conn(0x7f78c81435a0 0x7f78c8060430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:45.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78cf3a9700 1 --2- 172.21.15.63:0/3173277789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c80b93f0 0x7f78c8145df0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78cf3a9700 1 -- 172.21.15.63:0/3173277789 >> 172.21.15.63:0/3173277789 conn(0x7f78c8069b70 msgr2=0x7f78c8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78cf3a9700 1 -- 172.21.15.63:0/3173277789 shutdown_connections 2020-05-18T21:32:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.853+0000 7f78cf3a9700 1 -- 172.21.15.63:0/3173277789 wait complete. 2020-05-18T21:32:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78cf3a9700 1 Processor -- start 2020-05-18T21:32:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78cf3a9700 1 -- start start 2020-05-18T21:32:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78cf3a9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f78c80b7ca0 0x7f78c80af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78cf3a9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f78c81435a0 0x7f78c80acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78cf3a9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c8157cb0 con 0x7f78c80b93f0 2020-05-18T21:32:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78cf3a9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c80af7a0 con 0x7f78c81435a0 2020-05-18T21:32:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78cf3a9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c8147020 con 0x7f78c80b7ca0 2020-05-18T21:32:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78ceba8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f78c81435a0 0x7f78c80acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78ceba8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f78c81435a0 0x7f78c80acd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59276/0 (socket says 172.21.15.63:59276) 2020-05-18T21:32:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78ceba8700 1 -- 172.21.15.63:0/2323582713 learned_addr learned my addr 172.21.15.63:0/2323582713 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78ce3a7700 1 --2- 172.21.15.63:0/2323582713 >> v2:172.21.15.155:3300/0 conn(0x7f78c80b7ca0 0x7f78c80af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78ceba8700 1 -- 172.21.15.63:0/2323582713 >> v2:172.21.15.155:3300/0 conn(0x7f78c80b7ca0 msgr2=0x7f78c80af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78ceba8700 1 --2- 172.21.15.63:0/2323582713 >> v2:172.21.15.155:3300/0 conn(0x7f78c80b7ca0 0x7f78c80af290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78ceba8700 1 -- 172.21.15.63:0/2323582713 >> v1:172.21.15.155:6789/0 conn(0x7f78c80b93f0 legacy=0x7f78c8156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78ceba8700 1 -- 172.21.15.63:0/2323582713 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c8157580 con 0x7f78c81435a0 2020-05-18T21:32:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78ceba8700 1 --2- 172.21.15.63:0/2323582713 >> v2:172.21.15.63:3300/0 conn(0x7f78c81435a0 0x7f78c80acd50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f78c00032f0 tx=0x7f78c0010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78ceba8700 1 --2- 172.21.15.63:0/2323582713 >> v2:172.21.15.63:3300/0 conn(0x7f78c81435a0 0x7f78c80acd50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f78c00032f0 tx=0x7f78c0010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:45.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78ceba8700 1 --2- 172.21.15.63:0/2323582713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78c81435a0 0x7f78c80acd50 secure :-1 s=READY pgs=1214 cs=0 l=1 rx=0x7f78c00032f0 tx=0x7f78c0010f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:45.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78ceba8700 1 --2- 172.21.15.63:0/2323582713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78c81435a0 0x7f78c80acd50 secure :-1 s=THROTTLE_DONE pgs=1214 cs=0 l=1 rx=0x7f78c00032f0 tx=0x7f78c0010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:45.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78ceba8700 1 --2- 172.21.15.63:0/2323582713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78c81435a0 0x7f78c80acd50 secure :-1 s=THROTTLE_DONE pgs=1214 cs=0 l=1 rx=0x7f78c00032f0 tx=0x7f78c0010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:45.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78ceba8700 1 --2- 172.21.15.63:0/2323582713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78c81435a0 0x7f78c80acd50 secure :-1 s=THROTTLE_DONE pgs=1214 cs=0 l=1 rx=0x7f78c00032f0 tx=0x7f78c0010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:45.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78b77fe700 1 -- 172.21.15.63:0/2323582713 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78c0005a80 con 0x7f78c81435a0 2020-05-18T21:32:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78b77fe700 1 -- 172.21.15.63:0/2323582713 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c0005be0 con 0x7f78c81435a0 2020-05-18T21:32:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78cf3a9700 1 -- 172.21.15.63:0/2323582713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c81484d0 con 0x7f78c81435a0 2020-05-18T21:32:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78b77fe700 1 -- 172.21.15.63:0/2323582713 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78c0012a00 con 0x7f78c81435a0 2020-05-18T21:32:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78cf3a9700 1 -- 172.21.15.63:0/2323582713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c81534b0 con 0x7f78c81435a0 2020-05-18T21:32:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.857+0000 7f78ceba8700 1 --2- 172.21.15.63:0/2323582713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78c81435a0 0x7f78c80acd50 secure :-1 s=THROTTLE_DONE pgs=1214 cs=0 l=1 rx=0x7f78c00032f0 tx=0x7f78c0010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.861+0000 7f78cf3a9700 1 -- 172.21.15.63:0/2323582713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c80569e0 con 0x7f78c81435a0 2020-05-18T21:32:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.861+0000 7f78b77fe700 1 -- 172.21.15.63:0/2323582713 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f78c0012c30 con 0x7f78c81435a0 2020-05-18T21:32:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.861+0000 7f78ceba8700 1 --2- 172.21.15.63:0/2323582713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78c81435a0 0x7f78c80acd50 secure :-1 s=THROTTLE_DONE pgs=1214 cs=0 l=1 rx=0x7f78c00032f0 tx=0x7f78c0010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:45.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.861+0000 7f78b77fe700 1 --2- 172.21.15.63:0/2323582713 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78a804fae0 0x7f78a8051fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:45.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.861+0000 7f78b77fe700 1 -- 172.21.15.63:0/2323582713 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f78c0063c80 con 0x7f78c81435a0 2020-05-18T21:32:45.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.861+0000 7f78ce3a7700 1 --2- 172.21.15.63:0/2323582713 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78a804fae0 0x7f78a8051fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:45.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.861+0000 7f78ce3a7700 1 --2- 172.21.15.63:0/2323582713 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78a804fae0 0x7f78a8051fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f78c80b42e0 tx=0x7f78c4011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:45.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.861+0000 7f78ce3a7700 1 --2- 172.21.15.63:0/2323582713 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78a804fae0 0x7f78a8051fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f78c80b42e0 tx=0x7f78c4011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:45.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.861+0000 7f78ce3a7700 1 --2- 172.21.15.63:0/2323582713 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78a804fae0 0x7f78a8051fa0 secure :-1 s=READY pgs=480 cs=0 l=1 rx=0x7f78c80b42e0 tx=0x7f78c4011460).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:45.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.865+0000 7f78ceba8700 1 --2- 172.21.15.63:0/2323582713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78c81435a0 0x7f78c80acd50 secure :-1 s=THROTTLE_DONE pgs=1214 cs=0 l=1 rx=0x7f78c00032f0 tx=0x7f78c0010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:45.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:45.865+0000 7f78b77fe700 1 -- 172.21.15.63:0/2323582713 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f78c003e010 con 0x7f78c81435a0 2020-05-18T21:32:46.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.017+0000 7f78cf3a9700 1 -- 172.21.15.63:0/2323582713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78c8061c40 con 0x7f78c81435a0 2020-05-18T21:32:46.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.017+0000 7f78ceba8700 1 --2- 172.21.15.63:0/2323582713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78c81435a0 0x7f78c80acd50 secure :-1 s=THROTTLE_DONE pgs=1214 cs=0 l=1 rx=0x7f78c00032f0 tx=0x7f78c0010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.017+0000 7f78b77fe700 1 -- 172.21.15.63:0/2323582713 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+1783 (secure 0 0 0) 0x7f78c0041630 con 0x7f78c81435a0 2020-05-18T21:32:46.022 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:46.022 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":70,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7603,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3212955782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3212955782},{"type":"v1","addr":"172.21.15.155:6835","nonce":3212955782}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":69}],"filesystems":[{"mdsmap":{"epoch":70,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:31:30.209891+0000","modified":"2020-05-18T21:32:45.718789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-05-18T21:32:46.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.017+0000 7f78cf3a9700 1 -- 172.21.15.63:0/2323582713 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78a804fae0 msgr2=0x7f78a8051fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:46.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.017+0000 7f78cf3a9700 1 --2- 172.21.15.63:0/2323582713 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78a804fae0 0x7f78a8051fa0 secure :-1 s=READY pgs=480 cs=0 l=1 rx=0x7f78c80b42e0 tx=0x7f78c4011460).stop 2020-05-18T21:32:46.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.017+0000 7f78cf3a9700 1 -- 172.21.15.63:0/2323582713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78c81435a0 msgr2=0x7f78c80acd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:46.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.017+0000 7f78cf3a9700 1 --2- 172.21.15.63:0/2323582713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78c81435a0 0x7f78c80acd50 secure :-1 s=READY pgs=1214 cs=0 l=1 rx=0x7f78c00032f0 tx=0x7f78c0010f70).stop 2020-05-18T21:32:46.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.017+0000 7f78cf3a9700 1 -- 172.21.15.63:0/2323582713 shutdown_connections 2020-05-18T21:32:46.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.021+0000 7f78cf3a9700 1 --2- 172.21.15.63:0/2323582713 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78a804fae0 0x7f78a8051fa0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:46.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.021+0000 7f78cf3a9700 1 --2- 172.21.15.63:0/2323582713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78c81435a0 0x7f78c80acd50 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:46.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.021+0000 7f78cf3a9700 1 --2- 172.21.15.63:0/2323582713 >> v2:172.21.15.155:3300/0 conn(0x7f78c80b7ca0 0x7f78c80af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:46.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.021+0000 7f78cf3a9700 1 -- 172.21.15.63:0/2323582713 >> 172.21.15.63:0/2323582713 conn(0x7f78c8069b70 msgr2=0x7f78c80b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:46.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.021+0000 7f78cf3a9700 1 -- 172.21.15.63:0/2323582713 shutdown_connections 2020-05-18T21:32:46.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.021+0000 7f78cf3a9700 1 -- 172.21.15.63:0/2323582713 wait complete. 2020-05-18T21:32:46.025 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 70 2020-05-18T21:32:46.034 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-05-18T21:32:46.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.141+0000 7f4c7e746700 1 Processor -- start 2020-05-18T21:32:46.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.141+0000 7f4c7e746700 1 -- start start 2020-05-18T21:32:46.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.141+0000 7f4c7e746700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4c78144b10 0x7f4c780adc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:46.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.141+0000 7f4c7e746700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4c78143e90 0x7f4c7809dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:46.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.141+0000 7f4c7e746700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c78144ef0 con 0x7f4c780b93c0 2020-05-18T21:32:46.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.141+0000 7f4c7e746700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c7809e400 con 0x7f4c78144b10 2020-05-18T21:32:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.141+0000 7f4c7e746700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c7809e640 con 0x7f4c78143e90 2020-05-18T21:32:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.141+0000 7f4c77fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4c78144b10 0x7f4c780adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.141+0000 7f4c77fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4c78144b10 0x7f4c780adc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59280/0 (socket says 172.21.15.63:59280) 2020-05-18T21:32:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.141+0000 7f4c77fff700 1 -- 172.21.15.63:0/2747758532 learned_addr learned my addr 172.21.15.63:0/2747758532 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c777fe700 1 --2- 172.21.15.63:0/2747758532 >> v2:172.21.15.155:3300/0 conn(0x7f4c78143e90 0x7f4c7809dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:46.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c77fff700 1 -- 172.21.15.63:0/2747758532 >> v2:172.21.15.155:3300/0 conn(0x7f4c78143e90 msgr2=0x7f4c7809dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:46.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c77fff700 1 --2- 172.21.15.63:0/2747758532 >> v2:172.21.15.155:3300/0 conn(0x7f4c78143e90 0x7f4c7809dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:46.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c77fff700 1 -- 172.21.15.63:0/2747758532 >> v1:172.21.15.155:6789/0 conn(0x7f4c780b93c0 legacy=0x7f4c7805ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:46.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c77fff700 1 -- 172.21.15.63:0/2747758532 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7809e8e0 con 0x7f4c78144b10 2020-05-18T21:32:46.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c77fff700 1 --2- 172.21.15.63:0/2747758532 >> v2:172.21.15.63:3300/0 conn(0x7f4c78144b10 0x7f4c780adc10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4c68002f70 tx=0x7f4c7806ae40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c77fff700 1 --2- 172.21.15.63:0/2747758532 >> v2:172.21.15.63:3300/0 conn(0x7f4c78144b10 0x7f4c780adc10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4c68002f70 tx=0x7f4c7806ae40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c77fff700 1 --2- 172.21.15.63:0/2747758532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c78144b10 0x7f4c780adc10 secure :-1 s=READY pgs=1215 cs=0 l=1 rx=0x7f4c68002f70 tx=0x7f4c7806ae40).ready entity=mon.0 client_cookie=f51e4847d9c18a61 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:46.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c77fff700 1 --2- 172.21.15.63:0/2747758532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c78144b10 0x7f4c780adc10 secure :-1 s=THROTTLE_DONE pgs=1215 cs=0 l=1 rx=0x7f4c68002f70 tx=0x7f4c7806ae40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c77fff700 1 --2- 172.21.15.63:0/2747758532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c78144b10 0x7f4c780adc10 secure :-1 s=THROTTLE_DONE pgs=1215 cs=0 l=1 rx=0x7f4c68002f70 tx=0x7f4c7806ae40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c76ffd700 1 -- 172.21.15.63:0/2747758532 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c68011760 con 0x7f4c78144b10 2020-05-18T21:32:46.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c77fff700 1 --2- 172.21.15.63:0/2747758532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c78144b10 0x7f4c780adc10 secure :-1 s=THROTTLE_DONE pgs=1215 cs=0 l=1 rx=0x7f4c68002f70 tx=0x7f4c7806ae40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c76ffd700 1 -- 172.21.15.63:0/2747758532 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c680118c0 con 0x7f4c78144b10 2020-05-18T21:32:46.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c76ffd700 1 -- 172.21.15.63:0/2747758532 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c68011ce0 con 0x7f4c78144b10 2020-05-18T21:32:46.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c7e746700 1 -- 172.21.15.63:0/2747758532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c78144b10 msgr2=0x7f4c780adc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:46.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c7e746700 1 --2- 172.21.15.63:0/2747758532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c78144b10 0x7f4c780adc10 secure :-1 s=READY pgs=1215 cs=0 l=1 rx=0x7f4c68002f70 tx=0x7f4c7806ae40).stop 2020-05-18T21:32:46.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c7e746700 1 -- 172.21.15.63:0/2747758532 shutdown_connections 2020-05-18T21:32:46.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c7e746700 1 --2- 172.21.15.63:0/2747758532 >> v2:172.21.15.155:3300/0 conn(0x7f4c78143e90 0x7f4c7809dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:46.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c7e746700 1 --2- 172.21.15.63:0/2747758532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c78144b10 0x7f4c780adc10 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:46.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c7e746700 1 -- 172.21.15.63:0/2747758532 >> 172.21.15.63:0/2747758532 conn(0x7f4c7805b290 msgr2=0x7f4c780b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:46.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c7e746700 1 -- 172.21.15.63:0/2747758532 shutdown_connections 2020-05-18T21:32:46.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.145+0000 7f4c7e746700 1 -- 172.21.15.63:0/2747758532 wait complete. 2020-05-18T21:32:46.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c7e746700 1 Processor -- start 2020-05-18T21:32:46.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c7e746700 1 -- start start 2020-05-18T21:32:46.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c7e746700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4c78143e90 0x7f4c780b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:46.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c7e746700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c780b2f90 con 0x7f4c78144b10 2020-05-18T21:32:46.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c7e746700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c781510d0 con 0x7f4c780b93c0 2020-05-18T21:32:46.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c7e746700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c78140a20 con 0x7f4c78143e90 2020-05-18T21:32:46.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c7cce3700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4c78144b10 0x7f4c78065d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33246/0 (socket says 172.21.15.63:33246) 2020-05-18T21:32:46.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c7cce3700 1 -- 172.21.15.63:0/3332747922 learned_addr learned my addr 172.21.15.63:0/3332747922 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:46.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c777fe700 1 --2- 172.21.15.63:0/3332747922 >> v2:172.21.15.155:3300/0 conn(0x7f4c78143e90 0x7f4c780b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:46.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487910885 0 0) 0x7f4c780b2f90 con 0x7f4c78144b10 2020-05-18T21:32:46.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c58002fe0 con 0x7f4c78144b10 2020-05-18T21:32:46.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863835283 0 0) 0x7f4c781510d0 con 0x7f4c780b93c0 2020-05-18T21:32:46.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c780b2f90 con 0x7f4c780b93c0 2020-05-18T21:32:46.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2327154711 0 0) 0x7f4c58002fe0 con 0x7f4c78144b10 2020-05-18T21:32:46.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4c781510d0 con 0x7f4c78144b10 2020-05-18T21:32:46.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f4c70001c70 con 0x7f4c78144b10 2020-05-18T21:32:46.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 >> v2:172.21.15.155:3300/0 conn(0x7f4c78143e90 msgr2=0x7f4c780b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:46.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c757fa700 1 --2- 172.21.15.63:0/3332747922 >> v2:172.21.15.155:3300/0 conn(0x7f4c78143e90 0x7f4c780b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:46.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 >> v1:172.21.15.155:6789/0 conn(0x7f4c780b93c0 legacy=0x7f4c78151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:46.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 >> v1:172.21.15.63:6789/0 conn(0x7f4c78144b10 legacy=0x7f4c78065d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:46.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c757fa700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c58004bf0 0x7f4c58004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:46.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c757fa700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c58003b30 0x7f4c58003f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:46.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c757fa700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c580044b0 0x7f4c5800b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:46.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c78140a20 con 0x7f4c58003b30 2020-05-18T21:32:46.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5800bbc0 con 0x7f4c58004bf0 2020-05-18T21:32:46.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5800bd80 con 0x7f4c580044b0 2020-05-18T21:32:46.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c777fe700 1 --2- 172.21.15.63:0/3332747922 >> v2:172.21.15.155:3300/0 conn(0x7f4c78143e90 0x7f4c780b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:46.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c777fe700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c58003b30 0x7f4c58003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:46.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c77fff700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c58004bf0 0x7f4c58004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:46.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.149+0000 7f4c7cce3700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c580044b0 0x7f4c5800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:46.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c777fe700 1 -- 172.21.15.63:0/3332747922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c580044b0 msgr2=0x7f4c5800b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:46.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c777fe700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c580044b0 0x7f4c5800b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:46.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c777fe700 1 -- 172.21.15.63:0/3332747922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c58004bf0 msgr2=0x7f4c58004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:46.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c777fe700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c58004bf0 0x7f4c58004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:46.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c777fe700 1 -- 172.21.15.63:0/3332747922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c78151370 con 0x7f4c58003b30 2020-05-18T21:32:46.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c7cce3700 1 -- 172.21.15.63:0/3332747922 reap_dead start 2020-05-18T21:32:46.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c7e746700 1 -- 172.21.15.63:0/3332747922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c78151f20 con 0x7f4c58003b30 2020-05-18T21:32:46.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c777fe700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c58003b30 0x7f4c58003f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4c6c002f70 tx=0x7f4c6c0112c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c7e746700 1 -- 172.21.15.63:0/3332747922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c780b2af0 con 0x7f4c58003b30 2020-05-18T21:32:46.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c777fe700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c58003b30 0x7f4c58003f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4c6c002f70 tx=0x7f4c6c0112c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c777fe700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c58003b30 0x7f4c58003f70 secure :-1 s=READY pgs=1217 cs=0 l=1 rx=0x7f4c6c002f70 tx=0x7f4c6c0112c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:46.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c777fe700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c58003b30 0x7f4c58003f70 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7f4c6c002f70 tx=0x7f4c6c0112c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c6c00b2f0 con 0x7f4c58003b30 2020-05-18T21:32:46.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c777fe700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c58003b30 0x7f4c58003f70 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7f4c6c002f70 tx=0x7f4c6c0112c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c777fe700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c58003b30 0x7f4c58003f70 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7f4c6c002f70 tx=0x7f4c6c0112c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6c007390 con 0x7f4c58003b30 2020-05-18T21:32:46.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c6c011870 con 0x7f4c58003b30 2020-05-18T21:32:46.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c777fe700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c58003b30 0x7f4c58003f70 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7f4c6c002f70 tx=0x7f4c6c0112c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c7e746700 1 -- 172.21.15.63:0/3332747922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c54003380 con 0x7f4c58003b30 2020-05-18T21:32:46.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4c6c0119d0 con 0x7f4c58003b30 2020-05-18T21:32:46.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c777fe700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c58003b30 0x7f4c58003f70 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7f4c6c002f70 tx=0x7f4c6c0112c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c757fa700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4c58053c30 0x7f4c580560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:46.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f4c6c063ad0 con 0x7f4c58003b30 2020-05-18T21:32:46.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c77fff700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4c58053c30 0x7f4c580560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:46.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c77fff700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4c58053c30 0x7f4c580560f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4c68007f10 tx=0x7f4c7806ae40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c77fff700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4c58053c30 0x7f4c580560f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4c68007f10 tx=0x7f4c7806ae40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.153+0000 7f4c77fff700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4c58053c30 0x7f4c580560f0 secure :-1 s=READY pgs=481 cs=0 l=1 rx=0x7f4c68007f10 tx=0x7f4c7806ae40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:46.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.161+0000 7f4c777fe700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c58003b30 0x7f4c58003f70 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7f4c6c002f70 tx=0x7f4c6c0112c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.161+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f4c6c03df20 con 0x7f4c58003b30 2020-05-18T21:32:46.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.309+0000 7f4c7e746700 1 -- 172.21.15.63:0/3332747922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4c54002240 con 0x7f4c58003b30 2020-05-18T21:32:46.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.841+0000 7f4c777fe700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c58003b30 0x7f4c58003f70 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7f4c6c002f70 tx=0x7f4c6c0112c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.841+0000 7f4c757fa700 1 -- 172.21.15.63:0/3332747922 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v71) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4c6c041540 con 0x7f4c58003b30 2020-05-18T21:32:46.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.845+0000 7f4c7e746700 1 -- 172.21.15.63:0/3332747922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4c58053c30 msgr2=0x7f4c580560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:46.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.845+0000 7f4c7e746700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4c58053c30 0x7f4c580560f0 secure :-1 s=READY pgs=481 cs=0 l=1 rx=0x7f4c68007f10 tx=0x7f4c7806ae40).stop 2020-05-18T21:32:46.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.845+0000 7f4c7e746700 1 -- 172.21.15.63:0/3332747922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c58003b30 msgr2=0x7f4c58003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:46.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.845+0000 7f4c7e746700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c58003b30 0x7f4c58003f70 secure :-1 s=READY pgs=1217 cs=0 l=1 rx=0x7f4c6c002f70 tx=0x7f4c6c0112c0).stop 2020-05-18T21:32:46.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.845+0000 7f4c7e746700 1 -- 172.21.15.63:0/3332747922 shutdown_connections 2020-05-18T21:32:46.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.845+0000 7f4c7e746700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4c58053c30 0x7f4c580560f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:46.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.845+0000 7f4c7e746700 1 --2- 172.21.15.63:0/3332747922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c58003b30 0x7f4c58003f70 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:46.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.845+0000 7f4c7e746700 1 -- 172.21.15.63:0/3332747922 >> 172.21.15.63:0/3332747922 conn(0x7f4c7805b290 msgr2=0x7f4c7805c280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:46.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.845+0000 7f4c7e746700 1 -- 172.21.15.63:0/3332747922 shutdown_connections 2020-05-18T21:32:46.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.845+0000 7f4c7e746700 1 -- 172.21.15.63:0/3332747922 wait complete. 2020-05-18T21:32:46.865 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-05-18T21:32:46.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.977+0000 7fc609bd3700 1 Processor -- start 2020-05-18T21:32:46.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.977+0000 7fc609bd3700 1 -- start start 2020-05-18T21:32:46.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.977+0000 7fc609bd3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc60409dfb0 0x7fc60406a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:46.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.977+0000 7fc609bd3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604145e10 0x7fc6040b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:46.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.977+0000 7fc609bd3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6040b5f10 con 0x7fc6040b65e0 2020-05-18T21:32:46.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.977+0000 7fc609bd3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6040b6140 con 0x7fc60409dfb0 2020-05-18T21:32:46.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.977+0000 7fc609bd3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60409e390 con 0x7fc604145e10 2020-05-18T21:32:46.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.977+0000 7fc6093d2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604145e10 0x7fc6040b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:46.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.977+0000 7fc603fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fc6040b65e0 0x7fc604145700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:59804/0 (socket says 172.21.15.63:59804) 2020-05-18T21:32:46.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.977+0000 7fc603fff700 1 -- 172.21.15.63:0/1566164431 learned_addr learned my addr 172.21.15.63:0/1566164431 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:46.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.977+0000 7fc608bd1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc60409dfb0 0x7fc60406a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:46.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc6037fe700 1 -- 172.21.15.63:0/1566164431 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293235493 0 0) 0x7fc6040b5f10 con 0x7fc6040b65e0 2020-05-18T21:32:46.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc6037fe700 1 -- 172.21.15.63:0/1566164431 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5f0003270 con 0x7fc6040b65e0 2020-05-18T21:32:46.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc6093d2700 1 -- 172.21.15.63:0/1566164431 >> v2:172.21.15.155:3300/0 conn(0x7fc60409dfb0 msgr2=0x7fc60406a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:46.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc6093d2700 1 --2- 172.21.15.63:0/1566164431 >> v2:172.21.15.155:3300/0 conn(0x7fc60409dfb0 0x7fc60406a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:46.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc6093d2700 1 -- 172.21.15.63:0/1566164431 >> v1:172.21.15.155:6789/0 conn(0x7fc6040b65e0 legacy=0x7fc604145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:46.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc6093d2700 1 -- 172.21.15.63:0/1566164431 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60406aa10 con 0x7fc604145e10 2020-05-18T21:32:46.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc6093d2700 1 --2- 172.21.15.63:0/1566164431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604145e10 0x7fc6040b6a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc5fc0032f0 tx=0x7fc5fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc6093d2700 1 --2- 172.21.15.63:0/1566164431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604145e10 0x7fc6040b6a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc5fc0032f0 tx=0x7fc5fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc6093d2700 1 --2- 172.21.15.63:0/1566164431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604145e10 0x7fc6040b6a50 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7fc5fc0032f0 tx=0x7fc5fc007e00).ready entity=mon.2 client_cookie=5de7216c6aeb95c8 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:46.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc6093d2700 1 --2- 172.21.15.63:0/1566164431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604145e10 0x7fc6040b6a50 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fc5fc0032f0 tx=0x7fc5fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc6037fe700 1 -- 172.21.15.63:0/1566164431 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5fc011db0 con 0x7fc604145e10 2020-05-18T21:32:46.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc6093d2700 1 --2- 172.21.15.63:0/1566164431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604145e10 0x7fc6040b6a50 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fc5fc0032f0 tx=0x7fc5fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc6037fe700 1 -- 172.21.15.63:0/1566164431 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc00a180 con 0x7fc604145e10 2020-05-18T21:32:46.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc6093d2700 1 --2- 172.21.15.63:0/1566164431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604145e10 0x7fc6040b6a50 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fc5fc0032f0 tx=0x7fc5fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc6037fe700 1 -- 172.21.15.63:0/1566164431 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5fc00a560 con 0x7fc604145e10 2020-05-18T21:32:46.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc609bd3700 1 -- 172.21.15.63:0/1566164431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604145e10 msgr2=0x7fc6040b6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:46.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc609bd3700 1 --2- 172.21.15.63:0/1566164431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604145e10 0x7fc6040b6a50 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7fc5fc0032f0 tx=0x7fc5fc007e00).stop 2020-05-18T21:32:46.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc609bd3700 1 -- 172.21.15.63:0/1566164431 shutdown_connections 2020-05-18T21:32:46.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc609bd3700 1 --2- 172.21.15.63:0/1566164431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604145e10 0x7fc6040b6a50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:46.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc609bd3700 1 --2- 172.21.15.63:0/1566164431 >> v2:172.21.15.155:3300/0 conn(0x7fc60409dfb0 0x7fc60406a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:46.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc609bd3700 1 -- 172.21.15.63:0/1566164431 >> 172.21.15.63:0/1566164431 conn(0x7fc60405a7c0 msgr2=0x7fc60405aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:46.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc609bd3700 1 -- 172.21.15.63:0/1566164431 shutdown_connections 2020-05-18T21:32:46.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.981+0000 7fc609bd3700 1 -- 172.21.15.63:0/1566164431 wait complete. 2020-05-18T21:32:46.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.985+0000 7fc609bd3700 1 Processor -- start 2020-05-18T21:32:46.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.985+0000 7fc609bd3700 1 -- start start 2020-05-18T21:32:46.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.985+0000 7fc609bd3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc6040b65e0 0x7fc6041400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:46.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.985+0000 7fc609bd3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604145e10 0x7fc604153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:46.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.985+0000 7fc609bd3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc604114400 con 0x7fc60409dfb0 2020-05-18T21:32:46.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.985+0000 7fc609bd3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6041146a0 con 0x7fc6040b65e0 2020-05-18T21:32:46.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.985+0000 7fc609bd3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc604114940 con 0x7fc604145e10 2020-05-18T21:32:46.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.985+0000 7fc603fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc6040b65e0 0x7fc6041400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:46.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.985+0000 7fc608bd1700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fc60409dfb0 0x7fc60413f990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:59810/0 (socket says 172.21.15.63:59810) 2020-05-18T21:32:46.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.985+0000 7fc608bd1700 1 -- 172.21.15.63:0/2543688672 learned_addr learned my addr 172.21.15.63:0/2543688672 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:46.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.985+0000 7fc6093d2700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604145e10 0x7fc604153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:46.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc601ffb700 1 -- 172.21.15.63:0/2543688672 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702025552 0 0) 0x7fc604114400 con 0x7fc60409dfb0 2020-05-18T21:32:46.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc601ffb700 1 -- 172.21.15.63:0/2543688672 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5e4002fe0 con 0x7fc60409dfb0 2020-05-18T21:32:46.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc603fff700 1 -- 172.21.15.63:0/2543688672 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604145e10 msgr2=0x7fc604153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:46.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc603fff700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604145e10 0x7fc604153840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:46.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc603fff700 1 -- 172.21.15.63:0/2543688672 >> v1:172.21.15.155:6789/0 conn(0x7fc60409dfb0 legacy=0x7fc60413f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:46.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc603fff700 1 -- 172.21.15.63:0/2543688672 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc604114de0 con 0x7fc6040b65e0 2020-05-18T21:32:46.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc6093d2700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604145e10 0x7fc604153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:46.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc603fff700 1 --2- 172.21.15.63:0/2543688672 >> v2:172.21.15.63:3300/0 conn(0x7fc6040b65e0 0x7fc6041400a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc5f8001110 tx=0x7fc5f8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc603fff700 1 --2- 172.21.15.63:0/2543688672 >> v2:172.21.15.63:3300/0 conn(0x7fc6040b65e0 0x7fc6041400a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc5f8001110 tx=0x7fc5f8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc603fff700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6040b65e0 0x7fc6041400a0 secure :-1 s=READY pgs=1218 cs=0 l=1 rx=0x7fc5f8001110 tx=0x7fc5f8010930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:46.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc603fff700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6040b65e0 0x7fc6041400a0 secure :-1 s=THROTTLE_DONE pgs=1218 cs=0 l=1 rx=0x7fc5f8001110 tx=0x7fc5f8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc601ffb700 1 -- 172.21.15.63:0/2543688672 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5f8005d00 con 0x7fc6040b65e0 2020-05-18T21:32:46.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc603fff700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6040b65e0 0x7fc6041400a0 secure :-1 s=THROTTLE_DONE pgs=1218 cs=0 l=1 rx=0x7fc5f8001110 tx=0x7fc5f8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc601ffb700 1 -- 172.21.15.63:0/2543688672 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f8005e60 con 0x7fc6040b65e0 2020-05-18T21:32:46.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc609bd3700 1 -- 172.21.15.63:0/2543688672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc604144a00 con 0x7fc6040b65e0 2020-05-18T21:32:46.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc603fff700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6040b65e0 0x7fc6041400a0 secure :-1 s=THROTTLE_DONE pgs=1218 cs=0 l=1 rx=0x7fc5f8001110 tx=0x7fc5f8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:46.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc601ffb700 1 -- 172.21.15.63:0/2543688672 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5f80062c0 con 0x7fc6040b65e0 2020-05-18T21:32:46.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc609bd3700 1 -- 172.21.15.63:0/2543688672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc604113cf0 con 0x7fc6040b65e0 2020-05-18T21:32:47.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc603fff700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6040b65e0 0x7fc6041400a0 secure :-1 s=THROTTLE_DONE pgs=1218 cs=0 l=1 rx=0x7fc5f8001110 tx=0x7fc5f8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:47.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc609bd3700 1 -- 172.21.15.63:0/2543688672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6040569e0 con 0x7fc6040b65e0 2020-05-18T21:32:47.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc601ffb700 1 -- 172.21.15.63:0/2543688672 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc5f8006580 con 0x7fc6040b65e0 2020-05-18T21:32:47.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.989+0000 7fc603fff700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6040b65e0 0x7fc6041400a0 secure :-1 s=THROTTLE_DONE pgs=1218 cs=0 l=1 rx=0x7fc5f8001110 tx=0x7fc5f8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:47.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.993+0000 7fc601ffb700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc5e404fd20 0x7fc5e40521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:47.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.993+0000 7fc601ffb700 1 -- 172.21.15.63:0/2543688672 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6331+0+0 (secure 0 0 0) 0x7fc5f80090c0 con 0x7fc6040b65e0 2020-05-18T21:32:47.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.993+0000 7fc608bd1700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc5e404fd20 0x7fc5e40521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:47.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.993+0000 7fc608bd1700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc5e404fd20 0x7fc5e40521e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc5f4002f70 tx=0x7fc5f40090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:47.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.993+0000 7fc608bd1700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc5e404fd20 0x7fc5e40521e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc5f4002f70 tx=0x7fc5f40090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:47.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.993+0000 7fc608bd1700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc5e404fd20 0x7fc5e40521e0 secure :-1 s=READY pgs=482 cs=0 l=1 rx=0x7fc5f4002f70 tx=0x7fc5f40090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:47.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.997+0000 7fc603fff700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6040b65e0 0x7fc6041400a0 secure :-1 s=THROTTLE_DONE pgs=1218 cs=0 l=1 rx=0x7fc5f8001110 tx=0x7fc5f8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:47.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:46.997+0000 7fc601ffb700 1 -- 172.21.15.63:0/2543688672 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc5f803e050 con 0x7fc6040b65e0 2020-05-18T21:32:47.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.113+0000 7fc609bd3700 1 -- 172.21.15.63:0/2543688672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc604114ab0 con 0x7fc6040b65e0 2020-05-18T21:32:47.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.849+0000 7fc603fff700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6040b65e0 0x7fc6041400a0 secure :-1 s=THROTTLE_DONE pgs=1218 cs=0 l=1 rx=0x7fc5f8001110 tx=0x7fc5f8010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:47.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.849+0000 7fc601ffb700 1 -- 172.21.15.63:0/2543688672 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v88) v1 ==== 185+0+0 (secure 0 0 0) 0x7fc5f8041670 con 0x7fc6040b65e0 2020-05-18T21:32:47.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.857+0000 7fc609bd3700 1 -- 172.21.15.63:0/2543688672 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc5e404fd20 msgr2=0x7fc5e40521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:47.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.857+0000 7fc609bd3700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc5e404fd20 0x7fc5e40521e0 secure :-1 s=READY pgs=482 cs=0 l=1 rx=0x7fc5f4002f70 tx=0x7fc5f40090f0).stop 2020-05-18T21:32:47.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.857+0000 7fc609bd3700 1 -- 172.21.15.63:0/2543688672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6040b65e0 msgr2=0x7fc6041400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:47.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.857+0000 7fc609bd3700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6040b65e0 0x7fc6041400a0 secure :-1 s=READY pgs=1218 cs=0 l=1 rx=0x7fc5f8001110 tx=0x7fc5f8010930).stop 2020-05-18T21:32:47.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.857+0000 7fc609bd3700 1 -- 172.21.15.63:0/2543688672 shutdown_connections 2020-05-18T21:32:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.857+0000 7fc609bd3700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc5e404fd20 0x7fc5e40521e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.857+0000 7fc609bd3700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc604145e10 0x7fc604153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.857+0000 7fc609bd3700 1 --2- 172.21.15.63:0/2543688672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6040b65e0 0x7fc6041400a0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.857+0000 7fc609bd3700 1 -- 172.21.15.63:0/2543688672 >> 172.21.15.63:0/2543688672 conn(0x7fc60405a7c0 msgr2=0x7fc60405f340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.857+0000 7fc609bd3700 1 -- 172.21.15.63:0/2543688672 shutdown_connections 2020-05-18T21:32:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.857+0000 7fc609bd3700 1 -- 172.21.15.63:0/2543688672 wait complete. 2020-05-18T21:32:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2020-05-18T21:32:47.872 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-05-18T21:32:47.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.981+0000 7f859ce67700 1 Processor -- start 2020-05-18T21:32:47.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.981+0000 7f859ce67700 1 -- start start 2020-05-18T21:32:47.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.981+0000 7f859ce67700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85980b4df0 0x7f85980b2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:47.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.981+0000 7f859ce67700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f85981437c0 0x7f85980b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:47.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.981+0000 7f859ce67700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85980b5770 con 0x7f8598062a50 2020-05-18T21:32:47.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.981+0000 7f859ce67700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85980b54d0 con 0x7f85980b4df0 2020-05-18T21:32:47.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.981+0000 7f859ce67700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85980b51d0 con 0x7f85981437c0 2020-05-18T21:32:47.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.981+0000 7f85977fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85980b4df0 0x7f85980b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:47.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.981+0000 7f85977fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85980b4df0 0x7f85980b2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59314/0 (socket says 172.21.15.63:59314) 2020-05-18T21:32:47.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.981+0000 7f85977fe700 1 -- 172.21.15.63:0/4061065570 learned_addr learned my addr 172.21.15.63:0/4061065570 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:47.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.981+0000 7f8597fff700 1 --2- 172.21.15.63:0/4061065570 >> v2:172.21.15.155:3300/0 conn(0x7f85981437c0 0x7f85980b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:47.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.981+0000 7f85977fe700 1 -- 172.21.15.63:0/4061065570 >> v2:172.21.15.155:3300/0 conn(0x7f85981437c0 msgr2=0x7f85980b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:47.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.981+0000 7f85977fe700 1 --2- 172.21.15.63:0/4061065570 >> v2:172.21.15.155:3300/0 conn(0x7f85981437c0 0x7f85980b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:47.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.981+0000 7f85977fe700 1 -- 172.21.15.63:0/4061065570 >> v1:172.21.15.155:6789/0 conn(0x7f8598062a50 legacy=0x7f85981430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:47.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.981+0000 7f85977fe700 1 -- 172.21.15.63:0/4061065570 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8598062ec0 con 0x7f85980b4df0 2020-05-18T21:32:47.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.981+0000 7f85977fe700 1 --2- 172.21.15.63:0/4061065570 >> v2:172.21.15.63:3300/0 conn(0x7f85980b4df0 0x7f85980b2070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8588002f70 tx=0x7f8588007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:47.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.981+0000 7f85977fe700 1 --2- 172.21.15.63:0/4061065570 >> v2:172.21.15.63:3300/0 conn(0x7f85980b4df0 0x7f85980b2070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8588002f70 tx=0x7f8588007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:47.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.985+0000 7f85977fe700 1 --2- 172.21.15.63:0/4061065570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85980b4df0 0x7f85980b2070 secure :-1 s=READY pgs=1219 cs=0 l=1 rx=0x7f8588002f70 tx=0x7f8588007a80).ready entity=mon.0 client_cookie=ad61d0e92c305d63 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.985+0000 7f85977fe700 1 --2- 172.21.15.63:0/4061065570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85980b4df0 0x7f85980b2070 secure :-1 s=THROTTLE_DONE pgs=1219 cs=0 l=1 rx=0x7f8588002f70 tx=0x7f8588007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.985+0000 7f85977fe700 1 --2- 172.21.15.63:0/4061065570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85980b4df0 0x7f85980b2070 secure :-1 s=THROTTLE_DONE pgs=1219 cs=0 l=1 rx=0x7f8588002f70 tx=0x7f8588007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.985+0000 7f8596ffd700 1 -- 172.21.15.63:0/4061065570 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85880116b0 con 0x7f85980b4df0 2020-05-18T21:32:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.985+0000 7f85977fe700 1 --2- 172.21.15.63:0/4061065570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85980b4df0 0x7f85980b2070 secure :-1 s=THROTTLE_DONE pgs=1219 cs=0 l=1 rx=0x7f8588002f70 tx=0x7f8588007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.985+0000 7f8596ffd700 1 -- 172.21.15.63:0/4061065570 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8588011810 con 0x7f85980b4df0 2020-05-18T21:32:47.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.985+0000 7f8596ffd700 1 -- 172.21.15.63:0/4061065570 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8588011c30 con 0x7f85980b4df0 2020-05-18T21:32:47.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.985+0000 7f859ce67700 1 -- 172.21.15.63:0/4061065570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85980b4df0 msgr2=0x7f85980b2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:47.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.985+0000 7f859ce67700 1 --2- 172.21.15.63:0/4061065570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85980b4df0 0x7f85980b2070 secure :-1 s=READY pgs=1219 cs=0 l=1 rx=0x7f8588002f70 tx=0x7f8588007a80).stop 2020-05-18T21:32:47.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.985+0000 7f859ce67700 1 -- 172.21.15.63:0/4061065570 shutdown_connections 2020-05-18T21:32:47.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.985+0000 7f859ce67700 1 --2- 172.21.15.63:0/4061065570 >> v2:172.21.15.155:3300/0 conn(0x7f85981437c0 0x7f85980b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:47.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.985+0000 7f859ce67700 1 --2- 172.21.15.63:0/4061065570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85980b4df0 0x7f85980b2070 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:47.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.985+0000 7f859ce67700 1 -- 172.21.15.63:0/4061065570 >> 172.21.15.63:0/4061065570 conn(0x7f8598069b70 msgr2=0x7f8598069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:47.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.985+0000 7f859ce67700 1 -- 172.21.15.63:0/4061065570 shutdown_connections 2020-05-18T21:32:47.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.985+0000 7f859ce67700 1 -- 172.21.15.63:0/4061065570 wait complete. 2020-05-18T21:32:47.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.985+0000 7f859ce67700 1 Processor -- start 2020-05-18T21:32:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.985+0000 7f859ce67700 1 -- start start 2020-05-18T21:32:47.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f859ce67700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f85980b4df0 0x7f85981133f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:47.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f859ce67700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85981437c0 0x7f85980ae470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:47.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f859ce67700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8598151dd0 con 0x7f8598062a50 2020-05-18T21:32:47.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f859ce67700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85980afe50 con 0x7f85980b4df0 2020-05-18T21:32:47.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f859ce67700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85980b02f0 con 0x7f85981437c0 2020-05-18T21:32:47.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f85977fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8598062a50 0x7f85980b0ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33276/0 (socket says 172.21.15.63:33276) 2020-05-18T21:32:47.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f85977fe700 1 -- 172.21.15.63:0/3023103788 learned_addr learned my addr 172.21.15.63:0/3023103788 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:47.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f858ffff700 1 --2- 172.21.15.63:0/3023103788 >> v2:172.21.15.155:3300/0 conn(0x7f85980b4df0 0x7f85981133f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:47.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f8597fff700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85981437c0 0x7f85980ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:47.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f85957fa700 1 -- 172.21.15.63:0/3023103788 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090325125 0 0) 0x7f8598151dd0 con 0x7f8598062a50 2020-05-18T21:32:47.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f85957fa700 1 -- 172.21.15.63:0/3023103788 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f857c002fe0 con 0x7f8598062a50 2020-05-18T21:32:48.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f8597fff700 1 -- 172.21.15.63:0/3023103788 >> v2:172.21.15.155:3300/0 conn(0x7f85980b4df0 msgr2=0x7f85981133f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:48.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f8597fff700 1 --2- 172.21.15.63:0/3023103788 >> v2:172.21.15.155:3300/0 conn(0x7f85980b4df0 0x7f85981133f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:48.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f8597fff700 1 -- 172.21.15.63:0/3023103788 >> v1:172.21.15.63:6789/0 conn(0x7f8598062a50 legacy=0x7f85980b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:48.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f8597fff700 1 -- 172.21.15.63:0/3023103788 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8598151a80 con 0x7f85981437c0 2020-05-18T21:32:48.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f858ffff700 1 --2- 172.21.15.63:0/3023103788 >> v2:172.21.15.155:3300/0 conn(0x7f85980b4df0 0x7f85981133f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f8597fff700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85981437c0 0x7f85980ae470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f85981156b0 tx=0x7f8590010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f8597fff700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85981437c0 0x7f85980ae470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f85981156b0 tx=0x7f8590010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f8597fff700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85981437c0 0x7f85980ae470 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7f85981156b0 tx=0x7f8590010f00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f8597fff700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85981437c0 0x7f85980ae470 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f85981156b0 tx=0x7f8590010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f85957fa700 1 -- 172.21.15.63:0/3023103788 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8590005a80 con 0x7f85981437c0 2020-05-18T21:32:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f8597fff700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85981437c0 0x7f85980ae470 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f85981156b0 tx=0x7f8590010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f8597fff700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85981437c0 0x7f85980ae470 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f85981156b0 tx=0x7f8590010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f85957fa700 1 -- 172.21.15.63:0/3023103788 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8590005be0 con 0x7f85981437c0 2020-05-18T21:32:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f85957fa700 1 -- 172.21.15.63:0/3023103788 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f859000c940 con 0x7f85981437c0 2020-05-18T21:32:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f859ce67700 1 -- 172.21.15.63:0/3023103788 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85980b11e0 con 0x7f85981437c0 2020-05-18T21:32:48.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.989+0000 7f859ce67700 1 -- 172.21.15.63:0/3023103788 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85980aeaf0 con 0x7f85981437c0 2020-05-18T21:32:48.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.993+0000 7f8597fff700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85981437c0 0x7f85980ae470 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f85981156b0 tx=0x7f8590010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:48.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.993+0000 7f859ce67700 1 -- 172.21.15.63:0/3023103788 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8598151c10 con 0x7f85981437c0 2020-05-18T21:32:48.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.993+0000 7f8597fff700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85981437c0 0x7f85980ae470 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f85981156b0 tx=0x7f8590010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:48.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.993+0000 7f85957fa700 1 -- 172.21.15.63:0/3023103788 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f859000cb40 con 0x7f85981437c0 2020-05-18T21:32:48.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.993+0000 7f85957fa700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f857c04fd10 0x7f857c0521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:48.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.993+0000 7f85957fa700 1 -- 172.21.15.63:0/3023103788 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5893+0+0 (secure 0 0 0) 0x7f8590063ab0 con 0x7f85981437c0 2020-05-18T21:32:48.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.993+0000 7f85977fe700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f857c04fd10 0x7f857c0521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:48.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.993+0000 7f85977fe700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f857c04fd10 0x7f857c0521d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8588000bc0 tx=0x7f8588007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:48.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.993+0000 7f85977fe700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f857c04fd10 0x7f857c0521d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8588000bc0 tx=0x7f8588007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:48.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:47.993+0000 7f85977fe700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f857c04fd10 0x7f857c0521d0 secure :-1 s=READY pgs=483 cs=0 l=1 rx=0x7f8588000bc0 tx=0x7f8588007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:48.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.001+0000 7f8597fff700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85981437c0 0x7f85980ae470 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f85981156b0 tx=0x7f8590010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:48.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.001+0000 7f85957fa700 1 -- 172.21.15.63:0/3023103788 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f859003de00 con 0x7f85981437c0 2020-05-18T21:32:48.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.121+0000 7f859ce67700 1 -- 172.21.15.63:0/3023103788 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f85980569e0 con 0x7f85981437c0 2020-05-18T21:32:48.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.857+0000 7f8597fff700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85981437c0 0x7f85980ae470 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f85981156b0 tx=0x7f8590010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:48.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.857+0000 7f85957fa700 1 -- 172.21.15.63:0/3023103788 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v89) v1 ==== 173+0+0 (secure 0 0 0) 0x7f8590041420 con 0x7f85981437c0 2020-05-18T21:32:48.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.861+0000 7f859ce67700 1 -- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f857c04fd10 msgr2=0x7f857c0521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:48.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.861+0000 7f859ce67700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f857c04fd10 0x7f857c0521d0 secure :-1 s=READY pgs=483 cs=0 l=1 rx=0x7f8588000bc0 tx=0x7f8588007a80).stop 2020-05-18T21:32:48.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.861+0000 7f859ce67700 1 -- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85981437c0 msgr2=0x7f85980ae470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:48.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.861+0000 7f859ce67700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85981437c0 0x7f85980ae470 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7f85981156b0 tx=0x7f8590010f00).stop 2020-05-18T21:32:48.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.861+0000 7f859ce67700 1 -- 172.21.15.63:0/3023103788 shutdown_connections 2020-05-18T21:32:48.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.861+0000 7f859ce67700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f857c04fd10 0x7f857c0521d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:48.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.861+0000 7f859ce67700 1 --2- 172.21.15.63:0/3023103788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85981437c0 0x7f85980ae470 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:48.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.861+0000 7f859ce67700 1 --2- 172.21.15.63:0/3023103788 >> v2:172.21.15.155:3300/0 conn(0x7f85980b4df0 0x7f85981133f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:48.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.861+0000 7f859ce67700 1 -- 172.21.15.63:0/3023103788 >> 172.21.15.63:0/3023103788 conn(0x7f8598069b70 msgr2=0x7f85980b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:48.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.861+0000 7f859ce67700 1 -- 172.21.15.63:0/3023103788 shutdown_connections 2020-05-18T21:32:48.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.861+0000 7f859ce67700 1 -- 172.21.15.63:0/3023103788 wait complete. 2020-05-18T21:32:48.866 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2020-05-18T21:32:48.877 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:32:48.877 INFO:tasks.ceph.mds.a:Stopping old one... 2020-05-18T21:32:48.877 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:32:48.878 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:32:48.878 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:32:48.878 INFO:tasks.ceph.mds.b:Stopping old one... 2020-05-18T21:32:48.879 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:32:48.879 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:32:48.889 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:32:48.889 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:32:48.892 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:32:48.892 DEBUG:teuthology.parallel:result is None 2020-05-18T21:32:48.894 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:32:48.894 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:32:48.896 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:32:48.897 DEBUG:teuthology.parallel:result is None 2020-05-18T21:32:48.897 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-05-18T21:32:48.965 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:32:48.971 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:32:49.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.997+0000 7f0b169a5700 1 Processor -- start 2020-05-18T21:32:49.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.997+0000 7f0b169a5700 1 -- start start 2020-05-18T21:32:49.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.997+0000 7f0b169a5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0b100b22f0 0x7f0b100b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:49.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:48.997+0000 7f0b169a5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0b1013f790 0x7f0b1013fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:49.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b169a5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b10067140 con 0x7f0b10149460 2020-05-18T21:32:49.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b169a5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b10066f60 con 0x7f0b100b22f0 2020-05-18T21:32:49.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b169a5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b10146d10 con 0x7f0b1013f790 2020-05-18T21:32:49.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b159a3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0b100b22f0 0x7f0b100b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:49.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b159a3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0b100b22f0 0x7f0b100b26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59340/0 (socket says 172.21.15.63:59340) 2020-05-18T21:32:49.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b159a3700 1 -- 172.21.15.63:0/2146060286 learned_addr learned my addr 172.21.15.63:0/2146060286 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:49.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b151a2700 1 --2- 172.21.15.63:0/2146060286 >> v2:172.21.15.155:3300/0 conn(0x7f0b1013f790 0x7f0b1013fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:49.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b159a3700 1 -- 172.21.15.63:0/2146060286 >> v2:172.21.15.155:3300/0 conn(0x7f0b1013f790 msgr2=0x7f0b1013fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:49.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b159a3700 1 --2- 172.21.15.63:0/2146060286 >> v2:172.21.15.155:3300/0 conn(0x7f0b1013f790 0x7f0b1013fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:49.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b159a3700 1 -- 172.21.15.63:0/2146060286 >> v1:172.21.15.155:6789/0 conn(0x7f0b10149460 legacy=0x7f0b101498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:49.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b159a3700 1 -- 172.21.15.63:0/2146060286 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1005f870 con 0x7f0b100b22f0 2020-05-18T21:32:49.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b159a3700 1 --2- 172.21.15.63:0/2146060286 >> v2:172.21.15.63:3300/0 conn(0x7f0b100b22f0 0x7f0b100b26d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0b0c002f70 tx=0x7f0b0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:49.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b159a3700 1 --2- 172.21.15.63:0/2146060286 >> v2:172.21.15.63:3300/0 conn(0x7f0b100b22f0 0x7f0b100b26d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0b0c002f70 tx=0x7f0b0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:49.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b159a3700 1 --2- 172.21.15.63:0/2146060286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b100b22f0 0x7f0b100b26d0 secure :-1 s=READY pgs=1224 cs=0 l=1 rx=0x7f0b0c002f70 tx=0x7f0b0c007a80).ready entity=mon.0 client_cookie=15b48d6daa9083b7 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:49.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b159a3700 1 --2- 172.21.15.63:0/2146060286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b100b22f0 0x7f0b100b26d0 secure :-1 s=THROTTLE_DONE pgs=1224 cs=0 l=1 rx=0x7f0b0c002f70 tx=0x7f0b0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:49.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b159a3700 1 --2- 172.21.15.63:0/2146060286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b100b22f0 0x7f0b100b26d0 secure :-1 s=THROTTLE_DONE pgs=1224 cs=0 l=1 rx=0x7f0b0c002f70 tx=0x7f0b0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:49.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b149a1700 1 -- 172.21.15.63:0/2146060286 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b0c0116b0 con 0x7f0b100b22f0 2020-05-18T21:32:49.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b159a3700 1 --2- 172.21.15.63:0/2146060286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b100b22f0 0x7f0b100b26d0 secure :-1 s=THROTTLE_DONE pgs=1224 cs=0 l=1 rx=0x7f0b0c002f70 tx=0x7f0b0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:49.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b149a1700 1 -- 172.21.15.63:0/2146060286 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c011810 con 0x7f0b100b22f0 2020-05-18T21:32:49.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b149a1700 1 -- 172.21.15.63:0/2146060286 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b0c011c30 con 0x7f0b100b22f0 2020-05-18T21:32:49.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b169a5700 1 -- 172.21.15.63:0/2146060286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b100b22f0 msgr2=0x7f0b100b26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:49.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b169a5700 1 --2- 172.21.15.63:0/2146060286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b100b22f0 0x7f0b100b26d0 secure :-1 s=READY pgs=1224 cs=0 l=1 rx=0x7f0b0c002f70 tx=0x7f0b0c007a80).stop 2020-05-18T21:32:49.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b169a5700 1 -- 172.21.15.63:0/2146060286 shutdown_connections 2020-05-18T21:32:49.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b169a5700 1 --2- 172.21.15.63:0/2146060286 >> v2:172.21.15.155:3300/0 conn(0x7f0b1013f790 0x7f0b1013fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:49.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b169a5700 1 --2- 172.21.15.63:0/2146060286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b100b22f0 0x7f0b100b26d0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:49.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b169a5700 1 -- 172.21.15.63:0/2146060286 >> 172.21.15.63:0/2146060286 conn(0x7f0b100b9630 msgr2=0x7f0b100b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:49.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b169a5700 1 -- 172.21.15.63:0/2146060286 shutdown_connections 2020-05-18T21:32:49.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.001+0000 7f0b169a5700 1 -- 172.21.15.63:0/2146060286 wait complete. 2020-05-18T21:32:49.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0b169a5700 1 Processor -- start 2020-05-18T21:32:49.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0b169a5700 1 -- start start 2020-05-18T21:32:49.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0b169a5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b100b22f0 0x7f0b1013fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:49.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0b169a5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0b1013f790 0x7f0b10148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:49.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0b169a5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b10148bc0 con 0x7f0b10149460 2020-05-18T21:32:49.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0b169a5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b10142700 con 0x7f0b1013f790 2020-05-18T21:32:49.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0b169a5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b10141610 con 0x7f0b100b22f0 2020-05-18T21:32:49.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0b161a4700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0b10149460 0x7f0b10141ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33306/0 (socket says 172.21.15.63:33306) 2020-05-18T21:32:49.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0b159a3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b100b22f0 0x7f0b1013fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:49.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0b161a4700 1 -- 172.21.15.63:0/3358144521 learned_addr learned my addr 172.21.15.63:0/3358144521 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:49.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0b151a2700 1 --2- 172.21.15.63:0/3358144521 >> v2:172.21.15.155:3300/0 conn(0x7f0b1013f790 0x7f0b10148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:49.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0afeffd700 1 -- 172.21.15.63:0/3358144521 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1467224303 0 0) 0x7f0b10148bc0 con 0x7f0b10149460 2020-05-18T21:32:49.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0afeffd700 1 -- 172.21.15.63:0/3358144521 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0af0002fe0 con 0x7f0b10149460 2020-05-18T21:32:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0b151a2700 1 -- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b100b22f0 msgr2=0x7f0b1013fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0b151a2700 1 --2- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b100b22f0 0x7f0b1013fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0b151a2700 1 -- 172.21.15.63:0/3358144521 >> v1:172.21.15.63:6789/0 conn(0x7f0b10149460 legacy=0x7f0b10141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0b151a2700 1 -- 172.21.15.63:0/3358144521 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b101418b0 con 0x7f0b1013f790 2020-05-18T21:32:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0b151a2700 1 --2- 172.21.15.63:0/3358144521 >> v2:172.21.15.155:3300/0 conn(0x7f0b1013f790 0x7f0b10148760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0b00002f70 tx=0x7f0b00010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0b151a2700 1 --2- 172.21.15.63:0/3358144521 >> v2:172.21.15.155:3300/0 conn(0x7f0b1013f790 0x7f0b10148760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0b00002f70 tx=0x7f0b00010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.005+0000 7f0b151a2700 1 --2- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b1013f790 0x7f0b10148760 secure :-1 s=READY pgs=850 cs=0 l=1 rx=0x7f0b00002f70 tx=0x7f0b00010c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.009+0000 7f0b151a2700 1 --2- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b1013f790 0x7f0b10148760 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7f0b00002f70 tx=0x7f0b00010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.009+0000 7f0afeffd700 1 -- 172.21.15.63:0/3358144521 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b00007180 con 0x7f0b1013f790 2020-05-18T21:32:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.009+0000 7f0b151a2700 1 --2- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b1013f790 0x7f0b10148760 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7f0b00002f70 tx=0x7f0b00010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.009+0000 7f0afeffd700 1 -- 172.21.15.63:0/3358144521 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b000072e0 con 0x7f0b1013f790 2020-05-18T21:32:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.009+0000 7f0b151a2700 1 --2- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b1013f790 0x7f0b10148760 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7f0b00002f70 tx=0x7f0b00010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.009+0000 7f0afeffd700 1 -- 172.21.15.63:0/3358144521 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b000089b0 con 0x7f0b1013f790 2020-05-18T21:32:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.009+0000 7f0b169a5700 1 -- 172.21.15.63:0/3358144521 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b10141b50 con 0x7f0b1013f790 2020-05-18T21:32:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.009+0000 7f0b169a5700 1 -- 172.21.15.63:0/3358144521 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b10157340 con 0x7f0b1013f790 2020-05-18T21:32:49.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.009+0000 7f0b169a5700 1 -- 172.21.15.63:0/3358144521 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b100569e0 con 0x7f0b1013f790 2020-05-18T21:32:49.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.009+0000 7f0b151a2700 1 --2- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b1013f790 0x7f0b10148760 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7f0b00002f70 tx=0x7f0b00010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:49.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.009+0000 7f0afeffd700 1 -- 172.21.15.63:0/3358144521 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0b00008c30 con 0x7f0b1013f790 2020-05-18T21:32:49.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.009+0000 7f0b151a2700 1 --2- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b1013f790 0x7f0b10148760 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7f0b00002f70 tx=0x7f0b00010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:49.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.009+0000 7f0afeffd700 1 --2- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0af004fda0 0x7f0af0052260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:49.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.009+0000 7f0afeffd700 1 -- 172.21.15.63:0/3358144521 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5511+0+0 (secure 0 0 0) 0x7f0b00063ca0 con 0x7f0b1013f790 2020-05-18T21:32:49.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.013+0000 7f0b159a3700 1 --2- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0af004fda0 0x7f0af0052260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:49.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.013+0000 7f0b159a3700 1 --2- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0af004fda0 0x7f0af0052260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0b0c002f70 tx=0x7f0b0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:49.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.013+0000 7f0b159a3700 1 --2- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0af004fda0 0x7f0af0052260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0b0c002f70 tx=0x7f0b0c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:49.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.013+0000 7f0b159a3700 1 --2- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0af004fda0 0x7f0af0052260 secure :-1 s=READY pgs=484 cs=0 l=1 rx=0x7f0b0c002f70 tx=0x7f0b0c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.017+0000 7f0b151a2700 1 --2- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b1013f790 0x7f0b10148760 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7f0b00002f70 tx=0x7f0b00010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.017+0000 7f0afeffd700 1 -- 172.21.15.63:0/3358144521 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f0b0003dfd0 con 0x7f0b1013f790 2020-05-18T21:32:49.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2020-05-18T21:32:49.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.149+0000 7f0b169a5700 1 -- 172.21.15.63:0/3358144521 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f0b100008d0 con 0x7f0b1013f790 2020-05-18T21:32:49.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.981+0000 7f0b151a2700 1 --2- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b1013f790 0x7f0b10148760 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7f0b00002f70 tx=0x7f0b00010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:49.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.981+0000 7f0afeffd700 1 -- 172.21.15.63:0/3358144521 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v90) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0b000415f0 con 0x7f0b1013f790 2020-05-18T21:32:49.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.985+0000 7f0b169a5700 1 -- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0af004fda0 msgr2=0x7f0af0052260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:49.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.985+0000 7f0b169a5700 1 --2- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0af004fda0 0x7f0af0052260 secure :-1 s=READY pgs=484 cs=0 l=1 rx=0x7f0b0c002f70 tx=0x7f0b0c007a80).stop 2020-05-18T21:32:49.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.985+0000 7f0b169a5700 1 -- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b1013f790 msgr2=0x7f0b10148760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:49.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.985+0000 7f0b169a5700 1 --2- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b1013f790 0x7f0b10148760 secure :-1 s=READY pgs=850 cs=0 l=1 rx=0x7f0b00002f70 tx=0x7f0b00010c00).stop 2020-05-18T21:32:49.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.985+0000 7f0b169a5700 1 -- 172.21.15.63:0/3358144521 shutdown_connections 2020-05-18T21:32:49.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.985+0000 7f0b169a5700 1 --2- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0af004fda0 0x7f0af0052260 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:49.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.985+0000 7f0b169a5700 1 --2- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b1013f790 0x7f0b10148760 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:49.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.985+0000 7f0b169a5700 1 --2- 172.21.15.63:0/3358144521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b100b22f0 0x7f0b1013fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:49.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.985+0000 7f0b169a5700 1 -- 172.21.15.63:0/3358144521 >> 172.21.15.63:0/3358144521 conn(0x7f0b100b9630 msgr2=0x7f0b1013ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:49.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.985+0000 7f0b169a5700 1 -- 172.21.15.63:0/3358144521 shutdown_connections 2020-05-18T21:32:49.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:49.985+0000 7f0b169a5700 1 -- 172.21.15.63:0/3358144521 wait complete. 2020-05-18T21:32:49.990 INFO:teuthology.orchestra.run.smithi063.stderr: removed all blacklist entries 2020-05-18T21:32:50.002 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-05-18T21:32:50.002 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-05-18T21:32:50.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.117+0000 7f4e7b979700 1 Processor -- start 2020-05-18T21:32:50.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.117+0000 7f4e7b979700 1 -- start start 2020-05-18T21:32:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e7b979700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4e740b8f10 0x7f4e740b3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e7b979700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e74061d90 0x7f4e740b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e7b979700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e740b5940 con 0x7f4e740b6240 2020-05-18T21:32:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e7b979700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e740b53d0 con 0x7f4e740b8f10 2020-05-18T21:32:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e7b979700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e740b92f0 con 0x7f4e74061d90 2020-05-18T21:32:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e79f16700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4e740b6240 0x7f4e740996a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33316/0 (socket says 172.21.15.63:33316) 2020-05-18T21:32:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e79f16700 1 -- 172.21.15.63:0/2652946851 learned_addr learned my addr 172.21.15.63:0/2652946851 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:50.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e78f14700 1 --2- 172.21.15.63:0/2652946851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e74061d90 0x7f4e740b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e79715700 1 --2- 172.21.15.63:0/2652946851 >> v2:172.21.15.155:3300/0 conn(0x7f4e740b8f10 0x7f4e740b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e67fff700 1 -- 172.21.15.63:0/2652946851 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383494670 0 0) 0x7f4e740b5940 con 0x7f4e740b6240 2020-05-18T21:32:50.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e67fff700 1 -- 172.21.15.63:0/2652946851 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e5c003270 con 0x7f4e740b6240 2020-05-18T21:32:50.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e78f14700 1 -- 172.21.15.63:0/2652946851 >> v2:172.21.15.155:3300/0 conn(0x7f4e740b8f10 msgr2=0x7f4e740b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e78f14700 1 --2- 172.21.15.63:0/2652946851 >> v2:172.21.15.155:3300/0 conn(0x7f4e740b8f10 0x7f4e740b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e78f14700 1 -- 172.21.15.63:0/2652946851 >> v1:172.21.15.63:6789/0 conn(0x7f4e740b6240 legacy=0x7f4e740996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e78f14700 1 -- 172.21.15.63:0/2652946851 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e740b3aa0 con 0x7f4e74061d90 2020-05-18T21:32:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e78f14700 1 --2- 172.21.15.63:0/2652946851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e74061d90 0x7f4e740b5de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4e68002f70 tx=0x7f4e68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e78f14700 1 --2- 172.21.15.63:0/2652946851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e74061d90 0x7f4e740b5de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4e68002f70 tx=0x7f4e68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e78f14700 1 --2- 172.21.15.63:0/2652946851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e74061d90 0x7f4e740b5de0 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7f4e68002f70 tx=0x7f4e68007a80).ready entity=mon.2 client_cookie=dadf2dfe790ff810 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:50.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e78f14700 1 --2- 172.21.15.63:0/2652946851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e74061d90 0x7f4e740b5de0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f4e68002f70 tx=0x7f4e68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e67fff700 1 -- 172.21.15.63:0/2652946851 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e68008d70 con 0x7f4e74061d90 2020-05-18T21:32:50.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e78f14700 1 --2- 172.21.15.63:0/2652946851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e74061d90 0x7f4e740b5de0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f4e68002f70 tx=0x7f4e68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e67fff700 1 -- 172.21.15.63:0/2652946851 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e680116e0 con 0x7f4e74061d90 2020-05-18T21:32:50.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e78f14700 1 --2- 172.21.15.63:0/2652946851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e74061d90 0x7f4e740b5de0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f4e68002f70 tx=0x7f4e68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e67fff700 1 -- 172.21.15.63:0/2652946851 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e68011ac0 con 0x7f4e74061d90 2020-05-18T21:32:50.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e7b979700 1 -- 172.21.15.63:0/2652946851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e74061d90 msgr2=0x7f4e740b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e7b979700 1 --2- 172.21.15.63:0/2652946851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e74061d90 0x7f4e740b5de0 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7f4e68002f70 tx=0x7f4e68007a80).stop 2020-05-18T21:32:50.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e7b979700 1 -- 172.21.15.63:0/2652946851 shutdown_connections 2020-05-18T21:32:50.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e7b979700 1 --2- 172.21.15.63:0/2652946851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e74061d90 0x7f4e740b5de0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:50.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e7b979700 1 --2- 172.21.15.63:0/2652946851 >> v2:172.21.15.155:3300/0 conn(0x7f4e740b8f10 0x7f4e740b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:50.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e7b979700 1 -- 172.21.15.63:0/2652946851 >> 172.21.15.63:0/2652946851 conn(0x7f4e7405a7c0 msgr2=0x7f4e7405aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:50.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e7b979700 1 -- 172.21.15.63:0/2652946851 shutdown_connections 2020-05-18T21:32:50.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.121+0000 7f4e7b979700 1 -- 172.21.15.63:0/2652946851 wait complete. 2020-05-18T21:32:50.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e7b979700 1 Processor -- start 2020-05-18T21:32:50.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e7b979700 1 -- start start 2020-05-18T21:32:50.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e7b979700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4e74061d90 0x7f4e7408f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:50.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e7b979700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4e740b8f10 0x7f4e74064940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:50.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e7b979700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e74091d80 con 0x7f4e740b6240 2020-05-18T21:32:50.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e7b979700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e74092020 con 0x7f4e740b8f10 2020-05-18T21:32:50.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e7b979700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e740977a0 con 0x7f4e74061d90 2020-05-18T21:32:50.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e79f16700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4e740b8f10 0x7f4e74064940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e79715700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4e74061d90 0x7f4e7408f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e79f16700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4e740b8f10 0x7f4e74064940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59366/0 (socket says 172.21.15.63:59366) 2020-05-18T21:32:50.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e79f16700 1 -- 172.21.15.63:0/3302141160 learned_addr learned my addr 172.21.15.63:0/3302141160 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:50.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e79f16700 1 -- 172.21.15.63:0/3302141160 >> v2:172.21.15.155:3300/0 conn(0x7f4e74061d90 msgr2=0x7f4e7408f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e79f16700 1 --2- 172.21.15.63:0/3302141160 >> v2:172.21.15.155:3300/0 conn(0x7f4e74061d90 0x7f4e7408f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:50.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e79f16700 1 -- 172.21.15.63:0/3302141160 >> v1:172.21.15.155:6789/0 conn(0x7f4e740b6240 legacy=0x7f4e7414c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e79f16700 1 -- 172.21.15.63:0/3302141160 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e74091a00 con 0x7f4e740b8f10 2020-05-18T21:32:50.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e79f16700 1 --2- 172.21.15.63:0/3302141160 >> v2:172.21.15.63:3300/0 conn(0x7f4e740b8f10 0x7f4e74064940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4e6c001490 tx=0x7f4e6c010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e79f16700 1 --2- 172.21.15.63:0/3302141160 >> v2:172.21.15.63:3300/0 conn(0x7f4e740b8f10 0x7f4e74064940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4e6c001490 tx=0x7f4e6c010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e79f16700 1 --2- 172.21.15.63:0/3302141160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e740b8f10 0x7f4e74064940 secure :-1 s=READY pgs=1227 cs=0 l=1 rx=0x7f4e6c001490 tx=0x7f4e6c010c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:50.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e79f16700 1 --2- 172.21.15.63:0/3302141160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e740b8f10 0x7f4e74064940 secure :-1 s=THROTTLE_DONE pgs=1227 cs=0 l=1 rx=0x7f4e6c001490 tx=0x7f4e6c010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e667fc700 1 -- 172.21.15.63:0/3302141160 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e6c005e90 con 0x7f4e740b8f10 2020-05-18T21:32:50.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e79f16700 1 --2- 172.21.15.63:0/3302141160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e740b8f10 0x7f4e74064940 secure :-1 s=THROTTLE_DONE pgs=1227 cs=0 l=1 rx=0x7f4e6c001490 tx=0x7f4e6c010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e79f16700 1 --2- 172.21.15.63:0/3302141160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e740b8f10 0x7f4e74064940 secure :-1 s=THROTTLE_DONE pgs=1227 cs=0 l=1 rx=0x7f4e6c001490 tx=0x7f4e6c010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e667fc700 1 -- 172.21.15.63:0/3302141160 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6c012500 con 0x7f4e740b8f10 2020-05-18T21:32:50.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e7b979700 1 -- 172.21.15.63:0/3302141160 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e7414cbe0 con 0x7f4e740b8f10 2020-05-18T21:32:50.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e667fc700 1 -- 172.21.15.63:0/3302141160 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e6c012920 con 0x7f4e740b8f10 2020-05-18T21:32:50.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.125+0000 7f4e7b979700 1 -- 172.21.15.63:0/3302141160 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e74097de0 con 0x7f4e740b8f10 2020-05-18T21:32:50.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.129+0000 7f4e79f16700 1 --2- 172.21.15.63:0/3302141160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e740b8f10 0x7f4e74064940 secure :-1 s=THROTTLE_DONE pgs=1227 cs=0 l=1 rx=0x7f4e6c001490 tx=0x7f4e6c010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.129+0000 7f4e7b979700 1 -- 172.21.15.63:0/3302141160 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e740569e0 con 0x7f4e740b8f10 2020-05-18T21:32:50.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.129+0000 7f4e667fc700 1 -- 172.21.15.63:0/3302141160 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4e6c012b90 con 0x7f4e740b8f10 2020-05-18T21:32:50.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.129+0000 7f4e79f16700 1 --2- 172.21.15.63:0/3302141160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e740b8f10 0x7f4e74064940 secure :-1 s=THROTTLE_DONE pgs=1227 cs=0 l=1 rx=0x7f4e6c001490 tx=0x7f4e6c010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.129+0000 7f4e667fc700 1 --2- 172.21.15.63:0/3302141160 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4e5404fa60 0x7f4e54051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:50.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.129+0000 7f4e667fc700 1 -- 172.21.15.63:0/3302141160 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f4e6c0090c0 con 0x7f4e740b8f10 2020-05-18T21:32:50.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.129+0000 7f4e79715700 1 --2- 172.21.15.63:0/3302141160 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4e5404fa60 0x7f4e54051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.129+0000 7f4e79715700 1 --2- 172.21.15.63:0/3302141160 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4e5404fa60 0x7f4e54051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4e70002f70 tx=0x7f4e7000d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.129+0000 7f4e79715700 1 --2- 172.21.15.63:0/3302141160 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4e5404fa60 0x7f4e54051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4e70002f70 tx=0x7f4e7000d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.129+0000 7f4e79715700 1 --2- 172.21.15.63:0/3302141160 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4e5404fa60 0x7f4e54051f20 secure :-1 s=READY pgs=486 cs=0 l=1 rx=0x7f4e70002f70 tx=0x7f4e7000d8f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:50.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.133+0000 7f4e79f16700 1 --2- 172.21.15.63:0/3302141160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e740b8f10 0x7f4e74064940 secure :-1 s=THROTTLE_DONE pgs=1227 cs=0 l=1 rx=0x7f4e6c001490 tx=0x7f4e6c010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.133+0000 7f4e667fc700 1 -- 172.21.15.63:0/3302141160 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f4e6c03e750 con 0x7f4e740b8f10 2020-05-18T21:32:50.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.281+0000 7f4e7b979700 1 -- 172.21.15.63:0/3302141160 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4e74097910 con 0x7f4e740b8f10 2020-05-18T21:32:50.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.281+0000 7f4e79f16700 1 --2- 172.21.15.63:0/3302141160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e740b8f10 0x7f4e74064940 secure :-1 s=THROTTLE_DONE pgs=1227 cs=0 l=1 rx=0x7f4e6c001490 tx=0x7f4e6c010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.281+0000 7f4e667fc700 1 -- 172.21.15.63:0/3302141160 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v34) v1 ==== 80+0+4513 (secure 0 0 0) 0x7f4e6c041d70 con 0x7f4e740b8f10 2020-05-18T21:32:50.287 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:50.287 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:32:50.288 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_dump": [ 2020-05-18T21:32:50.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:50.288 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.a", 2020-05-18T21:32:50.288 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJekJyyLRAAfB5XJCsXTAmZdkFOaQrokg==", 2020-05-18T21:32:50.288 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:32:50.289 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:32:50.289 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:32:50.289 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:32:50.289 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:32:50.289 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:50.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:50.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:50.290 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.b", 2020-05-18T21:32:50.290 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeSVE8MRAAEEytuzLtcQMC+1uQ/yh8eA==", 2020-05-18T21:32:50.290 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:32:50.290 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:32:50.291 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:32:50.291 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:32:50.291 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:32:50.291 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:50.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:50.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:50.292 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.0", 2020-05-18T21:32:50.292 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBq/cJeIn7mJhAArx+YEdVbsfXXNOLWdaAgWw==", 2020-05-18T21:32:50.292 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:32:50.292 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:32:50.292 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:32:50.293 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:32:50.293 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:50.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:50.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:50.293 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.1", 2020-05-18T21:32:50.294 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBt/cJelHywCRAAFyQ3sPEE0RTSy4tKfsDfyw==", 2020-05-18T21:32:50.294 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:32:50.294 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:32:50.294 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:32:50.294 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:32:50.295 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:50.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:50.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:50.295 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.2", 2020-05-18T21:32:50.295 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBv/cJecexDLBAAxhlFq20MBkKvDjuM1yi8XQ==", 2020-05-18T21:32:50.295 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:32:50.296 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:32:50.296 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:32:50.296 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:32:50.296 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:50.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:50.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:50.297 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.3", 2020-05-18T21:32:50.297 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBy/cJe9IqwDxAAMg1In7bIITDcOZljzzTpDQ==", 2020-05-18T21:32:50.297 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:32:50.297 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:32:50.298 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:32:50.298 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:32:50.298 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:50.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:50.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:50.299 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.4", 2020-05-18T21:32:50.299 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB3/cJeLXgxFhAA/kMVV5hCRny2uXKvvbu8Og==", 2020-05-18T21:32:50.299 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:32:50.299 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:32:50.300 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:32:50.300 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:32:50.300 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:50.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:50.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:50.300 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.5", 2020-05-18T21:32:50.301 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB5/cJeucpsNRAAjGh+6yUC8Fji9PE4COi/Eg==", 2020-05-18T21:32:50.301 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:32:50.301 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:32:50.301 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:32:50.301 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:32:50.302 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:50.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:50.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:50.302 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.6", 2020-05-18T21:32:50.302 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB8/cJelSPpGhAAXobGqH9qaW1VZfEpH8bUbQ==", 2020-05-18T21:32:50.303 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:32:50.303 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:32:50.303 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:32:50.303 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:32:50.303 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:50.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:50.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:50.304 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.7", 2020-05-18T21:32:50.304 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB+/cJeUIl5OBAAPd8H8ohOWZw9ubO7uCB6zg==", 2020-05-18T21:32:50.304 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:32:50.304 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:32:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:32:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:32:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:50.305 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.0", 2020-05-18T21:32:50.306 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeap3RNhAAi2vKpsKtzSL1Uuqm8pWYJQ==", 2020-05-18T21:32:50.306 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:32:50.306 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:32:50.306 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:32:50.306 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:32:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.1", 2020-05-18T21:32:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJeekrQABAA5TmzWOt24C6hgZw/WTj5dw==", 2020-05-18T21:32:50.307 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:32:50.308 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:32:50.308 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:32:50.308 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:32:50.308 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:50.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.2", 2020-05-18T21:32:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJehSnFAxAAXUZwqNTXqAApEB3nXs4u6g==", 2020-05-18T21:32:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:32:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:32:50.309 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:32:50.310 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:32:50.310 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:50.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:50.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:50.310 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.3", 2020-05-18T21:32:50.311 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJe2HdDBhAA07y5pn/bKKa9TBbZFvIh9g==", 2020-05-18T21:32:50.311 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:32:50.311 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:32:50.311 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:32:50.311 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:32:50.311 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.admin", 2020-05-18T21:32:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJe/K4fGRAA+rP3BYuWiyx/fKmQ3bV6Lw==", 2020-05-18T21:32:50.312 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:32:50.313 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:32:50.313 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:32:50.313 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:32:50.313 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:32:50.313 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:50.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:50.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:50.314 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.x", 2020-05-18T21:32:50.314 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJemmqEKhAAe5ySRz8Id0ug4matQwL0uw==", 2020-05-18T21:32:50.314 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:32:50.314 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:32:50.315 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:32:50.315 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:32:50.315 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:50.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:50.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:50.316 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.y", 2020-05-18T21:32:50.316 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeF/BNJhAAi/vrldC6qoWJWnSHpE3ung==", 2020-05-18T21:32:50.316 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:32:50.316 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:32:50.316 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:32:50.316 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:32:50.317 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:50.317 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:50.317 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:32:50.317 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:32:50.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.285+0000 7f4e7b979700 1 -- 172.21.15.63:0/3302141160 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4e5404fa60 msgr2=0x7f4e54051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.285+0000 7f4e7b979700 1 --2- 172.21.15.63:0/3302141160 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4e5404fa60 0x7f4e54051f20 secure :-1 s=READY pgs=486 cs=0 l=1 rx=0x7f4e70002f70 tx=0x7f4e7000d8f0).stop 2020-05-18T21:32:50.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.285+0000 7f4e7b979700 1 -- 172.21.15.63:0/3302141160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e740b8f10 msgr2=0x7f4e74064940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.285+0000 7f4e7b979700 1 --2- 172.21.15.63:0/3302141160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e740b8f10 0x7f4e74064940 secure :-1 s=READY pgs=1227 cs=0 l=1 rx=0x7f4e6c001490 tx=0x7f4e6c010c70).stop 2020-05-18T21:32:50.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.285+0000 7f4e7b979700 1 -- 172.21.15.63:0/3302141160 shutdown_connections 2020-05-18T21:32:50.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.285+0000 7f4e7b979700 1 --2- 172.21.15.63:0/3302141160 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4e5404fa60 0x7f4e54051f20 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:50.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.285+0000 7f4e7b979700 1 --2- 172.21.15.63:0/3302141160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e740b8f10 0x7f4e74064940 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:50.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.285+0000 7f4e7b979700 1 --2- 172.21.15.63:0/3302141160 >> v2:172.21.15.155:3300/0 conn(0x7f4e74061d90 0x7f4e7408f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:50.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.285+0000 7f4e7b979700 1 -- 172.21.15.63:0/3302141160 >> 172.21.15.63:0/3302141160 conn(0x7f4e7405a7c0 msgr2=0x7f4e7409dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:50.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.285+0000 7f4e7b979700 1 -- 172.21.15.63:0/3302141160 shutdown_connections 2020-05-18T21:32:50.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.285+0000 7f4e7b979700 1 -- 172.21.15.63:0/3302141160 wait complete. 2020-05-18T21:32:50.321 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:32:50.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f026dae2700 1 Processor -- start 2020-05-18T21:32:50.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f026dae2700 1 -- start start 2020-05-18T21:32:50.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f026dae2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02680b2860 0x7f02680615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:50.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f026dae2700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026814d960 con 0x7f026814e570 2020-05-18T21:32:50.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f026dae2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026814db90 con 0x7f0268060b90 2020-05-18T21:32:50.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f026dae2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0268066210 con 0x7f02680b2860 2020-05-18T21:32:50.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f0267fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f026814e570 0x7f026814a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33328/0 (socket says 172.21.15.63:33328) 2020-05-18T21:32:50.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f0267fff700 1 -- 172.21.15.63:0/2164544431 learned_addr learned my addr 172.21.15.63:0/2164544431 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:50.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f0266ffd700 1 --2- 172.21.15.63:0/2164544431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02680b2860 0x7f02680615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f02667fc700 1 -- 172.21.15.63:0/2164544431 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173627612 0 0) 0x7f026814d960 con 0x7f026814e570 2020-05-18T21:32:50.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f02667fc700 1 -- 172.21.15.63:0/2164544431 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0248003270 con 0x7f026814e570 2020-05-18T21:32:50.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f02667fc700 1 -- 172.21.15.63:0/2164544431 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2193162722 0 0) 0x7f026814db90 con 0x7f0268060b90 2020-05-18T21:32:50.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f02667fc700 1 -- 172.21.15.63:0/2164544431 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f026814d960 con 0x7f0268060b90 2020-05-18T21:32:50.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f0266ffd700 1 -- 172.21.15.63:0/2164544431 >> v1:172.21.15.155:6789/0 conn(0x7f0268060b90 legacy=0x7f0268144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f0266ffd700 1 -- 172.21.15.63:0/2164544431 >> v1:172.21.15.63:6789/0 conn(0x7f026814e570 legacy=0x7f026814a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f0266ffd700 1 -- 172.21.15.63:0/2164544431 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026814de30 con 0x7f02680b2860 2020-05-18T21:32:50.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f0266ffd700 1 --2- 172.21.15.63:0/2164544431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02680b2860 0x7f02680615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0250002f70 tx=0x7f0250008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f0266ffd700 1 --2- 172.21.15.63:0/2164544431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02680b2860 0x7f02680615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0250002f70 tx=0x7f0250008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f0266ffd700 1 --2- 172.21.15.63:0/2164544431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02680b2860 0x7f02680615e0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f0250002f70 tx=0x7f0250008920).ready entity=mon.2 client_cookie=979cac76ff8d2675 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:50.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f0266ffd700 1 --2- 172.21.15.63:0/2164544431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02680b2860 0x7f02680615e0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f0250002f70 tx=0x7f0250008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f02667fc700 1 -- 172.21.15.63:0/2164544431 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0250008e80 con 0x7f02680b2860 2020-05-18T21:32:50.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f0266ffd700 1 --2- 172.21.15.63:0/2164544431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02680b2860 0x7f02680615e0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f0250002f70 tx=0x7f0250008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f02667fc700 1 -- 172.21.15.63:0/2164544431 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0250011580 con 0x7f02680b2860 2020-05-18T21:32:50.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f0266ffd700 1 --2- 172.21.15.63:0/2164544431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02680b2860 0x7f02680615e0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f0250002f70 tx=0x7f0250008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f02667fc700 1 -- 172.21.15.63:0/2164544431 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02500118e0 con 0x7f02680b2860 2020-05-18T21:32:50.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f026dae2700 1 -- 172.21.15.63:0/2164544431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02680b2860 msgr2=0x7f02680615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.425+0000 7f026dae2700 1 --2- 172.21.15.63:0/2164544431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02680b2860 0x7f02680615e0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f0250002f70 tx=0x7f0250008920).stop 2020-05-18T21:32:50.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.429+0000 7f026dae2700 1 -- 172.21.15.63:0/2164544431 shutdown_connections 2020-05-18T21:32:50.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.429+0000 7f026dae2700 1 --2- 172.21.15.63:0/2164544431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02680b2860 0x7f02680615e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:50.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.429+0000 7f026dae2700 1 -- 172.21.15.63:0/2164544431 >> 172.21.15.63:0/2164544431 conn(0x7f02680b83d0 msgr2=0x7f02680b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:50.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.429+0000 7f026dae2700 1 -- 172.21.15.63:0/2164544431 shutdown_connections 2020-05-18T21:32:50.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.429+0000 7f026dae2700 1 -- 172.21.15.63:0/2164544431 wait complete. 2020-05-18T21:32:50.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.429+0000 7f026dae2700 1 Processor -- start 2020-05-18T21:32:50.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.429+0000 7f026dae2700 1 -- start start 2020-05-18T21:32:50.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f026dae2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f02680b2860 0x7f0268064a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:50.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f026dae2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f026814e570 0x7f02681454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:50.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f026dae2700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0268064ed0 con 0x7f0268060b90 2020-05-18T21:32:50.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f026dae2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02680adab0 con 0x7f02680b2860 2020-05-18T21:32:50.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f026dae2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02680ad2d0 con 0x7f026814e570 2020-05-18T21:32:50.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f02677fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0268060b90 0x7f026814bf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33332/0 (socket says 172.21.15.63:33332) 2020-05-18T21:32:50.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f02677fe700 1 -- 172.21.15.63:0/1460308697 learned_addr learned my addr 172.21.15.63:0/1460308697 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:50.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0266ffd700 1 --2- 172.21.15.63:0/1460308697 >> v2:172.21.15.155:3300/0 conn(0x7f02680b2860 0x7f0268064a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0267fff700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f026814e570 0x7f02681454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0264ff9700 1 -- 172.21.15.63:0/1460308697 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273666838 0 0) 0x7f0268064ed0 con 0x7f0268060b90 2020-05-18T21:32:50.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0264ff9700 1 -- 172.21.15.63:0/1460308697 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f024c002fe0 con 0x7f0268060b90 2020-05-18T21:32:50.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0266ffd700 1 -- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f026814e570 msgr2=0x7f02681454e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0264ff9700 1 -- 172.21.15.63:0/1460308697 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1913258912 0 0) 0x7f024c002fe0 con 0x7f0268060b90 2020-05-18T21:32:50.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0266ffd700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f026814e570 0x7f02681454e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:50.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0266ffd700 1 -- 172.21.15.63:0/1460308697 >> v1:172.21.15.63:6789/0 conn(0x7f0268060b90 legacy=0x7f026814bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0266ffd700 1 -- 172.21.15.63:0/1460308697 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02680ad570 con 0x7f02680b2860 2020-05-18T21:32:50.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0267fff700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f026814e570 0x7f02681454e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:50.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0266ffd700 1 --2- 172.21.15.63:0/1460308697 >> v2:172.21.15.155:3300/0 conn(0x7f02680b2860 0x7f0268064a70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0258001ee0 tx=0x7f026805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0266ffd700 1 --2- 172.21.15.63:0/1460308697 >> v2:172.21.15.155:3300/0 conn(0x7f02680b2860 0x7f0268064a70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0258001ee0 tx=0x7f026805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0266ffd700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b2860 0x7f0268064a70 secure :-1 s=READY pgs=853 cs=0 l=1 rx=0x7f0258001ee0 tx=0x7f026805fa60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:50.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0266ffd700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b2860 0x7f0268064a70 secure :-1 s=THROTTLE_DONE pgs=853 cs=0 l=1 rx=0x7f0258001ee0 tx=0x7f026805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0264ff9700 1 -- 172.21.15.63:0/1460308697 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0258001d40 con 0x7f02680b2860 2020-05-18T21:32:50.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0266ffd700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b2860 0x7f0268064a70 secure :-1 s=THROTTLE_DONE pgs=853 cs=0 l=1 rx=0x7f0258001ee0 tx=0x7f026805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0266ffd700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b2860 0x7f0268064a70 secure :-1 s=THROTTLE_DONE pgs=853 cs=0 l=1 rx=0x7f0258001ee0 tx=0x7f026805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0264ff9700 1 -- 172.21.15.63:0/1460308697 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025000f630 con 0x7f02680b2860 2020-05-18T21:32:50.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f026dae2700 1 -- 172.21.15.63:0/1460308697 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02680ad810 con 0x7f02680b2860 2020-05-18T21:32:50.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0264ff9700 1 -- 172.21.15.63:0/1460308697 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0250007170 con 0x7f02680b2860 2020-05-18T21:32:50.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f026dae2700 1 -- 172.21.15.63:0/1460308697 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0268157660 con 0x7f02680b2860 2020-05-18T21:32:50.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f0266ffd700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b2860 0x7f0268064a70 secure :-1 s=THROTTLE_DONE pgs=853 cs=0 l=1 rx=0x7f0258001ee0 tx=0x7f026805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.433+0000 7f026dae2700 1 -- 172.21.15.63:0/1460308697 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02680569e0 con 0x7f02680b2860 2020-05-18T21:32:50.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.437+0000 7f0264ff9700 1 -- 172.21.15.63:0/1460308697 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f02500072d0 con 0x7f02680b2860 2020-05-18T21:32:50.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.437+0000 7f0266ffd700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b2860 0x7f0268064a70 secure :-1 s=THROTTLE_DONE pgs=853 cs=0 l=1 rx=0x7f0258001ee0 tx=0x7f026805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.437+0000 7f0264ff9700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024c04fd40 0x7f024c052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:50.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.437+0000 7f0264ff9700 1 -- 172.21.15.63:0/1460308697 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f02500640f0 con 0x7f02680b2860 2020-05-18T21:32:50.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.437+0000 7f02677fe700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024c04fd40 0x7f024c052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.437+0000 7f02677fe700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024c04fd40 0x7f024c052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0258001fa0 tx=0x7f02580099f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.437+0000 7f02677fe700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024c04fd40 0x7f024c052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0258001fa0 tx=0x7f02580099f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.437+0000 7f02677fe700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024c04fd40 0x7f024c052200 secure :-1 s=READY pgs=487 cs=0 l=1 rx=0x7f0258001fa0 tx=0x7f02580099f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:50.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.445+0000 7f0266ffd700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b2860 0x7f0268064a70 secure :-1 s=THROTTLE_DONE pgs=853 cs=0 l=1 rx=0x7f0258001ee0 tx=0x7f026805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.445+0000 7f0264ff9700 1 -- 172.21.15.63:0/1460308697 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f025003e4e0 con 0x7f02680b2860 2020-05-18T21:32:50.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.561+0000 7f026dae2700 1 -- 172.21.15.63:0/1460308697 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02680008d0 con 0x7f02680b2860 2020-05-18T21:32:50.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.561+0000 7f0266ffd700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b2860 0x7f0268064a70 secure :-1 s=THROTTLE_DONE pgs=853 cs=0 l=1 rx=0x7f0258001ee0 tx=0x7f026805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.561+0000 7f0264ff9700 1 -- 172.21.15.63:0/1460308697 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+13233 (secure 0 0 0) 0x7f02500079a0 con 0x7f02680b2860 2020-05-18T21:32:50.567 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:50.567 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":90,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:32:49.974664+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:32:50.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.565+0000 7f026dae2700 1 -- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024c04fd40 msgr2=0x7f024c052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.565+0000 7f026dae2700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024c04fd40 0x7f024c052200 secure :-1 s=READY pgs=487 cs=0 l=1 rx=0x7f0258001fa0 tx=0x7f02580099f0).stop 2020-05-18T21:32:50.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.565+0000 7f026dae2700 1 -- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b2860 msgr2=0x7f0268064a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.565+0000 7f026dae2700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b2860 0x7f0268064a70 secure :-1 s=READY pgs=853 cs=0 l=1 rx=0x7f0258001ee0 tx=0x7f026805fa60).stop 2020-05-18T21:32:50.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.565+0000 7f026dae2700 1 -- 172.21.15.63:0/1460308697 shutdown_connections 2020-05-18T21:32:50.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.565+0000 7f026dae2700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024c04fd40 0x7f024c052200 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:50.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.565+0000 7f026dae2700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f026814e570 0x7f02681454e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:50.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.565+0000 7f026dae2700 1 --2- 172.21.15.63:0/1460308697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b2860 0x7f0268064a70 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:50.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.565+0000 7f026dae2700 1 -- 172.21.15.63:0/1460308697 >> 172.21.15.63:0/1460308697 conn(0x7f02680b83d0 msgr2=0x7f02681477b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:50.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.565+0000 7f026dae2700 1 -- 172.21.15.63:0/1460308697 shutdown_connections 2020-05-18T21:32:50.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.565+0000 7f026dae2700 1 -- 172.21.15.63:0/1460308697 wait complete. 2020-05-18T21:32:50.579 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-05-18T21:32:50.581 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:32:50.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.689+0000 7f87ec961700 1 Processor -- start 2020-05-18T21:32:50.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.689+0000 7f87ec961700 1 -- start start 2020-05-18T21:32:50.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.689+0000 7f87ec961700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87e80b1550 0x7f87e80b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:50.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.689+0000 7f87ec961700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e81464a0 con 0x7f87e80b0d40 2020-05-18T21:32:50.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.689+0000 7f87ec961700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e8146740 con 0x7f87e80b4460 2020-05-18T21:32:50.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.689+0000 7f87ec961700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e81469e0 con 0x7f87e80b1550 2020-05-18T21:32:50.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.689+0000 7f87e759e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f87e80b0d40 0x7f87e80b6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33344/0 (socket says 172.21.15.63:33344) 2020-05-18T21:32:50.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.689+0000 7f87e759e700 1 -- 172.21.15.63:0/449396144 learned_addr learned my addr 172.21.15.63:0/449396144 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:50.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.689+0000 7f87dffff700 1 --2- 172.21.15.63:0/449396144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87e80b1550 0x7f87e80b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.689+0000 7f87e659c700 1 -- 172.21.15.63:0/449396144 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847145653 0 0) 0x7f87e81464a0 con 0x7f87e80b0d40 2020-05-18T21:32:50.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.689+0000 7f87e659c700 1 -- 172.21.15.63:0/449396144 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87c8003270 con 0x7f87e80b0d40 2020-05-18T21:32:50.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.689+0000 7f87e659c700 1 -- 172.21.15.63:0/449396144 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3996390833 0 0) 0x7f87c8003270 con 0x7f87e80b0d40 2020-05-18T21:32:50.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.689+0000 7f87e659c700 1 -- 172.21.15.63:0/449396144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87e80b1550 msgr2=0x7f87e80b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:50.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.689+0000 7f87e659c700 1 --2- 172.21.15.63:0/449396144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87e80b1550 0x7f87e80b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:50.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.689+0000 7f87e659c700 1 -- 172.21.15.63:0/449396144 >> v1:172.21.15.155:6789/0 conn(0x7f87e80b4460 legacy=0x7f87e8145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.689+0000 7f87e659c700 1 -- 172.21.15.63:0/449396144 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e80b4840 con 0x7f87e80b0d40 2020-05-18T21:32:50.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.689+0000 7f87e659c700 1 -- 172.21.15.63:0/449396144 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f87e0001a90 con 0x7f87e80b0d40 2020-05-18T21:32:50.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.689+0000 7f87e659c700 1 -- 172.21.15.63:0/449396144 >> v1:172.21.15.63:6789/0 conn(0x7f87e80b0d40 legacy=0x7f87e80b6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e659c700 1 --2- 172.21.15.63:0/449396144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87e80b1550 0x7f87c8003790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:50.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e659c700 1 --2- 172.21.15.63:0/449396144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87c8003bf0 0x7f87c8004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:50.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e659c700 1 --2- 172.21.15.63:0/449396144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87c8004620 0x7f87c8004aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:50.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e659c700 1 -- 172.21.15.63:0/449396144 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e81469e0 con 0x7f87c8004620 2020-05-18T21:32:50.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e659c700 1 -- 172.21.15.63:0/449396144 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c8005050 con 0x7f87c8003bf0 2020-05-18T21:32:50.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e659c700 1 -- 172.21.15.63:0/449396144 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c8005210 con 0x7f87e80b1550 2020-05-18T21:32:50.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e759e700 1 --2- 172.21.15.63:0/449396144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87c8004620 0x7f87c8004aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e6d9d700 1 --2- 172.21.15.63:0/449396144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87e80b1550 0x7f87c8003790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87dffff700 1 --2- 172.21.15.63:0/449396144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87c8003bf0 0x7f87c8004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e759e700 1 -- 172.21.15.63:0/449396144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87e80b1550 msgr2=0x7f87c8003790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:50.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e759e700 1 --2- 172.21.15.63:0/449396144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87e80b1550 0x7f87c8003790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:50.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e759e700 1 -- 172.21.15.63:0/449396144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87c8003bf0 msgr2=0x7f87c8004050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:50.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e759e700 1 --2- 172.21.15.63:0/449396144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87c8003bf0 0x7f87c8004050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:50.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e759e700 1 -- 172.21.15.63:0/449396144 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c8003270 con 0x7f87c8004620 2020-05-18T21:32:50.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87dffff700 1 --2- 172.21.15.63:0/449396144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87c8003bf0 0x7f87c8004050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:50.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e6d9d700 1 --2- 172.21.15.63:0/449396144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87e80b1550 0x7f87c8003790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:50.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e759e700 1 --2- 172.21.15.63:0/449396144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87c8004620 0x7f87c8004aa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f87e00017a0 tx=0x7f87e8061510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e759e700 1 --2- 172.21.15.63:0/449396144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87c8004620 0x7f87c8004aa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f87e00017a0 tx=0x7f87e8061510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e759e700 1 --2- 172.21.15.63:0/449396144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87c8004620 0x7f87c8004aa0 secure :-1 s=READY pgs=1231 cs=0 l=1 rx=0x7f87e00017a0 tx=0x7f87e8061510).ready entity=mon.0 client_cookie=eb6a410dec04bba9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:50.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e759e700 1 --2- 172.21.15.63:0/449396144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87c8004620 0x7f87c8004aa0 secure :-1 s=THROTTLE_DONE pgs=1231 cs=0 l=1 rx=0x7f87e00017a0 tx=0x7f87e8061510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e659c700 1 -- 172.21.15.63:0/449396144 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87e0005e20 con 0x7f87c8004620 2020-05-18T21:32:50.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e759e700 1 --2- 172.21.15.63:0/449396144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87c8004620 0x7f87c8004aa0 secure :-1 s=THROTTLE_DONE pgs=1231 cs=0 l=1 rx=0x7f87e00017a0 tx=0x7f87e8061510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e659c700 1 -- 172.21.15.63:0/449396144 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e0004c70 con 0x7f87c8004620 2020-05-18T21:32:50.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e759e700 1 --2- 172.21.15.63:0/449396144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87c8004620 0x7f87c8004aa0 secure :-1 s=THROTTLE_DONE pgs=1231 cs=0 l=1 rx=0x7f87e00017a0 tx=0x7f87e8061510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87ec961700 1 -- 172.21.15.63:0/449396144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87c8004620 msgr2=0x7f87c8004aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e659c700 1 -- 172.21.15.63:0/449396144 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87e0005010 con 0x7f87c8004620 2020-05-18T21:32:50.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87ec961700 1 --2- 172.21.15.63:0/449396144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87c8004620 0x7f87c8004aa0 secure :-1 s=READY pgs=1231 cs=0 l=1 rx=0x7f87e00017a0 tx=0x7f87e8061510).stop 2020-05-18T21:32:50.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87e759e700 1 -- 172.21.15.63:0/449396144 reap_dead start 2020-05-18T21:32:50.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87ec961700 1 -- 172.21.15.63:0/449396144 shutdown_connections 2020-05-18T21:32:50.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87ec961700 1 -- 172.21.15.63:0/449396144 >> 172.21.15.63:0/449396144 conn(0x7f87e8069b70 msgr2=0x7f87e8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:50.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87ec961700 1 -- 172.21.15.63:0/449396144 shutdown_connections 2020-05-18T21:32:50.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.693+0000 7f87ec961700 1 -- 172.21.15.63:0/449396144 wait complete. 2020-05-18T21:32:50.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87ec961700 1 Processor -- start 2020-05-18T21:32:50.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87ec961700 1 -- start start 2020-05-18T21:32:50.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87ec961700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f87e8137170 0x7f87e8137e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:50.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87ec961700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f87e80b29c0 0x7f87e80b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:50.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87ec961700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87e80628a0 0x7f87e8062d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:50.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87ec961700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e81382f0 con 0x7f87e80b29c0 2020-05-18T21:32:50.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87ec961700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e8115bc0 con 0x7f87e8137170 2020-05-18T21:32:50.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87ec961700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e8115e60 con 0x7f87e80628a0 2020-05-18T21:32:50.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87dffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f87e80b29c0 0x7f87e80b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87dffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f87e80b29c0 0x7f87e80b2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59398/0 (socket says 172.21.15.63:59398) 2020-05-18T21:32:50.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87dffff700 1 -- 172.21.15.63:0/3536247612 learned_addr learned my addr 172.21.15.63:0/3536247612 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:50.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87e759e700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87e80628a0 0x7f87e8062d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87e6d9d700 1 --2- 172.21.15.63:0/3536247612 >> v2:172.21.15.155:3300/0 conn(0x7f87e8137170 0x7f87e8137e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87dffff700 1 -- 172.21.15.63:0/3536247612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87e80628a0 msgr2=0x7f87e8062d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87dffff700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87e80628a0 0x7f87e8062d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:50.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87dffff700 1 -- 172.21.15.63:0/3536247612 >> v2:172.21.15.155:3300/0 conn(0x7f87e8137170 msgr2=0x7f87e8137e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87dffff700 1 --2- 172.21.15.63:0/3536247612 >> v2:172.21.15.155:3300/0 conn(0x7f87e8137170 0x7f87e8137e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:50.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87dffff700 1 -- 172.21.15.63:0/3536247612 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e8063f60 con 0x7f87e80b29c0 2020-05-18T21:32:50.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87e6d9d700 1 --2- 172.21.15.63:0/3536247612 >> v2:172.21.15.155:3300/0 conn(0x7f87e8137170 0x7f87e8137e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:32:50.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87e759e700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87e80628a0 0x7f87e8062d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:32:50.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87dffff700 1 --2- 172.21.15.63:0/3536247612 >> v2:172.21.15.63:3300/0 conn(0x7f87e80b29c0 0x7f87e80b2e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f87d0002f70 tx=0x7f87d0010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87dffff700 1 --2- 172.21.15.63:0/3536247612 >> v2:172.21.15.63:3300/0 conn(0x7f87e80b29c0 0x7f87e80b2e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f87d0002f70 tx=0x7f87d0010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87dffff700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87e80b29c0 0x7f87e80b2e00 secure :-1 s=READY pgs=1232 cs=0 l=1 rx=0x7f87d0002f70 tx=0x7f87d0010ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:50.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87dffff700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87e80b29c0 0x7f87e80b2e00 secure :-1 s=THROTTLE_DONE pgs=1232 cs=0 l=1 rx=0x7f87d0002f70 tx=0x7f87d0010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87dffff700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87e80b29c0 0x7f87e80b2e00 secure :-1 s=THROTTLE_DONE pgs=1232 cs=0 l=1 rx=0x7f87d0002f70 tx=0x7f87d0010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87dffff700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87e80b29c0 0x7f87e80b2e00 secure :-1 s=THROTTLE_DONE pgs=1232 cs=0 l=1 rx=0x7f87d0002f70 tx=0x7f87d0010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87e4d99700 1 -- 172.21.15.63:0/3536247612 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87d0007180 con 0x7f87e80b29c0 2020-05-18T21:32:50.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87e4d99700 1 -- 172.21.15.63:0/3536247612 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d00072e0 con 0x7f87e80b29c0 2020-05-18T21:32:50.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87ec961700 1 -- 172.21.15.63:0/3536247612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e8137550 con 0x7f87e80b29c0 2020-05-18T21:32:50.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87e4d99700 1 -- 172.21.15.63:0/3536247612 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87d0008730 con 0x7f87e80b29c0 2020-05-18T21:32:50.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87ec961700 1 -- 172.21.15.63:0/3536247612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e8115810 con 0x7f87e80b29c0 2020-05-18T21:32:50.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87dffff700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87e80b29c0 0x7f87e80b2e00 secure :-1 s=THROTTLE_DONE pgs=1232 cs=0 l=1 rx=0x7f87d0002f70 tx=0x7f87d0010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.697+0000 7f87ec961700 1 -- 172.21.15.63:0/3536247612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e80640f0 con 0x7f87e80b29c0 2020-05-18T21:32:50.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.701+0000 7f87e4d99700 1 -- 172.21.15.63:0/3536247612 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f87d000b280 con 0x7f87e80b29c0 2020-05-18T21:32:50.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.701+0000 7f87dffff700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87e80b29c0 0x7f87e80b2e00 secure :-1 s=THROTTLE_DONE pgs=1232 cs=0 l=1 rx=0x7f87d0002f70 tx=0x7f87d0010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.701+0000 7f87e4d99700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f87cc04fa50 0x7f87cc051f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:50.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.701+0000 7f87e4d99700 1 -- 172.21.15.63:0/3536247612 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f87d0063d10 con 0x7f87e80b29c0 2020-05-18T21:32:50.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.701+0000 7f87e6d9d700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f87cc04fa50 0x7f87cc051f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.701+0000 7f87e6d9d700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f87cc04fa50 0x7f87cc051f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f87e805c040 tx=0x7f87d800c9e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.701+0000 7f87e6d9d700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f87cc04fa50 0x7f87cc051f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f87e805c040 tx=0x7f87d800c9e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.701+0000 7f87e6d9d700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f87cc04fa50 0x7f87cc051f10 secure :-1 s=READY pgs=488 cs=0 l=1 rx=0x7f87e805c040 tx=0x7f87d800c9e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:50.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.705+0000 7f87dffff700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87e80b29c0 0x7f87e80b2e00 secure :-1 s=THROTTLE_DONE pgs=1232 cs=0 l=1 rx=0x7f87d0002f70 tx=0x7f87d0010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.705+0000 7f87e4d99700 1 -- 172.21.15.63:0/3536247612 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f87d003e0a0 con 0x7f87e80b29c0 2020-05-18T21:32:50.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.821+0000 7f87ec961700 1 -- 172.21.15.63:0/3536247612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f87e80569e0 con 0x7f87e80b29c0 2020-05-18T21:32:50.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.821+0000 7f87dffff700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87e80b29c0 0x7f87e80b2e00 secure :-1 s=THROTTLE_DONE pgs=1232 cs=0 l=1 rx=0x7f87d0002f70 tx=0x7f87d0010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.821+0000 7f87e4d99700 1 -- 172.21.15.63:0/3536247612 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v90) v1 ==== 110+0+10 (secure 0 0 0) 0x7f87d00416c0 con 0x7f87e80b29c0 2020-05-18T21:32:50.826 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:32:50.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.825+0000 7f87ec961700 1 -- 172.21.15.63:0/3536247612 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f87cc04fa50 msgr2=0x7f87cc051f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.825+0000 7f87ec961700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f87cc04fa50 0x7f87cc051f10 secure :-1 s=READY pgs=488 cs=0 l=1 rx=0x7f87e805c040 tx=0x7f87d800c9e0).stop 2020-05-18T21:32:50.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.825+0000 7f87ec961700 1 -- 172.21.15.63:0/3536247612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87e80b29c0 msgr2=0x7f87e80b2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.825+0000 7f87ec961700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87e80b29c0 0x7f87e80b2e00 secure :-1 s=READY pgs=1232 cs=0 l=1 rx=0x7f87d0002f70 tx=0x7f87d0010ed0).stop 2020-05-18T21:32:50.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.825+0000 7f87ec961700 1 -- 172.21.15.63:0/3536247612 shutdown_connections 2020-05-18T21:32:50.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.825+0000 7f87ec961700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f87cc04fa50 0x7f87cc051f10 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:50.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.825+0000 7f87ec961700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87e80628a0 0x7f87e8062d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:50.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.825+0000 7f87ec961700 1 --2- 172.21.15.63:0/3536247612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87e80b29c0 0x7f87e80b2e00 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:50.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.825+0000 7f87ec961700 1 --2- 172.21.15.63:0/3536247612 >> v2:172.21.15.155:3300/0 conn(0x7f87e8137170 0x7f87e8137e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:50.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.825+0000 7f87ec961700 1 -- 172.21.15.63:0/3536247612 >> 172.21.15.63:0/3536247612 conn(0x7f87e8069b70 msgr2=0x7f87e805c260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:50.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.825+0000 7f87ec961700 1 -- 172.21.15.63:0/3536247612 shutdown_connections 2020-05-18T21:32:50.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.825+0000 7f87ec961700 1 -- 172.21.15.63:0/3536247612 wait complete. 2020-05-18T21:32:50.844 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:32:50.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.945+0000 7f6abaea5700 1 Processor -- start 2020-05-18T21:32:50.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.945+0000 7f6abaea5700 1 -- start start 2020-05-18T21:32:50.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6abaea5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ab40b95a0 0x7f6ab40aef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:50.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6abaea5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6ab40b47b0 0x7f6ab4146610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:50.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6abaea5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab405fb20 con 0x7f6ab41461d0 2020-05-18T21:32:50.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6abaea5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab4145a90 con 0x7f6ab40b47b0 2020-05-18T21:32:50.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6abaea5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab4145d30 con 0x7f6ab40b95a0 2020-05-18T21:32:50.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6aba6a4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6ab40b47b0 0x7f6ab4146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6aba6a4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6ab40b47b0 0x7f6ab4146610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59408/0 (socket says 172.21.15.63:59408) 2020-05-18T21:32:50.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6aba6a4700 1 -- 172.21.15.63:0/2291318688 learned_addr learned my addr 172.21.15.63:0/2291318688 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:50.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6ab9ea3700 1 --2- 172.21.15.63:0/2291318688 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ab40b95a0 0x7f6ab40aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6aba6a4700 1 -- 172.21.15.63:0/2291318688 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ab40b95a0 msgr2=0x7f6ab40aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:50.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6aba6a4700 1 --2- 172.21.15.63:0/2291318688 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ab40b95a0 0x7f6ab40aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:50.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6aba6a4700 1 -- 172.21.15.63:0/2291318688 >> v1:172.21.15.155:6789/0 conn(0x7f6ab41461d0 legacy=0x7f6ab40b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6aba6a4700 1 -- 172.21.15.63:0/2291318688 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab40b9980 con 0x7f6ab40b47b0 2020-05-18T21:32:50.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6aba6a4700 1 --2- 172.21.15.63:0/2291318688 >> v2:172.21.15.63:3300/0 conn(0x7f6ab40b47b0 0x7f6ab4146610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6aac0032f0 tx=0x7f6aac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6aba6a4700 1 --2- 172.21.15.63:0/2291318688 >> v2:172.21.15.63:3300/0 conn(0x7f6ab40b47b0 0x7f6ab4146610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6aac0032f0 tx=0x7f6aac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6aba6a4700 1 --2- 172.21.15.63:0/2291318688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ab40b47b0 0x7f6ab4146610 secure :-1 s=READY pgs=1233 cs=0 l=1 rx=0x7f6aac0032f0 tx=0x7f6aac007e00).ready entity=mon.0 client_cookie=e2b98eaf7daac7ee server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:50.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6aba6a4700 1 --2- 172.21.15.63:0/2291318688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ab40b47b0 0x7f6ab4146610 secure :-1 s=THROTTLE_DONE pgs=1233 cs=0 l=1 rx=0x7f6aac0032f0 tx=0x7f6aac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6ab8ea1700 1 -- 172.21.15.63:0/2291318688 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aac012e40 con 0x7f6ab40b47b0 2020-05-18T21:32:50.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6aba6a4700 1 --2- 172.21.15.63:0/2291318688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ab40b47b0 0x7f6ab4146610 secure :-1 s=THROTTLE_DONE pgs=1233 cs=0 l=1 rx=0x7f6aac0032f0 tx=0x7f6aac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6aba6a4700 1 --2- 172.21.15.63:0/2291318688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ab40b47b0 0x7f6ab4146610 secure :-1 s=THROTTLE_DONE pgs=1233 cs=0 l=1 rx=0x7f6aac0032f0 tx=0x7f6aac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6ab8ea1700 1 -- 172.21.15.63:0/2291318688 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac00b370 con 0x7f6ab40b47b0 2020-05-18T21:32:50.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6ab8ea1700 1 -- 172.21.15.63:0/2291318688 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aac00b790 con 0x7f6ab40b47b0 2020-05-18T21:32:50.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6abaea5700 1 -- 172.21.15.63:0/2291318688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ab40b47b0 msgr2=0x7f6ab4146610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6abaea5700 1 --2- 172.21.15.63:0/2291318688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ab40b47b0 0x7f6ab4146610 secure :-1 s=READY pgs=1233 cs=0 l=1 rx=0x7f6aac0032f0 tx=0x7f6aac007e00).stop 2020-05-18T21:32:50.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6abaea5700 1 -- 172.21.15.63:0/2291318688 shutdown_connections 2020-05-18T21:32:50.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6abaea5700 1 --2- 172.21.15.63:0/2291318688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ab40b47b0 0x7f6ab4146610 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:50.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6abaea5700 1 --2- 172.21.15.63:0/2291318688 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ab40b95a0 0x7f6ab40aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:50.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6abaea5700 1 -- 172.21.15.63:0/2291318688 >> 172.21.15.63:0/2291318688 conn(0x7f6ab406a640 msgr2=0x7f6ab40b8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:50.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6abaea5700 1 -- 172.21.15.63:0/2291318688 shutdown_connections 2020-05-18T21:32:50.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6abaea5700 1 -- 172.21.15.63:0/2291318688 wait complete. 2020-05-18T21:32:50.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6abaea5700 1 Processor -- start 2020-05-18T21:32:50.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.949+0000 7f6abaea5700 1 -- start start 2020-05-18T21:32:50.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6abaea5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6ab40b47b0 0x7f6ab40b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:50.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6abaea5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6ab41461d0 0x7f6ab40b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:50.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6abaea5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab40b8240 con 0x7f6ab40b95a0 2020-05-18T21:32:50.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6abaea5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab40b1960 con 0x7f6ab40b47b0 2020-05-18T21:32:50.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6abaea5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab40b1c00 con 0x7f6ab41461d0 2020-05-18T21:32:50.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6ab96a2700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6ab40b95a0 0x7f6ab4144d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33366/0 (socket says 172.21.15.63:33366) 2020-05-18T21:32:50.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6ab96a2700 1 -- 172.21.15.63:0/2547092285 learned_addr learned my addr 172.21.15.63:0/2547092285 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:50.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6ab9ea3700 1 --2- 172.21.15.63:0/2547092285 >> v2:172.21.15.63:3300/0 conn(0x7f6ab40b47b0 0x7f6ab40b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6aba6a4700 1 --2- 172.21.15.63:0/2547092285 >> v2:172.21.15.155:3300/0 conn(0x7f6ab41461d0 0x7f6ab40b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6aa2ffd700 1 -- 172.21.15.63:0/2547092285 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705648528 0 0) 0x7f6ab405fb20 con 0x7f6ab40b95a0 2020-05-18T21:32:50.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6aa2ffd700 1 -- 172.21.15.63:0/2547092285 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a94002fe0 con 0x7f6ab40b95a0 2020-05-18T21:32:50.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6ab9ea3700 1 -- 172.21.15.63:0/2547092285 >> v2:172.21.15.155:3300/0 conn(0x7f6ab41461d0 msgr2=0x7f6ab40b7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6ab9ea3700 1 --2- 172.21.15.63:0/2547092285 >> v2:172.21.15.155:3300/0 conn(0x7f6ab41461d0 0x7f6ab40b7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:50.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6ab9ea3700 1 -- 172.21.15.63:0/2547092285 >> v1:172.21.15.63:6789/0 conn(0x7f6ab40b95a0 legacy=0x7f6ab4144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:50.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6ab9ea3700 1 -- 172.21.15.63:0/2547092285 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab40b1ea0 con 0x7f6ab40b47b0 2020-05-18T21:32:50.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6ab9ea3700 1 --2- 172.21.15.63:0/2547092285 >> v2:172.21.15.63:3300/0 conn(0x7f6ab40b47b0 0x7f6ab40b2950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ab0002f70 tx=0x7f6ab0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6ab9ea3700 1 --2- 172.21.15.63:0/2547092285 >> v2:172.21.15.63:3300/0 conn(0x7f6ab40b47b0 0x7f6ab40b2950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ab0002f70 tx=0x7f6ab0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6ab9ea3700 1 --2- 172.21.15.63:0/2547092285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ab40b47b0 0x7f6ab40b2950 secure :-1 s=READY pgs=1235 cs=0 l=1 rx=0x7f6ab0002f70 tx=0x7f6ab0010bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:50.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6ab9ea3700 1 --2- 172.21.15.63:0/2547092285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ab40b47b0 0x7f6ab40b2950 secure :-1 s=THROTTLE_DONE pgs=1235 cs=0 l=1 rx=0x7f6ab0002f70 tx=0x7f6ab0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6aa2ffd700 1 -- 172.21.15.63:0/2547092285 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ab0007550 con 0x7f6ab40b47b0 2020-05-18T21:32:50.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6ab9ea3700 1 --2- 172.21.15.63:0/2547092285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ab40b47b0 0x7f6ab40b2950 secure :-1 s=THROTTLE_DONE pgs=1235 cs=0 l=1 rx=0x7f6ab0002f70 tx=0x7f6ab0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6aa2ffd700 1 -- 172.21.15.63:0/2547092285 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab0005700 con 0x7f6ab40b47b0 2020-05-18T21:32:50.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6abaea5700 1 -- 172.21.15.63:0/2547092285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab4145470 con 0x7f6ab40b47b0 2020-05-18T21:32:50.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6ab9ea3700 1 --2- 172.21.15.63:0/2547092285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ab40b47b0 0x7f6ab40b2950 secure :-1 s=THROTTLE_DONE pgs=1235 cs=0 l=1 rx=0x7f6ab0002f70 tx=0x7f6ab0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6aa2ffd700 1 -- 172.21.15.63:0/2547092285 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ab0005ae0 con 0x7f6ab40b47b0 2020-05-18T21:32:50.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6abaea5700 1 -- 172.21.15.63:0/2547092285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab40b2340 con 0x7f6ab40b47b0 2020-05-18T21:32:50.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6ab9ea3700 1 --2- 172.21.15.63:0/2547092285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ab40b47b0 0x7f6ab40b2950 secure :-1 s=THROTTLE_DONE pgs=1235 cs=0 l=1 rx=0x7f6ab0002f70 tx=0x7f6ab0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.953+0000 7f6abaea5700 1 -- 172.21.15.63:0/2547092285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab40569e0 con 0x7f6ab40b47b0 2020-05-18T21:32:50.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.957+0000 7f6aa2ffd700 1 -- 172.21.15.63:0/2547092285 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6ab0005d60 con 0x7f6ab40b47b0 2020-05-18T21:32:50.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.957+0000 7f6ab9ea3700 1 --2- 172.21.15.63:0/2547092285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ab40b47b0 0x7f6ab40b2950 secure :-1 s=THROTTLE_DONE pgs=1235 cs=0 l=1 rx=0x7f6ab0002f70 tx=0x7f6ab0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.957+0000 7f6aa2ffd700 1 --2- 172.21.15.63:0/2547092285 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6a9404fd80 0x7f6a94052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:50.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.957+0000 7f6aa2ffd700 1 -- 172.21.15.63:0/2547092285 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6ab0063e70 con 0x7f6ab40b47b0 2020-05-18T21:32:50.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.957+0000 7f6ab96a2700 1 --2- 172.21.15.63:0/2547092285 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6a9404fd80 0x7f6a94052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:50.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.957+0000 7f6ab96a2700 1 --2- 172.21.15.63:0/2547092285 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6a9404fd80 0x7f6a94052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6aa40011a0 tx=0x7f6aa4001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.957+0000 7f6ab96a2700 1 --2- 172.21.15.63:0/2547092285 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6a9404fd80 0x7f6a94052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6aa40011a0 tx=0x7f6aa4001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.957+0000 7f6ab96a2700 1 --2- 172.21.15.63:0/2547092285 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6a9404fd80 0x7f6a94052240 secure :-1 s=READY pgs=489 cs=0 l=1 rx=0x7f6aa40011a0 tx=0x7f6aa4001880).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:50.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.961+0000 7f6ab9ea3700 1 --2- 172.21.15.63:0/2547092285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ab40b47b0 0x7f6ab40b2950 secure :-1 s=THROTTLE_DONE pgs=1235 cs=0 l=1 rx=0x7f6ab0002f70 tx=0x7f6ab0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:50.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:50.961+0000 7f6aa2ffd700 1 -- 172.21.15.63:0/2547092285 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6ab003e1a0 con 0x7f6ab40b47b0 2020-05-18T21:32:51.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.081+0000 7f6abaea5700 1 -- 172.21.15.63:0/2547092285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6ab4066470 con 0x7f6ab40b47b0 2020-05-18T21:32:51.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.081+0000 7f6ab9ea3700 1 --2- 172.21.15.63:0/2547092285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ab40b47b0 0x7f6ab40b2950 secure :-1 s=THROTTLE_DONE pgs=1235 cs=0 l=1 rx=0x7f6ab0002f70 tx=0x7f6ab0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.081+0000 7f6aa2ffd700 1 -- 172.21.15.63:0/2547092285 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v90) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6ab00417c0 con 0x7f6ab40b47b0 2020-05-18T21:32:51.085 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:32:51.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.081+0000 7f6abaea5700 1 -- 172.21.15.63:0/2547092285 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6a9404fd80 msgr2=0x7f6a94052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:51.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.081+0000 7f6abaea5700 1 --2- 172.21.15.63:0/2547092285 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6a9404fd80 0x7f6a94052240 secure :-1 s=READY pgs=489 cs=0 l=1 rx=0x7f6aa40011a0 tx=0x7f6aa4001880).stop 2020-05-18T21:32:51.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.081+0000 7f6abaea5700 1 -- 172.21.15.63:0/2547092285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ab40b47b0 msgr2=0x7f6ab40b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:51.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.081+0000 7f6abaea5700 1 --2- 172.21.15.63:0/2547092285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ab40b47b0 0x7f6ab40b2950 secure :-1 s=READY pgs=1235 cs=0 l=1 rx=0x7f6ab0002f70 tx=0x7f6ab0010bb0).stop 2020-05-18T21:32:51.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.081+0000 7f6abaea5700 1 -- 172.21.15.63:0/2547092285 shutdown_connections 2020-05-18T21:32:51.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.081+0000 7f6abaea5700 1 --2- 172.21.15.63:0/2547092285 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6a9404fd80 0x7f6a94052240 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:51.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.081+0000 7f6abaea5700 1 --2- 172.21.15.63:0/2547092285 >> v2:172.21.15.155:3300/0 conn(0x7f6ab41461d0 0x7f6ab40b7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:51.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.081+0000 7f6abaea5700 1 --2- 172.21.15.63:0/2547092285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ab40b47b0 0x7f6ab40b2950 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:51.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.081+0000 7f6abaea5700 1 -- 172.21.15.63:0/2547092285 >> 172.21.15.63:0/2547092285 conn(0x7f6ab406a640 msgr2=0x7f6ab409b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:51.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.081+0000 7f6abaea5700 1 -- 172.21.15.63:0/2547092285 shutdown_connections 2020-05-18T21:32:51.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.081+0000 7f6abaea5700 1 -- 172.21.15.63:0/2547092285 wait complete. 2020-05-18T21:32:51.102 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-05-18T21:32:51.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55fccab700 1 Processor -- start 2020-05-18T21:32:51.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55fccab700 1 -- start start 2020-05-18T21:32:51.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55fccab700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55f805f110 0x7f55f80b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:51.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55fccab700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f8064fd0 0x7f55f814d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:51.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55fccab700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f814a330 con 0x7f55f814aa70 2020-05-18T21:32:51.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55fccab700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f814a140 con 0x7f55f805f110 2020-05-18T21:32:51.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55fccab700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f8065460 con 0x7f55f8064fd0 2020-05-18T21:32:51.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55f7fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f8064fd0 0x7f55f814d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:51.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55f77fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55f805f110 0x7f55f80b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:51.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55f6ffd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f55f814aa70 0x7f55f80648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:59922/0 (socket says 172.21.15.63:59922) 2020-05-18T21:32:51.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55f6ffd700 1 -- 172.21.15.63:0/3860633452 learned_addr learned my addr 172.21.15.63:0/3860633452 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:51.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55f77fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55f805f110 0x7f55f80b4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:46036/0 (socket says 172.21.15.63:46036) 2020-05-18T21:32:51.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55f77fe700 1 -- 172.21.15.63:0/3860633452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f8064fd0 msgr2=0x7f55f814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:51.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55f77fe700 1 --2- 172.21.15.63:0/3860633452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f8064fd0 0x7f55f814d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:51.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55f77fe700 1 -- 172.21.15.63:0/3860633452 >> v1:172.21.15.155:6789/0 conn(0x7f55f814aa70 legacy=0x7f55f80648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:51.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55f77fe700 1 -- 172.21.15.63:0/3860633452 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f814a5d0 con 0x7f55f805f110 2020-05-18T21:32:51.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55f77fe700 1 --2- 172.21.15.63:0/3860633452 >> v2:172.21.15.155:3300/0 conn(0x7f55f805f110 0x7f55f80b4760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f55f8063c70 tx=0x7f55ec008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55f77fe700 1 --2- 172.21.15.63:0/3860633452 >> v2:172.21.15.155:3300/0 conn(0x7f55f805f110 0x7f55f80b4760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f55f8063c70 tx=0x7f55ec008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55f77fe700 1 --2- 172.21.15.63:0/3860633452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55f805f110 0x7f55f80b4760 secure :-1 s=READY pgs=857 cs=0 l=1 rx=0x7f55f8063c70 tx=0x7f55ec008920).ready entity=mon.1 client_cookie=fe3f909d0563fb50 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:51.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55f77fe700 1 --2- 172.21.15.63:0/3860633452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55f805f110 0x7f55f80b4760 secure :-1 s=THROTTLE_DONE pgs=857 cs=0 l=1 rx=0x7f55f8063c70 tx=0x7f55ec008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55f77fe700 1 --2- 172.21.15.63:0/3860633452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55f805f110 0x7f55f80b4760 secure :-1 s=THROTTLE_DONE pgs=857 cs=0 l=1 rx=0x7f55f8063c70 tx=0x7f55ec008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55f77fe700 1 --2- 172.21.15.63:0/3860633452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55f805f110 0x7f55f80b4760 secure :-1 s=THROTTLE_DONE pgs=857 cs=0 l=1 rx=0x7f55f8063c70 tx=0x7f55ec008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55f67fc700 1 -- 172.21.15.63:0/3860633452 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55ec008e80 con 0x7f55f805f110 2020-05-18T21:32:51.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55f67fc700 1 -- 172.21.15.63:0/3860633452 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec0115f0 con 0x7f55f805f110 2020-05-18T21:32:51.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55f67fc700 1 -- 172.21.15.63:0/3860633452 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55ec011a10 con 0x7f55f805f110 2020-05-18T21:32:51.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55fccab700 1 -- 172.21.15.63:0/3860633452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55f805f110 msgr2=0x7f55f80b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:51.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.201+0000 7f55fccab700 1 --2- 172.21.15.63:0/3860633452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55f805f110 0x7f55f80b4760 secure :-1 s=READY pgs=857 cs=0 l=1 rx=0x7f55f8063c70 tx=0x7f55ec008920).stop 2020-05-18T21:32:51.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55fccab700 1 -- 172.21.15.63:0/3860633452 shutdown_connections 2020-05-18T21:32:51.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55fccab700 1 --2- 172.21.15.63:0/3860633452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f8064fd0 0x7f55f814d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:51.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55fccab700 1 --2- 172.21.15.63:0/3860633452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55f805f110 0x7f55f80b4760 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:51.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55fccab700 1 -- 172.21.15.63:0/3860633452 >> 172.21.15.63:0/3860633452 conn(0x7f55f8069fc0 msgr2=0x7f55f806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:51.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55fccab700 1 -- 172.21.15.63:0/3860633452 shutdown_connections 2020-05-18T21:32:51.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55fccab700 1 -- 172.21.15.63:0/3860633452 wait complete. 2020-05-18T21:32:51.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55fccab700 1 Processor -- start 2020-05-18T21:32:51.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55fccab700 1 -- start start 2020-05-18T21:32:51.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55fccab700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f805f110 0x7f55f8145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:51.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55fccab700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55f814aa70 0x7f55f81461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:51.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55fccab700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f81492e0 con 0x7f55f8064fd0 2020-05-18T21:32:51.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55fccab700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f8149580 con 0x7f55f814aa70 2020-05-18T21:32:51.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55fccab700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f8149820 con 0x7f55f805f110 2020-05-18T21:32:51.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55f77fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f805f110 0x7f55f8145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:51.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55f6ffd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f55f8064fd0 0x7f55f815af50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:59928/0 (socket says 172.21.15.63:59928) 2020-05-18T21:32:51.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55f6ffd700 1 -- 172.21.15.63:0/2380630323 learned_addr learned my addr 172.21.15.63:0/2380630323 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:51.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55f7fff700 1 --2- 172.21.15.63:0/2380630323 >> v2:172.21.15.155:3300/0 conn(0x7f55f814aa70 0x7f55f81461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:51.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55f4ff9700 1 -- 172.21.15.63:0/2380630323 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734255885 0 0) 0x7f55f81492e0 con 0x7f55f8064fd0 2020-05-18T21:32:51.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55f4ff9700 1 -- 172.21.15.63:0/2380630323 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55d8002fe0 con 0x7f55f8064fd0 2020-05-18T21:32:51.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55f77fe700 1 -- 172.21.15.63:0/2380630323 >> v2:172.21.15.155:3300/0 conn(0x7f55f814aa70 msgr2=0x7f55f81461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:51.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55f77fe700 1 --2- 172.21.15.63:0/2380630323 >> v2:172.21.15.155:3300/0 conn(0x7f55f814aa70 0x7f55f81461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:51.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55f77fe700 1 -- 172.21.15.63:0/2380630323 >> v1:172.21.15.155:6789/0 conn(0x7f55f8064fd0 legacy=0x7f55f815af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:51.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55f77fe700 1 -- 172.21.15.63:0/2380630323 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f8147150 con 0x7f55f805f110 2020-05-18T21:32:51.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55f77fe700 1 --2- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f805f110 0x7f55f8145d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f55f8063c70 tx=0x7f55f80640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55f77fe700 1 --2- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f805f110 0x7f55f8145d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f55f8063c70 tx=0x7f55f80640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55f77fe700 1 --2- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f805f110 0x7f55f8145d60 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7f55f8063c70 tx=0x7f55f80640f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:51.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55f77fe700 1 --2- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f805f110 0x7f55f8145d60 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f55f8063c70 tx=0x7f55f80640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55f4ff9700 1 -- 172.21.15.63:0/2380630323 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55ec011980 con 0x7f55f805f110 2020-05-18T21:32:51.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55f77fe700 1 --2- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f805f110 0x7f55f8145d60 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f55f8063c70 tx=0x7f55f80640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55f77fe700 1 --2- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f805f110 0x7f55f8145d60 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f55f8063c70 tx=0x7f55f80640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55f4ff9700 1 -- 172.21.15.63:0/2380630323 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec007170 con 0x7f55f805f110 2020-05-18T21:32:51.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55fccab700 1 -- 172.21.15.63:0/2380630323 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f81473a0 con 0x7f55f805f110 2020-05-18T21:32:51.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55f4ff9700 1 -- 172.21.15.63:0/2380630323 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55ec007550 con 0x7f55f805f110 2020-05-18T21:32:51.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.205+0000 7f55fccab700 1 -- 172.21.15.63:0/2380630323 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f815b880 con 0x7f55f805f110 2020-05-18T21:32:51.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.209+0000 7f55fccab700 1 -- 172.21.15.63:0/2380630323 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f80569e0 con 0x7f55f805f110 2020-05-18T21:32:51.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.209+0000 7f55f77fe700 1 --2- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f805f110 0x7f55f8145d60 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f55f8063c70 tx=0x7f55f80640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.209+0000 7f55f77fe700 1 --2- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f805f110 0x7f55f8145d60 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f55f8063c70 tx=0x7f55f80640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.209+0000 7f55f4ff9700 1 -- 172.21.15.63:0/2380630323 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f55ec005700 con 0x7f55f805f110 2020-05-18T21:32:51.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.209+0000 7f55f4ff9700 1 --2- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55d804fd30 0x7f55d80521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:51.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.209+0000 7f55f4ff9700 1 -- 172.21.15.63:0/2380630323 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f55ec064440 con 0x7f55f805f110 2020-05-18T21:32:51.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.209+0000 7f55f6ffd700 1 --2- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55d804fd30 0x7f55d80521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:51.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.209+0000 7f55f6ffd700 1 --2- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55d804fd30 0x7f55d80521f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f55e80011a0 tx=0x7f55e80016d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.209+0000 7f55f6ffd700 1 --2- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55d804fd30 0x7f55d80521f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f55e80011a0 tx=0x7f55e80016d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.209+0000 7f55f6ffd700 1 --2- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55d804fd30 0x7f55d80521f0 secure :-1 s=READY pgs=490 cs=0 l=1 rx=0x7f55e80011a0 tx=0x7f55e80016d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:51.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.217+0000 7f55f77fe700 1 --2- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f805f110 0x7f55f8145d60 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f55f8063c70 tx=0x7f55f80640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.217+0000 7f55f4ff9700 1 -- 172.21.15.63:0/2380630323 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f55ec03e790 con 0x7f55f805f110 2020-05-18T21:32:51.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.333+0000 7f55fccab700 1 -- 172.21.15.63:0/2380630323 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f55f80625f0 con 0x7f55f805f110 2020-05-18T21:32:51.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.337+0000 7f55f77fe700 1 --2- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f805f110 0x7f55f8145d60 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f55f8063c70 tx=0x7f55f80640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.337+0000 7f55f4ff9700 1 -- 172.21.15.63:0/2380630323 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v90) v1 ==== 84+0+143 (secure 0 0 0) 0x7f55ec041db0 con 0x7f55f805f110 2020-05-18T21:32:51.340 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:51.341 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:32:51.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:51.341 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2020-05-18T21:32:51.341 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "device_health_metrics" 2020-05-18T21:32:51.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:32:51.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:32:51.342 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 2, 2020-05-18T21:32:51.342 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "rbd" 2020-05-18T21:32:51.342 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:32:51.342 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:32:51.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.337+0000 7f55fccab700 1 -- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55d804fd30 msgr2=0x7f55d80521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:51.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.337+0000 7f55fccab700 1 --2- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55d804fd30 0x7f55d80521f0 secure :-1 s=READY pgs=490 cs=0 l=1 rx=0x7f55e80011a0 tx=0x7f55e80016d0).stop 2020-05-18T21:32:51.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.337+0000 7f55fccab700 1 -- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f805f110 msgr2=0x7f55f8145d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:51.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.337+0000 7f55fccab700 1 --2- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f805f110 0x7f55f8145d60 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7f55f8063c70 tx=0x7f55f80640f0).stop 2020-05-18T21:32:51.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.337+0000 7f55fccab700 1 -- 172.21.15.63:0/2380630323 shutdown_connections 2020-05-18T21:32:51.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.337+0000 7f55fccab700 1 --2- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55d804fd30 0x7f55d80521f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:51.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.337+0000 7f55fccab700 1 --2- 172.21.15.63:0/2380630323 >> v2:172.21.15.155:3300/0 conn(0x7f55f814aa70 0x7f55f81461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:51.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.337+0000 7f55fccab700 1 --2- 172.21.15.63:0/2380630323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55f805f110 0x7f55f8145d60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:51.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.337+0000 7f55fccab700 1 -- 172.21.15.63:0/2380630323 >> 172.21.15.63:0/2380630323 conn(0x7f55f8069fc0 msgr2=0x7f55f80b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:51.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.337+0000 7f55fccab700 1 -- 172.21.15.63:0/2380630323 shutdown_connections 2020-05-18T21:32:51.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.337+0000 7f55fccab700 1 -- 172.21.15.63:0/2380630323 wait complete. 2020-05-18T21:32:51.353 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-05-18T21:32:51.354 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-05-18T21:32:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.457+0000 7f538a2c0700 1 Processor -- start 2020-05-18T21:32:51.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.457+0000 7f538a2c0700 1 -- start start 2020-05-18T21:32:51.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f538a2c0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b5a60 0x7f538409f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:51.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f538a2c0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5384146580 con 0x7f538412bd70 2020-05-18T21:32:51.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f538a2c0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5384062300 con 0x7f53840b62a0 2020-05-18T21:32:51.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f538a2c0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53841467b0 con 0x7f53840b5a60 2020-05-18T21:32:51.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5389abf700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f538412bd70 0x7f5384142ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33392/0 (socket says 172.21.15.63:33392) 2020-05-18T21:32:51.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5389abf700 1 -- 172.21.15.63:0/3564830777 learned_addr learned my addr 172.21.15.63:0/3564830777 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:51.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5388abd700 1 --2- 172.21.15.63:0/3564830777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b5a60 0x7f538409f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:51.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5373fff700 1 -- 172.21.15.63:0/3564830777 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662913848 0 0) 0x7f5384146580 con 0x7f538412bd70 2020-05-18T21:32:51.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5373fff700 1 -- 172.21.15.63:0/3564830777 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f536c003270 con 0x7f538412bd70 2020-05-18T21:32:51.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5373fff700 1 -- 172.21.15.63:0/3564830777 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434635487 0 0) 0x7f5384062300 con 0x7f53840b62a0 2020-05-18T21:32:51.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5373fff700 1 -- 172.21.15.63:0/3564830777 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5384146580 con 0x7f53840b62a0 2020-05-18T21:32:51.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5388abd700 1 -- 172.21.15.63:0/3564830777 >> v1:172.21.15.155:6789/0 conn(0x7f53840b62a0 legacy=0x7f5384146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:51.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5388abd700 1 -- 172.21.15.63:0/3564830777 >> v1:172.21.15.63:6789/0 conn(0x7f538412bd70 legacy=0x7f5384142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:51.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5373fff700 1 -- 172.21.15.63:0/3564830777 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3346549831 0 0) 0x7f536c003270 con 0x7f538412bd70 2020-05-18T21:32:51.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5388abd700 1 -- 172.21.15.63:0/3564830777 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5384147360 con 0x7f53840b5a60 2020-05-18T21:32:51.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5388abd700 1 --2- 172.21.15.63:0/3564830777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b5a60 0x7f538409f4c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f537c001490 tx=0x7f5374008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5388abd700 1 --2- 172.21.15.63:0/3564830777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b5a60 0x7f538409f4c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f537c001490 tx=0x7f5374008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5388abd700 1 --2- 172.21.15.63:0/3564830777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b5a60 0x7f538409f4c0 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f537c001490 tx=0x7f5374008920).ready entity=mon.2 client_cookie=f383fb4e6dc39c1d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:51.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5388abd700 1 --2- 172.21.15.63:0/3564830777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b5a60 0x7f538409f4c0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f537c001490 tx=0x7f5374008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5373fff700 1 -- 172.21.15.63:0/3564830777 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f537c001a90 con 0x7f53840b5a60 2020-05-18T21:32:51.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5388abd700 1 --2- 172.21.15.63:0/3564830777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b5a60 0x7f538409f4c0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f537c001490 tx=0x7f5374008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5373fff700 1 -- 172.21.15.63:0/3564830777 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5374008e80 con 0x7f53840b5a60 2020-05-18T21:32:51.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5388abd700 1 --2- 172.21.15.63:0/3564830777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b5a60 0x7f538409f4c0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f537c001490 tx=0x7f5374008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f5373fff700 1 -- 172.21.15.63:0/3564830777 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5374011440 con 0x7f53840b5a60 2020-05-18T21:32:51.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f538a2c0700 1 -- 172.21.15.63:0/3564830777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b5a60 msgr2=0x7f538409f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:51.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f538a2c0700 1 --2- 172.21.15.63:0/3564830777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b5a60 0x7f538409f4c0 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f537c001490 tx=0x7f5374008920).stop 2020-05-18T21:32:51.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f538a2c0700 1 -- 172.21.15.63:0/3564830777 shutdown_connections 2020-05-18T21:32:51.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f538a2c0700 1 --2- 172.21.15.63:0/3564830777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b5a60 0x7f538409f4c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:51.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f538a2c0700 1 -- 172.21.15.63:0/3564830777 >> 172.21.15.63:0/3564830777 conn(0x7f538405a7c0 msgr2=0x7f538405aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:51.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f538a2c0700 1 -- 172.21.15.63:0/3564830777 shutdown_connections 2020-05-18T21:32:51.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.461+0000 7f538a2c0700 1 -- 172.21.15.63:0/3564830777 wait complete. 2020-05-18T21:32:51.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.465+0000 7f538a2c0700 1 Processor -- start 2020-05-18T21:32:51.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.465+0000 7f538a2c0700 1 -- start start 2020-05-18T21:32:51.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.465+0000 7f538a2c0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f53840b5a60 0x7f53840b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:51.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.465+0000 7f538a2c0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b62a0 0x7f53841282b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:51.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.465+0000 7f538a2c0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53840b9210 con 0x7f538412bd70 2020-05-18T21:32:51.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.465+0000 7f538a2c0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53840b3230 con 0x7f53840b5a60 2020-05-18T21:32:51.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.465+0000 7f538a2c0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53841576d0 con 0x7f53840b62a0 2020-05-18T21:32:51.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.465+0000 7f53892be700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f53840b5a60 0x7f53840b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:51.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.465+0000 7f53892be700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f53840b5a60 0x7f53840b2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59438/0 (socket says 172.21.15.63:59438) 2020-05-18T21:32:51.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.465+0000 7f53892be700 1 -- 172.21.15.63:0/2726879948 learned_addr learned my addr 172.21.15.63:0/2726879948 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:51.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.465+0000 7f5388abd700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b62a0 0x7f53841282b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:51.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53727fc700 1 -- 172.21.15.63:0/2726879948 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502435017 0 0) 0x7f53840b9210 con 0x7f538412bd70 2020-05-18T21:32:51.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53727fc700 1 -- 172.21.15.63:0/2726879948 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5364002fe0 con 0x7f538412bd70 2020-05-18T21:32:51.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53892be700 1 -- 172.21.15.63:0/2726879948 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b62a0 msgr2=0x7f53841282b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:51.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53892be700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b62a0 0x7f53841282b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:51.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53892be700 1 -- 172.21.15.63:0/2726879948 >> v1:172.21.15.155:6789/0 conn(0x7f538412bd70 legacy=0x7f5384143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:51.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53892be700 1 -- 172.21.15.63:0/2726879948 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5384157970 con 0x7f53840b5a60 2020-05-18T21:32:51.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53892be700 1 --2- 172.21.15.63:0/2726879948 >> v2:172.21.15.63:3300/0 conn(0x7f53840b5a60 0x7f53840b2d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f53800011d0 tx=0x7f53800024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53892be700 1 --2- 172.21.15.63:0/2726879948 >> v2:172.21.15.63:3300/0 conn(0x7f53840b5a60 0x7f53840b2d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f53800011d0 tx=0x7f53800024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53892be700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b5a60 0x7f53840b2d90 secure :-1 s=READY pgs=1237 cs=0 l=1 rx=0x7f53800011d0 tx=0x7f53800024d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:51.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53892be700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b5a60 0x7f53840b2d90 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7f53800011d0 tx=0x7f53800024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53892be700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b5a60 0x7f53840b2d90 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7f53800011d0 tx=0x7f53800024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53727fc700 1 -- 172.21.15.63:0/2726879948 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f538000cc60 con 0x7f53840b5a60 2020-05-18T21:32:51.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53892be700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b5a60 0x7f53840b2d90 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7f53800011d0 tx=0x7f53800024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53727fc700 1 -- 172.21.15.63:0/2726879948 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538000ce00 con 0x7f53840b5a60 2020-05-18T21:32:51.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53727fc700 1 -- 172.21.15.63:0/2726879948 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f538000e370 con 0x7f53840b5a60 2020-05-18T21:32:51.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f538a2c0700 1 -- 172.21.15.63:0/2726879948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53840b9640 con 0x7f53840b5a60 2020-05-18T21:32:51.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f538a2c0700 1 -- 172.21.15.63:0/2726879948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5384143840 con 0x7f53840b5a60 2020-05-18T21:32:51.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53892be700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b5a60 0x7f53840b2d90 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7f53800011d0 tx=0x7f53800024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53727fc700 1 -- 172.21.15.63:0/2726879948 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f538000e5a0 con 0x7f53840b5a60 2020-05-18T21:32:51.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53892be700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b5a60 0x7f53840b2d90 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7f53800011d0 tx=0x7f53800024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f538a2c0700 1 -- 172.21.15.63:0/2726879948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5384143b50 con 0x7f53840b5a60 2020-05-18T21:32:51.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53727fc700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f536404fdb0 0x7f5364052270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:51.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f53727fc700 1 -- 172.21.15.63:0/2726879948 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5380063990 con 0x7f53840b5a60 2020-05-18T21:32:51.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.469+0000 7f5388abd700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f536404fdb0 0x7f5364052270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:51.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.473+0000 7f5388abd700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f536404fdb0 0x7f5364052270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f537c001490 tx=0x7f53841474f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.473+0000 7f5388abd700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f536404fdb0 0x7f5364052270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f537c001490 tx=0x7f53841474f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.473+0000 7f5388abd700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f536404fdb0 0x7f5364052270 secure :-1 s=READY pgs=491 cs=0 l=1 rx=0x7f537c001490 tx=0x7f53841474f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:51.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.477+0000 7f53892be700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b5a60 0x7f53840b2d90 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7f53800011d0 tx=0x7f53800024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.477+0000 7f53727fc700 1 -- 172.21.15.63:0/2726879948 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f5384143b50 con 0x7f53840b5a60 2020-05-18T21:32:51.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.593+0000 7f538a2c0700 1 -- 172.21.15.63:0/2726879948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f5384143b50 con 0x7f53840b5a60 2020-05-18T21:32:51.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.885+0000 7f53892be700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b5a60 0x7f53840b2d90 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7f53800011d0 tx=0x7f53800024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:51.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.885+0000 7f53727fc700 1 -- 172.21.15.63:0/2726879948 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v91) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5384143b50 con 0x7f53840b5a60 2020-05-18T21:32:51.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.893+0000 7f538a2c0700 1 -- 172.21.15.63:0/2726879948 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f536404fdb0 msgr2=0x7f5364052270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:51.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.893+0000 7f538a2c0700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f536404fdb0 0x7f5364052270 secure :-1 s=READY pgs=491 cs=0 l=1 rx=0x7f537c001490 tx=0x7f53841474f0).stop 2020-05-18T21:32:51.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.893+0000 7f538a2c0700 1 -- 172.21.15.63:0/2726879948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b5a60 msgr2=0x7f53840b2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:51.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.893+0000 7f538a2c0700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b5a60 0x7f53840b2d90 secure :-1 s=READY pgs=1237 cs=0 l=1 rx=0x7f53800011d0 tx=0x7f53800024d0).stop 2020-05-18T21:32:51.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.893+0000 7f538a2c0700 1 -- 172.21.15.63:0/2726879948 shutdown_connections 2020-05-18T21:32:51.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.893+0000 7f538a2c0700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f536404fdb0 0x7f5364052270 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:51.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.893+0000 7f538a2c0700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b62a0 0x7f53841282b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:51.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.893+0000 7f538a2c0700 1 --2- 172.21.15.63:0/2726879948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b5a60 0x7f53840b2d90 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:51.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.893+0000 7f538a2c0700 1 -- 172.21.15.63:0/2726879948 >> 172.21.15.63:0/2726879948 conn(0x7f538405a7c0 msgr2=0x7f5384145150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:51.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.893+0000 7f538a2c0700 1 -- 172.21.15.63:0/2726879948 shutdown_connections 2020-05-18T21:32:51.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:51.893+0000 7f538a2c0700 1 -- 172.21.15.63:0/2726879948 wait complete. 2020-05-18T21:32:51.903 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2020-05-18T21:32:51.912 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-05-18T21:32:52.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.013+0000 7fbf93a71700 1 Processor -- start 2020-05-18T21:32:52.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.013+0000 7fbf93a71700 1 -- start start 2020-05-18T21:32:52.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.013+0000 7fbf93a71700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbf8c0b9fa0 0x7fbf8c05f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:52.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.013+0000 7fbf93a71700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c1432d0 con 0x7fbf8c0ba380 2020-05-18T21:32:52.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.013+0000 7fbf93a71700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c147140 con 0x7fbf8c146d00 2020-05-18T21:32:52.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.013+0000 7fbf93a71700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8c1430c0 con 0x7fbf8c0b9fa0 2020-05-18T21:32:52.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.013+0000 7fbf9100c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbf8c0ba380 0x7fbf8c143770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33402/0 (socket says 172.21.15.63:33402) 2020-05-18T21:32:52.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.013+0000 7fbf9100c700 1 -- 172.21.15.63:0/1690622229 learned_addr learned my addr 172.21.15.63:0/1690622229 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:52.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.013+0000 7fbf9180d700 1 --2- 172.21.15.63:0/1690622229 >> v2:172.21.15.63:3300/0 conn(0x7fbf8c0b9fa0 0x7fbf8c05f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:52.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf9080b700 1 -- 172.21.15.63:0/1690622229 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1184701326 0 0) 0x7fbf8c1432d0 con 0x7fbf8c0ba380 2020-05-18T21:32:52.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf9080b700 1 -- 172.21.15.63:0/1690622229 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf74003270 con 0x7fbf8c0ba380 2020-05-18T21:32:52.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf9080b700 1 -- 172.21.15.63:0/1690622229 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645387 0 0) 0x7fbf8c147140 con 0x7fbf8c146d00 2020-05-18T21:32:52.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf9080b700 1 -- 172.21.15.63:0/1690622229 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf8c1432d0 con 0x7fbf8c146d00 2020-05-18T21:32:52.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf9180d700 1 -- 172.21.15.63:0/1690622229 >> v1:172.21.15.155:6789/0 conn(0x7fbf8c146d00 legacy=0x7fbf8c0b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:52.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf9080b700 1 -- 172.21.15.63:0/1690622229 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2988741523 0 0) 0x7fbf74003270 con 0x7fbf8c0ba380 2020-05-18T21:32:52.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf9180d700 1 -- 172.21.15.63:0/1690622229 >> v1:172.21.15.63:6789/0 conn(0x7fbf8c0ba380 legacy=0x7fbf8c143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:52.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf9180d700 1 -- 172.21.15.63:0/1690622229 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c142cf0 con 0x7fbf8c0b9fa0 2020-05-18T21:32:52.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf9180d700 1 --2- 172.21.15.63:0/1690622229 >> v2:172.21.15.63:3300/0 conn(0x7fbf8c0b9fa0 0x7fbf8c05f200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbf88002f70 tx=0x7fbf88007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:52.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf9180d700 1 --2- 172.21.15.63:0/1690622229 >> v2:172.21.15.63:3300/0 conn(0x7fbf8c0b9fa0 0x7fbf8c05f200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbf88002f70 tx=0x7fbf88007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:52.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf9180d700 1 --2- 172.21.15.63:0/1690622229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf8c0b9fa0 0x7fbf8c05f200 secure :-1 s=READY pgs=1239 cs=0 l=1 rx=0x7fbf88002f70 tx=0x7fbf88007a80).ready entity=mon.0 client_cookie=7eebbbddd148b29b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:52.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf9180d700 1 --2- 172.21.15.63:0/1690622229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf8c0b9fa0 0x7fbf8c05f200 secure :-1 s=THROTTLE_DONE pgs=1239 cs=0 l=1 rx=0x7fbf88002f70 tx=0x7fbf88007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:52.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf9080b700 1 -- 172.21.15.63:0/1690622229 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf88008e80 con 0x7fbf8c0b9fa0 2020-05-18T21:32:52.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf9180d700 1 --2- 172.21.15.63:0/1690622229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf8c0b9fa0 0x7fbf8c05f200 secure :-1 s=THROTTLE_DONE pgs=1239 cs=0 l=1 rx=0x7fbf88002f70 tx=0x7fbf88007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:52.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf9180d700 1 --2- 172.21.15.63:0/1690622229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf8c0b9fa0 0x7fbf8c05f200 secure :-1 s=THROTTLE_DONE pgs=1239 cs=0 l=1 rx=0x7fbf88002f70 tx=0x7fbf88007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:52.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf9080b700 1 -- 172.21.15.63:0/1690622229 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf88011540 con 0x7fbf8c0b9fa0 2020-05-18T21:32:52.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf9080b700 1 -- 172.21.15.63:0/1690622229 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf880118e0 con 0x7fbf8c0b9fa0 2020-05-18T21:32:52.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf93a71700 1 -- 172.21.15.63:0/1690622229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf8c0b9fa0 msgr2=0x7fbf8c05f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:52.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf93a71700 1 --2- 172.21.15.63:0/1690622229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf8c0b9fa0 0x7fbf8c05f200 secure :-1 s=READY pgs=1239 cs=0 l=1 rx=0x7fbf88002f70 tx=0x7fbf88007a80).stop 2020-05-18T21:32:52.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf93a71700 1 -- 172.21.15.63:0/1690622229 shutdown_connections 2020-05-18T21:32:52.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf93a71700 1 --2- 172.21.15.63:0/1690622229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf8c0b9fa0 0x7fbf8c05f200 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:52.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf93a71700 1 -- 172.21.15.63:0/1690622229 >> 172.21.15.63:0/1690622229 conn(0x7fbf8c05b290 msgr2=0x7fbf8c0b96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:52.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf93a71700 1 -- 172.21.15.63:0/1690622229 shutdown_connections 2020-05-18T21:32:52.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.017+0000 7fbf93a71700 1 -- 172.21.15.63:0/1690622229 wait complete. 2020-05-18T21:32:52.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf93a71700 1 Processor -- start 2020-05-18T21:32:52.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf93a71700 1 -- start start 2020-05-18T21:32:52.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf93a71700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf8c0b9fa0 0x7fbf8c0b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:52.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf93a71700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbf8c0ba380 0x7fbf8c0b7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:52.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf93a71700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c062f70 con 0x7fbf8c146d00 2020-05-18T21:32:52.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf93a71700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8c0b32b0 con 0x7fbf8c0ba380 2020-05-18T21:32:52.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf93a71700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0631a0 con 0x7fbf8c0b9fa0 2020-05-18T21:32:52.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf9100c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbf8c0ba380 0x7fbf8c0b7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:52.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf9100c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbf8c0ba380 0x7fbf8c0b7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59454/0 (socket says 172.21.15.63:59454) 2020-05-18T21:32:52.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf9100c700 1 -- 172.21.15.63:0/2132864434 learned_addr learned my addr 172.21.15.63:0/2132864434 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:52.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf9180d700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf8c0b9fa0 0x7fbf8c0b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:52.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf9100c700 1 -- 172.21.15.63:0/2132864434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf8c0b9fa0 msgr2=0x7fbf8c0b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:52.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf9100c700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf8c0b9fa0 0x7fbf8c0b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:52.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf7effd700 1 -- 172.21.15.63:0/2132864434 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612670461 0 0) 0x7fbf8c062f70 con 0x7fbf8c146d00 2020-05-18T21:32:52.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf9100c700 1 -- 172.21.15.63:0/2132864434 >> v1:172.21.15.155:6789/0 conn(0x7fbf8c146d00 legacy=0x7fbf8c0b71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:52.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf9100c700 1 -- 172.21.15.63:0/2132864434 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c063440 con 0x7fbf8c0ba380 2020-05-18T21:32:52.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf9100c700 1 --2- 172.21.15.63:0/2132864434 >> v2:172.21.15.63:3300/0 conn(0x7fbf8c0ba380 0x7fbf8c0b7b10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf80000bc0 tx=0x7fbf80010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:52.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf9100c700 1 --2- 172.21.15.63:0/2132864434 >> v2:172.21.15.63:3300/0 conn(0x7fbf8c0ba380 0x7fbf8c0b7b10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf80000bc0 tx=0x7fbf80010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:52.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf9100c700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf8c0ba380 0x7fbf8c0b7b10 secure :-1 s=READY pgs=1240 cs=0 l=1 rx=0x7fbf80000bc0 tx=0x7fbf80010a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:52.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf9100c700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf8c0ba380 0x7fbf8c0b7b10 secure :-1 s=THROTTLE_DONE pgs=1240 cs=0 l=1 rx=0x7fbf80000bc0 tx=0x7fbf80010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:52.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf7effd700 1 -- 172.21.15.63:0/2132864434 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf8000c990 con 0x7fbf8c0ba380 2020-05-18T21:32:52.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf9100c700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf8c0ba380 0x7fbf8c0b7b10 secure :-1 s=THROTTLE_DONE pgs=1240 cs=0 l=1 rx=0x7fbf80000bc0 tx=0x7fbf80010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:52.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf9100c700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf8c0ba380 0x7fbf8c0b7b10 secure :-1 s=THROTTLE_DONE pgs=1240 cs=0 l=1 rx=0x7fbf80000bc0 tx=0x7fbf80010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:52.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf7effd700 1 -- 172.21.15.63:0/2132864434 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8000caf0 con 0x7fbf8c0ba380 2020-05-18T21:32:52.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf93a71700 1 -- 172.21.15.63:0/2132864434 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8c0b7f70 con 0x7fbf8c0ba380 2020-05-18T21:32:52.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf7effd700 1 -- 172.21.15.63:0/2132864434 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf8000ce90 con 0x7fbf8c0ba380 2020-05-18T21:32:52.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.021+0000 7fbf93a71700 1 -- 172.21.15.63:0/2132864434 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c064b70 con 0x7fbf8c0ba380 2020-05-18T21:32:52.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.025+0000 7fbf9100c700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf8c0ba380 0x7fbf8c0b7b10 secure :-1 s=THROTTLE_DONE pgs=1240 cs=0 l=1 rx=0x7fbf80000bc0 tx=0x7fbf80010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:52.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.025+0000 7fbf93a71700 1 -- 172.21.15.63:0/2132864434 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8c0569e0 con 0x7fbf8c0ba380 2020-05-18T21:32:52.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.025+0000 7fbf7effd700 1 -- 172.21.15.63:0/2132864434 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fbf80004530 con 0x7fbf8c0ba380 2020-05-18T21:32:52.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.025+0000 7fbf9100c700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf8c0ba380 0x7fbf8c0b7b10 secure :-1 s=THROTTLE_DONE pgs=1240 cs=0 l=1 rx=0x7fbf80000bc0 tx=0x7fbf80010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:52.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.025+0000 7fbf7effd700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf6c04f8b0 0x7fbf6c051d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:52.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.025+0000 7fbf7effd700 1 -- 172.21.15.63:0/2132864434 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fbf80063810 con 0x7fbf8c0ba380 2020-05-18T21:32:52.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.025+0000 7fbf9180d700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf6c04f8b0 0x7fbf6c051d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:52.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.025+0000 7fbf9180d700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf6c04f8b0 0x7fbf6c051d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf88002f70 tx=0x7fbf88007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:52.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.025+0000 7fbf9180d700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf6c04f8b0 0x7fbf6c051d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf88002f70 tx=0x7fbf88007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:52.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.025+0000 7fbf9180d700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf6c04f8b0 0x7fbf6c051d70 secure :-1 s=READY pgs=492 cs=0 l=1 rx=0x7fbf88002f70 tx=0x7fbf88007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:52.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.033+0000 7fbf9100c700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf8c0ba380 0x7fbf8c0b7b10 secure :-1 s=THROTTLE_DONE pgs=1240 cs=0 l=1 rx=0x7fbf80000bc0 tx=0x7fbf80010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:52.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.033+0000 7fbf7effd700 1 -- 172.21.15.63:0/2132864434 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fbf8003db40 con 0x7fbf8c0ba380 2020-05-18T21:32:52.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.149+0000 7fbf93a71700 1 -- 172.21.15.63:0/2132864434 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fbf8c0b37f0 con 0x7fbf8c0ba380 2020-05-18T21:32:52.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.897+0000 7fbf9100c700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf8c0ba380 0x7fbf8c0b7b10 secure :-1 s=THROTTLE_DONE pgs=1240 cs=0 l=1 rx=0x7fbf80000bc0 tx=0x7fbf80010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:52.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.897+0000 7fbf7effd700 1 -- 172.21.15.63:0/2132864434 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v92) v1 ==== 125+0+0 (secure 0 0 0) 0x7fbf80041160 con 0x7fbf8c0ba380 2020-05-18T21:32:52.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.901+0000 7fbf93a71700 1 -- 172.21.15.63:0/2132864434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf6c04f8b0 msgr2=0x7fbf6c051d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:52.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.901+0000 7fbf93a71700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf6c04f8b0 0x7fbf6c051d70 secure :-1 s=READY pgs=492 cs=0 l=1 rx=0x7fbf88002f70 tx=0x7fbf88007a80).stop 2020-05-18T21:32:52.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.901+0000 7fbf93a71700 1 -- 172.21.15.63:0/2132864434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf8c0ba380 msgr2=0x7fbf8c0b7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:52.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.901+0000 7fbf93a71700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf8c0ba380 0x7fbf8c0b7b10 secure :-1 s=READY pgs=1240 cs=0 l=1 rx=0x7fbf80000bc0 tx=0x7fbf80010a20).stop 2020-05-18T21:32:52.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.901+0000 7fbf93a71700 1 -- 172.21.15.63:0/2132864434 shutdown_connections 2020-05-18T21:32:52.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.901+0000 7fbf93a71700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf6c04f8b0 0x7fbf6c051d70 secure :-1 s=CLOSED pgs=492 cs=0 l=1 rx=0x7fbf88002f70 tx=0x7fbf88007a80).stop 2020-05-18T21:32:52.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.901+0000 7fbf93a71700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf8c0ba380 0x7fbf8c0b7b10 secure :-1 s=CLOSED pgs=1240 cs=0 l=1 rx=0x7fbf80000bc0 tx=0x7fbf80010a20).stop 2020-05-18T21:32:52.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.901+0000 7fbf93a71700 1 --2- 172.21.15.63:0/2132864434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf8c0b9fa0 0x7fbf8c0b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:52.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.901+0000 7fbf93a71700 1 -- 172.21.15.63:0/2132864434 >> 172.21.15.63:0/2132864434 conn(0x7fbf8c05b290 msgr2=0x7fbf8c09dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:52.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.905+0000 7fbf93a71700 1 -- 172.21.15.63:0/2132864434 shutdown_connections 2020-05-18T21:32:52.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:52.905+0000 7fbf93a71700 1 -- 172.21.15.63:0/2132864434 wait complete. 2020-05-18T21:32:52.910 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2020-05-18T21:32:52.920 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-05-18T21:32:53.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f353bfff700 1 Processor -- start 2020-05-18T21:32:53.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f353bfff700 1 -- start start 2020-05-18T21:32:53.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f353bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f353c143960 0x7f353c098eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:53.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f353bfff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353c05f790 con 0x7f353c1477e0 2020-05-18T21:32:53.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f353bfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353c099310 con 0x7f353c061a10 2020-05-18T21:32:53.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f353bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353c05f9c0 con 0x7f353c143960 2020-05-18T21:32:53.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f353affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f353c143960 0x7f353c098eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:53.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f353affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f353c143960 0x7f353c098eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59460/0 (socket says 172.21.15.63:59460) 2020-05-18T21:32:53.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f353b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f353c1477e0 0x7f353c147bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33420/0 (socket says 172.21.15.63:33420) 2020-05-18T21:32:53.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f353affd700 1 -- 172.21.15.63:0/2228754998 learned_addr learned my addr 172.21.15.63:0/2228754998 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:53.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f353affd700 1 -- 172.21.15.63:0/2228754998 >> v1:172.21.15.155:6789/0 conn(0x7f353c061a10 legacy=0x7f353c0b9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f353affd700 1 -- 172.21.15.63:0/2228754998 >> v1:172.21.15.63:6789/0 conn(0x7f353c1477e0 legacy=0x7f353c147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f3539ffb700 1 -- 172.21.15.63:0/2228754998 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503705684 0 0) 0x7f353c05f790 con 0x7f353c1477e0 2020-05-18T21:32:53.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f353affd700 1 -- 172.21.15.63:0/2228754998 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c05fc60 con 0x7f353c143960 2020-05-18T21:32:53.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f353affd700 1 --2- 172.21.15.63:0/2228754998 >> v2:172.21.15.63:3300/0 conn(0x7f353c143960 0x7f353c098eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f352c002f70 tx=0x7f352c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f353affd700 1 --2- 172.21.15.63:0/2228754998 >> v2:172.21.15.63:3300/0 conn(0x7f353c143960 0x7f353c098eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f352c002f70 tx=0x7f352c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f353affd700 1 --2- 172.21.15.63:0/2228754998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f353c143960 0x7f353c098eb0 secure :-1 s=READY pgs=1242 cs=0 l=1 rx=0x7f352c002f70 tx=0x7f352c007a80).ready entity=mon.0 client_cookie=c5e8ef51e7cf3d8d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:53.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f353affd700 1 --2- 172.21.15.63:0/2228754998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f353c143960 0x7f353c098eb0 secure :-1 s=THROTTLE_DONE pgs=1242 cs=0 l=1 rx=0x7f352c002f70 tx=0x7f352c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f3539ffb700 1 -- 172.21.15.63:0/2228754998 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f352c010800 con 0x7f353c143960 2020-05-18T21:32:53.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f353affd700 1 --2- 172.21.15.63:0/2228754998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f353c143960 0x7f353c098eb0 secure :-1 s=THROTTLE_DONE pgs=1242 cs=0 l=1 rx=0x7f352c002f70 tx=0x7f352c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f3539ffb700 1 -- 172.21.15.63:0/2228754998 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c010960 con 0x7f353c143960 2020-05-18T21:32:53.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.017+0000 7f353affd700 1 --2- 172.21.15.63:0/2228754998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f353c143960 0x7f353c098eb0 secure :-1 s=THROTTLE_DONE pgs=1242 cs=0 l=1 rx=0x7f352c002f70 tx=0x7f352c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.021+0000 7f3539ffb700 1 -- 172.21.15.63:0/2228754998 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f352c010d80 con 0x7f353c143960 2020-05-18T21:32:53.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.021+0000 7f353bfff700 1 -- 172.21.15.63:0/2228754998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f353c143960 msgr2=0x7f353c098eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.021+0000 7f353bfff700 1 --2- 172.21.15.63:0/2228754998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f353c143960 0x7f353c098eb0 secure :-1 s=READY pgs=1242 cs=0 l=1 rx=0x7f352c002f70 tx=0x7f352c007a80).stop 2020-05-18T21:32:53.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.021+0000 7f353bfff700 1 -- 172.21.15.63:0/2228754998 shutdown_connections 2020-05-18T21:32:53.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.021+0000 7f353bfff700 1 --2- 172.21.15.63:0/2228754998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f353c143960 0x7f353c098eb0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.021+0000 7f353bfff700 1 -- 172.21.15.63:0/2228754998 >> 172.21.15.63:0/2228754998 conn(0x7f353c06a640 msgr2=0x7f353c0b8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:53.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.021+0000 7f353bfff700 1 -- 172.21.15.63:0/2228754998 shutdown_connections 2020-05-18T21:32:53.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.021+0000 7f353bfff700 1 -- 172.21.15.63:0/2228754998 wait complete. 2020-05-18T21:32:53.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.021+0000 7f353bfff700 1 Processor -- start 2020-05-18T21:32:53.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.021+0000 7f353bfff700 1 -- start start 2020-05-18T21:32:53.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.021+0000 7f353bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f353c061a10 0x7f353c0afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:53.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.021+0000 7f353bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f353c143960 0x7f353c061e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:53.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.021+0000 7f353bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f353c1477e0 0x7f353c0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:53.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.021+0000 7f353bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353c0b0310 con 0x7f353c143960 2020-05-18T21:32:53.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.021+0000 7f353bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353c145d60 con 0x7f353c1477e0 2020-05-18T21:32:53.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.021+0000 7f353bfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353c146000 con 0x7f353c061a10 2020-05-18T21:32:53.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.021+0000 7f353a7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f353c143960 0x7f353c061e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:53.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.021+0000 7f353a7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f353c143960 0x7f353c061e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59468/0 (socket says 172.21.15.63:59468) 2020-05-18T21:32:53.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.021+0000 7f353a7fc700 1 -- 172.21.15.63:0/50467603 learned_addr learned my addr 172.21.15.63:0/50467603 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:53.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f353affd700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f353c061a10 0x7f353c0afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:53.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f353b7fe700 1 --2- 172.21.15.63:0/50467603 >> v2:172.21.15.155:3300/0 conn(0x7f353c1477e0 0x7f353c0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:53.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f353a7fc700 1 -- 172.21.15.63:0/50467603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f353c061a10 msgr2=0x7f353c0afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f353a7fc700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f353c061a10 0x7f353c0afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f353a7fc700 1 -- 172.21.15.63:0/50467603 >> v2:172.21.15.155:3300/0 conn(0x7f353c1477e0 msgr2=0x7f353c0622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f353a7fc700 1 --2- 172.21.15.63:0/50467603 >> v2:172.21.15.155:3300/0 conn(0x7f353c1477e0 0x7f353c0622e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f353a7fc700 1 -- 172.21.15.63:0/50467603 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c151860 con 0x7f353c143960 2020-05-18T21:32:53.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f353a7fc700 1 --2- 172.21.15.63:0/50467603 >> v2:172.21.15.63:3300/0 conn(0x7f353c143960 0x7f353c061e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f353c060d90 tx=0x7f353000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f353a7fc700 1 --2- 172.21.15.63:0/50467603 >> v2:172.21.15.63:3300/0 conn(0x7f353c143960 0x7f353c061e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f353c060d90 tx=0x7f353000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f353a7fc700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f353c143960 0x7f353c061e80 secure :-1 s=READY pgs=1243 cs=0 l=1 rx=0x7f353c060d90 tx=0x7f353000c4a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:53.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f353a7fc700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f353c143960 0x7f353c061e80 secure :-1 s=THROTTLE_DONE pgs=1243 cs=0 l=1 rx=0x7f353c060d90 tx=0x7f353000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f353a7fc700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f353c143960 0x7f353c061e80 secure :-1 s=THROTTLE_DONE pgs=1243 cs=0 l=1 rx=0x7f353c060d90 tx=0x7f353000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f352bfff700 1 -- 172.21.15.63:0/50467603 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f353000cc60 con 0x7f353c143960 2020-05-18T21:32:53.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f353a7fc700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f353c143960 0x7f353c061e80 secure :-1 s=THROTTLE_DONE pgs=1243 cs=0 l=1 rx=0x7f353c060d90 tx=0x7f353000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f352bfff700 1 -- 172.21.15.63:0/50467603 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353000cdc0 con 0x7f353c143960 2020-05-18T21:32:53.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f353bfff700 1 -- 172.21.15.63:0/50467603 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353c0b28a0 con 0x7f353c143960 2020-05-18T21:32:53.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f352bfff700 1 -- 172.21.15.63:0/50467603 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3530011100 con 0x7f353c143960 2020-05-18T21:32:53.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f353bfff700 1 -- 172.21.15.63:0/50467603 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353c151d00 con 0x7f353c143960 2020-05-18T21:32:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f353bfff700 1 -- 172.21.15.63:0/50467603 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f353c145bc0 con 0x7f353c143960 2020-05-18T21:32:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f353a7fc700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f353c143960 0x7f353c061e80 secure :-1 s=THROTTLE_DONE pgs=1243 cs=0 l=1 rx=0x7f353c060d90 tx=0x7f353000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f352bfff700 1 -- 172.21.15.63:0/50467603 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3530006520 con 0x7f353c143960 2020-05-18T21:32:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f353a7fc700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f353c143960 0x7f353c061e80 secure :-1 s=THROTTLE_DONE pgs=1243 cs=0 l=1 rx=0x7f353c060d90 tx=0x7f353000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f352bfff700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f351804f9e0 0x7f3518051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:53.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.025+0000 7f352bfff700 1 -- 172.21.15.63:0/50467603 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f3530063760 con 0x7f353c143960 2020-05-18T21:32:53.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.029+0000 7f353affd700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f351804f9e0 0x7f3518051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:53.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.029+0000 7f353affd700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f351804f9e0 0x7f3518051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f352c002f70 tx=0x7f352c010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.029+0000 7f353affd700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f351804f9e0 0x7f3518051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f352c002f70 tx=0x7f352c010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.029+0000 7f353affd700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f351804f9e0 0x7f3518051ea0 secure :-1 s=READY pgs=493 cs=0 l=1 rx=0x7f352c002f70 tx=0x7f352c010fa0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:53.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.033+0000 7f353a7fc700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f353c143960 0x7f353c061e80 secure :-1 s=THROTTLE_DONE pgs=1243 cs=0 l=1 rx=0x7f353c060d90 tx=0x7f353000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.033+0000 7f352bfff700 1 -- 172.21.15.63:0/50467603 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f353c145bc0 con 0x7f353c143960 2020-05-18T21:32:53.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.181+0000 7f353bfff700 1 -- 172.21.15.63:0/50467603 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f353c145bc0 con 0x7f353c143960 2020-05-18T21:32:53.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.189+0000 7f353a7fc700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f353c143960 0x7f353c061e80 secure :-1 s=THROTTLE_DONE pgs=1243 cs=0 l=1 rx=0x7f353c060d90 tx=0x7f353000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.193+0000 7f352bfff700 1 -- 172.21.15.63:0/50467603 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 17 and data pool 18 v73) v1 ==== 189+0+0 (secure 0 0 0) 0x7f353c145bc0 con 0x7f353c143960 2020-05-18T21:32:53.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.197+0000 7f353bfff700 1 -- 172.21.15.63:0/50467603 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f351804f9e0 msgr2=0x7f3518051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.197+0000 7f353bfff700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f351804f9e0 0x7f3518051ea0 secure :-1 s=READY pgs=493 cs=0 l=1 rx=0x7f352c002f70 tx=0x7f352c010fa0).stop 2020-05-18T21:32:53.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.197+0000 7f353bfff700 1 -- 172.21.15.63:0/50467603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f353c143960 msgr2=0x7f353c061e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.197+0000 7f353bfff700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f353c143960 0x7f353c061e80 secure :-1 s=READY pgs=1243 cs=0 l=1 rx=0x7f353c060d90 tx=0x7f353000c4a0).stop 2020-05-18T21:32:53.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.197+0000 7f353bfff700 1 -- 172.21.15.63:0/50467603 shutdown_connections 2020-05-18T21:32:53.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.197+0000 7f353bfff700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f351804f9e0 0x7f3518051ea0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.197+0000 7f353bfff700 1 --2- 172.21.15.63:0/50467603 >> v2:172.21.15.155:3300/0 conn(0x7f353c1477e0 0x7f353c0622e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.197+0000 7f353bfff700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f353c143960 0x7f353c061e80 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.197+0000 7f353bfff700 1 --2- 172.21.15.63:0/50467603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f353c061a10 0x7f353c0afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.197+0000 7f353bfff700 1 -- 172.21.15.63:0/50467603 >> 172.21.15.63:0/50467603 conn(0x7f353c06a640 msgr2=0x7f353c05f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:53.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.197+0000 7f353bfff700 1 -- 172.21.15.63:0/50467603 shutdown_connections 2020-05-18T21:32:53.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.197+0000 7f353bfff700 1 -- 172.21.15.63:0/50467603 wait complete. 2020-05-18T21:32:53.205 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 17 and data pool 18 2020-05-18T21:32:53.217 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:32:53.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.301+0000 7fa159e77700 1 Processor -- start 2020-05-18T21:32:53.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.301+0000 7fa159e77700 1 -- start start 2020-05-18T21:32:53.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.305+0000 7fa159e77700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa154145ad0 0x7fa1540b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:53.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.305+0000 7fa159e77700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1540b5e70 con 0x7fa1541456f0 2020-05-18T21:32:53.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.305+0000 7fa159e77700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa154061d90 con 0x7fa1540b2ec0 2020-05-18T21:32:53.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.305+0000 7fa159e77700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15413cfe0 con 0x7fa154145ad0 2020-05-18T21:32:53.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.305+0000 7fa1537fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa1541456f0 0x7fa154143c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33438/0 (socket says 172.21.15.63:33438) 2020-05-18T21:32:53.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.305+0000 7fa1537fe700 1 -- 172.21.15.63:0/3444419449 learned_addr learned my addr 172.21.15.63:0/3444419449 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:53.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.305+0000 7fa153fff700 1 --2- 172.21.15.63:0/3444419449 >> v2:172.21.15.155:3300/0 conn(0x7fa154145ad0 0x7fa1540b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:53.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.305+0000 7fa1527fc700 1 -- 172.21.15.63:0/3444419449 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208578352 0 0) 0x7fa1540b5e70 con 0x7fa1541456f0 2020-05-18T21:32:53.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.305+0000 7fa1527fc700 1 -- 172.21.15.63:0/3444419449 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa140003270 con 0x7fa1541456f0 2020-05-18T21:32:53.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.305+0000 7fa153fff700 1 -- 172.21.15.63:0/3444419449 >> v1:172.21.15.155:6789/0 conn(0x7fa1540b2ec0 legacy=0x7fa1540b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.305+0000 7fa153fff700 1 -- 172.21.15.63:0/3444419449 >> v1:172.21.15.63:6789/0 conn(0x7fa1541456f0 legacy=0x7fa154143c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.305+0000 7fa153fff700 1 -- 172.21.15.63:0/3444419449 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa154099e40 con 0x7fa154145ad0 2020-05-18T21:32:53.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.305+0000 7fa153fff700 1 --2- 172.21.15.63:0/3444419449 >> v2:172.21.15.155:3300/0 conn(0x7fa154145ad0 0x7fa1540b5a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa14c0032f0 tx=0x7fa14c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.305+0000 7fa153fff700 1 --2- 172.21.15.63:0/3444419449 >> v2:172.21.15.155:3300/0 conn(0x7fa154145ad0 0x7fa1540b5a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa14c0032f0 tx=0x7fa14c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.305+0000 7fa153fff700 1 --2- 172.21.15.63:0/3444419449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa154145ad0 0x7fa1540b5a10 secure :-1 s=READY pgs=865 cs=0 l=1 rx=0x7fa14c0032f0 tx=0x7fa14c007e00).ready entity=mon.1 client_cookie=79bd3275018439f0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:53.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa153fff700 1 --2- 172.21.15.63:0/3444419449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa154145ad0 0x7fa1540b5a10 secure :-1 s=THROTTLE_DONE pgs=865 cs=0 l=1 rx=0x7fa14c0032f0 tx=0x7fa14c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa1527fc700 1 -- 172.21.15.63:0/3444419449 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14c011e60 con 0x7fa154145ad0 2020-05-18T21:32:53.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa153fff700 1 --2- 172.21.15.63:0/3444419449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa154145ad0 0x7fa1540b5a10 secure :-1 s=THROTTLE_DONE pgs=865 cs=0 l=1 rx=0x7fa14c0032f0 tx=0x7fa14c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa153fff700 1 --2- 172.21.15.63:0/3444419449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa154145ad0 0x7fa1540b5a10 secure :-1 s=THROTTLE_DONE pgs=865 cs=0 l=1 rx=0x7fa14c0032f0 tx=0x7fa14c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa1527fc700 1 -- 172.21.15.63:0/3444419449 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c00a180 con 0x7fa154145ad0 2020-05-18T21:32:53.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa1527fc700 1 -- 172.21.15.63:0/3444419449 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14c00a4e0 con 0x7fa154145ad0 2020-05-18T21:32:53.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa159e77700 1 -- 172.21.15.63:0/3444419449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa154145ad0 msgr2=0x7fa1540b5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa159e77700 1 --2- 172.21.15.63:0/3444419449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa154145ad0 0x7fa1540b5a10 secure :-1 s=READY pgs=865 cs=0 l=1 rx=0x7fa14c0032f0 tx=0x7fa14c007e00).stop 2020-05-18T21:32:53.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa159e77700 1 -- 172.21.15.63:0/3444419449 shutdown_connections 2020-05-18T21:32:53.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa159e77700 1 --2- 172.21.15.63:0/3444419449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa154145ad0 0x7fa1540b5a10 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa159e77700 1 -- 172.21.15.63:0/3444419449 >> 172.21.15.63:0/3444419449 conn(0x7fa15405a7c0 msgr2=0x7fa15405aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:53.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa159e77700 1 -- 172.21.15.63:0/3444419449 shutdown_connections 2020-05-18T21:32:53.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa159e77700 1 -- 172.21.15.63:0/3444419449 wait complete. 2020-05-18T21:32:53.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa159e77700 1 Processor -- start 2020-05-18T21:32:53.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa159e77700 1 -- start start 2020-05-18T21:32:53.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa159e77700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa1540b2ec0 0x7fa1540b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:53.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa159e77700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa1541456f0 0x7fa154146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:53.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa159e77700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa154145ad0 0x7fa1540b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:53.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa159e77700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1541467b0 con 0x7fa1540b2ec0 2020-05-18T21:32:53.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa159e77700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15409d4b0 con 0x7fa1541456f0 2020-05-18T21:32:53.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa159e77700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15409d750 con 0x7fa154145ad0 2020-05-18T21:32:53.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa1537fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa1540b2ec0 0x7fa1540b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:53.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa1537fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa1540b2ec0 0x7fa1540b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59488/0 (socket says 172.21.15.63:59488) 2020-05-18T21:32:53.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa1537fe700 1 -- 172.21.15.63:0/3106976478 learned_addr learned my addr 172.21.15.63:0/3106976478 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:53.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa153fff700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa154145ad0 0x7fa1540b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:53.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.309+0000 7fa152ffd700 1 --2- 172.21.15.63:0/3106976478 >> v2:172.21.15.155:3300/0 conn(0x7fa1541456f0 0x7fa154146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:53.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa1537fe700 1 -- 172.21.15.63:0/3106976478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa154145ad0 msgr2=0x7fa1540b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa1537fe700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa154145ad0 0x7fa1540b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa1537fe700 1 -- 172.21.15.63:0/3106976478 >> v2:172.21.15.155:3300/0 conn(0x7fa1541456f0 msgr2=0x7fa154146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa1537fe700 1 --2- 172.21.15.63:0/3106976478 >> v2:172.21.15.155:3300/0 conn(0x7fa1541456f0 0x7fa154146350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa1537fe700 1 -- 172.21.15.63:0/3106976478 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1540b4100 con 0x7fa1540b2ec0 2020-05-18T21:32:53.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa1537fe700 1 --2- 172.21.15.63:0/3106976478 >> v2:172.21.15.63:3300/0 conn(0x7fa1540b2ec0 0x7fa1540b4930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa1540b4580 tx=0x7fa144010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa1537fe700 1 --2- 172.21.15.63:0/3106976478 >> v2:172.21.15.63:3300/0 conn(0x7fa1540b2ec0 0x7fa1540b4930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa1540b4580 tx=0x7fa144010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa1537fe700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1540b2ec0 0x7fa1540b4930 secure :-1 s=READY pgs=1245 cs=0 l=1 rx=0x7fa1540b4580 tx=0x7fa144010950).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:53.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa1537fe700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1540b2ec0 0x7fa1540b4930 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7fa1540b4580 tx=0x7fa144010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa150ff9700 1 -- 172.21.15.63:0/3106976478 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa144005d00 con 0x7fa1540b2ec0 2020-05-18T21:32:53.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa1537fe700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1540b2ec0 0x7fa1540b4930 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7fa1540b4580 tx=0x7fa144010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa1537fe700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1540b2ec0 0x7fa1540b4930 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7fa1540b4580 tx=0x7fa144010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa150ff9700 1 -- 172.21.15.63:0/3106976478 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa144005e60 con 0x7fa1540b2ec0 2020-05-18T21:32:53.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa159e77700 1 -- 172.21.15.63:0/3106976478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa154153150 con 0x7fa1540b2ec0 2020-05-18T21:32:53.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa150ff9700 1 -- 172.21.15.63:0/3106976478 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1440062c0 con 0x7fa1540b2ec0 2020-05-18T21:32:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa159e77700 1 -- 172.21.15.63:0/3106976478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1541535d0 con 0x7fa1540b2ec0 2020-05-18T21:32:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa1537fe700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1540b2ec0 0x7fa1540b4930 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7fa1540b4580 tx=0x7fa144010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa159e77700 1 -- 172.21.15.63:0/3106976478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1540569e0 con 0x7fa1540b2ec0 2020-05-18T21:32:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa150ff9700 1 -- 172.21.15.63:0/3106976478 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa144006500 con 0x7fa1540b2ec0 2020-05-18T21:32:53.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa1537fe700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1540b2ec0 0x7fa1540b4930 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7fa1540b4580 tx=0x7fa144010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa150ff9700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa13404fa10 0x7fa134051ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:53.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa150ff9700 1 -- 172.21.15.63:0/3106976478 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa1440090c0 con 0x7fa1540b2ec0 2020-05-18T21:32:53.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.313+0000 7fa152ffd700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa13404fa10 0x7fa134051ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:53.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.317+0000 7fa152ffd700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa13404fa10 0x7fa134051ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa15405b300 tx=0x7fa14800c860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.317+0000 7fa152ffd700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa13404fa10 0x7fa134051ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa15405b300 tx=0x7fa14800c860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.317+0000 7fa152ffd700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa13404fa10 0x7fa134051ed0 secure :-1 s=READY pgs=495 cs=0 l=1 rx=0x7fa15405b300 tx=0x7fa14800c860).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:53.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.321+0000 7fa1537fe700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1540b2ec0 0x7fa1540b4930 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7fa1540b4580 tx=0x7fa144010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.321+0000 7fa150ff9700 1 -- 172.21.15.63:0/3106976478 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa14403e080 con 0x7fa1540b2ec0 2020-05-18T21:32:53.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.441+0000 7fa159e77700 1 -- 172.21.15.63:0/3106976478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1540008d0 con 0x7fa1540b2ec0 2020-05-18T21:32:53.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.441+0000 7fa1537fe700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1540b2ec0 0x7fa1540b4930 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7fa1540b4580 tx=0x7fa144010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.441+0000 7fa150ff9700 1 -- 172.21.15.63:0/3106976478 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16105 (secure 0 0 0) 0x7fa1440416a0 con 0x7fa1540b2ec0 2020-05-18T21:32:53.447 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:53.447 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":94,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:32:53.188301+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:32:51.634300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2020-05-18T21:32:52.187431+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:32:53.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.445+0000 7fa159e77700 1 -- 172.21.15.63:0/3106976478 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa13404fa10 msgr2=0x7fa134051ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.445+0000 7fa159e77700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa13404fa10 0x7fa134051ed0 secure :-1 s=READY pgs=495 cs=0 l=1 rx=0x7fa15405b300 tx=0x7fa14800c860).stop 2020-05-18T21:32:53.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.445+0000 7fa159e77700 1 -- 172.21.15.63:0/3106976478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1540b2ec0 msgr2=0x7fa1540b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.445+0000 7fa159e77700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1540b2ec0 0x7fa1540b4930 secure :-1 s=READY pgs=1245 cs=0 l=1 rx=0x7fa1540b4580 tx=0x7fa144010950).stop 2020-05-18T21:32:53.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.445+0000 7fa159e77700 1 -- 172.21.15.63:0/3106976478 shutdown_connections 2020-05-18T21:32:53.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.445+0000 7fa159e77700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa13404fa10 0x7fa134051ed0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.445+0000 7fa159e77700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa154145ad0 0x7fa1540b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.445+0000 7fa159e77700 1 --2- 172.21.15.63:0/3106976478 >> v2:172.21.15.155:3300/0 conn(0x7fa1541456f0 0x7fa154146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.445+0000 7fa159e77700 1 --2- 172.21.15.63:0/3106976478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1540b2ec0 0x7fa1540b4930 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.445+0000 7fa159e77700 1 -- 172.21.15.63:0/3106976478 >> 172.21.15.63:0/3106976478 conn(0x7fa15405a7c0 msgr2=0x7fa1540b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:53.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.445+0000 7fa159e77700 1 -- 172.21.15.63:0/3106976478 shutdown_connections 2020-05-18T21:32:53.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.445+0000 7fa159e77700 1 -- 172.21.15.63:0/3106976478 wait complete. 2020-05-18T21:32:53.460 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:32:53.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.553+0000 7f80cc985700 1 Processor -- start 2020-05-18T21:32:53.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.553+0000 7f80cc985700 1 -- start start 2020-05-18T21:32:53.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.553+0000 7f80cc985700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f80c809e0d0 0x7f80c8069fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:53.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.553+0000 7f80cc985700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80c809e4b0 0x7f80c8147a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:53.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.553+0000 7f80cc985700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c806a5e0 con 0x7f80c813d720 2020-05-18T21:32:53.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.553+0000 7f80cc985700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c806a880 con 0x7f80c809e0d0 2020-05-18T21:32:53.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.553+0000 7f80cc985700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c8147ed0 con 0x7f80c809e4b0 2020-05-18T21:32:53.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c759e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f80c813d720 0x7f80c8143e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33454/0 (socket says 172.21.15.63:33454) 2020-05-18T21:32:53.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c759e700 1 -- 172.21.15.63:0/2463692259 learned_addr learned my addr 172.21.15.63:0/2463692259 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:53.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c659c700 1 --2- 172.21.15.63:0/2463692259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80c809e4b0 0x7f80c8147a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:53.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c6d9d700 1 --2- 172.21.15.63:0/2463692259 >> v2:172.21.15.155:3300/0 conn(0x7f80c809e0d0 0x7f80c8069fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:53.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c5d9b700 1 -- 172.21.15.63:0/2463692259 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942008749 0 0) 0x7f80c806a5e0 con 0x7f80c813d720 2020-05-18T21:32:53.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c5d9b700 1 -- 172.21.15.63:0/2463692259 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80ac003270 con 0x7f80c813d720 2020-05-18T21:32:53.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c659c700 1 -- 172.21.15.63:0/2463692259 >> v2:172.21.15.155:3300/0 conn(0x7f80c809e0d0 msgr2=0x7f80c8069fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:53.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c659c700 1 --2- 172.21.15.63:0/2463692259 >> v2:172.21.15.155:3300/0 conn(0x7f80c809e0d0 0x7f80c8069fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:53.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c659c700 1 -- 172.21.15.63:0/2463692259 >> v1:172.21.15.63:6789/0 conn(0x7f80c813d720 legacy=0x7f80c8143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c659c700 1 -- 172.21.15.63:0/2463692259 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c8148040 con 0x7f80c809e4b0 2020-05-18T21:32:53.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c6d9d700 1 --2- 172.21.15.63:0/2463692259 >> v2:172.21.15.155:3300/0 conn(0x7f80c809e0d0 0x7f80c8069fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:53.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c659c700 1 --2- 172.21.15.63:0/2463692259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80c809e4b0 0x7f80c8147a70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f80bc002f70 tx=0x7f80bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c659c700 1 --2- 172.21.15.63:0/2463692259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80c809e4b0 0x7f80c8147a70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f80bc002f70 tx=0x7f80bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c659c700 1 --2- 172.21.15.63:0/2463692259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80c809e4b0 0x7f80c8147a70 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f80bc002f70 tx=0x7f80bc007a80).ready entity=mon.2 client_cookie=eed45053ae7db9c0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:53.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c659c700 1 --2- 172.21.15.63:0/2463692259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80c809e4b0 0x7f80c8147a70 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f80bc002f70 tx=0x7f80bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c5d9b700 1 -- 172.21.15.63:0/2463692259 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80bc008e80 con 0x7f80c809e4b0 2020-05-18T21:32:53.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c659c700 1 --2- 172.21.15.63:0/2463692259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80c809e4b0 0x7f80c8147a70 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f80bc002f70 tx=0x7f80bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c659c700 1 --2- 172.21.15.63:0/2463692259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80c809e4b0 0x7f80c8147a70 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f80bc002f70 tx=0x7f80bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c5d9b700 1 -- 172.21.15.63:0/2463692259 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80bc011540 con 0x7f80c809e4b0 2020-05-18T21:32:53.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80c5d9b700 1 -- 172.21.15.63:0/2463692259 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80bc011960 con 0x7f80c809e4b0 2020-05-18T21:32:53.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80cc985700 1 -- 172.21.15.63:0/2463692259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80c809e4b0 msgr2=0x7f80c8147a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80cc985700 1 --2- 172.21.15.63:0/2463692259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80c809e4b0 0x7f80c8147a70 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f80bc002f70 tx=0x7f80bc007a80).stop 2020-05-18T21:32:53.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80cc985700 1 -- 172.21.15.63:0/2463692259 shutdown_connections 2020-05-18T21:32:53.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80cc985700 1 --2- 172.21.15.63:0/2463692259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80c809e4b0 0x7f80c8147a70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80cc985700 1 --2- 172.21.15.63:0/2463692259 >> v2:172.21.15.155:3300/0 conn(0x7f80c809e0d0 0x7f80c8069fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:53.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80cc985700 1 -- 172.21.15.63:0/2463692259 >> 172.21.15.63:0/2463692259 conn(0x7f80c805a7c0 msgr2=0x7f80c805aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:53.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80cc985700 1 -- 172.21.15.63:0/2463692259 shutdown_connections 2020-05-18T21:32:53.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.557+0000 7f80cc985700 1 -- 172.21.15.63:0/2463692259 wait complete. 2020-05-18T21:32:53.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.561+0000 7f80cc985700 1 Processor -- start 2020-05-18T21:32:53.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.561+0000 7f80cc985700 1 -- start start 2020-05-18T21:32:53.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.561+0000 7f80cc985700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f80c809e4b0 0x7f80c813e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:53.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.561+0000 7f80cc985700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80c813d720 0x7f80c8151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:53.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.561+0000 7f80cc985700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c81544e0 con 0x7f80c809e0d0 2020-05-18T21:32:53.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.561+0000 7f80cc985700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c8154710 con 0x7f80c809e4b0 2020-05-18T21:32:53.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.561+0000 7f80cc985700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c81549b0 con 0x7f80c813d720 2020-05-18T21:32:53.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.561+0000 7f80c6d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f80c809e0d0 0x7f80c813c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33458/0 (socket says 172.21.15.63:33458) 2020-05-18T21:32:53.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.561+0000 7f80c6d9d700 1 -- 172.21.15.63:0/1850845280 learned_addr learned my addr 172.21.15.63:0/1850845280 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:53.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80c659c700 1 --2- 172.21.15.63:0/1850845280 >> v2:172.21.15.155:3300/0 conn(0x7f80c809e4b0 0x7f80c813e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:53.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80c759e700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80c813d720 0x7f80c8151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:53.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80b7fff700 1 -- 172.21.15.63:0/1850845280 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316464781 0 0) 0x7f80c81544e0 con 0x7f80c809e0d0 2020-05-18T21:32:53.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80b7fff700 1 -- 172.21.15.63:0/1850845280 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80a4002fe0 con 0x7f80c809e0d0 2020-05-18T21:32:53.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80c659c700 1 -- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80c813d720 msgr2=0x7f80c8151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80c659c700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80c813d720 0x7f80c8151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80c659c700 1 -- 172.21.15.63:0/1850845280 >> v1:172.21.15.63:6789/0 conn(0x7f80c809e0d0 legacy=0x7f80c813c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80b7fff700 1 -- 172.21.15.63:0/1850845280 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2732781140 0 0) 0x7f80a4002fe0 con 0x7f80c809e0d0 2020-05-18T21:32:53.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80c659c700 1 -- 172.21.15.63:0/1850845280 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c8151d70 con 0x7f80c809e4b0 2020-05-18T21:32:53.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80c659c700 1 --2- 172.21.15.63:0/1850845280 >> v2:172.21.15.155:3300/0 conn(0x7f80c809e4b0 0x7f80c813e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f80b8002660 tx=0x7f80bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80c659c700 1 --2- 172.21.15.63:0/1850845280 >> v2:172.21.15.155:3300/0 conn(0x7f80c809e4b0 0x7f80c813e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f80b8002660 tx=0x7f80bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80c659c700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c809e4b0 0x7f80c813e9e0 secure :-1 s=READY pgs=866 cs=0 l=1 rx=0x7f80b8002660 tx=0x7f80bc007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:53.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80c659c700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c809e4b0 0x7f80c813e9e0 secure :-1 s=THROTTLE_DONE pgs=866 cs=0 l=1 rx=0x7f80b8002660 tx=0x7f80bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80b7fff700 1 -- 172.21.15.63:0/1850845280 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80b8002500 con 0x7f80c809e4b0 2020-05-18T21:32:53.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80c659c700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c809e4b0 0x7f80c813e9e0 secure :-1 s=THROTTLE_DONE pgs=866 cs=0 l=1 rx=0x7f80b8002660 tx=0x7f80bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80cc985700 1 -- 172.21.15.63:0/1850845280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c813d030 con 0x7f80c809e4b0 2020-05-18T21:32:53.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80c659c700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c809e4b0 0x7f80c813e9e0 secure :-1 s=THROTTLE_DONE pgs=866 cs=0 l=1 rx=0x7f80b8002660 tx=0x7f80bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80b7fff700 1 -- 172.21.15.63:0/1850845280 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80bc0100e0 con 0x7f80c809e4b0 2020-05-18T21:32:53.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80b7fff700 1 -- 172.21.15.63:0/1850845280 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80bc00f860 con 0x7f80c809e4b0 2020-05-18T21:32:53.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80cc985700 1 -- 172.21.15.63:0/1850845280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c8150a30 con 0x7f80c809e4b0 2020-05-18T21:32:53.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80c659c700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c809e4b0 0x7f80c813e9e0 secure :-1 s=THROTTLE_DONE pgs=866 cs=0 l=1 rx=0x7f80b8002660 tx=0x7f80bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80cc985700 1 -- 172.21.15.63:0/1850845280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c80569e0 con 0x7f80c809e4b0 2020-05-18T21:32:53.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80b7fff700 1 -- 172.21.15.63:0/1850845280 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f80bc0080e0 con 0x7f80c809e4b0 2020-05-18T21:32:53.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80c659c700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c809e4b0 0x7f80c813e9e0 secure :-1 s=THROTTLE_DONE pgs=866 cs=0 l=1 rx=0x7f80b8002660 tx=0x7f80bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80b7fff700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f80a404fcc0 0x7f80a4052180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:53.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.565+0000 7f80b7fff700 1 -- 172.21.15.63:0/1850845280 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f80bc063db0 con 0x7f80c809e4b0 2020-05-18T21:32:53.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.569+0000 7f80c6d9d700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f80a404fcc0 0x7f80a4052180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:53.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.569+0000 7f80c6d9d700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f80a404fcc0 0x7f80a4052180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f80b80030b0 tx=0x7f80b8002830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.569+0000 7f80c6d9d700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f80a404fcc0 0x7f80a4052180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f80b80030b0 tx=0x7f80b8002830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.569+0000 7f80c6d9d700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f80a404fcc0 0x7f80a4052180 secure :-1 s=READY pgs=496 cs=0 l=1 rx=0x7f80b80030b0 tx=0x7f80b8002830).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:53.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.577+0000 7f80c659c700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c809e4b0 0x7f80c813e9e0 secure :-1 s=THROTTLE_DONE pgs=866 cs=0 l=1 rx=0x7f80b8002660 tx=0x7f80bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.577+0000 7f80b7fff700 1 -- 172.21.15.63:0/1850845280 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f80bc03e260 con 0x7f80c809e4b0 2020-05-18T21:32:53.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.693+0000 7f80cc985700 1 -- 172.21.15.63:0/1850845280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80c805c840 con 0x7f80c809e4b0 2020-05-18T21:32:53.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.693+0000 7f80c659c700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c809e4b0 0x7f80c813e9e0 secure :-1 s=THROTTLE_DONE pgs=866 cs=0 l=1 rx=0x7f80b8002660 tx=0x7f80bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.693+0000 7f80b7fff700 1 -- 172.21.15.63:0/1850845280 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16105 (secure 0 0 0) 0x7f80bc041880 con 0x7f80c809e4b0 2020-05-18T21:32:53.699 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:53.700 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":94,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:32:53.188301+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:32:51.634300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2020-05-18T21:32:52.187431+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:32:53.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.697+0000 7f80cc985700 1 -- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f80a404fcc0 msgr2=0x7f80a4052180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.697+0000 7f80cc985700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f80a404fcc0 0x7f80a4052180 secure :-1 s=READY pgs=496 cs=0 l=1 rx=0x7f80b80030b0 tx=0x7f80b8002830).stop 2020-05-18T21:32:53.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.697+0000 7f80cc985700 1 -- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c809e4b0 msgr2=0x7f80c813e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.697+0000 7f80cc985700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c809e4b0 0x7f80c813e9e0 secure :-1 s=READY pgs=866 cs=0 l=1 rx=0x7f80b8002660 tx=0x7f80bc007a80).stop 2020-05-18T21:32:53.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.697+0000 7f80cc985700 1 -- 172.21.15.63:0/1850845280 shutdown_connections 2020-05-18T21:32:53.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.697+0000 7f80cc985700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f80a404fcc0 0x7f80a4052180 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.697+0000 7f80cc985700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80c813d720 0x7f80c8151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.697+0000 7f80cc985700 1 --2- 172.21.15.63:0/1850845280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c809e4b0 0x7f80c813e9e0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.697+0000 7f80cc985700 1 -- 172.21.15.63:0/1850845280 >> 172.21.15.63:0/1850845280 conn(0x7f80c805a7c0 msgr2=0x7f80c813bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:53.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.697+0000 7f80cc985700 1 -- 172.21.15.63:0/1850845280 shutdown_connections 2020-05-18T21:32:53.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.697+0000 7f80cc985700 1 -- 172.21.15.63:0/1850845280 wait complete. 2020-05-18T21:32:53.712 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-05-18T21:32:53.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.809+0000 7f757710f700 1 Processor -- start 2020-05-18T21:32:53.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.809+0000 7f757710f700 1 -- start start 2020-05-18T21:32:53.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f757710f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700b7bf0 0x7f7570145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:53.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f757710f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7570143810 con 0x7f7570143430 2020-05-18T21:32:53.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f757710f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75700b7210 con 0x7f75700b6d70 2020-05-18T21:32:53.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f757710f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75700b74b0 con 0x7f75700b7bf0 2020-05-18T21:32:53.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f7574eab700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7570143430 0x7f75700b9160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33466/0 (socket says 172.21.15.63:33466) 2020-05-18T21:32:53.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f7574eab700 1 -- 172.21.15.63:0/1992751781 learned_addr learned my addr 172.21.15.63:0/1992751781 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:53.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f75756ac700 1 --2- 172.21.15.63:0/1992751781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700b7bf0 0x7f7570145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:53.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f756f7fe700 1 -- 172.21.15.63:0/1992751781 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018930209 0 0) 0x7f7570143810 con 0x7f7570143430 2020-05-18T21:32:53.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f756f7fe700 1 -- 172.21.15.63:0/1992751781 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7550003270 con 0x7f7570143430 2020-05-18T21:32:53.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f756f7fe700 1 -- 172.21.15.63:0/1992751781 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1292906369 0 0) 0x7f75700b7210 con 0x7f75700b6d70 2020-05-18T21:32:53.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f756f7fe700 1 -- 172.21.15.63:0/1992751781 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7570143810 con 0x7f75700b6d70 2020-05-18T21:32:53.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f75756ac700 1 -- 172.21.15.63:0/1992751781 >> v1:172.21.15.155:6789/0 conn(0x7f75700b6d70 legacy=0x7f75700b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f75756ac700 1 -- 172.21.15.63:0/1992751781 >> v1:172.21.15.63:6789/0 conn(0x7f7570143430 legacy=0x7f75700b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f75756ac700 1 -- 172.21.15.63:0/1992751781 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75700b7750 con 0x7f75700b7bf0 2020-05-18T21:32:53.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f75756ac700 1 --2- 172.21.15.63:0/1992751781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700b7bf0 0x7f7570145dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7568002f70 tx=0x7f7568008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f75756ac700 1 --2- 172.21.15.63:0/1992751781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700b7bf0 0x7f7570145dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7568002f70 tx=0x7f7568008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f75756ac700 1 --2- 172.21.15.63:0/1992751781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700b7bf0 0x7f7570145dd0 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7f7568002f70 tx=0x7f7568008920).ready entity=mon.2 client_cookie=276ed75d9e3fc546 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:53.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f75756ac700 1 --2- 172.21.15.63:0/1992751781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700b7bf0 0x7f7570145dd0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f7568002f70 tx=0x7f7568008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f756f7fe700 1 -- 172.21.15.63:0/1992751781 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7568008e80 con 0x7f75700b7bf0 2020-05-18T21:32:53.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f75756ac700 1 --2- 172.21.15.63:0/1992751781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700b7bf0 0x7f7570145dd0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f7568002f70 tx=0x7f7568008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f75756ac700 1 --2- 172.21.15.63:0/1992751781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700b7bf0 0x7f7570145dd0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f7568002f70 tx=0x7f7568008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f756f7fe700 1 -- 172.21.15.63:0/1992751781 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7568011580 con 0x7f75700b7bf0 2020-05-18T21:32:53.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f756f7fe700 1 -- 172.21.15.63:0/1992751781 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7568011960 con 0x7f75700b7bf0 2020-05-18T21:32:53.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f757710f700 1 -- 172.21.15.63:0/1992751781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700b7bf0 msgr2=0x7f7570145dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f757710f700 1 --2- 172.21.15.63:0/1992751781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700b7bf0 0x7f7570145dd0 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7f7568002f70 tx=0x7f7568008920).stop 2020-05-18T21:32:53.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f757710f700 1 -- 172.21.15.63:0/1992751781 shutdown_connections 2020-05-18T21:32:53.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f757710f700 1 --2- 172.21.15.63:0/1992751781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700b7bf0 0x7f7570145dd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f757710f700 1 -- 172.21.15.63:0/1992751781 >> 172.21.15.63:0/1992751781 conn(0x7f7570069b70 msgr2=0x7f7570069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:53.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f757710f700 1 -- 172.21.15.63:0/1992751781 shutdown_connections 2020-05-18T21:32:53.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.813+0000 7f757710f700 1 -- 172.21.15.63:0/1992751781 wait complete. 2020-05-18T21:32:53.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f757710f700 1 Processor -- start 2020-05-18T21:32:53.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f757710f700 1 -- start start 2020-05-18T21:32:53.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f757710f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f75700b7bf0 0x7f757013e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:53.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f757710f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7570143430 0x7f757013f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:53.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f757710f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75701474a0 con 0x7f75700b6d70 2020-05-18T21:32:53.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f757710f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7570147280 con 0x7f75700b7bf0 2020-05-18T21:32:53.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f757710f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7570147740 con 0x7f7570143430 2020-05-18T21:32:53.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f7574eab700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f75700b6d70 0x7f757013df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33472/0 (socket says 172.21.15.63:33472) 2020-05-18T21:32:53.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f756ffff700 1 --2- 172.21.15.63:0/1035472350 >> v2:172.21.15.63:3300/0 conn(0x7f75700b7bf0 0x7f757013e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:53.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f7574eab700 1 -- 172.21.15.63:0/1035472350 learned_addr learned my addr 172.21.15.63:0/1035472350 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:53.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f75756ac700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7570143430 0x7f757013f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:53.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f756ffff700 1 -- 172.21.15.63:0/1035472350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7570143430 msgr2=0x7f757013f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f756ffff700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7570143430 0x7f757013f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:53.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f756ffff700 1 -- 172.21.15.63:0/1035472350 >> v1:172.21.15.63:6789/0 conn(0x7f75700b6d70 legacy=0x7f757013df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:53.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f756ffff700 1 -- 172.21.15.63:0/1035472350 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75701479e0 con 0x7f75700b7bf0 2020-05-18T21:32:53.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f756ffff700 1 --2- 172.21.15.63:0/1035472350 >> v2:172.21.15.63:3300/0 conn(0x7f75700b7bf0 0x7f757013e680 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7570149ce0 tx=0x7f757005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f756ffff700 1 --2- 172.21.15.63:0/1035472350 >> v2:172.21.15.63:3300/0 conn(0x7f75700b7bf0 0x7f757013e680 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7570149ce0 tx=0x7f757005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f756ffff700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75700b7bf0 0x7f757013e680 secure :-1 s=READY pgs=1250 cs=0 l=1 rx=0x7f7570149ce0 tx=0x7f757005ab60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:53.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f756ffff700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75700b7bf0 0x7f757013e680 secure :-1 s=THROTTLE_DONE pgs=1250 cs=0 l=1 rx=0x7f7570149ce0 tx=0x7f757005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f756dffb700 1 -- 172.21.15.63:0/1035472350 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f755800ccb0 con 0x7f75700b7bf0 2020-05-18T21:32:53.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f756ffff700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75700b7bf0 0x7f757013e680 secure :-1 s=THROTTLE_DONE pgs=1250 cs=0 l=1 rx=0x7f7570149ce0 tx=0x7f757005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f756dffb700 1 -- 172.21.15.63:0/1035472350 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755800ce10 con 0x7f75700b7bf0 2020-05-18T21:32:53.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f756ffff700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75700b7bf0 0x7f757013e680 secure :-1 s=THROTTLE_DONE pgs=1250 cs=0 l=1 rx=0x7f7570149ce0 tx=0x7f757005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f757710f700 1 -- 172.21.15.63:0/1035472350 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757013f690 con 0x7f75700b7bf0 2020-05-18T21:32:53.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f756dffb700 1 -- 172.21.15.63:0/1035472350 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f755800e370 con 0x7f75700b7bf0 2020-05-18T21:32:53.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.817+0000 7f757710f700 1 -- 172.21.15.63:0/1035472350 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7570149dd0 con 0x7f75700b7bf0 2020-05-18T21:32:53.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.821+0000 7f756ffff700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75700b7bf0 0x7f757013e680 secure :-1 s=THROTTLE_DONE pgs=1250 cs=0 l=1 rx=0x7f7570149ce0 tx=0x7f757005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.821+0000 7f757710f700 1 -- 172.21.15.63:0/1035472350 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75700569e0 con 0x7f75700b7bf0 2020-05-18T21:32:53.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.821+0000 7f756dffb700 1 -- 172.21.15.63:0/1035472350 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7558010350 con 0x7f75700b7bf0 2020-05-18T21:32:53.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.821+0000 7f756ffff700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75700b7bf0 0x7f757013e680 secure :-1 s=THROTTLE_DONE pgs=1250 cs=0 l=1 rx=0x7f7570149ce0 tx=0x7f757005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.821+0000 7f756dffb700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f755404fa20 0x7f7554051ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:53.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.821+0000 7f756dffb700 1 -- 172.21.15.63:0/1035472350 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7558063a10 con 0x7f75700b7bf0 2020-05-18T21:32:53.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.821+0000 7f7574eab700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f755404fa20 0x7f7554051ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:53.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.821+0000 7f7574eab700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f755404fa20 0x7f7554051ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f757013ee30 tx=0x7f75600020d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.821+0000 7f7574eab700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f755404fa20 0x7f7554051ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f757013ee30 tx=0x7f75600020d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.821+0000 7f7574eab700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f755404fa20 0x7f7554051ee0 secure :-1 s=READY pgs=497 cs=0 l=1 rx=0x7f757013ee30 tx=0x7f75600020d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:53.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.829+0000 7f756ffff700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75700b7bf0 0x7f757013e680 secure :-1 s=THROTTLE_DONE pgs=1250 cs=0 l=1 rx=0x7f7570149ce0 tx=0x7f757005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:53.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.829+0000 7f756dffb700 1 -- 172.21.15.63:0/1035472350 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f755803dd40 con 0x7f75700b7bf0 2020-05-18T21:32:53.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:53.977+0000 7f757710f700 1 -- 172.21.15.63:0/1035472350 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f75700b3660 con 0x7f75700b7bf0 2020-05-18T21:32:54.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:54.821+0000 7f756ffff700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75700b7bf0 0x7f757013e680 secure :-1 s=READY pgs=1250 cs=0 l=1 rx=0x7f7570149ce0 tx=0x7f757005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:54.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:54.921+0000 7f756ffff700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75700b7bf0 0x7f757013e680 secure :-1 s=THROTTLE_DONE pgs=1250 cs=0 l=1 rx=0x7f7570149ce0 tx=0x7f757005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:54.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:54.921+0000 7f756dffb700 1 -- 172.21.15.63:0/1035472350 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v75) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7558041360 con 0x7f75700b7bf0 2020-05-18T21:32:54.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:54.921+0000 7f757710f700 1 -- 172.21.15.63:0/1035472350 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f755404fa20 msgr2=0x7f7554051ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:54.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:54.921+0000 7f757710f700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f755404fa20 0x7f7554051ee0 secure :-1 s=READY pgs=497 cs=0 l=1 rx=0x7f757013ee30 tx=0x7f75600020d0).stop 2020-05-18T21:32:54.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:54.921+0000 7f757710f700 1 -- 172.21.15.63:0/1035472350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75700b7bf0 msgr2=0x7f757013e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:54.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:54.921+0000 7f757710f700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75700b7bf0 0x7f757013e680 secure :-1 s=READY pgs=1250 cs=0 l=1 rx=0x7f7570149ce0 tx=0x7f757005ab60).stop 2020-05-18T21:32:54.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:54.925+0000 7f757710f700 1 -- 172.21.15.63:0/1035472350 shutdown_connections 2020-05-18T21:32:54.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:54.925+0000 7f757710f700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f755404fa20 0x7f7554051ee0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:54.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:54.925+0000 7f757710f700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7570143430 0x7f757013f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:54.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:54.925+0000 7f757710f700 1 --2- 172.21.15.63:0/1035472350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75700b7bf0 0x7f757013e680 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:54.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:54.925+0000 7f757710f700 1 -- 172.21.15.63:0/1035472350 >> 172.21.15.63:0/1035472350 conn(0x7f7570069b70 msgr2=0x7f7570060c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:54.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:54.925+0000 7f757710f700 1 -- 172.21.15.63:0/1035472350 shutdown_connections 2020-05-18T21:32:54.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:54.925+0000 7f757710f700 1 -- 172.21.15.63:0/1035472350 wait complete. 2020-05-18T21:32:54.944 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:55.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfc0802700 1 Processor -- start 2020-05-18T21:32:55.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfc0802700 1 -- start start 2020-05-18T21:32:55.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfc0802700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdfbc060b90 0x7fdfbc0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:55.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfc0802700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfbc0b2860 0x7fdfbc14e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:55.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfc0802700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdfbc144090 0x7fdfbc1444e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:55.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfc0802700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfbc144940 con 0x7fdfbc144090 2020-05-18T21:32:55.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfc0802700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfbc066210 con 0x7fdfbc060b90 2020-05-18T21:32:55.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfc0802700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc14d960 con 0x7fdfbc0b2860 2020-05-18T21:32:55.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfbad9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdfbc144090 0x7fdfbc1444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:55.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfbad9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdfbc144090 0x7fdfbc1444e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59524/0 (socket says 172.21.15.63:59524) 2020-05-18T21:32:55.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfbad9d700 1 -- 172.21.15.63:0/1312105086 learned_addr learned my addr 172.21.15.63:0/1312105086 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:55.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfba59c700 1 --2- 172.21.15.63:0/1312105086 >> v2:172.21.15.155:3300/0 conn(0x7fdfbc060b90 0x7fdfbc0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:55.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfb9d9b700 1 --2- 172.21.15.63:0/1312105086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfbc0b2860 0x7fdfbc14e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:55.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfbad9d700 1 -- 172.21.15.63:0/1312105086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfbc0b2860 msgr2=0x7fdfbc14e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:55.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfbad9d700 1 --2- 172.21.15.63:0/1312105086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfbc0b2860 0x7fdfbc14e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:55.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfbad9d700 1 -- 172.21.15.63:0/1312105086 >> v2:172.21.15.155:3300/0 conn(0x7fdfbc060b90 msgr2=0x7fdfbc0615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:55.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfbad9d700 1 --2- 172.21.15.63:0/1312105086 >> v2:172.21.15.155:3300/0 conn(0x7fdfbc060b90 0x7fdfbc0615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:55.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfbad9d700 1 -- 172.21.15.63:0/1312105086 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc14db90 con 0x7fdfbc144090 2020-05-18T21:32:55.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfbad9d700 1 --2- 172.21.15.63:0/1312105086 >> v2:172.21.15.63:3300/0 conn(0x7fdfbc144090 0x7fdfbc1444e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdfbc0b92c0 tx=0x7fdfb4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfbad9d700 1 --2- 172.21.15.63:0/1312105086 >> v2:172.21.15.63:3300/0 conn(0x7fdfbc144090 0x7fdfbc1444e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdfbc0b92c0 tx=0x7fdfb4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfbad9d700 1 --2- 172.21.15.63:0/1312105086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc144090 0x7fdfbc1444e0 secure :-1 s=READY pgs=1251 cs=0 l=1 rx=0x7fdfbc0b92c0 tx=0x7fdfb4008920).ready entity=mon.0 client_cookie=cd3fc2fbf538b3de server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:55.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfbad9d700 1 --2- 172.21.15.63:0/1312105086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc144090 0x7fdfbc1444e0 secure :-1 s=THROTTLE_DONE pgs=1251 cs=0 l=1 rx=0x7fdfbc0b92c0 tx=0x7fdfb4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfbad9d700 1 --2- 172.21.15.63:0/1312105086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc144090 0x7fdfbc1444e0 secure :-1 s=THROTTLE_DONE pgs=1251 cs=0 l=1 rx=0x7fdfbc0b92c0 tx=0x7fdfb4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfbad9d700 1 --2- 172.21.15.63:0/1312105086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc144090 0x7fdfbc1444e0 secure :-1 s=THROTTLE_DONE pgs=1251 cs=0 l=1 rx=0x7fdfbc0b92c0 tx=0x7fdfb4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfb959a700 1 -- 172.21.15.63:0/1312105086 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb40115c0 con 0x7fdfbc144090 2020-05-18T21:32:55.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfb959a700 1 -- 172.21.15.63:0/1312105086 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb4011720 con 0x7fdfbc144090 2020-05-18T21:32:55.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfb959a700 1 -- 172.21.15.63:0/1312105086 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb4011b40 con 0x7fdfbc144090 2020-05-18T21:32:55.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfc0802700 1 -- 172.21.15.63:0/1312105086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc144090 msgr2=0x7fdfbc1444e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.049+0000 7fdfc0802700 1 --2- 172.21.15.63:0/1312105086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc144090 0x7fdfbc1444e0 secure :-1 s=READY pgs=1251 cs=0 l=1 rx=0x7fdfbc0b92c0 tx=0x7fdfb4008920).stop 2020-05-18T21:32:55.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfc0802700 1 -- 172.21.15.63:0/1312105086 shutdown_connections 2020-05-18T21:32:55.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfc0802700 1 --2- 172.21.15.63:0/1312105086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc144090 0x7fdfbc1444e0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:55.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfc0802700 1 --2- 172.21.15.63:0/1312105086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfbc0b2860 0x7fdfbc14e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:55.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfc0802700 1 --2- 172.21.15.63:0/1312105086 >> v2:172.21.15.155:3300/0 conn(0x7fdfbc060b90 0x7fdfbc0615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:55.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfc0802700 1 -- 172.21.15.63:0/1312105086 >> 172.21.15.63:0/1312105086 conn(0x7fdfbc0b83d0 msgr2=0x7fdfbc0b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:55.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfc0802700 1 -- 172.21.15.63:0/1312105086 shutdown_connections 2020-05-18T21:32:55.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfc0802700 1 -- 172.21.15.63:0/1312105086 wait complete. 2020-05-18T21:32:55.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfc0802700 1 Processor -- start 2020-05-18T21:32:55.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfc0802700 1 -- start start 2020-05-18T21:32:55.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfc0802700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfbc060b90 0x7fdfbc15aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:55.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfc0802700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdfbc144090 0x7fdfbc156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:55.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfc0802700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfbc15b350 con 0x7fdfbc0b2860 2020-05-18T21:32:55.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfc0802700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfbc149580 con 0x7fdfbc144090 2020-05-18T21:32:55.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfc0802700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc149820 con 0x7fdfbc060b90 2020-05-18T21:32:55.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfbad9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdfbc144090 0x7fdfbc156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:55.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfbad9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdfbc144090 0x7fdfbc156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59532/0 (socket says 172.21.15.63:59532) 2020-05-18T21:32:55.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfb9d9b700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fdfbc0b2860 0x7fdfbc147040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:60032/0 (socket says 172.21.15.63:60032) 2020-05-18T21:32:55.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfbad9d700 1 -- 172.21.15.63:0/1036687373 learned_addr learned my addr 172.21.15.63:0/1036687373 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:55.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfba59c700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfbc060b90 0x7fdfbc15aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:55.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.053+0000 7fdfb37fe700 1 -- 172.21.15.63:0/1036687373 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827576547 0 0) 0x7fdfbc15b350 con 0x7fdfbc0b2860 2020-05-18T21:32:55.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfb37fe700 1 -- 172.21.15.63:0/1036687373 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfa0002fe0 con 0x7fdfbc0b2860 2020-05-18T21:32:55.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfbad9d700 1 -- 172.21.15.63:0/1036687373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfbc060b90 msgr2=0x7fdfbc15aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfbad9d700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfbc060b90 0x7fdfbc15aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:55.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfbad9d700 1 -- 172.21.15.63:0/1036687373 >> v1:172.21.15.155:6789/0 conn(0x7fdfbc0b2860 legacy=0x7fdfbc147040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfbad9d700 1 -- 172.21.15.63:0/1036687373 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc15b610 con 0x7fdfbc144090 2020-05-18T21:32:55.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfba59c700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfbc060b90 0x7fdfbc15aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:55.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfbad9d700 1 --2- 172.21.15.63:0/1036687373 >> v2:172.21.15.63:3300/0 conn(0x7fdfbc144090 0x7fdfbc156ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdfbc0b92c0 tx=0x7fdfbc05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfbad9d700 1 --2- 172.21.15.63:0/1036687373 >> v2:172.21.15.63:3300/0 conn(0x7fdfbc144090 0x7fdfbc156ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdfbc0b92c0 tx=0x7fdfbc05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfbad9d700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc144090 0x7fdfbc156ad0 secure :-1 s=READY pgs=1252 cs=0 l=1 rx=0x7fdfbc0b92c0 tx=0x7fdfbc05fa60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:55.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfbad9d700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc144090 0x7fdfbc156ad0 secure :-1 s=THROTTLE_DONE pgs=1252 cs=0 l=1 rx=0x7fdfbc0b92c0 tx=0x7fdfbc05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfb37fe700 1 -- 172.21.15.63:0/1036687373 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb40086d0 con 0x7fdfbc144090 2020-05-18T21:32:55.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfbad9d700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc144090 0x7fdfbc156ad0 secure :-1 s=THROTTLE_DONE pgs=1252 cs=0 l=1 rx=0x7fdfbc0b92c0 tx=0x7fdfbc05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfbad9d700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc144090 0x7fdfbc156ad0 secure :-1 s=THROTTLE_DONE pgs=1252 cs=0 l=1 rx=0x7fdfbc0b92c0 tx=0x7fdfbc05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfb37fe700 1 -- 172.21.15.63:0/1036687373 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb4011b80 con 0x7fdfbc144090 2020-05-18T21:32:55.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfc0802700 1 -- 172.21.15.63:0/1036687373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfbc15b880 con 0x7fdfbc144090 2020-05-18T21:32:55.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfb37fe700 1 -- 172.21.15.63:0/1036687373 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb4005ae0 con 0x7fdfbc144090 2020-05-18T21:32:55.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfc0802700 1 -- 172.21.15.63:0/1036687373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfbc1570d0 con 0x7fdfbc144090 2020-05-18T21:32:55.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfc0802700 1 -- 172.21.15.63:0/1036687373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfbc0569e0 con 0x7fdfbc144090 2020-05-18T21:32:55.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfbad9d700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc144090 0x7fdfbc156ad0 secure :-1 s=THROTTLE_DONE pgs=1252 cs=0 l=1 rx=0x7fdfbc0b92c0 tx=0x7fdfbc05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfb37fe700 1 -- 172.21.15.63:0/1036687373 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fdfb4005d20 con 0x7fdfbc144090 2020-05-18T21:32:55.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfbad9d700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc144090 0x7fdfbc156ad0 secure :-1 s=THROTTLE_DONE pgs=1252 cs=0 l=1 rx=0x7fdfbc0b92c0 tx=0x7fdfbc05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfb37fe700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdfa004fd80 0x7fdfa0052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:55.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.057+0000 7fdfb37fe700 1 -- 172.21.15.63:0/1036687373 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdfb40643b0 con 0x7fdfbc144090 2020-05-18T21:32:55.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.061+0000 7fdfba59c700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdfa004fd80 0x7fdfa0052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:55.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.061+0000 7fdfba59c700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdfa004fd80 0x7fdfa0052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdfa40032f0 tx=0x7fdfa400c120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.061+0000 7fdfba59c700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdfa004fd80 0x7fdfa0052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdfa40032f0 tx=0x7fdfa400c120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.061+0000 7fdfba59c700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdfa004fd80 0x7fdfa0052240 secure :-1 s=READY pgs=498 cs=0 l=1 rx=0x7fdfa40032f0 tx=0x7fdfa400c120).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:55.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.065+0000 7fdfbad9d700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc144090 0x7fdfbc156ad0 secure :-1 s=THROTTLE_DONE pgs=1252 cs=0 l=1 rx=0x7fdfbc0b92c0 tx=0x7fdfbc05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.065+0000 7fdfb37fe700 1 -- 172.21.15.63:0/1036687373 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fdfb403e860 con 0x7fdfbc144090 2020-05-18T21:32:55.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.209+0000 7fdfc0802700 1 -- 172.21.15.63:0/1036687373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfbc149c30 con 0x7fdfbc144090 2020-05-18T21:32:55.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.209+0000 7fdfbad9d700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc144090 0x7fdfbc156ad0 secure :-1 s=THROTTLE_DONE pgs=1252 cs=0 l=1 rx=0x7fdfbc0b92c0 tx=0x7fdfbc05fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.209+0000 7fdfb37fe700 1 -- 172.21.15.63:0/1036687373 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fdfb4041e80 con 0x7fdfbc144090 2020-05-18T21:32:55.215 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:55.215 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":75,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2619292063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2619292063},{"type":"v1","addr":"172.21.15.155:6835","nonce":2619292063}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:32:53.188564+0000","modified":"2020-05-18T21:32:54.910500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7842},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7842":{"gid":7842,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/468101601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":468101601},{"type":"v1","addr":"172.21.15.63:6833","nonce":468101601}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-05-18T21:32:55.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.213+0000 7fdfc0802700 1 -- 172.21.15.63:0/1036687373 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdfa004fd80 msgr2=0x7fdfa0052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.213+0000 7fdfc0802700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdfa004fd80 0x7fdfa0052240 secure :-1 s=READY pgs=498 cs=0 l=1 rx=0x7fdfa40032f0 tx=0x7fdfa400c120).stop 2020-05-18T21:32:55.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.213+0000 7fdfc0802700 1 -- 172.21.15.63:0/1036687373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc144090 msgr2=0x7fdfbc156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.213+0000 7fdfc0802700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc144090 0x7fdfbc156ad0 secure :-1 s=READY pgs=1252 cs=0 l=1 rx=0x7fdfbc0b92c0 tx=0x7fdfbc05fa60).stop 2020-05-18T21:32:55.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.213+0000 7fdfc0802700 1 -- 172.21.15.63:0/1036687373 shutdown_connections 2020-05-18T21:32:55.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.213+0000 7fdfc0802700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdfa004fd80 0x7fdfa0052240 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:55.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.213+0000 7fdfc0802700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc144090 0x7fdfbc156ad0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:55.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.213+0000 7fdfc0802700 1 --2- 172.21.15.63:0/1036687373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfbc060b90 0x7fdfbc15aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:55.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.213+0000 7fdfc0802700 1 -- 172.21.15.63:0/1036687373 >> 172.21.15.63:0/1036687373 conn(0x7fdfbc0b83d0 msgr2=0x7fdfbc142810 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:55.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.213+0000 7fdfc0802700 1 -- 172.21.15.63:0/1036687373 shutdown_connections 2020-05-18T21:32:55.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.213+0000 7fdfc0802700 1 -- 172.21.15.63:0/1036687373 wait complete. 2020-05-18T21:32:55.219 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 75 2020-05-18T21:32:55.227 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:32:55.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.325+0000 7ff96e503700 1 Processor -- start 2020-05-18T21:32:55.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.325+0000 7ff96e503700 1 -- start start 2020-05-18T21:32:55.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff96e503700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff96813de20 0x7ff9680b6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:55.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff96e503700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff9680b4f60 0x7ff9680b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:55.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff96e503700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff968069b70 con 0x7ff968144810 2020-05-18T21:32:55.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff96e503700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff968069e10 con 0x7ff9680b4f60 2020-05-18T21:32:55.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff96e503700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96806a0b0 con 0x7ff96813de20 2020-05-18T21:32:55.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff96caa0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff9680b4f60 0x7ff9680b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:55.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff95ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff968144810 0x7ff96806a550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33494/0 (socket says 172.21.15.63:33494) 2020-05-18T21:32:55.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff95ffff700 1 -- 172.21.15.63:0/3404597998 learned_addr learned my addr 172.21.15.63:0/3404597998 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:55.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff967fff700 1 --2- 172.21.15.63:0/3404597998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff96813de20 0x7ff9680b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:55.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff96caa0700 1 -- 172.21.15.63:0/3404597998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff96813de20 msgr2=0x7ff9680b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:55.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff96caa0700 1 --2- 172.21.15.63:0/3404597998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff96813de20 0x7ff9680b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:55.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff96caa0700 1 -- 172.21.15.63:0/3404597998 >> v1:172.21.15.63:6789/0 conn(0x7ff968144810 legacy=0x7ff96806a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff9677fe700 1 -- 172.21.15.63:0/3404597998 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096322880 0 0) 0x7ff968069b70 con 0x7ff968144810 2020-05-18T21:32:55.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff96caa0700 1 -- 172.21.15.63:0/3404597998 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff968144c50 con 0x7ff9680b4f60 2020-05-18T21:32:55.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff96caa0700 1 --2- 172.21.15.63:0/3404597998 >> v2:172.21.15.63:3300/0 conn(0x7ff9680b4f60 0x7ff9680b53f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff9600032f0 tx=0x7ff960007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff96caa0700 1 --2- 172.21.15.63:0/3404597998 >> v2:172.21.15.63:3300/0 conn(0x7ff9680b4f60 0x7ff9680b53f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff9600032f0 tx=0x7ff960007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff96caa0700 1 --2- 172.21.15.63:0/3404597998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9680b4f60 0x7ff9680b53f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rx=0x7ff9600032f0 tx=0x7ff960007e00).ready entity=mon.0 client_cookie=899e9fb67396e6f6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:55.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff96caa0700 1 --2- 172.21.15.63:0/3404597998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9680b4f60 0x7ff9680b53f0 secure :-1 s=THROTTLE_DONE pgs=1254 cs=0 l=1 rx=0x7ff9600032f0 tx=0x7ff960007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff9677fe700 1 -- 172.21.15.63:0/3404597998 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff960011e60 con 0x7ff9680b4f60 2020-05-18T21:32:55.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff96caa0700 1 --2- 172.21.15.63:0/3404597998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9680b4f60 0x7ff9680b53f0 secure :-1 s=THROTTLE_DONE pgs=1254 cs=0 l=1 rx=0x7ff9600032f0 tx=0x7ff960007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff9677fe700 1 -- 172.21.15.63:0/3404597998 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96000a180 con 0x7ff9680b4f60 2020-05-18T21:32:55.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff96caa0700 1 --2- 172.21.15.63:0/3404597998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9680b4f60 0x7ff9680b53f0 secure :-1 s=THROTTLE_DONE pgs=1254 cs=0 l=1 rx=0x7ff9600032f0 tx=0x7ff960007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff96e503700 1 -- 172.21.15.63:0/3404597998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9680b4f60 msgr2=0x7ff9680b53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff9677fe700 1 -- 172.21.15.63:0/3404597998 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff96000a520 con 0x7ff9680b4f60 2020-05-18T21:32:55.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.329+0000 7ff96e503700 1 --2- 172.21.15.63:0/3404597998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9680b4f60 0x7ff9680b53f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rx=0x7ff9600032f0 tx=0x7ff960007e00).stop 2020-05-18T21:32:55.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.333+0000 7ff96e503700 1 -- 172.21.15.63:0/3404597998 shutdown_connections 2020-05-18T21:32:55.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.333+0000 7ff96e503700 1 --2- 172.21.15.63:0/3404597998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9680b4f60 0x7ff9680b53f0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:55.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.333+0000 7ff96e503700 1 --2- 172.21.15.63:0/3404597998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff96813de20 0x7ff9680b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:55.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.333+0000 7ff96e503700 1 -- 172.21.15.63:0/3404597998 >> 172.21.15.63:0/3404597998 conn(0x7ff9680ba5c0 msgr2=0x7ff9680ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:55.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.333+0000 7ff96e503700 1 -- 172.21.15.63:0/3404597998 shutdown_connections 2020-05-18T21:32:55.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.333+0000 7ff96e503700 1 -- 172.21.15.63:0/3404597998 wait complete. 2020-05-18T21:32:55.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.333+0000 7ff96e503700 1 Processor -- start 2020-05-18T21:32:55.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.333+0000 7ff96e503700 1 -- start start 2020-05-18T21:32:55.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.333+0000 7ff96e503700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff9680b4f60 0x7ff968141250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:55.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.333+0000 7ff96e503700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff968155700 con 0x7ff96813de20 2020-05-18T21:32:55.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.333+0000 7ff96e503700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9680ae4f0 con 0x7ff968144810 2020-05-18T21:32:55.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.333+0000 7ff96e503700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9680ae790 con 0x7ff9680b4f60 2020-05-18T21:32:55.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.333+0000 7ff95ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff96813de20 0x7ff9681548e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33500/0 (socket says 172.21.15.63:33500) 2020-05-18T21:32:55.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.333+0000 7ff95ffff700 1 -- 172.21.15.63:0/4201635781 learned_addr learned my addr 172.21.15.63:0/4201635781 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:55.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.333+0000 7ff967fff700 1 --2- 172.21.15.63:0/4201635781 >> v2:172.21.15.155:3300/0 conn(0x7ff9680b4f60 0x7ff968141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:55.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.333+0000 7ff965ffb700 1 -- 172.21.15.63:0/4201635781 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993118468 0 0) 0x7ff968155700 con 0x7ff96813de20 2020-05-18T21:32:55.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.333+0000 7ff965ffb700 1 -- 172.21.15.63:0/4201635781 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff94c002fe0 con 0x7ff96813de20 2020-05-18T21:32:55.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff967fff700 1 -- 172.21.15.63:0/4201635781 >> v1:172.21.15.155:6789/0 conn(0x7ff968144810 legacy=0x7ff96813f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff965ffb700 1 -- 172.21.15.63:0/4201635781 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3580511841 0 0) 0x7ff94c002fe0 con 0x7ff96813de20 2020-05-18T21:32:55.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff967fff700 1 -- 172.21.15.63:0/4201635781 >> v1:172.21.15.63:6789/0 conn(0x7ff96813de20 legacy=0x7ff9681548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff967fff700 1 -- 172.21.15.63:0/4201635781 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96813e5e0 con 0x7ff9680b4f60 2020-05-18T21:32:55.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff967fff700 1 --2- 172.21.15.63:0/4201635781 >> v2:172.21.15.155:3300/0 conn(0x7ff9680b4f60 0x7ff968141250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff950001a40 tx=0x7ff958010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff967fff700 1 --2- 172.21.15.63:0/4201635781 >> v2:172.21.15.155:3300/0 conn(0x7ff9680b4f60 0x7ff968141250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff950001a40 tx=0x7ff958010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff967fff700 1 --2- 172.21.15.63:0/4201635781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9680b4f60 0x7ff968141250 secure :-1 s=READY pgs=870 cs=0 l=1 rx=0x7ff950001a40 tx=0x7ff958010bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:55.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff967fff700 1 --2- 172.21.15.63:0/4201635781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9680b4f60 0x7ff968141250 secure :-1 s=THROTTLE_DONE pgs=870 cs=0 l=1 rx=0x7ff950001a40 tx=0x7ff958010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff965ffb700 1 -- 172.21.15.63:0/4201635781 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9500018a0 con 0x7ff9680b4f60 2020-05-18T21:32:55.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff967fff700 1 --2- 172.21.15.63:0/4201635781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9680b4f60 0x7ff968141250 secure :-1 s=THROTTLE_DONE pgs=870 cs=0 l=1 rx=0x7ff950001a40 tx=0x7ff958010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff967fff700 1 --2- 172.21.15.63:0/4201635781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9680b4f60 0x7ff968141250 secure :-1 s=THROTTLE_DONE pgs=870 cs=0 l=1 rx=0x7ff950001a40 tx=0x7ff958010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff965ffb700 1 -- 172.21.15.63:0/4201635781 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95800e6c0 con 0x7ff9680b4f60 2020-05-18T21:32:55.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff96e503700 1 -- 172.21.15.63:0/4201635781 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96813cdc0 con 0x7ff9680b4f60 2020-05-18T21:32:55.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff965ffb700 1 -- 172.21.15.63:0/4201635781 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff95800ea20 con 0x7ff9680b4f60 2020-05-18T21:32:55.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff96e503700 1 -- 172.21.15.63:0/4201635781 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff968154ff0 con 0x7ff9680b4f60 2020-05-18T21:32:55.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff967fff700 1 --2- 172.21.15.63:0/4201635781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9680b4f60 0x7ff968141250 secure :-1 s=THROTTLE_DONE pgs=870 cs=0 l=1 rx=0x7ff950001a40 tx=0x7ff958010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff96e503700 1 -- 172.21.15.63:0/4201635781 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9680569e0 con 0x7ff9680b4f60 2020-05-18T21:32:55.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff965ffb700 1 -- 172.21.15.63:0/4201635781 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff95800ec20 con 0x7ff9680b4f60 2020-05-18T21:32:55.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff967fff700 1 --2- 172.21.15.63:0/4201635781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9680b4f60 0x7ff968141250 secure :-1 s=THROTTLE_DONE pgs=870 cs=0 l=1 rx=0x7ff950001a40 tx=0x7ff958010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff965ffb700 1 --2- 172.21.15.63:0/4201635781 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff94c04fca0 0x7ff94c052160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:55.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff965ffb700 1 -- 172.21.15.63:0/4201635781 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff958063670 con 0x7ff9680b4f60 2020-05-18T21:32:55.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.337+0000 7ff95ffff700 1 --2- 172.21.15.63:0/4201635781 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff94c04fca0 0x7ff94c052160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:55.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.341+0000 7ff95ffff700 1 --2- 172.21.15.63:0/4201635781 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff94c04fca0 0x7ff94c052160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff950001b00 tx=0x7ff950009660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.341+0000 7ff95ffff700 1 --2- 172.21.15.63:0/4201635781 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff94c04fca0 0x7ff94c052160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff950001b00 tx=0x7ff950009660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.341+0000 7ff95ffff700 1 --2- 172.21.15.63:0/4201635781 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff94c04fca0 0x7ff94c052160 secure :-1 s=READY pgs=499 cs=0 l=1 rx=0x7ff950001b00 tx=0x7ff950009660).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:55.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.349+0000 7ff967fff700 1 --2- 172.21.15.63:0/4201635781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9680b4f60 0x7ff968141250 secure :-1 s=THROTTLE_DONE pgs=870 cs=0 l=1 rx=0x7ff950001a40 tx=0x7ff958010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.349+0000 7ff965ffb700 1 -- 172.21.15.63:0/4201635781 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff95803dac0 con 0x7ff9680b4f60 2020-05-18T21:32:55.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.469+0000 7ff96e503700 1 -- 172.21.15.63:0/4201635781 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9680b6e40 con 0x7ff9680b4f60 2020-05-18T21:32:55.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.469+0000 7ff967fff700 1 --2- 172.21.15.63:0/4201635781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9680b4f60 0x7ff968141250 secure :-1 s=THROTTLE_DONE pgs=870 cs=0 l=1 rx=0x7ff950001a40 tx=0x7ff958010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.469+0000 7ff965ffb700 1 -- 172.21.15.63:0/4201635781 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16092 (secure 0 0 0) 0x7ff9580410e0 con 0x7ff9680b4f60 2020-05-18T21:32:55.475 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:55.475 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":95,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:32:54.190968+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:32:51.634300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2020-05-18T21:32:52.187431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:32:55.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.473+0000 7ff96e503700 1 -- 172.21.15.63:0/4201635781 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff94c04fca0 msgr2=0x7ff94c052160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.473+0000 7ff96e503700 1 --2- 172.21.15.63:0/4201635781 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff94c04fca0 0x7ff94c052160 secure :-1 s=READY pgs=499 cs=0 l=1 rx=0x7ff950001b00 tx=0x7ff950009660).stop 2020-05-18T21:32:55.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.473+0000 7ff96e503700 1 -- 172.21.15.63:0/4201635781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9680b4f60 msgr2=0x7ff968141250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.473+0000 7ff96e503700 1 --2- 172.21.15.63:0/4201635781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9680b4f60 0x7ff968141250 secure :-1 s=READY pgs=870 cs=0 l=1 rx=0x7ff950001a40 tx=0x7ff958010bb0).stop 2020-05-18T21:32:55.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.473+0000 7ff96e503700 1 -- 172.21.15.63:0/4201635781 shutdown_connections 2020-05-18T21:32:55.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.473+0000 7ff96e503700 1 --2- 172.21.15.63:0/4201635781 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff94c04fca0 0x7ff94c052160 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:55.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.473+0000 7ff96e503700 1 --2- 172.21.15.63:0/4201635781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9680b4f60 0x7ff968141250 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:55.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.473+0000 7ff96e503700 1 -- 172.21.15.63:0/4201635781 >> 172.21.15.63:0/4201635781 conn(0x7ff9680ba5c0 msgr2=0x7ff9680b7060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:55.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.473+0000 7ff96e503700 1 -- 172.21.15.63:0/4201635781 shutdown_connections 2020-05-18T21:32:55.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.473+0000 7ff96e503700 1 -- 172.21.15.63:0/4201635781 wait complete. 2020-05-18T21:32:55.494 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:32:55.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2020-05-18T21:32:55.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.601+0000 7f29d6513700 1 Processor -- start 2020-05-18T21:32:55.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.601+0000 7f29d6513700 1 -- start start 2020-05-18T21:32:55.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.601+0000 7f29d6513700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f29d00b5cb0 0x7f29d00b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:55.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.601+0000 7f29d6513700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d0025500 con 0x7f29d0151bc0 2020-05-18T21:32:55.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.601+0000 7f29d6513700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d0064ee0 con 0x7f29d00b6410 2020-05-18T21:32:55.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.601+0000 7f29d6513700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d00b67f0 con 0x7f29d00b5cb0 2020-05-18T21:32:55.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.601+0000 7f29d5511700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f29d00b5cb0 0x7f29d00b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:55.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.601+0000 7f29d7775700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f29d0151bc0 0x7f29d0152030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33510/0 (socket says 172.21.15.63:33510) 2020-05-18T21:32:55.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.601+0000 7f29d7775700 1 -- 172.21.15.63:0/2647412302 learned_addr learned my addr 172.21.15.63:0/2647412302 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:55.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d5511700 1 -- 172.21.15.63:0/2647412302 >> v1:172.21.15.155:6789/0 conn(0x7f29d00b6410 legacy=0x7f29d0061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d5511700 1 -- 172.21.15.63:0/2647412302 >> v1:172.21.15.63:6789/0 conn(0x7f29d0151bc0 legacy=0x7f29d0152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d4d10700 1 -- 172.21.15.63:0/2647412302 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768150547 0 0) 0x7f29d0064ee0 con 0x7f29d00b6410 2020-05-18T21:32:55.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d5511700 1 -- 172.21.15.63:0/2647412302 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d0025180 con 0x7f29d00b5cb0 2020-05-18T21:32:55.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d5511700 1 --2- 172.21.15.63:0/2647412302 >> v2:172.21.15.63:3300/0 conn(0x7f29d00b5cb0 0x7f29d00b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f29c8001110 tx=0x7f29c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d5511700 1 --2- 172.21.15.63:0/2647412302 >> v2:172.21.15.63:3300/0 conn(0x7f29d00b5cb0 0x7f29d00b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f29c8001110 tx=0x7f29c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d5511700 1 --2- 172.21.15.63:0/2647412302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d00b5cb0 0x7f29d00b6cd0 secure :-1 s=READY pgs=1257 cs=0 l=1 rx=0x7f29c8001110 tx=0x7f29c0007a80).ready entity=mon.0 client_cookie=31c9bf9c215eed76 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:55.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d5511700 1 --2- 172.21.15.63:0/2647412302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d00b5cb0 0x7f29d00b6cd0 secure :-1 s=THROTTLE_DONE pgs=1257 cs=0 l=1 rx=0x7f29c8001110 tx=0x7f29c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d4d10700 1 -- 172.21.15.63:0/2647412302 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29c0008d30 con 0x7f29d00b5cb0 2020-05-18T21:32:55.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d5511700 1 --2- 172.21.15.63:0/2647412302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d00b5cb0 0x7f29d00b6cd0 secure :-1 s=THROTTLE_DONE pgs=1257 cs=0 l=1 rx=0x7f29c8001110 tx=0x7f29c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d5511700 1 --2- 172.21.15.63:0/2647412302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d00b5cb0 0x7f29d00b6cd0 secure :-1 s=THROTTLE_DONE pgs=1257 cs=0 l=1 rx=0x7f29c8001110 tx=0x7f29c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d4d10700 1 -- 172.21.15.63:0/2647412302 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c0008e90 con 0x7f29d00b5cb0 2020-05-18T21:32:55.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d4d10700 1 -- 172.21.15.63:0/2647412302 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29c0011930 con 0x7f29d00b5cb0 2020-05-18T21:32:55.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d6513700 1 -- 172.21.15.63:0/2647412302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d00b5cb0 msgr2=0x7f29d00b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d6513700 1 --2- 172.21.15.63:0/2647412302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d00b5cb0 0x7f29d00b6cd0 secure :-1 s=READY pgs=1257 cs=0 l=1 rx=0x7f29c8001110 tx=0x7f29c0007a80).stop 2020-05-18T21:32:55.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d6513700 1 -- 172.21.15.63:0/2647412302 shutdown_connections 2020-05-18T21:32:55.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d6513700 1 --2- 172.21.15.63:0/2647412302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d00b5cb0 0x7f29d00b6cd0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:55.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d6513700 1 -- 172.21.15.63:0/2647412302 >> 172.21.15.63:0/2647412302 conn(0x7f29d0069b70 msgr2=0x7f29d0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:55.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d6513700 1 -- 172.21.15.63:0/2647412302 shutdown_connections 2020-05-18T21:32:55.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.605+0000 7f29d6513700 1 -- 172.21.15.63:0/2647412302 wait complete. 2020-05-18T21:32:55.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d6513700 1 Processor -- start 2020-05-18T21:32:55.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d6513700 1 -- start start 2020-05-18T21:32:55.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d6513700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f29d00b5cb0 0x7f29d00b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:55.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d6513700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29d0151bc0 0x7f29d0062330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:55.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d6513700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d00b4440 con 0x7f29d00b6410 2020-05-18T21:32:55.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d6513700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d0062790 con 0x7f29d00b5cb0 2020-05-18T21:32:55.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d6513700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d0126060 con 0x7f29d0151bc0 2020-05-18T21:32:55.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d5511700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f29d00b6410 0x7f29d00b3d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33514/0 (socket says 172.21.15.63:33514) 2020-05-18T21:32:55.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d5511700 1 -- 172.21.15.63:0/355179935 learned_addr learned my addr 172.21.15.63:0/355179935 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:55.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d5d12700 1 --2- 172.21.15.63:0/355179935 >> v2:172.21.15.155:3300/0 conn(0x7f29d00b5cb0 0x7f29d00b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:55.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d7775700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29d0151bc0 0x7f29d0062330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:55.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29c67fc700 1 -- 172.21.15.63:0/355179935 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251573533 0 0) 0x7f29d00b4440 con 0x7f29d00b6410 2020-05-18T21:32:55.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29c67fc700 1 -- 172.21.15.63:0/355179935 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29b8003270 con 0x7f29d00b6410 2020-05-18T21:32:55.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29c67fc700 1 -- 172.21.15.63:0/355179935 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2857206237 0 0) 0x7f29b8003270 con 0x7f29d00b6410 2020-05-18T21:32:55.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d5d12700 1 -- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29d0151bc0 msgr2=0x7f29d0062330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d5d12700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29d0151bc0 0x7f29d0062330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:55.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d5d12700 1 -- 172.21.15.63:0/355179935 >> v1:172.21.15.63:6789/0 conn(0x7f29d00b6410 legacy=0x7f29d00b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d5d12700 1 -- 172.21.15.63:0/355179935 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d00712d0 con 0x7f29d00b5cb0 2020-05-18T21:32:55.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d5d12700 1 --2- 172.21.15.63:0/355179935 >> v2:172.21.15.155:3300/0 conn(0x7f29d00b5cb0 0x7f29d00b3420 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f29c0008840 tx=0x7f29cc010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d5d12700 1 --2- 172.21.15.63:0/355179935 >> v2:172.21.15.155:3300/0 conn(0x7f29d00b5cb0 0x7f29d00b3420 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f29c0008840 tx=0x7f29cc010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d5d12700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29d00b5cb0 0x7f29d00b3420 secure :-1 s=READY pgs=872 cs=0 l=1 rx=0x7f29c0008840 tx=0x7f29cc010c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:55.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d5d12700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29d00b5cb0 0x7f29d00b3420 secure :-1 s=THROTTLE_DONE pgs=872 cs=0 l=1 rx=0x7f29c0008840 tx=0x7f29cc010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29c67fc700 1 -- 172.21.15.63:0/355179935 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29cc013070 con 0x7f29d00b5cb0 2020-05-18T21:32:55.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d5d12700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29d00b5cb0 0x7f29d00b3420 secure :-1 s=THROTTLE_DONE pgs=872 cs=0 l=1 rx=0x7f29c0008840 tx=0x7f29cc010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d6513700 1 -- 172.21.15.63:0/355179935 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d0071000 con 0x7f29d00b5cb0 2020-05-18T21:32:55.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29c67fc700 1 -- 172.21.15.63:0/355179935 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc006d90 con 0x7f29d00b5cb0 2020-05-18T21:32:55.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d5d12700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29d00b5cb0 0x7f29d00b3420 secure :-1 s=THROTTLE_DONE pgs=872 cs=0 l=1 rx=0x7f29c0008840 tx=0x7f29cc010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29c67fc700 1 -- 172.21.15.63:0/355179935 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29c00086a0 con 0x7f29d00b5cb0 2020-05-18T21:32:55.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.609+0000 7f29d6513700 1 -- 172.21.15.63:0/355179935 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d0125c30 con 0x7f29d00b5cb0 2020-05-18T21:32:55.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.613+0000 7f29d5d12700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29d00b5cb0 0x7f29d00b3420 secure :-1 s=THROTTLE_DONE pgs=872 cs=0 l=1 rx=0x7f29c0008840 tx=0x7f29cc010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.613+0000 7f29d6513700 1 -- 172.21.15.63:0/355179935 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d00569e0 con 0x7f29d00b5cb0 2020-05-18T21:32:55.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.613+0000 7f29c67fc700 1 -- 172.21.15.63:0/355179935 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f29cc003080 con 0x7f29d00b5cb0 2020-05-18T21:32:55.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.613+0000 7f29d5d12700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29d00b5cb0 0x7f29d00b3420 secure :-1 s=THROTTLE_DONE pgs=872 cs=0 l=1 rx=0x7f29c0008840 tx=0x7f29cc010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.613+0000 7f29c67fc700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29b804fd40 0x7f29b8052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:55.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.613+0000 7f29c67fc700 1 -- 172.21.15.63:0/355179935 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f29cc0637c0 con 0x7f29d00b5cb0 2020-05-18T21:32:55.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.613+0000 7f29d5511700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29b804fd40 0x7f29b8052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:55.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.613+0000 7f29d5511700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29b804fd40 0x7f29b8052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f29c0007b20 tx=0x7f29c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.613+0000 7f29d5511700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29b804fd40 0x7f29b8052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f29c0007b20 tx=0x7f29c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.613+0000 7f29d5511700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29b804fd40 0x7f29b8052200 secure :-1 s=READY pgs=500 cs=0 l=1 rx=0x7f29c0007b20 tx=0x7f29c0007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:55.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.621+0000 7f29d5d12700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29d00b5cb0 0x7f29d00b3420 secure :-1 s=THROTTLE_DONE pgs=872 cs=0 l=1 rx=0x7f29c0008840 tx=0x7f29cc010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.621+0000 7f29c67fc700 1 -- 172.21.15.63:0/355179935 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f29cc03daf0 con 0x7f29d00b5cb0 2020-05-18T21:32:55.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.773+0000 7f29d6513700 1 -- 172.21.15.63:0/355179935 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f29d0152520 con 0x7f29d00b5cb0 2020-05-18T21:32:55.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.781+0000 7f29d5d12700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29d00b5cb0 0x7f29d00b3420 secure :-1 s=THROTTLE_DONE pgs=872 cs=0 l=1 rx=0x7f29c0008840 tx=0x7f29cc010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.781+0000 7f29c67fc700 1 -- 172.21.15.63:0/355179935 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v35) v1 ==== 184+0+0 (secure 0 0 0) 0x7f29cc041110 con 0x7f29d00b5cb0 2020-05-18T21:32:55.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.785+0000 7f29d6513700 1 -- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29b804fd40 msgr2=0x7f29b8052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.785+0000 7f29d6513700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29b804fd40 0x7f29b8052200 secure :-1 s=READY pgs=500 cs=0 l=1 rx=0x7f29c0007b20 tx=0x7f29c0007a80).stop 2020-05-18T21:32:55.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.785+0000 7f29d6513700 1 -- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29d00b5cb0 msgr2=0x7f29d00b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.785+0000 7f29d6513700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29d00b5cb0 0x7f29d00b3420 secure :-1 s=READY pgs=872 cs=0 l=1 rx=0x7f29c0008840 tx=0x7f29cc010c50).stop 2020-05-18T21:32:55.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.785+0000 7f29d6513700 1 -- 172.21.15.63:0/355179935 shutdown_connections 2020-05-18T21:32:55.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.785+0000 7f29d6513700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f29b804fd40 0x7f29b8052200 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:55.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.785+0000 7f29d6513700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29d0151bc0 0x7f29d0062330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:55.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.785+0000 7f29d6513700 1 --2- 172.21.15.63:0/355179935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29d00b5cb0 0x7f29d00b3420 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:55.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.785+0000 7f29d6513700 1 -- 172.21.15.63:0/355179935 >> 172.21.15.63:0/355179935 conn(0x7f29d0069b70 msgr2=0x7f29d0069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:55.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.785+0000 7f29d6513700 1 -- 172.21.15.63:0/355179935 shutdown_connections 2020-05-18T21:32:55.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.785+0000 7f29d6513700 1 -- 172.21.15.63:0/355179935 wait complete. 2020-05-18T21:32:55.791 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.0 2020-05-18T21:32:55.803 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:32:55.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.917+0000 7f45f96ef700 1 Processor -- start 2020-05-18T21:32:55.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45f96ef700 1 -- start start 2020-05-18T21:32:55.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45f96ef700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f45f40b6cd0 0x7f45f41522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:55.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45f96ef700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f4025500 con 0x7f45f40b5cb0 2020-05-18T21:32:55.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45f96ef700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f4064ee0 con 0x7f45f40b6410 2020-05-18T21:32:55.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45f96ef700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f40b67f0 con 0x7f45f40b6cd0 2020-05-18T21:32:55.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45fa951700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f45f40b6cd0 0x7f45f41522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:55.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45ebfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f45f40b5cb0 0x7f45f4151bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33522/0 (socket says 172.21.15.63:33522) 2020-05-18T21:32:55.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45ebfff700 1 -- 172.21.15.63:0/4117826770 learned_addr learned my addr 172.21.15.63:0/4117826770 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:55.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45fa951700 1 -- 172.21.15.63:0/4117826770 >> v1:172.21.15.155:6789/0 conn(0x7f45f40b6410 legacy=0x7f45f4061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45fa951700 1 -- 172.21.15.63:0/4117826770 >> v1:172.21.15.63:6789/0 conn(0x7f45f40b5cb0 legacy=0x7f45f4151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45fa951700 1 -- 172.21.15.63:0/4117826770 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f4025180 con 0x7f45f40b6cd0 2020-05-18T21:32:55.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45fa951700 1 --2- 172.21.15.63:0/4117826770 >> v2:172.21.15.63:3300/0 conn(0x7f45f40b6cd0 0x7f45f41522d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f45ec0032f0 tx=0x7f45ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45fa951700 1 --2- 172.21.15.63:0/4117826770 >> v2:172.21.15.63:3300/0 conn(0x7f45f40b6cd0 0x7f45f41522d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f45ec0032f0 tx=0x7f45ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45fa951700 1 --2- 172.21.15.63:0/4117826770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45f40b6cd0 0x7f45f41522d0 secure :-1 s=READY pgs=1260 cs=0 l=1 rx=0x7f45ec0032f0 tx=0x7f45ec007e00).ready entity=mon.0 client_cookie=d0d1eccbc8de3da8 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:55.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45fa951700 1 --2- 172.21.15.63:0/4117826770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45f40b6cd0 0x7f45f41522d0 secure :-1 s=THROTTLE_DONE pgs=1260 cs=0 l=1 rx=0x7f45ec0032f0 tx=0x7f45ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45fa951700 1 --2- 172.21.15.63:0/4117826770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45f40b6cd0 0x7f45f41522d0 secure :-1 s=THROTTLE_DONE pgs=1260 cs=0 l=1 rx=0x7f45ec0032f0 tx=0x7f45ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45fa951700 1 --2- 172.21.15.63:0/4117826770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45f40b6cd0 0x7f45f41522d0 secure :-1 s=THROTTLE_DONE pgs=1260 cs=0 l=1 rx=0x7f45ec0032f0 tx=0x7f45ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45eb7fe700 1 -- 172.21.15.63:0/4117826770 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45ec00a180 con 0x7f45f40b6cd0 2020-05-18T21:32:55.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45eb7fe700 1 -- 172.21.15.63:0/4117826770 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec00a2e0 con 0x7f45f40b6cd0 2020-05-18T21:32:55.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45eb7fe700 1 -- 172.21.15.63:0/4117826770 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45ec00a700 con 0x7f45f40b6cd0 2020-05-18T21:32:55.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45f96ef700 1 -- 172.21.15.63:0/4117826770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45f40b6cd0 msgr2=0x7f45f41522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.921+0000 7f45f96ef700 1 --2- 172.21.15.63:0/4117826770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45f40b6cd0 0x7f45f41522d0 secure :-1 s=READY pgs=1260 cs=0 l=1 rx=0x7f45ec0032f0 tx=0x7f45ec007e00).stop 2020-05-18T21:32:55.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.925+0000 7f45f96ef700 1 -- 172.21.15.63:0/4117826770 shutdown_connections 2020-05-18T21:32:55.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.925+0000 7f45f96ef700 1 --2- 172.21.15.63:0/4117826770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45f40b6cd0 0x7f45f41522d0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:55.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.925+0000 7f45f96ef700 1 -- 172.21.15.63:0/4117826770 >> 172.21.15.63:0/4117826770 conn(0x7f45f4069b70 msgr2=0x7f45f4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:55.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.925+0000 7f45f96ef700 1 -- 172.21.15.63:0/4117826770 shutdown_connections 2020-05-18T21:32:55.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.925+0000 7f45f96ef700 1 -- 172.21.15.63:0/4117826770 wait complete. 2020-05-18T21:32:55.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.925+0000 7f45f96ef700 1 Processor -- start 2020-05-18T21:32:55.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.925+0000 7f45f96ef700 1 -- start start 2020-05-18T21:32:55.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.929+0000 7f45f96ef700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f45f40b6410 0x7f45f4137c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:55.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.929+0000 7f45f96ef700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f40b2e00 con 0x7f45f40b6cd0 2020-05-18T21:32:55.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.929+0000 7f45f96ef700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f41381d0 con 0x7f45f40b5cb0 2020-05-18T21:32:55.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.929+0000 7f45f96ef700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f40b46a0 con 0x7f45f40b6410 2020-05-18T21:32:55.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.929+0000 7f45fa951700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f45f40b6cd0 0x7f45f40b0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33528/0 (socket says 172.21.15.63:33528) 2020-05-18T21:32:55.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.929+0000 7f45fa951700 1 -- 172.21.15.63:0/476567689 learned_addr learned my addr 172.21.15.63:0/476567689 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:55.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.929+0000 7f45ebfff700 1 --2- 172.21.15.63:0/476567689 >> v2:172.21.15.155:3300/0 conn(0x7f45f40b6410 0x7f45f4137c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:55.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.929+0000 7f45ebfff700 1 -- 172.21.15.63:0/476567689 >> v1:172.21.15.155:6789/0 conn(0x7f45f40b5cb0 legacy=0x7f45f40654b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.929+0000 7f45ebfff700 1 -- 172.21.15.63:0/476567689 >> v1:172.21.15.63:6789/0 conn(0x7f45f40b6cd0 legacy=0x7f45f40b0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:55.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.929+0000 7f45ebfff700 1 -- 172.21.15.63:0/476567689 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f40b4940 con 0x7f45f40b6410 2020-05-18T21:32:55.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.929+0000 7f45ebfff700 1 --2- 172.21.15.63:0/476567689 >> v2:172.21.15.155:3300/0 conn(0x7f45f40b6410 0x7f45f4137c80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f45f4025b40 tx=0x7f45e4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.929+0000 7f45ebfff700 1 --2- 172.21.15.63:0/476567689 >> v2:172.21.15.155:3300/0 conn(0x7f45f40b6410 0x7f45f4137c80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f45f4025b40 tx=0x7f45e4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.929+0000 7f45ebfff700 1 --2- 172.21.15.63:0/476567689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45f40b6410 0x7f45f4137c80 secure :-1 s=READY pgs=875 cs=0 l=1 rx=0x7f45f4025b40 tx=0x7f45e4010960).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:55.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.933+0000 7f45ebfff700 1 --2- 172.21.15.63:0/476567689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45f40b6410 0x7f45f4137c80 secure :-1 s=THROTTLE_DONE pgs=875 cs=0 l=1 rx=0x7f45f4025b40 tx=0x7f45e4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.933+0000 7f45ebfff700 1 --2- 172.21.15.63:0/476567689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45f40b6410 0x7f45f4137c80 secure :-1 s=THROTTLE_DONE pgs=875 cs=0 l=1 rx=0x7f45f4025b40 tx=0x7f45e4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.933+0000 7f45ebfff700 1 --2- 172.21.15.63:0/476567689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45f40b6410 0x7f45f4137c80 secure :-1 s=THROTTLE_DONE pgs=875 cs=0 l=1 rx=0x7f45f4025b40 tx=0x7f45e4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.933+0000 7f45e97fa700 1 -- 172.21.15.63:0/476567689 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45e4005ce0 con 0x7f45f40b6410 2020-05-18T21:32:55.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.933+0000 7f45e97fa700 1 -- 172.21.15.63:0/476567689 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e4005e40 con 0x7f45f40b6410 2020-05-18T21:32:55.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.933+0000 7f45f96ef700 1 -- 172.21.15.63:0/476567689 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f40b1630 con 0x7f45f40b6410 2020-05-18T21:32:55.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.933+0000 7f45e97fa700 1 -- 172.21.15.63:0/476567689 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45e4006300 con 0x7f45f40b6410 2020-05-18T21:32:55.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.933+0000 7f45f96ef700 1 -- 172.21.15.63:0/476567689 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f40b0b40 con 0x7f45f40b6410 2020-05-18T21:32:55.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.937+0000 7f45ebfff700 1 --2- 172.21.15.63:0/476567689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45f40b6410 0x7f45f4137c80 secure :-1 s=THROTTLE_DONE pgs=875 cs=0 l=1 rx=0x7f45f4025b40 tx=0x7f45e4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.937+0000 7f45f96ef700 1 -- 172.21.15.63:0/476567689 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f40569e0 con 0x7f45f40b6410 2020-05-18T21:32:55.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.937+0000 7f45e97fa700 1 -- 172.21.15.63:0/476567689 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f45e4006570 con 0x7f45f40b6410 2020-05-18T21:32:55.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.937+0000 7f45ebfff700 1 --2- 172.21.15.63:0/476567689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45f40b6410 0x7f45f4137c80 secure :-1 s=THROTTLE_DONE pgs=875 cs=0 l=1 rx=0x7f45f4025b40 tx=0x7f45e4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.937+0000 7f45e97fa700 1 --2- 172.21.15.63:0/476567689 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f45d404f970 0x7f45d4051e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:55.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.937+0000 7f45e97fa700 1 -- 172.21.15.63:0/476567689 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f45e40090c0 con 0x7f45f40b6410 2020-05-18T21:32:55.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.937+0000 7f45f8eee700 1 --2- 172.21.15.63:0/476567689 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f45d404f970 0x7f45d4051e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:55.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.937+0000 7f45f8eee700 1 --2- 172.21.15.63:0/476567689 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f45d404f970 0x7f45d4051e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f45f40b0760 tx=0x7f45f00025a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.937+0000 7f45f8eee700 1 --2- 172.21.15.63:0/476567689 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f45d404f970 0x7f45d4051e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f45f40b0760 tx=0x7f45f00025a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.937+0000 7f45f8eee700 1 --2- 172.21.15.63:0/476567689 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f45d404f970 0x7f45d4051e30 secure :-1 s=READY pgs=501 cs=0 l=1 rx=0x7f45f40b0760 tx=0x7f45f00025a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:55.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.945+0000 7f45ebfff700 1 --2- 172.21.15.63:0/476567689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45f40b6410 0x7f45f4137c80 secure :-1 s=THROTTLE_DONE pgs=875 cs=0 l=1 rx=0x7f45f4025b40 tx=0x7f45e4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:55.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:55.945+0000 7f45e97fa700 1 -- 172.21.15.63:0/476567689 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f45e403e1b0 con 0x7f45f40b6410 2020-05-18T21:32:56.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.101+0000 7f45f96ef700 1 -- 172.21.15.63:0/476567689 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f45f40008d0 con 0x7f45f40b6410 2020-05-18T21:32:56.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.109+0000 7f45ebfff700 1 --2- 172.21.15.63:0/476567689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45f40b6410 0x7f45f4137c80 secure :-1 s=THROTTLE_DONE pgs=875 cs=0 l=1 rx=0x7f45f4025b40 tx=0x7f45e4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.109+0000 7f45e97fa700 1 -- 172.21.15.63:0/476567689 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v36) v1 ==== 184+0+0 (secure 0 0 0) 0x7f45e40417d0 con 0x7f45f40b6410 2020-05-18T21:32:56.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.113+0000 7f45f96ef700 1 -- 172.21.15.63:0/476567689 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f45d404f970 msgr2=0x7f45d4051e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:56.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.113+0000 7f45f96ef700 1 --2- 172.21.15.63:0/476567689 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f45d404f970 0x7f45d4051e30 secure :-1 s=READY pgs=501 cs=0 l=1 rx=0x7f45f40b0760 tx=0x7f45f00025a0).stop 2020-05-18T21:32:56.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.113+0000 7f45f96ef700 1 -- 172.21.15.63:0/476567689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45f40b6410 msgr2=0x7f45f4137c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:56.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.113+0000 7f45f96ef700 1 --2- 172.21.15.63:0/476567689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45f40b6410 0x7f45f4137c80 secure :-1 s=READY pgs=875 cs=0 l=1 rx=0x7f45f4025b40 tx=0x7f45e4010960).stop 2020-05-18T21:32:56.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.113+0000 7f45f96ef700 1 -- 172.21.15.63:0/476567689 shutdown_connections 2020-05-18T21:32:56.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.113+0000 7f45f96ef700 1 --2- 172.21.15.63:0/476567689 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f45d404f970 0x7f45d4051e30 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:56.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.113+0000 7f45f96ef700 1 --2- 172.21.15.63:0/476567689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45f40b6410 0x7f45f4137c80 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:56.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.113+0000 7f45f96ef700 1 -- 172.21.15.63:0/476567689 >> 172.21.15.63:0/476567689 conn(0x7f45f4069b70 msgr2=0x7f45f4061af0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:56.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.113+0000 7f45f96ef700 1 -- 172.21.15.63:0/476567689 shutdown_connections 2020-05-18T21:32:56.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.113+0000 7f45f96ef700 1 -- 172.21.15.63:0/476567689 wait complete. 2020-05-18T21:32:56.120 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.1 2020-05-18T21:32:56.132 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:32:56.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.245+0000 7f02fb59e700 1 Processor -- start 2020-05-18T21:32:56.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.245+0000 7f02fb59e700 1 -- start start 2020-05-18T21:32:56.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02fb59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02fc0b6410 0x7f02fc0b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:56.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02fb59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f02fc151bc0 0x7f02fc152050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:56.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02fb59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02fc025500 con 0x7f02fc0b5cb0 2020-05-18T21:32:56.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02fb59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02fc064ee0 con 0x7f02fc151bc0 2020-05-18T21:32:56.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02fb59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0b67f0 con 0x7f02fc0b6410 2020-05-18T21:32:56.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f03008cf700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f02fc151bc0 0x7f02fc152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:56.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02fa59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f02fc0b5cb0 0x7f02fc061af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33534/0 (socket says 172.21.15.63:33534) 2020-05-18T21:32:56.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02fa59c700 1 -- 172.21.15.63:0/1128582789 learned_addr learned my addr 172.21.15.63:0/1128582789 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:56.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02fad9d700 1 --2- 172.21.15.63:0/1128582789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02fc0b6410 0x7f02fc0b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:56.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02f9d9b700 1 -- 172.21.15.63:0/1128582789 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401653843 0 0) 0x7f02fc025500 con 0x7f02fc0b5cb0 2020-05-18T21:32:56.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02f9d9b700 1 -- 172.21.15.63:0/1128582789 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02e8003270 con 0x7f02fc0b5cb0 2020-05-18T21:32:56.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f03008cf700 1 -- 172.21.15.63:0/1128582789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02fc0b6410 msgr2=0x7f02fc0b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:56.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f03008cf700 1 --2- 172.21.15.63:0/1128582789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02fc0b6410 0x7f02fc0b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:56.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f03008cf700 1 -- 172.21.15.63:0/1128582789 >> v1:172.21.15.63:6789/0 conn(0x7f02fc0b5cb0 legacy=0x7f02fc061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:56.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f03008cf700 1 -- 172.21.15.63:0/1128582789 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02fc025180 con 0x7f02fc151bc0 2020-05-18T21:32:56.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f03008cf700 1 --2- 172.21.15.63:0/1128582789 >> v2:172.21.15.63:3300/0 conn(0x7f02fc151bc0 0x7f02fc152050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f02f40032f0 tx=0x7f02f4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f03008cf700 1 --2- 172.21.15.63:0/1128582789 >> v2:172.21.15.63:3300/0 conn(0x7f02fc151bc0 0x7f02fc152050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f02f40032f0 tx=0x7f02f4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f03008cf700 1 --2- 172.21.15.63:0/1128582789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02fc151bc0 0x7f02fc152050 secure :-1 s=READY pgs=1263 cs=0 l=1 rx=0x7f02f40032f0 tx=0x7f02f4007e00).ready entity=mon.0 client_cookie=edd6724cfc7e375b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:56.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f03008cf700 1 --2- 172.21.15.63:0/1128582789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02fc151bc0 0x7f02fc152050 secure :-1 s=THROTTLE_DONE pgs=1263 cs=0 l=1 rx=0x7f02f40032f0 tx=0x7f02f4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02f9d9b700 1 -- 172.21.15.63:0/1128582789 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02f4011db0 con 0x7f02fc151bc0 2020-05-18T21:32:56.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f03008cf700 1 --2- 172.21.15.63:0/1128582789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02fc151bc0 0x7f02fc152050 secure :-1 s=THROTTLE_DONE pgs=1263 cs=0 l=1 rx=0x7f02f40032f0 tx=0x7f02f4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02f9d9b700 1 -- 172.21.15.63:0/1128582789 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f400a180 con 0x7f02fc151bc0 2020-05-18T21:32:56.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f03008cf700 1 --2- 172.21.15.63:0/1128582789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02fc151bc0 0x7f02fc152050 secure :-1 s=THROTTLE_DONE pgs=1263 cs=0 l=1 rx=0x7f02f40032f0 tx=0x7f02f4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02f9d9b700 1 -- 172.21.15.63:0/1128582789 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02f400a5a0 con 0x7f02fc151bc0 2020-05-18T21:32:56.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02fb59e700 1 -- 172.21.15.63:0/1128582789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02fc151bc0 msgr2=0x7f02fc152050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:56.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02fb59e700 1 --2- 172.21.15.63:0/1128582789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02fc151bc0 0x7f02fc152050 secure :-1 s=READY pgs=1263 cs=0 l=1 rx=0x7f02f40032f0 tx=0x7f02f4007e00).stop 2020-05-18T21:32:56.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02fb59e700 1 -- 172.21.15.63:0/1128582789 shutdown_connections 2020-05-18T21:32:56.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02fb59e700 1 --2- 172.21.15.63:0/1128582789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02fc151bc0 0x7f02fc152050 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:56.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02fb59e700 1 --2- 172.21.15.63:0/1128582789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02fc0b6410 0x7f02fc0b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:56.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02fb59e700 1 -- 172.21.15.63:0/1128582789 >> 172.21.15.63:0/1128582789 conn(0x7f02fc069b70 msgr2=0x7f02fc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:56.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02fb59e700 1 -- 172.21.15.63:0/1128582789 shutdown_connections 2020-05-18T21:32:56.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.249+0000 7f02fb59e700 1 -- 172.21.15.63:0/1128582789 wait complete. 2020-05-18T21:32:56.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fb59e700 1 Processor -- start 2020-05-18T21:32:56.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fb59e700 1 -- start start 2020-05-18T21:32:56.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fb59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f02fc0b5cb0 0x7f02fc0b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:56.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fb59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f02fc0b6410 0x7f02fc123410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:56.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fb59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02fc151bc0 0x7f02fc0ac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:56.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fb59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02fc11f460 con 0x7f02fc0b5cb0 2020-05-18T21:32:56.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fb59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02fc0b4f10 con 0x7f02fc0b6410 2020-05-18T21:32:56.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fb59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0b4c70 con 0x7f02fc151bc0 2020-05-18T21:32:56.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fad9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f02fc0b5cb0 0x7f02fc0b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:56.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fad9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f02fc0b5cb0 0x7f02fc0b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59582/0 (socket says 172.21.15.63:59582) 2020-05-18T21:32:56.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fad9d700 1 -- 172.21.15.63:0/1228434458 learned_addr learned my addr 172.21.15.63:0/1228434458 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:56.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fa59c700 1 --2- 172.21.15.63:0/1228434458 >> v2:172.21.15.155:3300/0 conn(0x7f02fc0b6410 0x7f02fc123410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:56.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f03008cf700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02fc151bc0 0x7f02fc0ac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:56.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fad9d700 1 -- 172.21.15.63:0/1228434458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02fc151bc0 msgr2=0x7f02fc0ac6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:56.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fad9d700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02fc151bc0 0x7f02fc0ac6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:56.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fad9d700 1 -- 172.21.15.63:0/1228434458 >> v2:172.21.15.155:3300/0 conn(0x7f02fc0b6410 msgr2=0x7f02fc123410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:56.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fad9d700 1 --2- 172.21.15.63:0/1228434458 >> v2:172.21.15.155:3300/0 conn(0x7f02fc0b6410 0x7f02fc123410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:56.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fad9d700 1 -- 172.21.15.63:0/1228434458 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02fc0b4260 con 0x7f02fc0b5cb0 2020-05-18T21:32:56.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fad9d700 1 --2- 172.21.15.63:0/1228434458 >> v2:172.21.15.63:3300/0 conn(0x7f02fc0b5cb0 0x7f02fc0b4770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f02ec0030b0 tx=0x7f02ec010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fad9d700 1 --2- 172.21.15.63:0/1228434458 >> v2:172.21.15.63:3300/0 conn(0x7f02fc0b5cb0 0x7f02fc0b4770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f02ec0030b0 tx=0x7f02ec010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.253+0000 7f02fad9d700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02fc0b5cb0 0x7f02fc0b4770 secure :-1 s=READY pgs=1264 cs=0 l=1 rx=0x7f02ec0030b0 tx=0x7f02ec010d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:56.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.257+0000 7f02fad9d700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02fc0b5cb0 0x7f02fc0b4770 secure :-1 s=THROTTLE_DONE pgs=1264 cs=0 l=1 rx=0x7f02ec0030b0 tx=0x7f02ec010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.257+0000 7f02f37fe700 1 -- 172.21.15.63:0/1228434458 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02ec007180 con 0x7f02fc0b5cb0 2020-05-18T21:32:56.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.257+0000 7f02fad9d700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02fc0b5cb0 0x7f02fc0b4770 secure :-1 s=THROTTLE_DONE pgs=1264 cs=0 l=1 rx=0x7f02ec0030b0 tx=0x7f02ec010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.257+0000 7f02f37fe700 1 -- 172.21.15.63:0/1228434458 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec0072e0 con 0x7f02fc0b5cb0 2020-05-18T21:32:56.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.257+0000 7f02fad9d700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02fc0b5cb0 0x7f02fc0b4770 secure :-1 s=THROTTLE_DONE pgs=1264 cs=0 l=1 rx=0x7f02ec0030b0 tx=0x7f02ec010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.257+0000 7f02fb59e700 1 -- 172.21.15.63:0/1228434458 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02fc0acb50 con 0x7f02fc0b5cb0 2020-05-18T21:32:56.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.257+0000 7f02f37fe700 1 -- 172.21.15.63:0/1228434458 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02ec0123e0 con 0x7f02fc0b5cb0 2020-05-18T21:32:56.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.257+0000 7f02fb59e700 1 -- 172.21.15.63:0/1228434458 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02fc0b2ea0 con 0x7f02fc0b5cb0 2020-05-18T21:32:56.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.257+0000 7f02fad9d700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02fc0b5cb0 0x7f02fc0b4770 secure :-1 s=THROTTLE_DONE pgs=1264 cs=0 l=1 rx=0x7f02ec0030b0 tx=0x7f02ec010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.257+0000 7f02fb59e700 1 -- 172.21.15.63:0/1228434458 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02fc0569e0 con 0x7f02fc0b5cb0 2020-05-18T21:32:56.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.257+0000 7f02f37fe700 1 -- 172.21.15.63:0/1228434458 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f02ec012620 con 0x7f02fc0b5cb0 2020-05-18T21:32:56.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.257+0000 7f02fad9d700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02fc0b5cb0 0x7f02fc0b4770 secure :-1 s=THROTTLE_DONE pgs=1264 cs=0 l=1 rx=0x7f02ec0030b0 tx=0x7f02ec010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.257+0000 7f02f37fe700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f02e004fa00 0x7f02e0051ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:56.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.257+0000 7f02f37fe700 1 -- 172.21.15.63:0/1228434458 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f02ec064300 con 0x7f02fc0b5cb0 2020-05-18T21:32:56.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.257+0000 7f02fa59c700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f02e004fa00 0x7f02e0051ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:56.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.257+0000 7f02fa59c700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f02e004fa00 0x7f02e0051ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f02e4001110 tx=0x7f02e40017d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.257+0000 7f02fa59c700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f02e004fa00 0x7f02e0051ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f02e4001110 tx=0x7f02e40017d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.257+0000 7f02fa59c700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f02e004fa00 0x7f02e0051ec0 secure :-1 s=READY pgs=502 cs=0 l=1 rx=0x7f02e4001110 tx=0x7f02e40017d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:56.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.261+0000 7f02fad9d700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02fc0b5cb0 0x7f02fc0b4770 secure :-1 s=THROTTLE_DONE pgs=1264 cs=0 l=1 rx=0x7f02ec0030b0 tx=0x7f02ec010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.261+0000 7f02f37fe700 1 -- 172.21.15.63:0/1228434458 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f02ec03e6f0 con 0x7f02fc0b5cb0 2020-05-18T21:32:56.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.413+0000 7f02fb59e700 1 -- 172.21.15.63:0/1228434458 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f02fc0b9310 con 0x7f02fc0b5cb0 2020-05-18T21:32:56.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.421+0000 7f02fad9d700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02fc0b5cb0 0x7f02fc0b4770 secure :-1 s=THROTTLE_DONE pgs=1264 cs=0 l=1 rx=0x7f02ec0030b0 tx=0x7f02ec010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.421+0000 7f02f37fe700 1 -- 172.21.15.63:0/1228434458 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v37) v1 ==== 184+0+0 (secure 0 0 0) 0x7f02ec041d10 con 0x7f02fc0b5cb0 2020-05-18T21:32:56.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.425+0000 7f02fb59e700 1 -- 172.21.15.63:0/1228434458 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f02e004fa00 msgr2=0x7f02e0051ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:56.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.425+0000 7f02fb59e700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f02e004fa00 0x7f02e0051ec0 secure :-1 s=READY pgs=502 cs=0 l=1 rx=0x7f02e4001110 tx=0x7f02e40017d0).stop 2020-05-18T21:32:56.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.425+0000 7f02fb59e700 1 -- 172.21.15.63:0/1228434458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02fc0b5cb0 msgr2=0x7f02fc0b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:56.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.425+0000 7f02fb59e700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02fc0b5cb0 0x7f02fc0b4770 secure :-1 s=READY pgs=1264 cs=0 l=1 rx=0x7f02ec0030b0 tx=0x7f02ec010d80).stop 2020-05-18T21:32:56.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.425+0000 7f02fb59e700 1 -- 172.21.15.63:0/1228434458 shutdown_connections 2020-05-18T21:32:56.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.425+0000 7f02fb59e700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f02e004fa00 0x7f02e0051ec0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:56.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.425+0000 7f02fb59e700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02fc151bc0 0x7f02fc0ac6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:56.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.425+0000 7f02fb59e700 1 --2- 172.21.15.63:0/1228434458 >> v2:172.21.15.155:3300/0 conn(0x7f02fc0b6410 0x7f02fc123410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:56.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.425+0000 7f02fb59e700 1 --2- 172.21.15.63:0/1228434458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02fc0b5cb0 0x7f02fc0b4770 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:56.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.425+0000 7f02fb59e700 1 -- 172.21.15.63:0/1228434458 >> 172.21.15.63:0/1228434458 conn(0x7f02fc069b70 msgr2=0x7f02fc0b88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:56.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.425+0000 7f02fb59e700 1 -- 172.21.15.63:0/1228434458 shutdown_connections 2020-05-18T21:32:56.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.425+0000 7f02fb59e700 1 -- 172.21.15.63:0/1228434458 wait complete. 2020-05-18T21:32:56.433 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.2 2020-05-18T21:32:56.442 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:32:56.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.549+0000 7f965f59e700 1 Processor -- start 2020-05-18T21:32:56.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.549+0000 7f965f59e700 1 -- start start 2020-05-18T21:32:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.549+0000 7f965f59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f96600b6410 0x7f96600b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.549+0000 7f965f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96600b5cb0 0x7f9660061af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.549+0000 7f965f59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9660025500 con 0x7f9660151bc0 2020-05-18T21:32:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.549+0000 7f965f59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9660064ee0 con 0x7f96600b6410 2020-05-18T21:32:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.549+0000 7f965f59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96600b67f0 con 0x7f96600b5cb0 2020-05-18T21:32:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.549+0000 7f965e59c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96600b5cb0 0x7f9660061af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.549+0000 7f965ed9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f96600b6410 0x7f96600b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.549+0000 7f965e59c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96600b5cb0 0x7f9660061af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:50294/0 (socket says 172.21.15.63:50294) 2020-05-18T21:32:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.549+0000 7f965e59c700 1 -- 172.21.15.63:0/3910142741 learned_addr learned my addr 172.21.15.63:0/3910142741 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.549+0000 7f965dd9b700 1 -- 172.21.15.63:0/3910142741 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493216926 0 0) 0x7f9660025500 con 0x7f9660151bc0 2020-05-18T21:32:56.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.549+0000 7f965dd9b700 1 -- 172.21.15.63:0/3910142741 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9648003270 con 0x7f9660151bc0 2020-05-18T21:32:56.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.549+0000 7f965ed9d700 1 -- 172.21.15.63:0/3910142741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96600b5cb0 msgr2=0x7f9660061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:56.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.549+0000 7f965ed9d700 1 --2- 172.21.15.63:0/3910142741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96600b5cb0 0x7f9660061af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:56.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.549+0000 7f965ed9d700 1 -- 172.21.15.63:0/3910142741 >> v1:172.21.15.155:6789/0 conn(0x7f9660151bc0 legacy=0x7f9660152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:56.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.549+0000 7f965ed9d700 1 -- 172.21.15.63:0/3910142741 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9660025180 con 0x7f96600b6410 2020-05-18T21:32:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.549+0000 7f965e59c700 1 --2- 172.21.15.63:0/3910142741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96600b5cb0 0x7f9660061af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.553+0000 7f965ed9d700 1 --2- 172.21.15.63:0/3910142741 >> v2:172.21.15.155:3300/0 conn(0x7f96600b6410 0x7f96600b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9650002f70 tx=0x7f9650007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.553+0000 7f965ed9d700 1 --2- 172.21.15.63:0/3910142741 >> v2:172.21.15.155:3300/0 conn(0x7f96600b6410 0x7f96600b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9650002f70 tx=0x7f9650007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.553+0000 7f965ed9d700 1 --2- 172.21.15.63:0/3910142741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96600b6410 0x7f96600b6cd0 secure :-1 s=READY pgs=877 cs=0 l=1 rx=0x7f9650002f70 tx=0x7f9650007a80).ready entity=mon.1 client_cookie=ea0b1a3fd5a7d70f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.553+0000 7f965ed9d700 1 --2- 172.21.15.63:0/3910142741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96600b6410 0x7f96600b6cd0 secure :-1 s=THROTTLE_DONE pgs=877 cs=0 l=1 rx=0x7f9650002f70 tx=0x7f9650007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.553+0000 7f965ed9d700 1 --2- 172.21.15.63:0/3910142741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96600b6410 0x7f96600b6cd0 secure :-1 s=THROTTLE_DONE pgs=877 cs=0 l=1 rx=0x7f9650002f70 tx=0x7f9650007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.553+0000 7f965dd9b700 1 -- 172.21.15.63:0/3910142741 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9650008e80 con 0x7f96600b6410 2020-05-18T21:32:56.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.553+0000 7f965ed9d700 1 --2- 172.21.15.63:0/3910142741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96600b6410 0x7f96600b6cd0 secure :-1 s=THROTTLE_DONE pgs=877 cs=0 l=1 rx=0x7f9650002f70 tx=0x7f9650007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.553+0000 7f965dd9b700 1 -- 172.21.15.63:0/3910142741 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9650011540 con 0x7f96600b6410 2020-05-18T21:32:56.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.553+0000 7f965dd9b700 1 -- 172.21.15.63:0/3910142741 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9650011960 con 0x7f96600b6410 2020-05-18T21:32:56.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.553+0000 7f965f59e700 1 -- 172.21.15.63:0/3910142741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96600b6410 msgr2=0x7f96600b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:56.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.553+0000 7f965f59e700 1 --2- 172.21.15.63:0/3910142741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96600b6410 0x7f96600b6cd0 secure :-1 s=READY pgs=877 cs=0 l=1 rx=0x7f9650002f70 tx=0x7f9650007a80).stop 2020-05-18T21:32:56.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.553+0000 7f965f59e700 1 -- 172.21.15.63:0/3910142741 shutdown_connections 2020-05-18T21:32:56.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.553+0000 7f965f59e700 1 --2- 172.21.15.63:0/3910142741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96600b5cb0 0x7f9660061af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:56.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.553+0000 7f965f59e700 1 --2- 172.21.15.63:0/3910142741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96600b6410 0x7f96600b6cd0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:56.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.553+0000 7f965f59e700 1 -- 172.21.15.63:0/3910142741 >> 172.21.15.63:0/3910142741 conn(0x7f9660069b70 msgr2=0x7f9660069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:56.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.553+0000 7f965f59e700 1 -- 172.21.15.63:0/3910142741 shutdown_connections 2020-05-18T21:32:56.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.553+0000 7f965f59e700 1 -- 172.21.15.63:0/3910142741 wait complete. 2020-05-18T21:32:56.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f965f59e700 1 Processor -- start 2020-05-18T21:32:56.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f965f59e700 1 -- start start 2020-05-18T21:32:56.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f965f59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9660151bc0 0x7f96600628f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:56.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f965f59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9660062d50 con 0x7f96600b5cb0 2020-05-18T21:32:56.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f965f59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9660074510 con 0x7f96600b6410 2020-05-18T21:32:56.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f965f59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9660074330 con 0x7f9660151bc0 2020-05-18T21:32:56.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f9664e95700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9660151bc0 0x7f96600628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:56.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f9664e95700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9660151bc0 0x7f96600628f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59600/0 (socket says 172.21.15.63:59600) 2020-05-18T21:32:56.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f9664e95700 1 -- 172.21.15.63:0/3333303092 learned_addr learned my addr 172.21.15.63:0/3333303092 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:56.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f9664e95700 1 -- 172.21.15.63:0/3333303092 >> v1:172.21.15.155:6789/0 conn(0x7f96600b6410 legacy=0x7f9660124a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:56.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f9664e95700 1 -- 172.21.15.63:0/3333303092 >> v1:172.21.15.63:6789/0 conn(0x7f96600b5cb0 legacy=0x7f9660073b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:56.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f9664e95700 1 -- 172.21.15.63:0/3333303092 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96600747b0 con 0x7f9660151bc0 2020-05-18T21:32:56.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f9664e95700 1 --2- 172.21.15.63:0/3333303092 >> v2:172.21.15.63:3300/0 conn(0x7f9660151bc0 0x7f96600628f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9658001490 tx=0x7f9658010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f9664e95700 1 --2- 172.21.15.63:0/3333303092 >> v2:172.21.15.63:3300/0 conn(0x7f9660151bc0 0x7f96600628f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9658001490 tx=0x7f9658010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f9664e95700 1 --2- 172.21.15.63:0/3333303092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9660151bc0 0x7f96600628f0 secure :-1 s=READY pgs=1266 cs=0 l=1 rx=0x7f9658001490 tx=0x7f9658010dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:56.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f9664e95700 1 --2- 172.21.15.63:0/3333303092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9660151bc0 0x7f96600628f0 secure :-1 s=THROTTLE_DONE pgs=1266 cs=0 l=1 rx=0x7f9658001490 tx=0x7f9658010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f964f7fe700 1 -- 172.21.15.63:0/3333303092 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9658012430 con 0x7f9660151bc0 2020-05-18T21:32:56.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f9664e95700 1 --2- 172.21.15.63:0/3333303092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9660151bc0 0x7f96600628f0 secure :-1 s=THROTTLE_DONE pgs=1266 cs=0 l=1 rx=0x7f9658001490 tx=0x7f9658010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f9664e95700 1 --2- 172.21.15.63:0/3333303092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9660151bc0 0x7f96600628f0 secure :-1 s=THROTTLE_DONE pgs=1266 cs=0 l=1 rx=0x7f9658001490 tx=0x7f9658010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f964f7fe700 1 -- 172.21.15.63:0/3333303092 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9658012590 con 0x7f9660151bc0 2020-05-18T21:32:56.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f965f59e700 1 -- 172.21.15.63:0/3333303092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9660074a50 con 0x7f9660151bc0 2020-05-18T21:32:56.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f964f7fe700 1 -- 172.21.15.63:0/3333303092 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96580129b0 con 0x7f9660151bc0 2020-05-18T21:32:56.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.557+0000 7f965f59e700 1 -- 172.21.15.63:0/3333303092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9660128020 con 0x7f9660151bc0 2020-05-18T21:32:56.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.561+0000 7f9664e95700 1 --2- 172.21.15.63:0/3333303092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9660151bc0 0x7f96600628f0 secure :-1 s=THROTTLE_DONE pgs=1266 cs=0 l=1 rx=0x7f9658001490 tx=0x7f9658010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.561+0000 7f965f59e700 1 -- 172.21.15.63:0/3333303092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96600569e0 con 0x7f9660151bc0 2020-05-18T21:32:56.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.561+0000 7f964f7fe700 1 -- 172.21.15.63:0/3333303092 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9658012c20 con 0x7f9660151bc0 2020-05-18T21:32:56.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.561+0000 7f9664e95700 1 --2- 172.21.15.63:0/3333303092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9660151bc0 0x7f96600628f0 secure :-1 s=THROTTLE_DONE pgs=1266 cs=0 l=1 rx=0x7f9658001490 tx=0x7f9658010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.561+0000 7f964f7fe700 1 --2- 172.21.15.63:0/3333303092 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f964404f980 0x7f9644051e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:56.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.561+0000 7f964f7fe700 1 -- 172.21.15.63:0/3333303092 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9658063eb0 con 0x7f9660151bc0 2020-05-18T21:32:56.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.561+0000 7f965ed9d700 1 --2- 172.21.15.63:0/3333303092 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f964404f980 0x7f9644051e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:56.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.561+0000 7f965ed9d700 1 --2- 172.21.15.63:0/3333303092 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f964404f980 0x7f9644051e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96600641a0 tx=0x7f9650007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.561+0000 7f965ed9d700 1 --2- 172.21.15.63:0/3333303092 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f964404f980 0x7f9644051e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96600641a0 tx=0x7f9650007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.561+0000 7f965ed9d700 1 --2- 172.21.15.63:0/3333303092 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f964404f980 0x7f9644051e40 secure :-1 s=READY pgs=503 cs=0 l=1 rx=0x7f96600641a0 tx=0x7f9650007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:56.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.565+0000 7f9664e95700 1 --2- 172.21.15.63:0/3333303092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9660151bc0 0x7f96600628f0 secure :-1 s=THROTTLE_DONE pgs=1266 cs=0 l=1 rx=0x7f9658001490 tx=0x7f9658010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.565+0000 7f964f7fe700 1 -- 172.21.15.63:0/3333303092 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f965803e240 con 0x7f9660151bc0 2020-05-18T21:32:56.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.717+0000 7f965f59e700 1 -- 172.21.15.63:0/3333303092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f96600008d0 con 0x7f9660151bc0 2020-05-18T21:32:56.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.721+0000 7f9664e95700 1 --2- 172.21.15.63:0/3333303092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9660151bc0 0x7f96600628f0 secure :-1 s=THROTTLE_DONE pgs=1266 cs=0 l=1 rx=0x7f9658001490 tx=0x7f9658010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.721+0000 7f964f7fe700 1 -- 172.21.15.63:0/3333303092 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v38) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9658041860 con 0x7f9660151bc0 2020-05-18T21:32:56.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.725+0000 7f965f59e700 1 -- 172.21.15.63:0/3333303092 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f964404f980 msgr2=0x7f9644051e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:56.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.725+0000 7f965f59e700 1 --2- 172.21.15.63:0/3333303092 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f964404f980 0x7f9644051e40 secure :-1 s=READY pgs=503 cs=0 l=1 rx=0x7f96600641a0 tx=0x7f9650007a80).stop 2020-05-18T21:32:56.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.725+0000 7f965f59e700 1 -- 172.21.15.63:0/3333303092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9660151bc0 msgr2=0x7f96600628f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:56.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.725+0000 7f965f59e700 1 --2- 172.21.15.63:0/3333303092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9660151bc0 0x7f96600628f0 secure :-1 s=READY pgs=1266 cs=0 l=1 rx=0x7f9658001490 tx=0x7f9658010dd0).stop 2020-05-18T21:32:56.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.725+0000 7f965f59e700 1 -- 172.21.15.63:0/3333303092 shutdown_connections 2020-05-18T21:32:56.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.725+0000 7f965f59e700 1 --2- 172.21.15.63:0/3333303092 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f964404f980 0x7f9644051e40 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:56.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.725+0000 7f965f59e700 1 --2- 172.21.15.63:0/3333303092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9660151bc0 0x7f96600628f0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:56.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.725+0000 7f965f59e700 1 -- 172.21.15.63:0/3333303092 >> 172.21.15.63:0/3333303092 conn(0x7f9660069b70 msgr2=0x7f9660024770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:56.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.725+0000 7f965f59e700 1 -- 172.21.15.63:0/3333303092 shutdown_connections 2020-05-18T21:32:56.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.725+0000 7f965f59e700 1 -- 172.21.15.63:0/3333303092 wait complete. 2020-05-18T21:32:56.732 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.3 2020-05-18T21:32:56.741 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:56.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.841+0000 7f43bb59e700 1 Processor -- start 2020-05-18T21:32:56.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.841+0000 7f43bb59e700 1 -- start start 2020-05-18T21:32:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.841+0000 7f43bb59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f43bc05f110 0x7f43bc0b2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.841+0000 7f43bb59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43bc0b81b0 0x7f43bc12ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.841+0000 7f43bb59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f43bc12bec0 0x7f43bc149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.841+0000 7f43bb59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc0b8650 con 0x7f43bc05f110 2020-05-18T21:32:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.841+0000 7f43bb59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc0b88f0 con 0x7f43bc12bec0 2020-05-18T21:32:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.841+0000 7f43bb59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0b8b90 con 0x7f43bc0b81b0 2020-05-18T21:32:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43ba59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f43bc05f110 0x7f43bc0b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43ba59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f43bc05f110 0x7f43bc0b2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59606/0 (socket says 172.21.15.63:59606) 2020-05-18T21:32:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43ba59c700 1 -- 172.21.15.63:0/342880140 learned_addr learned my addr 172.21.15.63:0/342880140 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:56.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43b3fff700 1 --2- 172.21.15.63:0/342880140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43bc0b81b0 0x7f43bc12ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:56.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43bad9d700 1 --2- 172.21.15.63:0/342880140 >> v2:172.21.15.155:3300/0 conn(0x7f43bc12bec0 0x7f43bc149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:56.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43ba59c700 1 -- 172.21.15.63:0/342880140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43bc0b81b0 msgr2=0x7f43bc12ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:56.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43ba59c700 1 --2- 172.21.15.63:0/342880140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43bc0b81b0 0x7f43bc12ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:56.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43ba59c700 1 -- 172.21.15.63:0/342880140 >> v2:172.21.15.155:3300/0 conn(0x7f43bc12bec0 msgr2=0x7f43bc149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:56.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43ba59c700 1 --2- 172.21.15.63:0/342880140 >> v2:172.21.15.155:3300/0 conn(0x7f43bc12bec0 0x7f43bc149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:56.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43ba59c700 1 -- 172.21.15.63:0/342880140 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc0b9030 con 0x7f43bc05f110 2020-05-18T21:32:56.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43bad9d700 1 --2- 172.21.15.63:0/342880140 >> v2:172.21.15.155:3300/0 conn(0x7f43bc12bec0 0x7f43bc149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:32:56.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43ba59c700 1 --2- 172.21.15.63:0/342880140 >> v2:172.21.15.63:3300/0 conn(0x7f43bc05f110 0x7f43bc0b2940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f43ac002f70 tx=0x7f43ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43ba59c700 1 --2- 172.21.15.63:0/342880140 >> v2:172.21.15.63:3300/0 conn(0x7f43bc05f110 0x7f43bc0b2940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f43ac002f70 tx=0x7f43ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43ba59c700 1 --2- 172.21.15.63:0/342880140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43bc05f110 0x7f43bc0b2940 secure :-1 s=READY pgs=1267 cs=0 l=1 rx=0x7f43ac002f70 tx=0x7f43ac007a80).ready entity=mon.0 client_cookie=ea500274ac6615a8 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:56.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43ba59c700 1 --2- 172.21.15.63:0/342880140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43bc05f110 0x7f43bc0b2940 secure :-1 s=THROTTLE_DONE pgs=1267 cs=0 l=1 rx=0x7f43ac002f70 tx=0x7f43ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43b9d9b700 1 -- 172.21.15.63:0/342880140 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43ac0116b0 con 0x7f43bc05f110 2020-05-18T21:32:56.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43ba59c700 1 --2- 172.21.15.63:0/342880140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43bc05f110 0x7f43bc0b2940 secure :-1 s=THROTTLE_DONE pgs=1267 cs=0 l=1 rx=0x7f43ac002f70 tx=0x7f43ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43b9d9b700 1 -- 172.21.15.63:0/342880140 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac011810 con 0x7f43bc05f110 2020-05-18T21:32:56.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43ba59c700 1 --2- 172.21.15.63:0/342880140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43bc05f110 0x7f43bc0b2940 secure :-1 s=THROTTLE_DONE pgs=1267 cs=0 l=1 rx=0x7f43ac002f70 tx=0x7f43ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43bb59e700 1 -- 172.21.15.63:0/342880140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43bc05f110 msgr2=0x7f43bc0b2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:56.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43b9d9b700 1 -- 172.21.15.63:0/342880140 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43ac011c30 con 0x7f43bc05f110 2020-05-18T21:32:56.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43bb59e700 1 --2- 172.21.15.63:0/342880140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43bc05f110 0x7f43bc0b2940 secure :-1 s=READY pgs=1267 cs=0 l=1 rx=0x7f43ac002f70 tx=0x7f43ac007a80).stop 2020-05-18T21:32:56.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43bb59e700 1 -- 172.21.15.63:0/342880140 shutdown_connections 2020-05-18T21:32:56.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43bb59e700 1 --2- 172.21.15.63:0/342880140 >> v2:172.21.15.155:3300/0 conn(0x7f43bc12bec0 0x7f43bc149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:56.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43bb59e700 1 --2- 172.21.15.63:0/342880140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43bc0b81b0 0x7f43bc12ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:56.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43bb59e700 1 --2- 172.21.15.63:0/342880140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43bc05f110 0x7f43bc0b2940 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:56.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43bb59e700 1 -- 172.21.15.63:0/342880140 >> 172.21.15.63:0/342880140 conn(0x7f43bc069fc0 msgr2=0x7f43bc06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:56.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43bb59e700 1 -- 172.21.15.63:0/342880140 shutdown_connections 2020-05-18T21:32:56.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43bb59e700 1 -- 172.21.15.63:0/342880140 wait complete. 2020-05-18T21:32:56.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.845+0000 7f43bb59e700 1 Processor -- start 2020-05-18T21:32:56.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43bb59e700 1 -- start start 2020-05-18T21:32:56.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43bb59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f43bc05f110 0x7f43bc064a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:56.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43bb59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f43bc12bec0 0x7f43bc062280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:56.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43bb59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43bc1530e0 con 0x7f43bc0b81b0 2020-05-18T21:32:56.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43bb59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc065570 con 0x7f43bc05f110 2020-05-18T21:32:56.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43bb59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc0626e0 con 0x7f43bc12bec0 2020-05-18T21:32:56.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43ba59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f43bc05f110 0x7f43bc064a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:56.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43ba59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f43bc05f110 0x7f43bc064a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59610/0 (socket says 172.21.15.63:59610) 2020-05-18T21:32:56.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43ba59c700 1 -- 172.21.15.63:0/2368513142 learned_addr learned my addr 172.21.15.63:0/2368513142 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:56.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43bad9d700 1 --2- 172.21.15.63:0/2368513142 >> v2:172.21.15.155:3300/0 conn(0x7f43bc12bec0 0x7f43bc062280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:56.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43ba59c700 1 -- 172.21.15.63:0/2368513142 >> v2:172.21.15.155:3300/0 conn(0x7f43bc12bec0 msgr2=0x7f43bc062280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:56.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43b37fe700 1 -- 172.21.15.63:0/2368513142 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2523047625 0 0) 0x7f43bc1530e0 con 0x7f43bc0b81b0 2020-05-18T21:32:56.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43ba59c700 1 --2- 172.21.15.63:0/2368513142 >> v2:172.21.15.155:3300/0 conn(0x7f43bc12bec0 0x7f43bc062280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:56.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43ba59c700 1 -- 172.21.15.63:0/2368513142 >> v1:172.21.15.63:6789/0 conn(0x7f43bc0b81b0 legacy=0x7f43bc0640d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:56.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43ba59c700 1 -- 172.21.15.63:0/2368513142 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc153360 con 0x7f43bc05f110 2020-05-18T21:32:56.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43ba59c700 1 --2- 172.21.15.63:0/2368513142 >> v2:172.21.15.63:3300/0 conn(0x7f43bc05f110 0x7f43bc064a60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43ac002f70 tx=0x7f43ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43ba59c700 1 --2- 172.21.15.63:0/2368513142 >> v2:172.21.15.63:3300/0 conn(0x7f43bc05f110 0x7f43bc064a60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43ac002f70 tx=0x7f43ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43ba59c700 1 --2- 172.21.15.63:0/2368513142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43bc05f110 0x7f43bc064a60 secure :-1 s=READY pgs=1269 cs=0 l=1 rx=0x7f43ac002f70 tx=0x7f43ac007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:56.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43ba59c700 1 --2- 172.21.15.63:0/2368513142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43bc05f110 0x7f43bc064a60 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7f43ac002f70 tx=0x7f43ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43b37fe700 1 -- 172.21.15.63:0/2368513142 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43ac007360 con 0x7f43bc05f110 2020-05-18T21:32:56.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43bb59e700 1 -- 172.21.15.63:0/2368513142 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43bc153660 con 0x7f43bc05f110 2020-05-18T21:32:56.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43ba59c700 1 --2- 172.21.15.63:0/2368513142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43bc05f110 0x7f43bc064a60 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7f43ac002f70 tx=0x7f43ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43ba59c700 1 --2- 172.21.15.63:0/2368513142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43bc05f110 0x7f43bc064a60 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7f43ac002f70 tx=0x7f43ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43b37fe700 1 -- 172.21.15.63:0/2368513142 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac0074c0 con 0x7f43bc05f110 2020-05-18T21:32:56.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43bb59e700 1 -- 172.21.15.63:0/2368513142 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43bc153e10 con 0x7f43bc05f110 2020-05-18T21:32:56.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43b37fe700 1 -- 172.21.15.63:0/2368513142 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43ac0058f0 con 0x7f43bc05f110 2020-05-18T21:32:56.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.849+0000 7f43ba59c700 1 --2- 172.21.15.63:0/2368513142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43bc05f110 0x7f43bc064a60 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7f43ac002f70 tx=0x7f43ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.853+0000 7f43bb59e700 1 -- 172.21.15.63:0/2368513142 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43bc154120 con 0x7f43bc05f110 2020-05-18T21:32:56.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.853+0000 7f43b37fe700 1 -- 172.21.15.63:0/2368513142 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f43ac005af0 con 0x7f43bc05f110 2020-05-18T21:32:56.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.853+0000 7f43ba59c700 1 --2- 172.21.15.63:0/2368513142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43bc05f110 0x7f43bc064a60 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7f43ac002f70 tx=0x7f43ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.853+0000 7f43b37fe700 1 --2- 172.21.15.63:0/2368513142 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f43a004f8f0 0x7f43a0051db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:56.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.853+0000 7f43b37fe700 1 -- 172.21.15.63:0/2368513142 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f43ac0642c0 con 0x7f43bc05f110 2020-05-18T21:32:56.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.853+0000 7f43b3fff700 1 --2- 172.21.15.63:0/2368513142 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f43a004f8f0 0x7f43a0051db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:56.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.853+0000 7f43b3fff700 1 --2- 172.21.15.63:0/2368513142 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f43a004f8f0 0x7f43a0051db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43a4002f10 tx=0x7f43a40098f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.853+0000 7f43b3fff700 1 --2- 172.21.15.63:0/2368513142 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f43a004f8f0 0x7f43a0051db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43a4002f10 tx=0x7f43a40098f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.853+0000 7f43b3fff700 1 --2- 172.21.15.63:0/2368513142 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f43a004f8f0 0x7f43a0051db0 secure :-1 s=READY pgs=504 cs=0 l=1 rx=0x7f43a4002f10 tx=0x7f43a40098f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:56.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.861+0000 7f43ba59c700 1 --2- 172.21.15.63:0/2368513142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43bc05f110 0x7f43bc064a60 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7f43ac002f70 tx=0x7f43ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:56.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:56.861+0000 7f43b37fe700 1 -- 172.21.15.63:0/2368513142 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f43ac03e770 con 0x7f43bc05f110 2020-05-18T21:32:57.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.013+0000 7f43bb59e700 1 -- 172.21.15.63:0/2368513142 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43bc0569e0 con 0x7f43bc05f110 2020-05-18T21:32:57.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.013+0000 7f43ba59c700 1 --2- 172.21.15.63:0/2368513142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43bc05f110 0x7f43bc064a60 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7f43ac002f70 tx=0x7f43ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.013+0000 7f43b37fe700 1 -- 172.21.15.63:0/2368513142 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f43ac041d90 con 0x7f43bc05f110 2020-05-18T21:32:57.017 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:57.018 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":75,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2619292063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2619292063},{"type":"v1","addr":"172.21.15.155:6835","nonce":2619292063}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:32:53.188564+0000","modified":"2020-05-18T21:32:54.910500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7842},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7842":{"gid":7842,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/468101601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":468101601},{"type":"v1","addr":"172.21.15.63:6833","nonce":468101601}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-05-18T21:32:57.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.013+0000 7f43bb59e700 1 -- 172.21.15.63:0/2368513142 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f43a004f8f0 msgr2=0x7f43a0051db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:57.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.013+0000 7f43bb59e700 1 --2- 172.21.15.63:0/2368513142 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f43a004f8f0 0x7f43a0051db0 secure :-1 s=READY pgs=504 cs=0 l=1 rx=0x7f43a4002f10 tx=0x7f43a40098f0).stop 2020-05-18T21:32:57.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.013+0000 7f43bb59e700 1 -- 172.21.15.63:0/2368513142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43bc05f110 msgr2=0x7f43bc064a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:57.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.013+0000 7f43bb59e700 1 --2- 172.21.15.63:0/2368513142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43bc05f110 0x7f43bc064a60 secure :-1 s=READY pgs=1269 cs=0 l=1 rx=0x7f43ac002f70 tx=0x7f43ac007a80).stop 2020-05-18T21:32:57.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.013+0000 7f43bb59e700 1 -- 172.21.15.63:0/2368513142 shutdown_connections 2020-05-18T21:32:57.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.013+0000 7f43bb59e700 1 --2- 172.21.15.63:0/2368513142 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f43a004f8f0 0x7f43a0051db0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:57.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.013+0000 7f43bb59e700 1 --2- 172.21.15.63:0/2368513142 >> v2:172.21.15.155:3300/0 conn(0x7f43bc12bec0 0x7f43bc062280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:57.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.013+0000 7f43bb59e700 1 --2- 172.21.15.63:0/2368513142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43bc05f110 0x7f43bc064a60 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:57.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.013+0000 7f43bb59e700 1 -- 172.21.15.63:0/2368513142 >> 172.21.15.63:0/2368513142 conn(0x7f43bc069fc0 msgr2=0x7f43bc148c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:57.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.013+0000 7f43bb59e700 1 -- 172.21.15.63:0/2368513142 shutdown_connections 2020-05-18T21:32:57.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.013+0000 7f43bb59e700 1 -- 172.21.15.63:0/2368513142 wait complete. 2020-05-18T21:32:57.021 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 75 2020-05-18T21:32:57.232 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:32:53.188564+0000', 'modified': '2020-05-18T21:32:54.910500+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7842}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7842': {'gid': 7842, 'name': 'a', 'rank': 0, 'incarnation': 73, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/468101601', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 468101601}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 468101601}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:57.233 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:32:57.233 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:32:57.339 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:32:57.339 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:32:57.339 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:32:57.340 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 7842, 2020-05-18T21:32:57.340 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:32:57.340 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:32:57.340 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 4.1476575210000002, 2020-05-18T21:32:57.340 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 75, 2020-05-18T21:32:57.341 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 95, 2020-05-18T21:32:57.341 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 95, 2020-05-18T21:32:57.341 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 8.3717691789999993 2020-05-18T21:32:57.341 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:32:57.348 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 7842, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.1476575210000002, "mdsmap_epoch": 75, "osdmap_epoch": 95, "osdmap_epoch_barrier": 95, "uptime": 8.3717691789999993 } 2020-05-18T21:32:57.348 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:32:57.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.445+0000 7f8141e66700 1 Processor -- start 2020-05-18T21:32:57.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.445+0000 7f8141e66700 1 -- start start 2020-05-18T21:32:57.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.445+0000 7f8141e66700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f813c0bb5e0 0x7f813c0acee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:57.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.445+0000 7f8141e66700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f813c12efd0 0x7f813c12f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.445+0000 7f8141e66700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813c0af6e0 con 0x7f813c0bbcd0 2020-05-18T21:32:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.445+0000 7f8141e66700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813c0af980 con 0x7f813c0bb5e0 2020-05-18T21:32:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.445+0000 7f8141e66700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813c0b0530 con 0x7f813c12efd0 2020-05-18T21:32:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.445+0000 7f813b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f813c0bb5e0 0x7f813c0acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.445+0000 7f813b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f813c0bb5e0 0x7f813c0acee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59620/0 (socket says 172.21.15.63:59620) 2020-05-18T21:32:57.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.445+0000 7f813b7fe700 1 -- 172.21.15.63:0/1812297913 learned_addr learned my addr 172.21.15.63:0/1812297913 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:57.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.445+0000 7f813bfff700 1 --2- 172.21.15.63:0/1812297913 >> v2:172.21.15.155:3300/0 conn(0x7f813c12efd0 0x7f813c12f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:57.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.445+0000 7f813b7fe700 1 -- 172.21.15.63:0/1812297913 >> v2:172.21.15.155:3300/0 conn(0x7f813c12efd0 msgr2=0x7f813c12f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:57.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.445+0000 7f813b7fe700 1 --2- 172.21.15.63:0/1812297913 >> v2:172.21.15.155:3300/0 conn(0x7f813c12efd0 0x7f813c12f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:57.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.445+0000 7f813b7fe700 1 -- 172.21.15.63:0/1812297913 >> v1:172.21.15.155:6789/0 conn(0x7f813c0bbcd0 legacy=0x7f813c0afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:57.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.445+0000 7f813b7fe700 1 -- 172.21.15.63:0/1812297913 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c0bb9c0 con 0x7f813c0bb5e0 2020-05-18T21:32:57.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.445+0000 7f813b7fe700 1 --2- 172.21.15.63:0/1812297913 >> v2:172.21.15.63:3300/0 conn(0x7f813c0bb5e0 0x7f813c0acee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f812c002f70 tx=0x7f812c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.445+0000 7f813b7fe700 1 --2- 172.21.15.63:0/1812297913 >> v2:172.21.15.63:3300/0 conn(0x7f813c0bb5e0 0x7f813c0acee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f812c002f70 tx=0x7f812c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.445+0000 7f813b7fe700 1 --2- 172.21.15.63:0/1812297913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0bb5e0 0x7f813c0acee0 secure :-1 s=READY pgs=1270 cs=0 l=1 rx=0x7f812c002f70 tx=0x7f812c007a80).ready entity=mon.0 client_cookie=d8f217979810c750 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:57.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f813b7fe700 1 --2- 172.21.15.63:0/1812297913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0bb5e0 0x7f813c0acee0 secure :-1 s=THROTTLE_DONE pgs=1270 cs=0 l=1 rx=0x7f812c002f70 tx=0x7f812c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f813b7fe700 1 --2- 172.21.15.63:0/1812297913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0bb5e0 0x7f813c0acee0 secure :-1 s=THROTTLE_DONE pgs=1270 cs=0 l=1 rx=0x7f812c002f70 tx=0x7f812c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f813a7fc700 1 -- 172.21.15.63:0/1812297913 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f812c0116b0 con 0x7f813c0bb5e0 2020-05-18T21:32:57.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f813b7fe700 1 --2- 172.21.15.63:0/1812297913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0bb5e0 0x7f813c0acee0 secure :-1 s=THROTTLE_DONE pgs=1270 cs=0 l=1 rx=0x7f812c002f70 tx=0x7f812c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f813a7fc700 1 -- 172.21.15.63:0/1812297913 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c011810 con 0x7f813c0bb5e0 2020-05-18T21:32:57.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f813a7fc700 1 -- 172.21.15.63:0/1812297913 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f812c011c30 con 0x7f813c0bb5e0 2020-05-18T21:32:57.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f8141e66700 1 -- 172.21.15.63:0/1812297913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0bb5e0 msgr2=0x7f813c0acee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:57.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f8141e66700 1 --2- 172.21.15.63:0/1812297913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0bb5e0 0x7f813c0acee0 secure :-1 s=READY pgs=1270 cs=0 l=1 rx=0x7f812c002f70 tx=0x7f812c007a80).stop 2020-05-18T21:32:57.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f8141e66700 1 -- 172.21.15.63:0/1812297913 shutdown_connections 2020-05-18T21:32:57.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f8141e66700 1 --2- 172.21.15.63:0/1812297913 >> v2:172.21.15.155:3300/0 conn(0x7f813c12efd0 0x7f813c12f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:57.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f8141e66700 1 --2- 172.21.15.63:0/1812297913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0bb5e0 0x7f813c0acee0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:57.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f8141e66700 1 -- 172.21.15.63:0/1812297913 >> 172.21.15.63:0/1812297913 conn(0x7f813c069b70 msgr2=0x7f813c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:57.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f8141e66700 1 -- 172.21.15.63:0/1812297913 shutdown_connections 2020-05-18T21:32:57.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f8141e66700 1 -- 172.21.15.63:0/1812297913 wait complete. 2020-05-18T21:32:57.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f8141e66700 1 Processor -- start 2020-05-18T21:32:57.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f8141e66700 1 -- start start 2020-05-18T21:32:57.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f8141e66700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f813c0bbcd0 0x7f813c0b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:57.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f8141e66700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f813c12efd0 0x7f813c12cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:57.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f8141e66700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813c0b70d0 con 0x7f813c0bb5e0 2020-05-18T21:32:57.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f8141e66700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813c157980 con 0x7f813c0bbcd0 2020-05-18T21:32:57.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f8141e66700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0b7330 con 0x7f813c12efd0 2020-05-18T21:32:57.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f813affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f813c0bbcd0 0x7f813c0b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:57.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f813b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f813c0bb5e0 0x7f813c1478a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33580/0 (socket says 172.21.15.63:33580) 2020-05-18T21:32:57.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.449+0000 7f813affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f813c0bbcd0 0x7f813c0b5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59626/0 (socket says 172.21.15.63:59626) 2020-05-18T21:32:57.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f813b7fe700 1 -- 172.21.15.63:0/3528062471 learned_addr learned my addr 172.21.15.63:0/3528062471 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:57.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f813bfff700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f813c12efd0 0x7f813c12cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:57.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f813affd700 1 -- 172.21.15.63:0/3528062471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f813c12efd0 msgr2=0x7f813c12cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:57.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f813affd700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f813c12efd0 0x7f813c12cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:57.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f813affd700 1 -- 172.21.15.63:0/3528062471 >> v1:172.21.15.63:6789/0 conn(0x7f813c0bb5e0 legacy=0x7f813c1478a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:57.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f813affd700 1 -- 172.21.15.63:0/3528062471 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c147fb0 con 0x7f813c0bbcd0 2020-05-18T21:32:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f813affd700 1 --2- 172.21.15.63:0/3528062471 >> v2:172.21.15.63:3300/0 conn(0x7f813c0bbcd0 0x7f813c0b5170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f813c0ae780 tx=0x7f8130010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f813affd700 1 --2- 172.21.15.63:0/3528062471 >> v2:172.21.15.63:3300/0 conn(0x7f813c0bbcd0 0x7f813c0b5170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f813c0ae780 tx=0x7f8130010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f813affd700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0bbcd0 0x7f813c0b5170 secure :-1 s=READY pgs=1272 cs=0 l=1 rx=0x7f813c0ae780 tx=0x7f8130010920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f813affd700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0bbcd0 0x7f813c0b5170 secure :-1 s=THROTTLE_DONE pgs=1272 cs=0 l=1 rx=0x7f813c0ae780 tx=0x7f8130010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f8138ff9700 1 -- 172.21.15.63:0/3528062471 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f813000cc40 con 0x7f813c0bbcd0 2020-05-18T21:32:57.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f813affd700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0bbcd0 0x7f813c0b5170 secure :-1 s=THROTTLE_DONE pgs=1272 cs=0 l=1 rx=0x7f813c0ae780 tx=0x7f8130010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f813affd700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0bbcd0 0x7f813c0b5170 secure :-1 s=THROTTLE_DONE pgs=1272 cs=0 l=1 rx=0x7f813c0ae780 tx=0x7f8130010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f8138ff9700 1 -- 172.21.15.63:0/3528062471 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813000cde0 con 0x7f813c0bbcd0 2020-05-18T21:32:57.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f8141e66700 1 -- 172.21.15.63:0/3528062471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813c0b5a40 con 0x7f813c0bbcd0 2020-05-18T21:32:57.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f8138ff9700 1 -- 172.21.15.63:0/3528062471 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8130011100 con 0x7f813c0bbcd0 2020-05-18T21:32:57.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f8141e66700 1 -- 172.21.15.63:0/3528062471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813c1576c0 con 0x7f813c0bbcd0 2020-05-18T21:32:57.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f813affd700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0bbcd0 0x7f813c0b5170 secure :-1 s=THROTTLE_DONE pgs=1272 cs=0 l=1 rx=0x7f813c0ae780 tx=0x7f8130010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f8141e66700 1 -- 172.21.15.63:0/3528062471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813c0569e0 con 0x7f813c0bbcd0 2020-05-18T21:32:57.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f8138ff9700 1 -- 172.21.15.63:0/3528062471 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8130006520 con 0x7f813c0bbcd0 2020-05-18T21:32:57.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f813affd700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0bbcd0 0x7f813c0b5170 secure :-1 s=THROTTLE_DONE pgs=1272 cs=0 l=1 rx=0x7f813c0ae780 tx=0x7f8130010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.453+0000 7f8138ff9700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f811c04f980 0x7f811c051e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:57.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.457+0000 7f8138ff9700 1 -- 172.21.15.63:0/3528062471 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f81300636b0 con 0x7f813c0bbcd0 2020-05-18T21:32:57.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.457+0000 7f813b7fe700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f811c04f980 0x7f811c051e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:57.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.457+0000 7f813b7fe700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f811c04f980 0x7f811c051e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f813c06a710 tx=0x7f812c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.457+0000 7f813b7fe700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f811c04f980 0x7f811c051e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f813c06a710 tx=0x7f812c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.457+0000 7f813b7fe700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f811c04f980 0x7f811c051e40 secure :-1 s=READY pgs=505 cs=0 l=1 rx=0x7f813c06a710 tx=0x7f812c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:57.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.461+0000 7f813affd700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0bbcd0 0x7f813c0b5170 secure :-1 s=THROTTLE_DONE pgs=1272 cs=0 l=1 rx=0x7f813c0ae780 tx=0x7f8130010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.461+0000 7f8138ff9700 1 -- 172.21.15.63:0/3528062471 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f813003da40 con 0x7f813c0bbcd0 2020-05-18T21:32:57.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.581+0000 7f8141e66700 1 -- 172.21.15.63:0/3528062471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f813c0b3580 con 0x7f813c0bbcd0 2020-05-18T21:32:57.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.581+0000 7f813affd700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0bbcd0 0x7f813c0b5170 secure :-1 s=THROTTLE_DONE pgs=1272 cs=0 l=1 rx=0x7f813c0ae780 tx=0x7f8130010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.581+0000 7f8138ff9700 1 -- 172.21.15.63:0/3528062471 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16092 (secure 0 0 0) 0x7f8130041060 con 0x7f813c0bbcd0 2020-05-18T21:32:57.587 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:57.587 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":95,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:32:54.190968+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:32:51.634300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2020-05-18T21:32:52.187431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:32:57.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.585+0000 7f8141e66700 1 -- 172.21.15.63:0/3528062471 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f811c04f980 msgr2=0x7f811c051e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:57.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.585+0000 7f8141e66700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f811c04f980 0x7f811c051e40 secure :-1 s=READY pgs=505 cs=0 l=1 rx=0x7f813c06a710 tx=0x7f812c007a80).stop 2020-05-18T21:32:57.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.585+0000 7f8141e66700 1 -- 172.21.15.63:0/3528062471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0bbcd0 msgr2=0x7f813c0b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:57.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.585+0000 7f8141e66700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0bbcd0 0x7f813c0b5170 secure :-1 s=READY pgs=1272 cs=0 l=1 rx=0x7f813c0ae780 tx=0x7f8130010920).stop 2020-05-18T21:32:57.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.585+0000 7f8141e66700 1 -- 172.21.15.63:0/3528062471 shutdown_connections 2020-05-18T21:32:57.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.585+0000 7f8141e66700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f811c04f980 0x7f811c051e40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:57.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.585+0000 7f8141e66700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f813c12efd0 0x7f813c12cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:57.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.585+0000 7f8141e66700 1 --2- 172.21.15.63:0/3528062471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0bbcd0 0x7f813c0b5170 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:57.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.585+0000 7f8141e66700 1 -- 172.21.15.63:0/3528062471 >> 172.21.15.63:0/3528062471 conn(0x7f813c069b70 msgr2=0x7f813c060590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:57.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.585+0000 7f8141e66700 1 -- 172.21.15.63:0/3528062471 shutdown_connections 2020-05-18T21:32:57.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.585+0000 7f8141e66700 1 -- 172.21.15.63:0/3528062471 wait complete. 2020-05-18T21:32:57.604 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:32:51.634300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:32:52.187431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:32:57.605 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:32:57.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9791312700 1 Processor -- start 2020-05-18T21:32:57.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9791312700 1 -- start start 2020-05-18T21:32:57.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9791312700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f978c0bc8d0 0x7f978c060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:57.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9791312700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f978c143630 0x7f978c12e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:57.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9791312700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978c146420 con 0x7f978c145e30 2020-05-18T21:32:57.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9791312700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978c146e00 con 0x7f978c143630 2020-05-18T21:32:57.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9791312700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978c1466c0 con 0x7f978c0bc8d0 2020-05-18T21:32:57.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9790b11700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f978c143630 0x7f978c12e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:57.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9790b11700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f978c143630 0x7f978c12e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59636/0 (socket says 172.21.15.63:59636) 2020-05-18T21:32:57.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9790b11700 1 -- 172.21.15.63:0/1088065732 learned_addr learned my addr 172.21.15.63:0/1088065732 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:57.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f978bfff700 1 --2- 172.21.15.63:0/1088065732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f978c0bc8d0 0x7f978c060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:57.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9790b11700 1 -- 172.21.15.63:0/1088065732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f978c0bc8d0 msgr2=0x7f978c060b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:57.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9790b11700 1 --2- 172.21.15.63:0/1088065732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f978c0bc8d0 0x7f978c060b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:57.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9790b11700 1 -- 172.21.15.63:0/1088065732 >> v1:172.21.15.155:6789/0 conn(0x7f978c145e30 legacy=0x7f978c142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:57.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9790b11700 1 -- 172.21.15.63:0/1088065732 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c146960 con 0x7f978c143630 2020-05-18T21:32:57.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9790b11700 1 --2- 172.21.15.63:0/1088065732 >> v2:172.21.15.63:3300/0 conn(0x7f978c143630 0x7f978c12e770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f97840032f0 tx=0x7f9784007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9790b11700 1 --2- 172.21.15.63:0/1088065732 >> v2:172.21.15.63:3300/0 conn(0x7f978c143630 0x7f978c12e770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f97840032f0 tx=0x7f9784007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9790b11700 1 --2- 172.21.15.63:0/1088065732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978c143630 0x7f978c12e770 secure :-1 s=READY pgs=1273 cs=0 l=1 rx=0x7f97840032f0 tx=0x7f9784007e00).ready entity=mon.0 client_cookie=84a7cdd636d85579 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:57.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9790b11700 1 --2- 172.21.15.63:0/1088065732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978c143630 0x7f978c12e770 secure :-1 s=THROTTLE_DONE pgs=1273 cs=0 l=1 rx=0x7f97840032f0 tx=0x7f9784007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9790b11700 1 --2- 172.21.15.63:0/1088065732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978c143630 0x7f978c12e770 secure :-1 s=THROTTLE_DONE pgs=1273 cs=0 l=1 rx=0x7f97840032f0 tx=0x7f9784007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f978affd700 1 -- 172.21.15.63:0/1088065732 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9784011dc0 con 0x7f978c143630 2020-05-18T21:32:57.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9790b11700 1 --2- 172.21.15.63:0/1088065732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978c143630 0x7f978c12e770 secure :-1 s=THROTTLE_DONE pgs=1273 cs=0 l=1 rx=0x7f97840032f0 tx=0x7f9784007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f978affd700 1 -- 172.21.15.63:0/1088065732 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978400a180 con 0x7f978c143630 2020-05-18T21:32:57.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f978affd700 1 -- 172.21.15.63:0/1088065732 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f978400a5a0 con 0x7f978c143630 2020-05-18T21:32:57.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.709+0000 7f9791312700 1 -- 172.21.15.63:0/1088065732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978c143630 msgr2=0x7f978c12e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:57.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f9791312700 1 --2- 172.21.15.63:0/1088065732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978c143630 0x7f978c12e770 secure :-1 s=READY pgs=1273 cs=0 l=1 rx=0x7f97840032f0 tx=0x7f9784007e00).stop 2020-05-18T21:32:57.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f9791312700 1 -- 172.21.15.63:0/1088065732 shutdown_connections 2020-05-18T21:32:57.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f9791312700 1 --2- 172.21.15.63:0/1088065732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978c143630 0x7f978c12e770 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:57.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f9791312700 1 --2- 172.21.15.63:0/1088065732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f978c0bc8d0 0x7f978c060b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:57.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f9791312700 1 -- 172.21.15.63:0/1088065732 >> 172.21.15.63:0/1088065732 conn(0x7f978c05f3b0 msgr2=0x7f978c05f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:57.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f9791312700 1 -- 172.21.15.63:0/1088065732 shutdown_connections 2020-05-18T21:32:57.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f9791312700 1 -- 172.21.15.63:0/1088065732 wait complete. 2020-05-18T21:32:57.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f9791312700 1 Processor -- start 2020-05-18T21:32:57.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f9791312700 1 -- start start 2020-05-18T21:32:57.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f9791312700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f978c0bc8d0 0x7f978c153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:57.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f9791312700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f978c143630 0x7f978c1535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:57.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f9791312700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f978c145e30 0x7f978c1450c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:57.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f9791312700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978c153a10 con 0x7f978c143630 2020-05-18T21:32:57.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f9791312700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978c0af330 con 0x7f978c145e30 2020-05-18T21:32:57.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f9791312700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978c0af5d0 con 0x7f978c0bc8d0 2020-05-18T21:32:57.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f978b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f978c143630 0x7f978c1535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:57.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f978b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f978c143630 0x7f978c1535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59640/0 (socket says 172.21.15.63:59640) 2020-05-18T21:32:57.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f978b7fe700 1 -- 172.21.15.63:0/470745739 learned_addr learned my addr 172.21.15.63:0/470745739 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:57.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f978bfff700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f978c0bc8d0 0x7f978c153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:57.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f9790b11700 1 --2- 172.21.15.63:0/470745739 >> v2:172.21.15.155:3300/0 conn(0x7f978c145e30 0x7f978c1450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:57.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f978b7fe700 1 -- 172.21.15.63:0/470745739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f978c0bc8d0 msgr2=0x7f978c153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:57.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f978b7fe700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f978c0bc8d0 0x7f978c153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:57.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f978b7fe700 1 -- 172.21.15.63:0/470745739 >> v2:172.21.15.155:3300/0 conn(0x7f978c145e30 msgr2=0x7f978c1450c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:57.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f978b7fe700 1 --2- 172.21.15.63:0/470745739 >> v2:172.21.15.155:3300/0 conn(0x7f978c145e30 0x7f978c1450c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:57.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f978b7fe700 1 -- 172.21.15.63:0/470745739 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c0b2c90 con 0x7f978c143630 2020-05-18T21:32:57.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f9790b11700 1 --2- 172.21.15.63:0/470745739 >> v2:172.21.15.155:3300/0 conn(0x7f978c145e30 0x7f978c1450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:32:57.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f978b7fe700 1 --2- 172.21.15.63:0/470745739 >> v2:172.21.15.63:3300/0 conn(0x7f978c143630 0x7f978c1535b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f978c060620 tx=0x7f978c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f978b7fe700 1 --2- 172.21.15.63:0/470745739 >> v2:172.21.15.63:3300/0 conn(0x7f978c143630 0x7f978c1535b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f978c060620 tx=0x7f978c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.713+0000 7f978b7fe700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978c143630 0x7f978c1535b0 secure :-1 s=READY pgs=1274 cs=0 l=1 rx=0x7f978c060620 tx=0x7f978c061d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:57.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.717+0000 7f978b7fe700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978c143630 0x7f978c1535b0 secure :-1 s=THROTTLE_DONE pgs=1274 cs=0 l=1 rx=0x7f978c060620 tx=0x7f978c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.717+0000 7f97897fa700 1 -- 172.21.15.63:0/470745739 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f977400cc80 con 0x7f978c143630 2020-05-18T21:32:57.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.717+0000 7f978b7fe700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978c143630 0x7f978c1535b0 secure :-1 s=THROTTLE_DONE pgs=1274 cs=0 l=1 rx=0x7f978c060620 tx=0x7f978c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.717+0000 7f978b7fe700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978c143630 0x7f978c1535b0 secure :-1 s=THROTTLE_DONE pgs=1274 cs=0 l=1 rx=0x7f978c060620 tx=0x7f978c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.717+0000 7f97897fa700 1 -- 172.21.15.63:0/470745739 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977400cde0 con 0x7f978c143630 2020-05-18T21:32:57.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.717+0000 7f9791312700 1 -- 172.21.15.63:0/470745739 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978c0acef0 con 0x7f978c143630 2020-05-18T21:32:57.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.717+0000 7f97897fa700 1 -- 172.21.15.63:0/470745739 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9774012240 con 0x7f978c143630 2020-05-18T21:32:57.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.717+0000 7f9791312700 1 -- 172.21.15.63:0/470745739 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978c0b3130 con 0x7f978c143630 2020-05-18T21:32:57.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.717+0000 7f9791312700 1 -- 172.21.15.63:0/470745739 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978c060e20 con 0x7f978c143630 2020-05-18T21:32:57.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.717+0000 7f978b7fe700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978c143630 0x7f978c1535b0 secure :-1 s=THROTTLE_DONE pgs=1274 cs=0 l=1 rx=0x7f978c060620 tx=0x7f978c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.717+0000 7f978b7fe700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978c143630 0x7f978c1535b0 secure :-1 s=THROTTLE_DONE pgs=1274 cs=0 l=1 rx=0x7f978c060620 tx=0x7f978c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.717+0000 7f97897fa700 1 -- 172.21.15.63:0/470745739 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9774006570 con 0x7f978c143630 2020-05-18T21:32:57.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.717+0000 7f97897fa700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f977004fa30 0x7f9770051ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:57.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.717+0000 7f97897fa700 1 -- 172.21.15.63:0/470745739 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9774063900 con 0x7f978c143630 2020-05-18T21:32:57.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.717+0000 7f978bfff700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f977004fa30 0x7f9770051ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:57.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.717+0000 7f978bfff700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f977004fa30 0x7f9770051ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f977c002f70 tx=0x7f977c00d750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.717+0000 7f978bfff700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f977004fa30 0x7f9770051ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f977c002f70 tx=0x7f977c00d750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.717+0000 7f978bfff700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f977004fa30 0x7f9770051ef0 secure :-1 s=READY pgs=506 cs=0 l=1 rx=0x7f977c002f70 tx=0x7f977c00d750).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:57.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.721+0000 7f978b7fe700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978c143630 0x7f978c1535b0 secure :-1 s=THROTTLE_DONE pgs=1274 cs=0 l=1 rx=0x7f978c060620 tx=0x7f978c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.721+0000 7f97897fa700 1 -- 172.21.15.63:0/470745739 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f977403dc30 con 0x7f978c143630 2020-05-18T21:32:57.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.837+0000 7f9791312700 1 -- 172.21.15.63:0/470745739 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f978c0ad080 con 0x7f978c143630 2020-05-18T21:32:57.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.837+0000 7f978b7fe700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978c143630 0x7f978c1535b0 secure :-1 s=THROTTLE_DONE pgs=1274 cs=0 l=1 rx=0x7f978c060620 tx=0x7f978c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.837+0000 7f97897fa700 1 -- 172.21.15.63:0/470745739 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v95) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9774041250 con 0x7f978c143630 2020-05-18T21:32:57.844 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:32:57.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.841+0000 7f9791312700 1 -- 172.21.15.63:0/470745739 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f977004fa30 msgr2=0x7f9770051ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:57.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.841+0000 7f9791312700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f977004fa30 0x7f9770051ef0 secure :-1 s=READY pgs=506 cs=0 l=1 rx=0x7f977c002f70 tx=0x7f977c00d750).stop 2020-05-18T21:32:57.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.841+0000 7f9791312700 1 -- 172.21.15.63:0/470745739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978c143630 msgr2=0x7f978c1535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:57.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.841+0000 7f9791312700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978c143630 0x7f978c1535b0 secure :-1 s=READY pgs=1274 cs=0 l=1 rx=0x7f978c060620 tx=0x7f978c061d60).stop 2020-05-18T21:32:57.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.841+0000 7f9791312700 1 -- 172.21.15.63:0/470745739 shutdown_connections 2020-05-18T21:32:57.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.841+0000 7f9791312700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f977004fa30 0x7f9770051ef0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:57.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.841+0000 7f9791312700 1 --2- 172.21.15.63:0/470745739 >> v2:172.21.15.155:3300/0 conn(0x7f978c145e30 0x7f978c1450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:57.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.841+0000 7f9791312700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978c143630 0x7f978c1535b0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:57.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.841+0000 7f9791312700 1 --2- 172.21.15.63:0/470745739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f978c0bc8d0 0x7f978c153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:57.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.841+0000 7f9791312700 1 -- 172.21.15.63:0/470745739 >> 172.21.15.63:0/470745739 conn(0x7f978c05f3b0 msgr2=0x7f978c061040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:57.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.841+0000 7f9791312700 1 -- 172.21.15.63:0/470745739 shutdown_connections 2020-05-18T21:32:57.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.841+0000 7f9791312700 1 -- 172.21.15.63:0/470745739 wait complete. 2020-05-18T21:32:57.856 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:32:57.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.961+0000 7f86dff79700 1 Processor -- start 2020-05-18T21:32:57.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.961+0000 7f86dff79700 1 -- start start 2020-05-18T21:32:57.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.961+0000 7f86dff79700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f86d80b8630 0x7f86d80b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:57.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.961+0000 7f86dff79700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86d80b42b0 0x7f86d80b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:57.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.961+0000 7f86dff79700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d8060660 con 0x7f86d80b9500 2020-05-18T21:32:57.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.961+0000 7f86dff79700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d80b4ba0 con 0x7f86d80b8630 2020-05-18T21:32:57.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.961+0000 7f86dff79700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d8060890 con 0x7f86d80b42b0 2020-05-18T21:32:57.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86ddd15700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f86d80b9500 0x7f86d8061270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33602/0 (socket says 172.21.15.63:33602) 2020-05-18T21:32:57.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86ddd15700 1 -- 172.21.15.63:0/763632271 learned_addr learned my addr 172.21.15.63:0/763632271 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:57.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dd514700 1 --2- 172.21.15.63:0/763632271 >> v2:172.21.15.63:3300/0 conn(0x7f86d80b8630 0x7f86d80b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:57.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86de516700 1 --2- 172.21.15.63:0/763632271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86d80b42b0 0x7f86d80b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:57.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dcd13700 1 -- 172.21.15.63:0/763632271 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838147647 0 0) 0x7f86d8060660 con 0x7f86d80b9500 2020-05-18T21:32:57.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dcd13700 1 -- 172.21.15.63:0/763632271 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86c0003270 con 0x7f86d80b9500 2020-05-18T21:32:57.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dd514700 1 -- 172.21.15.63:0/763632271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86d80b42b0 msgr2=0x7f86d80b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:57.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dd514700 1 --2- 172.21.15.63:0/763632271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86d80b42b0 0x7f86d80b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:57.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dd514700 1 -- 172.21.15.63:0/763632271 >> v1:172.21.15.63:6789/0 conn(0x7f86d80b9500 legacy=0x7f86d8061270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:57.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dd514700 1 -- 172.21.15.63:0/763632271 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d8060b30 con 0x7f86d80b8630 2020-05-18T21:32:57.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dd514700 1 --2- 172.21.15.63:0/763632271 >> v2:172.21.15.63:3300/0 conn(0x7f86d80b8630 0x7f86d80b6d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f86c8002f70 tx=0x7f86c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dd514700 1 --2- 172.21.15.63:0/763632271 >> v2:172.21.15.63:3300/0 conn(0x7f86d80b8630 0x7f86d80b6d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f86c8002f70 tx=0x7f86c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dd514700 1 --2- 172.21.15.63:0/763632271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86d80b8630 0x7f86d80b6d90 secure :-1 s=READY pgs=1276 cs=0 l=1 rx=0x7f86c8002f70 tx=0x7f86c8007a80).ready entity=mon.0 client_cookie=799b2f6a1020b79f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dd514700 1 --2- 172.21.15.63:0/763632271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86d80b8630 0x7f86d80b6d90 secure :-1 s=THROTTLE_DONE pgs=1276 cs=0 l=1 rx=0x7f86c8002f70 tx=0x7f86c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dcd13700 1 -- 172.21.15.63:0/763632271 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86c8008e80 con 0x7f86d80b8630 2020-05-18T21:32:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dd514700 1 --2- 172.21.15.63:0/763632271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86d80b8630 0x7f86d80b6d90 secure :-1 s=THROTTLE_DONE pgs=1276 cs=0 l=1 rx=0x7f86c8002f70 tx=0x7f86c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dd514700 1 --2- 172.21.15.63:0/763632271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86d80b8630 0x7f86d80b6d90 secure :-1 s=THROTTLE_DONE pgs=1276 cs=0 l=1 rx=0x7f86c8002f70 tx=0x7f86c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dcd13700 1 -- 172.21.15.63:0/763632271 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c8011540 con 0x7f86d80b8630 2020-05-18T21:32:57.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dcd13700 1 -- 172.21.15.63:0/763632271 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86c8011960 con 0x7f86d80b8630 2020-05-18T21:32:57.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dff79700 1 -- 172.21.15.63:0/763632271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86d80b8630 msgr2=0x7f86d80b6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:57.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dff79700 1 --2- 172.21.15.63:0/763632271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86d80b8630 0x7f86d80b6d90 secure :-1 s=READY pgs=1276 cs=0 l=1 rx=0x7f86c8002f70 tx=0x7f86c8007a80).stop 2020-05-18T21:32:57.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dff79700 1 -- 172.21.15.63:0/763632271 shutdown_connections 2020-05-18T21:32:57.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dff79700 1 --2- 172.21.15.63:0/763632271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86d80b42b0 0x7f86d80b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:57.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dff79700 1 --2- 172.21.15.63:0/763632271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86d80b8630 0x7f86d80b6d90 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:57.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dff79700 1 -- 172.21.15.63:0/763632271 >> 172.21.15.63:0/763632271 conn(0x7f86d8069b70 msgr2=0x7f86d8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:57.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dff79700 1 -- 172.21.15.63:0/763632271 shutdown_connections 2020-05-18T21:32:57.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.965+0000 7f86dff79700 1 -- 172.21.15.63:0/763632271 wait complete. 2020-05-18T21:32:57.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.969+0000 7f86dff79700 1 Processor -- start 2020-05-18T21:32:57.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.969+0000 7f86dff79700 1 -- start start 2020-05-18T21:32:57.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.969+0000 7f86dff79700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f86d80b42b0 0x7f86d812f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:57.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.969+0000 7f86dff79700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f86d80b8630 0x7f86d80b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:57.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.969+0000 7f86dff79700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d80b2ac0 con 0x7f86d80b9500 2020-05-18T21:32:57.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.969+0000 7f86dff79700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d8157630 con 0x7f86d80b42b0 2020-05-18T21:32:57.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.969+0000 7f86dff79700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d8157390 con 0x7f86d80b8630 2020-05-18T21:32:57.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.969+0000 7f86ddd15700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f86d80b42b0 0x7f86d812f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:57.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.969+0000 7f86ddd15700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f86d80b42b0 0x7f86d812f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59654/0 (socket says 172.21.15.63:59654) 2020-05-18T21:32:57.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.969+0000 7f86ddd15700 1 -- 172.21.15.63:0/2935678937 learned_addr learned my addr 172.21.15.63:0/2935678937 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:57.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.969+0000 7f86dd514700 1 --2- 172.21.15.63:0/2935678937 >> v2:172.21.15.155:3300/0 conn(0x7f86d80b8630 0x7f86d80b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:57.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.969+0000 7f86ddd15700 1 -- 172.21.15.63:0/2935678937 >> v2:172.21.15.155:3300/0 conn(0x7f86d80b8630 msgr2=0x7f86d80b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:57.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.969+0000 7f86ddd15700 1 --2- 172.21.15.63:0/2935678937 >> v2:172.21.15.155:3300/0 conn(0x7f86d80b8630 0x7f86d80b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:57.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.969+0000 7f86ddd15700 1 -- 172.21.15.63:0/2935678937 >> v1:172.21.15.155:6789/0 conn(0x7f86d80b9500 legacy=0x7f86d812d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:57.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.969+0000 7f86ddd15700 1 -- 172.21.15.63:0/2935678937 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d812e000 con 0x7f86d80b42b0 2020-05-18T21:32:57.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.969+0000 7f86ddd15700 1 --2- 172.21.15.63:0/2935678937 >> v2:172.21.15.63:3300/0 conn(0x7f86d80b42b0 0x7f86d812f220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f86d80b1840 tx=0x7f86d40109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.969+0000 7f86ddd15700 1 --2- 172.21.15.63:0/2935678937 >> v2:172.21.15.63:3300/0 conn(0x7f86d80b42b0 0x7f86d812f220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f86d80b1840 tx=0x7f86d40109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.969+0000 7f86ddd15700 1 --2- 172.21.15.63:0/2935678937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86d80b42b0 0x7f86d812f220 secure :-1 s=READY pgs=1277 cs=0 l=1 rx=0x7f86d80b1840 tx=0x7f86d40109d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:57.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.969+0000 7f86ddd15700 1 --2- 172.21.15.63:0/2935678937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86d80b42b0 0x7f86d812f220 secure :-1 s=THROTTLE_DONE pgs=1277 cs=0 l=1 rx=0x7f86d80b1840 tx=0x7f86d40109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.973+0000 7f86ddd15700 1 --2- 172.21.15.63:0/2935678937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86d80b42b0 0x7f86d812f220 secure :-1 s=THROTTLE_DONE pgs=1277 cs=0 l=1 rx=0x7f86d80b1840 tx=0x7f86d40109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.973+0000 7f86c6ffd700 1 -- 172.21.15.63:0/2935678937 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86d4005d00 con 0x7f86d80b42b0 2020-05-18T21:32:57.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.973+0000 7f86ddd15700 1 --2- 172.21.15.63:0/2935678937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86d80b42b0 0x7f86d812f220 secure :-1 s=THROTTLE_DONE pgs=1277 cs=0 l=1 rx=0x7f86d80b1840 tx=0x7f86d40109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.973+0000 7f86c6ffd700 1 -- 172.21.15.63:0/2935678937 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d4005e60 con 0x7f86d80b42b0 2020-05-18T21:32:57.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.973+0000 7f86dff79700 1 -- 172.21.15.63:0/2935678937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d812f870 con 0x7f86d80b42b0 2020-05-18T21:32:57.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.973+0000 7f86c6ffd700 1 -- 172.21.15.63:0/2935678937 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86d40062c0 con 0x7f86d80b42b0 2020-05-18T21:32:57.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.973+0000 7f86dff79700 1 -- 172.21.15.63:0/2935678937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d80b3520 con 0x7f86d80b42b0 2020-05-18T21:32:57.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.973+0000 7f86ddd15700 1 --2- 172.21.15.63:0/2935678937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86d80b42b0 0x7f86d812f220 secure :-1 s=THROTTLE_DONE pgs=1277 cs=0 l=1 rx=0x7f86d80b1840 tx=0x7f86d40109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.973+0000 7f86dff79700 1 -- 172.21.15.63:0/2935678937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d80569e0 con 0x7f86d80b42b0 2020-05-18T21:32:57.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.973+0000 7f86c6ffd700 1 -- 172.21.15.63:0/2935678937 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f86d4006530 con 0x7f86d80b42b0 2020-05-18T21:32:57.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.973+0000 7f86ddd15700 1 --2- 172.21.15.63:0/2935678937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86d80b42b0 0x7f86d812f220 secure :-1 s=THROTTLE_DONE pgs=1277 cs=0 l=1 rx=0x7f86d80b1840 tx=0x7f86d40109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.973+0000 7f86c6ffd700 1 --2- 172.21.15.63:0/2935678937 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f86b804faf0 0x7f86b8051fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:57.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.973+0000 7f86c6ffd700 1 -- 172.21.15.63:0/2935678937 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f86d40090c0 con 0x7f86d80b42b0 2020-05-18T21:32:57.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.973+0000 7f86dd514700 1 --2- 172.21.15.63:0/2935678937 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f86b804faf0 0x7f86b8051fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:57.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.973+0000 7f86dd514700 1 --2- 172.21.15.63:0/2935678937 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f86b804faf0 0x7f86b8051fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f86c8002f70 tx=0x7f86c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.973+0000 7f86dd514700 1 --2- 172.21.15.63:0/2935678937 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f86b804faf0 0x7f86b8051fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f86c8002f70 tx=0x7f86c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.977+0000 7f86dd514700 1 --2- 172.21.15.63:0/2935678937 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f86b804faf0 0x7f86b8051fb0 secure :-1 s=READY pgs=507 cs=0 l=1 rx=0x7f86c8002f70 tx=0x7f86c8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:57.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.977+0000 7f86ddd15700 1 --2- 172.21.15.63:0/2935678937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86d80b42b0 0x7f86d812f220 secure :-1 s=THROTTLE_DONE pgs=1277 cs=0 l=1 rx=0x7f86d80b1840 tx=0x7f86d40109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:57.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:57.977+0000 7f86c6ffd700 1 -- 172.21.15.63:0/2935678937 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f86d403e160 con 0x7f86d80b42b0 2020-05-18T21:32:58.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.093+0000 7f86dff79700 1 -- 172.21.15.63:0/2935678937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f86d80008d0 con 0x7f86d80b42b0 2020-05-18T21:32:58.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.097+0000 7f86ddd15700 1 --2- 172.21.15.63:0/2935678937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86d80b42b0 0x7f86d812f220 secure :-1 s=THROTTLE_DONE pgs=1277 cs=0 l=1 rx=0x7f86d80b1840 tx=0x7f86d40109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.097+0000 7f86c6ffd700 1 -- 172.21.15.63:0/2935678937 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v95) v1 ==== 92+0+10 (secure 0 0 0) 0x7f86d4041780 con 0x7f86d80b42b0 2020-05-18T21:32:58.101 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:32:58.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.097+0000 7f86dff79700 1 -- 172.21.15.63:0/2935678937 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f86b804faf0 msgr2=0x7f86b8051fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.097+0000 7f86dff79700 1 --2- 172.21.15.63:0/2935678937 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f86b804faf0 0x7f86b8051fb0 secure :-1 s=READY pgs=507 cs=0 l=1 rx=0x7f86c8002f70 tx=0x7f86c8007a80).stop 2020-05-18T21:32:58.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.097+0000 7f86dff79700 1 -- 172.21.15.63:0/2935678937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86d80b42b0 msgr2=0x7f86d812f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.097+0000 7f86dff79700 1 --2- 172.21.15.63:0/2935678937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86d80b42b0 0x7f86d812f220 secure :-1 s=READY pgs=1277 cs=0 l=1 rx=0x7f86d80b1840 tx=0x7f86d40109d0).stop 2020-05-18T21:32:58.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.097+0000 7f86dff79700 1 -- 172.21.15.63:0/2935678937 shutdown_connections 2020-05-18T21:32:58.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.097+0000 7f86dff79700 1 --2- 172.21.15.63:0/2935678937 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f86b804faf0 0x7f86b8051fb0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.097+0000 7f86dff79700 1 --2- 172.21.15.63:0/2935678937 >> v2:172.21.15.155:3300/0 conn(0x7f86d80b8630 0x7f86d80b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.097+0000 7f86dff79700 1 --2- 172.21.15.63:0/2935678937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86d80b42b0 0x7f86d812f220 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.097+0000 7f86dff79700 1 -- 172.21.15.63:0/2935678937 >> 172.21.15.63:0/2935678937 conn(0x7f86d8069b70 msgr2=0x7f86d80b7270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:58.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.097+0000 7f86dff79700 1 -- 172.21.15.63:0/2935678937 shutdown_connections 2020-05-18T21:32:58.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.097+0000 7f86dff79700 1 -- 172.21.15.63:0/2935678937 wait complete. 2020-05-18T21:32:58.114 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:32:58.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68aafd7700 1 Processor -- start 2020-05-18T21:32:58.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68aafd7700 1 -- start start 2020-05-18T21:32:58.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68aafd7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68a40b4f40 0x7f68a4061180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:58.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68aafd7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f68a406a2c0 0x7f68a4132360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:58.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68aafd7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a4132c70 con 0x7f68a41327c0 2020-05-18T21:32:58.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68aafd7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a406a7d0 con 0x7f68a406a2c0 2020-05-18T21:32:58.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68aafd7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a40b2a10 con 0x7f68a40b4f40 2020-05-18T21:32:58.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68a97d4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f68a406a2c0 0x7f68a4132360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:58.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68a97d4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f68a406a2c0 0x7f68a4132360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59660/0 (socket says 172.21.15.63:59660) 2020-05-18T21:32:58.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68a97d4700 1 -- 172.21.15.63:0/3565435836 learned_addr learned my addr 172.21.15.63:0/3565435836 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:58.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68aa7d6700 1 --1- 172.21.15.63:0/3565435836 >> v1:172.21.15.63:6789/0 conn(0x7f68a41327c0 0x7f68a414d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33618/0 (socket says 172.21.15.63:33618) 2020-05-18T21:32:58.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68a9fd5700 1 --2- 172.21.15.63:0/3565435836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68a40b4f40 0x7f68a4061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:58.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68a97d4700 1 -- 172.21.15.63:0/3565435836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68a40b4f40 msgr2=0x7f68a4061180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:58.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68a97d4700 1 --2- 172.21.15.63:0/3565435836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68a40b4f40 0x7f68a4061180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:58.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68a97d4700 1 -- 172.21.15.63:0/3565435836 >> v1:172.21.15.63:6789/0 conn(0x7f68a41327c0 legacy=0x7f68a414d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68a8fd3700 1 -- 172.21.15.63:0/3565435836 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948728692 0 0) 0x7f68a4132c70 con 0x7f68a41327c0 2020-05-18T21:32:58.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68a97d4700 1 -- 172.21.15.63:0/3565435836 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a40b5320 con 0x7f68a406a2c0 2020-05-18T21:32:58.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68a9fd5700 1 --2- 172.21.15.63:0/3565435836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68a40b4f40 0x7f68a4061180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:32:58.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68a97d4700 1 --2- 172.21.15.63:0/3565435836 >> v2:172.21.15.63:3300/0 conn(0x7f68a406a2c0 0x7f68a4132360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f68a0002f70 tx=0x7f68a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68a97d4700 1 --2- 172.21.15.63:0/3565435836 >> v2:172.21.15.63:3300/0 conn(0x7f68a406a2c0 0x7f68a4132360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f68a0002f70 tx=0x7f68a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68a97d4700 1 --2- 172.21.15.63:0/3565435836 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68a406a2c0 0x7f68a4132360 secure :-1 s=READY pgs=1279 cs=0 l=1 rx=0x7f68a0002f70 tx=0x7f68a0007a80).ready entity=mon.0 client_cookie=a1ed4debbd7abbdc server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:58.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68a97d4700 1 --2- 172.21.15.63:0/3565435836 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68a406a2c0 0x7f68a4132360 secure :-1 s=THROTTLE_DONE pgs=1279 cs=0 l=1 rx=0x7f68a0002f70 tx=0x7f68a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68a8fd3700 1 -- 172.21.15.63:0/3565435836 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68a0011760 con 0x7f68a406a2c0 2020-05-18T21:32:58.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68a97d4700 1 --2- 172.21.15.63:0/3565435836 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68a406a2c0 0x7f68a4132360 secure :-1 s=THROTTLE_DONE pgs=1279 cs=0 l=1 rx=0x7f68a0002f70 tx=0x7f68a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68a8fd3700 1 -- 172.21.15.63:0/3565435836 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a00118c0 con 0x7f68a406a2c0 2020-05-18T21:32:58.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68a97d4700 1 --2- 172.21.15.63:0/3565435836 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68a406a2c0 0x7f68a4132360 secure :-1 s=THROTTLE_DONE pgs=1279 cs=0 l=1 rx=0x7f68a0002f70 tx=0x7f68a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68a8fd3700 1 -- 172.21.15.63:0/3565435836 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68a0011ca0 con 0x7f68a406a2c0 2020-05-18T21:32:58.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68aafd7700 1 -- 172.21.15.63:0/3565435836 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68a406a2c0 msgr2=0x7f68a4132360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68aafd7700 1 --2- 172.21.15.63:0/3565435836 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68a406a2c0 0x7f68a4132360 secure :-1 s=READY pgs=1279 cs=0 l=1 rx=0x7f68a0002f70 tx=0x7f68a0007a80).stop 2020-05-18T21:32:58.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68aafd7700 1 -- 172.21.15.63:0/3565435836 shutdown_connections 2020-05-18T21:32:58.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68aafd7700 1 --2- 172.21.15.63:0/3565435836 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68a406a2c0 0x7f68a4132360 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68aafd7700 1 --2- 172.21.15.63:0/3565435836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68a40b4f40 0x7f68a4061180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:58.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68aafd7700 1 -- 172.21.15.63:0/3565435836 >> 172.21.15.63:0/3565435836 conn(0x7f68a405fbd0 msgr2=0x7f68a4069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:58.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68aafd7700 1 -- 172.21.15.63:0/3565435836 shutdown_connections 2020-05-18T21:32:58.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.217+0000 7f68aafd7700 1 -- 172.21.15.63:0/3565435836 wait complete. 2020-05-18T21:32:58.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.221+0000 7f68aafd7700 1 Processor -- start 2020-05-18T21:32:58.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.221+0000 7f68aafd7700 1 -- start start 2020-05-18T21:32:58.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68aafd7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f68a406a2c0 0x7f68a4064950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:58.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68aafd7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f68a40b4f40 0x7f68a4157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:58.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68aafd7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a4064db0 con 0x7f68a41327c0 2020-05-18T21:32:58.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68aafd7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a4157300 con 0x7f68a40b4f40 2020-05-18T21:32:58.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68aafd7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a41575a0 con 0x7f68a406a2c0 2020-05-18T21:32:58.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68aa7d6700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f68a41327c0 0x7f68a415ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33624/0 (socket says 172.21.15.63:33624) 2020-05-18T21:32:58.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68aa7d6700 1 -- 172.21.15.63:0/627962484 learned_addr learned my addr 172.21.15.63:0/627962484 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:58.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68a97d4700 1 --2- 172.21.15.63:0/627962484 >> v2:172.21.15.63:3300/0 conn(0x7f68a40b4f40 0x7f68a4157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:58.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68a9fd5700 1 --2- 172.21.15.63:0/627962484 >> v2:172.21.15.155:3300/0 conn(0x7f68a406a2c0 0x7f68a4064950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:58.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f689affd700 1 -- 172.21.15.63:0/627962484 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278965701 0 0) 0x7f68a4064db0 con 0x7f68a41327c0 2020-05-18T21:32:58.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f689affd700 1 -- 172.21.15.63:0/627962484 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f688c002fe0 con 0x7f68a41327c0 2020-05-18T21:32:58.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f689affd700 1 -- 172.21.15.63:0/627962484 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2462123819 0 0) 0x7f688c002fe0 con 0x7f68a41327c0 2020-05-18T21:32:58.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68a97d4700 1 -- 172.21.15.63:0/627962484 >> v2:172.21.15.155:3300/0 conn(0x7f68a406a2c0 msgr2=0x7f68a4064950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68a97d4700 1 --2- 172.21.15.63:0/627962484 >> v2:172.21.15.155:3300/0 conn(0x7f68a406a2c0 0x7f68a4064950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68a97d4700 1 -- 172.21.15.63:0/627962484 >> v1:172.21.15.63:6789/0 conn(0x7f68a41327c0 legacy=0x7f68a415ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68a97d4700 1 -- 172.21.15.63:0/627962484 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a4158140 con 0x7f68a40b4f40 2020-05-18T21:32:58.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68a97d4700 1 --2- 172.21.15.63:0/627962484 >> v2:172.21.15.63:3300/0 conn(0x7f68a40b4f40 0x7f68a4157ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f689c001e00 tx=0x7f68a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68a97d4700 1 --2- 172.21.15.63:0/627962484 >> v2:172.21.15.63:3300/0 conn(0x7f68a40b4f40 0x7f68a4157ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f689c001e00 tx=0x7f68a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68a97d4700 1 --2- 172.21.15.63:0/627962484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68a40b4f40 0x7f68a4157ce0 secure :-1 s=READY pgs=1281 cs=0 l=1 rx=0x7f689c001e00 tx=0x7f68a0007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:58.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68a97d4700 1 --2- 172.21.15.63:0/627962484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68a40b4f40 0x7f68a4157ce0 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f689c001e00 tx=0x7f68a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f689affd700 1 -- 172.21.15.63:0/627962484 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f689c001c60 con 0x7f68a40b4f40 2020-05-18T21:32:58.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68a97d4700 1 --2- 172.21.15.63:0/627962484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68a40b4f40 0x7f68a4157ce0 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f689c001e00 tx=0x7f68a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f689affd700 1 -- 172.21.15.63:0/627962484 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a0011ca0 con 0x7f68a40b4f40 2020-05-18T21:32:58.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68a97d4700 1 --2- 172.21.15.63:0/627962484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68a40b4f40 0x7f68a4157ce0 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f689c001e00 tx=0x7f68a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68aafd7700 1 -- 172.21.15.63:0/627962484 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a414cd60 con 0x7f68a40b4f40 2020-05-18T21:32:58.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f689affd700 1 -- 172.21.15.63:0/627962484 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68a0007360 con 0x7f68a40b4f40 2020-05-18T21:32:58.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68aafd7700 1 -- 172.21.15.63:0/627962484 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a415aa70 con 0x7f68a40b4f40 2020-05-18T21:32:58.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68aafd7700 1 -- 172.21.15.63:0/627962484 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a40569e0 con 0x7f68a40b4f40 2020-05-18T21:32:58.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.225+0000 7f68a97d4700 1 --2- 172.21.15.63:0/627962484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68a40b4f40 0x7f68a4157ce0 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f689c001e00 tx=0x7f68a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.229+0000 7f689affd700 1 -- 172.21.15.63:0/627962484 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f68a0005700 con 0x7f68a40b4f40 2020-05-18T21:32:58.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.229+0000 7f68a97d4700 1 --2- 172.21.15.63:0/627962484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68a40b4f40 0x7f68a4157ce0 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f689c001e00 tx=0x7f68a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.229+0000 7f689affd700 1 --2- 172.21.15.63:0/627962484 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f688c04fd60 0x7f688c052220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:58.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.229+0000 7f689affd700 1 -- 172.21.15.63:0/627962484 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f68a0063db0 con 0x7f68a40b4f40 2020-05-18T21:32:58.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.229+0000 7f68a9fd5700 1 --2- 172.21.15.63:0/627962484 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f688c04fd60 0x7f688c052220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:58.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.229+0000 7f68a9fd5700 1 --2- 172.21.15.63:0/627962484 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f688c04fd60 0x7f688c052220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6894002f70 tx=0x7f6894007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.229+0000 7f68a9fd5700 1 --2- 172.21.15.63:0/627962484 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f688c04fd60 0x7f688c052220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6894002f70 tx=0x7f6894007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.229+0000 7f68a9fd5700 1 --2- 172.21.15.63:0/627962484 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f688c04fd60 0x7f688c052220 secure :-1 s=READY pgs=508 cs=0 l=1 rx=0x7f6894002f70 tx=0x7f6894007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:58.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.237+0000 7f68a97d4700 1 --2- 172.21.15.63:0/627962484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68a40b4f40 0x7f68a4157ce0 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f689c001e00 tx=0x7f68a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.237+0000 7f689affd700 1 -- 172.21.15.63:0/627962484 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f68a0041e60 con 0x7f68a40b4f40 2020-05-18T21:32:58.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.353+0000 7f68aafd7700 1 -- 172.21.15.63:0/627962484 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f68a4157a10 con 0x7f68a40b4f40 2020-05-18T21:32:58.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.353+0000 7f68a97d4700 1 --2- 172.21.15.63:0/627962484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68a40b4f40 0x7f68a4157ce0 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f689c001e00 tx=0x7f68a0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.353+0000 7f689affd700 1 -- 172.21.15.63:0/627962484 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+10 (secure 0 0 0) 0x7f68a003e200 con 0x7f68a40b4f40 2020-05-18T21:32:58.360 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:32:58.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.357+0000 7f68aafd7700 1 -- 172.21.15.63:0/627962484 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f688c04fd60 msgr2=0x7f688c052220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.357+0000 7f68aafd7700 1 --2- 172.21.15.63:0/627962484 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f688c04fd60 0x7f688c052220 secure :-1 s=READY pgs=508 cs=0 l=1 rx=0x7f6894002f70 tx=0x7f6894007a80).stop 2020-05-18T21:32:58.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.357+0000 7f68aafd7700 1 -- 172.21.15.63:0/627962484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68a40b4f40 msgr2=0x7f68a4157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.357+0000 7f68aafd7700 1 --2- 172.21.15.63:0/627962484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68a40b4f40 0x7f68a4157ce0 secure :-1 s=READY pgs=1281 cs=0 l=1 rx=0x7f689c001e00 tx=0x7f68a0007a80).stop 2020-05-18T21:32:58.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.357+0000 7f68aafd7700 1 -- 172.21.15.63:0/627962484 shutdown_connections 2020-05-18T21:32:58.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.357+0000 7f68aafd7700 1 --2- 172.21.15.63:0/627962484 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f688c04fd60 0x7f688c052220 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.357+0000 7f68aafd7700 1 --2- 172.21.15.63:0/627962484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68a40b4f40 0x7f68a4157ce0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.357+0000 7f68aafd7700 1 --2- 172.21.15.63:0/627962484 >> v2:172.21.15.155:3300/0 conn(0x7f68a406a2c0 0x7f68a4064950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.357+0000 7f68aafd7700 1 -- 172.21.15.63:0/627962484 >> 172.21.15.63:0/627962484 conn(0x7f68a405fbd0 msgr2=0x7f68a4132c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:58.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.357+0000 7f68aafd7700 1 -- 172.21.15.63:0/627962484 shutdown_connections 2020-05-18T21:32:58.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.357+0000 7f68aafd7700 1 -- 172.21.15.63:0/627962484 wait complete. 2020-05-18T21:32:58.372 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:32:58.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.477+0000 7ffa53410700 1 Processor -- start 2020-05-18T21:32:58.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.477+0000 7ffa53410700 1 -- start start 2020-05-18T21:32:58.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa53410700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffa4c0b8630 0x7ffa4c0b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:58.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa53410700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffa4c0b42b0 0x7ffa4c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:58.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa53410700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4c0b4ba0 con 0x7ffa4c0b9500 2020-05-18T21:32:58.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa53410700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa4c060890 con 0x7ffa4c0b8630 2020-05-18T21:32:58.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa53410700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa4c060b30 con 0x7ffa4c0b42b0 2020-05-18T21:32:58.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa509ab700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffa4c0b8630 0x7ffa4c0b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:58.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa509ab700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffa4c0b8630 0x7ffa4c0b6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59674/0 (socket says 172.21.15.63:59674) 2020-05-18T21:32:58.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa509ab700 1 -- 172.21.15.63:0/1441725226 learned_addr learned my addr 172.21.15.63:0/1441725226 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:58.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa511ac700 1 --1- 172.21.15.63:0/1441725226 >> v1:172.21.15.63:6789/0 conn(0x7ffa4c0b9500 0x7ffa4c061270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33628/0 (socket says 172.21.15.63:33628) 2020-05-18T21:32:58.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa519ad700 1 --2- 172.21.15.63:0/1441725226 >> v2:172.21.15.155:3300/0 conn(0x7ffa4c0b42b0 0x7ffa4c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:58.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa509ab700 1 -- 172.21.15.63:0/1441725226 >> v2:172.21.15.155:3300/0 conn(0x7ffa4c0b42b0 msgr2=0x7ffa4c0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:58.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa509ab700 1 --2- 172.21.15.63:0/1441725226 >> v2:172.21.15.155:3300/0 conn(0x7ffa4c0b42b0 0x7ffa4c0b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:58.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa509ab700 1 -- 172.21.15.63:0/1441725226 >> v1:172.21.15.63:6789/0 conn(0x7ffa4c0b9500 legacy=0x7ffa4c061270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa509ab700 1 -- 172.21.15.63:0/1441725226 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c060dd0 con 0x7ffa4c0b8630 2020-05-18T21:32:58.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa519ad700 1 --2- 172.21.15.63:0/1441725226 >> v2:172.21.15.155:3300/0 conn(0x7ffa4c0b42b0 0x7ffa4c0b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:32:58.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa509ab700 1 --2- 172.21.15.63:0/1441725226 >> v2:172.21.15.63:3300/0 conn(0x7ffa4c0b8630 0x7ffa4c0b6d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffa4c0b8000 tx=0x7ffa40007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa509ab700 1 --2- 172.21.15.63:0/1441725226 >> v2:172.21.15.63:3300/0 conn(0x7ffa4c0b8630 0x7ffa4c0b6d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffa4c0b8000 tx=0x7ffa40007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa509ab700 1 --2- 172.21.15.63:0/1441725226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa4c0b8630 0x7ffa4c0b6d90 secure :-1 s=READY pgs=1283 cs=0 l=1 rx=0x7ffa4c0b8000 tx=0x7ffa40007a80).ready entity=mon.0 client_cookie=faad8fa746b21030 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:58.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa509ab700 1 --2- 172.21.15.63:0/1441725226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa4c0b8630 0x7ffa4c0b6d90 secure :-1 s=THROTTLE_DONE pgs=1283 cs=0 l=1 rx=0x7ffa4c0b8000 tx=0x7ffa40007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa3ffff700 1 -- 172.21.15.63:0/1441725226 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa40011720 con 0x7ffa4c0b8630 2020-05-18T21:32:58.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa509ab700 1 --2- 172.21.15.63:0/1441725226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa4c0b8630 0x7ffa4c0b6d90 secure :-1 s=THROTTLE_DONE pgs=1283 cs=0 l=1 rx=0x7ffa4c0b8000 tx=0x7ffa40007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa509ab700 1 --2- 172.21.15.63:0/1441725226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa4c0b8630 0x7ffa4c0b6d90 secure :-1 s=THROTTLE_DONE pgs=1283 cs=0 l=1 rx=0x7ffa4c0b8000 tx=0x7ffa40007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa3ffff700 1 -- 172.21.15.63:0/1441725226 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa40011880 con 0x7ffa4c0b8630 2020-05-18T21:32:58.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa3ffff700 1 -- 172.21.15.63:0/1441725226 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa40011ca0 con 0x7ffa4c0b8630 2020-05-18T21:32:58.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa53410700 1 -- 172.21.15.63:0/1441725226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa4c0b8630 msgr2=0x7ffa4c0b6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa53410700 1 --2- 172.21.15.63:0/1441725226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa4c0b8630 0x7ffa4c0b6d90 secure :-1 s=READY pgs=1283 cs=0 l=1 rx=0x7ffa4c0b8000 tx=0x7ffa40007a80).stop 2020-05-18T21:32:58.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa53410700 1 -- 172.21.15.63:0/1441725226 shutdown_connections 2020-05-18T21:32:58.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa53410700 1 --2- 172.21.15.63:0/1441725226 >> v2:172.21.15.155:3300/0 conn(0x7ffa4c0b42b0 0x7ffa4c0b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:58.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa53410700 1 --2- 172.21.15.63:0/1441725226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa4c0b8630 0x7ffa4c0b6d90 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa53410700 1 -- 172.21.15.63:0/1441725226 >> 172.21.15.63:0/1441725226 conn(0x7ffa4c069b70 msgr2=0x7ffa4c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:58.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa53410700 1 -- 172.21.15.63:0/1441725226 shutdown_connections 2020-05-18T21:32:58.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.481+0000 7ffa53410700 1 -- 172.21.15.63:0/1441725226 wait complete. 2020-05-18T21:32:58.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa53410700 1 Processor -- start 2020-05-18T21:32:58.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa53410700 1 -- start start 2020-05-18T21:32:58.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa53410700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa4c0b8630 0x7ffa4c12dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:58.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa53410700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4c12ff60 con 0x7ffa4c0b9500 2020-05-18T21:32:58.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa53410700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4c130200 con 0x7ffa4c0b42b0 2020-05-18T21:32:58.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa53410700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c1304a0 con 0x7ffa4c0b8630 2020-05-18T21:32:58.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa519ad700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ffa4c0b9500 0x7ffa4c0b0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33638/0 (socket says 172.21.15.63:33638) 2020-05-18T21:32:58.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa519ad700 1 -- 172.21.15.63:0/4086695132 learned_addr learned my addr 172.21.15.63:0/4086695132 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:32:58.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa509ab700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa4c0b8630 0x7ffa4c12dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:58.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159433441 0 0) 0x7ffa4c12ff60 con 0x7ffa4c0b9500 2020-05-18T21:32:58.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa2c002fe0 con 0x7ffa4c0b9500 2020-05-18T21:32:58.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997995721 0 0) 0x7ffa4c130200 con 0x7ffa4c0b42b0 2020-05-18T21:32:58.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa4c12ff60 con 0x7ffa4c0b42b0 2020-05-18T21:32:58.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2437178671 0 0) 0x7ffa2c002fe0 con 0x7ffa4c0b9500 2020-05-18T21:32:58.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffa4c130200 con 0x7ffa4c0b9500 2020-05-18T21:32:58.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7ffa44002a60 con 0x7ffa4c0b9500 2020-05-18T21:32:58.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa4c0b8630 msgr2=0x7ffa4c12dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa4c0b8630 0x7ffa4c12dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 >> v1:172.21.15.155:6789/0 conn(0x7ffa4c0b42b0 legacy=0x7ffa4c12d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 >> v1:172.21.15.63:6789/0 conn(0x7ffa4c0b9500 legacy=0x7ffa4c0b0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa2c004bf0 0x7ffa2c004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:58.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa2c003880 0x7ffa2c003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:58.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa2c004120 0x7ffa2c00b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:58.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c1304a0 con 0x7ffa2c004120 2020-05-18T21:32:58.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c00bbc0 con 0x7ffa2c003880 2020-05-18T21:32:58.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c00bd00 con 0x7ffa2c004bf0 2020-05-18T21:32:58.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa519ad700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa2c004120 0x7ffa2c00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:58.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa509ab700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa4c0b8630 0x7ffa4c12dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:32:58.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa511ac700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa2c004bf0 0x7ffa2c004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:58.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa519ad700 1 -- 172.21.15.63:0/4086695132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa2c004bf0 msgr2=0x7ffa2c004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa519ad700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa2c004bf0 0x7ffa2c004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa519ad700 1 -- 172.21.15.63:0/4086695132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa2c003880 msgr2=0x7ffa2c003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa519ad700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa2c003880 0x7ffa2c003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa519ad700 1 -- 172.21.15.63:0/4086695132 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c0b1630 con 0x7ffa2c004120 2020-05-18T21:32:58.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa53410700 1 -- 172.21.15.63:0/4086695132 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa4c12ed30 con 0x7ffa2c004120 2020-05-18T21:32:58.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa519ad700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa2c004120 0x7ffa2c00b760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffa44002830 tx=0x7ffa44011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa53410700 1 -- 172.21.15.63:0/4086695132 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4c12e140 con 0x7ffa2c004120 2020-05-18T21:32:58.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa519ad700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa2c004120 0x7ffa2c00b760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffa44002830 tx=0x7ffa44011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa519ad700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa2c004120 0x7ffa2c00b760 secure :-1 s=READY pgs=1285 cs=0 l=1 rx=0x7ffa44002830 tx=0x7ffa44011880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:58.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa519ad700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa2c004120 0x7ffa2c00b760 secure :-1 s=THROTTLE_DONE pgs=1285 cs=0 l=1 rx=0x7ffa44002830 tx=0x7ffa44011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa44012680 con 0x7ffa2c004120 2020-05-18T21:32:58.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa519ad700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa2c004120 0x7ffa2c00b760 secure :-1 s=THROTTLE_DONE pgs=1285 cs=0 l=1 rx=0x7ffa44002830 tx=0x7ffa44011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa440127e0 con 0x7ffa2c004120 2020-05-18T21:32:58.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa519ad700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa2c004120 0x7ffa2c00b760 secure :-1 s=THROTTLE_DONE pgs=1285 cs=0 l=1 rx=0x7ffa44002830 tx=0x7ffa44011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.485+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa44012b80 con 0x7ffa2c004120 2020-05-18T21:32:58.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.489+0000 7ffa519ad700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa2c004120 0x7ffa2c00b760 secure :-1 s=THROTTLE_DONE pgs=1285 cs=0 l=1 rx=0x7ffa44002830 tx=0x7ffa44011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.489+0000 7ffa53410700 1 -- 172.21.15.63:0/4086695132 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa28003380 con 0x7ffa2c004120 2020-05-18T21:32:58.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.489+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ffa4400e180 con 0x7ffa2c004120 2020-05-18T21:32:58.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.489+0000 7ffa519ad700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa2c004120 0x7ffa2c00b760 secure :-1 s=THROTTLE_DONE pgs=1285 cs=0 l=1 rx=0x7ffa44002830 tx=0x7ffa44011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.489+0000 7ffa3e7fc700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffa2c058400 0x7ffa2c05a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:58.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.489+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffa44064ac0 con 0x7ffa2c004120 2020-05-18T21:32:58.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.489+0000 7ffa511ac700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffa2c058400 0x7ffa2c05a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:58.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.489+0000 7ffa511ac700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffa2c058400 0x7ffa2c05a8c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffa48001020 tx=0x7ffa48001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.489+0000 7ffa511ac700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffa2c058400 0x7ffa2c05a8c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffa48001020 tx=0x7ffa48001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.489+0000 7ffa511ac700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffa2c058400 0x7ffa2c05a8c0 secure :-1 s=READY pgs=509 cs=0 l=1 rx=0x7ffa48001020 tx=0x7ffa48001960).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:58.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.497+0000 7ffa519ad700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa2c004120 0x7ffa2c00b760 secure :-1 s=THROTTLE_DONE pgs=1285 cs=0 l=1 rx=0x7ffa44002830 tx=0x7ffa44011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.497+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ffa4403ee70 con 0x7ffa2c004120 2020-05-18T21:32:58.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.613+0000 7ffa53410700 1 -- 172.21.15.63:0/4086695132 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffa28002240 con 0x7ffa2c004120 2020-05-18T21:32:58.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.613+0000 7ffa519ad700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa2c004120 0x7ffa2c00b760 secure :-1 s=THROTTLE_DONE pgs=1285 cs=0 l=1 rx=0x7ffa44002830 tx=0x7ffa44011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.613+0000 7ffa3e7fc700 1 -- 172.21.15.63:0/4086695132 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+10 (secure 0 0 0) 0x7ffa44042490 con 0x7ffa2c004120 2020-05-18T21:32:58.619 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:32:58.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.617+0000 7ffa53410700 1 -- 172.21.15.63:0/4086695132 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffa2c058400 msgr2=0x7ffa2c05a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.617+0000 7ffa53410700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffa2c058400 0x7ffa2c05a8c0 secure :-1 s=READY pgs=509 cs=0 l=1 rx=0x7ffa48001020 tx=0x7ffa48001960).stop 2020-05-18T21:32:58.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.617+0000 7ffa53410700 1 -- 172.21.15.63:0/4086695132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa2c004120 msgr2=0x7ffa2c00b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.617+0000 7ffa519ad700 1 -- 172.21.15.63:0/4086695132 reap_dead start 2020-05-18T21:32:58.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.617+0000 7ffa53410700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa2c004120 0x7ffa2c00b760 secure :-1 s=READY pgs=1285 cs=0 l=1 rx=0x7ffa44002830 tx=0x7ffa44011880).stop 2020-05-18T21:32:58.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.617+0000 7ffa53410700 1 -- 172.21.15.63:0/4086695132 shutdown_connections 2020-05-18T21:32:58.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.617+0000 7ffa53410700 1 --2- 172.21.15.63:0/4086695132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa2c004120 0x7ffa2c00b760 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.617+0000 7ffa53410700 1 -- 172.21.15.63:0/4086695132 >> 172.21.15.63:0/4086695132 conn(0x7ffa4c069b70 msgr2=0x7ffa4c0b7270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:58.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.617+0000 7ffa53410700 1 -- 172.21.15.63:0/4086695132 shutdown_connections 2020-05-18T21:32:58.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.617+0000 7ffa53410700 1 -- 172.21.15.63:0/4086695132 wait complete. 2020-05-18T21:32:58.632 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:32:58.633 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:32:58.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb856664700 1 Processor -- start 2020-05-18T21:32:58.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb856664700 1 -- start start 2020-05-18T21:32:58.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb856664700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb85005f110 0x7fb8500b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:58.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb856664700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb850064fd0 0x7fb85014d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:32:58.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb856664700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85014a330 con 0x7fb85014aa70 2020-05-18T21:32:58.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb856664700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85014a140 con 0x7fb850064fd0 2020-05-18T21:32:58.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb856664700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb850065460 con 0x7fb85005f110 2020-05-18T21:32:58.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb855e63700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb850064fd0 0x7fb85014d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:58.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb855e63700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb850064fd0 0x7fb85014d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59696/0 (socket says 172.21.15.63:59696) 2020-05-18T21:32:58.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb855e63700 1 -- 172.21.15.63:0/2859288845 learned_addr learned my addr 172.21.15.63:0/2859288845 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:58.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb855662700 1 --2- 172.21.15.63:0/2859288845 >> v2:172.21.15.155:3300/0 conn(0x7fb85005f110 0x7fb8500b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:58.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb855e63700 1 -- 172.21.15.63:0/2859288845 >> v2:172.21.15.155:3300/0 conn(0x7fb85005f110 msgr2=0x7fb8500b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:32:58.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb855e63700 1 --2- 172.21.15.63:0/2859288845 >> v2:172.21.15.155:3300/0 conn(0x7fb85005f110 0x7fb8500b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:58.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb855e63700 1 -- 172.21.15.63:0/2859288845 >> v1:172.21.15.63:6789/0 conn(0x7fb85014aa70 legacy=0x7fb8500648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb855e63700 1 -- 172.21.15.63:0/2859288845 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85014a5d0 con 0x7fb850064fd0 2020-05-18T21:32:58.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb855e63700 1 --2- 172.21.15.63:0/2859288845 >> v2:172.21.15.63:3300/0 conn(0x7fb850064fd0 0x7fb85014d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb850063f10 tx=0x7fb848008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb855e63700 1 --2- 172.21.15.63:0/2859288845 >> v2:172.21.15.63:3300/0 conn(0x7fb850064fd0 0x7fb85014d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb850063f10 tx=0x7fb848008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb855e63700 1 --2- 172.21.15.63:0/2859288845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb850064fd0 0x7fb85014d710 secure :-1 s=READY pgs=1287 cs=0 l=1 rx=0x7fb850063f10 tx=0x7fb848008920).ready entity=mon.0 client_cookie=79f2183ba2637aad server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:58.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb855e63700 1 --2- 172.21.15.63:0/2859288845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb850064fd0 0x7fb85014d710 secure :-1 s=THROTTLE_DONE pgs=1287 cs=0 l=1 rx=0x7fb850063f10 tx=0x7fb848008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb847fff700 1 -- 172.21.15.63:0/2859288845 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb848011760 con 0x7fb850064fd0 2020-05-18T21:32:58.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.733+0000 7fb855e63700 1 --2- 172.21.15.63:0/2859288845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb850064fd0 0x7fb85014d710 secure :-1 s=THROTTLE_DONE pgs=1287 cs=0 l=1 rx=0x7fb850063f10 tx=0x7fb848008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.737+0000 7fb847fff700 1 -- 172.21.15.63:0/2859288845 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8480118c0 con 0x7fb850064fd0 2020-05-18T21:32:58.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.737+0000 7fb856664700 1 -- 172.21.15.63:0/2859288845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb850064fd0 msgr2=0x7fb85014d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.737+0000 7fb855e63700 1 --2- 172.21.15.63:0/2859288845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb850064fd0 0x7fb85014d710 secure :-1 s=THROTTLE_DONE pgs=1287 cs=0 l=1 rx=0x7fb850063f10 tx=0x7fb848008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.737+0000 7fb847fff700 1 -- 172.21.15.63:0/2859288845 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb848011ce0 con 0x7fb850064fd0 2020-05-18T21:32:58.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.737+0000 7fb856664700 1 --2- 172.21.15.63:0/2859288845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb850064fd0 0x7fb85014d710 secure :-1 s=READY pgs=1287 cs=0 l=1 rx=0x7fb850063f10 tx=0x7fb848008920).stop 2020-05-18T21:32:58.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.737+0000 7fb856664700 1 -- 172.21.15.63:0/2859288845 shutdown_connections 2020-05-18T21:32:58.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.737+0000 7fb856664700 1 --2- 172.21.15.63:0/2859288845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb850064fd0 0x7fb85014d710 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.737+0000 7fb856664700 1 --2- 172.21.15.63:0/2859288845 >> v2:172.21.15.155:3300/0 conn(0x7fb85005f110 0x7fb8500b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:32:58.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.737+0000 7fb856664700 1 -- 172.21.15.63:0/2859288845 >> 172.21.15.63:0/2859288845 conn(0x7fb850069fc0 msgr2=0x7fb85006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:58.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.737+0000 7fb856664700 1 -- 172.21.15.63:0/2859288845 shutdown_connections 2020-05-18T21:32:58.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.737+0000 7fb856664700 1 -- 172.21.15.63:0/2859288845 wait complete. 2020-05-18T21:32:58.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.737+0000 7fb856664700 1 Processor -- start 2020-05-18T21:32:58.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.737+0000 7fb856664700 1 -- start start 2020-05-18T21:32:58.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb856664700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb85005f110 0x7fb85014dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:58.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb856664700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb850064fd0 0x7fb85014d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:58.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb856664700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb85014aa70 0x7fb850061d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:58.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb856664700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85014da30 con 0x7fb850064fd0 2020-05-18T21:32:58.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb856664700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8500621e0 con 0x7fb85014aa70 2020-05-18T21:32:58.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb856664700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85014dc70 con 0x7fb85005f110 2020-05-18T21:32:58.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb854e61700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb850064fd0 0x7fb85014d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:58.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb854e61700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb850064fd0 0x7fb85014d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59700/0 (socket says 172.21.15.63:59700) 2020-05-18T21:32:58.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb854e61700 1 -- 172.21.15.63:0/1981211644 learned_addr learned my addr 172.21.15.63:0/1981211644 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:32:58.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb855662700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb85005f110 0x7fb85014dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:58.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb855e63700 1 --2- 172.21.15.63:0/1981211644 >> v2:172.21.15.155:3300/0 conn(0x7fb85014aa70 0x7fb850061d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:58.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb854e61700 1 -- 172.21.15.63:0/1981211644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb85005f110 msgr2=0x7fb85014dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb854e61700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb85005f110 0x7fb85014dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb854e61700 1 -- 172.21.15.63:0/1981211644 >> v2:172.21.15.155:3300/0 conn(0x7fb85014aa70 msgr2=0x7fb850061d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb854e61700 1 --2- 172.21.15.63:0/1981211644 >> v2:172.21.15.155:3300/0 conn(0x7fb85014aa70 0x7fb850061d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb854e61700 1 -- 172.21.15.63:0/1981211644 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85014af10 con 0x7fb850064fd0 2020-05-18T21:32:58.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb854e61700 1 --2- 172.21.15.63:0/1981211644 >> v2:172.21.15.63:3300/0 conn(0x7fb850064fd0 0x7fb85014d5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb850060a90 tx=0x7fb84c00c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb854e61700 1 --2- 172.21.15.63:0/1981211644 >> v2:172.21.15.63:3300/0 conn(0x7fb850064fd0 0x7fb85014d5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb850060a90 tx=0x7fb84c00c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb854e61700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb850064fd0 0x7fb85014d5d0 secure :-1 s=READY pgs=1288 cs=0 l=1 rx=0x7fb850060a90 tx=0x7fb84c00c800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:58.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb854e61700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb850064fd0 0x7fb85014d5d0 secure :-1 s=THROTTLE_DONE pgs=1288 cs=0 l=1 rx=0x7fb850060a90 tx=0x7fb84c00c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb854e61700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb850064fd0 0x7fb85014d5d0 secure :-1 s=THROTTLE_DONE pgs=1288 cs=0 l=1 rx=0x7fb850060a90 tx=0x7fb84c00c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb8467fc700 1 -- 172.21.15.63:0/1981211644 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb84c0101e0 con 0x7fb850064fd0 2020-05-18T21:32:58.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb854e61700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb850064fd0 0x7fb85014d5d0 secure :-1 s=THROTTLE_DONE pgs=1288 cs=0 l=1 rx=0x7fb850060a90 tx=0x7fb84c00c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb8467fc700 1 -- 172.21.15.63:0/1981211644 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84c010340 con 0x7fb850064fd0 2020-05-18T21:32:58.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb856664700 1 -- 172.21.15.63:0/1981211644 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85014b1b0 con 0x7fb850064fd0 2020-05-18T21:32:58.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb8467fc700 1 -- 172.21.15.63:0/1981211644 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb84c0106e0 con 0x7fb850064fd0 2020-05-18T21:32:58.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb856664700 1 -- 172.21.15.63:0/1981211644 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85014b870 con 0x7fb850064fd0 2020-05-18T21:32:58.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb856664700 1 -- 172.21.15.63:0/1981211644 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8500569e0 con 0x7fb850064fd0 2020-05-18T21:32:58.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.741+0000 7fb854e61700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb850064fd0 0x7fb85014d5d0 secure :-1 s=THROTTLE_DONE pgs=1288 cs=0 l=1 rx=0x7fb850060a90 tx=0x7fb84c00c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.745+0000 7fb8467fc700 1 -- 172.21.15.63:0/1981211644 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb84c0068a0 con 0x7fb850064fd0 2020-05-18T21:32:58.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.745+0000 7fb854e61700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb850064fd0 0x7fb85014d5d0 secure :-1 s=THROTTLE_DONE pgs=1288 cs=0 l=1 rx=0x7fb850060a90 tx=0x7fb84c00c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.745+0000 7fb8467fc700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb83004fa30 0x7fb830051ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:32:58.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.745+0000 7fb8467fc700 1 -- 172.21.15.63:0/1981211644 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb84c063f50 con 0x7fb850064fd0 2020-05-18T21:32:58.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.745+0000 7fb855662700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb83004fa30 0x7fb830051ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:32:58.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.745+0000 7fb855662700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb83004fa30 0x7fb830051ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb840002f70 tx=0x7fb84000d750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.745+0000 7fb855662700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb83004fa30 0x7fb830051ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb840002f70 tx=0x7fb84000d750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.745+0000 7fb855662700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb83004fa30 0x7fb830051ef0 secure :-1 s=READY pgs=510 cs=0 l=1 rx=0x7fb840002f70 tx=0x7fb84000d750).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:32:58.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.749+0000 7fb854e61700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb850064fd0 0x7fb85014d5d0 secure :-1 s=THROTTLE_DONE pgs=1288 cs=0 l=1 rx=0x7fb850060a90 tx=0x7fb84c00c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.749+0000 7fb8467fc700 1 -- 172.21.15.63:0/1981211644 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb84c03e280 con 0x7fb850064fd0 2020-05-18T21:32:58.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.893+0000 7fb856664700 1 -- 172.21.15.63:0/1981211644 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb85014b340 con 0x7fb850064fd0 2020-05-18T21:32:58.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.893+0000 7fb854e61700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb850064fd0 0x7fb85014d5d0 secure :-1 s=THROTTLE_DONE pgs=1288 cs=0 l=1 rx=0x7fb850060a90 tx=0x7fb84c00c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:32:58.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.893+0000 7fb8467fc700 1 -- 172.21.15.63:0/1981211644 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fb84c0418a0 con 0x7fb850064fd0 2020-05-18T21:32:58.897 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:32:58.898 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":75,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2619292063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2619292063},{"type":"v1","addr":"172.21.15.155:6835","nonce":2619292063}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:32:53.188564+0000","modified":"2020-05-18T21:32:54.910500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7842},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7842":{"gid":7842,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/468101601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":468101601},{"type":"v1","addr":"172.21.15.63:6833","nonce":468101601}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-05-18T21:32:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.893+0000 7fb856664700 1 -- 172.21.15.63:0/1981211644 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb83004fa30 msgr2=0x7fb830051ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.893+0000 7fb856664700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb83004fa30 0x7fb830051ef0 secure :-1 s=READY pgs=510 cs=0 l=1 rx=0x7fb840002f70 tx=0x7fb84000d750).stop 2020-05-18T21:32:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.893+0000 7fb856664700 1 -- 172.21.15.63:0/1981211644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb850064fd0 msgr2=0x7fb85014d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:32:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.893+0000 7fb856664700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb850064fd0 0x7fb85014d5d0 secure :-1 s=READY pgs=1288 cs=0 l=1 rx=0x7fb850060a90 tx=0x7fb84c00c800).stop 2020-05-18T21:32:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.893+0000 7fb856664700 1 -- 172.21.15.63:0/1981211644 shutdown_connections 2020-05-18T21:32:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.893+0000 7fb856664700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb83004fa30 0x7fb830051ef0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.893+0000 7fb856664700 1 --2- 172.21.15.63:0/1981211644 >> v2:172.21.15.155:3300/0 conn(0x7fb85014aa70 0x7fb850061d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.893+0000 7fb856664700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb850064fd0 0x7fb85014d5d0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.893+0000 7fb856664700 1 --2- 172.21.15.63:0/1981211644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb85005f110 0x7fb85014dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:32:58.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.893+0000 7fb856664700 1 -- 172.21.15.63:0/1981211644 >> 172.21.15.63:0/1981211644 conn(0x7fb850069fc0 msgr2=0x7fb850147d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:32:58.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.893+0000 7fb856664700 1 -- 172.21.15.63:0/1981211644 shutdown_connections 2020-05-18T21:32:58.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:32:58.893+0000 7fb856664700 1 -- 172.21.15.63:0/1981211644 wait complete. 2020-05-18T21:32:58.902 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 75 2020-05-18T21:32:59.111 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:32:53.188564+0000', 'modified': '2020-05-18T21:32:54.910500+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7842}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7842': {'gid': 7842, 'name': 'a', 'rank': 0, 'incarnation': 73, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/468101601', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 468101601}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 468101601}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:32:59.112 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:32:59.112 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:32:59.223 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:32:59.227 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:32:59.228 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:32:59.228 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 7842, 2020-05-18T21:32:59.228 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:32:59.228 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:32:59.228 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 6.0313357480000001, 2020-05-18T21:32:59.229 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 75, 2020-05-18T21:32:59.229 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 95, 2020-05-18T21:32:59.229 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 95, 2020-05-18T21:32:59.229 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 10.255445286 2020-05-18T21:32:59.229 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:32:59.232 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 7842, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.0313357480000001, "mdsmap_epoch": 75, "osdmap_epoch": 95, "osdmap_epoch_barrier": 95, "uptime": 10.255445286 } 2020-05-18T21:32:59.232 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:32:59.233 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:32:59.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.234 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:32:59.241 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:32:59.242 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:32:59.242 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:32:59.242 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:59.242 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:32:59.242 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:59.243 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:59.243 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:59.243 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:59.243 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:59.243 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:32:59.243 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:59.244 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:32:59.244 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:32:59.244 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:32:59.244 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42463sec preferred_lft 42463sec 2020-05-18T21:32:59.244 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:32:59.245 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:32:59.245 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:32:59.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.246 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:32:59.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.261 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:32:59.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.333 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:32:59.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.352 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:32:59.410 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:32:59.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.412 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:32:59.421 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:32:59.421 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:32:59.421 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:32:59.422 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:32:59.422 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:32:59.422 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:32:59.422 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:32:59.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.423 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:32:59.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.442 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:32:59.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.502 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:32:59.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.518 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:32:59.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.525 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:32:59.548 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:32:59.573 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:32:59.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.578 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:32:59.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.598 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-05-18T21:32:59.612 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-05-18T21:32:59.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.613 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-05-18T21:32:59.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.627 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:32:59.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.643 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-05-18T21:32:59.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.705 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-05-18T21:32:59.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.725 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-05-18T21:32:59.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.745 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 up' 2020-05-18T21:32:59.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:32:59.813 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.0 master ceph-brx' 2020-05-18T21:32:59.827 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-05-18T21:32:59.827 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-05-18T21:32:59.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:32:59.828 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:32:59.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:32:59.880 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:32:59.896 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:32:59.897 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:32:59.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:32:59.899 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:32:59.905 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:32:59.906 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:32:59.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:32:59.950 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:32:59.964 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:32:59.965 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:32:59.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:32:59.966 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:33:00.028 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2020-05-18T21:33:00.025+0000 7f3804e1a080 -1 init, newargv = 0x55a4d7ce0de0 newargc=9 2020-05-18T21:33:00.028 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[29250]: starting ceph client 2020-05-18T21:33:00.037 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[29250]: starting fuse 2020-05-18T21:33:01.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:01.072 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:33:01.092 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:33:01.093 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:33:01.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:01.094 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:33:01.145 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:33:01.146 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:33:01.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:01.147 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:33:01.147 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:33:01.148 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:33:01.148 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:33:01.149 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:33:01.149 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:01.149 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:33:01.150 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:33:01.150 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:33:01.151 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:01.151 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:33:01.151 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:33:01.152 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:33:01.152 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:33:01.153 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:01.153 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:33:01.154 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:33:01.154 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:33:01.154 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:33:01.155 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:33:01.155 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:01.156 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:33:01.156 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:33:01.209 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.29250.asok 2020-05-18T21:33:01.214 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.29250.asok 2020-05-18T21:33:01.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:01.215 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.29250.asok status 2020-05-18T21:33:01.359 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:01.359 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:33:01.359 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:33:01.360 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:33:01.360 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:33:01.360 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:33:01.360 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:33:01.360 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "29250", 2020-05-18T21:33:01.360 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:33:01.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:01.361 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:33:01.361 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:33:01.361 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 8037, 2020-05-18T21:33:01.361 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:33:01.362 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:33:01.362 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:33:01.362 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 8037 2020-05-18T21:33:01.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:01.362 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:33:01.363 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:01.363 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:33:01.363 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1710528347 2020-05-18T21:33:01.363 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:01.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:01.364 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:33:01.364 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:01.364 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:33:01.364 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1710528347 2020-05-18T21:33:01.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:01.365 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.8037 192.168.0.1:0/1710528347", 2020-05-18T21:33:01.365 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/1710528347", 2020-05-18T21:33:01.365 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:33:01.365 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 75, 2020-05-18T21:33:01.366 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 95, 2020-05-18T21:33:01.366 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:33:01.366 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:33:01.366 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:01.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:01.368 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:33:01.368 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:33:01.380 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:33:01.381 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-05-18T21:33:01.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:01.382 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:33:01.442 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo dd if=/dev/urandom of=file_a bs=1M conv=fdatasync count=8 seek=0) 2020-05-18T21:33:01.587 INFO:teuthology.orchestra.run.smithi063.stderr:8+0 records in 2020-05-18T21:33:01.587 INFO:teuthology.orchestra.run.smithi063.stderr:8+0 records out 2020-05-18T21:33:01.587 INFO:teuthology.orchestra.run.smithi063.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.11706 s, 71.7 MB/s 2020-05-18T21:33:01.589 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:33:01.589 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:33:01.590 INFO:teuthology.orchestra.run.smithi063:> import stat 2020-05-18T21:33:01.590 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:01.591 INFO:teuthology.orchestra.run.smithi063:> print(os.stat("/home/ubuntu/cephtest/mnt.0/file_a").st_ino) 2020-05-18T21:33:01.591 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:33:01.668 INFO:teuthology.orchestra.run.smithi063.stdout:1099511627776 2020-05-18T21:33:01.858 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo dd if=/dev/urandom of=file_b bs=1M conv=fdatasync count=8 seek=0) 2020-05-18T21:33:02.049 INFO:teuthology.orchestra.run.smithi063.stderr:8+0 records in 2020-05-18T21:33:02.049 INFO:teuthology.orchestra.run.smithi063.stderr:8+0 records out 2020-05-18T21:33:02.049 INFO:teuthology.orchestra.run.smithi063.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.126654 s, 66.2 MB/s 2020-05-18T21:33:02.050 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:33:02.051 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:33:02.051 INFO:teuthology.orchestra.run.smithi063:> import stat 2020-05-18T21:33:02.051 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:02.052 INFO:teuthology.orchestra.run.smithi063:> print(os.stat("/home/ubuntu/cephtest/mnt.0/file_b").st_ino) 2020-05-18T21:33:02.052 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:33:02.129 INFO:teuthology.orchestra.run.smithi063.stdout:1099511627777 2020-05-18T21:33:02.319 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:02.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.424+0000 7fb51cf6b700 1 Processor -- start 2020-05-18T21:33:02.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.424+0000 7fb51cf6b700 1 -- start start 2020-05-18T21:33:02.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb51cf6b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb5180b7cc0 0x7fb51806a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:02.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb51cf6b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb518145e60 0x7fb518149670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:02.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb51cf6b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5180b8160 con 0x7fb518146be0 2020-05-18T21:33:02.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb51cf6b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5181462d0 con 0x7fb5180b7cc0 2020-05-18T21:33:02.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb51cf6b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb518061c00 con 0x7fb518145e60 2020-05-18T21:33:02.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb515d9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb5180b7cc0 0x7fb51806a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:02.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb515d9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb5180b7cc0 0x7fb51806a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:46344/0 (socket says 172.21.15.63:46344) 2020-05-18T21:33:02.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb516d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb518145e60 0x7fb518149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:02.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb515d9b700 1 -- 172.21.15.63:0/3205602341 learned_addr learned my addr 172.21.15.63:0/3205602341 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:02.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb51659c700 1 --1- 172.21.15.63:0/3205602341 >> v1:172.21.15.155:6789/0 conn(0x7fb518146be0 0x7fb5180b5630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:60230/0 (socket says 172.21.15.63:60230) 2020-05-18T21:33:02.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb515d9b700 1 -- 172.21.15.63:0/3205602341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb518145e60 msgr2=0x7fb518149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:02.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb515d9b700 1 --2- 172.21.15.63:0/3205602341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb518145e60 0x7fb518149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:02.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb515d9b700 1 -- 172.21.15.63:0/3205602341 >> v1:172.21.15.155:6789/0 conn(0x7fb518146be0 legacy=0x7fb5180b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb51559a700 1 -- 172.21.15.63:0/3205602341 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576879003 0 0) 0x7fb5180b8160 con 0x7fb518146be0 2020-05-18T21:33:02.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb515d9b700 1 -- 172.21.15.63:0/3205602341 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb518061ea0 con 0x7fb5180b7cc0 2020-05-18T21:33:02.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb516d9d700 1 --2- 172.21.15.63:0/3205602341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb518145e60 0x7fb518149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:02.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb515d9b700 1 --2- 172.21.15.63:0/3205602341 >> v2:172.21.15.155:3300/0 conn(0x7fb5180b7cc0 0x7fb51806a280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb515d9b700 1 --2- 172.21.15.63:0/3205602341 >> v2:172.21.15.155:3300/0 conn(0x7fb5180b7cc0 0x7fb51806a280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb515d9b700 1 --2- 172.21.15.63:0/3205602341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5180b7cc0 0x7fb51806a280 secure :-1 s=READY pgs=885 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).ready entity=mon.1 client_cookie=338806c080c72d4d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:02.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb515d9b700 1 --2- 172.21.15.63:0/3205602341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5180b7cc0 0x7fb51806a280 secure :-1 s=THROTTLE_DONE pgs=885 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb515d9b700 1 --2- 172.21.15.63:0/3205602341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5180b7cc0 0x7fb51806a280 secure :-1 s=THROTTLE_DONE pgs=885 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb51559a700 1 -- 172.21.15.63:0/3205602341 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5080116b0 con 0x7fb5180b7cc0 2020-05-18T21:33:02.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb51559a700 1 -- 172.21.15.63:0/3205602341 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb508011810 con 0x7fb5180b7cc0 2020-05-18T21:33:02.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb515d9b700 1 --2- 172.21.15.63:0/3205602341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5180b7cc0 0x7fb51806a280 secure :-1 s=THROTTLE_DONE pgs=885 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb51559a700 1 -- 172.21.15.63:0/3205602341 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb508011c30 con 0x7fb5180b7cc0 2020-05-18T21:33:02.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb51cf6b700 1 -- 172.21.15.63:0/3205602341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5180b7cc0 msgr2=0x7fb51806a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb51cf6b700 1 --2- 172.21.15.63:0/3205602341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5180b7cc0 0x7fb51806a280 secure :-1 s=READY pgs=885 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).stop 2020-05-18T21:33:02.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb51cf6b700 1 -- 172.21.15.63:0/3205602341 shutdown_connections 2020-05-18T21:33:02.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb51cf6b700 1 --2- 172.21.15.63:0/3205602341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb518145e60 0x7fb518149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:02.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb51cf6b700 1 --2- 172.21.15.63:0/3205602341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5180b7cc0 0x7fb51806a280 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:02.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb51cf6b700 1 -- 172.21.15.63:0/3205602341 >> 172.21.15.63:0/3205602341 conn(0x7fb51805b240 msgr2=0x7fb518069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:02.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb51cf6b700 1 -- 172.21.15.63:0/3205602341 shutdown_connections 2020-05-18T21:33:02.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.428+0000 7fb51cf6b700 1 -- 172.21.15.63:0/3205602341 wait complete. 2020-05-18T21:33:02.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.432+0000 7fb51cf6b700 1 Processor -- start 2020-05-18T21:33:02.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.432+0000 7fb51cf6b700 1 -- start start 2020-05-18T21:33:02.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.432+0000 7fb51cf6b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5180b7cc0 0x7fb5180b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:02.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.432+0000 7fb51cf6b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb518145e60 0x7fb518142a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:02.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.432+0000 7fb51cf6b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb518142e80 con 0x7fb518146be0 2020-05-18T21:33:02.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.432+0000 7fb51cf6b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5180afe20 con 0x7fb518145e60 2020-05-18T21:33:02.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.432+0000 7fb51cf6b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51809d970 con 0x7fb5180b7cc0 2020-05-18T21:33:02.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.432+0000 7fb515d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb518145e60 0x7fb518142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:02.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.432+0000 7fb515d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb518145e60 0x7fb518142a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59734/0 (socket says 172.21.15.63:59734) 2020-05-18T21:33:02.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.432+0000 7fb515d9b700 1 -- 172.21.15.63:0/276767837 learned_addr learned my addr 172.21.15.63:0/276767837 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:02.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.432+0000 7fb51659c700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5180b7cc0 0x7fb5180b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:02.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.432+0000 7fb515d9b700 1 -- 172.21.15.63:0/276767837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5180b7cc0 msgr2=0x7fb5180b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.432+0000 7fb515d9b700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5180b7cc0 0x7fb5180b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:02.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.432+0000 7fb515d9b700 1 -- 172.21.15.63:0/276767837 >> v1:172.21.15.155:6789/0 conn(0x7fb518146be0 legacy=0x7fb51808f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.432+0000 7fb515d9b700 1 -- 172.21.15.63:0/276767837 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51809dae0 con 0x7fb518145e60 2020-05-18T21:33:02.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.432+0000 7fb515d9b700 1 --2- 172.21.15.63:0/276767837 >> v2:172.21.15.63:3300/0 conn(0x7fb518145e60 0x7fb518142a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.432+0000 7fb515d9b700 1 --2- 172.21.15.63:0/276767837 >> v2:172.21.15.63:3300/0 conn(0x7fb518145e60 0x7fb518142a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.432+0000 7fb515d9b700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb518145e60 0x7fb518142a20 secure :-1 s=READY pgs=1292 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:02.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.436+0000 7fb515d9b700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb518145e60 0x7fb518142a20 secure :-1 s=THROTTLE_DONE pgs=1292 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.436+0000 7fb5077fe700 1 -- 172.21.15.63:0/276767837 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb508007360 con 0x7fb518145e60 2020-05-18T21:33:02.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.436+0000 7fb515d9b700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb518145e60 0x7fb518142a20 secure :-1 s=THROTTLE_DONE pgs=1292 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.436+0000 7fb515d9b700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb518145e60 0x7fb518142a20 secure :-1 s=THROTTLE_DONE pgs=1292 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.436+0000 7fb5077fe700 1 -- 172.21.15.63:0/276767837 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5080074c0 con 0x7fb518145e60 2020-05-18T21:33:02.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.436+0000 7fb51cf6b700 1 -- 172.21.15.63:0/276767837 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51809e140 con 0x7fb518145e60 2020-05-18T21:33:02.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.436+0000 7fb5077fe700 1 -- 172.21.15.63:0/276767837 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5080058f0 con 0x7fb518145e60 2020-05-18T21:33:02.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.436+0000 7fb51cf6b700 1 -- 172.21.15.63:0/276767837 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51809ea50 con 0x7fb518145e60 2020-05-18T21:33:02.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.436+0000 7fb515d9b700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb518145e60 0x7fb518142a20 secure :-1 s=THROTTLE_DONE pgs=1292 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.436+0000 7fb51cf6b700 1 -- 172.21.15.63:0/276767837 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5180569e0 con 0x7fb518145e60 2020-05-18T21:33:02.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.436+0000 7fb5077fe700 1 -- 172.21.15.63:0/276767837 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb5080080e0 con 0x7fb518145e60 2020-05-18T21:33:02.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.436+0000 7fb515d9b700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb518145e60 0x7fb518142a20 secure :-1 s=THROTTLE_DONE pgs=1292 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.436+0000 7fb5077fe700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4f404fb80 0x7fb4f4052040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:02.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.436+0000 7fb5077fe700 1 -- 172.21.15.63:0/276767837 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb5080642a0 con 0x7fb518145e60 2020-05-18T21:33:02.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.436+0000 7fb51659c700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4f404fb80 0x7fb4f4052040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:02.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.440+0000 7fb51659c700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4f404fb80 0x7fb4f4052040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb50c000ed0 tx=0x7fb50c001e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.440+0000 7fb51659c700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4f404fb80 0x7fb4f4052040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb50c000ed0 tx=0x7fb50c001e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.440+0000 7fb51659c700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4f404fb80 0x7fb4f4052040 secure :-1 s=READY pgs=511 cs=0 l=1 rx=0x7fb50c000ed0 tx=0x7fb50c001e50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:02.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.444+0000 7fb515d9b700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb518145e60 0x7fb518142a20 secure :-1 s=THROTTLE_DONE pgs=1292 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.444+0000 7fb5077fe700 1 -- 172.21.15.63:0/276767837 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb50803e690 con 0x7fb518145e60 2020-05-18T21:33:02.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.596+0000 7fb51cf6b700 1 -- 172.21.15.63:0/276767837 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb51809dc70 con 0x7fb518145e60 2020-05-18T21:33:02.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.596+0000 7fb515d9b700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb518145e60 0x7fb518142a20 secure :-1 s=THROTTLE_DONE pgs=1292 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.596+0000 7fb5077fe700 1 -- 172.21.15.63:0/276767837 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fb508041cb0 con 0x7fb518145e60 2020-05-18T21:33:02.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.596+0000 7fb51cf6b700 1 -- 172.21.15.63:0/276767837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4f404fb80 msgr2=0x7fb4f4052040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.596+0000 7fb51cf6b700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4f404fb80 0x7fb4f4052040 secure :-1 s=READY pgs=511 cs=0 l=1 rx=0x7fb50c000ed0 tx=0x7fb50c001e50).stop 2020-05-18T21:33:02.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.596+0000 7fb51cf6b700 1 -- 172.21.15.63:0/276767837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb518145e60 msgr2=0x7fb518142a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.596+0000 7fb51cf6b700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb518145e60 0x7fb518142a20 secure :-1 s=READY pgs=1292 cs=0 l=1 rx=0x7fb508002f70 tx=0x7fb508007a80).stop 2020-05-18T21:33:02.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.596+0000 7fb51cf6b700 1 -- 172.21.15.63:0/276767837 shutdown_connections 2020-05-18T21:33:02.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.596+0000 7fb51cf6b700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb4f404fb80 0x7fb4f4052040 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:02.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.596+0000 7fb51cf6b700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb518145e60 0x7fb518142a20 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:02.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.596+0000 7fb51cf6b700 1 --2- 172.21.15.63:0/276767837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5180b7cc0 0x7fb5180b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:02.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.596+0000 7fb51cf6b700 1 -- 172.21.15.63:0/276767837 >> 172.21.15.63:0/276767837 conn(0x7fb51805b240 msgr2=0x7fb5180b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:02.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.596+0000 7fb51cf6b700 1 -- 172.21.15.63:0/276767837 shutdown_connections 2020-05-18T21:33:02.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.596+0000 7fb51cf6b700 1 -- 172.21.15.63:0/276767837 wait complete. 2020-05-18T21:33:02.609 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:02.610 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":75,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2619292063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2619292063},{"type":"v1","addr":"172.21.15.155:6835","nonce":2619292063}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:32:53.188564+0000","modified":"2020-05-18T21:32:54.910500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7842},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7842":{"gid":7842,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/468101601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":468101601},{"type":"v1","addr":"172.21.15.63:6833","nonce":468101601}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-05-18T21:33:02.611 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 75 2020-05-18T21:33:02.615 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush journal 2020-05-18T21:33:02.739 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:02.739 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "", 2020-05-18T21:33:02.740 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0 2020-05-18T21:33:02.740 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:02.749 INFO:tasks.cephfs.filesystem:_json_asok output: { "message": "", "return_code": 0 } 2020-05-18T21:33:02.750 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_data getxattr 10000000000.00000000 parent 2020-05-18T21:33:02.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff8306b3b80 1 Processor -- start 2020-05-18T21:33:02.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff8306b3b80 1 -- start start 2020-05-18T21:33:02.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff8306b3b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x55ca237b95e0 0x55ca237b5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:02.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff8306b3b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55ca2372b660 0x55ca2372bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:02.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff8306b3b80 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55ca2366a460 con 0x7ff81c002300 2020-05-18T21:33:02.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff8306b3b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ca23696800 con 0x55ca2372b660 2020-05-18T21:33:02.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff8306b3b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ca23676110 con 0x55ca237b95e0 2020-05-18T21:33:02.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff82f2f7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55ca2372b660 0x55ca2372bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:02.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff82f2f7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55ca2372b660 0x55ca2372bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59756/0 (socket says 172.21.15.63:59756) 2020-05-18T21:33:02.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff82f2f7700 1 -- 172.21.15.63:0/1034821217 learned_addr learned my addr 172.21.15.63:0/1034821217 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:02.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff82e2f5700 1 --2- 172.21.15.63:0/1034821217 >> v2:172.21.15.155:3300/0 conn(0x55ca237b95e0 0x55ca237b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:02.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff82f2f7700 1 -- 172.21.15.63:0/1034821217 >> v2:172.21.15.155:3300/0 conn(0x55ca237b95e0 msgr2=0x55ca237b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:02.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff82f2f7700 1 --2- 172.21.15.63:0/1034821217 >> v2:172.21.15.155:3300/0 conn(0x55ca237b95e0 0x55ca237b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:02.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff82f2f7700 1 -- 172.21.15.63:0/1034821217 >> v1:172.21.15.155:6789/0 conn(0x7ff81c002300 legacy=0x55ca237b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff82f2f7700 1 -- 172.21.15.63:0/1034821217 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca2372cf00 con 0x55ca2372b660 2020-05-18T21:33:02.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff82f2f7700 1 --2- 172.21.15.63:0/1034821217 >> v2:172.21.15.63:3300/0 conn(0x55ca2372b660 0x55ca2372bab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x55ca2372b150 tx=0x7ff82800b550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff82f2f7700 1 --2- 172.21.15.63:0/1034821217 >> v2:172.21.15.63:3300/0 conn(0x55ca2372b660 0x55ca2372bab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x55ca2372b150 tx=0x7ff82800b550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff82f2f7700 1 --2- 172.21.15.63:0/1034821217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca2372b660 0x55ca2372bab0 secure :-1 s=READY pgs=1295 cs=0 l=1 rx=0x55ca2372b150 tx=0x7ff82800b550).ready entity=mon.0 client_cookie=ce3ef73dd6bb95f8 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:02.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff82f2f7700 1 --2- 172.21.15.63:0/1034821217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca2372b660 0x55ca2372bab0 secure :-1 s=THROTTLE_DONE pgs=1295 cs=0 l=1 rx=0x55ca2372b150 tx=0x7ff82800b550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff82caf2700 1 -- 172.21.15.63:0/1034821217 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff82800bb40 con 0x55ca2372b660 2020-05-18T21:33:02.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff82f2f7700 1 --2- 172.21.15.63:0/1034821217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca2372b660 0x55ca2372bab0 secure :-1 s=THROTTLE_DONE pgs=1295 cs=0 l=1 rx=0x55ca2372b150 tx=0x7ff82800b550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff82caf2700 1 -- 172.21.15.63:0/1034821217 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82800bca0 con 0x55ca2372b660 2020-05-18T21:33:02.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff82f2f7700 1 --2- 172.21.15.63:0/1034821217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca2372b660 0x55ca2372bab0 secure :-1 s=THROTTLE_DONE pgs=1295 cs=0 l=1 rx=0x55ca2372b150 tx=0x7ff82800b550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff82caf2700 1 -- 172.21.15.63:0/1034821217 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff828010630 con 0x55ca2372b660 2020-05-18T21:33:02.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff8306b3b80 1 -- 172.21.15.63:0/1034821217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca2372b660 msgr2=0x55ca2372bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.776+0000 7ff8306b3b80 1 --2- 172.21.15.63:0/1034821217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca2372b660 0x55ca2372bab0 secure :-1 s=READY pgs=1295 cs=0 l=1 rx=0x55ca2372b150 tx=0x7ff82800b550).stop 2020-05-18T21:33:02.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff8306b3b80 1 -- 172.21.15.63:0/1034821217 shutdown_connections 2020-05-18T21:33:02.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff8306b3b80 1 --2- 172.21.15.63:0/1034821217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca2372b660 0x55ca2372bab0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:02.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff8306b3b80 1 --2- 172.21.15.63:0/1034821217 >> v2:172.21.15.155:3300/0 conn(0x55ca237b95e0 0x55ca237b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:02.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff8306b3b80 1 -- 172.21.15.63:0/1034821217 >> 172.21.15.63:0/1034821217 conn(0x55ca2372d850 msgr2=0x55ca236e9990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:02.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff8306b3b80 1 -- 172.21.15.63:0/1034821217 shutdown_connections 2020-05-18T21:33:02.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff8306b3b80 1 -- 172.21.15.63:0/1034821217 wait complete. 2020-05-18T21:33:02.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff8306b3b80 1 Processor -- start 2020-05-18T21:33:02.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff8306b3b80 1 -- start start 2020-05-18T21:33:02.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff8306b3b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55ca2372b660 0x55ca237b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:02.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff8306b3b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ca237b95e0 0x55ca23726540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:02.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff8306b3b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55ca237292f0 con 0x7ff81c002300 2020-05-18T21:33:02.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff8306b3b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ca23666a40 con 0x55ca2372b660 2020-05-18T21:33:02.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff8306b3b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca23729590 con 0x55ca237b95e0 2020-05-18T21:33:02.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff82f2f7700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff81c002300 0x55ca237b4030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33718/0 (socket says 172.21.15.63:33718) 2020-05-18T21:33:02.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff82f2f7700 1 -- 172.21.15.63:0/1185216547 learned_addr learned my addr 172.21.15.63:0/1185216547 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:02.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff82e2f5700 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ca237b95e0 0x55ca23726540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:02.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff82eaf6700 1 --2- 172.21.15.63:0/1185216547 >> v2:172.21.15.63:3300/0 conn(0x55ca2372b660 0x55ca237b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:02.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff827fff700 1 -- 172.21.15.63:0/1185216547 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665195155 0 0) 0x55ca237292f0 con 0x7ff81c002300 2020-05-18T21:33:02.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff827fff700 1 -- 172.21.15.63:0/1185216547 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff810002020 con 0x7ff81c002300 2020-05-18T21:33:02.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff827fff700 1 -- 172.21.15.63:0/1185216547 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3338212040 0 0) 0x7ff810002020 con 0x7ff81c002300 2020-05-18T21:33:02.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff82e2f5700 1 -- 172.21.15.63:0/1185216547 >> v2:172.21.15.63:3300/0 conn(0x55ca2372b660 msgr2=0x55ca237b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff82e2f5700 1 --2- 172.21.15.63:0/1185216547 >> v2:172.21.15.63:3300/0 conn(0x55ca2372b660 0x55ca237b5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:02.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff82e2f5700 1 -- 172.21.15.63:0/1185216547 >> v1:172.21.15.63:6789/0 conn(0x7ff81c002300 legacy=0x55ca237b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff82e2f5700 1 -- 172.21.15.63:0/1185216547 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca23729830 con 0x55ca237b95e0 2020-05-18T21:33:02.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.780+0000 7ff82eaf6700 1 --2- 172.21.15.63:0/1185216547 >> v2:172.21.15.63:3300/0 conn(0x55ca2372b660 0x55ca237b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:02.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff82e2f5700 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ca237b95e0 0x55ca23726540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x55ca23725a10 tx=0x7ff81800f7d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff82e2f5700 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ca237b95e0 0x55ca23726540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x55ca23725a10 tx=0x7ff81800f7d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff82e2f5700 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ca237b95e0 0x55ca23726540 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x55ca23725a10 tx=0x7ff81800f7d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:02.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff82e2f5700 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ca237b95e0 0x55ca23726540 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x55ca23725a10 tx=0x7ff81800f7d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff827fff700 1 -- 172.21.15.63:0/1185216547 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff828010a40 con 0x55ca237b95e0 2020-05-18T21:33:02.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff82e2f5700 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ca237b95e0 0x55ca23726540 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x55ca23725a10 tx=0x7ff81800f7d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff827fff700 1 -- 172.21.15.63:0/1185216547 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff818001ca0 con 0x55ca237b95e0 2020-05-18T21:33:02.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff82e2f5700 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ca237b95e0 0x55ca23726540 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x55ca23725a10 tx=0x7ff81800f7d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff8306b3b80 1 -- 172.21.15.63:0/1185216547 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ca23724600 con 0x55ca237b95e0 2020-05-18T21:33:02.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff827fff700 1 -- 172.21.15.63:0/1185216547 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff81800b3d0 con 0x55ca237b95e0 2020-05-18T21:33:02.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff8306b3b80 1 -- 172.21.15.63:0/1185216547 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca237b64e0 con 0x55ca237b95e0 2020-05-18T21:33:02.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff82e2f5700 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ca237b95e0 0x55ca23726540 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x55ca23725a10 tx=0x7ff81800f7d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff827fff700 1 -- 172.21.15.63:0/1185216547 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff81800b5d0 con 0x55ca237b95e0 2020-05-18T21:33:02.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff82e2f5700 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ca237b95e0 0x55ca23726540 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x55ca23725a10 tx=0x7ff81800f7d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff827fff700 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff81004e940 0x7ff810050e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:02.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff827fff700 1 -- 172.21.15.63:0/1185216547 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff818062570 con 0x55ca237b95e0 2020-05-18T21:33:02.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff8306b3b80 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x55ca237269a0 0x55ca237d2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:02.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff8306b3b80 1 -- 172.21.15.63:0/1185216547 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- osd_op(unknown.0.0:1 18.0 18:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected e95) v8 -- 0x55ca237d2dc0 con 0x55ca237269a0 2020-05-18T21:33:02.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff82eaf6700 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff81004e940 0x7ff810050e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:02.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.784+0000 7ff82f2f7700 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x55ca237269a0 0x55ca237d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:02.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.788+0000 7ff82eaf6700 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff81004e940 0x7ff810050e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x55ca2370ff50 tx=0x7ff820006af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.788+0000 7ff82f2f7700 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x55ca237269a0 0x55ca237d2910 crc :-1 s=READY pgs=30 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:02.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.788+0000 7ff82eaf6700 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff81004e940 0x7ff810050e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x55ca2370ff50 tx=0x7ff820006af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.788+0000 7ff82eaf6700 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff81004e940 0x7ff810050e00 secure :-1 s=READY pgs=512 cs=0 l=1 rx=0x55ca2370ff50 tx=0x7ff820006af0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:02.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.788+0000 7ff82f2f7700 1 -- 172.21.15.63:0/1185216547 <== osd.0 v2:172.21.15.63:6800/12803 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x7ff82800d810 con 0x55ca237269a0 2020-05-18T21:33:02.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.788+0000 7ff8306b3b80 1 -- 172.21.15.63:0/1185216547 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x55ca237269a0 msgr2=0x55ca237d2910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.788+0000 7ff8306b3b80 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x55ca237269a0 0x55ca237d2910 crc :-1 s=READY pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:02.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.788+0000 7ff8306b3b80 1 -- 172.21.15.63:0/1185216547 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff81004e940 msgr2=0x7ff810050e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.788+0000 7ff8306b3b80 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff81004e940 0x7ff810050e00 secure :-1 s=READY pgs=512 cs=0 l=1 rx=0x55ca2370ff50 tx=0x7ff820006af0).stop 2020-05-18T21:33:02.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.788+0000 7ff8306b3b80 1 -- 172.21.15.63:0/1185216547 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ca237b95e0 msgr2=0x55ca23726540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.788+0000 7ff8306b3b80 1 --2- 172.21.15.63:0/1185216547 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55ca237b95e0 0x55ca23726540 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x55ca23725a10 tx=0x7ff81800f7d0).stop 2020-05-18T21:33:02.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.788+0000 7ff82f2f7700 1 -- 172.21.15.63:0/1185216547 reap_dead start 2020-05-18T21:33:02.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.788+0000 7ff8306b3b80 1 -- 172.21.15.63:0/1185216547 shutdown_connections 2020-05-18T21:33:02.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.788+0000 7ff8306b3b80 1 -- 172.21.15.63:0/1185216547 >> 172.21.15.63:0/1185216547 conn(0x55ca2372d850 msgr2=0x55ca237bd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:02.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.788+0000 7ff8306b3b80 1 -- 172.21.15.63:0/1185216547 shutdown_connections 2020-05-18T21:33:02.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.788+0000 7ff8306b3b80 1 -- 172.21.15.63:0/1185216547 wait complete. 2020-05-18T21:33:02.860 INFO:teuthology.orchestra.run.smithi063.stdout:8file_a 2020-05-18T21:33:02.861 INFO:teuthology.orchestra.run.smithi063:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2020-05-18T21:33:02.891 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:02.892 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1099511627776, 2020-05-18T21:33:02.892 INFO:teuthology.orchestra.run.smithi063.stdout: "ancestors": [ 2020-05-18T21:33:02.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:02.893 INFO:teuthology.orchestra.run.smithi063.stdout: "dirino": 1, 2020-05-18T21:33:02.893 INFO:teuthology.orchestra.run.smithi063.stdout: "dname": "file_a", 2020-05-18T21:33:02.893 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 6 2020-05-18T21:33:02.893 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:02.894 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:33:02.894 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 18, 2020-05-18T21:33:02.894 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [] 2020-05-18T21:33:02.894 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:02.895 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:02.896 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_data getxattr 10000000001.00000000 parent 2020-05-18T21:33:02.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.924+0000 7fc14f41fb80 1 Processor -- start 2020-05-18T21:33:02.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.924+0000 7fc14f41fb80 1 -- start start 2020-05-18T21:33:02.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.924+0000 7fc14f41fb80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x55611431c670 0x5561143c18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:02.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.924+0000 7fc14f41fb80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8a60 0x5561143c2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:02.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.924+0000 7fc14f41fb80 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55611429cd20 con 0x5561143c8680 2020-05-18T21:33:02.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.924+0000 7fc14f41fb80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x556114274a40 con 0x55611431c670 2020-05-18T21:33:02.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.924+0000 7fc14f41fb80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55611433a060 con 0x5561143c8a60 2020-05-18T21:33:02.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.924+0000 7fc14e063700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8a60 0x5561143c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:02.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.924+0000 7fc14d862700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x55611431c670 0x5561143c18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:02.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.924+0000 7fc14d061700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x5561143c8680 0x55611433adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:60280/0 (socket says 172.21.15.63:60280) 2020-05-18T21:33:02.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.924+0000 7fc14d061700 1 -- 172.21.15.63:0/2512658731 learned_addr learned my addr 172.21.15.63:0/2512658731 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:02.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc1477fe700 1 -- 172.21.15.63:0/2512658731 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113844211 0 0) 0x55611429cd20 con 0x5561143c8680 2020-05-18T21:33:02.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14e063700 1 -- 172.21.15.63:0/2512658731 >> v2:172.21.15.155:3300/0 conn(0x55611431c670 msgr2=0x5561143c18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:02.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14e063700 1 --2- 172.21.15.63:0/2512658731 >> v2:172.21.15.155:3300/0 conn(0x55611431c670 0x5561143c18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:02.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14e063700 1 -- 172.21.15.63:0/2512658731 >> v1:172.21.15.155:6789/0 conn(0x5561143c8680 legacy=0x55611433adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14e063700 1 -- 172.21.15.63:0/2512658731 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561142984b0 con 0x5561143c8a60 2020-05-18T21:33:02.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14e063700 1 --2- 172.21.15.63:0/2512658731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8a60 0x5561143c2250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x5561143385b0 tx=0x7fc148006fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14e063700 1 --2- 172.21.15.63:0/2512658731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8a60 0x5561143c2250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x5561143385b0 tx=0x7fc148006fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14e063700 1 --2- 172.21.15.63:0/2512658731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8a60 0x5561143c2250 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x5561143385b0 tx=0x7fc148006fa0).ready entity=mon.2 client_cookie=4414d33c561e0fc6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:02.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14e063700 1 --2- 172.21.15.63:0/2512658731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8a60 0x5561143c2250 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x5561143385b0 tx=0x7fc148006fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc1477fe700 1 -- 172.21.15.63:0/2512658731 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc148008e50 con 0x5561143c8a60 2020-05-18T21:33:02.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14e063700 1 --2- 172.21.15.63:0/2512658731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8a60 0x5561143c2250 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x5561143385b0 tx=0x7fc148006fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc1477fe700 1 -- 172.21.15.63:0/2512658731 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc148006360 con 0x5561143c8a60 2020-05-18T21:33:02.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14e063700 1 --2- 172.21.15.63:0/2512658731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8a60 0x5561143c2250 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x5561143385b0 tx=0x7fc148006fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14f41fb80 1 -- 172.21.15.63:0/2512658731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8a60 msgr2=0x5561143c2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc1477fe700 1 -- 172.21.15.63:0/2512658731 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1480064d0 con 0x5561143c8a60 2020-05-18T21:33:02.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14f41fb80 1 --2- 172.21.15.63:0/2512658731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8a60 0x5561143c2250 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x5561143385b0 tx=0x7fc148006fa0).stop 2020-05-18T21:33:02.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14f41fb80 1 -- 172.21.15.63:0/2512658731 shutdown_connections 2020-05-18T21:33:02.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14f41fb80 1 --2- 172.21.15.63:0/2512658731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8a60 0x5561143c2250 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:02.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14f41fb80 1 --2- 172.21.15.63:0/2512658731 >> v2:172.21.15.155:3300/0 conn(0x55611431c670 0x5561143c18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:02.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14f41fb80 1 -- 172.21.15.63:0/2512658731 >> 172.21.15.63:0/2512658731 conn(0x55611433b850 msgr2=0x5561142f7740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:02.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14f41fb80 1 -- 172.21.15.63:0/2512658731 shutdown_connections 2020-05-18T21:33:02.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14f41fb80 1 -- 172.21.15.63:0/2512658731 wait complete. 2020-05-18T21:33:02.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14f41fb80 1 Processor -- start 2020-05-18T21:33:02.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.928+0000 7fc14f41fb80 1 -- start start 2020-05-18T21:33:02.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14f41fb80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8680 0x55611433acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:02.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14f41fb80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x5561143c8a60 0x55611431ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:02.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14f41fb80 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x556114278460 con 0x55611431c670 2020-05-18T21:33:02.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14f41fb80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x5561143377e0 con 0x5561143c8a60 2020-05-18T21:33:02.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14f41fb80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561143c6970 con 0x5561143c8680 2020-05-18T21:33:02.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14d061700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8680 0x55611433acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:02.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14d862700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x55611431c670 0x5561143c0140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:60284/0 (socket says 172.21.15.63:60284) 2020-05-18T21:33:02.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14e063700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x5561143c8a60 0x55611431ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:02.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14d862700 1 -- 172.21.15.63:0/3204491595 learned_addr learned my addr 172.21.15.63:0/3204491595 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:02.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14d061700 1 -- 172.21.15.63:0/3204491595 >> v2:172.21.15.155:3300/0 conn(0x5561143c8a60 msgr2=0x55611431ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14d061700 1 --2- 172.21.15.63:0/3204491595 >> v2:172.21.15.155:3300/0 conn(0x5561143c8a60 0x55611431ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:02.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14d061700 1 -- 172.21.15.63:0/3204491595 >> v1:172.21.15.155:6789/0 conn(0x55611431c670 legacy=0x5561143c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14d061700 1 -- 172.21.15.63:0/3204491595 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556114339b50 con 0x5561143c8680 2020-05-18T21:33:02.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14e063700 1 --2- 172.21.15.63:0/3204491595 >> v2:172.21.15.155:3300/0 conn(0x5561143c8a60 0x55611431ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:02.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14d061700 1 --2- 172.21.15.63:0/3204491595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8680 0x55611433acf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc1380030b0 tx=0x7fc13800f630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14d061700 1 --2- 172.21.15.63:0/3204491595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8680 0x55611433acf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc1380030b0 tx=0x7fc13800f630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14d061700 1 --2- 172.21.15.63:0/3204491595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8680 0x55611433acf0 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7fc1380030b0 tx=0x7fc13800f630).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:02.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14d061700 1 --2- 172.21.15.63:0/3204491595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8680 0x55611433acf0 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7fc1380030b0 tx=0x7fc13800f630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc146ffd700 1 -- 172.21.15.63:0/3204491595 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc138004a70 con 0x5561143c8680 2020-05-18T21:33:02.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14d061700 1 --2- 172.21.15.63:0/3204491595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8680 0x55611433acf0 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7fc1380030b0 tx=0x7fc13800f630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14d061700 1 --2- 172.21.15.63:0/3204491595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8680 0x55611433acf0 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7fc1380030b0 tx=0x7fc13800f630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc146ffd700 1 -- 172.21.15.63:0/3204491595 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc138004bd0 con 0x5561143c8680 2020-05-18T21:33:02.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14f41fb80 1 -- 172.21.15.63:0/3204491595 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556114337540 con 0x5561143c8680 2020-05-18T21:33:02.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc146ffd700 1 -- 172.21.15.63:0/3204491595 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc138007550 con 0x5561143c8680 2020-05-18T21:33:02.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.932+0000 7fc14f41fb80 1 -- 172.21.15.63:0/3204491595 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556114337c80 con 0x5561143c8680 2020-05-18T21:33:02.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.936+0000 7fc14d061700 1 --2- 172.21.15.63:0/3204491595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8680 0x55611433acf0 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7fc1380030b0 tx=0x7fc13800f630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.936+0000 7fc146ffd700 1 -- 172.21.15.63:0/3204491595 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc1380077c0 con 0x5561143c8680 2020-05-18T21:33:02.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.936+0000 7fc14d061700 1 --2- 172.21.15.63:0/3204491595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8680 0x55611433acf0 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7fc1380030b0 tx=0x7fc13800f630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.936+0000 7fc146ffd700 1 --2- 172.21.15.63:0/3204491595 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc13004e500 0x7fc1300509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:02.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.936+0000 7fc146ffd700 1 -- 172.21.15.63:0/3204491595 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc138062b00 con 0x5561143c8680 2020-05-18T21:33:02.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.936+0000 7fc14d862700 1 --2- 172.21.15.63:0/3204491595 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc13004e500 0x7fc1300509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:02.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.936+0000 7fc14f41fb80 1 --2- 172.21.15.63:0/3204491595 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x5561143de290 0x5561143e0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:02.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.936+0000 7fc14f41fb80 1 -- 172.21.15.63:0/3204491595 --> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] -- osd_op(unknown.0.0:1 18.7 18:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected e95) v8 -- 0x556114331c70 con 0x5561143de290 2020-05-18T21:33:02.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.936+0000 7fc14e063700 1 --2- 172.21.15.63:0/3204491595 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x5561143de290 0x5561143e0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:02.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.936+0000 7fc14d862700 1 --2- 172.21.15.63:0/3204491595 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc13004e500 0x7fc1300509c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x5561143384b0 tx=0x7fc14000d770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.936+0000 7fc14d862700 1 --2- 172.21.15.63:0/3204491595 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc13004e500 0x7fc1300509c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x5561143384b0 tx=0x7fc14000d770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:02.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.936+0000 7fc14d862700 1 --2- 172.21.15.63:0/3204491595 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc13004e500 0x7fc1300509c0 secure :-1 s=READY pgs=513 cs=0 l=1 rx=0x5561143384b0 tx=0x7fc14000d770).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:02.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.936+0000 7fc14e063700 1 --2- 172.21.15.63:0/3204491595 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x5561143de290 0x5561143e0680 crc :-1 s=READY pgs=20 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:02.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.940+0000 7fc14e063700 1 -- 172.21.15.63:0/3204491595 <== osd.2 v2:172.21.15.63:6822/12806 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (62) out=62b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x7fc148007520 con 0x5561143de290 2020-05-18T21:33:02.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.940+0000 7fc14f41fb80 1 -- 172.21.15.63:0/3204491595 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x5561143de290 msgr2=0x5561143e0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.940+0000 7fc14f41fb80 1 --2- 172.21.15.63:0/3204491595 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x5561143de290 0x5561143e0680 crc :-1 s=READY pgs=20 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:02.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.940+0000 7fc14f41fb80 1 -- 172.21.15.63:0/3204491595 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc13004e500 msgr2=0x7fc1300509c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.940+0000 7fc14f41fb80 1 --2- 172.21.15.63:0/3204491595 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc13004e500 0x7fc1300509c0 secure :-1 s=READY pgs=513 cs=0 l=1 rx=0x5561143384b0 tx=0x7fc14000d770).stop 2020-05-18T21:33:02.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.940+0000 7fc14f41fb80 1 -- 172.21.15.63:0/3204491595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8680 msgr2=0x55611433acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:02.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.940+0000 7fc14f41fb80 1 --2- 172.21.15.63:0/3204491595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5561143c8680 0x55611433acf0 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7fc1380030b0 tx=0x7fc13800f630).stop 2020-05-18T21:33:02.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.940+0000 7fc14e063700 1 -- 172.21.15.63:0/3204491595 reap_dead start 2020-05-18T21:33:02.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.940+0000 7fc14f41fb80 1 -- 172.21.15.63:0/3204491595 shutdown_connections 2020-05-18T21:33:02.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.940+0000 7fc14f41fb80 1 -- 172.21.15.63:0/3204491595 >> 172.21.15.63:0/3204491595 conn(0x55611433b850 msgr2=0x556114339270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:02.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.940+0000 7fc14f41fb80 1 -- 172.21.15.63:0/3204491595 shutdown_connections 2020-05-18T21:33:02.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:02.940+0000 7fc14f41fb80 1 -- 172.21.15.63:0/3204491595 wait complete. 2020-05-18T21:33:02.966 INFO:teuthology.orchestra.run.smithi063.stdout:8file_b  2020-05-18T21:33:02.966 INFO:teuthology.orchestra.run.smithi063:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2020-05-18T21:33:03.021 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:03.022 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1099511627777, 2020-05-18T21:33:03.022 INFO:teuthology.orchestra.run.smithi063.stdout: "ancestors": [ 2020-05-18T21:33:03.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:03.023 INFO:teuthology.orchestra.run.smithi063.stdout: "dirino": 1, 2020-05-18T21:33:03.023 INFO:teuthology.orchestra.run.smithi063.stdout: "dname": "file_b", 2020-05-18T21:33:03.023 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 12 2020-05-18T21:33:03.024 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:03.024 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:33:03.024 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 18, 2020-05-18T21:33:03.025 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [] 2020-05-18T21:33:03.025 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:03.025 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:03.028 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mv file_a file_b) 2020-05-18T21:33:03.060 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:03.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.212+0000 7f19dabc3700 1 Processor -- start 2020-05-18T21:33:03.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.212+0000 7f19dabc3700 1 -- start start 2020-05-18T21:33:03.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.212+0000 7f19dabc3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f19d4061500 0x7f19d4065e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:03.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.212+0000 7f19dabc3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4143110 0x7f19d40650e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:03.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.212+0000 7f19dabc3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d4146850 con 0x7f19d4142c90 2020-05-18T21:33:03.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.212+0000 7f19dabc3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d413c9c0 con 0x7f19d4061500 2020-05-18T21:33:03.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.212+0000 7f19dabc3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d4142550 con 0x7f19d4143110 2020-05-18T21:33:03.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.212+0000 7f19d3fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f19d4142c90 0x7f19d40649d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33748/0 (socket says 172.21.15.63:33748) 2020-05-18T21:33:03.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.212+0000 7f19d3fff700 1 -- 172.21.15.63:0/399782938 learned_addr learned my addr 172.21.15.63:0/399782938 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:03.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.212+0000 7f19d895f700 1 --2- 172.21.15.63:0/399782938 >> v2:172.21.15.155:3300/0 conn(0x7f19d4061500 0x7f19d4065e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:03.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.212+0000 7f19d9160700 1 --2- 172.21.15.63:0/399782938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4143110 0x7f19d40650e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:03.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.212+0000 7f19d37fe700 1 -- 172.21.15.63:0/399782938 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574152190 0 0) 0x7f19d4146850 con 0x7f19d4142c90 2020-05-18T21:33:03.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.212+0000 7f19d37fe700 1 -- 172.21.15.63:0/399782938 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19b4003270 con 0x7f19d4142c90 2020-05-18T21:33:03.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.212+0000 7f19d37fe700 1 -- 172.21.15.63:0/399782938 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1121711949 0 0) 0x7f19b4003270 con 0x7f19d4142c90 2020-05-18T21:33:03.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.212+0000 7f19d37fe700 1 -- 172.21.15.63:0/399782938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4143110 msgr2=0x7f19d40650e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:03.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.212+0000 7f19d37fe700 1 --2- 172.21.15.63:0/399782938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4143110 0x7f19d40650e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:03.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d37fe700 1 -- 172.21.15.63:0/399782938 >> v2:172.21.15.155:3300/0 conn(0x7f19d4061500 msgr2=0x7f19d4065e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:03.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d37fe700 1 --2- 172.21.15.63:0/399782938 >> v2:172.21.15.155:3300/0 conn(0x7f19d4061500 0x7f19d4065e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:03.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d37fe700 1 -- 172.21.15.63:0/399782938 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d41427f0 con 0x7f19d4142c90 2020-05-18T21:33:03.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d37fe700 1 -- 172.21.15.63:0/399782938 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f19bc001710 con 0x7f19d4142c90 2020-05-18T21:33:03.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d37fe700 1 -- 172.21.15.63:0/399782938 >> v1:172.21.15.63:6789/0 conn(0x7f19d4142c90 legacy=0x7f19d40649d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:03.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d37fe700 1 --2- 172.21.15.63:0/399782938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19b4003760 0x7f19b4003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:03.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d37fe700 1 --2- 172.21.15.63:0/399782938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4143110 0x7f19b4004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:03.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d37fe700 1 --2- 172.21.15.63:0/399782938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19b4004970 0x7f19b4004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:03.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d37fe700 1 -- 172.21.15.63:0/399782938 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d413c9c0 con 0x7f19b4003760 2020-05-18T21:33:03.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d37fe700 1 -- 172.21.15.63:0/399782938 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d4142550 con 0x7f19b4004970 2020-05-18T21:33:03.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d37fe700 1 -- 172.21.15.63:0/399782938 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40053c0 con 0x7f19d4143110 2020-05-18T21:33:03.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d895f700 1 --2- 172.21.15.63:0/399782938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19b4003760 0x7f19b4003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:03.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d3fff700 1 --2- 172.21.15.63:0/399782938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4143110 0x7f19b4004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:03.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d9160700 1 --2- 172.21.15.63:0/399782938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19b4004970 0x7f19b4004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:03.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d895f700 1 -- 172.21.15.63:0/399782938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4143110 msgr2=0x7f19b4004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:03.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d895f700 1 --2- 172.21.15.63:0/399782938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4143110 0x7f19b4004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:03.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d895f700 1 -- 172.21.15.63:0/399782938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19b4004970 msgr2=0x7f19b4004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:03.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d895f700 1 --2- 172.21.15.63:0/399782938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19b4004970 0x7f19b4004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:03.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d895f700 1 -- 172.21.15.63:0/399782938 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b4003270 con 0x7f19b4003760 2020-05-18T21:33:03.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d895f700 1 --2- 172.21.15.63:0/399782938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19b4003760 0x7f19b4003b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f19c40032f0 tx=0x7f19c40103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d895f700 1 --2- 172.21.15.63:0/399782938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19b4003760 0x7f19b4003b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f19c40032f0 tx=0x7f19c40103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d895f700 1 --2- 172.21.15.63:0/399782938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19b4003760 0x7f19b4003b80 secure :-1 s=READY pgs=1299 cs=0 l=1 rx=0x7f19c40032f0 tx=0x7f19c40103e0).ready entity=mon.0 client_cookie=b396e3df203bc0dd server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:03.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d895f700 1 --2- 172.21.15.63:0/399782938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19b4003760 0x7f19b4003b80 secure :-1 s=THROTTLE_DONE pgs=1299 cs=0 l=1 rx=0x7f19c40032f0 tx=0x7f19c40103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d37fe700 1 -- 172.21.15.63:0/399782938 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19c40112c0 con 0x7f19b4003760 2020-05-18T21:33:03.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d895f700 1 --2- 172.21.15.63:0/399782938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19b4003760 0x7f19b4003b80 secure :-1 s=THROTTLE_DONE pgs=1299 cs=0 l=1 rx=0x7f19c40032f0 tx=0x7f19c40103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d37fe700 1 -- 172.21.15.63:0/399782938 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c4011420 con 0x7f19b4003760 2020-05-18T21:33:03.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d895f700 1 --2- 172.21.15.63:0/399782938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19b4003760 0x7f19b4003b80 secure :-1 s=THROTTLE_DONE pgs=1299 cs=0 l=1 rx=0x7f19c40032f0 tx=0x7f19c40103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d37fe700 1 -- 172.21.15.63:0/399782938 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19c40117c0 con 0x7f19b4003760 2020-05-18T21:33:03.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19dabc3700 1 -- 172.21.15.63:0/399782938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19b4003760 msgr2=0x7f19b4003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:03.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19dabc3700 1 --2- 172.21.15.63:0/399782938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19b4003760 0x7f19b4003b80 secure :-1 s=READY pgs=1299 cs=0 l=1 rx=0x7f19c40032f0 tx=0x7f19c40103e0).stop 2020-05-18T21:33:03.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19d9160700 1 -- 172.21.15.63:0/399782938 reap_dead start 2020-05-18T21:33:03.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19dabc3700 1 -- 172.21.15.63:0/399782938 shutdown_connections 2020-05-18T21:33:03.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19dabc3700 1 -- 172.21.15.63:0/399782938 >> 172.21.15.63:0/399782938 conn(0x7f19d40b83d0 msgr2=0x7f19d40b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:03.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19dabc3700 1 -- 172.21.15.63:0/399782938 shutdown_connections 2020-05-18T21:33:03.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.216+0000 7f19dabc3700 1 -- 172.21.15.63:0/399782938 wait complete. 2020-05-18T21:33:03.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19dabc3700 1 Processor -- start 2020-05-18T21:33:03.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19dabc3700 1 -- start start 2020-05-18T21:33:03.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19dabc3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4132180 0x7f19d40643e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:03.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19dabc3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f19d4140fa0 0x7f19d4141430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:03.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19dabc3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d413eec0 con 0x7f19d40b08e0 2020-05-18T21:33:03.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19dabc3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d40b0d40 con 0x7f19d4140fa0 2020-05-18T21:33:03.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19dabc3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d4132560 con 0x7f19d4132180 2020-05-18T21:33:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19d895f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4132180 0x7f19d40643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19d9160700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f19d4140fa0 0x7f19d4141430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19d3fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f19d40b08e0 0x7f19d413bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:60308/0 (socket says 172.21.15.63:60308) 2020-05-18T21:33:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19d3fff700 1 -- 172.21.15.63:0/2957613385 learned_addr learned my addr 172.21.15.63:0/2957613385 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19d1ffb700 1 -- 172.21.15.63:0/2957613385 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989190305 0 0) 0x7f19d413eec0 con 0x7f19d40b08e0 2020-05-18T21:33:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19d1ffb700 1 -- 172.21.15.63:0/2957613385 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19b8002fe0 con 0x7f19d40b08e0 2020-05-18T21:33:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19d895f700 1 -- 172.21.15.63:0/2957613385 >> v2:172.21.15.155:3300/0 conn(0x7f19d4140fa0 msgr2=0x7f19d4141430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19d895f700 1 --2- 172.21.15.63:0/2957613385 >> v2:172.21.15.155:3300/0 conn(0x7f19d4140fa0 0x7f19d4141430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19d895f700 1 -- 172.21.15.63:0/2957613385 >> v1:172.21.15.155:6789/0 conn(0x7f19d40b08e0 legacy=0x7f19d413bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19d895f700 1 -- 172.21.15.63:0/2957613385 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d413f160 con 0x7f19d4132180 2020-05-18T21:33:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19d895f700 1 --2- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4132180 0x7f19d40643e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f19c40032f0 tx=0x7f19c40103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19d895f700 1 --2- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4132180 0x7f19d40643e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f19c40032f0 tx=0x7f19c40103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19d895f700 1 --2- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4132180 0x7f19d40643e0 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f19c40032f0 tx=0x7f19c40103e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19d895f700 1 --2- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4132180 0x7f19d40643e0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f19c40032f0 tx=0x7f19c40103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19d1ffb700 1 -- 172.21.15.63:0/2957613385 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19c4005e80 con 0x7f19d4132180 2020-05-18T21:33:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19d895f700 1 --2- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4132180 0x7f19d40643e0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f19c40032f0 tx=0x7f19c40103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19d895f700 1 --2- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4132180 0x7f19d40643e0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f19c40032f0 tx=0x7f19c40103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19d1ffb700 1 -- 172.21.15.63:0/2957613385 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c4007180 con 0x7f19d4132180 2020-05-18T21:33:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19dabc3700 1 -- 172.21.15.63:0/2957613385 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d413c5e0 con 0x7f19d4132180 2020-05-18T21:33:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19d1ffb700 1 -- 172.21.15.63:0/2957613385 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19c4007520 con 0x7f19d4132180 2020-05-18T21:33:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.220+0000 7f19dabc3700 1 -- 172.21.15.63:0/2957613385 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d413f600 con 0x7f19d4132180 2020-05-18T21:33:03.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.224+0000 7f19d895f700 1 --2- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4132180 0x7f19d40643e0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f19c40032f0 tx=0x7f19c40103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.224+0000 7f19dabc3700 1 -- 172.21.15.63:0/2957613385 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d413f320 con 0x7f19d4132180 2020-05-18T21:33:03.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.224+0000 7f19d895f700 1 --2- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4132180 0x7f19d40643e0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f19c40032f0 tx=0x7f19c40103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.224+0000 7f19d1ffb700 1 -- 172.21.15.63:0/2957613385 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f19c4007720 con 0x7f19d4132180 2020-05-18T21:33:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.224+0000 7f19d1ffb700 1 --2- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f19b804fd30 0x7f19b80521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.224+0000 7f19d1ffb700 1 -- 172.21.15.63:0/2957613385 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f19c4063fe0 con 0x7f19d4132180 2020-05-18T21:33:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.224+0000 7f19d3fff700 1 --2- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f19b804fd30 0x7f19b80521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:03.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.224+0000 7f19d3fff700 1 --2- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f19b804fd30 0x7f19b80521f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f19bc001420 tx=0x7f19d413ffb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.224+0000 7f19d3fff700 1 --2- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f19b804fd30 0x7f19b80521f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f19bc001420 tx=0x7f19d413ffb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.224+0000 7f19d3fff700 1 --2- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f19b804fd30 0x7f19b80521f0 secure :-1 s=READY pgs=514 cs=0 l=1 rx=0x7f19bc001420 tx=0x7f19d413ffb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.232+0000 7f19d895f700 1 --2- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4132180 0x7f19d40643e0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f19c40032f0 tx=0x7f19c40103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.232+0000 7f19d1ffb700 1 -- 172.21.15.63:0/2957613385 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f19c403e3f0 con 0x7f19d4132180 2020-05-18T21:33:03.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.384+0000 7f19dabc3700 1 -- 172.21.15.63:0/2957613385 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19d413ecf0 con 0x7f19d4132180 2020-05-18T21:33:03.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.384+0000 7f19d895f700 1 --2- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4132180 0x7f19d40643e0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f19c40032f0 tx=0x7f19c40103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.384+0000 7f19d1ffb700 1 -- 172.21.15.63:0/2957613385 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f19c4015870 con 0x7f19d4132180 2020-05-18T21:33:03.393 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:03.393 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":75,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2619292063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2619292063},{"type":"v1","addr":"172.21.15.155:6835","nonce":2619292063}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:32:53.188564+0000","modified":"2020-05-18T21:32:54.910500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7842},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7842":{"gid":7842,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/468101601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":468101601},{"type":"v1","addr":"172.21.15.63:6833","nonce":468101601}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-05-18T21:33:03.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.388+0000 7f19dabc3700 1 -- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f19b804fd30 msgr2=0x7f19b80521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:03.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.388+0000 7f19dabc3700 1 --2- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f19b804fd30 0x7f19b80521f0 secure :-1 s=READY pgs=514 cs=0 l=1 rx=0x7f19bc001420 tx=0x7f19d413ffb0).stop 2020-05-18T21:33:03.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.388+0000 7f19dabc3700 1 -- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4132180 msgr2=0x7f19d40643e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:03.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.388+0000 7f19dabc3700 1 --2- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4132180 0x7f19d40643e0 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f19c40032f0 tx=0x7f19c40103e0).stop 2020-05-18T21:33:03.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.388+0000 7f19dabc3700 1 -- 172.21.15.63:0/2957613385 shutdown_connections 2020-05-18T21:33:03.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.388+0000 7f19dabc3700 1 --2- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f19b804fd30 0x7f19b80521f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:03.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.388+0000 7f19dabc3700 1 --2- 172.21.15.63:0/2957613385 >> v2:172.21.15.155:3300/0 conn(0x7f19d4140fa0 0x7f19d4141430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:03.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.388+0000 7f19dabc3700 1 --2- 172.21.15.63:0/2957613385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d4132180 0x7f19d40643e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:03.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.388+0000 7f19dabc3700 1 -- 172.21.15.63:0/2957613385 >> 172.21.15.63:0/2957613385 conn(0x7f19d40b83d0 msgr2=0x7f19d40b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:03.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.388+0000 7f19dabc3700 1 -- 172.21.15.63:0/2957613385 shutdown_connections 2020-05-18T21:33:03.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.388+0000 7f19dabc3700 1 -- 172.21.15.63:0/2957613385 wait complete. 2020-05-18T21:33:03.398 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 75 2020-05-18T21:33:03.408 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_created 2020-05-18T21:33:03.503 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:03.503 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:33:03.503 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_created": 1 2020-05-18T21:33:03.504 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:03.504 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:03.512 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_created": 1 } } 2020-05-18T21:33:03.512 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:03.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab2821f700 1 Processor -- start 2020-05-18T21:33:03.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab2821f700 1 -- start start 2020-05-18T21:33:03.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab2821f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fab20143da0 0x7fab2012a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:03.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab2821f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20147e60 0x7fab200650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:03.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab2821f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab20144240 con 0x7fab20060b90 2020-05-18T21:33:03.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab2821f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab201444e0 con 0x7fab20143da0 2020-05-18T21:33:03.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab2821f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab20144780 con 0x7fab20147e60 2020-05-18T21:33:03.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab257ba700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fab20143da0 0x7fab2012a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:03.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab267bc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20147e60 0x7fab200650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:03.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab267bc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20147e60 0x7fab200650c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:50516/0 (socket says 172.21.15.63:50516) 2020-05-18T21:33:03.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab257ba700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fab20143da0 0x7fab2012a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:46426/0 (socket says 172.21.15.63:46426) 2020-05-18T21:33:03.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab267bc700 1 -- 172.21.15.63:0/4005660834 learned_addr learned my addr 172.21.15.63:0/4005660834 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:03.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab25fbb700 1 --1- 172.21.15.63:0/4005660834 >> v1:172.21.15.155:6789/0 conn(0x7fab20060b90 0x7fab201299d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:60314/0 (socket says 172.21.15.63:60314) 2020-05-18T21:33:03.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab267bc700 1 -- 172.21.15.63:0/4005660834 >> v2:172.21.15.155:3300/0 conn(0x7fab20143da0 msgr2=0x7fab2012a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:03.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab267bc700 1 --2- 172.21.15.63:0/4005660834 >> v2:172.21.15.155:3300/0 conn(0x7fab20143da0 0x7fab2012a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:03.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab267bc700 1 -- 172.21.15.63:0/4005660834 >> v1:172.21.15.155:6789/0 conn(0x7fab20060b90 legacy=0x7fab201299d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:03.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab267bc700 1 -- 172.21.15.63:0/4005660834 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab20144c20 con 0x7fab20147e60 2020-05-18T21:33:03.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab267bc700 1 --2- 172.21.15.63:0/4005660834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20147e60 0x7fab200650c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fab180032f0 tx=0x7fab18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab267bc700 1 --2- 172.21.15.63:0/4005660834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20147e60 0x7fab200650c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fab180032f0 tx=0x7fab18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab267bc700 1 --2- 172.21.15.63:0/4005660834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20147e60 0x7fab200650c0 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7fab180032f0 tx=0x7fab18007e00).ready entity=mon.2 client_cookie=66db5798f93c4efa server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:03.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab267bc700 1 --2- 172.21.15.63:0/4005660834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20147e60 0x7fab200650c0 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fab180032f0 tx=0x7fab18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab24fb9700 1 -- 172.21.15.63:0/4005660834 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab18011d10 con 0x7fab20147e60 2020-05-18T21:33:03.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab267bc700 1 --2- 172.21.15.63:0/4005660834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20147e60 0x7fab200650c0 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fab180032f0 tx=0x7fab18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab267bc700 1 --2- 172.21.15.63:0/4005660834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20147e60 0x7fab200650c0 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fab180032f0 tx=0x7fab18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab24fb9700 1 -- 172.21.15.63:0/4005660834 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab18011e70 con 0x7fab20147e60 2020-05-18T21:33:03.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab24fb9700 1 -- 172.21.15.63:0/4005660834 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab1800a370 con 0x7fab20147e60 2020-05-18T21:33:03.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab2821f700 1 -- 172.21.15.63:0/4005660834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20147e60 msgr2=0x7fab200650c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:03.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab2821f700 1 --2- 172.21.15.63:0/4005660834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20147e60 0x7fab200650c0 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7fab180032f0 tx=0x7fab18007e00).stop 2020-05-18T21:33:03.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab2821f700 1 -- 172.21.15.63:0/4005660834 shutdown_connections 2020-05-18T21:33:03.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab2821f700 1 --2- 172.21.15.63:0/4005660834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20147e60 0x7fab200650c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:03.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab2821f700 1 --2- 172.21.15.63:0/4005660834 >> v2:172.21.15.155:3300/0 conn(0x7fab20143da0 0x7fab2012a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:03.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab2821f700 1 -- 172.21.15.63:0/4005660834 >> 172.21.15.63:0/4005660834 conn(0x7fab200b83d0 msgr2=0x7fab200b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:03.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.612+0000 7fab2821f700 1 -- 172.21.15.63:0/4005660834 shutdown_connections 2020-05-18T21:33:03.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.616+0000 7fab2821f700 1 -- 172.21.15.63:0/4005660834 wait complete. 2020-05-18T21:33:03.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.616+0000 7fab2821f700 1 Processor -- start 2020-05-18T21:33:03.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.616+0000 7fab2821f700 1 -- start start 2020-05-18T21:33:03.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.616+0000 7fab2821f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20143da0 0x7fab200adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:03.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.616+0000 7fab2821f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab200b0ba0 con 0x7fab20060b90 2020-05-18T21:33:03.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.616+0000 7fab2821f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab200ac710 con 0x7fab20147e60 2020-05-18T21:33:03.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.616+0000 7fab2821f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab200ac9b0 con 0x7fab20143da0 2020-05-18T21:33:03.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.616+0000 7fab25fbb700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fab20060b90 0x7fab200b0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33772/0 (socket says 172.21.15.63:33772) 2020-05-18T21:33:03.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.616+0000 7fab25fbb700 1 -- 172.21.15.63:0/2463376168 learned_addr learned my addr 172.21.15.63:0/2463376168 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:03.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.616+0000 7fab257ba700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20143da0 0x7fab200adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:03.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.616+0000 7fab0effd700 1 -- 172.21.15.63:0/2463376168 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36893245 0 0) 0x7fab200b0ba0 con 0x7fab20060b90 2020-05-18T21:33:03.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.616+0000 7fab0effd700 1 -- 172.21.15.63:0/2463376168 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab00002fe0 con 0x7fab20060b90 2020-05-18T21:33:03.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.616+0000 7fab0effd700 1 -- 172.21.15.63:0/2463376168 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 735464566 0 0) 0x7fab200ac710 con 0x7fab20147e60 2020-05-18T21:33:03.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.616+0000 7fab257ba700 1 -- 172.21.15.63:0/2463376168 >> v1:172.21.15.155:6789/0 conn(0x7fab20147e60 legacy=0x7fab201424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:03.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.616+0000 7fab257ba700 1 -- 172.21.15.63:0/2463376168 >> v1:172.21.15.63:6789/0 conn(0x7fab20060b90 legacy=0x7fab200b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:03.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.616+0000 7fab257ba700 1 -- 172.21.15.63:0/2463376168 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab20142c00 con 0x7fab20143da0 2020-05-18T21:33:03.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.620+0000 7fab257ba700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20143da0 0x7fab200adfb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab10002f70 tx=0x7fab10010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.620+0000 7fab257ba700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20143da0 0x7fab200adfb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab10002f70 tx=0x7fab10010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.620+0000 7fab257ba700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20143da0 0x7fab200adfb0 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7fab10002f70 tx=0x7fab10010c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:03.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.620+0000 7fab257ba700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20143da0 0x7fab200adfb0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fab10002f70 tx=0x7fab10010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.620+0000 7fab0effd700 1 -- 172.21.15.63:0/2463376168 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab10007550 con 0x7fab20143da0 2020-05-18T21:33:03.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.620+0000 7fab257ba700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20143da0 0x7fab200adfb0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fab10002f70 tx=0x7fab10010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.620+0000 7fab257ba700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20143da0 0x7fab200adfb0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fab10002f70 tx=0x7fab10010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.620+0000 7fab0effd700 1 -- 172.21.15.63:0/2463376168 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab10005700 con 0x7fab20143da0 2020-05-18T21:33:03.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.620+0000 7fab0effd700 1 -- 172.21.15.63:0/2463376168 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab10005a60 con 0x7fab20143da0 2020-05-18T21:33:03.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.620+0000 7fab2821f700 1 -- 172.21.15.63:0/2463376168 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab200b04c0 con 0x7fab20143da0 2020-05-18T21:33:03.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.620+0000 7fab2821f700 1 -- 172.21.15.63:0/2463376168 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab200b0940 con 0x7fab20143da0 2020-05-18T21:33:03.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.620+0000 7fab257ba700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20143da0 0x7fab200adfb0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fab10002f70 tx=0x7fab10010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.620+0000 7fab2821f700 1 -- 172.21.15.63:0/2463376168 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab200569e0 con 0x7fab20143da0 2020-05-18T21:33:03.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.620+0000 7fab0effd700 1 -- 172.21.15.63:0/2463376168 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fab10005c60 con 0x7fab20143da0 2020-05-18T21:33:03.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.620+0000 7fab257ba700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20143da0 0x7fab200adfb0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fab10002f70 tx=0x7fab10010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.624+0000 7fab0effd700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab0004fce0 0x7fab000521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:03.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.624+0000 7fab0effd700 1 -- 172.21.15.63:0/2463376168 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fab10063eb0 con 0x7fab20143da0 2020-05-18T21:33:03.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.624+0000 7fab25fbb700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab0004fce0 0x7fab000521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:03.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.624+0000 7fab25fbb700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab0004fce0 0x7fab000521a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab1c000f30 tx=0x7fab1c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.624+0000 7fab25fbb700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab0004fce0 0x7fab000521a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab1c000f30 tx=0x7fab1c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.624+0000 7fab25fbb700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab0004fce0 0x7fab000521a0 secure :-1 s=READY pgs=515 cs=0 l=1 rx=0x7fab1c000f30 tx=0x7fab1c0017a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:03.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.632+0000 7fab257ba700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20143da0 0x7fab200adfb0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fab10002f70 tx=0x7fab10010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.632+0000 7fab0effd700 1 -- 172.21.15.63:0/2463376168 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fab1003e240 con 0x7fab20143da0 2020-05-18T21:33:03.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.780+0000 7fab2821f700 1 -- 172.21.15.63:0/2463376168 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab20143b80 con 0x7fab20143da0 2020-05-18T21:33:03.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.780+0000 7fab257ba700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20143da0 0x7fab200adfb0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fab10002f70 tx=0x7fab10010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:03.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.780+0000 7fab0effd700 1 -- 172.21.15.63:0/2463376168 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fab10041860 con 0x7fab20143da0 2020-05-18T21:33:03.786 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:03.787 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":75,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2619292063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2619292063},{"type":"v1","addr":"172.21.15.155:6835","nonce":2619292063}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:32:53.188564+0000","modified":"2020-05-18T21:32:54.910500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7842},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7842":{"gid":7842,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/468101601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":468101601},{"type":"v1","addr":"172.21.15.63:6833","nonce":468101601}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-05-18T21:33:03.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.780+0000 7fab2821f700 1 -- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab0004fce0 msgr2=0x7fab000521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:03.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.780+0000 7fab2821f700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab0004fce0 0x7fab000521a0 secure :-1 s=READY pgs=515 cs=0 l=1 rx=0x7fab1c000f30 tx=0x7fab1c0017a0).stop 2020-05-18T21:33:03.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.780+0000 7fab2821f700 1 -- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20143da0 msgr2=0x7fab200adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:03.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.780+0000 7fab2821f700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20143da0 0x7fab200adfb0 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7fab10002f70 tx=0x7fab10010c10).stop 2020-05-18T21:33:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.780+0000 7fab2821f700 1 -- 172.21.15.63:0/2463376168 shutdown_connections 2020-05-18T21:33:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.780+0000 7fab2821f700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fab0004fce0 0x7fab000521a0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:03.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.780+0000 7fab2821f700 1 --2- 172.21.15.63:0/2463376168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab20143da0 0x7fab200adfb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:03.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.780+0000 7fab2821f700 1 -- 172.21.15.63:0/2463376168 >> 172.21.15.63:0/2463376168 conn(0x7fab200b83d0 msgr2=0x7fab200b3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:03.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.780+0000 7fab2821f700 1 -- 172.21.15.63:0/2463376168 shutdown_connections 2020-05-18T21:33:03.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:03.780+0000 7fab2821f700 1 -- 172.21.15.63:0/2463376168 wait complete. 2020-05-18T21:33:03.803 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 75 2020-05-18T21:33:03.804 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_enqueued 2020-05-18T21:33:03.901 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:03.902 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:33:03.902 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 0 2020-05-18T21:33:03.902 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:03.903 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:03.909 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_enqueued": 0 } } 2020-05-18T21:33:03.910 DEBUG:tasks.ceph_test_case:wait_until_equal: 0 != 1, waiting (timeout=60)... 2020-05-18T21:33:08.911 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:09.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.024+0000 7ff8e1986700 1 Processor -- start 2020-05-18T21:33:09.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.024+0000 7ff8e1986700 1 -- start start 2020-05-18T21:33:09.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8e1986700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff8dc1435a0 0x7ff8dc060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:09.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8e1986700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc0b7020 con 0x7ff8dc145df0 2020-05-18T21:33:09.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8e1986700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc0b72c0 con 0x7ff8dc0b93f0 2020-05-18T21:33:09.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8e1986700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8dc0b7560 con 0x7ff8dc1435a0 2020-05-18T21:33:09.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8d3fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff8dc145df0 0x7ff8dc142e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33782/0 (socket says 172.21.15.63:33782) 2020-05-18T21:33:09.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8d3fff700 1 -- 172.21.15.63:0/583642842 learned_addr learned my addr 172.21.15.63:0/583642842 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:09.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8e1185700 1 --2- 172.21.15.63:0/583642842 >> v2:172.21.15.155:3300/0 conn(0x7ff8dc1435a0 0x7ff8dc060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:09.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8d37fe700 1 -- 172.21.15.63:0/583642842 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967784841 0 0) 0x7ff8dc0b7020 con 0x7ff8dc145df0 2020-05-18T21:33:09.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8d37fe700 1 -- 172.21.15.63:0/583642842 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8c8003270 con 0x7ff8dc145df0 2020-05-18T21:33:09.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8d37fe700 1 -- 172.21.15.63:0/583642842 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855988956 0 0) 0x7ff8dc0b72c0 con 0x7ff8dc0b93f0 2020-05-18T21:33:09.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8d37fe700 1 -- 172.21.15.63:0/583642842 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8dc0b7020 con 0x7ff8dc0b93f0 2020-05-18T21:33:09.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8e1185700 1 -- 172.21.15.63:0/583642842 >> v1:172.21.15.155:6789/0 conn(0x7ff8dc0b93f0 legacy=0x7ff8dc0b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:09.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8e1185700 1 -- 172.21.15.63:0/583642842 >> v1:172.21.15.63:6789/0 conn(0x7ff8dc145df0 legacy=0x7ff8dc142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:09.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8e1185700 1 -- 172.21.15.63:0/583642842 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc0b7800 con 0x7ff8dc1435a0 2020-05-18T21:33:09.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8e1185700 1 --2- 172.21.15.63:0/583642842 >> v2:172.21.15.155:3300/0 conn(0x7ff8dc1435a0 0x7ff8dc060430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff8d40032f0 tx=0x7ff8d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8e1185700 1 --2- 172.21.15.63:0/583642842 >> v2:172.21.15.155:3300/0 conn(0x7ff8dc1435a0 0x7ff8dc060430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff8d40032f0 tx=0x7ff8d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8e1185700 1 --2- 172.21.15.63:0/583642842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8dc1435a0 0x7ff8dc060430 secure :-1 s=READY pgs=895 cs=0 l=1 rx=0x7ff8d40032f0 tx=0x7ff8d4007e00).ready entity=mon.1 client_cookie=b2973fad0550b363 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:09.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8e1185700 1 --2- 172.21.15.63:0/583642842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8dc1435a0 0x7ff8dc060430 secure :-1 s=THROTTLE_DONE pgs=895 cs=0 l=1 rx=0x7ff8d40032f0 tx=0x7ff8d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8d37fe700 1 -- 172.21.15.63:0/583642842 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8d4011db0 con 0x7ff8dc1435a0 2020-05-18T21:33:09.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8e1185700 1 --2- 172.21.15.63:0/583642842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8dc1435a0 0x7ff8dc060430 secure :-1 s=THROTTLE_DONE pgs=895 cs=0 l=1 rx=0x7ff8d40032f0 tx=0x7ff8d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8d37fe700 1 -- 172.21.15.63:0/583642842 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d400a180 con 0x7ff8dc1435a0 2020-05-18T21:33:09.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8e1185700 1 --2- 172.21.15.63:0/583642842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8dc1435a0 0x7ff8dc060430 secure :-1 s=THROTTLE_DONE pgs=895 cs=0 l=1 rx=0x7ff8d40032f0 tx=0x7ff8d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8d37fe700 1 -- 172.21.15.63:0/583642842 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8d400a560 con 0x7ff8dc1435a0 2020-05-18T21:33:09.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8e1986700 1 -- 172.21.15.63:0/583642842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8dc1435a0 msgr2=0x7ff8dc060430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:09.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.028+0000 7ff8e1986700 1 --2- 172.21.15.63:0/583642842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8dc1435a0 0x7ff8dc060430 secure :-1 s=READY pgs=895 cs=0 l=1 rx=0x7ff8d40032f0 tx=0x7ff8d4007e00).stop 2020-05-18T21:33:09.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.032+0000 7ff8e1986700 1 -- 172.21.15.63:0/583642842 shutdown_connections 2020-05-18T21:33:09.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.032+0000 7ff8e1986700 1 --2- 172.21.15.63:0/583642842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8dc1435a0 0x7ff8dc060430 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:09.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.032+0000 7ff8e1986700 1 -- 172.21.15.63:0/583642842 >> 172.21.15.63:0/583642842 conn(0x7ff8dc069b70 msgr2=0x7ff8dc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:09.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.032+0000 7ff8e1986700 1 -- 172.21.15.63:0/583642842 shutdown_connections 2020-05-18T21:33:09.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.032+0000 7ff8e1986700 1 -- 172.21.15.63:0/583642842 wait complete. 2020-05-18T21:33:09.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.032+0000 7ff8e1986700 1 Processor -- start 2020-05-18T21:33:09.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.032+0000 7ff8e1986700 1 -- start start 2020-05-18T21:33:09.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.032+0000 7ff8e1986700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8dc0b93f0 0x7ff8dc141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:09.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.032+0000 7ff8e1986700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff8dc1435a0 0x7ff8dc153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:09.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.032+0000 7ff8e1986700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc0ac850 con 0x7ff8dc145df0 2020-05-18T21:33:09.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.032+0000 7ff8e1986700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8dc0acaf0 con 0x7ff8dc1435a0 2020-05-18T21:33:09.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.032+0000 7ff8e1986700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc0acd90 con 0x7ff8dc0b93f0 2020-05-18T21:33:09.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.032+0000 7ff8d3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff8dc1435a0 0x7ff8dc153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:09.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.032+0000 7ff8e1185700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff8dc145df0 0x7ff8dc130cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33790/0 (socket says 172.21.15.63:33790) 2020-05-18T21:33:09.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.032+0000 7ff8e1185700 1 -- 172.21.15.63:0/209938777 learned_addr learned my addr 172.21.15.63:0/209938777 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:09.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.032+0000 7ff8e0984700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8dc0b93f0 0x7ff8dc141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:09.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8d3fff700 1 -- 172.21.15.63:0/209938777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8dc0b93f0 msgr2=0x7ff8dc141d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:09.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8d3fff700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8dc0b93f0 0x7ff8dc141d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:09.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8d3fff700 1 -- 172.21.15.63:0/209938777 >> v1:172.21.15.63:6789/0 conn(0x7ff8dc145df0 legacy=0x7ff8dc130cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:09.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8d3fff700 1 -- 172.21.15.63:0/209938777 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc0ac4d0 con 0x7ff8dc1435a0 2020-05-18T21:33:09.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8d1ffb700 1 -- 172.21.15.63:0/209938777 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539502352 0 0) 0x7ff8dc0ac850 con 0x7ff8dc145df0 2020-05-18T21:33:09.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8d3fff700 1 --2- 172.21.15.63:0/209938777 >> v2:172.21.15.63:3300/0 conn(0x7ff8dc1435a0 0x7ff8dc153860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff8cc001110 tx=0x7ff8cc0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8d3fff700 1 --2- 172.21.15.63:0/209938777 >> v2:172.21.15.63:3300/0 conn(0x7ff8dc1435a0 0x7ff8dc153860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff8cc001110 tx=0x7ff8cc0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8d3fff700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8dc1435a0 0x7ff8dc153860 secure :-1 s=READY pgs=1303 cs=0 l=1 rx=0x7ff8cc001110 tx=0x7ff8cc0108f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:09.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8d3fff700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8dc1435a0 0x7ff8dc153860 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7ff8cc001110 tx=0x7ff8cc0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8d1ffb700 1 -- 172.21.15.63:0/209938777 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8cc005d00 con 0x7ff8dc1435a0 2020-05-18T21:33:09.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8d3fff700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8dc1435a0 0x7ff8dc153860 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7ff8cc001110 tx=0x7ff8cc0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8d1ffb700 1 -- 172.21.15.63:0/209938777 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8cc005e60 con 0x7ff8dc1435a0 2020-05-18T21:33:09.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8d3fff700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8dc1435a0 0x7ff8dc153860 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7ff8cc001110 tx=0x7ff8cc0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8e1986700 1 -- 172.21.15.63:0/209938777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8dc13fcd0 con 0x7ff8dc1435a0 2020-05-18T21:33:09.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8d1ffb700 1 -- 172.21.15.63:0/209938777 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8cc0062c0 con 0x7ff8dc1435a0 2020-05-18T21:33:09.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8e1986700 1 -- 172.21.15.63:0/209938777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc1315e0 con 0x7ff8dc1435a0 2020-05-18T21:33:09.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8d3fff700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8dc1435a0 0x7ff8dc153860 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7ff8cc001110 tx=0x7ff8cc0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8e1986700 1 -- 172.21.15.63:0/209938777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8dc0569e0 con 0x7ff8dc1435a0 2020-05-18T21:33:09.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8d1ffb700 1 -- 172.21.15.63:0/209938777 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff8cc006500 con 0x7ff8dc1435a0 2020-05-18T21:33:09.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8d3fff700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8dc1435a0 0x7ff8dc153860 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7ff8cc001110 tx=0x7ff8cc0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8d1ffb700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8bc04f8e0 0x7ff8bc051da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:09.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8d1ffb700 1 -- 172.21.15.63:0/209938777 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff8cc0090c0 con 0x7ff8dc1435a0 2020-05-18T21:33:09.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8e0984700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8bc04f8e0 0x7ff8bc051da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:09.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.036+0000 7ff8e0984700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8bc04f8e0 0x7ff8bc051da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff8d8001110 tx=0x7ff8d80010b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.040+0000 7ff8e0984700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8bc04f8e0 0x7ff8bc051da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff8d8001110 tx=0x7ff8d80010b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.040+0000 7ff8e0984700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8bc04f8e0 0x7ff8bc051da0 secure :-1 s=READY pgs=516 cs=0 l=1 rx=0x7ff8d8001110 tx=0x7ff8d80010b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:09.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.044+0000 7ff8d3fff700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8dc1435a0 0x7ff8dc153860 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7ff8cc001110 tx=0x7ff8cc0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.044+0000 7ff8d1ffb700 1 -- 172.21.15.63:0/209938777 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff8cc03e040 con 0x7ff8dc1435a0 2020-05-18T21:33:09.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.192+0000 7ff8e1986700 1 -- 172.21.15.63:0/209938777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8dc0ac660 con 0x7ff8dc1435a0 2020-05-18T21:33:09.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.192+0000 7ff8d3fff700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8dc1435a0 0x7ff8dc153860 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7ff8cc001110 tx=0x7ff8cc0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.192+0000 7ff8d1ffb700 1 -- 172.21.15.63:0/209938777 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+2140 (secure 0 0 0) 0x7ff8cc041660 con 0x7ff8dc1435a0 2020-05-18T21:33:09.198 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:09.198 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":75,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2619292063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2619292063},{"type":"v1","addr":"172.21.15.155:6835","nonce":2619292063}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:32:53.188564+0000","modified":"2020-05-18T21:32:54.910500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7842},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7842":{"gid":7842,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/468101601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":468101601},{"type":"v1","addr":"172.21.15.63:6833","nonce":468101601}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-05-18T21:33:09.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.192+0000 7ff8e1986700 1 -- 172.21.15.63:0/209938777 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8bc04f8e0 msgr2=0x7ff8bc051da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:09.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.192+0000 7ff8e1986700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8bc04f8e0 0x7ff8bc051da0 secure :-1 s=READY pgs=516 cs=0 l=1 rx=0x7ff8d8001110 tx=0x7ff8d80010b0).stop 2020-05-18T21:33:09.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.192+0000 7ff8e1986700 1 -- 172.21.15.63:0/209938777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8dc1435a0 msgr2=0x7ff8dc153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:09.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.192+0000 7ff8e1986700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8dc1435a0 0x7ff8dc153860 secure :-1 s=READY pgs=1303 cs=0 l=1 rx=0x7ff8cc001110 tx=0x7ff8cc0108f0).stop 2020-05-18T21:33:09.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.192+0000 7ff8e1986700 1 -- 172.21.15.63:0/209938777 shutdown_connections 2020-05-18T21:33:09.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.192+0000 7ff8e1986700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff8bc04f8e0 0x7ff8bc051da0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:09.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.192+0000 7ff8e1986700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8dc1435a0 0x7ff8dc153860 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:09.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.192+0000 7ff8e1986700 1 --2- 172.21.15.63:0/209938777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8dc0b93f0 0x7ff8dc141d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:09.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.192+0000 7ff8e1986700 1 -- 172.21.15.63:0/209938777 >> 172.21.15.63:0/209938777 conn(0x7ff8dc069b70 msgr2=0x7ff8dc148070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:09.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.192+0000 7ff8e1986700 1 -- 172.21.15.63:0/209938777 shutdown_connections 2020-05-18T21:33:09.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.192+0000 7ff8e1986700 1 -- 172.21.15.63:0/209938777 wait complete. 2020-05-18T21:33:09.202 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 75 2020-05-18T21:33:09.210 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_enqueued 2020-05-18T21:33:09.301 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:33:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 1 2020-05-18T21:33:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:09.303 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:09.309 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_enqueued": 1 } } 2020-05-18T21:33:09.310 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:09.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.408+0000 7f43c6f13700 1 Processor -- start 2020-05-18T21:33:09.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.408+0000 7f43c6f13700 1 -- start start 2020-05-18T21:33:09.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.408+0000 7f43c6f13700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f43c005f110 0x7f43c00b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:09.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.408+0000 7f43c6f13700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 0x7f43c00648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:09.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.408+0000 7f43c6f13700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c014a330 con 0x7f43c0064d20 2020-05-18T21:33:09.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.408+0000 7f43c6f13700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c014a140 con 0x7f43c005f110 2020-05-18T21:33:09.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.408+0000 7f43c6f13700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c014a5d0 con 0x7f43c014aa70 2020-05-18T21:33:09.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.408+0000 7f43c5f11700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f43c005f110 0x7f43c00b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:09.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.408+0000 7f43c5f11700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f43c005f110 0x7f43c00b4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59840/0 (socket says 172.21.15.63:59840) 2020-05-18T21:33:09.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.408+0000 7f43c5f11700 1 -- 172.21.15.63:0/2060319134 learned_addr learned my addr 172.21.15.63:0/2060319134 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:09.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.408+0000 7f43c5710700 1 --2- 172.21.15.63:0/2060319134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 0x7f43c00648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:09.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.408+0000 7f43c4f0f700 1 -- 172.21.15.63:0/2060319134 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489830734 0 0) 0x7f43c014a330 con 0x7f43c0064d20 2020-05-18T21:33:09.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.408+0000 7f43c4f0f700 1 -- 172.21.15.63:0/2060319134 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43a8003270 con 0x7f43c0064d20 2020-05-18T21:33:09.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.408+0000 7f43c5f11700 1 -- 172.21.15.63:0/2060319134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 msgr2=0x7f43c00648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:09.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.408+0000 7f43c5f11700 1 --2- 172.21.15.63:0/2060319134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 0x7f43c00648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:09.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.408+0000 7f43c5f11700 1 -- 172.21.15.63:0/2060319134 >> v1:172.21.15.155:6789/0 conn(0x7f43c0064d20 legacy=0x7f43c014d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:09.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.408+0000 7f43c5f11700 1 -- 172.21.15.63:0/2060319134 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c0063430 con 0x7f43c005f110 2020-05-18T21:33:09.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.408+0000 7f43c5710700 1 --2- 172.21.15.63:0/2060319134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 0x7f43c00648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:09.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.408+0000 7f43c5f11700 1 --2- 172.21.15.63:0/2060319134 >> v2:172.21.15.63:3300/0 conn(0x7f43c005f110 0x7f43c00b4760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f43c0063c70 tx=0x7f43b0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c5f11700 1 --2- 172.21.15.63:0/2060319134 >> v2:172.21.15.63:3300/0 conn(0x7f43c005f110 0x7f43c00b4760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f43c0063c70 tx=0x7f43b0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c5f11700 1 --2- 172.21.15.63:0/2060319134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c005f110 0x7f43c00b4760 secure :-1 s=READY pgs=1304 cs=0 l=1 rx=0x7f43c0063c70 tx=0x7f43b0008920).ready entity=mon.0 client_cookie=ab87ddaa1bb6ce47 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:09.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c5f11700 1 --2- 172.21.15.63:0/2060319134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c005f110 0x7f43c00b4760 secure :-1 s=THROTTLE_DONE pgs=1304 cs=0 l=1 rx=0x7f43c0063c70 tx=0x7f43b0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c4f0f700 1 -- 172.21.15.63:0/2060319134 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43b0011600 con 0x7f43c005f110 2020-05-18T21:33:09.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c5f11700 1 --2- 172.21.15.63:0/2060319134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c005f110 0x7f43c00b4760 secure :-1 s=THROTTLE_DONE pgs=1304 cs=0 l=1 rx=0x7f43c0063c70 tx=0x7f43b0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c4f0f700 1 -- 172.21.15.63:0/2060319134 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b0011760 con 0x7f43c005f110 2020-05-18T21:33:09.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c5f11700 1 --2- 172.21.15.63:0/2060319134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c005f110 0x7f43c00b4760 secure :-1 s=THROTTLE_DONE pgs=1304 cs=0 l=1 rx=0x7f43c0063c70 tx=0x7f43b0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c6f13700 1 -- 172.21.15.63:0/2060319134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c005f110 msgr2=0x7f43c00b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:09.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c4f0f700 1 -- 172.21.15.63:0/2060319134 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43b0011b80 con 0x7f43c005f110 2020-05-18T21:33:09.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c6f13700 1 --2- 172.21.15.63:0/2060319134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c005f110 0x7f43c00b4760 secure :-1 s=READY pgs=1304 cs=0 l=1 rx=0x7f43c0063c70 tx=0x7f43b0008920).stop 2020-05-18T21:33:09.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c6f13700 1 -- 172.21.15.63:0/2060319134 shutdown_connections 2020-05-18T21:33:09.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c6f13700 1 --2- 172.21.15.63:0/2060319134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 0x7f43c00648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:09.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c6f13700 1 --2- 172.21.15.63:0/2060319134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c005f110 0x7f43c00b4760 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:09.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c6f13700 1 -- 172.21.15.63:0/2060319134 >> 172.21.15.63:0/2060319134 conn(0x7f43c0069fc0 msgr2=0x7f43c006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:09.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c6f13700 1 -- 172.21.15.63:0/2060319134 shutdown_connections 2020-05-18T21:33:09.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c6f13700 1 -- 172.21.15.63:0/2060319134 wait complete. 2020-05-18T21:33:09.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c6f13700 1 Processor -- start 2020-05-18T21:33:09.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c6f13700 1 -- start start 2020-05-18T21:33:09.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c6f13700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f43c005f110 0x7f43c013cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:09.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c6f13700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 0x7f43c0146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:09.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c6f13700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c0147070 con 0x7f43c0064d20 2020-05-18T21:33:09.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c6f13700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c01472b0 con 0x7f43c005f110 2020-05-18T21:33:09.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c6f13700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c0147db0 con 0x7f43c014aa70 2020-05-18T21:33:09.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c5710700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f43c0064d20 0x7f43c015ab70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33800/0 (socket says 172.21.15.63:33800) 2020-05-18T21:33:09.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.412+0000 7f43c5710700 1 -- 172.21.15.63:0/3729281461 learned_addr learned my addr 172.21.15.63:0/3729281461 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:09.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43c5f11700 1 --2- 172.21.15.63:0/3729281461 >> v2:172.21.15.155:3300/0 conn(0x7f43c005f110 0x7f43c013cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:09.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43c6712700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 0x7f43c0146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:09.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43beffd700 1 -- 172.21.15.63:0/3729281461 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439510639 0 0) 0x7f43ac002280 con 0x7f43c0064d20 2020-05-18T21:33:09.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43beffd700 1 -- 172.21.15.63:0/3729281461 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f439c002fe0 con 0x7f43c0064d20 2020-05-18T21:33:09.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43beffd700 1 -- 172.21.15.63:0/3729281461 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 936983244 0 0) 0x7f439c002fe0 con 0x7f43c0064d20 2020-05-18T21:33:09.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43beffd700 1 -- 172.21.15.63:0/3729281461 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f43ac002280 con 0x7f43c0064d20 2020-05-18T21:33:09.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43beffd700 1 -- 172.21.15.63:0/3729281461 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f43ac002a50 con 0x7f43c0064d20 2020-05-18T21:33:09.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43c6712700 1 -- 172.21.15.63:0/3729281461 >> v2:172.21.15.155:3300/0 conn(0x7f43c005f110 msgr2=0x7f43c013cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:09.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43c6712700 1 --2- 172.21.15.63:0/3729281461 >> v2:172.21.15.155:3300/0 conn(0x7f43c005f110 0x7f43c013cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:09.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43c6712700 1 -- 172.21.15.63:0/3729281461 >> v1:172.21.15.63:6789/0 conn(0x7f43c0064d20 legacy=0x7f43c015ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:09.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43c6712700 1 -- 172.21.15.63:0/3729281461 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c0148050 con 0x7f43c014aa70 2020-05-18T21:33:09.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43c5f11700 1 --2- 172.21.15.63:0/3729281461 >> v2:172.21.15.155:3300/0 conn(0x7f43c005f110 0x7f43c013cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:09.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43c6712700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 0x7f43c0146c10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43b8001110 tx=0x7f43b80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43c6712700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 0x7f43c0146c10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43b8001110 tx=0x7f43b80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43c6712700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 0x7f43c0146c10 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f43b8001110 tx=0x7f43b80108c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:09.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43c6712700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 0x7f43c0146c10 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f43b8001110 tx=0x7f43b80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43beffd700 1 -- 172.21.15.63:0/3729281461 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43b80069f0 con 0x7f43c014aa70 2020-05-18T21:33:09.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43c6712700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 0x7f43c0146c10 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f43b8001110 tx=0x7f43b80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43c6712700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 0x7f43c0146c10 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f43b8001110 tx=0x7f43b80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43beffd700 1 -- 172.21.15.63:0/3729281461 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b8006b50 con 0x7f43c014aa70 2020-05-18T21:33:09.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43c6f13700 1 -- 172.21.15.63:0/3729281461 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c0158420 con 0x7f43c014aa70 2020-05-18T21:33:09.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43beffd700 1 -- 172.21.15.63:0/3729281461 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43b8008180 con 0x7f43c014aa70 2020-05-18T21:33:09.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43c6f13700 1 -- 172.21.15.63:0/3729281461 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c015b4a0 con 0x7f43c014aa70 2020-05-18T21:33:09.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43c6f13700 1 -- 172.21.15.63:0/3729281461 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c01481e0 con 0x7f43c014aa70 2020-05-18T21:33:09.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.416+0000 7f43c6712700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 0x7f43c0146c10 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f43b8001110 tx=0x7f43b80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.420+0000 7f43beffd700 1 -- 172.21.15.63:0/3729281461 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f43b80083f0 con 0x7f43c014aa70 2020-05-18T21:33:09.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.420+0000 7f43c6712700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 0x7f43c0146c10 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f43b8001110 tx=0x7f43b80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.420+0000 7f43beffd700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f439c050100 0x7f439c0525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:09.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.420+0000 7f43beffd700 1 -- 172.21.15.63:0/3729281461 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f43b8063a60 con 0x7f43c014aa70 2020-05-18T21:33:09.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.420+0000 7f43c5f11700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f439c050100 0x7f439c0525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:09.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.420+0000 7f43c5f11700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f439c050100 0x7f439c0525c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43c0063c70 tx=0x7f43c00635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.420+0000 7f43c5f11700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f439c050100 0x7f439c0525c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43c0063c70 tx=0x7f43c00635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.420+0000 7f43c5f11700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f439c050100 0x7f439c0525c0 secure :-1 s=READY pgs=517 cs=0 l=1 rx=0x7f43c0063c70 tx=0x7f43c00635c0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:09.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.428+0000 7f43c6712700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 0x7f43c0146c10 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f43b8001110 tx=0x7f43b80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.428+0000 7f43beffd700 1 -- 172.21.15.63:0/3729281461 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f43b803dd90 con 0x7f43c014aa70 2020-05-18T21:33:09.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.580+0000 7f43c6f13700 1 -- 172.21.15.63:0/3729281461 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43c00569e0 con 0x7f43c014aa70 2020-05-18T21:33:09.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.584+0000 7f43c6712700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 0x7f43c0146c10 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f43b8001110 tx=0x7f43b80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.584+0000 7f43beffd700 1 -- 172.21.15.63:0/3729281461 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f43b80413b0 con 0x7f43c014aa70 2020-05-18T21:33:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:09.589 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":75,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2619292063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2619292063},{"type":"v1","addr":"172.21.15.155:6835","nonce":2619292063}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:32:53.188564+0000","modified":"2020-05-18T21:32:54.910500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7842},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7842":{"gid":7842,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/468101601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":468101601},{"type":"v1","addr":"172.21.15.63:6833","nonce":468101601}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-05-18T21:33:09.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.584+0000 7f43c6f13700 1 -- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f439c050100 msgr2=0x7f439c0525c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:09.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.584+0000 7f43c6f13700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f439c050100 0x7f439c0525c0 secure :-1 s=READY pgs=517 cs=0 l=1 rx=0x7f43c0063c70 tx=0x7f43c00635c0).stop 2020-05-18T21:33:09.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.584+0000 7f43c6f13700 1 -- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 msgr2=0x7f43c0146c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:09.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.584+0000 7f43c6f13700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 0x7f43c0146c10 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f43b8001110 tx=0x7f43b80108c0).stop 2020-05-18T21:33:09.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.584+0000 7f43c6f13700 1 -- 172.21.15.63:0/3729281461 shutdown_connections 2020-05-18T21:33:09.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.584+0000 7f43c6f13700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f439c050100 0x7f439c0525c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:09.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.584+0000 7f43c6f13700 1 --2- 172.21.15.63:0/3729281461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43c014aa70 0x7f43c0146c10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:09.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.584+0000 7f43c6f13700 1 --2- 172.21.15.63:0/3729281461 >> v2:172.21.15.155:3300/0 conn(0x7f43c005f110 0x7f43c013cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:09.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.584+0000 7f43c6f13700 1 -- 172.21.15.63:0/3729281461 >> 172.21.15.63:0/3729281461 conn(0x7f43c0069fc0 msgr2=0x7f43c00b8560 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:09.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.584+0000 7f43c6f13700 1 -- 172.21.15.63:0/3729281461 shutdown_connections 2020-05-18T21:33:09.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.584+0000 7f43c6f13700 1 -- 172.21.15.63:0/3729281461 wait complete. 2020-05-18T21:33:09.593 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 75 2020-05-18T21:33:09.601 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump purge_queue pq_executed 2020-05-18T21:33:09.702 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:09.702 INFO:teuthology.orchestra.run.smithi063.stdout: "purge_queue": { 2020-05-18T21:33:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executed": 1 2020-05-18T21:33:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:09.703 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:09.711 INFO:tasks.cephfs.filesystem:_json_asok output: { "purge_queue": { "pq_executed": 1 } } 2020-05-18T21:33:09.712 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:09.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05f0cb8700 1 Processor -- start 2020-05-18T21:33:09.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05f0cb8700 1 -- start start 2020-05-18T21:33:09.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05f0cb8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f05ec069eb0 0x7f05ec062f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:09.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05f0cb8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05ec1453d0 0x7f05ec145860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:09.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05f0cb8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ec149690 con 0x7f05ec0b6500 2020-05-18T21:33:09.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05f0cb8700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ec14a4e0 con 0x7f05ec069eb0 2020-05-18T21:33:09.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05f0cb8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec149930 con 0x7f05ec1453d0 2020-05-18T21:33:09.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05eb7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f05ec069eb0 0x7f05ec062f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:09.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05eaffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f05ec0b6500 0x7f05ec149dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33810/0 (socket says 172.21.15.63:33810) 2020-05-18T21:33:09.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05eaffd700 1 -- 172.21.15.63:0/2666937823 learned_addr learned my addr 172.21.15.63:0/2666937823 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:09.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05ebfff700 1 --2- 172.21.15.63:0/2666937823 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05ec1453d0 0x7f05ec145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:09.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05ea7fc700 1 -- 172.21.15.63:0/2666937823 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830412767 0 0) 0x7f05ec149690 con 0x7f05ec0b6500 2020-05-18T21:33:09.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05ea7fc700 1 -- 172.21.15.63:0/2666937823 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05d8003270 con 0x7f05ec0b6500 2020-05-18T21:33:09.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05eb7fe700 1 -- 172.21.15.63:0/2666937823 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05ec1453d0 msgr2=0x7f05ec145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:09.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05eb7fe700 1 --2- 172.21.15.63:0/2666937823 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05ec1453d0 0x7f05ec145860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:09.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05eb7fe700 1 -- 172.21.15.63:0/2666937823 >> v1:172.21.15.63:6789/0 conn(0x7f05ec0b6500 legacy=0x7f05ec149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:09.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05eb7fe700 1 -- 172.21.15.63:0/2666937823 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec064450 con 0x7f05ec069eb0 2020-05-18T21:33:09.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05ebfff700 1 --2- 172.21.15.63:0/2666937823 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05ec1453d0 0x7f05ec145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:33:09.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05eb7fe700 1 --2- 172.21.15.63:0/2666937823 >> v2:172.21.15.63:3300/0 conn(0x7f05ec069eb0 0x7f05ec062f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f05dc002f70 tx=0x7f05dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05eb7fe700 1 --2- 172.21.15.63:0/2666937823 >> v2:172.21.15.63:3300/0 conn(0x7f05ec069eb0 0x7f05ec062f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f05dc002f70 tx=0x7f05dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05eb7fe700 1 --2- 172.21.15.63:0/2666937823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05ec069eb0 0x7f05ec062f20 secure :-1 s=READY pgs=1307 cs=0 l=1 rx=0x7f05dc002f70 tx=0x7f05dc007a80).ready entity=mon.0 client_cookie=338b5b0eb5e1b782 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:09.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05eb7fe700 1 --2- 172.21.15.63:0/2666937823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05ec069eb0 0x7f05ec062f20 secure :-1 s=THROTTLE_DONE pgs=1307 cs=0 l=1 rx=0x7f05dc002f70 tx=0x7f05dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05ea7fc700 1 -- 172.21.15.63:0/2666937823 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05dc008e80 con 0x7f05ec069eb0 2020-05-18T21:33:09.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05eb7fe700 1 --2- 172.21.15.63:0/2666937823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05ec069eb0 0x7f05ec062f20 secure :-1 s=THROTTLE_DONE pgs=1307 cs=0 l=1 rx=0x7f05dc002f70 tx=0x7f05dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05ea7fc700 1 -- 172.21.15.63:0/2666937823 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05dc0115f0 con 0x7f05ec069eb0 2020-05-18T21:33:09.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.812+0000 7f05eb7fe700 1 --2- 172.21.15.63:0/2666937823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05ec069eb0 0x7f05ec062f20 secure :-1 s=THROTTLE_DONE pgs=1307 cs=0 l=1 rx=0x7f05dc002f70 tx=0x7f05dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.816+0000 7f05ea7fc700 1 -- 172.21.15.63:0/2666937823 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05dc011a10 con 0x7f05ec069eb0 2020-05-18T21:33:09.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.816+0000 7f05f0cb8700 1 -- 172.21.15.63:0/2666937823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05ec069eb0 msgr2=0x7f05ec062f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:09.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.816+0000 7f05f0cb8700 1 --2- 172.21.15.63:0/2666937823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05ec069eb0 0x7f05ec062f20 secure :-1 s=READY pgs=1307 cs=0 l=1 rx=0x7f05dc002f70 tx=0x7f05dc007a80).stop 2020-05-18T21:33:09.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.816+0000 7f05f0cb8700 1 -- 172.21.15.63:0/2666937823 shutdown_connections 2020-05-18T21:33:09.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.816+0000 7f05f0cb8700 1 --2- 172.21.15.63:0/2666937823 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05ec1453d0 0x7f05ec145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:09.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.816+0000 7f05f0cb8700 1 --2- 172.21.15.63:0/2666937823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05ec069eb0 0x7f05ec062f20 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:09.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.816+0000 7f05f0cb8700 1 -- 172.21.15.63:0/2666937823 >> 172.21.15.63:0/2666937823 conn(0x7f05ec066d00 msgr2=0x7f05ec05a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:09.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.816+0000 7f05f0cb8700 1 -- 172.21.15.63:0/2666937823 shutdown_connections 2020-05-18T21:33:09.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.816+0000 7f05f0cb8700 1 -- 172.21.15.63:0/2666937823 wait complete. 2020-05-18T21:33:09.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.816+0000 7f05f0cb8700 1 Processor -- start 2020-05-18T21:33:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.816+0000 7f05f0cb8700 1 -- start start 2020-05-18T21:33:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05f0cb8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05ec069eb0 0x7f05ec0b8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05f0cb8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f05ec0b6500 0x7f05ec0b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:09.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05f0cb8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ec0b90c0 con 0x7f05ec1453d0 2020-05-18T21:33:09.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05f0cb8700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ec142fc0 con 0x7f05ec0b6500 2020-05-18T21:33:09.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05f0cb8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec143260 con 0x7f05ec069eb0 2020-05-18T21:33:09.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05eaffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f05ec0b6500 0x7f05ec0b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:09.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05eaffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f05ec0b6500 0x7f05ec0b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59860/0 (socket says 172.21.15.63:59860) 2020-05-18T21:33:09.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05eaffd700 1 -- 172.21.15.63:0/1000689323 learned_addr learned my addr 172.21.15.63:0/1000689323 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:09.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05eb7fe700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05ec069eb0 0x7f05ec0b8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:09.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05eaffd700 1 -- 172.21.15.63:0/1000689323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05ec069eb0 msgr2=0x7f05ec0b8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:09.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05eaffd700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05ec069eb0 0x7f05ec0b8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:09.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05eaffd700 1 -- 172.21.15.63:0/1000689323 >> v1:172.21.15.63:6789/0 conn(0x7f05ec1453d0 legacy=0x7f05ec13fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:09.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05eaffd700 1 -- 172.21.15.63:0/1000689323 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec0b30f0 con 0x7f05ec0b6500 2020-05-18T21:33:09.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05e8ff9700 1 -- 172.21.15.63:0/1000689323 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790653561 0 0) 0x7f05ec0b90c0 con 0x7f05ec1453d0 2020-05-18T21:33:09.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05eaffd700 1 --2- 172.21.15.63:0/1000689323 >> v2:172.21.15.63:3300/0 conn(0x7f05ec0b6500 0x7f05ec0b12f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05e0001110 tx=0x7f05e0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05eaffd700 1 --2- 172.21.15.63:0/1000689323 >> v2:172.21.15.63:3300/0 conn(0x7f05ec0b6500 0x7f05ec0b12f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05e0001110 tx=0x7f05e0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05eaffd700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05ec0b6500 0x7f05ec0b12f0 secure :-1 s=READY pgs=1309 cs=0 l=1 rx=0x7f05e0001110 tx=0x7f05e0010a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:09.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05eaffd700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05ec0b6500 0x7f05ec0b12f0 secure :-1 s=THROTTLE_DONE pgs=1309 cs=0 l=1 rx=0x7f05e0001110 tx=0x7f05e0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05e8ff9700 1 -- 172.21.15.63:0/1000689323 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05e0010570 con 0x7f05ec0b6500 2020-05-18T21:33:09.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05eaffd700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05ec0b6500 0x7f05ec0b12f0 secure :-1 s=THROTTLE_DONE pgs=1309 cs=0 l=1 rx=0x7f05e0001110 tx=0x7f05e0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05eaffd700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05ec0b6500 0x7f05ec0b12f0 secure :-1 s=THROTTLE_DONE pgs=1309 cs=0 l=1 rx=0x7f05e0001110 tx=0x7f05e0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05e8ff9700 1 -- 172.21.15.63:0/1000689323 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e000c670 con 0x7f05ec0b6500 2020-05-18T21:33:09.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05f0cb8700 1 -- 172.21.15.63:0/1000689323 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ec0b1750 con 0x7f05ec0b6500 2020-05-18T21:33:09.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05e8ff9700 1 -- 172.21.15.63:0/1000689323 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05e000c9d0 con 0x7f05ec0b6500 2020-05-18T21:33:09.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.820+0000 7f05f0cb8700 1 -- 172.21.15.63:0/1000689323 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ec142d40 con 0x7f05ec0b6500 2020-05-18T21:33:09.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.824+0000 7f05f0cb8700 1 -- 172.21.15.63:0/1000689323 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ec0569e0 con 0x7f05ec0b6500 2020-05-18T21:33:09.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.824+0000 7f05eaffd700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05ec0b6500 0x7f05ec0b12f0 secure :-1 s=THROTTLE_DONE pgs=1309 cs=0 l=1 rx=0x7f05e0001110 tx=0x7f05e0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.824+0000 7f05e8ff9700 1 -- 172.21.15.63:0/1000689323 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f05e000cbd0 con 0x7f05ec0b6500 2020-05-18T21:33:09.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.824+0000 7f05eaffd700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05ec0b6500 0x7f05ec0b12f0 secure :-1 s=THROTTLE_DONE pgs=1309 cs=0 l=1 rx=0x7f05e0001110 tx=0x7f05e0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.824+0000 7f05e8ff9700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05cc04f8f0 0x7f05cc051db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:09.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.824+0000 7f05e8ff9700 1 -- 172.21.15.63:0/1000689323 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f05e0063650 con 0x7f05ec0b6500 2020-05-18T21:33:09.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.824+0000 7f05eb7fe700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05cc04f8f0 0x7f05cc051db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:09.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.824+0000 7f05eb7fe700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05cc04f8f0 0x7f05cc051db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05dc002f70 tx=0x7f05dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.824+0000 7f05eb7fe700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05cc04f8f0 0x7f05cc051db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05dc002f70 tx=0x7f05dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.824+0000 7f05eb7fe700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05cc04f8f0 0x7f05cc051db0 secure :-1 s=READY pgs=518 cs=0 l=1 rx=0x7f05dc002f70 tx=0x7f05dc007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:09.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.832+0000 7f05eaffd700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05ec0b6500 0x7f05ec0b12f0 secure :-1 s=THROTTLE_DONE pgs=1309 cs=0 l=1 rx=0x7f05e0001110 tx=0x7f05e0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.832+0000 7f05e8ff9700 1 -- 172.21.15.63:0/1000689323 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f05e003da40 con 0x7f05ec0b6500 2020-05-18T21:33:09.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.980+0000 7f05f0cb8700 1 -- 172.21.15.63:0/1000689323 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05ec065f30 con 0x7f05ec0b6500 2020-05-18T21:33:09.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.980+0000 7f05eaffd700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05ec0b6500 0x7f05ec0b12f0 secure :-1 s=THROTTLE_DONE pgs=1309 cs=0 l=1 rx=0x7f05e0001110 tx=0x7f05e0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:09.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.980+0000 7f05e8ff9700 1 -- 172.21.15.63:0/1000689323 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f05e0041060 con 0x7f05ec0b6500 2020-05-18T21:33:09.986 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:09.986 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":75,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2619292063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2619292063},{"type":"v1","addr":"172.21.15.155:6835","nonce":2619292063}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:32:53.188564+0000","modified":"2020-05-18T21:32:54.910500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7842},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7842":{"gid":7842,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/468101601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":468101601},{"type":"v1","addr":"172.21.15.63:6833","nonce":468101601}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-05-18T21:33:09.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.980+0000 7f05f0cb8700 1 -- 172.21.15.63:0/1000689323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05cc04f8f0 msgr2=0x7f05cc051db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:09.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.980+0000 7f05f0cb8700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05cc04f8f0 0x7f05cc051db0 secure :-1 s=READY pgs=518 cs=0 l=1 rx=0x7f05dc002f70 tx=0x7f05dc007a80).stop 2020-05-18T21:33:09.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.980+0000 7f05f0cb8700 1 -- 172.21.15.63:0/1000689323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05ec0b6500 msgr2=0x7f05ec0b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:09.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.980+0000 7f05f0cb8700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05ec0b6500 0x7f05ec0b12f0 secure :-1 s=READY pgs=1309 cs=0 l=1 rx=0x7f05e0001110 tx=0x7f05e0010a30).stop 2020-05-18T21:33:09.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.980+0000 7f05f0cb8700 1 -- 172.21.15.63:0/1000689323 shutdown_connections 2020-05-18T21:33:09.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.980+0000 7f05f0cb8700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05cc04f8f0 0x7f05cc051db0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:09.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.980+0000 7f05f0cb8700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05ec0b6500 0x7f05ec0b12f0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:09.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.980+0000 7f05f0cb8700 1 --2- 172.21.15.63:0/1000689323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05ec069eb0 0x7f05ec0b8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:09.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.980+0000 7f05f0cb8700 1 -- 172.21.15.63:0/1000689323 >> 172.21.15.63:0/1000689323 conn(0x7f05ec066d00 msgr2=0x7f05ec144010 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:09.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.980+0000 7f05f0cb8700 1 -- 172.21.15.63:0/1000689323 shutdown_connections 2020-05-18T21:33:09.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:09.980+0000 7f05f0cb8700 1 -- 172.21.15.63:0/1000689323 wait complete. 2020-05-18T21:33:09.990 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 75 2020-05-18T21:33:09.998 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache 2020-05-18T21:33:10.089 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:10.090 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:33:10.090 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays": 0, 2020-05-18T21:33:10.090 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_delayed": 0, 2020-05-18T21:33:10.090 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:33:10.091 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_created": 1, 2020-05-18T21:33:10.091 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 1, 2020-05-18T21:33:10.091 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_reintegrated": 0, 2020-05-18T21:33:10.091 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_migrated": 0, 2020-05-18T21:33:10.091 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_processing": 0, 2020-05-18T21:33:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:33:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:33:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_started": 0, 2020-05-18T21:33:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_completed": 0, 2020-05-18T21:33:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:33:10.093 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_exportdir": 0, 2020-05-18T21:33:10.093 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_flush": 0, 2020-05-18T21:33:10.093 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragmentdir": 0, 2020-05-18T21:33:10.093 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragstats": 0, 2020-05-18T21:33:10.093 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_inodestats": 0 2020-05-18T21:33:10.094 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:10.094 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:10.097 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "strays_created": 1, "strays_enqueued": 1, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0 } } 2020-05-18T21:33:10.098 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:10.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.196+0000 7f9c63fff700 1 Processor -- start 2020-05-18T21:33:10.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.196+0000 7f9c63fff700 1 -- start start 2020-05-18T21:33:10.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.196+0000 7f9c63fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c640b4760 0x7f9c640648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:10.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.196+0000 7f9c63fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c64064d20 0x7f9c6414d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:10.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.196+0000 7f9c63fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6414a330 con 0x7f9c6405f110 2020-05-18T21:33:10.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.196+0000 7f9c63fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6414a140 con 0x7f9c640b4760 2020-05-18T21:33:10.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.196+0000 7f9c63fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6414a5d0 con 0x7f9c64064d20 2020-05-18T21:33:10.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c62ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9c6405f110 0x7f9c6414aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33822/0 (socket says 172.21.15.63:33822) 2020-05-18T21:33:10.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c62ffd700 1 -- 172.21.15.63:0/2271478156 learned_addr learned my addr 172.21.15.63:0/2271478156 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:10.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c637fe700 1 --2- 172.21.15.63:0/2271478156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c64064d20 0x7f9c6414d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c627fc700 1 --2- 172.21.15.63:0/2271478156 >> v2:172.21.15.155:3300/0 conn(0x7f9c640b4760 0x7f9c640648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c61ffb700 1 -- 172.21.15.63:0/2271478156 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839404104 0 0) 0x7f9c6414a330 con 0x7f9c6405f110 2020-05-18T21:33:10.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c61ffb700 1 -- 172.21.15.63:0/2271478156 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c48003270 con 0x7f9c6405f110 2020-05-18T21:33:10.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c637fe700 1 -- 172.21.15.63:0/2271478156 >> v2:172.21.15.155:3300/0 conn(0x7f9c640b4760 msgr2=0x7f9c640648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:10.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c637fe700 1 --2- 172.21.15.63:0/2271478156 >> v2:172.21.15.155:3300/0 conn(0x7f9c640b4760 0x7f9c640648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:10.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c637fe700 1 -- 172.21.15.63:0/2271478156 >> v1:172.21.15.63:6789/0 conn(0x7f9c6405f110 legacy=0x7f9c6414aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c637fe700 1 -- 172.21.15.63:0/2271478156 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c64063430 con 0x7f9c64064d20 2020-05-18T21:33:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c627fc700 1 --2- 172.21.15.63:0/2271478156 >> v2:172.21.15.155:3300/0 conn(0x7f9c640b4760 0x7f9c640648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c637fe700 1 --2- 172.21.15.63:0/2271478156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c64064d20 0x7f9c6414d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9c5c0032f0 tx=0x7f9c5c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c637fe700 1 --2- 172.21.15.63:0/2271478156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c64064d20 0x7f9c6414d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9c5c0032f0 tx=0x7f9c5c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c637fe700 1 --2- 172.21.15.63:0/2271478156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c64064d20 0x7f9c6414d710 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7f9c5c0032f0 tx=0x7f9c5c007e00).ready entity=mon.2 client_cookie=4e80b8240f70fd87 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:10.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c637fe700 1 --2- 172.21.15.63:0/2271478156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c64064d20 0x7f9c6414d710 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f9c5c0032f0 tx=0x7f9c5c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c61ffb700 1 -- 172.21.15.63:0/2271478156 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c5c011db0 con 0x7f9c64064d20 2020-05-18T21:33:10.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c637fe700 1 --2- 172.21.15.63:0/2271478156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c64064d20 0x7f9c6414d710 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f9c5c0032f0 tx=0x7f9c5c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c61ffb700 1 -- 172.21.15.63:0/2271478156 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c00a180 con 0x7f9c64064d20 2020-05-18T21:33:10.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c637fe700 1 --2- 172.21.15.63:0/2271478156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c64064d20 0x7f9c6414d710 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f9c5c0032f0 tx=0x7f9c5c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c61ffb700 1 -- 172.21.15.63:0/2271478156 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c5c00a5a0 con 0x7f9c64064d20 2020-05-18T21:33:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c63fff700 1 -- 172.21.15.63:0/2271478156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c64064d20 msgr2=0x7f9c6414d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.200+0000 7f9c63fff700 1 --2- 172.21.15.63:0/2271478156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c64064d20 0x7f9c6414d710 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7f9c5c0032f0 tx=0x7f9c5c007e00).stop 2020-05-18T21:33:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c63fff700 1 -- 172.21.15.63:0/2271478156 shutdown_connections 2020-05-18T21:33:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c63fff700 1 --2- 172.21.15.63:0/2271478156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c64064d20 0x7f9c6414d710 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c63fff700 1 --2- 172.21.15.63:0/2271478156 >> v2:172.21.15.155:3300/0 conn(0x7f9c640b4760 0x7f9c640648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:10.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c63fff700 1 -- 172.21.15.63:0/2271478156 >> 172.21.15.63:0/2271478156 conn(0x7f9c64069fc0 msgr2=0x7f9c6406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:10.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c63fff700 1 -- 172.21.15.63:0/2271478156 shutdown_connections 2020-05-18T21:33:10.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c63fff700 1 -- 172.21.15.63:0/2271478156 wait complete. 2020-05-18T21:33:10.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c63fff700 1 Processor -- start 2020-05-18T21:33:10.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c63fff700 1 -- start start 2020-05-18T21:33:10.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c63fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c64064d20 0x7f9c6415b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c63fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c64147fb0 con 0x7f9c6405f110 2020-05-18T21:33:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c63fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c64148250 con 0x7f9c640b4760 2020-05-18T21:33:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c63fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c64144790 con 0x7f9c64064d20 2020-05-18T21:33:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c627fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c64064d20 0x7f9c6415b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c62ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9c6405f110 0x7f9c6415adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33828/0 (socket says 172.21.15.63:33828) 2020-05-18T21:33:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c62ffd700 1 -- 172.21.15.63:0/3509251766 learned_addr learned my addr 172.21.15.63:0/3509251766 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c5bfff700 1 -- 172.21.15.63:0/3509251766 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680260322 0 0) 0x7f9c64147fb0 con 0x7f9c6405f110 2020-05-18T21:33:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c5bfff700 1 -- 172.21.15.63:0/3509251766 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c3c002fe0 con 0x7f9c6405f110 2020-05-18T21:33:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c627fc700 1 -- 172.21.15.63:0/3509251766 >> v1:172.21.15.155:6789/0 conn(0x7f9c640b4760 legacy=0x7f9c64144c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c627fc700 1 -- 172.21.15.63:0/3509251766 >> v1:172.21.15.63:6789/0 conn(0x7f9c6405f110 legacy=0x7f9c6415adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c627fc700 1 -- 172.21.15.63:0/3509251766 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6415b920 con 0x7f9c64064d20 2020-05-18T21:33:10.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c627fc700 1 --2- 172.21.15.63:0/3509251766 >> v2:172.21.15.63:3300/0 conn(0x7f9c64064d20 0x7f9c6415b4c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c4c002f70 tx=0x7f9c4c010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c627fc700 1 --2- 172.21.15.63:0/3509251766 >> v2:172.21.15.63:3300/0 conn(0x7f9c64064d20 0x7f9c6415b4c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c4c002f70 tx=0x7f9c4c010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.204+0000 7f9c627fc700 1 --2- 172.21.15.63:0/3509251766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c64064d20 0x7f9c6415b4c0 secure :-1 s=READY pgs=1312 cs=0 l=1 rx=0x7f9c4c002f70 tx=0x7f9c4c010de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.208+0000 7f9c627fc700 1 --2- 172.21.15.63:0/3509251766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c64064d20 0x7f9c6415b4c0 secure :-1 s=THROTTLE_DONE pgs=1312 cs=0 l=1 rx=0x7f9c4c002f70 tx=0x7f9c4c010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.208+0000 7f9c5bfff700 1 -- 172.21.15.63:0/3509251766 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c4c00c980 con 0x7f9c64064d20 2020-05-18T21:33:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.208+0000 7f9c627fc700 1 --2- 172.21.15.63:0/3509251766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c64064d20 0x7f9c6415b4c0 secure :-1 s=THROTTLE_DONE pgs=1312 cs=0 l=1 rx=0x7f9c4c002f70 tx=0x7f9c4c010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.208+0000 7f9c627fc700 1 --2- 172.21.15.63:0/3509251766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c64064d20 0x7f9c6415b4c0 secure :-1 s=THROTTLE_DONE pgs=1312 cs=0 l=1 rx=0x7f9c4c002f70 tx=0x7f9c4c010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.208+0000 7f9c5bfff700 1 -- 172.21.15.63:0/3509251766 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c00cae0 con 0x7f9c64064d20 2020-05-18T21:33:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.208+0000 7f9c63fff700 1 -- 172.21.15.63:0/3509251766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c64147c30 con 0x7f9c64064d20 2020-05-18T21:33:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.208+0000 7f9c5bfff700 1 -- 172.21.15.63:0/3509251766 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c4c005700 con 0x7f9c64064d20 2020-05-18T21:33:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.208+0000 7f9c63fff700 1 -- 172.21.15.63:0/3509251766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c64142740 con 0x7f9c64064d20 2020-05-18T21:33:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.208+0000 7f9c63fff700 1 -- 172.21.15.63:0/3509251766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c640569e0 con 0x7f9c64064d20 2020-05-18T21:33:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.208+0000 7f9c627fc700 1 --2- 172.21.15.63:0/3509251766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c64064d20 0x7f9c6415b4c0 secure :-1 s=THROTTLE_DONE pgs=1312 cs=0 l=1 rx=0x7f9c4c002f70 tx=0x7f9c4c010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.208+0000 7f9c5bfff700 1 -- 172.21.15.63:0/3509251766 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9c4c0071a0 con 0x7f9c64064d20 2020-05-18T21:33:10.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.208+0000 7f9c627fc700 1 --2- 172.21.15.63:0/3509251766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c64064d20 0x7f9c6415b4c0 secure :-1 s=THROTTLE_DONE pgs=1312 cs=0 l=1 rx=0x7f9c4c002f70 tx=0x7f9c4c010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.208+0000 7f9c5bfff700 1 --2- 172.21.15.63:0/3509251766 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c3c04fd40 0x7f9c3c052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:10.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.208+0000 7f9c5bfff700 1 -- 172.21.15.63:0/3509251766 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9c4c063870 con 0x7f9c64064d20 2020-05-18T21:33:10.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.208+0000 7f9c62ffd700 1 --2- 172.21.15.63:0/3509251766 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c3c04fd40 0x7f9c3c052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.208+0000 7f9c62ffd700 1 --2- 172.21.15.63:0/3509251766 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c3c04fd40 0x7f9c3c052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c54001150 tx=0x7f9c54001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.212+0000 7f9c62ffd700 1 --2- 172.21.15.63:0/3509251766 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c3c04fd40 0x7f9c3c052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c54001150 tx=0x7f9c54001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.212+0000 7f9c62ffd700 1 --2- 172.21.15.63:0/3509251766 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c3c04fd40 0x7f9c3c052200 secure :-1 s=READY pgs=519 cs=0 l=1 rx=0x7f9c54001150 tx=0x7f9c54001720).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:10.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.216+0000 7f9c627fc700 1 --2- 172.21.15.63:0/3509251766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c64064d20 0x7f9c6415b4c0 secure :-1 s=THROTTLE_DONE pgs=1312 cs=0 l=1 rx=0x7f9c4c002f70 tx=0x7f9c4c010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.216+0000 7f9c5bfff700 1 -- 172.21.15.63:0/3509251766 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9c4c03dc00 con 0x7f9c64064d20 2020-05-18T21:33:10.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.364+0000 7f9c63fff700 1 -- 172.21.15.63:0/3509251766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c64142740 con 0x7f9c64064d20 2020-05-18T21:33:10.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.364+0000 7f9c627fc700 1 --2- 172.21.15.63:0/3509251766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c64064d20 0x7f9c6415b4c0 secure :-1 s=THROTTLE_DONE pgs=1312 cs=0 l=1 rx=0x7f9c4c002f70 tx=0x7f9c4c010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.364+0000 7f9c5bfff700 1 -- 172.21.15.63:0/3509251766 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f9c64142740 con 0x7f9c64064d20 2020-05-18T21:33:10.370 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:10.370 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":75,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2619292063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2619292063},{"type":"v1","addr":"172.21.15.155:6835","nonce":2619292063}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:32:53.188564+0000","modified":"2020-05-18T21:32:54.910500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7842},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7842":{"gid":7842,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/468101601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":468101601},{"type":"v1","addr":"172.21.15.63:6833","nonce":468101601}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-05-18T21:33:10.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.364+0000 7f9c63fff700 1 -- 172.21.15.63:0/3509251766 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c3c04fd40 msgr2=0x7f9c3c052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.364+0000 7f9c63fff700 1 --2- 172.21.15.63:0/3509251766 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c3c04fd40 0x7f9c3c052200 secure :-1 s=READY pgs=519 cs=0 l=1 rx=0x7f9c54001150 tx=0x7f9c54001720).stop 2020-05-18T21:33:10.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.364+0000 7f9c63fff700 1 -- 172.21.15.63:0/3509251766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c64064d20 msgr2=0x7f9c6415b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.364+0000 7f9c63fff700 1 --2- 172.21.15.63:0/3509251766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c64064d20 0x7f9c6415b4c0 secure :-1 s=READY pgs=1312 cs=0 l=1 rx=0x7f9c4c002f70 tx=0x7f9c4c010de0).stop 2020-05-18T21:33:10.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.364+0000 7f9c63fff700 1 -- 172.21.15.63:0/3509251766 shutdown_connections 2020-05-18T21:33:10.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.364+0000 7f9c63fff700 1 --2- 172.21.15.63:0/3509251766 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c3c04fd40 0x7f9c3c052200 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:10.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.364+0000 7f9c63fff700 1 --2- 172.21.15.63:0/3509251766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c64064d20 0x7f9c6415b4c0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:10.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.364+0000 7f9c63fff700 1 -- 172.21.15.63:0/3509251766 >> 172.21.15.63:0/3509251766 conn(0x7f9c64069fc0 msgr2=0x7f9c64149880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:10.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.364+0000 7f9c63fff700 1 -- 172.21.15.63:0/3509251766 shutdown_connections 2020-05-18T21:33:10.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.364+0000 7f9c63fff700 1 -- 172.21.15.63:0/3509251766 wait complete. 2020-05-18T21:33:10.374 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 75 2020-05-18T21:33:10.382 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump purge_queue 2020-05-18T21:33:10.483 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:10.484 INFO:teuthology.orchestra.run.smithi063.stdout: "purge_queue": { 2020-05-18T21:33:10.484 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops": 0, 2020-05-18T21:33:10.484 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops_high_water": 3, 2020-05-18T21:33:10.484 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing": 0, 2020-05-18T21:33:10.484 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_high_water": 1, 2020-05-18T21:33:10.485 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executed": 1, 2020-05-18T21:33:10.485 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_item_in_journal": 0 2020-05-18T21:33:10.485 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:10.485 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:10.492 INFO:tasks.cephfs.filesystem:_json_asok output: { "purge_queue": { "pq_executing_ops": 0, "pq_executing_ops_high_water": 3, "pq_executing": 0, "pq_executing_high_water": 1, "pq_executed": 1, "pq_item_in_journal": 0 } } 2020-05-18T21:33:10.493 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_data ls 2020-05-18T21:33:10.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafe3eb0b80 1 Processor -- start 2020-05-18T21:33:10.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafe3eb0b80 1 -- start start 2020-05-18T21:33:10.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafe3eb0b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561e87ae9700 0x561e87a5e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:10.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafe3eb0b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x561e87aed680 0x561e87aeda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:10.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafe3eb0b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x561e8799d460 con 0x561e87a5cc40 2020-05-18T21:33:10.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafe3eb0b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x561e879c9800 con 0x561e87aed680 2020-05-18T21:33:10.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafe3eb0b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e879a9110 con 0x561e87ae9700 2020-05-18T21:33:10.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafe22f3700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x561e87a5cc40 0x561e87a40570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33846/0 (socket says 172.21.15.63:33846) 2020-05-18T21:33:10.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafe22f3700 1 -- 172.21.15.63:0/3650709210 learned_addr learned my addr 172.21.15.63:0/3650709210 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:10.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafe1af2700 1 --2- 172.21.15.63:0/3650709210 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561e87ae9700 0x561e87a5e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafe2af4700 1 --2- 172.21.15.63:0/3650709210 >> v2:172.21.15.155:3300/0 conn(0x561e87aed680 0x561e87aeda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafdbfff700 1 -- 172.21.15.63:0/3650709210 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287029346 0 0) 0x561e8799d460 con 0x561e87a5cc40 2020-05-18T21:33:10.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafdbfff700 1 -- 172.21.15.63:0/3650709210 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafc4002020 con 0x561e87a5cc40 2020-05-18T21:33:10.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafdbfff700 1 -- 172.21.15.63:0/3650709210 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 787433387 0 0) 0x7fafc4002020 con 0x561e87a5cc40 2020-05-18T21:33:10.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafdbfff700 1 -- 172.21.15.63:0/3650709210 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561e87ae9700 msgr2=0x561e87a5e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:10.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafdbfff700 1 --2- 172.21.15.63:0/3650709210 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561e87ae9700 0x561e87a5e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:10.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafdbfff700 1 -- 172.21.15.63:0/3650709210 >> v2:172.21.15.155:3300/0 conn(0x561e87aed680 msgr2=0x561e87aeda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:10.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafdbfff700 1 --2- 172.21.15.63:0/3650709210 >> v2:172.21.15.155:3300/0 conn(0x561e87aed680 0x561e87aeda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:10.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafdbfff700 1 -- 172.21.15.63:0/3650709210 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e87aec630 con 0x561e87a5cc40 2020-05-18T21:33:10.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafdbfff700 1 -- 172.21.15.63:0/3650709210 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fafd4001740 con 0x561e87a5cc40 2020-05-18T21:33:10.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafe1af2700 1 --2- 172.21.15.63:0/3650709210 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561e87ae9700 0x561e87a5e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:10.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafdbfff700 1 -- 172.21.15.63:0/3650709210 >> v1:172.21.15.63:6789/0 conn(0x561e87a5cc40 legacy=0x561e87a40570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafdbfff700 1 --2- 172.21.15.63:0/3650709210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafc4002660 0x7fafc4002aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:10.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafdbfff700 1 --2- 172.21.15.63:0/3650709210 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fafc4002f50 0x7fafc40033b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:10.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafdbfff700 1 --2- 172.21.15.63:0/3650709210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafc40038d0 0x7fafc4003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:10.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafdbfff700 1 -- 172.21.15.63:0/3650709210 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e879c9800 con 0x7fafc4002660 2020-05-18T21:33:10.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafdbfff700 1 -- 172.21.15.63:0/3650709210 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e879a9110 con 0x7fafc40038d0 2020-05-18T21:33:10.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.516+0000 7fafdbfff700 1 -- 172.21.15.63:0/3650709210 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc400a580 con 0x7fafc4002f50 2020-05-18T21:33:10.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe22f3700 1 --2- 172.21.15.63:0/3650709210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafc4002660 0x7fafc4002aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe2af4700 1 --2- 172.21.15.63:0/3650709210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafc40038d0 0x7fafc4003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe1af2700 1 --2- 172.21.15.63:0/3650709210 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fafc4002f50 0x7fafc40033b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe22f3700 1 -- 172.21.15.63:0/3650709210 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fafc4002f50 msgr2=0x7fafc40033b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:10.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe22f3700 1 --2- 172.21.15.63:0/3650709210 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fafc4002f50 0x7fafc40033b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:10.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe22f3700 1 -- 172.21.15.63:0/3650709210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafc40038d0 msgr2=0x7fafc4003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:10.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe22f3700 1 --2- 172.21.15.63:0/3650709210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafc40038d0 0x7fafc4003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:10.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe22f3700 1 -- 172.21.15.63:0/3650709210 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4002020 con 0x7fafc4002660 2020-05-18T21:33:10.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe22f3700 1 --2- 172.21.15.63:0/3650709210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafc4002660 0x7fafc4002aa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fafd40011d0 tx=0x7fafd4002dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe22f3700 1 --2- 172.21.15.63:0/3650709210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafc4002660 0x7fafc4002aa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fafd40011d0 tx=0x7fafd4002dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe22f3700 1 --2- 172.21.15.63:0/3650709210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafc4002660 0x7fafc4002aa0 secure :-1 s=READY pgs=1316 cs=0 l=1 rx=0x7fafd40011d0 tx=0x7fafd4002dc0).ready entity=mon.0 client_cookie=353f0a98a6a5d37f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:10.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe22f3700 1 --2- 172.21.15.63:0/3650709210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafc4002660 0x7fafc4002aa0 secure :-1 s=THROTTLE_DONE pgs=1316 cs=0 l=1 rx=0x7fafd40011d0 tx=0x7fafd4002dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafdbfff700 1 -- 172.21.15.63:0/3650709210 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafd400d820 con 0x7fafc4002660 2020-05-18T21:33:10.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe22f3700 1 --2- 172.21.15.63:0/3650709210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafc4002660 0x7fafc4002aa0 secure :-1 s=THROTTLE_DONE pgs=1316 cs=0 l=1 rx=0x7fafd40011d0 tx=0x7fafd4002dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe22f3700 1 --2- 172.21.15.63:0/3650709210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafc4002660 0x7fafc4002aa0 secure :-1 s=THROTTLE_DONE pgs=1316 cs=0 l=1 rx=0x7fafd40011d0 tx=0x7fafd4002dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafdbfff700 1 -- 172.21.15.63:0/3650709210 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd400d980 con 0x7fafc4002660 2020-05-18T21:33:10.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafdbfff700 1 -- 172.21.15.63:0/3650709210 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafd400dd60 con 0x7fafc4002660 2020-05-18T21:33:10.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe3eb0b80 1 -- 172.21.15.63:0/3650709210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafc4002660 msgr2=0x7fafc4002aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe3eb0b80 1 --2- 172.21.15.63:0/3650709210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fafc4002660 0x7fafc4002aa0 secure :-1 s=READY pgs=1316 cs=0 l=1 rx=0x7fafd40011d0 tx=0x7fafd4002dc0).stop 2020-05-18T21:33:10.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe2af4700 1 -- 172.21.15.63:0/3650709210 reap_dead start 2020-05-18T21:33:10.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe3eb0b80 1 -- 172.21.15.63:0/3650709210 shutdown_connections 2020-05-18T21:33:10.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe3eb0b80 1 -- 172.21.15.63:0/3650709210 >> 172.21.15.63:0/3650709210 conn(0x561e87a60850 msgr2=0x561e87a41a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:10.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe3eb0b80 1 -- 172.21.15.63:0/3650709210 shutdown_connections 2020-05-18T21:33:10.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe3eb0b80 1 -- 172.21.15.63:0/3650709210 wait complete. 2020-05-18T21:33:10.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe3eb0b80 1 Processor -- start 2020-05-18T21:33:10.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.520+0000 7fafe3eb0b80 1 -- start start 2020-05-18T21:33:10.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafe3eb0b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561e87a55ee0 0x561e87ae6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:10.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafe3eb0b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x561e87ae8080 con 0x561e87ae5300 2020-05-18T21:33:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafe3eb0b80 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x561e87ae8320 con 0x561e87a55b00 2020-05-18T21:33:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafe3eb0b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e87999a40 con 0x561e87a55ee0 2020-05-18T21:33:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafe2af4700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x561e87ae5300 0x561e87ae3cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33858/0 (socket says 172.21.15.63:33858) 2020-05-18T21:33:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafe2af4700 1 -- 172.21.15.63:0/3236174916 learned_addr learned my addr 172.21.15.63:0/3236174916 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafe1af2700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561e87a55ee0 0x561e87ae6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafdb7fe700 1 -- 172.21.15.63:0/3236174916 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1800296558 0 0) 0x561e87ae8080 con 0x561e87ae5300 2020-05-18T21:33:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafdb7fe700 1 -- 172.21.15.63:0/3236174916 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafc4003330 con 0x561e87ae5300 2020-05-18T21:33:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafdb7fe700 1 -- 172.21.15.63:0/3236174916 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762320871 0 0) 0x561e87ae8320 con 0x561e87a55b00 2020-05-18T21:33:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafdb7fe700 1 -- 172.21.15.63:0/3236174916 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x561e87ae8080 con 0x561e87a55b00 2020-05-18T21:33:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafe1af2700 1 -- 172.21.15.63:0/3236174916 >> v1:172.21.15.155:6789/0 conn(0x561e87a55b00 legacy=0x561e87a41910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafe1af2700 1 -- 172.21.15.63:0/3236174916 >> v1:172.21.15.63:6789/0 conn(0x561e87ae5300 legacy=0x561e87ae3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafe1af2700 1 -- 172.21.15.63:0/3236174916 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e87ae85c0 con 0x561e87a55ee0 2020-05-18T21:33:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafe1af2700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561e87a55ee0 0x561e87ae6320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fafcc000b60 tx=0x7fafcc002f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafe1af2700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561e87a55ee0 0x561e87ae6320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fafcc000b60 tx=0x7fafcc002f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafe1af2700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561e87a55ee0 0x561e87ae6320 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7fafcc000b60 tx=0x7fafcc002f50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:10.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafe1af2700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561e87a55ee0 0x561e87ae6320 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fafcc000b60 tx=0x7fafcc002f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafdb7fe700 1 -- 172.21.15.63:0/3236174916 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafcc00b370 con 0x561e87a55ee0 2020-05-18T21:33:10.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafe1af2700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561e87a55ee0 0x561e87ae6320 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fafcc000b60 tx=0x7fafcc002f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafdb7fe700 1 -- 172.21.15.63:0/3236174916 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc00b4d0 con 0x561e87a55ee0 2020-05-18T21:33:10.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafe1af2700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561e87a55ee0 0x561e87ae6320 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fafcc000b60 tx=0x7fafcc002f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafe3eb0b80 1 -- 172.21.15.63:0/3236174916 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561e87a5c6e0 con 0x561e87a55ee0 2020-05-18T21:33:10.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafdb7fe700 1 -- 172.21.15.63:0/3236174916 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafcc00b870 con 0x561e87a55ee0 2020-05-18T21:33:10.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.524+0000 7fafe3eb0b80 1 -- 172.21.15.63:0/3236174916 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e87ae5960 con 0x561e87a55ee0 2020-05-18T21:33:10.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.528+0000 7fafe1af2700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561e87a55ee0 0x561e87ae6320 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fafcc000b60 tx=0x7fafcc002f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.528+0000 7fafdb7fe700 1 -- 172.21.15.63:0/3236174916 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fafcc00ba70 con 0x561e87a55ee0 2020-05-18T21:33:10.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.528+0000 7fafe1af2700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561e87a55ee0 0x561e87ae6320 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fafcc000b60 tx=0x7fafcc002f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.528+0000 7fafdb7fe700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fafc404fe30 0x7fafc40522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:10.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.528+0000 7fafdb7fe700 1 -- 172.21.15.63:0/3236174916 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fafcc063590 con 0x561e87a55ee0 2020-05-18T21:33:10.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.528+0000 7fafe3eb0b80 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x561e87b04da0 0x561e87b07190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:10.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.528+0000 7fafe3eb0b80 1 -- 172.21.15.63:0/3236174916 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- osd_op(unknown.0.0:1 18.0 18:00000000::::head [pgnls start_epoch 95 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e95) v8 -- 0x561e87ae4e20 con 0x561e87b04da0 2020-05-18T21:33:10.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.528+0000 7fafe22f3700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fafc404fe30 0x7fafc40522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.528+0000 7fafe2af4700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x561e87b04da0 0x561e87b07190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.528+0000 7fafe22f3700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fafc404fe30 0x7fafc40522f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fafd400a6c0 tx=0x7fafd4002dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.528+0000 7fafe22f3700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fafc404fe30 0x7fafc40522f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fafd400a6c0 tx=0x7fafd4002dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.528+0000 7fafe22f3700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fafc404fe30 0x7fafc40522f0 secure :-1 s=READY pgs=520 cs=0 l=1 rx=0x7fafd400a6c0 tx=0x7fafd4002dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:10.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.528+0000 7fafe2af4700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x561e87b04da0 0x561e87b07190 crc :-1 s=READY pgs=31 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:10.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.528+0000 7fafe2af4700 1 -- 172.21.15.63:0/3236174916 <== osd.0 v2:172.21.15.63:6800/12803 1 ==== osd_op_reply(1 [pgnls start_epoch 95 out=81b] v95'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x7fafdc003450 con 0x561e87b04da0 2020-05-18T21:33:10.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.532+0000 7fafe2af4700 1 -- 172.21.15.63:0/3236174916 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- osd_op(unknown.0.0:2 18.4 18:20000000::::head [pgnls start_epoch 95 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e95) v8 -- 0x561e87ae4e20 con 0x561e87b04da0 2020-05-18T21:33:10.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.532+0000 7fafe2af4700 1 -- 172.21.15.63:0/3236174916 <== osd.0 v2:172.21.15.63:6800/12803 2 ==== osd_op_reply(2 [pgnls start_epoch 95 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafdc003450 con 0x561e87b04da0 2020-05-18T21:33:10.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.532+0000 7fafe2af4700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x561e87a5cc40 0x7fafdc004060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:10.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.532+0000 7fafe2af4700 1 -- 172.21.15.63:0/3236174916 --> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] -- osd_op(unknown.0.0:3 18.2 18:40000000::::head [pgnls start_epoch 95 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e95) v8 -- 0x561e87ae4e20 con 0x561e87a5cc40 2020-05-18T21:33:10.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.532+0000 7fafe22f3700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x561e87a5cc40 0x7fafdc004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.532+0000 7fafe22f3700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x561e87a5cc40 0x7fafdc004060 crc :-1 s=READY pgs=18 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:10.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.532+0000 7fafe22f3700 1 -- 172.21.15.63:0/3236174916 <== osd.7 v2:172.21.15.155:6823/13026 1 ==== osd_op_reply(3 [pgnls start_epoch 95 out=81b] v95'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x7fafd4002a30 con 0x561e87a5cc40 2020-05-18T21:33:10.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.532+0000 7fafe22f3700 1 -- 172.21.15.63:0/3236174916 --> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] -- osd_op(unknown.0.0:4 18.6 18:60000000::::head [pgnls start_epoch 95 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e95) v8 -- 0x561e87ae4e20 con 0x561e87a5cc40 2020-05-18T21:33:10.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.536+0000 7fafe22f3700 1 -- 172.21.15.63:0/3236174916 <== osd.7 v2:172.21.15.155:6823/13026 2 ==== osd_op_reply(4 [pgnls start_epoch 95 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafd4002a30 con 0x561e87a5cc40 2020-05-18T21:33:10.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.536+0000 7fafe22f3700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fafd400f780 0x7fafd400b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:10.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.536+0000 7fafe22f3700 1 -- 172.21.15.63:0/3236174916 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- osd_op(unknown.0.0:5 18.1 18:80000000::::head [pgnls start_epoch 95 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e95) v8 -- 0x561e87ae4e20 con 0x7fafd400f780 2020-05-18T21:33:10.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.536+0000 7fafe1af2700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fafd400f780 0x7fafd400b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.536+0000 7fafe1af2700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fafd400f780 0x7fafd400b2b0 crc :-1 s=READY pgs=18 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:10.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.536+0000 7fafe1af2700 1 -- 172.21.15.63:0/3236174916 <== osd.3 v2:172.21.15.63:6814/12805 1 ==== osd_op_reply(5 [pgnls start_epoch 95 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafcc03fa40 con 0x7fafd400f780 2020-05-18T21:33:10.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.536+0000 7fafe1af2700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x561e87ae9700 0x7fafcc040600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:10.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.536+0000 7fafe1af2700 1 -- 172.21.15.63:0/3236174916 --> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] -- osd_op(unknown.0.0:6 18.5 18:a0000000::::head [pgnls start_epoch 95 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e95) v8 -- 0x561e87ae4e20 con 0x561e87ae9700 2020-05-18T21:33:10.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.536+0000 7fafe2af4700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x561e87ae9700 0x7fafcc040600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.536+0000 7fafe2af4700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x561e87ae9700 0x7fafcc040600 crc :-1 s=READY pgs=22 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:10.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.536+0000 7fafe2af4700 1 -- 172.21.15.63:0/3236174916 <== osd.1 v2:172.21.15.63:6808/12804 1 ==== osd_op_reply(6 [pgnls start_epoch 95 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafdc003450 con 0x561e87ae9700 2020-05-18T21:33:10.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.536+0000 7fafe2af4700 1 -- 172.21.15.63:0/3236174916 --> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] -- osd_op(unknown.0.0:7 18.3 18:c0000000::::head [pgnls start_epoch 95 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e95) v8 -- 0x561e87ae4e20 con 0x561e87ae9700 2020-05-18T21:33:10.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe2af4700 1 -- 172.21.15.63:0/3236174916 <== osd.1 v2:172.21.15.63:6808/12804 2 ==== osd_op_reply(7 [pgnls start_epoch 95 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafdc003450 con 0x561e87ae9700 2020-05-18T21:33:10.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe2af4700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x561e87aed680 0x7fafdc004b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:10.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe2af4700 1 -- 172.21.15.63:0/3236174916 --> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] -- osd_op(unknown.0.0:8 18.7 18:e0000000::::head [pgnls start_epoch 95 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e95) v8 -- 0x561e87ae4e20 con 0x561e87aed680 2020-05-18T21:33:10.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe22f3700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x561e87aed680 0x7fafdc004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe22f3700 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x561e87aed680 0x7fafdc004b40 crc :-1 s=READY pgs=21 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:10.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe22f3700 1 -- 172.21.15.63:0/3236174916 <== osd.2 v2:172.21.15.63:6822/12806 1 ==== osd_op_reply(8 [pgnls start_epoch 95 out=49b] v95'5 uv5 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafd4002a30 con 0x561e87aed680 2020-05-18T21:33:10.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe3eb0b80 1 -- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x561e87b04da0 msgr2=0x561e87b07190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe3eb0b80 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x561e87b04da0 0x561e87b07190 crc :-1 s=READY pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:10.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe3eb0b80 1 -- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x561e87ae9700 msgr2=0x7fafcc040600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe3eb0b80 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x561e87ae9700 0x7fafcc040600 crc :-1 s=READY pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:10.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe3eb0b80 1 -- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x561e87aed680 msgr2=0x7fafdc004b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe3eb0b80 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x561e87aed680 0x7fafdc004b40 crc :-1 s=READY pgs=21 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:10.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe3eb0b80 1 -- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fafd400f780 msgr2=0x7fafd400b2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe3eb0b80 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fafd400f780 0x7fafd400b2b0 crc :-1 s=READY pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:10.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe2af4700 1 -- 172.21.15.63:0/3236174916 reap_dead start 2020-05-18T21:33:10.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe3eb0b80 1 -- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x561e87a5cc40 msgr2=0x7fafdc004060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe3eb0b80 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x561e87a5cc40 0x7fafdc004060 crc :-1 s=READY pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:10.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe3eb0b80 1 -- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fafc404fe30 msgr2=0x7fafc40522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe3eb0b80 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fafc404fe30 0x7fafc40522f0 secure :-1 s=READY pgs=520 cs=0 l=1 rx=0x7fafd400a6c0 tx=0x7fafd4002dc0).stop 2020-05-18T21:33:10.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe3eb0b80 1 -- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561e87a55ee0 msgr2=0x561e87ae6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.540+0000 7fafe3eb0b80 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561e87a55ee0 0x561e87ae6320 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7fafcc000b60 tx=0x7fafcc002f50).stop 2020-05-18T21:33:10.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.544+0000 7fafe3eb0b80 1 -- 172.21.15.63:0/3236174916 shutdown_connections 2020-05-18T21:33:10.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.544+0000 7fafe3eb0b80 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fafd400f780 0x7fafd400b2b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:10.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.544+0000 7fafe3eb0b80 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x561e87a5cc40 0x7fafdc004060 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:10.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.544+0000 7fafe3eb0b80 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fafc404fe30 0x7fafc40522f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:10.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.544+0000 7fafe3eb0b80 1 --2- 172.21.15.63:0/3236174916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561e87a55ee0 0x561e87ae6320 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:10.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.544+0000 7fafe3eb0b80 1 -- 172.21.15.63:0/3236174916 >> 172.21.15.63:0/3236174916 conn(0x561e87a60850 msgr2=0x561e87aeda60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:10.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.544+0000 7fafe3eb0b80 1 -- 172.21.15.63:0/3236174916 shutdown_connections 2020-05-18T21:33:10.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.544+0000 7fafe3eb0b80 1 -- 172.21.15.63:0/3236174916 wait complete. 2020-05-18T21:33:10.560 INFO:teuthology.orchestra.run.smithi063.stdout:10000000000.00000000 2020-05-18T21:33:10.560 INFO:teuthology.orchestra.run.smithi063.stdout:10000000000.00000001 2020-05-18T21:33:10.560 INFO:tasks.cephfs.filesystem:All objects for ino 1099511627777 size 8388608 are absent 2020-05-18T21:33:10.561 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:10.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efef5d29700 1 Processor -- start 2020-05-18T21:33:10.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efef5d29700 1 -- start start 2020-05-18T21:33:10.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efef5d29700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efef00bb5e0 0x7efef00acee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:10.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efef5d29700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efef00bbcd0 0x7efef00afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:10.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efef5d29700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef00af980 con 0x7efef00b0280 2020-05-18T21:33:10.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efef5d29700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef00af770 con 0x7efef00bbcd0 2020-05-18T21:33:10.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efef5d29700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef00bb9c0 con 0x7efef00bb5e0 2020-05-18T21:33:10.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efee7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efef00bbcd0 0x7efef00afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efee7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efef00bbcd0 0x7efef00afe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59916/0 (socket says 172.21.15.63:59916) 2020-05-18T21:33:10.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efee7fff700 1 -- 172.21.15.63:0/2416638103 learned_addr learned my addr 172.21.15.63:0/2416638103 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:10.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efeef7fe700 1 --2- 172.21.15.63:0/2416638103 >> v2:172.21.15.155:3300/0 conn(0x7efef00bb5e0 0x7efef00acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efee7fff700 1 -- 172.21.15.63:0/2416638103 >> v2:172.21.15.155:3300/0 conn(0x7efef00bb5e0 msgr2=0x7efef00acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:10.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efee7fff700 1 --2- 172.21.15.63:0/2416638103 >> v2:172.21.15.155:3300/0 conn(0x7efef00bb5e0 0x7efef00acee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:10.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efee7fff700 1 -- 172.21.15.63:0/2416638103 >> v1:172.21.15.155:6789/0 conn(0x7efef00b0280 legacy=0x7efef012efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:10.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efee7fff700 1 -- 172.21.15.63:0/2416638103 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef00af3d0 con 0x7efef00bbcd0 2020-05-18T21:33:10.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efee7fff700 1 --2- 172.21.15.63:0/2416638103 >> v2:172.21.15.63:3300/0 conn(0x7efef00bbcd0 0x7efef00afe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efef00ae780 tx=0x7efed8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efee7fff700 1 --2- 172.21.15.63:0/2416638103 >> v2:172.21.15.63:3300/0 conn(0x7efef00bbcd0 0x7efef00afe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efef00ae780 tx=0x7efed8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efee7fff700 1 --2- 172.21.15.63:0/2416638103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efef00bbcd0 0x7efef00afe20 secure :-1 s=READY pgs=1318 cs=0 l=1 rx=0x7efef00ae780 tx=0x7efed8007a80).ready entity=mon.0 client_cookie=1461b512e3e7670d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:10.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efee7fff700 1 --2- 172.21.15.63:0/2416638103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efef00bbcd0 0x7efef00afe20 secure :-1 s=THROTTLE_DONE pgs=1318 cs=0 l=1 rx=0x7efef00ae780 tx=0x7efed8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efeeeffd700 1 -- 172.21.15.63:0/2416638103 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efed8011720 con 0x7efef00bbcd0 2020-05-18T21:33:10.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efee7fff700 1 --2- 172.21.15.63:0/2416638103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efef00bbcd0 0x7efef00afe20 secure :-1 s=THROTTLE_DONE pgs=1318 cs=0 l=1 rx=0x7efef00ae780 tx=0x7efed8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efee7fff700 1 --2- 172.21.15.63:0/2416638103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efef00bbcd0 0x7efef00afe20 secure :-1 s=THROTTLE_DONE pgs=1318 cs=0 l=1 rx=0x7efef00ae780 tx=0x7efed8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efeeeffd700 1 -- 172.21.15.63:0/2416638103 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed8011880 con 0x7efef00bbcd0 2020-05-18T21:33:10.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efeeeffd700 1 -- 172.21.15.63:0/2416638103 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efed8011c60 con 0x7efef00bbcd0 2020-05-18T21:33:10.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efef5d29700 1 -- 172.21.15.63:0/2416638103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efef00bbcd0 msgr2=0x7efef00afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.700+0000 7efef5d29700 1 --2- 172.21.15.63:0/2416638103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efef00bbcd0 0x7efef00afe20 secure :-1 s=READY pgs=1318 cs=0 l=1 rx=0x7efef00ae780 tx=0x7efed8007a80).stop 2020-05-18T21:33:10.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.704+0000 7efef5d29700 1 -- 172.21.15.63:0/2416638103 shutdown_connections 2020-05-18T21:33:10.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.704+0000 7efef5d29700 1 --2- 172.21.15.63:0/2416638103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efef00bbcd0 0x7efef00afe20 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:10.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.704+0000 7efef5d29700 1 --2- 172.21.15.63:0/2416638103 >> v2:172.21.15.155:3300/0 conn(0x7efef00bb5e0 0x7efef00acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:10.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.704+0000 7efef5d29700 1 -- 172.21.15.63:0/2416638103 >> 172.21.15.63:0/2416638103 conn(0x7efef0069b70 msgr2=0x7efef0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:10.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.704+0000 7efef5d29700 1 -- 172.21.15.63:0/2416638103 shutdown_connections 2020-05-18T21:33:10.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.704+0000 7efef5d29700 1 -- 172.21.15.63:0/2416638103 wait complete. 2020-05-18T21:33:10.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.704+0000 7efef5d29700 1 Processor -- start 2020-05-18T21:33:10.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.704+0000 7efef5d29700 1 -- start start 2020-05-18T21:33:10.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.704+0000 7efef5d29700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efef00b0280 0x7efef00b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:10.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efef5d29700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efef00bb5e0 0x7efef01177c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:10.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efef5d29700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef0116de0 con 0x7efef00bbcd0 2020-05-18T21:33:10.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efef5d29700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef0117080 con 0x7efef00b0280 2020-05-18T21:33:10.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efef5d29700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef0117320 con 0x7efef00bb5e0 2020-05-18T21:33:10.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efeef7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efef00b0280 0x7efef00b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efeef7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efef00b0280 0x7efef00b7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59922/0 (socket says 172.21.15.63:59922) 2020-05-18T21:33:10.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efeeffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efef00bbcd0 0x7efef0147d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33882/0 (socket says 172.21.15.63:33882) 2020-05-18T21:33:10.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efeef7fe700 1 -- 172.21.15.63:0/2912897810 learned_addr learned my addr 172.21.15.63:0/2912897810 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:10.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efee7fff700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efef00bb5e0 0x7efef01177c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efeef7fe700 1 -- 172.21.15.63:0/2912897810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efef00bb5e0 msgr2=0x7efef01177c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efeef7fe700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efef00bb5e0 0x7efef01177c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:10.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efeef7fe700 1 -- 172.21.15.63:0/2912897810 >> v1:172.21.15.63:6789/0 conn(0x7efef00bbcd0 legacy=0x7efef0147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efeef7fe700 1 -- 172.21.15.63:0/2912897810 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef0148410 con 0x7efef00b0280 2020-05-18T21:33:10.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efee7fff700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efef00bb5e0 0x7efef01177c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:10.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efeef7fe700 1 --2- 172.21.15.63:0/2912897810 >> v2:172.21.15.63:3300/0 conn(0x7efef00b0280 0x7efef00b7ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efee0002f70 tx=0x7efee0010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efeef7fe700 1 --2- 172.21.15.63:0/2912897810 >> v2:172.21.15.63:3300/0 conn(0x7efef00b0280 0x7efef00b7ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efee0002f70 tx=0x7efee0010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efeef7fe700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efef00b0280 0x7efef00b7ed0 secure :-1 s=READY pgs=1320 cs=0 l=1 rx=0x7efee0002f70 tx=0x7efee0010c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:10.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efeef7fe700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efef00b0280 0x7efef00b7ed0 secure :-1 s=THROTTLE_DONE pgs=1320 cs=0 l=1 rx=0x7efee0002f70 tx=0x7efee0010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efeed7fa700 1 -- 172.21.15.63:0/2912897810 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efee0012b10 con 0x7efef00b0280 2020-05-18T21:33:10.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efeef7fe700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efef00b0280 0x7efef00b7ed0 secure :-1 s=THROTTLE_DONE pgs=1320 cs=0 l=1 rx=0x7efee0002f70 tx=0x7efee0010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efeed7fa700 1 -- 172.21.15.63:0/2912897810 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee0012c70 con 0x7efef00b0280 2020-05-18T21:33:10.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efeef7fe700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efef00b0280 0x7efef00b7ed0 secure :-1 s=THROTTLE_DONE pgs=1320 cs=0 l=1 rx=0x7efee0002f70 tx=0x7efee0010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efeed7fa700 1 -- 172.21.15.63:0/2912897810 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efee0012de0 con 0x7efef00b0280 2020-05-18T21:33:10.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efef5d29700 1 -- 172.21.15.63:0/2912897810 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef01169f0 con 0x7efef00b0280 2020-05-18T21:33:10.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efef5d29700 1 -- 172.21.15.63:0/2912897810 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef00b6740 con 0x7efef00b0280 2020-05-18T21:33:10.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.708+0000 7efeef7fe700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efef00b0280 0x7efef00b7ed0 secure :-1 s=THROTTLE_DONE pgs=1320 cs=0 l=1 rx=0x7efee0002f70 tx=0x7efee0010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.712+0000 7efeed7fa700 1 -- 172.21.15.63:0/2912897810 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7efee0007190 con 0x7efef00b0280 2020-05-18T21:33:10.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.712+0000 7efeef7fe700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efef00b0280 0x7efef00b7ed0 secure :-1 s=THROTTLE_DONE pgs=1320 cs=0 l=1 rx=0x7efee0002f70 tx=0x7efee0010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.712+0000 7efef5d29700 1 -- 172.21.15.63:0/2912897810 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef00569e0 con 0x7efef00b0280 2020-05-18T21:33:10.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.712+0000 7efeed7fa700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efec804f9c0 0x7efec8051e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:10.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.712+0000 7efeed7fa700 1 -- 172.21.15.63:0/2912897810 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efee0063fc0 con 0x7efef00b0280 2020-05-18T21:33:10.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.712+0000 7efee7fff700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efec804f9c0 0x7efec8051e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:10.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.712+0000 7efee7fff700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efec804f9c0 0x7efec8051e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efef00ae780 tx=0x7efed8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.712+0000 7efee7fff700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efec804f9c0 0x7efec8051e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efef00ae780 tx=0x7efed8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.712+0000 7efee7fff700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efec804f9c0 0x7efec8051e80 secure :-1 s=READY pgs=521 cs=0 l=1 rx=0x7efef00ae780 tx=0x7efed8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:10.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.716+0000 7efeef7fe700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efef00b0280 0x7efef00b7ed0 secure :-1 s=THROTTLE_DONE pgs=1320 cs=0 l=1 rx=0x7efee0002f70 tx=0x7efee0010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.716+0000 7efeed7fa700 1 -- 172.21.15.63:0/2912897810 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7efee003e350 con 0x7efef00b0280 2020-05-18T21:33:10.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.868+0000 7efef5d29700 1 -- 172.21.15.63:0/2912897810 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efef00b6740 con 0x7efef00b0280 2020-05-18T21:33:10.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.868+0000 7efeef7fe700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efef00b0280 0x7efef00b7ed0 secure :-1 s=THROTTLE_DONE pgs=1320 cs=0 l=1 rx=0x7efee0002f70 tx=0x7efee0010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:10.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.868+0000 7efeed7fa700 1 -- 172.21.15.63:0/2912897810 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+2140 (secure 0 0 0) 0x7efef00b6740 con 0x7efef00b0280 2020-05-18T21:33:10.876 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:10.876 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":75,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2619292063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2619292063},{"type":"v1","addr":"172.21.15.155:6835","nonce":2619292063}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:32:53.188564+0000","modified":"2020-05-18T21:32:54.910500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7842},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7842":{"gid":7842,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/468101601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":468101601},{"type":"v1","addr":"172.21.15.63:6833","nonce":468101601}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-05-18T21:33:10.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.872+0000 7efef5d29700 1 -- 172.21.15.63:0/2912897810 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efec804f9c0 msgr2=0x7efec8051e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.872+0000 7efef5d29700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efec804f9c0 0x7efec8051e80 secure :-1 s=READY pgs=521 cs=0 l=1 rx=0x7efef00ae780 tx=0x7efed8007a80).stop 2020-05-18T21:33:10.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.872+0000 7efef5d29700 1 -- 172.21.15.63:0/2912897810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efef00b0280 msgr2=0x7efef00b7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:10.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.872+0000 7efef5d29700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efef00b0280 0x7efef00b7ed0 secure :-1 s=READY pgs=1320 cs=0 l=1 rx=0x7efee0002f70 tx=0x7efee0010c70).stop 2020-05-18T21:33:10.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.872+0000 7efef5d29700 1 -- 172.21.15.63:0/2912897810 shutdown_connections 2020-05-18T21:33:10.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.872+0000 7efef5d29700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efec804f9c0 0x7efec8051e80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:10.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.872+0000 7efef5d29700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efef00bb5e0 0x7efef01177c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:10.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.872+0000 7efef5d29700 1 --2- 172.21.15.63:0/2912897810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efef00b0280 0x7efef00b7ed0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:10.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.872+0000 7efef5d29700 1 -- 172.21.15.63:0/2912897810 >> 172.21.15.63:0/2912897810 conn(0x7efef0069b70 msgr2=0x7efef0060590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:10.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.872+0000 7efef5d29700 1 -- 172.21.15.63:0/2912897810 shutdown_connections 2020-05-18T21:33:10.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:10.872+0000 7efef5d29700 1 -- 172.21.15.63:0/2912897810 wait complete. 2020-05-18T21:33:10.880 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 75 2020-05-18T21:33:10.887 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush journal 2020-05-18T21:33:11.003 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:11.003 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "", 2020-05-18T21:33:11.004 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0 2020-05-18T21:33:11.004 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:11.014 INFO:tasks.cephfs.filesystem:_json_asok output: { "message": "", "return_code": 0 } 2020-05-18T21:33:11.015 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_data getxattr 10000000000.00000000 parent 2020-05-18T21:33:11.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.036+0000 7f6abf082b80 1 Processor -- start 2020-05-18T21:33:11.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.036+0000 7f6abf082b80 1 -- start start 2020-05-18T21:33:11.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abf082b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560b3fd16c40 0x560b3fd184e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:11.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abf082b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x560b3fda7680 0x560b3fda6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:11.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abf082b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x560b3fc774b0 con 0x560b3fda3700 2020-05-18T21:33:11.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abf082b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x560b3fc63110 con 0x560b3fda7680 2020-05-18T21:33:11.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abf082b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x560b3fc53a40 con 0x560b3fd16c40 2020-05-18T21:33:11.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abccc4700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x560b3fda3700 0x560b3fcd60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33896/0 (socket says 172.21.15.63:33896) 2020-05-18T21:33:11.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abccc4700 1 -- 172.21.15.63:0/1948085222 learned_addr learned my addr 172.21.15.63:0/1948085222 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:11.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abd4c5700 1 --2- 172.21.15.63:0/1948085222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560b3fd16c40 0x560b3fd184e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:11.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abdcc6700 1 --2- 172.21.15.63:0/1948085222 >> v2:172.21.15.155:3300/0 conn(0x560b3fda7680 0x560b3fda6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:11.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6ab6ffd700 1 -- 172.21.15.63:0/1948085222 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538088317 0 0) 0x560b3fc774b0 con 0x560b3fda3700 2020-05-18T21:33:11.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6ab6ffd700 1 -- 172.21.15.63:0/1948085222 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aa0002020 con 0x560b3fda3700 2020-05-18T21:33:11.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abdcc6700 1 -- 172.21.15.63:0/1948085222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560b3fd16c40 msgr2=0x560b3fd184e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:11.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abdcc6700 1 --2- 172.21.15.63:0/1948085222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560b3fd16c40 0x560b3fd184e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:11.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abdcc6700 1 -- 172.21.15.63:0/1948085222 >> v1:172.21.15.63:6789/0 conn(0x560b3fda3700 legacy=0x560b3fcd60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:11.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6ab6ffd700 1 -- 172.21.15.63:0/1948085222 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 611147642 0 0) 0x7f6aa0002020 con 0x560b3fda3700 2020-05-18T21:33:11.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abdcc6700 1 -- 172.21.15.63:0/1948085222 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b3fc57460 con 0x560b3fda7680 2020-05-18T21:33:11.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abdcc6700 1 --2- 172.21.15.63:0/1948085222 >> v2:172.21.15.155:3300/0 conn(0x560b3fda7680 0x560b3fda6590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6aa800d3b0 tx=0x7f6ab800a9e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abdcc6700 1 --2- 172.21.15.63:0/1948085222 >> v2:172.21.15.155:3300/0 conn(0x560b3fda7680 0x560b3fda6590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6aa800d3b0 tx=0x7f6ab800a9e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abdcc6700 1 --2- 172.21.15.63:0/1948085222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560b3fda7680 0x560b3fda6590 secure :-1 s=READY pgs=901 cs=0 l=1 rx=0x7f6aa800d3b0 tx=0x7f6ab800a9e0).ready entity=mon.1 client_cookie=1bd90cbb1e41feeb server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:11.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abdcc6700 1 --2- 172.21.15.63:0/1948085222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560b3fda7680 0x560b3fda6590 secure :-1 s=THROTTLE_DONE pgs=901 cs=0 l=1 rx=0x7f6aa800d3b0 tx=0x7f6ab800a9e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6ab6ffd700 1 -- 172.21.15.63:0/1948085222 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ab800aea0 con 0x560b3fda7680 2020-05-18T21:33:11.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abdcc6700 1 --2- 172.21.15.63:0/1948085222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560b3fda7680 0x560b3fda6590 secure :-1 s=THROTTLE_DONE pgs=901 cs=0 l=1 rx=0x7f6aa800d3b0 tx=0x7f6ab800a9e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abdcc6700 1 --2- 172.21.15.63:0/1948085222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560b3fda7680 0x560b3fda6590 secure :-1 s=THROTTLE_DONE pgs=901 cs=0 l=1 rx=0x7f6aa800d3b0 tx=0x7f6ab800a9e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6ab6ffd700 1 -- 172.21.15.63:0/1948085222 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab80108a0 con 0x560b3fda7680 2020-05-18T21:33:11.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abf082b80 1 -- 172.21.15.63:0/1948085222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560b3fda7680 msgr2=0x560b3fda6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:11.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abf082b80 1 --2- 172.21.15.63:0/1948085222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560b3fda7680 0x560b3fda6590 secure :-1 s=READY pgs=901 cs=0 l=1 rx=0x7f6aa800d3b0 tx=0x7f6ab800a9e0).stop 2020-05-18T21:33:11.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6ab6ffd700 1 -- 172.21.15.63:0/1948085222 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aa800e460 con 0x560b3fda7680 2020-05-18T21:33:11.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abf082b80 1 -- 172.21.15.63:0/1948085222 shutdown_connections 2020-05-18T21:33:11.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abf082b80 1 --2- 172.21.15.63:0/1948085222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560b3fda7680 0x560b3fda6590 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:11.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abf082b80 1 --2- 172.21.15.63:0/1948085222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560b3fd16c40 0x560b3fd184e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:11.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abf082b80 1 -- 172.21.15.63:0/1948085222 >> 172.21.15.63:0/1948085222 conn(0x560b3fd1a850 msgr2=0x560b3fcfc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:11.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abf082b80 1 -- 172.21.15.63:0/1948085222 shutdown_connections 2020-05-18T21:33:11.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.040+0000 7f6abf082b80 1 -- 172.21.15.63:0/1948085222 wait complete. 2020-05-18T21:33:11.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abf082b80 1 Processor -- start 2020-05-18T21:33:11.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abf082b80 1 -- start start 2020-05-18T21:33:11.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abf082b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x560b3fd16c40 0x560b3fcfbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:11.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abf082b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560b3fda3700 0x560b3fd9ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:11.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abf082b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x560b3fda7680 0x560b3fd9f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:11.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abf082b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x560b3fcd67b0 con 0x560b3fd16c40 2020-05-18T21:33:11.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abf082b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x560b3fcd69e0 con 0x560b3fda7680 2020-05-18T21:33:11.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abf082b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x560b3fda2060 con 0x560b3fda3700 2020-05-18T21:33:11.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abd4c5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x560b3fd16c40 0x560b3fcfbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:11.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abd4c5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x560b3fd16c40 0x560b3fcfbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59942/0 (socket says 172.21.15.63:59942) 2020-05-18T21:33:11.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abd4c5700 1 -- 172.21.15.63:0/594079048 learned_addr learned my addr 172.21.15.63:0/594079048 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:11.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abdcc6700 1 --2- 172.21.15.63:0/594079048 >> v2:172.21.15.155:3300/0 conn(0x560b3fda7680 0x560b3fd9f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:11.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abccc4700 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560b3fda3700 0x560b3fd9ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:11.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abd4c5700 1 -- 172.21.15.63:0/594079048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560b3fda3700 msgr2=0x560b3fd9ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:11.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abd4c5700 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560b3fda3700 0x560b3fd9ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:11.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abd4c5700 1 -- 172.21.15.63:0/594079048 >> v2:172.21.15.155:3300/0 conn(0x560b3fda7680 msgr2=0x560b3fd9f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:11.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abd4c5700 1 --2- 172.21.15.63:0/594079048 >> v2:172.21.15.155:3300/0 conn(0x560b3fda7680 0x560b3fd9f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:11.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abd4c5700 1 -- 172.21.15.63:0/594079048 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b3fdaa9a0 con 0x560b3fd16c40 2020-05-18T21:33:11.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abdcc6700 1 --2- 172.21.15.63:0/594079048 >> v2:172.21.15.155:3300/0 conn(0x560b3fda7680 0x560b3fd9f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:11.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abd4c5700 1 --2- 172.21.15.63:0/594079048 >> v2:172.21.15.63:3300/0 conn(0x560b3fd16c40 0x560b3fcfbd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ab0000bc0 tx=0x7f6ab000b1b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abd4c5700 1 --2- 172.21.15.63:0/594079048 >> v2:172.21.15.63:3300/0 conn(0x560b3fd16c40 0x560b3fcfbd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ab0000bc0 tx=0x7f6ab000b1b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abd4c5700 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b3fd16c40 0x560b3fcfbd30 secure :-1 s=READY pgs=1324 cs=0 l=1 rx=0x7f6ab0000bc0 tx=0x7f6ab000b1b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:11.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abd4c5700 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b3fd16c40 0x560b3fcfbd30 secure :-1 s=THROTTLE_DONE pgs=1324 cs=0 l=1 rx=0x7f6ab0000bc0 tx=0x7f6ab000b1b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abd4c5700 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b3fd16c40 0x560b3fcfbd30 secure :-1 s=THROTTLE_DONE pgs=1324 cs=0 l=1 rx=0x7f6ab0000bc0 tx=0x7f6ab000b1b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6ab67fc700 1 -- 172.21.15.63:0/594079048 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ab000b8f0 con 0x560b3fd16c40 2020-05-18T21:33:11.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abd4c5700 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b3fd16c40 0x560b3fcfbd30 secure :-1 s=THROTTLE_DONE pgs=1324 cs=0 l=1 rx=0x7f6ab0000bc0 tx=0x7f6ab000b1b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6ab67fc700 1 -- 172.21.15.63:0/594079048 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab000ba50 con 0x560b3fd16c40 2020-05-18T21:33:11.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6ab67fc700 1 -- 172.21.15.63:0/594079048 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ab000be70 con 0x560b3fd16c40 2020-05-18T21:33:11.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abf082b80 1 -- 172.21.15.63:0/594079048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560b3fcd60f0 con 0x560b3fd16c40 2020-05-18T21:33:11.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abf082b80 1 -- 172.21.15.63:0/594079048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560b3fda26e0 con 0x560b3fd16c40 2020-05-18T21:33:11.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.044+0000 7f6abd4c5700 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b3fd16c40 0x560b3fcfbd30 secure :-1 s=THROTTLE_DONE pgs=1324 cs=0 l=1 rx=0x7f6ab0000bc0 tx=0x7f6ab000b1b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6ab67fc700 1 -- 172.21.15.63:0/594079048 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6ab0006370 con 0x560b3fd16c40 2020-05-18T21:33:11.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abd4c5700 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b3fd16c40 0x560b3fcfbd30 secure :-1 s=THROTTLE_DONE pgs=1324 cs=0 l=1 rx=0x7f6ab0000bc0 tx=0x7f6ab000b1b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6ab67fc700 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6aa004e650 0x7f6aa0050b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:11.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6ab67fc700 1 -- 172.21.15.63:0/594079048 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6ab0063190 con 0x560b3fd16c40 2020-05-18T21:33:11.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abf082b80 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x560b3fd9fc00 0x560b3fda0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:11.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abf082b80 1 -- 172.21.15.63:0/594079048 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- osd_op(unknown.0.0:1 18.0 18:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected e95) v8 -- 0x560b3fcfce00 con 0x560b3fd9fc00 2020-05-18T21:33:11.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abccc4700 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6aa004e650 0x7f6aa0050b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:11.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abdcc6700 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x560b3fd9fc00 0x560b3fda0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:11.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abccc4700 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6aa004e650 0x7f6aa0050b10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6aa80070a0 tx=0x7f6aa8006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abccc4700 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6aa004e650 0x7f6aa0050b10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6aa80070a0 tx=0x7f6aa8006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abccc4700 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6aa004e650 0x7f6aa0050b10 secure :-1 s=READY pgs=522 cs=0 l=1 rx=0x7f6aa80070a0 tx=0x7f6aa8006620).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:11.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abdcc6700 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x560b3fd9fc00 0x560b3fda0040 crc :-1 s=READY pgs=32 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:11.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abdcc6700 1 -- 172.21.15.63:0/594079048 <== osd.0 v2:172.21.15.63:6800/12803 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x7f6ab8006bc0 con 0x560b3fd9fc00 2020-05-18T21:33:11.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abf082b80 1 -- 172.21.15.63:0/594079048 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x560b3fd9fc00 msgr2=0x560b3fda0040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:11.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abf082b80 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x560b3fd9fc00 0x560b3fda0040 crc :-1 s=READY pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:11.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abf082b80 1 -- 172.21.15.63:0/594079048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6aa004e650 msgr2=0x7f6aa0050b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:11.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abf082b80 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6aa004e650 0x7f6aa0050b10 secure :-1 s=READY pgs=522 cs=0 l=1 rx=0x7f6aa80070a0 tx=0x7f6aa8006620).stop 2020-05-18T21:33:11.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abf082b80 1 -- 172.21.15.63:0/594079048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b3fd16c40 msgr2=0x560b3fcfbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:11.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abf082b80 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b3fd16c40 0x560b3fcfbd30 secure :-1 s=READY pgs=1324 cs=0 l=1 rx=0x7f6ab0000bc0 tx=0x7f6ab000b1b0).stop 2020-05-18T21:33:11.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abdcc6700 1 -- 172.21.15.63:0/594079048 reap_dead start 2020-05-18T21:33:11.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abf082b80 1 -- 172.21.15.63:0/594079048 shutdown_connections 2020-05-18T21:33:11.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abf082b80 1 --2- 172.21.15.63:0/594079048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b3fd16c40 0x560b3fcfbd30 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:11.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abf082b80 1 -- 172.21.15.63:0/594079048 >> 172.21.15.63:0/594079048 conn(0x560b3fd1a850 msgr2=0x560b3fd1a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:11.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abf082b80 1 -- 172.21.15.63:0/594079048 shutdown_connections 2020-05-18T21:33:11.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.048+0000 7f6abf082b80 1 -- 172.21.15.63:0/594079048 wait complete. 2020-05-18T21:33:11.069 INFO:teuthology.orchestra.run.smithi063.stdout:8file_b 2020-05-18T21:33:11.069 INFO:teuthology.orchestra.run.smithi063:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2020-05-18T21:33:11.141 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:11.142 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1099511627776, 2020-05-18T21:33:11.142 INFO:teuthology.orchestra.run.smithi063.stdout: "ancestors": [ 2020-05-18T21:33:11.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:11.143 INFO:teuthology.orchestra.run.smithi063.stdout: "dirino": 1, 2020-05-18T21:33:11.143 INFO:teuthology.orchestra.run.smithi063.stdout: "dname": "file_b", 2020-05-18T21:33:11.143 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 21 2020-05-18T21:33:11.143 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:11.143 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:33:11.144 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 18, 2020-05-18T21:33:11.144 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [] 2020-05-18T21:33:11.144 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:11.144 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:11.145 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_data ls 2020-05-18T21:33:11.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.164+0000 7f1ec8dc2b80 1 Processor -- start 2020-05-18T21:33:11.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.164+0000 7f1ec8dc2b80 1 -- start start 2020-05-18T21:33:11.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec8dc2b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0a60 0x56041509c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:11.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec8dc2b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x5604150a0ea0 0x56041509d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:11.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec8dc2b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x560414f50460 con 0x5604150a0680 2020-05-18T21:33:11.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec8dc2b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x560414f7c800 con 0x5604150a0ea0 2020-05-18T21:33:11.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec8dc2b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x560414f5c110 con 0x5604150a0a60 2020-05-18T21:33:11.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec7a06700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x5604150a0ea0 0x56041509d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:11.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec7205700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x5604150a0680 0x560414fcf8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33914/0 (socket says 172.21.15.63:33914) 2020-05-18T21:33:11.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec7205700 1 -- 172.21.15.63:0/275094791 learned_addr learned my addr 172.21.15.63:0/275094791 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:11.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec6a04700 1 --2- 172.21.15.63:0/275094791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0a60 0x56041509c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:11.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec5201700 1 -- 172.21.15.63:0/275094791 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376414243 0 0) 0x560414f50460 con 0x5604150a0680 2020-05-18T21:33:11.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec5201700 1 -- 172.21.15.63:0/275094791 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ea8002020 con 0x5604150a0680 2020-05-18T21:33:11.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec6a04700 1 -- 172.21.15.63:0/275094791 >> v2:172.21.15.63:3300/0 conn(0x5604150a0ea0 msgr2=0x56041509d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:11.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec6a04700 1 --2- 172.21.15.63:0/275094791 >> v2:172.21.15.63:3300/0 conn(0x5604150a0ea0 0x56041509d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:11.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec6a04700 1 -- 172.21.15.63:0/275094791 >> v1:172.21.15.63:6789/0 conn(0x5604150a0680 legacy=0x560414fcf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:11.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec6a04700 1 -- 172.21.15.63:0/275094791 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560415099e50 con 0x5604150a0a60 2020-05-18T21:33:11.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec6a04700 1 --2- 172.21.15.63:0/275094791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0a60 0x56041509c280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x5604150144b0 tx=0x7f1eb800e7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec6a04700 1 --2- 172.21.15.63:0/275094791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0a60 0x56041509c280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x5604150144b0 tx=0x7f1eb800e7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec6a04700 1 --2- 172.21.15.63:0/275094791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0a60 0x56041509c280 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x5604150144b0 tx=0x7f1eb800e7c0).ready entity=mon.2 client_cookie=707c4c6a9f0a51e9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:11.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec6a04700 1 --2- 172.21.15.63:0/275094791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0a60 0x56041509c280 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x5604150144b0 tx=0x7f1eb800e7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec5201700 1 -- 172.21.15.63:0/275094791 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eb80057a0 con 0x5604150a0a60 2020-05-18T21:33:11.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec6a04700 1 --2- 172.21.15.63:0/275094791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0a60 0x56041509c280 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x5604150144b0 tx=0x7f1eb800e7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec6a04700 1 --2- 172.21.15.63:0/275094791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0a60 0x56041509c280 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x5604150144b0 tx=0x7f1eb800e7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec5201700 1 -- 172.21.15.63:0/275094791 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb8005900 con 0x5604150a0a60 2020-05-18T21:33:11.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec5201700 1 -- 172.21.15.63:0/275094791 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eb8005ce0 con 0x5604150a0a60 2020-05-18T21:33:11.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec8dc2b80 1 -- 172.21.15.63:0/275094791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0a60 msgr2=0x56041509c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:11.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec8dc2b80 1 --2- 172.21.15.63:0/275094791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0a60 0x56041509c280 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x5604150144b0 tx=0x7f1eb800e7c0).stop 2020-05-18T21:33:11.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec8dc2b80 1 -- 172.21.15.63:0/275094791 shutdown_connections 2020-05-18T21:33:11.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec8dc2b80 1 --2- 172.21.15.63:0/275094791 >> v2:172.21.15.63:3300/0 conn(0x5604150a0ea0 0x56041509d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:11.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec8dc2b80 1 --2- 172.21.15.63:0/275094791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0a60 0x56041509c280 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:11.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec8dc2b80 1 -- 172.21.15.63:0/275094791 >> 172.21.15.63:0/275094791 conn(0x560415013850 msgr2=0x5604150130c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:11.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec8dc2b80 1 -- 172.21.15.63:0/275094791 shutdown_connections 2020-05-18T21:33:11.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec8dc2b80 1 -- 172.21.15.63:0/275094791 wait complete. 2020-05-18T21:33:11.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec8dc2b80 1 Processor -- start 2020-05-18T21:33:11.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.168+0000 7f1ec8dc2b80 1 -- start start 2020-05-18T21:33:11.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec8dc2b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0680 0x560415011200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:11.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec8dc2b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x560415011770 con 0x5604150a0ea0 2020-05-18T21:33:11.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec8dc2b80 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x560414fcf600 con 0x5604150a0a60 2020-05-18T21:33:11.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec8dc2b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x560414f4ca40 con 0x5604150a0680 2020-05-18T21:33:11.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec7a06700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x5604150a0ea0 0x560415009ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33924/0 (socket says 172.21.15.63:33924) 2020-05-18T21:33:11.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec7a06700 1 -- 172.21.15.63:0/879832033 learned_addr learned my addr 172.21.15.63:0/879832033 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:11.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec7205700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0680 0x560415011200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:11.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec4a00700 1 -- 172.21.15.63:0/879832033 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254886682 0 0) 0x560415011770 con 0x5604150a0ea0 2020-05-18T21:33:11.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec4a00700 1 -- 172.21.15.63:0/879832033 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ea8002260 con 0x5604150a0ea0 2020-05-18T21:33:11.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec4a00700 1 -- 172.21.15.63:0/879832033 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341392488 0 0) 0x560414fcf600 con 0x5604150a0a60 2020-05-18T21:33:11.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec4a00700 1 -- 172.21.15.63:0/879832033 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x560415011770 con 0x5604150a0a60 2020-05-18T21:33:11.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec7205700 1 -- 172.21.15.63:0/879832033 >> v1:172.21.15.155:6789/0 conn(0x5604150a0a60 legacy=0x56041509ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:11.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec7205700 1 -- 172.21.15.63:0/879832033 >> v1:172.21.15.63:6789/0 conn(0x5604150a0ea0 legacy=0x560415009ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:11.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec7205700 1 -- 172.21.15.63:0/879832033 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560414fcf860 con 0x5604150a0680 2020-05-18T21:33:11.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec7205700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0680 0x560415011200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1eb0000bf0 tx=0x7f1eb0006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec7205700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0680 0x560415011200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1eb0000bf0 tx=0x7f1eb0006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec7205700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0680 0x560415011200 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7f1eb0000bf0 tx=0x7f1eb0006620).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:11.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec7205700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0680 0x560415011200 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f1eb0000bf0 tx=0x7f1eb0006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec4a00700 1 -- 172.21.15.63:0/879832033 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eb0005c70 con 0x5604150a0680 2020-05-18T21:33:11.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec7205700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0680 0x560415011200 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f1eb0000bf0 tx=0x7f1eb0006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec4a00700 1 -- 172.21.15.63:0/879832033 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb0005dd0 con 0x5604150a0680 2020-05-18T21:33:11.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec7205700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0680 0x560415011200 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f1eb0000bf0 tx=0x7f1eb0006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec8dc2b80 1 -- 172.21.15.63:0/879832033 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560414fcfb80 con 0x5604150a0680 2020-05-18T21:33:11.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec4a00700 1 -- 172.21.15.63:0/879832033 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eb00061b0 con 0x5604150a0680 2020-05-18T21:33:11.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.172+0000 7f1ec8dc2b80 1 -- 172.21.15.63:0/879832033 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56041509c300 con 0x5604150a0680 2020-05-18T21:33:11.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.176+0000 7f1ec7205700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0680 0x560415011200 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f1eb0000bf0 tx=0x7f1eb0006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.176+0000 7f1ec4a00700 1 -- 172.21.15.63:0/879832033 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1eb0007240 con 0x5604150a0680 2020-05-18T21:33:11.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.176+0000 7f1ec7205700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0680 0x560415011200 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f1eb0000bf0 tx=0x7f1eb0006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.176+0000 7f1ec4a00700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1ea804ed40 0x7f1ea8051200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:11.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.176+0000 7f1ec4a00700 1 -- 172.21.15.63:0/879832033 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1eb0062e20 con 0x5604150a0680 2020-05-18T21:33:11.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.176+0000 7f1ec6a04700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1ea804ed40 0x7f1ea8051200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:11.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.176+0000 7f1ec8dc2b80 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x56041500a520 0x5604150b9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:11.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.176+0000 7f1ec8dc2b80 1 -- 172.21.15.63:0/879832033 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- osd_op(unknown.0.0:1 18.0 18:00000000::::head [pgnls start_epoch 95 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e95) v8 -- 0x5604150b9970 con 0x56041500a520 2020-05-18T21:33:11.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.176+0000 7f1ec6a04700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1ea804ed40 0x7f1ea8051200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1eb8001dc0 tx=0x7f1eb800e7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.176+0000 7f1ec6a04700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1ea804ed40 0x7f1ea8051200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1eb8001dc0 tx=0x7f1eb800e7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:11.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.176+0000 7f1ec6a04700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1ea804ed40 0x7f1ea8051200 secure :-1 s=READY pgs=523 cs=0 l=1 rx=0x7f1eb8001dc0 tx=0x7f1eb800e7c0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:11.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.176+0000 7f1ec7a06700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x56041500a520 0x5604150b9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:11.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.176+0000 7f1ec7a06700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x56041500a520 0x5604150b9510 crc :-1 s=READY pgs=33 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:11.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.180+0000 7f1ec7a06700 1 -- 172.21.15.63:0/879832033 <== osd.0 v2:172.21.15.63:6800/12803 1 ==== osd_op_reply(1 [pgnls start_epoch 95 out=81b] v95'4 uv4 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x7f1ec00044e0 con 0x56041500a520 2020-05-18T21:33:11.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.180+0000 7f1ec7a06700 1 -- 172.21.15.63:0/879832033 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- osd_op(unknown.0.0:2 18.4 18:20000000::::head [pgnls start_epoch 95 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e95) v8 -- 0x5604150b9970 con 0x56041500a520 2020-05-18T21:33:11.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.180+0000 7f1ec7a06700 1 -- 172.21.15.63:0/879832033 <== osd.0 v2:172.21.15.63:6800/12803 2 ==== osd_op_reply(2 [pgnls start_epoch 95 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ec00044e0 con 0x56041500a520 2020-05-18T21:33:11.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.180+0000 7f1ec7a06700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7f1ec0005060 0x7f1ec00054a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:11.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.180+0000 7f1ec7a06700 1 -- 172.21.15.63:0/879832033 --> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] -- osd_op(unknown.0.0:3 18.2 18:40000000::::head [pgnls start_epoch 95 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e95) v8 -- 0x5604150b9970 con 0x7f1ec0005060 2020-05-18T21:33:11.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.180+0000 7f1ec7205700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7f1ec0005060 0x7f1ec00054a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:11.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.180+0000 7f1ec7205700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7f1ec0005060 0x7f1ec00054a0 crc :-1 s=READY pgs=19 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:11.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.184+0000 7f1ec7205700 1 -- 172.21.15.63:0/879832033 <== osd.7 v2:172.21.15.155:6823/13026 1 ==== osd_op_reply(3 [pgnls start_epoch 95 out=81b] v95'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x7f1eb003f270 con 0x7f1ec0005060 2020-05-18T21:33:11.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.184+0000 7f1ec7205700 1 -- 172.21.15.63:0/879832033 --> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] -- osd_op(unknown.0.0:4 18.6 18:60000000::::head [pgnls start_epoch 95 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e95) v8 -- 0x5604150b9970 con 0x7f1ec0005060 2020-05-18T21:33:11.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.184+0000 7f1ec7205700 1 -- 172.21.15.63:0/879832033 <== osd.7 v2:172.21.15.155:6823/13026 2 ==== osd_op_reply(4 [pgnls start_epoch 95 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1eb003f270 con 0x7f1ec0005060 2020-05-18T21:33:11.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.184+0000 7f1ec7205700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7f1eb00403c0 0x7f1eb003f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:11.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.184+0000 7f1ec7205700 1 -- 172.21.15.63:0/879832033 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- osd_op(unknown.0.0:5 18.1 18:80000000::::head [pgnls start_epoch 95 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e95) v8 -- 0x5604150b9970 con 0x7f1eb00403c0 2020-05-18T21:33:11.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.184+0000 7f1ec6a04700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7f1eb00403c0 0x7f1eb003f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:11.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.184+0000 7f1ec6a04700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7f1eb00403c0 0x7f1eb003f530 crc :-1 s=READY pgs=19 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:11.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.188+0000 7f1ec6a04700 1 -- 172.21.15.63:0/879832033 <== osd.3 v2:172.21.15.63:6814/12805 1 ==== osd_op_reply(5 [pgnls start_epoch 95 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1eb800fdb0 con 0x7f1eb00403c0 2020-05-18T21:33:11.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.188+0000 7f1ec6a04700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7f1eb8005a70 0x7f1eb80077d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:11.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.188+0000 7f1ec6a04700 1 -- 172.21.15.63:0/879832033 --> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] -- osd_op(unknown.0.0:6 18.5 18:a0000000::::head [pgnls start_epoch 95 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e95) v8 -- 0x5604150b9970 con 0x7f1eb8005a70 2020-05-18T21:33:11.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.188+0000 7f1ec7a06700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7f1eb8005a70 0x7f1eb80077d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:11.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.188+0000 7f1ec7a06700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7f1eb8005a70 0x7f1eb80077d0 crc :-1 s=READY pgs=23 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:11.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.188+0000 7f1ec7a06700 1 -- 172.21.15.63:0/879832033 <== osd.1 v2:172.21.15.63:6808/12804 1 ==== osd_op_reply(6 [pgnls start_epoch 95 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ec00044e0 con 0x7f1eb8005a70 2020-05-18T21:33:11.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.188+0000 7f1ec7a06700 1 -- 172.21.15.63:0/879832033 --> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] -- osd_op(unknown.0.0:7 18.3 18:c0000000::::head [pgnls start_epoch 95 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e95) v8 -- 0x5604150b9970 con 0x7f1eb8005a70 2020-05-18T21:33:11.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.188+0000 7f1ec7a06700 1 -- 172.21.15.63:0/879832033 <== osd.1 v2:172.21.15.63:6808/12804 2 ==== osd_op_reply(7 [pgnls start_epoch 95 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ec00044e0 con 0x7f1eb8005a70 2020-05-18T21:33:11.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.188+0000 7f1ec7a06700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f1ec000aa40 0x7f1ec000b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:11.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.188+0000 7f1ec7a06700 1 -- 172.21.15.63:0/879832033 --> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] -- osd_op(unknown.0.0:8 18.7 18:e0000000::::head [pgnls start_epoch 95 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e95) v8 -- 0x5604150b9970 con 0x7f1ec000aa40 2020-05-18T21:33:11.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.188+0000 7f1ec7205700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f1ec000aa40 0x7f1ec000b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:11.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.188+0000 7f1ec7205700 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f1ec000aa40 0x7f1ec000b040 crc :-1 s=READY pgs=22 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:11.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec7205700 1 -- 172.21.15.63:0/879832033 <== osd.2 v2:172.21.15.63:6822/12806 1 ==== osd_op_reply(8 [pgnls start_epoch 95 out=49b] v95'5 uv5 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1eb003f270 con 0x7f1ec000aa40 2020-05-18T21:33:11.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 -- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x56041500a520 msgr2=0x5604150b9510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:11.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x56041500a520 0x5604150b9510 crc :-1 s=READY pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:11.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 -- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7f1eb8005a70 msgr2=0x7f1eb80077d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:11.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7f1eb8005a70 0x7f1eb80077d0 crc :-1 s=READY pgs=23 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:11.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 -- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f1ec000aa40 msgr2=0x7f1ec000b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:11.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f1ec000aa40 0x7f1ec000b040 crc :-1 s=READY pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:11.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 -- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7f1eb00403c0 msgr2=0x7f1eb003f530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:11.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7f1eb00403c0 0x7f1eb003f530 crc :-1 s=READY pgs=19 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:11.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 -- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7f1ec0005060 msgr2=0x7f1ec00054a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:11.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7f1ec0005060 0x7f1ec00054a0 crc :-1 s=READY pgs=19 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:11.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec7a06700 1 -- 172.21.15.63:0/879832033 reap_dead start 2020-05-18T21:33:11.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 -- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1ea804ed40 msgr2=0x7f1ea8051200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:11.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1ea804ed40 0x7f1ea8051200 secure :-1 s=READY pgs=523 cs=0 l=1 rx=0x7f1eb8001dc0 tx=0x7f1eb800e7c0).stop 2020-05-18T21:33:11.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 -- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0680 msgr2=0x560415011200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:11.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0680 0x560415011200 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7f1eb0000bf0 tx=0x7f1eb0006620).stop 2020-05-18T21:33:11.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 -- 172.21.15.63:0/879832033 shutdown_connections 2020-05-18T21:33:11.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1ea804ed40 0x7f1ea8051200 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:11.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 --2- 172.21.15.63:0/879832033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604150a0680 0x560415011200 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:11.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 -- 172.21.15.63:0/879832033 >> 172.21.15.63:0/879832033 conn(0x560415013850 msgr2=0x560415012bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:11.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 -- 172.21.15.63:0/879832033 shutdown_connections 2020-05-18T21:33:11.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:11.192+0000 7f1ec8dc2b80 1 -- 172.21.15.63:0/879832033 wait complete. 2020-05-18T21:33:11.216 INFO:teuthology.orchestra.run.smithi063.stdout:10000000000.00000000 2020-05-18T21:33:11.216 INFO:teuthology.orchestra.run.smithi063.stdout:10000000000.00000001 2020-05-18T21:33:11.217 INFO:tasks.cephfs.filesystem:All objects for ino 1099511627776 size 8388608 found 2020-05-18T21:33:11.218 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:33:11.218 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:33:11.237 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:33:11.258 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:33:11.258 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:33:11.259 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:33:11.259 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:33:11.295 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[29250]: fuse finished with error 0 and tester_r 0 2020-05-18T21:33:11.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:11.299 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:33:11.305 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:33:11.305 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:33:11.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:11.306 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 down' 2020-05-18T21:33:11.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:11.323 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.0' 2020-05-18T21:33:11.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:11.458 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:33:11.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:11.477 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:33:11.541 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:33:11.541 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:33:11.542 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:33:11.542 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:11.542 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:33:11.542 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:11.542 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:11.543 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:11.543 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:11.543 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:11.543 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:11.543 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:11.543 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:33:11.544 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:11.544 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:33:11.544 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42451sec preferred_lft 42451sec 2020-05-18T21:33:11.544 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:33:11.544 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:11.545 INFO:teuthology.orchestra.run.smithi063.stdout:27: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-05-18T21:33:11.545 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:11.545 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:33:11.545 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:11.545 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::b069:7ff:fe81:2fd1/64 scope link 2020-05-18T21:33:11.546 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:11.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:11.547 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:33:11.564 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:33:11.654 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:33:11.654 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:33:11.654 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:11.655 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:33:11.655 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:11.655 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:33:11.655 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:11.655 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:33:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:11.656 INFO:teuthology.orchestra.run.smithi063.stdout:27: ceph-brx: mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:33:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:11.658 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:33:11.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:11.659 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:33:11.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:11.726 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:33:11.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:11.854 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:33:11.864 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:33:11.865 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:33:11.865 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:33:11.865 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:33:11.865 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:33:11.865 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:33:11.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:11.866 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:33:11.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:11.883 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:33:11.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:11.898 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:33:11.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:11.912 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:33:11.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:11.918 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:33:11.966 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-05-18T21:33:11.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:33:11.967 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-05-18T21:33:11.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:11.968 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:33:11.976 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:33:11.976 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:33:11.976 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:33:11.976 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:11.977 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:33:11.977 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:11.977 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:11.977 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:11.977 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:11.978 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:11.978 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:11.978 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:11.978 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:33:11.978 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:11.979 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:33:11.979 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42451sec preferred_lft 42451sec 2020-05-18T21:33:11.979 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:33:11.979 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:11.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:11.980 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:33:11.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:11.988 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:33:11.995 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2020-05-18T21:33:11.996 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:33:11.997 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-05-18T21:33:11.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:11.998 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:33:12.004 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:33:12.004 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:33:12.004 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:33:12.004 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:12.004 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:33:12.005 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:12.005 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:12.005 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:12.005 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:12.005 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:12.006 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:12.006 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:12.006 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:33:12.006 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:12.006 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:33:12.007 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42455sec preferred_lft 42455sec 2020-05-18T21:33:12.007 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:33:12.007 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:12.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:12.008 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:33:12.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:12.056 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:33:12.062 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2020-05-18T21:33:12.063 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:33:12.064 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-05-18T21:33:12.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:12.064 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:33:12.069 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:33:12.069 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:33:12.070 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:33:12.070 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:12.070 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:33:12.070 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:12.071 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:12.071 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:12.071 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:12.071 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:12.071 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:12.072 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:12.072 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:33:12.072 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:12.072 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:33:12.073 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42455sec preferred_lft 42455sec 2020-05-18T21:33:12.073 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:33:12.073 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:12.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:12.075 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:33:12.081 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_strays.TestStrays.test_mv_cleanup' 2020-05-18T21:33:12.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe165cf9700 1 Processor -- start 2020-05-18T21:33:12.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe165cf9700 1 -- start start 2020-05-18T21:33:12.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe165cf9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe1600b93f0 0x7fe160145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:12.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe165cf9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1600b7ca0 0x7fe160142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:12.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe165cf9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe1601432f0 0x7fe160060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:12.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe165cf9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1600b7020 con 0x7fe1600b93f0 2020-05-18T21:33:12.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe165cf9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1600b72c0 con 0x7fe1601432f0 2020-05-18T21:33:12.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe165cf9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1600b7560 con 0x7fe1600b7ca0 2020-05-18T21:33:12.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe164cf7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe1600b93f0 0x7fe160145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:12.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe164cf7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe1600b93f0 0x7fe160145df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59982/0 (socket says 172.21.15.63:59982) 2020-05-18T21:33:12.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe164cf7700 1 -- 172.21.15.63:0/3985958450 learned_addr learned my addr 172.21.15.63:0/3985958450 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:12.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe1654f8700 1 --2- 172.21.15.63:0/3985958450 >> v2:172.21.15.155:3300/0 conn(0x7fe1601432f0 0x7fe160060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:12.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe15ffff700 1 --2- 172.21.15.63:0/3985958450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1600b7ca0 0x7fe160142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:12.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe164cf7700 1 -- 172.21.15.63:0/3985958450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1600b7ca0 msgr2=0x7fe160142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:12.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe164cf7700 1 --2- 172.21.15.63:0/3985958450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1600b7ca0 0x7fe160142e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:12.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe164cf7700 1 -- 172.21.15.63:0/3985958450 >> v2:172.21.15.155:3300/0 conn(0x7fe1601432f0 msgr2=0x7fe160060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:12.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe164cf7700 1 --2- 172.21.15.63:0/3985958450 >> v2:172.21.15.155:3300/0 conn(0x7fe1601432f0 0x7fe160060430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:12.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe164cf7700 1 -- 172.21.15.63:0/3985958450 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1600b7800 con 0x7fe1600b93f0 2020-05-18T21:33:12.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe164cf7700 1 --2- 172.21.15.63:0/3985958450 >> v2:172.21.15.63:3300/0 conn(0x7fe1600b93f0 0x7fe160145df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe1600619f0 tx=0x7fe150007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe164cf7700 1 --2- 172.21.15.63:0/3985958450 >> v2:172.21.15.63:3300/0 conn(0x7fe1600b93f0 0x7fe160145df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe1600619f0 tx=0x7fe150007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe164cf7700 1 --2- 172.21.15.63:0/3985958450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1600b93f0 0x7fe160145df0 secure :-1 s=READY pgs=1329 cs=0 l=1 rx=0x7fe1600619f0 tx=0x7fe150007a80).ready entity=mon.0 client_cookie=cfca5f261f33589d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:12.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.188+0000 7fe164cf7700 1 --2- 172.21.15.63:0/3985958450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1600b93f0 0x7fe160145df0 secure :-1 s=THROTTLE_DONE pgs=1329 cs=0 l=1 rx=0x7fe1600619f0 tx=0x7fe150007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.192+0000 7fe164cf7700 1 --2- 172.21.15.63:0/3985958450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1600b93f0 0x7fe160145df0 secure :-1 s=THROTTLE_DONE pgs=1329 cs=0 l=1 rx=0x7fe1600619f0 tx=0x7fe150007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.192+0000 7fe164cf7700 1 --2- 172.21.15.63:0/3985958450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1600b93f0 0x7fe160145df0 secure :-1 s=THROTTLE_DONE pgs=1329 cs=0 l=1 rx=0x7fe1600619f0 tx=0x7fe150007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.192+0000 7fe15f7fe700 1 -- 172.21.15.63:0/3985958450 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1500115c0 con 0x7fe1600b93f0 2020-05-18T21:33:12.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.192+0000 7fe15f7fe700 1 -- 172.21.15.63:0/3985958450 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe150011720 con 0x7fe1600b93f0 2020-05-18T21:33:12.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.192+0000 7fe15f7fe700 1 -- 172.21.15.63:0/3985958450 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe150011b40 con 0x7fe1600b93f0 2020-05-18T21:33:12.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.192+0000 7fe165cf9700 1 -- 172.21.15.63:0/3985958450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1600b93f0 msgr2=0x7fe160145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:12.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.192+0000 7fe165cf9700 1 --2- 172.21.15.63:0/3985958450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1600b93f0 0x7fe160145df0 secure :-1 s=READY pgs=1329 cs=0 l=1 rx=0x7fe1600619f0 tx=0x7fe150007a80).stop 2020-05-18T21:33:12.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.192+0000 7fe165cf9700 1 -- 172.21.15.63:0/3985958450 shutdown_connections 2020-05-18T21:33:12.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.192+0000 7fe165cf9700 1 --2- 172.21.15.63:0/3985958450 >> v2:172.21.15.155:3300/0 conn(0x7fe1601432f0 0x7fe160060430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:12.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.192+0000 7fe165cf9700 1 --2- 172.21.15.63:0/3985958450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1600b7ca0 0x7fe160142e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:12.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.192+0000 7fe165cf9700 1 --2- 172.21.15.63:0/3985958450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1600b93f0 0x7fe160145df0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:12.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.192+0000 7fe165cf9700 1 -- 172.21.15.63:0/3985958450 >> 172.21.15.63:0/3985958450 conn(0x7fe160069b70 msgr2=0x7fe160069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:12.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.192+0000 7fe165cf9700 1 -- 172.21.15.63:0/3985958450 shutdown_connections 2020-05-18T21:33:12.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.192+0000 7fe165cf9700 1 -- 172.21.15.63:0/3985958450 wait complete. 2020-05-18T21:33:12.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.192+0000 7fe165cf9700 1 Processor -- start 2020-05-18T21:33:12.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe165cf9700 1 -- start start 2020-05-18T21:33:12.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe165cf9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe1600b7ca0 0x7fe1600b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:12.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe165cf9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe1600b93f0 0x7fe160141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:12.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe165cf9700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1600ad0b0 con 0x7fe1601432f0 2020-05-18T21:33:12.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe165cf9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe160157af0 con 0x7fe1600b7ca0 2020-05-18T21:33:12.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe165cf9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1600af080 con 0x7fe1600b93f0 2020-05-18T21:33:12.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe164cf7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe1600b7ca0 0x7fe1600b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:12.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe164cf7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe1600b7ca0 0x7fe1600b2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59988/0 (socket says 172.21.15.63:59988) 2020-05-18T21:33:12.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe164cf7700 1 -- 172.21.15.63:0/1816436056 learned_addr learned my addr 172.21.15.63:0/1816436056 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:12.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe1654f8700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe1601432f0 0x7fe160156ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33948/0 (socket says 172.21.15.63:33948) 2020-05-18T21:33:12.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe15ffff700 1 --2- 172.21.15.63:0/1816436056 >> v2:172.21.15.155:3300/0 conn(0x7fe1600b93f0 0x7fe160141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:12.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe164cf7700 1 -- 172.21.15.63:0/1816436056 >> v2:172.21.15.155:3300/0 conn(0x7fe1600b93f0 msgr2=0x7fe160141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:12.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe164cf7700 1 --2- 172.21.15.63:0/1816436056 >> v2:172.21.15.155:3300/0 conn(0x7fe1600b93f0 0x7fe160141640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:12.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe164cf7700 1 -- 172.21.15.63:0/1816436056 >> v1:172.21.15.63:6789/0 conn(0x7fe1601432f0 legacy=0x7fe160156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:12.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe15dffb700 1 -- 172.21.15.63:0/1816436056 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707466739 0 0) 0x7fe1600ad0b0 con 0x7fe1601432f0 2020-05-18T21:33:12.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe164cf7700 1 -- 172.21.15.63:0/1816436056 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1600af2e0 con 0x7fe1600b7ca0 2020-05-18T21:33:12.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe15ffff700 1 --2- 172.21.15.63:0/1816436056 >> v2:172.21.15.155:3300/0 conn(0x7fe1600b93f0 0x7fe160141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:12.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe164cf7700 1 --2- 172.21.15.63:0/1816436056 >> v2:172.21.15.63:3300/0 conn(0x7fe1600b7ca0 0x7fe1600b2c80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe1600619f0 tx=0x7fe150007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe164cf7700 1 --2- 172.21.15.63:0/1816436056 >> v2:172.21.15.63:3300/0 conn(0x7fe1600b7ca0 0x7fe1600b2c80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe1600619f0 tx=0x7fe150007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe164cf7700 1 --2- 172.21.15.63:0/1816436056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1600b7ca0 0x7fe1600b2c80 secure :-1 s=READY pgs=1331 cs=0 l=1 rx=0x7fe1600619f0 tx=0x7fe150007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:12.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe164cf7700 1 --2- 172.21.15.63:0/1816436056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1600b7ca0 0x7fe1600b2c80 secure :-1 s=THROTTLE_DONE pgs=1331 cs=0 l=1 rx=0x7fe1600619f0 tx=0x7fe150007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe164cf7700 1 --2- 172.21.15.63:0/1816436056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1600b7ca0 0x7fe1600b2c80 secure :-1 s=THROTTLE_DONE pgs=1331 cs=0 l=1 rx=0x7fe1600619f0 tx=0x7fe150007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe15dffb700 1 -- 172.21.15.63:0/1816436056 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe150005700 con 0x7fe1600b7ca0 2020-05-18T21:33:12.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe164cf7700 1 --2- 172.21.15.63:0/1816436056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1600b7ca0 0x7fe1600b2c80 secure :-1 s=THROTTLE_DONE pgs=1331 cs=0 l=1 rx=0x7fe1600619f0 tx=0x7fe150007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe15dffb700 1 -- 172.21.15.63:0/1816436056 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe150005860 con 0x7fe1600b7ca0 2020-05-18T21:33:12.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe165cf9700 1 -- 172.21.15.63:0/1816436056 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe160157600 con 0x7fe1600b7ca0 2020-05-18T21:33:12.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe15dffb700 1 -- 172.21.15.63:0/1816436056 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe150005bc0 con 0x7fe1600b7ca0 2020-05-18T21:33:12.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.196+0000 7fe165cf9700 1 -- 172.21.15.63:0/1816436056 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe160141cc0 con 0x7fe1600b7ca0 2020-05-18T21:33:12.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.200+0000 7fe165cf9700 1 -- 172.21.15.63:0/1816436056 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1600af4e0 con 0x7fe1600b7ca0 2020-05-18T21:33:12.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.200+0000 7fe164cf7700 1 --2- 172.21.15.63:0/1816436056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1600b7ca0 0x7fe1600b2c80 secure :-1 s=THROTTLE_DONE pgs=1331 cs=0 l=1 rx=0x7fe1600619f0 tx=0x7fe150007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.200+0000 7fe15dffb700 1 -- 172.21.15.63:0/1816436056 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe150012470 con 0x7fe1600b7ca0 2020-05-18T21:33:12.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.200+0000 7fe164cf7700 1 --2- 172.21.15.63:0/1816436056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1600b7ca0 0x7fe1600b2c80 secure :-1 s=THROTTLE_DONE pgs=1331 cs=0 l=1 rx=0x7fe1600619f0 tx=0x7fe150007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.200+0000 7fe15dffb700 1 --2- 172.21.15.63:0/1816436056 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe14004f8d0 0x7fe140051d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:12.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.200+0000 7fe15dffb700 1 -- 172.21.15.63:0/1816436056 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe150064490 con 0x7fe1600b7ca0 2020-05-18T21:33:12.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.200+0000 7fe15ffff700 1 --2- 172.21.15.63:0/1816436056 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe14004f8d0 0x7fe140051d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:12.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.200+0000 7fe15ffff700 1 --2- 172.21.15.63:0/1816436056 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe14004f8d0 0x7fe140051d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe154002f70 tx=0x7fe15400b5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.200+0000 7fe15ffff700 1 --2- 172.21.15.63:0/1816436056 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe14004f8d0 0x7fe140051d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe154002f70 tx=0x7fe15400b5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.200+0000 7fe15ffff700 1 --2- 172.21.15.63:0/1816436056 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe14004f8d0 0x7fe140051d90 secure :-1 s=READY pgs=524 cs=0 l=1 rx=0x7fe154002f70 tx=0x7fe15400b5f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:12.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.204+0000 7fe164cf7700 1 --2- 172.21.15.63:0/1816436056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1600b7ca0 0x7fe1600b2c80 secure :-1 s=THROTTLE_DONE pgs=1331 cs=0 l=1 rx=0x7fe1600619f0 tx=0x7fe150007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.204+0000 7fe15dffb700 1 -- 172.21.15.63:0/1816436056 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe1600af4e0 con 0x7fe1600b7ca0 2020-05-18T21:33:12.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.360+0000 7fe165cf9700 1 -- 172.21.15.63:0/1816436056 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_mv_cleanup"]} v 0) v1 -- 0x7fe1600af4e0 con 0x7fe1600b7ca0 2020-05-18T21:33:12.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.708+0000 7fe164cf7700 1 --2- 172.21.15.63:0/1816436056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1600b7ca0 0x7fe1600b2c80 secure :-1 s=THROTTLE_DONE pgs=1331 cs=0 l=1 rx=0x7fe1600619f0 tx=0x7fe150007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.708+0000 7fe15dffb700 1 -- 172.21.15.63:0/1816436056 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_mv_cleanup"]}]=0 v324) v1 ==== 130+0+0 (secure 0 0 0) 0x7fe1600af4e0 con 0x7fe1600b7ca0 2020-05-18T21:33:12.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.712+0000 7fe165cf9700 1 -- 172.21.15.63:0/1816436056 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe14004f8d0 msgr2=0x7fe140051d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:12.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.712+0000 7fe165cf9700 1 --2- 172.21.15.63:0/1816436056 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe14004f8d0 0x7fe140051d90 secure :-1 s=READY pgs=524 cs=0 l=1 rx=0x7fe154002f70 tx=0x7fe15400b5f0).stop 2020-05-18T21:33:12.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.712+0000 7fe165cf9700 1 -- 172.21.15.63:0/1816436056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1600b7ca0 msgr2=0x7fe1600b2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:12.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.712+0000 7fe165cf9700 1 --2- 172.21.15.63:0/1816436056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1600b7ca0 0x7fe1600b2c80 secure :-1 s=READY pgs=1331 cs=0 l=1 rx=0x7fe1600619f0 tx=0x7fe150007a80).stop 2020-05-18T21:33:12.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.712+0000 7fe165cf9700 1 -- 172.21.15.63:0/1816436056 shutdown_connections 2020-05-18T21:33:12.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.712+0000 7fe165cf9700 1 --2- 172.21.15.63:0/1816436056 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe14004f8d0 0x7fe140051d90 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:12.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.712+0000 7fe165cf9700 1 --2- 172.21.15.63:0/1816436056 >> v2:172.21.15.155:3300/0 conn(0x7fe1600b93f0 0x7fe160141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:12.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.712+0000 7fe165cf9700 1 --2- 172.21.15.63:0/1816436056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1600b7ca0 0x7fe1600b2c80 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:12.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.712+0000 7fe165cf9700 1 -- 172.21.15.63:0/1816436056 >> 172.21.15.63:0/1816436056 conn(0x7fe160069b70 msgr2=0x7fe160143f90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:12.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.712+0000 7fe165cf9700 1 -- 172.21.15.63:0/1816436056 shutdown_connections 2020-05-18T21:33:12.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.712+0000 7fe165cf9700 1 -- 172.21.15.63:0/1816436056 wait complete. 2020-05-18T21:33:12.735 INFO:tasks.cephfs_test_runner:test_mv_cleanup (tasks.cephfs.test_strays.TestStrays) ... ok 2020-05-18T21:33:12.736 INFO:tasks.cephfs_test_runner:Starting test: test_mv_hardlink_cleanup (tasks.cephfs.test_strays.TestStrays) 2020-05-18T21:33:12.736 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_strays.TestStrays.test_mv_hardlink_cleanup' 2020-05-18T21:33:12.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.840+0000 7fe72933e700 1 Processor -- start 2020-05-18T21:33:12.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.840+0000 7fe72933e700 1 -- start start 2020-05-18T21:33:12.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.840+0000 7fe72933e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe72405f110 0x7fe7240657a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:12.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.840+0000 7fe72933e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe7240b4e70 0x7fe72414a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:12.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.840+0000 7fe72933e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe724065060 con 0x7fe724063380 2020-05-18T21:33:12.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.840+0000 7fe72933e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe724064e80 con 0x7fe72405f110 2020-05-18T21:33:12.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.840+0000 7fe72933e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe724065300 con 0x7fe7240b4e70 2020-05-18T21:33:12.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.840+0000 7fe7237fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe724063380 0x7fe7240b4760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33952/0 (socket says 172.21.15.63:33952) 2020-05-18T21:33:12.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.840+0000 7fe7237fe700 1 -- 172.21.15.63:0/1256512763 learned_addr learned my addr 172.21.15.63:0/1256512763 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:12.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.840+0000 7fe723fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe72405f110 0x7fe7240657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:12.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.840+0000 7fe728b3d700 1 --2- 172.21.15.63:0/1256512763 >> v2:172.21.15.155:3300/0 conn(0x7fe7240b4e70 0x7fe72414a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:12.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe722ffd700 1 -- 172.21.15.63:0/1256512763 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128303208 0 0) 0x7fe724065060 con 0x7fe724063380 2020-05-18T21:33:12.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe722ffd700 1 -- 172.21.15.63:0/1256512763 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe704003270 con 0x7fe724063380 2020-05-18T21:33:12.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe723fff700 1 -- 172.21.15.63:0/1256512763 >> v2:172.21.15.155:3300/0 conn(0x7fe7240b4e70 msgr2=0x7fe72414a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:12.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe723fff700 1 --2- 172.21.15.63:0/1256512763 >> v2:172.21.15.155:3300/0 conn(0x7fe7240b4e70 0x7fe72414a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:12.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe723fff700 1 -- 172.21.15.63:0/1256512763 >> v1:172.21.15.63:6789/0 conn(0x7fe724063380 legacy=0x7fe7240b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:12.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe723fff700 1 -- 172.21.15.63:0/1256512763 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72405f4f0 con 0x7fe72405f110 2020-05-18T21:33:12.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe723fff700 1 --2- 172.21.15.63:0/1256512763 >> v2:172.21.15.63:3300/0 conn(0x7fe72405f110 0x7fe7240657a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe714002f70 tx=0x7fe714007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe723fff700 1 --2- 172.21.15.63:0/1256512763 >> v2:172.21.15.63:3300/0 conn(0x7fe72405f110 0x7fe7240657a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe714002f70 tx=0x7fe714007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe723fff700 1 --2- 172.21.15.63:0/1256512763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe72405f110 0x7fe7240657a0 secure :-1 s=READY pgs=1333 cs=0 l=1 rx=0x7fe714002f70 tx=0x7fe714007a80).ready entity=mon.0 client_cookie=732d7f219336a292 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:12.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe723fff700 1 --2- 172.21.15.63:0/1256512763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe72405f110 0x7fe7240657a0 secure :-1 s=THROTTLE_DONE pgs=1333 cs=0 l=1 rx=0x7fe714002f70 tx=0x7fe714007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe722ffd700 1 -- 172.21.15.63:0/1256512763 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe714008e50 con 0x7fe72405f110 2020-05-18T21:33:12.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe723fff700 1 --2- 172.21.15.63:0/1256512763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe72405f110 0x7fe7240657a0 secure :-1 s=THROTTLE_DONE pgs=1333 cs=0 l=1 rx=0x7fe714002f70 tx=0x7fe714007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe722ffd700 1 -- 172.21.15.63:0/1256512763 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe714011540 con 0x7fe72405f110 2020-05-18T21:33:12.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe723fff700 1 --2- 172.21.15.63:0/1256512763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe72405f110 0x7fe7240657a0 secure :-1 s=THROTTLE_DONE pgs=1333 cs=0 l=1 rx=0x7fe714002f70 tx=0x7fe714007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe72933e700 1 -- 172.21.15.63:0/1256512763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe72405f110 msgr2=0x7fe7240657a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:12.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe722ffd700 1 -- 172.21.15.63:0/1256512763 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe714011960 con 0x7fe72405f110 2020-05-18T21:33:12.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe72933e700 1 --2- 172.21.15.63:0/1256512763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe72405f110 0x7fe7240657a0 secure :-1 s=READY pgs=1333 cs=0 l=1 rx=0x7fe714002f70 tx=0x7fe714007a80).stop 2020-05-18T21:33:12.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe72933e700 1 -- 172.21.15.63:0/1256512763 shutdown_connections 2020-05-18T21:33:12.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe72933e700 1 --2- 172.21.15.63:0/1256512763 >> v2:172.21.15.155:3300/0 conn(0x7fe7240b4e70 0x7fe72414a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:12.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe72933e700 1 --2- 172.21.15.63:0/1256512763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe72405f110 0x7fe7240657a0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:12.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe72933e700 1 -- 172.21.15.63:0/1256512763 >> 172.21.15.63:0/1256512763 conn(0x7fe724069fc0 msgr2=0x7fe72406a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:12.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe72933e700 1 -- 172.21.15.63:0/1256512763 shutdown_connections 2020-05-18T21:33:12.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe72933e700 1 -- 172.21.15.63:0/1256512763 wait complete. 2020-05-18T21:33:12.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.844+0000 7fe72933e700 1 Processor -- start 2020-05-18T21:33:12.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe72933e700 1 -- start start 2020-05-18T21:33:12.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe72933e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe724063380 0x7fe7240b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:12.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe72933e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7240b4e70 0x7fe7240b6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:12.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe72933e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7240b0120 con 0x7fe72405f110 2020-05-18T21:33:12.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe72933e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7240b4310 con 0x7fe724063380 2020-05-18T21:33:12.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe72933e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7240b03c0 con 0x7fe7240b4e70 2020-05-18T21:33:12.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe728b3d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7240b4e70 0x7fe7240b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:12.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe7237fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe724063380 0x7fe7240b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:12.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe728b3d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7240b4e70 0x7fe7240b6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:50708/0 (socket says 172.21.15.63:50708) 2020-05-18T21:33:12.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe7237fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe724063380 0x7fe7240b62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:46620/0 (socket says 172.21.15.63:46620) 2020-05-18T21:33:12.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe728b3d700 1 -- 172.21.15.63:0/3329269488 learned_addr learned my addr 172.21.15.63:0/3329269488 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:12.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe723fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fe72405f110 0x7fe7240b3c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:60506/0 (socket says 172.21.15.63:60506) 2020-05-18T21:33:12.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe728b3d700 1 -- 172.21.15.63:0/3329269488 >> v2:172.21.15.155:3300/0 conn(0x7fe724063380 msgr2=0x7fe7240b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:12.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe728b3d700 1 --2- 172.21.15.63:0/3329269488 >> v2:172.21.15.155:3300/0 conn(0x7fe724063380 0x7fe7240b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:12.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe728b3d700 1 -- 172.21.15.63:0/3329269488 >> v1:172.21.15.155:6789/0 conn(0x7fe72405f110 legacy=0x7fe7240b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:12.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe728b3d700 1 -- 172.21.15.63:0/3329269488 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7240afe20 con 0x7fe7240b4e70 2020-05-18T21:33:12.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe728b3d700 1 --2- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7240b4e70 0x7fe7240b6740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe71c002f70 tx=0x7fe71c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe728b3d700 1 --2- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7240b4e70 0x7fe7240b6740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe71c002f70 tx=0x7fe71c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe728b3d700 1 --2- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7240b4e70 0x7fe7240b6740 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7fe71c002f70 tx=0x7fe71c010c30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe728b3d700 1 --2- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7240b4e70 0x7fe7240b6740 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fe71c002f70 tx=0x7fe71c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe7217fa700 1 -- 172.21.15.63:0/3329269488 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe71c007550 con 0x7fe7240b4e70 2020-05-18T21:33:12.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe728b3d700 1 --2- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7240b4e70 0x7fe7240b6740 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fe71c002f70 tx=0x7fe71c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe728b3d700 1 --2- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7240b4e70 0x7fe7240b6740 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fe71c002f70 tx=0x7fe71c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe7217fa700 1 -- 172.21.15.63:0/3329269488 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c005700 con 0x7fe7240b4e70 2020-05-18T21:33:12.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe72933e700 1 -- 172.21.15.63:0/3329269488 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe724157780 con 0x7fe7240b4e70 2020-05-18T21:33:12.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe7217fa700 1 -- 172.21.15.63:0/3329269488 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe71c005ae0 con 0x7fe7240b4e70 2020-05-18T21:33:12.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.848+0000 7fe72933e700 1 -- 172.21.15.63:0/3329269488 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe724136c30 con 0x7fe7240b4e70 2020-05-18T21:33:12.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.852+0000 7fe728b3d700 1 --2- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7240b4e70 0x7fe7240b6740 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fe71c002f70 tx=0x7fe71c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.852+0000 7fe72933e700 1 -- 172.21.15.63:0/3329269488 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7240569e0 con 0x7fe7240b4e70 2020-05-18T21:33:12.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.852+0000 7fe7217fa700 1 -- 172.21.15.63:0/3329269488 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe71c005d60 con 0x7fe7240b4e70 2020-05-18T21:33:12.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.852+0000 7fe728b3d700 1 --2- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7240b4e70 0x7fe7240b6740 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fe71c002f70 tx=0x7fe71c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.852+0000 7fe7217fa700 1 --2- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe70804f9b0 0x7fe708051e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:12.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.852+0000 7fe7217fa700 1 -- 172.21.15.63:0/3329269488 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe71c0640c0 con 0x7fe7240b4e70 2020-05-18T21:33:12.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.852+0000 7fe723fff700 1 --2- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe70804f9b0 0x7fe708051e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:12.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.852+0000 7fe723fff700 1 --2- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe70804f9b0 0x7fe708051e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe7240b5a10 tx=0x7fe714007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.852+0000 7fe723fff700 1 --2- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe70804f9b0 0x7fe708051e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe7240b5a10 tx=0x7fe714007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.852+0000 7fe723fff700 1 --2- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe70804f9b0 0x7fe708051e70 secure :-1 s=READY pgs=525 cs=0 l=1 rx=0x7fe7240b5a10 tx=0x7fe714007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:12.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.860+0000 7fe728b3d700 1 --2- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7240b4e70 0x7fe7240b6740 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fe71c002f70 tx=0x7fe71c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:12.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:12.860+0000 7fe7217fa700 1 -- 172.21.15.63:0/3329269488 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe71c03e470 con 0x7fe7240b4e70 2020-05-18T21:33:13.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.012+0000 7fe72933e700 1 -- 172.21.15.63:0/3329269488 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_mv_hardlink_cleanup"]} v 0) v1 -- 0x7fe724140bc0 con 0x7fe7240b4e70 2020-05-18T21:33:13.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.720+0000 7fe728b3d700 1 --2- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7240b4e70 0x7fe7240b6740 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fe71c002f70 tx=0x7fe71c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:13.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.720+0000 7fe7217fa700 1 -- 172.21.15.63:0/3329269488 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_mv_hardlink_cleanup"]}]=0 v325) v1 ==== 142+0+0 (secure 0 0 0) 0x7fe71c041a90 con 0x7fe7240b4e70 2020-05-18T21:33:13.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.724+0000 7fe72933e700 1 -- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe70804f9b0 msgr2=0x7fe708051e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:13.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.724+0000 7fe72933e700 1 --2- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe70804f9b0 0x7fe708051e70 secure :-1 s=READY pgs=525 cs=0 l=1 rx=0x7fe7240b5a10 tx=0x7fe714007a80).stop 2020-05-18T21:33:13.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.724+0000 7fe72933e700 1 -- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7240b4e70 msgr2=0x7fe7240b6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:13.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.724+0000 7fe72933e700 1 --2- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7240b4e70 0x7fe7240b6740 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7fe71c002f70 tx=0x7fe71c010c30).stop 2020-05-18T21:33:13.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.724+0000 7fe72933e700 1 -- 172.21.15.63:0/3329269488 shutdown_connections 2020-05-18T21:33:13.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.724+0000 7fe72933e700 1 --2- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe70804f9b0 0x7fe708051e70 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:13.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.724+0000 7fe72933e700 1 --2- 172.21.15.63:0/3329269488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7240b4e70 0x7fe7240b6740 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:13.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.724+0000 7fe72933e700 1 --2- 172.21.15.63:0/3329269488 >> v2:172.21.15.155:3300/0 conn(0x7fe724063380 0x7fe7240b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:13.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.724+0000 7fe72933e700 1 -- 172.21.15.63:0/3329269488 >> 172.21.15.63:0/3329269488 conn(0x7fe724069fc0 msgr2=0x7fe72414cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:13.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.724+0000 7fe72933e700 1 -- 172.21.15.63:0/3329269488 shutdown_connections 2020-05-18T21:33:13.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.724+0000 7fe72933e700 1 -- 172.21.15.63:0/3329269488 wait complete. 2020-05-18T21:33:13.745 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:33:13.746 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:33:13.762 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:33:13.784 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:33:13.785 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-05-18T21:33:13.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.900+0000 7f1cce295700 1 Processor -- start 2020-05-18T21:33:13.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.900+0000 7f1cce295700 1 -- start start 2020-05-18T21:33:13.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cce295700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cc80b2860 0x7f1cc80615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:13.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cce295700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1cc814e570 0x7f1cc814a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:13.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cce295700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc814d960 con 0x7f1cc8060b90 2020-05-18T21:33:13.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cce295700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc8066210 con 0x7f1cc814e570 2020-05-18T21:33:13.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cce295700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc814db90 con 0x7f1cc80b2860 2020-05-18T21:33:13.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1ccc832700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1cc814e570 0x7f1cc814a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:13.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cc7fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1cc8060b90 0x7f1cc8144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33968/0 (socket says 172.21.15.63:33968) 2020-05-18T21:33:13.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cc7fff700 1 -- 172.21.15.63:0/3972519178 learned_addr learned my addr 172.21.15.63:0/3972519178 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:13.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cc77fe700 1 --2- 172.21.15.63:0/3972519178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cc80b2860 0x7f1cc80615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:13.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cc6ffd700 1 -- 172.21.15.63:0/3972519178 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443989421 0 0) 0x7f1cc814d960 con 0x7f1cc8060b90 2020-05-18T21:33:13.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cc6ffd700 1 -- 172.21.15.63:0/3972519178 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cb4003270 con 0x7f1cc8060b90 2020-05-18T21:33:13.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1ccc832700 1 -- 172.21.15.63:0/3972519178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cc80b2860 msgr2=0x7f1cc80615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:13.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1ccc832700 1 --2- 172.21.15.63:0/3972519178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cc80b2860 0x7f1cc80615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:13.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1ccc832700 1 -- 172.21.15.63:0/3972519178 >> v1:172.21.15.63:6789/0 conn(0x7f1cc8060b90 legacy=0x7f1cc8144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:13.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1ccc832700 1 -- 172.21.15.63:0/3972519178 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc814de30 con 0x7f1cc814e570 2020-05-18T21:33:13.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1ccc832700 1 --2- 172.21.15.63:0/3972519178 >> v2:172.21.15.63:3300/0 conn(0x7f1cc814e570 0x7f1cc814a390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1cc00032f0 tx=0x7f1cc0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:13.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1ccc832700 1 --2- 172.21.15.63:0/3972519178 >> v2:172.21.15.63:3300/0 conn(0x7f1cc814e570 0x7f1cc814a390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1cc00032f0 tx=0x7f1cc0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:13.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1ccc832700 1 --2- 172.21.15.63:0/3972519178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc814e570 0x7f1cc814a390 secure :-1 s=READY pgs=1335 cs=0 l=1 rx=0x7f1cc00032f0 tx=0x7f1cc0007e00).ready entity=mon.0 client_cookie=fd519feffe73e15a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:13.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1ccc832700 1 --2- 172.21.15.63:0/3972519178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc814e570 0x7f1cc814a390 secure :-1 s=THROTTLE_DONE pgs=1335 cs=0 l=1 rx=0x7f1cc00032f0 tx=0x7f1cc0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:13.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1ccc832700 1 --2- 172.21.15.63:0/3972519178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc814e570 0x7f1cc814a390 secure :-1 s=THROTTLE_DONE pgs=1335 cs=0 l=1 rx=0x7f1cc00032f0 tx=0x7f1cc0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:13.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cc6ffd700 1 -- 172.21.15.63:0/3972519178 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cc0011db0 con 0x7f1cc814e570 2020-05-18T21:33:13.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1ccc832700 1 --2- 172.21.15.63:0/3972519178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc814e570 0x7f1cc814a390 secure :-1 s=THROTTLE_DONE pgs=1335 cs=0 l=1 rx=0x7f1cc00032f0 tx=0x7f1cc0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:13.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cc6ffd700 1 -- 172.21.15.63:0/3972519178 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc000a180 con 0x7f1cc814e570 2020-05-18T21:33:13.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cc6ffd700 1 -- 172.21.15.63:0/3972519178 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cc000a5a0 con 0x7f1cc814e570 2020-05-18T21:33:13.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cce295700 1 -- 172.21.15.63:0/3972519178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc814e570 msgr2=0x7f1cc814a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:13.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cce295700 1 --2- 172.21.15.63:0/3972519178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc814e570 0x7f1cc814a390 secure :-1 s=READY pgs=1335 cs=0 l=1 rx=0x7f1cc00032f0 tx=0x7f1cc0007e00).stop 2020-05-18T21:33:13.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cce295700 1 -- 172.21.15.63:0/3972519178 shutdown_connections 2020-05-18T21:33:13.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cce295700 1 --2- 172.21.15.63:0/3972519178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc814e570 0x7f1cc814a390 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:13.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cce295700 1 --2- 172.21.15.63:0/3972519178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cc80b2860 0x7f1cc80615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:13.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cce295700 1 -- 172.21.15.63:0/3972519178 >> 172.21.15.63:0/3972519178 conn(0x7f1cc80b83d0 msgr2=0x7f1cc80b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:13.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cce295700 1 -- 172.21.15.63:0/3972519178 shutdown_connections 2020-05-18T21:33:13.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.904+0000 7f1cce295700 1 -- 172.21.15.63:0/3972519178 wait complete. 2020-05-18T21:33:13.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cce295700 1 Processor -- start 2020-05-18T21:33:13.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cce295700 1 -- start start 2020-05-18T21:33:13.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cce295700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1cc80b2860 0x7f1cc8069eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:13.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cce295700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1cc814e570 0x7f1cc80af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:13.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cce295700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc806a310 con 0x7f1cc8060b90 2020-05-18T21:33:13.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cce295700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc814ce40 con 0x7f1cc80b2860 2020-05-18T21:33:13.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cce295700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc814d040 con 0x7f1cc814e570 2020-05-18T21:33:13.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cc77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1cc80b2860 0x7f1cc8069eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:13.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cc77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1cc80b2860 0x7f1cc8069eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60018/0 (socket says 172.21.15.63:60018) 2020-05-18T21:33:13.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cc77fe700 1 -- 172.21.15.63:0/4048020893 learned_addr learned my addr 172.21.15.63:0/4048020893 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:13.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1ccc832700 1 --2- 172.21.15.63:0/4048020893 >> v2:172.21.15.155:3300/0 conn(0x7f1cc814e570 0x7f1cc80af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:13.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cc77fe700 1 -- 172.21.15.63:0/4048020893 >> v2:172.21.15.155:3300/0 conn(0x7f1cc814e570 msgr2=0x7f1cc80af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:13.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cc77fe700 1 --2- 172.21.15.63:0/4048020893 >> v2:172.21.15.155:3300/0 conn(0x7f1cc814e570 0x7f1cc80af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:13.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cc77fe700 1 -- 172.21.15.63:0/4048020893 >> v1:172.21.15.155:6789/0 conn(0x7f1cc8060b90 legacy=0x7f1cc814c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:13.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cc77fe700 1 -- 172.21.15.63:0/4048020893 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc815b1a0 con 0x7f1cc80b2860 2020-05-18T21:33:13.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cc77fe700 1 --2- 172.21.15.63:0/4048020893 >> v2:172.21.15.63:3300/0 conn(0x7f1cc80b2860 0x7f1cc8069eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1cbc0030b0 tx=0x7f1cbc010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:13.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cc77fe700 1 --2- 172.21.15.63:0/4048020893 >> v2:172.21.15.63:3300/0 conn(0x7f1cc80b2860 0x7f1cc8069eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1cbc0030b0 tx=0x7f1cbc010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:13.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cc77fe700 1 --2- 172.21.15.63:0/4048020893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc80b2860 0x7f1cc8069eb0 secure :-1 s=READY pgs=1336 cs=0 l=1 rx=0x7f1cbc0030b0 tx=0x7f1cbc010ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:13.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cc77fe700 1 --2- 172.21.15.63:0/4048020893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc80b2860 0x7f1cc8069eb0 secure :-1 s=THROTTLE_DONE pgs=1336 cs=0 l=1 rx=0x7f1cbc0030b0 tx=0x7f1cbc010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:13.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cc77fe700 1 --2- 172.21.15.63:0/4048020893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc80b2860 0x7f1cc8069eb0 secure :-1 s=THROTTLE_DONE pgs=1336 cs=0 l=1 rx=0x7f1cbc0030b0 tx=0x7f1cbc010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:13.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cc57fa700 1 -- 172.21.15.63:0/4048020893 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cbc007560 con 0x7f1cc80b2860 2020-05-18T21:33:13.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cc77fe700 1 --2- 172.21.15.63:0/4048020893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc80b2860 0x7f1cc8069eb0 secure :-1 s=THROTTLE_DONE pgs=1336 cs=0 l=1 rx=0x7f1cbc0030b0 tx=0x7f1cbc010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:13.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cc57fa700 1 -- 172.21.15.63:0/4048020893 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc005a00 con 0x7f1cc80b2860 2020-05-18T21:33:13.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cc57fa700 1 -- 172.21.15.63:0/4048020893 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cbc005de0 con 0x7f1cc80b2860 2020-05-18T21:33:13.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cce295700 1 -- 172.21.15.63:0/4048020893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc80adc80 con 0x7f1cc80b2860 2020-05-18T21:33:13.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.908+0000 7f1cce295700 1 -- 172.21.15.63:0/4048020893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc80af870 con 0x7f1cc80b2860 2020-05-18T21:33:13.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.912+0000 7f1cc77fe700 1 --2- 172.21.15.63:0/4048020893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc80b2860 0x7f1cc8069eb0 secure :-1 s=THROTTLE_DONE pgs=1336 cs=0 l=1 rx=0x7f1cbc0030b0 tx=0x7f1cbc010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:13.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.912+0000 7f1cce295700 1 -- 172.21.15.63:0/4048020893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc80569e0 con 0x7f1cc80b2860 2020-05-18T21:33:13.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.912+0000 7f1cc57fa700 1 -- 172.21.15.63:0/4048020893 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1cbc0089b0 con 0x7f1cc80b2860 2020-05-18T21:33:13.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.912+0000 7f1cc77fe700 1 --2- 172.21.15.63:0/4048020893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc80b2860 0x7f1cc8069eb0 secure :-1 s=THROTTLE_DONE pgs=1336 cs=0 l=1 rx=0x7f1cbc0030b0 tx=0x7f1cbc010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:13.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.912+0000 7f1cc57fa700 1 --2- 172.21.15.63:0/4048020893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1ca804f9e0 0x7f1ca8051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:13.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.912+0000 7f1cc57fa700 1 -- 172.21.15.63:0/4048020893 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1cbc063ee0 con 0x7f1cc80b2860 2020-05-18T21:33:13.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.912+0000 7f1cc7fff700 1 --2- 172.21.15.63:0/4048020893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1ca804f9e0 0x7f1ca8051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:13.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.912+0000 7f1cc7fff700 1 --2- 172.21.15.63:0/4048020893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1ca804f9e0 0x7f1ca8051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1cc80af100 tx=0x7f1cb8001cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:13.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.912+0000 7f1cc7fff700 1 --2- 172.21.15.63:0/4048020893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1ca804f9e0 0x7f1ca8051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1cc80af100 tx=0x7f1cb8001cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:13.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.912+0000 7f1cc7fff700 1 --2- 172.21.15.63:0/4048020893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1ca804f9e0 0x7f1ca8051ea0 secure :-1 s=READY pgs=526 cs=0 l=1 rx=0x7f1cc80af100 tx=0x7f1cb8001cb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:13.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.920+0000 7f1cc77fe700 1 --2- 172.21.15.63:0/4048020893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc80b2860 0x7f1cc8069eb0 secure :-1 s=THROTTLE_DONE pgs=1336 cs=0 l=1 rx=0x7f1cbc0030b0 tx=0x7f1cbc010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:13.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:13.920+0000 7f1cc57fa700 1 -- 172.21.15.63:0/4048020893 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f1cbc03e270 con 0x7f1cc80b2860 2020-05-18T21:33:14.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.036+0000 7f1cce295700 1 -- 172.21.15.63:0/4048020893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1cc80b43b0 con 0x7f1cc80b2860 2020-05-18T21:33:14.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.040+0000 7f1cc77fe700 1 --2- 172.21.15.63:0/4048020893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc80b2860 0x7f1cc8069eb0 secure :-1 s=THROTTLE_DONE pgs=1336 cs=0 l=1 rx=0x7f1cbc0030b0 tx=0x7f1cbc010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.040+0000 7f1cc57fa700 1 -- 172.21.15.63:0/4048020893 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v95) v1 ==== 81+0+33699 (secure 0 0 0) 0x7f1cbc041890 con 0x7f1cc80b2860 2020-05-18T21:33:14.047 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:14.047 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:14.047 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 95, 2020-05-18T21:33:14.047 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:33:14.048 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2020-05-18T21:26:28.798650+0000", 2020-05-18T21:33:14.048 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2020-05-18T21:32:54.190968+0000", 2020-05-18T21:33:14.048 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:33:14.048 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:33:14.048 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-05-18T21:33:14.049 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5799936, 2020-05-18T21:33:14.049 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2020-05-18T21:33:14.049 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2020-05-18T21:33:14.049 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2020-05-18T21:33:14.049 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2020-05-18T21:33:14.050 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2020-05-18T21:33:14.050 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:33:14.050 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 4, 2020-05-18T21:33:14.050 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2020-05-18T21:33:14.050 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-05-18T21:33:14.051 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2020-05-18T21:33:14.051 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2020-05-18T21:33:14.051 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 18, 2020-05-18T21:33:14.051 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 8, 2020-05-18T21:33:14.051 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2020-05-18T21:33:14.051 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "jewel", 2020-05-18T21:33:14.052 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "pacific", 2020-05-18T21:33:14.052 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:33:14.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.052 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2020-05-18T21:33:14.052 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "device_health_metrics", 2020-05-18T21:33:14.053 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:33.080792+0000", 2020-05-18T21:33:14.053 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:33:14.053 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:33:14.053 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:33:14.053 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:33:14.054 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:33:14.054 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:33:14.054 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:33:14.054 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:33:14.054 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2020-05-18T21:33:14.054 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2020-05-18T21:33:14.055 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2020-05-18T21:33:14.056 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2020-05-18T21:33:14.056 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2020-05-18T21:33:14.056 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:33:14.056 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:33:14.056 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:33:14.057 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:33:14.057 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:33:14.057 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:33:14.057 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:33:14.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.058 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "15", 2020-05-18T21:33:14.058 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:33:14.058 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:33:14.058 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:33:14.059 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:33:14.059 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:33:14.059 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:33:14.059 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:33:14.059 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:33:14.059 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:33:14.060 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:33:14.060 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:33:14.060 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:33:14.060 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:33:14.060 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:33:14.061 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:33:14.061 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:33:14.061 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:33:14.061 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:33:14.063 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:33:14.063 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:33:14.064 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:33:14.064 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:33:14.065 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:33:14.065 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:33:14.065 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:33:14.065 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:33:14.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.066 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:33:14.066 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:33:14.066 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:33:14.066 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:33:14.067 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:33:14.067 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:33:14.067 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:33:14.067 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:33:14.067 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:33:14.067 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:33:14.068 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:33:14.068 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:33:14.068 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2020-05-18T21:33:14.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.068 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:33:14.069 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_devicehealth": {} 2020-05-18T21:33:14.069 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.071 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2020-05-18T21:33:14.071 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2020-05-18T21:33:14.072 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:40.149370+0000", 2020-05-18T21:33:14.072 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:33:14.072 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:33:14.072 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:33:14.072 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:33:14.073 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:33:14.073 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:33:14.073 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:33:14.073 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:33:14.073 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:33:14.074 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:33:14.074 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:33:14.074 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:33:14.074 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:33:14.075 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:33:14.075 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:33:14.075 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:33:14.076 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:33:14.076 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:33:14.076 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:33:14.076 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:33:14.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.077 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2020-05-18T21:33:14.077 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:33:14.077 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:33:14.077 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:33:14.077 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:33:14.077 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:33:14.078 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:33:14.078 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:33:14.078 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:33:14.078 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:33:14.078 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:33:14.079 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:33:14.079 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:33:14.079 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:33:14.079 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:33:14.079 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:33:14.080 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:33:14.080 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:33:14.080 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:33:14.080 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:33:14.080 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:33:14.080 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:33:14.081 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:33:14.081 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:33:14.081 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:33:14.081 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:33:14.081 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:33:14.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.082 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:33:14.082 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:33:14.082 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:33:14.082 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:33:14.082 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:33:14.083 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:33:14.083 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:33:14.083 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:33:14.083 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:33:14.083 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:33:14.084 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:33:14.084 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:33:14.084 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:33:14.084 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2020-05-18T21:33:14.084 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.085 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 17, 2020-05-18T21:33:14.085 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2020-05-18T21:33:14.085 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:32:51.634300+0000", 2020-05-18T21:33:14.085 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:33:14.086 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:33:14.086 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:33:14.086 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:33:14.086 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:33:14.087 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:33:14.087 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:33:14.087 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:33:14.087 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:33:14.087 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:33:14.088 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:33:14.088 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:33:14.088 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:33:14.088 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:33:14.088 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:33:14.088 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:33:14.089 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:33:14.089 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:33:14.089 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:33:14.089 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:33:14.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.090 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "94", 2020-05-18T21:33:14.090 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:33:14.090 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:33:14.090 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:33:14.090 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:33:14.091 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:33:14.091 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:33:14.091 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:33:14.091 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:33:14.092 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:33:14.092 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:33:14.092 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:33:14.092 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:33:14.092 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:33:14.092 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:33:14.093 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:33:14.093 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:33:14.093 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:33:14.093 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:33:14.093 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:33:14.094 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:33:14.094 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:33:14.094 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:33:14.094 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:33:14.094 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:33:14.095 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:33:14.095 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:33:14.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.095 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:33:14.095 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:33:14.095 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:33:14.096 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:33:14.096 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:33:14.096 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:33:14.096 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:33:14.096 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:33:14.097 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:33:14.097 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:33:14.097 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:33:14.097 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:33:14.098 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2020-05-18T21:33:14.098 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2020-05-18T21:33:14.098 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2020-05-18T21:33:14.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.098 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:33:14.099 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:33:14.099 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2020-05-18T21:33:14.099 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.103 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.104 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 18, 2020-05-18T21:33:14.105 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2020-05-18T21:33:14.106 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:32:52.187431+0000", 2020-05-18T21:33:14.106 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:33:14.106 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:33:14.106 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:33:14.107 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:33:14.107 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:33:14.107 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:33:14.107 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:33:14.107 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:33:14.108 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:33:14.108 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:33:14.109 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:33:14.109 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:33:14.109 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:33:14.110 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:33:14.110 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:33:14.110 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:33:14.111 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:33:14.111 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:33:14.111 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:33:14.111 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:33:14.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.112 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "95", 2020-05-18T21:33:14.112 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:33:14.112 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:33:14.112 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:33:14.112 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:33:14.113 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:33:14.113 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:33:14.113 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:33:14.114 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:33:14.114 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:33:14.114 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:33:14.115 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:33:14.115 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:33:14.115 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:33:14.115 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:33:14.115 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:33:14.116 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:33:14.116 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:33:14.116 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:33:14.117 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:33:14.117 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:33:14.117 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:33:14.117 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:33:14.117 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:33:14.118 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:33:14.118 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:33:14.118 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:33:14.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.118 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:33:14.118 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:33:14.119 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:33:14.119 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:33:14.119 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:33:14.119 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:33:14.119 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:33:14.120 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:33:14.120 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:33:14.120 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:33:14.120 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:33:14.120 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:33:14.121 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:33:14.121 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:33:14.121 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2020-05-18T21:33:14.121 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.121 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.121 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.122 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:33:14.122 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2020-05-18T21:33:14.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.122 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:33:14.122 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "c6ae0fbf-604c-4e8d-b1b8-6038821420e3", 2020-05-18T21:33:14.123 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:33:14.123 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:33:14.123 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:33:14.123 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:33:14.123 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:33:14.123 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:33:14.124 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:33:14.124 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 92, 2020-05-18T21:33:14.124 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:33:14.124 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:33:14.124 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:33:14.125 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.125 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.125 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2020-05-18T21:33:14.125 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:33:14.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.126 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.126 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2020-05-18T21:33:14.126 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:33:14.126 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.127 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.127 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:33:14.127 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.128 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.128 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6802", 2020-05-18T21:33:14.128 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:33:14.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.128 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.129 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6803", 2020-05-18T21:33:14.129 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:33:14.129 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.129 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.130 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:33:14.130 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.131 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.131 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6806", 2020-05-18T21:33:14.131 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:33:14.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.132 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.132 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6807", 2020-05-18T21:33:14.132 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:33:14.132 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.133 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.133 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:33:14.133 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.134 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.134 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6804", 2020-05-18T21:33:14.134 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:33:14.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.134 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.135 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6805", 2020-05-18T21:33:14.135 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:33:14.135 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.135 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.136 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6801/12803", 2020-05-18T21:33:14.136 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6803/12803", 2020-05-18T21:33:14.136 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6807/12803", 2020-05-18T21:33:14.136 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6805/12803", 2020-05-18T21:33:14.136 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:33:14.136 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:33:14.137 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:33:14.137 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.137 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:33:14.138 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6", 2020-05-18T21:33:14.138 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:33:14.138 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:33:14.138 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:33:14.138 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:33:14.139 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:33:14.139 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:33:14.139 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:33:14.139 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 92, 2020-05-18T21:33:14.139 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:33:14.139 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:33:14.140 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:33:14.140 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.140 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.140 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6808", 2020-05-18T21:33:14.141 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:33:14.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.141 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.141 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6809", 2020-05-18T21:33:14.142 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:33:14.142 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.142 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.142 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:33:14.143 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.143 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.143 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6810", 2020-05-18T21:33:14.143 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:33:14.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.144 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.144 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6811", 2020-05-18T21:33:14.144 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:33:14.144 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.145 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.145 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:33:14.145 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.146 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.146 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6815", 2020-05-18T21:33:14.146 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:33:14.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.147 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.147 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6817", 2020-05-18T21:33:14.147 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:33:14.147 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.147 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.148 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:33:14.148 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.148 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.148 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6812", 2020-05-18T21:33:14.149 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:33:14.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.149 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.149 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6813", 2020-05-18T21:33:14.149 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:33:14.150 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.150 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.150 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6809/12804", 2020-05-18T21:33:14.150 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6811/12804", 2020-05-18T21:33:14.151 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6817/12804", 2020-05-18T21:33:14.151 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6813/12804", 2020-05-18T21:33:14.151 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:33:14.151 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:33:14.151 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:33:14.151 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.152 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:33:14.152 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "ec8d9fa9-dae9-45f6-b286-735ab3801c27", 2020-05-18T21:33:14.152 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:33:14.153 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:33:14.153 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:33:14.153 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:33:14.153 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:33:14.153 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:33:14.154 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:33:14.154 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 92, 2020-05-18T21:33:14.154 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:33:14.154 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:33:14.154 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:33:14.154 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.155 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.155 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6822", 2020-05-18T21:33:14.155 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:33:14.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.156 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.156 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6824", 2020-05-18T21:33:14.156 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:33:14.156 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.156 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.157 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:33:14.157 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.157 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.158 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6826", 2020-05-18T21:33:14.158 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:33:14.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.158 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.159 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6827", 2020-05-18T21:33:14.159 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:33:14.159 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.159 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.159 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:33:14.160 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.160 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.160 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.160 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6830", 2020-05-18T21:33:14.160 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:33:14.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.161 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.161 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6831", 2020-05-18T21:33:14.161 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:33:14.161 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.162 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.162 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:33:14.162 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.163 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.163 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6828", 2020-05-18T21:33:14.163 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:33:14.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.163 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.164 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6829", 2020-05-18T21:33:14.164 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:33:14.164 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.164 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.165 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6824/12806", 2020-05-18T21:33:14.165 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6827/12806", 2020-05-18T21:33:14.165 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6831/12806", 2020-05-18T21:33:14.165 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6829/12806", 2020-05-18T21:33:14.165 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:33:14.165 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:33:14.166 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:33:14.166 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.166 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:33:14.167 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "1030fedf-adad-4e79-b839-59385d4d7d2a", 2020-05-18T21:33:14.167 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:33:14.167 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:33:14.167 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:33:14.167 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:33:14.168 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:33:14.168 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:33:14.168 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:33:14.168 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 93, 2020-05-18T21:33:14.168 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:33:14.168 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:33:14.169 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:33:14.169 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.169 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.169 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6814", 2020-05-18T21:33:14.170 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:33:14.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.170 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.170 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6816", 2020-05-18T21:33:14.170 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:33:14.171 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.171 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.171 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:33:14.171 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.172 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.172 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6818", 2020-05-18T21:33:14.172 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:33:14.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.173 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.173 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6819", 2020-05-18T21:33:14.173 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:33:14.173 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.173 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.174 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:33:14.174 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.174 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.175 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6823", 2020-05-18T21:33:14.175 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:33:14.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.175 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.175 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6825", 2020-05-18T21:33:14.176 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:33:14.176 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.176 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.176 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:33:14.177 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.177 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.177 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6820", 2020-05-18T21:33:14.177 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:33:14.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.178 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.178 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6821", 2020-05-18T21:33:14.178 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:33:14.178 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.179 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.179 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6816/12805", 2020-05-18T21:33:14.179 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6819/12805", 2020-05-18T21:33:14.179 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6825/12805", 2020-05-18T21:33:14.179 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6821/12805", 2020-05-18T21:33:14.180 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:33:14.180 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:33:14.180 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:33:14.180 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.181 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:33:14.181 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "8ad15a9b-97b4-4002-b1d4-7292e09b4ef6", 2020-05-18T21:33:14.181 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:33:14.181 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:33:14.181 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:33:14.182 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:33:14.182 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:33:14.182 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:33:14.182 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:33:14.182 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 91, 2020-05-18T21:33:14.183 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:33:14.183 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:33:14.183 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:33:14.183 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.184 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.184 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6800", 2020-05-18T21:33:14.184 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:33:14.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.184 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.185 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6801", 2020-05-18T21:33:14.185 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:33:14.185 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.185 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.186 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:33:14.186 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.186 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.186 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6802", 2020-05-18T21:33:14.186 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:33:14.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.187 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.187 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6803", 2020-05-18T21:33:14.187 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:33:14.188 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.188 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.188 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:33:14.188 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.189 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.189 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6806", 2020-05-18T21:33:14.189 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:33:14.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.190 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.190 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6807", 2020-05-18T21:33:14.190 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:33:14.190 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.190 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.191 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:33:14.191 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.191 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.191 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6804", 2020-05-18T21:33:14.192 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:33:14.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.192 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.192 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6805", 2020-05-18T21:33:14.192 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:33:14.193 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.193 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.193 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6801/13023", 2020-05-18T21:33:14.193 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6803/13023", 2020-05-18T21:33:14.194 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6807/13023", 2020-05-18T21:33:14.194 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6805/13023", 2020-05-18T21:33:14.194 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:33:14.194 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:33:14.194 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:33:14.194 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.195 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:33:14.195 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0dce88f8-b984-43e1-95e2-4132171102d2", 2020-05-18T21:33:14.195 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:33:14.196 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:33:14.196 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:33:14.196 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:33:14.196 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:33:14.196 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:33:14.196 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:33:14.197 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 82, 2020-05-18T21:33:14.197 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:33:14.197 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:33:14.197 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:33:14.197 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.198 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.198 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6808", 2020-05-18T21:33:14.198 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:33:14.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.199 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.199 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6809", 2020-05-18T21:33:14.199 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:33:14.200 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.200 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.200 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:33:14.200 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.201 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.201 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6810", 2020-05-18T21:33:14.201 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:33:14.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.202 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.202 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6811", 2020-05-18T21:33:14.202 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:33:14.202 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.203 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.203 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:33:14.203 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.203 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.204 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6814", 2020-05-18T21:33:14.204 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:33:14.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.204 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.205 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6816", 2020-05-18T21:33:14.205 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:33:14.205 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.205 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.206 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:33:14.206 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.206 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.206 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6812", 2020-05-18T21:33:14.206 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:33:14.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.207 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.207 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6813", 2020-05-18T21:33:14.207 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:33:14.208 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.208 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.208 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6809/13024", 2020-05-18T21:33:14.208 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6811/13024", 2020-05-18T21:33:14.208 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6816/13024", 2020-05-18T21:33:14.209 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6813/13024", 2020-05-18T21:33:14.209 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:33:14.209 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:33:14.209 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:33:14.209 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.210 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:33:14.210 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "e1bc92f8-3692-4483-b0fb-905c94fa1469", 2020-05-18T21:33:14.210 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:33:14.211 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:33:14.211 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:33:14.211 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:33:14.211 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:33:14.211 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:33:14.211 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:33:14.212 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 91, 2020-05-18T21:33:14.212 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:33:14.212 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:33:14.212 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:33:14.213 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.214 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.215 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6815", 2020-05-18T21:33:14.215 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:33:14.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.216 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.216 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6817", 2020-05-18T21:33:14.216 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:33:14.216 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.216 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.217 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:33:14.218 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.219 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.219 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6818", 2020-05-18T21:33:14.219 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:33:14.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.220 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.220 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6819", 2020-05-18T21:33:14.220 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:33:14.220 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.220 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.221 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:33:14.221 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.221 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.222 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6822", 2020-05-18T21:33:14.222 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:33:14.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.222 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.223 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6824", 2020-05-18T21:33:14.223 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:33:14.223 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.223 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.224 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:33:14.224 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.224 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.224 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6820", 2020-05-18T21:33:14.224 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:33:14.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.225 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.225 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6821", 2020-05-18T21:33:14.225 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:33:14.226 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.226 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.227 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6817/13025", 2020-05-18T21:33:14.227 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6819/13025", 2020-05-18T21:33:14.227 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6824/13025", 2020-05-18T21:33:14.227 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6821/13025", 2020-05-18T21:33:14.227 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:33:14.228 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:33:14.228 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:33:14.228 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.229 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:33:14.229 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "b76e000c-a078-48c4-9e1e-34d286a9992c", 2020-05-18T21:33:14.229 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:33:14.229 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:33:14.230 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:33:14.230 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:33:14.230 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:33:14.230 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:33:14.231 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:33:14.231 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 92, 2020-05-18T21:33:14.231 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:33:14.231 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:33:14.231 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:33:14.231 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.232 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.232 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6823", 2020-05-18T21:33:14.232 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:33:14.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.233 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.233 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6825", 2020-05-18T21:33:14.233 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:33:14.233 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.234 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.234 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:33:14.234 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.235 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.235 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6826", 2020-05-18T21:33:14.235 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:33:14.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.236 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.236 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6827", 2020-05-18T21:33:14.236 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:33:14.236 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.237 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.237 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:33:14.237 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.238 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.238 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6830", 2020-05-18T21:33:14.238 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:33:14.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.239 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.239 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6831", 2020-05-18T21:33:14.239 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:33:14.240 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.240 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.241 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:33:14.241 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:14.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.241 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:14.242 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6828", 2020-05-18T21:33:14.242 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:33:14.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.242 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:14.243 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6829", 2020-05-18T21:33:14.243 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:33:14.243 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.243 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.244 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6825/13026", 2020-05-18T21:33:14.244 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6827/13026", 2020-05-18T21:33:14.244 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6831/13026", 2020-05-18T21:33:14.244 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6829/13026", 2020-05-18T21:33:14.245 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:33:14.245 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:33:14.245 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:33:14.245 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:14.246 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.246 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:33:14.246 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2020-05-18T21:33:14.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.247 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:33:14.247 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:33:14.247 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:33:14.247 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:33:14.248 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:33:14.248 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:33:14.248 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.281434+0000", 2020-05-18T21:33:14.248 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:33:14.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.249 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:33:14.249 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:33:14.249 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:33:14.250 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:33:14.250 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:33:14.250 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:33:14.250 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.608518+0000", 2020-05-18T21:33:14.250 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:33:14.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.251 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:33:14.251 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:33:14.251 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:33:14.251 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:33:14.252 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:33:14.252 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:33:14.252 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.582386+0000", 2020-05-18T21:33:14.252 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:33:14.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.253 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:33:14.253 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:33:14.253 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:33:14.253 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:33:14.254 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:33:14.254 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:33:14.254 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.573488+0000", 2020-05-18T21:33:14.254 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:33:14.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.255 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:33:14.255 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:33:14.255 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:33:14.256 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:33:14.256 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:33:14.256 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:33:14.256 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.604174+0000", 2020-05-18T21:33:14.256 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:33:14.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.257 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:33:14.257 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:33:14.258 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:33:14.258 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:33:14.258 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:33:14.259 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:33:14.259 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.371004+0000", 2020-05-18T21:33:14.259 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:33:14.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.260 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:33:14.260 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:33:14.261 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:33:14.261 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:33:14.261 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:33:14.261 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:33:14.261 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.593070+0000", 2020-05-18T21:33:14.262 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:33:14.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:14.262 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:33:14.262 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:33:14.263 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:33:14.263 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:33:14.263 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:33:14.263 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:33:14.263 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.667677+0000", 2020-05-18T21:33:14.264 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:33:14.264 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.264 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:33:14.264 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2020-05-18T21:33:14.265 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2020-05-18T21:33:14.265 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2020-05-18T21:33:14.265 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2020-05-18T21:33:14.265 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklist": {}, 2020-05-18T21:33:14.265 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2020-05-18T21:33:14.266 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2020-05-18T21:33:14.266 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2020-05-18T21:33:14.266 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2020-05-18T21:33:14.266 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2020-05-18T21:33:14.266 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2020-05-18T21:33:14.267 INFO:teuthology.orchestra.run.smithi063.stdout: "ruleset-failure-domain": "osd", 2020-05-18T21:33:14.267 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2020-05-18T21:33:14.267 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:14.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:14.267 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2020-05-18T21:33:14.267 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2020-05-18T21:33:14.268 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2020-05-18T21:33:14.268 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2020-05-18T21:33:14.268 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {} 2020-05-18T21:33:14.268 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:14.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.040+0000 7f1cce295700 1 -- 172.21.15.63:0/4048020893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1ca804f9e0 msgr2=0x7f1ca8051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:14.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.040+0000 7f1cce295700 1 --2- 172.21.15.63:0/4048020893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1ca804f9e0 0x7f1ca8051ea0 secure :-1 s=READY pgs=526 cs=0 l=1 rx=0x7f1cc80af100 tx=0x7f1cb8001cb0).stop 2020-05-18T21:33:14.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.040+0000 7f1cce295700 1 -- 172.21.15.63:0/4048020893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc80b2860 msgr2=0x7f1cc8069eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:14.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.040+0000 7f1cce295700 1 --2- 172.21.15.63:0/4048020893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc80b2860 0x7f1cc8069eb0 secure :-1 s=READY pgs=1336 cs=0 l=1 rx=0x7f1cbc0030b0 tx=0x7f1cbc010ce0).stop 2020-05-18T21:33:14.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.044+0000 7f1cce295700 1 -- 172.21.15.63:0/4048020893 shutdown_connections 2020-05-18T21:33:14.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.044+0000 7f1cce295700 1 --2- 172.21.15.63:0/4048020893 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1ca804f9e0 0x7f1ca8051ea0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:14.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.044+0000 7f1cce295700 1 --2- 172.21.15.63:0/4048020893 >> v2:172.21.15.155:3300/0 conn(0x7f1cc814e570 0x7f1cc80af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:14.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.044+0000 7f1cce295700 1 --2- 172.21.15.63:0/4048020893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc80b2860 0x7f1cc8069eb0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:14.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.044+0000 7f1cce295700 1 -- 172.21.15.63:0/4048020893 >> 172.21.15.63:0/4048020893 conn(0x7f1cc80b83d0 msgr2=0x7f1cc8147720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:14.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.044+0000 7f1cce295700 1 -- 172.21.15.63:0/4048020893 shutdown_connections 2020-05-18T21:33:14.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.044+0000 7f1cce295700 1 -- 172.21.15.63:0/4048020893 wait complete. 2020-05-18T21:33:14.274 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:14.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff29cfac700 1 Processor -- start 2020-05-18T21:33:14.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff29cfac700 1 -- start start 2020-05-18T21:33:14.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff29cfac700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff2980b93f0 0x7ff298145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:14.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff29cfac700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff2980b7ca0 0x7ff298142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:14.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff29cfac700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2981432f0 0x7ff298060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:14.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff29cfac700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2980b7020 con 0x7ff2980b93f0 2020-05-18T21:33:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff29cfac700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2980b72c0 con 0x7ff2980b7ca0 2020-05-18T21:33:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff29cfac700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980b7560 con 0x7ff2981432f0 2020-05-18T21:33:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff2977fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff2980b93f0 0x7ff298145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff2977fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff2980b93f0 0x7ff298145df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60024/0 (socket says 172.21.15.63:60024) 2020-05-18T21:33:14.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff2977fe700 1 -- 172.21.15.63:0/1234532682 learned_addr learned my addr 172.21.15.63:0/1234532682 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:14.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff297fff700 1 --2- 172.21.15.63:0/1234532682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2981432f0 0x7ff298060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:14.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff28effd700 1 --2- 172.21.15.63:0/1234532682 >> v2:172.21.15.155:3300/0 conn(0x7ff2980b7ca0 0x7ff298142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:14.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff2977fe700 1 -- 172.21.15.63:0/1234532682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2981432f0 msgr2=0x7ff298060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff2977fe700 1 --2- 172.21.15.63:0/1234532682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2981432f0 0x7ff298060430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff2977fe700 1 -- 172.21.15.63:0/1234532682 >> v2:172.21.15.155:3300/0 conn(0x7ff2980b7ca0 msgr2=0x7ff298142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff2977fe700 1 --2- 172.21.15.63:0/1234532682 >> v2:172.21.15.155:3300/0 conn(0x7ff2980b7ca0 0x7ff298142e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff2977fe700 1 -- 172.21.15.63:0/1234532682 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2980b7800 con 0x7ff2980b93f0 2020-05-18T21:33:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff2977fe700 1 --2- 172.21.15.63:0/1234532682 >> v2:172.21.15.63:3300/0 conn(0x7ff2980b93f0 0x7ff298145df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff288002f70 tx=0x7ff288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff2977fe700 1 --2- 172.21.15.63:0/1234532682 >> v2:172.21.15.63:3300/0 conn(0x7ff2980b93f0 0x7ff298145df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff288002f70 tx=0x7ff288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff2977fe700 1 --2- 172.21.15.63:0/1234532682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2980b93f0 0x7ff298145df0 secure :-1 s=READY pgs=1337 cs=0 l=1 rx=0x7ff288002f70 tx=0x7ff288007a80).ready entity=mon.0 client_cookie=e3f9813d93459042 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:14.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff2977fe700 1 --2- 172.21.15.63:0/1234532682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2980b93f0 0x7ff298145df0 secure :-1 s=THROTTLE_DONE pgs=1337 cs=0 l=1 rx=0x7ff288002f70 tx=0x7ff288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff2977fe700 1 --2- 172.21.15.63:0/1234532682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2980b93f0 0x7ff298145df0 secure :-1 s=THROTTLE_DONE pgs=1337 cs=0 l=1 rx=0x7ff288002f70 tx=0x7ff288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff296ffd700 1 -- 172.21.15.63:0/1234532682 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff288011760 con 0x7ff2980b93f0 2020-05-18T21:33:14.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff2977fe700 1 --2- 172.21.15.63:0/1234532682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2980b93f0 0x7ff298145df0 secure :-1 s=THROTTLE_DONE pgs=1337 cs=0 l=1 rx=0x7ff288002f70 tx=0x7ff288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff296ffd700 1 -- 172.21.15.63:0/1234532682 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2880118c0 con 0x7ff2980b93f0 2020-05-18T21:33:14.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff296ffd700 1 -- 172.21.15.63:0/1234532682 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff288011ce0 con 0x7ff2980b93f0 2020-05-18T21:33:14.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff29cfac700 1 -- 172.21.15.63:0/1234532682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2980b93f0 msgr2=0x7ff298145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:14.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff29cfac700 1 --2- 172.21.15.63:0/1234532682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2980b93f0 0x7ff298145df0 secure :-1 s=READY pgs=1337 cs=0 l=1 rx=0x7ff288002f70 tx=0x7ff288007a80).stop 2020-05-18T21:33:14.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff29cfac700 1 -- 172.21.15.63:0/1234532682 shutdown_connections 2020-05-18T21:33:14.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff29cfac700 1 --2- 172.21.15.63:0/1234532682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2981432f0 0x7ff298060430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:14.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff29cfac700 1 --2- 172.21.15.63:0/1234532682 >> v2:172.21.15.155:3300/0 conn(0x7ff2980b7ca0 0x7ff298142e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:14.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff29cfac700 1 --2- 172.21.15.63:0/1234532682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2980b93f0 0x7ff298145df0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff29cfac700 1 -- 172.21.15.63:0/1234532682 >> 172.21.15.63:0/1234532682 conn(0x7ff298069b70 msgr2=0x7ff298069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff29cfac700 1 -- 172.21.15.63:0/1234532682 shutdown_connections 2020-05-18T21:33:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.384+0000 7ff29cfac700 1 -- 172.21.15.63:0/1234532682 wait complete. 2020-05-18T21:33:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff29cfac700 1 Processor -- start 2020-05-18T21:33:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff29cfac700 1 -- start start 2020-05-18T21:33:14.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff29cfac700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b93f0 0x7ff2980ad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:14.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff29cfac700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff298145df0 con 0x7ff2981432f0 2020-05-18T21:33:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff29cfac700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff298146090 con 0x7ff2980b7ca0 2020-05-18T21:33:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff29cfac700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff298146330 con 0x7ff2980b93f0 2020-05-18T21:33:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff297fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff2981432f0 0x7ff298155ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33990/0 (socket says 172.21.15.63:33990) 2020-05-18T21:33:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff297fff700 1 -- 172.21.15.63:0/878914738 learned_addr learned my addr 172.21.15.63:0/878914738 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff28effd700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b93f0 0x7ff2980ad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:14.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff2957fa700 1 -- 172.21.15.63:0/878914738 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769789727 0 0) 0x7ff298145df0 con 0x7ff2981432f0 2020-05-18T21:33:14.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff2957fa700 1 -- 172.21.15.63:0/878914738 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff27c002fe0 con 0x7ff2981432f0 2020-05-18T21:33:14.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff2957fa700 1 -- 172.21.15.63:0/878914738 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 133007700 0 0) 0x7ff298146090 con 0x7ff2980b7ca0 2020-05-18T21:33:14.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff2957fa700 1 -- 172.21.15.63:0/878914738 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff298145df0 con 0x7ff2980b7ca0 2020-05-18T21:33:14.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff2957fa700 1 -- 172.21.15.63:0/878914738 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1680288409 0 0) 0x7ff27c002fe0 con 0x7ff2981432f0 2020-05-18T21:33:14.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff2957fa700 1 -- 172.21.15.63:0/878914738 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff298146090 con 0x7ff2981432f0 2020-05-18T21:33:14.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff2957fa700 1 -- 172.21.15.63:0/878914738 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7ff290001910 con 0x7ff2981432f0 2020-05-18T21:33:14.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff28effd700 1 -- 172.21.15.63:0/878914738 >> v1:172.21.15.155:6789/0 conn(0x7ff2980b7ca0 legacy=0x7ff298153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff28effd700 1 -- 172.21.15.63:0/878914738 >> v1:172.21.15.63:6789/0 conn(0x7ff2981432f0 legacy=0x7ff298155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff28effd700 1 -- 172.21.15.63:0/878914738 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff298147f10 con 0x7ff2980b93f0 2020-05-18T21:33:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff28effd700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b93f0 0x7ff2980ad5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff280002f70 tx=0x7ff280010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff28effd700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b93f0 0x7ff2980ad5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff280002f70 tx=0x7ff280010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff28effd700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b93f0 0x7ff2980ad5d0 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7ff280002f70 tx=0x7ff280010b60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:14.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff28effd700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b93f0 0x7ff2980ad5d0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ff280002f70 tx=0x7ff280010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff2957fa700 1 -- 172.21.15.63:0/878914738 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff280007560 con 0x7ff2980b93f0 2020-05-18T21:33:14.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff29cfac700 1 -- 172.21.15.63:0/878914738 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff298145a70 con 0x7ff2980b93f0 2020-05-18T21:33:14.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff28effd700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b93f0 0x7ff2980ad5d0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ff280002f70 tx=0x7ff280010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff29cfac700 1 -- 172.21.15.63:0/878914738 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2981568a0 con 0x7ff2980b93f0 2020-05-18T21:33:14.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff28effd700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b93f0 0x7ff2980ad5d0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ff280002f70 tx=0x7ff280010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff2957fa700 1 -- 172.21.15.63:0/878914738 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2800058e0 con 0x7ff2980b93f0 2020-05-18T21:33:14.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff2957fa700 1 -- 172.21.15.63:0/878914738 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff280005c40 con 0x7ff2980b93f0 2020-05-18T21:33:14.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.388+0000 7ff28effd700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b93f0 0x7ff2980ad5d0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ff280002f70 tx=0x7ff280010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.392+0000 7ff29cfac700 1 -- 172.21.15.63:0/878914738 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2980569e0 con 0x7ff2980b93f0 2020-05-18T21:33:14.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.392+0000 7ff28effd700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b93f0 0x7ff2980ad5d0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ff280002f70 tx=0x7ff280010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.392+0000 7ff2957fa700 1 -- 172.21.15.63:0/878914738 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff28000e240 con 0x7ff2980b93f0 2020-05-18T21:33:14.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.392+0000 7ff2957fa700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff27c050130 0x7ff27c0525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:14.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.392+0000 7ff2957fa700 1 -- 172.21.15.63:0/878914738 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff2800639d0 con 0x7ff2980b93f0 2020-05-18T21:33:14.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.392+0000 7ff2977fe700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff27c050130 0x7ff27c0525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:14.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.392+0000 7ff2977fe700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff27c050130 0x7ff27c0525f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff288007f10 tx=0x7ff288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.392+0000 7ff2977fe700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff27c050130 0x7ff27c0525f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff288007f10 tx=0x7ff288007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.392+0000 7ff2977fe700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff27c050130 0x7ff27c0525f0 secure :-1 s=READY pgs=527 cs=0 l=1 rx=0x7ff288007f10 tx=0x7ff288007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:14.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.400+0000 7ff28effd700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b93f0 0x7ff2980ad5d0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ff280002f70 tx=0x7ff280010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.400+0000 7ff2957fa700 1 -- 172.21.15.63:0/878914738 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff28003dd20 con 0x7ff2980b93f0 2020-05-18T21:33:14.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.548+0000 7ff29cfac700 1 -- 172.21.15.63:0/878914738 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff298145c00 con 0x7ff2980b93f0 2020-05-18T21:33:14.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.548+0000 7ff28effd700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b93f0 0x7ff2980ad5d0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ff280002f70 tx=0x7ff280010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.548+0000 7ff2957fa700 1 -- 172.21.15.63:0/878914738 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+2140 (secure 0 0 0) 0x7ff280041340 con 0x7ff2980b93f0 2020-05-18T21:33:14.556 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:14.556 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":75,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2619292063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2619292063},{"type":"v1","addr":"172.21.15.155:6835","nonce":2619292063}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:32:53.188564+0000","modified":"2020-05-18T21:32:54.910500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7842},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7842":{"gid":7842,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/468101601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":468101601},{"type":"v1","addr":"172.21.15.63:6833","nonce":468101601}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-05-18T21:33:14.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.552+0000 7ff29cfac700 1 -- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff27c050130 msgr2=0x7ff27c0525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:14.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.552+0000 7ff29cfac700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff27c050130 0x7ff27c0525f0 secure :-1 s=READY pgs=527 cs=0 l=1 rx=0x7ff288007f10 tx=0x7ff288007a80).stop 2020-05-18T21:33:14.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.552+0000 7ff29cfac700 1 -- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b93f0 msgr2=0x7ff2980ad5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:14.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.552+0000 7ff29cfac700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b93f0 0x7ff2980ad5d0 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7ff280002f70 tx=0x7ff280010b60).stop 2020-05-18T21:33:14.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.552+0000 7ff29cfac700 1 -- 172.21.15.63:0/878914738 shutdown_connections 2020-05-18T21:33:14.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.552+0000 7ff29cfac700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff27c050130 0x7ff27c0525f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:14.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.552+0000 7ff29cfac700 1 --2- 172.21.15.63:0/878914738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b93f0 0x7ff2980ad5d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:14.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.552+0000 7ff29cfac700 1 -- 172.21.15.63:0/878914738 >> 172.21.15.63:0/878914738 conn(0x7ff298069b70 msgr2=0x7ff29805c310 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:14.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.552+0000 7ff29cfac700 1 -- 172.21.15.63:0/878914738 shutdown_connections 2020-05-18T21:33:14.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.552+0000 7ff29cfac700 1 -- 172.21.15.63:0/878914738 wait complete. 2020-05-18T21:33:14.560 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 75 2020-05-18T21:33:14.569 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-05-18T21:33:14.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb05a2ec700 1 Processor -- start 2020-05-18T21:33:14.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb05a2ec700 1 -- start start 2020-05-18T21:33:14.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb05a2ec700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb0540b6c00 0x7fb0541466b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:14.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb05a2ec700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0540b0520 con 0x7fb0540b4370 2020-05-18T21:33:14.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb05a2ec700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0540b48f0 con 0x7fb054142ca0 2020-05-18T21:33:14.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb05a2ec700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0540b4b90 con 0x7fb0540b6c00 2020-05-18T21:33:14.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb053fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb0540b6c00 0x7fb0541466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:14.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb0537fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb0540b4370 0x7fb054142590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33996/0 (socket says 172.21.15.63:33996) 2020-05-18T21:33:14.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb0537fe700 1 -- 172.21.15.63:0/3682340061 learned_addr learned my addr 172.21.15.63:0/3682340061 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:14.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb052ffd700 1 -- 172.21.15.63:0/3682340061 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545620128 0 0) 0x7fb0540b0520 con 0x7fb0540b4370 2020-05-18T21:33:14.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb052ffd700 1 -- 172.21.15.63:0/3682340061 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb040003270 con 0x7fb0540b4370 2020-05-18T21:33:14.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb053fff700 1 -- 172.21.15.63:0/3682340061 >> v1:172.21.15.155:6789/0 conn(0x7fb054142ca0 legacy=0x7fb0540b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:14.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb052ffd700 1 -- 172.21.15.63:0/3682340061 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1132038001 0 0) 0x7fb0540b48f0 con 0x7fb054142ca0 2020-05-18T21:33:14.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb053fff700 1 -- 172.21.15.63:0/3682340061 >> v1:172.21.15.63:6789/0 conn(0x7fb0540b4370 legacy=0x7fb054142590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:14.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb053fff700 1 -- 172.21.15.63:0/3682340061 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0540b4e30 con 0x7fb0540b6c00 2020-05-18T21:33:14.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb053fff700 1 --2- 172.21.15.63:0/3682340061 >> v2:172.21.15.63:3300/0 conn(0x7fb0540b6c00 0x7fb0541466b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb044002f70 tx=0x7fb044007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb053fff700 1 --2- 172.21.15.63:0/3682340061 >> v2:172.21.15.63:3300/0 conn(0x7fb0540b6c00 0x7fb0541466b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb044002f70 tx=0x7fb044007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb053fff700 1 --2- 172.21.15.63:0/3682340061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0540b6c00 0x7fb0541466b0 secure :-1 s=READY pgs=1340 cs=0 l=1 rx=0x7fb044002f70 tx=0x7fb044007a80).ready entity=mon.0 client_cookie=6b4923c1707210ba server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:14.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb053fff700 1 --2- 172.21.15.63:0/3682340061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0540b6c00 0x7fb0541466b0 secure :-1 s=THROTTLE_DONE pgs=1340 cs=0 l=1 rx=0x7fb044002f70 tx=0x7fb044007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb052ffd700 1 -- 172.21.15.63:0/3682340061 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb044008e80 con 0x7fb0540b6c00 2020-05-18T21:33:14.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb053fff700 1 --2- 172.21.15.63:0/3682340061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0540b6c00 0x7fb0541466b0 secure :-1 s=THROTTLE_DONE pgs=1340 cs=0 l=1 rx=0x7fb044002f70 tx=0x7fb044007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb053fff700 1 --2- 172.21.15.63:0/3682340061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0540b6c00 0x7fb0541466b0 secure :-1 s=THROTTLE_DONE pgs=1340 cs=0 l=1 rx=0x7fb044002f70 tx=0x7fb044007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb052ffd700 1 -- 172.21.15.63:0/3682340061 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0440115f0 con 0x7fb0540b6c00 2020-05-18T21:33:14.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.684+0000 7fb052ffd700 1 -- 172.21.15.63:0/3682340061 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb044011990 con 0x7fb0540b6c00 2020-05-18T21:33:14.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.688+0000 7fb05a2ec700 1 -- 172.21.15.63:0/3682340061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0540b6c00 msgr2=0x7fb0541466b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:14.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.688+0000 7fb05a2ec700 1 --2- 172.21.15.63:0/3682340061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0540b6c00 0x7fb0541466b0 secure :-1 s=READY pgs=1340 cs=0 l=1 rx=0x7fb044002f70 tx=0x7fb044007a80).stop 2020-05-18T21:33:14.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.688+0000 7fb05a2ec700 1 -- 172.21.15.63:0/3682340061 shutdown_connections 2020-05-18T21:33:14.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.688+0000 7fb05a2ec700 1 --2- 172.21.15.63:0/3682340061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0540b6c00 0x7fb0541466b0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:14.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.688+0000 7fb05a2ec700 1 -- 172.21.15.63:0/3682340061 >> 172.21.15.63:0/3682340061 conn(0x7fb0540ba1e0 msgr2=0x7fb0540b61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:14.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.688+0000 7fb05a2ec700 1 -- 172.21.15.63:0/3682340061 shutdown_connections 2020-05-18T21:33:14.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.688+0000 7fb05a2ec700 1 -- 172.21.15.63:0/3682340061 wait complete. 2020-05-18T21:33:14.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.688+0000 7fb05a2ec700 1 Processor -- start 2020-05-18T21:33:14.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.688+0000 7fb05a2ec700 1 -- start start 2020-05-18T21:33:14.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.688+0000 7fb05a2ec700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb0540b4370 0x7fb054065420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:14.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.688+0000 7fb05a2ec700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0540938b0 con 0x7fb054142ca0 2020-05-18T21:33:14.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.688+0000 7fb05a2ec700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb054093b50 con 0x7fb0540b6c00 2020-05-18T21:33:14.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.688+0000 7fb05a2ec700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb054063550 con 0x7fb0540b4370 2020-05-18T21:33:14.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.688+0000 7fb058889700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb054142ca0 0x7fb05405af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34002/0 (socket says 172.21.15.63:34002) 2020-05-18T21:33:14.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.688+0000 7fb058889700 1 -- 172.21.15.63:0/1910194177 learned_addr learned my addr 172.21.15.63:0/1910194177 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:14.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.688+0000 7fb053fff700 1 --2- 172.21.15.63:0/1910194177 >> v2:172.21.15.155:3300/0 conn(0x7fb0540b4370 0x7fb054065420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:14.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.688+0000 7fb0517fa700 1 -- 172.21.15.63:0/1910194177 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698603582 0 0) 0x7fb0540938b0 con 0x7fb054142ca0 2020-05-18T21:33:14.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.688+0000 7fb0517fa700 1 -- 172.21.15.63:0/1910194177 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb034002fe0 con 0x7fb054142ca0 2020-05-18T21:33:14.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0517fa700 1 -- 172.21.15.63:0/1910194177 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1068433326 0 0) 0x7fb034002fe0 con 0x7fb054142ca0 2020-05-18T21:33:14.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0517fa700 1 -- 172.21.15.63:0/1910194177 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb0540938b0 con 0x7fb054142ca0 2020-05-18T21:33:14.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0517fa700 1 -- 172.21.15.63:0/1910194177 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fb04c001ce0 con 0x7fb054142ca0 2020-05-18T21:33:14.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0517fa700 1 -- 172.21.15.63:0/1910194177 >> v2:172.21.15.155:3300/0 conn(0x7fb0540b4370 msgr2=0x7fb054065420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:14.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0517fa700 1 --2- 172.21.15.63:0/1910194177 >> v2:172.21.15.155:3300/0 conn(0x7fb0540b4370 0x7fb054065420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:14.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0517fa700 1 -- 172.21.15.63:0/1910194177 >> v1:172.21.15.155:6789/0 conn(0x7fb0540b6c00 legacy=0x7fb0541534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:14.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0517fa700 1 -- 172.21.15.63:0/1910194177 >> v1:172.21.15.63:6789/0 conn(0x7fb054142ca0 legacy=0x7fb05405af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:14.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0517fa700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb034004a80 0x7fb034004e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:14.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0517fa700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb034005310 0x7fb034003a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:14.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0517fa700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb034003fc0 0x7fb034004470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:14.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0517fa700 1 -- 172.21.15.63:0/1910194177 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb054063550 con 0x7fb034005310 2020-05-18T21:33:14.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0517fa700 1 -- 172.21.15.63:0/1910194177 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03400b850 con 0x7fb034003fc0 2020-05-18T21:33:14.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0517fa700 1 -- 172.21.15.63:0/1910194177 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03400ba10 con 0x7fb034004a80 2020-05-18T21:33:14.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0537fe700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb034005310 0x7fb034003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:14.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb053fff700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb034004a80 0x7fb034004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:14.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb058889700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb034003fc0 0x7fb034004470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:14.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0537fe700 1 -- 172.21.15.63:0/1910194177 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb034004a80 msgr2=0x7fb034004e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:14.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0537fe700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb034004a80 0x7fb034004e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:14.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0537fe700 1 -- 172.21.15.63:0/1910194177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb034003fc0 msgr2=0x7fb034004470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:14.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0537fe700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb034003fc0 0x7fb034004470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:14.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0537fe700 1 -- 172.21.15.63:0/1910194177 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05405b670 con 0x7fb034005310 2020-05-18T21:33:14.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb058889700 1 -- 172.21.15.63:0/1910194177 reap_dead start 2020-05-18T21:33:14.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb05a2ec700 1 -- 172.21.15.63:0/1910194177 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0541462b0 con 0x7fb034005310 2020-05-18T21:33:14.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0537fe700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb034005310 0x7fb034003a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb0480011d0 tx=0x7fb04800c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb05a2ec700 1 -- 172.21.15.63:0/1910194177 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb054063b90 con 0x7fb034005310 2020-05-18T21:33:14.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0537fe700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb034005310 0x7fb034003a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb0480011d0 tx=0x7fb04800c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0537fe700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb034005310 0x7fb034003a20 secure :-1 s=READY pgs=1342 cs=0 l=1 rx=0x7fb0480011d0 tx=0x7fb04800c600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:14.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0537fe700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb034005310 0x7fb034003a20 secure :-1 s=THROTTLE_DONE pgs=1342 cs=0 l=1 rx=0x7fb0480011d0 tx=0x7fb04800c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0517fa700 1 -- 172.21.15.63:0/1910194177 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb048010570 con 0x7fb034005310 2020-05-18T21:33:14.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0537fe700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb034005310 0x7fb034003a20 secure :-1 s=THROTTLE_DONE pgs=1342 cs=0 l=1 rx=0x7fb0480011d0 tx=0x7fb04800c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0517fa700 1 -- 172.21.15.63:0/1910194177 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04800c660 con 0x7fb034005310 2020-05-18T21:33:14.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0537fe700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb034005310 0x7fb034003a20 secure :-1 s=THROTTLE_DONE pgs=1342 cs=0 l=1 rx=0x7fb0480011d0 tx=0x7fb04800c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0517fa700 1 -- 172.21.15.63:0/1910194177 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb04800ca40 con 0x7fb034005310 2020-05-18T21:33:14.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb05a2ec700 1 -- 172.21.15.63:0/1910194177 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb030003380 con 0x7fb034005310 2020-05-18T21:33:14.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0537fe700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb034005310 0x7fb034003a20 secure :-1 s=THROTTLE_DONE pgs=1342 cs=0 l=1 rx=0x7fb0480011d0 tx=0x7fb04800c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0517fa700 1 -- 172.21.15.63:0/1910194177 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb04800cba0 con 0x7fb034005310 2020-05-18T21:33:14.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.692+0000 7fb0537fe700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb034005310 0x7fb034003a20 secure :-1 s=THROTTLE_DONE pgs=1342 cs=0 l=1 rx=0x7fb0480011d0 tx=0x7fb04800c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.696+0000 7fb0517fa700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0340537b0 0x7fb034055c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:14.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.696+0000 7fb0517fa700 1 -- 172.21.15.63:0/1910194177 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb048063830 con 0x7fb034005310 2020-05-18T21:33:14.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.696+0000 7fb053fff700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0340537b0 0x7fb034055c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:14.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.696+0000 7fb053fff700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0340537b0 0x7fb034055c70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb044002f70 tx=0x7fb044007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.696+0000 7fb053fff700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0340537b0 0x7fb034055c70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb044002f70 tx=0x7fb044007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.696+0000 7fb053fff700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0340537b0 0x7fb034055c70 secure :-1 s=READY pgs=528 cs=0 l=1 rx=0x7fb044002f70 tx=0x7fb044007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:14.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.700+0000 7fb0537fe700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb034005310 0x7fb034003a20 secure :-1 s=THROTTLE_DONE pgs=1342 cs=0 l=1 rx=0x7fb0480011d0 tx=0x7fb04800c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:14.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.700+0000 7fb0517fa700 1 -- 172.21.15.63:0/1910194177 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb04803dc20 con 0x7fb034005310 2020-05-18T21:33:14.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:14.852+0000 7fb05a2ec700 1 -- 172.21.15.63:0/1910194177 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb030002210 con 0x7fb034005310 2020-05-18T21:33:15.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.688+0000 7fb0537fe700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb034005310 0x7fb034003a20 secure :-1 s=READY pgs=1342 cs=0 l=1 rx=0x7fb0480011d0 tx=0x7fb04800c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:15.724 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:33:15.720+0000 7fdb4592c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:33:15.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.736+0000 7fb0537fe700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb034005310 0x7fb034003a20 secure :-1 s=THROTTLE_DONE pgs=1342 cs=0 l=1 rx=0x7fb0480011d0 tx=0x7fb04800c600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:15.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.736+0000 7fb0517fa700 1 -- 172.21.15.63:0/1910194177 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v76) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb048041240 con 0x7fb034005310 2020-05-18T21:33:15.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.740+0000 7fb05a2ec700 1 -- 172.21.15.63:0/1910194177 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0340537b0 msgr2=0x7fb034055c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:15.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.740+0000 7fb05a2ec700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0340537b0 0x7fb034055c70 secure :-1 s=READY pgs=528 cs=0 l=1 rx=0x7fb044002f70 tx=0x7fb044007a80).stop 2020-05-18T21:33:15.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.740+0000 7fb05a2ec700 1 -- 172.21.15.63:0/1910194177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb034005310 msgr2=0x7fb034003a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:15.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.740+0000 7fb05a2ec700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb034005310 0x7fb034003a20 secure :-1 s=READY pgs=1342 cs=0 l=1 rx=0x7fb0480011d0 tx=0x7fb04800c600).stop 2020-05-18T21:33:15.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.740+0000 7fb05a2ec700 1 -- 172.21.15.63:0/1910194177 shutdown_connections 2020-05-18T21:33:15.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.740+0000 7fb05a2ec700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0340537b0 0x7fb034055c70 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:15.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.740+0000 7fb05a2ec700 1 --2- 172.21.15.63:0/1910194177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb034005310 0x7fb034003a20 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:15.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.740+0000 7fb05a2ec700 1 -- 172.21.15.63:0/1910194177 >> 172.21.15.63:0/1910194177 conn(0x7fb0540ba1e0 msgr2=0x7fb054142490 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:15.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.740+0000 7fb05a2ec700 1 -- 172.21.15.63:0/1910194177 shutdown_connections 2020-05-18T21:33:15.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.740+0000 7fb05a2ec700 1 -- 172.21.15.63:0/1910194177 wait complete. 2020-05-18T21:33:15.748 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-05-18T21:33:15.762 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:15.770 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:33:15.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.852+0000 7f5977c1d700 1 Processor -- start 2020-05-18T21:33:15.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.852+0000 7f5977c1d700 1 -- start start 2020-05-18T21:33:15.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.852+0000 7f5977c1d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5970060b90 0x7f59700615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:15.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.852+0000 7f5977c1d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59700b2860 0x7f597014e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:15.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.852+0000 7f5977c1d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597014d960 con 0x7f5970144090 2020-05-18T21:33:15.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.852+0000 7f5977c1d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5970066210 con 0x7f5970060b90 2020-05-18T21:33:15.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.852+0000 7f5977c1d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597014db90 con 0x7f59700b2860 2020-05-18T21:33:15.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f59759b9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5970060b90 0x7f59700615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:15.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f59759b9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5970060b90 0x7f59700615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:46686/0 (socket says 172.21.15.63:46686) 2020-05-18T21:33:15.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f59751b8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59700b2860 0x7f597014e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:15.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f59759b9700 1 -- 172.21.15.63:0/3344374967 learned_addr learned my addr 172.21.15.63:0/3344374967 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:15.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f59759b9700 1 -- 172.21.15.63:0/3344374967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59700b2860 msgr2=0x7f597014e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:15.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f59759b9700 1 --2- 172.21.15.63:0/3344374967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59700b2860 0x7f597014e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:15.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f59759b9700 1 -- 172.21.15.63:0/3344374967 >> v1:172.21.15.155:6789/0 conn(0x7f5970144090 legacy=0x7f597014a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:15.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f59759b9700 1 -- 172.21.15.63:0/3344374967 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597014de30 con 0x7f5970060b90 2020-05-18T21:33:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f59751b8700 1 --2- 172.21.15.63:0/3344374967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59700b2860 0x7f597014e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f59759b9700 1 --2- 172.21.15.63:0/3344374967 >> v2:172.21.15.155:3300/0 conn(0x7f5970060b90 0x7f59700615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f59600032f0 tx=0x7f5960007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f59759b9700 1 --2- 172.21.15.63:0/3344374967 >> v2:172.21.15.155:3300/0 conn(0x7f5970060b90 0x7f59700615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f59600032f0 tx=0x7f5960007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f59759b9700 1 --2- 172.21.15.63:0/3344374967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5970060b90 0x7f59700615e0 secure :-1 s=READY pgs=913 cs=0 l=1 rx=0x7f59600032f0 tx=0x7f5960007e00).ready entity=mon.1 client_cookie=4f165c02cd8d7997 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f59759b9700 1 --2- 172.21.15.63:0/3344374967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5970060b90 0x7f59700615e0 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f59600032f0 tx=0x7f5960007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f59759b9700 1 --2- 172.21.15.63:0/3344374967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5970060b90 0x7f59700615e0 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f59600032f0 tx=0x7f5960007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f59749b7700 1 -- 172.21.15.63:0/3344374967 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5960011d10 con 0x7f5970060b90 2020-05-18T21:33:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f59759b9700 1 --2- 172.21.15.63:0/3344374967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5970060b90 0x7f59700615e0 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f59600032f0 tx=0x7f5960007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f59749b7700 1 -- 172.21.15.63:0/3344374967 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5960011e70 con 0x7f5970060b90 2020-05-18T21:33:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f59749b7700 1 -- 172.21.15.63:0/3344374967 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f596000a370 con 0x7f5970060b90 2020-05-18T21:33:15.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f5977c1d700 1 -- 172.21.15.63:0/3344374967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5970060b90 msgr2=0x7f59700615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:15.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f5977c1d700 1 --2- 172.21.15.63:0/3344374967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5970060b90 0x7f59700615e0 secure :-1 s=READY pgs=913 cs=0 l=1 rx=0x7f59600032f0 tx=0x7f5960007e00).stop 2020-05-18T21:33:15.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f5977c1d700 1 -- 172.21.15.63:0/3344374967 shutdown_connections 2020-05-18T21:33:15.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f5977c1d700 1 --2- 172.21.15.63:0/3344374967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59700b2860 0x7f597014e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:15.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f5977c1d700 1 --2- 172.21.15.63:0/3344374967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5970060b90 0x7f59700615e0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:15.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f5977c1d700 1 -- 172.21.15.63:0/3344374967 >> 172.21.15.63:0/3344374967 conn(0x7f59700b83d0 msgr2=0x7f59700b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:15.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f5977c1d700 1 -- 172.21.15.63:0/3344374967 shutdown_connections 2020-05-18T21:33:15.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.856+0000 7f5977c1d700 1 -- 172.21.15.63:0/3344374967 wait complete. 2020-05-18T21:33:15.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.860+0000 7f5977c1d700 1 Processor -- start 2020-05-18T21:33:15.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.860+0000 7f5977c1d700 1 -- start start 2020-05-18T21:33:15.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.860+0000 7f5977c1d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5970060b90 0x7f5970145d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:15.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.860+0000 7f5977c1d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f59700b2860 0x7f59701473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:15.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.860+0000 7f5977c1d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597015b6a0 con 0x7f5970144090 2020-05-18T21:33:15.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.860+0000 7f5977c1d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59700ad100 con 0x7f59700b2860 2020-05-18T21:33:15.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.860+0000 7f5977c1d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59701454d0 con 0x7f5970060b90 2020-05-18T21:33:15.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.860+0000 7f59751b8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f59700b2860 0x7f59701473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:15.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.860+0000 7f59751b8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f59700b2860 0x7f59701473f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60078/0 (socket says 172.21.15.63:60078) 2020-05-18T21:33:15.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.860+0000 7f59759b9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5970060b90 0x7f5970145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:15.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.860+0000 7f59751b8700 1 -- 172.21.15.63:0/3132356870 learned_addr learned my addr 172.21.15.63:0/3132356870 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:15.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.860+0000 7f59751b8700 1 -- 172.21.15.63:0/3132356870 >> v2:172.21.15.155:3300/0 conn(0x7f5970060b90 msgr2=0x7f5970145d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:15.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.860+0000 7f59751b8700 1 --2- 172.21.15.63:0/3132356870 >> v2:172.21.15.155:3300/0 conn(0x7f5970060b90 0x7f5970145d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:15.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.860+0000 7f59751b8700 1 -- 172.21.15.63:0/3132356870 >> v1:172.21.15.155:6789/0 conn(0x7f5970144090 legacy=0x7f59701434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:15.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.860+0000 7f59751b8700 1 -- 172.21.15.63:0/3132356870 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597014aa30 con 0x7f59700b2860 2020-05-18T21:33:15.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.860+0000 7f59751b8700 1 --2- 172.21.15.63:0/3132356870 >> v2:172.21.15.63:3300/0 conn(0x7f59700b2860 0x7f59701473f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5964002f70 tx=0x7f5964010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:15.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.864+0000 7f59751b8700 1 --2- 172.21.15.63:0/3132356870 >> v2:172.21.15.63:3300/0 conn(0x7f59700b2860 0x7f59701473f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5964002f70 tx=0x7f5964010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:15.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.864+0000 7f59751b8700 1 --2- 172.21.15.63:0/3132356870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59700b2860 0x7f59701473f0 secure :-1 s=READY pgs=1345 cs=0 l=1 rx=0x7f5964002f70 tx=0x7f5964010e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:15.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.864+0000 7f59751b8700 1 --2- 172.21.15.63:0/3132356870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59700b2860 0x7f59701473f0 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7f5964002f70 tx=0x7f5964010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:15.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.864+0000 7f59751b8700 1 --2- 172.21.15.63:0/3132356870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59700b2860 0x7f59701473f0 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7f5964002f70 tx=0x7f5964010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:15.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.864+0000 7f596effd700 1 -- 172.21.15.63:0/3132356870 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f596400e370 con 0x7f59700b2860 2020-05-18T21:33:15.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.864+0000 7f59751b8700 1 --2- 172.21.15.63:0/3132356870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59700b2860 0x7f59701473f0 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7f5964002f70 tx=0x7f5964010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:15.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.864+0000 7f596effd700 1 -- 172.21.15.63:0/3132356870 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5964012a20 con 0x7f59700b2860 2020-05-18T21:33:15.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.864+0000 7f5977c1d700 1 -- 172.21.15.63:0/3132356870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597014acd0 con 0x7f59700b2860 2020-05-18T21:33:15.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.864+0000 7f596effd700 1 -- 172.21.15.63:0/3132356870 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5964012e00 con 0x7f59700b2860 2020-05-18T21:33:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.864+0000 7f5977c1d700 1 -- 172.21.15.63:0/3132356870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5970143bd0 con 0x7f59700b2860 2020-05-18T21:33:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.864+0000 7f59751b8700 1 --2- 172.21.15.63:0/3132356870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59700b2860 0x7f59701473f0 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7f5964002f70 tx=0x7f5964010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.864+0000 7f5977c1d700 1 -- 172.21.15.63:0/3132356870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59700569e0 con 0x7f59700b2860 2020-05-18T21:33:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.864+0000 7f596effd700 1 -- 172.21.15.63:0/3132356870 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f59640071a0 con 0x7f59700b2860 2020-05-18T21:33:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.864+0000 7f59751b8700 1 --2- 172.21.15.63:0/3132356870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59700b2860 0x7f59701473f0 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7f5964002f70 tx=0x7f5964010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.864+0000 7f596effd700 1 --2- 172.21.15.63:0/3132356870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f595004fa10 0x7f5950051ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.864+0000 7f596effd700 1 -- 172.21.15.63:0/3132356870 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f5964063b10 con 0x7f59700b2860 2020-05-18T21:33:15.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.864+0000 7f59759b9700 1 --2- 172.21.15.63:0/3132356870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f595004fa10 0x7f5950051ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:15.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.868+0000 7f59759b9700 1 --2- 172.21.15.63:0/3132356870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f595004fa10 0x7f5950051ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59600032f0 tx=0x7f5960007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:15.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.868+0000 7f59759b9700 1 --2- 172.21.15.63:0/3132356870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f595004fa10 0x7f5950051ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59600032f0 tx=0x7f5960007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:15.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.868+0000 7f59759b9700 1 --2- 172.21.15.63:0/3132356870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f595004fa10 0x7f5950051ed0 secure :-1 s=READY pgs=529 cs=0 l=1 rx=0x7f59600032f0 tx=0x7f5960007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:15.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.872+0000 7f59751b8700 1 --2- 172.21.15.63:0/3132356870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59700b2860 0x7f59701473f0 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7f5964002f70 tx=0x7f5964010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:15.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:15.872+0000 7f596effd700 1 -- 172.21.15.63:0/3132356870 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f596403de40 con 0x7f59700b2860 2020-05-18T21:33:16.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.020+0000 7f5977c1d700 1 -- 172.21.15.63:0/3132356870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59700008d0 con 0x7f59700b2860 2020-05-18T21:33:16.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.020+0000 7f59751b8700 1 --2- 172.21.15.63:0/3132356870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59700b2860 0x7f59701473f0 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7f5964002f70 tx=0x7f5964010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:16.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.020+0000 7f596effd700 1 -- 172.21.15.63:0/3132356870 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+1782 (secure 0 0 0) 0x7f5964041460 con 0x7f59700b2860 2020-05-18T21:33:16.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.024+0000 7f5977c1d700 1 -- 172.21.15.63:0/3132356870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f595004fa10 msgr2=0x7f5950051ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:16.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.024+0000 7f5977c1d700 1 --2- 172.21.15.63:0/3132356870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f595004fa10 0x7f5950051ed0 secure :-1 s=READY pgs=529 cs=0 l=1 rx=0x7f59600032f0 tx=0x7f5960007e00).stop 2020-05-18T21:33:16.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.024+0000 7f5977c1d700 1 -- 172.21.15.63:0/3132356870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59700b2860 msgr2=0x7f59701473f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:16.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.024+0000 7f5977c1d700 1 --2- 172.21.15.63:0/3132356870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59700b2860 0x7f59701473f0 secure :-1 s=READY pgs=1345 cs=0 l=1 rx=0x7f5964002f70 tx=0x7f5964010e80).stop 2020-05-18T21:33:16.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.024+0000 7f5977c1d700 1 -- 172.21.15.63:0/3132356870 shutdown_connections 2020-05-18T21:33:16.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.024+0000 7f5977c1d700 1 --2- 172.21.15.63:0/3132356870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f595004fa10 0x7f5950051ed0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:16.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.024+0000 7f5977c1d700 1 --2- 172.21.15.63:0/3132356870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59700b2860 0x7f59701473f0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:16.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.024+0000 7f5977c1d700 1 --2- 172.21.15.63:0/3132356870 >> v2:172.21.15.155:3300/0 conn(0x7f5970060b90 0x7f5970145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:16.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.024+0000 7f5977c1d700 1 -- 172.21.15.63:0/3132356870 >> 172.21.15.63:0/3132356870 conn(0x7f59700b83d0 msgr2=0x7f59700b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:16.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.024+0000 7f5977c1d700 1 -- 172.21.15.63:0/3132356870 shutdown_connections 2020-05-18T21:33:16.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.024+0000 7f5977c1d700 1 -- 172.21.15.63:0/3132356870 wait complete. 2020-05-18T21:33:16.038 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 76 2020-05-18T21:33:16.038 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:16.039 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":76,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2619292063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2619292063},{"type":"v1","addr":"172.21.15.155:6835","nonce":2619292063}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":76,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:32:53.188564+0000","modified":"2020-05-18T21:33:15.724252+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-05-18T21:33:16.040 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-05-18T21:33:16.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b1296a700 1 Processor -- start 2020-05-18T21:33:16.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b1296a700 1 -- start start 2020-05-18T21:33:16.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b1296a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2b0c1440a0 0x7f2b0c061130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:16.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b1296a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c063d90 0x7f2b0c064240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:16.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b1296a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0c063360 con 0x7f2b0c14d690 2020-05-18T21:33:16.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b1296a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0c063600 con 0x7f2b0c1440a0 2020-05-18T21:33:16.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b1296a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c0638a0 con 0x7f2b0c063d90 2020-05-18T21:33:16.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b11167700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2b0c14d690 0x7f2b0c14dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34042/0 (socket says 172.21.15.63:34042) 2020-05-18T21:33:16.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b11968700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2b0c1440a0 0x7f2b0c061130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:16.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b11167700 1 -- 172.21.15.63:0/3283084197 learned_addr learned my addr 172.21.15.63:0/3283084197 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:16.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b12169700 1 --2- 172.21.15.63:0/3283084197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c063d90 0x7f2b0c064240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:16.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b11968700 1 -- 172.21.15.63:0/3283084197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c063d90 msgr2=0x7f2b0c064240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:16.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b11968700 1 --2- 172.21.15.63:0/3283084197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c063d90 0x7f2b0c064240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:16.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b11968700 1 -- 172.21.15.63:0/3283084197 >> v1:172.21.15.63:6789/0 conn(0x7f2b0c14d690 legacy=0x7f2b0c14dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:16.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b10966700 1 -- 172.21.15.63:0/3283084197 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700488318 0 0) 0x7f2b0c063360 con 0x7f2b0c14d690 2020-05-18T21:33:16.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b11968700 1 -- 172.21.15.63:0/3283084197 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c144480 con 0x7f2b0c1440a0 2020-05-18T21:33:16.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b11968700 1 --2- 172.21.15.63:0/3283084197 >> v2:172.21.15.63:3300/0 conn(0x7f2b0c1440a0 0x7f2b0c061130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2af4002f70 tx=0x7f2af4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:16.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b11968700 1 --2- 172.21.15.63:0/3283084197 >> v2:172.21.15.63:3300/0 conn(0x7f2b0c1440a0 0x7f2b0c061130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2af4002f70 tx=0x7f2af4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:16.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b11968700 1 --2- 172.21.15.63:0/3283084197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b0c1440a0 0x7f2b0c061130 secure :-1 s=READY pgs=1347 cs=0 l=1 rx=0x7f2af4002f70 tx=0x7f2af4007a80).ready entity=mon.0 client_cookie=8f39b4f26e48c40e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:16.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b11968700 1 --2- 172.21.15.63:0/3283084197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b0c1440a0 0x7f2b0c061130 secure :-1 s=THROTTLE_DONE pgs=1347 cs=0 l=1 rx=0x7f2af4002f70 tx=0x7f2af4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:16.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b10966700 1 -- 172.21.15.63:0/3283084197 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2af4008d70 con 0x7f2b0c1440a0 2020-05-18T21:33:16.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b11968700 1 --2- 172.21.15.63:0/3283084197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b0c1440a0 0x7f2b0c061130 secure :-1 s=THROTTLE_DONE pgs=1347 cs=0 l=1 rx=0x7f2af4002f70 tx=0x7f2af4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:16.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b10966700 1 -- 172.21.15.63:0/3283084197 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af4011790 con 0x7f2b0c1440a0 2020-05-18T21:33:16.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b11968700 1 --2- 172.21.15.63:0/3283084197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b0c1440a0 0x7f2b0c061130 secure :-1 s=THROTTLE_DONE pgs=1347 cs=0 l=1 rx=0x7f2af4002f70 tx=0x7f2af4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:16.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b10966700 1 -- 172.21.15.63:0/3283084197 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2af4011b70 con 0x7f2b0c1440a0 2020-05-18T21:33:16.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b1296a700 1 -- 172.21.15.63:0/3283084197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b0c1440a0 msgr2=0x7f2b0c061130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:16.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b1296a700 1 --2- 172.21.15.63:0/3283084197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b0c1440a0 0x7f2b0c061130 secure :-1 s=READY pgs=1347 cs=0 l=1 rx=0x7f2af4002f70 tx=0x7f2af4007a80).stop 2020-05-18T21:33:16.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b1296a700 1 -- 172.21.15.63:0/3283084197 shutdown_connections 2020-05-18T21:33:16.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b1296a700 1 --2- 172.21.15.63:0/3283084197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c063d90 0x7f2b0c064240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:16.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b1296a700 1 --2- 172.21.15.63:0/3283084197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b0c1440a0 0x7f2b0c061130 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:16.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.148+0000 7f2b1296a700 1 -- 172.21.15.63:0/3283084197 >> 172.21.15.63:0/3283084197 conn(0x7f2b0c069b70 msgr2=0x7f2b0c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:16.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.152+0000 7f2b1296a700 1 -- 172.21.15.63:0/3283084197 shutdown_connections 2020-05-18T21:33:16.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.152+0000 7f2b1296a700 1 -- 172.21.15.63:0/3283084197 wait complete. 2020-05-18T21:33:16.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.152+0000 7f2b1296a700 1 Processor -- start 2020-05-18T21:33:16.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.152+0000 7f2b1296a700 1 -- start start 2020-05-18T21:33:16.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b1296a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2b0c1440a0 0x7f2b0c146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:16.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b1296a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c14d690 0x7f2b0c157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:16.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b1296a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0c149ee0 con 0x7f2b0c063d90 2020-05-18T21:33:16.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b1296a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0c146ba0 con 0x7f2b0c1440a0 2020-05-18T21:33:16.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b1296a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c146e40 con 0x7f2b0c14d690 2020-05-18T21:33:16.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b11968700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2b0c063d90 0x7f2b0c0b62e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34046/0 (socket says 172.21.15.63:34046) 2020-05-18T21:33:16.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b11968700 1 -- 172.21.15.63:0/859730205 learned_addr learned my addr 172.21.15.63:0/859730205 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:16.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b11167700 1 --2- 172.21.15.63:0/859730205 >> v2:172.21.15.63:3300/0 conn(0x7f2b0c1440a0 0x7f2b0c146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:16.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b12169700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c14d690 0x7f2b0c157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:16.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b0affd700 1 -- 172.21.15.63:0/859730205 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746555754 0 0) 0x7f2b0c149ee0 con 0x7f2b0c063d90 2020-05-18T21:33:16.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b0affd700 1 -- 172.21.15.63:0/859730205 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2af0002fe0 con 0x7f2b0c063d90 2020-05-18T21:33:16.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b11167700 1 -- 172.21.15.63:0/859730205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c14d690 msgr2=0x7f2b0c157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:16.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b11167700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c14d690 0x7f2b0c157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:16.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b11167700 1 -- 172.21.15.63:0/859730205 >> v1:172.21.15.63:6789/0 conn(0x7f2b0c063d90 legacy=0x7f2b0c0b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:16.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b0affd700 1 -- 172.21.15.63:0/859730205 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2367482728 0 0) 0x7f2af0002fe0 con 0x7f2b0c063d90 2020-05-18T21:33:16.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b11167700 1 -- 172.21.15.63:0/859730205 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c1470e0 con 0x7f2b0c1440a0 2020-05-18T21:33:16.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b11167700 1 --2- 172.21.15.63:0/859730205 >> v2:172.21.15.63:3300/0 conn(0x7f2b0c1440a0 0x7f2b0c146620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2af4011d40 tx=0x7f2afc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:16.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b11167700 1 --2- 172.21.15.63:0/859730205 >> v2:172.21.15.63:3300/0 conn(0x7f2b0c1440a0 0x7f2b0c146620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2af4011d40 tx=0x7f2afc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:16.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b11167700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b0c1440a0 0x7f2b0c146620 secure :-1 s=READY pgs=1349 cs=0 l=1 rx=0x7f2af4011d40 tx=0x7f2afc010cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:16.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b11167700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b0c1440a0 0x7f2b0c146620 secure :-1 s=THROTTLE_DONE pgs=1349 cs=0 l=1 rx=0x7f2af4011d40 tx=0x7f2afc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:16.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b0affd700 1 -- 172.21.15.63:0/859730205 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2af4011ba0 con 0x7f2b0c1440a0 2020-05-18T21:33:16.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b11167700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b0c1440a0 0x7f2b0c146620 secure :-1 s=THROTTLE_DONE pgs=1349 cs=0 l=1 rx=0x7f2af4011d40 tx=0x7f2afc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:16.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b1296a700 1 -- 172.21.15.63:0/859730205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0c157b90 con 0x7f2b0c1440a0 2020-05-18T21:33:16.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b0affd700 1 -- 172.21.15.63:0/859730205 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2afc005e70 con 0x7f2b0c1440a0 2020-05-18T21:33:16.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b11167700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b0c1440a0 0x7f2b0c146620 secure :-1 s=THROTTLE_DONE pgs=1349 cs=0 l=1 rx=0x7f2af4011d40 tx=0x7f2afc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:16.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b0affd700 1 -- 172.21.15.63:0/859730205 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2afc012380 con 0x7f2b0c1440a0 2020-05-18T21:33:16.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b1296a700 1 -- 172.21.15.63:0/859730205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0c157fe0 con 0x7f2b0c1440a0 2020-05-18T21:33:16.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.156+0000 7f2b11167700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b0c1440a0 0x7f2b0c146620 secure :-1 s=THROTTLE_DONE pgs=1349 cs=0 l=1 rx=0x7f2af4011d40 tx=0x7f2afc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:16.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.160+0000 7f2b1296a700 1 -- 172.21.15.63:0/859730205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0c0569e0 con 0x7f2b0c1440a0 2020-05-18T21:33:16.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.160+0000 7f2b0affd700 1 -- 172.21.15.63:0/859730205 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2afc0125c0 con 0x7f2b0c1440a0 2020-05-18T21:33:16.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.160+0000 7f2b11167700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b0c1440a0 0x7f2b0c146620 secure :-1 s=THROTTLE_DONE pgs=1349 cs=0 l=1 rx=0x7f2af4011d40 tx=0x7f2afc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:16.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.160+0000 7f2b0affd700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2af004fd30 0x7f2af00521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:16.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.160+0000 7f2b0affd700 1 -- 172.21.15.63:0/859730205 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f2afc0090c0 con 0x7f2b0c1440a0 2020-05-18T21:33:16.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.160+0000 7f2b11968700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2af004fd30 0x7f2af00521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:16.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.160+0000 7f2b11968700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2af004fd30 0x7f2af00521f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2af4002f10 tx=0x7f2af4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:16.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.160+0000 7f2b11968700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2af004fd30 0x7f2af00521f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2af4002f10 tx=0x7f2af4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:16.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.160+0000 7f2b11968700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2af004fd30 0x7f2af00521f0 secure :-1 s=READY pgs=530 cs=0 l=1 rx=0x7f2af4002f10 tx=0x7f2af4007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:16.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.168+0000 7f2b11167700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b0c1440a0 0x7f2b0c146620 secure :-1 s=THROTTLE_DONE pgs=1349 cs=0 l=1 rx=0x7f2af4011d40 tx=0x7f2afc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:16.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.168+0000 7f2b0affd700 1 -- 172.21.15.63:0/859730205 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2afc03dfc0 con 0x7f2b0c1440a0 2020-05-18T21:33:16.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.312+0000 7f2b1296a700 1 -- 172.21.15.63:0/859730205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2b0c0008d0 con 0x7f2b0c1440a0 2020-05-18T21:33:16.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.864+0000 7f2b11167700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b0c1440a0 0x7f2b0c146620 secure :-1 s=THROTTLE_DONE pgs=1349 cs=0 l=1 rx=0x7f2af4011d40 tx=0x7f2afc010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:16.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.864+0000 7f2b0affd700 1 -- 172.21.15.63:0/859730205 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v77) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2afc0415e0 con 0x7f2b0c1440a0 2020-05-18T21:33:16.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.868+0000 7f2b1296a700 1 -- 172.21.15.63:0/859730205 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2af004fd30 msgr2=0x7f2af00521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:16.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.868+0000 7f2b1296a700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2af004fd30 0x7f2af00521f0 secure :-1 s=READY pgs=530 cs=0 l=1 rx=0x7f2af4002f10 tx=0x7f2af4007a80).stop 2020-05-18T21:33:16.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.868+0000 7f2b1296a700 1 -- 172.21.15.63:0/859730205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b0c1440a0 msgr2=0x7f2b0c146620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:16.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.868+0000 7f2b1296a700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b0c1440a0 0x7f2b0c146620 secure :-1 s=READY pgs=1349 cs=0 l=1 rx=0x7f2af4011d40 tx=0x7f2afc010cb0).stop 2020-05-18T21:33:16.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.868+0000 7f2b1296a700 1 -- 172.21.15.63:0/859730205 shutdown_connections 2020-05-18T21:33:16.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.868+0000 7f2b1296a700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2af004fd30 0x7f2af00521f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:16.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.868+0000 7f2b1296a700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c14d690 0x7f2b0c157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:16.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.868+0000 7f2b1296a700 1 --2- 172.21.15.63:0/859730205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b0c1440a0 0x7f2b0c146620 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:16.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.868+0000 7f2b1296a700 1 -- 172.21.15.63:0/859730205 >> 172.21.15.63:0/859730205 conn(0x7f2b0c069b70 msgr2=0x7f2b0c0626f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:16.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.868+0000 7f2b1296a700 1 -- 172.21.15.63:0/859730205 shutdown_connections 2020-05-18T21:33:16.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:16.868+0000 7f2b1296a700 1 -- 172.21.15.63:0/859730205 wait complete. 2020-05-18T21:33:16.890 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-05-18T21:33:17.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.004+0000 7fc788d36700 1 Processor -- start 2020-05-18T21:33:17.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.004+0000 7fc788d36700 1 -- start start 2020-05-18T21:33:17.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.004+0000 7fc788d36700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc7841469b0 0x7fc784149d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:17.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.004+0000 7fc788d36700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc784145fd0 con 0x7fc7840b68d0 2020-05-18T21:33:17.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.004+0000 7fc788d36700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc784146270 con 0x7fc7840b99d0 2020-05-18T21:33:17.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.004+0000 7fc788d36700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc784146510 con 0x7fc7841469b0 2020-05-18T21:33:17.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.004+0000 7fc7837fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc7840b68d0 0x7fc7840b8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34054/0 (socket says 172.21.15.63:34054) 2020-05-18T21:33:17.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.004+0000 7fc7837fe700 1 -- 172.21.15.63:0/49802654 learned_addr learned my addr 172.21.15.63:0/49802654 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:17.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.008+0000 7fc783fff700 1 --2- 172.21.15.63:0/49802654 >> v2:172.21.15.155:3300/0 conn(0x7fc7841469b0 0x7fc784149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:17.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.008+0000 7fc7827fc700 1 -- 172.21.15.63:0/49802654 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963488354 0 0) 0x7fc784145fd0 con 0x7fc7840b68d0 2020-05-18T21:33:17.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.008+0000 7fc783fff700 1 -- 172.21.15.63:0/49802654 >> v1:172.21.15.155:6789/0 conn(0x7fc7840b99d0 legacy=0x7fc784060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:17.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.008+0000 7fc783fff700 1 -- 172.21.15.63:0/49802654 >> v1:172.21.15.63:6789/0 conn(0x7fc7840b68d0 legacy=0x7fc7840b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:17.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.008+0000 7fc783fff700 1 -- 172.21.15.63:0/49802654 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7840b6cb0 con 0x7fc7841469b0 2020-05-18T21:33:17.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.008+0000 7fc783fff700 1 --2- 172.21.15.63:0/49802654 >> v2:172.21.15.155:3300/0 conn(0x7fc7841469b0 0x7fc784149d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc77c0032f0 tx=0x7fc77c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:17.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.008+0000 7fc783fff700 1 --2- 172.21.15.63:0/49802654 >> v2:172.21.15.155:3300/0 conn(0x7fc7841469b0 0x7fc784149d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc77c0032f0 tx=0x7fc77c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:17.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.008+0000 7fc783fff700 1 --2- 172.21.15.63:0/49802654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7841469b0 0x7fc784149d40 secure :-1 s=READY pgs=916 cs=0 l=1 rx=0x7fc77c0032f0 tx=0x7fc77c007e00).ready entity=mon.1 client_cookie=7d13f40a5da7b314 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:17.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.008+0000 7fc783fff700 1 --2- 172.21.15.63:0/49802654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7841469b0 0x7fc784149d40 secure :-1 s=THROTTLE_DONE pgs=916 cs=0 l=1 rx=0x7fc77c0032f0 tx=0x7fc77c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:17.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.008+0000 7fc7827fc700 1 -- 172.21.15.63:0/49802654 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc77c00a180 con 0x7fc7841469b0 2020-05-18T21:33:17.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.008+0000 7fc783fff700 1 --2- 172.21.15.63:0/49802654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7841469b0 0x7fc784149d40 secure :-1 s=THROTTLE_DONE pgs=916 cs=0 l=1 rx=0x7fc77c0032f0 tx=0x7fc77c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:17.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.008+0000 7fc7827fc700 1 -- 172.21.15.63:0/49802654 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77c00a2e0 con 0x7fc7841469b0 2020-05-18T21:33:17.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.008+0000 7fc783fff700 1 --2- 172.21.15.63:0/49802654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7841469b0 0x7fc784149d40 secure :-1 s=THROTTLE_DONE pgs=916 cs=0 l=1 rx=0x7fc77c0032f0 tx=0x7fc77c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:17.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.008+0000 7fc7827fc700 1 -- 172.21.15.63:0/49802654 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc77c00a700 con 0x7fc7841469b0 2020-05-18T21:33:17.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.008+0000 7fc788d36700 1 -- 172.21.15.63:0/49802654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7841469b0 msgr2=0x7fc784149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:17.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.008+0000 7fc788d36700 1 --2- 172.21.15.63:0/49802654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7841469b0 0x7fc784149d40 secure :-1 s=READY pgs=916 cs=0 l=1 rx=0x7fc77c0032f0 tx=0x7fc77c007e00).stop 2020-05-18T21:33:17.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.012+0000 7fc788d36700 1 -- 172.21.15.63:0/49802654 shutdown_connections 2020-05-18T21:33:17.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.012+0000 7fc788d36700 1 --2- 172.21.15.63:0/49802654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7841469b0 0x7fc784149d40 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:17.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.012+0000 7fc788d36700 1 -- 172.21.15.63:0/49802654 >> 172.21.15.63:0/49802654 conn(0x7fc784069b70 msgr2=0x7fc784069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:17.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.012+0000 7fc788d36700 1 -- 172.21.15.63:0/49802654 shutdown_connections 2020-05-18T21:33:17.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.012+0000 7fc788d36700 1 -- 172.21.15.63:0/49802654 wait complete. 2020-05-18T21:33:17.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.012+0000 7fc788d36700 1 Processor -- start 2020-05-18T21:33:17.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.012+0000 7fc788d36700 1 -- start start 2020-05-18T21:33:17.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc788d36700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc7840b68d0 0x7fc784142270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:17.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc788d36700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc7840b99d0 0x7fc7841483b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:17.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc788d36700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc784148810 con 0x7fc7841469b0 2020-05-18T21:33:17.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc788d36700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc784153220 con 0x7fc7840b68d0 2020-05-18T21:33:17.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc788d36700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7841534c0 con 0x7fc7840b99d0 2020-05-18T21:33:17.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc7837fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc7840b68d0 0x7fc784142270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:17.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc7837fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc7840b68d0 0x7fc784142270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60104/0 (socket says 172.21.15.63:60104) 2020-05-18T21:33:17.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc7837fe700 1 -- 172.21.15.63:0/1430723272 learned_addr learned my addr 172.21.15.63:0/1430723272 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:17.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc782ffd700 1 --2- 172.21.15.63:0/1430723272 >> v2:172.21.15.155:3300/0 conn(0x7fc7840b99d0 0x7fc7841483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:17.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc7837fe700 1 -- 172.21.15.63:0/1430723272 >> v2:172.21.15.155:3300/0 conn(0x7fc7840b99d0 msgr2=0x7fc7841483b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:17.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc7837fe700 1 --2- 172.21.15.63:0/1430723272 >> v2:172.21.15.155:3300/0 conn(0x7fc7840b99d0 0x7fc7841483b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:17.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc7837fe700 1 -- 172.21.15.63:0/1430723272 >> v1:172.21.15.155:6789/0 conn(0x7fc7841469b0 legacy=0x7fc784152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:17.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc7837fe700 1 -- 172.21.15.63:0/1430723272 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc784153760 con 0x7fc7840b68d0 2020-05-18T21:33:17.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc7837fe700 1 --2- 172.21.15.63:0/1430723272 >> v2:172.21.15.63:3300/0 conn(0x7fc7840b68d0 0x7fc784142270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc774000bc0 tx=0x7fc7740109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:17.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc7837fe700 1 --2- 172.21.15.63:0/1430723272 >> v2:172.21.15.63:3300/0 conn(0x7fc7840b68d0 0x7fc784142270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc774000bc0 tx=0x7fc7740109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:17.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc7837fe700 1 --2- 172.21.15.63:0/1430723272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7840b68d0 0x7fc784142270 secure :-1 s=READY pgs=1351 cs=0 l=1 rx=0x7fc774000bc0 tx=0x7fc7740109a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:17.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc7837fe700 1 --2- 172.21.15.63:0/1430723272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7840b68d0 0x7fc784142270 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7fc774000bc0 tx=0x7fc7740109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:17.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc7837fe700 1 --2- 172.21.15.63:0/1430723272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7840b68d0 0x7fc784142270 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7fc774000bc0 tx=0x7fc7740109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:17.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc7837fe700 1 --2- 172.21.15.63:0/1430723272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7840b68d0 0x7fc784142270 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7fc774000bc0 tx=0x7fc7740109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:17.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc780ff9700 1 -- 172.21.15.63:0/1430723272 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc774005ce0 con 0x7fc7840b68d0 2020-05-18T21:33:17.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc780ff9700 1 -- 172.21.15.63:0/1430723272 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc774005e40 con 0x7fc7840b68d0 2020-05-18T21:33:17.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc788d36700 1 -- 172.21.15.63:0/1430723272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc784152e30 con 0x7fc7840b68d0 2020-05-18T21:33:17.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc780ff9700 1 -- 172.21.15.63:0/1430723272 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7740062c0 con 0x7fc7840b68d0 2020-05-18T21:33:17.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc788d36700 1 -- 172.21.15.63:0/1430723272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc784157260 con 0x7fc7840b68d0 2020-05-18T21:33:17.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc7837fe700 1 --2- 172.21.15.63:0/1430723272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7840b68d0 0x7fc784142270 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7fc774000bc0 tx=0x7fc7740109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:17.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.016+0000 7fc788d36700 1 -- 172.21.15.63:0/1430723272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7840569e0 con 0x7fc7840b68d0 2020-05-18T21:33:17.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.020+0000 7fc780ff9700 1 -- 172.21.15.63:0/1430723272 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc774006420 con 0x7fc7840b68d0 2020-05-18T21:33:17.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.020+0000 7fc7837fe700 1 --2- 172.21.15.63:0/1430723272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7840b68d0 0x7fc784142270 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7fc774000bc0 tx=0x7fc7740109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:17.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.020+0000 7fc780ff9700 1 --2- 172.21.15.63:0/1430723272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc76804f9e0 0x7fc768051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:17.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.020+0000 7fc780ff9700 1 -- 172.21.15.63:0/1430723272 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc7740090c0 con 0x7fc7840b68d0 2020-05-18T21:33:17.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.020+0000 7fc782ffd700 1 --2- 172.21.15.63:0/1430723272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc76804f9e0 0x7fc768051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:17.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.020+0000 7fc782ffd700 1 --2- 172.21.15.63:0/1430723272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc76804f9e0 0x7fc768051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc7840b8c90 tx=0x7fc76c003e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:17.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.020+0000 7fc782ffd700 1 --2- 172.21.15.63:0/1430723272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc76804f9e0 0x7fc768051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc7840b8c90 tx=0x7fc76c003e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:17.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.020+0000 7fc782ffd700 1 --2- 172.21.15.63:0/1430723272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc76804f9e0 0x7fc768051ea0 secure :-1 s=READY pgs=531 cs=0 l=1 rx=0x7fc7840b8c90 tx=0x7fc76c003e40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:17.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.024+0000 7fc7837fe700 1 --2- 172.21.15.63:0/1430723272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7840b68d0 0x7fc784142270 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7fc774000bc0 tx=0x7fc7740109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:17.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.024+0000 7fc780ff9700 1 -- 172.21.15.63:0/1430723272 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc77403e200 con 0x7fc7840b68d0 2020-05-18T21:33:17.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.136+0000 7fc788d36700 1 -- 172.21.15.63:0/1430723272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc7840008d0 con 0x7fc7840b68d0 2020-05-18T21:33:17.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.876+0000 7fc7837fe700 1 --2- 172.21.15.63:0/1430723272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7840b68d0 0x7fc784142270 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7fc774000bc0 tx=0x7fc7740109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:17.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.876+0000 7fc780ff9700 1 -- 172.21.15.63:0/1430723272 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v97) v1 ==== 185+0+0 (secure 0 0 0) 0x7fc774041820 con 0x7fc7840b68d0 2020-05-18T21:33:17.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.884+0000 7fc788d36700 1 -- 172.21.15.63:0/1430723272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc76804f9e0 msgr2=0x7fc768051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:17.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.884+0000 7fc788d36700 1 --2- 172.21.15.63:0/1430723272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc76804f9e0 0x7fc768051ea0 secure :-1 s=READY pgs=531 cs=0 l=1 rx=0x7fc7840b8c90 tx=0x7fc76c003e40).stop 2020-05-18T21:33:17.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.884+0000 7fc788d36700 1 -- 172.21.15.63:0/1430723272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7840b68d0 msgr2=0x7fc784142270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:17.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.884+0000 7fc788d36700 1 --2- 172.21.15.63:0/1430723272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7840b68d0 0x7fc784142270 secure :-1 s=READY pgs=1351 cs=0 l=1 rx=0x7fc774000bc0 tx=0x7fc7740109a0).stop 2020-05-18T21:33:17.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.884+0000 7fc788d36700 1 -- 172.21.15.63:0/1430723272 shutdown_connections 2020-05-18T21:33:17.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.884+0000 7fc788d36700 1 --2- 172.21.15.63:0/1430723272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc76804f9e0 0x7fc768051ea0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:17.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.884+0000 7fc788d36700 1 --2- 172.21.15.63:0/1430723272 >> v2:172.21.15.155:3300/0 conn(0x7fc7840b99d0 0x7fc7841483b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:17.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.884+0000 7fc788d36700 1 --2- 172.21.15.63:0/1430723272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7840b68d0 0x7fc784142270 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:17.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.884+0000 7fc788d36700 1 -- 172.21.15.63:0/1430723272 >> 172.21.15.63:0/1430723272 conn(0x7fc784069b70 msgr2=0x7fc78405c260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:17.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.884+0000 7fc788d36700 1 -- 172.21.15.63:0/1430723272 shutdown_connections 2020-05-18T21:33:17.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:17.884+0000 7fc788d36700 1 -- 172.21.15.63:0/1430723272 wait complete. 2020-05-18T21:33:17.894 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2020-05-18T21:33:17.902 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-05-18T21:33:18.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.008+0000 7f01b250b700 1 Processor -- start 2020-05-18T21:33:18.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.008+0000 7f01b250b700 1 -- start start 2020-05-18T21:33:18.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b250b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f01ac05ef00 0x7f01ac142110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:18.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b250b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ac142650 con 0x7f01ac061b30 2020-05-18T21:33:18.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b250b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ac1428c0 con 0x7f01ac146060 2020-05-18T21:33:18.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b250b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ac142b60 con 0x7f01ac05ef00 2020-05-18T21:33:18.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b1509700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f01ac05ef00 0x7f01ac142110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:18.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b0d08700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f01ac061b30 0x7f01ac145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34070/0 (socket says 172.21.15.63:34070) 2020-05-18T21:33:18.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b0d08700 1 -- 172.21.15.63:0/3388622931 learned_addr learned my addr 172.21.15.63:0/3388622931 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:18.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b1509700 1 -- 172.21.15.63:0/3388622931 >> v1:172.21.15.155:6789/0 conn(0x7f01ac146060 legacy=0x7f01ac0b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:18.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b1509700 1 -- 172.21.15.63:0/3388622931 >> v1:172.21.15.63:6789/0 conn(0x7f01ac061b30 legacy=0x7f01ac145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:18.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f019bfff700 1 -- 172.21.15.63:0/3388622931 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185545455 0 0) 0x7f01ac142650 con 0x7f01ac061b30 2020-05-18T21:33:18.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b1509700 1 -- 172.21.15.63:0/3388622931 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac143000 con 0x7f01ac05ef00 2020-05-18T21:33:18.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b1509700 1 --2- 172.21.15.63:0/3388622931 >> v2:172.21.15.63:3300/0 conn(0x7f01ac05ef00 0x7f01ac142110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f01a8002f70 tx=0x7f01a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:18.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b1509700 1 --2- 172.21.15.63:0/3388622931 >> v2:172.21.15.63:3300/0 conn(0x7f01ac05ef00 0x7f01ac142110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f01a8002f70 tx=0x7f01a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:18.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b1509700 1 --2- 172.21.15.63:0/3388622931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01ac05ef00 0x7f01ac142110 secure :-1 s=READY pgs=1353 cs=0 l=1 rx=0x7f01a8002f70 tx=0x7f01a8007a80).ready entity=mon.0 client_cookie=9e9bc4c20eb8d5f6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:18.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b1509700 1 --2- 172.21.15.63:0/3388622931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01ac05ef00 0x7f01ac142110 secure :-1 s=THROTTLE_DONE pgs=1353 cs=0 l=1 rx=0x7f01a8002f70 tx=0x7f01a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:18.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b1509700 1 --2- 172.21.15.63:0/3388622931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01ac05ef00 0x7f01ac142110 secure :-1 s=THROTTLE_DONE pgs=1353 cs=0 l=1 rx=0x7f01a8002f70 tx=0x7f01a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:18.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f019bfff700 1 -- 172.21.15.63:0/3388622931 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01a8008e80 con 0x7f01ac05ef00 2020-05-18T21:33:18.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b1509700 1 --2- 172.21.15.63:0/3388622931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01ac05ef00 0x7f01ac142110 secure :-1 s=THROTTLE_DONE pgs=1353 cs=0 l=1 rx=0x7f01a8002f70 tx=0x7f01a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:18.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f019bfff700 1 -- 172.21.15.63:0/3388622931 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a80116a0 con 0x7f01ac05ef00 2020-05-18T21:33:18.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f019bfff700 1 -- 172.21.15.63:0/3388622931 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01a8011ac0 con 0x7f01ac05ef00 2020-05-18T21:33:18.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b250b700 1 -- 172.21.15.63:0/3388622931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01ac05ef00 msgr2=0x7f01ac142110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:18.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b250b700 1 --2- 172.21.15.63:0/3388622931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01ac05ef00 0x7f01ac142110 secure :-1 s=READY pgs=1353 cs=0 l=1 rx=0x7f01a8002f70 tx=0x7f01a8007a80).stop 2020-05-18T21:33:18.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b250b700 1 -- 172.21.15.63:0/3388622931 shutdown_connections 2020-05-18T21:33:18.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b250b700 1 --2- 172.21.15.63:0/3388622931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01ac05ef00 0x7f01ac142110 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:18.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b250b700 1 -- 172.21.15.63:0/3388622931 >> 172.21.15.63:0/3388622931 conn(0x7f01ac0b8b10 msgr2=0x7f01ac0b8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:18.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b250b700 1 -- 172.21.15.63:0/3388622931 shutdown_connections 2020-05-18T21:33:18.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.012+0000 7f01b250b700 1 -- 172.21.15.63:0/3388622931 wait complete. 2020-05-18T21:33:18.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.016+0000 7f01b250b700 1 Processor -- start 2020-05-18T21:33:18.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.016+0000 7f01b250b700 1 -- start start 2020-05-18T21:33:18.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.016+0000 7f01b250b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01ac05ef00 0x7f01ac097660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:18.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.016+0000 7f01b250b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f01ac061b30 0x7f01ac0b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:18.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.016+0000 7f01b250b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ac1573d0 con 0x7f01ac146060 2020-05-18T21:33:18.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.016+0000 7f01b250b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ac0b21f0 con 0x7f01ac061b30 2020-05-18T21:33:18.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.016+0000 7f01b250b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac157120 con 0x7f01ac05ef00 2020-05-18T21:33:18.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.016+0000 7f01b0d08700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f01ac061b30 0x7f01ac0b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:18.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.016+0000 7f01b0d08700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f01ac061b30 0x7f01ac0b2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60120/0 (socket says 172.21.15.63:60120) 2020-05-18T21:33:18.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.016+0000 7f01b0d08700 1 -- 172.21.15.63:0/1043779474 learned_addr learned my addr 172.21.15.63:0/1043779474 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:18.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.016+0000 7f01b1509700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01ac05ef00 0x7f01ac097660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:18.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.016+0000 7f019a7fc700 1 -- 172.21.15.63:0/1043779474 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 449831294 0 0) 0x7f01ac1573d0 con 0x7f01ac146060 2020-05-18T21:33:18.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.016+0000 7f019a7fc700 1 -- 172.21.15.63:0/1043779474 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f018c002fe0 con 0x7f01ac146060 2020-05-18T21:33:18.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.016+0000 7f01b1509700 1 -- 172.21.15.63:0/1043779474 >> v2:172.21.15.63:3300/0 conn(0x7f01ac061b30 msgr2=0x7f01ac0b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:18.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.016+0000 7f01b1509700 1 --2- 172.21.15.63:0/1043779474 >> v2:172.21.15.63:3300/0 conn(0x7f01ac061b30 0x7f01ac0b2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:18.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.016+0000 7f01b1509700 1 -- 172.21.15.63:0/1043779474 >> v1:172.21.15.155:6789/0 conn(0x7f01ac146060 legacy=0x7f01ac156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:18.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.016+0000 7f01b1509700 1 -- 172.21.15.63:0/1043779474 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac0b2af0 con 0x7f01ac05ef00 2020-05-18T21:33:18.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.016+0000 7f01b1509700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01ac05ef00 0x7f01ac097660 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f01a8002f70 tx=0x7f01a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:18.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.020+0000 7f01b1509700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01ac05ef00 0x7f01ac097660 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f01a8002f70 tx=0x7f01a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:18.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.020+0000 7f01b1509700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01ac05ef00 0x7f01ac097660 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7f01a8002f70 tx=0x7f01a8007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:18.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.020+0000 7f01b1509700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01ac05ef00 0x7f01ac097660 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f01a8002f70 tx=0x7f01a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:18.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.020+0000 7f019a7fc700 1 -- 172.21.15.63:0/1043779474 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01a800f880 con 0x7f01ac05ef00 2020-05-18T21:33:18.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.020+0000 7f01b1509700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01ac05ef00 0x7f01ac097660 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f01a8002f70 tx=0x7f01a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:18.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.020+0000 7f01b250b700 1 -- 172.21.15.63:0/1043779474 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ac097cf0 con 0x7f01ac05ef00 2020-05-18T21:33:18.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.020+0000 7f019a7fc700 1 -- 172.21.15.63:0/1043779474 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a8007360 con 0x7f01ac05ef00 2020-05-18T21:33:18.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.020+0000 7f01b1509700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01ac05ef00 0x7f01ac097660 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f01a8002f70 tx=0x7f01a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:18.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.020+0000 7f019a7fc700 1 -- 172.21.15.63:0/1043779474 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01a8005700 con 0x7f01ac05ef00 2020-05-18T21:33:18.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.020+0000 7f01b250b700 1 -- 172.21.15.63:0/1043779474 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ac1445b0 con 0x7f01ac05ef00 2020-05-18T21:33:18.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.020+0000 7f01b1509700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01ac05ef00 0x7f01ac097660 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f01a8002f70 tx=0x7f01a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:18.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.020+0000 7f01b250b700 1 -- 172.21.15.63:0/1043779474 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ac0569e0 con 0x7f01ac05ef00 2020-05-18T21:33:18.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.020+0000 7f019a7fc700 1 -- 172.21.15.63:0/1043779474 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f01a8005900 con 0x7f01ac05ef00 2020-05-18T21:33:18.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.020+0000 7f01b1509700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01ac05ef00 0x7f01ac097660 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f01a8002f70 tx=0x7f01a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:18.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.020+0000 7f019a7fc700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f018c04fd10 0x7f018c0521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:18.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.020+0000 7f019a7fc700 1 -- 172.21.15.63:0/1043779474 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f01a8064450 con 0x7f01ac05ef00 2020-05-18T21:33:18.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.024+0000 7f01b0d08700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f018c04fd10 0x7f018c0521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:18.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.024+0000 7f01b0d08700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f018c04fd10 0x7f018c0521d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f019c000bc0 tx=0x7f019c001440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:18.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.024+0000 7f01b0d08700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f018c04fd10 0x7f018c0521d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f019c000bc0 tx=0x7f019c001440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:18.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.024+0000 7f01b0d08700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f018c04fd10 0x7f018c0521d0 secure :-1 s=READY pgs=532 cs=0 l=1 rx=0x7f019c000bc0 tx=0x7f019c001440).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:18.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.032+0000 7f01b1509700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01ac05ef00 0x7f01ac097660 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f01a8002f70 tx=0x7f01a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:18.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.032+0000 7f019a7fc700 1 -- 172.21.15.63:0/1043779474 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f01a803e900 con 0x7f01ac05ef00 2020-05-18T21:33:18.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.148+0000 7f01b250b700 1 -- 172.21.15.63:0/1043779474 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f01ac0b2330 con 0x7f01ac05ef00 2020-05-18T21:33:18.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.888+0000 7f01b1509700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01ac05ef00 0x7f01ac097660 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f01a8002f70 tx=0x7f01a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:18.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.888+0000 7f019a7fc700 1 -- 172.21.15.63:0/1043779474 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v98) v1 ==== 173+0+0 (secure 0 0 0) 0x7f01a8041f20 con 0x7f01ac05ef00 2020-05-18T21:33:18.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.892+0000 7f01b250b700 1 -- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f018c04fd10 msgr2=0x7f018c0521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:18.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.892+0000 7f01b250b700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f018c04fd10 0x7f018c0521d0 secure :-1 s=READY pgs=532 cs=0 l=1 rx=0x7f019c000bc0 tx=0x7f019c001440).stop 2020-05-18T21:33:18.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.892+0000 7f01b250b700 1 -- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01ac05ef00 msgr2=0x7f01ac097660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:18.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.892+0000 7f01b250b700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01ac05ef00 0x7f01ac097660 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7f01a8002f70 tx=0x7f01a8007a80).stop 2020-05-18T21:33:18.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.892+0000 7f01b250b700 1 -- 172.21.15.63:0/1043779474 shutdown_connections 2020-05-18T21:33:18.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.892+0000 7f01b250b700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f018c04fd10 0x7f018c0521d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:18.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.892+0000 7f01b250b700 1 --2- 172.21.15.63:0/1043779474 >> v2:172.21.15.63:3300/0 conn(0x7f01ac061b30 0x7f01ac0b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:18.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.892+0000 7f01b250b700 1 --2- 172.21.15.63:0/1043779474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01ac05ef00 0x7f01ac097660 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:18.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.892+0000 7f01b250b700 1 -- 172.21.15.63:0/1043779474 >> 172.21.15.63:0/1043779474 conn(0x7f01ac0b8b10 msgr2=0x7f01ac0b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:18.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.892+0000 7f01b250b700 1 -- 172.21.15.63:0/1043779474 shutdown_connections 2020-05-18T21:33:18.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:18.892+0000 7f01b250b700 1 -- 172.21.15.63:0/1043779474 wait complete. 2020-05-18T21:33:18.902 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2020-05-18T21:33:18.913 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:33:18.913 INFO:tasks.ceph.mds.a:Stopping old one... 2020-05-18T21:33:18.914 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:33:18.914 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:33:18.914 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:33:18.915 INFO:tasks.ceph.mds.b:Stopping old one... 2020-05-18T21:33:18.915 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:33:18.915 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:33:18.930 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:33:18.930 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:33:18.933 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:33:18.933 DEBUG:teuthology.parallel:result is None 2020-05-18T21:33:18.935 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:33:18.935 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:33:18.937 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:33:18.937 DEBUG:teuthology.parallel:result is None 2020-05-18T21:33:18.938 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-05-18T21:33:19.000 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:33:19.001 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:33:19.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509a92e700 1 Processor -- start 2020-05-18T21:33:19.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509a92e700 1 -- start start 2020-05-18T21:33:19.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509a92e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f509405f390 0x7f509405bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:19.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509a92e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f50940b66e0 0x7f5094145450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:19.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509a92e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50941458b0 0x7f50940b3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:19.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509a92e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509409dc00 con 0x7f50940b66e0 2020-05-18T21:33:19.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509a92e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5094145d60 con 0x7f509405f390 2020-05-18T21:33:19.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509a92e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509409ddf0 con 0x7f50941458b0 2020-05-18T21:33:19.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509912b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f50940b66e0 0x7f5094145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:19.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509912b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f50940b66e0 0x7f5094145450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60140/0 (socket says 172.21.15.63:60140) 2020-05-18T21:33:19.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509912b700 1 -- 172.21.15.63:0/1610059558 learned_addr learned my addr 172.21.15.63:0/1610059558 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:19.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509a12d700 1 --2- 172.21.15.63:0/1610059558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50941458b0 0x7f50940b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:19.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509992c700 1 --2- 172.21.15.63:0/1610059558 >> v2:172.21.15.155:3300/0 conn(0x7f509405f390 0x7f509405bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:19.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509912b700 1 -- 172.21.15.63:0/1610059558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50941458b0 msgr2=0x7f50940b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:19.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509912b700 1 --2- 172.21.15.63:0/1610059558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50941458b0 0x7f50940b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:19.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509912b700 1 -- 172.21.15.63:0/1610059558 >> v2:172.21.15.155:3300/0 conn(0x7f509405f390 msgr2=0x7f509405bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:19.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509912b700 1 --2- 172.21.15.63:0/1610059558 >> v2:172.21.15.155:3300/0 conn(0x7f509405f390 0x7f509405bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:19.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509912b700 1 -- 172.21.15.63:0/1610059558 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509409e090 con 0x7f50940b66e0 2020-05-18T21:33:19.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509912b700 1 --2- 172.21.15.63:0/1610059558 >> v2:172.21.15.63:3300/0 conn(0x7f50940b66e0 0x7f5094145450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5084002f70 tx=0x7f5084007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:19.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509912b700 1 --2- 172.21.15.63:0/1610059558 >> v2:172.21.15.63:3300/0 conn(0x7f50940b66e0 0x7f5094145450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5084002f70 tx=0x7f5084007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:19.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509912b700 1 --2- 172.21.15.63:0/1610059558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50940b66e0 0x7f5094145450 secure :-1 s=READY pgs=1359 cs=0 l=1 rx=0x7f5084002f70 tx=0x7f5084007a80).ready entity=mon.0 client_cookie=25cf8d9b2375e9e3 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:19.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509912b700 1 --2- 172.21.15.63:0/1610059558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50940b66e0 0x7f5094145450 secure :-1 s=THROTTLE_DONE pgs=1359 cs=0 l=1 rx=0x7f5084002f70 tx=0x7f5084007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:19.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509912b700 1 --2- 172.21.15.63:0/1610059558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50940b66e0 0x7f5094145450 secure :-1 s=THROTTLE_DONE pgs=1359 cs=0 l=1 rx=0x7f5084002f70 tx=0x7f5084007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:19.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509892a700 1 -- 172.21.15.63:0/1610059558 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5084011600 con 0x7f50940b66e0 2020-05-18T21:33:19.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509912b700 1 --2- 172.21.15.63:0/1610059558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50940b66e0 0x7f5094145450 secure :-1 s=THROTTLE_DONE pgs=1359 cs=0 l=1 rx=0x7f5084002f70 tx=0x7f5084007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:19.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509892a700 1 -- 172.21.15.63:0/1610059558 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5084011760 con 0x7f50940b66e0 2020-05-18T21:33:19.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509892a700 1 -- 172.21.15.63:0/1610059558 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5084011b80 con 0x7f50940b66e0 2020-05-18T21:33:19.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509a92e700 1 -- 172.21.15.63:0/1610059558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50940b66e0 msgr2=0x7f5094145450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:19.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.036+0000 7f509a92e700 1 --2- 172.21.15.63:0/1610059558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50940b66e0 0x7f5094145450 secure :-1 s=READY pgs=1359 cs=0 l=1 rx=0x7f5084002f70 tx=0x7f5084007a80).stop 2020-05-18T21:33:19.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.040+0000 7f509a92e700 1 -- 172.21.15.63:0/1610059558 shutdown_connections 2020-05-18T21:33:19.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.040+0000 7f509a92e700 1 --2- 172.21.15.63:0/1610059558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50941458b0 0x7f50940b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:19.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.040+0000 7f509a92e700 1 --2- 172.21.15.63:0/1610059558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50940b66e0 0x7f5094145450 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:19.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.040+0000 7f509a92e700 1 --2- 172.21.15.63:0/1610059558 >> v2:172.21.15.155:3300/0 conn(0x7f509405f390 0x7f509405bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:19.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.040+0000 7f509a92e700 1 -- 172.21.15.63:0/1610059558 >> 172.21.15.63:0/1610059558 conn(0x7f509406a640 msgr2=0x7f50940b6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:19.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.040+0000 7f509a92e700 1 -- 172.21.15.63:0/1610059558 shutdown_connections 2020-05-18T21:33:19.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.040+0000 7f509a92e700 1 -- 172.21.15.63:0/1610059558 wait complete. 2020-05-18T21:33:19.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.040+0000 7f509a92e700 1 Processor -- start 2020-05-18T21:33:19.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.040+0000 7f509a92e700 1 -- start start 2020-05-18T21:33:19.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509a92e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f509405f390 0x7f50940badc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:19.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509a92e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50940ba970 con 0x7f50941458b0 2020-05-18T21:33:19.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509a92e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509413f430 con 0x7f50940b66e0 2020-05-18T21:33:19.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509a92e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509413f6d0 con 0x7f509405f390 2020-05-18T21:33:19.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509a12d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f50941458b0 0x7f509413fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34104/0 (socket says 172.21.15.63:34104) 2020-05-18T21:33:19.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509a12d700 1 -- 172.21.15.63:0/1640944332 learned_addr learned my addr 172.21.15.63:0/1640944332 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:19.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509992c700 1 --2- 172.21.15.63:0/1640944332 >> v2:172.21.15.63:3300/0 conn(0x7f509405f390 0x7f50940badc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:19.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f5082ffd700 1 -- 172.21.15.63:0/1640944332 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904541649 0 0) 0x7f50940ba970 con 0x7f50941458b0 2020-05-18T21:33:19.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f5082ffd700 1 -- 172.21.15.63:0/1640944332 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5074002fe0 con 0x7f50941458b0 2020-05-18T21:33:19.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f5082ffd700 1 -- 172.21.15.63:0/1640944332 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903731221 0 0) 0x7f509413f430 con 0x7f50940b66e0 2020-05-18T21:33:19.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f5082ffd700 1 -- 172.21.15.63:0/1640944332 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50940ba970 con 0x7f50940b66e0 2020-05-18T21:33:19.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509992c700 1 -- 172.21.15.63:0/1640944332 >> v1:172.21.15.155:6789/0 conn(0x7f50940b66e0 legacy=0x7f5094063d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:19.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509992c700 1 -- 172.21.15.63:0/1640944332 >> v1:172.21.15.63:6789/0 conn(0x7f50941458b0 legacy=0x7f509413fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:19.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509992c700 1 -- 172.21.15.63:0/1640944332 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509413f150 con 0x7f509405f390 2020-05-18T21:33:19.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509992c700 1 --2- 172.21.15.63:0/1640944332 >> v2:172.21.15.63:3300/0 conn(0x7f509405f390 0x7f50940badc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5090002f70 tx=0x7f5090010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:19.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509992c700 1 --2- 172.21.15.63:0/1640944332 >> v2:172.21.15.63:3300/0 conn(0x7f509405f390 0x7f50940badc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5090002f70 tx=0x7f5090010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:19.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509992c700 1 --2- 172.21.15.63:0/1640944332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f509405f390 0x7f50940badc0 secure :-1 s=READY pgs=1361 cs=0 l=1 rx=0x7f5090002f70 tx=0x7f5090010c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:19.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509992c700 1 --2- 172.21.15.63:0/1640944332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f509405f390 0x7f50940badc0 secure :-1 s=THROTTLE_DONE pgs=1361 cs=0 l=1 rx=0x7f5090002f70 tx=0x7f5090010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:19.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f5082ffd700 1 -- 172.21.15.63:0/1640944332 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5090007550 con 0x7f509405f390 2020-05-18T21:33:19.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509992c700 1 --2- 172.21.15.63:0/1640944332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f509405f390 0x7f50940badc0 secure :-1 s=THROTTLE_DONE pgs=1361 cs=0 l=1 rx=0x7f5090002f70 tx=0x7f5090010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:19.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509992c700 1 --2- 172.21.15.63:0/1640944332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f509405f390 0x7f50940badc0 secure :-1 s=THROTTLE_DONE pgs=1361 cs=0 l=1 rx=0x7f5090002f70 tx=0x7f5090010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:19.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f5082ffd700 1 -- 172.21.15.63:0/1640944332 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5090005700 con 0x7f509405f390 2020-05-18T21:33:19.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509a92e700 1 -- 172.21.15.63:0/1640944332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5094065330 con 0x7f509405f390 2020-05-18T21:33:19.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f5082ffd700 1 -- 172.21.15.63:0/1640944332 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5090005aa0 con 0x7f509405f390 2020-05-18T21:33:19.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509a92e700 1 -- 172.21.15.63:0/1640944332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5094064640 con 0x7f509405f390 2020-05-18T21:33:19.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509992c700 1 --2- 172.21.15.63:0/1640944332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f509405f390 0x7f50940badc0 secure :-1 s=THROTTLE_DONE pgs=1361 cs=0 l=1 rx=0x7f5090002f70 tx=0x7f5090010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:19.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.044+0000 7f509a92e700 1 -- 172.21.15.63:0/1640944332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509413fb30 con 0x7f509405f390 2020-05-18T21:33:19.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.048+0000 7f5082ffd700 1 -- 172.21.15.63:0/1640944332 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5090005d10 con 0x7f509405f390 2020-05-18T21:33:19.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.048+0000 7f509992c700 1 --2- 172.21.15.63:0/1640944332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f509405f390 0x7f50940badc0 secure :-1 s=THROTTLE_DONE pgs=1361 cs=0 l=1 rx=0x7f5090002f70 tx=0x7f5090010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:19.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.048+0000 7f5082ffd700 1 --2- 172.21.15.63:0/1640944332 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f507404ff00 0x7f50740523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:19.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.048+0000 7f5082ffd700 1 -- 172.21.15.63:0/1640944332 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f5090063ef0 con 0x7f509405f390 2020-05-18T21:33:19.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.048+0000 7f509912b700 1 --2- 172.21.15.63:0/1640944332 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f507404ff00 0x7f50740523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:19.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.048+0000 7f509912b700 1 --2- 172.21.15.63:0/1640944332 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f507404ff00 0x7f50740523c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5084007f10 tx=0x7f5084007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:19.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.048+0000 7f509912b700 1 --2- 172.21.15.63:0/1640944332 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f507404ff00 0x7f50740523c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5084007f10 tx=0x7f5084007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:19.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.048+0000 7f509912b700 1 --2- 172.21.15.63:0/1640944332 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f507404ff00 0x7f50740523c0 secure :-1 s=READY pgs=533 cs=0 l=1 rx=0x7f5084007f10 tx=0x7f5084007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:19.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.052+0000 7f509992c700 1 --2- 172.21.15.63:0/1640944332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f509405f390 0x7f50940badc0 secure :-1 s=THROTTLE_DONE pgs=1361 cs=0 l=1 rx=0x7f5090002f70 tx=0x7f5090010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:19.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.052+0000 7f5082ffd700 1 -- 172.21.15.63:0/1640944332 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f509003e2e0 con 0x7f509405f390 2020-05-18T21:33:19.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:19.180+0000 7f509a92e700 1 -- 172.21.15.63:0/1640944332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f5094141ef0 con 0x7f509405f390 2020-05-18T21:33:20.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.024+0000 7f509992c700 1 --2- 172.21.15.63:0/1640944332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f509405f390 0x7f50940badc0 secure :-1 s=THROTTLE_DONE pgs=1361 cs=0 l=1 rx=0x7f5090002f70 tx=0x7f5090010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.024+0000 7f5082ffd700 1 -- 172.21.15.63:0/1640944332 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v100) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5094141ef0 con 0x7f509405f390 2020-05-18T21:33:20.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.028+0000 7f509a92e700 1 -- 172.21.15.63:0/1640944332 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f507404ff00 msgr2=0x7f50740523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:20.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.028+0000 7f509a92e700 1 --2- 172.21.15.63:0/1640944332 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f507404ff00 0x7f50740523c0 secure :-1 s=READY pgs=533 cs=0 l=1 rx=0x7f5084007f10 tx=0x7f5084007a80).stop 2020-05-18T21:33:20.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.028+0000 7f509a92e700 1 -- 172.21.15.63:0/1640944332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f509405f390 msgr2=0x7f50940badc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:20.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.028+0000 7f509a92e700 1 --2- 172.21.15.63:0/1640944332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f509405f390 0x7f50940badc0 secure :-1 s=READY pgs=1361 cs=0 l=1 rx=0x7f5090002f70 tx=0x7f5090010c50).stop 2020-05-18T21:33:20.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.028+0000 7f509a92e700 1 -- 172.21.15.63:0/1640944332 shutdown_connections 2020-05-18T21:33:20.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.028+0000 7f509a92e700 1 --2- 172.21.15.63:0/1640944332 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f507404ff00 0x7f50740523c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:20.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.028+0000 7f509a92e700 1 --2- 172.21.15.63:0/1640944332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f509405f390 0x7f50940badc0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:20.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.028+0000 7f509a92e700 1 -- 172.21.15.63:0/1640944332 >> 172.21.15.63:0/1640944332 conn(0x7f509406a640 msgr2=0x7f50940b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:20.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.028+0000 7f509a92e700 1 -- 172.21.15.63:0/1640944332 shutdown_connections 2020-05-18T21:33:20.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.028+0000 7f509a92e700 1 -- 172.21.15.63:0/1640944332 wait complete. 2020-05-18T21:33:20.038 INFO:teuthology.orchestra.run.smithi063.stderr: removed all blacklist entries 2020-05-18T21:33:20.051 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-05-18T21:33:20.052 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-05-18T21:33:20.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.152+0000 7f769d2c9700 1 Processor -- start 2020-05-18T21:33:20.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.152+0000 7f769d2c9700 1 -- start start 2020-05-18T21:33:20.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.152+0000 7f769d2c9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7698144350 0x7f769806a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:20.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.152+0000 7f769d2c9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f76980b5670 0x7f76980b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:20.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.152+0000 7f769d2c9700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76980b4dd0 con 0x7f7698144730 2020-05-18T21:33:20.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.152+0000 7f769d2c9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7698061260 con 0x7f76980b5670 2020-05-18T21:33:20.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.152+0000 7f769d2c9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7698061500 con 0x7f7698144350 2020-05-18T21:33:20.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.152+0000 7f76967fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7698144730 0x7f76980619a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34110/0 (socket says 172.21.15.63:34110) 2020-05-18T21:33:20.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.152+0000 7f76967fc700 1 -- 172.21.15.63:0/447539319 learned_addr learned my addr 172.21.15.63:0/447539319 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:20.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f76977fe700 1 --2- 172.21.15.63:0/447539319 >> v2:172.21.15.155:3300/0 conn(0x7f76980b5670 0x7f76980b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:20.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f7696ffd700 1 --2- 172.21.15.63:0/447539319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7698144350 0x7f769806a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:20.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f7695ffb700 1 -- 172.21.15.63:0/447539319 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731527816 0 0) 0x7f76980b4dd0 con 0x7f7698144730 2020-05-18T21:33:20.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f7695ffb700 1 -- 172.21.15.63:0/447539319 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7678003270 con 0x7f7698144730 2020-05-18T21:33:20.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f76977fe700 1 -- 172.21.15.63:0/447539319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7698144350 msgr2=0x7f769806a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:20.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f76977fe700 1 --2- 172.21.15.63:0/447539319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7698144350 0x7f769806a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:20.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f76977fe700 1 -- 172.21.15.63:0/447539319 >> v1:172.21.15.63:6789/0 conn(0x7f7698144730 legacy=0x7f76980619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:20.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f76977fe700 1 -- 172.21.15.63:0/447539319 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7698144b90 con 0x7f76980b5670 2020-05-18T21:33:20.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f76977fe700 1 --2- 172.21.15.63:0/447539319 >> v2:172.21.15.155:3300/0 conn(0x7f76980b5670 0x7f76980b5b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f76900032f0 tx=0x7f7690007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f76977fe700 1 --2- 172.21.15.63:0/447539319 >> v2:172.21.15.155:3300/0 conn(0x7f76980b5670 0x7f76980b5b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f76900032f0 tx=0x7f7690007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f76977fe700 1 --2- 172.21.15.63:0/447539319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76980b5670 0x7f76980b5b00 secure :-1 s=READY pgs=923 cs=0 l=1 rx=0x7f76900032f0 tx=0x7f7690007e00).ready entity=mon.1 client_cookie=c15d21fe8d5465e6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:20.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f76977fe700 1 --2- 172.21.15.63:0/447539319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76980b5670 0x7f76980b5b00 secure :-1 s=THROTTLE_DONE pgs=923 cs=0 l=1 rx=0x7f76900032f0 tx=0x7f7690007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f7695ffb700 1 -- 172.21.15.63:0/447539319 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7690011db0 con 0x7f76980b5670 2020-05-18T21:33:20.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f76977fe700 1 --2- 172.21.15.63:0/447539319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76980b5670 0x7f76980b5b00 secure :-1 s=THROTTLE_DONE pgs=923 cs=0 l=1 rx=0x7f76900032f0 tx=0x7f7690007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f7695ffb700 1 -- 172.21.15.63:0/447539319 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769000a180 con 0x7f76980b5670 2020-05-18T21:33:20.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f76977fe700 1 --2- 172.21.15.63:0/447539319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76980b5670 0x7f76980b5b00 secure :-1 s=THROTTLE_DONE pgs=923 cs=0 l=1 rx=0x7f76900032f0 tx=0x7f7690007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f7695ffb700 1 -- 172.21.15.63:0/447539319 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f769000a560 con 0x7f76980b5670 2020-05-18T21:33:20.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f769d2c9700 1 -- 172.21.15.63:0/447539319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76980b5670 msgr2=0x7f76980b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:20.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f769d2c9700 1 --2- 172.21.15.63:0/447539319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76980b5670 0x7f76980b5b00 secure :-1 s=READY pgs=923 cs=0 l=1 rx=0x7f76900032f0 tx=0x7f7690007e00).stop 2020-05-18T21:33:20.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f769d2c9700 1 -- 172.21.15.63:0/447539319 shutdown_connections 2020-05-18T21:33:20.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f769d2c9700 1 --2- 172.21.15.63:0/447539319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76980b5670 0x7f76980b5b00 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:20.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f769d2c9700 1 --2- 172.21.15.63:0/447539319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7698144350 0x7f769806a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:20.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f769d2c9700 1 -- 172.21.15.63:0/447539319 >> 172.21.15.63:0/447539319 conn(0x7f769805b240 msgr2=0x7f7698069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:20.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f769d2c9700 1 -- 172.21.15.63:0/447539319 shutdown_connections 2020-05-18T21:33:20.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.156+0000 7f769d2c9700 1 -- 172.21.15.63:0/447539319 wait complete. 2020-05-18T21:33:20.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f769d2c9700 1 Processor -- start 2020-05-18T21:33:20.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f769d2c9700 1 -- start start 2020-05-18T21:33:20.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f769d2c9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7698144350 0x7f76980b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:20.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f769d2c9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7698144730 0x7f769809a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:20.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f769d2c9700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7698064d20 con 0x7f76980b5670 2020-05-18T21:33:20.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f769d2c9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76980652a0 con 0x7f7698144730 2020-05-18T21:33:20.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f769d2c9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76980b6c00 con 0x7f7698144350 2020-05-18T21:33:20.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f76977fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7698144730 0x7f769809a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:20.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f7696ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f76980b5670 0x7f7698150500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34116/0 (socket says 172.21.15.63:34116) 2020-05-18T21:33:20.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f76977fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7698144730 0x7f769809a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60164/0 (socket says 172.21.15.63:60164) 2020-05-18T21:33:20.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f7696ffd700 1 -- 172.21.15.63:0/575578017 learned_addr learned my addr 172.21.15.63:0/575578017 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:20.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f76967fc700 1 --2- 172.21.15.63:0/575578017 >> v2:172.21.15.155:3300/0 conn(0x7f7698144350 0x7f76980b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:20.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f76977fe700 1 -- 172.21.15.63:0/575578017 >> v2:172.21.15.155:3300/0 conn(0x7f7698144350 msgr2=0x7f76980b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:20.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f76977fe700 1 --2- 172.21.15.63:0/575578017 >> v2:172.21.15.155:3300/0 conn(0x7f7698144350 0x7f76980b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:20.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f76977fe700 1 -- 172.21.15.63:0/575578017 >> v1:172.21.15.63:6789/0 conn(0x7f76980b5670 legacy=0x7f7698150500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:20.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f768ffff700 1 -- 172.21.15.63:0/575578017 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502996657 0 0) 0x7f7698064d20 con 0x7f76980b5670 2020-05-18T21:33:20.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f76977fe700 1 -- 172.21.15.63:0/575578017 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769809cc50 con 0x7f7698144730 2020-05-18T21:33:20.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f76977fe700 1 --2- 172.21.15.63:0/575578017 >> v2:172.21.15.63:3300/0 conn(0x7f7698144730 0x7f769809a480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f76980b86f0 tx=0x7f7690007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f76977fe700 1 --2- 172.21.15.63:0/575578017 >> v2:172.21.15.63:3300/0 conn(0x7f7698144730 0x7f769809a480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f76980b86f0 tx=0x7f7690007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f76977fe700 1 --2- 172.21.15.63:0/575578017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7698144730 0x7f769809a480 secure :-1 s=READY pgs=1364 cs=0 l=1 rx=0x7f76980b86f0 tx=0x7f7690007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:20.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f76977fe700 1 --2- 172.21.15.63:0/575578017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7698144730 0x7f769809a480 secure :-1 s=THROTTLE_DONE pgs=1364 cs=0 l=1 rx=0x7f76980b86f0 tx=0x7f7690007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f768ffff700 1 -- 172.21.15.63:0/575578017 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7690005c70 con 0x7f7698144730 2020-05-18T21:33:20.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f76977fe700 1 --2- 172.21.15.63:0/575578017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7698144730 0x7f769809a480 secure :-1 s=THROTTLE_DONE pgs=1364 cs=0 l=1 rx=0x7f76980b86f0 tx=0x7f7690007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f76977fe700 1 --2- 172.21.15.63:0/575578017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7698144730 0x7f769809a480 secure :-1 s=THROTTLE_DONE pgs=1364 cs=0 l=1 rx=0x7f76980b86f0 tx=0x7f7690007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f768ffff700 1 -- 172.21.15.63:0/575578017 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7690005dd0 con 0x7f7698144730 2020-05-18T21:33:20.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f769d2c9700 1 -- 172.21.15.63:0/575578017 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7698150c10 con 0x7f7698144730 2020-05-18T21:33:20.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f768ffff700 1 -- 172.21.15.63:0/575578017 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7690007360 con 0x7f7698144730 2020-05-18T21:33:20.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.160+0000 7f769d2c9700 1 -- 172.21.15.63:0/575578017 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7698064a70 con 0x7f7698144730 2020-05-18T21:33:20.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.164+0000 7f76977fe700 1 --2- 172.21.15.63:0/575578017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7698144730 0x7f769809a480 secure :-1 s=THROTTLE_DONE pgs=1364 cs=0 l=1 rx=0x7f76980b86f0 tx=0x7f7690007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.164+0000 7f769d2c9700 1 -- 172.21.15.63:0/575578017 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76980569e0 con 0x7f7698144730 2020-05-18T21:33:20.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.164+0000 7f768ffff700 1 -- 172.21.15.63:0/575578017 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f76900075d0 con 0x7f7698144730 2020-05-18T21:33:20.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.164+0000 7f76977fe700 1 --2- 172.21.15.63:0/575578017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7698144730 0x7f769809a480 secure :-1 s=THROTTLE_DONE pgs=1364 cs=0 l=1 rx=0x7f76980b86f0 tx=0x7f7690007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.164+0000 7f768ffff700 1 --2- 172.21.15.63:0/575578017 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f767c04f830 0x7f767c051cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:20.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.164+0000 7f768ffff700 1 -- 172.21.15.63:0/575578017 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7690064a60 con 0x7f7698144730 2020-05-18T21:33:20.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.164+0000 7f7696ffd700 1 --2- 172.21.15.63:0/575578017 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f767c04f830 0x7f767c051cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:20.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.164+0000 7f7696ffd700 1 --2- 172.21.15.63:0/575578017 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f767c04f830 0x7f767c051cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7680007a80 tx=0x7f76800081d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.164+0000 7f7696ffd700 1 --2- 172.21.15.63:0/575578017 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f767c04f830 0x7f767c051cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7680007a80 tx=0x7f76800081d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.164+0000 7f7696ffd700 1 --2- 172.21.15.63:0/575578017 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f767c04f830 0x7f767c051cf0 secure :-1 s=READY pgs=536 cs=0 l=1 rx=0x7f7680007a80 tx=0x7f76800081d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:20.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.168+0000 7f76977fe700 1 --2- 172.21.15.63:0/575578017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7698144730 0x7f769809a480 secure :-1 s=THROTTLE_DONE pgs=1364 cs=0 l=1 rx=0x7f76980b86f0 tx=0x7f7690007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.168+0000 7f768ffff700 1 -- 172.21.15.63:0/575578017 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f769003ef10 con 0x7f7698144730 2020-05-18T21:33:20.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.320+0000 7f769d2c9700 1 -- 172.21.15.63:0/575578017 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7698143f90 con 0x7f7698144730 2020-05-18T21:33:20.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.320+0000 7f76977fe700 1 --2- 172.21.15.63:0/575578017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7698144730 0x7f769809a480 secure :-1 s=THROTTLE_DONE pgs=1364 cs=0 l=1 rx=0x7f76980b86f0 tx=0x7f7690007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.320+0000 7f768ffff700 1 -- 172.21.15.63:0/575578017 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v38) v1 ==== 80+0+4513 (secure 0 0 0) 0x7f7690042530 con 0x7f7698144730 2020-05-18T21:33:20.328 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:20.329 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:20.329 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_dump": [ 2020-05-18T21:33:20.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:20.329 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.a", 2020-05-18T21:33:20.330 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJekJyyLRAAfB5XJCsXTAmZdkFOaQrokg==", 2020-05-18T21:33:20.330 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:20.330 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:33:20.330 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:20.331 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:20.331 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:20.331 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:20.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:20.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:20.332 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.b", 2020-05-18T21:33:20.332 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeSVE8MRAAEEytuzLtcQMC+1uQ/yh8eA==", 2020-05-18T21:33:20.332 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:20.333 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:33:20.333 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:20.334 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:20.334 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:20.334 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:20.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:20.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:20.335 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.0", 2020-05-18T21:33:20.335 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBq/cJeIn7mJhAArx+YEdVbsfXXNOLWdaAgWw==", 2020-05-18T21:33:20.336 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:20.336 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:20.336 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:20.336 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:20.336 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:20.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:20.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:20.337 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.1", 2020-05-18T21:33:20.338 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBt/cJelHywCRAAFyQ3sPEE0RTSy4tKfsDfyw==", 2020-05-18T21:33:20.338 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:20.338 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:20.338 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:20.338 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:20.339 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:20.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:20.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:20.339 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.2", 2020-05-18T21:33:20.340 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBv/cJecexDLBAAxhlFq20MBkKvDjuM1yi8XQ==", 2020-05-18T21:33:20.340 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:20.340 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:20.341 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:20.341 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:20.341 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:20.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:20.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:20.342 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.3", 2020-05-18T21:33:20.342 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBy/cJe9IqwDxAAMg1In7bIITDcOZljzzTpDQ==", 2020-05-18T21:33:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.4", 2020-05-18T21:33:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB3/cJeLXgxFhAA/kMVV5hCRny2uXKvvbu8Og==", 2020-05-18T21:33:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.5", 2020-05-18T21:33:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB5/cJeucpsNRAAjGh+6yUC8Fji9PE4COi/Eg==", 2020-05-18T21:33:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:20.347 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:20.347 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:20.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:20.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:20.348 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.6", 2020-05-18T21:33:20.348 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB8/cJelSPpGhAAXobGqH9qaW1VZfEpH8bUbQ==", 2020-05-18T21:33:20.348 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:20.349 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:20.349 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:20.349 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:20.350 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:20.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:20.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:20.350 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.7", 2020-05-18T21:33:20.351 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB+/cJeUIl5OBAAPd8H8ohOWZw9ubO7uCB6zg==", 2020-05-18T21:33:20.351 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:20.351 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:20.352 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:20.352 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:20.352 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:20.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:20.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:20.353 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.0", 2020-05-18T21:33:20.353 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeap3RNhAAi2vKpsKtzSL1Uuqm8pWYJQ==", 2020-05-18T21:33:20.354 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:20.354 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:33:20.354 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:33:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:33:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:20.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:20.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:20.356 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.1", 2020-05-18T21:33:20.357 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJeekrQABAA5TmzWOt24C6hgZw/WTj5dw==", 2020-05-18T21:33:20.357 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:20.357 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:33:20.360 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:33:20.360 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:33:20.361 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:20.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:20.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:20.361 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.2", 2020-05-18T21:33:20.361 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJehSnFAxAAXUZwqNTXqAApEB3nXs4u6g==", 2020-05-18T21:33:20.362 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:20.362 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:33:20.362 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:33:20.362 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:33:20.363 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:20.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:20.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:20.363 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.3", 2020-05-18T21:33:20.364 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJe2HdDBhAA07y5pn/bKKa9TBbZFvIh9g==", 2020-05-18T21:33:20.364 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:20.364 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:33:20.364 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:33:20.365 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:33:20.365 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:20.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:20.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:20.366 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.admin", 2020-05-18T21:33:20.366 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJe/K4fGRAA+rP3BYuWiyx/fKmQ3bV6Lw==", 2020-05-18T21:33:20.366 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:20.366 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:33:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:20.368 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.x", 2020-05-18T21:33:20.368 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJemmqEKhAAe5ySRz8Id0ug4matQwL0uw==", 2020-05-18T21:33:20.368 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:20.369 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:33:20.369 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:33:20.369 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:20.369 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:20.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:20.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:20.370 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.y", 2020-05-18T21:33:20.378 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeF/BNJhAAi/vrldC6qoWJWnSHpE3ung==", 2020-05-18T21:33:20.378 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:20.378 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:33:20.379 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:33:20.379 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:20.379 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:20.379 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:20.379 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:20.380 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:20.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.324+0000 7f769d2c9700 1 -- 172.21.15.63:0/575578017 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f767c04f830 msgr2=0x7f767c051cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:20.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.324+0000 7f769d2c9700 1 --2- 172.21.15.63:0/575578017 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f767c04f830 0x7f767c051cf0 secure :-1 s=READY pgs=536 cs=0 l=1 rx=0x7f7680007a80 tx=0x7f76800081d0).stop 2020-05-18T21:33:20.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.324+0000 7f769d2c9700 1 -- 172.21.15.63:0/575578017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7698144730 msgr2=0x7f769809a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:20.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.324+0000 7f769d2c9700 1 --2- 172.21.15.63:0/575578017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7698144730 0x7f769809a480 secure :-1 s=READY pgs=1364 cs=0 l=1 rx=0x7f76980b86f0 tx=0x7f7690007e00).stop 2020-05-18T21:33:20.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.324+0000 7f769d2c9700 1 -- 172.21.15.63:0/575578017 shutdown_connections 2020-05-18T21:33:20.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.324+0000 7f769d2c9700 1 --2- 172.21.15.63:0/575578017 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f767c04f830 0x7f767c051cf0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:20.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.324+0000 7f769d2c9700 1 --2- 172.21.15.63:0/575578017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7698144730 0x7f769809a480 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:20.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.324+0000 7f769d2c9700 1 --2- 172.21.15.63:0/575578017 >> v2:172.21.15.155:3300/0 conn(0x7f7698144350 0x7f76980b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:20.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.324+0000 7f769d2c9700 1 -- 172.21.15.63:0/575578017 >> 172.21.15.63:0/575578017 conn(0x7f769805b240 msgr2=0x7f76980b9430 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:20.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.324+0000 7f769d2c9700 1 -- 172.21.15.63:0/575578017 shutdown_connections 2020-05-18T21:33:20.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.324+0000 7f769d2c9700 1 -- 172.21.15.63:0/575578017 wait complete. 2020-05-18T21:33:20.385 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:33:20.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.488+0000 7f0647099700 1 Processor -- start 2020-05-18T21:33:20.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.488+0000 7f0647099700 1 -- start start 2020-05-18T21:33:20.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0647099700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f064009e7f0 0x7f064006a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:20.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0647099700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f064009c130 0x7f064009c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:20.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0647099700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06400b5750 con 0x7f06400b5040 2020-05-18T21:33:20.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0647099700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06400b59f0 con 0x7f064009e7f0 2020-05-18T21:33:20.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0647099700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06400b5c90 con 0x7f064009c130 2020-05-18T21:33:20.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0644e35700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f064009e7f0 0x7f064006a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:20.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0645636700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f064009c130 0x7f064009c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:20.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f063ffff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f06400b5040 0x7f0640141ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:60672/0 (socket says 172.21.15.63:60672) 2020-05-18T21:33:20.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f063ffff700 1 -- 172.21.15.63:0/3088399204 learned_addr learned my addr 172.21.15.63:0/3088399204 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:20.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f063f7fe700 1 -- 172.21.15.63:0/3088399204 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301865437 0 0) 0x7f06400b5750 con 0x7f06400b5040 2020-05-18T21:33:20.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f063f7fe700 1 -- 172.21.15.63:0/3088399204 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0624003270 con 0x7f06400b5040 2020-05-18T21:33:20.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0645636700 1 -- 172.21.15.63:0/3088399204 >> v2:172.21.15.155:3300/0 conn(0x7f064009e7f0 msgr2=0x7f064006a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:20.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0645636700 1 --2- 172.21.15.63:0/3088399204 >> v2:172.21.15.155:3300/0 conn(0x7f064009e7f0 0x7f064006a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:20.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0645636700 1 -- 172.21.15.63:0/3088399204 >> v1:172.21.15.155:6789/0 conn(0x7f06400b5040 legacy=0x7f0640141ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:20.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0645636700 1 -- 172.21.15.63:0/3088399204 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06400b54a0 con 0x7f064009c130 2020-05-18T21:33:20.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0645636700 1 --2- 172.21.15.63:0/3088399204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f064009c130 0x7f064009c5a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f06380032f0 tx=0x7f0638007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0645636700 1 --2- 172.21.15.63:0/3088399204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f064009c130 0x7f064009c5a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f06380032f0 tx=0x7f0638007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0645636700 1 --2- 172.21.15.63:0/3088399204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f064009c130 0x7f064009c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7f06380032f0 tx=0x7f0638007e00).ready entity=mon.2 client_cookie=4bb710c590813dda server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:20.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0645636700 1 --2- 172.21.15.63:0/3088399204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f064009c130 0x7f064009c5a0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f06380032f0 tx=0x7f0638007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f063f7fe700 1 -- 172.21.15.63:0/3088399204 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0638011db0 con 0x7f064009c130 2020-05-18T21:33:20.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0645636700 1 --2- 172.21.15.63:0/3088399204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f064009c130 0x7f064009c5a0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f06380032f0 tx=0x7f0638007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f063f7fe700 1 -- 172.21.15.63:0/3088399204 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063800a180 con 0x7f064009c130 2020-05-18T21:33:20.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0645636700 1 --2- 172.21.15.63:0/3088399204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f064009c130 0x7f064009c5a0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f06380032f0 tx=0x7f0638007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f063f7fe700 1 -- 172.21.15.63:0/3088399204 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f063800a560 con 0x7f064009c130 2020-05-18T21:33:20.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0647099700 1 -- 172.21.15.63:0/3088399204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f064009c130 msgr2=0x7f064009c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:20.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0647099700 1 --2- 172.21.15.63:0/3088399204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f064009c130 0x7f064009c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7f06380032f0 tx=0x7f0638007e00).stop 2020-05-18T21:33:20.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0647099700 1 -- 172.21.15.63:0/3088399204 shutdown_connections 2020-05-18T21:33:20.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0647099700 1 --2- 172.21.15.63:0/3088399204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f064009c130 0x7f064009c5a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:20.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0647099700 1 --2- 172.21.15.63:0/3088399204 >> v2:172.21.15.155:3300/0 conn(0x7f064009e7f0 0x7f064006a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:20.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0647099700 1 -- 172.21.15.63:0/3088399204 >> 172.21.15.63:0/3088399204 conn(0x7f064005b240 msgr2=0x7f0640069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:20.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0647099700 1 -- 172.21.15.63:0/3088399204 shutdown_connections 2020-05-18T21:33:20.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.492+0000 7f0647099700 1 -- 172.21.15.63:0/3088399204 wait complete. 2020-05-18T21:33:20.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f0647099700 1 Processor -- start 2020-05-18T21:33:20.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f0647099700 1 -- start start 2020-05-18T21:33:20.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f0647099700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f064009c130 0x7f0640145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:20.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f0647099700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f064009e7f0 0x7f06400624c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:20.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f0647099700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064013b6b0 con 0x7f06400b5040 2020-05-18T21:33:20.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f0647099700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064013b950 con 0x7f064009c130 2020-05-18T21:33:20.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f0647099700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064013bbf0 con 0x7f064009e7f0 2020-05-18T21:33:20.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f0645636700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f06400b5040 0x7f0640132e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34132/0 (socket says 172.21.15.63:34132) 2020-05-18T21:33:20.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f0645636700 1 -- 172.21.15.63:0/3351065722 learned_addr learned my addr 172.21.15.63:0/3351065722 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:20.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f0644e35700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f064009c130 0x7f0640145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:20.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f063dffb700 1 -- 172.21.15.63:0/3351065722 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906647702 0 0) 0x7f064013b6b0 con 0x7f06400b5040 2020-05-18T21:33:20.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f063ffff700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f064009e7f0 0x7f06400624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:20.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f063dffb700 1 -- 172.21.15.63:0/3351065722 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0618002fe0 con 0x7f06400b5040 2020-05-18T21:33:20.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f0644e35700 1 -- 172.21.15.63:0/3351065722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f064009e7f0 msgr2=0x7f06400624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:20.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f0644e35700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f064009e7f0 0x7f06400624c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:20.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f0644e35700 1 -- 172.21.15.63:0/3351065722 >> v1:172.21.15.63:6789/0 conn(0x7f06400b5040 legacy=0x7f0640132e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:20.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f063dffb700 1 -- 172.21.15.63:0/3351065722 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2270549242 0 0) 0x7f0618002fe0 con 0x7f06400b5040 2020-05-18T21:33:20.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f0644e35700 1 -- 172.21.15.63:0/3351065722 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0640133540 con 0x7f064009c130 2020-05-18T21:33:20.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f063ffff700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f064009e7f0 0x7f06400624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:33:20.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.496+0000 7f0644e35700 1 --2- 172.21.15.63:0/3351065722 >> v2:172.21.15.63:3300/0 conn(0x7f064009c130 0x7f0640145360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0638008b40 tx=0x7f0630010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.500+0000 7f0644e35700 1 --2- 172.21.15.63:0/3351065722 >> v2:172.21.15.63:3300/0 conn(0x7f064009c130 0x7f0640145360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0638008b40 tx=0x7f0630010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.500+0000 7f0644e35700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f064009c130 0x7f0640145360 secure :-1 s=READY pgs=1366 cs=0 l=1 rx=0x7f0638008b40 tx=0x7f0630010c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:20.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.500+0000 7f0644e35700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f064009c130 0x7f0640145360 secure :-1 s=THROTTLE_DONE pgs=1366 cs=0 l=1 rx=0x7f0638008b40 tx=0x7f0630010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.500+0000 7f063dffb700 1 -- 172.21.15.63:0/3351065722 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06380089a0 con 0x7f064009c130 2020-05-18T21:33:20.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.500+0000 7f0644e35700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f064009c130 0x7f0640145360 secure :-1 s=THROTTLE_DONE pgs=1366 cs=0 l=1 rx=0x7f0638008b40 tx=0x7f0630010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.500+0000 7f0644e35700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f064009c130 0x7f0640145360 secure :-1 s=THROTTLE_DONE pgs=1366 cs=0 l=1 rx=0x7f0638008b40 tx=0x7f0630010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.500+0000 7f063dffb700 1 -- 172.21.15.63:0/3351065722 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0630007370 con 0x7f064009c130 2020-05-18T21:33:20.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.500+0000 7f0647099700 1 -- 172.21.15.63:0/3351065722 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06400b26f0 con 0x7f064009c130 2020-05-18T21:33:20.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.500+0000 7f063dffb700 1 -- 172.21.15.63:0/3351065722 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0630005a00 con 0x7f064009c130 2020-05-18T21:33:20.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.500+0000 7f0647099700 1 -- 172.21.15.63:0/3351065722 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06400b2ba0 con 0x7f064009c130 2020-05-18T21:33:20.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.500+0000 7f0644e35700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f064009c130 0x7f0640145360 secure :-1 s=THROTTLE_DONE pgs=1366 cs=0 l=1 rx=0x7f0638008b40 tx=0x7f0630010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.500+0000 7f0647099700 1 -- 172.21.15.63:0/3351065722 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06400569e0 con 0x7f064009c130 2020-05-18T21:33:20.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.500+0000 7f063dffb700 1 -- 172.21.15.63:0/3351065722 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0630005c70 con 0x7f064009c130 2020-05-18T21:33:20.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.500+0000 7f0644e35700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f064009c130 0x7f0640145360 secure :-1 s=THROTTLE_DONE pgs=1366 cs=0 l=1 rx=0x7f0638008b40 tx=0x7f0630010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.500+0000 7f063dffb700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f061804fd80 0x7f0618052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:20.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.504+0000 7f063dffb700 1 -- 172.21.15.63:0/3351065722 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f0630063670 con 0x7f064009c130 2020-05-18T21:33:20.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.504+0000 7f063ffff700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f061804fd80 0x7f0618052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:20.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.504+0000 7f063ffff700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f061804fd80 0x7f0618052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0628001110 tx=0x7f0628001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.504+0000 7f063ffff700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f061804fd80 0x7f0618052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0628001110 tx=0x7f0628001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.504+0000 7f063ffff700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f061804fd80 0x7f0618052240 secure :-1 s=READY pgs=537 cs=0 l=1 rx=0x7f0628001110 tx=0x7f0628001840).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:20.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.508+0000 7f0644e35700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f064009c130 0x7f0640145360 secure :-1 s=THROTTLE_DONE pgs=1366 cs=0 l=1 rx=0x7f0638008b40 tx=0x7f0630010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.508+0000 7f063dffb700 1 -- 172.21.15.63:0/3351065722 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f063003db20 con 0x7f064009c130 2020-05-18T21:33:20.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.624+0000 7f0647099700 1 -- 172.21.15.63:0/3351065722 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06400008d0 con 0x7f064009c130 2020-05-18T21:33:20.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.628+0000 7f0644e35700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f064009c130 0x7f0640145360 secure :-1 s=THROTTLE_DONE pgs=1366 cs=0 l=1 rx=0x7f0638008b40 tx=0x7f0630010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.628+0000 7f063dffb700 1 -- 172.21.15.63:0/3351065722 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+13234 (secure 0 0 0) 0x7f0630041140 con 0x7f064009c130 2020-05-18T21:33:20.634 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:20.635 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":100,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:33:20.016136+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:33:20.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.628+0000 7f0647099700 1 -- 172.21.15.63:0/3351065722 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f061804fd80 msgr2=0x7f0618052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:20.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.628+0000 7f0647099700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f061804fd80 0x7f0618052240 secure :-1 s=READY pgs=537 cs=0 l=1 rx=0x7f0628001110 tx=0x7f0628001840).stop 2020-05-18T21:33:20.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.628+0000 7f0647099700 1 -- 172.21.15.63:0/3351065722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f064009c130 msgr2=0x7f0640145360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:20.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.628+0000 7f0647099700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f064009c130 0x7f0640145360 secure :-1 s=READY pgs=1366 cs=0 l=1 rx=0x7f0638008b40 tx=0x7f0630010c20).stop 2020-05-18T21:33:20.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.628+0000 7f0647099700 1 -- 172.21.15.63:0/3351065722 shutdown_connections 2020-05-18T21:33:20.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.628+0000 7f0647099700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f061804fd80 0x7f0618052240 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:20.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.628+0000 7f0647099700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f064009e7f0 0x7f06400624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:20.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.628+0000 7f0647099700 1 --2- 172.21.15.63:0/3351065722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f064009c130 0x7f0640145360 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:20.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.628+0000 7f0647099700 1 -- 172.21.15.63:0/3351065722 >> 172.21.15.63:0/3351065722 conn(0x7f064005b240 msgr2=0x7f0640069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:20.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.628+0000 7f0647099700 1 -- 172.21.15.63:0/3351065722 shutdown_connections 2020-05-18T21:33:20.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.628+0000 7f0647099700 1 -- 172.21.15.63:0/3351065722 wait complete. 2020-05-18T21:33:20.651 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-05-18T21:33:20.652 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:33:20.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.752+0000 7f05bbebc700 1 Processor -- start 2020-05-18T21:33:20.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.752+0000 7f05bbebc700 1 -- start start 2020-05-18T21:33:20.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.752+0000 7f05bbebc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05b40b50b0 0x7f05b40b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:20.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.752+0000 7f05bbebc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f05b4061be0 0x7f05b4062020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:20.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.752+0000 7f05bbebc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f05b4064860 0x7f05b4064d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:20.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.752+0000 7f05bbebc700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b4065ec0 con 0x7f05b4064860 2020-05-18T21:33:20.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.752+0000 7f05bbebc700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b4066160 con 0x7f05b4061be0 2020-05-18T21:33:20.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.752+0000 7f05bbebc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b4064120 con 0x7f05b40b50b0 2020-05-18T21:33:20.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.752+0000 7f05ba459700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f05b4064860 0x7f05b4064d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:20.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05ba459700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f05b4064860 0x7f05b4064d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60186/0 (socket says 172.21.15.63:60186) 2020-05-18T21:33:20.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05ba459700 1 -- 172.21.15.63:0/623976245 learned_addr learned my addr 172.21.15.63:0/623976245 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:20.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05b9457700 1 --2- 172.21.15.63:0/623976245 >> v2:172.21.15.155:3300/0 conn(0x7f05b4061be0 0x7f05b4062020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:20.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05b9c58700 1 --2- 172.21.15.63:0/623976245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05b40b50b0 0x7f05b40b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:20.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05b9457700 1 -- 172.21.15.63:0/623976245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05b40b50b0 msgr2=0x7f05b40b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:20.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05b9457700 1 --2- 172.21.15.63:0/623976245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05b40b50b0 0x7f05b40b8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:20.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05b9457700 1 -- 172.21.15.63:0/623976245 >> v2:172.21.15.63:3300/0 conn(0x7f05b4064860 msgr2=0x7f05b4064d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:20.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05b9457700 1 --2- 172.21.15.63:0/623976245 >> v2:172.21.15.63:3300/0 conn(0x7f05b4064860 0x7f05b4064d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:20.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05b9457700 1 -- 172.21.15.63:0/623976245 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b40643c0 con 0x7f05b4061be0 2020-05-18T21:33:20.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05b9457700 1 --2- 172.21.15.63:0/623976245 >> v2:172.21.15.155:3300/0 conn(0x7f05b4061be0 0x7f05b4062020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f05b00032f0 tx=0x7f05b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05b9457700 1 --2- 172.21.15.63:0/623976245 >> v2:172.21.15.155:3300/0 conn(0x7f05b4061be0 0x7f05b4062020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f05b00032f0 tx=0x7f05b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05b9457700 1 --2- 172.21.15.63:0/623976245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05b4061be0 0x7f05b4062020 secure :-1 s=READY pgs=925 cs=0 l=1 rx=0x7f05b00032f0 tx=0x7f05b0007e00).ready entity=mon.1 client_cookie=be3c0b7a373dd13c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:20.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05b9457700 1 --2- 172.21.15.63:0/623976245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05b4061be0 0x7f05b4062020 secure :-1 s=THROTTLE_DONE pgs=925 cs=0 l=1 rx=0x7f05b00032f0 tx=0x7f05b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05b8c56700 1 -- 172.21.15.63:0/623976245 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05b0011db0 con 0x7f05b4061be0 2020-05-18T21:33:20.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05b9457700 1 --2- 172.21.15.63:0/623976245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05b4061be0 0x7f05b4062020 secure :-1 s=THROTTLE_DONE pgs=925 cs=0 l=1 rx=0x7f05b00032f0 tx=0x7f05b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05b9457700 1 --2- 172.21.15.63:0/623976245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05b4061be0 0x7f05b4062020 secure :-1 s=THROTTLE_DONE pgs=925 cs=0 l=1 rx=0x7f05b00032f0 tx=0x7f05b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05b8c56700 1 -- 172.21.15.63:0/623976245 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b000a180 con 0x7f05b4061be0 2020-05-18T21:33:20.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05b8c56700 1 -- 172.21.15.63:0/623976245 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05b000a5a0 con 0x7f05b4061be0 2020-05-18T21:33:20.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05bbebc700 1 -- 172.21.15.63:0/623976245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05b4061be0 msgr2=0x7f05b4062020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:20.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05bbebc700 1 --2- 172.21.15.63:0/623976245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05b4061be0 0x7f05b4062020 secure :-1 s=READY pgs=925 cs=0 l=1 rx=0x7f05b00032f0 tx=0x7f05b0007e00).stop 2020-05-18T21:33:20.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05bbebc700 1 -- 172.21.15.63:0/623976245 shutdown_connections 2020-05-18T21:33:20.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05bbebc700 1 --2- 172.21.15.63:0/623976245 >> v2:172.21.15.63:3300/0 conn(0x7f05b4064860 0x7f05b4064d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:20.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05bbebc700 1 --2- 172.21.15.63:0/623976245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05b4061be0 0x7f05b4062020 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:20.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05bbebc700 1 --2- 172.21.15.63:0/623976245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05b40b50b0 0x7f05b40b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:20.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05bbebc700 1 -- 172.21.15.63:0/623976245 >> 172.21.15.63:0/623976245 conn(0x7f05b40b83b0 msgr2=0x7f05b40b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:20.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05bbebc700 1 -- 172.21.15.63:0/623976245 shutdown_connections 2020-05-18T21:33:20.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.756+0000 7f05bbebc700 1 -- 172.21.15.63:0/623976245 wait complete. 2020-05-18T21:33:20.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.760+0000 7f05bbebc700 1 Processor -- start 2020-05-18T21:33:20.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.760+0000 7f05bbebc700 1 -- start start 2020-05-18T21:33:20.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.760+0000 7f05bbebc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f05b4061be0 0x7f05b414b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:20.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.760+0000 7f05bbebc700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b415b620 con 0x7f05b4064860 2020-05-18T21:33:20.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.760+0000 7f05bbebc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b415b8c0 con 0x7f05b40b50b0 2020-05-18T21:33:20.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.760+0000 7f05bbebc700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b40af3f0 con 0x7f05b4061be0 2020-05-18T21:33:20.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.760+0000 7f05b9c58700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f05b4061be0 0x7f05b414b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:20.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.760+0000 7f05b9457700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f05b4064860 0x7f05b415ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34146/0 (socket says 172.21.15.63:34146) 2020-05-18T21:33:20.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.760+0000 7f05b9457700 1 -- 172.21.15.63:0/812728134 learned_addr learned my addr 172.21.15.63:0/812728134 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:20.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.760+0000 7f05b9c58700 1 -- 172.21.15.63:0/812728134 >> v1:172.21.15.155:6789/0 conn(0x7f05b40b50b0 legacy=0x7f05b414bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:20.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.760+0000 7f05b9c58700 1 -- 172.21.15.63:0/812728134 >> v1:172.21.15.63:6789/0 conn(0x7f05b4064860 legacy=0x7f05b415ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:20.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.760+0000 7f05b9c58700 1 -- 172.21.15.63:0/812728134 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b415bb60 con 0x7f05b4061be0 2020-05-18T21:33:20.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.760+0000 7f05a6ffd700 1 -- 172.21.15.63:0/812728134 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155230130 0 0) 0x7f05b415b620 con 0x7f05b4064860 2020-05-18T21:33:20.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.760+0000 7f05b9c58700 1 --2- 172.21.15.63:0/812728134 >> v2:172.21.15.63:3300/0 conn(0x7f05b4061be0 0x7f05b414b760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05ac007960 tx=0x7f05b405b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.764+0000 7f05b9c58700 1 --2- 172.21.15.63:0/812728134 >> v2:172.21.15.63:3300/0 conn(0x7f05b4061be0 0x7f05b414b760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05ac007960 tx=0x7f05b405b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.764+0000 7f05b9c58700 1 --2- 172.21.15.63:0/812728134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b4061be0 0x7f05b414b760 secure :-1 s=READY pgs=1368 cs=0 l=1 rx=0x7f05ac007960 tx=0x7f05b405b560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:20.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.764+0000 7f05b9c58700 1 --2- 172.21.15.63:0/812728134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b4061be0 0x7f05b414b760 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7f05ac007960 tx=0x7f05b405b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.764+0000 7f05a6ffd700 1 -- 172.21.15.63:0/812728134 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05a8012a60 con 0x7f05b4061be0 2020-05-18T21:33:20.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.764+0000 7f05b9c58700 1 --2- 172.21.15.63:0/812728134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b4061be0 0x7f05b414b760 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7f05ac007960 tx=0x7f05b405b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.764+0000 7f05b9c58700 1 --2- 172.21.15.63:0/812728134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b4061be0 0x7f05b414b760 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7f05ac007960 tx=0x7f05b405b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.764+0000 7f05a6ffd700 1 -- 172.21.15.63:0/812728134 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a8012bc0 con 0x7f05b4061be0 2020-05-18T21:33:20.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.764+0000 7f05bbebc700 1 -- 172.21.15.63:0/812728134 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b414d770 con 0x7f05b4061be0 2020-05-18T21:33:20.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.764+0000 7f05a6ffd700 1 -- 172.21.15.63:0/812728134 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05a800e280 con 0x7f05b4061be0 2020-05-18T21:33:20.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.764+0000 7f05bbebc700 1 -- 172.21.15.63:0/812728134 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b414c780 con 0x7f05b4061be0 2020-05-18T21:33:20.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.764+0000 7f05b9c58700 1 --2- 172.21.15.63:0/812728134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b4061be0 0x7f05b414b760 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7f05ac007960 tx=0x7f05b405b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.764+0000 7f05bbebc700 1 -- 172.21.15.63:0/812728134 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b40b7c40 con 0x7f05b4061be0 2020-05-18T21:33:20.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.764+0000 7f05a6ffd700 1 -- 172.21.15.63:0/812728134 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f05a8007190 con 0x7f05b4061be0 2020-05-18T21:33:20.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.764+0000 7f05b9c58700 1 --2- 172.21.15.63:0/812728134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b4061be0 0x7f05b414b760 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7f05ac007960 tx=0x7f05b405b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.764+0000 7f05a6ffd700 1 --2- 172.21.15.63:0/812728134 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f059404f890 0x7f0594051d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:20.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.764+0000 7f05a6ffd700 1 -- 172.21.15.63:0/812728134 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f05a80120d0 con 0x7f05b4061be0 2020-05-18T21:33:20.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.764+0000 7f05b9457700 1 --2- 172.21.15.63:0/812728134 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f059404f890 0x7f0594051d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:20.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.768+0000 7f05b9457700 1 --2- 172.21.15.63:0/812728134 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f059404f890 0x7f0594051d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05b00086a0 tx=0x7f05b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.768+0000 7f05b9457700 1 --2- 172.21.15.63:0/812728134 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f059404f890 0x7f0594051d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05b00086a0 tx=0x7f05b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.768+0000 7f05b9457700 1 --2- 172.21.15.63:0/812728134 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f059404f890 0x7f0594051d50 secure :-1 s=READY pgs=538 cs=0 l=1 rx=0x7f05b00086a0 tx=0x7f05b0007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:20.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.772+0000 7f05b9c58700 1 --2- 172.21.15.63:0/812728134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b4061be0 0x7f05b414b760 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7f05ac007960 tx=0x7f05b405b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.772+0000 7f05a6ffd700 1 -- 172.21.15.63:0/812728134 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f05a803e030 con 0x7f05b4061be0 2020-05-18T21:33:20.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.888+0000 7f05bbebc700 1 -- 172.21.15.63:0/812728134 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f05b40569e0 con 0x7f05b4061be0 2020-05-18T21:33:20.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.888+0000 7f05b9c58700 1 --2- 172.21.15.63:0/812728134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b4061be0 0x7f05b414b760 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7f05ac007960 tx=0x7f05b405b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:20.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.888+0000 7f05a6ffd700 1 -- 172.21.15.63:0/812728134 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v100) v1 ==== 110+0+10 (secure 0 0 0) 0x7f05a8041650 con 0x7f05b4061be0 2020-05-18T21:33:20.896 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:33:20.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.892+0000 7f05bbebc700 1 -- 172.21.15.63:0/812728134 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f059404f890 msgr2=0x7f0594051d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.892+0000 7f05bbebc700 1 --2- 172.21.15.63:0/812728134 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f059404f890 0x7f0594051d50 secure :-1 s=READY pgs=538 cs=0 l=1 rx=0x7f05b00086a0 tx=0x7f05b0007e00).stop 2020-05-18T21:33:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.892+0000 7f05bbebc700 1 -- 172.21.15.63:0/812728134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b4061be0 msgr2=0x7f05b414b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.892+0000 7f05bbebc700 1 --2- 172.21.15.63:0/812728134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b4061be0 0x7f05b414b760 secure :-1 s=READY pgs=1368 cs=0 l=1 rx=0x7f05ac007960 tx=0x7f05b405b560).stop 2020-05-18T21:33:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.892+0000 7f05bbebc700 1 -- 172.21.15.63:0/812728134 shutdown_connections 2020-05-18T21:33:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.892+0000 7f05bbebc700 1 --2- 172.21.15.63:0/812728134 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f059404f890 0x7f0594051d50 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:20.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.892+0000 7f05bbebc700 1 --2- 172.21.15.63:0/812728134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b4061be0 0x7f05b414b760 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:20.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.892+0000 7f05bbebc700 1 -- 172.21.15.63:0/812728134 >> 172.21.15.63:0/812728134 conn(0x7f05b40b83b0 msgr2=0x7f05b40b63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:20.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.892+0000 7f05bbebc700 1 -- 172.21.15.63:0/812728134 shutdown_connections 2020-05-18T21:33:20.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:20.892+0000 7f05bbebc700 1 -- 172.21.15.63:0/812728134 wait complete. 2020-05-18T21:33:20.915 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:33:21.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.020+0000 7f48f65f8700 1 Processor -- start 2020-05-18T21:33:21.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.020+0000 7f48f65f8700 1 -- start start 2020-05-18T21:33:21.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.020+0000 7f48f65f8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f48f005f640 0x7f48f00b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:21.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.020+0000 7f48f65f8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f48f0143560 0x7f48f0146990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:21.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.020+0000 7f48f65f8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f0146250 con 0x7f48f0149f20 2020-05-18T21:33:21.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.020+0000 7f48f65f8700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f01464f0 con 0x7f48f005f640 2020-05-18T21:33:21.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.020+0000 7f48f65f8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f0146df0 con 0x7f48f0143560 2020-05-18T21:33:21.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f55f6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f48f005f640 0x7f48f00b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:21.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f5df7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f48f0143560 0x7f48f0146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:21.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f5df7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f48f0143560 0x7f48f0146990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:46816/0 (socket says 172.21.15.63:46816) 2020-05-18T21:33:21.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f4df5700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f48f0149f20 0x7f48f0142e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:60702/0 (socket says 172.21.15.63:60702) 2020-05-18T21:33:21.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f5df7700 1 -- 172.21.15.63:0/536990985 learned_addr learned my addr 172.21.15.63:0/536990985 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:21.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f5df7700 1 -- 172.21.15.63:0/536990985 >> v2:172.21.15.63:3300/0 conn(0x7f48f005f640 msgr2=0x7f48f00b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:21.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f5df7700 1 --2- 172.21.15.63:0/536990985 >> v2:172.21.15.63:3300/0 conn(0x7f48f005f640 0x7f48f00b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:21.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f5df7700 1 -- 172.21.15.63:0/536990985 >> v1:172.21.15.155:6789/0 conn(0x7f48f0149f20 legacy=0x7f48f0142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f5df7700 1 -- 172.21.15.63:0/536990985 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f005fa20 con 0x7f48f0143560 2020-05-18T21:33:21.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f55f6700 1 --2- 172.21.15.63:0/536990985 >> v2:172.21.15.63:3300/0 conn(0x7f48f005f640 0x7f48f00b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:21.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f5df7700 1 --2- 172.21.15.63:0/536990985 >> v2:172.21.15.155:3300/0 conn(0x7f48f0143560 0x7f48f0146990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f48e80032f0 tx=0x7f48e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f5df7700 1 --2- 172.21.15.63:0/536990985 >> v2:172.21.15.155:3300/0 conn(0x7f48f0143560 0x7f48f0146990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f48e80032f0 tx=0x7f48e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f5df7700 1 --2- 172.21.15.63:0/536990985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f0143560 0x7f48f0146990 secure :-1 s=READY pgs=928 cs=0 l=1 rx=0x7f48e80032f0 tx=0x7f48e8007e00).ready entity=mon.1 client_cookie=a23fca908b1b32e3 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:21.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f5df7700 1 --2- 172.21.15.63:0/536990985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f0143560 0x7f48f0146990 secure :-1 s=THROTTLE_DONE pgs=928 cs=0 l=1 rx=0x7f48e80032f0 tx=0x7f48e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48dffff700 1 -- 172.21.15.63:0/536990985 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48e8011e00 con 0x7f48f0143560 2020-05-18T21:33:21.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f5df7700 1 --2- 172.21.15.63:0/536990985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f0143560 0x7f48f0146990 secure :-1 s=THROTTLE_DONE pgs=928 cs=0 l=1 rx=0x7f48e80032f0 tx=0x7f48e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f5df7700 1 --2- 172.21.15.63:0/536990985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f0143560 0x7f48f0146990 secure :-1 s=THROTTLE_DONE pgs=928 cs=0 l=1 rx=0x7f48e80032f0 tx=0x7f48e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48dffff700 1 -- 172.21.15.63:0/536990985 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e800a180 con 0x7f48f0143560 2020-05-18T21:33:21.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48dffff700 1 -- 172.21.15.63:0/536990985 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48e800a5a0 con 0x7f48f0143560 2020-05-18T21:33:21.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f65f8700 1 -- 172.21.15.63:0/536990985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f0143560 msgr2=0x7f48f0146990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f65f8700 1 --2- 172.21.15.63:0/536990985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f0143560 0x7f48f0146990 secure :-1 s=READY pgs=928 cs=0 l=1 rx=0x7f48e80032f0 tx=0x7f48e8007e00).stop 2020-05-18T21:33:21.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f65f8700 1 -- 172.21.15.63:0/536990985 shutdown_connections 2020-05-18T21:33:21.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f65f8700 1 --2- 172.21.15.63:0/536990985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f0143560 0x7f48f0146990 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:21.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f65f8700 1 --2- 172.21.15.63:0/536990985 >> v2:172.21.15.63:3300/0 conn(0x7f48f005f640 0x7f48f00b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:21.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f65f8700 1 -- 172.21.15.63:0/536990985 >> 172.21.15.63:0/536990985 conn(0x7f48f005b290 msgr2=0x7f48f005ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:21.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f65f8700 1 -- 172.21.15.63:0/536990985 shutdown_connections 2020-05-18T21:33:21.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.024+0000 7f48f65f8700 1 -- 172.21.15.63:0/536990985 wait complete. 2020-05-18T21:33:21.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f65f8700 1 Processor -- start 2020-05-18T21:33:21.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f65f8700 1 -- start start 2020-05-18T21:33:21.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f65f8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0143560 0x7f48f00b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:21.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f65f8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f00b2280 con 0x7f48f005f640 2020-05-18T21:33:21.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f65f8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f00b35b0 con 0x7f48f0149f20 2020-05-18T21:33:21.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f65f8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f00b29a0 con 0x7f48f0143560 2020-05-18T21:33:21.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f55f6700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f48f005f640 0x7f48f0144e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34158/0 (socket says 172.21.15.63:34158) 2020-05-18T21:33:21.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f55f6700 1 -- 172.21.15.63:0/571267651 learned_addr learned my addr 172.21.15.63:0/571267651 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:21.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f4df5700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0143560 0x7f48f00b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:21.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48de7fc700 1 -- 172.21.15.63:0/571267651 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24170421 0 0) 0x7f48f00b2280 con 0x7f48f005f640 2020-05-18T21:33:21.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48de7fc700 1 -- 172.21.15.63:0/571267651 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48d0002fe0 con 0x7f48f005f640 2020-05-18T21:33:21.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48de7fc700 1 -- 172.21.15.63:0/571267651 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 630568729 0 0) 0x7f48d0002fe0 con 0x7f48f005f640 2020-05-18T21:33:21.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48de7fc700 1 -- 172.21.15.63:0/571267651 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f48f00b2280 con 0x7f48f005f640 2020-05-18T21:33:21.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48de7fc700 1 -- 172.21.15.63:0/571267651 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f48ec002500 con 0x7f48f005f640 2020-05-18T21:33:21.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48de7fc700 1 -- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0143560 msgr2=0x7f48f00b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48de7fc700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0143560 0x7f48f00b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:21.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48de7fc700 1 -- 172.21.15.63:0/571267651 >> v1:172.21.15.155:6789/0 conn(0x7f48f0149f20 legacy=0x7f48f00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48de7fc700 1 -- 172.21.15.63:0/571267651 >> v1:172.21.15.63:6789/0 conn(0x7f48f005f640 legacy=0x7f48f0144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48de7fc700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0143560 0x7f48d0004a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:21.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48de7fc700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48d0004ee0 0x7f48d00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:21.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48de7fc700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48d0003e00 0x7f48d0004260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:21.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48de7fc700 1 -- 172.21.15.63:0/571267651 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d00047e0 con 0x7f48d0004ee0 2020-05-18T21:33:21.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48de7fc700 1 -- 172.21.15.63:0/571267651 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d0005400 con 0x7f48d0003e00 2020-05-18T21:33:21.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48de7fc700 1 -- 172.21.15.63:0/571267651 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d00055c0 con 0x7f48f0143560 2020-05-18T21:33:21.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f4df5700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48d0004ee0 0x7f48d00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:21.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f55f6700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0143560 0x7f48d0004a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:21.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f5df7700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48d0003e00 0x7f48d0004260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:21.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f55f6700 1 -- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48d0003e00 msgr2=0x7f48d0004260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f55f6700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48d0003e00 0x7f48d0004260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:21.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f55f6700 1 -- 172.21.15.63:0/571267651 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48d0004ee0 msgr2=0x7f48d00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f55f6700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48d0004ee0 0x7f48d00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:21.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f55f6700 1 -- 172.21.15.63:0/571267651 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f00b2500 con 0x7f48f0143560 2020-05-18T21:33:21.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f65f8700 1 -- 172.21.15.63:0/571267651 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f00b32f0 con 0x7f48f0143560 2020-05-18T21:33:21.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f55f6700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0143560 0x7f48d0004a80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f48ec007ac0 tx=0x7f48ec011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f4df5700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48d0004ee0 0x7f48d00039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:21.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f65f8700 1 -- 172.21.15.63:0/571267651 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f00b8920 con 0x7f48f0143560 2020-05-18T21:33:21.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f55f6700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0143560 0x7f48d0004a80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f48ec007ac0 tx=0x7f48ec011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f55f6700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0143560 0x7f48d0004a80 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7f48ec007ac0 tx=0x7f48ec011920).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:21.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f55f6700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0143560 0x7f48d0004a80 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f48ec007ac0 tx=0x7f48ec011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48de7fc700 1 -- 172.21.15.63:0/571267651 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48ec007600 con 0x7f48f0143560 2020-05-18T21:33:21.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f55f6700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0143560 0x7f48d0004a80 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f48ec007ac0 tx=0x7f48ec011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48de7fc700 1 -- 172.21.15.63:0/571267651 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec005910 con 0x7f48f0143560 2020-05-18T21:33:21.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48f55f6700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0143560 0x7f48d0004a80 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f48ec007ac0 tx=0x7f48ec011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.028+0000 7f48de7fc700 1 -- 172.21.15.63:0/571267651 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48ec005cf0 con 0x7f48f0143560 2020-05-18T21:33:21.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.032+0000 7f48f65f8700 1 -- 172.21.15.63:0/571267651 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48cc003380 con 0x7f48f0143560 2020-05-18T21:33:21.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.032+0000 7f48f55f6700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0143560 0x7f48d0004a80 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f48ec007ac0 tx=0x7f48ec011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.032+0000 7f48de7fc700 1 -- 172.21.15.63:0/571267651 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f48ec00d3f0 con 0x7f48f0143560 2020-05-18T21:33:21.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.032+0000 7f48f55f6700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0143560 0x7f48d0004a80 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f48ec007ac0 tx=0x7f48ec011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.032+0000 7f48de7fc700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48d0057d30 0x7f48d005a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:21.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.032+0000 7f48de7fc700 1 -- 172.21.15.63:0/571267651 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f48ec0643f0 con 0x7f48f0143560 2020-05-18T21:33:21.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.032+0000 7f48f4df5700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48d0057d30 0x7f48d005a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:21.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.032+0000 7f48f4df5700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48d0057d30 0x7f48d005a1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f48f0061300 tx=0x7f48e0001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.032+0000 7f48f4df5700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48d0057d30 0x7f48d005a1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f48f0061300 tx=0x7f48e0001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.032+0000 7f48f4df5700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48d0057d30 0x7f48d005a1f0 secure :-1 s=READY pgs=539 cs=0 l=1 rx=0x7f48f0061300 tx=0x7f48e0001720).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:21.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.040+0000 7f48f55f6700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0143560 0x7f48d0004a80 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f48ec007ac0 tx=0x7f48ec011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.040+0000 7f48de7fc700 1 -- 172.21.15.63:0/571267651 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f48ec03e7e0 con 0x7f48f0143560 2020-05-18T21:33:21.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.160+0000 7f48f65f8700 1 -- 172.21.15.63:0/571267651 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f48cc002240 con 0x7f48f0143560 2020-05-18T21:33:21.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.160+0000 7f48f55f6700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0143560 0x7f48d0004a80 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f48ec007ac0 tx=0x7f48ec011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.160+0000 7f48de7fc700 1 -- 172.21.15.63:0/571267651 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v100) v1 ==== 92+0+10 (secure 0 0 0) 0x7f48ec041e00 con 0x7f48f0143560 2020-05-18T21:33:21.168 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:33:21.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.164+0000 7f48f65f8700 1 -- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48d0057d30 msgr2=0x7f48d005a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.164+0000 7f48f65f8700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48d0057d30 0x7f48d005a1f0 secure :-1 s=READY pgs=539 cs=0 l=1 rx=0x7f48f0061300 tx=0x7f48e0001720).stop 2020-05-18T21:33:21.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.164+0000 7f48f5df7700 1 -- 172.21.15.63:0/571267651 reap_dead start 2020-05-18T21:33:21.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.164+0000 7f48f65f8700 1 -- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0143560 msgr2=0x7f48d0004a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.164+0000 7f48f65f8700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0143560 0x7f48d0004a80 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7f48ec007ac0 tx=0x7f48ec011920).stop 2020-05-18T21:33:21.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.164+0000 7f48f65f8700 1 -- 172.21.15.63:0/571267651 shutdown_connections 2020-05-18T21:33:21.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.164+0000 7f48f65f8700 1 --2- 172.21.15.63:0/571267651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0143560 0x7f48d0004a80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:21.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.164+0000 7f48f65f8700 1 -- 172.21.15.63:0/571267651 >> 172.21.15.63:0/571267651 conn(0x7f48f005b290 msgr2=0x7f48f009da60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:21.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.164+0000 7f48f65f8700 1 -- 172.21.15.63:0/571267651 shutdown_connections 2020-05-18T21:33:21.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.164+0000 7f48f65f8700 1 -- 172.21.15.63:0/571267651 wait complete. 2020-05-18T21:33:21.186 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-05-18T21:33:21.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.284+0000 7f7181ad1700 1 Processor -- start 2020-05-18T21:33:21.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.284+0000 7f7181ad1700 1 -- start start 2020-05-18T21:33:21.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f7181ad1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f717c069fb0 0x7f717c143e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:21.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f7181ad1700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717c06a5e0 con 0x7f717c09e4b0 2020-05-18T21:33:21.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f7181ad1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717c06a880 con 0x7f717c09e0d0 2020-05-18T21:33:21.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f7181ad1700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717c064a90 con 0x7f717c069fb0 2020-05-18T21:33:21.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f717bfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f717c09e4b0 0x7f717c13d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34174/0 (socket says 172.21.15.63:34174) 2020-05-18T21:33:21.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f717bfff700 1 -- 172.21.15.63:0/1486165432 learned_addr learned my addr 172.21.15.63:0/1486165432 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:21.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f71812d0700 1 --2- 172.21.15.63:0/1486165432 >> v2:172.21.15.155:3300/0 conn(0x7f717c069fb0 0x7f717c143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:21.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f717b7fe700 1 -- 172.21.15.63:0/1486165432 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724946538 0 0) 0x7f717c06a5e0 con 0x7f717c09e4b0 2020-05-18T21:33:21.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f717b7fe700 1 -- 172.21.15.63:0/1486165432 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7168003270 con 0x7f717c09e4b0 2020-05-18T21:33:21.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f717b7fe700 1 -- 172.21.15.63:0/1486165432 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026528756 0 0) 0x7f717c06a880 con 0x7f717c09e0d0 2020-05-18T21:33:21.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f717b7fe700 1 -- 172.21.15.63:0/1486165432 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f717c06a5e0 con 0x7f717c09e0d0 2020-05-18T21:33:21.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f717b7fe700 1 -- 172.21.15.63:0/1486165432 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1375257985 0 0) 0x7f7168003270 con 0x7f717c09e4b0 2020-05-18T21:33:21.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f71812d0700 1 -- 172.21.15.63:0/1486165432 >> v1:172.21.15.155:6789/0 conn(0x7f717c09e0d0 legacy=0x7f717c147a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f71812d0700 1 -- 172.21.15.63:0/1486165432 >> v1:172.21.15.63:6789/0 conn(0x7f717c09e4b0 legacy=0x7f717c13d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f71812d0700 1 -- 172.21.15.63:0/1486165432 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717c064bd0 con 0x7f717c069fb0 2020-05-18T21:33:21.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f71812d0700 1 --2- 172.21.15.63:0/1486165432 >> v2:172.21.15.155:3300/0 conn(0x7f717c069fb0 0x7f717c143e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f716c001110 tx=0x7f7174007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f71812d0700 1 --2- 172.21.15.63:0/1486165432 >> v2:172.21.15.155:3300/0 conn(0x7f717c069fb0 0x7f717c143e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f716c001110 tx=0x7f7174007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f71812d0700 1 --2- 172.21.15.63:0/1486165432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f717c069fb0 0x7f717c143e80 secure :-1 s=READY pgs=931 cs=0 l=1 rx=0x7f716c001110 tx=0x7f7174007e00).ready entity=mon.1 client_cookie=6267b03e012a591b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:21.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f71812d0700 1 --2- 172.21.15.63:0/1486165432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f717c069fb0 0x7f717c143e80 secure :-1 s=THROTTLE_DONE pgs=931 cs=0 l=1 rx=0x7f716c001110 tx=0x7f7174007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f717b7fe700 1 -- 172.21.15.63:0/1486165432 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f716c001710 con 0x7f717c069fb0 2020-05-18T21:33:21.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f71812d0700 1 --2- 172.21.15.63:0/1486165432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f717c069fb0 0x7f717c143e80 secure :-1 s=THROTTLE_DONE pgs=931 cs=0 l=1 rx=0x7f716c001110 tx=0x7f7174007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f717b7fe700 1 -- 172.21.15.63:0/1486165432 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7174011ac0 con 0x7f717c069fb0 2020-05-18T21:33:21.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f71812d0700 1 --2- 172.21.15.63:0/1486165432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f717c069fb0 0x7f717c143e80 secure :-1 s=THROTTLE_DONE pgs=931 cs=0 l=1 rx=0x7f716c001110 tx=0x7f7174007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f717b7fe700 1 -- 172.21.15.63:0/1486165432 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7174011e20 con 0x7f717c069fb0 2020-05-18T21:33:21.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f7181ad1700 1 -- 172.21.15.63:0/1486165432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f717c069fb0 msgr2=0x7f717c143e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.288+0000 7f7181ad1700 1 --2- 172.21.15.63:0/1486165432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f717c069fb0 0x7f717c143e80 secure :-1 s=READY pgs=931 cs=0 l=1 rx=0x7f716c001110 tx=0x7f7174007e00).stop 2020-05-18T21:33:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.292+0000 7f7181ad1700 1 -- 172.21.15.63:0/1486165432 shutdown_connections 2020-05-18T21:33:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.292+0000 7f7181ad1700 1 --2- 172.21.15.63:0/1486165432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f717c069fb0 0x7f717c143e80 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.292+0000 7f7181ad1700 1 -- 172.21.15.63:0/1486165432 >> 172.21.15.63:0/1486165432 conn(0x7f717c05a7c0 msgr2=0x7f717c05aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.292+0000 7f7181ad1700 1 -- 172.21.15.63:0/1486165432 shutdown_connections 2020-05-18T21:33:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.292+0000 7f7181ad1700 1 -- 172.21.15.63:0/1486165432 wait complete. 2020-05-18T21:33:21.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.292+0000 7f7181ad1700 1 Processor -- start 2020-05-18T21:33:21.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.292+0000 7f7181ad1700 1 -- start start 2020-05-18T21:33:21.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.292+0000 7f7181ad1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c09e0d0 0x7f717c061e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:21.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f7181ad1700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717c1400f0 con 0x7f717c09e4b0 2020-05-18T21:33:21.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f7181ad1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717c140390 con 0x7f717c069fb0 2020-05-18T21:33:21.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f7181ad1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717c062320 con 0x7f717c09e0d0 2020-05-18T21:33:21.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f71812d0700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f717c09e4b0 0x7f717c13ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34182/0 (socket says 172.21.15.63:34182) 2020-05-18T21:33:21.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f71812d0700 1 -- 172.21.15.63:0/2171827087 learned_addr learned my addr 172.21.15.63:0/2171827087 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:21.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f717bfff700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c09e0d0 0x7f717c061e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:21.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f7179ffb700 1 -- 172.21.15.63:0/2171827087 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322798297 0 0) 0x7f717c1400f0 con 0x7f717c09e4b0 2020-05-18T21:33:21.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f7179ffb700 1 -- 172.21.15.63:0/2171827087 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f715c002fe0 con 0x7f717c09e4b0 2020-05-18T21:33:21.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f7179ffb700 1 -- 172.21.15.63:0/2171827087 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284691686 0 0) 0x7f717c140390 con 0x7f717c069fb0 2020-05-18T21:33:21.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f7179ffb700 1 -- 172.21.15.63:0/2171827087 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f717c1400f0 con 0x7f717c069fb0 2020-05-18T21:33:21.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f717bfff700 1 -- 172.21.15.63:0/2171827087 >> v1:172.21.15.155:6789/0 conn(0x7f717c069fb0 legacy=0x7f717c0af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f717bfff700 1 -- 172.21.15.63:0/2171827087 >> v1:172.21.15.63:6789/0 conn(0x7f717c09e4b0 legacy=0x7f717c13ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f717bfff700 1 -- 172.21.15.63:0/2171827087 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717c140630 con 0x7f717c09e0d0 2020-05-18T21:33:21.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f717bfff700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c09e0d0 0x7f717c061e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f716c000fe0 tx=0x7f716c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f717bfff700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c09e0d0 0x7f717c061e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f716c000fe0 tx=0x7f716c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f717bfff700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c09e0d0 0x7f717c061e30 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7f716c000fe0 tx=0x7f716c010c60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f717bfff700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c09e0d0 0x7f717c061e30 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f716c000fe0 tx=0x7f716c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f7179ffb700 1 -- 172.21.15.63:0/2171827087 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f716c00c990 con 0x7f717c09e0d0 2020-05-18T21:33:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f717bfff700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c09e0d0 0x7f717c061e30 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f716c000fe0 tx=0x7f716c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f717bfff700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c09e0d0 0x7f717c061e30 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f716c000fe0 tx=0x7f716c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f7179ffb700 1 -- 172.21.15.63:0/2171827087 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c00caf0 con 0x7f717c09e0d0 2020-05-18T21:33:21.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f7181ad1700 1 -- 172.21.15.63:0/2171827087 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717c13f330 con 0x7f717c09e0d0 2020-05-18T21:33:21.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f7179ffb700 1 -- 172.21.15.63:0/2171827087 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f716c00ce90 con 0x7f717c09e0d0 2020-05-18T21:33:21.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f7181ad1700 1 -- 172.21.15.63:0/2171827087 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717c13ce70 con 0x7f717c09e0d0 2020-05-18T21:33:21.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f717bfff700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c09e0d0 0x7f717c061e30 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f716c000fe0 tx=0x7f716c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.296+0000 7f7181ad1700 1 -- 172.21.15.63:0/2171827087 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f717c1407c0 con 0x7f717c09e0d0 2020-05-18T21:33:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.300+0000 7f717bfff700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c09e0d0 0x7f717c061e30 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f716c000fe0 tx=0x7f716c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.300+0000 7f7179ffb700 1 -- 172.21.15.63:0/2171827087 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f716c004530 con 0x7f717c09e0d0 2020-05-18T21:33:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.300+0000 7f7179ffb700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f715c04fe30 0x7f715c0522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.300+0000 7f7179ffb700 1 -- 172.21.15.63:0/2171827087 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f716c063be0 con 0x7f717c09e0d0 2020-05-18T21:33:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.300+0000 7f7180acf700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f715c04fe30 0x7f715c0522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:21.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.300+0000 7f7180acf700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f715c04fe30 0x7f715c0522f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f71700012c0 tx=0x7f7170002760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.300+0000 7f7180acf700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f715c04fe30 0x7f715c0522f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f71700012c0 tx=0x7f7170002760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.300+0000 7f7180acf700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f715c04fe30 0x7f715c0522f0 secure :-1 s=READY pgs=540 cs=0 l=1 rx=0x7f71700012c0 tx=0x7f7170002760).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:21.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.308+0000 7f717bfff700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c09e0d0 0x7f717c061e30 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f716c000fe0 tx=0x7f716c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.308+0000 7f7179ffb700 1 -- 172.21.15.63:0/2171827087 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f716c03ded0 con 0x7f717c09e0d0 2020-05-18T21:33:21.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.428+0000 7f7181ad1700 1 -- 172.21.15.63:0/2171827087 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f717c0569e0 con 0x7f717c09e0d0 2020-05-18T21:33:21.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.428+0000 7f717bfff700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c09e0d0 0x7f717c061e30 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f716c000fe0 tx=0x7f716c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.428+0000 7f7179ffb700 1 -- 172.21.15.63:0/2171827087 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v100) v1 ==== 84+0+143 (secure 0 0 0) 0x7f716c0414f0 con 0x7f717c09e0d0 2020-05-18T21:33:21.436 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:21.436 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:33:21.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:21.437 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2020-05-18T21:33:21.437 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "device_health_metrics" 2020-05-18T21:33:21.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:21.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:21.438 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 2, 2020-05-18T21:33:21.438 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "rbd" 2020-05-18T21:33:21.438 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:21.438 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:33:21.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.432+0000 7f7181ad1700 1 -- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f715c04fe30 msgr2=0x7f715c0522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.432+0000 7f7181ad1700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f715c04fe30 0x7f715c0522f0 secure :-1 s=READY pgs=540 cs=0 l=1 rx=0x7f71700012c0 tx=0x7f7170002760).stop 2020-05-18T21:33:21.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.432+0000 7f7181ad1700 1 -- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c09e0d0 msgr2=0x7f717c061e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.432+0000 7f7181ad1700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c09e0d0 0x7f717c061e30 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7f716c000fe0 tx=0x7f716c010c60).stop 2020-05-18T21:33:21.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.432+0000 7f7181ad1700 1 -- 172.21.15.63:0/2171827087 shutdown_connections 2020-05-18T21:33:21.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.432+0000 7f7181ad1700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f715c04fe30 0x7f715c0522f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:21.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.432+0000 7f7181ad1700 1 --2- 172.21.15.63:0/2171827087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c09e0d0 0x7f717c061e30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:21.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.432+0000 7f7181ad1700 1 -- 172.21.15.63:0/2171827087 >> 172.21.15.63:0/2171827087 conn(0x7f717c05a7c0 msgr2=0x7f717c05aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:21.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.432+0000 7f7181ad1700 1 -- 172.21.15.63:0/2171827087 shutdown_connections 2020-05-18T21:33:21.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.432+0000 7f7181ad1700 1 -- 172.21.15.63:0/2171827087 wait complete. 2020-05-18T21:33:21.456 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-05-18T21:33:21.463 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-05-18T21:33:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.572+0000 7efeb60ed700 1 Processor -- start 2020-05-18T21:33:21.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.572+0000 7efeb60ed700 1 -- start start 2020-05-18T21:33:21.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.572+0000 7efeb60ed700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efeb00bc8d0 0x7efeb0060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:21.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.572+0000 7efeb60ed700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb0146420 con 0x7efeb0145e30 2020-05-18T21:33:21.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.572+0000 7efeb60ed700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb01466c0 con 0x7efeb0143630 2020-05-18T21:33:21.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.572+0000 7efeb60ed700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb0146e00 con 0x7efeb00bc8d0 2020-05-18T21:33:21.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.572+0000 7efeb48ea700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efeb0145e30 0x7efeb0142f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34186/0 (socket says 172.21.15.63:34186) 2020-05-18T21:33:21.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.572+0000 7efeb48ea700 1 -- 172.21.15.63:0/3807568781 learned_addr learned my addr 172.21.15.63:0/3807568781 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:21.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.572+0000 7efeb50eb700 1 --2- 172.21.15.63:0/3807568781 >> v2:172.21.15.155:3300/0 conn(0x7efeb00bc8d0 0x7efeb0060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:21.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 -- 172.21.15.63:0/3807568781 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035321665 0 0) 0x7efeb0146420 con 0x7efeb0145e30 2020-05-18T21:33:21.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 -- 172.21.15.63:0/3807568781 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe94003270 con 0x7efeb0145e30 2020-05-18T21:33:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 -- 172.21.15.63:0/3807568781 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734014137 0 0) 0x7efeb01466c0 con 0x7efeb0143630 2020-05-18T21:33:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 -- 172.21.15.63:0/3807568781 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeb0146420 con 0x7efeb0143630 2020-05-18T21:33:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 -- 172.21.15.63:0/3807568781 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3798529820 0 0) 0x7efe94003270 con 0x7efeb0145e30 2020-05-18T21:33:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 -- 172.21.15.63:0/3807568781 >> v2:172.21.15.155:3300/0 conn(0x7efeb00bc8d0 msgr2=0x7efeb0060b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 --2- 172.21.15.63:0/3807568781 >> v2:172.21.15.155:3300/0 conn(0x7efeb00bc8d0 0x7efeb0060b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 -- 172.21.15.63:0/3807568781 >> v1:172.21.15.155:6789/0 conn(0x7efeb0143630 legacy=0x7efeb012e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 -- 172.21.15.63:0/3807568781 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb0146960 con 0x7efeb0145e30 2020-05-18T21:33:21.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 -- 172.21.15.63:0/3807568781 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7efeac001890 con 0x7efeb0145e30 2020-05-18T21:33:21.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 -- 172.21.15.63:0/3807568781 >> v1:172.21.15.63:6789/0 conn(0x7efeb0145e30 legacy=0x7efeb0142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 --2- 172.21.15.63:0/3807568781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe94003940 0x7efe94003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:21.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 --2- 172.21.15.63:0/3807568781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe94004510 0x7efe94004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:21.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 --2- 172.21.15.63:0/3807568781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe94004df0 0x7efe9400b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:21.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 -- 172.21.15.63:0/3807568781 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb0146e00 con 0x7efe94004df0 2020-05-18T21:33:21.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 -- 172.21.15.63:0/3807568781 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9400bbc0 con 0x7efe94004510 2020-05-18T21:33:21.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 -- 172.21.15.63:0/3807568781 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9400bd00 con 0x7efe94003940 2020-05-18T21:33:21.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb50eb700 1 --2- 172.21.15.63:0/3807568781 >> v2:172.21.15.155:3300/0 conn(0x7efeb00bc8d0 0x7efeb0060b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:21.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb58ec700 1 --2- 172.21.15.63:0/3807568781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe94004df0 0x7efe9400b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:21.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb48ea700 1 --2- 172.21.15.63:0/3807568781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe94004510 0x7efe94004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:21.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb50eb700 1 --2- 172.21.15.63:0/3807568781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe94003940 0x7efe94003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:21.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb58ec700 1 -- 172.21.15.63:0/3807568781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe94003940 msgr2=0x7efe94003d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:21.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb58ec700 1 --2- 172.21.15.63:0/3807568781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe94003940 0x7efe94003d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb58ec700 1 -- 172.21.15.63:0/3807568781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe94004510 msgr2=0x7efe94004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb58ec700 1 --2- 172.21.15.63:0/3807568781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe94004510 0x7efe94004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb58ec700 1 -- 172.21.15.63:0/3807568781 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe94003270 con 0x7efe94004df0 2020-05-18T21:33:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb58ec700 1 --2- 172.21.15.63:0/3807568781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe94004df0 0x7efe9400b760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efea8001490 tx=0x7efea8001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb58ec700 1 -- 172.21.15.63:0/3807568781 reap_dead start 2020-05-18T21:33:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb58ec700 1 --2- 172.21.15.63:0/3807568781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe94004df0 0x7efe9400b760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efea8001490 tx=0x7efea8001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb58ec700 1 --2- 172.21.15.63:0/3807568781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe94004df0 0x7efe9400b760 secure :-1 s=READY pgs=1373 cs=0 l=1 rx=0x7efea8001490 tx=0x7efea8001950).ready entity=mon.0 client_cookie=f4bceb936b2bdd1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb58ec700 1 --2- 172.21.15.63:0/3807568781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe94004df0 0x7efe9400b760 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7efea8001490 tx=0x7efea8001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb58ec700 1 --2- 172.21.15.63:0/3807568781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe94004df0 0x7efe9400b760 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7efea8001490 tx=0x7efea8001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 -- 172.21.15.63:0/3807568781 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efea800cdf0 con 0x7efe94004df0 2020-05-18T21:33:21.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb58ec700 1 --2- 172.21.15.63:0/3807568781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe94004df0 0x7efe9400b760 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7efea8001490 tx=0x7efea8001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 -- 172.21.15.63:0/3807568781 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea80111c0 con 0x7efe94004df0 2020-05-18T21:33:21.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efe9bfff700 1 -- 172.21.15.63:0/3807568781 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efea8011520 con 0x7efe94004df0 2020-05-18T21:33:21.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb60ed700 1 -- 172.21.15.63:0/3807568781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe94004df0 msgr2=0x7efe9400b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb60ed700 1 --2- 172.21.15.63:0/3807568781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe94004df0 0x7efe9400b760 secure :-1 s=READY pgs=1373 cs=0 l=1 rx=0x7efea8001490 tx=0x7efea8001950).stop 2020-05-18T21:33:21.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb60ed700 1 -- 172.21.15.63:0/3807568781 shutdown_connections 2020-05-18T21:33:21.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb60ed700 1 --2- 172.21.15.63:0/3807568781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe94004df0 0x7efe9400b760 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:21.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb60ed700 1 -- 172.21.15.63:0/3807568781 >> 172.21.15.63:0/3807568781 conn(0x7efeb005f3b0 msgr2=0x7efeb005f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:21.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb60ed700 1 -- 172.21.15.63:0/3807568781 shutdown_connections 2020-05-18T21:33:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.576+0000 7efeb60ed700 1 -- 172.21.15.63:0/3807568781 wait complete. 2020-05-18T21:33:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efeb60ed700 1 Processor -- start 2020-05-18T21:33:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efeb60ed700 1 -- start start 2020-05-18T21:33:21.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efeb60ed700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe94004df0 0x7efeb0156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:21.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efeb60ed700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efeb00ae070 0x7efeb0156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:21.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efeb60ed700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb0156ed0 con 0x7efeb0141d60 2020-05-18T21:33:21.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efeb60ed700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb00ae710 con 0x7efeb00ae070 2020-05-18T21:33:21.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efeb60ed700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00acff0 con 0x7efe94004df0 2020-05-18T21:33:21.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efeb48ea700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efeb00ae070 0x7efeb0156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:21.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efeb58ec700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efeb0141d60 0x7efeb00afa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34200/0 (socket says 172.21.15.63:34200) 2020-05-18T21:33:21.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efeb58ec700 1 -- 172.21.15.63:0/1127071626 learned_addr learned my addr 172.21.15.63:0/1127071626 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:21.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efeb50eb700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe94004df0 0x7efeb0156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:21.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efea2ffd700 1 -- 172.21.15.63:0/1127071626 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717324048 0 0) 0x7efeb0156ed0 con 0x7efeb0141d60 2020-05-18T21:33:21.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efea2ffd700 1 -- 172.21.15.63:0/1127071626 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe8c002fe0 con 0x7efeb0141d60 2020-05-18T21:33:21.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efeb50eb700 1 -- 172.21.15.63:0/1127071626 >> v2:172.21.15.63:3300/0 conn(0x7efeb00ae070 msgr2=0x7efeb0156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efeb50eb700 1 --2- 172.21.15.63:0/1127071626 >> v2:172.21.15.63:3300/0 conn(0x7efeb00ae070 0x7efeb0156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:21.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efeb50eb700 1 -- 172.21.15.63:0/1127071626 >> v1:172.21.15.63:6789/0 conn(0x7efeb0141d60 legacy=0x7efeb00afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efeb50eb700 1 -- 172.21.15.63:0/1127071626 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb00ad290 con 0x7efe94004df0 2020-05-18T21:33:21.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efeb50eb700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe94004df0 0x7efeb0156510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efea4002f70 tx=0x7efea4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efeb50eb700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe94004df0 0x7efeb0156510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efea4002f70 tx=0x7efea4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.580+0000 7efeb50eb700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe94004df0 0x7efeb0156510 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7efea4002f70 tx=0x7efea4010c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:21.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.584+0000 7efeb50eb700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe94004df0 0x7efeb0156510 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7efea4002f70 tx=0x7efea4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.584+0000 7efea2ffd700 1 -- 172.21.15.63:0/1127071626 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efea4007180 con 0x7efe94004df0 2020-05-18T21:33:21.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.584+0000 7efeb50eb700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe94004df0 0x7efeb0156510 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7efea4002f70 tx=0x7efea4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.584+0000 7efeb50eb700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe94004df0 0x7efeb0156510 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7efea4002f70 tx=0x7efea4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.584+0000 7efea2ffd700 1 -- 172.21.15.63:0/1127071626 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea40072e0 con 0x7efe94004df0 2020-05-18T21:33:21.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.584+0000 7efeb60ed700 1 -- 172.21.15.63:0/1127071626 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb00ad730 con 0x7efe94004df0 2020-05-18T21:33:21.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.584+0000 7efea2ffd700 1 -- 172.21.15.63:0/1127071626 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efea400c490 con 0x7efe94004df0 2020-05-18T21:33:21.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.584+0000 7efeb60ed700 1 -- 172.21.15.63:0/1127071626 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb00b65c0 con 0x7efe94004df0 2020-05-18T21:33:21.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.584+0000 7efeb50eb700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe94004df0 0x7efeb0156510 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7efea4002f70 tx=0x7efea4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.584+0000 7efeb60ed700 1 -- 172.21.15.63:0/1127071626 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb00ad420 con 0x7efe94004df0 2020-05-18T21:33:21.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.584+0000 7efea2ffd700 1 -- 172.21.15.63:0/1127071626 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7efea400e1a0 con 0x7efe94004df0 2020-05-18T21:33:21.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.584+0000 7efeb50eb700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe94004df0 0x7efeb0156510 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7efea4002f70 tx=0x7efea4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.584+0000 7efea2ffd700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe8c04fe40 0x7efe8c052300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:21.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.584+0000 7efea2ffd700 1 -- 172.21.15.63:0/1127071626 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5253+0+0 (secure 0 0 0) 0x7efea4063d80 con 0x7efe94004df0 2020-05-18T21:33:21.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.584+0000 7efeb48ea700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe8c04fe40 0x7efe8c052300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:21.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.584+0000 7efeb48ea700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe8c04fe40 0x7efe8c052300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efeac001660 tx=0x7efeb0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.588+0000 7efeb48ea700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe8c04fe40 0x7efe8c052300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efeac001660 tx=0x7efeb0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.588+0000 7efeb48ea700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe8c04fe40 0x7efe8c052300 secure :-1 s=READY pgs=541 cs=0 l=1 rx=0x7efeac001660 tx=0x7efeb0061d60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:21.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.592+0000 7efeb50eb700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe94004df0 0x7efeb0156510 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7efea4002f70 tx=0x7efea4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.592+0000 7efea2ffd700 1 -- 172.21.15.63:0/1127071626 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7efea403e0b0 con 0x7efe94004df0 2020-05-18T21:33:21.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.716+0000 7efeb60ed700 1 -- 172.21.15.63:0/1127071626 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7efeb00569e0 con 0x7efe94004df0 2020-05-18T21:33:21.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.912+0000 7efeb50eb700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe94004df0 0x7efeb0156510 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7efea4002f70 tx=0x7efea4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:21.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.912+0000 7efea2ffd700 1 -- 172.21.15.63:0/1127071626 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v101) v1 ==== 133+0+0 (secure 0 0 0) 0x7efea40416d0 con 0x7efe94004df0 2020-05-18T21:33:21.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.916+0000 7efeb60ed700 1 -- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe8c04fe40 msgr2=0x7efe8c052300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.916+0000 7efeb60ed700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe8c04fe40 0x7efe8c052300 secure :-1 s=READY pgs=541 cs=0 l=1 rx=0x7efeac001660 tx=0x7efeb0061d60).stop 2020-05-18T21:33:21.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.916+0000 7efeb60ed700 1 -- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe94004df0 msgr2=0x7efeb0156510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:21.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.916+0000 7efeb60ed700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe94004df0 0x7efeb0156510 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7efea4002f70 tx=0x7efea4010c80).stop 2020-05-18T21:33:21.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.916+0000 7efeb60ed700 1 -- 172.21.15.63:0/1127071626 shutdown_connections 2020-05-18T21:33:21.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.916+0000 7efeb60ed700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe8c04fe40 0x7efe8c052300 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:21.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.916+0000 7efeb60ed700 1 --2- 172.21.15.63:0/1127071626 >> v2:172.21.15.63:3300/0 conn(0x7efeb00ae070 0x7efeb0156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:21.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.916+0000 7efeb60ed700 1 --2- 172.21.15.63:0/1127071626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe94004df0 0x7efeb0156510 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:21.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.916+0000 7efeb60ed700 1 -- 172.21.15.63:0/1127071626 >> 172.21.15.63:0/1127071626 conn(0x7efeb005f3b0 msgr2=0x7efeb00bbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:21.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.916+0000 7efeb60ed700 1 -- 172.21.15.63:0/1127071626 shutdown_connections 2020-05-18T21:33:21.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:21.916+0000 7efeb60ed700 1 -- 172.21.15.63:0/1127071626 wait complete. 2020-05-18T21:33:21.931 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2020-05-18T21:33:21.943 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-05-18T21:33:22.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.060+0000 7f153ffff700 1 Processor -- start 2020-05-18T21:33:22.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.060+0000 7f153ffff700 1 -- start start 2020-05-18T21:33:22.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.060+0000 7f153ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f15401438a0 0x7f154009e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:22.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.060+0000 7f153ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154013ff90 0x7f1540140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:22.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.060+0000 7f153ffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15401408a0 con 0x7f15400b9810 2020-05-18T21:33:22.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.060+0000 7f153ffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15400b6f60 con 0x7f15401438a0 2020-05-18T21:33:22.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.060+0000 7f153ffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15400b6110 con 0x7f154013ff90 2020-05-18T21:33:22.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.060+0000 7f153effd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f15400b9810 0x7f15400b6850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34206/0 (socket says 172.21.15.63:34206) 2020-05-18T21:33:22.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.060+0000 7f153effd700 1 -- 172.21.15.63:0/1389147117 learned_addr learned my addr 172.21.15.63:0/1389147117 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:22.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.060+0000 7f1537fff700 1 --2- 172.21.15.63:0/1389147117 >> v2:172.21.15.155:3300/0 conn(0x7f15401438a0 0x7f154009e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:22.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.060+0000 7f153f7fe700 1 --2- 172.21.15.63:0/1389147117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154013ff90 0x7f1540140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:22.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f153e7fc700 1 -- 172.21.15.63:0/1389147117 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219036754 0 0) 0x7f15401408a0 con 0x7f15400b9810 2020-05-18T21:33:22.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f153e7fc700 1 -- 172.21.15.63:0/1389147117 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1520003270 con 0x7f15400b9810 2020-05-18T21:33:22.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f1537fff700 1 -- 172.21.15.63:0/1389147117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154013ff90 msgr2=0x7f1540140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:22.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f1537fff700 1 --2- 172.21.15.63:0/1389147117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154013ff90 0x7f1540140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:22.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f1537fff700 1 -- 172.21.15.63:0/1389147117 >> v1:172.21.15.63:6789/0 conn(0x7f15400b9810 legacy=0x7f15400b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:22.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f1537fff700 1 -- 172.21.15.63:0/1389147117 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15400b63b0 con 0x7f15401438a0 2020-05-18T21:33:22.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f1537fff700 1 --2- 172.21.15.63:0/1389147117 >> v2:172.21.15.155:3300/0 conn(0x7f15401438a0 0x7f154009e750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1528002f70 tx=0x7f1528007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:22.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f1537fff700 1 --2- 172.21.15.63:0/1389147117 >> v2:172.21.15.155:3300/0 conn(0x7f15401438a0 0x7f154009e750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1528002f70 tx=0x7f1528007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:22.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f1537fff700 1 --2- 172.21.15.63:0/1389147117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15401438a0 0x7f154009e750 secure :-1 s=READY pgs=934 cs=0 l=1 rx=0x7f1528002f70 tx=0x7f1528007a80).ready entity=mon.1 client_cookie=d3d8ace89d205e7f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:22.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f1537fff700 1 --2- 172.21.15.63:0/1389147117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15401438a0 0x7f154009e750 secure :-1 s=THROTTLE_DONE pgs=934 cs=0 l=1 rx=0x7f1528002f70 tx=0x7f1528007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:22.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f153e7fc700 1 -- 172.21.15.63:0/1389147117 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1528008e80 con 0x7f15401438a0 2020-05-18T21:33:22.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f1537fff700 1 --2- 172.21.15.63:0/1389147117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15401438a0 0x7f154009e750 secure :-1 s=THROTTLE_DONE pgs=934 cs=0 l=1 rx=0x7f1528002f70 tx=0x7f1528007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:22.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f153e7fc700 1 -- 172.21.15.63:0/1389147117 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1528011540 con 0x7f15401438a0 2020-05-18T21:33:22.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f1537fff700 1 --2- 172.21.15.63:0/1389147117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15401438a0 0x7f154009e750 secure :-1 s=THROTTLE_DONE pgs=934 cs=0 l=1 rx=0x7f1528002f70 tx=0x7f1528007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:22.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f153e7fc700 1 -- 172.21.15.63:0/1389147117 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1528011960 con 0x7f15401438a0 2020-05-18T21:33:22.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f153ffff700 1 -- 172.21.15.63:0/1389147117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15401438a0 msgr2=0x7f154009e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:22.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f153ffff700 1 --2- 172.21.15.63:0/1389147117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15401438a0 0x7f154009e750 secure :-1 s=READY pgs=934 cs=0 l=1 rx=0x7f1528002f70 tx=0x7f1528007a80).stop 2020-05-18T21:33:22.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f153ffff700 1 -- 172.21.15.63:0/1389147117 shutdown_connections 2020-05-18T21:33:22.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f153ffff700 1 --2- 172.21.15.63:0/1389147117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154013ff90 0x7f1540140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:22.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f153ffff700 1 --2- 172.21.15.63:0/1389147117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15401438a0 0x7f154009e750 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:22.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f153ffff700 1 -- 172.21.15.63:0/1389147117 >> 172.21.15.63:0/1389147117 conn(0x7f154005a7c0 msgr2=0x7f154005aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:22.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f153ffff700 1 -- 172.21.15.63:0/1389147117 shutdown_connections 2020-05-18T21:33:22.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.064+0000 7f153ffff700 1 -- 172.21.15.63:0/1389147117 wait complete. 2020-05-18T21:33:22.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153ffff700 1 Processor -- start 2020-05-18T21:33:22.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153ffff700 1 -- start start 2020-05-18T21:33:22.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f15400b9810 0x7f1540062fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:22.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153ffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1540153720 con 0x7f154013ff90 2020-05-18T21:33:22.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153ffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15401539c0 con 0x7f15401438a0 2020-05-18T21:33:22.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153ffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1540153c60 con 0x7f15400b9810 2020-05-18T21:33:22.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f1537fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f154013ff90 0x7f1540134170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34214/0 (socket says 172.21.15.63:34214) 2020-05-18T21:33:22.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f1537fff700 1 -- 172.21.15.63:0/3495779682 learned_addr learned my addr 172.21.15.63:0/3495779682 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:22.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153effd700 1 --2- 172.21.15.63:0/3495779682 >> v2:172.21.15.155:3300/0 conn(0x7f15400b9810 0x7f1540062fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:22.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153cff9700 1 -- 172.21.15.63:0/3495779682 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931035982 0 0) 0x7f1540153720 con 0x7f154013ff90 2020-05-18T21:33:22.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153cff9700 1 -- 172.21.15.63:0/3495779682 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1524002fe0 con 0x7f154013ff90 2020-05-18T21:33:22.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153cff9700 1 -- 172.21.15.63:0/3495779682 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723852046 0 0) 0x7f15401539c0 con 0x7f15401438a0 2020-05-18T21:33:22.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153cff9700 1 -- 172.21.15.63:0/3495779682 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1540153720 con 0x7f15401438a0 2020-05-18T21:33:22.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153effd700 1 -- 172.21.15.63:0/3495779682 >> v1:172.21.15.155:6789/0 conn(0x7f15401438a0 legacy=0x7f1540065270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:22.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153effd700 1 -- 172.21.15.63:0/3495779682 >> v1:172.21.15.63:6789/0 conn(0x7f154013ff90 legacy=0x7f1540134170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:22.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153effd700 1 -- 172.21.15.63:0/3495779682 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1540134880 con 0x7f15400b9810 2020-05-18T21:33:22.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153effd700 1 --2- 172.21.15.63:0/3495779682 >> v2:172.21.15.155:3300/0 conn(0x7f15400b9810 0x7f1540062fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1530001110 tx=0x7f15300108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:22.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153effd700 1 --2- 172.21.15.63:0/3495779682 >> v2:172.21.15.155:3300/0 conn(0x7f15400b9810 0x7f1540062fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1530001110 tx=0x7f15300108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:22.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153effd700 1 --2- 172.21.15.63:0/3495779682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15400b9810 0x7f1540062fa0 secure :-1 s=READY pgs=936 cs=0 l=1 rx=0x7f1530001110 tx=0x7f15300108f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:22.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153effd700 1 --2- 172.21.15.63:0/3495779682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15400b9810 0x7f1540062fa0 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f1530001110 tx=0x7f15300108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:22.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153cff9700 1 -- 172.21.15.63:0/3495779682 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1530005c10 con 0x7f15400b9810 2020-05-18T21:33:22.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153effd700 1 --2- 172.21.15.63:0/3495779682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15400b9810 0x7f1540062fa0 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f1530001110 tx=0x7f15300108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:22.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153effd700 1 --2- 172.21.15.63:0/3495779682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15400b9810 0x7f1540062fa0 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f1530001110 tx=0x7f15300108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:22.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153cff9700 1 -- 172.21.15.63:0/3495779682 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1530005d70 con 0x7f15400b9810 2020-05-18T21:33:22.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.068+0000 7f153cff9700 1 -- 172.21.15.63:0/3495779682 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15300062c0 con 0x7f15400b9810 2020-05-18T21:33:22.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.072+0000 7f153ffff700 1 -- 172.21.15.63:0/3495779682 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15400b2cb0 con 0x7f15400b9810 2020-05-18T21:33:22.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.072+0000 7f153ffff700 1 -- 172.21.15.63:0/3495779682 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15400b3130 con 0x7f15400b9810 2020-05-18T21:33:22.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.072+0000 7f153ffff700 1 -- 172.21.15.63:0/3495779682 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15400569e0 con 0x7f15400b9810 2020-05-18T21:33:22.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.072+0000 7f153effd700 1 --2- 172.21.15.63:0/3495779682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15400b9810 0x7f1540062fa0 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f1530001110 tx=0x7f15300108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:22.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.072+0000 7f153cff9700 1 -- 172.21.15.63:0/3495779682 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1530006470 con 0x7f15400b9810 2020-05-18T21:33:22.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.072+0000 7f153effd700 1 --2- 172.21.15.63:0/3495779682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15400b9810 0x7f1540062fa0 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f1530001110 tx=0x7f15300108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:22.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.072+0000 7f153cff9700 1 --2- 172.21.15.63:0/3495779682 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f152404fed0 0x7f1524052390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:22.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.072+0000 7f153cff9700 1 -- 172.21.15.63:0/3495779682 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f15300090c0 con 0x7f15400b9810 2020-05-18T21:33:22.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.072+0000 7f1537fff700 1 --2- 172.21.15.63:0/3495779682 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f152404fed0 0x7f1524052390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:22.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.076+0000 7f1537fff700 1 --2- 172.21.15.63:0/3495779682 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f152404fed0 0x7f1524052390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1528007f10 tx=0x7f1528007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:22.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.076+0000 7f1537fff700 1 --2- 172.21.15.63:0/3495779682 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f152404fed0 0x7f1524052390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1528007f10 tx=0x7f1528007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:22.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.076+0000 7f1537fff700 1 --2- 172.21.15.63:0/3495779682 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f152404fed0 0x7f1524052390 secure :-1 s=READY pgs=542 cs=0 l=1 rx=0x7f1528007f10 tx=0x7f1528007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:22.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.080+0000 7f153effd700 1 --2- 172.21.15.63:0/3495779682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15400b9810 0x7f1540062fa0 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f1530001110 tx=0x7f15300108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:22.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.080+0000 7f153cff9700 1 -- 172.21.15.63:0/3495779682 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f153003df50 con 0x7f15400b9810 2020-05-18T21:33:22.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.204+0000 7f153ffff700 1 -- 172.21.15.63:0/3495779682 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f15400b7c30 con 0x7f15400b9810 2020-05-18T21:33:22.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.924+0000 7f153effd700 1 --2- 172.21.15.63:0/3495779682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15400b9810 0x7f1540062fa0 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f1530001110 tx=0x7f15300108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:22.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.924+0000 7f153cff9700 1 -- 172.21.15.63:0/3495779682 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v102) v1 ==== 125+0+0 (secure 0 0 0) 0x7f1530041570 con 0x7f15400b9810 2020-05-18T21:33:22.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.932+0000 7f153ffff700 1 -- 172.21.15.63:0/3495779682 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f152404fed0 msgr2=0x7f1524052390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:22.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.932+0000 7f153ffff700 1 --2- 172.21.15.63:0/3495779682 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f152404fed0 0x7f1524052390 secure :-1 s=READY pgs=542 cs=0 l=1 rx=0x7f1528007f10 tx=0x7f1528007a80).stop 2020-05-18T21:33:22.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.932+0000 7f153ffff700 1 -- 172.21.15.63:0/3495779682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15400b9810 msgr2=0x7f1540062fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:22.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.932+0000 7f153ffff700 1 --2- 172.21.15.63:0/3495779682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15400b9810 0x7f1540062fa0 secure :-1 s=READY pgs=936 cs=0 l=1 rx=0x7f1530001110 tx=0x7f15300108f0).stop 2020-05-18T21:33:22.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.936+0000 7f153ffff700 1 -- 172.21.15.63:0/3495779682 shutdown_connections 2020-05-18T21:33:22.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.936+0000 7f153ffff700 1 --2- 172.21.15.63:0/3495779682 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f152404fed0 0x7f1524052390 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.936+0000 7f153ffff700 1 --2- 172.21.15.63:0/3495779682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15400b9810 0x7f1540062fa0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.936+0000 7f153ffff700 1 -- 172.21.15.63:0/3495779682 >> 172.21.15.63:0/3495779682 conn(0x7f154005a7c0 msgr2=0x7f154013f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.936+0000 7f153ffff700 1 -- 172.21.15.63:0/3495779682 shutdown_connections 2020-05-18T21:33:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:22.936+0000 7f153ffff700 1 -- 172.21.15.63:0/3495779682 wait complete. 2020-05-18T21:33:22.943 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2020-05-18T21:33:22.952 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-05-18T21:33:23.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.052+0000 7f174942b700 1 Processor -- start 2020-05-18T21:33:23.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.052+0000 7f174942b700 1 -- start start 2020-05-18T21:33:23.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f174942b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1744065dc0 0x7f1744145b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:23.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f174942b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f17440b4890 0x7f17440ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:23.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f174942b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17441461b0 con 0x7f1744145790 2020-05-18T21:33:23.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f174942b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17441466f0 con 0x7f17440b4890 2020-05-18T21:33:23.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f174942b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1744145fd0 con 0x7f1744065dc0 2020-05-18T21:33:23.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f1748c2a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f17440b4890 0x7f17440ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f1748c2a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f17440b4890 0x7f17440ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60268/0 (socket says 172.21.15.63:60268) 2020-05-18T21:33:23.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f1748c2a700 1 -- 172.21.15.63:0/2607560490 learned_addr learned my addr 172.21.15.63:0/2607560490 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:23.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f173bfff700 1 --2- 172.21.15.63:0/2607560490 >> v2:172.21.15.155:3300/0 conn(0x7f1744065dc0 0x7f1744145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f1748c2a700 1 -- 172.21.15.63:0/2607560490 >> v2:172.21.15.155:3300/0 conn(0x7f1744065dc0 msgr2=0x7f1744145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:23.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f1748c2a700 1 --2- 172.21.15.63:0/2607560490 >> v2:172.21.15.155:3300/0 conn(0x7f1744065dc0 0x7f1744145b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:23.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f1748c2a700 1 -- 172.21.15.63:0/2607560490 >> v1:172.21.15.155:6789/0 conn(0x7f1744145790 legacy=0x7f1744061030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f1748c2a700 1 -- 172.21.15.63:0/2607560490 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1744146450 con 0x7f17440b4890 2020-05-18T21:33:23.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f173bfff700 1 --2- 172.21.15.63:0/2607560490 >> v2:172.21.15.155:3300/0 conn(0x7f1744065dc0 0x7f1744145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:33:23.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f1748c2a700 1 --2- 172.21.15.63:0/2607560490 >> v2:172.21.15.63:3300/0 conn(0x7f17440b4890 0x7f17440ad770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f17440b2b70 tx=0x7f173c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f1748c2a700 1 --2- 172.21.15.63:0/2607560490 >> v2:172.21.15.63:3300/0 conn(0x7f17440b4890 0x7f17440ad770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f17440b2b70 tx=0x7f173c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f1748c2a700 1 --2- 172.21.15.63:0/2607560490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17440b4890 0x7f17440ad770 secure :-1 s=READY pgs=1377 cs=0 l=1 rx=0x7f17440b2b70 tx=0x7f173c008ca0).ready entity=mon.0 client_cookie=c4a95f7504d1d109 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:23.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f1748c2a700 1 --2- 172.21.15.63:0/2607560490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17440b4890 0x7f17440ad770 secure :-1 s=THROTTLE_DONE pgs=1377 cs=0 l=1 rx=0x7f17440b2b70 tx=0x7f173c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f17437fe700 1 -- 172.21.15.63:0/2607560490 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f173c011dc0 con 0x7f17440b4890 2020-05-18T21:33:23.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f1748c2a700 1 --2- 172.21.15.63:0/2607560490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17440b4890 0x7f17440ad770 secure :-1 s=THROTTLE_DONE pgs=1377 cs=0 l=1 rx=0x7f17440b2b70 tx=0x7f173c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f17437fe700 1 -- 172.21.15.63:0/2607560490 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173c00a180 con 0x7f17440b4890 2020-05-18T21:33:23.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f1748c2a700 1 --2- 172.21.15.63:0/2607560490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17440b4890 0x7f17440ad770 secure :-1 s=THROTTLE_DONE pgs=1377 cs=0 l=1 rx=0x7f17440b2b70 tx=0x7f173c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f174942b700 1 -- 172.21.15.63:0/2607560490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17440b4890 msgr2=0x7f17440ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f174942b700 1 --2- 172.21.15.63:0/2607560490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17440b4890 0x7f17440ad770 secure :-1 s=READY pgs=1377 cs=0 l=1 rx=0x7f17440b2b70 tx=0x7f173c008ca0).stop 2020-05-18T21:33:23.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f17437fe700 1 -- 172.21.15.63:0/2607560490 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f173c00a5a0 con 0x7f17440b4890 2020-05-18T21:33:23.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f174942b700 1 -- 172.21.15.63:0/2607560490 shutdown_connections 2020-05-18T21:33:23.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f174942b700 1 --2- 172.21.15.63:0/2607560490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17440b4890 0x7f17440ad770 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:23.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f174942b700 1 --2- 172.21.15.63:0/2607560490 >> v2:172.21.15.155:3300/0 conn(0x7f1744065dc0 0x7f1744145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:23.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f174942b700 1 -- 172.21.15.63:0/2607560490 >> 172.21.15.63:0/2607560490 conn(0x7f174405fb90 msgr2=0x7f1744069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:23.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f174942b700 1 -- 172.21.15.63:0/2607560490 shutdown_connections 2020-05-18T21:33:23.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.056+0000 7f174942b700 1 -- 172.21.15.63:0/2607560490 wait complete. 2020-05-18T21:33:23.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f174942b700 1 Processor -- start 2020-05-18T21:33:23.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f174942b700 1 -- start start 2020-05-18T21:33:23.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f174942b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17440b4890 0x7f1744061f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:23.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f174942b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1744145790 0x7f1744132590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:23.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f174942b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17441536f0 con 0x7f1744065dc0 2020-05-18T21:33:23.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f174942b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1744153950 con 0x7f1744145790 2020-05-18T21:33:23.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f174942b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17440b24f0 con 0x7f17440b4890 2020-05-18T21:33:23.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f1743fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1744065dc0 0x7f1744143e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34226/0 (socket says 172.21.15.63:34226) 2020-05-18T21:33:23.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f1743fff700 1 -- 172.21.15.63:0/3555925370 learned_addr learned my addr 172.21.15.63:0/3555925370 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:23.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f173bfff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17440b4890 0x7f1744061f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f1748c2a700 1 --2- 172.21.15.63:0/3555925370 >> v2:172.21.15.155:3300/0 conn(0x7f1744145790 0x7f1744132590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f1741ffb700 1 -- 172.21.15.63:0/3555925370 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 801329222 0 0) 0x7f17441536f0 con 0x7f1744065dc0 2020-05-18T21:33:23.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f1741ffb700 1 -- 172.21.15.63:0/3555925370 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1728002fe0 con 0x7f1744065dc0 2020-05-18T21:33:23.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f1741ffb700 1 -- 172.21.15.63:0/3555925370 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4048966467 0 0) 0x7f1728002fe0 con 0x7f1744065dc0 2020-05-18T21:33:23.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f1741ffb700 1 -- 172.21.15.63:0/3555925370 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f17441536f0 con 0x7f1744065dc0 2020-05-18T21:33:23.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f1741ffb700 1 -- 172.21.15.63:0/3555925370 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f1734001970 con 0x7f1744065dc0 2020-05-18T21:33:23.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f1741ffb700 1 -- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17440b4890 msgr2=0x7f1744061f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f1741ffb700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17440b4890 0x7f1744061f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:23.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f1741ffb700 1 -- 172.21.15.63:0/3555925370 >> v2:172.21.15.155:3300/0 conn(0x7f1744145790 msgr2=0x7f1744132590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f1741ffb700 1 --2- 172.21.15.63:0/3555925370 >> v2:172.21.15.155:3300/0 conn(0x7f1744145790 0x7f1744132590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:23.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f1741ffb700 1 -- 172.21.15.63:0/3555925370 >> v1:172.21.15.63:6789/0 conn(0x7f1744065dc0 legacy=0x7f1744143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f1741ffb700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1728004b50 0x7f1728004f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:23.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f1741ffb700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17280039a0 0x7f1728003de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:23.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f1741ffb700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1728004240 0x7f172800b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:23.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f1741ffb700 1 -- 172.21.15.63:0/3555925370 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1744153950 con 0x7f1728004b50 2020-05-18T21:33:23.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f1741ffb700 1 -- 172.21.15.63:0/3555925370 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17440b24f0 con 0x7f17280039a0 2020-05-18T21:33:23.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.060+0000 7f1741ffb700 1 -- 172.21.15.63:0/3555925370 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172800bbc0 con 0x7f1728004240 2020-05-18T21:33:23.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1743fff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1728004b50 0x7f1728004f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f173bfff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17440b4890 0x7f1744061f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:23.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1748c2a700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1728004240 0x7f172800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f173bfff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17280039a0 0x7f1728003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1743fff700 1 -- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1728004240 msgr2=0x7f172800b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1743fff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1728004240 0x7f172800b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:23.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1743fff700 1 -- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17280039a0 msgr2=0x7f1728003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1743fff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17280039a0 0x7f1728003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:23.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1743fff700 1 -- 172.21.15.63:0/3555925370 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1744144550 con 0x7f1728004b50 2020-05-18T21:33:23.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f174942b700 1 -- 172.21.15.63:0/3555925370 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17440b20c0 con 0x7f1728004b50 2020-05-18T21:33:23.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1743fff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1728004b50 0x7f1728004f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1734001680 tx=0x7f1734011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1748c2a700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1728004240 0x7f172800b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:33:23.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f173bfff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17280039a0 0x7f1728003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:33:23.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f174942b700 1 -- 172.21.15.63:0/3555925370 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17440615d0 con 0x7f1728004b50 2020-05-18T21:33:23.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1743fff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1728004b50 0x7f1728004f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1734001680 tx=0x7f1734011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1743fff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1728004b50 0x7f1728004f50 secure :-1 s=READY pgs=1379 cs=0 l=1 rx=0x7f1734001680 tx=0x7f1734011470).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:23.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1743fff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1728004b50 0x7f1728004f50 secure :-1 s=THROTTLE_DONE pgs=1379 cs=0 l=1 rx=0x7f1734001680 tx=0x7f1734011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1743fff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1728004b50 0x7f1728004f50 secure :-1 s=THROTTLE_DONE pgs=1379 cs=0 l=1 rx=0x7f1734001680 tx=0x7f1734011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1741ffb700 1 -- 172.21.15.63:0/3555925370 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f173400ee50 con 0x7f1728004b50 2020-05-18T21:33:23.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1743fff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1728004b50 0x7f1728004f50 secure :-1 s=THROTTLE_DONE pgs=1379 cs=0 l=1 rx=0x7f1734001680 tx=0x7f1734011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1741ffb700 1 -- 172.21.15.63:0/3555925370 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1734010170 con 0x7f1728004b50 2020-05-18T21:33:23.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1741ffb700 1 -- 172.21.15.63:0/3555925370 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1734010510 con 0x7f1728004b50 2020-05-18T21:33:23.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1743fff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1728004b50 0x7f1728004f50 secure :-1 s=THROTTLE_DONE pgs=1379 cs=0 l=1 rx=0x7f1734001680 tx=0x7f1734011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f174942b700 1 -- 172.21.15.63:0/3555925370 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f171c003380 con 0x7f1728004b50 2020-05-18T21:33:23.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1741ffb700 1 -- 172.21.15.63:0/3555925370 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1734010670 con 0x7f1728004b50 2020-05-18T21:33:23.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1743fff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1728004b50 0x7f1728004f50 secure :-1 s=THROTTLE_DONE pgs=1379 cs=0 l=1 rx=0x7f1734001680 tx=0x7f1734011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1741ffb700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1728058240 0x7f172805a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:23.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.064+0000 7f1741ffb700 1 -- 172.21.15.63:0/3555925370 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f1734063f50 con 0x7f1728004b50 2020-05-18T21:33:23.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.068+0000 7f173bfff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1728058240 0x7f172805a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.068+0000 7f173bfff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1728058240 0x7f172805a700 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f172c002f70 tx=0x7f172c00b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.068+0000 7f173bfff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1728058240 0x7f172805a700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f172c002f70 tx=0x7f172c00b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.068+0000 7f173bfff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1728058240 0x7f172805a700 secure :-1 s=READY pgs=543 cs=0 l=1 rx=0x7f172c002f70 tx=0x7f172c00b390).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:23.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.072+0000 7f1743fff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1728004b50 0x7f1728004f50 secure :-1 s=THROTTLE_DONE pgs=1379 cs=0 l=1 rx=0x7f1734001680 tx=0x7f1734011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.072+0000 7f1741ffb700 1 -- 172.21.15.63:0/3555925370 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f173403e2e0 con 0x7f1728004b50 2020-05-18T21:33:23.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.224+0000 7f174942b700 1 -- 172.21.15.63:0/3555925370 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f171c0022a0 con 0x7f1728004b50 2020-05-18T21:33:23.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.236+0000 7f1743fff700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1728004b50 0x7f1728004f50 secure :-1 s=THROTTLE_DONE pgs=1379 cs=0 l=1 rx=0x7f1734001680 tx=0x7f1734011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.236+0000 7f1741ffb700 1 -- 172.21.15.63:0/3555925370 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 19 and data pool 20 v79) v1 ==== 189+0+0 (secure 0 0 0) 0x7f1734041900 con 0x7f1728004b50 2020-05-18T21:33:23.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.240+0000 7f174942b700 1 -- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1728058240 msgr2=0x7f172805a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.240+0000 7f174942b700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1728058240 0x7f172805a700 secure :-1 s=READY pgs=543 cs=0 l=1 rx=0x7f172c002f70 tx=0x7f172c00b390).stop 2020-05-18T21:33:23.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.240+0000 7f1748c2a700 1 -- 172.21.15.63:0/3555925370 reap_dead start 2020-05-18T21:33:23.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.240+0000 7f174942b700 1 -- 172.21.15.63:0/3555925370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1728004b50 msgr2=0x7f1728004f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.240+0000 7f174942b700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1728004b50 0x7f1728004f50 secure :-1 s=READY pgs=1379 cs=0 l=1 rx=0x7f1734001680 tx=0x7f1734011470).stop 2020-05-18T21:33:23.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.240+0000 7f174942b700 1 -- 172.21.15.63:0/3555925370 shutdown_connections 2020-05-18T21:33:23.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.240+0000 7f174942b700 1 --2- 172.21.15.63:0/3555925370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1728004b50 0x7f1728004f50 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:23.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.240+0000 7f174942b700 1 -- 172.21.15.63:0/3555925370 >> 172.21.15.63:0/3555925370 conn(0x7f174405fb90 msgr2=0x7f17440b6170 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:23.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.240+0000 7f174942b700 1 -- 172.21.15.63:0/3555925370 shutdown_connections 2020-05-18T21:33:23.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.240+0000 7f174942b700 1 -- 172.21.15.63:0/3555925370 wait complete. 2020-05-18T21:33:23.248 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 19 and data pool 20 2020-05-18T21:33:23.262 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:33:23.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.348+0000 7efcab59e700 1 Processor -- start 2020-05-18T21:33:23.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.348+0000 7efcab59e700 1 -- start start 2020-05-18T21:33:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.348+0000 7efcab59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efcac145df0 0x7efcac142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.348+0000 7efcab59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efcac1432f0 0x7efcac060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.348+0000 7efcab59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcac0b7020 con 0x7efcac0b93f0 2020-05-18T21:33:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.348+0000 7efcab59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcac0b72c0 con 0x7efcac145df0 2020-05-18T21:33:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.348+0000 7efcab59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcac0b7560 con 0x7efcac1432f0 2020-05-18T21:33:23.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.348+0000 7efca1d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efcac145df0 0x7efcac142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.348+0000 7efca1d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efcac145df0 0x7efcac142e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60284/0 (socket says 172.21.15.63:60284) 2020-05-18T21:33:23.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.348+0000 7efcaa59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efcac0b93f0 0x7efcac0b7ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34242/0 (socket says 172.21.15.63:34242) 2020-05-18T21:33:23.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.348+0000 7efca1d9b700 1 -- 172.21.15.63:0/2661043855 learned_addr learned my addr 172.21.15.63:0/2661043855 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:23.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.348+0000 7efcaad9d700 1 --2- 172.21.15.63:0/2661043855 >> v2:172.21.15.155:3300/0 conn(0x7efcac1432f0 0x7efcac060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.348+0000 7efca1d9b700 1 -- 172.21.15.63:0/2661043855 >> v2:172.21.15.155:3300/0 conn(0x7efcac1432f0 msgr2=0x7efcac060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:23.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.348+0000 7efca1d9b700 1 --2- 172.21.15.63:0/2661043855 >> v2:172.21.15.155:3300/0 conn(0x7efcac1432f0 0x7efcac060430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:23.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.348+0000 7efca1d9b700 1 -- 172.21.15.63:0/2661043855 >> v1:172.21.15.63:6789/0 conn(0x7efcac0b93f0 legacy=0x7efcac0b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.348+0000 7efca1d9b700 1 -- 172.21.15.63:0/2661043855 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac0b7800 con 0x7efcac145df0 2020-05-18T21:33:23.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.348+0000 7efca1d9b700 1 --2- 172.21.15.63:0/2661043855 >> v2:172.21.15.63:3300/0 conn(0x7efcac145df0 0x7efcac142e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.348+0000 7efca1d9b700 1 --2- 172.21.15.63:0/2661043855 >> v2:172.21.15.63:3300/0 conn(0x7efcac145df0 0x7efcac142e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efca1d9b700 1 --2- 172.21.15.63:0/2661043855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcac145df0 0x7efcac142e90 secure :-1 s=READY pgs=1381 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).ready entity=mon.0 client_cookie=84406b53318cd231 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:23.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efca1d9b700 1 --2- 172.21.15.63:0/2661043855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcac145df0 0x7efcac142e90 secure :-1 s=THROTTLE_DONE pgs=1381 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efca1d9b700 1 --2- 172.21.15.63:0/2661043855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcac145df0 0x7efcac142e90 secure :-1 s=THROTTLE_DONE pgs=1381 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efca9d9b700 1 -- 172.21.15.63:0/2661043855 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc94011760 con 0x7efcac145df0 2020-05-18T21:33:23.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efca1d9b700 1 --2- 172.21.15.63:0/2661043855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcac145df0 0x7efcac142e90 secure :-1 s=THROTTLE_DONE pgs=1381 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efca9d9b700 1 -- 172.21.15.63:0/2661043855 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc940118c0 con 0x7efcac145df0 2020-05-18T21:33:23.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efca9d9b700 1 -- 172.21.15.63:0/2661043855 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc94011ce0 con 0x7efcac145df0 2020-05-18T21:33:23.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efcab59e700 1 -- 172.21.15.63:0/2661043855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcac145df0 msgr2=0x7efcac142e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efcab59e700 1 --2- 172.21.15.63:0/2661043855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcac145df0 0x7efcac142e90 secure :-1 s=READY pgs=1381 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).stop 2020-05-18T21:33:23.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efcab59e700 1 -- 172.21.15.63:0/2661043855 shutdown_connections 2020-05-18T21:33:23.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efcab59e700 1 --2- 172.21.15.63:0/2661043855 >> v2:172.21.15.155:3300/0 conn(0x7efcac1432f0 0x7efcac060430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:23.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efcab59e700 1 --2- 172.21.15.63:0/2661043855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcac145df0 0x7efcac142e90 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:23.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efcab59e700 1 -- 172.21.15.63:0/2661043855 >> 172.21.15.63:0/2661043855 conn(0x7efcac069b70 msgr2=0x7efcac069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:23.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efcab59e700 1 -- 172.21.15.63:0/2661043855 shutdown_connections 2020-05-18T21:33:23.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efcab59e700 1 -- 172.21.15.63:0/2661043855 wait complete. 2020-05-18T21:33:23.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efcab59e700 1 Processor -- start 2020-05-18T21:33:23.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efcab59e700 1 -- start start 2020-05-18T21:33:23.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efcab59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efcac0b93f0 0x7efcac0ba580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:23.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efcab59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efcac1432f0 0x7efcac157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:23.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efcab59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcac157ae0 con 0x7efcac145df0 2020-05-18T21:33:23.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efcab59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcac141760 con 0x7efcac0b93f0 2020-05-18T21:33:23.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.352+0000 7efcab59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcac141a00 con 0x7efcac1432f0 2020-05-18T21:33:23.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efcaa59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efcac0b93f0 0x7efcac0ba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efcaa59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efcac0b93f0 0x7efcac0ba580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60290/0 (socket says 172.21.15.63:60290) 2020-05-18T21:33:23.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efcaad9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efcac145df0 0x7efcac13baf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34250/0 (socket says 172.21.15.63:34250) 2020-05-18T21:33:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efcaa59c700 1 -- 172.21.15.63:0/3981249506 learned_addr learned my addr 172.21.15.63:0/3981249506 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efca1d9b700 1 --2- 172.21.15.63:0/3981249506 >> v2:172.21.15.155:3300/0 conn(0x7efcac1432f0 0x7efcac157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efcaa59c700 1 -- 172.21.15.63:0/3981249506 >> v2:172.21.15.155:3300/0 conn(0x7efcac1432f0 msgr2=0x7efcac157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efcaa59c700 1 --2- 172.21.15.63:0/3981249506 >> v2:172.21.15.155:3300/0 conn(0x7efcac1432f0 0x7efcac157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efca3fff700 1 -- 172.21.15.63:0/3981249506 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1383910961 0 0) 0x7efcac157ae0 con 0x7efcac145df0 2020-05-18T21:33:23.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efcaa59c700 1 -- 172.21.15.63:0/3981249506 >> v1:172.21.15.63:6789/0 conn(0x7efcac145df0 legacy=0x7efcac13baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efcaa59c700 1 -- 172.21.15.63:0/3981249506 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac141ea0 con 0x7efcac0b93f0 2020-05-18T21:33:23.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efcaa59c700 1 --2- 172.21.15.63:0/3981249506 >> v2:172.21.15.63:3300/0 conn(0x7efcac0b93f0 0x7efcac0ba580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc9c001040 tx=0x7efc9c0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efcaa59c700 1 --2- 172.21.15.63:0/3981249506 >> v2:172.21.15.63:3300/0 conn(0x7efcac0b93f0 0x7efcac0ba580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc9c001040 tx=0x7efc9c0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efcaa59c700 1 --2- 172.21.15.63:0/3981249506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcac0b93f0 0x7efcac0ba580 secure :-1 s=READY pgs=1383 cs=0 l=1 rx=0x7efc9c001040 tx=0x7efc9c0109f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efcaa59c700 1 --2- 172.21.15.63:0/3981249506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcac0b93f0 0x7efcac0ba580 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7efc9c001040 tx=0x7efc9c0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efca3fff700 1 -- 172.21.15.63:0/3981249506 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc9c00c9b0 con 0x7efcac0b93f0 2020-05-18T21:33:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efcaa59c700 1 --2- 172.21.15.63:0/3981249506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcac0b93f0 0x7efcac0ba580 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7efc9c001040 tx=0x7efc9c0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efca3fff700 1 -- 172.21.15.63:0/3981249506 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c00cb10 con 0x7efcac0b93f0 2020-05-18T21:33:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efcaa59c700 1 --2- 172.21.15.63:0/3981249506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcac0b93f0 0x7efcac0ba580 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7efc9c001040 tx=0x7efc9c0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efcab59e700 1 -- 172.21.15.63:0/3981249506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcac1420f0 con 0x7efcac0b93f0 2020-05-18T21:33:23.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efca3fff700 1 -- 172.21.15.63:0/3981249506 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc9c004530 con 0x7efcac0b93f0 2020-05-18T21:33:23.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efcab59e700 1 -- 172.21.15.63:0/3981249506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcac0bcf20 con 0x7efcac0b93f0 2020-05-18T21:33:23.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efcab59e700 1 -- 172.21.15.63:0/3981249506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcac0569e0 con 0x7efcac0b93f0 2020-05-18T21:33:23.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.356+0000 7efcaa59c700 1 --2- 172.21.15.63:0/3981249506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcac0b93f0 0x7efcac0ba580 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7efc9c001040 tx=0x7efc9c0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.360+0000 7efca3fff700 1 -- 172.21.15.63:0/3981249506 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7efc9c0046e0 con 0x7efcac0b93f0 2020-05-18T21:33:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.360+0000 7efcaa59c700 1 --2- 172.21.15.63:0/3981249506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcac0b93f0 0x7efcac0ba580 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7efc9c001040 tx=0x7efc9c0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.360+0000 7efca3fff700 1 --2- 172.21.15.63:0/3981249506 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efc9004f860 0x7efc90051d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:23.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.360+0000 7efca3fff700 1 -- 172.21.15.63:0/3981249506 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efc9c0636d0 con 0x7efcac0b93f0 2020-05-18T21:33:23.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.360+0000 7efca1d9b700 1 --2- 172.21.15.63:0/3981249506 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efc9004f860 0x7efc90051d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.360+0000 7efca1d9b700 1 --2- 172.21.15.63:0/3981249506 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efc9004f860 0x7efc90051d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.360+0000 7efca1d9b700 1 --2- 172.21.15.63:0/3981249506 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efc9004f860 0x7efc90051d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.360+0000 7efca1d9b700 1 --2- 172.21.15.63:0/3981249506 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efc9004f860 0x7efc90051d20 secure :-1 s=READY pgs=544 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.368+0000 7efcaa59c700 1 --2- 172.21.15.63:0/3981249506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcac0b93f0 0x7efcac0ba580 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7efc9c001040 tx=0x7efc9c0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.368+0000 7efca3fff700 1 -- 172.21.15.63:0/3981249506 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7efc9c03da60 con 0x7efcac0b93f0 2020-05-18T21:33:23.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.480+0000 7efcab59e700 1 -- 172.21.15.63:0/3981249506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcac061c40 con 0x7efcac0b93f0 2020-05-18T21:33:23.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.484+0000 7efcaa59c700 1 --2- 172.21.15.63:0/3981249506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcac0b93f0 0x7efcac0ba580 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7efc9c001040 tx=0x7efc9c0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.484+0000 7efca3fff700 1 -- 172.21.15.63:0/3981249506 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+16116 (secure 0 0 0) 0x7efc9c041080 con 0x7efcac0b93f0 2020-05-18T21:33:23.490 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:23.491 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":103,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:33:23.230176+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:33:21.749613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2020-05-18T21:33:22.242521+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:33:23.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.484+0000 7efcab59e700 1 -- 172.21.15.63:0/3981249506 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efc9004f860 msgr2=0x7efc90051d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.484+0000 7efcab59e700 1 --2- 172.21.15.63:0/3981249506 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efc9004f860 0x7efc90051d20 secure :-1 s=READY pgs=544 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).stop 2020-05-18T21:33:23.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.484+0000 7efcab59e700 1 -- 172.21.15.63:0/3981249506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcac0b93f0 msgr2=0x7efcac0ba580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.484+0000 7efcab59e700 1 --2- 172.21.15.63:0/3981249506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcac0b93f0 0x7efcac0ba580 secure :-1 s=READY pgs=1383 cs=0 l=1 rx=0x7efc9c001040 tx=0x7efc9c0109f0).stop 2020-05-18T21:33:23.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.484+0000 7efcab59e700 1 -- 172.21.15.63:0/3981249506 shutdown_connections 2020-05-18T21:33:23.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.484+0000 7efcab59e700 1 --2- 172.21.15.63:0/3981249506 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efc9004f860 0x7efc90051d20 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:23.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.484+0000 7efcab59e700 1 --2- 172.21.15.63:0/3981249506 >> v2:172.21.15.155:3300/0 conn(0x7efcac1432f0 0x7efcac157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:23.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.484+0000 7efcab59e700 1 --2- 172.21.15.63:0/3981249506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcac0b93f0 0x7efcac0ba580 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:23.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.484+0000 7efcab59e700 1 -- 172.21.15.63:0/3981249506 >> 172.21.15.63:0/3981249506 conn(0x7efcac069b70 msgr2=0x7efcac1424b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:23.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.484+0000 7efcab59e700 1 -- 172.21.15.63:0/3981249506 shutdown_connections 2020-05-18T21:33:23.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.484+0000 7efcab59e700 1 -- 172.21.15.63:0/3981249506 wait complete. 2020-05-18T21:33:23.504 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:33:23.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.604+0000 7f9785628700 1 Processor -- start 2020-05-18T21:33:23.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.604+0000 7f9785628700 1 -- start start 2020-05-18T21:33:23.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.604+0000 7f9785628700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97800659d0 0x7f97800acea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:23.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.604+0000 7f9785628700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f978013c710 0x7f978013cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:23.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.604+0000 7f9785628700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97800b4af0 con 0x7f978005f110 2020-05-18T21:33:23.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.604+0000 7f9785628700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978013cfe0 con 0x7f978013c710 2020-05-18T21:33:23.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.604+0000 7f9785628700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97801460e0 con 0x7f97800659d0 2020-05-18T21:33:23.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.604+0000 7f9784e27700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f978013c710 0x7f978013cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.604+0000 7f977ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f978005f110 0x7f9780146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34254/0 (socket says 172.21.15.63:34254) 2020-05-18T21:33:23.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.604+0000 7f977ffff700 1 -- 172.21.15.63:0/1437290353 learned_addr learned my addr 172.21.15.63:0/1437290353 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:23.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.604+0000 7f977f7fe700 1 --2- 172.21.15.63:0/1437290353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97800659d0 0x7f97800acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.604+0000 7f9784e27700 1 -- 172.21.15.63:0/1437290353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97800659d0 msgr2=0x7f97800acea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:23.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.604+0000 7f9784e27700 1 --2- 172.21.15.63:0/1437290353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97800659d0 0x7f97800acea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:23.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.604+0000 7f9784e27700 1 -- 172.21.15.63:0/1437290353 >> v1:172.21.15.63:6789/0 conn(0x7f978005f110 legacy=0x7f9780146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.604+0000 7f9784e27700 1 -- 172.21.15.63:0/1437290353 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9780146380 con 0x7f978013c710 2020-05-18T21:33:23.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.604+0000 7f9784e27700 1 --2- 172.21.15.63:0/1437290353 >> v2:172.21.15.63:3300/0 conn(0x7f978013c710 0x7f978013cb80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f97780032f0 tx=0x7f9778007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.608+0000 7f9784e27700 1 --2- 172.21.15.63:0/1437290353 >> v2:172.21.15.63:3300/0 conn(0x7f978013c710 0x7f978013cb80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f97780032f0 tx=0x7f9778007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.608+0000 7f9784e27700 1 --2- 172.21.15.63:0/1437290353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978013c710 0x7f978013cb80 secure :-1 s=READY pgs=1385 cs=0 l=1 rx=0x7f97780032f0 tx=0x7f9778007e00).ready entity=mon.0 client_cookie=8dca9095248c670e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:23.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.608+0000 7f9784e27700 1 --2- 172.21.15.63:0/1437290353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978013c710 0x7f978013cb80 secure :-1 s=THROTTLE_DONE pgs=1385 cs=0 l=1 rx=0x7f97780032f0 tx=0x7f9778007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.608+0000 7f977effd700 1 -- 172.21.15.63:0/1437290353 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f977800a370 con 0x7f978013c710 2020-05-18T21:33:23.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.608+0000 7f9784e27700 1 --2- 172.21.15.63:0/1437290353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978013c710 0x7f978013cb80 secure :-1 s=THROTTLE_DONE pgs=1385 cs=0 l=1 rx=0x7f97780032f0 tx=0x7f9778007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.608+0000 7f9784e27700 1 --2- 172.21.15.63:0/1437290353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978013c710 0x7f978013cb80 secure :-1 s=THROTTLE_DONE pgs=1385 cs=0 l=1 rx=0x7f97780032f0 tx=0x7f9778007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.608+0000 7f977effd700 1 -- 172.21.15.63:0/1437290353 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977800a4d0 con 0x7f978013c710 2020-05-18T21:33:23.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.608+0000 7f977effd700 1 -- 172.21.15.63:0/1437290353 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f977800a8f0 con 0x7f978013c710 2020-05-18T21:33:23.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.608+0000 7f9785628700 1 -- 172.21.15.63:0/1437290353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978013c710 msgr2=0x7f978013cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.608+0000 7f9785628700 1 --2- 172.21.15.63:0/1437290353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978013c710 0x7f978013cb80 secure :-1 s=READY pgs=1385 cs=0 l=1 rx=0x7f97780032f0 tx=0x7f9778007e00).stop 2020-05-18T21:33:23.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.608+0000 7f9785628700 1 -- 172.21.15.63:0/1437290353 shutdown_connections 2020-05-18T21:33:23.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.608+0000 7f9785628700 1 --2- 172.21.15.63:0/1437290353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978013c710 0x7f978013cb80 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:23.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.608+0000 7f9785628700 1 --2- 172.21.15.63:0/1437290353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97800659d0 0x7f97800acea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:23.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.608+0000 7f9785628700 1 -- 172.21.15.63:0/1437290353 >> 172.21.15.63:0/1437290353 conn(0x7f9780069fc0 msgr2=0x7f978006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:23.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.608+0000 7f9785628700 1 -- 172.21.15.63:0/1437290353 shutdown_connections 2020-05-18T21:33:23.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.608+0000 7f9785628700 1 -- 172.21.15.63:0/1437290353 wait complete. 2020-05-18T21:33:23.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.608+0000 7f9785628700 1 Processor -- start 2020-05-18T21:33:23.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.608+0000 7f9785628700 1 -- start start 2020-05-18T21:33:23.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f9785628700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f978013c710 0x7f9780139be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:23.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f9785628700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97800b43c0 con 0x7f97800659d0 2020-05-18T21:33:23.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f9785628700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97800b4120 con 0x7f978005f110 2020-05-18T21:33:23.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f9785628700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978013f020 con 0x7f978013c710 2020-05-18T21:33:23.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f9784e27700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f978013c710 0x7f9780139be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f977f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f97800659d0 0x7f97801394d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34262/0 (socket says 172.21.15.63:34262) 2020-05-18T21:33:23.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f977f7fe700 1 -- 172.21.15.63:0/3196210365 learned_addr learned my addr 172.21.15.63:0/3196210365 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:23.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f977d7fa700 1 -- 172.21.15.63:0/3196210365 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624094125 0 0) 0x7f97800b43c0 con 0x7f97800659d0 2020-05-18T21:33:23.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f9784e27700 1 -- 172.21.15.63:0/3196210365 >> v1:172.21.15.155:6789/0 conn(0x7f978005f110 legacy=0x7f9780156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f9784e27700 1 -- 172.21.15.63:0/3196210365 >> v1:172.21.15.63:6789/0 conn(0x7f97800659d0 legacy=0x7f97801394d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f9784e27700 1 -- 172.21.15.63:0/3196210365 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9780156ea0 con 0x7f978013c710 2020-05-18T21:33:23.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f9784e27700 1 --2- 172.21.15.63:0/3196210365 >> v2:172.21.15.63:3300/0 conn(0x7f978013c710 0x7f9780139be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f97800b9050 tx=0x7f9778007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f9784e27700 1 --2- 172.21.15.63:0/3196210365 >> v2:172.21.15.63:3300/0 conn(0x7f978013c710 0x7f9780139be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f97800b9050 tx=0x7f9778007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f9784e27700 1 --2- 172.21.15.63:0/3196210365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978013c710 0x7f9780139be0 secure :-1 s=READY pgs=1387 cs=0 l=1 rx=0x7f97800b9050 tx=0x7f9778007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:23.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f9784e27700 1 --2- 172.21.15.63:0/3196210365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978013c710 0x7f9780139be0 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f97800b9050 tx=0x7f9778007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f977d7fa700 1 -- 172.21.15.63:0/3196210365 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f977800fea0 con 0x7f978013c710 2020-05-18T21:33:23.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f9784e27700 1 --2- 172.21.15.63:0/3196210365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978013c710 0x7f9780139be0 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f97800b9050 tx=0x7f9778007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f9784e27700 1 --2- 172.21.15.63:0/3196210365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978013c710 0x7f9780139be0 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f97800b9050 tx=0x7f9778007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f977d7fa700 1 -- 172.21.15.63:0/3196210365 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977800ae80 con 0x7f978013c710 2020-05-18T21:33:23.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f9785628700 1 -- 172.21.15.63:0/3196210365 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978013fa90 con 0x7f978013c710 2020-05-18T21:33:23.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f977d7fa700 1 -- 172.21.15.63:0/3196210365 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9778015760 con 0x7f978013c710 2020-05-18T21:33:23.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f9785628700 1 -- 172.21.15.63:0/3196210365 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978013f4c0 con 0x7f978013c710 2020-05-18T21:33:23.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f9784e27700 1 --2- 172.21.15.63:0/3196210365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978013c710 0x7f9780139be0 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f97800b9050 tx=0x7f9778007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.612+0000 7f9785628700 1 -- 172.21.15.63:0/3196210365 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97800b3f40 con 0x7f978013c710 2020-05-18T21:33:23.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.616+0000 7f977d7fa700 1 -- 172.21.15.63:0/3196210365 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9778005a80 con 0x7f978013c710 2020-05-18T21:33:23.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.616+0000 7f9784e27700 1 --2- 172.21.15.63:0/3196210365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978013c710 0x7f9780139be0 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f97800b9050 tx=0x7f9778007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.616+0000 7f977d7fa700 1 --2- 172.21.15.63:0/3196210365 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f976404f970 0x7f9764051e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:23.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.616+0000 7f977d7fa700 1 -- 172.21.15.63:0/3196210365 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9778064520 con 0x7f978013c710 2020-05-18T21:33:23.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.616+0000 7f977ffff700 1 --2- 172.21.15.63:0/3196210365 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f976404f970 0x7f9764051e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.616+0000 7f977ffff700 1 --2- 172.21.15.63:0/3196210365 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f976404f970 0x7f9764051e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f97800ad390 tx=0x7f9770001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.616+0000 7f977ffff700 1 --2- 172.21.15.63:0/3196210365 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f976404f970 0x7f9764051e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f97800ad390 tx=0x7f9770001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.616+0000 7f977ffff700 1 --2- 172.21.15.63:0/3196210365 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f976404f970 0x7f9764051e30 secure :-1 s=READY pgs=545 cs=0 l=1 rx=0x7f97800ad390 tx=0x7f9770001400).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:23.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.620+0000 7f9784e27700 1 --2- 172.21.15.63:0/3196210365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978013c710 0x7f9780139be0 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f97800b9050 tx=0x7f9778007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.620+0000 7f977d7fa700 1 -- 172.21.15.63:0/3196210365 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f977803e910 con 0x7f978013c710 2020-05-18T21:33:23.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.736+0000 7f9785628700 1 -- 172.21.15.63:0/3196210365 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97800569e0 con 0x7f978013c710 2020-05-18T21:33:23.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.736+0000 7f9784e27700 1 --2- 172.21.15.63:0/3196210365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978013c710 0x7f9780139be0 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f97800b9050 tx=0x7f9778007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.736+0000 7f977d7fa700 1 -- 172.21.15.63:0/3196210365 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+16116 (secure 0 0 0) 0x7f9778041f30 con 0x7f978013c710 2020-05-18T21:33:23.743 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:23.743 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":103,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:33:23.230176+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:33:21.749613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2020-05-18T21:33:22.242521+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:33:23.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.740+0000 7f9785628700 1 -- 172.21.15.63:0/3196210365 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f976404f970 msgr2=0x7f9764051e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.740+0000 7f9785628700 1 --2- 172.21.15.63:0/3196210365 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f976404f970 0x7f9764051e30 secure :-1 s=READY pgs=545 cs=0 l=1 rx=0x7f97800ad390 tx=0x7f9770001400).stop 2020-05-18T21:33:23.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.740+0000 7f9785628700 1 -- 172.21.15.63:0/3196210365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978013c710 msgr2=0x7f9780139be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.740+0000 7f9785628700 1 --2- 172.21.15.63:0/3196210365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978013c710 0x7f9780139be0 secure :-1 s=READY pgs=1387 cs=0 l=1 rx=0x7f97800b9050 tx=0x7f9778007e00).stop 2020-05-18T21:33:23.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.740+0000 7f9785628700 1 -- 172.21.15.63:0/3196210365 shutdown_connections 2020-05-18T21:33:23.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.740+0000 7f9785628700 1 --2- 172.21.15.63:0/3196210365 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f976404f970 0x7f9764051e30 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:23.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.740+0000 7f9785628700 1 --2- 172.21.15.63:0/3196210365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f978013c710 0x7f9780139be0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:23.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.740+0000 7f9785628700 1 -- 172.21.15.63:0/3196210365 >> 172.21.15.63:0/3196210365 conn(0x7f9780069fc0 msgr2=0x7f978006a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:23.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.740+0000 7f9785628700 1 -- 172.21.15.63:0/3196210365 shutdown_connections 2020-05-18T21:33:23.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.740+0000 7f9785628700 1 -- 172.21.15.63:0/3196210365 wait complete. 2020-05-18T21:33:23.762 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-05-18T21:33:23.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.864+0000 7f67d67dd700 1 Processor -- start 2020-05-18T21:33:23.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.864+0000 7f67d67dd700 1 -- start start 2020-05-18T21:33:23.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.864+0000 7f67d67dd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f67d0143630 0x7f67d0060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:23.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.864+0000 7f67d67dd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d0146420 con 0x7f67d0145e30 2020-05-18T21:33:23.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.864+0000 7f67d67dd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d01466c0 con 0x7f67d00bc8d0 2020-05-18T21:33:23.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.864+0000 7f67d67dd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d0146e00 con 0x7f67d0143630 2020-05-18T21:33:23.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.864+0000 7f67d4fda700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f67d0143630 0x7f67d0060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.864+0000 7f67d5fdc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f67d0145e30 0x7f67d012e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34270/0 (socket says 172.21.15.63:34270) 2020-05-18T21:33:23.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.864+0000 7f67d5fdc700 1 -- 172.21.15.63:0/2092361300 learned_addr learned my addr 172.21.15.63:0/2092361300 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:23.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.864+0000 7f67c7fff700 1 -- 172.21.15.63:0/2092361300 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1271447495 0 0) 0x7f67d0146420 con 0x7f67d0145e30 2020-05-18T21:33:23.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.864+0000 7f67c7fff700 1 -- 172.21.15.63:0/2092361300 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67b4003270 con 0x7f67d0145e30 2020-05-18T21:33:23.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.864+0000 7f67d4fda700 1 -- 172.21.15.63:0/2092361300 >> v1:172.21.15.155:6789/0 conn(0x7f67d00bc8d0 legacy=0x7f67d0142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.864+0000 7f67d4fda700 1 -- 172.21.15.63:0/2092361300 >> v1:172.21.15.63:6789/0 conn(0x7f67d0145e30 legacy=0x7f67d012e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.864+0000 7f67c7fff700 1 -- 172.21.15.63:0/2092361300 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3007818449 0 0) 0x7f67b4003270 con 0x7f67d0145e30 2020-05-18T21:33:23.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.864+0000 7f67d4fda700 1 -- 172.21.15.63:0/2092361300 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d0146960 con 0x7f67d0143630 2020-05-18T21:33:23.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.864+0000 7f67d4fda700 1 --2- 172.21.15.63:0/2092361300 >> v2:172.21.15.63:3300/0 conn(0x7f67d0143630 0x7f67d0060b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f67c8001c30 tx=0x7f67d0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.868+0000 7f67d4fda700 1 --2- 172.21.15.63:0/2092361300 >> v2:172.21.15.63:3300/0 conn(0x7f67d0143630 0x7f67d0060b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f67c8001c30 tx=0x7f67d0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.868+0000 7f67d4fda700 1 --2- 172.21.15.63:0/2092361300 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67d0143630 0x7f67d0060b00 secure :-1 s=READY pgs=1389 cs=0 l=1 rx=0x7f67c8001c30 tx=0x7f67d0061d60).ready entity=mon.0 client_cookie=964a450e72d0c765 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:23.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.868+0000 7f67d4fda700 1 --2- 172.21.15.63:0/2092361300 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67d0143630 0x7f67d0060b00 secure :-1 s=THROTTLE_DONE pgs=1389 cs=0 l=1 rx=0x7f67c8001c30 tx=0x7f67d0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.868+0000 7f67c7fff700 1 -- 172.21.15.63:0/2092361300 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67c8001a90 con 0x7f67d0143630 2020-05-18T21:33:23.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.868+0000 7f67d4fda700 1 --2- 172.21.15.63:0/2092361300 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67d0143630 0x7f67d0060b00 secure :-1 s=THROTTLE_DONE pgs=1389 cs=0 l=1 rx=0x7f67c8001c30 tx=0x7f67d0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.868+0000 7f67c7fff700 1 -- 172.21.15.63:0/2092361300 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c0008e40 con 0x7f67d0143630 2020-05-18T21:33:23.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.868+0000 7f67d4fda700 1 --2- 172.21.15.63:0/2092361300 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67d0143630 0x7f67d0060b00 secure :-1 s=THROTTLE_DONE pgs=1389 cs=0 l=1 rx=0x7f67c8001c30 tx=0x7f67d0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.868+0000 7f67c7fff700 1 -- 172.21.15.63:0/2092361300 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67c00114f0 con 0x7f67d0143630 2020-05-18T21:33:23.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.868+0000 7f67d67dd700 1 -- 172.21.15.63:0/2092361300 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67d0143630 msgr2=0x7f67d0060b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.868+0000 7f67d67dd700 1 --2- 172.21.15.63:0/2092361300 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67d0143630 0x7f67d0060b00 secure :-1 s=READY pgs=1389 cs=0 l=1 rx=0x7f67c8001c30 tx=0x7f67d0061d60).stop 2020-05-18T21:33:23.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.868+0000 7f67d67dd700 1 -- 172.21.15.63:0/2092361300 shutdown_connections 2020-05-18T21:33:23.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.868+0000 7f67d67dd700 1 --2- 172.21.15.63:0/2092361300 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67d0143630 0x7f67d0060b00 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:23.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.868+0000 7f67d67dd700 1 -- 172.21.15.63:0/2092361300 >> 172.21.15.63:0/2092361300 conn(0x7f67d005f3b0 msgr2=0x7f67d005f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:23.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.868+0000 7f67d67dd700 1 -- 172.21.15.63:0/2092361300 shutdown_connections 2020-05-18T21:33:23.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.868+0000 7f67d67dd700 1 -- 172.21.15.63:0/2092361300 wait complete. 2020-05-18T21:33:23.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.868+0000 7f67d67dd700 1 Processor -- start 2020-05-18T21:33:23.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.868+0000 7f67d67dd700 1 -- start start 2020-05-18T21:33:23.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d67dd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f67d0143630 0x7f67d01567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:23.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d67dd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67d0145e30 0x7f67d00b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:23.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d67dd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d00b33a0 con 0x7f67d00bc8d0 2020-05-18T21:33:23.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d67dd700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d00b4740 con 0x7f67d0143630 2020-05-18T21:33:23.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d67dd700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d00b49e0 con 0x7f67d0145e30 2020-05-18T21:33:23.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d57db700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f67d00bc8d0 0x7f67d01475f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34274/0 (socket says 172.21.15.63:34274) 2020-05-18T21:33:23.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d57db700 1 -- 172.21.15.63:0/3653485253 learned_addr learned my addr 172.21.15.63:0/3653485253 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:23.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d5fdc700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67d0145e30 0x7f67d00b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d4fda700 1 --2- 172.21.15.63:0/3653485253 >> v2:172.21.15.155:3300/0 conn(0x7f67d0143630 0x7f67d01567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67c67fc700 1 -- 172.21.15.63:0/3653485253 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871326189 0 0) 0x7f67d00b33a0 con 0x7f67d00bc8d0 2020-05-18T21:33:23.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67c67fc700 1 -- 172.21.15.63:0/3653485253 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67b8002fe0 con 0x7f67d00bc8d0 2020-05-18T21:33:23.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67c67fc700 1 -- 172.21.15.63:0/3653485253 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2767398843 0 0) 0x7f67b8002fe0 con 0x7f67d00bc8d0 2020-05-18T21:33:23.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d4fda700 1 -- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67d0145e30 msgr2=0x7f67d00b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d4fda700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67d0145e30 0x7f67d00b2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:23.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d4fda700 1 -- 172.21.15.63:0/3653485253 >> v1:172.21.15.63:6789/0 conn(0x7f67d00bc8d0 legacy=0x7f67d01475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:23.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d4fda700 1 -- 172.21.15.63:0/3653485253 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d00b4c80 con 0x7f67d0143630 2020-05-18T21:33:23.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d5fdc700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67d0145e30 0x7f67d00b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:23.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d4fda700 1 --2- 172.21.15.63:0/3653485253 >> v2:172.21.15.155:3300/0 conn(0x7f67d0143630 0x7f67d01567b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f67cc001b10 tx=0x7f67d0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d4fda700 1 --2- 172.21.15.63:0/3653485253 >> v2:172.21.15.155:3300/0 conn(0x7f67d0143630 0x7f67d01567b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f67cc001b10 tx=0x7f67d0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d4fda700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0143630 0x7f67d01567b0 secure :-1 s=READY pgs=940 cs=0 l=1 rx=0x7f67cc001b10 tx=0x7f67d0061d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:23.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d4fda700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0143630 0x7f67d01567b0 secure :-1 s=THROTTLE_DONE pgs=940 cs=0 l=1 rx=0x7f67cc001b10 tx=0x7f67d0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67c67fc700 1 -- 172.21.15.63:0/3653485253 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67cc001970 con 0x7f67d0143630 2020-05-18T21:33:23.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d4fda700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0143630 0x7f67d01567b0 secure :-1 s=THROTTLE_DONE pgs=940 cs=0 l=1 rx=0x7f67cc001b10 tx=0x7f67d0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d4fda700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0143630 0x7f67d01567b0 secure :-1 s=THROTTLE_DONE pgs=940 cs=0 l=1 rx=0x7f67cc001b10 tx=0x7f67d0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67c67fc700 1 -- 172.21.15.63:0/3653485253 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c0007170 con 0x7f67d0143630 2020-05-18T21:33:23.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67c67fc700 1 -- 172.21.15.63:0/3653485253 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67c00074d0 con 0x7f67d0143630 2020-05-18T21:33:23.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d67dd700 1 -- 172.21.15.63:0/3653485253 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d0147d00 con 0x7f67d0143630 2020-05-18T21:33:23.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.872+0000 7f67d67dd700 1 -- 172.21.15.63:0/3653485253 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d00b42a0 con 0x7f67d0143630 2020-05-18T21:33:23.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.876+0000 7f67d4fda700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0143630 0x7f67d01567b0 secure :-1 s=THROTTLE_DONE pgs=940 cs=0 l=1 rx=0x7f67cc001b10 tx=0x7f67d0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.876+0000 7f67d67dd700 1 -- 172.21.15.63:0/3653485253 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d00569e0 con 0x7f67d0143630 2020-05-18T21:33:23.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.876+0000 7f67c67fc700 1 -- 172.21.15.63:0/3653485253 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f67c0011930 con 0x7f67d0143630 2020-05-18T21:33:23.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.876+0000 7f67d4fda700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0143630 0x7f67d01567b0 secure :-1 s=THROTTLE_DONE pgs=940 cs=0 l=1 rx=0x7f67cc001b10 tx=0x7f67d0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.876+0000 7f67c67fc700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f67b804fd80 0x7f67b8052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:23.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.876+0000 7f67c67fc700 1 -- 172.21.15.63:0/3653485253 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f67c0064150 con 0x7f67d0143630 2020-05-18T21:33:23.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.876+0000 7f67d57db700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f67b804fd80 0x7f67b8052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:23.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.876+0000 7f67d57db700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f67b804fd80 0x7f67b8052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f67cc001210 tx=0x7f67cc009650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.876+0000 7f67d57db700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f67b804fd80 0x7f67b8052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f67cc001210 tx=0x7f67cc009650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.876+0000 7f67d57db700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f67b804fd80 0x7f67b8052240 secure :-1 s=READY pgs=546 cs=0 l=1 rx=0x7f67cc001210 tx=0x7f67cc009650).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:23.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.884+0000 7f67d4fda700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0143630 0x7f67d01567b0 secure :-1 s=THROTTLE_DONE pgs=940 cs=0 l=1 rx=0x7f67cc001b10 tx=0x7f67d0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:23.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:23.884+0000 7f67c67fc700 1 -- 172.21.15.63:0/3653485253 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f67c003e5a0 con 0x7f67d0143630 2020-05-18T21:33:24.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:24.036+0000 7f67d67dd700 1 -- 172.21.15.63:0/3653485253 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f67d00008d0 con 0x7f67d0143630 2020-05-18T21:33:24.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:24.876+0000 7f67d4fda700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0143630 0x7f67d01567b0 secure :-1 s=READY pgs=940 cs=0 l=1 rx=0x7f67cc001b10 tx=0x7f67d0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:24.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:24.944+0000 7f67d4fda700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0143630 0x7f67d01567b0 secure :-1 s=THROTTLE_DONE pgs=940 cs=0 l=1 rx=0x7f67cc001b10 tx=0x7f67d0061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:24.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:24.944+0000 7f67c67fc700 1 -- 172.21.15.63:0/3653485253 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v81) v1 ==== 118+0+0 (secure 0 0 0) 0x7f67c0041bc0 con 0x7f67d0143630 2020-05-18T21:33:24.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:24.948+0000 7f67d67dd700 1 -- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f67b804fd80 msgr2=0x7f67b8052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:24.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:24.948+0000 7f67d67dd700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f67b804fd80 0x7f67b8052240 secure :-1 s=READY pgs=546 cs=0 l=1 rx=0x7f67cc001210 tx=0x7f67cc009650).stop 2020-05-18T21:33:24.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:24.948+0000 7f67d67dd700 1 -- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0143630 msgr2=0x7f67d01567b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:24.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:24.948+0000 7f67d67dd700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0143630 0x7f67d01567b0 secure :-1 s=READY pgs=940 cs=0 l=1 rx=0x7f67cc001b10 tx=0x7f67d0061d60).stop 2020-05-18T21:33:24.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:24.948+0000 7f67d67dd700 1 -- 172.21.15.63:0/3653485253 shutdown_connections 2020-05-18T21:33:24.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:24.948+0000 7f67d67dd700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f67b804fd80 0x7f67b8052240 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:24.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:24.948+0000 7f67d67dd700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67d0145e30 0x7f67d00b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:24.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:24.948+0000 7f67d67dd700 1 --2- 172.21.15.63:0/3653485253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0143630 0x7f67d01567b0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:24.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:24.948+0000 7f67d67dd700 1 -- 172.21.15.63:0/3653485253 >> 172.21.15.63:0/3653485253 conn(0x7f67d005f3b0 msgr2=0x7f67d012ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:24.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:24.948+0000 7f67d67dd700 1 -- 172.21.15.63:0/3653485253 shutdown_connections 2020-05-18T21:33:24.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:24.948+0000 7f67d67dd700 1 -- 172.21.15.63:0/3653485253 wait complete. 2020-05-18T21:33:24.970 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:25.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.068+0000 7f026e2ca700 1 Processor -- start 2020-05-18T21:33:25.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.068+0000 7f026e2ca700 1 -- start start 2020-05-18T21:33:25.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026e2ca700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0268146ba0 0x7f0268099c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:25.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026e2ca700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f026809b3a0 0x7f02680b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:25.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026e2ca700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02680b8f40 0x7f0268098780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:25.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026e2ca700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0268146f80 con 0x7f026809b3a0 2020-05-18T21:33:25.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026e2ca700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026809b990 con 0x7f0268146ba0 2020-05-18T21:33:25.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026e2ca700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02681439d0 con 0x7f02680b8f40 2020-05-18T21:33:25.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026cac7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f026809b3a0 0x7f02680b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:25.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026cac7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f026809b3a0 0x7f02680b8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60328/0 (socket says 172.21.15.63:60328) 2020-05-18T21:33:25.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026cac7700 1 -- 172.21.15.63:0/1295058182 learned_addr learned my addr 172.21.15.63:0/1295058182 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:25.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026d2c8700 1 --2- 172.21.15.63:0/1295058182 >> v2:172.21.15.155:3300/0 conn(0x7f0268146ba0 0x7f0268099c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:25.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026dac9700 1 --2- 172.21.15.63:0/1295058182 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02680b8f40 0x7f0268098780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026cac7700 1 -- 172.21.15.63:0/1295058182 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02680b8f40 msgr2=0x7f0268098780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026cac7700 1 --2- 172.21.15.63:0/1295058182 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02680b8f40 0x7f0268098780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:25.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026cac7700 1 -- 172.21.15.63:0/1295058182 >> v2:172.21.15.155:3300/0 conn(0x7f0268146ba0 msgr2=0x7f0268099c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:25.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026cac7700 1 --2- 172.21.15.63:0/1295058182 >> v2:172.21.15.155:3300/0 conn(0x7f0268146ba0 0x7f0268099c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:25.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026cac7700 1 -- 172.21.15.63:0/1295058182 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0268144760 con 0x7f026809b3a0 2020-05-18T21:33:25.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026cac7700 1 --2- 172.21.15.63:0/1295058182 >> v2:172.21.15.63:3300/0 conn(0x7f026809b3a0 0x7f02680b8ae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f026809bad0 tx=0x7f0258008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026cac7700 1 --2- 172.21.15.63:0/1295058182 >> v2:172.21.15.63:3300/0 conn(0x7f026809b3a0 0x7f02680b8ae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f026809bad0 tx=0x7f0258008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026cac7700 1 --2- 172.21.15.63:0/1295058182 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f026809b3a0 0x7f02680b8ae0 secure :-1 s=READY pgs=1391 cs=0 l=1 rx=0x7f026809bad0 tx=0x7f0258008920).ready entity=mon.0 client_cookie=930f25abc2aa4a1c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:25.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026cac7700 1 --2- 172.21.15.63:0/1295058182 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f026809b3a0 0x7f02680b8ae0 secure :-1 s=THROTTLE_DONE pgs=1391 cs=0 l=1 rx=0x7f026809bad0 tx=0x7f0258008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026cac7700 1 --2- 172.21.15.63:0/1295058182 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f026809b3a0 0x7f02680b8ae0 secure :-1 s=THROTTLE_DONE pgs=1391 cs=0 l=1 rx=0x7f026809bad0 tx=0x7f0258008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026cac7700 1 --2- 172.21.15.63:0/1295058182 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f026809b3a0 0x7f02680b8ae0 secure :-1 s=THROTTLE_DONE pgs=1391 cs=0 l=1 rx=0x7f026809bad0 tx=0x7f0258008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f0257fff700 1 -- 172.21.15.63:0/1295058182 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0258011600 con 0x7f026809b3a0 2020-05-18T21:33:25.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f0257fff700 1 -- 172.21.15.63:0/1295058182 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0258011760 con 0x7f026809b3a0 2020-05-18T21:33:25.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f0257fff700 1 -- 172.21.15.63:0/1295058182 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0258011b80 con 0x7f026809b3a0 2020-05-18T21:33:25.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026e2ca700 1 -- 172.21.15.63:0/1295058182 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f026809b3a0 msgr2=0x7f02680b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026e2ca700 1 --2- 172.21.15.63:0/1295058182 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f026809b3a0 0x7f02680b8ae0 secure :-1 s=READY pgs=1391 cs=0 l=1 rx=0x7f026809bad0 tx=0x7f0258008920).stop 2020-05-18T21:33:25.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026e2ca700 1 -- 172.21.15.63:0/1295058182 shutdown_connections 2020-05-18T21:33:25.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026e2ca700 1 --2- 172.21.15.63:0/1295058182 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02680b8f40 0x7f0268098780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:25.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026e2ca700 1 --2- 172.21.15.63:0/1295058182 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f026809b3a0 0x7f02680b8ae0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:25.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.072+0000 7f026e2ca700 1 --2- 172.21.15.63:0/1295058182 >> v2:172.21.15.155:3300/0 conn(0x7f0268146ba0 0x7f0268099c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:25.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.076+0000 7f026e2ca700 1 -- 172.21.15.63:0/1295058182 >> 172.21.15.63:0/1295058182 conn(0x7f026805f630 msgr2=0x7f026805a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:25.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.076+0000 7f026e2ca700 1 -- 172.21.15.63:0/1295058182 shutdown_connections 2020-05-18T21:33:25.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.076+0000 7f026e2ca700 1 -- 172.21.15.63:0/1295058182 wait complete. 2020-05-18T21:33:25.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.076+0000 7f026e2ca700 1 Processor -- start 2020-05-18T21:33:25.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.076+0000 7f026e2ca700 1 -- start start 2020-05-18T21:33:25.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.076+0000 7f026e2ca700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f02680b8f40 0x7f0268151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:25.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.076+0000 7f026e2ca700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02680b5b70 con 0x7f0268146ba0 2020-05-18T21:33:25.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.076+0000 7f026e2ca700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0268154240 con 0x7f026809b3a0 2020-05-18T21:33:25.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.076+0000 7f026e2ca700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02680b5990 con 0x7f02680b8f40 2020-05-18T21:33:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.076+0000 7f026dac9700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0268146ba0 0x7f0268064db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34292/0 (socket says 172.21.15.63:34292) 2020-05-18T21:33:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.076+0000 7f026dac9700 1 -- 172.21.15.63:0/104270631 learned_addr learned my addr 172.21.15.63:0/104270631 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.076+0000 7f026cac7700 1 --2- 172.21.15.63:0/104270631 >> v2:172.21.15.155:3300/0 conn(0x7f02680b8f40 0x7f0268151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f02567fc700 1 -- 172.21.15.63:0/104270631 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3899051466 0 0) 0x7f02680b5b70 con 0x7f0268146ba0 2020-05-18T21:33:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f02567fc700 1 -- 172.21.15.63:0/104270631 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0248002fe0 con 0x7f0268146ba0 2020-05-18T21:33:25.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f026cac7700 1 -- 172.21.15.63:0/104270631 >> v1:172.21.15.155:6789/0 conn(0x7f026809b3a0 legacy=0x7f02680b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f02567fc700 1 -- 172.21.15.63:0/104270631 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474224646 0 0) 0x7f0268154240 con 0x7f026809b3a0 2020-05-18T21:33:25.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f026cac7700 1 -- 172.21.15.63:0/104270631 >> v1:172.21.15.63:6789/0 conn(0x7f0268146ba0 legacy=0x7f0268064db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f026cac7700 1 -- 172.21.15.63:0/104270631 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02680654c0 con 0x7f02680b8f40 2020-05-18T21:33:25.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f026cac7700 1 --2- 172.21.15.63:0/104270631 >> v2:172.21.15.155:3300/0 conn(0x7f02680b8f40 0x7f0268151820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0268064cc0 tx=0x7f026809ef90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f026cac7700 1 --2- 172.21.15.63:0/104270631 >> v2:172.21.15.155:3300/0 conn(0x7f02680b8f40 0x7f0268151820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0268064cc0 tx=0x7f026809ef90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f026cac7700 1 --2- 172.21.15.63:0/104270631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b8f40 0x7f0268151820 secure :-1 s=READY pgs=942 cs=0 l=1 rx=0x7f0268064cc0 tx=0x7f026809ef90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:25.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f026cac7700 1 --2- 172.21.15.63:0/104270631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b8f40 0x7f0268151820 secure :-1 s=THROTTLE_DONE pgs=942 cs=0 l=1 rx=0x7f0268064cc0 tx=0x7f026809ef90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f02567fc700 1 -- 172.21.15.63:0/104270631 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0258008750 con 0x7f02680b8f40 2020-05-18T21:33:25.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f026cac7700 1 --2- 172.21.15.63:0/104270631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b8f40 0x7f0268151820 secure :-1 s=THROTTLE_DONE pgs=942 cs=0 l=1 rx=0x7f0268064cc0 tx=0x7f026809ef90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f026cac7700 1 --2- 172.21.15.63:0/104270631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b8f40 0x7f0268151820 secure :-1 s=THROTTLE_DONE pgs=942 cs=0 l=1 rx=0x7f0268064cc0 tx=0x7f026809ef90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f02567fc700 1 -- 172.21.15.63:0/104270631 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0258007170 con 0x7f02680b8f40 2020-05-18T21:33:25.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f026e2ca700 1 -- 172.21.15.63:0/104270631 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0268140fc0 con 0x7f02680b8f40 2020-05-18T21:33:25.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f02567fc700 1 -- 172.21.15.63:0/104270631 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02580074d0 con 0x7f02680b8f40 2020-05-18T21:33:25.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f026e2ca700 1 -- 172.21.15.63:0/104270631 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02681546e0 con 0x7f02680b8f40 2020-05-18T21:33:25.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f026cac7700 1 --2- 172.21.15.63:0/104270631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b8f40 0x7f0268151820 secure :-1 s=THROTTLE_DONE pgs=942 cs=0 l=1 rx=0x7f0268064cc0 tx=0x7f026809ef90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f026e2ca700 1 -- 172.21.15.63:0/104270631 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02681543d0 con 0x7f02680b8f40 2020-05-18T21:33:25.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f02567fc700 1 -- 172.21.15.63:0/104270631 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0258005700 con 0x7f02680b8f40 2020-05-18T21:33:25.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.080+0000 7f026cac7700 1 --2- 172.21.15.63:0/104270631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b8f40 0x7f0268151820 secure :-1 s=THROTTLE_DONE pgs=942 cs=0 l=1 rx=0x7f0268064cc0 tx=0x7f026809ef90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.084+0000 7f02567fc700 1 --2- 172.21.15.63:0/104270631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024804fc70 0x7f0248052130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:25.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.084+0000 7f02567fc700 1 -- 172.21.15.63:0/104270631 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0258064210 con 0x7f02680b8f40 2020-05-18T21:33:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.084+0000 7f026d2c8700 1 --2- 172.21.15.63:0/104270631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024804fc70 0x7f0248052130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.084+0000 7f026d2c8700 1 --2- 172.21.15.63:0/104270631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024804fc70 0x7f0248052130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0264007960 tx=0x7f0264008190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.084+0000 7f026d2c8700 1 --2- 172.21.15.63:0/104270631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024804fc70 0x7f0248052130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0264007960 tx=0x7f0264008190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.084+0000 7f026d2c8700 1 --2- 172.21.15.63:0/104270631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024804fc70 0x7f0248052130 secure :-1 s=READY pgs=547 cs=0 l=1 rx=0x7f0264007960 tx=0x7f0264008190).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.092+0000 7f026cac7700 1 --2- 172.21.15.63:0/104270631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b8f40 0x7f0268151820 secure :-1 s=THROTTLE_DONE pgs=942 cs=0 l=1 rx=0x7f0268064cc0 tx=0x7f026809ef90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.092+0000 7f02567fc700 1 -- 172.21.15.63:0/104270631 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f025803e660 con 0x7f02680b8f40 2020-05-18T21:33:25.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.240+0000 7f026e2ca700 1 -- 172.21.15.63:0/104270631 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02680569e0 con 0x7f02680b8f40 2020-05-18T21:33:25.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.244+0000 7f026cac7700 1 --2- 172.21.15.63:0/104270631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b8f40 0x7f0268151820 secure :-1 s=THROTTLE_DONE pgs=942 cs=0 l=1 rx=0x7f0268064cc0 tx=0x7f026809ef90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.244+0000 7f02567fc700 1 -- 172.21.15.63:0/104270631 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f0258041c80 con 0x7f02680b8f40 2020-05-18T21:33:25.250 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:25.250 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":81,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6113,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2300000397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2300000397},{"type":"v1","addr":"172.21.15.63:6833","nonce":2300000397}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":78}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:23.230529+0000","modified":"2020-05-18T21:33:24.934162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8059":{"gid":8059,"name":"b","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1291107650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1291107650},{"type":"v1","addr":"172.21.15.155:6835","nonce":1291107650}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-05-18T21:33:25.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.244+0000 7f026e2ca700 1 -- 172.21.15.63:0/104270631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024804fc70 msgr2=0x7f0248052130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.244+0000 7f026e2ca700 1 --2- 172.21.15.63:0/104270631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024804fc70 0x7f0248052130 secure :-1 s=READY pgs=547 cs=0 l=1 rx=0x7f0264007960 tx=0x7f0264008190).stop 2020-05-18T21:33:25.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.244+0000 7f026e2ca700 1 -- 172.21.15.63:0/104270631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b8f40 msgr2=0x7f0268151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.244+0000 7f026e2ca700 1 --2- 172.21.15.63:0/104270631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b8f40 0x7f0268151820 secure :-1 s=READY pgs=942 cs=0 l=1 rx=0x7f0268064cc0 tx=0x7f026809ef90).stop 2020-05-18T21:33:25.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.244+0000 7f026e2ca700 1 -- 172.21.15.63:0/104270631 shutdown_connections 2020-05-18T21:33:25.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.244+0000 7f026e2ca700 1 --2- 172.21.15.63:0/104270631 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024804fc70 0x7f0248052130 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:25.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.244+0000 7f026e2ca700 1 --2- 172.21.15.63:0/104270631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02680b8f40 0x7f0268151820 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:25.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.244+0000 7f026e2ca700 1 -- 172.21.15.63:0/104270631 >> 172.21.15.63:0/104270631 conn(0x7f026805f630 msgr2=0x7f0268145180 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:25.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.244+0000 7f026e2ca700 1 -- 172.21.15.63:0/104270631 shutdown_connections 2020-05-18T21:33:25.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.244+0000 7f026e2ca700 1 -- 172.21.15.63:0/104270631 wait complete. 2020-05-18T21:33:25.255 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 81 2020-05-18T21:33:25.262 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:33:25.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.360+0000 7f89364c6700 1 Processor -- start 2020-05-18T21:33:25.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.360+0000 7f89364c6700 1 -- start start 2020-05-18T21:33:25.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f89364c6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f89301435a0 0x7f8930060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:25.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f89364c6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89300b7020 con 0x7f8930145df0 2020-05-18T21:33:25.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f89364c6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89300b72c0 con 0x7f89300b93f0 2020-05-18T21:33:25.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f89364c6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89300b7560 con 0x7f89301435a0 2020-05-18T21:33:25.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f8935cc5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f89301435a0 0x7f8930060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:25.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f8934cc3700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8930145df0 0x7f8930142e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34298/0 (socket says 172.21.15.63:34298) 2020-05-18T21:33:25.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f8934cc3700 1 -- 172.21.15.63:0/3512404910 learned_addr learned my addr 172.21.15.63:0/3512404910 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:25.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f891ffff700 1 -- 172.21.15.63:0/3512404910 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990459396 0 0) 0x7f89300b7020 con 0x7f8930145df0 2020-05-18T21:33:25.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f891ffff700 1 -- 172.21.15.63:0/3512404910 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8918003270 con 0x7f8930145df0 2020-05-18T21:33:25.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f8935cc5700 1 -- 172.21.15.63:0/3512404910 >> v1:172.21.15.155:6789/0 conn(0x7f89300b93f0 legacy=0x7f89300b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f8935cc5700 1 -- 172.21.15.63:0/3512404910 >> v1:172.21.15.63:6789/0 conn(0x7f8930145df0 legacy=0x7f8930142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f8935cc5700 1 -- 172.21.15.63:0/3512404910 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89300b7800 con 0x7f89301435a0 2020-05-18T21:33:25.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f8935cc5700 1 --2- 172.21.15.63:0/3512404910 >> v2:172.21.15.63:3300/0 conn(0x7f89301435a0 0x7f8930060430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f89280032f0 tx=0x7f8928007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f8935cc5700 1 --2- 172.21.15.63:0/3512404910 >> v2:172.21.15.63:3300/0 conn(0x7f89301435a0 0x7f8930060430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f89280032f0 tx=0x7f8928007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f8935cc5700 1 --2- 172.21.15.63:0/3512404910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89301435a0 0x7f8930060430 secure :-1 s=READY pgs=1394 cs=0 l=1 rx=0x7f89280032f0 tx=0x7f8928007e00).ready entity=mon.0 client_cookie=81b9eaf422fb1724 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:25.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f8935cc5700 1 --2- 172.21.15.63:0/3512404910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89301435a0 0x7f8930060430 secure :-1 s=THROTTLE_DONE pgs=1394 cs=0 l=1 rx=0x7f89280032f0 tx=0x7f8928007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f8935cc5700 1 --2- 172.21.15.63:0/3512404910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89301435a0 0x7f8930060430 secure :-1 s=THROTTLE_DONE pgs=1394 cs=0 l=1 rx=0x7f89280032f0 tx=0x7f8928007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f891ffff700 1 -- 172.21.15.63:0/3512404910 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8928011e60 con 0x7f89301435a0 2020-05-18T21:33:25.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f8935cc5700 1 --2- 172.21.15.63:0/3512404910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89301435a0 0x7f8930060430 secure :-1 s=THROTTLE_DONE pgs=1394 cs=0 l=1 rx=0x7f89280032f0 tx=0x7f8928007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f891ffff700 1 -- 172.21.15.63:0/3512404910 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892800a180 con 0x7f89301435a0 2020-05-18T21:33:25.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f89364c6700 1 -- 172.21.15.63:0/3512404910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89301435a0 msgr2=0x7f8930060430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f891ffff700 1 -- 172.21.15.63:0/3512404910 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f892800a520 con 0x7f89301435a0 2020-05-18T21:33:25.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f89364c6700 1 --2- 172.21.15.63:0/3512404910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89301435a0 0x7f8930060430 secure :-1 s=READY pgs=1394 cs=0 l=1 rx=0x7f89280032f0 tx=0x7f8928007e00).stop 2020-05-18T21:33:25.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f89364c6700 1 -- 172.21.15.63:0/3512404910 shutdown_connections 2020-05-18T21:33:25.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f89364c6700 1 --2- 172.21.15.63:0/3512404910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89301435a0 0x7f8930060430 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:25.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f89364c6700 1 -- 172.21.15.63:0/3512404910 >> 172.21.15.63:0/3512404910 conn(0x7f8930069b70 msgr2=0x7f8930069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:25.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f89364c6700 1 -- 172.21.15.63:0/3512404910 shutdown_connections 2020-05-18T21:33:25.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.364+0000 7f89364c6700 1 -- 172.21.15.63:0/3512404910 wait complete. 2020-05-18T21:33:25.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f89364c6700 1 Processor -- start 2020-05-18T21:33:25.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f89364c6700 1 -- start start 2020-05-18T21:33:25.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f89364c6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8930145df0 0x7f893013e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:25.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f89364c6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893013ea40 con 0x7f89300b93f0 2020-05-18T21:33:25.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f89364c6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89300b2ff0 con 0x7f89301435a0 2020-05-18T21:33:25.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f89364c6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89300b3290 con 0x7f8930145df0 2020-05-18T21:33:25.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f89354c4700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f89300b93f0 0x7f89300b27c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34304/0 (socket says 172.21.15.63:34304) 2020-05-18T21:33:25.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f89354c4700 1 -- 172.21.15.63:0/3679067387 learned_addr learned my addr 172.21.15.63:0/3679067387 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:25.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f8935cc5700 1 --2- 172.21.15.63:0/3679067387 >> v2:172.21.15.155:3300/0 conn(0x7f8930145df0 0x7f893013e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:25.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f891e7fc700 1 -- 172.21.15.63:0/3679067387 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135020154 0 0) 0x7f893013ea40 con 0x7f89300b93f0 2020-05-18T21:33:25.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f891e7fc700 1 -- 172.21.15.63:0/3679067387 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8910002fe0 con 0x7f89300b93f0 2020-05-18T21:33:25.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f891e7fc700 1 -- 172.21.15.63:0/3679067387 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582688183 0 0) 0x7f89300b2ff0 con 0x7f89301435a0 2020-05-18T21:33:25.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f891e7fc700 1 -- 172.21.15.63:0/3679067387 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f893013ea40 con 0x7f89301435a0 2020-05-18T21:33:25.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f891e7fc700 1 -- 172.21.15.63:0/3679067387 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2509088461 0 0) 0x7f8910002fe0 con 0x7f89300b93f0 2020-05-18T21:33:25.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f8935cc5700 1 -- 172.21.15.63:0/3679067387 >> v1:172.21.15.155:6789/0 conn(0x7f89301435a0 legacy=0x7f89301416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f8935cc5700 1 -- 172.21.15.63:0/3679067387 >> v1:172.21.15.63:6789/0 conn(0x7f89300b93f0 legacy=0x7f89300b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f8935cc5700 1 -- 172.21.15.63:0/3679067387 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89300ac4d0 con 0x7f8930145df0 2020-05-18T21:33:25.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f8935cc5700 1 --2- 172.21.15.63:0/3679067387 >> v2:172.21.15.155:3300/0 conn(0x7f8930145df0 0x7f893013e5e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f892c001ad0 tx=0x7f8928007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f8935cc5700 1 --2- 172.21.15.63:0/3679067387 >> v2:172.21.15.155:3300/0 conn(0x7f8930145df0 0x7f893013e5e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f892c001ad0 tx=0x7f8928007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f8935cc5700 1 --2- 172.21.15.63:0/3679067387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8930145df0 0x7f893013e5e0 secure :-1 s=READY pgs=945 cs=0 l=1 rx=0x7f892c001ad0 tx=0x7f8928007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:25.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f8935cc5700 1 --2- 172.21.15.63:0/3679067387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8930145df0 0x7f893013e5e0 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7f892c001ad0 tx=0x7f8928007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f891e7fc700 1 -- 172.21.15.63:0/3679067387 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f892c001970 con 0x7f8930145df0 2020-05-18T21:33:25.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f8935cc5700 1 --2- 172.21.15.63:0/3679067387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8930145df0 0x7f893013e5e0 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7f892c001ad0 tx=0x7f8928007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f8935cc5700 1 --2- 172.21.15.63:0/3679067387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8930145df0 0x7f893013e5e0 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7f892c001ad0 tx=0x7f8928007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f891e7fc700 1 -- 172.21.15.63:0/3679067387 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8928005a80 con 0x7f8930145df0 2020-05-18T21:33:25.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f89364c6700 1 -- 172.21.15.63:0/3679067387 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8930141db0 con 0x7f8930145df0 2020-05-18T21:33:25.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f891e7fc700 1 -- 172.21.15.63:0/3679067387 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8928005de0 con 0x7f8930145df0 2020-05-18T21:33:25.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.368+0000 7f89364c6700 1 -- 172.21.15.63:0/3679067387 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89301413a0 con 0x7f8930145df0 2020-05-18T21:33:25.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.372+0000 7f8935cc5700 1 --2- 172.21.15.63:0/3679067387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8930145df0 0x7f893013e5e0 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7f892c001ad0 tx=0x7f8928007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.372+0000 7f89364c6700 1 -- 172.21.15.63:0/3679067387 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89300569e0 con 0x7f8930145df0 2020-05-18T21:33:25.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.372+0000 7f891e7fc700 1 -- 172.21.15.63:0/3679067387 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8928007170 con 0x7f8930145df0 2020-05-18T21:33:25.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.372+0000 7f8935cc5700 1 --2- 172.21.15.63:0/3679067387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8930145df0 0x7f893013e5e0 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7f892c001ad0 tx=0x7f8928007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.372+0000 7f891e7fc700 1 --2- 172.21.15.63:0/3679067387 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f891004fe20 0x7f89100522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:25.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.372+0000 7f891e7fc700 1 -- 172.21.15.63:0/3679067387 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f89280644d0 con 0x7f8930145df0 2020-05-18T21:33:25.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.372+0000 7f89354c4700 1 --2- 172.21.15.63:0/3679067387 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f891004fe20 0x7f89100522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:25.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.372+0000 7f89354c4700 1 --2- 172.21.15.63:0/3679067387 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f891004fe20 0x7f89100522e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f892c001210 tx=0x7f892c009630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.372+0000 7f89354c4700 1 --2- 172.21.15.63:0/3679067387 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f891004fe20 0x7f89100522e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f892c001210 tx=0x7f892c009630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.372+0000 7f89354c4700 1 --2- 172.21.15.63:0/3679067387 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f891004fe20 0x7f89100522e0 secure :-1 s=READY pgs=548 cs=0 l=1 rx=0x7f892c001210 tx=0x7f892c009630).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:25.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.380+0000 7f8935cc5700 1 --2- 172.21.15.63:0/3679067387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8930145df0 0x7f893013e5e0 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7f892c001ad0 tx=0x7f8928007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.380+0000 7f891e7fc700 1 -- 172.21.15.63:0/3679067387 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f892803e860 con 0x7f8930145df0 2020-05-18T21:33:25.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.500+0000 7f89364c6700 1 -- 172.21.15.63:0/3679067387 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89300b8570 con 0x7f8930145df0 2020-05-18T21:33:25.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.508+0000 7f8935cc5700 1 --2- 172.21.15.63:0/3679067387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8930145df0 0x7f893013e5e0 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7f892c001ad0 tx=0x7f8928007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.508+0000 7f891e7fc700 1 -- 172.21.15.63:0/3679067387 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f8928041e80 con 0x7f8930145df0 2020-05-18T21:33:25.509 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:25.510 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":104,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:33:24.233716+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:33:21.749613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2020-05-18T21:33:22.242521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:33:25.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.508+0000 7f89364c6700 1 -- 172.21.15.63:0/3679067387 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f891004fe20 msgr2=0x7f89100522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.508+0000 7f89364c6700 1 --2- 172.21.15.63:0/3679067387 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f891004fe20 0x7f89100522e0 secure :-1 s=READY pgs=548 cs=0 l=1 rx=0x7f892c001210 tx=0x7f892c009630).stop 2020-05-18T21:33:25.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.508+0000 7f89364c6700 1 -- 172.21.15.63:0/3679067387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8930145df0 msgr2=0x7f893013e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.508+0000 7f89364c6700 1 --2- 172.21.15.63:0/3679067387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8930145df0 0x7f893013e5e0 secure :-1 s=READY pgs=945 cs=0 l=1 rx=0x7f892c001ad0 tx=0x7f8928007e00).stop 2020-05-18T21:33:25.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.508+0000 7f89364c6700 1 -- 172.21.15.63:0/3679067387 shutdown_connections 2020-05-18T21:33:25.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.508+0000 7f89364c6700 1 --2- 172.21.15.63:0/3679067387 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f891004fe20 0x7f89100522e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:25.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.508+0000 7f89364c6700 1 --2- 172.21.15.63:0/3679067387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8930145df0 0x7f893013e5e0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:25.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.508+0000 7f89364c6700 1 -- 172.21.15.63:0/3679067387 >> 172.21.15.63:0/3679067387 conn(0x7f8930069b70 msgr2=0x7f89301439b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:25.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.508+0000 7f89364c6700 1 -- 172.21.15.63:0/3679067387 shutdown_connections 2020-05-18T21:33:25.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.508+0000 7f89364c6700 1 -- 172.21.15.63:0/3679067387 wait complete. 2020-05-18T21:33:25.523 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:33:25.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f7428625700 1 Processor -- start 2020-05-18T21:33:25.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f7428625700 1 -- start start 2020-05-18T21:33:25.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f7428625700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74200ad070 0x7f7420156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:25.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f7428625700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7420065a70 con 0x7f74200b8c30 2020-05-18T21:33:25.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f7428625700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74200b9010 con 0x7f7420157260 2020-05-18T21:33:25.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f7428625700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74200801d0 con 0x7f74200ad070 2020-05-18T21:33:25.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f7426bc2700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f74200b8c30 0x7f74201566f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34310/0 (socket says 172.21.15.63:34310) 2020-05-18T21:33:25.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f7426bc2700 1 -- 172.21.15.63:0/2351843025 learned_addr learned my addr 172.21.15.63:0/2351843025 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:25.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f74263c1700 1 --2- 172.21.15.63:0/2351843025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74200ad070 0x7f7420156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:25.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f7425bc0700 1 -- 172.21.15.63:0/2351843025 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2099072675 0 0) 0x7f7420065a70 con 0x7f74200b8c30 2020-05-18T21:33:25.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f7425bc0700 1 -- 172.21.15.63:0/2351843025 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f740c003270 con 0x7f74200b8c30 2020-05-18T21:33:25.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f7425bc0700 1 -- 172.21.15.63:0/2351843025 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413588953 0 0) 0x7f74200b9010 con 0x7f7420157260 2020-05-18T21:33:25.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f7425bc0700 1 -- 172.21.15.63:0/2351843025 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7420065a70 con 0x7f7420157260 2020-05-18T21:33:25.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f74263c1700 1 -- 172.21.15.63:0/2351843025 >> v1:172.21.15.155:6789/0 conn(0x7f7420157260 legacy=0x7f742015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f74263c1700 1 -- 172.21.15.63:0/2351843025 >> v1:172.21.15.63:6789/0 conn(0x7f74200b8c30 legacy=0x7f74201566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f74263c1700 1 -- 172.21.15.63:0/2351843025 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742005bf00 con 0x7f74200ad070 2020-05-18T21:33:25.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f74263c1700 1 --2- 172.21.15.63:0/2351843025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74200ad070 0x7f7420156e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7410002f70 tx=0x7f7410008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f74263c1700 1 --2- 172.21.15.63:0/2351843025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74200ad070 0x7f7420156e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7410002f70 tx=0x7f7410008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f74263c1700 1 --2- 172.21.15.63:0/2351843025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74200ad070 0x7f7420156e00 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f7410002f70 tx=0x7f7410008920).ready entity=mon.2 client_cookie=8bc02ce9bc8ad2e3 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:25.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f74263c1700 1 --2- 172.21.15.63:0/2351843025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74200ad070 0x7f7420156e00 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f7410002f70 tx=0x7f7410008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f7425bc0700 1 -- 172.21.15.63:0/2351843025 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7410008e80 con 0x7f74200ad070 2020-05-18T21:33:25.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f74263c1700 1 --2- 172.21.15.63:0/2351843025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74200ad070 0x7f7420156e00 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f7410002f70 tx=0x7f7410008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f7425bc0700 1 -- 172.21.15.63:0/2351843025 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7410011580 con 0x7f74200ad070 2020-05-18T21:33:25.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f74263c1700 1 --2- 172.21.15.63:0/2351843025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74200ad070 0x7f7420156e00 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f7410002f70 tx=0x7f7410008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f7428625700 1 -- 172.21.15.63:0/2351843025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74200ad070 msgr2=0x7f7420156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f7425bc0700 1 -- 172.21.15.63:0/2351843025 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74100118e0 con 0x7f74200ad070 2020-05-18T21:33:25.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.632+0000 7f7428625700 1 --2- 172.21.15.63:0/2351843025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74200ad070 0x7f7420156e00 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f7410002f70 tx=0x7f7410008920).stop 2020-05-18T21:33:25.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.636+0000 7f7428625700 1 -- 172.21.15.63:0/2351843025 shutdown_connections 2020-05-18T21:33:25.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.636+0000 7f7428625700 1 --2- 172.21.15.63:0/2351843025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74200ad070 0x7f7420156e00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:25.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.636+0000 7f7428625700 1 -- 172.21.15.63:0/2351843025 >> 172.21.15.63:0/2351843025 conn(0x7f742006a640 msgr2=0x7f74200b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:25.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.636+0000 7f7428625700 1 -- 172.21.15.63:0/2351843025 shutdown_connections 2020-05-18T21:33:25.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.636+0000 7f7428625700 1 -- 172.21.15.63:0/2351843025 wait complete. 2020-05-18T21:33:25.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.636+0000 7f7428625700 1 Processor -- start 2020-05-18T21:33:25.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.636+0000 7f7428625700 1 -- start start 2020-05-18T21:33:25.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.636+0000 7f7428625700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74200ad070 0x7f7420137ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:25.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.636+0000 7f7428625700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f74200b8c30 0x7f742007fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:25.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.636+0000 7f7428625700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742007ffe0 con 0x7f7420157260 2020-05-18T21:33:25.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.636+0000 7f7428625700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7420138120 con 0x7f74200b8c30 2020-05-18T21:33:25.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.636+0000 7f7428625700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74201383c0 con 0x7f74200ad070 2020-05-18T21:33:25.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.636+0000 7f74273c3700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7420157260 0x7f7420072560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34318/0 (socket says 172.21.15.63:34318) 2020-05-18T21:33:25.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.636+0000 7f74273c3700 1 -- 172.21.15.63:0/2937820621 learned_addr learned my addr 172.21.15.63:0/2937820621 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:25.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.636+0000 7f74263c1700 1 --2- 172.21.15.63:0/2937820621 >> v2:172.21.15.63:3300/0 conn(0x7f74200b8c30 0x7f742007fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:25.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.636+0000 7f7426bc2700 1 --2- 172.21.15.63:0/2937820621 >> v2:172.21.15.155:3300/0 conn(0x7f74200ad070 0x7f7420137ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:25.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f74177fe700 1 -- 172.21.15.63:0/2937820621 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780518266 0 0) 0x7f742007ffe0 con 0x7f7420157260 2020-05-18T21:33:25.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f74263c1700 1 -- 172.21.15.63:0/2937820621 >> v2:172.21.15.155:3300/0 conn(0x7f74200ad070 msgr2=0x7f7420137ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f74263c1700 1 --2- 172.21.15.63:0/2937820621 >> v2:172.21.15.155:3300/0 conn(0x7f74200ad070 0x7f7420137ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:25.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f74263c1700 1 -- 172.21.15.63:0/2937820621 >> v1:172.21.15.63:6789/0 conn(0x7f7420157260 legacy=0x7f7420072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f74263c1700 1 -- 172.21.15.63:0/2937820621 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7420072050 con 0x7f74200b8c30 2020-05-18T21:33:25.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f74263c1700 1 --2- 172.21.15.63:0/2937820621 >> v2:172.21.15.63:3300/0 conn(0x7f74200b8c30 0x7f742007fb80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7420071f60 tx=0x7f7420066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f74263c1700 1 --2- 172.21.15.63:0/2937820621 >> v2:172.21.15.63:3300/0 conn(0x7f74200b8c30 0x7f742007fb80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7420071f60 tx=0x7f7420066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f74263c1700 1 --2- 172.21.15.63:0/2937820621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74200b8c30 0x7f742007fb80 secure :-1 s=READY pgs=1398 cs=0 l=1 rx=0x7f7420071f60 tx=0x7f7420066290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:25.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f74263c1700 1 --2- 172.21.15.63:0/2937820621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74200b8c30 0x7f742007fb80 secure :-1 s=THROTTLE_DONE pgs=1398 cs=0 l=1 rx=0x7f7420071f60 tx=0x7f7420066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f74263c1700 1 --2- 172.21.15.63:0/2937820621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74200b8c30 0x7f742007fb80 secure :-1 s=THROTTLE_DONE pgs=1398 cs=0 l=1 rx=0x7f7420071f60 tx=0x7f7420066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f74177fe700 1 -- 172.21.15.63:0/2937820621 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f741000f830 con 0x7f74200b8c30 2020-05-18T21:33:25.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f74263c1700 1 --2- 172.21.15.63:0/2937820621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74200b8c30 0x7f742007fb80 secure :-1 s=THROTTLE_DONE pgs=1398 cs=0 l=1 rx=0x7f7420071f60 tx=0x7f7420066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f74177fe700 1 -- 172.21.15.63:0/2937820621 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7410007170 con 0x7f74200b8c30 2020-05-18T21:33:25.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f7428625700 1 -- 172.21.15.63:0/2937820621 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7420120800 con 0x7f74200b8c30 2020-05-18T21:33:25.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f74177fe700 1 -- 172.21.15.63:0/2937820621 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7410007510 con 0x7f74200b8c30 2020-05-18T21:33:25.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f7428625700 1 -- 172.21.15.63:0/2937820621 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7420120d30 con 0x7f74200b8c30 2020-05-18T21:33:25.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f74263c1700 1 --2- 172.21.15.63:0/2937820621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74200b8c30 0x7f742007fb80 secure :-1 s=THROTTLE_DONE pgs=1398 cs=0 l=1 rx=0x7f7420071f60 tx=0x7f7420066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f7428625700 1 -- 172.21.15.63:0/2937820621 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7420072260 con 0x7f74200b8c30 2020-05-18T21:33:25.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f74177fe700 1 -- 172.21.15.63:0/2937820621 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7410005700 con 0x7f74200b8c30 2020-05-18T21:33:25.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f74263c1700 1 --2- 172.21.15.63:0/2937820621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74200b8c30 0x7f742007fb80 secure :-1 s=THROTTLE_DONE pgs=1398 cs=0 l=1 rx=0x7f7420071f60 tx=0x7f7420066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f74177fe700 1 --2- 172.21.15.63:0/2937820621 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f740804f7f0 0x7f7408051cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:25.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.640+0000 7f74177fe700 1 -- 172.21.15.63:0/2937820621 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f74100a84b0 con 0x7f74200b8c30 2020-05-18T21:33:25.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.644+0000 7f7426bc2700 1 --2- 172.21.15.63:0/2937820621 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f740804f7f0 0x7f7408051cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:25.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.644+0000 7f7426bc2700 1 --2- 172.21.15.63:0/2937820621 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f740804f7f0 0x7f7408051cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f741c001110 tx=0x7f741c001920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.644+0000 7f7426bc2700 1 --2- 172.21.15.63:0/2937820621 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f740804f7f0 0x7f7408051cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f741c001110 tx=0x7f741c001920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.644+0000 7f7426bc2700 1 --2- 172.21.15.63:0/2937820621 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f740804f7f0 0x7f7408051cb0 secure :-1 s=READY pgs=549 cs=0 l=1 rx=0x7f741c001110 tx=0x7f741c001920).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:25.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.648+0000 7f74263c1700 1 --2- 172.21.15.63:0/2937820621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74200b8c30 0x7f742007fb80 secure :-1 s=THROTTLE_DONE pgs=1398 cs=0 l=1 rx=0x7f7420071f60 tx=0x7f7420066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.648+0000 7f74177fe700 1 -- 172.21.15.63:0/2937820621 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f7410082960 con 0x7f74200b8c30 2020-05-18T21:33:25.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.800+0000 7f7428625700 1 -- 172.21.15.63:0/2937820621 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f74200569e0 con 0x7f74200b8c30 2020-05-18T21:33:25.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.808+0000 7f74263c1700 1 --2- 172.21.15.63:0/2937820621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74200b8c30 0x7f742007fb80 secure :-1 s=THROTTLE_DONE pgs=1398 cs=0 l=1 rx=0x7f7420071f60 tx=0x7f7420066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.808+0000 7f74177fe700 1 -- 172.21.15.63:0/2937820621 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v39) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7410085f80 con 0x7f74200b8c30 2020-05-18T21:33:25.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.808+0000 7f7428625700 1 -- 172.21.15.63:0/2937820621 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f740804f7f0 msgr2=0x7f7408051cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.808+0000 7f7428625700 1 --2- 172.21.15.63:0/2937820621 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f740804f7f0 0x7f7408051cb0 secure :-1 s=READY pgs=549 cs=0 l=1 rx=0x7f741c001110 tx=0x7f741c001920).stop 2020-05-18T21:33:25.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.808+0000 7f7428625700 1 -- 172.21.15.63:0/2937820621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74200b8c30 msgr2=0x7f742007fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.808+0000 7f7428625700 1 --2- 172.21.15.63:0/2937820621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74200b8c30 0x7f742007fb80 secure :-1 s=READY pgs=1398 cs=0 l=1 rx=0x7f7420071f60 tx=0x7f7420066290).stop 2020-05-18T21:33:25.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.808+0000 7f7428625700 1 -- 172.21.15.63:0/2937820621 shutdown_connections 2020-05-18T21:33:25.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.808+0000 7f7428625700 1 --2- 172.21.15.63:0/2937820621 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f740804f7f0 0x7f7408051cb0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:25.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.808+0000 7f7428625700 1 --2- 172.21.15.63:0/2937820621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74200b8c30 0x7f742007fb80 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:25.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.808+0000 7f7428625700 1 --2- 172.21.15.63:0/2937820621 >> v2:172.21.15.155:3300/0 conn(0x7f74200ad070 0x7f7420137ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:25.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.808+0000 7f7428625700 1 -- 172.21.15.63:0/2937820621 >> 172.21.15.63:0/2937820621 conn(0x7f742006a640 msgr2=0x7f74200aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:25.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.808+0000 7f7428625700 1 -- 172.21.15.63:0/2937820621 shutdown_connections 2020-05-18T21:33:25.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.808+0000 7f7428625700 1 -- 172.21.15.63:0/2937820621 wait complete. 2020-05-18T21:33:25.821 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.0 2020-05-18T21:33:25.829 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:33:25.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce65efa700 1 Processor -- start 2020-05-18T21:33:25.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce65efa700 1 -- start start 2020-05-18T21:33:25.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce65efa700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fce600ad070 0x7fce60156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:25.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce65efa700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fce60157260 0x7fce6015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce65efa700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce60065a70 con 0x7fce600b8c30 2020-05-18T21:33:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce65efa700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce600801d0 con 0x7fce600ad070 2020-05-18T21:33:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce65efa700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce600b5ae0 con 0x7fce60157260 2020-05-18T21:33:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce5f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fce600ad070 0x7fce60156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce5f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fce600ad070 0x7fce60156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60368/0 (socket says 172.21.15.63:60368) 2020-05-18T21:33:25.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce5f7fe700 1 -- 172.21.15.63:0/3391146394 learned_addr learned my addr 172.21.15.63:0/3391146394 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:25.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce5ffff700 1 --1- 172.21.15.63:0/3391146394 >> v1:172.21.15.63:6789/0 conn(0x7fce600b8c30 0x7fce601566f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34326/0 (socket says 172.21.15.63:34326) 2020-05-18T21:33:25.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce64c98700 1 --2- 172.21.15.63:0/3391146394 >> v2:172.21.15.155:3300/0 conn(0x7fce60157260 0x7fce6015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:25.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce5f7fe700 1 -- 172.21.15.63:0/3391146394 >> v2:172.21.15.155:3300/0 conn(0x7fce60157260 msgr2=0x7fce6015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:25.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce5f7fe700 1 --2- 172.21.15.63:0/3391146394 >> v2:172.21.15.155:3300/0 conn(0x7fce60157260 0x7fce6015c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:25.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce5f7fe700 1 -- 172.21.15.63:0/3391146394 >> v1:172.21.15.63:6789/0 conn(0x7fce600b8c30 legacy=0x7fce601566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce5f7fe700 1 -- 172.21.15.63:0/3391146394 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce600b9010 con 0x7fce600ad070 2020-05-18T21:33:25.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce5f7fe700 1 --2- 172.21.15.63:0/3391146394 >> v2:172.21.15.63:3300/0 conn(0x7fce600ad070 0x7fce60156e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fce54002f70 tx=0x7fce54007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce5f7fe700 1 --2- 172.21.15.63:0/3391146394 >> v2:172.21.15.63:3300/0 conn(0x7fce600ad070 0x7fce60156e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fce54002f70 tx=0x7fce54007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce5f7fe700 1 --2- 172.21.15.63:0/3391146394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce600ad070 0x7fce60156e00 secure :-1 s=READY pgs=1400 cs=0 l=1 rx=0x7fce54002f70 tx=0x7fce54007a80).ready entity=mon.0 client_cookie=8457aa049d59c618 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce5f7fe700 1 --2- 172.21.15.63:0/3391146394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce600ad070 0x7fce60156e00 secure :-1 s=THROTTLE_DONE pgs=1400 cs=0 l=1 rx=0x7fce54002f70 tx=0x7fce54007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce5effd700 1 -- 172.21.15.63:0/3391146394 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce54011760 con 0x7fce600ad070 2020-05-18T21:33:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce5f7fe700 1 --2- 172.21.15.63:0/3391146394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce600ad070 0x7fce60156e00 secure :-1 s=THROTTLE_DONE pgs=1400 cs=0 l=1 rx=0x7fce54002f70 tx=0x7fce54007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce5f7fe700 1 --2- 172.21.15.63:0/3391146394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce600ad070 0x7fce60156e00 secure :-1 s=THROTTLE_DONE pgs=1400 cs=0 l=1 rx=0x7fce54002f70 tx=0x7fce54007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce5effd700 1 -- 172.21.15.63:0/3391146394 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce540118c0 con 0x7fce600ad070 2020-05-18T21:33:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce5effd700 1 -- 172.21.15.63:0/3391146394 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce54011ce0 con 0x7fce600ad070 2020-05-18T21:33:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce65efa700 1 -- 172.21.15.63:0/3391146394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce600ad070 msgr2=0x7fce60156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.936+0000 7fce65efa700 1 --2- 172.21.15.63:0/3391146394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce600ad070 0x7fce60156e00 secure :-1 s=READY pgs=1400 cs=0 l=1 rx=0x7fce54002f70 tx=0x7fce54007a80).stop 2020-05-18T21:33:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.940+0000 7fce65efa700 1 -- 172.21.15.63:0/3391146394 shutdown_connections 2020-05-18T21:33:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.940+0000 7fce65efa700 1 --2- 172.21.15.63:0/3391146394 >> v2:172.21.15.155:3300/0 conn(0x7fce60157260 0x7fce6015c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.940+0000 7fce65efa700 1 --2- 172.21.15.63:0/3391146394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce600ad070 0x7fce60156e00 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.940+0000 7fce65efa700 1 -- 172.21.15.63:0/3391146394 >> 172.21.15.63:0/3391146394 conn(0x7fce6006a640 msgr2=0x7fce600b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.940+0000 7fce65efa700 1 -- 172.21.15.63:0/3391146394 shutdown_connections 2020-05-18T21:33:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.940+0000 7fce65efa700 1 -- 172.21.15.63:0/3391146394 wait complete. 2020-05-18T21:33:25.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.940+0000 7fce65efa700 1 Processor -- start 2020-05-18T21:33:25.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.940+0000 7fce65efa700 1 -- start start 2020-05-18T21:33:25.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce65efa700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fce600b8c30 0x7fce600635e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:25.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce65efa700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce60157260 0x7fce6006f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:25.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce65efa700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce6006fd20 con 0x7fce600ad070 2020-05-18T21:33:25.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce65efa700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce60134020 con 0x7fce600b8c30 2020-05-18T21:33:25.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce65efa700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce601342c0 con 0x7fce60157260 2020-05-18T21:33:25.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce5f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fce600b8c30 0x7fce600635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:25.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce5f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fce600b8c30 0x7fce600635e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60376/0 (socket says 172.21.15.63:60376) 2020-05-18T21:33:25.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce5f7fe700 1 -- 172.21.15.63:0/1425815695 learned_addr learned my addr 172.21.15.63:0/1425815695 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:25.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce64c98700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce60157260 0x7fce6006f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:25.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce5f7fe700 1 -- 172.21.15.63:0/1425815695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce60157260 msgr2=0x7fce6006f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce5f7fe700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce60157260 0x7fce6006f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:25.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce5f7fe700 1 -- 172.21.15.63:0/1425815695 >> v1:172.21.15.155:6789/0 conn(0x7fce600ad070 legacy=0x7fce60134a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:25.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce5f7fe700 1 -- 172.21.15.63:0/1425815695 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce60134560 con 0x7fce600b8c30 2020-05-18T21:33:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce5f7fe700 1 --2- 172.21.15.63:0/1425815695 >> v2:172.21.15.63:3300/0 conn(0x7fce600b8c30 0x7fce600635e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fce54002f70 tx=0x7fce54007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce5f7fe700 1 --2- 172.21.15.63:0/1425815695 >> v2:172.21.15.63:3300/0 conn(0x7fce600b8c30 0x7fce600635e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fce54002f70 tx=0x7fce54007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce5f7fe700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce600b8c30 0x7fce600635e0 secure :-1 s=READY pgs=1401 cs=0 l=1 rx=0x7fce54002f70 tx=0x7fce54007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce5f7fe700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce600b8c30 0x7fce600635e0 secure :-1 s=THROTTLE_DONE pgs=1401 cs=0 l=1 rx=0x7fce54002f70 tx=0x7fce54007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce5cff9700 1 -- 172.21.15.63:0/1425815695 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce54005700 con 0x7fce600b8c30 2020-05-18T21:33:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce5f7fe700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce600b8c30 0x7fce600635e0 secure :-1 s=THROTTLE_DONE pgs=1401 cs=0 l=1 rx=0x7fce54002f70 tx=0x7fce54007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce65efa700 1 -- 172.21.15.63:0/1425815695 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce60133ca0 con 0x7fce600b8c30 2020-05-18T21:33:25.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce5cff9700 1 -- 172.21.15.63:0/1425815695 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce54005860 con 0x7fce600b8c30 2020-05-18T21:33:25.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.944+0000 7fce5f7fe700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce600b8c30 0x7fce600635e0 secure :-1 s=THROTTLE_DONE pgs=1401 cs=0 l=1 rx=0x7fce54002f70 tx=0x7fce54007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.948+0000 7fce5cff9700 1 -- 172.21.15.63:0/1425815695 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce54005bc0 con 0x7fce600b8c30 2020-05-18T21:33:25.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.948+0000 7fce65efa700 1 -- 172.21.15.63:0/1425815695 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce60135110 con 0x7fce600b8c30 2020-05-18T21:33:25.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.948+0000 7fce5f7fe700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce600b8c30 0x7fce600635e0 secure :-1 s=THROTTLE_DONE pgs=1401 cs=0 l=1 rx=0x7fce54002f70 tx=0x7fce54007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.948+0000 7fce65efa700 1 -- 172.21.15.63:0/1425815695 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce601346f0 con 0x7fce600b8c30 2020-05-18T21:33:25.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.948+0000 7fce5cff9700 1 -- 172.21.15.63:0/1425815695 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fce540071a0 con 0x7fce600b8c30 2020-05-18T21:33:25.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.948+0000 7fce5f7fe700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce600b8c30 0x7fce600635e0 secure :-1 s=THROTTLE_DONE pgs=1401 cs=0 l=1 rx=0x7fce54002f70 tx=0x7fce54007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.948+0000 7fce5cff9700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fce4004f9b0 0x7fce40051e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:25.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.948+0000 7fce5cff9700 1 -- 172.21.15.63:0/1425815695 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fce540668f0 con 0x7fce600b8c30 2020-05-18T21:33:25.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.948+0000 7fce5ffff700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fce4004f9b0 0x7fce40051e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:25.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.948+0000 7fce5ffff700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fce4004f9b0 0x7fce40051e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fce60135a20 tx=0x7fce50001530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.948+0000 7fce5ffff700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fce4004f9b0 0x7fce40051e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fce60135a20 tx=0x7fce50001530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.948+0000 7fce5ffff700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fce4004f9b0 0x7fce40051e70 secure :-1 s=READY pgs=550 cs=0 l=1 rx=0x7fce60135a20 tx=0x7fce50001530).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:25.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.952+0000 7fce5f7fe700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce600b8c30 0x7fce600635e0 secure :-1 s=THROTTLE_DONE pgs=1401 cs=0 l=1 rx=0x7fce54002f70 tx=0x7fce54007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:25.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:25.952+0000 7fce5cff9700 1 -- 172.21.15.63:0/1425815695 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fce54040d40 con 0x7fce600b8c30 2020-05-18T21:33:26.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.104+0000 7fce65efa700 1 -- 172.21.15.63:0/1425815695 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fce60133e30 con 0x7fce600b8c30 2020-05-18T21:33:26.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.112+0000 7fce5f7fe700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce600b8c30 0x7fce600635e0 secure :-1 s=THROTTLE_DONE pgs=1401 cs=0 l=1 rx=0x7fce54002f70 tx=0x7fce54007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.112+0000 7fce5cff9700 1 -- 172.21.15.63:0/1425815695 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v40) v1 ==== 184+0+0 (secure 0 0 0) 0x7fce54044360 con 0x7fce600b8c30 2020-05-18T21:33:26.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.112+0000 7fce65efa700 1 -- 172.21.15.63:0/1425815695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fce4004f9b0 msgr2=0x7fce40051e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:26.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.112+0000 7fce65efa700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fce4004f9b0 0x7fce40051e70 secure :-1 s=READY pgs=550 cs=0 l=1 rx=0x7fce60135a20 tx=0x7fce50001530).stop 2020-05-18T21:33:26.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.112+0000 7fce65efa700 1 -- 172.21.15.63:0/1425815695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce600b8c30 msgr2=0x7fce600635e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:26.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.112+0000 7fce65efa700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce600b8c30 0x7fce600635e0 secure :-1 s=READY pgs=1401 cs=0 l=1 rx=0x7fce54002f70 tx=0x7fce54007a80).stop 2020-05-18T21:33:26.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.112+0000 7fce65efa700 1 -- 172.21.15.63:0/1425815695 shutdown_connections 2020-05-18T21:33:26.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.112+0000 7fce65efa700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fce4004f9b0 0x7fce40051e70 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:26.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.112+0000 7fce65efa700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce60157260 0x7fce6006f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:26.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.112+0000 7fce65efa700 1 --2- 172.21.15.63:0/1425815695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce600b8c30 0x7fce600635e0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:26.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.112+0000 7fce65efa700 1 -- 172.21.15.63:0/1425815695 >> 172.21.15.63:0/1425815695 conn(0x7fce6006a640 msgr2=0x7fce600b1530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:26.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.112+0000 7fce65efa700 1 -- 172.21.15.63:0/1425815695 shutdown_connections 2020-05-18T21:33:26.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.112+0000 7fce65efa700 1 -- 172.21.15.63:0/1425815695 wait complete. 2020-05-18T21:33:26.122 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.1 2020-05-18T21:33:26.132 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:33:26.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.244+0000 7f0fff0a0700 1 Processor -- start 2020-05-18T21:33:26.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.244+0000 7f0fff0a0700 1 -- start start 2020-05-18T21:33:26.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.244+0000 7f0fff0a0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0ff80b6cd0 0x7f0ff81522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:26.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.244+0000 7f0fff0a0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff8025500 con 0x7f0ff80b5cb0 2020-05-18T21:33:26.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.244+0000 7f0fff0a0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff8064ee0 con 0x7f0ff80b6410 2020-05-18T21:33:26.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.244+0000 7f0fff0a0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff80b67f0 con 0x7f0ff80b6cd0 2020-05-18T21:33:26.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.244+0000 7f0ffe09e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0ff80b5cb0 0x7f0ff8151bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34340/0 (socket says 172.21.15.63:34340) 2020-05-18T21:33:26.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.244+0000 7f0ffe09e700 1 -- 172.21.15.63:0/4058299257 learned_addr learned my addr 172.21.15.63:0/4058299257 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:26.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.244+0000 7f1000302700 1 --2- 172.21.15.63:0/4058299257 >> v2:172.21.15.63:3300/0 conn(0x7f0ff80b6cd0 0x7f0ff81522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:26.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.244+0000 7f0ffd89d700 1 -- 172.21.15.63:0/4058299257 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865349878 0 0) 0x7f0ff8025500 con 0x7f0ff80b5cb0 2020-05-18T21:33:26.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.244+0000 7f0ffd89d700 1 -- 172.21.15.63:0/4058299257 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fe0003270 con 0x7f0ff80b5cb0 2020-05-18T21:33:26.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.244+0000 7f1000302700 1 -- 172.21.15.63:0/4058299257 >> v1:172.21.15.155:6789/0 conn(0x7f0ff80b6410 legacy=0x7f0ff8061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:26.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.244+0000 7f1000302700 1 -- 172.21.15.63:0/4058299257 >> v1:172.21.15.63:6789/0 conn(0x7f0ff80b5cb0 legacy=0x7f0ff8151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:26.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.244+0000 7f1000302700 1 -- 172.21.15.63:0/4058299257 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff8025180 con 0x7f0ff80b6cd0 2020-05-18T21:33:26.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.248+0000 7f1000302700 1 --2- 172.21.15.63:0/4058299257 >> v2:172.21.15.63:3300/0 conn(0x7f0ff80b6cd0 0x7f0ff81522d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0fe8002f70 tx=0x7f0fe8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.248+0000 7f1000302700 1 --2- 172.21.15.63:0/4058299257 >> v2:172.21.15.63:3300/0 conn(0x7f0ff80b6cd0 0x7f0ff81522d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0fe8002f70 tx=0x7f0fe8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.248+0000 7f1000302700 1 --2- 172.21.15.63:0/4058299257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ff80b6cd0 0x7f0ff81522d0 secure :-1 s=READY pgs=1403 cs=0 l=1 rx=0x7f0fe8002f70 tx=0x7f0fe8007a80).ready entity=mon.0 client_cookie=529421302bce832d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:26.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.248+0000 7f1000302700 1 --2- 172.21.15.63:0/4058299257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ff80b6cd0 0x7f0ff81522d0 secure :-1 s=THROTTLE_DONE pgs=1403 cs=0 l=1 rx=0x7f0fe8002f70 tx=0x7f0fe8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.248+0000 7f0ffd89d700 1 -- 172.21.15.63:0/4058299257 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fe8008e80 con 0x7f0ff80b6cd0 2020-05-18T21:33:26.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.248+0000 7f1000302700 1 --2- 172.21.15.63:0/4058299257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ff80b6cd0 0x7f0ff81522d0 secure :-1 s=THROTTLE_DONE pgs=1403 cs=0 l=1 rx=0x7f0fe8002f70 tx=0x7f0fe8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.248+0000 7f1000302700 1 --2- 172.21.15.63:0/4058299257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ff80b6cd0 0x7f0ff81522d0 secure :-1 s=THROTTLE_DONE pgs=1403 cs=0 l=1 rx=0x7f0fe8002f70 tx=0x7f0fe8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.248+0000 7f0ffd89d700 1 -- 172.21.15.63:0/4058299257 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe80115f0 con 0x7f0ff80b6cd0 2020-05-18T21:33:26.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.248+0000 7f0ffd89d700 1 -- 172.21.15.63:0/4058299257 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fe80119d0 con 0x7f0ff80b6cd0 2020-05-18T21:33:26.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.248+0000 7f0fff0a0700 1 -- 172.21.15.63:0/4058299257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ff80b6cd0 msgr2=0x7f0ff81522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:26.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.248+0000 7f0fff0a0700 1 --2- 172.21.15.63:0/4058299257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ff80b6cd0 0x7f0ff81522d0 secure :-1 s=READY pgs=1403 cs=0 l=1 rx=0x7f0fe8002f70 tx=0x7f0fe8007a80).stop 2020-05-18T21:33:26.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.248+0000 7f0fff0a0700 1 -- 172.21.15.63:0/4058299257 shutdown_connections 2020-05-18T21:33:26.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.248+0000 7f0fff0a0700 1 --2- 172.21.15.63:0/4058299257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ff80b6cd0 0x7f0ff81522d0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:26.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.248+0000 7f0fff0a0700 1 -- 172.21.15.63:0/4058299257 >> 172.21.15.63:0/4058299257 conn(0x7f0ff8069b70 msgr2=0x7f0ff8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:26.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.248+0000 7f0fff0a0700 1 -- 172.21.15.63:0/4058299257 shutdown_connections 2020-05-18T21:33:26.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.248+0000 7f0fff0a0700 1 -- 172.21.15.63:0/4058299257 wait complete. 2020-05-18T21:33:26.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.248+0000 7f0fff0a0700 1 Processor -- start 2020-05-18T21:33:26.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.248+0000 7f0fff0a0700 1 -- start start 2020-05-18T21:33:26.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f0fff0a0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ff80b5cb0 0x7f0ff80b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:26.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f0fff0a0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0ff80b6cd0 0x7f0ff80b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:26.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f0fff0a0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff8136020 con 0x7f0ff80b6410 2020-05-18T21:33:26.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f0fff0a0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff80b0e60 con 0x7f0ff80b6cd0 2020-05-18T21:33:26.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f0fff0a0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8136280 con 0x7f0ff80b5cb0 2020-05-18T21:33:26.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f1000302700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0ff80b6cd0 0x7f0ff80b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:26.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f0ffe09e700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f0ff80b6410 0x7f0ff8152b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:60892/0 (socket says 172.21.15.63:60892) 2020-05-18T21:33:26.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f1000302700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0ff80b6cd0 0x7f0ff80b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:47006/0 (socket says 172.21.15.63:47006) 2020-05-18T21:33:26.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f0ffe09e700 1 -- 172.21.15.63:0/2741016644 learned_addr learned my addr 172.21.15.63:0/2741016644 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:26.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f0ffe89f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ff80b5cb0 0x7f0ff80b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:26.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f1000302700 1 -- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ff80b5cb0 msgr2=0x7f0ff80b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:26.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f1000302700 1 --2- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ff80b5cb0 0x7f0ff80b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:26.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f1000302700 1 -- 172.21.15.63:0/2741016644 >> v1:172.21.15.155:6789/0 conn(0x7f0ff80b6410 legacy=0x7f0ff8152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:26.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f1000302700 1 -- 172.21.15.63:0/2741016644 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80b4670 con 0x7f0ff80b6cd0 2020-05-18T21:33:26.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f0ff77fe700 1 -- 172.21.15.63:0/2741016644 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653779147 0 0) 0x7f0ff8136020 con 0x7f0ff80b6410 2020-05-18T21:33:26.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f1000302700 1 --2- 172.21.15.63:0/2741016644 >> v2:172.21.15.155:3300/0 conn(0x7f0ff80b6cd0 0x7f0ff80b0a00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0fe8002f70 tx=0x7f0fe8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f1000302700 1 --2- 172.21.15.63:0/2741016644 >> v2:172.21.15.155:3300/0 conn(0x7f0ff80b6cd0 0x7f0ff80b0a00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0fe8002f70 tx=0x7f0fe8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f1000302700 1 --2- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff80b6cd0 0x7f0ff80b0a00 secure :-1 s=READY pgs=950 cs=0 l=1 rx=0x7f0fe8002f70 tx=0x7f0fe8007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:26.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f1000302700 1 --2- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff80b6cd0 0x7f0ff80b0a00 secure :-1 s=THROTTLE_DONE pgs=950 cs=0 l=1 rx=0x7f0fe8002f70 tx=0x7f0fe8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f0ff77fe700 1 -- 172.21.15.63:0/2741016644 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fe8005700 con 0x7f0ff80b6cd0 2020-05-18T21:33:26.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f1000302700 1 --2- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff80b6cd0 0x7f0ff80b0a00 secure :-1 s=THROTTLE_DONE pgs=950 cs=0 l=1 rx=0x7f0fe8002f70 tx=0x7f0fe8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f1000302700 1 --2- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff80b6cd0 0x7f0ff80b0a00 secure :-1 s=THROTTLE_DONE pgs=950 cs=0 l=1 rx=0x7f0fe8002f70 tx=0x7f0fe8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f0ff77fe700 1 -- 172.21.15.63:0/2741016644 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe8005860 con 0x7f0ff80b6cd0 2020-05-18T21:33:26.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f0ff77fe700 1 -- 172.21.15.63:0/2741016644 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fe8005c00 con 0x7f0ff80b6cd0 2020-05-18T21:33:26.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f0fff0a0700 1 -- 172.21.15.63:0/2741016644 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff80b4800 con 0x7f0ff80b6cd0 2020-05-18T21:33:26.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f0fff0a0700 1 -- 172.21.15.63:0/2741016644 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff8151b30 con 0x7f0ff80b6cd0 2020-05-18T21:33:26.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.252+0000 7f0fff0a0700 1 -- 172.21.15.63:0/2741016644 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff80569e0 con 0x7f0ff80b6cd0 2020-05-18T21:33:26.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.256+0000 7f1000302700 1 --2- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff80b6cd0 0x7f0ff80b0a00 secure :-1 s=THROTTLE_DONE pgs=950 cs=0 l=1 rx=0x7f0fe8002f70 tx=0x7f0fe8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.256+0000 7f0ff77fe700 1 -- 172.21.15.63:0/2741016644 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0fe8007180 con 0x7f0ff80b6cd0 2020-05-18T21:33:26.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.256+0000 7f1000302700 1 --2- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff80b6cd0 0x7f0ff80b0a00 secure :-1 s=THROTTLE_DONE pgs=950 cs=0 l=1 rx=0x7f0fe8002f70 tx=0x7f0fe8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.256+0000 7f0ff77fe700 1 --2- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fd804f820 0x7f0fd8051ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:26.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.256+0000 7f0ff77fe700 1 -- 172.21.15.63:0/2741016644 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0fe8064490 con 0x7f0ff80b6cd0 2020-05-18T21:33:26.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.256+0000 7f0ffe89f700 1 --2- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fd804f820 0x7f0fd8051ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:26.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.256+0000 7f0ffe89f700 1 --2- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fd804f820 0x7f0fd8051ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ff8061560 tx=0x7f0ff00041e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.256+0000 7f0ffe89f700 1 --2- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fd804f820 0x7f0fd8051ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ff8061560 tx=0x7f0ff00041e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.256+0000 7f0ffe89f700 1 --2- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fd804f820 0x7f0fd8051ce0 secure :-1 s=READY pgs=551 cs=0 l=1 rx=0x7f0ff8061560 tx=0x7f0ff00041e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:26.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.264+0000 7f1000302700 1 --2- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff80b6cd0 0x7f0ff80b0a00 secure :-1 s=THROTTLE_DONE pgs=950 cs=0 l=1 rx=0x7f0fe8002f70 tx=0x7f0fe8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.264+0000 7f0ff77fe700 1 -- 172.21.15.63:0/2741016644 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f0fe803e940 con 0x7f0ff80b6cd0 2020-05-18T21:33:26.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.416+0000 7f0fff0a0700 1 -- 172.21.15.63:0/2741016644 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0ff80b3370 con 0x7f0ff80b6cd0 2020-05-18T21:33:26.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.424+0000 7f1000302700 1 --2- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff80b6cd0 0x7f0ff80b0a00 secure :-1 s=THROTTLE_DONE pgs=950 cs=0 l=1 rx=0x7f0fe8002f70 tx=0x7f0fe8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.424+0000 7f0ff77fe700 1 -- 172.21.15.63:0/2741016644 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v41) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0fe8041f60 con 0x7f0ff80b6cd0 2020-05-18T21:33:26.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.428+0000 7f0fff0a0700 1 -- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fd804f820 msgr2=0x7f0fd8051ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:26.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.428+0000 7f0fff0a0700 1 --2- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fd804f820 0x7f0fd8051ce0 secure :-1 s=READY pgs=551 cs=0 l=1 rx=0x7f0ff8061560 tx=0x7f0ff00041e0).stop 2020-05-18T21:33:26.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.428+0000 7f0fff0a0700 1 -- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff80b6cd0 msgr2=0x7f0ff80b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:26.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.428+0000 7f0fff0a0700 1 --2- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff80b6cd0 0x7f0ff80b0a00 secure :-1 s=READY pgs=950 cs=0 l=1 rx=0x7f0fe8002f70 tx=0x7f0fe8007a80).stop 2020-05-18T21:33:26.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.428+0000 7f0fff0a0700 1 -- 172.21.15.63:0/2741016644 shutdown_connections 2020-05-18T21:33:26.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.428+0000 7f0fff0a0700 1 --2- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fd804f820 0x7f0fd8051ce0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:26.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.428+0000 7f0fff0a0700 1 --2- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff80b6cd0 0x7f0ff80b0a00 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:26.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.428+0000 7f0fff0a0700 1 --2- 172.21.15.63:0/2741016644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ff80b5cb0 0x7f0ff80b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:26.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.428+0000 7f0fff0a0700 1 -- 172.21.15.63:0/2741016644 >> 172.21.15.63:0/2741016644 conn(0x7f0ff8069b70 msgr2=0x7f0ff80b8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:26.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.428+0000 7f0fff0a0700 1 -- 172.21.15.63:0/2741016644 shutdown_connections 2020-05-18T21:33:26.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.428+0000 7f0fff0a0700 1 -- 172.21.15.63:0/2741016644 wait complete. 2020-05-18T21:33:26.435 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.2 2020-05-18T21:33:26.446 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:33:26.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.552+0000 7f3b3a617700 1 Processor -- start 2020-05-18T21:33:26.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.552+0000 7f3b3a617700 1 -- start start 2020-05-18T21:33:26.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.552+0000 7f3b3a617700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b340b6410 0x7f3b340b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:26.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.552+0000 7f3b3a617700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b34151bc0 0x7f3b34152030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:26.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.552+0000 7f3b3a617700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b34025500 con 0x7f3b340b5cb0 2020-05-18T21:33:26.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.552+0000 7f3b3a617700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b34064ee0 con 0x7f3b340b6410 2020-05-18T21:33:26.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.552+0000 7f3b3a617700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340b67f0 con 0x7f3b34151bc0 2020-05-18T21:33:26.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.552+0000 7f3b39e16700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b340b6410 0x7f3b340b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:26.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.552+0000 7f3b39e16700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b340b6410 0x7f3b340b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60396/0 (socket says 172.21.15.63:60396) 2020-05-18T21:33:26.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.552+0000 7f3b39e16700 1 -- 172.21.15.63:0/2185233648 learned_addr learned my addr 172.21.15.63:0/2185233648 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:26.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.552+0000 7f3b3b879700 1 --2- 172.21.15.63:0/2185233648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b34151bc0 0x7f3b34152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:26.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.552+0000 7f3b39e16700 1 -- 172.21.15.63:0/2185233648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b34151bc0 msgr2=0x7f3b34152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:26.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.552+0000 7f3b39e16700 1 --2- 172.21.15.63:0/2185233648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b34151bc0 0x7f3b34152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:26.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.552+0000 7f3b39e16700 1 -- 172.21.15.63:0/2185233648 >> v1:172.21.15.155:6789/0 conn(0x7f3b340b5cb0 legacy=0x7f3b34061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:26.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.552+0000 7f3b39e16700 1 -- 172.21.15.63:0/2185233648 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b34025180 con 0x7f3b340b6410 2020-05-18T21:33:26.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.552+0000 7f3b39e16700 1 --2- 172.21.15.63:0/2185233648 >> v2:172.21.15.63:3300/0 conn(0x7f3b340b6410 0x7f3b340b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3b240032f0 tx=0x7f3b24007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.552+0000 7f3b39e16700 1 --2- 172.21.15.63:0/2185233648 >> v2:172.21.15.63:3300/0 conn(0x7f3b340b6410 0x7f3b340b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3b240032f0 tx=0x7f3b24007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.552+0000 7f3b39e16700 1 --2- 172.21.15.63:0/2185233648 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b340b6410 0x7f3b340b6cd0 secure :-1 s=READY pgs=1404 cs=0 l=1 rx=0x7f3b240032f0 tx=0x7f3b24007e00).ready entity=mon.0 client_cookie=3a9b8c9d09ebbbcc server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:26.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b39e16700 1 --2- 172.21.15.63:0/2185233648 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b340b6410 0x7f3b340b6cd0 secure :-1 s=THROTTLE_DONE pgs=1404 cs=0 l=1 rx=0x7f3b240032f0 tx=0x7f3b24007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b38e14700 1 -- 172.21.15.63:0/2185233648 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b24011dc0 con 0x7f3b340b6410 2020-05-18T21:33:26.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b39e16700 1 --2- 172.21.15.63:0/2185233648 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b340b6410 0x7f3b340b6cd0 secure :-1 s=THROTTLE_DONE pgs=1404 cs=0 l=1 rx=0x7f3b240032f0 tx=0x7f3b24007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b38e14700 1 -- 172.21.15.63:0/2185233648 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2400a180 con 0x7f3b340b6410 2020-05-18T21:33:26.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b39e16700 1 --2- 172.21.15.63:0/2185233648 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b340b6410 0x7f3b340b6cd0 secure :-1 s=THROTTLE_DONE pgs=1404 cs=0 l=1 rx=0x7f3b240032f0 tx=0x7f3b24007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b3a617700 1 -- 172.21.15.63:0/2185233648 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b340b6410 msgr2=0x7f3b340b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:26.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b3a617700 1 --2- 172.21.15.63:0/2185233648 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b340b6410 0x7f3b340b6cd0 secure :-1 s=READY pgs=1404 cs=0 l=1 rx=0x7f3b240032f0 tx=0x7f3b24007e00).stop 2020-05-18T21:33:26.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b38e14700 1 -- 172.21.15.63:0/2185233648 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b2400a5a0 con 0x7f3b340b6410 2020-05-18T21:33:26.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b3a617700 1 -- 172.21.15.63:0/2185233648 shutdown_connections 2020-05-18T21:33:26.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b3a617700 1 --2- 172.21.15.63:0/2185233648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b34151bc0 0x7f3b34152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:26.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b3a617700 1 --2- 172.21.15.63:0/2185233648 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b340b6410 0x7f3b340b6cd0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:26.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b3a617700 1 -- 172.21.15.63:0/2185233648 >> 172.21.15.63:0/2185233648 conn(0x7f3b34069b70 msgr2=0x7f3b34069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:26.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b3a617700 1 -- 172.21.15.63:0/2185233648 shutdown_connections 2020-05-18T21:33:26.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b3a617700 1 -- 172.21.15.63:0/2185233648 wait complete. 2020-05-18T21:33:26.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b3a617700 1 Processor -- start 2020-05-18T21:33:26.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b3a617700 1 -- start start 2020-05-18T21:33:26.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b3a617700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b340b6410 0x7f3b3415a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:26.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b3a617700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3b34151bc0 0x7f3b3407faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:26.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b3a617700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b340b83f0 con 0x7f3b340b5cb0 2020-05-18T21:33:26.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b3a617700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3407ffe0 con 0x7f3b340b6410 2020-05-18T21:33:26.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b3a617700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b340b8690 con 0x7f3b34151bc0 2020-05-18T21:33:26.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b39615700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b340b6410 0x7f3b3415a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:26.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b39615700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b340b6410 0x7f3b3415a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60404/0 (socket says 172.21.15.63:60404) 2020-05-18T21:33:26.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b39615700 1 -- 172.21.15.63:0/337707229 learned_addr learned my addr 172.21.15.63:0/337707229 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:26.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.556+0000 7f3b3b879700 1 --2- 172.21.15.63:0/337707229 >> v2:172.21.15.155:3300/0 conn(0x7f3b34151bc0 0x7f3b3407faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:26.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b39615700 1 -- 172.21.15.63:0/337707229 >> v2:172.21.15.155:3300/0 conn(0x7f3b34151bc0 msgr2=0x7f3b3407faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:26.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b39615700 1 --2- 172.21.15.63:0/337707229 >> v2:172.21.15.155:3300/0 conn(0x7f3b34151bc0 0x7f3b3407faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:26.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b39615700 1 -- 172.21.15.63:0/337707229 >> v1:172.21.15.155:6789/0 conn(0x7f3b340b5cb0 legacy=0x7f3b340b7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:26.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b39615700 1 -- 172.21.15.63:0/337707229 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b340b8930 con 0x7f3b340b6410 2020-05-18T21:33:26.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b3b879700 1 --2- 172.21.15.63:0/337707229 >> v2:172.21.15.155:3300/0 conn(0x7f3b34151bc0 0x7f3b3407faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:26.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b39615700 1 --2- 172.21.15.63:0/337707229 >> v2:172.21.15.63:3300/0 conn(0x7f3b340b6410 0x7f3b3415a450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b34061560 tx=0x7f3b2800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b39615700 1 --2- 172.21.15.63:0/337707229 >> v2:172.21.15.63:3300/0 conn(0x7f3b340b6410 0x7f3b3415a450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b34061560 tx=0x7f3b2800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b39615700 1 --2- 172.21.15.63:0/337707229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b340b6410 0x7f3b3415a450 secure :-1 s=READY pgs=1405 cs=0 l=1 rx=0x7f3b34061560 tx=0x7f3b2800c4a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:26.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b39615700 1 --2- 172.21.15.63:0/337707229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b340b6410 0x7f3b3415a450 secure :-1 s=THROTTLE_DONE pgs=1405 cs=0 l=1 rx=0x7f3b34061560 tx=0x7f3b2800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b39615700 1 --2- 172.21.15.63:0/337707229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b340b6410 0x7f3b3415a450 secure :-1 s=THROTTLE_DONE pgs=1405 cs=0 l=1 rx=0x7f3b34061560 tx=0x7f3b2800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b327fc700 1 -- 172.21.15.63:0/337707229 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b2800cc60 con 0x7f3b340b6410 2020-05-18T21:33:26.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b39615700 1 --2- 172.21.15.63:0/337707229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b340b6410 0x7f3b3415a450 secure :-1 s=THROTTLE_DONE pgs=1405 cs=0 l=1 rx=0x7f3b34061560 tx=0x7f3b2800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b327fc700 1 -- 172.21.15.63:0/337707229 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2800cdc0 con 0x7f3b340b6410 2020-05-18T21:33:26.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b3a617700 1 -- 172.21.15.63:0/337707229 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b341583d0 con 0x7f3b340b6410 2020-05-18T21:33:26.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b327fc700 1 -- 172.21.15.63:0/337707229 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b28012220 con 0x7f3b340b6410 2020-05-18T21:33:26.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b3a617700 1 -- 172.21.15.63:0/337707229 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b34158900 con 0x7f3b340b6410 2020-05-18T21:33:26.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b3a617700 1 -- 172.21.15.63:0/337707229 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b340569e0 con 0x7f3b340b6410 2020-05-18T21:33:26.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b39615700 1 --2- 172.21.15.63:0/337707229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b340b6410 0x7f3b3415a450 secure :-1 s=THROTTLE_DONE pgs=1405 cs=0 l=1 rx=0x7f3b34061560 tx=0x7f3b2800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b327fc700 1 -- 172.21.15.63:0/337707229 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3b28006520 con 0x7f3b340b6410 2020-05-18T21:33:26.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.560+0000 7f3b39615700 1 --2- 172.21.15.63:0/337707229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b340b6410 0x7f3b3415a450 secure :-1 s=THROTTLE_DONE pgs=1405 cs=0 l=1 rx=0x7f3b34061560 tx=0x7f3b2800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.564+0000 7f3b327fc700 1 --2- 172.21.15.63:0/337707229 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b1404fad0 0x7f3b14051f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:26.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.564+0000 7f3b327fc700 1 -- 172.21.15.63:0/337707229 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3b280638d0 con 0x7f3b340b6410 2020-05-18T21:33:26.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.564+0000 7f3b39e16700 1 --2- 172.21.15.63:0/337707229 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b1404fad0 0x7f3b14051f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:26.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.564+0000 7f3b39e16700 1 --2- 172.21.15.63:0/337707229 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b1404fad0 0x7f3b14051f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b34151b50 tx=0x7f3b24007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.564+0000 7f3b39e16700 1 --2- 172.21.15.63:0/337707229 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b1404fad0 0x7f3b14051f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b34151b50 tx=0x7f3b24007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.564+0000 7f3b39e16700 1 --2- 172.21.15.63:0/337707229 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b1404fad0 0x7f3b14051f90 secure :-1 s=READY pgs=552 cs=0 l=1 rx=0x7f3b34151b50 tx=0x7f3b24007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:26.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.568+0000 7f3b39615700 1 --2- 172.21.15.63:0/337707229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b340b6410 0x7f3b3415a450 secure :-1 s=THROTTLE_DONE pgs=1405 cs=0 l=1 rx=0x7f3b34061560 tx=0x7f3b2800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.568+0000 7f3b327fc700 1 -- 172.21.15.63:0/337707229 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3b2803dc60 con 0x7f3b340b6410 2020-05-18T21:33:26.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.720+0000 7f3b3a617700 1 -- 172.21.15.63:0/337707229 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f3b340008d0 con 0x7f3b340b6410 2020-05-18T21:33:26.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.728+0000 7f3b39615700 1 --2- 172.21.15.63:0/337707229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b340b6410 0x7f3b3415a450 secure :-1 s=THROTTLE_DONE pgs=1405 cs=0 l=1 rx=0x7f3b34061560 tx=0x7f3b2800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.728+0000 7f3b327fc700 1 -- 172.21.15.63:0/337707229 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v42) v1 ==== 184+0+0 (secure 0 0 0) 0x7f3b28041280 con 0x7f3b340b6410 2020-05-18T21:33:26.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.728+0000 7f3b3a617700 1 -- 172.21.15.63:0/337707229 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b1404fad0 msgr2=0x7f3b14051f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:26.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.728+0000 7f3b3a617700 1 --2- 172.21.15.63:0/337707229 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b1404fad0 0x7f3b14051f90 secure :-1 s=READY pgs=552 cs=0 l=1 rx=0x7f3b34151b50 tx=0x7f3b24007e00).stop 2020-05-18T21:33:26.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.728+0000 7f3b3a617700 1 -- 172.21.15.63:0/337707229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b340b6410 msgr2=0x7f3b3415a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:26.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.728+0000 7f3b3a617700 1 --2- 172.21.15.63:0/337707229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b340b6410 0x7f3b3415a450 secure :-1 s=READY pgs=1405 cs=0 l=1 rx=0x7f3b34061560 tx=0x7f3b2800c4a0).stop 2020-05-18T21:33:26.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.728+0000 7f3b3a617700 1 -- 172.21.15.63:0/337707229 shutdown_connections 2020-05-18T21:33:26.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.728+0000 7f3b3a617700 1 --2- 172.21.15.63:0/337707229 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b1404fad0 0x7f3b14051f90 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:26.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.728+0000 7f3b3a617700 1 --2- 172.21.15.63:0/337707229 >> v2:172.21.15.155:3300/0 conn(0x7f3b34151bc0 0x7f3b3407faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:26.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.728+0000 7f3b3a617700 1 --2- 172.21.15.63:0/337707229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b340b6410 0x7f3b3415a450 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:26.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.728+0000 7f3b3a617700 1 -- 172.21.15.63:0/337707229 >> 172.21.15.63:0/337707229 conn(0x7f3b34069b70 msgr2=0x7f3b34156560 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:26.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.728+0000 7f3b3a617700 1 -- 172.21.15.63:0/337707229 shutdown_connections 2020-05-18T21:33:26.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.728+0000 7f3b3a617700 1 -- 172.21.15.63:0/337707229 wait complete. 2020-05-18T21:33:26.738 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.3 2020-05-18T21:33:26.748 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:26.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.848+0000 7f930f2a6700 1 Processor -- start 2020-05-18T21:33:26.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.848+0000 7f930f2a6700 1 -- start start 2020-05-18T21:33:26.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.848+0000 7f930f2a6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f930809e7f0 0x7f930806a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:26.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.848+0000 7f930f2a6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f93080b5040 0x7f9308141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:26.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.848+0000 7f930f2a6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9308142350 con 0x7f9308141f20 2020-05-18T21:33:26.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.848+0000 7f930f2a6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93080b5750 con 0x7f930809e7f0 2020-05-18T21:33:26.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.848+0000 7f930f2a6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93080b59f0 con 0x7f93080b5040 2020-05-18T21:33:26.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930d042700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f930809e7f0 0x7f930806a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:26.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930d843700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9308141f20 0x7f93080610e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34370/0 (socket says 172.21.15.63:34370) 2020-05-18T21:33:26.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930d843700 1 -- 172.21.15.63:0/946024199 learned_addr learned my addr 172.21.15.63:0/946024199 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:26.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930c841700 1 --2- 172.21.15.63:0/946024199 >> v2:172.21.15.155:3300/0 conn(0x7f93080b5040 0x7f9308141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:26.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930d042700 1 -- 172.21.15.63:0/946024199 >> v2:172.21.15.155:3300/0 conn(0x7f93080b5040 msgr2=0x7f9308141ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:26.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930d042700 1 --2- 172.21.15.63:0/946024199 >> v2:172.21.15.155:3300/0 conn(0x7f93080b5040 0x7f9308141ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:26.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930d042700 1 -- 172.21.15.63:0/946024199 >> v1:172.21.15.63:6789/0 conn(0x7f9308141f20 legacy=0x7f93080610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:26.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f92f7fff700 1 -- 172.21.15.63:0/946024199 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149499776 0 0) 0x7f9308142350 con 0x7f9308141f20 2020-05-18T21:33:26.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930d042700 1 -- 172.21.15.63:0/946024199 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93080b5c90 con 0x7f930809e7f0 2020-05-18T21:33:26.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930d042700 1 --2- 172.21.15.63:0/946024199 >> v2:172.21.15.63:3300/0 conn(0x7f930809e7f0 0x7f930806a640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9304002f70 tx=0x7f9304007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930d042700 1 --2- 172.21.15.63:0/946024199 >> v2:172.21.15.63:3300/0 conn(0x7f930809e7f0 0x7f930806a640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9304002f70 tx=0x7f9304007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930d042700 1 --2- 172.21.15.63:0/946024199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f930809e7f0 0x7f930806a640 secure :-1 s=READY pgs=1407 cs=0 l=1 rx=0x7f9304002f70 tx=0x7f9304007a80).ready entity=mon.0 client_cookie=b44a61dcad96e55c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:26.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930d042700 1 --2- 172.21.15.63:0/946024199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f930809e7f0 0x7f930806a640 secure :-1 s=THROTTLE_DONE pgs=1407 cs=0 l=1 rx=0x7f9304002f70 tx=0x7f9304007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f92f7fff700 1 -- 172.21.15.63:0/946024199 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9304008e50 con 0x7f930809e7f0 2020-05-18T21:33:26.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930d042700 1 --2- 172.21.15.63:0/946024199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f930809e7f0 0x7f930806a640 secure :-1 s=THROTTLE_DONE pgs=1407 cs=0 l=1 rx=0x7f9304002f70 tx=0x7f9304007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f92f7fff700 1 -- 172.21.15.63:0/946024199 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93040115f0 con 0x7f930809e7f0 2020-05-18T21:33:26.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930d042700 1 --2- 172.21.15.63:0/946024199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f930809e7f0 0x7f930806a640 secure :-1 s=THROTTLE_DONE pgs=1407 cs=0 l=1 rx=0x7f9304002f70 tx=0x7f9304007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f92f7fff700 1 -- 172.21.15.63:0/946024199 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93040119d0 con 0x7f930809e7f0 2020-05-18T21:33:26.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930f2a6700 1 -- 172.21.15.63:0/946024199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f930809e7f0 msgr2=0x7f930806a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:26.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930f2a6700 1 --2- 172.21.15.63:0/946024199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f930809e7f0 0x7f930806a640 secure :-1 s=READY pgs=1407 cs=0 l=1 rx=0x7f9304002f70 tx=0x7f9304007a80).stop 2020-05-18T21:33:26.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930f2a6700 1 -- 172.21.15.63:0/946024199 shutdown_connections 2020-05-18T21:33:26.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930f2a6700 1 --2- 172.21.15.63:0/946024199 >> v2:172.21.15.155:3300/0 conn(0x7f93080b5040 0x7f9308141ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:26.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930f2a6700 1 --2- 172.21.15.63:0/946024199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f930809e7f0 0x7f930806a640 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:26.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930f2a6700 1 -- 172.21.15.63:0/946024199 >> 172.21.15.63:0/946024199 conn(0x7f930805b240 msgr2=0x7f9308069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:26.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930f2a6700 1 -- 172.21.15.63:0/946024199 shutdown_connections 2020-05-18T21:33:26.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.852+0000 7f930f2a6700 1 -- 172.21.15.63:0/946024199 wait complete. 2020-05-18T21:33:26.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.856+0000 7f930f2a6700 1 Processor -- start 2020-05-18T21:33:26.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.856+0000 7f930f2a6700 1 -- start start 2020-05-18T21:33:26.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.856+0000 7f930f2a6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9308141f20 0x7f93080b9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:26.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.856+0000 7f930f2a6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93080b99e0 con 0x7f930809e7f0 2020-05-18T21:33:26.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f930d042700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f930809e7f0 0x7f93080631d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34372/0 (socket says 172.21.15.63:34372) 2020-05-18T21:33:26.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f930f2a6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9308063a70 con 0x7f93080b5040 2020-05-18T21:33:26.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f930d843700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9308141f20 0x7f93080b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:26.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f930d042700 1 -- 172.21.15.63:0/2063207262 learned_addr learned my addr 172.21.15.63:0/2063207262 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:26.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f930f2a6700 1 -- 172.21.15.63:0/2063207262 --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9308141a50 con 0x7f9308141f20 2020-05-18T21:33:26.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f92f67fc700 1 -- 172.21.15.63:0/2063207262 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744464603 0 0) 0x7f93080b99e0 con 0x7f930809e7f0 2020-05-18T21:33:26.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f92f67fc700 1 -- 172.21.15.63:0/2063207262 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92e8002fe0 con 0x7f930809e7f0 2020-05-18T21:33:26.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f92f67fc700 1 -- 172.21.15.63:0/2063207262 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300080937 0 0) 0x7f9308063a70 con 0x7f93080b5040 2020-05-18T21:33:26.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f92f67fc700 1 -- 172.21.15.63:0/2063207262 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93080b99e0 con 0x7f93080b5040 2020-05-18T21:33:26.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f930d843700 1 -- 172.21.15.63:0/2063207262 >> v1:172.21.15.155:6789/0 conn(0x7f93080b5040 legacy=0x7f9308061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:26.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f930d843700 1 -- 172.21.15.63:0/2063207262 >> v1:172.21.15.63:6789/0 conn(0x7f930809e7f0 legacy=0x7f93080631d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:26.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f930d843700 1 -- 172.21.15.63:0/2063207262 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9308154860 con 0x7f9308141f20 2020-05-18T21:33:26.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f930d843700 1 --2- 172.21.15.63:0/2063207262 >> v2:172.21.15.63:3300/0 conn(0x7f9308141f20 0x7f93080b9580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f930809db70 tx=0x7f9300010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f930d843700 1 --2- 172.21.15.63:0/2063207262 >> v2:172.21.15.63:3300/0 conn(0x7f9308141f20 0x7f93080b9580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f930809db70 tx=0x7f9300010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f930d843700 1 --2- 172.21.15.63:0/2063207262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9308141f20 0x7f93080b9580 secure :-1 s=READY pgs=1409 cs=0 l=1 rx=0x7f930809db70 tx=0x7f9300010c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:26.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f930d843700 1 --2- 172.21.15.63:0/2063207262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9308141f20 0x7f93080b9580 secure :-1 s=THROTTLE_DONE pgs=1409 cs=0 l=1 rx=0x7f930809db70 tx=0x7f9300010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f930d843700 1 --2- 172.21.15.63:0/2063207262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9308141f20 0x7f93080b9580 secure :-1 s=THROTTLE_DONE pgs=1409 cs=0 l=1 rx=0x7f930809db70 tx=0x7f9300010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f92f67fc700 1 -- 172.21.15.63:0/2063207262 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9300005e70 con 0x7f9308141f20 2020-05-18T21:33:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f930d843700 1 --2- 172.21.15.63:0/2063207262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9308141f20 0x7f93080b9580 secure :-1 s=THROTTLE_DONE pgs=1409 cs=0 l=1 rx=0x7f930809db70 tx=0x7f9300010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f92f67fc700 1 -- 172.21.15.63:0/2063207262 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9300012420 con 0x7f9308141f20 2020-05-18T21:33:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f930f2a6700 1 -- 172.21.15.63:0/2063207262 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9308061b80 con 0x7f9308141f20 2020-05-18T21:33:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f92f67fc700 1 -- 172.21.15.63:0/2063207262 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9300012840 con 0x7f9308141f20 2020-05-18T21:33:26.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f930f2a6700 1 -- 172.21.15.63:0/2063207262 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9308154d00 con 0x7f9308141f20 2020-05-18T21:33:26.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f930d843700 1 --2- 172.21.15.63:0/2063207262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9308141f20 0x7f93080b9580 secure :-1 s=THROTTLE_DONE pgs=1409 cs=0 l=1 rx=0x7f930809db70 tx=0x7f9300010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f930f2a6700 1 -- 172.21.15.63:0/2063207262 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9308063c70 con 0x7f9308141f20 2020-05-18T21:33:26.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f92f67fc700 1 -- 172.21.15.63:0/2063207262 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9300012ab0 con 0x7f9308141f20 2020-05-18T21:33:26.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f930d843700 1 --2- 172.21.15.63:0/2063207262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9308141f20 0x7f93080b9580 secure :-1 s=THROTTLE_DONE pgs=1409 cs=0 l=1 rx=0x7f930809db70 tx=0x7f9300010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.860+0000 7f92f67fc700 1 --2- 172.21.15.63:0/2063207262 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f92e804fed0 0x7f92e8052390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:26.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.864+0000 7f92f67fc700 1 -- 172.21.15.63:0/2063207262 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f93000090c0 con 0x7f9308141f20 2020-05-18T21:33:26.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.864+0000 7f930d042700 1 --2- 172.21.15.63:0/2063207262 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f92e804fed0 0x7f92e8052390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:26.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.864+0000 7f930d042700 1 --2- 172.21.15.63:0/2063207262 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f92e804fed0 0x7f92e8052390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9304008920 tx=0x7f9304007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.864+0000 7f930d042700 1 --2- 172.21.15.63:0/2063207262 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f92e804fed0 0x7f92e8052390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9304008920 tx=0x7f9304007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.864+0000 7f930d042700 1 --2- 172.21.15.63:0/2063207262 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f92e804fed0 0x7f92e8052390 secure :-1 s=READY pgs=553 cs=0 l=1 rx=0x7f9304008920 tx=0x7f9304007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:26.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.868+0000 7f930d843700 1 --2- 172.21.15.63:0/2063207262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9308141f20 0x7f93080b9580 secure :-1 s=THROTTLE_DONE pgs=1409 cs=0 l=1 rx=0x7f930809db70 tx=0x7f9300010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:26.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:26.868+0000 7f92f67fc700 1 -- 172.21.15.63:0/2063207262 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f930003e4d0 con 0x7f9308141f20 2020-05-18T21:33:27.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.020+0000 7f930f2a6700 1 -- 172.21.15.63:0/2063207262 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9308061d10 con 0x7f9308141f20 2020-05-18T21:33:27.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.020+0000 7f930d843700 1 --2- 172.21.15.63:0/2063207262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9308141f20 0x7f93080b9580 secure :-1 s=THROTTLE_DONE pgs=1409 cs=0 l=1 rx=0x7f930809db70 tx=0x7f9300010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.020+0000 7f92f67fc700 1 -- 172.21.15.63:0/2063207262 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f9300041af0 con 0x7f9308141f20 2020-05-18T21:33:27.026 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:27.026 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":81,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6113,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2300000397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2300000397},{"type":"v1","addr":"172.21.15.63:6833","nonce":2300000397}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":78}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:23.230529+0000","modified":"2020-05-18T21:33:24.934162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8059":{"gid":8059,"name":"b","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1291107650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1291107650},{"type":"v1","addr":"172.21.15.155:6835","nonce":1291107650}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-05-18T21:33:27.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.020+0000 7f930f2a6700 1 -- 172.21.15.63:0/2063207262 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f92e804fed0 msgr2=0x7f92e8052390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:27.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.020+0000 7f930f2a6700 1 --2- 172.21.15.63:0/2063207262 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f92e804fed0 0x7f92e8052390 secure :-1 s=READY pgs=553 cs=0 l=1 rx=0x7f9304008920 tx=0x7f9304007a80).stop 2020-05-18T21:33:27.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.020+0000 7f930f2a6700 1 -- 172.21.15.63:0/2063207262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9308141f20 msgr2=0x7f93080b9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:27.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.020+0000 7f930f2a6700 1 --2- 172.21.15.63:0/2063207262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9308141f20 0x7f93080b9580 secure :-1 s=READY pgs=1409 cs=0 l=1 rx=0x7f930809db70 tx=0x7f9300010c50).stop 2020-05-18T21:33:27.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.020+0000 7f930f2a6700 1 -- 172.21.15.63:0/2063207262 shutdown_connections 2020-05-18T21:33:27.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.020+0000 7f930f2a6700 1 --2- 172.21.15.63:0/2063207262 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f92e804fed0 0x7f92e8052390 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:27.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.020+0000 7f930f2a6700 1 --2- 172.21.15.63:0/2063207262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9308141f20 0x7f93080b9580 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:27.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.020+0000 7f930f2a6700 1 -- 172.21.15.63:0/2063207262 >> 172.21.15.63:0/2063207262 conn(0x7f930805b240 msgr2=0x7f93080b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:27.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.020+0000 7f930f2a6700 1 -- 172.21.15.63:0/2063207262 shutdown_connections 2020-05-18T21:33:27.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.020+0000 7f930f2a6700 1 -- 172.21.15.63:0/2063207262 wait complete. 2020-05-18T21:33:27.031 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 81 2020-05-18T21:33:27.240 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 81, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:33:23.230529+0000', 'modified': '2020-05-18T21:33:24.934162+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8059}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8059': {'gid': 8059, 'name': 'b', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6835/1291107650', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 1291107650}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 1291107650}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:33:27.241 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:33:27.242 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:33:27.348 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:33:27.349 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:33:27.349 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2020-05-18T21:33:27.349 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 8059, 2020-05-18T21:33:27.349 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:33:27.350 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:33:27.350 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 4.1121760649999999, 2020-05-18T21:33:27.350 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 81, 2020-05-18T21:33:27.350 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 104, 2020-05-18T21:33:27.350 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 104, 2020-05-18T21:33:27.351 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 8.3456985970000002 2020-05-18T21:33:27.351 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:33:27.357 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 8059, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.1121760649999999, "mdsmap_epoch": 81, "osdmap_epoch": 104, "osdmap_epoch_barrier": 104, "uptime": 8.3456985970000002 } 2020-05-18T21:33:27.358 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:33:27.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.464+0000 7fe2f3fff700 1 Processor -- start 2020-05-18T21:33:27.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.464+0000 7fe2f3fff700 1 -- start start 2020-05-18T21:33:27.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe2f4060310 0x7fe2f41492f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:27.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe2f41468f0 0x7fe2f40628e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:27.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f3fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f4145cc0 con 0x7fe2f4149db0 2020-05-18T21:33:27.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f3fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f414a190 con 0x7fe2f4060310 2020-05-18T21:33:27.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f3fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f4060fd0 con 0x7fe2f41468f0 2020-05-18T21:33:27.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f2ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe2f4149db0 0x7fe2f40b6e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34380/0 (socket says 172.21.15.63:34380) 2020-05-18T21:33:27.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f2ffd700 1 -- 172.21.15.63:0/2730776279 learned_addr learned my addr 172.21.15.63:0/2730776279 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:27.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2ebfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe2f4060310 0x7fe2f41492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:27.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f37fe700 1 --2- 172.21.15.63:0/2730776279 >> v2:172.21.15.155:3300/0 conn(0x7fe2f41468f0 0x7fe2f40628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:27.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f27fc700 1 -- 172.21.15.63:0/2730776279 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188442055 0 0) 0x7fe2f4145cc0 con 0x7fe2f4149db0 2020-05-18T21:33:27.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f27fc700 1 -- 172.21.15.63:0/2730776279 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d4003270 con 0x7fe2f4149db0 2020-05-18T21:33:27.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2ebfff700 1 -- 172.21.15.63:0/2730776279 >> v2:172.21.15.155:3300/0 conn(0x7fe2f41468f0 msgr2=0x7fe2f40628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:27.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2ebfff700 1 --2- 172.21.15.63:0/2730776279 >> v2:172.21.15.155:3300/0 conn(0x7fe2f41468f0 0x7fe2f40628e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:27.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2ebfff700 1 -- 172.21.15.63:0/2730776279 >> v1:172.21.15.63:6789/0 conn(0x7fe2f4149db0 legacy=0x7fe2f40b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:27.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2ebfff700 1 -- 172.21.15.63:0/2730776279 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f4145f10 con 0x7fe2f4060310 2020-05-18T21:33:27.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2ebfff700 1 --2- 172.21.15.63:0/2730776279 >> v2:172.21.15.63:3300/0 conn(0x7fe2f4060310 0x7fe2f41492f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe2dc002f70 tx=0x7fe2dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2ebfff700 1 --2- 172.21.15.63:0/2730776279 >> v2:172.21.15.63:3300/0 conn(0x7fe2f4060310 0x7fe2f41492f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe2dc002f70 tx=0x7fe2dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2ebfff700 1 --2- 172.21.15.63:0/2730776279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f4060310 0x7fe2f41492f0 secure :-1 s=READY pgs=1411 cs=0 l=1 rx=0x7fe2dc002f70 tx=0x7fe2dc007a80).ready entity=mon.0 client_cookie=bbf4bb4810970a72 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:27.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2ebfff700 1 --2- 172.21.15.63:0/2730776279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f4060310 0x7fe2f41492f0 secure :-1 s=THROTTLE_DONE pgs=1411 cs=0 l=1 rx=0x7fe2dc002f70 tx=0x7fe2dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f27fc700 1 -- 172.21.15.63:0/2730776279 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2dc008e50 con 0x7fe2f4060310 2020-05-18T21:33:27.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2ebfff700 1 --2- 172.21.15.63:0/2730776279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f4060310 0x7fe2f41492f0 secure :-1 s=THROTTLE_DONE pgs=1411 cs=0 l=1 rx=0x7fe2dc002f70 tx=0x7fe2dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f27fc700 1 -- 172.21.15.63:0/2730776279 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc011540 con 0x7fe2f4060310 2020-05-18T21:33:27.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2ebfff700 1 --2- 172.21.15.63:0/2730776279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f4060310 0x7fe2f41492f0 secure :-1 s=THROTTLE_DONE pgs=1411 cs=0 l=1 rx=0x7fe2dc002f70 tx=0x7fe2dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f3fff700 1 -- 172.21.15.63:0/2730776279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f4060310 msgr2=0x7fe2f41492f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:27.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f27fc700 1 -- 172.21.15.63:0/2730776279 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2dc011960 con 0x7fe2f4060310 2020-05-18T21:33:27.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f3fff700 1 --2- 172.21.15.63:0/2730776279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f4060310 0x7fe2f41492f0 secure :-1 s=READY pgs=1411 cs=0 l=1 rx=0x7fe2dc002f70 tx=0x7fe2dc007a80).stop 2020-05-18T21:33:27.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f3fff700 1 -- 172.21.15.63:0/2730776279 shutdown_connections 2020-05-18T21:33:27.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f3fff700 1 --2- 172.21.15.63:0/2730776279 >> v2:172.21.15.155:3300/0 conn(0x7fe2f41468f0 0x7fe2f40628e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:27.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f3fff700 1 --2- 172.21.15.63:0/2730776279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f4060310 0x7fe2f41492f0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:27.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f3fff700 1 -- 172.21.15.63:0/2730776279 >> 172.21.15.63:0/2730776279 conn(0x7fe2f405eee0 msgr2=0x7fe2f405f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:27.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f3fff700 1 -- 172.21.15.63:0/2730776279 shutdown_connections 2020-05-18T21:33:27.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.468+0000 7fe2f3fff700 1 -- 172.21.15.63:0/2730776279 wait complete. 2020-05-18T21:33:27.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2f3fff700 1 Processor -- start 2020-05-18T21:33:27.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2f3fff700 1 -- start start 2020-05-18T21:33:27.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2f3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe2f41468f0 0x7fe2f41454d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:27.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2f3fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f40b31c0 con 0x7fe2f4149db0 2020-05-18T21:33:27.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2f3fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f40b3460 con 0x7fe2f4060310 2020-05-18T21:33:27.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2f3fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f40b2eb0 con 0x7fe2f41468f0 2020-05-18T21:33:27.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2f37fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe2f4149db0 0x7fe2f413d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34390/0 (socket says 172.21.15.63:34390) 2020-05-18T21:33:27.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2f37fe700 1 -- 172.21.15.63:0/1867307862 learned_addr learned my addr 172.21.15.63:0/1867307862 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:27.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2ebfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe2f41468f0 0x7fe2f41454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:27.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2f0ff9700 1 -- 172.21.15.63:0/1867307862 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868781336 0 0) 0x7fe2f40b31c0 con 0x7fe2f4149db0 2020-05-18T21:33:27.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2f0ff9700 1 -- 172.21.15.63:0/1867307862 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d8002fe0 con 0x7fe2f4149db0 2020-05-18T21:33:27.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2ebfff700 1 -- 172.21.15.63:0/1867307862 >> v1:172.21.15.155:6789/0 conn(0x7fe2f4060310 legacy=0x7fe2f40b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:27.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2ebfff700 1 -- 172.21.15.63:0/1867307862 >> v1:172.21.15.63:6789/0 conn(0x7fe2f4149db0 legacy=0x7fe2f413d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:27.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2ebfff700 1 -- 172.21.15.63:0/1867307862 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f40b0950 con 0x7fe2f41468f0 2020-05-18T21:33:27.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2ebfff700 1 --2- 172.21.15.63:0/1867307862 >> v2:172.21.15.63:3300/0 conn(0x7fe2f41468f0 0x7fe2f41454d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe2dc002f70 tx=0x7fe2dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2ebfff700 1 --2- 172.21.15.63:0/1867307862 >> v2:172.21.15.63:3300/0 conn(0x7fe2f41468f0 0x7fe2f41454d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe2dc002f70 tx=0x7fe2dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2ebfff700 1 --2- 172.21.15.63:0/1867307862 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f41468f0 0x7fe2f41454d0 secure :-1 s=READY pgs=1413 cs=0 l=1 rx=0x7fe2dc002f70 tx=0x7fe2dc007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:27.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2ebfff700 1 --2- 172.21.15.63:0/1867307862 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f41468f0 0x7fe2f41454d0 secure :-1 s=THROTTLE_DONE pgs=1413 cs=0 l=1 rx=0x7fe2dc002f70 tx=0x7fe2dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2f0ff9700 1 -- 172.21.15.63:0/1867307862 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2dc0119c0 con 0x7fe2f41468f0 2020-05-18T21:33:27.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2ebfff700 1 --2- 172.21.15.63:0/1867307862 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f41468f0 0x7fe2f41454d0 secure :-1 s=THROTTLE_DONE pgs=1413 cs=0 l=1 rx=0x7fe2dc002f70 tx=0x7fe2dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.472+0000 7fe2ebfff700 1 --2- 172.21.15.63:0/1867307862 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f41468f0 0x7fe2f41454d0 secure :-1 s=THROTTLE_DONE pgs=1413 cs=0 l=1 rx=0x7fe2dc002f70 tx=0x7fe2dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.476+0000 7fe2f0ff9700 1 -- 172.21.15.63:0/1867307862 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc007170 con 0x7fe2f41468f0 2020-05-18T21:33:27.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.476+0000 7fe2f0ff9700 1 -- 172.21.15.63:0/1867307862 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2dc007550 con 0x7fe2f41468f0 2020-05-18T21:33:27.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.476+0000 7fe2f3fff700 1 -- 172.21.15.63:0/1867307862 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f413d9b0 con 0x7fe2f41468f0 2020-05-18T21:33:27.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.476+0000 7fe2f3fff700 1 -- 172.21.15.63:0/1867307862 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f40b4440 con 0x7fe2f41468f0 2020-05-18T21:33:27.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.476+0000 7fe2ebfff700 1 --2- 172.21.15.63:0/1867307862 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f41468f0 0x7fe2f41454d0 secure :-1 s=THROTTLE_DONE pgs=1413 cs=0 l=1 rx=0x7fe2dc002f70 tx=0x7fe2dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.476+0000 7fe2f3fff700 1 -- 172.21.15.63:0/1867307862 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f40b2ff0 con 0x7fe2f41468f0 2020-05-18T21:33:27.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.476+0000 7fe2f0ff9700 1 -- 172.21.15.63:0/1867307862 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe2dc005700 con 0x7fe2f41468f0 2020-05-18T21:33:27.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.476+0000 7fe2ebfff700 1 --2- 172.21.15.63:0/1867307862 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f41468f0 0x7fe2f41454d0 secure :-1 s=THROTTLE_DONE pgs=1413 cs=0 l=1 rx=0x7fe2dc002f70 tx=0x7fe2dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.476+0000 7fe2f0ff9700 1 --2- 172.21.15.63:0/1867307862 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe2d804fd30 0x7fe2d80521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:27.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.476+0000 7fe2f0ff9700 1 -- 172.21.15.63:0/1867307862 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe2dc0643f0 con 0x7fe2f41468f0 2020-05-18T21:33:27.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.476+0000 7fe2f2ffd700 1 --2- 172.21.15.63:0/1867307862 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe2d804fd30 0x7fe2d80521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:27.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.476+0000 7fe2f2ffd700 1 --2- 172.21.15.63:0/1867307862 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe2d804fd30 0x7fe2d80521f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe2f40b9ae0 tx=0x7fe2f4066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.480+0000 7fe2f2ffd700 1 --2- 172.21.15.63:0/1867307862 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe2d804fd30 0x7fe2d80521f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe2f40b9ae0 tx=0x7fe2f4066620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.480+0000 7fe2f2ffd700 1 --2- 172.21.15.63:0/1867307862 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe2d804fd30 0x7fe2d80521f0 secure :-1 s=READY pgs=554 cs=0 l=1 rx=0x7fe2f40b9ae0 tx=0x7fe2f4066620).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:27.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.484+0000 7fe2ebfff700 1 --2- 172.21.15.63:0/1867307862 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f41468f0 0x7fe2f41454d0 secure :-1 s=THROTTLE_DONE pgs=1413 cs=0 l=1 rx=0x7fe2dc002f70 tx=0x7fe2dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.484+0000 7fe2f0ff9700 1 -- 172.21.15.63:0/1867307862 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe2dc03e8a0 con 0x7fe2f41468f0 2020-05-18T21:33:27.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.600+0000 7fe2f3fff700 1 -- 172.21.15.63:0/1867307862 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2f40569e0 con 0x7fe2f41468f0 2020-05-18T21:33:27.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.600+0000 7fe2ebfff700 1 --2- 172.21.15.63:0/1867307862 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f41468f0 0x7fe2f41454d0 secure :-1 s=THROTTLE_DONE pgs=1413 cs=0 l=1 rx=0x7fe2dc002f70 tx=0x7fe2dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.600+0000 7fe2f0ff9700 1 -- 172.21.15.63:0/1867307862 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+16103 (secure 0 0 0) 0x7fe2dc041ec0 con 0x7fe2f41468f0 2020-05-18T21:33:27.607 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:27.608 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":104,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:33:24.233716+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:33:21.749613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2020-05-18T21:33:22.242521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:33:27.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.604+0000 7fe2f3fff700 1 -- 172.21.15.63:0/1867307862 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe2d804fd30 msgr2=0x7fe2d80521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:27.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.604+0000 7fe2f3fff700 1 --2- 172.21.15.63:0/1867307862 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe2d804fd30 0x7fe2d80521f0 secure :-1 s=READY pgs=554 cs=0 l=1 rx=0x7fe2f40b9ae0 tx=0x7fe2f4066620).stop 2020-05-18T21:33:27.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.604+0000 7fe2f3fff700 1 -- 172.21.15.63:0/1867307862 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f41468f0 msgr2=0x7fe2f41454d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:27.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.604+0000 7fe2f3fff700 1 --2- 172.21.15.63:0/1867307862 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f41468f0 0x7fe2f41454d0 secure :-1 s=READY pgs=1413 cs=0 l=1 rx=0x7fe2dc002f70 tx=0x7fe2dc007a80).stop 2020-05-18T21:33:27.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.604+0000 7fe2f3fff700 1 -- 172.21.15.63:0/1867307862 shutdown_connections 2020-05-18T21:33:27.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.604+0000 7fe2f3fff700 1 --2- 172.21.15.63:0/1867307862 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe2d804fd30 0x7fe2d80521f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:27.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.604+0000 7fe2f3fff700 1 --2- 172.21.15.63:0/1867307862 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f41468f0 0x7fe2f41454d0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:27.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.604+0000 7fe2f3fff700 1 -- 172.21.15.63:0/1867307862 >> 172.21.15.63:0/1867307862 conn(0x7fe2f405eee0 msgr2=0x7fe2f4069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:27.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.604+0000 7fe2f3fff700 1 -- 172.21.15.63:0/1867307862 shutdown_connections 2020-05-18T21:33:27.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.604+0000 7fe2f3fff700 1 -- 172.21.15.63:0/1867307862 wait complete. 2020-05-18T21:33:27.620 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:33:21.749613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:33:22.242521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:33:27.621 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:33:27.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.720+0000 7f3c96758700 1 Processor -- start 2020-05-18T21:33:27.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.720+0000 7f3c96758700 1 -- start start 2020-05-18T21:33:27.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.720+0000 7f3c96758700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c9014e120 0x7f3c90060860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:27.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.720+0000 7f3c96758700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3c900bc590 0x7f3c900bca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:27.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.720+0000 7f3c96758700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c9014e5a0 con 0x7f3c901441f0 2020-05-18T21:33:27.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.720+0000 7f3c96758700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c9014a240 con 0x7f3c900bc590 2020-05-18T21:33:27.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.720+0000 7f3c96758700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9014a430 con 0x7f3c9014e120 2020-05-18T21:33:27.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.720+0000 7f3c95756700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f3c901441f0 0x7f3c900b6fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:60942/0 (socket says 172.21.15.63:60942) 2020-05-18T21:33:27.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.720+0000 7f3c95756700 1 -- 172.21.15.63:0/2267503381 learned_addr learned my addr 172.21.15.63:0/2267503381 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:27.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.720+0000 7f3c94f55700 1 --2- 172.21.15.63:0/2267503381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c9014e120 0x7f3c90060860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:27.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c95f57700 1 --2- 172.21.15.63:0/2267503381 >> v2:172.21.15.155:3300/0 conn(0x7f3c900bc590 0x7f3c900bca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:27.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c83fff700 1 -- 172.21.15.63:0/2267503381 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921268488 0 0) 0x7f3c9014e5a0 con 0x7f3c901441f0 2020-05-18T21:33:27.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c83fff700 1 -- 172.21.15.63:0/2267503381 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c74003270 con 0x7f3c901441f0 2020-05-18T21:33:27.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c94f55700 1 -- 172.21.15.63:0/2267503381 >> v2:172.21.15.155:3300/0 conn(0x7f3c900bc590 msgr2=0x7f3c900bca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:27.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c94f55700 1 --2- 172.21.15.63:0/2267503381 >> v2:172.21.15.155:3300/0 conn(0x7f3c900bc590 0x7f3c900bca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:27.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c94f55700 1 -- 172.21.15.63:0/2267503381 >> v1:172.21.15.155:6789/0 conn(0x7f3c901441f0 legacy=0x7f3c900b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:27.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c94f55700 1 -- 172.21.15.63:0/2267503381 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c900b76b0 con 0x7f3c9014e120 2020-05-18T21:33:27.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c94f55700 1 --2- 172.21.15.63:0/2267503381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c9014e120 0x7f3c90060860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3c84002f70 tx=0x7f3c90061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c94f55700 1 --2- 172.21.15.63:0/2267503381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c9014e120 0x7f3c90060860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3c84002f70 tx=0x7f3c90061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c94f55700 1 --2- 172.21.15.63:0/2267503381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c9014e120 0x7f3c90060860 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f3c84002f70 tx=0x7f3c90061d60).ready entity=mon.2 client_cookie=ac88ceaf61524b66 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:27.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c94f55700 1 --2- 172.21.15.63:0/2267503381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c9014e120 0x7f3c90060860 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f3c84002f70 tx=0x7f3c90061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c83fff700 1 -- 172.21.15.63:0/2267503381 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c84008e80 con 0x7f3c9014e120 2020-05-18T21:33:27.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c94f55700 1 --2- 172.21.15.63:0/2267503381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c9014e120 0x7f3c90060860 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f3c84002f70 tx=0x7f3c90061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c83fff700 1 -- 172.21.15.63:0/2267503381 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c84011540 con 0x7f3c9014e120 2020-05-18T21:33:27.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c94f55700 1 --2- 172.21.15.63:0/2267503381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c9014e120 0x7f3c90060860 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f3c84002f70 tx=0x7f3c90061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c83fff700 1 -- 172.21.15.63:0/2267503381 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c84011920 con 0x7f3c9014e120 2020-05-18T21:33:27.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c96758700 1 -- 172.21.15.63:0/2267503381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c9014e120 msgr2=0x7f3c90060860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:27.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c96758700 1 --2- 172.21.15.63:0/2267503381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c9014e120 0x7f3c90060860 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f3c84002f70 tx=0x7f3c90061d60).stop 2020-05-18T21:33:27.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c96758700 1 -- 172.21.15.63:0/2267503381 shutdown_connections 2020-05-18T21:33:27.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c96758700 1 --2- 172.21.15.63:0/2267503381 >> v2:172.21.15.155:3300/0 conn(0x7f3c900bc590 0x7f3c900bca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:27.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c96758700 1 --2- 172.21.15.63:0/2267503381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c9014e120 0x7f3c90060860 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:27.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c96758700 1 -- 172.21.15.63:0/2267503381 >> 172.21.15.63:0/2267503381 conn(0x7f3c9005f3b0 msgr2=0x7f3c9005f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c96758700 1 -- 172.21.15.63:0/2267503381 shutdown_connections 2020-05-18T21:33:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.724+0000 7f3c96758700 1 -- 172.21.15.63:0/2267503381 wait complete. 2020-05-18T21:33:27.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.728+0000 7f3c96758700 1 Processor -- start 2020-05-18T21:33:27.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.728+0000 7f3c96758700 1 -- start start 2020-05-18T21:33:27.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.728+0000 7f3c96758700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3c900bc590 0x7f3c9013fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.728+0000 7f3c96758700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c901441f0 0x7f3c9013ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.728+0000 7f3c96758700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c901403a0 con 0x7f3c9014e120 2020-05-18T21:33:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.728+0000 7f3c96758700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c90065450 con 0x7f3c900bc590 2020-05-18T21:33:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.728+0000 7f3c96758700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9014b820 con 0x7f3c901441f0 2020-05-18T21:33:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.728+0000 7f3c95756700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3c900bc590 0x7f3c9013fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:27.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.728+0000 7f3c95f57700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3c9014e120 0x7f3c901408c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34404/0 (socket says 172.21.15.63:34404) 2020-05-18T21:33:27.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.728+0000 7f3c95f57700 1 -- 172.21.15.63:0/430264842 learned_addr learned my addr 172.21.15.63:0/430264842 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:27.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.728+0000 7f3c94f55700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c901441f0 0x7f3c9013ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:27.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.728+0000 7f3c95756700 1 -- 172.21.15.63:0/430264842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c901441f0 msgr2=0x7f3c9013ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:27.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.728+0000 7f3c95756700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c901441f0 0x7f3c9013ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:27.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.728+0000 7f3c95756700 1 -- 172.21.15.63:0/430264842 >> v1:172.21.15.63:6789/0 conn(0x7f3c9014e120 legacy=0x7f3c901408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:27.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.728+0000 7f3c82ffd700 1 -- 172.21.15.63:0/430264842 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454544618 0 0) 0x7f3c901403a0 con 0x7f3c9014e120 2020-05-18T21:33:27.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.732+0000 7f3c95756700 1 -- 172.21.15.63:0/430264842 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9014bac0 con 0x7f3c900bc590 2020-05-18T21:33:27.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.732+0000 7f3c95756700 1 --2- 172.21.15.63:0/430264842 >> v2:172.21.15.63:3300/0 conn(0x7f3c900bc590 0x7f3c9013fae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3c8c001110 tx=0x7f3c8c0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.732+0000 7f3c95756700 1 --2- 172.21.15.63:0/430264842 >> v2:172.21.15.63:3300/0 conn(0x7f3c900bc590 0x7f3c9013fae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3c8c001110 tx=0x7f3c8c0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.732+0000 7f3c95756700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c900bc590 0x7f3c9013fae0 secure :-1 s=READY pgs=1415 cs=0 l=1 rx=0x7f3c8c001110 tx=0x7f3c8c0108f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:27.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.732+0000 7f3c95756700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c900bc590 0x7f3c9013fae0 secure :-1 s=THROTTLE_DONE pgs=1415 cs=0 l=1 rx=0x7f3c8c001110 tx=0x7f3c8c0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.732+0000 7f3c95756700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c900bc590 0x7f3c9013fae0 secure :-1 s=THROTTLE_DONE pgs=1415 cs=0 l=1 rx=0x7f3c8c001110 tx=0x7f3c8c0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.732+0000 7f3c82ffd700 1 -- 172.21.15.63:0/430264842 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c8c005d00 con 0x7f3c900bc590 2020-05-18T21:33:27.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.732+0000 7f3c95756700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c900bc590 0x7f3c9013fae0 secure :-1 s=THROTTLE_DONE pgs=1415 cs=0 l=1 rx=0x7f3c8c001110 tx=0x7f3c8c0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.732+0000 7f3c82ffd700 1 -- 172.21.15.63:0/430264842 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8c005e60 con 0x7f3c900bc590 2020-05-18T21:33:27.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.732+0000 7f3c82ffd700 1 -- 172.21.15.63:0/430264842 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c8c0062c0 con 0x7f3c900bc590 2020-05-18T21:33:27.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.732+0000 7f3c96758700 1 -- 172.21.15.63:0/430264842 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c900650d0 con 0x7f3c900bc590 2020-05-18T21:33:27.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.732+0000 7f3c96758700 1 -- 172.21.15.63:0/430264842 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c90063ce0 con 0x7f3c900bc590 2020-05-18T21:33:27.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.732+0000 7f3c95756700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c900bc590 0x7f3c9013fae0 secure :-1 s=THROTTLE_DONE pgs=1415 cs=0 l=1 rx=0x7f3c8c001110 tx=0x7f3c8c0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.732+0000 7f3c96758700 1 -- 172.21.15.63:0/430264842 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c900569e0 con 0x7f3c900bc590 2020-05-18T21:33:27.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.732+0000 7f3c82ffd700 1 -- 172.21.15.63:0/430264842 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3c8c0064f0 con 0x7f3c900bc590 2020-05-18T21:33:27.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.732+0000 7f3c95756700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c900bc590 0x7f3c9013fae0 secure :-1 s=THROTTLE_DONE pgs=1415 cs=0 l=1 rx=0x7f3c8c001110 tx=0x7f3c8c0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.732+0000 7f3c82ffd700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3c6c04f910 0x7f3c6c051dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:27.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.732+0000 7f3c82ffd700 1 -- 172.21.15.63:0/430264842 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3c8c0090c0 con 0x7f3c900bc590 2020-05-18T21:33:27.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.732+0000 7f3c94f55700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3c6c04f910 0x7f3c6c051dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:27.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.736+0000 7f3c94f55700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3c6c04f910 0x7f3c6c051dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3c84002f70 tx=0x7f3c90061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.736+0000 7f3c94f55700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3c6c04f910 0x7f3c6c051dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3c84002f70 tx=0x7f3c90061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.736+0000 7f3c94f55700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3c6c04f910 0x7f3c6c051dd0 secure :-1 s=READY pgs=555 cs=0 l=1 rx=0x7f3c84002f70 tx=0x7f3c90061d60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:27.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.740+0000 7f3c95756700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c900bc590 0x7f3c9013fae0 secure :-1 s=THROTTLE_DONE pgs=1415 cs=0 l=1 rx=0x7f3c8c001110 tx=0x7f3c8c0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.740+0000 7f3c82ffd700 1 -- 172.21.15.63:0/430264842 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3c8c03de30 con 0x7f3c900bc590 2020-05-18T21:33:27.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.856+0000 7f3c96758700 1 -- 172.21.15.63:0/430264842 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3c90063ce0 con 0x7f3c900bc590 2020-05-18T21:33:27.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.856+0000 7f3c95756700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c900bc590 0x7f3c9013fae0 secure :-1 s=THROTTLE_DONE pgs=1415 cs=0 l=1 rx=0x7f3c8c001110 tx=0x7f3c8c0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.856+0000 7f3c82ffd700 1 -- 172.21.15.63:0/430264842 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v104) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3c90063ce0 con 0x7f3c900bc590 2020-05-18T21:33:27.864 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:33:27.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.860+0000 7f3c96758700 1 -- 172.21.15.63:0/430264842 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3c6c04f910 msgr2=0x7f3c6c051dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:27.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.860+0000 7f3c96758700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3c6c04f910 0x7f3c6c051dd0 secure :-1 s=READY pgs=555 cs=0 l=1 rx=0x7f3c84002f70 tx=0x7f3c90061d60).stop 2020-05-18T21:33:27.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.860+0000 7f3c96758700 1 -- 172.21.15.63:0/430264842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c900bc590 msgr2=0x7f3c9013fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:27.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.860+0000 7f3c96758700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c900bc590 0x7f3c9013fae0 secure :-1 s=READY pgs=1415 cs=0 l=1 rx=0x7f3c8c001110 tx=0x7f3c8c0108f0).stop 2020-05-18T21:33:27.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.860+0000 7f3c96758700 1 -- 172.21.15.63:0/430264842 shutdown_connections 2020-05-18T21:33:27.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.860+0000 7f3c96758700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3c6c04f910 0x7f3c6c051dd0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:27.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.860+0000 7f3c96758700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c901441f0 0x7f3c9013ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:27.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.860+0000 7f3c96758700 1 --2- 172.21.15.63:0/430264842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c900bc590 0x7f3c9013fae0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:27.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.860+0000 7f3c96758700 1 -- 172.21.15.63:0/430264842 >> 172.21.15.63:0/430264842 conn(0x7f3c9005f3b0 msgr2=0x7f3c900b9820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:27.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.860+0000 7f3c96758700 1 -- 172.21.15.63:0/430264842 shutdown_connections 2020-05-18T21:33:27.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.860+0000 7f3c96758700 1 -- 172.21.15.63:0/430264842 wait complete. 2020-05-18T21:33:27.878 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:33:27.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf69a45700 1 Processor -- start 2020-05-18T21:33:27.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf69a45700 1 -- start start 2020-05-18T21:33:27.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf69a45700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf640b58e0 0x7fbf64063b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:27.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf69a45700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf64065570 con 0x7fbf6412b8d0 2020-05-18T21:33:27.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf69a45700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf64065810 con 0x7fbf64146b70 2020-05-18T21:33:27.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf69a45700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf640b5cc0 con 0x7fbf640b58e0 2020-05-18T21:33:27.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf637fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbf6412b8d0 0x7fbf6412bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34412/0 (socket says 172.21.15.63:34412) 2020-05-18T21:33:27.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf637fe700 1 -- 172.21.15.63:0/1337356029 learned_addr learned my addr 172.21.15.63:0/1337356029 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:27.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf62ffd700 1 --2- 172.21.15.63:0/1337356029 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf640b58e0 0x7fbf64063b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:27.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf627fc700 1 -- 172.21.15.63:0/1337356029 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200719610 0 0) 0x7fbf64065570 con 0x7fbf6412b8d0 2020-05-18T21:33:27.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf627fc700 1 -- 172.21.15.63:0/1337356029 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf44003270 con 0x7fbf6412b8d0 2020-05-18T21:33:27.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf627fc700 1 -- 172.21.15.63:0/1337356029 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200271704 0 0) 0x7fbf64065810 con 0x7fbf64146b70 2020-05-18T21:33:27.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf62ffd700 1 -- 172.21.15.63:0/1337356029 >> v1:172.21.15.155:6789/0 conn(0x7fbf64146b70 legacy=0x7fbf64065cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:27.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf62ffd700 1 -- 172.21.15.63:0/1337356029 >> v1:172.21.15.63:6789/0 conn(0x7fbf6412b8d0 legacy=0x7fbf6412bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:27.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf62ffd700 1 -- 172.21.15.63:0/1337356029 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf64065260 con 0x7fbf640b58e0 2020-05-18T21:33:27.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf62ffd700 1 --2- 172.21.15.63:0/1337356029 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf640b58e0 0x7fbf64063b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbf54002f70 tx=0x7fbf54008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf62ffd700 1 --2- 172.21.15.63:0/1337356029 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf640b58e0 0x7fbf64063b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbf54002f70 tx=0x7fbf54008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf62ffd700 1 --2- 172.21.15.63:0/1337356029 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf640b58e0 0x7fbf64063b60 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7fbf54002f70 tx=0x7fbf54008920).ready entity=mon.2 client_cookie=80de72d7151386e1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:27.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf62ffd700 1 --2- 172.21.15.63:0/1337356029 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf640b58e0 0x7fbf64063b60 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7fbf54002f70 tx=0x7fbf54008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf627fc700 1 -- 172.21.15.63:0/1337356029 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf54008e80 con 0x7fbf640b58e0 2020-05-18T21:33:27.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf62ffd700 1 --2- 172.21.15.63:0/1337356029 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf640b58e0 0x7fbf64063b60 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7fbf54002f70 tx=0x7fbf54008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf62ffd700 1 --2- 172.21.15.63:0/1337356029 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf640b58e0 0x7fbf64063b60 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7fbf54002f70 tx=0x7fbf54008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:27.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf627fc700 1 -- 172.21.15.63:0/1337356029 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf54011630 con 0x7fbf640b58e0 2020-05-18T21:33:27.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf627fc700 1 -- 172.21.15.63:0/1337356029 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf540119d0 con 0x7fbf640b58e0 2020-05-18T21:33:27.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf69a45700 1 -- 172.21.15.63:0/1337356029 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf640b58e0 msgr2=0x7fbf64063b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:27.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf69a45700 1 --2- 172.21.15.63:0/1337356029 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf640b58e0 0x7fbf64063b60 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7fbf54002f70 tx=0x7fbf54008920).stop 2020-05-18T21:33:27.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf69a45700 1 -- 172.21.15.63:0/1337356029 shutdown_connections 2020-05-18T21:33:27.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf69a45700 1 --2- 172.21.15.63:0/1337356029 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf640b58e0 0x7fbf64063b60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:27.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf69a45700 1 -- 172.21.15.63:0/1337356029 >> 172.21.15.63:0/1337356029 conn(0x7fbf640b8ec0 msgr2=0x7fbf640b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:27.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf69a45700 1 -- 172.21.15.63:0/1337356029 shutdown_connections 2020-05-18T21:33:27.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.980+0000 7fbf69a45700 1 -- 172.21.15.63:0/1337356029 wait complete. 2020-05-18T21:33:27.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.984+0000 7fbf69a45700 1 Processor -- start 2020-05-18T21:33:27.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.984+0000 7fbf69a45700 1 -- start start 2020-05-18T21:33:27.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.984+0000 7fbf69a45700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6412b8d0 0x7fbf640b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:27.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.984+0000 7fbf69a45700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbf64146b70 0x7fbf64143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:27.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.984+0000 7fbf69a45700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf640b4440 con 0x7fbf640b58e0 2020-05-18T21:33:27.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.984+0000 7fbf69a45700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf640ad720 con 0x7fbf64146b70 2020-05-18T21:33:27.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.984+0000 7fbf69a45700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf640ad9c0 con 0x7fbf6412b8d0 2020-05-18T21:33:27.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf637fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbf64146b70 0x7fbf64143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:27.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf5bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6412b8d0 0x7fbf640b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:27.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf637fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbf64146b70 0x7fbf64143000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60462/0 (socket says 172.21.15.63:60462) 2020-05-18T21:33:27.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf62ffd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fbf640b58e0 0x7fbf640ae100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:60962/0 (socket says 172.21.15.63:60962) 2020-05-18T21:33:27.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf5bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6412b8d0 0x7fbf640b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:51162/0 (socket says 172.21.15.63:51162) 2020-05-18T21:33:27.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf637fe700 1 -- 172.21.15.63:0/1869076701 learned_addr learned my addr 172.21.15.63:0/1869076701 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:27.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf60ff9700 1 -- 172.21.15.63:0/1869076701 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270508206 0 0) 0x7fbf640b4440 con 0x7fbf640b58e0 2020-05-18T21:33:27.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf60ff9700 1 -- 172.21.15.63:0/1869076701 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf48002fe0 con 0x7fbf640b58e0 2020-05-18T21:33:27.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf5bfff700 1 -- 172.21.15.63:0/1869076701 >> v2:172.21.15.63:3300/0 conn(0x7fbf64146b70 msgr2=0x7fbf64143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf5bfff700 1 --2- 172.21.15.63:0/1869076701 >> v2:172.21.15.63:3300/0 conn(0x7fbf64146b70 0x7fbf64143000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:28.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf5bfff700 1 -- 172.21.15.63:0/1869076701 >> v1:172.21.15.155:6789/0 conn(0x7fbf640b58e0 legacy=0x7fbf640ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf5bfff700 1 -- 172.21.15.63:0/1869076701 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf640adc60 con 0x7fbf6412b8d0 2020-05-18T21:33:28.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf5bfff700 1 --2- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6412b8d0 0x7fbf640b3fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf4c000bc0 tx=0x7fbf4c001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf5bfff700 1 --2- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6412b8d0 0x7fbf640b3fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf4c000bc0 tx=0x7fbf4c001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf5bfff700 1 --2- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6412b8d0 0x7fbf640b3fe0 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7fbf4c000bc0 tx=0x7fbf4c001e80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:28.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf5bfff700 1 --2- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6412b8d0 0x7fbf640b3fe0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fbf4c000bc0 tx=0x7fbf4c001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf60ff9700 1 -- 172.21.15.63:0/1869076701 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf4c00cc60 con 0x7fbf6412b8d0 2020-05-18T21:33:28.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf5bfff700 1 --2- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6412b8d0 0x7fbf640b3fe0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fbf4c000bc0 tx=0x7fbf4c001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf5bfff700 1 --2- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6412b8d0 0x7fbf640b3fe0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fbf4c000bc0 tx=0x7fbf4c001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf60ff9700 1 -- 172.21.15.63:0/1869076701 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c00cdc0 con 0x7fbf6412b8d0 2020-05-18T21:33:28.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf69a45700 1 -- 172.21.15.63:0/1869076701 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf64143460 con 0x7fbf6412b8d0 2020-05-18T21:33:28.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf60ff9700 1 -- 172.21.15.63:0/1869076701 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf4c011070 con 0x7fbf6412b8d0 2020-05-18T21:33:28.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf69a45700 1 -- 172.21.15.63:0/1869076701 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf64127a80 con 0x7fbf6412b8d0 2020-05-18T21:33:28.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf5bfff700 1 --2- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6412b8d0 0x7fbf640b3fe0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fbf4c000bc0 tx=0x7fbf4c001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf60ff9700 1 -- 172.21.15.63:0/1869076701 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fbf4c006520 con 0x7fbf6412b8d0 2020-05-18T21:33:28.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf5bfff700 1 --2- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6412b8d0 0x7fbf640b3fe0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fbf4c000bc0 tx=0x7fbf4c001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf69a45700 1 -- 172.21.15.63:0/1869076701 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf640569e0 con 0x7fbf6412b8d0 2020-05-18T21:33:28.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf60ff9700 1 --2- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf4804fd40 0x7fbf48052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:28.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.988+0000 7fbf60ff9700 1 -- 172.21.15.63:0/1869076701 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbf4c063730 con 0x7fbf6412b8d0 2020-05-18T21:33:28.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.992+0000 7fbf62ffd700 1 --2- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf4804fd40 0x7fbf48052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.992+0000 7fbf62ffd700 1 --2- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf4804fd40 0x7fbf48052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf54008500 tx=0x7fbf640653f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.992+0000 7fbf62ffd700 1 --2- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf4804fd40 0x7fbf48052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf54008500 tx=0x7fbf640653f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.992+0000 7fbf62ffd700 1 --2- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf4804fd40 0x7fbf48052200 secure :-1 s=READY pgs=556 cs=0 l=1 rx=0x7fbf54008500 tx=0x7fbf640653f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:28.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.996+0000 7fbf5bfff700 1 --2- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6412b8d0 0x7fbf640b3fe0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fbf4c000bc0 tx=0x7fbf4c001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:27.996+0000 7fbf60ff9700 1 -- 172.21.15.63:0/1869076701 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fbf4c03da60 con 0x7fbf6412b8d0 2020-05-18T21:33:28.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.116+0000 7fbf69a45700 1 -- 172.21.15.63:0/1869076701 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbf640603c0 con 0x7fbf6412b8d0 2020-05-18T21:33:28.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.116+0000 7fbf5bfff700 1 --2- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6412b8d0 0x7fbf640b3fe0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fbf4c000bc0 tx=0x7fbf4c001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.116+0000 7fbf60ff9700 1 -- 172.21.15.63:0/1869076701 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v104) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbf4c041080 con 0x7fbf6412b8d0 2020-05-18T21:33:28.124 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:33:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.120+0000 7fbf69a45700 1 -- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf4804fd40 msgr2=0x7fbf48052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.120+0000 7fbf69a45700 1 --2- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf4804fd40 0x7fbf48052200 secure :-1 s=READY pgs=556 cs=0 l=1 rx=0x7fbf54008500 tx=0x7fbf640653f0).stop 2020-05-18T21:33:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.120+0000 7fbf69a45700 1 -- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6412b8d0 msgr2=0x7fbf640b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.120+0000 7fbf69a45700 1 --2- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6412b8d0 0x7fbf640b3fe0 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7fbf4c000bc0 tx=0x7fbf4c001e80).stop 2020-05-18T21:33:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.120+0000 7fbf69a45700 1 -- 172.21.15.63:0/1869076701 shutdown_connections 2020-05-18T21:33:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.120+0000 7fbf69a45700 1 --2- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbf4804fd40 0x7fbf48052200 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.120+0000 7fbf69a45700 1 --2- 172.21.15.63:0/1869076701 >> v2:172.21.15.63:3300/0 conn(0x7fbf64146b70 0x7fbf64143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.120+0000 7fbf69a45700 1 --2- 172.21.15.63:0/1869076701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6412b8d0 0x7fbf640b3fe0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.120+0000 7fbf69a45700 1 -- 172.21.15.63:0/1869076701 >> 172.21.15.63:0/1869076701 conn(0x7fbf640b8ec0 msgr2=0x7fbf6405ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.120+0000 7fbf69a45700 1 -- 172.21.15.63:0/1869076701 shutdown_connections 2020-05-18T21:33:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.120+0000 7fbf69a45700 1 -- 172.21.15.63:0/1869076701 wait complete. 2020-05-18T21:33:28.137 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:33:28.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72c26dd700 1 Processor -- start 2020-05-18T21:33:28.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72c26dd700 1 -- start start 2020-05-18T21:33:28.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72c26dd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f72bc0b50b0 0x7f72bc0b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:28.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72c26dd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72bc065ec0 con 0x7f72bc062020 2020-05-18T21:33:28.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72c26dd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72bc066160 con 0x7f72bc061be0 2020-05-18T21:33:28.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72c26dd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72bc064120 con 0x7f72bc0b50b0 2020-05-18T21:33:28.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72bbfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f72bc0b50b0 0x7f72bc0b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72c0c7a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f72bc062020 0x7f72bc149880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34426/0 (socket says 172.21.15.63:34426) 2020-05-18T21:33:28.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72c0c7a700 1 -- 172.21.15.63:0/950916563 learned_addr learned my addr 172.21.15.63:0/950916563 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:28.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72bbfff700 1 -- 172.21.15.63:0/950916563 >> v1:172.21.15.155:6789/0 conn(0x7f72bc061be0 legacy=0x7f72bc064860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72bbfff700 1 -- 172.21.15.63:0/950916563 >> v1:172.21.15.63:6789/0 conn(0x7f72bc062020 legacy=0x7f72bc149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72bbfff700 1 -- 172.21.15.63:0/950916563 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc0643c0 con 0x7f72bc0b50b0 2020-05-18T21:33:28.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72bbfff700 1 --2- 172.21.15.63:0/950916563 >> v2:172.21.15.63:3300/0 conn(0x7f72bc0b50b0 0x7f72bc0b8ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f72ac0032f0 tx=0x7f72bc05b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72bbfff700 1 --2- 172.21.15.63:0/950916563 >> v2:172.21.15.63:3300/0 conn(0x7f72bc0b50b0 0x7f72bc0b8ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f72ac0032f0 tx=0x7f72bc05b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72bbfff700 1 --2- 172.21.15.63:0/950916563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72bc0b50b0 0x7f72bc0b8ed0 secure :-1 s=READY pgs=1418 cs=0 l=1 rx=0x7f72ac0032f0 tx=0x7f72bc05b560).ready entity=mon.0 client_cookie=bc134f693f3abf1b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:28.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72bbfff700 1 --2- 172.21.15.63:0/950916563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72bc0b50b0 0x7f72bc0b8ed0 secure :-1 s=THROTTLE_DONE pgs=1418 cs=0 l=1 rx=0x7f72ac0032f0 tx=0x7f72bc05b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72bbfff700 1 --2- 172.21.15.63:0/950916563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72bc0b50b0 0x7f72bc0b8ed0 secure :-1 s=THROTTLE_DONE pgs=1418 cs=0 l=1 rx=0x7f72ac0032f0 tx=0x7f72bc05b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72baffd700 1 -- 172.21.15.63:0/950916563 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72ac00a180 con 0x7f72bc0b50b0 2020-05-18T21:33:28.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72bbfff700 1 --2- 172.21.15.63:0/950916563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72bc0b50b0 0x7f72bc0b8ed0 secure :-1 s=THROTTLE_DONE pgs=1418 cs=0 l=1 rx=0x7f72ac0032f0 tx=0x7f72bc05b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72baffd700 1 -- 172.21.15.63:0/950916563 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac00a2e0 con 0x7f72bc0b50b0 2020-05-18T21:33:28.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72baffd700 1 -- 172.21.15.63:0/950916563 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72ac00a700 con 0x7f72bc0b50b0 2020-05-18T21:33:28.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72c26dd700 1 -- 172.21.15.63:0/950916563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72bc0b50b0 msgr2=0x7f72bc0b8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.240+0000 7f72c26dd700 1 --2- 172.21.15.63:0/950916563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72bc0b50b0 0x7f72bc0b8ed0 secure :-1 s=READY pgs=1418 cs=0 l=1 rx=0x7f72ac0032f0 tx=0x7f72bc05b560).stop 2020-05-18T21:33:28.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.244+0000 7f72c26dd700 1 -- 172.21.15.63:0/950916563 shutdown_connections 2020-05-18T21:33:28.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.244+0000 7f72c26dd700 1 --2- 172.21.15.63:0/950916563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72bc0b50b0 0x7f72bc0b8ed0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:28.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.244+0000 7f72c26dd700 1 -- 172.21.15.63:0/950916563 >> 172.21.15.63:0/950916563 conn(0x7f72bc0b83b0 msgr2=0x7f72bc0b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:28.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.244+0000 7f72c26dd700 1 -- 172.21.15.63:0/950916563 shutdown_connections 2020-05-18T21:33:28.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.244+0000 7f72c26dd700 1 -- 172.21.15.63:0/950916563 wait complete. 2020-05-18T21:33:28.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.244+0000 7f72c26dd700 1 Processor -- start 2020-05-18T21:33:28.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.244+0000 7f72c26dd700 1 -- start start 2020-05-18T21:33:28.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72c26dd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f72bc062020 0x7f72bc119cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:28.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72c26dd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72bc13d1f0 con 0x7f72bc061be0 2020-05-18T21:33:28.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72c26dd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72bc0ae380 con 0x7f72bc0b50b0 2020-05-18T21:33:28.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72c26dd700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72bc0ae5b0 con 0x7f72bc062020 2020-05-18T21:33:28.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72bbfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f72bc061be0 0x7f72bc0b0990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34428/0 (socket says 172.21.15.63:34428) 2020-05-18T21:33:28.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72bbfff700 1 -- 172.21.15.63:0/977100704 learned_addr learned my addr 172.21.15.63:0/977100704 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:28.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72bb7fe700 1 --2- 172.21.15.63:0/977100704 >> v2:172.21.15.155:3300/0 conn(0x7f72bc062020 0x7f72bc119cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72b97fa700 1 -- 172.21.15.63:0/977100704 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551453527 0 0) 0x7f72bc13d1f0 con 0x7f72bc061be0 2020-05-18T21:33:28.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72b97fa700 1 -- 172.21.15.63:0/977100704 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72a0002fe0 con 0x7f72bc061be0 2020-05-18T21:33:28.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72b97fa700 1 -- 172.21.15.63:0/977100704 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1824124688 0 0) 0x7f72a0002fe0 con 0x7f72bc061be0 2020-05-18T21:33:28.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72b97fa700 1 -- 172.21.15.63:0/977100704 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f72bc13d1f0 con 0x7f72bc061be0 2020-05-18T21:33:28.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72b97fa700 1 -- 172.21.15.63:0/977100704 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f72ac008a70 con 0x7f72bc061be0 2020-05-18T21:33:28.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72b97fa700 1 -- 172.21.15.63:0/977100704 >> v2:172.21.15.155:3300/0 conn(0x7f72bc062020 msgr2=0x7f72bc119cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72b97fa700 1 --2- 172.21.15.63:0/977100704 >> v2:172.21.15.155:3300/0 conn(0x7f72bc062020 0x7f72bc119cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:28.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72b97fa700 1 -- 172.21.15.63:0/977100704 >> v1:172.21.15.155:6789/0 conn(0x7f72bc0b50b0 legacy=0x7f72bc0aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72b97fa700 1 -- 172.21.15.63:0/977100704 >> v1:172.21.15.63:6789/0 conn(0x7f72bc061be0 legacy=0x7f72bc0b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72b97fa700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72a0004ad0 0x7f72a0004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:28.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72b97fa700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72a00039a0 0x7f72a0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:28.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72b97fa700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72a0004240 0x7f72a000b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:28.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72b97fa700 1 -- 172.21.15.63:0/977100704 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc0ae5b0 con 0x7f72a00039a0 2020-05-18T21:33:28.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72b97fa700 1 -- 172.21.15.63:0/977100704 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a0004800 con 0x7f72a0004240 2020-05-18T21:33:28.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72b97fa700 1 -- 172.21.15.63:0/977100704 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a000bbf0 con 0x7f72a0004ad0 2020-05-18T21:33:28.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72bb7fe700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72a00039a0 0x7f72a0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72bbfff700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72a0004ad0 0x7f72a0004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72c0c7a700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72a0004240 0x7f72a000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72bb7fe700 1 -- 172.21.15.63:0/977100704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72a0004ad0 msgr2=0x7f72a0004ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72bb7fe700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72a0004ad0 0x7f72a0004ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:28.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72bb7fe700 1 -- 172.21.15.63:0/977100704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72a0004240 msgr2=0x7f72a000b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72bb7fe700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72a0004240 0x7f72a000b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:28.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72c0c7a700 1 -- 172.21.15.63:0/977100704 reap_dead start 2020-05-18T21:33:28.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72bb7fe700 1 -- 172.21.15.63:0/977100704 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc0ae850 con 0x7f72a00039a0 2020-05-18T21:33:28.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72bbfff700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72a0004ad0 0x7f72a0004ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:33:28.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72c26dd700 1 -- 172.21.15.63:0/977100704 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72bc0aeaf0 con 0x7f72a00039a0 2020-05-18T21:33:28.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72c26dd700 1 -- 172.21.15.63:0/977100704 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72bc119cc0 con 0x7f72a00039a0 2020-05-18T21:33:28.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72bb7fe700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72a00039a0 0x7f72a0003de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f72bc069090 tx=0x7f72a4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72bb7fe700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72a00039a0 0x7f72a0003de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f72bc069090 tx=0x7f72a4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72bb7fe700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72a00039a0 0x7f72a0003de0 secure :-1 s=READY pgs=1420 cs=0 l=1 rx=0x7f72bc069090 tx=0x7f72a4010d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:28.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72bb7fe700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72a00039a0 0x7f72a0003de0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7f72bc069090 tx=0x7f72a4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72bb7fe700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72a00039a0 0x7f72a0003de0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7f72bc069090 tx=0x7f72a4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72b97fa700 1 -- 172.21.15.63:0/977100704 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72a4006710 con 0x7f72a00039a0 2020-05-18T21:33:28.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72bb7fe700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72a00039a0 0x7f72a0003de0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7f72bc069090 tx=0x7f72a4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72b97fa700 1 -- 172.21.15.63:0/977100704 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a4006870 con 0x7f72a00039a0 2020-05-18T21:33:28.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.248+0000 7f72b97fa700 1 -- 172.21.15.63:0/977100704 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72a4006c10 con 0x7f72a00039a0 2020-05-18T21:33:28.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.252+0000 7f72c26dd700 1 -- 172.21.15.63:0/977100704 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7294003380 con 0x7f72a00039a0 2020-05-18T21:33:28.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.252+0000 7f72bb7fe700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72a00039a0 0x7f72a0003de0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7f72bc069090 tx=0x7f72a4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.252+0000 7f72b97fa700 1 -- 172.21.15.63:0/977100704 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f72a4006d70 con 0x7f72a00039a0 2020-05-18T21:33:28.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.252+0000 7f72bb7fe700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72a00039a0 0x7f72a0003de0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7f72bc069090 tx=0x7f72a4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.252+0000 7f72b97fa700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f72a0053a50 0x7f72a0055f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:28.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.252+0000 7f72b97fa700 1 -- 172.21.15.63:0/977100704 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f72a4063d50 con 0x7f72a00039a0 2020-05-18T21:33:28.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.252+0000 7f72bbfff700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f72a0053a50 0x7f72a0055f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.252+0000 7f72bbfff700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f72a0053a50 0x7f72a0055f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f72ac0105e0 tx=0x7f72bc05b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.252+0000 7f72bbfff700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f72a0053a50 0x7f72a0055f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f72ac0105e0 tx=0x7f72bc05b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.252+0000 7f72bbfff700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f72a0053a50 0x7f72a0055f10 secure :-1 s=READY pgs=557 cs=0 l=1 rx=0x7f72ac0105e0 tx=0x7f72bc05b560).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:28.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.256+0000 7f72bb7fe700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72a00039a0 0x7f72a0003de0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7f72bc069090 tx=0x7f72a4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.256+0000 7f72b97fa700 1 -- 172.21.15.63:0/977100704 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f72a403e140 con 0x7f72a00039a0 2020-05-18T21:33:28.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.376+0000 7f72c26dd700 1 -- 172.21.15.63:0/977100704 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7294002240 con 0x7f72a00039a0 2020-05-18T21:33:28.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.376+0000 7f72bb7fe700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72a00039a0 0x7f72a0003de0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7f72bc069090 tx=0x7f72a4010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.376+0000 7f72b97fa700 1 -- 172.21.15.63:0/977100704 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v104) v1 ==== 104+0+10 (secure 0 0 0) 0x7f72a4041760 con 0x7f72a00039a0 2020-05-18T21:33:28.383 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:33:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.380+0000 7f72c26dd700 1 -- 172.21.15.63:0/977100704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f72a0053a50 msgr2=0x7f72a0055f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.380+0000 7f72c26dd700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f72a0053a50 0x7f72a0055f10 secure :-1 s=READY pgs=557 cs=0 l=1 rx=0x7f72ac0105e0 tx=0x7f72bc05b560).stop 2020-05-18T21:33:28.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.380+0000 7f72c26dd700 1 -- 172.21.15.63:0/977100704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72a00039a0 msgr2=0x7f72a0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.380+0000 7f72c26dd700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72a00039a0 0x7f72a0003de0 secure :-1 s=READY pgs=1420 cs=0 l=1 rx=0x7f72bc069090 tx=0x7f72a4010d70).stop 2020-05-18T21:33:28.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.380+0000 7f72c26dd700 1 -- 172.21.15.63:0/977100704 shutdown_connections 2020-05-18T21:33:28.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.380+0000 7f72c26dd700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f72a0053a50 0x7f72a0055f10 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:28.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.380+0000 7f72c26dd700 1 --2- 172.21.15.63:0/977100704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72a00039a0 0x7f72a0003de0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:28.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.380+0000 7f72c26dd700 1 -- 172.21.15.63:0/977100704 >> 172.21.15.63:0/977100704 conn(0x7f72bc0b83b0 msgr2=0x7f72bc1488b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:28.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.380+0000 7f72c26dd700 1 -- 172.21.15.63:0/977100704 shutdown_connections 2020-05-18T21:33:28.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.380+0000 7f72c26dd700 1 -- 172.21.15.63:0/977100704 wait complete. 2020-05-18T21:33:28.399 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:33:28.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.504+0000 7fcb2df2d700 1 Processor -- start 2020-05-18T21:33:28.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.504+0000 7fcb2df2d700 1 -- start start 2020-05-18T21:33:28.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2df2d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb2809dfb0 0x7fcb2806a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:28.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2df2d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb280b5f10 con 0x7fcb280b65e0 2020-05-18T21:33:28.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2df2d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb280b6140 con 0x7fcb28145e10 2020-05-18T21:33:28.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2df2d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2809e390 con 0x7fcb2809dfb0 2020-05-18T21:33:28.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcb280b65e0 0x7fcb28145700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34442/0 (socket says 172.21.15.63:34442) 2020-05-18T21:33:28.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1ffff700 1 -- 172.21.15.63:0/304018972 learned_addr learned my addr 172.21.15.63:0/304018972 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:28.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2cf2b700 1 --2- 172.21.15.63:0/304018972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb2809dfb0 0x7fcb2806a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 -- 172.21.15.63:0/304018972 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389121630 0 0) 0x7fcb280b5f10 con 0x7fcb280b65e0 2020-05-18T21:33:28.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 -- 172.21.15.63:0/304018972 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb14003270 con 0x7fcb280b65e0 2020-05-18T21:33:28.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 -- 172.21.15.63:0/304018972 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621296128 0 0) 0x7fcb280b6140 con 0x7fcb28145e10 2020-05-18T21:33:28.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 -- 172.21.15.63:0/304018972 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb280b5f10 con 0x7fcb28145e10 2020-05-18T21:33:28.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 -- 172.21.15.63:0/304018972 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 897190854 0 0) 0x7fcb14003270 con 0x7fcb280b65e0 2020-05-18T21:33:28.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 -- 172.21.15.63:0/304018972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb2809dfb0 msgr2=0x7fcb2806a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:28.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 --2- 172.21.15.63:0/304018972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb2809dfb0 0x7fcb2806a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:28.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 -- 172.21.15.63:0/304018972 >> v1:172.21.15.155:6789/0 conn(0x7fcb28145e10 legacy=0x7fcb280b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 -- 172.21.15.63:0/304018972 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2806aa10 con 0x7fcb280b65e0 2020-05-18T21:33:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 -- 172.21.15.63:0/304018972 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fcb18001710 con 0x7fcb280b65e0 2020-05-18T21:33:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 -- 172.21.15.63:0/304018972 >> v1:172.21.15.63:6789/0 conn(0x7fcb280b65e0 legacy=0x7fcb28145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 --2- 172.21.15.63:0/304018972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb14003920 0x7fcb14003d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 --2- 172.21.15.63:0/304018972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb14004510 0x7fcb14004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 --2- 172.21.15.63:0/304018972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb2809dfb0 0x7fcb14004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 -- 172.21.15.63:0/304018972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2809e390 con 0x7fcb14003920 2020-05-18T21:33:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 -- 172.21.15.63:0/304018972 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb14005250 con 0x7fcb14004510 2020-05-18T21:33:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 -- 172.21.15.63:0/304018972 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1400b760 con 0x7fcb2809dfb0 2020-05-18T21:33:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2cf2b700 1 --2- 172.21.15.63:0/304018972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb14003920 0x7fcb14003d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1ffff700 1 --2- 172.21.15.63:0/304018972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb14004510 0x7fcb14004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2d72c700 1 --2- 172.21.15.63:0/304018972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb2809dfb0 0x7fcb14004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2cf2b700 1 -- 172.21.15.63:0/304018972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb2809dfb0 msgr2=0x7fcb14004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:28.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2cf2b700 1 --2- 172.21.15.63:0/304018972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb2809dfb0 0x7fcb14004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:28.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2cf2b700 1 -- 172.21.15.63:0/304018972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb14004510 msgr2=0x7fcb14004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:28.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2cf2b700 1 --2- 172.21.15.63:0/304018972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb14004510 0x7fcb14004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:28.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2cf2b700 1 -- 172.21.15.63:0/304018972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb14003270 con 0x7fcb14003920 2020-05-18T21:33:28.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2cf2b700 1 --2- 172.21.15.63:0/304018972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb14003920 0x7fcb14003d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcb24002f70 tx=0x7fcb24010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2cf2b700 1 --2- 172.21.15.63:0/304018972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb14003920 0x7fcb14003d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcb24002f70 tx=0x7fcb24010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2cf2b700 1 --2- 172.21.15.63:0/304018972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb14003920 0x7fcb14003d20 secure :-1 s=READY pgs=1422 cs=0 l=1 rx=0x7fcb24002f70 tx=0x7fcb24010060).ready entity=mon.0 client_cookie=853a397b4e40e2c1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:28.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2cf2b700 1 --2- 172.21.15.63:0/304018972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb14003920 0x7fcb14003d20 secure :-1 s=THROTTLE_DONE pgs=1422 cs=0 l=1 rx=0x7fcb24002f70 tx=0x7fcb24010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 -- 172.21.15.63:0/304018972 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb24008e10 con 0x7fcb14003920 2020-05-18T21:33:28.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2cf2b700 1 --2- 172.21.15.63:0/304018972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb14003920 0x7fcb14003d20 secure :-1 s=THROTTLE_DONE pgs=1422 cs=0 l=1 rx=0x7fcb24002f70 tx=0x7fcb24010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 -- 172.21.15.63:0/304018972 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb24010910 con 0x7fcb14003920 2020-05-18T21:33:28.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2cf2b700 1 --2- 172.21.15.63:0/304018972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb14003920 0x7fcb14003d20 secure :-1 s=THROTTLE_DONE pgs=1422 cs=0 l=1 rx=0x7fcb24002f70 tx=0x7fcb24010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb1f7fe700 1 -- 172.21.15.63:0/304018972 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb24010cb0 con 0x7fcb14003920 2020-05-18T21:33:28.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2df2d700 1 -- 172.21.15.63:0/304018972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb14003920 msgr2=0x7fcb14003d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2df2d700 1 --2- 172.21.15.63:0/304018972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb14003920 0x7fcb14003d20 secure :-1 s=READY pgs=1422 cs=0 l=1 rx=0x7fcb24002f70 tx=0x7fcb24010060).stop 2020-05-18T21:33:28.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.508+0000 7fcb2d72c700 1 -- 172.21.15.63:0/304018972 reap_dead start 2020-05-18T21:33:28.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.512+0000 7fcb2df2d700 1 -- 172.21.15.63:0/304018972 shutdown_connections 2020-05-18T21:33:28.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.512+0000 7fcb2df2d700 1 -- 172.21.15.63:0/304018972 >> 172.21.15.63:0/304018972 conn(0x7fcb2805a7c0 msgr2=0x7fcb2805aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:28.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.512+0000 7fcb2df2d700 1 -- 172.21.15.63:0/304018972 shutdown_connections 2020-05-18T21:33:28.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.512+0000 7fcb2df2d700 1 -- 172.21.15.63:0/304018972 wait complete. 2020-05-18T21:33:28.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.512+0000 7fcb2df2d700 1 Processor -- start 2020-05-18T21:33:28.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.512+0000 7fcb2df2d700 1 -- start start 2020-05-18T21:33:28.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2df2d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcb28153a10 0x7fcb28153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:28.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2df2d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcb28112f00 0x7fcb28113390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:28.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2df2d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb280aedc0 con 0x7fcb280b9440 2020-05-18T21:33:28.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2df2d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb280af030 con 0x7fcb28112f00 2020-05-18T21:33:28.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2df2d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb280af2d0 con 0x7fcb28153a10 2020-05-18T21:33:28.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2d72c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcb28112f00 0x7fcb28113390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2cf2b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcb280b9440 0x7fcb280ae6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34456/0 (socket says 172.21.15.63:34456) 2020-05-18T21:33:28.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2d72c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcb28112f00 0x7fcb28113390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60502/0 (socket says 172.21.15.63:60502) 2020-05-18T21:33:28.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2cf2b700 1 -- 172.21.15.63:0/3774913013 learned_addr learned my addr 172.21.15.63:0/3774913013 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:28.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb1ffff700 1 --2- 172.21.15.63:0/3774913013 >> v2:172.21.15.155:3300/0 conn(0x7fcb28153a10 0x7fcb28153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2d72c700 1 -- 172.21.15.63:0/3774913013 >> v2:172.21.15.155:3300/0 conn(0x7fcb28153a10 msgr2=0x7fcb28153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2d72c700 1 --2- 172.21.15.63:0/3774913013 >> v2:172.21.15.155:3300/0 conn(0x7fcb28153a10 0x7fcb28153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:28.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2d72c700 1 -- 172.21.15.63:0/3774913013 >> v1:172.21.15.63:6789/0 conn(0x7fcb280b9440 legacy=0x7fcb280ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2d72c700 1 -- 172.21.15.63:0/3774913013 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb280af570 con 0x7fcb28112f00 2020-05-18T21:33:28.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2d72c700 1 --2- 172.21.15.63:0/3774913013 >> v2:172.21.15.63:3300/0 conn(0x7fcb28112f00 0x7fcb28113390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcb28065ec0 tx=0x7fcb2000c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2d72c700 1 --2- 172.21.15.63:0/3774913013 >> v2:172.21.15.63:3300/0 conn(0x7fcb28112f00 0x7fcb28113390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcb28065ec0 tx=0x7fcb2000c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2d72c700 1 --2- 172.21.15.63:0/3774913013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb28112f00 0x7fcb28113390 secure :-1 s=READY pgs=1424 cs=0 l=1 rx=0x7fcb28065ec0 tx=0x7fcb2000c8a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:28.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2d72c700 1 --2- 172.21.15.63:0/3774913013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb28112f00 0x7fcb28113390 secure :-1 s=THROTTLE_DONE pgs=1424 cs=0 l=1 rx=0x7fcb28065ec0 tx=0x7fcb2000c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2d72c700 1 --2- 172.21.15.63:0/3774913013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb28112f00 0x7fcb28113390 secure :-1 s=THROTTLE_DONE pgs=1424 cs=0 l=1 rx=0x7fcb28065ec0 tx=0x7fcb2000c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb1dffb700 1 -- 172.21.15.63:0/3774913013 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb20003560 con 0x7fcb28112f00 2020-05-18T21:33:28.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2d72c700 1 --2- 172.21.15.63:0/3774913013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb28112f00 0x7fcb28113390 secure :-1 s=THROTTLE_DONE pgs=1424 cs=0 l=1 rx=0x7fcb28065ec0 tx=0x7fcb2000c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb1dffb700 1 -- 172.21.15.63:0/3774913013 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb200036c0 con 0x7fcb28112f00 2020-05-18T21:33:28.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2df2d700 1 -- 172.21.15.63:0/3774913013 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb280b9820 con 0x7fcb28112f00 2020-05-18T21:33:28.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb1dffb700 1 -- 172.21.15.63:0/3774913013 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb20003a60 con 0x7fcb28112f00 2020-05-18T21:33:28.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2df2d700 1 -- 172.21.15.63:0/3774913013 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb280b0050 con 0x7fcb28112f00 2020-05-18T21:33:28.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2d72c700 1 --2- 172.21.15.63:0/3774913013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb28112f00 0x7fcb28113390 secure :-1 s=THROTTLE_DONE pgs=1424 cs=0 l=1 rx=0x7fcb28065ec0 tx=0x7fcb2000c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2df2d700 1 -- 172.21.15.63:0/3774913013 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb280569e0 con 0x7fcb28112f00 2020-05-18T21:33:28.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb1dffb700 1 -- 172.21.15.63:0/3774913013 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fcb20003bc0 con 0x7fcb28112f00 2020-05-18T21:33:28.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.516+0000 7fcb2d72c700 1 --2- 172.21.15.63:0/3774913013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb28112f00 0x7fcb28113390 secure :-1 s=THROTTLE_DONE pgs=1424 cs=0 l=1 rx=0x7fcb28065ec0 tx=0x7fcb2000c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.520+0000 7fcb1dffb700 1 --2- 172.21.15.63:0/3774913013 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcb0804fa10 0x7fcb08051ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.520+0000 7fcb1dffb700 1 -- 172.21.15.63:0/3774913013 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcb20063940 con 0x7fcb28112f00 2020-05-18T21:33:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.520+0000 7fcb2cf2b700 1 --2- 172.21.15.63:0/3774913013 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcb0804fa10 0x7fcb08051ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.520+0000 7fcb2cf2b700 1 --2- 172.21.15.63:0/3774913013 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcb0804fa10 0x7fcb08051ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcb28112de0 tx=0x7fcb24010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.520+0000 7fcb2cf2b700 1 --2- 172.21.15.63:0/3774913013 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcb0804fa10 0x7fcb08051ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcb28112de0 tx=0x7fcb24010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.520+0000 7fcb2cf2b700 1 --2- 172.21.15.63:0/3774913013 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcb0804fa10 0x7fcb08051ed0 secure :-1 s=READY pgs=558 cs=0 l=1 rx=0x7fcb28112de0 tx=0x7fcb24010060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:28.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.524+0000 7fcb2d72c700 1 --2- 172.21.15.63:0/3774913013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb28112f00 0x7fcb28113390 secure :-1 s=THROTTLE_DONE pgs=1424 cs=0 l=1 rx=0x7fcb28065ec0 tx=0x7fcb2000c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.524+0000 7fcb1dffb700 1 -- 172.21.15.63:0/3774913013 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fcb2003dd30 con 0x7fcb28112f00 2020-05-18T21:33:28.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.640+0000 7fcb2df2d700 1 -- 172.21.15.63:0/3774913013 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcb280b9d20 con 0x7fcb28112f00 2020-05-18T21:33:28.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.640+0000 7fcb2d72c700 1 --2- 172.21.15.63:0/3774913013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb28112f00 0x7fcb28113390 secure :-1 s=THROTTLE_DONE pgs=1424 cs=0 l=1 rx=0x7fcb28065ec0 tx=0x7fcb2000c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.640+0000 7fcb1dffb700 1 -- 172.21.15.63:0/3774913013 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v104) v1 ==== 100+0+10 (secure 0 0 0) 0x7fcb20041350 con 0x7fcb28112f00 2020-05-18T21:33:28.649 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:33:28.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.644+0000 7fcb2df2d700 1 -- 172.21.15.63:0/3774913013 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcb0804fa10 msgr2=0x7fcb08051ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.644+0000 7fcb2df2d700 1 --2- 172.21.15.63:0/3774913013 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcb0804fa10 0x7fcb08051ed0 secure :-1 s=READY pgs=558 cs=0 l=1 rx=0x7fcb28112de0 tx=0x7fcb24010060).stop 2020-05-18T21:33:28.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.644+0000 7fcb2df2d700 1 -- 172.21.15.63:0/3774913013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb28112f00 msgr2=0x7fcb28113390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.644+0000 7fcb2df2d700 1 --2- 172.21.15.63:0/3774913013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb28112f00 0x7fcb28113390 secure :-1 s=READY pgs=1424 cs=0 l=1 rx=0x7fcb28065ec0 tx=0x7fcb2000c8a0).stop 2020-05-18T21:33:28.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.644+0000 7fcb2df2d700 1 -- 172.21.15.63:0/3774913013 shutdown_connections 2020-05-18T21:33:28.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.644+0000 7fcb2df2d700 1 --2- 172.21.15.63:0/3774913013 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcb0804fa10 0x7fcb08051ed0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:28.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.644+0000 7fcb2df2d700 1 --2- 172.21.15.63:0/3774913013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb28112f00 0x7fcb28113390 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:28.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.644+0000 7fcb2df2d700 1 --2- 172.21.15.63:0/3774913013 >> v2:172.21.15.155:3300/0 conn(0x7fcb28153a10 0x7fcb28153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:28.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.644+0000 7fcb2df2d700 1 -- 172.21.15.63:0/3774913013 >> 172.21.15.63:0/3774913013 conn(0x7fcb2805a7c0 msgr2=0x7fcb280b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:28.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.644+0000 7fcb2df2d700 1 -- 172.21.15.63:0/3774913013 shutdown_connections 2020-05-18T21:33:28.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.644+0000 7fcb2df2d700 1 -- 172.21.15.63:0/3774913013 wait complete. 2020-05-18T21:33:28.668 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:33:28.669 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:28.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9b03875700 1 Processor -- start 2020-05-18T21:33:28.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9b03875700 1 -- start start 2020-05-18T21:33:28.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9b03875700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9afc06a280 0x7f9afc0619a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:28.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9b03875700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9afc0b4dd0 con 0x7f9afc144350 2020-05-18T21:33:28.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9b03875700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9afc061260 con 0x7f9afc0b5670 2020-05-18T21:33:28.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9b03875700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc061500 con 0x7f9afc06a280 2020-05-18T21:33:28.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9b01611700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9afc144350 0x7f9afc144730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34462/0 (socket says 172.21.15.63:34462) 2020-05-18T21:33:28.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9b01611700 1 -- 172.21.15.63:0/2658431455 learned_addr learned my addr 172.21.15.63:0/2658431455 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:28.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9b00e10700 1 --2- 172.21.15.63:0/2658431455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9afc06a280 0x7f9afc0619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9afbfff700 1 -- 172.21.15.63:0/2658431455 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249439696 0 0) 0x7f9afc0b4dd0 con 0x7f9afc144350 2020-05-18T21:33:28.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9afbfff700 1 -- 172.21.15.63:0/2658431455 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9adc003270 con 0x7f9afc144350 2020-05-18T21:33:28.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9afbfff700 1 -- 172.21.15.63:0/2658431455 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525782612 0 0) 0x7f9afc061260 con 0x7f9afc0b5670 2020-05-18T21:33:28.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9afbfff700 1 -- 172.21.15.63:0/2658431455 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9afc0b4dd0 con 0x7f9afc0b5670 2020-05-18T21:33:28.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9afbfff700 1 -- 172.21.15.63:0/2658431455 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 981008607 0 0) 0x7f9adc003270 con 0x7f9afc144350 2020-05-18T21:33:28.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9afbfff700 1 -- 172.21.15.63:0/2658431455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9afc06a280 msgr2=0x7f9afc0619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:28.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9afbfff700 1 --2- 172.21.15.63:0/2658431455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9afc06a280 0x7f9afc0619a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:28.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9afbfff700 1 -- 172.21.15.63:0/2658431455 >> v1:172.21.15.155:6789/0 conn(0x7f9afc0b5670 legacy=0x7f9afc09c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9afbfff700 1 -- 172.21.15.63:0/2658431455 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc061e00 con 0x7f9afc144350 2020-05-18T21:33:28.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9afbfff700 1 -- 172.21.15.63:0/2658431455 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f9af4001a10 con 0x7f9afc144350 2020-05-18T21:33:28.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9afbfff700 1 -- 172.21.15.63:0/2658431455 >> v1:172.21.15.63:6789/0 conn(0x7f9afc144350 legacy=0x7f9afc144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9afbfff700 1 --2- 172.21.15.63:0/2658431455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9afc06a280 0x7f9adc003920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:28.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9afbfff700 1 --2- 172.21.15.63:0/2658431455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9adc003dd0 0x7f9adc004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:28.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9afbfff700 1 --2- 172.21.15.63:0/2658431455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9adc004970 0x7f9adc004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:28.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9afbfff700 1 -- 172.21.15.63:0/2658431455 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc061500 con 0x7f9adc004970 2020-05-18T21:33:28.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9afbfff700 1 -- 172.21.15.63:0/2658431455 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc005250 con 0x7f9adc003dd0 2020-05-18T21:33:28.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9afbfff700 1 -- 172.21.15.63:0/2658431455 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc0053e0 con 0x7f9afc06a280 2020-05-18T21:33:28.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9b01e12700 1 --2- 172.21.15.63:0/2658431455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9adc004970 0x7f9adc004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9b01611700 1 --2- 172.21.15.63:0/2658431455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9afc06a280 0x7f9adc003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.764+0000 7f9b00e10700 1 --2- 172.21.15.63:0/2658431455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9adc003dd0 0x7f9adc004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b00e10700 1 -- 172.21.15.63:0/2658431455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9afc06a280 msgr2=0x7f9adc003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:28.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b00e10700 1 --2- 172.21.15.63:0/2658431455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9afc06a280 0x7f9adc003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:28.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b00e10700 1 -- 172.21.15.63:0/2658431455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9adc004970 msgr2=0x7f9adc004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:28.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b00e10700 1 --2- 172.21.15.63:0/2658431455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9adc004970 0x7f9adc004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:28.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b00e10700 1 -- 172.21.15.63:0/2658431455 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9adc003270 con 0x7f9adc003dd0 2020-05-18T21:33:28.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b01611700 1 --2- 172.21.15.63:0/2658431455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9afc06a280 0x7f9adc003920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:28.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b00e10700 1 --2- 172.21.15.63:0/2658431455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9adc003dd0 0x7f9adc004510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9ae4002f70 tx=0x7f9ae4010040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b00e10700 1 --2- 172.21.15.63:0/2658431455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9adc003dd0 0x7f9adc004510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9ae4002f70 tx=0x7f9ae4010040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b00e10700 1 --2- 172.21.15.63:0/2658431455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9adc003dd0 0x7f9adc004510 secure :-1 s=READY pgs=962 cs=0 l=1 rx=0x7f9ae4002f70 tx=0x7f9ae4010040).ready entity=mon.1 client_cookie=dd50ccde52348752 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:28.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b00e10700 1 --2- 172.21.15.63:0/2658431455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9adc003dd0 0x7f9adc004510 secure :-1 s=THROTTLE_DONE pgs=962 cs=0 l=1 rx=0x7f9ae4002f70 tx=0x7f9ae4010040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9afbfff700 1 -- 172.21.15.63:0/2658431455 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ae4008e10 con 0x7f9adc003dd0 2020-05-18T21:33:28.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b00e10700 1 --2- 172.21.15.63:0/2658431455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9adc003dd0 0x7f9adc004510 secure :-1 s=THROTTLE_DONE pgs=962 cs=0 l=1 rx=0x7f9ae4002f70 tx=0x7f9ae4010040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b00e10700 1 --2- 172.21.15.63:0/2658431455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9adc003dd0 0x7f9adc004510 secure :-1 s=THROTTLE_DONE pgs=962 cs=0 l=1 rx=0x7f9ae4002f70 tx=0x7f9ae4010040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9afbfff700 1 -- 172.21.15.63:0/2658431455 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae40108f0 con 0x7f9adc003dd0 2020-05-18T21:33:28.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9afbfff700 1 -- 172.21.15.63:0/2658431455 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ae4010c50 con 0x7f9adc003dd0 2020-05-18T21:33:28.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b03875700 1 -- 172.21.15.63:0/2658431455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9adc003dd0 msgr2=0x7f9adc004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b03875700 1 --2- 172.21.15.63:0/2658431455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9adc003dd0 0x7f9adc004510 secure :-1 s=READY pgs=962 cs=0 l=1 rx=0x7f9ae4002f70 tx=0x7f9ae4010040).stop 2020-05-18T21:33:28.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b01e12700 1 -- 172.21.15.63:0/2658431455 reap_dead start 2020-05-18T21:33:28.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b03875700 1 -- 172.21.15.63:0/2658431455 shutdown_connections 2020-05-18T21:33:28.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b03875700 1 -- 172.21.15.63:0/2658431455 >> 172.21.15.63:0/2658431455 conn(0x7f9afc05b240 msgr2=0x7f9afc069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:28.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b03875700 1 -- 172.21.15.63:0/2658431455 shutdown_connections 2020-05-18T21:33:28.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b03875700 1 -- 172.21.15.63:0/2658431455 wait complete. 2020-05-18T21:33:28.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b03875700 1 Processor -- start 2020-05-18T21:33:28.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.768+0000 7f9b03875700 1 -- start start 2020-05-18T21:33:28.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b03875700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9afc0b82d0 0x7f9afc065190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:28.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b03875700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9afc064b10 0x7f9afc0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:28.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b03875700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9afc064f80 con 0x7f9afc0b2660 2020-05-18T21:33:28.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b03875700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9afc064130 con 0x7f9afc064b10 2020-05-18T21:33:28.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b03875700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9afc0643d0 con 0x7f9afc0b82d0 2020-05-18T21:33:28.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b00e10700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9afc0b2660 0x7f9afc140e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34474/0 (socket says 172.21.15.63:34474) 2020-05-18T21:33:28.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b00e10700 1 -- 172.21.15.63:0/2726281706 learned_addr learned my addr 172.21.15.63:0/2726281706 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:28.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b01e12700 1 --2- 172.21.15.63:0/2726281706 >> v2:172.21.15.63:3300/0 conn(0x7f9afc064b10 0x7f9afc0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b01611700 1 --2- 172.21.15.63:0/2726281706 >> v2:172.21.15.155:3300/0 conn(0x7f9afc0b82d0 0x7f9afc065190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9afa7fc700 1 -- 172.21.15.63:0/2726281706 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911067335 0 0) 0x7f9afc064f80 con 0x7f9afc0b2660 2020-05-18T21:33:28.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9afa7fc700 1 -- 172.21.15.63:0/2726281706 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ae0002fe0 con 0x7f9afc0b2660 2020-05-18T21:33:28.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b01e12700 1 -- 172.21.15.63:0/2726281706 >> v2:172.21.15.155:3300/0 conn(0x7f9afc0b82d0 msgr2=0x7f9afc065190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b01e12700 1 --2- 172.21.15.63:0/2726281706 >> v2:172.21.15.155:3300/0 conn(0x7f9afc0b82d0 0x7f9afc065190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:28.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b01e12700 1 -- 172.21.15.63:0/2726281706 >> v1:172.21.15.63:6789/0 conn(0x7f9afc0b2660 legacy=0x7f9afc140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b01e12700 1 -- 172.21.15.63:0/2726281706 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc064670 con 0x7f9afc064b10 2020-05-18T21:33:28.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b01e12700 1 --2- 172.21.15.63:0/2726281706 >> v2:172.21.15.63:3300/0 conn(0x7f9afc064b10 0x7f9afc0afbe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9aec0011d0 tx=0x7f9aec003ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b01e12700 1 --2- 172.21.15.63:0/2726281706 >> v2:172.21.15.63:3300/0 conn(0x7f9afc064b10 0x7f9afc0afbe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9aec0011d0 tx=0x7f9aec003ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b01e12700 1 --2- 172.21.15.63:0/2726281706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9afc064b10 0x7f9afc0afbe0 secure :-1 s=READY pgs=1427 cs=0 l=1 rx=0x7f9aec0011d0 tx=0x7f9aec003ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:28.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b01e12700 1 --2- 172.21.15.63:0/2726281706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9afc064b10 0x7f9afc0afbe0 secure :-1 s=THROTTLE_DONE pgs=1427 cs=0 l=1 rx=0x7f9aec0011d0 tx=0x7f9aec003ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9afa7fc700 1 -- 172.21.15.63:0/2726281706 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aec011ea0 con 0x7f9afc064b10 2020-05-18T21:33:28.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b01e12700 1 --2- 172.21.15.63:0/2726281706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9afc064b10 0x7f9afc0afbe0 secure :-1 s=THROTTLE_DONE pgs=1427 cs=0 l=1 rx=0x7f9aec0011d0 tx=0x7f9aec003ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b03875700 1 -- 172.21.15.63:0/2726281706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9afc0b86b0 con 0x7f9afc064b10 2020-05-18T21:33:28.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9afa7fc700 1 -- 172.21.15.63:0/2726281706 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec00cb70 con 0x7f9afc064b10 2020-05-18T21:33:28.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b01e12700 1 --2- 172.21.15.63:0/2726281706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9afc064b10 0x7f9afc0afbe0 secure :-1 s=THROTTLE_DONE pgs=1427 cs=0 l=1 rx=0x7f9aec0011d0 tx=0x7f9aec003ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9afa7fc700 1 -- 172.21.15.63:0/2726281706 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aec010e90 con 0x7f9afc064b10 2020-05-18T21:33:28.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b03875700 1 -- 172.21.15.63:0/2726281706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9afc141550 con 0x7f9afc064b10 2020-05-18T21:33:28.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b01e12700 1 --2- 172.21.15.63:0/2726281706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9afc064b10 0x7f9afc0afbe0 secure :-1 s=THROTTLE_DONE pgs=1427 cs=0 l=1 rx=0x7f9aec0011d0 tx=0x7f9aec003ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.772+0000 7f9b03875700 1 -- 172.21.15.63:0/2726281706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9afc0569e0 con 0x7f9afc064b10 2020-05-18T21:33:28.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.776+0000 7f9afa7fc700 1 -- 172.21.15.63:0/2726281706 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9aec006520 con 0x7f9afc064b10 2020-05-18T21:33:28.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.776+0000 7f9b01e12700 1 --2- 172.21.15.63:0/2726281706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9afc064b10 0x7f9afc0afbe0 secure :-1 s=THROTTLE_DONE pgs=1427 cs=0 l=1 rx=0x7f9aec0011d0 tx=0x7f9aec003ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.776+0000 7f9afa7fc700 1 --2- 172.21.15.63:0/2726281706 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9ae004fd10 0x7f9ae00521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:28.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.776+0000 7f9afa7fc700 1 -- 172.21.15.63:0/2726281706 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9aec063530 con 0x7f9afc064b10 2020-05-18T21:33:28.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.776+0000 7f9b01611700 1 --2- 172.21.15.63:0/2726281706 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9ae004fd10 0x7f9ae00521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:28.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.776+0000 7f9b01611700 1 --2- 172.21.15.63:0/2726281706 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9ae004fd10 0x7f9ae00521d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9af40017e0 tx=0x7f9afc09c040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.776+0000 7f9b01611700 1 --2- 172.21.15.63:0/2726281706 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9ae004fd10 0x7f9ae00521d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9af40017e0 tx=0x7f9afc09c040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.776+0000 7f9b01611700 1 --2- 172.21.15.63:0/2726281706 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9ae004fd10 0x7f9ae00521d0 secure :-1 s=READY pgs=559 cs=0 l=1 rx=0x7f9af40017e0 tx=0x7f9afc09c040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:28.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.780+0000 7f9b01e12700 1 --2- 172.21.15.63:0/2726281706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9afc064b10 0x7f9afc0afbe0 secure :-1 s=THROTTLE_DONE pgs=1427 cs=0 l=1 rx=0x7f9aec0011d0 tx=0x7f9aec003ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.780+0000 7f9afa7fc700 1 -- 172.21.15.63:0/2726281706 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9aec03d860 con 0x7f9afc064b10 2020-05-18T21:33:28.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.932+0000 7f9b03875700 1 -- 172.21.15.63:0/2726281706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9afc062cb0 con 0x7f9afc064b10 2020-05-18T21:33:28.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.932+0000 7f9b01e12700 1 --2- 172.21.15.63:0/2726281706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9afc064b10 0x7f9afc0afbe0 secure :-1 s=THROTTLE_DONE pgs=1427 cs=0 l=1 rx=0x7f9aec0011d0 tx=0x7f9aec003ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:28.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.932+0000 7f9afa7fc700 1 -- 172.21.15.63:0/2726281706 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f9aec040e80 con 0x7f9afc064b10 2020-05-18T21:33:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:28.940 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":81,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6113,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2300000397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2300000397},{"type":"v1","addr":"172.21.15.63:6833","nonce":2300000397}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":78}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:23.230529+0000","modified":"2020-05-18T21:33:24.934162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8059":{"gid":8059,"name":"b","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1291107650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1291107650},{"type":"v1","addr":"172.21.15.155:6835","nonce":1291107650}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-05-18T21:33:28.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.936+0000 7f9b03875700 1 -- 172.21.15.63:0/2726281706 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9ae004fd10 msgr2=0x7f9ae00521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.936+0000 7f9b03875700 1 --2- 172.21.15.63:0/2726281706 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9ae004fd10 0x7f9ae00521d0 secure :-1 s=READY pgs=559 cs=0 l=1 rx=0x7f9af40017e0 tx=0x7f9afc09c040).stop 2020-05-18T21:33:28.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.936+0000 7f9b03875700 1 -- 172.21.15.63:0/2726281706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9afc064b10 msgr2=0x7f9afc0afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:28.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.936+0000 7f9b03875700 1 --2- 172.21.15.63:0/2726281706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9afc064b10 0x7f9afc0afbe0 secure :-1 s=READY pgs=1427 cs=0 l=1 rx=0x7f9aec0011d0 tx=0x7f9aec003ed0).stop 2020-05-18T21:33:28.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.936+0000 7f9b03875700 1 -- 172.21.15.63:0/2726281706 shutdown_connections 2020-05-18T21:33:28.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.936+0000 7f9b03875700 1 --2- 172.21.15.63:0/2726281706 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9ae004fd10 0x7f9ae00521d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:28.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.936+0000 7f9b03875700 1 --2- 172.21.15.63:0/2726281706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9afc064b10 0x7f9afc0afbe0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:28.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.936+0000 7f9b03875700 1 --2- 172.21.15.63:0/2726281706 >> v2:172.21.15.155:3300/0 conn(0x7f9afc0b82d0 0x7f9afc065190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:28.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.936+0000 7f9b03875700 1 -- 172.21.15.63:0/2726281706 >> 172.21.15.63:0/2726281706 conn(0x7f9afc05b240 msgr2=0x7f9afc0b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:28.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.936+0000 7f9b03875700 1 -- 172.21.15.63:0/2726281706 shutdown_connections 2020-05-18T21:33:28.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:28.936+0000 7f9b03875700 1 -- 172.21.15.63:0/2726281706 wait complete. 2020-05-18T21:33:28.944 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 81 2020-05-18T21:33:29.154 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 81, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:33:23.230529+0000', 'modified': '2020-05-18T21:33:24.934162+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8059}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8059': {'gid': 8059, 'name': 'b', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6835/1291107650', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 1291107650}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 1291107650}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:33:29.155 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:33:29.156 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:33:29.262 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:33:29.262 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:33:29.262 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2020-05-18T21:33:29.262 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 8059, 2020-05-18T21:33:29.263 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:33:29.263 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:33:29.263 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 6.0253625880000001, 2020-05-18T21:33:29.263 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 81, 2020-05-18T21:33:29.263 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 104, 2020-05-18T21:33:29.264 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 104, 2020-05-18T21:33:29.264 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 10.258880320999999 2020-05-18T21:33:29.264 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:33:29.270 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 8059, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.0253625880000001, "mdsmap_epoch": 81, "osdmap_epoch": 104, "osdmap_epoch_barrier": 104, "uptime": 10.258880320999999 } 2020-05-18T21:33:29.271 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:33:29.272 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:33:29.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.273 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:33:29.281 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:33:29.281 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:33:29.282 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:33:29.282 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:29.282 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:33:29.282 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:29.283 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:29.283 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:29.283 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:29.283 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:29.283 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:29.284 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:29.284 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:33:29.284 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:29.284 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:33:29.284 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42433sec preferred_lft 42433sec 2020-05-18T21:33:29.284 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:33:29.285 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:29.285 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:33:29.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.286 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:33:29.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.345 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:33:29.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.362 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:33:29.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.378 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:33:29.440 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:33:29.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.443 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:33:29.453 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:33:29.453 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:33:29.454 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:33:29.454 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:33:29.454 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:33:29.455 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:33:29.455 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:33:29.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.456 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:33:29.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.474 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:33:29.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.534 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:33:29.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.559 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:33:29.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.568 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:33:29.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.577 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:33:29.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.639 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-05-18T21:33:29.641 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:33:29.644 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:33:29.659 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-05-18T21:33:29.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.660 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-05-18T21:33:29.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.747 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:33:29.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.767 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-05-18T21:33:29.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.782 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-05-18T21:33:29.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.845 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-05-18T21:33:29.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.860 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 up' 2020-05-18T21:33:29.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:29.877 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.0 master ceph-brx' 2020-05-18T21:33:29.941 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-05-18T21:33:29.941 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-05-18T21:33:29.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:29.942 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:33:29.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:29.950 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:33:29.964 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:33:29.965 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:33:29.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:29.967 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:33:30.019 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:33:30.019 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:33:30.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:30.022 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:33:30.036 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:33:30.038 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:33:30.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:30.039 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:33:30.108 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2020-05-18T21:33:30.104+0000 7f5f6a6ee080 -1 init, newargv = 0x560f42a6f530 newargc=9ceph-fuse[30852]: starting ceph client 2020-05-18T21:33:30.109 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr: 2020-05-18T21:33:30.120 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[30852]: starting fuse 2020-05-18T21:33:31.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:31.148 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:33:31.165 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:33:31.166 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:33:31.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:31.167 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:33:31.174 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:33:31.175 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:33:31.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:31.176 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:33:31.176 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:33:31.177 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:33:31.177 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:33:31.177 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:33:31.178 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:31.178 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:33:31.179 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:33:31.179 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:33:31.180 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:31.180 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:33:31.180 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:33:31.181 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:33:31.181 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:33:31.182 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:31.182 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:33:31.182 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:33:31.183 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:33:31.183 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:33:31.184 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:33:31.184 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:31.185 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:33:31.185 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:33:31.232 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.30852.asok 2020-05-18T21:33:31.236 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.30852.asok 2020-05-18T21:33:31.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:31.237 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.30852.asok status 2020-05-18T21:33:31.372 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:31.372 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:33:31.373 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:33:31.373 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:33:31.373 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:33:31.373 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:33:31.373 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:33:31.374 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "30852", 2020-05-18T21:33:31.374 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:33:31.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:31.374 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:33:31.374 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:33:31.375 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 8478, 2020-05-18T21:33:31.375 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:33:31.375 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:33:31.375 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:33:31.375 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 8478 2020-05-18T21:33:31.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:31.376 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:33:31.376 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:31.376 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:33:31.376 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1296194290 2020-05-18T21:33:31.376 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:31.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:31.377 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:33:31.377 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:31.377 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:33:31.377 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1296194290 2020-05-18T21:33:31.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:31.378 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.8478 192.168.0.1:0/1296194290", 2020-05-18T21:33:31.378 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/1296194290", 2020-05-18T21:33:31.378 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:33:31.378 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 81, 2020-05-18T21:33:31.378 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 104, 2020-05-18T21:33:31.379 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:33:31.379 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:33:31.379 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:31.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:31.381 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:33:31.382 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:33:31.388 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:33:31.389 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-05-18T21:33:31.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:31.390 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:33:31.405 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo dd if=/dev/urandom of=file_a bs=1M conv=fdatasync count=8 seek=0) 2020-05-18T21:33:31.555 INFO:teuthology.orchestra.run.smithi063.stderr:8+0 records in 2020-05-18T21:33:31.556 INFO:teuthology.orchestra.run.smithi063.stderr:8+0 records out 2020-05-18T21:33:31.556 INFO:teuthology.orchestra.run.smithi063.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.121846 s, 68.8 MB/s 2020-05-18T21:33:31.557 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:33:31.568 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:33:31.568 INFO:teuthology.orchestra.run.smithi063:> import stat 2020-05-18T21:33:31.568 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:31.569 INFO:teuthology.orchestra.run.smithi063:> print(os.stat("/home/ubuntu/cephtest/mnt.0/file_a").st_ino) 2020-05-18T21:33:31.569 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:33:31.649 INFO:teuthology.orchestra.run.smithi063.stdout:1099511627776 2020-05-18T21:33:31.839 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo dd if=/dev/urandom of=file_b bs=1M conv=fdatasync count=8 seek=0) 2020-05-18T21:33:32.005 INFO:teuthology.orchestra.run.smithi063.stderr:8+0 records in 2020-05-18T21:33:32.006 INFO:teuthology.orchestra.run.smithi063.stderr:8+0 records out 2020-05-18T21:33:32.006 INFO:teuthology.orchestra.run.smithi063.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.102676 s, 81.7 MB/s 2020-05-18T21:33:32.007 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:33:32.008 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:33:32.008 INFO:teuthology.orchestra.run.smithi063:> import stat 2020-05-18T21:33:32.009 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:32.009 INFO:teuthology.orchestra.run.smithi063:> print(os.stat("/home/ubuntu/cephtest/mnt.0/file_b").st_ino) 2020-05-18T21:33:32.009 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:33:32.089 INFO:teuthology.orchestra.run.smithi063.stdout:1099511627777 2020-05-18T21:33:32.279 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo ln file_b linkto_b) 2020-05-18T21:33:32.309 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:33:32.309 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:33:32.310 INFO:teuthology.orchestra.run.smithi063:> import stat 2020-05-18T21:33:32.310 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:32.311 INFO:teuthology.orchestra.run.smithi063:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkto_b").st_ino) 2020-05-18T21:33:32.311 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:33:32.431 INFO:teuthology.orchestra.run.smithi063.stdout:1099511627777 2020-05-18T21:33:32.632 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mv file_a file_b) 2020-05-18T21:33:32.676 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.832+0000 7ff815070700 1 Processor -- start 2020-05-18T21:33:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.832+0000 7ff815070700 1 -- start start 2020-05-18T21:33:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.832+0000 7ff815070700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810064fd0 0x7ff81014d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.832+0000 7ff815070700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff81014a330 con 0x7ff8100b4760 2020-05-18T21:33:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.832+0000 7ff815070700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff81014a5d0 con 0x7ff81005f110 2020-05-18T21:33:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.832+0000 7ff815070700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81014a140 con 0x7ff810064fd0 2020-05-18T21:33:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.832+0000 7ff80f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff8100b4760 0x7ff8100648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34512/0 (socket says 172.21.15.63:34512) 2020-05-18T21:33:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.832+0000 7ff80f7fe700 1 -- 172.21.15.63:0/2712386383 learned_addr learned my addr 172.21.15.63:0/2712386383 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.832+0000 7ff81486f700 1 --2- 172.21.15.63:0/2712386383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810064fd0 0x7ff81014d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.832+0000 7ff80effd700 1 -- 172.21.15.63:0/2712386383 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886378145 0 0) 0x7ff81014a330 con 0x7ff8100b4760 2020-05-18T21:33:32.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.832+0000 7ff80effd700 1 -- 172.21.15.63:0/2712386383 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7fc003270 con 0x7ff8100b4760 2020-05-18T21:33:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff80effd700 1 -- 172.21.15.63:0/2712386383 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2696383985 0 0) 0x7ff7fc003270 con 0x7ff8100b4760 2020-05-18T21:33:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff80effd700 1 -- 172.21.15.63:0/2712386383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810064fd0 msgr2=0x7ff81014d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff80effd700 1 --2- 172.21.15.63:0/2712386383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810064fd0 0x7ff81014d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:32.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff80effd700 1 -- 172.21.15.63:0/2712386383 >> v1:172.21.15.155:6789/0 conn(0x7ff81005f110 legacy=0x7ff81014aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:32.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff80effd700 1 -- 172.21.15.63:0/2712386383 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff810063430 con 0x7ff8100b4760 2020-05-18T21:33:32.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff80effd700 1 -- 172.21.15.63:0/2712386383 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7ff804001730 con 0x7ff8100b4760 2020-05-18T21:33:32.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff80effd700 1 -- 172.21.15.63:0/2712386383 >> v1:172.21.15.63:6789/0 conn(0x7ff8100b4760 legacy=0x7ff8100648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:32.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff80effd700 1 --2- 172.21.15.63:0/2712386383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7fc003790 0x7ff7fc003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff80effd700 1 --2- 172.21.15.63:0/2712386383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7fc0040d0 0x7ff7fc0045b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff80effd700 1 --2- 172.21.15.63:0/2712386383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810064fd0 0x7ff7fc004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff80effd700 1 -- 172.21.15.63:0/2712386383 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc004fc0 con 0x7ff7fc003790 2020-05-18T21:33:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff80effd700 1 -- 172.21.15.63:0/2712386383 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc005130 con 0x7ff7fc0040d0 2020-05-18T21:33:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff80effd700 1 -- 172.21.15.63:0/2712386383 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc0052f0 con 0x7ff810064fd0 2020-05-18T21:33:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff80ffff700 1 --2- 172.21.15.63:0/2712386383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7fc003790 0x7ff7fc003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff80f7fe700 1 --2- 172.21.15.63:0/2712386383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7fc0040d0 0x7ff7fc0045b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff81486f700 1 --2- 172.21.15.63:0/2712386383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810064fd0 0x7ff7fc004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff81486f700 1 -- 172.21.15.63:0/2712386383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7fc0040d0 msgr2=0x7ff7fc0045b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff81486f700 1 --2- 172.21.15.63:0/2712386383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7fc0040d0 0x7ff7fc0045b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff81486f700 1 -- 172.21.15.63:0/2712386383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7fc003790 msgr2=0x7ff7fc003bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff81486f700 1 --2- 172.21.15.63:0/2712386383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7fc003790 0x7ff7fc003bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff81486f700 1 -- 172.21.15.63:0/2712386383 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc003270 con 0x7ff810064fd0 2020-05-18T21:33:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff80ffff700 1 --2- 172.21.15.63:0/2712386383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7fc003790 0x7ff7fc003bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff81486f700 1 --2- 172.21.15.63:0/2712386383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810064fd0 0x7ff7fc004b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff8080032f0 tx=0x7ff8080103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff81486f700 1 --2- 172.21.15.63:0/2712386383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810064fd0 0x7ff7fc004b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff8080032f0 tx=0x7ff8080103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff81486f700 1 --2- 172.21.15.63:0/2712386383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810064fd0 0x7ff7fc004b40 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7ff8080032f0 tx=0x7ff8080103e0).ready entity=mon.2 client_cookie=e40b711cc63403ca server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff81486f700 1 --2- 172.21.15.63:0/2712386383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810064fd0 0x7ff7fc004b40 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7ff8080032f0 tx=0x7ff8080103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:32.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff80effd700 1 -- 172.21.15.63:0/2712386383 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8080112c0 con 0x7ff810064fd0 2020-05-18T21:33:32.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff81486f700 1 --2- 172.21.15.63:0/2712386383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810064fd0 0x7ff7fc004b40 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7ff8080032f0 tx=0x7ff8080103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:32.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff80effd700 1 -- 172.21.15.63:0/2712386383 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff808011420 con 0x7ff810064fd0 2020-05-18T21:33:32.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff81486f700 1 --2- 172.21.15.63:0/2712386383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810064fd0 0x7ff7fc004b40 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7ff8080032f0 tx=0x7ff8080103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:32.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff80effd700 1 -- 172.21.15.63:0/2712386383 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff808011780 con 0x7ff810064fd0 2020-05-18T21:33:32.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff815070700 1 -- 172.21.15.63:0/2712386383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810064fd0 msgr2=0x7ff7fc004b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:32.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff815070700 1 --2- 172.21.15.63:0/2712386383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810064fd0 0x7ff7fc004b40 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7ff8080032f0 tx=0x7ff8080103e0).stop 2020-05-18T21:33:32.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff81486f700 1 -- 172.21.15.63:0/2712386383 reap_dead start 2020-05-18T21:33:32.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff815070700 1 -- 172.21.15.63:0/2712386383 shutdown_connections 2020-05-18T21:33:32.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff815070700 1 -- 172.21.15.63:0/2712386383 >> 172.21.15.63:0/2712386383 conn(0x7ff810069fc0 msgr2=0x7ff81006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:32.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff815070700 1 -- 172.21.15.63:0/2712386383 shutdown_connections 2020-05-18T21:33:32.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.836+0000 7ff815070700 1 -- 172.21.15.63:0/2712386383 wait complete. 2020-05-18T21:33:32.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.840+0000 7ff815070700 1 Processor -- start 2020-05-18T21:33:32.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.840+0000 7ff815070700 1 -- start start 2020-05-18T21:33:32.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.840+0000 7ff815070700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810144f60 0x7ff810157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:32.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.840+0000 7ff815070700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff810158350 con 0x7ff81015ae50 2020-05-18T21:33:32.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.840+0000 7ff815070700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff810157510 con 0x7ff81014c200 2020-05-18T21:33:32.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.840+0000 7ff815070700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8101577b0 con 0x7ff810144f60 2020-05-18T21:33:32.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.840+0000 7ff80ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff81015ae50 0x7ff81015b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34524/0 (socket says 172.21.15.63:34524) 2020-05-18T21:33:32.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.840+0000 7ff80ffff700 1 -- 172.21.15.63:0/2328561331 learned_addr learned my addr 172.21.15.63:0/2328561331 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:32.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.840+0000 7ff80f7fe700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810144f60 0x7ff810157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:32.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.840+0000 7ff80d7fa700 1 -- 172.21.15.63:0/2328561331 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646778789 0 0) 0x7ff810158350 con 0x7ff81015ae50 2020-05-18T21:33:32.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.840+0000 7ff80d7fa700 1 -- 172.21.15.63:0/2328561331 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7f0002fe0 con 0x7ff81015ae50 2020-05-18T21:33:32.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.840+0000 7ff80d7fa700 1 -- 172.21.15.63:0/2328561331 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731020732 0 0) 0x7ff810157510 con 0x7ff81014c200 2020-05-18T21:33:32.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.840+0000 7ff80d7fa700 1 -- 172.21.15.63:0/2328561331 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff810158350 con 0x7ff81014c200 2020-05-18T21:33:32.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.840+0000 7ff80f7fe700 1 -- 172.21.15.63:0/2328561331 >> v1:172.21.15.155:6789/0 conn(0x7ff81014c200 legacy=0x7ff810146910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:32.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.840+0000 7ff80f7fe700 1 -- 172.21.15.63:0/2328561331 >> v1:172.21.15.63:6789/0 conn(0x7ff81015ae50 legacy=0x7ff81015b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:32.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.840+0000 7ff80f7fe700 1 -- 172.21.15.63:0/2328561331 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff810157a50 con 0x7ff810144f60 2020-05-18T21:33:32.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.840+0000 7ff80f7fe700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810144f60 0x7ff810157ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff804001440 tx=0x7ff8100635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:32.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.840+0000 7ff80f7fe700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810144f60 0x7ff810157ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff804001440 tx=0x7ff8100635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:32.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.844+0000 7ff80f7fe700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810144f60 0x7ff810157ef0 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7ff804001440 tx=0x7ff8100635c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:32.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.844+0000 7ff80f7fe700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810144f60 0x7ff810157ef0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7ff804001440 tx=0x7ff8100635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:32.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.844+0000 7ff80d7fa700 1 -- 172.21.15.63:0/2328561331 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff80400ccb0 con 0x7ff810144f60 2020-05-18T21:33:32.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.844+0000 7ff80f7fe700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810144f60 0x7ff810157ef0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7ff804001440 tx=0x7ff8100635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:32.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.844+0000 7ff80f7fe700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810144f60 0x7ff810157ef0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7ff804001440 tx=0x7ff8100635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:32.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.844+0000 7ff80d7fa700 1 -- 172.21.15.63:0/2328561331 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80400ce10 con 0x7ff810144f60 2020-05-18T21:33:32.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.844+0000 7ff815070700 1 -- 172.21.15.63:0/2328561331 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff81014c690 con 0x7ff810144f60 2020-05-18T21:33:32.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.844+0000 7ff80d7fa700 1 -- 172.21.15.63:0/2328561331 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff80400e360 con 0x7ff810144f60 2020-05-18T21:33:32.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.844+0000 7ff815070700 1 -- 172.21.15.63:0/2328561331 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff810147020 con 0x7ff810144f60 2020-05-18T21:33:32.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.844+0000 7ff80f7fe700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810144f60 0x7ff810157ef0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7ff804001440 tx=0x7ff8100635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:32.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.844+0000 7ff815070700 1 -- 172.21.15.63:0/2328561331 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff810157be0 con 0x7ff810144f60 2020-05-18T21:33:32.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.844+0000 7ff80d7fa700 1 -- 172.21.15.63:0/2328561331 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff80400e590 con 0x7ff810144f60 2020-05-18T21:33:32.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.844+0000 7ff80f7fe700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810144f60 0x7ff810157ef0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7ff804001440 tx=0x7ff8100635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:32.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.844+0000 7ff80d7fa700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff7f004fec0 0x7ff7f0052380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:32.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.844+0000 7ff80d7fa700 1 -- 172.21.15.63:0/2328561331 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff804063810 con 0x7ff810144f60 2020-05-18T21:33:32.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.848+0000 7ff80ffff700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff7f004fec0 0x7ff7f0052380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:32.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.848+0000 7ff80ffff700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff7f004fec0 0x7ff7f0052380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff810060350 tx=0x7ff800001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:32.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.848+0000 7ff80ffff700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff7f004fec0 0x7ff7f0052380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff810060350 tx=0x7ff800001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:32.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.848+0000 7ff80ffff700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff7f004fec0 0x7ff7f0052380 secure :-1 s=READY pgs=560 cs=0 l=1 rx=0x7ff810060350 tx=0x7ff800001e60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:32.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.856+0000 7ff80f7fe700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810144f60 0x7ff810157ef0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7ff804001440 tx=0x7ff8100635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:32.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:32.856+0000 7ff80d7fa700 1 -- 172.21.15.63:0/2328561331 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff80403db40 con 0x7ff810144f60 2020-05-18T21:33:33.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.008+0000 7ff815070700 1 -- 172.21.15.63:0/2328561331 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8100569e0 con 0x7ff810144f60 2020-05-18T21:33:33.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.008+0000 7ff80f7fe700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810144f60 0x7ff810157ef0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7ff804001440 tx=0x7ff8100635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.008+0000 7ff80d7fa700 1 -- 172.21.15.63:0/2328561331 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+2143 (secure 0 0 0) 0x7ff804041160 con 0x7ff810144f60 2020-05-18T21:33:33.015 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:33.015 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":81,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6113,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2300000397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2300000397},{"type":"v1","addr":"172.21.15.63:6833","nonce":2300000397}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":78}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:23.230529+0000","modified":"2020-05-18T21:33:24.934162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8059":{"gid":8059,"name":"b","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1291107650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1291107650},{"type":"v1","addr":"172.21.15.155:6835","nonce":1291107650}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-05-18T21:33:33.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.012+0000 7ff815070700 1 -- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff7f004fec0 msgr2=0x7ff7f0052380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:33.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.012+0000 7ff815070700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff7f004fec0 0x7ff7f0052380 secure :-1 s=READY pgs=560 cs=0 l=1 rx=0x7ff810060350 tx=0x7ff800001e60).stop 2020-05-18T21:33:33.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.012+0000 7ff815070700 1 -- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810144f60 msgr2=0x7ff810157ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:33.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.012+0000 7ff815070700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810144f60 0x7ff810157ef0 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7ff804001440 tx=0x7ff8100635c0).stop 2020-05-18T21:33:33.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.012+0000 7ff815070700 1 -- 172.21.15.63:0/2328561331 shutdown_connections 2020-05-18T21:33:33.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.012+0000 7ff815070700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff7f004fec0 0x7ff7f0052380 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:33.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.012+0000 7ff815070700 1 --2- 172.21.15.63:0/2328561331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff810144f60 0x7ff810157ef0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:33.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.012+0000 7ff815070700 1 -- 172.21.15.63:0/2328561331 >> 172.21.15.63:0/2328561331 conn(0x7ff810069fc0 msgr2=0x7ff810060c90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:33.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.012+0000 7ff815070700 1 -- 172.21.15.63:0/2328561331 shutdown_connections 2020-05-18T21:33:33.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.012+0000 7ff815070700 1 -- 172.21.15.63:0/2328561331 wait complete. 2020-05-18T21:33:33.022 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 81 2020-05-18T21:33:33.032 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump mds_cache num_strays 2020-05-18T21:33:33.136 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:33:33.137 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:33:33.137 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 0 2020-05-18T21:33:33.137 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:33:33.138 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:33:33.146 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "num_strays": 0 } } 2020-05-18T21:33:33.147 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:33.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.252+0000 7f68e0f31700 1 Processor -- start 2020-05-18T21:33:33.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.252+0000 7f68e0f31700 1 -- start start 2020-05-18T21:33:33.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.252+0000 7f68e0f31700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc149cc0 0x7f68dc145d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:33.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.252+0000 7f68e0f31700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68dc061140 con 0x7f68dc0b5860 2020-05-18T21:33:33.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.252+0000 7f68e0f31700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68dc0613e0 con 0x7f68dc09c9f0 2020-05-18T21:33:33.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.252+0000 7f68e0f31700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc062230 con 0x7f68dc149cc0 2020-05-18T21:33:33.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.252+0000 7f68db7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f68dc0b5860 0x7f68dc061b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34532/0 (socket says 172.21.15.63:34532) 2020-05-18T21:33:33.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.252+0000 7f68db7fe700 1 -- 172.21.15.63:0/990197865 learned_addr learned my addr 172.21.15.63:0/990197865 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:33.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68dbfff700 1 --2- 172.21.15.63:0/990197865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc149cc0 0x7f68dc145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:33.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68da7fc700 1 -- 172.21.15.63:0/990197865 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872787371 0 0) 0x7f68dc061140 con 0x7f68dc0b5860 2020-05-18T21:33:33.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68da7fc700 1 -- 172.21.15.63:0/990197865 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68c8003270 con 0x7f68dc0b5860 2020-05-18T21:33:33.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68da7fc700 1 -- 172.21.15.63:0/990197865 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152589904 0 0) 0x7f68dc0613e0 con 0x7f68dc09c9f0 2020-05-18T21:33:33.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68da7fc700 1 -- 172.21.15.63:0/990197865 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68dc061140 con 0x7f68dc09c9f0 2020-05-18T21:33:33.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68dbfff700 1 -- 172.21.15.63:0/990197865 >> v1:172.21.15.155:6789/0 conn(0x7f68dc09c9f0 legacy=0x7f68dc09e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:33.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68da7fc700 1 -- 172.21.15.63:0/990197865 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1124576161 0 0) 0x7f68c8003270 con 0x7f68dc0b5860 2020-05-18T21:33:33.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68dbfff700 1 -- 172.21.15.63:0/990197865 >> v1:172.21.15.63:6789/0 conn(0x7f68dc0b5860 legacy=0x7f68dc061b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:33.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68dbfff700 1 -- 172.21.15.63:0/990197865 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc061680 con 0x7f68dc149cc0 2020-05-18T21:33:33.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68dbfff700 1 --2- 172.21.15.63:0/990197865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc149cc0 0x7f68dc145d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f68d0001110 tx=0x7f68d4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68dbfff700 1 --2- 172.21.15.63:0/990197865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc149cc0 0x7f68dc145d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f68d0001110 tx=0x7f68d4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68dbfff700 1 --2- 172.21.15.63:0/990197865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc149cc0 0x7f68dc145d30 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7f68d0001110 tx=0x7f68d4008ca0).ready entity=mon.2 client_cookie=d7278b846dd68efc server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:33.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68dbfff700 1 --2- 172.21.15.63:0/990197865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc149cc0 0x7f68dc145d30 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f68d0001110 tx=0x7f68d4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68da7fc700 1 -- 172.21.15.63:0/990197865 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68d0001710 con 0x7f68dc149cc0 2020-05-18T21:33:33.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68dbfff700 1 --2- 172.21.15.63:0/990197865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc149cc0 0x7f68dc145d30 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f68d0001110 tx=0x7f68d4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68da7fc700 1 -- 172.21.15.63:0/990197865 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d4011ac0 con 0x7f68dc149cc0 2020-05-18T21:33:33.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68dbfff700 1 --2- 172.21.15.63:0/990197865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc149cc0 0x7f68dc145d30 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f68d0001110 tx=0x7f68d4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68da7fc700 1 -- 172.21.15.63:0/990197865 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68d4011e20 con 0x7f68dc149cc0 2020-05-18T21:33:33.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68e0f31700 1 -- 172.21.15.63:0/990197865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc149cc0 msgr2=0x7f68dc145d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:33.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68e0f31700 1 --2- 172.21.15.63:0/990197865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc149cc0 0x7f68dc145d30 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7f68d0001110 tx=0x7f68d4008ca0).stop 2020-05-18T21:33:33.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68e0f31700 1 -- 172.21.15.63:0/990197865 shutdown_connections 2020-05-18T21:33:33.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68e0f31700 1 --2- 172.21.15.63:0/990197865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc149cc0 0x7f68dc145d30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:33.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68e0f31700 1 -- 172.21.15.63:0/990197865 >> 172.21.15.63:0/990197865 conn(0x7f68dc05a7c0 msgr2=0x7f68dc05aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:33.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68e0f31700 1 -- 172.21.15.63:0/990197865 shutdown_connections 2020-05-18T21:33:33.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.256+0000 7f68e0f31700 1 -- 172.21.15.63:0/990197865 wait complete. 2020-05-18T21:33:33.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.260+0000 7f68e0f31700 1 Processor -- start 2020-05-18T21:33:33.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.260+0000 7f68e0f31700 1 -- start start 2020-05-18T21:33:33.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.260+0000 7f68e0f31700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc09c9f0 0x7f68dc1425c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:33.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.260+0000 7f68e0f31700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f68dc0b5860 0x7f68dc0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:33.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.260+0000 7f68e0f31700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68dc0b3530 con 0x7f68dc149cc0 2020-05-18T21:33:33.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.260+0000 7f68e0f31700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68dc064c00 con 0x7f68dc0b5860 2020-05-18T21:33:33.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.260+0000 7f68e0f31700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc064ea0 con 0x7f68dc09c9f0 2020-05-18T21:33:33.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.260+0000 7f68dbfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f68dc149cc0 0x7f68dc1412a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34540/0 (socket says 172.21.15.63:34540) 2020-05-18T21:33:33.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.260+0000 7f68dbfff700 1 -- 172.21.15.63:0/1091996459 learned_addr learned my addr 172.21.15.63:0/1091996459 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:33.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.260+0000 7f68daffd700 1 --2- 172.21.15.63:0/1091996459 >> v2:172.21.15.63:3300/0 conn(0x7f68dc0b5860 0x7f68dc0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:33.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.260+0000 7f68db7fe700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc09c9f0 0x7f68dc1425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:33.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.260+0000 7f68d8ff9700 1 -- 172.21.15.63:0/1091996459 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1729338242 0 0) 0x7f68dc0b3530 con 0x7f68dc149cc0 2020-05-18T21:33:33.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.260+0000 7f68d8ff9700 1 -- 172.21.15.63:0/1091996459 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68bc002fe0 con 0x7f68dc149cc0 2020-05-18T21:33:33.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.260+0000 7f68db7fe700 1 -- 172.21.15.63:0/1091996459 >> v2:172.21.15.63:3300/0 conn(0x7f68dc0b5860 msgr2=0x7f68dc0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:33.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.260+0000 7f68db7fe700 1 --2- 172.21.15.63:0/1091996459 >> v2:172.21.15.63:3300/0 conn(0x7f68dc0b5860 0x7f68dc0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:33.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.260+0000 7f68db7fe700 1 -- 172.21.15.63:0/1091996459 >> v1:172.21.15.63:6789/0 conn(0x7f68dc149cc0 legacy=0x7f68dc1412a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:33.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.260+0000 7f68db7fe700 1 -- 172.21.15.63:0/1091996459 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc065180 con 0x7f68dc09c9f0 2020-05-18T21:33:33.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.260+0000 7f68db7fe700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc09c9f0 0x7f68dc1425c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f68d0000fe0 tx=0x7f68d0010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.264+0000 7f68db7fe700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc09c9f0 0x7f68dc1425c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f68d0000fe0 tx=0x7f68d0010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.264+0000 7f68db7fe700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc09c9f0 0x7f68dc1425c0 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f68d0000fe0 tx=0x7f68d0010cb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:33.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.264+0000 7f68db7fe700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc09c9f0 0x7f68dc1425c0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f68d0000fe0 tx=0x7f68d0010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.264+0000 7f68d8ff9700 1 -- 172.21.15.63:0/1091996459 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68d000c990 con 0x7f68dc09c9f0 2020-05-18T21:33:33.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.264+0000 7f68db7fe700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc09c9f0 0x7f68dc1425c0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f68d0000fe0 tx=0x7f68d0010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.264+0000 7f68db7fe700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc09c9f0 0x7f68dc1425c0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f68d0000fe0 tx=0x7f68d0010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.264+0000 7f68d8ff9700 1 -- 172.21.15.63:0/1091996459 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d000caf0 con 0x7f68dc09c9f0 2020-05-18T21:33:33.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.264+0000 7f68e0f31700 1 -- 172.21.15.63:0/1091996459 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68dc141f10 con 0x7f68dc09c9f0 2020-05-18T21:33:33.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.264+0000 7f68d8ff9700 1 -- 172.21.15.63:0/1091996459 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68d000ce90 con 0x7f68dc09c9f0 2020-05-18T21:33:33.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.264+0000 7f68e0f31700 1 -- 172.21.15.63:0/1091996459 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68dc064790 con 0x7f68dc09c9f0 2020-05-18T21:33:33.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.264+0000 7f68e0f31700 1 -- 172.21.15.63:0/1091996459 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68dc0569e0 con 0x7f68dc09c9f0 2020-05-18T21:33:33.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.264+0000 7f68db7fe700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc09c9f0 0x7f68dc1425c0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f68d0000fe0 tx=0x7f68d0010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.264+0000 7f68d8ff9700 1 -- 172.21.15.63:0/1091996459 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f68d0013070 con 0x7f68dc09c9f0 2020-05-18T21:33:33.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.264+0000 7f68db7fe700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc09c9f0 0x7f68dc1425c0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f68d0000fe0 tx=0x7f68d0010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.264+0000 7f68d8ff9700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f68bc04fd80 0x7f68bc052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:33.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.264+0000 7f68d8ff9700 1 -- 172.21.15.63:0/1091996459 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f68d0063960 con 0x7f68dc09c9f0 2020-05-18T21:33:33.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.268+0000 7f68daffd700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f68bc04fd80 0x7f68bc052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:33.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.268+0000 7f68daffd700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f68bc04fd80 0x7f68bc052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f68cc001110 tx=0x7f68cc003b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.268+0000 7f68daffd700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f68bc04fd80 0x7f68bc052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f68cc001110 tx=0x7f68cc003b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.268+0000 7f68daffd700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f68bc04fd80 0x7f68bc052240 secure :-1 s=READY pgs=561 cs=0 l=1 rx=0x7f68cc001110 tx=0x7f68cc003b50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:33.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.276+0000 7f68db7fe700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc09c9f0 0x7f68dc1425c0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f68d0000fe0 tx=0x7f68d0010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.276+0000 7f68d8ff9700 1 -- 172.21.15.63:0/1091996459 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f68d003dc90 con 0x7f68dc09c9f0 2020-05-18T21:33:33.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.428+0000 7f68e0f31700 1 -- 172.21.15.63:0/1091996459 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68dc065310 con 0x7f68dc09c9f0 2020-05-18T21:33:33.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.428+0000 7f68db7fe700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc09c9f0 0x7f68dc1425c0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f68d0000fe0 tx=0x7f68d0010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.428+0000 7f68d8ff9700 1 -- 172.21.15.63:0/1091996459 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f68d00412b0 con 0x7f68dc09c9f0 2020-05-18T21:33:33.436 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:33.437 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":81,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6113,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2300000397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2300000397},{"type":"v1","addr":"172.21.15.63:6833","nonce":2300000397}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":78}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:23.230529+0000","modified":"2020-05-18T21:33:24.934162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8059":{"gid":8059,"name":"b","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1291107650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1291107650},{"type":"v1","addr":"172.21.15.155:6835","nonce":1291107650}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-05-18T21:33:33.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.432+0000 7f68e0f31700 1 -- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f68bc04fd80 msgr2=0x7f68bc052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:33.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.432+0000 7f68e0f31700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f68bc04fd80 0x7f68bc052240 secure :-1 s=READY pgs=561 cs=0 l=1 rx=0x7f68cc001110 tx=0x7f68cc003b50).stop 2020-05-18T21:33:33.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.432+0000 7f68e0f31700 1 -- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc09c9f0 msgr2=0x7f68dc1425c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:33.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.432+0000 7f68e0f31700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc09c9f0 0x7f68dc1425c0 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f68d0000fe0 tx=0x7f68d0010cb0).stop 2020-05-18T21:33:33.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.432+0000 7f68e0f31700 1 -- 172.21.15.63:0/1091996459 shutdown_connections 2020-05-18T21:33:33.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.432+0000 7f68e0f31700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f68bc04fd80 0x7f68bc052240 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:33.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.432+0000 7f68e0f31700 1 --2- 172.21.15.63:0/1091996459 >> v2:172.21.15.63:3300/0 conn(0x7f68dc0b5860 0x7f68dc0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:33.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.432+0000 7f68e0f31700 1 --2- 172.21.15.63:0/1091996459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68dc09c9f0 0x7f68dc1425c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:33.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.432+0000 7f68e0f31700 1 -- 172.21.15.63:0/1091996459 >> 172.21.15.63:0/1091996459 conn(0x7f68dc05a7c0 msgr2=0x7f68dc05c260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:33.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.432+0000 7f68e0f31700 1 -- 172.21.15.63:0/1091996459 shutdown_connections 2020-05-18T21:33:33.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.432+0000 7f68e0f31700 1 -- 172.21.15.63:0/1091996459 wait complete. 2020-05-18T21:33:33.442 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 81 2020-05-18T21:33:33.449 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump mds_cache strays_created 2020-05-18T21:33:33.555 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:33:33.555 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:33:33.556 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 1 2020-05-18T21:33:33.556 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:33:33.556 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:33:33.564 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_created": 1 } } 2020-05-18T21:33:33.565 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:33.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.664+0000 7fcc15fcd700 1 Processor -- start 2020-05-18T21:33:33.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.664+0000 7fcc15fcd700 1 -- start start 2020-05-18T21:33:33.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc15fcd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc10060b90 0x7fcc100615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:33.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc15fcd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcc100b2860 0x7fcc1014e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:33.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc15fcd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcc10144090 0x7fcc101444e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:33.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc15fcd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc10144940 con 0x7fcc100b2860 2020-05-18T21:33:33.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc15fcd700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc10066210 con 0x7fcc10144090 2020-05-18T21:33:33.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc15fcd700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1014d960 con 0x7fcc10060b90 2020-05-18T21:33:33.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcc100b2860 0x7fcc1014e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:33.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcc100b2860 0x7fcc1014e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60590/0 (socket says 172.21.15.63:60590) 2020-05-18T21:33:33.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0effd700 1 -- 172.21.15.63:0/3959035080 learned_addr learned my addr 172.21.15.63:0/3959035080 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:33.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0ffff700 1 --2- 172.21.15.63:0/3959035080 >> v2:172.21.15.155:3300/0 conn(0x7fcc10144090 0x7fcc101444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:33.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0f7fe700 1 --2- 172.21.15.63:0/3959035080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc10060b90 0x7fcc100615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:33.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0effd700 1 -- 172.21.15.63:0/3959035080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc10060b90 msgr2=0x7fcc100615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:33.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0effd700 1 --2- 172.21.15.63:0/3959035080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc10060b90 0x7fcc100615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:33.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0effd700 1 -- 172.21.15.63:0/3959035080 >> v2:172.21.15.155:3300/0 conn(0x7fcc10144090 msgr2=0x7fcc101444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:33.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0effd700 1 --2- 172.21.15.63:0/3959035080 >> v2:172.21.15.155:3300/0 conn(0x7fcc10144090 0x7fcc101444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:33.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0effd700 1 -- 172.21.15.63:0/3959035080 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1014db90 con 0x7fcc100b2860 2020-05-18T21:33:33.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0ffff700 1 --2- 172.21.15.63:0/3959035080 >> v2:172.21.15.155:3300/0 conn(0x7fcc10144090 0x7fcc101444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:33:33.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0f7fe700 1 --2- 172.21.15.63:0/3959035080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc10060b90 0x7fcc100615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:33:33.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0effd700 1 --2- 172.21.15.63:0/3959035080 >> v2:172.21.15.63:3300/0 conn(0x7fcc100b2860 0x7fcc1014e570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcc100b92c0 tx=0x7fcc00008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0effd700 1 --2- 172.21.15.63:0/3959035080 >> v2:172.21.15.63:3300/0 conn(0x7fcc100b2860 0x7fcc1014e570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcc100b92c0 tx=0x7fcc00008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0effd700 1 --2- 172.21.15.63:0/3959035080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc100b2860 0x7fcc1014e570 secure :-1 s=READY pgs=1436 cs=0 l=1 rx=0x7fcc100b92c0 tx=0x7fcc00008920).ready entity=mon.0 client_cookie=bc10c73d72d0de60 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:33.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0effd700 1 --2- 172.21.15.63:0/3959035080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc100b2860 0x7fcc1014e570 secure :-1 s=THROTTLE_DONE pgs=1436 cs=0 l=1 rx=0x7fcc100b92c0 tx=0x7fcc00008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0e7fc700 1 -- 172.21.15.63:0/3959035080 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc00008e60 con 0x7fcc100b2860 2020-05-18T21:33:33.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0effd700 1 --2- 172.21.15.63:0/3959035080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc100b2860 0x7fcc1014e570 secure :-1 s=THROTTLE_DONE pgs=1436 cs=0 l=1 rx=0x7fcc100b92c0 tx=0x7fcc00008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0e7fc700 1 -- 172.21.15.63:0/3959035080 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc00011910 con 0x7fcc100b2860 2020-05-18T21:33:33.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0effd700 1 --2- 172.21.15.63:0/3959035080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc100b2860 0x7fcc1014e570 secure :-1 s=THROTTLE_DONE pgs=1436 cs=0 l=1 rx=0x7fcc100b92c0 tx=0x7fcc00008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc0e7fc700 1 -- 172.21.15.63:0/3959035080 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc00011cf0 con 0x7fcc100b2860 2020-05-18T21:33:33.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc15fcd700 1 -- 172.21.15.63:0/3959035080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc100b2860 msgr2=0x7fcc1014e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:33.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc15fcd700 1 --2- 172.21.15.63:0/3959035080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc100b2860 0x7fcc1014e570 secure :-1 s=READY pgs=1436 cs=0 l=1 rx=0x7fcc100b92c0 tx=0x7fcc00008920).stop 2020-05-18T21:33:33.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc15fcd700 1 -- 172.21.15.63:0/3959035080 shutdown_connections 2020-05-18T21:33:33.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc15fcd700 1 --2- 172.21.15.63:0/3959035080 >> v2:172.21.15.155:3300/0 conn(0x7fcc10144090 0x7fcc101444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:33.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc15fcd700 1 --2- 172.21.15.63:0/3959035080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc100b2860 0x7fcc1014e570 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:33.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc15fcd700 1 --2- 172.21.15.63:0/3959035080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc10060b90 0x7fcc100615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:33.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc15fcd700 1 -- 172.21.15.63:0/3959035080 >> 172.21.15.63:0/3959035080 conn(0x7fcc100b83d0 msgr2=0x7fcc100b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:33.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc15fcd700 1 -- 172.21.15.63:0/3959035080 shutdown_connections 2020-05-18T21:33:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.668+0000 7fcc15fcd700 1 -- 172.21.15.63:0/3959035080 wait complete. 2020-05-18T21:33:33.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.672+0000 7fcc15fcd700 1 Processor -- start 2020-05-18T21:33:33.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.672+0000 7fcc15fcd700 1 -- start start 2020-05-18T21:33:33.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.672+0000 7fcc15fcd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcc100b2860 0x7fcc100aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:33.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.672+0000 7fcc15fcd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc100af500 con 0x7fcc10144090 2020-05-18T21:33:33.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.672+0000 7fcc15fcd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc10142e00 con 0x7fcc10060b90 2020-05-18T21:33:33.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.672+0000 7fcc15fcd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc101430a0 con 0x7fcc100b2860 2020-05-18T21:33:33.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.672+0000 7fcc0effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcc100b2860 0x7fcc100aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:33.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.672+0000 7fcc0effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcc100b2860 0x7fcc100aec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60598/0 (socket says 172.21.15.63:60598) 2020-05-18T21:33:33.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.672+0000 7fcc0effd700 1 -- 172.21.15.63:0/3492591478 learned_addr learned my addr 172.21.15.63:0/3492591478 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:33.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.676+0000 7fcc0effd700 1 -- 172.21.15.63:0/3492591478 >> v1:172.21.15.155:6789/0 conn(0x7fcc10060b90 legacy=0x7fcc101405a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:33.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.676+0000 7fcc0effd700 1 -- 172.21.15.63:0/3492591478 >> v1:172.21.15.63:6789/0 conn(0x7fcc10144090 legacy=0x7fcc100b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:33.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.676+0000 7fcc0effd700 1 -- 172.21.15.63:0/3492591478 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc101588a0 con 0x7fcc100b2860 2020-05-18T21:33:33.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.676+0000 7fcc0cff9700 1 -- 172.21.15.63:0/3492591478 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557205192 0 0) 0x7fcc100af500 con 0x7fcc10144090 2020-05-18T21:33:33.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.676+0000 7fcc0effd700 1 --2- 172.21.15.63:0/3492591478 >> v2:172.21.15.63:3300/0 conn(0x7fcc100b2860 0x7fcc100aec60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcc100b92c0 tx=0x7fcc1005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.676+0000 7fcc0effd700 1 --2- 172.21.15.63:0/3492591478 >> v2:172.21.15.63:3300/0 conn(0x7fcc100b2860 0x7fcc100aec60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcc100b92c0 tx=0x7fcc1005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.676+0000 7fcc0effd700 1 --2- 172.21.15.63:0/3492591478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc100b2860 0x7fcc100aec60 secure :-1 s=READY pgs=1438 cs=0 l=1 rx=0x7fcc100b92c0 tx=0x7fcc1005fa60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:33.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.676+0000 7fcc0effd700 1 --2- 172.21.15.63:0/3492591478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc100b2860 0x7fcc100aec60 secure :-1 s=THROTTLE_DONE pgs=1438 cs=0 l=1 rx=0x7fcc100b92c0 tx=0x7fcc1005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.676+0000 7fcc0cff9700 1 -- 172.21.15.63:0/3492591478 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc00011df0 con 0x7fcc100b2860 2020-05-18T21:33:33.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.676+0000 7fcc0effd700 1 --2- 172.21.15.63:0/3492591478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc100b2860 0x7fcc100aec60 secure :-1 s=THROTTLE_DONE pgs=1438 cs=0 l=1 rx=0x7fcc100b92c0 tx=0x7fcc1005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.676+0000 7fcc0cff9700 1 -- 172.21.15.63:0/3492591478 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc00007360 con 0x7fcc100b2860 2020-05-18T21:33:33.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.676+0000 7fcc0effd700 1 --2- 172.21.15.63:0/3492591478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc100b2860 0x7fcc100aec60 secure :-1 s=THROTTLE_DONE pgs=1438 cs=0 l=1 rx=0x7fcc100b92c0 tx=0x7fcc1005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.676+0000 7fcc0cff9700 1 -- 172.21.15.63:0/3492591478 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc000074d0 con 0x7fcc100b2860 2020-05-18T21:33:33.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.676+0000 7fcc15fcd700 1 -- 172.21.15.63:0/3492591478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc10140cb0 con 0x7fcc100b2860 2020-05-18T21:33:33.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.676+0000 7fcc15fcd700 1 -- 172.21.15.63:0/3492591478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc10158370 con 0x7fcc100b2860 2020-05-18T21:33:33.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.676+0000 7fcc0effd700 1 --2- 172.21.15.63:0/3492591478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc100b2860 0x7fcc100aec60 secure :-1 s=THROTTLE_DONE pgs=1438 cs=0 l=1 rx=0x7fcc100b92c0 tx=0x7fcc1005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.676+0000 7fcc15fcd700 1 -- 172.21.15.63:0/3492591478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc100569e0 con 0x7fcc100b2860 2020-05-18T21:33:33.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.676+0000 7fcc0cff9700 1 -- 172.21.15.63:0/3492591478 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fcc000058f0 con 0x7fcc100b2860 2020-05-18T21:33:33.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.676+0000 7fcc0effd700 1 --2- 172.21.15.63:0/3492591478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc100b2860 0x7fcc100aec60 secure :-1 s=THROTTLE_DONE pgs=1438 cs=0 l=1 rx=0x7fcc100b92c0 tx=0x7fcc1005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.680+0000 7fcc0cff9700 1 --2- 172.21.15.63:0/3492591478 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcbf004f810 0x7fcbf0051cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:33.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.680+0000 7fcc0cff9700 1 -- 172.21.15.63:0/3492591478 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcc00064650 con 0x7fcc100b2860 2020-05-18T21:33:33.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.680+0000 7fcc0f7fe700 1 --2- 172.21.15.63:0/3492591478 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcbf004f810 0x7fcbf0051cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:33.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.680+0000 7fcc0f7fe700 1 --2- 172.21.15.63:0/3492591478 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcbf004f810 0x7fcbf0051cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcc10141fd0 tx=0x7fcc04001210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.680+0000 7fcc0f7fe700 1 --2- 172.21.15.63:0/3492591478 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcbf004f810 0x7fcbf0051cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcc10141fd0 tx=0x7fcc04001210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.680+0000 7fcc0f7fe700 1 --2- 172.21.15.63:0/3492591478 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcbf004f810 0x7fcbf0051cd0 secure :-1 s=READY pgs=562 cs=0 l=1 rx=0x7fcc10141fd0 tx=0x7fcc04001210).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:33.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.688+0000 7fcc0effd700 1 --2- 172.21.15.63:0/3492591478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc100b2860 0x7fcc100aec60 secure :-1 s=THROTTLE_DONE pgs=1438 cs=0 l=1 rx=0x7fcc100b92c0 tx=0x7fcc1005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.688+0000 7fcc0cff9700 1 -- 172.21.15.63:0/3492591478 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fcc0003eaa0 con 0x7fcc100b2860 2020-05-18T21:33:33.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.840+0000 7fcc15fcd700 1 -- 172.21.15.63:0/3492591478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc10140e40 con 0x7fcc100b2860 2020-05-18T21:33:33.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.840+0000 7fcc0effd700 1 --2- 172.21.15.63:0/3492591478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc100b2860 0x7fcc100aec60 secure :-1 s=THROTTLE_DONE pgs=1438 cs=0 l=1 rx=0x7fcc100b92c0 tx=0x7fcc1005fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:33.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.840+0000 7fcc0cff9700 1 -- 172.21.15.63:0/3492591478 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+2143 (secure 0 0 0) 0x7fcc000420c0 con 0x7fcc100b2860 2020-05-18T21:33:33.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.840+0000 7fcc15fcd700 1 -- 172.21.15.63:0/3492591478 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcbf004f810 msgr2=0x7fcbf0051cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:33.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.840+0000 7fcc15fcd700 1 --2- 172.21.15.63:0/3492591478 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcbf004f810 0x7fcbf0051cd0 secure :-1 s=READY pgs=562 cs=0 l=1 rx=0x7fcc10141fd0 tx=0x7fcc04001210).stop 2020-05-18T21:33:33.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.840+0000 7fcc15fcd700 1 -- 172.21.15.63:0/3492591478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc100b2860 msgr2=0x7fcc100aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:33.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.840+0000 7fcc15fcd700 1 --2- 172.21.15.63:0/3492591478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc100b2860 0x7fcc100aec60 secure :-1 s=READY pgs=1438 cs=0 l=1 rx=0x7fcc100b92c0 tx=0x7fcc1005fa60).stop 2020-05-18T21:33:33.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.840+0000 7fcc15fcd700 1 -- 172.21.15.63:0/3492591478 shutdown_connections 2020-05-18T21:33:33.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.840+0000 7fcc15fcd700 1 --2- 172.21.15.63:0/3492591478 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcbf004f810 0x7fcbf0051cd0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:33.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.840+0000 7fcc15fcd700 1 --2- 172.21.15.63:0/3492591478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc100b2860 0x7fcc100aec60 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:33.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.840+0000 7fcc15fcd700 1 -- 172.21.15.63:0/3492591478 >> 172.21.15.63:0/3492591478 conn(0x7fcc100b83d0 msgr2=0x7fcc10143600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:33.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.840+0000 7fcc15fcd700 1 -- 172.21.15.63:0/3492591478 shutdown_connections 2020-05-18T21:33:33.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:33.840+0000 7fcc15fcd700 1 -- 172.21.15.63:0/3492591478 wait complete. 2020-05-18T21:33:33.854 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 81 2020-05-18T21:33:33.855 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:33.855 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":81,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6113,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2300000397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2300000397},{"type":"v1","addr":"172.21.15.63:6833","nonce":2300000397}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":78}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:23.230529+0000","modified":"2020-05-18T21:33:24.934162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8059":{"gid":8059,"name":"b","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1291107650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1291107650},{"type":"v1","addr":"172.21.15.155:6835","nonce":1291107650}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-05-18T21:33:33.859 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump mds_cache strays_reintegrated 2020-05-18T21:33:33.967 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:33:33.967 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:33:33.967 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 1 2020-05-18T21:33:33.967 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:33:33.968 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:33:33.976 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_reintegrated": 1 } } 2020-05-18T21:33:33.977 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_data ls 2020-05-18T21:33:34.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.004+0000 7fcef49f9b80 1 Processor -- start 2020-05-18T21:33:34.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.004+0000 7fcef49f9b80 1 -- start start 2020-05-18T21:33:34.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.004+0000 7fcef49f9b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x55a877bb6c40 0x55a877bb8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:34.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.004+0000 7fcef49f9b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55a877c47680 0x55a877bb8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:34.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.004+0000 7fcef49f9b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55a877b174b0 con 0x55a877c43700 2020-05-18T21:33:34.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef49f9b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a877b03110 con 0x55a877c47680 2020-05-18T21:33:34.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef49f9b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a877af3a40 con 0x55a877bb6c40 2020-05-18T21:33:34.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef2e3c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x55a877bb6c40 0x55a877bb8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef2e3c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x55a877bb6c40 0x55a877bb8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:47224/0 (socket says 172.21.15.63:47224) 2020-05-18T21:33:34.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef2e3c700 1 -- 172.21.15.63:0/2859549674 learned_addr learned my addr 172.21.15.63:0/2859549674 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:34.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef363d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55a877c47680 0x55a877bb8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef0e38700 1 -- 172.21.15.63:0/2859549674 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161704469 0 0) 0x55a877b174b0 con 0x55a877c43700 2020-05-18T21:33:34.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef0e38700 1 -- 172.21.15.63:0/2859549674 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fced4002020 con 0x55a877c43700 2020-05-18T21:33:34.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef2e3c700 1 -- 172.21.15.63:0/2859549674 >> v2:172.21.15.63:3300/0 conn(0x55a877c47680 msgr2=0x55a877bb8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:34.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/2859549674 >> v2:172.21.15.63:3300/0 conn(0x55a877c47680 0x55a877bb8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:34.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef2e3c700 1 -- 172.21.15.63:0/2859549674 >> v1:172.21.15.63:6789/0 conn(0x55a877c43700 legacy=0x55a877c46b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef2e3c700 1 -- 172.21.15.63:0/2859549674 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a877af7460 con 0x55a877bb6c40 2020-05-18T21:33:34.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/2859549674 >> v2:172.21.15.155:3300/0 conn(0x55a877bb6c40 0x55a877bb8a00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x55a877b9dc90 tx=0x7fcedc00e8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/2859549674 >> v2:172.21.15.155:3300/0 conn(0x55a877bb6c40 0x55a877bb8a00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x55a877b9dc90 tx=0x7fcedc00e8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/2859549674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a877bb6c40 0x55a877bb8a00 secure :-1 s=READY pgs=968 cs=0 l=1 rx=0x55a877b9dc90 tx=0x7fcedc00e8d0).ready entity=mon.1 client_cookie=1c47d4f4eebd4c7b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/2859549674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a877bb6c40 0x55a877bb8a00 secure :-1 s=THROTTLE_DONE pgs=968 cs=0 l=1 rx=0x55a877b9dc90 tx=0x7fcedc00e8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef0e38700 1 -- 172.21.15.63:0/2859549674 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcedc00f4f0 con 0x55a877bb6c40 2020-05-18T21:33:34.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/2859549674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a877bb6c40 0x55a877bb8a00 secure :-1 s=THROTTLE_DONE pgs=968 cs=0 l=1 rx=0x55a877b9dc90 tx=0x7fcedc00e8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/2859549674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a877bb6c40 0x55a877bb8a00 secure :-1 s=THROTTLE_DONE pgs=968 cs=0 l=1 rx=0x55a877b9dc90 tx=0x7fcedc00e8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef0e38700 1 -- 172.21.15.63:0/2859549674 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc00f650 con 0x55a877bb6c40 2020-05-18T21:33:34.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef0e38700 1 -- 172.21.15.63:0/2859549674 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcedc00fa30 con 0x55a877bb6c40 2020-05-18T21:33:34.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef49f9b80 1 -- 172.21.15.63:0/2859549674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a877bb6c40 msgr2=0x55a877bb8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef49f9b80 1 --2- 172.21.15.63:0/2859549674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a877bb6c40 0x55a877bb8a00 secure :-1 s=READY pgs=968 cs=0 l=1 rx=0x55a877b9dc90 tx=0x7fcedc00e8d0).stop 2020-05-18T21:33:34.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef49f9b80 1 -- 172.21.15.63:0/2859549674 shutdown_connections 2020-05-18T21:33:34.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef49f9b80 1 --2- 172.21.15.63:0/2859549674 >> v2:172.21.15.63:3300/0 conn(0x55a877c47680 0x55a877bb8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:34.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef49f9b80 1 --2- 172.21.15.63:0/2859549674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a877bb6c40 0x55a877bb8a00 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef49f9b80 1 -- 172.21.15.63:0/2859549674 >> 172.21.15.63:0/2859549674 conn(0x55a877bba850 msgr2=0x55a877b9f760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:34.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef49f9b80 1 -- 172.21.15.63:0/2859549674 shutdown_connections 2020-05-18T21:33:34.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.008+0000 7fcef49f9b80 1 -- 172.21.15.63:0/2859549674 wait complete. 2020-05-18T21:33:34.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fcef49f9b80 1 Processor -- start 2020-05-18T21:33:34.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fcef49f9b80 1 -- start start 2020-05-18T21:33:34.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fcef49f9b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x55a877bb6c40 0x55a877c28e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fcef49f9b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a877c43700 0x55a877c3eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fcef49f9b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55a877c296f0 con 0x55a877c47680 2020-05-18T21:33:34.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fcef49f9b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a877c292e0 con 0x55a877bb6c40 2020-05-18T21:33:34.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fcef49f9b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a877b9fe70 con 0x55a877c43700 2020-05-18T21:33:34.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fcef363d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x55a877c47680 0x55a877b9f760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34574/0 (socket says 172.21.15.63:34574) 2020-05-18T21:33:34.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fcef363d700 1 -- 172.21.15.63:0/3052416938 learned_addr learned my addr 172.21.15.63:0/3052416938 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:34.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fcef263b700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a877c43700 0x55a877c3eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/3052416938 >> v2:172.21.15.155:3300/0 conn(0x55a877bb6c40 0x55a877c28e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fceebfff700 1 -- 172.21.15.63:0/3052416938 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232939180 0 0) 0x55a877c296f0 con 0x55a877c47680 2020-05-18T21:33:34.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fceebfff700 1 -- 172.21.15.63:0/3052416938 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fced4002260 con 0x55a877c47680 2020-05-18T21:33:34.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fceebfff700 1 -- 172.21.15.63:0/3052416938 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3740903672 0 0) 0x7fced4002260 con 0x55a877c47680 2020-05-18T21:33:34.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fceebfff700 1 -- 172.21.15.63:0/3052416938 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x55a877c296f0 con 0x55a877c47680 2020-05-18T21:33:34.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fceebfff700 1 -- 172.21.15.63:0/3052416938 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fceec0077f0 con 0x55a877c47680 2020-05-18T21:33:34.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fcef263b700 1 -- 172.21.15.63:0/3052416938 >> v2:172.21.15.155:3300/0 conn(0x55a877bb6c40 msgr2=0x55a877c28e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fcef263b700 1 --2- 172.21.15.63:0/3052416938 >> v2:172.21.15.155:3300/0 conn(0x55a877bb6c40 0x55a877c28e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fcef263b700 1 -- 172.21.15.63:0/3052416938 >> v1:172.21.15.63:6789/0 conn(0x55a877c47680 legacy=0x55a877b9f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fcef263b700 1 -- 172.21.15.63:0/3052416938 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a877b9bb00 con 0x55a877c43700 2020-05-18T21:33:34.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fcef263b700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a877c43700 0x55a877c3eed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcee4006300 tx=0x7fcee400f640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/3052416938 >> v2:172.21.15.155:3300/0 conn(0x55a877bb6c40 0x55a877c28e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:34.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fcef263b700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a877c43700 0x55a877c3eed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcee4006300 tx=0x7fcee400f640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.012+0000 7fcef263b700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a877c43700 0x55a877c3eed0 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7fcee4006300 tx=0x7fcee400f640).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fcef263b700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a877c43700 0x55a877c3eed0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7fcee4006300 tx=0x7fcee400f640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fceebfff700 1 -- 172.21.15.63:0/3052416938 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcee4004490 con 0x55a877c43700 2020-05-18T21:33:34.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fcef263b700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a877c43700 0x55a877c3eed0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7fcee4006300 tx=0x7fcee400f640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fceebfff700 1 -- 172.21.15.63:0/3052416938 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee40045f0 con 0x55a877c43700 2020-05-18T21:33:34.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fcef263b700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a877c43700 0x55a877c3eed0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7fcee4006300 tx=0x7fcee400f640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fcef49f9b80 1 -- 172.21.15.63:0/3052416938 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a877c3f330 con 0x55a877c43700 2020-05-18T21:33:34.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fceebfff700 1 -- 172.21.15.63:0/3052416938 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcee4004950 con 0x55a877c43700 2020-05-18T21:33:34.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fcef49f9b80 1 -- 172.21.15.63:0/3052416938 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a877c3fe10 con 0x55a877c43700 2020-05-18T21:33:34.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fcef263b700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a877c43700 0x55a877c3eed0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7fcee4006300 tx=0x7fcee400f640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fceebfff700 1 -- 172.21.15.63:0/3052416938 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fcee4004b50 con 0x55a877c43700 2020-05-18T21:33:34.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fcef263b700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a877c43700 0x55a877c3eed0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7fcee4006300 tx=0x7fcee400f640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fceebfff700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fced404eed0 0x7fced4051390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fceebfff700 1 -- 172.21.15.63:0/3052416938 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcee40622e0 con 0x55a877c43700 2020-05-18T21:33:34.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fcef49f9b80 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55a877c5cef0 0x55a877c5f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fcef49f9b80 1 -- 172.21.15.63:0/3052416938 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- osd_op(unknown.0.0:1 20.0 20:00000000::::head [pgnls start_epoch 104 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e104) v8 -- 0x55a877c5f740 con 0x55a877c5cef0 2020-05-18T21:33:34.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fced404eed0 0x7fced4051390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fcef363d700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55a877c5cef0 0x55a877c5f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fced404eed0 0x7fced4051390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x55a877b9dc90 tx=0x7fcedc00e8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fced404eed0 0x7fced4051390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x55a877b9dc90 tx=0x7fcedc00e8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.016+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fced404eed0 0x7fced4051390 secure :-1 s=READY pgs=563 cs=0 l=1 rx=0x55a877b9dc90 tx=0x7fcedc00e8d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.020+0000 7fcef363d700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55a877c5cef0 0x55a877c5f2e0 crc :-1 s=READY pgs=22 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.020+0000 7fcef363d700 1 -- 172.21.15.63:0/3052416938 <== osd.3 v2:172.21.15.63:6814/12805 1 ==== osd_op_reply(1 [pgnls start_epoch 104 out=81b] v104'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x7fceec007b80 con 0x55a877c5cef0 2020-05-18T21:33:34.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.020+0000 7fcef363d700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7fceec00fb30 0x7fceec0105e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.020+0000 7fcef363d700 1 -- 172.21.15.63:0/3052416938 --> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] -- osd_op(unknown.0.0:2 20.4 20:20000000::::head [pgnls start_epoch 104 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e104) v8 -- 0x55a877c5f740 con 0x7fceec00fb30 2020-05-18T21:33:34.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.020+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7fceec00fb30 0x7fceec0105e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.020+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7fceec00fb30 0x7fceec0105e0 crc :-1 s=READY pgs=25 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.020+0000 7fcef2e3c700 1 -- 172.21.15.63:0/3052416938 <== osd.1 v2:172.21.15.63:6808/12804 1 ==== osd_op_reply(2 [pgnls start_epoch 104 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcedc00fab0 con 0x7fceec00fb30 2020-05-18T21:33:34.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.020+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7fcedc006910 0x7fcedc00d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.020+0000 7fcef2e3c700 1 -- 172.21.15.63:0/3052416938 --> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] -- osd_op(unknown.0.0:3 20.2 20:40000000::::head [pgnls start_epoch 104 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e104) v8 -- 0x55a877c5f740 con 0x7fcedc006910 2020-05-18T21:33:34.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.020+0000 7fcef263b700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7fcedc006910 0x7fcedc00d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.024+0000 7fcef263b700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7fcedc006910 0x7fcedc00d3e0 crc :-1 s=READY pgs=22 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.024+0000 7fcef263b700 1 -- 172.21.15.63:0/3052416938 <== osd.7 v2:172.21.15.155:6823/13026 1 ==== osd_op_reply(3 [pgnls start_epoch 104 out=81b] v104'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x7fcee403e6d0 con 0x7fcedc006910 2020-05-18T21:33:34.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.024+0000 7fcef263b700 1 -- 172.21.15.63:0/3052416938 --> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] -- osd_op(unknown.0.0:4 20.6 20:60000000::::head [pgnls start_epoch 104 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e104) v8 -- 0x55a877c5f740 con 0x7fceec00fb30 2020-05-18T21:33:34.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.024+0000 7fcef2e3c700 1 -- 172.21.15.63:0/3052416938 <== osd.1 v2:172.21.15.63:6808/12804 2 ==== osd_op_reply(4 [pgnls start_epoch 104 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcedc00fab0 con 0x7fceec00fb30 2020-05-18T21:33:34.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.024+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7fcedc00dd50 0x7fcedc008370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.024+0000 7fcef2e3c700 1 -- 172.21.15.63:0/3052416938 --> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] -- osd_op(unknown.0.0:5 20.1 20:80000000::::head [pgnls start_epoch 104 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e104) v8 -- 0x55a877c5f740 con 0x7fcedc00dd50 2020-05-18T21:33:34.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.024+0000 7fcef363d700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7fcedc00dd50 0x7fcedc008370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.028+0000 7fcef363d700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7fcedc00dd50 0x7fcedc008370 crc :-1 s=READY pgs=25 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.028+0000 7fcef363d700 1 -- 172.21.15.63:0/3052416938 <== osd.6 v2:172.21.15.155:6815/13025 1 ==== osd_op_reply(5 [pgnls start_epoch 104 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fceec007b80 con 0x7fcedc00dd50 2020-05-18T21:33:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.028+0000 7fcef363d700 1 -- 172.21.15.63:0/3052416938 --> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] -- osd_op(unknown.0.0:6 20.5 20:a0000000::::head [pgnls start_epoch 104 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e104) v8 -- 0x55a877c5f740 con 0x7fceec00fb30 2020-05-18T21:33:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.028+0000 7fcef2e3c700 1 -- 172.21.15.63:0/3052416938 <== osd.1 v2:172.21.15.63:6808/12804 3 ==== osd_op_reply(6 [pgnls start_epoch 104 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcedc00fab0 con 0x7fceec00fb30 2020-05-18T21:33:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.028+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7fcedc007300 0x7fcedc007740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.028+0000 7fcef2e3c700 1 -- 172.21.15.63:0/3052416938 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- osd_op(unknown.0.0:7 20.3 20:c0000000::::head [pgnls start_epoch 104 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e104) v8 -- 0x55a877c5f740 con 0x7fcedc007300 2020-05-18T21:33:34.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.028+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7fcedc007300 0x7fcedc007740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.028+0000 7fcef2e3c700 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7fcedc007300 0x7fcedc007740 crc :-1 s=READY pgs=34 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef2e3c700 1 -- 172.21.15.63:0/3052416938 <== osd.0 v2:172.21.15.63:6800/12803 1 ==== osd_op_reply(7 [pgnls start_epoch 104 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcedc00fab0 con 0x7fcedc007300 2020-05-18T21:33:34.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef2e3c700 1 -- 172.21.15.63:0/3052416938 --> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] -- osd_op(unknown.0.0:8 20.7 20:e0000000::::head [pgnls start_epoch 104 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e104) v8 -- 0x55a877c5f740 con 0x7fcedc006910 2020-05-18T21:33:34.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef263b700 1 -- 172.21.15.63:0/3052416938 <== osd.7 v2:172.21.15.155:6823/13026 2 ==== osd_op_reply(8 [pgnls start_epoch 104 out=113b] v104'2 uv2 ondisk = 1) v8 ==== 144+0+113 (crc 0 0 0) 0x7fcee403e6d0 con 0x7fcedc006910 2020-05-18T21:33:34.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 -- 172.21.15.63:0/3052416938 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7fcedc007300 msgr2=0x7fcedc007740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7fcedc007300 0x7fcedc007740 crc :-1 s=READY pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 -- 172.21.15.63:0/3052416938 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7fceec00fb30 msgr2=0x7fceec0105e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7fceec00fb30 0x7fceec0105e0 crc :-1 s=READY pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 -- 172.21.15.63:0/3052416938 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55a877c5cef0 msgr2=0x55a877c5f2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55a877c5cef0 0x55a877c5f2e0 crc :-1 s=READY pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 -- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7fcedc00dd50 msgr2=0x7fcedc008370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7fcedc00dd50 0x7fcedc008370 crc :-1 s=READY pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 -- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7fcedc006910 msgr2=0x7fcedc00d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7fcedc006910 0x7fcedc00d3e0 crc :-1 s=READY pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef363d700 1 -- 172.21.15.63:0/3052416938 reap_dead start 2020-05-18T21:33:34.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef363d700 1 -- 172.21.15.63:0/3052416938 reap_dead start 2020-05-18T21:33:34.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef363d700 1 -- 172.21.15.63:0/3052416938 reap_dead start 2020-05-18T21:33:34.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 -- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fced404eed0 msgr2=0x7fced4051390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fced404eed0 0x7fced4051390 secure :-1 s=READY pgs=563 cs=0 l=1 rx=0x55a877b9dc90 tx=0x7fcedc00e8d0).stop 2020-05-18T21:33:34.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 -- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a877c43700 msgr2=0x55a877c3eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a877c43700 0x55a877c3eed0 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7fcee4006300 tx=0x7fcee400f640).stop 2020-05-18T21:33:34.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 -- 172.21.15.63:0/3052416938 shutdown_connections 2020-05-18T21:33:34.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fced404eed0 0x7fced4051390 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 --2- 172.21.15.63:0/3052416938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a877c43700 0x55a877c3eed0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 -- 172.21.15.63:0/3052416938 >> 172.21.15.63:0/3052416938 conn(0x55a877bba850 msgr2=0x55a877bb87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:34.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 -- 172.21.15.63:0/3052416938 shutdown_connections 2020-05-18T21:33:34.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.032+0000 7fcef49f9b80 1 -- 172.21.15.63:0/3052416938 wait complete. 2020-05-18T21:33:34.051 INFO:teuthology.orchestra.run.smithi063.stdout:10000000000.00000000 2020-05-18T21:33:34.051 INFO:teuthology.orchestra.run.smithi063.stdout:10000000000.00000001 2020-05-18T21:33:34.052 INFO:teuthology.orchestra.run.smithi063.stdout:10000000001.00000000 2020-05-18T21:33:34.052 INFO:teuthology.orchestra.run.smithi063.stdout:10000000001.00000001 2020-05-18T21:33:34.052 INFO:tasks.cephfs.filesystem:All objects for ino 1099511627776 size 8388608 found 2020-05-18T21:33:34.053 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_data ls 2020-05-18T21:33:34.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.116+0000 7f41a2ce3b80 1 Processor -- start 2020-05-18T21:33:34.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.116+0000 7f41a2ce3b80 1 -- start start 2020-05-18T21:33:34.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.116+0000 7f41a2ce3b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x55f56e19fa60 0x55f56e19a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:34.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.116+0000 7f41a2ce3b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f56e19fea0 0x55f56e19e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:34.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.116+0000 7f41a2ce3b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55f56e06f4b0 con 0x55f56e19f680 2020-05-18T21:33:34.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.116+0000 7f41a2ce3b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f56e05b110 con 0x55f56e19fa60 2020-05-18T21:33:34.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.116+0000 7f41a2ce3b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f56e04ba40 con 0x55f56e19fea0 2020-05-18T21:33:34.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.116+0000 7f41a1126700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x55f56e19f680 0x55f56e1a35b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34594/0 (socket says 172.21.15.63:34594) 2020-05-18T21:33:34.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.116+0000 7f41a1126700 1 -- 172.21.15.63:0/1393198347 learned_addr learned my addr 172.21.15.63:0/1393198347 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:34.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.116+0000 7f41a0925700 1 --2- 172.21.15.63:0/1393198347 >> v2:172.21.15.155:3300/0 conn(0x55f56e19fa60 0x55f56e19a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.116+0000 7f41a1927700 1 --2- 172.21.15.63:0/1393198347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f56e19fea0 0x55f56e19e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.116+0000 7f419affd700 1 -- 172.21.15.63:0/1393198347 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466303421 0 0) 0x55f56e06f4b0 con 0x55f56e19f680 2020-05-18T21:33:34.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.116+0000 7f419affd700 1 -- 172.21.15.63:0/1393198347 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4184002020 con 0x55f56e19f680 2020-05-18T21:33:34.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a0925700 1 -- 172.21.15.63:0/1393198347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f56e19fea0 msgr2=0x55f56e19e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:34.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a0925700 1 --2- 172.21.15.63:0/1393198347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f56e19fea0 0x55f56e19e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:34.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a0925700 1 -- 172.21.15.63:0/1393198347 >> v1:172.21.15.63:6789/0 conn(0x55f56e19f680 legacy=0x55f56e1a35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a0925700 1 -- 172.21.15.63:0/1393198347 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f56e04f460 con 0x55f56e19fa60 2020-05-18T21:33:34.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a0925700 1 --2- 172.21.15.63:0/1393198347 >> v2:172.21.15.155:3300/0 conn(0x55f56e19fa60 0x55f56e19a7a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f418c001110 tx=0x7f418c00e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a0925700 1 --2- 172.21.15.63:0/1393198347 >> v2:172.21.15.155:3300/0 conn(0x55f56e19fa60 0x55f56e19a7a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f418c001110 tx=0x7f418c00e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a0925700 1 --2- 172.21.15.63:0/1393198347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f56e19fa60 0x55f56e19a7a0 secure :-1 s=READY pgs=970 cs=0 l=1 rx=0x7f418c001110 tx=0x7f418c00e800).ready entity=mon.1 client_cookie=5d5e125f2099947a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a0925700 1 --2- 172.21.15.63:0/1393198347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f56e19fa60 0x55f56e19a7a0 secure :-1 s=THROTTLE_DONE pgs=970 cs=0 l=1 rx=0x7f418c001110 tx=0x7f418c00e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f419affd700 1 -- 172.21.15.63:0/1393198347 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f418c007460 con 0x55f56e19fa60 2020-05-18T21:33:34.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a0925700 1 --2- 172.21.15.63:0/1393198347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f56e19fa60 0x55f56e19a7a0 secure :-1 s=THROTTLE_DONE pgs=970 cs=0 l=1 rx=0x7f418c001110 tx=0x7f418c00e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a0925700 1 --2- 172.21.15.63:0/1393198347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f56e19fa60 0x55f56e19a7a0 secure :-1 s=THROTTLE_DONE pgs=970 cs=0 l=1 rx=0x7f418c001110 tx=0x7f418c00e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f419affd700 1 -- 172.21.15.63:0/1393198347 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c0075c0 con 0x55f56e19fa60 2020-05-18T21:33:34.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f419affd700 1 -- 172.21.15.63:0/1393198347 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f418c0079a0 con 0x55f56e19fa60 2020-05-18T21:33:34.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a2ce3b80 1 -- 172.21.15.63:0/1393198347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f56e19fa60 msgr2=0x55f56e19a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a2ce3b80 1 --2- 172.21.15.63:0/1393198347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f56e19fa60 0x55f56e19a7a0 secure :-1 s=READY pgs=970 cs=0 l=1 rx=0x7f418c001110 tx=0x7f418c00e800).stop 2020-05-18T21:33:34.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a2ce3b80 1 -- 172.21.15.63:0/1393198347 shutdown_connections 2020-05-18T21:33:34.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a2ce3b80 1 --2- 172.21.15.63:0/1393198347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f56e19fea0 0x55f56e19e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:34.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a2ce3b80 1 --2- 172.21.15.63:0/1393198347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f56e19fa60 0x55f56e19a7a0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a2ce3b80 1 -- 172.21.15.63:0/1393198347 >> 172.21.15.63:0/1393198347 conn(0x55f56e112850 msgr2=0x55f56e0cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:34.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a2ce3b80 1 -- 172.21.15.63:0/1393198347 shutdown_connections 2020-05-18T21:33:34.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a2ce3b80 1 -- 172.21.15.63:0/1393198347 wait complete. 2020-05-18T21:33:34.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a2ce3b80 1 Processor -- start 2020-05-18T21:33:34.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a2ce3b80 1 -- start start 2020-05-18T21:33:34.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a2ce3b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55f56e19f680 0x55f56e1a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a2ce3b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x55f56e19fa60 0x55f56e1928f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a2ce3b80 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55f56e19aa70 con 0x55f56e19fea0 2020-05-18T21:33:34.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a2ce3b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f56e193c80 con 0x55f56e19f680 2020-05-18T21:33:34.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.120+0000 7f41a2ce3b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f56e1a1000 con 0x55f56e19fa60 2020-05-18T21:33:34.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f41a1126700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55f56e19f680 0x55f56e1a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f41a1126700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55f56e19f680 0x55f56e1a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60646/0 (socket says 172.21.15.63:60646) 2020-05-18T21:33:34.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f41a1126700 1 -- 172.21.15.63:0/648083287 learned_addr learned my addr 172.21.15.63:0/648083287 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:34.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f41a0925700 1 --2- 172.21.15.63:0/648083287 >> v2:172.21.15.155:3300/0 conn(0x55f56e19fa60 0x55f56e1928f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f41a1126700 1 -- 172.21.15.63:0/648083287 >> v2:172.21.15.155:3300/0 conn(0x55f56e19fa60 msgr2=0x55f56e1928f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f41a1126700 1 --2- 172.21.15.63:0/648083287 >> v2:172.21.15.155:3300/0 conn(0x55f56e19fa60 0x55f56e1928f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f41a1126700 1 -- 172.21.15.63:0/648083287 >> v1:172.21.15.155:6789/0 conn(0x55f56e19fea0 legacy=0x55f56e0f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f41a1126700 1 -- 172.21.15.63:0/648083287 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f56e1a0460 con 0x55f56e19f680 2020-05-18T21:33:34.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f41a1126700 1 --2- 172.21.15.63:0/648083287 >> v2:172.21.15.63:3300/0 conn(0x55f56e19f680 0x55f56e1a0ba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4194006c20 tx=0x7f4194006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f41a1126700 1 --2- 172.21.15.63:0/648083287 >> v2:172.21.15.63:3300/0 conn(0x55f56e19f680 0x55f56e1a0ba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4194006c20 tx=0x7f4194006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f41a1126700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f56e19f680 0x55f56e1a0ba0 secure :-1 s=READY pgs=1445 cs=0 l=1 rx=0x7f4194006c20 tx=0x7f4194006620).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f41a1126700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f56e19f680 0x55f56e1a0ba0 secure :-1 s=THROTTLE_DONE pgs=1445 cs=0 l=1 rx=0x7f4194006c20 tx=0x7f4194006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f419a7fc700 1 -- 172.21.15.63:0/648083287 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4194009930 con 0x55f56e19f680 2020-05-18T21:33:34.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f41a1126700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f56e19f680 0x55f56e1a0ba0 secure :-1 s=THROTTLE_DONE pgs=1445 cs=0 l=1 rx=0x7f4194006c20 tx=0x7f4194006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f419a7fc700 1 -- 172.21.15.63:0/648083287 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4194009a90 con 0x55f56e19f680 2020-05-18T21:33:34.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f41a1126700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f56e19f680 0x55f56e1a0ba0 secure :-1 s=THROTTLE_DONE pgs=1445 cs=0 l=1 rx=0x7f4194006c20 tx=0x7f4194006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f419a7fc700 1 -- 172.21.15.63:0/648083287 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f419400b370 con 0x55f56e19f680 2020-05-18T21:33:34.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f41a2ce3b80 1 -- 172.21.15.63:0/648083287 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f56e1a0700 con 0x55f56e19f680 2020-05-18T21:33:34.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f41a2ce3b80 1 -- 172.21.15.63:0/648083287 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f56e19a6f0 con 0x55f56e19f680 2020-05-18T21:33:34.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.124+0000 7f41a1126700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f56e19f680 0x55f56e1a0ba0 secure :-1 s=THROTTLE_DONE pgs=1445 cs=0 l=1 rx=0x7f4194006c20 tx=0x7f4194006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.128+0000 7f419a7fc700 1 -- 172.21.15.63:0/648083287 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f419400b5f0 con 0x55f56e19f680 2020-05-18T21:33:34.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.128+0000 7f41a1126700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f56e19f680 0x55f56e1a0ba0 secure :-1 s=THROTTLE_DONE pgs=1445 cs=0 l=1 rx=0x7f4194006c20 tx=0x7f4194006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.128+0000 7f419a7fc700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f418404e720 0x7f4184050be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.128+0000 7f419a7fc700 1 -- 172.21.15.63:0/648083287 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4194063220 con 0x55f56e19f680 2020-05-18T21:33:34.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.128+0000 7f41a0925700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f418404e720 0x7f4184050be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.128+0000 7f41a2ce3b80 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55f56e1a28f0 0x55f56e1a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.128+0000 7f41a2ce3b80 1 -- 172.21.15.63:0/648083287 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- osd_op(unknown.0.0:1 20.0 20:00000000::::head [pgnls start_epoch 104 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e104) v8 -- 0x55f56e1b75d0 con 0x55f56e1a28f0 2020-05-18T21:33:34.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.128+0000 7f41a1927700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55f56e1a28f0 0x55f56e1a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.128+0000 7f41a0925700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f418404e720 0x7f4184050be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f418c001110 tx=0x7f418c00e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.128+0000 7f41a0925700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f418404e720 0x7f4184050be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f418c001110 tx=0x7f418c00e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.128+0000 7f41a0925700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f418404e720 0x7f4184050be0 secure :-1 s=READY pgs=564 cs=0 l=1 rx=0x7f418c001110 tx=0x7f418c00e800).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.128+0000 7f41a1927700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55f56e1a28f0 0x55f56e1a2d30 crc :-1 s=READY pgs=23 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.128+0000 7f41a1927700 1 -- 172.21.15.63:0/648083287 <== osd.3 v2:172.21.15.63:6814/12805 1 ==== osd_op_reply(1 [pgnls start_epoch 104 out=81b] v104'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x7f419c005bd0 con 0x55f56e1a28f0 2020-05-18T21:33:34.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.128+0000 7f41a1927700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7f419c00b0f0 0x7f419c00b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.128+0000 7f41a1927700 1 -- 172.21.15.63:0/648083287 --> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] -- osd_op(unknown.0.0:2 20.4 20:20000000::::head [pgnls start_epoch 104 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e104) v8 -- 0x55f56e1b75d0 con 0x7f419c00b0f0 2020-05-18T21:33:34.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.128+0000 7f41a1126700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7f419c00b0f0 0x7f419c00b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.132+0000 7f41a1126700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7f419c00b0f0 0x7f419c00b510 crc :-1 s=READY pgs=26 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.132+0000 7f41a1126700 1 -- 172.21.15.63:0/648083287 <== osd.1 v2:172.21.15.63:6808/12804 1 ==== osd_op_reply(2 [pgnls start_epoch 104 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f419403f5b0 con 0x7f419c00b0f0 2020-05-18T21:33:34.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.132+0000 7f41a1126700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7f4194040700 0x7f4194040170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.132+0000 7f41a1126700 1 -- 172.21.15.63:0/648083287 --> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] -- osd_op(unknown.0.0:3 20.2 20:40000000::::head [pgnls start_epoch 104 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e104) v8 -- 0x55f56e1b75d0 con 0x7f4194040700 2020-05-18T21:33:34.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.132+0000 7f41a0925700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7f4194040700 0x7f4194040170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.132+0000 7f41a0925700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7f4194040700 0x7f4194040170 crc :-1 s=READY pgs=23 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.136+0000 7f41a0925700 1 -- 172.21.15.63:0/648083287 <== osd.7 v2:172.21.15.155:6823/13026 1 ==== osd_op_reply(3 [pgnls start_epoch 104 out=81b] v104'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x7f418c007830 con 0x7f4194040700 2020-05-18T21:33:34.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.136+0000 7f41a0925700 1 -- 172.21.15.63:0/648083287 --> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] -- osd_op(unknown.0.0:4 20.6 20:60000000::::head [pgnls start_epoch 104 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e104) v8 -- 0x55f56e1b75d0 con 0x7f419c00b0f0 2020-05-18T21:33:34.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.136+0000 7f41a1126700 1 -- 172.21.15.63:0/648083287 <== osd.1 v2:172.21.15.63:6808/12804 2 ==== osd_op_reply(4 [pgnls start_epoch 104 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f419403f5b0 con 0x7f419c00b0f0 2020-05-18T21:33:34.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.136+0000 7f41a1126700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f419403f870 0x7f419403fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.136+0000 7f41a1126700 1 -- 172.21.15.63:0/648083287 --> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] -- osd_op(unknown.0.0:5 20.1 20:80000000::::head [pgnls start_epoch 104 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e104) v8 -- 0x55f56e1b75d0 con 0x7f419403f870 2020-05-18T21:33:34.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.136+0000 7f41a1927700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f419403f870 0x7f419403fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.136+0000 7f41a1927700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f419403f870 0x7f419403fcb0 crc :-1 s=READY pgs=26 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.136+0000 7f41a1927700 1 -- 172.21.15.63:0/648083287 <== osd.6 v2:172.21.15.155:6815/13025 1 ==== osd_op_reply(5 [pgnls start_epoch 104 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f419c005bd0 con 0x7f419403f870 2020-05-18T21:33:34.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.136+0000 7f41a1927700 1 -- 172.21.15.63:0/648083287 --> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] -- osd_op(unknown.0.0:6 20.5 20:a0000000::::head [pgnls start_epoch 104 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e104) v8 -- 0x55f56e1b75d0 con 0x7f419c00b0f0 2020-05-18T21:33:34.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.140+0000 7f41a1126700 1 -- 172.21.15.63:0/648083287 <== osd.1 v2:172.21.15.63:6808/12804 3 ==== osd_op_reply(6 [pgnls start_epoch 104 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f419403f5b0 con 0x7f419c00b0f0 2020-05-18T21:33:34.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.140+0000 7f41a1126700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f419403ee10 0x7f4194043520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.140+0000 7f41a1126700 1 -- 172.21.15.63:0/648083287 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- osd_op(unknown.0.0:7 20.3 20:c0000000::::head [pgnls start_epoch 104 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e104) v8 -- 0x55f56e1b75d0 con 0x7f419403ee10 2020-05-18T21:33:34.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.140+0000 7f41a1126700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f419403ee10 0x7f4194043520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.140+0000 7f41a1126700 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f419403ee10 0x7f4194043520 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.140+0000 7f41a1126700 1 -- 172.21.15.63:0/648083287 <== osd.0 v2:172.21.15.63:6800/12803 1 ==== osd_op_reply(7 [pgnls start_epoch 104 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f419403f5b0 con 0x7f419403ee10 2020-05-18T21:33:34.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.140+0000 7f41a1126700 1 -- 172.21.15.63:0/648083287 --> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] -- osd_op(unknown.0.0:8 20.7 20:e0000000::::head [pgnls start_epoch 104 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e104) v8 -- 0x55f56e1b75d0 con 0x7f4194040700 2020-05-18T21:33:34.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a0925700 1 -- 172.21.15.63:0/648083287 <== osd.7 v2:172.21.15.155:6823/13026 2 ==== osd_op_reply(8 [pgnls start_epoch 104 out=113b] v104'2 uv2 ondisk = 1) v8 ==== 144+0+113 (crc 0 0 0) 0x7f418c007830 con 0x7f4194040700 2020-05-18T21:33:34.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a2ce3b80 1 -- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f419403ee10 msgr2=0x7f4194043520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a2ce3b80 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f419403ee10 0x7f4194043520 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a2ce3b80 1 -- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7f419c00b0f0 msgr2=0x7f419c00b510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a2ce3b80 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7f419c00b0f0 0x7f419c00b510 crc :-1 s=READY pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a2ce3b80 1 -- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55f56e1a28f0 msgr2=0x55f56e1a2d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a2ce3b80 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55f56e1a28f0 0x55f56e1a2d30 crc :-1 s=READY pgs=23 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a2ce3b80 1 -- 172.21.15.63:0/648083287 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f419403f870 msgr2=0x7f419403fcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a2ce3b80 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f419403f870 0x7f419403fcb0 crc :-1 s=READY pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a2ce3b80 1 -- 172.21.15.63:0/648083287 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7f4194040700 msgr2=0x7f4194040170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a2ce3b80 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7f4194040700 0x7f4194040170 crc :-1 s=READY pgs=23 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a2ce3b80 1 -- 172.21.15.63:0/648083287 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f418404e720 msgr2=0x7f4184050be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a2ce3b80 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f418404e720 0x7f4184050be0 secure :-1 s=READY pgs=564 cs=0 l=1 rx=0x7f418c001110 tx=0x7f418c00e800).stop 2020-05-18T21:33:34.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a2ce3b80 1 -- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f56e19f680 msgr2=0x55f56e1a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a2ce3b80 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f56e19f680 0x55f56e1a0ba0 secure :-1 s=READY pgs=1445 cs=0 l=1 rx=0x7f4194006c20 tx=0x7f4194006620).stop 2020-05-18T21:33:34.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a1927700 1 -- 172.21.15.63:0/648083287 reap_dead start 2020-05-18T21:33:34.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a1927700 1 -- 172.21.15.63:0/648083287 reap_dead start 2020-05-18T21:33:34.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a1927700 1 -- 172.21.15.63:0/648083287 reap_dead start 2020-05-18T21:33:34.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a2ce3b80 1 -- 172.21.15.63:0/648083287 shutdown_connections 2020-05-18T21:33:34.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a2ce3b80 1 --2- 172.21.15.63:0/648083287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f56e19f680 0x55f56e1a0ba0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a2ce3b80 1 -- 172.21.15.63:0/648083287 >> 172.21.15.63:0/648083287 conn(0x55f56e112850 msgr2=0x55f56e0f34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:34.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a2ce3b80 1 -- 172.21.15.63:0/648083287 shutdown_connections 2020-05-18T21:33:34.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.144+0000 7f41a2ce3b80 1 -- 172.21.15.63:0/648083287 wait complete. 2020-05-18T21:33:34.155 INFO:teuthology.orchestra.run.smithi063.stdout:10000000000.00000000 2020-05-18T21:33:34.155 INFO:teuthology.orchestra.run.smithi063.stdout:10000000000.00000001 2020-05-18T21:33:34.156 INFO:teuthology.orchestra.run.smithi063.stdout:10000000001.00000000 2020-05-18T21:33:34.156 INFO:teuthology.orchestra.run.smithi063.stdout:10000000001.00000001 2020-05-18T21:33:34.157 INFO:tasks.cephfs.filesystem:All objects for ino 1099511627777 size 8388608 found 2020-05-18T21:33:34.157 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:34.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e8105700 1 Processor -- start 2020-05-18T21:33:34.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e8105700 1 -- start start 2020-05-18T21:33:34.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e8105700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb9e0060b90 0x7fb9e00615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:34.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e8105700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9e014e570 0x7fb9e014a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:34.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e8105700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e014d960 con 0x7fb9e00b2860 2020-05-18T21:33:34.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e8105700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e0066210 con 0x7fb9e0060b90 2020-05-18T21:33:34.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e8105700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e014db90 con 0x7fb9e014e570 2020-05-18T21:33:34.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e5ea1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb9e0060b90 0x7fb9e00615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e56a0700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb9e00b2860 0x7fb9e0144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34618/0 (socket says 172.21.15.63:34618) 2020-05-18T21:33:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e56a0700 1 -- 172.21.15.63:0/732125390 learned_addr learned my addr 172.21.15.63:0/732125390 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e66a2700 1 --2- 172.21.15.63:0/732125390 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9e014e570 0x7fb9e014a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e5ea1700 1 -- 172.21.15.63:0/732125390 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9e014e570 msgr2=0x7fb9e014a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e5ea1700 1 --2- 172.21.15.63:0/732125390 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9e014e570 0x7fb9e014a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:34.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e5ea1700 1 -- 172.21.15.63:0/732125390 >> v1:172.21.15.63:6789/0 conn(0x7fb9e00b2860 legacy=0x7fb9e0144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e4e9f700 1 -- 172.21.15.63:0/732125390 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315866542 0 0) 0x7fb9e014d960 con 0x7fb9e00b2860 2020-05-18T21:33:34.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e5ea1700 1 -- 172.21.15.63:0/732125390 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e014de30 con 0x7fb9e0060b90 2020-05-18T21:33:34.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e5ea1700 1 --2- 172.21.15.63:0/732125390 >> v2:172.21.15.63:3300/0 conn(0x7fb9e0060b90 0x7fb9e00615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb9d4002f70 tx=0x7fb9d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e5ea1700 1 --2- 172.21.15.63:0/732125390 >> v2:172.21.15.63:3300/0 conn(0x7fb9e0060b90 0x7fb9e00615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb9d4002f70 tx=0x7fb9d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e5ea1700 1 --2- 172.21.15.63:0/732125390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9e0060b90 0x7fb9e00615e0 secure :-1 s=READY pgs=1447 cs=0 l=1 rx=0x7fb9d4002f70 tx=0x7fb9d4007a80).ready entity=mon.0 client_cookie=3e2d4ec228670ecd server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e5ea1700 1 --2- 172.21.15.63:0/732125390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9e0060b90 0x7fb9e00615e0 secure :-1 s=THROTTLE_DONE pgs=1447 cs=0 l=1 rx=0x7fb9d4002f70 tx=0x7fb9d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e4e9f700 1 -- 172.21.15.63:0/732125390 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9d4008e80 con 0x7fb9e0060b90 2020-05-18T21:33:34.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e5ea1700 1 --2- 172.21.15.63:0/732125390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9e0060b90 0x7fb9e00615e0 secure :-1 s=THROTTLE_DONE pgs=1447 cs=0 l=1 rx=0x7fb9d4002f70 tx=0x7fb9d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e4e9f700 1 -- 172.21.15.63:0/732125390 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d40115f0 con 0x7fb9e0060b90 2020-05-18T21:33:34.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e5ea1700 1 --2- 172.21.15.63:0/732125390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9e0060b90 0x7fb9e00615e0 secure :-1 s=THROTTLE_DONE pgs=1447 cs=0 l=1 rx=0x7fb9d4002f70 tx=0x7fb9d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e4e9f700 1 -- 172.21.15.63:0/732125390 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9d40119d0 con 0x7fb9e0060b90 2020-05-18T21:33:34.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e8105700 1 -- 172.21.15.63:0/732125390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9e0060b90 msgr2=0x7fb9e00615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e8105700 1 --2- 172.21.15.63:0/732125390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9e0060b90 0x7fb9e00615e0 secure :-1 s=READY pgs=1447 cs=0 l=1 rx=0x7fb9d4002f70 tx=0x7fb9d4007a80).stop 2020-05-18T21:33:34.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e8105700 1 -- 172.21.15.63:0/732125390 shutdown_connections 2020-05-18T21:33:34.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e8105700 1 --2- 172.21.15.63:0/732125390 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9e014e570 0x7fb9e014a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:34.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e8105700 1 --2- 172.21.15.63:0/732125390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9e0060b90 0x7fb9e00615e0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e8105700 1 -- 172.21.15.63:0/732125390 >> 172.21.15.63:0/732125390 conn(0x7fb9e00b83d0 msgr2=0x7fb9e00b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:34.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e8105700 1 -- 172.21.15.63:0/732125390 shutdown_connections 2020-05-18T21:33:34.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.264+0000 7fb9e8105700 1 -- 172.21.15.63:0/732125390 wait complete. 2020-05-18T21:33:34.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9e8105700 1 Processor -- start 2020-05-18T21:33:34.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9e8105700 1 -- start start 2020-05-18T21:33:34.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9e8105700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb9e0060b90 0x7fb9e0149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9e8105700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb9e014e570 0x7fb9e00ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9e8105700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e00b0700 con 0x7fb9e00b2860 2020-05-18T21:33:34.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9e8105700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e00ad750 con 0x7fb9e0060b90 2020-05-18T21:33:34.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9e8105700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e00aec80 con 0x7fb9e014e570 2020-05-18T21:33:34.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9e56a0700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb9e00b2860 0x7fb9e00afff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34626/0 (socket says 172.21.15.63:34626) 2020-05-18T21:33:34.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9e56a0700 1 -- 172.21.15.63:0/2953316514 learned_addr learned my addr 172.21.15.63:0/2953316514 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:34.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9e5ea1700 1 --2- 172.21.15.63:0/2953316514 >> v2:172.21.15.63:3300/0 conn(0x7fb9e0060b90 0x7fb9e0149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9e66a2700 1 --2- 172.21.15.63:0/2953316514 >> v2:172.21.15.155:3300/0 conn(0x7fb9e014e570 0x7fb9e00ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9d2ffd700 1 -- 172.21.15.63:0/2953316514 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438369036 0 0) 0x7fb9e00b0700 con 0x7fb9e00b2860 2020-05-18T21:33:34.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9d2ffd700 1 -- 172.21.15.63:0/2953316514 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9c8002fe0 con 0x7fb9e00b2860 2020-05-18T21:33:34.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9e66a2700 1 -- 172.21.15.63:0/2953316514 >> v2:172.21.15.63:3300/0 conn(0x7fb9e0060b90 msgr2=0x7fb9e0149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9e66a2700 1 --2- 172.21.15.63:0/2953316514 >> v2:172.21.15.63:3300/0 conn(0x7fb9e0060b90 0x7fb9e0149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9e66a2700 1 -- 172.21.15.63:0/2953316514 >> v1:172.21.15.63:6789/0 conn(0x7fb9e00b2860 legacy=0x7fb9e00afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9d2ffd700 1 -- 172.21.15.63:0/2953316514 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 856032881 0 0) 0x7fb9c8002fe0 con 0x7fb9e00b2860 2020-05-18T21:33:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9e66a2700 1 -- 172.21.15.63:0/2953316514 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e00aef20 con 0x7fb9e014e570 2020-05-18T21:33:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9e5ea1700 1 --2- 172.21.15.63:0/2953316514 >> v2:172.21.15.63:3300/0 conn(0x7fb9e0060b90 0x7fb9e0149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9e66a2700 1 --2- 172.21.15.63:0/2953316514 >> v2:172.21.15.155:3300/0 conn(0x7fb9e014e570 0x7fb9e00ad1d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb9d80032f0 tx=0x7fb9d8010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.268+0000 7fb9e66a2700 1 --2- 172.21.15.63:0/2953316514 >> v2:172.21.15.155:3300/0 conn(0x7fb9e014e570 0x7fb9e00ad1d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb9d80032f0 tx=0x7fb9d8010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.272+0000 7fb9e66a2700 1 --2- 172.21.15.63:0/2953316514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9e014e570 0x7fb9e00ad1d0 secure :-1 s=READY pgs=972 cs=0 l=1 rx=0x7fb9d80032f0 tx=0x7fb9d8010f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.272+0000 7fb9e66a2700 1 --2- 172.21.15.63:0/2953316514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9e014e570 0x7fb9e00ad1d0 secure :-1 s=THROTTLE_DONE pgs=972 cs=0 l=1 rx=0x7fb9d80032f0 tx=0x7fb9d8010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.272+0000 7fb9d2ffd700 1 -- 172.21.15.63:0/2953316514 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9d8005a80 con 0x7fb9e014e570 2020-05-18T21:33:34.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.272+0000 7fb9e66a2700 1 --2- 172.21.15.63:0/2953316514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9e014e570 0x7fb9e00ad1d0 secure :-1 s=THROTTLE_DONE pgs=972 cs=0 l=1 rx=0x7fb9d80032f0 tx=0x7fb9d8010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.272+0000 7fb9e66a2700 1 --2- 172.21.15.63:0/2953316514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9e014e570 0x7fb9e00ad1d0 secure :-1 s=THROTTLE_DONE pgs=972 cs=0 l=1 rx=0x7fb9d80032f0 tx=0x7fb9d8010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.272+0000 7fb9d2ffd700 1 -- 172.21.15.63:0/2953316514 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d8005be0 con 0x7fb9e014e570 2020-05-18T21:33:34.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.272+0000 7fb9e8105700 1 -- 172.21.15.63:0/2953316514 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e014a440 con 0x7fb9e014e570 2020-05-18T21:33:34.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.272+0000 7fb9d2ffd700 1 -- 172.21.15.63:0/2953316514 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9d800c940 con 0x7fb9e014e570 2020-05-18T21:33:34.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.272+0000 7fb9e8105700 1 -- 172.21.15.63:0/2953316514 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e00656b0 con 0x7fb9e014e570 2020-05-18T21:33:34.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.272+0000 7fb9e66a2700 1 --2- 172.21.15.63:0/2953316514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9e014e570 0x7fb9e00ad1d0 secure :-1 s=THROTTLE_DONE pgs=972 cs=0 l=1 rx=0x7fb9d80032f0 tx=0x7fb9d8010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.272+0000 7fb9e8105700 1 -- 172.21.15.63:0/2953316514 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e00659c0 con 0x7fb9e014e570 2020-05-18T21:33:34.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.272+0000 7fb9d2ffd700 1 -- 172.21.15.63:0/2953316514 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb9d800cb80 con 0x7fb9e014e570 2020-05-18T21:33:34.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.272+0000 7fb9e66a2700 1 --2- 172.21.15.63:0/2953316514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9e014e570 0x7fb9e00ad1d0 secure :-1 s=THROTTLE_DONE pgs=972 cs=0 l=1 rx=0x7fb9d80032f0 tx=0x7fb9d8010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.272+0000 7fb9d2ffd700 1 --2- 172.21.15.63:0/2953316514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb9c804fcf0 0x7fb9c80521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.272+0000 7fb9d2ffd700 1 -- 172.21.15.63:0/2953316514 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb9d8063a70 con 0x7fb9e014e570 2020-05-18T21:33:34.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.272+0000 7fb9e5ea1700 1 --2- 172.21.15.63:0/2953316514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb9c804fcf0 0x7fb9c80521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.272+0000 7fb9e5ea1700 1 --2- 172.21.15.63:0/2953316514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb9c804fcf0 0x7fb9c80521b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb9d4002f70 tx=0x7fb9d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.272+0000 7fb9e5ea1700 1 --2- 172.21.15.63:0/2953316514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb9c804fcf0 0x7fb9c80521b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb9d4002f70 tx=0x7fb9d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.272+0000 7fb9e5ea1700 1 --2- 172.21.15.63:0/2953316514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb9c804fcf0 0x7fb9c80521b0 secure :-1 s=READY pgs=565 cs=0 l=1 rx=0x7fb9d4002f70 tx=0x7fb9d4007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.284+0000 7fb9e66a2700 1 --2- 172.21.15.63:0/2953316514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9e014e570 0x7fb9e00ad1d0 secure :-1 s=THROTTLE_DONE pgs=972 cs=0 l=1 rx=0x7fb9d80032f0 tx=0x7fb9d8010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.284+0000 7fb9d2ffd700 1 -- 172.21.15.63:0/2953316514 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb9d803de00 con 0x7fb9e014e570 2020-05-18T21:33:34.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.432+0000 7fb9e8105700 1 -- 172.21.15.63:0/2953316514 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9e00569e0 con 0x7fb9e014e570 2020-05-18T21:33:34.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.432+0000 7fb9e66a2700 1 --2- 172.21.15.63:0/2953316514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9e014e570 0x7fb9e00ad1d0 secure :-1 s=THROTTLE_DONE pgs=972 cs=0 l=1 rx=0x7fb9d80032f0 tx=0x7fb9d8010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.432+0000 7fb9d2ffd700 1 -- 172.21.15.63:0/2953316514 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+2143 (secure 0 0 0) 0x7fb9d8041420 con 0x7fb9e014e570 2020-05-18T21:33:34.440 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:34.440 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":81,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6113,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2300000397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2300000397},{"type":"v1","addr":"172.21.15.63:6833","nonce":2300000397}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":78}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:23.230529+0000","modified":"2020-05-18T21:33:24.934162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8059":{"gid":8059,"name":"b","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1291107650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1291107650},{"type":"v1","addr":"172.21.15.155:6835","nonce":1291107650}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-05-18T21:33:34.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.436+0000 7fb9e8105700 1 -- 172.21.15.63:0/2953316514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb9c804fcf0 msgr2=0x7fb9c80521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.436+0000 7fb9e8105700 1 --2- 172.21.15.63:0/2953316514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb9c804fcf0 0x7fb9c80521b0 secure :-1 s=READY pgs=565 cs=0 l=1 rx=0x7fb9d4002f70 tx=0x7fb9d4007a80).stop 2020-05-18T21:33:34.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.436+0000 7fb9e8105700 1 -- 172.21.15.63:0/2953316514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9e014e570 msgr2=0x7fb9e00ad1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.436+0000 7fb9e8105700 1 --2- 172.21.15.63:0/2953316514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9e014e570 0x7fb9e00ad1d0 secure :-1 s=READY pgs=972 cs=0 l=1 rx=0x7fb9d80032f0 tx=0x7fb9d8010f00).stop 2020-05-18T21:33:34.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.436+0000 7fb9e8105700 1 -- 172.21.15.63:0/2953316514 shutdown_connections 2020-05-18T21:33:34.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.436+0000 7fb9e8105700 1 --2- 172.21.15.63:0/2953316514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb9c804fcf0 0x7fb9c80521b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.436+0000 7fb9e8105700 1 --2- 172.21.15.63:0/2953316514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9e014e570 0x7fb9e00ad1d0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.436+0000 7fb9e8105700 1 --2- 172.21.15.63:0/2953316514 >> v2:172.21.15.63:3300/0 conn(0x7fb9e0060b90 0x7fb9e0149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.436+0000 7fb9e8105700 1 -- 172.21.15.63:0/2953316514 >> 172.21.15.63:0/2953316514 conn(0x7fb9e00b83d0 msgr2=0x7fb9e00b7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:34.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.436+0000 7fb9e8105700 1 -- 172.21.15.63:0/2953316514 shutdown_connections 2020-05-18T21:33:34.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.436+0000 7fb9e8105700 1 -- 172.21.15.63:0/2953316514 wait complete. 2020-05-18T21:33:34.444 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 81 2020-05-18T21:33:34.452 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok flush journal 2020-05-18T21:33:34.569 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:33:34.569 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "", 2020-05-18T21:33:34.569 INFO:teuthology.orchestra.run.smithi155.stdout: "return_code": 0 2020-05-18T21:33:34.569 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:33:34.578 INFO:tasks.cephfs.filesystem:_json_asok output: { "message": "", "return_code": 0 } 2020-05-18T21:33:34.579 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_data getxattr 10000000001.00000000 parent 2020-05-18T21:33:34.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.604+0000 7f7328a93b80 1 Processor -- start 2020-05-18T21:33:34.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.604+0000 7f7328a93b80 1 -- start start 2020-05-18T21:33:34.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7328a93b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x55570abc8930 0x55570abd81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:34.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7328a93b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55570aaa24b0 con 0x55570ab27000 2020-05-18T21:33:34.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7326ed6700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x55570ab27000 0x55570abd7ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34644/0 (socket says 172.21.15.63:34644) 2020-05-18T21:33:34.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7326ed6700 1 -- 172.21.15.63:0/3560012799 learned_addr learned my addr 172.21.15.63:0/3560012799 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:34.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7328a93b80 1 -- 172.21.15.63:0/3560012799 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55570aa82460 con 0x55570abd8620 2020-05-18T21:33:34.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7328a93b80 1 -- 172.21.15.63:0/3560012799 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x55570aa8e110 con 0x55570abc8930 2020-05-18T21:33:34.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f73266d5700 1 --2- 172.21.15.63:0/3560012799 >> v2:172.21.15.155:3300/0 conn(0x55570abc8930 0x55570abd81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 -- 172.21.15.63:0/3560012799 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770534257 0 0) 0x55570aaa24b0 con 0x55570ab27000 2020-05-18T21:33:34.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 -- 172.21.15.63:0/3560012799 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7308002020 con 0x55570ab27000 2020-05-18T21:33:34.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 -- 172.21.15.63:0/3560012799 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906369489 0 0) 0x55570aa82460 con 0x55570abd8620 2020-05-18T21:33:34.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 -- 172.21.15.63:0/3560012799 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x55570aaa24b0 con 0x55570abd8620 2020-05-18T21:33:34.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 -- 172.21.15.63:0/3560012799 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1497902427 0 0) 0x7f7308002020 con 0x55570ab27000 2020-05-18T21:33:34.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 -- 172.21.15.63:0/3560012799 >> v2:172.21.15.155:3300/0 conn(0x55570abc8930 msgr2=0x55570abd81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:34.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 --2- 172.21.15.63:0/3560012799 >> v2:172.21.15.155:3300/0 conn(0x55570abc8930 0x55570abd81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:34.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 -- 172.21.15.63:0/3560012799 >> v1:172.21.15.155:6789/0 conn(0x55570abd8620 legacy=0x55570ab419a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 -- 172.21.15.63:0/3560012799 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55570abcd500 con 0x55570ab27000 2020-05-18T21:33:34.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 -- 172.21.15.63:0/3560012799 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f7310001670 con 0x55570ab27000 2020-05-18T21:33:34.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 -- 172.21.15.63:0/3560012799 >> v1:172.21.15.63:6789/0 conn(0x55570ab27000 legacy=0x55570abd7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 --2- 172.21.15.63:0/3560012799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73080027d0 0x7f7308002bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:34.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 --2- 172.21.15.63:0/3560012799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73080030a0 0x7f7308003500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:34.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 --2- 172.21.15.63:0/3560012799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7308003a70 0x7f7308003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:34.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 -- 172.21.15.63:0/3560012799 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570aa8e110 con 0x7f73080030a0 2020-05-18T21:33:34.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 -- 172.21.15.63:0/3560012799 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730800a6c0 con 0x7f7308003a70 2020-05-18T21:33:34.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 -- 172.21.15.63:0/3560012799 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730800a880 con 0x7f73080027d0 2020-05-18T21:33:34.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f73266d5700 1 --2- 172.21.15.63:0/3560012799 >> v2:172.21.15.155:3300/0 conn(0x55570abc8930 0x55570abd81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:34.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f73276d7700 1 --2- 172.21.15.63:0/3560012799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7308003a70 0x7f7308003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7326ed6700 1 --2- 172.21.15.63:0/3560012799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73080027d0 0x7f7308002bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f73266d5700 1 --2- 172.21.15.63:0/3560012799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73080030a0 0x7f7308003500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f73276d7700 1 -- 172.21.15.63:0/3560012799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73080027d0 msgr2=0x7f7308002bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:34.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f73276d7700 1 --2- 172.21.15.63:0/3560012799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73080027d0 0x7f7308002bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:34.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f73276d7700 1 -- 172.21.15.63:0/3560012799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73080030a0 msgr2=0x7f7308003500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:34.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f73276d7700 1 --2- 172.21.15.63:0/3560012799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73080030a0 0x7f7308003500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:34.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f73276d7700 1 -- 172.21.15.63:0/3560012799 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7308002020 con 0x7f7308003a70 2020-05-18T21:33:34.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f73266d5700 1 --2- 172.21.15.63:0/3560012799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73080030a0 0x7f7308003500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:33:34.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f73276d7700 1 --2- 172.21.15.63:0/3560012799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7308003a70 0x7f7308003f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x55570ab237e0 tx=0x7f732000e790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f73276d7700 1 -- 172.21.15.63:0/3560012799 reap_dead start 2020-05-18T21:33:34.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f73276d7700 1 --2- 172.21.15.63:0/3560012799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7308003a70 0x7f7308003f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x55570ab237e0 tx=0x7f732000e790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f73276d7700 1 --2- 172.21.15.63:0/3560012799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7308003a70 0x7f7308003f20 secure :-1 s=READY pgs=975 cs=0 l=1 rx=0x55570ab237e0 tx=0x7f732000e790).ready entity=mon.1 client_cookie=60ade7e06fee5229 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f73276d7700 1 --2- 172.21.15.63:0/3560012799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7308003a70 0x7f7308003f20 secure :-1 s=THROTTLE_DONE pgs=975 cs=0 l=1 rx=0x55570ab237e0 tx=0x7f732000e790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 -- 172.21.15.63:0/3560012799 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7320004b10 con 0x7f7308003a70 2020-05-18T21:33:34.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f73276d7700 1 --2- 172.21.15.63:0/3560012799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7308003a70 0x7f7308003f20 secure :-1 s=THROTTLE_DONE pgs=975 cs=0 l=1 rx=0x55570ab237e0 tx=0x7f732000e790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f73276d7700 1 --2- 172.21.15.63:0/3560012799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7308003a70 0x7f7308003f20 secure :-1 s=THROTTLE_DONE pgs=975 cs=0 l=1 rx=0x55570ab237e0 tx=0x7f732000e790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 -- 172.21.15.63:0/3560012799 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7320004c70 con 0x7f7308003a70 2020-05-18T21:33:34.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7324ed2700 1 -- 172.21.15.63:0/3560012799 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7320004e20 con 0x7f7308003a70 2020-05-18T21:33:34.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7328a93b80 1 -- 172.21.15.63:0/3560012799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7308003a70 msgr2=0x7f7308003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.608+0000 7f7328a93b80 1 --2- 172.21.15.63:0/3560012799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7308003a70 0x7f7308003f20 secure :-1 s=READY pgs=975 cs=0 l=1 rx=0x55570ab237e0 tx=0x7f732000e790).stop 2020-05-18T21:33:34.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.612+0000 7f7328a93b80 1 -- 172.21.15.63:0/3560012799 shutdown_connections 2020-05-18T21:33:34.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.612+0000 7f7328a93b80 1 --2- 172.21.15.63:0/3560012799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7308003a70 0x7f7308003f20 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.612+0000 7f7328a93b80 1 -- 172.21.15.63:0/3560012799 >> 172.21.15.63:0/3560012799 conn(0x55570ab43640 msgr2=0x55570ab04180 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:34.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.612+0000 7f7328a93b80 1 -- 172.21.15.63:0/3560012799 shutdown_connections 2020-05-18T21:33:34.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.612+0000 7f7328a93b80 1 -- 172.21.15.63:0/3560012799 wait complete. 2020-05-18T21:33:34.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.612+0000 7f7328a93b80 1 Processor -- start 2020-05-18T21:33:34.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.612+0000 7f7328a93b80 1 -- start start 2020-05-18T21:33:34.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.612+0000 7f7328a93b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x55570ab3abc0 0x55570ab42880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.612+0000 7f7328a93b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55570ab3c260 0x55570ab3c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.612+0000 7f7328a93b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55570abc7cf0 con 0x7f7308003a70 2020-05-18T21:33:34.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.612+0000 7f7328a93b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x55570aa7ea40 con 0x55570ab3abc0 2020-05-18T21:33:34.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.612+0000 7f7328a93b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55570ab3d700 con 0x55570ab3c260 2020-05-18T21:33:34.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.612+0000 7f7326ed6700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7308003a70 0x55570ab04330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34656/0 (socket says 172.21.15.63:34656) 2020-05-18T21:33:34.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.612+0000 7f7326ed6700 1 -- 172.21.15.63:0/3640368163 learned_addr learned my addr 172.21.15.63:0/3640368163 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:34.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f73276d7700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55570ab3c260 0x55570ab3c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f73266d5700 1 --2- 172.21.15.63:0/3640368163 >> v2:172.21.15.155:3300/0 conn(0x55570ab3abc0 0x55570ab42880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f731ffff700 1 -- 172.21.15.63:0/3640368163 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254982264 0 0) 0x55570abc7cf0 con 0x7f7308003a70 2020-05-18T21:33:34.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f731ffff700 1 -- 172.21.15.63:0/3640368163 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7308002360 con 0x7f7308003a70 2020-05-18T21:33:34.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f731ffff700 1 -- 172.21.15.63:0/3640368163 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 742600270 0 0) 0x7f7308002360 con 0x7f7308003a70 2020-05-18T21:33:34.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f731ffff700 1 -- 172.21.15.63:0/3640368163 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x55570abc7cf0 con 0x7f7308003a70 2020-05-18T21:33:34.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f731ffff700 1 -- 172.21.15.63:0/3640368163 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f7310001e40 con 0x7f7308003a70 2020-05-18T21:33:34.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f731ffff700 1 -- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55570ab3c260 msgr2=0x55570ab3c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f731ffff700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55570ab3c260 0x55570ab3c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f731ffff700 1 -- 172.21.15.63:0/3640368163 >> v2:172.21.15.155:3300/0 conn(0x55570ab3abc0 msgr2=0x55570ab42880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f731ffff700 1 --2- 172.21.15.63:0/3640368163 >> v2:172.21.15.155:3300/0 conn(0x55570ab3abc0 0x55570ab42880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f731ffff700 1 -- 172.21.15.63:0/3640368163 >> v1:172.21.15.63:6789/0 conn(0x7f7308003a70 legacy=0x55570ab04330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f731ffff700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7308002bb0 0x7f7308003e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f731ffff700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7308006450 0x7f73080088e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f731ffff700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7308008d40 0x7f73080091a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f731ffff700 1 -- 172.21.15.63:0/3640368163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570aa7ea40 con 0x7f7308008d40 2020-05-18T21:33:34.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f731ffff700 1 -- 172.21.15.63:0/3640368163 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570ab3d700 con 0x7f7308006450 2020-05-18T21:33:34.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f731ffff700 1 -- 172.21.15.63:0/3640368163 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7308003790 con 0x7f7308002bb0 2020-05-18T21:33:34.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f73276d7700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55570ab3c260 0x55570ab3c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:34.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f7326ed6700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7308002bb0 0x7f7308003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f73266d5700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7308006450 0x7f73080088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f73276d7700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7308008d40 0x7f73080091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f73276d7700 1 -- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7308002bb0 msgr2=0x7f7308003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f73276d7700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7308002bb0 0x7f7308003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f73276d7700 1 -- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7308006450 msgr2=0x7f73080088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f73276d7700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7308006450 0x7f73080088e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f73276d7700 1 -- 172.21.15.63:0/3640368163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55570ab270e0 con 0x7f7308008d40 2020-05-18T21:33:34.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f73266d5700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7308006450 0x7f73080088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:34.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f7328a93b80 1 -- 172.21.15.63:0/3640368163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55570ab386e0 con 0x7f7308008d40 2020-05-18T21:33:34.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f73276d7700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7308008d40 0x7f73080091a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7308003920 tx=0x7f732000e790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f7328a93b80 1 -- 172.21.15.63:0/3640368163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55570ab3c410 con 0x7f7308008d40 2020-05-18T21:33:34.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f73276d7700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7308008d40 0x7f73080091a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7308003920 tx=0x7f732000e790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f73276d7700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7308008d40 0x7f73080091a0 secure :-1 s=READY pgs=1452 cs=0 l=1 rx=0x7f7308003920 tx=0x7f732000e790).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f73276d7700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7308008d40 0x7f73080091a0 secure :-1 s=THROTTLE_DONE pgs=1452 cs=0 l=1 rx=0x7f7308003920 tx=0x7f732000e790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f731ffff700 1 -- 172.21.15.63:0/3640368163 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f732000ddd0 con 0x7f7308008d40 2020-05-18T21:33:34.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f73276d7700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7308008d40 0x7f73080091a0 secure :-1 s=THROTTLE_DONE pgs=1452 cs=0 l=1 rx=0x7f7308003920 tx=0x7f732000e790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f73276d7700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7308008d40 0x7f73080091a0 secure :-1 s=THROTTLE_DONE pgs=1452 cs=0 l=1 rx=0x7f7308003920 tx=0x7f732000e790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f731ffff700 1 -- 172.21.15.63:0/3640368163 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73200132f0 con 0x7f7308008d40 2020-05-18T21:33:34.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f731ffff700 1 -- 172.21.15.63:0/3640368163 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73200136d0 con 0x7f7308008d40 2020-05-18T21:33:34.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.616+0000 7f73276d7700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7308008d40 0x7f73080091a0 secure :-1 s=THROTTLE_DONE pgs=1452 cs=0 l=1 rx=0x7f7308003920 tx=0x7f732000e790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.620+0000 7f731ffff700 1 -- 172.21.15.63:0/3640368163 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7320013830 con 0x7f7308008d40 2020-05-18T21:33:34.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.620+0000 7f73276d7700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7308008d40 0x7f73080091a0 secure :-1 s=THROTTLE_DONE pgs=1452 cs=0 l=1 rx=0x7f7308003920 tx=0x7f732000e790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.620+0000 7f731ffff700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7308058160 0x7f730805a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.620+0000 7f731ffff700 1 -- 172.21.15.63:0/3640368163 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7320062f30 con 0x7f7308008d40 2020-05-18T21:33:34.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.620+0000 7f7326ed6700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7308058160 0x7f730805a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.620+0000 7f7328a93b80 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x55570abe3cf0 0x55570abe60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:34.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.620+0000 7f7328a93b80 1 -- 172.21.15.63:0/3640368163 --> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] -- osd_op(unknown.0.0:1 20.7 20:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected e104) v8 -- 0x55570abe6540 con 0x55570abe3cf0 2020-05-18T21:33:34.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.620+0000 7f7326ed6700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7308058160 0x7f730805a620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f73100018e0 tx=0x55570ab417d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.620+0000 7f73266d5700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x55570abe3cf0 0x55570abe60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:34.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.620+0000 7f7326ed6700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7308058160 0x7f730805a620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f73100018e0 tx=0x55570ab417d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:34.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.620+0000 7f7326ed6700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7308058160 0x7f730805a620 secure :-1 s=READY pgs=566 cs=0 l=1 rx=0x7f73100018e0 tx=0x55570ab417d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.620+0000 7f73266d5700 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x55570abe3cf0 0x55570abe60e0 crc :-1 s=READY pgs=24 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:34.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.620+0000 7f73266d5700 1 -- 172.21.15.63:0/3640368163 <== osd.7 v2:172.21.15.155:6823/13026 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (64) out=64b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+64 (crc 0 0 0) 0x7f731800a840 con 0x55570abe3cf0 2020-05-18T21:33:34.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.620+0000 7f7328a93b80 1 -- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x55570abe3cf0 msgr2=0x55570abe60e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.620+0000 7f7328a93b80 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x55570abe3cf0 0x55570abe60e0 crc :-1 s=READY pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.620+0000 7f73276d7700 1 -- 172.21.15.63:0/3640368163 reap_dead start 2020-05-18T21:33:34.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.620+0000 7f7328a93b80 1 -- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7308058160 msgr2=0x7f730805a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.620+0000 7f7328a93b80 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7308058160 0x7f730805a620 secure :-1 s=READY pgs=566 cs=0 l=1 rx=0x7f73100018e0 tx=0x55570ab417d0).stop 2020-05-18T21:33:34.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.624+0000 7f7328a93b80 1 -- 172.21.15.63:0/3640368163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7308008d40 msgr2=0x7f73080091a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:34.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.624+0000 7f7328a93b80 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7308008d40 0x7f73080091a0 secure :-1 s=READY pgs=1452 cs=0 l=1 rx=0x7f7308003920 tx=0x7f732000e790).stop 2020-05-18T21:33:34.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.624+0000 7f7328a93b80 1 -- 172.21.15.63:0/3640368163 shutdown_connections 2020-05-18T21:33:34.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.624+0000 7f7328a93b80 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7308058160 0x7f730805a620 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.624+0000 7f7328a93b80 1 --2- 172.21.15.63:0/3640368163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7308008d40 0x7f73080091a0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:34.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.624+0000 7f7328a93b80 1 -- 172.21.15.63:0/3640368163 >> 172.21.15.63:0/3640368163 conn(0x55570ab43640 msgr2=0x55570abcc970 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:34.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.624+0000 7f7328a93b80 1 -- 172.21.15.63:0/3640368163 shutdown_connections 2020-05-18T21:33:34.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:34.624+0000 7f7328a93b80 1 -- 172.21.15.63:0/3640368163 wait complete. 2020-05-18T21:33:34.647 INFO:teuthology.orchestra.run.smithi063.stdout::linkto_b 2020-05-18T21:33:34.647 INFO:teuthology.orchestra.run.smithi063:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2020-05-18T21:33:34.716 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:34.716 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1099511627777, 2020-05-18T21:33:34.716 INFO:teuthology.orchestra.run.smithi063.stdout: "ancestors": [ 2020-05-18T21:33:34.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:34.717 INFO:teuthology.orchestra.run.smithi063.stdout: "dirino": 1, 2020-05-18T21:33:34.717 INFO:teuthology.orchestra.run.smithi063.stdout: "dname": "linkto_b", 2020-05-18T21:33:34.717 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 27 2020-05-18T21:33:34.717 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:34.718 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:33:34.718 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 20, 2020-05-18T21:33:34.718 INFO:teuthology.orchestra.run.smithi063.stdout: "old_pools": [] 2020-05-18T21:33:34.718 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:34.718 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:34.719 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:33:34.720 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:33:34.736 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:33:34.765 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:33:34.765 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:33:34.766 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:33:34.766 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:33:34.783 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[30852]: fuse finished with error 0 and tester_r 0 2020-05-18T21:33:34.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:34.789 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:33:34.839 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:33:34.839 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:33:34.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:34.840 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 down' 2020-05-18T21:33:34.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:34.867 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.0' 2020-05-18T21:33:34.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:34.947 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:33:35.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:35.008 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:33:35.016 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:33:35.016 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:33:35.016 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:33:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:33:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:35.017 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.018 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:35.018 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.018 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:35.018 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.018 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:33:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:33:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42428sec preferred_lft 42428sec 2020-05-18T21:33:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:33:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:35.020 INFO:teuthology.orchestra.run.smithi063.stdout:29: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-05-18T21:33:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:33:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::80ff:a3ff:fe6b:e85a/64 scope link 2020-05-18T21:33:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:35.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:35.022 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:33:35.037 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:33:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:33:35.038 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:33:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.039 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:33:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.040 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:33:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.040 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:33:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.041 INFO:teuthology.orchestra.run.smithi063.stdout:29: ceph-brx: mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:33:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.043 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:33:35.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:35.044 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:33:35.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:35.106 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:33:35.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:35.247 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:33:35.257 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:33:35.258 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:33:35.258 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:33:35.258 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:33:35.258 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:33:35.259 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:33:35.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:35.260 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:33:35.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:35.317 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:33:35.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:35.333 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:33:35.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:35.346 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:33:35.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:35.400 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:33:35.406 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-05-18T21:33:35.407 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:33:35.407 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-05-18T21:33:35.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:35.408 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:33:35.414 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:33:35.414 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:33:35.414 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:33:35.415 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:35.415 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:33:35.415 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:35.415 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:35.415 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.416 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:35.416 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.416 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:35.416 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.416 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:33:35.416 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.417 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:33:35.417 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42427sec preferred_lft 42427sec 2020-05-18T21:33:35.417 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:33:35.417 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:35.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:35.418 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:33:35.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:35.464 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:33:35.471 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2020-05-18T21:33:35.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:33:35.472 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-05-18T21:33:35.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:35.473 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:33:35.480 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:33:35.480 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:33:35.480 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:33:35.480 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:35.481 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:33:35.481 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:35.481 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:35.481 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.481 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:35.481 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.482 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:35.482 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.482 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:33:35.482 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.482 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:33:35.483 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42432sec preferred_lft 42432sec 2020-05-18T21:33:35.483 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:33:35.483 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:35.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:35.484 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:33:35.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:35.492 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:33:35.539 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2020-05-18T21:33:35.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:33:35.541 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-05-18T21:33:35.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:35.542 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:33:35.549 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:33:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:33:35.550 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:33:35.550 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:35.550 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:33:35.550 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:35.550 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:35.551 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.551 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:35.551 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.551 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:35.551 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.552 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:33:35.552 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:35.552 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:33:35.552 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42431sec preferred_lft 42431sec 2020-05-18T21:33:35.552 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:33:35.552 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:35.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:35.553 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:33:35.560 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_strays.TestStrays.test_mv_hardlink_cleanup' 2020-05-18T21:33:35.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84c77e700 1 Processor -- start 2020-05-18T21:33:35.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84c77e700 1 -- start start 2020-05-18T21:33:35.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84c77e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd84414aeb0 0x7fd84414b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:35.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84c77e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8440ad9d0 con 0x7fd844147ab0 2020-05-18T21:33:35.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84c77e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8440adc70 con 0x7fd8440614c0 2020-05-18T21:33:35.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84c77e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd844147e90 con 0x7fd84414aeb0 2020-05-18T21:33:35.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84ad1b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd84414aeb0 0x7fd84414b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:35.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84a51a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd844147ab0 0x7fd8440ae110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34674/0 (socket says 172.21.15.63:34674) 2020-05-18T21:33:35.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84a51a700 1 -- 172.21.15.63:0/257994742 learned_addr learned my addr 172.21.15.63:0/257994742 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:35.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84ad1b700 1 -- 172.21.15.63:0/257994742 >> v1:172.21.15.155:6789/0 conn(0x7fd8440614c0 legacy=0x7fd844060850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:35.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84ad1b700 1 -- 172.21.15.63:0/257994742 >> v1:172.21.15.63:6789/0 conn(0x7fd844147ab0 legacy=0x7fd8440ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:35.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84ad1b700 1 -- 172.21.15.63:0/257994742 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8440ae820 con 0x7fd84414aeb0 2020-05-18T21:33:35.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84ad1b700 1 --2- 172.21.15.63:0/257994742 >> v2:172.21.15.63:3300/0 conn(0x7fd84414aeb0 0x7fd84414b640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd83c0032f0 tx=0x7fd83c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:35.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84ad1b700 1 --2- 172.21.15.63:0/257994742 >> v2:172.21.15.63:3300/0 conn(0x7fd84414aeb0 0x7fd84414b640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd83c0032f0 tx=0x7fd83c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:35.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84ad1b700 1 --2- 172.21.15.63:0/257994742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd84414aeb0 0x7fd84414b640 secure :-1 s=READY pgs=1454 cs=0 l=1 rx=0x7fd83c0032f0 tx=0x7fd83c007e00).ready entity=mon.0 client_cookie=d97fc67b418401ca server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:35.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84ad1b700 1 --2- 172.21.15.63:0/257994742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd84414aeb0 0x7fd84414b640 secure :-1 s=THROTTLE_DONE pgs=1454 cs=0 l=1 rx=0x7fd83c0032f0 tx=0x7fd83c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:35.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd849518700 1 -- 172.21.15.63:0/257994742 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd83c00a180 con 0x7fd84414aeb0 2020-05-18T21:33:35.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84ad1b700 1 --2- 172.21.15.63:0/257994742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd84414aeb0 0x7fd84414b640 secure :-1 s=THROTTLE_DONE pgs=1454 cs=0 l=1 rx=0x7fd83c0032f0 tx=0x7fd83c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:35.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84ad1b700 1 --2- 172.21.15.63:0/257994742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd84414aeb0 0x7fd84414b640 secure :-1 s=THROTTLE_DONE pgs=1454 cs=0 l=1 rx=0x7fd83c0032f0 tx=0x7fd83c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:35.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd849518700 1 -- 172.21.15.63:0/257994742 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c00a2e0 con 0x7fd84414aeb0 2020-05-18T21:33:35.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd849518700 1 -- 172.21.15.63:0/257994742 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd83c00a700 con 0x7fd84414aeb0 2020-05-18T21:33:35.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84c77e700 1 -- 172.21.15.63:0/257994742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd84414aeb0 msgr2=0x7fd84414b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:35.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84c77e700 1 --2- 172.21.15.63:0/257994742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd84414aeb0 0x7fd84414b640 secure :-1 s=READY pgs=1454 cs=0 l=1 rx=0x7fd83c0032f0 tx=0x7fd83c007e00).stop 2020-05-18T21:33:35.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84c77e700 1 -- 172.21.15.63:0/257994742 shutdown_connections 2020-05-18T21:33:35.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84c77e700 1 --2- 172.21.15.63:0/257994742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd84414aeb0 0x7fd84414b640 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:35.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84c77e700 1 -- 172.21.15.63:0/257994742 >> 172.21.15.63:0/257994742 conn(0x7fd844069b70 msgr2=0x7fd844069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:35.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84c77e700 1 -- 172.21.15.63:0/257994742 shutdown_connections 2020-05-18T21:33:35.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.668+0000 7fd84c77e700 1 -- 172.21.15.63:0/257994742 wait complete. 2020-05-18T21:33:35.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.672+0000 7fd84c77e700 1 Processor -- start 2020-05-18T21:33:35.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.672+0000 7fd84c77e700 1 -- start start 2020-05-18T21:33:35.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.672+0000 7fd84c77e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd8440614c0 0x7fd8440afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:35.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.672+0000 7fd84c77e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd844147ab0 0x7fd8440b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:35.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.672+0000 7fd84c77e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8440b5090 con 0x7fd84414aeb0 2020-05-18T21:33:35.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.672+0000 7fd84c77e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8440b26a0 con 0x7fd8440614c0 2020-05-18T21:33:35.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.672+0000 7fd84c77e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440b5960 con 0x7fd844147ab0 2020-05-18T21:33:35.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.672+0000 7fd84a51a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd8440614c0 0x7fd8440afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:35.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.672+0000 7fd84ad1b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd84414aeb0 0x7fd84415a0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34680/0 (socket says 172.21.15.63:34680) 2020-05-18T21:33:35.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.672+0000 7fd84ad1b700 1 -- 172.21.15.63:0/3430564870 learned_addr learned my addr 172.21.15.63:0/3430564870 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:35.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.672+0000 7fd849d19700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd844147ab0 0x7fd8440b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:35.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd84a51a700 1 -- 172.21.15.63:0/3430564870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd844147ab0 msgr2=0x7fd8440b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:35.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd8337fe700 1 -- 172.21.15.63:0/3430564870 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248855118 0 0) 0x7fd8440b5090 con 0x7fd84414aeb0 2020-05-18T21:33:35.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd84a51a700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd844147ab0 0x7fd8440b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:35.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd84a51a700 1 -- 172.21.15.63:0/3430564870 >> v1:172.21.15.63:6789/0 conn(0x7fd84414aeb0 legacy=0x7fd84415a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:35.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd84a51a700 1 -- 172.21.15.63:0/3430564870 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84415ba30 con 0x7fd8440614c0 2020-05-18T21:33:35.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd84a51a700 1 --2- 172.21.15.63:0/3430564870 >> v2:172.21.15.63:3300/0 conn(0x7fd8440614c0 0x7fd8440afa70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd84405fb40 tx=0x7fd8400108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:35.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd84a51a700 1 --2- 172.21.15.63:0/3430564870 >> v2:172.21.15.63:3300/0 conn(0x7fd8440614c0 0x7fd8440afa70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd84405fb40 tx=0x7fd8400108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:35.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd84a51a700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8440614c0 0x7fd8440afa70 secure :-1 s=READY pgs=1456 cs=0 l=1 rx=0x7fd84405fb40 tx=0x7fd8400108b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:35.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd84a51a700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8440614c0 0x7fd8440afa70 secure :-1 s=THROTTLE_DONE pgs=1456 cs=0 l=1 rx=0x7fd84405fb40 tx=0x7fd8400108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:35.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd8337fe700 1 -- 172.21.15.63:0/3430564870 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd840005ce0 con 0x7fd8440614c0 2020-05-18T21:33:35.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd84a51a700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8440614c0 0x7fd8440afa70 secure :-1 s=THROTTLE_DONE pgs=1456 cs=0 l=1 rx=0x7fd84405fb40 tx=0x7fd8400108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:35.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd8337fe700 1 -- 172.21.15.63:0/3430564870 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd840005e40 con 0x7fd8440614c0 2020-05-18T21:33:35.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd84a51a700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8440614c0 0x7fd8440afa70 secure :-1 s=THROTTLE_DONE pgs=1456 cs=0 l=1 rx=0x7fd84405fb40 tx=0x7fd8400108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:35.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd84c77e700 1 -- 172.21.15.63:0/3430564870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84415bcd0 con 0x7fd8440614c0 2020-05-18T21:33:35.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd8337fe700 1 -- 172.21.15.63:0/3430564870 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8400062c0 con 0x7fd8440614c0 2020-05-18T21:33:35.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd84c77e700 1 -- 172.21.15.63:0/3430564870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84415a830 con 0x7fd8440614c0 2020-05-18T21:33:35.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd84a51a700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8440614c0 0x7fd8440afa70 secure :-1 s=THROTTLE_DONE pgs=1456 cs=0 l=1 rx=0x7fd84405fb40 tx=0x7fd8400108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:35.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd84c77e700 1 -- 172.21.15.63:0/3430564870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8440569e0 con 0x7fd8440614c0 2020-05-18T21:33:35.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd8337fe700 1 -- 172.21.15.63:0/3430564870 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd840006540 con 0x7fd8440614c0 2020-05-18T21:33:35.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd84a51a700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8440614c0 0x7fd8440afa70 secure :-1 s=THROTTLE_DONE pgs=1456 cs=0 l=1 rx=0x7fd84405fb40 tx=0x7fd8400108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:35.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd8337fe700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd82404f830 0x7fd824051cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:35.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd8337fe700 1 -- 172.21.15.63:0/3430564870 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd8400090c0 con 0x7fd8440614c0 2020-05-18T21:33:35.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.676+0000 7fd849d19700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd82404f830 0x7fd824051cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:35.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.680+0000 7fd849d19700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd82404f830 0x7fd824051cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd844060490 tx=0x7fd83400c860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:35.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.680+0000 7fd849d19700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd82404f830 0x7fd824051cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd844060490 tx=0x7fd83400c860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:35.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.680+0000 7fd849d19700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd82404f830 0x7fd824051cf0 secure :-1 s=READY pgs=567 cs=0 l=1 rx=0x7fd844060490 tx=0x7fd83400c860).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:35.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.688+0000 7fd84a51a700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8440614c0 0x7fd8440afa70 secure :-1 s=THROTTLE_DONE pgs=1456 cs=0 l=1 rx=0x7fd84405fb40 tx=0x7fd8400108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:35.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.688+0000 7fd8337fe700 1 -- 172.21.15.63:0/3430564870 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd84003e160 con 0x7fd8440614c0 2020-05-18T21:33:35.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:35.840+0000 7fd84c77e700 1 -- 172.21.15.63:0/3430564870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_mv_hardlink_cleanup"]} v 0) v1 -- 0x7fd8440008d0 con 0x7fd8440614c0 2020-05-18T21:33:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.235+0000 7fd84a51a700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8440614c0 0x7fd8440afa70 secure :-1 s=THROTTLE_DONE pgs=1456 cs=0 l=1 rx=0x7fd84405fb40 tx=0x7fd8400108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.235+0000 7fd8337fe700 1 -- 172.21.15.63:0/3430564870 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_mv_hardlink_cleanup"]}]=0 v346) v1 ==== 139+0+0 (secure 0 0 0) 0x7fd840041780 con 0x7fd8440614c0 2020-05-18T21:33:36.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.239+0000 7fd84c77e700 1 -- 172.21.15.63:0/3430564870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd82404f830 msgr2=0x7fd824051cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:36.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.239+0000 7fd84c77e700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd82404f830 0x7fd824051cf0 secure :-1 s=READY pgs=567 cs=0 l=1 rx=0x7fd844060490 tx=0x7fd83400c860).stop 2020-05-18T21:33:36.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.239+0000 7fd84c77e700 1 -- 172.21.15.63:0/3430564870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8440614c0 msgr2=0x7fd8440afa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.239+0000 7fd84c77e700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8440614c0 0x7fd8440afa70 secure :-1 s=READY pgs=1456 cs=0 l=1 rx=0x7fd84405fb40 tx=0x7fd8400108b0).stop 2020-05-18T21:33:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.239+0000 7fd84c77e700 1 -- 172.21.15.63:0/3430564870 shutdown_connections 2020-05-18T21:33:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.239+0000 7fd84c77e700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd82404f830 0x7fd824051cf0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.239+0000 7fd84c77e700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd844147ab0 0x7fd8440b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:36.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.239+0000 7fd84c77e700 1 --2- 172.21.15.63:0/3430564870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8440614c0 0x7fd8440afa70 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:36.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.239+0000 7fd84c77e700 1 -- 172.21.15.63:0/3430564870 >> 172.21.15.63:0/3430564870 conn(0x7fd844069b70 msgr2=0x7fd8441468a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:36.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.239+0000 7fd84c77e700 1 -- 172.21.15.63:0/3430564870 shutdown_connections 2020-05-18T21:33:36.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.239+0000 7fd84c77e700 1 -- 172.21.15.63:0/3430564870 wait complete. 2020-05-18T21:33:36.261 INFO:tasks.cephfs_test_runner:test_mv_hardlink_cleanup (tasks.cephfs.test_strays.TestStrays) ... ok 2020-05-18T21:33:36.261 INFO:tasks.cephfs_test_runner:Starting test: test_open_inode (tasks.cephfs.test_strays.TestStrays) 2020-05-18T21:33:36.262 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_strays.TestStrays.test_open_inode' 2020-05-18T21:33:36.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.363+0000 7fe0cd2da700 1 Processor -- start 2020-05-18T21:33:36.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.363+0000 7fe0cd2da700 1 -- start start 2020-05-18T21:33:36.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0cd2da700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe0c809d4a0 0x7fe0c809b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:36.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0cd2da700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0c8099120 0x7fe0c809c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:36.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0cd2da700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe0c809cb60 0x7fe0c80b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:36.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0cd2da700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c809bd20 con 0x7fe0c809d4a0 2020-05-18T21:33:36.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0cd2da700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c809bfc0 con 0x7fe0c809cb60 2020-05-18T21:33:36.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0cd2da700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c809c260 con 0x7fe0c8099120 2020-05-18T21:33:36.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0c7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe0c809d4a0 0x7fe0c809b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:36.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0c7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe0c809d4a0 0x7fe0c809b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60730/0 (socket says 172.21.15.63:60730) 2020-05-18T21:33:36.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0c7fff700 1 -- 172.21.15.63:0/4073674642 learned_addr learned my addr 172.21.15.63:0/4073674642 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:36.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0c77fe700 1 --2- 172.21.15.63:0/4073674642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0c8099120 0x7fe0c809c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:36.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0ccad9700 1 --2- 172.21.15.63:0/4073674642 >> v2:172.21.15.155:3300/0 conn(0x7fe0c809cb60 0x7fe0c80b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:36.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0c7fff700 1 -- 172.21.15.63:0/4073674642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0c8099120 msgr2=0x7fe0c809c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:36.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/4073674642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0c8099120 0x7fe0c809c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:36.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0c7fff700 1 -- 172.21.15.63:0/4073674642 >> v2:172.21.15.155:3300/0 conn(0x7fe0c809cb60 msgr2=0x7fe0c80b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:36.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/4073674642 >> v2:172.21.15.155:3300/0 conn(0x7fe0c809cb60 0x7fe0c80b4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:36.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0c7fff700 1 -- 172.21.15.63:0/4073674642 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c809dbc0 con 0x7fe0c809d4a0 2020-05-18T21:33:36.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/4073674642 >> v2:172.21.15.63:3300/0 conn(0x7fe0c809d4a0 0x7fe0c809b5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe0b80032f0 tx=0x7fe0b8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:36.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/4073674642 >> v2:172.21.15.63:3300/0 conn(0x7fe0c809d4a0 0x7fe0c809b5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe0b80032f0 tx=0x7fe0b8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:36.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/4073674642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c809d4a0 0x7fe0c809b5d0 secure :-1 s=READY pgs=1457 cs=0 l=1 rx=0x7fe0b80032f0 tx=0x7fe0b8007e00).ready entity=mon.0 client_cookie=fba16d6e57ad01b0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:36.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/4073674642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c809d4a0 0x7fe0c809b5d0 secure :-1 s=THROTTLE_DONE pgs=1457 cs=0 l=1 rx=0x7fe0b80032f0 tx=0x7fe0b8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:36.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0c6ffd700 1 -- 172.21.15.63:0/4073674642 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b8011c60 con 0x7fe0c809d4a0 2020-05-18T21:33:36.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/4073674642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c809d4a0 0x7fe0c809b5d0 secure :-1 s=THROTTLE_DONE pgs=1457 cs=0 l=1 rx=0x7fe0b80032f0 tx=0x7fe0b8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:36.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0c6ffd700 1 -- 172.21.15.63:0/4073674642 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b8011dc0 con 0x7fe0c809d4a0 2020-05-18T21:33:36.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0cd2da700 1 -- 172.21.15.63:0/4073674642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c809d4a0 msgr2=0x7fe0c809b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:36.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/4073674642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c809d4a0 0x7fe0c809b5d0 secure :-1 s=THROTTLE_DONE pgs=1457 cs=0 l=1 rx=0x7fe0b80032f0 tx=0x7fe0b8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:36.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0c6ffd700 1 -- 172.21.15.63:0/4073674642 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b800a370 con 0x7fe0c809d4a0 2020-05-18T21:33:36.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.367+0000 7fe0cd2da700 1 --2- 172.21.15.63:0/4073674642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c809d4a0 0x7fe0c809b5d0 secure :-1 s=READY pgs=1457 cs=0 l=1 rx=0x7fe0b80032f0 tx=0x7fe0b8007e00).stop 2020-05-18T21:33:36.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.371+0000 7fe0cd2da700 1 -- 172.21.15.63:0/4073674642 shutdown_connections 2020-05-18T21:33:36.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.371+0000 7fe0cd2da700 1 --2- 172.21.15.63:0/4073674642 >> v2:172.21.15.155:3300/0 conn(0x7fe0c809cb60 0x7fe0c80b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:36.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.371+0000 7fe0cd2da700 1 --2- 172.21.15.63:0/4073674642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0c8099120 0x7fe0c809c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:36.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.371+0000 7fe0cd2da700 1 --2- 172.21.15.63:0/4073674642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c809d4a0 0x7fe0c809b5d0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:36.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.371+0000 7fe0cd2da700 1 -- 172.21.15.63:0/4073674642 >> 172.21.15.63:0/4073674642 conn(0x7fe0c805f630 msgr2=0x7fe0c805a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:36.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.371+0000 7fe0cd2da700 1 -- 172.21.15.63:0/4073674642 shutdown_connections 2020-05-18T21:33:36.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.371+0000 7fe0cd2da700 1 -- 172.21.15.63:0/4073674642 wait complete. 2020-05-18T21:33:36.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.371+0000 7fe0cd2da700 1 Processor -- start 2020-05-18T21:33:36.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.371+0000 7fe0cd2da700 1 -- start start 2020-05-18T21:33:36.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0cd2da700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe0c8099120 0x7fe0c813ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:36.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0cd2da700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe0c809cb60 0x7fe0c8142790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:36.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0cd2da700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0c809d4a0 0x7fe0c8142bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:36.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0cd2da700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c813f130 con 0x7fe0c8099120 2020-05-18T21:33:36.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0cd2da700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c8142050 con 0x7fe0c809cb60 2020-05-18T21:33:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0cd2da700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c81422f0 con 0x7fe0c809d4a0 2020-05-18T21:33:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0c7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe0c8099120 0x7fe0c813ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0c7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe0c8099120 0x7fe0c813ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60736/0 (socket says 172.21.15.63:60736) 2020-05-18T21:33:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0c7fff700 1 -- 172.21.15.63:0/208111316 learned_addr learned my addr 172.21.15.63:0/208111316 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0ccad9700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0c809d4a0 0x7fe0c8142bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0c77fe700 1 --2- 172.21.15.63:0/208111316 >> v2:172.21.15.155:3300/0 conn(0x7fe0c809cb60 0x7fe0c8142790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:36.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0c7fff700 1 -- 172.21.15.63:0/208111316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0c809d4a0 msgr2=0x7fe0c8142bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:36.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0c809d4a0 0x7fe0c8142bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:36.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0c7fff700 1 -- 172.21.15.63:0/208111316 >> v2:172.21.15.155:3300/0 conn(0x7fe0c809cb60 msgr2=0x7fe0c8142790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:36.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/208111316 >> v2:172.21.15.155:3300/0 conn(0x7fe0c809cb60 0x7fe0c8142790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:36.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0c7fff700 1 -- 172.21.15.63:0/208111316 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c8145a90 con 0x7fe0c8099120 2020-05-18T21:33:36.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0c77fe700 1 --2- 172.21.15.63:0/208111316 >> v2:172.21.15.155:3300/0 conn(0x7fe0c809cb60 0x7fe0c8142790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:36.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/208111316 >> v2:172.21.15.63:3300/0 conn(0x7fe0c8099120 0x7fe0c813ecd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe0b80032f0 tx=0x7fe0b8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:36.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/208111316 >> v2:172.21.15.63:3300/0 conn(0x7fe0c8099120 0x7fe0c813ecd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe0b80032f0 tx=0x7fe0b8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:36.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c8099120 0x7fe0c813ecd0 secure :-1 s=READY pgs=1458 cs=0 l=1 rx=0x7fe0b80032f0 tx=0x7fe0b8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:36.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c8099120 0x7fe0c813ecd0 secure :-1 s=THROTTLE_DONE pgs=1458 cs=0 l=1 rx=0x7fe0b80032f0 tx=0x7fe0b8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:36.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c8099120 0x7fe0c813ecd0 secure :-1 s=THROTTLE_DONE pgs=1458 cs=0 l=1 rx=0x7fe0b80032f0 tx=0x7fe0b8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:36.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0c57fa700 1 -- 172.21.15.63:0/208111316 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b8005a80 con 0x7fe0c8099120 2020-05-18T21:33:36.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c8099120 0x7fe0c813ecd0 secure :-1 s=THROTTLE_DONE pgs=1458 cs=0 l=1 rx=0x7fe0b80032f0 tx=0x7fe0b8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:36.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0c57fa700 1 -- 172.21.15.63:0/208111316 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b8005be0 con 0x7fe0c8099120 2020-05-18T21:33:36.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0c57fa700 1 -- 172.21.15.63:0/208111316 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b8007170 con 0x7fe0c8099120 2020-05-18T21:33:36.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0cd2da700 1 -- 172.21.15.63:0/208111316 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c80b9840 con 0x7fe0c8099120 2020-05-18T21:33:36.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.375+0000 7fe0cd2da700 1 -- 172.21.15.63:0/208111316 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c80b9450 con 0x7fe0c8099120 2020-05-18T21:33:36.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.379+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c8099120 0x7fe0c813ecd0 secure :-1 s=THROTTLE_DONE pgs=1458 cs=0 l=1 rx=0x7fe0b80032f0 tx=0x7fe0b8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:36.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.379+0000 7fe0cd2da700 1 -- 172.21.15.63:0/208111316 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c80569e0 con 0x7fe0c8099120 2020-05-18T21:33:36.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.379+0000 7fe0c57fa700 1 -- 172.21.15.63:0/208111316 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe0b80073e0 con 0x7fe0c8099120 2020-05-18T21:33:36.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.379+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c8099120 0x7fe0c813ecd0 secure :-1 s=THROTTLE_DONE pgs=1458 cs=0 l=1 rx=0x7fe0b80032f0 tx=0x7fe0b8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:36.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.379+0000 7fe0c57fa700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe0a804f9f0 0x7fe0a8051eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:36.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.379+0000 7fe0c57fa700 1 -- 172.21.15.63:0/208111316 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe0b8064800 con 0x7fe0c8099120 2020-05-18T21:33:36.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.379+0000 7fe0c77fe700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe0a804f9f0 0x7fe0a8051eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:36.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.379+0000 7fe0c77fe700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe0a804f9f0 0x7fe0a8051eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe0bc002f70 tx=0x7fe0bc00bd00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:36.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.379+0000 7fe0c77fe700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe0a804f9f0 0x7fe0a8051eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe0bc002f70 tx=0x7fe0bc00bd00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:36.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.379+0000 7fe0c77fe700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe0a804f9f0 0x7fe0a8051eb0 secure :-1 s=READY pgs=568 cs=0 l=1 rx=0x7fe0bc002f70 tx=0x7fe0bc00bd00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:36.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.383+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c8099120 0x7fe0c813ecd0 secure :-1 s=THROTTLE_DONE pgs=1458 cs=0 l=1 rx=0x7fe0b80032f0 tx=0x7fe0b8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:36.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.383+0000 7fe0c57fa700 1 -- 172.21.15.63:0/208111316 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe0b803ecb0 con 0x7fe0c8099120 2020-05-18T21:33:36.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:36.535+0000 7fe0cd2da700 1 -- 172.21.15.63:0/208111316 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_open_inode"]} v 0) v1 -- 0x7fe0c8145c80 con 0x7fe0c8099120 2020-05-18T21:33:37.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.243+0000 7fe0c7fff700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c8099120 0x7fe0c813ecd0 secure :-1 s=THROTTLE_DONE pgs=1458 cs=0 l=1 rx=0x7fe0b80032f0 tx=0x7fe0b8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.243+0000 7fe0c57fa700 1 -- 172.21.15.63:0/208111316 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_open_inode"]}]=0 v347) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe0b8007c60 con 0x7fe0c8099120 2020-05-18T21:33:37.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.247+0000 7fe0cd2da700 1 -- 172.21.15.63:0/208111316 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe0a804f9f0 msgr2=0x7fe0a8051eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:37.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.247+0000 7fe0cd2da700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe0a804f9f0 0x7fe0a8051eb0 secure :-1 s=READY pgs=568 cs=0 l=1 rx=0x7fe0bc002f70 tx=0x7fe0bc00bd00).stop 2020-05-18T21:33:37.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.247+0000 7fe0cd2da700 1 -- 172.21.15.63:0/208111316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c8099120 msgr2=0x7fe0c813ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:37.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.247+0000 7fe0cd2da700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c8099120 0x7fe0c813ecd0 secure :-1 s=READY pgs=1458 cs=0 l=1 rx=0x7fe0b80032f0 tx=0x7fe0b8007e00).stop 2020-05-18T21:33:37.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.247+0000 7fe0cd2da700 1 -- 172.21.15.63:0/208111316 shutdown_connections 2020-05-18T21:33:37.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.247+0000 7fe0cd2da700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe0a804f9f0 0x7fe0a8051eb0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:37.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.247+0000 7fe0cd2da700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0c809d4a0 0x7fe0c8142bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:37.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.247+0000 7fe0cd2da700 1 --2- 172.21.15.63:0/208111316 >> v2:172.21.15.155:3300/0 conn(0x7fe0c809cb60 0x7fe0c8142790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:37.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.247+0000 7fe0cd2da700 1 --2- 172.21.15.63:0/208111316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c8099120 0x7fe0c813ecd0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:37.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.247+0000 7fe0cd2da700 1 -- 172.21.15.63:0/208111316 >> 172.21.15.63:0/208111316 conn(0x7fe0c805f630 msgr2=0x7fe0c8140170 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:37.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.247+0000 7fe0cd2da700 1 -- 172.21.15.63:0/208111316 shutdown_connections 2020-05-18T21:33:37.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.251+0000 7fe0cd2da700 1 -- 172.21.15.63:0/208111316 wait complete. 2020-05-18T21:33:37.273 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:33:37.274 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:33:37.288 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:33:37.308 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:33:37.309 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-05-18T21:33:37.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.411+0000 7f47c6def700 1 Processor -- start 2020-05-18T21:33:37.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.411+0000 7f47c6def700 1 -- start start 2020-05-18T21:33:37.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.411+0000 7f47c6def700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47c0145df0 0x7f47c0142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:37.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.411+0000 7f47c6def700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c00b7020 con 0x7f47c01432f0 2020-05-18T21:33:37.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.411+0000 7f47c6def700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c00b72c0 con 0x7f47c00b93f0 2020-05-18T21:33:37.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.411+0000 7f47c6def700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c00b7560 con 0x7f47c0145df0 2020-05-18T21:33:37.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.411+0000 7f47c65ee700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f47c01432f0 0x7f47c0060430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34704/0 (socket says 172.21.15.63:34704) 2020-05-18T21:33:37.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.411+0000 7f47c65ee700 1 -- 172.21.15.63:0/2887580168 learned_addr learned my addr 172.21.15.63:0/2887580168 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:37.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.411+0000 7f47c55ec700 1 --2- 172.21.15.63:0/2887580168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47c0145df0 0x7f47c0142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:37.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c4deb700 1 -- 172.21.15.63:0/2887580168 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3352925761 0 0) 0x7f47c00b7020 con 0x7f47c01432f0 2020-05-18T21:33:37.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c4deb700 1 -- 172.21.15.63:0/2887580168 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47a8003270 con 0x7f47c01432f0 2020-05-18T21:33:37.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c55ec700 1 -- 172.21.15.63:0/2887580168 >> v1:172.21.15.155:6789/0 conn(0x7f47c00b93f0 legacy=0x7f47c00b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:37.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c55ec700 1 -- 172.21.15.63:0/2887580168 >> v1:172.21.15.63:6789/0 conn(0x7f47c01432f0 legacy=0x7f47c0060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:37.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c55ec700 1 -- 172.21.15.63:0/2887580168 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c00b7800 con 0x7f47c0145df0 2020-05-18T21:33:37.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c55ec700 1 --2- 172.21.15.63:0/2887580168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47c0145df0 0x7f47c0142e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f47b0002f70 tx=0x7f47b0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c55ec700 1 --2- 172.21.15.63:0/2887580168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47c0145df0 0x7f47c0142e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f47b0002f70 tx=0x7f47b0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c55ec700 1 --2- 172.21.15.63:0/2887580168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47c0145df0 0x7f47c0142e90 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7f47b0002f70 tx=0x7f47b0008920).ready entity=mon.2 client_cookie=88a3f13463d3ee61 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:37.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c55ec700 1 --2- 172.21.15.63:0/2887580168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47c0145df0 0x7f47c0142e90 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f47b0002f70 tx=0x7f47b0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c4deb700 1 -- 172.21.15.63:0/2887580168 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47b0008e80 con 0x7f47c0145df0 2020-05-18T21:33:37.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c55ec700 1 --2- 172.21.15.63:0/2887580168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47c0145df0 0x7f47c0142e90 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f47b0002f70 tx=0x7f47b0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c4deb700 1 -- 172.21.15.63:0/2887580168 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b0011630 con 0x7f47c0145df0 2020-05-18T21:33:37.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c55ec700 1 --2- 172.21.15.63:0/2887580168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47c0145df0 0x7f47c0142e90 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f47b0002f70 tx=0x7f47b0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c4deb700 1 -- 172.21.15.63:0/2887580168 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47b00119d0 con 0x7f47c0145df0 2020-05-18T21:33:37.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c6def700 1 -- 172.21.15.63:0/2887580168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47c0145df0 msgr2=0x7f47c0142e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:37.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c6def700 1 --2- 172.21.15.63:0/2887580168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47c0145df0 0x7f47c0142e90 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7f47b0002f70 tx=0x7f47b0008920).stop 2020-05-18T21:33:37.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c6def700 1 -- 172.21.15.63:0/2887580168 shutdown_connections 2020-05-18T21:33:37.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c6def700 1 --2- 172.21.15.63:0/2887580168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47c0145df0 0x7f47c0142e90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:37.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c6def700 1 -- 172.21.15.63:0/2887580168 >> 172.21.15.63:0/2887580168 conn(0x7f47c0069b70 msgr2=0x7f47c0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:37.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c6def700 1 -- 172.21.15.63:0/2887580168 shutdown_connections 2020-05-18T21:33:37.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.415+0000 7f47c6def700 1 -- 172.21.15.63:0/2887580168 wait complete. 2020-05-18T21:33:37.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47c6def700 1 Processor -- start 2020-05-18T21:33:37.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47c6def700 1 -- start start 2020-05-18T21:33:37.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47c6def700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f47c01432f0 0x7f47c012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:37.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47c6def700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c00bcfb0 con 0x7f47c00b93f0 2020-05-18T21:33:37.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47c6def700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c00bd250 con 0x7f47c0145df0 2020-05-18T21:33:37.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47c6def700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c0142190 con 0x7f47c01432f0 2020-05-18T21:33:37.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47c55ec700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f47c01432f0 0x7f47c012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:37.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47c5ded700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f47c00b93f0 0x7f47c0130e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34706/0 (socket says 172.21.15.63:34706) 2020-05-18T21:33:37.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47c5ded700 1 -- 172.21.15.63:0/109710382 learned_addr learned my addr 172.21.15.63:0/109710382 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:37.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47c55ec700 1 -- 172.21.15.63:0/109710382 >> v1:172.21.15.155:6789/0 conn(0x7f47c0145df0 legacy=0x7f47c00ba5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:37.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47aeffd700 1 -- 172.21.15.63:0/109710382 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618446827 0 0) 0x7f47c00bcfb0 con 0x7f47c00b93f0 2020-05-18T21:33:37.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47c55ec700 1 -- 172.21.15.63:0/109710382 >> v1:172.21.15.63:6789/0 conn(0x7f47c00b93f0 legacy=0x7f47c0130e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:37.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47c55ec700 1 -- 172.21.15.63:0/109710382 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c0131520 con 0x7f47c01432f0 2020-05-18T21:33:37.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47c55ec700 1 --2- 172.21.15.63:0/109710382 >> v2:172.21.15.63:3300/0 conn(0x7f47c01432f0 0x7f47c012ff60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f47c0153800 tx=0x7f47b00113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47c55ec700 1 --2- 172.21.15.63:0/109710382 >> v2:172.21.15.63:3300/0 conn(0x7f47c01432f0 0x7f47c012ff60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f47c0153800 tx=0x7f47b00113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47c55ec700 1 --2- 172.21.15.63:0/109710382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47c01432f0 0x7f47c012ff60 secure :-1 s=READY pgs=1461 cs=0 l=1 rx=0x7f47c0153800 tx=0x7f47b00113e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:37.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47c55ec700 1 --2- 172.21.15.63:0/109710382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47c01432f0 0x7f47c012ff60 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7f47c0153800 tx=0x7f47b00113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47aeffd700 1 -- 172.21.15.63:0/109710382 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47b000f8c0 con 0x7f47c01432f0 2020-05-18T21:33:37.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47c55ec700 1 --2- 172.21.15.63:0/109710382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47c01432f0 0x7f47c012ff60 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7f47c0153800 tx=0x7f47b00113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47c55ec700 1 --2- 172.21.15.63:0/109710382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47c01432f0 0x7f47c012ff60 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7f47c0153800 tx=0x7f47b00113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47aeffd700 1 -- 172.21.15.63:0/109710382 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b00119f0 con 0x7f47c01432f0 2020-05-18T21:33:37.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47c6def700 1 -- 172.21.15.63:0/109710382 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c0141cf0 con 0x7f47c01432f0 2020-05-18T21:33:37.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.419+0000 7f47aeffd700 1 -- 172.21.15.63:0/109710382 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47b0007550 con 0x7f47c01432f0 2020-05-18T21:33:37.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.423+0000 7f47c6def700 1 -- 172.21.15.63:0/109710382 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c00bcb90 con 0x7f47c01432f0 2020-05-18T21:33:37.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.423+0000 7f47c55ec700 1 --2- 172.21.15.63:0/109710382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47c01432f0 0x7f47c012ff60 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7f47c0153800 tx=0x7f47b00113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.423+0000 7f47c6def700 1 -- 172.21.15.63:0/109710382 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c0142000 con 0x7f47c01432f0 2020-05-18T21:33:37.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.423+0000 7f47aeffd700 1 -- 172.21.15.63:0/109710382 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f47b0005700 con 0x7f47c01432f0 2020-05-18T21:33:37.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.423+0000 7f47c55ec700 1 --2- 172.21.15.63:0/109710382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47c01432f0 0x7f47c012ff60 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7f47c0153800 tx=0x7f47b00113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.423+0000 7f47aeffd700 1 --2- 172.21.15.63:0/109710382 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47a004f860 0x7f47a0051d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:37.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.423+0000 7f47aeffd700 1 -- 172.21.15.63:0/109710382 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f47b0064460 con 0x7f47c01432f0 2020-05-18T21:33:37.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.423+0000 7f47c5ded700 1 --2- 172.21.15.63:0/109710382 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47a004f860 0x7f47a0051d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:37.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.423+0000 7f47c5ded700 1 --2- 172.21.15.63:0/109710382 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47a004f860 0x7f47a0051d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f47bc0012a0 tx=0x7f47bc001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.423+0000 7f47c5ded700 1 --2- 172.21.15.63:0/109710382 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47a004f860 0x7f47a0051d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f47bc0012a0 tx=0x7f47bc001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.423+0000 7f47c5ded700 1 --2- 172.21.15.63:0/109710382 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47a004f860 0x7f47a0051d20 secure :-1 s=READY pgs=569 cs=0 l=1 rx=0x7f47bc0012a0 tx=0x7f47bc001820).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:37.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.431+0000 7f47c55ec700 1 --2- 172.21.15.63:0/109710382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47c01432f0 0x7f47c012ff60 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7f47c0153800 tx=0x7f47b00113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.431+0000 7f47aeffd700 1 -- 172.21.15.63:0/109710382 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f47b003e850 con 0x7f47c01432f0 2020-05-18T21:33:37.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.547+0000 7f47c6def700 1 -- 172.21.15.63:0/109710382 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f47c00bd3e0 con 0x7f47c01432f0 2020-05-18T21:33:37.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.547+0000 7f47c55ec700 1 --2- 172.21.15.63:0/109710382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47c01432f0 0x7f47c012ff60 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7f47c0153800 tx=0x7f47b00113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.547+0000 7f47aeffd700 1 -- 172.21.15.63:0/109710382 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v104) v1 ==== 81+0+33710 (secure 0 0 0) 0x7f47b0041e70 con 0x7f47c01432f0 2020-05-18T21:33:37.557 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:37.558 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:37.558 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 104, 2020-05-18T21:33:37.558 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:33:37.559 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2020-05-18T21:26:28.798650+0000", 2020-05-18T21:33:37.559 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2020-05-18T21:33:24.233716+0000", 2020-05-18T21:33:37.559 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:33:37.560 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:33:37.560 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-05-18T21:33:37.560 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5799936, 2020-05-18T21:33:37.560 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2020-05-18T21:33:37.560 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2020-05-18T21:33:37.561 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2020-05-18T21:33:37.561 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2020-05-18T21:33:37.561 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2020-05-18T21:33:37.561 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:33:37.561 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 4, 2020-05-18T21:33:37.566 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2020-05-18T21:33:37.566 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-05-18T21:33:37.567 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2020-05-18T21:33:37.567 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2020-05-18T21:33:37.567 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 20, 2020-05-18T21:33:37.567 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 8, 2020-05-18T21:33:37.567 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2020-05-18T21:33:37.568 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "jewel", 2020-05-18T21:33:37.568 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "pacific", 2020-05-18T21:33:37.568 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:33:37.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.569 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2020-05-18T21:33:37.569 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "device_health_metrics", 2020-05-18T21:33:37.569 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:33.080792+0000", 2020-05-18T21:33:37.570 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:33:37.570 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:33:37.570 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:33:37.570 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:33:37.570 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:33:37.571 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:33:37.571 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:33:37.571 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:33:37.571 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2020-05-18T21:33:37.571 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2020-05-18T21:33:37.572 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2020-05-18T21:33:37.572 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2020-05-18T21:33:37.572 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2020-05-18T21:33:37.572 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:33:37.572 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:33:37.573 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:33:37.573 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:33:37.573 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:33:37.573 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:33:37.573 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:33:37.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.574 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "15", 2020-05-18T21:33:37.574 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:33:37.574 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:33:37.574 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:33:37.575 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:33:37.575 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:33:37.575 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:33:37.575 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:33:37.575 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:33:37.576 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:33:37.576 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:33:37.576 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:33:37.576 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:33:37.576 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:33:37.577 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:33:37.577 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:33:37.577 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:33:37.577 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:33:37.577 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:33:37.578 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:33:37.578 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:33:37.578 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:33:37.578 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:33:37.579 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:33:37.579 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:33:37.579 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:33:37.579 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:33:37.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.579 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:33:37.580 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:33:37.580 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:33:37.580 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:33:37.580 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:33:37.580 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:33:37.581 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:33:37.581 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:33:37.581 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:33:37.581 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:33:37.582 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:33:37.582 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:33:37.582 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2020-05-18T21:33:37.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.582 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:33:37.583 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_devicehealth": {} 2020-05-18T21:33:37.583 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.583 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2020-05-18T21:33:37.584 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2020-05-18T21:33:37.584 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:40.149370+0000", 2020-05-18T21:33:37.584 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:33:37.584 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:33:37.584 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:33:37.585 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:33:37.585 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:33:37.585 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:33:37.585 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:33:37.585 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:33:37.586 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:33:37.586 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:33:37.586 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:33:37.586 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:33:37.586 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:33:37.587 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:33:37.587 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:33:37.587 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:33:37.587 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:33:37.587 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:33:37.588 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:33:37.588 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:33:37.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.588 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2020-05-18T21:33:37.588 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:33:37.589 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:33:37.589 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:33:37.589 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:33:37.589 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:33:37.589 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:33:37.590 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:33:37.590 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:33:37.590 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:33:37.590 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:33:37.590 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:33:37.591 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:33:37.591 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:33:37.591 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:33:37.591 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:33:37.591 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:33:37.592 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:33:37.592 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:33:37.592 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:33:37.592 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:33:37.592 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:33:37.593 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:33:37.593 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:33:37.593 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:33:37.593 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:33:37.593 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:33:37.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.594 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:33:37.594 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:33:37.594 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:33:37.594 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:33:37.595 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:33:37.595 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:33:37.595 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:33:37.595 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:33:37.595 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:33:37.596 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:33:37.596 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:33:37.596 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:33:37.596 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:33:37.596 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2020-05-18T21:33:37.597 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.597 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 19, 2020-05-18T21:33:37.597 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2020-05-18T21:33:37.598 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:33:21.749613+0000", 2020-05-18T21:33:37.598 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:33:37.598 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:33:37.598 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:33:37.598 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:33:37.599 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:33:37.599 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:33:37.599 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:33:37.599 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:33:37.599 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:33:37.600 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:33:37.600 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:33:37.600 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:33:37.600 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:33:37.600 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:33:37.601 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:33:37.601 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:33:37.601 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:33:37.601 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:33:37.602 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:33:37.602 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:33:37.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.602 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "103", 2020-05-18T21:33:37.603 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:33:37.603 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:33:37.603 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:33:37.603 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:33:37.604 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:33:37.604 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:33:37.604 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:33:37.604 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:33:37.604 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:33:37.605 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:33:37.605 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:33:37.605 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:33:37.605 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:33:37.606 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:33:37.606 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:33:37.606 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:33:37.606 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:33:37.607 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:33:37.607 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:33:37.607 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:33:37.607 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:33:37.607 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:33:37.608 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:33:37.608 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:33:37.608 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:33:37.608 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:33:37.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.609 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:33:37.609 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:33:37.609 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:33:37.610 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:33:37.610 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:33:37.610 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:33:37.610 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:33:37.610 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:33:37.611 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:33:37.611 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:33:37.611 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:33:37.611 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:33:37.611 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2020-05-18T21:33:37.612 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2020-05-18T21:33:37.612 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2020-05-18T21:33:37.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.612 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:33:37.612 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:33:37.613 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2020-05-18T21:33:37.613 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.613 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.614 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 20, 2020-05-18T21:33:37.614 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2020-05-18T21:33:37.614 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:33:22.242521+0000", 2020-05-18T21:33:37.615 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:33:37.615 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:33:37.615 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:33:37.615 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:33:37.616 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:33:37.616 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:33:37.616 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:33:37.617 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:33:37.617 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:33:37.617 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:33:37.618 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:33:37.618 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:33:37.618 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:33:37.619 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:33:37.619 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:33:37.619 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:33:37.620 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:33:37.620 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:33:37.620 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:33:37.621 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:33:37.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.621 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "104", 2020-05-18T21:33:37.622 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:33:37.622 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:33:37.622 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:33:37.623 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:33:37.623 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:33:37.623 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:33:37.624 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:33:37.624 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:33:37.625 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:33:37.625 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:33:37.626 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:33:37.626 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:33:37.626 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:33:37.627 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:33:37.627 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:33:37.627 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:33:37.627 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:33:37.628 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:33:37.628 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:33:37.628 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:33:37.629 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:33:37.629 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:33:37.630 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:33:37.630 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:33:37.630 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:33:37.631 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:33:37.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.631 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:33:37.632 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:33:37.632 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:33:37.632 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:33:37.633 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:33:37.633 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:33:37.633 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:33:37.634 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:33:37.634 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:33:37.635 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:33:37.635 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:33:37.635 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:33:37.636 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:33:37.636 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:33:37.636 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2020-05-18T21:33:37.637 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.637 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.637 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.638 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:33:37.638 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2020-05-18T21:33:37.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.638 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:33:37.639 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "c6ae0fbf-604c-4e8d-b1b8-6038821420e3", 2020-05-18T21:33:37.639 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:33:37.639 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:33:37.639 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:33:37.639 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:33:37.640 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:33:37.640 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:33:37.640 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:33:37.640 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 102, 2020-05-18T21:33:37.640 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:33:37.641 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:33:37.641 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:33:37.641 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.642 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.642 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2020-05-18T21:33:37.642 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:33:37.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.643 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.643 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2020-05-18T21:33:37.643 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:33:37.643 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.643 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.644 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:33:37.644 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.644 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.645 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6802", 2020-05-18T21:33:37.645 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:33:37.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.645 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.646 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6803", 2020-05-18T21:33:37.646 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:33:37.646 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.646 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.647 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:33:37.647 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.648 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.648 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6806", 2020-05-18T21:33:37.648 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:33:37.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.649 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.649 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6807", 2020-05-18T21:33:37.649 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:33:37.649 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.649 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.650 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:33:37.650 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.650 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.651 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6804", 2020-05-18T21:33:37.651 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:33:37.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.651 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.652 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6805", 2020-05-18T21:33:37.652 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:33:37.652 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.652 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.653 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6801/12803", 2020-05-18T21:33:37.653 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6803/12803", 2020-05-18T21:33:37.653 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6807/12803", 2020-05-18T21:33:37.653 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6805/12803", 2020-05-18T21:33:37.654 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:33:37.654 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:33:37.654 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:33:37.654 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.655 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:33:37.655 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6", 2020-05-18T21:33:37.655 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:33:37.655 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:33:37.656 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:33:37.656 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:33:37.656 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:33:37.656 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:33:37.656 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:33:37.657 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 102, 2020-05-18T21:33:37.657 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:33:37.657 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:33:37.657 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:33:37.657 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.658 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.658 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6808", 2020-05-18T21:33:37.658 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:33:37.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.659 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.659 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6809", 2020-05-18T21:33:37.659 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:33:37.659 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.660 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.660 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:33:37.660 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.661 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.661 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6810", 2020-05-18T21:33:37.661 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:33:37.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.662 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.662 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6811", 2020-05-18T21:33:37.662 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:33:37.662 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.662 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.663 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:33:37.663 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.663 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.663 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6815", 2020-05-18T21:33:37.664 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:33:37.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.664 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.664 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6817", 2020-05-18T21:33:37.665 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:33:37.665 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.665 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.665 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:33:37.666 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.666 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.666 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6812", 2020-05-18T21:33:37.666 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:33:37.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.667 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.667 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6813", 2020-05-18T21:33:37.667 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:33:37.668 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.668 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.668 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6809/12804", 2020-05-18T21:33:37.668 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6811/12804", 2020-05-18T21:33:37.669 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6817/12804", 2020-05-18T21:33:37.669 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6813/12804", 2020-05-18T21:33:37.669 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:33:37.669 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:33:37.669 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:33:37.670 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.670 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:33:37.670 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "ec8d9fa9-dae9-45f6-b286-735ab3801c27", 2020-05-18T21:33:37.670 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:33:37.671 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:33:37.671 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:33:37.671 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:33:37.671 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:33:37.671 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:33:37.672 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:33:37.672 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 101, 2020-05-18T21:33:37.672 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:33:37.672 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:33:37.672 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:33:37.673 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.673 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.673 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6822", 2020-05-18T21:33:37.673 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:33:37.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.674 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.674 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6824", 2020-05-18T21:33:37.674 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:33:37.675 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.675 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.675 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:33:37.675 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.676 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.676 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6826", 2020-05-18T21:33:37.676 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:33:37.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.677 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.677 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6827", 2020-05-18T21:33:37.677 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:33:37.677 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.678 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.678 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:33:37.678 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.679 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.679 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6830", 2020-05-18T21:33:37.679 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:33:37.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.680 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.680 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6831", 2020-05-18T21:33:37.680 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:33:37.680 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.680 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.681 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:33:37.681 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.681 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.682 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6828", 2020-05-18T21:33:37.682 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:33:37.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.682 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.683 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6829", 2020-05-18T21:33:37.683 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:33:37.683 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.683 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.683 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6824/12806", 2020-05-18T21:33:37.684 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6827/12806", 2020-05-18T21:33:37.684 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6831/12806", 2020-05-18T21:33:37.684 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6829/12806", 2020-05-18T21:33:37.684 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:33:37.684 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:33:37.685 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:33:37.685 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.685 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:33:37.686 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "1030fedf-adad-4e79-b839-59385d4d7d2a", 2020-05-18T21:33:37.686 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:33:37.686 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:33:37.686 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:33:37.686 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:33:37.687 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:33:37.687 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:33:37.687 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:33:37.687 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 102, 2020-05-18T21:33:37.687 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:33:37.688 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:33:37.688 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:33:37.688 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.688 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.689 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6814", 2020-05-18T21:33:37.689 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:33:37.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.689 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.690 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6816", 2020-05-18T21:33:37.690 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:33:37.690 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.690 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.691 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:33:37.691 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.691 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.691 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6818", 2020-05-18T21:33:37.692 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:33:37.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.692 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.692 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6819", 2020-05-18T21:33:37.693 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:33:37.693 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.695 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.695 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:33:37.696 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.696 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.696 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6823", 2020-05-18T21:33:37.696 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:33:37.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.697 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.697 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6825", 2020-05-18T21:33:37.697 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:33:37.698 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.698 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.698 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:33:37.698 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.699 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.699 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6820", 2020-05-18T21:33:37.699 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:33:37.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.700 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.700 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6821", 2020-05-18T21:33:37.700 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:33:37.700 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.701 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.701 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6816/12805", 2020-05-18T21:33:37.701 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6819/12805", 2020-05-18T21:33:37.701 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6825/12805", 2020-05-18T21:33:37.702 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6821/12805", 2020-05-18T21:33:37.702 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:33:37.702 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:33:37.702 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:33:37.702 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.703 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:33:37.703 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "8ad15a9b-97b4-4002-b1d4-7292e09b4ef6", 2020-05-18T21:33:37.703 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:33:37.703 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:33:37.704 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:33:37.704 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:33:37.704 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:33:37.704 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:33:37.704 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:33:37.705 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 101, 2020-05-18T21:33:37.705 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:33:37.705 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:33:37.705 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:33:37.705 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.706 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.706 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6800", 2020-05-18T21:33:37.706 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:33:37.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.707 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.707 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6801", 2020-05-18T21:33:37.707 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:33:37.707 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.708 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.708 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:33:37.708 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.709 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.709 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6802", 2020-05-18T21:33:37.709 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:33:37.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.710 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.710 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6803", 2020-05-18T21:33:37.710 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:33:37.711 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.711 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.711 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:33:37.711 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.712 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.712 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6806", 2020-05-18T21:33:37.712 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:33:37.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.713 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.713 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6807", 2020-05-18T21:33:37.713 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:33:37.713 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.714 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.714 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:33:37.714 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.715 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.715 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6804", 2020-05-18T21:33:37.715 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:33:37.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.716 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.716 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6805", 2020-05-18T21:33:37.716 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:33:37.716 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.716 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.717 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6801/13023", 2020-05-18T21:33:37.717 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6803/13023", 2020-05-18T21:33:37.717 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6807/13023", 2020-05-18T21:33:37.717 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6805/13023", 2020-05-18T21:33:37.717 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:33:37.718 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:33:37.718 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:33:37.718 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.719 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:33:37.719 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0dce88f8-b984-43e1-95e2-4132171102d2", 2020-05-18T21:33:37.719 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:33:37.719 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:33:37.719 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:33:37.720 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:33:37.720 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:33:37.720 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:33:37.720 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:33:37.720 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 101, 2020-05-18T21:33:37.721 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:33:37.721 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:33:37.721 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:33:37.721 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.722 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.722 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6808", 2020-05-18T21:33:37.722 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:33:37.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.723 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.723 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6809", 2020-05-18T21:33:37.723 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:33:37.723 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.723 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.724 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:33:37.724 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.724 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.725 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6810", 2020-05-18T21:33:37.725 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:33:37.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.726 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.726 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6811", 2020-05-18T21:33:37.726 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:33:37.726 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.727 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.727 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:33:37.727 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.727 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.728 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6814", 2020-05-18T21:33:37.728 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:33:37.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.729 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.729 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6816", 2020-05-18T21:33:37.729 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:33:37.729 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.729 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.730 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:33:37.730 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.730 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.731 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6812", 2020-05-18T21:33:37.731 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:33:37.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.731 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.732 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6813", 2020-05-18T21:33:37.732 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:33:37.732 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.732 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.732 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6809/13024", 2020-05-18T21:33:37.733 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6811/13024", 2020-05-18T21:33:37.733 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6816/13024", 2020-05-18T21:33:37.733 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6813/13024", 2020-05-18T21:33:37.733 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:33:37.734 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:33:37.734 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:33:37.734 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.734 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:33:37.735 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "e1bc92f8-3692-4483-b0fb-905c94fa1469", 2020-05-18T21:33:37.735 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:33:37.735 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:33:37.735 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:33:37.735 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:33:37.736 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:33:37.736 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:33:37.736 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:33:37.736 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 102, 2020-05-18T21:33:37.736 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:33:37.737 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:33:37.737 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:33:37.737 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.737 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.738 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6815", 2020-05-18T21:33:37.738 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:33:37.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.738 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.739 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6817", 2020-05-18T21:33:37.739 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:33:37.739 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.739 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.740 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:33:37.740 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.740 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.740 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.740 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6818", 2020-05-18T21:33:37.741 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:33:37.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.741 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.741 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6819", 2020-05-18T21:33:37.742 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:33:37.742 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.742 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.742 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:33:37.743 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.743 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.744 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6822", 2020-05-18T21:33:37.744 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:33:37.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.744 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.744 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.745 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6824", 2020-05-18T21:33:37.745 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:33:37.745 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.745 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.746 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:33:37.746 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.746 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.746 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6820", 2020-05-18T21:33:37.747 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:33:37.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.747 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.747 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6821", 2020-05-18T21:33:37.748 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:33:37.748 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.748 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.748 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6817/13025", 2020-05-18T21:33:37.749 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6819/13025", 2020-05-18T21:33:37.749 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6824/13025", 2020-05-18T21:33:37.749 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6821/13025", 2020-05-18T21:33:37.749 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:33:37.749 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:33:37.750 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:33:37.750 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.750 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.750 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:33:37.751 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "b76e000c-a078-48c4-9e1e-34d286a9992c", 2020-05-18T21:33:37.751 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:33:37.751 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:33:37.751 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:33:37.751 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:33:37.752 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:33:37.752 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:33:37.752 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:33:37.752 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 102, 2020-05-18T21:33:37.752 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:33:37.753 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:33:37.753 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:33:37.753 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.754 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.754 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6823", 2020-05-18T21:33:37.754 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:33:37.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.755 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.755 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6825", 2020-05-18T21:33:37.755 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:33:37.755 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.756 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.756 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:33:37.756 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.757 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.757 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6826", 2020-05-18T21:33:37.757 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:33:37.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.758 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.758 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6827", 2020-05-18T21:33:37.758 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:33:37.758 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.758 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.759 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:33:37.759 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.759 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.759 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6830", 2020-05-18T21:33:37.760 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:33:37.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.760 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.760 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6831", 2020-05-18T21:33:37.761 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:33:37.761 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.761 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.761 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:33:37.762 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:37.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.762 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:37.762 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6828", 2020-05-18T21:33:37.762 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:33:37.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.763 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.763 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:37.763 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6829", 2020-05-18T21:33:37.763 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:33:37.764 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.764 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.764 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6825/13026", 2020-05-18T21:33:37.764 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6827/13026", 2020-05-18T21:33:37.765 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6831/13026", 2020-05-18T21:33:37.765 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6829/13026", 2020-05-18T21:33:37.765 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:33:37.765 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:33:37.765 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:33:37.766 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:37.766 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.766 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:33:37.766 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2020-05-18T21:33:37.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.767 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:33:37.767 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:33:37.767 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:33:37.767 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:33:37.767 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:33:37.768 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:33:37.768 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.281434+0000", 2020-05-18T21:33:37.768 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:33:37.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.768 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.769 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:33:37.769 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:33:37.769 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:33:37.769 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:33:37.769 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:33:37.770 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:33:37.770 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.608518+0000", 2020-05-18T21:33:37.770 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:33:37.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.770 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:33:37.771 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:33:37.771 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:33:37.771 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:33:37.771 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:33:37.771 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:33:37.772 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.582386+0000", 2020-05-18T21:33:37.772 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:33:37.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.772 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:33:37.773 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:33:37.773 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:33:37.773 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:33:37.773 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:33:37.773 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:33:37.774 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.573488+0000", 2020-05-18T21:33:37.774 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:33:37.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.774 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.774 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:33:37.775 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:33:37.775 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:33:37.775 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:33:37.775 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:33:37.775 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:33:37.776 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.604174+0000", 2020-05-18T21:33:37.776 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:33:37.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.776 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.776 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:33:37.777 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:33:37.777 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:33:37.777 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:33:37.777 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:33:37.777 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:33:37.778 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.371004+0000", 2020-05-18T21:33:37.778 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:33:37.778 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.778 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.778 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:33:37.779 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:33:37.779 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:33:37.779 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:33:37.779 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:33:37.779 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:33:37.780 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.593070+0000", 2020-05-18T21:33:37.780 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:33:37.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.780 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:37.780 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:33:37.781 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:33:37.781 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:33:37.781 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:33:37.781 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:33:37.781 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:33:37.782 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.667677+0000", 2020-05-18T21:33:37.782 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:33:37.782 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.782 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:33:37.782 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2020-05-18T21:33:37.783 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2020-05-18T21:33:37.783 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2020-05-18T21:33:37.783 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2020-05-18T21:33:37.783 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklist": {}, 2020-05-18T21:33:37.783 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2020-05-18T21:33:37.783 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2020-05-18T21:33:37.784 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2020-05-18T21:33:37.784 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2020-05-18T21:33:37.784 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2020-05-18T21:33:37.784 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2020-05-18T21:33:37.784 INFO:teuthology.orchestra.run.smithi063.stdout: "ruleset-failure-domain": "osd", 2020-05-18T21:33:37.785 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2020-05-18T21:33:37.785 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:37.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:37.785 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2020-05-18T21:33:37.785 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2020-05-18T21:33:37.786 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2020-05-18T21:33:37.786 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2020-05-18T21:33:37.786 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {} 2020-05-18T21:33:37.786 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:37.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.551+0000 7f47c6def700 1 -- 172.21.15.63:0/109710382 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47a004f860 msgr2=0x7f47a0051d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:37.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.551+0000 7f47c6def700 1 --2- 172.21.15.63:0/109710382 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47a004f860 0x7f47a0051d20 secure :-1 s=READY pgs=569 cs=0 l=1 rx=0x7f47bc0012a0 tx=0x7f47bc001820).stop 2020-05-18T21:33:37.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.551+0000 7f47c6def700 1 -- 172.21.15.63:0/109710382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47c01432f0 msgr2=0x7f47c012ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:37.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.551+0000 7f47c6def700 1 --2- 172.21.15.63:0/109710382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47c01432f0 0x7f47c012ff60 secure :-1 s=READY pgs=1461 cs=0 l=1 rx=0x7f47c0153800 tx=0x7f47b00113e0).stop 2020-05-18T21:33:37.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.551+0000 7f47c6def700 1 -- 172.21.15.63:0/109710382 shutdown_connections 2020-05-18T21:33:37.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.551+0000 7f47c6def700 1 --2- 172.21.15.63:0/109710382 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47a004f860 0x7f47a0051d20 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:37.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.551+0000 7f47c6def700 1 --2- 172.21.15.63:0/109710382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47c01432f0 0x7f47c012ff60 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:37.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.551+0000 7f47c6def700 1 -- 172.21.15.63:0/109710382 >> 172.21.15.63:0/109710382 conn(0x7f47c0069b70 msgr2=0x7f47c0142520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:37.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.551+0000 7f47c6def700 1 -- 172.21.15.63:0/109710382 shutdown_connections 2020-05-18T21:33:37.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.551+0000 7f47c6def700 1 -- 172.21.15.63:0/109710382 wait complete. 2020-05-18T21:33:37.791 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:37.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee66dbc700 1 Processor -- start 2020-05-18T21:33:37.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee66dbc700 1 -- start start 2020-05-18T21:33:37.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee66dbc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee600b4760 0x7fee600648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:37.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee66dbc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fee60064d20 0x7fee6014d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:37.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee66dbc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6014a330 con 0x7fee6005f110 2020-05-18T21:33:37.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee66dbc700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6014a140 con 0x7fee60064d20 2020-05-18T21:33:37.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee66dbc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6014a5d0 con 0x7fee600b4760 2020-05-18T21:33:37.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee655b9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee600b4760 0x7fee600648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:37.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee665bb700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fee60064d20 0x7fee6014d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:37.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee65dba700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fee6005f110 0x7fee6014aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:33030/0 (socket says 172.21.15.63:33030) 2020-05-18T21:33:37.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee65dba700 1 -- 172.21.15.63:0/938310935 learned_addr learned my addr 172.21.15.63:0/938310935 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:37.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee64db8700 1 -- 172.21.15.63:0/938310935 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442680935 0 0) 0x7fee6014a330 con 0x7fee6005f110 2020-05-18T21:33:37.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee64db8700 1 -- 172.21.15.63:0/938310935 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee4c003270 con 0x7fee6005f110 2020-05-18T21:33:37.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee665bb700 1 -- 172.21.15.63:0/938310935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee600b4760 msgr2=0x7fee600648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:37.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee665bb700 1 --2- 172.21.15.63:0/938310935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee600b4760 0x7fee600648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:37.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee665bb700 1 -- 172.21.15.63:0/938310935 >> v1:172.21.15.155:6789/0 conn(0x7fee6005f110 legacy=0x7fee6014aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:37.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee665bb700 1 -- 172.21.15.63:0/938310935 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee60063430 con 0x7fee60064d20 2020-05-18T21:33:37.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee665bb700 1 --2- 172.21.15.63:0/938310935 >> v2:172.21.15.155:3300/0 conn(0x7fee60064d20 0x7fee6014d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fee60060a90 tx=0x7fee58008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee665bb700 1 --2- 172.21.15.63:0/938310935 >> v2:172.21.15.155:3300/0 conn(0x7fee60064d20 0x7fee6014d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fee60060a90 tx=0x7fee58008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.895+0000 7fee665bb700 1 --2- 172.21.15.63:0/938310935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee60064d20 0x7fee6014d710 secure :-1 s=READY pgs=980 cs=0 l=1 rx=0x7fee60060a90 tx=0x7fee58008ca0).ready entity=mon.1 client_cookie=64ace5171336ad29 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:37.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.899+0000 7fee665bb700 1 --2- 172.21.15.63:0/938310935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee60064d20 0x7fee6014d710 secure :-1 s=THROTTLE_DONE pgs=980 cs=0 l=1 rx=0x7fee60060a90 tx=0x7fee58008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.899+0000 7fee64db8700 1 -- 172.21.15.63:0/938310935 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee58011db0 con 0x7fee60064d20 2020-05-18T21:33:37.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.899+0000 7fee665bb700 1 --2- 172.21.15.63:0/938310935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee60064d20 0x7fee6014d710 secure :-1 s=THROTTLE_DONE pgs=980 cs=0 l=1 rx=0x7fee60060a90 tx=0x7fee58008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.899+0000 7fee64db8700 1 -- 172.21.15.63:0/938310935 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5800a180 con 0x7fee60064d20 2020-05-18T21:33:37.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.899+0000 7fee665bb700 1 --2- 172.21.15.63:0/938310935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee60064d20 0x7fee6014d710 secure :-1 s=THROTTLE_DONE pgs=980 cs=0 l=1 rx=0x7fee60060a90 tx=0x7fee58008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.899+0000 7fee64db8700 1 -- 172.21.15.63:0/938310935 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee5800a560 con 0x7fee60064d20 2020-05-18T21:33:37.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.899+0000 7fee66dbc700 1 -- 172.21.15.63:0/938310935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee60064d20 msgr2=0x7fee6014d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:37.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.899+0000 7fee66dbc700 1 --2- 172.21.15.63:0/938310935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee60064d20 0x7fee6014d710 secure :-1 s=READY pgs=980 cs=0 l=1 rx=0x7fee60060a90 tx=0x7fee58008ca0).stop 2020-05-18T21:33:37.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.899+0000 7fee66dbc700 1 -- 172.21.15.63:0/938310935 shutdown_connections 2020-05-18T21:33:37.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.899+0000 7fee66dbc700 1 --2- 172.21.15.63:0/938310935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee60064d20 0x7fee6014d710 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:37.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.899+0000 7fee66dbc700 1 --2- 172.21.15.63:0/938310935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee600b4760 0x7fee600648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:37.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.899+0000 7fee66dbc700 1 -- 172.21.15.63:0/938310935 >> 172.21.15.63:0/938310935 conn(0x7fee60069fc0 msgr2=0x7fee6006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:37.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.899+0000 7fee66dbc700 1 -- 172.21.15.63:0/938310935 shutdown_connections 2020-05-18T21:33:37.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.899+0000 7fee66dbc700 1 -- 172.21.15.63:0/938310935 wait complete. 2020-05-18T21:33:37.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.899+0000 7fee66dbc700 1 Processor -- start 2020-05-18T21:33:37.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.899+0000 7fee66dbc700 1 -- start start 2020-05-18T21:33:37.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee66dbc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fee6005f110 0x7fee601429e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:37.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee66dbc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fee60064d20 0x7fee60145af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:37.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee66dbc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee60140670 con 0x7fee600b4760 2020-05-18T21:33:37.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee66dbc700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee60145f50 con 0x7fee6005f110 2020-05-18T21:33:37.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee66dbc700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee60143010 con 0x7fee60064d20 2020-05-18T21:33:37.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee65dba700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fee6005f110 0x7fee601429e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:37.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee65dba700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fee6005f110 0x7fee601429e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60764/0 (socket says 172.21.15.63:60764) 2020-05-18T21:33:37.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee65dba700 1 -- 172.21.15.63:0/3348678584 learned_addr learned my addr 172.21.15.63:0/3348678584 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:37.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee655b9700 1 --2- 172.21.15.63:0/3348678584 >> v2:172.21.15.155:3300/0 conn(0x7fee60064d20 0x7fee60145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:37.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee65dba700 1 -- 172.21.15.63:0/3348678584 >> v2:172.21.15.155:3300/0 conn(0x7fee60064d20 msgr2=0x7fee60145af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:37.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee65dba700 1 --2- 172.21.15.63:0/3348678584 >> v2:172.21.15.155:3300/0 conn(0x7fee60064d20 0x7fee60145af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:37.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee65dba700 1 -- 172.21.15.63:0/3348678584 >> v1:172.21.15.155:6789/0 conn(0x7fee600b4760 legacy=0x7fee6013ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:37.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee65dba700 1 -- 172.21.15.63:0/3348678584 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee60148950 con 0x7fee6005f110 2020-05-18T21:33:37.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee65dba700 1 --2- 172.21.15.63:0/3348678584 >> v2:172.21.15.63:3300/0 conn(0x7fee6005f110 0x7fee601429e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee50001110 tx=0x7fee500109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee65dba700 1 --2- 172.21.15.63:0/3348678584 >> v2:172.21.15.63:3300/0 conn(0x7fee6005f110 0x7fee601429e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee50001110 tx=0x7fee500109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee65dba700 1 --2- 172.21.15.63:0/3348678584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6005f110 0x7fee601429e0 secure :-1 s=READY pgs=1462 cs=0 l=1 rx=0x7fee50001110 tx=0x7fee500109d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee65dba700 1 --2- 172.21.15.63:0/3348678584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6005f110 0x7fee601429e0 secure :-1 s=THROTTLE_DONE pgs=1462 cs=0 l=1 rx=0x7fee50001110 tx=0x7fee500109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee5effd700 1 -- 172.21.15.63:0/3348678584 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee50005d00 con 0x7fee6005f110 2020-05-18T21:33:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee65dba700 1 --2- 172.21.15.63:0/3348678584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6005f110 0x7fee601429e0 secure :-1 s=THROTTLE_DONE pgs=1462 cs=0 l=1 rx=0x7fee50001110 tx=0x7fee500109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee65dba700 1 --2- 172.21.15.63:0/3348678584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6005f110 0x7fee601429e0 secure :-1 s=THROTTLE_DONE pgs=1462 cs=0 l=1 rx=0x7fee50001110 tx=0x7fee500109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee5effd700 1 -- 172.21.15.63:0/3348678584 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee50005e60 con 0x7fee6005f110 2020-05-18T21:33:37.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee66dbc700 1 -- 172.21.15.63:0/3348678584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee60148bf0 con 0x7fee6005f110 2020-05-18T21:33:37.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee5effd700 1 -- 172.21.15.63:0/3348678584 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee500062c0 con 0x7fee6005f110 2020-05-18T21:33:37.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee66dbc700 1 -- 172.21.15.63:0/3348678584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee60142570 con 0x7fee6005f110 2020-05-18T21:33:37.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee65dba700 1 --2- 172.21.15.63:0/3348678584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6005f110 0x7fee601429e0 secure :-1 s=THROTTLE_DONE pgs=1462 cs=0 l=1 rx=0x7fee50001110 tx=0x7fee500109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee66dbc700 1 -- 172.21.15.63:0/3348678584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee60142e40 con 0x7fee6005f110 2020-05-18T21:33:37.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee5effd700 1 -- 172.21.15.63:0/3348678584 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fee50006530 con 0x7fee6005f110 2020-05-18T21:33:37.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.903+0000 7fee65dba700 1 --2- 172.21.15.63:0/3348678584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6005f110 0x7fee601429e0 secure :-1 s=THROTTLE_DONE pgs=1462 cs=0 l=1 rx=0x7fee50001110 tx=0x7fee500109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.907+0000 7fee5effd700 1 --2- 172.21.15.63:0/3348678584 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee4004faf0 0x7fee40051fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:37.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.907+0000 7fee5effd700 1 -- 172.21.15.63:0/3348678584 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fee500090c0 con 0x7fee6005f110 2020-05-18T21:33:37.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.907+0000 7fee655b9700 1 --2- 172.21.15.63:0/3348678584 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee4004faf0 0x7fee40051fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:37.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.907+0000 7fee655b9700 1 --2- 172.21.15.63:0/3348678584 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee4004faf0 0x7fee40051fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee54002f70 tx=0x7fee5400f360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.907+0000 7fee655b9700 1 --2- 172.21.15.63:0/3348678584 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee4004faf0 0x7fee40051fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee54002f70 tx=0x7fee5400f360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.907+0000 7fee655b9700 1 --2- 172.21.15.63:0/3348678584 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee4004faf0 0x7fee40051fb0 secure :-1 s=READY pgs=570 cs=0 l=1 rx=0x7fee54002f70 tx=0x7fee5400f360).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:37.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.911+0000 7fee65dba700 1 --2- 172.21.15.63:0/3348678584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6005f110 0x7fee601429e0 secure :-1 s=THROTTLE_DONE pgs=1462 cs=0 l=1 rx=0x7fee50001110 tx=0x7fee500109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:37.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:37.911+0000 7fee5effd700 1 -- 172.21.15.63:0/3348678584 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fee5003e280 con 0x7fee6005f110 2020-05-18T21:33:38.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.063+0000 7fee66dbc700 1 -- 172.21.15.63:0/3348678584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee600569e0 con 0x7fee6005f110 2020-05-18T21:33:38.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.063+0000 7fee65dba700 1 --2- 172.21.15.63:0/3348678584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6005f110 0x7fee601429e0 secure :-1 s=THROTTLE_DONE pgs=1462 cs=0 l=1 rx=0x7fee50001110 tx=0x7fee500109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:38.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.063+0000 7fee5effd700 1 -- 172.21.15.63:0/3348678584 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+2143 (secure 0 0 0) 0x7fee500418a0 con 0x7fee6005f110 2020-05-18T21:33:38.072 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:38.072 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":81,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6113,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2300000397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2300000397},{"type":"v1","addr":"172.21.15.63:6833","nonce":2300000397}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":78}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:23.230529+0000","modified":"2020-05-18T21:33:24.934162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8059":{"gid":8059,"name":"b","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1291107650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1291107650},{"type":"v1","addr":"172.21.15.155:6835","nonce":1291107650}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-05-18T21:33:38.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.067+0000 7fee66dbc700 1 -- 172.21.15.63:0/3348678584 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee4004faf0 msgr2=0x7fee40051fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:38.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.067+0000 7fee66dbc700 1 --2- 172.21.15.63:0/3348678584 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee4004faf0 0x7fee40051fb0 secure :-1 s=READY pgs=570 cs=0 l=1 rx=0x7fee54002f70 tx=0x7fee5400f360).stop 2020-05-18T21:33:38.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.067+0000 7fee66dbc700 1 -- 172.21.15.63:0/3348678584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6005f110 msgr2=0x7fee601429e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:38.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.067+0000 7fee66dbc700 1 --2- 172.21.15.63:0/3348678584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6005f110 0x7fee601429e0 secure :-1 s=READY pgs=1462 cs=0 l=1 rx=0x7fee50001110 tx=0x7fee500109d0).stop 2020-05-18T21:33:38.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.067+0000 7fee66dbc700 1 -- 172.21.15.63:0/3348678584 shutdown_connections 2020-05-18T21:33:38.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.067+0000 7fee66dbc700 1 --2- 172.21.15.63:0/3348678584 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fee4004faf0 0x7fee40051fb0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:38.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.067+0000 7fee66dbc700 1 --2- 172.21.15.63:0/3348678584 >> v2:172.21.15.155:3300/0 conn(0x7fee60064d20 0x7fee60145af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:38.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.067+0000 7fee66dbc700 1 --2- 172.21.15.63:0/3348678584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6005f110 0x7fee601429e0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:38.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.067+0000 7fee66dbc700 1 -- 172.21.15.63:0/3348678584 >> 172.21.15.63:0/3348678584 conn(0x7fee60069fc0 msgr2=0x7fee600b7800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:38.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.067+0000 7fee66dbc700 1 -- 172.21.15.63:0/3348678584 shutdown_connections 2020-05-18T21:33:38.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.067+0000 7fee66dbc700 1 -- 172.21.15.63:0/3348678584 wait complete. 2020-05-18T21:33:38.076 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 81 2020-05-18T21:33:38.084 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-05-18T21:33:38.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.183+0000 7f2e5bc37700 1 Processor -- start 2020-05-18T21:33:38.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.183+0000 7f2e5bc37700 1 -- start start 2020-05-18T21:33:38.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e5bc37700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2e540b8f10 0x7f2e540af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:38.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e5bc37700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5414a490 con 0x7f2e54065e60 2020-05-18T21:33:38.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e5bc37700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5414a730 con 0x7f2e541475a0 2020-05-18T21:33:38.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e5bc37700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5414a9d0 con 0x7f2e540b8f10 2020-05-18T21:33:38.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e591d2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2e540b8f10 0x7f2e540af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:38.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e599d3700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2e54065e60 0x7f2e5414ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34728/0 (socket says 172.21.15.63:34728) 2020-05-18T21:33:38.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e599d3700 1 -- 172.21.15.63:0/3085419280 learned_addr learned my addr 172.21.15.63:0/3085419280 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:38.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e591d2700 1 -- 172.21.15.63:0/3085419280 >> v1:172.21.15.155:6789/0 conn(0x7f2e541475a0 legacy=0x7f2e5405ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:38.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e591d2700 1 -- 172.21.15.63:0/3085419280 >> v1:172.21.15.63:6789/0 conn(0x7f2e54065e60 legacy=0x7f2e5414ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:38.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e589d1700 1 -- 172.21.15.63:0/3085419280 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350552925 0 0) 0x7f2e5414a490 con 0x7f2e54065e60 2020-05-18T21:33:38.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e591d2700 1 -- 172.21.15.63:0/3085419280 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e540af540 con 0x7f2e540b8f10 2020-05-18T21:33:38.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e591d2700 1 --2- 172.21.15.63:0/3085419280 >> v2:172.21.15.63:3300/0 conn(0x7f2e540b8f10 0x7f2e540af830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2e50002f70 tx=0x7f2e50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:38.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e591d2700 1 --2- 172.21.15.63:0/3085419280 >> v2:172.21.15.63:3300/0 conn(0x7f2e540b8f10 0x7f2e540af830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2e50002f70 tx=0x7f2e50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:38.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e591d2700 1 --2- 172.21.15.63:0/3085419280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e540b8f10 0x7f2e540af830 secure :-1 s=READY pgs=1464 cs=0 l=1 rx=0x7f2e50002f70 tx=0x7f2e50007a80).ready entity=mon.0 client_cookie=605a7c0627a096d0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:38.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e591d2700 1 --2- 172.21.15.63:0/3085419280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e540b8f10 0x7f2e540af830 secure :-1 s=THROTTLE_DONE pgs=1464 cs=0 l=1 rx=0x7f2e50002f70 tx=0x7f2e50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:38.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e589d1700 1 -- 172.21.15.63:0/3085419280 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e50008e80 con 0x7f2e540b8f10 2020-05-18T21:33:38.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e591d2700 1 --2- 172.21.15.63:0/3085419280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e540b8f10 0x7f2e540af830 secure :-1 s=THROTTLE_DONE pgs=1464 cs=0 l=1 rx=0x7f2e50002f70 tx=0x7f2e50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:38.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e591d2700 1 --2- 172.21.15.63:0/3085419280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e540b8f10 0x7f2e540af830 secure :-1 s=THROTTLE_DONE pgs=1464 cs=0 l=1 rx=0x7f2e50002f70 tx=0x7f2e50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:38.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e589d1700 1 -- 172.21.15.63:0/3085419280 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e500116a0 con 0x7f2e540b8f10 2020-05-18T21:33:38.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e589d1700 1 -- 172.21.15.63:0/3085419280 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e50011ac0 con 0x7f2e540b8f10 2020-05-18T21:33:38.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e5bc37700 1 -- 172.21.15.63:0/3085419280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e540b8f10 msgr2=0x7f2e540af830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:38.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e5bc37700 1 --2- 172.21.15.63:0/3085419280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e540b8f10 0x7f2e540af830 secure :-1 s=READY pgs=1464 cs=0 l=1 rx=0x7f2e50002f70 tx=0x7f2e50007a80).stop 2020-05-18T21:33:38.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e5bc37700 1 -- 172.21.15.63:0/3085419280 shutdown_connections 2020-05-18T21:33:38.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e5bc37700 1 --2- 172.21.15.63:0/3085419280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e540b8f10 0x7f2e540af830 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:38.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e5bc37700 1 -- 172.21.15.63:0/3085419280 >> 172.21.15.63:0/3085419280 conn(0x7f2e540b83f0 msgr2=0x7f2e540b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:38.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e5bc37700 1 -- 172.21.15.63:0/3085419280 shutdown_connections 2020-05-18T21:33:38.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.187+0000 7f2e5bc37700 1 -- 172.21.15.63:0/3085419280 wait complete. 2020-05-18T21:33:38.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.191+0000 7f2e5bc37700 1 Processor -- start 2020-05-18T21:33:38.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.191+0000 7f2e5bc37700 1 -- start start 2020-05-18T21:33:38.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e5bc37700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2e541475a0 0x7f2e54063050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:38.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e5bc37700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e54062e40 con 0x7f2e54065e60 2020-05-18T21:33:38.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e5bc37700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e54062900 con 0x7f2e540b8f10 2020-05-18T21:33:38.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e5bc37700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e54062ba0 con 0x7f2e541475a0 2020-05-18T21:33:38.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e599d3700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2e54065e60 0x7f2e540b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34734/0 (socket says 172.21.15.63:34734) 2020-05-18T21:33:38.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e599d3700 1 -- 172.21.15.63:0/1942080001 learned_addr learned my addr 172.21.15.63:0/1942080001 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:38.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e5a1d4700 1 --2- 172.21.15.63:0/1942080001 >> v2:172.21.15.155:3300/0 conn(0x7f2e541475a0 0x7f2e54063050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:38.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e46ffd700 1 -- 172.21.15.63:0/1942080001 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995110216 0 0) 0x7f2e54062e40 con 0x7f2e54065e60 2020-05-18T21:33:38.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e46ffd700 1 -- 172.21.15.63:0/1942080001 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e34002fe0 con 0x7f2e54065e60 2020-05-18T21:33:38.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e46ffd700 1 -- 172.21.15.63:0/1942080001 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574169492 0 0) 0x7f2e54062900 con 0x7f2e540b8f10 2020-05-18T21:33:38.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e46ffd700 1 -- 172.21.15.63:0/1942080001 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e54062e40 con 0x7f2e540b8f10 2020-05-18T21:33:38.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e46ffd700 1 -- 172.21.15.63:0/1942080001 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1119316171 0 0) 0x7f2e34002fe0 con 0x7f2e54065e60 2020-05-18T21:33:38.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e46ffd700 1 -- 172.21.15.63:0/1942080001 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2e54062900 con 0x7f2e54065e60 2020-05-18T21:33:38.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e46ffd700 1 -- 172.21.15.63:0/1942080001 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f2e480018a0 con 0x7f2e54065e60 2020-05-18T21:33:38.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e5a1d4700 1 -- 172.21.15.63:0/1942080001 >> v1:172.21.15.155:6789/0 conn(0x7f2e540b8f10 legacy=0x7f2e54062090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:38.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e5a1d4700 1 -- 172.21.15.63:0/1942080001 >> v1:172.21.15.63:6789/0 conn(0x7f2e54065e60 legacy=0x7f2e540b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:38.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e5a1d4700 1 -- 172.21.15.63:0/1942080001 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e54060c90 con 0x7f2e541475a0 2020-05-18T21:33:38.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e5a1d4700 1 --2- 172.21.15.63:0/1942080001 >> v2:172.21.15.155:3300/0 conn(0x7f2e541475a0 0x7f2e54063050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2e480045b0 tx=0x7f2e4c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:38.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e5a1d4700 1 --2- 172.21.15.63:0/1942080001 >> v2:172.21.15.155:3300/0 conn(0x7f2e541475a0 0x7f2e54063050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2e480045b0 tx=0x7f2e4c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:38.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e5a1d4700 1 --2- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e541475a0 0x7f2e54063050 secure :-1 s=READY pgs=984 cs=0 l=1 rx=0x7f2e480045b0 tx=0x7f2e4c010b60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:38.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e5a1d4700 1 --2- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e541475a0 0x7f2e54063050 secure :-1 s=THROTTLE_DONE pgs=984 cs=0 l=1 rx=0x7f2e480045b0 tx=0x7f2e4c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:38.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e46ffd700 1 -- 172.21.15.63:0/1942080001 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e50008e80 con 0x7f2e541475a0 2020-05-18T21:33:38.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e5a1d4700 1 --2- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e541475a0 0x7f2e54063050 secure :-1 s=THROTTLE_DONE pgs=984 cs=0 l=1 rx=0x7f2e480045b0 tx=0x7f2e4c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:38.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e5bc37700 1 -- 172.21.15.63:0/1942080001 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e54146360 con 0x7f2e541475a0 2020-05-18T21:33:38.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e46ffd700 1 -- 172.21.15.63:0/1942080001 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c006c70 con 0x7f2e541475a0 2020-05-18T21:33:38.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e5a1d4700 1 --2- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e541475a0 0x7f2e54063050 secure :-1 s=THROTTLE_DONE pgs=984 cs=0 l=1 rx=0x7f2e480045b0 tx=0x7f2e4c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:38.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e5bc37700 1 -- 172.21.15.63:0/1942080001 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e54146810 con 0x7f2e541475a0 2020-05-18T21:33:38.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.195+0000 7f2e46ffd700 1 -- 172.21.15.63:0/1942080001 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e4c002260 con 0x7f2e541475a0 2020-05-18T21:33:38.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.199+0000 7f2e5bc37700 1 -- 172.21.15.63:0/1942080001 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e540569e0 con 0x7f2e541475a0 2020-05-18T21:33:38.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.199+0000 7f2e5a1d4700 1 --2- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e541475a0 0x7f2e54063050 secure :-1 s=THROTTLE_DONE pgs=984 cs=0 l=1 rx=0x7f2e480045b0 tx=0x7f2e4c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:38.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.199+0000 7f2e46ffd700 1 -- 172.21.15.63:0/1942080001 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2e4c003080 con 0x7f2e541475a0 2020-05-18T21:33:38.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.199+0000 7f2e5a1d4700 1 --2- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e541475a0 0x7f2e54063050 secure :-1 s=THROTTLE_DONE pgs=984 cs=0 l=1 rx=0x7f2e480045b0 tx=0x7f2e4c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:38.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.199+0000 7f2e46ffd700 1 --2- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e34050110 0x7f2e340525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:38.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.199+0000 7f2e46ffd700 1 -- 172.21.15.63:0/1942080001 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2e4c063510 con 0x7f2e541475a0 2020-05-18T21:33:38.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.199+0000 7f2e599d3700 1 --2- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e34050110 0x7f2e340525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:38.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.199+0000 7f2e599d3700 1 --2- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e34050110 0x7f2e340525d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2e48001030 tx=0x7f2e48009740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:38.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.199+0000 7f2e599d3700 1 --2- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e34050110 0x7f2e340525d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2e48001030 tx=0x7f2e48009740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:38.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.199+0000 7f2e599d3700 1 --2- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e34050110 0x7f2e340525d0 secure :-1 s=READY pgs=571 cs=0 l=1 rx=0x7f2e48001030 tx=0x7f2e48009740).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:38.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.207+0000 7f2e5a1d4700 1 --2- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e541475a0 0x7f2e54063050 secure :-1 s=THROTTLE_DONE pgs=984 cs=0 l=1 rx=0x7f2e480045b0 tx=0x7f2e4c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:38.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.207+0000 7f2e46ffd700 1 -- 172.21.15.63:0/1942080001 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2e4c03d900 con 0x7f2e541475a0 2020-05-18T21:33:38.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:38.359+0000 7f2e5bc37700 1 -- 172.21.15.63:0/1942080001 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2e54060e20 con 0x7f2e541475a0 2020-05-18T21:33:39.012 INFO:tasks.ceph.mds.b.smithi155.stderr:2020-05-18T21:33:39.009+0000 7ff19b6b3700 -1 MDSIOContextBase: blacklisted! Restarting... 2020-05-18T21:33:39.025 INFO:tasks.ceph.mds.b.smithi155.stderr: -1> 2020-05-18T21:33:39.009+0000 7ff19b6b3700 -1 MDSIOContextBase: blacklisted! Restarting... 2020-05-18T21:33:39.046 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:33:39.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.199+0000 7f2e5a1d4700 1 --2- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e541475a0 0x7f2e54063050 secure :-1 s=READY pgs=984 cs=0 l=1 rx=0x7f2e480045b0 tx=0x7f2e4c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.252 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:33:39.243+0000 7fdb4592c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:33:39.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.267+0000 7f2e5a1d4700 1 --2- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e541475a0 0x7f2e54063050 secure :-1 s=THROTTLE_DONE pgs=984 cs=0 l=1 rx=0x7f2e480045b0 tx=0x7f2e4c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.267+0000 7f2e46ffd700 1 -- 172.21.15.63:0/1942080001 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v82) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2e4c040f20 con 0x7f2e541475a0 2020-05-18T21:33:39.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.267+0000 7f2e5bc37700 1 -- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e34050110 msgr2=0x7f2e340525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:39.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.267+0000 7f2e5bc37700 1 --2- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e34050110 0x7f2e340525d0 secure :-1 s=READY pgs=571 cs=0 l=1 rx=0x7f2e48001030 tx=0x7f2e48009740).stop 2020-05-18T21:33:39.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.267+0000 7f2e5bc37700 1 -- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e541475a0 msgr2=0x7f2e54063050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:39.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.267+0000 7f2e5bc37700 1 --2- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e541475a0 0x7f2e54063050 secure :-1 s=READY pgs=984 cs=0 l=1 rx=0x7f2e480045b0 tx=0x7f2e4c010b60).stop 2020-05-18T21:33:39.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.267+0000 7f2e5bc37700 1 -- 172.21.15.63:0/1942080001 shutdown_connections 2020-05-18T21:33:39.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.267+0000 7f2e5bc37700 1 --2- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e34050110 0x7f2e340525d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:39.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.267+0000 7f2e5bc37700 1 --2- 172.21.15.63:0/1942080001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e541475a0 0x7f2e54063050 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:39.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.267+0000 7f2e5bc37700 1 -- 172.21.15.63:0/1942080001 >> 172.21.15.63:0/1942080001 conn(0x7f2e540b83f0 msgr2=0x7f2e540b74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:39.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.267+0000 7f2e5bc37700 1 -- 172.21.15.63:0/1942080001 shutdown_connections 2020-05-18T21:33:39.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.267+0000 7f2e5bc37700 1 -- 172.21.15.63:0/1942080001 wait complete. 2020-05-18T21:33:39.278 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-05-18T21:33:39.290 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:39.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1338d700 1 Processor -- start 2020-05-18T21:33:39.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1338d700 1 -- start start 2020-05-18T21:33:39.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1338d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3e0c05f110 0x7f3e0c0b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:39.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1338d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3e0c064fd0 0x7f3e0c14d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:39.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1338d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e0c14a330 con 0x7f3e0c14aa70 2020-05-18T21:33:39.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1338d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0c14a140 con 0x7f3e0c05f110 2020-05-18T21:33:39.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1338d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0c065460 con 0x7f3e0c064fd0 2020-05-18T21:33:39.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1238b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3e0c05f110 0x7f3e0c0b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:39.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e11b8a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3e0c14aa70 0x7f3e0c0648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34742/0 (socket says 172.21.15.63:34742) 2020-05-18T21:33:39.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e11b8a700 1 -- 172.21.15.63:0/1028972442 learned_addr learned my addr 172.21.15.63:0/1028972442 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:39.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e12b8c700 1 --2- 172.21.15.63:0/1028972442 >> v2:172.21.15.155:3300/0 conn(0x7f3e0c064fd0 0x7f3e0c14d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:39.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e11389700 1 -- 172.21.15.63:0/1028972442 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274442827 0 0) 0x7f3e0c14a330 con 0x7f3e0c14aa70 2020-05-18T21:33:39.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e11389700 1 -- 172.21.15.63:0/1028972442 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3df4003270 con 0x7f3e0c14aa70 2020-05-18T21:33:39.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1238b700 1 -- 172.21.15.63:0/1028972442 >> v2:172.21.15.155:3300/0 conn(0x7f3e0c064fd0 msgr2=0x7f3e0c14d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:39.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1238b700 1 --2- 172.21.15.63:0/1028972442 >> v2:172.21.15.155:3300/0 conn(0x7f3e0c064fd0 0x7f3e0c14d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:39.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e11389700 1 -- 172.21.15.63:0/1028972442 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2846747629 0 0) 0x7f3df4003270 con 0x7f3e0c14aa70 2020-05-18T21:33:39.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1238b700 1 -- 172.21.15.63:0/1028972442 >> v1:172.21.15.63:6789/0 conn(0x7f3e0c14aa70 legacy=0x7f3e0c0648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:39.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1238b700 1 -- 172.21.15.63:0/1028972442 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c14a5d0 con 0x7f3e0c05f110 2020-05-18T21:33:39.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1238b700 1 --2- 172.21.15.63:0/1028972442 >> v2:172.21.15.63:3300/0 conn(0x7f3e0c05f110 0x7f3e0c0b4760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3e080018b0 tx=0x7f3dfc008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1238b700 1 --2- 172.21.15.63:0/1028972442 >> v2:172.21.15.63:3300/0 conn(0x7f3e0c05f110 0x7f3e0c0b4760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3e080018b0 tx=0x7f3dfc008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1238b700 1 --2- 172.21.15.63:0/1028972442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e0c05f110 0x7f3e0c0b4760 secure :-1 s=READY pgs=1468 cs=0 l=1 rx=0x7f3e080018b0 tx=0x7f3dfc008920).ready entity=mon.0 client_cookie=64c8317f93343cfa server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:39.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1238b700 1 --2- 172.21.15.63:0/1028972442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e0c05f110 0x7f3e0c0b4760 secure :-1 s=THROTTLE_DONE pgs=1468 cs=0 l=1 rx=0x7f3e080018b0 tx=0x7f3dfc008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e11389700 1 -- 172.21.15.63:0/1028972442 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e08001710 con 0x7f3e0c05f110 2020-05-18T21:33:39.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1238b700 1 --2- 172.21.15.63:0/1028972442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e0c05f110 0x7f3e0c0b4760 secure :-1 s=THROTTLE_DONE pgs=1468 cs=0 l=1 rx=0x7f3e080018b0 tx=0x7f3dfc008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e11389700 1 -- 172.21.15.63:0/1028972442 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc008e80 con 0x7f3e0c05f110 2020-05-18T21:33:39.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1238b700 1 --2- 172.21.15.63:0/1028972442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e0c05f110 0x7f3e0c0b4760 secure :-1 s=THROTTLE_DONE pgs=1468 cs=0 l=1 rx=0x7f3e080018b0 tx=0x7f3dfc008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1338d700 1 -- 172.21.15.63:0/1028972442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e0c05f110 msgr2=0x7f3e0c0b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:39.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1338d700 1 --2- 172.21.15.63:0/1028972442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e0c05f110 0x7f3e0c0b4760 secure :-1 s=READY pgs=1468 cs=0 l=1 rx=0x7f3e080018b0 tx=0x7f3dfc008920).stop 2020-05-18T21:33:39.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e11389700 1 -- 172.21.15.63:0/1028972442 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dfc011440 con 0x7f3e0c05f110 2020-05-18T21:33:39.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1338d700 1 -- 172.21.15.63:0/1028972442 shutdown_connections 2020-05-18T21:33:39.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1338d700 1 --2- 172.21.15.63:0/1028972442 >> v2:172.21.15.155:3300/0 conn(0x7f3e0c064fd0 0x7f3e0c14d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:39.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1338d700 1 --2- 172.21.15.63:0/1028972442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e0c05f110 0x7f3e0c0b4760 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:39.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1338d700 1 -- 172.21.15.63:0/1028972442 >> 172.21.15.63:0/1028972442 conn(0x7f3e0c069fc0 msgr2=0x7f3e0c06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:39.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1338d700 1 -- 172.21.15.63:0/1028972442 shutdown_connections 2020-05-18T21:33:39.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.391+0000 7f3e1338d700 1 -- 172.21.15.63:0/1028972442 wait complete. 2020-05-18T21:33:39.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e1338d700 1 Processor -- start 2020-05-18T21:33:39.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e1338d700 1 -- start start 2020-05-18T21:33:39.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e1338d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3e0c05f110 0x7f3e0c142420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:39.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e1338d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3e0c064fd0 0x7f3e0c15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:39.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e1338d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e0c14aa70 0x7f3e0c15b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:39.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e1338d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0c142880 con 0x7f3e0c064fd0 2020-05-18T21:33:39.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e1338d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0c1430e0 con 0x7f3e0c05f110 2020-05-18T21:33:39.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e1338d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c143380 con 0x7f3e0c14aa70 2020-05-18T21:33:39.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e11b8a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3e0c064fd0 0x7f3e0c15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:39.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e11b8a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3e0c064fd0 0x7f3e0c15ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60794/0 (socket says 172.21.15.63:60794) 2020-05-18T21:33:39.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e11b8a700 1 -- 172.21.15.63:0/2744447353 learned_addr learned my addr 172.21.15.63:0/2744447353 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:39.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e1238b700 1 --2- 172.21.15.63:0/2744447353 >> v2:172.21.15.155:3300/0 conn(0x7f3e0c05f110 0x7f3e0c142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:39.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e12b8c700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e0c14aa70 0x7f3e0c15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:39.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e11b8a700 1 -- 172.21.15.63:0/2744447353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e0c14aa70 msgr2=0x7f3e0c15b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:39.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e11b8a700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e0c14aa70 0x7f3e0c15b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:39.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e11b8a700 1 -- 172.21.15.63:0/2744447353 >> v2:172.21.15.155:3300/0 conn(0x7f3e0c05f110 msgr2=0x7f3e0c142420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:39.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e11b8a700 1 --2- 172.21.15.63:0/2744447353 >> v2:172.21.15.155:3300/0 conn(0x7f3e0c05f110 0x7f3e0c142420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:39.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e11b8a700 1 -- 172.21.15.63:0/2744447353 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c149d00 con 0x7f3e0c064fd0 2020-05-18T21:33:39.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e11b8a700 1 --2- 172.21.15.63:0/2744447353 >> v2:172.21.15.63:3300/0 conn(0x7f3e0c064fd0 0x7f3e0c15ae20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e0c0b59e0 tx=0x7f3e08010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e11b8a700 1 --2- 172.21.15.63:0/2744447353 >> v2:172.21.15.63:3300/0 conn(0x7f3e0c064fd0 0x7f3e0c15ae20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e0c0b59e0 tx=0x7f3e08010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e11b8a700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e0c064fd0 0x7f3e0c15ae20 secure :-1 s=READY pgs=1469 cs=0 l=1 rx=0x7f3e0c0b59e0 tx=0x7f3e08010cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:39.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e11b8a700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e0c064fd0 0x7f3e0c15ae20 secure :-1 s=THROTTLE_DONE pgs=1469 cs=0 l=1 rx=0x7f3e0c0b59e0 tx=0x7f3e08010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e11b8a700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e0c064fd0 0x7f3e0c15ae20 secure :-1 s=THROTTLE_DONE pgs=1469 cs=0 l=1 rx=0x7f3e0c0b59e0 tx=0x7f3e08010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3dfb7fe700 1 -- 172.21.15.63:0/2744447353 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e0800c960 con 0x7f3e0c064fd0 2020-05-18T21:33:39.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e11b8a700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e0c064fd0 0x7f3e0c15ae20 secure :-1 s=THROTTLE_DONE pgs=1469 cs=0 l=1 rx=0x7f3e0c0b59e0 tx=0x7f3e08010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3dfb7fe700 1 -- 172.21.15.63:0/2744447353 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0800cac0 con 0x7f3e0c064fd0 2020-05-18T21:33:39.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e1338d700 1 -- 172.21.15.63:0/2744447353 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0c140d30 con 0x7f3e0c064fd0 2020-05-18T21:33:39.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3dfb7fe700 1 -- 172.21.15.63:0/2744447353 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e0800cea0 con 0x7f3e0c064fd0 2020-05-18T21:33:39.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.395+0000 7f3e1338d700 1 -- 172.21.15.63:0/2744447353 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0c142cb0 con 0x7f3e0c064fd0 2020-05-18T21:33:39.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.399+0000 7f3e11b8a700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e0c064fd0 0x7f3e0c15ae20 secure :-1 s=THROTTLE_DONE pgs=1469 cs=0 l=1 rx=0x7f3e0c0b59e0 tx=0x7f3e08010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.399+0000 7f3e1338d700 1 -- 172.21.15.63:0/2744447353 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e0c1449a0 con 0x7f3e0c064fd0 2020-05-18T21:33:39.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.399+0000 7f3dfb7fe700 1 -- 172.21.15.63:0/2744447353 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3e08013070 con 0x7f3e0c064fd0 2020-05-18T21:33:39.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.399+0000 7f3e11b8a700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e0c064fd0 0x7f3e0c15ae20 secure :-1 s=THROTTLE_DONE pgs=1469 cs=0 l=1 rx=0x7f3e0c0b59e0 tx=0x7f3e08010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.399+0000 7f3dfb7fe700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3dec04fac0 0x7f3dec051f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:39.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.399+0000 7f3dfb7fe700 1 -- 172.21.15.63:0/2744447353 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f3e080638a0 con 0x7f3e0c064fd0 2020-05-18T21:33:39.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.399+0000 7f3e1238b700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3dec04fac0 0x7f3dec051f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:39.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.399+0000 7f3e1238b700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3dec04fac0 0x7f3dec051f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e080018b0 tx=0x7f3e0c0640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.399+0000 7f3e1238b700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3dec04fac0 0x7f3dec051f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e080018b0 tx=0x7f3e0c0640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.399+0000 7f3e1238b700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3dec04fac0 0x7f3dec051f80 secure :-1 s=READY pgs=573 cs=0 l=1 rx=0x7f3e080018b0 tx=0x7f3e0c0640f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:39.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.407+0000 7f3e11b8a700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e0c064fd0 0x7f3e0c15ae20 secure :-1 s=THROTTLE_DONE pgs=1469 cs=0 l=1 rx=0x7f3e0c0b59e0 tx=0x7f3e08010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.407+0000 7f3dfb7fe700 1 -- 172.21.15.63:0/2744447353 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3e0c1449a0 con 0x7f3e0c064fd0 2020-05-18T21:33:39.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.555+0000 7f3e1338d700 1 -- 172.21.15.63:0/2744447353 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e0c1449a0 con 0x7f3e0c064fd0 2020-05-18T21:33:39.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.555+0000 7f3e11b8a700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e0c064fd0 0x7f3e0c15ae20 secure :-1 s=THROTTLE_DONE pgs=1469 cs=0 l=1 rx=0x7f3e0c0b59e0 tx=0x7f3e08010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.555+0000 7f3dfb7fe700 1 -- 172.21.15.63:0/2744447353 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f3e0c1449a0 con 0x7f3e0c064fd0 2020-05-18T21:33:39.565 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:39.566 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":82,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6113,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/2300000397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2300000397},{"type":"v1","addr":"172.21.15.63:6833","nonce":2300000397}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":78},{"gid":8329,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1712251040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1712251040},{"type":"v1","addr":"172.21.15.155:6835","nonce":1712251040}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":82}],"filesystems":[{"mdsmap":{"epoch":82,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:23.230529+0000","modified":"2020-05-18T21:33:39.251376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-05-18T21:33:39.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.559+0000 7f3e1338d700 1 -- 172.21.15.63:0/2744447353 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3dec04fac0 msgr2=0x7f3dec051f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:39.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.559+0000 7f3e1338d700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3dec04fac0 0x7f3dec051f80 secure :-1 s=READY pgs=573 cs=0 l=1 rx=0x7f3e080018b0 tx=0x7f3e0c0640f0).stop 2020-05-18T21:33:39.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.559+0000 7f3e1338d700 1 -- 172.21.15.63:0/2744447353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e0c064fd0 msgr2=0x7f3e0c15ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:39.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.559+0000 7f3e1338d700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e0c064fd0 0x7f3e0c15ae20 secure :-1 s=READY pgs=1469 cs=0 l=1 rx=0x7f3e0c0b59e0 tx=0x7f3e08010cb0).stop 2020-05-18T21:33:39.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.559+0000 7f3e1338d700 1 -- 172.21.15.63:0/2744447353 shutdown_connections 2020-05-18T21:33:39.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.559+0000 7f3e1338d700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3dec04fac0 0x7f3dec051f80 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:39.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.559+0000 7f3e1338d700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e0c14aa70 0x7f3e0c15b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:39.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.559+0000 7f3e1338d700 1 --2- 172.21.15.63:0/2744447353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e0c064fd0 0x7f3e0c15ae20 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:39.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.559+0000 7f3e1338d700 1 --2- 172.21.15.63:0/2744447353 >> v2:172.21.15.155:3300/0 conn(0x7f3e0c05f110 0x7f3e0c142420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:39.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.559+0000 7f3e1338d700 1 -- 172.21.15.63:0/2744447353 >> 172.21.15.63:0/2744447353 conn(0x7f3e0c069fc0 msgr2=0x7f3e0c14d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:39.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.559+0000 7f3e1338d700 1 -- 172.21.15.63:0/2744447353 shutdown_connections 2020-05-18T21:33:39.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.559+0000 7f3e1338d700 1 -- 172.21.15.63:0/2744447353 wait complete. 2020-05-18T21:33:39.570 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 82 2020-05-18T21:33:39.584 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-05-18T21:33:39.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 Processor -- start 2020-05-18T21:33:39.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 -- start start 2020-05-18T21:33:39.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f58700606d0 0x7f5870061d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:39.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f58700621d0 0x7f587014d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:39.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587014e740 con 0x7f58700b5100 2020-05-18T21:33:39.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587014b290 con 0x7f58700606d0 2020-05-18T21:33:39.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58701447c0 con 0x7f58700621d0 2020-05-18T21:33:39.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f58700606d0 0x7f5870061d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:39.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f58700b5100 0x7f587014ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34756/0 (socket says 172.21.15.63:34756) 2020-05-18T21:33:39.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586f7fe700 1 -- 172.21.15.63:0/532722041 learned_addr learned my addr 172.21.15.63:0/532722041 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:39.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586ffff700 1 --2- 172.21.15.63:0/532722041 >> v2:172.21.15.155:3300/0 conn(0x7f58700621d0 0x7f587014d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:39.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586effd700 1 -- 172.21.15.63:0/532722041 >> v2:172.21.15.155:3300/0 conn(0x7f58700621d0 msgr2=0x7f587014d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:39.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586effd700 1 --2- 172.21.15.63:0/532722041 >> v2:172.21.15.155:3300/0 conn(0x7f58700621d0 0x7f587014d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:39.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586effd700 1 -- 172.21.15.63:0/532722041 >> v1:172.21.15.63:6789/0 conn(0x7f58700b5100 legacy=0x7f587014ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:39.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586effd700 1 -- 172.21.15.63:0/532722041 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587014a440 con 0x7f58700606d0 2020-05-18T21:33:39.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586effd700 1 --2- 172.21.15.63:0/532722041 >> v2:172.21.15.63:3300/0 conn(0x7f58700606d0 0x7f5870061d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5870147e50 tx=0x7f5864008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586effd700 1 --2- 172.21.15.63:0/532722041 >> v2:172.21.15.63:3300/0 conn(0x7f58700606d0 0x7f5870061d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5870147e50 tx=0x7f5864008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586effd700 1 --2- 172.21.15.63:0/532722041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58700606d0 0x7f5870061d70 secure :-1 s=READY pgs=1471 cs=0 l=1 rx=0x7f5870147e50 tx=0x7f5864008920).ready entity=mon.0 client_cookie=40424f8081db0528 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:39.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586effd700 1 --2- 172.21.15.63:0/532722041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58700606d0 0x7f5870061d70 secure :-1 s=THROTTLE_DONE pgs=1471 cs=0 l=1 rx=0x7f5870147e50 tx=0x7f5864008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586effd700 1 --2- 172.21.15.63:0/532722041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58700606d0 0x7f5870061d70 secure :-1 s=THROTTLE_DONE pgs=1471 cs=0 l=1 rx=0x7f5870147e50 tx=0x7f5864008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586effd700 1 --2- 172.21.15.63:0/532722041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58700606d0 0x7f5870061d70 secure :-1 s=THROTTLE_DONE pgs=1471 cs=0 l=1 rx=0x7f5870147e50 tx=0x7f5864008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586e7fc700 1 -- 172.21.15.63:0/532722041 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5864008e80 con 0x7f58700606d0 2020-05-18T21:33:39.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586e7fc700 1 -- 172.21.15.63:0/532722041 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58640115f0 con 0x7f58700606d0 2020-05-18T21:33:39.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586e7fc700 1 -- 172.21.15.63:0/532722041 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5864011a10 con 0x7f58700606d0 2020-05-18T21:33:39.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 -- 172.21.15.63:0/532722041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58700606d0 msgr2=0x7f5870061d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:39.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 --2- 172.21.15.63:0/532722041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58700606d0 0x7f5870061d70 secure :-1 s=READY pgs=1471 cs=0 l=1 rx=0x7f5870147e50 tx=0x7f5864008920).stop 2020-05-18T21:33:39.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 -- 172.21.15.63:0/532722041 shutdown_connections 2020-05-18T21:33:39.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 --2- 172.21.15.63:0/532722041 >> v2:172.21.15.155:3300/0 conn(0x7f58700621d0 0x7f587014d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:39.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 --2- 172.21.15.63:0/532722041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58700606d0 0x7f5870061d70 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:39.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 -- 172.21.15.63:0/532722041 >> 172.21.15.63:0/532722041 conn(0x7f587009da60 msgr2=0x7f587009de40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:39.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 -- 172.21.15.63:0/532722041 shutdown_connections 2020-05-18T21:33:39.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 -- 172.21.15.63:0/532722041 wait complete. 2020-05-18T21:33:39.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 Processor -- start 2020-05-18T21:33:39.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 -- start start 2020-05-18T21:33:39.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58700b5100 0x7f58700b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:39.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58701449b0 con 0x7f58700606d0 2020-05-18T21:33:39.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5870134ab0 con 0x7f58700621d0 2020-05-18T21:33:39.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f587615f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587015c110 con 0x7f58700b5100 2020-05-18T21:33:39.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f58700606d0 0x7f5870141050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34764/0 (socket says 172.21.15.63:34764) 2020-05-18T21:33:39.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586f7fe700 1 -- 172.21.15.63:0/1360218345 learned_addr learned my addr 172.21.15.63:0/1360218345 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:39.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586ffff700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58700b5100 0x7f58700b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:39.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.691+0000 7f586cff9700 1 -- 172.21.15.63:0/1360218345 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144413450 0 0) 0x7f58701449b0 con 0x7f58700606d0 2020-05-18T21:33:39.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f586cff9700 1 -- 172.21.15.63:0/1360218345 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5850002fe0 con 0x7f58700606d0 2020-05-18T21:33:39.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f586cff9700 1 -- 172.21.15.63:0/1360218345 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462402333 0 0) 0x7f5870134ab0 con 0x7f58700621d0 2020-05-18T21:33:39.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f586cff9700 1 -- 172.21.15.63:0/1360218345 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58701449b0 con 0x7f58700621d0 2020-05-18T21:33:39.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f586cff9700 1 -- 172.21.15.63:0/1360218345 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1728038970 0 0) 0x7f5850002fe0 con 0x7f58700606d0 2020-05-18T21:33:39.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f586ffff700 1 -- 172.21.15.63:0/1360218345 >> v1:172.21.15.155:6789/0 conn(0x7f58700621d0 legacy=0x7f5870144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:39.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f586ffff700 1 -- 172.21.15.63:0/1360218345 >> v1:172.21.15.63:6789/0 conn(0x7f58700606d0 legacy=0x7f5870141050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:39.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f586ffff700 1 -- 172.21.15.63:0/1360218345 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587015c3b0 con 0x7f58700b5100 2020-05-18T21:33:39.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f586ffff700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58700b5100 0x7f58700b6290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5860000f30 tx=0x7f5868010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f586ffff700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58700b5100 0x7f58700b6290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5860000f30 tx=0x7f5868010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f586ffff700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58700b5100 0x7f58700b6290 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7f5860000f30 tx=0x7f5868010f00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:39.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f586ffff700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58700b5100 0x7f58700b6290 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f5860000f30 tx=0x7f5868010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f586cff9700 1 -- 172.21.15.63:0/1360218345 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5860001890 con 0x7f58700b5100 2020-05-18T21:33:39.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f586ffff700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58700b5100 0x7f58700b6290 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f5860000f30 tx=0x7f5868010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f586ffff700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58700b5100 0x7f58700b6290 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f5860000f30 tx=0x7f5868010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f586cff9700 1 -- 172.21.15.63:0/1360218345 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586800e370 con 0x7f58700b5100 2020-05-18T21:33:39.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f587615f700 1 -- 172.21.15.63:0/1360218345 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5870146510 con 0x7f58700b5100 2020-05-18T21:33:39.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f586cff9700 1 -- 172.21.15.63:0/1360218345 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5868005c70 con 0x7f58700b5100 2020-05-18T21:33:39.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f587615f700 1 -- 172.21.15.63:0/1360218345 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5870141900 con 0x7f58700b5100 2020-05-18T21:33:39.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f587615f700 1 -- 172.21.15.63:0/1360218345 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58701466a0 con 0x7f58700b5100 2020-05-18T21:33:39.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f586ffff700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58700b5100 0x7f58700b6290 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f5860000f30 tx=0x7f5868010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f586cff9700 1 -- 172.21.15.63:0/1360218345 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f586800c940 con 0x7f58700b5100 2020-05-18T21:33:39.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.695+0000 7f586ffff700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58700b5100 0x7f58700b6290 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f5860000f30 tx=0x7f5868010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.699+0000 7f586cff9700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f585004feb0 0x7f5850052370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:39.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.699+0000 7f586cff9700 1 -- 172.21.15.63:0/1360218345 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f5868063860 con 0x7f58700b5100 2020-05-18T21:33:39.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.699+0000 7f586f7fe700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f585004feb0 0x7f5850052370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:39.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.699+0000 7f586f7fe700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f585004feb0 0x7f5850052370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5860001000 tx=0x7f5860009eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.699+0000 7f586f7fe700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f585004feb0 0x7f5850052370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5860001000 tx=0x7f5860009eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.699+0000 7f586f7fe700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f585004feb0 0x7f5850052370 secure :-1 s=READY pgs=574 cs=0 l=1 rx=0x7f5860001000 tx=0x7f5860009eb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:39.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.707+0000 7f586ffff700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58700b5100 0x7f58700b6290 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f5860000f30 tx=0x7f5868010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:39.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.707+0000 7f586cff9700 1 -- 172.21.15.63:0/1360218345 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f586803dcb0 con 0x7f58700b5100 2020-05-18T21:33:39.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:39.867+0000 7f587615f700 1 -- 172.21.15.63:0/1360218345 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f58700569e0 con 0x7f58700b5100 2020-05-18T21:33:40.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.267+0000 7f586ffff700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58700b5100 0x7f58700b6290 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f5860000f30 tx=0x7f5868010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:40.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.267+0000 7f586cff9700 1 -- 172.21.15.63:0/1360218345 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v83) v1 ==== 104+0+0 (secure 0 0 0) 0x7f58680412d0 con 0x7f58700b5100 2020-05-18T21:33:40.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.275+0000 7f587615f700 1 -- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f585004feb0 msgr2=0x7f5850052370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:40.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.275+0000 7f587615f700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f585004feb0 0x7f5850052370 secure :-1 s=READY pgs=574 cs=0 l=1 rx=0x7f5860001000 tx=0x7f5860009eb0).stop 2020-05-18T21:33:40.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.275+0000 7f587615f700 1 -- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58700b5100 msgr2=0x7f58700b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:40.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.275+0000 7f587615f700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58700b5100 0x7f58700b6290 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7f5860000f30 tx=0x7f5868010f00).stop 2020-05-18T21:33:40.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.275+0000 7f587615f700 1 -- 172.21.15.63:0/1360218345 shutdown_connections 2020-05-18T21:33:40.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.275+0000 7f587615f700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f585004feb0 0x7f5850052370 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:40.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.275+0000 7f587615f700 1 --2- 172.21.15.63:0/1360218345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58700b5100 0x7f58700b6290 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:40.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.275+0000 7f587615f700 1 -- 172.21.15.63:0/1360218345 >> 172.21.15.63:0/1360218345 conn(0x7f587009da60 msgr2=0x7f58700b2880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:40.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.275+0000 7f587615f700 1 -- 172.21.15.63:0/1360218345 shutdown_connections 2020-05-18T21:33:40.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.275+0000 7f587615f700 1 -- 172.21.15.63:0/1360218345 wait complete. 2020-05-18T21:33:40.295 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-05-18T21:33:40.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe226d6700 1 Processor -- start 2020-05-18T21:33:40.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe226d6700 1 -- start start 2020-05-18T21:33:40.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe226d6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe1c147390 0x7efe1c1477f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:40.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe226d6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efe1c0b60e0 0x7efe1c0b6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:40.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe226d6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe1c147d10 con 0x7efe1c062da0 2020-05-18T21:33:40.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe226d6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1c147fb0 con 0x7efe1c147390 2020-05-18T21:33:40.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe226d6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1c0b69d0 con 0x7efe1c0b60e0 2020-05-18T21:33:40.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe13fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe1c147390 0x7efe1c1477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:40.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe1bfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efe1c062da0 0x7efe1c143c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34768/0 (socket says 172.21.15.63:34768) 2020-05-18T21:33:40.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe1bfff700 1 -- 172.21.15.63:0/1709030532 learned_addr learned my addr 172.21.15.63:0/1709030532 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:40.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe20c73700 1 --2- 172.21.15.63:0/1709030532 >> v2:172.21.15.155:3300/0 conn(0x7efe1c0b60e0 0x7efe1c0b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:40.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe1b7fe700 1 -- 172.21.15.63:0/1709030532 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517291314 0 0) 0x7efe1c147d10 con 0x7efe1c062da0 2020-05-18T21:33:40.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe1b7fe700 1 -- 172.21.15.63:0/1709030532 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe00003270 con 0x7efe1c062da0 2020-05-18T21:33:40.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe13fff700 1 -- 172.21.15.63:0/1709030532 >> v2:172.21.15.155:3300/0 conn(0x7efe1c0b60e0 msgr2=0x7efe1c0b6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:40.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe13fff700 1 --2- 172.21.15.63:0/1709030532 >> v2:172.21.15.155:3300/0 conn(0x7efe1c0b60e0 0x7efe1c0b6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:40.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe13fff700 1 -- 172.21.15.63:0/1709030532 >> v1:172.21.15.63:6789/0 conn(0x7efe1c062da0 legacy=0x7efe1c143c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:40.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe13fff700 1 -- 172.21.15.63:0/1709030532 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1c063180 con 0x7efe1c147390 2020-05-18T21:33:40.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe13fff700 1 --2- 172.21.15.63:0/1709030532 >> v2:172.21.15.63:3300/0 conn(0x7efe1c147390 0x7efe1c1477f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efe04002f70 tx=0x7efe04007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:40.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe13fff700 1 --2- 172.21.15.63:0/1709030532 >> v2:172.21.15.63:3300/0 conn(0x7efe1c147390 0x7efe1c1477f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efe04002f70 tx=0x7efe04007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:40.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe13fff700 1 --2- 172.21.15.63:0/1709030532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe1c147390 0x7efe1c1477f0 secure :-1 s=READY pgs=1474 cs=0 l=1 rx=0x7efe04002f70 tx=0x7efe04007a80).ready entity=mon.0 client_cookie=93b10ad549bac541 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:40.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe13fff700 1 --2- 172.21.15.63:0/1709030532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe1c147390 0x7efe1c1477f0 secure :-1 s=THROTTLE_DONE pgs=1474 cs=0 l=1 rx=0x7efe04002f70 tx=0x7efe04007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:40.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe13fff700 1 --2- 172.21.15.63:0/1709030532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe1c147390 0x7efe1c1477f0 secure :-1 s=THROTTLE_DONE pgs=1474 cs=0 l=1 rx=0x7efe04002f70 tx=0x7efe04007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:40.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe1b7fe700 1 -- 172.21.15.63:0/1709030532 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe04008e50 con 0x7efe1c147390 2020-05-18T21:33:40.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe13fff700 1 --2- 172.21.15.63:0/1709030532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe1c147390 0x7efe1c1477f0 secure :-1 s=THROTTLE_DONE pgs=1474 cs=0 l=1 rx=0x7efe04002f70 tx=0x7efe04007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:40.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe1b7fe700 1 -- 172.21.15.63:0/1709030532 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe04011540 con 0x7efe1c147390 2020-05-18T21:33:40.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe1b7fe700 1 -- 172.21.15.63:0/1709030532 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe04011960 con 0x7efe1c147390 2020-05-18T21:33:40.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe226d6700 1 -- 172.21.15.63:0/1709030532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe1c147390 msgr2=0x7efe1c1477f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:40.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe226d6700 1 --2- 172.21.15.63:0/1709030532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe1c147390 0x7efe1c1477f0 secure :-1 s=READY pgs=1474 cs=0 l=1 rx=0x7efe04002f70 tx=0x7efe04007a80).stop 2020-05-18T21:33:40.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe226d6700 1 -- 172.21.15.63:0/1709030532 shutdown_connections 2020-05-18T21:33:40.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe226d6700 1 --2- 172.21.15.63:0/1709030532 >> v2:172.21.15.155:3300/0 conn(0x7efe1c0b60e0 0x7efe1c0b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:40.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe226d6700 1 --2- 172.21.15.63:0/1709030532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe1c147390 0x7efe1c1477f0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:40.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe226d6700 1 -- 172.21.15.63:0/1709030532 >> 172.21.15.63:0/1709030532 conn(0x7efe1c0b70a0 msgr2=0x7efe1c0b74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:40.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe226d6700 1 -- 172.21.15.63:0/1709030532 shutdown_connections 2020-05-18T21:33:40.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.407+0000 7efe226d6700 1 -- 172.21.15.63:0/1709030532 wait complete. 2020-05-18T21:33:40.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe226d6700 1 Processor -- start 2020-05-18T21:33:40.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe226d6700 1 -- start start 2020-05-18T21:33:40.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe226d6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efe1c0b60e0 0x7efe1c146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:40.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe226d6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe1c147390 0x7efe1c13d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:40.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe226d6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe1c13f160 con 0x7efe1c062da0 2020-05-18T21:33:40.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe226d6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1c146730 con 0x7efe1c147390 2020-05-18T21:33:40.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe226d6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1c13eec0 con 0x7efe1c0b60e0 2020-05-18T21:33:40.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe1bfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efe1c062da0 0x7efe1c1429a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34774/0 (socket says 172.21.15.63:34774) 2020-05-18T21:33:40.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe1bfff700 1 -- 172.21.15.63:0/260179228 learned_addr learned my addr 172.21.15.63:0/260179228 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:40.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe20c73700 1 --2- 172.21.15.63:0/260179228 >> v2:172.21.15.63:3300/0 conn(0x7efe1c147390 0x7efe1c13d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:40.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe13fff700 1 --2- 172.21.15.63:0/260179228 >> v2:172.21.15.155:3300/0 conn(0x7efe1c0b60e0 0x7efe1c146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:40.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe19ffb700 1 -- 172.21.15.63:0/260179228 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334927622 0 0) 0x7efe1c13f160 con 0x7efe1c062da0 2020-05-18T21:33:40.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe19ffb700 1 -- 172.21.15.63:0/260179228 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdf4002fe0 con 0x7efe1c062da0 2020-05-18T21:33:40.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe20c73700 1 -- 172.21.15.63:0/260179228 >> v2:172.21.15.155:3300/0 conn(0x7efe1c0b60e0 msgr2=0x7efe1c146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:40.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe20c73700 1 --2- 172.21.15.63:0/260179228 >> v2:172.21.15.155:3300/0 conn(0x7efe1c0b60e0 0x7efe1c146b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:40.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe20c73700 1 -- 172.21.15.63:0/260179228 >> v1:172.21.15.63:6789/0 conn(0x7efe1c062da0 legacy=0x7efe1c1429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:40.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe20c73700 1 -- 172.21.15.63:0/260179228 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1c09e980 con 0x7efe1c147390 2020-05-18T21:33:40.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe20c73700 1 --2- 172.21.15.63:0/260179228 >> v2:172.21.15.63:3300/0 conn(0x7efe1c147390 0x7efe1c13d1d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe140032f0 tx=0x7efe14010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:40.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe20c73700 1 --2- 172.21.15.63:0/260179228 >> v2:172.21.15.63:3300/0 conn(0x7efe1c147390 0x7efe1c13d1d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe140032f0 tx=0x7efe14010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:40.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe20c73700 1 --2- 172.21.15.63:0/260179228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe1c147390 0x7efe1c13d1d0 secure :-1 s=READY pgs=1476 cs=0 l=1 rx=0x7efe140032f0 tx=0x7efe14010f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:40.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe20c73700 1 --2- 172.21.15.63:0/260179228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe1c147390 0x7efe1c13d1d0 secure :-1 s=THROTTLE_DONE pgs=1476 cs=0 l=1 rx=0x7efe140032f0 tx=0x7efe14010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:40.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe19ffb700 1 -- 172.21.15.63:0/260179228 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe14005a80 con 0x7efe1c147390 2020-05-18T21:33:40.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe20c73700 1 --2- 172.21.15.63:0/260179228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe1c147390 0x7efe1c13d1d0 secure :-1 s=THROTTLE_DONE pgs=1476 cs=0 l=1 rx=0x7efe140032f0 tx=0x7efe14010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:40.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe20c73700 1 --2- 172.21.15.63:0/260179228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe1c147390 0x7efe1c13d1d0 secure :-1 s=THROTTLE_DONE pgs=1476 cs=0 l=1 rx=0x7efe140032f0 tx=0x7efe14010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:40.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe19ffb700 1 -- 172.21.15.63:0/260179228 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe14005be0 con 0x7efe1c147390 2020-05-18T21:33:40.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe226d6700 1 -- 172.21.15.63:0/260179228 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1c13d630 con 0x7efe1c147390 2020-05-18T21:33:40.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe19ffb700 1 -- 172.21.15.63:0/260179228 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe1400c940 con 0x7efe1c147390 2020-05-18T21:33:40.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.411+0000 7efe226d6700 1 -- 172.21.15.63:0/260179228 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe1c13dbb0 con 0x7efe1c147390 2020-05-18T21:33:40.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.415+0000 7efe20c73700 1 --2- 172.21.15.63:0/260179228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe1c147390 0x7efe1c13d1d0 secure :-1 s=THROTTLE_DONE pgs=1476 cs=0 l=1 rx=0x7efe140032f0 tx=0x7efe14010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:40.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.415+0000 7efe226d6700 1 -- 172.21.15.63:0/260179228 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1c13ed00 con 0x7efe1c147390 2020-05-18T21:33:40.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.415+0000 7efe19ffb700 1 -- 172.21.15.63:0/260179228 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7efe1400cb70 con 0x7efe1c147390 2020-05-18T21:33:40.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.415+0000 7efe20c73700 1 --2- 172.21.15.63:0/260179228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe1c147390 0x7efe1c13d1d0 secure :-1 s=THROTTLE_DONE pgs=1476 cs=0 l=1 rx=0x7efe140032f0 tx=0x7efe14010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:40.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.415+0000 7efe19ffb700 1 --2- 172.21.15.63:0/260179228 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdf404fd60 0x7efdf4052220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:40.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.415+0000 7efe19ffb700 1 -- 172.21.15.63:0/260179228 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6159+0+0 (secure 0 0 0) 0x7efe14063af0 con 0x7efe1c147390 2020-05-18T21:33:40.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.415+0000 7efe1bfff700 1 --2- 172.21.15.63:0/260179228 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdf404fd60 0x7efdf4052220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:40.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.415+0000 7efe1bfff700 1 --2- 172.21.15.63:0/260179228 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdf404fd60 0x7efdf4052220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe0c001150 tx=0x7efe0c001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:40.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.415+0000 7efe1bfff700 1 --2- 172.21.15.63:0/260179228 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdf404fd60 0x7efdf4052220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe0c001150 tx=0x7efe0c001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:40.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.415+0000 7efe1bfff700 1 --2- 172.21.15.63:0/260179228 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdf404fd60 0x7efdf4052220 secure :-1 s=READY pgs=575 cs=0 l=1 rx=0x7efe0c001150 tx=0x7efe0c001700).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:40.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.419+0000 7efe20c73700 1 --2- 172.21.15.63:0/260179228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe1c147390 0x7efe1c13d1d0 secure :-1 s=THROTTLE_DONE pgs=1476 cs=0 l=1 rx=0x7efe140032f0 tx=0x7efe14010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:40.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.419+0000 7efe19ffb700 1 -- 172.21.15.63:0/260179228 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7efe1403de20 con 0x7efe1c147390 2020-05-18T21:33:40.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:40.535+0000 7efe226d6700 1 -- 172.21.15.63:0/260179228 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efe1c0569e0 con 0x7efe1c147390 2020-05-18T21:33:41.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.283+0000 7efe20c73700 1 --2- 172.21.15.63:0/260179228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe1c147390 0x7efe1c13d1d0 secure :-1 s=THROTTLE_DONE pgs=1476 cs=0 l=1 rx=0x7efe140032f0 tx=0x7efe14010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:41.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.283+0000 7efe19ffb700 1 -- 172.21.15.63:0/260179228 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v106) v1 ==== 185+0+0 (secure 0 0 0) 0x7efe14041440 con 0x7efe1c147390 2020-05-18T21:33:41.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.291+0000 7efe226d6700 1 -- 172.21.15.63:0/260179228 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdf404fd60 msgr2=0x7efdf4052220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:41.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.291+0000 7efe226d6700 1 --2- 172.21.15.63:0/260179228 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdf404fd60 0x7efdf4052220 secure :-1 s=READY pgs=575 cs=0 l=1 rx=0x7efe0c001150 tx=0x7efe0c001700).stop 2020-05-18T21:33:41.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.291+0000 7efe226d6700 1 -- 172.21.15.63:0/260179228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe1c147390 msgr2=0x7efe1c13d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:41.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.291+0000 7efe226d6700 1 --2- 172.21.15.63:0/260179228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe1c147390 0x7efe1c13d1d0 secure :-1 s=READY pgs=1476 cs=0 l=1 rx=0x7efe140032f0 tx=0x7efe14010f00).stop 2020-05-18T21:33:41.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.291+0000 7efe226d6700 1 -- 172.21.15.63:0/260179228 shutdown_connections 2020-05-18T21:33:41.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.291+0000 7efe226d6700 1 --2- 172.21.15.63:0/260179228 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdf404fd60 0x7efdf4052220 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:41.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.291+0000 7efe226d6700 1 --2- 172.21.15.63:0/260179228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe1c147390 0x7efe1c13d1d0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:41.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.291+0000 7efe226d6700 1 --2- 172.21.15.63:0/260179228 >> v2:172.21.15.155:3300/0 conn(0x7efe1c0b60e0 0x7efe1c146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:41.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.291+0000 7efe226d6700 1 -- 172.21.15.63:0/260179228 >> 172.21.15.63:0/260179228 conn(0x7efe1c0b70a0 msgr2=0x7efe1c0b5990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:41.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.291+0000 7efe226d6700 1 -- 172.21.15.63:0/260179228 shutdown_connections 2020-05-18T21:33:41.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.291+0000 7efe226d6700 1 -- 172.21.15.63:0/260179228 wait complete. 2020-05-18T21:33:41.296 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2020-05-18T21:33:41.307 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-05-18T21:33:41.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.415+0000 7f2381ebf700 1 Processor -- start 2020-05-18T21:33:41.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.415+0000 7f2381ebf700 1 -- start start 2020-05-18T21:33:41.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f2381ebf700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f237c1441f0 0x7f237c060860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:41.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f2381ebf700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f237c0bc590 0x7f237c0bc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:41.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f2381ebf700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f237c14e5a0 con 0x7f237c14e120 2020-05-18T21:33:41.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f2381ebf700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237c14a240 con 0x7f237c1441f0 2020-05-18T21:33:41.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f2381ebf700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237c14a430 con 0x7f237c0bc590 2020-05-18T21:33:41.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f2380ebd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f237c1441f0 0x7f237c060860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:41.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f23816be700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f237c0bc590 0x7f237c0bc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:41.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f237bfff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f237c14e120 0x7f237c0b6fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:33100/0 (socket says 172.21.15.63:33100) 2020-05-18T21:33:41.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f2380ebd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f237c1441f0 0x7f237c060860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:47442/0 (socket says 172.21.15.63:47442) 2020-05-18T21:33:41.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f237bfff700 1 -- 172.21.15.63:0/59086608 learned_addr learned my addr 172.21.15.63:0/59086608 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f237b7fe700 1 -- 172.21.15.63:0/59086608 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628559825 0 0) 0x7f237c14e5a0 con 0x7f237c14e120 2020-05-18T21:33:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f23816be700 1 -- 172.21.15.63:0/59086608 >> v2:172.21.15.155:3300/0 conn(0x7f237c1441f0 msgr2=0x7f237c060860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f23816be700 1 --2- 172.21.15.63:0/59086608 >> v2:172.21.15.155:3300/0 conn(0x7f237c1441f0 0x7f237c060860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f23816be700 1 -- 172.21.15.63:0/59086608 >> v1:172.21.15.155:6789/0 conn(0x7f237c14e120 legacy=0x7f237c0b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f23816be700 1 -- 172.21.15.63:0/59086608 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c0b76b0 con 0x7f237c0bc590 2020-05-18T21:33:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f23816be700 1 --2- 172.21.15.63:0/59086608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f237c0bc590 0x7f237c0bc9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2374002f70 tx=0x7f2374007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f23816be700 1 --2- 172.21.15.63:0/59086608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f237c0bc590 0x7f237c0bc9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2374002f70 tx=0x7f2374007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f23816be700 1 --2- 172.21.15.63:0/59086608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f237c0bc590 0x7f237c0bc9e0 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7f2374002f70 tx=0x7f2374007a80).ready entity=mon.2 client_cookie=d0bdcceb76bd252e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f23816be700 1 --2- 172.21.15.63:0/59086608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f237c0bc590 0x7f237c0bc9e0 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f2374002f70 tx=0x7f2374007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f237b7fe700 1 -- 172.21.15.63:0/59086608 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2374008e80 con 0x7f237c0bc590 2020-05-18T21:33:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f23816be700 1 --2- 172.21.15.63:0/59086608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f237c0bc590 0x7f237c0bc9e0 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f2374002f70 tx=0x7f2374007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f23816be700 1 --2- 172.21.15.63:0/59086608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f237c0bc590 0x7f237c0bc9e0 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f2374002f70 tx=0x7f2374007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f237b7fe700 1 -- 172.21.15.63:0/59086608 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23740115f0 con 0x7f237c0bc590 2020-05-18T21:33:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f2381ebf700 1 -- 172.21.15.63:0/59086608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f237c0bc590 msgr2=0x7f237c0bc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f237b7fe700 1 -- 172.21.15.63:0/59086608 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23740119d0 con 0x7f237c0bc590 2020-05-18T21:33:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f2381ebf700 1 --2- 172.21.15.63:0/59086608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f237c0bc590 0x7f237c0bc9e0 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7f2374002f70 tx=0x7f2374007a80).stop 2020-05-18T21:33:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f2381ebf700 1 -- 172.21.15.63:0/59086608 shutdown_connections 2020-05-18T21:33:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f2381ebf700 1 --2- 172.21.15.63:0/59086608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f237c0bc590 0x7f237c0bc9e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f2381ebf700 1 --2- 172.21.15.63:0/59086608 >> v2:172.21.15.155:3300/0 conn(0x7f237c1441f0 0x7f237c060860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f2381ebf700 1 -- 172.21.15.63:0/59086608 >> 172.21.15.63:0/59086608 conn(0x7f237c05f3b0 msgr2=0x7f237c05f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f2381ebf700 1 -- 172.21.15.63:0/59086608 shutdown_connections 2020-05-18T21:33:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.419+0000 7f2381ebf700 1 -- 172.21.15.63:0/59086608 wait complete. 2020-05-18T21:33:41.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.423+0000 7f2381ebf700 1 Processor -- start 2020-05-18T21:33:41.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.423+0000 7f2381ebf700 1 -- start start 2020-05-18T21:33:41.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.423+0000 7f2381ebf700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f237c0bc590 0x7f237c063eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:41.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.423+0000 7f2381ebf700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f237c063340 con 0x7f237c14e120 2020-05-18T21:33:41.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.423+0000 7f2381ebf700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f237c15acc0 con 0x7f237c1441f0 2020-05-18T21:33:41.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.423+0000 7f2381ebf700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237c15af60 con 0x7f237c0bc590 2020-05-18T21:33:41.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.423+0000 7f2380ebd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f237c0bc590 0x7f237c063eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:41.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.423+0000 7f2380ebd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f237c0bc590 0x7f237c063eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60832/0 (socket says 172.21.15.63:60832) 2020-05-18T21:33:41.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.423+0000 7f2380ebd700 1 -- 172.21.15.63:0/2022112910 learned_addr learned my addr 172.21.15.63:0/2022112910 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:41.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.423+0000 7f2380ebd700 1 -- 172.21.15.63:0/2022112910 >> v1:172.21.15.155:6789/0 conn(0x7f237c1441f0 legacy=0x7f237c062520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:41.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.423+0000 7f2380ebd700 1 -- 172.21.15.63:0/2022112910 >> v1:172.21.15.63:6789/0 conn(0x7f237c14e120 legacy=0x7f237c062c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:41.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.423+0000 7f2379ffb700 1 -- 172.21.15.63:0/2022112910 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804484643 0 0) 0x7f237c063340 con 0x7f237c14e120 2020-05-18T21:33:41.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.423+0000 7f2380ebd700 1 -- 172.21.15.63:0/2022112910 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c15b200 con 0x7f237c0bc590 2020-05-18T21:33:41.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.423+0000 7f2380ebd700 1 --2- 172.21.15.63:0/2022112910 >> v2:172.21.15.63:3300/0 conn(0x7f237c0bc590 0x7f237c063eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f236c003430 tx=0x7f236c011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:41.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.423+0000 7f2380ebd700 1 --2- 172.21.15.63:0/2022112910 >> v2:172.21.15.63:3300/0 conn(0x7f237c0bc590 0x7f237c063eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f236c003430 tx=0x7f236c011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:41.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.423+0000 7f2380ebd700 1 --2- 172.21.15.63:0/2022112910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f237c0bc590 0x7f237c063eb0 secure :-1 s=READY pgs=1478 cs=0 l=1 rx=0x7f236c003430 tx=0x7f236c011100).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:41.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.423+0000 7f2380ebd700 1 --2- 172.21.15.63:0/2022112910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f237c0bc590 0x7f237c063eb0 secure :-1 s=THROTTLE_DONE pgs=1478 cs=0 l=1 rx=0x7f236c003430 tx=0x7f236c011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:41.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.423+0000 7f2379ffb700 1 -- 172.21.15.63:0/2022112910 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f236c005e70 con 0x7f237c0bc590 2020-05-18T21:33:41.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.423+0000 7f2381ebf700 1 -- 172.21.15.63:0/2022112910 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f237c15a940 con 0x7f237c0bc590 2020-05-18T21:33:41.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.427+0000 7f2380ebd700 1 --2- 172.21.15.63:0/2022112910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f237c0bc590 0x7f237c063eb0 secure :-1 s=THROTTLE_DONE pgs=1478 cs=0 l=1 rx=0x7f236c003430 tx=0x7f236c011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:41.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.427+0000 7f2381ebf700 1 -- 172.21.15.63:0/2022112910 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237c0662f0 con 0x7f237c0bc590 2020-05-18T21:33:41.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.427+0000 7f2379ffb700 1 -- 172.21.15.63:0/2022112910 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c012b70 con 0x7f237c0bc590 2020-05-18T21:33:41.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.427+0000 7f2380ebd700 1 --2- 172.21.15.63:0/2022112910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f237c0bc590 0x7f237c063eb0 secure :-1 s=THROTTLE_DONE pgs=1478 cs=0 l=1 rx=0x7f236c003430 tx=0x7f236c011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:41.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.427+0000 7f2379ffb700 1 -- 172.21.15.63:0/2022112910 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f236c007180 con 0x7f237c0bc590 2020-05-18T21:33:41.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.427+0000 7f2380ebd700 1 --2- 172.21.15.63:0/2022112910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f237c0bc590 0x7f237c063eb0 secure :-1 s=THROTTLE_DONE pgs=1478 cs=0 l=1 rx=0x7f236c003430 tx=0x7f236c011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:41.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.427+0000 7f2381ebf700 1 -- 172.21.15.63:0/2022112910 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f237c0569e0 con 0x7f237c0bc590 2020-05-18T21:33:41.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.427+0000 7f2379ffb700 1 -- 172.21.15.63:0/2022112910 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f236c00e1a0 con 0x7f237c0bc590 2020-05-18T21:33:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.427+0000 7f2380ebd700 1 --2- 172.21.15.63:0/2022112910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f237c0bc590 0x7f237c063eb0 secure :-1 s=THROTTLE_DONE pgs=1478 cs=0 l=1 rx=0x7f236c003430 tx=0x7f236c011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.427+0000 7f2379ffb700 1 --2- 172.21.15.63:0/2022112910 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f235c04f8d0 0x7f235c051d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.427+0000 7f2379ffb700 1 -- 172.21.15.63:0/2022112910 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f236c063e60 con 0x7f237c0bc590 2020-05-18T21:33:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.427+0000 7f237bfff700 1 --2- 172.21.15.63:0/2022112910 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f235c04f8d0 0x7f235c051d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.427+0000 7f237bfff700 1 --2- 172.21.15.63:0/2022112910 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f235c04f8d0 0x7f235c051d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f237c0b6890 tx=0x7f237c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.427+0000 7f237bfff700 1 --2- 172.21.15.63:0/2022112910 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f235c04f8d0 0x7f235c051d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f237c0b6890 tx=0x7f237c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:41.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.427+0000 7f237bfff700 1 --2- 172.21.15.63:0/2022112910 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f235c04f8d0 0x7f235c051d90 secure :-1 s=READY pgs=576 cs=0 l=1 rx=0x7f237c0b6890 tx=0x7f237c061d60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:41.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.431+0000 7f2380ebd700 1 --2- 172.21.15.63:0/2022112910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f237c0bc590 0x7f237c063eb0 secure :-1 s=THROTTLE_DONE pgs=1478 cs=0 l=1 rx=0x7f236c003430 tx=0x7f236c011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:41.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.431+0000 7f2379ffb700 1 -- 172.21.15.63:0/2022112910 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f236c03e190 con 0x7f237c0bc590 2020-05-18T21:33:41.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:41.551+0000 7f2381ebf700 1 -- 172.21.15.63:0/2022112910 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f237c0008d0 con 0x7f237c0bc590 2020-05-18T21:33:42.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.287+0000 7f2380ebd700 1 --2- 172.21.15.63:0/2022112910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f237c0bc590 0x7f237c063eb0 secure :-1 s=THROTTLE_DONE pgs=1478 cs=0 l=1 rx=0x7f236c003430 tx=0x7f236c011100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:42.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.287+0000 7f2379ffb700 1 -- 172.21.15.63:0/2022112910 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v107) v1 ==== 173+0+0 (secure 0 0 0) 0x7f236c0417b0 con 0x7f237c0bc590 2020-05-18T21:33:42.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.291+0000 7f2381ebf700 1 -- 172.21.15.63:0/2022112910 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f235c04f8d0 msgr2=0x7f235c051d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:42.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.291+0000 7f2381ebf700 1 --2- 172.21.15.63:0/2022112910 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f235c04f8d0 0x7f235c051d90 secure :-1 s=READY pgs=576 cs=0 l=1 rx=0x7f237c0b6890 tx=0x7f237c061d60).stop 2020-05-18T21:33:42.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.291+0000 7f2381ebf700 1 -- 172.21.15.63:0/2022112910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f237c0bc590 msgr2=0x7f237c063eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:42.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.291+0000 7f2381ebf700 1 --2- 172.21.15.63:0/2022112910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f237c0bc590 0x7f237c063eb0 secure :-1 s=READY pgs=1478 cs=0 l=1 rx=0x7f236c003430 tx=0x7f236c011100).stop 2020-05-18T21:33:42.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.291+0000 7f2381ebf700 1 -- 172.21.15.63:0/2022112910 shutdown_connections 2020-05-18T21:33:42.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.291+0000 7f2381ebf700 1 --2- 172.21.15.63:0/2022112910 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f235c04f8d0 0x7f235c051d90 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:42.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.291+0000 7f2381ebf700 1 --2- 172.21.15.63:0/2022112910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f237c0bc590 0x7f237c063eb0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:42.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.291+0000 7f2381ebf700 1 -- 172.21.15.63:0/2022112910 >> 172.21.15.63:0/2022112910 conn(0x7f237c05f3b0 msgr2=0x7f237c0b78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:42.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.291+0000 7f2381ebf700 1 -- 172.21.15.63:0/2022112910 shutdown_connections 2020-05-18T21:33:42.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.291+0000 7f2381ebf700 1 -- 172.21.15.63:0/2022112910 wait complete. 2020-05-18T21:33:42.298 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2020-05-18T21:33:42.308 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:33:42.308 INFO:tasks.ceph.mds.a:Stopping old one... 2020-05-18T21:33:42.308 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:33:42.309 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:33:42.309 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:33:42.309 INFO:tasks.ceph.mds.b:Stopping old one... 2020-05-18T21:33:42.310 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:33:42.310 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:33:42.319 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:33:42.319 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:33:42.321 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:33:42.321 DEBUG:teuthology.parallel:result is None 2020-05-18T21:33:42.323 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:33:42.324 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:33:42.367 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:33:42.368 DEBUG:teuthology.parallel:result is None 2020-05-18T21:33:42.369 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-05-18T21:33:42.399 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:33:42.448 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:33:42.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.467+0000 7fe8082c1700 1 Processor -- start 2020-05-18T21:33:42.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.467+0000 7fe8082c1700 1 -- start start 2020-05-18T21:33:42.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe8082c1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe800065f00 0x7fe8000b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:42.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe8082c1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe800146d40 0x7fe8000b1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:42.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe8082c1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe800142c70 con 0x7fe8000b3ea0 2020-05-18T21:33:42.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe8082c1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8000b1250 con 0x7fe800065f00 2020-05-18T21:33:42.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe8082c1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8000b14f0 con 0x7fe800146d40 2020-05-18T21:33:42.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe80605d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe800065f00 0x7fe8000b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:42.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe80605d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe800065f00 0x7fe8000b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60852/0 (socket says 172.21.15.63:60852) 2020-05-18T21:33:42.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe80605d700 1 -- 172.21.15.63:0/1055981808 learned_addr learned my addr 172.21.15.63:0/1055981808 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:42.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe80585c700 1 --2- 172.21.15.63:0/1055981808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe800146d40 0x7fe8000b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:42.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe80605d700 1 -- 172.21.15.63:0/1055981808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe800146d40 msgr2=0x7fe8000b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:42.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe80605d700 1 --2- 172.21.15.63:0/1055981808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe800146d40 0x7fe8000b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:42.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe80605d700 1 -- 172.21.15.63:0/1055981808 >> v1:172.21.15.155:6789/0 conn(0x7fe8000b3ea0 legacy=0x7fe8000afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:42.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe80605d700 1 -- 172.21.15.63:0/1055981808 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8000662e0 con 0x7fe800065f00 2020-05-18T21:33:42.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe80585c700 1 --2- 172.21.15.63:0/1055981808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe800146d40 0x7fe8000b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:33:42.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe80605d700 1 --2- 172.21.15.63:0/1055981808 >> v2:172.21.15.63:3300/0 conn(0x7fe800065f00 0x7fe8000b4890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe7fc002f70 tx=0x7fe7fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:42.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe80605d700 1 --2- 172.21.15.63:0/1055981808 >> v2:172.21.15.63:3300/0 conn(0x7fe800065f00 0x7fe8000b4890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe7fc002f70 tx=0x7fe7fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:42.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe80605d700 1 --2- 172.21.15.63:0/1055981808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe800065f00 0x7fe8000b4890 secure :-1 s=READY pgs=1481 cs=0 l=1 rx=0x7fe7fc002f70 tx=0x7fe7fc007a80).ready entity=mon.0 client_cookie=80d811084f2e5404 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:42.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe80605d700 1 --2- 172.21.15.63:0/1055981808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe800065f00 0x7fe8000b4890 secure :-1 s=THROTTLE_DONE pgs=1481 cs=0 l=1 rx=0x7fe7fc002f70 tx=0x7fe7fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:42.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe80605d700 1 --2- 172.21.15.63:0/1055981808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe800065f00 0x7fe8000b4890 secure :-1 s=THROTTLE_DONE pgs=1481 cs=0 l=1 rx=0x7fe7fc002f70 tx=0x7fe7fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:42.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe80605d700 1 --2- 172.21.15.63:0/1055981808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe800065f00 0x7fe8000b4890 secure :-1 s=THROTTLE_DONE pgs=1481 cs=0 l=1 rx=0x7fe7fc002f70 tx=0x7fe7fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:42.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe80505b700 1 -- 172.21.15.63:0/1055981808 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7fc013970 con 0x7fe800065f00 2020-05-18T21:33:42.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe80505b700 1 -- 172.21.15.63:0/1055981808 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc013ad0 con 0x7fe800065f00 2020-05-18T21:33:42.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe80505b700 1 -- 172.21.15.63:0/1055981808 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7fc00a180 con 0x7fe800065f00 2020-05-18T21:33:42.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe8082c1700 1 -- 172.21.15.63:0/1055981808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe800065f00 msgr2=0x7fe8000b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:42.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.471+0000 7fe8082c1700 1 --2- 172.21.15.63:0/1055981808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe800065f00 0x7fe8000b4890 secure :-1 s=READY pgs=1481 cs=0 l=1 rx=0x7fe7fc002f70 tx=0x7fe7fc007a80).stop 2020-05-18T21:33:42.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.475+0000 7fe8082c1700 1 -- 172.21.15.63:0/1055981808 shutdown_connections 2020-05-18T21:33:42.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.475+0000 7fe8082c1700 1 --2- 172.21.15.63:0/1055981808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe800146d40 0x7fe8000b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:42.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.475+0000 7fe8082c1700 1 --2- 172.21.15.63:0/1055981808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe800065f00 0x7fe8000b4890 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:42.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.475+0000 7fe8082c1700 1 -- 172.21.15.63:0/1055981808 >> 172.21.15.63:0/1055981808 conn(0x7fe8000b83f0 msgr2=0x7fe8000b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:42.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.475+0000 7fe8082c1700 1 -- 172.21.15.63:0/1055981808 shutdown_connections 2020-05-18T21:33:42.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.475+0000 7fe8082c1700 1 -- 172.21.15.63:0/1055981808 wait complete. 2020-05-18T21:33:42.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.479+0000 7fe8082c1700 1 Processor -- start 2020-05-18T21:33:42.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.479+0000 7fe8082c1700 1 -- start start 2020-05-18T21:33:42.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.479+0000 7fe8082c1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe800065f00 0x7fe8001420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:42.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.479+0000 7fe8082c1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe800146d40 0x7fe800144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:42.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.479+0000 7fe8082c1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe800144ba0 con 0x7fe8000b3ea0 2020-05-18T21:33:42.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.479+0000 7fe8082c1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe800063af0 con 0x7fe800065f00 2020-05-18T21:33:42.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.479+0000 7fe8082c1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe800063d90 con 0x7fe800146d40 2020-05-18T21:33:42.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.479+0000 7fe80605d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe800065f00 0x7fe8001420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:42.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.479+0000 7fe80605d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe800065f00 0x7fe8001420b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60858/0 (socket says 172.21.15.63:60858) 2020-05-18T21:33:42.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.479+0000 7fe80605d700 1 -- 172.21.15.63:0/3950928745 learned_addr learned my addr 172.21.15.63:0/3950928745 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:42.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.479+0000 7fe80685e700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe800146d40 0x7fe800144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:42.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.479+0000 7fe80605d700 1 -- 172.21.15.63:0/3950928745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe800146d40 msgr2=0x7fe800144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:42.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.479+0000 7fe80605d700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe800146d40 0x7fe800144740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:42.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.479+0000 7fe80605d700 1 -- 172.21.15.63:0/3950928745 >> v1:172.21.15.155:6789/0 conn(0x7fe8000b3ea0 legacy=0x7fe80013e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:42.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.479+0000 7fe80605d700 1 -- 172.21.15.63:0/3950928745 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe800064030 con 0x7fe800065f00 2020-05-18T21:33:42.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.479+0000 7fe80605d700 1 --2- 172.21.15.63:0/3950928745 >> v2:172.21.15.63:3300/0 conn(0x7fe800065f00 0x7fe8001420b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe7fc002f70 tx=0x7fe7fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:42.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.479+0000 7fe80605d700 1 --2- 172.21.15.63:0/3950928745 >> v2:172.21.15.63:3300/0 conn(0x7fe800065f00 0x7fe8001420b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe7fc002f70 tx=0x7fe7fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:42.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.479+0000 7fe80605d700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe800065f00 0x7fe8001420b0 secure :-1 s=READY pgs=1482 cs=0 l=1 rx=0x7fe7fc002f70 tx=0x7fe7fc007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:42.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.483+0000 7fe80605d700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe800065f00 0x7fe8001420b0 secure :-1 s=THROTTLE_DONE pgs=1482 cs=0 l=1 rx=0x7fe7fc002f70 tx=0x7fe7fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:42.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.483+0000 7fe80605d700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe800065f00 0x7fe8001420b0 secure :-1 s=THROTTLE_DONE pgs=1482 cs=0 l=1 rx=0x7fe7fc002f70 tx=0x7fe7fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:42.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.483+0000 7fe7ef7fe700 1 -- 172.21.15.63:0/3950928745 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7fc0134d0 con 0x7fe800065f00 2020-05-18T21:33:42.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.483+0000 7fe80605d700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe800065f00 0x7fe8001420b0 secure :-1 s=THROTTLE_DONE pgs=1482 cs=0 l=1 rx=0x7fe7fc002f70 tx=0x7fe7fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:42.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.483+0000 7fe7ef7fe700 1 -- 172.21.15.63:0/3950928745 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc005700 con 0x7fe800065f00 2020-05-18T21:33:42.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.483+0000 7fe8082c1700 1 -- 172.21.15.63:0/3950928745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8001453d0 con 0x7fe800065f00 2020-05-18T21:33:42.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.483+0000 7fe7ef7fe700 1 -- 172.21.15.63:0/3950928745 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7fc005aa0 con 0x7fe800065f00 2020-05-18T21:33:42.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.483+0000 7fe8082c1700 1 -- 172.21.15.63:0/3950928745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe800063690 con 0x7fe800065f00 2020-05-18T21:33:42.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.483+0000 7fe80605d700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe800065f00 0x7fe8001420b0 secure :-1 s=THROTTLE_DONE pgs=1482 cs=0 l=1 rx=0x7fe7fc002f70 tx=0x7fe7fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:42.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.483+0000 7fe8082c1700 1 -- 172.21.15.63:0/3950928745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe800064230 con 0x7fe800065f00 2020-05-18T21:33:42.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.487+0000 7fe7ef7fe700 1 -- 172.21.15.63:0/3950928745 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe7fc005d10 con 0x7fe800065f00 2020-05-18T21:33:42.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.487+0000 7fe80605d700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe800065f00 0x7fe8001420b0 secure :-1 s=THROTTLE_DONE pgs=1482 cs=0 l=1 rx=0x7fe7fc002f70 tx=0x7fe7fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:42.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.487+0000 7fe7ef7fe700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe7e004fa80 0x7fe7e0051f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:42.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.487+0000 7fe7ef7fe700 1 -- 172.21.15.63:0/3950928745 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fe7fc0663f0 con 0x7fe800065f00 2020-05-18T21:33:42.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.487+0000 7fe80585c700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe7e004fa80 0x7fe7e0051f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:42.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.487+0000 7fe80585c700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe7e004fa80 0x7fe7e0051f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe8001451f0 tx=0x7fe7f0009510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:42.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.487+0000 7fe80585c700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe7e004fa80 0x7fe7e0051f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe8001451f0 tx=0x7fe7f0009510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:42.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.487+0000 7fe80585c700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe7e004fa80 0x7fe7e0051f40 secure :-1 s=READY pgs=577 cs=0 l=1 rx=0x7fe8001451f0 tx=0x7fe7f0009510).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:42.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.491+0000 7fe80605d700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe800065f00 0x7fe8001420b0 secure :-1 s=THROTTLE_DONE pgs=1482 cs=0 l=1 rx=0x7fe7fc002f70 tx=0x7fe7fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:42.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.491+0000 7fe7ef7fe700 1 -- 172.21.15.63:0/3950928745 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe800064230 con 0x7fe800065f00 2020-05-18T21:33:42.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:42.615+0000 7fe8082c1700 1 -- 172.21.15.63:0/3950928745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fe800064230 con 0x7fe800065f00 2020-05-18T21:33:43.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.479+0000 7fe80605d700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe800065f00 0x7fe8001420b0 secure :-1 s=READY pgs=1482 cs=0 l=1 rx=0x7fe7fc002f70 tx=0x7fe7fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.491+0000 7fe80605d700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe800065f00 0x7fe8001420b0 secure :-1 s=THROTTLE_DONE pgs=1482 cs=0 l=1 rx=0x7fe7fc002f70 tx=0x7fe7fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.491+0000 7fe7ef7fe700 1 -- 172.21.15.63:0/3950928745 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v109) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe800064230 con 0x7fe800065f00 2020-05-18T21:33:43.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.495+0000 7fe8082c1700 1 -- 172.21.15.63:0/3950928745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe7e004fa80 msgr2=0x7fe7e0051f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:43.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.495+0000 7fe8082c1700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe7e004fa80 0x7fe7e0051f40 secure :-1 s=READY pgs=577 cs=0 l=1 rx=0x7fe8001451f0 tx=0x7fe7f0009510).stop 2020-05-18T21:33:43.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.495+0000 7fe8082c1700 1 -- 172.21.15.63:0/3950928745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe800065f00 msgr2=0x7fe8001420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:43.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.495+0000 7fe8082c1700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe800065f00 0x7fe8001420b0 secure :-1 s=READY pgs=1482 cs=0 l=1 rx=0x7fe7fc002f70 tx=0x7fe7fc007a80).stop 2020-05-18T21:33:43.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.495+0000 7fe8082c1700 1 -- 172.21.15.63:0/3950928745 shutdown_connections 2020-05-18T21:33:43.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.495+0000 7fe8082c1700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe7e004fa80 0x7fe7e0051f40 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:43.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.495+0000 7fe8082c1700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe800146d40 0x7fe800144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:43.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.495+0000 7fe8082c1700 1 --2- 172.21.15.63:0/3950928745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe800065f00 0x7fe8001420b0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:43.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.495+0000 7fe8082c1700 1 -- 172.21.15.63:0/3950928745 >> 172.21.15.63:0/3950928745 conn(0x7fe8000b83f0 msgr2=0x7fe8000ad3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:43.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.495+0000 7fe8082c1700 1 -- 172.21.15.63:0/3950928745 shutdown_connections 2020-05-18T21:33:43.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.495+0000 7fe8082c1700 1 -- 172.21.15.63:0/3950928745 wait complete. 2020-05-18T21:33:43.503 INFO:teuthology.orchestra.run.smithi063.stderr: removed all blacklist entries 2020-05-18T21:33:43.515 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-05-18T21:33:43.516 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-05-18T21:33:43.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c5dc5c700 1 Processor -- start 2020-05-18T21:33:43.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c5dc5c700 1 -- start start 2020-05-18T21:33:43.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c5dc5c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c580bbcd0 0x7f9c580afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:43.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c5dc5c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c580b0280 0x7f9c5812efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:43.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c5dc5c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c580af980 con 0x7f9c580bb5e0 2020-05-18T21:33:43.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c5dc5c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c580af770 con 0x7f9c580b0280 2020-05-18T21:33:43.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c5dc5c700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c580bb9c0 con 0x7f9c580bbcd0 2020-05-18T21:33:43.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c577fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9c580bb5e0 0x7f9c580acee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34822/0 (socket says 172.21.15.63:34822) 2020-05-18T21:33:43.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c577fe700 1 -- 172.21.15.63:0/1370456616 learned_addr learned my addr 172.21.15.63:0/1370456616 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:43.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c57fff700 1 --2- 172.21.15.63:0/1370456616 >> v2:172.21.15.63:3300/0 conn(0x7f9c580b0280 0x7f9c5812efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:43.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c56ffd700 1 --2- 172.21.15.63:0/1370456616 >> v2:172.21.15.155:3300/0 conn(0x7f9c580bbcd0 0x7f9c580afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:43.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c567fc700 1 -- 172.21.15.63:0/1370456616 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891498711 0 0) 0x7f9c580af980 con 0x7f9c580bb5e0 2020-05-18T21:33:43.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c567fc700 1 -- 172.21.15.63:0/1370456616 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c3c003270 con 0x7f9c580bb5e0 2020-05-18T21:33:43.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c57fff700 1 -- 172.21.15.63:0/1370456616 >> v2:172.21.15.155:3300/0 conn(0x7f9c580bbcd0 msgr2=0x7f9c580afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:43.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c57fff700 1 --2- 172.21.15.63:0/1370456616 >> v2:172.21.15.155:3300/0 conn(0x7f9c580bbcd0 0x7f9c580afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:43.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c57fff700 1 -- 172.21.15.63:0/1370456616 >> v1:172.21.15.63:6789/0 conn(0x7f9c580bb5e0 legacy=0x7f9c580acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:43.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c57fff700 1 -- 172.21.15.63:0/1370456616 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c580af3d0 con 0x7f9c580b0280 2020-05-18T21:33:43.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c57fff700 1 --2- 172.21.15.63:0/1370456616 >> v2:172.21.15.63:3300/0 conn(0x7f9c580b0280 0x7f9c5812efd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9c50002f70 tx=0x7f9c50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c57fff700 1 --2- 172.21.15.63:0/1370456616 >> v2:172.21.15.63:3300/0 conn(0x7f9c580b0280 0x7f9c5812efd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9c50002f70 tx=0x7f9c50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c57fff700 1 --2- 172.21.15.63:0/1370456616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c580b0280 0x7f9c5812efd0 secure :-1 s=READY pgs=1484 cs=0 l=1 rx=0x7f9c50002f70 tx=0x7f9c50007a80).ready entity=mon.0 client_cookie=260e92d2f5591454 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:43.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c57fff700 1 --2- 172.21.15.63:0/1370456616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c580b0280 0x7f9c5812efd0 secure :-1 s=THROTTLE_DONE pgs=1484 cs=0 l=1 rx=0x7f9c50002f70 tx=0x7f9c50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c567fc700 1 -- 172.21.15.63:0/1370456616 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c50008e50 con 0x7f9c580b0280 2020-05-18T21:33:43.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c57fff700 1 --2- 172.21.15.63:0/1370456616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c580b0280 0x7f9c5812efd0 secure :-1 s=THROTTLE_DONE pgs=1484 cs=0 l=1 rx=0x7f9c50002f70 tx=0x7f9c50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c57fff700 1 --2- 172.21.15.63:0/1370456616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c580b0280 0x7f9c5812efd0 secure :-1 s=THROTTLE_DONE pgs=1484 cs=0 l=1 rx=0x7f9c50002f70 tx=0x7f9c50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c567fc700 1 -- 172.21.15.63:0/1370456616 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c50011540 con 0x7f9c580b0280 2020-05-18T21:33:43.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c567fc700 1 -- 172.21.15.63:0/1370456616 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c50011960 con 0x7f9c580b0280 2020-05-18T21:33:43.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c5dc5c700 1 -- 172.21.15.63:0/1370456616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c580b0280 msgr2=0x7f9c5812efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:43.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.663+0000 7f9c5dc5c700 1 --2- 172.21.15.63:0/1370456616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c580b0280 0x7f9c5812efd0 secure :-1 s=READY pgs=1484 cs=0 l=1 rx=0x7f9c50002f70 tx=0x7f9c50007a80).stop 2020-05-18T21:33:43.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.667+0000 7f9c5dc5c700 1 -- 172.21.15.63:0/1370456616 shutdown_connections 2020-05-18T21:33:43.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.667+0000 7f9c5dc5c700 1 --2- 172.21.15.63:0/1370456616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c580b0280 0x7f9c5812efd0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:43.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.667+0000 7f9c5dc5c700 1 --2- 172.21.15.63:0/1370456616 >> v2:172.21.15.155:3300/0 conn(0x7f9c580bbcd0 0x7f9c580afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:43.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.667+0000 7f9c5dc5c700 1 -- 172.21.15.63:0/1370456616 >> 172.21.15.63:0/1370456616 conn(0x7f9c58069b70 msgr2=0x7f9c58069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:43.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.667+0000 7f9c5dc5c700 1 -- 172.21.15.63:0/1370456616 shutdown_connections 2020-05-18T21:33:43.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.667+0000 7f9c5dc5c700 1 -- 172.21.15.63:0/1370456616 wait complete. 2020-05-18T21:33:43.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.667+0000 7f9c5dc5c700 1 Processor -- start 2020-05-18T21:33:43.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.667+0000 7f9c5dc5c700 1 -- start start 2020-05-18T21:33:43.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.667+0000 7f9c5dc5c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c580bb5e0 0x7f9c58153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:43.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.667+0000 7f9c5dc5c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c580bbcd0 0x7f9c580b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:43.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.667+0000 7f9c5dc5c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c580b7f20 con 0x7f9c580b0280 2020-05-18T21:33:43.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.667+0000 7f9c5dc5c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c580b6050 con 0x7f9c580bb5e0 2020-05-18T21:33:43.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.667+0000 7f9c5dc5c700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c580b81c0 con 0x7f9c580bbcd0 2020-05-18T21:33:43.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.667+0000 7f9c577fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9c580b0280 0x7f9c580b7760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34828/0 (socket says 172.21.15.63:34828) 2020-05-18T21:33:43.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.667+0000 7f9c577fe700 1 -- 172.21.15.63:0/806990615 learned_addr learned my addr 172.21.15.63:0/806990615 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:43.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.667+0000 7f9c56ffd700 1 --2- 172.21.15.63:0/806990615 >> v2:172.21.15.63:3300/0 conn(0x7f9c580bb5e0 0x7f9c58153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:43.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c57fff700 1 --2- 172.21.15.63:0/806990615 >> v2:172.21.15.155:3300/0 conn(0x7f9c580bbcd0 0x7f9c580b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:43.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c54ff9700 1 -- 172.21.15.63:0/806990615 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781988102 0 0) 0x7f9c580b7f20 con 0x7f9c580b0280 2020-05-18T21:33:43.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c54ff9700 1 -- 172.21.15.63:0/806990615 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c30002fe0 con 0x7f9c580b0280 2020-05-18T21:33:43.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c56ffd700 1 -- 172.21.15.63:0/806990615 >> v2:172.21.15.155:3300/0 conn(0x7f9c580bbcd0 msgr2=0x7f9c580b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:43.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c56ffd700 1 --2- 172.21.15.63:0/806990615 >> v2:172.21.15.155:3300/0 conn(0x7f9c580bbcd0 0x7f9c580b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:43.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c56ffd700 1 -- 172.21.15.63:0/806990615 >> v1:172.21.15.63:6789/0 conn(0x7f9c580b0280 legacy=0x7f9c580b7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:43.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c54ff9700 1 -- 172.21.15.63:0/806990615 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1372084787 0 0) 0x7f9c30002fe0 con 0x7f9c580b0280 2020-05-18T21:33:43.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c56ffd700 1 -- 172.21.15.63:0/806990615 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c580b8460 con 0x7f9c580bb5e0 2020-05-18T21:33:43.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c56ffd700 1 --2- 172.21.15.63:0/806990615 >> v2:172.21.15.63:3300/0 conn(0x7f9c580bb5e0 0x7f9c58153480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c40001a60 tx=0x7f9c48011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c56ffd700 1 --2- 172.21.15.63:0/806990615 >> v2:172.21.15.63:3300/0 conn(0x7f9c580bb5e0 0x7f9c58153480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c40001a60 tx=0x7f9c48011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c56ffd700 1 --2- 172.21.15.63:0/806990615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c580bb5e0 0x7f9c58153480 secure :-1 s=READY pgs=1486 cs=0 l=1 rx=0x7f9c40001a60 tx=0x7f9c48011010).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:43.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c56ffd700 1 --2- 172.21.15.63:0/806990615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c580bb5e0 0x7f9c58153480 secure :-1 s=THROTTLE_DONE pgs=1486 cs=0 l=1 rx=0x7f9c40001a60 tx=0x7f9c48011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c54ff9700 1 -- 172.21.15.63:0/806990615 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c400018c0 con 0x7f9c580bb5e0 2020-05-18T21:33:43.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c56ffd700 1 --2- 172.21.15.63:0/806990615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c580bb5e0 0x7f9c58153480 secure :-1 s=THROTTLE_DONE pgs=1486 cs=0 l=1 rx=0x7f9c40001a60 tx=0x7f9c48011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c54ff9700 1 -- 172.21.15.63:0/806990615 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4800e370 con 0x7f9c580bb5e0 2020-05-18T21:33:43.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c56ffd700 1 --2- 172.21.15.63:0/806990615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c580bb5e0 0x7f9c58153480 secure :-1 s=THROTTLE_DONE pgs=1486 cs=0 l=1 rx=0x7f9c40001a60 tx=0x7f9c48011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c5dc5c700 1 -- 172.21.15.63:0/806990615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c581538e0 con 0x7f9c580bb5e0 2020-05-18T21:33:43.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c54ff9700 1 -- 172.21.15.63:0/806990615 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c48005c70 con 0x7f9c580bb5e0 2020-05-18T21:33:43.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c5dc5c700 1 -- 172.21.15.63:0/806990615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c580b2c80 con 0x7f9c580bb5e0 2020-05-18T21:33:43.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c56ffd700 1 --2- 172.21.15.63:0/806990615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c580bb5e0 0x7f9c58153480 secure :-1 s=THROTTLE_DONE pgs=1486 cs=0 l=1 rx=0x7f9c40001a60 tx=0x7f9c48011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c5dc5c700 1 -- 172.21.15.63:0/806990615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c580569e0 con 0x7f9c580bb5e0 2020-05-18T21:33:43.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c54ff9700 1 -- 172.21.15.63:0/806990615 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9c4800c940 con 0x7f9c580bb5e0 2020-05-18T21:33:43.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c56ffd700 1 --2- 172.21.15.63:0/806990615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c580bb5e0 0x7f9c58153480 secure :-1 s=THROTTLE_DONE pgs=1486 cs=0 l=1 rx=0x7f9c40001a60 tx=0x7f9c48011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c54ff9700 1 --2- 172.21.15.63:0/806990615 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c3004fd40 0x7f9c30052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:43.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.671+0000 7f9c54ff9700 1 -- 172.21.15.63:0/806990615 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9c48063700 con 0x7f9c580bb5e0 2020-05-18T21:33:43.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.675+0000 7f9c577fe700 1 --2- 172.21.15.63:0/806990615 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c3004fd40 0x7f9c30052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:43.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.675+0000 7f9c577fe700 1 --2- 172.21.15.63:0/806990615 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c3004fd40 0x7f9c30052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c40001aa0 tx=0x7f9c40009640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.675+0000 7f9c577fe700 1 --2- 172.21.15.63:0/806990615 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c3004fd40 0x7f9c30052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c40001aa0 tx=0x7f9c40009640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.675+0000 7f9c577fe700 1 --2- 172.21.15.63:0/806990615 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c3004fd40 0x7f9c30052200 secure :-1 s=READY pgs=579 cs=0 l=1 rx=0x7f9c40001aa0 tx=0x7f9c40009640).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:43.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.679+0000 7f9c56ffd700 1 --2- 172.21.15.63:0/806990615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c580bb5e0 0x7f9c58153480 secure :-1 s=THROTTLE_DONE pgs=1486 cs=0 l=1 rx=0x7f9c40001a60 tx=0x7f9c48011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.679+0000 7f9c54ff9700 1 -- 172.21.15.63:0/806990615 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9c4803da90 con 0x7f9c580bb5e0 2020-05-18T21:33:43.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.831+0000 7f9c5dc5c700 1 -- 172.21.15.63:0/806990615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9c5812e9e0 con 0x7f9c580bb5e0 2020-05-18T21:33:43.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.831+0000 7f9c56ffd700 1 --2- 172.21.15.63:0/806990615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c580bb5e0 0x7f9c58153480 secure :-1 s=THROTTLE_DONE pgs=1486 cs=0 l=1 rx=0x7f9c40001a60 tx=0x7f9c48011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.831+0000 7f9c54ff9700 1 -- 172.21.15.63:0/806990615 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v42) v1 ==== 80+0+4513 (secure 0 0 0) 0x7f9c480410b0 con 0x7f9c580bb5e0 2020-05-18T21:33:43.838 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:43.838 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:43.838 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_dump": [ 2020-05-18T21:33:43.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:43.839 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.a", 2020-05-18T21:33:43.839 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJekJyyLRAAfB5XJCsXTAmZdkFOaQrokg==", 2020-05-18T21:33:43.840 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:43.840 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:33:43.840 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:43.840 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:43.840 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:43.840 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:43.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:43.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:43.841 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.b", 2020-05-18T21:33:43.841 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeSVE8MRAAEEytuzLtcQMC+1uQ/yh8eA==", 2020-05-18T21:33:43.841 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:43.842 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:33:43.842 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:43.842 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:43.842 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:43.843 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:43.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:43.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:43.843 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.0", 2020-05-18T21:33:43.843 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBq/cJeIn7mJhAArx+YEdVbsfXXNOLWdaAgWw==", 2020-05-18T21:33:43.844 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:43.844 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:43.844 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:43.844 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:43.844 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:43.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:43.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:43.845 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.1", 2020-05-18T21:33:43.845 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBt/cJelHywCRAAFyQ3sPEE0RTSy4tKfsDfyw==", 2020-05-18T21:33:43.845 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:43.846 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:43.846 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:43.846 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:43.846 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:43.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:43.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:43.847 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.2", 2020-05-18T21:33:43.847 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBv/cJecexDLBAAxhlFq20MBkKvDjuM1yi8XQ==", 2020-05-18T21:33:43.847 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:43.848 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:43.848 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:43.848 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:43.848 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:43.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:43.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:43.849 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.3", 2020-05-18T21:33:43.849 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBy/cJe9IqwDxAAMg1In7bIITDcOZljzzTpDQ==", 2020-05-18T21:33:43.849 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:43.849 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:43.849 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:43.850 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:43.850 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:43.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:43.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:43.850 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.4", 2020-05-18T21:33:43.850 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB3/cJeLXgxFhAA/kMVV5hCRny2uXKvvbu8Og==", 2020-05-18T21:33:43.851 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:43.851 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:43.851 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:43.851 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:43.851 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:43.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:43.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:43.852 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.5", 2020-05-18T21:33:43.852 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB5/cJeucpsNRAAjGh+6yUC8Fji9PE4COi/Eg==", 2020-05-18T21:33:43.852 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:43.853 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:43.853 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:43.853 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:43.853 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:43.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:43.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:43.854 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.6", 2020-05-18T21:33:43.854 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB8/cJelSPpGhAAXobGqH9qaW1VZfEpH8bUbQ==", 2020-05-18T21:33:43.854 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:43.854 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:43.854 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:43.855 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:43.855 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:43.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:43.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:43.855 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.7", 2020-05-18T21:33:43.855 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB+/cJeUIl5OBAAPd8H8ohOWZw9ubO7uCB6zg==", 2020-05-18T21:33:43.856 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:43.856 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:43.856 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:43.856 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:43.856 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:43.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:43.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:43.857 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.0", 2020-05-18T21:33:43.857 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeap3RNhAAi2vKpsKtzSL1Uuqm8pWYJQ==", 2020-05-18T21:33:43.857 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:43.857 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:33:43.858 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:33:43.858 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:33:43.858 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:43.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:43.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:43.859 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.1", 2020-05-18T21:33:43.859 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJeekrQABAA5TmzWOt24C6hgZw/WTj5dw==", 2020-05-18T21:33:43.859 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:43.859 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:33:43.859 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:33:43.859 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:33:43.860 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:43.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:43.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:43.860 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.2", 2020-05-18T21:33:43.860 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJehSnFAxAAXUZwqNTXqAApEB3nXs4u6g==", 2020-05-18T21:33:43.861 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:43.861 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:33:43.861 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:33:43.861 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:33:43.861 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:43.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:43.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:43.862 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.3", 2020-05-18T21:33:43.862 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJe2HdDBhAA07y5pn/bKKa9TBbZFvIh9g==", 2020-05-18T21:33:43.862 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:43.862 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:33:43.863 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:33:43.863 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:33:43.863 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:43.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:43.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:43.863 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.admin", 2020-05-18T21:33:43.864 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJe/K4fGRAA+rP3BYuWiyx/fKmQ3bV6Lw==", 2020-05-18T21:33:43.864 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:43.864 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:33:43.864 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:33:43.864 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:33:43.865 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:43.865 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:43.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:43.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:43.866 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.x", 2020-05-18T21:33:43.866 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJemmqEKhAAe5ySRz8Id0ug4matQwL0uw==", 2020-05-18T21:33:43.866 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:43.867 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:33:43.867 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:33:43.867 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:43.867 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:43.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:43.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:43.868 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.y", 2020-05-18T21:33:43.868 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeF/BNJhAAi/vrldC6qoWJWnSHpE3ung==", 2020-05-18T21:33:43.868 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:33:43.868 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:33:43.868 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:33:43.869 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:33:43.869 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:43.869 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:43.869 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:43.869 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:43.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.835+0000 7f9c5dc5c700 1 -- 172.21.15.63:0/806990615 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c3004fd40 msgr2=0x7f9c30052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:43.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.835+0000 7f9c5dc5c700 1 --2- 172.21.15.63:0/806990615 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c3004fd40 0x7f9c30052200 secure :-1 s=READY pgs=579 cs=0 l=1 rx=0x7f9c40001aa0 tx=0x7f9c40009640).stop 2020-05-18T21:33:43.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.835+0000 7f9c5dc5c700 1 -- 172.21.15.63:0/806990615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c580bb5e0 msgr2=0x7f9c58153480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:43.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.835+0000 7f9c5dc5c700 1 --2- 172.21.15.63:0/806990615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c580bb5e0 0x7f9c58153480 secure :-1 s=READY pgs=1486 cs=0 l=1 rx=0x7f9c40001a60 tx=0x7f9c48011010).stop 2020-05-18T21:33:43.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.835+0000 7f9c5dc5c700 1 -- 172.21.15.63:0/806990615 shutdown_connections 2020-05-18T21:33:43.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.835+0000 7f9c5dc5c700 1 --2- 172.21.15.63:0/806990615 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c3004fd40 0x7f9c30052200 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:43.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.835+0000 7f9c5dc5c700 1 --2- 172.21.15.63:0/806990615 >> v2:172.21.15.155:3300/0 conn(0x7f9c580bbcd0 0x7f9c580b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:43.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.835+0000 7f9c5dc5c700 1 --2- 172.21.15.63:0/806990615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c580bb5e0 0x7f9c58153480 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:43.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.835+0000 7f9c5dc5c700 1 -- 172.21.15.63:0/806990615 >> 172.21.15.63:0/806990615 conn(0x7f9c58069b70 msgr2=0x7f9c580b8780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:43.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.835+0000 7f9c5dc5c700 1 -- 172.21.15.63:0/806990615 shutdown_connections 2020-05-18T21:33:43.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.835+0000 7f9c5dc5c700 1 -- 172.21.15.63:0/806990615 wait complete. 2020-05-18T21:33:43.874 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:33:43.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.975+0000 7f3f02aab700 1 Processor -- start 2020-05-18T21:33:43.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.975+0000 7f3f02aab700 1 -- start start 2020-05-18T21:33:43.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f02aab700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3efc0b7cc0 0x7f3efc06a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:43.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f02aab700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3efc145e60 0x7f3efc149670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:43.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f02aab700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3efc0b8160 con 0x7f3efc146be0 2020-05-18T21:33:43.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f02aab700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3efc061c00 con 0x7f3efc145e60 2020-05-18T21:33:43.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f02aab700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3efc061ea0 con 0x7f3efc0b7cc0 2020-05-18T21:33:43.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f01048700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3efc145e60 0x7f3efc149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:43.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f00847700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3efc146be0 0x7f3efc0b5630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34836/0 (socket says 172.21.15.63:34836) 2020-05-18T21:33:43.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f00847700 1 -- 172.21.15.63:0/3787881861 learned_addr learned my addr 172.21.15.63:0/3787881861 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:43.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3efbfff700 1 --2- 172.21.15.63:0/3787881861 >> v2:172.21.15.155:3300/0 conn(0x7f3efc0b7cc0 0x7f3efc06a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:43.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f01048700 1 -- 172.21.15.63:0/3787881861 >> v2:172.21.15.155:3300/0 conn(0x7f3efc0b7cc0 msgr2=0x7f3efc06a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:43.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f01048700 1 --2- 172.21.15.63:0/3787881861 >> v2:172.21.15.155:3300/0 conn(0x7f3efc0b7cc0 0x7f3efc06a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:43.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f01048700 1 -- 172.21.15.63:0/3787881861 >> v1:172.21.15.63:6789/0 conn(0x7f3efc146be0 legacy=0x7f3efc0b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:43.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f01048700 1 -- 172.21.15.63:0/3787881861 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc146280 con 0x7f3efc145e60 2020-05-18T21:33:43.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3efb7fe700 1 -- 172.21.15.63:0/3787881861 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243161546 0 0) 0x7f3efc0b8160 con 0x7f3efc146be0 2020-05-18T21:33:43.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f01048700 1 --2- 172.21.15.63:0/3787881861 >> v2:172.21.15.63:3300/0 conn(0x7f3efc145e60 0x7f3efc149670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3ef40032f0 tx=0x7f3ef4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f01048700 1 --2- 172.21.15.63:0/3787881861 >> v2:172.21.15.63:3300/0 conn(0x7f3efc145e60 0x7f3efc149670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3ef40032f0 tx=0x7f3ef4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f01048700 1 --2- 172.21.15.63:0/3787881861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3efc145e60 0x7f3efc149670 secure :-1 s=READY pgs=1488 cs=0 l=1 rx=0x7f3ef40032f0 tx=0x7f3ef4007e00).ready entity=mon.0 client_cookie=eb85a8f9fa1e89fd server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:43.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f01048700 1 --2- 172.21.15.63:0/3787881861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3efc145e60 0x7f3efc149670 secure :-1 s=THROTTLE_DONE pgs=1488 cs=0 l=1 rx=0x7f3ef40032f0 tx=0x7f3ef4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3efb7fe700 1 -- 172.21.15.63:0/3787881861 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ef4011e60 con 0x7f3efc145e60 2020-05-18T21:33:43.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f01048700 1 --2- 172.21.15.63:0/3787881861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3efc145e60 0x7f3efc149670 secure :-1 s=THROTTLE_DONE pgs=1488 cs=0 l=1 rx=0x7f3ef40032f0 tx=0x7f3ef4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f01048700 1 --2- 172.21.15.63:0/3787881861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3efc145e60 0x7f3efc149670 secure :-1 s=THROTTLE_DONE pgs=1488 cs=0 l=1 rx=0x7f3ef40032f0 tx=0x7f3ef4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3efb7fe700 1 -- 172.21.15.63:0/3787881861 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef400a180 con 0x7f3efc145e60 2020-05-18T21:33:43.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3efb7fe700 1 -- 172.21.15.63:0/3787881861 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ef400a520 con 0x7f3efc145e60 2020-05-18T21:33:43.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f02aab700 1 -- 172.21.15.63:0/3787881861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3efc145e60 msgr2=0x7f3efc149670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:43.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f02aab700 1 --2- 172.21.15.63:0/3787881861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3efc145e60 0x7f3efc149670 secure :-1 s=READY pgs=1488 cs=0 l=1 rx=0x7f3ef40032f0 tx=0x7f3ef4007e00).stop 2020-05-18T21:33:43.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f02aab700 1 -- 172.21.15.63:0/3787881861 shutdown_connections 2020-05-18T21:33:43.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f02aab700 1 --2- 172.21.15.63:0/3787881861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3efc145e60 0x7f3efc149670 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:43.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f02aab700 1 --2- 172.21.15.63:0/3787881861 >> v2:172.21.15.155:3300/0 conn(0x7f3efc0b7cc0 0x7f3efc06a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:43.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f02aab700 1 -- 172.21.15.63:0/3787881861 >> 172.21.15.63:0/3787881861 conn(0x7f3efc05b240 msgr2=0x7f3efc069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:43.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f02aab700 1 -- 172.21.15.63:0/3787881861 shutdown_connections 2020-05-18T21:33:43.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f02aab700 1 -- 172.21.15.63:0/3787881861 wait complete. 2020-05-18T21:33:43.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.979+0000 7f3f02aab700 1 Processor -- start 2020-05-18T21:33:43.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3f02aab700 1 -- start start 2020-05-18T21:33:43.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3f02aab700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3efc146be0 0x7f3efc0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:43.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3f02aab700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3efc0b2960 con 0x7f3efc145e60 2020-05-18T21:33:43.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3f02aab700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3efc157320 con 0x7f3efc0b7cc0 2020-05-18T21:33:43.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3f02aab700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc09d460 con 0x7f3efc146be0 2020-05-18T21:33:43.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3efbfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3efc145e60 0x7f3efc152620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34844/0 (socket says 172.21.15.63:34844) 2020-05-18T21:33:43.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3efbfff700 1 -- 172.21.15.63:0/4140223729 learned_addr learned my addr 172.21.15.63:0/4140223729 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:43.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3f01048700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3efc146be0 0x7f3efc0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:43.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3ef9ffb700 1 -- 172.21.15.63:0/4140223729 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845622360 0 0) 0x7f3eec001f00 con 0x7f3efc145e60 2020-05-18T21:33:43.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3ef9ffb700 1 -- 172.21.15.63:0/4140223729 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3edc002fe0 con 0x7f3efc145e60 2020-05-18T21:33:43.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3ef9ffb700 1 -- 172.21.15.63:0/4140223729 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16540556 0 0) 0x7f3efc157320 con 0x7f3efc0b7cc0 2020-05-18T21:33:43.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3ef9ffb700 1 -- 172.21.15.63:0/4140223729 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3eec001f00 con 0x7f3efc0b7cc0 2020-05-18T21:33:43.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3ef9ffb700 1 -- 172.21.15.63:0/4140223729 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 465170815 0 0) 0x7f3edc002fe0 con 0x7f3efc145e60 2020-05-18T21:33:43.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3ef9ffb700 1 -- 172.21.15.63:0/4140223729 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3efc157320 con 0x7f3efc145e60 2020-05-18T21:33:43.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3ef9ffb700 1 -- 172.21.15.63:0/4140223729 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f3eec002690 con 0x7f3efc145e60 2020-05-18T21:33:43.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3f01048700 1 -- 172.21.15.63:0/4140223729 >> v1:172.21.15.155:6789/0 conn(0x7f3efc0b7cc0 legacy=0x7f3efc156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:43.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3f01048700 1 -- 172.21.15.63:0/4140223729 >> v1:172.21.15.63:6789/0 conn(0x7f3efc145e60 legacy=0x7f3efc152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:43.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3f01048700 1 -- 172.21.15.63:0/4140223729 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc0b1c20 con 0x7f3efc146be0 2020-05-18T21:33:43.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3f01048700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3efc146be0 0x7f3efc0b2500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ef40032f0 tx=0x7f3ef4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3f01048700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3efc146be0 0x7f3efc0b2500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ef40032f0 tx=0x7f3ef4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3f01048700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3efc146be0 0x7f3efc0b2500 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f3ef40032f0 tx=0x7f3ef4007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:43.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3f01048700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3efc146be0 0x7f3efc0b2500 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f3ef40032f0 tx=0x7f3ef4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3ef9ffb700 1 -- 172.21.15.63:0/4140223729 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ef4005a80 con 0x7f3efc146be0 2020-05-18T21:33:43.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3f02aab700 1 -- 172.21.15.63:0/4140223729 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc157070 con 0x7f3efc146be0 2020-05-18T21:33:43.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3f01048700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3efc146be0 0x7f3efc0b2500 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f3ef40032f0 tx=0x7f3ef4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3ef9ffb700 1 -- 172.21.15.63:0/4140223729 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef4005be0 con 0x7f3efc146be0 2020-05-18T21:33:43.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3f01048700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3efc146be0 0x7f3efc0b2500 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f3ef40032f0 tx=0x7f3ef4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3ef9ffb700 1 -- 172.21.15.63:0/4140223729 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ef40110d0 con 0x7f3efc146be0 2020-05-18T21:33:43.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.983+0000 7f3f02aab700 1 -- 172.21.15.63:0/4140223729 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3efc0b20c0 con 0x7f3efc146be0 2020-05-18T21:33:43.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.987+0000 7f3f01048700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3efc146be0 0x7f3efc0b2500 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f3ef40032f0 tx=0x7f3ef4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.987+0000 7f3f02aab700 1 -- 172.21.15.63:0/4140223729 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc0569e0 con 0x7f3efc146be0 2020-05-18T21:33:43.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.987+0000 7f3ef9ffb700 1 -- 172.21.15.63:0/4140223729 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3ef4011310 con 0x7f3efc146be0 2020-05-18T21:33:43.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.987+0000 7f3f01048700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3efc146be0 0x7f3efc0b2500 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f3ef40032f0 tx=0x7f3ef4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.987+0000 7f3ef9ffb700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3edc050130 0x7f3edc0525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:43.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.987+0000 7f3ef9ffb700 1 -- 172.21.15.63:0/4140223729 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3ef4064200 con 0x7f3efc146be0 2020-05-18T21:33:43.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.987+0000 7f3f00847700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3edc050130 0x7f3edc0525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:43.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.987+0000 7f3f00847700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3edc050130 0x7f3edc0525f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ef0000f20 tx=0x7f3ef0001690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.987+0000 7f3f00847700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3edc050130 0x7f3edc0525f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ef0000f20 tx=0x7f3ef0001690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:43.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.987+0000 7f3f00847700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3edc050130 0x7f3edc0525f0 secure :-1 s=READY pgs=580 cs=0 l=1 rx=0x7f3ef0000f20 tx=0x7f3ef0001690).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:44.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.995+0000 7f3f01048700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3efc146be0 0x7f3efc0b2500 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f3ef40032f0 tx=0x7f3ef4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:43.995+0000 7f3ef9ffb700 1 -- 172.21.15.63:0/4140223729 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3ef403e5b0 con 0x7f3efc146be0 2020-05-18T21:33:44.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.115+0000 7f3f02aab700 1 -- 172.21.15.63:0/4140223729 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3efc0b1e20 con 0x7f3efc146be0 2020-05-18T21:33:44.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.115+0000 7f3f01048700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3efc146be0 0x7f3efc0b2500 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f3ef40032f0 tx=0x7f3ef4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.115+0000 7f3ef9ffb700 1 -- 172.21.15.63:0/4140223729 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+13242 (secure 0 0 0) 0x7f3ef4041bd0 con 0x7f3efc146be0 2020-05-18T21:33:44.119 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:44.119 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":109,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:33:43.482947+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:33:44.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.119+0000 7f3f02aab700 1 -- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3edc050130 msgr2=0x7f3edc0525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.119+0000 7f3f02aab700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3edc050130 0x7f3edc0525f0 secure :-1 s=READY pgs=580 cs=0 l=1 rx=0x7f3ef0000f20 tx=0x7f3ef0001690).stop 2020-05-18T21:33:44.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.119+0000 7f3f02aab700 1 -- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3efc146be0 msgr2=0x7f3efc0b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.119+0000 7f3f02aab700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3efc146be0 0x7f3efc0b2500 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f3ef40032f0 tx=0x7f3ef4007e00).stop 2020-05-18T21:33:44.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.119+0000 7f3f02aab700 1 -- 172.21.15.63:0/4140223729 shutdown_connections 2020-05-18T21:33:44.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.119+0000 7f3f02aab700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3edc050130 0x7f3edc0525f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:44.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.119+0000 7f3f02aab700 1 --2- 172.21.15.63:0/4140223729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3efc146be0 0x7f3efc0b2500 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:44.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.119+0000 7f3f02aab700 1 -- 172.21.15.63:0/4140223729 >> 172.21.15.63:0/4140223729 conn(0x7f3efc05b240 msgr2=0x7f3efc144280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:44.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.119+0000 7f3f02aab700 1 -- 172.21.15.63:0/4140223729 shutdown_connections 2020-05-18T21:33:44.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.119+0000 7f3f02aab700 1 -- 172.21.15.63:0/4140223729 wait complete. 2020-05-18T21:33:44.137 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-05-18T21:33:44.138 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:33:44.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.243+0000 7f485cd39700 1 Processor -- start 2020-05-18T21:33:44.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.243+0000 7f485cd39700 1 -- start start 2020-05-18T21:33:44.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.243+0000 7f485cd39700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48580b8cf0 0x7f48580afb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:44.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.243+0000 7f485cd39700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48580ba3e0 con 0x7f48581459f0 2020-05-18T21:33:44.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.243+0000 7f485cd39700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48580b9ea0 con 0x7f48580ad0f0 2020-05-18T21:33:44.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.243+0000 7f485cd39700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48580ae270 con 0x7f48580b8cf0 2020-05-18T21:33:44.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.243+0000 7f485659c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f48581459f0 0x7f48580bc750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34850/0 (socket says 172.21.15.63:34850) 2020-05-18T21:33:44.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.243+0000 7f485659c700 1 -- 172.21.15.63:0/595259074 learned_addr learned my addr 172.21.15.63:0/595259074 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:44.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.243+0000 7f4856d9d700 1 --2- 172.21.15.63:0/595259074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48580b8cf0 0x7f48580afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:44.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.243+0000 7f4855d9b700 1 -- 172.21.15.63:0/595259074 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522751730 0 0) 0x7f48580ba3e0 con 0x7f48581459f0 2020-05-18T21:33:44.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f4855d9b700 1 -- 172.21.15.63:0/595259074 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4838003270 con 0x7f48581459f0 2020-05-18T21:33:44.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f4855d9b700 1 -- 172.21.15.63:0/595259074 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 454359136 0 0) 0x7f48580b9ea0 con 0x7f48580ad0f0 2020-05-18T21:33:44.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f4855d9b700 1 -- 172.21.15.63:0/595259074 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48580ba3e0 con 0x7f48580ad0f0 2020-05-18T21:33:44.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f4856d9d700 1 -- 172.21.15.63:0/595259074 >> v1:172.21.15.155:6789/0 conn(0x7f48580ad0f0 legacy=0x7f4858145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f4856d9d700 1 -- 172.21.15.63:0/595259074 >> v1:172.21.15.63:6789/0 conn(0x7f48581459f0 legacy=0x7f48580bc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f4856d9d700 1 -- 172.21.15.63:0/595259074 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48580ba140 con 0x7f48580b8cf0 2020-05-18T21:33:44.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f4856d9d700 1 --2- 172.21.15.63:0/595259074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48580b8cf0 0x7f48580afb60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f48500032f0 tx=0x7f4850008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f4856d9d700 1 --2- 172.21.15.63:0/595259074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48580b8cf0 0x7f48580afb60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f48500032f0 tx=0x7f4850008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f4856d9d700 1 --2- 172.21.15.63:0/595259074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48580b8cf0 0x7f48580afb60 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7f48500032f0 tx=0x7f4850008ca0).ready entity=mon.2 client_cookie=ed79c2db73ec6bad server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:44.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f4856d9d700 1 --2- 172.21.15.63:0/595259074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48580b8cf0 0x7f48580afb60 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7f48500032f0 tx=0x7f4850008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f4855d9b700 1 -- 172.21.15.63:0/595259074 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4850011df0 con 0x7f48580b8cf0 2020-05-18T21:33:44.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f4856d9d700 1 --2- 172.21.15.63:0/595259074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48580b8cf0 0x7f48580afb60 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7f48500032f0 tx=0x7f4850008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f4856d9d700 1 --2- 172.21.15.63:0/595259074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48580b8cf0 0x7f48580afb60 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7f48500032f0 tx=0x7f4850008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f4855d9b700 1 -- 172.21.15.63:0/595259074 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485000a180 con 0x7f48580b8cf0 2020-05-18T21:33:44.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f4855d9b700 1 -- 172.21.15.63:0/595259074 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f485000a4e0 con 0x7f48580b8cf0 2020-05-18T21:33:44.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f485cd39700 1 -- 172.21.15.63:0/595259074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48580b8cf0 msgr2=0x7f48580afb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f485cd39700 1 --2- 172.21.15.63:0/595259074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48580b8cf0 0x7f48580afb60 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7f48500032f0 tx=0x7f4850008ca0).stop 2020-05-18T21:33:44.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f485cd39700 1 -- 172.21.15.63:0/595259074 shutdown_connections 2020-05-18T21:33:44.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f485cd39700 1 --2- 172.21.15.63:0/595259074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48580b8cf0 0x7f48580afb60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:44.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f485cd39700 1 -- 172.21.15.63:0/595259074 >> 172.21.15.63:0/595259074 conn(0x7f485805f540 msgr2=0x7f485805f920 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:44.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f485cd39700 1 -- 172.21.15.63:0/595259074 shutdown_connections 2020-05-18T21:33:44.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f485cd39700 1 -- 172.21.15.63:0/595259074 wait complete. 2020-05-18T21:33:44.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f485cd39700 1 Processor -- start 2020-05-18T21:33:44.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.247+0000 7f485cd39700 1 -- start start 2020-05-18T21:33:44.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f485cd39700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f48581459f0 0x7f48581472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:44.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f485cd39700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48580b74e0 con 0x7f48580ad0f0 2020-05-18T21:33:44.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f485cd39700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48580b7780 con 0x7f48580b8cf0 2020-05-18T21:33:44.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f485cd39700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48580b7a20 con 0x7f48581459f0 2020-05-18T21:33:44.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f485659c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f48580ad0f0 0x7f485813e620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34856/0 (socket says 172.21.15.63:34856) 2020-05-18T21:33:44.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f485659c700 1 -- 172.21.15.63:0/3385331745 learned_addr learned my addr 172.21.15.63:0/3385331745 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:44.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f4856d9d700 1 --2- 172.21.15.63:0/3385331745 >> v2:172.21.15.155:3300/0 conn(0x7f48581459f0 0x7f48581472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:44.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f484ffff700 1 -- 172.21.15.63:0/3385331745 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012644673 0 0) 0x7f48580b74e0 con 0x7f48580ad0f0 2020-05-18T21:33:44.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f484ffff700 1 -- 172.21.15.63:0/3385331745 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f483c002fe0 con 0x7f48580ad0f0 2020-05-18T21:33:44.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f484ffff700 1 -- 172.21.15.63:0/3385331745 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671946071 0 0) 0x7f48580b7780 con 0x7f48580b8cf0 2020-05-18T21:33:44.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f484ffff700 1 -- 172.21.15.63:0/3385331745 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48580b74e0 con 0x7f48580b8cf0 2020-05-18T21:33:44.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f4856d9d700 1 -- 172.21.15.63:0/3385331745 >> v1:172.21.15.155:6789/0 conn(0x7f48580b8cf0 legacy=0x7f48580b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f4856d9d700 1 -- 172.21.15.63:0/3385331745 >> v1:172.21.15.63:6789/0 conn(0x7f48580ad0f0 legacy=0x7f485813e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f484ffff700 1 -- 172.21.15.63:0/3385331745 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4021244274 0 0) 0x7f483c002fe0 con 0x7f48580ad0f0 2020-05-18T21:33:44.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f4856d9d700 1 -- 172.21.15.63:0/3385331745 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485813ed30 con 0x7f48581459f0 2020-05-18T21:33:44.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f4856d9d700 1 --2- 172.21.15.63:0/3385331745 >> v2:172.21.15.155:3300/0 conn(0x7f48581459f0 0x7f48581472e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4848001040 tx=0x7f48580bd870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f4856d9d700 1 --2- 172.21.15.63:0/3385331745 >> v2:172.21.15.155:3300/0 conn(0x7f48581459f0 0x7f48581472e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4848001040 tx=0x7f48580bd870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f4856d9d700 1 --2- 172.21.15.63:0/3385331745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48581459f0 0x7f48581472e0 secure :-1 s=READY pgs=1001 cs=0 l=1 rx=0x7f4848001040 tx=0x7f48580bd870).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:44.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f4856d9d700 1 --2- 172.21.15.63:0/3385331745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48581459f0 0x7f48581472e0 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f4848001040 tx=0x7f48580bd870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f484ffff700 1 -- 172.21.15.63:0/3385331745 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4848001980 con 0x7f48581459f0 2020-05-18T21:33:44.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f4856d9d700 1 --2- 172.21.15.63:0/3385331745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48581459f0 0x7f48581472e0 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f4848001040 tx=0x7f48580bd870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f485cd39700 1 -- 172.21.15.63:0/3385331745 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48580b6eb0 con 0x7f48581459f0 2020-05-18T21:33:44.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f484ffff700 1 -- 172.21.15.63:0/3385331745 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485000ad20 con 0x7f48581459f0 2020-05-18T21:33:44.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f4856d9d700 1 --2- 172.21.15.63:0/3385331745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48581459f0 0x7f48581472e0 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f4848001040 tx=0x7f48580bd870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f484ffff700 1 -- 172.21.15.63:0/3385331745 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f485000ae90 con 0x7f48581459f0 2020-05-18T21:33:44.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.251+0000 7f485cd39700 1 -- 172.21.15.63:0/3385331745 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4858157680 con 0x7f48581459f0 2020-05-18T21:33:44.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.255+0000 7f4856d9d700 1 --2- 172.21.15.63:0/3385331745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48581459f0 0x7f48581472e0 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f4848001040 tx=0x7f48580bd870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.255+0000 7f485cd39700 1 -- 172.21.15.63:0/3385331745 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48580569e0 con 0x7f48581459f0 2020-05-18T21:33:44.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.255+0000 7f4856d9d700 1 --2- 172.21.15.63:0/3385331745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48581459f0 0x7f48581472e0 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f4848001040 tx=0x7f48580bd870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.255+0000 7f484ffff700 1 -- 172.21.15.63:0/3385331745 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4850005c70 con 0x7f48581459f0 2020-05-18T21:33:44.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.255+0000 7f484ffff700 1 --2- 172.21.15.63:0/3385331745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f483c04fdc0 0x7f483c052280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:44.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.255+0000 7f484ffff700 1 -- 172.21.15.63:0/3385331745 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f4850064570 con 0x7f48581459f0 2020-05-18T21:33:44.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.255+0000 7f485659c700 1 --2- 172.21.15.63:0/3385331745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f483c04fdc0 0x7f483c052280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:44.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.255+0000 7f485659c700 1 --2- 172.21.15.63:0/3385331745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f483c04fdc0 0x7f483c052280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f48480011d0 tx=0x7f4848009eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.255+0000 7f485659c700 1 --2- 172.21.15.63:0/3385331745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f483c04fdc0 0x7f483c052280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f48480011d0 tx=0x7f4848009eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.255+0000 7f485659c700 1 --2- 172.21.15.63:0/3385331745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f483c04fdc0 0x7f483c052280 secure :-1 s=READY pgs=581 cs=0 l=1 rx=0x7f48480011d0 tx=0x7f4848009eb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:44.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.263+0000 7f4856d9d700 1 --2- 172.21.15.63:0/3385331745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48581459f0 0x7f48581472e0 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f4848001040 tx=0x7f48580bd870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.263+0000 7f484ffff700 1 -- 172.21.15.63:0/3385331745 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f485003e9e0 con 0x7f48581459f0 2020-05-18T21:33:44.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.383+0000 7f485cd39700 1 -- 172.21.15.63:0/3385331745 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f48580008d0 con 0x7f48581459f0 2020-05-18T21:33:44.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.387+0000 7f4856d9d700 1 --2- 172.21.15.63:0/3385331745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48581459f0 0x7f48581472e0 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f4848001040 tx=0x7f48580bd870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.387+0000 7f484ffff700 1 -- 172.21.15.63:0/3385331745 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v109) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4850042000 con 0x7f48581459f0 2020-05-18T21:33:44.390 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:33:44.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.387+0000 7f485cd39700 1 -- 172.21.15.63:0/3385331745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f483c04fdc0 msgr2=0x7f483c052280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.387+0000 7f485cd39700 1 --2- 172.21.15.63:0/3385331745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f483c04fdc0 0x7f483c052280 secure :-1 s=READY pgs=581 cs=0 l=1 rx=0x7f48480011d0 tx=0x7f4848009eb0).stop 2020-05-18T21:33:44.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.387+0000 7f485cd39700 1 -- 172.21.15.63:0/3385331745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48581459f0 msgr2=0x7f48581472e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.387+0000 7f485cd39700 1 --2- 172.21.15.63:0/3385331745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48581459f0 0x7f48581472e0 secure :-1 s=READY pgs=1001 cs=0 l=1 rx=0x7f4848001040 tx=0x7f48580bd870).stop 2020-05-18T21:33:44.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.387+0000 7f485cd39700 1 -- 172.21.15.63:0/3385331745 shutdown_connections 2020-05-18T21:33:44.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.387+0000 7f485cd39700 1 --2- 172.21.15.63:0/3385331745 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f483c04fdc0 0x7f483c052280 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:44.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.387+0000 7f485cd39700 1 --2- 172.21.15.63:0/3385331745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48581459f0 0x7f48581472e0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:44.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.387+0000 7f485cd39700 1 -- 172.21.15.63:0/3385331745 >> 172.21.15.63:0/3385331745 conn(0x7f485805f540 msgr2=0x7f48580bc750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:44.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.387+0000 7f485cd39700 1 -- 172.21.15.63:0/3385331745 shutdown_connections 2020-05-18T21:33:44.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.387+0000 7f485cd39700 1 -- 172.21.15.63:0/3385331745 wait complete. 2020-05-18T21:33:44.406 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:33:44.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.507+0000 7f6a03fff700 1 Processor -- start 2020-05-18T21:33:44.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a03fff700 1 -- start start 2020-05-18T21:33:44.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a03fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a0409dfb0 0x7f6a0406a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:44.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a03fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a040b5f10 con 0x7f6a040b65e0 2020-05-18T21:33:44.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a03fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a040b6140 con 0x7f6a04145e10 2020-05-18T21:33:44.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a03fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0409e390 con 0x7f6a0409dfb0 2020-05-18T21:33:44.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a027fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6a040b65e0 0x7f6a04145700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34866/0 (socket says 172.21.15.63:34866) 2020-05-18T21:33:44.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a027fc700 1 -- 172.21.15.63:0/3582067052 learned_addr learned my addr 172.21.15.63:0/3582067052 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:44.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a02ffd700 1 --2- 172.21.15.63:0/3582067052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a0409dfb0 0x7f6a0406a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:44.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a01ffb700 1 -- 172.21.15.63:0/3582067052 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119786385 0 0) 0x7f6a040b5f10 con 0x7f6a040b65e0 2020-05-18T21:33:44.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a01ffb700 1 -- 172.21.15.63:0/3582067052 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69e4003270 con 0x7f6a040b65e0 2020-05-18T21:33:44.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a01ffb700 1 -- 172.21.15.63:0/3582067052 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645851486 0 0) 0x7f6a040b6140 con 0x7f6a04145e10 2020-05-18T21:33:44.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a01ffb700 1 -- 172.21.15.63:0/3582067052 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a040b5f10 con 0x7f6a04145e10 2020-05-18T21:33:44.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a02ffd700 1 -- 172.21.15.63:0/3582067052 >> v1:172.21.15.155:6789/0 conn(0x7f6a04145e10 legacy=0x7f6a040b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a02ffd700 1 -- 172.21.15.63:0/3582067052 >> v1:172.21.15.63:6789/0 conn(0x7f6a040b65e0 legacy=0x7f6a04145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a01ffb700 1 -- 172.21.15.63:0/3582067052 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1351862835 0 0) 0x7f69e4003270 con 0x7f6a040b65e0 2020-05-18T21:33:44.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a02ffd700 1 -- 172.21.15.63:0/3582067052 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0406aa10 con 0x7f6a0409dfb0 2020-05-18T21:33:44.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a02ffd700 1 --2- 172.21.15.63:0/3582067052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a0409dfb0 0x7f6a0406a170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f69ec001110 tx=0x7f69f4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a02ffd700 1 --2- 172.21.15.63:0/3582067052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a0409dfb0 0x7f6a0406a170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f69ec001110 tx=0x7f69f4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a02ffd700 1 --2- 172.21.15.63:0/3582067052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a0409dfb0 0x7f6a0406a170 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f69ec001110 tx=0x7f69f4008920).ready entity=mon.2 client_cookie=f4a21115a59d4e5 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:44.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a02ffd700 1 --2- 172.21.15.63:0/3582067052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a0409dfb0 0x7f6a0406a170 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f69ec001110 tx=0x7f69f4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a01ffb700 1 -- 172.21.15.63:0/3582067052 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69ec001710 con 0x7f6a0409dfb0 2020-05-18T21:33:44.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a02ffd700 1 --2- 172.21.15.63:0/3582067052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a0409dfb0 0x7f6a0406a170 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f69ec001110 tx=0x7f69f4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a02ffd700 1 --2- 172.21.15.63:0/3582067052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a0409dfb0 0x7f6a0406a170 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f69ec001110 tx=0x7f69f4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a01ffb700 1 -- 172.21.15.63:0/3582067052 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f4008e80 con 0x7f6a0409dfb0 2020-05-18T21:33:44.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a03fff700 1 -- 172.21.15.63:0/3582067052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a0409dfb0 msgr2=0x7f6a0406a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a01ffb700 1 -- 172.21.15.63:0/3582067052 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69f4011440 con 0x7f6a0409dfb0 2020-05-18T21:33:44.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.511+0000 7f6a03fff700 1 --2- 172.21.15.63:0/3582067052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a0409dfb0 0x7f6a0406a170 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f69ec001110 tx=0x7f69f4008920).stop 2020-05-18T21:33:44.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a03fff700 1 -- 172.21.15.63:0/3582067052 shutdown_connections 2020-05-18T21:33:44.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a03fff700 1 --2- 172.21.15.63:0/3582067052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a0409dfb0 0x7f6a0406a170 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:44.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a03fff700 1 -- 172.21.15.63:0/3582067052 >> 172.21.15.63:0/3582067052 conn(0x7f6a0405a7c0 msgr2=0x7f6a0405aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:44.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a03fff700 1 -- 172.21.15.63:0/3582067052 shutdown_connections 2020-05-18T21:33:44.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a03fff700 1 -- 172.21.15.63:0/3582067052 wait complete. 2020-05-18T21:33:44.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a03fff700 1 Processor -- start 2020-05-18T21:33:44.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a03fff700 1 -- start start 2020-05-18T21:33:44.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a03fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a0409dfb0 0x7f6a04114d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:44.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a03fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6a040b65e0 0x7f6a0405f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:44.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a03fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6a04145e10 0x7f6a04157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:44.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a03fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a04115160 con 0x7f6a04145e10 2020-05-18T21:33:44.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a03fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0405f550 con 0x7f6a040b65e0 2020-05-18T21:33:44.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a03fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a04114320 con 0x7f6a0409dfb0 2020-05-18T21:33:44.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a037fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6a04145e10 0x7f6a04157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:44.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a037fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6a04145e10 0x7f6a04157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60918/0 (socket says 172.21.15.63:60918) 2020-05-18T21:33:44.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a037fe700 1 -- 172.21.15.63:0/3519756408 learned_addr learned my addr 172.21.15.63:0/3519756408 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:44.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a027fc700 1 --2- 172.21.15.63:0/3519756408 >> v2:172.21.15.155:3300/0 conn(0x7f6a040b65e0 0x7f6a0405f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:44.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a02ffd700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a0409dfb0 0x7f6a04114d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:44.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a037fe700 1 -- 172.21.15.63:0/3519756408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a0409dfb0 msgr2=0x7f6a04114d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a037fe700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a0409dfb0 0x7f6a04114d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:44.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a037fe700 1 -- 172.21.15.63:0/3519756408 >> v2:172.21.15.155:3300/0 conn(0x7f6a040b65e0 msgr2=0x7f6a0405f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a037fe700 1 --2- 172.21.15.63:0/3519756408 >> v2:172.21.15.155:3300/0 conn(0x7f6a040b65e0 0x7f6a0405f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:44.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a037fe700 1 -- 172.21.15.63:0/3519756408 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a041145c0 con 0x7f6a04145e10 2020-05-18T21:33:44.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a037fe700 1 --2- 172.21.15.63:0/3519756408 >> v2:172.21.15.63:3300/0 conn(0x7f6a04145e10 0x7f6a04157550 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f69fc001490 tx=0x7f69fc0027a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a037fe700 1 --2- 172.21.15.63:0/3519756408 >> v2:172.21.15.63:3300/0 conn(0x7f6a04145e10 0x7f6a04157550 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f69fc001490 tx=0x7f69fc0027a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a037fe700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a04145e10 0x7f6a04157550 secure :-1 s=READY pgs=1493 cs=0 l=1 rx=0x7f69fc001490 tx=0x7f69fc0027a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:44.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a037fe700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a04145e10 0x7f6a04157550 secure :-1 s=THROTTLE_DONE pgs=1493 cs=0 l=1 rx=0x7f69fc001490 tx=0x7f69fc0027a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f69fbfff700 1 -- 172.21.15.63:0/3519756408 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69fc0122b0 con 0x7f6a04145e10 2020-05-18T21:33:44.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a037fe700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a04145e10 0x7f6a04157550 secure :-1 s=THROTTLE_DONE pgs=1493 cs=0 l=1 rx=0x7f69fc001490 tx=0x7f69fc0027a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f69fbfff700 1 -- 172.21.15.63:0/3519756408 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc012410 con 0x7f6a04145e10 2020-05-18T21:33:44.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a037fe700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a04145e10 0x7f6a04157550 secure :-1 s=THROTTLE_DONE pgs=1493 cs=0 l=1 rx=0x7f69fc001490 tx=0x7f69fc0027a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.515+0000 7f6a03fff700 1 -- 172.21.15.63:0/3519756408 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a04114860 con 0x7f6a04145e10 2020-05-18T21:33:44.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.519+0000 7f69fbfff700 1 -- 172.21.15.63:0/3519756408 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69fc012830 con 0x7f6a04145e10 2020-05-18T21:33:44.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.519+0000 7f6a03fff700 1 -- 172.21.15.63:0/3519756408 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a040b1580 con 0x7f6a04145e10 2020-05-18T21:33:44.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.519+0000 7f6a03fff700 1 -- 172.21.15.63:0/3519756408 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a040569e0 con 0x7f6a04145e10 2020-05-18T21:33:44.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.519+0000 7f6a037fe700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a04145e10 0x7f6a04157550 secure :-1 s=THROTTLE_DONE pgs=1493 cs=0 l=1 rx=0x7f69fc001490 tx=0x7f69fc0027a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.519+0000 7f69fbfff700 1 -- 172.21.15.63:0/3519756408 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f69fc012af0 con 0x7f6a04145e10 2020-05-18T21:33:44.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.519+0000 7f6a037fe700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a04145e10 0x7f6a04157550 secure :-1 s=THROTTLE_DONE pgs=1493 cs=0 l=1 rx=0x7f69fc001490 tx=0x7f69fc0027a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.519+0000 7f69fbfff700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f69e804fa10 0x7f69e8051ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:44.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.519+0000 7f69fbfff700 1 -- 172.21.15.63:0/3519756408 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f69fc063fe0 con 0x7f6a04145e10 2020-05-18T21:33:44.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.519+0000 7f6a02ffd700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f69e804fa10 0x7f69e8051ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:44.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.519+0000 7f6a02ffd700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f69e804fa10 0x7f69e8051ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f69ec001110 tx=0x7f6a0406aba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.519+0000 7f6a02ffd700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f69e804fa10 0x7f69e8051ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f69ec001110 tx=0x7f6a0406aba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.519+0000 7f6a02ffd700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f69e804fa10 0x7f69e8051ed0 secure :-1 s=READY pgs=582 cs=0 l=1 rx=0x7f69ec001110 tx=0x7f6a0406aba0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:44.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.523+0000 7f6a037fe700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a04145e10 0x7f6a04157550 secure :-1 s=THROTTLE_DONE pgs=1493 cs=0 l=1 rx=0x7f69fc001490 tx=0x7f69fc0027a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.523+0000 7f69fbfff700 1 -- 172.21.15.63:0/3519756408 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f69fc03e310 con 0x7f6a04145e10 2020-05-18T21:33:44.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.643+0000 7f6a03fff700 1 -- 172.21.15.63:0/3519756408 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6a0405b7d0 con 0x7f6a04145e10 2020-05-18T21:33:44.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.643+0000 7f6a037fe700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a04145e10 0x7f6a04157550 secure :-1 s=THROTTLE_DONE pgs=1493 cs=0 l=1 rx=0x7f69fc001490 tx=0x7f69fc0027a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.643+0000 7f69fbfff700 1 -- 172.21.15.63:0/3519756408 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v109) v1 ==== 92+0+10 (secure 0 0 0) 0x7f69fc041930 con 0x7f6a04145e10 2020-05-18T21:33:44.648 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:33:44.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.647+0000 7f6a03fff700 1 -- 172.21.15.63:0/3519756408 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f69e804fa10 msgr2=0x7f69e8051ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.647+0000 7f6a03fff700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f69e804fa10 0x7f69e8051ed0 secure :-1 s=READY pgs=582 cs=0 l=1 rx=0x7f69ec001110 tx=0x7f6a0406aba0).stop 2020-05-18T21:33:44.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.647+0000 7f6a03fff700 1 -- 172.21.15.63:0/3519756408 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a04145e10 msgr2=0x7f6a04157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.647+0000 7f6a03fff700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a04145e10 0x7f6a04157550 secure :-1 s=READY pgs=1493 cs=0 l=1 rx=0x7f69fc001490 tx=0x7f69fc0027a0).stop 2020-05-18T21:33:44.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.647+0000 7f6a03fff700 1 -- 172.21.15.63:0/3519756408 shutdown_connections 2020-05-18T21:33:44.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.647+0000 7f6a03fff700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f69e804fa10 0x7f69e8051ed0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:44.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.647+0000 7f6a03fff700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a04145e10 0x7f6a04157550 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:44.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.647+0000 7f6a03fff700 1 --2- 172.21.15.63:0/3519756408 >> v2:172.21.15.155:3300/0 conn(0x7f6a040b65e0 0x7f6a0405f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:44.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.647+0000 7f6a03fff700 1 --2- 172.21.15.63:0/3519756408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a0409dfb0 0x7f6a04114d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:44.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.647+0000 7f6a03fff700 1 -- 172.21.15.63:0/3519756408 >> 172.21.15.63:0/3519756408 conn(0x7f6a0405a7c0 msgr2=0x7f6a040b7620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:44.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.647+0000 7f6a03fff700 1 -- 172.21.15.63:0/3519756408 shutdown_connections 2020-05-18T21:33:44.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.647+0000 7f6a03fff700 1 -- 172.21.15.63:0/3519756408 wait complete. 2020-05-18T21:33:44.660 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-05-18T21:33:44.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.755+0000 7fd2e2d7b700 1 Processor -- start 2020-05-18T21:33:44.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.755+0000 7fd2e2d7b700 1 -- start start 2020-05-18T21:33:44.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e2d7b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2dc0b45f0 0x7fd2dc0632f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:44.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e2d7b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd2dc145ed0 0x7fd2dc146360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:44.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e2d7b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2dc145790 con 0x7fd2dc0658a0 2020-05-18T21:33:44.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e2d7b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2dc063900 con 0x7fd2dc145ed0 2020-05-18T21:33:44.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e2d7b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc145a30 con 0x7fd2dc0b45f0 2020-05-18T21:33:44.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e1578700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2dc0b45f0 0x7fd2dc0632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:44.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e257a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd2dc145ed0 0x7fd2dc146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:44.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e1578700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2dc0b45f0 0x7fd2dc0632f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:51624/0 (socket says 172.21.15.63:51624) 2020-05-18T21:33:44.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e1578700 1 -- 172.21.15.63:0/2542338974 learned_addr learned my addr 172.21.15.63:0/2542338974 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:44.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e257a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd2dc145ed0 0x7fd2dc146360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:47542/0 (socket says 172.21.15.63:47542) 2020-05-18T21:33:44.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e1578700 1 -- 172.21.15.63:0/2542338974 >> v2:172.21.15.155:3300/0 conn(0x7fd2dc145ed0 msgr2=0x7fd2dc146360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:44.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e1578700 1 --2- 172.21.15.63:0/2542338974 >> v2:172.21.15.155:3300/0 conn(0x7fd2dc145ed0 0x7fd2dc146360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:44.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e1578700 1 -- 172.21.15.63:0/2542338974 >> v1:172.21.15.155:6789/0 conn(0x7fd2dc0658a0 legacy=0x7fd2dc0b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e1578700 1 -- 172.21.15.63:0/2542338974 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2dc065c80 con 0x7fd2dc0b45f0 2020-05-18T21:33:44.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e257a700 1 --2- 172.21.15.63:0/2542338974 >> v2:172.21.15.155:3300/0 conn(0x7fd2dc145ed0 0x7fd2dc146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:44.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e1578700 1 --2- 172.21.15.63:0/2542338974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2dc0b45f0 0x7fd2dc0632f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd2cc002f70 tx=0x7fd2cc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e1578700 1 --2- 172.21.15.63:0/2542338974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2dc0b45f0 0x7fd2dc0632f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd2cc002f70 tx=0x7fd2cc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e1578700 1 --2- 172.21.15.63:0/2542338974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2dc0b45f0 0x7fd2dc0632f0 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7fd2cc002f70 tx=0x7fd2cc007a80).ready entity=mon.2 client_cookie=aabc53cf3955e328 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:44.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e1578700 1 --2- 172.21.15.63:0/2542338974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2dc0b45f0 0x7fd2dc0632f0 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7fd2cc002f70 tx=0x7fd2cc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e0d77700 1 -- 172.21.15.63:0/2542338974 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2cc0116b0 con 0x7fd2dc0b45f0 2020-05-18T21:33:44.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e1578700 1 --2- 172.21.15.63:0/2542338974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2dc0b45f0 0x7fd2dc0632f0 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7fd2cc002f70 tx=0x7fd2cc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e1578700 1 --2- 172.21.15.63:0/2542338974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2dc0b45f0 0x7fd2dc0632f0 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7fd2cc002f70 tx=0x7fd2cc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e0d77700 1 -- 172.21.15.63:0/2542338974 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2cc011810 con 0x7fd2dc0b45f0 2020-05-18T21:33:44.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e0d77700 1 -- 172.21.15.63:0/2542338974 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2cc011c30 con 0x7fd2dc0b45f0 2020-05-18T21:33:44.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e2d7b700 1 -- 172.21.15.63:0/2542338974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2dc0b45f0 msgr2=0x7fd2dc0632f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e2d7b700 1 --2- 172.21.15.63:0/2542338974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2dc0b45f0 0x7fd2dc0632f0 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7fd2cc002f70 tx=0x7fd2cc007a80).stop 2020-05-18T21:33:44.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e2d7b700 1 -- 172.21.15.63:0/2542338974 shutdown_connections 2020-05-18T21:33:44.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e2d7b700 1 --2- 172.21.15.63:0/2542338974 >> v2:172.21.15.155:3300/0 conn(0x7fd2dc145ed0 0x7fd2dc146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:44.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e2d7b700 1 --2- 172.21.15.63:0/2542338974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2dc0b45f0 0x7fd2dc0632f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:44.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e2d7b700 1 -- 172.21.15.63:0/2542338974 >> 172.21.15.63:0/2542338974 conn(0x7fd2dc069fc0 msgr2=0x7fd2dc06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:44.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e2d7b700 1 -- 172.21.15.63:0/2542338974 shutdown_connections 2020-05-18T21:33:44.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.759+0000 7fd2e2d7b700 1 -- 172.21.15.63:0/2542338974 wait complete. 2020-05-18T21:33:44.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e2d7b700 1 Processor -- start 2020-05-18T21:33:44.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e2d7b700 1 -- start start 2020-05-18T21:33:44.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e2d7b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd2dc0b45f0 0x7fd2dc0b6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:44.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e2d7b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd2dc145ed0 0x7fd2dc156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:44.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e2d7b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2dc13afd0 con 0x7fd2dc0658a0 2020-05-18T21:33:44.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e2d7b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2dc0b7310 con 0x7fd2dc145ed0 2020-05-18T21:33:44.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e2d7b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2dc134300 con 0x7fd2dc0b45f0 2020-05-18T21:33:44.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e257a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd2dc145ed0 0x7fd2dc156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:44.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e1578700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd2dc0b45f0 0x7fd2dc0b6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:44.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e1578700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd2dc0b45f0 0x7fd2dc0b6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:47544/0 (socket says 172.21.15.63:47544) 2020-05-18T21:33:44.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e1578700 1 -- 172.21.15.63:0/2357824089 learned_addr learned my addr 172.21.15.63:0/2357824089 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:44.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e257a700 1 -- 172.21.15.63:0/2357824089 >> v2:172.21.15.155:3300/0 conn(0x7fd2dc0b45f0 msgr2=0x7fd2dc0b6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2caffd700 1 -- 172.21.15.63:0/2357824089 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147073901 0 0) 0x7fd2dc145790 con 0x7fd2dc0658a0 2020-05-18T21:33:44.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e257a700 1 --2- 172.21.15.63:0/2357824089 >> v2:172.21.15.155:3300/0 conn(0x7fd2dc0b45f0 0x7fd2dc0b6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:44.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e257a700 1 -- 172.21.15.63:0/2357824089 >> v1:172.21.15.155:6789/0 conn(0x7fd2dc0658a0 legacy=0x7fd2dc13a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e257a700 1 -- 172.21.15.63:0/2357824089 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2dc13b5d0 con 0x7fd2dc145ed0 2020-05-18T21:33:44.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e1578700 1 --2- 172.21.15.63:0/2357824089 >> v2:172.21.15.155:3300/0 conn(0x7fd2dc0b45f0 0x7fd2dc0b6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:44.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e257a700 1 --2- 172.21.15.63:0/2357824089 >> v2:172.21.15.63:3300/0 conn(0x7fd2dc145ed0 0x7fd2dc156ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2d40032f0 tx=0x7fd2d40110d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e257a700 1 --2- 172.21.15.63:0/2357824089 >> v2:172.21.15.63:3300/0 conn(0x7fd2dc145ed0 0x7fd2dc156ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2d40032f0 tx=0x7fd2d40110d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e257a700 1 --2- 172.21.15.63:0/2357824089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2dc145ed0 0x7fd2dc156ce0 secure :-1 s=READY pgs=1494 cs=0 l=1 rx=0x7fd2d40032f0 tx=0x7fd2d40110d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:44.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e257a700 1 --2- 172.21.15.63:0/2357824089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2dc145ed0 0x7fd2dc156ce0 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7fd2d40032f0 tx=0x7fd2d40110d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2caffd700 1 -- 172.21.15.63:0/2357824089 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2d400b270 con 0x7fd2dc145ed0 2020-05-18T21:33:44.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e257a700 1 --2- 172.21.15.63:0/2357824089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2dc145ed0 0x7fd2dc156ce0 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7fd2d40032f0 tx=0x7fd2d40110d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2caffd700 1 -- 172.21.15.63:0/2357824089 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d400b3d0 con 0x7fd2dc145ed0 2020-05-18T21:33:44.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e2d7b700 1 -- 172.21.15.63:0/2357824089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2dc13b870 con 0x7fd2dc145ed0 2020-05-18T21:33:44.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2e257a700 1 --2- 172.21.15.63:0/2357824089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2dc145ed0 0x7fd2dc156ce0 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7fd2d40032f0 tx=0x7fd2d40110d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.763+0000 7fd2caffd700 1 -- 172.21.15.63:0/2357824089 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2d400b540 con 0x7fd2dc145ed0 2020-05-18T21:33:44.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.767+0000 7fd2e2d7b700 1 -- 172.21.15.63:0/2357824089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2dc157140 con 0x7fd2dc145ed0 2020-05-18T21:33:44.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.767+0000 7fd2e257a700 1 --2- 172.21.15.63:0/2357824089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2dc145ed0 0x7fd2dc156ce0 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7fd2d40032f0 tx=0x7fd2d40110d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.767+0000 7fd2e2d7b700 1 -- 172.21.15.63:0/2357824089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2dc0569e0 con 0x7fd2dc145ed0 2020-05-18T21:33:44.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.767+0000 7fd2caffd700 1 -- 172.21.15.63:0/2357824089 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd2d4008910 con 0x7fd2dc145ed0 2020-05-18T21:33:44.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.767+0000 7fd2e257a700 1 --2- 172.21.15.63:0/2357824089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2dc145ed0 0x7fd2dc156ce0 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7fd2d40032f0 tx=0x7fd2d40110d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.767+0000 7fd2caffd700 1 --2- 172.21.15.63:0/2357824089 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd2bc04f8f0 0x7fd2bc051db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:44.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.767+0000 7fd2caffd700 1 -- 172.21.15.63:0/2357824089 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd2d4063fc0 con 0x7fd2dc145ed0 2020-05-18T21:33:44.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.767+0000 7fd2e1d79700 1 --2- 172.21.15.63:0/2357824089 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd2bc04f8f0 0x7fd2bc051db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:44.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.767+0000 7fd2e1d79700 1 --2- 172.21.15.63:0/2357824089 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd2bc04f8f0 0x7fd2bc051db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2d80021b0 tx=0x7fd2d8002760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.767+0000 7fd2e1d79700 1 --2- 172.21.15.63:0/2357824089 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd2bc04f8f0 0x7fd2bc051db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2d80021b0 tx=0x7fd2d8002760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.767+0000 7fd2e1d79700 1 --2- 172.21.15.63:0/2357824089 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd2bc04f8f0 0x7fd2bc051db0 secure :-1 s=READY pgs=583 cs=0 l=1 rx=0x7fd2d80021b0 tx=0x7fd2d8002760).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:44.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.775+0000 7fd2e257a700 1 --2- 172.21.15.63:0/2357824089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2dc145ed0 0x7fd2dc156ce0 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7fd2d40032f0 tx=0x7fd2d40110d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.775+0000 7fd2caffd700 1 -- 172.21.15.63:0/2357824089 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd2d403e2f0 con 0x7fd2dc145ed0 2020-05-18T21:33:44.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.891+0000 7fd2e2d7b700 1 -- 172.21.15.63:0/2357824089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd2dc13bd10 con 0x7fd2dc145ed0 2020-05-18T21:33:44.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.891+0000 7fd2e257a700 1 --2- 172.21.15.63:0/2357824089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2dc145ed0 0x7fd2dc156ce0 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7fd2d40032f0 tx=0x7fd2d40110d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:44.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.891+0000 7fd2caffd700 1 -- 172.21.15.63:0/2357824089 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v109) v1 ==== 84+0+143 (secure 0 0 0) 0x7fd2d4041910 con 0x7fd2dc145ed0 2020-05-18T21:33:44.896 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:44.897 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:33:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2020-05-18T21:33:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "device_health_metrics" 2020-05-18T21:33:44.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 2, 2020-05-18T21:33:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "rbd" 2020-05-18T21:33:44.898 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:44.898 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:33:44.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.895+0000 7fd2e2d7b700 1 -- 172.21.15.63:0/2357824089 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd2bc04f8f0 msgr2=0x7fd2bc051db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.895+0000 7fd2e2d7b700 1 --2- 172.21.15.63:0/2357824089 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd2bc04f8f0 0x7fd2bc051db0 secure :-1 s=READY pgs=583 cs=0 l=1 rx=0x7fd2d80021b0 tx=0x7fd2d8002760).stop 2020-05-18T21:33:44.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.895+0000 7fd2e2d7b700 1 -- 172.21.15.63:0/2357824089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2dc145ed0 msgr2=0x7fd2dc156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:44.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.895+0000 7fd2e2d7b700 1 --2- 172.21.15.63:0/2357824089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2dc145ed0 0x7fd2dc156ce0 secure :-1 s=READY pgs=1494 cs=0 l=1 rx=0x7fd2d40032f0 tx=0x7fd2d40110d0).stop 2020-05-18T21:33:44.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.895+0000 7fd2e2d7b700 1 -- 172.21.15.63:0/2357824089 shutdown_connections 2020-05-18T21:33:44.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.895+0000 7fd2e2d7b700 1 --2- 172.21.15.63:0/2357824089 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd2bc04f8f0 0x7fd2bc051db0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:44.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.895+0000 7fd2e2d7b700 1 --2- 172.21.15.63:0/2357824089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2dc145ed0 0x7fd2dc156ce0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:44.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.895+0000 7fd2e2d7b700 1 --2- 172.21.15.63:0/2357824089 >> v2:172.21.15.155:3300/0 conn(0x7fd2dc0b45f0 0x7fd2dc0b6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:44.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.895+0000 7fd2e2d7b700 1 -- 172.21.15.63:0/2357824089 >> 172.21.15.63:0/2357824089 conn(0x7fd2dc069fc0 msgr2=0x7fd2dc1433e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:44.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.895+0000 7fd2e2d7b700 1 -- 172.21.15.63:0/2357824089 shutdown_connections 2020-05-18T21:33:44.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:44.895+0000 7fd2e2d7b700 1 -- 172.21.15.63:0/2357824089 wait complete. 2020-05-18T21:33:44.909 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-05-18T21:33:44.909 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-05-18T21:33:45.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.015+0000 7f05ca68a700 1 Processor -- start 2020-05-18T21:33:45.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.015+0000 7f05ca68a700 1 -- start start 2020-05-18T21:33:45.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.015+0000 7f05ca68a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f05c4062d30 0x7f05c4063660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:45.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.015+0000 7f05ca68a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05c4143720 0x7f05c40afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:45.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.015+0000 7f05ca68a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c4143b80 con 0x7f05c41432e0 2020-05-18T21:33:45.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.015+0000 7f05ca68a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c40b49b0 con 0x7f05c4062d30 2020-05-18T21:33:45.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.015+0000 7f05ca68a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c405ed50 con 0x7f05c4143720 2020-05-18T21:33:45.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.015+0000 7f05c3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f05c4062d30 0x7f05c4063660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:45.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.015+0000 7f05c3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f05c4062d30 0x7f05c4063660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60936/0 (socket says 172.21.15.63:60936) 2020-05-18T21:33:45.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.015+0000 7f05c3fff700 1 -- 172.21.15.63:0/3017126070 learned_addr learned my addr 172.21.15.63:0/3017126070 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:45.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.015+0000 7f05c8c27700 1 --2- 172.21.15.63:0/3017126070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05c4143720 0x7f05c40afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:45.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05c2ffd700 1 -- 172.21.15.63:0/3017126070 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855477884 0 0) 0x7f05c4143b80 con 0x7f05c41432e0 2020-05-18T21:33:45.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05c2ffd700 1 -- 172.21.15.63:0/3017126070 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05a4003270 con 0x7f05c41432e0 2020-05-18T21:33:45.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05c3fff700 1 -- 172.21.15.63:0/3017126070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05c4143720 msgr2=0x7f05c40afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:45.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05c3fff700 1 --2- 172.21.15.63:0/3017126070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05c4143720 0x7f05c40afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:45.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05c3fff700 1 -- 172.21.15.63:0/3017126070 >> v1:172.21.15.155:6789/0 conn(0x7f05c41432e0 legacy=0x7f05c40af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:45.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05c3fff700 1 -- 172.21.15.63:0/3017126070 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c405eff0 con 0x7f05c4062d30 2020-05-18T21:33:45.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05c8c27700 1 --2- 172.21.15.63:0/3017126070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05c4143720 0x7f05c40afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:45.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05c3fff700 1 --2- 172.21.15.63:0/3017126070 >> v2:172.21.15.63:3300/0 conn(0x7f05c4062d30 0x7f05c4063660 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05c3fff700 1 --2- 172.21.15.63:0/3017126070 >> v2:172.21.15.63:3300/0 conn(0x7f05c4062d30 0x7f05c4063660 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05c3fff700 1 --2- 172.21.15.63:0/3017126070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05c4062d30 0x7f05c4063660 secure :-1 s=READY pgs=1495 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).ready entity=mon.0 client_cookie=461a0d53185aa17f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:45.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05c3fff700 1 --2- 172.21.15.63:0/3017126070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05c4062d30 0x7f05c4063660 secure :-1 s=THROTTLE_DONE pgs=1495 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05c3fff700 1 --2- 172.21.15.63:0/3017126070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05c4062d30 0x7f05c4063660 secure :-1 s=THROTTLE_DONE pgs=1495 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05c2ffd700 1 -- 172.21.15.63:0/3017126070 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05b4011600 con 0x7f05c4062d30 2020-05-18T21:33:45.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05c3fff700 1 --2- 172.21.15.63:0/3017126070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05c4062d30 0x7f05c4063660 secure :-1 s=THROTTLE_DONE pgs=1495 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05c2ffd700 1 -- 172.21.15.63:0/3017126070 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b4011760 con 0x7f05c4062d30 2020-05-18T21:33:45.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05c2ffd700 1 -- 172.21.15.63:0/3017126070 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05b4011b80 con 0x7f05c4062d30 2020-05-18T21:33:45.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05ca68a700 1 -- 172.21.15.63:0/3017126070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05c4062d30 msgr2=0x7f05c4063660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:45.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05ca68a700 1 --2- 172.21.15.63:0/3017126070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05c4062d30 0x7f05c4063660 secure :-1 s=READY pgs=1495 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).stop 2020-05-18T21:33:45.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05ca68a700 1 -- 172.21.15.63:0/3017126070 shutdown_connections 2020-05-18T21:33:45.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05ca68a700 1 --2- 172.21.15.63:0/3017126070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05c4143720 0x7f05c40afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:45.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05ca68a700 1 --2- 172.21.15.63:0/3017126070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05c4062d30 0x7f05c4063660 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:45.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05ca68a700 1 -- 172.21.15.63:0/3017126070 >> 172.21.15.63:0/3017126070 conn(0x7f05c40b7050 msgr2=0x7f05c40b7460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:45.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05ca68a700 1 -- 172.21.15.63:0/3017126070 shutdown_connections 2020-05-18T21:33:45.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05ca68a700 1 -- 172.21.15.63:0/3017126070 wait complete. 2020-05-18T21:33:45.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05ca68a700 1 Processor -- start 2020-05-18T21:33:45.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.019+0000 7f05ca68a700 1 -- start start 2020-05-18T21:33:45.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05ca68a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05c4062d30 0x7f05c413e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:45.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05ca68a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f05c41432e0 0x7f05c40b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:45.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05ca68a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c4061870 con 0x7f05c4143720 2020-05-18T21:33:45.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05ca68a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c4061b10 con 0x7f05c41432e0 2020-05-18T21:33:45.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05ca68a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c4061db0 con 0x7f05c4062d30 2020-05-18T21:33:45.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c37fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f05c41432e0 0x7f05c40b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:45.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c37fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f05c41432e0 0x7f05c40b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:47560/0 (socket says 172.21.15.63:47560) 2020-05-18T21:33:45.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c37fe700 1 -- 172.21.15.63:0/2583343564 learned_addr learned my addr 172.21.15.63:0/2583343564 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:45.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c3fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05c4062d30 0x7f05c413e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:45.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c37fe700 1 -- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05c4062d30 msgr2=0x7f05c413e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:45.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c37fe700 1 --2- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05c4062d30 0x7f05c413e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:45.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c37fe700 1 -- 172.21.15.63:0/2583343564 >> v1:172.21.15.155:6789/0 conn(0x7f05c4143720 legacy=0x7f05c4144af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:45.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c37fe700 1 -- 172.21.15.63:0/2583343564 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c4145200 con 0x7f05c41432e0 2020-05-18T21:33:45.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c37fe700 1 --2- 172.21.15.63:0/2583343564 >> v2:172.21.15.155:3300/0 conn(0x7f05c41432e0 0x7f05c40b40d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05ac0011d0 tx=0x7f05ac002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c37fe700 1 --2- 172.21.15.63:0/2583343564 >> v2:172.21.15.155:3300/0 conn(0x7f05c41432e0 0x7f05c40b40d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05ac0011d0 tx=0x7f05ac002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c37fe700 1 --2- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05c41432e0 0x7f05c40b40d0 secure :-1 s=READY pgs=1007 cs=0 l=1 rx=0x7f05ac0011d0 tx=0x7f05ac002eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:45.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c37fe700 1 --2- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05c41432e0 0x7f05c40b40d0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7f05ac0011d0 tx=0x7f05ac002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c17fa700 1 -- 172.21.15.63:0/2583343564 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05ac00c960 con 0x7f05c41432e0 2020-05-18T21:33:45.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c37fe700 1 --2- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05c41432e0 0x7f05c40b40d0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7f05ac0011d0 tx=0x7f05ac002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c17fa700 1 -- 172.21.15.63:0/2583343564 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac00cac0 con 0x7f05c41432e0 2020-05-18T21:33:45.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c37fe700 1 --2- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05c41432e0 0x7f05c40b40d0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7f05ac0011d0 tx=0x7f05ac002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05ca68a700 1 -- 172.21.15.63:0/2583343564 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c40b1cb0 con 0x7f05c41432e0 2020-05-18T21:33:45.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c17fa700 1 -- 172.21.15.63:0/2583343564 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05ac012470 con 0x7f05c41432e0 2020-05-18T21:33:45.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05ca68a700 1 -- 172.21.15.63:0/2583343564 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c40615e0 con 0x7f05c41432e0 2020-05-18T21:33:45.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c37fe700 1 --2- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05c41432e0 0x7f05c40b40d0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7f05ac0011d0 tx=0x7f05ac002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05ca68a700 1 -- 172.21.15.63:0/2583343564 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c40569e0 con 0x7f05c41432e0 2020-05-18T21:33:45.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c17fa700 1 -- 172.21.15.63:0/2583343564 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f05ac012730 con 0x7f05c41432e0 2020-05-18T21:33:45.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c37fe700 1 --2- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05c41432e0 0x7f05c40b40d0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7f05ac0011d0 tx=0x7f05ac002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c17fa700 1 --2- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05a804f900 0x7f05a8051dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:45.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.023+0000 7f05c17fa700 1 -- 172.21.15.63:0/2583343564 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f05ac063750 con 0x7f05c41432e0 2020-05-18T21:33:45.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.027+0000 7f05c3fff700 1 --2- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05a804f900 0x7f05a8051dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:45.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.027+0000 7f05c3fff700 1 --2- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05a804f900 0x7f05a8051dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.027+0000 7f05c3fff700 1 --2- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05a804f900 0x7f05a8051dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.027+0000 7f05c3fff700 1 --2- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05a804f900 0x7f05a8051dc0 secure :-1 s=READY pgs=584 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:45.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.035+0000 7f05c37fe700 1 --2- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05c41432e0 0x7f05c40b40d0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7f05ac0011d0 tx=0x7f05ac002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.035+0000 7f05c17fa700 1 -- 172.21.15.63:0/2583343564 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f05ac03db40 con 0x7f05c41432e0 2020-05-18T21:33:45.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.155+0000 7f05ca68a700 1 -- 172.21.15.63:0/2583343564 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f05c413eac0 con 0x7f05c41432e0 2020-05-18T21:33:45.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.315+0000 7f05c37fe700 1 --2- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05c41432e0 0x7f05c40b40d0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7f05ac0011d0 tx=0x7f05ac002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.315+0000 7f05c17fa700 1 -- 172.21.15.63:0/2583343564 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v110) v1 ==== 133+0+0 (secure 0 0 0) 0x7f05ac041160 con 0x7f05c41432e0 2020-05-18T21:33:45.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.319+0000 7f05ca68a700 1 -- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05a804f900 msgr2=0x7f05a8051dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:45.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.319+0000 7f05ca68a700 1 --2- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05a804f900 0x7f05a8051dc0 secure :-1 s=READY pgs=584 cs=0 l=1 rx=0x7f05b4002f70 tx=0x7f05b4007a80).stop 2020-05-18T21:33:45.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.319+0000 7f05ca68a700 1 -- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05c41432e0 msgr2=0x7f05c40b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:45.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.319+0000 7f05ca68a700 1 --2- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05c41432e0 0x7f05c40b40d0 secure :-1 s=READY pgs=1007 cs=0 l=1 rx=0x7f05ac0011d0 tx=0x7f05ac002eb0).stop 2020-05-18T21:33:45.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.319+0000 7f05ca68a700 1 -- 172.21.15.63:0/2583343564 shutdown_connections 2020-05-18T21:33:45.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.319+0000 7f05ca68a700 1 --2- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f05a804f900 0x7f05a8051dc0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:45.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.319+0000 7f05ca68a700 1 --2- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05c41432e0 0x7f05c40b40d0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:45.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.319+0000 7f05ca68a700 1 --2- 172.21.15.63:0/2583343564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05c4062d30 0x7f05c413e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:45.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.319+0000 7f05ca68a700 1 -- 172.21.15.63:0/2583343564 >> 172.21.15.63:0/2583343564 conn(0x7f05c40b7050 msgr2=0x7f05c40b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:45.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.319+0000 7f05ca68a700 1 -- 172.21.15.63:0/2583343564 shutdown_connections 2020-05-18T21:33:45.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.319+0000 7f05ca68a700 1 -- 172.21.15.63:0/2583343564 wait complete. 2020-05-18T21:33:45.325 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2020-05-18T21:33:45.335 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-05-18T21:33:45.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.443+0000 7fcab6100700 1 Processor -- start 2020-05-18T21:33:45.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.443+0000 7fcab6100700 1 -- start start 2020-05-18T21:33:45.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcab6100700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcab00b6d90 0x7fcab012ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:45.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcab6100700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab0060890 con 0x7fcab00b8630 2020-05-18T21:33:45.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcab6100700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab0060b30 con 0x7fcab00b9500 2020-05-18T21:33:45.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcab6100700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab0060dd0 con 0x7fcab00b6d90 2020-05-18T21:33:45.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcaaffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcab00b6d90 0x7fcab012ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:45.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcaaeffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcab00b8630 0x7fcab00b42b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34908/0 (socket says 172.21.15.63:34908) 2020-05-18T21:33:45.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcaaeffd700 1 -- 172.21.15.63:0/3807776742 learned_addr learned my addr 172.21.15.63:0/3807776742 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:45.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcaaffff700 1 -- 172.21.15.63:0/3807776742 >> v1:172.21.15.155:6789/0 conn(0x7fcab00b9500 legacy=0x7fcab0061270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:45.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcaaffff700 1 -- 172.21.15.63:0/3807776742 >> v1:172.21.15.63:6789/0 conn(0x7fcab00b8630 legacy=0x7fcab00b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:45.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcaae7fc700 1 -- 172.21.15.63:0/3807776742 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599546698 0 0) 0x7fcab0060890 con 0x7fcab00b8630 2020-05-18T21:33:45.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcaaffff700 1 -- 172.21.15.63:0/3807776742 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab00b98e0 con 0x7fcab00b6d90 2020-05-18T21:33:45.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcaaffff700 1 --2- 172.21.15.63:0/3807776742 >> v2:172.21.15.63:3300/0 conn(0x7fcab00b6d90 0x7fcab012ed60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcab00b8000 tx=0x7fcaa8008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcaaffff700 1 --2- 172.21.15.63:0/3807776742 >> v2:172.21.15.63:3300/0 conn(0x7fcab00b6d90 0x7fcab012ed60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcab00b8000 tx=0x7fcaa8008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcaaffff700 1 --2- 172.21.15.63:0/3807776742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcab00b6d90 0x7fcab012ed60 secure :-1 s=READY pgs=1497 cs=0 l=1 rx=0x7fcab00b8000 tx=0x7fcaa8008ca0).ready entity=mon.0 client_cookie=b2b04bcfddc41e9b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:45.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcaaffff700 1 --2- 172.21.15.63:0/3807776742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcab00b6d90 0x7fcab012ed60 secure :-1 s=THROTTLE_DONE pgs=1497 cs=0 l=1 rx=0x7fcab00b8000 tx=0x7fcaa8008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcaaffff700 1 --2- 172.21.15.63:0/3807776742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcab00b6d90 0x7fcab012ed60 secure :-1 s=THROTTLE_DONE pgs=1497 cs=0 l=1 rx=0x7fcab00b8000 tx=0x7fcaa8008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcaae7fc700 1 -- 172.21.15.63:0/3807776742 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaa800a180 con 0x7fcab00b6d90 2020-05-18T21:33:45.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcaaffff700 1 --2- 172.21.15.63:0/3807776742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcab00b6d90 0x7fcab012ed60 secure :-1 s=THROTTLE_DONE pgs=1497 cs=0 l=1 rx=0x7fcab00b8000 tx=0x7fcaa8008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcaae7fc700 1 -- 172.21.15.63:0/3807776742 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa800a2e0 con 0x7fcab00b6d90 2020-05-18T21:33:45.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcab6100700 1 -- 172.21.15.63:0/3807776742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcab00b6d90 msgr2=0x7fcab012ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:45.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcaae7fc700 1 -- 172.21.15.63:0/3807776742 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaa800a700 con 0x7fcab00b6d90 2020-05-18T21:33:45.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcab6100700 1 --2- 172.21.15.63:0/3807776742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcab00b6d90 0x7fcab012ed60 secure :-1 s=READY pgs=1497 cs=0 l=1 rx=0x7fcab00b8000 tx=0x7fcaa8008ca0).stop 2020-05-18T21:33:45.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcab6100700 1 -- 172.21.15.63:0/3807776742 shutdown_connections 2020-05-18T21:33:45.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcab6100700 1 --2- 172.21.15.63:0/3807776742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcab00b6d90 0x7fcab012ed60 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:45.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcab6100700 1 -- 172.21.15.63:0/3807776742 >> 172.21.15.63:0/3807776742 conn(0x7fcab0069b70 msgr2=0x7fcab0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:45.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcab6100700 1 -- 172.21.15.63:0/3807776742 shutdown_connections 2020-05-18T21:33:45.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcab6100700 1 -- 172.21.15.63:0/3807776742 wait complete. 2020-05-18T21:33:45.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcab6100700 1 Processor -- start 2020-05-18T21:33:45.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.447+0000 7fcab6100700 1 -- start start 2020-05-18T21:33:45.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcab6100700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcab00b6d90 0x7fcab012d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:45.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcab6100700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcab00b8630 0x7fcab0144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:45.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcab6100700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab0145440 con 0x7fcab00b9500 2020-05-18T21:33:45.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcab6100700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab01578c0 con 0x7fcab00b8630 2020-05-18T21:33:45.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcab6100700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab0156e50 con 0x7fcab00b6d90 2020-05-18T21:33:45.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcaaeffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcab00b8630 0x7fcab0144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:45.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcaaeffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcab00b8630 0x7fcab0144be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60960/0 (socket says 172.21.15.63:60960) 2020-05-18T21:33:45.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcaaf7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcab00b6d90 0x7fcab012d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:45.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcaaeffd700 1 -- 172.21.15.63:0/1924099740 learned_addr learned my addr 172.21.15.63:0/1924099740 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:45.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcaacff9700 1 -- 172.21.15.63:0/1924099740 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135946900 0 0) 0x7fcab0145440 con 0x7fcab00b9500 2020-05-18T21:33:45.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcaaeffd700 1 -- 172.21.15.63:0/1924099740 >> v2:172.21.15.155:3300/0 conn(0x7fcab00b6d90 msgr2=0x7fcab012d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:45.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcaaeffd700 1 --2- 172.21.15.63:0/1924099740 >> v2:172.21.15.155:3300/0 conn(0x7fcab00b6d90 0x7fcab012d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:45.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcaaeffd700 1 -- 172.21.15.63:0/1924099740 >> v1:172.21.15.155:6789/0 conn(0x7fcab00b9500 legacy=0x7fcab00af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:45.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcaaeffd700 1 -- 172.21.15.63:0/1924099740 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab01570f0 con 0x7fcab00b8630 2020-05-18T21:33:45.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcaaeffd700 1 --2- 172.21.15.63:0/1924099740 >> v2:172.21.15.63:3300/0 conn(0x7fcab00b8630 0x7fcab0144be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcaa4000bc0 tx=0x7fcaa4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcaaeffd700 1 --2- 172.21.15.63:0/1924099740 >> v2:172.21.15.63:3300/0 conn(0x7fcab00b8630 0x7fcab0144be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcaa4000bc0 tx=0x7fcaa4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcaaeffd700 1 --2- 172.21.15.63:0/1924099740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcab00b8630 0x7fcab0144be0 secure :-1 s=READY pgs=1498 cs=0 l=1 rx=0x7fcaa4000bc0 tx=0x7fcaa4010960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:45.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcaaeffd700 1 --2- 172.21.15.63:0/1924099740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcab00b8630 0x7fcab0144be0 secure :-1 s=THROTTLE_DONE pgs=1498 cs=0 l=1 rx=0x7fcaa4000bc0 tx=0x7fcaa4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcaacff9700 1 -- 172.21.15.63:0/1924099740 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaa4005ce0 con 0x7fcab00b8630 2020-05-18T21:33:45.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcaaeffd700 1 --2- 172.21.15.63:0/1924099740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcab00b8630 0x7fcab0144be0 secure :-1 s=THROTTLE_DONE pgs=1498 cs=0 l=1 rx=0x7fcaa4000bc0 tx=0x7fcaa4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcaacff9700 1 -- 172.21.15.63:0/1924099740 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa4005e40 con 0x7fcab00b8630 2020-05-18T21:33:45.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcaaeffd700 1 --2- 172.21.15.63:0/1924099740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcab00b8630 0x7fcab0144be0 secure :-1 s=THROTTLE_DONE pgs=1498 cs=0 l=1 rx=0x7fcaa4000bc0 tx=0x7fcaa4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcab6100700 1 -- 172.21.15.63:0/1924099740 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab0157390 con 0x7fcab00b8630 2020-05-18T21:33:45.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcaacff9700 1 -- 172.21.15.63:0/1924099740 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaa40062c0 con 0x7fcab00b8630 2020-05-18T21:33:45.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcab6100700 1 -- 172.21.15.63:0/1924099740 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab00b0000 con 0x7fcab00b8630 2020-05-18T21:33:45.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.451+0000 7fcaaeffd700 1 --2- 172.21.15.63:0/1924099740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcab00b8630 0x7fcab0144be0 secure :-1 s=THROTTLE_DONE pgs=1498 cs=0 l=1 rx=0x7fcaa4000bc0 tx=0x7fcaa4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.455+0000 7fcab6100700 1 -- 172.21.15.63:0/1924099740 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab00569e0 con 0x7fcab00b8630 2020-05-18T21:33:45.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.455+0000 7fcaacff9700 1 -- 172.21.15.63:0/1924099740 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fcaa4006500 con 0x7fcab00b8630 2020-05-18T21:33:45.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.455+0000 7fcaaeffd700 1 --2- 172.21.15.63:0/1924099740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcab00b8630 0x7fcab0144be0 secure :-1 s=THROTTLE_DONE pgs=1498 cs=0 l=1 rx=0x7fcaa4000bc0 tx=0x7fcaa4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.455+0000 7fcaacff9700 1 --2- 172.21.15.63:0/1924099740 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9004f810 0x7fca90051cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:45.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.455+0000 7fcaacff9700 1 -- 172.21.15.63:0/1924099740 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fcaa40090c0 con 0x7fcab00b8630 2020-05-18T21:33:45.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.455+0000 7fcaaf7fe700 1 --2- 172.21.15.63:0/1924099740 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9004f810 0x7fca90051cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:45.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.455+0000 7fcaaf7fe700 1 --2- 172.21.15.63:0/1924099740 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9004f810 0x7fca90051cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcab0043320 tx=0x7fcaa0003e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.455+0000 7fcaaf7fe700 1 --2- 172.21.15.63:0/1924099740 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9004f810 0x7fca90051cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcab0043320 tx=0x7fcaa0003e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.455+0000 7fcaaf7fe700 1 --2- 172.21.15.63:0/1924099740 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9004f810 0x7fca90051cd0 secure :-1 s=READY pgs=585 cs=0 l=1 rx=0x7fcab0043320 tx=0x7fcaa0003e40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:45.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.459+0000 7fcaaeffd700 1 --2- 172.21.15.63:0/1924099740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcab00b8630 0x7fcab0144be0 secure :-1 s=THROTTLE_DONE pgs=1498 cs=0 l=1 rx=0x7fcaa4000bc0 tx=0x7fcaa4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:45.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.459+0000 7fcaacff9700 1 -- 172.21.15.63:0/1924099740 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fcaa403e1d0 con 0x7fcab00b8630 2020-05-18T21:33:45.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:45.575+0000 7fcab6100700 1 -- 172.21.15.63:0/1924099740 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fcab012d9a0 con 0x7fcab00b8630 2020-05-18T21:33:46.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.319+0000 7fcaaeffd700 1 --2- 172.21.15.63:0/1924099740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcab00b8630 0x7fcab0144be0 secure :-1 s=THROTTLE_DONE pgs=1498 cs=0 l=1 rx=0x7fcaa4000bc0 tx=0x7fcaa4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.319+0000 7fcaacff9700 1 -- 172.21.15.63:0/1924099740 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v111) v1 ==== 125+0+0 (secure 0 0 0) 0x7fcaa40417f0 con 0x7fcab00b8630 2020-05-18T21:33:46.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.323+0000 7fcab6100700 1 -- 172.21.15.63:0/1924099740 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9004f810 msgr2=0x7fca90051cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:46.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.323+0000 7fcab6100700 1 --2- 172.21.15.63:0/1924099740 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9004f810 0x7fca90051cd0 secure :-1 s=READY pgs=585 cs=0 l=1 rx=0x7fcab0043320 tx=0x7fcaa0003e40).stop 2020-05-18T21:33:46.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.323+0000 7fcab6100700 1 -- 172.21.15.63:0/1924099740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcab00b8630 msgr2=0x7fcab0144be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:46.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.323+0000 7fcab6100700 1 --2- 172.21.15.63:0/1924099740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcab00b8630 0x7fcab0144be0 secure :-1 s=READY pgs=1498 cs=0 l=1 rx=0x7fcaa4000bc0 tx=0x7fcaa4010960).stop 2020-05-18T21:33:46.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.323+0000 7fcab6100700 1 -- 172.21.15.63:0/1924099740 shutdown_connections 2020-05-18T21:33:46.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.323+0000 7fcab6100700 1 --2- 172.21.15.63:0/1924099740 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9004f810 0x7fca90051cd0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:46.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.323+0000 7fcab6100700 1 --2- 172.21.15.63:0/1924099740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcab00b8630 0x7fcab0144be0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:46.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.323+0000 7fcab6100700 1 --2- 172.21.15.63:0/1924099740 >> v2:172.21.15.155:3300/0 conn(0x7fcab00b6d90 0x7fcab012d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:46.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.323+0000 7fcab6100700 1 -- 172.21.15.63:0/1924099740 >> 172.21.15.63:0/1924099740 conn(0x7fcab0069b70 msgr2=0x7fcab00bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:46.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.323+0000 7fcab6100700 1 -- 172.21.15.63:0/1924099740 shutdown_connections 2020-05-18T21:33:46.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.323+0000 7fcab6100700 1 -- 172.21.15.63:0/1924099740 wait complete. 2020-05-18T21:33:46.328 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2020-05-18T21:33:46.339 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-05-18T21:33:46.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.439+0000 7f123020f700 1 Processor -- start 2020-05-18T21:33:46.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.443+0000 7f123020f700 1 -- start start 2020-05-18T21:33:46.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.443+0000 7f123020f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f12280b9540 0x7f122806a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:46.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.443+0000 7f123020f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1228143100 0x7f1228143570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:46.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.443+0000 7f123020f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1228146fa0 con 0x7f1228146ac0 2020-05-18T21:33:46.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.443+0000 7f123020f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12280b59c0 con 0x7f12280b9540 2020-05-18T21:33:46.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.443+0000 7f123020f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12280b5c60 con 0x7f1228143100 2020-05-18T21:33:46.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.443+0000 7f122dfab700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f12280b9540 0x7f122806a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:46.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.443+0000 7f122dfab700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f12280b9540 0x7f122806a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60964/0 (socket says 172.21.15.63:60964) 2020-05-18T21:33:46.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.443+0000 7f122dfab700 1 -- 172.21.15.63:0/2877331806 learned_addr learned my addr 172.21.15.63:0/2877331806 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:46.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.443+0000 7f122e7ac700 1 --2- 172.21.15.63:0/2877331806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1228143100 0x7f1228143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:46.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.443+0000 7f122dfab700 1 -- 172.21.15.63:0/2877331806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1228143100 msgr2=0x7f1228143570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:46.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.443+0000 7f122dfab700 1 --2- 172.21.15.63:0/2877331806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1228143100 0x7f1228143570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:46.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.443+0000 7f122dfab700 1 -- 172.21.15.63:0/2877331806 >> v1:172.21.15.155:6789/0 conn(0x7f1228146ac0 legacy=0x7f12280b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:46.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.443+0000 7f122dfab700 1 -- 172.21.15.63:0/2877331806 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12280b6810 con 0x7f12280b9540 2020-05-18T21:33:46.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.443+0000 7f122e7ac700 1 --2- 172.21.15.63:0/2877331806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1228143100 0x7f1228143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:33:46.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.443+0000 7f122dfab700 1 --2- 172.21.15.63:0/2877331806 >> v2:172.21.15.63:3300/0 conn(0x7f12280b9540 0x7f122806a280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f12200032f0 tx=0x7f1220007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.443+0000 7f122dfab700 1 --2- 172.21.15.63:0/2877331806 >> v2:172.21.15.63:3300/0 conn(0x7f12280b9540 0x7f122806a280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f12200032f0 tx=0x7f1220007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.443+0000 7f122dfab700 1 --2- 172.21.15.63:0/2877331806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12280b9540 0x7f122806a280 secure :-1 s=READY pgs=1499 cs=0 l=1 rx=0x7f12200032f0 tx=0x7f1220007e00).ready entity=mon.0 client_cookie=d093a28a56dd41f9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:46.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.447+0000 7f122dfab700 1 --2- 172.21.15.63:0/2877331806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12280b9540 0x7f122806a280 secure :-1 s=THROTTLE_DONE pgs=1499 cs=0 l=1 rx=0x7f12200032f0 tx=0x7f1220007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.447+0000 7f122cfa9700 1 -- 172.21.15.63:0/2877331806 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1220011dc0 con 0x7f12280b9540 2020-05-18T21:33:46.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.451+0000 7f122dfab700 1 --2- 172.21.15.63:0/2877331806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12280b9540 0x7f122806a280 secure :-1 s=THROTTLE_DONE pgs=1499 cs=0 l=1 rx=0x7f12200032f0 tx=0x7f1220007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.451+0000 7f122dfab700 1 --2- 172.21.15.63:0/2877331806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12280b9540 0x7f122806a280 secure :-1 s=THROTTLE_DONE pgs=1499 cs=0 l=1 rx=0x7f12200032f0 tx=0x7f1220007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.451+0000 7f122cfa9700 1 -- 172.21.15.63:0/2877331806 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122000a180 con 0x7f12280b9540 2020-05-18T21:33:46.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.451+0000 7f122cfa9700 1 -- 172.21.15.63:0/2877331806 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f122000a5a0 con 0x7f12280b9540 2020-05-18T21:33:46.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.451+0000 7f123020f700 1 -- 172.21.15.63:0/2877331806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12280b9540 msgr2=0x7f122806a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:46.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.451+0000 7f123020f700 1 --2- 172.21.15.63:0/2877331806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12280b9540 0x7f122806a280 secure :-1 s=READY pgs=1499 cs=0 l=1 rx=0x7f12200032f0 tx=0x7f1220007e00).stop 2020-05-18T21:33:46.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.451+0000 7f123020f700 1 -- 172.21.15.63:0/2877331806 shutdown_connections 2020-05-18T21:33:46.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.451+0000 7f123020f700 1 --2- 172.21.15.63:0/2877331806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1228143100 0x7f1228143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:46.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.451+0000 7f123020f700 1 --2- 172.21.15.63:0/2877331806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12280b9540 0x7f122806a280 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:46.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.451+0000 7f123020f700 1 -- 172.21.15.63:0/2877331806 >> 172.21.15.63:0/2877331806 conn(0x7f122805f2e0 msgr2=0x7f1228069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:46.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.451+0000 7f123020f700 1 -- 172.21.15.63:0/2877331806 shutdown_connections 2020-05-18T21:33:46.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.451+0000 7f123020f700 1 -- 172.21.15.63:0/2877331806 wait complete. 2020-05-18T21:33:46.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.451+0000 7f123020f700 1 Processor -- start 2020-05-18T21:33:46.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.451+0000 7f123020f700 1 -- start start 2020-05-18T21:33:46.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.455+0000 7f123020f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f12280b9540 0x7f12280aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:46.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.455+0000 7f123020f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1228146ac0 0x7f1228157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:46.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.455+0000 7f123020f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1228065220 con 0x7f1228143100 2020-05-18T21:33:46.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.455+0000 7f123020f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12280654c0 con 0x7f12280b9540 2020-05-18T21:33:46.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.455+0000 7f123020f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1228064720 con 0x7f1228146ac0 2020-05-18T21:33:46.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.455+0000 7f122dfab700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f12280b9540 0x7f12280aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:46.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.455+0000 7f122dfab700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f12280b9540 0x7f12280aec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60970/0 (socket says 172.21.15.63:60970) 2020-05-18T21:33:46.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.455+0000 7f122dfab700 1 -- 172.21.15.63:0/3819500720 learned_addr learned my addr 172.21.15.63:0/3819500720 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:46.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.455+0000 7f122dfab700 1 -- 172.21.15.63:0/3819500720 >> v2:172.21.15.155:3300/0 conn(0x7f1228146ac0 msgr2=0x7f1228157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:46.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.455+0000 7f122dfab700 1 --2- 172.21.15.63:0/3819500720 >> v2:172.21.15.155:3300/0 conn(0x7f1228146ac0 0x7f1228157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:46.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.455+0000 7f122dfab700 1 -- 172.21.15.63:0/3819500720 >> v1:172.21.15.63:6789/0 conn(0x7f1228143100 legacy=0x7f1228145550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:46.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.455+0000 7f122dfab700 1 -- 172.21.15.63:0/3819500720 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1228064890 con 0x7f12280b9540 2020-05-18T21:33:46.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.455+0000 7f122dfab700 1 --2- 172.21.15.63:0/3819500720 >> v2:172.21.15.63:3300/0 conn(0x7f12280b9540 0x7f12280aec70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f12200032f0 tx=0x7f1220007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.455+0000 7f122dfab700 1 --2- 172.21.15.63:0/3819500720 >> v2:172.21.15.63:3300/0 conn(0x7f12280b9540 0x7f12280aec70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f12200032f0 tx=0x7f1220007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.455+0000 7f122dfab700 1 --2- 172.21.15.63:0/3819500720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12280b9540 0x7f12280aec70 secure :-1 s=READY pgs=1501 cs=0 l=1 rx=0x7f12200032f0 tx=0x7f1220007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:46.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.459+0000 7f122dfab700 1 --2- 172.21.15.63:0/3819500720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12280b9540 0x7f12280aec70 secure :-1 s=THROTTLE_DONE pgs=1501 cs=0 l=1 rx=0x7f12200032f0 tx=0x7f1220007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.459+0000 7f1216ffd700 1 -- 172.21.15.63:0/3819500720 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1220011e80 con 0x7f12280b9540 2020-05-18T21:33:46.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.459+0000 7f123020f700 1 -- 172.21.15.63:0/3819500720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1228064b50 con 0x7f12280b9540 2020-05-18T21:33:46.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.459+0000 7f122dfab700 1 --2- 172.21.15.63:0/3819500720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12280b9540 0x7f12280aec70 secure :-1 s=THROTTLE_DONE pgs=1501 cs=0 l=1 rx=0x7f12200032f0 tx=0x7f1220007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.459+0000 7f123020f700 1 -- 172.21.15.63:0/3819500720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1228158010 con 0x7f12280b9540 2020-05-18T21:33:46.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.459+0000 7f122dfab700 1 --2- 172.21.15.63:0/3819500720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12280b9540 0x7f12280aec70 secure :-1 s=THROTTLE_DONE pgs=1501 cs=0 l=1 rx=0x7f12200032f0 tx=0x7f1220007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.459+0000 7f1216ffd700 1 -- 172.21.15.63:0/3819500720 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1220005c70 con 0x7f12280b9540 2020-05-18T21:33:46.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.459+0000 7f1216ffd700 1 -- 172.21.15.63:0/3819500720 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f122000f5b0 con 0x7f12280b9540 2020-05-18T21:33:46.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.459+0000 7f123020f700 1 -- 172.21.15.63:0/3819500720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1204003380 con 0x7f12280b9540 2020-05-18T21:33:46.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.459+0000 7f122dfab700 1 --2- 172.21.15.63:0/3819500720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12280b9540 0x7f12280aec70 secure :-1 s=THROTTLE_DONE pgs=1501 cs=0 l=1 rx=0x7f12200032f0 tx=0x7f1220007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.459+0000 7f1216ffd700 1 -- 172.21.15.63:0/3819500720 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f122000f7e0 con 0x7f12280b9540 2020-05-18T21:33:46.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.459+0000 7f122dfab700 1 --2- 172.21.15.63:0/3819500720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12280b9540 0x7f12280aec70 secure :-1 s=THROTTLE_DONE pgs=1501 cs=0 l=1 rx=0x7f12200032f0 tx=0x7f1220007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.459+0000 7f1216ffd700 1 --2- 172.21.15.63:0/3819500720 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f120804fa90 0x7f1208051f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:46.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.459+0000 7f1216ffd700 1 -- 172.21.15.63:0/3819500720 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f1220064b10 con 0x7f12280b9540 2020-05-18T21:33:46.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.459+0000 7f122d7aa700 1 --2- 172.21.15.63:0/3819500720 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f120804fa90 0x7f1208051f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:46.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.463+0000 7f122d7aa700 1 --2- 172.21.15.63:0/3819500720 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f120804fa90 0x7f1208051f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1228063ea0 tx=0x7f1224002610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.463+0000 7f122d7aa700 1 --2- 172.21.15.63:0/3819500720 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f120804fa90 0x7f1208051f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1228063ea0 tx=0x7f1224002610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.463+0000 7f122d7aa700 1 --2- 172.21.15.63:0/3819500720 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f120804fa90 0x7f1208051f50 secure :-1 s=READY pgs=586 cs=0 l=1 rx=0x7f1228063ea0 tx=0x7f1224002610).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:46.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.463+0000 7f122dfab700 1 --2- 172.21.15.63:0/3819500720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12280b9540 0x7f12280aec70 secure :-1 s=THROTTLE_DONE pgs=1501 cs=0 l=1 rx=0x7f12200032f0 tx=0x7f1220007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.463+0000 7f1216ffd700 1 -- 172.21.15.63:0/3819500720 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f122003ef60 con 0x7f12280b9540 2020-05-18T21:33:46.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.611+0000 7f123020f700 1 -- 172.21.15.63:0/3819500720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f12040022a0 con 0x7f12280b9540 2020-05-18T21:33:46.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.619+0000 7f122dfab700 1 --2- 172.21.15.63:0/3819500720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12280b9540 0x7f12280aec70 secure :-1 s=THROTTLE_DONE pgs=1501 cs=0 l=1 rx=0x7f12200032f0 tx=0x7f1220007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.619+0000 7f1216ffd700 1 -- 172.21.15.63:0/3819500720 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 21 and data pool 22 v85) v1 ==== 189+0+0 (secure 0 0 0) 0x7f1220042580 con 0x7f12280b9540 2020-05-18T21:33:46.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.623+0000 7f123020f700 1 -- 172.21.15.63:0/3819500720 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f120804fa90 msgr2=0x7f1208051f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:46.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.623+0000 7f123020f700 1 --2- 172.21.15.63:0/3819500720 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f120804fa90 0x7f1208051f50 secure :-1 s=READY pgs=586 cs=0 l=1 rx=0x7f1228063ea0 tx=0x7f1224002610).stop 2020-05-18T21:33:46.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.623+0000 7f123020f700 1 -- 172.21.15.63:0/3819500720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12280b9540 msgr2=0x7f12280aec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:46.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.623+0000 7f123020f700 1 --2- 172.21.15.63:0/3819500720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12280b9540 0x7f12280aec70 secure :-1 s=READY pgs=1501 cs=0 l=1 rx=0x7f12200032f0 tx=0x7f1220007e00).stop 2020-05-18T21:33:46.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.623+0000 7f123020f700 1 -- 172.21.15.63:0/3819500720 shutdown_connections 2020-05-18T21:33:46.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.623+0000 7f123020f700 1 --2- 172.21.15.63:0/3819500720 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f120804fa90 0x7f1208051f50 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:46.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.623+0000 7f123020f700 1 --2- 172.21.15.63:0/3819500720 >> v2:172.21.15.155:3300/0 conn(0x7f1228146ac0 0x7f1228157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:46.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.623+0000 7f123020f700 1 --2- 172.21.15.63:0/3819500720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12280b9540 0x7f12280aec70 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:46.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.623+0000 7f123020f700 1 -- 172.21.15.63:0/3819500720 >> 172.21.15.63:0/3819500720 conn(0x7f122805f2e0 msgr2=0x7f1228069c00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:46.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.623+0000 7f123020f700 1 -- 172.21.15.63:0/3819500720 shutdown_connections 2020-05-18T21:33:46.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.623+0000 7f123020f700 1 -- 172.21.15.63:0/3819500720 wait complete. 2020-05-18T21:33:46.630 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 21 and data pool 22 2020-05-18T21:33:46.642 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:33:46.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb7a49700 1 Processor -- start 2020-05-18T21:33:46.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb7a49700 1 -- start start 2020-05-18T21:33:46.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb7a49700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4fb00bb5e0 0x7f4fb00acee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:46.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb7a49700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4fb00bbcd0 0x7f4fb00afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:46.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb7a49700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb00af980 con 0x7f4fb00b0280 2020-05-18T21:33:46.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb7a49700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb00af770 con 0x7f4fb00bbcd0 2020-05-18T21:33:46.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb7a49700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb00bb9c0 con 0x7f4fb00bb5e0 2020-05-18T21:33:46.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb5fe6700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4fb00b0280 0x7f4fb012efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34950/0 (socket says 172.21.15.63:34950) 2020-05-18T21:33:46.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb5fe6700 1 -- 172.21.15.63:0/103394803 learned_addr learned my addr 172.21.15.63:0/103394803 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:46.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb4fe4700 1 --2- 172.21.15.63:0/103394803 >> v2:172.21.15.63:3300/0 conn(0x7f4fb00bbcd0 0x7f4fb00afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:46.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb57e5700 1 --2- 172.21.15.63:0/103394803 >> v2:172.21.15.155:3300/0 conn(0x7f4fb00bb5e0 0x7f4fb00acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:46.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fa7fff700 1 -- 172.21.15.63:0/103394803 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73860707 0 0) 0x7f4fb00af980 con 0x7f4fb00b0280 2020-05-18T21:33:46.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fa7fff700 1 -- 172.21.15.63:0/103394803 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f94003270 con 0x7f4fb00b0280 2020-05-18T21:33:46.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb4fe4700 1 -- 172.21.15.63:0/103394803 >> v2:172.21.15.155:3300/0 conn(0x7f4fb00bb5e0 msgr2=0x7f4fb00acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:46.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb4fe4700 1 --2- 172.21.15.63:0/103394803 >> v2:172.21.15.155:3300/0 conn(0x7f4fb00bb5e0 0x7f4fb00acee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:46.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb4fe4700 1 -- 172.21.15.63:0/103394803 >> v1:172.21.15.63:6789/0 conn(0x7f4fb00b0280 legacy=0x7f4fb012efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:46.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb4fe4700 1 -- 172.21.15.63:0/103394803 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb00af3d0 con 0x7f4fb00bbcd0 2020-05-18T21:33:46.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb4fe4700 1 --2- 172.21.15.63:0/103394803 >> v2:172.21.15.63:3300/0 conn(0x7f4fb00bbcd0 0x7f4fb00afe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4fa0002f70 tx=0x7f4fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb4fe4700 1 --2- 172.21.15.63:0/103394803 >> v2:172.21.15.63:3300/0 conn(0x7f4fb00bbcd0 0x7f4fb00afe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4fa0002f70 tx=0x7f4fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb4fe4700 1 --2- 172.21.15.63:0/103394803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb00bbcd0 0x7f4fb00afe20 secure :-1 s=READY pgs=1503 cs=0 l=1 rx=0x7f4fa0002f70 tx=0x7f4fa0007a80).ready entity=mon.0 client_cookie=28b0842616a65205 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:46.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb4fe4700 1 --2- 172.21.15.63:0/103394803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb00bbcd0 0x7f4fb00afe20 secure :-1 s=THROTTLE_DONE pgs=1503 cs=0 l=1 rx=0x7f4fa0002f70 tx=0x7f4fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fa7fff700 1 -- 172.21.15.63:0/103394803 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fa0008e50 con 0x7f4fb00bbcd0 2020-05-18T21:33:46.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb4fe4700 1 --2- 172.21.15.63:0/103394803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb00bbcd0 0x7f4fb00afe20 secure :-1 s=THROTTLE_DONE pgs=1503 cs=0 l=1 rx=0x7f4fa0002f70 tx=0x7f4fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fa7fff700 1 -- 172.21.15.63:0/103394803 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa0011540 con 0x7f4fb00bbcd0 2020-05-18T21:33:46.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb4fe4700 1 --2- 172.21.15.63:0/103394803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb00bbcd0 0x7f4fb00afe20 secure :-1 s=THROTTLE_DONE pgs=1503 cs=0 l=1 rx=0x7f4fa0002f70 tx=0x7f4fa0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb7a49700 1 -- 172.21.15.63:0/103394803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb00bbcd0 msgr2=0x7f4fb00afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:46.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fa7fff700 1 -- 172.21.15.63:0/103394803 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fa0011920 con 0x7f4fb00bbcd0 2020-05-18T21:33:46.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.731+0000 7f4fb7a49700 1 --2- 172.21.15.63:0/103394803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb00bbcd0 0x7f4fb00afe20 secure :-1 s=READY pgs=1503 cs=0 l=1 rx=0x7f4fa0002f70 tx=0x7f4fa0007a80).stop 2020-05-18T21:33:46.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb7a49700 1 -- 172.21.15.63:0/103394803 shutdown_connections 2020-05-18T21:33:46.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb7a49700 1 --2- 172.21.15.63:0/103394803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb00bbcd0 0x7f4fb00afe20 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:46.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb7a49700 1 --2- 172.21.15.63:0/103394803 >> v2:172.21.15.155:3300/0 conn(0x7f4fb00bb5e0 0x7f4fb00acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:46.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb7a49700 1 -- 172.21.15.63:0/103394803 >> 172.21.15.63:0/103394803 conn(0x7f4fb0069b70 msgr2=0x7f4fb0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:46.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb7a49700 1 -- 172.21.15.63:0/103394803 shutdown_connections 2020-05-18T21:33:46.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb7a49700 1 -- 172.21.15.63:0/103394803 wait complete. 2020-05-18T21:33:46.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb7a49700 1 Processor -- start 2020-05-18T21:33:46.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb7a49700 1 -- start start 2020-05-18T21:33:46.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb7a49700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fb00bb5e0 0x7f4fb0153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:46.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb7a49700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4fb00bbcd0 0x7f4fb00b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:46.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb7a49700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb00b4510 con 0x7f4fb00b0280 2020-05-18T21:33:46.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb7a49700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb00b4300 con 0x7f4fb00bbcd0 2020-05-18T21:33:46.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb7a49700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb00b47b0 con 0x7f4fb00bb5e0 2020-05-18T21:33:46.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb5fe6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4fb00bbcd0 0x7f4fb00b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:46.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb5fe6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4fb00bbcd0 0x7f4fb00b62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32768/0 (socket says 172.21.15.63:32768) 2020-05-18T21:33:46.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb5fe6700 1 -- 172.21.15.63:0/4081239114 learned_addr learned my addr 172.21.15.63:0/4081239114 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:46.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb4fe4700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fb00bb5e0 0x7f4fb0153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:46.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb5fe6700 1 -- 172.21.15.63:0/4081239114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fb00bb5e0 msgr2=0x7f4fb0153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:46.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb5fe6700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fb00bb5e0 0x7f4fb0153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:46.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb5fe6700 1 -- 172.21.15.63:0/4081239114 >> v1:172.21.15.155:6789/0 conn(0x7f4fb00b0280 legacy=0x7f4fb01454f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:46.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb5fe6700 1 -- 172.21.15.63:0/4081239114 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb00b8a70 con 0x7f4fb00bbcd0 2020-05-18T21:33:46.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb5fe6700 1 --2- 172.21.15.63:0/4081239114 >> v2:172.21.15.63:3300/0 conn(0x7f4fb00bbcd0 0x7f4fb00b62a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4fa8001490 tx=0x7f4fa8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb5fe6700 1 --2- 172.21.15.63:0/4081239114 >> v2:172.21.15.63:3300/0 conn(0x7f4fb00bbcd0 0x7f4fb00b62a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4fa8001490 tx=0x7f4fa8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb5fe6700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb00bbcd0 0x7f4fb00b62a0 secure :-1 s=READY pgs=1504 cs=0 l=1 rx=0x7f4fa8001490 tx=0x7f4fa8010d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:46.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb5fe6700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb00bbcd0 0x7f4fb00b62a0 secure :-1 s=THROTTLE_DONE pgs=1504 cs=0 l=1 rx=0x7f4fa8001490 tx=0x7f4fa8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb5fe6700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb00bbcd0 0x7f4fb00b62a0 secure :-1 s=THROTTLE_DONE pgs=1504 cs=0 l=1 rx=0x7f4fa8001490 tx=0x7f4fa8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb5fe6700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb00bbcd0 0x7f4fb00b62a0 secure :-1 s=THROTTLE_DONE pgs=1504 cs=0 l=1 rx=0x7f4fa8001490 tx=0x7f4fa8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fa67fc700 1 -- 172.21.15.63:0/4081239114 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fa8005e20 con 0x7f4fb00bbcd0 2020-05-18T21:33:46.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fa67fc700 1 -- 172.21.15.63:0/4081239114 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa80127c0 con 0x7f4fb00bbcd0 2020-05-18T21:33:46.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb7a49700 1 -- 172.21.15.63:0/4081239114 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb0145c00 con 0x7f4fb00bbcd0 2020-05-18T21:33:46.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fa67fc700 1 -- 172.21.15.63:0/4081239114 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fa8012be0 con 0x7f4fb00bbcd0 2020-05-18T21:33:46.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.735+0000 7f4fb7a49700 1 -- 172.21.15.63:0/4081239114 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb00b3f70 con 0x7f4fb00bbcd0 2020-05-18T21:33:46.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.739+0000 7f4fb5fe6700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb00bbcd0 0x7f4fb00b62a0 secure :-1 s=THROTTLE_DONE pgs=1504 cs=0 l=1 rx=0x7f4fa8001490 tx=0x7f4fa8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.739+0000 7f4fb7a49700 1 -- 172.21.15.63:0/4081239114 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb00569e0 con 0x7f4fb00bbcd0 2020-05-18T21:33:46.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.739+0000 7f4fa67fc700 1 -- 172.21.15.63:0/4081239114 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4fa80113c0 con 0x7f4fb00bbcd0 2020-05-18T21:33:46.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.739+0000 7f4fb5fe6700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb00bbcd0 0x7f4fb00b62a0 secure :-1 s=THROTTLE_DONE pgs=1504 cs=0 l=1 rx=0x7f4fa8001490 tx=0x7f4fa8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.739+0000 7f4fa67fc700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f9804fa60 0x7f4f98051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:46.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.739+0000 7f4fa67fc700 1 -- 172.21.15.63:0/4081239114 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4fa800a0b0 con 0x7f4fb00bbcd0 2020-05-18T21:33:46.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.739+0000 7f4fb57e5700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f9804fa60 0x7f4f98051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:46.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.739+0000 7f4fb57e5700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f9804fa60 0x7f4f98051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4fb0147920 tx=0x7f4fac007740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.739+0000 7f4fb57e5700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f9804fa60 0x7f4f98051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4fb0147920 tx=0x7f4fac007740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.739+0000 7f4fb57e5700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f9804fa60 0x7f4f98051f20 secure :-1 s=READY pgs=588 cs=0 l=1 rx=0x7f4fb0147920 tx=0x7f4fac007740).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:46.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.747+0000 7f4fb5fe6700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb00bbcd0 0x7f4fb00b62a0 secure :-1 s=THROTTLE_DONE pgs=1504 cs=0 l=1 rx=0x7f4fa8001490 tx=0x7f4fa8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.747+0000 7f4fa67fc700 1 -- 172.21.15.63:0/4081239114 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f4fa803e900 con 0x7f4fb00bbcd0 2020-05-18T21:33:46.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.863+0000 7f4fb7a49700 1 -- 172.21.15.63:0/4081239114 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fb006aac0 con 0x7f4fb00bbcd0 2020-05-18T21:33:46.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.863+0000 7f4fb5fe6700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb00bbcd0 0x7f4fb00b62a0 secure :-1 s=THROTTLE_DONE pgs=1504 cs=0 l=1 rx=0x7f4fa8001490 tx=0x7f4fa8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.863+0000 7f4fa67fc700 1 -- 172.21.15.63:0/4081239114 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16116 (secure 0 0 0) 0x7f4fa8041f20 con 0x7f4fb00bbcd0 2020-05-18T21:33:46.868 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:46.869 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":113,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:33:46.613080+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:33:45.188898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2020-05-18T21:33:45.614699+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:33:46.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.867+0000 7f4fb7a49700 1 -- 172.21.15.63:0/4081239114 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f9804fa60 msgr2=0x7f4f98051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:46.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.867+0000 7f4fb7a49700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f9804fa60 0x7f4f98051f20 secure :-1 s=READY pgs=588 cs=0 l=1 rx=0x7f4fb0147920 tx=0x7f4fac007740).stop 2020-05-18T21:33:46.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.867+0000 7f4fb7a49700 1 -- 172.21.15.63:0/4081239114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb00bbcd0 msgr2=0x7f4fb00b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:46.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.867+0000 7f4fb7a49700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb00bbcd0 0x7f4fb00b62a0 secure :-1 s=READY pgs=1504 cs=0 l=1 rx=0x7f4fa8001490 tx=0x7f4fa8010d60).stop 2020-05-18T21:33:46.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.867+0000 7f4fb7a49700 1 -- 172.21.15.63:0/4081239114 shutdown_connections 2020-05-18T21:33:46.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.867+0000 7f4fb7a49700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f9804fa60 0x7f4f98051f20 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:46.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.867+0000 7f4fb7a49700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb00bbcd0 0x7f4fb00b62a0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:46.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.867+0000 7f4fb7a49700 1 --2- 172.21.15.63:0/4081239114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fb00bb5e0 0x7f4fb0153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:46.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.867+0000 7f4fb7a49700 1 -- 172.21.15.63:0/4081239114 >> 172.21.15.63:0/4081239114 conn(0x7f4fb0069b70 msgr2=0x7f4fb0069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:46.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.867+0000 7f4fb7a49700 1 -- 172.21.15.63:0/4081239114 shutdown_connections 2020-05-18T21:33:46.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.867+0000 7f4fb7a49700 1 -- 172.21.15.63:0/4081239114 wait complete. 2020-05-18T21:33:46.886 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:33:46.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a67fff700 1 Processor -- start 2020-05-18T21:33:46.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a67fff700 1 -- start start 2020-05-18T21:33:46.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a67fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a68145df0 0x7f8a68142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:46.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a67fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8a681432f0 0x7f8a68060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:46.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a67fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a680b7020 con 0x7f8a680b93f0 2020-05-18T21:33:46.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a67fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a680b72c0 con 0x7f8a681432f0 2020-05-18T21:33:46.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a67fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a680b7560 con 0x7f8a68145df0 2020-05-18T21:33:46.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a66ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8a680b93f0 0x7f8a680b7ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34962/0 (socket says 172.21.15.63:34962) 2020-05-18T21:33:46.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a66ffd700 1 -- 172.21.15.63:0/1029345608 learned_addr learned my addr 172.21.15.63:0/1029345608 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:46.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a677fe700 1 --2- 172.21.15.63:0/1029345608 >> v2:172.21.15.63:3300/0 conn(0x7f8a681432f0 0x7f8a68060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:46.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a667fc700 1 --2- 172.21.15.63:0/1029345608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a68145df0 0x7f8a68142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:46.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a65ffb700 1 -- 172.21.15.63:0/1029345608 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665865336 0 0) 0x7f8a680b7020 con 0x7f8a680b93f0 2020-05-18T21:33:46.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a65ffb700 1 -- 172.21.15.63:0/1029345608 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a48003270 con 0x7f8a680b93f0 2020-05-18T21:33:46.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a677fe700 1 -- 172.21.15.63:0/1029345608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a68145df0 msgr2=0x7f8a68142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:46.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a677fe700 1 --2- 172.21.15.63:0/1029345608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a68145df0 0x7f8a68142e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:46.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a677fe700 1 -- 172.21.15.63:0/1029345608 >> v1:172.21.15.63:6789/0 conn(0x7f8a680b93f0 legacy=0x7f8a680b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:46.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a677fe700 1 -- 172.21.15.63:0/1029345608 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a680b7800 con 0x7f8a681432f0 2020-05-18T21:33:46.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a677fe700 1 --2- 172.21.15.63:0/1029345608 >> v2:172.21.15.63:3300/0 conn(0x7f8a681432f0 0x7f8a68060430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8a60002f70 tx=0x7f8a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a677fe700 1 --2- 172.21.15.63:0/1029345608 >> v2:172.21.15.63:3300/0 conn(0x7f8a681432f0 0x7f8a68060430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8a60002f70 tx=0x7f8a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.983+0000 7f8a677fe700 1 --2- 172.21.15.63:0/1029345608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a681432f0 0x7f8a68060430 secure :-1 s=READY pgs=1506 cs=0 l=1 rx=0x7f8a60002f70 tx=0x7f8a60007a80).ready entity=mon.0 client_cookie=f86d02d817fb2b65 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:46.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a677fe700 1 --2- 172.21.15.63:0/1029345608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a681432f0 0x7f8a68060430 secure :-1 s=THROTTLE_DONE pgs=1506 cs=0 l=1 rx=0x7f8a60002f70 tx=0x7f8a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a65ffb700 1 -- 172.21.15.63:0/1029345608 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a60008e80 con 0x7f8a681432f0 2020-05-18T21:33:46.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a677fe700 1 --2- 172.21.15.63:0/1029345608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a681432f0 0x7f8a68060430 secure :-1 s=THROTTLE_DONE pgs=1506 cs=0 l=1 rx=0x7f8a60002f70 tx=0x7f8a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a677fe700 1 --2- 172.21.15.63:0/1029345608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a681432f0 0x7f8a68060430 secure :-1 s=THROTTLE_DONE pgs=1506 cs=0 l=1 rx=0x7f8a60002f70 tx=0x7f8a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:46.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a65ffb700 1 -- 172.21.15.63:0/1029345608 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a60011540 con 0x7f8a681432f0 2020-05-18T21:33:46.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a65ffb700 1 -- 172.21.15.63:0/1029345608 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a60011960 con 0x7f8a681432f0 2020-05-18T21:33:46.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a67fff700 1 -- 172.21.15.63:0/1029345608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a681432f0 msgr2=0x7f8a68060430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:46.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a67fff700 1 --2- 172.21.15.63:0/1029345608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a681432f0 0x7f8a68060430 secure :-1 s=READY pgs=1506 cs=0 l=1 rx=0x7f8a60002f70 tx=0x7f8a60007a80).stop 2020-05-18T21:33:46.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a67fff700 1 -- 172.21.15.63:0/1029345608 shutdown_connections 2020-05-18T21:33:46.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a67fff700 1 --2- 172.21.15.63:0/1029345608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a681432f0 0x7f8a68060430 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:46.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a67fff700 1 --2- 172.21.15.63:0/1029345608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a68145df0 0x7f8a68142e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:46.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a67fff700 1 -- 172.21.15.63:0/1029345608 >> 172.21.15.63:0/1029345608 conn(0x7f8a68069b70 msgr2=0x7f8a68069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:46.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a67fff700 1 -- 172.21.15.63:0/1029345608 shutdown_connections 2020-05-18T21:33:46.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a67fff700 1 -- 172.21.15.63:0/1029345608 wait complete. 2020-05-18T21:33:46.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a67fff700 1 Processor -- start 2020-05-18T21:33:46.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a67fff700 1 -- start start 2020-05-18T21:33:46.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a67fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680b93f0 0x7f8a681402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:46.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a67fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8a681432f0 0x7f8a68157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:46.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a67fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a68156e80 con 0x7f8a68145df0 2020-05-18T21:33:46.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a67fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a681570b0 con 0x7f8a681432f0 2020-05-18T21:33:46.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a67fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a68157350 con 0x7f8a680b93f0 2020-05-18T21:33:47.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a667fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8a681432f0 0x7f8a68157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:47.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a66ffd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680b93f0 0x7f8a681402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:47.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a677fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f8a68145df0 0x7f8a6813ddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:33286/0 (socket says 172.21.15.63:33286) 2020-05-18T21:33:47.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.987+0000 7f8a677fe700 1 -- 172.21.15.63:0/438962544 learned_addr learned my addr 172.21.15.63:0/438962544 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:47.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.991+0000 7f8a5ffff700 1 -- 172.21.15.63:0/438962544 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739134062 0 0) 0x7f8a68156e80 con 0x7f8a68145df0 2020-05-18T21:33:47.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.991+0000 7f8a66ffd700 1 -- 172.21.15.63:0/438962544 >> v2:172.21.15.155:3300/0 conn(0x7f8a681432f0 msgr2=0x7f8a68157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:47.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.991+0000 7f8a66ffd700 1 --2- 172.21.15.63:0/438962544 >> v2:172.21.15.155:3300/0 conn(0x7f8a681432f0 0x7f8a68157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:47.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.991+0000 7f8a66ffd700 1 -- 172.21.15.63:0/438962544 >> v1:172.21.15.155:6789/0 conn(0x7f8a68145df0 legacy=0x7f8a6813ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:47.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.991+0000 7f8a66ffd700 1 -- 172.21.15.63:0/438962544 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a681575f0 con 0x7f8a680b93f0 2020-05-18T21:33:47.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.991+0000 7f8a667fc700 1 --2- 172.21.15.63:0/438962544 >> v2:172.21.15.155:3300/0 conn(0x7f8a681432f0 0x7f8a68157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:47.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.991+0000 7f8a66ffd700 1 --2- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680b93f0 0x7f8a681402e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a50001110 tx=0x7f8a500108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.991+0000 7f8a66ffd700 1 --2- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680b93f0 0x7f8a681402e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a50001110 tx=0x7f8a500108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.991+0000 7f8a66ffd700 1 --2- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680b93f0 0x7f8a681402e0 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f8a50001110 tx=0x7f8a500108f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:47.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.991+0000 7f8a66ffd700 1 --2- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680b93f0 0x7f8a681402e0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f8a50001110 tx=0x7f8a500108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.991+0000 7f8a5ffff700 1 -- 172.21.15.63:0/438962544 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a50005d00 con 0x7f8a680b93f0 2020-05-18T21:33:47.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.991+0000 7f8a66ffd700 1 --2- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680b93f0 0x7f8a681402e0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f8a50001110 tx=0x7f8a500108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.991+0000 7f8a66ffd700 1 --2- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680b93f0 0x7f8a681402e0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f8a50001110 tx=0x7f8a500108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.991+0000 7f8a5ffff700 1 -- 172.21.15.63:0/438962544 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a50005e60 con 0x7f8a680b93f0 2020-05-18T21:33:47.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.991+0000 7f8a5ffff700 1 -- 172.21.15.63:0/438962544 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a500062c0 con 0x7f8a680b93f0 2020-05-18T21:33:47.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.991+0000 7f8a67fff700 1 -- 172.21.15.63:0/438962544 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6813e4d0 con 0x7f8a680b93f0 2020-05-18T21:33:47.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.991+0000 7f8a67fff700 1 -- 172.21.15.63:0/438962544 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a68141b70 con 0x7f8a680b93f0 2020-05-18T21:33:47.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.991+0000 7f8a67fff700 1 -- 172.21.15.63:0/438962544 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a680569e0 con 0x7f8a680b93f0 2020-05-18T21:33:47.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.991+0000 7f8a66ffd700 1 --2- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680b93f0 0x7f8a681402e0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f8a50001110 tx=0x7f8a500108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.995+0000 7f8a5ffff700 1 -- 172.21.15.63:0/438962544 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8a500064c0 con 0x7f8a680b93f0 2020-05-18T21:33:47.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.995+0000 7f8a66ffd700 1 --2- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680b93f0 0x7f8a681402e0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f8a50001110 tx=0x7f8a500108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.995+0000 7f8a5ffff700 1 --2- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8a4c04f8f0 0x7f8a4c051db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:47.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.995+0000 7f8a5ffff700 1 -- 172.21.15.63:0/438962544 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8a500090c0 con 0x7f8a680b93f0 2020-05-18T21:33:47.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.995+0000 7f8a667fc700 1 --2- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8a4c04f8f0 0x7f8a4c051db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:47.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.995+0000 7f8a667fc700 1 --2- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8a4c04f8f0 0x7f8a4c051db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a580032f0 tx=0x7f8a58008010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.995+0000 7f8a667fc700 1 --2- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8a4c04f8f0 0x7f8a4c051db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a580032f0 tx=0x7f8a58008010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:46.995+0000 7f8a667fc700 1 --2- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8a4c04f8f0 0x7f8a4c051db0 secure :-1 s=READY pgs=589 cs=0 l=1 rx=0x7f8a580032f0 tx=0x7f8a58008010).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:47.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.003+0000 7f8a66ffd700 1 --2- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680b93f0 0x7f8a681402e0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f8a50001110 tx=0x7f8a500108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.003+0000 7f8a5ffff700 1 -- 172.21.15.63:0/438962544 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f8a5003e080 con 0x7f8a680b93f0 2020-05-18T21:33:47.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.123+0000 7f8a67fff700 1 -- 172.21.15.63:0/438962544 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a6806a490 con 0x7f8a680b93f0 2020-05-18T21:33:47.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.123+0000 7f8a66ffd700 1 --2- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680b93f0 0x7f8a681402e0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f8a50001110 tx=0x7f8a500108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.123+0000 7f8a5ffff700 1 -- 172.21.15.63:0/438962544 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16116 (secure 0 0 0) 0x7f8a500416a0 con 0x7f8a680b93f0 2020-05-18T21:33:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:47.127 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":113,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:33:46.613080+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:33:45.188898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2020-05-18T21:33:45.614699+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:33:47.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.123+0000 7f8a67fff700 1 -- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8a4c04f8f0 msgr2=0x7f8a4c051db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:47.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.123+0000 7f8a67fff700 1 --2- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8a4c04f8f0 0x7f8a4c051db0 secure :-1 s=READY pgs=589 cs=0 l=1 rx=0x7f8a580032f0 tx=0x7f8a58008010).stop 2020-05-18T21:33:47.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.123+0000 7f8a67fff700 1 -- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680b93f0 msgr2=0x7f8a681402e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:47.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.123+0000 7f8a67fff700 1 --2- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680b93f0 0x7f8a681402e0 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f8a50001110 tx=0x7f8a500108f0).stop 2020-05-18T21:33:47.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.123+0000 7f8a67fff700 1 -- 172.21.15.63:0/438962544 shutdown_connections 2020-05-18T21:33:47.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.123+0000 7f8a67fff700 1 --2- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8a4c04f8f0 0x7f8a4c051db0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:47.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.123+0000 7f8a67fff700 1 --2- 172.21.15.63:0/438962544 >> v2:172.21.15.155:3300/0 conn(0x7f8a681432f0 0x7f8a68157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:47.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.123+0000 7f8a67fff700 1 --2- 172.21.15.63:0/438962544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680b93f0 0x7f8a681402e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:47.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.123+0000 7f8a67fff700 1 -- 172.21.15.63:0/438962544 >> 172.21.15.63:0/438962544 conn(0x7f8a68069b70 msgr2=0x7f8a681422b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:47.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.127+0000 7f8a67fff700 1 -- 172.21.15.63:0/438962544 shutdown_connections 2020-05-18T21:33:47.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.127+0000 7f8a67fff700 1 -- 172.21.15.63:0/438962544 wait complete. 2020-05-18T21:33:47.140 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-05-18T21:33:47.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.251+0000 7f6feb59e700 1 Processor -- start 2020-05-18T21:33:47.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.251+0000 7f6feb59e700 1 -- start start 2020-05-18T21:33:47.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.251+0000 7f6feb59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fec0b4460 0x7f6fec0b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:47.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.251+0000 7f6feb59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6fec0b6c10 0x7f6fec0b70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:47.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.251+0000 7f6feb59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fec146740 con 0x7f6fec145ca0 2020-05-18T21:33:47.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.251+0000 7f6feb59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fec1469e0 con 0x7f6fec0b6c10 2020-05-18T21:33:47.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.251+0000 7f6feb59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec0b4840 con 0x7f6fec0b4460 2020-05-18T21:33:47.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.251+0000 7f6fead9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6fec0b6c10 0x7f6fec0b70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:47.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.251+0000 7f6fead9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6fec0b6c10 0x7f6fec0b70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32792/0 (socket says 172.21.15.63:32792) 2020-05-18T21:33:47.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.251+0000 7f6fead9d700 1 -- 172.21.15.63:0/1368757149 learned_addr learned my addr 172.21.15.63:0/1368757149 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:47.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.251+0000 7f6fea59c700 1 --2- 172.21.15.63:0/1368757149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fec0b4460 0x7f6fec0b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:47.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.251+0000 7f6fead9d700 1 -- 172.21.15.63:0/1368757149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fec0b4460 msgr2=0x7f6fec0b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:47.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.251+0000 7f6fead9d700 1 --2- 172.21.15.63:0/1368757149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fec0b4460 0x7f6fec0b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:47.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.251+0000 7f6fe959a700 1 -- 172.21.15.63:0/1368757149 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923530072 0 0) 0x7f6fec146740 con 0x7f6fec145ca0 2020-05-18T21:33:47.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.251+0000 7f6fead9d700 1 -- 172.21.15.63:0/1368757149 >> v1:172.21.15.155:6789/0 conn(0x7f6fec145ca0 legacy=0x7f6fec0b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:47.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.251+0000 7f6fead9d700 1 -- 172.21.15.63:0/1368757149 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec0b0ff0 con 0x7f6fec0b6c10 2020-05-18T21:33:47.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.255+0000 7f6fead9d700 1 --2- 172.21.15.63:0/1368757149 >> v2:172.21.15.63:3300/0 conn(0x7f6fec0b6c10 0x7f6fec0b70a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6fe40032f0 tx=0x7f6fe4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.255+0000 7f6fead9d700 1 --2- 172.21.15.63:0/1368757149 >> v2:172.21.15.63:3300/0 conn(0x7f6fec0b6c10 0x7f6fec0b70a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6fe40032f0 tx=0x7f6fe4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.255+0000 7f6fead9d700 1 --2- 172.21.15.63:0/1368757149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fec0b6c10 0x7f6fec0b70a0 secure :-1 s=READY pgs=1507 cs=0 l=1 rx=0x7f6fe40032f0 tx=0x7f6fe4007e00).ready entity=mon.0 client_cookie=5dd9310ac4e2350b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:47.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.255+0000 7f6fead9d700 1 --2- 172.21.15.63:0/1368757149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fec0b6c10 0x7f6fec0b70a0 secure :-1 s=THROTTLE_DONE pgs=1507 cs=0 l=1 rx=0x7f6fe40032f0 tx=0x7f6fe4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.255+0000 7f6fe959a700 1 -- 172.21.15.63:0/1368757149 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fe4011d10 con 0x7f6fec0b6c10 2020-05-18T21:33:47.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.255+0000 7f6fead9d700 1 --2- 172.21.15.63:0/1368757149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fec0b6c10 0x7f6fec0b70a0 secure :-1 s=THROTTLE_DONE pgs=1507 cs=0 l=1 rx=0x7f6fe40032f0 tx=0x7f6fe4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.255+0000 7f6fe959a700 1 -- 172.21.15.63:0/1368757149 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe4011e70 con 0x7f6fec0b6c10 2020-05-18T21:33:47.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.255+0000 7f6fead9d700 1 --2- 172.21.15.63:0/1368757149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fec0b6c10 0x7f6fec0b70a0 secure :-1 s=THROTTLE_DONE pgs=1507 cs=0 l=1 rx=0x7f6fe40032f0 tx=0x7f6fe4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.255+0000 7f6fe959a700 1 -- 172.21.15.63:0/1368757149 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fe400a370 con 0x7f6fec0b6c10 2020-05-18T21:33:47.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.255+0000 7f6feb59e700 1 -- 172.21.15.63:0/1368757149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fec0b6c10 msgr2=0x7f6fec0b70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:47.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.255+0000 7f6feb59e700 1 --2- 172.21.15.63:0/1368757149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fec0b6c10 0x7f6fec0b70a0 secure :-1 s=READY pgs=1507 cs=0 l=1 rx=0x7f6fe40032f0 tx=0x7f6fe4007e00).stop 2020-05-18T21:33:47.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.255+0000 7f6feb59e700 1 -- 172.21.15.63:0/1368757149 shutdown_connections 2020-05-18T21:33:47.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.255+0000 7f6feb59e700 1 --2- 172.21.15.63:0/1368757149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fec0b6c10 0x7f6fec0b70a0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:47.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.255+0000 7f6feb59e700 1 --2- 172.21.15.63:0/1368757149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fec0b4460 0x7f6fec0b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:47.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.255+0000 7f6feb59e700 1 -- 172.21.15.63:0/1368757149 >> 172.21.15.63:0/1368757149 conn(0x7f6fec069b70 msgr2=0x7f6fec069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:47.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.255+0000 7f6feb59e700 1 -- 172.21.15.63:0/1368757149 shutdown_connections 2020-05-18T21:33:47.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.255+0000 7f6feb59e700 1 -- 172.21.15.63:0/1368757149 wait complete. 2020-05-18T21:33:47.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6feb59e700 1 Processor -- start 2020-05-18T21:33:47.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6feb59e700 1 -- start start 2020-05-18T21:33:47.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6feb59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6fec0b4460 0x7f6fec0baaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:47.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6feb59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6fec0b6c10 0x7f6fec0628a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:47.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6feb59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fec064ec0 con 0x7f6fec145ca0 2020-05-18T21:33:47.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6feb59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fec0bb0b0 con 0x7f6fec0b4460 2020-05-18T21:33:47.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6feb59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fec0b8ea0 con 0x7f6fec0b6c10 2020-05-18T21:33:47.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6fea59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6fec0b4460 0x7f6fec0baaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:47.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6fead9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6fec145ca0 0x7f6fec133b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34986/0 (socket says 172.21.15.63:34986) 2020-05-18T21:33:47.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6fea59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6fec0b4460 0x7f6fec0baaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32794/0 (socket says 172.21.15.63:32794) 2020-05-18T21:33:47.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6fead9d700 1 -- 172.21.15.63:0/4070238304 learned_addr learned my addr 172.21.15.63:0/4070238304 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:47.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6fe9d9b700 1 --2- 172.21.15.63:0/4070238304 >> v2:172.21.15.155:3300/0 conn(0x7f6fec0b6c10 0x7f6fec0628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:47.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6fea59c700 1 -- 172.21.15.63:0/4070238304 >> v2:172.21.15.155:3300/0 conn(0x7f6fec0b6c10 msgr2=0x7f6fec0628a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:47.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6fea59c700 1 --2- 172.21.15.63:0/4070238304 >> v2:172.21.15.155:3300/0 conn(0x7f6fec0b6c10 0x7f6fec0628a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:47.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6fea59c700 1 -- 172.21.15.63:0/4070238304 >> v1:172.21.15.63:6789/0 conn(0x7f6fec145ca0 legacy=0x7f6fec133b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:47.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6fdb7fe700 1 -- 172.21.15.63:0/4070238304 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397556081 0 0) 0x7f6fec064ec0 con 0x7f6fec145ca0 2020-05-18T21:33:47.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6fea59c700 1 -- 172.21.15.63:0/4070238304 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec0b9140 con 0x7f6fec0b4460 2020-05-18T21:33:47.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6fea59c700 1 --2- 172.21.15.63:0/4070238304 >> v2:172.21.15.63:3300/0 conn(0x7f6fec0b4460 0x7f6fec0baaf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6fe0002f70 tx=0x7f6fe0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6fea59c700 1 --2- 172.21.15.63:0/4070238304 >> v2:172.21.15.63:3300/0 conn(0x7f6fec0b4460 0x7f6fec0baaf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6fe0002f70 tx=0x7f6fe0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6fea59c700 1 --2- 172.21.15.63:0/4070238304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fec0b4460 0x7f6fec0baaf0 secure :-1 s=READY pgs=1509 cs=0 l=1 rx=0x7f6fe0002f70 tx=0x7f6fe0010bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:47.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6fea59c700 1 --2- 172.21.15.63:0/4070238304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fec0b4460 0x7f6fec0baaf0 secure :-1 s=THROTTLE_DONE pgs=1509 cs=0 l=1 rx=0x7f6fe0002f70 tx=0x7f6fe0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6fea59c700 1 --2- 172.21.15.63:0/4070238304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fec0b4460 0x7f6fec0baaf0 secure :-1 s=THROTTLE_DONE pgs=1509 cs=0 l=1 rx=0x7f6fe0002f70 tx=0x7f6fe0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.259+0000 7f6fdb7fe700 1 -- 172.21.15.63:0/4070238304 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fe0007550 con 0x7f6fec0b4460 2020-05-18T21:33:47.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.263+0000 7f6fea59c700 1 --2- 172.21.15.63:0/4070238304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fec0b4460 0x7f6fec0baaf0 secure :-1 s=THROTTLE_DONE pgs=1509 cs=0 l=1 rx=0x7f6fe0002f70 tx=0x7f6fe0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.263+0000 7f6fdb7fe700 1 -- 172.21.15.63:0/4070238304 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe0005700 con 0x7f6fec0b4460 2020-05-18T21:33:47.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.263+0000 7f6feb59e700 1 -- 172.21.15.63:0/4070238304 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fec134230 con 0x7f6fec0b4460 2020-05-18T21:33:47.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.263+0000 7f6fdb7fe700 1 -- 172.21.15.63:0/4070238304 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fe0005a60 con 0x7f6fec0b4460 2020-05-18T21:33:47.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.263+0000 7f6feb59e700 1 -- 172.21.15.63:0/4070238304 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fec062ea0 con 0x7f6fec0b4460 2020-05-18T21:33:47.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.263+0000 7f6fea59c700 1 --2- 172.21.15.63:0/4070238304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fec0b4460 0x7f6fec0baaf0 secure :-1 s=THROTTLE_DONE pgs=1509 cs=0 l=1 rx=0x7f6fe0002f70 tx=0x7f6fe0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.263+0000 7f6feb59e700 1 -- 172.21.15.63:0/4070238304 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fec0569e0 con 0x7f6fec0b4460 2020-05-18T21:33:47.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.263+0000 7f6fdb7fe700 1 -- 172.21.15.63:0/4070238304 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6fe0005cd0 con 0x7f6fec0b4460 2020-05-18T21:33:47.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.263+0000 7f6fea59c700 1 --2- 172.21.15.63:0/4070238304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fec0b4460 0x7f6fec0baaf0 secure :-1 s=THROTTLE_DONE pgs=1509 cs=0 l=1 rx=0x7f6fe0002f70 tx=0x7f6fe0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.263+0000 7f6fdb7fe700 1 --2- 172.21.15.63:0/4070238304 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6fc804f8b0 0x7f6fc8051d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:47.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.263+0000 7f6fdb7fe700 1 -- 172.21.15.63:0/4070238304 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6fe0063e90 con 0x7f6fec0b4460 2020-05-18T21:33:47.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.263+0000 7f6fe9d9b700 1 --2- 172.21.15.63:0/4070238304 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6fc804f8b0 0x7f6fc8051d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:47.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.267+0000 7f6fe9d9b700 1 --2- 172.21.15.63:0/4070238304 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6fc804f8b0 0x7f6fc8051d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6fdc000bc0 tx=0x7f6fdc003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.267+0000 7f6fe9d9b700 1 --2- 172.21.15.63:0/4070238304 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6fc804f8b0 0x7f6fc8051d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6fdc000bc0 tx=0x7f6fdc003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.267+0000 7f6fe9d9b700 1 --2- 172.21.15.63:0/4070238304 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6fc804f8b0 0x7f6fc8051d70 secure :-1 s=READY pgs=590 cs=0 l=1 rx=0x7f6fdc000bc0 tx=0x7f6fdc003e90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:47.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.271+0000 7f6fea59c700 1 --2- 172.21.15.63:0/4070238304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fec0b4460 0x7f6fec0baaf0 secure :-1 s=THROTTLE_DONE pgs=1509 cs=0 l=1 rx=0x7f6fe0002f70 tx=0x7f6fe0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.271+0000 7f6fdb7fe700 1 -- 172.21.15.63:0/4070238304 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6fe003e1c0 con 0x7f6fec0b4460 2020-05-18T21:33:47.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.427+0000 7f6feb59e700 1 -- 172.21.15.63:0/4070238304 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6fec06a6e0 con 0x7f6fec0b4460 2020-05-18T21:33:47.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.627+0000 7f6fea59c700 1 --2- 172.21.15.63:0/4070238304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fec0b4460 0x7f6fec0baaf0 secure :-1 s=THROTTLE_DONE pgs=1509 cs=0 l=1 rx=0x7f6fe0002f70 tx=0x7f6fe0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.627+0000 7f6fdb7fe700 1 -- 172.21.15.63:0/4070238304 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v86) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6fe00417e0 con 0x7f6fec0b4460 2020-05-18T21:33:47.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.631+0000 7f6feb59e700 1 -- 172.21.15.63:0/4070238304 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6fc804f8b0 msgr2=0x7f6fc8051d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:47.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.631+0000 7f6feb59e700 1 --2- 172.21.15.63:0/4070238304 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6fc804f8b0 0x7f6fc8051d70 secure :-1 s=READY pgs=590 cs=0 l=1 rx=0x7f6fdc000bc0 tx=0x7f6fdc003e90).stop 2020-05-18T21:33:47.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.631+0000 7f6feb59e700 1 -- 172.21.15.63:0/4070238304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fec0b4460 msgr2=0x7f6fec0baaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.631+0000 7f6feb59e700 1 --2- 172.21.15.63:0/4070238304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fec0b4460 0x7f6fec0baaf0 secure :-1 s=READY pgs=1509 cs=0 l=1 rx=0x7f6fe0002f70 tx=0x7f6fe0010bd0).stop 2020-05-18T21:33:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.631+0000 7f6feb59e700 1 -- 172.21.15.63:0/4070238304 shutdown_connections 2020-05-18T21:33:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.631+0000 7f6feb59e700 1 --2- 172.21.15.63:0/4070238304 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6fc804f8b0 0x7f6fc8051d70 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.631+0000 7f6feb59e700 1 --2- 172.21.15.63:0/4070238304 >> v2:172.21.15.155:3300/0 conn(0x7f6fec0b6c10 0x7f6fec0628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.631+0000 7f6feb59e700 1 --2- 172.21.15.63:0/4070238304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fec0b4460 0x7f6fec0baaf0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.631+0000 7f6feb59e700 1 -- 172.21.15.63:0/4070238304 >> 172.21.15.63:0/4070238304 conn(0x7f6fec069b70 msgr2=0x7f6fec05c320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.631+0000 7f6feb59e700 1 -- 172.21.15.63:0/4070238304 shutdown_connections 2020-05-18T21:33:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.631+0000 7f6feb59e700 1 -- 172.21.15.63:0/4070238304 wait complete. 2020-05-18T21:33:47.649 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:47.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe9447700 1 Processor -- start 2020-05-18T21:33:47.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe9447700 1 -- start start 2020-05-18T21:33:47.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe9447700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdbe40bb5e0 0x7fdbe40acee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:47.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe9447700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbe412efd0 0x7fdbe412f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:47.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe9447700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe40af6e0 con 0x7fdbe40bbcd0 2020-05-18T21:33:47.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe9447700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe40af980 con 0x7fdbe40bb5e0 2020-05-18T21:33:47.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe9447700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe40b0530 con 0x7fdbe412efd0 2020-05-18T21:33:47.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe27fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdbe40bbcd0 0x7fdbe40afe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34992/0 (socket says 172.21.15.63:34992) 2020-05-18T21:33:47.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe27fc700 1 -- 172.21.15.63:0/3952622692 learned_addr learned my addr 172.21.15.63:0/3952622692 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:47.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe37fe700 1 --2- 172.21.15.63:0/3952622692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbe412efd0 0x7fdbe412f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:47.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe2ffd700 1 --2- 172.21.15.63:0/3952622692 >> v2:172.21.15.155:3300/0 conn(0x7fdbe40bb5e0 0x7fdbe40acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:47.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe1ffb700 1 -- 172.21.15.63:0/3952622692 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986525434 0 0) 0x7fdbe40af6e0 con 0x7fdbe40bbcd0 2020-05-18T21:33:47.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe1ffb700 1 -- 172.21.15.63:0/3952622692 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbc4003270 con 0x7fdbe40bbcd0 2020-05-18T21:33:47.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe1ffb700 1 -- 172.21.15.63:0/3952622692 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2798014683 0 0) 0x7fdbc4003270 con 0x7fdbe40bbcd0 2020-05-18T21:33:47.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe1ffb700 1 -- 172.21.15.63:0/3952622692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbe412efd0 msgr2=0x7fdbe412f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:47.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe1ffb700 1 --2- 172.21.15.63:0/3952622692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbe412efd0 0x7fdbe412f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:47.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe1ffb700 1 -- 172.21.15.63:0/3952622692 >> v2:172.21.15.155:3300/0 conn(0x7fdbe40bb5e0 msgr2=0x7fdbe40acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:47.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe1ffb700 1 --2- 172.21.15.63:0/3952622692 >> v2:172.21.15.155:3300/0 conn(0x7fdbe40bb5e0 0x7fdbe40acee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:47.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe1ffb700 1 -- 172.21.15.63:0/3952622692 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe40bb9c0 con 0x7fdbe40bbcd0 2020-05-18T21:33:47.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe1ffb700 1 -- 172.21.15.63:0/3952622692 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fdbcc001710 con 0x7fdbe40bbcd0 2020-05-18T21:33:47.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe37fe700 1 --2- 172.21.15.63:0/3952622692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbe412efd0 0x7fdbe412f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:47.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe1ffb700 1 -- 172.21.15.63:0/3952622692 >> v1:172.21.15.63:6789/0 conn(0x7fdbe40bbcd0 legacy=0x7fdbe40afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:47.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe1ffb700 1 --2- 172.21.15.63:0/3952622692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc4003760 0x7fdbc4003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:47.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe1ffb700 1 --2- 172.21.15.63:0/3952622692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbc40040a0 0x7fdbc4004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:47.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe1ffb700 1 --2- 172.21.15.63:0/3952622692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbe412efd0 0x7fdbc4004b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:47.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe1ffb700 1 -- 172.21.15.63:0/3952622692 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe40af980 con 0x7fdbc4003760 2020-05-18T21:33:47.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe1ffb700 1 -- 172.21.15.63:0/3952622692 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe40b0530 con 0x7fdbc40040a0 2020-05-18T21:33:47.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe1ffb700 1 -- 172.21.15.63:0/3952622692 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40050e0 con 0x7fdbe412efd0 2020-05-18T21:33:47.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe2ffd700 1 --2- 172.21.15.63:0/3952622692 >> v2:172.21.15.155:3300/0 conn(0x7fdbe40bb5e0 0x7fdbe40acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:47.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe27fc700 1 --2- 172.21.15.63:0/3952622692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbc40040a0 0x7fdbc4004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:47.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe2ffd700 1 --2- 172.21.15.63:0/3952622692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc4003760 0x7fdbc4003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:47.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe37fe700 1 --2- 172.21.15.63:0/3952622692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbe412efd0 0x7fdbc4004b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:47.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe2ffd700 1 -- 172.21.15.63:0/3952622692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbe412efd0 msgr2=0x7fdbc4004b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:47.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe2ffd700 1 --2- 172.21.15.63:0/3952622692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbe412efd0 0x7fdbc4004b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:47.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe2ffd700 1 -- 172.21.15.63:0/3952622692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbc40040a0 msgr2=0x7fdbc4004570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:47.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe2ffd700 1 --2- 172.21.15.63:0/3952622692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbc40040a0 0x7fdbc4004570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:47.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe2ffd700 1 -- 172.21.15.63:0/3952622692 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc4003270 con 0x7fdbc4003760 2020-05-18T21:33:47.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.759+0000 7fdbe2ffd700 1 --2- 172.21.15.63:0/3952622692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc4003760 0x7fdbc4003b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdbd4002f70 tx=0x7fdbd400bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.763+0000 7fdbe2ffd700 1 --2- 172.21.15.63:0/3952622692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc4003760 0x7fdbc4003b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdbd4002f70 tx=0x7fdbd400bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.763+0000 7fdbe2ffd700 1 --2- 172.21.15.63:0/3952622692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc4003760 0x7fdbc4003b80 secure :-1 s=READY pgs=1511 cs=0 l=1 rx=0x7fdbd4002f70 tx=0x7fdbd400bf80).ready entity=mon.0 client_cookie=c4ed1901c058596b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:47.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.763+0000 7fdbe2ffd700 1 --2- 172.21.15.63:0/3952622692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc4003760 0x7fdbc4003b80 secure :-1 s=THROTTLE_DONE pgs=1511 cs=0 l=1 rx=0x7fdbd4002f70 tx=0x7fdbd400bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.763+0000 7fdbe1ffb700 1 -- 172.21.15.63:0/3952622692 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbd4010c80 con 0x7fdbc4003760 2020-05-18T21:33:47.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.763+0000 7fdbe2ffd700 1 --2- 172.21.15.63:0/3952622692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc4003760 0x7fdbc4003b80 secure :-1 s=THROTTLE_DONE pgs=1511 cs=0 l=1 rx=0x7fdbd4002f70 tx=0x7fdbd400bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.763+0000 7fdbe1ffb700 1 -- 172.21.15.63:0/3952622692 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd4010de0 con 0x7fdbc4003760 2020-05-18T21:33:47.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.763+0000 7fdbe2ffd700 1 --2- 172.21.15.63:0/3952622692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc4003760 0x7fdbc4003b80 secure :-1 s=THROTTLE_DONE pgs=1511 cs=0 l=1 rx=0x7fdbd4002f70 tx=0x7fdbd400bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.763+0000 7fdbe9447700 1 -- 172.21.15.63:0/3952622692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc4003760 msgr2=0x7fdbc4003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:47.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.763+0000 7fdbe1ffb700 1 -- 172.21.15.63:0/3952622692 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbd400c680 con 0x7fdbc4003760 2020-05-18T21:33:47.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.763+0000 7fdbe9447700 1 --2- 172.21.15.63:0/3952622692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc4003760 0x7fdbc4003b80 secure :-1 s=READY pgs=1511 cs=0 l=1 rx=0x7fdbd4002f70 tx=0x7fdbd400bf80).stop 2020-05-18T21:33:47.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.763+0000 7fdbe37fe700 1 -- 172.21.15.63:0/3952622692 reap_dead start 2020-05-18T21:33:47.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.763+0000 7fdbe9447700 1 -- 172.21.15.63:0/3952622692 shutdown_connections 2020-05-18T21:33:47.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.763+0000 7fdbe9447700 1 -- 172.21.15.63:0/3952622692 >> 172.21.15.63:0/3952622692 conn(0x7fdbe4069b70 msgr2=0x7fdbe4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:47.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.763+0000 7fdbe9447700 1 -- 172.21.15.63:0/3952622692 shutdown_connections 2020-05-18T21:33:47.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.763+0000 7fdbe9447700 1 -- 172.21.15.63:0/3952622692 wait complete. 2020-05-18T21:33:47.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.763+0000 7fdbe9447700 1 Processor -- start 2020-05-18T21:33:47.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.763+0000 7fdbe9447700 1 -- start start 2020-05-18T21:33:47.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe9447700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbe4156c90 0x7fdbe40b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:47.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe9447700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdbe4147af0 0x7fdbe4147f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:47.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe9447700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe412c470 con 0x7fdbe4157070 2020-05-18T21:33:47.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe9447700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe41483a0 con 0x7fdbe4147af0 2020-05-18T21:33:47.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe9447700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe412c6a0 con 0x7fdbe4156c90 2020-05-18T21:33:47.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe27fc700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fdbe4157070 0x7fdbe40b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:33320/0 (socket says 172.21.15.63:33320) 2020-05-18T21:33:47.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe2ffd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbe4156c90 0x7fdbe40b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:47.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe37fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdbe4147af0 0x7fdbe4147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:47.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe27fc700 1 -- 172.21.15.63:0/3563141403 learned_addr learned my addr 172.21.15.63:0/3563141403 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:47.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe37fe700 1 -- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbe4156c90 msgr2=0x7fdbe40b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:47.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe37fe700 1 --2- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbe4156c90 0x7fdbe40b4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:47.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe37fe700 1 -- 172.21.15.63:0/3563141403 >> v1:172.21.15.155:6789/0 conn(0x7fdbe4157070 legacy=0x7fdbe40b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:47.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe37fe700 1 -- 172.21.15.63:0/3563141403 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe412cbe0 con 0x7fdbe4147af0 2020-05-18T21:33:47.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe37fe700 1 --2- 172.21.15.63:0/3563141403 >> v2:172.21.15.155:3300/0 conn(0x7fdbe4147af0 0x7fdbe4147f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdbcc001970 tx=0x7fdbdc009390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe37fe700 1 --2- 172.21.15.63:0/3563141403 >> v2:172.21.15.155:3300/0 conn(0x7fdbe4147af0 0x7fdbe4147f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdbcc001970 tx=0x7fdbdc009390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe37fe700 1 --2- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbe4147af0 0x7fdbe4147f40 secure :-1 s=READY pgs=1015 cs=0 l=1 rx=0x7fdbcc001970 tx=0x7fdbdc009390).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:47.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe37fe700 1 --2- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbe4147af0 0x7fdbe4147f40 secure :-1 s=THROTTLE_DONE pgs=1015 cs=0 l=1 rx=0x7fdbcc001970 tx=0x7fdbdc009390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbdbfff700 1 -- 172.21.15.63:0/3563141403 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbdc00e550 con 0x7fdbe4147af0 2020-05-18T21:33:47.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe37fe700 1 --2- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbe4147af0 0x7fdbe4147f40 secure :-1 s=THROTTLE_DONE pgs=1015 cs=0 l=1 rx=0x7fdbcc001970 tx=0x7fdbdc009390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe37fe700 1 --2- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbe4147af0 0x7fdbe4147f40 secure :-1 s=THROTTLE_DONE pgs=1015 cs=0 l=1 rx=0x7fdbcc001970 tx=0x7fdbdc009390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbdbfff700 1 -- 172.21.15.63:0/3563141403 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc00e6b0 con 0x7fdbe4147af0 2020-05-18T21:33:47.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe9447700 1 -- 172.21.15.63:0/3563141403 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe412c940 con 0x7fdbe4147af0 2020-05-18T21:33:47.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbdbfff700 1 -- 172.21.15.63:0/3563141403 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbdc00ca00 con 0x7fdbe4147af0 2020-05-18T21:33:47.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.767+0000 7fdbe9447700 1 -- 172.21.15.63:0/3563141403 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe40b34a0 con 0x7fdbe4147af0 2020-05-18T21:33:47.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.771+0000 7fdbe37fe700 1 --2- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbe4147af0 0x7fdbe4147f40 secure :-1 s=THROTTLE_DONE pgs=1015 cs=0 l=1 rx=0x7fdbcc001970 tx=0x7fdbdc009390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.771+0000 7fdbe9447700 1 -- 172.21.15.63:0/3563141403 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe40569e0 con 0x7fdbe4147af0 2020-05-18T21:33:47.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.771+0000 7fdbdbfff700 1 -- 172.21.15.63:0/3563141403 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fdbdc00cb60 con 0x7fdbe4147af0 2020-05-18T21:33:47.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.771+0000 7fdbe37fe700 1 --2- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbe4147af0 0x7fdbe4147f40 secure :-1 s=THROTTLE_DONE pgs=1015 cs=0 l=1 rx=0x7fdbcc001970 tx=0x7fdbdc009390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.771+0000 7fdbdbfff700 1 --2- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbc804f9c0 0x7fdbc8051e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:47.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.771+0000 7fdbdbfff700 1 -- 172.21.15.63:0/3563141403 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdbdc063e20 con 0x7fdbe4147af0 2020-05-18T21:33:47.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.771+0000 7fdbe2ffd700 1 --2- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbc804f9c0 0x7fdbc8051e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:47.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.771+0000 7fdbe2ffd700 1 --2- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbc804f9c0 0x7fdbc8051e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdbd4002f70 tx=0x7fdbd400bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.771+0000 7fdbe2ffd700 1 --2- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbc804f9c0 0x7fdbc8051e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdbd4002f70 tx=0x7fdbd400bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.771+0000 7fdbe2ffd700 1 --2- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbc804f9c0 0x7fdbc8051e80 secure :-1 s=READY pgs=591 cs=0 l=1 rx=0x7fdbd4002f70 tx=0x7fdbd400bf80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:47.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.779+0000 7fdbe37fe700 1 --2- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbe4147af0 0x7fdbe4147f40 secure :-1 s=THROTTLE_DONE pgs=1015 cs=0 l=1 rx=0x7fdbcc001970 tx=0x7fdbdc009390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.779+0000 7fdbdbfff700 1 -- 172.21.15.63:0/3563141403 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fdbdc03e130 con 0x7fdbe4147af0 2020-05-18T21:33:47.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.931+0000 7fdbe9447700 1 -- 172.21.15.63:0/3563141403 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbe40008d0 con 0x7fdbe4147af0 2020-05-18T21:33:47.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.931+0000 7fdbe37fe700 1 --2- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbe4147af0 0x7fdbe4147f40 secure :-1 s=THROTTLE_DONE pgs=1015 cs=0 l=1 rx=0x7fdbcc001970 tx=0x7fdbdc009390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:47.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.931+0000 7fdbdbfff700 1 -- 172.21.15.63:0/3563141403 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fdbdc041750 con 0x7fdbe4147af0 2020-05-18T21:33:47.937 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:47.937 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/911406335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":911406335},{"type":"v1","addr":"172.21.15.155:6835","nonce":911406335}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:46.613321+0000","modified":"2020-05-18T21:33:47.617221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8365":{"gid":8365,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/299278803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":299278803},{"type":"v1","addr":"172.21.15.63:6833","nonce":299278803}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-05-18T21:33:47.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.935+0000 7fdbe9447700 1 -- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbc804f9c0 msgr2=0x7fdbc8051e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:47.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.935+0000 7fdbe9447700 1 --2- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbc804f9c0 0x7fdbc8051e80 secure :-1 s=READY pgs=591 cs=0 l=1 rx=0x7fdbd4002f70 tx=0x7fdbd400bf80).stop 2020-05-18T21:33:47.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.935+0000 7fdbe9447700 1 -- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbe4147af0 msgr2=0x7fdbe4147f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:47.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.935+0000 7fdbe9447700 1 --2- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbe4147af0 0x7fdbe4147f40 secure :-1 s=READY pgs=1015 cs=0 l=1 rx=0x7fdbcc001970 tx=0x7fdbdc009390).stop 2020-05-18T21:33:47.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.935+0000 7fdbe9447700 1 -- 172.21.15.63:0/3563141403 shutdown_connections 2020-05-18T21:33:47.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.935+0000 7fdbe9447700 1 --2- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdbc804f9c0 0x7fdbc8051e80 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:47.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.935+0000 7fdbe9447700 1 --2- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbe4147af0 0x7fdbe4147f40 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:47.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.935+0000 7fdbe9447700 1 --2- 172.21.15.63:0/3563141403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbe4156c90 0x7fdbe40b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:47.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.935+0000 7fdbe9447700 1 -- 172.21.15.63:0/3563141403 >> 172.21.15.63:0/3563141403 conn(0x7fdbe4069b70 msgr2=0x7fdbe4148710 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:47.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.935+0000 7fdbe9447700 1 -- 172.21.15.63:0/3563141403 shutdown_connections 2020-05-18T21:33:47.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:47.935+0000 7fdbe9447700 1 -- 172.21.15.63:0/3563141403 wait complete. 2020-05-18T21:33:47.942 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 86 2020-05-18T21:33:47.954 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:33:48.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f5754427700 1 Processor -- start 2020-05-18T21:33:48.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f5754427700 1 -- start start 2020-05-18T21:33:48.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f5754427700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f574c0bb5e0 0x7f574c0acee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:48.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f5754427700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f574c12efd0 0x7f574c12f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:48.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f5754427700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574c0af6e0 con 0x7f574c0bbcd0 2020-05-18T21:33:48.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f5754427700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574c0af980 con 0x7f574c0bb5e0 2020-05-18T21:33:48.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f5754427700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574c0b0530 con 0x7f574c12efd0 2020-05-18T21:33:48.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57519c2700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f574c0bbcd0 0x7f574c0afe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35010/0 (socket says 172.21.15.63:35010) 2020-05-18T21:33:48.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57519c2700 1 -- 172.21.15.63:0/3750239715 learned_addr learned my addr 172.21.15.63:0/3750239715 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:48.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57529c4700 1 --2- 172.21.15.63:0/3750239715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f574c12efd0 0x7f574c12f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57521c3700 1 --2- 172.21.15.63:0/3750239715 >> v2:172.21.15.155:3300/0 conn(0x7f574c0bb5e0 0x7f574c0acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57511c1700 1 -- 172.21.15.63:0/3750239715 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370634903 0 0) 0x7f574c0af6e0 con 0x7f574c0bbcd0 2020-05-18T21:33:48.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57511c1700 1 -- 172.21.15.63:0/3750239715 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f572c003270 con 0x7f574c0bbcd0 2020-05-18T21:33:48.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57511c1700 1 -- 172.21.15.63:0/3750239715 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2855150035 0 0) 0x7f572c003270 con 0x7f574c0bbcd0 2020-05-18T21:33:48.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57511c1700 1 -- 172.21.15.63:0/3750239715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f574c12efd0 msgr2=0x7f574c12f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:48.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57511c1700 1 --2- 172.21.15.63:0/3750239715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f574c12efd0 0x7f574c12f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:48.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57511c1700 1 -- 172.21.15.63:0/3750239715 >> v2:172.21.15.155:3300/0 conn(0x7f574c0bb5e0 msgr2=0x7f574c0acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:48.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57511c1700 1 --2- 172.21.15.63:0/3750239715 >> v2:172.21.15.155:3300/0 conn(0x7f574c0bb5e0 0x7f574c0acee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:48.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57511c1700 1 -- 172.21.15.63:0/3750239715 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574c0bb9c0 con 0x7f574c0bbcd0 2020-05-18T21:33:48.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57511c1700 1 -- 172.21.15.63:0/3750239715 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f573c001a90 con 0x7f574c0bbcd0 2020-05-18T21:33:48.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57511c1700 1 -- 172.21.15.63:0/3750239715 >> v1:172.21.15.63:6789/0 conn(0x7f574c0bbcd0 legacy=0x7f574c0afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57511c1700 1 --2- 172.21.15.63:0/3750239715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f572c003760 0x7f572c003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:48.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57511c1700 1 --2- 172.21.15.63:0/3750239715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f572c0040a0 0x7f572c004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:48.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57511c1700 1 --2- 172.21.15.63:0/3750239715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f574c12efd0 0x7f572c004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:48.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57511c1700 1 -- 172.21.15.63:0/3750239715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c0af980 con 0x7f572c003760 2020-05-18T21:33:48.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57511c1700 1 -- 172.21.15.63:0/3750239715 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c0b0530 con 0x7f572c0040a0 2020-05-18T21:33:48.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57511c1700 1 -- 172.21.15.63:0/3750239715 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c005030 con 0x7f574c12efd0 2020-05-18T21:33:48.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57521c3700 1 --2- 172.21.15.63:0/3750239715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f572c003760 0x7f572c003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57519c2700 1 --2- 172.21.15.63:0/3750239715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f572c0040a0 0x7f572c004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57529c4700 1 --2- 172.21.15.63:0/3750239715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f574c12efd0 0x7f572c004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57521c3700 1 -- 172.21.15.63:0/3750239715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f574c12efd0 msgr2=0x7f572c004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:48.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57521c3700 1 --2- 172.21.15.63:0/3750239715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f574c12efd0 0x7f572c004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:48.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57521c3700 1 -- 172.21.15.63:0/3750239715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f572c0040a0 msgr2=0x7f572c004570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:48.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57521c3700 1 --2- 172.21.15.63:0/3750239715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f572c0040a0 0x7f572c004570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:48.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57521c3700 1 -- 172.21.15.63:0/3750239715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c003270 con 0x7f572c003760 2020-05-18T21:33:48.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57519c2700 1 --2- 172.21.15.63:0/3750239715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f572c0040a0 0x7f572c004570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:33:48.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57521c3700 1 --2- 172.21.15.63:0/3750239715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f572c003760 0x7f572c003b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5734002f70 tx=0x7f5734010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57521c3700 1 --2- 172.21.15.63:0/3750239715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f572c003760 0x7f572c003b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5734002f70 tx=0x7f5734010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.051+0000 7f57521c3700 1 --2- 172.21.15.63:0/3750239715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f572c003760 0x7f572c003b80 secure :-1 s=READY pgs=1513 cs=0 l=1 rx=0x7f5734002f70 tx=0x7f5734010110).ready entity=mon.0 client_cookie=5948ab4a7eaa0537 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:48.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.055+0000 7f57521c3700 1 --2- 172.21.15.63:0/3750239715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f572c003760 0x7f572c003b80 secure :-1 s=THROTTLE_DONE pgs=1513 cs=0 l=1 rx=0x7f5734002f70 tx=0x7f5734010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.055+0000 7f57511c1700 1 -- 172.21.15.63:0/3750239715 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57340089b0 con 0x7f572c003760 2020-05-18T21:33:48.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.055+0000 7f57521c3700 1 --2- 172.21.15.63:0/3750239715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f572c003760 0x7f572c003b80 secure :-1 s=THROTTLE_DONE pgs=1513 cs=0 l=1 rx=0x7f5734002f70 tx=0x7f5734010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.055+0000 7f57521c3700 1 --2- 172.21.15.63:0/3750239715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f572c003760 0x7f572c003b80 secure :-1 s=THROTTLE_DONE pgs=1513 cs=0 l=1 rx=0x7f5734002f70 tx=0x7f5734010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.055+0000 7f57511c1700 1 -- 172.21.15.63:0/3750239715 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5734008b10 con 0x7f572c003760 2020-05-18T21:33:48.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.055+0000 7f57511c1700 1 -- 172.21.15.63:0/3750239715 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57340110d0 con 0x7f572c003760 2020-05-18T21:33:48.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.055+0000 7f5754427700 1 -- 172.21.15.63:0/3750239715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f572c003760 msgr2=0x7f572c003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.055+0000 7f5754427700 1 --2- 172.21.15.63:0/3750239715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f572c003760 0x7f572c003b80 secure :-1 s=READY pgs=1513 cs=0 l=1 rx=0x7f5734002f70 tx=0x7f5734010110).stop 2020-05-18T21:33:48.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.055+0000 7f57529c4700 1 -- 172.21.15.63:0/3750239715 reap_dead start 2020-05-18T21:33:48.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.055+0000 7f5754427700 1 -- 172.21.15.63:0/3750239715 shutdown_connections 2020-05-18T21:33:48.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.055+0000 7f5754427700 1 -- 172.21.15.63:0/3750239715 >> 172.21.15.63:0/3750239715 conn(0x7f574c069b70 msgr2=0x7f574c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:48.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.055+0000 7f5754427700 1 -- 172.21.15.63:0/3750239715 shutdown_connections 2020-05-18T21:33:48.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.055+0000 7f5754427700 1 -- 172.21.15.63:0/3750239715 wait complete. 2020-05-18T21:33:48.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.055+0000 7f5754427700 1 Processor -- start 2020-05-18T21:33:48.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.055+0000 7f5754427700 1 -- start start 2020-05-18T21:33:48.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f5754427700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f574c12c110 0x7f574c12d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:48.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f5754427700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f574c1157d0 0x7f574c157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:48.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f5754427700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574c12c620 con 0x7f574c12d590 2020-05-18T21:33:48.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f5754427700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574c12ddd0 con 0x7f574c1157d0 2020-05-18T21:33:48.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f5754427700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574c12c8c0 con 0x7f574c12c110 2020-05-18T21:33:48.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f57529c4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f574c1157d0 0x7f574c157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f57529c4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f574c1157d0 0x7f574c157170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32838/0 (socket says 172.21.15.63:32838) 2020-05-18T21:33:48.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f57529c4700 1 -- 172.21.15.63:0/2445475561 learned_addr learned my addr 172.21.15.63:0/2445475561 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:48.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f57519c2700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f574c12c110 0x7f574c12d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f57529c4700 1 -- 172.21.15.63:0/2445475561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f574c12c110 msgr2=0x7f574c12d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f57529c4700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f574c12c110 0x7f574c12d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:48.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f57529c4700 1 -- 172.21.15.63:0/2445475561 >> v1:172.21.15.155:6789/0 conn(0x7f574c12d590 legacy=0x7f574c1160d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f57529c4700 1 -- 172.21.15.63:0/2445475561 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574c115c60 con 0x7f574c1157d0 2020-05-18T21:33:48.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f57529c4700 1 --2- 172.21.15.63:0/2445475561 >> v2:172.21.15.63:3300/0 conn(0x7f574c1157d0 0x7f574c157170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f573c001cf0 tx=0x7f57440108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f57529c4700 1 --2- 172.21.15.63:0/2445475561 >> v2:172.21.15.63:3300/0 conn(0x7f574c1157d0 0x7f574c157170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f573c001cf0 tx=0x7f57440108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f57529c4700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574c1157d0 0x7f574c157170 secure :-1 s=READY pgs=1514 cs=0 l=1 rx=0x7f573c001cf0 tx=0x7f57440108b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:48.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f57529c4700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574c1157d0 0x7f574c157170 secure :-1 s=THROTTLE_DONE pgs=1514 cs=0 l=1 rx=0x7f573c001cf0 tx=0x7f57440108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f574b7fe700 1 -- 172.21.15.63:0/2445475561 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5744007560 con 0x7f574c1157d0 2020-05-18T21:33:48.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f57529c4700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574c1157d0 0x7f574c157170 secure :-1 s=THROTTLE_DONE pgs=1514 cs=0 l=1 rx=0x7f573c001cf0 tx=0x7f57440108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f57529c4700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574c1157d0 0x7f574c157170 secure :-1 s=THROTTLE_DONE pgs=1514 cs=0 l=1 rx=0x7f573c001cf0 tx=0x7f57440108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f574b7fe700 1 -- 172.21.15.63:0/2445475561 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5744005a00 con 0x7f574c1157d0 2020-05-18T21:33:48.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f574b7fe700 1 -- 172.21.15.63:0/2445475561 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5744005de0 con 0x7f574c1157d0 2020-05-18T21:33:48.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f5754427700 1 -- 172.21.15.63:0/2445475561 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f574c1575d0 con 0x7f574c1157d0 2020-05-18T21:33:48.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f5754427700 1 -- 172.21.15.63:0/2445475561 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f574c153580 con 0x7f574c1157d0 2020-05-18T21:33:48.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f57529c4700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574c1157d0 0x7f574c157170 secure :-1 s=THROTTLE_DONE pgs=1514 cs=0 l=1 rx=0x7f573c001cf0 tx=0x7f57440108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.059+0000 7f5754427700 1 -- 172.21.15.63:0/2445475561 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f574c12cac0 con 0x7f574c1157d0 2020-05-18T21:33:48.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.063+0000 7f574b7fe700 1 -- 172.21.15.63:0/2445475561 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f574400a280 con 0x7f574c1157d0 2020-05-18T21:33:48.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.063+0000 7f57529c4700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574c1157d0 0x7f574c157170 secure :-1 s=THROTTLE_DONE pgs=1514 cs=0 l=1 rx=0x7f573c001cf0 tx=0x7f57440108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.063+0000 7f574b7fe700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f573004f900 0x7f5730051dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:48.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.063+0000 7f574b7fe700 1 -- 172.21.15.63:0/2445475561 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5744063580 con 0x7f574c1157d0 2020-05-18T21:33:48.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.063+0000 7f57521c3700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f573004f900 0x7f5730051dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.063+0000 7f57521c3700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f573004f900 0x7f5730051dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f574c0b8960 tx=0x7f5734010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.063+0000 7f57521c3700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f573004f900 0x7f5730051dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f574c0b8960 tx=0x7f5734010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.063+0000 7f57521c3700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f573004f900 0x7f5730051dc0 secure :-1 s=READY pgs=592 cs=0 l=1 rx=0x7f574c0b8960 tx=0x7f5734010110).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:48.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.071+0000 7f57529c4700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574c1157d0 0x7f574c157170 secure :-1 s=THROTTLE_DONE pgs=1514 cs=0 l=1 rx=0x7f573c001cf0 tx=0x7f57440108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.071+0000 7f574b7fe700 1 -- 172.21.15.63:0/2445475561 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f574403d910 con 0x7f574c1157d0 2020-05-18T21:33:48.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.187+0000 7f5754427700 1 -- 172.21.15.63:0/2445475561 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f574c0569e0 con 0x7f574c1157d0 2020-05-18T21:33:48.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.191+0000 7f57529c4700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574c1157d0 0x7f574c157170 secure :-1 s=THROTTLE_DONE pgs=1514 cs=0 l=1 rx=0x7f573c001cf0 tx=0x7f57440108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.191+0000 7f574b7fe700 1 -- 172.21.15.63:0/2445475561 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f5744040f30 con 0x7f574c1157d0 2020-05-18T21:33:48.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.191+0000 7f5754427700 1 -- 172.21.15.63:0/2445475561 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f573004f900 msgr2=0x7f5730051dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.191+0000 7f5754427700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f573004f900 0x7f5730051dc0 secure :-1 s=READY pgs=592 cs=0 l=1 rx=0x7f574c0b8960 tx=0x7f5734010110).stop 2020-05-18T21:33:48.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.191+0000 7f5754427700 1 -- 172.21.15.63:0/2445475561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574c1157d0 msgr2=0x7f574c157170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.191+0000 7f5754427700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574c1157d0 0x7f574c157170 secure :-1 s=READY pgs=1514 cs=0 l=1 rx=0x7f573c001cf0 tx=0x7f57440108b0).stop 2020-05-18T21:33:48.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.191+0000 7f5754427700 1 -- 172.21.15.63:0/2445475561 shutdown_connections 2020-05-18T21:33:48.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.191+0000 7f5754427700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f573004f900 0x7f5730051dc0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:48.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.191+0000 7f5754427700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574c1157d0 0x7f574c157170 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:48.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.191+0000 7f5754427700 1 --2- 172.21.15.63:0/2445475561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f574c12c110 0x7f574c12d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:48.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.191+0000 7f5754427700 1 -- 172.21.15.63:0/2445475561 >> 172.21.15.63:0/2445475561 conn(0x7f574c069b70 msgr2=0x7f574c148850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:48.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.191+0000 7f5754427700 1 -- 172.21.15.63:0/2445475561 shutdown_connections 2020-05-18T21:33:48.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.191+0000 7f5754427700 1 -- 172.21.15.63:0/2445475561 wait complete. 2020-05-18T21:33:48.200 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:48.200 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":114,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:33:47.617336+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:33:45.188898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2020-05-18T21:33:45.614699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:33:48.207 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:33:48.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2983147700 1 Processor -- start 2020-05-18T21:33:48.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2983147700 1 -- start start 2020-05-18T21:33:48.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2983147700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f297c0b6cd0 0x7f297c1522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:48.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2983147700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297c025500 con 0x7f297c0b6410 2020-05-18T21:33:48.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2983147700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297c064ee0 con 0x7f297c0b5cb0 2020-05-18T21:33:48.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2983147700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f297c0b67f0 con 0x7f297c0b6cd0 2020-05-18T21:33:48.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2982946700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f297c0b6410 0x7f297c061af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35032/0 (socket says 172.21.15.63:35032) 2020-05-18T21:33:48.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2982946700 1 -- 172.21.15.63:0/3459863106 learned_addr learned my addr 172.21.15.63:0/3459863106 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:48.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f29843a9700 1 --2- 172.21.15.63:0/3459863106 >> v2:172.21.15.155:3300/0 conn(0x7f297c0b6cd0 0x7f297c1522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2981944700 1 -- 172.21.15.63:0/3459863106 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306651333 0 0) 0x7f297c025500 con 0x7f297c0b6410 2020-05-18T21:33:48.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2981944700 1 -- 172.21.15.63:0/3459863106 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2968003270 con 0x7f297c0b6410 2020-05-18T21:33:48.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2981944700 1 -- 172.21.15.63:0/3459863106 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2478152338 0 0) 0x7f2968003270 con 0x7f297c0b6410 2020-05-18T21:33:48.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2981944700 1 -- 172.21.15.63:0/3459863106 >> v2:172.21.15.155:3300/0 conn(0x7f297c0b6cd0 msgr2=0x7f297c1522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:48.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2981944700 1 --2- 172.21.15.63:0/3459863106 >> v2:172.21.15.155:3300/0 conn(0x7f297c0b6cd0 0x7f297c1522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:48.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2981944700 1 -- 172.21.15.63:0/3459863106 >> v1:172.21.15.155:6789/0 conn(0x7f297c0b5cb0 legacy=0x7f297c151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2981944700 1 -- 172.21.15.63:0/3459863106 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c025180 con 0x7f297c0b6410 2020-05-18T21:33:48.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2981944700 1 -- 172.21.15.63:0/3459863106 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f2978001710 con 0x7f297c0b6410 2020-05-18T21:33:48.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2981944700 1 -- 172.21.15.63:0/3459863106 >> v1:172.21.15.63:6789/0 conn(0x7f297c0b6410 legacy=0x7f297c061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2981944700 1 --2- 172.21.15.63:0/3459863106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968003760 0x7f2968003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:48.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2981944700 1 --2- 172.21.15.63:0/3459863106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2968004510 0x7f2968004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:48.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2981944700 1 --2- 172.21.15.63:0/3459863106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2968004df0 0x7f296800b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:48.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2981944700 1 -- 172.21.15.63:0/3459863106 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c0b67f0 con 0x7f2968003760 2020-05-18T21:33:48.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2981944700 1 -- 172.21.15.63:0/3459863106 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2968004200 con 0x7f2968004510 2020-05-18T21:33:48.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2981944700 1 -- 172.21.15.63:0/3459863106 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296804fbd0 con 0x7f2968004df0 2020-05-18T21:33:48.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f29843a9700 1 --2- 172.21.15.63:0/3459863106 >> v2:172.21.15.155:3300/0 conn(0x7f297c0b6cd0 0x7f297c1522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:48.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2982946700 1 --2- 172.21.15.63:0/3459863106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968003760 0x7f2968003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2982145700 1 --2- 172.21.15.63:0/3459863106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2968004510 0x7f2968004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f29843a9700 1 --2- 172.21.15.63:0/3459863106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2968004df0 0x7f296800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2982946700 1 -- 172.21.15.63:0/3459863106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2968004df0 msgr2=0x7f296800b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:48.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2982946700 1 --2- 172.21.15.63:0/3459863106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2968004df0 0x7f296800b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:48.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2982946700 1 -- 172.21.15.63:0/3459863106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2968004510 msgr2=0x7f2968004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:48.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f2982946700 1 --2- 172.21.15.63:0/3459863106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2968004510 0x7f2968004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:48.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.319+0000 7f29843a9700 1 -- 172.21.15.63:0/3459863106 reap_dead start 2020-05-18T21:33:48.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.323+0000 7f2982946700 1 -- 172.21.15.63:0/3459863106 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2968003270 con 0x7f2968003760 2020-05-18T21:33:48.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.323+0000 7f2982946700 1 --2- 172.21.15.63:0/3459863106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968003760 0x7f2968003b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2978001420 tx=0x7f297c025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.323+0000 7f2982946700 1 --2- 172.21.15.63:0/3459863106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968003760 0x7f2968003b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2978001420 tx=0x7f297c025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.323+0000 7f2982946700 1 --2- 172.21.15.63:0/3459863106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968003760 0x7f2968003b80 secure :-1 s=READY pgs=1516 cs=0 l=1 rx=0x7f2978001420 tx=0x7f297c025310).ready entity=mon.0 client_cookie=5de4776b8d283021 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:48.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.323+0000 7f2982946700 1 --2- 172.21.15.63:0/3459863106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968003760 0x7f2968003b80 secure :-1 s=THROTTLE_DONE pgs=1516 cs=0 l=1 rx=0x7f2978001420 tx=0x7f297c025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.323+0000 7f2981944700 1 -- 172.21.15.63:0/3459863106 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f297800e370 con 0x7f2968003760 2020-05-18T21:33:48.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.323+0000 7f2982946700 1 --2- 172.21.15.63:0/3459863106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968003760 0x7f2968003b80 secure :-1 s=THROTTLE_DONE pgs=1516 cs=0 l=1 rx=0x7f2978001420 tx=0x7f297c025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.323+0000 7f2981944700 1 -- 172.21.15.63:0/3459863106 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297800e4d0 con 0x7f2968003760 2020-05-18T21:33:48.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.323+0000 7f2982946700 1 --2- 172.21.15.63:0/3459863106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968003760 0x7f2968003b80 secure :-1 s=THROTTLE_DONE pgs=1516 cs=0 l=1 rx=0x7f2978001420 tx=0x7f297c025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.323+0000 7f2981944700 1 -- 172.21.15.63:0/3459863106 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f297800e640 con 0x7f2968003760 2020-05-18T21:33:48.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.323+0000 7f2983147700 1 -- 172.21.15.63:0/3459863106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968003760 msgr2=0x7f2968003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.323+0000 7f2983147700 1 --2- 172.21.15.63:0/3459863106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968003760 0x7f2968003b80 secure :-1 s=READY pgs=1516 cs=0 l=1 rx=0x7f2978001420 tx=0x7f297c025310).stop 2020-05-18T21:33:48.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.323+0000 7f2983147700 1 -- 172.21.15.63:0/3459863106 shutdown_connections 2020-05-18T21:33:48.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.323+0000 7f2983147700 1 --2- 172.21.15.63:0/3459863106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968003760 0x7f2968003b80 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:48.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.323+0000 7f2983147700 1 -- 172.21.15.63:0/3459863106 >> 172.21.15.63:0/3459863106 conn(0x7f297c069b70 msgr2=0x7f297c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:48.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.323+0000 7f2983147700 1 -- 172.21.15.63:0/3459863106 shutdown_connections 2020-05-18T21:33:48.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.323+0000 7f2983147700 1 -- 172.21.15.63:0/3459863106 wait complete. 2020-05-18T21:33:48.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.323+0000 7f2983147700 1 Processor -- start 2020-05-18T21:33:48.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.323+0000 7f2983147700 1 -- start start 2020-05-18T21:33:48.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f2983147700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2968003760 0x7f297c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:48.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f2983147700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297c156ad0 con 0x7f297c0b5330 2020-05-18T21:33:48.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f2983147700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297c1533a0 con 0x7f297c156340 2020-05-18T21:33:48.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f2983147700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f297c0b4270 con 0x7f2968003760 2020-05-18T21:33:48.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f2982145700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f297c0b5330 0x7f297c0b9630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35044/0 (socket says 172.21.15.63:35044) 2020-05-18T21:33:48.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f2982145700 1 -- 172.21.15.63:0/1488254355 learned_addr learned my addr 172.21.15.63:0/1488254355 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:48.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f2982946700 1 --2- 172.21.15.63:0/1488254355 >> v2:172.21.15.155:3300/0 conn(0x7f2968003760 0x7f297c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f29737fe700 1 -- 172.21.15.63:0/1488254355 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945024975 0 0) 0x7f297c156ad0 con 0x7f297c0b5330 2020-05-18T21:33:48.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f29737fe700 1 -- 172.21.15.63:0/1488254355 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2964003270 con 0x7f297c0b5330 2020-05-18T21:33:48.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f2982946700 1 -- 172.21.15.63:0/1488254355 >> v1:172.21.15.155:6789/0 conn(0x7f297c156340 legacy=0x7f297c1537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f2982946700 1 -- 172.21.15.63:0/1488254355 >> v1:172.21.15.63:6789/0 conn(0x7f297c0b5330 legacy=0x7f297c0b9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f29737fe700 1 -- 172.21.15.63:0/1488254355 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3425152167 0 0) 0x7f2964003270 con 0x7f297c0b5330 2020-05-18T21:33:48.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f2982946700 1 -- 172.21.15.63:0/1488254355 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c0b44e0 con 0x7f2968003760 2020-05-18T21:33:48.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f2982946700 1 --2- 172.21.15.63:0/1488254355 >> v2:172.21.15.155:3300/0 conn(0x7f2968003760 0x7f297c0b4d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2978001420 tx=0x7f297c025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f2982946700 1 --2- 172.21.15.63:0/1488254355 >> v2:172.21.15.155:3300/0 conn(0x7f2968003760 0x7f297c0b4d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2978001420 tx=0x7f297c025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f2982946700 1 --2- 172.21.15.63:0/1488254355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2968003760 0x7f297c0b4d00 secure :-1 s=READY pgs=1019 cs=0 l=1 rx=0x7f2978001420 tx=0x7f297c025310).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:48.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f2982946700 1 --2- 172.21.15.63:0/1488254355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2968003760 0x7f297c0b4d00 secure :-1 s=THROTTLE_DONE pgs=1019 cs=0 l=1 rx=0x7f2978001420 tx=0x7f297c025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f29737fe700 1 -- 172.21.15.63:0/1488254355 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29780150c0 con 0x7f2968003760 2020-05-18T21:33:48.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f2982946700 1 --2- 172.21.15.63:0/1488254355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2968003760 0x7f297c0b4d00 secure :-1 s=THROTTLE_DONE pgs=1019 cs=0 l=1 rx=0x7f2978001420 tx=0x7f297c025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f2983147700 1 -- 172.21.15.63:0/1488254355 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297c0b4780 con 0x7f2968003760 2020-05-18T21:33:48.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f29737fe700 1 -- 172.21.15.63:0/1488254355 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297800e6e0 con 0x7f2968003760 2020-05-18T21:33:48.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f2982946700 1 --2- 172.21.15.63:0/1488254355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2968003760 0x7f297c0b4d00 secure :-1 s=THROTTLE_DONE pgs=1019 cs=0 l=1 rx=0x7f2978001420 tx=0x7f297c025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f29737fe700 1 -- 172.21.15.63:0/1488254355 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29780100c0 con 0x7f2968003760 2020-05-18T21:33:48.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.327+0000 7f2983147700 1 -- 172.21.15.63:0/1488254355 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297c0b35d0 con 0x7f2968003760 2020-05-18T21:33:48.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.331+0000 7f2982946700 1 --2- 172.21.15.63:0/1488254355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2968003760 0x7f297c0b4d00 secure :-1 s=THROTTLE_DONE pgs=1019 cs=0 l=1 rx=0x7f2978001420 tx=0x7f297c025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.331+0000 7f2983147700 1 -- 172.21.15.63:0/1488254355 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297c156770 con 0x7f2968003760 2020-05-18T21:33:48.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.331+0000 7f29737fe700 1 -- 172.21.15.63:0/1488254355 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f29780102c0 con 0x7f2968003760 2020-05-18T21:33:48.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.331+0000 7f2982946700 1 --2- 172.21.15.63:0/1488254355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2968003760 0x7f297c0b4d00 secure :-1 s=THROTTLE_DONE pgs=1019 cs=0 l=1 rx=0x7f2978001420 tx=0x7f297c025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.331+0000 7f29737fe700 1 --2- 172.21.15.63:0/1488254355 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f296404fcd0 0x7f2964052190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:48.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.331+0000 7f29737fe700 1 -- 172.21.15.63:0/1488254355 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2978063fe0 con 0x7f2968003760 2020-05-18T21:33:48.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.331+0000 7f2982145700 1 --2- 172.21.15.63:0/1488254355 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f296404fcd0 0x7f2964052190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.331+0000 7f2982145700 1 --2- 172.21.15.63:0/1488254355 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f296404fcd0 0x7f2964052190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f296c0014f0 tx=0x7f296c00cda0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.331+0000 7f2982145700 1 --2- 172.21.15.63:0/1488254355 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f296404fcd0 0x7f2964052190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f296c0014f0 tx=0x7f296c00cda0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.331+0000 7f2982145700 1 --2- 172.21.15.63:0/1488254355 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f296404fcd0 0x7f2964052190 secure :-1 s=READY pgs=593 cs=0 l=1 rx=0x7f296c0014f0 tx=0x7f296c00cda0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:48.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.343+0000 7f2982946700 1 --2- 172.21.15.63:0/1488254355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2968003760 0x7f297c0b4d00 secure :-1 s=THROTTLE_DONE pgs=1019 cs=0 l=1 rx=0x7f2978001420 tx=0x7f297c025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.343+0000 7f29737fe700 1 -- 172.21.15.63:0/1488254355 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f297803e430 con 0x7f2968003760 2020-05-18T21:33:48.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.495+0000 7f2983147700 1 -- 172.21.15.63:0/1488254355 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f297c0569e0 con 0x7f2968003760 2020-05-18T21:33:48.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.503+0000 7f2982946700 1 --2- 172.21.15.63:0/1488254355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2968003760 0x7f297c0b4d00 secure :-1 s=THROTTLE_DONE pgs=1019 cs=0 l=1 rx=0x7f2978001420 tx=0x7f297c025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.503+0000 7f29737fe700 1 -- 172.21.15.63:0/1488254355 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v43) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2978041a50 con 0x7f2968003760 2020-05-18T21:33:48.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.507+0000 7f2983147700 1 -- 172.21.15.63:0/1488254355 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f296404fcd0 msgr2=0x7f2964052190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.507+0000 7f2983147700 1 --2- 172.21.15.63:0/1488254355 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f296404fcd0 0x7f2964052190 secure :-1 s=READY pgs=593 cs=0 l=1 rx=0x7f296c0014f0 tx=0x7f296c00cda0).stop 2020-05-18T21:33:48.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.507+0000 7f2983147700 1 -- 172.21.15.63:0/1488254355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2968003760 msgr2=0x7f297c0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.507+0000 7f2983147700 1 --2- 172.21.15.63:0/1488254355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2968003760 0x7f297c0b4d00 secure :-1 s=READY pgs=1019 cs=0 l=1 rx=0x7f2978001420 tx=0x7f297c025310).stop 2020-05-18T21:33:48.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.507+0000 7f2983147700 1 -- 172.21.15.63:0/1488254355 shutdown_connections 2020-05-18T21:33:48.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.507+0000 7f2983147700 1 --2- 172.21.15.63:0/1488254355 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f296404fcd0 0x7f2964052190 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:48.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.507+0000 7f2983147700 1 --2- 172.21.15.63:0/1488254355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2968003760 0x7f297c0b4d00 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:48.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.507+0000 7f2983147700 1 -- 172.21.15.63:0/1488254355 >> 172.21.15.63:0/1488254355 conn(0x7f297c069b70 msgr2=0x7f297c024770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:48.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.507+0000 7f2983147700 1 -- 172.21.15.63:0/1488254355 shutdown_connections 2020-05-18T21:33:48.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.507+0000 7f2983147700 1 -- 172.21.15.63:0/1488254355 wait complete. 2020-05-18T21:33:48.515 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.0 2020-05-18T21:33:48.529 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:33:48.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26d1f00700 1 Processor -- start 2020-05-18T21:33:48.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26d1f00700 1 -- start start 2020-05-18T21:33:48.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26d1f00700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26cc0b5cb0 0x7f26cc0b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:48.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26d1f00700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc025500 con 0x7f26cc0b6410 2020-05-18T21:33:48.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26d1f00700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc064ee0 con 0x7f26cc151bc0 2020-05-18T21:33:48.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26d1f00700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0b67f0 con 0x7f26cc0b5cb0 2020-05-18T21:33:48.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26d16ff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f26cc0b6410 0x7f26cc061af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35050/0 (socket says 172.21.15.63:35050) 2020-05-18T21:33:48.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26d16ff700 1 -- 172.21.15.63:0/1794230898 learned_addr learned my addr 172.21.15.63:0/1794230898 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:48.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26d0efe700 1 --2- 172.21.15.63:0/1794230898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26cc0b5cb0 0x7f26cc0b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26bffff700 1 -- 172.21.15.63:0/1794230898 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625467160 0 0) 0x7f26cc025500 con 0x7f26cc0b6410 2020-05-18T21:33:48.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26bffff700 1 -- 172.21.15.63:0/1794230898 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26b8003270 con 0x7f26cc0b6410 2020-05-18T21:33:48.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26bffff700 1 -- 172.21.15.63:0/1794230898 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 288471207 0 0) 0x7f26b8003270 con 0x7f26cc0b6410 2020-05-18T21:33:48.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26bffff700 1 -- 172.21.15.63:0/1794230898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26cc0b5cb0 msgr2=0x7f26cc0b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:48.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26bffff700 1 --2- 172.21.15.63:0/1794230898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26cc0b5cb0 0x7f26cc0b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:48.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26bffff700 1 -- 172.21.15.63:0/1794230898 >> v1:172.21.15.155:6789/0 conn(0x7f26cc151bc0 legacy=0x7f26cc152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26bffff700 1 -- 172.21.15.63:0/1794230898 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc025180 con 0x7f26cc0b6410 2020-05-18T21:33:48.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26bffff700 1 -- 172.21.15.63:0/1794230898 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f26c8001710 con 0x7f26cc0b6410 2020-05-18T21:33:48.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26d0efe700 1 --2- 172.21.15.63:0/1794230898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26cc0b5cb0 0x7f26cc0b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:48.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26bffff700 1 -- 172.21.15.63:0/1794230898 >> v1:172.21.15.63:6789/0 conn(0x7f26cc0b6410 legacy=0x7f26cc061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26bffff700 1 --2- 172.21.15.63:0/1794230898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b8003790 0x7f26b8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:48.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.643+0000 7f26bffff700 1 --2- 172.21.15.63:0/1794230898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26cc0b5cb0 0x7f26b8004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:48.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26bffff700 1 --2- 172.21.15.63:0/1794230898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26b8004970 0x7f26b8004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:48.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26bffff700 1 -- 172.21.15.63:0/1794230898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0b67f0 con 0x7f26b8003790 2020-05-18T21:33:48.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26bffff700 1 -- 172.21.15.63:0/1794230898 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b80053d0 con 0x7f26b8004970 2020-05-18T21:33:48.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26bffff700 1 -- 172.21.15.63:0/1794230898 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b8004170 con 0x7f26cc0b5cb0 2020-05-18T21:33:48.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d16ff700 1 --2- 172.21.15.63:0/1794230898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b8003790 0x7f26b8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d0efe700 1 --2- 172.21.15.63:0/1794230898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26cc0b5cb0 0x7f26b8004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d3162700 1 --2- 172.21.15.63:0/1794230898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26b8004970 0x7f26b8004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d16ff700 1 -- 172.21.15.63:0/1794230898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26cc0b5cb0 msgr2=0x7f26b8004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:48.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d16ff700 1 --2- 172.21.15.63:0/1794230898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26cc0b5cb0 0x7f26b8004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:48.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d16ff700 1 -- 172.21.15.63:0/1794230898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26b8004970 msgr2=0x7f26b8004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:48.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d16ff700 1 --2- 172.21.15.63:0/1794230898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26b8004970 0x7f26b8004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:48.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d16ff700 1 -- 172.21.15.63:0/1794230898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b8003270 con 0x7f26b8003790 2020-05-18T21:33:48.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d16ff700 1 --2- 172.21.15.63:0/1794230898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b8003790 0x7f26b8003b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f26c8001420 tx=0x7f26cc025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d16ff700 1 --2- 172.21.15.63:0/1794230898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b8003790 0x7f26b8003b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f26c8001420 tx=0x7f26cc025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d16ff700 1 --2- 172.21.15.63:0/1794230898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b8003790 0x7f26b8003b70 secure :-1 s=READY pgs=1519 cs=0 l=1 rx=0x7f26c8001420 tx=0x7f26cc025310).ready entity=mon.0 client_cookie=f95250bdb12062cd server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:48.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d16ff700 1 --2- 172.21.15.63:0/1794230898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b8003790 0x7f26b8003b70 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7f26c8001420 tx=0x7f26cc025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26bffff700 1 -- 172.21.15.63:0/1794230898 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26c800e180 con 0x7f26b8003790 2020-05-18T21:33:48.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d16ff700 1 --2- 172.21.15.63:0/1794230898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b8003790 0x7f26b8003b70 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7f26c8001420 tx=0x7f26cc025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26bffff700 1 -- 172.21.15.63:0/1794230898 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c800e2e0 con 0x7f26b8003790 2020-05-18T21:33:48.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d16ff700 1 --2- 172.21.15.63:0/1794230898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b8003790 0x7f26b8003b70 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7f26c8001420 tx=0x7f26cc025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d1f00700 1 -- 172.21.15.63:0/1794230898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b8003790 msgr2=0x7f26b8003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26bffff700 1 -- 172.21.15.63:0/1794230898 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26c80100c0 con 0x7f26b8003790 2020-05-18T21:33:48.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d1f00700 1 --2- 172.21.15.63:0/1794230898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b8003790 0x7f26b8003b70 secure :-1 s=READY pgs=1519 cs=0 l=1 rx=0x7f26c8001420 tx=0x7f26cc025310).stop 2020-05-18T21:33:48.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d3162700 1 -- 172.21.15.63:0/1794230898 reap_dead start 2020-05-18T21:33:48.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d1f00700 1 -- 172.21.15.63:0/1794230898 shutdown_connections 2020-05-18T21:33:48.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d1f00700 1 -- 172.21.15.63:0/1794230898 >> 172.21.15.63:0/1794230898 conn(0x7f26cc069b70 msgr2=0x7f26cc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:48.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d1f00700 1 -- 172.21.15.63:0/1794230898 shutdown_connections 2020-05-18T21:33:48.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d1f00700 1 -- 172.21.15.63:0/1794230898 wait complete. 2020-05-18T21:33:48.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d1f00700 1 Processor -- start 2020-05-18T21:33:48.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.647+0000 7f26d1f00700 1 -- start start 2020-05-18T21:33:48.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26d1f00700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f26cc0b2120 0x7f26cc0afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:48.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26d1f00700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc0b1570 con 0x7f26cc065650 2020-05-18T21:33:48.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26d1f00700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc0add80 con 0x7f26cc0acea0 2020-05-18T21:33:48.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26d1f00700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc065a30 con 0x7f26cc0b2120 2020-05-18T21:33:48.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26d16ff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f26cc065650 0x7f26cc0ad670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35060/0 (socket says 172.21.15.63:35060) 2020-05-18T21:33:48.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26d16ff700 1 -- 172.21.15.63:0/1592318551 learned_addr learned my addr 172.21.15.63:0/1592318551 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:48.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26d3162700 1 --2- 172.21.15.63:0/1592318551 >> v2:172.21.15.63:3300/0 conn(0x7f26cc0b2120 0x7f26cc0afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26d3162700 1 -- 172.21.15.63:0/1592318551 >> v1:172.21.15.155:6789/0 conn(0x7f26cc0acea0 legacy=0x7f26cc0b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26d3162700 1 -- 172.21.15.63:0/1592318551 >> v1:172.21.15.63:6789/0 conn(0x7f26cc065650 legacy=0x7f26cc0ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26bdffb700 1 -- 172.21.15.63:0/1592318551 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845142837 0 0) 0x7f26cc0b1570 con 0x7f26cc065650 2020-05-18T21:33:48.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26d3162700 1 -- 172.21.15.63:0/1592318551 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc0b52c0 con 0x7f26cc0b2120 2020-05-18T21:33:48.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26d3162700 1 --2- 172.21.15.63:0/1592318551 >> v2:172.21.15.63:3300/0 conn(0x7f26cc0b2120 0x7f26cc0afb40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26c80018f0 tx=0x7f26c4010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26d3162700 1 --2- 172.21.15.63:0/1592318551 >> v2:172.21.15.63:3300/0 conn(0x7f26cc0b2120 0x7f26cc0afb40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26c80018f0 tx=0x7f26c4010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26d3162700 1 --2- 172.21.15.63:0/1592318551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26cc0b2120 0x7f26cc0afb40 secure :-1 s=READY pgs=1521 cs=0 l=1 rx=0x7f26c80018f0 tx=0x7f26c4010e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:48.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26d3162700 1 --2- 172.21.15.63:0/1592318551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26cc0b2120 0x7f26cc0afb40 secure :-1 s=THROTTLE_DONE pgs=1521 cs=0 l=1 rx=0x7f26c80018f0 tx=0x7f26c4010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26bdffb700 1 -- 172.21.15.63:0/1592318551 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26c4003560 con 0x7f26cc0b2120 2020-05-18T21:33:48.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26d3162700 1 --2- 172.21.15.63:0/1592318551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26cc0b2120 0x7f26cc0afb40 secure :-1 s=THROTTLE_DONE pgs=1521 cs=0 l=1 rx=0x7f26c80018f0 tx=0x7f26c4010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26d3162700 1 --2- 172.21.15.63:0/1592318551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26cc0b2120 0x7f26cc0afb40 secure :-1 s=THROTTLE_DONE pgs=1521 cs=0 l=1 rx=0x7f26c80018f0 tx=0x7f26c4010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26bdffb700 1 -- 172.21.15.63:0/1592318551 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c40036c0 con 0x7f26cc0b2120 2020-05-18T21:33:48.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26d1f00700 1 -- 172.21.15.63:0/1592318551 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26cc0b1260 con 0x7f26cc0b2120 2020-05-18T21:33:48.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26bdffb700 1 -- 172.21.15.63:0/1592318551 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26c4003a20 con 0x7f26cc0b2120 2020-05-18T21:33:48.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.651+0000 7f26d1f00700 1 -- 172.21.15.63:0/1592318551 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc07fb80 con 0x7f26cc0b2120 2020-05-18T21:33:48.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.655+0000 7f26d3162700 1 --2- 172.21.15.63:0/1592318551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26cc0b2120 0x7f26cc0afb40 secure :-1 s=THROTTLE_DONE pgs=1521 cs=0 l=1 rx=0x7f26c80018f0 tx=0x7f26c4010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.655+0000 7f26d1f00700 1 -- 172.21.15.63:0/1592318551 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26cc0b1700 con 0x7f26cc0b2120 2020-05-18T21:33:48.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.655+0000 7f26bdffb700 1 -- 172.21.15.63:0/1592318551 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f26c4003b80 con 0x7f26cc0b2120 2020-05-18T21:33:48.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.655+0000 7f26d3162700 1 --2- 172.21.15.63:0/1592318551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26cc0b2120 0x7f26cc0afb40 secure :-1 s=THROTTLE_DONE pgs=1521 cs=0 l=1 rx=0x7f26c80018f0 tx=0x7f26c4010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.655+0000 7f26bdffb700 1 --2- 172.21.15.63:0/1592318551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f26ac04f920 0x7f26ac051de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:48.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.655+0000 7f26bdffb700 1 -- 172.21.15.63:0/1592318551 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f26c4063960 con 0x7f26cc0b2120 2020-05-18T21:33:48.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.655+0000 7f26d16ff700 1 --2- 172.21.15.63:0/1592318551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f26ac04f920 0x7f26ac051de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.655+0000 7f26d16ff700 1 --2- 172.21.15.63:0/1592318551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f26ac04f920 0x7f26ac051de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26c800b940 tx=0x7f26cc025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.655+0000 7f26d16ff700 1 --2- 172.21.15.63:0/1592318551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f26ac04f920 0x7f26ac051de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26c800b940 tx=0x7f26cc025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.655+0000 7f26d16ff700 1 --2- 172.21.15.63:0/1592318551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f26ac04f920 0x7f26ac051de0 secure :-1 s=READY pgs=594 cs=0 l=1 rx=0x7f26c800b940 tx=0x7f26cc025310).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:48.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.659+0000 7f26d3162700 1 --2- 172.21.15.63:0/1592318551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26cc0b2120 0x7f26cc0afb40 secure :-1 s=THROTTLE_DONE pgs=1521 cs=0 l=1 rx=0x7f26c80018f0 tx=0x7f26c4010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.659+0000 7f26bdffb700 1 -- 172.21.15.63:0/1592318551 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f26c403ddb0 con 0x7f26cc0b2120 2020-05-18T21:33:48.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.811+0000 7f26d1f00700 1 -- 172.21.15.63:0/1592318551 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f26cc0569e0 con 0x7f26cc0b2120 2020-05-18T21:33:48.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.819+0000 7f26d3162700 1 --2- 172.21.15.63:0/1592318551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26cc0b2120 0x7f26cc0afb40 secure :-1 s=THROTTLE_DONE pgs=1521 cs=0 l=1 rx=0x7f26c80018f0 tx=0x7f26c4010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.819+0000 7f26bdffb700 1 -- 172.21.15.63:0/1592318551 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v44) v1 ==== 184+0+0 (secure 0 0 0) 0x7f26c40413d0 con 0x7f26cc0b2120 2020-05-18T21:33:48.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.819+0000 7f26d1f00700 1 -- 172.21.15.63:0/1592318551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f26ac04f920 msgr2=0x7f26ac051de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.819+0000 7f26d1f00700 1 --2- 172.21.15.63:0/1592318551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f26ac04f920 0x7f26ac051de0 secure :-1 s=READY pgs=594 cs=0 l=1 rx=0x7f26c800b940 tx=0x7f26cc025310).stop 2020-05-18T21:33:48.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.819+0000 7f26d1f00700 1 -- 172.21.15.63:0/1592318551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26cc0b2120 msgr2=0x7f26cc0afb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.819+0000 7f26d1f00700 1 --2- 172.21.15.63:0/1592318551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26cc0b2120 0x7f26cc0afb40 secure :-1 s=READY pgs=1521 cs=0 l=1 rx=0x7f26c80018f0 tx=0x7f26c4010e30).stop 2020-05-18T21:33:48.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.819+0000 7f26d1f00700 1 -- 172.21.15.63:0/1592318551 shutdown_connections 2020-05-18T21:33:48.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.819+0000 7f26d1f00700 1 --2- 172.21.15.63:0/1592318551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f26ac04f920 0x7f26ac051de0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:48.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.819+0000 7f26d1f00700 1 --2- 172.21.15.63:0/1592318551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26cc0b2120 0x7f26cc0afb40 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:48.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.819+0000 7f26d1f00700 1 -- 172.21.15.63:0/1592318551 >> 172.21.15.63:0/1592318551 conn(0x7f26cc069b70 msgr2=0x7f26cc024770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:48.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.819+0000 7f26d1f00700 1 -- 172.21.15.63:0/1592318551 shutdown_connections 2020-05-18T21:33:48.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.819+0000 7f26d1f00700 1 -- 172.21.15.63:0/1592318551 wait complete. 2020-05-18T21:33:48.826 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.1 2020-05-18T21:33:48.836 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:33:48.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.943+0000 7f6a818e1700 1 Processor -- start 2020-05-18T21:33:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.943+0000 7f6a818e1700 1 -- start start 2020-05-18T21:33:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a818e1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6a7c0b6410 0x7f6a7c0b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a818e1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a7c151bc0 0x7f6a7c152030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:48.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a818e1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7c025500 con 0x7f6a7c0b5cb0 2020-05-18T21:33:48.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a818e1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7c064ee0 con 0x7f6a7c0b6410 2020-05-18T21:33:48.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a818e1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c0b67f0 con 0x7f6a7c151bc0 2020-05-18T21:33:48.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a810e0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6a7c0b6410 0x7f6a7c0b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a810e0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6a7c0b6410 0x7f6a7c0b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32880/0 (socket says 172.21.15.63:32880) 2020-05-18T21:33:48.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a810e0700 1 -- 172.21.15.63:0/2738059568 learned_addr learned my addr 172.21.15.63:0/2738059568 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:48.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a82b43700 1 --2- 172.21.15.63:0/2738059568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a7c151bc0 0x7f6a7c152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a810e0700 1 -- 172.21.15.63:0/2738059568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a7c151bc0 msgr2=0x7f6a7c152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:48.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a810e0700 1 --2- 172.21.15.63:0/2738059568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a7c151bc0 0x7f6a7c152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:48.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a810e0700 1 -- 172.21.15.63:0/2738059568 >> v1:172.21.15.155:6789/0 conn(0x7f6a7c0b5cb0 legacy=0x7f6a7c061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a810e0700 1 -- 172.21.15.63:0/2738059568 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c025180 con 0x7f6a7c0b6410 2020-05-18T21:33:48.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a810e0700 1 --2- 172.21.15.63:0/2738059568 >> v2:172.21.15.63:3300/0 conn(0x7f6a7c0b6410 0x7f6a7c0b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6a78002f70 tx=0x7f6a78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a810e0700 1 --2- 172.21.15.63:0/2738059568 >> v2:172.21.15.63:3300/0 conn(0x7f6a7c0b6410 0x7f6a7c0b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6a78002f70 tx=0x7f6a78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a810e0700 1 --2- 172.21.15.63:0/2738059568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a7c0b6410 0x7f6a7c0b6cd0 secure :-1 s=READY pgs=1522 cs=0 l=1 rx=0x7f6a78002f70 tx=0x7f6a78007a80).ready entity=mon.0 client_cookie=1f3f02c5c6a280f0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:48.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a810e0700 1 --2- 172.21.15.63:0/2738059568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a7c0b6410 0x7f6a7c0b6cd0 secure :-1 s=THROTTLE_DONE pgs=1522 cs=0 l=1 rx=0x7f6a78002f70 tx=0x7f6a78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a6ffff700 1 -- 172.21.15.63:0/2738059568 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a780116b0 con 0x7f6a7c0b6410 2020-05-18T21:33:48.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a810e0700 1 --2- 172.21.15.63:0/2738059568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a7c0b6410 0x7f6a7c0b6cd0 secure :-1 s=THROTTLE_DONE pgs=1522 cs=0 l=1 rx=0x7f6a78002f70 tx=0x7f6a78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a810e0700 1 --2- 172.21.15.63:0/2738059568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a7c0b6410 0x7f6a7c0b6cd0 secure :-1 s=THROTTLE_DONE pgs=1522 cs=0 l=1 rx=0x7f6a78002f70 tx=0x7f6a78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a6ffff700 1 -- 172.21.15.63:0/2738059568 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a78011810 con 0x7f6a7c0b6410 2020-05-18T21:33:48.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a6ffff700 1 -- 172.21.15.63:0/2738059568 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a78011c30 con 0x7f6a7c0b6410 2020-05-18T21:33:48.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a818e1700 1 -- 172.21.15.63:0/2738059568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a7c0b6410 msgr2=0x7f6a7c0b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a818e1700 1 --2- 172.21.15.63:0/2738059568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a7c0b6410 0x7f6a7c0b6cd0 secure :-1 s=READY pgs=1522 cs=0 l=1 rx=0x7f6a78002f70 tx=0x7f6a78007a80).stop 2020-05-18T21:33:48.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a818e1700 1 -- 172.21.15.63:0/2738059568 shutdown_connections 2020-05-18T21:33:48.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a818e1700 1 --2- 172.21.15.63:0/2738059568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a7c151bc0 0x7f6a7c152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:48.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a818e1700 1 --2- 172.21.15.63:0/2738059568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a7c0b6410 0x7f6a7c0b6cd0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:48.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a818e1700 1 -- 172.21.15.63:0/2738059568 >> 172.21.15.63:0/2738059568 conn(0x7f6a7c069b70 msgr2=0x7f6a7c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:48.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a818e1700 1 -- 172.21.15.63:0/2738059568 shutdown_connections 2020-05-18T21:33:48.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.947+0000 7f6a818e1700 1 -- 172.21.15.63:0/2738059568 wait complete. 2020-05-18T21:33:48.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.951+0000 7f6a818e1700 1 Processor -- start 2020-05-18T21:33:48.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.951+0000 7f6a818e1700 1 -- start start 2020-05-18T21:33:48.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.951+0000 7f6a818e1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6a7c151bc0 0x7f6a7c13aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:48.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.951+0000 7f6a818e1700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7c13b1f0 con 0x7f6a7c0b6410 2020-05-18T21:33:48.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.951+0000 7f6a818e1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7c07fc50 con 0x7f6a7c0b5cb0 2020-05-18T21:33:48.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.951+0000 7f6a818e1700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7c0661c0 con 0x7f6a7c151bc0 2020-05-18T21:33:48.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.951+0000 7f6a808df700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6a7c0b6410 0x7f6a7c065a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35076/0 (socket says 172.21.15.63:35076) 2020-05-18T21:33:48.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.951+0000 7f6a808df700 1 -- 172.21.15.63:0/1979569616 learned_addr learned my addr 172.21.15.63:0/1979569616 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:48.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.951+0000 7f6a82b43700 1 --2- 172.21.15.63:0/1979569616 >> v2:172.21.15.155:3300/0 conn(0x7f6a7c151bc0 0x7f6a7c13aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.951+0000 7f6a6dffb700 1 -- 172.21.15.63:0/1979569616 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185831609 0 0) 0x7f6a7c13b1f0 con 0x7f6a7c0b6410 2020-05-18T21:33:48.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.951+0000 7f6a6dffb700 1 -- 172.21.15.63:0/1979569616 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a5c003270 con 0x7f6a7c0b6410 2020-05-18T21:33:48.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.951+0000 7f6a6dffb700 1 -- 172.21.15.63:0/1979569616 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 666738476 0 0) 0x7f6a5c003270 con 0x7f6a7c0b6410 2020-05-18T21:33:48.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.951+0000 7f6a82b43700 1 -- 172.21.15.63:0/1979569616 >> v1:172.21.15.155:6789/0 conn(0x7f6a7c0b5cb0 legacy=0x7f6a7c065310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.951+0000 7f6a82b43700 1 -- 172.21.15.63:0/1979569616 >> v1:172.21.15.63:6789/0 conn(0x7f6a7c0b6410 legacy=0x7f6a7c065a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:48.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.951+0000 7f6a82b43700 1 -- 172.21.15.63:0/1979569616 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c07fef0 con 0x7f6a7c151bc0 2020-05-18T21:33:48.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.955+0000 7f6a82b43700 1 --2- 172.21.15.63:0/1979569616 >> v2:172.21.15.155:3300/0 conn(0x7f6a7c151bc0 0x7f6a7c13aca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6a70001ba0 tx=0x7f6a74010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.955+0000 7f6a82b43700 1 --2- 172.21.15.63:0/1979569616 >> v2:172.21.15.155:3300/0 conn(0x7f6a7c151bc0 0x7f6a7c13aca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6a70001ba0 tx=0x7f6a74010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.955+0000 7f6a82b43700 1 --2- 172.21.15.63:0/1979569616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a7c151bc0 0x7f6a7c13aca0 secure :-1 s=READY pgs=1024 cs=0 l=1 rx=0x7f6a70001ba0 tx=0x7f6a74010f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:48.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.955+0000 7f6a82b43700 1 --2- 172.21.15.63:0/1979569616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a7c151bc0 0x7f6a7c13aca0 secure :-1 s=THROTTLE_DONE pgs=1024 cs=0 l=1 rx=0x7f6a70001ba0 tx=0x7f6a74010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.955+0000 7f6a6dffb700 1 -- 172.21.15.63:0/1979569616 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a70001a00 con 0x7f6a7c151bc0 2020-05-18T21:33:48.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.955+0000 7f6a82b43700 1 --2- 172.21.15.63:0/1979569616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a7c151bc0 0x7f6a7c13aca0 secure :-1 s=THROTTLE_DONE pgs=1024 cs=0 l=1 rx=0x7f6a70001ba0 tx=0x7f6a74010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.955+0000 7f6a6dffb700 1 -- 172.21.15.63:0/1979569616 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7400e9a0 con 0x7f6a7c151bc0 2020-05-18T21:33:48.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.955+0000 7f6a82b43700 1 --2- 172.21.15.63:0/1979569616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a7c151bc0 0x7f6a7c13aca0 secure :-1 s=THROTTLE_DONE pgs=1024 cs=0 l=1 rx=0x7f6a70001ba0 tx=0x7f6a74010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.955+0000 7f6a6dffb700 1 -- 172.21.15.63:0/1979569616 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a7400ed00 con 0x7f6a7c151bc0 2020-05-18T21:33:48.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.955+0000 7f6a818e1700 1 -- 172.21.15.63:0/1979569616 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7c0b1d50 con 0x7f6a7c151bc0 2020-05-18T21:33:48.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.955+0000 7f6a818e1700 1 -- 172.21.15.63:0/1979569616 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7c1586b0 con 0x7f6a7c151bc0 2020-05-18T21:33:48.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.955+0000 7f6a82b43700 1 --2- 172.21.15.63:0/1979569616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a7c151bc0 0x7f6a7c13aca0 secure :-1 s=THROTTLE_DONE pgs=1024 cs=0 l=1 rx=0x7f6a70001ba0 tx=0x7f6a74010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.955+0000 7f6a818e1700 1 -- 172.21.15.63:0/1979569616 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7c080080 con 0x7f6a7c151bc0 2020-05-18T21:33:48.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.955+0000 7f6a6dffb700 1 -- 172.21.15.63:0/1979569616 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6a74005a80 con 0x7f6a7c151bc0 2020-05-18T21:33:48.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.955+0000 7f6a82b43700 1 --2- 172.21.15.63:0/1979569616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a7c151bc0 0x7f6a7c13aca0 secure :-1 s=THROTTLE_DONE pgs=1024 cs=0 l=1 rx=0x7f6a70001ba0 tx=0x7f6a74010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.955+0000 7f6a6dffb700 1 --2- 172.21.15.63:0/1979569616 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6a5c04fcd0 0x7f6a5c052190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:48.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.955+0000 7f6a6dffb700 1 -- 172.21.15.63:0/1979569616 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6a74063480 con 0x7f6a7c151bc0 2020-05-18T21:33:48.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.959+0000 7f6a810e0700 1 --2- 172.21.15.63:0/1979569616 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6a5c04fcd0 0x7f6a5c052190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:48.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.959+0000 7f6a810e0700 1 --2- 172.21.15.63:0/1979569616 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6a5c04fcd0 0x7f6a5c052190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6a78007f10 tx=0x7f6a78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.959+0000 7f6a810e0700 1 --2- 172.21.15.63:0/1979569616 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6a5c04fcd0 0x7f6a5c052190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6a78007f10 tx=0x7f6a78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.959+0000 7f6a810e0700 1 --2- 172.21.15.63:0/1979569616 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6a5c04fcd0 0x7f6a5c052190 secure :-1 s=READY pgs=595 cs=0 l=1 rx=0x7f6a78007f10 tx=0x7f6a78007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:48.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.967+0000 7f6a82b43700 1 --2- 172.21.15.63:0/1979569616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a7c151bc0 0x7f6a7c13aca0 secure :-1 s=THROTTLE_DONE pgs=1024 cs=0 l=1 rx=0x7f6a70001ba0 tx=0x7f6a74010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:48.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:48.967+0000 7f6a6dffb700 1 -- 172.21.15.63:0/1979569616 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6a7403d870 con 0x7f6a7c151bc0 2020-05-18T21:33:49.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.119+0000 7f6a818e1700 1 -- 172.21.15.63:0/1979569616 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f6a7c0569e0 con 0x7f6a7c151bc0 2020-05-18T21:33:49.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.127+0000 7f6a82b43700 1 --2- 172.21.15.63:0/1979569616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a7c151bc0 0x7f6a7c13aca0 secure :-1 s=THROTTLE_DONE pgs=1024 cs=0 l=1 rx=0x7f6a70001ba0 tx=0x7f6a74010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.127+0000 7f6a6dffb700 1 -- 172.21.15.63:0/1979569616 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v45) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6a74040e90 con 0x7f6a7c151bc0 2020-05-18T21:33:49.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.127+0000 7f6a818e1700 1 -- 172.21.15.63:0/1979569616 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6a5c04fcd0 msgr2=0x7f6a5c052190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:49.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.127+0000 7f6a818e1700 1 --2- 172.21.15.63:0/1979569616 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6a5c04fcd0 0x7f6a5c052190 secure :-1 s=READY pgs=595 cs=0 l=1 rx=0x7f6a78007f10 tx=0x7f6a78007a80).stop 2020-05-18T21:33:49.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.127+0000 7f6a818e1700 1 -- 172.21.15.63:0/1979569616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a7c151bc0 msgr2=0x7f6a7c13aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:49.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.127+0000 7f6a818e1700 1 --2- 172.21.15.63:0/1979569616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a7c151bc0 0x7f6a7c13aca0 secure :-1 s=READY pgs=1024 cs=0 l=1 rx=0x7f6a70001ba0 tx=0x7f6a74010f00).stop 2020-05-18T21:33:49.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.131+0000 7f6a818e1700 1 -- 172.21.15.63:0/1979569616 shutdown_connections 2020-05-18T21:33:49.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.131+0000 7f6a818e1700 1 --2- 172.21.15.63:0/1979569616 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6a5c04fcd0 0x7f6a5c052190 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:49.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.131+0000 7f6a818e1700 1 --2- 172.21.15.63:0/1979569616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a7c151bc0 0x7f6a7c13aca0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:49.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.131+0000 7f6a818e1700 1 -- 172.21.15.63:0/1979569616 >> 172.21.15.63:0/1979569616 conn(0x7f6a7c069b70 msgr2=0x7f6a7c0b7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:49.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.131+0000 7f6a818e1700 1 -- 172.21.15.63:0/1979569616 shutdown_connections 2020-05-18T21:33:49.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.131+0000 7f6a818e1700 1 -- 172.21.15.63:0/1979569616 wait complete. 2020-05-18T21:33:49.137 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.2 2020-05-18T21:33:49.147 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:33:49.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.263+0000 7f543359e700 1 Processor -- start 2020-05-18T21:33:49.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.263+0000 7f543359e700 1 -- start start 2020-05-18T21:33:49.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.263+0000 7f543359e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f54340b6cd0 0x7f54341522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:49.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f543359e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5434025500 con 0x7f54340b5cb0 2020-05-18T21:33:49.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f543359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5434064ee0 con 0x7f54340b6410 2020-05-18T21:33:49.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f543359e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54340b67f0 con 0x7f54340b6cd0 2020-05-18T21:33:49.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f543259c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f54340b5cb0 0x7f5434151bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35084/0 (socket says 172.21.15.63:35084) 2020-05-18T21:33:49.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f5438e7e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f54340b6cd0 0x7f54341522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:49.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f543259c700 1 -- 172.21.15.63:0/903831118 learned_addr learned my addr 172.21.15.63:0/903831118 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:49.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f5431d9b700 1 -- 172.21.15.63:0/903831118 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877445777 0 0) 0x7f5434025500 con 0x7f54340b5cb0 2020-05-18T21:33:49.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f5431d9b700 1 -- 172.21.15.63:0/903831118 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f541c003270 con 0x7f54340b5cb0 2020-05-18T21:33:49.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f5431d9b700 1 -- 172.21.15.63:0/903831118 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805320537 0 0) 0x7f5434064ee0 con 0x7f54340b6410 2020-05-18T21:33:49.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f5431d9b700 1 -- 172.21.15.63:0/903831118 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5434025500 con 0x7f54340b6410 2020-05-18T21:33:49.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f5438e7e700 1 -- 172.21.15.63:0/903831118 >> v1:172.21.15.155:6789/0 conn(0x7f54340b6410 legacy=0x7f5434061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:49.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f5431d9b700 1 -- 172.21.15.63:0/903831118 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 117167616 0 0) 0x7f541c003270 con 0x7f54340b5cb0 2020-05-18T21:33:49.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f5438e7e700 1 -- 172.21.15.63:0/903831118 >> v1:172.21.15.63:6789/0 conn(0x7f54340b5cb0 legacy=0x7f5434151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:49.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f5438e7e700 1 -- 172.21.15.63:0/903831118 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5434025180 con 0x7f54340b6cd0 2020-05-18T21:33:49.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f5438e7e700 1 --2- 172.21.15.63:0/903831118 >> v2:172.21.15.63:3300/0 conn(0x7f54340b6cd0 0x7f54341522d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f54280018b0 tx=0x7f542c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f5438e7e700 1 --2- 172.21.15.63:0/903831118 >> v2:172.21.15.63:3300/0 conn(0x7f54340b6cd0 0x7f54341522d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f54280018b0 tx=0x7f542c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f5438e7e700 1 --2- 172.21.15.63:0/903831118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54340b6cd0 0x7f54341522d0 secure :-1 s=READY pgs=1525 cs=0 l=1 rx=0x7f54280018b0 tx=0x7f542c007e00).ready entity=mon.0 client_cookie=a8d4a2f69cddf91f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:49.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f5438e7e700 1 --2- 172.21.15.63:0/903831118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54340b6cd0 0x7f54341522d0 secure :-1 s=THROTTLE_DONE pgs=1525 cs=0 l=1 rx=0x7f54280018b0 tx=0x7f542c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f5431d9b700 1 -- 172.21.15.63:0/903831118 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5428001710 con 0x7f54340b6cd0 2020-05-18T21:33:49.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f5438e7e700 1 --2- 172.21.15.63:0/903831118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54340b6cd0 0x7f54341522d0 secure :-1 s=THROTTLE_DONE pgs=1525 cs=0 l=1 rx=0x7f54280018b0 tx=0x7f542c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f5438e7e700 1 --2- 172.21.15.63:0/903831118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54340b6cd0 0x7f54341522d0 secure :-1 s=THROTTLE_DONE pgs=1525 cs=0 l=1 rx=0x7f54280018b0 tx=0x7f542c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f5431d9b700 1 -- 172.21.15.63:0/903831118 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c011ac0 con 0x7f54340b6cd0 2020-05-18T21:33:49.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f5431d9b700 1 -- 172.21.15.63:0/903831118 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542c011e60 con 0x7f54340b6cd0 2020-05-18T21:33:49.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f543359e700 1 -- 172.21.15.63:0/903831118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54340b6cd0 msgr2=0x7f54341522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:49.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f543359e700 1 --2- 172.21.15.63:0/903831118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54340b6cd0 0x7f54341522d0 secure :-1 s=READY pgs=1525 cs=0 l=1 rx=0x7f54280018b0 tx=0x7f542c007e00).stop 2020-05-18T21:33:49.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f543359e700 1 -- 172.21.15.63:0/903831118 shutdown_connections 2020-05-18T21:33:49.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f543359e700 1 --2- 172.21.15.63:0/903831118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54340b6cd0 0x7f54341522d0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:49.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f543359e700 1 -- 172.21.15.63:0/903831118 >> 172.21.15.63:0/903831118 conn(0x7f5434069b70 msgr2=0x7f5434069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:49.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f543359e700 1 -- 172.21.15.63:0/903831118 shutdown_connections 2020-05-18T21:33:49.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.267+0000 7f543359e700 1 -- 172.21.15.63:0/903831118 wait complete. 2020-05-18T21:33:49.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.271+0000 7f543359e700 1 Processor -- start 2020-05-18T21:33:49.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.271+0000 7f543359e700 1 -- start start 2020-05-18T21:33:49.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.271+0000 7f543359e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54340b5cb0 0x7f54340ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:49.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.271+0000 7f543359e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543411ea60 con 0x7f54340b6cd0 2020-05-18T21:33:49.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.271+0000 7f543359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543411ed00 con 0x7f54340b6410 2020-05-18T21:33:49.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.271+0000 7f543359e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543411efa0 con 0x7f54340b5cb0 2020-05-18T21:33:49.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.271+0000 7f5438e7e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f54340b6cd0 0x7f543407f680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35092/0 (socket says 172.21.15.63:35092) 2020-05-18T21:33:49.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.271+0000 7f5438e7e700 1 -- 172.21.15.63:0/3028800837 learned_addr learned my addr 172.21.15.63:0/3028800837 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:49.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.271+0000 7f5432d9d700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54340b5cb0 0x7f54340ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:49.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.271+0000 7f54237fe700 1 -- 172.21.15.63:0/3028800837 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199556057 0 0) 0x7f543411ea60 con 0x7f54340b6cd0 2020-05-18T21:33:49.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.271+0000 7f54237fe700 1 -- 172.21.15.63:0/3028800837 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5418003270 con 0x7f54340b6cd0 2020-05-18T21:33:49.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.271+0000 7f54237fe700 1 -- 172.21.15.63:0/3028800837 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841332483 0 0) 0x7f543411ed00 con 0x7f54340b6410 2020-05-18T21:33:49.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.271+0000 7f54237fe700 1 -- 172.21.15.63:0/3028800837 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f543411ea60 con 0x7f54340b6410 2020-05-18T21:33:49.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.271+0000 7f5432d9d700 1 -- 172.21.15.63:0/3028800837 >> v1:172.21.15.155:6789/0 conn(0x7f54340b6410 legacy=0x7f54340b96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:49.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.271+0000 7f5432d9d700 1 -- 172.21.15.63:0/3028800837 >> v1:172.21.15.63:6789/0 conn(0x7f54340b6cd0 legacy=0x7f543407f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:49.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.271+0000 7f54237fe700 1 -- 172.21.15.63:0/3028800837 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3522072285 0 0) 0x7f5418003270 con 0x7f54340b6cd0 2020-05-18T21:33:49.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.271+0000 7f5432d9d700 1 -- 172.21.15.63:0/3028800837 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543411f240 con 0x7f54340b5cb0 2020-05-18T21:33:49.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.271+0000 7f5432d9d700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54340b5cb0 0x7f54340ac4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f542c0033b0 tx=0x7f5424010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f5432d9d700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54340b5cb0 0x7f54340ac4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f542c0033b0 tx=0x7f5424010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f5432d9d700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54340b5cb0 0x7f54340ac4d0 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7f542c0033b0 tx=0x7f5424010910).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:49.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f5432d9d700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54340b5cb0 0x7f54340ac4d0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f542c0033b0 tx=0x7f5424010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f54237fe700 1 -- 172.21.15.63:0/3028800837 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542c008a20 con 0x7f54340b5cb0 2020-05-18T21:33:49.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f543359e700 1 -- 172.21.15.63:0/3028800837 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543407fd90 con 0x7f54340b5cb0 2020-05-18T21:33:49.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f5432d9d700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54340b5cb0 0x7f54340ac4d0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f542c0033b0 tx=0x7f5424010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f54237fe700 1 -- 172.21.15.63:0/3028800837 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5424006800 con 0x7f54340b5cb0 2020-05-18T21:33:49.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f5432d9d700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54340b5cb0 0x7f54340ac4d0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f542c0033b0 tx=0x7f5424010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f543359e700 1 -- 172.21.15.63:0/3028800837 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5434122c10 con 0x7f54340b5cb0 2020-05-18T21:33:49.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f54237fe700 1 -- 172.21.15.63:0/3028800837 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5424006c30 con 0x7f54340b5cb0 2020-05-18T21:33:49.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f543359e700 1 -- 172.21.15.63:0/3028800837 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543411fa20 con 0x7f54340b5cb0 2020-05-18T21:33:49.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f5432d9d700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54340b5cb0 0x7f54340ac4d0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f542c0033b0 tx=0x7f5424010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f54237fe700 1 -- 172.21.15.63:0/3028800837 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f542400a350 con 0x7f54340b5cb0 2020-05-18T21:33:49.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f5432d9d700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54340b5cb0 0x7f54340ac4d0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f542c0033b0 tx=0x7f5424010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f54237fe700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f541804fe60 0x7f5418052320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:49.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f54237fe700 1 -- 172.21.15.63:0/3028800837 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f54240636b0 con 0x7f54340b5cb0 2020-05-18T21:33:49.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f543259c700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f541804fe60 0x7f5418052320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:49.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f543259c700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f541804fe60 0x7f5418052320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f54280018f0 tx=0x7f54280019e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f543259c700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f541804fe60 0x7f5418052320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f54280018f0 tx=0x7f54280019e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.275+0000 7f543259c700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f541804fe60 0x7f5418052320 secure :-1 s=READY pgs=596 cs=0 l=1 rx=0x7f54280018f0 tx=0x7f54280019e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:49.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.287+0000 7f5432d9d700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54340b5cb0 0x7f54340ac4d0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f542c0033b0 tx=0x7f5424010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.287+0000 7f54237fe700 1 -- 172.21.15.63:0/3028800837 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f542403d9e0 con 0x7f54340b5cb0 2020-05-18T21:33:49.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.443+0000 7f543359e700 1 -- 172.21.15.63:0/3028800837 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f54340569e0 con 0x7f54340b5cb0 2020-05-18T21:33:49.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.451+0000 7f5432d9d700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54340b5cb0 0x7f54340ac4d0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f542c0033b0 tx=0x7f5424010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.451+0000 7f54237fe700 1 -- 172.21.15.63:0/3028800837 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v46) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5424041000 con 0x7f54340b5cb0 2020-05-18T21:33:49.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.455+0000 7f543359e700 1 -- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f541804fe60 msgr2=0x7f5418052320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:49.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.455+0000 7f543359e700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f541804fe60 0x7f5418052320 secure :-1 s=READY pgs=596 cs=0 l=1 rx=0x7f54280018f0 tx=0x7f54280019e0).stop 2020-05-18T21:33:49.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.455+0000 7f543359e700 1 -- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54340b5cb0 msgr2=0x7f54340ac4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:49.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.455+0000 7f543359e700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54340b5cb0 0x7f54340ac4d0 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7f542c0033b0 tx=0x7f5424010910).stop 2020-05-18T21:33:49.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.455+0000 7f543359e700 1 -- 172.21.15.63:0/3028800837 shutdown_connections 2020-05-18T21:33:49.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.455+0000 7f543359e700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f541804fe60 0x7f5418052320 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:49.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.455+0000 7f543359e700 1 --2- 172.21.15.63:0/3028800837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54340b5cb0 0x7f54340ac4d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:49.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.455+0000 7f543359e700 1 -- 172.21.15.63:0/3028800837 >> 172.21.15.63:0/3028800837 conn(0x7f5434069b70 msgr2=0x7f54340b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:49.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.455+0000 7f543359e700 1 -- 172.21.15.63:0/3028800837 shutdown_connections 2020-05-18T21:33:49.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.455+0000 7f543359e700 1 -- 172.21.15.63:0/3028800837 wait complete. 2020-05-18T21:33:49.460 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.3 2020-05-18T21:33:49.471 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:49.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.567+0000 7fde6a7ca700 1 Processor -- start 2020-05-18T21:33:49.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.567+0000 7fde6a7ca700 1 -- start start 2020-05-18T21:33:49.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.567+0000 7fde6a7ca700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde64060b90 0x7fde640615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:49.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.567+0000 7fde6a7ca700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde6414d960 con 0x7fde6414e570 2020-05-18T21:33:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.567+0000 7fde6a7ca700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde6414db90 con 0x7fde640b2860 2020-05-18T21:33:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.567+0000 7fde6a7ca700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde64066210 con 0x7fde64060b90 2020-05-18T21:33:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.567+0000 7fde68d67700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fde6414e570 0x7fde6414a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35100/0 (socket says 172.21.15.63:35100) 2020-05-18T21:33:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.567+0000 7fde68d67700 1 -- 172.21.15.63:0/1912829893 learned_addr learned my addr 172.21.15.63:0/1912829893 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde63fff700 1 --2- 172.21.15.63:0/1912829893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde64060b90 0x7fde640615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:49.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 -- 172.21.15.63:0/1912829893 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756705307 0 0) 0x7fde6414d960 con 0x7fde6414e570 2020-05-18T21:33:49.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 -- 172.21.15.63:0/1912829893 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde44003270 con 0x7fde6414e570 2020-05-18T21:33:49.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 -- 172.21.15.63:0/1912829893 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671175286 0 0) 0x7fde6414db90 con 0x7fde640b2860 2020-05-18T21:33:49.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 -- 172.21.15.63:0/1912829893 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde6414d960 con 0x7fde640b2860 2020-05-18T21:33:49.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 -- 172.21.15.63:0/1912829893 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 480272705 0 0) 0x7fde44003270 con 0x7fde6414e570 2020-05-18T21:33:49.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 -- 172.21.15.63:0/1912829893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde64060b90 msgr2=0x7fde640615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:49.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 --2- 172.21.15.63:0/1912829893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde64060b90 0x7fde640615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:49.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 -- 172.21.15.63:0/1912829893 >> v1:172.21.15.155:6789/0 conn(0x7fde640b2860 legacy=0x7fde64144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:49.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 -- 172.21.15.63:0/1912829893 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6414de30 con 0x7fde6414e570 2020-05-18T21:33:49.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 -- 172.21.15.63:0/1912829893 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fde5c001710 con 0x7fde6414e570 2020-05-18T21:33:49.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 -- 172.21.15.63:0/1912829893 >> v1:172.21.15.63:6789/0 conn(0x7fde6414e570 legacy=0x7fde6414a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:49.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 --2- 172.21.15.63:0/1912829893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde64060b90 0x7fde44003920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:49.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 --2- 172.21.15.63:0/1912829893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde44003d80 0x7fde44004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:49.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 --2- 172.21.15.63:0/1912829893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde44004970 0x7fde44004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:49.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 -- 172.21.15.63:0/1912829893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde64066210 con 0x7fde44003d80 2020-05-18T21:33:49.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 -- 172.21.15.63:0/1912829893 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde44005250 con 0x7fde44004970 2020-05-18T21:33:49.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 -- 172.21.15.63:0/1912829893 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4400b760 con 0x7fde64060b90 2020-05-18T21:33:49.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde637fe700 1 --2- 172.21.15.63:0/1912829893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde44003d80 0x7fde44004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:49.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde63fff700 1 --2- 172.21.15.63:0/1912829893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde64060b90 0x7fde44003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:49.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde68d67700 1 --2- 172.21.15.63:0/1912829893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde44004970 0x7fde44004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde637fe700 1 -- 172.21.15.63:0/1912829893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde64060b90 msgr2=0x7fde44003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde637fe700 1 --2- 172.21.15.63:0/1912829893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde64060b90 0x7fde44003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde637fe700 1 -- 172.21.15.63:0/1912829893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde44004970 msgr2=0x7fde44004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde637fe700 1 --2- 172.21.15.63:0/1912829893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde44004970 0x7fde44004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde637fe700 1 -- 172.21.15.63:0/1912829893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde44003270 con 0x7fde44003d80 2020-05-18T21:33:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde63fff700 1 --2- 172.21.15.63:0/1912829893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde64060b90 0x7fde44003920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:33:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde637fe700 1 --2- 172.21.15.63:0/1912829893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde44003d80 0x7fde44004510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fde4c001490 tx=0x7fde4c00c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde637fe700 1 --2- 172.21.15.63:0/1912829893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde44003d80 0x7fde44004510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fde4c001490 tx=0x7fde4c00c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde637fe700 1 --2- 172.21.15.63:0/1912829893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde44003d80 0x7fde44004510 secure :-1 s=READY pgs=1528 cs=0 l=1 rx=0x7fde4c001490 tx=0x7fde4c00c320).ready entity=mon.0 client_cookie=b95d772468fee961 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde637fe700 1 --2- 172.21.15.63:0/1912829893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde44003d80 0x7fde44004510 secure :-1 s=THROTTLE_DONE pgs=1528 cs=0 l=1 rx=0x7fde4c001490 tx=0x7fde4c00c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde637fe700 1 --2- 172.21.15.63:0/1912829893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde44003d80 0x7fde44004510 secure :-1 s=THROTTLE_DONE pgs=1528 cs=0 l=1 rx=0x7fde4c001490 tx=0x7fde4c00c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 -- 172.21.15.63:0/1912829893 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde4c001e80 con 0x7fde44003d80 2020-05-18T21:33:49.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde637fe700 1 --2- 172.21.15.63:0/1912829893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde44003d80 0x7fde44004510 secure :-1 s=THROTTLE_DONE pgs=1528 cs=0 l=1 rx=0x7fde4c001490 tx=0x7fde4c00c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 -- 172.21.15.63:0/1912829893 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c00caa0 con 0x7fde44003d80 2020-05-18T21:33:49.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde62ffd700 1 -- 172.21.15.63:0/1912829893 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde4c0110d0 con 0x7fde44003d80 2020-05-18T21:33:49.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde6a7ca700 1 -- 172.21.15.63:0/1912829893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde44003d80 msgr2=0x7fde44004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:49.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde6a7ca700 1 --2- 172.21.15.63:0/1912829893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde44003d80 0x7fde44004510 secure :-1 s=READY pgs=1528 cs=0 l=1 rx=0x7fde4c001490 tx=0x7fde4c00c320).stop 2020-05-18T21:33:49.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde68d67700 1 -- 172.21.15.63:0/1912829893 reap_dead start 2020-05-18T21:33:49.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde6a7ca700 1 -- 172.21.15.63:0/1912829893 shutdown_connections 2020-05-18T21:33:49.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde6a7ca700 1 -- 172.21.15.63:0/1912829893 >> 172.21.15.63:0/1912829893 conn(0x7fde640b83d0 msgr2=0x7fde640b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:49.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde6a7ca700 1 -- 172.21.15.63:0/1912829893 shutdown_connections 2020-05-18T21:33:49.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.571+0000 7fde6a7ca700 1 -- 172.21.15.63:0/1912829893 wait complete. 2020-05-18T21:33:49.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.575+0000 7fde6a7ca700 1 Processor -- start 2020-05-18T21:33:49.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.575+0000 7fde6a7ca700 1 -- start start 2020-05-18T21:33:49.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.575+0000 7fde6a7ca700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fde6415bc60 0x7fde64149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:49.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.575+0000 7fde6a7ca700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde64159ec0 0x7fde640acd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:49.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.575+0000 7fde6a7ca700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde6415b050 con 0x7fde640b5370 2020-05-18T21:33:49.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.575+0000 7fde6a7ca700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde6415a2f0 con 0x7fde6415bc60 2020-05-18T21:33:49.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.575+0000 7fde6a7ca700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde6415b280 con 0x7fde64159ec0 2020-05-18T21:33:49.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.575+0000 7fde637fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fde6415bc60 0x7fde64149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:49.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.575+0000 7fde637fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fde6415bc60 0x7fde64149bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32922/0 (socket says 172.21.15.63:32922) 2020-05-18T21:33:49.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde637fe700 1 -- 172.21.15.63:0/104158780 learned_addr learned my addr 172.21.15.63:0/104158780 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:49.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde68d67700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde64159ec0 0x7fde640acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:49.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde637fe700 1 -- 172.21.15.63:0/104158780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde64159ec0 msgr2=0x7fde640acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:49.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde637fe700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde64159ec0 0x7fde640acd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:49.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde637fe700 1 -- 172.21.15.63:0/104158780 >> v1:172.21.15.63:6789/0 conn(0x7fde640b5370 legacy=0x7fde64144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:49.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde617fa700 1 -- 172.21.15.63:0/104158780 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308677799 0 0) 0x7fde6415b050 con 0x7fde640b5370 2020-05-18T21:33:49.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde637fe700 1 -- 172.21.15.63:0/104158780 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6415b520 con 0x7fde6415bc60 2020-05-18T21:33:49.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde637fe700 1 --2- 172.21.15.63:0/104158780 >> v2:172.21.15.63:3300/0 conn(0x7fde6415bc60 0x7fde64149bd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fde4c001490 tx=0x7fde4c00c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde637fe700 1 --2- 172.21.15.63:0/104158780 >> v2:172.21.15.63:3300/0 conn(0x7fde6415bc60 0x7fde64149bd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fde4c001490 tx=0x7fde4c00c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde637fe700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde6415bc60 0x7fde64149bd0 secure :-1 s=READY pgs=1530 cs=0 l=1 rx=0x7fde4c001490 tx=0x7fde4c00c320).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:49.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde637fe700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde6415bc60 0x7fde64149bd0 secure :-1 s=THROTTLE_DONE pgs=1530 cs=0 l=1 rx=0x7fde4c001490 tx=0x7fde4c00c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde637fe700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde6415bc60 0x7fde64149bd0 secure :-1 s=THROTTLE_DONE pgs=1530 cs=0 l=1 rx=0x7fde4c001490 tx=0x7fde4c00c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde617fa700 1 -- 172.21.15.63:0/104158780 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde4c00cea0 con 0x7fde6415bc60 2020-05-18T21:33:49.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde637fe700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde6415bc60 0x7fde64149bd0 secure :-1 s=THROTTLE_DONE pgs=1530 cs=0 l=1 rx=0x7fde4c001490 tx=0x7fde4c00c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde617fa700 1 -- 172.21.15.63:0/104158780 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c00e180 con 0x7fde6415bc60 2020-05-18T21:33:49.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde6a7ca700 1 -- 172.21.15.63:0/104158780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde6415b7c0 con 0x7fde6415bc60 2020-05-18T21:33:49.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde617fa700 1 -- 172.21.15.63:0/104158780 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde4c00e5a0 con 0x7fde6415bc60 2020-05-18T21:33:49.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde6a7ca700 1 -- 172.21.15.63:0/104158780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde64144c60 con 0x7fde6415bc60 2020-05-18T21:33:49.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde637fe700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde6415bc60 0x7fde64149bd0 secure :-1 s=THROTTLE_DONE pgs=1530 cs=0 l=1 rx=0x7fde4c001490 tx=0x7fde4c00c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde6a7ca700 1 -- 172.21.15.63:0/104158780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde640569e0 con 0x7fde6415bc60 2020-05-18T21:33:49.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde617fa700 1 -- 172.21.15.63:0/104158780 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fde4c00e700 con 0x7fde6415bc60 2020-05-18T21:33:49.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde637fe700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde6415bc60 0x7fde64149bd0 secure :-1 s=THROTTLE_DONE pgs=1530 cs=0 l=1 rx=0x7fde4c001490 tx=0x7fde4c00c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde617fa700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde4804f8f0 0x7fde48051db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:49.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.579+0000 7fde617fa700 1 -- 172.21.15.63:0/104158780 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fde4c064330 con 0x7fde6415bc60 2020-05-18T21:33:49.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.583+0000 7fde63fff700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde4804f8f0 0x7fde48051db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:49.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.583+0000 7fde63fff700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde4804f8f0 0x7fde48051db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fde54002f10 tx=0x7fde5400c860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.583+0000 7fde63fff700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde4804f8f0 0x7fde48051db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fde54002f10 tx=0x7fde5400c860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.583+0000 7fde63fff700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde4804f8f0 0x7fde48051db0 secure :-1 s=READY pgs=597 cs=0 l=1 rx=0x7fde54002f10 tx=0x7fde5400c860).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:49.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.587+0000 7fde637fe700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde6415bc60 0x7fde64149bd0 secure :-1 s=THROTTLE_DONE pgs=1530 cs=0 l=1 rx=0x7fde4c001490 tx=0x7fde4c00c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.587+0000 7fde617fa700 1 -- 172.21.15.63:0/104158780 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fde4c03e720 con 0x7fde6415bc60 2020-05-18T21:33:49.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.735+0000 7fde6a7ca700 1 -- 172.21.15.63:0/104158780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde64065900 con 0x7fde6415bc60 2020-05-18T21:33:49.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.739+0000 7fde637fe700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde6415bc60 0x7fde64149bd0 secure :-1 s=THROTTLE_DONE pgs=1530 cs=0 l=1 rx=0x7fde4c001490 tx=0x7fde4c00c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:49.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.739+0000 7fde617fa700 1 -- 172.21.15.63:0/104158780 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fde4c041d40 con 0x7fde6415bc60 2020-05-18T21:33:49.743 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:49.743 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/911406335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":911406335},{"type":"v1","addr":"172.21.15.155:6835","nonce":911406335}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:46.613321+0000","modified":"2020-05-18T21:33:47.617221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8365":{"gid":8365,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/299278803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":299278803},{"type":"v1","addr":"172.21.15.63:6833","nonce":299278803}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-05-18T21:33:49.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.739+0000 7fde6a7ca700 1 -- 172.21.15.63:0/104158780 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde4804f8f0 msgr2=0x7fde48051db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:49.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.739+0000 7fde6a7ca700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde4804f8f0 0x7fde48051db0 secure :-1 s=READY pgs=597 cs=0 l=1 rx=0x7fde54002f10 tx=0x7fde5400c860).stop 2020-05-18T21:33:49.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.739+0000 7fde6a7ca700 1 -- 172.21.15.63:0/104158780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde6415bc60 msgr2=0x7fde64149bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:49.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.739+0000 7fde6a7ca700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde6415bc60 0x7fde64149bd0 secure :-1 s=READY pgs=1530 cs=0 l=1 rx=0x7fde4c001490 tx=0x7fde4c00c320).stop 2020-05-18T21:33:49.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.739+0000 7fde6a7ca700 1 -- 172.21.15.63:0/104158780 shutdown_connections 2020-05-18T21:33:49.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.739+0000 7fde6a7ca700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fde4804f8f0 0x7fde48051db0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:49.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.739+0000 7fde6a7ca700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde64159ec0 0x7fde640acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:49.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.739+0000 7fde6a7ca700 1 --2- 172.21.15.63:0/104158780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde6415bc60 0x7fde64149bd0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:49.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.739+0000 7fde6a7ca700 1 -- 172.21.15.63:0/104158780 >> 172.21.15.63:0/104158780 conn(0x7fde640b83d0 msgr2=0x7fde640b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:49.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.739+0000 7fde6a7ca700 1 -- 172.21.15.63:0/104158780 shutdown_connections 2020-05-18T21:33:49.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:49.739+0000 7fde6a7ca700 1 -- 172.21.15.63:0/104158780 wait complete. 2020-05-18T21:33:49.749 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 86 2020-05-18T21:33:49.956 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:33:46.613321+0000', 'modified': '2020-05-18T21:33:47.617221+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8365}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8365': {'gid': 8365, 'name': 'a', 'rank': 0, 'incarnation': 85, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/299278803', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 299278803}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 299278803}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:33:49.957 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:33:49.958 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:33:50.082 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:50.083 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:33:50.083 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:33:50.083 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 8365, 2020-05-18T21:33:50.084 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:33:50.084 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:33:50.084 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 3.462809526, 2020-05-18T21:33:50.084 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 86, 2020-05-18T21:33:50.085 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 114, 2020-05-18T21:33:50.085 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 113, 2020-05-18T21:33:50.085 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 7.6871883050000003 2020-05-18T21:33:50.085 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:50.091 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 8365, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.462809526, "mdsmap_epoch": 86, "osdmap_epoch": 114, "osdmap_epoch_barrier": 113, "uptime": 7.6871883050000003 } 2020-05-18T21:33:50.092 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:33:50.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.187+0000 7f6b0e5ce700 1 Processor -- start 2020-05-18T21:33:50.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.187+0000 7f6b0e5ce700 1 -- start start 2020-05-18T21:33:50.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b0e5ce700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b080652b0 0x7f6b08142f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:50.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b0e5ce700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6b0805bda0 0x7f6b081400d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:50.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b0e5ce700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6b08140530 0x7f6b0812ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:50.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b0e5ce700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0805ab40 con 0x7f6b0805bda0 2020-05-18T21:33:50.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b0e5ce700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0805ade0 con 0x7f6b08140530 2020-05-18T21:33:50.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b0e5ce700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0805b080 con 0x7f6b080652b0 2020-05-18T21:33:50.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b077fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6b0805bda0 0x7f6b081400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b077fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6b0805bda0 0x7f6b081400d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32930/0 (socket says 172.21.15.63:32930) 2020-05-18T21:33:50.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b077fe700 1 -- 172.21.15.63:0/3677933454 learned_addr learned my addr 172.21.15.63:0/3677933454 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:50.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b0cb6b700 1 --2- 172.21.15.63:0/3677933454 >> v2:172.21.15.155:3300/0 conn(0x7f6b08140530 0x7f6b0812ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b07fff700 1 --2- 172.21.15.63:0/3677933454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b080652b0 0x7f6b08142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b077fe700 1 -- 172.21.15.63:0/3677933454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b080652b0 msgr2=0x7f6b08142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:50.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b077fe700 1 --2- 172.21.15.63:0/3677933454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b080652b0 0x7f6b08142f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:50.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b077fe700 1 -- 172.21.15.63:0/3677933454 >> v2:172.21.15.155:3300/0 conn(0x7f6b08140530 msgr2=0x7f6b0812ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:50.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b077fe700 1 --2- 172.21.15.63:0/3677933454 >> v2:172.21.15.155:3300/0 conn(0x7f6b08140530 0x7f6b0812ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:50.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b077fe700 1 -- 172.21.15.63:0/3677933454 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b08065690 con 0x7f6b0805bda0 2020-05-18T21:33:50.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b077fe700 1 --2- 172.21.15.63:0/3677933454 >> v2:172.21.15.63:3300/0 conn(0x7f6b0805bda0 0x7f6b081400d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6b0805b400 tx=0x7f6afc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b077fe700 1 --2- 172.21.15.63:0/3677933454 >> v2:172.21.15.63:3300/0 conn(0x7f6b0805bda0 0x7f6b081400d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6b0805b400 tx=0x7f6afc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b077fe700 1 --2- 172.21.15.63:0/3677933454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b0805bda0 0x7f6b081400d0 secure :-1 s=READY pgs=1531 cs=0 l=1 rx=0x7f6b0805b400 tx=0x7f6afc007a80).ready entity=mon.0 client_cookie=afe39a8acfe28eca server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:50.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b077fe700 1 --2- 172.21.15.63:0/3677933454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b0805bda0 0x7f6b081400d0 secure :-1 s=THROTTLE_DONE pgs=1531 cs=0 l=1 rx=0x7f6b0805b400 tx=0x7f6afc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b06ffd700 1 -- 172.21.15.63:0/3677933454 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6afc0115c0 con 0x7f6b0805bda0 2020-05-18T21:33:50.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b077fe700 1 --2- 172.21.15.63:0/3677933454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b0805bda0 0x7f6b081400d0 secure :-1 s=THROTTLE_DONE pgs=1531 cs=0 l=1 rx=0x7f6b0805b400 tx=0x7f6afc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b06ffd700 1 -- 172.21.15.63:0/3677933454 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc011720 con 0x7f6b0805bda0 2020-05-18T21:33:50.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b077fe700 1 --2- 172.21.15.63:0/3677933454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b0805bda0 0x7f6b081400d0 secure :-1 s=THROTTLE_DONE pgs=1531 cs=0 l=1 rx=0x7f6b0805b400 tx=0x7f6afc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b06ffd700 1 -- 172.21.15.63:0/3677933454 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6afc011b40 con 0x7f6b0805bda0 2020-05-18T21:33:50.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b0e5ce700 1 -- 172.21.15.63:0/3677933454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b0805bda0 msgr2=0x7f6b081400d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b0e5ce700 1 --2- 172.21.15.63:0/3677933454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b0805bda0 0x7f6b081400d0 secure :-1 s=READY pgs=1531 cs=0 l=1 rx=0x7f6b0805b400 tx=0x7f6afc007a80).stop 2020-05-18T21:33:50.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b0e5ce700 1 -- 172.21.15.63:0/3677933454 shutdown_connections 2020-05-18T21:33:50.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b0e5ce700 1 --2- 172.21.15.63:0/3677933454 >> v2:172.21.15.155:3300/0 conn(0x7f6b08140530 0x7f6b0812ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:50.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b0e5ce700 1 --2- 172.21.15.63:0/3677933454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b0805bda0 0x7f6b081400d0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:50.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b0e5ce700 1 --2- 172.21.15.63:0/3677933454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b080652b0 0x7f6b08142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:50.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b0e5ce700 1 -- 172.21.15.63:0/3677933454 >> 172.21.15.63:0/3677933454 conn(0x7f6b08066ed0 msgr2=0x7f6b080b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:50.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b0e5ce700 1 -- 172.21.15.63:0/3677933454 shutdown_connections 2020-05-18T21:33:50.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.191+0000 7f6b0e5ce700 1 -- 172.21.15.63:0/3677933454 wait complete. 2020-05-18T21:33:50.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0e5ce700 1 Processor -- start 2020-05-18T21:33:50.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0e5ce700 1 -- start start 2020-05-18T21:33:50.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0e5ce700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6b080652b0 0x7f6b08151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:50.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0e5ce700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6b08140530 0x7f6b080b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:50.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0e5ce700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b080b21f0 con 0x7f6b0805bda0 2020-05-18T21:33:50.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0e5ce700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0806a360 con 0x7f6b08140530 2020-05-18T21:33:50.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0e5ce700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0806a600 con 0x7f6b080652b0 2020-05-18T21:33:50.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b07fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6b0805bda0 0x7f6b080aefe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35122/0 (socket says 172.21.15.63:35122) 2020-05-18T21:33:50.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b07fff700 1 -- 172.21.15.63:0/2550097298 learned_addr learned my addr 172.21.15.63:0/2550097298 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:50.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0cb6b700 1 --2- 172.21.15.63:0/2550097298 >> v2:172.21.15.63:3300/0 conn(0x7f6b08140530 0x7f6b080b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b077fe700 1 --2- 172.21.15.63:0/2550097298 >> v2:172.21.15.155:3300/0 conn(0x7f6b080652b0 0x7f6b08151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0cb6b700 1 -- 172.21.15.63:0/2550097298 >> v2:172.21.15.155:3300/0 conn(0x7f6b080652b0 msgr2=0x7f6b08151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0cb6b700 1 --2- 172.21.15.63:0/2550097298 >> v2:172.21.15.155:3300/0 conn(0x7f6b080652b0 0x7f6b08151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:50.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0cb6b700 1 -- 172.21.15.63:0/2550097298 >> v1:172.21.15.63:6789/0 conn(0x7f6b0805bda0 legacy=0x7f6b080aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b057fa700 1 -- 172.21.15.63:0/2550097298 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077815247 0 0) 0x7f6b080b21f0 con 0x7f6b0805bda0 2020-05-18T21:33:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0cb6b700 1 -- 172.21.15.63:0/2550097298 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b080b37b0 con 0x7f6b08140530 2020-05-18T21:33:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b077fe700 1 --2- 172.21.15.63:0/2550097298 >> v2:172.21.15.155:3300/0 conn(0x7f6b080652b0 0x7f6b08151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:33:50.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0cb6b700 1 --2- 172.21.15.63:0/2550097298 >> v2:172.21.15.63:3300/0 conn(0x7f6b08140530 0x7f6b080b1d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6af8002f70 tx=0x7f6af8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0cb6b700 1 --2- 172.21.15.63:0/2550097298 >> v2:172.21.15.63:3300/0 conn(0x7f6b08140530 0x7f6b080b1d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6af8002f70 tx=0x7f6af8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0cb6b700 1 --2- 172.21.15.63:0/2550097298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b08140530 0x7f6b080b1d90 secure :-1 s=READY pgs=1533 cs=0 l=1 rx=0x7f6af8002f70 tx=0x7f6af8010b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:50.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0cb6b700 1 --2- 172.21.15.63:0/2550097298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b08140530 0x7f6b080b1d90 secure :-1 s=THROTTLE_DONE pgs=1533 cs=0 l=1 rx=0x7f6af8002f70 tx=0x7f6af8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b057fa700 1 -- 172.21.15.63:0/2550097298 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6af8007550 con 0x7f6b08140530 2020-05-18T21:33:50.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0cb6b700 1 --2- 172.21.15.63:0/2550097298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b08140530 0x7f6b080b1d90 secure :-1 s=THROTTLE_DONE pgs=1533 cs=0 l=1 rx=0x7f6af8002f70 tx=0x7f6af8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0cb6b700 1 --2- 172.21.15.63:0/2550097298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b08140530 0x7f6b080b1d90 secure :-1 s=THROTTLE_DONE pgs=1533 cs=0 l=1 rx=0x7f6af8002f70 tx=0x7f6af8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b057fa700 1 -- 172.21.15.63:0/2550097298 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af8005700 con 0x7f6b08140530 2020-05-18T21:33:50.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0e5ce700 1 -- 172.21.15.63:0/2550097298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b08069fe0 con 0x7f6b08140530 2020-05-18T21:33:50.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b057fa700 1 -- 172.21.15.63:0/2550097298 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6af8005a60 con 0x7f6b08140530 2020-05-18T21:33:50.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.195+0000 7f6b0e5ce700 1 -- 172.21.15.63:0/2550097298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b080b4be0 con 0x7f6b08140530 2020-05-18T21:33:50.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.199+0000 7f6b0cb6b700 1 --2- 172.21.15.63:0/2550097298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b08140530 0x7f6b080b1d90 secure :-1 s=THROTTLE_DONE pgs=1533 cs=0 l=1 rx=0x7f6af8002f70 tx=0x7f6af8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.199+0000 7f6b0e5ce700 1 -- 172.21.15.63:0/2550097298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b080b3940 con 0x7f6b08140530 2020-05-18T21:33:50.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.199+0000 7f6b057fa700 1 -- 172.21.15.63:0/2550097298 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6af8005c90 con 0x7f6b08140530 2020-05-18T21:33:50.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.199+0000 7f6b0cb6b700 1 --2- 172.21.15.63:0/2550097298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b08140530 0x7f6b080b1d90 secure :-1 s=THROTTLE_DONE pgs=1533 cs=0 l=1 rx=0x7f6af8002f70 tx=0x7f6af8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.199+0000 7f6b057fa700 1 --2- 172.21.15.63:0/2550097298 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6ae804f940 0x7f6ae8051e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:50.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.199+0000 7f6b057fa700 1 -- 172.21.15.63:0/2550097298 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6af8063d30 con 0x7f6b08140530 2020-05-18T21:33:50.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.199+0000 7f6b07fff700 1 --2- 172.21.15.63:0/2550097298 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6ae804f940 0x7f6ae8051e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.199+0000 7f6b07fff700 1 --2- 172.21.15.63:0/2550097298 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6ae804f940 0x7f6ae8051e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b00007e50 tx=0x7f6b00009510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.199+0000 7f6b07fff700 1 --2- 172.21.15.63:0/2550097298 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6ae804f940 0x7f6ae8051e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b00007e50 tx=0x7f6b00009510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.199+0000 7f6b07fff700 1 --2- 172.21.15.63:0/2550097298 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6ae804f940 0x7f6ae8051e00 secure :-1 s=READY pgs=598 cs=0 l=1 rx=0x7f6b00007e50 tx=0x7f6b00009510).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:50.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.207+0000 7f6b0cb6b700 1 --2- 172.21.15.63:0/2550097298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b08140530 0x7f6b080b1d90 secure :-1 s=THROTTLE_DONE pgs=1533 cs=0 l=1 rx=0x7f6af8002f70 tx=0x7f6af8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.207+0000 7f6b057fa700 1 -- 172.21.15.63:0/2550097298 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6af803e060 con 0x7f6b08140530 2020-05-18T21:33:50.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.323+0000 7f6b0e5ce700 1 -- 172.21.15.63:0/2550097298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b0806a170 con 0x7f6b08140530 2020-05-18T21:33:50.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.323+0000 7f6b0cb6b700 1 --2- 172.21.15.63:0/2550097298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b08140530 0x7f6b080b1d90 secure :-1 s=THROTTLE_DONE pgs=1533 cs=0 l=1 rx=0x7f6af8002f70 tx=0x7f6af8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.323+0000 7f6b057fa700 1 -- 172.21.15.63:0/2550097298 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f6af8041680 con 0x7f6b08140530 2020-05-18T21:33:50.329 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:50.329 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":114,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:33:47.617336+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:33:45.188898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2020-05-18T21:33:45.614699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:33:50.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.327+0000 7f6b0e5ce700 1 -- 172.21.15.63:0/2550097298 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6ae804f940 msgr2=0x7f6ae8051e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.327+0000 7f6b0e5ce700 1 --2- 172.21.15.63:0/2550097298 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6ae804f940 0x7f6ae8051e00 secure :-1 s=READY pgs=598 cs=0 l=1 rx=0x7f6b00007e50 tx=0x7f6b00009510).stop 2020-05-18T21:33:50.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.327+0000 7f6b0e5ce700 1 -- 172.21.15.63:0/2550097298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b08140530 msgr2=0x7f6b080b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.327+0000 7f6b0e5ce700 1 --2- 172.21.15.63:0/2550097298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b08140530 0x7f6b080b1d90 secure :-1 s=READY pgs=1533 cs=0 l=1 rx=0x7f6af8002f70 tx=0x7f6af8010b90).stop 2020-05-18T21:33:50.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.327+0000 7f6b0e5ce700 1 -- 172.21.15.63:0/2550097298 shutdown_connections 2020-05-18T21:33:50.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.327+0000 7f6b0e5ce700 1 --2- 172.21.15.63:0/2550097298 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6ae804f940 0x7f6ae8051e00 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:50.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.327+0000 7f6b0e5ce700 1 --2- 172.21.15.63:0/2550097298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b08140530 0x7f6b080b1d90 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:50.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.327+0000 7f6b0e5ce700 1 --2- 172.21.15.63:0/2550097298 >> v2:172.21.15.155:3300/0 conn(0x7f6b080652b0 0x7f6b08151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:50.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.327+0000 7f6b0e5ce700 1 -- 172.21.15.63:0/2550097298 >> 172.21.15.63:0/2550097298 conn(0x7f6b08066ed0 msgr2=0x7f6b0805c180 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:50.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.327+0000 7f6b0e5ce700 1 -- 172.21.15.63:0/2550097298 shutdown_connections 2020-05-18T21:33:50.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.327+0000 7f6b0e5ce700 1 -- 172.21.15.63:0/2550097298 wait complete. 2020-05-18T21:33:50.352 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:33:45.188898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:33:45.614699+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:33:50.353 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:33:50.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f383d483700 1 Processor -- start 2020-05-18T21:33:50.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f383d483700 1 -- start start 2020-05-18T21:33:50.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f383d483700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38380bc8d0 0x7f3838060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:50.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f383d483700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3838145e30 0x7f3838142f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:50.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f383d483700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3838143380 0x7f383812e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:50.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f383d483700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3838146e00 con 0x7f3838145e30 2020-05-18T21:33:50.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f383d483700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3838146420 con 0x7f3838143380 2020-05-18T21:33:50.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f383d483700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38381466c0 con 0x7f38380bc8d0 2020-05-18T21:33:50.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f382f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3838145e30 0x7f3838142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f382f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3838145e30 0x7f3838142f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32944/0 (socket says 172.21.15.63:32944) 2020-05-18T21:33:50.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f382f7fe700 1 -- 172.21.15.63:0/2324094535 learned_addr learned my addr 172.21.15.63:0/2324094535 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:50.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f383cc82700 1 --2- 172.21.15.63:0/2324094535 >> v2:172.21.15.155:3300/0 conn(0x7f3838143380 0x7f383812e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f3837fff700 1 --2- 172.21.15.63:0/2324094535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38380bc8d0 0x7f3838060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f382f7fe700 1 -- 172.21.15.63:0/2324094535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38380bc8d0 msgr2=0x7f3838060b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:50.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f382f7fe700 1 --2- 172.21.15.63:0/2324094535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38380bc8d0 0x7f3838060b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:50.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f382f7fe700 1 -- 172.21.15.63:0/2324094535 >> v2:172.21.15.155:3300/0 conn(0x7f3838143380 msgr2=0x7f383812e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:50.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f382f7fe700 1 --2- 172.21.15.63:0/2324094535 >> v2:172.21.15.155:3300/0 conn(0x7f3838143380 0x7f383812e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:50.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f382f7fe700 1 -- 172.21.15.63:0/2324094535 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3838146960 con 0x7f3838145e30 2020-05-18T21:33:50.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f383cc82700 1 --2- 172.21.15.63:0/2324094535 >> v2:172.21.15.155:3300/0 conn(0x7f3838143380 0x7f383812e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:33:50.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f382f7fe700 1 --2- 172.21.15.63:0/2324094535 >> v2:172.21.15.63:3300/0 conn(0x7f3838145e30 0x7f3838142f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3820002f70 tx=0x7f3838061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f382f7fe700 1 --2- 172.21.15.63:0/2324094535 >> v2:172.21.15.63:3300/0 conn(0x7f3838145e30 0x7f3838142f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3820002f70 tx=0x7f3838061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f382f7fe700 1 --2- 172.21.15.63:0/2324094535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3838145e30 0x7f3838142f20 secure :-1 s=READY pgs=1534 cs=0 l=1 rx=0x7f3820002f70 tx=0x7f3838061d60).ready entity=mon.0 client_cookie=1795d46d7d03c9ff server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:50.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f382f7fe700 1 --2- 172.21.15.63:0/2324094535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3838145e30 0x7f3838142f20 secure :-1 s=THROTTLE_DONE pgs=1534 cs=0 l=1 rx=0x7f3820002f70 tx=0x7f3838061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f382f7fe700 1 --2- 172.21.15.63:0/2324094535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3838145e30 0x7f3838142f20 secure :-1 s=THROTTLE_DONE pgs=1534 cs=0 l=1 rx=0x7f3820002f70 tx=0x7f3838061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f38377fe700 1 -- 172.21.15.63:0/2324094535 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3820011760 con 0x7f3838145e30 2020-05-18T21:33:50.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f382f7fe700 1 --2- 172.21.15.63:0/2324094535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3838145e30 0x7f3838142f20 secure :-1 s=THROTTLE_DONE pgs=1534 cs=0 l=1 rx=0x7f3820002f70 tx=0x7f3838061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f38377fe700 1 -- 172.21.15.63:0/2324094535 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38200118c0 con 0x7f3838145e30 2020-05-18T21:33:50.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f38377fe700 1 -- 172.21.15.63:0/2324094535 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3820011ce0 con 0x7f3838145e30 2020-05-18T21:33:50.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f383d483700 1 -- 172.21.15.63:0/2324094535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3838145e30 msgr2=0x7f3838142f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.463+0000 7f383d483700 1 --2- 172.21.15.63:0/2324094535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3838145e30 0x7f3838142f20 secure :-1 s=READY pgs=1534 cs=0 l=1 rx=0x7f3820002f70 tx=0x7f3838061d60).stop 2020-05-18T21:33:50.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.467+0000 7f383d483700 1 -- 172.21.15.63:0/2324094535 shutdown_connections 2020-05-18T21:33:50.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.467+0000 7f383d483700 1 --2- 172.21.15.63:0/2324094535 >> v2:172.21.15.155:3300/0 conn(0x7f3838143380 0x7f383812e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:50.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.467+0000 7f383d483700 1 --2- 172.21.15.63:0/2324094535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3838145e30 0x7f3838142f20 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:50.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.467+0000 7f383d483700 1 --2- 172.21.15.63:0/2324094535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38380bc8d0 0x7f3838060b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:50.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.467+0000 7f383d483700 1 -- 172.21.15.63:0/2324094535 >> 172.21.15.63:0/2324094535 conn(0x7f383805f3b0 msgr2=0x7f383805f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:50.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.467+0000 7f383d483700 1 -- 172.21.15.63:0/2324094535 shutdown_connections 2020-05-18T21:33:50.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.467+0000 7f383d483700 1 -- 172.21.15.63:0/2324094535 wait complete. 2020-05-18T21:33:50.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.467+0000 7f383d483700 1 Processor -- start 2020-05-18T21:33:50.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.467+0000 7f383d483700 1 -- start start 2020-05-18T21:33:50.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f383d483700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3838145e30 0x7f38380b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:50.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f383d483700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38380b2700 con 0x7f38380bc8d0 2020-05-18T21:33:50.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f383d483700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38380b29a0 con 0x7f3838143380 2020-05-18T21:33:50.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f383d483700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38380b2c40 con 0x7f3838145e30 2020-05-18T21:33:50.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f3837fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f38380bc8d0 0x7f38380b4f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35136/0 (socket says 172.21.15.63:35136) 2020-05-18T21:33:50.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f3837fff700 1 -- 172.21.15.63:0/1328717685 learned_addr learned my addr 172.21.15.63:0/1328717685 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:50.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f383cc82700 1 --2- 172.21.15.63:0/1328717685 >> v2:172.21.15.63:3300/0 conn(0x7f3838145e30 0x7f38380b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f383cc82700 1 -- 172.21.15.63:0/1328717685 >> v1:172.21.15.155:6789/0 conn(0x7f3838143380 legacy=0x7f38381357e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f383cc82700 1 -- 172.21.15.63:0/1328717685 >> v1:172.21.15.63:6789/0 conn(0x7f38380bc8d0 legacy=0x7f38380b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f3835ffb700 1 -- 172.21.15.63:0/1328717685 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479365922 0 0) 0x7f38380b29a0 con 0x7f3838143380 2020-05-18T21:33:50.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f383cc82700 1 -- 172.21.15.63:0/1328717685 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38380b56a0 con 0x7f3838145e30 2020-05-18T21:33:50.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f383cc82700 1 --2- 172.21.15.63:0/1328717685 >> v2:172.21.15.63:3300/0 conn(0x7f3838145e30 0x7f38380b30e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3828002f70 tx=0x7f3830010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f383cc82700 1 --2- 172.21.15.63:0/1328717685 >> v2:172.21.15.63:3300/0 conn(0x7f3838145e30 0x7f38380b30e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3828002f70 tx=0x7f3830010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f383cc82700 1 --2- 172.21.15.63:0/1328717685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3838145e30 0x7f38380b30e0 secure :-1 s=READY pgs=1536 cs=0 l=1 rx=0x7f3828002f70 tx=0x7f3830010db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:50.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f383cc82700 1 --2- 172.21.15.63:0/1328717685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3838145e30 0x7f38380b30e0 secure :-1 s=THROTTLE_DONE pgs=1536 cs=0 l=1 rx=0x7f3828002f70 tx=0x7f3830010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f3835ffb700 1 -- 172.21.15.63:0/1328717685 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3830012b70 con 0x7f3838145e30 2020-05-18T21:33:50.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f383cc82700 1 --2- 172.21.15.63:0/1328717685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3838145e30 0x7f38380b30e0 secure :-1 s=THROTTLE_DONE pgs=1536 cs=0 l=1 rx=0x7f3828002f70 tx=0x7f3830010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f3835ffb700 1 -- 172.21.15.63:0/1328717685 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3830012cd0 con 0x7f3838145e30 2020-05-18T21:33:50.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f383d483700 1 -- 172.21.15.63:0/1328717685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38380b23d0 con 0x7f3838145e30 2020-05-18T21:33:50.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f383cc82700 1 --2- 172.21.15.63:0/1328717685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3838145e30 0x7f38380b30e0 secure :-1 s=THROTTLE_DONE pgs=1536 cs=0 l=1 rx=0x7f3828002f70 tx=0x7f3830010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f3835ffb700 1 -- 172.21.15.63:0/1328717685 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3830012e40 con 0x7f3838145e30 2020-05-18T21:33:50.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f383d483700 1 -- 172.21.15.63:0/1328717685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38381423f0 con 0x7f3838145e30 2020-05-18T21:33:50.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f383cc82700 1 --2- 172.21.15.63:0/1328717685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3838145e30 0x7f38380b30e0 secure :-1 s=THROTTLE_DONE pgs=1536 cs=0 l=1 rx=0x7f3828002f70 tx=0x7f3830010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f383d483700 1 -- 172.21.15.63:0/1328717685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38380569e0 con 0x7f3838145e30 2020-05-18T21:33:50.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.471+0000 7f3835ffb700 1 -- 172.21.15.63:0/1328717685 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3830005a80 con 0x7f3838145e30 2020-05-18T21:33:50.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.475+0000 7f383cc82700 1 --2- 172.21.15.63:0/1328717685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3838145e30 0x7f38380b30e0 secure :-1 s=THROTTLE_DONE pgs=1536 cs=0 l=1 rx=0x7f3828002f70 tx=0x7f3830010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.475+0000 7f3835ffb700 1 --2- 172.21.15.63:0/1328717685 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f381c04f800 0x7f381c051cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:50.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.475+0000 7f3835ffb700 1 -- 172.21.15.63:0/1328717685 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3830064380 con 0x7f3838145e30 2020-05-18T21:33:50.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.475+0000 7f3837fff700 1 --2- 172.21.15.63:0/1328717685 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f381c04f800 0x7f381c051cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.475+0000 7f3837fff700 1 --2- 172.21.15.63:0/1328717685 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f381c04f800 0x7f381c051cc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3828007a80 tx=0x7f38280022e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.475+0000 7f3837fff700 1 --2- 172.21.15.63:0/1328717685 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f381c04f800 0x7f381c051cc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3828007a80 tx=0x7f38280022e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.475+0000 7f3837fff700 1 --2- 172.21.15.63:0/1328717685 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f381c04f800 0x7f381c051cc0 secure :-1 s=READY pgs=599 cs=0 l=1 rx=0x7f3828007a80 tx=0x7f38280022e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:50.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.479+0000 7f383cc82700 1 --2- 172.21.15.63:0/1328717685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3838145e30 0x7f38380b30e0 secure :-1 s=THROTTLE_DONE pgs=1536 cs=0 l=1 rx=0x7f3828002f70 tx=0x7f3830010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.479+0000 7f3835ffb700 1 -- 172.21.15.63:0/1328717685 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f383003e710 con 0x7f3838145e30 2020-05-18T21:33:50.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.599+0000 7f383d483700 1 -- 172.21.15.63:0/1328717685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f38380b2560 con 0x7f3838145e30 2020-05-18T21:33:50.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.599+0000 7f383cc82700 1 --2- 172.21.15.63:0/1328717685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3838145e30 0x7f38380b30e0 secure :-1 s=THROTTLE_DONE pgs=1536 cs=0 l=1 rx=0x7f3828002f70 tx=0x7f3830010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.599+0000 7f3835ffb700 1 -- 172.21.15.63:0/1328717685 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v114) v1 ==== 110+0+10 (secure 0 0 0) 0x7f38380b2560 con 0x7f3838145e30 2020-05-18T21:33:50.602 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:33:50.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.599+0000 7f383d483700 1 -- 172.21.15.63:0/1328717685 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f381c04f800 msgr2=0x7f381c051cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.599+0000 7f383d483700 1 --2- 172.21.15.63:0/1328717685 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f381c04f800 0x7f381c051cc0 secure :-1 s=READY pgs=599 cs=0 l=1 rx=0x7f3828007a80 tx=0x7f38280022e0).stop 2020-05-18T21:33:50.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.599+0000 7f383d483700 1 -- 172.21.15.63:0/1328717685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3838145e30 msgr2=0x7f38380b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.599+0000 7f383d483700 1 --2- 172.21.15.63:0/1328717685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3838145e30 0x7f38380b30e0 secure :-1 s=READY pgs=1536 cs=0 l=1 rx=0x7f3828002f70 tx=0x7f3830010db0).stop 2020-05-18T21:33:50.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.599+0000 7f383d483700 1 -- 172.21.15.63:0/1328717685 shutdown_connections 2020-05-18T21:33:50.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.599+0000 7f383d483700 1 --2- 172.21.15.63:0/1328717685 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f381c04f800 0x7f381c051cc0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:50.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.599+0000 7f383d483700 1 --2- 172.21.15.63:0/1328717685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3838145e30 0x7f38380b30e0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:50.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.599+0000 7f383d483700 1 -- 172.21.15.63:0/1328717685 >> 172.21.15.63:0/1328717685 conn(0x7f383805f3b0 msgr2=0x7f38380b9030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:50.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.599+0000 7f383d483700 1 -- 172.21.15.63:0/1328717685 shutdown_connections 2020-05-18T21:33:50.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.599+0000 7f383d483700 1 -- 172.21.15.63:0/1328717685 wait complete. 2020-05-18T21:33:50.615 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:33:50.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.719+0000 7f3883dbf700 1 Processor -- start 2020-05-18T21:33:50.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.719+0000 7f3883dbf700 1 -- start start 2020-05-18T21:33:50.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.719+0000 7f3883dbf700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f387c14b340 0x7f387c14d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:50.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.719+0000 7f3883dbf700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387c0b8a80 con 0x7f387c061e60 2020-05-18T21:33:50.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.719+0000 7f3883dbf700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387c0b8d20 con 0x7f387c142260 2020-05-18T21:33:50.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.719+0000 7f3883dbf700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387c0b8fc0 con 0x7f387c14b340 2020-05-18T21:33:50.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.719+0000 7f388235c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f387c14b340 0x7f387c14d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.719+0000 7f3881b5b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f387c061e60 0x7f387c0b80c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35144/0 (socket says 172.21.15.63:35144) 2020-05-18T21:33:50.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.719+0000 7f388235c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f387c14b340 0x7f387c14d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32960/0 (socket says 172.21.15.63:32960) 2020-05-18T21:33:50.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.719+0000 7f3881b5b700 1 -- 172.21.15.63:0/359516708 learned_addr learned my addr 172.21.15.63:0/359516708 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:50.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f388235c700 1 -- 172.21.15.63:0/359516708 >> v1:172.21.15.155:6789/0 conn(0x7f387c142260 legacy=0x7f387c1426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:50.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f388235c700 1 -- 172.21.15.63:0/359516708 >> v1:172.21.15.63:6789/0 conn(0x7f387c061e60 legacy=0x7f387c0b80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f3880b59700 1 -- 172.21.15.63:0/359516708 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962377247 0 0) 0x7f387c0b8a80 con 0x7f387c061e60 2020-05-18T21:33:50.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f388235c700 1 -- 172.21.15.63:0/359516708 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c0b5de0 con 0x7f387c14b340 2020-05-18T21:33:50.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f388235c700 1 --2- 172.21.15.63:0/359516708 >> v2:172.21.15.63:3300/0 conn(0x7f387c14b340 0x7f387c14d730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f387c066aa0 tx=0x7f3874007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f388235c700 1 --2- 172.21.15.63:0/359516708 >> v2:172.21.15.63:3300/0 conn(0x7f387c14b340 0x7f387c14d730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f387c066aa0 tx=0x7f3874007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f388235c700 1 --2- 172.21.15.63:0/359516708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f387c14b340 0x7f387c14d730 secure :-1 s=READY pgs=1538 cs=0 l=1 rx=0x7f387c066aa0 tx=0x7f3874007e00).ready entity=mon.0 client_cookie=39f71565315fde99 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:50.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f388235c700 1 --2- 172.21.15.63:0/359516708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f387c14b340 0x7f387c14d730 secure :-1 s=THROTTLE_DONE pgs=1538 cs=0 l=1 rx=0x7f387c066aa0 tx=0x7f3874007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f3880b59700 1 -- 172.21.15.63:0/359516708 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f387400a180 con 0x7f387c14b340 2020-05-18T21:33:50.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f388235c700 1 --2- 172.21.15.63:0/359516708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f387c14b340 0x7f387c14d730 secure :-1 s=THROTTLE_DONE pgs=1538 cs=0 l=1 rx=0x7f387c066aa0 tx=0x7f3874007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f388235c700 1 --2- 172.21.15.63:0/359516708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f387c14b340 0x7f387c14d730 secure :-1 s=THROTTLE_DONE pgs=1538 cs=0 l=1 rx=0x7f387c066aa0 tx=0x7f3874007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f3880b59700 1 -- 172.21.15.63:0/359516708 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387400a2e0 con 0x7f387c14b340 2020-05-18T21:33:50.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f3880b59700 1 -- 172.21.15.63:0/359516708 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f387400a640 con 0x7f387c14b340 2020-05-18T21:33:50.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f3883dbf700 1 -- 172.21.15.63:0/359516708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f387c14b340 msgr2=0x7f387c14d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f3883dbf700 1 --2- 172.21.15.63:0/359516708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f387c14b340 0x7f387c14d730 secure :-1 s=READY pgs=1538 cs=0 l=1 rx=0x7f387c066aa0 tx=0x7f3874007e00).stop 2020-05-18T21:33:50.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f3883dbf700 1 -- 172.21.15.63:0/359516708 shutdown_connections 2020-05-18T21:33:50.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f3883dbf700 1 --2- 172.21.15.63:0/359516708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f387c14b340 0x7f387c14d730 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:50.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f3883dbf700 1 -- 172.21.15.63:0/359516708 >> 172.21.15.63:0/359516708 conn(0x7f387c0b9700 msgr2=0x7f387c0b9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:50.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f3883dbf700 1 -- 172.21.15.63:0/359516708 shutdown_connections 2020-05-18T21:33:50.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f3883dbf700 1 -- 172.21.15.63:0/359516708 wait complete. 2020-05-18T21:33:50.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f3883dbf700 1 Processor -- start 2020-05-18T21:33:50.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.723+0000 7f3883dbf700 1 -- start start 2020-05-18T21:33:50.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3883dbf700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f387c061e60 0x7f387c1340a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:50.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3883dbf700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f387c142260 0x7f387c134500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:50.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3883dbf700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f387c14b340 0x7f387c0b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:50.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3883dbf700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387c0b3250 con 0x7f387c061e60 2020-05-18T21:33:50.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3883dbf700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387c0b2ac0 con 0x7f387c14b340 2020-05-18T21:33:50.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3883dbf700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0b34b0 con 0x7f387c142260 2020-05-18T21:33:50.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3881b5b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f387c061e60 0x7f387c1340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3881b5b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f387c061e60 0x7f387c1340a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32966/0 (socket says 172.21.15.63:32966) 2020-05-18T21:33:50.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3881b5b700 1 -- 172.21.15.63:0/2218489543 learned_addr learned my addr 172.21.15.63:0/2218489543 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:50.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f388235c700 1 --2- 172.21.15.63:0/2218489543 >> v2:172.21.15.155:3300/0 conn(0x7f387c14b340 0x7f387c0b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f388135a700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f387c142260 0x7f387c134500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3881b5b700 1 -- 172.21.15.63:0/2218489543 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f387c142260 msgr2=0x7f387c134500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3881b5b700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f387c142260 0x7f387c134500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:50.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3881b5b700 1 -- 172.21.15.63:0/2218489543 >> v2:172.21.15.155:3300/0 conn(0x7f387c14b340 msgr2=0x7f387c0b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3881b5b700 1 --2- 172.21.15.63:0/2218489543 >> v2:172.21.15.155:3300/0 conn(0x7f387c14b340 0x7f387c0b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:50.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3881b5b700 1 -- 172.21.15.63:0/2218489543 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c0b2d60 con 0x7f387c061e60 2020-05-18T21:33:50.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3881b5b700 1 --2- 172.21.15.63:0/2218489543 >> v2:172.21.15.63:3300/0 conn(0x7f387c061e60 0x7f387c1340a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f386c000bc0 tx=0x7f386c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3881b5b700 1 --2- 172.21.15.63:0/2218489543 >> v2:172.21.15.63:3300/0 conn(0x7f387c061e60 0x7f387c1340a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f386c000bc0 tx=0x7f386c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3881b5b700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f387c061e60 0x7f387c1340a0 secure :-1 s=READY pgs=1539 cs=0 l=1 rx=0x7f386c000bc0 tx=0x7f386c0109a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:50.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3881b5b700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f387c061e60 0x7f387c1340a0 secure :-1 s=THROTTLE_DONE pgs=1539 cs=0 l=1 rx=0x7f386c000bc0 tx=0x7f386c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3881b5b700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f387c061e60 0x7f387c1340a0 secure :-1 s=THROTTLE_DONE pgs=1539 cs=0 l=1 rx=0x7f386c000bc0 tx=0x7f386c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f387affd700 1 -- 172.21.15.63:0/2218489543 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f386c005ce0 con 0x7f387c061e60 2020-05-18T21:33:50.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3881b5b700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f387c061e60 0x7f387c1340a0 secure :-1 s=THROTTLE_DONE pgs=1539 cs=0 l=1 rx=0x7f386c000bc0 tx=0x7f386c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f387affd700 1 -- 172.21.15.63:0/2218489543 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386c005e40 con 0x7f387c061e60 2020-05-18T21:33:50.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3883dbf700 1 -- 172.21.15.63:0/2218489543 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387c05f6e0 con 0x7f387c061e60 2020-05-18T21:33:50.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f387affd700 1 -- 172.21.15.63:0/2218489543 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f386c0062c0 con 0x7f387c061e60 2020-05-18T21:33:50.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3883dbf700 1 -- 172.21.15.63:0/2218489543 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387c09f670 con 0x7f387c061e60 2020-05-18T21:33:50.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.727+0000 7f3881b5b700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f387c061e60 0x7f387c1340a0 secure :-1 s=THROTTLE_DONE pgs=1539 cs=0 l=1 rx=0x7f386c000bc0 tx=0x7f386c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.731+0000 7f3883dbf700 1 -- 172.21.15.63:0/2218489543 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387c09f390 con 0x7f387c061e60 2020-05-18T21:33:50.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.731+0000 7f387affd700 1 -- 172.21.15.63:0/2218489543 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f386c006530 con 0x7f387c061e60 2020-05-18T21:33:50.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.731+0000 7f3881b5b700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f387c061e60 0x7f387c1340a0 secure :-1 s=THROTTLE_DONE pgs=1539 cs=0 l=1 rx=0x7f386c000bc0 tx=0x7f386c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.731+0000 7f387affd700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f385c04f9b0 0x7f385c051e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:50.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.731+0000 7f387affd700 1 -- 172.21.15.63:0/2218489543 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f386c0090c0 con 0x7f387c061e60 2020-05-18T21:33:50.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.731+0000 7f388135a700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f385c04f9b0 0x7f385c051e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.731+0000 7f388135a700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f385c04f9b0 0x7f385c051e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3870000ed0 tx=0x7f3870003a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.731+0000 7f388135a700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f385c04f9b0 0x7f385c051e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3870000ed0 tx=0x7f3870003a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.731+0000 7f388135a700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f385c04f9b0 0x7f385c051e70 secure :-1 s=READY pgs=600 cs=0 l=1 rx=0x7f3870000ed0 tx=0x7f3870003a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:50.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.735+0000 7f3881b5b700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f387c061e60 0x7f387c1340a0 secure :-1 s=THROTTLE_DONE pgs=1539 cs=0 l=1 rx=0x7f386c000bc0 tx=0x7f386c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.735+0000 7f387affd700 1 -- 172.21.15.63:0/2218489543 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f386c03e120 con 0x7f387c061e60 2020-05-18T21:33:50.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.851+0000 7f3883dbf700 1 -- 172.21.15.63:0/2218489543 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f387c0569e0 con 0x7f387c061e60 2020-05-18T21:33:50.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.851+0000 7f3881b5b700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f387c061e60 0x7f387c1340a0 secure :-1 s=THROTTLE_DONE pgs=1539 cs=0 l=1 rx=0x7f386c000bc0 tx=0x7f386c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.851+0000 7f387affd700 1 -- 172.21.15.63:0/2218489543 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v114) v1 ==== 92+0+10 (secure 0 0 0) 0x7f386c041740 con 0x7f387c061e60 2020-05-18T21:33:50.855 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:33:50.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.851+0000 7f3883dbf700 1 -- 172.21.15.63:0/2218489543 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f385c04f9b0 msgr2=0x7f385c051e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.851+0000 7f3883dbf700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f385c04f9b0 0x7f385c051e70 secure :-1 s=READY pgs=600 cs=0 l=1 rx=0x7f3870000ed0 tx=0x7f3870003a80).stop 2020-05-18T21:33:50.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.851+0000 7f3883dbf700 1 -- 172.21.15.63:0/2218489543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f387c061e60 msgr2=0x7f387c1340a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.851+0000 7f3883dbf700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f387c061e60 0x7f387c1340a0 secure :-1 s=READY pgs=1539 cs=0 l=1 rx=0x7f386c000bc0 tx=0x7f386c0109a0).stop 2020-05-18T21:33:50.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.851+0000 7f3883dbf700 1 -- 172.21.15.63:0/2218489543 shutdown_connections 2020-05-18T21:33:50.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.851+0000 7f3883dbf700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f385c04f9b0 0x7f385c051e70 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:50.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.851+0000 7f3883dbf700 1 --2- 172.21.15.63:0/2218489543 >> v2:172.21.15.155:3300/0 conn(0x7f387c14b340 0x7f387c0b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:50.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.851+0000 7f3883dbf700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f387c142260 0x7f387c134500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:50.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.851+0000 7f3883dbf700 1 --2- 172.21.15.63:0/2218489543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f387c061e60 0x7f387c1340a0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:50.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.851+0000 7f3883dbf700 1 -- 172.21.15.63:0/2218489543 >> 172.21.15.63:0/2218489543 conn(0x7f387c0b9700 msgr2=0x7f387c05eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:50.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.855+0000 7f3883dbf700 1 -- 172.21.15.63:0/2218489543 shutdown_connections 2020-05-18T21:33:50.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.855+0000 7f3883dbf700 1 -- 172.21.15.63:0/2218489543 wait complete. 2020-05-18T21:33:50.868 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:33:50.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.971+0000 7f15155f0700 1 Processor -- start 2020-05-18T21:33:50.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.971+0000 7f15155f0700 1 -- start start 2020-05-18T21:33:50.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f15155f0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1510143430 0x7f1510145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:50.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f15155f0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f15100b7bf0 0x7f15100b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:50.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f15155f0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1510143810 con 0x7f15100b6d70 2020-05-18T21:33:50.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f15155f0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15100b7210 con 0x7f15100b7bf0 2020-05-18T21:33:50.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f15155f0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15100b74b0 con 0x7f1510143430 2020-05-18T21:33:50.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f150f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f15100b7bf0 0x7f15100b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f150f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f15100b7bf0 0x7f15100b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32974/0 (socket says 172.21.15.63:32974) 2020-05-18T21:33:50.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f150f7fe700 1 -- 172.21.15.63:0/1577374957 learned_addr learned my addr 172.21.15.63:0/1577374957 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:50.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f150effd700 1 --2- 172.21.15.63:0/1577374957 >> v2:172.21.15.155:3300/0 conn(0x7f1510143430 0x7f1510145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f150f7fe700 1 -- 172.21.15.63:0/1577374957 >> v2:172.21.15.155:3300/0 conn(0x7f1510143430 msgr2=0x7f1510145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f150f7fe700 1 --2- 172.21.15.63:0/1577374957 >> v2:172.21.15.155:3300/0 conn(0x7f1510143430 0x7f1510145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f150f7fe700 1 -- 172.21.15.63:0/1577374957 >> v1:172.21.15.155:6789/0 conn(0x7f15100b6d70 legacy=0x7f15100b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f150f7fe700 1 -- 172.21.15.63:0/1577374957 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15100b7750 con 0x7f15100b7bf0 2020-05-18T21:33:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f150effd700 1 --2- 172.21.15.63:0/1577374957 >> v2:172.21.15.155:3300/0 conn(0x7f1510143430 0x7f1510145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:33:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f150f7fe700 1 --2- 172.21.15.63:0/1577374957 >> v2:172.21.15.63:3300/0 conn(0x7f15100b7bf0 0x7f15100b4290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f15080032f0 tx=0x7f1508007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f150f7fe700 1 --2- 172.21.15.63:0/1577374957 >> v2:172.21.15.63:3300/0 conn(0x7f15100b7bf0 0x7f15100b4290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f15080032f0 tx=0x7f1508007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f150f7fe700 1 --2- 172.21.15.63:0/1577374957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15100b7bf0 0x7f15100b4290 secure :-1 s=READY pgs=1540 cs=0 l=1 rx=0x7f15080032f0 tx=0x7f1508007e00).ready entity=mon.0 client_cookie=656e2552aef1b1a2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f150f7fe700 1 --2- 172.21.15.63:0/1577374957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15100b7bf0 0x7f15100b4290 secure :-1 s=THROTTLE_DONE pgs=1540 cs=0 l=1 rx=0x7f15080032f0 tx=0x7f1508007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f150dffb700 1 -- 172.21.15.63:0/1577374957 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1508011dc0 con 0x7f15100b7bf0 2020-05-18T21:33:50.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f150f7fe700 1 --2- 172.21.15.63:0/1577374957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15100b7bf0 0x7f15100b4290 secure :-1 s=THROTTLE_DONE pgs=1540 cs=0 l=1 rx=0x7f15080032f0 tx=0x7f1508007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f150f7fe700 1 --2- 172.21.15.63:0/1577374957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15100b7bf0 0x7f15100b4290 secure :-1 s=THROTTLE_DONE pgs=1540 cs=0 l=1 rx=0x7f15080032f0 tx=0x7f1508007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f150dffb700 1 -- 172.21.15.63:0/1577374957 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150800a180 con 0x7f15100b7bf0 2020-05-18T21:33:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f150dffb700 1 -- 172.21.15.63:0/1577374957 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f150800a5a0 con 0x7f15100b7bf0 2020-05-18T21:33:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f15155f0700 1 -- 172.21.15.63:0/1577374957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15100b7bf0 msgr2=0x7f15100b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f15155f0700 1 --2- 172.21.15.63:0/1577374957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15100b7bf0 0x7f15100b4290 secure :-1 s=READY pgs=1540 cs=0 l=1 rx=0x7f15080032f0 tx=0x7f1508007e00).stop 2020-05-18T21:33:50.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f15155f0700 1 -- 172.21.15.63:0/1577374957 shutdown_connections 2020-05-18T21:33:50.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f15155f0700 1 --2- 172.21.15.63:0/1577374957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15100b7bf0 0x7f15100b4290 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:50.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f15155f0700 1 --2- 172.21.15.63:0/1577374957 >> v2:172.21.15.155:3300/0 conn(0x7f1510143430 0x7f1510145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:50.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f15155f0700 1 -- 172.21.15.63:0/1577374957 >> 172.21.15.63:0/1577374957 conn(0x7f1510069b70 msgr2=0x7f1510069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:50.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f15155f0700 1 -- 172.21.15.63:0/1577374957 shutdown_connections 2020-05-18T21:33:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.975+0000 7f15155f0700 1 -- 172.21.15.63:0/1577374957 wait complete. 2020-05-18T21:33:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.979+0000 7f15155f0700 1 Processor -- start 2020-05-18T21:33:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.979+0000 7f15155f0700 1 -- start start 2020-05-18T21:33:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.979+0000 7f15155f0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f15100b6d70 0x7f15101480e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:50.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.979+0000 7f15155f0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1510143430 0x7f1510148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:50.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.979+0000 7f15155f0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1510148540 con 0x7f15100b7bf0 2020-05-18T21:33:50.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.979+0000 7f15155f0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1510149370 con 0x7f15100b6d70 2020-05-18T21:33:50.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.979+0000 7f15155f0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15100ad5e0 con 0x7f1510143430 2020-05-18T21:33:50.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.979+0000 7f150effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f15100b6d70 0x7f15101480e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.979+0000 7f150e7fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f15100b7bf0 0x7f15101568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35166/0 (socket says 172.21.15.63:35166) 2020-05-18T21:33:50.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.979+0000 7f150e7fc700 1 -- 172.21.15.63:0/2351818948 learned_addr learned my addr 172.21.15.63:0/2351818948 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:50.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.979+0000 7f150f7fe700 1 --2- 172.21.15.63:0/2351818948 >> v2:172.21.15.155:3300/0 conn(0x7f1510143430 0x7f1510148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:50.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.979+0000 7f150effd700 1 -- 172.21.15.63:0/2351818948 >> v2:172.21.15.155:3300/0 conn(0x7f1510143430 msgr2=0x7f1510148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.979+0000 7f150effd700 1 --2- 172.21.15.63:0/2351818948 >> v2:172.21.15.155:3300/0 conn(0x7f1510143430 0x7f1510148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:50.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.979+0000 7f150effd700 1 -- 172.21.15.63:0/2351818948 >> v1:172.21.15.63:6789/0 conn(0x7f15100b7bf0 legacy=0x7f15101568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:50.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.979+0000 7f150effd700 1 -- 172.21.15.63:0/2351818948 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15100ad880 con 0x7f15100b6d70 2020-05-18T21:33:50.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.979+0000 7f14fffff700 1 -- 172.21.15.63:0/2351818948 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435500196 0 0) 0x7f1510148540 con 0x7f15100b7bf0 2020-05-18T21:33:50.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.979+0000 7f150effd700 1 --2- 172.21.15.63:0/2351818948 >> v2:172.21.15.63:3300/0 conn(0x7f15100b6d70 0x7f15101480e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1504002f70 tx=0x7f1504010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.979+0000 7f150effd700 1 --2- 172.21.15.63:0/2351818948 >> v2:172.21.15.63:3300/0 conn(0x7f15100b6d70 0x7f15101480e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1504002f70 tx=0x7f1504010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:50.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.979+0000 7f150effd700 1 --2- 172.21.15.63:0/2351818948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15100b6d70 0x7f15101480e0 secure :-1 s=READY pgs=1542 cs=0 l=1 rx=0x7f1504002f70 tx=0x7f1504010a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:50.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.983+0000 7f150effd700 1 --2- 172.21.15.63:0/2351818948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15100b6d70 0x7f15101480e0 secure :-1 s=THROTTLE_DONE pgs=1542 cs=0 l=1 rx=0x7f1504002f70 tx=0x7f1504010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.983+0000 7f14fffff700 1 -- 172.21.15.63:0/2351818948 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1504013070 con 0x7f15100b6d70 2020-05-18T21:33:51.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.983+0000 7f150effd700 1 --2- 172.21.15.63:0/2351818948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15100b6d70 0x7f15101480e0 secure :-1 s=THROTTLE_DONE pgs=1542 cs=0 l=1 rx=0x7f1504002f70 tx=0x7f1504010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.983+0000 7f14fffff700 1 -- 172.21.15.63:0/2351818948 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1504007180 con 0x7f15100b6d70 2020-05-18T21:33:51.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.983+0000 7f15155f0700 1 -- 172.21.15.63:0/2351818948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15101439a0 con 0x7f15100b6d70 2020-05-18T21:33:51.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.983+0000 7f150effd700 1 --2- 172.21.15.63:0/2351818948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15100b6d70 0x7f15101480e0 secure :-1 s=THROTTLE_DONE pgs=1542 cs=0 l=1 rx=0x7f1504002f70 tx=0x7f1504010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.983+0000 7f14fffff700 1 -- 172.21.15.63:0/2351818948 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15040074e0 con 0x7f15100b6d70 2020-05-18T21:33:51.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.983+0000 7f15155f0700 1 -- 172.21.15.63:0/2351818948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15101573f0 con 0x7f15100b6d70 2020-05-18T21:33:51.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.983+0000 7f15155f0700 1 -- 172.21.15.63:0/2351818948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15100569e0 con 0x7f15100b6d70 2020-05-18T21:33:51.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.983+0000 7f150effd700 1 --2- 172.21.15.63:0/2351818948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15100b6d70 0x7f15101480e0 secure :-1 s=THROTTLE_DONE pgs=1542 cs=0 l=1 rx=0x7f1504002f70 tx=0x7f1504010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.983+0000 7f14fffff700 1 -- 172.21.15.63:0/2351818948 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1504012130 con 0x7f15100b6d70 2020-05-18T21:33:51.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.983+0000 7f150effd700 1 --2- 172.21.15.63:0/2351818948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15100b6d70 0x7f15101480e0 secure :-1 s=THROTTLE_DONE pgs=1542 cs=0 l=1 rx=0x7f1504002f70 tx=0x7f1504010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.983+0000 7f14fffff700 1 --2- 172.21.15.63:0/2351818948 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14ec04f950 0x7f14ec051e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:51.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.983+0000 7f14fffff700 1 -- 172.21.15.63:0/2351818948 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1504063b20 con 0x7f15100b6d70 2020-05-18T21:33:51.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.983+0000 7f150e7fc700 1 --2- 172.21.15.63:0/2351818948 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14ec04f950 0x7f14ec051e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:51.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.987+0000 7f150e7fc700 1 --2- 172.21.15.63:0/2351818948 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14ec04f950 0x7f14ec051e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1500001380 tx=0x7f151005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.987+0000 7f150e7fc700 1 --2- 172.21.15.63:0/2351818948 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14ec04f950 0x7f14ec051e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1500001380 tx=0x7f151005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.987+0000 7f150e7fc700 1 --2- 172.21.15.63:0/2351818948 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14ec04f950 0x7f14ec051e10 secure :-1 s=READY pgs=601 cs=0 l=1 rx=0x7f1500001380 tx=0x7f151005ab60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:51.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.991+0000 7f150effd700 1 --2- 172.21.15.63:0/2351818948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15100b6d70 0x7f15101480e0 secure :-1 s=THROTTLE_DONE pgs=1542 cs=0 l=1 rx=0x7f1504002f70 tx=0x7f1504010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:50.991+0000 7f14fffff700 1 -- 172.21.15.63:0/2351818948 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f150403de50 con 0x7f15100b6d70 2020-05-18T21:33:51.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.111+0000 7f15155f0700 1 -- 172.21.15.63:0/2351818948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15100ad3c0 con 0x7f15100b6d70 2020-05-18T21:33:51.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.111+0000 7f150effd700 1 --2- 172.21.15.63:0/2351818948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15100b6d70 0x7f15101480e0 secure :-1 s=THROTTLE_DONE pgs=1542 cs=0 l=1 rx=0x7f1504002f70 tx=0x7f1504010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.111+0000 7f14fffff700 1 -- 172.21.15.63:0/2351818948 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v114) v1 ==== 104+0+10 (secure 0 0 0) 0x7f1504041470 con 0x7f15100b6d70 2020-05-18T21:33:51.127 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:33:51.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.111+0000 7f15155f0700 1 -- 172.21.15.63:0/2351818948 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14ec04f950 msgr2=0x7f14ec051e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:51.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.111+0000 7f15155f0700 1 --2- 172.21.15.63:0/2351818948 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14ec04f950 0x7f14ec051e10 secure :-1 s=READY pgs=601 cs=0 l=1 rx=0x7f1500001380 tx=0x7f151005ab60).stop 2020-05-18T21:33:51.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.111+0000 7f15155f0700 1 -- 172.21.15.63:0/2351818948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15100b6d70 msgr2=0x7f15101480e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:51.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.111+0000 7f15155f0700 1 --2- 172.21.15.63:0/2351818948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15100b6d70 0x7f15101480e0 secure :-1 s=READY pgs=1542 cs=0 l=1 rx=0x7f1504002f70 tx=0x7f1504010a90).stop 2020-05-18T21:33:51.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.111+0000 7f15155f0700 1 -- 172.21.15.63:0/2351818948 shutdown_connections 2020-05-18T21:33:51.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.111+0000 7f15155f0700 1 --2- 172.21.15.63:0/2351818948 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14ec04f950 0x7f14ec051e10 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:51.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.111+0000 7f15155f0700 1 --2- 172.21.15.63:0/2351818948 >> v2:172.21.15.155:3300/0 conn(0x7f1510143430 0x7f1510148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:51.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.111+0000 7f15155f0700 1 --2- 172.21.15.63:0/2351818948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15100b6d70 0x7f15101480e0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:51.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.111+0000 7f15155f0700 1 -- 172.21.15.63:0/2351818948 >> 172.21.15.63:0/2351818948 conn(0x7f1510069b70 msgr2=0x7f15100b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:51.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.115+0000 7f15155f0700 1 -- 172.21.15.63:0/2351818948 shutdown_connections 2020-05-18T21:33:51.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.115+0000 7f15155f0700 1 -- 172.21.15.63:0/2351818948 wait complete. 2020-05-18T21:33:51.136 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:33:51.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.235+0000 7f1316bce700 1 Processor -- start 2020-05-18T21:33:51.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.235+0000 7f1316bce700 1 -- start start 2020-05-18T21:33:51.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1316bce700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f13100b9500 0x7f13100b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:51.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1316bce700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f13100b6d90 0x7f1310061270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:51.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1316bce700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100616d0 0x7f13100b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:51.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1316bce700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13100b7ec0 con 0x7f13100b6d90 2020-05-18T21:33:51.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1316bce700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1310060660 con 0x7f13100b9500 2020-05-18T21:33:51.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1316bce700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1310060890 con 0x7f13100616d0 2020-05-18T21:33:51.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1307fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f13100b6d90 0x7f1310061270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:51.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1307fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f13100b6d90 0x7f1310061270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32986/0 (socket says 172.21.15.63:32986) 2020-05-18T21:33:51.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1307fff700 1 -- 172.21.15.63:0/2232145936 learned_addr learned my addr 172.21.15.63:0/2232145936 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:51.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f131496a700 1 --2- 172.21.15.63:0/2232145936 >> v2:172.21.15.155:3300/0 conn(0x7f13100b9500 0x7f13100b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:51.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f131516b700 1 --2- 172.21.15.63:0/2232145936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100616d0 0x7f13100b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1307fff700 1 -- 172.21.15.63:0/2232145936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100616d0 msgr2=0x7f13100b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1307fff700 1 --2- 172.21.15.63:0/2232145936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100616d0 0x7f13100b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1307fff700 1 -- 172.21.15.63:0/2232145936 >> v2:172.21.15.155:3300/0 conn(0x7f13100b9500 msgr2=0x7f13100b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:51.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1307fff700 1 --2- 172.21.15.63:0/2232145936 >> v2:172.21.15.155:3300/0 conn(0x7f13100b9500 0x7f13100b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:51.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1307fff700 1 -- 172.21.15.63:0/2232145936 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1310060b30 con 0x7f13100b6d90 2020-05-18T21:33:51.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f131496a700 1 --2- 172.21.15.63:0/2232145936 >> v2:172.21.15.155:3300/0 conn(0x7f13100b9500 0x7f13100b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f131516b700 1 --2- 172.21.15.63:0/2232145936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100616d0 0x7f13100b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1307fff700 1 --2- 172.21.15.63:0/2232145936 >> v2:172.21.15.63:3300/0 conn(0x7f13100b6d90 0x7f1310061270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f131006ab40 tx=0x7f1300008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1307fff700 1 --2- 172.21.15.63:0/2232145936 >> v2:172.21.15.63:3300/0 conn(0x7f13100b6d90 0x7f1310061270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f131006ab40 tx=0x7f1300008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1307fff700 1 --2- 172.21.15.63:0/2232145936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13100b6d90 0x7f1310061270 secure :-1 s=READY pgs=1543 cs=0 l=1 rx=0x7f131006ab40 tx=0x7f1300008920).ready entity=mon.0 client_cookie=27acb4d95877fdb8 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:51.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1307fff700 1 --2- 172.21.15.63:0/2232145936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13100b6d90 0x7f1310061270 secure :-1 s=THROTTLE_DONE pgs=1543 cs=0 l=1 rx=0x7f131006ab40 tx=0x7f1300008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1307fff700 1 --2- 172.21.15.63:0/2232145936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13100b6d90 0x7f1310061270 secure :-1 s=THROTTLE_DONE pgs=1543 cs=0 l=1 rx=0x7f131006ab40 tx=0x7f1300008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f13077fe700 1 -- 172.21.15.63:0/2232145936 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1300011600 con 0x7f13100b6d90 2020-05-18T21:33:51.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1307fff700 1 --2- 172.21.15.63:0/2232145936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13100b6d90 0x7f1310061270 secure :-1 s=THROTTLE_DONE pgs=1543 cs=0 l=1 rx=0x7f131006ab40 tx=0x7f1300008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f13077fe700 1 -- 172.21.15.63:0/2232145936 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1300011760 con 0x7f13100b6d90 2020-05-18T21:33:51.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f13077fe700 1 -- 172.21.15.63:0/2232145936 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1300011b80 con 0x7f13100b6d90 2020-05-18T21:33:51.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1316bce700 1 -- 172.21.15.63:0/2232145936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13100b6d90 msgr2=0x7f1310061270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:51.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1316bce700 1 --2- 172.21.15.63:0/2232145936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13100b6d90 0x7f1310061270 secure :-1 s=READY pgs=1543 cs=0 l=1 rx=0x7f131006ab40 tx=0x7f1300008920).stop 2020-05-18T21:33:51.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1316bce700 1 -- 172.21.15.63:0/2232145936 shutdown_connections 2020-05-18T21:33:51.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1316bce700 1 --2- 172.21.15.63:0/2232145936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100616d0 0x7f13100b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:51.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1316bce700 1 --2- 172.21.15.63:0/2232145936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13100b6d90 0x7f1310061270 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:51.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1316bce700 1 --2- 172.21.15.63:0/2232145936 >> v2:172.21.15.155:3300/0 conn(0x7f13100b9500 0x7f13100b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1316bce700 1 -- 172.21.15.63:0/2232145936 >> 172.21.15.63:0/2232145936 conn(0x7f1310069b70 msgr2=0x7f1310069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1316bce700 1 -- 172.21.15.63:0/2232145936 shutdown_connections 2020-05-18T21:33:51.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.239+0000 7f1316bce700 1 -- 172.21.15.63:0/2232145936 wait complete. 2020-05-18T21:33:51.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1316bce700 1 Processor -- start 2020-05-18T21:33:51.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1316bce700 1 -- start start 2020-05-18T21:33:51.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1316bce700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100b6d90 0x7f13100bbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:51.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1316bce700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13100bc0f0 con 0x7f13100616d0 2020-05-18T21:33:51.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1316bce700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13100acee0 con 0x7f13100b9500 2020-05-18T21:33:51.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1316bce700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13100ad180 con 0x7f13100b6d90 2020-05-18T21:33:51.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f131496a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f13100616d0 0x7f131012c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35178/0 (socket says 172.21.15.63:35178) 2020-05-18T21:33:51.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f131496a700 1 -- 172.21.15.63:0/1768526209 learned_addr learned my addr 172.21.15.63:0/1768526209 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:51.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1307fff700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100b6d90 0x7f13100bbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:51.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1305ffb700 1 -- 172.21.15.63:0/1768526209 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479102296 0 0) 0x7f13100bc0f0 con 0x7f13100616d0 2020-05-18T21:33:51.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1305ffb700 1 -- 172.21.15.63:0/1768526209 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12f0002fe0 con 0x7f13100616d0 2020-05-18T21:33:51.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1305ffb700 1 -- 172.21.15.63:0/1768526209 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603173814 0 0) 0x7f13100acee0 con 0x7f13100b9500 2020-05-18T21:33:51.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1305ffb700 1 -- 172.21.15.63:0/1768526209 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13100bc0f0 con 0x7f13100b9500 2020-05-18T21:33:51.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1305ffb700 1 -- 172.21.15.63:0/1768526209 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2454306513 0 0) 0x7f12f0002fe0 con 0x7f13100616d0 2020-05-18T21:33:51.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1307fff700 1 -- 172.21.15.63:0/1768526209 >> v1:172.21.15.155:6789/0 conn(0x7f13100b9500 legacy=0x7f13100b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:51.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1307fff700 1 -- 172.21.15.63:0/1768526209 >> v1:172.21.15.63:6789/0 conn(0x7f13100616d0 legacy=0x7f131012c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:51.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1307fff700 1 -- 172.21.15.63:0/1768526209 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13100b15e0 con 0x7f13100b6d90 2020-05-18T21:33:51.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1307fff700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100b6d90 0x7f13100bbc90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f130c002f70 tx=0x7f13000113b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1307fff700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100b6d90 0x7f13100bbc90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f130c002f70 tx=0x7f13000113b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1307fff700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100b6d90 0x7f13100bbc90 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f130c002f70 tx=0x7f13000113b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:51.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1307fff700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100b6d90 0x7f13100bbc90 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f130c002f70 tx=0x7f13000113b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1305ffb700 1 -- 172.21.15.63:0/1768526209 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f130c002500 con 0x7f13100b6d90 2020-05-18T21:33:51.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1307fff700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100b6d90 0x7f13100bbc90 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f130c002f70 tx=0x7f13000113b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1307fff700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100b6d90 0x7f13100bbc90 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f130c002f70 tx=0x7f13000113b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1316bce700 1 -- 172.21.15.63:0/1768526209 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13100b2d80 con 0x7f13100b6d90 2020-05-18T21:33:51.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.243+0000 7f1305ffb700 1 -- 172.21.15.63:0/1768526209 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1300011a50 con 0x7f13100b6d90 2020-05-18T21:33:51.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.247+0000 7f1305ffb700 1 -- 172.21.15.63:0/1768526209 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1300008770 con 0x7f13100b6d90 2020-05-18T21:33:51.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.247+0000 7f1316bce700 1 -- 172.21.15.63:0/1768526209 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131012cda0 con 0x7f13100b6d90 2020-05-18T21:33:51.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.247+0000 7f1316bce700 1 -- 172.21.15.63:0/1768526209 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13100569e0 con 0x7f13100b6d90 2020-05-18T21:33:51.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.247+0000 7f1307fff700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100b6d90 0x7f13100bbc90 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f130c002f70 tx=0x7f13000113b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.247+0000 7f1305ffb700 1 -- 172.21.15.63:0/1768526209 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1300007360 con 0x7f13100b6d90 2020-05-18T21:33:51.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.247+0000 7f1307fff700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100b6d90 0x7f13100bbc90 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f130c002f70 tx=0x7f13000113b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.247+0000 7f1305ffb700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f12f004fea0 0x7f12f0052360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:51.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.247+0000 7f1305ffb700 1 -- 172.21.15.63:0/1768526209 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1300063a30 con 0x7f13100b6d90 2020-05-18T21:33:51.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.247+0000 7f131496a700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f12f004fea0 0x7f12f0052360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:51.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.247+0000 7f131496a700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f12f004fea0 0x7f12f0052360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f130c0030b0 tx=0x7f130c0027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.247+0000 7f131496a700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f12f004fea0 0x7f12f0052360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f130c0030b0 tx=0x7f130c0027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.251+0000 7f131496a700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f12f004fea0 0x7f12f0052360 secure :-1 s=READY pgs=602 cs=0 l=1 rx=0x7f130c0030b0 tx=0x7f130c0027b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:51.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.259+0000 7f1307fff700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100b6d90 0x7f13100bbc90 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f130c002f70 tx=0x7f13000113b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.259+0000 7f1305ffb700 1 -- 172.21.15.63:0/1768526209 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f130003de80 con 0x7f13100b6d90 2020-05-18T21:33:51.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.375+0000 7f1316bce700 1 -- 172.21.15.63:0/1768526209 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f13100b6470 con 0x7f13100b6d90 2020-05-18T21:33:51.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.375+0000 7f1307fff700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100b6d90 0x7f13100bbc90 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f130c002f70 tx=0x7f13000113b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.375+0000 7f1305ffb700 1 -- 172.21.15.63:0/1768526209 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v114) v1 ==== 100+0+10 (secure 0 0 0) 0x7f13000414a0 con 0x7f13100b6d90 2020-05-18T21:33:51.381 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:33:51.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.379+0000 7f1316bce700 1 -- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f12f004fea0 msgr2=0x7f12f0052360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:51.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.379+0000 7f1316bce700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f12f004fea0 0x7f12f0052360 secure :-1 s=READY pgs=602 cs=0 l=1 rx=0x7f130c0030b0 tx=0x7f130c0027b0).stop 2020-05-18T21:33:51.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.379+0000 7f1316bce700 1 -- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100b6d90 msgr2=0x7f13100bbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:51.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.379+0000 7f1316bce700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100b6d90 0x7f13100bbc90 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f130c002f70 tx=0x7f13000113b0).stop 2020-05-18T21:33:51.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.379+0000 7f1316bce700 1 -- 172.21.15.63:0/1768526209 shutdown_connections 2020-05-18T21:33:51.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.379+0000 7f1316bce700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f12f004fea0 0x7f12f0052360 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:51.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.379+0000 7f1316bce700 1 --2- 172.21.15.63:0/1768526209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100b6d90 0x7f13100bbc90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:51.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.379+0000 7f1316bce700 1 -- 172.21.15.63:0/1768526209 >> 172.21.15.63:0/1768526209 conn(0x7f1310069b70 msgr2=0x7f13100bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:51.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.379+0000 7f1316bce700 1 -- 172.21.15.63:0/1768526209 shutdown_connections 2020-05-18T21:33:51.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.379+0000 7f1316bce700 1 -- 172.21.15.63:0/1768526209 wait complete. 2020-05-18T21:33:51.393 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:33:51.394 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:51.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.487+0000 7fb35240e700 1 Processor -- start 2020-05-18T21:33:51.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.487+0000 7fb35240e700 1 -- start start 2020-05-18T21:33:51.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.487+0000 7fb35240e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb34c146be0 0x7fb34c06a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:51.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.487+0000 7fb35240e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34c0b8160 con 0x7fb34c0b7cc0 2020-05-18T21:33:51.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.487+0000 7fb35240e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34c061c00 con 0x7fb34c145e60 2020-05-18T21:33:51.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.487+0000 7fb35240e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34c061ea0 con 0x7fb34c146be0 2020-05-18T21:33:51.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.487+0000 7fb34bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb34c146be0 0x7fb34c06a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:51.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb34b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb34c0b7cc0 0x7fb34c0b5630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35186/0 (socket says 172.21.15.63:35186) 2020-05-18T21:33:51.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb34b7fe700 1 -- 172.21.15.63:0/930793033 learned_addr learned my addr 172.21.15.63:0/930793033 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:51.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb34affd700 1 -- 172.21.15.63:0/930793033 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611779725 0 0) 0x7fb34c0b8160 con 0x7fb34c0b7cc0 2020-05-18T21:33:51.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb34affd700 1 -- 172.21.15.63:0/930793033 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb338003270 con 0x7fb34c0b7cc0 2020-05-18T21:33:51.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb34bfff700 1 -- 172.21.15.63:0/930793033 >> v1:172.21.15.155:6789/0 conn(0x7fb34c145e60 legacy=0x7fb34c149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:51.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb34bfff700 1 -- 172.21.15.63:0/930793033 >> v1:172.21.15.63:6789/0 conn(0x7fb34c0b7cc0 legacy=0x7fb34c0b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:51.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb34bfff700 1 -- 172.21.15.63:0/930793033 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c146280 con 0x7fb34c146be0 2020-05-18T21:33:51.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb34bfff700 1 --2- 172.21.15.63:0/930793033 >> v2:172.21.15.63:3300/0 conn(0x7fb34c146be0 0x7fb34c06a280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb340002f70 tx=0x7fb340007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb34bfff700 1 --2- 172.21.15.63:0/930793033 >> v2:172.21.15.63:3300/0 conn(0x7fb34c146be0 0x7fb34c06a280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb340002f70 tx=0x7fb340007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb34bfff700 1 --2- 172.21.15.63:0/930793033 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb34c146be0 0x7fb34c06a280 secure :-1 s=READY pgs=1546 cs=0 l=1 rx=0x7fb340002f70 tx=0x7fb340007a80).ready entity=mon.0 client_cookie=6f9d54a6c5cda802 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:51.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb34bfff700 1 --2- 172.21.15.63:0/930793033 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb34c146be0 0x7fb34c06a280 secure :-1 s=THROTTLE_DONE pgs=1546 cs=0 l=1 rx=0x7fb340002f70 tx=0x7fb340007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb34affd700 1 -- 172.21.15.63:0/930793033 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb340008e80 con 0x7fb34c146be0 2020-05-18T21:33:51.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb34bfff700 1 --2- 172.21.15.63:0/930793033 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb34c146be0 0x7fb34c06a280 secure :-1 s=THROTTLE_DONE pgs=1546 cs=0 l=1 rx=0x7fb340002f70 tx=0x7fb340007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb34bfff700 1 --2- 172.21.15.63:0/930793033 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb34c146be0 0x7fb34c06a280 secure :-1 s=THROTTLE_DONE pgs=1546 cs=0 l=1 rx=0x7fb340002f70 tx=0x7fb340007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb34affd700 1 -- 172.21.15.63:0/930793033 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3400115f0 con 0x7fb34c146be0 2020-05-18T21:33:51.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb34affd700 1 -- 172.21.15.63:0/930793033 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3400119d0 con 0x7fb34c146be0 2020-05-18T21:33:51.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb35240e700 1 -- 172.21.15.63:0/930793033 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb34c146be0 msgr2=0x7fb34c06a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:51.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb35240e700 1 --2- 172.21.15.63:0/930793033 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb34c146be0 0x7fb34c06a280 secure :-1 s=READY pgs=1546 cs=0 l=1 rx=0x7fb340002f70 tx=0x7fb340007a80).stop 2020-05-18T21:33:51.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb35240e700 1 -- 172.21.15.63:0/930793033 shutdown_connections 2020-05-18T21:33:51.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb35240e700 1 --2- 172.21.15.63:0/930793033 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb34c146be0 0x7fb34c06a280 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:51.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb35240e700 1 -- 172.21.15.63:0/930793033 >> 172.21.15.63:0/930793033 conn(0x7fb34c05b240 msgr2=0x7fb34c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:51.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb35240e700 1 -- 172.21.15.63:0/930793033 shutdown_connections 2020-05-18T21:33:51.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.491+0000 7fb35240e700 1 -- 172.21.15.63:0/930793033 wait complete. 2020-05-18T21:33:51.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb35240e700 1 Processor -- start 2020-05-18T21:33:51.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb35240e700 1 -- start start 2020-05-18T21:33:51.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb35240e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb34c0b7cc0 0x7fb34c0ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:51.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb35240e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb34c145e60 0x7fb34c158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:51.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb35240e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34c142eb0 con 0x7fb34c146be0 2020-05-18T21:33:51.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb35240e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34c09bc50 con 0x7fb34c145e60 2020-05-18T21:33:51.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb35240e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c09bef0 con 0x7fb34c0b7cc0 2020-05-18T21:33:51.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb34b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb34c145e60 0x7fb34c158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:51.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb34b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb34c145e60 0x7fb34c158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33006/0 (socket says 172.21.15.63:33006) 2020-05-18T21:33:51.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb34b7fe700 1 -- 172.21.15.63:0/183924577 learned_addr learned my addr 172.21.15.63:0/183924577 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:51.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb34bfff700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb34c0b7cc0 0x7fb34c0ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:51.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb3497fa700 1 -- 172.21.15.63:0/183924577 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359175912 0 0) 0x7fb34c142eb0 con 0x7fb34c146be0 2020-05-18T21:33:51.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb34b7fe700 1 -- 172.21.15.63:0/183924577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb34c0b7cc0 msgr2=0x7fb34c0ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:51.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb34b7fe700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb34c0b7cc0 0x7fb34c0ae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:51.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb34b7fe700 1 -- 172.21.15.63:0/183924577 >> v1:172.21.15.155:6789/0 conn(0x7fb34c146be0 legacy=0x7fb34c09c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:51.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb34b7fe700 1 -- 172.21.15.63:0/183924577 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c09c190 con 0x7fb34c145e60 2020-05-18T21:33:51.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb34b7fe700 1 --2- 172.21.15.63:0/183924577 >> v2:172.21.15.63:3300/0 conn(0x7fb34c145e60 0x7fb34c158190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb33c001110 tx=0x7fb33c0013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb34b7fe700 1 --2- 172.21.15.63:0/183924577 >> v2:172.21.15.63:3300/0 conn(0x7fb34c145e60 0x7fb34c158190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb33c001110 tx=0x7fb33c0013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb34b7fe700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb34c145e60 0x7fb34c158190 secure :-1 s=READY pgs=1547 cs=0 l=1 rx=0x7fb33c001110 tx=0x7fb33c0013f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:51.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb34b7fe700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb34c145e60 0x7fb34c158190 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7fb33c001110 tx=0x7fb33c0013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb34b7fe700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb34c145e60 0x7fb34c158190 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7fb33c001110 tx=0x7fb33c0013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb3497fa700 1 -- 172.21.15.63:0/183924577 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb33c00c970 con 0x7fb34c145e60 2020-05-18T21:33:51.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb34b7fe700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb34c145e60 0x7fb34c158190 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7fb33c001110 tx=0x7fb33c0013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb3497fa700 1 -- 172.21.15.63:0/183924577 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c00cad0 con 0x7fb34c145e60 2020-05-18T21:33:51.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb35240e700 1 -- 172.21.15.63:0/183924577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34c1585f0 con 0x7fb34c145e60 2020-05-18T21:33:51.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb3497fa700 1 -- 172.21.15.63:0/183924577 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb33c00d0d0 con 0x7fb34c145e60 2020-05-18T21:33:51.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.495+0000 7fb35240e700 1 -- 172.21.15.63:0/183924577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34c0b00a0 con 0x7fb34c145e60 2020-05-18T21:33:51.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.499+0000 7fb34b7fe700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb34c145e60 0x7fb34c158190 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7fb33c001110 tx=0x7fb33c0013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.499+0000 7fb35240e700 1 -- 172.21.15.63:0/183924577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34c0b0710 con 0x7fb34c145e60 2020-05-18T21:33:51.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.499+0000 7fb3497fa700 1 -- 172.21.15.63:0/183924577 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb33c005600 con 0x7fb34c145e60 2020-05-18T21:33:51.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.499+0000 7fb34b7fe700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb34c145e60 0x7fb34c158190 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7fb33c001110 tx=0x7fb33c0013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.499+0000 7fb3497fa700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb32c04f940 0x7fb32c051e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:51.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.499+0000 7fb3497fa700 1 -- 172.21.15.63:0/183924577 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb33c0100c0 con 0x7fb34c145e60 2020-05-18T21:33:51.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.499+0000 7fb34bfff700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb32c04f940 0x7fb32c051e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:51.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.499+0000 7fb34bfff700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb32c04f940 0x7fb32c051e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb340002f70 tx=0x7fb340007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.499+0000 7fb34bfff700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb32c04f940 0x7fb32c051e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb340002f70 tx=0x7fb340007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.499+0000 7fb34bfff700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb32c04f940 0x7fb32c051e00 secure :-1 s=READY pgs=603 cs=0 l=1 rx=0x7fb340002f70 tx=0x7fb340007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:51.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.507+0000 7fb34b7fe700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb34c145e60 0x7fb34c158190 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7fb33c001110 tx=0x7fb33c0013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.507+0000 7fb3497fa700 1 -- 172.21.15.63:0/183924577 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb34c0b0710 con 0x7fb34c145e60 2020-05-18T21:33:51.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.651+0000 7fb35240e700 1 -- 172.21.15.63:0/183924577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb34c0b0710 con 0x7fb34c145e60 2020-05-18T21:33:51.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.651+0000 7fb34b7fe700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb34c145e60 0x7fb34c158190 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7fb33c001110 tx=0x7fb33c0013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:51.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.651+0000 7fb3497fa700 1 -- 172.21.15.63:0/183924577 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fb34c0b0710 con 0x7fb34c145e60 2020-05-18T21:33:51.656 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:51.656 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/911406335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":911406335},{"type":"v1","addr":"172.21.15.155:6835","nonce":911406335}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:46.613321+0000","modified":"2020-05-18T21:33:47.617221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8365":{"gid":8365,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/299278803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":299278803},{"type":"v1","addr":"172.21.15.63:6833","nonce":299278803}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-05-18T21:33:51.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.655+0000 7fb35240e700 1 -- 172.21.15.63:0/183924577 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb32c04f940 msgr2=0x7fb32c051e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:51.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.655+0000 7fb35240e700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb32c04f940 0x7fb32c051e00 secure :-1 s=READY pgs=603 cs=0 l=1 rx=0x7fb340002f70 tx=0x7fb340007a80).stop 2020-05-18T21:33:51.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.655+0000 7fb35240e700 1 -- 172.21.15.63:0/183924577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb34c145e60 msgr2=0x7fb34c158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:51.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.655+0000 7fb35240e700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb34c145e60 0x7fb34c158190 secure :-1 s=READY pgs=1547 cs=0 l=1 rx=0x7fb33c001110 tx=0x7fb33c0013f0).stop 2020-05-18T21:33:51.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.655+0000 7fb35240e700 1 -- 172.21.15.63:0/183924577 shutdown_connections 2020-05-18T21:33:51.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.655+0000 7fb35240e700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb32c04f940 0x7fb32c051e00 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:51.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.655+0000 7fb35240e700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb34c145e60 0x7fb34c158190 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:51.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.655+0000 7fb35240e700 1 --2- 172.21.15.63:0/183924577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb34c0b7cc0 0x7fb34c0ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:51.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.655+0000 7fb35240e700 1 -- 172.21.15.63:0/183924577 >> 172.21.15.63:0/183924577 conn(0x7fb34c05b240 msgr2=0x7fb34c144ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:51.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.655+0000 7fb35240e700 1 -- 172.21.15.63:0/183924577 shutdown_connections 2020-05-18T21:33:51.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:51.655+0000 7fb35240e700 1 -- 172.21.15.63:0/183924577 wait complete. 2020-05-18T21:33:51.660 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 86 2020-05-18T21:33:51.871 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:33:46.613321+0000', 'modified': '2020-05-18T21:33:47.617221+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8365}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8365': {'gid': 8365, 'name': 'a', 'rank': 0, 'incarnation': 85, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/299278803', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 299278803}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 299278803}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:33:51.871 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:33:51.872 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:33:51.983 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:51.983 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:33:51.984 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:33:51.984 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 8365, 2020-05-18T21:33:51.984 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:33:51.984 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:33:51.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 5.3635815850000004, 2020-05-18T21:33:51.985 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 86, 2020-05-18T21:33:51.985 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 114, 2020-05-18T21:33:51.985 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 113, 2020-05-18T21:33:51.986 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 9.5879526649999995 2020-05-18T21:33:51.986 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:51.992 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 8365, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.3635815850000004, "mdsmap_epoch": 86, "osdmap_epoch": 114, "osdmap_epoch_barrier": 113, "uptime": 9.5879526649999995 } 2020-05-18T21:33:51.993 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:33:51.993 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:33:51.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:51.994 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:33:52.003 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:33:52.003 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:33:52.003 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:33:52.004 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:52.004 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:33:52.004 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:52.005 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:52.005 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:52.005 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:52.006 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:52.006 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:33:52.006 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:52.007 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:33:52.007 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:33:52.007 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:33:52.007 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42411sec preferred_lft 42411sec 2020-05-18T21:33:52.008 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:33:52.008 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:33:52.009 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:33:52.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:52.011 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:33:52.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:52.032 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:33:52.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:52.101 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:33:52.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:52.119 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:33:52.176 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:33:52.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:52.180 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:33:52.190 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:33:52.190 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:33:52.190 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:33:52.191 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:33:52.191 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:33:52.191 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:33:52.192 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:33:52.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:52.193 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:33:52.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:52.214 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:33:52.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:52.275 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:33:52.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:52.296 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:33:52.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:52.344 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:33:52.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:52.351 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:33:52.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:52.373 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-05-18T21:33:52.437 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-05-18T21:33:52.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:52.438 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-05-18T21:33:52.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:52.456 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:33:52.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:52.517 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-05-18T21:33:52.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:52.535 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-05-18T21:33:52.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:52.598 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-05-18T21:33:52.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:52.614 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 up' 2020-05-18T21:33:52.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:33:52.633 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.0 master ceph-brx' 2020-05-18T21:33:52.654 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-05-18T21:33:52.655 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-05-18T21:33:52.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:52.656 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:33:52.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:52.704 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:33:52.721 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:33:52.722 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:33:52.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:52.724 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:33:52.729 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:33:52.729 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:33:52.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:52.775 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:33:52.793 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:33:52.794 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:33:52.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:52.795 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:33:52.855 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2020-05-18T21:33:52.851+0000 7f72c0006080 -1 init, newargv = 0x556a7fb78530 newargc=9 2020-05-18T21:33:52.855 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[32256]: starting ceph client 2020-05-18T21:33:52.866 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[32256]: starting fuse 2020-05-18T21:33:53.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:53.903 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:33:53.921 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:33:53.922 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:33:53.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:53.924 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:33:53.930 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:33:53.930 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:33:53.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:53.931 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:33:53.932 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:33:53.932 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:33:53.932 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:33:53.933 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:33:53.933 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:53.934 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:33:53.935 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:33:53.935 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:33:53.936 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:53.937 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:33:53.937 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:33:53.938 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:33:53.939 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:33:53.940 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:53.941 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:33:53.941 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:33:53.942 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:33:53.943 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:33:53.943 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:33:53.945 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:53.947 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:33:53.947 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:33:53.995 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.32256.asok 2020-05-18T21:33:54.000 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.32256.asok 2020-05-18T21:33:54.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:54.001 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.32256.asok status 2020-05-18T21:33:54.090 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:54.090 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:33:54.090 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:33:54.091 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:33:54.091 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:33:54.091 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:33:54.091 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:33:54.091 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "32256", 2020-05-18T21:33:54.092 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:33:54.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:54.092 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:33:54.092 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:33:54.092 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 8542, 2020-05-18T21:33:54.092 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:33:54.093 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:33:54.093 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:33:54.093 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 8542 2020-05-18T21:33:54.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:54.093 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:33:54.094 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:54.094 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:33:54.094 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1381514735 2020-05-18T21:33:54.094 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:54.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:54.095 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:33:54.095 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:54.095 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:33:54.095 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1381514735 2020-05-18T21:33:54.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:54.096 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.8542 192.168.0.1:0/1381514735", 2020-05-18T21:33:54.096 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/1381514735", 2020-05-18T21:33:54.096 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:33:54.096 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 86, 2020-05-18T21:33:54.096 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 114, 2020-05-18T21:33:54.096 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:33:54.097 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:33:54.097 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:54.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:54.099 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:33:54.100 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:33:54.110 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:33:54.111 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-05-18T21:33:54.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:54.112 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:33:54.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:54.172 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:33:54.172 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:33:54.173 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:33:54.173 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:33:54.174 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:33:54.174 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:54.175 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:33:54.175 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:33:54.175 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:33:54.176 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:54.176 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:33:54.177 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:33:54.177 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:33:54.177 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:33:54.178 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:54.178 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:33:54.178 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:33:54.179 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:33:54.179 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:33:54.180 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:33:54.180 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:54.180 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:33:54.181 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:33:54.223 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.32256.asok 2020-05-18T21:33:54.228 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.32256.asok 2020-05-18T21:33:54.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:33:54.229 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.32256.asok mds_sessions 2020-05-18T21:33:54.322 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:54.322 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 8542, 2020-05-18T21:33:54.323 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:33:54.323 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:33:54.324 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:33:54.324 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 8542 2020-05-18T21:33:54.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:54.325 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:33:54.325 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:54.325 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:33:54.325 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1381514735 2020-05-18T21:33:54.326 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:54.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:54.326 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.8542 v1:192.168.0.1:0/1381514735", 2020-05-18T21:33:54.326 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "v1:192.168.0.1:0/1381514735", 2020-05-18T21:33:54.327 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions": [ 2020-05-18T21:33:54.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:54.327 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": 0, 2020-05-18T21:33:54.327 INFO:teuthology.orchestra.run.smithi063.stdout: "addrs": { 2020-05-18T21:33:54.327 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:33:54.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:54.328 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:33:54.328 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6832", 2020-05-18T21:33:54.328 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 299278803 2020-05-18T21:33:54.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:54.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:54.329 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:33:54.329 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6833", 2020-05-18T21:33:54.329 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 299278803 2020-05-18T21:33:54.329 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:54.329 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:33:54.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:54.330 INFO:teuthology.orchestra.run.smithi063.stdout: "seq": 0, 2020-05-18T21:33:54.330 INFO:teuthology.orchestra.run.smithi063.stdout: "cap_gen": 0, 2020-05-18T21:33:54.330 INFO:teuthology.orchestra.run.smithi063.stdout: "cap_ttl": "2020-05-18T21:34:53.858112+0000", 2020-05-18T21:33:54.330 INFO:teuthology.orchestra.run.smithi063.stdout: "last_cap_renew_request": "2020-05-18T21:33:53.858112+0000", 2020-05-18T21:33:54.330 INFO:teuthology.orchestra.run.smithi063.stdout: "cap_renew_seq": 2, 2020-05-18T21:33:54.331 INFO:teuthology.orchestra.run.smithi063.stdout: "num_caps": 1, 2020-05-18T21:33:54.331 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "open" 2020-05-18T21:33:54.331 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:54.331 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:33:54.331 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 86 2020-05-18T21:33:54.332 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:54.333 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:33:54.333 INFO:teuthology.orchestra.run.smithi063:> import time 2020-05-18T21:33:54.334 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:54.334 INFO:teuthology.orchestra.run.smithi063:> with open("/home/ubuntu/cephtest/mnt.0/open_file", '"'"'w'"'"') as f: 2020-05-18T21:33:54.335 INFO:teuthology.orchestra.run.smithi063:> f.write('"'"'content'"'"') 2020-05-18T21:33:54.335 INFO:teuthology.orchestra.run.smithi063:> f.flush() 2020-05-18T21:33:54.335 INFO:teuthology.orchestra.run.smithi063:> f.write('"'"'content2'"'"') 2020-05-18T21:33:54.336 INFO:teuthology.orchestra.run.smithi063:> while True: 2020-05-18T21:33:54.337 INFO:teuthology.orchestra.run.smithi063:> time.sleep(1) 2020-05-18T21:33:54.337 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:33:54.339 INFO:teuthology.orchestra.run.smithi063:> sudo ls /home/ubuntu/cephtest/mnt.0/open_file 2020-05-18T21:33:54.353 INFO:teuthology.orchestra.run.smithi063.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/open_file': No such file or directory 2020-05-18T21:33:54.355 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-05-18T21:33:55.356 INFO:teuthology.orchestra.run.smithi063:> sudo ls /home/ubuntu/cephtest/mnt.0/open_file 2020-05-18T21:33:55.372 INFO:teuthology.orchestra.run.smithi063.stdout:/home/ubuntu/cephtest/mnt.0/open_file 2020-05-18T21:33:55.374 DEBUG:tasks.cephfs.mount:File open_file became visible from 0 after 1s 2020-05-18T21:33:55.375 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo dd if=/dev/urandom of=open_file bs=1M conv=fdatasync count=8 seek=0) 2020-05-18T21:33:55.544 INFO:teuthology.orchestra.run.smithi063.stderr:8+0 records in 2020-05-18T21:33:55.544 INFO:teuthology.orchestra.run.smithi063.stderr:8+0 records out 2020-05-18T21:33:55.545 INFO:teuthology.orchestra.run.smithi063.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.101573 s, 82.6 MB/s 2020-05-18T21:33:55.546 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:33:55.547 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:33:55.547 INFO:teuthology.orchestra.run.smithi063:> import stat 2020-05-18T21:33:55.547 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:33:55.548 INFO:teuthology.orchestra.run.smithi063:> print(os.stat("/home/ubuntu/cephtest/mnt.0/open_file").st_ino) 2020-05-18T21:33:55.549 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:33:55.626 INFO:teuthology.orchestra.run.smithi063.stdout:1099511627776 2020-05-18T21:33:55.816 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:55.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.923+0000 7faddd943700 1 Processor -- start 2020-05-18T21:33:55.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.923+0000 7faddd943700 1 -- start start 2020-05-18T21:33:55.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.923+0000 7faddd943700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fadd80b4760 0x7fadd80648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:55.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.923+0000 7faddd943700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd814a330 con 0x7fadd805f110 2020-05-18T21:33:55.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.923+0000 7faddd943700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd814a5d0 con 0x7fadd8064d20 2020-05-18T21:33:55.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.923+0000 7faddd943700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd814a140 con 0x7fadd80b4760 2020-05-18T21:33:55.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.923+0000 7faddc941700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fadd805f110 0x7fadd814aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35220/0 (socket says 172.21.15.63:35220) 2020-05-18T21:33:55.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7faddc941700 1 -- 172.21.15.63:0/732568459 learned_addr learned my addr 172.21.15.63:0/732568459 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:55.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7fadd7fff700 1 --2- 172.21.15.63:0/732568459 >> v2:172.21.15.155:3300/0 conn(0x7fadd80b4760 0x7fadd80648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:55.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7fadd77fe700 1 -- 172.21.15.63:0/732568459 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822067479 0 0) 0x7fadd814a330 con 0x7fadd805f110 2020-05-18T21:33:55.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7fadd77fe700 1 -- 172.21.15.63:0/732568459 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadc4003270 con 0x7fadd805f110 2020-05-18T21:33:55.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7fadd7fff700 1 -- 172.21.15.63:0/732568459 >> v1:172.21.15.155:6789/0 conn(0x7fadd8064d20 legacy=0x7fadd814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:55.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7fadd7fff700 1 -- 172.21.15.63:0/732568459 >> v1:172.21.15.63:6789/0 conn(0x7fadd805f110 legacy=0x7fadd814aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:55.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7fadd7fff700 1 -- 172.21.15.63:0/732568459 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd8063430 con 0x7fadd80b4760 2020-05-18T21:33:55.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7fadd7fff700 1 --2- 172.21.15.63:0/732568459 >> v2:172.21.15.155:3300/0 conn(0x7fadd80b4760 0x7fadd80648c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fadc8002f70 tx=0x7fadc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:55.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7fadd7fff700 1 --2- 172.21.15.63:0/732568459 >> v2:172.21.15.155:3300/0 conn(0x7fadd80b4760 0x7fadd80648c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fadc8002f70 tx=0x7fadc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:55.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7fadd7fff700 1 --2- 172.21.15.63:0/732568459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadd80b4760 0x7fadd80648c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rx=0x7fadc8002f70 tx=0x7fadc8007a80).ready entity=mon.1 client_cookie=3285a4837dd18fa2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:55.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7fadd7fff700 1 --2- 172.21.15.63:0/732568459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadd80b4760 0x7fadd80648c0 secure :-1 s=THROTTLE_DONE pgs=1038 cs=0 l=1 rx=0x7fadc8002f70 tx=0x7fadc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:55.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7fadd77fe700 1 -- 172.21.15.63:0/732568459 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadc8008e80 con 0x7fadd80b4760 2020-05-18T21:33:55.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7fadd7fff700 1 --2- 172.21.15.63:0/732568459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadd80b4760 0x7fadd80648c0 secure :-1 s=THROTTLE_DONE pgs=1038 cs=0 l=1 rx=0x7fadc8002f70 tx=0x7fadc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:55.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7fadd7fff700 1 --2- 172.21.15.63:0/732568459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadd80b4760 0x7fadd80648c0 secure :-1 s=THROTTLE_DONE pgs=1038 cs=0 l=1 rx=0x7fadc8002f70 tx=0x7fadc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:55.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7fadd77fe700 1 -- 172.21.15.63:0/732568459 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc80115f0 con 0x7fadd80b4760 2020-05-18T21:33:55.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7fadd77fe700 1 -- 172.21.15.63:0/732568459 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadc8011990 con 0x7fadd80b4760 2020-05-18T21:33:55.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7faddd943700 1 -- 172.21.15.63:0/732568459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadd80b4760 msgr2=0x7fadd80648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:55.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7faddd943700 1 --2- 172.21.15.63:0/732568459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadd80b4760 0x7fadd80648c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rx=0x7fadc8002f70 tx=0x7fadc8007a80).stop 2020-05-18T21:33:55.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7faddd943700 1 -- 172.21.15.63:0/732568459 shutdown_connections 2020-05-18T21:33:55.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7faddd943700 1 --2- 172.21.15.63:0/732568459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadd80b4760 0x7fadd80648c0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:55.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7faddd943700 1 -- 172.21.15.63:0/732568459 >> 172.21.15.63:0/732568459 conn(0x7fadd8069fc0 msgr2=0x7fadd806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:55.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7faddd943700 1 -- 172.21.15.63:0/732568459 shutdown_connections 2020-05-18T21:33:55.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7faddd943700 1 -- 172.21.15.63:0/732568459 wait complete. 2020-05-18T21:33:55.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7faddd943700 1 Processor -- start 2020-05-18T21:33:55.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.927+0000 7faddd943700 1 -- start start 2020-05-18T21:33:55.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddd943700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fadd805f110 0x7fadd80b6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:55.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddd943700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fadd8064d20 0x7fadd8147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:55.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddd943700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd80b6b90 con 0x7fadd80b4760 2020-05-18T21:33:55.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddd943700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd8133080 con 0x7fadd805f110 2020-05-18T21:33:55.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddd943700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd8133320 con 0x7fadd8064d20 2020-05-18T21:33:55.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddc941700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fadd805f110 0x7fadd80b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:55.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7fadd7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fadd8064d20 0x7fadd8147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:55.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddc941700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fadd805f110 0x7fadd80b6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33040/0 (socket says 172.21.15.63:33040) 2020-05-18T21:33:55.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddc941700 1 -- 172.21.15.63:0/388598859 learned_addr learned my addr 172.21.15.63:0/388598859 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:55.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddc941700 1 -- 172.21.15.63:0/388598859 >> v2:172.21.15.155:3300/0 conn(0x7fadd8064d20 msgr2=0x7fadd8147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:55.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddc941700 1 --2- 172.21.15.63:0/388598859 >> v2:172.21.15.155:3300/0 conn(0x7fadd8064d20 0x7fadd8147180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:55.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddc941700 1 -- 172.21.15.63:0/388598859 >> v1:172.21.15.155:6789/0 conn(0x7fadd80b4760 legacy=0x7fadd8132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:55.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddc941700 1 -- 172.21.15.63:0/388598859 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd81335c0 con 0x7fadd805f110 2020-05-18T21:33:55.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddc941700 1 --2- 172.21.15.63:0/388598859 >> v2:172.21.15.63:3300/0 conn(0x7fadd805f110 0x7fadd80b6730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fadcc001110 tx=0x7fadcc010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:55.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddc941700 1 --2- 172.21.15.63:0/388598859 >> v2:172.21.15.63:3300/0 conn(0x7fadd805f110 0x7fadd80b6730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fadcc001110 tx=0x7fadcc010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:55.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddc941700 1 --2- 172.21.15.63:0/388598859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadd805f110 0x7fadd80b6730 secure :-1 s=READY pgs=1551 cs=0 l=1 rx=0x7fadcc001110 tx=0x7fadcc010950).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:55.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddc941700 1 --2- 172.21.15.63:0/388598859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadd805f110 0x7fadd80b6730 secure :-1 s=THROTTLE_DONE pgs=1551 cs=0 l=1 rx=0x7fadcc001110 tx=0x7fadcc010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:55.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7fadd5ffb700 1 -- 172.21.15.63:0/388598859 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadcc005d00 con 0x7fadd805f110 2020-05-18T21:33:55.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddc941700 1 --2- 172.21.15.63:0/388598859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadd805f110 0x7fadd80b6730 secure :-1 s=THROTTLE_DONE pgs=1551 cs=0 l=1 rx=0x7fadcc001110 tx=0x7fadcc010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:55.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7fadd5ffb700 1 -- 172.21.15.63:0/388598859 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc005e60 con 0x7fadd805f110 2020-05-18T21:33:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddc941700 1 --2- 172.21.15.63:0/388598859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadd805f110 0x7fadd80b6730 secure :-1 s=THROTTLE_DONE pgs=1551 cs=0 l=1 rx=0x7fadcc001110 tx=0x7fadcc010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddd943700 1 -- 172.21.15.63:0/388598859 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd81452c0 con 0x7fadd805f110 2020-05-18T21:33:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7fadd5ffb700 1 -- 172.21.15.63:0/388598859 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadcc0062c0 con 0x7fadd805f110 2020-05-18T21:33:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddd943700 1 -- 172.21.15.63:0/388598859 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd8132c10 con 0x7fadd805f110 2020-05-18T21:33:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.931+0000 7faddc941700 1 --2- 172.21.15.63:0/388598859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadd805f110 0x7fadd80b6730 secure :-1 s=THROTTLE_DONE pgs=1551 cs=0 l=1 rx=0x7fadcc001110 tx=0x7fadcc010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:55.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.935+0000 7faddd943700 1 -- 172.21.15.63:0/388598859 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd80569e0 con 0x7fadd805f110 2020-05-18T21:33:55.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.935+0000 7fadd5ffb700 1 -- 172.21.15.63:0/388598859 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fadcc006540 con 0x7fadd805f110 2020-05-18T21:33:55.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.935+0000 7faddc941700 1 --2- 172.21.15.63:0/388598859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadd805f110 0x7fadd80b6730 secure :-1 s=THROTTLE_DONE pgs=1551 cs=0 l=1 rx=0x7fadcc001110 tx=0x7fadcc010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:55.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.935+0000 7fadd5ffb700 1 --2- 172.21.15.63:0/388598859 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fadb804f9e0 0x7fadb8051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:55.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.935+0000 7fadd5ffb700 1 -- 172.21.15.63:0/388598859 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fadcc0090c0 con 0x7fadd805f110 2020-05-18T21:33:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.935+0000 7fadd7fff700 1 --2- 172.21.15.63:0/388598859 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fadb804f9e0 0x7fadb8051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.935+0000 7fadd7fff700 1 --2- 172.21.15.63:0/388598859 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fadb804f9e0 0x7fadb8051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fadc8002f70 tx=0x7fadc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.935+0000 7fadd7fff700 1 --2- 172.21.15.63:0/388598859 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fadb804f9e0 0x7fadb8051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fadc8002f70 tx=0x7fadc8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.935+0000 7fadd7fff700 1 --2- 172.21.15.63:0/388598859 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fadb804f9e0 0x7fadb8051ea0 secure :-1 s=READY pgs=604 cs=0 l=1 rx=0x7fadc8002f70 tx=0x7fadc8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:55.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.939+0000 7faddc941700 1 --2- 172.21.15.63:0/388598859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadd805f110 0x7fadd80b6730 secure :-1 s=THROTTLE_DONE pgs=1551 cs=0 l=1 rx=0x7fadcc001110 tx=0x7fadcc010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:55.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:55.939+0000 7fadd5ffb700 1 -- 172.21.15.63:0/388598859 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fadcc03e080 con 0x7fadd805f110 2020-05-18T21:33:56.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.087+0000 7faddd943700 1 -- 172.21.15.63:0/388598859 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadd8063cb0 con 0x7fadd805f110 2020-05-18T21:33:56.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.091+0000 7faddc941700 1 --2- 172.21.15.63:0/388598859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadd805f110 0x7fadd80b6730 secure :-1 s=THROTTLE_DONE pgs=1551 cs=0 l=1 rx=0x7fadcc001110 tx=0x7fadcc010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.091+0000 7fadd5ffb700 1 -- 172.21.15.63:0/388598859 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fadcc0416a0 con 0x7fadd805f110 2020-05-18T21:33:56.094 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:56.094 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/911406335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":911406335},{"type":"v1","addr":"172.21.15.155:6835","nonce":911406335}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:46.613321+0000","modified":"2020-05-18T21:33:47.617221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8365":{"gid":8365,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/299278803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":299278803},{"type":"v1","addr":"172.21.15.63:6833","nonce":299278803}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-05-18T21:33:56.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.091+0000 7faddd943700 1 -- 172.21.15.63:0/388598859 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fadb804f9e0 msgr2=0x7fadb8051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:56.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.091+0000 7faddd943700 1 --2- 172.21.15.63:0/388598859 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fadb804f9e0 0x7fadb8051ea0 secure :-1 s=READY pgs=604 cs=0 l=1 rx=0x7fadc8002f70 tx=0x7fadc8007a80).stop 2020-05-18T21:33:56.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.091+0000 7faddd943700 1 -- 172.21.15.63:0/388598859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadd805f110 msgr2=0x7fadd80b6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:56.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.091+0000 7faddd943700 1 --2- 172.21.15.63:0/388598859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadd805f110 0x7fadd80b6730 secure :-1 s=READY pgs=1551 cs=0 l=1 rx=0x7fadcc001110 tx=0x7fadcc010950).stop 2020-05-18T21:33:56.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.091+0000 7faddd943700 1 -- 172.21.15.63:0/388598859 shutdown_connections 2020-05-18T21:33:56.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.091+0000 7faddd943700 1 --2- 172.21.15.63:0/388598859 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fadb804f9e0 0x7fadb8051ea0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:56.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.091+0000 7faddd943700 1 --2- 172.21.15.63:0/388598859 >> v2:172.21.15.155:3300/0 conn(0x7fadd8064d20 0x7fadd8147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:56.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.091+0000 7faddd943700 1 --2- 172.21.15.63:0/388598859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadd805f110 0x7fadd80b6730 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:56.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.091+0000 7faddd943700 1 -- 172.21.15.63:0/388598859 >> 172.21.15.63:0/388598859 conn(0x7fadd8069fc0 msgr2=0x7fadd80651d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:56.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.091+0000 7faddd943700 1 -- 172.21.15.63:0/388598859 shutdown_connections 2020-05-18T21:33:56.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.091+0000 7faddd943700 1 -- 172.21.15.63:0/388598859 wait complete. 2020-05-18T21:33:56.099 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 86 2020-05-18T21:33:56.106 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok session ls 2020-05-18T21:33:56.200 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:33:56.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:56.201 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 8542, 2020-05-18T21:33:56.201 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": { 2020-05-18T21:33:56.201 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:33:56.202 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:33:56.202 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 8542 2020-05-18T21:33:56.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:56.203 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:33:56.203 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "any", 2020-05-18T21:33:56.203 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:33:56.204 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1381514735 2020-05-18T21:33:56.204 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:56.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:56.204 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "open", 2020-05-18T21:33:56.204 INFO:teuthology.orchestra.run.smithi063.stdout: "num_leases": 1, 2020-05-18T21:33:56.205 INFO:teuthology.orchestra.run.smithi063.stdout: "num_caps": 2, 2020-05-18T21:33:56.205 INFO:teuthology.orchestra.run.smithi063.stdout: "request_load_avg": 8, 2020-05-18T21:33:56.205 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 3.3398921389999998, 2020-05-18T21:33:56.205 INFO:teuthology.orchestra.run.smithi063.stdout: "requests_in_flight": 0, 2020-05-18T21:33:56.206 INFO:teuthology.orchestra.run.smithi063.stdout: "completed_requests": 1, 2020-05-18T21:33:56.206 INFO:teuthology.orchestra.run.smithi063.stdout: "reconnecting": false, 2020-05-18T21:33:56.206 INFO:teuthology.orchestra.run.smithi063.stdout: "recall_caps": { 2020-05-18T21:33:56.206 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0, 2020-05-18T21:33:56.207 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 60 2020-05-18T21:33:56.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:56.207 INFO:teuthology.orchestra.run.smithi063.stdout: "release_caps": { 2020-05-18T21:33:56.207 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0, 2020-05-18T21:33:56.207 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 60 2020-05-18T21:33:56.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:56.208 INFO:teuthology.orchestra.run.smithi063.stdout: "recall_caps_throttle": { 2020-05-18T21:33:56.208 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0, 2020-05-18T21:33:56.208 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 2.5 2020-05-18T21:33:56.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:56.208 INFO:teuthology.orchestra.run.smithi063.stdout: "recall_caps_throttle2o": { 2020-05-18T21:33:56.209 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0, 2020-05-18T21:33:56.209 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 0.5 2020-05-18T21:33:56.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:56.209 INFO:teuthology.orchestra.run.smithi063.stdout: "session_cache_liveness": { 2020-05-18T21:33:56.209 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 3.9799821431877485, 2020-05-18T21:33:56.210 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 300 2020-05-18T21:33:56.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:56.210 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": "client.8542 192.168.0.1:0/1381514735", 2020-05-18T21:33:56.210 INFO:teuthology.orchestra.run.smithi063.stdout: "completed_requests": [ 2020-05-18T21:33:56.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:56.210 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 9, 2020-05-18T21:33:56.211 INFO:teuthology.orchestra.run.smithi063.stdout: "created_ino": "0x0" 2020-05-18T21:33:56.211 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:56.211 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:33:56.211 INFO:teuthology.orchestra.run.smithi063.stdout: "prealloc_inos": [ 2020-05-18T21:33:56.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:56.212 INFO:teuthology.orchestra.run.smithi063.stdout: "start": "0x10000000001", 2020-05-18T21:33:56.212 INFO:teuthology.orchestra.run.smithi063.stdout: "length": 1000 2020-05-18T21:33:56.212 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:56.212 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:33:56.212 INFO:teuthology.orchestra.run.smithi063.stdout: "used_inos": [], 2020-05-18T21:33:56.212 INFO:teuthology.orchestra.run.smithi063.stdout: "client_metadata": { 2020-05-18T21:33:56.213 INFO:teuthology.orchestra.run.smithi063.stdout: "client_features": { 2020-05-18T21:33:56.213 INFO:teuthology.orchestra.run.smithi063.stdout: "feature_bits": "0x0000000000003fff" 2020-05-18T21:33:56.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:56.213 INFO:teuthology.orchestra.run.smithi063.stdout: "metric_spec": { 2020-05-18T21:33:56.213 INFO:teuthology.orchestra.run.smithi063.stdout: "metric_flags": { 2020-05-18T21:33:56.214 INFO:teuthology.orchestra.run.smithi063.stdout: "feature_bits": "0x" 2020-05-18T21:33:56.214 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:56.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:56.214 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:33:56.215 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:33:56.215 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:33:56.215 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:33:56.215 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:33:56.215 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "32256", 2020-05-18T21:33:56.216 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:33:56.217 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:56.217 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:56.217 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:33:56.218 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 8542, "entity": { "name": { "type": "client", "num": 8542 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 1381514735 } }, "state": "open", "num_leases": 1, "num_caps": 2, "request_load_avg": 8, "uptime": 3.3398921389999998, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 3.9799821431877485, "halflife": 300 }, "inst": "client.8542 192.168.0.1:0/1381514735", "completed_requests": [ { "tid": 9, "created_ino": "0x0" } ], "prealloc_inos": [ { "start": "0x10000000001", "length": 1000 } ], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", "entity_id": "0", "hostname": "smithi063", "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "32256", "root": "/" } } ] 2020-05-18T21:33:56.219 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rm -f open_file) 2020-05-18T21:33:56.239 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:56.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14e09b1700 1 Processor -- start 2020-05-18T21:33:56.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14e09b1700 1 -- start start 2020-05-18T21:33:56.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14e09b1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc05f110 0x7f14dc0b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:56.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14e09b1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f14dc14aa70 0x7f14dc0648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:56.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14e09b1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f14dc064d20 0x7f14dc14d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:56.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14e09b1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14dc14a140 con 0x7f14dc064d20 2020-05-18T21:33:56.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14e09b1700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14dc14a330 con 0x7f14dc14aa70 2020-05-18T21:33:56.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14e09b1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc14a5d0 con 0x7f14dc05f110 2020-05-18T21:33:56.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14dbfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f14dc064d20 0x7f14dc14d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:56.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14dbfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f14dc064d20 0x7f14dc14d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33050/0 (socket says 172.21.15.63:33050) 2020-05-18T21:33:56.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14daffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f14dc14aa70 0x7f14dc0648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:56.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14dbfff700 1 -- 172.21.15.63:0/1669037445 learned_addr learned my addr 172.21.15.63:0/1669037445 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:56.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14db7fe700 1 --2- 172.21.15.63:0/1669037445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc05f110 0x7f14dc0b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:56.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14dbfff700 1 -- 172.21.15.63:0/1669037445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc05f110 msgr2=0x7f14dc0b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:56.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14dbfff700 1 --2- 172.21.15.63:0/1669037445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc05f110 0x7f14dc0b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:56.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14dbfff700 1 -- 172.21.15.63:0/1669037445 >> v2:172.21.15.155:3300/0 conn(0x7f14dc14aa70 msgr2=0x7f14dc0648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:56.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14dbfff700 1 --2- 172.21.15.63:0/1669037445 >> v2:172.21.15.155:3300/0 conn(0x7f14dc14aa70 0x7f14dc0648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:56.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14dbfff700 1 -- 172.21.15.63:0/1669037445 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc063430 con 0x7f14dc064d20 2020-05-18T21:33:56.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14daffd700 1 --2- 172.21.15.63:0/1669037445 >> v2:172.21.15.155:3300/0 conn(0x7f14dc14aa70 0x7f14dc0648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:56.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14dbfff700 1 --2- 172.21.15.63:0/1669037445 >> v2:172.21.15.63:3300/0 conn(0x7f14dc064d20 0x7f14dc14d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f14dc063c70 tx=0x7f14d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14dbfff700 1 --2- 172.21.15.63:0/1669037445 >> v2:172.21.15.63:3300/0 conn(0x7f14dc064d20 0x7f14dc14d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f14dc063c70 tx=0x7f14d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14dbfff700 1 --2- 172.21.15.63:0/1669037445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14dc064d20 0x7f14dc14d710 secure :-1 s=READY pgs=1552 cs=0 l=1 rx=0x7f14dc063c70 tx=0x7f14d4007e00).ready entity=mon.0 client_cookie=d80e63d551428a53 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:56.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14dbfff700 1 --2- 172.21.15.63:0/1669037445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14dc064d20 0x7f14dc14d710 secure :-1 s=THROTTLE_DONE pgs=1552 cs=0 l=1 rx=0x7f14dc063c70 tx=0x7f14d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14dbfff700 1 --2- 172.21.15.63:0/1669037445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14dc064d20 0x7f14dc14d710 secure :-1 s=THROTTLE_DONE pgs=1552 cs=0 l=1 rx=0x7f14dc063c70 tx=0x7f14d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14da7fc700 1 -- 172.21.15.63:0/1669037445 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14d4011c20 con 0x7f14dc064d20 2020-05-18T21:33:56.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14dbfff700 1 --2- 172.21.15.63:0/1669037445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14dc064d20 0x7f14dc14d710 secure :-1 s=THROTTLE_DONE pgs=1552 cs=0 l=1 rx=0x7f14dc063c70 tx=0x7f14d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.343+0000 7f14da7fc700 1 -- 172.21.15.63:0/1669037445 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d4011d80 con 0x7f14dc064d20 2020-05-18T21:33:56.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.347+0000 7f14da7fc700 1 -- 172.21.15.63:0/1669037445 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14d400a370 con 0x7f14dc064d20 2020-05-18T21:33:56.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.347+0000 7f14e09b1700 1 -- 172.21.15.63:0/1669037445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14dc064d20 msgr2=0x7f14dc14d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:56.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.347+0000 7f14e09b1700 1 --2- 172.21.15.63:0/1669037445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14dc064d20 0x7f14dc14d710 secure :-1 s=READY pgs=1552 cs=0 l=1 rx=0x7f14dc063c70 tx=0x7f14d4007e00).stop 2020-05-18T21:33:56.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.347+0000 7f14e09b1700 1 -- 172.21.15.63:0/1669037445 shutdown_connections 2020-05-18T21:33:56.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.347+0000 7f14e09b1700 1 --2- 172.21.15.63:0/1669037445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14dc064d20 0x7f14dc14d710 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:56.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.347+0000 7f14e09b1700 1 --2- 172.21.15.63:0/1669037445 >> v2:172.21.15.155:3300/0 conn(0x7f14dc14aa70 0x7f14dc0648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:56.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.347+0000 7f14e09b1700 1 --2- 172.21.15.63:0/1669037445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc05f110 0x7f14dc0b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:56.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.347+0000 7f14e09b1700 1 -- 172.21.15.63:0/1669037445 >> 172.21.15.63:0/1669037445 conn(0x7f14dc069fc0 msgr2=0x7f14dc06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:56.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.347+0000 7f14e09b1700 1 -- 172.21.15.63:0/1669037445 shutdown_connections 2020-05-18T21:33:56.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.347+0000 7f14e09b1700 1 -- 172.21.15.63:0/1669037445 wait complete. 2020-05-18T21:33:56.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.347+0000 7f14e09b1700 1 Processor -- start 2020-05-18T21:33:56.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.347+0000 7f14e09b1700 1 -- start start 2020-05-18T21:33:56.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14e09b1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc14aa70 0x7f14dc145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:56.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14e09b1700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14dc142c60 con 0x7f14dc064d20 2020-05-18T21:33:56.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14daffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f14dc064d20 0x7f14dc147f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35242/0 (socket says 172.21.15.63:35242) 2020-05-18T21:33:56.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14daffd700 1 -- 172.21.15.63:0/1384226848 learned_addr learned my addr 172.21.15.63:0/1384226848 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:56.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14e09b1700 1 -- 172.21.15.63:0/1384226848 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14dc142e90 con 0x7f14dc05f110 2020-05-18T21:33:56.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14e09b1700 1 -- 172.21.15.63:0/1384226848 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc143130 con 0x7f14dc14aa70 2020-05-18T21:33:56.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14dbfff700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc14aa70 0x7f14dc145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:56.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14d8ff9700 1 -- 172.21.15.63:0/1384226848 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796687026 0 0) 0x7f14dc142c60 con 0x7f14dc064d20 2020-05-18T21:33:56.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14d8ff9700 1 -- 172.21.15.63:0/1384226848 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14c0002fe0 con 0x7f14dc064d20 2020-05-18T21:33:56.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14d8ff9700 1 -- 172.21.15.63:0/1384226848 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374406335 0 0) 0x7f14dc142e90 con 0x7f14dc05f110 2020-05-18T21:33:56.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14d8ff9700 1 -- 172.21.15.63:0/1384226848 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14dc142c60 con 0x7f14dc05f110 2020-05-18T21:33:56.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14d8ff9700 1 -- 172.21.15.63:0/1384226848 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 321882966 0 0) 0x7f14c0002fe0 con 0x7f14dc064d20 2020-05-18T21:33:56.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14dbfff700 1 -- 172.21.15.63:0/1384226848 >> v1:172.21.15.155:6789/0 conn(0x7f14dc05f110 legacy=0x7f14dc140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:56.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14dbfff700 1 -- 172.21.15.63:0/1384226848 >> v1:172.21.15.63:6789/0 conn(0x7f14dc064d20 legacy=0x7f14dc147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:56.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14dbfff700 1 -- 172.21.15.63:0/1384226848 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc142710 con 0x7f14dc14aa70 2020-05-18T21:33:56.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14dbfff700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc14aa70 0x7f14dc145a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f14c4002660 tx=0x7f14d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14dbfff700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc14aa70 0x7f14dc145a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f14c4002660 tx=0x7f14d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14dbfff700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc14aa70 0x7f14dc145a50 secure :-1 s=READY pgs=238 cs=0 l=1 rx=0x7f14c4002660 tx=0x7f14d4007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:56.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14dbfff700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc14aa70 0x7f14dc145a50 secure :-1 s=THROTTLE_DONE pgs=238 cs=0 l=1 rx=0x7f14c4002660 tx=0x7f14d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14d8ff9700 1 -- 172.21.15.63:0/1384226848 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14c4002500 con 0x7f14dc14aa70 2020-05-18T21:33:56.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14dbfff700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc14aa70 0x7f14dc145a50 secure :-1 s=THROTTLE_DONE pgs=238 cs=0 l=1 rx=0x7f14c4002660 tx=0x7f14d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14dbfff700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc14aa70 0x7f14dc145a50 secure :-1 s=THROTTLE_DONE pgs=238 cs=0 l=1 rx=0x7f14c4002660 tx=0x7f14d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14d8ff9700 1 -- 172.21.15.63:0/1384226848 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d4011e90 con 0x7f14dc14aa70 2020-05-18T21:33:56.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14e09b1700 1 -- 172.21.15.63:0/1384226848 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14dc13f7f0 con 0x7f14dc14aa70 2020-05-18T21:33:56.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14d8ff9700 1 -- 172.21.15.63:0/1384226848 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14d400a410 con 0x7f14dc14aa70 2020-05-18T21:33:56.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.351+0000 7f14e09b1700 1 -- 172.21.15.63:0/1384226848 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14dc148830 con 0x7f14dc14aa70 2020-05-18T21:33:56.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.355+0000 7f14e09b1700 1 -- 172.21.15.63:0/1384226848 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14dc0569e0 con 0x7f14dc14aa70 2020-05-18T21:33:56.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.355+0000 7f14dbfff700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc14aa70 0x7f14dc145a50 secure :-1 s=THROTTLE_DONE pgs=238 cs=0 l=1 rx=0x7f14c4002660 tx=0x7f14d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.355+0000 7f14d8ff9700 1 -- 172.21.15.63:0/1384226848 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f14d4005a80 con 0x7f14dc14aa70 2020-05-18T21:33:56.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.355+0000 7f14dbfff700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc14aa70 0x7f14dc145a50 secure :-1 s=THROTTLE_DONE pgs=238 cs=0 l=1 rx=0x7f14c4002660 tx=0x7f14d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.355+0000 7f14d8ff9700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14c004feb0 0x7f14c0052370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:56.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.355+0000 7f14d8ff9700 1 -- 172.21.15.63:0/1384226848 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f14d4063ee0 con 0x7f14dc14aa70 2020-05-18T21:33:56.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.355+0000 7f14db7fe700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14c004feb0 0x7f14c0052370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:56.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.355+0000 7f14db7fe700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14c004feb0 0x7f14c0052370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f14cc002f30 tx=0x7f14cc0090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.355+0000 7f14db7fe700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14c004feb0 0x7f14c0052370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f14cc002f30 tx=0x7f14cc0090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.355+0000 7f14db7fe700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14c004feb0 0x7f14c0052370 secure :-1 s=READY pgs=605 cs=0 l=1 rx=0x7f14cc002f30 tx=0x7f14cc0090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:56.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.367+0000 7f14dbfff700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc14aa70 0x7f14dc145a50 secure :-1 s=THROTTLE_DONE pgs=238 cs=0 l=1 rx=0x7f14c4002660 tx=0x7f14d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.367+0000 7f14d8ff9700 1 -- 172.21.15.63:0/1384226848 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f14d403e390 con 0x7f14dc14aa70 2020-05-18T21:33:56.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.515+0000 7f14e09b1700 1 -- 172.21.15.63:0/1384226848 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14dc142a40 con 0x7f14dc14aa70 2020-05-18T21:33:56.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.515+0000 7f14dbfff700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc14aa70 0x7f14dc145a50 secure :-1 s=THROTTLE_DONE pgs=238 cs=0 l=1 rx=0x7f14c4002660 tx=0x7f14d4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.515+0000 7f14d8ff9700 1 -- 172.21.15.63:0/1384226848 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f14d40419b0 con 0x7f14dc14aa70 2020-05-18T21:33:56.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.515+0000 7f14e09b1700 1 -- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14c004feb0 msgr2=0x7f14c0052370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:56.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.515+0000 7f14e09b1700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14c004feb0 0x7f14c0052370 secure :-1 s=READY pgs=605 cs=0 l=1 rx=0x7f14cc002f30 tx=0x7f14cc0090f0).stop 2020-05-18T21:33:56.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.515+0000 7f14e09b1700 1 -- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc14aa70 msgr2=0x7f14dc145a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:56.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.515+0000 7f14e09b1700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc14aa70 0x7f14dc145a50 secure :-1 s=READY pgs=238 cs=0 l=1 rx=0x7f14c4002660 tx=0x7f14d4007e00).stop 2020-05-18T21:33:56.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.515+0000 7f14e09b1700 1 -- 172.21.15.63:0/1384226848 shutdown_connections 2020-05-18T21:33:56.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.515+0000 7f14e09b1700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f14c004feb0 0x7f14c0052370 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:56.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.515+0000 7f14e09b1700 1 --2- 172.21.15.63:0/1384226848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14dc14aa70 0x7f14dc145a50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:56.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.515+0000 7f14e09b1700 1 -- 172.21.15.63:0/1384226848 >> 172.21.15.63:0/1384226848 conn(0x7f14dc069fc0 msgr2=0x7f14dc1436e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:56.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.519+0000 7f14e09b1700 1 -- 172.21.15.63:0/1384226848 shutdown_connections 2020-05-18T21:33:56.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.519+0000 7f14e09b1700 1 -- 172.21.15.63:0/1384226848 wait complete. 2020-05-18T21:33:56.527 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 86 2020-05-18T21:33:56.527 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:56.527 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/911406335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":911406335},{"type":"v1","addr":"172.21.15.155:6835","nonce":911406335}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:46.613321+0000","modified":"2020-05-18T21:33:47.617221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8365":{"gid":8365,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/299278803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":299278803},{"type":"v1","addr":"172.21.15.63:6833","nonce":299278803}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-05-18T21:33:56.532 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache num_strays 2020-05-18T21:33:56.634 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:56.634 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:33:56.634 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays": 1 2020-05-18T21:33:56.635 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:56.635 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:56.642 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "num_strays": 1 } } 2020-05-18T21:33:56.643 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:56.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.739+0000 7f867f132700 1 Processor -- start 2020-05-18T21:33:56.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.739+0000 7f867f132700 1 -- start start 2020-05-18T21:33:56.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.739+0000 7f867f132700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8678145df0 0x7f8678142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:56.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.739+0000 7f867f132700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86780b7020 con 0x7f86780b93f0 2020-05-18T21:33:56.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.739+0000 7f867f132700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86780b72c0 con 0x7f86781432f0 2020-05-18T21:33:56.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.739+0000 7f867f132700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86780b7560 con 0x7f8678145df0 2020-05-18T21:33:56.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.739+0000 7f867d92f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8678145df0 0x7f8678142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:56.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867e130700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f86780b93f0 0x7f86780b7ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35250/0 (socket says 172.21.15.63:35250) 2020-05-18T21:33:56.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867e130700 1 -- 172.21.15.63:0/1655131944 learned_addr learned my addr 172.21.15.63:0/1655131944 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:56.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867d92f700 1 -- 172.21.15.63:0/1655131944 >> v1:172.21.15.155:6789/0 conn(0x7f86781432f0 legacy=0x7f8678060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:56.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867d92f700 1 -- 172.21.15.63:0/1655131944 >> v1:172.21.15.63:6789/0 conn(0x7f86780b93f0 legacy=0x7f86780b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:56.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867d92f700 1 -- 172.21.15.63:0/1655131944 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86780b7800 con 0x7f8678145df0 2020-05-18T21:33:56.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867d12e700 1 -- 172.21.15.63:0/1655131944 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415365800 0 0) 0x7f86780b7020 con 0x7f86780b93f0 2020-05-18T21:33:56.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867d92f700 1 --2- 172.21.15.63:0/1655131944 >> v2:172.21.15.63:3300/0 conn(0x7f8678145df0 0x7f8678142e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f866c002f70 tx=0x7f866c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867d92f700 1 --2- 172.21.15.63:0/1655131944 >> v2:172.21.15.63:3300/0 conn(0x7f8678145df0 0x7f8678142e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f866c002f70 tx=0x7f866c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867d92f700 1 --2- 172.21.15.63:0/1655131944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8678145df0 0x7f8678142e90 secure :-1 s=READY pgs=1555 cs=0 l=1 rx=0x7f866c002f70 tx=0x7f866c007a80).ready entity=mon.0 client_cookie=efe6aa58e1dc90f1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:56.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867d92f700 1 --2- 172.21.15.63:0/1655131944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8678145df0 0x7f8678142e90 secure :-1 s=THROTTLE_DONE pgs=1555 cs=0 l=1 rx=0x7f866c002f70 tx=0x7f866c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867d12e700 1 -- 172.21.15.63:0/1655131944 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f866c008e80 con 0x7f8678145df0 2020-05-18T21:33:56.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867d92f700 1 --2- 172.21.15.63:0/1655131944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8678145df0 0x7f8678142e90 secure :-1 s=THROTTLE_DONE pgs=1555 cs=0 l=1 rx=0x7f866c002f70 tx=0x7f866c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867d92f700 1 --2- 172.21.15.63:0/1655131944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8678145df0 0x7f8678142e90 secure :-1 s=THROTTLE_DONE pgs=1555 cs=0 l=1 rx=0x7f866c002f70 tx=0x7f866c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867d12e700 1 -- 172.21.15.63:0/1655131944 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c0116a0 con 0x7f8678145df0 2020-05-18T21:33:56.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867d12e700 1 -- 172.21.15.63:0/1655131944 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f866c011ac0 con 0x7f8678145df0 2020-05-18T21:33:56.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867f132700 1 -- 172.21.15.63:0/1655131944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8678145df0 msgr2=0x7f8678142e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:56.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867f132700 1 --2- 172.21.15.63:0/1655131944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8678145df0 0x7f8678142e90 secure :-1 s=READY pgs=1555 cs=0 l=1 rx=0x7f866c002f70 tx=0x7f866c007a80).stop 2020-05-18T21:33:56.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867f132700 1 -- 172.21.15.63:0/1655131944 shutdown_connections 2020-05-18T21:33:56.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867f132700 1 --2- 172.21.15.63:0/1655131944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8678145df0 0x7f8678142e90 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:56.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867f132700 1 -- 172.21.15.63:0/1655131944 >> 172.21.15.63:0/1655131944 conn(0x7f8678069b70 msgr2=0x7f8678069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:56.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867f132700 1 -- 172.21.15.63:0/1655131944 shutdown_connections 2020-05-18T21:33:56.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867f132700 1 -- 172.21.15.63:0/1655131944 wait complete. 2020-05-18T21:33:56.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867f132700 1 Processor -- start 2020-05-18T21:33:56.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.743+0000 7f867f132700 1 -- start start 2020-05-18T21:33:56.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867f132700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f86780b93f0 0x7f867813d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:56.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867f132700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8678145df0 0x7f86780ba580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:56.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867f132700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867813d200 con 0x7f86781432f0 2020-05-18T21:33:56.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867f132700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867813dda0 con 0x7f86780b93f0 2020-05-18T21:33:56.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867f132700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867813d4a0 con 0x7f8678145df0 2020-05-18T21:33:56.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867d92f700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f86781432f0 0x7f8678136190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35254/0 (socket says 172.21.15.63:35254) 2020-05-18T21:33:56.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867d92f700 1 -- 172.21.15.63:0/2717336629 learned_addr learned my addr 172.21.15.63:0/2717336629 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:56.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867e130700 1 --2- 172.21.15.63:0/2717336629 >> v2:172.21.15.63:3300/0 conn(0x7f86780b93f0 0x7f867813d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:56.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867e931700 1 --2- 172.21.15.63:0/2717336629 >> v2:172.21.15.155:3300/0 conn(0x7f8678145df0 0x7f86780ba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:56.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f866b7fe700 1 -- 172.21.15.63:0/2717336629 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673924866 0 0) 0x7f867813d200 con 0x7f86781432f0 2020-05-18T21:33:56.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f866b7fe700 1 -- 172.21.15.63:0/2717336629 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8658002fe0 con 0x7f86781432f0 2020-05-18T21:33:56.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867e130700 1 -- 172.21.15.63:0/2717336629 >> v2:172.21.15.155:3300/0 conn(0x7f8678145df0 msgr2=0x7f86780ba580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:56.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867e130700 1 --2- 172.21.15.63:0/2717336629 >> v2:172.21.15.155:3300/0 conn(0x7f8678145df0 0x7f86780ba580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:56.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867e130700 1 -- 172.21.15.63:0/2717336629 >> v1:172.21.15.63:6789/0 conn(0x7f86781432f0 legacy=0x7f8678136190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:56.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f866b7fe700 1 -- 172.21.15.63:0/2717336629 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1921949495 0 0) 0x7f8658002fe0 con 0x7f86781432f0 2020-05-18T21:33:56.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867e130700 1 -- 172.21.15.63:0/2717336629 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867813cf10 con 0x7f86780b93f0 2020-05-18T21:33:56.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867e130700 1 --2- 172.21.15.63:0/2717336629 >> v2:172.21.15.63:3300/0 conn(0x7f86780b93f0 0x7f867813d940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f866c008360 tx=0x7f8674010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867e130700 1 --2- 172.21.15.63:0/2717336629 >> v2:172.21.15.63:3300/0 conn(0x7f86780b93f0 0x7f867813d940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f866c008360 tx=0x7f8674010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867e130700 1 --2- 172.21.15.63:0/2717336629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86780b93f0 0x7f867813d940 secure :-1 s=READY pgs=1557 cs=0 l=1 rx=0x7f866c008360 tx=0x7f8674010940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:56.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867e130700 1 --2- 172.21.15.63:0/2717336629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86780b93f0 0x7f867813d940 secure :-1 s=THROTTLE_DONE pgs=1557 cs=0 l=1 rx=0x7f866c008360 tx=0x7f8674010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f866b7fe700 1 -- 172.21.15.63:0/2717336629 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f866c008e80 con 0x7f86780b93f0 2020-05-18T21:33:56.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867e130700 1 --2- 172.21.15.63:0/2717336629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86780b93f0 0x7f867813d940 secure :-1 s=THROTTLE_DONE pgs=1557 cs=0 l=1 rx=0x7f866c008360 tx=0x7f8674010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f866b7fe700 1 -- 172.21.15.63:0/2717336629 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86740058e0 con 0x7f86780b93f0 2020-05-18T21:33:56.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867e130700 1 --2- 172.21.15.63:0/2717336629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86780b93f0 0x7f867813d940 secure :-1 s=THROTTLE_DONE pgs=1557 cs=0 l=1 rx=0x7f866c008360 tx=0x7f8674010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867f132700 1 -- 172.21.15.63:0/2717336629 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8678141ae0 con 0x7f86780b93f0 2020-05-18T21:33:56.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f866b7fe700 1 -- 172.21.15.63:0/2717336629 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8674005c80 con 0x7f86780b93f0 2020-05-18T21:33:56.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.747+0000 7f867f132700 1 -- 172.21.15.63:0/2717336629 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86780ba9e0 con 0x7f86780b93f0 2020-05-18T21:33:56.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.751+0000 7f867f132700 1 -- 172.21.15.63:0/2717336629 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86780569e0 con 0x7f86780b93f0 2020-05-18T21:33:56.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.751+0000 7f867e130700 1 --2- 172.21.15.63:0/2717336629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86780b93f0 0x7f867813d940 secure :-1 s=THROTTLE_DONE pgs=1557 cs=0 l=1 rx=0x7f866c008360 tx=0x7f8674010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.751+0000 7f866b7fe700 1 -- 172.21.15.63:0/2717336629 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f867400a360 con 0x7f86780b93f0 2020-05-18T21:33:56.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.751+0000 7f867e130700 1 --2- 172.21.15.63:0/2717336629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86780b93f0 0x7f867813d940 secure :-1 s=THROTTLE_DONE pgs=1557 cs=0 l=1 rx=0x7f866c008360 tx=0x7f8674010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.751+0000 7f866b7fe700 1 --2- 172.21.15.63:0/2717336629 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f865804fd20 0x7f86580521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:56.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.751+0000 7f866b7fe700 1 -- 172.21.15.63:0/2717336629 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f86740090c0 con 0x7f86780b93f0 2020-05-18T21:33:56.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.751+0000 7f867d92f700 1 --2- 172.21.15.63:0/2717336629 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f865804fd20 0x7f86580521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:56.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.751+0000 7f867d92f700 1 --2- 172.21.15.63:0/2717336629 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f865804fd20 0x7f86580521e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f866c002f10 tx=0x7f866c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.751+0000 7f867d92f700 1 --2- 172.21.15.63:0/2717336629 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f865804fd20 0x7f86580521e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f866c002f10 tx=0x7f866c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.751+0000 7f867d92f700 1 --2- 172.21.15.63:0/2717336629 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f865804fd20 0x7f86580521e0 secure :-1 s=READY pgs=606 cs=0 l=1 rx=0x7f866c002f10 tx=0x7f866c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:56.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.759+0000 7f867e130700 1 --2- 172.21.15.63:0/2717336629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86780b93f0 0x7f867813d940 secure :-1 s=THROTTLE_DONE pgs=1557 cs=0 l=1 rx=0x7f866c008360 tx=0x7f8674010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.759+0000 7f866b7fe700 1 -- 172.21.15.63:0/2717336629 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f867403da40 con 0x7f86780b93f0 2020-05-18T21:33:56.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.907+0000 7f867f132700 1 -- 172.21.15.63:0/2717336629 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8678061c40 con 0x7f86780b93f0 2020-05-18T21:33:56.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.907+0000 7f867e130700 1 --2- 172.21.15.63:0/2717336629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86780b93f0 0x7f867813d940 secure :-1 s=THROTTLE_DONE pgs=1557 cs=0 l=1 rx=0x7f866c008360 tx=0x7f8674010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:56.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.907+0000 7f866b7fe700 1 -- 172.21.15.63:0/2717336629 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f8674041060 con 0x7f86780b93f0 2020-05-18T21:33:56.911 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:56.911 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/911406335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":911406335},{"type":"v1","addr":"172.21.15.155:6835","nonce":911406335}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:46.613321+0000","modified":"2020-05-18T21:33:47.617221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8365":{"gid":8365,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/299278803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":299278803},{"type":"v1","addr":"172.21.15.63:6833","nonce":299278803}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-05-18T21:33:56.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.907+0000 7f867f132700 1 -- 172.21.15.63:0/2717336629 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f865804fd20 msgr2=0x7f86580521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:56.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.907+0000 7f867f132700 1 --2- 172.21.15.63:0/2717336629 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f865804fd20 0x7f86580521e0 secure :-1 s=READY pgs=606 cs=0 l=1 rx=0x7f866c002f10 tx=0x7f866c007a80).stop 2020-05-18T21:33:56.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.907+0000 7f867f132700 1 -- 172.21.15.63:0/2717336629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86780b93f0 msgr2=0x7f867813d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:56.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.907+0000 7f867f132700 1 --2- 172.21.15.63:0/2717336629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86780b93f0 0x7f867813d940 secure :-1 s=READY pgs=1557 cs=0 l=1 rx=0x7f866c008360 tx=0x7f8674010940).stop 2020-05-18T21:33:56.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.907+0000 7f867f132700 1 -- 172.21.15.63:0/2717336629 shutdown_connections 2020-05-18T21:33:56.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.907+0000 7f867f132700 1 --2- 172.21.15.63:0/2717336629 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f865804fd20 0x7f86580521e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:56.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.907+0000 7f867f132700 1 --2- 172.21.15.63:0/2717336629 >> v2:172.21.15.155:3300/0 conn(0x7f8678145df0 0x7f86780ba580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:56.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.907+0000 7f867f132700 1 --2- 172.21.15.63:0/2717336629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86780b93f0 0x7f867813d940 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:56.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.907+0000 7f867f132700 1 -- 172.21.15.63:0/2717336629 >> 172.21.15.63:0/2717336629 conn(0x7f8678069b70 msgr2=0x7f86780b9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:56.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.907+0000 7f867f132700 1 -- 172.21.15.63:0/2717336629 shutdown_connections 2020-05-18T21:33:56.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:56.911+0000 7f867f132700 1 -- 172.21.15.63:0/2717336629 wait complete. 2020-05-18T21:33:56.915 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 86 2020-05-18T21:33:56.924 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_created 2020-05-18T21:33:57.022 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:57.022 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:33:57.023 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_created": 1 2020-05-18T21:33:57.023 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:57.023 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:57.028 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_created": 1 } } 2020-05-18T21:33:57.029 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:57.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f938dac5700 1 Processor -- start 2020-05-18T21:33:57.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f938dac5700 1 -- start start 2020-05-18T21:33:57.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f938dac5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f938805f110 0x7f93880b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:57.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f938dac5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f938814aa70 0x7f93880648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:57.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f938dac5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938814a330 con 0x7f9388064d20 2020-05-18T21:33:57.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f938dac5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938814a140 con 0x7f938814aa70 2020-05-18T21:33:57.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f938dac5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938814a5d0 con 0x7f938805f110 2020-05-18T21:33:57.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f9387fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f938814aa70 0x7f93880648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f9387fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f938814aa70 0x7f93880648c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33074/0 (socket says 172.21.15.63:33074) 2020-05-18T21:33:57.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f9387fff700 1 -- 172.21.15.63:0/3656152323 learned_addr learned my addr 172.21.15.63:0/3656152323 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:57.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f938d2c4700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9388064d20 0x7f938814d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35266/0 (socket says 172.21.15.63:35266) 2020-05-18T21:33:57.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f938cac3700 1 --2- 172.21.15.63:0/3656152323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f938805f110 0x7f93880b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f9387fff700 1 -- 172.21.15.63:0/3656152323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f938805f110 msgr2=0x7f93880b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:57.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f9387fff700 1 --2- 172.21.15.63:0/3656152323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f938805f110 0x7f93880b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:57.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f9387fff700 1 -- 172.21.15.63:0/3656152323 >> v1:172.21.15.63:6789/0 conn(0x7f9388064d20 legacy=0x7f938814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f9387fff700 1 -- 172.21.15.63:0/3656152323 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9388063430 con 0x7f938814aa70 2020-05-18T21:33:57.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f9387fff700 1 --2- 172.21.15.63:0/3656152323 >> v2:172.21.15.63:3300/0 conn(0x7f938814aa70 0x7f93880648c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9388063c70 tx=0x7f9370008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f9387fff700 1 --2- 172.21.15.63:0/3656152323 >> v2:172.21.15.63:3300/0 conn(0x7f938814aa70 0x7f93880648c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9388063c70 tx=0x7f9370008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f9387fff700 1 --2- 172.21.15.63:0/3656152323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f938814aa70 0x7f93880648c0 secure :-1 s=READY pgs=1559 cs=0 l=1 rx=0x7f9388063c70 tx=0x7f9370008920).ready entity=mon.0 client_cookie=19e5733ae64adc45 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:57.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f9387fff700 1 --2- 172.21.15.63:0/3656152323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f938814aa70 0x7f93880648c0 secure :-1 s=THROTTLE_DONE pgs=1559 cs=0 l=1 rx=0x7f9388063c70 tx=0x7f9370008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f9387fff700 1 --2- 172.21.15.63:0/3656152323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f938814aa70 0x7f93880648c0 secure :-1 s=THROTTLE_DONE pgs=1559 cs=0 l=1 rx=0x7f9388063c70 tx=0x7f9370008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f93877fe700 1 -- 172.21.15.63:0/3656152323 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9370011760 con 0x7f938814aa70 2020-05-18T21:33:57.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f9387fff700 1 --2- 172.21.15.63:0/3656152323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f938814aa70 0x7f93880648c0 secure :-1 s=THROTTLE_DONE pgs=1559 cs=0 l=1 rx=0x7f9388063c70 tx=0x7f9370008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f93877fe700 1 -- 172.21.15.63:0/3656152323 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93700118c0 con 0x7f938814aa70 2020-05-18T21:33:57.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f93877fe700 1 -- 172.21.15.63:0/3656152323 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9370011ce0 con 0x7f938814aa70 2020-05-18T21:33:57.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f938dac5700 1 -- 172.21.15.63:0/3656152323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f938814aa70 msgr2=0x7f93880648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.135+0000 7f938dac5700 1 --2- 172.21.15.63:0/3656152323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f938814aa70 0x7f93880648c0 secure :-1 s=READY pgs=1559 cs=0 l=1 rx=0x7f9388063c70 tx=0x7f9370008920).stop 2020-05-18T21:33:57.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.139+0000 7f938dac5700 1 -- 172.21.15.63:0/3656152323 shutdown_connections 2020-05-18T21:33:57.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.139+0000 7f938dac5700 1 --2- 172.21.15.63:0/3656152323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f938814aa70 0x7f93880648c0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:57.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.139+0000 7f938dac5700 1 --2- 172.21.15.63:0/3656152323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f938805f110 0x7f93880b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:57.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.139+0000 7f938dac5700 1 -- 172.21.15.63:0/3656152323 >> 172.21.15.63:0/3656152323 conn(0x7f9388069fc0 msgr2=0x7f938806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:57.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.139+0000 7f938dac5700 1 -- 172.21.15.63:0/3656152323 shutdown_connections 2020-05-18T21:33:57.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.139+0000 7f938dac5700 1 -- 172.21.15.63:0/3656152323 wait complete. 2020-05-18T21:33:57.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.139+0000 7f938dac5700 1 Processor -- start 2020-05-18T21:33:57.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.139+0000 7f938dac5700 1 -- start start 2020-05-18T21:33:57.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.139+0000 7f938dac5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9388064d20 0x7f93880b8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:57.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.139+0000 7f938dac5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f938814aa70 0x7f938814b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:57.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.139+0000 7f938dac5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938814ba10 con 0x7f938805f110 2020-05-18T21:33:57.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.139+0000 7f938dac5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93880b6ad0 con 0x7f9388064d20 2020-05-18T21:33:57.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.139+0000 7f938dac5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9388146610 con 0x7f938814aa70 2020-05-18T21:33:57.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.139+0000 7f9387fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9388064d20 0x7f93880b8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.139+0000 7f9387fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9388064d20 0x7f93880b8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33082/0 (socket says 172.21.15.63:33082) 2020-05-18T21:33:57.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.139+0000 7f9387fff700 1 -- 172.21.15.63:0/2082396892 learned_addr learned my addr 172.21.15.63:0/2082396892 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:57.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.139+0000 7f938d2c4700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f938814aa70 0x7f938814b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f9387fff700 1 -- 172.21.15.63:0/2082396892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f938814aa70 msgr2=0x7f938814b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f9387fff700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f938814aa70 0x7f938814b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:57.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f9387fff700 1 -- 172.21.15.63:0/2082396892 >> v1:172.21.15.155:6789/0 conn(0x7f938805f110 legacy=0x7f93880b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f9387fff700 1 -- 172.21.15.63:0/2082396892 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93881468b0 con 0x7f9388064d20 2020-05-18T21:33:57.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f938d2c4700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f938814aa70 0x7f938814b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:33:57.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f9387fff700 1 --2- 172.21.15.63:0/2082396892 >> v2:172.21.15.63:3300/0 conn(0x7f9388064d20 0x7f93880b8270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9388063c70 tx=0x7f93880635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f9387fff700 1 --2- 172.21.15.63:0/2082396892 >> v2:172.21.15.63:3300/0 conn(0x7f9388064d20 0x7f93880b8270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9388063c70 tx=0x7f93880635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f9387fff700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9388064d20 0x7f93880b8270 secure :-1 s=READY pgs=1560 cs=0 l=1 rx=0x7f9388063c70 tx=0x7f93880635c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:57.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f9387fff700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9388064d20 0x7f93880b8270 secure :-1 s=THROTTLE_DONE pgs=1560 cs=0 l=1 rx=0x7f9388063c70 tx=0x7f93880635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f9387fff700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9388064d20 0x7f93880b8270 secure :-1 s=THROTTLE_DONE pgs=1560 cs=0 l=1 rx=0x7f9388063c70 tx=0x7f93880635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f9387fff700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9388064d20 0x7f93880b8270 secure :-1 s=THROTTLE_DONE pgs=1560 cs=0 l=1 rx=0x7f9388063c70 tx=0x7f93880635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f9385ffb700 1 -- 172.21.15.63:0/2082396892 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9370007360 con 0x7f9388064d20 2020-05-18T21:33:57.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f9385ffb700 1 -- 172.21.15.63:0/2082396892 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93700074c0 con 0x7f9388064d20 2020-05-18T21:33:57.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f938dac5700 1 -- 172.21.15.63:0/2082396892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9388145b80 con 0x7f9388064d20 2020-05-18T21:33:57.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f9385ffb700 1 -- 172.21.15.63:0/2082396892 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93700058f0 con 0x7f9388064d20 2020-05-18T21:33:57.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f938dac5700 1 -- 172.21.15.63:0/2082396892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93881460b0 con 0x7f9388064d20 2020-05-18T21:33:57.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f9387fff700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9388064d20 0x7f93880b8270 secure :-1 s=THROTTLE_DONE pgs=1560 cs=0 l=1 rx=0x7f9388063c70 tx=0x7f93880635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f938dac5700 1 -- 172.21.15.63:0/2082396892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9388146a70 con 0x7f9388064d20 2020-05-18T21:33:57.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f9385ffb700 1 -- 172.21.15.63:0/2082396892 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9370005b60 con 0x7f9388064d20 2020-05-18T21:33:57.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f9387fff700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9388064d20 0x7f93880b8270 secure :-1 s=THROTTLE_DONE pgs=1560 cs=0 l=1 rx=0x7f9388063c70 tx=0x7f93880635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f9385ffb700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f936004f9f0 0x7f9360051eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:57.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f9385ffb700 1 -- 172.21.15.63:0/2082396892 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9370064550 con 0x7f9388064d20 2020-05-18T21:33:57.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f938cac3700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f936004f9f0 0x7f9360051eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f938cac3700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f936004f9f0 0x7f9360051eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9388149360 tx=0x7f9378008d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f938cac3700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f936004f9f0 0x7f9360051eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9388149360 tx=0x7f9378008d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.143+0000 7f938cac3700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f936004f9f0 0x7f9360051eb0 secure :-1 s=READY pgs=607 cs=0 l=1 rx=0x7f9388149360 tx=0x7f9378008d50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:57.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.147+0000 7f9387fff700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9388064d20 0x7f93880b8270 secure :-1 s=THROTTLE_DONE pgs=1560 cs=0 l=1 rx=0x7f9388063c70 tx=0x7f93880635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.147+0000 7f9385ffb700 1 -- 172.21.15.63:0/2082396892 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f937003e9a0 con 0x7f9388064d20 2020-05-18T21:33:57.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.299+0000 7f938dac5700 1 -- 172.21.15.63:0/2082396892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93880569e0 con 0x7f9388064d20 2020-05-18T21:33:57.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.299+0000 7f9387fff700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9388064d20 0x7f93880b8270 secure :-1 s=THROTTLE_DONE pgs=1560 cs=0 l=1 rx=0x7f9388063c70 tx=0x7f93880635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.299+0000 7f9385ffb700 1 -- 172.21.15.63:0/2082396892 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f9370041fc0 con 0x7f9388064d20 2020-05-18T21:33:57.304 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:57.304 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/911406335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":911406335},{"type":"v1","addr":"172.21.15.155:6835","nonce":911406335}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:46.613321+0000","modified":"2020-05-18T21:33:47.617221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8365":{"gid":8365,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/299278803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":299278803},{"type":"v1","addr":"172.21.15.63:6833","nonce":299278803}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-05-18T21:33:57.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.299+0000 7f938dac5700 1 -- 172.21.15.63:0/2082396892 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f936004f9f0 msgr2=0x7f9360051eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.299+0000 7f938dac5700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f936004f9f0 0x7f9360051eb0 secure :-1 s=READY pgs=607 cs=0 l=1 rx=0x7f9388149360 tx=0x7f9378008d50).stop 2020-05-18T21:33:57.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.299+0000 7f938dac5700 1 -- 172.21.15.63:0/2082396892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9388064d20 msgr2=0x7f93880b8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.299+0000 7f938dac5700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9388064d20 0x7f93880b8270 secure :-1 s=READY pgs=1560 cs=0 l=1 rx=0x7f9388063c70 tx=0x7f93880635c0).stop 2020-05-18T21:33:57.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.299+0000 7f938dac5700 1 -- 172.21.15.63:0/2082396892 shutdown_connections 2020-05-18T21:33:57.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.299+0000 7f938dac5700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f936004f9f0 0x7f9360051eb0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:57.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.299+0000 7f938dac5700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f938814aa70 0x7f938814b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:57.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.299+0000 7f938dac5700 1 --2- 172.21.15.63:0/2082396892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9388064d20 0x7f93880b8270 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:57.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.299+0000 7f938dac5700 1 -- 172.21.15.63:0/2082396892 >> 172.21.15.63:0/2082396892 conn(0x7f9388069fc0 msgr2=0x7f9388060470 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:57.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.299+0000 7f938dac5700 1 -- 172.21.15.63:0/2082396892 shutdown_connections 2020-05-18T21:33:57.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.303+0000 7f938dac5700 1 -- 172.21.15.63:0/2082396892 wait complete. 2020-05-18T21:33:57.308 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 86 2020-05-18T21:33:57.320 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_enqueued 2020-05-18T21:33:57.418 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:33:57.418 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:33:57.418 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 0 2020-05-18T21:33:57.419 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:57.419 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:33:57.426 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_enqueued": 0 } } 2020-05-18T21:33:57.427 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:57.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.527+0000 7f26848e1700 1 Processor -- start 2020-05-18T21:33:57.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.527+0000 7f26848e1700 1 -- start start 2020-05-18T21:33:57.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.527+0000 7f26848e1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26800b5860 0x7f2680149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:57.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.527+0000 7f26848e1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f268009e360 0x7f268009e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:57.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.527+0000 7f26848e1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2680061140 con 0x7f268009c9f0 2020-05-18T21:33:57.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.527+0000 7f26848e1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2680062230 con 0x7f268009e360 2020-05-18T21:33:57.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.527+0000 7f26848e1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26800613e0 con 0x7f26800b5860 2020-05-18T21:33:57.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.527+0000 7f267ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f268009e360 0x7f268009e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.527+0000 7f267ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f268009e360 0x7f268009e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33092/0 (socket says 172.21.15.63:33092) 2020-05-18T21:33:57.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.527+0000 7f267ffff700 1 -- 172.21.15.63:0/3589955629 learned_addr learned my addr 172.21.15.63:0/3589955629 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:57.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.527+0000 7f267f7fe700 1 --2- 172.21.15.63:0/3589955629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26800b5860 0x7f2680149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.527+0000 7f267ffff700 1 -- 172.21.15.63:0/3589955629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26800b5860 msgr2=0x7f2680149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:57.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.527+0000 7f267ffff700 1 --2- 172.21.15.63:0/3589955629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26800b5860 0x7f2680149cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:57.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.527+0000 7f267ffff700 1 -- 172.21.15.63:0/3589955629 >> v1:172.21.15.155:6789/0 conn(0x7f268009c9f0 legacy=0x7f2680061b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.527+0000 7f267ffff700 1 -- 172.21.15.63:0/3589955629 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2680061680 con 0x7f268009e360 2020-05-18T21:33:57.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.527+0000 7f267f7fe700 1 --2- 172.21.15.63:0/3589955629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26800b5860 0x7f2680149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:33:57.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.527+0000 7f267ffff700 1 --2- 172.21.15.63:0/3589955629 >> v2:172.21.15.63:3300/0 conn(0x7f268009e360 0x7f268009e7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f26780032f0 tx=0x7f2678007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.531+0000 7f267ffff700 1 --2- 172.21.15.63:0/3589955629 >> v2:172.21.15.63:3300/0 conn(0x7f268009e360 0x7f268009e7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f26780032f0 tx=0x7f2678007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.531+0000 7f267ffff700 1 --2- 172.21.15.63:0/3589955629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f268009e360 0x7f268009e7f0 secure :-1 s=READY pgs=1561 cs=0 l=1 rx=0x7f26780032f0 tx=0x7f2678007e00).ready entity=mon.0 client_cookie=1789e2d1dced6080 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:57.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.531+0000 7f267ffff700 1 --2- 172.21.15.63:0/3589955629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f268009e360 0x7f268009e7f0 secure :-1 s=THROTTLE_DONE pgs=1561 cs=0 l=1 rx=0x7f26780032f0 tx=0x7f2678007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.531+0000 7f267ffff700 1 --2- 172.21.15.63:0/3589955629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f268009e360 0x7f268009e7f0 secure :-1 s=THROTTLE_DONE pgs=1561 cs=0 l=1 rx=0x7f26780032f0 tx=0x7f2678007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.531+0000 7f267effd700 1 -- 172.21.15.63:0/3589955629 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2678011dc0 con 0x7f268009e360 2020-05-18T21:33:57.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.531+0000 7f267ffff700 1 --2- 172.21.15.63:0/3589955629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f268009e360 0x7f268009e7f0 secure :-1 s=THROTTLE_DONE pgs=1561 cs=0 l=1 rx=0x7f26780032f0 tx=0x7f2678007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.531+0000 7f267effd700 1 -- 172.21.15.63:0/3589955629 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267800a180 con 0x7f268009e360 2020-05-18T21:33:57.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.531+0000 7f267effd700 1 -- 172.21.15.63:0/3589955629 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f267800a5a0 con 0x7f268009e360 2020-05-18T21:33:57.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.531+0000 7f26848e1700 1 -- 172.21.15.63:0/3589955629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f268009e360 msgr2=0x7f268009e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.531+0000 7f26848e1700 1 --2- 172.21.15.63:0/3589955629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f268009e360 0x7f268009e7f0 secure :-1 s=READY pgs=1561 cs=0 l=1 rx=0x7f26780032f0 tx=0x7f2678007e00).stop 2020-05-18T21:33:57.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.531+0000 7f26848e1700 1 -- 172.21.15.63:0/3589955629 shutdown_connections 2020-05-18T21:33:57.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.531+0000 7f26848e1700 1 --2- 172.21.15.63:0/3589955629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f268009e360 0x7f268009e7f0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:57.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.531+0000 7f26848e1700 1 --2- 172.21.15.63:0/3589955629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26800b5860 0x7f2680149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:57.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.531+0000 7f26848e1700 1 -- 172.21.15.63:0/3589955629 >> 172.21.15.63:0/3589955629 conn(0x7f268005a7c0 msgr2=0x7f268005aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:57.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.531+0000 7f26848e1700 1 -- 172.21.15.63:0/3589955629 shutdown_connections 2020-05-18T21:33:57.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.531+0000 7f26848e1700 1 -- 172.21.15.63:0/3589955629 wait complete. 2020-05-18T21:33:57.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.531+0000 7f26848e1700 1 Processor -- start 2020-05-18T21:33:57.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.531+0000 7f26848e1700 1 -- start start 2020-05-18T21:33:57.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f26848e1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f268009c9f0 0x7f26801531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:57.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f26848e1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f26800b5860 0x7f2680063d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:57.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f26848e1700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268009a9d0 con 0x7f268009e360 2020-05-18T21:33:57.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f26848e1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f268009a7c0 con 0x7f268009c9f0 2020-05-18T21:33:57.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f26848e1700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f268009ac70 con 0x7f26800b5860 2020-05-18T21:33:57.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f267f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f268009c9f0 0x7f26801531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f2677fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f268009e360 0x7f2680063670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35284/0 (socket says 172.21.15.63:35284) 2020-05-18T21:33:57.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f2677fff700 1 -- 172.21.15.63:0/3064847690 learned_addr learned my addr 172.21.15.63:0/3064847690 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:57.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f267ffff700 1 --2- 172.21.15.63:0/3064847690 >> v2:172.21.15.155:3300/0 conn(0x7f26800b5860 0x7f2680063d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f267d7fa700 1 -- 172.21.15.63:0/3064847690 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676678580 0 0) 0x7f268009a9d0 con 0x7f268009e360 2020-05-18T21:33:57.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f267d7fa700 1 -- 172.21.15.63:0/3064847690 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2664002fe0 con 0x7f268009e360 2020-05-18T21:33:57.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f267f7fe700 1 -- 172.21.15.63:0/3064847690 >> v2:172.21.15.155:3300/0 conn(0x7f26800b5860 msgr2=0x7f2680063d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f267f7fe700 1 --2- 172.21.15.63:0/3064847690 >> v2:172.21.15.155:3300/0 conn(0x7f26800b5860 0x7f2680063d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:57.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f267f7fe700 1 -- 172.21.15.63:0/3064847690 >> v1:172.21.15.63:6789/0 conn(0x7f268009e360 legacy=0x7f2680063670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f267f7fe700 1 -- 172.21.15.63:0/3064847690 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268009a3b0 con 0x7f268009c9f0 2020-05-18T21:33:57.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f267f7fe700 1 --2- 172.21.15.63:0/3064847690 >> v2:172.21.15.63:3300/0 conn(0x7f268009c9f0 0x7f26801531b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2680066090 tx=0x7f2670010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f267f7fe700 1 --2- 172.21.15.63:0/3064847690 >> v2:172.21.15.63:3300/0 conn(0x7f268009c9f0 0x7f26801531b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2680066090 tx=0x7f2670010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f267f7fe700 1 --2- 172.21.15.63:0/3064847690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f268009c9f0 0x7f26801531b0 secure :-1 s=READY pgs=1563 cs=0 l=1 rx=0x7f2680066090 tx=0x7f2670010a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:57.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f267f7fe700 1 --2- 172.21.15.63:0/3064847690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f268009c9f0 0x7f26801531b0 secure :-1 s=THROTTLE_DONE pgs=1563 cs=0 l=1 rx=0x7f2680066090 tx=0x7f2670010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f267f7fe700 1 --2- 172.21.15.63:0/3064847690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f268009c9f0 0x7f26801531b0 secure :-1 s=THROTTLE_DONE pgs=1563 cs=0 l=1 rx=0x7f2680066090 tx=0x7f2670010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f267d7fa700 1 -- 172.21.15.63:0/3064847690 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2670007180 con 0x7f268009c9f0 2020-05-18T21:33:57.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f267f7fe700 1 --2- 172.21.15.63:0/3064847690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f268009c9f0 0x7f26801531b0 secure :-1 s=THROTTLE_DONE pgs=1563 cs=0 l=1 rx=0x7f2680066090 tx=0x7f2670010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f267d7fa700 1 -- 172.21.15.63:0/3064847690 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26700072e0 con 0x7f268009c9f0 2020-05-18T21:33:57.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f26848e1700 1 -- 172.21.15.63:0/3064847690 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2680064ab0 con 0x7f268009c9f0 2020-05-18T21:33:57.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f267d7fa700 1 -- 172.21.15.63:0/3064847690 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f267000e120 con 0x7f268009c9f0 2020-05-18T21:33:57.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f26848e1700 1 -- 172.21.15.63:0/3064847690 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268008fbb0 con 0x7f268009c9f0 2020-05-18T21:33:57.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f267f7fe700 1 --2- 172.21.15.63:0/3064847690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f268009c9f0 0x7f26801531b0 secure :-1 s=THROTTLE_DONE pgs=1563 cs=0 l=1 rx=0x7f2680066090 tx=0x7f2670010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.535+0000 7f26848e1700 1 -- 172.21.15.63:0/3064847690 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268009a5a0 con 0x7f268009c9f0 2020-05-18T21:33:57.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.539+0000 7f267d7fa700 1 -- 172.21.15.63:0/3064847690 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f267000e390 con 0x7f268009c9f0 2020-05-18T21:33:57.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.539+0000 7f267f7fe700 1 --2- 172.21.15.63:0/3064847690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f268009c9f0 0x7f26801531b0 secure :-1 s=THROTTLE_DONE pgs=1563 cs=0 l=1 rx=0x7f2680066090 tx=0x7f2670010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.539+0000 7f267d7fa700 1 --2- 172.21.15.63:0/3064847690 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f266404fdd0 0x7f2664052290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:57.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.539+0000 7f267d7fa700 1 -- 172.21.15.63:0/3064847690 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f26700639d0 con 0x7f268009c9f0 2020-05-18T21:33:57.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.539+0000 7f2677fff700 1 --2- 172.21.15.63:0/3064847690 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f266404fdd0 0x7f2664052290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.539+0000 7f2677fff700 1 --2- 172.21.15.63:0/3064847690 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f266404fdd0 0x7f2664052290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2668000f50 tx=0x7f2668001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.539+0000 7f2677fff700 1 --2- 172.21.15.63:0/3064847690 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f266404fdd0 0x7f2664052290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2668000f50 tx=0x7f2668001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.539+0000 7f2677fff700 1 --2- 172.21.15.63:0/3064847690 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f266404fdd0 0x7f2664052290 secure :-1 s=READY pgs=608 cs=0 l=1 rx=0x7f2668000f50 tx=0x7f2668001820).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:57.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.543+0000 7f267f7fe700 1 --2- 172.21.15.63:0/3064847690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f268009c9f0 0x7f26801531b0 secure :-1 s=THROTTLE_DONE pgs=1563 cs=0 l=1 rx=0x7f2680066090 tx=0x7f2670010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.543+0000 7f267d7fa700 1 -- 172.21.15.63:0/3064847690 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f267003dd60 con 0x7f268009c9f0 2020-05-18T21:33:57.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.687+0000 7f26848e1700 1 -- 172.21.15.63:0/3064847690 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26800569e0 con 0x7f268009c9f0 2020-05-18T21:33:57.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.687+0000 7f267f7fe700 1 --2- 172.21.15.63:0/3064847690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f268009c9f0 0x7f26801531b0 secure :-1 s=THROTTLE_DONE pgs=1563 cs=0 l=1 rx=0x7f2680066090 tx=0x7f2670010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.687+0000 7f267d7fa700 1 -- 172.21.15.63:0/3064847690 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f2670041380 con 0x7f268009c9f0 2020-05-18T21:33:57.693 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:57.693 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/911406335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":911406335},{"type":"v1","addr":"172.21.15.155:6835","nonce":911406335}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:46.613321+0000","modified":"2020-05-18T21:33:47.617221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8365":{"gid":8365,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/299278803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":299278803},{"type":"v1","addr":"172.21.15.63:6833","nonce":299278803}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-05-18T21:33:57.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.691+0000 7f26848e1700 1 -- 172.21.15.63:0/3064847690 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f266404fdd0 msgr2=0x7f2664052290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.691+0000 7f26848e1700 1 --2- 172.21.15.63:0/3064847690 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f266404fdd0 0x7f2664052290 secure :-1 s=READY pgs=608 cs=0 l=1 rx=0x7f2668000f50 tx=0x7f2668001820).stop 2020-05-18T21:33:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.691+0000 7f26848e1700 1 -- 172.21.15.63:0/3064847690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f268009c9f0 msgr2=0x7f26801531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.691+0000 7f26848e1700 1 --2- 172.21.15.63:0/3064847690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f268009c9f0 0x7f26801531b0 secure :-1 s=READY pgs=1563 cs=0 l=1 rx=0x7f2680066090 tx=0x7f2670010a90).stop 2020-05-18T21:33:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.691+0000 7f26848e1700 1 -- 172.21.15.63:0/3064847690 shutdown_connections 2020-05-18T21:33:57.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.691+0000 7f26848e1700 1 --2- 172.21.15.63:0/3064847690 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f266404fdd0 0x7f2664052290 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:57.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.691+0000 7f26848e1700 1 --2- 172.21.15.63:0/3064847690 >> v2:172.21.15.155:3300/0 conn(0x7f26800b5860 0x7f2680063d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:57.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.691+0000 7f26848e1700 1 --2- 172.21.15.63:0/3064847690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f268009c9f0 0x7f26801531b0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:57.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.691+0000 7f26848e1700 1 -- 172.21.15.63:0/3064847690 >> 172.21.15.63:0/3064847690 conn(0x7f268005a7c0 msgr2=0x7f268009e770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:57.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.691+0000 7f26848e1700 1 -- 172.21.15.63:0/3064847690 shutdown_connections 2020-05-18T21:33:57.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.691+0000 7f26848e1700 1 -- 172.21.15.63:0/3064847690 wait complete. 2020-05-18T21:33:57.701 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 86 2020-05-18T21:33:57.710 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok session ls 2020-05-18T21:33:57.823 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:33:57.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:57.823 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 8542, 2020-05-18T21:33:57.824 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": { 2020-05-18T21:33:57.824 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:33:57.824 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:33:57.824 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 8542 2020-05-18T21:33:57.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:57.824 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:33:57.825 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "any", 2020-05-18T21:33:57.825 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:33:57.825 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1381514735 2020-05-18T21:33:57.825 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:57.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:57.826 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "open", 2020-05-18T21:33:57.826 INFO:teuthology.orchestra.run.smithi063.stdout: "num_leases": 1, 2020-05-18T21:33:57.826 INFO:teuthology.orchestra.run.smithi063.stdout: "num_caps": 2, 2020-05-18T21:33:57.826 INFO:teuthology.orchestra.run.smithi063.stdout: "request_load_avg": 9, 2020-05-18T21:33:57.826 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 4.9638432320000003, 2020-05-18T21:33:57.827 INFO:teuthology.orchestra.run.smithi063.stdout: "requests_in_flight": 0, 2020-05-18T21:33:57.827 INFO:teuthology.orchestra.run.smithi063.stdout: "completed_requests": 1, 2020-05-18T21:33:57.827 INFO:teuthology.orchestra.run.smithi063.stdout: "reconnecting": false, 2020-05-18T21:33:57.827 INFO:teuthology.orchestra.run.smithi063.stdout: "recall_caps": { 2020-05-18T21:33:57.827 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0, 2020-05-18T21:33:57.827 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 60 2020-05-18T21:33:57.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:57.828 INFO:teuthology.orchestra.run.smithi063.stdout: "release_caps": { 2020-05-18T21:33:57.828 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0, 2020-05-18T21:33:57.828 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 60 2020-05-18T21:33:57.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:57.829 INFO:teuthology.orchestra.run.smithi063.stdout: "recall_caps_throttle": { 2020-05-18T21:33:57.829 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0, 2020-05-18T21:33:57.829 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 2.5 2020-05-18T21:33:57.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:57.830 INFO:teuthology.orchestra.run.smithi063.stdout: "recall_caps_throttle2o": { 2020-05-18T21:33:57.830 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0, 2020-05-18T21:33:57.830 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 0.5 2020-05-18T21:33:57.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:57.830 INFO:teuthology.orchestra.run.smithi063.stdout: "session_cache_liveness": { 2020-05-18T21:33:57.831 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 4.9614237202795843, 2020-05-18T21:33:57.832 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 300 2020-05-18T21:33:57.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:57.832 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": "client.8542 192.168.0.1:0/1381514735", 2020-05-18T21:33:57.832 INFO:teuthology.orchestra.run.smithi063.stdout: "completed_requests": [ 2020-05-18T21:33:57.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:57.833 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 10, 2020-05-18T21:33:57.834 INFO:teuthology.orchestra.run.smithi063.stdout: "created_ino": "0x0" 2020-05-18T21:33:57.834 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:57.834 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:33:57.834 INFO:teuthology.orchestra.run.smithi063.stdout: "prealloc_inos": [ 2020-05-18T21:33:57.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:57.835 INFO:teuthology.orchestra.run.smithi063.stdout: "start": "0x10000000001", 2020-05-18T21:33:57.835 INFO:teuthology.orchestra.run.smithi063.stdout: "length": 1000 2020-05-18T21:33:57.835 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:57.835 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:33:57.835 INFO:teuthology.orchestra.run.smithi063.stdout: "used_inos": [], 2020-05-18T21:33:57.836 INFO:teuthology.orchestra.run.smithi063.stdout: "client_metadata": { 2020-05-18T21:33:57.836 INFO:teuthology.orchestra.run.smithi063.stdout: "client_features": { 2020-05-18T21:33:57.836 INFO:teuthology.orchestra.run.smithi063.stdout: "feature_bits": "0x0000000000003fff" 2020-05-18T21:33:57.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:57.837 INFO:teuthology.orchestra.run.smithi063.stdout: "metric_spec": { 2020-05-18T21:33:57.837 INFO:teuthology.orchestra.run.smithi063.stdout: "metric_flags": { 2020-05-18T21:33:57.837 INFO:teuthology.orchestra.run.smithi063.stdout: "feature_bits": "0x" 2020-05-18T21:33:57.837 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:57.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:57.838 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:33:57.838 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:33:57.838 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:33:57.838 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:33:57.839 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:33:57.839 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "32256", 2020-05-18T21:33:57.839 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:33:57.839 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:57.839 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:57.840 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:33:57.841 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 8542, "entity": { "name": { "type": "client", "num": 8542 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 1381514735 } }, "state": "open", "num_leases": 1, "num_caps": 2, "request_load_avg": 9, "uptime": 4.9638432320000003, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 4.9614237202795843, "halflife": 300 }, "inst": "client.8542 192.168.0.1:0/1381514735", "completed_requests": [ { "tid": 10, "created_ino": "0x0" } ], "prealloc_inos": [ { "start": "0x10000000001", "length": 1000 } ], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", "entity_id": "0", "hostname": "smithi063", "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "32256", "root": "/" } } ] 2020-05-18T21:33:57.841 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_data ls 2020-05-18T21:33:57.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.871+0000 7ffa2a4b9b80 1 Processor -- start 2020-05-18T21:33:57.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.871+0000 7ffa2a4b9b80 1 -- start start 2020-05-18T21:33:57.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.871+0000 7ffa2a4b9b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x560be6434570 0x560be64165c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:57.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.871+0000 7ffa2a4b9b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x560be6434e10 0x560be64b9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:57.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.871+0000 7ffa2a4b9b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x560be6398d20 con 0x560be64bae70 2020-05-18T21:33:57.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.871+0000 7ffa2a4b9b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x560be6370a40 con 0x560be6434570 2020-05-18T21:33:57.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.871+0000 7ffa2a4b9b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x560be63f5470 con 0x560be6434e10 2020-05-18T21:33:57.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.871+0000 7ffa288fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x560be6434570 0x560be64165c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.871+0000 7ffa280fb700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x560be6434e10 0x560be64b9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.871+0000 7ffa290fd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x560be64bae70 0x560be64c3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35300/0 (socket says 172.21.15.63:35300) 2020-05-18T21:33:57.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.871+0000 7ffa290fd700 1 -- 172.21.15.63:0/1888437523 learned_addr learned my addr 172.21.15.63:0/1888437523 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:57.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa288fc700 1 -- 172.21.15.63:0/1888437523 >> v2:172.21.15.155:3300/0 conn(0x560be6434e10 msgr2=0x560be64b9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:33:57.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa288fc700 1 --2- 172.21.15.63:0/1888437523 >> v2:172.21.15.155:3300/0 conn(0x560be6434e10 0x560be64b9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:57.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa288fc700 1 -- 172.21.15.63:0/1888437523 >> v1:172.21.15.63:6789/0 conn(0x560be64bae70 legacy=0x560be64c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa288fc700 1 -- 172.21.15.63:0/1888437523 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560be63944b0 con 0x560be6434570 2020-05-18T21:33:57.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa288fc700 1 --2- 172.21.15.63:0/1888437523 >> v2:172.21.15.63:3300/0 conn(0x560be6434570 0x560be64165c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffa18002f70 tx=0x7ffa18006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa288fc700 1 --2- 172.21.15.63:0/1888437523 >> v2:172.21.15.63:3300/0 conn(0x560be6434570 0x560be64165c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffa18002f70 tx=0x7ffa18006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa288fc700 1 --2- 172.21.15.63:0/1888437523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560be6434570 0x560be64165c0 secure :-1 s=READY pgs=1566 cs=0 l=1 rx=0x7ffa18002f70 tx=0x7ffa18006620).ready entity=mon.0 client_cookie=8f855081b4bde8b1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:57.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa288fc700 1 --2- 172.21.15.63:0/1888437523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560be6434570 0x560be64165c0 secure :-1 s=THROTTLE_DONE pgs=1566 cs=0 l=1 rx=0x7ffa18002f70 tx=0x7ffa18006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa268f8700 1 -- 172.21.15.63:0/1888437523 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa18007450 con 0x560be6434570 2020-05-18T21:33:57.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa288fc700 1 --2- 172.21.15.63:0/1888437523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560be6434570 0x560be64165c0 secure :-1 s=THROTTLE_DONE pgs=1566 cs=0 l=1 rx=0x7ffa18002f70 tx=0x7ffa18006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa268f8700 1 -- 172.21.15.63:0/1888437523 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1800b370 con 0x560be6434570 2020-05-18T21:33:57.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa288fc700 1 --2- 172.21.15.63:0/1888437523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560be6434570 0x560be64165c0 secure :-1 s=THROTTLE_DONE pgs=1566 cs=0 l=1 rx=0x7ffa18002f70 tx=0x7ffa18006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa2a4b9b80 1 -- 172.21.15.63:0/1888437523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560be6434570 msgr2=0x560be64165c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa268f8700 1 -- 172.21.15.63:0/1888437523 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa1800b710 con 0x560be6434570 2020-05-18T21:33:57.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa2a4b9b80 1 --2- 172.21.15.63:0/1888437523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560be6434570 0x560be64165c0 secure :-1 s=READY pgs=1566 cs=0 l=1 rx=0x7ffa18002f70 tx=0x7ffa18006620).stop 2020-05-18T21:33:57.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa2a4b9b80 1 -- 172.21.15.63:0/1888437523 shutdown_connections 2020-05-18T21:33:57.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa2a4b9b80 1 --2- 172.21.15.63:0/1888437523 >> v2:172.21.15.155:3300/0 conn(0x560be6434e10 0x560be64b9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:33:57.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa2a4b9b80 1 --2- 172.21.15.63:0/1888437523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560be6434570 0x560be64165c0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:57.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa2a4b9b80 1 -- 172.21.15.63:0/1888437523 >> 172.21.15.63:0/1888437523 conn(0x560be6435640 msgr2=0x560be63de9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:57.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa2a4b9b80 1 -- 172.21.15.63:0/1888437523 shutdown_connections 2020-05-18T21:33:57.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa2a4b9b80 1 -- 172.21.15.63:0/1888437523 wait complete. 2020-05-18T21:33:57.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa2a4b9b80 1 Processor -- start 2020-05-18T21:33:57.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.875+0000 7ffa2a4b9b80 1 -- start start 2020-05-18T21:33:57.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa2a4b9b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x560be6434570 0x560be64b9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:57.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa2a4b9b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560be6434e10 0x560be64b81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:57.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa2a4b9b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x560be6374460 con 0x560be64bae70 2020-05-18T21:33:57.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa2a4b9b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x560be6430b50 con 0x560be6434570 2020-05-18T21:33:57.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa2a4b9b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x560be6430df0 con 0x560be6434e10 2020-05-18T21:33:57.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa288fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x560be6434570 0x560be64b9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa290fd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x560be64bae70 0x560be64cf5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35306/0 (socket says 172.21.15.63:35306) 2020-05-18T21:33:57.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa290fd700 1 -- 172.21.15.63:0/3602458881 learned_addr learned my addr 172.21.15.63:0/3602458881 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:57.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa288fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x560be6434570 0x560be64b9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33116/0 (socket says 172.21.15.63:33116) 2020-05-18T21:33:57.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa280fb700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560be6434e10 0x560be64b81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa288fc700 1 -- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560be6434e10 msgr2=0x560be64b81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa288fc700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x560be6434e10 0x560be64b81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:57.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa260f7700 1 -- 172.21.15.63:0/3602458881 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151507228 0 0) 0x560be6374460 con 0x560be64bae70 2020-05-18T21:33:57.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa288fc700 1 -- 172.21.15.63:0/3602458881 >> v1:172.21.15.63:6789/0 conn(0x560be64bae70 legacy=0x560be64cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa288fc700 1 -- 172.21.15.63:0/3602458881 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560be6431090 con 0x560be6434570 2020-05-18T21:33:57.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa288fc700 1 --2- 172.21.15.63:0/3602458881 >> v2:172.21.15.63:3300/0 conn(0x560be6434570 0x560be64b9e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffa18002f70 tx=0x7ffa18006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa288fc700 1 --2- 172.21.15.63:0/3602458881 >> v2:172.21.15.63:3300/0 conn(0x560be6434570 0x560be64b9e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffa18002f70 tx=0x7ffa18006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa288fc700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560be6434570 0x560be64b9e40 secure :-1 s=READY pgs=1568 cs=0 l=1 rx=0x7ffa18002f70 tx=0x7ffa18006620).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:57.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa288fc700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560be6434570 0x560be64b9e40 secure :-1 s=THROTTLE_DONE pgs=1568 cs=0 l=1 rx=0x7ffa18002f70 tx=0x7ffa18006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa260f7700 1 -- 172.21.15.63:0/3602458881 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa1800b790 con 0x560be6434570 2020-05-18T21:33:57.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa288fc700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560be6434570 0x560be64b9e40 secure :-1 s=THROTTLE_DONE pgs=1568 cs=0 l=1 rx=0x7ffa18002f70 tx=0x7ffa18006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa288fc700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560be6434570 0x560be64b9e40 secure :-1 s=THROTTLE_DONE pgs=1568 cs=0 l=1 rx=0x7ffa18002f70 tx=0x7ffa18006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa260f7700 1 -- 172.21.15.63:0/3602458881 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1800c860 con 0x560be6434570 2020-05-18T21:33:57.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa2a4b9b80 1 -- 172.21.15.63:0/3602458881 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560be6430840 con 0x560be6434570 2020-05-18T21:33:57.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa260f7700 1 -- 172.21.15.63:0/3602458881 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa1800cbc0 con 0x560be6434570 2020-05-18T21:33:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa2a4b9b80 1 -- 172.21.15.63:0/3602458881 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560be64cfce0 con 0x560be6434570 2020-05-18T21:33:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.879+0000 7ffa288fc700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560be6434570 0x560be64b9e40 secure :-1 s=THROTTLE_DONE pgs=1568 cs=0 l=1 rx=0x7ffa18002f70 tx=0x7ffa18006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.883+0000 7ffa260f7700 1 -- 172.21.15.63:0/3602458881 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ffa1800cd70 con 0x560be6434570 2020-05-18T21:33:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.883+0000 7ffa288fc700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560be6434570 0x560be64b9e40 secure :-1 s=THROTTLE_DONE pgs=1568 cs=0 l=1 rx=0x7ffa18002f70 tx=0x7ffa18006620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.883+0000 7ffa260f7700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffa0804e3e0 0x7ffa080508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:57.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.883+0000 7ffa260f7700 1 -- 172.21.15.63:0/3602458881 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffa1801a070 con 0x560be6434570 2020-05-18T21:33:57.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.883+0000 7ffa2a4b9b80 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x560be64bf8b0 0x560be64bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:57.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.883+0000 7ffa280fb700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffa0804e3e0 0x7ffa080508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.883+0000 7ffa2a4b9b80 1 -- 172.21.15.63:0/3602458881 --> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] -- osd_op(unknown.0.0:1 22.0 22:00000000::::head [pgnls start_epoch 114 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e114) v8 -- 0x560be64dcbb0 con 0x560be64bf8b0 2020-05-18T21:33:57.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.883+0000 7ffa280fb700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffa0804e3e0 0x7ffa080508a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffa10002f70 tx=0x7ffa1000a5a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.883+0000 7ffa290fd700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x560be64bf8b0 0x560be64bfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.883+0000 7ffa280fb700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffa0804e3e0 0x7ffa080508a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffa10002f70 tx=0x7ffa1000a5a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:57.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.883+0000 7ffa280fb700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffa0804e3e0 0x7ffa080508a0 secure :-1 s=READY pgs=609 cs=0 l=1 rx=0x7ffa10002f70 tx=0x7ffa1000a5a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:57.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.883+0000 7ffa290fd700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x560be64bf8b0 0x560be64bfcf0 crc :-1 s=READY pgs=25 cs=0 l=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:57.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.887+0000 7ffa290fd700 1 -- 172.21.15.63:0/3602458881 <== osd.4 v2:172.21.15.155:6800/13023 1 ==== osd_op_reply(1 [pgnls start_epoch 114 out=81b] v114'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x7ffa20004620 con 0x560be64bf8b0 2020-05-18T21:33:57.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.887+0000 7ffa290fd700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7ffa20001540 0x7ffa20001980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:57.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.887+0000 7ffa290fd700 1 -- 172.21.15.63:0/3602458881 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- osd_op(unknown.0.0:2 22.4 22:20000000::::head [pgnls start_epoch 114 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e114) v8 -- 0x560be64dcbb0 con 0x7ffa20001540 2020-05-18T21:33:57.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.887+0000 7ffa288fc700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7ffa20001540 0x7ffa20001980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.887+0000 7ffa288fc700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7ffa20001540 0x7ffa20001980 crc :-1 s=READY pgs=25 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:57.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.887+0000 7ffa288fc700 1 -- 172.21.15.63:0/3602458881 <== osd.3 v2:172.21.15.63:6814/12805 1 ==== osd_op_reply(2 [pgnls start_epoch 114 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa18040410 con 0x7ffa20001540 2020-05-18T21:33:57.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.887+0000 7ffa288fc700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7ffa18041560 0x7ffa180406d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:57.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.887+0000 7ffa288fc700 1 -- 172.21.15.63:0/3602458881 --> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] -- osd_op(unknown.0.0:3 22.2 22:40000000::::head [pgnls start_epoch 114 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e114) v8 -- 0x560be64dcbb0 con 0x7ffa18041560 2020-05-18T21:33:57.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.887+0000 7ffa280fb700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7ffa18041560 0x7ffa180406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.887+0000 7ffa280fb700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7ffa18041560 0x7ffa180406d0 crc :-1 s=READY pgs=29 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:57.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.887+0000 7ffa280fb700 1 -- 172.21.15.63:0/3602458881 <== osd.1 v2:172.21.15.63:6808/12804 1 ==== osd_op_reply(3 [pgnls start_epoch 114 out=81b] v114'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x7ffa1000c650 con 0x7ffa18041560 2020-05-18T21:33:57.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.887+0000 7ffa280fb700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7ffa10002500 0x7ffa10002940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:57.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.887+0000 7ffa280fb700 1 -- 172.21.15.63:0/3602458881 --> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] -- osd_op(unknown.0.0:4 22.6 22:60000000::::head [pgnls start_epoch 114 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e114) v8 -- 0x560be64dcbb0 con 0x7ffa10002500 2020-05-18T21:33:57.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.891+0000 7ffa290fd700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7ffa10002500 0x7ffa10002940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.891+0000 7ffa290fd700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7ffa10002500 0x7ffa10002940 crc :-1 s=READY pgs=28 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:57.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.891+0000 7ffa290fd700 1 -- 172.21.15.63:0/3602458881 <== osd.5 v2:172.21.15.155:6808/13024 1 ==== osd_op_reply(4 [pgnls start_epoch 114 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa20004620 con 0x7ffa10002500 2020-05-18T21:33:57.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.891+0000 7ffa290fd700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7ffa20005570 0x7ffa20005990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:57.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.891+0000 7ffa290fd700 1 -- 172.21.15.63:0/3602458881 --> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] -- osd_op(unknown.0.0:5 22.1 22:80000000::::head [pgnls start_epoch 114 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e114) v8 -- 0x560be64dcbb0 con 0x7ffa20005570 2020-05-18T21:33:57.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.891+0000 7ffa288fc700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7ffa20005570 0x7ffa20005990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:57.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.891+0000 7ffa288fc700 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7ffa20005570 0x7ffa20005990 crc :-1 s=READY pgs=28 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:57.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.895+0000 7ffa288fc700 1 -- 172.21.15.63:0/3602458881 <== osd.6 v2:172.21.15.155:6815/13025 1 ==== osd_op_reply(5 [pgnls start_epoch 114 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa18040410 con 0x7ffa20005570 2020-05-18T21:33:57.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.895+0000 7ffa288fc700 1 -- 172.21.15.63:0/3602458881 --> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] -- osd_op(unknown.0.0:6 22.5 22:a0000000::::head [pgnls start_epoch 114 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e114) v8 -- 0x560be64dcbb0 con 0x7ffa20005570 2020-05-18T21:33:57.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.895+0000 7ffa288fc700 1 -- 172.21.15.63:0/3602458881 <== osd.6 v2:172.21.15.155:6815/13025 2 ==== osd_op_reply(6 [pgnls start_epoch 114 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa18040410 con 0x7ffa20005570 2020-05-18T21:33:57.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.895+0000 7ffa288fc700 1 -- 172.21.15.63:0/3602458881 --> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] -- osd_op(unknown.0.0:7 22.3 22:c0000000::::head [pgnls start_epoch 114 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e114) v8 -- 0x560be64dcbb0 con 0x560be64bf8b0 2020-05-18T21:33:57.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa290fd700 1 -- 172.21.15.63:0/3602458881 <== osd.4 v2:172.21.15.155:6800/13023 2 ==== osd_op_reply(7 [pgnls start_epoch 114 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa20004620 con 0x560be64bf8b0 2020-05-18T21:33:57.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa290fd700 1 -- 172.21.15.63:0/3602458881 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- osd_op(unknown.0.0:8 22.7 22:e0000000::::head [pgnls start_epoch 114 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e114) v8 -- 0x560be64dcbb0 con 0x7ffa20001540 2020-05-18T21:33:57.911 INFO:teuthology.orchestra.run.smithi063.stdout:10000000000.00000000 2020-05-18T21:33:57.911 INFO:teuthology.orchestra.run.smithi063.stdout:10000000000.00000001 2020-05-18T21:33:57.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa288fc700 1 -- 172.21.15.63:0/3602458881 <== osd.3 v2:172.21.15.63:6814/12805 2 ==== osd_op_reply(8 [pgnls start_epoch 114 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa18040410 con 0x7ffa20001540 2020-05-18T21:33:57.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 -- 172.21.15.63:0/3602458881 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7ffa18041560 msgr2=0x7ffa180406d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7ffa18041560 0x7ffa180406d0 crc :-1 s=READY pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:57.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 -- 172.21.15.63:0/3602458881 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7ffa20001540 msgr2=0x7ffa20001980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7ffa20001540 0x7ffa20001980 crc :-1 s=READY pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:57.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 -- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x560be64bf8b0 msgr2=0x560be64bfcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x560be64bf8b0 0x560be64bfcf0 crc :-1 s=READY pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:57.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 -- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7ffa10002500 msgr2=0x7ffa10002940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7ffa10002500 0x7ffa10002940 crc :-1 s=READY pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:57.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 -- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7ffa20005570 msgr2=0x7ffa20005990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7ffa20005570 0x7ffa20005990 crc :-1 s=READY pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:57.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa290fd700 1 -- 172.21.15.63:0/3602458881 reap_dead start 2020-05-18T21:33:57.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa290fd700 1 -- 172.21.15.63:0/3602458881 reap_dead start 2020-05-18T21:33:57.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa290fd700 1 -- 172.21.15.63:0/3602458881 reap_dead start 2020-05-18T21:33:57.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 -- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffa0804e3e0 msgr2=0x7ffa080508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffa0804e3e0 0x7ffa080508a0 secure :-1 s=READY pgs=609 cs=0 l=1 rx=0x7ffa10002f70 tx=0x7ffa1000a5a0).stop 2020-05-18T21:33:57.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 -- 172.21.15.63:0/3602458881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560be6434570 msgr2=0x560be64b9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:57.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560be6434570 0x560be64b9e40 secure :-1 s=READY pgs=1568 cs=0 l=1 rx=0x7ffa18002f70 tx=0x7ffa18006620).stop 2020-05-18T21:33:57.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 -- 172.21.15.63:0/3602458881 shutdown_connections 2020-05-18T21:33:57.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffa0804e3e0 0x7ffa080508a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:57.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 --2- 172.21.15.63:0/3602458881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560be6434570 0x560be64b9e40 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:57.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 -- 172.21.15.63:0/3602458881 >> 172.21.15.63:0/3602458881 conn(0x560be6435640 msgr2=0x560be64165c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:57.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 -- 172.21.15.63:0/3602458881 shutdown_connections 2020-05-18T21:33:57.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:57.907+0000 7ffa2a4b9b80 1 -- 172.21.15.63:0/3602458881 wait complete. 2020-05-18T21:33:57.917 INFO:tasks.cephfs.filesystem:All objects for ino 1099511627776 size 8388608 found 2020-05-18T21:33:57.930 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:33:58.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd5aa89700 1 Processor -- start 2020-05-18T21:33:58.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd5aa89700 1 -- start start 2020-05-18T21:33:58.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd5aa89700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbd540b93f0 0x7fbd54145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:33:58.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd5aa89700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd540b7020 con 0x7fbd540b7ca0 2020-05-18T21:33:58.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd5aa89700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd540b72c0 con 0x7fbd541435a0 2020-05-18T21:33:58.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd5aa89700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd540b7560 con 0x7fbd540b93f0 2020-05-18T21:33:58.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd59a87700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbd540b93f0 0x7fbd54145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:58.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd59286700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbd540b7ca0 0x7fbd54142e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35320/0 (socket says 172.21.15.63:35320) 2020-05-18T21:33:58.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd59286700 1 -- 172.21.15.63:0/3861267404 learned_addr learned my addr 172.21.15.63:0/3861267404 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:33:58.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd59a87700 1 -- 172.21.15.63:0/3861267404 >> v1:172.21.15.155:6789/0 conn(0x7fbd541435a0 legacy=0x7fbd54060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:58.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd59a87700 1 -- 172.21.15.63:0/3861267404 >> v1:172.21.15.63:6789/0 conn(0x7fbd540b7ca0 legacy=0x7fbd54142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:58.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd59a87700 1 -- 172.21.15.63:0/3861267404 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd540b7800 con 0x7fbd540b93f0 2020-05-18T21:33:58.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd59a87700 1 --2- 172.21.15.63:0/3861267404 >> v2:172.21.15.63:3300/0 conn(0x7fbd540b93f0 0x7fbd54145df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbd44002f70 tx=0x7fbd44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:58.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd59a87700 1 --2- 172.21.15.63:0/3861267404 >> v2:172.21.15.63:3300/0 conn(0x7fbd540b93f0 0x7fbd54145df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbd44002f70 tx=0x7fbd44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:58.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd59a87700 1 --2- 172.21.15.63:0/3861267404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd540b93f0 0x7fbd54145df0 secure :-1 s=READY pgs=1570 cs=0 l=1 rx=0x7fbd44002f70 tx=0x7fbd44007a80).ready entity=mon.0 client_cookie=353da901f14f9a7d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:58.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd59a87700 1 --2- 172.21.15.63:0/3861267404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd540b93f0 0x7fbd54145df0 secure :-1 s=THROTTLE_DONE pgs=1570 cs=0 l=1 rx=0x7fbd44002f70 tx=0x7fbd44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:58.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd58a85700 1 -- 172.21.15.63:0/3861267404 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd44008e80 con 0x7fbd540b93f0 2020-05-18T21:33:58.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd59a87700 1 --2- 172.21.15.63:0/3861267404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd540b93f0 0x7fbd54145df0 secure :-1 s=THROTTLE_DONE pgs=1570 cs=0 l=1 rx=0x7fbd44002f70 tx=0x7fbd44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:58.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd58a85700 1 -- 172.21.15.63:0/3861267404 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd440116a0 con 0x7fbd540b93f0 2020-05-18T21:33:58.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd59a87700 1 --2- 172.21.15.63:0/3861267404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd540b93f0 0x7fbd54145df0 secure :-1 s=THROTTLE_DONE pgs=1570 cs=0 l=1 rx=0x7fbd44002f70 tx=0x7fbd44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:58.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd58a85700 1 -- 172.21.15.63:0/3861267404 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd44011ac0 con 0x7fbd540b93f0 2020-05-18T21:33:58.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd5aa89700 1 -- 172.21.15.63:0/3861267404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd540b93f0 msgr2=0x7fbd54145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:58.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.083+0000 7fbd5aa89700 1 --2- 172.21.15.63:0/3861267404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd540b93f0 0x7fbd54145df0 secure :-1 s=READY pgs=1570 cs=0 l=1 rx=0x7fbd44002f70 tx=0x7fbd44007a80).stop 2020-05-18T21:33:58.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.087+0000 7fbd5aa89700 1 -- 172.21.15.63:0/3861267404 shutdown_connections 2020-05-18T21:33:58.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.087+0000 7fbd5aa89700 1 --2- 172.21.15.63:0/3861267404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd540b93f0 0x7fbd54145df0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:58.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.087+0000 7fbd5aa89700 1 -- 172.21.15.63:0/3861267404 >> 172.21.15.63:0/3861267404 conn(0x7fbd54069b70 msgr2=0x7fbd54069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:58.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.087+0000 7fbd5aa89700 1 -- 172.21.15.63:0/3861267404 shutdown_connections 2020-05-18T21:33:58.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.087+0000 7fbd5aa89700 1 -- 172.21.15.63:0/3861267404 wait complete. 2020-05-18T21:33:58.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.087+0000 7fbd5aa89700 1 Processor -- start 2020-05-18T21:33:58.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.087+0000 7fbd5aa89700 1 -- start start 2020-05-18T21:33:58.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.087+0000 7fbd5aa89700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbd540b7ca0 0x7fbd54157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:58.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.087+0000 7fbd5aa89700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd540b93f0 0x7fbd540ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:58.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.087+0000 7fbd5aa89700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbd541435a0 0x7fbd54143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:58.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.087+0000 7fbd5aa89700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd540aec00 con 0x7fbd540b7ca0 2020-05-18T21:33:58.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.087+0000 7fbd5aa89700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd54144170 con 0x7fbd541435a0 2020-05-18T21:33:58.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.087+0000 7fbd5aa89700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540addc0 con 0x7fbd540b93f0 2020-05-18T21:33:58.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.087+0000 7fbd59a87700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbd540b7ca0 0x7fbd54157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:58.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd59a87700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbd540b7ca0 0x7fbd54157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33138/0 (socket says 172.21.15.63:33138) 2020-05-18T21:33:58.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd59a87700 1 -- 172.21.15.63:0/1221791472 learned_addr learned my addr 172.21.15.63:0/1221791472 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:33:58.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd59286700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd540b93f0 0x7fbd540ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:58.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd5a288700 1 --2- 172.21.15.63:0/1221791472 >> v2:172.21.15.155:3300/0 conn(0x7fbd541435a0 0x7fbd54143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:58.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd59a87700 1 -- 172.21.15.63:0/1221791472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd540b93f0 msgr2=0x7fbd540ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:58.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd59a87700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd540b93f0 0x7fbd540ae7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:58.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd59a87700 1 -- 172.21.15.63:0/1221791472 >> v2:172.21.15.155:3300/0 conn(0x7fbd541435a0 msgr2=0x7fbd54143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:58.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd59a87700 1 --2- 172.21.15.63:0/1221791472 >> v2:172.21.15.155:3300/0 conn(0x7fbd541435a0 0x7fbd54143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:58.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd59a87700 1 -- 172.21.15.63:0/1221791472 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd540ae060 con 0x7fbd540b7ca0 2020-05-18T21:33:58.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd59286700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd540b93f0 0x7fbd540ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:33:58.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd59a87700 1 --2- 172.21.15.63:0/1221791472 >> v2:172.21.15.63:3300/0 conn(0x7fbd540b7ca0 0x7fbd54157080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd44002f70 tx=0x7fbd44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:58.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd59a87700 1 --2- 172.21.15.63:0/1221791472 >> v2:172.21.15.63:3300/0 conn(0x7fbd540b7ca0 0x7fbd54157080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd44002f70 tx=0x7fbd44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:58.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd59a87700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd540b7ca0 0x7fbd54157080 secure :-1 s=READY pgs=1571 cs=0 l=1 rx=0x7fbd44002f70 tx=0x7fbd44007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:58.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd59a87700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd540b7ca0 0x7fbd54157080 secure :-1 s=THROTTLE_DONE pgs=1571 cs=0 l=1 rx=0x7fbd44002f70 tx=0x7fbd44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:58.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd59a87700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd540b7ca0 0x7fbd54157080 secure :-1 s=THROTTLE_DONE pgs=1571 cs=0 l=1 rx=0x7fbd44002f70 tx=0x7fbd44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:58.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd59a87700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd540b7ca0 0x7fbd54157080 secure :-1 s=THROTTLE_DONE pgs=1571 cs=0 l=1 rx=0x7fbd44002f70 tx=0x7fbd44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:58.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd52ffd700 1 -- 172.21.15.63:0/1221791472 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd44007360 con 0x7fbd540b7ca0 2020-05-18T21:33:58.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd52ffd700 1 -- 172.21.15.63:0/1221791472 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd440074c0 con 0x7fbd540b7ca0 2020-05-18T21:33:58.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd5aa89700 1 -- 172.21.15.63:0/1221791472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd540ae300 con 0x7fbd540b7ca0 2020-05-18T21:33:58.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd52ffd700 1 -- 172.21.15.63:0/1221791472 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd440058f0 con 0x7fbd540b7ca0 2020-05-18T21:33:58.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd5aa89700 1 -- 172.21.15.63:0/1221791472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd540ac4d0 con 0x7fbd540b7ca0 2020-05-18T21:33:58.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd59a87700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd540b7ca0 0x7fbd54157080 secure :-1 s=THROTTLE_DONE pgs=1571 cs=0 l=1 rx=0x7fbd44002f70 tx=0x7fbd44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:58.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd5aa89700 1 -- 172.21.15.63:0/1221791472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd540569e0 con 0x7fbd540b7ca0 2020-05-18T21:33:58.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd52ffd700 1 -- 172.21.15.63:0/1221791472 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fbd44005b60 con 0x7fbd540b7ca0 2020-05-18T21:33:58.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.091+0000 7fbd59a87700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd540b7ca0 0x7fbd54157080 secure :-1 s=THROTTLE_DONE pgs=1571 cs=0 l=1 rx=0x7fbd44002f70 tx=0x7fbd44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:58.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.095+0000 7fbd52ffd700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbd3404fac0 0x7fbd34051f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:33:58.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.095+0000 7fbd52ffd700 1 -- 172.21.15.63:0/1221791472 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbd44064630 con 0x7fbd540b7ca0 2020-05-18T21:33:58.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.095+0000 7fbd59286700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbd3404fac0 0x7fbd34051f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:33:58.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.095+0000 7fbd59286700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbd3404fac0 0x7fbd34051f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd5406ab40 tx=0x7fbd4800cfb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:58.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.095+0000 7fbd59286700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbd3404fac0 0x7fbd34051f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd5406ab40 tx=0x7fbd4800cfb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:58.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.095+0000 7fbd59286700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbd3404fac0 0x7fbd34051f80 secure :-1 s=READY pgs=610 cs=0 l=1 rx=0x7fbd5406ab40 tx=0x7fbd4800cfb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:33:58.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.099+0000 7fbd59a87700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd540b7ca0 0x7fbd54157080 secure :-1 s=THROTTLE_DONE pgs=1571 cs=0 l=1 rx=0x7fbd44002f70 tx=0x7fbd44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:58.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.099+0000 7fbd52ffd700 1 -- 172.21.15.63:0/1221791472 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fbd4403e960 con 0x7fbd540b7ca0 2020-05-18T21:33:58.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.251+0000 7fbd5aa89700 1 -- 172.21.15.63:0/1221791472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd540ae490 con 0x7fbd540b7ca0 2020-05-18T21:33:58.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.251+0000 7fbd59a87700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd540b7ca0 0x7fbd54157080 secure :-1 s=THROTTLE_DONE pgs=1571 cs=0 l=1 rx=0x7fbd44002f70 tx=0x7fbd44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:33:58.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.251+0000 7fbd52ffd700 1 -- 172.21.15.63:0/1221791472 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fbd44041f80 con 0x7fbd540b7ca0 2020-05-18T21:33:58.254 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:33:58.255 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/911406335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":911406335},{"type":"v1","addr":"172.21.15.155:6835","nonce":911406335}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:46.613321+0000","modified":"2020-05-18T21:33:47.617221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8365":{"gid":8365,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/299278803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":299278803},{"type":"v1","addr":"172.21.15.63:6833","nonce":299278803}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-05-18T21:33:58.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.251+0000 7fbd5aa89700 1 -- 172.21.15.63:0/1221791472 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbd3404fac0 msgr2=0x7fbd34051f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:58.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.251+0000 7fbd5aa89700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbd3404fac0 0x7fbd34051f80 secure :-1 s=READY pgs=610 cs=0 l=1 rx=0x7fbd5406ab40 tx=0x7fbd4800cfb0).stop 2020-05-18T21:33:58.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.251+0000 7fbd5aa89700 1 -- 172.21.15.63:0/1221791472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd540b7ca0 msgr2=0x7fbd54157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:33:58.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.251+0000 7fbd5aa89700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd540b7ca0 0x7fbd54157080 secure :-1 s=READY pgs=1571 cs=0 l=1 rx=0x7fbd44002f70 tx=0x7fbd44007a80).stop 2020-05-18T21:33:58.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.251+0000 7fbd5aa89700 1 -- 172.21.15.63:0/1221791472 shutdown_connections 2020-05-18T21:33:58.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.251+0000 7fbd5aa89700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbd3404fac0 0x7fbd34051f80 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:58.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.251+0000 7fbd5aa89700 1 --2- 172.21.15.63:0/1221791472 >> v2:172.21.15.155:3300/0 conn(0x7fbd541435a0 0x7fbd54143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:58.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.251+0000 7fbd5aa89700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd540b93f0 0x7fbd540ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:58.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.251+0000 7fbd5aa89700 1 --2- 172.21.15.63:0/1221791472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd540b7ca0 0x7fbd54157080 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:33:58.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.251+0000 7fbd5aa89700 1 -- 172.21.15.63:0/1221791472 >> 172.21.15.63:0/1221791472 conn(0x7fbd54069b70 msgr2=0x7fbd54060b00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:33:58.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.251+0000 7fbd5aa89700 1 -- 172.21.15.63:0/1221791472 shutdown_connections 2020-05-18T21:33:58.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:33:58.251+0000 7fbd5aa89700 1 -- 172.21.15.63:0/1221791472 wait complete. 2020-05-18T21:33:58.259 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 86 2020-05-18T21:33:58.281 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok session ls 2020-05-18T21:33:58.387 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:33:58.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:58.387 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 8542, 2020-05-18T21:33:58.388 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": { 2020-05-18T21:33:58.388 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:33:58.388 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:33:58.388 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 8542 2020-05-18T21:33:58.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:58.389 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:33:58.389 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "any", 2020-05-18T21:33:58.389 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:33:58.389 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1381514735 2020-05-18T21:33:58.389 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:58.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:58.390 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "open", 2020-05-18T21:33:58.390 INFO:teuthology.orchestra.run.smithi063.stdout: "num_leases": 1, 2020-05-18T21:33:58.390 INFO:teuthology.orchestra.run.smithi063.stdout: "num_caps": 2, 2020-05-18T21:33:58.390 INFO:teuthology.orchestra.run.smithi063.stdout: "request_load_avg": 9, 2020-05-18T21:33:58.390 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 5.5278265280000003, 2020-05-18T21:33:58.391 INFO:teuthology.orchestra.run.smithi063.stdout: "requests_in_flight": 0, 2020-05-18T21:33:58.391 INFO:teuthology.orchestra.run.smithi063.stdout: "completed_requests": 1, 2020-05-18T21:33:58.391 INFO:teuthology.orchestra.run.smithi063.stdout: "reconnecting": false, 2020-05-18T21:33:58.391 INFO:teuthology.orchestra.run.smithi063.stdout: "recall_caps": { 2020-05-18T21:33:58.391 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0, 2020-05-18T21:33:58.391 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 60 2020-05-18T21:33:58.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:58.392 INFO:teuthology.orchestra.run.smithi063.stdout: "release_caps": { 2020-05-18T21:33:58.392 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0, 2020-05-18T21:33:58.392 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 60 2020-05-18T21:33:58.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:58.393 INFO:teuthology.orchestra.run.smithi063.stdout: "recall_caps_throttle": { 2020-05-18T21:33:58.393 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0, 2020-05-18T21:33:58.393 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 2.5 2020-05-18T21:33:58.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:58.393 INFO:teuthology.orchestra.run.smithi063.stdout: "recall_caps_throttle2o": { 2020-05-18T21:33:58.397 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0, 2020-05-18T21:33:58.398 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 0.5 2020-05-18T21:33:58.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:58.398 INFO:teuthology.orchestra.run.smithi063.stdout: "session_cache_liveness": { 2020-05-18T21:33:58.399 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 4.9549628081107908, 2020-05-18T21:33:58.399 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 300 2020-05-18T21:33:58.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:58.399 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": "client.8542 192.168.0.1:0/1381514735", 2020-05-18T21:33:58.399 INFO:teuthology.orchestra.run.smithi063.stdout: "completed_requests": [ 2020-05-18T21:33:58.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:58.402 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 10, 2020-05-18T21:33:58.402 INFO:teuthology.orchestra.run.smithi063.stdout: "created_ino": "0x0" 2020-05-18T21:33:58.404 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:58.404 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:33:58.404 INFO:teuthology.orchestra.run.smithi063.stdout: "prealloc_inos": [ 2020-05-18T21:33:58.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:33:58.405 INFO:teuthology.orchestra.run.smithi063.stdout: "start": "0x10000000001", 2020-05-18T21:33:58.405 INFO:teuthology.orchestra.run.smithi063.stdout: "length": 1000 2020-05-18T21:33:58.405 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:58.405 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:33:58.405 INFO:teuthology.orchestra.run.smithi063.stdout: "used_inos": [], 2020-05-18T21:33:58.406 INFO:teuthology.orchestra.run.smithi063.stdout: "client_metadata": { 2020-05-18T21:33:58.406 INFO:teuthology.orchestra.run.smithi063.stdout: "client_features": { 2020-05-18T21:33:58.406 INFO:teuthology.orchestra.run.smithi063.stdout: "feature_bits": "0x0000000000003fff" 2020-05-18T21:33:58.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:58.406 INFO:teuthology.orchestra.run.smithi063.stdout: "metric_spec": { 2020-05-18T21:33:58.407 INFO:teuthology.orchestra.run.smithi063.stdout: "metric_flags": { 2020-05-18T21:33:58.407 INFO:teuthology.orchestra.run.smithi063.stdout: "feature_bits": "0x" 2020-05-18T21:33:58.407 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:58.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:33:58.407 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:33:58.408 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:33:58.408 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:33:58.408 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:33:58.408 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:33:58.408 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "32256", 2020-05-18T21:33:58.409 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:33:58.409 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:58.409 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:33:58.409 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:33:58.410 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 8542, "entity": { "name": { "type": "client", "num": 8542 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 1381514735 } }, "state": "open", "num_leases": 1, "num_caps": 2, "request_load_avg": 9, "uptime": 5.5278265280000003, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 4.9549628081107908, "halflife": 300 }, "inst": "client.8542 192.168.0.1:0/1381514735", "completed_requests": [ { "tid": 10, "created_ino": "0x0" } ], "prealloc_inos": [ { "start": "0x10000000001", "length": 1000 } ], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", "entity_id": "0", "hostname": "smithi063", "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "32256", "root": "/" } } ] 2020-05-18T21:33:58.411 DEBUG:tasks.ceph_test_case:wait_until_equal: 2 != 1, waiting (timeout=60)... 2020-05-18T21:33:59.692 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:33:59.695 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:34:03.412 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:34:03.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.519+0000 7faae759e700 1 Processor -- start 2020-05-18T21:34:03.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.519+0000 7faae759e700 1 -- start start 2020-05-18T21:34:03.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faae8142bf0 0x7faae8065130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:03.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faae80acbe0 0x7faae80ad040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:03.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae8143090 con 0x7faae8061d80 2020-05-18T21:34:03.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae759e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae80b6b10 con 0x7faae8142bf0 2020-05-18T21:34:03.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae8143330 con 0x7faae80acbe0 2020-05-18T21:34:03.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae5d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faae8142bf0 0x7faae8065130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:03.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae5d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faae8142bf0 0x7faae8065130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33148/0 (socket says 172.21.15.63:33148) 2020-05-18T21:34:03.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae5d9b700 1 -- 172.21.15.63:0/1755307913 learned_addr learned my addr 172.21.15.63:0/1755307913 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:03.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae6d9d700 1 --2- 172.21.15.63:0/1755307913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faae80acbe0 0x7faae80ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:03.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae5d9b700 1 -- 172.21.15.63:0/1755307913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faae80acbe0 msgr2=0x7faae80ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:03.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae5d9b700 1 --2- 172.21.15.63:0/1755307913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faae80acbe0 0x7faae80ad040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:03.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae5d9b700 1 -- 172.21.15.63:0/1755307913 >> v1:172.21.15.155:6789/0 conn(0x7faae8061d80 legacy=0x7faae80ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:03.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae5d9b700 1 -- 172.21.15.63:0/1755307913 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae81435d0 con 0x7faae8142bf0 2020-05-18T21:34:03.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae5d9b700 1 --2- 172.21.15.63:0/1755307913 >> v2:172.21.15.63:3300/0 conn(0x7faae8142bf0 0x7faae8065130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faad00032f0 tx=0x7faad0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:03.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae5d9b700 1 --2- 172.21.15.63:0/1755307913 >> v2:172.21.15.63:3300/0 conn(0x7faae8142bf0 0x7faae8065130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faad00032f0 tx=0x7faad0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:03.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae5d9b700 1 --2- 172.21.15.63:0/1755307913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faae8142bf0 0x7faae8065130 secure :-1 s=READY pgs=1572 cs=0 l=1 rx=0x7faad00032f0 tx=0x7faad0007e00).ready entity=mon.0 client_cookie=e67644eea379b6f9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:03.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae5d9b700 1 --2- 172.21.15.63:0/1755307913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faae8142bf0 0x7faae8065130 secure :-1 s=THROTTLE_DONE pgs=1572 cs=0 l=1 rx=0x7faad00032f0 tx=0x7faad0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:03.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae559a700 1 -- 172.21.15.63:0/1755307913 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faad0011d10 con 0x7faae8142bf0 2020-05-18T21:34:03.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae5d9b700 1 --2- 172.21.15.63:0/1755307913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faae8142bf0 0x7faae8065130 secure :-1 s=THROTTLE_DONE pgs=1572 cs=0 l=1 rx=0x7faad00032f0 tx=0x7faad0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:03.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae559a700 1 -- 172.21.15.63:0/1755307913 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad0011e70 con 0x7faae8142bf0 2020-05-18T21:34:03.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae5d9b700 1 --2- 172.21.15.63:0/1755307913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faae8142bf0 0x7faae8065130 secure :-1 s=THROTTLE_DONE pgs=1572 cs=0 l=1 rx=0x7faad00032f0 tx=0x7faad0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:03.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae559a700 1 -- 172.21.15.63:0/1755307913 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faad000a370 con 0x7faae8142bf0 2020-05-18T21:34:03.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae759e700 1 -- 172.21.15.63:0/1755307913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faae8142bf0 msgr2=0x7faae8065130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:03.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae759e700 1 --2- 172.21.15.63:0/1755307913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faae8142bf0 0x7faae8065130 secure :-1 s=READY pgs=1572 cs=0 l=1 rx=0x7faad00032f0 tx=0x7faad0007e00).stop 2020-05-18T21:34:03.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae759e700 1 -- 172.21.15.63:0/1755307913 shutdown_connections 2020-05-18T21:34:03.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae759e700 1 --2- 172.21.15.63:0/1755307913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faae80acbe0 0x7faae80ad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:03.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae759e700 1 --2- 172.21.15.63:0/1755307913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faae8142bf0 0x7faae8065130 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:03.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae759e700 1 -- 172.21.15.63:0/1755307913 >> 172.21.15.63:0/1755307913 conn(0x7faae8066d00 msgr2=0x7faae805a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:03.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae759e700 1 -- 172.21.15.63:0/1755307913 shutdown_connections 2020-05-18T21:34:03.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.523+0000 7faae759e700 1 -- 172.21.15.63:0/1755307913 wait complete. 2020-05-18T21:34:03.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae759e700 1 Processor -- start 2020-05-18T21:34:03.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae759e700 1 -- start start 2020-05-18T21:34:03.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faae8061d80 0x7faae8141750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:03.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faae8142bf0 0x7faae8157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:03.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae8153ab0 con 0x7faae80acbe0 2020-05-18T21:34:03.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae759e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae8153d50 con 0x7faae8142bf0 2020-05-18T21:34:03.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae8153ff0 con 0x7faae8061d80 2020-05-18T21:34:03.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae6d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faae8142bf0 0x7faae8157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:03.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae6d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faae8142bf0 0x7faae8157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33156/0 (socket says 172.21.15.63:33156) 2020-05-18T21:34:03.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae6d9d700 1 -- 172.21.15.63:0/339278704 learned_addr learned my addr 172.21.15.63:0/339278704 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:03.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae659c700 1 --2- 172.21.15.63:0/339278704 >> v2:172.21.15.155:3300/0 conn(0x7faae8061d80 0x7faae8141750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:03.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae6d9d700 1 -- 172.21.15.63:0/339278704 >> v2:172.21.15.155:3300/0 conn(0x7faae8061d80 msgr2=0x7faae8141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:03.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae6d9d700 1 --2- 172.21.15.63:0/339278704 >> v2:172.21.15.155:3300/0 conn(0x7faae8061d80 0x7faae8141750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:03.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faadf7fe700 1 -- 172.21.15.63:0/339278704 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382581221 0 0) 0x7faae8153ab0 con 0x7faae80acbe0 2020-05-18T21:34:03.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae6d9d700 1 -- 172.21.15.63:0/339278704 >> v1:172.21.15.63:6789/0 conn(0x7faae80acbe0 legacy=0x7faae8156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:03.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae6d9d700 1 -- 172.21.15.63:0/339278704 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae80b3a20 con 0x7faae8142bf0 2020-05-18T21:34:03.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae6d9d700 1 --2- 172.21.15.63:0/339278704 >> v2:172.21.15.63:3300/0 conn(0x7faae8142bf0 0x7faae8157520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faae0002f70 tx=0x7faae0010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:03.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae6d9d700 1 --2- 172.21.15.63:0/339278704 >> v2:172.21.15.63:3300/0 conn(0x7faae8142bf0 0x7faae8157520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faae0002f70 tx=0x7faae0010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:03.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae6d9d700 1 --2- 172.21.15.63:0/339278704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faae8142bf0 0x7faae8157520 secure :-1 s=READY pgs=1574 cs=0 l=1 rx=0x7faae0002f70 tx=0x7faae0010bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:03.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae6d9d700 1 --2- 172.21.15.63:0/339278704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faae8142bf0 0x7faae8157520 secure :-1 s=THROTTLE_DONE pgs=1574 cs=0 l=1 rx=0x7faae0002f70 tx=0x7faae0010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:03.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faadf7fe700 1 -- 172.21.15.63:0/339278704 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faae0007550 con 0x7faae8142bf0 2020-05-18T21:34:03.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae6d9d700 1 --2- 172.21.15.63:0/339278704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faae8142bf0 0x7faae8157520 secure :-1 s=THROTTLE_DONE pgs=1574 cs=0 l=1 rx=0x7faae0002f70 tx=0x7faae0010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:03.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae6d9d700 1 --2- 172.21.15.63:0/339278704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faae8142bf0 0x7faae8157520 secure :-1 s=THROTTLE_DONE pgs=1574 cs=0 l=1 rx=0x7faae0002f70 tx=0x7faae0010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:03.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faadf7fe700 1 -- 172.21.15.63:0/339278704 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae0005700 con 0x7faae8142bf0 2020-05-18T21:34:03.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae759e700 1 -- 172.21.15.63:0/339278704 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae80b3c70 con 0x7faae8142bf0 2020-05-18T21:34:03.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faadf7fe700 1 -- 172.21.15.63:0/339278704 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faae0005aa0 con 0x7faae8142bf0 2020-05-18T21:34:03.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.527+0000 7faae759e700 1 -- 172.21.15.63:0/339278704 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae8153630 con 0x7faae8142bf0 2020-05-18T21:34:03.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.531+0000 7faae6d9d700 1 --2- 172.21.15.63:0/339278704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faae8142bf0 0x7faae8157520 secure :-1 s=THROTTLE_DONE pgs=1574 cs=0 l=1 rx=0x7faae0002f70 tx=0x7faae0010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:03.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.531+0000 7faae759e700 1 -- 172.21.15.63:0/339278704 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae8153910 con 0x7faae8142bf0 2020-05-18T21:34:03.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.531+0000 7faadf7fe700 1 -- 172.21.15.63:0/339278704 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7faae0005d10 con 0x7faae8142bf0 2020-05-18T21:34:03.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.531+0000 7faae6d9d700 1 --2- 172.21.15.63:0/339278704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faae8142bf0 0x7faae8157520 secure :-1 s=THROTTLE_DONE pgs=1574 cs=0 l=1 rx=0x7faae0002f70 tx=0x7faae0010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:03.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.531+0000 7faadf7fe700 1 --2- 172.21.15.63:0/339278704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faacc04f910 0x7faacc051dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:03.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.531+0000 7faadf7fe700 1 -- 172.21.15.63:0/339278704 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faae0063f20 con 0x7faae8142bf0 2020-05-18T21:34:03.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.531+0000 7faae659c700 1 --2- 172.21.15.63:0/339278704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faacc04f910 0x7faacc051dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:03.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.531+0000 7faae659c700 1 --2- 172.21.15.63:0/339278704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faacc04f910 0x7faacc051dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faae80ba680 tx=0x7faad8003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:03.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.531+0000 7faae659c700 1 --2- 172.21.15.63:0/339278704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faacc04f910 0x7faacc051dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faae80ba680 tx=0x7faad8003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:03.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.531+0000 7faae659c700 1 --2- 172.21.15.63:0/339278704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faacc04f910 0x7faacc051dd0 secure :-1 s=READY pgs=611 cs=0 l=1 rx=0x7faae80ba680 tx=0x7faad8003e60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:03.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.539+0000 7faae6d9d700 1 --2- 172.21.15.63:0/339278704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faae8142bf0 0x7faae8157520 secure :-1 s=THROTTLE_DONE pgs=1574 cs=0 l=1 rx=0x7faae0002f70 tx=0x7faae0010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:03.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.539+0000 7faadf7fe700 1 -- 172.21.15.63:0/339278704 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7faae8153910 con 0x7faae8142bf0 2020-05-18T21:34:03.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.687+0000 7faae759e700 1 -- 172.21.15.63:0/339278704 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faae8153910 con 0x7faae8142bf0 2020-05-18T21:34:03.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.691+0000 7faae6d9d700 1 --2- 172.21.15.63:0/339278704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faae8142bf0 0x7faae8157520 secure :-1 s=THROTTLE_DONE pgs=1574 cs=0 l=1 rx=0x7faae0002f70 tx=0x7faae0010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:03.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.691+0000 7faadf7fe700 1 -- 172.21.15.63:0/339278704 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+2139 (secure 0 0 0) 0x7faae8153910 con 0x7faae8142bf0 2020-05-18T21:34:03.694 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:03.694 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/911406335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":911406335},{"type":"v1","addr":"172.21.15.155:6835","nonce":911406335}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:46.613321+0000","modified":"2020-05-18T21:33:47.617221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8365":{"gid":8365,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/299278803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":299278803},{"type":"v1","addr":"172.21.15.63:6833","nonce":299278803}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-05-18T21:34:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.691+0000 7faae759e700 1 -- 172.21.15.63:0/339278704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faacc04f910 msgr2=0x7faacc051dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.691+0000 7faae759e700 1 --2- 172.21.15.63:0/339278704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faacc04f910 0x7faacc051dd0 secure :-1 s=READY pgs=611 cs=0 l=1 rx=0x7faae80ba680 tx=0x7faad8003e60).stop 2020-05-18T21:34:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.691+0000 7faae759e700 1 -- 172.21.15.63:0/339278704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faae8142bf0 msgr2=0x7faae8157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.691+0000 7faae759e700 1 --2- 172.21.15.63:0/339278704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faae8142bf0 0x7faae8157520 secure :-1 s=READY pgs=1574 cs=0 l=1 rx=0x7faae0002f70 tx=0x7faae0010bf0).stop 2020-05-18T21:34:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.691+0000 7faae759e700 1 -- 172.21.15.63:0/339278704 shutdown_connections 2020-05-18T21:34:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.691+0000 7faae759e700 1 --2- 172.21.15.63:0/339278704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faacc04f910 0x7faacc051dd0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.691+0000 7faae759e700 1 --2- 172.21.15.63:0/339278704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faae8142bf0 0x7faae8157520 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.691+0000 7faae759e700 1 --2- 172.21.15.63:0/339278704 >> v2:172.21.15.155:3300/0 conn(0x7faae8061d80 0x7faae8141750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.691+0000 7faae759e700 1 -- 172.21.15.63:0/339278704 >> 172.21.15.63:0/339278704 conn(0x7faae8066d00 msgr2=0x7faae81423e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.691+0000 7faae759e700 1 -- 172.21.15.63:0/339278704 shutdown_connections 2020-05-18T21:34:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:03.691+0000 7faae759e700 1 -- 172.21.15.63:0/339278704 wait complete. 2020-05-18T21:34:03.699 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 86 2020-05-18T21:34:03.711 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok session ls 2020-05-18T21:34:03.806 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:34:03.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:03.807 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 8542, 2020-05-18T21:34:03.807 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": { 2020-05-18T21:34:03.807 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:34:03.807 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:34:03.808 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 8542 2020-05-18T21:34:03.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:03.808 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:34:03.808 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "any", 2020-05-18T21:34:03.808 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:34:03.809 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1381514735 2020-05-18T21:34:03.809 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:03.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:03.809 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "open", 2020-05-18T21:34:03.809 INFO:teuthology.orchestra.run.smithi063.stdout: "num_leases": 1, 2020-05-18T21:34:03.809 INFO:teuthology.orchestra.run.smithi063.stdout: "num_caps": 2, 2020-05-18T21:34:03.810 INFO:teuthology.orchestra.run.smithi063.stdout: "request_load_avg": 8, 2020-05-18T21:34:03.810 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 10.947679179, 2020-05-18T21:34:03.810 INFO:teuthology.orchestra.run.smithi063.stdout: "requests_in_flight": 0, 2020-05-18T21:34:03.810 INFO:teuthology.orchestra.run.smithi063.stdout: "completed_requests": 1, 2020-05-18T21:34:03.810 INFO:teuthology.orchestra.run.smithi063.stdout: "reconnecting": false, 2020-05-18T21:34:03.811 INFO:teuthology.orchestra.run.smithi063.stdout: "recall_caps": { 2020-05-18T21:34:03.811 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0, 2020-05-18T21:34:03.811 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 60 2020-05-18T21:34:03.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:03.811 INFO:teuthology.orchestra.run.smithi063.stdout: "release_caps": { 2020-05-18T21:34:03.812 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0, 2020-05-18T21:34:03.812 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 60 2020-05-18T21:34:03.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:03.812 INFO:teuthology.orchestra.run.smithi063.stdout: "recall_caps_throttle": { 2020-05-18T21:34:03.812 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0, 2020-05-18T21:34:03.812 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 2.5 2020-05-18T21:34:03.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:03.813 INFO:teuthology.orchestra.run.smithi063.stdout: "recall_caps_throttle2o": { 2020-05-18T21:34:03.813 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0, 2020-05-18T21:34:03.813 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 0.5 2020-05-18T21:34:03.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:03.814 INFO:teuthology.orchestra.run.smithi063.stdout: "session_cache_liveness": { 2020-05-18T21:34:03.814 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 4.893301079965938, 2020-05-18T21:34:03.814 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 300 2020-05-18T21:34:03.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:03.814 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": "client.8542 192.168.0.1:0/1381514735", 2020-05-18T21:34:03.815 INFO:teuthology.orchestra.run.smithi063.stdout: "completed_requests": [ 2020-05-18T21:34:03.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:03.815 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 10, 2020-05-18T21:34:03.815 INFO:teuthology.orchestra.run.smithi063.stdout: "created_ino": "0x0" 2020-05-18T21:34:03.815 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:03.815 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:34:03.816 INFO:teuthology.orchestra.run.smithi063.stdout: "prealloc_inos": [ 2020-05-18T21:34:03.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:03.816 INFO:teuthology.orchestra.run.smithi063.stdout: "start": "0x10000000001", 2020-05-18T21:34:03.816 INFO:teuthology.orchestra.run.smithi063.stdout: "length": 1000 2020-05-18T21:34:03.817 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:03.817 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:34:03.817 INFO:teuthology.orchestra.run.smithi063.stdout: "used_inos": [], 2020-05-18T21:34:03.817 INFO:teuthology.orchestra.run.smithi063.stdout: "client_metadata": { 2020-05-18T21:34:03.817 INFO:teuthology.orchestra.run.smithi063.stdout: "client_features": { 2020-05-18T21:34:03.818 INFO:teuthology.orchestra.run.smithi063.stdout: "feature_bits": "0x0000000000003fff" 2020-05-18T21:34:03.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:03.818 INFO:teuthology.orchestra.run.smithi063.stdout: "metric_spec": { 2020-05-18T21:34:03.818 INFO:teuthology.orchestra.run.smithi063.stdout: "metric_flags": { 2020-05-18T21:34:03.818 INFO:teuthology.orchestra.run.smithi063.stdout: "feature_bits": "0x" 2020-05-18T21:34:03.819 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:03.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:03.819 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:34:03.819 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:34:03.819 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:34:03.819 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:34:03.820 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:34:03.820 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "32256", 2020-05-18T21:34:03.820 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:34:03.820 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:03.820 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:03.821 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:34:03.822 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 8542, "entity": { "name": { "type": "client", "num": 8542 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 1381514735 } }, "state": "open", "num_leases": 1, "num_caps": 2, "request_load_avg": 8, "uptime": 10.947679179, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 4.893301079965938, "halflife": 300 }, "inst": "client.8542 192.168.0.1:0/1381514735", "completed_requests": [ { "tid": 10, "created_ino": "0x0" } ], "prealloc_inos": [ { "start": "0x10000000001", "length": 1000 } ], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", "entity_id": "0", "hostname": "smithi063", "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "32256", "root": "/" } } ] 2020-05-18T21:34:03.822 DEBUG:tasks.ceph_test_case:wait_until_equal: 2 != 1, waiting (timeout=60)... 2020-05-18T21:34:08.824 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:34:08.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.931+0000 7f2aeb59e700 1 Processor -- start 2020-05-18T21:34:08.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2aeb59e700 1 -- start start 2020-05-18T21:34:08.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2aeb59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec1402e0 0x7f2aec0ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:08.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2aeb59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec0b0f40 con 0x7f2aec0b3000 2020-05-18T21:34:08.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2aeb59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec0b0410 con 0x7f2aec0b13a0 2020-05-18T21:34:08.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2aeb59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec1406c0 con 0x7f2aec1402e0 2020-05-18T21:34:08.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2ae9d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2aec0b3000 0x7f2aec05a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35350/0 (socket says 172.21.15.63:35350) 2020-05-18T21:34:08.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2ae9d9b700 1 -- 172.21.15.63:0/1349218192 learned_addr learned my addr 172.21.15.63:0/1349218192 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:08.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2aea59c700 1 --2- 172.21.15.63:0/1349218192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec1402e0 0x7f2aec0ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:08.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2ae959a700 1 -- 172.21.15.63:0/1349218192 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125447968 0 0) 0x7f2aec0b0f40 con 0x7f2aec0b3000 2020-05-18T21:34:08.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2ae959a700 1 -- 172.21.15.63:0/1349218192 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ad0003270 con 0x7f2aec0b3000 2020-05-18T21:34:08.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2ae959a700 1 -- 172.21.15.63:0/1349218192 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685828976 0 0) 0x7f2aec0b0410 con 0x7f2aec0b13a0 2020-05-18T21:34:08.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2ae959a700 1 -- 172.21.15.63:0/1349218192 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aec0b0f40 con 0x7f2aec0b13a0 2020-05-18T21:34:08.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2aea59c700 1 -- 172.21.15.63:0/1349218192 >> v1:172.21.15.155:6789/0 conn(0x7f2aec0b13a0 legacy=0x7f2aec142c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:08.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2aea59c700 1 -- 172.21.15.63:0/1349218192 >> v1:172.21.15.63:6789/0 conn(0x7f2aec0b3000 legacy=0x7f2aec05a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:08.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2ae959a700 1 -- 172.21.15.63:0/1349218192 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2755965011 0 0) 0x7f2ad0003270 con 0x7f2aec0b3000 2020-05-18T21:34:08.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2aea59c700 1 -- 172.21.15.63:0/1349218192 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec0b35f0 con 0x7f2aec1402e0 2020-05-18T21:34:08.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2aea59c700 1 --2- 172.21.15.63:0/1349218192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec1402e0 0x7f2aec0ac4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2ae0001110 tx=0x7f2adc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:08.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2aea59c700 1 --2- 172.21.15.63:0/1349218192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec1402e0 0x7f2aec0ac4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2ae0001110 tx=0x7f2adc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:08.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2aea59c700 1 --2- 172.21.15.63:0/1349218192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec1402e0 0x7f2aec0ac4d0 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7f2ae0001110 tx=0x7f2adc008ca0).ready entity=mon.2 client_cookie=5974f01d32ade363 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:08.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2aea59c700 1 --2- 172.21.15.63:0/1349218192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec1402e0 0x7f2aec0ac4d0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f2ae0001110 tx=0x7f2adc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:08.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2ae959a700 1 -- 172.21.15.63:0/1349218192 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ae0001710 con 0x7f2aec1402e0 2020-05-18T21:34:08.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2aea59c700 1 --2- 172.21.15.63:0/1349218192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec1402e0 0x7f2aec0ac4d0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f2ae0001110 tx=0x7f2adc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:08.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2aea59c700 1 --2- 172.21.15.63:0/1349218192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec1402e0 0x7f2aec0ac4d0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f2ae0001110 tx=0x7f2adc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:08.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2ae959a700 1 -- 172.21.15.63:0/1349218192 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc011ac0 con 0x7f2aec1402e0 2020-05-18T21:34:08.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2ae959a700 1 -- 172.21.15.63:0/1349218192 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2adc011e20 con 0x7f2aec1402e0 2020-05-18T21:34:08.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2aeb59e700 1 -- 172.21.15.63:0/1349218192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec1402e0 msgr2=0x7f2aec0ac4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:08.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.935+0000 7f2aeb59e700 1 --2- 172.21.15.63:0/1349218192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec1402e0 0x7f2aec0ac4d0 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7f2ae0001110 tx=0x7f2adc008ca0).stop 2020-05-18T21:34:08.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.939+0000 7f2aeb59e700 1 -- 172.21.15.63:0/1349218192 shutdown_connections 2020-05-18T21:34:08.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.939+0000 7f2aeb59e700 1 --2- 172.21.15.63:0/1349218192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec1402e0 0x7f2aec0ac4d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:08.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.939+0000 7f2aeb59e700 1 -- 172.21.15.63:0/1349218192 >> 172.21.15.63:0/1349218192 conn(0x7f2aec066d00 msgr2=0x7f2aec0b9590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:08.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.939+0000 7f2aeb59e700 1 -- 172.21.15.63:0/1349218192 shutdown_connections 2020-05-18T21:34:08.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.939+0000 7f2aeb59e700 1 -- 172.21.15.63:0/1349218192 wait complete. 2020-05-18T21:34:08.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.939+0000 7f2aeb59e700 1 Processor -- start 2020-05-18T21:34:08.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.939+0000 7f2aeb59e700 1 -- start start 2020-05-18T21:34:08.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.939+0000 7f2aeb59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec0b13a0 0x7f2aec141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:08.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.939+0000 7f2aeb59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2aec1402e0 0x7f2aec13c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:08.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.939+0000 7f2aeb59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec146430 con 0x7f2aec0b3000 2020-05-18T21:34:08.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.939+0000 7f2aeb59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec1466d0 con 0x7f2aec1402e0 2020-05-18T21:34:08.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.939+0000 7f2aeb59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec062c40 con 0x7f2aec0b13a0 2020-05-18T21:34:08.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.939+0000 7f2ae9d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2aec0b3000 0x7f2aec13c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35356/0 (socket says 172.21.15.63:35356) 2020-05-18T21:34:08.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.939+0000 7f2ae9d9b700 1 -- 172.21.15.63:0/2360268556 learned_addr learned my addr 172.21.15.63:0/2360268556 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:08.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.939+0000 7f2aea59c700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec0b13a0 0x7f2aec141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:08.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.939+0000 7f2aead9d700 1 --2- 172.21.15.63:0/2360268556 >> v2:172.21.15.155:3300/0 conn(0x7f2aec1402e0 0x7f2aec13c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:08.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.939+0000 7f2adb7fe700 1 -- 172.21.15.63:0/2360268556 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795593831 0 0) 0x7f2aec146430 con 0x7f2aec0b3000 2020-05-18T21:34:08.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2adb7fe700 1 -- 172.21.15.63:0/2360268556 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ac8002fe0 con 0x7f2aec0b3000 2020-05-18T21:34:08.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2adb7fe700 1 -- 172.21.15.63:0/2360268556 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3439913439 0 0) 0x7f2ac8002fe0 con 0x7f2aec0b3000 2020-05-18T21:34:08.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2adb7fe700 1 -- 172.21.15.63:0/2360268556 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2aec146430 con 0x7f2aec0b3000 2020-05-18T21:34:08.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2adb7fe700 1 -- 172.21.15.63:0/2360268556 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f2ae0004530 con 0x7f2aec0b3000 2020-05-18T21:34:08.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2adb7fe700 1 -- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec0b13a0 msgr2=0x7f2aec141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:08.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2adb7fe700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec0b13a0 0x7f2aec141280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:08.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2adb7fe700 1 -- 172.21.15.63:0/2360268556 >> v2:172.21.15.155:3300/0 conn(0x7f2aec1402e0 msgr2=0x7f2aec13c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:08.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2adb7fe700 1 --2- 172.21.15.63:0/2360268556 >> v2:172.21.15.155:3300/0 conn(0x7f2aec1402e0 0x7f2aec13c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:08.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2adb7fe700 1 -- 172.21.15.63:0/2360268556 >> v1:172.21.15.63:6789/0 conn(0x7f2aec0b3000 legacy=0x7f2aec13c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:08.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2adb7fe700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ac8005b10 0x7f2ac8005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:08.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2adb7fe700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ac8006410 0x7f2ac8008a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:08.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2adb7fe700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec0b13a0 0x7f2ac800af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:08.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2adb7fe700 1 -- 172.21.15.63:0/2360268556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec1466d0 con 0x7f2ac8005b10 2020-05-18T21:34:08.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2adb7fe700 1 -- 172.21.15.63:0/2360268556 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec062c40 con 0x7f2ac8006410 2020-05-18T21:34:08.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2adb7fe700 1 -- 172.21.15.63:0/2360268556 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac800b420 con 0x7f2aec0b13a0 2020-05-18T21:34:08.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aea59c700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ac8005b10 0x7f2ac8005ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:08.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aead9d700 1 --2- 172.21.15.63:0/2360268556 >> v2:172.21.15.155:3300/0 conn(0x7f2aec1402e0 0x7f2aec13c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:08.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2ae9d9b700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ac8006410 0x7f2ac8008a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:08.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aead9d700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec0b13a0 0x7f2ac800af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:08.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aea59c700 1 -- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec0b13a0 msgr2=0x7f2ac800af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:08.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aea59c700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec0b13a0 0x7f2ac800af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:08.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aea59c700 1 -- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ac8006410 msgr2=0x7f2ac8008a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:08.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aea59c700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ac8006410 0x7f2ac8008a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:08.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aea59c700 1 -- 172.21.15.63:0/2360268556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec0640f0 con 0x7f2ac8005b10 2020-05-18T21:34:08.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2ae9d9b700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ac8006410 0x7f2ac8008a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:34:08.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aeb59e700 1 -- 172.21.15.63:0/2360268556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aec064340 con 0x7f2ac8005b10 2020-05-18T21:34:08.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aea59c700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ac8005b10 0x7f2ac8005ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2ae0001110 tx=0x7f2aec0acce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:08.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aead9d700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aec0b13a0 0x7f2ac800af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:34:08.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aeb59e700 1 -- 172.21.15.63:0/2360268556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aec1414a0 con 0x7f2ac8005b10 2020-05-18T21:34:08.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aea59c700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ac8005b10 0x7f2ac8005ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2ae0001110 tx=0x7f2aec0acce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:08.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aea59c700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ac8005b10 0x7f2ac8005ef0 secure :-1 s=READY pgs=1577 cs=0 l=1 rx=0x7f2ae0001110 tx=0x7f2aec0acce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:08.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aea59c700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ac8005b10 0x7f2ac8005ef0 secure :-1 s=THROTTLE_DONE pgs=1577 cs=0 l=1 rx=0x7f2ae0001110 tx=0x7f2aec0acce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:08.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aea59c700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ac8005b10 0x7f2ac8005ef0 secure :-1 s=THROTTLE_DONE pgs=1577 cs=0 l=1 rx=0x7f2ae0001110 tx=0x7f2aec0acce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:08.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2adb7fe700 1 -- 172.21.15.63:0/2360268556 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2adc005c70 con 0x7f2ac8005b10 2020-05-18T21:34:08.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aea59c700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ac8005b10 0x7f2ac8005ef0 secure :-1 s=THROTTLE_DONE pgs=1577 cs=0 l=1 rx=0x7f2ae0001110 tx=0x7f2aec0acce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:08.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2adb7fe700 1 -- 172.21.15.63:0/2360268556 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc005dd0 con 0x7f2ac8005b10 2020-05-18T21:34:08.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2adb7fe700 1 -- 172.21.15.63:0/2360268556 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2adc00a680 con 0x7f2ac8005b10 2020-05-18T21:34:08.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aea59c700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ac8005b10 0x7f2ac8005ef0 secure :-1 s=THROTTLE_DONE pgs=1577 cs=0 l=1 rx=0x7f2ae0001110 tx=0x7f2aec0acce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:08.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aeb59e700 1 -- 172.21.15.63:0/2360268556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac4003380 con 0x7f2ac8005b10 2020-05-18T21:34:08.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2adb7fe700 1 -- 172.21.15.63:0/2360268556 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2adc00a7e0 con 0x7f2ac8005b10 2020-05-18T21:34:08.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.943+0000 7f2aea59c700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ac8005b10 0x7f2ac8005ef0 secure :-1 s=THROTTLE_DONE pgs=1577 cs=0 l=1 rx=0x7f2ae0001110 tx=0x7f2aec0acce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:08.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.947+0000 7f2adb7fe700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ac8057bf0 0x7f2ac805a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:08.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.947+0000 7f2adb7fe700 1 -- 172.21.15.63:0/2360268556 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2adc0648c0 con 0x7f2ac8005b10 2020-05-18T21:34:08.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.947+0000 7f2ae9d9b700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ac8057bf0 0x7f2ac805a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:08.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.947+0000 7f2ae9d9b700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ac8057bf0 0x7f2ac805a0b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2ae0001e20 tx=0x7f2ae0005840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:08.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.947+0000 7f2ae9d9b700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ac8057bf0 0x7f2ac805a0b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2ae0001e20 tx=0x7f2ae0005840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:08.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.947+0000 7f2ae9d9b700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ac8057bf0 0x7f2ac805a0b0 secure :-1 s=READY pgs=612 cs=0 l=1 rx=0x7f2ae0001e20 tx=0x7f2ae0005840).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:08.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.951+0000 7f2aea59c700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ac8005b10 0x7f2ac8005ef0 secure :-1 s=THROTTLE_DONE pgs=1577 cs=0 l=1 rx=0x7f2ae0001110 tx=0x7f2aec0acce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:08.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:08.951+0000 7f2adb7fe700 1 -- 172.21.15.63:0/2360268556 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2adc03ed70 con 0x7f2ac8005b10 2020-05-18T21:34:09.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.099+0000 7f2aeb59e700 1 -- 172.21.15.63:0/2360268556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ac4003720 con 0x7f2ac8005b10 2020-05-18T21:34:09.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.099+0000 7f2aea59c700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ac8005b10 0x7f2ac8005ef0 secure :-1 s=THROTTLE_DONE pgs=1577 cs=0 l=1 rx=0x7f2ae0001110 tx=0x7f2aec0acce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.099+0000 7f2adb7fe700 1 -- 172.21.15.63:0/2360268556 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f2adc042390 con 0x7f2ac8005b10 2020-05-18T21:34:09.103 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:09.103 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/911406335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":911406335},{"type":"v1","addr":"172.21.15.155:6835","nonce":911406335}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:46.613321+0000","modified":"2020-05-18T21:33:47.617221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8365":{"gid":8365,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/299278803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":299278803},{"type":"v1","addr":"172.21.15.63:6833","nonce":299278803}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-05-18T21:34:09.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.099+0000 7f2aeb59e700 1 -- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ac8057bf0 msgr2=0x7f2ac805a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:09.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.099+0000 7f2aeb59e700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ac8057bf0 0x7f2ac805a0b0 secure :-1 s=READY pgs=612 cs=0 l=1 rx=0x7f2ae0001e20 tx=0x7f2ae0005840).stop 2020-05-18T21:34:09.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.099+0000 7f2aeb59e700 1 -- 172.21.15.63:0/2360268556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ac8005b10 msgr2=0x7f2ac8005ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:09.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.099+0000 7f2aeb59e700 1 --2- 172.21.15.63:0/2360268556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ac8005b10 0x7f2ac8005ef0 secure :-1 s=READY pgs=1577 cs=0 l=1 rx=0x7f2ae0001110 tx=0x7f2aec0acce0).stop 2020-05-18T21:34:09.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.099+0000 7f2aead9d700 1 -- 172.21.15.63:0/2360268556 reap_dead start 2020-05-18T21:34:09.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.099+0000 7f2aeb59e700 1 -- 172.21.15.63:0/2360268556 shutdown_connections 2020-05-18T21:34:09.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.099+0000 7f2aeb59e700 1 -- 172.21.15.63:0/2360268556 >> 172.21.15.63:0/2360268556 conn(0x7f2aec066d00 msgr2=0x7f2aec0b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:09.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.099+0000 7f2aeb59e700 1 -- 172.21.15.63:0/2360268556 shutdown_connections 2020-05-18T21:34:09.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.099+0000 7f2aeb59e700 1 -- 172.21.15.63:0/2360268556 wait complete. 2020-05-18T21:34:09.107 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 86 2020-05-18T21:34:09.116 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok session ls 2020-05-18T21:34:09.215 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:34:09.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:09.216 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 8542, 2020-05-18T21:34:09.216 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": { 2020-05-18T21:34:09.216 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:34:09.217 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:34:09.217 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 8542 2020-05-18T21:34:09.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:09.217 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:34:09.217 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "any", 2020-05-18T21:34:09.218 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:34:09.218 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1381514735 2020-05-18T21:34:09.218 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:09.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:09.218 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "open", 2020-05-18T21:34:09.219 INFO:teuthology.orchestra.run.smithi063.stdout: "num_leases": 1, 2020-05-18T21:34:09.219 INFO:teuthology.orchestra.run.smithi063.stdout: "num_caps": 1, 2020-05-18T21:34:09.219 INFO:teuthology.orchestra.run.smithi063.stdout: "request_load_avg": 8, 2020-05-18T21:34:09.219 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 16.355549460999999, 2020-05-18T21:34:09.220 INFO:teuthology.orchestra.run.smithi063.stdout: "requests_in_flight": 0, 2020-05-18T21:34:09.220 INFO:teuthology.orchestra.run.smithi063.stdout: "completed_requests": 1, 2020-05-18T21:34:09.220 INFO:teuthology.orchestra.run.smithi063.stdout: "reconnecting": false, 2020-05-18T21:34:09.220 INFO:teuthology.orchestra.run.smithi063.stdout: "recall_caps": { 2020-05-18T21:34:09.220 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0, 2020-05-18T21:34:09.221 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 60 2020-05-18T21:34:09.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:09.221 INFO:teuthology.orchestra.run.smithi063.stdout: "release_caps": { 2020-05-18T21:34:09.221 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0.97933025572397314, 2020-05-18T21:34:09.222 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 60 2020-05-18T21:34:09.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:09.223 INFO:teuthology.orchestra.run.smithi063.stdout: "recall_caps_throttle": { 2020-05-18T21:34:09.223 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0, 2020-05-18T21:34:09.223 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 2.5 2020-05-18T21:34:09.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:09.224 INFO:teuthology.orchestra.run.smithi063.stdout: "recall_caps_throttle2o": { 2020-05-18T21:34:09.224 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 0, 2020-05-18T21:34:09.224 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 0.5 2020-05-18T21:34:09.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:09.224 INFO:teuthology.orchestra.run.smithi063.stdout: "session_cache_liveness": { 2020-05-18T21:34:09.225 INFO:teuthology.orchestra.run.smithi063.stdout: "value": 5.8202420457515345, 2020-05-18T21:34:09.225 INFO:teuthology.orchestra.run.smithi063.stdout: "halflife": 300 2020-05-18T21:34:09.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:09.225 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": "client.8542 192.168.0.1:0/1381514735", 2020-05-18T21:34:09.226 INFO:teuthology.orchestra.run.smithi063.stdout: "completed_requests": [ 2020-05-18T21:34:09.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:09.226 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 10, 2020-05-18T21:34:09.226 INFO:teuthology.orchestra.run.smithi063.stdout: "created_ino": "0x0" 2020-05-18T21:34:09.226 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:34:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: "prealloc_inos": [ 2020-05-18T21:34:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: "start": "0x10000000001", 2020-05-18T21:34:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: "length": 1000 2020-05-18T21:34:09.228 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:09.228 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:34:09.228 INFO:teuthology.orchestra.run.smithi063.stdout: "used_inos": [], 2020-05-18T21:34:09.228 INFO:teuthology.orchestra.run.smithi063.stdout: "client_metadata": { 2020-05-18T21:34:09.228 INFO:teuthology.orchestra.run.smithi063.stdout: "client_features": { 2020-05-18T21:34:09.229 INFO:teuthology.orchestra.run.smithi063.stdout: "feature_bits": "0x0000000000003fff" 2020-05-18T21:34:09.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:09.229 INFO:teuthology.orchestra.run.smithi063.stdout: "metric_spec": { 2020-05-18T21:34:09.229 INFO:teuthology.orchestra.run.smithi063.stdout: "metric_flags": { 2020-05-18T21:34:09.229 INFO:teuthology.orchestra.run.smithi063.stdout: "feature_bits": "0x" 2020-05-18T21:34:09.230 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:09.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:09.230 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:34:09.230 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:34:09.231 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:34:09.231 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:34:09.231 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:34:09.231 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "32256", 2020-05-18T21:34:09.231 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:34:09.232 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:09.232 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:09.232 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:34:09.237 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 8542, "entity": { "name": { "type": "client", "num": 8542 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 1381514735 } }, "state": "open", "num_leases": 1, "num_caps": 1, "request_load_avg": 8, "uptime": 16.355549460999999, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0.97933025572397314, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 5.8202420457515345, "halflife": 300 }, "inst": "client.8542 192.168.0.1:0/1381514735", "completed_requests": [ { "tid": 10, "created_ino": "0x0" } ], "prealloc_inos": [ { "start": "0x10000000001", "length": 1000 } ], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", "entity_id": "0", "hostname": "smithi063", "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "32256", "root": "/" } } ] 2020-05-18T21:34:09.238 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:34:09.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f063a309700 1 Processor -- start 2020-05-18T21:34:09.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f063a309700 1 -- start start 2020-05-18T21:34:09.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f063a309700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0634060b90 0x7f06340615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:09.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f063a309700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06340b2860 0x7f063414e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:09.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f063a309700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063414d960 con 0x7f0634144090 2020-05-18T21:34:09.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f063a309700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0634066210 con 0x7f0634060b90 2020-05-18T21:34:09.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f063a309700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063414db90 con 0x7f06340b2860 2020-05-18T21:34:09.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f06388a6700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0634144090 0x7f063414a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35372/0 (socket says 172.21.15.63:35372) 2020-05-18T21:34:09.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f0633fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0634060b90 0x7f06340615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:09.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f06388a6700 1 -- 172.21.15.63:0/3231689397 learned_addr learned my addr 172.21.15.63:0/3231689397 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:09.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f062b7fe700 1 --2- 172.21.15.63:0/3231689397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06340b2860 0x7f063414e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:09.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f06337fe700 1 -- 172.21.15.63:0/3231689397 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681079745 0 0) 0x7f063414d960 con 0x7f0634144090 2020-05-18T21:34:09.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f06337fe700 1 -- 172.21.15.63:0/3231689397 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0614003270 con 0x7f0634144090 2020-05-18T21:34:09.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f0633fff700 1 -- 172.21.15.63:0/3231689397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06340b2860 msgr2=0x7f063414e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:09.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f0633fff700 1 --2- 172.21.15.63:0/3231689397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06340b2860 0x7f063414e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:09.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f0633fff700 1 -- 172.21.15.63:0/3231689397 >> v1:172.21.15.63:6789/0 conn(0x7f0634144090 legacy=0x7f063414a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:09.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f0633fff700 1 -- 172.21.15.63:0/3231689397 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063414de30 con 0x7f0634060b90 2020-05-18T21:34:09.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f062b7fe700 1 --2- 172.21.15.63:0/3231689397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06340b2860 0x7f063414e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:09.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f0633fff700 1 --2- 172.21.15.63:0/3231689397 >> v2:172.21.15.155:3300/0 conn(0x7f0634060b90 0x7f06340615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0624002f70 tx=0x7f0624007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f0633fff700 1 --2- 172.21.15.63:0/3231689397 >> v2:172.21.15.155:3300/0 conn(0x7f0634060b90 0x7f06340615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0624002f70 tx=0x7f0624007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f0633fff700 1 --2- 172.21.15.63:0/3231689397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0634060b90 0x7f06340615e0 secure :-1 s=READY pgs=1047 cs=0 l=1 rx=0x7f0624002f70 tx=0x7f0624007a80).ready entity=mon.1 client_cookie=f83b8efdbb67202f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:09.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f0633fff700 1 --2- 172.21.15.63:0/3231689397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0634060b90 0x7f06340615e0 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7f0624002f70 tx=0x7f0624007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f06337fe700 1 -- 172.21.15.63:0/3231689397 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0624008e80 con 0x7f0634060b90 2020-05-18T21:34:09.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f0633fff700 1 --2- 172.21.15.63:0/3231689397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0634060b90 0x7f06340615e0 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7f0624002f70 tx=0x7f0624007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f06337fe700 1 -- 172.21.15.63:0/3231689397 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0624011540 con 0x7f0634060b90 2020-05-18T21:34:09.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f0633fff700 1 --2- 172.21.15.63:0/3231689397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0634060b90 0x7f06340615e0 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7f0624002f70 tx=0x7f0624007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f06337fe700 1 -- 172.21.15.63:0/3231689397 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0624011920 con 0x7f0634060b90 2020-05-18T21:34:09.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f063a309700 1 -- 172.21.15.63:0/3231689397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0634060b90 msgr2=0x7f06340615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:09.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f063a309700 1 --2- 172.21.15.63:0/3231689397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0634060b90 0x7f06340615e0 secure :-1 s=READY pgs=1047 cs=0 l=1 rx=0x7f0624002f70 tx=0x7f0624007a80).stop 2020-05-18T21:34:09.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f063a309700 1 -- 172.21.15.63:0/3231689397 shutdown_connections 2020-05-18T21:34:09.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f063a309700 1 --2- 172.21.15.63:0/3231689397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06340b2860 0x7f063414e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:09.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f063a309700 1 --2- 172.21.15.63:0/3231689397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0634060b90 0x7f06340615e0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:09.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f063a309700 1 -- 172.21.15.63:0/3231689397 >> 172.21.15.63:0/3231689397 conn(0x7f06340b83d0 msgr2=0x7f06340b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:09.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f063a309700 1 -- 172.21.15.63:0/3231689397 shutdown_connections 2020-05-18T21:34:09.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.339+0000 7f063a309700 1 -- 172.21.15.63:0/3231689397 wait complete. 2020-05-18T21:34:09.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.343+0000 7f063a309700 1 Processor -- start 2020-05-18T21:34:09.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.343+0000 7f063a309700 1 -- start start 2020-05-18T21:34:09.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f063a309700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f06340b2860 0x7f063414af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:09.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f063a309700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0634144090 0x7f0634065000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:09.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f063a309700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0634148700 con 0x7f0634060b90 2020-05-18T21:34:09.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f063a309700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06341477d0 con 0x7f06340b2860 2020-05-18T21:34:09.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f063a309700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0634065460 con 0x7f0634144090 2020-05-18T21:34:09.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f062b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f06340b2860 0x7f063414af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:09.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f0633fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0634060b90 0x7f06341470c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35374/0 (socket says 172.21.15.63:35374) 2020-05-18T21:34:09.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f0633fff700 1 -- 172.21.15.63:0/3469447261 learned_addr learned my addr 172.21.15.63:0/3469447261 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:09.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f06388a6700 1 --2- 172.21.15.63:0/3469447261 >> v2:172.21.15.155:3300/0 conn(0x7f0634144090 0x7f0634065000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:09.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f062b7fe700 1 -- 172.21.15.63:0/3469447261 >> v2:172.21.15.155:3300/0 conn(0x7f0634144090 msgr2=0x7f0634065000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:09.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f062b7fe700 1 --2- 172.21.15.63:0/3469447261 >> v2:172.21.15.155:3300/0 conn(0x7f0634144090 0x7f0634065000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:09.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f062b7fe700 1 -- 172.21.15.63:0/3469447261 >> v1:172.21.15.63:6789/0 conn(0x7f0634060b90 legacy=0x7f06341470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:09.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f0631ffb700 1 -- 172.21.15.63:0/3469447261 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167959145 0 0) 0x7f0634148700 con 0x7f0634060b90 2020-05-18T21:34:09.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f062b7fe700 1 -- 172.21.15.63:0/3469447261 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06340ad070 con 0x7f06340b2860 2020-05-18T21:34:09.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f062b7fe700 1 --2- 172.21.15.63:0/3469447261 >> v2:172.21.15.63:3300/0 conn(0x7f06340b2860 0x7f063414af70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f061c002f70 tx=0x7f061c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f062b7fe700 1 --2- 172.21.15.63:0/3469447261 >> v2:172.21.15.63:3300/0 conn(0x7f06340b2860 0x7f063414af70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f061c002f70 tx=0x7f061c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f062b7fe700 1 --2- 172.21.15.63:0/3469447261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06340b2860 0x7f063414af70 secure :-1 s=READY pgs=1580 cs=0 l=1 rx=0x7f061c002f70 tx=0x7f061c010dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:09.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f062b7fe700 1 --2- 172.21.15.63:0/3469447261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06340b2860 0x7f063414af70 secure :-1 s=THROTTLE_DONE pgs=1580 cs=0 l=1 rx=0x7f061c002f70 tx=0x7f061c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f062b7fe700 1 --2- 172.21.15.63:0/3469447261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06340b2860 0x7f063414af70 secure :-1 s=THROTTLE_DONE pgs=1580 cs=0 l=1 rx=0x7f061c002f70 tx=0x7f061c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f0631ffb700 1 -- 172.21.15.63:0/3469447261 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f061c00c980 con 0x7f06340b2860 2020-05-18T21:34:09.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f062b7fe700 1 --2- 172.21.15.63:0/3469447261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06340b2860 0x7f063414af70 secure :-1 s=THROTTLE_DONE pgs=1580 cs=0 l=1 rx=0x7f061c002f70 tx=0x7f061c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f0631ffb700 1 -- 172.21.15.63:0/3469447261 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c00cae0 con 0x7f06340b2860 2020-05-18T21:34:09.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f063a309700 1 -- 172.21.15.63:0/3469447261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0634148160 con 0x7f06340b2860 2020-05-18T21:34:09.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f0631ffb700 1 -- 172.21.15.63:0/3469447261 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f061c005700 con 0x7f06340b2860 2020-05-18T21:34:09.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f063a309700 1 -- 172.21.15.63:0/3469447261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0634146ca0 con 0x7f06340b2860 2020-05-18T21:34:09.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f062b7fe700 1 --2- 172.21.15.63:0/3469447261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06340b2860 0x7f063414af70 secure :-1 s=THROTTLE_DONE pgs=1580 cs=0 l=1 rx=0x7f061c002f70 tx=0x7f061c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.347+0000 7f063a309700 1 -- 172.21.15.63:0/3469447261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06340569e0 con 0x7f06340b2860 2020-05-18T21:34:09.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.351+0000 7f0631ffb700 1 -- 172.21.15.63:0/3469447261 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f061c0071a0 con 0x7f06340b2860 2020-05-18T21:34:09.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.351+0000 7f062b7fe700 1 --2- 172.21.15.63:0/3469447261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06340b2860 0x7f063414af70 secure :-1 s=THROTTLE_DONE pgs=1580 cs=0 l=1 rx=0x7f061c002f70 tx=0x7f061c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.351+0000 7f0631ffb700 1 --2- 172.21.15.63:0/3469447261 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f061804f940 0x7f0618051e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:09.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.351+0000 7f0631ffb700 1 -- 172.21.15.63:0/3469447261 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f061c063ad0 con 0x7f06340b2860 2020-05-18T21:34:09.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.351+0000 7f0633fff700 1 --2- 172.21.15.63:0/3469447261 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f061804f940 0x7f0618051e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:09.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.351+0000 7f0633fff700 1 --2- 172.21.15.63:0/3469447261 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f061804f940 0x7f0618051e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0624007f10 tx=0x7f0624007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.351+0000 7f0633fff700 1 --2- 172.21.15.63:0/3469447261 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f061804f940 0x7f0618051e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0624007f10 tx=0x7f0624007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.351+0000 7f0633fff700 1 --2- 172.21.15.63:0/3469447261 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f061804f940 0x7f0618051e00 secure :-1 s=READY pgs=613 cs=0 l=1 rx=0x7f0624007f10 tx=0x7f0624007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:09.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.355+0000 7f062b7fe700 1 --2- 172.21.15.63:0/3469447261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06340b2860 0x7f063414af70 secure :-1 s=THROTTLE_DONE pgs=1580 cs=0 l=1 rx=0x7f061c002f70 tx=0x7f061c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.355+0000 7f0631ffb700 1 -- 172.21.15.63:0/3469447261 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f061c03de00 con 0x7f06340b2860 2020-05-18T21:34:09.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.503+0000 7f063a309700 1 -- 172.21.15.63:0/3469447261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06340008d0 con 0x7f06340b2860 2020-05-18T21:34:09.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.507+0000 7f062b7fe700 1 --2- 172.21.15.63:0/3469447261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06340b2860 0x7f063414af70 secure :-1 s=THROTTLE_DONE pgs=1580 cs=0 l=1 rx=0x7f061c002f70 tx=0x7f061c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.507+0000 7f0631ffb700 1 -- 172.21.15.63:0/3469447261 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f061c041420 con 0x7f06340b2860 2020-05-18T21:34:09.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.507+0000 7f063a309700 1 -- 172.21.15.63:0/3469447261 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f061804f940 msgr2=0x7f0618051e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:09.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.507+0000 7f063a309700 1 --2- 172.21.15.63:0/3469447261 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f061804f940 0x7f0618051e00 secure :-1 s=READY pgs=613 cs=0 l=1 rx=0x7f0624007f10 tx=0x7f0624007a80).stop 2020-05-18T21:34:09.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.507+0000 7f063a309700 1 -- 172.21.15.63:0/3469447261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06340b2860 msgr2=0x7f063414af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:09.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.507+0000 7f063a309700 1 --2- 172.21.15.63:0/3469447261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06340b2860 0x7f063414af70 secure :-1 s=READY pgs=1580 cs=0 l=1 rx=0x7f061c002f70 tx=0x7f061c010dc0).stop 2020-05-18T21:34:09.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.507+0000 7f063a309700 1 -- 172.21.15.63:0/3469447261 shutdown_connections 2020-05-18T21:34:09.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.507+0000 7f063a309700 1 --2- 172.21.15.63:0/3469447261 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f061804f940 0x7f0618051e00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:09.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.507+0000 7f063a309700 1 --2- 172.21.15.63:0/3469447261 >> v2:172.21.15.155:3300/0 conn(0x7f0634144090 0x7f0634065000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:09.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.507+0000 7f063a309700 1 --2- 172.21.15.63:0/3469447261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06340b2860 0x7f063414af70 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:09.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.507+0000 7f063a309700 1 -- 172.21.15.63:0/3469447261 >> 172.21.15.63:0/3469447261 conn(0x7f06340b83d0 msgr2=0x7f0634064240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:09.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.507+0000 7f063a309700 1 -- 172.21.15.63:0/3469447261 shutdown_connections 2020-05-18T21:34:09.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.507+0000 7f063a309700 1 -- 172.21.15.63:0/3469447261 wait complete. 2020-05-18T21:34:09.516 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:09.517 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/911406335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":911406335},{"type":"v1","addr":"172.21.15.155:6835","nonce":911406335}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:46.613321+0000","modified":"2020-05-18T21:33:47.617221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8365":{"gid":8365,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/299278803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":299278803},{"type":"v1","addr":"172.21.15.63:6833","nonce":299278803}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-05-18T21:34:09.518 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 86 2020-05-18T21:34:09.522 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache strays_enqueued 2020-05-18T21:34:09.618 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:34:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:34:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 1 2020-05-18T21:34:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:09.619 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:34:09.626 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_enqueued": 1 } } 2020-05-18T21:34:09.627 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:34:09.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a06874700 1 Processor -- start 2020-05-18T21:34:09.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a06874700 1 -- start start 2020-05-18T21:34:09.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a06874700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7a0014a180 0x7f7a00065a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:09.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a06874700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a000acdc0 0x7f7a000b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:09.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a06874700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a000af1b0 con 0x7f7a000b8640 2020-05-18T21:34:09.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a06874700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a000ae7d0 con 0x7f7a0014a180 2020-05-18T21:34:09.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a06874700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a000aea70 con 0x7f7a000acdc0 2020-05-18T21:34:09.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f79fffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7a000b8640 0x7f7a00149a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35382/0 (socket says 172.21.15.63:35382) 2020-05-18T21:34:09.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f79ff7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7a0014a180 0x7f7a00065a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:09.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f79fffff700 1 -- 172.21.15.63:0/567043381 learned_addr learned my addr 172.21.15.63:0/567043381 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:09.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a04e11700 1 --2- 172.21.15.63:0/567043381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a000acdc0 0x7f7a000b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:09.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a04e11700 1 -- 172.21.15.63:0/567043381 >> v2:172.21.15.63:3300/0 conn(0x7f7a0014a180 msgr2=0x7f7a00065a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:09.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a04e11700 1 --2- 172.21.15.63:0/567043381 >> v2:172.21.15.63:3300/0 conn(0x7f7a0014a180 0x7f7a00065a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:09.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a04e11700 1 -- 172.21.15.63:0/567043381 >> v1:172.21.15.63:6789/0 conn(0x7f7a000b8640 legacy=0x7f7a00149a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:09.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f79feffd700 1 -- 172.21.15.63:0/567043381 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 769204862 0 0) 0x7f7a000af1b0 con 0x7f7a000b8640 2020-05-18T21:34:09.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a04e11700 1 -- 172.21.15.63:0/567043381 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a000aed10 con 0x7f7a000acdc0 2020-05-18T21:34:09.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f79ff7fe700 1 --2- 172.21.15.63:0/567043381 >> v2:172.21.15.63:3300/0 conn(0x7f7a0014a180 0x7f7a00065a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:09.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a04e11700 1 --2- 172.21.15.63:0/567043381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a000acdc0 0x7f7a000b4c00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f79f80032f0 tx=0x7f79f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a04e11700 1 --2- 172.21.15.63:0/567043381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a000acdc0 0x7f7a000b4c00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f79f80032f0 tx=0x7f79f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a04e11700 1 --2- 172.21.15.63:0/567043381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a000acdc0 0x7f7a000b4c00 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7f79f80032f0 tx=0x7f79f8007e00).ready entity=mon.2 client_cookie=6b3d349dd19f8445 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:09.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a04e11700 1 --2- 172.21.15.63:0/567043381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a000acdc0 0x7f7a000b4c00 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f79f80032f0 tx=0x7f79f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a04e11700 1 --2- 172.21.15.63:0/567043381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a000acdc0 0x7f7a000b4c00 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f79f80032f0 tx=0x7f79f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a04e11700 1 --2- 172.21.15.63:0/567043381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a000acdc0 0x7f7a000b4c00 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f79f80032f0 tx=0x7f79f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f79feffd700 1 -- 172.21.15.63:0/567043381 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79f8011e60 con 0x7f7a000acdc0 2020-05-18T21:34:09.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f79feffd700 1 -- 172.21.15.63:0/567043381 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f800a180 con 0x7f7a000acdc0 2020-05-18T21:34:09.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a06874700 1 -- 172.21.15.63:0/567043381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a000acdc0 msgr2=0x7f7a000b4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:09.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f7a06874700 1 --2- 172.21.15.63:0/567043381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a000acdc0 0x7f7a000b4c00 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7f79f80032f0 tx=0x7f79f8007e00).stop 2020-05-18T21:34:09.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.723+0000 7f79feffd700 1 -- 172.21.15.63:0/567043381 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79f800a520 con 0x7f7a000acdc0 2020-05-18T21:34:09.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f7a06874700 1 -- 172.21.15.63:0/567043381 shutdown_connections 2020-05-18T21:34:09.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f7a06874700 1 --2- 172.21.15.63:0/567043381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a000acdc0 0x7f7a000b4c00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:09.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f7a06874700 1 --2- 172.21.15.63:0/567043381 >> v2:172.21.15.63:3300/0 conn(0x7f7a0014a180 0x7f7a00065a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:09.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f7a06874700 1 -- 172.21.15.63:0/567043381 >> 172.21.15.63:0/567043381 conn(0x7f7a0005edd0 msgr2=0x7f7a0005f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:09.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f7a06874700 1 -- 172.21.15.63:0/567043381 shutdown_connections 2020-05-18T21:34:09.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f7a06874700 1 -- 172.21.15.63:0/567043381 wait complete. 2020-05-18T21:34:09.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f7a06874700 1 Processor -- start 2020-05-18T21:34:09.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f7a06874700 1 -- start start 2020-05-18T21:34:09.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f7a06874700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7a000acdc0 0x7f7a0014e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:09.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f7a06874700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a000b8640 0x7f7a000b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:09.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f7a06874700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a000b47f0 con 0x7f7a0014a180 2020-05-18T21:34:09.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f7a06874700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a0014db10 con 0x7f7a000acdc0 2020-05-18T21:34:09.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f7a06874700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0014ddb0 con 0x7f7a000b8640 2020-05-18T21:34:09.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f79fffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7a000acdc0 0x7f7a0014e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:09.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f79fffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7a000acdc0 0x7f7a0014e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33200/0 (socket says 172.21.15.63:33200) 2020-05-18T21:34:09.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f79fffff700 1 -- 172.21.15.63:0/44219850 learned_addr learned my addr 172.21.15.63:0/44219850 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:09.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f79ff7fe700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a000b8640 0x7f7a000b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:09.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f79fd7fa700 1 -- 172.21.15.63:0/44219850 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517008550 0 0) 0x7f7a000b47f0 con 0x7f7a0014a180 2020-05-18T21:34:09.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f79fd7fa700 1 -- 172.21.15.63:0/44219850 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79e0002fe0 con 0x7f7a0014a180 2020-05-18T21:34:09.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f79fffff700 1 -- 172.21.15.63:0/44219850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a000b8640 msgr2=0x7f7a000b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:09.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f79fffff700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a000b8640 0x7f7a000b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:09.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f79fffff700 1 -- 172.21.15.63:0/44219850 >> v1:172.21.15.155:6789/0 conn(0x7f7a0014a180 legacy=0x7f7a001434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:09.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.727+0000 7f79fd7fa700 1 -- 172.21.15.63:0/44219850 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1394120677 0 0) 0x7f79e0002fe0 con 0x7f7a0014a180 2020-05-18T21:34:09.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.731+0000 7f79fffff700 1 -- 172.21.15.63:0/44219850 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0014e050 con 0x7f7a000acdc0 2020-05-18T21:34:09.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.731+0000 7f79fffff700 1 --2- 172.21.15.63:0/44219850 >> v2:172.21.15.63:3300/0 conn(0x7f7a000acdc0 0x7f7a0014e280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79f8010510 tx=0x7f79f00109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.731+0000 7f79fffff700 1 --2- 172.21.15.63:0/44219850 >> v2:172.21.15.63:3300/0 conn(0x7f7a000acdc0 0x7f7a0014e280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79f8010510 tx=0x7f79f00109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.731+0000 7f79fffff700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a000acdc0 0x7f7a0014e280 secure :-1 s=READY pgs=1582 cs=0 l=1 rx=0x7f79f8010510 tx=0x7f79f00109a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:09.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.731+0000 7f79fffff700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a000acdc0 0x7f7a0014e280 secure :-1 s=THROTTLE_DONE pgs=1582 cs=0 l=1 rx=0x7f79f8010510 tx=0x7f79f00109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.731+0000 7f79fffff700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a000acdc0 0x7f7a0014e280 secure :-1 s=THROTTLE_DONE pgs=1582 cs=0 l=1 rx=0x7f79f8010510 tx=0x7f79f00109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.731+0000 7f79fd7fa700 1 -- 172.21.15.63:0/44219850 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79f800a590 con 0x7f7a000acdc0 2020-05-18T21:34:09.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.731+0000 7f79fffff700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a000acdc0 0x7f7a0014e280 secure :-1 s=THROTTLE_DONE pgs=1582 cs=0 l=1 rx=0x7f79f8010510 tx=0x7f79f00109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.731+0000 7f79fd7fa700 1 -- 172.21.15.63:0/44219850 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f0011e90 con 0x7f7a000acdc0 2020-05-18T21:34:09.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.731+0000 7f7a06874700 1 -- 172.21.15.63:0/44219850 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a000b0710 con 0x7f7a000acdc0 2020-05-18T21:34:09.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.731+0000 7f79fd7fa700 1 -- 172.21.15.63:0/44219850 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79f0005ce0 con 0x7f7a000acdc0 2020-05-18T21:34:09.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.731+0000 7f7a06874700 1 -- 172.21.15.63:0/44219850 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a0014b980 con 0x7f7a000acdc0 2020-05-18T21:34:09.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.731+0000 7f79fffff700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a000acdc0 0x7f7a0014e280 secure :-1 s=THROTTLE_DONE pgs=1582 cs=0 l=1 rx=0x7f79f8010510 tx=0x7f79f00109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.731+0000 7f7a06874700 1 -- 172.21.15.63:0/44219850 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a0014d950 con 0x7f7a000acdc0 2020-05-18T21:34:09.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.731+0000 7f79fd7fa700 1 -- 172.21.15.63:0/44219850 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f79f000a360 con 0x7f7a000acdc0 2020-05-18T21:34:09.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.731+0000 7f79fffff700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a000acdc0 0x7f7a0014e280 secure :-1 s=THROTTLE_DONE pgs=1582 cs=0 l=1 rx=0x7f79f8010510 tx=0x7f79f00109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.731+0000 7f79fd7fa700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f79e004fd80 0x7f79e0052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.731+0000 7f79fd7fa700 1 -- 172.21.15.63:0/44219850 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f79f00090c0 con 0x7f7a000acdc0 2020-05-18T21:34:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.731+0000 7f79ff7fe700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f79e004fd80 0x7f79e0052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.735+0000 7f79ff7fe700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f79e004fd80 0x7f79e0052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79f4002f70 tx=0x7f79f400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.735+0000 7f79ff7fe700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f79e004fd80 0x7f79e0052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79f4002f70 tx=0x7f79f400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.735+0000 7f79ff7fe700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f79e004fd80 0x7f79e0052240 secure :-1 s=READY pgs=614 cs=0 l=1 rx=0x7f79f4002f70 tx=0x7f79f400f570).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:09.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.739+0000 7f79fffff700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a000acdc0 0x7f7a0014e280 secure :-1 s=THROTTLE_DONE pgs=1582 cs=0 l=1 rx=0x7f79f8010510 tx=0x7f79f00109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.739+0000 7f79fd7fa700 1 -- 172.21.15.63:0/44219850 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f79f003da60 con 0x7f7a000acdc0 2020-05-18T21:34:09.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.887+0000 7f7a06874700 1 -- 172.21.15.63:0/44219850 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a000569e0 con 0x7f7a000acdc0 2020-05-18T21:34:09.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.891+0000 7f79fffff700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a000acdc0 0x7f7a0014e280 secure :-1 s=THROTTLE_DONE pgs=1582 cs=0 l=1 rx=0x7f79f8010510 tx=0x7f79f00109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:09.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.891+0000 7f79fd7fa700 1 -- 172.21.15.63:0/44219850 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f79f0041080 con 0x7f7a000acdc0 2020-05-18T21:34:09.894 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:09.895 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/911406335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":911406335},{"type":"v1","addr":"172.21.15.155:6835","nonce":911406335}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:46.613321+0000","modified":"2020-05-18T21:33:47.617221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8365":{"gid":8365,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/299278803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":299278803},{"type":"v1","addr":"172.21.15.63:6833","nonce":299278803}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-05-18T21:34:09.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.891+0000 7f7a06874700 1 -- 172.21.15.63:0/44219850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f79e004fd80 msgr2=0x7f79e0052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:09.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.891+0000 7f7a06874700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f79e004fd80 0x7f79e0052240 secure :-1 s=READY pgs=614 cs=0 l=1 rx=0x7f79f4002f70 tx=0x7f79f400f570).stop 2020-05-18T21:34:09.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.891+0000 7f7a06874700 1 -- 172.21.15.63:0/44219850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a000acdc0 msgr2=0x7f7a0014e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:09.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.891+0000 7f7a06874700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a000acdc0 0x7f7a0014e280 secure :-1 s=READY pgs=1582 cs=0 l=1 rx=0x7f79f8010510 tx=0x7f79f00109a0).stop 2020-05-18T21:34:09.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.891+0000 7f7a06874700 1 -- 172.21.15.63:0/44219850 shutdown_connections 2020-05-18T21:34:09.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.891+0000 7f7a06874700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f79e004fd80 0x7f79e0052240 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:09.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.891+0000 7f7a06874700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a000b8640 0x7f7a000b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:09.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.891+0000 7f7a06874700 1 --2- 172.21.15.63:0/44219850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a000acdc0 0x7f7a0014e280 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:09.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.891+0000 7f7a06874700 1 -- 172.21.15.63:0/44219850 >> 172.21.15.63:0/44219850 conn(0x7f7a0005edd0 msgr2=0x7f7a001456e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:09.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.891+0000 7f7a06874700 1 -- 172.21.15.63:0/44219850 shutdown_connections 2020-05-18T21:34:09.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:09.891+0000 7f7a06874700 1 -- 172.21.15.63:0/44219850 wait complete. 2020-05-18T21:34:09.901 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 86 2020-05-18T21:34:09.913 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump mds_cache num_strays 2020-05-18T21:34:10.016 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:34:10.017 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:34:10.017 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays": 0 2020-05-18T21:34:10.017 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:10.018 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:34:10.025 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "num_strays": 0 } } 2020-05-18T21:34:10.026 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:34:10.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.127+0000 7fea05e02700 1 Processor -- start 2020-05-18T21:34:10.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.127+0000 7fea05e02700 1 -- start start 2020-05-18T21:34:10.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.127+0000 7fea05e02700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea00060b90 0x7fea000615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:10.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.127+0000 7fea05e02700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fea0014e570 0x7fea0014a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:10.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.127+0000 7fea05e02700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea0014d960 con 0x7fea000b2860 2020-05-18T21:34:10.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.127+0000 7fea05e02700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea00066210 con 0x7fea0014e570 2020-05-18T21:34:10.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.127+0000 7fea05e02700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0014db90 con 0x7fea00060b90 2020-05-18T21:34:10.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.127+0000 7fe9feffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fea000b2860 0x7fea00144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35396/0 (socket says 172.21.15.63:35396) 2020-05-18T21:34:10.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.127+0000 7fe9feffd700 1 -- 172.21.15.63:0/430411832 learned_addr learned my addr 172.21.15.63:0/430411832 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:10.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.127+0000 7fe9fffff700 1 --2- 172.21.15.63:0/430411832 >> v2:172.21.15.63:3300/0 conn(0x7fea0014e570 0x7fea0014a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:10.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.127+0000 7fe9ff7fe700 1 --2- 172.21.15.63:0/430411832 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea00060b90 0x7fea000615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:10.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fe9fe7fc700 1 -- 172.21.15.63:0/430411832 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146572668 0 0) 0x7fea0014d960 con 0x7fea000b2860 2020-05-18T21:34:10.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fe9fe7fc700 1 -- 172.21.15.63:0/430411832 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9e4003270 con 0x7fea000b2860 2020-05-18T21:34:10.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fe9fffff700 1 -- 172.21.15.63:0/430411832 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea00060b90 msgr2=0x7fea000615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:10.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fe9fffff700 1 --2- 172.21.15.63:0/430411832 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea00060b90 0x7fea000615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:10.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fe9fffff700 1 -- 172.21.15.63:0/430411832 >> v1:172.21.15.63:6789/0 conn(0x7fea000b2860 legacy=0x7fea00144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fe9fffff700 1 -- 172.21.15.63:0/430411832 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0014de30 con 0x7fea0014e570 2020-05-18T21:34:10.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fe9fffff700 1 --2- 172.21.15.63:0/430411832 >> v2:172.21.15.63:3300/0 conn(0x7fea0014e570 0x7fea0014a390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe9f80032f0 tx=0x7fe9f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fe9fffff700 1 --2- 172.21.15.63:0/430411832 >> v2:172.21.15.63:3300/0 conn(0x7fea0014e570 0x7fea0014a390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe9f80032f0 tx=0x7fe9f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fe9fffff700 1 --2- 172.21.15.63:0/430411832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea0014e570 0x7fea0014a390 secure :-1 s=READY pgs=1584 cs=0 l=1 rx=0x7fe9f80032f0 tx=0x7fe9f8007e00).ready entity=mon.0 client_cookie=e516a2d24de043d3 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:10.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fe9fffff700 1 --2- 172.21.15.63:0/430411832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea0014e570 0x7fea0014a390 secure :-1 s=THROTTLE_DONE pgs=1584 cs=0 l=1 rx=0x7fe9f80032f0 tx=0x7fe9f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fe9fe7fc700 1 -- 172.21.15.63:0/430411832 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f8011db0 con 0x7fea0014e570 2020-05-18T21:34:10.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fe9fffff700 1 --2- 172.21.15.63:0/430411832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea0014e570 0x7fea0014a390 secure :-1 s=THROTTLE_DONE pgs=1584 cs=0 l=1 rx=0x7fe9f80032f0 tx=0x7fe9f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fe9fffff700 1 --2- 172.21.15.63:0/430411832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea0014e570 0x7fea0014a390 secure :-1 s=THROTTLE_DONE pgs=1584 cs=0 l=1 rx=0x7fe9f80032f0 tx=0x7fe9f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fe9fe7fc700 1 -- 172.21.15.63:0/430411832 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f800a180 con 0x7fea0014e570 2020-05-18T21:34:10.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fe9fe7fc700 1 -- 172.21.15.63:0/430411832 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f800a5a0 con 0x7fea0014e570 2020-05-18T21:34:10.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fea05e02700 1 -- 172.21.15.63:0/430411832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea0014e570 msgr2=0x7fea0014a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fea05e02700 1 --2- 172.21.15.63:0/430411832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea0014e570 0x7fea0014a390 secure :-1 s=READY pgs=1584 cs=0 l=1 rx=0x7fe9f80032f0 tx=0x7fe9f8007e00).stop 2020-05-18T21:34:10.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fea05e02700 1 -- 172.21.15.63:0/430411832 shutdown_connections 2020-05-18T21:34:10.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fea05e02700 1 --2- 172.21.15.63:0/430411832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea0014e570 0x7fea0014a390 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:10.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fea05e02700 1 --2- 172.21.15.63:0/430411832 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea00060b90 0x7fea000615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:10.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fea05e02700 1 -- 172.21.15.63:0/430411832 >> 172.21.15.63:0/430411832 conn(0x7fea000b83d0 msgr2=0x7fea000b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:10.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fea05e02700 1 -- 172.21.15.63:0/430411832 shutdown_connections 2020-05-18T21:34:10.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fea05e02700 1 -- 172.21.15.63:0/430411832 wait complete. 2020-05-18T21:34:10.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fea05e02700 1 Processor -- start 2020-05-18T21:34:10.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.131+0000 7fea05e02700 1 -- start start 2020-05-18T21:34:10.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fea05e02700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea0014e570 0x7fea00146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:10.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fea05e02700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea00157450 con 0x7fea00060b90 2020-05-18T21:34:10.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fea05e02700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea001466e0 con 0x7fea000b2860 2020-05-18T21:34:10.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fea05e02700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea000ac700 con 0x7fea0014e570 2020-05-18T21:34:10.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9ff7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fea00060b90 0x7fea000ad0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35404/0 (socket says 172.21.15.63:35404) 2020-05-18T21:34:10.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9ff7fe700 1 -- 172.21.15.63:0/3041781749 learned_addr learned my addr 172.21.15.63:0/3041781749 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:10.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9fffff700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea0014e570 0x7fea00146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:10.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9fcff9700 1 -- 172.21.15.63:0/3041781749 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290114833 0 0) 0x7fea00157450 con 0x7fea00060b90 2020-05-18T21:34:10.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9fcff9700 1 -- 172.21.15.63:0/3041781749 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9d8002fe0 con 0x7fea00060b90 2020-05-18T21:34:10.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9fcff9700 1 -- 172.21.15.63:0/3041781749 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141181119 0 0) 0x7fea001466e0 con 0x7fea000b2860 2020-05-18T21:34:10.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9fcff9700 1 -- 172.21.15.63:0/3041781749 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea00157450 con 0x7fea000b2860 2020-05-18T21:34:10.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9fffff700 1 -- 172.21.15.63:0/3041781749 >> v1:172.21.15.155:6789/0 conn(0x7fea000b2860 legacy=0x7fea0014a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9fffff700 1 -- 172.21.15.63:0/3041781749 >> v1:172.21.15.63:6789/0 conn(0x7fea00060b90 legacy=0x7fea000ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9fffff700 1 -- 172.21.15.63:0/3041781749 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea000ac9a0 con 0x7fea0014e570 2020-05-18T21:34:10.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9fffff700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea0014e570 0x7fea00146280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9f80032f0 tx=0x7fe9f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9fffff700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea0014e570 0x7fea00146280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9f80032f0 tx=0x7fe9f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9fffff700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea0014e570 0x7fea00146280 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7fe9f80032f0 tx=0x7fe9f8007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:10.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9fffff700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea0014e570 0x7fea00146280 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fe9f80032f0 tx=0x7fe9f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9fcff9700 1 -- 172.21.15.63:0/3041781749 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f8005c70 con 0x7fea0014e570 2020-05-18T21:34:10.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9fffff700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea0014e570 0x7fea00146280 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fe9f80032f0 tx=0x7fe9f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9fffff700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea0014e570 0x7fea00146280 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fe9f80032f0 tx=0x7fe9f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9fcff9700 1 -- 172.21.15.63:0/3041781749 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f8005dd0 con 0x7fea0014e570 2020-05-18T21:34:10.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fea05e02700 1 -- 172.21.15.63:0/3041781749 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea000acc40 con 0x7fea0014e570 2020-05-18T21:34:10.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9fcff9700 1 -- 172.21.15.63:0/3041781749 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f80112c0 con 0x7fea0014e570 2020-05-18T21:34:10.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fea05e02700 1 -- 172.21.15.63:0/3041781749 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea0014ac30 con 0x7fea0014e570 2020-05-18T21:34:10.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fea05e02700 1 -- 172.21.15.63:0/3041781749 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea000569e0 con 0x7fea0014e570 2020-05-18T21:34:10.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.135+0000 7fe9fffff700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea0014e570 0x7fea00146280 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fe9f80032f0 tx=0x7fe9f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.139+0000 7fe9fcff9700 1 -- 172.21.15.63:0/3041781749 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe9f8010560 con 0x7fea0014e570 2020-05-18T21:34:10.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.139+0000 7fe9fffff700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea0014e570 0x7fea00146280 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fe9f80032f0 tx=0x7fe9f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.139+0000 7fe9fcff9700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9d804fea0 0x7fe9d8052360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:10.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.139+0000 7fe9fcff9700 1 -- 172.21.15.63:0/3041781749 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe9f8064610 con 0x7fea0014e570 2020-05-18T21:34:10.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.139+0000 7fe9ff7fe700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9d804fea0 0x7fe9d8052360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:10.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.139+0000 7fe9ff7fe700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9d804fea0 0x7fe9d8052360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9f0002f70 tx=0x7fe9f00090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.139+0000 7fe9ff7fe700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9d804fea0 0x7fe9d8052360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9f0002f70 tx=0x7fe9f00090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.139+0000 7fe9ff7fe700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9d804fea0 0x7fe9d8052360 secure :-1 s=READY pgs=615 cs=0 l=1 rx=0x7fe9f0002f70 tx=0x7fe9f00090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:10.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.147+0000 7fe9fffff700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea0014e570 0x7fea00146280 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fe9f80032f0 tx=0x7fe9f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.147+0000 7fe9fcff9700 1 -- 172.21.15.63:0/3041781749 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe9f803e900 con 0x7fea0014e570 2020-05-18T21:34:10.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.295+0000 7fea05e02700 1 -- 172.21.15.63:0/3041781749 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea000008d0 con 0x7fea0014e570 2020-05-18T21:34:10.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.295+0000 7fe9fffff700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea0014e570 0x7fea00146280 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fe9f80032f0 tx=0x7fe9f8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.295+0000 7fe9fcff9700 1 -- 172.21.15.63:0/3041781749 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fe9f8041f20 con 0x7fea0014e570 2020-05-18T21:34:10.301 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:10.301 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/911406335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":911406335},{"type":"v1","addr":"172.21.15.155:6835","nonce":911406335}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:46.613321+0000","modified":"2020-05-18T21:33:47.617221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8365":{"gid":8365,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/299278803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":299278803},{"type":"v1","addr":"172.21.15.63:6833","nonce":299278803}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-05-18T21:34:10.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.299+0000 7fea05e02700 1 -- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9d804fea0 msgr2=0x7fe9d8052360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.299+0000 7fea05e02700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9d804fea0 0x7fe9d8052360 secure :-1 s=READY pgs=615 cs=0 l=1 rx=0x7fe9f0002f70 tx=0x7fe9f00090f0).stop 2020-05-18T21:34:10.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.299+0000 7fea05e02700 1 -- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea0014e570 msgr2=0x7fea00146280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.299+0000 7fea05e02700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea0014e570 0x7fea00146280 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7fe9f80032f0 tx=0x7fe9f8007e00).stop 2020-05-18T21:34:10.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.299+0000 7fea05e02700 1 -- 172.21.15.63:0/3041781749 shutdown_connections 2020-05-18T21:34:10.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.299+0000 7fea05e02700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9d804fea0 0x7fe9d8052360 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:10.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.299+0000 7fea05e02700 1 --2- 172.21.15.63:0/3041781749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea0014e570 0x7fea00146280 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:10.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.299+0000 7fea05e02700 1 -- 172.21.15.63:0/3041781749 >> 172.21.15.63:0/3041781749 conn(0x7fea000b83d0 msgr2=0x7fea00147650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:10.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.299+0000 7fea05e02700 1 -- 172.21.15.63:0/3041781749 shutdown_connections 2020-05-18T21:34:10.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.299+0000 7fea05e02700 1 -- 172.21.15.63:0/3041781749 wait complete. 2020-05-18T21:34:10.306 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 86 2020-05-18T21:34:10.314 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump purge_queue pq_executed 2020-05-18T21:34:10.408 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:34:10.408 INFO:teuthology.orchestra.run.smithi063.stdout: "purge_queue": { 2020-05-18T21:34:10.408 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executed": 1 2020-05-18T21:34:10.409 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:10.409 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:34:10.416 INFO:tasks.cephfs.filesystem:_json_asok output: { "purge_queue": { "pq_executed": 1 } } 2020-05-18T21:34:10.417 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_data ls 2020-05-18T21:34:10.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.443+0000 7fc9d2a31b80 1 Processor -- start 2020-05-18T21:34:10.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.443+0000 7fc9d2a31b80 1 -- start start 2020-05-18T21:34:10.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d2a31b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x563a0fc74c40 0x563a0fc59f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:10.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d2a31b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x563a0fd029c0 0x563a0fd008e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:10.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d2a31b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x563a0fd05680 0x563a0fc78150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:10.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d2a31b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x563a0fbe1800 con 0x563a0fd05680 2020-05-18T21:34:10.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d2a31b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x563a0fbc1110 con 0x563a0fc74c40 2020-05-18T21:34:10.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d2a31b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a0fbb1a40 con 0x563a0fd029c0 2020-05-18T21:34:10.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d1675700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x563a0fd05680 0x563a0fc78150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:10.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d1675700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x563a0fd05680 0x563a0fc78150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33230/0 (socket says 172.21.15.63:33230) 2020-05-18T21:34:10.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d1675700 1 -- 172.21.15.63:0/3533454602 learned_addr learned my addr 172.21.15.63:0/3533454602 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:10.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d0e74700 1 --2- 172.21.15.63:0/3533454602 >> v2:172.21.15.155:3300/0 conn(0x563a0fc74c40 0x563a0fc59f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:10.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d0673700 1 --2- 172.21.15.63:0/3533454602 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x563a0fd029c0 0x563a0fd008e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:10.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d1675700 1 -- 172.21.15.63:0/3533454602 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x563a0fd029c0 msgr2=0x563a0fd008e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:10.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d1675700 1 --2- 172.21.15.63:0/3533454602 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x563a0fd029c0 0x563a0fd008e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:10.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d1675700 1 -- 172.21.15.63:0/3533454602 >> v2:172.21.15.155:3300/0 conn(0x563a0fc74c40 msgr2=0x563a0fc59f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:10.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d1675700 1 --2- 172.21.15.63:0/3533454602 >> v2:172.21.15.155:3300/0 conn(0x563a0fc74c40 0x563a0fc59f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:10.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d1675700 1 -- 172.21.15.63:0/3533454602 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a0fbb5460 con 0x563a0fd05680 2020-05-18T21:34:10.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d1675700 1 --2- 172.21.15.63:0/3533454602 >> v2:172.21.15.63:3300/0 conn(0x563a0fd05680 0x563a0fc78150 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x563a0fd04830 tx=0x7fc9c80069a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d1675700 1 --2- 172.21.15.63:0/3533454602 >> v2:172.21.15.63:3300/0 conn(0x563a0fd05680 0x563a0fc78150 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x563a0fd04830 tx=0x7fc9c80069a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d1675700 1 --2- 172.21.15.63:0/3533454602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a0fd05680 0x563a0fc78150 secure :-1 s=READY pgs=1588 cs=0 l=1 rx=0x563a0fd04830 tx=0x7fc9c80069a0).ready entity=mon.0 client_cookie=964c1c5be485ac4e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:10.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d1675700 1 --2- 172.21.15.63:0/3533454602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a0fd05680 0x563a0fc78150 secure :-1 s=THROTTLE_DONE pgs=1588 cs=0 l=1 rx=0x563a0fd04830 tx=0x7fc9c80069a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d1675700 1 --2- 172.21.15.63:0/3533454602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a0fd05680 0x563a0fc78150 secure :-1 s=THROTTLE_DONE pgs=1588 cs=0 l=1 rx=0x563a0fd04830 tx=0x7fc9c80069a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9cee70700 1 -- 172.21.15.63:0/3533454602 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9c8006aa0 con 0x563a0fd05680 2020-05-18T21:34:10.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d1675700 1 --2- 172.21.15.63:0/3533454602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a0fd05680 0x563a0fc78150 secure :-1 s=THROTTLE_DONE pgs=1588 cs=0 l=1 rx=0x563a0fd04830 tx=0x7fc9c80069a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9cee70700 1 -- 172.21.15.63:0/3533454602 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c8006360 con 0x563a0fd05680 2020-05-18T21:34:10.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9cee70700 1 -- 172.21.15.63:0/3533454602 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9c8004810 con 0x563a0fd05680 2020-05-18T21:34:10.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d2a31b80 1 -- 172.21.15.63:0/3533454602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a0fd05680 msgr2=0x563a0fc78150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d2a31b80 1 --2- 172.21.15.63:0/3533454602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a0fd05680 0x563a0fc78150 secure :-1 s=READY pgs=1588 cs=0 l=1 rx=0x563a0fd04830 tx=0x7fc9c80069a0).stop 2020-05-18T21:34:10.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d2a31b80 1 -- 172.21.15.63:0/3533454602 shutdown_connections 2020-05-18T21:34:10.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d2a31b80 1 --2- 172.21.15.63:0/3533454602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a0fd05680 0x563a0fc78150 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:10.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d2a31b80 1 --2- 172.21.15.63:0/3533454602 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x563a0fd029c0 0x563a0fd008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:10.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d2a31b80 1 --2- 172.21.15.63:0/3533454602 >> v2:172.21.15.155:3300/0 conn(0x563a0fc74c40 0x563a0fc59f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:10.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d2a31b80 1 -- 172.21.15.63:0/3533454602 >> 172.21.15.63:0/3533454602 conn(0x563a0fc78850 msgr2=0x563a0fd01860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:10.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d2a31b80 1 -- 172.21.15.63:0/3533454602 shutdown_connections 2020-05-18T21:34:10.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.447+0000 7fc9d2a31b80 1 -- 172.21.15.63:0/3533454602 wait complete. 2020-05-18T21:34:10.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.451+0000 7fc9d2a31b80 1 Processor -- start 2020-05-18T21:34:10.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.451+0000 7fc9d2a31b80 1 -- start start 2020-05-18T21:34:10.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.451+0000 7fc9d2a31b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x563a0fd029c0 0x563a0fcf7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:10.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.451+0000 7fc9d2a31b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x563a0fd05680 0x563a0fd13db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:10.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.451+0000 7fc9d2a31b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x563a0fc58a50 con 0x563a0fc74c40 2020-05-18T21:34:10.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.451+0000 7fc9d2a31b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x563a0fc58cf0 con 0x563a0fd05680 2020-05-18T21:34:10.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.451+0000 7fc9d2a31b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a0fc59190 con 0x563a0fd029c0 2020-05-18T21:34:10.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.451+0000 7fc9d0e74700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x563a0fc74c40 0x563a0fcf5670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35422/0 (socket says 172.21.15.63:35422) 2020-05-18T21:34:10.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.451+0000 7fc9d0e74700 1 -- 172.21.15.63:0/3734295680 learned_addr learned my addr 172.21.15.63:0/3734295680 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:10.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.451+0000 7fc9d0673700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x563a0fd029c0 0x563a0fcf7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:10.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.451+0000 7fc9d1675700 1 --2- 172.21.15.63:0/3734295680 >> v2:172.21.15.155:3300/0 conn(0x563a0fd05680 0x563a0fd13db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:10.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.451+0000 7fc9ce66f700 1 -- 172.21.15.63:0/3734295680 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086598657 0 0) 0x563a0fc58a50 con 0x563a0fc74c40 2020-05-18T21:34:10.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.451+0000 7fc9ce66f700 1 -- 172.21.15.63:0/3734295680 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9bc002020 con 0x563a0fc74c40 2020-05-18T21:34:10.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.455+0000 7fc9d0673700 1 -- 172.21.15.63:0/3734295680 >> v2:172.21.15.155:3300/0 conn(0x563a0fd05680 msgr2=0x563a0fd13db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.455+0000 7fc9d0673700 1 --2- 172.21.15.63:0/3734295680 >> v2:172.21.15.155:3300/0 conn(0x563a0fd05680 0x563a0fd13db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:10.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.455+0000 7fc9d0673700 1 -- 172.21.15.63:0/3734295680 >> v1:172.21.15.63:6789/0 conn(0x563a0fc74c40 legacy=0x563a0fcf5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.455+0000 7fc9ce66f700 1 -- 172.21.15.63:0/3734295680 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1794932804 0 0) 0x7fc9bc002020 con 0x563a0fc74c40 2020-05-18T21:34:10.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.455+0000 7fc9d0673700 1 -- 172.21.15.63:0/3734295680 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a0fc592d0 con 0x563a0fd029c0 2020-05-18T21:34:10.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.455+0000 7fc9d0673700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x563a0fd029c0 0x563a0fcf7760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9c0001a20 tx=0x7fc9c400f720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.455+0000 7fc9d0673700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x563a0fd029c0 0x563a0fcf7760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9c0001a20 tx=0x7fc9c400f720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.455+0000 7fc9d0673700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x563a0fd029c0 0x563a0fcf7760 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7fc9c0001a20 tx=0x7fc9c400f720).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:10.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.455+0000 7fc9d0673700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x563a0fd029c0 0x563a0fcf7760 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7fc9c0001a20 tx=0x7fc9c400f720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.455+0000 7fc9d0673700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x563a0fd029c0 0x563a0fcf7760 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7fc9c0001a20 tx=0x7fc9c400f720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.455+0000 7fc9ce66f700 1 -- 172.21.15.63:0/3734295680 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9c00018c0 con 0x563a0fd029c0 2020-05-18T21:34:10.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.455+0000 7fc9d0673700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x563a0fd029c0 0x563a0fcf7760 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7fc9c0001a20 tx=0x7fc9c400f720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.455+0000 7fc9ce66f700 1 -- 172.21.15.63:0/3734295680 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c400fe60 con 0x563a0fd029c0 2020-05-18T21:34:10.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.455+0000 7fc9ce66f700 1 -- 172.21.15.63:0/3734295680 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9c400b3b0 con 0x563a0fd029c0 2020-05-18T21:34:10.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.455+0000 7fc9d2a31b80 1 -- 172.21.15.63:0/3734295680 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563a0fc594c0 con 0x563a0fd029c0 2020-05-18T21:34:10.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.455+0000 7fc9d2a31b80 1 -- 172.21.15.63:0/3734295680 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a0fcfeff0 con 0x563a0fd029c0 2020-05-18T21:34:10.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.455+0000 7fc9d0673700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x563a0fd029c0 0x563a0fcf7760 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7fc9c0001a20 tx=0x7fc9c400f720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.455+0000 7fc9ce66f700 1 -- 172.21.15.63:0/3734295680 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc9c400b5e0 con 0x563a0fd029c0 2020-05-18T21:34:10.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.455+0000 7fc9d0673700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x563a0fd029c0 0x563a0fcf7760 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7fc9c0001a20 tx=0x7fc9c400f720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.459+0000 7fc9ce66f700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc9bc04e9e0 0x7fc9bc050ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:10.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.459+0000 7fc9ce66f700 1 -- 172.21.15.63:0/3734295680 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc9c4062250 con 0x563a0fd029c0 2020-05-18T21:34:10.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.459+0000 7fc9d0e74700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc9bc04e9e0 0x7fc9bc050ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:10.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.459+0000 7fc9d2a31b80 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x563a0fcfde80 0x563a0fd1d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:10.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.459+0000 7fc9d2a31b80 1 -- 172.21.15.63:0/3734295680 --> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] -- osd_op(unknown.0.0:1 22.0 22:00000000::::head [pgnls start_epoch 114 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e114) v8 -- 0x563a0fcfe2c0 con 0x563a0fcfde80 2020-05-18T21:34:10.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.459+0000 7fc9d1675700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x563a0fcfde80 0x563a0fd1d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:10.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.459+0000 7fc9d0e74700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc9bc04e9e0 0x7fc9bc050ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9c00023b0 tx=0x7fc9c0003ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.459+0000 7fc9d0e74700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc9bc04e9e0 0x7fc9bc050ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9c00023b0 tx=0x7fc9c0003ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.459+0000 7fc9d0e74700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc9bc04e9e0 0x7fc9bc050ea0 secure :-1 s=READY pgs=616 cs=0 l=1 rx=0x7fc9c00023b0 tx=0x7fc9c0003ca0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:10.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.459+0000 7fc9d1675700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x563a0fcfde80 0x563a0fd1d530 crc :-1 s=READY pgs=26 cs=0 l=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:10.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.459+0000 7fc9d1675700 1 -- 172.21.15.63:0/3734295680 <== osd.4 v2:172.21.15.155:6800/13023 1 ==== osd_op_reply(1 [pgnls start_epoch 114 out=49b] v114'4 uv4 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9c80075c0 con 0x563a0fcfde80 2020-05-18T21:34:10.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.463+0000 7fc9d1675700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fc9c8006170 0x7fc9c8010600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:10.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.463+0000 7fc9d1675700 1 -- 172.21.15.63:0/3734295680 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- osd_op(unknown.0.0:2 22.4 22:20000000::::head [pgnls start_epoch 114 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e114) v8 -- 0x563a0fcfe2c0 con 0x7fc9c8006170 2020-05-18T21:34:10.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.463+0000 7fc9d0e74700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fc9c8006170 0x7fc9c8010600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:10.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.463+0000 7fc9d0e74700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fc9c8006170 0x7fc9c8010600 crc :-1 s=READY pgs=26 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:10.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.463+0000 7fc9d0e74700 1 -- 172.21.15.63:0/3734295680 <== osd.3 v2:172.21.15.63:6814/12805 1 ==== osd_op_reply(2 [pgnls start_epoch 114 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9c000dd10 con 0x7fc9c8006170 2020-05-18T21:34:10.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.463+0000 7fc9d0e74700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7fc9c000a880 0x7fc9c000b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:10.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.463+0000 7fc9d0e74700 1 -- 172.21.15.63:0/3734295680 --> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] -- osd_op(unknown.0.0:3 22.2 22:40000000::::head [pgnls start_epoch 114 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e114) v8 -- 0x563a0fcfe2c0 con 0x7fc9c000a880 2020-05-18T21:34:10.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.463+0000 7fc9d0673700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7fc9c000a880 0x7fc9c000b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:10.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.463+0000 7fc9d0673700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7fc9c000a880 0x7fc9c000b270 crc :-1 s=READY pgs=30 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:10.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.463+0000 7fc9d0673700 1 -- 172.21.15.63:0/3734295680 <== osd.1 v2:172.21.15.63:6808/12804 1 ==== osd_op_reply(3 [pgnls start_epoch 114 out=49b] v114'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9c403e6a0 con 0x7fc9c000a880 2020-05-18T21:34:10.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.463+0000 7fc9d0673700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7fc9c403f7f0 0x7fc9c403f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:10.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.463+0000 7fc9d0673700 1 -- 172.21.15.63:0/3734295680 --> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] -- osd_op(unknown.0.0:4 22.6 22:60000000::::head [pgnls start_epoch 114 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e114) v8 -- 0x563a0fcfe2c0 con 0x7fc9c403f7f0 2020-05-18T21:34:10.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.467+0000 7fc9d1675700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7fc9c403f7f0 0x7fc9c403f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:10.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.467+0000 7fc9d1675700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7fc9c403f7f0 0x7fc9c403f260 crc :-1 s=READY pgs=29 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:10.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.467+0000 7fc9d1675700 1 -- 172.21.15.63:0/3734295680 <== osd.5 v2:172.21.15.155:6808/13024 1 ==== osd_op_reply(4 [pgnls start_epoch 114 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9c80075c0 con 0x7fc9c403f7f0 2020-05-18T21:34:10.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.467+0000 7fc9d1675700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7fc9c800d290 0x7fc9c800d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:10.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.467+0000 7fc9d1675700 1 -- 172.21.15.63:0/3734295680 --> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] -- osd_op(unknown.0.0:5 22.1 22:80000000::::head [pgnls start_epoch 114 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e114) v8 -- 0x563a0fcfe2c0 con 0x7fc9c800d290 2020-05-18T21:34:10.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.467+0000 7fc9d0e74700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7fc9c800d290 0x7fc9c800d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:10.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.467+0000 7fc9d0e74700 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7fc9c800d290 0x7fc9c800d6d0 crc :-1 s=READY pgs=29 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:10.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.467+0000 7fc9d0e74700 1 -- 172.21.15.63:0/3734295680 <== osd.6 v2:172.21.15.155:6815/13025 1 ==== osd_op_reply(5 [pgnls start_epoch 114 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9c000dd10 con 0x7fc9c800d290 2020-05-18T21:34:10.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.467+0000 7fc9d0e74700 1 -- 172.21.15.63:0/3734295680 --> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] -- osd_op(unknown.0.0:6 22.5 22:a0000000::::head [pgnls start_epoch 114 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e114) v8 -- 0x563a0fcfe2c0 con 0x7fc9c800d290 2020-05-18T21:34:10.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.471+0000 7fc9d0e74700 1 -- 172.21.15.63:0/3734295680 <== osd.6 v2:172.21.15.155:6815/13025 2 ==== osd_op_reply(6 [pgnls start_epoch 114 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9c000dd10 con 0x7fc9c800d290 2020-05-18T21:34:10.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.471+0000 7fc9d0e74700 1 -- 172.21.15.63:0/3734295680 --> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] -- osd_op(unknown.0.0:7 22.3 22:c0000000::::head [pgnls start_epoch 114 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e114) v8 -- 0x563a0fcfe2c0 con 0x563a0fcfde80 2020-05-18T21:34:10.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d1675700 1 -- 172.21.15.63:0/3734295680 <== osd.4 v2:172.21.15.155:6800/13023 2 ==== osd_op_reply(7 [pgnls start_epoch 114 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9c80075c0 con 0x563a0fcfde80 2020-05-18T21:34:10.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d1675700 1 -- 172.21.15.63:0/3734295680 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- osd_op(unknown.0.0:8 22.7 22:e0000000::::head [pgnls start_epoch 114 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e114) v8 -- 0x563a0fcfe2c0 con 0x7fc9c8006170 2020-05-18T21:34:10.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d0e74700 1 -- 172.21.15.63:0/3734295680 <== osd.3 v2:172.21.15.63:6814/12805 2 ==== osd_op_reply(8 [pgnls start_epoch 114 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9c000dd10 con 0x7fc9c8006170 2020-05-18T21:34:10.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 -- 172.21.15.63:0/3734295680 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7fc9c000a880 msgr2=0x7fc9c000b270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7fc9c000a880 0x7fc9c000b270 crc :-1 s=READY pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:10.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 -- 172.21.15.63:0/3734295680 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fc9c8006170 msgr2=0x7fc9c8010600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fc9c8006170 0x7fc9c8010600 crc :-1 s=READY pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:10.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 -- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x563a0fcfde80 msgr2=0x563a0fd1d530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x563a0fcfde80 0x563a0fd1d530 crc :-1 s=READY pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:10.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 -- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7fc9c403f7f0 msgr2=0x7fc9c403f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7fc9c403f7f0 0x7fc9c403f260 crc :-1 s=READY pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:10.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 -- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7fc9c800d290 msgr2=0x7fc9c800d6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7fc9c800d290 0x7fc9c800d6d0 crc :-1 s=READY pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:10.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d1675700 1 -- 172.21.15.63:0/3734295680 reap_dead start 2020-05-18T21:34:10.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d1675700 1 -- 172.21.15.63:0/3734295680 reap_dead start 2020-05-18T21:34:10.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d1675700 1 -- 172.21.15.63:0/3734295680 reap_dead start 2020-05-18T21:34:10.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 -- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc9bc04e9e0 msgr2=0x7fc9bc050ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc9bc04e9e0 0x7fc9bc050ea0 secure :-1 s=READY pgs=616 cs=0 l=1 rx=0x7fc9c00023b0 tx=0x7fc9c0003ca0).stop 2020-05-18T21:34:10.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 -- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x563a0fd029c0 msgr2=0x563a0fcf7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x563a0fd029c0 0x563a0fcf7760 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7fc9c0001a20 tx=0x7fc9c400f720).stop 2020-05-18T21:34:10.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 -- 172.21.15.63:0/3734295680 shutdown_connections 2020-05-18T21:34:10.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc9bc04e9e0 0x7fc9bc050ea0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:10.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 --2- 172.21.15.63:0/3734295680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x563a0fd029c0 0x563a0fcf7760 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:10.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 -- 172.21.15.63:0/3734295680 >> 172.21.15.63:0/3734295680 conn(0x563a0fc78850 msgr2=0x563a0fd03290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:10.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 -- 172.21.15.63:0/3734295680 shutdown_connections 2020-05-18T21:34:10.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.479+0000 7fc9d2a31b80 1 -- 172.21.15.63:0/3734295680 wait complete. 2020-05-18T21:34:10.504 INFO:tasks.cephfs.filesystem:All objects for ino 1099511627776 size 8388608 are absent 2020-05-18T21:34:10.505 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early df --format=json-pretty 2020-05-18T21:34:10.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.639+0000 7f334885f700 1 Processor -- start 2020-05-18T21:34:10.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.639+0000 7f334885f700 1 -- start start 2020-05-18T21:34:10.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.639+0000 7f334885f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f33440b7280 0x7f33440b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:10.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.639+0000 7f334885f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33440b50e0 con 0x7f3344143de0 2020-05-18T21:34:10.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.639+0000 7f334885f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3344144760 con 0x7f33441438e0 2020-05-18T21:34:10.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.639+0000 7f334885f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3344144a00 con 0x7f33440b7280 2020-05-18T21:34:10.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.639+0000 7f3341d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3344143de0 0x7f33441431d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35440/0 (socket says 172.21.15.63:35440) 2020-05-18T21:34:10.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.639+0000 7f3341d9b700 1 -- 172.21.15.63:0/163157148 learned_addr learned my addr 172.21.15.63:0/163157148 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:10.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.639+0000 7f334259c700 1 --2- 172.21.15.63:0/163157148 >> v2:172.21.15.155:3300/0 conn(0x7f33440b7280 0x7f33440b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:10.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.639+0000 7f334159a700 1 -- 172.21.15.63:0/163157148 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 823861157 0 0) 0x7f33440b50e0 con 0x7f3344143de0 2020-05-18T21:34:10.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.639+0000 7f334159a700 1 -- 172.21.15.63:0/163157148 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3328003270 con 0x7f3344143de0 2020-05-18T21:34:10.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.639+0000 7f334159a700 1 -- 172.21.15.63:0/163157148 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2732671979 0 0) 0x7f3328003270 con 0x7f3344143de0 2020-05-18T21:34:10.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.639+0000 7f334259c700 1 -- 172.21.15.63:0/163157148 >> v1:172.21.15.155:6789/0 conn(0x7f33441438e0 legacy=0x7f33441475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.639+0000 7f334259c700 1 -- 172.21.15.63:0/163157148 >> v1:172.21.15.63:6789/0 conn(0x7f3344143de0 legacy=0x7f33441431d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.639+0000 7f334259c700 1 -- 172.21.15.63:0/163157148 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33440b7660 con 0x7f33440b7280 2020-05-18T21:34:10.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.643+0000 7f334259c700 1 --2- 172.21.15.63:0/163157148 >> v2:172.21.15.155:3300/0 conn(0x7f33440b7280 0x7f33440b4c80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3334002f70 tx=0x7f3334007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.643+0000 7f334259c700 1 --2- 172.21.15.63:0/163157148 >> v2:172.21.15.155:3300/0 conn(0x7f33440b7280 0x7f33440b4c80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3334002f70 tx=0x7f3334007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.643+0000 7f334259c700 1 --2- 172.21.15.63:0/163157148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33440b7280 0x7f33440b4c80 secure :-1 s=READY pgs=1052 cs=0 l=1 rx=0x7f3334002f70 tx=0x7f3334007a80).ready entity=mon.1 client_cookie=d19d1351784db18f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:10.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.643+0000 7f334259c700 1 --2- 172.21.15.63:0/163157148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33440b7280 0x7f33440b4c80 secure :-1 s=THROTTLE_DONE pgs=1052 cs=0 l=1 rx=0x7f3334002f70 tx=0x7f3334007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.643+0000 7f334159a700 1 -- 172.21.15.63:0/163157148 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3334008e80 con 0x7f33440b7280 2020-05-18T21:34:10.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.643+0000 7f334259c700 1 --2- 172.21.15.63:0/163157148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33440b7280 0x7f33440b4c80 secure :-1 s=THROTTLE_DONE pgs=1052 cs=0 l=1 rx=0x7f3334002f70 tx=0x7f3334007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.643+0000 7f334259c700 1 --2- 172.21.15.63:0/163157148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33440b7280 0x7f33440b4c80 secure :-1 s=THROTTLE_DONE pgs=1052 cs=0 l=1 rx=0x7f3334002f70 tx=0x7f3334007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.643+0000 7f334159a700 1 -- 172.21.15.63:0/163157148 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33340115f0 con 0x7f33440b7280 2020-05-18T21:34:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.643+0000 7f334159a700 1 -- 172.21.15.63:0/163157148 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3334011950 con 0x7f33440b7280 2020-05-18T21:34:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.643+0000 7f334885f700 1 -- 172.21.15.63:0/163157148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33440b7280 msgr2=0x7f33440b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.643+0000 7f334885f700 1 --2- 172.21.15.63:0/163157148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33440b7280 0x7f33440b4c80 secure :-1 s=READY pgs=1052 cs=0 l=1 rx=0x7f3334002f70 tx=0x7f3334007a80).stop 2020-05-18T21:34:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.643+0000 7f334885f700 1 -- 172.21.15.63:0/163157148 shutdown_connections 2020-05-18T21:34:10.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.643+0000 7f334885f700 1 --2- 172.21.15.63:0/163157148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33440b7280 0x7f33440b4c80 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:10.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.643+0000 7f334885f700 1 -- 172.21.15.63:0/163157148 >> 172.21.15.63:0/163157148 conn(0x7f3344069b70 msgr2=0x7f3344069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:10.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.643+0000 7f334885f700 1 -- 172.21.15.63:0/163157148 shutdown_connections 2020-05-18T21:34:10.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.643+0000 7f334885f700 1 -- 172.21.15.63:0/163157148 wait complete. 2020-05-18T21:34:10.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.643+0000 7f334885f700 1 Processor -- start 2020-05-18T21:34:10.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.643+0000 7f334885f700 1 -- start start 2020-05-18T21:34:10.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334885f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f33440b7280 0x7f33441552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:10.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334885f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f33441438e0 0x7f3344154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:10.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334885f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3344154e90 con 0x7f3344143de0 2020-05-18T21:34:10.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334885f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33440647f0 con 0x7f33440b7280 2020-05-18T21:34:10.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334885f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3344064a90 con 0x7f33441438e0 2020-05-18T21:34:10.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334259c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f33440b7280 0x7f33441552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:10.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f3342d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3344143de0 0x7f33440639b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35450/0 (socket says 172.21.15.63:35450) 2020-05-18T21:34:10.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f3342d9d700 1 -- 172.21.15.63:0/1775774634 learned_addr learned my addr 172.21.15.63:0/1775774634 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:10.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f3341d9b700 1 --2- 172.21.15.63:0/1775774634 >> v2:172.21.15.155:3300/0 conn(0x7f33441438e0 0x7f3344154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:10.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334259c700 1 -- 172.21.15.63:0/1775774634 >> v2:172.21.15.155:3300/0 conn(0x7f33441438e0 msgr2=0x7f3344154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334259c700 1 --2- 172.21.15.63:0/1775774634 >> v2:172.21.15.155:3300/0 conn(0x7f33441438e0 0x7f3344154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334259c700 1 -- 172.21.15.63:0/1775774634 >> v1:172.21.15.63:6789/0 conn(0x7f3344143de0 legacy=0x7f33440639b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334259c700 1 -- 172.21.15.63:0/1775774634 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3344064d30 con 0x7f33440b7280 2020-05-18T21:34:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334259c700 1 --2- 172.21.15.63:0/1775774634 >> v2:172.21.15.63:3300/0 conn(0x7f33440b7280 0x7f33441552a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3334002f70 tx=0x7f3334007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334259c700 1 --2- 172.21.15.63:0/1775774634 >> v2:172.21.15.63:3300/0 conn(0x7f33440b7280 0x7f33441552a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3334002f70 tx=0x7f3334007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334259c700 1 --2- 172.21.15.63:0/1775774634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33440b7280 0x7f33441552a0 secure :-1 s=READY pgs=1592 cs=0 l=1 rx=0x7f3334002f70 tx=0x7f3334007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:10.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334259c700 1 --2- 172.21.15.63:0/1775774634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33440b7280 0x7f33441552a0 secure :-1 s=THROTTLE_DONE pgs=1592 cs=0 l=1 rx=0x7f3334002f70 tx=0x7f3334007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f33337fe700 1 -- 172.21.15.63:0/1775774634 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3334007170 con 0x7f33440b7280 2020-05-18T21:34:10.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334259c700 1 --2- 172.21.15.63:0/1775774634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33440b7280 0x7f33441552a0 secure :-1 s=THROTTLE_DONE pgs=1592 cs=0 l=1 rx=0x7f3334002f70 tx=0x7f3334007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f33337fe700 1 -- 172.21.15.63:0/1775774634 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33340072d0 con 0x7f33440b7280 2020-05-18T21:34:10.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334885f700 1 -- 172.21.15.63:0/1775774634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33441411f0 con 0x7f33440b7280 2020-05-18T21:34:10.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334259c700 1 --2- 172.21.15.63:0/1775774634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33440b7280 0x7f33441552a0 secure :-1 s=THROTTLE_DONE pgs=1592 cs=0 l=1 rx=0x7f3334002f70 tx=0x7f3334007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f33337fe700 1 -- 172.21.15.63:0/1775774634 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3334005700 con 0x7f33440b7280 2020-05-18T21:34:10.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334885f700 1 -- 172.21.15.63:0/1775774634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33440642e0 con 0x7f33440b7280 2020-05-18T21:34:10.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334259c700 1 --2- 172.21.15.63:0/1775774634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33440b7280 0x7f33441552a0 secure :-1 s=THROTTLE_DONE pgs=1592 cs=0 l=1 rx=0x7f3334002f70 tx=0x7f3334007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f334885f700 1 -- 172.21.15.63:0/1775774634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33440569e0 con 0x7f33440b7280 2020-05-18T21:34:10.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.647+0000 7f33337fe700 1 -- 172.21.15.63:0/1775774634 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f33340059c0 con 0x7f33440b7280 2020-05-18T21:34:10.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.651+0000 7f334259c700 1 --2- 172.21.15.63:0/1775774634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33440b7280 0x7f33441552a0 secure :-1 s=THROTTLE_DONE pgs=1592 cs=0 l=1 rx=0x7f3334002f70 tx=0x7f3334007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.651+0000 7f33337fe700 1 --2- 172.21.15.63:0/1775774634 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f332004fa50 0x7f3320051f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:10.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.651+0000 7f33337fe700 1 -- 172.21.15.63:0/1775774634 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3334064440 con 0x7f33440b7280 2020-05-18T21:34:10.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.651+0000 7f3341d9b700 1 --2- 172.21.15.63:0/1775774634 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f332004fa50 0x7f3320051f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:10.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.651+0000 7f3341d9b700 1 --2- 172.21.15.63:0/1775774634 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f332004fa50 0x7f3320051f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3338000bc0 tx=0x7f33380013b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.651+0000 7f3341d9b700 1 --2- 172.21.15.63:0/1775774634 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f332004fa50 0x7f3320051f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3338000bc0 tx=0x7f33380013b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.651+0000 7f3341d9b700 1 --2- 172.21.15.63:0/1775774634 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f332004fa50 0x7f3320051f10 secure :-1 s=READY pgs=617 cs=0 l=1 rx=0x7f3338000bc0 tx=0x7f33380013b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:10.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.655+0000 7f334259c700 1 --2- 172.21.15.63:0/1775774634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33440b7280 0x7f33441552a0 secure :-1 s=THROTTLE_DONE pgs=1592 cs=0 l=1 rx=0x7f3334002f70 tx=0x7f3334007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.655+0000 7f33337fe700 1 -- 172.21.15.63:0/1775774634 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f333403e890 con 0x7f33440b7280 2020-05-18T21:34:10.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.807+0000 7f334885f700 1 -- 172.21.15.63:0/1775774634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f33440645c0 con 0x7f33440b7280 2020-05-18T21:34:10.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.807+0000 7f334259c700 1 --2- 172.21.15.63:0/1775774634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33440b7280 0x7f33441552a0 secure :-1 s=THROTTLE_DONE pgs=1592 cs=0 l=1 rx=0x7f3334002f70 tx=0x7f3334007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:10.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.807+0000 7f33337fe700 1 -- 172.21.15.63:0/1775774634 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1975 (secure 0 0 0) 0x7f3334041eb0 con 0x7f33440b7280 2020-05-18T21:34:10.813 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:10.813 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:34:10.813 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:34:10.814 INFO:teuthology.orchestra.run.smithi063.stdout: "total_bytes": 773094113280, 2020-05-18T21:34:10.814 INFO:teuthology.orchestra.run.smithi063.stdout: "total_avail_bytes": 764475777024, 2020-05-18T21:34:10.814 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_bytes": 28401664, 2020-05-18T21:34:10.814 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_bytes": 8618336256, 2020-05-18T21:34:10.814 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_ratio": 0.011147848330438137, 2020-05-18T21:34:10.815 INFO:teuthology.orchestra.run.smithi063.stdout: "num_osds": 8, 2020-05-18T21:34:10.815 INFO:teuthology.orchestra.run.smithi063.stdout: "num_per_pool_osds": 8, 2020-05-18T21:34:10.815 INFO:teuthology.orchestra.run.smithi063.stdout: "num_per_pool_omap_osds": 8 2020-05-18T21:34:10.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:10.815 INFO:teuthology.orchestra.run.smithi063.stdout: "stats_by_class": { 2020-05-18T21:34:10.815 INFO:teuthology.orchestra.run.smithi063.stdout: "ssd": { 2020-05-18T21:34:10.816 INFO:teuthology.orchestra.run.smithi063.stdout: "total_bytes": 773094113280, 2020-05-18T21:34:10.816 INFO:teuthology.orchestra.run.smithi063.stdout: "total_avail_bytes": 764475777024, 2020-05-18T21:34:10.816 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_bytes": 28401664, 2020-05-18T21:34:10.816 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_bytes": 8618336256, 2020-05-18T21:34:10.816 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_ratio": 0.011147848330438137 2020-05-18T21:34:10.817 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:10.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:10.817 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:34:10.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:10.817 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_health_metrics", 2020-05-18T21:34:10.818 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 1, 2020-05-18T21:34:10.818 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:34:10.818 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 0, 2020-05-18T21:34:10.818 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 2, 2020-05-18T21:34:10.818 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 0, 2020-05-18T21:34:10.820 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 0, 2020-05-18T21:34:10.820 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 0, 2020-05-18T21:34:10.821 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362885251072 2020-05-18T21:34:10.821 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:10.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:10.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:10.821 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd", 2020-05-18T21:34:10.822 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 2, 2020-05-18T21:34:10.822 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:34:10.822 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 0, 2020-05-18T21:34:10.822 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 0, 2020-05-18T21:34:10.822 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 0, 2020-05-18T21:34:10.823 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 0, 2020-05-18T21:34:10.823 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 0, 2020-05-18T21:34:10.823 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362885251072 2020-05-18T21:34:10.823 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:10.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:10.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:10.824 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephfs_metadata", 2020-05-18T21:34:10.824 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 21, 2020-05-18T21:34:10.824 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:34:10.824 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 17748, 2020-05-18T21:34:10.824 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 22, 2020-05-18T21:34:10.825 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 88, 2020-05-18T21:34:10.825 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 90112, 2020-05-18T21:34:10.825 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 1.2416045080954063e-07, 2020-05-18T21:34:10.825 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362885251072 2020-05-18T21:34:10.825 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:10.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:10.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:10.826 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephfs_data", 2020-05-18T21:34:10.826 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 22, 2020-05-18T21:34:10.826 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:34:10.826 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 8388608, 2020-05-18T21:34:10.827 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 2, 2020-05-18T21:34:10.827 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 16384, 2020-05-18T21:34:10.827 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 16777216, 2020-05-18T21:34:10.827 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 2.3115886506275274e-05, 2020-05-18T21:34:10.827 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362885251072 2020-05-18T21:34:10.828 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:10.828 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:10.828 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:10.828 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:34:10.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.811+0000 7f334885f700 1 -- 172.21.15.63:0/1775774634 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f332004fa50 msgr2=0x7f3320051f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.811+0000 7f334885f700 1 --2- 172.21.15.63:0/1775774634 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f332004fa50 0x7f3320051f10 secure :-1 s=READY pgs=617 cs=0 l=1 rx=0x7f3338000bc0 tx=0x7f33380013b0).stop 2020-05-18T21:34:10.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.811+0000 7f334885f700 1 -- 172.21.15.63:0/1775774634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33440b7280 msgr2=0x7f33441552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:10.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.811+0000 7f334885f700 1 --2- 172.21.15.63:0/1775774634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33440b7280 0x7f33441552a0 secure :-1 s=READY pgs=1592 cs=0 l=1 rx=0x7f3334002f70 tx=0x7f3334007a80).stop 2020-05-18T21:34:10.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.811+0000 7f334885f700 1 -- 172.21.15.63:0/1775774634 shutdown_connections 2020-05-18T21:34:10.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.811+0000 7f334885f700 1 --2- 172.21.15.63:0/1775774634 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f332004fa50 0x7f3320051f10 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:10.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.811+0000 7f334885f700 1 --2- 172.21.15.63:0/1775774634 >> v2:172.21.15.155:3300/0 conn(0x7f33441438e0 0x7f3344154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:10.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.811+0000 7f334885f700 1 --2- 172.21.15.63:0/1775774634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33440b7280 0x7f33441552a0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:10.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.811+0000 7f334885f700 1 -- 172.21.15.63:0/1775774634 >> 172.21.15.63:0/1775774634 conn(0x7f3344069b70 msgr2=0x7f33440b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:10.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.811+0000 7f334885f700 1 -- 172.21.15.63:0/1775774634 shutdown_connections 2020-05-18T21:34:10.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:10.811+0000 7f334885f700 1 -- 172.21.15.63:0/1775774634 wait complete. 2020-05-18T21:34:10.844 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60)... 2020-05-18T21:34:15.846 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early df --format=json-pretty 2020-05-18T21:34:15.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc02b59e700 1 Processor -- start 2020-05-18T21:34:15.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc02b59e700 1 -- start start 2020-05-18T21:34:15.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc02b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc02c0b41a0 0x7fc02c0b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:15.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc02b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc02c0b2d20 0x7fc02c1497e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:15.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc02b59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc02c0ae580 con 0x7fc02c05f0d0 2020-05-18T21:34:15.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc02b59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02c05f8c0 con 0x7fc02c0b2d20 2020-05-18T21:34:15.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc02b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c061160 con 0x7fc02c0b41a0 2020-05-18T21:34:15.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc02ad9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc02c0b2d20 0x7fc02c1497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:15.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc021d9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc02c0b41a0 0x7fc02c0b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:15.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc02a59c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fc02c05f0d0 0x7fc02c0aeb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:33770/0 (socket says 172.21.15.63:33770) 2020-05-18T21:34:15.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc02ad9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc02c0b2d20 0x7fc02c1497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33270/0 (socket says 172.21.15.63:33270) 2020-05-18T21:34:15.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc02a59c700 1 -- 172.21.15.63:0/3815563181 learned_addr learned my addr 172.21.15.63:0/3815563181 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:15.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc021d9b700 1 -- 172.21.15.63:0/3815563181 >> v2:172.21.15.63:3300/0 conn(0x7fc02c0b2d20 msgr2=0x7fc02c1497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:15.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc021d9b700 1 --2- 172.21.15.63:0/3815563181 >> v2:172.21.15.63:3300/0 conn(0x7fc02c0b2d20 0x7fc02c1497e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:15.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc021d9b700 1 -- 172.21.15.63:0/3815563181 >> v1:172.21.15.155:6789/0 conn(0x7fc02c05f0d0 legacy=0x7fc02c0aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:15.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc029d9b700 1 -- 172.21.15.63:0/3815563181 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011350238 0 0) 0x7fc02c0ae580 con 0x7fc02c05f0d0 2020-05-18T21:34:15.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc021d9b700 1 -- 172.21.15.63:0/3815563181 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02c05f4b0 con 0x7fc02c0b41a0 2020-05-18T21:34:15.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc021d9b700 1 --2- 172.21.15.63:0/3815563181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc02c0b41a0 0x7fc02c0b28c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc014002f70 tx=0x7fc014007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:15.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc021d9b700 1 --2- 172.21.15.63:0/3815563181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc02c0b41a0 0x7fc02c0b28c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc014002f70 tx=0x7fc014007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:15.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc021d9b700 1 --2- 172.21.15.63:0/3815563181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc02c0b41a0 0x7fc02c0b28c0 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7fc014002f70 tx=0x7fc014007a80).ready entity=mon.2 client_cookie=95d5ff23d16d91a5 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:15.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc021d9b700 1 --2- 172.21.15.63:0/3815563181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc02c0b41a0 0x7fc02c0b28c0 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7fc014002f70 tx=0x7fc014007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:15.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc029d9b700 1 -- 172.21.15.63:0/3815563181 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc014008e80 con 0x7fc02c0b41a0 2020-05-18T21:34:15.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc021d9b700 1 --2- 172.21.15.63:0/3815563181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc02c0b41a0 0x7fc02c0b28c0 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7fc014002f70 tx=0x7fc014007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:15.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc029d9b700 1 -- 172.21.15.63:0/3815563181 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0140115f0 con 0x7fc02c0b41a0 2020-05-18T21:34:15.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc021d9b700 1 --2- 172.21.15.63:0/3815563181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc02c0b41a0 0x7fc02c0b28c0 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7fc014002f70 tx=0x7fc014007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:15.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc029d9b700 1 -- 172.21.15.63:0/3815563181 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0140119d0 con 0x7fc02c0b41a0 2020-05-18T21:34:15.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc02b59e700 1 -- 172.21.15.63:0/3815563181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc02c0b41a0 msgr2=0x7fc02c0b28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:15.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.955+0000 7fc02b59e700 1 --2- 172.21.15.63:0/3815563181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc02c0b41a0 0x7fc02c0b28c0 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7fc014002f70 tx=0x7fc014007a80).stop 2020-05-18T21:34:15.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.959+0000 7fc02b59e700 1 -- 172.21.15.63:0/3815563181 shutdown_connections 2020-05-18T21:34:15.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.959+0000 7fc02b59e700 1 --2- 172.21.15.63:0/3815563181 >> v2:172.21.15.63:3300/0 conn(0x7fc02c0b2d20 0x7fc02c1497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:15.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.959+0000 7fc02b59e700 1 --2- 172.21.15.63:0/3815563181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc02c0b41a0 0x7fc02c0b28c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:15.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.959+0000 7fc02b59e700 1 -- 172.21.15.63:0/3815563181 >> 172.21.15.63:0/3815563181 conn(0x7fc02c069fc0 msgr2=0x7fc02c06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:15.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.959+0000 7fc02b59e700 1 -- 172.21.15.63:0/3815563181 shutdown_connections 2020-05-18T21:34:15.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.959+0000 7fc02b59e700 1 -- 172.21.15.63:0/3815563181 wait complete. 2020-05-18T21:34:15.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.959+0000 7fc02b59e700 1 Processor -- start 2020-05-18T21:34:15.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.959+0000 7fc02b59e700 1 -- start start 2020-05-18T21:34:15.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc02b59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc02c05f0d0 0x7fc02c0b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:15.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc02b59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc02c0b1e20 con 0x7fc02c0b2d20 2020-05-18T21:34:15.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc02b59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc02c1578d0 con 0x7fc02c0b41a0 2020-05-18T21:34:15.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc02b59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02c1359c0 con 0x7fc02c05f0d0 2020-05-18T21:34:15.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc021d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc02c0b2d20 0x7fc02c1352b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35460/0 (socket says 172.21.15.63:35460) 2020-05-18T21:34:15.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc021d9b700 1 -- 172.21.15.63:0/3533310105 learned_addr learned my addr 172.21.15.63:0/3533310105 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:15.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc02a59c700 1 --2- 172.21.15.63:0/3533310105 >> v2:172.21.15.155:3300/0 conn(0x7fc02c05f0d0 0x7fc02c0b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:15.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc023fff700 1 -- 172.21.15.63:0/3533310105 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387681825 0 0) 0x7fc02c0b1e20 con 0x7fc02c0b2d20 2020-05-18T21:34:15.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc023fff700 1 -- 172.21.15.63:0/3533310105 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc010002fe0 con 0x7fc02c0b2d20 2020-05-18T21:34:15.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc02a59c700 1 -- 172.21.15.63:0/3533310105 >> v1:172.21.15.155:6789/0 conn(0x7fc02c0b41a0 legacy=0x7fc02c157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:15.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc02a59c700 1 -- 172.21.15.63:0/3533310105 >> v1:172.21.15.63:6789/0 conn(0x7fc02c0b2d20 legacy=0x7fc02c1352b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:15.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc02a59c700 1 -- 172.21.15.63:0/3533310105 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02c135b00 con 0x7fc02c05f0d0 2020-05-18T21:34:15.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc02a59c700 1 --2- 172.21.15.63:0/3533310105 >> v2:172.21.15.155:3300/0 conn(0x7fc02c05f0d0 0x7fc02c0b0860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc01c000bc0 tx=0x7fc01c010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:15.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc02a59c700 1 --2- 172.21.15.63:0/3533310105 >> v2:172.21.15.155:3300/0 conn(0x7fc02c05f0d0 0x7fc02c0b0860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc01c000bc0 tx=0x7fc01c010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:15.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc02a59c700 1 --2- 172.21.15.63:0/3533310105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc02c05f0d0 0x7fc02c0b0860 secure :-1 s=READY pgs=1055 cs=0 l=1 rx=0x7fc01c000bc0 tx=0x7fc01c010940).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:15.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc02a59c700 1 --2- 172.21.15.63:0/3533310105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc02c05f0d0 0x7fc02c0b0860 secure :-1 s=THROTTLE_DONE pgs=1055 cs=0 l=1 rx=0x7fc01c000bc0 tx=0x7fc01c010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:15.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc023fff700 1 -- 172.21.15.63:0/3533310105 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc01c005ce0 con 0x7fc02c05f0d0 2020-05-18T21:34:15.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc02a59c700 1 --2- 172.21.15.63:0/3533310105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc02c05f0d0 0x7fc02c0b0860 secure :-1 s=THROTTLE_DONE pgs=1055 cs=0 l=1 rx=0x7fc01c000bc0 tx=0x7fc01c010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:15.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc02a59c700 1 --2- 172.21.15.63:0/3533310105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc02c05f0d0 0x7fc02c0b0860 secure :-1 s=THROTTLE_DONE pgs=1055 cs=0 l=1 rx=0x7fc01c000bc0 tx=0x7fc01c010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:15.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc023fff700 1 -- 172.21.15.63:0/3533310105 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01c005e40 con 0x7fc02c05f0d0 2020-05-18T21:34:15.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc02b59e700 1 -- 172.21.15.63:0/3533310105 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02c0b17f0 con 0x7fc02c05f0d0 2020-05-18T21:34:15.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc023fff700 1 -- 172.21.15.63:0/3533310105 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc01c006300 con 0x7fc02c05f0d0 2020-05-18T21:34:15.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.963+0000 7fc02b59e700 1 -- 172.21.15.63:0/3533310105 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02c0ad340 con 0x7fc02c05f0d0 2020-05-18T21:34:15.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.967+0000 7fc02a59c700 1 --2- 172.21.15.63:0/3533310105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc02c05f0d0 0x7fc02c0b0860 secure :-1 s=THROTTLE_DONE pgs=1055 cs=0 l=1 rx=0x7fc01c000bc0 tx=0x7fc01c010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:15.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.967+0000 7fc02b59e700 1 -- 172.21.15.63:0/3533310105 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc02c0ad7f0 con 0x7fc02c05f0d0 2020-05-18T21:34:15.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.967+0000 7fc023fff700 1 -- 172.21.15.63:0/3533310105 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc01c006570 con 0x7fc02c05f0d0 2020-05-18T21:34:15.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.967+0000 7fc02a59c700 1 --2- 172.21.15.63:0/3533310105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc02c05f0d0 0x7fc02c0b0860 secure :-1 s=THROTTLE_DONE pgs=1055 cs=0 l=1 rx=0x7fc01c000bc0 tx=0x7fc01c010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:15.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.967+0000 7fc023fff700 1 --2- 172.21.15.63:0/3533310105 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc01004fcf0 0x7fc0100521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:15.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.967+0000 7fc023fff700 1 -- 172.21.15.63:0/3533310105 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc01c0090c0 con 0x7fc02c05f0d0 2020-05-18T21:34:15.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.967+0000 7fc021d9b700 1 --2- 172.21.15.63:0/3533310105 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc01004fcf0 0x7fc0100521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:15.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.967+0000 7fc021d9b700 1 --2- 172.21.15.63:0/3533310105 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc01004fcf0 0x7fc0100521b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc014008500 tx=0x7fc014007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:15.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.967+0000 7fc021d9b700 1 --2- 172.21.15.63:0/3533310105 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc01004fcf0 0x7fc0100521b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc014008500 tx=0x7fc014007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:15.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.967+0000 7fc021d9b700 1 --2- 172.21.15.63:0/3533310105 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc01004fcf0 0x7fc0100521b0 secure :-1 s=READY pgs=618 cs=0 l=1 rx=0x7fc014008500 tx=0x7fc014007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:15.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.975+0000 7fc02a59c700 1 --2- 172.21.15.63:0/3533310105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc02c05f0d0 0x7fc02c0b0860 secure :-1 s=THROTTLE_DONE pgs=1055 cs=0 l=1 rx=0x7fc01c000bc0 tx=0x7fc01c010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:15.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:15.975+0000 7fc023fff700 1 -- 172.21.15.63:0/3533310105 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc01c03e0e0 con 0x7fc02c05f0d0 2020-05-18T21:34:16.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:16.131+0000 7fc02b59e700 1 -- 172.21.15.63:0/3533310105 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fc02c0b1c70 con 0x7fc02c05f0d0 2020-05-18T21:34:16.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:16.131+0000 7fc02a59c700 1 --2- 172.21.15.63:0/3533310105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc02c05f0d0 0x7fc02c0b0860 secure :-1 s=THROTTLE_DONE pgs=1055 cs=0 l=1 rx=0x7fc01c000bc0 tx=0x7fc01c010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:16.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:16.131+0000 7fc023fff700 1 -- 172.21.15.63:0/3533310105 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1939 (secure 0 0 0) 0x7fc01c041700 con 0x7fc02c05f0d0 2020-05-18T21:34:16.134 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:16.135 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:34:16.135 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:34:16.135 INFO:teuthology.orchestra.run.smithi063.stdout: "total_bytes": 773094113280, 2020-05-18T21:34:16.135 INFO:teuthology.orchestra.run.smithi063.stdout: "total_avail_bytes": 764492537856, 2020-05-18T21:34:16.135 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_bytes": 11640832, 2020-05-18T21:34:16.136 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_bytes": 8601575424, 2020-05-18T21:34:16.136 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_ratio": 0.011126169003546238, 2020-05-18T21:34:16.136 INFO:teuthology.orchestra.run.smithi063.stdout: "num_osds": 8, 2020-05-18T21:34:16.136 INFO:teuthology.orchestra.run.smithi063.stdout: "num_per_pool_osds": 8, 2020-05-18T21:34:16.137 INFO:teuthology.orchestra.run.smithi063.stdout: "num_per_pool_omap_osds": 8 2020-05-18T21:34:16.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:16.137 INFO:teuthology.orchestra.run.smithi063.stdout: "stats_by_class": { 2020-05-18T21:34:16.137 INFO:teuthology.orchestra.run.smithi063.stdout: "ssd": { 2020-05-18T21:34:16.137 INFO:teuthology.orchestra.run.smithi063.stdout: "total_bytes": 773094113280, 2020-05-18T21:34:16.138 INFO:teuthology.orchestra.run.smithi063.stdout: "total_avail_bytes": 764492537856, 2020-05-18T21:34:16.138 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_bytes": 11640832, 2020-05-18T21:34:16.138 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_bytes": 8601575424, 2020-05-18T21:34:16.138 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_ratio": 0.011126169003546238 2020-05-18T21:34:16.138 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:16.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:16.139 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:34:16.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:16.139 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_health_metrics", 2020-05-18T21:34:16.139 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 1, 2020-05-18T21:34:16.139 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:34:16.140 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 0, 2020-05-18T21:34:16.140 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 2, 2020-05-18T21:34:16.140 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 0, 2020-05-18T21:34:16.140 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 0, 2020-05-18T21:34:16.140 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 0, 2020-05-18T21:34:16.141 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362918772736 2020-05-18T21:34:16.141 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:16.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:16.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:16.141 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd", 2020-05-18T21:34:16.141 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 2, 2020-05-18T21:34:16.142 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:34:16.142 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 0, 2020-05-18T21:34:16.142 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 0, 2020-05-18T21:34:16.142 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 0, 2020-05-18T21:34:16.142 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 0, 2020-05-18T21:34:16.143 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 0, 2020-05-18T21:34:16.143 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362918772736 2020-05-18T21:34:16.143 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:16.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:16.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:16.143 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephfs_metadata", 2020-05-18T21:34:16.144 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 21, 2020-05-18T21:34:16.144 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:34:16.144 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 20282, 2020-05-18T21:34:16.144 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 23, 2020-05-18T21:34:16.144 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 104, 2020-05-18T21:34:16.145 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 106496, 2020-05-18T21:34:16.145 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 1.4672150427941233e-07, 2020-05-18T21:34:16.145 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362918772736 2020-05-18T21:34:16.145 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:16.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:16.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:16.146 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephfs_data", 2020-05-18T21:34:16.146 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 22, 2020-05-18T21:34:16.146 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:34:16.146 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 0, 2020-05-18T21:34:16.146 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 0, 2020-05-18T21:34:16.147 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 0, 2020-05-18T21:34:16.147 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 0, 2020-05-18T21:34:16.147 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 0, 2020-05-18T21:34:16.147 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362918772736 2020-05-18T21:34:16.147 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:16.147 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:16.148 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:16.148 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:34:16.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:16.131+0000 7fc02b59e700 1 -- 172.21.15.63:0/3533310105 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc01004fcf0 msgr2=0x7fc0100521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:16.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:16.131+0000 7fc02b59e700 1 --2- 172.21.15.63:0/3533310105 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc01004fcf0 0x7fc0100521b0 secure :-1 s=READY pgs=618 cs=0 l=1 rx=0x7fc014008500 tx=0x7fc014007a80).stop 2020-05-18T21:34:16.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:16.131+0000 7fc02b59e700 1 -- 172.21.15.63:0/3533310105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc02c05f0d0 msgr2=0x7fc02c0b0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:16.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:16.131+0000 7fc02b59e700 1 --2- 172.21.15.63:0/3533310105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc02c05f0d0 0x7fc02c0b0860 secure :-1 s=READY pgs=1055 cs=0 l=1 rx=0x7fc01c000bc0 tx=0x7fc01c010940).stop 2020-05-18T21:34:16.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:16.131+0000 7fc02b59e700 1 -- 172.21.15.63:0/3533310105 shutdown_connections 2020-05-18T21:34:16.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:16.131+0000 7fc02b59e700 1 --2- 172.21.15.63:0/3533310105 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc01004fcf0 0x7fc0100521b0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:16.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:16.131+0000 7fc02b59e700 1 --2- 172.21.15.63:0/3533310105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc02c05f0d0 0x7fc02c0b0860 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:16.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:16.131+0000 7fc02b59e700 1 -- 172.21.15.63:0/3533310105 >> 172.21.15.63:0/3533310105 conn(0x7fc02c069fc0 msgr2=0x7fc02c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:16.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:16.131+0000 7fc02b59e700 1 -- 172.21.15.63:0/3533310105 shutdown_connections 2020-05-18T21:34:16.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:16.131+0000 7fc02b59e700 1 -- 172.21.15.63:0/3533310105 wait complete. 2020-05-18T21:34:16.154 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s 2020-05-18T21:34:16.154 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:34:16.155 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:34:16.172 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:34:16.193 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:34:16.193 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:34:16.194 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:34:16.194 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:34:16.211 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[32256]: fuse finished with error 0 and tester_r 0 2020-05-18T21:34:16.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.214 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:34:16.263 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:34:16.263 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:34:16.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.264 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 down' 2020-05-18T21:34:16.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.289 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.0' 2020-05-18T21:34:16.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.364 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:34:16.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.384 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:34:16.393 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:34:16.393 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:34:16.393 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:34:16.393 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:34:16.394 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:34:16.394 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:34:16.394 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:34:16.394 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.394 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:34:16.395 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.395 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:34:16.395 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.395 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:34:16.395 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.395 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:34:16.396 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42386sec preferred_lft 42386sec 2020-05-18T21:34:16.396 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:34:16.396 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:34:16.396 INFO:teuthology.orchestra.run.smithi063.stdout:31: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-05-18T21:34:16.396 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.397 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:34:16.397 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:34:16.397 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::f092:4eff:fe49:ee61/64 scope link 2020-05-18T21:34:16.397 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:34:16.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.398 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:34:16.454 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:34:16.454 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:34:16.455 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:34:16.455 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.455 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:34:16.455 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.455 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:34:16.456 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.456 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:34:16.456 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.457 INFO:teuthology.orchestra.run.smithi063.stdout:31: ceph-brx: mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:34:16.457 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.458 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:34:16.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.459 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:34:16.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.476 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:34:16.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.607 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:34:16.617 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:34:16.617 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:34:16.617 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:34:16.618 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:34:16.618 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:34:16.618 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:34:16.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.619 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:34:16.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.639 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:34:16.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.655 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:34:16.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.670 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:34:16.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.720 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:34:16.726 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-05-18T21:34:16.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:34:16.727 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-05-18T21:34:16.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.728 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:34:16.741 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:34:16.742 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:34:16.742 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:34:16.742 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:34:16.743 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:34:16.743 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:34:16.743 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:34:16.743 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.743 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:34:16.744 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.744 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:34:16.744 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.744 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:34:16.744 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.744 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:34:16.745 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42386sec preferred_lft 42386sec 2020-05-18T21:34:16.745 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:34:16.745 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:34:16.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.746 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:34:16.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.796 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:34:16.803 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2020-05-18T21:34:16.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:34:16.804 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-05-18T21:34:16.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.805 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:34:16.813 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:34:16.813 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:34:16.813 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:34:16.813 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:34:16.814 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:34:16.814 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:34:16.814 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:34:16.814 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.814 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:34:16.814 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.815 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:34:16.815 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.815 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:34:16.815 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.815 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:34:16.816 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42390sec preferred_lft 42390sec 2020-05-18T21:34:16.816 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:34:16.816 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:34:16.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.817 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:34:16.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.863 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:34:16.869 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2020-05-18T21:34:16.870 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:34:16.871 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-05-18T21:34:16.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.872 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:34:16.879 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:34:16.879 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:34:16.879 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:34:16.879 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:34:16.880 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:34:16.880 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:34:16.880 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:34:16.881 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.881 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:34:16.881 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.881 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:34:16.882 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.882 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:34:16.882 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:16.882 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:34:16.882 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42390sec preferred_lft 42390sec 2020-05-18T21:34:16.883 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:34:16.883 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:34:16.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:16.884 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:34:16.926 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_strays.TestStrays.test_open_inode' 2020-05-18T21:34:17.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dcecea700 1 Processor -- start 2020-05-18T21:34:17.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dcecea700 1 -- start start 2020-05-18T21:34:17.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dcecea700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2dc80b2860 0x7f2dc80615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:17.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dcecea700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc814d960 con 0x7f2dc814e570 2020-05-18T21:34:17.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dcecea700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc814db90 con 0x7f2dc8060b90 2020-05-18T21:34:17.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dcecea700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc8066210 con 0x7f2dc80b2860 2020-05-18T21:34:17.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dcd287700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2dc814e570 0x7f2dc814a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35472/0 (socket says 172.21.15.63:35472) 2020-05-18T21:34:17.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dcd287700 1 -- 172.21.15.63:0/308353838 learned_addr learned my addr 172.21.15.63:0/308353838 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:17.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dc7fff700 1 --2- 172.21.15.63:0/308353838 >> v2:172.21.15.63:3300/0 conn(0x7f2dc80b2860 0x7f2dc80615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:17.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dc77fe700 1 -- 172.21.15.63:0/308353838 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307167500 0 0) 0x7f2dc814d960 con 0x7f2dc814e570 2020-05-18T21:34:17.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dc77fe700 1 -- 172.21.15.63:0/308353838 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da8003270 con 0x7f2dc814e570 2020-05-18T21:34:17.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dc77fe700 1 -- 172.21.15.63:0/308353838 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082696213 0 0) 0x7f2dc814db90 con 0x7f2dc8060b90 2020-05-18T21:34:17.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dc77fe700 1 -- 172.21.15.63:0/308353838 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dc814d960 con 0x7f2dc8060b90 2020-05-18T21:34:17.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dc7fff700 1 -- 172.21.15.63:0/308353838 >> v1:172.21.15.155:6789/0 conn(0x7f2dc8060b90 legacy=0x7f2dc8144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:17.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dc7fff700 1 -- 172.21.15.63:0/308353838 >> v1:172.21.15.63:6789/0 conn(0x7f2dc814e570 legacy=0x7f2dc814a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:17.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dc7fff700 1 -- 172.21.15.63:0/308353838 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc814de30 con 0x7f2dc80b2860 2020-05-18T21:34:17.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dc7fff700 1 --2- 172.21.15.63:0/308353838 >> v2:172.21.15.63:3300/0 conn(0x7f2dc80b2860 0x7f2dc80615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2db0001110 tx=0x7f2db8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dc7fff700 1 --2- 172.21.15.63:0/308353838 >> v2:172.21.15.63:3300/0 conn(0x7f2dc80b2860 0x7f2dc80615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2db0001110 tx=0x7f2db8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dc7fff700 1 --2- 172.21.15.63:0/308353838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2dc80b2860 0x7f2dc80615e0 secure :-1 s=READY pgs=1595 cs=0 l=1 rx=0x7f2db0001110 tx=0x7f2db8007e00).ready entity=mon.0 client_cookie=c277a51f7017efec server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:17.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dc7fff700 1 --2- 172.21.15.63:0/308353838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2dc80b2860 0x7f2dc80615e0 secure :-1 s=THROTTLE_DONE pgs=1595 cs=0 l=1 rx=0x7f2db0001110 tx=0x7f2db8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dc77fe700 1 -- 172.21.15.63:0/308353838 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2db8011d70 con 0x7f2dc80b2860 2020-05-18T21:34:17.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dc7fff700 1 --2- 172.21.15.63:0/308353838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2dc80b2860 0x7f2dc80615e0 secure :-1 s=THROTTLE_DONE pgs=1595 cs=0 l=1 rx=0x7f2db0001110 tx=0x7f2db8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dc77fe700 1 -- 172.21.15.63:0/308353838 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db800a180 con 0x7f2dc80b2860 2020-05-18T21:34:17.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dc7fff700 1 --2- 172.21.15.63:0/308353838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2dc80b2860 0x7f2dc80615e0 secure :-1 s=THROTTLE_DONE pgs=1595 cs=0 l=1 rx=0x7f2db0001110 tx=0x7f2db8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dc77fe700 1 -- 172.21.15.63:0/308353838 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2db800a4e0 con 0x7f2dc80b2860 2020-05-18T21:34:17.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dcecea700 1 -- 172.21.15.63:0/308353838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2dc80b2860 msgr2=0x7f2dc80615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:17.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.035+0000 7f2dcecea700 1 --2- 172.21.15.63:0/308353838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2dc80b2860 0x7f2dc80615e0 secure :-1 s=READY pgs=1595 cs=0 l=1 rx=0x7f2db0001110 tx=0x7f2db8007e00).stop 2020-05-18T21:34:17.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.039+0000 7f2dcecea700 1 -- 172.21.15.63:0/308353838 shutdown_connections 2020-05-18T21:34:17.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.039+0000 7f2dcecea700 1 --2- 172.21.15.63:0/308353838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2dc80b2860 0x7f2dc80615e0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:17.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.039+0000 7f2dcecea700 1 -- 172.21.15.63:0/308353838 >> 172.21.15.63:0/308353838 conn(0x7f2dc80b83d0 msgr2=0x7f2dc80b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:17.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.039+0000 7f2dcecea700 1 -- 172.21.15.63:0/308353838 shutdown_connections 2020-05-18T21:34:17.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.039+0000 7f2dcecea700 1 -- 172.21.15.63:0/308353838 wait complete. 2020-05-18T21:34:17.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.039+0000 7f2dcecea700 1 Processor -- start 2020-05-18T21:34:17.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.039+0000 7f2dcecea700 1 -- start start 2020-05-18T21:34:17.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcecea700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2dc8060b90 0x7f2dc8149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:17.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcecea700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2dc80b2860 0x7f2dc80b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:17.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcecea700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc80ac850 con 0x7f2dc814e570 2020-05-18T21:34:17.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcecea700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc81579d0 con 0x7f2dc8060b90 2020-05-18T21:34:17.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcecea700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc8145d70 con 0x7f2dc80b2860 2020-05-18T21:34:17.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcca86700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2dc8060b90 0x7f2dc8149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:17.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcca86700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2dc8060b90 0x7f2dc8149b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33286/0 (socket says 172.21.15.63:33286) 2020-05-18T21:34:17.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcca86700 1 -- 172.21.15.63:0/3389659374 learned_addr learned my addr 172.21.15.63:0/3389659374 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:17.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dc7fff700 1 --2- 172.21.15.63:0/3389659374 >> v2:172.21.15.155:3300/0 conn(0x7f2dc80b2860 0x7f2dc80b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:17.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcca86700 1 -- 172.21.15.63:0/3389659374 >> v2:172.21.15.155:3300/0 conn(0x7f2dc80b2860 msgr2=0x7f2dc80b6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:17.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcca86700 1 --2- 172.21.15.63:0/3389659374 >> v2:172.21.15.155:3300/0 conn(0x7f2dc80b2860 0x7f2dc80b6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:17.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcca86700 1 -- 172.21.15.63:0/3389659374 >> v1:172.21.15.155:6789/0 conn(0x7f2dc814e570 legacy=0x7f2dc8157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:17.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcca86700 1 -- 172.21.15.63:0/3389659374 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc80ac4d0 con 0x7f2dc8060b90 2020-05-18T21:34:17.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dc7fff700 1 --2- 172.21.15.63:0/3389659374 >> v2:172.21.15.155:3300/0 conn(0x7f2dc80b2860 0x7f2dc80b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:34:17.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcca86700 1 --2- 172.21.15.63:0/3389659374 >> v2:172.21.15.63:3300/0 conn(0x7f2dc8060b90 0x7f2dc8149b30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2dc80b77f0 tx=0x7f2db000c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcca86700 1 --2- 172.21.15.63:0/3389659374 >> v2:172.21.15.63:3300/0 conn(0x7f2dc8060b90 0x7f2dc8149b30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2dc80b77f0 tx=0x7f2db000c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcca86700 1 --2- 172.21.15.63:0/3389659374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2dc8060b90 0x7f2dc8149b30 secure :-1 s=READY pgs=1596 cs=0 l=1 rx=0x7f2dc80b77f0 tx=0x7f2db000c520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:17.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcca86700 1 --2- 172.21.15.63:0/3389659374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2dc8060b90 0x7f2dc8149b30 secure :-1 s=THROTTLE_DONE pgs=1596 cs=0 l=1 rx=0x7f2dc80b77f0 tx=0x7f2db000c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcca86700 1 --2- 172.21.15.63:0/3389659374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2dc8060b90 0x7f2dc8149b30 secure :-1 s=THROTTLE_DONE pgs=1596 cs=0 l=1 rx=0x7f2dc80b77f0 tx=0x7f2db000c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcca86700 1 --2- 172.21.15.63:0/3389659374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2dc8060b90 0x7f2dc8149b30 secure :-1 s=THROTTLE_DONE pgs=1596 cs=0 l=1 rx=0x7f2dc80b77f0 tx=0x7f2db000c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dc5ffb700 1 -- 172.21.15.63:0/3389659374 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2db000cc60 con 0x7f2dc8060b90 2020-05-18T21:34:17.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dc5ffb700 1 -- 172.21.15.63:0/3389659374 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db000ce00 con 0x7f2dc8060b90 2020-05-18T21:34:17.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dc5ffb700 1 -- 172.21.15.63:0/3389659374 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2db0012350 con 0x7f2dc8060b90 2020-05-18T21:34:17.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcecea700 1 -- 172.21.15.63:0/3389659374 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc8158580 con 0x7f2dc8060b90 2020-05-18T21:34:17.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcecea700 1 -- 172.21.15.63:0/3389659374 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc8144c40 con 0x7f2dc8060b90 2020-05-18T21:34:17.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.043+0000 7f2dcca86700 1 --2- 172.21.15.63:0/3389659374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2dc8060b90 0x7f2dc8149b30 secure :-1 s=THROTTLE_DONE pgs=1596 cs=0 l=1 rx=0x7f2dc80b77f0 tx=0x7f2db000c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.047+0000 7f2dc5ffb700 1 -- 172.21.15.63:0/3389659374 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2db0006520 con 0x7f2dc8060b90 2020-05-18T21:34:17.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.047+0000 7f2dcca86700 1 --2- 172.21.15.63:0/3389659374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2dc8060b90 0x7f2dc8149b30 secure :-1 s=THROTTLE_DONE pgs=1596 cs=0 l=1 rx=0x7f2dc80b77f0 tx=0x7f2db000c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.047+0000 7f2dcecea700 1 -- 172.21.15.63:0/3389659374 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc80569e0 con 0x7f2dc8060b90 2020-05-18T21:34:17.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.047+0000 7f2dc5ffb700 1 --2- 172.21.15.63:0/3389659374 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2dac04fa50 0x7f2dac051f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:17.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.047+0000 7f2dc5ffb700 1 -- 172.21.15.63:0/3389659374 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2db0063a50 con 0x7f2dc8060b90 2020-05-18T21:34:17.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.047+0000 7f2dc7fff700 1 --2- 172.21.15.63:0/3389659374 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2dac04fa50 0x7f2dac051f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:17.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.047+0000 7f2dc7fff700 1 --2- 172.21.15.63:0/3389659374 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2dac04fa50 0x7f2dac051f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2db0001110 tx=0x7f2db8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.047+0000 7f2dc7fff700 1 --2- 172.21.15.63:0/3389659374 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2dac04fa50 0x7f2dac051f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2db0001110 tx=0x7f2db8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.047+0000 7f2dc7fff700 1 --2- 172.21.15.63:0/3389659374 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2dac04fa50 0x7f2dac051f10 secure :-1 s=READY pgs=619 cs=0 l=1 rx=0x7f2db0001110 tx=0x7f2db8007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:17.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.051+0000 7f2dcca86700 1 --2- 172.21.15.63:0/3389659374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2dc8060b90 0x7f2dc8149b30 secure :-1 s=THROTTLE_DONE pgs=1596 cs=0 l=1 rx=0x7f2dc80b77f0 tx=0x7f2db000c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.051+0000 7f2dc5ffb700 1 -- 172.21.15.63:0/3389659374 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2db003dde0 con 0x7f2dc8060b90 2020-05-18T21:34:17.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.207+0000 7f2dcecea700 1 -- 172.21.15.63:0/3389659374 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_open_inode"]} v 0) v1 -- 0x7f2dc80ac660 con 0x7f2dc8060b90 2020-05-18T21:34:17.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.239+0000 7f2dcca86700 1 --2- 172.21.15.63:0/3389659374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2dc8060b90 0x7f2dc8149b30 secure :-1 s=THROTTLE_DONE pgs=1596 cs=0 l=1 rx=0x7f2dc80b77f0 tx=0x7f2db000c520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.239+0000 7f2dc5ffb700 1 -- 172.21.15.63:0/3389659374 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_open_inode"]}]=0 v378) v1 ==== 130+0+0 (secure 0 0 0) 0x7f2db0041400 con 0x7f2dc8060b90 2020-05-18T21:34:17.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.243+0000 7f2dcecea700 1 -- 172.21.15.63:0/3389659374 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2dac04fa50 msgr2=0x7f2dac051f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:17.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.243+0000 7f2dcecea700 1 --2- 172.21.15.63:0/3389659374 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2dac04fa50 0x7f2dac051f10 secure :-1 s=READY pgs=619 cs=0 l=1 rx=0x7f2db0001110 tx=0x7f2db8007e00).stop 2020-05-18T21:34:17.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.243+0000 7f2dcecea700 1 -- 172.21.15.63:0/3389659374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2dc8060b90 msgr2=0x7f2dc8149b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:17.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.243+0000 7f2dcecea700 1 --2- 172.21.15.63:0/3389659374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2dc8060b90 0x7f2dc8149b30 secure :-1 s=READY pgs=1596 cs=0 l=1 rx=0x7f2dc80b77f0 tx=0x7f2db000c520).stop 2020-05-18T21:34:17.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.243+0000 7f2dcecea700 1 -- 172.21.15.63:0/3389659374 shutdown_connections 2020-05-18T21:34:17.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.243+0000 7f2dcecea700 1 --2- 172.21.15.63:0/3389659374 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2dac04fa50 0x7f2dac051f10 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:17.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.243+0000 7f2dcecea700 1 --2- 172.21.15.63:0/3389659374 >> v2:172.21.15.155:3300/0 conn(0x7f2dc80b2860 0x7f2dc80b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:17.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.243+0000 7f2dcecea700 1 --2- 172.21.15.63:0/3389659374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2dc8060b90 0x7f2dc8149b30 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:17.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.243+0000 7f2dcecea700 1 -- 172.21.15.63:0/3389659374 >> 172.21.15.63:0/3389659374 conn(0x7f2dc80b83d0 msgr2=0x7f2dc814a390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:17.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.243+0000 7f2dcecea700 1 -- 172.21.15.63:0/3389659374 shutdown_connections 2020-05-18T21:34:17.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.243+0000 7f2dcecea700 1 -- 172.21.15.63:0/3389659374 wait complete. 2020-05-18T21:34:17.260 INFO:tasks.cephfs_test_runner:test_open_inode (tasks.cephfs.test_strays.TestStrays) ... ok 2020-05-18T21:34:17.260 INFO:tasks.cephfs_test_runner:Starting test: test_ops_throttle (tasks.cephfs.test_strays.TestStrays) 2020-05-18T21:34:17.261 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_strays.TestStrays.test_ops_throttle' 2020-05-18T21:34:17.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.363+0000 7f72b6db2700 1 Processor -- start 2020-05-18T21:34:17.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.363+0000 7f72b6db2700 1 -- start start 2020-05-18T21:34:17.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.363+0000 7f72b6db2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b0145df0 0x7f72b0142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:17.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.363+0000 7f72b6db2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f72b01432f0 0x7f72b0060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:17.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.363+0000 7f72b6db2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b00b7020 con 0x7f72b00b93f0 2020-05-18T21:34:17.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.363+0000 7f72b6db2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b00b72c0 con 0x7f72b01432f0 2020-05-18T21:34:17.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.363+0000 7f72b6db2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b00b7560 con 0x7f72b0145df0 2020-05-18T21:34:17.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.363+0000 7f72b65b1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f72b01432f0 0x7f72b0060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:17.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.363+0000 7f72b65b1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f72b01432f0 0x7f72b0060430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33298/0 (socket says 172.21.15.63:33298) 2020-05-18T21:34:17.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.363+0000 7f72b65b1700 1 -- 172.21.15.63:0/2677452937 learned_addr learned my addr 172.21.15.63:0/2677452937 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:17.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.363+0000 7f72b55af700 1 --2- 172.21.15.63:0/2677452937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b0145df0 0x7f72b0142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:17.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b65b1700 1 -- 172.21.15.63:0/2677452937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b0145df0 msgr2=0x7f72b0142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:17.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b65b1700 1 --2- 172.21.15.63:0/2677452937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b0145df0 0x7f72b0142e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:17.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b65b1700 1 -- 172.21.15.63:0/2677452937 >> v1:172.21.15.155:6789/0 conn(0x7f72b00b93f0 legacy=0x7f72b00b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:17.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b65b1700 1 -- 172.21.15.63:0/2677452937 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b00b7800 con 0x7f72b01432f0 2020-05-18T21:34:17.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b65b1700 1 --2- 172.21.15.63:0/2677452937 >> v2:172.21.15.63:3300/0 conn(0x7f72b01432f0 0x7f72b0060430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f72a8002f70 tx=0x7f72a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b65b1700 1 --2- 172.21.15.63:0/2677452937 >> v2:172.21.15.63:3300/0 conn(0x7f72b01432f0 0x7f72b0060430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f72a8002f70 tx=0x7f72a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b65b1700 1 --2- 172.21.15.63:0/2677452937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72b01432f0 0x7f72b0060430 secure :-1 s=READY pgs=1597 cs=0 l=1 rx=0x7f72a8002f70 tx=0x7f72a8007a80).ready entity=mon.0 client_cookie=8967d7d7db7c93d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:17.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b65b1700 1 --2- 172.21.15.63:0/2677452937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72b01432f0 0x7f72b0060430 secure :-1 s=THROTTLE_DONE pgs=1597 cs=0 l=1 rx=0x7f72a8002f70 tx=0x7f72a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b4dae700 1 -- 172.21.15.63:0/2677452937 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72a8011760 con 0x7f72b01432f0 2020-05-18T21:34:17.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b65b1700 1 --2- 172.21.15.63:0/2677452937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72b01432f0 0x7f72b0060430 secure :-1 s=THROTTLE_DONE pgs=1597 cs=0 l=1 rx=0x7f72a8002f70 tx=0x7f72a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b65b1700 1 --2- 172.21.15.63:0/2677452937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72b01432f0 0x7f72b0060430 secure :-1 s=THROTTLE_DONE pgs=1597 cs=0 l=1 rx=0x7f72a8002f70 tx=0x7f72a8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b4dae700 1 -- 172.21.15.63:0/2677452937 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a80118c0 con 0x7f72b01432f0 2020-05-18T21:34:17.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b4dae700 1 -- 172.21.15.63:0/2677452937 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72a8011ce0 con 0x7f72b01432f0 2020-05-18T21:34:17.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b6db2700 1 -- 172.21.15.63:0/2677452937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72b01432f0 msgr2=0x7f72b0060430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:17.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b6db2700 1 --2- 172.21.15.63:0/2677452937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72b01432f0 0x7f72b0060430 secure :-1 s=READY pgs=1597 cs=0 l=1 rx=0x7f72a8002f70 tx=0x7f72a8007a80).stop 2020-05-18T21:34:17.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b6db2700 1 -- 172.21.15.63:0/2677452937 shutdown_connections 2020-05-18T21:34:17.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b6db2700 1 --2- 172.21.15.63:0/2677452937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72b01432f0 0x7f72b0060430 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:17.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b6db2700 1 --2- 172.21.15.63:0/2677452937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b0145df0 0x7f72b0142e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:17.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b6db2700 1 -- 172.21.15.63:0/2677452937 >> 172.21.15.63:0/2677452937 conn(0x7f72b0069b70 msgr2=0x7f72b0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:17.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b6db2700 1 -- 172.21.15.63:0/2677452937 shutdown_connections 2020-05-18T21:34:17.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b6db2700 1 -- 172.21.15.63:0/2677452937 wait complete. 2020-05-18T21:34:17.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b6db2700 1 Processor -- start 2020-05-18T21:34:17.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.367+0000 7f72b6db2700 1 -- start start 2020-05-18T21:34:17.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b6db2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f72b00b93f0 0x7f72b0061490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:17.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b6db2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b01432f0 0x7f72b0144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:17.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b6db2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b0143aa0 con 0x7f72b0145df0 2020-05-18T21:34:17.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b6db2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b00bd050 con 0x7f72b00b93f0 2020-05-18T21:34:17.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b6db2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b00bd2f0 con 0x7f72b01432f0 2020-05-18T21:34:17.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b5db0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f72b00b93f0 0x7f72b0061490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:17.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b5db0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f72b00b93f0 0x7f72b0061490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33302/0 (socket says 172.21.15.63:33302) 2020-05-18T21:34:17.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b5db0700 1 -- 172.21.15.63:0/1696175294 learned_addr learned my addr 172.21.15.63:0/1696175294 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:17.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b55af700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b01432f0 0x7f72b0144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:17.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72a2ffd700 1 -- 172.21.15.63:0/1696175294 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263740157 0 0) 0x7f72b0143aa0 con 0x7f72b0145df0 2020-05-18T21:34:17.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b5db0700 1 -- 172.21.15.63:0/1696175294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b01432f0 msgr2=0x7f72b0144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:17.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b5db0700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b01432f0 0x7f72b0144450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:17.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b5db0700 1 -- 172.21.15.63:0/1696175294 >> v1:172.21.15.155:6789/0 conn(0x7f72b0145df0 legacy=0x7f72b013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:17.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b5db0700 1 -- 172.21.15.63:0/1696175294 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b0143790 con 0x7f72b00b93f0 2020-05-18T21:34:17.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b5db0700 1 --2- 172.21.15.63:0/1696175294 >> v2:172.21.15.63:3300/0 conn(0x7f72b00b93f0 0x7f72b0061490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f72b0145ac0 tx=0x7f72a400c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b5db0700 1 --2- 172.21.15.63:0/1696175294 >> v2:172.21.15.63:3300/0 conn(0x7f72b00b93f0 0x7f72b0061490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f72b0145ac0 tx=0x7f72a400c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b5db0700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72b00b93f0 0x7f72b0061490 secure :-1 s=READY pgs=1598 cs=0 l=1 rx=0x7f72b0145ac0 tx=0x7f72a400c4d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:17.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b5db0700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72b00b93f0 0x7f72b0061490 secure :-1 s=THROTTLE_DONE pgs=1598 cs=0 l=1 rx=0x7f72b0145ac0 tx=0x7f72a400c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72a2ffd700 1 -- 172.21.15.63:0/1696175294 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72a400c960 con 0x7f72b00b93f0 2020-05-18T21:34:17.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b5db0700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72b00b93f0 0x7f72b0061490 secure :-1 s=THROTTLE_DONE pgs=1598 cs=0 l=1 rx=0x7f72b0145ac0 tx=0x7f72a400c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72a2ffd700 1 -- 172.21.15.63:0/1696175294 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a400cac0 con 0x7f72b00b93f0 2020-05-18T21:34:17.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b5db0700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72b00b93f0 0x7f72b0061490 secure :-1 s=THROTTLE_DONE pgs=1598 cs=0 l=1 rx=0x7f72b0145ac0 tx=0x7f72a400c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b6db2700 1 -- 172.21.15.63:0/1696175294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b013bcf0 con 0x7f72b00b93f0 2020-05-18T21:34:17.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72a2ffd700 1 -- 172.21.15.63:0/1696175294 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72a400ce60 con 0x7f72b00b93f0 2020-05-18T21:34:17.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b6db2700 1 -- 172.21.15.63:0/1696175294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b00607f0 con 0x7f72b00b93f0 2020-05-18T21:34:17.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.371+0000 7f72b5db0700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72b00b93f0 0x7f72b0061490 secure :-1 s=THROTTLE_DONE pgs=1598 cs=0 l=1 rx=0x7f72b0145ac0 tx=0x7f72a400c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.375+0000 7f72a2ffd700 1 -- 172.21.15.63:0/1696175294 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f72a40101b0 con 0x7f72b00b93f0 2020-05-18T21:34:17.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.375+0000 7f72b5db0700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72b00b93f0 0x7f72b0061490 secure :-1 s=THROTTLE_DONE pgs=1598 cs=0 l=1 rx=0x7f72b0145ac0 tx=0x7f72a400c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.375+0000 7f72b6db2700 1 -- 172.21.15.63:0/1696175294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b00569e0 con 0x7f72b00b93f0 2020-05-18T21:34:17.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.375+0000 7f72a2ffd700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f729004f920 0x7f7290051de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:17.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.375+0000 7f72a2ffd700 1 -- 172.21.15.63:0/1696175294 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f72a4063710 con 0x7f72b00b93f0 2020-05-18T21:34:17.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.375+0000 7f72b55af700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f729004f920 0x7f7290051de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:17.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.375+0000 7f72b55af700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f729004f920 0x7f7290051de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f72ac0032f0 tx=0x7f72ac00daf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.375+0000 7f72b55af700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f729004f920 0x7f7290051de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f72ac0032f0 tx=0x7f72ac00daf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.375+0000 7f72b55af700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f729004f920 0x7f7290051de0 secure :-1 s=READY pgs=620 cs=0 l=1 rx=0x7f72ac0032f0 tx=0x7f72ac00daf0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:17.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.379+0000 7f72b5db0700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72b00b93f0 0x7f72b0061490 secure :-1 s=THROTTLE_DONE pgs=1598 cs=0 l=1 rx=0x7f72b0145ac0 tx=0x7f72a400c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:17.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.379+0000 7f72a2ffd700 1 -- 172.21.15.63:0/1696175294 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f72a403da40 con 0x7f72b00b93f0 2020-05-18T21:34:17.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:17.531+0000 7f72b6db2700 1 -- 172.21.15.63:0/1696175294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_ops_throttle"]} v 0) v1 -- 0x7f72b0061c40 con 0x7f72b00b93f0 2020-05-18T21:34:18.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.243+0000 7f72b5db0700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72b00b93f0 0x7f72b0061490 secure :-1 s=THROTTLE_DONE pgs=1598 cs=0 l=1 rx=0x7f72b0145ac0 tx=0x7f72a400c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.243+0000 7f72a2ffd700 1 -- 172.21.15.63:0/1696175294 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_ops_throttle"]}]=0 v379) v1 ==== 135+0+0 (secure 0 0 0) 0x7f72a4041060 con 0x7f72b00b93f0 2020-05-18T21:34:18.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.247+0000 7f72b6db2700 1 -- 172.21.15.63:0/1696175294 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f729004f920 msgr2=0x7f7290051de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:18.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.247+0000 7f72b6db2700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f729004f920 0x7f7290051de0 secure :-1 s=READY pgs=620 cs=0 l=1 rx=0x7f72ac0032f0 tx=0x7f72ac00daf0).stop 2020-05-18T21:34:18.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.247+0000 7f72b6db2700 1 -- 172.21.15.63:0/1696175294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72b00b93f0 msgr2=0x7f72b0061490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:18.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.247+0000 7f72b6db2700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72b00b93f0 0x7f72b0061490 secure :-1 s=READY pgs=1598 cs=0 l=1 rx=0x7f72b0145ac0 tx=0x7f72a400c4d0).stop 2020-05-18T21:34:18.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.247+0000 7f72b6db2700 1 -- 172.21.15.63:0/1696175294 shutdown_connections 2020-05-18T21:34:18.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.247+0000 7f72b6db2700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f729004f920 0x7f7290051de0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:18.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.247+0000 7f72b6db2700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b01432f0 0x7f72b0144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:18.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.247+0000 7f72b6db2700 1 --2- 172.21.15.63:0/1696175294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72b00b93f0 0x7f72b0061490 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:18.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.247+0000 7f72b6db2700 1 -- 172.21.15.63:0/1696175294 >> 172.21.15.63:0/1696175294 conn(0x7f72b0069b70 msgr2=0x7f72b0142240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:18.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.247+0000 7f72b6db2700 1 -- 172.21.15.63:0/1696175294 shutdown_connections 2020-05-18T21:34:18.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.247+0000 7f72b6db2700 1 -- 172.21.15.63:0/1696175294 wait complete. 2020-05-18T21:34:18.265 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:34:18.266 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:34:18.285 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:34:18.305 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:34:18.306 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-05-18T21:34:18.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.411+0000 7fa7abf10700 1 Processor -- start 2020-05-18T21:34:18.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.411+0000 7fa7abf10700 1 -- start start 2020-05-18T21:34:18.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7abf10700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa7a4060b90 0x7fa7a40615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:18.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7abf10700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa7a40b2860 0x7fa7a414e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:18.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7abf10700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a4144090 0x7fa7a41444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:18.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7abf10700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a4144920 con 0x7fa7a4060b90 2020-05-18T21:34:18.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7abf10700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a4066210 con 0x7fa7a40b2860 2020-05-18T21:34:18.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7abf10700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a414d960 con 0x7fa7a4144090 2020-05-18T21:34:18.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7a9cac700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa7a4060b90 0x7fa7a40615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:18.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7a9cac700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa7a4060b90 0x7fa7a40615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33310/0 (socket says 172.21.15.63:33310) 2020-05-18T21:34:18.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7a9cac700 1 -- 172.21.15.63:0/3587816480 learned_addr learned my addr 172.21.15.63:0/3587816480 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:18.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7aa4ad700 1 --2- 172.21.15.63:0/3587816480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a4144090 0x7fa7a41444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:18.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7a94ab700 1 --2- 172.21.15.63:0/3587816480 >> v2:172.21.15.155:3300/0 conn(0x7fa7a40b2860 0x7fa7a414e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:18.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7a9cac700 1 -- 172.21.15.63:0/3587816480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a4144090 msgr2=0x7fa7a41444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:18.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7a9cac700 1 --2- 172.21.15.63:0/3587816480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a4144090 0x7fa7a41444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:18.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7a9cac700 1 -- 172.21.15.63:0/3587816480 >> v2:172.21.15.155:3300/0 conn(0x7fa7a40b2860 msgr2=0x7fa7a414e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:18.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7a9cac700 1 --2- 172.21.15.63:0/3587816480 >> v2:172.21.15.155:3300/0 conn(0x7fa7a40b2860 0x7fa7a414e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:18.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7a9cac700 1 -- 172.21.15.63:0/3587816480 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a414db90 con 0x7fa7a4060b90 2020-05-18T21:34:18.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7a94ab700 1 --2- 172.21.15.63:0/3587816480 >> v2:172.21.15.155:3300/0 conn(0x7fa7a40b2860 0x7fa7a414e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:34:18.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7a9cac700 1 --2- 172.21.15.63:0/3587816480 >> v2:172.21.15.63:3300/0 conn(0x7fa7a4060b90 0x7fa7a40615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa7a4066350 tx=0x7fa798008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7a9cac700 1 --2- 172.21.15.63:0/3587816480 >> v2:172.21.15.63:3300/0 conn(0x7fa7a4060b90 0x7fa7a40615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa7a4066350 tx=0x7fa798008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7a9cac700 1 --2- 172.21.15.63:0/3587816480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a4060b90 0x7fa7a40615e0 secure :-1 s=READY pgs=1599 cs=0 l=1 rx=0x7fa7a4066350 tx=0x7fa798008920).ready entity=mon.0 client_cookie=fc72f363cbca5bfe server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:18.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7a9cac700 1 --2- 172.21.15.63:0/3587816480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a4060b90 0x7fa7a40615e0 secure :-1 s=THROTTLE_DONE pgs=1599 cs=0 l=1 rx=0x7fa7a4066350 tx=0x7fa798008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7a8caa700 1 -- 172.21.15.63:0/3587816480 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7980116b0 con 0x7fa7a4060b90 2020-05-18T21:34:18.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7a9cac700 1 --2- 172.21.15.63:0/3587816480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a4060b90 0x7fa7a40615e0 secure :-1 s=THROTTLE_DONE pgs=1599 cs=0 l=1 rx=0x7fa7a4066350 tx=0x7fa798008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7a8caa700 1 -- 172.21.15.63:0/3587816480 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa798011810 con 0x7fa7a4060b90 2020-05-18T21:34:18.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7abf10700 1 -- 172.21.15.63:0/3587816480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a4060b90 msgr2=0x7fa7a40615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:18.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7a9cac700 1 --2- 172.21.15.63:0/3587816480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a4060b90 0x7fa7a40615e0 secure :-1 s=THROTTLE_DONE pgs=1599 cs=0 l=1 rx=0x7fa7a4066350 tx=0x7fa798008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7a8caa700 1 -- 172.21.15.63:0/3587816480 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa798011c30 con 0x7fa7a4060b90 2020-05-18T21:34:18.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7abf10700 1 --2- 172.21.15.63:0/3587816480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a4060b90 0x7fa7a40615e0 secure :-1 s=READY pgs=1599 cs=0 l=1 rx=0x7fa7a4066350 tx=0x7fa798008920).stop 2020-05-18T21:34:18.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7abf10700 1 -- 172.21.15.63:0/3587816480 shutdown_connections 2020-05-18T21:34:18.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7abf10700 1 --2- 172.21.15.63:0/3587816480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a4144090 0x7fa7a41444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:18.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7abf10700 1 --2- 172.21.15.63:0/3587816480 >> v2:172.21.15.155:3300/0 conn(0x7fa7a40b2860 0x7fa7a414e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:18.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7abf10700 1 --2- 172.21.15.63:0/3587816480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a4060b90 0x7fa7a40615e0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:18.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7abf10700 1 -- 172.21.15.63:0/3587816480 >> 172.21.15.63:0/3587816480 conn(0x7fa7a40b83d0 msgr2=0x7fa7a40b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:18.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7abf10700 1 -- 172.21.15.63:0/3587816480 shutdown_connections 2020-05-18T21:34:18.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.415+0000 7fa7abf10700 1 -- 172.21.15.63:0/3587816480 wait complete. 2020-05-18T21:34:18.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.419+0000 7fa7abf10700 1 Processor -- start 2020-05-18T21:34:18.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.419+0000 7fa7abf10700 1 -- start start 2020-05-18T21:34:18.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.419+0000 7fa7abf10700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa7a4144090 0x7fa7a40acba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:18.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.419+0000 7fa7abf10700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a41418d0 con 0x7fa7a4060b90 2020-05-18T21:34:18.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.419+0000 7fa7abf10700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a40b72e0 con 0x7fa7a40b2860 2020-05-18T21:34:18.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.419+0000 7fa7abf10700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a4135f40 con 0x7fa7a4144090 2020-05-18T21:34:18.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.419+0000 7fa7a9cac700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa7a4060b90 0x7fa7a415aa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35502/0 (socket says 172.21.15.63:35502) 2020-05-18T21:34:18.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.419+0000 7fa7a9cac700 1 -- 172.21.15.63:0/2748319776 learned_addr learned my addr 172.21.15.63:0/2748319776 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:18.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.419+0000 7fa7aa4ad700 1 --2- 172.21.15.63:0/2748319776 >> v2:172.21.15.155:3300/0 conn(0x7fa7a4144090 0x7fa7a40acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:18.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.419+0000 7fa796ffd700 1 -- 172.21.15.63:0/2748319776 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719779874 0 0) 0x7fa7a41418d0 con 0x7fa7a4060b90 2020-05-18T21:34:18.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.419+0000 7fa796ffd700 1 -- 172.21.15.63:0/2748319776 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa784002fe0 con 0x7fa7a4060b90 2020-05-18T21:34:18.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.419+0000 7fa796ffd700 1 -- 172.21.15.63:0/2748319776 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342463807 0 0) 0x7fa7a40b72e0 con 0x7fa7a40b2860 2020-05-18T21:34:18.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.419+0000 7fa796ffd700 1 -- 172.21.15.63:0/2748319776 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7a41418d0 con 0x7fa7a40b2860 2020-05-18T21:34:18.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.419+0000 7fa7aa4ad700 1 -- 172.21.15.63:0/2748319776 >> v1:172.21.15.155:6789/0 conn(0x7fa7a40b2860 legacy=0x7fa7a415b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:18.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.419+0000 7fa7aa4ad700 1 -- 172.21.15.63:0/2748319776 >> v1:172.21.15.63:6789/0 conn(0x7fa7a4060b90 legacy=0x7fa7a415aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:18.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.419+0000 7fa7aa4ad700 1 -- 172.21.15.63:0/2748319776 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a4141b40 con 0x7fa7a4144090 2020-05-18T21:34:18.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.419+0000 7fa7aa4ad700 1 --2- 172.21.15.63:0/2748319776 >> v2:172.21.15.155:3300/0 conn(0x7fa7a4144090 0x7fa7a40acba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa79c0032f0 tx=0x7fa79c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.419+0000 7fa7aa4ad700 1 --2- 172.21.15.63:0/2748319776 >> v2:172.21.15.155:3300/0 conn(0x7fa7a4144090 0x7fa7a40acba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa79c0032f0 tx=0x7fa79c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.419+0000 7fa7aa4ad700 1 --2- 172.21.15.63:0/2748319776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a4144090 0x7fa7a40acba0 secure :-1 s=READY pgs=1061 cs=0 l=1 rx=0x7fa79c0032f0 tx=0x7fa79c010f20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:18.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.423+0000 7fa7aa4ad700 1 --2- 172.21.15.63:0/2748319776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a4144090 0x7fa7a40acba0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7fa79c0032f0 tx=0x7fa79c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.423+0000 7fa796ffd700 1 -- 172.21.15.63:0/2748319776 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79c012d10 con 0x7fa7a4144090 2020-05-18T21:34:18.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.423+0000 7fa7abf10700 1 -- 172.21.15.63:0/2748319776 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a4141de0 con 0x7fa7a4144090 2020-05-18T21:34:18.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.423+0000 7fa7aa4ad700 1 --2- 172.21.15.63:0/2748319776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a4144090 0x7fa7a40acba0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7fa79c0032f0 tx=0x7fa79c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.423+0000 7fa7aa4ad700 1 --2- 172.21.15.63:0/2748319776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a4144090 0x7fa7a40acba0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7fa79c0032f0 tx=0x7fa79c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.423+0000 7fa796ffd700 1 -- 172.21.15.63:0/2748319776 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c012e70 con 0x7fa7a4144090 2020-05-18T21:34:18.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.423+0000 7fa796ffd700 1 -- 172.21.15.63:0/2748319776 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79c00a370 con 0x7fa7a4144090 2020-05-18T21:34:18.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.423+0000 7fa7abf10700 1 -- 172.21.15.63:0/2748319776 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a40b7aa0 con 0x7fa7a4144090 2020-05-18T21:34:18.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.423+0000 7fa7aa4ad700 1 --2- 172.21.15.63:0/2748319776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a4144090 0x7fa7a40acba0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7fa79c0032f0 tx=0x7fa79c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.423+0000 7fa7abf10700 1 -- 172.21.15.63:0/2748319776 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a40569e0 con 0x7fa7a4144090 2020-05-18T21:34:18.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.423+0000 7fa796ffd700 1 -- 172.21.15.63:0/2748319776 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa79c00a5b0 con 0x7fa7a4144090 2020-05-18T21:34:18.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.423+0000 7fa7aa4ad700 1 --2- 172.21.15.63:0/2748319776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a4144090 0x7fa7a40acba0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7fa79c0032f0 tx=0x7fa79c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.423+0000 7fa796ffd700 1 --2- 172.21.15.63:0/2748319776 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa78404feb0 0x7fa784052370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:18.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.423+0000 7fa796ffd700 1 -- 172.21.15.63:0/2748319776 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa79c064520 con 0x7fa7a4144090 2020-05-18T21:34:18.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.423+0000 7fa7a9cac700 1 --2- 172.21.15.63:0/2748319776 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa78404feb0 0x7fa784052370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:18.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.423+0000 7fa7a9cac700 1 --2- 172.21.15.63:0/2748319776 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa78404feb0 0x7fa784052370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa798000bc0 tx=0x7fa7a405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.423+0000 7fa7a9cac700 1 --2- 172.21.15.63:0/2748319776 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa78404feb0 0x7fa784052370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa798000bc0 tx=0x7fa7a405fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.427+0000 7fa7a9cac700 1 --2- 172.21.15.63:0/2748319776 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa78404feb0 0x7fa784052370 secure :-1 s=READY pgs=621 cs=0 l=1 rx=0x7fa798000bc0 tx=0x7fa7a405fa60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:18.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.431+0000 7fa7aa4ad700 1 --2- 172.21.15.63:0/2748319776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a4144090 0x7fa7a40acba0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7fa79c0032f0 tx=0x7fa79c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.431+0000 7fa796ffd700 1 -- 172.21.15.63:0/2748319776 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa79c03e850 con 0x7fa7a4144090 2020-05-18T21:34:18.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.551+0000 7fa7abf10700 1 -- 172.21.15.63:0/2748319776 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa7a40008d0 con 0x7fa7a4144090 2020-05-18T21:34:18.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.551+0000 7fa7aa4ad700 1 --2- 172.21.15.63:0/2748319776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a4144090 0x7fa7a40acba0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7fa79c0032f0 tx=0x7fa79c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.551+0000 7fa796ffd700 1 -- 172.21.15.63:0/2748319776 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v114) v1 ==== 81+0+33710 (secure 0 0 0) 0x7fa79c041e70 con 0x7fa7a4144090 2020-05-18T21:34:18.557 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:18.557 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:34:18.557 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 114, 2020-05-18T21:34:18.557 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:34:18.558 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2020-05-18T21:26:28.798650+0000", 2020-05-18T21:34:18.558 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2020-05-18T21:33:47.617336+0000", 2020-05-18T21:34:18.558 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:34:18.558 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:34:18.558 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-05-18T21:34:18.559 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5799936, 2020-05-18T21:34:18.559 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2020-05-18T21:34:18.559 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2020-05-18T21:34:18.559 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2020-05-18T21:34:18.559 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2020-05-18T21:34:18.560 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2020-05-18T21:34:18.560 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:34:18.560 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 4, 2020-05-18T21:34:18.560 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2020-05-18T21:34:18.560 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-05-18T21:34:18.561 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2020-05-18T21:34:18.561 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2020-05-18T21:34:18.561 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 22, 2020-05-18T21:34:18.561 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 8, 2020-05-18T21:34:18.562 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2020-05-18T21:34:18.562 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "jewel", 2020-05-18T21:34:18.562 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "pacific", 2020-05-18T21:34:18.562 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:34:18.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.563 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2020-05-18T21:34:18.563 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "device_health_metrics", 2020-05-18T21:34:18.563 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:33.080792+0000", 2020-05-18T21:34:18.563 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:34:18.563 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:34:18.564 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:34:18.564 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:34:18.564 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:34:18.564 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:34:18.564 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:34:18.564 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:34:18.565 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2020-05-18T21:34:18.565 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2020-05-18T21:34:18.565 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2020-05-18T21:34:18.565 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2020-05-18T21:34:18.565 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2020-05-18T21:34:18.566 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:34:18.566 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:34:18.566 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:34:18.566 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:34:18.566 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:34:18.567 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:34:18.567 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:34:18.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.567 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "15", 2020-05-18T21:34:18.567 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:34:18.567 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:34:18.568 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:34:18.568 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:34:18.568 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:34:18.568 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:34:18.569 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:34:18.569 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:34:18.569 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:34:18.570 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:34:18.570 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:34:18.570 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:34:18.570 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:34:18.571 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:34:18.571 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:34:18.571 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:34:18.571 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:34:18.571 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:34:18.572 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:34:18.572 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:34:18.572 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:34:18.572 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:34:18.572 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:34:18.572 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:34:18.573 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:34:18.573 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:34:18.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.573 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:34:18.573 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:34:18.574 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:34:18.574 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:34:18.574 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:34:18.574 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:34:18.575 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:34:18.575 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:34:18.575 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:34:18.575 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:34:18.575 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:34:18.576 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:34:18.576 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2020-05-18T21:34:18.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.576 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:34:18.576 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_devicehealth": {} 2020-05-18T21:34:18.577 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.577 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2020-05-18T21:34:18.577 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2020-05-18T21:34:18.577 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:40.149370+0000", 2020-05-18T21:34:18.578 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:34:18.578 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:34:18.578 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:34:18.578 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:34:18.578 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:34:18.579 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:34:18.579 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:34:18.579 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:34:18.579 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:34:18.579 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:34:18.580 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:34:18.580 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:34:18.580 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:34:18.580 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:34:18.580 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:34:18.580 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:34:18.581 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:34:18.581 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:34:18.581 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:34:18.581 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:34:18.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.582 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2020-05-18T21:34:18.582 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:34:18.582 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:34:18.582 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:34:18.583 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:34:18.583 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:34:18.583 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:34:18.583 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:34:18.583 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:34:18.584 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:34:18.584 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:34:18.584 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:34:18.584 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:34:18.584 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:34:18.584 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:34:18.585 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:34:18.585 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:34:18.585 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:34:18.585 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:34:18.585 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:34:18.586 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:34:18.586 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:34:18.586 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:34:18.586 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:34:18.586 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:34:18.586 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:34:18.587 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:34:18.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.587 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:34:18.587 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:34:18.587 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:34:18.588 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:34:18.588 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:34:18.588 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:34:18.588 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:34:18.588 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:34:18.588 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:34:18.589 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:34:18.589 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:34:18.589 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:34:18.589 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:34:18.589 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2020-05-18T21:34:18.590 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.590 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 21, 2020-05-18T21:34:18.590 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2020-05-18T21:34:18.591 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:33:45.188898+0000", 2020-05-18T21:34:18.591 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:34:18.591 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:34:18.591 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:34:18.591 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:34:18.592 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:34:18.592 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:34:18.592 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:34:18.592 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:34:18.592 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:34:18.592 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:34:18.593 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:34:18.593 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:34:18.593 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:34:18.593 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:34:18.593 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:34:18.594 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:34:18.594 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:34:18.594 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:34:18.594 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:34:18.594 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:34:18.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.595 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "113", 2020-05-18T21:34:18.595 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:34:18.595 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:34:18.595 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:34:18.595 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:34:18.596 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:34:18.596 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:34:18.596 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:34:18.596 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:34:18.596 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:34:18.596 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:34:18.597 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:34:18.597 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:34:18.597 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:34:18.597 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:34:18.597 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:34:18.598 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:34:18.598 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:34:18.598 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:34:18.598 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:34:18.598 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:34:18.598 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:34:18.599 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:34:18.599 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:34:18.599 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:34:18.599 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:34:18.599 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:34:18.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.600 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:34:18.600 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:34:18.600 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:34:18.600 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:34:18.600 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:34:18.601 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:34:18.601 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:34:18.601 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:34:18.601 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:34:18.601 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:34:18.602 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:34:18.602 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:34:18.602 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2020-05-18T21:34:18.602 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2020-05-18T21:34:18.602 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2020-05-18T21:34:18.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.603 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:34:18.603 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:34:18.603 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2020-05-18T21:34:18.603 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.603 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.604 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 22, 2020-05-18T21:34:18.604 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2020-05-18T21:34:18.604 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:33:45.614699+0000", 2020-05-18T21:34:18.605 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:34:18.605 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:34:18.605 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:34:18.605 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:34:18.605 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:34:18.605 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:34:18.606 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:34:18.606 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:34:18.606 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:34:18.606 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:34:18.606 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:34:18.607 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:34:18.607 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:34:18.607 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:34:18.607 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:34:18.607 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:34:18.607 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:34:18.608 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:34:18.608 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:34:18.609 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:34:18.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.610 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "114", 2020-05-18T21:34:18.610 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:34:18.610 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:34:18.610 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:34:18.610 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:34:18.611 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:34:18.611 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:34:18.611 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:34:18.611 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:34:18.611 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:34:18.612 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:34:18.612 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:34:18.612 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:34:18.612 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:34:18.612 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:34:18.612 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:34:18.613 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:34:18.613 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:34:18.613 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:34:18.613 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:34:18.613 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:34:18.614 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:34:18.614 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:34:18.614 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:34:18.614 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:34:18.614 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:34:18.614 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:34:18.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.615 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:34:18.615 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:34:18.615 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:34:18.615 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:34:18.616 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:34:18.616 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:34:18.616 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:34:18.616 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:34:18.616 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:34:18.617 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:34:18.617 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:34:18.617 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:34:18.617 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:34:18.617 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:34:18.617 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2020-05-18T21:34:18.618 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.618 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.618 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.618 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:34:18.618 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2020-05-18T21:34:18.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.619 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:34:18.619 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "c6ae0fbf-604c-4e8d-b1b8-6038821420e3", 2020-05-18T21:34:18.619 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:34:18.619 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:34:18.619 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:34:18.620 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:34:18.620 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:34:18.620 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:34:18.620 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:34:18.620 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 102, 2020-05-18T21:34:18.621 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:34:18.621 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:34:18.621 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:34:18.621 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.621 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.622 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2020-05-18T21:34:18.622 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:34:18.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.622 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.623 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2020-05-18T21:34:18.623 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:34:18.623 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.623 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.624 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:34:18.624 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.624 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.624 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6802", 2020-05-18T21:34:18.624 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:34:18.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.625 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.625 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6803", 2020-05-18T21:34:18.625 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:34:18.626 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.626 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.626 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:34:18.626 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.627 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.627 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6806", 2020-05-18T21:34:18.627 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:34:18.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.628 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.628 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6807", 2020-05-18T21:34:18.628 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:34:18.628 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.628 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.629 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:34:18.629 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.629 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.629 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6804", 2020-05-18T21:34:18.630 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:34:18.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.630 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.630 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6805", 2020-05-18T21:34:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:34:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6801/12803", 2020-05-18T21:34:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6803/12803", 2020-05-18T21:34:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6807/12803", 2020-05-18T21:34:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6805/12803", 2020-05-18T21:34:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:34:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:34:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:34:18.633 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.633 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:34:18.633 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6", 2020-05-18T21:34:18.634 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:34:18.634 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:34:18.634 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:34:18.634 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:34:18.634 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:34:18.634 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:34:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:34:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 111, 2020-05-18T21:34:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:34:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:34:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:34:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6808", 2020-05-18T21:34:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:34:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.637 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.637 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6809", 2020-05-18T21:34:18.637 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:34:18.638 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.638 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.638 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:34:18.638 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6810", 2020-05-18T21:34:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:34:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.640 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.640 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6811", 2020-05-18T21:34:18.640 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:34:18.640 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.640 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:34:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6815", 2020-05-18T21:34:18.642 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:34:18.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.642 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.642 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6817", 2020-05-18T21:34:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:34:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:34:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.644 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.644 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6812", 2020-05-18T21:34:18.644 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:34:18.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6813", 2020-05-18T21:34:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:34:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.646 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6809/12804", 2020-05-18T21:34:18.646 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6811/12804", 2020-05-18T21:34:18.646 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6817/12804", 2020-05-18T21:34:18.646 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6813/12804", 2020-05-18T21:34:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:34:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:34:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:34:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:34:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "ec8d9fa9-dae9-45f6-b286-735ab3801c27", 2020-05-18T21:34:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:34:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:34:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:34:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:34:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:34:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:34:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:34:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 110, 2020-05-18T21:34:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:34:18.650 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:34:18.650 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:34:18.650 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.650 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6822", 2020-05-18T21:34:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:34:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6824", 2020-05-18T21:34:18.652 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:34:18.652 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.652 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.652 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:34:18.653 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.653 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.653 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6826", 2020-05-18T21:34:18.653 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:34:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6827", 2020-05-18T21:34:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:34:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.655 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.655 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:34:18.655 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6830", 2020-05-18T21:34:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:34:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.657 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6831", 2020-05-18T21:34:18.657 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:34:18.657 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.657 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:34:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6828", 2020-05-18T21:34:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:34:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6829", 2020-05-18T21:34:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:34:18.660 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.660 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.660 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6824/12806", 2020-05-18T21:34:18.660 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6827/12806", 2020-05-18T21:34:18.661 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6831/12806", 2020-05-18T21:34:18.661 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6829/12806", 2020-05-18T21:34:18.661 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:34:18.661 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:34:18.662 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:34:18.662 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.662 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:34:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "1030fedf-adad-4e79-b839-59385d4d7d2a", 2020-05-18T21:34:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:34:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:34:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:34:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:34:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:34:18.664 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:34:18.664 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:34:18.664 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 111, 2020-05-18T21:34:18.664 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:34:18.664 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:34:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:34:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6814", 2020-05-18T21:34:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:34:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6816", 2020-05-18T21:34:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:34:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:34:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6818", 2020-05-18T21:34:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:34:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.669 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.669 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6819", 2020-05-18T21:34:18.669 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:34:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:34:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6823", 2020-05-18T21:34:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:34:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6825", 2020-05-18T21:34:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:34:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:34:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.674 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6820", 2020-05-18T21:34:18.674 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:34:18.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.674 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.675 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6821", 2020-05-18T21:34:18.675 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:34:18.675 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.675 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.676 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6816/12805", 2020-05-18T21:34:18.676 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6819/12805", 2020-05-18T21:34:18.676 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6825/12805", 2020-05-18T21:34:18.676 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6821/12805", 2020-05-18T21:34:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:34:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:34:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:34:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.678 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:34:18.678 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "8ad15a9b-97b4-4002-b1d4-7292e09b4ef6", 2020-05-18T21:34:18.678 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:34:18.678 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:34:18.678 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:34:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:34:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:34:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:34:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:34:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 111, 2020-05-18T21:34:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:34:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:34:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:34:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6800", 2020-05-18T21:34:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:34:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.682 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6801", 2020-05-18T21:34:18.682 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:34:18.682 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.682 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.683 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:34:18.683 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.683 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.684 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6802", 2020-05-18T21:34:18.684 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:34:18.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.684 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.684 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6803", 2020-05-18T21:34:18.685 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:34:18.685 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.685 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.685 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:34:18.686 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.686 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.686 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6806", 2020-05-18T21:34:18.686 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:34:18.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.687 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.687 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6807", 2020-05-18T21:34:18.687 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:34:18.687 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:34:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6804", 2020-05-18T21:34:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:34:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.690 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6805", 2020-05-18T21:34:18.690 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:34:18.690 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.690 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6801/13023", 2020-05-18T21:34:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6803/13023", 2020-05-18T21:34:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6807/13023", 2020-05-18T21:34:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6805/13023", 2020-05-18T21:34:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:34:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:34:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:34:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:34:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0dce88f8-b984-43e1-95e2-4132171102d2", 2020-05-18T21:34:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:34:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:34:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:34:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:34:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:34:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:34:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:34:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 111, 2020-05-18T21:34:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:34:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:34:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:34:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6808", 2020-05-18T21:34:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:34:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6809", 2020-05-18T21:34:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:34:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:34:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6810", 2020-05-18T21:34:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:34:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.699 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.699 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6811", 2020-05-18T21:34:18.699 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:34:18.699 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.699 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:34:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6814", 2020-05-18T21:34:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:34:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6816", 2020-05-18T21:34:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:34:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:34:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6812", 2020-05-18T21:34:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:34:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6813", 2020-05-18T21:34:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:34:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6809/13024", 2020-05-18T21:34:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6811/13024", 2020-05-18T21:34:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6816/13024", 2020-05-18T21:34:18.706 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6813/13024", 2020-05-18T21:34:18.706 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:34:18.706 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:34:18.706 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:34:18.706 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.707 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:34:18.707 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "e1bc92f8-3692-4483-b0fb-905c94fa1469", 2020-05-18T21:34:18.707 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:34:18.707 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:34:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:34:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:34:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:34:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:34:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:34:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 111, 2020-05-18T21:34:18.709 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:34:18.709 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:34:18.709 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:34:18.709 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.710 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.710 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6815", 2020-05-18T21:34:18.710 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:34:18.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6817", 2020-05-18T21:34:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:34:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.712 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:34:18.712 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.712 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.713 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6818", 2020-05-18T21:34:18.713 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:34:18.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.713 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.714 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6819", 2020-05-18T21:34:18.714 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:34:18.714 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.714 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.714 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:34:18.715 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.715 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.715 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6822", 2020-05-18T21:34:18.715 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:34:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6824", 2020-05-18T21:34:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:34:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.717 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.717 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:34:18.717 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6820", 2020-05-18T21:34:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:34:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.719 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6821", 2020-05-18T21:34:18.719 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:34:18.719 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.719 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6817/13025", 2020-05-18T21:34:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6819/13025", 2020-05-18T21:34:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6824/13025", 2020-05-18T21:34:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6821/13025", 2020-05-18T21:34:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:34:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:34:18.721 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:34:18.721 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.721 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:34:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "b76e000c-a078-48c4-9e1e-34d286a9992c", 2020-05-18T21:34:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:34:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:34:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:34:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:34:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:34:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:34:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:34:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 110, 2020-05-18T21:34:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:34:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:34:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:34:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6823", 2020-05-18T21:34:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:34:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6825", 2020-05-18T21:34:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:34:18.726 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.726 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.726 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:34:18.726 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6826", 2020-05-18T21:34:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:34:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.728 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.728 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6827", 2020-05-18T21:34:18.728 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:34:18.728 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.728 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:34:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6830", 2020-05-18T21:34:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:34:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6831", 2020-05-18T21:34:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:34:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:34:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:34:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:34:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6828", 2020-05-18T21:34:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:34:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6829", 2020-05-18T21:34:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:34:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6825/13026", 2020-05-18T21:34:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6827/13026", 2020-05-18T21:34:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6831/13026", 2020-05-18T21:34:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6829/13026", 2020-05-18T21:34:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:34:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:34:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:34:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:34:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2020-05-18T21:34:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:34:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:34:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:34:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:34:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:34:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:34:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.281434+0000", 2020-05-18T21:34:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:34:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:34:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:34:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:34:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:34:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:34:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:34:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.608518+0000", 2020-05-18T21:34:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:34:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:34:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:34:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:34:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:34:18.741 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:34:18.741 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:34:18.741 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.582386+0000", 2020-05-18T21:34:18.741 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:34:18.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:34:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:34:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:34:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:34:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:34:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:34:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.573488+0000", 2020-05-18T21:34:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:34:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.744 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:34:18.744 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:34:18.744 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:34:18.744 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:34:18.744 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:34:18.745 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:34:18.745 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.604174+0000", 2020-05-18T21:34:18.745 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:34:18.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.745 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.745 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:34:18.746 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:34:18.746 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:34:18.746 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:34:18.746 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:34:18.746 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:34:18.747 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.371004+0000", 2020-05-18T21:34:18.747 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:34:18.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.747 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:34:18.747 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:34:18.748 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:34:18.748 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:34:18.748 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:34:18.748 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:34:18.748 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.593070+0000", 2020-05-18T21:34:18.749 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:34:18.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:18.749 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:34:18.749 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:34:18.749 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:34:18.750 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:34:18.750 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:34:18.750 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:34:18.750 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.667677+0000", 2020-05-18T21:34:18.750 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:34:18.751 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.751 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:34:18.751 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2020-05-18T21:34:18.751 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2020-05-18T21:34:18.751 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2020-05-18T21:34:18.751 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2020-05-18T21:34:18.752 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklist": {}, 2020-05-18T21:34:18.752 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2020-05-18T21:34:18.752 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2020-05-18T21:34:18.752 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2020-05-18T21:34:18.752 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2020-05-18T21:34:18.753 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2020-05-18T21:34:18.753 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2020-05-18T21:34:18.753 INFO:teuthology.orchestra.run.smithi063.stdout: "ruleset-failure-domain": "osd", 2020-05-18T21:34:18.753 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2020-05-18T21:34:18.753 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:18.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:18.754 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2020-05-18T21:34:18.754 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2020-05-18T21:34:18.754 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2020-05-18T21:34:18.754 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2020-05-18T21:34:18.754 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {} 2020-05-18T21:34:18.755 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:34:18.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.555+0000 7fa7abf10700 1 -- 172.21.15.63:0/2748319776 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa78404feb0 msgr2=0x7fa784052370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:18.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.555+0000 7fa7abf10700 1 --2- 172.21.15.63:0/2748319776 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa78404feb0 0x7fa784052370 secure :-1 s=READY pgs=621 cs=0 l=1 rx=0x7fa798000bc0 tx=0x7fa7a405fa60).stop 2020-05-18T21:34:18.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.555+0000 7fa7abf10700 1 -- 172.21.15.63:0/2748319776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a4144090 msgr2=0x7fa7a40acba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:18.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.555+0000 7fa7abf10700 1 --2- 172.21.15.63:0/2748319776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a4144090 0x7fa7a40acba0 secure :-1 s=READY pgs=1061 cs=0 l=1 rx=0x7fa79c0032f0 tx=0x7fa79c010f20).stop 2020-05-18T21:34:18.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.555+0000 7fa7abf10700 1 -- 172.21.15.63:0/2748319776 shutdown_connections 2020-05-18T21:34:18.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.555+0000 7fa7abf10700 1 --2- 172.21.15.63:0/2748319776 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa78404feb0 0x7fa784052370 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:18.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.555+0000 7fa7abf10700 1 --2- 172.21.15.63:0/2748319776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a4144090 0x7fa7a40acba0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:18.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.555+0000 7fa7abf10700 1 -- 172.21.15.63:0/2748319776 >> 172.21.15.63:0/2748319776 conn(0x7fa7a40b83d0 msgr2=0x7fa7a4143150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:18.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.555+0000 7fa7abf10700 1 -- 172.21.15.63:0/2748319776 shutdown_connections 2020-05-18T21:34:18.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.555+0000 7fa7abf10700 1 -- 172.21.15.63:0/2748319776 wait complete. 2020-05-18T21:34:18.759 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:34:18.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.863+0000 7fb72f0a3700 1 Processor -- start 2020-05-18T21:34:18.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.863+0000 7fb72f0a3700 1 -- start start 2020-05-18T21:34:18.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.863+0000 7fb72f0a3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb72805f110 0x7fb7280b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:18.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.863+0000 7fb72f0a3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb72814aa70 0x7fb7280648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:18.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.863+0000 7fb72f0a3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72814a330 con 0x7fb728064d20 2020-05-18T21:34:18.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.863+0000 7fb72f0a3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb72814a140 con 0x7fb72805f110 2020-05-18T21:34:18.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.863+0000 7fb72f0a3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72814a5d0 con 0x7fb72814aa70 2020-05-18T21:34:18.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.863+0000 7fb72e0a1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb72805f110 0x7fb7280b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:18.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.863+0000 7fb72d8a0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb72814aa70 0x7fb7280648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:18.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.863+0000 7fb72e0a1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb72805f110 0x7fb7280b4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33324/0 (socket says 172.21.15.63:33324) 2020-05-18T21:34:18.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.863+0000 7fb72e0a1700 1 -- 172.21.15.63:0/1634357827 learned_addr learned my addr 172.21.15.63:0/1634357827 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:18.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72d09f700 1 -- 172.21.15.63:0/1634357827 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446179091 0 0) 0x7fb72814a330 con 0x7fb728064d20 2020-05-18T21:34:18.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72d09f700 1 -- 172.21.15.63:0/1634357827 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb714003270 con 0x7fb728064d20 2020-05-18T21:34:18.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72d8a0700 1 -- 172.21.15.63:0/1634357827 >> v2:172.21.15.63:3300/0 conn(0x7fb72805f110 msgr2=0x7fb7280b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:18.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72d8a0700 1 --2- 172.21.15.63:0/1634357827 >> v2:172.21.15.63:3300/0 conn(0x7fb72805f110 0x7fb7280b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:18.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72d8a0700 1 -- 172.21.15.63:0/1634357827 >> v1:172.21.15.155:6789/0 conn(0x7fb728064d20 legacy=0x7fb72814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:18.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72d8a0700 1 -- 172.21.15.63:0/1634357827 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb728063430 con 0x7fb72814aa70 2020-05-18T21:34:18.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72e0a1700 1 --2- 172.21.15.63:0/1634357827 >> v2:172.21.15.63:3300/0 conn(0x7fb72805f110 0x7fb7280b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:18.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72d8a0700 1 --2- 172.21.15.63:0/1634357827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb72814aa70 0x7fb7280648c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb728063c70 tx=0x7fb71c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72d8a0700 1 --2- 172.21.15.63:0/1634357827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb72814aa70 0x7fb7280648c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb728063c70 tx=0x7fb71c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72d8a0700 1 --2- 172.21.15.63:0/1634357827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb72814aa70 0x7fb7280648c0 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7fb728063c70 tx=0x7fb71c008920).ready entity=mon.2 client_cookie=6ebe37d559901e0e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:18.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72d8a0700 1 --2- 172.21.15.63:0/1634357827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb72814aa70 0x7fb7280648c0 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7fb728063c70 tx=0x7fb71c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72d09f700 1 -- 172.21.15.63:0/1634357827 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb71c011540 con 0x7fb72814aa70 2020-05-18T21:34:18.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72d8a0700 1 --2- 172.21.15.63:0/1634357827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb72814aa70 0x7fb7280648c0 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7fb728063c70 tx=0x7fb71c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72d8a0700 1 --2- 172.21.15.63:0/1634357827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb72814aa70 0x7fb7280648c0 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7fb728063c70 tx=0x7fb71c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72d09f700 1 -- 172.21.15.63:0/1634357827 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c0116a0 con 0x7fb72814aa70 2020-05-18T21:34:18.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72d09f700 1 -- 172.21.15.63:0/1634357827 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb71c011a80 con 0x7fb72814aa70 2020-05-18T21:34:18.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72f0a3700 1 -- 172.21.15.63:0/1634357827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb72814aa70 msgr2=0x7fb7280648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:18.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72f0a3700 1 --2- 172.21.15.63:0/1634357827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb72814aa70 0x7fb7280648c0 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7fb728063c70 tx=0x7fb71c008920).stop 2020-05-18T21:34:18.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72f0a3700 1 -- 172.21.15.63:0/1634357827 shutdown_connections 2020-05-18T21:34:18.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72f0a3700 1 --2- 172.21.15.63:0/1634357827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb72814aa70 0x7fb7280648c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:18.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72f0a3700 1 --2- 172.21.15.63:0/1634357827 >> v2:172.21.15.63:3300/0 conn(0x7fb72805f110 0x7fb7280b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:18.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72f0a3700 1 -- 172.21.15.63:0/1634357827 >> 172.21.15.63:0/1634357827 conn(0x7fb728069fc0 msgr2=0x7fb72806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:18.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72f0a3700 1 -- 172.21.15.63:0/1634357827 shutdown_connections 2020-05-18T21:34:18.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.867+0000 7fb72f0a3700 1 -- 172.21.15.63:0/1634357827 wait complete. 2020-05-18T21:34:18.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.871+0000 7fb72f0a3700 1 Processor -- start 2020-05-18T21:34:18.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.871+0000 7fb72f0a3700 1 -- start start 2020-05-18T21:34:18.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.871+0000 7fb72f0a3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb728064d20 0x7fb7281576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:18.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.871+0000 7fb72f0a3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb72814aa70 0x7fb7281469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:18.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.871+0000 7fb72f0a3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb728146000 con 0x7fb72805f110 2020-05-18T21:34:18.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.871+0000 7fb72f0a3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7281462a0 con 0x7fb728064d20 2020-05-18T21:34:18.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.871+0000 7fb72f0a3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb728146540 con 0x7fb72814aa70 2020-05-18T21:34:18.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.871+0000 7fb72e0a1700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb72805f110 0x7fb72814b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35516/0 (socket says 172.21.15.63:35516) 2020-05-18T21:34:18.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.871+0000 7fb72e0a1700 1 -- 172.21.15.63:0/4072179096 learned_addr learned my addr 172.21.15.63:0/4072179096 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:18.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.871+0000 7fb72d8a0700 1 --2- 172.21.15.63:0/4072179096 >> v2:172.21.15.155:3300/0 conn(0x7fb728064d20 0x7fb7281576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:18.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.871+0000 7fb72e8a2700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb72814aa70 0x7fb7281469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:18.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb7277fe700 1 -- 172.21.15.63:0/4072179096 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651318073 0 0) 0x7fb728146000 con 0x7fb72805f110 2020-05-18T21:34:18.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb7277fe700 1 -- 172.21.15.63:0/4072179096 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb708002fe0 con 0x7fb72805f110 2020-05-18T21:34:18.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb72d8a0700 1 -- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb72814aa70 msgr2=0x7fb7281469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:18.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb72d8a0700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb72814aa70 0x7fb7281469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:18.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb72d8a0700 1 -- 172.21.15.63:0/4072179096 >> v1:172.21.15.63:6789/0 conn(0x7fb72805f110 legacy=0x7fb72814b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:18.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb72d8a0700 1 -- 172.21.15.63:0/4072179096 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72814d130 con 0x7fb728064d20 2020-05-18T21:34:18.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb72e8a2700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb72814aa70 0x7fb7281469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:18.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb72d8a0700 1 --2- 172.21.15.63:0/4072179096 >> v2:172.21.15.155:3300/0 conn(0x7fb728064d20 0x7fb7281576c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb728063c70 tx=0x7fb7280635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb72d8a0700 1 --2- 172.21.15.63:0/4072179096 >> v2:172.21.15.155:3300/0 conn(0x7fb728064d20 0x7fb7281576c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb728063c70 tx=0x7fb7280635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb72d8a0700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb728064d20 0x7fb7281576c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rx=0x7fb728063c70 tx=0x7fb7280635c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:18.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb72d8a0700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb728064d20 0x7fb7281576c0 secure :-1 s=THROTTLE_DONE pgs=1063 cs=0 l=1 rx=0x7fb728063c70 tx=0x7fb7280635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb72d8a0700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb728064d20 0x7fb7281576c0 secure :-1 s=THROTTLE_DONE pgs=1063 cs=0 l=1 rx=0x7fb728063c70 tx=0x7fb7280635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb7277fe700 1 -- 172.21.15.63:0/4072179096 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb71c011a50 con 0x7fb728064d20 2020-05-18T21:34:18.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb72d8a0700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb728064d20 0x7fb7281576c0 secure :-1 s=THROTTLE_DONE pgs=1063 cs=0 l=1 rx=0x7fb728063c70 tx=0x7fb7280635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb7277fe700 1 -- 172.21.15.63:0/4072179096 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c007170 con 0x7fb728064d20 2020-05-18T21:34:18.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb7277fe700 1 -- 172.21.15.63:0/4072179096 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb71c007550 con 0x7fb728064d20 2020-05-18T21:34:18.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb72f0a3700 1 -- 172.21.15.63:0/4072179096 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb728144e40 con 0x7fb728064d20 2020-05-18T21:34:18.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb72f0a3700 1 -- 172.21.15.63:0/4072179096 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb728146fe0 con 0x7fb728064d20 2020-05-18T21:34:18.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb72d8a0700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb728064d20 0x7fb7281576c0 secure :-1 s=THROTTLE_DONE pgs=1063 cs=0 l=1 rx=0x7fb728063c70 tx=0x7fb7280635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb72f0a3700 1 -- 172.21.15.63:0/4072179096 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7280569e0 con 0x7fb728064d20 2020-05-18T21:34:18.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb72d8a0700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb728064d20 0x7fb7281576c0 secure :-1 s=THROTTLE_DONE pgs=1063 cs=0 l=1 rx=0x7fb728063c70 tx=0x7fb7280635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb7277fe700 1 -- 172.21.15.63:0/4072179096 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb71c005700 con 0x7fb728064d20 2020-05-18T21:34:18.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb7277fe700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb70804fd20 0x7fb7080521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:18.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.875+0000 7fb7277fe700 1 -- 172.21.15.63:0/4072179096 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb71c0640c0 con 0x7fb728064d20 2020-05-18T21:34:18.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.879+0000 7fb72e0a1700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb70804fd20 0x7fb7080521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:18.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.879+0000 7fb72e0a1700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb70804fd20 0x7fb7080521e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb7180032f0 tx=0x7fb718009770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.879+0000 7fb72e0a1700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb70804fd20 0x7fb7080521e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb7180032f0 tx=0x7fb718009770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.879+0000 7fb72e0a1700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb70804fd20 0x7fb7080521e0 secure :-1 s=READY pgs=622 cs=0 l=1 rx=0x7fb7180032f0 tx=0x7fb718009770).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:18.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.887+0000 7fb72d8a0700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb728064d20 0x7fb7281576c0 secure :-1 s=THROTTLE_DONE pgs=1063 cs=0 l=1 rx=0x7fb728063c70 tx=0x7fb7280635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:18.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:18.887+0000 7fb7277fe700 1 -- 172.21.15.63:0/4072179096 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb71c03e530 con 0x7fb728064d20 2020-05-18T21:34:19.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.039+0000 7fb72f0a3700 1 -- 172.21.15.63:0/4072179096 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7281466b0 con 0x7fb728064d20 2020-05-18T21:34:19.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.039+0000 7fb72d8a0700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb728064d20 0x7fb7281576c0 secure :-1 s=THROTTLE_DONE pgs=1063 cs=0 l=1 rx=0x7fb728063c70 tx=0x7fb7280635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:19.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.039+0000 7fb7277fe700 1 -- 172.21.15.63:0/4072179096 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fb71c041b50 con 0x7fb728064d20 2020-05-18T21:34:19.043 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:19.044 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":86,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/911406335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":911406335},{"type":"v1","addr":"172.21.15.155:6835","nonce":911406335}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:46.613321+0000","modified":"2020-05-18T21:33:47.617221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8365":{"gid":8365,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/299278803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":299278803},{"type":"v1","addr":"172.21.15.63:6833","nonce":299278803}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-05-18T21:34:19.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.039+0000 7fb72f0a3700 1 -- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb70804fd20 msgr2=0x7fb7080521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:19.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.039+0000 7fb72f0a3700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb70804fd20 0x7fb7080521e0 secure :-1 s=READY pgs=622 cs=0 l=1 rx=0x7fb7180032f0 tx=0x7fb718009770).stop 2020-05-18T21:34:19.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.039+0000 7fb72f0a3700 1 -- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb728064d20 msgr2=0x7fb7281576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:19.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.039+0000 7fb72f0a3700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb728064d20 0x7fb7281576c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rx=0x7fb728063c70 tx=0x7fb7280635c0).stop 2020-05-18T21:34:19.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.043+0000 7fb72f0a3700 1 -- 172.21.15.63:0/4072179096 shutdown_connections 2020-05-18T21:34:19.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.043+0000 7fb72f0a3700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb70804fd20 0x7fb7080521e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:19.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.043+0000 7fb72f0a3700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb72814aa70 0x7fb7281469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:19.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.043+0000 7fb72f0a3700 1 --2- 172.21.15.63:0/4072179096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb728064d20 0x7fb7281576c0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:19.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.043+0000 7fb72f0a3700 1 -- 172.21.15.63:0/4072179096 >> 172.21.15.63:0/4072179096 conn(0x7fb728069fc0 msgr2=0x7fb728143780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:19.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.043+0000 7fb72f0a3700 1 -- 172.21.15.63:0/4072179096 shutdown_connections 2020-05-18T21:34:19.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.043+0000 7fb72f0a3700 1 -- 172.21.15.63:0/4072179096 wait complete. 2020-05-18T21:34:19.047 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 86 2020-05-18T21:34:19.056 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-05-18T21:34:19.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec254db700 1 Processor -- start 2020-05-18T21:34:19.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec254db700 1 -- start start 2020-05-18T21:34:19.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec254db700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fec200b2310 0x7fec2014e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:19.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec254db700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fec200b89a0 0x7fec200b8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:19.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec254db700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2014e660 con 0x7fec20065a10 2020-05-18T21:34:19.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec254db700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec200b4bd0 con 0x7fec200b89a0 2020-05-18T21:34:19.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec254db700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2014b0d0 con 0x7fec200b2310 2020-05-18T21:34:19.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec1f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fec20065a10 0x7fec2014a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35526/0 (socket says 172.21.15.63:35526) 2020-05-18T21:34:19.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec24cda700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fec200b89a0 0x7fec200b8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:19.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec1f7fe700 1 -- 172.21.15.63:0/2808871655 learned_addr learned my addr 172.21.15.63:0/2808871655 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:19.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec1ffff700 1 --2- 172.21.15.63:0/2808871655 >> v2:172.21.15.155:3300/0 conn(0x7fec200b2310 0x7fec2014e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:19.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec1effd700 1 -- 172.21.15.63:0/2808871655 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037893830 0 0) 0x7fec2014e660 con 0x7fec20065a10 2020-05-18T21:34:19.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec1effd700 1 -- 172.21.15.63:0/2808871655 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec0c003270 con 0x7fec20065a10 2020-05-18T21:34:19.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec24cda700 1 -- 172.21.15.63:0/2808871655 >> v2:172.21.15.155:3300/0 conn(0x7fec200b2310 msgr2=0x7fec2014e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:19.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec24cda700 1 --2- 172.21.15.63:0/2808871655 >> v2:172.21.15.155:3300/0 conn(0x7fec200b2310 0x7fec2014e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:19.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec24cda700 1 -- 172.21.15.63:0/2808871655 >> v1:172.21.15.63:6789/0 conn(0x7fec20065a10 legacy=0x7fec2014a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:19.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec24cda700 1 -- 172.21.15.63:0/2808871655 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2014a280 con 0x7fec200b89a0 2020-05-18T21:34:19.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec24cda700 1 --2- 172.21.15.63:0/2808871655 >> v2:172.21.15.63:3300/0 conn(0x7fec200b89a0 0x7fec200b8e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fec180032f0 tx=0x7fec18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:19.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec24cda700 1 --2- 172.21.15.63:0/2808871655 >> v2:172.21.15.63:3300/0 conn(0x7fec200b89a0 0x7fec200b8e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fec180032f0 tx=0x7fec18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:19.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec24cda700 1 --2- 172.21.15.63:0/2808871655 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec200b89a0 0x7fec200b8e30 secure :-1 s=READY pgs=1603 cs=0 l=1 rx=0x7fec180032f0 tx=0x7fec18007e00).ready entity=mon.0 client_cookie=bb43ef4b65199b9a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:19.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec24cda700 1 --2- 172.21.15.63:0/2808871655 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec200b89a0 0x7fec200b8e30 secure :-1 s=THROTTLE_DONE pgs=1603 cs=0 l=1 rx=0x7fec180032f0 tx=0x7fec18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:19.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec1effd700 1 -- 172.21.15.63:0/2808871655 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec18011db0 con 0x7fec200b89a0 2020-05-18T21:34:19.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec24cda700 1 --2- 172.21.15.63:0/2808871655 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec200b89a0 0x7fec200b8e30 secure :-1 s=THROTTLE_DONE pgs=1603 cs=0 l=1 rx=0x7fec180032f0 tx=0x7fec18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:19.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec1effd700 1 -- 172.21.15.63:0/2808871655 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1800a180 con 0x7fec200b89a0 2020-05-18T21:34:19.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec24cda700 1 --2- 172.21.15.63:0/2808871655 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec200b89a0 0x7fec200b8e30 secure :-1 s=THROTTLE_DONE pgs=1603 cs=0 l=1 rx=0x7fec180032f0 tx=0x7fec18007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:19.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec254db700 1 -- 172.21.15.63:0/2808871655 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec200b89a0 msgr2=0x7fec200b8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:19.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec254db700 1 --2- 172.21.15.63:0/2808871655 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec200b89a0 0x7fec200b8e30 secure :-1 s=READY pgs=1603 cs=0 l=1 rx=0x7fec180032f0 tx=0x7fec18007e00).stop 2020-05-18T21:34:19.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.159+0000 7fec1effd700 1 -- 172.21.15.63:0/2808871655 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1800a5a0 con 0x7fec200b89a0 2020-05-18T21:34:19.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec254db700 1 -- 172.21.15.63:0/2808871655 shutdown_connections 2020-05-18T21:34:19.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec254db700 1 --2- 172.21.15.63:0/2808871655 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec200b89a0 0x7fec200b8e30 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:19.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec254db700 1 --2- 172.21.15.63:0/2808871655 >> v2:172.21.15.155:3300/0 conn(0x7fec200b2310 0x7fec2014e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:19.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec254db700 1 -- 172.21.15.63:0/2808871655 >> 172.21.15.63:0/2808871655 conn(0x7fec2005fb50 msgr2=0x7fec200b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:19.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec254db700 1 -- 172.21.15.63:0/2808871655 shutdown_connections 2020-05-18T21:34:19.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec254db700 1 -- 172.21.15.63:0/2808871655 wait complete. 2020-05-18T21:34:19.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec254db700 1 Processor -- start 2020-05-18T21:34:19.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec254db700 1 -- start start 2020-05-18T21:34:19.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec254db700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fec200b89a0 0x7fec20148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:19.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec254db700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec20146a10 con 0x7fec200b2310 2020-05-18T21:34:19.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec254db700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec20146cb0 con 0x7fec20065a10 2020-05-18T21:34:19.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec254db700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec200b1380 con 0x7fec200b89a0 2020-05-18T21:34:19.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec1f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fec200b2310 0x7fec20145420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35532/0 (socket says 172.21.15.63:35532) 2020-05-18T21:34:19.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec1f7fe700 1 -- 172.21.15.63:0/697326582 learned_addr learned my addr 172.21.15.63:0/697326582 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:19.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec24cda700 1 --2- 172.21.15.63:0/697326582 >> v2:172.21.15.155:3300/0 conn(0x7fec200b89a0 0x7fec20148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:19.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec1d7fa700 1 -- 172.21.15.63:0/697326582 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443823495 0 0) 0x7fec20146a10 con 0x7fec200b2310 2020-05-18T21:34:19.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec1d7fa700 1 -- 172.21.15.63:0/697326582 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec00002fe0 con 0x7fec200b2310 2020-05-18T21:34:19.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec1d7fa700 1 -- 172.21.15.63:0/697326582 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2331442714 0 0) 0x7fec00002fe0 con 0x7fec200b2310 2020-05-18T21:34:19.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec1d7fa700 1 -- 172.21.15.63:0/697326582 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fec20146a10 con 0x7fec200b2310 2020-05-18T21:34:19.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec1d7fa700 1 -- 172.21.15.63:0/697326582 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fec14001980 con 0x7fec200b2310 2020-05-18T21:34:19.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec1d7fa700 1 -- 172.21.15.63:0/697326582 >> v2:172.21.15.155:3300/0 conn(0x7fec200b89a0 msgr2=0x7fec20148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:19.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec1d7fa700 1 --2- 172.21.15.63:0/697326582 >> v2:172.21.15.155:3300/0 conn(0x7fec200b89a0 0x7fec20148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:19.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec1d7fa700 1 -- 172.21.15.63:0/697326582 >> v1:172.21.15.155:6789/0 conn(0x7fec20065a10 legacy=0x7fec200b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:19.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec1d7fa700 1 -- 172.21.15.63:0/697326582 >> v1:172.21.15.63:6789/0 conn(0x7fec200b2310 legacy=0x7fec20145420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:19.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec1d7fa700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec00004a80 0x7fec00004e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:19.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec1d7fa700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec00005310 0x7fec00003a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:19.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec1d7fa700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec00003f90 0x7fec00004410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:19.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec1d7fa700 1 -- 172.21.15.63:0/697326582 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec200b1380 con 0x7fec00004a80 2020-05-18T21:34:19.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec1d7fa700 1 -- 172.21.15.63:0/697326582 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0000b7f0 con 0x7fec00005310 2020-05-18T21:34:19.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec1d7fa700 1 -- 172.21.15.63:0/697326582 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0000b9b0 con 0x7fec00003f90 2020-05-18T21:34:19.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec24cda700 1 --2- 172.21.15.63:0/697326582 >> v2:172.21.15.155:3300/0 conn(0x7fec200b89a0 0x7fec20148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:19.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec1ffff700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec00004a80 0x7fec00004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:19.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.163+0000 7fec1f7fe700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec00005310 0x7fec00003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:19.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec24cda700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec00003f90 0x7fec00004410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:19.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1ffff700 1 -- 172.21.15.63:0/697326582 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec00003f90 msgr2=0x7fec00004410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:19.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1ffff700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec00003f90 0x7fec00004410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:19.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1ffff700 1 -- 172.21.15.63:0/697326582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec00005310 msgr2=0x7fec00003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:19.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1ffff700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec00005310 0x7fec00003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:19.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1ffff700 1 -- 172.21.15.63:0/697326582 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec200afc50 con 0x7fec00004a80 2020-05-18T21:34:19.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec24cda700 1 -- 172.21.15.63:0/697326582 reap_dead start 2020-05-18T21:34:19.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec254db700 1 -- 172.21.15.63:0/697326582 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec200afea0 con 0x7fec00004a80 2020-05-18T21:34:19.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1ffff700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec00004a80 0x7fec00004e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fec10007960 tx=0x7fec2005e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:19.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec254db700 1 -- 172.21.15.63:0/697326582 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec20065200 con 0x7fec00004a80 2020-05-18T21:34:19.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1ffff700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec00004a80 0x7fec00004e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fec10007960 tx=0x7fec2005e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:19.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1ffff700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec00004a80 0x7fec00004e60 secure :-1 s=READY pgs=1605 cs=0 l=1 rx=0x7fec10007960 tx=0x7fec2005e150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:19.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1ffff700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec00004a80 0x7fec00004e60 secure :-1 s=THROTTLE_DONE pgs=1605 cs=0 l=1 rx=0x7fec10007960 tx=0x7fec2005e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:19.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1ffff700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec00004a80 0x7fec00004e60 secure :-1 s=THROTTLE_DONE pgs=1605 cs=0 l=1 rx=0x7fec10007960 tx=0x7fec2005e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:19.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1ffff700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec00004a80 0x7fec00004e60 secure :-1 s=THROTTLE_DONE pgs=1605 cs=0 l=1 rx=0x7fec10007960 tx=0x7fec2005e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:19.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1d7fa700 1 -- 172.21.15.63:0/697326582 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec10007610 con 0x7fec00004a80 2020-05-18T21:34:19.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1d7fa700 1 -- 172.21.15.63:0/697326582 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1000e7a0 con 0x7fec00004a80 2020-05-18T21:34:19.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1d7fa700 1 -- 172.21.15.63:0/697326582 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1000eb40 con 0x7fec00004a80 2020-05-18T21:34:19.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1ffff700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec00004a80 0x7fec00004e60 secure :-1 s=THROTTLE_DONE pgs=1605 cs=0 l=1 rx=0x7fec10007960 tx=0x7fec2005e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:19.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1d7fa700 1 -- 172.21.15.63:0/697326582 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fec1000eca0 con 0x7fec00004a80 2020-05-18T21:34:19.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1ffff700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec00004a80 0x7fec00004e60 secure :-1 s=THROTTLE_DONE pgs=1605 cs=0 l=1 rx=0x7fec10007960 tx=0x7fec2005e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:19.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec254db700 1 -- 172.21.15.63:0/697326582 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febfc003380 con 0x7fec00004a80 2020-05-18T21:34:19.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1d7fa700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fec00053770 0x7fec00055c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:19.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1d7fa700 1 -- 172.21.15.63:0/697326582 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fec100645d0 con 0x7fec00004a80 2020-05-18T21:34:19.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1f7fe700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fec00053770 0x7fec00055c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:19.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1f7fe700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fec00053770 0x7fec00055c30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fec14005560 tx=0x7fec1400fd00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:19.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1f7fe700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fec00053770 0x7fec00055c30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fec14005560 tx=0x7fec1400fd00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:19.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.167+0000 7fec1f7fe700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fec00053770 0x7fec00055c30 secure :-1 s=READY pgs=623 cs=0 l=1 rx=0x7fec14005560 tx=0x7fec1400fd00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:19.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.175+0000 7fec1ffff700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec00004a80 0x7fec00004e60 secure :-1 s=THROTTLE_DONE pgs=1605 cs=0 l=1 rx=0x7fec10007960 tx=0x7fec2005e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:19.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.175+0000 7fec1d7fa700 1 -- 172.21.15.63:0/697326582 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fec1003e960 con 0x7fec00004a80 2020-05-18T21:34:19.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:19.323+0000 7fec254db700 1 -- 172.21.15.63:0/697326582 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7febfc002210 con 0x7fec00004a80 2020-05-18T21:34:20.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.163+0000 7fec1ffff700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec00004a80 0x7fec00004e60 secure :-1 s=READY pgs=1605 cs=0 l=1 rx=0x7fec10007960 tx=0x7fec2005e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.244 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:34:20.243+0000 7fdb4592c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:34:20.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.247+0000 7fec1ffff700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec00004a80 0x7fec00004e60 secure :-1 s=THROTTLE_DONE pgs=1605 cs=0 l=1 rx=0x7fec10007960 tx=0x7fec2005e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.247+0000 7fec1d7fa700 1 -- 172.21.15.63:0/697326582 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v87) v1 ==== 161+0+0 (secure 0 0 0) 0x7fec10041f80 con 0x7fec00004a80 2020-05-18T21:34:20.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.255+0000 7fec254db700 1 -- 172.21.15.63:0/697326582 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fec00053770 msgr2=0x7fec00055c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:20.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.255+0000 7fec254db700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fec00053770 0x7fec00055c30 secure :-1 s=READY pgs=623 cs=0 l=1 rx=0x7fec14005560 tx=0x7fec1400fd00).stop 2020-05-18T21:34:20.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.255+0000 7fec254db700 1 -- 172.21.15.63:0/697326582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec00004a80 msgr2=0x7fec00004e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:20.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.255+0000 7fec254db700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec00004a80 0x7fec00004e60 secure :-1 s=READY pgs=1605 cs=0 l=1 rx=0x7fec10007960 tx=0x7fec2005e150).stop 2020-05-18T21:34:20.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.255+0000 7fec254db700 1 -- 172.21.15.63:0/697326582 shutdown_connections 2020-05-18T21:34:20.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.255+0000 7fec254db700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fec00053770 0x7fec00055c30 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:20.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.255+0000 7fec254db700 1 --2- 172.21.15.63:0/697326582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec00004a80 0x7fec00004e60 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:20.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.255+0000 7fec254db700 1 -- 172.21.15.63:0/697326582 >> 172.21.15.63:0/697326582 conn(0x7fec2005fb50 msgr2=0x7fec200b4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:20.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.255+0000 7fec254db700 1 -- 172.21.15.63:0/697326582 shutdown_connections 2020-05-18T21:34:20.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.255+0000 7fec254db700 1 -- 172.21.15.63:0/697326582 wait complete. 2020-05-18T21:34:20.261 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-05-18T21:34:20.277 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:34:20.291 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:34:20.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.371+0000 7f0b43a45700 1 Processor -- start 2020-05-18T21:34:20.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.371+0000 7f0b43a45700 1 -- start start 2020-05-18T21:34:20.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b43a45700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b3c060b90 0x7f0b3c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:20.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b43a45700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0b3c14e570 0x7f0b3c14a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:20.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b43a45700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3c14d960 con 0x7f0b3c0b2860 2020-05-18T21:34:20.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b43a45700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3c066210 con 0x7f0b3c14e570 2020-05-18T21:34:20.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b43a45700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c14db90 con 0x7f0b3c060b90 2020-05-18T21:34:20.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b40fe0700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0b3c0b2860 0x7f0b3c144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35558/0 (socket says 172.21.15.63:35558) 2020-05-18T21:34:20.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b40fe0700 1 -- 172.21.15.63:0/2222541958 learned_addr learned my addr 172.21.15.63:0/2222541958 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:20.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b41fe2700 1 --2- 172.21.15.63:0/2222541958 >> v2:172.21.15.155:3300/0 conn(0x7f0b3c14e570 0x7f0b3c14a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:20.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b417e1700 1 --2- 172.21.15.63:0/2222541958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b3c060b90 0x7f0b3c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:20.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b3bfff700 1 -- 172.21.15.63:0/2222541958 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232821639 0 0) 0x7f0b3c14d960 con 0x7f0b3c0b2860 2020-05-18T21:34:20.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b3bfff700 1 -- 172.21.15.63:0/2222541958 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b28003270 con 0x7f0b3c0b2860 2020-05-18T21:34:20.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b417e1700 1 -- 172.21.15.63:0/2222541958 >> v2:172.21.15.155:3300/0 conn(0x7f0b3c14e570 msgr2=0x7f0b3c14a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:20.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b417e1700 1 --2- 172.21.15.63:0/2222541958 >> v2:172.21.15.155:3300/0 conn(0x7f0b3c14e570 0x7f0b3c14a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:20.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b417e1700 1 -- 172.21.15.63:0/2222541958 >> v1:172.21.15.63:6789/0 conn(0x7f0b3c0b2860 legacy=0x7f0b3c144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:20.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b417e1700 1 -- 172.21.15.63:0/2222541958 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3c14de30 con 0x7f0b3c060b90 2020-05-18T21:34:20.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b41fe2700 1 --2- 172.21.15.63:0/2222541958 >> v2:172.21.15.155:3300/0 conn(0x7f0b3c14e570 0x7f0b3c14a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:20.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b417e1700 1 --2- 172.21.15.63:0/2222541958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b3c060b90 0x7f0b3c0615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0b340032f0 tx=0x7f0b34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b417e1700 1 --2- 172.21.15.63:0/2222541958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b3c060b90 0x7f0b3c0615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0b340032f0 tx=0x7f0b34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b417e1700 1 --2- 172.21.15.63:0/2222541958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b3c060b90 0x7f0b3c0615e0 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f0b340032f0 tx=0x7f0b34007e00).ready entity=mon.2 client_cookie=c261ed894cdf1c7a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:20.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b417e1700 1 --2- 172.21.15.63:0/2222541958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b3c060b90 0x7f0b3c0615e0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f0b340032f0 tx=0x7f0b34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b3bfff700 1 -- 172.21.15.63:0/2222541958 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b34011db0 con 0x7f0b3c060b90 2020-05-18T21:34:20.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b417e1700 1 --2- 172.21.15.63:0/2222541958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b3c060b90 0x7f0b3c0615e0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f0b340032f0 tx=0x7f0b34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b417e1700 1 --2- 172.21.15.63:0/2222541958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b3c060b90 0x7f0b3c0615e0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f0b340032f0 tx=0x7f0b34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b3bfff700 1 -- 172.21.15.63:0/2222541958 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3400a180 con 0x7f0b3c060b90 2020-05-18T21:34:20.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b43a45700 1 -- 172.21.15.63:0/2222541958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b3c060b90 msgr2=0x7f0b3c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:20.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b43a45700 1 --2- 172.21.15.63:0/2222541958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b3c060b90 0x7f0b3c0615e0 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f0b340032f0 tx=0x7f0b34007e00).stop 2020-05-18T21:34:20.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b3bfff700 1 -- 172.21.15.63:0/2222541958 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b3400a5a0 con 0x7f0b3c060b90 2020-05-18T21:34:20.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b43a45700 1 -- 172.21.15.63:0/2222541958 shutdown_connections 2020-05-18T21:34:20.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b43a45700 1 --2- 172.21.15.63:0/2222541958 >> v2:172.21.15.155:3300/0 conn(0x7f0b3c14e570 0x7f0b3c14a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:20.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b43a45700 1 --2- 172.21.15.63:0/2222541958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b3c060b90 0x7f0b3c0615e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:20.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b43a45700 1 -- 172.21.15.63:0/2222541958 >> 172.21.15.63:0/2222541958 conn(0x7f0b3c0b83d0 msgr2=0x7f0b3c0b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:20.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b43a45700 1 -- 172.21.15.63:0/2222541958 shutdown_connections 2020-05-18T21:34:20.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.375+0000 7f0b43a45700 1 -- 172.21.15.63:0/2222541958 wait complete. 2020-05-18T21:34:20.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b43a45700 1 Processor -- start 2020-05-18T21:34:20.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b43a45700 1 -- start start 2020-05-18T21:34:20.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b43a45700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b3c060b90 0x7f0b3c14b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:20.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b43a45700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0b3c0b2860 0x7f0b3c14cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:20.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b43a45700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3c149580 con 0x7f0b3c14e570 2020-05-18T21:34:20.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b43a45700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3c149820 con 0x7f0b3c0b2860 2020-05-18T21:34:20.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b43a45700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c149ac0 con 0x7f0b3c060b90 2020-05-18T21:34:20.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b40fe0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0b3c0b2860 0x7f0b3c14cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:20.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b41fe2700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0b3c14e570 0x7f0b3c157840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35562/0 (socket says 172.21.15.63:35562) 2020-05-18T21:34:20.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b41fe2700 1 -- 172.21.15.63:0/1477673832 learned_addr learned my addr 172.21.15.63:0/1477673832 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:20.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b417e1700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b3c060b90 0x7f0b3c14b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:20.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b40fe0700 1 -- 172.21.15.63:0/1477673832 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b3c060b90 msgr2=0x7f0b3c14b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:20.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b40fe0700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b3c060b90 0x7f0b3c14b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:20.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b3a7fc700 1 -- 172.21.15.63:0/1477673832 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593798252 0 0) 0x7f0b3c149580 con 0x7f0b3c14e570 2020-05-18T21:34:20.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b40fe0700 1 -- 172.21.15.63:0/1477673832 >> v1:172.21.15.63:6789/0 conn(0x7f0b3c14e570 legacy=0x7f0b3c157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:20.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b40fe0700 1 -- 172.21.15.63:0/1477673832 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3c149d60 con 0x7f0b3c0b2860 2020-05-18T21:34:20.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b40fe0700 1 --2- 172.21.15.63:0/1477673832 >> v2:172.21.15.63:3300/0 conn(0x7f0b3c0b2860 0x7f0b3c14cde0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0b30001110 tx=0x7f0b30010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b40fe0700 1 --2- 172.21.15.63:0/1477673832 >> v2:172.21.15.63:3300/0 conn(0x7f0b3c0b2860 0x7f0b3c14cde0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0b30001110 tx=0x7f0b30010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b40fe0700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c0b2860 0x7f0b3c14cde0 secure :-1 s=READY pgs=1611 cs=0 l=1 rx=0x7f0b30001110 tx=0x7f0b30010930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:20.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b40fe0700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c0b2860 0x7f0b3c14cde0 secure :-1 s=THROTTLE_DONE pgs=1611 cs=0 l=1 rx=0x7f0b30001110 tx=0x7f0b30010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b3a7fc700 1 -- 172.21.15.63:0/1477673832 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b30005d00 con 0x7f0b3c0b2860 2020-05-18T21:34:20.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b40fe0700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c0b2860 0x7f0b3c14cde0 secure :-1 s=THROTTLE_DONE pgs=1611 cs=0 l=1 rx=0x7f0b30001110 tx=0x7f0b30010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b3a7fc700 1 -- 172.21.15.63:0/1477673832 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b30005e60 con 0x7f0b3c0b2860 2020-05-18T21:34:20.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b40fe0700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c0b2860 0x7f0b3c14cde0 secure :-1 s=THROTTLE_DONE pgs=1611 cs=0 l=1 rx=0x7f0b30001110 tx=0x7f0b30010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.379+0000 7f0b43a45700 1 -- 172.21.15.63:0/1477673832 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3c0ac810 con 0x7f0b3c0b2860 2020-05-18T21:34:20.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.383+0000 7f0b3a7fc700 1 -- 172.21.15.63:0/1477673832 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b300062c0 con 0x7f0b3c0b2860 2020-05-18T21:34:20.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.383+0000 7f0b43a45700 1 -- 172.21.15.63:0/1477673832 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3c0accc0 con 0x7f0b3c0b2860 2020-05-18T21:34:20.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.383+0000 7f0b40fe0700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c0b2860 0x7f0b3c14cde0 secure :-1 s=THROTTLE_DONE pgs=1611 cs=0 l=1 rx=0x7f0b30001110 tx=0x7f0b30010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.383+0000 7f0b43a45700 1 -- 172.21.15.63:0/1477673832 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b3c0569e0 con 0x7f0b3c0b2860 2020-05-18T21:34:20.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.383+0000 7f0b3a7fc700 1 -- 172.21.15.63:0/1477673832 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0b30006540 con 0x7f0b3c0b2860 2020-05-18T21:34:20.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.383+0000 7f0b40fe0700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c0b2860 0x7f0b3c14cde0 secure :-1 s=THROTTLE_DONE pgs=1611 cs=0 l=1 rx=0x7f0b30001110 tx=0x7f0b30010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.383+0000 7f0b3a7fc700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0b1c04f910 0x7f0b1c051dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:20.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.383+0000 7f0b3a7fc700 1 -- 172.21.15.63:0/1477673832 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0b300090c0 con 0x7f0b3c0b2860 2020-05-18T21:34:20.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.383+0000 7f0b417e1700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0b1c04f910 0x7f0b1c051dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:20.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.383+0000 7f0b417e1700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0b1c04f910 0x7f0b1c051dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0b340032f0 tx=0x7f0b34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.383+0000 7f0b417e1700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0b1c04f910 0x7f0b1c051dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0b340032f0 tx=0x7f0b34007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.383+0000 7f0b417e1700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0b1c04f910 0x7f0b1c051dd0 secure :-1 s=READY pgs=624 cs=0 l=1 rx=0x7f0b340032f0 tx=0x7f0b34007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:20.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.391+0000 7f0b40fe0700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c0b2860 0x7f0b3c14cde0 secure :-1 s=THROTTLE_DONE pgs=1611 cs=0 l=1 rx=0x7f0b30001110 tx=0x7f0b30010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.391+0000 7f0b3a7fc700 1 -- 172.21.15.63:0/1477673832 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f0b3003e070 con 0x7f0b3c0b2860 2020-05-18T21:34:20.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.539+0000 7f0b43a45700 1 -- 172.21.15.63:0/1477673832 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b3c0008d0 con 0x7f0b3c0b2860 2020-05-18T21:34:20.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.539+0000 7f0b40fe0700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c0b2860 0x7f0b3c14cde0 secure :-1 s=THROTTLE_DONE pgs=1611 cs=0 l=1 rx=0x7f0b30001110 tx=0x7f0b30010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.539+0000 7f0b3a7fc700 1 -- 172.21.15.63:0/1477673832 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+1782 (secure 0 0 0) 0x7f0b30041690 con 0x7f0b3c0b2860 2020-05-18T21:34:20.544 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:20.544 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":87,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/911406335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":911406335},{"type":"v1","addr":"172.21.15.155:6835","nonce":911406335}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":87,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:33:46.613321+0000","modified":"2020-05-18T21:34:20.243267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-05-18T21:34:20.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.543+0000 7f0b43a45700 1 -- 172.21.15.63:0/1477673832 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0b1c04f910 msgr2=0x7f0b1c051dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:20.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.543+0000 7f0b43a45700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0b1c04f910 0x7f0b1c051dd0 secure :-1 s=READY pgs=624 cs=0 l=1 rx=0x7f0b340032f0 tx=0x7f0b34007e00).stop 2020-05-18T21:34:20.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.543+0000 7f0b43a45700 1 -- 172.21.15.63:0/1477673832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c0b2860 msgr2=0x7f0b3c14cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:20.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.543+0000 7f0b43a45700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c0b2860 0x7f0b3c14cde0 secure :-1 s=READY pgs=1611 cs=0 l=1 rx=0x7f0b30001110 tx=0x7f0b30010930).stop 2020-05-18T21:34:20.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.543+0000 7f0b43a45700 1 -- 172.21.15.63:0/1477673832 shutdown_connections 2020-05-18T21:34:20.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.543+0000 7f0b43a45700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0b1c04f910 0x7f0b1c051dd0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:20.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.543+0000 7f0b43a45700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c0b2860 0x7f0b3c14cde0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:20.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.543+0000 7f0b43a45700 1 --2- 172.21.15.63:0/1477673832 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b3c060b90 0x7f0b3c14b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:20.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.543+0000 7f0b43a45700 1 -- 172.21.15.63:0/1477673832 >> 172.21.15.63:0/1477673832 conn(0x7f0b3c0b83d0 msgr2=0x7f0b3c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:20.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.543+0000 7f0b43a45700 1 -- 172.21.15.63:0/1477673832 shutdown_connections 2020-05-18T21:34:20.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.543+0000 7f0b43a45700 1 -- 172.21.15.63:0/1477673832 wait complete. 2020-05-18T21:34:20.548 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 87 2020-05-18T21:34:20.557 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-05-18T21:34:20.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.659+0000 7efed08a4700 1 Processor -- start 2020-05-18T21:34:20.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.659+0000 7efed08a4700 1 -- start start 2020-05-18T21:34:20.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efed08a4700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efecc061570 0x7efecc149f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:20.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efed08a4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efecc146520 0x7efecc146960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:20.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efed08a4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efecc145de0 con 0x7efecc0b9060 2020-05-18T21:34:20.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efed08a4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc0bcea0 con 0x7efecc146520 2020-05-18T21:34:20.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efed08a4700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc146080 con 0x7efecc061570 2020-05-18T21:34:20.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efec9d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efecc146520 0x7efecc146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:20.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efec9d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efecc146520 0x7efecc146960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33382/0 (socket says 172.21.15.63:33382) 2020-05-18T21:34:20.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efec9d9b700 1 -- 172.21.15.63:0/684943096 learned_addr learned my addr 172.21.15.63:0/684943096 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:20.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efeca59c700 1 --2- 172.21.15.63:0/684943096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efecc061570 0x7efecc149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:20.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efec959a700 1 -- 172.21.15.63:0/684943096 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284766531 0 0) 0x7efecc145de0 con 0x7efecc0b9060 2020-05-18T21:34:20.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efec959a700 1 -- 172.21.15.63:0/684943096 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeac003270 con 0x7efecc0b9060 2020-05-18T21:34:20.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efec9d9b700 1 -- 172.21.15.63:0/684943096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efecc061570 msgr2=0x7efecc149f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:20.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efec9d9b700 1 --2- 172.21.15.63:0/684943096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efecc061570 0x7efecc149f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:20.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efec9d9b700 1 -- 172.21.15.63:0/684943096 >> v1:172.21.15.155:6789/0 conn(0x7efecc0b9060 legacy=0x7efecc12ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:20.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efec9d9b700 1 -- 172.21.15.63:0/684943096 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc061950 con 0x7efecc146520 2020-05-18T21:34:20.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efeca59c700 1 --2- 172.21.15.63:0/684943096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efecc061570 0x7efecc149f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:20.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efec9d9b700 1 --2- 172.21.15.63:0/684943096 >> v2:172.21.15.63:3300/0 conn(0x7efecc146520 0x7efecc146960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efeb4002f70 tx=0x7efeb4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efec9d9b700 1 --2- 172.21.15.63:0/684943096 >> v2:172.21.15.63:3300/0 conn(0x7efecc146520 0x7efecc146960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efeb4002f70 tx=0x7efeb4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efec9d9b700 1 --2- 172.21.15.63:0/684943096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efecc146520 0x7efecc146960 secure :-1 s=READY pgs=1612 cs=0 l=1 rx=0x7efeb4002f70 tx=0x7efeb4007a80).ready entity=mon.0 client_cookie=564b46e0f708ff27 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:20.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efec9d9b700 1 --2- 172.21.15.63:0/684943096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efecc146520 0x7efecc146960 secure :-1 s=THROTTLE_DONE pgs=1612 cs=0 l=1 rx=0x7efeb4002f70 tx=0x7efeb4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efec959a700 1 -- 172.21.15.63:0/684943096 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeb4011600 con 0x7efecc146520 2020-05-18T21:34:20.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efec9d9b700 1 --2- 172.21.15.63:0/684943096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efecc146520 0x7efecc146960 secure :-1 s=THROTTLE_DONE pgs=1612 cs=0 l=1 rx=0x7efeb4002f70 tx=0x7efeb4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efec9d9b700 1 --2- 172.21.15.63:0/684943096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efecc146520 0x7efecc146960 secure :-1 s=THROTTLE_DONE pgs=1612 cs=0 l=1 rx=0x7efeb4002f70 tx=0x7efeb4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efec959a700 1 -- 172.21.15.63:0/684943096 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb4011760 con 0x7efecc146520 2020-05-18T21:34:20.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efec959a700 1 -- 172.21.15.63:0/684943096 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeb4011b80 con 0x7efecc146520 2020-05-18T21:34:20.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efed08a4700 1 -- 172.21.15.63:0/684943096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efecc146520 msgr2=0x7efecc146960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:20.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efed08a4700 1 --2- 172.21.15.63:0/684943096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efecc146520 0x7efecc146960 secure :-1 s=READY pgs=1612 cs=0 l=1 rx=0x7efeb4002f70 tx=0x7efeb4007a80).stop 2020-05-18T21:34:20.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efed08a4700 1 -- 172.21.15.63:0/684943096 shutdown_connections 2020-05-18T21:34:20.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efed08a4700 1 --2- 172.21.15.63:0/684943096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efecc146520 0x7efecc146960 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:20.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efed08a4700 1 --2- 172.21.15.63:0/684943096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efecc061570 0x7efecc149f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:20.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efed08a4700 1 -- 172.21.15.63:0/684943096 >> 172.21.15.63:0/684943096 conn(0x7efecc05f440 msgr2=0x7efecc05f820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:20.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efed08a4700 1 -- 172.21.15.63:0/684943096 shutdown_connections 2020-05-18T21:34:20.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.663+0000 7efed08a4700 1 -- 172.21.15.63:0/684943096 wait complete. 2020-05-18T21:34:20.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.667+0000 7efed08a4700 1 Processor -- start 2020-05-18T21:34:20.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.667+0000 7efed08a4700 1 -- start start 2020-05-18T21:34:20.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efed08a4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efecc061570 0x7efecc0b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:20.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efed08a4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efecc146520 0x7efecc0b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:20.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efed08a4700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efecc157040 con 0x7efecc0b9060 2020-05-18T21:34:20.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efed08a4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc156e30 con 0x7efecc061570 2020-05-18T21:34:20.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efed08a4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc1572e0 con 0x7efecc146520 2020-05-18T21:34:20.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efeca59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efecc061570 0x7efecc0b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:20.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efec9d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efecc0b9060 0x7efecc0b76f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35578/0 (socket says 172.21.15.63:35578) 2020-05-18T21:34:20.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efec9d9b700 1 -- 172.21.15.63:0/4209748630 learned_addr learned my addr 172.21.15.63:0/4209748630 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:20.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efecad9d700 1 --2- 172.21.15.63:0/4209748630 >> v2:172.21.15.155:3300/0 conn(0x7efecc146520 0x7efecc0b7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:20.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efec37fe700 1 -- 172.21.15.63:0/4209748630 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273497128 0 0) 0x7efecc157040 con 0x7efecc0b9060 2020-05-18T21:34:20.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efec37fe700 1 -- 172.21.15.63:0/4209748630 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeb0002fe0 con 0x7efecc0b9060 2020-05-18T21:34:20.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efec37fe700 1 -- 172.21.15.63:0/4209748630 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4190998116 0 0) 0x7efeb0002fe0 con 0x7efecc0b9060 2020-05-18T21:34:20.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efecad9d700 1 -- 172.21.15.63:0/4209748630 >> v2:172.21.15.63:3300/0 conn(0x7efecc061570 msgr2=0x7efecc0b6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:20.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efecad9d700 1 --2- 172.21.15.63:0/4209748630 >> v2:172.21.15.63:3300/0 conn(0x7efecc061570 0x7efecc0b6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:20.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efecad9d700 1 -- 172.21.15.63:0/4209748630 >> v1:172.21.15.63:6789/0 conn(0x7efecc0b9060 legacy=0x7efecc0b76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:20.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efecad9d700 1 -- 172.21.15.63:0/4209748630 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc0b7010 con 0x7efecc146520 2020-05-18T21:34:20.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efecad9d700 1 --2- 172.21.15.63:0/4209748630 >> v2:172.21.15.155:3300/0 conn(0x7efecc146520 0x7efecc0b7e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efecc0ae8a0 tx=0x7efec4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efecad9d700 1 --2- 172.21.15.63:0/4209748630 >> v2:172.21.15.155:3300/0 conn(0x7efecc146520 0x7efecc0b7e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efecc0ae8a0 tx=0x7efec4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efecad9d700 1 --2- 172.21.15.63:0/4209748630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efecc146520 0x7efecc0b7e00 secure :-1 s=READY pgs=1069 cs=0 l=1 rx=0x7efecc0ae8a0 tx=0x7efec4010c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:20.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efecad9d700 1 --2- 172.21.15.63:0/4209748630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efecc146520 0x7efecc0b7e00 secure :-1 s=THROTTLE_DONE pgs=1069 cs=0 l=1 rx=0x7efecc0ae8a0 tx=0x7efec4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efec37fe700 1 -- 172.21.15.63:0/4209748630 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeb4011e40 con 0x7efecc146520 2020-05-18T21:34:20.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efecad9d700 1 --2- 172.21.15.63:0/4209748630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efecc146520 0x7efecc0b7e00 secure :-1 s=THROTTLE_DONE pgs=1069 cs=0 l=1 rx=0x7efecc0ae8a0 tx=0x7efec4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efed08a4700 1 -- 172.21.15.63:0/4209748630 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efecc12bf20 con 0x7efecc146520 2020-05-18T21:34:20.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efec37fe700 1 -- 172.21.15.63:0/4209748630 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec4006d90 con 0x7efecc146520 2020-05-18T21:34:20.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efecad9d700 1 --2- 172.21.15.63:0/4209748630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efecc146520 0x7efecc0b7e00 secure :-1 s=THROTTLE_DONE pgs=1069 cs=0 l=1 rx=0x7efecc0ae8a0 tx=0x7efec4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efec37fe700 1 -- 172.21.15.63:0/4209748630 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efec4008370 con 0x7efecc146520 2020-05-18T21:34:20.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efed08a4700 1 -- 172.21.15.63:0/4209748630 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efecc156620 con 0x7efecc146520 2020-05-18T21:34:20.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efecad9d700 1 --2- 172.21.15.63:0/4209748630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efecc146520 0x7efecc0b7e00 secure :-1 s=THROTTLE_DONE pgs=1069 cs=0 l=1 rx=0x7efecc0ae8a0 tx=0x7efec4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.671+0000 7efed08a4700 1 -- 172.21.15.63:0/4209748630 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efecc0569e0 con 0x7efecc146520 2020-05-18T21:34:20.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.675+0000 7efec37fe700 1 -- 172.21.15.63:0/4209748630 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7efec40085b0 con 0x7efecc146520 2020-05-18T21:34:20.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.675+0000 7efecad9d700 1 --2- 172.21.15.63:0/4209748630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efecc146520 0x7efecc0b7e00 secure :-1 s=THROTTLE_DONE pgs=1069 cs=0 l=1 rx=0x7efecc0ae8a0 tx=0x7efec4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.675+0000 7efec37fe700 1 --2- 172.21.15.63:0/4209748630 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efeb004fce0 0x7efeb00521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:20.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.675+0000 7efec37fe700 1 -- 172.21.15.63:0/4209748630 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6159+0+0 (secure 0 0 0) 0x7efec4063ab0 con 0x7efecc146520 2020-05-18T21:34:20.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.675+0000 7efeca59c700 1 --2- 172.21.15.63:0/4209748630 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efeb004fce0 0x7efeb00521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:20.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.675+0000 7efeca59c700 1 --2- 172.21.15.63:0/4209748630 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efeb004fce0 0x7efeb00521a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efebc002f70 tx=0x7efebc00ebe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.675+0000 7efeca59c700 1 --2- 172.21.15.63:0/4209748630 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efeb004fce0 0x7efeb00521a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efebc002f70 tx=0x7efebc00ebe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.675+0000 7efeca59c700 1 --2- 172.21.15.63:0/4209748630 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efeb004fce0 0x7efeb00521a0 secure :-1 s=READY pgs=625 cs=0 l=1 rx=0x7efebc002f70 tx=0x7efebc00ebe0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:20.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.683+0000 7efecad9d700 1 --2- 172.21.15.63:0/4209748630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efecc146520 0x7efecc0b7e00 secure :-1 s=THROTTLE_DONE pgs=1069 cs=0 l=1 rx=0x7efecc0ae8a0 tx=0x7efec4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:20.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.683+0000 7efec37fe700 1 -- 172.21.15.63:0/4209748630 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7efec403de40 con 0x7efecc146520 2020-05-18T21:34:20.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:20.835+0000 7efed08a4700 1 -- 172.21.15.63:0/4209748630 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efecc0b71a0 con 0x7efecc146520 2020-05-18T21:34:21.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.271+0000 7efecad9d700 1 --2- 172.21.15.63:0/4209748630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efecc146520 0x7efecc0b7e00 secure :-1 s=THROTTLE_DONE pgs=1069 cs=0 l=1 rx=0x7efecc0ae8a0 tx=0x7efec4010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:21.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.271+0000 7efec37fe700 1 -- 172.21.15.63:0/4209748630 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v88) v1 ==== 104+0+0 (secure 0 0 0) 0x7efec4041460 con 0x7efecc146520 2020-05-18T21:34:21.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.275+0000 7efed08a4700 1 -- 172.21.15.63:0/4209748630 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efeb004fce0 msgr2=0x7efeb00521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:21.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.275+0000 7efed08a4700 1 --2- 172.21.15.63:0/4209748630 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efeb004fce0 0x7efeb00521a0 secure :-1 s=READY pgs=625 cs=0 l=1 rx=0x7efebc002f70 tx=0x7efebc00ebe0).stop 2020-05-18T21:34:21.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.275+0000 7efed08a4700 1 -- 172.21.15.63:0/4209748630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efecc146520 msgr2=0x7efecc0b7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:21.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.275+0000 7efed08a4700 1 --2- 172.21.15.63:0/4209748630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efecc146520 0x7efecc0b7e00 secure :-1 s=READY pgs=1069 cs=0 l=1 rx=0x7efecc0ae8a0 tx=0x7efec4010c40).stop 2020-05-18T21:34:21.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.275+0000 7efed08a4700 1 -- 172.21.15.63:0/4209748630 shutdown_connections 2020-05-18T21:34:21.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.275+0000 7efed08a4700 1 --2- 172.21.15.63:0/4209748630 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efeb004fce0 0x7efeb00521a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:21.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.275+0000 7efed08a4700 1 --2- 172.21.15.63:0/4209748630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efecc146520 0x7efecc0b7e00 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:21.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.275+0000 7efed08a4700 1 --2- 172.21.15.63:0/4209748630 >> v2:172.21.15.63:3300/0 conn(0x7efecc061570 0x7efecc0b6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:21.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.275+0000 7efed08a4700 1 -- 172.21.15.63:0/4209748630 >> 172.21.15.63:0/4209748630 conn(0x7efecc05f440 msgr2=0x7efecc060470 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:21.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.275+0000 7efed08a4700 1 -- 172.21.15.63:0/4209748630 shutdown_connections 2020-05-18T21:34:21.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.275+0000 7efed08a4700 1 -- 172.21.15.63:0/4209748630 wait complete. 2020-05-18T21:34:21.295 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-05-18T21:34:21.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.403+0000 7fbd22d3f700 1 Processor -- start 2020-05-18T21:34:21.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.403+0000 7fbd22d3f700 1 -- start start 2020-05-18T21:34:21.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd22d3f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbd1c149d50 0x7fbd1c06a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:21.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd22d3f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 0x7fbd1c0ad830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:21.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd22d3f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1c0b3790 con 0x7fbd1c0adc90 2020-05-18T21:34:21.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd22d3f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1c0b39f0 con 0x7fbd1c149d50 2020-05-18T21:34:21.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd22d3f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c0b3c90 con 0x7fbd1c0ad3f0 2020-05-18T21:34:21.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd2253e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbd1c0adc90 0x7fbd1c060660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35586/0 (socket says 172.21.15.63:35586) 2020-05-18T21:34:21.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd2253e700 1 -- 172.21.15.63:0/3909102463 learned_addr learned my addr 172.21.15.63:0/3909102463 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:21.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd21d3d700 1 --2- 172.21.15.63:0/3909102463 >> v2:172.21.15.63:3300/0 conn(0x7fbd1c149d50 0x7fbd1c06a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:21.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd2153c700 1 --2- 172.21.15.63:0/3909102463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 0x7fbd1c0ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:21.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd20d3b700 1 -- 172.21.15.63:0/3909102463 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483247360 0 0) 0x7fbd1c0b3790 con 0x7fbd1c0adc90 2020-05-18T21:34:21.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd20d3b700 1 -- 172.21.15.63:0/3909102463 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd04003270 con 0x7fbd1c0adc90 2020-05-18T21:34:21.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd21d3d700 1 -- 172.21.15.63:0/3909102463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 msgr2=0x7fbd1c0ad830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:21.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd21d3d700 1 --2- 172.21.15.63:0/3909102463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 0x7fbd1c0ad830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:21.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd21d3d700 1 -- 172.21.15.63:0/3909102463 >> v1:172.21.15.63:6789/0 conn(0x7fbd1c0adc90 legacy=0x7fbd1c060660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:21.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd20d3b700 1 -- 172.21.15.63:0/3909102463 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4266732981 0 0) 0x7fbd04003270 con 0x7fbd1c0adc90 2020-05-18T21:34:21.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd21d3d700 1 -- 172.21.15.63:0/3909102463 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c0ae400 con 0x7fbd1c149d50 2020-05-18T21:34:21.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd2153c700 1 --2- 172.21.15.63:0/3909102463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 0x7fbd1c0ad830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:21.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd21d3d700 1 --2- 172.21.15.63:0/3909102463 >> v2:172.21.15.63:3300/0 conn(0x7fbd1c149d50 0x7fbd1c06a630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbd1c0b4330 tx=0x7fbd0c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:21.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd21d3d700 1 --2- 172.21.15.63:0/3909102463 >> v2:172.21.15.63:3300/0 conn(0x7fbd1c149d50 0x7fbd1c06a630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbd1c0b4330 tx=0x7fbd0c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:21.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd21d3d700 1 --2- 172.21.15.63:0/3909102463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd1c149d50 0x7fbd1c06a630 secure :-1 s=READY pgs=1615 cs=0 l=1 rx=0x7fbd1c0b4330 tx=0x7fbd0c008920).ready entity=mon.0 client_cookie=39e25aa58fd1a303 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:21.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd21d3d700 1 --2- 172.21.15.63:0/3909102463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd1c149d50 0x7fbd1c06a630 secure :-1 s=THROTTLE_DONE pgs=1615 cs=0 l=1 rx=0x7fbd1c0b4330 tx=0x7fbd0c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:21.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd21d3d700 1 --2- 172.21.15.63:0/3909102463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd1c149d50 0x7fbd1c06a630 secure :-1 s=THROTTLE_DONE pgs=1615 cs=0 l=1 rx=0x7fbd1c0b4330 tx=0x7fbd0c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:21.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd20d3b700 1 -- 172.21.15.63:0/3909102463 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd14001ab0 con 0x7fbd1c149d50 2020-05-18T21:34:21.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd21d3d700 1 --2- 172.21.15.63:0/3909102463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd1c149d50 0x7fbd1c06a630 secure :-1 s=THROTTLE_DONE pgs=1615 cs=0 l=1 rx=0x7fbd1c0b4330 tx=0x7fbd0c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:21.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd20d3b700 1 -- 172.21.15.63:0/3909102463 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c008b80 con 0x7fbd1c149d50 2020-05-18T21:34:21.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd20d3b700 1 -- 172.21.15.63:0/3909102463 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd0c0113d0 con 0x7fbd1c149d50 2020-05-18T21:34:21.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd22d3f700 1 -- 172.21.15.63:0/3909102463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd1c149d50 msgr2=0x7fbd1c06a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:21.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd22d3f700 1 --2- 172.21.15.63:0/3909102463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd1c149d50 0x7fbd1c06a630 secure :-1 s=READY pgs=1615 cs=0 l=1 rx=0x7fbd1c0b4330 tx=0x7fbd0c008920).stop 2020-05-18T21:34:21.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd22d3f700 1 -- 172.21.15.63:0/3909102463 shutdown_connections 2020-05-18T21:34:21.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd22d3f700 1 --2- 172.21.15.63:0/3909102463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 0x7fbd1c0ad830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:21.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd22d3f700 1 --2- 172.21.15.63:0/3909102463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd1c149d50 0x7fbd1c06a630 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:21.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd22d3f700 1 -- 172.21.15.63:0/3909102463 >> 172.21.15.63:0/3909102463 conn(0x7fbd1c05fb90 msgr2=0x7fbd1c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:21.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd22d3f700 1 -- 172.21.15.63:0/3909102463 shutdown_connections 2020-05-18T21:34:21.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.407+0000 7fbd22d3f700 1 -- 172.21.15.63:0/3909102463 wait complete. 2020-05-18T21:34:21.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd22d3f700 1 Processor -- start 2020-05-18T21:34:21.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd22d3f700 1 -- start start 2020-05-18T21:34:21.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd22d3f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 0x7fbd1c0b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:21.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd22d3f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1c061ae0 con 0x7fbd1c149d50 2020-05-18T21:34:21.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd22d3f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1c061d80 con 0x7fbd1c0adc90 2020-05-18T21:34:21.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd22d3f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c062020 con 0x7fbd1c0ad3f0 2020-05-18T21:34:21.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd2253e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbd1c149d50 0x7fbd1c14b540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35592/0 (socket says 172.21.15.63:35592) 2020-05-18T21:34:21.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd2253e700 1 -- 172.21.15.63:0/3729866459 learned_addr learned my addr 172.21.15.63:0/3729866459 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:21.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd21d3d700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 0x7fbd1c0b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:21.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd0affd700 1 -- 172.21.15.63:0/3729866459 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380766799 0 0) 0x7fbd1c061ae0 con 0x7fbd1c149d50 2020-05-18T21:34:21.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd0affd700 1 -- 172.21.15.63:0/3729866459 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcfc002fe0 con 0x7fbd1c149d50 2020-05-18T21:34:21.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd0affd700 1 -- 172.21.15.63:0/3729866459 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115759340 0 0) 0x7fbd1c061d80 con 0x7fbd1c0adc90 2020-05-18T21:34:21.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd0affd700 1 -- 172.21.15.63:0/3729866459 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd1c061ae0 con 0x7fbd1c0adc90 2020-05-18T21:34:21.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd0affd700 1 -- 172.21.15.63:0/3729866459 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2854835665 0 0) 0x7fbcfc002fe0 con 0x7fbd1c149d50 2020-05-18T21:34:21.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd0affd700 1 -- 172.21.15.63:0/3729866459 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbd1c061d80 con 0x7fbd1c149d50 2020-05-18T21:34:21.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd0affd700 1 -- 172.21.15.63:0/3729866459 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fbd14001550 con 0x7fbd1c149d50 2020-05-18T21:34:21.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd21d3d700 1 -- 172.21.15.63:0/3729866459 >> v1:172.21.15.155:6789/0 conn(0x7fbd1c0adc90 legacy=0x7fbd1c14ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:21.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd21d3d700 1 -- 172.21.15.63:0/3729866459 >> v1:172.21.15.63:6789/0 conn(0x7fbd1c149d50 legacy=0x7fbd1c14b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:21.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd21d3d700 1 -- 172.21.15.63:0/3729866459 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c064ca0 con 0x7fbd1c0ad3f0 2020-05-18T21:34:21.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd21d3d700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 0x7fbd1c0b0a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd1c0b4330 tx=0x7fbd1c0ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:21.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd21d3d700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 0x7fbd1c0b0a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd1c0b4330 tx=0x7fbd1c0ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:21.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.411+0000 7fbd21d3d700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 0x7fbd1c0b0a20 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7fbd1c0b4330 tx=0x7fbd1c0ae590).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:21.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.415+0000 7fbd21d3d700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 0x7fbd1c0b0a20 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7fbd1c0b4330 tx=0x7fbd1c0ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:21.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.415+0000 7fbd0affd700 1 -- 172.21.15.63:0/3729866459 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd0c007170 con 0x7fbd1c0ad3f0 2020-05-18T21:34:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.415+0000 7fbd21d3d700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 0x7fbd1c0b0a20 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7fbd1c0b4330 tx=0x7fbd1c0ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.415+0000 7fbd21d3d700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 0x7fbd1c0b0a20 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7fbd1c0b4330 tx=0x7fbd1c0ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.415+0000 7fbd0affd700 1 -- 172.21.15.63:0/3729866459 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c0072d0 con 0x7fbd1c0ad3f0 2020-05-18T21:34:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.415+0000 7fbd22d3f700 1 -- 172.21.15.63:0/3729866459 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1c0634d0 con 0x7fbd1c0ad3f0 2020-05-18T21:34:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.415+0000 7fbd0affd700 1 -- 172.21.15.63:0/3729866459 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd0c005700 con 0x7fbd1c0ad3f0 2020-05-18T21:34:21.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.415+0000 7fbd22d3f700 1 -- 172.21.15.63:0/3729866459 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1c0b0e80 con 0x7fbd1c0ad3f0 2020-05-18T21:34:21.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.415+0000 7fbd22d3f700 1 -- 172.21.15.63:0/3729866459 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd1c0569e0 con 0x7fbd1c0ad3f0 2020-05-18T21:34:21.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.415+0000 7fbd21d3d700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 0x7fbd1c0b0a20 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7fbd1c0b4330 tx=0x7fbd1c0ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:21.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.415+0000 7fbd21d3d700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 0x7fbd1c0b0a20 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7fbd1c0b4330 tx=0x7fbd1c0ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:21.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.415+0000 7fbd0affd700 1 -- 172.21.15.63:0/3729866459 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fbd0c0058b0 con 0x7fbd1c0ad3f0 2020-05-18T21:34:21.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.415+0000 7fbd0affd700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbcfc0500d0 0x7fbcfc052590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:21.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.415+0000 7fbd0affd700 1 -- 172.21.15.63:0/3729866459 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fbd0c063c10 con 0x7fbd1c0ad3f0 2020-05-18T21:34:21.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.415+0000 7fbd2153c700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbcfc0500d0 0x7fbcfc052590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:21.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.415+0000 7fbd2153c700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbcfc0500d0 0x7fbcfc052590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd18007760 tx=0x7fbd180093b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:21.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.415+0000 7fbd2153c700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbcfc0500d0 0x7fbcfc052590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd18007760 tx=0x7fbd180093b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:21.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.415+0000 7fbd2153c700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbcfc0500d0 0x7fbcfc052590 secure :-1 s=READY pgs=626 cs=0 l=1 rx=0x7fbd18007760 tx=0x7fbd180093b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:21.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.423+0000 7fbd21d3d700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 0x7fbd1c0b0a20 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7fbd1c0b4330 tx=0x7fbd1c0ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:21.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.423+0000 7fbd0affd700 1 -- 172.21.15.63:0/3729866459 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fbd0c03e080 con 0x7fbd1c0ad3f0 2020-05-18T21:34:21.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:21.543+0000 7fbd22d3f700 1 -- 172.21.15.63:0/3729866459 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbd1c065b40 con 0x7fbd1c0ad3f0 2020-05-18T21:34:22.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.283+0000 7fbd21d3d700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 0x7fbd1c0b0a20 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7fbd1c0b4330 tx=0x7fbd1c0ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:22.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.283+0000 7fbd0affd700 1 -- 172.21.15.63:0/3729866459 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v116) v1 ==== 185+0+0 (secure 0 0 0) 0x7fbd0c0416a0 con 0x7fbd1c0ad3f0 2020-05-18T21:34:22.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.287+0000 7fbd22d3f700 1 -- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbcfc0500d0 msgr2=0x7fbcfc052590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:22.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.287+0000 7fbd22d3f700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbcfc0500d0 0x7fbcfc052590 secure :-1 s=READY pgs=626 cs=0 l=1 rx=0x7fbd18007760 tx=0x7fbd180093b0).stop 2020-05-18T21:34:22.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.287+0000 7fbd22d3f700 1 -- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 msgr2=0x7fbd1c0b0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:22.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.287+0000 7fbd22d3f700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 0x7fbd1c0b0a20 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7fbd1c0b4330 tx=0x7fbd1c0ae590).stop 2020-05-18T21:34:22.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.291+0000 7fbd22d3f700 1 -- 172.21.15.63:0/3729866459 shutdown_connections 2020-05-18T21:34:22.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.291+0000 7fbd22d3f700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbcfc0500d0 0x7fbcfc052590 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:22.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.291+0000 7fbd22d3f700 1 --2- 172.21.15.63:0/3729866459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c0ad3f0 0x7fbd1c0b0a20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:22.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.291+0000 7fbd22d3f700 1 -- 172.21.15.63:0/3729866459 >> 172.21.15.63:0/3729866459 conn(0x7fbd1c05fb90 msgr2=0x7fbd1c060620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:22.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.291+0000 7fbd22d3f700 1 -- 172.21.15.63:0/3729866459 shutdown_connections 2020-05-18T21:34:22.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.291+0000 7fbd22d3f700 1 -- 172.21.15.63:0/3729866459 wait complete. 2020-05-18T21:34:22.296 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2020-05-18T21:34:22.306 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-05-18T21:34:22.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476ffff700 1 Processor -- start 2020-05-18T21:34:22.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476ffff700 1 -- start start 2020-05-18T21:34:22.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4770142ed0 0x7f47700606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:22.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4770065a10 0x7f4770145790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:22.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476ffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47700b4630 con 0x7f47700b4f60 2020-05-18T21:34:22.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476ffff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4770060c50 con 0x7f4770065a10 2020-05-18T21:34:22.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476ffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4770060ef0 con 0x7f4770142ed0 2020-05-18T21:34:22.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4770065a10 0x7f4770145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:22.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476effd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f47700b4f60 0x7f47701427c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35598/0 (socket says 172.21.15.63:35598) 2020-05-18T21:34:22.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476effd700 1 -- 172.21.15.63:0/1293748318 learned_addr learned my addr 172.21.15.63:0/1293748318 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:22.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f47667fc700 1 --2- 172.21.15.63:0/1293748318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4770142ed0 0x7f47700606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:22.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476f7fe700 1 -- 172.21.15.63:0/1293748318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4770142ed0 msgr2=0x7f47700606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:22.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476f7fe700 1 --2- 172.21.15.63:0/1293748318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4770142ed0 0x7f47700606d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476f7fe700 1 -- 172.21.15.63:0/1293748318 >> v1:172.21.15.63:6789/0 conn(0x7f47700b4f60 legacy=0x7f47701427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476e7fc700 1 -- 172.21.15.63:0/1293748318 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931094584 0 0) 0x7f47700b4630 con 0x7f47700b4f60 2020-05-18T21:34:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476f7fe700 1 -- 172.21.15.63:0/1293748318 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4770061190 con 0x7f4770065a10 2020-05-18T21:34:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476f7fe700 1 --2- 172.21.15.63:0/1293748318 >> v2:172.21.15.63:3300/0 conn(0x7f4770065a10 0x7f4770145790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f47680032f0 tx=0x7f4768007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:22.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476f7fe700 1 --2- 172.21.15.63:0/1293748318 >> v2:172.21.15.63:3300/0 conn(0x7f4770065a10 0x7f4770145790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f47680032f0 tx=0x7f4768007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:22.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476f7fe700 1 --2- 172.21.15.63:0/1293748318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4770065a10 0x7f4770145790 secure :-1 s=READY pgs=1618 cs=0 l=1 rx=0x7f47680032f0 tx=0x7f4768007e00).ready entity=mon.0 client_cookie=6d62cf892ec4d10c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:22.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476f7fe700 1 --2- 172.21.15.63:0/1293748318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4770065a10 0x7f4770145790 secure :-1 s=THROTTLE_DONE pgs=1618 cs=0 l=1 rx=0x7f47680032f0 tx=0x7f4768007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:22.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476e7fc700 1 -- 172.21.15.63:0/1293748318 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4768011e60 con 0x7f4770065a10 2020-05-18T21:34:22.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476f7fe700 1 --2- 172.21.15.63:0/1293748318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4770065a10 0x7f4770145790 secure :-1 s=THROTTLE_DONE pgs=1618 cs=0 l=1 rx=0x7f47680032f0 tx=0x7f4768007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476f7fe700 1 --2- 172.21.15.63:0/1293748318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4770065a10 0x7f4770145790 secure :-1 s=THROTTLE_DONE pgs=1618 cs=0 l=1 rx=0x7f47680032f0 tx=0x7f4768007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476e7fc700 1 -- 172.21.15.63:0/1293748318 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476800a180 con 0x7f4770065a10 2020-05-18T21:34:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476e7fc700 1 -- 172.21.15.63:0/1293748318 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f476800a520 con 0x7f4770065a10 2020-05-18T21:34:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476ffff700 1 -- 172.21.15.63:0/1293748318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4770065a10 msgr2=0x7f4770145790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.415+0000 7f476ffff700 1 --2- 172.21.15.63:0/1293748318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4770065a10 0x7f4770145790 secure :-1 s=READY pgs=1618 cs=0 l=1 rx=0x7f47680032f0 tx=0x7f4768007e00).stop 2020-05-18T21:34:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.419+0000 7f476ffff700 1 -- 172.21.15.63:0/1293748318 shutdown_connections 2020-05-18T21:34:22.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.419+0000 7f476ffff700 1 --2- 172.21.15.63:0/1293748318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4770065a10 0x7f4770145790 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:22.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.419+0000 7f476ffff700 1 --2- 172.21.15.63:0/1293748318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4770142ed0 0x7f47700606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:22.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.419+0000 7f476ffff700 1 -- 172.21.15.63:0/1293748318 >> 172.21.15.63:0/1293748318 conn(0x7f477005fbd0 msgr2=0x7f4770069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:22.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.419+0000 7f476ffff700 1 -- 172.21.15.63:0/1293748318 shutdown_connections 2020-05-18T21:34:22.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.419+0000 7f476ffff700 1 -- 172.21.15.63:0/1293748318 wait complete. 2020-05-18T21:34:22.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.419+0000 7f476ffff700 1 Processor -- start 2020-05-18T21:34:22.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.419+0000 7f476ffff700 1 -- start start 2020-05-18T21:34:22.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.419+0000 7f476ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4770065a10 0x7f4770134000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:22.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.419+0000 7f476ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4770142ed0 0x7f4770063380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:22.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.419+0000 7f476ffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477013be10 con 0x7f47700b4f60 2020-05-18T21:34:22.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476ffff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4770063870 con 0x7f4770142ed0 2020-05-18T21:34:22.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476ffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477013c0b0 con 0x7f4770065a10 2020-05-18T21:34:22.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4770142ed0 0x7f4770063380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:22.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4770142ed0 0x7f4770063380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33420/0 (socket says 172.21.15.63:33420) 2020-05-18T21:34:22.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476f7fe700 1 -- 172.21.15.63:0/1897614681 learned_addr learned my addr 172.21.15.63:0/1897614681 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:22.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476effd700 1 --2- 172.21.15.63:0/1897614681 >> v2:172.21.15.155:3300/0 conn(0x7f4770065a10 0x7f4770134000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:22.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476f7fe700 1 -- 172.21.15.63:0/1897614681 >> v2:172.21.15.155:3300/0 conn(0x7f4770065a10 msgr2=0x7f4770134000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:22.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476f7fe700 1 --2- 172.21.15.63:0/1897614681 >> v2:172.21.15.155:3300/0 conn(0x7f4770065a10 0x7f4770134000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:22.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476f7fe700 1 -- 172.21.15.63:0/1897614681 >> v1:172.21.15.155:6789/0 conn(0x7f47700b4f60 legacy=0x7f477013da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476cff9700 1 -- 172.21.15.63:0/1897614681 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845147380 0 0) 0x7f477013be10 con 0x7f47700b4f60 2020-05-18T21:34:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476f7fe700 1 -- 172.21.15.63:0/1897614681 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47701416a0 con 0x7f4770142ed0 2020-05-18T21:34:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476f7fe700 1 --2- 172.21.15.63:0/1897614681 >> v2:172.21.15.63:3300/0 conn(0x7f4770142ed0 0x7f4770063380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f47680032f0 tx=0x7f4768007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476f7fe700 1 --2- 172.21.15.63:0/1897614681 >> v2:172.21.15.63:3300/0 conn(0x7f4770142ed0 0x7f4770063380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f47680032f0 tx=0x7f4768007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476f7fe700 1 --2- 172.21.15.63:0/1897614681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4770142ed0 0x7f4770063380 secure :-1 s=READY pgs=1619 cs=0 l=1 rx=0x7f47680032f0 tx=0x7f4768007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476f7fe700 1 --2- 172.21.15.63:0/1897614681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4770142ed0 0x7f4770063380 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f47680032f0 tx=0x7f4768007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476f7fe700 1 --2- 172.21.15.63:0/1897614681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4770142ed0 0x7f4770063380 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f47680032f0 tx=0x7f4768007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476cff9700 1 -- 172.21.15.63:0/1897614681 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f476800ae40 con 0x7f4770142ed0 2020-05-18T21:34:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476f7fe700 1 --2- 172.21.15.63:0/1897614681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4770142ed0 0x7f4770063380 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f47680032f0 tx=0x7f4768007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476cff9700 1 -- 172.21.15.63:0/1897614681 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47680114d0 con 0x7f4770142ed0 2020-05-18T21:34:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476ffff700 1 -- 172.21.15.63:0/1897614681 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47700adea0 con 0x7f4770142ed0 2020-05-18T21:34:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476cff9700 1 -- 172.21.15.63:0/1897614681 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4768005c70 con 0x7f4770142ed0 2020-05-18T21:34:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476ffff700 1 -- 172.21.15.63:0/1897614681 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4770133c30 con 0x7f4770142ed0 2020-05-18T21:34:22.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476f7fe700 1 --2- 172.21.15.63:0/1897614681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4770142ed0 0x7f4770063380 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f47680032f0 tx=0x7f4768007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:22.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.423+0000 7f476ffff700 1 -- 172.21.15.63:0/1897614681 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47700569e0 con 0x7f4770142ed0 2020-05-18T21:34:22.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.427+0000 7f476cff9700 1 -- 172.21.15.63:0/1897614681 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4768010610 con 0x7f4770142ed0 2020-05-18T21:34:22.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.427+0000 7f476f7fe700 1 --2- 172.21.15.63:0/1897614681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4770142ed0 0x7f4770063380 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f47680032f0 tx=0x7f4768007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:22.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.427+0000 7f476cff9700 1 --2- 172.21.15.63:0/1897614681 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f474804f910 0x7f4748051dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:22.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.427+0000 7f476cff9700 1 -- 172.21.15.63:0/1897614681 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f4768064730 con 0x7f4770142ed0 2020-05-18T21:34:22.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.427+0000 7f476effd700 1 --2- 172.21.15.63:0/1897614681 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f474804f910 0x7f4748051dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:22.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.427+0000 7f476effd700 1 --2- 172.21.15.63:0/1897614681 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f474804f910 0x7f4748051dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4760000bc0 tx=0x7f4760001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:22.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.427+0000 7f476effd700 1 --2- 172.21.15.63:0/1897614681 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f474804f910 0x7f4748051dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4760000bc0 tx=0x7f4760001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:22.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.427+0000 7f476effd700 1 --2- 172.21.15.63:0/1897614681 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f474804f910 0x7f4748051dd0 secure :-1 s=READY pgs=627 cs=0 l=1 rx=0x7f4760000bc0 tx=0x7f4760001840).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:22.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.431+0000 7f476f7fe700 1 --2- 172.21.15.63:0/1897614681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4770142ed0 0x7f4770063380 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f47680032f0 tx=0x7f4768007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:22.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.431+0000 7f476cff9700 1 -- 172.21.15.63:0/1897614681 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f476803eb20 con 0x7f4770142ed0 2020-05-18T21:34:22.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:22.547+0000 7f476ffff700 1 -- 172.21.15.63:0/1897614681 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f477013eab0 con 0x7f4770142ed0 2020-05-18T21:34:23.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.294+0000 7f476f7fe700 1 --2- 172.21.15.63:0/1897614681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4770142ed0 0x7f4770063380 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f47680032f0 tx=0x7f4768007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:23.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.294+0000 7f476cff9700 1 -- 172.21.15.63:0/1897614681 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v117) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4768042140 con 0x7f4770142ed0 2020-05-18T21:34:23.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.298+0000 7f476ffff700 1 -- 172.21.15.63:0/1897614681 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f474804f910 msgr2=0x7f4748051dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:23.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.298+0000 7f476ffff700 1 --2- 172.21.15.63:0/1897614681 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f474804f910 0x7f4748051dd0 secure :-1 s=READY pgs=627 cs=0 l=1 rx=0x7f4760000bc0 tx=0x7f4760001840).stop 2020-05-18T21:34:23.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.298+0000 7f476ffff700 1 -- 172.21.15.63:0/1897614681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4770142ed0 msgr2=0x7f4770063380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:23.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.298+0000 7f476ffff700 1 --2- 172.21.15.63:0/1897614681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4770142ed0 0x7f4770063380 secure :-1 s=READY pgs=1619 cs=0 l=1 rx=0x7f47680032f0 tx=0x7f4768007e00).stop 2020-05-18T21:34:23.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.298+0000 7f476ffff700 1 -- 172.21.15.63:0/1897614681 shutdown_connections 2020-05-18T21:34:23.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.298+0000 7f476ffff700 1 --2- 172.21.15.63:0/1897614681 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f474804f910 0x7f4748051dd0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:23.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.298+0000 7f476ffff700 1 --2- 172.21.15.63:0/1897614681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4770142ed0 0x7f4770063380 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:23.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.298+0000 7f476ffff700 1 --2- 172.21.15.63:0/1897614681 >> v2:172.21.15.155:3300/0 conn(0x7f4770065a10 0x7f4770134000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:23.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.298+0000 7f476ffff700 1 -- 172.21.15.63:0/1897614681 >> 172.21.15.63:0/1897614681 conn(0x7f477005fbd0 msgr2=0x7f47700b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:23.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.298+0000 7f476ffff700 1 -- 172.21.15.63:0/1897614681 shutdown_connections 2020-05-18T21:34:23.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.298+0000 7f476ffff700 1 -- 172.21.15.63:0/1897614681 wait complete. 2020-05-18T21:34:23.308 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2020-05-18T21:34:23.318 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:34:23.319 INFO:tasks.ceph.mds.a:Stopping old one... 2020-05-18T21:34:23.319 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:34:23.319 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:34:23.320 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:34:23.320 INFO:tasks.ceph.mds.b:Stopping old one... 2020-05-18T21:34:23.320 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:34:23.320 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:34:23.332 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:34:23.332 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:34:23.334 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:34:23.334 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:34:23.335 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:34:23.336 DEBUG:teuthology.parallel:result is None 2020-05-18T21:34:23.377 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:34:23.378 DEBUG:teuthology.parallel:result is None 2020-05-18T21:34:23.379 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-05-18T21:34:23.409 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:34:23.455 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:34:23.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.482+0000 7f11a58e3700 1 Processor -- start 2020-05-18T21:34:23.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.482+0000 7f11a58e3700 1 -- start start 2020-05-18T21:34:23.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f11a58e3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f11a0060ac0 0x7f11a00b4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:23.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f11a58e3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f11a009c340 0x7f11a014b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:23.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f11a58e3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a009c140 con 0x7f11a0141dc0 2020-05-18T21:34:23.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f11a58e3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a009e640 con 0x7f11a0060ac0 2020-05-18T21:34:23.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f11a58e3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a009e8e0 con 0x7f11a009c340 2020-05-18T21:34:23.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f119ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f11a0060ac0 0x7f11a00b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:23.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f119ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f11a0060ac0 0x7f11a00b4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33440/0 (socket says 172.21.15.63:33440) 2020-05-18T21:34:23.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f119ffff700 1 -- 172.21.15.63:0/4244730439 learned_addr learned my addr 172.21.15.63:0/4244730439 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:23.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f11a50e2700 1 --2- 172.21.15.63:0/4244730439 >> v2:172.21.15.155:3300/0 conn(0x7f11a009c340 0x7f11a014b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:23.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f119ffff700 1 -- 172.21.15.63:0/4244730439 >> v2:172.21.15.155:3300/0 conn(0x7f11a009c340 msgr2=0x7f11a014b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:23.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f119ffff700 1 --2- 172.21.15.63:0/4244730439 >> v2:172.21.15.155:3300/0 conn(0x7f11a009c340 0x7f11a014b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:23.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f119ffff700 1 -- 172.21.15.63:0/4244730439 >> v1:172.21.15.155:6789/0 conn(0x7f11a0141dc0 legacy=0x7f11a005ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:23.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f119ffff700 1 -- 172.21.15.63:0/4244730439 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a009eb80 con 0x7f11a0060ac0 2020-05-18T21:34:23.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f119ffff700 1 --2- 172.21.15.63:0/4244730439 >> v2:172.21.15.63:3300/0 conn(0x7f11a0060ac0 0x7f11a00b4410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f118c002f70 tx=0x7f118c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:23.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f119ffff700 1 --2- 172.21.15.63:0/4244730439 >> v2:172.21.15.63:3300/0 conn(0x7f11a0060ac0 0x7f11a00b4410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f118c002f70 tx=0x7f118c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:23.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f119ffff700 1 --2- 172.21.15.63:0/4244730439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11a0060ac0 0x7f11a00b4410 secure :-1 s=READY pgs=1623 cs=0 l=1 rx=0x7f118c002f70 tx=0x7f118c007a80).ready entity=mon.0 client_cookie=15be16f70eb3605a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:23.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f119ffff700 1 --2- 172.21.15.63:0/4244730439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11a0060ac0 0x7f11a00b4410 secure :-1 s=THROTTLE_DONE pgs=1623 cs=0 l=1 rx=0x7f118c002f70 tx=0x7f118c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:23.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f119ffff700 1 --2- 172.21.15.63:0/4244730439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11a0060ac0 0x7f11a00b4410 secure :-1 s=THROTTLE_DONE pgs=1623 cs=0 l=1 rx=0x7f118c002f70 tx=0x7f118c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:23.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f119ffff700 1 --2- 172.21.15.63:0/4244730439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11a0060ac0 0x7f11a00b4410 secure :-1 s=THROTTLE_DONE pgs=1623 cs=0 l=1 rx=0x7f118c002f70 tx=0x7f118c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:23.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f119f7fe700 1 -- 172.21.15.63:0/4244730439 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f118c009e80 con 0x7f11a0060ac0 2020-05-18T21:34:23.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f119f7fe700 1 -- 172.21.15.63:0/4244730439 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118c012a60 con 0x7f11a0060ac0 2020-05-18T21:34:23.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f11a58e3700 1 -- 172.21.15.63:0/4244730439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11a0060ac0 msgr2=0x7f11a00b4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:23.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f11a58e3700 1 --2- 172.21.15.63:0/4244730439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11a0060ac0 0x7f11a00b4410 secure :-1 s=READY pgs=1623 cs=0 l=1 rx=0x7f118c002f70 tx=0x7f118c007a80).stop 2020-05-18T21:34:23.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f119f7fe700 1 -- 172.21.15.63:0/4244730439 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f118c012e80 con 0x7f11a0060ac0 2020-05-18T21:34:23.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f11a58e3700 1 -- 172.21.15.63:0/4244730439 shutdown_connections 2020-05-18T21:34:23.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f11a58e3700 1 --2- 172.21.15.63:0/4244730439 >> v2:172.21.15.155:3300/0 conn(0x7f11a009c340 0x7f11a014b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:23.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f11a58e3700 1 --2- 172.21.15.63:0/4244730439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11a0060ac0 0x7f11a00b4410 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:23.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f11a58e3700 1 -- 172.21.15.63:0/4244730439 >> 172.21.15.63:0/4244730439 conn(0x7f11a00b9630 msgr2=0x7f11a00b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:23.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f11a58e3700 1 -- 172.21.15.63:0/4244730439 shutdown_connections 2020-05-18T21:34:23.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.486+0000 7f11a58e3700 1 -- 172.21.15.63:0/4244730439 wait complete. 2020-05-18T21:34:23.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a58e3700 1 Processor -- start 2020-05-18T21:34:23.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a58e3700 1 -- start start 2020-05-18T21:34:23.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a58e3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11a0060ac0 0x7f11a0065710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:23.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a58e3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a01577b0 con 0x7f11a009c340 2020-05-18T21:34:23.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a58e3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a0065b70 con 0x7f11a0141dc0 2020-05-18T21:34:23.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a58e3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a0156960 con 0x7f11a0060ac0 2020-05-18T21:34:23.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f119ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f11a009c340 0x7f11a01570a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35632/0 (socket says 172.21.15.63:35632) 2020-05-18T21:34:23.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f119ffff700 1 -- 172.21.15.63:0/1556590366 learned_addr learned my addr 172.21.15.63:0/1556590366 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:23.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a48e1700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11a0060ac0 0x7f11a0065710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:23.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f119dffb700 1 -- 172.21.15.63:0/1556590366 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371282557 0 0) 0x7f11a01577b0 con 0x7f11a009c340 2020-05-18T21:34:23.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f119dffb700 1 -- 172.21.15.63:0/1556590366 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1188002fe0 con 0x7f11a009c340 2020-05-18T21:34:23.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f119dffb700 1 -- 172.21.15.63:0/1556590366 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2577596648 0 0) 0x7f1188002fe0 con 0x7f11a009c340 2020-05-18T21:34:23.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f119dffb700 1 -- 172.21.15.63:0/1556590366 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f11a01577b0 con 0x7f11a009c340 2020-05-18T21:34:23.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f119dffb700 1 -- 172.21.15.63:0/1556590366 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f118c009e80 con 0x7f11a009c340 2020-05-18T21:34:23.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f119dffb700 1 -- 172.21.15.63:0/1556590366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11a0060ac0 msgr2=0x7f11a0065710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:23.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f119dffb700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11a0060ac0 0x7f11a0065710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:23.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f119dffb700 1 -- 172.21.15.63:0/1556590366 >> v1:172.21.15.155:6789/0 conn(0x7f11a0141dc0 legacy=0x7f11a00b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:23.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f119dffb700 1 -- 172.21.15.63:0/1556590366 >> v1:172.21.15.63:6789/0 conn(0x7f11a009c340 legacy=0x7f11a01570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:23.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f119dffb700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1188004a80 0x7f1188004e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:23.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f119dffb700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11a0060ac0 0x7f11880039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:23.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f119dffb700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1188003e00 0x7f1188004280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:23.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f119dffb700 1 -- 172.21.15.63:0/1556590366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a0156960 con 0x7f1188004a80 2020-05-18T21:34:23.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f119dffb700 1 -- 172.21.15.63:0/1556590366 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11880047d0 con 0x7f1188003e00 2020-05-18T21:34:23.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f119dffb700 1 -- 172.21.15.63:0/1556590366 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11880053f0 con 0x7f11a0060ac0 2020-05-18T21:34:23.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a48e1700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1188004a80 0x7f1188004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:23.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f119ffff700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11a0060ac0 0x7f11880039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:23.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a50e2700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1188003e00 0x7f1188004280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:23.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a48e1700 1 -- 172.21.15.63:0/1556590366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11a0060ac0 msgr2=0x7f11880039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:23.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a48e1700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11a0060ac0 0x7f11880039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:23.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a48e1700 1 -- 172.21.15.63:0/1556590366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1188003e00 msgr2=0x7f1188004280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:23.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a48e1700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1188003e00 0x7f1188004280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:23.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a48e1700 1 -- 172.21.15.63:0/1556590366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a0156c00 con 0x7f1188004a80 2020-05-18T21:34:23.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a50e2700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1188003e00 0x7f1188004280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:34:23.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a58e3700 1 -- 172.21.15.63:0/1556590366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a00b0ba0 con 0x7f1188004a80 2020-05-18T21:34:23.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a58e3700 1 -- 172.21.15.63:0/1556590366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a00b2b90 con 0x7f1188004a80 2020-05-18T21:34:23.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a48e1700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1188004a80 0x7f1188004e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f11a00b32e0 tx=0x7f1194010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:23.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a48e1700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1188004a80 0x7f1188004e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f11a00b32e0 tx=0x7f1194010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:23.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.490+0000 7f11a48e1700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1188004a80 0x7f1188004e60 secure :-1 s=READY pgs=1625 cs=0 l=1 rx=0x7f11a00b32e0 tx=0x7f1194010c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:23.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.494+0000 7f11a48e1700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1188004a80 0x7f1188004e60 secure :-1 s=THROTTLE_DONE pgs=1625 cs=0 l=1 rx=0x7f11a00b32e0 tx=0x7f1194010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:23.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.494+0000 7f11a48e1700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1188004a80 0x7f1188004e60 secure :-1 s=THROTTLE_DONE pgs=1625 cs=0 l=1 rx=0x7f11a00b32e0 tx=0x7f1194010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:23.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.494+0000 7f119dffb700 1 -- 172.21.15.63:0/1556590366 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1194006710 con 0x7f1188004a80 2020-05-18T21:34:23.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.494+0000 7f11a48e1700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1188004a80 0x7f1188004e60 secure :-1 s=THROTTLE_DONE pgs=1625 cs=0 l=1 rx=0x7f11a00b32e0 tx=0x7f1194010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:23.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.494+0000 7f119dffb700 1 -- 172.21.15.63:0/1556590366 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1194006870 con 0x7f1188004a80 2020-05-18T21:34:23.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.494+0000 7f119dffb700 1 -- 172.21.15.63:0/1556590366 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1194006c10 con 0x7f1188004a80 2020-05-18T21:34:23.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.494+0000 7f11a48e1700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1188004a80 0x7f1188004e60 secure :-1 s=THROTTLE_DONE pgs=1625 cs=0 l=1 rx=0x7f11a00b32e0 tx=0x7f1194010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:23.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.494+0000 7f11a58e3700 1 -- 172.21.15.63:0/1556590366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117c003380 con 0x7f1188004a80 2020-05-18T21:34:23.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.494+0000 7f119dffb700 1 -- 172.21.15.63:0/1556590366 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1194006d70 con 0x7f1188004a80 2020-05-18T21:34:23.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.494+0000 7f11a48e1700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1188004a80 0x7f1188004e60 secure :-1 s=THROTTLE_DONE pgs=1625 cs=0 l=1 rx=0x7f11a00b32e0 tx=0x7f1194010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:23.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.494+0000 7f119dffb700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1188057c30 0x7f118805a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:23.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.494+0000 7f119dffb700 1 -- 172.21.15.63:0/1556590366 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f1194063b20 con 0x7f1188004a80 2020-05-18T21:34:23.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.494+0000 7f119ffff700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1188057c30 0x7f118805a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:23.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.494+0000 7f119ffff700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1188057c30 0x7f118805a0f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f118c008340 tx=0x7f118c007b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:23.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.494+0000 7f119ffff700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1188057c30 0x7f118805a0f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f118c008340 tx=0x7f118c007b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:23.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.494+0000 7f119ffff700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1188057c30 0x7f118805a0f0 secure :-1 s=READY pgs=628 cs=0 l=1 rx=0x7f118c008340 tx=0x7f118c007b20).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:23.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.498+0000 7f11a48e1700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1188004a80 0x7f1188004e60 secure :-1 s=THROTTLE_DONE pgs=1625 cs=0 l=1 rx=0x7f11a00b32e0 tx=0x7f1194010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:23.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.498+0000 7f119dffb700 1 -- 172.21.15.63:0/1556590366 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f119403df90 con 0x7f1188004a80 2020-05-18T21:34:23.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:23.630+0000 7f11a58e3700 1 -- 172.21.15.63:0/1556590366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f117c003720 con 0x7f1188004a80 2020-05-18T21:34:24.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.442+0000 7f11a48e1700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1188004a80 0x7f1188004e60 secure :-1 s=THROTTLE_DONE pgs=1625 cs=0 l=1 rx=0x7f11a00b32e0 tx=0x7f1194010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.442+0000 7f119dffb700 1 -- 172.21.15.63:0/1556590366 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v118) v1 ==== 97+0+0 (secure 0 0 0) 0x7f11940415b0 con 0x7f1188004a80 2020-05-18T21:34:24.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.442+0000 7f11a58e3700 1 -- 172.21.15.63:0/1556590366 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1188057c30 msgr2=0x7f118805a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:24.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.442+0000 7f11a58e3700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1188057c30 0x7f118805a0f0 secure :-1 s=READY pgs=628 cs=0 l=1 rx=0x7f118c008340 tx=0x7f118c007b20).stop 2020-05-18T21:34:24.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.446+0000 7f11a58e3700 1 -- 172.21.15.63:0/1556590366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1188004a80 msgr2=0x7f1188004e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:24.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.446+0000 7f11a58e3700 1 --2- 172.21.15.63:0/1556590366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1188004a80 0x7f1188004e60 secure :-1 s=READY pgs=1625 cs=0 l=1 rx=0x7f11a00b32e0 tx=0x7f1194010c60).stop 2020-05-18T21:34:24.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.446+0000 7f11a50e2700 1 -- 172.21.15.63:0/1556590366 reap_dead start 2020-05-18T21:34:24.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.446+0000 7f11a50e2700 1 -- 172.21.15.63:0/1556590366 reap_dead start 2020-05-18T21:34:24.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.446+0000 7f11a58e3700 1 -- 172.21.15.63:0/1556590366 shutdown_connections 2020-05-18T21:34:24.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.446+0000 7f11a58e3700 1 -- 172.21.15.63:0/1556590366 >> 172.21.15.63:0/1556590366 conn(0x7f11a00b9630 msgr2=0x7f11a009d810 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:24.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.446+0000 7f11a58e3700 1 -- 172.21.15.63:0/1556590366 shutdown_connections 2020-05-18T21:34:24.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.446+0000 7f11a58e3700 1 -- 172.21.15.63:0/1556590366 wait complete. 2020-05-18T21:34:24.451 INFO:teuthology.orchestra.run.smithi063.stderr: removed all blacklist entries 2020-05-18T21:34:24.462 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-05-18T21:34:24.462 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-05-18T21:34:24.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51ea04700 1 Processor -- start 2020-05-18T21:34:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51ea04700 1 -- start start 2020-05-18T21:34:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51ea04700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc518145df0 0x7fc518142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51ea04700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5181432f0 0x7fc518060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51ea04700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5180b7020 con 0x7fc5180b93f0 2020-05-18T21:34:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51ea04700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5180b72c0 con 0x7fc518145df0 2020-05-18T21:34:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51ea04700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5180b7560 con 0x7fc5181432f0 2020-05-18T21:34:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51d201700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc518145df0 0x7fc518142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51da02700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc5180b93f0 0x7fc5180b7ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35646/0 (socket says 172.21.15.63:35646) 2020-05-18T21:34:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51d201700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc518145df0 0x7fc518142e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33458/0 (socket says 172.21.15.63:33458) 2020-05-18T21:34:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51da02700 1 -- 172.21.15.63:0/693061129 learned_addr learned my addr 172.21.15.63:0/693061129 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51e203700 1 --2- 172.21.15.63:0/693061129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5181432f0 0x7fc518060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:24.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51d201700 1 -- 172.21.15.63:0/693061129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5181432f0 msgr2=0x7fc518060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:24.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51ca00700 1 -- 172.21.15.63:0/693061129 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185823464 0 0) 0x7fc5180b7020 con 0x7fc5180b93f0 2020-05-18T21:34:24.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51d201700 1 --2- 172.21.15.63:0/693061129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5181432f0 0x7fc518060430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:24.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51d201700 1 -- 172.21.15.63:0/693061129 >> v1:172.21.15.63:6789/0 conn(0x7fc5180b93f0 legacy=0x7fc5180b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:24.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51d201700 1 -- 172.21.15.63:0/693061129 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5180b7800 con 0x7fc518145df0 2020-05-18T21:34:24.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51e203700 1 --2- 172.21.15.63:0/693061129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5181432f0 0x7fc518060430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:34:24.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51d201700 1 --2- 172.21.15.63:0/693061129 >> v2:172.21.15.63:3300/0 conn(0x7fc518145df0 0x7fc518142e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc508002f70 tx=0x7fc508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51d201700 1 --2- 172.21.15.63:0/693061129 >> v2:172.21.15.63:3300/0 conn(0x7fc518145df0 0x7fc518142e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc508002f70 tx=0x7fc508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51d201700 1 --2- 172.21.15.63:0/693061129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc518145df0 0x7fc518142e90 secure :-1 s=READY pgs=1627 cs=0 l=1 rx=0x7fc508002f70 tx=0x7fc508007a80).ready entity=mon.0 client_cookie=714761324560ac8a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:24.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51d201700 1 --2- 172.21.15.63:0/693061129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc518145df0 0x7fc518142e90 secure :-1 s=THROTTLE_DONE pgs=1627 cs=0 l=1 rx=0x7fc508002f70 tx=0x7fc508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51ca00700 1 -- 172.21.15.63:0/693061129 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc508008e80 con 0x7fc518145df0 2020-05-18T21:34:24.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51d201700 1 --2- 172.21.15.63:0/693061129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc518145df0 0x7fc518142e90 secure :-1 s=THROTTLE_DONE pgs=1627 cs=0 l=1 rx=0x7fc508002f70 tx=0x7fc508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51d201700 1 --2- 172.21.15.63:0/693061129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc518145df0 0x7fc518142e90 secure :-1 s=THROTTLE_DONE pgs=1627 cs=0 l=1 rx=0x7fc508002f70 tx=0x7fc508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51ca00700 1 -- 172.21.15.63:0/693061129 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5080116a0 con 0x7fc518145df0 2020-05-18T21:34:24.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51ca00700 1 -- 172.21.15.63:0/693061129 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc508011a80 con 0x7fc518145df0 2020-05-18T21:34:24.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51ea04700 1 -- 172.21.15.63:0/693061129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc518145df0 msgr2=0x7fc518142e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:24.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.586+0000 7fc51ea04700 1 --2- 172.21.15.63:0/693061129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc518145df0 0x7fc518142e90 secure :-1 s=READY pgs=1627 cs=0 l=1 rx=0x7fc508002f70 tx=0x7fc508007a80).stop 2020-05-18T21:34:24.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.590+0000 7fc51ea04700 1 -- 172.21.15.63:0/693061129 shutdown_connections 2020-05-18T21:34:24.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.590+0000 7fc51ea04700 1 --2- 172.21.15.63:0/693061129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5181432f0 0x7fc518060430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:24.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.590+0000 7fc51ea04700 1 --2- 172.21.15.63:0/693061129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc518145df0 0x7fc518142e90 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:24.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.590+0000 7fc51ea04700 1 -- 172.21.15.63:0/693061129 >> 172.21.15.63:0/693061129 conn(0x7fc518069b70 msgr2=0x7fc518069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:24.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.590+0000 7fc51ea04700 1 -- 172.21.15.63:0/693061129 shutdown_connections 2020-05-18T21:34:24.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.590+0000 7fc51ea04700 1 -- 172.21.15.63:0/693061129 wait complete. 2020-05-18T21:34:24.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.590+0000 7fc51ea04700 1 Processor -- start 2020-05-18T21:34:24.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.590+0000 7fc51ea04700 1 -- start start 2020-05-18T21:34:24.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51ea04700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc5180b93f0 0x7fc5180adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:24.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51ea04700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5180b2e80 con 0x7fc518145df0 2020-05-18T21:34:24.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51da02700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc5180b93f0 0x7fc5180adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:24.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51ea04700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5180b3120 con 0x7fc5181432f0 2020-05-18T21:34:24.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51ea04700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc518141b00 con 0x7fc5180b93f0 2020-05-18T21:34:24.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51da02700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc5180b93f0 0x7fc5180adaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33464/0 (socket says 172.21.15.63:33464) 2020-05-18T21:34:24.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51da02700 1 -- 172.21.15.63:0/1838308921 learned_addr learned my addr 172.21.15.63:0/1838308921 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:24.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51da02700 1 -- 172.21.15.63:0/1838308921 >> v1:172.21.15.155:6789/0 conn(0x7fc5181432f0 legacy=0x7fc5181413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:24.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51da02700 1 -- 172.21.15.63:0/1838308921 >> v1:172.21.15.63:6789/0 conn(0x7fc518145df0 legacy=0x7fc5180ba900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:24.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51da02700 1 -- 172.21.15.63:0/1838308921 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc518141c40 con 0x7fc5180b93f0 2020-05-18T21:34:24.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc506ffd700 1 -- 172.21.15.63:0/1838308921 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155832941 0 0) 0x7fc5180b2e80 con 0x7fc518145df0 2020-05-18T21:34:24.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51da02700 1 --2- 172.21.15.63:0/1838308921 >> v2:172.21.15.63:3300/0 conn(0x7fc5180b93f0 0x7fc5180adaf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc514000bc0 tx=0x7fc514010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51da02700 1 --2- 172.21.15.63:0/1838308921 >> v2:172.21.15.63:3300/0 conn(0x7fc5180b93f0 0x7fc5180adaf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc514000bc0 tx=0x7fc514010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51da02700 1 --2- 172.21.15.63:0/1838308921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5180b93f0 0x7fc5180adaf0 secure :-1 s=READY pgs=1629 cs=0 l=1 rx=0x7fc514000bc0 tx=0x7fc514010a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:24.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51da02700 1 --2- 172.21.15.63:0/1838308921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5180b93f0 0x7fc5180adaf0 secure :-1 s=THROTTLE_DONE pgs=1629 cs=0 l=1 rx=0x7fc514000bc0 tx=0x7fc514010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc506ffd700 1 -- 172.21.15.63:0/1838308921 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc514005d30 con 0x7fc5180b93f0 2020-05-18T21:34:24.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51ea04700 1 -- 172.21.15.63:0/1838308921 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5180bc830 con 0x7fc5180b93f0 2020-05-18T21:34:24.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51da02700 1 --2- 172.21.15.63:0/1838308921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5180b93f0 0x7fc5180adaf0 secure :-1 s=THROTTLE_DONE pgs=1629 cs=0 l=1 rx=0x7fc514000bc0 tx=0x7fc514010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51da02700 1 --2- 172.21.15.63:0/1838308921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5180b93f0 0x7fc5180adaf0 secure :-1 s=THROTTLE_DONE pgs=1629 cs=0 l=1 rx=0x7fc514000bc0 tx=0x7fc514010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc506ffd700 1 -- 172.21.15.63:0/1838308921 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc514005e90 con 0x7fc5180b93f0 2020-05-18T21:34:24.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc506ffd700 1 -- 172.21.15.63:0/1838308921 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5140122e0 con 0x7fc5180b93f0 2020-05-18T21:34:24.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51ea04700 1 -- 172.21.15.63:0/1838308921 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5180b2c50 con 0x7fc5180b93f0 2020-05-18T21:34:24.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51da02700 1 --2- 172.21.15.63:0/1838308921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5180b93f0 0x7fc5180adaf0 secure :-1 s=THROTTLE_DONE pgs=1629 cs=0 l=1 rx=0x7fc514000bc0 tx=0x7fc514010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.594+0000 7fc51ea04700 1 -- 172.21.15.63:0/1838308921 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5180569e0 con 0x7fc5180b93f0 2020-05-18T21:34:24.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.598+0000 7fc506ffd700 1 -- 172.21.15.63:0/1838308921 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc514012560 con 0x7fc5180b93f0 2020-05-18T21:34:24.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.598+0000 7fc51da02700 1 --2- 172.21.15.63:0/1838308921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5180b93f0 0x7fc5180adaf0 secure :-1 s=THROTTLE_DONE pgs=1629 cs=0 l=1 rx=0x7fc514000bc0 tx=0x7fc514010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.598+0000 7fc506ffd700 1 --2- 172.21.15.63:0/1838308921 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc4f804f8a0 0x7fc4f8051d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:24.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.598+0000 7fc506ffd700 1 -- 172.21.15.63:0/1838308921 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc5140090c0 con 0x7fc5180b93f0 2020-05-18T21:34:24.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.598+0000 7fc51d201700 1 --2- 172.21.15.63:0/1838308921 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc4f804f8a0 0x7fc4f8051d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:24.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.598+0000 7fc51d201700 1 --2- 172.21.15.63:0/1838308921 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc4f804f8a0 0x7fc4f8051d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc5180b5b10 tx=0x7fc508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.598+0000 7fc51d201700 1 --2- 172.21.15.63:0/1838308921 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc4f804f8a0 0x7fc4f8051d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc5180b5b10 tx=0x7fc508007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.598+0000 7fc51d201700 1 --2- 172.21.15.63:0/1838308921 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc4f804f8a0 0x7fc4f8051d60 secure :-1 s=READY pgs=630 cs=0 l=1 rx=0x7fc5180b5b10 tx=0x7fc508007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:24.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.602+0000 7fc51da02700 1 --2- 172.21.15.63:0/1838308921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5180b93f0 0x7fc5180adaf0 secure :-1 s=THROTTLE_DONE pgs=1629 cs=0 l=1 rx=0x7fc514000bc0 tx=0x7fc514010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.602+0000 7fc506ffd700 1 -- 172.21.15.63:0/1838308921 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc51403e340 con 0x7fc5180b93f0 2020-05-18T21:34:24.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.758+0000 7fc51ea04700 1 -- 172.21.15.63:0/1838308921 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc5180ba260 con 0x7fc5180b93f0 2020-05-18T21:34:24.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.758+0000 7fc51da02700 1 --2- 172.21.15.63:0/1838308921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5180b93f0 0x7fc5180adaf0 secure :-1 s=THROTTLE_DONE pgs=1629 cs=0 l=1 rx=0x7fc514000bc0 tx=0x7fc514010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.758+0000 7fc506ffd700 1 -- 172.21.15.63:0/1838308921 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v46) v1 ==== 80+0+4513 (secure 0 0 0) 0x7fc514041960 con 0x7fc5180b93f0 2020-05-18T21:34:24.763 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:24.763 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:34:24.764 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_dump": [ 2020-05-18T21:34:24.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:24.764 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.a", 2020-05-18T21:34:24.764 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJekJyyLRAAfB5XJCsXTAmZdkFOaQrokg==", 2020-05-18T21:34:24.765 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:34:24.765 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:34:24.765 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:34:24.765 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:34:24.765 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:34:24.766 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:24.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:24.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:24.766 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.b", 2020-05-18T21:34:24.766 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeSVE8MRAAEEytuzLtcQMC+1uQ/yh8eA==", 2020-05-18T21:34:24.767 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:34:24.767 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:34:24.767 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:34:24.767 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:34:24.767 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:34:24.768 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:24.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:24.768 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:24.768 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.0", 2020-05-18T21:34:24.768 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBq/cJeIn7mJhAArx+YEdVbsfXXNOLWdaAgWw==", 2020-05-18T21:34:24.769 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:34:24.769 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:34:24.769 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:34:24.769 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:34:24.769 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:24.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:24.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:24.770 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.1", 2020-05-18T21:34:24.770 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBt/cJelHywCRAAFyQ3sPEE0RTSy4tKfsDfyw==", 2020-05-18T21:34:24.770 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:34:24.771 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:34:24.771 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:34:24.771 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:34:24.771 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:24.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:24.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:24.772 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.2", 2020-05-18T21:34:24.772 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBv/cJecexDLBAAxhlFq20MBkKvDjuM1yi8XQ==", 2020-05-18T21:34:24.772 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:34:24.772 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:34:24.773 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:34:24.773 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:34:24.773 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:24.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:24.773 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:24.774 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.3", 2020-05-18T21:34:24.774 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBy/cJe9IqwDxAAMg1In7bIITDcOZljzzTpDQ==", 2020-05-18T21:34:24.774 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:34:24.774 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:34:24.774 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:34:24.775 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:34:24.775 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:24.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:24.775 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:24.775 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.4", 2020-05-18T21:34:24.776 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB3/cJeLXgxFhAA/kMVV5hCRny2uXKvvbu8Og==", 2020-05-18T21:34:24.776 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:34:24.776 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:34:24.776 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:34:24.776 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:34:24.776 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:24.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:24.777 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:24.777 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.5", 2020-05-18T21:34:24.777 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB5/cJeucpsNRAAjGh+6yUC8Fji9PE4COi/Eg==", 2020-05-18T21:34:24.778 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:34:24.778 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:34:24.778 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:34:24.778 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:34:24.778 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:24.779 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:24.779 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:24.779 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.6", 2020-05-18T21:34:24.779 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB8/cJelSPpGhAAXobGqH9qaW1VZfEpH8bUbQ==", 2020-05-18T21:34:24.779 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:34:24.780 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:34:24.780 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:34:24.780 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:34:24.780 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:24.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:24.781 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:24.781 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.7", 2020-05-18T21:34:24.781 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB+/cJeUIl5OBAAPd8H8ohOWZw9ubO7uCB6zg==", 2020-05-18T21:34:24.781 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:34:24.781 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:34:24.782 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:34:24.782 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:34:24.782 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:24.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:24.782 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:24.783 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.0", 2020-05-18T21:34:24.783 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeap3RNhAAi2vKpsKtzSL1Uuqm8pWYJQ==", 2020-05-18T21:34:24.783 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:34:24.783 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:34:24.783 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:34:24.784 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:34:24.784 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:24.784 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:24.784 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:24.784 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.1", 2020-05-18T21:34:24.784 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJeekrQABAA5TmzWOt24C6hgZw/WTj5dw==", 2020-05-18T21:34:24.785 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:34:24.785 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:34:24.785 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:34:24.785 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:34:24.786 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:24.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:24.786 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:24.786 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.2", 2020-05-18T21:34:24.786 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJehSnFAxAAXUZwqNTXqAApEB3nXs4u6g==", 2020-05-18T21:34:24.787 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:34:24.787 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:34:24.787 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:34:24.787 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:34:24.787 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:24.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:24.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:24.788 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.3", 2020-05-18T21:34:24.788 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJe2HdDBhAA07y5pn/bKKa9TBbZFvIh9g==", 2020-05-18T21:34:24.788 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:34:24.789 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:34:24.789 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:34:24.789 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:34:24.790 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:24.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:24.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:24.790 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.admin", 2020-05-18T21:34:24.790 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJe/K4fGRAA+rP3BYuWiyx/fKmQ3bV6Lw==", 2020-05-18T21:34:24.790 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:34:24.791 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:34:24.791 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:34:24.791 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:34:24.791 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:34:24.791 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:24.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:24.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:24.792 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.x", 2020-05-18T21:34:24.792 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJemmqEKhAAe5ySRz8Id0ug4matQwL0uw==", 2020-05-18T21:34:24.793 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:34:24.793 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:34:24.794 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:34:24.794 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:34:24.794 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:24.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:24.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:24.795 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.y", 2020-05-18T21:34:24.795 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeF/BNJhAAi/vrldC6qoWJWnSHpE3ung==", 2020-05-18T21:34:24.795 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:34:24.795 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:34:24.795 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:34:24.796 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:34:24.796 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:24.796 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:24.796 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:34:24.796 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:34:24.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.758+0000 7fc51ea04700 1 -- 172.21.15.63:0/1838308921 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc4f804f8a0 msgr2=0x7fc4f8051d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:24.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.758+0000 7fc51ea04700 1 --2- 172.21.15.63:0/1838308921 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc4f804f8a0 0x7fc4f8051d60 secure :-1 s=READY pgs=630 cs=0 l=1 rx=0x7fc5180b5b10 tx=0x7fc508007a80).stop 2020-05-18T21:34:24.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.758+0000 7fc51ea04700 1 -- 172.21.15.63:0/1838308921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5180b93f0 msgr2=0x7fc5180adaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:24.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.758+0000 7fc51ea04700 1 --2- 172.21.15.63:0/1838308921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5180b93f0 0x7fc5180adaf0 secure :-1 s=READY pgs=1629 cs=0 l=1 rx=0x7fc514000bc0 tx=0x7fc514010a50).stop 2020-05-18T21:34:24.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.758+0000 7fc51ea04700 1 -- 172.21.15.63:0/1838308921 shutdown_connections 2020-05-18T21:34:24.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.758+0000 7fc51ea04700 1 --2- 172.21.15.63:0/1838308921 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc4f804f8a0 0x7fc4f8051d60 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:24.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.758+0000 7fc51ea04700 1 --2- 172.21.15.63:0/1838308921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5180b93f0 0x7fc5180adaf0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:24.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.758+0000 7fc51ea04700 1 -- 172.21.15.63:0/1838308921 >> 172.21.15.63:0/1838308921 conn(0x7fc518069b70 msgr2=0x7fc5180b7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:24.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.758+0000 7fc51ea04700 1 -- 172.21.15.63:0/1838308921 shutdown_connections 2020-05-18T21:34:24.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.758+0000 7fc51ea04700 1 -- 172.21.15.63:0/1838308921 wait complete. 2020-05-18T21:34:24.801 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:34:24.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.906+0000 7f0d2994e700 1 Processor -- start 2020-05-18T21:34:24.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.906+0000 7f0d2994e700 1 -- start start 2020-05-18T21:34:24.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2994e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2405b2b0 0x7f0d24145e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:24.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2994e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0d241462d0 0x7f0d24099b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:24.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2994e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d240b51f0 con 0x7f0d240b8e20 2020-05-18T21:34:24.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2994e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d241428d0 con 0x7f0d241462d0 2020-05-18T21:34:24.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2994e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d24142b70 con 0x7f0d2405b2b0 2020-05-18T21:34:24.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2914d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0d241462d0 0x7f0d24099b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:24.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2894c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f0d240b8e20 0x7f0d24145760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:33976/0 (socket says 172.21.15.63:33976) 2020-05-18T21:34:24.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2894c700 1 -- 172.21.15.63:0/4265776956 learned_addr learned my addr 172.21.15.63:0/4265776956 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:24.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d23fff700 1 --2- 172.21.15.63:0/4265776956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2405b2b0 0x7f0d24145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:24.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d237fe700 1 -- 172.21.15.63:0/4265776956 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798173128 0 0) 0x7f0d240b51f0 con 0x7f0d240b8e20 2020-05-18T21:34:24.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d237fe700 1 -- 172.21.15.63:0/4265776956 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d08003270 con 0x7f0d240b8e20 2020-05-18T21:34:24.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2914d700 1 -- 172.21.15.63:0/4265776956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2405b2b0 msgr2=0x7f0d24145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:24.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2914d700 1 --2- 172.21.15.63:0/4265776956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2405b2b0 0x7f0d24145e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:24.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2914d700 1 -- 172.21.15.63:0/4265776956 >> v1:172.21.15.155:6789/0 conn(0x7f0d240b8e20 legacy=0x7f0d24145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:24.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2914d700 1 -- 172.21.15.63:0/4265776956 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24142e10 con 0x7f0d241462d0 2020-05-18T21:34:24.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2914d700 1 --2- 172.21.15.63:0/4265776956 >> v2:172.21.15.63:3300/0 conn(0x7f0d241462d0 0x7f0d24099b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0d1c0032f0 tx=0x7f0d1c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2914d700 1 --2- 172.21.15.63:0/4265776956 >> v2:172.21.15.63:3300/0 conn(0x7f0d241462d0 0x7f0d24099b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0d1c0032f0 tx=0x7f0d1c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2914d700 1 --2- 172.21.15.63:0/4265776956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d241462d0 0x7f0d24099b00 secure :-1 s=READY pgs=1630 cs=0 l=1 rx=0x7f0d1c0032f0 tx=0x7f0d1c007e00).ready entity=mon.0 client_cookie=e2b115c8a559a01f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:24.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2914d700 1 --2- 172.21.15.63:0/4265776956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d241462d0 0x7f0d24099b00 secure :-1 s=THROTTLE_DONE pgs=1630 cs=0 l=1 rx=0x7f0d1c0032f0 tx=0x7f0d1c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d237fe700 1 -- 172.21.15.63:0/4265776956 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d1c011db0 con 0x7f0d241462d0 2020-05-18T21:34:24.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2914d700 1 --2- 172.21.15.63:0/4265776956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d241462d0 0x7f0d24099b00 secure :-1 s=THROTTLE_DONE pgs=1630 cs=0 l=1 rx=0x7f0d1c0032f0 tx=0x7f0d1c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d237fe700 1 -- 172.21.15.63:0/4265776956 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c00a180 con 0x7f0d241462d0 2020-05-18T21:34:24.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2914d700 1 --2- 172.21.15.63:0/4265776956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d241462d0 0x7f0d24099b00 secure :-1 s=THROTTLE_DONE pgs=1630 cs=0 l=1 rx=0x7f0d1c0032f0 tx=0x7f0d1c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2994e700 1 -- 172.21.15.63:0/4265776956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d241462d0 msgr2=0x7f0d24099b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:24.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d237fe700 1 -- 172.21.15.63:0/4265776956 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d1c00a5a0 con 0x7f0d241462d0 2020-05-18T21:34:24.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2994e700 1 --2- 172.21.15.63:0/4265776956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d241462d0 0x7f0d24099b00 secure :-1 s=READY pgs=1630 cs=0 l=1 rx=0x7f0d1c0032f0 tx=0x7f0d1c007e00).stop 2020-05-18T21:34:24.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2994e700 1 -- 172.21.15.63:0/4265776956 shutdown_connections 2020-05-18T21:34:24.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2994e700 1 --2- 172.21.15.63:0/4265776956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d241462d0 0x7f0d24099b00 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:24.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2994e700 1 --2- 172.21.15.63:0/4265776956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2405b2b0 0x7f0d24145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:24.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2994e700 1 -- 172.21.15.63:0/4265776956 >> 172.21.15.63:0/4265776956 conn(0x7f0d2405f630 msgr2=0x7f0d2405a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:24.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2994e700 1 -- 172.21.15.63:0/4265776956 shutdown_connections 2020-05-18T21:34:24.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.910+0000 7f0d2994e700 1 -- 172.21.15.63:0/4265776956 wait complete. 2020-05-18T21:34:24.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.914+0000 7f0d2994e700 1 Processor -- start 2020-05-18T21:34:24.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.914+0000 7f0d2994e700 1 -- start start 2020-05-18T21:34:24.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.914+0000 7f0d2994e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0d240b8e20 0x7f0d240649e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:24.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.914+0000 7f0d2994e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d241462d0 0x7f0d2415b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:24.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.914+0000 7f0d2994e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d24064450 con 0x7f0d2405b2b0 2020-05-18T21:34:24.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.914+0000 7f0d2994e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2415bcf0 con 0x7f0d240b8e20 2020-05-18T21:34:24.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.914+0000 7f0d2994e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d240646f0 con 0x7f0d241462d0 2020-05-18T21:34:24.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.914+0000 7f0d2894c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0d2405b2b0 0x7f0d24065500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35666/0 (socket says 172.21.15.63:35666) 2020-05-18T21:34:24.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.914+0000 7f0d2894c700 1 -- 172.21.15.63:0/867954759 learned_addr learned my addr 172.21.15.63:0/867954759 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:24.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.914+0000 7f0d23fff700 1 --2- 172.21.15.63:0/867954759 >> v2:172.21.15.63:3300/0 conn(0x7f0d240b8e20 0x7f0d240649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:24.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d2914d700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d241462d0 0x7f0d2415b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:24.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d21ffb700 1 -- 172.21.15.63:0/867954759 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277245749 0 0) 0x7f0d24064450 con 0x7f0d2405b2b0 2020-05-18T21:34:24.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d21ffb700 1 -- 172.21.15.63:0/867954759 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d0c002fe0 con 0x7f0d2405b2b0 2020-05-18T21:34:24.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d23fff700 1 -- 172.21.15.63:0/867954759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d241462d0 msgr2=0x7f0d2415b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:24.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d23fff700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d241462d0 0x7f0d2415b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:24.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d23fff700 1 -- 172.21.15.63:0/867954759 >> v1:172.21.15.63:6789/0 conn(0x7f0d2405b2b0 legacy=0x7f0d24065500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:24.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d23fff700 1 -- 172.21.15.63:0/867954759 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24061030 con 0x7f0d240b8e20 2020-05-18T21:34:24.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d23fff700 1 --2- 172.21.15.63:0/867954759 >> v2:172.21.15.63:3300/0 conn(0x7f0d240b8e20 0x7f0d240649e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0d10002f70 tx=0x7f0d10010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d23fff700 1 --2- 172.21.15.63:0/867954759 >> v2:172.21.15.63:3300/0 conn(0x7f0d240b8e20 0x7f0d240649e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0d10002f70 tx=0x7f0d10010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d23fff700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d240b8e20 0x7f0d240649e0 secure :-1 s=READY pgs=1632 cs=0 l=1 rx=0x7f0d10002f70 tx=0x7f0d10010c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:24.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d23fff700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d240b8e20 0x7f0d240649e0 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7f0d10002f70 tx=0x7f0d10010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d21ffb700 1 -- 172.21.15.63:0/867954759 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d10007550 con 0x7f0d240b8e20 2020-05-18T21:34:24.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d23fff700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d240b8e20 0x7f0d240649e0 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7f0d10002f70 tx=0x7f0d10010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d23fff700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d240b8e20 0x7f0d240649e0 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7f0d10002f70 tx=0x7f0d10010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d21ffb700 1 -- 172.21.15.63:0/867954759 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d10005700 con 0x7f0d240b8e20 2020-05-18T21:34:24.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d2994e700 1 -- 172.21.15.63:0/867954759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2415af10 con 0x7f0d240b8e20 2020-05-18T21:34:24.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d21ffb700 1 -- 172.21.15.63:0/867954759 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d10005aa0 con 0x7f0d240b8e20 2020-05-18T21:34:24.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d2994e700 1 -- 172.21.15.63:0/867954759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d24064090 con 0x7f0d240b8e20 2020-05-18T21:34:24.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d23fff700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d240b8e20 0x7f0d240649e0 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7f0d10002f70 tx=0x7f0d10010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d2994e700 1 -- 172.21.15.63:0/867954759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d240611c0 con 0x7f0d240b8e20 2020-05-18T21:34:24.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d21ffb700 1 -- 172.21.15.63:0/867954759 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0d10005d10 con 0x7f0d240b8e20 2020-05-18T21:34:24.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.918+0000 7f0d23fff700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d240b8e20 0x7f0d240649e0 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7f0d10002f70 tx=0x7f0d10010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.922+0000 7f0d21ffb700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d0c04fdd0 0x7f0d0c052290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:24.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.922+0000 7f0d21ffb700 1 -- 172.21.15.63:0/867954759 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f0d10063d60 con 0x7f0d240b8e20 2020-05-18T21:34:24.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.922+0000 7f0d2894c700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d0c04fdd0 0x7f0d0c052290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:24.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.922+0000 7f0d2894c700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d0c04fdd0 0x7f0d0c052290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0d18001150 tx=0x7f0d18001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.922+0000 7f0d2894c700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d0c04fdd0 0x7f0d0c052290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0d18001150 tx=0x7f0d18001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.922+0000 7f0d2894c700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d0c04fdd0 0x7f0d0c052290 secure :-1 s=READY pgs=631 cs=0 l=1 rx=0x7f0d18001150 tx=0x7f0d18001700).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:24.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.926+0000 7f0d23fff700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d240b8e20 0x7f0d240649e0 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7f0d10002f70 tx=0x7f0d10010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:24.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:24.926+0000 7f0d21ffb700 1 -- 172.21.15.63:0/867954759 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f0d1003e150 con 0x7f0d240b8e20 2020-05-18T21:34:25.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.042+0000 7f0d2994e700 1 -- 172.21.15.63:0/867954759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d240569e0 con 0x7f0d240b8e20 2020-05-18T21:34:25.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.046+0000 7f0d23fff700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d240b8e20 0x7f0d240649e0 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7f0d10002f70 tx=0x7f0d10010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.046+0000 7f0d21ffb700 1 -- 172.21.15.63:0/867954759 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+13242 (secure 0 0 0) 0x7f0d10041770 con 0x7f0d240b8e20 2020-05-18T21:34:25.051 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:25.052 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":118,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:34:24.434486+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:34:25.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.046+0000 7f0d2994e700 1 -- 172.21.15.63:0/867954759 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d0c04fdd0 msgr2=0x7f0d0c052290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.046+0000 7f0d2994e700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d0c04fdd0 0x7f0d0c052290 secure :-1 s=READY pgs=631 cs=0 l=1 rx=0x7f0d18001150 tx=0x7f0d18001700).stop 2020-05-18T21:34:25.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.046+0000 7f0d2994e700 1 -- 172.21.15.63:0/867954759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d240b8e20 msgr2=0x7f0d240649e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.046+0000 7f0d2994e700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d240b8e20 0x7f0d240649e0 secure :-1 s=READY pgs=1632 cs=0 l=1 rx=0x7f0d10002f70 tx=0x7f0d10010c10).stop 2020-05-18T21:34:25.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.046+0000 7f0d2994e700 1 -- 172.21.15.63:0/867954759 shutdown_connections 2020-05-18T21:34:25.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.046+0000 7f0d2994e700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d0c04fdd0 0x7f0d0c052290 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:25.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.046+0000 7f0d2994e700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d241462d0 0x7f0d2415b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:25.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.046+0000 7f0d2994e700 1 --2- 172.21.15.63:0/867954759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d240b8e20 0x7f0d240649e0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:25.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.046+0000 7f0d2994e700 1 -- 172.21.15.63:0/867954759 >> 172.21.15.63:0/867954759 conn(0x7f0d2405f630 msgr2=0x7f0d2406a360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:25.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.046+0000 7f0d2994e700 1 -- 172.21.15.63:0/867954759 shutdown_connections 2020-05-18T21:34:25.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.046+0000 7f0d2994e700 1 -- 172.21.15.63:0/867954759 wait complete. 2020-05-18T21:34:25.069 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-05-18T21:34:25.070 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:34:25.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.174+0000 7f30652be700 1 Processor -- start 2020-05-18T21:34:25.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.174+0000 7f30652be700 1 -- start start 2020-05-18T21:34:25.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.174+0000 7f30652be700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3060143430 0x7f3060145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:25.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.174+0000 7f30652be700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30600b7bf0 0x7f30600b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:25.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.174+0000 7f30652be700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3060143810 con 0x7f30600b6d70 2020-05-18T21:34:25.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.174+0000 7f30652be700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30600b7210 con 0x7f3060143430 2020-05-18T21:34:25.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.174+0000 7f30652be700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30600b74b0 con 0x7f30600b7bf0 2020-05-18T21:34:25.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.174+0000 7f305e7fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f30600b6d70 0x7f30600b9160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35674/0 (socket says 172.21.15.63:35674) 2020-05-18T21:34:25.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.174+0000 7f305e7fc700 1 -- 172.21.15.63:0/1560242261 learned_addr learned my addr 172.21.15.63:0/1560242261 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:25.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.174+0000 7f305effd700 1 --2- 172.21.15.63:0/1560242261 >> v2:172.21.15.155:3300/0 conn(0x7f3060143430 0x7f3060145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.174+0000 7f305f7fe700 1 --2- 172.21.15.63:0/1560242261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30600b7bf0 0x7f30600b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305dffb700 1 -- 172.21.15.63:0/1560242261 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758386289 0 0) 0x7f3060143810 con 0x7f30600b6d70 2020-05-18T21:34:25.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305dffb700 1 -- 172.21.15.63:0/1560242261 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3044003270 con 0x7f30600b6d70 2020-05-18T21:34:25.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305dffb700 1 -- 172.21.15.63:0/1560242261 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1261638072 0 0) 0x7f3044003270 con 0x7f30600b6d70 2020-05-18T21:34:25.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305dffb700 1 -- 172.21.15.63:0/1560242261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30600b7bf0 msgr2=0x7f30600b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:25.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305dffb700 1 --2- 172.21.15.63:0/1560242261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30600b7bf0 0x7f30600b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:25.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305dffb700 1 -- 172.21.15.63:0/1560242261 >> v2:172.21.15.155:3300/0 conn(0x7f3060143430 msgr2=0x7f3060145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:25.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305dffb700 1 --2- 172.21.15.63:0/1560242261 >> v2:172.21.15.155:3300/0 conn(0x7f3060143430 0x7f3060145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:25.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305dffb700 1 -- 172.21.15.63:0/1560242261 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30600b7750 con 0x7f30600b6d70 2020-05-18T21:34:25.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305dffb700 1 -- 172.21.15.63:0/1560242261 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f3050001890 con 0x7f30600b6d70 2020-05-18T21:34:25.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305f7fe700 1 --2- 172.21.15.63:0/1560242261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30600b7bf0 0x7f30600b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:25.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305dffb700 1 -- 172.21.15.63:0/1560242261 >> v1:172.21.15.63:6789/0 conn(0x7f30600b6d70 legacy=0x7f30600b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305dffb700 1 --2- 172.21.15.63:0/1560242261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3044003760 0x7f3044003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:25.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305dffb700 1 --2- 172.21.15.63:0/1560242261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30440040a0 0x7f3044004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:25.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305dffb700 1 --2- 172.21.15.63:0/1560242261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30600b7bf0 0x7f3044004b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:25.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305dffb700 1 -- 172.21.15.63:0/1560242261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30600b7210 con 0x7f30440040a0 2020-05-18T21:34:25.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305dffb700 1 -- 172.21.15.63:0/1560242261 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30600b74b0 con 0x7f3044003760 2020-05-18T21:34:25.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305dffb700 1 -- 172.21.15.63:0/1560242261 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3044005110 con 0x7f30600b7bf0 2020-05-18T21:34:25.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305effd700 1 --2- 172.21.15.63:0/1560242261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3044003760 0x7f3044003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305e7fc700 1 --2- 172.21.15.63:0/1560242261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30440040a0 0x7f3044004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305f7fe700 1 --2- 172.21.15.63:0/1560242261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30600b7bf0 0x7f3044004b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305effd700 1 -- 172.21.15.63:0/1560242261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30600b7bf0 msgr2=0x7f3044004b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:25.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305effd700 1 --2- 172.21.15.63:0/1560242261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30600b7bf0 0x7f3044004b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:25.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305effd700 1 -- 172.21.15.63:0/1560242261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30440040a0 msgr2=0x7f3044004570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:25.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305effd700 1 --2- 172.21.15.63:0/1560242261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30440040a0 0x7f3044004570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:25.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305effd700 1 -- 172.21.15.63:0/1560242261 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3044003270 con 0x7f3044003760 2020-05-18T21:34:25.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305f7fe700 1 --2- 172.21.15.63:0/1560242261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30600b7bf0 0x7f3044004b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:25.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305effd700 1 --2- 172.21.15.63:0/1560242261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3044003760 0x7f3044003b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f30540032f0 tx=0x7f30540103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305effd700 1 --2- 172.21.15.63:0/1560242261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3044003760 0x7f3044003b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f30540032f0 tx=0x7f30540103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305effd700 1 --2- 172.21.15.63:0/1560242261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3044003760 0x7f3044003b80 secure :-1 s=READY pgs=1079 cs=0 l=1 rx=0x7f30540032f0 tx=0x7f30540103e0).ready entity=mon.1 client_cookie=9b52e662d1ddac7c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:25.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305effd700 1 --2- 172.21.15.63:0/1560242261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3044003760 0x7f3044003b80 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f30540032f0 tx=0x7f30540103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305dffb700 1 -- 172.21.15.63:0/1560242261 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30540112c0 con 0x7f3044003760 2020-05-18T21:34:25.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305effd700 1 --2- 172.21.15.63:0/1560242261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3044003760 0x7f3044003b80 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f30540032f0 tx=0x7f30540103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305effd700 1 --2- 172.21.15.63:0/1560242261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3044003760 0x7f3044003b80 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f30540032f0 tx=0x7f30540103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305dffb700 1 -- 172.21.15.63:0/1560242261 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3054011420 con 0x7f3044003760 2020-05-18T21:34:25.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305dffb700 1 -- 172.21.15.63:0/1560242261 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3054011780 con 0x7f3044003760 2020-05-18T21:34:25.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f30652be700 1 -- 172.21.15.63:0/1560242261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3044003760 msgr2=0x7f3044003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f30652be700 1 --2- 172.21.15.63:0/1560242261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3044003760 0x7f3044003b80 secure :-1 s=READY pgs=1079 cs=0 l=1 rx=0x7f30540032f0 tx=0x7f30540103e0).stop 2020-05-18T21:34:25.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f305f7fe700 1 -- 172.21.15.63:0/1560242261 reap_dead start 2020-05-18T21:34:25.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f30652be700 1 -- 172.21.15.63:0/1560242261 shutdown_connections 2020-05-18T21:34:25.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f30652be700 1 -- 172.21.15.63:0/1560242261 >> 172.21.15.63:0/1560242261 conn(0x7f3060069b70 msgr2=0x7f3060069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:25.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f30652be700 1 -- 172.21.15.63:0/1560242261 shutdown_connections 2020-05-18T21:34:25.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.178+0000 7f30652be700 1 -- 172.21.15.63:0/1560242261 wait complete. 2020-05-18T21:34:25.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.182+0000 7f30652be700 1 Processor -- start 2020-05-18T21:34:25.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.182+0000 7f30652be700 1 -- start start 2020-05-18T21:34:25.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.182+0000 7f30652be700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3060149b20 0x7f3060149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:25.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.182+0000 7f30652be700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30600aef70 con 0x7f3060142440 2020-05-18T21:34:25.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.182+0000 7f305effd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3060142440 0x7f30600af950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35686/0 (socket says 172.21.15.63:35686) 2020-05-18T21:34:25.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.182+0000 7f305effd700 1 -- 172.21.15.63:0/1175071958 learned_addr learned my addr 172.21.15.63:0/1175071958 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:25.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.182+0000 7f30652be700 1 -- 172.21.15.63:0/1175071958 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30600af210 con 0x7f30600acef0 2020-05-18T21:34:25.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.182+0000 7f30652be700 1 -- 172.21.15.63:0/1175071958 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30600b0060 con 0x7f3060149b20 2020-05-18T21:34:25.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f305e7fc700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3060149b20 0x7f3060149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160722117 0 0) 0x7f30600aef70 con 0x7f3060142440 2020-05-18T21:34:25.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f303c002fe0 con 0x7f3060142440 2020-05-18T21:34:25.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842852496 0 0) 0x7f30600af210 con 0x7f30600acef0 2020-05-18T21:34:25.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30600aef70 con 0x7f30600acef0 2020-05-18T21:34:25.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3965164055 0 0) 0x7f303c002fe0 con 0x7f3060142440 2020-05-18T21:34:25.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f30600af210 con 0x7f3060142440 2020-05-18T21:34:25.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f3054008360 con 0x7f3060142440 2020-05-18T21:34:25.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3060149b20 msgr2=0x7f3060149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3060149b20 0x7f3060149f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:25.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 >> v1:172.21.15.155:6789/0 conn(0x7f30600acef0 legacy=0x7f30600b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 >> v1:172.21.15.63:6789/0 conn(0x7f3060142440 legacy=0x7f30600af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f303c004bf0 0x7f303c005010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:25.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f303c003b30 0x7f303c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:25.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f303c0043d0 0x7f303c00b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:25.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30600b0060 con 0x7f303c003b30 2020-05-18T21:34:25.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c004990 con 0x7f303c004bf0 2020-05-18T21:34:25.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303c00bbc0 con 0x7f303c0043d0 2020-05-18T21:34:25.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f305e7fc700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3060149b20 0x7f3060149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:25.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f305effd700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f303c004bf0 0x7f303c005010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f305e7fc700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f303c003b30 0x7f303c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f305f7fe700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f303c0043d0 0x7f303c00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f305e7fc700 1 -- 172.21.15.63:0/1175071958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f303c0043d0 msgr2=0x7f303c00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f305e7fc700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f303c0043d0 0x7f303c00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:25.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f305e7fc700 1 -- 172.21.15.63:0/1175071958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f303c004bf0 msgr2=0x7f303c005010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f305e7fc700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f303c004bf0 0x7f303c005010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:25.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f305e7fc700 1 -- 172.21.15.63:0/1175071958 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30600af4b0 con 0x7f303c003b30 2020-05-18T21:34:25.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f30652be700 1 -- 172.21.15.63:0/1175071958 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3060142820 con 0x7f303c003b30 2020-05-18T21:34:25.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f305e7fc700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f303c003b30 0x7f303c003f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f303c0056d0 tx=0x7f30600605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f30652be700 1 -- 172.21.15.63:0/1175071958 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3060149f80 con 0x7f303c003b30 2020-05-18T21:34:25.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f305e7fc700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f303c003b30 0x7f303c003f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f303c0056d0 tx=0x7f30600605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f305e7fc700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f303c003b30 0x7f303c003f70 secure :-1 s=READY pgs=1635 cs=0 l=1 rx=0x7f303c0056d0 tx=0x7f30600605c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:25.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f305e7fc700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f303c003b30 0x7f303c003f70 secure :-1 s=THROTTLE_DONE pgs=1635 cs=0 l=1 rx=0x7f303c0056d0 tx=0x7f30600605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f305e7fc700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f303c003b30 0x7f303c003f70 secure :-1 s=THROTTLE_DONE pgs=1635 cs=0 l=1 rx=0x7f303c0056d0 tx=0x7f30600605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3050007360 con 0x7f303c003b30 2020-05-18T21:34:25.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f305e7fc700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f303c003b30 0x7f303c003f70 secure :-1 s=THROTTLE_DONE pgs=1635 cs=0 l=1 rx=0x7f303c0056d0 tx=0x7f30600605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3050011830 con 0x7f303c003b30 2020-05-18T21:34:25.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3050011bd0 con 0x7f303c003b30 2020-05-18T21:34:25.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f30652be700 1 -- 172.21.15.63:0/1175071958 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3040003380 con 0x7f303c003b30 2020-05-18T21:34:25.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f305e7fc700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f303c003b30 0x7f303c003f70 secure :-1 s=THROTTLE_DONE pgs=1635 cs=0 l=1 rx=0x7f303c0056d0 tx=0x7f30600605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3050011d30 con 0x7f303c003b30 2020-05-18T21:34:25.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.186+0000 7f305e7fc700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f303c003b30 0x7f303c003f70 secure :-1 s=THROTTLE_DONE pgs=1635 cs=0 l=1 rx=0x7f303c0056d0 tx=0x7f30600605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.190+0000 7f304ffff700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f303c058310 0x7f303c05a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:25.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.190+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3050063430 con 0x7f303c003b30 2020-05-18T21:34:25.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.190+0000 7f305effd700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f303c058310 0x7f303c05a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.190+0000 7f305effd700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f303c058310 0x7f303c05a7d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f30600b3500 tx=0x7f30540103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.190+0000 7f305effd700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f303c058310 0x7f303c05a7d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f30600b3500 tx=0x7f30540103e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.190+0000 7f305effd700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f303c058310 0x7f303c05a7d0 secure :-1 s=READY pgs=632 cs=0 l=1 rx=0x7f30600b3500 tx=0x7f30540103e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:25.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.194+0000 7f305e7fc700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f303c003b30 0x7f303c003f70 secure :-1 s=THROTTLE_DONE pgs=1635 cs=0 l=1 rx=0x7f303c0056d0 tx=0x7f30600605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.194+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f305003d8e0 con 0x7f303c003b30 2020-05-18T21:34:25.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.310+0000 7f30652be700 1 -- 172.21.15.63:0/1175071958 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3040002260 con 0x7f303c003b30 2020-05-18T21:34:25.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.314+0000 7f305e7fc700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f303c003b30 0x7f303c003f70 secure :-1 s=THROTTLE_DONE pgs=1635 cs=0 l=1 rx=0x7f303c0056d0 tx=0x7f30600605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.314+0000 7f304ffff700 1 -- 172.21.15.63:0/1175071958 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v118) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3050040f00 con 0x7f303c003b30 2020-05-18T21:34:25.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.314+0000 7f30652be700 1 -- 172.21.15.63:0/1175071958 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f303c058310 msgr2=0x7f303c05a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.314+0000 7f30652be700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f303c058310 0x7f303c05a7d0 secure :-1 s=READY pgs=632 cs=0 l=1 rx=0x7f30600b3500 tx=0x7f30540103e0).stop 2020-05-18T21:34:25.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.314+0000 7f305f7fe700 1 -- 172.21.15.63:0/1175071958 reap_dead start 2020-05-18T21:34:25.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.314+0000 7f30652be700 1 -- 172.21.15.63:0/1175071958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f303c003b30 msgr2=0x7f303c003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.314+0000 7f30652be700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f303c003b30 0x7f303c003f70 secure :-1 s=READY pgs=1635 cs=0 l=1 rx=0x7f303c0056d0 tx=0x7f30600605c0).stop 2020-05-18T21:34:25.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.314+0000 7f30652be700 1 -- 172.21.15.63:0/1175071958 shutdown_connections 2020-05-18T21:34:25.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.314+0000 7f30652be700 1 --2- 172.21.15.63:0/1175071958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f303c003b30 0x7f303c003f70 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:25.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.314+0000 7f30652be700 1 -- 172.21.15.63:0/1175071958 >> 172.21.15.63:0/1175071958 conn(0x7f3060069b70 msgr2=0x7f30600b8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.314+0000 7f30652be700 1 -- 172.21.15.63:0/1175071958 shutdown_connections 2020-05-18T21:34:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.314+0000 7f30652be700 1 -- 172.21.15.63:0/1175071958 wait complete. 2020-05-18T21:34:25.326 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:34:25.335 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:34:25.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.434+0000 7f471df70700 1 Processor -- start 2020-05-18T21:34:25.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.434+0000 7f471df70700 1 -- start start 2020-05-18T21:34:25.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.438+0000 7f471df70700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f471809b0b0 0x7f47180b3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:25.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.438+0000 7f471df70700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47180b5590 con 0x7f4718146490 2020-05-18T21:34:25.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.438+0000 7f471df70700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47180b3c00 con 0x7f47180aef00 2020-05-18T21:34:25.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.438+0000 7f471df70700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47180b3ea0 con 0x7f471809b0b0 2020-05-18T21:34:25.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.438+0000 7f47177fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f471809b0b0 0x7f47180b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.438+0000 7f47177fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f471809b0b0 0x7f47180b3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33512/0 (socket says 172.21.15.63:33512) 2020-05-18T21:34:25.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.438+0000 7f47177fe700 1 -- 172.21.15.63:0/3243123077 learned_addr learned my addr 172.21.15.63:0/3243123077 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:25.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.438+0000 7f47177fe700 1 -- 172.21.15.63:0/3243123077 >> v1:172.21.15.155:6789/0 conn(0x7f47180aef00 legacy=0x7f47180b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.438+0000 7f47177fe700 1 -- 172.21.15.63:0/3243123077 >> v1:172.21.15.63:6789/0 conn(0x7f4718146490 legacy=0x7f4718146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.438+0000 7f47177fe700 1 -- 172.21.15.63:0/3243123077 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47180b4140 con 0x7f471809b0b0 2020-05-18T21:34:25.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.438+0000 7f47177fe700 1 --2- 172.21.15.63:0/3243123077 >> v2:172.21.15.63:3300/0 conn(0x7f471809b0b0 0x7f47180b3680 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4708002f70 tx=0x7f4708007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.438+0000 7f47177fe700 1 --2- 172.21.15.63:0/3243123077 >> v2:172.21.15.63:3300/0 conn(0x7f471809b0b0 0x7f47180b3680 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4708002f70 tx=0x7f4708007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.438+0000 7f47177fe700 1 --2- 172.21.15.63:0/3243123077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f471809b0b0 0x7f47180b3680 secure :-1 s=READY pgs=1637 cs=0 l=1 rx=0x7f4708002f70 tx=0x7f4708007a80).ready entity=mon.0 client_cookie=63895a150ece776a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:25.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.442+0000 7f47177fe700 1 --2- 172.21.15.63:0/3243123077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f471809b0b0 0x7f47180b3680 secure :-1 s=THROTTLE_DONE pgs=1637 cs=0 l=1 rx=0x7f4708002f70 tx=0x7f4708007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.442+0000 7f4716ffd700 1 -- 172.21.15.63:0/3243123077 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4708011760 con 0x7f471809b0b0 2020-05-18T21:34:25.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.442+0000 7f47177fe700 1 --2- 172.21.15.63:0/3243123077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f471809b0b0 0x7f47180b3680 secure :-1 s=THROTTLE_DONE pgs=1637 cs=0 l=1 rx=0x7f4708002f70 tx=0x7f4708007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.442+0000 7f4716ffd700 1 -- 172.21.15.63:0/3243123077 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47080118c0 con 0x7f471809b0b0 2020-05-18T21:34:25.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.442+0000 7f47177fe700 1 --2- 172.21.15.63:0/3243123077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f471809b0b0 0x7f47180b3680 secure :-1 s=THROTTLE_DONE pgs=1637 cs=0 l=1 rx=0x7f4708002f70 tx=0x7f4708007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.442+0000 7f471df70700 1 -- 172.21.15.63:0/3243123077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f471809b0b0 msgr2=0x7f47180b3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.442+0000 7f4716ffd700 1 -- 172.21.15.63:0/3243123077 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4708011ce0 con 0x7f471809b0b0 2020-05-18T21:34:25.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.442+0000 7f471df70700 1 --2- 172.21.15.63:0/3243123077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f471809b0b0 0x7f47180b3680 secure :-1 s=READY pgs=1637 cs=0 l=1 rx=0x7f4708002f70 tx=0x7f4708007a80).stop 2020-05-18T21:34:25.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.442+0000 7f471df70700 1 -- 172.21.15.63:0/3243123077 shutdown_connections 2020-05-18T21:34:25.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.442+0000 7f471df70700 1 --2- 172.21.15.63:0/3243123077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f471809b0b0 0x7f47180b3680 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:25.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.442+0000 7f471df70700 1 -- 172.21.15.63:0/3243123077 >> 172.21.15.63:0/3243123077 conn(0x7f47180b9770 msgr2=0x7f47180b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:25.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.442+0000 7f471df70700 1 -- 172.21.15.63:0/3243123077 shutdown_connections 2020-05-18T21:34:25.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.442+0000 7f471df70700 1 -- 172.21.15.63:0/3243123077 wait complete. 2020-05-18T21:34:25.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f471df70700 1 Processor -- start 2020-05-18T21:34:25.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f471df70700 1 -- start start 2020-05-18T21:34:25.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f471df70700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f471809b0b0 0x7f47180b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:25.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f471df70700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4718146490 0x7f4718141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:25.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f471df70700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47180987e0 con 0x7f47180aef00 2020-05-18T21:34:25.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f471df70700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47180b1ed0 con 0x7f4718146490 2020-05-18T21:34:25.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f471df70700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47181416e0 con 0x7f471809b0b0 2020-05-18T21:34:25.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f470ffff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f47180aef00 0x7f4718144270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:34022/0 (socket says 172.21.15.63:34022) 2020-05-18T21:34:25.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f470ffff700 1 -- 172.21.15.63:0/988925130 learned_addr learned my addr 172.21.15.63:0/988925130 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:25.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f4717fff700 1 --2- 172.21.15.63:0/988925130 >> v2:172.21.15.63:3300/0 conn(0x7f4718146490 0x7f4718141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f47177fe700 1 --2- 172.21.15.63:0/988925130 >> v2:172.21.15.155:3300/0 conn(0x7f471809b0b0 0x7f47180b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f4717fff700 1 -- 172.21.15.63:0/988925130 >> v2:172.21.15.155:3300/0 conn(0x7f471809b0b0 msgr2=0x7f47180b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f4717fff700 1 --2- 172.21.15.63:0/988925130 >> v2:172.21.15.155:3300/0 conn(0x7f471809b0b0 0x7f47180b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:25.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f4717fff700 1 -- 172.21.15.63:0/988925130 >> v1:172.21.15.155:6789/0 conn(0x7f47180aef00 legacy=0x7f4718144270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f4717fff700 1 -- 172.21.15.63:0/988925130 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4718144980 con 0x7f4718146490 2020-05-18T21:34:25.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f4717fff700 1 --2- 172.21.15.63:0/988925130 >> v2:172.21.15.63:3300/0 conn(0x7f4718146490 0x7f4718141280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f47180b44c0 tx=0x7f4710010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f4717fff700 1 --2- 172.21.15.63:0/988925130 >> v2:172.21.15.63:3300/0 conn(0x7f4718146490 0x7f4718141280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f47180b44c0 tx=0x7f4710010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f4717fff700 1 --2- 172.21.15.63:0/988925130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4718146490 0x7f4718141280 secure :-1 s=READY pgs=1638 cs=0 l=1 rx=0x7f47180b44c0 tx=0x7f4710010be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:25.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f4717fff700 1 --2- 172.21.15.63:0/988925130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4718146490 0x7f4718141280 secure :-1 s=THROTTLE_DONE pgs=1638 cs=0 l=1 rx=0x7f47180b44c0 tx=0x7f4710010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f4717fff700 1 --2- 172.21.15.63:0/988925130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4718146490 0x7f4718141280 secure :-1 s=THROTTLE_DONE pgs=1638 cs=0 l=1 rx=0x7f47180b44c0 tx=0x7f4710010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f4717fff700 1 --2- 172.21.15.63:0/988925130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4718146490 0x7f4718141280 secure :-1 s=THROTTLE_DONE pgs=1638 cs=0 l=1 rx=0x7f47180b44c0 tx=0x7f4710010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f47157fa700 1 -- 172.21.15.63:0/988925130 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4710002280 con 0x7f4718146490 2020-05-18T21:34:25.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f47157fa700 1 -- 172.21.15.63:0/988925130 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47100023e0 con 0x7f4718146490 2020-05-18T21:34:25.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f471df70700 1 -- 172.21.15.63:0/988925130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4718141b50 con 0x7f4718146490 2020-05-18T21:34:25.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f47157fa700 1 -- 172.21.15.63:0/988925130 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4710002800 con 0x7f4718146490 2020-05-18T21:34:25.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.446+0000 7f471df70700 1 -- 172.21.15.63:0/988925130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4718098560 con 0x7f4718146490 2020-05-18T21:34:25.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.450+0000 7f4717fff700 1 --2- 172.21.15.63:0/988925130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4718146490 0x7f4718141280 secure :-1 s=THROTTLE_DONE pgs=1638 cs=0 l=1 rx=0x7f47180b44c0 tx=0x7f4710010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.450+0000 7f471df70700 1 -- 172.21.15.63:0/988925130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47180569e0 con 0x7f4718146490 2020-05-18T21:34:25.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.450+0000 7f47157fa700 1 -- 172.21.15.63:0/988925130 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4710002a70 con 0x7f4718146490 2020-05-18T21:34:25.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.450+0000 7f4717fff700 1 --2- 172.21.15.63:0/988925130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4718146490 0x7f4718141280 secure :-1 s=THROTTLE_DONE pgs=1638 cs=0 l=1 rx=0x7f47180b44c0 tx=0x7f4710010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.450+0000 7f47157fa700 1 --2- 172.21.15.63:0/988925130 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f46fc04f9e0 0x7f46fc051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:25.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.450+0000 7f47157fa700 1 -- 172.21.15.63:0/988925130 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f4710064260 con 0x7f4718146490 2020-05-18T21:34:25.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.450+0000 7f47177fe700 1 --2- 172.21.15.63:0/988925130 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f46fc04f9e0 0x7f46fc051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.450+0000 7f47177fe700 1 --2- 172.21.15.63:0/988925130 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f46fc04f9e0 0x7f46fc051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4708002f70 tx=0x7f4708007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.450+0000 7f47177fe700 1 --2- 172.21.15.63:0/988925130 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f46fc04f9e0 0x7f46fc051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4708002f70 tx=0x7f4708007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.450+0000 7f47177fe700 1 --2- 172.21.15.63:0/988925130 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f46fc04f9e0 0x7f46fc051ea0 secure :-1 s=READY pgs=633 cs=0 l=1 rx=0x7f4708002f70 tx=0x7f4708007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:25.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.454+0000 7f4717fff700 1 --2- 172.21.15.63:0/988925130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4718146490 0x7f4718141280 secure :-1 s=THROTTLE_DONE pgs=1638 cs=0 l=1 rx=0x7f47180b44c0 tx=0x7f4710010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.454+0000 7f47157fa700 1 -- 172.21.15.63:0/988925130 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f471003e5f0 con 0x7f4718146490 2020-05-18T21:34:25.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.570+0000 7f471df70700 1 -- 172.21.15.63:0/988925130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f471806ac80 con 0x7f4718146490 2020-05-18T21:34:25.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.570+0000 7f4717fff700 1 --2- 172.21.15.63:0/988925130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4718146490 0x7f4718141280 secure :-1 s=THROTTLE_DONE pgs=1638 cs=0 l=1 rx=0x7f47180b44c0 tx=0x7f4710010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.570+0000 7f47157fa700 1 -- 172.21.15.63:0/988925130 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v118) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4710041c10 con 0x7f4718146490 2020-05-18T21:34:25.576 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:34:25.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.574+0000 7f471df70700 1 -- 172.21.15.63:0/988925130 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f46fc04f9e0 msgr2=0x7f46fc051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.574+0000 7f471df70700 1 --2- 172.21.15.63:0/988925130 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f46fc04f9e0 0x7f46fc051ea0 secure :-1 s=READY pgs=633 cs=0 l=1 rx=0x7f4708002f70 tx=0x7f4708007a80).stop 2020-05-18T21:34:25.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.574+0000 7f471df70700 1 -- 172.21.15.63:0/988925130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4718146490 msgr2=0x7f4718141280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.574+0000 7f471df70700 1 --2- 172.21.15.63:0/988925130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4718146490 0x7f4718141280 secure :-1 s=READY pgs=1638 cs=0 l=1 rx=0x7f47180b44c0 tx=0x7f4710010be0).stop 2020-05-18T21:34:25.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.574+0000 7f471df70700 1 -- 172.21.15.63:0/988925130 shutdown_connections 2020-05-18T21:34:25.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.574+0000 7f471df70700 1 --2- 172.21.15.63:0/988925130 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f46fc04f9e0 0x7f46fc051ea0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:25.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.574+0000 7f471df70700 1 --2- 172.21.15.63:0/988925130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4718146490 0x7f4718141280 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:25.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.574+0000 7f471df70700 1 --2- 172.21.15.63:0/988925130 >> v2:172.21.15.155:3300/0 conn(0x7f471809b0b0 0x7f47180b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:25.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.574+0000 7f471df70700 1 -- 172.21.15.63:0/988925130 >> 172.21.15.63:0/988925130 conn(0x7f47180b9770 msgr2=0x7f471814f990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:25.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.574+0000 7f471df70700 1 -- 172.21.15.63:0/988925130 shutdown_connections 2020-05-18T21:34:25.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.574+0000 7f471df70700 1 -- 172.21.15.63:0/988925130 wait complete. 2020-05-18T21:34:25.589 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-05-18T21:34:25.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.686+0000 7febf2b3b700 1 Processor -- start 2020-05-18T21:34:25.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf2b3b700 1 -- start start 2020-05-18T21:34:25.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf2b3b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7febec145250 0x7febec09c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:25.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf2b3b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7febec09cb50 0x7febec0b5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:25.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf2b3b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febec0b5970 0x7febec069b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:25.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf2b3b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febec0634b0 con 0x7febec145250 2020-05-18T21:34:25.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf2b3b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febec0663d0 con 0x7febec09cb50 2020-05-18T21:34:25.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf2b3b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec061b00 con 0x7febec0b5970 2020-05-18T21:34:25.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf1b39700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7febec145250 0x7febec09c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf1338700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7febec09cb50 0x7febec0b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf1338700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7febec09cb50 0x7febec0b5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:48374/0 (socket says 172.21.15.63:48374) 2020-05-18T21:34:25.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf1b39700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7febec145250 0x7febec09c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33528/0 (socket says 172.21.15.63:33528) 2020-05-18T21:34:25.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf1338700 1 -- 172.21.15.63:0/2469115464 learned_addr learned my addr 172.21.15.63:0/2469115464 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:25.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf233a700 1 --2- 172.21.15.63:0/2469115464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febec0b5970 0x7febec069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf1338700 1 -- 172.21.15.63:0/2469115464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febec0b5970 msgr2=0x7febec069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:25.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf1338700 1 --2- 172.21.15.63:0/2469115464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febec0b5970 0x7febec069b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:25.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf1338700 1 -- 172.21.15.63:0/2469115464 >> v2:172.21.15.63:3300/0 conn(0x7febec145250 msgr2=0x7febec09c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:25.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf1338700 1 --2- 172.21.15.63:0/2469115464 >> v2:172.21.15.63:3300/0 conn(0x7febec145250 0x7febec09c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:25.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf1338700 1 -- 172.21.15.63:0/2469115464 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec09d320 con 0x7febec09cb50 2020-05-18T21:34:25.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf1b39700 1 --2- 172.21.15.63:0/2469115464 >> v2:172.21.15.63:3300/0 conn(0x7febec145250 0x7febec09c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:25.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf1338700 1 --2- 172.21.15.63:0/2469115464 >> v2:172.21.15.155:3300/0 conn(0x7febec09cb50 0x7febec0b5510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7febdc002f70 tx=0x7febdc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf1338700 1 --2- 172.21.15.63:0/2469115464 >> v2:172.21.15.155:3300/0 conn(0x7febec09cb50 0x7febec0b5510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7febdc002f70 tx=0x7febdc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf1338700 1 --2- 172.21.15.63:0/2469115464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febec09cb50 0x7febec0b5510 secure :-1 s=READY pgs=1083 cs=0 l=1 rx=0x7febdc002f70 tx=0x7febdc007a80).ready entity=mon.1 client_cookie=f94442ae7bde63c3 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:25.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf1338700 1 --2- 172.21.15.63:0/2469115464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febec09cb50 0x7febec0b5510 secure :-1 s=THROTTLE_DONE pgs=1083 cs=0 l=1 rx=0x7febdc002f70 tx=0x7febdc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf0b37700 1 -- 172.21.15.63:0/2469115464 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febdc011600 con 0x7febec09cb50 2020-05-18T21:34:25.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf1338700 1 --2- 172.21.15.63:0/2469115464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febec09cb50 0x7febec0b5510 secure :-1 s=THROTTLE_DONE pgs=1083 cs=0 l=1 rx=0x7febdc002f70 tx=0x7febdc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf1338700 1 --2- 172.21.15.63:0/2469115464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febec09cb50 0x7febec0b5510 secure :-1 s=THROTTLE_DONE pgs=1083 cs=0 l=1 rx=0x7febdc002f70 tx=0x7febdc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf0b37700 1 -- 172.21.15.63:0/2469115464 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc011760 con 0x7febec09cb50 2020-05-18T21:34:25.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf0b37700 1 -- 172.21.15.63:0/2469115464 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febdc011b40 con 0x7febec09cb50 2020-05-18T21:34:25.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf2b3b700 1 -- 172.21.15.63:0/2469115464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febec09cb50 msgr2=0x7febec0b5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf2b3b700 1 --2- 172.21.15.63:0/2469115464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febec09cb50 0x7febec0b5510 secure :-1 s=READY pgs=1083 cs=0 l=1 rx=0x7febdc002f70 tx=0x7febdc007a80).stop 2020-05-18T21:34:25.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf2b3b700 1 -- 172.21.15.63:0/2469115464 shutdown_connections 2020-05-18T21:34:25.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf2b3b700 1 --2- 172.21.15.63:0/2469115464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febec0b5970 0x7febec069b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:25.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf2b3b700 1 --2- 172.21.15.63:0/2469115464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febec09cb50 0x7febec0b5510 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:25.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf2b3b700 1 --2- 172.21.15.63:0/2469115464 >> v2:172.21.15.63:3300/0 conn(0x7febec145250 0x7febec09c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:25.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf2b3b700 1 -- 172.21.15.63:0/2469115464 >> 172.21.15.63:0/2469115464 conn(0x7febec05a7c0 msgr2=0x7febec05aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:25.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf2b3b700 1 -- 172.21.15.63:0/2469115464 shutdown_connections 2020-05-18T21:34:25.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.690+0000 7febf2b3b700 1 -- 172.21.15.63:0/2469115464 wait complete. 2020-05-18T21:34:25.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febf2b3b700 1 Processor -- start 2020-05-18T21:34:25.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febf2b3b700 1 -- start start 2020-05-18T21:34:25.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febf2b3b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7febec09cb50 0x7febec0b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:25.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febf2b3b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febec0b5970 0x7febec0b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:25.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febf2b3b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febec0b4e50 con 0x7febec145250 2020-05-18T21:34:25.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febf2b3b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febec156850 con 0x7febec09cb50 2020-05-18T21:34:25.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febf2b3b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec0b5090 con 0x7febec0b5970 2020-05-18T21:34:25.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febf233a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7febec145250 0x7febec153280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35722/0 (socket says 172.21.15.63:35722) 2020-05-18T21:34:25.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febf233a700 1 -- 172.21.15.63:0/812563012 learned_addr learned my addr 172.21.15.63:0/812563012 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:25.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febf1b39700 1 --2- 172.21.15.63:0/812563012 >> v2:172.21.15.155:3300/0 conn(0x7febec09cb50 0x7febec0b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febf1338700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febec0b5970 0x7febec0b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febdaffd700 1 -- 172.21.15.63:0/812563012 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577023584 0 0) 0x7febe4001250 con 0x7febec145250 2020-05-18T21:34:25.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febdaffd700 1 -- 172.21.15.63:0/812563012 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febcc002fe0 con 0x7febec145250 2020-05-18T21:34:25.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febf1b39700 1 -- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febec0b5970 msgr2=0x7febec0b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febf1b39700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febec0b5970 0x7febec0b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:25.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febf1b39700 1 -- 172.21.15.63:0/812563012 >> v1:172.21.15.63:6789/0 conn(0x7febec145250 legacy=0x7febec153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febf1b39700 1 -- 172.21.15.63:0/812563012 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec0b5330 con 0x7febec09cb50 2020-05-18T21:34:25.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febf1b39700 1 --2- 172.21.15.63:0/812563012 >> v2:172.21.15.155:3300/0 conn(0x7febec09cb50 0x7febec0b41f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7febe8002f70 tx=0x7febe8010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febf1b39700 1 --2- 172.21.15.63:0/812563012 >> v2:172.21.15.155:3300/0 conn(0x7febec09cb50 0x7febec0b41f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7febe8002f70 tx=0x7febe8010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febf1b39700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febec09cb50 0x7febec0b41f0 secure :-1 s=READY pgs=1084 cs=0 l=1 rx=0x7febe8002f70 tx=0x7febe8010d30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:25.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.694+0000 7febf1b39700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febec09cb50 0x7febec0b41f0 secure :-1 s=THROTTLE_DONE pgs=1084 cs=0 l=1 rx=0x7febe8002f70 tx=0x7febe8010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.698+0000 7febdaffd700 1 -- 172.21.15.63:0/812563012 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febe8007550 con 0x7febec09cb50 2020-05-18T21:34:25.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.698+0000 7febf1b39700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febec09cb50 0x7febec0b41f0 secure :-1 s=THROTTLE_DONE pgs=1084 cs=0 l=1 rx=0x7febe8002f70 tx=0x7febe8010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.698+0000 7febf1b39700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febec09cb50 0x7febec0b41f0 secure :-1 s=THROTTLE_DONE pgs=1084 cs=0 l=1 rx=0x7febe8002f70 tx=0x7febe8010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.698+0000 7febdaffd700 1 -- 172.21.15.63:0/812563012 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe8005700 con 0x7febec09cb50 2020-05-18T21:34:25.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.698+0000 7febf2b3b700 1 -- 172.21.15.63:0/812563012 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febec0657b0 con 0x7febec09cb50 2020-05-18T21:34:25.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.698+0000 7febdaffd700 1 -- 172.21.15.63:0/812563012 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febe8005b20 con 0x7febec09cb50 2020-05-18T21:34:25.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.698+0000 7febf2b3b700 1 -- 172.21.15.63:0/812563012 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec065c60 con 0x7febec09cb50 2020-05-18T21:34:25.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.698+0000 7febf2b3b700 1 -- 172.21.15.63:0/812563012 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febec156990 con 0x7febec09cb50 2020-05-18T21:34:25.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.698+0000 7febf1b39700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febec09cb50 0x7febec0b41f0 secure :-1 s=THROTTLE_DONE pgs=1084 cs=0 l=1 rx=0x7febe8002f70 tx=0x7febe8010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.698+0000 7febdaffd700 1 -- 172.21.15.63:0/812563012 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7febe8010190 con 0x7febec09cb50 2020-05-18T21:34:25.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.698+0000 7febf1b39700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febec09cb50 0x7febec0b41f0 secure :-1 s=THROTTLE_DONE pgs=1084 cs=0 l=1 rx=0x7febe8002f70 tx=0x7febe8010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.698+0000 7febdaffd700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7febcc04fdf0 0x7febcc0522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:25.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.698+0000 7febdaffd700 1 -- 172.21.15.63:0/812563012 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5253+0+0 (secure 0 0 0) 0x7febe8064260 con 0x7febec09cb50 2020-05-18T21:34:25.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.698+0000 7febf1338700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7febcc04fdf0 0x7febcc0522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.702+0000 7febf1338700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7febcc04fdf0 0x7febcc0522b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7febdc002f70 tx=0x7febdc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.702+0000 7febf1338700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7febcc04fdf0 0x7febcc0522b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7febdc002f70 tx=0x7febdc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.702+0000 7febf1338700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7febcc04fdf0 0x7febcc0522b0 secure :-1 s=READY pgs=634 cs=0 l=1 rx=0x7febdc002f70 tx=0x7febdc007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:25.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.706+0000 7febf1b39700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febec09cb50 0x7febec0b41f0 secure :-1 s=THROTTLE_DONE pgs=1084 cs=0 l=1 rx=0x7febe8002f70 tx=0x7febe8010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.706+0000 7febdaffd700 1 -- 172.21.15.63:0/812563012 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7febe803e590 con 0x7febec09cb50 2020-05-18T21:34:25.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.822+0000 7febf2b3b700 1 -- 172.21.15.63:0/812563012 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7febec0569e0 con 0x7febec09cb50 2020-05-18T21:34:25.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.822+0000 7febf1b39700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febec09cb50 0x7febec0b41f0 secure :-1 s=THROTTLE_DONE pgs=1084 cs=0 l=1 rx=0x7febe8002f70 tx=0x7febe8010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.822+0000 7febdaffd700 1 -- 172.21.15.63:0/812563012 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v118) v1 ==== 84+0+143 (secure 0 0 0) 0x7febe8041bb0 con 0x7febec09cb50 2020-05-18T21:34:25.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.822+0000 7febf2b3b700 1 -- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7febcc04fdf0 msgr2=0x7febcc0522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.822+0000 7febf2b3b700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7febcc04fdf0 0x7febcc0522b0 secure :-1 s=READY pgs=634 cs=0 l=1 rx=0x7febdc002f70 tx=0x7febdc007a80).stop 2020-05-18T21:34:25.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.822+0000 7febf2b3b700 1 -- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febec09cb50 msgr2=0x7febec0b41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.822+0000 7febf2b3b700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febec09cb50 0x7febec0b41f0 secure :-1 s=READY pgs=1084 cs=0 l=1 rx=0x7febe8002f70 tx=0x7febe8010d30).stop 2020-05-18T21:34:25.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.822+0000 7febf2b3b700 1 -- 172.21.15.63:0/812563012 shutdown_connections 2020-05-18T21:34:25.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.822+0000 7febf2b3b700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7febcc04fdf0 0x7febcc0522b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:25.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.822+0000 7febf2b3b700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febec0b5970 0x7febec0b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:25.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.822+0000 7febf2b3b700 1 --2- 172.21.15.63:0/812563012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febec09cb50 0x7febec0b41f0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:25.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.822+0000 7febf2b3b700 1 -- 172.21.15.63:0/812563012 >> 172.21.15.63:0/812563012 conn(0x7febec05a7c0 msgr2=0x7febec09b310 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:25.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.822+0000 7febf2b3b700 1 -- 172.21.15.63:0/812563012 shutdown_connections 2020-05-18T21:34:25.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.822+0000 7febf2b3b700 1 -- 172.21.15.63:0/812563012 wait complete. 2020-05-18T21:34:25.833 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:25.834 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:34:25.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:25.834 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2020-05-18T21:34:25.834 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "device_health_metrics" 2020-05-18T21:34:25.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:25.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:34:25.835 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 2, 2020-05-18T21:34:25.836 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "rbd" 2020-05-18T21:34:25.836 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:25.836 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:34:25.839 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-05-18T21:34:25.840 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-05-18T21:34:25.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.942+0000 7f9c7b0b7700 1 Processor -- start 2020-05-18T21:34:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.942+0000 7f9c7b0b7700 1 -- start start 2020-05-18T21:34:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.942+0000 7f9c7b0b7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c740b6190 0x7f9c74066e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.942+0000 7f9c7b0b7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c740b4900 con 0x7f9c740b4fd0 2020-05-18T21:34:25.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.942+0000 7f9c7b0b7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c74098c80 con 0x7f9c74142a40 2020-05-18T21:34:25.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.942+0000 7f9c7b0b7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c740b4b30 con 0x7f9c740b6190 2020-05-18T21:34:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.942+0000 7f9c73fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9c740b4fd0 0x7f9c74142330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35732/0 (socket says 172.21.15.63:35732) 2020-05-18T21:34:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.942+0000 7f9c73fff700 1 -- 172.21.15.63:0/2408390678 learned_addr learned my addr 172.21.15.63:0/2408390678 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.942+0000 7f9c78e53700 1 --2- 172.21.15.63:0/2408390678 >> v2:172.21.15.155:3300/0 conn(0x7f9c740b6190 0x7f9c74066e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.942+0000 7f9c737fe700 1 -- 172.21.15.63:0/2408390678 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854258521 0 0) 0x7f9c740b4900 con 0x7f9c740b4fd0 2020-05-18T21:34:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.942+0000 7f9c737fe700 1 -- 172.21.15.63:0/2408390678 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c54003270 con 0x7f9c740b4fd0 2020-05-18T21:34:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.942+0000 7f9c78e53700 1 -- 172.21.15.63:0/2408390678 >> v1:172.21.15.155:6789/0 conn(0x7f9c74142a40 legacy=0x7f9c7405ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.942+0000 7f9c78e53700 1 -- 172.21.15.63:0/2408390678 >> v1:172.21.15.63:6789/0 conn(0x7f9c740b4fd0 legacy=0x7f9c74142330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.942+0000 7f9c78e53700 1 -- 172.21.15.63:0/2408390678 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c740b6570 con 0x7f9c740b6190 2020-05-18T21:34:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.942+0000 7f9c78e53700 1 --2- 172.21.15.63:0/2408390678 >> v2:172.21.15.155:3300/0 conn(0x7f9c740b6190 0x7f9c74066e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9c640032f0 tx=0x7f9c64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.946+0000 7f9c78e53700 1 --2- 172.21.15.63:0/2408390678 >> v2:172.21.15.155:3300/0 conn(0x7f9c740b6190 0x7f9c74066e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9c640032f0 tx=0x7f9c64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.946+0000 7f9c78e53700 1 --2- 172.21.15.63:0/2408390678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c740b6190 0x7f9c74066e80 secure :-1 s=READY pgs=1086 cs=0 l=1 rx=0x7f9c640032f0 tx=0x7f9c64007e00).ready entity=mon.1 client_cookie=6ce217932b6cc16c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.946+0000 7f9c78e53700 1 --2- 172.21.15.63:0/2408390678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c740b6190 0x7f9c74066e80 secure :-1 s=THROTTLE_DONE pgs=1086 cs=0 l=1 rx=0x7f9c640032f0 tx=0x7f9c64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.946+0000 7f9c737fe700 1 -- 172.21.15.63:0/2408390678 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c64011e60 con 0x7f9c740b6190 2020-05-18T21:34:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.946+0000 7f9c78e53700 1 --2- 172.21.15.63:0/2408390678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c740b6190 0x7f9c74066e80 secure :-1 s=THROTTLE_DONE pgs=1086 cs=0 l=1 rx=0x7f9c640032f0 tx=0x7f9c64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.946+0000 7f9c737fe700 1 -- 172.21.15.63:0/2408390678 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6400a180 con 0x7f9c740b6190 2020-05-18T21:34:25.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.946+0000 7f9c78e53700 1 --2- 172.21.15.63:0/2408390678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c740b6190 0x7f9c74066e80 secure :-1 s=THROTTLE_DONE pgs=1086 cs=0 l=1 rx=0x7f9c640032f0 tx=0x7f9c64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.946+0000 7f9c737fe700 1 -- 172.21.15.63:0/2408390678 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c6400a4e0 con 0x7f9c740b6190 2020-05-18T21:34:25.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.946+0000 7f9c7b0b7700 1 -- 172.21.15.63:0/2408390678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c740b6190 msgr2=0x7f9c74066e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.946+0000 7f9c7b0b7700 1 --2- 172.21.15.63:0/2408390678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c740b6190 0x7f9c74066e80 secure :-1 s=READY pgs=1086 cs=0 l=1 rx=0x7f9c640032f0 tx=0x7f9c64007e00).stop 2020-05-18T21:34:25.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.946+0000 7f9c7b0b7700 1 -- 172.21.15.63:0/2408390678 shutdown_connections 2020-05-18T21:34:25.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.946+0000 7f9c7b0b7700 1 --2- 172.21.15.63:0/2408390678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c740b6190 0x7f9c74066e80 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.946+0000 7f9c7b0b7700 1 -- 172.21.15.63:0/2408390678 >> 172.21.15.63:0/2408390678 conn(0x7f9c740b9720 msgr2=0x7f9c740b5740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.946+0000 7f9c7b0b7700 1 -- 172.21.15.63:0/2408390678 shutdown_connections 2020-05-18T21:34:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.946+0000 7f9c7b0b7700 1 -- 172.21.15.63:0/2408390678 wait complete. 2020-05-18T21:34:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.946+0000 7f9c7b0b7700 1 Processor -- start 2020-05-18T21:34:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.946+0000 7f9c7b0b7700 1 -- start start 2020-05-18T21:34:25.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c7b0b7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c740b4fd0 0x7f9c7413f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:25.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c7b0b7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c74150da0 0x7f9c74155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:25.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c7b0b7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7413ee10 con 0x7f9c740b6190 2020-05-18T21:34:25.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c7b0b7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c741557d0 con 0x7f9c740b4fd0 2020-05-18T21:34:25.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c7b0b7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7413f0b0 con 0x7f9c74150da0 2020-05-18T21:34:25.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c73fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9c740b6190 0x7f9c74150690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35736/0 (socket says 172.21.15.63:35736) 2020-05-18T21:34:25.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c73fff700 1 -- 172.21.15.63:0/3673257642 learned_addr learned my addr 172.21.15.63:0/3673257642 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:25.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c78e53700 1 --2- 172.21.15.63:0/3673257642 >> v2:172.21.15.63:3300/0 conn(0x7f9c740b4fd0 0x7f9c7413f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c79654700 1 --2- 172.21.15.63:0/3673257642 >> v2:172.21.15.155:3300/0 conn(0x7f9c74150da0 0x7f9c74155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c71ffb700 1 -- 172.21.15.63:0/3673257642 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3070881365 0 0) 0x7f9c7413ee10 con 0x7f9c740b6190 2020-05-18T21:34:25.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c71ffb700 1 -- 172.21.15.63:0/3673257642 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c58002fe0 con 0x7f9c740b6190 2020-05-18T21:34:25.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c78e53700 1 -- 172.21.15.63:0/3673257642 >> v2:172.21.15.155:3300/0 conn(0x7f9c74150da0 msgr2=0x7f9c74155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c78e53700 1 --2- 172.21.15.63:0/3673257642 >> v2:172.21.15.155:3300/0 conn(0x7f9c74150da0 0x7f9c74155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:25.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c78e53700 1 -- 172.21.15.63:0/3673257642 >> v1:172.21.15.63:6789/0 conn(0x7f9c740b6190 legacy=0x7f9c74150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:25.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c78e53700 1 -- 172.21.15.63:0/3673257642 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7413f350 con 0x7f9c740b4fd0 2020-05-18T21:34:25.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c78e53700 1 --2- 172.21.15.63:0/3673257642 >> v2:172.21.15.63:3300/0 conn(0x7f9c740b4fd0 0x7f9c7413f7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c640032f0 tx=0x7f9c64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c78e53700 1 --2- 172.21.15.63:0/3673257642 >> v2:172.21.15.63:3300/0 conn(0x7f9c740b4fd0 0x7f9c7413f7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c640032f0 tx=0x7f9c64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c78e53700 1 --2- 172.21.15.63:0/3673257642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c740b4fd0 0x7f9c7413f7f0 secure :-1 s=READY pgs=1642 cs=0 l=1 rx=0x7f9c640032f0 tx=0x7f9c64007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:25.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c78e53700 1 --2- 172.21.15.63:0/3673257642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c740b4fd0 0x7f9c7413f7f0 secure :-1 s=THROTTLE_DONE pgs=1642 cs=0 l=1 rx=0x7f9c640032f0 tx=0x7f9c64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c71ffb700 1 -- 172.21.15.63:0/3673257642 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c64008aa0 con 0x7f9c740b4fd0 2020-05-18T21:34:25.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c7b0b7700 1 -- 172.21.15.63:0/3673257642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c740b23e0 con 0x7f9c740b4fd0 2020-05-18T21:34:25.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c78e53700 1 --2- 172.21.15.63:0/3673257642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c740b4fd0 0x7f9c7413f7f0 secure :-1 s=THROTTLE_DONE pgs=1642 cs=0 l=1 rx=0x7f9c640032f0 tx=0x7f9c64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c71ffb700 1 -- 172.21.15.63:0/3673257642 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c64005c70 con 0x7f9c740b4fd0 2020-05-18T21:34:25.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c78e53700 1 --2- 172.21.15.63:0/3673257642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c740b4fd0 0x7f9c7413f7f0 secure :-1 s=THROTTLE_DONE pgs=1642 cs=0 l=1 rx=0x7f9c640032f0 tx=0x7f9c64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c71ffb700 1 -- 172.21.15.63:0/3673257642 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c64005de0 con 0x7f9c740b4fd0 2020-05-18T21:34:25.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c7b0b7700 1 -- 172.21.15.63:0/3673257642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7409a670 con 0x7f9c740b4fd0 2020-05-18T21:34:25.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.950+0000 7f9c78e53700 1 --2- 172.21.15.63:0/3673257642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c740b4fd0 0x7f9c7413f7f0 secure :-1 s=THROTTLE_DONE pgs=1642 cs=0 l=1 rx=0x7f9c640032f0 tx=0x7f9c64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.954+0000 7f9c7b0b7700 1 -- 172.21.15.63:0/3673257642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c7413ec40 con 0x7f9c740b4fd0 2020-05-18T21:34:25.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.954+0000 7f9c71ffb700 1 -- 172.21.15.63:0/3673257642 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9c6400f7a0 con 0x7f9c740b4fd0 2020-05-18T21:34:25.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.954+0000 7f9c78e53700 1 --2- 172.21.15.63:0/3673257642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c740b4fd0 0x7f9c7413f7f0 secure :-1 s=THROTTLE_DONE pgs=1642 cs=0 l=1 rx=0x7f9c640032f0 tx=0x7f9c64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.954+0000 7f9c71ffb700 1 --2- 172.21.15.63:0/3673257642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5804fd40 0x7f9c58052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:25.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.954+0000 7f9c71ffb700 1 -- 172.21.15.63:0/3673257642 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9c64064c00 con 0x7f9c740b4fd0 2020-05-18T21:34:25.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.954+0000 7f9c73fff700 1 --2- 172.21.15.63:0/3673257642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5804fd40 0x7f9c58052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:25.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.954+0000 7f9c73fff700 1 --2- 172.21.15.63:0/3673257642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5804fd40 0x7f9c58052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c5c000f50 tx=0x7f9c5c001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.954+0000 7f9c73fff700 1 --2- 172.21.15.63:0/3673257642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5804fd40 0x7f9c58052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c5c000f50 tx=0x7f9c5c001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.954+0000 7f9c73fff700 1 --2- 172.21.15.63:0/3673257642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5804fd40 0x7f9c58052200 secure :-1 s=READY pgs=635 cs=0 l=1 rx=0x7f9c5c000f50 tx=0x7f9c5c001780).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:25.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.958+0000 7f9c78e53700 1 --2- 172.21.15.63:0/3673257642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c740b4fd0 0x7f9c7413f7f0 secure :-1 s=THROTTLE_DONE pgs=1642 cs=0 l=1 rx=0x7f9c640032f0 tx=0x7f9c64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:25.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:25.958+0000 7f9c71ffb700 1 -- 172.21.15.63:0/3673257642 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9c6403f050 con 0x7f9c740b4fd0 2020-05-18T21:34:26.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.074+0000 7f9c7b0b7700 1 -- 172.21.15.63:0/3673257642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f9c740569e0 con 0x7f9c740b4fd0 2020-05-18T21:34:26.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.446+0000 7f9c78e53700 1 --2- 172.21.15.63:0/3673257642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c740b4fd0 0x7f9c7413f7f0 secure :-1 s=THROTTLE_DONE pgs=1642 cs=0 l=1 rx=0x7f9c640032f0 tx=0x7f9c64007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:26.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.446+0000 7f9c71ffb700 1 -- 172.21.15.63:0/3673257642 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v119) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9c64042670 con 0x7f9c740b4fd0 2020-05-18T21:34:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.450+0000 7f9c7b0b7700 1 -- 172.21.15.63:0/3673257642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5804fd40 msgr2=0x7f9c58052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.450+0000 7f9c7b0b7700 1 --2- 172.21.15.63:0/3673257642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5804fd40 0x7f9c58052200 secure :-1 s=READY pgs=635 cs=0 l=1 rx=0x7f9c5c000f50 tx=0x7f9c5c001780).stop 2020-05-18T21:34:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.450+0000 7f9c7b0b7700 1 -- 172.21.15.63:0/3673257642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c740b4fd0 msgr2=0x7f9c7413f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.450+0000 7f9c7b0b7700 1 --2- 172.21.15.63:0/3673257642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c740b4fd0 0x7f9c7413f7f0 secure :-1 s=READY pgs=1642 cs=0 l=1 rx=0x7f9c640032f0 tx=0x7f9c64007e00).stop 2020-05-18T21:34:26.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.450+0000 7f9c7b0b7700 1 -- 172.21.15.63:0/3673257642 shutdown_connections 2020-05-18T21:34:26.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.450+0000 7f9c7b0b7700 1 --2- 172.21.15.63:0/3673257642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9c5804fd40 0x7f9c58052200 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:26.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.450+0000 7f9c7b0b7700 1 --2- 172.21.15.63:0/3673257642 >> v2:172.21.15.155:3300/0 conn(0x7f9c74150da0 0x7f9c74155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:26.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.450+0000 7f9c7b0b7700 1 --2- 172.21.15.63:0/3673257642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c740b4fd0 0x7f9c7413f7f0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:26.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.450+0000 7f9c7b0b7700 1 -- 172.21.15.63:0/3673257642 >> 172.21.15.63:0/3673257642 conn(0x7f9c740b9720 msgr2=0x7f9c7406a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:26.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.450+0000 7f9c7b0b7700 1 -- 172.21.15.63:0/3673257642 shutdown_connections 2020-05-18T21:34:26.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.450+0000 7f9c7b0b7700 1 -- 172.21.15.63:0/3673257642 wait complete. 2020-05-18T21:34:26.456 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2020-05-18T21:34:26.469 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-05-18T21:34:26.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.582+0000 7fca3759e700 1 Processor -- start 2020-05-18T21:34:26.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.582+0000 7fca3759e700 1 -- start start 2020-05-18T21:34:26.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.582+0000 7fca3759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fca381458b0 0x7fca38063770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:26.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.582+0000 7fca3759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca380b5c90 0x7fca380b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:26.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.582+0000 7fca3759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca380a0680 con 0x7fca3806a690 2020-05-18T21:34:26.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.582+0000 7fca3759e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca380b42c0 con 0x7fca381458b0 2020-05-18T21:34:26.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.582+0000 7fca3759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca380b4560 con 0x7fca380b5c90 2020-05-18T21:34:26.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.582+0000 7fca3659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fca381458b0 0x7fca38063770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:26.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.582+0000 7fca3659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fca381458b0 0x7fca38063770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33556/0 (socket says 172.21.15.63:33556) 2020-05-18T21:34:26.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.582+0000 7fca3659c700 1 -- 172.21.15.63:0/1217952770 learned_addr learned my addr 172.21.15.63:0/1217952770 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:26.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.582+0000 7fca36d9d700 1 --2- 172.21.15.63:0/1217952770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca380b5c90 0x7fca380b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:26.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.582+0000 7fca3659c700 1 -- 172.21.15.63:0/1217952770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca380b5c90 msgr2=0x7fca380b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:26.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.582+0000 7fca3659c700 1 --2- 172.21.15.63:0/1217952770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca380b5c90 0x7fca380b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:26.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.582+0000 7fca3659c700 1 -- 172.21.15.63:0/1217952770 >> v1:172.21.15.63:6789/0 conn(0x7fca3806a690 legacy=0x7fca380b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:26.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.582+0000 7fca3659c700 1 -- 172.21.15.63:0/1217952770 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca380b3fb0 con 0x7fca381458b0 2020-05-18T21:34:26.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.582+0000 7fca3559a700 1 -- 172.21.15.63:0/1217952770 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771550071 0 0) 0x7fca380a0680 con 0x7fca3806a690 2020-05-18T21:34:26.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.582+0000 7fca3659c700 1 --2- 172.21.15.63:0/1217952770 >> v2:172.21.15.63:3300/0 conn(0x7fca381458b0 0x7fca38063770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fca2c002f70 tx=0x7fca2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:26.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3659c700 1 --2- 172.21.15.63:0/1217952770 >> v2:172.21.15.63:3300/0 conn(0x7fca381458b0 0x7fca38063770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fca2c002f70 tx=0x7fca2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:26.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3659c700 1 --2- 172.21.15.63:0/1217952770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca381458b0 0x7fca38063770 secure :-1 s=READY pgs=1644 cs=0 l=1 rx=0x7fca2c002f70 tx=0x7fca2c007a80).ready entity=mon.0 client_cookie=c4f3d2c533591675 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:26.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3659c700 1 --2- 172.21.15.63:0/1217952770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca381458b0 0x7fca38063770 secure :-1 s=THROTTLE_DONE pgs=1644 cs=0 l=1 rx=0x7fca2c002f70 tx=0x7fca2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:26.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3659c700 1 --2- 172.21.15.63:0/1217952770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca381458b0 0x7fca38063770 secure :-1 s=THROTTLE_DONE pgs=1644 cs=0 l=1 rx=0x7fca2c002f70 tx=0x7fca2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:26.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3659c700 1 --2- 172.21.15.63:0/1217952770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca381458b0 0x7fca38063770 secure :-1 s=THROTTLE_DONE pgs=1644 cs=0 l=1 rx=0x7fca2c002f70 tx=0x7fca2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:26.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3559a700 1 -- 172.21.15.63:0/1217952770 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca2c0116b0 con 0x7fca381458b0 2020-05-18T21:34:26.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3559a700 1 -- 172.21.15.63:0/1217952770 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c011810 con 0x7fca381458b0 2020-05-18T21:34:26.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3559a700 1 -- 172.21.15.63:0/1217952770 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca2c011bf0 con 0x7fca381458b0 2020-05-18T21:34:26.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3759e700 1 -- 172.21.15.63:0/1217952770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca381458b0 msgr2=0x7fca38063770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:26.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3759e700 1 --2- 172.21.15.63:0/1217952770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca381458b0 0x7fca38063770 secure :-1 s=READY pgs=1644 cs=0 l=1 rx=0x7fca2c002f70 tx=0x7fca2c007a80).stop 2020-05-18T21:34:26.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3759e700 1 -- 172.21.15.63:0/1217952770 shutdown_connections 2020-05-18T21:34:26.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3759e700 1 --2- 172.21.15.63:0/1217952770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca380b5c90 0x7fca380b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:26.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3759e700 1 --2- 172.21.15.63:0/1217952770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca381458b0 0x7fca38063770 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:26.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3759e700 1 -- 172.21.15.63:0/1217952770 >> 172.21.15.63:0/1217952770 conn(0x7fca3805fbd0 msgr2=0x7fca38069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:26.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3759e700 1 -- 172.21.15.63:0/1217952770 shutdown_connections 2020-05-18T21:34:26.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3759e700 1 -- 172.21.15.63:0/1217952770 wait complete. 2020-05-18T21:34:26.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3759e700 1 Processor -- start 2020-05-18T21:34:26.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3759e700 1 -- start start 2020-05-18T21:34:26.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca3806a690 0x7fca381133f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:26.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca380b5c90 0x7fca380b8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:26.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca380b8c30 con 0x7fca381458b0 2020-05-18T21:34:26.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca380b8ed0 con 0x7fca3806a690 2020-05-18T21:34:26.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca380b8980 con 0x7fca380b5c90 2020-05-18T21:34:26.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca36d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fca381458b0 0x7fca3809f3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35750/0 (socket says 172.21.15.63:35750) 2020-05-18T21:34:26.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca36d9d700 1 -- 172.21.15.63:0/3517857353 learned_addr learned my addr 172.21.15.63:0/3517857353 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:26.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca3659c700 1 --2- 172.21.15.63:0/3517857353 >> v2:172.21.15.155:3300/0 conn(0x7fca3806a690 0x7fca381133f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:26.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca35d9b700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca380b5c90 0x7fca380b8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:26.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca277fe700 1 -- 172.21.15.63:0/3517857353 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622704889 0 0) 0x7fca380b8c30 con 0x7fca381458b0 2020-05-18T21:34:26.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca277fe700 1 -- 172.21.15.63:0/3517857353 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca14002fe0 con 0x7fca381458b0 2020-05-18T21:34:26.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca277fe700 1 -- 172.21.15.63:0/3517857353 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3904712581 0 0) 0x7fca14002fe0 con 0x7fca381458b0 2020-05-18T21:34:26.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca277fe700 1 -- 172.21.15.63:0/3517857353 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fca380b8c30 con 0x7fca381458b0 2020-05-18T21:34:26.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca277fe700 1 -- 172.21.15.63:0/3517857353 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fca30001850 con 0x7fca381458b0 2020-05-18T21:34:26.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca277fe700 1 -- 172.21.15.63:0/3517857353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca380b5c90 msgr2=0x7fca380b8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:26.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca277fe700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca380b5c90 0x7fca380b8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:26.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca277fe700 1 -- 172.21.15.63:0/3517857353 >> v2:172.21.15.155:3300/0 conn(0x7fca3806a690 msgr2=0x7fca381133f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:26.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca277fe700 1 --2- 172.21.15.63:0/3517857353 >> v2:172.21.15.155:3300/0 conn(0x7fca3806a690 0x7fca381133f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:26.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.586+0000 7fca277fe700 1 -- 172.21.15.63:0/3517857353 >> v1:172.21.15.63:6789/0 conn(0x7fca381458b0 legacy=0x7fca3809f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:26.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca277fe700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca14004a80 0x7fca14004ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:26.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca277fe700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca14008750 0x7fca1400ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:26.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca277fe700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca1400afa0 0x7fca1400d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:26.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca277fe700 1 -- 172.21.15.63:0/3517857353 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca380b8ed0 con 0x7fca14008750 2020-05-18T21:34:26.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca277fe700 1 -- 172.21.15.63:0/3517857353 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca380b8980 con 0x7fca1400afa0 2020-05-18T21:34:26.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca277fe700 1 -- 172.21.15.63:0/3517857353 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1400da30 con 0x7fca14004a80 2020-05-18T21:34:26.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca35d9b700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca14008750 0x7fca1400ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:26.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca3659c700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca14004a80 0x7fca14004ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:26.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca36d9d700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca1400afa0 0x7fca1400d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:26.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca35d9b700 1 -- 172.21.15.63:0/3517857353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca14004a80 msgr2=0x7fca14004ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:26.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca35d9b700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca14004a80 0x7fca14004ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:26.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca35d9b700 1 -- 172.21.15.63:0/3517857353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca1400afa0 msgr2=0x7fca1400d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:26.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca35d9b700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca1400afa0 0x7fca1400d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:26.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca35d9b700 1 -- 172.21.15.63:0/3517857353 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca38156570 con 0x7fca14008750 2020-05-18T21:34:26.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca3759e700 1 -- 172.21.15.63:0/3517857353 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca380b8520 con 0x7fca14008750 2020-05-18T21:34:26.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca36d9d700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca1400afa0 0x7fca1400d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:34:26.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca3759e700 1 -- 172.21.15.63:0/3517857353 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca38156960 con 0x7fca14008750 2020-05-18T21:34:26.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca35d9b700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca14008750 0x7fca1400ab40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca28000bc0 tx=0x7fca2800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:26.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca35d9b700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca14008750 0x7fca1400ab40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca28000bc0 tx=0x7fca2800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:26.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca35d9b700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca14008750 0x7fca1400ab40 secure :-1 s=READY pgs=1646 cs=0 l=1 rx=0x7fca28000bc0 tx=0x7fca2800c4a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:26.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca35d9b700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca14008750 0x7fca1400ab40 secure :-1 s=THROTTLE_DONE pgs=1646 cs=0 l=1 rx=0x7fca28000bc0 tx=0x7fca2800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:26.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca35d9b700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca14008750 0x7fca1400ab40 secure :-1 s=THROTTLE_DONE pgs=1646 cs=0 l=1 rx=0x7fca28000bc0 tx=0x7fca2800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:26.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca277fe700 1 -- 172.21.15.63:0/3517857353 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca28012350 con 0x7fca14008750 2020-05-18T21:34:26.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca35d9b700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca14008750 0x7fca1400ab40 secure :-1 s=THROTTLE_DONE pgs=1646 cs=0 l=1 rx=0x7fca28000bc0 tx=0x7fca2800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:26.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca277fe700 1 -- 172.21.15.63:0/3517857353 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca280124b0 con 0x7fca14008750 2020-05-18T21:34:26.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca277fe700 1 -- 172.21.15.63:0/3517857353 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca28012890 con 0x7fca14008750 2020-05-18T21:34:26.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca35d9b700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca14008750 0x7fca1400ab40 secure :-1 s=THROTTLE_DONE pgs=1646 cs=0 l=1 rx=0x7fca28000bc0 tx=0x7fca2800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:26.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca3759e700 1 -- 172.21.15.63:0/3517857353 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca10003380 con 0x7fca14008750 2020-05-18T21:34:26.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca277fe700 1 -- 172.21.15.63:0/3517857353 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fca280129f0 con 0x7fca14008750 2020-05-18T21:34:26.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca35d9b700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca14008750 0x7fca1400ab40 secure :-1 s=THROTTLE_DONE pgs=1646 cs=0 l=1 rx=0x7fca28000bc0 tx=0x7fca2800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:26.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.590+0000 7fca277fe700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca14058100 0x7fca1405a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:26.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.594+0000 7fca277fe700 1 -- 172.21.15.63:0/3517857353 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fca28063450 con 0x7fca14008750 2020-05-18T21:34:26.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.594+0000 7fca3659c700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca14058100 0x7fca1405a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:26.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.594+0000 7fca3659c700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca14058100 0x7fca1405a5c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca2c002f70 tx=0x7fca2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:26.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.594+0000 7fca3659c700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca14058100 0x7fca1405a5c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca2c002f70 tx=0x7fca2c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:26.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.594+0000 7fca3659c700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca14058100 0x7fca1405a5c0 secure :-1 s=READY pgs=636 cs=0 l=1 rx=0x7fca2c002f70 tx=0x7fca2c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:26.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.598+0000 7fca35d9b700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca14008750 0x7fca1400ab40 secure :-1 s=THROTTLE_DONE pgs=1646 cs=0 l=1 rx=0x7fca28000bc0 tx=0x7fca2800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:26.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.598+0000 7fca277fe700 1 -- 172.21.15.63:0/3517857353 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fca2803d840 con 0x7fca14008750 2020-05-18T21:34:26.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:26.718+0000 7fca3759e700 1 -- 172.21.15.63:0/3517857353 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fca10002240 con 0x7fca14008750 2020-05-18T21:34:27.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.458+0000 7fca35d9b700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca14008750 0x7fca1400ab40 secure :-1 s=THROTTLE_DONE pgs=1646 cs=0 l=1 rx=0x7fca28000bc0 tx=0x7fca2800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.458+0000 7fca277fe700 1 -- 172.21.15.63:0/3517857353 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v120) v1 ==== 125+0+0 (secure 0 0 0) 0x7fca28040e60 con 0x7fca14008750 2020-05-18T21:34:27.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.470+0000 7fca3759e700 1 -- 172.21.15.63:0/3517857353 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca14058100 msgr2=0x7fca1405a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:27.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.470+0000 7fca3759e700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca14058100 0x7fca1405a5c0 secure :-1 s=READY pgs=636 cs=0 l=1 rx=0x7fca2c002f70 tx=0x7fca2c007a80).stop 2020-05-18T21:34:27.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.470+0000 7fca36d9d700 1 -- 172.21.15.63:0/3517857353 reap_dead start 2020-05-18T21:34:27.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.470+0000 7fca3759e700 1 -- 172.21.15.63:0/3517857353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca14008750 msgr2=0x7fca1400ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:27.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.470+0000 7fca3759e700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca14008750 0x7fca1400ab40 secure :-1 s=READY pgs=1646 cs=0 l=1 rx=0x7fca28000bc0 tx=0x7fca2800c4a0).stop 2020-05-18T21:34:27.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.470+0000 7fca3759e700 1 -- 172.21.15.63:0/3517857353 shutdown_connections 2020-05-18T21:34:27.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.470+0000 7fca3759e700 1 --2- 172.21.15.63:0/3517857353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca14008750 0x7fca1400ab40 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:27.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.470+0000 7fca3759e700 1 -- 172.21.15.63:0/3517857353 >> 172.21.15.63:0/3517857353 conn(0x7fca3805fbd0 msgr2=0x7fca380b6350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:27.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.474+0000 7fca3759e700 1 -- 172.21.15.63:0/3517857353 shutdown_connections 2020-05-18T21:34:27.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.474+0000 7fca3759e700 1 -- 172.21.15.63:0/3517857353 wait complete. 2020-05-18T21:34:27.479 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2020-05-18T21:34:27.489 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-05-18T21:34:27.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.594+0000 7fe7bf2b6700 1 Processor -- start 2020-05-18T21:34:27.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.594+0000 7fe7bf2b6700 1 -- start start 2020-05-18T21:34:27.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.594+0000 7fe7bf2b6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7b80b99d0 0x7fe7b81469b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:27.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.594+0000 7fe7bf2b6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe7b8149d40 0x7fe7b8060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:27.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.594+0000 7fe7bf2b6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b8145fd0 con 0x7fe7b80b68d0 2020-05-18T21:34:27.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.594+0000 7fe7bf2b6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b8146270 con 0x7fe7b8149d40 2020-05-18T21:34:27.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.594+0000 7fe7bf2b6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b8146510 con 0x7fe7b80b99d0 2020-05-18T21:34:27.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.594+0000 7fe7beab5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe7b8149d40 0x7fe7b8060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:27.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.594+0000 7fe7bdab3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7b80b99d0 0x7fe7b81469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:27.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7beab5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe7b8149d40 0x7fe7b8060430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:48426/0 (socket says 172.21.15.63:48426) 2020-05-18T21:34:27.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7be2b4700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fe7b80b68d0 0x7fe7b80b8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:34078/0 (socket says 172.21.15.63:34078) 2020-05-18T21:34:27.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7beab5700 1 -- 172.21.15.63:0/2537952826 learned_addr learned my addr 172.21.15.63:0/2537952826 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:27.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7bdab3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7b80b99d0 0x7fe7b81469b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:52510/0 (socket says 172.21.15.63:52510) 2020-05-18T21:34:27.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7beab5700 1 -- 172.21.15.63:0/2537952826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7b80b99d0 msgr2=0x7fe7b81469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:27.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7beab5700 1 --2- 172.21.15.63:0/2537952826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7b80b99d0 0x7fe7b81469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:27.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7beab5700 1 -- 172.21.15.63:0/2537952826 >> v1:172.21.15.155:6789/0 conn(0x7fe7b80b68d0 legacy=0x7fe7b80b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:27.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7beab5700 1 -- 172.21.15.63:0/2537952826 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b814a1f0 con 0x7fe7b8149d40 2020-05-18T21:34:27.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7beab5700 1 --2- 172.21.15.63:0/2537952826 >> v2:172.21.15.155:3300/0 conn(0x7fe7b8149d40 0x7fe7b8060430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe7b80b8c90 tx=0x7fe7b0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7beab5700 1 --2- 172.21.15.63:0/2537952826 >> v2:172.21.15.155:3300/0 conn(0x7fe7b8149d40 0x7fe7b8060430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe7b80b8c90 tx=0x7fe7b0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7beab5700 1 --2- 172.21.15.63:0/2537952826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b8149d40 0x7fe7b8060430 secure :-1 s=READY pgs=1088 cs=0 l=1 rx=0x7fe7b80b8c90 tx=0x7fe7b0008ca0).ready entity=mon.1 client_cookie=af5a7197f8485eff server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:27.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7beab5700 1 --2- 172.21.15.63:0/2537952826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b8149d40 0x7fe7b8060430 secure :-1 s=THROTTLE_DONE pgs=1088 cs=0 l=1 rx=0x7fe7b80b8c90 tx=0x7fe7b0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7beab5700 1 --2- 172.21.15.63:0/2537952826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b8149d40 0x7fe7b8060430 secure :-1 s=THROTTLE_DONE pgs=1088 cs=0 l=1 rx=0x7fe7b80b8c90 tx=0x7fe7b0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7bd2b2700 1 -- 172.21.15.63:0/2537952826 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7b0011d10 con 0x7fe7b8149d40 2020-05-18T21:34:27.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7beab5700 1 --2- 172.21.15.63:0/2537952826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b8149d40 0x7fe7b8060430 secure :-1 s=THROTTLE_DONE pgs=1088 cs=0 l=1 rx=0x7fe7b80b8c90 tx=0x7fe7b0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7bd2b2700 1 -- 172.21.15.63:0/2537952826 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b0011e70 con 0x7fe7b8149d40 2020-05-18T21:34:27.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7bd2b2700 1 -- 172.21.15.63:0/2537952826 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7b000a370 con 0x7fe7b8149d40 2020-05-18T21:34:27.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7bf2b6700 1 -- 172.21.15.63:0/2537952826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b8149d40 msgr2=0x7fe7b8060430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:27.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7bf2b6700 1 --2- 172.21.15.63:0/2537952826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b8149d40 0x7fe7b8060430 secure :-1 s=READY pgs=1088 cs=0 l=1 rx=0x7fe7b80b8c90 tx=0x7fe7b0008ca0).stop 2020-05-18T21:34:27.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7bf2b6700 1 -- 172.21.15.63:0/2537952826 shutdown_connections 2020-05-18T21:34:27.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7bf2b6700 1 --2- 172.21.15.63:0/2537952826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7b8149d40 0x7fe7b8060430 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:27.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7bf2b6700 1 --2- 172.21.15.63:0/2537952826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7b80b99d0 0x7fe7b81469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:27.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7bf2b6700 1 -- 172.21.15.63:0/2537952826 >> 172.21.15.63:0/2537952826 conn(0x7fe7b8069b70 msgr2=0x7fe7b8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:27.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7bf2b6700 1 -- 172.21.15.63:0/2537952826 shutdown_connections 2020-05-18T21:34:27.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.598+0000 7fe7bf2b6700 1 -- 172.21.15.63:0/2537952826 wait complete. 2020-05-18T21:34:27.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7bf2b6700 1 Processor -- start 2020-05-18T21:34:27.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7bf2b6700 1 -- start start 2020-05-18T21:34:27.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7bf2b6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe7b80b68d0 0x7fe7b80adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:27.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7bf2b6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe7b80b99d0 0x7fe7b8152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:27.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7bf2b6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b8153180 con 0x7fe7b8149d40 2020-05-18T21:34:27.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7bf2b6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b8153420 con 0x7fe7b80b68d0 2020-05-18T21:34:27.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7bf2b6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b81536c0 con 0x7fe7b80b99d0 2020-05-18T21:34:27.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7be2b4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe7b80b68d0 0x7fe7b80adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:27.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7beab5700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe7b8149d40 0x7fe7b81413c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35772/0 (socket says 172.21.15.63:35772) 2020-05-18T21:34:27.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7beab5700 1 -- 172.21.15.63:0/1997134437 learned_addr learned my addr 172.21.15.63:0/1997134437 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:27.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7bdab3700 1 --2- 172.21.15.63:0/1997134437 >> v2:172.21.15.155:3300/0 conn(0x7fe7b80b99d0 0x7fe7b8152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:27.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7a77fe700 1 -- 172.21.15.63:0/1997134437 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030490110 0 0) 0x7fe7b8153180 con 0x7fe7b8149d40 2020-05-18T21:34:27.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7a77fe700 1 -- 172.21.15.63:0/1997134437 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe798002fe0 con 0x7fe7b8149d40 2020-05-18T21:34:27.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7be2b4700 1 -- 172.21.15.63:0/1997134437 >> v2:172.21.15.155:3300/0 conn(0x7fe7b80b99d0 msgr2=0x7fe7b8152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:27.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7be2b4700 1 --2- 172.21.15.63:0/1997134437 >> v2:172.21.15.155:3300/0 conn(0x7fe7b80b99d0 0x7fe7b8152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:27.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7be2b4700 1 -- 172.21.15.63:0/1997134437 >> v1:172.21.15.63:6789/0 conn(0x7fe7b8149d40 legacy=0x7fe7b81413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:27.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7be2b4700 1 -- 172.21.15.63:0/1997134437 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b8141ad0 con 0x7fe7b80b68d0 2020-05-18T21:34:27.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7bdab3700 1 --2- 172.21.15.63:0/1997134437 >> v2:172.21.15.155:3300/0 conn(0x7fe7b80b99d0 0x7fe7b8152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:27.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7be2b4700 1 --2- 172.21.15.63:0/1997134437 >> v2:172.21.15.63:3300/0 conn(0x7fe7b80b68d0 0x7fe7b80adb30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe7b8061790 tx=0x7fe7b40108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7be2b4700 1 --2- 172.21.15.63:0/1997134437 >> v2:172.21.15.63:3300/0 conn(0x7fe7b80b68d0 0x7fe7b80adb30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe7b8061790 tx=0x7fe7b40108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7be2b4700 1 --2- 172.21.15.63:0/1997134437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7b80b68d0 0x7fe7b80adb30 secure :-1 s=READY pgs=1648 cs=0 l=1 rx=0x7fe7b8061790 tx=0x7fe7b40108b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:27.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7be2b4700 1 --2- 172.21.15.63:0/1997134437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7b80b68d0 0x7fe7b80adb30 secure :-1 s=THROTTLE_DONE pgs=1648 cs=0 l=1 rx=0x7fe7b8061790 tx=0x7fe7b40108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.602+0000 7fe7a77fe700 1 -- 172.21.15.63:0/1997134437 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7b4011ea0 con 0x7fe7b80b68d0 2020-05-18T21:34:27.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.606+0000 7fe7be2b4700 1 --2- 172.21.15.63:0/1997134437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7b80b68d0 0x7fe7b80adb30 secure :-1 s=THROTTLE_DONE pgs=1648 cs=0 l=1 rx=0x7fe7b8061790 tx=0x7fe7b40108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.606+0000 7fe7be2b4700 1 --2- 172.21.15.63:0/1997134437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7b80b68d0 0x7fe7b80adb30 secure :-1 s=THROTTLE_DONE pgs=1648 cs=0 l=1 rx=0x7fe7b8061790 tx=0x7fe7b40108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.606+0000 7fe7a77fe700 1 -- 172.21.15.63:0/1997134437 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b4011510 con 0x7fe7b80b68d0 2020-05-18T21:34:27.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.606+0000 7fe7bf2b6700 1 -- 172.21.15.63:0/1997134437 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b8157050 con 0x7fe7b80b68d0 2020-05-18T21:34:27.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.606+0000 7fe7a77fe700 1 -- 172.21.15.63:0/1997134437 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7b4011930 con 0x7fe7b80b68d0 2020-05-18T21:34:27.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.606+0000 7fe7bf2b6700 1 -- 172.21.15.63:0/1997134437 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b81574d0 con 0x7fe7b80b68d0 2020-05-18T21:34:27.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.606+0000 7fe7be2b4700 1 --2- 172.21.15.63:0/1997134437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7b80b68d0 0x7fe7b80adb30 secure :-1 s=THROTTLE_DONE pgs=1648 cs=0 l=1 rx=0x7fe7b8061790 tx=0x7fe7b40108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.606+0000 7fe7bf2b6700 1 -- 172.21.15.63:0/1997134437 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b80569e0 con 0x7fe7b80b68d0 2020-05-18T21:34:27.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.606+0000 7fe7a77fe700 1 -- 172.21.15.63:0/1997134437 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe7b400b370 con 0x7fe7b80b68d0 2020-05-18T21:34:27.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.606+0000 7fe7be2b4700 1 --2- 172.21.15.63:0/1997134437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7b80b68d0 0x7fe7b80adb30 secure :-1 s=THROTTLE_DONE pgs=1648 cs=0 l=1 rx=0x7fe7b8061790 tx=0x7fe7b40108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.606+0000 7fe7a77fe700 1 --2- 172.21.15.63:0/1997134437 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe79804fd40 0x7fe798052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:27.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.606+0000 7fe7a77fe700 1 -- 172.21.15.63:0/1997134437 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fe7b4063c00 con 0x7fe7b80b68d0 2020-05-18T21:34:27.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.606+0000 7fe7bdab3700 1 --2- 172.21.15.63:0/1997134437 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe79804fd40 0x7fe798052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:27.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.606+0000 7fe7bdab3700 1 --2- 172.21.15.63:0/1997134437 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe79804fd40 0x7fe798052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe7a8002f70 tx=0x7fe7a8007c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.610+0000 7fe7bdab3700 1 --2- 172.21.15.63:0/1997134437 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe79804fd40 0x7fe798052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe7a8002f70 tx=0x7fe7a8007c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.610+0000 7fe7bdab3700 1 --2- 172.21.15.63:0/1997134437 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe79804fd40 0x7fe798052200 secure :-1 s=READY pgs=637 cs=0 l=1 rx=0x7fe7a8002f70 tx=0x7fe7a8007c90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:27.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.614+0000 7fe7be2b4700 1 --2- 172.21.15.63:0/1997134437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7b80b68d0 0x7fe7b80adb30 secure :-1 s=THROTTLE_DONE pgs=1648 cs=0 l=1 rx=0x7fe7b8061790 tx=0x7fe7b40108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.614+0000 7fe7a77fe700 1 -- 172.21.15.63:0/1997134437 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe7b403df90 con 0x7fe7b80b68d0 2020-05-18T21:34:27.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.762+0000 7fe7bf2b6700 1 -- 172.21.15.63:0/1997134437 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fe7b8153830 con 0x7fe7b80b68d0 2020-05-18T21:34:27.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.774+0000 7fe7be2b4700 1 --2- 172.21.15.63:0/1997134437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7b80b68d0 0x7fe7b80adb30 secure :-1 s=THROTTLE_DONE pgs=1648 cs=0 l=1 rx=0x7fe7b8061790 tx=0x7fe7b40108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.774+0000 7fe7a77fe700 1 -- 172.21.15.63:0/1997134437 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 23 and data pool 24 v90) v1 ==== 189+0+0 (secure 0 0 0) 0x7fe7b40415b0 con 0x7fe7b80b68d0 2020-05-18T21:34:27.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.782+0000 7fe7bf2b6700 1 -- 172.21.15.63:0/1997134437 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe79804fd40 msgr2=0x7fe798052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:27.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.782+0000 7fe7bf2b6700 1 --2- 172.21.15.63:0/1997134437 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe79804fd40 0x7fe798052200 secure :-1 s=READY pgs=637 cs=0 l=1 rx=0x7fe7a8002f70 tx=0x7fe7a8007c90).stop 2020-05-18T21:34:27.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.782+0000 7fe7bf2b6700 1 -- 172.21.15.63:0/1997134437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7b80b68d0 msgr2=0x7fe7b80adb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:27.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.782+0000 7fe7bf2b6700 1 --2- 172.21.15.63:0/1997134437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7b80b68d0 0x7fe7b80adb30 secure :-1 s=READY pgs=1648 cs=0 l=1 rx=0x7fe7b8061790 tx=0x7fe7b40108b0).stop 2020-05-18T21:34:27.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.782+0000 7fe7bf2b6700 1 -- 172.21.15.63:0/1997134437 shutdown_connections 2020-05-18T21:34:27.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.782+0000 7fe7bf2b6700 1 --2- 172.21.15.63:0/1997134437 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe79804fd40 0x7fe798052200 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:27.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.782+0000 7fe7bf2b6700 1 --2- 172.21.15.63:0/1997134437 >> v2:172.21.15.155:3300/0 conn(0x7fe7b80b99d0 0x7fe7b8152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:27.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.782+0000 7fe7bf2b6700 1 --2- 172.21.15.63:0/1997134437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7b80b68d0 0x7fe7b80adb30 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:27.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.782+0000 7fe7bf2b6700 1 -- 172.21.15.63:0/1997134437 >> 172.21.15.63:0/1997134437 conn(0x7fe7b8069b70 msgr2=0x7fe7b80bb860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:27.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.782+0000 7fe7bf2b6700 1 -- 172.21.15.63:0/1997134437 shutdown_connections 2020-05-18T21:34:27.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.782+0000 7fe7bf2b6700 1 -- 172.21.15.63:0/1997134437 wait complete. 2020-05-18T21:34:27.790 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 23 and data pool 24 2020-05-18T21:34:27.802 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:34:27.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa0351fd700 1 Processor -- start 2020-05-18T21:34:27.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa0351fd700 1 -- start start 2020-05-18T21:34:27.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa0351fd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa03005f110 0x7fa0300b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:27.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa0351fd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa03014aa70 0x7fa0300648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:27.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa0351fd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa030064d20 0x7fa03014d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:27.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa0351fd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03014a140 con 0x7fa03014aa70 2020-05-18T21:34:27.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa0351fd700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03014a330 con 0x7fa03005f110 2020-05-18T21:34:27.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa0351fd700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03014a5d0 con 0x7fa030064d20 2020-05-18T21:34:27.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa02f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa03014aa70 0x7fa0300648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:27.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa02f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa03014aa70 0x7fa0300648c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33600/0 (socket says 172.21.15.63:33600) 2020-05-18T21:34:27.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa02f7fe700 1 -- 172.21.15.63:0/3211106786 learned_addr learned my addr 172.21.15.63:0/3211106786 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:27.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa0349fc700 1 --2- 172.21.15.63:0/3211106786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa030064d20 0x7fa03014d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:27.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa02ffff700 1 --2- 172.21.15.63:0/3211106786 >> v2:172.21.15.155:3300/0 conn(0x7fa03005f110 0x7fa0300b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:27.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa02f7fe700 1 -- 172.21.15.63:0/3211106786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa030064d20 msgr2=0x7fa03014d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:27.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/3211106786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa030064d20 0x7fa03014d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:27.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa02f7fe700 1 -- 172.21.15.63:0/3211106786 >> v2:172.21.15.155:3300/0 conn(0x7fa03005f110 msgr2=0x7fa0300b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:27.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/3211106786 >> v2:172.21.15.155:3300/0 conn(0x7fa03005f110 0x7fa0300b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:27.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa02f7fe700 1 -- 172.21.15.63:0/3211106786 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa030063430 con 0x7fa03014aa70 2020-05-18T21:34:27.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa0349fc700 1 --2- 172.21.15.63:0/3211106786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa030064d20 0x7fa03014d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:34:27.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/3211106786 >> v2:172.21.15.63:3300/0 conn(0x7fa03014aa70 0x7fa0300648c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa018002f70 tx=0x7fa018007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/3211106786 >> v2:172.21.15.63:3300/0 conn(0x7fa03014aa70 0x7fa0300648c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa018002f70 tx=0x7fa018007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.890+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/3211106786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa03014aa70 0x7fa0300648c0 secure :-1 s=READY pgs=1649 cs=0 l=1 rx=0x7fa018002f70 tx=0x7fa018007a80).ready entity=mon.0 client_cookie=b0a5eeb97922b082 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:27.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/3211106786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa03014aa70 0x7fa0300648c0 secure :-1 s=THROTTLE_DONE pgs=1649 cs=0 l=1 rx=0x7fa018002f70 tx=0x7fa018007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/3211106786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa03014aa70 0x7fa0300648c0 secure :-1 s=THROTTLE_DONE pgs=1649 cs=0 l=1 rx=0x7fa018002f70 tx=0x7fa018007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa02effd700 1 -- 172.21.15.63:0/3211106786 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa018011760 con 0x7fa03014aa70 2020-05-18T21:34:27.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/3211106786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa03014aa70 0x7fa0300648c0 secure :-1 s=THROTTLE_DONE pgs=1649 cs=0 l=1 rx=0x7fa018002f70 tx=0x7fa018007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa02effd700 1 -- 172.21.15.63:0/3211106786 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0180118c0 con 0x7fa03014aa70 2020-05-18T21:34:27.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa02effd700 1 -- 172.21.15.63:0/3211106786 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa018011ce0 con 0x7fa03014aa70 2020-05-18T21:34:27.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa0351fd700 1 -- 172.21.15.63:0/3211106786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa03014aa70 msgr2=0x7fa0300648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:27.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa0351fd700 1 --2- 172.21.15.63:0/3211106786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa03014aa70 0x7fa0300648c0 secure :-1 s=READY pgs=1649 cs=0 l=1 rx=0x7fa018002f70 tx=0x7fa018007a80).stop 2020-05-18T21:34:27.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa0351fd700 1 -- 172.21.15.63:0/3211106786 shutdown_connections 2020-05-18T21:34:27.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa0351fd700 1 --2- 172.21.15.63:0/3211106786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa030064d20 0x7fa03014d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:27.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa0351fd700 1 --2- 172.21.15.63:0/3211106786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa03014aa70 0x7fa0300648c0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:27.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa0351fd700 1 --2- 172.21.15.63:0/3211106786 >> v2:172.21.15.155:3300/0 conn(0x7fa03005f110 0x7fa0300b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:27.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa0351fd700 1 -- 172.21.15.63:0/3211106786 >> 172.21.15.63:0/3211106786 conn(0x7fa030069fc0 msgr2=0x7fa03006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:27.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa0351fd700 1 -- 172.21.15.63:0/3211106786 shutdown_connections 2020-05-18T21:34:27.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa0351fd700 1 -- 172.21.15.63:0/3211106786 wait complete. 2020-05-18T21:34:27.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa0351fd700 1 Processor -- start 2020-05-18T21:34:27.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa0351fd700 1 -- start start 2020-05-18T21:34:27.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa0351fd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa030064d20 0x7fa030149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:27.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa0351fd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0300ac4d0 con 0x7fa03014aa70 2020-05-18T21:34:27.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa0351fd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa030149700 con 0x7fa03005f110 2020-05-18T21:34:27.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa0351fd700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0301499a0 con 0x7fa030064d20 2020-05-18T21:34:27.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa0349fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa03014aa70 0x7fa0301454a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35794/0 (socket says 172.21.15.63:35794) 2020-05-18T21:34:27.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa0349fc700 1 -- 172.21.15.63:0/2896848845 learned_addr learned my addr 172.21.15.63:0/2896848845 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:27.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/2896848845 >> v2:172.21.15.155:3300/0 conn(0x7fa030064d20 0x7fa030149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:27.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.894+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751540995 0 0) 0x7fa0300ac4d0 con 0x7fa03014aa70 2020-05-18T21:34:27.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa014002fe0 con 0x7fa03014aa70 2020-05-18T21:34:27.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368175922 0 0) 0x7fa030149700 con 0x7fa03005f110 2020-05-18T21:34:27.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0300ac4d0 con 0x7fa03005f110 2020-05-18T21:34:27.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 838242658 0 0) 0x7fa014002fe0 con 0x7fa03014aa70 2020-05-18T21:34:27.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa030149700 con 0x7fa03014aa70 2020-05-18T21:34:27.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fa020002540 con 0x7fa03014aa70 2020-05-18T21:34:27.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 >> v2:172.21.15.155:3300/0 conn(0x7fa030064d20 msgr2=0x7fa030149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:27.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 --2- 172.21.15.63:0/2896848845 >> v2:172.21.15.155:3300/0 conn(0x7fa030064d20 0x7fa030149be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:27.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 >> v1:172.21.15.155:6789/0 conn(0x7fa03005f110 legacy=0x7fa030140610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:27.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 >> v1:172.21.15.63:6789/0 conn(0x7fa03014aa70 legacy=0x7fa0301454a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:27.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa014004bf0 0x7fa014004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:27.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa014003b30 0x7fa014003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:27.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa014004410 0x7fa01400b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:27.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0301499a0 con 0x7fa014003b30 2020-05-18T21:34:27.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01400bc20 con 0x7fa014004410 2020-05-18T21:34:27.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01400bde0 con 0x7fa014004bf0 2020-05-18T21:34:27.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa014003b30 0x7fa014003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:27.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02ffff700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa014004bf0 0x7fa014004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:27.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa0349fc700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa014004410 0x7fa01400b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:27.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02f7fe700 1 -- 172.21.15.63:0/2896848845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa014004bf0 msgr2=0x7fa014004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:27.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa014004bf0 0x7fa014004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:27.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02f7fe700 1 -- 172.21.15.63:0/2896848845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa014004410 msgr2=0x7fa01400b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:27.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa014004410 0x7fa01400b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:27.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02f7fe700 1 -- 172.21.15.63:0/2896848845 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa030145000 con 0x7fa014003b30 2020-05-18T21:34:27.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa0351fd700 1 -- 172.21.15.63:0/2896848845 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa030140d20 con 0x7fa014003b30 2020-05-18T21:34:27.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02ffff700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa014004bf0 0x7fa014004ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:27.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa0349fc700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa014004410 0x7fa01400b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:27.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa0349fc700 1 -- 172.21.15.63:0/2896848845 reap_dead start 2020-05-18T21:34:27.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa0351fd700 1 -- 172.21.15.63:0/2896848845 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa030149470 con 0x7fa014003b30 2020-05-18T21:34:27.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa014003b30 0x7fa014003fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa018002f70 tx=0x7fa018007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa014003b30 0x7fa014003fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa018002f70 tx=0x7fa018007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa014003b30 0x7fa014003fb0 secure :-1 s=READY pgs=1651 cs=0 l=1 rx=0x7fa018002f70 tx=0x7fa018007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:27.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa014003b30 0x7fa014003fb0 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7fa018002f70 tx=0x7fa018007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa018007170 con 0x7fa014003b30 2020-05-18T21:34:27.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa014003b30 0x7fa014003fb0 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7fa018002f70 tx=0x7fa018007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa014003b30 0x7fa014003fb0 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7fa018002f70 tx=0x7fa018007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa018007310 con 0x7fa014003b30 2020-05-18T21:34:27.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa018005700 con 0x7fa014003b30 2020-05-18T21:34:27.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa014003b30 0x7fa014003fb0 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7fa018002f70 tx=0x7fa018007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa0351fd700 1 -- 172.21.15.63:0/2896848845 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa008003380 con 0x7fa014003b30 2020-05-18T21:34:27.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa018005860 con 0x7fa014003b30 2020-05-18T21:34:27.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.898+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa014003b30 0x7fa014003fb0 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7fa018002f70 tx=0x7fa018007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.902+0000 7fa02d7fa700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa014053b80 0x7fa014056040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:27.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.902+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa0180641d0 con 0x7fa014003b30 2020-05-18T21:34:27.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.902+0000 7fa02ffff700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa014053b80 0x7fa014056040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:27.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.902+0000 7fa02ffff700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa014053b80 0x7fa014056040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa0280032b0 tx=0x7fa028008750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.902+0000 7fa02ffff700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa014053b80 0x7fa014056040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa0280032b0 tx=0x7fa028008750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.902+0000 7fa02ffff700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa014053b80 0x7fa014056040 secure :-1 s=READY pgs=639 cs=0 l=1 rx=0x7fa0280032b0 tx=0x7fa028008750).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:27.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.906+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa014003b30 0x7fa014003fb0 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7fa018002f70 tx=0x7fa018007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:27.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:27.906+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa01803e6a0 con 0x7fa014003b30 2020-05-18T21:34:28.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.022+0000 7fa0351fd700 1 -- 172.21.15.63:0/2896848845 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa008002210 con 0x7fa014003b30 2020-05-18T21:34:28.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.022+0000 7fa02f7fe700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa014003b30 0x7fa014003fb0 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7fa018002f70 tx=0x7fa018007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.022+0000 7fa02d7fa700 1 -- 172.21.15.63:0/2896848845 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+16116 (secure 0 0 0) 0x7fa018041cc0 con 0x7fa014003b30 2020-05-18T21:34:28.028 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:28.028 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":122,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:34:27.766820+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:34:26.108423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2020-05-18T21:34:26.753473+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:34:28.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.022+0000 7fa0351fd700 1 -- 172.21.15.63:0/2896848845 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa014053b80 msgr2=0x7fa014056040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:28.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.022+0000 7fa0351fd700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa014053b80 0x7fa014056040 secure :-1 s=READY pgs=639 cs=0 l=1 rx=0x7fa0280032b0 tx=0x7fa028008750).stop 2020-05-18T21:34:28.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.022+0000 7fa0351fd700 1 -- 172.21.15.63:0/2896848845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa014003b30 msgr2=0x7fa014003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:28.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.022+0000 7fa0351fd700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa014003b30 0x7fa014003fb0 secure :-1 s=READY pgs=1651 cs=0 l=1 rx=0x7fa018002f70 tx=0x7fa018007a80).stop 2020-05-18T21:34:28.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.026+0000 7fa0351fd700 1 -- 172.21.15.63:0/2896848845 shutdown_connections 2020-05-18T21:34:28.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.026+0000 7fa0351fd700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa014053b80 0x7fa014056040 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:28.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.026+0000 7fa0351fd700 1 --2- 172.21.15.63:0/2896848845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa014003b30 0x7fa014003fb0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:28.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.026+0000 7fa0351fd700 1 -- 172.21.15.63:0/2896848845 >> 172.21.15.63:0/2896848845 conn(0x7fa030069fc0 msgr2=0x7fa030060420 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:28.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.026+0000 7fa0351fd700 1 -- 172.21.15.63:0/2896848845 shutdown_connections 2020-05-18T21:34:28.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.026+0000 7fa0351fd700 1 -- 172.21.15.63:0/2896848845 wait complete. 2020-05-18T21:34:28.041 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:34:28.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa1983700 1 Processor -- start 2020-05-18T21:34:28.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa1983700 1 -- start start 2020-05-18T21:34:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa1983700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf9c0b93f0 0x7faf9c145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa1983700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf9c0b7ca0 0x7faf9c142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa1983700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faf9c1432f0 0x7faf9c060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa1983700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9c0b7020 con 0x7faf9c0b93f0 2020-05-18T21:34:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa1983700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9c0b72c0 con 0x7faf9c1432f0 2020-05-18T21:34:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa1983700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c0b7560 con 0x7faf9c0b7ca0 2020-05-18T21:34:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa0981700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf9c0b93f0 0x7faf9c145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa0981700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf9c0b93f0 0x7faf9c145df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33616/0 (socket says 172.21.15.63:33616) 2020-05-18T21:34:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa0981700 1 -- 172.21.15.63:0/3732650372 learned_addr learned my addr 172.21.15.63:0/3732650372 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:28.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7faf93fff700 1 --2- 172.21.15.63:0/3732650372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf9c0b7ca0 0x7faf9c142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:28.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa1182700 1 --2- 172.21.15.63:0/3732650372 >> v2:172.21.15.155:3300/0 conn(0x7faf9c1432f0 0x7faf9c060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:28.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa0981700 1 -- 172.21.15.63:0/3732650372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf9c0b7ca0 msgr2=0x7faf9c142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:28.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa0981700 1 --2- 172.21.15.63:0/3732650372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf9c0b7ca0 0x7faf9c142e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:28.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa0981700 1 -- 172.21.15.63:0/3732650372 >> v2:172.21.15.155:3300/0 conn(0x7faf9c1432f0 msgr2=0x7faf9c060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:28.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa0981700 1 --2- 172.21.15.63:0/3732650372 >> v2:172.21.15.155:3300/0 conn(0x7faf9c1432f0 0x7faf9c060430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:28.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa0981700 1 -- 172.21.15.63:0/3732650372 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c0b7800 con 0x7faf9c0b93f0 2020-05-18T21:34:28.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa0981700 1 --2- 172.21.15.63:0/3732650372 >> v2:172.21.15.63:3300/0 conn(0x7faf9c0b93f0 0x7faf9c145df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faf9c0619f0 tx=0x7faf98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa0981700 1 --2- 172.21.15.63:0/3732650372 >> v2:172.21.15.63:3300/0 conn(0x7faf9c0b93f0 0x7faf9c145df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faf9c0619f0 tx=0x7faf98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa0981700 1 --2- 172.21.15.63:0/3732650372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf9c0b93f0 0x7faf9c145df0 secure :-1 s=READY pgs=1652 cs=0 l=1 rx=0x7faf9c0619f0 tx=0x7faf98007a80).ready entity=mon.0 client_cookie=b0431c31cad67e72 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:28.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa0981700 1 --2- 172.21.15.63:0/3732650372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf9c0b93f0 0x7faf9c145df0 secure :-1 s=THROTTLE_DONE pgs=1652 cs=0 l=1 rx=0x7faf9c0619f0 tx=0x7faf98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa0981700 1 --2- 172.21.15.63:0/3732650372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf9c0b93f0 0x7faf9c145df0 secure :-1 s=THROTTLE_DONE pgs=1652 cs=0 l=1 rx=0x7faf9c0619f0 tx=0x7faf98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7faf937fe700 1 -- 172.21.15.63:0/3732650372 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf98011720 con 0x7faf9c0b93f0 2020-05-18T21:34:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa0981700 1 --2- 172.21.15.63:0/3732650372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf9c0b93f0 0x7faf9c145df0 secure :-1 s=THROTTLE_DONE pgs=1652 cs=0 l=1 rx=0x7faf9c0619f0 tx=0x7faf98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7faf937fe700 1 -- 172.21.15.63:0/3732650372 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf98011880 con 0x7faf9c0b93f0 2020-05-18T21:34:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7faf937fe700 1 -- 172.21.15.63:0/3732650372 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf98011ca0 con 0x7faf9c0b93f0 2020-05-18T21:34:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa1983700 1 -- 172.21.15.63:0/3732650372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf9c0b93f0 msgr2=0x7faf9c145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:28.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.142+0000 7fafa1983700 1 --2- 172.21.15.63:0/3732650372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf9c0b93f0 0x7faf9c145df0 secure :-1 s=READY pgs=1652 cs=0 l=1 rx=0x7faf9c0619f0 tx=0x7faf98007a80).stop 2020-05-18T21:34:28.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.146+0000 7fafa1983700 1 -- 172.21.15.63:0/3732650372 shutdown_connections 2020-05-18T21:34:28.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.146+0000 7fafa1983700 1 --2- 172.21.15.63:0/3732650372 >> v2:172.21.15.155:3300/0 conn(0x7faf9c1432f0 0x7faf9c060430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:28.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.146+0000 7fafa1983700 1 --2- 172.21.15.63:0/3732650372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf9c0b7ca0 0x7faf9c142e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:28.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.146+0000 7fafa1983700 1 --2- 172.21.15.63:0/3732650372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf9c0b93f0 0x7faf9c145df0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:28.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.146+0000 7fafa1983700 1 -- 172.21.15.63:0/3732650372 >> 172.21.15.63:0/3732650372 conn(0x7faf9c069b70 msgr2=0x7faf9c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:28.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.146+0000 7fafa1983700 1 -- 172.21.15.63:0/3732650372 shutdown_connections 2020-05-18T21:34:28.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.146+0000 7fafa1983700 1 -- 172.21.15.63:0/3732650372 wait complete. 2020-05-18T21:34:28.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.146+0000 7fafa1983700 1 Processor -- start 2020-05-18T21:34:28.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.146+0000 7fafa1983700 1 -- start start 2020-05-18T21:34:28.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7fafa1983700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faf9c1432f0 0x7faf9c115660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:28.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7fafa1983700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf9c115ac0 con 0x7faf9c0b93f0 2020-05-18T21:34:28.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7fafa1983700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf9c115d00 con 0x7faf9c0b7ca0 2020-05-18T21:34:28.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7fafa1983700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9c0ac570 con 0x7faf9c1432f0 2020-05-18T21:34:28.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7faf93fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7faf9c0b93f0 0x7faf9c0b0350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35812/0 (socket says 172.21.15.63:35812) 2020-05-18T21:34:28.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7faf93fff700 1 -- 172.21.15.63:0/3671455440 learned_addr learned my addr 172.21.15.63:0/3671455440 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:28.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7fafa1182700 1 --2- 172.21.15.63:0/3671455440 >> v2:172.21.15.155:3300/0 conn(0x7faf9c1432f0 0x7faf9c115660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:28.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7faf91ffb700 1 -- 172.21.15.63:0/3671455440 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047630080 0 0) 0x7faf8c001f80 con 0x7faf9c0b93f0 2020-05-18T21:34:28.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7faf91ffb700 1 -- 172.21.15.63:0/3671455440 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf7c002fe0 con 0x7faf9c0b93f0 2020-05-18T21:34:28.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7faf91ffb700 1 -- 172.21.15.63:0/3671455440 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 214262634 0 0) 0x7faf7c002fe0 con 0x7faf9c0b93f0 2020-05-18T21:34:28.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7fafa1182700 1 -- 172.21.15.63:0/3671455440 >> v1:172.21.15.155:6789/0 conn(0x7faf9c0b7ca0 legacy=0x7faf9c154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7fafa1182700 1 -- 172.21.15.63:0/3671455440 >> v1:172.21.15.63:6789/0 conn(0x7faf9c0b93f0 legacy=0x7faf9c0b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7fafa1182700 1 -- 172.21.15.63:0/3671455440 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c0ac810 con 0x7faf9c1432f0 2020-05-18T21:34:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7fafa1182700 1 --2- 172.21.15.63:0/3671455440 >> v2:172.21.15.155:3300/0 conn(0x7faf9c1432f0 0x7faf9c115660 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf8c002930 tx=0x7faf94010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7fafa1182700 1 --2- 172.21.15.63:0/3671455440 >> v2:172.21.15.155:3300/0 conn(0x7faf9c1432f0 0x7faf9c115660 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf8c002930 tx=0x7faf94010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7fafa1182700 1 --2- 172.21.15.63:0/3671455440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf9c1432f0 0x7faf9c115660 secure :-1 s=READY pgs=1091 cs=0 l=1 rx=0x7faf8c002930 tx=0x7faf94010d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7fafa1182700 1 --2- 172.21.15.63:0/3671455440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf9c1432f0 0x7faf9c115660 secure :-1 s=THROTTLE_DONE pgs=1091 cs=0 l=1 rx=0x7faf8c002930 tx=0x7faf94010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7faf91ffb700 1 -- 172.21.15.63:0/3671455440 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf8c002790 con 0x7faf9c1432f0 2020-05-18T21:34:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7fafa1182700 1 --2- 172.21.15.63:0/3671455440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf9c1432f0 0x7faf9c115660 secure :-1 s=THROTTLE_DONE pgs=1091 cs=0 l=1 rx=0x7faf8c002930 tx=0x7faf94010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7faf91ffb700 1 -- 172.21.15.63:0/3671455440 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf94012960 con 0x7faf9c1432f0 2020-05-18T21:34:28.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7fafa1182700 1 --2- 172.21.15.63:0/3671455440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf9c1432f0 0x7faf9c115660 secure :-1 s=THROTTLE_DONE pgs=1091 cs=0 l=1 rx=0x7faf8c002930 tx=0x7faf94010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7fafa1983700 1 -- 172.21.15.63:0/3671455440 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9c0b0a60 con 0x7faf9c1432f0 2020-05-18T21:34:28.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7faf91ffb700 1 -- 172.21.15.63:0/3671455440 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf94012cc0 con 0x7faf9c1432f0 2020-05-18T21:34:28.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7fafa1983700 1 -- 172.21.15.63:0/3671455440 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9c0b2e30 con 0x7faf9c1432f0 2020-05-18T21:34:28.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7fafa1983700 1 -- 172.21.15.63:0/3671455440 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9c0b32e0 con 0x7faf9c1432f0 2020-05-18T21:34:28.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.150+0000 7fafa1182700 1 --2- 172.21.15.63:0/3671455440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf9c1432f0 0x7faf9c115660 secure :-1 s=THROTTLE_DONE pgs=1091 cs=0 l=1 rx=0x7faf8c002930 tx=0x7faf94010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.154+0000 7faf91ffb700 1 -- 172.21.15.63:0/3671455440 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7faf940101c0 con 0x7faf9c1432f0 2020-05-18T21:34:28.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.154+0000 7fafa1182700 1 --2- 172.21.15.63:0/3671455440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf9c1432f0 0x7faf9c115660 secure :-1 s=THROTTLE_DONE pgs=1091 cs=0 l=1 rx=0x7faf8c002930 tx=0x7faf94010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.154+0000 7faf91ffb700 1 --2- 172.21.15.63:0/3671455440 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf7c04fcd0 0x7faf7c052190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:28.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.154+0000 7faf91ffb700 1 -- 172.21.15.63:0/3671455440 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faf94063ce0 con 0x7faf9c1432f0 2020-05-18T21:34:28.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.154+0000 7fafa0981700 1 --2- 172.21.15.63:0/3671455440 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf7c04fcd0 0x7faf7c052190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:28.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.154+0000 7fafa0981700 1 --2- 172.21.15.63:0/3671455440 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf7c04fcd0 0x7faf7c052190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf98002f70 tx=0x7faf98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.154+0000 7fafa0981700 1 --2- 172.21.15.63:0/3671455440 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf7c04fcd0 0x7faf7c052190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf98002f70 tx=0x7faf98007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.154+0000 7fafa0981700 1 --2- 172.21.15.63:0/3671455440 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf7c04fcd0 0x7faf7c052190 secure :-1 s=READY pgs=640 cs=0 l=1 rx=0x7faf98002f70 tx=0x7faf98007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:28.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.162+0000 7fafa1182700 1 --2- 172.21.15.63:0/3671455440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf9c1432f0 0x7faf9c115660 secure :-1 s=THROTTLE_DONE pgs=1091 cs=0 l=1 rx=0x7faf8c002930 tx=0x7faf94010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.162+0000 7faf91ffb700 1 -- 172.21.15.63:0/3671455440 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7faf9403e010 con 0x7faf9c1432f0 2020-05-18T21:34:28.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.278+0000 7fafa1983700 1 -- 172.21.15.63:0/3671455440 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf9c0569e0 con 0x7faf9c1432f0 2020-05-18T21:34:28.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.282+0000 7fafa1182700 1 --2- 172.21.15.63:0/3671455440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf9c1432f0 0x7faf9c115660 secure :-1 s=THROTTLE_DONE pgs=1091 cs=0 l=1 rx=0x7faf8c002930 tx=0x7faf94010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.282+0000 7faf91ffb700 1 -- 172.21.15.63:0/3671455440 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+16116 (secure 0 0 0) 0x7faf94041630 con 0x7faf9c1432f0 2020-05-18T21:34:28.288 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:28.288 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":122,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:34:27.766820+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:34:26.108423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2020-05-18T21:34:26.753473+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:34:28.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.286+0000 7fafa1983700 1 -- 172.21.15.63:0/3671455440 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf7c04fcd0 msgr2=0x7faf7c052190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:28.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.286+0000 7fafa1983700 1 --2- 172.21.15.63:0/3671455440 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf7c04fcd0 0x7faf7c052190 secure :-1 s=READY pgs=640 cs=0 l=1 rx=0x7faf98002f70 tx=0x7faf98007a80).stop 2020-05-18T21:34:28.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.286+0000 7fafa1983700 1 -- 172.21.15.63:0/3671455440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf9c1432f0 msgr2=0x7faf9c115660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:28.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.286+0000 7fafa1983700 1 --2- 172.21.15.63:0/3671455440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf9c1432f0 0x7faf9c115660 secure :-1 s=READY pgs=1091 cs=0 l=1 rx=0x7faf8c002930 tx=0x7faf94010d60).stop 2020-05-18T21:34:28.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.286+0000 7fafa1983700 1 -- 172.21.15.63:0/3671455440 shutdown_connections 2020-05-18T21:34:28.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.286+0000 7fafa1983700 1 --2- 172.21.15.63:0/3671455440 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf7c04fcd0 0x7faf7c052190 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:28.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.286+0000 7fafa1983700 1 --2- 172.21.15.63:0/3671455440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf9c1432f0 0x7faf9c115660 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:28.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.286+0000 7fafa1983700 1 -- 172.21.15.63:0/3671455440 >> 172.21.15.63:0/3671455440 conn(0x7faf9c069b70 msgr2=0x7faf9c141f70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:28.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.286+0000 7fafa1983700 1 -- 172.21.15.63:0/3671455440 shutdown_connections 2020-05-18T21:34:28.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.286+0000 7fafa1983700 1 -- 172.21.15.63:0/3671455440 wait complete. 2020-05-18T21:34:28.306 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-05-18T21:34:28.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.410+0000 7fc10b59e700 1 Processor -- start 2020-05-18T21:34:28.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.410+0000 7fc10b59e700 1 -- start start 2020-05-18T21:34:28.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.410+0000 7fc10b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc10c0b4f40 0x7fc10c061180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:28.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.410+0000 7fc10b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc10c06a2c0 0x7fc10c132360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:28.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.410+0000 7fc10b59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10c132c70 con 0x7fc10c1327c0 2020-05-18T21:34:28.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.410+0000 7fc10b59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10c06a7d0 con 0x7fc10c0b4f40 2020-05-18T21:34:28.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.410+0000 7fc10b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c0b2a10 con 0x7fc10c06a2c0 2020-05-18T21:34:28.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.410+0000 7fc10a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc10c0b4f40 0x7fc10c061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:28.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc10c0b4f40 0x7fc10c061180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33630/0 (socket says 172.21.15.63:33630) 2020-05-18T21:34:28.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10a59c700 1 -- 172.21.15.63:0/3807645172 learned_addr learned my addr 172.21.15.63:0/3807645172 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:28.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc109d9b700 1 --2- 172.21.15.63:0/3807645172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc10c06a2c0 0x7fc10c132360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:28.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10a59c700 1 -- 172.21.15.63:0/3807645172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc10c06a2c0 msgr2=0x7fc10c132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:28.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10a59c700 1 --2- 172.21.15.63:0/3807645172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc10c06a2c0 0x7fc10c132360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:28.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10a59c700 1 -- 172.21.15.63:0/3807645172 >> v1:172.21.15.155:6789/0 conn(0x7fc10c1327c0 legacy=0x7fc10c14d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:28.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10a59c700 1 -- 172.21.15.63:0/3807645172 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c0b5320 con 0x7fc10c0b4f40 2020-05-18T21:34:28.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10a59c700 1 --2- 172.21.15.63:0/3807645172 >> v2:172.21.15.63:3300/0 conn(0x7fc10c0b4f40 0x7fc10c061180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc10c0b4870 tx=0x7fc0fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10a59c700 1 --2- 172.21.15.63:0/3807645172 >> v2:172.21.15.63:3300/0 conn(0x7fc10c0b4f40 0x7fc10c061180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc10c0b4870 tx=0x7fc0fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10a59c700 1 --2- 172.21.15.63:0/3807645172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc10c0b4f40 0x7fc10c061180 secure :-1 s=READY pgs=1654 cs=0 l=1 rx=0x7fc10c0b4870 tx=0x7fc0fc007a80).ready entity=mon.0 client_cookie=cafaa913f0fd7c7a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:28.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10a59c700 1 --2- 172.21.15.63:0/3807645172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc10c0b4f40 0x7fc10c061180 secure :-1 s=THROTTLE_DONE pgs=1654 cs=0 l=1 rx=0x7fc10c0b4870 tx=0x7fc0fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10a59c700 1 --2- 172.21.15.63:0/3807645172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc10c0b4f40 0x7fc10c061180 secure :-1 s=THROTTLE_DONE pgs=1654 cs=0 l=1 rx=0x7fc10c0b4870 tx=0x7fc0fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10959a700 1 -- 172.21.15.63:0/3807645172 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0fc011720 con 0x7fc10c0b4f40 2020-05-18T21:34:28.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10a59c700 1 --2- 172.21.15.63:0/3807645172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc10c0b4f40 0x7fc10c061180 secure :-1 s=THROTTLE_DONE pgs=1654 cs=0 l=1 rx=0x7fc10c0b4870 tx=0x7fc0fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10959a700 1 -- 172.21.15.63:0/3807645172 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0fc011880 con 0x7fc10c0b4f40 2020-05-18T21:34:28.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10959a700 1 -- 172.21.15.63:0/3807645172 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0fc011c60 con 0x7fc10c0b4f40 2020-05-18T21:34:28.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10b59e700 1 -- 172.21.15.63:0/3807645172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc10c0b4f40 msgr2=0x7fc10c061180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:28.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10b59e700 1 --2- 172.21.15.63:0/3807645172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc10c0b4f40 0x7fc10c061180 secure :-1 s=READY pgs=1654 cs=0 l=1 rx=0x7fc10c0b4870 tx=0x7fc0fc007a80).stop 2020-05-18T21:34:28.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10b59e700 1 -- 172.21.15.63:0/3807645172 shutdown_connections 2020-05-18T21:34:28.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10b59e700 1 --2- 172.21.15.63:0/3807645172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc10c06a2c0 0x7fc10c132360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:28.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10b59e700 1 --2- 172.21.15.63:0/3807645172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc10c0b4f40 0x7fc10c061180 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:28.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10b59e700 1 -- 172.21.15.63:0/3807645172 >> 172.21.15.63:0/3807645172 conn(0x7fc10c05fbd0 msgr2=0x7fc10c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:28.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10b59e700 1 -- 172.21.15.63:0/3807645172 shutdown_connections 2020-05-18T21:34:28.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10b59e700 1 -- 172.21.15.63:0/3807645172 wait complete. 2020-05-18T21:34:28.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10b59e700 1 Processor -- start 2020-05-18T21:34:28.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.414+0000 7fc10b59e700 1 -- start start 2020-05-18T21:34:28.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc10c06a2c0 0x7fc10c11b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:28.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc10c1327c0 0x7fc10c0b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:28.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10b59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10c11bc00 con 0x7fc10c0b4f40 2020-05-18T21:34:28.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10b59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10c11bea0 con 0x7fc10c1327c0 2020-05-18T21:34:28.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c0b20f0 con 0x7fc10c06a2c0 2020-05-18T21:34:28.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc109d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc10c0b4f40 0x7fc10c157540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35826/0 (socket says 172.21.15.63:35826) 2020-05-18T21:34:28.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc109d9b700 1 -- 172.21.15.63:0/2879164283 learned_addr learned my addr 172.21.15.63:0/2879164283 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:28.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10ad9d700 1 --2- 172.21.15.63:0/2879164283 >> v2:172.21.15.63:3300/0 conn(0x7fc10c1327c0 0x7fc10c0b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:28.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10a59c700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc10c06a2c0 0x7fc10c11b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:28.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc0fb7fe700 1 -- 172.21.15.63:0/2879164283 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369501286 0 0) 0x7fc10c11bc00 con 0x7fc10c0b4f40 2020-05-18T21:34:28.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc0fb7fe700 1 -- 172.21.15.63:0/2879164283 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0e8002fe0 con 0x7fc10c0b4f40 2020-05-18T21:34:28.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10ad9d700 1 -- 172.21.15.63:0/2879164283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc10c06a2c0 msgr2=0x7fc10c11b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:28.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10ad9d700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc10c06a2c0 0x7fc10c11b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:28.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10ad9d700 1 -- 172.21.15.63:0/2879164283 >> v1:172.21.15.63:6789/0 conn(0x7fc10c0b4f40 legacy=0x7fc10c157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:28.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10ad9d700 1 -- 172.21.15.63:0/2879164283 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c0b2230 con 0x7fc10c1327c0 2020-05-18T21:34:28.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10ad9d700 1 --2- 172.21.15.63:0/2879164283 >> v2:172.21.15.63:3300/0 conn(0x7fc10c1327c0 0x7fc10c0b11c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc104002310 tx=0x7fc104010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10ad9d700 1 --2- 172.21.15.63:0/2879164283 >> v2:172.21.15.63:3300/0 conn(0x7fc10c1327c0 0x7fc10c0b11c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc104002310 tx=0x7fc104010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10ad9d700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc10c1327c0 0x7fc10c0b11c0 secure :-1 s=READY pgs=1656 cs=0 l=1 rx=0x7fc104002310 tx=0x7fc104010b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10ad9d700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc10c1327c0 0x7fc10c0b11c0 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7fc104002310 tx=0x7fc104010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc0fb7fe700 1 -- 172.21.15.63:0/2879164283 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1040121b0 con 0x7fc10c1327c0 2020-05-18T21:34:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10ad9d700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc10c1327c0 0x7fc10c0b11c0 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7fc104002310 tx=0x7fc104010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc0fb7fe700 1 -- 172.21.15.63:0/2879164283 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc104012310 con 0x7fc10c1327c0 2020-05-18T21:34:28.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10b59e700 1 -- 172.21.15.63:0/2879164283 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10c157c50 con 0x7fc10c1327c0 2020-05-18T21:34:28.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10ad9d700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc10c1327c0 0x7fc10c0b11c0 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7fc104002310 tx=0x7fc104010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc0fb7fe700 1 -- 172.21.15.63:0/2879164283 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc104012730 con 0x7fc10c1327c0 2020-05-18T21:34:28.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10b59e700 1 -- 172.21.15.63:0/2879164283 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10c1580d0 con 0x7fc10c1327c0 2020-05-18T21:34:28.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.418+0000 7fc10ad9d700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc10c1327c0 0x7fc10c0b11c0 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7fc104002310 tx=0x7fc104010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.422+0000 7fc10b59e700 1 -- 172.21.15.63:0/2879164283 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc10c0afef0 con 0x7fc10c1327c0 2020-05-18T21:34:28.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.422+0000 7fc0fb7fe700 1 -- 172.21.15.63:0/2879164283 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc1040129f0 con 0x7fc10c1327c0 2020-05-18T21:34:28.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.422+0000 7fc10ad9d700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc10c1327c0 0x7fc10c0b11c0 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7fc104002310 tx=0x7fc104010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.422+0000 7fc0fb7fe700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc0e804fd30 0x7fc0e80521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:28.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.422+0000 7fc0fb7fe700 1 -- 172.21.15.63:0/2879164283 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc1040640c0 con 0x7fc10c1327c0 2020-05-18T21:34:28.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.422+0000 7fc10a59c700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc0e804fd30 0x7fc0e80521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:28.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.422+0000 7fc10a59c700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc0e804fd30 0x7fc0e80521f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc10c0b4870 tx=0x7fc0fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.422+0000 7fc10a59c700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc0e804fd30 0x7fc0e80521f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc10c0b4870 tx=0x7fc0fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.422+0000 7fc10a59c700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc0e804fd30 0x7fc0e80521f0 secure :-1 s=READY pgs=641 cs=0 l=1 rx=0x7fc10c0b4870 tx=0x7fc0fc007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:28.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.426+0000 7fc10ad9d700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc10c1327c0 0x7fc10c0b11c0 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7fc104002310 tx=0x7fc104010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.426+0000 7fc0fb7fe700 1 -- 172.21.15.63:0/2879164283 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc10403e4b0 con 0x7fc10c1327c0 2020-05-18T21:34:28.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.578+0000 7fc10b59e700 1 -- 172.21.15.63:0/2879164283 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc10c0569e0 con 0x7fc10c1327c0 2020-05-18T21:34:28.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.770+0000 7fc10ad9d700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc10c1327c0 0x7fc10c0b11c0 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7fc104002310 tx=0x7fc104010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.770+0000 7fc0fb7fe700 1 -- 172.21.15.63:0/2879164283 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v91) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc104041ad0 con 0x7fc10c1327c0 2020-05-18T21:34:28.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.774+0000 7fc10b59e700 1 -- 172.21.15.63:0/2879164283 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc0e804fd30 msgr2=0x7fc0e80521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:28.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.774+0000 7fc10b59e700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc0e804fd30 0x7fc0e80521f0 secure :-1 s=READY pgs=641 cs=0 l=1 rx=0x7fc10c0b4870 tx=0x7fc0fc007a80).stop 2020-05-18T21:34:28.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.774+0000 7fc10b59e700 1 -- 172.21.15.63:0/2879164283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc10c1327c0 msgr2=0x7fc10c0b11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:28.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.774+0000 7fc10b59e700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc10c1327c0 0x7fc10c0b11c0 secure :-1 s=READY pgs=1656 cs=0 l=1 rx=0x7fc104002310 tx=0x7fc104010b90).stop 2020-05-18T21:34:28.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.774+0000 7fc10b59e700 1 -- 172.21.15.63:0/2879164283 shutdown_connections 2020-05-18T21:34:28.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.774+0000 7fc10b59e700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc0e804fd30 0x7fc0e80521f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:28.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.774+0000 7fc10b59e700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc10c1327c0 0x7fc10c0b11c0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:28.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.774+0000 7fc10b59e700 1 --2- 172.21.15.63:0/2879164283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc10c06a2c0 0x7fc10c11b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:28.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.774+0000 7fc10b59e700 1 -- 172.21.15.63:0/2879164283 >> 172.21.15.63:0/2879164283 conn(0x7fc10c05fbd0 msgr2=0x7fc10c0b8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:28.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.774+0000 7fc10b59e700 1 -- 172.21.15.63:0/2879164283 shutdown_connections 2020-05-18T21:34:28.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.774+0000 7fc10b59e700 1 -- 172.21.15.63:0/2879164283 wait complete. 2020-05-18T21:34:28.796 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:34:28.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.894+0000 7faf089c7700 1 Processor -- start 2020-05-18T21:34:28.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.894+0000 7faf089c7700 1 -- start start 2020-05-18T21:34:28.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf089c7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf04145b80 0x7faf04142bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:28.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf089c7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faf0413f870 0x7faf0413fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:28.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf089c7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf04145f60 con 0x7faf0409b490 2020-05-18T21:34:28.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf089c7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf040b5f00 con 0x7faf04145b80 2020-05-18T21:34:28.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf089c7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf04143490 con 0x7faf0413f870 2020-05-18T21:34:28.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf0259c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf04145b80 0x7faf04142bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:28.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf0259c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf04145b80 0x7faf04142bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33644/0 (socket says 172.21.15.63:33644) 2020-05-18T21:34:28.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf0259c700 1 -- 172.21.15.63:0/1990979301 learned_addr learned my addr 172.21.15.63:0/1990979301 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:28.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf02d9d700 1 --2- 172.21.15.63:0/1990979301 >> v2:172.21.15.155:3300/0 conn(0x7faf0413f870 0x7faf0413fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:28.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf0259c700 1 -- 172.21.15.63:0/1990979301 >> v2:172.21.15.155:3300/0 conn(0x7faf0413f870 msgr2=0x7faf0413fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:28.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf0259c700 1 --2- 172.21.15.63:0/1990979301 >> v2:172.21.15.155:3300/0 conn(0x7faf0413f870 0x7faf0413fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:28.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf0259c700 1 -- 172.21.15.63:0/1990979301 >> v1:172.21.15.155:6789/0 conn(0x7faf0409b490 legacy=0x7faf0409bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:28.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf0259c700 1 -- 172.21.15.63:0/1990979301 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf04143730 con 0x7faf04145b80 2020-05-18T21:34:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf02d9d700 1 --2- 172.21.15.63:0/1990979301 >> v2:172.21.15.155:3300/0 conn(0x7faf0413f870 0x7faf0413fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:34:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf0259c700 1 --2- 172.21.15.63:0/1990979301 >> v2:172.21.15.63:3300/0 conn(0x7faf04145b80 0x7faf04142bf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faef4002f70 tx=0x7faef4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf0259c700 1 --2- 172.21.15.63:0/1990979301 >> v2:172.21.15.63:3300/0 conn(0x7faf04145b80 0x7faf04142bf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faef4002f70 tx=0x7faef4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf0259c700 1 --2- 172.21.15.63:0/1990979301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf04145b80 0x7faf04142bf0 secure :-1 s=READY pgs=1657 cs=0 l=1 rx=0x7faef4002f70 tx=0x7faef4007a80).ready entity=mon.0 client_cookie=ea4bcfd205464b2b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf0259c700 1 --2- 172.21.15.63:0/1990979301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf04145b80 0x7faf04142bf0 secure :-1 s=THROTTLE_DONE pgs=1657 cs=0 l=1 rx=0x7faef4002f70 tx=0x7faef4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf0259c700 1 --2- 172.21.15.63:0/1990979301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf04145b80 0x7faf04142bf0 secure :-1 s=THROTTLE_DONE pgs=1657 cs=0 l=1 rx=0x7faef4002f70 tx=0x7faef4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf0159a700 1 -- 172.21.15.63:0/1990979301 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef4013e60 con 0x7faf04145b80 2020-05-18T21:34:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf0259c700 1 --2- 172.21.15.63:0/1990979301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf04145b80 0x7faf04142bf0 secure :-1 s=THROTTLE_DONE pgs=1657 cs=0 l=1 rx=0x7faef4002f70 tx=0x7faef4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf0159a700 1 -- 172.21.15.63:0/1990979301 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef400c180 con 0x7faf04145b80 2020-05-18T21:34:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf0159a700 1 -- 172.21.15.63:0/1990979301 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef400c560 con 0x7faf04145b80 2020-05-18T21:34:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf089c7700 1 -- 172.21.15.63:0/1990979301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf04145b80 msgr2=0x7faf04142bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.898+0000 7faf089c7700 1 --2- 172.21.15.63:0/1990979301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf04145b80 0x7faf04142bf0 secure :-1 s=READY pgs=1657 cs=0 l=1 rx=0x7faef4002f70 tx=0x7faef4007a80).stop 2020-05-18T21:34:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.902+0000 7faf089c7700 1 -- 172.21.15.63:0/1990979301 shutdown_connections 2020-05-18T21:34:28.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.902+0000 7faf089c7700 1 --2- 172.21.15.63:0/1990979301 >> v2:172.21.15.155:3300/0 conn(0x7faf0413f870 0x7faf0413fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:28.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.902+0000 7faf089c7700 1 --2- 172.21.15.63:0/1990979301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf04145b80 0x7faf04142bf0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:28.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.902+0000 7faf089c7700 1 -- 172.21.15.63:0/1990979301 >> 172.21.15.63:0/1990979301 conn(0x7faf0405b240 msgr2=0x7faf04069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:28.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.902+0000 7faf089c7700 1 -- 172.21.15.63:0/1990979301 shutdown_connections 2020-05-18T21:34:28.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.902+0000 7faf089c7700 1 -- 172.21.15.63:0/1990979301 wait complete. 2020-05-18T21:34:28.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.902+0000 7faf089c7700 1 Processor -- start 2020-05-18T21:34:28.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.902+0000 7faf089c7700 1 -- start start 2020-05-18T21:34:28.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf089c7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf0409b490 0x7faf041405d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf089c7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf04145b80 0x7faf040b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf089c7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf04141ee0 con 0x7faf0413f870 2020-05-18T21:34:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf089c7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf04143240 con 0x7faf04145b80 2020-05-18T21:34:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf089c7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf04142140 con 0x7faf0409b490 2020-05-18T21:34:28.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf02d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf04145b80 0x7faf040b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:28.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf02d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faf04145b80 0x7faf040b7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33652/0 (socket says 172.21.15.63:33652) 2020-05-18T21:34:28.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf02d9d700 1 -- 172.21.15.63:0/1893365916 learned_addr learned my addr 172.21.15.63:0/1893365916 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:28.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf01d9b700 1 --1- 172.21.15.63:0/1893365916 >> v1:172.21.15.63:6789/0 conn(0x7faf0413f870 0x7faf040b87b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35842/0 (socket says 172.21.15.63:35842) 2020-05-18T21:34:28.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf0259c700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf0409b490 0x7faf041405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:28.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf02d9d700 1 -- 172.21.15.63:0/1893365916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf0409b490 msgr2=0x7faf041405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:28.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf02d9d700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf0409b490 0x7faf041405d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:28.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faef37fe700 1 -- 172.21.15.63:0/1893365916 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443298529 0 0) 0x7faf04141ee0 con 0x7faf0413f870 2020-05-18T21:34:28.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf02d9d700 1 -- 172.21.15.63:0/1893365916 >> v1:172.21.15.63:6789/0 conn(0x7faf0413f870 legacy=0x7faf040b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:28.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf02d9d700 1 -- 172.21.15.63:0/1893365916 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040b8ec0 con 0x7faf04145b80 2020-05-18T21:34:28.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf02d9d700 1 --2- 172.21.15.63:0/1893365916 >> v2:172.21.15.63:3300/0 conn(0x7faf04145b80 0x7faf040b7150 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faefc0032f0 tx=0x7faefc010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf02d9d700 1 --2- 172.21.15.63:0/1893365916 >> v2:172.21.15.63:3300/0 conn(0x7faf04145b80 0x7faf040b7150 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faefc0032f0 tx=0x7faefc010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf02d9d700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf04145b80 0x7faf040b7150 secure :-1 s=READY pgs=1659 cs=0 l=1 rx=0x7faefc0032f0 tx=0x7faefc010e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:28.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf02d9d700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf04145b80 0x7faf040b7150 secure :-1 s=THROTTLE_DONE pgs=1659 cs=0 l=1 rx=0x7faefc0032f0 tx=0x7faefc010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faef37fe700 1 -- 172.21.15.63:0/1893365916 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faefc005e70 con 0x7faf04145b80 2020-05-18T21:34:28.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf02d9d700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf04145b80 0x7faf040b7150 secure :-1 s=THROTTLE_DONE pgs=1659 cs=0 l=1 rx=0x7faefc0032f0 tx=0x7faefc010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf02d9d700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf04145b80 0x7faf040b7150 secure :-1 s=THROTTLE_DONE pgs=1659 cs=0 l=1 rx=0x7faefc0032f0 tx=0x7faefc010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faef37fe700 1 -- 172.21.15.63:0/1893365916 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc007560 con 0x7faf04145b80 2020-05-18T21:34:28.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf089c7700 1 -- 172.21.15.63:0/1893365916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf040b7710 con 0x7faf04145b80 2020-05-18T21:34:28.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faef37fe700 1 -- 172.21.15.63:0/1893365916 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faefc0078c0 con 0x7faf04145b80 2020-05-18T21:34:28.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.906+0000 7faf089c7700 1 -- 172.21.15.63:0/1893365916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf040b9af0 con 0x7faf04145b80 2020-05-18T21:34:28.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.910+0000 7faf02d9d700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf04145b80 0x7faf040b7150 secure :-1 s=THROTTLE_DONE pgs=1659 cs=0 l=1 rx=0x7faefc0032f0 tx=0x7faefc010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.910+0000 7faf089c7700 1 -- 172.21.15.63:0/1893365916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf04142310 con 0x7faf04145b80 2020-05-18T21:34:28.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.910+0000 7faef37fe700 1 -- 172.21.15.63:0/1893365916 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7faefc0101a0 con 0x7faf04145b80 2020-05-18T21:34:28.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.910+0000 7faf02d9d700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf04145b80 0x7faf040b7150 secure :-1 s=THROTTLE_DONE pgs=1659 cs=0 l=1 rx=0x7faefc0032f0 tx=0x7faefc010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.910+0000 7faef37fe700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faee004f820 0x7faee0051ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:28.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.910+0000 7faef37fe700 1 -- 172.21.15.63:0/1893365916 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faefc063c50 con 0x7faf04145b80 2020-05-18T21:34:28.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.910+0000 7faf0259c700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faee004f820 0x7faee0051ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:28.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.910+0000 7faf0259c700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faee004f820 0x7faee0051ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faef4002f70 tx=0x7faef4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.910+0000 7faf0259c700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faee004f820 0x7faee0051ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faef4002f70 tx=0x7faef4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.910+0000 7faf0259c700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faee004f820 0x7faee0051ce0 secure :-1 s=READY pgs=642 cs=0 l=1 rx=0x7faef4002f70 tx=0x7faef4007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:28.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.914+0000 7faf02d9d700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf04145b80 0x7faf040b7150 secure :-1 s=THROTTLE_DONE pgs=1659 cs=0 l=1 rx=0x7faefc0032f0 tx=0x7faefc010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:28.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:28.914+0000 7faef37fe700 1 -- 172.21.15.63:0/1893365916 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7faefc03dfe0 con 0x7faf04145b80 2020-05-18T21:34:29.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.066+0000 7faf089c7700 1 -- 172.21.15.63:0/1893365916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf040569e0 con 0x7faf04145b80 2020-05-18T21:34:29.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.066+0000 7faf02d9d700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf04145b80 0x7faf040b7150 secure :-1 s=THROTTLE_DONE pgs=1659 cs=0 l=1 rx=0x7faefc0032f0 tx=0x7faefc010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.066+0000 7faef37fe700 1 -- 172.21.15.63:0/1893365916 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+2145 (secure 0 0 0) 0x7faefc041600 con 0x7faf04145b80 2020-05-18T21:34:29.072 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:29.072 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2906955228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2906955228},{"type":"v1","addr":"172.21.15.155:6835","nonce":2906955228}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":90}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:34:27.767123+0000","modified":"2020-05-18T21:34:28.769908+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9057":{"gid":9057,"name":"a","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/1197291437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1197291437},{"type":"v1","addr":"172.21.15.63:6833","nonce":1197291437}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-05-18T21:34:29.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.066+0000 7faf089c7700 1 -- 172.21.15.63:0/1893365916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faee004f820 msgr2=0x7faee0051ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.066+0000 7faf089c7700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faee004f820 0x7faee0051ce0 secure :-1 s=READY pgs=642 cs=0 l=1 rx=0x7faef4002f70 tx=0x7faef4007a80).stop 2020-05-18T21:34:29.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.066+0000 7faf089c7700 1 -- 172.21.15.63:0/1893365916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf04145b80 msgr2=0x7faf040b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.070+0000 7faf089c7700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf04145b80 0x7faf040b7150 secure :-1 s=READY pgs=1659 cs=0 l=1 rx=0x7faefc0032f0 tx=0x7faefc010e50).stop 2020-05-18T21:34:29.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.070+0000 7faf089c7700 1 -- 172.21.15.63:0/1893365916 shutdown_connections 2020-05-18T21:34:29.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.070+0000 7faf089c7700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faee004f820 0x7faee0051ce0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:29.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.070+0000 7faf089c7700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf04145b80 0x7faf040b7150 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:29.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.070+0000 7faf089c7700 1 --2- 172.21.15.63:0/1893365916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf0409b490 0x7faf041405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:29.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.070+0000 7faf089c7700 1 -- 172.21.15.63:0/1893365916 >> 172.21.15.63:0/1893365916 conn(0x7faf0405b240 msgr2=0x7faf04143e80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:29.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.070+0000 7faf089c7700 1 -- 172.21.15.63:0/1893365916 shutdown_connections 2020-05-18T21:34:29.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.070+0000 7faf089c7700 1 -- 172.21.15.63:0/1893365916 wait complete. 2020-05-18T21:34:29.076 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 91 2020-05-18T21:34:29.084 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:34:29.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.182+0000 7fe668d99700 1 Processor -- start 2020-05-18T21:34:29.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.182+0000 7fe668d99700 1 -- start start 2020-05-18T21:34:29.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe668d99700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe664149d90 0x7fe664066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:29.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe668d99700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6640b3d30 0x7fe6640b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:29.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe668d99700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6640b79c0 con 0x7fe66406a280 2020-05-18T21:34:29.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe668d99700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6640b7bf0 con 0x7fe664149d90 2020-05-18T21:34:29.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe668d99700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe664061c00 con 0x7fe6640b3d30 2020-05-18T21:34:29.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe661d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe66406a280 0x7fe6640b5670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35846/0 (socket says 172.21.15.63:35846) 2020-05-18T21:34:29.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe661d9b700 1 -- 172.21.15.63:0/294742465 learned_addr learned my addr 172.21.15.63:0/294742465 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:29.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66259c700 1 --2- 172.21.15.63:0/294742465 >> v2:172.21.15.155:3300/0 conn(0x7fe664149d90 0x7fe664066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:29.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe662d9d700 1 --2- 172.21.15.63:0/294742465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6640b3d30 0x7fe6640b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:29.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66159a700 1 -- 172.21.15.63:0/294742465 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3633496911 0 0) 0x7fe6640b79c0 con 0x7fe66406a280 2020-05-18T21:34:29.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66159a700 1 -- 172.21.15.63:0/294742465 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe644003270 con 0x7fe66406a280 2020-05-18T21:34:29.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66159a700 1 -- 172.21.15.63:0/294742465 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2991072101 0 0) 0x7fe644003270 con 0x7fe66406a280 2020-05-18T21:34:29.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66159a700 1 -- 172.21.15.63:0/294742465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6640b3d30 msgr2=0x7fe6640b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:29.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66159a700 1 --2- 172.21.15.63:0/294742465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6640b3d30 0x7fe6640b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:29.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66159a700 1 -- 172.21.15.63:0/294742465 >> v2:172.21.15.155:3300/0 conn(0x7fe664149d90 msgr2=0x7fe664066f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:29.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66159a700 1 --2- 172.21.15.63:0/294742465 >> v2:172.21.15.155:3300/0 conn(0x7fe664149d90 0x7fe664066f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:29.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66159a700 1 -- 172.21.15.63:0/294742465 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6640b7e90 con 0x7fe66406a280 2020-05-18T21:34:29.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66159a700 1 -- 172.21.15.63:0/294742465 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fe64c001710 con 0x7fe66406a280 2020-05-18T21:34:29.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66159a700 1 -- 172.21.15.63:0/294742465 >> v1:172.21.15.63:6789/0 conn(0x7fe66406a280 legacy=0x7fe6640b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66159a700 1 --2- 172.21.15.63:0/294742465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6640b3d30 0x7fe644003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:29.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66159a700 1 --2- 172.21.15.63:0/294742465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe644003bc0 0x7fe644004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:29.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66159a700 1 --2- 172.21.15.63:0/294742465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe644004600 0x7fe644004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:29.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66159a700 1 -- 172.21.15.63:0/294742465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6640b7bf0 con 0x7fe644003bc0 2020-05-18T21:34:29.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66159a700 1 -- 172.21.15.63:0/294742465 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe664061c00 con 0x7fe644004600 2020-05-18T21:34:29.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66159a700 1 -- 172.21.15.63:0/294742465 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe644005090 con 0x7fe6640b3d30 2020-05-18T21:34:29.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe661d9b700 1 --2- 172.21.15.63:0/294742465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe644003bc0 0x7fe644004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:29.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66259c700 1 --2- 172.21.15.63:0/294742465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6640b3d30 0x7fe644003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:29.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe661d9b700 1 -- 172.21.15.63:0/294742465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6640b3d30 msgr2=0x7fe644003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:29.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe661d9b700 1 --2- 172.21.15.63:0/294742465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6640b3d30 0x7fe644003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:29.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe662d9d700 1 --2- 172.21.15.63:0/294742465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe644004600 0x7fe644004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:29.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe661d9b700 1 -- 172.21.15.63:0/294742465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe644004600 msgr2=0x7fe644004a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:29.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe661d9b700 1 --2- 172.21.15.63:0/294742465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe644004600 0x7fe644004a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:29.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe661d9b700 1 -- 172.21.15.63:0/294742465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe644003270 con 0x7fe644003bc0 2020-05-18T21:34:29.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe662d9d700 1 --2- 172.21.15.63:0/294742465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe644004600 0x7fe644004a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:34:29.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe661d9b700 1 --2- 172.21.15.63:0/294742465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe644003bc0 0x7fe644004020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe64c001420 tx=0x7fe66414d820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe661d9b700 1 --2- 172.21.15.63:0/294742465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe644003bc0 0x7fe644004020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe64c001420 tx=0x7fe66414d820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe661d9b700 1 --2- 172.21.15.63:0/294742465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe644003bc0 0x7fe644004020 secure :-1 s=READY pgs=1661 cs=0 l=1 rx=0x7fe64c001420 tx=0x7fe66414d820).ready entity=mon.0 client_cookie=4ce81d99823f705b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:29.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe661d9b700 1 --2- 172.21.15.63:0/294742465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe644003bc0 0x7fe644004020 secure :-1 s=THROTTLE_DONE pgs=1661 cs=0 l=1 rx=0x7fe64c001420 tx=0x7fe66414d820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66159a700 1 -- 172.21.15.63:0/294742465 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe64c00e370 con 0x7fe644003bc0 2020-05-18T21:34:29.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe661d9b700 1 --2- 172.21.15.63:0/294742465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe644003bc0 0x7fe644004020 secure :-1 s=THROTTLE_DONE pgs=1661 cs=0 l=1 rx=0x7fe64c001420 tx=0x7fe66414d820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe661d9b700 1 --2- 172.21.15.63:0/294742465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe644003bc0 0x7fe644004020 secure :-1 s=THROTTLE_DONE pgs=1661 cs=0 l=1 rx=0x7fe64c001420 tx=0x7fe66414d820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66159a700 1 -- 172.21.15.63:0/294742465 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c00e4d0 con 0x7fe644003bc0 2020-05-18T21:34:29.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe668d99700 1 -- 172.21.15.63:0/294742465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe644003bc0 msgr2=0x7fe644004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe66159a700 1 -- 172.21.15.63:0/294742465 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe64c0100c0 con 0x7fe644003bc0 2020-05-18T21:34:29.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe668d99700 1 --2- 172.21.15.63:0/294742465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe644003bc0 0x7fe644004020 secure :-1 s=READY pgs=1661 cs=0 l=1 rx=0x7fe64c001420 tx=0x7fe66414d820).stop 2020-05-18T21:34:29.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe662d9d700 1 -- 172.21.15.63:0/294742465 reap_dead start 2020-05-18T21:34:29.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.186+0000 7fe668d99700 1 -- 172.21.15.63:0/294742465 shutdown_connections 2020-05-18T21:34:29.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe668d99700 1 -- 172.21.15.63:0/294742465 >> 172.21.15.63:0/294742465 conn(0x7fe66405b240 msgr2=0x7fe664069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:29.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe668d99700 1 -- 172.21.15.63:0/294742465 shutdown_connections 2020-05-18T21:34:29.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe668d99700 1 -- 172.21.15.63:0/294742465 wait complete. 2020-05-18T21:34:29.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe668d99700 1 Processor -- start 2020-05-18T21:34:29.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe668d99700 1 -- start start 2020-05-18T21:34:29.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe668d99700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe664145a70 0x7fe664157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:29.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe668d99700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe6640b2830 0x7fe664147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:29.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe668d99700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6640b2cb0 con 0x7fe664148050 2020-05-18T21:34:29.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe668d99700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6641573d0 con 0x7fe6640b2830 2020-05-18T21:34:29.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe668d99700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe664158340 con 0x7fe664145a70 2020-05-18T21:34:29.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe661d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe6640b2830 0x7fe664147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:29.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe661d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe6640b2830 0x7fe664147bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33672/0 (socket says 172.21.15.63:33672) 2020-05-18T21:34:29.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe661d9b700 1 -- 172.21.15.63:0/2777417366 learned_addr learned my addr 172.21.15.63:0/2777417366 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:29.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe66259c700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe664145a70 0x7fe664157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:29.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe661d9b700 1 -- 172.21.15.63:0/2777417366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe664145a70 msgr2=0x7fe664157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe661d9b700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe664145a70 0x7fe664157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:29.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe661d9b700 1 -- 172.21.15.63:0/2777417366 >> v1:172.21.15.155:6789/0 conn(0x7fe664148050 legacy=0x7fe66415aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe661d9b700 1 -- 172.21.15.63:0/2777417366 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6641496b0 con 0x7fe6640b2830 2020-05-18T21:34:29.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe661d9b700 1 --2- 172.21.15.63:0/2777417366 >> v2:172.21.15.63:3300/0 conn(0x7fe6640b2830 0x7fe664147bf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe64c001420 tx=0x7fe66414d820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe661d9b700 1 --2- 172.21.15.63:0/2777417366 >> v2:172.21.15.63:3300/0 conn(0x7fe6640b2830 0x7fe664147bf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe64c001420 tx=0x7fe66414d820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe661d9b700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6640b2830 0x7fe664147bf0 secure :-1 s=READY pgs=1662 cs=0 l=1 rx=0x7fe64c001420 tx=0x7fe66414d820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:29.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe661d9b700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6640b2830 0x7fe664147bf0 secure :-1 s=THROTTLE_DONE pgs=1662 cs=0 l=1 rx=0x7fe64c001420 tx=0x7fe66414d820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe65b7fe700 1 -- 172.21.15.63:0/2777417366 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe64c00e7a0 con 0x7fe6640b2830 2020-05-18T21:34:29.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe661d9b700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6640b2830 0x7fe664147bf0 secure :-1 s=THROTTLE_DONE pgs=1662 cs=0 l=1 rx=0x7fe64c001420 tx=0x7fe66414d820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe661d9b700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6640b2830 0x7fe664147bf0 secure :-1 s=THROTTLE_DONE pgs=1662 cs=0 l=1 rx=0x7fe64c001420 tx=0x7fe66414d820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe65b7fe700 1 -- 172.21.15.63:0/2777417366 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c0104c0 con 0x7fe6640b2830 2020-05-18T21:34:29.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe65b7fe700 1 -- 172.21.15.63:0/2777417366 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe64c0108e0 con 0x7fe6640b2830 2020-05-18T21:34:29.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe668d99700 1 -- 172.21.15.63:0/2777417366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66414a170 con 0x7fe6640b2830 2020-05-18T21:34:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.190+0000 7fe668d99700 1 -- 172.21.15.63:0/2777417366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6640b21f0 con 0x7fe6640b2830 2020-05-18T21:34:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.194+0000 7fe661d9b700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6640b2830 0x7fe664147bf0 secure :-1 s=THROTTLE_DONE pgs=1662 cs=0 l=1 rx=0x7fe64c001420 tx=0x7fe66414d820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.194+0000 7fe668d99700 1 -- 172.21.15.63:0/2777417366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6640569e0 con 0x7fe6640b2830 2020-05-18T21:34:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.194+0000 7fe65b7fe700 1 -- 172.21.15.63:0/2777417366 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe64c0045f0 con 0x7fe6640b2830 2020-05-18T21:34:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.194+0000 7fe661d9b700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6640b2830 0x7fe664147bf0 secure :-1 s=THROTTLE_DONE pgs=1662 cs=0 l=1 rx=0x7fe64c001420 tx=0x7fe66414d820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.194+0000 7fe65b7fe700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe64804f920 0x7fe648051de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:29.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.194+0000 7fe65b7fe700 1 -- 172.21.15.63:0/2777417366 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe64c064310 con 0x7fe6640b2830 2020-05-18T21:34:29.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.194+0000 7fe66259c700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe64804f920 0x7fe648051de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:29.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.194+0000 7fe66259c700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe64804f920 0x7fe648051de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe654002f70 tx=0x7fe654008080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.194+0000 7fe66259c700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe64804f920 0x7fe648051de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe654002f70 tx=0x7fe654008080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.194+0000 7fe66259c700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe64804f920 0x7fe648051de0 secure :-1 s=READY pgs=643 cs=0 l=1 rx=0x7fe654002f70 tx=0x7fe654008080).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:29.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.202+0000 7fe661d9b700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6640b2830 0x7fe664147bf0 secure :-1 s=THROTTLE_DONE pgs=1662 cs=0 l=1 rx=0x7fe64c001420 tx=0x7fe66414d820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.202+0000 7fe65b7fe700 1 -- 172.21.15.63:0/2777417366 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe64c03e680 con 0x7fe6640b2830 2020-05-18T21:34:29.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.322+0000 7fe668d99700 1 -- 172.21.15.63:0/2777417366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6640b32d0 con 0x7fe6640b2830 2020-05-18T21:34:29.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.322+0000 7fe661d9b700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6640b2830 0x7fe664147bf0 secure :-1 s=THROTTLE_DONE pgs=1662 cs=0 l=1 rx=0x7fe64c001420 tx=0x7fe66414d820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.322+0000 7fe65b7fe700 1 -- 172.21.15.63:0/2777417366 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16103 (secure 0 0 0) 0x7fe64c041c60 con 0x7fe6640b2830 2020-05-18T21:34:29.329 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:29.329 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":123,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:34:28.770580+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:34:26.108423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2020-05-18T21:34:26.753473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:34:29.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.326+0000 7fe668d99700 1 -- 172.21.15.63:0/2777417366 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe64804f920 msgr2=0x7fe648051de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.326+0000 7fe668d99700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe64804f920 0x7fe648051de0 secure :-1 s=READY pgs=643 cs=0 l=1 rx=0x7fe654002f70 tx=0x7fe654008080).stop 2020-05-18T21:34:29.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.326+0000 7fe668d99700 1 -- 172.21.15.63:0/2777417366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6640b2830 msgr2=0x7fe664147bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.326+0000 7fe668d99700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6640b2830 0x7fe664147bf0 secure :-1 s=READY pgs=1662 cs=0 l=1 rx=0x7fe64c001420 tx=0x7fe66414d820).stop 2020-05-18T21:34:29.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.326+0000 7fe668d99700 1 -- 172.21.15.63:0/2777417366 shutdown_connections 2020-05-18T21:34:29.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.326+0000 7fe668d99700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe64804f920 0x7fe648051de0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:29.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.326+0000 7fe668d99700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6640b2830 0x7fe664147bf0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:29.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.326+0000 7fe668d99700 1 --2- 172.21.15.63:0/2777417366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe664145a70 0x7fe664157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:29.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.326+0000 7fe668d99700 1 -- 172.21.15.63:0/2777417366 >> 172.21.15.63:0/2777417366 conn(0x7fe66405b240 msgr2=0x7fe6640b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:29.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.326+0000 7fe668d99700 1 -- 172.21.15.63:0/2777417366 shutdown_connections 2020-05-18T21:34:29.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.326+0000 7fe668d99700 1 -- 172.21.15.63:0/2777417366 wait complete. 2020-05-18T21:34:29.341 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:34:29.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.446+0000 7fe6b7fff700 1 Processor -- start 2020-05-18T21:34:29.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.446+0000 7fe6b7fff700 1 -- start start 2020-05-18T21:34:29.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6b7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe6b80b6410 0x7fe6b80b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:29.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6b7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe6b8151bc0 0x7fe6b8152030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:29.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6b7fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b8025500 con 0x7fe6b80b5cb0 2020-05-18T21:34:29.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6b7fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b8064ee0 con 0x7fe6b8151bc0 2020-05-18T21:34:29.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6b7fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b80b67f0 con 0x7fe6b80b6410 2020-05-18T21:34:29.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6bd3f4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe6b8151bc0 0x7fe6b8152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:29.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6bd3f4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe6b8151bc0 0x7fe6b8152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33680/0 (socket says 172.21.15.63:33680) 2020-05-18T21:34:29.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6bd3f4700 1 -- 172.21.15.63:0/2045319412 learned_addr learned my addr 172.21.15.63:0/2045319412 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:29.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6b77fe700 1 --2- 172.21.15.63:0/2045319412 >> v2:172.21.15.155:3300/0 conn(0x7fe6b80b6410 0x7fe6b80b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:29.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6bd3f4700 1 -- 172.21.15.63:0/2045319412 >> v2:172.21.15.155:3300/0 conn(0x7fe6b80b6410 msgr2=0x7fe6b80b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:29.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6bd3f4700 1 --2- 172.21.15.63:0/2045319412 >> v2:172.21.15.155:3300/0 conn(0x7fe6b80b6410 0x7fe6b80b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:29.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6bd3f4700 1 -- 172.21.15.63:0/2045319412 >> v1:172.21.15.155:6789/0 conn(0x7fe6b80b5cb0 legacy=0x7fe6b8061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:29.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6bd3f4700 1 -- 172.21.15.63:0/2045319412 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b8025180 con 0x7fe6b8151bc0 2020-05-18T21:34:29.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6b77fe700 1 --2- 172.21.15.63:0/2045319412 >> v2:172.21.15.155:3300/0 conn(0x7fe6b80b6410 0x7fe6b80b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:34:29.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6bd3f4700 1 --2- 172.21.15.63:0/2045319412 >> v2:172.21.15.63:3300/0 conn(0x7fe6b8151bc0 0x7fe6b8152030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe6b8025b40 tx=0x7fe6b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6bd3f4700 1 --2- 172.21.15.63:0/2045319412 >> v2:172.21.15.63:3300/0 conn(0x7fe6b8151bc0 0x7fe6b8152030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe6b8025b40 tx=0x7fe6b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6bd3f4700 1 --2- 172.21.15.63:0/2045319412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6b8151bc0 0x7fe6b8152030 secure :-1 s=READY pgs=1663 cs=0 l=1 rx=0x7fe6b8025b40 tx=0x7fe6b0007e00).ready entity=mon.0 client_cookie=b0e5be80b2e79549 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:29.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6bd3f4700 1 --2- 172.21.15.63:0/2045319412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6b8151bc0 0x7fe6b8152030 secure :-1 s=THROTTLE_DONE pgs=1663 cs=0 l=1 rx=0x7fe6b8025b40 tx=0x7fe6b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6bd3f4700 1 --2- 172.21.15.63:0/2045319412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6b8151bc0 0x7fe6b8152030 secure :-1 s=THROTTLE_DONE pgs=1663 cs=0 l=1 rx=0x7fe6b8025b40 tx=0x7fe6b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6b67fc700 1 -- 172.21.15.63:0/2045319412 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6b0011d80 con 0x7fe6b8151bc0 2020-05-18T21:34:29.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6bd3f4700 1 --2- 172.21.15.63:0/2045319412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6b8151bc0 0x7fe6b8152030 secure :-1 s=THROTTLE_DONE pgs=1663 cs=0 l=1 rx=0x7fe6b8025b40 tx=0x7fe6b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6b67fc700 1 -- 172.21.15.63:0/2045319412 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b000a180 con 0x7fe6b8151bc0 2020-05-18T21:34:29.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6b67fc700 1 -- 172.21.15.63:0/2045319412 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6b000a560 con 0x7fe6b8151bc0 2020-05-18T21:34:29.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6b7fff700 1 -- 172.21.15.63:0/2045319412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6b8151bc0 msgr2=0x7fe6b8152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6b7fff700 1 --2- 172.21.15.63:0/2045319412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6b8151bc0 0x7fe6b8152030 secure :-1 s=READY pgs=1663 cs=0 l=1 rx=0x7fe6b8025b40 tx=0x7fe6b0007e00).stop 2020-05-18T21:34:29.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6b7fff700 1 -- 172.21.15.63:0/2045319412 shutdown_connections 2020-05-18T21:34:29.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6b7fff700 1 --2- 172.21.15.63:0/2045319412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6b8151bc0 0x7fe6b8152030 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:29.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6b7fff700 1 --2- 172.21.15.63:0/2045319412 >> v2:172.21.15.155:3300/0 conn(0x7fe6b80b6410 0x7fe6b80b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:29.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.450+0000 7fe6b7fff700 1 -- 172.21.15.63:0/2045319412 >> 172.21.15.63:0/2045319412 conn(0x7fe6b8069b70 msgr2=0x7fe6b8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:29.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.454+0000 7fe6b7fff700 1 -- 172.21.15.63:0/2045319412 shutdown_connections 2020-05-18T21:34:29.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.454+0000 7fe6b7fff700 1 -- 172.21.15.63:0/2045319412 wait complete. 2020-05-18T21:34:29.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.454+0000 7fe6b7fff700 1 Processor -- start 2020-05-18T21:34:29.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.454+0000 7fe6b7fff700 1 -- start start 2020-05-18T21:34:29.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.454+0000 7fe6b7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe6b80b5cb0 0x7fe6b8155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:29.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.454+0000 7fe6b7fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b8151bc0 0x7fe6b813ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:29.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.454+0000 7fe6b7fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b8155840 con 0x7fe6b80b6410 2020-05-18T21:34:29.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.454+0000 7fe6b7fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b8155ae0 con 0x7fe6b80b5cb0 2020-05-18T21:34:29.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.454+0000 7fe6b7fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b8155d80 con 0x7fe6b8151bc0 2020-05-18T21:34:29.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.454+0000 7fe6b77fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe6b80b5cb0 0x7fe6b8155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:29.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.454+0000 7fe6b6ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe6b80b6410 0x7fe6b813d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35874/0 (socket says 172.21.15.63:35874) 2020-05-18T21:34:29.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.454+0000 7fe6b6ffd700 1 -- 172.21.15.63:0/4213225652 learned_addr learned my addr 172.21.15.63:0/4213225652 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:29.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.454+0000 7fe6bd3f4700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b8151bc0 0x7fe6b813ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:29.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.458+0000 7fe6bd3f4700 1 -- 172.21.15.63:0/4213225652 >> v2:172.21.15.155:3300/0 conn(0x7fe6b80b5cb0 msgr2=0x7fe6b8155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.458+0000 7fe6bd3f4700 1 --2- 172.21.15.63:0/4213225652 >> v2:172.21.15.155:3300/0 conn(0x7fe6b80b5cb0 0x7fe6b8155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:29.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.458+0000 7fe6bd3f4700 1 -- 172.21.15.63:0/4213225652 >> v1:172.21.15.63:6789/0 conn(0x7fe6b80b6410 legacy=0x7fe6b813d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.458+0000 7fe69ffff700 1 -- 172.21.15.63:0/4213225652 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790611886 0 0) 0x7fe6b8155840 con 0x7fe6b80b6410 2020-05-18T21:34:29.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.458+0000 7fe6bd3f4700 1 -- 172.21.15.63:0/4213225652 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b80acdc0 con 0x7fe6b8151bc0 2020-05-18T21:34:29.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.458+0000 7fe6b77fe700 1 --2- 172.21.15.63:0/4213225652 >> v2:172.21.15.155:3300/0 conn(0x7fe6b80b5cb0 0x7fe6b8155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:29.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.458+0000 7fe6bd3f4700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b8151bc0 0x7fe6b813ce00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe6b8025b40 tx=0x7fe6b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.458+0000 7fe6bd3f4700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b8151bc0 0x7fe6b813ce00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe6b8025b40 tx=0x7fe6b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.458+0000 7fe6bd3f4700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b8151bc0 0x7fe6b813ce00 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7fe6b8025b40 tx=0x7fe6b0007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:29.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.458+0000 7fe6bd3f4700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b8151bc0 0x7fe6b813ce00 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7fe6b8025b40 tx=0x7fe6b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.458+0000 7fe69ffff700 1 -- 172.21.15.63:0/4213225652 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6b000ae40 con 0x7fe6b8151bc0 2020-05-18T21:34:29.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.458+0000 7fe6bd3f4700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b8151bc0 0x7fe6b813ce00 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7fe6b8025b40 tx=0x7fe6b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.458+0000 7fe6bd3f4700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b8151bc0 0x7fe6b813ce00 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7fe6b8025b40 tx=0x7fe6b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.458+0000 7fe69ffff700 1 -- 172.21.15.63:0/4213225652 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b0005c70 con 0x7fe6b8151bc0 2020-05-18T21:34:29.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.458+0000 7fe6b7fff700 1 -- 172.21.15.63:0/4213225652 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b813db30 con 0x7fe6b8151bc0 2020-05-18T21:34:29.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.458+0000 7fe69ffff700 1 -- 172.21.15.63:0/4213225652 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6b0005de0 con 0x7fe6b8151bc0 2020-05-18T21:34:29.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.458+0000 7fe6b7fff700 1 -- 172.21.15.63:0/4213225652 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b813e060 con 0x7fe6b8151bc0 2020-05-18T21:34:29.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.462+0000 7fe6bd3f4700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b8151bc0 0x7fe6b813ce00 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7fe6b8025b40 tx=0x7fe6b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.462+0000 7fe6b7fff700 1 -- 172.21.15.63:0/4213225652 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b80569e0 con 0x7fe6b8151bc0 2020-05-18T21:34:29.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.462+0000 7fe69ffff700 1 -- 172.21.15.63:0/4213225652 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe6b00112c0 con 0x7fe6b8151bc0 2020-05-18T21:34:29.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.462+0000 7fe69ffff700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe69804f880 0x7fe698051d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:29.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.462+0000 7fe6b77fe700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe69804f880 0x7fe698051d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:29.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.462+0000 7fe6b77fe700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe69804f880 0x7fe698051d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe6a8002f70 tx=0x7fe6a800b430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.462+0000 7fe6b77fe700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe69804f880 0x7fe698051d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe6a8002f70 tx=0x7fe6a800b430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.462+0000 7fe6b77fe700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe69804f880 0x7fe698051d40 secure :-1 s=READY pgs=644 cs=0 l=1 rx=0x7fe6a8002f70 tx=0x7fe6a800b430).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:29.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.466+0000 7fe6bd3f4700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b8151bc0 0x7fe6b813ce00 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7fe6b8025b40 tx=0x7fe6b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.466+0000 7fe69ffff700 1 -- 172.21.15.63:0/4213225652 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe6b00406b0 con 0x7fe6b8151bc0 2020-05-18T21:34:29.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.470+0000 7fe6bd3f4700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b8151bc0 0x7fe6b813ce00 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7fe6b8025b40 tx=0x7fe6b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.470+0000 7fe69ffff700 1 -- 172.21.15.63:0/4213225652 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe6b003e8b0 con 0x7fe6b8151bc0 2020-05-18T21:34:29.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.626+0000 7fe6b7fff700 1 -- 172.21.15.63:0/4213225652 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fe6b80b5a10 con 0x7fe6b8151bc0 2020-05-18T21:34:29.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.634+0000 7fe6bd3f4700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b8151bc0 0x7fe6b813ce00 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7fe6b8025b40 tx=0x7fe6b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.634+0000 7fe69ffff700 1 -- 172.21.15.63:0/4213225652 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v47) v1 ==== 184+0+0 (secure 0 0 0) 0x7fe6b0041ed0 con 0x7fe6b8151bc0 2020-05-18T21:34:29.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.634+0000 7fe6b7fff700 1 -- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe69804f880 msgr2=0x7fe698051d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.634+0000 7fe6b7fff700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe69804f880 0x7fe698051d40 secure :-1 s=READY pgs=644 cs=0 l=1 rx=0x7fe6a8002f70 tx=0x7fe6a800b430).stop 2020-05-18T21:34:29.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.634+0000 7fe6b7fff700 1 -- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b8151bc0 msgr2=0x7fe6b813ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.634+0000 7fe6b7fff700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b8151bc0 0x7fe6b813ce00 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7fe6b8025b40 tx=0x7fe6b0007e00).stop 2020-05-18T21:34:29.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.634+0000 7fe6b7fff700 1 -- 172.21.15.63:0/4213225652 shutdown_connections 2020-05-18T21:34:29.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.634+0000 7fe6b7fff700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe69804f880 0x7fe698051d40 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:29.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.634+0000 7fe6b7fff700 1 --2- 172.21.15.63:0/4213225652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b8151bc0 0x7fe6b813ce00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:29.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.634+0000 7fe6b7fff700 1 --2- 172.21.15.63:0/4213225652 >> v2:172.21.15.155:3300/0 conn(0x7fe6b80b5cb0 0x7fe6b8155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:29.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.634+0000 7fe6b7fff700 1 -- 172.21.15.63:0/4213225652 >> 172.21.15.63:0/4213225652 conn(0x7fe6b8069b70 msgr2=0x7fe6b80b8870 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:29.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.634+0000 7fe6b7fff700 1 -- 172.21.15.63:0/4213225652 shutdown_connections 2020-05-18T21:34:29.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.634+0000 7fe6b7fff700 1 -- 172.21.15.63:0/4213225652 wait complete. 2020-05-18T21:34:29.643 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.0 2020-05-18T21:34:29.651 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:34:29.756 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:34:29.758 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:34:29.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.762+0000 7fa225cad700 1 Processor -- start 2020-05-18T21:34:29.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.762+0000 7fa225cad700 1 -- start start 2020-05-18T21:34:29.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa225cad700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2200b5cb0 0x7fa2200b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:29.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa225cad700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa220025500 con 0x7fa2200b6410 2020-05-18T21:34:29.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa225cad700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa220064ee0 con 0x7fa220151bc0 2020-05-18T21:34:29.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa225cad700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2200b67f0 con 0x7fa2200b5cb0 2020-05-18T21:34:29.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa2254ac700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa2200b6410 0x7fa220061af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35880/0 (socket says 172.21.15.63:35880) 2020-05-18T21:34:29.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa2254ac700 1 -- 172.21.15.63:0/382208831 learned_addr learned my addr 172.21.15.63:0/382208831 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:29.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa224cab700 1 --2- 172.21.15.63:0/382208831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2200b5cb0 0x7fa2200b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:29.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa217fff700 1 -- 172.21.15.63:0/382208831 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409978966 0 0) 0x7fa220025500 con 0x7fa2200b6410 2020-05-18T21:34:29.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa217fff700 1 -- 172.21.15.63:0/382208831 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa20c003270 con 0x7fa2200b6410 2020-05-18T21:34:29.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa217fff700 1 -- 172.21.15.63:0/382208831 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771528233 0 0) 0x7fa220064ee0 con 0x7fa220151bc0 2020-05-18T21:34:29.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa217fff700 1 -- 172.21.15.63:0/382208831 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa220025500 con 0x7fa220151bc0 2020-05-18T21:34:29.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa224cab700 1 -- 172.21.15.63:0/382208831 >> v1:172.21.15.155:6789/0 conn(0x7fa220151bc0 legacy=0x7fa220152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa224cab700 1 -- 172.21.15.63:0/382208831 >> v1:172.21.15.63:6789/0 conn(0x7fa2200b6410 legacy=0x7fa220061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa224cab700 1 -- 172.21.15.63:0/382208831 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa220025180 con 0x7fa2200b5cb0 2020-05-18T21:34:29.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa224cab700 1 --2- 172.21.15.63:0/382208831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2200b5cb0 0x7fa2200b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa21c002f70 tx=0x7fa21c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa224cab700 1 --2- 172.21.15.63:0/382208831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2200b5cb0 0x7fa2200b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa21c002f70 tx=0x7fa21c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa224cab700 1 --2- 172.21.15.63:0/382208831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2200b5cb0 0x7fa2200b6cd0 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7fa21c002f70 tx=0x7fa21c008920).ready entity=mon.2 client_cookie=2e5192d721b929f5 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:29.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa224cab700 1 --2- 172.21.15.63:0/382208831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2200b5cb0 0x7fa2200b6cd0 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7fa21c002f70 tx=0x7fa21c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa217fff700 1 -- 172.21.15.63:0/382208831 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa21c008e80 con 0x7fa2200b5cb0 2020-05-18T21:34:29.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa224cab700 1 --2- 172.21.15.63:0/382208831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2200b5cb0 0x7fa2200b6cd0 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7fa21c002f70 tx=0x7fa21c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa217fff700 1 -- 172.21.15.63:0/382208831 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21c011580 con 0x7fa2200b5cb0 2020-05-18T21:34:29.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa224cab700 1 --2- 172.21.15.63:0/382208831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2200b5cb0 0x7fa2200b6cd0 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7fa21c002f70 tx=0x7fa21c008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa217fff700 1 -- 172.21.15.63:0/382208831 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa21c0118e0 con 0x7fa2200b5cb0 2020-05-18T21:34:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa225cad700 1 -- 172.21.15.63:0/382208831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2200b5cb0 msgr2=0x7fa2200b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa225cad700 1 --2- 172.21.15.63:0/382208831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2200b5cb0 0x7fa2200b6cd0 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7fa21c002f70 tx=0x7fa21c008920).stop 2020-05-18T21:34:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa225cad700 1 -- 172.21.15.63:0/382208831 shutdown_connections 2020-05-18T21:34:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa225cad700 1 --2- 172.21.15.63:0/382208831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2200b5cb0 0x7fa2200b6cd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:29.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa225cad700 1 -- 172.21.15.63:0/382208831 >> 172.21.15.63:0/382208831 conn(0x7fa220069b70 msgr2=0x7fa220069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:29.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.766+0000 7fa225cad700 1 -- 172.21.15.63:0/382208831 shutdown_connections 2020-05-18T21:34:29.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.770+0000 7fa225cad700 1 -- 172.21.15.63:0/382208831 wait complete. 2020-05-18T21:34:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.770+0000 7fa225cad700 1 Processor -- start 2020-05-18T21:34:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.770+0000 7fa225cad700 1 -- start start 2020-05-18T21:34:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa225cad700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa2200b5cb0 0x7fa2200b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa225cad700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa2200b6410 0x7fa220073cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:29.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa225cad700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2200b2450 con 0x7fa220151bc0 2020-05-18T21:34:29.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa225cad700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2200b0650 con 0x7fa2200b5cb0 2020-05-18T21:34:29.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa225cad700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2200b2940 con 0x7fa2200b6410 2020-05-18T21:34:29.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa2254ac700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa2200b5cb0 0x7fa2200b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:29.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa2254ac700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa2200b5cb0 0x7fa2200b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33698/0 (socket says 172.21.15.63:33698) 2020-05-18T21:34:29.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa2254ac700 1 -- 172.21.15.63:0/2872235289 learned_addr learned my addr 172.21.15.63:0/2872235289 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:29.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa226f0f700 1 --1- 172.21.15.63:0/2872235289 >> v1:172.21.15.63:6789/0 conn(0x7fa220151bc0 0x7fa220122780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35890/0 (socket says 172.21.15.63:35890) 2020-05-18T21:34:29.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa224cab700 1 --2- 172.21.15.63:0/2872235289 >> v2:172.21.15.155:3300/0 conn(0x7fa2200b6410 0x7fa220073cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:29.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa2254ac700 1 -- 172.21.15.63:0/2872235289 >> v2:172.21.15.155:3300/0 conn(0x7fa2200b6410 msgr2=0x7fa220073cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa2254ac700 1 --2- 172.21.15.63:0/2872235289 >> v2:172.21.15.155:3300/0 conn(0x7fa2200b6410 0x7fa220073cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:29.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa2254ac700 1 -- 172.21.15.63:0/2872235289 >> v1:172.21.15.63:6789/0 conn(0x7fa220151bc0 legacy=0x7fa220122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa215ffb700 1 -- 172.21.15.63:0/2872235289 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674060854 0 0) 0x7fa2200b2450 con 0x7fa220151bc0 2020-05-18T21:34:29.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa2254ac700 1 -- 172.21.15.63:0/2872235289 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2200b2de0 con 0x7fa2200b5cb0 2020-05-18T21:34:29.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa224cab700 1 --2- 172.21.15.63:0/2872235289 >> v2:172.21.15.155:3300/0 conn(0x7fa2200b6410 0x7fa220073cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:34:29.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa2254ac700 1 --2- 172.21.15.63:0/2872235289 >> v2:172.21.15.63:3300/0 conn(0x7fa2200b5cb0 0x7fa2200b3930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa218001490 tx=0x7fa218010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa2254ac700 1 --2- 172.21.15.63:0/2872235289 >> v2:172.21.15.63:3300/0 conn(0x7fa2200b5cb0 0x7fa2200b3930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa218001490 tx=0x7fa218010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa2254ac700 1 --2- 172.21.15.63:0/2872235289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2200b5cb0 0x7fa2200b3930 secure :-1 s=READY pgs=1667 cs=0 l=1 rx=0x7fa218001490 tx=0x7fa218010de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:29.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa2254ac700 1 --2- 172.21.15.63:0/2872235289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2200b5cb0 0x7fa2200b3930 secure :-1 s=THROTTLE_DONE pgs=1667 cs=0 l=1 rx=0x7fa218001490 tx=0x7fa218010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa2254ac700 1 --2- 172.21.15.63:0/2872235289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2200b5cb0 0x7fa2200b3930 secure :-1 s=THROTTLE_DONE pgs=1667 cs=0 l=1 rx=0x7fa218001490 tx=0x7fa218010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa215ffb700 1 -- 172.21.15.63:0/2872235289 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa218005e90 con 0x7fa2200b5cb0 2020-05-18T21:34:29.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa2254ac700 1 --2- 172.21.15.63:0/2872235289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2200b5cb0 0x7fa2200b3930 secure :-1 s=THROTTLE_DONE pgs=1667 cs=0 l=1 rx=0x7fa218001490 tx=0x7fa218010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa215ffb700 1 -- 172.21.15.63:0/2872235289 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa218012670 con 0x7fa2200b5cb0 2020-05-18T21:34:29.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa225cad700 1 -- 172.21.15.63:0/2872235289 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2200b40d0 con 0x7fa2200b5cb0 2020-05-18T21:34:29.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa215ffb700 1 -- 172.21.15.63:0/2872235289 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2180129d0 con 0x7fa2200b5cb0 2020-05-18T21:34:29.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa225cad700 1 -- 172.21.15.63:0/2872235289 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa220123030 con 0x7fa2200b5cb0 2020-05-18T21:34:29.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa2254ac700 1 --2- 172.21.15.63:0/2872235289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2200b5cb0 0x7fa2200b3930 secure :-1 s=THROTTLE_DONE pgs=1667 cs=0 l=1 rx=0x7fa218001490 tx=0x7fa218010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa215ffb700 1 -- 172.21.15.63:0/2872235289 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa218012c40 con 0x7fa2200b5cb0 2020-05-18T21:34:29.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa2254ac700 1 --2- 172.21.15.63:0/2872235289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2200b5cb0 0x7fa2200b3930 secure :-1 s=THROTTLE_DONE pgs=1667 cs=0 l=1 rx=0x7fa218001490 tx=0x7fa218010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa225cad700 1 -- 172.21.15.63:0/2872235289 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2200569e0 con 0x7fa2200b5cb0 2020-05-18T21:34:29.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa215ffb700 1 --2- 172.21.15.63:0/2872235289 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa20004f940 0x7fa200051e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:29.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.774+0000 7fa215ffb700 1 -- 172.21.15.63:0/2872235289 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa2180090c0 con 0x7fa2200b5cb0 2020-05-18T21:34:29.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.778+0000 7fa224cab700 1 --2- 172.21.15.63:0/2872235289 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa20004f940 0x7fa200051e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:29.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.778+0000 7fa224cab700 1 --2- 172.21.15.63:0/2872235289 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa20004f940 0x7fa200051e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa21c002f70 tx=0x7fa220025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.778+0000 7fa224cab700 1 --2- 172.21.15.63:0/2872235289 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa20004f940 0x7fa200051e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa21c002f70 tx=0x7fa220025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.778+0000 7fa224cab700 1 --2- 172.21.15.63:0/2872235289 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa20004f940 0x7fa200051e00 secure :-1 s=READY pgs=645 cs=0 l=1 rx=0x7fa21c002f70 tx=0x7fa220025310).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:29.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.782+0000 7fa2254ac700 1 --2- 172.21.15.63:0/2872235289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2200b5cb0 0x7fa2200b3930 secure :-1 s=THROTTLE_DONE pgs=1667 cs=0 l=1 rx=0x7fa218001490 tx=0x7fa218010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.782+0000 7fa215ffb700 1 -- 172.21.15.63:0/2872235289 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa21803e500 con 0x7fa2200b5cb0 2020-05-18T21:34:29.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.930+0000 7fa225cad700 1 -- 172.21.15.63:0/2872235289 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa2200b2ab0 con 0x7fa2200b5cb0 2020-05-18T21:34:29.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.938+0000 7fa2254ac700 1 --2- 172.21.15.63:0/2872235289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2200b5cb0 0x7fa2200b3930 secure :-1 s=THROTTLE_DONE pgs=1667 cs=0 l=1 rx=0x7fa218001490 tx=0x7fa218010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:29.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.938+0000 7fa215ffb700 1 -- 172.21.15.63:0/2872235289 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v48) v1 ==== 184+0+0 (secure 0 0 0) 0x7fa218041b20 con 0x7fa2200b5cb0 2020-05-18T21:34:29.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.942+0000 7fa225cad700 1 -- 172.21.15.63:0/2872235289 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa20004f940 msgr2=0x7fa200051e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.942+0000 7fa225cad700 1 --2- 172.21.15.63:0/2872235289 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa20004f940 0x7fa200051e00 secure :-1 s=READY pgs=645 cs=0 l=1 rx=0x7fa21c002f70 tx=0x7fa220025310).stop 2020-05-18T21:34:29.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.942+0000 7fa225cad700 1 -- 172.21.15.63:0/2872235289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2200b5cb0 msgr2=0x7fa2200b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:29.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.942+0000 7fa225cad700 1 --2- 172.21.15.63:0/2872235289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2200b5cb0 0x7fa2200b3930 secure :-1 s=READY pgs=1667 cs=0 l=1 rx=0x7fa218001490 tx=0x7fa218010de0).stop 2020-05-18T21:34:29.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.942+0000 7fa225cad700 1 -- 172.21.15.63:0/2872235289 shutdown_connections 2020-05-18T21:34:29.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.942+0000 7fa225cad700 1 --2- 172.21.15.63:0/2872235289 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa20004f940 0x7fa200051e00 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:29.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.942+0000 7fa225cad700 1 --2- 172.21.15.63:0/2872235289 >> v2:172.21.15.155:3300/0 conn(0x7fa2200b6410 0x7fa220073cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:29.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.942+0000 7fa225cad700 1 --2- 172.21.15.63:0/2872235289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2200b5cb0 0x7fa2200b3930 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:29.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.942+0000 7fa225cad700 1 -- 172.21.15.63:0/2872235289 >> 172.21.15.63:0/2872235289 conn(0x7fa220069b70 msgr2=0x7fa220133c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:29.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.942+0000 7fa225cad700 1 -- 172.21.15.63:0/2872235289 shutdown_connections 2020-05-18T21:34:29.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:29.942+0000 7fa225cad700 1 -- 172.21.15.63:0/2872235289 wait complete. 2020-05-18T21:34:29.948 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.1 2020-05-18T21:34:29.959 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:34:30.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55e9949700 1 Processor -- start 2020-05-18T21:34:30.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55e9949700 1 -- start start 2020-05-18T21:34:30.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55e9949700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55e40b5cb0 0x7f55e40b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:30.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55e9949700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55e4151bc0 0x7f55e4152030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:30.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55e9949700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e4025500 con 0x7f55e40b6410 2020-05-18T21:34:30.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55e9949700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e4064ee0 con 0x7f55e40b5cb0 2020-05-18T21:34:30.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55e9949700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e40b67f0 con 0x7f55e4151bc0 2020-05-18T21:34:30.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55e9148700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f55e40b6410 0x7f55e4061af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35894/0 (socket says 172.21.15.63:35894) 2020-05-18T21:34:30.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55e9148700 1 -- 172.21.15.63:0/4062432510 learned_addr learned my addr 172.21.15.63:0/4062432510 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:30.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55e8947700 1 --2- 172.21.15.63:0/4062432510 >> v2:172.21.15.155:3300/0 conn(0x7f55e40b5cb0 0x7f55e40b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:30.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55eabab700 1 --2- 172.21.15.63:0/4062432510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55e4151bc0 0x7f55e4152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:30.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55dbfff700 1 -- 172.21.15.63:0/4062432510 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905721991 0 0) 0x7f55e4025500 con 0x7f55e40b6410 2020-05-18T21:34:30.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55dbfff700 1 -- 172.21.15.63:0/4062432510 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55d0003270 con 0x7f55e40b6410 2020-05-18T21:34:30.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55e8947700 1 -- 172.21.15.63:0/4062432510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55e4151bc0 msgr2=0x7f55e4152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:30.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55e8947700 1 --2- 172.21.15.63:0/4062432510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55e4151bc0 0x7f55e4152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:30.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55e8947700 1 -- 172.21.15.63:0/4062432510 >> v1:172.21.15.63:6789/0 conn(0x7f55e40b6410 legacy=0x7f55e4061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:30.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55e8947700 1 -- 172.21.15.63:0/4062432510 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e4025180 con 0x7f55e40b5cb0 2020-05-18T21:34:30.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55eabab700 1 --2- 172.21.15.63:0/4062432510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55e4151bc0 0x7f55e4152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:30.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55e8947700 1 --2- 172.21.15.63:0/4062432510 >> v2:172.21.15.155:3300/0 conn(0x7f55e40b5cb0 0x7f55e40b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f55d4002f70 tx=0x7f55d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55e8947700 1 --2- 172.21.15.63:0/4062432510 >> v2:172.21.15.155:3300/0 conn(0x7f55e40b5cb0 0x7f55e40b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f55d4002f70 tx=0x7f55d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.078+0000 7f55e8947700 1 --2- 172.21.15.63:0/4062432510 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e40b5cb0 0x7f55e40b6cd0 secure :-1 s=READY pgs=1097 cs=0 l=1 rx=0x7f55d4002f70 tx=0x7f55d4007a80).ready entity=mon.1 client_cookie=d8685f3bf6eaa9d0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:30.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.082+0000 7f55e8947700 1 --2- 172.21.15.63:0/4062432510 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e40b5cb0 0x7f55e40b6cd0 secure :-1 s=THROTTLE_DONE pgs=1097 cs=0 l=1 rx=0x7f55d4002f70 tx=0x7f55d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.082+0000 7f55dbfff700 1 -- 172.21.15.63:0/4062432510 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55d4008e80 con 0x7f55e40b5cb0 2020-05-18T21:34:30.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.082+0000 7f55e8947700 1 --2- 172.21.15.63:0/4062432510 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e40b5cb0 0x7f55e40b6cd0 secure :-1 s=THROTTLE_DONE pgs=1097 cs=0 l=1 rx=0x7f55d4002f70 tx=0x7f55d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.082+0000 7f55e8947700 1 --2- 172.21.15.63:0/4062432510 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e40b5cb0 0x7f55e40b6cd0 secure :-1 s=THROTTLE_DONE pgs=1097 cs=0 l=1 rx=0x7f55d4002f70 tx=0x7f55d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.082+0000 7f55dbfff700 1 -- 172.21.15.63:0/4062432510 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d4011540 con 0x7f55e40b5cb0 2020-05-18T21:34:30.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.082+0000 7f55dbfff700 1 -- 172.21.15.63:0/4062432510 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55d4011960 con 0x7f55e40b5cb0 2020-05-18T21:34:30.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.082+0000 7f55e9949700 1 -- 172.21.15.63:0/4062432510 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e40b5cb0 msgr2=0x7f55e40b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:30.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.082+0000 7f55e9949700 1 --2- 172.21.15.63:0/4062432510 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e40b5cb0 0x7f55e40b6cd0 secure :-1 s=READY pgs=1097 cs=0 l=1 rx=0x7f55d4002f70 tx=0x7f55d4007a80).stop 2020-05-18T21:34:30.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.082+0000 7f55e9949700 1 -- 172.21.15.63:0/4062432510 shutdown_connections 2020-05-18T21:34:30.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.082+0000 7f55e9949700 1 --2- 172.21.15.63:0/4062432510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55e4151bc0 0x7f55e4152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:30.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.082+0000 7f55e9949700 1 --2- 172.21.15.63:0/4062432510 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55e40b5cb0 0x7f55e40b6cd0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:30.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.082+0000 7f55e9949700 1 -- 172.21.15.63:0/4062432510 >> 172.21.15.63:0/4062432510 conn(0x7f55e4069b70 msgr2=0x7f55e4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:30.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.082+0000 7f55e9949700 1 -- 172.21.15.63:0/4062432510 shutdown_connections 2020-05-18T21:34:30.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.082+0000 7f55e9949700 1 -- 172.21.15.63:0/4062432510 wait complete. 2020-05-18T21:34:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e9949700 1 Processor -- start 2020-05-18T21:34:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e9949700 1 -- start start 2020-05-18T21:34:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e9949700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f55e40b6410 0x7f55e40b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e9949700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e407f390 con 0x7f55e40b5cb0 2020-05-18T21:34:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e9949700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e407f630 con 0x7f55e4151bc0 2020-05-18T21:34:30.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e9949700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e4071380 con 0x7f55e40b6410 2020-05-18T21:34:30.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e9148700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f55e40b5cb0 0x7f55e40af660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35900/0 (socket says 172.21.15.63:35900) 2020-05-18T21:34:30.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e9148700 1 -- 172.21.15.63:0/1126231465 learned_addr learned my addr 172.21.15.63:0/1126231465 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:30.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e8947700 1 --2- 172.21.15.63:0/1126231465 >> v2:172.21.15.63:3300/0 conn(0x7f55e40b6410 0x7f55e40b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:30.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55d9ffb700 1 -- 172.21.15.63:0/1126231465 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337187847 0 0) 0x7f55e407f390 con 0x7f55e40b5cb0 2020-05-18T21:34:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55d9ffb700 1 -- 172.21.15.63:0/1126231465 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55c4003270 con 0x7f55e40b5cb0 2020-05-18T21:34:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55d9ffb700 1 -- 172.21.15.63:0/1126231465 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563832482 0 0) 0x7f55e407f630 con 0x7f55e4151bc0 2020-05-18T21:34:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e8947700 1 -- 172.21.15.63:0/1126231465 >> v1:172.21.15.155:6789/0 conn(0x7f55e4151bc0 legacy=0x7f55e4071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e8947700 1 -- 172.21.15.63:0/1126231465 >> v1:172.21.15.63:6789/0 conn(0x7f55e40b5cb0 legacy=0x7f55e40af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e8947700 1 -- 172.21.15.63:0/1126231465 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e40afd70 con 0x7f55e40b6410 2020-05-18T21:34:30.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e8947700 1 --2- 172.21.15.63:0/1126231465 >> v2:172.21.15.63:3300/0 conn(0x7f55e40b6410 0x7f55e40b3bd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f55e0001a60 tx=0x7f55d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e8947700 1 --2- 172.21.15.63:0/1126231465 >> v2:172.21.15.63:3300/0 conn(0x7f55e40b6410 0x7f55e40b3bd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f55e0001a60 tx=0x7f55d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e8947700 1 --2- 172.21.15.63:0/1126231465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55e40b6410 0x7f55e40b3bd0 secure :-1 s=READY pgs=1670 cs=0 l=1 rx=0x7f55e0001a60 tx=0x7f55d4007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:30.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e8947700 1 --2- 172.21.15.63:0/1126231465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55e40b6410 0x7f55e40b3bd0 secure :-1 s=THROTTLE_DONE pgs=1670 cs=0 l=1 rx=0x7f55e0001a60 tx=0x7f55d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55d9ffb700 1 -- 172.21.15.63:0/1126231465 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55e00018c0 con 0x7f55e40b6410 2020-05-18T21:34:30.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e8947700 1 --2- 172.21.15.63:0/1126231465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55e40b6410 0x7f55e40b3bd0 secure :-1 s=THROTTLE_DONE pgs=1670 cs=0 l=1 rx=0x7f55e0001a60 tx=0x7f55d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e8947700 1 --2- 172.21.15.63:0/1126231465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55e40b6410 0x7f55e40b3bd0 secure :-1 s=THROTTLE_DONE pgs=1670 cs=0 l=1 rx=0x7f55e0001a60 tx=0x7f55d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55d9ffb700 1 -- 172.21.15.63:0/1126231465 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d4011660 con 0x7f55e40b6410 2020-05-18T21:34:30.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e9949700 1 -- 172.21.15.63:0/1126231465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e4125e70 con 0x7f55e40b6410 2020-05-18T21:34:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55d9ffb700 1 -- 172.21.15.63:0/1126231465 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55d40119c0 con 0x7f55e40b6410 2020-05-18T21:34:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.086+0000 7f55e9949700 1 -- 172.21.15.63:0/1126231465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e4126320 con 0x7f55e40b6410 2020-05-18T21:34:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.090+0000 7f55e8947700 1 --2- 172.21.15.63:0/1126231465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55e40b6410 0x7f55e40b3bd0 secure :-1 s=THROTTLE_DONE pgs=1670 cs=0 l=1 rx=0x7f55e0001a60 tx=0x7f55d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.090+0000 7f55e9949700 1 -- 172.21.15.63:0/1126231465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e4071550 con 0x7f55e40b6410 2020-05-18T21:34:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.090+0000 7f55d9ffb700 1 -- 172.21.15.63:0/1126231465 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f55d4007170 con 0x7f55e40b6410 2020-05-18T21:34:30.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.090+0000 7f55e8947700 1 --2- 172.21.15.63:0/1126231465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55e40b6410 0x7f55e40b3bd0 secure :-1 s=THROTTLE_DONE pgs=1670 cs=0 l=1 rx=0x7f55e0001a60 tx=0x7f55d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.090+0000 7f55d9ffb700 1 --2- 172.21.15.63:0/1126231465 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55c404fd50 0x7f55c4052210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:30.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.090+0000 7f55d9ffb700 1 -- 172.21.15.63:0/1126231465 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f55d4063cb0 con 0x7f55e40b6410 2020-05-18T21:34:30.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.090+0000 7f55e9148700 1 --2- 172.21.15.63:0/1126231465 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55c404fd50 0x7f55c4052210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:30.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.090+0000 7f55e9148700 1 --2- 172.21.15.63:0/1126231465 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55c404fd50 0x7f55c4052210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f55e0001150 tx=0x7f55e0009e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.090+0000 7f55e9148700 1 --2- 172.21.15.63:0/1126231465 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55c404fd50 0x7f55c4052210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f55e0001150 tx=0x7f55e0009e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.090+0000 7f55e9148700 1 --2- 172.21.15.63:0/1126231465 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55c404fd50 0x7f55c4052210 secure :-1 s=READY pgs=646 cs=0 l=1 rx=0x7f55e0001150 tx=0x7f55e0009e10).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:30.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.098+0000 7f55e8947700 1 --2- 172.21.15.63:0/1126231465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55e40b6410 0x7f55e40b3bd0 secure :-1 s=THROTTLE_DONE pgs=1670 cs=0 l=1 rx=0x7f55e0001a60 tx=0x7f55d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.098+0000 7f55d9ffb700 1 -- 172.21.15.63:0/1126231465 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f55d403e160 con 0x7f55e40b6410 2020-05-18T21:34:30.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.254+0000 7f55e9949700 1 -- 172.21.15.63:0/1126231465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f55e40569e0 con 0x7f55e40b6410 2020-05-18T21:34:30.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.258+0000 7f55e8947700 1 --2- 172.21.15.63:0/1126231465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55e40b6410 0x7f55e40b3bd0 secure :-1 s=THROTTLE_DONE pgs=1670 cs=0 l=1 rx=0x7f55e0001a60 tx=0x7f55d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.258+0000 7f55d9ffb700 1 -- 172.21.15.63:0/1126231465 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v49) v1 ==== 184+0+0 (secure 0 0 0) 0x7f55d4041780 con 0x7f55e40b6410 2020-05-18T21:34:30.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.262+0000 7f55e9949700 1 -- 172.21.15.63:0/1126231465 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55c404fd50 msgr2=0x7f55c4052210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:30.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.262+0000 7f55e9949700 1 --2- 172.21.15.63:0/1126231465 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55c404fd50 0x7f55c4052210 secure :-1 s=READY pgs=646 cs=0 l=1 rx=0x7f55e0001150 tx=0x7f55e0009e10).stop 2020-05-18T21:34:30.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.262+0000 7f55e9949700 1 -- 172.21.15.63:0/1126231465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55e40b6410 msgr2=0x7f55e40b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:30.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.262+0000 7f55e9949700 1 --2- 172.21.15.63:0/1126231465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55e40b6410 0x7f55e40b3bd0 secure :-1 s=READY pgs=1670 cs=0 l=1 rx=0x7f55e0001a60 tx=0x7f55d4007a80).stop 2020-05-18T21:34:30.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.262+0000 7f55e9949700 1 -- 172.21.15.63:0/1126231465 shutdown_connections 2020-05-18T21:34:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.262+0000 7f55e9949700 1 --2- 172.21.15.63:0/1126231465 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f55c404fd50 0x7f55c4052210 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.262+0000 7f55e9949700 1 --2- 172.21.15.63:0/1126231465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55e40b6410 0x7f55e40b3bd0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.262+0000 7f55e9949700 1 -- 172.21.15.63:0/1126231465 >> 172.21.15.63:0/1126231465 conn(0x7f55e4069b70 msgr2=0x7f55e407fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.262+0000 7f55e9949700 1 -- 172.21.15.63:0/1126231465 shutdown_connections 2020-05-18T21:34:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.262+0000 7f55e9949700 1 -- 172.21.15.63:0/1126231465 wait complete. 2020-05-18T21:34:30.268 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.2 2020-05-18T21:34:30.277 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:34:30.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.382+0000 7f66ec65b700 1 Processor -- start 2020-05-18T21:34:30.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.382+0000 7f66ec65b700 1 -- start start 2020-05-18T21:34:30.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.382+0000 7f66ec65b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e40b8c30 0x7f66e41566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:30.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.382+0000 7f66ec65b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f66e4157260 0x7f66e415c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:30.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.382+0000 7f66ec65b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e4065a70 con 0x7f66e40ad070 2020-05-18T21:34:30.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.382+0000 7f66ec65b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e40801d0 con 0x7f66e4157260 2020-05-18T21:34:30.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.382+0000 7f66ec65b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40b5ae0 con 0x7f66e40b8c30 2020-05-18T21:34:30.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.382+0000 7f66eb3f9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f66e4157260 0x7f66e415c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:30.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.382+0000 7f66eb3f9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f66e4157260 0x7f66e415c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33722/0 (socket says 172.21.15.63:33722) 2020-05-18T21:34:30.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.382+0000 7f66eb3f9700 1 -- 172.21.15.63:0/2623446286 learned_addr learned my addr 172.21.15.63:0/2623446286 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:30.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.382+0000 7f66eabf8700 1 --2- 172.21.15.63:0/2623446286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e40b8c30 0x7f66e41566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:30.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.382+0000 7f66eb3f9700 1 -- 172.21.15.63:0/2623446286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e40b8c30 msgr2=0x7f66e41566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:30.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.382+0000 7f66eb3f9700 1 --2- 172.21.15.63:0/2623446286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e40b8c30 0x7f66e41566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:30.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.382+0000 7f66eb3f9700 1 -- 172.21.15.63:0/2623446286 >> v1:172.21.15.155:6789/0 conn(0x7f66e40ad070 legacy=0x7f66e4156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:30.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.382+0000 7f66eb3f9700 1 -- 172.21.15.63:0/2623446286 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e40b9010 con 0x7f66e4157260 2020-05-18T21:34:30.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.382+0000 7f66eb3f9700 1 --2- 172.21.15.63:0/2623446286 >> v2:172.21.15.63:3300/0 conn(0x7f66e4157260 0x7f66e415c9c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f66dc002f70 tx=0x7f66dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.386+0000 7f66eb3f9700 1 --2- 172.21.15.63:0/2623446286 >> v2:172.21.15.63:3300/0 conn(0x7f66e4157260 0x7f66e415c9c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f66dc002f70 tx=0x7f66dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.386+0000 7f66eb3f9700 1 --2- 172.21.15.63:0/2623446286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66e4157260 0x7f66e415c9c0 secure :-1 s=READY pgs=1671 cs=0 l=1 rx=0x7f66dc002f70 tx=0x7f66dc007a80).ready entity=mon.0 client_cookie=dd6563b6e158eb7c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:30.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.386+0000 7f66eb3f9700 1 --2- 172.21.15.63:0/2623446286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66e4157260 0x7f66e415c9c0 secure :-1 s=THROTTLE_DONE pgs=1671 cs=0 l=1 rx=0x7f66dc002f70 tx=0x7f66dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.386+0000 7f66e9bf6700 1 -- 172.21.15.63:0/2623446286 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66dc0116b0 con 0x7f66e4157260 2020-05-18T21:34:30.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.386+0000 7f66eb3f9700 1 --2- 172.21.15.63:0/2623446286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66e4157260 0x7f66e415c9c0 secure :-1 s=THROTTLE_DONE pgs=1671 cs=0 l=1 rx=0x7f66dc002f70 tx=0x7f66dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.386+0000 7f66e9bf6700 1 -- 172.21.15.63:0/2623446286 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc011810 con 0x7f66e4157260 2020-05-18T21:34:30.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.386+0000 7f66eb3f9700 1 --2- 172.21.15.63:0/2623446286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66e4157260 0x7f66e415c9c0 secure :-1 s=THROTTLE_DONE pgs=1671 cs=0 l=1 rx=0x7f66dc002f70 tx=0x7f66dc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.386+0000 7f66ec65b700 1 -- 172.21.15.63:0/2623446286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66e4157260 msgr2=0x7f66e415c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:30.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.386+0000 7f66e9bf6700 1 -- 172.21.15.63:0/2623446286 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66dc011c30 con 0x7f66e4157260 2020-05-18T21:34:30.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.386+0000 7f66ec65b700 1 --2- 172.21.15.63:0/2623446286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66e4157260 0x7f66e415c9c0 secure :-1 s=READY pgs=1671 cs=0 l=1 rx=0x7f66dc002f70 tx=0x7f66dc007a80).stop 2020-05-18T21:34:30.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.386+0000 7f66ec65b700 1 -- 172.21.15.63:0/2623446286 shutdown_connections 2020-05-18T21:34:30.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.386+0000 7f66ec65b700 1 --2- 172.21.15.63:0/2623446286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66e4157260 0x7f66e415c9c0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:30.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.386+0000 7f66ec65b700 1 --2- 172.21.15.63:0/2623446286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e40b8c30 0x7f66e41566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:30.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.386+0000 7f66ec65b700 1 -- 172.21.15.63:0/2623446286 >> 172.21.15.63:0/2623446286 conn(0x7f66e406a640 msgr2=0x7f66e40b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:30.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.386+0000 7f66ec65b700 1 -- 172.21.15.63:0/2623446286 shutdown_connections 2020-05-18T21:34:30.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.386+0000 7f66ec65b700 1 -- 172.21.15.63:0/2623446286 wait complete. 2020-05-18T21:34:30.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.386+0000 7f66ec65b700 1 Processor -- start 2020-05-18T21:34:30.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.386+0000 7f66ec65b700 1 -- start start 2020-05-18T21:34:30.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.386+0000 7f66ec65b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f66e40ad070 0x7f66e4064ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:30.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66ec65b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e4157260 0x7f66e40b6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:30.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66ec65b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e4072cc0 con 0x7f66e40b8c30 2020-05-18T21:34:30.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66ec65b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e4072f60 con 0x7f66e40ad070 2020-05-18T21:34:30.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66ec65b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40729b0 con 0x7f66e4157260 2020-05-18T21:34:30.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66eabf8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f66e40ad070 0x7f66e4064ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:30.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66eabf8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f66e40ad070 0x7f66e4064ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33726/0 (socket says 172.21.15.63:33726) 2020-05-18T21:34:30.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66eabf8700 1 -- 172.21.15.63:0/3679820128 learned_addr learned my addr 172.21.15.63:0/3679820128 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:30.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66eb3f9700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e4157260 0x7f66e40b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:30.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66eabf8700 1 -- 172.21.15.63:0/3679820128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e4157260 msgr2=0x7f66e40b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:30.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66eabf8700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e4157260 0x7f66e40b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:30.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66eabf8700 1 -- 172.21.15.63:0/3679820128 >> v1:172.21.15.63:6789/0 conn(0x7f66e40b8c30 legacy=0x7f66e4121180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:30.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66eabf8700 1 -- 172.21.15.63:0/3679820128 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e4073400 con 0x7f66e40ad070 2020-05-18T21:34:30.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66eabf8700 1 --2- 172.21.15.63:0/3679820128 >> v2:172.21.15.63:3300/0 conn(0x7f66e40ad070 0x7f66e4064ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f66d4003430 tx=0x7f66d4011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66eabf8700 1 --2- 172.21.15.63:0/3679820128 >> v2:172.21.15.63:3300/0 conn(0x7f66e40ad070 0x7f66e4064ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f66d4003430 tx=0x7f66d4011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66eabf8700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66e40ad070 0x7f66e4064ef0 secure :-1 s=READY pgs=1673 cs=0 l=1 rx=0x7f66d4003430 tx=0x7f66d4011050).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:30.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66eabf8700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66e40ad070 0x7f66e4064ef0 secure :-1 s=THROTTLE_DONE pgs=1673 cs=0 l=1 rx=0x7f66d4003430 tx=0x7f66d4011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66e37fe700 1 -- 172.21.15.63:0/3679820128 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66d4005e70 con 0x7f66e40ad070 2020-05-18T21:34:30.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66eabf8700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66e40ad070 0x7f66e4064ef0 secure :-1 s=THROTTLE_DONE pgs=1673 cs=0 l=1 rx=0x7f66d4003430 tx=0x7f66d4011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66eabf8700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66e40ad070 0x7f66e4064ef0 secure :-1 s=THROTTLE_DONE pgs=1673 cs=0 l=1 rx=0x7f66d4003430 tx=0x7f66d4011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66e37fe700 1 -- 172.21.15.63:0/3679820128 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d4007560 con 0x7f66e40ad070 2020-05-18T21:34:30.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66ec65b700 1 -- 172.21.15.63:0/3679820128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e40735b0 con 0x7f66e40ad070 2020-05-18T21:34:30.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66e37fe700 1 -- 172.21.15.63:0/3679820128 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66d4007940 con 0x7f66e40ad070 2020-05-18T21:34:30.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66ec65b700 1 -- 172.21.15.63:0/3679820128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e4073a60 con 0x7f66e40ad070 2020-05-18T21:34:30.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66eabf8700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66e40ad070 0x7f66e4064ef0 secure :-1 s=THROTTLE_DONE pgs=1673 cs=0 l=1 rx=0x7f66d4003430 tx=0x7f66d4011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66e37fe700 1 -- 172.21.15.63:0/3679820128 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f66d400e1a0 con 0x7f66e40ad070 2020-05-18T21:34:30.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66eabf8700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66e40ad070 0x7f66e4064ef0 secure :-1 s=THROTTLE_DONE pgs=1673 cs=0 l=1 rx=0x7f66d4003430 tx=0x7f66d4011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66ec65b700 1 -- 172.21.15.63:0/3679820128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e4072af0 con 0x7f66e40ad070 2020-05-18T21:34:30.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66e37fe700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f66c404f9d0 0x7f66c4051e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:30.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66e37fe700 1 -- 172.21.15.63:0/3679820128 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f66d4063c90 con 0x7f66e40ad070 2020-05-18T21:34:30.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.390+0000 7f66ea3f7700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f66c404f9d0 0x7f66c4051e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:30.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.394+0000 7f66ea3f7700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f66c404f9d0 0x7f66c4051e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f66e40b6cc0 tx=0x7f66d8002610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.394+0000 7f66ea3f7700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f66c404f9d0 0x7f66c4051e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f66e40b6cc0 tx=0x7f66d8002610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.394+0000 7f66ea3f7700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f66c404f9d0 0x7f66c4051e90 secure :-1 s=READY pgs=647 cs=0 l=1 rx=0x7f66e40b6cc0 tx=0x7f66d8002610).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:30.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.394+0000 7f66eabf8700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66e40ad070 0x7f66e4064ef0 secure :-1 s=THROTTLE_DONE pgs=1673 cs=0 l=1 rx=0x7f66d4003430 tx=0x7f66d4011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.394+0000 7f66e37fe700 1 -- 172.21.15.63:0/3679820128 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f66d403e020 con 0x7f66e40ad070 2020-05-18T21:34:30.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.550+0000 7f66ec65b700 1 -- 172.21.15.63:0/3679820128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f66e40569e0 con 0x7f66e40ad070 2020-05-18T21:34:30.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.558+0000 7f66eabf8700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66e40ad070 0x7f66e4064ef0 secure :-1 s=THROTTLE_DONE pgs=1673 cs=0 l=1 rx=0x7f66d4003430 tx=0x7f66d4011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.558+0000 7f66e37fe700 1 -- 172.21.15.63:0/3679820128 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v50) v1 ==== 184+0+0 (secure 0 0 0) 0x7f66d4041640 con 0x7f66e40ad070 2020-05-18T21:34:30.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.558+0000 7f66ec65b700 1 -- 172.21.15.63:0/3679820128 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f66c404f9d0 msgr2=0x7f66c4051e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:30.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.558+0000 7f66ec65b700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f66c404f9d0 0x7f66c4051e90 secure :-1 s=READY pgs=647 cs=0 l=1 rx=0x7f66e40b6cc0 tx=0x7f66d8002610).stop 2020-05-18T21:34:30.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.558+0000 7f66ec65b700 1 -- 172.21.15.63:0/3679820128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66e40ad070 msgr2=0x7f66e4064ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:30.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.558+0000 7f66ec65b700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66e40ad070 0x7f66e4064ef0 secure :-1 s=READY pgs=1673 cs=0 l=1 rx=0x7f66d4003430 tx=0x7f66d4011050).stop 2020-05-18T21:34:30.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.558+0000 7f66ec65b700 1 -- 172.21.15.63:0/3679820128 shutdown_connections 2020-05-18T21:34:30.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.558+0000 7f66ec65b700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f66c404f9d0 0x7f66c4051e90 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:30.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.558+0000 7f66ec65b700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e4157260 0x7f66e40b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:30.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.558+0000 7f66ec65b700 1 --2- 172.21.15.63:0/3679820128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66e40ad070 0x7f66e4064ef0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:30.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.558+0000 7f66ec65b700 1 -- 172.21.15.63:0/3679820128 >> 172.21.15.63:0/3679820128 conn(0x7f66e406a640 msgr2=0x7f66e4134cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:30.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.558+0000 7f66ec65b700 1 -- 172.21.15.63:0/3679820128 shutdown_connections 2020-05-18T21:34:30.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.558+0000 7f66ec65b700 1 -- 172.21.15.63:0/3679820128 wait complete. 2020-05-18T21:34:30.566 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.3 2020-05-18T21:34:30.576 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:34:30.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf82b6700 1 Processor -- start 2020-05-18T21:34:30.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf82b6700 1 -- start start 2020-05-18T21:34:30.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf82b6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffaf0066f20 0x7ffaf006a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:30.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf82b6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf00b79c0 con 0x7ffaf0149d90 2020-05-18T21:34:30.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf82b6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf00b7e90 con 0x7ffaf00b3d30 2020-05-18T21:34:30.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf82b6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf00b7bf0 con 0x7ffaf0066f20 2020-05-18T21:34:30.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf6052700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ffaf0149d90 0x7ffaf00b5670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35922/0 (socket says 172.21.15.63:35922) 2020-05-18T21:34:30.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf6052700 1 -- 172.21.15.63:0/1249312977 learned_addr learned my addr 172.21.15.63:0/1249312977 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:30.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5851700 1 --2- 172.21.15.63:0/1249312977 >> v2:172.21.15.155:3300/0 conn(0x7ffaf0066f20 0x7ffaf006a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:30.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5050700 1 -- 172.21.15.63:0/1249312977 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845773785 0 0) 0x7ffaf00b79c0 con 0x7ffaf0149d90 2020-05-18T21:34:30.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5050700 1 -- 172.21.15.63:0/1249312977 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffad8003270 con 0x7ffaf0149d90 2020-05-18T21:34:30.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5050700 1 -- 172.21.15.63:0/1249312977 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2119934416 0 0) 0x7ffad8003270 con 0x7ffaf0149d90 2020-05-18T21:34:30.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5050700 1 -- 172.21.15.63:0/1249312977 >> v2:172.21.15.155:3300/0 conn(0x7ffaf0066f20 msgr2=0x7ffaf006a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:30.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5050700 1 --2- 172.21.15.63:0/1249312977 >> v2:172.21.15.155:3300/0 conn(0x7ffaf0066f20 0x7ffaf006a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:30.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5050700 1 -- 172.21.15.63:0/1249312977 >> v1:172.21.15.155:6789/0 conn(0x7ffaf00b3d30 legacy=0x7ffaf00b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:30.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5050700 1 -- 172.21.15.63:0/1249312977 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf0061c00 con 0x7ffaf0149d90 2020-05-18T21:34:30.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5050700 1 -- 172.21.15.63:0/1249312977 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7ffae4001710 con 0x7ffaf0149d90 2020-05-18T21:34:30.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5050700 1 -- 172.21.15.63:0/1249312977 >> v1:172.21.15.63:6789/0 conn(0x7ffaf0149d90 legacy=0x7ffaf00b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:30.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5050700 1 --2- 172.21.15.63:0/1249312977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffad8003760 0x7ffad8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:30.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5050700 1 --2- 172.21.15.63:0/1249312977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffad8004010 0x7ffad8004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:30.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5050700 1 --2- 172.21.15.63:0/1249312977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffad8004a60 0x7ffad8004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:30.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5050700 1 -- 172.21.15.63:0/1249312977 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00b7bf0 con 0x7ffad8004010 2020-05-18T21:34:30.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5050700 1 -- 172.21.15.63:0/1249312977 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad800b7f0 con 0x7ffad8004a60 2020-05-18T21:34:30.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5050700 1 -- 172.21.15.63:0/1249312977 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad800b9b0 con 0x7ffad8003760 2020-05-18T21:34:30.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5851700 1 --2- 172.21.15.63:0/1249312977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffad8004010 0x7ffad8004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:30.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf6052700 1 --2- 172.21.15.63:0/1249312977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffad8003760 0x7ffad8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:30.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf6853700 1 --2- 172.21.15.63:0/1249312977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffad8004a60 0x7ffad8004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:30.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5851700 1 -- 172.21.15.63:0/1249312977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffad8003760 msgr2=0x7ffad8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:30.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5851700 1 --2- 172.21.15.63:0/1249312977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffad8003760 0x7ffad8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:30.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5851700 1 -- 172.21.15.63:0/1249312977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffad8004a60 msgr2=0x7ffad8004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:30.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5851700 1 --2- 172.21.15.63:0/1249312977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffad8004a60 0x7ffad8004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:30.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf6853700 1 -- 172.21.15.63:0/1249312977 reap_dead start 2020-05-18T21:34:30.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.674+0000 7ffaf5851700 1 -- 172.21.15.63:0/1249312977 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad8003270 con 0x7ffad8004010 2020-05-18T21:34:30.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.678+0000 7ffaf5851700 1 --2- 172.21.15.63:0/1249312977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffad8004010 0x7ffad8004510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffae8008cd0 tx=0x7ffae80081c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.678+0000 7ffaf5851700 1 --2- 172.21.15.63:0/1249312977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffad8004010 0x7ffad8004510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffae8008cd0 tx=0x7ffae80081c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.678+0000 7ffaf5851700 1 --2- 172.21.15.63:0/1249312977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffad8004010 0x7ffad8004510 secure :-1 s=READY pgs=1675 cs=0 l=1 rx=0x7ffae8008cd0 tx=0x7ffae80081c0).ready entity=mon.0 client_cookie=80525230b7dce2b0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:30.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.678+0000 7ffaf5851700 1 --2- 172.21.15.63:0/1249312977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffad8004010 0x7ffad8004510 secure :-1 s=THROTTLE_DONE pgs=1675 cs=0 l=1 rx=0x7ffae8008cd0 tx=0x7ffae80081c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.678+0000 7ffaf5050700 1 -- 172.21.15.63:0/1249312977 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffae8005a80 con 0x7ffad8004010 2020-05-18T21:34:30.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.678+0000 7ffaf5851700 1 --2- 172.21.15.63:0/1249312977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffad8004010 0x7ffad8004510 secure :-1 s=THROTTLE_DONE pgs=1675 cs=0 l=1 rx=0x7ffae8008cd0 tx=0x7ffae80081c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.678+0000 7ffaf5050700 1 -- 172.21.15.63:0/1249312977 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae8005be0 con 0x7ffad8004010 2020-05-18T21:34:30.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.678+0000 7ffaf5851700 1 --2- 172.21.15.63:0/1249312977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffad8004010 0x7ffad8004510 secure :-1 s=THROTTLE_DONE pgs=1675 cs=0 l=1 rx=0x7ffae8008cd0 tx=0x7ffae80081c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.678+0000 7ffaf5050700 1 -- 172.21.15.63:0/1249312977 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffae80110d0 con 0x7ffad8004010 2020-05-18T21:34:30.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.678+0000 7ffaf82b6700 1 -- 172.21.15.63:0/1249312977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffad8004010 msgr2=0x7ffad8004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:30.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.678+0000 7ffaf82b6700 1 --2- 172.21.15.63:0/1249312977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffad8004010 0x7ffad8004510 secure :-1 s=READY pgs=1675 cs=0 l=1 rx=0x7ffae8008cd0 tx=0x7ffae80081c0).stop 2020-05-18T21:34:30.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.678+0000 7ffaf82b6700 1 -- 172.21.15.63:0/1249312977 shutdown_connections 2020-05-18T21:34:30.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.678+0000 7ffaf82b6700 1 --2- 172.21.15.63:0/1249312977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffad8004010 0x7ffad8004510 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:30.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.678+0000 7ffaf82b6700 1 -- 172.21.15.63:0/1249312977 >> 172.21.15.63:0/1249312977 conn(0x7ffaf005b240 msgr2=0x7ffaf0069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:30.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.678+0000 7ffaf82b6700 1 -- 172.21.15.63:0/1249312977 shutdown_connections 2020-05-18T21:34:30.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.678+0000 7ffaf82b6700 1 -- 172.21.15.63:0/1249312977 wait complete. 2020-05-18T21:34:30.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf82b6700 1 Processor -- start 2020-05-18T21:34:30.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf82b6700 1 -- start start 2020-05-18T21:34:30.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf82b6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffaf015b580 0x7ffaf0161be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:30.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf82b6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf0157870 con 0x7ffad8004010 2020-05-18T21:34:30.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf82b6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf0157b10 con 0x7ffaf0158250 2020-05-18T21:34:30.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf82b6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf015ba30 con 0x7ffaf015b580 2020-05-18T21:34:30.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf6052700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ffad8004010 0x7ffaf009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35934/0 (socket says 172.21.15.63:35934) 2020-05-18T21:34:30.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf6052700 1 -- 172.21.15.63:0/2141707986 learned_addr learned my addr 172.21.15.63:0/2141707986 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:30.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf6853700 1 --2- 172.21.15.63:0/2141707986 >> v2:172.21.15.63:3300/0 conn(0x7ffaf015b580 0x7ffaf0161be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:30.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffae37fe700 1 -- 172.21.15.63:0/2141707986 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598938347 0 0) 0x7ffaf0157b10 con 0x7ffaf0158250 2020-05-18T21:34:30.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffae37fe700 1 -- 172.21.15.63:0/2141707986 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffad0002fe0 con 0x7ffaf0158250 2020-05-18T21:34:30.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf6853700 1 -- 172.21.15.63:0/2141707986 >> v1:172.21.15.155:6789/0 conn(0x7ffaf0158250 legacy=0x7ffaf014cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:30.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf6853700 1 -- 172.21.15.63:0/2141707986 >> v1:172.21.15.63:6789/0 conn(0x7ffad8004010 legacy=0x7ffaf009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:30.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffae37fe700 1 -- 172.21.15.63:0/2141707986 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925490861 0 0) 0x7ffaf0157870 con 0x7ffad8004010 2020-05-18T21:34:30.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf6853700 1 -- 172.21.15.63:0/2141707986 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf0157db0 con 0x7ffaf015b580 2020-05-18T21:34:30.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf6853700 1 --2- 172.21.15.63:0/2141707986 >> v2:172.21.15.63:3300/0 conn(0x7ffaf015b580 0x7ffaf0161be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffaf014b2b0 tx=0x7ffaec00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf6853700 1 --2- 172.21.15.63:0/2141707986 >> v2:172.21.15.63:3300/0 conn(0x7ffaf015b580 0x7ffaf0161be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffaf014b2b0 tx=0x7ffaec00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf6853700 1 --2- 172.21.15.63:0/2141707986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffaf015b580 0x7ffaf0161be0 secure :-1 s=READY pgs=1677 cs=0 l=1 rx=0x7ffaf014b2b0 tx=0x7ffaec00c4a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:30.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf6853700 1 --2- 172.21.15.63:0/2141707986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffaf015b580 0x7ffaf0161be0 secure :-1 s=THROTTLE_DONE pgs=1677 cs=0 l=1 rx=0x7ffaf014b2b0 tx=0x7ffaec00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffae37fe700 1 -- 172.21.15.63:0/2141707986 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaec00cd50 con 0x7ffaf015b580 2020-05-18T21:34:30.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf6853700 1 --2- 172.21.15.63:0/2141707986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffaf015b580 0x7ffaf0161be0 secure :-1 s=THROTTLE_DONE pgs=1677 cs=0 l=1 rx=0x7ffaf014b2b0 tx=0x7ffaec00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf6853700 1 --2- 172.21.15.63:0/2141707986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffaf015b580 0x7ffaf0161be0 secure :-1 s=THROTTLE_DONE pgs=1677 cs=0 l=1 rx=0x7ffaf014b2b0 tx=0x7ffaec00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffae37fe700 1 -- 172.21.15.63:0/2141707986 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaec010d90 con 0x7ffaf015b580 2020-05-18T21:34:30.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffae37fe700 1 -- 172.21.15.63:0/2141707986 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaec0110f0 con 0x7ffaf015b580 2020-05-18T21:34:30.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf82b6700 1 -- 172.21.15.63:0/2141707986 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf00b0360 con 0x7ffaf015b580 2020-05-18T21:34:30.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.682+0000 7ffaf82b6700 1 -- 172.21.15.63:0/2141707986 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf0157450 con 0x7ffaf015b580 2020-05-18T21:34:30.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.686+0000 7ffaf6853700 1 --2- 172.21.15.63:0/2141707986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffaf015b580 0x7ffaf0161be0 secure :-1 s=THROTTLE_DONE pgs=1677 cs=0 l=1 rx=0x7ffaf014b2b0 tx=0x7ffaec00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.686+0000 7ffaf82b6700 1 -- 172.21.15.63:0/2141707986 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf00569e0 con 0x7ffaf015b580 2020-05-18T21:34:30.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.686+0000 7ffae37fe700 1 -- 172.21.15.63:0/2141707986 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ffaec006520 con 0x7ffaf015b580 2020-05-18T21:34:30.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.686+0000 7ffaf6853700 1 --2- 172.21.15.63:0/2141707986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffaf015b580 0x7ffaf0161be0 secure :-1 s=THROTTLE_DONE pgs=1677 cs=0 l=1 rx=0x7ffaf014b2b0 tx=0x7ffaec00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.686+0000 7ffae37fe700 1 --2- 172.21.15.63:0/2141707986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffad004fca0 0x7ffad0052160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:30.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.686+0000 7ffae37fe700 1 -- 172.21.15.63:0/2141707986 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffaec063880 con 0x7ffaf015b580 2020-05-18T21:34:30.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.686+0000 7ffaf6052700 1 --2- 172.21.15.63:0/2141707986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffad004fca0 0x7ffad0052160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:30.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.686+0000 7ffaf6052700 1 --2- 172.21.15.63:0/2141707986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffad004fca0 0x7ffad0052160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffae4001420 tx=0x7ffaf0067390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.686+0000 7ffaf6052700 1 --2- 172.21.15.63:0/2141707986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffad004fca0 0x7ffad0052160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffae4001420 tx=0x7ffaf0067390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.686+0000 7ffaf6052700 1 --2- 172.21.15.63:0/2141707986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffad004fca0 0x7ffad0052160 secure :-1 s=READY pgs=648 cs=0 l=1 rx=0x7ffae4001420 tx=0x7ffaf0067390).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:30.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.694+0000 7ffaf6853700 1 --2- 172.21.15.63:0/2141707986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffaf015b580 0x7ffaf0161be0 secure :-1 s=THROTTLE_DONE pgs=1677 cs=0 l=1 rx=0x7ffaf014b2b0 tx=0x7ffaec00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.694+0000 7ffae37fe700 1 -- 172.21.15.63:0/2141707986 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ffaec03dbb0 con 0x7ffaf015b580 2020-05-18T21:34:30.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.842+0000 7ffaf82b6700 1 -- 172.21.15.63:0/2141707986 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffaf006a890 con 0x7ffaf015b580 2020-05-18T21:34:30.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.842+0000 7ffaf6853700 1 --2- 172.21.15.63:0/2141707986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffaf015b580 0x7ffaf0161be0 secure :-1 s=THROTTLE_DONE pgs=1677 cs=0 l=1 rx=0x7ffaf014b2b0 tx=0x7ffaec00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:30.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.842+0000 7ffae37fe700 1 -- 172.21.15.63:0/2141707986 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+2145 (secure 0 0 0) 0x7ffaec0411d0 con 0x7ffaf015b580 2020-05-18T21:34:30.847 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:30.847 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2906955228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2906955228},{"type":"v1","addr":"172.21.15.155:6835","nonce":2906955228}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":90}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:34:27.767123+0000","modified":"2020-05-18T21:34:28.769908+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9057":{"gid":9057,"name":"a","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/1197291437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1197291437},{"type":"v1","addr":"172.21.15.63:6833","nonce":1197291437}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-05-18T21:34:30.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.842+0000 7ffaf82b6700 1 -- 172.21.15.63:0/2141707986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffad004fca0 msgr2=0x7ffad0052160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:30.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.842+0000 7ffaf82b6700 1 --2- 172.21.15.63:0/2141707986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffad004fca0 0x7ffad0052160 secure :-1 s=READY pgs=648 cs=0 l=1 rx=0x7ffae4001420 tx=0x7ffaf0067390).stop 2020-05-18T21:34:30.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.842+0000 7ffaf82b6700 1 -- 172.21.15.63:0/2141707986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffaf015b580 msgr2=0x7ffaf0161be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:30.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.842+0000 7ffaf82b6700 1 --2- 172.21.15.63:0/2141707986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffaf015b580 0x7ffaf0161be0 secure :-1 s=READY pgs=1677 cs=0 l=1 rx=0x7ffaf014b2b0 tx=0x7ffaec00c4a0).stop 2020-05-18T21:34:30.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.842+0000 7ffaf82b6700 1 -- 172.21.15.63:0/2141707986 shutdown_connections 2020-05-18T21:34:30.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.842+0000 7ffaf82b6700 1 --2- 172.21.15.63:0/2141707986 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffad004fca0 0x7ffad0052160 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:30.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.842+0000 7ffaf82b6700 1 --2- 172.21.15.63:0/2141707986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffaf015b580 0x7ffaf0161be0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:30.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.842+0000 7ffaf82b6700 1 -- 172.21.15.63:0/2141707986 >> 172.21.15.63:0/2141707986 conn(0x7ffaf005b240 msgr2=0x7ffaf00b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:30.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.842+0000 7ffaf82b6700 1 -- 172.21.15.63:0/2141707986 shutdown_connections 2020-05-18T21:34:30.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:30.842+0000 7ffaf82b6700 1 -- 172.21.15.63:0/2141707986 wait complete. 2020-05-18T21:34:30.852 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 91 2020-05-18T21:34:31.060 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 91, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:34:27.767123+0000', 'modified': '2020-05-18T21:34:28.769908+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9057}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9057': {'gid': 9057, 'name': 'a', 'rank': 0, 'incarnation': 90, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/1197291437', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 1197291437}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 1197291437}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:34:31.061 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:34:31.062 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:34:31.177 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:34:31.177 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:34:31.177 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:34:31.178 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 9057, 2020-05-18T21:34:31.178 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:34:31.178 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:34:31.178 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 3.4048472470000002, 2020-05-18T21:34:31.178 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 91, 2020-05-18T21:34:31.179 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 123, 2020-05-18T21:34:31.179 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 122, 2020-05-18T21:34:31.179 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 7.7648903359999997 2020-05-18T21:34:31.179 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:34:31.186 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 9057, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.4048472470000002, "mdsmap_epoch": 91, "osdmap_epoch": 123, "osdmap_epoch_barrier": 122, "uptime": 7.7648903359999997 } 2020-05-18T21:34:31.187 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:34:31.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5f59e700 1 Processor -- start 2020-05-18T21:34:31.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5f59e700 1 -- start start 2020-05-18T21:34:31.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a600b4760 0x7f3a600648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:31.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5f59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3a60064d20 0x7f3a6014d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:31.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5f59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6014a330 con 0x7f3a6005f110 2020-05-18T21:34:31.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5f59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a6014a140 con 0x7f3a60064d20 2020-05-18T21:34:31.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5f59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6014a5d0 con 0x7f3a600b4760 2020-05-18T21:34:31.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5ed9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3a60064d20 0x7f3a6014d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:31.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5ed9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3a60064d20 0x7f3a6014d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33758/0 (socket says 172.21.15.63:33758) 2020-05-18T21:34:31.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5ed9d700 1 -- 172.21.15.63:0/2746489459 learned_addr learned my addr 172.21.15.63:0/2746489459 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:31.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5dd9b700 1 --2- 172.21.15.63:0/2746489459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a600b4760 0x7f3a600648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:31.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5ed9d700 1 -- 172.21.15.63:0/2746489459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a600b4760 msgr2=0x7f3a600648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:31.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2746489459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a600b4760 0x7f3a600648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:31.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5ed9d700 1 -- 172.21.15.63:0/2746489459 >> v1:172.21.15.155:6789/0 conn(0x7f3a6005f110 legacy=0x7f3a6014aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:31.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5ed9d700 1 -- 172.21.15.63:0/2746489459 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a60063430 con 0x7f3a60064d20 2020-05-18T21:34:31.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2746489459 >> v2:172.21.15.63:3300/0 conn(0x7f3a60064d20 0x7f3a6014d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3a60062a20 tx=0x7f3a58008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2746489459 >> v2:172.21.15.63:3300/0 conn(0x7f3a60064d20 0x7f3a6014d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3a60062a20 tx=0x7f3a58008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2746489459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a60064d20 0x7f3a6014d710 secure :-1 s=READY pgs=1678 cs=0 l=1 rx=0x7f3a60062a20 tx=0x7f3a58008ca0).ready entity=mon.0 client_cookie=f54f9b54a582f1b0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:31.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2746489459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a60064d20 0x7f3a6014d710 secure :-1 s=THROTTLE_DONE pgs=1678 cs=0 l=1 rx=0x7f3a60062a20 tx=0x7f3a58008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2746489459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a60064d20 0x7f3a6014d710 secure :-1 s=THROTTLE_DONE pgs=1678 cs=0 l=1 rx=0x7f3a60062a20 tx=0x7f3a58008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5d59a700 1 -- 172.21.15.63:0/2746489459 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a58011d80 con 0x7f3a60064d20 2020-05-18T21:34:31.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5d59a700 1 -- 172.21.15.63:0/2746489459 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5800a180 con 0x7f3a60064d20 2020-05-18T21:34:31.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2746489459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a60064d20 0x7f3a6014d710 secure :-1 s=THROTTLE_DONE pgs=1678 cs=0 l=1 rx=0x7f3a60062a20 tx=0x7f3a58008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5d59a700 1 -- 172.21.15.63:0/2746489459 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a5800a560 con 0x7f3a60064d20 2020-05-18T21:34:31.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5f59e700 1 -- 172.21.15.63:0/2746489459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a60064d20 msgr2=0x7f3a6014d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.282+0000 7f3a5f59e700 1 --2- 172.21.15.63:0/2746489459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a60064d20 0x7f3a6014d710 secure :-1 s=READY pgs=1678 cs=0 l=1 rx=0x7f3a60062a20 tx=0x7f3a58008ca0).stop 2020-05-18T21:34:31.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.286+0000 7f3a5f59e700 1 -- 172.21.15.63:0/2746489459 shutdown_connections 2020-05-18T21:34:31.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.286+0000 7f3a5f59e700 1 --2- 172.21.15.63:0/2746489459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a60064d20 0x7f3a6014d710 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:31.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.286+0000 7f3a5f59e700 1 --2- 172.21.15.63:0/2746489459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a600b4760 0x7f3a600648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:31.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.286+0000 7f3a5f59e700 1 -- 172.21.15.63:0/2746489459 >> 172.21.15.63:0/2746489459 conn(0x7f3a60069fc0 msgr2=0x7f3a6006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:31.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.286+0000 7f3a5f59e700 1 -- 172.21.15.63:0/2746489459 shutdown_connections 2020-05-18T21:34:31.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.286+0000 7f3a5f59e700 1 -- 172.21.15.63:0/2746489459 wait complete. 2020-05-18T21:34:31.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.286+0000 7f3a5f59e700 1 Processor -- start 2020-05-18T21:34:31.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.286+0000 7f3a5f59e700 1 -- start start 2020-05-18T21:34:31.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5f59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3a60064d20 0x7f3a6015b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:31.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5f59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6015ba70 con 0x7f3a6005f110 2020-05-18T21:34:31.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5f59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a60149520 con 0x7f3a600b4760 2020-05-18T21:34:31.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5f59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a601497c0 con 0x7f3a60064d20 2020-05-18T21:34:31.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5e59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3a6005f110 0x7f3a6015abb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35948/0 (socket says 172.21.15.63:35948) 2020-05-18T21:34:31.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5e59c700 1 -- 172.21.15.63:0/2756768240 learned_addr learned my addr 172.21.15.63:0/2756768240 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:31.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5dd9b700 1 --2- 172.21.15.63:0/2756768240 >> v2:172.21.15.155:3300/0 conn(0x7f3a60064d20 0x7f3a6015b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:31.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a4f7fe700 1 -- 172.21.15.63:0/2756768240 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012680934 0 0) 0x7f3a6015ba70 con 0x7f3a6005f110 2020-05-18T21:34:31.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a4f7fe700 1 -- 172.21.15.63:0/2756768240 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a3c002fe0 con 0x7f3a6005f110 2020-05-18T21:34:31.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a4f7fe700 1 -- 172.21.15.63:0/2756768240 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2167511362 0 0) 0x7f3a3c002fe0 con 0x7f3a6005f110 2020-05-18T21:34:31.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a4f7fe700 1 -- 172.21.15.63:0/2756768240 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3a6015ba70 con 0x7f3a6005f110 2020-05-18T21:34:31.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a4f7fe700 1 -- 172.21.15.63:0/2756768240 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f3a54002950 con 0x7f3a6005f110 2020-05-18T21:34:31.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a4f7fe700 1 -- 172.21.15.63:0/2756768240 >> v2:172.21.15.155:3300/0 conn(0x7f3a60064d20 msgr2=0x7f3a6015b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a4f7fe700 1 --2- 172.21.15.63:0/2756768240 >> v2:172.21.15.155:3300/0 conn(0x7f3a60064d20 0x7f3a6015b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:31.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a4f7fe700 1 -- 172.21.15.63:0/2756768240 >> v1:172.21.15.155:6789/0 conn(0x7f3a600b4760 legacy=0x7f3a60141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a4f7fe700 1 -- 172.21.15.63:0/2756768240 >> v1:172.21.15.63:6789/0 conn(0x7f3a6005f110 legacy=0x7f3a6015abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a4f7fe700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a3c004a80 0x7f3a3c004ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:31.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a4f7fe700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a3c0039a0 0x7f3a3c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:31.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a4f7fe700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a3c004280 0x7f3a3c005730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:31.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a4f7fe700 1 -- 172.21.15.63:0/2756768240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a601497c0 con 0x7f3a3c004280 2020-05-18T21:34:31.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a4f7fe700 1 -- 172.21.15.63:0/2756768240 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c004820 con 0x7f3a3c004a80 2020-05-18T21:34:31.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a4f7fe700 1 -- 172.21.15.63:0/2756768240 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c005bc0 con 0x7f3a3c0039a0 2020-05-18T21:34:31.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a3c004280 0x7f3a3c005730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:31.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5dd9b700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a3c0039a0 0x7f3a3c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:31.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5e59c700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a3c004a80 0x7f3a3c004ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:31.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5ed9d700 1 -- 172.21.15.63:0/2756768240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a3c0039a0 msgr2=0x7f3a3c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a3c0039a0 0x7f3a3c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:31.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5ed9d700 1 -- 172.21.15.63:0/2756768240 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a3c004a80 msgr2=0x7f3a3c004ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a3c004a80 0x7f3a3c004ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:31.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5ed9d700 1 -- 172.21.15.63:0/2756768240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6015b2c0 con 0x7f3a3c004280 2020-05-18T21:34:31.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5f59e700 1 -- 172.21.15.63:0/2756768240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a60149200 con 0x7f3a3c004280 2020-05-18T21:34:31.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5dd9b700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a3c0039a0 0x7f3a3c003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:34:31.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5e59c700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a3c004a80 0x7f3a3c004ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:34:31.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a3c004280 0x7f3a3c005730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3a60142f10 tx=0x7f3a60063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5f59e700 1 -- 172.21.15.63:0/2756768240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a60146360 con 0x7f3a3c004280 2020-05-18T21:34:31.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5ed9d700 1 -- 172.21.15.63:0/2756768240 reap_dead start 2020-05-18T21:34:31.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a3c004280 0x7f3a3c005730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3a60142f10 tx=0x7f3a60063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a3c004280 0x7f3a3c005730 secure :-1 s=READY pgs=1680 cs=0 l=1 rx=0x7f3a60142f10 tx=0x7f3a60063c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:31.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a3c004280 0x7f3a3c005730 secure :-1 s=THROTTLE_DONE pgs=1680 cs=0 l=1 rx=0x7f3a60142f10 tx=0x7f3a60063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a4f7fe700 1 -- 172.21.15.63:0/2756768240 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a5800ae80 con 0x7f3a3c004280 2020-05-18T21:34:31.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a3c004280 0x7f3a3c005730 secure :-1 s=THROTTLE_DONE pgs=1680 cs=0 l=1 rx=0x7f3a60142f10 tx=0x7f3a60063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a4f7fe700 1 -- 172.21.15.63:0/2756768240 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a58005c70 con 0x7f3a3c004280 2020-05-18T21:34:31.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a3c004280 0x7f3a3c005730 secure :-1 s=THROTTLE_DONE pgs=1680 cs=0 l=1 rx=0x7f3a60142f10 tx=0x7f3a60063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.290+0000 7f3a4f7fe700 1 -- 172.21.15.63:0/2756768240 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a58007170 con 0x7f3a3c004280 2020-05-18T21:34:31.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.294+0000 7f3a5f59e700 1 -- 172.21.15.63:0/2756768240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a38003380 con 0x7f3a3c004280 2020-05-18T21:34:31.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.294+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a3c004280 0x7f3a3c005730 secure :-1 s=THROTTLE_DONE pgs=1680 cs=0 l=1 rx=0x7f3a60142f10 tx=0x7f3a60063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.294+0000 7f3a4f7fe700 1 -- 172.21.15.63:0/2756768240 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3a580072d0 con 0x7f3a3c004280 2020-05-18T21:34:31.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.294+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a3c004280 0x7f3a3c005730 secure :-1 s=THROTTLE_DONE pgs=1680 cs=0 l=1 rx=0x7f3a60142f10 tx=0x7f3a60063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.294+0000 7f3a4f7fe700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a3c0538b0 0x7f3a3c055d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:31.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.294+0000 7f3a4f7fe700 1 -- 172.21.15.63:0/2756768240 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3a58064610 con 0x7f3a3c004280 2020-05-18T21:34:31.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.294+0000 7f3a5e59c700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a3c0538b0 0x7f3a3c055d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:31.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.294+0000 7f3a5e59c700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a3c0538b0 0x7f3a3c055d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3a54002660 tx=0x7f3a54008540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.294+0000 7f3a5e59c700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a3c0538b0 0x7f3a3c055d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3a54002660 tx=0x7f3a54008540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.294+0000 7f3a5e59c700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a3c0538b0 0x7f3a3c055d70 secure :-1 s=READY pgs=649 cs=0 l=1 rx=0x7f3a54002660 tx=0x7f3a54008540).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:31.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.302+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a3c004280 0x7f3a3c005730 secure :-1 s=THROTTLE_DONE pgs=1680 cs=0 l=1 rx=0x7f3a60142f10 tx=0x7f3a60063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.302+0000 7f3a4f7fe700 1 -- 172.21.15.63:0/2756768240 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3a5803eac0 con 0x7f3a3c004280 2020-05-18T21:34:31.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.414+0000 7f3a5f59e700 1 -- 172.21.15.63:0/2756768240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a38002210 con 0x7f3a3c004280 2020-05-18T21:34:31.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.418+0000 7f3a5ed9d700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a3c004280 0x7f3a3c005730 secure :-1 s=THROTTLE_DONE pgs=1680 cs=0 l=1 rx=0x7f3a60142f10 tx=0x7f3a60063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.418+0000 7f3a4f7fe700 1 -- 172.21.15.63:0/2756768240 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f3a580420e0 con 0x7f3a3c004280 2020-05-18T21:34:31.423 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:31.423 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":123,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:34:28.770580+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:34:26.108423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2020-05-18T21:34:26.753473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:34:31.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.418+0000 7f3a5f59e700 1 -- 172.21.15.63:0/2756768240 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a3c0538b0 msgr2=0x7f3a3c055d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.418+0000 7f3a5f59e700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a3c0538b0 0x7f3a3c055d70 secure :-1 s=READY pgs=649 cs=0 l=1 rx=0x7f3a54002660 tx=0x7f3a54008540).stop 2020-05-18T21:34:31.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.418+0000 7f3a5f59e700 1 -- 172.21.15.63:0/2756768240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a3c004280 msgr2=0x7f3a3c005730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.418+0000 7f3a5f59e700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a3c004280 0x7f3a3c005730 secure :-1 s=READY pgs=1680 cs=0 l=1 rx=0x7f3a60142f10 tx=0x7f3a60063c50).stop 2020-05-18T21:34:31.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.418+0000 7f3a5f59e700 1 -- 172.21.15.63:0/2756768240 shutdown_connections 2020-05-18T21:34:31.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.418+0000 7f3a5f59e700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a3c0538b0 0x7f3a3c055d70 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:31.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.418+0000 7f3a5f59e700 1 --2- 172.21.15.63:0/2756768240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a3c004280 0x7f3a3c005730 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:31.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.418+0000 7f3a5f59e700 1 -- 172.21.15.63:0/2756768240 >> 172.21.15.63:0/2756768240 conn(0x7f3a60069fc0 msgr2=0x7f3a60061870 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:31.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.418+0000 7f3a5f59e700 1 -- 172.21.15.63:0/2756768240 shutdown_connections 2020-05-18T21:34:31.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.418+0000 7f3a5f59e700 1 -- 172.21.15.63:0/2756768240 wait complete. 2020-05-18T21:34:31.435 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:34:26.108423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:34:26.753473+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:34:31.436 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:34:31.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.538+0000 7fa896491700 1 Processor -- start 2020-05-18T21:34:31.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.538+0000 7fa896491700 1 -- start start 2020-05-18T21:34:31.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa896491700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa8900bc8d0 0x7fa890060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:31.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa896491700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa890145e30 0x7fa890142f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:31.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa896491700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa890143380 0x7fa89012e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:31.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa896491700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa890146e00 con 0x7fa8900bc8d0 2020-05-18T21:34:31.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa896491700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa890146420 con 0x7fa890145e30 2020-05-18T21:34:31.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa896491700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8901466c0 con 0x7fa890143380 2020-05-18T21:34:31.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa89548f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa8900bc8d0 0x7fa890060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:31.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa89548f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa8900bc8d0 0x7fa890060b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33776/0 (socket says 172.21.15.63:33776) 2020-05-18T21:34:31.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa89548f700 1 -- 172.21.15.63:0/3187152486 learned_addr learned my addr 172.21.15.63:0/3187152486 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:31.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa895c90700 1 --2- 172.21.15.63:0/3187152486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa890143380 0x7fa89012e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:31.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa894c8e700 1 --2- 172.21.15.63:0/3187152486 >> v2:172.21.15.155:3300/0 conn(0x7fa890145e30 0x7fa890142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:31.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa89548f700 1 -- 172.21.15.63:0/3187152486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa890143380 msgr2=0x7fa89012e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:31.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa89548f700 1 --2- 172.21.15.63:0/3187152486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa890143380 0x7fa89012e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:31.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa89548f700 1 -- 172.21.15.63:0/3187152486 >> v2:172.21.15.155:3300/0 conn(0x7fa890145e30 msgr2=0x7fa890142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:31.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa89548f700 1 --2- 172.21.15.63:0/3187152486 >> v2:172.21.15.155:3300/0 conn(0x7fa890145e30 0x7fa890142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:31.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa89548f700 1 -- 172.21.15.63:0/3187152486 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa890146960 con 0x7fa8900bc8d0 2020-05-18T21:34:31.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa89548f700 1 --2- 172.21.15.63:0/3187152486 >> v2:172.21.15.63:3300/0 conn(0x7fa8900bc8d0 0x7fa890060b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa88c002f70 tx=0x7fa88c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa89548f700 1 --2- 172.21.15.63:0/3187152486 >> v2:172.21.15.63:3300/0 conn(0x7fa8900bc8d0 0x7fa890060b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa88c002f70 tx=0x7fa88c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa89548f700 1 --2- 172.21.15.63:0/3187152486 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8900bc8d0 0x7fa890060b00 secure :-1 s=READY pgs=1681 cs=0 l=1 rx=0x7fa88c002f70 tx=0x7fa88c007a80).ready entity=mon.0 client_cookie=74a647d4ced48278 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:31.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa89548f700 1 --2- 172.21.15.63:0/3187152486 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8900bc8d0 0x7fa890060b00 secure :-1 s=THROTTLE_DONE pgs=1681 cs=0 l=1 rx=0x7fa88c002f70 tx=0x7fa88c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa87bfff700 1 -- 172.21.15.63:0/3187152486 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa88c011600 con 0x7fa8900bc8d0 2020-05-18T21:34:31.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa89548f700 1 --2- 172.21.15.63:0/3187152486 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8900bc8d0 0x7fa890060b00 secure :-1 s=THROTTLE_DONE pgs=1681 cs=0 l=1 rx=0x7fa88c002f70 tx=0x7fa88c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa87bfff700 1 -- 172.21.15.63:0/3187152486 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c011760 con 0x7fa8900bc8d0 2020-05-18T21:34:31.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa89548f700 1 --2- 172.21.15.63:0/3187152486 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8900bc8d0 0x7fa890060b00 secure :-1 s=THROTTLE_DONE pgs=1681 cs=0 l=1 rx=0x7fa88c002f70 tx=0x7fa88c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa896491700 1 -- 172.21.15.63:0/3187152486 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8900bc8d0 msgr2=0x7fa890060b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa87bfff700 1 -- 172.21.15.63:0/3187152486 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa88c011b80 con 0x7fa8900bc8d0 2020-05-18T21:34:31.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.542+0000 7fa896491700 1 --2- 172.21.15.63:0/3187152486 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8900bc8d0 0x7fa890060b00 secure :-1 s=READY pgs=1681 cs=0 l=1 rx=0x7fa88c002f70 tx=0x7fa88c007a80).stop 2020-05-18T21:34:31.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.546+0000 7fa896491700 1 -- 172.21.15.63:0/3187152486 shutdown_connections 2020-05-18T21:34:31.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.546+0000 7fa896491700 1 --2- 172.21.15.63:0/3187152486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa890143380 0x7fa89012e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:31.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.546+0000 7fa896491700 1 --2- 172.21.15.63:0/3187152486 >> v2:172.21.15.155:3300/0 conn(0x7fa890145e30 0x7fa890142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:31.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.546+0000 7fa896491700 1 --2- 172.21.15.63:0/3187152486 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8900bc8d0 0x7fa890060b00 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:31.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.546+0000 7fa896491700 1 -- 172.21.15.63:0/3187152486 >> 172.21.15.63:0/3187152486 conn(0x7fa89005f3b0 msgr2=0x7fa89005f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:31.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.546+0000 7fa896491700 1 -- 172.21.15.63:0/3187152486 shutdown_connections 2020-05-18T21:34:31.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.546+0000 7fa896491700 1 -- 172.21.15.63:0/3187152486 wait complete. 2020-05-18T21:34:31.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.546+0000 7fa896491700 1 Processor -- start 2020-05-18T21:34:31.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.546+0000 7fa896491700 1 -- start start 2020-05-18T21:34:31.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.546+0000 7fa896491700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa8900bc8d0 0x7fa890156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:31.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.546+0000 7fa896491700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa890145e30 0x7fa8901409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:31.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.546+0000 7fa896491700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa890153030 con 0x7fa890143380 2020-05-18T21:34:31.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.546+0000 7fa896491700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8901532d0 con 0x7fa890145e30 2020-05-18T21:34:31.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.546+0000 7fa896491700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa890141e50 con 0x7fa8900bc8d0 2020-05-18T21:34:31.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.546+0000 7fa895c90700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa890145e30 0x7fa8901409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:31.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.546+0000 7fa894c8e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa890143380 0x7fa890153770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35968/0 (socket says 172.21.15.63:35968) 2020-05-18T21:34:31.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.546+0000 7fa894c8e700 1 -- 172.21.15.63:0/1722099703 learned_addr learned my addr 172.21.15.63:0/1722099703 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:31.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa89548f700 1 --2- 172.21.15.63:0/1722099703 >> v2:172.21.15.155:3300/0 conn(0x7fa8900bc8d0 0x7fa890156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:31.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa882ffd700 1 -- 172.21.15.63:0/1722099703 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1725717953 0 0) 0x7fa890153030 con 0x7fa890143380 2020-05-18T21:34:31.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa895c90700 1 -- 172.21.15.63:0/1722099703 >> v2:172.21.15.155:3300/0 conn(0x7fa8900bc8d0 msgr2=0x7fa890156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa895c90700 1 --2- 172.21.15.63:0/1722099703 >> v2:172.21.15.155:3300/0 conn(0x7fa8900bc8d0 0x7fa890156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:31.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa895c90700 1 -- 172.21.15.63:0/1722099703 >> v1:172.21.15.63:6789/0 conn(0x7fa890143380 legacy=0x7fa890153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa895c90700 1 -- 172.21.15.63:0/1722099703 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8900bbb90 con 0x7fa890145e30 2020-05-18T21:34:31.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa89548f700 1 --2- 172.21.15.63:0/1722099703 >> v2:172.21.15.155:3300/0 conn(0x7fa8900bc8d0 0x7fa890156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:31.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa895c90700 1 --2- 172.21.15.63:0/1722099703 >> v2:172.21.15.63:3300/0 conn(0x7fa890145e30 0x7fa8901409a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa8880032f0 tx=0x7fa888010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa895c90700 1 --2- 172.21.15.63:0/1722099703 >> v2:172.21.15.63:3300/0 conn(0x7fa890145e30 0x7fa8901409a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa8880032f0 tx=0x7fa888010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa895c90700 1 --2- 172.21.15.63:0/1722099703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa890145e30 0x7fa8901409a0 secure :-1 s=READY pgs=1683 cs=0 l=1 rx=0x7fa8880032f0 tx=0x7fa888010f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:31.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa895c90700 1 --2- 172.21.15.63:0/1722099703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa890145e30 0x7fa8901409a0 secure :-1 s=THROTTLE_DONE pgs=1683 cs=0 l=1 rx=0x7fa8880032f0 tx=0x7fa888010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa882ffd700 1 -- 172.21.15.63:0/1722099703 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa888005a80 con 0x7fa890145e30 2020-05-18T21:34:31.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa895c90700 1 --2- 172.21.15.63:0/1722099703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa890145e30 0x7fa8901409a0 secure :-1 s=THROTTLE_DONE pgs=1683 cs=0 l=1 rx=0x7fa8880032f0 tx=0x7fa888010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa895c90700 1 --2- 172.21.15.63:0/1722099703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa890145e30 0x7fa8901409a0 secure :-1 s=THROTTLE_DONE pgs=1683 cs=0 l=1 rx=0x7fa8880032f0 tx=0x7fa888010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa882ffd700 1 -- 172.21.15.63:0/1722099703 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa888005be0 con 0x7fa890145e30 2020-05-18T21:34:31.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa896491700 1 -- 172.21.15.63:0/1722099703 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8900bbe60 con 0x7fa890145e30 2020-05-18T21:34:31.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa882ffd700 1 -- 172.21.15.63:0/1722099703 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8880129c0 con 0x7fa890145e30 2020-05-18T21:34:31.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa896491700 1 -- 172.21.15.63:0/1722099703 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8901524e0 con 0x7fa890145e30 2020-05-18T21:34:31.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa895c90700 1 --2- 172.21.15.63:0/1722099703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa890145e30 0x7fa8901409a0 secure :-1 s=THROTTLE_DONE pgs=1683 cs=0 l=1 rx=0x7fa8880032f0 tx=0x7fa888010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa896491700 1 -- 172.21.15.63:0/1722099703 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8900569e0 con 0x7fa890145e30 2020-05-18T21:34:31.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa882ffd700 1 -- 172.21.15.63:0/1722099703 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa888012bf0 con 0x7fa890145e30 2020-05-18T21:34:31.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.550+0000 7fa895c90700 1 --2- 172.21.15.63:0/1722099703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa890145e30 0x7fa8901409a0 secure :-1 s=THROTTLE_DONE pgs=1683 cs=0 l=1 rx=0x7fa8880032f0 tx=0x7fa888010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.554+0000 7fa882ffd700 1 --2- 172.21.15.63:0/1722099703 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa86c04f8b0 0x7fa86c051d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:31.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.554+0000 7fa882ffd700 1 -- 172.21.15.63:0/1722099703 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa888063b80 con 0x7fa890145e30 2020-05-18T21:34:31.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.554+0000 7fa89548f700 1 --2- 172.21.15.63:0/1722099703 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa86c04f8b0 0x7fa86c051d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:31.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.554+0000 7fa89548f700 1 --2- 172.21.15.63:0/1722099703 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa86c04f8b0 0x7fa86c051d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa88c002f70 tx=0x7fa88c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.554+0000 7fa89548f700 1 --2- 172.21.15.63:0/1722099703 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa86c04f8b0 0x7fa86c051d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa88c002f70 tx=0x7fa88c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.554+0000 7fa89548f700 1 --2- 172.21.15.63:0/1722099703 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa86c04f8b0 0x7fa86c051d70 secure :-1 s=READY pgs=650 cs=0 l=1 rx=0x7fa88c002f70 tx=0x7fa88c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:31.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.558+0000 7fa895c90700 1 --2- 172.21.15.63:0/1722099703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa890145e30 0x7fa8901409a0 secure :-1 s=THROTTLE_DONE pgs=1683 cs=0 l=1 rx=0x7fa8880032f0 tx=0x7fa888010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.558+0000 7fa882ffd700 1 -- 172.21.15.63:0/1722099703 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa88803df10 con 0x7fa890145e30 2020-05-18T21:34:31.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.674+0000 7fa896491700 1 -- 172.21.15.63:0/1722099703 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa8900008d0 con 0x7fa890145e30 2020-05-18T21:34:31.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.674+0000 7fa895c90700 1 --2- 172.21.15.63:0/1722099703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa890145e30 0x7fa8901409a0 secure :-1 s=THROTTLE_DONE pgs=1683 cs=0 l=1 rx=0x7fa8880032f0 tx=0x7fa888010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.674+0000 7fa882ffd700 1 -- 172.21.15.63:0/1722099703 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v123) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa888041530 con 0x7fa890145e30 2020-05-18T21:34:31.681 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:34:31.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.678+0000 7fa896491700 1 -- 172.21.15.63:0/1722099703 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa86c04f8b0 msgr2=0x7fa86c051d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.678+0000 7fa896491700 1 --2- 172.21.15.63:0/1722099703 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa86c04f8b0 0x7fa86c051d70 secure :-1 s=READY pgs=650 cs=0 l=1 rx=0x7fa88c002f70 tx=0x7fa88c007a80).stop 2020-05-18T21:34:31.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.678+0000 7fa896491700 1 -- 172.21.15.63:0/1722099703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa890145e30 msgr2=0x7fa8901409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.678+0000 7fa896491700 1 --2- 172.21.15.63:0/1722099703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa890145e30 0x7fa8901409a0 secure :-1 s=READY pgs=1683 cs=0 l=1 rx=0x7fa8880032f0 tx=0x7fa888010f30).stop 2020-05-18T21:34:31.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.678+0000 7fa896491700 1 -- 172.21.15.63:0/1722099703 shutdown_connections 2020-05-18T21:34:31.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.678+0000 7fa896491700 1 --2- 172.21.15.63:0/1722099703 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa86c04f8b0 0x7fa86c051d70 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:31.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.678+0000 7fa896491700 1 --2- 172.21.15.63:0/1722099703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa890145e30 0x7fa8901409a0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:31.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.678+0000 7fa896491700 1 --2- 172.21.15.63:0/1722099703 >> v2:172.21.15.155:3300/0 conn(0x7fa8900bc8d0 0x7fa890156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:31.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.678+0000 7fa896491700 1 -- 172.21.15.63:0/1722099703 >> 172.21.15.63:0/1722099703 conn(0x7fa89005f3b0 msgr2=0x7fa8900b81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:31.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.678+0000 7fa896491700 1 -- 172.21.15.63:0/1722099703 shutdown_connections 2020-05-18T21:34:31.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.678+0000 7fa896491700 1 -- 172.21.15.63:0/1722099703 wait complete. 2020-05-18T21:34:31.693 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:34:31.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.798+0000 7fac6d78b700 1 Processor -- start 2020-05-18T21:34:31.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.798+0000 7fac6d78b700 1 -- start start 2020-05-18T21:34:31.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.798+0000 7fac6d78b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fac680b68d0 0x7fac681469b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:31.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.798+0000 7fac6d78b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac68145fd0 con 0x7fac680b99d0 2020-05-18T21:34:31.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.798+0000 7fac6d78b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac68146270 con 0x7fac68149d40 2020-05-18T21:34:31.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.798+0000 7fac6d78b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac68146510 con 0x7fac680b68d0 2020-05-18T21:34:31.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.798+0000 7fac677fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fac680b99d0 0x7fac680b8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35978/0 (socket says 172.21.15.63:35978) 2020-05-18T21:34:31.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.798+0000 7fac677fe700 1 -- 172.21.15.63:0/1042954462 learned_addr learned my addr 172.21.15.63:0/1042954462 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:31.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.798+0000 7fac67fff700 1 --2- 172.21.15.63:0/1042954462 >> v2:172.21.15.155:3300/0 conn(0x7fac680b68d0 0x7fac681469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:31.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.798+0000 7fac66ffd700 1 -- 172.21.15.63:0/1042954462 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067914443 0 0) 0x7fac68145fd0 con 0x7fac680b99d0 2020-05-18T21:34:31.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.798+0000 7fac66ffd700 1 -- 172.21.15.63:0/1042954462 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac54003270 con 0x7fac680b99d0 2020-05-18T21:34:31.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.798+0000 7fac66ffd700 1 -- 172.21.15.63:0/1042954462 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532495277 0 0) 0x7fac68146270 con 0x7fac68149d40 2020-05-18T21:34:31.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.798+0000 7fac66ffd700 1 -- 172.21.15.63:0/1042954462 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac68145fd0 con 0x7fac68149d40 2020-05-18T21:34:31.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.798+0000 7fac66ffd700 1 -- 172.21.15.63:0/1042954462 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3274211048 0 0) 0x7fac54003270 con 0x7fac680b99d0 2020-05-18T21:34:31.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac67fff700 1 -- 172.21.15.63:0/1042954462 >> v1:172.21.15.155:6789/0 conn(0x7fac68149d40 legacy=0x7fac68060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac67fff700 1 -- 172.21.15.63:0/1042954462 >> v1:172.21.15.63:6789/0 conn(0x7fac680b99d0 legacy=0x7fac680b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac67fff700 1 -- 172.21.15.63:0/1042954462 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6814a1f0 con 0x7fac680b68d0 2020-05-18T21:34:31.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac67fff700 1 --2- 172.21.15.63:0/1042954462 >> v2:172.21.15.155:3300/0 conn(0x7fac680b68d0 0x7fac681469b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fac58001110 tx=0x7fac5c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac67fff700 1 --2- 172.21.15.63:0/1042954462 >> v2:172.21.15.155:3300/0 conn(0x7fac680b68d0 0x7fac681469b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fac58001110 tx=0x7fac5c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac67fff700 1 --2- 172.21.15.63:0/1042954462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac680b68d0 0x7fac681469b0 secure :-1 s=READY pgs=1105 cs=0 l=1 rx=0x7fac58001110 tx=0x7fac5c007a80).ready entity=mon.1 client_cookie=99196816419e0297 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:31.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac67fff700 1 --2- 172.21.15.63:0/1042954462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac680b68d0 0x7fac681469b0 secure :-1 s=THROTTLE_DONE pgs=1105 cs=0 l=1 rx=0x7fac58001110 tx=0x7fac5c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac66ffd700 1 -- 172.21.15.63:0/1042954462 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac58001710 con 0x7fac680b68d0 2020-05-18T21:34:31.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac67fff700 1 --2- 172.21.15.63:0/1042954462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac680b68d0 0x7fac681469b0 secure :-1 s=THROTTLE_DONE pgs=1105 cs=0 l=1 rx=0x7fac58001110 tx=0x7fac5c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac66ffd700 1 -- 172.21.15.63:0/1042954462 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5c008e40 con 0x7fac680b68d0 2020-05-18T21:34:31.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac67fff700 1 --2- 172.21.15.63:0/1042954462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac680b68d0 0x7fac681469b0 secure :-1 s=THROTTLE_DONE pgs=1105 cs=0 l=1 rx=0x7fac58001110 tx=0x7fac5c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac66ffd700 1 -- 172.21.15.63:0/1042954462 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac5c011440 con 0x7fac680b68d0 2020-05-18T21:34:31.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac6d78b700 1 -- 172.21.15.63:0/1042954462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac680b68d0 msgr2=0x7fac681469b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac6d78b700 1 --2- 172.21.15.63:0/1042954462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac680b68d0 0x7fac681469b0 secure :-1 s=READY pgs=1105 cs=0 l=1 rx=0x7fac58001110 tx=0x7fac5c007a80).stop 2020-05-18T21:34:31.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac6d78b700 1 -- 172.21.15.63:0/1042954462 shutdown_connections 2020-05-18T21:34:31.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac6d78b700 1 --2- 172.21.15.63:0/1042954462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac680b68d0 0x7fac681469b0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:31.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac6d78b700 1 -- 172.21.15.63:0/1042954462 >> 172.21.15.63:0/1042954462 conn(0x7fac68069b70 msgr2=0x7fac68069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:31.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac6d78b700 1 -- 172.21.15.63:0/1042954462 shutdown_connections 2020-05-18T21:34:31.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac6d78b700 1 -- 172.21.15.63:0/1042954462 wait complete. 2020-05-18T21:34:31.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac6d78b700 1 Processor -- start 2020-05-18T21:34:31.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.802+0000 7fac6d78b700 1 -- start start 2020-05-18T21:34:31.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac6d78b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fac680b99d0 0x7fac68144710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:31.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac6d78b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac68149d40 0x7fac68060920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:31.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac6d78b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac681566a0 con 0x7fac680b68d0 2020-05-18T21:34:31.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac6d78b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac68060d80 con 0x7fac680b99d0 2020-05-18T21:34:31.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac6d78b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac680adef0 con 0x7fac68149d40 2020-05-18T21:34:31.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac67fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fac680b68d0 0x7fac680af7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35982/0 (socket says 172.21.15.63:35982) 2020-05-18T21:34:31.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac67fff700 1 -- 172.21.15.63:0/1156746835 learned_addr learned my addr 172.21.15.63:0/1156746835 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:31.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac677fe700 1 --2- 172.21.15.63:0/1156746835 >> v2:172.21.15.155:3300/0 conn(0x7fac680b99d0 0x7fac68144710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:31.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac6cf8a700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac68149d40 0x7fac68060920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:31.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac657fa700 1 -- 172.21.15.63:0/1156746835 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535846391 0 0) 0x7fac681566a0 con 0x7fac680b68d0 2020-05-18T21:34:31.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac657fa700 1 -- 172.21.15.63:0/1156746835 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac48002fe0 con 0x7fac680b68d0 2020-05-18T21:34:31.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac677fe700 1 -- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac68149d40 msgr2=0x7fac68060920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac677fe700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac68149d40 0x7fac68060920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:31.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac677fe700 1 -- 172.21.15.63:0/1156746835 >> v1:172.21.15.63:6789/0 conn(0x7fac680b68d0 legacy=0x7fac680af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac677fe700 1 -- 172.21.15.63:0/1156746835 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac681568d0 con 0x7fac680b99d0 2020-05-18T21:34:31.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac677fe700 1 --2- 172.21.15.63:0/1156746835 >> v2:172.21.15.155:3300/0 conn(0x7fac680b99d0 0x7fac68144710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac58000fe0 tx=0x7fac58010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac677fe700 1 --2- 172.21.15.63:0/1156746835 >> v2:172.21.15.155:3300/0 conn(0x7fac680b99d0 0x7fac68144710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac58000fe0 tx=0x7fac58010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac677fe700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac680b99d0 0x7fac68144710 secure :-1 s=READY pgs=1106 cs=0 l=1 rx=0x7fac58000fe0 tx=0x7fac58010cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:31.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac677fe700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac680b99d0 0x7fac68144710 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7fac58000fe0 tx=0x7fac58010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac657fa700 1 -- 172.21.15.63:0/1156746835 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac5800c990 con 0x7fac680b99d0 2020-05-18T21:34:31.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac677fe700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac680b99d0 0x7fac68144710 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7fac58000fe0 tx=0x7fac58010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac677fe700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac680b99d0 0x7fac68144710 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7fac58000fe0 tx=0x7fac58010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac657fa700 1 -- 172.21.15.63:0/1156746835 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5800caf0 con 0x7fac680b99d0 2020-05-18T21:34:31.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac6d78b700 1 -- 172.21.15.63:0/1156746835 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac680adb30 con 0x7fac680b99d0 2020-05-18T21:34:31.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac657fa700 1 -- 172.21.15.63:0/1156746835 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac5800ce90 con 0x7fac680b99d0 2020-05-18T21:34:31.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.806+0000 7fac6d78b700 1 -- 172.21.15.63:0/1156746835 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac680b00f0 con 0x7fac680b99d0 2020-05-18T21:34:31.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.810+0000 7fac677fe700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac680b99d0 0x7fac68144710 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7fac58000fe0 tx=0x7fac58010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.810+0000 7fac6d78b700 1 -- 172.21.15.63:0/1156746835 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac680569e0 con 0x7fac680b99d0 2020-05-18T21:34:31.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.810+0000 7fac677fe700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac680b99d0 0x7fac68144710 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7fac58000fe0 tx=0x7fac58010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.810+0000 7fac657fa700 1 -- 172.21.15.63:0/1156746835 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fac58013070 con 0x7fac680b99d0 2020-05-18T21:34:31.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.810+0000 7fac657fa700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fac4804fdb0 0x7fac48052270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:31.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.810+0000 7fac657fa700 1 -- 172.21.15.63:0/1156746835 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fac58063990 con 0x7fac680b99d0 2020-05-18T21:34:31.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.810+0000 7fac67fff700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fac4804fdb0 0x7fac48052270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:31.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.810+0000 7fac67fff700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fac4804fdb0 0x7fac48052270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac5c000bc0 tx=0x7fac5c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.810+0000 7fac67fff700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fac4804fdb0 0x7fac48052270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac5c000bc0 tx=0x7fac5c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.810+0000 7fac67fff700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fac4804fdb0 0x7fac48052270 secure :-1 s=READY pgs=651 cs=0 l=1 rx=0x7fac5c000bc0 tx=0x7fac5c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:31.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.818+0000 7fac677fe700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac680b99d0 0x7fac68144710 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7fac58000fe0 tx=0x7fac58010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.818+0000 7fac657fa700 1 -- 172.21.15.63:0/1156746835 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fac5803dc80 con 0x7fac680b99d0 2020-05-18T21:34:31.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.938+0000 7fac6d78b700 1 -- 172.21.15.63:0/1156746835 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fac680008d0 con 0x7fac680b99d0 2020-05-18T21:34:31.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.938+0000 7fac677fe700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac680b99d0 0x7fac68144710 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7fac58000fe0 tx=0x7fac58010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:31.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.938+0000 7fac657fa700 1 -- 172.21.15.63:0/1156746835 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v123) v1 ==== 92+0+10 (secure 0 0 0) 0x7fac580412a0 con 0x7fac680b99d0 2020-05-18T21:34:31.944 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:34:31.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.942+0000 7fac6d78b700 1 -- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fac4804fdb0 msgr2=0x7fac48052270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.942+0000 7fac6d78b700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fac4804fdb0 0x7fac48052270 secure :-1 s=READY pgs=651 cs=0 l=1 rx=0x7fac5c000bc0 tx=0x7fac5c007a80).stop 2020-05-18T21:34:31.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.942+0000 7fac6d78b700 1 -- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac680b99d0 msgr2=0x7fac68144710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:31.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.942+0000 7fac6d78b700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac680b99d0 0x7fac68144710 secure :-1 s=READY pgs=1106 cs=0 l=1 rx=0x7fac58000fe0 tx=0x7fac58010cb0).stop 2020-05-18T21:34:31.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.942+0000 7fac6d78b700 1 -- 172.21.15.63:0/1156746835 shutdown_connections 2020-05-18T21:34:31.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.942+0000 7fac6d78b700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fac4804fdb0 0x7fac48052270 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:31.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.942+0000 7fac6d78b700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac68149d40 0x7fac68060920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:31.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.942+0000 7fac6d78b700 1 --2- 172.21.15.63:0/1156746835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac680b99d0 0x7fac68144710 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:31.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.942+0000 7fac6d78b700 1 -- 172.21.15.63:0/1156746835 >> 172.21.15.63:0/1156746835 conn(0x7fac68069b70 msgr2=0x7fac680b7830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:31.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.942+0000 7fac6d78b700 1 -- 172.21.15.63:0/1156746835 shutdown_connections 2020-05-18T21:34:31.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:31.942+0000 7fac6d78b700 1 -- 172.21.15.63:0/1156746835 wait complete. 2020-05-18T21:34:31.957 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:34:32.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b116fc700 1 Processor -- start 2020-05-18T21:34:32.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b116fc700 1 -- start start 2020-05-18T21:34:32.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b116fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2b0c05f710 0x7f2b0c061e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:32.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b116fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c0622d0 0x7f2b0c09bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:32.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b116fc700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0c09e8b0 con 0x7f2b0c069eb0 2020-05-18T21:34:32.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b116fc700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0c14d950 con 0x7f2b0c05f710 2020-05-18T21:34:32.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b116fc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c14a6c0 con 0x7f2b0c0622d0 2020-05-18T21:34:32.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b0affd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2b0c069eb0 0x7f2b0c14ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35990/0 (socket says 172.21.15.63:35990) 2020-05-18T21:34:32.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b0affd700 1 -- 172.21.15.63:0/461608293 learned_addr learned my addr 172.21.15.63:0/461608293 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:32.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b0b7fe700 1 --2- 172.21.15.63:0/461608293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c0622d0 0x7f2b0c09bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:32.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b0a7fc700 1 --2- 172.21.15.63:0/461608293 >> v2:172.21.15.155:3300/0 conn(0x7f2b0c05f710 0x7f2b0c061e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:32.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b09ffb700 1 -- 172.21.15.63:0/461608293 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398099178 0 0) 0x7f2b0c09e8b0 con 0x7f2b0c069eb0 2020-05-18T21:34:32.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b09ffb700 1 -- 172.21.15.63:0/461608293 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aec003270 con 0x7f2b0c069eb0 2020-05-18T21:34:32.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b0b7fe700 1 -- 172.21.15.63:0/461608293 >> v2:172.21.15.155:3300/0 conn(0x7f2b0c05f710 msgr2=0x7f2b0c061e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:32.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b0b7fe700 1 --2- 172.21.15.63:0/461608293 >> v2:172.21.15.155:3300/0 conn(0x7f2b0c05f710 0x7f2b0c061e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:32.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b0b7fe700 1 -- 172.21.15.63:0/461608293 >> v1:172.21.15.63:6789/0 conn(0x7f2b0c069eb0 legacy=0x7f2b0c14ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b0b7fe700 1 -- 172.21.15.63:0/461608293 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c062760 con 0x7f2b0c0622d0 2020-05-18T21:34:32.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b0b7fe700 1 --2- 172.21.15.63:0/461608293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c0622d0 0x7f2b0c09bbb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2b040032f0 tx=0x7f2b04007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b0b7fe700 1 --2- 172.21.15.63:0/461608293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c0622d0 0x7f2b0c09bbb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2b040032f0 tx=0x7f2b04007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b0b7fe700 1 --2- 172.21.15.63:0/461608293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c0622d0 0x7f2b0c09bbb0 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7f2b040032f0 tx=0x7f2b04007e00).ready entity=mon.2 client_cookie=1adbb749b24e3698 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:32.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b0b7fe700 1 --2- 172.21.15.63:0/461608293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c0622d0 0x7f2b0c09bbb0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f2b040032f0 tx=0x7f2b04007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b09ffb700 1 -- 172.21.15.63:0/461608293 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b04011db0 con 0x7f2b0c0622d0 2020-05-18T21:34:32.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b0b7fe700 1 --2- 172.21.15.63:0/461608293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c0622d0 0x7f2b0c09bbb0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f2b040032f0 tx=0x7f2b04007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b09ffb700 1 -- 172.21.15.63:0/461608293 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0400a180 con 0x7f2b0c0622d0 2020-05-18T21:34:32.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b0b7fe700 1 --2- 172.21.15.63:0/461608293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c0622d0 0x7f2b0c09bbb0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f2b040032f0 tx=0x7f2b04007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b09ffb700 1 -- 172.21.15.63:0/461608293 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b0400a560 con 0x7f2b0c0622d0 2020-05-18T21:34:32.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b116fc700 1 -- 172.21.15.63:0/461608293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c0622d0 msgr2=0x7f2b0c09bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.062+0000 7f2b116fc700 1 --2- 172.21.15.63:0/461608293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c0622d0 0x7f2b0c09bbb0 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7f2b040032f0 tx=0x7f2b04007e00).stop 2020-05-18T21:34:32.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.066+0000 7f2b116fc700 1 -- 172.21.15.63:0/461608293 shutdown_connections 2020-05-18T21:34:32.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.066+0000 7f2b116fc700 1 --2- 172.21.15.63:0/461608293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c0622d0 0x7f2b0c09bbb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:32.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.066+0000 7f2b116fc700 1 --2- 172.21.15.63:0/461608293 >> v2:172.21.15.155:3300/0 conn(0x7f2b0c05f710 0x7f2b0c061e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:32.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.066+0000 7f2b116fc700 1 -- 172.21.15.63:0/461608293 >> 172.21.15.63:0/461608293 conn(0x7f2b0c05b290 msgr2=0x7f2b0c05ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:32.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.066+0000 7f2b116fc700 1 -- 172.21.15.63:0/461608293 shutdown_connections 2020-05-18T21:34:32.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.066+0000 7f2b116fc700 1 -- 172.21.15.63:0/461608293 wait complete. 2020-05-18T21:34:32.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.066+0000 7f2b116fc700 1 Processor -- start 2020-05-18T21:34:32.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.066+0000 7f2b116fc700 1 -- start start 2020-05-18T21:34:32.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b116fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c0622d0 0x7f2b0c099260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:32.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b116fc700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0c0638e0 con 0x7f2b0c05f710 2020-05-18T21:34:32.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b116fc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0c09ad50 con 0x7f2b0c069eb0 2020-05-18T21:34:32.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b0affd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2b0c05f710 0x7f2b0c149940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35996/0 (socket says 172.21.15.63:35996) 2020-05-18T21:34:32.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b116fc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c09b730 con 0x7f2b0c0622d0 2020-05-18T21:34:32.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b0affd700 1 -- 172.21.15.63:0/3588288509 learned_addr learned my addr 172.21.15.63:0/3588288509 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:32.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b0a7fc700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c0622d0 0x7f2b0c099260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:32.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b03fff700 1 -- 172.21.15.63:0/3588288509 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260535093 0 0) 0x7f2b0c0638e0 con 0x7f2b0c05f710 2020-05-18T21:34:32.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b03fff700 1 -- 172.21.15.63:0/3588288509 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2af0002fe0 con 0x7f2b0c05f710 2020-05-18T21:34:32.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b03fff700 1 -- 172.21.15.63:0/3588288509 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 379596030 0 0) 0x7f2af0002fe0 con 0x7f2b0c05f710 2020-05-18T21:34:32.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b03fff700 1 -- 172.21.15.63:0/3588288509 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2b0c0638e0 con 0x7f2b0c05f710 2020-05-18T21:34:32.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b03fff700 1 -- 172.21.15.63:0/3588288509 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f2afc0018c0 con 0x7f2b0c05f710 2020-05-18T21:34:32.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b03fff700 1 -- 172.21.15.63:0/3588288509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c0622d0 msgr2=0x7f2b0c099260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b03fff700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c0622d0 0x7f2b0c099260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:32.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b03fff700 1 -- 172.21.15.63:0/3588288509 >> v1:172.21.15.155:6789/0 conn(0x7f2b0c069eb0 legacy=0x7f2b0c097810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b03fff700 1 -- 172.21.15.63:0/3588288509 >> v1:172.21.15.63:6789/0 conn(0x7f2b0c05f710 legacy=0x7f2b0c149940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b03fff700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af0004a80 0x7f2af0004e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:32.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b03fff700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2af00052c0 0x7f2af00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:32.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b03fff700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af0003f50 0x7f2af00043d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:32.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b03fff700 1 -- 172.21.15.63:0/3588288509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c09b730 con 0x7f2af00052c0 2020-05-18T21:34:32.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b03fff700 1 -- 172.21.15.63:0/3588288509 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af000b850 con 0x7f2af0003f50 2020-05-18T21:34:32.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b03fff700 1 -- 172.21.15.63:0/3588288509 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af000ba10 con 0x7f2af0004a80 2020-05-18T21:34:32.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b0a7fc700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0c0622d0 0x7f2b0c099260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:32.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b0b7fe700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af0003f50 0x7f2af00043d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:32.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b0affd700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af0004a80 0x7f2af0004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:32.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b0a7fc700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2af00052c0 0x7f2af00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:32.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b0a7fc700 1 -- 172.21.15.63:0/3588288509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af0004a80 msgr2=0x7f2af0004e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b0a7fc700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af0004a80 0x7f2af0004e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:32.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b0a7fc700 1 -- 172.21.15.63:0/3588288509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af0003f50 msgr2=0x7f2af00043d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b0a7fc700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af0003f50 0x7f2af00043d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:32.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b0a7fc700 1 -- 172.21.15.63:0/3588288509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c09aff0 con 0x7f2af00052c0 2020-05-18T21:34:32.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b116fc700 1 -- 172.21.15.63:0/3588288509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0c09b2f0 con 0x7f2af00052c0 2020-05-18T21:34:32.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b0a7fc700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2af00052c0 0x7f2af00039e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2af4002f70 tx=0x7f2af4010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b116fc700 1 -- 172.21.15.63:0/3588288509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0c098ec0 con 0x7f2af00052c0 2020-05-18T21:34:32.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b0a7fc700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2af00052c0 0x7f2af00039e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2af4002f70 tx=0x7f2af4010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b0a7fc700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2af00052c0 0x7f2af00039e0 secure :-1 s=READY pgs=1688 cs=0 l=1 rx=0x7f2af4002f70 tx=0x7f2af4010cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:32.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b0a7fc700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2af00052c0 0x7f2af00039e0 secure :-1 s=THROTTLE_DONE pgs=1688 cs=0 l=1 rx=0x7f2af4002f70 tx=0x7f2af4010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b03fff700 1 -- 172.21.15.63:0/3588288509 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2af4005ae0 con 0x7f2af00052c0 2020-05-18T21:34:32.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b0a7fc700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2af00052c0 0x7f2af00039e0 secure :-1 s=THROTTLE_DONE pgs=1688 cs=0 l=1 rx=0x7f2af4002f70 tx=0x7f2af4010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b03fff700 1 -- 172.21.15.63:0/3588288509 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af4005c40 con 0x7f2af00052c0 2020-05-18T21:34:32.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b0a7fc700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2af00052c0 0x7f2af00039e0 secure :-1 s=THROTTLE_DONE pgs=1688 cs=0 l=1 rx=0x7f2af4002f70 tx=0x7f2af4010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b03fff700 1 -- 172.21.15.63:0/3588288509 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2af40126f0 con 0x7f2af00052c0 2020-05-18T21:34:32.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b116fc700 1 -- 172.21.15.63:0/3588288509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae4003380 con 0x7f2af00052c0 2020-05-18T21:34:32.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.070+0000 7f2b0a7fc700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2af00052c0 0x7f2af00039e0 secure :-1 s=THROTTLE_DONE pgs=1688 cs=0 l=1 rx=0x7f2af4002f70 tx=0x7f2af4010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.074+0000 7f2b03fff700 1 -- 172.21.15.63:0/3588288509 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2af4012850 con 0x7f2af00052c0 2020-05-18T21:34:32.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.074+0000 7f2b0a7fc700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2af00052c0 0x7f2af00039e0 secure :-1 s=THROTTLE_DONE pgs=1688 cs=0 l=1 rx=0x7f2af4002f70 tx=0x7f2af4010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.074+0000 7f2b03fff700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2af0058220 0x7f2af005a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:32.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.074+0000 7f2b03fff700 1 -- 172.21.15.63:0/3588288509 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2af4063d90 con 0x7f2af00052c0 2020-05-18T21:34:32.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.074+0000 7f2b0affd700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2af0058220 0x7f2af005a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:32.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.074+0000 7f2b0affd700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2af0058220 0x7f2af005a6e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2afc005580 tx=0x7f2afc008d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.074+0000 7f2b0affd700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2af0058220 0x7f2af005a6e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2afc005580 tx=0x7f2afc008d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.074+0000 7f2b0affd700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2af0058220 0x7f2af005a6e0 secure :-1 s=READY pgs=652 cs=0 l=1 rx=0x7f2afc005580 tx=0x7f2afc008d70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:32.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.078+0000 7f2b0a7fc700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2af00052c0 0x7f2af00039e0 secure :-1 s=THROTTLE_DONE pgs=1688 cs=0 l=1 rx=0x7f2af4002f70 tx=0x7f2af4010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.078+0000 7f2b03fff700 1 -- 172.21.15.63:0/3588288509 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2af403e120 con 0x7f2af00052c0 2020-05-18T21:34:32.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.198+0000 7f2b116fc700 1 -- 172.21.15.63:0/3588288509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ae4002240 con 0x7f2af00052c0 2020-05-18T21:34:32.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.198+0000 7f2b0a7fc700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2af00052c0 0x7f2af00039e0 secure :-1 s=THROTTLE_DONE pgs=1688 cs=0 l=1 rx=0x7f2af4002f70 tx=0x7f2af4010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.198+0000 7f2b03fff700 1 -- 172.21.15.63:0/3588288509 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v123) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2af4041740 con 0x7f2af00052c0 2020-05-18T21:34:32.203 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:34:32.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.198+0000 7f2b116fc700 1 -- 172.21.15.63:0/3588288509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2af0058220 msgr2=0x7f2af005a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.198+0000 7f2b116fc700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2af0058220 0x7f2af005a6e0 secure :-1 s=READY pgs=652 cs=0 l=1 rx=0x7f2afc005580 tx=0x7f2afc008d70).stop 2020-05-18T21:34:32.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.198+0000 7f2b116fc700 1 -- 172.21.15.63:0/3588288509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2af00052c0 msgr2=0x7f2af00039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.198+0000 7f2b0b7fe700 1 -- 172.21.15.63:0/3588288509 reap_dead start 2020-05-18T21:34:32.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.198+0000 7f2b116fc700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2af00052c0 0x7f2af00039e0 secure :-1 s=READY pgs=1688 cs=0 l=1 rx=0x7f2af4002f70 tx=0x7f2af4010cc0).stop 2020-05-18T21:34:32.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.202+0000 7f2b116fc700 1 -- 172.21.15.63:0/3588288509 shutdown_connections 2020-05-18T21:34:32.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.202+0000 7f2b116fc700 1 --2- 172.21.15.63:0/3588288509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2af00052c0 0x7f2af00039e0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:32.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.202+0000 7f2b116fc700 1 -- 172.21.15.63:0/3588288509 >> 172.21.15.63:0/3588288509 conn(0x7f2b0c05b290 msgr2=0x7f2b0c0b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:32.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.202+0000 7f2b116fc700 1 -- 172.21.15.63:0/3588288509 shutdown_connections 2020-05-18T21:34:32.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.202+0000 7f2b116fc700 1 -- 172.21.15.63:0/3588288509 wait complete. 2020-05-18T21:34:32.219 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:34:32.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.322+0000 7f58b17f4700 1 Processor -- start 2020-05-18T21:34:32.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.322+0000 7f58b17f4700 1 -- start start 2020-05-18T21:34:32.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58b17f4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f58ac0b8630 0x7f58ac0b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:32.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58b17f4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f58ac0b42b0 0x7f58ac0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:32.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58b17f4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ac0b4ba0 con 0x7f58ac0b9500 2020-05-18T21:34:32.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58b17f4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58ac060890 con 0x7f58ac0b42b0 2020-05-18T21:34:32.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58b17f4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58ac060b30 con 0x7f58ac0b8630 2020-05-18T21:34:32.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58ab7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f58ac0b42b0 0x7f58ac0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:32.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58ab7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f58ac0b42b0 0x7f58ac0b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33826/0 (socket says 172.21.15.63:33826) 2020-05-18T21:34:32.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58ab7fe700 1 -- 172.21.15.63:0/1718830795 learned_addr learned my addr 172.21.15.63:0/1718830795 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:32.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58aa7fc700 1 --2- 172.21.15.63:0/1718830795 >> v2:172.21.15.155:3300/0 conn(0x7f58ac0b8630 0x7f58ac0b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:32.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58ab7fe700 1 -- 172.21.15.63:0/1718830795 >> v2:172.21.15.155:3300/0 conn(0x7f58ac0b8630 msgr2=0x7f58ac0b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:32.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58ab7fe700 1 --2- 172.21.15.63:0/1718830795 >> v2:172.21.15.155:3300/0 conn(0x7f58ac0b8630 0x7f58ac0b6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:32.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58ab7fe700 1 -- 172.21.15.63:0/1718830795 >> v1:172.21.15.155:6789/0 conn(0x7f58ac0b9500 legacy=0x7f58ac061270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58ab7fe700 1 -- 172.21.15.63:0/1718830795 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac060dd0 con 0x7f58ac0b42b0 2020-05-18T21:34:32.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58ab7fe700 1 --2- 172.21.15.63:0/1718830795 >> v2:172.21.15.63:3300/0 conn(0x7f58ac0b42b0 0x7f58ac0b4740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f58ac0b8000 tx=0x7f58a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58ab7fe700 1 --2- 172.21.15.63:0/1718830795 >> v2:172.21.15.63:3300/0 conn(0x7f58ac0b42b0 0x7f58ac0b4740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f58ac0b8000 tx=0x7f58a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58ab7fe700 1 --2- 172.21.15.63:0/1718830795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58ac0b42b0 0x7f58ac0b4740 secure :-1 s=READY pgs=1689 cs=0 l=1 rx=0x7f58ac0b8000 tx=0x7f58a4007e00).ready entity=mon.0 client_cookie=bdb30282f00a92a4 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:32.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58ab7fe700 1 --2- 172.21.15.63:0/1718830795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58ac0b42b0 0x7f58ac0b4740 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7f58ac0b8000 tx=0x7f58a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58ab7fe700 1 --2- 172.21.15.63:0/1718830795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58ac0b42b0 0x7f58ac0b4740 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7f58ac0b8000 tx=0x7f58a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58a9ffb700 1 -- 172.21.15.63:0/1718830795 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58a4011cd0 con 0x7f58ac0b42b0 2020-05-18T21:34:32.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58ab7fe700 1 --2- 172.21.15.63:0/1718830795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58ac0b42b0 0x7f58ac0b4740 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7f58ac0b8000 tx=0x7f58a4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58a9ffb700 1 -- 172.21.15.63:0/1718830795 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a4011e30 con 0x7f58ac0b42b0 2020-05-18T21:34:32.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58a9ffb700 1 -- 172.21.15.63:0/1718830795 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58a400a370 con 0x7f58ac0b42b0 2020-05-18T21:34:32.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58b17f4700 1 -- 172.21.15.63:0/1718830795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58ac0b42b0 msgr2=0x7f58ac0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58b17f4700 1 --2- 172.21.15.63:0/1718830795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58ac0b42b0 0x7f58ac0b4740 secure :-1 s=READY pgs=1689 cs=0 l=1 rx=0x7f58ac0b8000 tx=0x7f58a4007e00).stop 2020-05-18T21:34:32.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58b17f4700 1 -- 172.21.15.63:0/1718830795 shutdown_connections 2020-05-18T21:34:32.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58b17f4700 1 --2- 172.21.15.63:0/1718830795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58ac0b42b0 0x7f58ac0b4740 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:32.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58b17f4700 1 --2- 172.21.15.63:0/1718830795 >> v2:172.21.15.155:3300/0 conn(0x7f58ac0b8630 0x7f58ac0b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:32.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58b17f4700 1 -- 172.21.15.63:0/1718830795 >> 172.21.15.63:0/1718830795 conn(0x7f58ac069b70 msgr2=0x7f58ac069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:32.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58b17f4700 1 -- 172.21.15.63:0/1718830795 shutdown_connections 2020-05-18T21:34:32.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.326+0000 7f58b17f4700 1 -- 172.21.15.63:0/1718830795 wait complete. 2020-05-18T21:34:32.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58b17f4700 1 Processor -- start 2020-05-18T21:34:32.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58b17f4700 1 -- start start 2020-05-18T21:34:32.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58b17f4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f58ac0b8630 0x7f58ac0b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:32.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58b17f4700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ac131bd0 con 0x7f58ac0b42b0 2020-05-18T21:34:32.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58b17f4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ac131e70 con 0x7f58ac0b9500 2020-05-18T21:34:32.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58b17f4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58ac132110 con 0x7f58ac0b8630 2020-05-18T21:34:32.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58aaffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f58ac0b42b0 0x7f58ac12fd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36016/0 (socket says 172.21.15.63:36016) 2020-05-18T21:34:32.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58aaffd700 1 -- 172.21.15.63:0/2884202749 learned_addr learned my addr 172.21.15.63:0/2884202749 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:32.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58aa7fc700 1 --2- 172.21.15.63:0/2884202749 >> v2:172.21.15.155:3300/0 conn(0x7f58ac0b8630 0x7f58ac0b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:32.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f589bfff700 1 -- 172.21.15.63:0/2884202749 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995027784 0 0) 0x7f58ac131bd0 con 0x7f58ac0b42b0 2020-05-18T21:34:32.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f589bfff700 1 -- 172.21.15.63:0/2884202749 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5888002fe0 con 0x7f58ac0b42b0 2020-05-18T21:34:32.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f589bfff700 1 -- 172.21.15.63:0/2884202749 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2671015164 0 0) 0x7f5888002fe0 con 0x7f58ac0b42b0 2020-05-18T21:34:32.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f589bfff700 1 -- 172.21.15.63:0/2884202749 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58ac131bd0 con 0x7f58ac0b42b0 2020-05-18T21:34:32.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f589bfff700 1 -- 172.21.15.63:0/2884202749 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f58a0001970 con 0x7f58ac0b42b0 2020-05-18T21:34:32.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f589bfff700 1 -- 172.21.15.63:0/2884202749 >> v2:172.21.15.155:3300/0 conn(0x7f58ac0b8630 msgr2=0x7f58ac0b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f589bfff700 1 --2- 172.21.15.63:0/2884202749 >> v2:172.21.15.155:3300/0 conn(0x7f58ac0b8630 0x7f58ac0b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:32.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f589bfff700 1 -- 172.21.15.63:0/2884202749 >> v1:172.21.15.155:6789/0 conn(0x7f58ac0b9500 legacy=0x7f58ac0aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f589bfff700 1 -- 172.21.15.63:0/2884202749 >> v1:172.21.15.63:6789/0 conn(0x7f58ac0b42b0 legacy=0x7f58ac12fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f589bfff700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5888004a80 0x7f5888004e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:32.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f589bfff700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58880039a0 0x7f5888003e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:32.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f589bfff700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5888004280 0x7f588800b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:32.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f589bfff700 1 -- 172.21.15.63:0/2884202749 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac132110 con 0x7f5888004a80 2020-05-18T21:34:32.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f589bfff700 1 -- 172.21.15.63:0/2884202749 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58880047f0 con 0x7f58880039a0 2020-05-18T21:34:32.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f589bfff700 1 -- 172.21.15.63:0/2884202749 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588800bbc0 con 0x7f5888004280 2020-05-18T21:34:32.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58aaffd700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5888004a80 0x7f5888004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:32.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58ab7fe700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5888004280 0x7f588800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:32.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58aa7fc700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58880039a0 0x7f5888003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:32.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58aaffd700 1 -- 172.21.15.63:0/2884202749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5888004280 msgr2=0x7f588800b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58aaffd700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5888004280 0x7f588800b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:32.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58aaffd700 1 -- 172.21.15.63:0/2884202749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58880039a0 msgr2=0x7f5888003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58aaffd700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58880039a0 0x7f5888003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:32.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58aaffd700 1 -- 172.21.15.63:0/2884202749 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac1318c0 con 0x7f5888004a80 2020-05-18T21:34:32.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58ab7fe700 1 -- 172.21.15.63:0/2884202749 reap_dead start 2020-05-18T21:34:32.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58b17f4700 1 -- 172.21.15.63:0/2884202749 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ac0b33e0 con 0x7f5888004a80 2020-05-18T21:34:32.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58aaffd700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5888004a80 0x7f5888004e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58a0001680 tx=0x7f58a0011440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58aaffd700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5888004a80 0x7f5888004e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58a0001680 tx=0x7f58a0011440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58aaffd700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5888004a80 0x7f5888004e80 secure :-1 s=READY pgs=1691 cs=0 l=1 rx=0x7f58a0001680 tx=0x7f58a0011440).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:32.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.330+0000 7f58b17f4700 1 -- 172.21.15.63:0/2884202749 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ac0b2bf0 con 0x7f5888004a80 2020-05-18T21:34:32.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.334+0000 7f58aaffd700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5888004a80 0x7f5888004e80 secure :-1 s=THROTTLE_DONE pgs=1691 cs=0 l=1 rx=0x7f58a0001680 tx=0x7f58a0011440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.334+0000 7f589bfff700 1 -- 172.21.15.63:0/2884202749 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58a00105a0 con 0x7f5888004a80 2020-05-18T21:34:32.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.334+0000 7f58aaffd700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5888004a80 0x7f5888004e80 secure :-1 s=THROTTLE_DONE pgs=1691 cs=0 l=1 rx=0x7f58a0001680 tx=0x7f58a0011440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.334+0000 7f58aaffd700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5888004a80 0x7f5888004e80 secure :-1 s=THROTTLE_DONE pgs=1691 cs=0 l=1 rx=0x7f58a0001680 tx=0x7f58a0011440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.334+0000 7f589bfff700 1 -- 172.21.15.63:0/2884202749 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a0010700 con 0x7f5888004a80 2020-05-18T21:34:32.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.334+0000 7f589bfff700 1 -- 172.21.15.63:0/2884202749 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58a0010aa0 con 0x7f5888004a80 2020-05-18T21:34:32.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.334+0000 7f58aaffd700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5888004a80 0x7f5888004e80 secure :-1 s=THROTTLE_DONE pgs=1691 cs=0 l=1 rx=0x7f58a0001680 tx=0x7f58a0011440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.334+0000 7f58b17f4700 1 -- 172.21.15.63:0/2884202749 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ac0569e0 con 0x7f5888004a80 2020-05-18T21:34:32.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.334+0000 7f589bfff700 1 -- 172.21.15.63:0/2884202749 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f58a0005510 con 0x7f5888004a80 2020-05-18T21:34:32.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.334+0000 7f58aaffd700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5888004a80 0x7f5888004e80 secure :-1 s=THROTTLE_DONE pgs=1691 cs=0 l=1 rx=0x7f58a0001680 tx=0x7f58a0011440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.334+0000 7f589bfff700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5888053950 0x7f5888055e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:32.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.334+0000 7f589bfff700 1 -- 172.21.15.63:0/2884202749 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f58a0063f00 con 0x7f5888004a80 2020-05-18T21:34:32.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.334+0000 7f58aa7fc700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5888053950 0x7f5888055e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:32.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.334+0000 7f58aa7fc700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5888053950 0x7f5888055e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f589c002f70 tx=0x7f589c00daa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.334+0000 7f58aa7fc700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5888053950 0x7f5888055e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f589c002f70 tx=0x7f589c00daa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.334+0000 7f58aa7fc700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5888053950 0x7f5888055e10 secure :-1 s=READY pgs=653 cs=0 l=1 rx=0x7f589c002f70 tx=0x7f589c00daa0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:32.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.338+0000 7f58aaffd700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5888004a80 0x7f5888004e80 secure :-1 s=THROTTLE_DONE pgs=1691 cs=0 l=1 rx=0x7f58a0001680 tx=0x7f58a0011440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.338+0000 7f589bfff700 1 -- 172.21.15.63:0/2884202749 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f58a003e290 con 0x7f5888004a80 2020-05-18T21:34:32.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.454+0000 7f58b17f4700 1 -- 172.21.15.63:0/2884202749 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f58ac0008d0 con 0x7f5888004a80 2020-05-18T21:34:32.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.454+0000 7f58aaffd700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5888004a80 0x7f5888004e80 secure :-1 s=THROTTLE_DONE pgs=1691 cs=0 l=1 rx=0x7f58a0001680 tx=0x7f58a0011440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.454+0000 7f589bfff700 1 -- 172.21.15.63:0/2884202749 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v123) v1 ==== 100+0+10 (secure 0 0 0) 0x7f58a00418b0 con 0x7f5888004a80 2020-05-18T21:34:32.459 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:34:32.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.454+0000 7f58b17f4700 1 -- 172.21.15.63:0/2884202749 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5888053950 msgr2=0x7f5888055e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.454+0000 7f58b17f4700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5888053950 0x7f5888055e10 secure :-1 s=READY pgs=653 cs=0 l=1 rx=0x7f589c002f70 tx=0x7f589c00daa0).stop 2020-05-18T21:34:32.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.454+0000 7f58b17f4700 1 -- 172.21.15.63:0/2884202749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5888004a80 msgr2=0x7f5888004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.454+0000 7f58b17f4700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5888004a80 0x7f5888004e80 secure :-1 s=READY pgs=1691 cs=0 l=1 rx=0x7f58a0001680 tx=0x7f58a0011440).stop 2020-05-18T21:34:32.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.454+0000 7f58b17f4700 1 -- 172.21.15.63:0/2884202749 shutdown_connections 2020-05-18T21:34:32.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.454+0000 7f58b17f4700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5888053950 0x7f5888055e10 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:32.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.454+0000 7f58b17f4700 1 --2- 172.21.15.63:0/2884202749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5888004a80 0x7f5888004e80 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:32.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.454+0000 7f58b17f4700 1 -- 172.21.15.63:0/2884202749 >> 172.21.15.63:0/2884202749 conn(0x7f58ac069b70 msgr2=0x7f58ac0b7270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:32.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.454+0000 7f58b17f4700 1 -- 172.21.15.63:0/2884202749 shutdown_connections 2020-05-18T21:34:32.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.454+0000 7f58b17f4700 1 -- 172.21.15.63:0/2884202749 wait complete. 2020-05-18T21:34:32.471 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:34:32.472 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:34:32.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.566+0000 7f00ddcb9700 1 Processor -- start 2020-05-18T21:34:32.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.566+0000 7f00ddcb9700 1 -- start start 2020-05-18T21:34:32.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00ddcb9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f00d8060b90 0x7f00d80615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:32.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00ddcb9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f00d80b2860 0x7f00d814e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:32.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00ddcb9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d814d960 con 0x7f00d8144090 2020-05-18T21:34:32.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00ddcb9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d8066210 con 0x7f00d8060b90 2020-05-18T21:34:32.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00ddcb9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d814db90 con 0x7f00d80b2860 2020-05-18T21:34:32.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00d77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f00d8060b90 0x7f00d80615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:32.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00d77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f00d8060b90 0x7f00d80615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33842/0 (socket says 172.21.15.63:33842) 2020-05-18T21:34:32.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00d77fe700 1 -- 172.21.15.63:0/517736217 learned_addr learned my addr 172.21.15.63:0/517736217 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:32.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00d6ffd700 1 --2- 172.21.15.63:0/517736217 >> v2:172.21.15.155:3300/0 conn(0x7f00d80b2860 0x7f00d814e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:32.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00d77fe700 1 -- 172.21.15.63:0/517736217 >> v2:172.21.15.155:3300/0 conn(0x7f00d80b2860 msgr2=0x7f00d814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:32.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00d77fe700 1 --2- 172.21.15.63:0/517736217 >> v2:172.21.15.155:3300/0 conn(0x7f00d80b2860 0x7f00d814e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:32.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00d77fe700 1 -- 172.21.15.63:0/517736217 >> v1:172.21.15.155:6789/0 conn(0x7f00d8144090 legacy=0x7f00d814a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00d77fe700 1 -- 172.21.15.63:0/517736217 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d814de30 con 0x7f00d8060b90 2020-05-18T21:34:32.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00d77fe700 1 --2- 172.21.15.63:0/517736217 >> v2:172.21.15.63:3300/0 conn(0x7f00d8060b90 0x7f00d80615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f00c80032f0 tx=0x7f00c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00d77fe700 1 --2- 172.21.15.63:0/517736217 >> v2:172.21.15.63:3300/0 conn(0x7f00d8060b90 0x7f00d80615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f00c80032f0 tx=0x7f00c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00d77fe700 1 --2- 172.21.15.63:0/517736217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00d8060b90 0x7f00d80615e0 secure :-1 s=READY pgs=1692 cs=0 l=1 rx=0x7f00c80032f0 tx=0x7f00c8007e00).ready entity=mon.0 client_cookie=38a39e2c193cfa1d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:32.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00d77fe700 1 --2- 172.21.15.63:0/517736217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00d8060b90 0x7f00d80615e0 secure :-1 s=THROTTLE_DONE pgs=1692 cs=0 l=1 rx=0x7f00c80032f0 tx=0x7f00c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00d67fc700 1 -- 172.21.15.63:0/517736217 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00c8011dc0 con 0x7f00d8060b90 2020-05-18T21:34:32.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00d77fe700 1 --2- 172.21.15.63:0/517736217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00d8060b90 0x7f00d80615e0 secure :-1 s=THROTTLE_DONE pgs=1692 cs=0 l=1 rx=0x7f00c80032f0 tx=0x7f00c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00d67fc700 1 -- 172.21.15.63:0/517736217 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c800a180 con 0x7f00d8060b90 2020-05-18T21:34:32.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00d77fe700 1 --2- 172.21.15.63:0/517736217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00d8060b90 0x7f00d80615e0 secure :-1 s=THROTTLE_DONE pgs=1692 cs=0 l=1 rx=0x7f00c80032f0 tx=0x7f00c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00d67fc700 1 -- 172.21.15.63:0/517736217 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00c800a5a0 con 0x7f00d8060b90 2020-05-18T21:34:32.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00ddcb9700 1 -- 172.21.15.63:0/517736217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00d8060b90 msgr2=0x7f00d80615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00ddcb9700 1 --2- 172.21.15.63:0/517736217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00d8060b90 0x7f00d80615e0 secure :-1 s=READY pgs=1692 cs=0 l=1 rx=0x7f00c80032f0 tx=0x7f00c8007e00).stop 2020-05-18T21:34:32.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00ddcb9700 1 -- 172.21.15.63:0/517736217 shutdown_connections 2020-05-18T21:34:32.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00ddcb9700 1 --2- 172.21.15.63:0/517736217 >> v2:172.21.15.155:3300/0 conn(0x7f00d80b2860 0x7f00d814e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:32.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00ddcb9700 1 --2- 172.21.15.63:0/517736217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00d8060b90 0x7f00d80615e0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:32.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00ddcb9700 1 -- 172.21.15.63:0/517736217 >> 172.21.15.63:0/517736217 conn(0x7f00d80b83d0 msgr2=0x7f00d80b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:32.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00ddcb9700 1 -- 172.21.15.63:0/517736217 shutdown_connections 2020-05-18T21:34:32.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.570+0000 7f00ddcb9700 1 -- 172.21.15.63:0/517736217 wait complete. 2020-05-18T21:34:32.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.574+0000 7f00ddcb9700 1 Processor -- start 2020-05-18T21:34:32.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.574+0000 7f00ddcb9700 1 -- start start 2020-05-18T21:34:32.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.574+0000 7f00ddcb9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f00d8060b90 0x7f00d8148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:32.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.574+0000 7f00ddcb9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f00d80b2860 0x7f00d8149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:32.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.574+0000 7f00ddcb9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d80acfc0 con 0x7f00d8144090 2020-05-18T21:34:32.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.574+0000 7f00ddcb9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d815aee0 con 0x7f00d8060b90 2020-05-18T21:34:32.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.574+0000 7f00ddcb9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d815b180 con 0x7f00d80b2860 2020-05-18T21:34:32.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.574+0000 7f00d77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f00d8060b90 0x7f00d8148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:32.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.574+0000 7f00d77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f00d8060b90 0x7f00d8148830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33848/0 (socket says 172.21.15.63:33848) 2020-05-18T21:34:32.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.574+0000 7f00d77fe700 1 -- 172.21.15.63:0/1030466018 learned_addr learned my addr 172.21.15.63:0/1030466018 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:32.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.574+0000 7f00d6ffd700 1 --2- 172.21.15.63:0/1030466018 >> v2:172.21.15.155:3300/0 conn(0x7f00d80b2860 0x7f00d8149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:32.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.574+0000 7f00d77fe700 1 -- 172.21.15.63:0/1030466018 >> v2:172.21.15.155:3300/0 conn(0x7f00d80b2860 msgr2=0x7f00d8149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.574+0000 7f00d77fe700 1 --2- 172.21.15.63:0/1030466018 >> v2:172.21.15.155:3300/0 conn(0x7f00d80b2860 0x7f00d8149ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:32.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.574+0000 7f00d77fe700 1 -- 172.21.15.63:0/1030466018 >> v1:172.21.15.155:6789/0 conn(0x7f00d8144090 legacy=0x7f00d8143500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.574+0000 7f00d77fe700 1 -- 172.21.15.63:0/1030466018 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d815b420 con 0x7f00d8060b90 2020-05-18T21:34:32.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.574+0000 7f00d77fe700 1 --2- 172.21.15.63:0/1030466018 >> v2:172.21.15.63:3300/0 conn(0x7f00d8060b90 0x7f00d8148830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f00c80032f0 tx=0x7f00c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00d77fe700 1 --2- 172.21.15.63:0/1030466018 >> v2:172.21.15.63:3300/0 conn(0x7f00d8060b90 0x7f00d8148830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f00c80032f0 tx=0x7f00c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00d77fe700 1 --2- 172.21.15.63:0/1030466018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00d8060b90 0x7f00d8148830 secure :-1 s=READY pgs=1693 cs=0 l=1 rx=0x7f00c80032f0 tx=0x7f00c8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:32.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00d77fe700 1 --2- 172.21.15.63:0/1030466018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00d8060b90 0x7f00d8148830 secure :-1 s=THROTTLE_DONE pgs=1693 cs=0 l=1 rx=0x7f00c80032f0 tx=0x7f00c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00d77fe700 1 --2- 172.21.15.63:0/1030466018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00d8060b90 0x7f00d8148830 secure :-1 s=THROTTLE_DONE pgs=1693 cs=0 l=1 rx=0x7f00c80032f0 tx=0x7f00c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00d4ff9700 1 -- 172.21.15.63:0/1030466018 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00c800ae40 con 0x7f00d8060b90 2020-05-18T21:34:32.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00d77fe700 1 --2- 172.21.15.63:0/1030466018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00d8060b90 0x7f00d8148830 secure :-1 s=THROTTLE_DONE pgs=1693 cs=0 l=1 rx=0x7f00c80032f0 tx=0x7f00c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00d4ff9700 1 -- 172.21.15.63:0/1030466018 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c8011e20 con 0x7f00d8060b90 2020-05-18T21:34:32.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00ddcb9700 1 -- 172.21.15.63:0/1030466018 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d8143c10 con 0x7f00d8060b90 2020-05-18T21:34:32.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00d4ff9700 1 -- 172.21.15.63:0/1030466018 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00c8005e60 con 0x7f00d8060b90 2020-05-18T21:34:32.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00ddcb9700 1 -- 172.21.15.63:0/1030466018 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d815bae0 con 0x7f00d8060b90 2020-05-18T21:34:32.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00d77fe700 1 --2- 172.21.15.63:0/1030466018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00d8060b90 0x7f00d8148830 secure :-1 s=THROTTLE_DONE pgs=1693 cs=0 l=1 rx=0x7f00c80032f0 tx=0x7f00c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00ddcb9700 1 -- 172.21.15.63:0/1030466018 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d80569e0 con 0x7f00d8060b90 2020-05-18T21:34:32.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00d4ff9700 1 -- 172.21.15.63:0/1030466018 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f00c800f5b0 con 0x7f00d8060b90 2020-05-18T21:34:32.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00d77fe700 1 --2- 172.21.15.63:0/1030466018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00d8060b90 0x7f00d8148830 secure :-1 s=THROTTLE_DONE pgs=1693 cs=0 l=1 rx=0x7f00c80032f0 tx=0x7f00c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00d4ff9700 1 --2- 172.21.15.63:0/1030466018 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f00bc04fa20 0x7f00bc051ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:32.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00d4ff9700 1 -- 172.21.15.63:0/1030466018 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f00c8064b90 con 0x7f00d8060b90 2020-05-18T21:34:32.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00d6ffd700 1 --2- 172.21.15.63:0/1030466018 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f00bc04fa20 0x7f00bc051ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:32.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00d6ffd700 1 --2- 172.21.15.63:0/1030466018 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f00bc04fa20 0x7f00bc051ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f00c0002f70 tx=0x7f00c000d820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00d6ffd700 1 --2- 172.21.15.63:0/1030466018 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f00bc04fa20 0x7f00bc051ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f00c0002f70 tx=0x7f00c000d820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.578+0000 7f00d6ffd700 1 --2- 172.21.15.63:0/1030466018 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f00bc04fa20 0x7f00bc051ee0 secure :-1 s=READY pgs=654 cs=0 l=1 rx=0x7f00c0002f70 tx=0x7f00c000d820).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:32.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.586+0000 7f00d77fe700 1 --2- 172.21.15.63:0/1030466018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00d8060b90 0x7f00d8148830 secure :-1 s=THROTTLE_DONE pgs=1693 cs=0 l=1 rx=0x7f00c80032f0 tx=0x7f00c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.586+0000 7f00d4ff9700 1 -- 172.21.15.63:0/1030466018 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f00c803ef80 con 0x7f00d8060b90 2020-05-18T21:34:32.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.734+0000 7f00ddcb9700 1 -- 172.21.15.63:0/1030466018 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00d80b5e10 con 0x7f00d8060b90 2020-05-18T21:34:32.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.734+0000 7f00d77fe700 1 --2- 172.21.15.63:0/1030466018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00d8060b90 0x7f00d8148830 secure :-1 s=THROTTLE_DONE pgs=1693 cs=0 l=1 rx=0x7f00c80032f0 tx=0x7f00c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:32.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.734+0000 7f00d4ff9700 1 -- 172.21.15.63:0/1030466018 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f00c8007c60 con 0x7f00d8060b90 2020-05-18T21:34:32.742 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:32.742 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2906955228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2906955228},{"type":"v1","addr":"172.21.15.155:6835","nonce":2906955228}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":90}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:34:27.767123+0000","modified":"2020-05-18T21:34:28.769908+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9057":{"gid":9057,"name":"a","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/1197291437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1197291437},{"type":"v1","addr":"172.21.15.63:6833","nonce":1197291437}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-05-18T21:34:32.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.738+0000 7f00ddcb9700 1 -- 172.21.15.63:0/1030466018 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f00bc04fa20 msgr2=0x7f00bc051ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.738+0000 7f00ddcb9700 1 --2- 172.21.15.63:0/1030466018 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f00bc04fa20 0x7f00bc051ee0 secure :-1 s=READY pgs=654 cs=0 l=1 rx=0x7f00c0002f70 tx=0x7f00c000d820).stop 2020-05-18T21:34:32.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.738+0000 7f00ddcb9700 1 -- 172.21.15.63:0/1030466018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00d8060b90 msgr2=0x7f00d8148830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:32.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.738+0000 7f00ddcb9700 1 --2- 172.21.15.63:0/1030466018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00d8060b90 0x7f00d8148830 secure :-1 s=READY pgs=1693 cs=0 l=1 rx=0x7f00c80032f0 tx=0x7f00c8007e00).stop 2020-05-18T21:34:32.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.738+0000 7f00ddcb9700 1 -- 172.21.15.63:0/1030466018 shutdown_connections 2020-05-18T21:34:32.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.738+0000 7f00ddcb9700 1 --2- 172.21.15.63:0/1030466018 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f00bc04fa20 0x7f00bc051ee0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:32.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.738+0000 7f00ddcb9700 1 --2- 172.21.15.63:0/1030466018 >> v2:172.21.15.155:3300/0 conn(0x7f00d80b2860 0x7f00d8149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:32.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.738+0000 7f00ddcb9700 1 --2- 172.21.15.63:0/1030466018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00d8060b90 0x7f00d8148830 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:32.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.738+0000 7f00ddcb9700 1 -- 172.21.15.63:0/1030466018 >> 172.21.15.63:0/1030466018 conn(0x7f00d80b83d0 msgr2=0x7f00d8062ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:32.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.738+0000 7f00ddcb9700 1 -- 172.21.15.63:0/1030466018 shutdown_connections 2020-05-18T21:34:32.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:32.738+0000 7f00ddcb9700 1 -- 172.21.15.63:0/1030466018 wait complete. 2020-05-18T21:34:32.748 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 91 2020-05-18T21:34:32.954 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 91, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:34:27.767123+0000', 'modified': '2020-05-18T21:34:28.769908+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9057}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9057': {'gid': 9057, 'name': 'a', 'rank': 0, 'incarnation': 90, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/1197291437', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 1197291437}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 1197291437}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:34:32.955 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:34:32.955 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:34:33.064 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:34:33.064 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:34:33.065 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:34:33.065 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 9057, 2020-05-18T21:34:33.065 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:34:33.065 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:34:33.066 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 5.292226672, 2020-05-18T21:34:33.066 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 91, 2020-05-18T21:34:33.066 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 123, 2020-05-18T21:34:33.066 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 122, 2020-05-18T21:34:33.066 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 9.6522718970000003 2020-05-18T21:34:33.066 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:34:33.073 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 9057, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.292226672, "mdsmap_epoch": 91, "osdmap_epoch": 123, "osdmap_epoch_barrier": 122, "uptime": 9.6522718970000003 } 2020-05-18T21:34:33.074 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:34:33.075 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:34:33.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.076 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:34:33.084 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:34:33.084 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:34:33.085 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:34:33.085 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:34:33.085 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:34:33.085 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:34:33.085 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:34:33.086 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:33.086 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:34:33.086 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:33.086 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:34:33.086 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:33.087 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:34:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:34:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:34:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42370sec preferred_lft 42370sec 2020-05-18T21:34:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:34:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:34:33.088 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:34:33.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.089 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:34:33.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.107 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:34:33.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.168 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:34:33.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.184 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:34:33.195 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:34:33.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.197 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:34:33.249 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:34:33.250 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:34:33.250 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:34:33.250 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:34:33.250 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:34:33.250 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:34:33.251 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:34:33.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.252 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:34:33.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.268 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:34:33.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.285 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:34:33.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.348 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:34:33.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.358 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:34:33.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.367 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:34:33.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.429 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-05-18T21:34:33.443 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-05-18T21:34:33.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.444 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-05-18T21:34:33.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.476 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:34:33.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.536 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-05-18T21:34:33.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.555 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-05-18T21:34:33.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.573 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-05-18T21:34:33.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.590 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 up' 2020-05-18T21:34:33.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:34:33.652 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.0 master ceph-brx' 2020-05-18T21:34:33.668 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-05-18T21:34:33.669 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-05-18T21:34:33.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:34:33.670 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:34:33.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:34:33.678 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:34:33.741 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:34:33.742 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:34:33.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:34:33.743 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:34:33.748 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:34:33.748 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:34:33.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:34:33.751 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:34:33.766 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:34:33.767 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:34:33.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:34:33.771 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:34:33.836 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[33973]: starting ceph client 2020-05-18T21:34:33.837 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2020-05-18T21:34:33.830+0000 7f80832bb080 -1 init, newargv = 0x55c8e7ddbde0 newargc=9 2020-05-18T21:34:33.845 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[33973]: starting fuse 2020-05-18T21:34:34.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:34:34.918 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:34:34.936 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:34:34.937 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:34:34.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:34:34.939 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:34:34.987 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:34:34.987 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:34:34.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:34:34.989 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:34:34.989 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:34:34.990 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:34:34.990 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:34:34.990 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:34:34.991 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:34:34.991 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:34:34.992 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:34:34.992 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:34:34.993 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:34:34.993 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:34:34.994 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:34:34.995 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:34:34.995 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:34:34.996 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:34:34.997 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:34:34.997 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:34:34.998 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:34:34.999 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:34:34.999 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:34:35.000 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:34:35.000 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:34:35.000 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:34:35.047 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.33973.asok 2020-05-18T21:34:35.052 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33973.asok 2020-05-18T21:34:35.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:34:35.054 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33973.asok status 2020-05-18T21:34:35.143 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:34:35.144 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:34:35.144 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:34:35.145 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:34:35.145 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:34:35.145 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:34:35.146 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:34:35.146 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "33973", 2020-05-18T21:34:35.146 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:34:35.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:35.147 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:34:35.147 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:34:35.148 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 6575, 2020-05-18T21:34:35.148 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:34:35.148 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:34:35.149 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:34:35.149 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 6575 2020-05-18T21:34:35.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:35.150 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:34:35.150 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:35.150 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:0", 2020-05-18T21:34:35.151 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2423731242 2020-05-18T21:34:35.151 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:34:35.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:35.152 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:34:35.152 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:34:35.152 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:0", 2020-05-18T21:34:35.153 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2423731242 2020-05-18T21:34:35.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:34:35.153 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.6575 172.21.15.63:0/2423731242", 2020-05-18T21:34:35.154 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "172.21.15.63:0/2423731242", 2020-05-18T21:34:35.154 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:34:35.155 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 91, 2020-05-18T21:34:35.155 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 123, 2020-05-18T21:34:35.155 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:34:35.156 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:34:35.156 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:34:35.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:34:35.159 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:34:35.159 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:34:35.169 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:34:35.170 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-05-18T21:34:35.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:34:35.171 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:34:35.191 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:34:35.194 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:34:35.230 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2020-05-18T21:34:35.231 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2020-05-18T21:34:35.231 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:34:35.232 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2020-05-18T21:34:35.232 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.232 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2020-05-18T21:34:35.233 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.233 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2020-05-18T21:34:35.233 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.234 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2020-05-18T21:34:35.234 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2020-05-18T21:34:35.234 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.235 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2020-05-18T21:34:35.235 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2020-05-18T21:34:35.235 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.236 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:34:35.236 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2020-05-18T21:34:35.236 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.237 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:34:35.237 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:34:35.237 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.238 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2020-05-18T21:34:35.238 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.238 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2020-05-18T21:34:35.239 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2020-05-18T21:34:35.239 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:34:35.239 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:34:35.240 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2020-05-18T21:34:35.240 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:34:35.240 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2020-05-18T21:34:35.241 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:34:35.241 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:34:35.241 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2020-05-18T21:34:35.242 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.242 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:34:35.242 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.243 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2020-05-18T21:34:35.243 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.243 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2020-05-18T21:34:35.243 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.244 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2020-05-18T21:34:35.244 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2020-05-18T21:34:35.244 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:34:35.245 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:34:35.245 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.245 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2020-05-18T21:34:35.246 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2020-05-18T21:34:35.246 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.246 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2020-05-18T21:34:35.247 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2020-05-18T21:34:35.247 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.247 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2020-05-18T21:34:35.248 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2020-05-18T21:34:35.248 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.248 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2020-05-18T21:34:35.249 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2020-05-18T21:34:35.249 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2020-05-18T21:34:35.250 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.250 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2020-05-18T21:34:35.250 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2020-05-18T21:34:35.251 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.251 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:34:35.251 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.251 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2020-05-18T21:34:35.252 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.252 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2020-05-18T21:34:35.252 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.253 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:34:35.253 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2020-05-18T21:34:35.253 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.254 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2020-05-18T21:34:35.254 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2020-05-18T21:34:35.254 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2020-05-18T21:34:35.255 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2020-05-18T21:34:35.255 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2020-05-18T21:34:35.256 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2020-05-18T21:34:35.256 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2020-05-18T21:34:35.257 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2020-05-18T21:34:35.257 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2020-05-18T21:34:35.257 INFO:teuthology.orchestra.run.smithi063.stdout: debug filestore = 20 2020-05-18T21:34:35.258 INFO:teuthology.orchestra.run.smithi063.stdout: debug journal = 20 2020-05-18T21:34:35.258 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 20 2020-05-18T21:34:35.258 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 25 2020-05-18T21:34:35.259 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2020-05-18T21:34:35.259 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:34:35.259 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2020-05-18T21:34:35.260 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:34:35.260 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:34:35.260 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2020-05-18T21:34:35.261 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:34:35.261 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.262 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2020-05-18T21:34:35.262 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:34:35.262 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2020-05-18T21:34:35.263 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:34:35.263 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:34:35.263 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:34:35.264 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:34:35.265 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2020-05-18T21:34:35.265 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.266 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2020-05-18T21:34:35.266 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:34:35.266 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:34:35.267 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2020-05-18T21:34:35.267 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:34:35.267 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2020-05-18T21:34:35.268 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2020-05-18T21:34:35.268 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:34:35.268 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2020-05-18T21:34:35.268 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2020-05-18T21:34:35.269 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:34:35.269 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2020-05-18T21:34:35.269 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.269 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2020-05-18T21:34:35.270 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2020-05-18T21:34:35.270 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2020-05-18T21:34:35.270 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2020-05-18T21:34:35.270 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:34:35.270 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:34:35.270 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2020-05-18T21:34:35.271 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2020-05-18T21:34:35.271 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:34:35.271 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2020-05-18T21:34:35.271 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2020-05-18T21:34:35.271 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2020-05-18T21:34:35.272 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2020-05-18T21:34:35.272 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2020-05-18T21:34:35.272 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2020-05-18T21:34:35.272 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2020-05-18T21:34:35.272 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2020-05-18T21:34:35.272 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:34:35.273 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal frag = True 2020-05-18T21:34:35.273 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal fragment size max = 10000 2020-05-18T21:34:35.273 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal merge size = 5 2020-05-18T21:34:35.273 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split bits = 3 2020-05-18T21:34:35.273 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split size = 100 2020-05-18T21:34:35.274 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2020-05-18T21:34:35.274 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2020-05-18T21:34:35.274 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2020-05-18T21:34:35.274 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2020-05-18T21:34:35.274 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:34:35.274 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_files = 100000000 2020-05-18T21:34:35.276 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2020-05-18T21:34:35.276 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2020-05-18T21:34:35.276 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:34:35.277 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2020-05-18T21:34:35.277 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.277 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2020-05-18T21:34:35.277 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.277 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2020-05-18T21:34:35.277 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.278 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2020-05-18T21:34:35.278 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2020-05-18T21:34:35.278 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.278 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2020-05-18T21:34:35.278 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2020-05-18T21:34:35.279 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.279 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:34:35.279 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2020-05-18T21:34:35.279 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.279 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:34:35.279 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:34:35.280 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.280 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2020-05-18T21:34:35.280 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.280 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2020-05-18T21:34:35.280 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2020-05-18T21:34:35.281 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:34:35.281 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:34:35.281 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2020-05-18T21:34:35.281 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:34:35.281 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2020-05-18T21:34:35.282 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:34:35.282 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:34:35.282 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2020-05-18T21:34:35.282 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.282 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:34:35.283 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.283 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2020-05-18T21:34:35.283 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.283 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2020-05-18T21:34:35.283 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.284 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2020-05-18T21:34:35.284 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2020-05-18T21:34:35.284 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:34:35.284 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:34:35.284 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.284 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2020-05-18T21:34:35.285 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2020-05-18T21:34:35.285 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.285 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2020-05-18T21:34:35.285 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2020-05-18T21:34:35.285 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.286 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2020-05-18T21:34:35.286 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2020-05-18T21:34:35.286 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.286 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2020-05-18T21:34:35.286 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2020-05-18T21:34:35.286 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2020-05-18T21:34:35.287 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.287 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2020-05-18T21:34:35.287 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2020-05-18T21:34:35.287 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.287 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:34:35.288 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.288 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2020-05-18T21:34:35.288 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.288 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2020-05-18T21:34:35.288 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.288 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:34:35.289 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2020-05-18T21:34:35.289 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.289 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2020-05-18T21:34:35.289 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2020-05-18T21:34:35.289 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2020-05-18T21:34:35.290 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2020-05-18T21:34:35.290 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2020-05-18T21:34:35.290 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2020-05-18T21:34:35.290 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2020-05-18T21:34:35.290 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2020-05-18T21:34:35.290 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2020-05-18T21:34:35.291 INFO:teuthology.orchestra.run.smithi155.stdout: debug filestore = 20 2020-05-18T21:34:35.291 INFO:teuthology.orchestra.run.smithi155.stdout: debug journal = 20 2020-05-18T21:34:35.291 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 20 2020-05-18T21:34:35.291 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 25 2020-05-18T21:34:35.291 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2020-05-18T21:34:35.292 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:34:35.292 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2020-05-18T21:34:35.292 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:34:35.292 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:34:35.292 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2020-05-18T21:34:35.292 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:34:35.293 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.293 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2020-05-18T21:34:35.293 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:34:35.293 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2020-05-18T21:34:35.293 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:34:35.293 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:34:35.294 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:34:35.294 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:34:35.294 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2020-05-18T21:34:35.294 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.294 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2020-05-18T21:34:35.295 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:34:35.295 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:34:35.295 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2020-05-18T21:34:35.295 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:34:35.295 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2020-05-18T21:34:35.295 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2020-05-18T21:34:35.296 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:34:35.296 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2020-05-18T21:34:35.296 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2020-05-18T21:34:35.296 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:34:35.296 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2020-05-18T21:34:35.297 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.297 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2020-05-18T21:34:35.297 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2020-05-18T21:34:35.297 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2020-05-18T21:34:35.297 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2020-05-18T21:34:35.297 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:34:35.298 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:34:35.298 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2020-05-18T21:34:35.298 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2020-05-18T21:34:35.298 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:34:35.298 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2020-05-18T21:34:35.299 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2020-05-18T21:34:35.299 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2020-05-18T21:34:35.299 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2020-05-18T21:34:35.299 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2020-05-18T21:34:35.299 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2020-05-18T21:34:35.299 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2020-05-18T21:34:35.300 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2020-05-18T21:34:35.300 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:34:35.300 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal frag = True 2020-05-18T21:34:35.300 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2020-05-18T21:34:35.300 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2020-05-18T21:34:35.301 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2020-05-18T21:34:35.301 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2020-05-18T21:34:35.301 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2020-05-18T21:34:35.301 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2020-05-18T21:34:35.302 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2020-05-18T21:34:35.302 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2020-05-18T21:34:35.302 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:34:35.302 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_files = 100000000 2020-05-18T21:34:35.303 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:34:35.318 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:34:35.352 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2020-05-18T21:34:35.352 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2020-05-18T21:34:35.352 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:34:35.352 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2020-05-18T21:34:35.352 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.353 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2020-05-18T21:34:35.353 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.353 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2020-05-18T21:34:35.353 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.353 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2020-05-18T21:34:35.354 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2020-05-18T21:34:35.354 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.354 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2020-05-18T21:34:35.354 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2020-05-18T21:34:35.354 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.355 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:34:35.355 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2020-05-18T21:34:35.355 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.355 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:34:35.356 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:34:35.356 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.356 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2020-05-18T21:34:35.356 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.356 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2020-05-18T21:34:35.356 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2020-05-18T21:34:35.357 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:34:35.357 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:34:35.357 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2020-05-18T21:34:35.357 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:34:35.357 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2020-05-18T21:34:35.358 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:34:35.358 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:34:35.358 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2020-05-18T21:34:35.358 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.358 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:34:35.359 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.359 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2020-05-18T21:34:35.359 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.359 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2020-05-18T21:34:35.359 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.359 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2020-05-18T21:34:35.360 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2020-05-18T21:34:35.360 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:34:35.360 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:34:35.360 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.360 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2020-05-18T21:34:35.360 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2020-05-18T21:34:35.361 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.361 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2020-05-18T21:34:35.361 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2020-05-18T21:34:35.361 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.361 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2020-05-18T21:34:35.362 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2020-05-18T21:34:35.362 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.362 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2020-05-18T21:34:35.362 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2020-05-18T21:34:35.362 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2020-05-18T21:34:35.362 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.363 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2020-05-18T21:34:35.363 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2020-05-18T21:34:35.363 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.363 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:34:35.363 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.364 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2020-05-18T21:34:35.364 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.364 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2020-05-18T21:34:35.364 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.365 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:34:35.365 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2020-05-18T21:34:35.365 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.366 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2020-05-18T21:34:35.366 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2020-05-18T21:34:35.366 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2020-05-18T21:34:35.366 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2020-05-18T21:34:35.366 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2020-05-18T21:34:35.367 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2020-05-18T21:34:35.367 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2020-05-18T21:34:35.367 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2020-05-18T21:34:35.367 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2020-05-18T21:34:35.367 INFO:teuthology.orchestra.run.smithi063.stdout: debug filestore = 20 2020-05-18T21:34:35.368 INFO:teuthology.orchestra.run.smithi063.stdout: debug journal = 20 2020-05-18T21:34:35.368 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 20 2020-05-18T21:34:35.368 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 25 2020-05-18T21:34:35.368 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2020-05-18T21:34:35.368 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:34:35.369 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2020-05-18T21:34:35.369 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:34:35.369 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:34:35.369 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2020-05-18T21:34:35.369 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:34:35.370 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.370 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2020-05-18T21:34:35.370 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:34:35.370 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2020-05-18T21:34:35.371 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:34:35.371 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:34:35.371 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:34:35.371 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:34:35.371 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2020-05-18T21:34:35.371 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.372 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2020-05-18T21:34:35.372 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:34:35.372 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:34:35.372 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2020-05-18T21:34:35.372 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:34:35.372 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2020-05-18T21:34:35.373 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2020-05-18T21:34:35.373 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:34:35.373 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2020-05-18T21:34:35.373 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2020-05-18T21:34:35.373 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:34:35.374 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2020-05-18T21:34:35.374 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.374 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2020-05-18T21:34:35.374 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2020-05-18T21:34:35.374 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2020-05-18T21:34:35.375 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2020-05-18T21:34:35.375 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:34:35.375 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:34:35.375 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2020-05-18T21:34:35.375 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2020-05-18T21:34:35.375 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:34:35.376 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2020-05-18T21:34:35.376 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2020-05-18T21:34:35.376 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2020-05-18T21:34:35.376 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2020-05-18T21:34:35.376 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2020-05-18T21:34:35.377 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2020-05-18T21:34:35.377 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2020-05-18T21:34:35.377 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2020-05-18T21:34:35.377 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:34:35.377 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal frag = True 2020-05-18T21:34:35.377 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal fragment size max = 10000 2020-05-18T21:34:35.378 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal merge size = 5 2020-05-18T21:34:35.378 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split bits = 3 2020-05-18T21:34:35.378 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split size = 100 2020-05-18T21:34:35.378 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2020-05-18T21:34:35.378 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2020-05-18T21:34:35.378 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2020-05-18T21:34:35.379 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2020-05-18T21:34:35.379 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:34:35.379 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_files = 100000000 2020-05-18T21:34:35.379 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_ops = 16 2020-05-18T21:34:35.381 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2020-05-18T21:34:35.381 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2020-05-18T21:34:35.381 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:34:35.381 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2020-05-18T21:34:35.381 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.382 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2020-05-18T21:34:35.382 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.382 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2020-05-18T21:34:35.382 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.382 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2020-05-18T21:34:35.383 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2020-05-18T21:34:35.383 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.383 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2020-05-18T21:34:35.383 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2020-05-18T21:34:35.384 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.384 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:34:35.384 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2020-05-18T21:34:35.384 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.384 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:34:35.385 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:34:35.385 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.385 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2020-05-18T21:34:35.385 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.385 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2020-05-18T21:34:35.385 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2020-05-18T21:34:35.386 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:34:35.386 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:34:35.386 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2020-05-18T21:34:35.386 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:34:35.386 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2020-05-18T21:34:35.387 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:34:35.387 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:34:35.387 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2020-05-18T21:34:35.387 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.387 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:34:35.387 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.388 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2020-05-18T21:34:35.388 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.388 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2020-05-18T21:34:35.388 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.388 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2020-05-18T21:34:35.389 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2020-05-18T21:34:35.389 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:34:35.389 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:34:35.389 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.389 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2020-05-18T21:34:35.389 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2020-05-18T21:34:35.390 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.390 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2020-05-18T21:34:35.390 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2020-05-18T21:34:35.390 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.390 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2020-05-18T21:34:35.391 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2020-05-18T21:34:35.391 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.391 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2020-05-18T21:34:35.391 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2020-05-18T21:34:35.391 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2020-05-18T21:34:35.391 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.392 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2020-05-18T21:34:35.392 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2020-05-18T21:34:35.392 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.392 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:34:35.392 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.393 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2020-05-18T21:34:35.393 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.393 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2020-05-18T21:34:35.393 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.393 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:34:35.393 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2020-05-18T21:34:35.394 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.394 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2020-05-18T21:34:35.394 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2020-05-18T21:34:35.394 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2020-05-18T21:34:35.394 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2020-05-18T21:34:35.395 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2020-05-18T21:34:35.395 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2020-05-18T21:34:35.395 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2020-05-18T21:34:35.395 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2020-05-18T21:34:35.395 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2020-05-18T21:34:35.395 INFO:teuthology.orchestra.run.smithi155.stdout: debug filestore = 20 2020-05-18T21:34:35.396 INFO:teuthology.orchestra.run.smithi155.stdout: debug journal = 20 2020-05-18T21:34:35.396 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 20 2020-05-18T21:34:35.396 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 25 2020-05-18T21:34:35.396 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2020-05-18T21:34:35.397 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:34:35.397 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2020-05-18T21:34:35.397 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:34:35.397 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:34:35.397 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2020-05-18T21:34:35.398 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:34:35.398 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.398 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2020-05-18T21:34:35.398 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:34:35.398 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2020-05-18T21:34:35.398 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:34:35.399 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:34:35.399 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:34:35.399 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:34:35.399 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2020-05-18T21:34:35.399 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.400 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2020-05-18T21:34:35.400 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:34:35.400 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:34:35.400 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2020-05-18T21:34:35.400 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:34:35.400 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2020-05-18T21:34:35.401 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2020-05-18T21:34:35.401 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:34:35.401 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2020-05-18T21:34:35.401 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2020-05-18T21:34:35.401 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:34:35.402 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2020-05-18T21:34:35.402 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.402 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2020-05-18T21:34:35.402 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2020-05-18T21:34:35.403 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2020-05-18T21:34:35.403 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2020-05-18T21:34:35.403 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:34:35.403 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:34:35.403 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2020-05-18T21:34:35.403 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2020-05-18T21:34:35.404 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:34:35.404 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2020-05-18T21:34:35.404 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2020-05-18T21:34:35.404 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2020-05-18T21:34:35.404 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2020-05-18T21:34:35.405 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2020-05-18T21:34:35.405 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2020-05-18T21:34:35.405 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2020-05-18T21:34:35.405 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2020-05-18T21:34:35.406 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:34:35.406 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal frag = True 2020-05-18T21:34:35.406 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2020-05-18T21:34:35.406 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2020-05-18T21:34:35.406 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2020-05-18T21:34:35.406 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2020-05-18T21:34:35.407 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2020-05-18T21:34:35.407 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2020-05-18T21:34:35.407 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2020-05-18T21:34:35.407 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2020-05-18T21:34:35.407 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:34:35.408 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_files = 100000000 2020-05-18T21:34:35.408 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_ops = 16 2020-05-18T21:34:35.408 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:34:35.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8fb101700 1 Processor -- start 2020-05-18T21:34:35.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8fb101700 1 -- start start 2020-05-18T21:34:35.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8fb101700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb8f40bd480 0x7fb8f409eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:35.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8fb101700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8f412f770 0x7fb8f40b8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:35.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8fb101700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f41497f0 con 0x7fb8f4065050 2020-05-18T21:34:35.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8fb101700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f4149a90 con 0x7fb8f40bd480 2020-05-18T21:34:35.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8fb101700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4149d30 con 0x7fb8f412f770 2020-05-18T21:34:35.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f3fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb8f4065050 0x7fb8f412f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36058/0 (socket says 172.21.15.63:36058) 2020-05-18T21:34:35.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f3fff700 1 -- 172.21.15.63:0/3476878195 learned_addr learned my addr 172.21.15.63:0/3476878195 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:35.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f8e9d700 1 --2- 172.21.15.63:0/3476878195 >> v2:172.21.15.155:3300/0 conn(0x7fb8f40bd480 0x7fb8f409eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:35.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f969e700 1 --2- 172.21.15.63:0/3476878195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8f412f770 0x7fb8f40b8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:35.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f37fe700 1 -- 172.21.15.63:0/3476878195 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89748975 0 0) 0x7fb8f41497f0 con 0x7fb8f4065050 2020-05-18T21:34:35.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f37fe700 1 -- 172.21.15.63:0/3476878195 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8e0003270 con 0x7fb8f4065050 2020-05-18T21:34:35.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f969e700 1 -- 172.21.15.63:0/3476878195 >> v2:172.21.15.155:3300/0 conn(0x7fb8f40bd480 msgr2=0x7fb8f409eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:35.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f969e700 1 --2- 172.21.15.63:0/3476878195 >> v2:172.21.15.155:3300/0 conn(0x7fb8f40bd480 0x7fb8f409eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:35.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f969e700 1 -- 172.21.15.63:0/3476878195 >> v1:172.21.15.63:6789/0 conn(0x7fb8f4065050 legacy=0x7fb8f412f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:35.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f969e700 1 -- 172.21.15.63:0/3476878195 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f40bd860 con 0x7fb8f412f770 2020-05-18T21:34:35.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f8e9d700 1 --2- 172.21.15.63:0/3476878195 >> v2:172.21.15.155:3300/0 conn(0x7fb8f40bd480 0x7fb8f409eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:35.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f969e700 1 --2- 172.21.15.63:0/3476878195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8f412f770 0x7fb8f40b8080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb8ec0032f0 tx=0x7fb8ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f969e700 1 --2- 172.21.15.63:0/3476878195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8f412f770 0x7fb8f40b8080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb8ec0032f0 tx=0x7fb8ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f969e700 1 --2- 172.21.15.63:0/3476878195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8f412f770 0x7fb8f40b8080 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7fb8ec0032f0 tx=0x7fb8ec007e00).ready entity=mon.2 client_cookie=392b10920fee3e24 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:35.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f969e700 1 --2- 172.21.15.63:0/3476878195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8f412f770 0x7fb8f40b8080 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fb8ec0032f0 tx=0x7fb8ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f37fe700 1 -- 172.21.15.63:0/3476878195 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ec011db0 con 0x7fb8f412f770 2020-05-18T21:34:35.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f969e700 1 --2- 172.21.15.63:0/3476878195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8f412f770 0x7fb8f40b8080 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fb8ec0032f0 tx=0x7fb8ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f969e700 1 --2- 172.21.15.63:0/3476878195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8f412f770 0x7fb8f40b8080 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fb8ec0032f0 tx=0x7fb8ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f37fe700 1 -- 172.21.15.63:0/3476878195 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec00a180 con 0x7fb8f412f770 2020-05-18T21:34:35.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8f37fe700 1 -- 172.21.15.63:0/3476878195 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ec00a5a0 con 0x7fb8f412f770 2020-05-18T21:34:35.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8fb101700 1 -- 172.21.15.63:0/3476878195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8f412f770 msgr2=0x7fb8f40b8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:35.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.518+0000 7fb8fb101700 1 --2- 172.21.15.63:0/3476878195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8f412f770 0x7fb8f40b8080 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7fb8ec0032f0 tx=0x7fb8ec007e00).stop 2020-05-18T21:34:35.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.522+0000 7fb8fb101700 1 -- 172.21.15.63:0/3476878195 shutdown_connections 2020-05-18T21:34:35.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.522+0000 7fb8fb101700 1 --2- 172.21.15.63:0/3476878195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8f412f770 0x7fb8f40b8080 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:35.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.522+0000 7fb8fb101700 1 --2- 172.21.15.63:0/3476878195 >> v2:172.21.15.155:3300/0 conn(0x7fb8f40bd480 0x7fb8f409eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:35.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.522+0000 7fb8fb101700 1 -- 172.21.15.63:0/3476878195 >> 172.21.15.63:0/3476878195 conn(0x7fb8f405f690 msgr2=0x7fb8f40bca30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:35.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.522+0000 7fb8fb101700 1 -- 172.21.15.63:0/3476878195 shutdown_connections 2020-05-18T21:34:35.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.522+0000 7fb8fb101700 1 -- 172.21.15.63:0/3476878195 wait complete. 2020-05-18T21:34:35.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.522+0000 7fb8fb101700 1 Processor -- start 2020-05-18T21:34:35.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.522+0000 7fb8fb101700 1 -- start start 2020-05-18T21:34:35.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8fb101700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb8f412f770 0x7fb8f4146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:35.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8fb101700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f40b8850 con 0x7fb8f4065050 2020-05-18T21:34:35.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8fb101700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f40b8af0 con 0x7fb8f40bd480 2020-05-18T21:34:35.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8fb101700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f40b8d90 con 0x7fb8f412f770 2020-05-18T21:34:35.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8f8e9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb8f4065050 0x7fb8f4156d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36062/0 (socket says 172.21.15.63:36062) 2020-05-18T21:34:35.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8f8e9d700 1 -- 172.21.15.63:0/3122875071 learned_addr learned my addr 172.21.15.63:0/3122875071 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:35.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8f969e700 1 --2- 172.21.15.63:0/3122875071 >> v2:172.21.15.155:3300/0 conn(0x7fb8f412f770 0x7fb8f4146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:35.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8f1ffb700 1 -- 172.21.15.63:0/3122875071 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280029721 0 0) 0x7fb8f40b8850 con 0x7fb8f4065050 2020-05-18T21:34:35.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8f1ffb700 1 -- 172.21.15.63:0/3122875071 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8d4002fe0 con 0x7fb8f4065050 2020-05-18T21:34:35.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8f969e700 1 -- 172.21.15.63:0/3122875071 >> v1:172.21.15.155:6789/0 conn(0x7fb8f40bd480 legacy=0x7fb8f40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:35.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8f969e700 1 -- 172.21.15.63:0/3122875071 >> v1:172.21.15.63:6789/0 conn(0x7fb8f4065050 legacy=0x7fb8f4156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8f1ffb700 1 -- 172.21.15.63:0/3122875071 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2455447106 0 0) 0x7fb8d4002fe0 con 0x7fb8f4065050 2020-05-18T21:34:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8f969e700 1 -- 172.21.15.63:0/3122875071 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f4157700 con 0x7fb8f412f770 2020-05-18T21:34:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8f969e700 1 --2- 172.21.15.63:0/3122875071 >> v2:172.21.15.155:3300/0 conn(0x7fb8f412f770 0x7fb8f4146bd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb8e4002660 tx=0x7fb8ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8f969e700 1 --2- 172.21.15.63:0/3122875071 >> v2:172.21.15.155:3300/0 conn(0x7fb8f412f770 0x7fb8f4146bd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb8e4002660 tx=0x7fb8ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8f969e700 1 --2- 172.21.15.63:0/3122875071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8f412f770 0x7fb8f4146bd0 secure :-1 s=READY pgs=1115 cs=0 l=1 rx=0x7fb8e4002660 tx=0x7fb8ec007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:35.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8f969e700 1 --2- 172.21.15.63:0/3122875071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8f412f770 0x7fb8f4146bd0 secure :-1 s=THROTTLE_DONE pgs=1115 cs=0 l=1 rx=0x7fb8e4002660 tx=0x7fb8ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8f1ffb700 1 -- 172.21.15.63:0/3122875071 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8e4002500 con 0x7fb8f412f770 2020-05-18T21:34:35.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8f969e700 1 --2- 172.21.15.63:0/3122875071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8f412f770 0x7fb8f4146bd0 secure :-1 s=THROTTLE_DONE pgs=1115 cs=0 l=1 rx=0x7fb8e4002660 tx=0x7fb8ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8f969e700 1 --2- 172.21.15.63:0/3122875071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8f412f770 0x7fb8f4146bd0 secure :-1 s=THROTTLE_DONE pgs=1115 cs=0 l=1 rx=0x7fb8e4002660 tx=0x7fb8ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8f1ffb700 1 -- 172.21.15.63:0/3122875071 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec011e90 con 0x7fb8f412f770 2020-05-18T21:34:35.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8fb101700 1 -- 172.21.15.63:0/3122875071 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f412bda0 con 0x7fb8f412f770 2020-05-18T21:34:35.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8f1ffb700 1 -- 172.21.15.63:0/3122875071 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ec008af0 con 0x7fb8f412f770 2020-05-18T21:34:35.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8fb101700 1 -- 172.21.15.63:0/3122875071 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f412c1f0 con 0x7fb8f412f770 2020-05-18T21:34:35.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8fb101700 1 -- 172.21.15.63:0/3122875071 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f40569e0 con 0x7fb8f412f770 2020-05-18T21:34:35.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.526+0000 7fb8f969e700 1 --2- 172.21.15.63:0/3122875071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8f412f770 0x7fb8f4146bd0 secure :-1 s=THROTTLE_DONE pgs=1115 cs=0 l=1 rx=0x7fb8e4002660 tx=0x7fb8ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.530+0000 7fb8f1ffb700 1 -- 172.21.15.63:0/3122875071 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb8ec005c70 con 0x7fb8f412f770 2020-05-18T21:34:35.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.530+0000 7fb8f969e700 1 --2- 172.21.15.63:0/3122875071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8f412f770 0x7fb8f4146bd0 secure :-1 s=THROTTLE_DONE pgs=1115 cs=0 l=1 rx=0x7fb8e4002660 tx=0x7fb8ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.530+0000 7fb8f1ffb700 1 --2- 172.21.15.63:0/3122875071 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb8d404fc70 0x7fb8d4052130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:35.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.530+0000 7fb8f1ffb700 1 -- 172.21.15.63:0/3122875071 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb8ec064310 con 0x7fb8f412f770 2020-05-18T21:34:35.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.530+0000 7fb8f8e9d700 1 --2- 172.21.15.63:0/3122875071 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb8d404fc70 0x7fb8d4052130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:35.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.530+0000 7fb8f8e9d700 1 --2- 172.21.15.63:0/3122875071 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb8d404fc70 0x7fb8d4052130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb8e40030b0 tx=0x7fb8e4002830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.530+0000 7fb8f8e9d700 1 --2- 172.21.15.63:0/3122875071 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb8d404fc70 0x7fb8d4052130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb8e40030b0 tx=0x7fb8e4002830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.530+0000 7fb8f8e9d700 1 --2- 172.21.15.63:0/3122875071 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb8d404fc70 0x7fb8d4052130 secure :-1 s=READY pgs=655 cs=0 l=1 rx=0x7fb8e40030b0 tx=0x7fb8e4002830).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:35.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.538+0000 7fb8f969e700 1 --2- 172.21.15.63:0/3122875071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8f412f770 0x7fb8f4146bd0 secure :-1 s=THROTTLE_DONE pgs=1115 cs=0 l=1 rx=0x7fb8e4002660 tx=0x7fb8ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.538+0000 7fb8f1ffb700 1 -- 172.21.15.63:0/3122875071 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb8ec03e7c0 con 0x7fb8f412f770 2020-05-18T21:34:35.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.658+0000 7fb8fb101700 1 -- 172.21.15.63:0/3122875071 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8f40a2c10 con 0x7fb8f412f770 2020-05-18T21:34:35.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.662+0000 7fb8f969e700 1 --2- 172.21.15.63:0/3122875071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8f412f770 0x7fb8f4146bd0 secure :-1 s=THROTTLE_DONE pgs=1115 cs=0 l=1 rx=0x7fb8e4002660 tx=0x7fb8ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.662+0000 7fb8f1ffb700 1 -- 172.21.15.63:0/3122875071 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v123) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb8ec041de0 con 0x7fb8f412f770 2020-05-18T21:34:35.666 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:34:35.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.662+0000 7fb8fb101700 1 -- 172.21.15.63:0/3122875071 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb8d404fc70 msgr2=0x7fb8d4052130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:35.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.662+0000 7fb8fb101700 1 --2- 172.21.15.63:0/3122875071 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb8d404fc70 0x7fb8d4052130 secure :-1 s=READY pgs=655 cs=0 l=1 rx=0x7fb8e40030b0 tx=0x7fb8e4002830).stop 2020-05-18T21:34:35.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.662+0000 7fb8fb101700 1 -- 172.21.15.63:0/3122875071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8f412f770 msgr2=0x7fb8f4146bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:35.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.662+0000 7fb8fb101700 1 --2- 172.21.15.63:0/3122875071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8f412f770 0x7fb8f4146bd0 secure :-1 s=READY pgs=1115 cs=0 l=1 rx=0x7fb8e4002660 tx=0x7fb8ec007e00).stop 2020-05-18T21:34:35.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.662+0000 7fb8fb101700 1 -- 172.21.15.63:0/3122875071 shutdown_connections 2020-05-18T21:34:35.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.662+0000 7fb8fb101700 1 --2- 172.21.15.63:0/3122875071 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb8d404fc70 0x7fb8d4052130 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:35.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.662+0000 7fb8fb101700 1 --2- 172.21.15.63:0/3122875071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8f412f770 0x7fb8f4146bd0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:35.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.662+0000 7fb8fb101700 1 -- 172.21.15.63:0/3122875071 >> 172.21.15.63:0/3122875071 conn(0x7fb8f405f690 msgr2=0x7fb8f409dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:35.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.662+0000 7fb8fb101700 1 -- 172.21.15.63:0/3122875071 shutdown_connections 2020-05-18T21:34:35.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.662+0000 7fb8fb101700 1 -- 172.21.15.63:0/3122875071 wait complete. 2020-05-18T21:34:35.678 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:34:35.680 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:34:35.709 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2020-05-18T21:34:35.709 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2020-05-18T21:34:35.710 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:34:35.710 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2020-05-18T21:34:35.710 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.710 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2020-05-18T21:34:35.710 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.711 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2020-05-18T21:34:35.711 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.711 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2020-05-18T21:34:35.711 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2020-05-18T21:34:35.711 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.712 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2020-05-18T21:34:35.712 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2020-05-18T21:34:35.712 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.712 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:34:35.712 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2020-05-18T21:34:35.713 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.713 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:34:35.713 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:34:35.713 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.713 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2020-05-18T21:34:35.713 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.714 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2020-05-18T21:34:35.714 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2020-05-18T21:34:35.714 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:34:35.714 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:34:35.714 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2020-05-18T21:34:35.715 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:34:35.715 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2020-05-18T21:34:35.715 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:34:35.715 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:34:35.715 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2020-05-18T21:34:35.715 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.716 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:34:35.716 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.716 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2020-05-18T21:34:35.716 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.716 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2020-05-18T21:34:35.717 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.717 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2020-05-18T21:34:35.717 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2020-05-18T21:34:35.717 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:34:35.718 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:34:35.718 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.718 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2020-05-18T21:34:35.718 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2020-05-18T21:34:35.718 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.719 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2020-05-18T21:34:35.719 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2020-05-18T21:34:35.719 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.719 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2020-05-18T21:34:35.719 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2020-05-18T21:34:35.719 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.720 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2020-05-18T21:34:35.720 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2020-05-18T21:34:35.720 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2020-05-18T21:34:35.720 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.720 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2020-05-18T21:34:35.721 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2020-05-18T21:34:35.721 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.721 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:34:35.721 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.721 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2020-05-18T21:34:35.722 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.722 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2020-05-18T21:34:35.722 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.722 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:34:35.722 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2020-05-18T21:34:35.723 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.723 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2020-05-18T21:34:35.723 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2020-05-18T21:34:35.723 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2020-05-18T21:34:35.723 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2020-05-18T21:34:35.724 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2020-05-18T21:34:35.724 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2020-05-18T21:34:35.724 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2020-05-18T21:34:35.724 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2020-05-18T21:34:35.724 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2020-05-18T21:34:35.724 INFO:teuthology.orchestra.run.smithi063.stdout: debug filestore = 20 2020-05-18T21:34:35.725 INFO:teuthology.orchestra.run.smithi063.stdout: debug journal = 20 2020-05-18T21:34:35.725 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 20 2020-05-18T21:34:35.725 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 25 2020-05-18T21:34:35.725 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2020-05-18T21:34:35.725 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:34:35.726 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2020-05-18T21:34:35.726 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:34:35.726 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:34:35.726 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2020-05-18T21:34:35.726 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:34:35.726 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.727 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2020-05-18T21:34:35.727 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:34:35.727 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2020-05-18T21:34:35.727 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:34:35.727 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:34:35.728 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:34:35.728 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:34:35.728 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2020-05-18T21:34:35.728 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.728 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2020-05-18T21:34:35.728 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:34:35.729 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:34:35.729 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2020-05-18T21:34:35.729 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:34:35.729 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2020-05-18T21:34:35.729 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2020-05-18T21:34:35.730 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:34:35.730 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2020-05-18T21:34:35.730 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2020-05-18T21:34:35.730 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:34:35.730 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2020-05-18T21:34:35.731 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:35.731 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2020-05-18T21:34:35.731 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2020-05-18T21:34:35.731 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2020-05-18T21:34:35.731 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2020-05-18T21:34:35.732 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:34:35.732 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:34:35.732 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2020-05-18T21:34:35.732 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2020-05-18T21:34:35.732 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:34:35.733 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2020-05-18T21:34:35.733 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2020-05-18T21:34:35.733 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2020-05-18T21:34:35.733 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2020-05-18T21:34:35.733 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2020-05-18T21:34:35.734 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2020-05-18T21:34:35.734 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2020-05-18T21:34:35.734 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2020-05-18T21:34:35.734 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:34:35.734 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal frag = True 2020-05-18T21:34:35.735 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal fragment size max = 10000 2020-05-18T21:34:35.735 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal merge size = 5 2020-05-18T21:34:35.735 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split bits = 3 2020-05-18T21:34:35.735 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split size = 100 2020-05-18T21:34:35.735 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2020-05-18T21:34:35.735 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2020-05-18T21:34:35.736 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2020-05-18T21:34:35.736 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2020-05-18T21:34:35.736 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:34:35.736 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_files = 100000000 2020-05-18T21:34:35.736 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_ops = 16 2020-05-18T21:34:35.736 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_ops_per_pg = 2.0 2020-05-18T21:34:35.738 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2020-05-18T21:34:35.738 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2020-05-18T21:34:35.738 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:34:35.739 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2020-05-18T21:34:35.739 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.739 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2020-05-18T21:34:35.739 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.739 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2020-05-18T21:34:35.740 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.740 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2020-05-18T21:34:35.740 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2020-05-18T21:34:35.740 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.740 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2020-05-18T21:34:35.741 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2020-05-18T21:34:35.741 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.741 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:34:35.741 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2020-05-18T21:34:35.741 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.741 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:34:35.742 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:34:35.742 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.742 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2020-05-18T21:34:35.742 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.742 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2020-05-18T21:34:35.743 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2020-05-18T21:34:35.743 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:34:35.743 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:34:35.743 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2020-05-18T21:34:35.743 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:34:35.743 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2020-05-18T21:34:35.744 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:34:35.744 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:34:35.744 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2020-05-18T21:34:35.744 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.744 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:34:35.745 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.745 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2020-05-18T21:34:35.745 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.745 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2020-05-18T21:34:35.745 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.745 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2020-05-18T21:34:35.746 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2020-05-18T21:34:35.746 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:34:35.746 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:34:35.746 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.746 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2020-05-18T21:34:35.747 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2020-05-18T21:34:35.747 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.747 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2020-05-18T21:34:35.747 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2020-05-18T21:34:35.747 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.747 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2020-05-18T21:34:35.748 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2020-05-18T21:34:35.748 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.748 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2020-05-18T21:34:35.748 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2020-05-18T21:34:35.748 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2020-05-18T21:34:35.749 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.749 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2020-05-18T21:34:35.749 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2020-05-18T21:34:35.749 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.749 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:34:35.749 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.750 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2020-05-18T21:34:35.750 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.750 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2020-05-18T21:34:35.750 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.750 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:34:35.751 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2020-05-18T21:34:35.751 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.751 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2020-05-18T21:34:35.751 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2020-05-18T21:34:35.751 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2020-05-18T21:34:35.751 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2020-05-18T21:34:35.752 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2020-05-18T21:34:35.752 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2020-05-18T21:34:35.752 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2020-05-18T21:34:35.752 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2020-05-18T21:34:35.752 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2020-05-18T21:34:35.752 INFO:teuthology.orchestra.run.smithi155.stdout: debug filestore = 20 2020-05-18T21:34:35.753 INFO:teuthology.orchestra.run.smithi155.stdout: debug journal = 20 2020-05-18T21:34:35.753 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 20 2020-05-18T21:34:35.753 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 25 2020-05-18T21:34:35.753 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2020-05-18T21:34:35.753 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:34:35.754 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2020-05-18T21:34:35.754 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:34:35.754 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:34:35.754 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2020-05-18T21:34:35.756 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:34:35.756 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.756 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2020-05-18T21:34:35.756 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:34:35.757 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2020-05-18T21:34:35.757 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:34:35.757 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:34:35.757 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:34:35.757 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:34:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2020-05-18T21:34:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.758 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2020-05-18T21:34:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:34:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:34:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2020-05-18T21:34:35.759 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:34:35.759 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2020-05-18T21:34:35.759 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2020-05-18T21:34:35.759 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:34:35.759 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2020-05-18T21:34:35.760 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2020-05-18T21:34:35.760 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:34:35.760 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2020-05-18T21:34:35.760 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:34:35.760 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2020-05-18T21:34:35.760 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2020-05-18T21:34:35.761 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2020-05-18T21:34:35.761 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2020-05-18T21:34:35.761 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:34:35.761 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:34:35.761 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2020-05-18T21:34:35.762 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2020-05-18T21:34:35.762 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:34:35.762 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2020-05-18T21:34:35.762 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2020-05-18T21:34:35.762 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2020-05-18T21:34:35.763 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2020-05-18T21:34:35.763 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2020-05-18T21:34:35.763 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2020-05-18T21:34:35.763 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2020-05-18T21:34:35.763 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2020-05-18T21:34:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:34:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal frag = True 2020-05-18T21:34:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2020-05-18T21:34:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2020-05-18T21:34:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2020-05-18T21:34:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2020-05-18T21:34:35.765 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2020-05-18T21:34:35.765 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2020-05-18T21:34:35.765 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2020-05-18T21:34:35.765 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2020-05-18T21:34:35.765 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:34:35.766 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_files = 100000000 2020-05-18T21:34:35.766 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_ops = 16 2020-05-18T21:34:35.766 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_ops_per_pg = 2.0 2020-05-18T21:34:35.767 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:34:35.767 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:34:35.767 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:34:35.768 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:34:35.787 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:34:35.787 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail b 2020-05-18T21:34:35.788 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:34:35.788 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail a 2020-05-18T21:34:35.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.886+0000 7f4048947700 1 Processor -- start 2020-05-18T21:34:35.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.886+0000 7f4048947700 1 -- start start 2020-05-18T21:34:35.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4048947700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4044149da0 0x7f40440b9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:35.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4048947700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f40440b9300 0x7f40440b9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:35.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4048947700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f404409e680 con 0x7f404414e2f0 2020-05-18T21:34:35.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4048947700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40440655d0 con 0x7f40440b9300 2020-05-18T21:34:35.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4048947700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4044065870 con 0x7f4044149da0 2020-05-18T21:34:35.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f40437fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4044149da0 0x7f40440b9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:35.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4043fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f40440b9300 0x7f40440b9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:35.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f40437fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4044149da0 0x7f40440b9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:52818/0 (socket says 172.21.15.63:52818) 2020-05-18T21:34:35.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f40437fe700 1 -- 172.21.15.63:0/2481010404 learned_addr learned my addr 172.21.15.63:0/2481010404 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:35.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4043fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f40440b9300 0x7f40440b9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:48736/0 (socket says 172.21.15.63:48736) 2020-05-18T21:34:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4043fff700 1 -- 172.21.15.63:0/2481010404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4044149da0 msgr2=0x7f40440b9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4043fff700 1 --2- 172.21.15.63:0/2481010404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4044149da0 0x7f40440b9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4043fff700 1 -- 172.21.15.63:0/2481010404 >> v1:172.21.15.155:6789/0 conn(0x7f404414e2f0 legacy=0x7f4044065d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4043fff700 1 -- 172.21.15.63:0/2481010404 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4044066420 con 0x7f40440b9300 2020-05-18T21:34:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f40437fe700 1 --2- 172.21.15.63:0/2481010404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4044149da0 0x7f40440b9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4043fff700 1 --2- 172.21.15.63:0/2481010404 >> v2:172.21.15.155:3300/0 conn(0x7f40440b9300 0x7f40440b9720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f403c0032f0 tx=0x7f403c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4043fff700 1 --2- 172.21.15.63:0/2481010404 >> v2:172.21.15.155:3300/0 conn(0x7f40440b9300 0x7f40440b9720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f403c0032f0 tx=0x7f403c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4043fff700 1 --2- 172.21.15.63:0/2481010404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40440b9300 0x7f40440b9720 secure :-1 s=READY pgs=1117 cs=0 l=1 rx=0x7f403c0032f0 tx=0x7f403c007e00).ready entity=mon.1 client_cookie=a8b8a38dc11369a8 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4043fff700 1 --2- 172.21.15.63:0/2481010404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40440b9300 0x7f40440b9720 secure :-1 s=THROTTLE_DONE pgs=1117 cs=0 l=1 rx=0x7f403c0032f0 tx=0x7f403c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4042ffd700 1 -- 172.21.15.63:0/2481010404 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f403c011e60 con 0x7f40440b9300 2020-05-18T21:34:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4043fff700 1 --2- 172.21.15.63:0/2481010404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40440b9300 0x7f40440b9720 secure :-1 s=THROTTLE_DONE pgs=1117 cs=0 l=1 rx=0x7f403c0032f0 tx=0x7f403c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4042ffd700 1 -- 172.21.15.63:0/2481010404 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403c00a180 con 0x7f40440b9300 2020-05-18T21:34:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4043fff700 1 --2- 172.21.15.63:0/2481010404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40440b9300 0x7f40440b9720 secure :-1 s=THROTTLE_DONE pgs=1117 cs=0 l=1 rx=0x7f403c0032f0 tx=0x7f403c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4042ffd700 1 -- 172.21.15.63:0/2481010404 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f403c00a560 con 0x7f40440b9300 2020-05-18T21:34:35.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4048947700 1 -- 172.21.15.63:0/2481010404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40440b9300 msgr2=0x7f40440b9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:35.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4048947700 1 --2- 172.21.15.63:0/2481010404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40440b9300 0x7f40440b9720 secure :-1 s=READY pgs=1117 cs=0 l=1 rx=0x7f403c0032f0 tx=0x7f403c007e00).stop 2020-05-18T21:34:35.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4048947700 1 -- 172.21.15.63:0/2481010404 shutdown_connections 2020-05-18T21:34:35.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4048947700 1 --2- 172.21.15.63:0/2481010404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40440b9300 0x7f40440b9720 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:35.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4048947700 1 --2- 172.21.15.63:0/2481010404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4044149da0 0x7f40440b9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:35.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4048947700 1 -- 172.21.15.63:0/2481010404 >> 172.21.15.63:0/2481010404 conn(0x7f404405eb50 msgr2=0x7f404405ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:35.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4048947700 1 -- 172.21.15.63:0/2481010404 shutdown_connections 2020-05-18T21:34:35.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.890+0000 7f4048947700 1 -- 172.21.15.63:0/2481010404 wait complete. 2020-05-18T21:34:35.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4048947700 1 Processor -- start 2020-05-18T21:34:35.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4048947700 1 -- start start 2020-05-18T21:34:35.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbbab5b8700 1 Processor -- start 2020-05-18T21:34:35.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbbab5b8700 1 -- start start 2020-05-18T21:34:35.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbbab5b8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbba405b390 0x7fbba4146610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:35.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbbab5b8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbba40631f0 0x7fbba4063bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:35.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbbab5b8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbba4064030 0x7fbba4142a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:35.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbbab5b8700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba4142630 con 0x7fbba40631f0 2020-05-18T21:34:35.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbbab5b8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba40b5870 con 0x7fbba4064030 2020-05-18T21:34:35.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbbab5b8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba40b5b10 con 0x7fbba405b390 2020-05-18T21:34:35.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbba8b53700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbba40631f0 0x7fbba4063bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:35.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbba8b53700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbba40631f0 0x7fbba4063bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33892/0 (socket says 172.21.15.63:33892) 2020-05-18T21:34:35.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbba8b53700 1 -- 172.21.15.63:0/2811397089 learned_addr learned my addr 172.21.15.63:0/2811397089 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:35.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbba9354700 1 --2- 172.21.15.63:0/2811397089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbba405b390 0x7fbba4146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:35.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbba9b55700 1 --2- 172.21.15.63:0/2811397089 >> v2:172.21.15.155:3300/0 conn(0x7fbba4064030 0x7fbba4142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:35.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbba8b53700 1 -- 172.21.15.63:0/2811397089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbba405b390 msgr2=0x7fbba4146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:35.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbba8b53700 1 --2- 172.21.15.63:0/2811397089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbba405b390 0x7fbba4146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbba8b53700 1 -- 172.21.15.63:0/2811397089 >> v2:172.21.15.155:3300/0 conn(0x7fbba4064030 msgr2=0x7fbba4142a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbba8b53700 1 --2- 172.21.15.63:0/2811397089 >> v2:172.21.15.155:3300/0 conn(0x7fbba4064030 0x7fbba4142a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbba8b53700 1 -- 172.21.15.63:0/2811397089 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba40b5db0 con 0x7fbba40631f0 2020-05-18T21:34:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbba9b55700 1 --2- 172.21.15.63:0/2811397089 >> v2:172.21.15.155:3300/0 conn(0x7fbba4064030 0x7fbba4142a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:34:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbba9354700 1 --2- 172.21.15.63:0/2811397089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbba405b390 0x7fbba4146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:34:35.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbba8b53700 1 --2- 172.21.15.63:0/2811397089 >> v2:172.21.15.63:3300/0 conn(0x7fbba40631f0 0x7fbba4063bd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbb94002f70 tx=0x7fbb94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbba8b53700 1 --2- 172.21.15.63:0/2811397089 >> v2:172.21.15.63:3300/0 conn(0x7fbba40631f0 0x7fbba4063bd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbb94002f70 tx=0x7fbb94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbba8b53700 1 --2- 172.21.15.63:0/2811397089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbba40631f0 0x7fbba4063bd0 secure :-1 s=READY pgs=1698 cs=0 l=1 rx=0x7fbb94002f70 tx=0x7fbb94007a80).ready entity=mon.0 client_cookie=38c839f55f8a1f02 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:35.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbba8b53700 1 --2- 172.21.15.63:0/2811397089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbba40631f0 0x7fbba4063bd0 secure :-1 s=THROTTLE_DONE pgs=1698 cs=0 l=1 rx=0x7fbb94002f70 tx=0x7fbb94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbb93fff700 1 -- 172.21.15.63:0/2811397089 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb94013970 con 0x7fbba40631f0 2020-05-18T21:34:35.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbba8b53700 1 --2- 172.21.15.63:0/2811397089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbba40631f0 0x7fbba4063bd0 secure :-1 s=THROTTLE_DONE pgs=1698 cs=0 l=1 rx=0x7fbb94002f70 tx=0x7fbb94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbba8b53700 1 --2- 172.21.15.63:0/2811397089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbba40631f0 0x7fbba4063bd0 secure :-1 s=THROTTLE_DONE pgs=1698 cs=0 l=1 rx=0x7fbb94002f70 tx=0x7fbb94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbb93fff700 1 -- 172.21.15.63:0/2811397089 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb94013ad0 con 0x7fbba40631f0 2020-05-18T21:34:35.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbb93fff700 1 -- 172.21.15.63:0/2811397089 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb9400a180 con 0x7fbba40631f0 2020-05-18T21:34:35.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbbab5b8700 1 -- 172.21.15.63:0/2811397089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbba40631f0 msgr2=0x7fbba4063bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:35.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbbab5b8700 1 --2- 172.21.15.63:0/2811397089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbba40631f0 0x7fbba4063bd0 secure :-1 s=READY pgs=1698 cs=0 l=1 rx=0x7fbb94002f70 tx=0x7fbb94007a80).stop 2020-05-18T21:34:35.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbbab5b8700 1 -- 172.21.15.63:0/2811397089 shutdown_connections 2020-05-18T21:34:35.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbbab5b8700 1 --2- 172.21.15.63:0/2811397089 >> v2:172.21.15.155:3300/0 conn(0x7fbba4064030 0x7fbba4142a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:35.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbbab5b8700 1 --2- 172.21.15.63:0/2811397089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbba40631f0 0x7fbba4063bd0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:35.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbbab5b8700 1 --2- 172.21.15.63:0/2811397089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbba405b390 0x7fbba4146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:35.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbbab5b8700 1 -- 172.21.15.63:0/2811397089 >> 172.21.15.63:0/2811397089 conn(0x7fbba405eb50 msgr2=0x7fbba405ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:35.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbbab5b8700 1 -- 172.21.15.63:0/2811397089 shutdown_connections 2020-05-18T21:34:35.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7fbbab5b8700 1 -- 172.21.15.63:0/2811397089 wait complete. 2020-05-18T21:34:35.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7fbbab5b8700 1 Processor -- start 2020-05-18T21:34:35.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7fbbab5b8700 1 -- start start 2020-05-18T21:34:35.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7fbbab5b8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbba405b390 0x7fbba413bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:35.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7fbbab5b8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbba4064030 0x7fbba413e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:35.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7fbbab5b8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba414f870 con 0x7fbba40631f0 2020-05-18T21:34:35.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7fbbab5b8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba413bd00 con 0x7fbba405b390 2020-05-18T21:34:35.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7fbbab5b8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba414fb10 con 0x7fbba4064030 2020-05-18T21:34:35.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7fbba8b53700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbba40631f0 0x7fbba414ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36094/0 (socket says 172.21.15.63:36094) 2020-05-18T21:34:35.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7fbba8b53700 1 -- 172.21.15.63:0/2115717080 learned_addr learned my addr 172.21.15.63:0/2115717080 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:35.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7fbba9354700 1 --2- 172.21.15.63:0/2115717080 >> v2:172.21.15.155:3300/0 conn(0x7fbba405b390 0x7fbba413bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:35.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbba9b55700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbba4064030 0x7fbba413e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:35.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbba9354700 1 -- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbba4064030 msgr2=0x7fbba413e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:35.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbba9354700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbba4064030 0x7fbba413e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:35.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbba9354700 1 -- 172.21.15.63:0/2115717080 >> v1:172.21.15.63:6789/0 conn(0x7fbba40631f0 legacy=0x7fbba414ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:35.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbba9354700 1 -- 172.21.15.63:0/2115717080 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba414f580 con 0x7fbba405b390 2020-05-18T21:34:35.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbba9b55700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbba4064030 0x7fbba413e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:35.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbba9354700 1 --2- 172.21.15.63:0/2115717080 >> v2:172.21.15.155:3300/0 conn(0x7fbba405b390 0x7fbba413bf90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbba0002f70 tx=0x7fbba0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbba9354700 1 --2- 172.21.15.63:0/2115717080 >> v2:172.21.15.155:3300/0 conn(0x7fbba405b390 0x7fbba413bf90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbba0002f70 tx=0x7fbba0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbba9354700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba405b390 0x7fbba413bf90 secure :-1 s=READY pgs=1119 cs=0 l=1 rx=0x7fbba0002f70 tx=0x7fbba0010a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:35.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbba9354700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba405b390 0x7fbba413bf90 secure :-1 s=THROTTLE_DONE pgs=1119 cs=0 l=1 rx=0x7fbba0002f70 tx=0x7fbba0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbb927fc700 1 -- 172.21.15.63:0/2115717080 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbba0007180 con 0x7fbba405b390 2020-05-18T21:34:35.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbba9354700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba405b390 0x7fbba413bf90 secure :-1 s=THROTTLE_DONE pgs=1119 cs=0 l=1 rx=0x7fbba0002f70 tx=0x7fbba0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbba9354700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba405b390 0x7fbba413bf90 secure :-1 s=THROTTLE_DONE pgs=1119 cs=0 l=1 rx=0x7fbba0002f70 tx=0x7fbba0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbb927fc700 1 -- 172.21.15.63:0/2115717080 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba00072e0 con 0x7fbba405b390 2020-05-18T21:34:35.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbbab5b8700 1 -- 172.21.15.63:0/2115717080 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba41535b0 con 0x7fbba405b390 2020-05-18T21:34:35.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbb927fc700 1 -- 172.21.15.63:0/2115717080 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbba0012160 con 0x7fbba405b390 2020-05-18T21:34:35.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbbab5b8700 1 -- 172.21.15.63:0/2115717080 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba413ed40 con 0x7fbba405b390 2020-05-18T21:34:35.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbba9354700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba405b390 0x7fbba413bf90 secure :-1 s=THROTTLE_DONE pgs=1119 cs=0 l=1 rx=0x7fbba0002f70 tx=0x7fbba0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbbab5b8700 1 -- 172.21.15.63:0/2115717080 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba4153a60 con 0x7fbba405b390 2020-05-18T21:34:35.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbb927fc700 1 -- 172.21.15.63:0/2115717080 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fbba0012360 con 0x7fbba405b390 2020-05-18T21:34:35.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbba9354700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba405b390 0x7fbba413bf90 secure :-1 s=THROTTLE_DONE pgs=1119 cs=0 l=1 rx=0x7fbba0002f70 tx=0x7fbba0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbb927fc700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbb8404f9b0 0x7fbb84051e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:35.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7fbb927fc700 1 -- 172.21.15.63:0/2115717080 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbba0063ba0 con 0x7fbba405b390 2020-05-18T21:34:35.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.906+0000 7fbba8b53700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbb8404f9b0 0x7fbb84051e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:35.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.906+0000 7fbba8b53700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbb8404f9b0 0x7fbb84051e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbba4144be0 tx=0x7fbb94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.906+0000 7fbba8b53700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbb8404f9b0 0x7fbb84051e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbba4144be0 tx=0x7fbb94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.906+0000 7fbba8b53700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbb8404f9b0 0x7fbb84051e70 secure :-1 s=READY pgs=657 cs=0 l=1 rx=0x7fbba4144be0 tx=0x7fbb94007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:35.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4048947700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f40440b9300 0x7f40440b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:35.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4048947700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f404414e2f0 0x7f4044146770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:35.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4048947700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4044064060 con 0x7f4044149da0 2020-05-18T21:34:35.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4048947700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4044063e70 con 0x7f404414e2f0 2020-05-18T21:34:35.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4048947700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4044064300 con 0x7f40440b9300 2020-05-18T21:34:35.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4043fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f404414e2f0 0x7f4044146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:35.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f40437fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f40440b9300 0x7f40440b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:35.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4043fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f404414e2f0 0x7f4044146770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33900/0 (socket says 172.21.15.63:33900) 2020-05-18T21:34:35.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4043fff700 1 -- 172.21.15.63:0/2517793392 learned_addr learned my addr 172.21.15.63:0/2517793392 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:35.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4043fff700 1 -- 172.21.15.63:0/2517793392 >> v2:172.21.15.155:3300/0 conn(0x7f40440b9300 msgr2=0x7f40440b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:35.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4043fff700 1 --2- 172.21.15.63:0/2517793392 >> v2:172.21.15.155:3300/0 conn(0x7f40440b9300 0x7f40440b82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:35.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4043fff700 1 -- 172.21.15.63:0/2517793392 >> v1:172.21.15.155:6789/0 conn(0x7f4044149da0 legacy=0x7f4044146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:35.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4043fff700 1 -- 172.21.15.63:0/2517793392 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40440b8920 con 0x7f404414e2f0 2020-05-18T21:34:35.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4043fff700 1 --2- 172.21.15.63:0/2517793392 >> v2:172.21.15.63:3300/0 conn(0x7f404414e2f0 0x7f4044146770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f403c0032f0 tx=0x7f403c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4043fff700 1 --2- 172.21.15.63:0/2517793392 >> v2:172.21.15.63:3300/0 conn(0x7f404414e2f0 0x7f4044146770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f403c0032f0 tx=0x7f403c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4043fff700 1 --2- 172.21.15.63:0/2517793392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f404414e2f0 0x7f4044146770 secure :-1 s=READY pgs=1699 cs=0 l=1 rx=0x7f403c0032f0 tx=0x7f403c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:35.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4043fff700 1 --2- 172.21.15.63:0/2517793392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f404414e2f0 0x7f4044146770 secure :-1 s=THROTTLE_DONE pgs=1699 cs=0 l=1 rx=0x7f403c0032f0 tx=0x7f403c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4043fff700 1 --2- 172.21.15.63:0/2517793392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f404414e2f0 0x7f4044146770 secure :-1 s=THROTTLE_DONE pgs=1699 cs=0 l=1 rx=0x7f403c0032f0 tx=0x7f403c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4043fff700 1 --2- 172.21.15.63:0/2517793392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f404414e2f0 0x7f4044146770 secure :-1 s=THROTTLE_DONE pgs=1699 cs=0 l=1 rx=0x7f403c0032f0 tx=0x7f403c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f40417fa700 1 -- 172.21.15.63:0/2517793392 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f403c005a80 con 0x7f404414e2f0 2020-05-18T21:34:35.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f40417fa700 1 -- 172.21.15.63:0/2517793392 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403c005be0 con 0x7f404414e2f0 2020-05-18T21:34:35.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f4048947700 1 -- 172.21.15.63:0/2517793392 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4044061de0 con 0x7f404414e2f0 2020-05-18T21:34:35.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.894+0000 7f40417fa700 1 -- 172.21.15.63:0/2517793392 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f403c00f5b0 con 0x7f404414e2f0 2020-05-18T21:34:35.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7f4048947700 1 -- 172.21.15.63:0/2517793392 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4044064940 con 0x7f404414e2f0 2020-05-18T21:34:35.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7f4043fff700 1 --2- 172.21.15.63:0/2517793392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f404414e2f0 0x7f4044146770 secure :-1 s=THROTTLE_DONE pgs=1699 cs=0 l=1 rx=0x7f403c0032f0 tx=0x7f403c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7f40417fa700 1 -- 172.21.15.63:0/2517793392 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f403c008460 con 0x7f404414e2f0 2020-05-18T21:34:35.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7f4043fff700 1 --2- 172.21.15.63:0/2517793392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f404414e2f0 0x7f4044146770 secure :-1 s=THROTTLE_DONE pgs=1699 cs=0 l=1 rx=0x7f403c0032f0 tx=0x7f403c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7f4048947700 1 -- 172.21.15.63:0/2517793392 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40440569e0 con 0x7f404414e2f0 2020-05-18T21:34:35.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7f40417fa700 1 --2- 172.21.15.63:0/2517793392 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f402804f990 0x7f4028051e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:35.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7f40417fa700 1 -- 172.21.15.63:0/2517793392 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f403c0649c0 con 0x7f404414e2f0 2020-05-18T21:34:35.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7f40437fe700 1 --2- 172.21.15.63:0/2517793392 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f402804f990 0x7f4028051e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:35.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7f40437fe700 1 --2- 172.21.15.63:0/2517793392 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f402804f990 0x7f4028051e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4034002f70 tx=0x7f403400ebe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7f40437fe700 1 --2- 172.21.15.63:0/2517793392 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f402804f990 0x7f4028051e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4034002f70 tx=0x7f403400ebe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.898+0000 7f40437fe700 1 --2- 172.21.15.63:0/2517793392 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f402804f990 0x7f4028051e50 secure :-1 s=READY pgs=656 cs=0 l=1 rx=0x7f4034002f70 tx=0x7f403400ebe0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:35.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7f4043fff700 1 --2- 172.21.15.63:0/2517793392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f404414e2f0 0x7f4044146770 secure :-1 s=THROTTLE_DONE pgs=1699 cs=0 l=1 rx=0x7f403c0032f0 tx=0x7f403c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.902+0000 7f40417fa700 1 -- 172.21.15.63:0/2517793392 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f403c03ee70 con 0x7f404414e2f0 2020-05-18T21:34:35.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.914+0000 7fbba9354700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba405b390 0x7fbba413bf90 secure :-1 s=THROTTLE_DONE pgs=1119 cs=0 l=1 rx=0x7fbba0002f70 tx=0x7fbba0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:35.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:35.914+0000 7fbb927fc700 1 -- 172.21.15.63:0/2115717080 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fbba003df30 con 0x7fbba405b390 2020-05-18T21:34:36.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.054+0000 7f4048947700 1 -- 172.21.15.63:0/2517793392 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f4044064440 con 0x7f404414e2f0 2020-05-18T21:34:36.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.066+0000 7fbbab5b8700 1 -- 172.21.15.63:0/2115717080 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fbba40569e0 con 0x7fbba405b390 2020-05-18T21:34:36.225 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:34:36.222+0000 7fdb4592c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:34:36.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.226+0000 7f4043fff700 1 --2- 172.21.15.63:0/2517793392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f404414e2f0 0x7f4044146770 secure :-1 s=THROTTLE_DONE pgs=1699 cs=0 l=1 rx=0x7f403c0032f0 tx=0x7f403c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:36.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.226+0000 7f40417fa700 1 -- 172.21.15.63:0/2517793392 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 9057 v92) v1 ==== 95+0+0 (secure 0 0 0) 0x7f403c042490 con 0x7f404414e2f0 2020-05-18T21:34:36.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.230+0000 7fbba9354700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba405b390 0x7fbba413bf90 secure :-1 s=THROTTLE_DONE pgs=1119 cs=0 l=1 rx=0x7fbba0002f70 tx=0x7fbba0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:36.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.230+0000 7fbb927fc700 1 -- 172.21.15.63:0/2115717080 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6467 v92) v1 ==== 95+0+0 (secure 0 0 0) 0x7fbba0041550 con 0x7fbba405b390 2020-05-18T21:34:36.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.230+0000 7f4048947700 1 -- 172.21.15.63:0/2517793392 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f402804f990 msgr2=0x7f4028051e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:36.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.230+0000 7f4048947700 1 --2- 172.21.15.63:0/2517793392 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f402804f990 0x7f4028051e50 secure :-1 s=READY pgs=656 cs=0 l=1 rx=0x7f4034002f70 tx=0x7f403400ebe0).stop 2020-05-18T21:34:36.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.230+0000 7f4048947700 1 -- 172.21.15.63:0/2517793392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f404414e2f0 msgr2=0x7f4044146770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:36.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.230+0000 7f4048947700 1 --2- 172.21.15.63:0/2517793392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f404414e2f0 0x7f4044146770 secure :-1 s=READY pgs=1699 cs=0 l=1 rx=0x7f403c0032f0 tx=0x7f403c007e00).stop 2020-05-18T21:34:36.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.230+0000 7f4048947700 1 -- 172.21.15.63:0/2517793392 shutdown_connections 2020-05-18T21:34:36.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.230+0000 7f4048947700 1 --2- 172.21.15.63:0/2517793392 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f402804f990 0x7f4028051e50 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:36.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.230+0000 7f4048947700 1 --2- 172.21.15.63:0/2517793392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f404414e2f0 0x7f4044146770 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:36.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.230+0000 7f4048947700 1 --2- 172.21.15.63:0/2517793392 >> v2:172.21.15.155:3300/0 conn(0x7f40440b9300 0x7f40440b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:36.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.230+0000 7f4048947700 1 -- 172.21.15.63:0/2517793392 >> 172.21.15.63:0/2517793392 conn(0x7f404405eb50 msgr2=0x7f404414a720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:36.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.234+0000 7f4048947700 1 -- 172.21.15.63:0/2517793392 shutdown_connections 2020-05-18T21:34:36.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.234+0000 7f4048947700 1 -- 172.21.15.63:0/2517793392 wait complete. 2020-05-18T21:34:36.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.234+0000 7fbbab5b8700 1 -- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbb8404f9b0 msgr2=0x7fbb84051e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:36.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.234+0000 7fbbab5b8700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbb8404f9b0 0x7fbb84051e70 secure :-1 s=READY pgs=657 cs=0 l=1 rx=0x7fbba4144be0 tx=0x7fbb94007a80).stop 2020-05-18T21:34:36.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.234+0000 7fbbab5b8700 1 -- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba405b390 msgr2=0x7fbba413bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:36.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.234+0000 7fbbab5b8700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba405b390 0x7fbba413bf90 secure :-1 s=READY pgs=1119 cs=0 l=1 rx=0x7fbba0002f70 tx=0x7fbba0010a90).stop 2020-05-18T21:34:36.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.234+0000 7fbbab5b8700 1 -- 172.21.15.63:0/2115717080 shutdown_connections 2020-05-18T21:34:36.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.234+0000 7fbbab5b8700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbb8404f9b0 0x7fbb84051e70 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.234+0000 7fbbab5b8700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbba4064030 0x7fbba413e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.234+0000 7fbbab5b8700 1 --2- 172.21.15.63:0/2115717080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba405b390 0x7fbba413bf90 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.234+0000 7fbbab5b8700 1 -- 172.21.15.63:0/2115717080 >> 172.21.15.63:0/2115717080 conn(0x7fbba405eb50 msgr2=0x7fbba405a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.234+0000 7fbbab5b8700 1 -- 172.21.15.63:0/2115717080 shutdown_connections 2020-05-18T21:34:36.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.234+0000 7fbbab5b8700 1 -- 172.21.15.63:0/2115717080 wait complete. 2020-05-18T21:34:36.242 INFO:teuthology.orchestra.run.smithi063.stderr:failed mds gid 9057 2020-05-18T21:34:36.242 INFO:teuthology.orchestra.run.smithi063.stderr:failed mds gid 6467 2020-05-18T21:34:36.254 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:34:36.254 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:34:36.255 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:34:36.256 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:34:36.257 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:34:36.258 DEBUG:teuthology.parallel:result is None 2020-05-18T21:34:36.259 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:34:36.259 DEBUG:teuthology.parallel:result is None 2020-05-18T21:34:36.260 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:34:36.326 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:34:36.333 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:34:36.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.354+0000 7f296fddb700 1 Processor -- start 2020-05-18T21:34:36.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.354+0000 7f296fddb700 1 -- start start 2020-05-18T21:34:36.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296fddb700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f296805eb50 0x7f296809b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:36.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296fddb700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29681439c0 0x7f296805b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:36.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296fddb700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2968143e50 con 0x7f29680b5270 2020-05-18T21:34:36.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296fddb700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2968063130 con 0x7f296805eb50 2020-05-18T21:34:36.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296fddb700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29680633d0 con 0x7f29681439c0 2020-05-18T21:34:36.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296db77700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f29680b5270 0x7f29681432b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36114/0 (socket says 172.21.15.63:36114) 2020-05-18T21:34:36.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296db77700 1 -- 172.21.15.63:0/786157541 learned_addr learned my addr 172.21.15.63:0/786157541 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:36.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296d376700 1 --2- 172.21.15.63:0/786157541 >> v2:172.21.15.155:3300/0 conn(0x7f296805eb50 0x7f296809b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:36.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296e378700 1 --2- 172.21.15.63:0/786157541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29681439c0 0x7f296805b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:36.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296cb75700 1 -- 172.21.15.63:0/786157541 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3518576277 0 0) 0x7f2968143e50 con 0x7f29680b5270 2020-05-18T21:34:36.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296cb75700 1 -- 172.21.15.63:0/786157541 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2950003270 con 0x7f29680b5270 2020-05-18T21:34:36.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296cb75700 1 -- 172.21.15.63:0/786157541 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3357573536 0 0) 0x7f2950003270 con 0x7f29680b5270 2020-05-18T21:34:36.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296cb75700 1 -- 172.21.15.63:0/786157541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29681439c0 msgr2=0x7f296805b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:36.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296cb75700 1 --2- 172.21.15.63:0/786157541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29681439c0 0x7f296805b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:36.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296cb75700 1 -- 172.21.15.63:0/786157541 >> v2:172.21.15.155:3300/0 conn(0x7f296805eb50 msgr2=0x7f296809b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:36.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296cb75700 1 --2- 172.21.15.63:0/786157541 >> v2:172.21.15.155:3300/0 conn(0x7f296805eb50 0x7f296809b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:36.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296cb75700 1 -- 172.21.15.63:0/786157541 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29680b5650 con 0x7f29680b5270 2020-05-18T21:34:36.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296cb75700 1 -- 172.21.15.63:0/786157541 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f2958001710 con 0x7f29680b5270 2020-05-18T21:34:36.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296e378700 1 --2- 172.21.15.63:0/786157541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29681439c0 0x7f296805b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:36.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296d376700 1 --2- 172.21.15.63:0/786157541 >> v2:172.21.15.155:3300/0 conn(0x7f296805eb50 0x7f296809b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:36.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296cb75700 1 -- 172.21.15.63:0/786157541 >> v1:172.21.15.63:6789/0 conn(0x7f29680b5270 legacy=0x7f29681432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:36.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296cb75700 1 --2- 172.21.15.63:0/786157541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29500037e0 0x7f2950003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:36.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296cb75700 1 --2- 172.21.15.63:0/786157541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29681439c0 0x7f2950004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:36.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296cb75700 1 --2- 172.21.15.63:0/786157541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2950004970 0x7f2950004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:36.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296cb75700 1 -- 172.21.15.63:0/786157541 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2968063130 con 0x7f2950004970 2020-05-18T21:34:36.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296cb75700 1 -- 172.21.15.63:0/786157541 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29680633d0 con 0x7f29500037e0 2020-05-18T21:34:36.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296cb75700 1 -- 172.21.15.63:0/786157541 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2950005250 con 0x7f29681439c0 2020-05-18T21:34:36.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296e378700 1 --2- 172.21.15.63:0/786157541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2950004970 0x7f2950004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:36.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296d376700 1 --2- 172.21.15.63:0/786157541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29681439c0 0x7f2950004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:36.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296db77700 1 --2- 172.21.15.63:0/786157541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29500037e0 0x7f2950003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:36.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296e378700 1 -- 172.21.15.63:0/786157541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29681439c0 msgr2=0x7f2950004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:36.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296e378700 1 --2- 172.21.15.63:0/786157541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29681439c0 0x7f2950004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:36.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296e378700 1 -- 172.21.15.63:0/786157541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29500037e0 msgr2=0x7f2950003c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:36.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296e378700 1 --2- 172.21.15.63:0/786157541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29500037e0 0x7f2950003c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:36.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296e378700 1 -- 172.21.15.63:0/786157541 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2950003270 con 0x7f2950004970 2020-05-18T21:34:36.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296db77700 1 --2- 172.21.15.63:0/786157541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29500037e0 0x7f2950003c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:34:36.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296e378700 1 --2- 172.21.15.63:0/786157541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2950004970 0x7f2950004df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2950004480 tx=0x7f296000c290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296e378700 1 --2- 172.21.15.63:0/786157541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2950004970 0x7f2950004df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2950004480 tx=0x7f296000c290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296e378700 1 --2- 172.21.15.63:0/786157541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2950004970 0x7f2950004df0 secure :-1 s=READY pgs=1705 cs=0 l=1 rx=0x7f2950004480 tx=0x7f296000c290).ready entity=mon.0 client_cookie=e8b2a952b04dea2c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296e378700 1 --2- 172.21.15.63:0/786157541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2950004970 0x7f2950004df0 secure :-1 s=THROTTLE_DONE pgs=1705 cs=0 l=1 rx=0x7f2950004480 tx=0x7f296000c290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296e378700 1 --2- 172.21.15.63:0/786157541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2950004970 0x7f2950004df0 secure :-1 s=THROTTLE_DONE pgs=1705 cs=0 l=1 rx=0x7f2950004480 tx=0x7f296000c290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296cb75700 1 -- 172.21.15.63:0/786157541 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f296000eb50 con 0x7f2950004970 2020-05-18T21:34:36.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296e378700 1 --2- 172.21.15.63:0/786157541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2950004970 0x7f2950004df0 secure :-1 s=THROTTLE_DONE pgs=1705 cs=0 l=1 rx=0x7f2950004480 tx=0x7f296000c290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:36.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296cb75700 1 -- 172.21.15.63:0/786157541 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296000ecb0 con 0x7f2950004970 2020-05-18T21:34:36.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296cb75700 1 -- 172.21.15.63:0/786157541 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f296000ee60 con 0x7f2950004970 2020-05-18T21:34:36.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296fddb700 1 -- 172.21.15.63:0/786157541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2950004970 msgr2=0x7f2950004df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:36.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296fddb700 1 --2- 172.21.15.63:0/786157541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2950004970 0x7f2950004df0 secure :-1 s=READY pgs=1705 cs=0 l=1 rx=0x7f2950004480 tx=0x7f296000c290).stop 2020-05-18T21:34:36.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296e378700 1 -- 172.21.15.63:0/786157541 reap_dead start 2020-05-18T21:34:36.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296fddb700 1 -- 172.21.15.63:0/786157541 shutdown_connections 2020-05-18T21:34:36.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.358+0000 7f296fddb700 1 -- 172.21.15.63:0/786157541 >> 172.21.15.63:0/786157541 conn(0x7f29680b59b0 msgr2=0x7f29680b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:36.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.362+0000 7f296fddb700 1 -- 172.21.15.63:0/786157541 shutdown_connections 2020-05-18T21:34:36.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.362+0000 7f296fddb700 1 -- 172.21.15.63:0/786157541 wait complete. 2020-05-18T21:34:36.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.362+0000 7f296fddb700 1 Processor -- start 2020-05-18T21:34:36.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.362+0000 7f296fddb700 1 -- start start 2020-05-18T21:34:36.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.362+0000 7f296fddb700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29680620e0 0x7f29680662a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:36.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.362+0000 7f296fddb700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2968064f30 con 0x7f296809c110 2020-05-18T21:34:36.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.362+0000 7f296fddb700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2968157010 con 0x7f296813dee0 2020-05-18T21:34:36.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.362+0000 7f296fddb700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296809df50 con 0x7f29680620e0 2020-05-18T21:34:36.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.362+0000 7f296d376700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f296809c110 0x7f296813d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36126/0 (socket says 172.21.15.63:36126) 2020-05-18T21:34:36.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.362+0000 7f296d376700 1 -- 172.21.15.63:0/3285066118 learned_addr learned my addr 172.21.15.63:0/3285066118 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:36.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.362+0000 7f296db77700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29680620e0 0x7f29680662a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:36.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.362+0000 7f2956ffd700 1 -- 172.21.15.63:0/3285066118 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169494452 0 0) 0x7f2968064f30 con 0x7f296809c110 2020-05-18T21:34:36.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.362+0000 7f2956ffd700 1 -- 172.21.15.63:0/3285066118 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2948002fe0 con 0x7f296809c110 2020-05-18T21:34:36.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.362+0000 7f2956ffd700 1 -- 172.21.15.63:0/3285066118 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 426600308 0 0) 0x7f2948002fe0 con 0x7f296809c110 2020-05-18T21:34:36.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.362+0000 7f2956ffd700 1 -- 172.21.15.63:0/3285066118 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2968064f30 con 0x7f296809c110 2020-05-18T21:34:36.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.362+0000 7f2956ffd700 1 -- 172.21.15.63:0/3285066118 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f29640014d0 con 0x7f296809c110 2020-05-18T21:34:36.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f2956ffd700 1 -- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29680620e0 msgr2=0x7f29680662a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:36.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f2956ffd700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29680620e0 0x7f29680662a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:36.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f2956ffd700 1 -- 172.21.15.63:0/3285066118 >> v1:172.21.15.155:6789/0 conn(0x7f296813dee0 legacy=0x7f2968065360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:36.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f2956ffd700 1 -- 172.21.15.63:0/3285066118 >> v1:172.21.15.63:6789/0 conn(0x7f296809c110 legacy=0x7f296813d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:36.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f2956ffd700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2948004a80 0x7f29480039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:36.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f2956ffd700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2948003e00 0x7f2948004240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:36.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f2956ffd700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2948008e80 0x7f294800b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:36.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f2956ffd700 1 -- 172.21.15.63:0/3285066118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294800b6d0 con 0x7f2948003e00 2020-05-18T21:34:36.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f2956ffd700 1 -- 172.21.15.63:0/3285066118 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294800b840 con 0x7f2948004a80 2020-05-18T21:34:36.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f2956ffd700 1 -- 172.21.15.63:0/3285066118 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294800ba00 con 0x7f2948008e80 2020-05-18T21:34:36.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296db77700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29680620e0 0x7f29680662a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:34:36.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296d376700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2948003e00 0x7f2948004240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:36.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296db77700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2948004a80 0x7f29480039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:36.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296e378700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2948008e80 0x7f294800b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:36.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296d376700 1 -- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2948008e80 msgr2=0x7f294800b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:36.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296d376700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2948008e80 0x7f294800b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:36.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296d376700 1 -- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2948004a80 msgr2=0x7f29480039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:36.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296d376700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2948004a80 0x7f29480039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:36.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296d376700 1 -- 172.21.15.63:0/3285066118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29680624c0 con 0x7f2948003e00 2020-05-18T21:34:36.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296fddb700 1 -- 172.21.15.63:0/3285066118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2968063af0 con 0x7f2948003e00 2020-05-18T21:34:36.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296e378700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2948008e80 0x7f294800b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:34:36.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296d376700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2948003e00 0x7f2948004240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2964002f30 tx=0x7f2964011ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:36.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296fddb700 1 -- 172.21.15.63:0/3285066118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2968147400 con 0x7f2948003e00 2020-05-18T21:34:36.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296d376700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2948003e00 0x7f2948004240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2964002f30 tx=0x7f2964011ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:36.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296d376700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2948003e00 0x7f2948004240 secure :-1 s=READY pgs=1707 cs=0 l=1 rx=0x7f2964002f30 tx=0x7f2964011ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:36.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296d376700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2948003e00 0x7f2948004240 secure :-1 s=THROTTLE_DONE pgs=1707 cs=0 l=1 rx=0x7f2964002f30 tx=0x7f2964011ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:36.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f2956ffd700 1 -- 172.21.15.63:0/3285066118 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2964005700 con 0x7f2948003e00 2020-05-18T21:34:36.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296d376700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2948003e00 0x7f2948004240 secure :-1 s=THROTTLE_DONE pgs=1707 cs=0 l=1 rx=0x7f2964002f30 tx=0x7f2964011ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:36.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296d376700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2948003e00 0x7f2948004240 secure :-1 s=THROTTLE_DONE pgs=1707 cs=0 l=1 rx=0x7f2964002f30 tx=0x7f2964011ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:36.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f2956ffd700 1 -- 172.21.15.63:0/3285066118 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2964005860 con 0x7f2948003e00 2020-05-18T21:34:36.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f2956ffd700 1 -- 172.21.15.63:0/3285066118 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2964005c80 con 0x7f2948003e00 2020-05-18T21:34:36.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296d376700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2948003e00 0x7f2948004240 secure :-1 s=THROTTLE_DONE pgs=1707 cs=0 l=1 rx=0x7f2964002f30 tx=0x7f2964011ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:36.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.366+0000 7f296fddb700 1 -- 172.21.15.63:0/3285066118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2944003380 con 0x7f2948003e00 2020-05-18T21:34:36.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.370+0000 7f2956ffd700 1 -- 172.21.15.63:0/3285066118 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f296400f690 con 0x7f2948003e00 2020-05-18T21:34:36.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.370+0000 7f296d376700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2948003e00 0x7f2948004240 secure :-1 s=THROTTLE_DONE pgs=1707 cs=0 l=1 rx=0x7f2964002f30 tx=0x7f2964011ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:36.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.370+0000 7f2956ffd700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2948058180 0x7f294805a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:36.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.370+0000 7f2956ffd700 1 -- 172.21.15.63:0/3285066118 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f29640130d0 con 0x7f2948003e00 2020-05-18T21:34:36.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.370+0000 7f296db77700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2948058180 0x7f294805a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:36.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.370+0000 7f296db77700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2948058180 0x7f294805a640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2958001420 tx=0x7f29680b57e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:36.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.370+0000 7f296db77700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2948058180 0x7f294805a640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2958001420 tx=0x7f29680b57e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:36.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.370+0000 7f296db77700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2948058180 0x7f294805a640 secure :-1 s=READY pgs=658 cs=0 l=1 rx=0x7f2958001420 tx=0x7f29680b57e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:36.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.374+0000 7f296d376700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2948003e00 0x7f2948004240 secure :-1 s=THROTTLE_DONE pgs=1707 cs=0 l=1 rx=0x7f2964002f30 tx=0x7f2964011ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:36.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.378+0000 7f2956ffd700 1 -- 172.21.15.63:0/3285066118 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f296403ef60 con 0x7f2948003e00 2020-05-18T21:34:36.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.530+0000 7f296fddb700 1 -- 172.21.15.63:0/3285066118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2944003720 con 0x7f2948003e00 2020-05-18T21:34:36.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.530+0000 7f296d376700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2948003e00 0x7f2948004240 secure :-1 s=THROTTLE_DONE pgs=1707 cs=0 l=1 rx=0x7f2964002f30 tx=0x7f2964011ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:36.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.530+0000 7f2956ffd700 1 -- 172.21.15.63:0/3285066118 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+1430 (secure 0 0 0) 0x7f2964042580 con 0x7f2948003e00 2020-05-18T21:34:36.536 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:36.537 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:34:27.767123+0000","modified":"2020-05-18T21:34:36.224073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-05-18T21:34:36.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.534+0000 7f296fddb700 1 -- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2948058180 msgr2=0x7f294805a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:36.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.534+0000 7f296fddb700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2948058180 0x7f294805a640 secure :-1 s=READY pgs=658 cs=0 l=1 rx=0x7f2958001420 tx=0x7f29680b57e0).stop 2020-05-18T21:34:36.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.534+0000 7f296fddb700 1 -- 172.21.15.63:0/3285066118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2948003e00 msgr2=0x7f2948004240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:36.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.534+0000 7f296fddb700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2948003e00 0x7f2948004240 secure :-1 s=READY pgs=1707 cs=0 l=1 rx=0x7f2964002f30 tx=0x7f2964011ba0).stop 2020-05-18T21:34:36.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.534+0000 7f296e378700 1 -- 172.21.15.63:0/3285066118 reap_dead start 2020-05-18T21:34:36.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.534+0000 7f296fddb700 1 -- 172.21.15.63:0/3285066118 shutdown_connections 2020-05-18T21:34:36.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.534+0000 7f296fddb700 1 --2- 172.21.15.63:0/3285066118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2948003e00 0x7f2948004240 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:36.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.534+0000 7f296fddb700 1 -- 172.21.15.63:0/3285066118 >> 172.21.15.63:0/3285066118 conn(0x7f29680b59b0 msgr2=0x7f2968069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:36.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.534+0000 7f296fddb700 1 -- 172.21.15.63:0/3285066118 shutdown_connections 2020-05-18T21:34:36.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:36.534+0000 7f296fddb700 1 -- 172.21.15.63:0/3285066118 wait complete. 2020-05-18T21:34:36.540 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 92 2020-05-18T21:34:36.751 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 92, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:34:27.767123+0000', 'modified': '2020-05-18T21:34:36.224073+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 124, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:34:36.751 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2020-05-18T21:34:37.752 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:34:37.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.858+0000 7f12adf62700 1 Processor -- start 2020-05-18T21:34:37.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.858+0000 7f12adf62700 1 -- start start 2020-05-18T21:34:37.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.858+0000 7f12adf62700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12a8149650 0x7f12a80b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:37.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.858+0000 7f12adf62700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f12a80b32f0 0x7f12a80b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:37.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.858+0000 7f12adf62700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a8146470 con 0x7f12a814a0d0 2020-05-18T21:34:37.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.858+0000 7f12adf62700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a8146710 con 0x7f12a80b32f0 2020-05-18T21:34:37.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.858+0000 7f12adf62700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a81469b0 con 0x7f12a8149650 2020-05-18T21:34:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.858+0000 7f12ad761700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f12a80b32f0 0x7f12a80b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.858+0000 7f12ad761700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f12a80b32f0 0x7f12a80b37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33966/0 (socket says 172.21.15.63:33966) 2020-05-18T21:34:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.858+0000 7f12ad761700 1 -- 172.21.15.63:0/1001267596 learned_addr learned my addr 172.21.15.63:0/1001267596 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.858+0000 7f12a7fff700 1 --2- 172.21.15.63:0/1001267596 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12a8149650 0x7f12a80b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.858+0000 7f12ad761700 1 -- 172.21.15.63:0/1001267596 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12a8149650 msgr2=0x7f12a80b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.858+0000 7f12ad761700 1 --2- 172.21.15.63:0/1001267596 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12a8149650 0x7f12a80b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.858+0000 7f12ad761700 1 -- 172.21.15.63:0/1001267596 >> v1:172.21.15.155:6789/0 conn(0x7f12a814a0d0 legacy=0x7f12a80b8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.858+0000 7f12ad761700 1 -- 172.21.15.63:0/1001267596 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a814a4b0 con 0x7f12a80b32f0 2020-05-18T21:34:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.858+0000 7f12ad761700 1 --2- 172.21.15.63:0/1001267596 >> v2:172.21.15.63:3300/0 conn(0x7f12a80b32f0 0x7f12a80b37a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f12a8146d30 tx=0x7f12a0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.858+0000 7f12ad761700 1 --2- 172.21.15.63:0/1001267596 >> v2:172.21.15.63:3300/0 conn(0x7f12a80b32f0 0x7f12a80b37a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f12a8146d30 tx=0x7f12a0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.862+0000 7f12ad761700 1 --2- 172.21.15.63:0/1001267596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12a80b32f0 0x7f12a80b37a0 secure :-1 s=READY pgs=1708 cs=0 l=1 rx=0x7f12a8146d30 tx=0x7f12a0008ca0).ready entity=mon.0 client_cookie=8879c3e6c273eba9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.862+0000 7f12ad761700 1 --2- 172.21.15.63:0/1001267596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12a80b32f0 0x7f12a80b37a0 secure :-1 s=THROTTLE_DONE pgs=1708 cs=0 l=1 rx=0x7f12a8146d30 tx=0x7f12a0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.862+0000 7f12ad761700 1 --2- 172.21.15.63:0/1001267596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12a80b32f0 0x7f12a80b37a0 secure :-1 s=THROTTLE_DONE pgs=1708 cs=0 l=1 rx=0x7f12a8146d30 tx=0x7f12a0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.862+0000 7f12a77fe700 1 -- 172.21.15.63:0/1001267596 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12a0011d10 con 0x7f12a80b32f0 2020-05-18T21:34:37.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.862+0000 7f12ad761700 1 --2- 172.21.15.63:0/1001267596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12a80b32f0 0x7f12a80b37a0 secure :-1 s=THROTTLE_DONE pgs=1708 cs=0 l=1 rx=0x7f12a8146d30 tx=0x7f12a0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:37.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.862+0000 7f12a77fe700 1 -- 172.21.15.63:0/1001267596 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a0011e70 con 0x7f12a80b32f0 2020-05-18T21:34:37.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.862+0000 7f12a77fe700 1 -- 172.21.15.63:0/1001267596 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12a000a370 con 0x7f12a80b32f0 2020-05-18T21:34:37.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.862+0000 7f12adf62700 1 -- 172.21.15.63:0/1001267596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12a80b32f0 msgr2=0x7f12a80b37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:37.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.862+0000 7f12adf62700 1 --2- 172.21.15.63:0/1001267596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12a80b32f0 0x7f12a80b37a0 secure :-1 s=READY pgs=1708 cs=0 l=1 rx=0x7f12a8146d30 tx=0x7f12a0008ca0).stop 2020-05-18T21:34:37.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.862+0000 7f12adf62700 1 -- 172.21.15.63:0/1001267596 shutdown_connections 2020-05-18T21:34:37.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.862+0000 7f12adf62700 1 --2- 172.21.15.63:0/1001267596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12a80b32f0 0x7f12a80b37a0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:37.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.862+0000 7f12adf62700 1 --2- 172.21.15.63:0/1001267596 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12a8149650 0x7f12a80b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:37.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.862+0000 7f12adf62700 1 -- 172.21.15.63:0/1001267596 >> 172.21.15.63:0/1001267596 conn(0x7f12a805f620 msgr2=0x7f12a80b84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:37.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.862+0000 7f12adf62700 1 -- 172.21.15.63:0/1001267596 shutdown_connections 2020-05-18T21:34:37.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.862+0000 7f12adf62700 1 -- 172.21.15.63:0/1001267596 wait complete. 2020-05-18T21:34:37.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.862+0000 7f12adf62700 1 Processor -- start 2020-05-18T21:34:37.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.862+0000 7f12adf62700 1 -- start start 2020-05-18T21:34:37.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12adf62700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f12a80b32f0 0x7f12a8140fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:37.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12adf62700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f12a8149650 0x7f12a8142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:37.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12adf62700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a81433f0 con 0x7f12a814a0d0 2020-05-18T21:34:37.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12adf62700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a8143670 con 0x7f12a8149650 2020-05-18T21:34:37.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12adf62700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a8143910 con 0x7f12a80b32f0 2020-05-18T21:34:37.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f12a8149650 0x7f12a8142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:37.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f12a8149650 0x7f12a8142f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33968/0 (socket says 172.21.15.63:33968) 2020-05-18T21:34:37.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a7fff700 1 -- 172.21.15.63:0/1409086803 learned_addr learned my addr 172.21.15.63:0/1409086803 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:37.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12acf60700 1 --2- 172.21.15.63:0/1409086803 >> v2:172.21.15.155:3300/0 conn(0x7f12a80b32f0 0x7f12a8140fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:37.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a7fff700 1 -- 172.21.15.63:0/1409086803 >> v2:172.21.15.155:3300/0 conn(0x7f12a80b32f0 msgr2=0x7f12a8140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:37.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a7fff700 1 --2- 172.21.15.63:0/1409086803 >> v2:172.21.15.155:3300/0 conn(0x7f12a80b32f0 0x7f12a8140fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:37.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a7fff700 1 -- 172.21.15.63:0/1409086803 >> v1:172.21.15.63:6789/0 conn(0x7f12a814a0d0 legacy=0x7f12a80af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:37.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a7fff700 1 -- 172.21.15.63:0/1409086803 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a8143bb0 con 0x7f12a8149650 2020-05-18T21:34:37.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a5ffb700 1 -- 172.21.15.63:0/1409086803 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331337036 0 0) 0x7f12a81433f0 con 0x7f12a814a0d0 2020-05-18T21:34:37.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12acf60700 1 --2- 172.21.15.63:0/1409086803 >> v2:172.21.15.155:3300/0 conn(0x7f12a80b32f0 0x7f12a8140fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:34:37.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a7fff700 1 --2- 172.21.15.63:0/1409086803 >> v2:172.21.15.63:3300/0 conn(0x7f12a8149650 0x7f12a8142f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1298002f70 tx=0x7f1298010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:37.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a7fff700 1 --2- 172.21.15.63:0/1409086803 >> v2:172.21.15.63:3300/0 conn(0x7f12a8149650 0x7f12a8142f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1298002f70 tx=0x7f1298010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:37.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a7fff700 1 --2- 172.21.15.63:0/1409086803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12a8149650 0x7f12a8142f90 secure :-1 s=READY pgs=1710 cs=0 l=1 rx=0x7f1298002f70 tx=0x7f1298010d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:37.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a7fff700 1 --2- 172.21.15.63:0/1409086803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12a8149650 0x7f12a8142f90 secure :-1 s=THROTTLE_DONE pgs=1710 cs=0 l=1 rx=0x7f1298002f70 tx=0x7f1298010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:37.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a7fff700 1 --2- 172.21.15.63:0/1409086803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12a8149650 0x7f12a8142f90 secure :-1 s=THROTTLE_DONE pgs=1710 cs=0 l=1 rx=0x7f1298002f70 tx=0x7f1298010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:37.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a5ffb700 1 -- 172.21.15.63:0/1409086803 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1298007550 con 0x7f12a8149650 2020-05-18T21:34:37.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a7fff700 1 --2- 172.21.15.63:0/1409086803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12a8149650 0x7f12a8142f90 secure :-1 s=THROTTLE_DONE pgs=1710 cs=0 l=1 rx=0x7f1298002f70 tx=0x7f1298010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:37.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a5ffb700 1 -- 172.21.15.63:0/1409086803 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12980127b0 con 0x7f12a8149650 2020-05-18T21:34:37.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12adf62700 1 -- 172.21.15.63:0/1409086803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a8145060 con 0x7f12a8149650 2020-05-18T21:34:37.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a5ffb700 1 -- 172.21.15.63:0/1409086803 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1298012b50 con 0x7f12a8149650 2020-05-18T21:34:37.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12adf62700 1 -- 172.21.15.63:0/1409086803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a8140930 con 0x7f12a8149650 2020-05-18T21:34:37.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a7fff700 1 --2- 172.21.15.63:0/1409086803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12a8149650 0x7f12a8142f90 secure :-1 s=THROTTLE_DONE pgs=1710 cs=0 l=1 rx=0x7f1298002f70 tx=0x7f1298010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:37.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12adf62700 1 -- 172.21.15.63:0/1409086803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a80569e0 con 0x7f12a8149650 2020-05-18T21:34:37.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a5ffb700 1 -- 172.21.15.63:0/1409086803 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1298005700 con 0x7f12a8149650 2020-05-18T21:34:37.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.866+0000 7f12a7fff700 1 --2- 172.21.15.63:0/1409086803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12a8149650 0x7f12a8142f90 secure :-1 s=THROTTLE_DONE pgs=1710 cs=0 l=1 rx=0x7f1298002f70 tx=0x7f1298010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:37.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.870+0000 7f12a5ffb700 1 --2- 172.21.15.63:0/1409086803 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f128c04f8a0 0x7f128c051d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:37.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.870+0000 7f12a5ffb700 1 -- 172.21.15.63:0/1409086803 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1298064300 con 0x7f12a8149650 2020-05-18T21:34:37.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.870+0000 7f12acf60700 1 --2- 172.21.15.63:0/1409086803 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f128c04f8a0 0x7f128c051d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:37.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.870+0000 7f12acf60700 1 --2- 172.21.15.63:0/1409086803 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f128c04f8a0 0x7f128c051d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f12a8061010 tx=0x7f12900017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:37.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.870+0000 7f12acf60700 1 --2- 172.21.15.63:0/1409086803 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f128c04f8a0 0x7f128c051d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f12a8061010 tx=0x7f12900017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:37.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.870+0000 7f12acf60700 1 --2- 172.21.15.63:0/1409086803 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f128c04f8a0 0x7f128c051d60 secure :-1 s=READY pgs=660 cs=0 l=1 rx=0x7f12a8061010 tx=0x7f12900017f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:37.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.874+0000 7f12a7fff700 1 --2- 172.21.15.63:0/1409086803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12a8149650 0x7f12a8142f90 secure :-1 s=THROTTLE_DONE pgs=1710 cs=0 l=1 rx=0x7f1298002f70 tx=0x7f1298010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:37.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:37.874+0000 7f12a5ffb700 1 -- 172.21.15.63:0/1409086803 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f129803e630 con 0x7f12a8149650 2020-05-18T21:34:38.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:38.026+0000 7f12adf62700 1 -- 172.21.15.63:0/1409086803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12a80678d0 con 0x7f12a8149650 2020-05-18T21:34:38.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:38.026+0000 7f12a7fff700 1 --2- 172.21.15.63:0/1409086803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12a8149650 0x7f12a8142f90 secure :-1 s=THROTTLE_DONE pgs=1710 cs=0 l=1 rx=0x7f1298002f70 tx=0x7f1298010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:38.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:38.026+0000 7f12a5ffb700 1 -- 172.21.15.63:0/1409086803 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+1792 (secure 0 0 0) 0x7f1298041c50 con 0x7f12a8149650 2020-05-18T21:34:38.031 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:38.031 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":94,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:34:27.767123+0000","modified":"2020-05-18T21:34:37.243818+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"a","rank":0,"incarnation":94,"state":"up:replay","state_seq":1,"addr":"172.21.15.63:6833/1314928434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1314928434},{"type":"v1","addr":"172.21.15.63:6833","nonce":1314928434}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-05-18T21:34:38.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:38.026+0000 7f12adf62700 1 -- 172.21.15.63:0/1409086803 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f128c04f8a0 msgr2=0x7f128c051d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:38.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:38.026+0000 7f12adf62700 1 --2- 172.21.15.63:0/1409086803 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f128c04f8a0 0x7f128c051d60 secure :-1 s=READY pgs=660 cs=0 l=1 rx=0x7f12a8061010 tx=0x7f12900017f0).stop 2020-05-18T21:34:38.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:38.026+0000 7f12adf62700 1 -- 172.21.15.63:0/1409086803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12a8149650 msgr2=0x7f12a8142f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:38.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:38.026+0000 7f12adf62700 1 --2- 172.21.15.63:0/1409086803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12a8149650 0x7f12a8142f90 secure :-1 s=READY pgs=1710 cs=0 l=1 rx=0x7f1298002f70 tx=0x7f1298010d20).stop 2020-05-18T21:34:38.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:38.026+0000 7f12adf62700 1 -- 172.21.15.63:0/1409086803 shutdown_connections 2020-05-18T21:34:38.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:38.026+0000 7f12adf62700 1 --2- 172.21.15.63:0/1409086803 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f128c04f8a0 0x7f128c051d60 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:38.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:38.026+0000 7f12adf62700 1 --2- 172.21.15.63:0/1409086803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12a8149650 0x7f12a8142f90 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:38.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:38.026+0000 7f12adf62700 1 --2- 172.21.15.63:0/1409086803 >> v2:172.21.15.155:3300/0 conn(0x7f12a80b32f0 0x7f12a8140fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:38.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:38.026+0000 7f12adf62700 1 -- 172.21.15.63:0/1409086803 >> 172.21.15.63:0/1409086803 conn(0x7f12a805f620 msgr2=0x7f12a80b84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:38.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:38.026+0000 7f12adf62700 1 -- 172.21.15.63:0/1409086803 shutdown_connections 2020-05-18T21:34:38.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:38.026+0000 7f12adf62700 1 -- 172.21.15.63:0/1409086803 wait complete. 2020-05-18T21:34:38.035 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 94 2020-05-18T21:34:38.245 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 94, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:34:27.767123+0000', 'modified': '2020-05-18T21:34:37.243818+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 124, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9294': {'gid': 9294, 'name': 'a', 'rank': 0, 'incarnation': 94, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.63:6833/1314928434', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 1314928434}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 1314928434}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:34:38.246 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9294:up:replay 2020-05-18T21:34:39.247 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:34:39.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007ffff700 1 Processor -- start 2020-05-18T21:34:39.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007ffff700 1 -- start start 2020-05-18T21:34:39.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f008005a7c0 0x7f008014b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:39.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f00800615b0 0x7f008014daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:39.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007ffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008005ac60 con 0x7f00800b8f40 2020-05-18T21:34:39.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007ffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008005af00 con 0x7f00800615b0 2020-05-18T21:34:39.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007ffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008005b1a0 con 0x7f008005a7c0 2020-05-18T21:34:39.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007e7fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f008005a7c0 0x7f008014b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:39.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007e7fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f008005a7c0 0x7f008014b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:52914/0 (socket says 172.21.15.63:52914) 2020-05-18T21:34:39.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007effd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f00800b8f40 0x7f008014aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:34482/0 (socket says 172.21.15.63:34482) 2020-05-18T21:34:39.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007e7fc700 1 -- 172.21.15.63:0/1706299256 learned_addr learned my addr 172.21.15.63:0/1706299256 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:39.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007f7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f00800615b0 0x7f008014daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:39.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007dffb700 1 -- 172.21.15.63:0/1706299256 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661773136 0 0) 0x7f008005ac60 con 0x7f00800b8f40 2020-05-18T21:34:39.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007dffb700 1 -- 172.21.15.63:0/1706299256 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0060003270 con 0x7f00800b8f40 2020-05-18T21:34:39.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007e7fc700 1 -- 172.21.15.63:0/1706299256 >> v2:172.21.15.155:3300/0 conn(0x7f00800615b0 msgr2=0x7f008014daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:34:39.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007e7fc700 1 --2- 172.21.15.63:0/1706299256 >> v2:172.21.15.155:3300/0 conn(0x7f00800615b0 0x7f008014daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:39.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007e7fc700 1 -- 172.21.15.63:0/1706299256 >> v1:172.21.15.155:6789/0 conn(0x7f00800b8f40 legacy=0x7f008014aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:39.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007e7fc700 1 -- 172.21.15.63:0/1706299256 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00800af2e0 con 0x7f008005a7c0 2020-05-18T21:34:39.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007e7fc700 1 --2- 172.21.15.63:0/1706299256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f008005a7c0 0x7f008014b1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f00680032f0 tx=0x7f0068007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:39.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007e7fc700 1 --2- 172.21.15.63:0/1706299256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f008005a7c0 0x7f008014b1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f00680032f0 tx=0x7f0068007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:39.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007e7fc700 1 --2- 172.21.15.63:0/1706299256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f008005a7c0 0x7f008014b1f0 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7f00680032f0 tx=0x7f0068007e00).ready entity=mon.2 client_cookie=8d6b23cb344b9648 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007e7fc700 1 --2- 172.21.15.63:0/1706299256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f008005a7c0 0x7f008014b1f0 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f00680032f0 tx=0x7f0068007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007dffb700 1 -- 172.21.15.63:0/1706299256 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0068011c60 con 0x7f008005a7c0 2020-05-18T21:34:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007e7fc700 1 --2- 172.21.15.63:0/1706299256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f008005a7c0 0x7f008014b1f0 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f00680032f0 tx=0x7f0068007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007e7fc700 1 --2- 172.21.15.63:0/1706299256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f008005a7c0 0x7f008014b1f0 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f00680032f0 tx=0x7f0068007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007dffb700 1 -- 172.21.15.63:0/1706299256 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0068011dc0 con 0x7f008005a7c0 2020-05-18T21:34:39.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007dffb700 1 -- 172.21.15.63:0/1706299256 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f006800a370 con 0x7f008005a7c0 2020-05-18T21:34:39.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007ffff700 1 -- 172.21.15.63:0/1706299256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f008005a7c0 msgr2=0x7f008014b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:39.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.354+0000 7f007ffff700 1 --2- 172.21.15.63:0/1706299256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f008005a7c0 0x7f008014b1f0 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7f00680032f0 tx=0x7f0068007e00).stop 2020-05-18T21:34:39.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.358+0000 7f007ffff700 1 -- 172.21.15.63:0/1706299256 shutdown_connections 2020-05-18T21:34:39.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.358+0000 7f007ffff700 1 --2- 172.21.15.63:0/1706299256 >> v2:172.21.15.155:3300/0 conn(0x7f00800615b0 0x7f008014daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:34:39.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.358+0000 7f007ffff700 1 --2- 172.21.15.63:0/1706299256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f008005a7c0 0x7f008014b1f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:39.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.358+0000 7f007ffff700 1 -- 172.21.15.63:0/1706299256 >> 172.21.15.63:0/1706299256 conn(0x7f008005f620 msgr2=0x7f00800b84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:39.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.358+0000 7f007ffff700 1 -- 172.21.15.63:0/1706299256 shutdown_connections 2020-05-18T21:34:39.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.358+0000 7f007ffff700 1 -- 172.21.15.63:0/1706299256 wait complete. 2020-05-18T21:34:39.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.358+0000 7f007ffff700 1 Processor -- start 2020-05-18T21:34:39.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.358+0000 7f007ffff700 1 -- start start 2020-05-18T21:34:39.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f008005a7c0 0x7f008011a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:39.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00800615b0 0x7f008011a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:39.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007ffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0080062d70 con 0x7f00800b8f40 2020-05-18T21:34:39.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007ffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00801590e0 con 0x7f008005a7c0 2020-05-18T21:34:39.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007ffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0080159380 con 0x7f00800615b0 2020-05-18T21:34:39.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f00800b8f40 0x7f0080157970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36176/0 (socket says 172.21.15.63:36176) 2020-05-18T21:34:39.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007f7fe700 1 -- 172.21.15.63:0/1148844192 learned_addr learned my addr 172.21.15.63:0/1148844192 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:39.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007e7fc700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00800615b0 0x7f008011a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:39.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007effd700 1 --2- 172.21.15.63:0/1148844192 >> v2:172.21.15.155:3300/0 conn(0x7f008005a7c0 0x7f008011a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:39.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f0077fff700 1 -- 172.21.15.63:0/1148844192 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133278823 0 0) 0x7f0080062d70 con 0x7f00800b8f40 2020-05-18T21:34:39.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f0077fff700 1 -- 172.21.15.63:0/1148844192 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0064002fe0 con 0x7f00800b8f40 2020-05-18T21:34:39.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007effd700 1 -- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00800615b0 msgr2=0x7f008011a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:39.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007effd700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00800615b0 0x7f008011a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:39.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007effd700 1 -- 172.21.15.63:0/1148844192 >> v1:172.21.15.63:6789/0 conn(0x7f00800b8f40 legacy=0x7f0080157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:39.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007effd700 1 -- 172.21.15.63:0/1148844192 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00800b0ab0 con 0x7f008005a7c0 2020-05-18T21:34:39.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007effd700 1 --2- 172.21.15.63:0/1148844192 >> v2:172.21.15.155:3300/0 conn(0x7f008005a7c0 0x7f008011a020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0078001110 tx=0x7f0078010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:39.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007effd700 1 --2- 172.21.15.63:0/1148844192 >> v2:172.21.15.155:3300/0 conn(0x7f008005a7c0 0x7f008011a020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0078001110 tx=0x7f0078010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:39.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007effd700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f008005a7c0 0x7f008011a020 secure :-1 s=READY pgs=1128 cs=0 l=1 rx=0x7f0078001110 tx=0x7f0078010910).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:39.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007effd700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f008005a7c0 0x7f008011a020 secure :-1 s=THROTTLE_DONE pgs=1128 cs=0 l=1 rx=0x7f0078001110 tx=0x7f0078010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:39.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f0077fff700 1 -- 172.21.15.63:0/1148844192 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0078005c40 con 0x7f008005a7c0 2020-05-18T21:34:39.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007effd700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f008005a7c0 0x7f008011a020 secure :-1 s=THROTTLE_DONE pgs=1128 cs=0 l=1 rx=0x7f0078001110 tx=0x7f0078010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:39.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f0077fff700 1 -- 172.21.15.63:0/1148844192 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0078005da0 con 0x7f008005a7c0 2020-05-18T21:34:39.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007effd700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f008005a7c0 0x7f008011a020 secure :-1 s=THROTTLE_DONE pgs=1128 cs=0 l=1 rx=0x7f0078001110 tx=0x7f0078010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:39.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007ffff700 1 -- 172.21.15.63:0/1148844192 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008011a8e0 con 0x7f008005a7c0 2020-05-18T21:34:39.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f0077fff700 1 -- 172.21.15.63:0/1148844192 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00780062c0 con 0x7f008005a7c0 2020-05-18T21:34:39.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007ffff700 1 -- 172.21.15.63:0/1148844192 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0080065220 con 0x7f008005a7c0 2020-05-18T21:34:39.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007effd700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f008005a7c0 0x7f008011a020 secure :-1 s=THROTTLE_DONE pgs=1128 cs=0 l=1 rx=0x7f0078001110 tx=0x7f0078010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:39.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.362+0000 7f007ffff700 1 -- 172.21.15.63:0/1148844192 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00800b0c40 con 0x7f008005a7c0 2020-05-18T21:34:39.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.366+0000 7f0077fff700 1 -- 172.21.15.63:0/1148844192 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0078006580 con 0x7f008005a7c0 2020-05-18T21:34:39.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.366+0000 7f007effd700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f008005a7c0 0x7f008011a020 secure :-1 s=THROTTLE_DONE pgs=1128 cs=0 l=1 rx=0x7f0078001110 tx=0x7f0078010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:39.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.366+0000 7f0077fff700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f006404fd70 0x7f0064052230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:39.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.366+0000 7f0077fff700 1 -- 172.21.15.63:0/1148844192 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f00780090c0 con 0x7f008005a7c0 2020-05-18T21:34:39.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.366+0000 7f007e7fc700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f006404fd70 0x7f0064052230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:39.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.366+0000 7f007e7fc700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f006404fd70 0x7f0064052230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f00680032f0 tx=0x7f0068007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:39.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.366+0000 7f007e7fc700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f006404fd70 0x7f0064052230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f00680032f0 tx=0x7f0068007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:39.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.366+0000 7f007e7fc700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f006404fd70 0x7f0064052230 secure :-1 s=READY pgs=661 cs=0 l=1 rx=0x7f00680032f0 tx=0x7f0068007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:39.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.374+0000 7f007effd700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f008005a7c0 0x7f008011a020 secure :-1 s=THROTTLE_DONE pgs=1128 cs=0 l=1 rx=0x7f0078001110 tx=0x7f0078010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:39.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.374+0000 7f0077fff700 1 -- 172.21.15.63:0/1148844192 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f00800b0c40 con 0x7f008005a7c0 2020-05-18T21:34:39.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.522+0000 7f007ffff700 1 -- 172.21.15.63:0/1148844192 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00800b0c40 con 0x7f008005a7c0 2020-05-18T21:34:39.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.526+0000 7f007effd700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f008005a7c0 0x7f008011a020 secure :-1 s=THROTTLE_DONE pgs=1128 cs=0 l=1 rx=0x7f0078001110 tx=0x7f0078010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:39.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.526+0000 7f0077fff700 1 -- 172.21.15.63:0/1148844192 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+1792 (secure 0 0 0) 0x7f00800b0c40 con 0x7f008005a7c0 2020-05-18T21:34:39.530 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:39.530 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":96,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:34:27.767123+0000","modified":"2020-05-18T21:34:39.260925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"a","rank":0,"incarnation":94,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.63:6833/1314928434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1314928434},{"type":"v1","addr":"172.21.15.63:6833","nonce":1314928434}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-05-18T21:34:39.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.526+0000 7f007ffff700 1 -- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f006404fd70 msgr2=0x7f0064052230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:39.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.526+0000 7f007ffff700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f006404fd70 0x7f0064052230 secure :-1 s=READY pgs=661 cs=0 l=1 rx=0x7f00680032f0 tx=0x7f0068007e00).stop 2020-05-18T21:34:39.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.526+0000 7f007ffff700 1 -- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f008005a7c0 msgr2=0x7f008011a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:39.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.526+0000 7f007ffff700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f008005a7c0 0x7f008011a020 secure :-1 s=READY pgs=1128 cs=0 l=1 rx=0x7f0078001110 tx=0x7f0078010910).stop 2020-05-18T21:34:39.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.526+0000 7f007ffff700 1 -- 172.21.15.63:0/1148844192 shutdown_connections 2020-05-18T21:34:39.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.526+0000 7f007ffff700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f006404fd70 0x7f0064052230 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:39.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.526+0000 7f007ffff700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00800615b0 0x7f008011a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:39.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.526+0000 7f007ffff700 1 --2- 172.21.15.63:0/1148844192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f008005a7c0 0x7f008011a020 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:39.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.526+0000 7f007ffff700 1 -- 172.21.15.63:0/1148844192 >> 172.21.15.63:0/1148844192 conn(0x7f008005f620 msgr2=0x7f00800b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:39.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.526+0000 7f007ffff700 1 -- 172.21.15.63:0/1148844192 shutdown_connections 2020-05-18T21:34:39.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:39.526+0000 7f007ffff700 1 -- 172.21.15.63:0/1148844192 wait complete. 2020-05-18T21:34:39.535 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 96 2020-05-18T21:34:39.744 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 96, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:34:27.767123+0000', 'modified': '2020-05-18T21:34:39.260925+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 124, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9294': {'gid': 9294, 'name': 'a', 'rank': 0, 'incarnation': 94, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.63:6833/1314928434', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 1314928434}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 1314928434}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:34:39.744 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9294:up:rejoin 2020-05-18T21:34:40.745 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:34:40.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc183d64700 1 Processor -- start 2020-05-18T21:34:40.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc183d64700 1 -- start start 2020-05-18T21:34:40.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc183d64700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc17c0648f0 0x7fc17c066680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:40.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc183d64700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c14aa50 con 0x7fc17c14da70 2020-05-18T21:34:40.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc183d64700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c0b5430 con 0x7fc17c0b5050 2020-05-18T21:34:40.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc183d64700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17c14a840 con 0x7fc17c0648f0 2020-05-18T21:34:40.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc182301700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc17c0648f0 0x7fc17c066680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:40.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc1812ff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc17c14da70 0x7fc17c065f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36180/0 (socket says 172.21.15.63:36180) 2020-05-18T21:34:40.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc1812ff700 1 -- 172.21.15.63:0/2487682248 learned_addr learned my addr 172.21.15.63:0/2487682248 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:40.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc182301700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc17c0648f0 0x7fc17c066680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33996/0 (socket says 172.21.15.63:33996) 2020-05-18T21:34:40.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc182301700 1 -- 172.21.15.63:0/2487682248 >> v1:172.21.15.155:6789/0 conn(0x7fc17c0b5050 legacy=0x7fc17c14aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:40.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc182301700 1 -- 172.21.15.63:0/2487682248 >> v1:172.21.15.63:6789/0 conn(0x7fc17c14da70 legacy=0x7fc17c065f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:40.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc182301700 1 -- 172.21.15.63:0/2487682248 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c066ae0 con 0x7fc17c0648f0 2020-05-18T21:34:40.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc182301700 1 --2- 172.21.15.63:0/2487682248 >> v2:172.21.15.63:3300/0 conn(0x7fc17c0648f0 0x7fc17c066680 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc1740032f0 tx=0x7fc174007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:40.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc182301700 1 --2- 172.21.15.63:0/2487682248 >> v2:172.21.15.63:3300/0 conn(0x7fc17c0648f0 0x7fc17c066680 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc1740032f0 tx=0x7fc174007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:40.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc182301700 1 --2- 172.21.15.63:0/2487682248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc17c0648f0 0x7fc17c066680 secure :-1 s=READY pgs=1713 cs=0 l=1 rx=0x7fc1740032f0 tx=0x7fc174007e00).ready entity=mon.0 client_cookie=957476b6cc6c5abf server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:40.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc182301700 1 --2- 172.21.15.63:0/2487682248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc17c0648f0 0x7fc17c066680 secure :-1 s=THROTTLE_DONE pgs=1713 cs=0 l=1 rx=0x7fc1740032f0 tx=0x7fc174007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:40.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc182301700 1 --2- 172.21.15.63:0/2487682248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc17c0648f0 0x7fc17c066680 secure :-1 s=THROTTLE_DONE pgs=1713 cs=0 l=1 rx=0x7fc1740032f0 tx=0x7fc174007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:40.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc180afe700 1 -- 172.21.15.63:0/2487682248 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc17400a180 con 0x7fc17c0648f0 2020-05-18T21:34:40.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc182301700 1 --2- 172.21.15.63:0/2487682248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc17c0648f0 0x7fc17c066680 secure :-1 s=THROTTLE_DONE pgs=1713 cs=0 l=1 rx=0x7fc1740032f0 tx=0x7fc174007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:40.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.854+0000 7fc180afe700 1 -- 172.21.15.63:0/2487682248 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17400a2e0 con 0x7fc17c0648f0 2020-05-18T21:34:40.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.858+0000 7fc180afe700 1 -- 172.21.15.63:0/2487682248 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc17400a700 con 0x7fc17c0648f0 2020-05-18T21:34:40.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.858+0000 7fc183d64700 1 -- 172.21.15.63:0/2487682248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc17c0648f0 msgr2=0x7fc17c066680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:40.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.858+0000 7fc183d64700 1 --2- 172.21.15.63:0/2487682248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc17c0648f0 0x7fc17c066680 secure :-1 s=READY pgs=1713 cs=0 l=1 rx=0x7fc1740032f0 tx=0x7fc174007e00).stop 2020-05-18T21:34:40.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.858+0000 7fc183d64700 1 -- 172.21.15.63:0/2487682248 shutdown_connections 2020-05-18T21:34:40.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.858+0000 7fc183d64700 1 --2- 172.21.15.63:0/2487682248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc17c0648f0 0x7fc17c066680 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:40.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.858+0000 7fc183d64700 1 -- 172.21.15.63:0/2487682248 >> 172.21.15.63:0/2487682248 conn(0x7fc17c0b8630 msgr2=0x7fc17c0b8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:40.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.858+0000 7fc183d64700 1 -- 172.21.15.63:0/2487682248 shutdown_connections 2020-05-18T21:34:40.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.858+0000 7fc183d64700 1 -- 172.21.15.63:0/2487682248 wait complete. 2020-05-18T21:34:40.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.858+0000 7fc183d64700 1 Processor -- start 2020-05-18T21:34:40.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.858+0000 7fc183d64700 1 -- start start 2020-05-18T21:34:40.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc183d64700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc17c0648f0 0x7fc17c0ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:40.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc183d64700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc17c0b5050 0x7fc17c0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:40.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc183d64700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c0af180 con 0x7fc17c14da70 2020-05-18T21:34:40.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc183d64700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17c0af420 con 0x7fc17c0b5050 2020-05-18T21:34:40.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc183d64700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c0af6c0 con 0x7fc17c0648f0 2020-05-18T21:34:40.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc181b00700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc17c0648f0 0x7fc17c0ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:40.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc181b00700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc17c0648f0 0x7fc17c0ac9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:52932/0 (socket says 172.21.15.63:52932) 2020-05-18T21:34:40.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc1812ff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc17c0b5050 0x7fc17c0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:40.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc181b00700 1 -- 172.21.15.63:0/2640690424 learned_addr learned my addr 172.21.15.63:0/2640690424 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:34:40.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc181b00700 1 -- 172.21.15.63:0/2640690424 >> v2:172.21.15.155:3300/0 conn(0x7fc17c0b5050 msgr2=0x7fc17c0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:40.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc181b00700 1 --2- 172.21.15.63:0/2640690424 >> v2:172.21.15.155:3300/0 conn(0x7fc17c0b5050 0x7fc17c0ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:40.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc181b00700 1 -- 172.21.15.63:0/2640690424 >> v1:172.21.15.155:6789/0 conn(0x7fc17c14da70 legacy=0x7fc17c12ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:40.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc181b00700 1 -- 172.21.15.63:0/2640690424 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c12f680 con 0x7fc17c0648f0 2020-05-18T21:34:40.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc181b00700 1 --2- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc17c0648f0 0x7fc17c0ac9f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc17c0b5b60 tx=0x7fc17c05fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:40.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc181b00700 1 --2- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc17c0648f0 0x7fc17c0ac9f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc17c0b5b60 tx=0x7fc17c05fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:40.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc181b00700 1 --2- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc17c0648f0 0x7fc17c0ac9f0 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7fc17c0b5b60 tx=0x7fc17c05fbd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc181b00700 1 --2- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc17c0648f0 0x7fc17c0ac9f0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7fc17c0b5b60 tx=0x7fc17c05fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc16effd700 1 -- 172.21.15.63:0/2640690424 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc17000ccb0 con 0x7fc17c0648f0 2020-05-18T21:34:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc181b00700 1 --2- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc17c0648f0 0x7fc17c0ac9f0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7fc17c0b5b60 tx=0x7fc17c05fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc181b00700 1 --2- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc17c0648f0 0x7fc17c0ac9f0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7fc17c0b5b60 tx=0x7fc17c05fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc16effd700 1 -- 172.21.15.63:0/2640690424 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17000ce10 con 0x7fc17c0648f0 2020-05-18T21:34:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc16effd700 1 -- 172.21.15.63:0/2640690424 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc170012240 con 0x7fc17c0648f0 2020-05-18T21:34:40.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc183d64700 1 -- 172.21.15.63:0/2640690424 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17c0ace50 con 0x7fc17c0648f0 2020-05-18T21:34:40.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.862+0000 7fc183d64700 1 -- 172.21.15.63:0/2640690424 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17c157d60 con 0x7fc17c0648f0 2020-05-18T21:34:40.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.866+0000 7fc181b00700 1 --2- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc17c0648f0 0x7fc17c0ac9f0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7fc17c0b5b60 tx=0x7fc17c05fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:40.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.866+0000 7fc183d64700 1 -- 172.21.15.63:0/2640690424 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17c0569e0 con 0x7fc17c0648f0 2020-05-18T21:34:40.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.866+0000 7fc16effd700 1 -- 172.21.15.63:0/2640690424 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc170006570 con 0x7fc17c0648f0 2020-05-18T21:34:40.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.866+0000 7fc181b00700 1 --2- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc17c0648f0 0x7fc17c0ac9f0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7fc17c0b5b60 tx=0x7fc17c05fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:40.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.866+0000 7fc16effd700 1 --2- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc15c04fab0 0x7fc15c051f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:40.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.866+0000 7fc16effd700 1 -- 172.21.15.63:0/2640690424 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc1700636b0 con 0x7fc17c0648f0 2020-05-18T21:34:40.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.866+0000 7fc1812ff700 1 --2- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc15c04fab0 0x7fc15c051f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:40.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.866+0000 7fc1812ff700 1 --2- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc15c04fab0 0x7fc15c051f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc17c0b9320 tx=0x7fc178001dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:40.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.866+0000 7fc1812ff700 1 --2- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc15c04fab0 0x7fc15c051f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc17c0b9320 tx=0x7fc178001dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:40.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.866+0000 7fc1812ff700 1 --2- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc15c04fab0 0x7fc15c051f70 secure :-1 s=READY pgs=662 cs=0 l=1 rx=0x7fc17c0b9320 tx=0x7fc178001dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:40.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.874+0000 7fc181b00700 1 --2- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc17c0648f0 0x7fc17c0ac9f0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7fc17c0b5b60 tx=0x7fc17c05fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:40.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:40.874+0000 7fc16effd700 1 -- 172.21.15.63:0/2640690424 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc17003da40 con 0x7fc17c0648f0 2020-05-18T21:34:41.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:41.026+0000 7fc183d64700 1 -- 172.21.15.63:0/2640690424 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc17c0aef60 con 0x7fc17c0648f0 2020-05-18T21:34:41.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:41.026+0000 7fc181b00700 1 --2- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc17c0648f0 0x7fc17c0ac9f0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7fc17c0b5b60 tx=0x7fc17c05fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:41.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:41.026+0000 7fc16effd700 1 -- 172.21.15.63:0/2640690424 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+1798 (secure 0 0 0) 0x7fc170041060 con 0x7fc17c0648f0 2020-05-18T21:34:41.033 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:41.033 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":97,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:34:27.767123+0000","modified":"2020-05-18T21:34:40.271082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"a","rank":0,"incarnation":94,"state":"up:clientreplay","state_seq":4,"addr":"172.21.15.63:6833/1314928434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1314928434},{"type":"v1","addr":"172.21.15.63:6833","nonce":1314928434}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-05-18T21:34:41.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:41.030+0000 7fc183d64700 1 -- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc15c04fab0 msgr2=0x7fc15c051f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:41.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:41.030+0000 7fc183d64700 1 --2- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc15c04fab0 0x7fc15c051f70 secure :-1 s=READY pgs=662 cs=0 l=1 rx=0x7fc17c0b9320 tx=0x7fc178001dc0).stop 2020-05-18T21:34:41.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:41.030+0000 7fc183d64700 1 -- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc17c0648f0 msgr2=0x7fc17c0ac9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:41.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:41.030+0000 7fc183d64700 1 --2- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc17c0648f0 0x7fc17c0ac9f0 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7fc17c0b5b60 tx=0x7fc17c05fbd0).stop 2020-05-18T21:34:41.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:41.030+0000 7fc183d64700 1 -- 172.21.15.63:0/2640690424 shutdown_connections 2020-05-18T21:34:41.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:41.030+0000 7fc183d64700 1 --2- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc15c04fab0 0x7fc15c051f70 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:41.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:41.030+0000 7fc183d64700 1 --2- 172.21.15.63:0/2640690424 >> v2:172.21.15.155:3300/0 conn(0x7fc17c0b5050 0x7fc17c0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:41.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:41.030+0000 7fc183d64700 1 --2- 172.21.15.63:0/2640690424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc17c0648f0 0x7fc17c0ac9f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:41.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:41.030+0000 7fc183d64700 1 -- 172.21.15.63:0/2640690424 >> 172.21.15.63:0/2640690424 conn(0x7fc17c0b8630 msgr2=0x7fc17c149b90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:41.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:41.030+0000 7fc183d64700 1 -- 172.21.15.63:0/2640690424 shutdown_connections 2020-05-18T21:34:41.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:41.030+0000 7fc183d64700 1 -- 172.21.15.63:0/2640690424 wait complete. 2020-05-18T21:34:41.038 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 97 2020-05-18T21:34:41.248 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 97, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:34:27.767123+0000', 'modified': '2020-05-18T21:34:40.271082+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 124, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9294': {'gid': 9294, 'name': 'a', 'rank': 0, 'incarnation': 94, 'state': 'up:clientreplay', 'state_seq': 4, 'addr': '172.21.15.63:6833/1314928434', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 1314928434}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 1314928434}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:34:41.249 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9294:up:clientreplay 2020-05-18T21:34:42.250 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:34:42.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f131657e700 1 Processor -- start 2020-05-18T21:34:42.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f131657e700 1 -- start start 2020-05-18T21:34:42.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f131657e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f131014da70 0x7f13100648f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:34:42.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f131657e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131014aa50 con 0x7f1310065f70 2020-05-18T21:34:42.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f131657e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13100b5430 con 0x7f13100b5050 2020-05-18T21:34:42.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f131657e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131014a840 con 0x7f131014da70 2020-05-18T21:34:42.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f130f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f131014da70 0x7f13100648f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:42.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f1314b1b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1310065f70 0x7f13100663c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36198/0 (socket says 172.21.15.63:36198) 2020-05-18T21:34:42.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f1314b1b700 1 -- 172.21.15.63:0/2175528442 learned_addr learned my addr 172.21.15.63:0/2175528442 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:42.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f130effd700 1 -- 172.21.15.63:0/2175528442 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876359023 0 0) 0x7f131014aa50 con 0x7f1310065f70 2020-05-18T21:34:42.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f130effd700 1 -- 172.21.15.63:0/2175528442 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12f0003270 con 0x7f1310065f70 2020-05-18T21:34:42.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f130f7fe700 1 -- 172.21.15.63:0/2175528442 >> v1:172.21.15.155:6789/0 conn(0x7f13100b5050 legacy=0x7f131014aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:42.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f130f7fe700 1 -- 172.21.15.63:0/2175528442 >> v1:172.21.15.63:6789/0 conn(0x7f1310065f70 legacy=0x7f13100663c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:42.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f130effd700 1 -- 172.21.15.63:0/2175528442 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 184472541 0 0) 0x7f12f0003270 con 0x7f1310065f70 2020-05-18T21:34:42.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f130f7fe700 1 -- 172.21.15.63:0/2175528442 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1310066ad0 con 0x7f131014da70 2020-05-18T21:34:42.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f130f7fe700 1 --2- 172.21.15.63:0/2175528442 >> v2:172.21.15.63:3300/0 conn(0x7f131014da70 0x7f13100648f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f12f8002f70 tx=0x7f12f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:42.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f130f7fe700 1 --2- 172.21.15.63:0/2175528442 >> v2:172.21.15.63:3300/0 conn(0x7f131014da70 0x7f13100648f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f12f8002f70 tx=0x7f12f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:42.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f130f7fe700 1 --2- 172.21.15.63:0/2175528442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f131014da70 0x7f13100648f0 secure :-1 s=READY pgs=1715 cs=0 l=1 rx=0x7f12f8002f70 tx=0x7f12f8007a80).ready entity=mon.0 client_cookie=37b92b7d5cc8873c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:42.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f130f7fe700 1 --2- 172.21.15.63:0/2175528442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f131014da70 0x7f13100648f0 secure :-1 s=THROTTLE_DONE pgs=1715 cs=0 l=1 rx=0x7f12f8002f70 tx=0x7f12f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:42.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f130effd700 1 -- 172.21.15.63:0/2175528442 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12f8008e80 con 0x7f131014da70 2020-05-18T21:34:42.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f130f7fe700 1 --2- 172.21.15.63:0/2175528442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f131014da70 0x7f13100648f0 secure :-1 s=THROTTLE_DONE pgs=1715 cs=0 l=1 rx=0x7f12f8002f70 tx=0x7f12f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:42.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f130effd700 1 -- 172.21.15.63:0/2175528442 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f80115f0 con 0x7f131014da70 2020-05-18T21:34:42.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f130f7fe700 1 --2- 172.21.15.63:0/2175528442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f131014da70 0x7f13100648f0 secure :-1 s=THROTTLE_DONE pgs=1715 cs=0 l=1 rx=0x7f12f8002f70 tx=0x7f12f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:42.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f130effd700 1 -- 172.21.15.63:0/2175528442 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12f8011990 con 0x7f131014da70 2020-05-18T21:34:42.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f131657e700 1 -- 172.21.15.63:0/2175528442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f131014da70 msgr2=0x7f13100648f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:42.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f131657e700 1 --2- 172.21.15.63:0/2175528442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f131014da70 0x7f13100648f0 secure :-1 s=READY pgs=1715 cs=0 l=1 rx=0x7f12f8002f70 tx=0x7f12f8007a80).stop 2020-05-18T21:34:42.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f131657e700 1 -- 172.21.15.63:0/2175528442 shutdown_connections 2020-05-18T21:34:42.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f131657e700 1 --2- 172.21.15.63:0/2175528442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f131014da70 0x7f13100648f0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:42.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f131657e700 1 -- 172.21.15.63:0/2175528442 >> 172.21.15.63:0/2175528442 conn(0x7f13100b8630 msgr2=0x7f13100b8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:42.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f131657e700 1 -- 172.21.15.63:0/2175528442 shutdown_connections 2020-05-18T21:34:42.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.358+0000 7f131657e700 1 -- 172.21.15.63:0/2175528442 wait complete. 2020-05-18T21:34:42.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.362+0000 7f131657e700 1 Processor -- start 2020-05-18T21:34:42.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.362+0000 7f131657e700 1 -- start start 2020-05-18T21:34:42.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f131657e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1310065f70 0x7f13100ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:42.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f131657e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131012ff30 con 0x7f13100b5050 2020-05-18T21:34:42.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f131657e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131015bcc0 con 0x7f131014da70 2020-05-18T21:34:42.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f131657e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131012fc90 con 0x7f1310065f70 2020-05-18T21:34:42.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f130ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1310065f70 0x7f13100ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:42.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f130f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f13100b5050 0x7f131015aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36202/0 (socket says 172.21.15.63:36202) 2020-05-18T21:34:42.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f130f7fe700 1 -- 172.21.15.63:0/59676051 learned_addr learned my addr 172.21.15.63:0/59676051 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:34:42.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f130ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1310065f70 0x7f13100ac9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34012/0 (socket says 172.21.15.63:34012) 2020-05-18T21:34:42.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f130ffff700 1 -- 172.21.15.63:0/59676051 >> v1:172.21.15.155:6789/0 conn(0x7f131014da70 legacy=0x7f131015b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:42.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f130d7fa700 1 -- 172.21.15.63:0/59676051 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11734327 0 0) 0x7f131012ff30 con 0x7f13100b5050 2020-05-18T21:34:42.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f130ffff700 1 -- 172.21.15.63:0/59676051 >> v1:172.21.15.63:6789/0 conn(0x7f13100b5050 legacy=0x7f131015aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:42.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f130ffff700 1 -- 172.21.15.63:0/59676051 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131012dd10 con 0x7f1310065f70 2020-05-18T21:34:42.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f130ffff700 1 --2- 172.21.15.63:0/59676051 >> v2:172.21.15.63:3300/0 conn(0x7f1310065f70 0x7f13100ac9f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f13100b5b60 tx=0x7f131005fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:42.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f130ffff700 1 --2- 172.21.15.63:0/59676051 >> v2:172.21.15.63:3300/0 conn(0x7f1310065f70 0x7f13100ac9f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f13100b5b60 tx=0x7f131005fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:42.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f130ffff700 1 --2- 172.21.15.63:0/59676051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1310065f70 0x7f13100ac9f0 secure :-1 s=READY pgs=1717 cs=0 l=1 rx=0x7f13100b5b60 tx=0x7f131005fbd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:42.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f130ffff700 1 --2- 172.21.15.63:0/59676051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1310065f70 0x7f13100ac9f0 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7f13100b5b60 tx=0x7f131005fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:42.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f130d7fa700 1 -- 172.21.15.63:0/59676051 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1300006c50 con 0x7f1310065f70 2020-05-18T21:34:42.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f130ffff700 1 --2- 172.21.15.63:0/59676051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1310065f70 0x7f13100ac9f0 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7f13100b5b60 tx=0x7f131005fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:42.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f130ffff700 1 --2- 172.21.15.63:0/59676051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1310065f70 0x7f13100ac9f0 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7f13100b5b60 tx=0x7f131005fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:42.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f130d7fa700 1 -- 172.21.15.63:0/59676051 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1300006db0 con 0x7f1310065f70 2020-05-18T21:34:42.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f131657e700 1 -- 172.21.15.63:0/59676051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f131012f980 con 0x7f1310065f70 2020-05-18T21:34:42.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f130d7fa700 1 -- 172.21.15.63:0/59676051 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1300011160 con 0x7f1310065f70 2020-05-18T21:34:42.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f131657e700 1 -- 172.21.15.63:0/59676051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1310131d90 con 0x7f1310065f70 2020-05-18T21:34:42.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f130ffff700 1 --2- 172.21.15.63:0/59676051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1310065f70 0x7f13100ac9f0 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7f13100b5b60 tx=0x7f131005fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:42.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.366+0000 7f131657e700 1 -- 172.21.15.63:0/59676051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13100569e0 con 0x7f1310065f70 2020-05-18T21:34:42.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.370+0000 7f130d7fa700 1 -- 172.21.15.63:0/59676051 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f13000113d0 con 0x7f1310065f70 2020-05-18T21:34:42.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.370+0000 7f130ffff700 1 --2- 172.21.15.63:0/59676051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1310065f70 0x7f13100ac9f0 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7f13100b5b60 tx=0x7f131005fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:42.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.370+0000 7f130d7fa700 1 --2- 172.21.15.63:0/59676051 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f12f404f890 0x7f12f4051d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:34:42.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.370+0000 7f130d7fa700 1 -- 172.21.15.63:0/59676051 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1300063ad0 con 0x7f1310065f70 2020-05-18T21:34:42.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.370+0000 7f130f7fe700 1 --2- 172.21.15.63:0/59676051 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f12f404f890 0x7f12f4051d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:34:42.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.370+0000 7f130f7fe700 1 --2- 172.21.15.63:0/59676051 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f12f404f890 0x7f12f4051d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f12f8007f10 tx=0x7f12f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:42.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.370+0000 7f130f7fe700 1 --2- 172.21.15.63:0/59676051 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f12f404f890 0x7f12f4051d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f12f8007f10 tx=0x7f12f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:42.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.370+0000 7f130f7fe700 1 --2- 172.21.15.63:0/59676051 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f12f404f890 0x7f12f4051d50 secure :-1 s=READY pgs=664 cs=0 l=1 rx=0x7f12f8007f10 tx=0x7f12f8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:34:42.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.374+0000 7f130ffff700 1 --2- 172.21.15.63:0/59676051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1310065f70 0x7f13100ac9f0 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7f13100b5b60 tx=0x7f131005fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:42.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.374+0000 7f130d7fa700 1 -- 172.21.15.63:0/59676051 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f130003de00 con 0x7f1310065f70 2020-05-18T21:34:42.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.526+0000 7f131657e700 1 -- 172.21.15.63:0/59676051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f131005e490 con 0x7f1310065f70 2020-05-18T21:34:42.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.526+0000 7f130ffff700 1 --2- 172.21.15.63:0/59676051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1310065f70 0x7f13100ac9f0 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7f13100b5b60 tx=0x7f131005fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:34:42.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.526+0000 7f130d7fa700 1 -- 172.21.15.63:0/59676051 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f1300041420 con 0x7f1310065f70 2020-05-18T21:34:42.532 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:34:42.532 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":98,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/3483934102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3483934102},{"type":"v1","addr":"172.21.15.155:6835","nonce":3483934102}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":98}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:34:27.767123+0000","modified":"2020-05-18T21:34:41.281280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"a","rank":0,"incarnation":94,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6833/1314928434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1314928434},{"type":"v1","addr":"172.21.15.63:6833","nonce":1314928434}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-05-18T21:34:42.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.526+0000 7f131657e700 1 -- 172.21.15.63:0/59676051 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f12f404f890 msgr2=0x7f12f4051d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:42.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.526+0000 7f131657e700 1 --2- 172.21.15.63:0/59676051 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f12f404f890 0x7f12f4051d50 secure :-1 s=READY pgs=664 cs=0 l=1 rx=0x7f12f8007f10 tx=0x7f12f8007a80).stop 2020-05-18T21:34:42.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.526+0000 7f131657e700 1 -- 172.21.15.63:0/59676051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1310065f70 msgr2=0x7f13100ac9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:34:42.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.526+0000 7f131657e700 1 --2- 172.21.15.63:0/59676051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1310065f70 0x7f13100ac9f0 secure :-1 s=READY pgs=1717 cs=0 l=1 rx=0x7f13100b5b60 tx=0x7f131005fbd0).stop 2020-05-18T21:34:42.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.526+0000 7f131657e700 1 -- 172.21.15.63:0/59676051 shutdown_connections 2020-05-18T21:34:42.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.526+0000 7f131657e700 1 --2- 172.21.15.63:0/59676051 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f12f404f890 0x7f12f4051d50 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:42.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.530+0000 7f131657e700 1 --2- 172.21.15.63:0/59676051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1310065f70 0x7f13100ac9f0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:34:42.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.530+0000 7f131657e700 1 -- 172.21.15.63:0/59676051 >> 172.21.15.63:0/59676051 conn(0x7f13100b8630 msgr2=0x7f1310149b90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:34:42.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.530+0000 7f131657e700 1 -- 172.21.15.63:0/59676051 shutdown_connections 2020-05-18T21:34:42.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:34:42.530+0000 7f131657e700 1 -- 172.21.15.63:0/59676051 wait complete. 2020-05-18T21:34:42.535 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 98 2020-05-18T21:34:42.746 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 98, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:34:27.767123+0000', 'modified': '2020-05-18T21:34:41.281280+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 124, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9294': {'gid': 9294, 'name': 'a', 'rank': 0, 'incarnation': 94, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.63:6833/1314928434', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 1314928434}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 1314928434}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:34:42.747 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:34:42.748 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:34:42.855 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:34:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:34:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:34:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 9294, 2020-05-18T21:34:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:34:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:34:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 5.6026638269999998, 2020-05-18T21:34:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 98, 2020-05-18T21:34:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 125, 2020-05-18T21:34:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 125, 2020-05-18T21:34:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 6.52758123 2020-05-18T21:34:42.858 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:34:42.864 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 9294, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.6026638269999998, "mdsmap_epoch": 98, "osdmap_epoch": 125, "osdmap_epoch_barrier": 125, "uptime": 6.52758123 } 2020-05-18T21:34:42.865 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:34:42.866 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:34:42.866 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:34:42.867 INFO:teuthology.orchestra.run.smithi063:> mount_path = "/home/ubuntu/cephtest/mnt.0" 2020-05-18T21:34:42.867 INFO:teuthology.orchestra.run.smithi063:> subdir = "delete_me" 2020-05-18T21:34:42.868 INFO:teuthology.orchestra.run.smithi063:> size_unit = 1048576 2020-05-18T21:34:42.869 INFO:teuthology.orchestra.run.smithi063:> file_multiplier = 100 2020-05-18T21:34:42.869 INFO:teuthology.orchestra.run.smithi063:> os.mkdir(os.path.join(mount_path, subdir)) 2020-05-18T21:34:42.870 INFO:teuthology.orchestra.run.smithi063:> for i in range(0, file_multiplier): 2020-05-18T21:34:42.870 INFO:teuthology.orchestra.run.smithi063:> for size in range(0, 16*size_unit, size_unit): 2020-05-18T21:34:42.870 INFO:teuthology.orchestra.run.smithi063:> filename = "{0}_{1}.bin".format(i, size // size_unit) 2020-05-18T21:34:42.871 INFO:teuthology.orchestra.run.smithi063:> with open(os.path.join(mount_path, subdir, filename), '"'"'w'"'"') as f: 2020-05-18T21:34:42.871 INFO:teuthology.orchestra.run.smithi063:> f.write(size * '"'"'x'"'"') 2020-05-18T21:34:42.872 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:34:59.812 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:34:59.816 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:35:26.396 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok config get mds_max_purge_ops 2020-05-18T21:35:26.398 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rm -rf delete_me) 2020-05-18T21:35:26.500 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:35:26.501 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_max_purge_ops": "16" 2020-05-18T21:35:26.501 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:35:26.509 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_max_purge_ops": "16" } 2020-05-18T21:35:26.510 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok config get mds_max_purge_files 2020-05-18T21:35:26.603 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:35:26.603 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_max_purge_files": "100000000" 2020-05-18T21:35:26.604 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:35:26.612 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_max_purge_files": "100000000" } 2020-05-18T21:35:26.613 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:35:26.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.714+0000 7f513359e700 1 Processor -- start 2020-05-18T21:35:26.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.714+0000 7f513359e700 1 -- start start 2020-05-18T21:35:26.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f513359e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f51340b9da0 0x7f51340b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:26.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f513359e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f513405f6a0 0x7f5134146500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:26.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f513359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51340b7250 con 0x7f513405eb50 2020-05-18T21:35:26.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f513359e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51340b74f0 con 0x7f51340b9da0 2020-05-18T21:35:26.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f513359e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51340b7790 con 0x7f513405f6a0 2020-05-18T21:35:26.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f5132d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f513405f6a0 0x7f5134146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:26.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f513259c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f51340b9da0 0x7f51340b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:26.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f5132d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f513405f6a0 0x7f5134146500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:52970/0 (socket says 172.21.15.63:52970) 2020-05-18T21:35:26.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f5132d9d700 1 -- 172.21.15.63:0/784130263 learned_addr learned my addr 172.21.15.63:0/784130263 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:26.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f5132d9d700 1 -- 172.21.15.63:0/784130263 >> v2:172.21.15.155:3300/0 conn(0x7f51340b9da0 msgr2=0x7f51340b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:26.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f5132d9d700 1 --2- 172.21.15.63:0/784130263 >> v2:172.21.15.155:3300/0 conn(0x7f51340b9da0 0x7f51340b7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:26.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f5132d9d700 1 -- 172.21.15.63:0/784130263 >> v1:172.21.15.155:6789/0 conn(0x7f513405eb50 legacy=0x7f513405ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:26.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f5132d9d700 1 -- 172.21.15.63:0/784130263 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51340b7a30 con 0x7f513405f6a0 2020-05-18T21:35:26.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f513259c700 1 --2- 172.21.15.63:0/784130263 >> v2:172.21.15.155:3300/0 conn(0x7f51340b9da0 0x7f51340b7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:35:26.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f5132d9d700 1 --2- 172.21.15.63:0/784130263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f513405f6a0 0x7f5134146500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f512c0032f0 tx=0x7f512c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:26.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f5132d9d700 1 --2- 172.21.15.63:0/784130263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f513405f6a0 0x7f5134146500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f512c0032f0 tx=0x7f512c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:26.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f5132d9d700 1 --2- 172.21.15.63:0/784130263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f513405f6a0 0x7f5134146500 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7f512c0032f0 tx=0x7f512c007e00).ready entity=mon.2 client_cookie=730f9886bd90ea4b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:26.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f5132d9d700 1 --2- 172.21.15.63:0/784130263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f513405f6a0 0x7f5134146500 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f512c0032f0 tx=0x7f512c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:26.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f5132d9d700 1 --2- 172.21.15.63:0/784130263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f513405f6a0 0x7f5134146500 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f512c0032f0 tx=0x7f512c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:26.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f5131d9b700 1 -- 172.21.15.63:0/784130263 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f512c011e00 con 0x7f513405f6a0 2020-05-18T21:35:26.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f5132d9d700 1 --2- 172.21.15.63:0/784130263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f513405f6a0 0x7f5134146500 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f512c0032f0 tx=0x7f512c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:26.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f5131d9b700 1 -- 172.21.15.63:0/784130263 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c00a180 con 0x7f513405f6a0 2020-05-18T21:35:26.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f5131d9b700 1 -- 172.21.15.63:0/784130263 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f512c00a5a0 con 0x7f513405f6a0 2020-05-18T21:35:26.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f513359e700 1 -- 172.21.15.63:0/784130263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f513405f6a0 msgr2=0x7f5134146500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:26.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f513359e700 1 --2- 172.21.15.63:0/784130263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f513405f6a0 0x7f5134146500 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7f512c0032f0 tx=0x7f512c007e00).stop 2020-05-18T21:35:26.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f513359e700 1 -- 172.21.15.63:0/784130263 shutdown_connections 2020-05-18T21:35:26.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f513359e700 1 --2- 172.21.15.63:0/784130263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f513405f6a0 0x7f5134146500 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:26.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f513359e700 1 --2- 172.21.15.63:0/784130263 >> v2:172.21.15.155:3300/0 conn(0x7f51340b9da0 0x7f51340b7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:26.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f513359e700 1 -- 172.21.15.63:0/784130263 >> 172.21.15.63:0/784130263 conn(0x7f51340bd340 msgr2=0x7f51340b9350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:26.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f513359e700 1 -- 172.21.15.63:0/784130263 shutdown_connections 2020-05-18T21:35:26.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.718+0000 7f513359e700 1 -- 172.21.15.63:0/784130263 wait complete. 2020-05-18T21:35:26.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f513359e700 1 Processor -- start 2020-05-18T21:35:26.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f513359e700 1 -- start start 2020-05-18T21:35:26.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f513359e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f513405f6a0 0x7f5134157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:26.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f513359e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5134145360 con 0x7f513405eb50 2020-05-18T21:35:26.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f513359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5134145600 con 0x7f51340b9da0 2020-05-18T21:35:26.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f513359e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5134158170 con 0x7f513405f6a0 2020-05-18T21:35:26.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f513259c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f513405eb50 0x7f51340b30b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36226/0 (socket says 172.21.15.63:36226) 2020-05-18T21:35:26.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f513259c700 1 -- 172.21.15.63:0/513172425 learned_addr learned my addr 172.21.15.63:0/513172425 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:26.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f512bfff700 1 --2- 172.21.15.63:0/513172425 >> v2:172.21.15.155:3300/0 conn(0x7f513405f6a0 0x7f5134157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:26.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f512b7fe700 1 -- 172.21.15.63:0/513172425 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323146398 0 0) 0x7f5134145360 con 0x7f513405eb50 2020-05-18T21:35:26.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f512b7fe700 1 -- 172.21.15.63:0/513172425 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5118002fe0 con 0x7f513405eb50 2020-05-18T21:35:26.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f512bfff700 1 -- 172.21.15.63:0/513172425 >> v1:172.21.15.155:6789/0 conn(0x7f51340b9da0 legacy=0x7f5134140220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:26.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f512bfff700 1 -- 172.21.15.63:0/513172425 >> v1:172.21.15.63:6789/0 conn(0x7f513405eb50 legacy=0x7f51340b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:26.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f512bfff700 1 -- 172.21.15.63:0/513172425 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51340b5920 con 0x7f513405f6a0 2020-05-18T21:35:26.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f512bfff700 1 --2- 172.21.15.63:0/513172425 >> v2:172.21.15.155:3300/0 conn(0x7f513405f6a0 0x7f5134157b90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f512c008290 tx=0x7f511c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:26.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f512bfff700 1 --2- 172.21.15.63:0/513172425 >> v2:172.21.15.155:3300/0 conn(0x7f513405f6a0 0x7f5134157b90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f512c008290 tx=0x7f511c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:26.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f512bfff700 1 --2- 172.21.15.63:0/513172425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f513405f6a0 0x7f5134157b90 secure :-1 s=READY pgs=1135 cs=0 l=1 rx=0x7f512c008290 tx=0x7f511c0108a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:26.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f512bfff700 1 --2- 172.21.15.63:0/513172425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f513405f6a0 0x7f5134157b90 secure :-1 s=THROTTLE_DONE pgs=1135 cs=0 l=1 rx=0x7f512c008290 tx=0x7f511c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:26.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f512b7fe700 1 -- 172.21.15.63:0/513172425 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f511c00cd30 con 0x7f513405f6a0 2020-05-18T21:35:26.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f512bfff700 1 --2- 172.21.15.63:0/513172425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f513405f6a0 0x7f5134157b90 secure :-1 s=THROTTLE_DONE pgs=1135 cs=0 l=1 rx=0x7f512c008290 tx=0x7f511c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:26.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f513359e700 1 -- 172.21.15.63:0/513172425 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51340b37c0 con 0x7f513405f6a0 2020-05-18T21:35:26.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f512bfff700 1 --2- 172.21.15.63:0/513172425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f513405f6a0 0x7f5134157b90 secure :-1 s=THROTTLE_DONE pgs=1135 cs=0 l=1 rx=0x7f512c008290 tx=0x7f511c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:26.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f512b7fe700 1 -- 172.21.15.63:0/513172425 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c00ce90 con 0x7f513405f6a0 2020-05-18T21:35:26.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f512b7fe700 1 -- 172.21.15.63:0/513172425 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f511c0018c0 con 0x7f513405f6a0 2020-05-18T21:35:26.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.722+0000 7f513359e700 1 -- 172.21.15.63:0/513172425 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513414a920 con 0x7f513405f6a0 2020-05-18T21:35:26.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.726+0000 7f513359e700 1 -- 172.21.15.63:0/513172425 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5134145790 con 0x7f513405f6a0 2020-05-18T21:35:26.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.726+0000 7f512bfff700 1 --2- 172.21.15.63:0/513172425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f513405f6a0 0x7f5134157b90 secure :-1 s=THROTTLE_DONE pgs=1135 cs=0 l=1 rx=0x7f512c008290 tx=0x7f511c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:26.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.726+0000 7f512b7fe700 1 -- 172.21.15.63:0/513172425 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f511c006520 con 0x7f513405f6a0 2020-05-18T21:35:26.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.726+0000 7f512bfff700 1 --2- 172.21.15.63:0/513172425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f513405f6a0 0x7f5134157b90 secure :-1 s=THROTTLE_DONE pgs=1135 cs=0 l=1 rx=0x7f512c008290 tx=0x7f511c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:26.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.726+0000 7f512b7fe700 1 --2- 172.21.15.63:0/513172425 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f511804fca0 0x7f5118052160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:26.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.726+0000 7f512b7fe700 1 -- 172.21.15.63:0/513172425 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f511c0638a0 con 0x7f513405f6a0 2020-05-18T21:35:26.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.726+0000 7f513259c700 1 --2- 172.21.15.63:0/513172425 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f511804fca0 0x7f5118052160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:26.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.726+0000 7f513259c700 1 --2- 172.21.15.63:0/513172425 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f511804fca0 0x7f5118052160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5124002f70 tx=0x7f51240093f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:26.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.726+0000 7f513259c700 1 --2- 172.21.15.63:0/513172425 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f511804fca0 0x7f5118052160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5124002f70 tx=0x7f51240093f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:26.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.726+0000 7f513259c700 1 --2- 172.21.15.63:0/513172425 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f511804fca0 0x7f5118052160 secure :-1 s=READY pgs=665 cs=0 l=1 rx=0x7f5124002f70 tx=0x7f51240093f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:26.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.734+0000 7f512bfff700 1 --2- 172.21.15.63:0/513172425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f513405f6a0 0x7f5134157b90 secure :-1 s=THROTTLE_DONE pgs=1135 cs=0 l=1 rx=0x7f512c008290 tx=0x7f511c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:26.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.734+0000 7f512b7fe700 1 -- 172.21.15.63:0/513172425 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f511c03dc30 con 0x7f513405f6a0 2020-05-18T21:35:26.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.934+0000 7f513359e700 1 -- 172.21.15.63:0/513172425 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51340569e0 con 0x7f513405f6a0 2020-05-18T21:35:26.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.938+0000 7f512bfff700 1 --2- 172.21.15.63:0/513172425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f513405f6a0 0x7f5134157b90 secure :-1 s=THROTTLE_DONE pgs=1135 cs=0 l=1 rx=0x7f512c008290 tx=0x7f511c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:26.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.938+0000 7f512b7fe700 1 -- 172.21.15.63:0/513172425 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f511c041250 con 0x7f513405f6a0 2020-05-18T21:35:26.942 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:26.942 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":98,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/3483934102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3483934102},{"type":"v1","addr":"172.21.15.155:6835","nonce":3483934102}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":98}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:34:27.767123+0000","modified":"2020-05-18T21:34:41.281280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"a","rank":0,"incarnation":94,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6833/1314928434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1314928434},{"type":"v1","addr":"172.21.15.63:6833","nonce":1314928434}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-05-18T21:35:26.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.938+0000 7f513359e700 1 -- 172.21.15.63:0/513172425 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f511804fca0 msgr2=0x7f5118052160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:26.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.938+0000 7f513359e700 1 --2- 172.21.15.63:0/513172425 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f511804fca0 0x7f5118052160 secure :-1 s=READY pgs=665 cs=0 l=1 rx=0x7f5124002f70 tx=0x7f51240093f0).stop 2020-05-18T21:35:26.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.938+0000 7f513359e700 1 -- 172.21.15.63:0/513172425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f513405f6a0 msgr2=0x7f5134157b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:26.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.938+0000 7f513359e700 1 --2- 172.21.15.63:0/513172425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f513405f6a0 0x7f5134157b90 secure :-1 s=READY pgs=1135 cs=0 l=1 rx=0x7f512c008290 tx=0x7f511c0108a0).stop 2020-05-18T21:35:26.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.938+0000 7f513359e700 1 -- 172.21.15.63:0/513172425 shutdown_connections 2020-05-18T21:35:26.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.938+0000 7f513359e700 1 --2- 172.21.15.63:0/513172425 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f511804fca0 0x7f5118052160 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:26.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.938+0000 7f513359e700 1 --2- 172.21.15.63:0/513172425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f513405f6a0 0x7f5134157b90 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:26.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.938+0000 7f513359e700 1 -- 172.21.15.63:0/513172425 >> 172.21.15.63:0/513172425 conn(0x7f51340bd340 msgr2=0x7f5134141350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:26.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.938+0000 7f513359e700 1 -- 172.21.15.63:0/513172425 shutdown_connections 2020-05-18T21:35:26.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:26.938+0000 7f513359e700 1 -- 172.21.15.63:0/513172425 wait complete. 2020-05-18T21:35:26.946 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 98 2020-05-18T21:35:26.957 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2020-05-18T21:35:27.066 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:35:27.066 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-0": { 2020-05-18T21:35:27.066 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 39, 2020-05-18T21:35:27.066 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 34, 2020-05-18T21:35:27.067 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 80093, 2020-05-18T21:35:27.067 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 66448, 2020-05-18T21:35:27.067 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 5, 2020-05-18T21:35:27.067 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 0, 2020-05-18T21:35:27.067 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.011765523, 2020-05-18T21:35:27.067 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.001983693, 2020-05-18T21:35:27.068 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.011574789, 2020-05-18T21:35:27.068 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000823075, 2020-05-18T21:35:27.068 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:27.069 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 34, 2020-05-18T21:35:27.069 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.006300519, 2020-05-18T21:35:27.069 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000185309 2020-05-18T21:35:27.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.070 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:27.070 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.070 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.071 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.071 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:27.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.071 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-1": { 2020-05-18T21:35:27.071 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 1348, 2020-05-18T21:35:27.072 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 1359, 2020-05-18T21:35:27.072 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 317375, 2020-05-18T21:35:27.072 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 5176923, 2020-05-18T21:35:27.072 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 5, 2020-05-18T21:35:27.072 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 2, 2020-05-18T21:35:27.073 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.176432000, 2020-05-18T21:35:27.073 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.066989934, 2020-05-18T21:35:27.073 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.041030696, 2020-05-18T21:35:27.073 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.056508800, 2020-05-18T21:35:27.073 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:27.073 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1359, 2020-05-18T21:35:27.074 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.056371272, 2020-05-18T21:35:27.074 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000041479 2020-05-18T21:35:27.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.075 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:27.075 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.075 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.075 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.075 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:27.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.076 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-2": { 2020-05-18T21:35:27.076 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 9321, 2020-05-18T21:35:27.076 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 16064, 2020-05-18T21:35:27.076 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 2718901, 2020-05-18T21:35:27.076 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 15339892, 2020-05-18T21:35:27.077 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 5, 2020-05-18T21:35:27.077 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 2, 2020-05-18T21:35:27.077 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 1.449853437, 2020-05-18T21:35:27.077 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.690711630, 2020-05-18T21:35:27.077 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.766962700, 2020-05-18T21:35:27.077 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.103880924, 2020-05-18T21:35:27.078 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:27.078 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 16063, 2020-05-18T21:35:27.078 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.695113677, 2020-05-18T21:35:27.078 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000043274 2020-05-18T21:35:27.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.079 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:27.079 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 19656, 2020-05-18T21:35:27.079 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.007062471, 2020-05-18T21:35:27.079 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000359 2020-05-18T21:35:27.079 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:27.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.080 INFO:teuthology.orchestra.run.smithi063.stdout: "cct": { 2020-05-18T21:35:27.080 INFO:teuthology.orchestra.run.smithi063.stdout: "total_workers": 1, 2020-05-18T21:35:27.081 INFO:teuthology.orchestra.run.smithi063.stdout: "unhealthy_workers": 0 2020-05-18T21:35:27.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.081 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-MDSRank": { 2020-05-18T21:35:27.081 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2020-05-18T21:35:27.081 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2020-05-18T21:35:27.082 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 6428, 2020-05-18T21:35:27.082 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 3.072920168, 2020-05-18T21:35:27.082 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000478052 2020-05-18T21:35:27.082 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:27.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.083 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-PurgeQueue": { 2020-05-18T21:35:27.083 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2020-05-18T21:35:27.083 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2020-05-18T21:35:27.083 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 4, 2020-05-18T21:35:27.083 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000135958, 2020-05-18T21:35:27.084 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000033989 2020-05-18T21:35:27.084 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:27.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.084 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2020-05-18T21:35:27.084 INFO:teuthology.orchestra.run.smithi063.stdout: "request": 1793, 2020-05-18T21:35:27.084 INFO:teuthology.orchestra.run.smithi063.stdout: "reply": 1791, 2020-05-18T21:35:27.085 INFO:teuthology.orchestra.run.smithi063.stdout: "reply_latency": { 2020-05-18T21:35:27.085 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1791, 2020-05-18T21:35:27.085 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 2.641652227, 2020-05-18T21:35:27.085 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001474959 2020-05-18T21:35:27.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.086 INFO:teuthology.orchestra.run.smithi063.stdout: "forward": 0, 2020-05-18T21:35:27.086 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_fetch": 12, 2020-05-18T21:35:27.086 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_commit": 73, 2020-05-18T21:35:27.086 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_split": 9, 2020-05-18T21:35:27.087 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_merge": 0, 2020-05-18T21:35:27.087 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes": 1611, 2020-05-18T21:35:27.087 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_top": 0, 2020-05-18T21:35:27.087 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_bottom": 1611, 2020-05-18T21:35:27.087 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pin_tail": 0, 2020-05-18T21:35:27.087 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pinned": 1611, 2020-05-18T21:35:27.088 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_expired": 0, 2020-05-18T21:35:27.088 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_with_caps": 1602, 2020-05-18T21:35:27.088 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": 1602, 2020-05-18T21:35:27.088 INFO:teuthology.orchestra.run.smithi063.stdout: "subtrees": 2, 2020-05-18T21:35:27.088 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse": 1794, 2020-05-18T21:35:27.089 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_hit": 1792, 2020-05-18T21:35:27.089 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_forward": 0, 2020-05-18T21:35:27.089 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_discover": 0, 2020-05-18T21:35:27.089 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_dir_fetch": 0, 2020-05-18T21:35:27.089 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_remote_ino": 0, 2020-05-18T21:35:27.089 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_lock": 0, 2020-05-18T21:35:27.090 INFO:teuthology.orchestra.run.smithi063.stdout: "load_cent": 223899, 2020-05-18T21:35:27.090 INFO:teuthology.orchestra.run.smithi063.stdout: "q": 0, 2020-05-18T21:35:27.090 INFO:teuthology.orchestra.run.smithi063.stdout: "exported": 0, 2020-05-18T21:35:27.090 INFO:teuthology.orchestra.run.smithi063.stdout: "exported_inodes": 0, 2020-05-18T21:35:27.090 INFO:teuthology.orchestra.run.smithi063.stdout: "imported": 0, 2020-05-18T21:35:27.091 INFO:teuthology.orchestra.run.smithi063.stdout: "imported_inodes": 0, 2020-05-18T21:35:27.091 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_dir_fetch": 0, 2020-05-18T21:35:27.091 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_backtrace_fetch": 0, 2020-05-18T21:35:27.091 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_peer_discover": 0, 2020-05-18T21:35:27.091 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rfiles": 1432, 2020-05-18T21:35:27.091 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rbytes": 10896408576, 2020-05-18T21:35:27.092 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rsnaps": 0 2020-05-18T21:35:27.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.092 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:35:27.092 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays": 117, 2020-05-18T21:35:27.092 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_delayed": 0, 2020-05-18T21:35:27.093 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:35:27.093 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_created": 117, 2020-05-18T21:35:27.093 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 0, 2020-05-18T21:35:27.093 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_reintegrated": 0, 2020-05-18T21:35:27.093 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_migrated": 0, 2020-05-18T21:35:27.093 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_processing": 0, 2020-05-18T21:35:27.094 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:35:27.094 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:35:27.094 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_started": 0, 2020-05-18T21:35:27.094 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_completed": 0, 2020-05-18T21:35:27.094 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:35:27.095 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_exportdir": 0, 2020-05-18T21:35:27.095 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_flush": 0, 2020-05-18T21:35:27.095 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragmentdir": 9, 2020-05-18T21:35:27.095 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragstats": 0, 2020-05-18T21:35:27.095 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_inodestats": 0 2020-05-18T21:35:27.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.096 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log": { 2020-05-18T21:35:27.096 INFO:teuthology.orchestra.run.smithi063.stdout: "evadd": 6810, 2020-05-18T21:35:27.096 INFO:teuthology.orchestra.run.smithi063.stdout: "evex": 0, 2020-05-18T21:35:27.096 INFO:teuthology.orchestra.run.smithi063.stdout: "evtrm": 0, 2020-05-18T21:35:27.096 INFO:teuthology.orchestra.run.smithi063.stdout: "ev": 6812, 2020-05-18T21:35:27.097 INFO:teuthology.orchestra.run.smithi063.stdout: "evexg": 0, 2020-05-18T21:35:27.097 INFO:teuthology.orchestra.run.smithi063.stdout: "evexd": 0, 2020-05-18T21:35:27.097 INFO:teuthology.orchestra.run.smithi063.stdout: "segadd": 9, 2020-05-18T21:35:27.097 INFO:teuthology.orchestra.run.smithi063.stdout: "segex": 0, 2020-05-18T21:35:27.097 INFO:teuthology.orchestra.run.smithi063.stdout: "segtrm": 0, 2020-05-18T21:35:27.097 INFO:teuthology.orchestra.run.smithi063.stdout: "seg": 10, 2020-05-18T21:35:27.098 INFO:teuthology.orchestra.run.smithi063.stdout: "segexg": 0, 2020-05-18T21:35:27.098 INFO:teuthology.orchestra.run.smithi063.stdout: "segexd": 0, 2020-05-18T21:35:27.098 INFO:teuthology.orchestra.run.smithi063.stdout: "expos": 4194304, 2020-05-18T21:35:27.098 INFO:teuthology.orchestra.run.smithi063.stdout: "wrpos": 17404220, 2020-05-18T21:35:27.098 INFO:teuthology.orchestra.run.smithi063.stdout: "rdpos": 4195196, 2020-05-18T21:35:27.099 INFO:teuthology.orchestra.run.smithi063.stdout: "jlat": { 2020-05-18T21:35:27.099 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 3620, 2020-05-18T21:35:27.099 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 19.428560976, 2020-05-18T21:35:27.099 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.005367005 2020-05-18T21:35:27.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.099 INFO:teuthology.orchestra.run.smithi063.stdout: "replayed": 2 2020-05-18T21:35:27.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.100 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_mem": { 2020-05-18T21:35:27.100 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1614, 2020-05-18T21:35:27.100 INFO:teuthology.orchestra.run.smithi063.stdout: "ino+": 1614, 2020-05-18T21:35:27.100 INFO:teuthology.orchestra.run.smithi063.stdout: "ino-": 0, 2020-05-18T21:35:27.101 INFO:teuthology.orchestra.run.smithi063.stdout: "dir": 76, 2020-05-18T21:35:27.101 INFO:teuthology.orchestra.run.smithi063.stdout: "dir+": 85, 2020-05-18T21:35:27.101 INFO:teuthology.orchestra.run.smithi063.stdout: "dir-": 9, 2020-05-18T21:35:27.101 INFO:teuthology.orchestra.run.smithi063.stdout: "dn": 1728, 2020-05-18T21:35:27.101 INFO:teuthology.orchestra.run.smithi063.stdout: "dn+": 1728, 2020-05-18T21:35:27.101 INFO:teuthology.orchestra.run.smithi063.stdout: "dn-": 0, 2020-05-18T21:35:27.102 INFO:teuthology.orchestra.run.smithi063.stdout: "cap": 1602, 2020-05-18T21:35:27.102 INFO:teuthology.orchestra.run.smithi063.stdout: "cap+": 1602, 2020-05-18T21:35:27.102 INFO:teuthology.orchestra.run.smithi063.stdout: "cap-": 0, 2020-05-18T21:35:27.102 INFO:teuthology.orchestra.run.smithi063.stdout: "rss": 51596, 2020-05-18T21:35:27.102 INFO:teuthology.orchestra.run.smithi063.stdout: "heap": 331932 2020-05-18T21:35:27.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.103 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_server": { 2020-05-18T21:35:27.103 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_client_request": 1864, 2020-05-18T21:35:27.103 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_server_request": 0, 2020-05-18T21:35:27.103 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_request": 1794, 2020-05-18T21:35:27.103 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_session": 3, 2020-05-18T21:35:27.104 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_slave_request": 0, 2020-05-18T21:35:27.104 INFO:teuthology.orchestra.run.smithi063.stdout: "req_create_latency": { 2020-05-18T21:35:27.104 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1600, 2020-05-18T21:35:27.104 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 2.331516366, 2020-05-18T21:35:27.104 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001457197 2020-05-18T21:35:27.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.105 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getattr_latency": { 2020-05-18T21:35:27.105 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 2, 2020-05-18T21:35:27.105 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000941751, 2020-05-18T21:35:27.105 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000470875 2020-05-18T21:35:27.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.106 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getfilelock_latency": { 2020-05-18T21:35:27.106 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.107 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.107 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.107 INFO:teuthology.orchestra.run.smithi063.stdout: "req_link_latency": { 2020-05-18T21:35:27.107 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.108 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.108 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.108 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookup_latency": { 2020-05-18T21:35:27.108 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:27.108 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.001560520, 2020-05-18T21:35:27.109 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001560520 2020-05-18T21:35:27.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.109 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookuphash_latency": { 2020-05-18T21:35:27.109 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.109 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.110 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.110 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupino_latency": { 2020-05-18T21:35:27.110 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.110 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.110 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.111 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupname_latency": { 2020-05-18T21:35:27.111 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.111 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.111 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.112 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupparent_latency": { 2020-05-18T21:35:27.112 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.112 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.112 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.113 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupsnap_latency": { 2020-05-18T21:35:27.113 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.113 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.113 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.114 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lssnap_latency": { 2020-05-18T21:35:27.114 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.114 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.114 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.114 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mkdir_latency": { 2020-05-18T21:35:27.115 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:27.115 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.004721025, 2020-05-18T21:35:27.115 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.004721025 2020-05-18T21:35:27.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.115 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mknod_latency": { 2020-05-18T21:35:27.116 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.116 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.116 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.116 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mksnap_latency": { 2020-05-18T21:35:27.116 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.117 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.117 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.117 INFO:teuthology.orchestra.run.smithi063.stdout: "req_open_latency": { 2020-05-18T21:35:27.117 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.118 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.118 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.118 INFO:teuthology.orchestra.run.smithi063.stdout: "req_readdir_latency": { 2020-05-18T21:35:27.118 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 70, 2020-05-18T21:35:27.118 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.134635846, 2020-05-18T21:35:27.119 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001923369 2020-05-18T21:35:27.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.119 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rename_latency": { 2020-05-18T21:35:27.119 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.119 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.120 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.122 INFO:teuthology.orchestra.run.smithi063.stdout: "req_renamesnap_latency": { 2020-05-18T21:35:27.122 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.122 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.123 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.123 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmdir_latency": { 2020-05-18T21:35:27.123 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.123 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.124 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.124 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmsnap_latency": { 2020-05-18T21:35:27.124 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.124 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.125 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.125 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmxattr_latency": { 2020-05-18T21:35:27.125 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.125 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.125 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.126 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setattr_latency": { 2020-05-18T21:35:27.126 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.126 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.126 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.127 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setdirlayout_latency": { 2020-05-18T21:35:27.127 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.127 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.127 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.128 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setfilelock_latency": { 2020-05-18T21:35:27.128 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.128 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.128 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.129 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setlayout_latency": { 2020-05-18T21:35:27.129 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.129 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.129 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.130 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setxattr_latency": { 2020-05-18T21:35:27.136 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.136 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.136 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.137 INFO:teuthology.orchestra.run.smithi063.stdout: "req_symlink_latency": { 2020-05-18T21:35:27.137 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.138 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.138 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.139 INFO:teuthology.orchestra.run.smithi063.stdout: "req_unlink_latency": { 2020-05-18T21:35:27.139 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 117, 2020-05-18T21:35:27.139 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.168276719, 2020-05-18T21:35:27.140 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001438262 2020-05-18T21:35:27.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.140 INFO:teuthology.orchestra.run.smithi063.stdout: "cap_revoke_eviction": 0 2020-05-18T21:35:27.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.141 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_sessions": { 2020-05-18T21:35:27.141 INFO:teuthology.orchestra.run.smithi063.stdout: "session_count": 1, 2020-05-18T21:35:27.142 INFO:teuthology.orchestra.run.smithi063.stdout: "session_add": 1, 2020-05-18T21:35:27.142 INFO:teuthology.orchestra.run.smithi063.stdout: "session_remove": 0, 2020-05-18T21:35:27.142 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_open": 1, 2020-05-18T21:35:27.143 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_stale": 0, 2020-05-18T21:35:27.143 INFO:teuthology.orchestra.run.smithi063.stdout: "total_load": 1429, 2020-05-18T21:35:27.143 INFO:teuthology.orchestra.run.smithi063.stdout: "average_load": 1429, 2020-05-18T21:35:27.145 INFO:teuthology.orchestra.run.smithi063.stdout: "avg_session_uptime": 898 2020-05-18T21:35:27.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.146 INFO:teuthology.orchestra.run.smithi063.stdout: "mempool": { 2020-05-18T21:35:27.146 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_bytes": 0, 2020-05-18T21:35:27.146 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_items": 0, 2020-05-18T21:35:27.147 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_bytes": 0, 2020-05-18T21:35:27.147 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_items": 0, 2020-05-18T21:35:27.147 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_bytes": 0, 2020-05-18T21:35:27.148 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_items": 0, 2020-05-18T21:35:27.148 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_bytes": 0, 2020-05-18T21:35:27.148 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_items": 0, 2020-05-18T21:35:27.149 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_bytes": 0, 2020-05-18T21:35:27.149 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_items": 0, 2020-05-18T21:35:27.149 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_bytes": 0, 2020-05-18T21:35:27.150 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_items": 0, 2020-05-18T21:35:27.150 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_bytes": 0, 2020-05-18T21:35:27.151 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_items": 0, 2020-05-18T21:35:27.151 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_bytes": 0, 2020-05-18T21:35:27.151 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_items": 0, 2020-05-18T21:35:27.152 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_bytes": 0, 2020-05-18T21:35:27.152 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_items": 0, 2020-05-18T21:35:27.152 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_bytes": 0, 2020-05-18T21:35:27.153 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_items": 0, 2020-05-18T21:35:27.153 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_bytes": 116939, 2020-05-18T21:35:27.153 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_items": 77, 2020-05-18T21:35:27.154 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_bytes": 0, 2020-05-18T21:35:27.154 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_items": 0, 2020-05-18T21:35:27.154 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bytes": 0, 2020-05-18T21:35:27.155 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_items": 0, 2020-05-18T21:35:27.155 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_bytes": 0, 2020-05-18T21:35:27.155 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_items": 0, 2020-05-18T21:35:27.156 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_bytes": 0, 2020-05-18T21:35:27.156 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_items": 0, 2020-05-18T21:35:27.156 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_bytes": 6128, 2020-05-18T21:35:27.157 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_items": 93, 2020-05-18T21:35:27.157 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_bytes": 0, 2020-05-18T21:35:27.157 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_items": 0, 2020-05-18T21:35:27.158 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_bytes": 0, 2020-05-18T21:35:27.158 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_items": 0, 2020-05-18T21:35:27.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_bytes": 4821216, 2020-05-18T21:35:27.159 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_items": 31052, 2020-05-18T21:35:27.160 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_bytes": 0, 2020-05-18T21:35:27.160 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_items": 0, 2020-05-18T21:35:27.160 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_bytes": 0, 2020-05-18T21:35:27.161 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_items": 0 2020-05-18T21:35:27.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.161 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter": { 2020-05-18T21:35:27.162 INFO:teuthology.orchestra.run.smithi063.stdout: "op_active": 0, 2020-05-18T21:35:27.162 INFO:teuthology.orchestra.run.smithi063.stdout: "op_laggy": 0, 2020-05-18T21:35:27.162 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send": 3751, 2020-05-18T21:35:27.163 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send_bytes": 13548370, 2020-05-18T21:35:27.163 INFO:teuthology.orchestra.run.smithi063.stdout: "op_resend": 0, 2020-05-18T21:35:27.163 INFO:teuthology.orchestra.run.smithi063.stdout: "op_reply": 3751, 2020-05-18T21:35:27.164 INFO:teuthology.orchestra.run.smithi063.stdout: "op": 3751, 2020-05-18T21:35:27.164 INFO:teuthology.orchestra.run.smithi063.stdout: "op_r": 26, 2020-05-18T21:35:27.164 INFO:teuthology.orchestra.run.smithi063.stdout: "op_w": 3725, 2020-05-18T21:35:27.165 INFO:teuthology.orchestra.run.smithi063.stdout: "op_rmw": 0, 2020-05-18T21:35:27.165 INFO:teuthology.orchestra.run.smithi063.stdout: "op_pg": 0, 2020-05-18T21:35:27.166 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_stat": 2, 2020-05-18T21:35:27.166 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_create": 0, 2020-05-18T21:35:27.166 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_read": 8, 2020-05-18T21:35:27.167 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_write": 3620, 2020-05-18T21:35:27.167 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writefull": 4, 2020-05-18T21:35:27.167 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writesame": 0, 2020-05-18T21:35:27.167 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_append": 0, 2020-05-18T21:35:27.168 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_zero": 1, 2020-05-18T21:35:27.168 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_truncate": 1, 2020-05-18T21:35:27.168 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_delete": 16, 2020-05-18T21:35:27.169 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_mapext": 0, 2020-05-18T21:35:27.169 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_sparse_read": 0, 2020-05-18T21:35:27.169 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_clonerange": 0, 2020-05-18T21:35:27.170 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_getxattr": 14, 2020-05-18T21:35:27.170 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_setxattr": 0, 2020-05-18T21:35:27.170 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_cmpxattr": 0, 2020-05-18T21:35:27.171 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_rmxattr": 0, 2020-05-18T21:35:27.171 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_resetxattrs": 0, 2020-05-18T21:35:27.171 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_call": 0, 2020-05-18T21:35:27.171 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_watch": 0, 2020-05-18T21:35:27.172 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_notify": 0, 2020-05-18T21:35:27.172 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_src_cmpxattr": 0, 2020-05-18T21:35:27.172 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls": 0, 2020-05-18T21:35:27.172 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls_filter": 0, 2020-05-18T21:35:27.173 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_other": 0, 2020-05-18T21:35:27.173 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_active": 0, 2020-05-18T21:35:27.173 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_send": 0, 2020-05-18T21:35:27.174 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_resend": 0, 2020-05-18T21:35:27.174 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_ping": 0, 2020-05-18T21:35:27.175 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_active": 0, 2020-05-18T21:35:27.175 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_send": 0, 2020-05-18T21:35:27.175 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_resend": 0, 2020-05-18T21:35:27.175 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_active": 0, 2020-05-18T21:35:27.175 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_send": 0, 2020-05-18T21:35:27.176 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_resend": 0, 2020-05-18T21:35:27.176 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_active": 0, 2020-05-18T21:35:27.176 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_send": 0, 2020-05-18T21:35:27.176 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_resend": 0, 2020-05-18T21:35:27.177 INFO:teuthology.orchestra.run.smithi063.stdout: "command_active": 0, 2020-05-18T21:35:27.177 INFO:teuthology.orchestra.run.smithi063.stdout: "command_send": 0, 2020-05-18T21:35:27.177 INFO:teuthology.orchestra.run.smithi063.stdout: "command_resend": 0, 2020-05-18T21:35:27.178 INFO:teuthology.orchestra.run.smithi063.stdout: "map_epoch": 0, 2020-05-18T21:35:27.178 INFO:teuthology.orchestra.run.smithi063.stdout: "map_full": 0, 2020-05-18T21:35:27.178 INFO:teuthology.orchestra.run.smithi063.stdout: "map_inc": 0, 2020-05-18T21:35:27.178 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_sessions": 5, 2020-05-18T21:35:27.178 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_open": 5, 2020-05-18T21:35:27.179 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_close": 0, 2020-05-18T21:35:27.179 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_laggy": 0, 2020-05-18T21:35:27.179 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_wr": 165, 2020-05-18T21:35:27.179 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_rd": 28, 2020-05-18T21:35:27.179 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_del": 9 2020-05-18T21:35:27.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.180 INFO:teuthology.orchestra.run.smithi063.stdout: "oft": { 2020-05-18T21:35:27.180 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_objs": 0, 2020-05-18T21:35:27.180 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_kv_pairs": 0, 2020-05-18T21:35:27.180 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_updates": 0, 2020-05-18T21:35:27.180 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_removes": 0 2020-05-18T21:35:27.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.181 INFO:teuthology.orchestra.run.smithi063.stdout: "purge_queue": { 2020-05-18T21:35:27.181 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops": 0, 2020-05-18T21:35:27.181 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops_high_water": 0, 2020-05-18T21:35:27.182 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing": 0, 2020-05-18T21:35:27.182 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_high_water": 0, 2020-05-18T21:35:27.182 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executed": 0, 2020-05-18T21:35:27.182 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_item_in_journal": 0 2020-05-18T21:35:27.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.183 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-05-18T21:35:27.183 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 240, 2020-05-18T21:35:27.183 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2020-05-18T21:35:27.183 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:27.183 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 10706, 2020-05-18T21:35:27.184 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 2323447, 2020-05-18T21:35:27.184 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:27.184 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 10706, 2020-05-18T21:35:27.184 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:27.184 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:27.185 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 10705, 2020-05-18T21:35:27.185 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 2323207, 2020-05-18T21:35:27.185 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:27.185 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.186 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.186 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.186 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:27.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.187 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_bytes": { 2020-05-18T21:35:27.187 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:27.187 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2020-05-18T21:35:27.188 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:27.188 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2020-05-18T21:35:27.188 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2020-05-18T21:35:27.188 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:27.189 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2020-05-18T21:35:27.189 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 3751, 2020-05-18T21:35:27.189 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 13549476, 2020-05-18T21:35:27.189 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 3722, 2020-05-18T21:35:27.190 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 13549476, 2020-05-18T21:35:27.190 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:27.190 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.191 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.191 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.191 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:27.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.192 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_ops": { 2020-05-18T21:35:27.192 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:27.192 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 1024, 2020-05-18T21:35:27.193 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:27.193 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2020-05-18T21:35:27.193 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2020-05-18T21:35:27.194 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:27.194 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2020-05-18T21:35:27.194 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 3751, 2020-05-18T21:35:27.195 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 3751, 2020-05-18T21:35:27.195 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 3751, 2020-05-18T21:35:27.195 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 3751, 2020-05-18T21:35:27.196 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:27.196 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.196 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.196 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.197 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:27.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.197 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle": { 2020-05-18T21:35:27.198 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:27.198 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2020-05-18T21:35:27.198 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:27.198 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2020-05-18T21:35:27.199 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2020-05-18T21:35:27.199 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:27.199 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2020-05-18T21:35:27.200 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:27.200 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:27.200 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 0, 2020-05-18T21:35:27.200 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 0, 2020-05-18T21:35:27.200 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:27.201 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.201 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.201 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.201 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:27.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:27.202 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle-0x55eb89907c20": { 2020-05-18T21:35:27.202 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 446427, 2020-05-18T21:35:27.202 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2020-05-18T21:35:27.202 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:27.202 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 6810, 2020-05-18T21:35:27.203 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 13208586, 2020-05-18T21:35:27.203 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:27.203 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 6810, 2020-05-18T21:35:27.203 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:27.204 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:27.204 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 3620, 2020-05-18T21:35:27.204 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 12762159, 2020-05-18T21:35:27.204 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:27.204 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:27.205 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:27.205 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:27.205 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:27.205 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:27.206 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:35:27.207 INFO:tasks.cephfs.filesystem:_json_asok output: { "AsyncMessenger::Worker-0": { "msgr_recv_messages": 39, "msgr_send_messages": 34, "msgr_recv_bytes": 80093, "msgr_send_bytes": 66448, "msgr_created_connections": 5, "msgr_active_connections": 0, "msgr_running_total_time": 0.011765523, "msgr_running_send_time": 0.001983693, "msgr_running_recv_time": 0.011574789, "msgr_running_fast_dispatch_time": 0.000823075, "msgr_send_messages_queue_lat": { "avgcount": 34, "sum": 0.006300519, "avgtime": 0.000185309 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-1": { "msgr_recv_messages": 1348, "msgr_send_messages": 1359, "msgr_recv_bytes": 317375, "msgr_send_bytes": 5176923, "msgr_created_connections": 5, "msgr_active_connections": 2, "msgr_running_total_time": 0.176432000, "msgr_running_send_time": 0.066989934, "msgr_running_recv_time": 0.041030696, "msgr_running_fast_dispatch_time": 0.056508800, "msgr_send_messages_queue_lat": { "avgcount": 1359, "sum": 0.056371272, "avgtime": 0.000041479 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-2": { "msgr_recv_messages": 9321, "msgr_send_messages": 16064, "msgr_recv_bytes": 2718901, "msgr_send_bytes": 15339892, "msgr_created_connections": 5, "msgr_active_connections": 2, "msgr_running_total_time": 1.449853437, "msgr_running_send_time": 0.690711630, "msgr_running_recv_time": 0.766962700, "msgr_running_fast_dispatch_time": 0.103880924, "msgr_send_messages_queue_lat": { "avgcount": 16063, "sum": 0.695113677, "avgtime": 0.000043274 }, "msgr_handle_ack_lat": { "avgcount": 19656, "sum": 0.007062471, "avgtime": 0.000000359 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "queue_len": 0, "complete_latency": { "avgcount": 6428, "sum": 3.072920168, "avgtime": 0.000478052 } }, "finisher-PurgeQueue": { "queue_len": 0, "complete_latency": { "avgcount": 4, "sum": 0.000135958, "avgtime": 0.000033989 } }, "mds": { "request": 1793, "reply": 1791, "reply_latency": { "avgcount": 1791, "sum": 2.641652227, "avgtime": 0.001474959 }, "forward": 0, "dir_fetch": 12, "dir_commit": 73, "dir_split": 9, "dir_merge": 0, "inodes": 1611, "inodes_top": 0, "inodes_bottom": 1611, "inodes_pin_tail": 0, "inodes_pinned": 1611, "inodes_expired": 0, "inodes_with_caps": 1602, "caps": 1602, "subtrees": 2, "traverse": 1794, "traverse_hit": 1792, "traverse_forward": 0, "traverse_discover": 0, "traverse_dir_fetch": 0, "traverse_remote_ino": 0, "traverse_lock": 0, "load_cent": 223899, "q": 0, "exported": 0, "exported_inodes": 0, "imported": 0, "imported_inodes": 0, "openino_dir_fetch": 0, "openino_backtrace_fetch": 0, "openino_peer_discover": 0, "root_rfiles": 1432, "root_rbytes": 10896408576, "root_rsnaps": 0 }, "mds_cache": { "num_strays": 117, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "strays_created": 117, "strays_enqueued": 0, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 9, "ireq_fragstats": 0, "ireq_inodestats": 0 }, "mds_log": { "evadd": 6810, "evex": 0, "evtrm": 0, "ev": 6812, "evexg": 0, "evexd": 0, "segadd": 9, "segex": 0, "segtrm": 0, "seg": 10, "segexg": 0, "segexd": 0, "expos": 4194304, "wrpos": 17404220, "rdpos": 4195196, "jlat": { "avgcount": 3620, "sum": 19.428560976, "avgtime": 0.005367005 }, "replayed": 2 }, "mds_mem": { "ino": 1614, "ino+": 1614, "ino-": 0, "dir": 76, "dir+": 85, "dir-": 9, "dn": 1728, "dn+": 1728, "dn-": 0, "cap": 1602, "cap+": 1602, "cap-": 0, "rss": 51596, "heap": 331932 }, "mds_server": { "dispatch_client_request": 1864, "dispatch_server_request": 0, "handle_client_request": 1794, "handle_client_session": 3, "handle_slave_request": 0, "req_create_latency": { "avgcount": 1600, "sum": 2.331516366, "avgtime": 0.001457197 }, "req_getattr_latency": { "avgcount": 2, "sum": 0.000941751, "avgtime": 0.000470875 }, "req_getfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_link_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookup_latency": { "avgcount": 1, "sum": 0.001560520, "avgtime": 0.001560520 }, "req_lookuphash_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupino_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupname_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupparent_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lssnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mkdir_latency": { "avgcount": 1, "sum": 0.004721025, "avgtime": 0.004721025 }, "req_mknod_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mksnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_open_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_readdir_latency": { "avgcount": 70, "sum": 0.134635846, "avgtime": 0.001923369 }, "req_rename_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_renamesnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmdir_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setdirlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_symlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_unlink_latency": { "avgcount": 117, "sum": 0.168276719, "avgtime": 0.001438262 }, "cap_revoke_eviction": 0 }, "mds_sessions": { "session_count": 1, "session_add": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1429, "average_load": 1429, "avg_session_uptime": 898 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "buffer_anon_bytes": 116939, "buffer_anon_items": 77, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6128, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 4821216, "mds_co_items": 31052, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "op_active": 0, "op_laggy": 0, "op_send": 3751, "op_send_bytes": 13548370, "op_resend": 0, "op_reply": 3751, "op": 3751, "op_r": 26, "op_w": 3725, "op_rmw": 0, "op_pg": 0, "osdop_stat": 2, "osdop_create": 0, "osdop_read": 8, "osdop_write": 3620, "osdop_writefull": 4, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 1, "osdop_truncate": 1, "osdop_delete": 16, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 14, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 5, "osd_session_open": 5, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 165, "omap_rd": 28, "omap_del": 9 }, "oft": { "omap_total_objs": 0, "omap_total_kv_pairs": 0, "omap_total_updates": 0, "omap_total_removes": 0 }, "purge_queue": { "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executed": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "val": 240, "max": 104857600, "get_started": 0, "get": 10706, "get_sum": 2323447, "get_or_fail_fail": 0, "get_or_fail_success": 10706, "take": 0, "take_sum": 0, "put": 10705, "put_sum": 2323207, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_bytes": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 3751, "take_sum": 13549476, "put": 3722, "put_sum": 13549476, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_ops": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 3751, "take_sum": 3751, "put": 3751, "put_sum": 3751, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle": { "val": 0, "max": 3758096384, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle-0x55eb89907c20": { "val": 446427, "max": 3758096384, "get_started": 0, "get": 6810, "get_sum": 13208586, "get_or_fail_fail": 0, "get_or_fail_success": 6810, "take": 0, "take_sum": 0, "put": 3620, "put_sum": 12762159, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } 2020-05-18T21:35:27.208 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/117, 0/117 2020-05-18T21:35:28.209 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:35:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.314+0000 7f9609f45700 1 Processor -- start 2020-05-18T21:35:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.314+0000 7f9609f45700 1 -- start start 2020-05-18T21:35:28.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.314+0000 7f9609f45700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f96040ba910 0x7f96040ad260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:28.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.314+0000 7f9609f45700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9604143e10 0x7f9604140d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:28.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.314+0000 7f9609f45700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9604141180 0x7f960412c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:28.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.314+0000 7f9609f45700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96040adb00 con 0x7f96040ba910 2020-05-18T21:35:28.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.314+0000 7f9609f45700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96040adda0 con 0x7f9604141180 2020-05-18T21:35:28.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.314+0000 7f9609f45700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96040ae040 con 0x7f9604143e10 2020-05-18T21:35:28.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.314+0000 7f9608f43700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f96040ba910 0x7f96040ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:28.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.314+0000 7f9608f43700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f96040ba910 0x7f96040ad260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34046/0 (socket says 172.21.15.63:34046) 2020-05-18T21:35:28.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.314+0000 7f9608f43700 1 -- 172.21.15.63:0/283347527 learned_addr learned my addr 172.21.15.63:0/283347527 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:28.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.314+0000 7f9603fff700 1 --2- 172.21.15.63:0/283347527 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9604143e10 0x7f9604140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:28.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.314+0000 7f9609744700 1 --2- 172.21.15.63:0/283347527 >> v2:172.21.15.155:3300/0 conn(0x7f9604141180 0x7f960412c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:28.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9608f43700 1 -- 172.21.15.63:0/283347527 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9604143e10 msgr2=0x7f9604140d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:28.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9608f43700 1 --2- 172.21.15.63:0/283347527 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9604143e10 0x7f9604140d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:28.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9608f43700 1 -- 172.21.15.63:0/283347527 >> v2:172.21.15.155:3300/0 conn(0x7f9604141180 msgr2=0x7f960412c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:28.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9608f43700 1 --2- 172.21.15.63:0/283347527 >> v2:172.21.15.155:3300/0 conn(0x7f9604141180 0x7f960412c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:28.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9608f43700 1 -- 172.21.15.63:0/283347527 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96040bacf0 con 0x7f96040ba910 2020-05-18T21:35:28.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9603fff700 1 --2- 172.21.15.63:0/283347527 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9604143e10 0x7f9604140d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:35:28.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9609744700 1 --2- 172.21.15.63:0/283347527 >> v2:172.21.15.155:3300/0 conn(0x7f9604141180 0x7f960412c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:35:28.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9608f43700 1 --2- 172.21.15.63:0/283347527 >> v2:172.21.15.63:3300/0 conn(0x7f96040ba910 0x7f96040ad260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f95f8002f70 tx=0x7f95f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:28.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9608f43700 1 --2- 172.21.15.63:0/283347527 >> v2:172.21.15.63:3300/0 conn(0x7f96040ba910 0x7f96040ad260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f95f8002f70 tx=0x7f95f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:28.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9608f43700 1 --2- 172.21.15.63:0/283347527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96040ba910 0x7f96040ad260 secure :-1 s=READY pgs=1719 cs=0 l=1 rx=0x7f95f8002f70 tx=0x7f95f8007a80).ready entity=mon.0 client_cookie=b0a321bf896f823b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:28.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9608f43700 1 --2- 172.21.15.63:0/283347527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96040ba910 0x7f96040ad260 secure :-1 s=THROTTLE_DONE pgs=1719 cs=0 l=1 rx=0x7f95f8002f70 tx=0x7f95f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:28.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f96037fe700 1 -- 172.21.15.63:0/283347527 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95f8011760 con 0x7f96040ba910 2020-05-18T21:35:28.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9608f43700 1 --2- 172.21.15.63:0/283347527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96040ba910 0x7f96040ad260 secure :-1 s=THROTTLE_DONE pgs=1719 cs=0 l=1 rx=0x7f95f8002f70 tx=0x7f95f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:28.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9608f43700 1 --2- 172.21.15.63:0/283347527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96040ba910 0x7f96040ad260 secure :-1 s=THROTTLE_DONE pgs=1719 cs=0 l=1 rx=0x7f95f8002f70 tx=0x7f95f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:28.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f96037fe700 1 -- 172.21.15.63:0/283347527 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f80118c0 con 0x7f96040ba910 2020-05-18T21:35:28.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f96037fe700 1 -- 172.21.15.63:0/283347527 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95f8011ce0 con 0x7f96040ba910 2020-05-18T21:35:28.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9609f45700 1 -- 172.21.15.63:0/283347527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96040ba910 msgr2=0x7f96040ad260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:28.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9609f45700 1 --2- 172.21.15.63:0/283347527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96040ba910 0x7f96040ad260 secure :-1 s=READY pgs=1719 cs=0 l=1 rx=0x7f95f8002f70 tx=0x7f95f8007a80).stop 2020-05-18T21:35:28.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9609f45700 1 -- 172.21.15.63:0/283347527 shutdown_connections 2020-05-18T21:35:28.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9609f45700 1 --2- 172.21.15.63:0/283347527 >> v2:172.21.15.155:3300/0 conn(0x7f9604141180 0x7f960412c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:28.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9609f45700 1 --2- 172.21.15.63:0/283347527 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9604143e10 0x7f9604140d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:28.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9609f45700 1 --2- 172.21.15.63:0/283347527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96040ba910 0x7f96040ad260 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9609f45700 1 -- 172.21.15.63:0/283347527 >> 172.21.15.63:0/283347527 conn(0x7f9604061450 msgr2=0x7f9604061830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9609f45700 1 -- 172.21.15.63:0/283347527 shutdown_connections 2020-05-18T21:35:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9609f45700 1 -- 172.21.15.63:0/283347527 wait complete. 2020-05-18T21:35:28.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9609f45700 1 Processor -- start 2020-05-18T21:35:28.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.318+0000 7f9609f45700 1 -- start start 2020-05-18T21:35:28.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9609f45700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9604143e10 0x7f9604147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:28.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9609f45700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9604148210 con 0x7f96040ba910 2020-05-18T21:35:28.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9609f45700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96040af870 con 0x7f9604141180 2020-05-18T21:35:28.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9609f45700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96040aee90 con 0x7f9604143e10 2020-05-18T21:35:28.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9608f43700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f96040ba910 0x7f96040ae580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36240/0 (socket says 172.21.15.63:36240) 2020-05-18T21:35:28.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9608f43700 1 -- 172.21.15.63:0/1452548406 learned_addr learned my addr 172.21.15.63:0/1452548406 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:28.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9609744700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9604143e10 0x7f9604147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:28.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9601ffb700 1 -- 172.21.15.63:0/1452548406 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629077119 0 0) 0x7f9604148210 con 0x7f96040ba910 2020-05-18T21:35:28.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9601ffb700 1 -- 172.21.15.63:0/1452548406 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95ec002fe0 con 0x7f96040ba910 2020-05-18T21:35:28.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9601ffb700 1 -- 172.21.15.63:0/1452548406 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2514735642 0 0) 0x7f95ec002fe0 con 0x7f96040ba910 2020-05-18T21:35:28.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9601ffb700 1 -- 172.21.15.63:0/1452548406 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9604148210 con 0x7f96040ba910 2020-05-18T21:35:28.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9601ffb700 1 -- 172.21.15.63:0/1452548406 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f95f8008620 con 0x7f96040ba910 2020-05-18T21:35:28.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9601ffb700 1 -- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9604143e10 msgr2=0x7f9604147db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:28.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9601ffb700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9604143e10 0x7f9604147db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:28.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9601ffb700 1 -- 172.21.15.63:0/1452548406 >> v1:172.21.15.155:6789/0 conn(0x7f9604141180 legacy=0x7f96040b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:28.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9601ffb700 1 -- 172.21.15.63:0/1452548406 >> v1:172.21.15.63:6789/0 conn(0x7f96040ba910 legacy=0x7f96040ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:28.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9601ffb700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec004a80 0x7f95ec004e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:28.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9601ffb700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95ec005310 0x7f95ec003a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:28.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9601ffb700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9604143e10 0x7f95ec003f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:28.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9601ffb700 1 -- 172.21.15.63:0/1452548406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96040aee90 con 0x7f95ec004a80 2020-05-18T21:35:28.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9601ffb700 1 -- 172.21.15.63:0/1452548406 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec004470 con 0x7f95ec005310 2020-05-18T21:35:28.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9601ffb700 1 -- 172.21.15.63:0/1452548406 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec004630 con 0x7f9604143e10 2020-05-18T21:35:28.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9608f43700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec004a80 0x7f95ec004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:28.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9609744700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9604143e10 0x7f95ec003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:28.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9603fff700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95ec005310 0x7f95ec003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:28.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9608f43700 1 -- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9604143e10 msgr2=0x7f95ec003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:28.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9608f43700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9604143e10 0x7f95ec003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:28.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9608f43700 1 -- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95ec005310 msgr2=0x7f95ec003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:28.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9608f43700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95ec005310 0x7f95ec003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:28.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9608f43700 1 -- 172.21.15.63:0/1452548406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96040af130 con 0x7f95ec004a80 2020-05-18T21:35:28.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9609744700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9604143e10 0x7f95ec003f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:35:28.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9603fff700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95ec005310 0x7f95ec003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:35:28.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9609f45700 1 -- 172.21.15.63:0/1452548406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96040af3d0 con 0x7f95ec004a80 2020-05-18T21:35:28.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9608f43700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec004a80 0x7f95ec004e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f95f8010300 tx=0x7f95f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:28.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9609f45700 1 -- 172.21.15.63:0/1452548406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96040b12f0 con 0x7f95ec004a80 2020-05-18T21:35:28.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9608f43700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec004a80 0x7f95ec004e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f95f8010300 tx=0x7f95f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:28.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9608f43700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec004a80 0x7f95ec004e60 secure :-1 s=READY pgs=1721 cs=0 l=1 rx=0x7f95f8010300 tx=0x7f95f8007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:28.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9608f43700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec004a80 0x7f95ec004e60 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7f95f8010300 tx=0x7f95f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:28.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9608f43700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec004a80 0x7f95ec004e60 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7f95f8010300 tx=0x7f95f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:28.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9608f43700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec004a80 0x7f95ec004e60 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7f95f8010300 tx=0x7f95f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:28.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9601ffb700 1 -- 172.21.15.63:0/1452548406 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95f80078c0 con 0x7f95ec004a80 2020-05-18T21:35:28.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9601ffb700 1 -- 172.21.15.63:0/1452548406 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f800ae30 con 0x7f95ec004a80 2020-05-18T21:35:28.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.322+0000 7f9601ffb700 1 -- 172.21.15.63:0/1452548406 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95f8007360 con 0x7f95ec004a80 2020-05-18T21:35:28.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.326+0000 7f9609f45700 1 -- 172.21.15.63:0/1452548406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e0003380 con 0x7f95ec004a80 2020-05-18T21:35:28.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.326+0000 7f9608f43700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec004a80 0x7f95ec004e60 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7f95f8010300 tx=0x7f95f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:28.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.326+0000 7f9601ffb700 1 -- 172.21.15.63:0/1452548406 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f95f80074c0 con 0x7f95ec004a80 2020-05-18T21:35:28.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.326+0000 7f9608f43700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec004a80 0x7f95ec004e60 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7f95f8010300 tx=0x7f95f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:28.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.326+0000 7f9601ffb700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f95ec057b30 0x7f95ec059ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:28.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.326+0000 7f9601ffb700 1 -- 172.21.15.63:0/1452548406 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f95f8064d10 con 0x7f95ec004a80 2020-05-18T21:35:28.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.326+0000 7f9603fff700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f95ec057b30 0x7f95ec059ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:28.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.326+0000 7f9603fff700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f95ec057b30 0x7f95ec059ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f95f0002f30 tx=0x7f95f0009620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:28.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.326+0000 7f9603fff700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f95ec057b30 0x7f95ec059ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f95f0002f30 tx=0x7f95f0009620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:28.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.326+0000 7f9603fff700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f95ec057b30 0x7f95ec059ff0 secure :-1 s=READY pgs=666 cs=0 l=1 rx=0x7f95f0002f30 tx=0x7f95f0009620).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:28.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.330+0000 7f9608f43700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec004a80 0x7f95ec004e60 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7f95f8010300 tx=0x7f95f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:28.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.330+0000 7f9601ffb700 1 -- 172.21.15.63:0/1452548406 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f95f803f1c0 con 0x7f95ec004a80 2020-05-18T21:35:28.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.486+0000 7f9609f45700 1 -- 172.21.15.63:0/1452548406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95e0003720 con 0x7f95ec004a80 2020-05-18T21:35:28.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.486+0000 7f9608f43700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec004a80 0x7f95ec004e60 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7f95f8010300 tx=0x7f95f8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:28.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.486+0000 7f9601ffb700 1 -- 172.21.15.63:0/1452548406 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f95f80427e0 con 0x7f95ec004a80 2020-05-18T21:35:28.492 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:28.492 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":98,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/3483934102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3483934102},{"type":"v1","addr":"172.21.15.155:6835","nonce":3483934102}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":98}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:34:27.767123+0000","modified":"2020-05-18T21:34:41.281280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"a","rank":0,"incarnation":94,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6833/1314928434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1314928434},{"type":"v1","addr":"172.21.15.63:6833","nonce":1314928434}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-05-18T21:35:28.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.490+0000 7f9609f45700 1 -- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f95ec057b30 msgr2=0x7f95ec059ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:28.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.490+0000 7f9609f45700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f95ec057b30 0x7f95ec059ff0 secure :-1 s=READY pgs=666 cs=0 l=1 rx=0x7f95f0002f30 tx=0x7f95f0009620).stop 2020-05-18T21:35:28.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.490+0000 7f9609f45700 1 -- 172.21.15.63:0/1452548406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec004a80 msgr2=0x7f95ec004e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:28.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.490+0000 7f9609f45700 1 --2- 172.21.15.63:0/1452548406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec004a80 0x7f95ec004e60 secure :-1 s=READY pgs=1721 cs=0 l=1 rx=0x7f95f8010300 tx=0x7f95f8007a80).stop 2020-05-18T21:35:28.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.490+0000 7f9609744700 1 -- 172.21.15.63:0/1452548406 reap_dead start 2020-05-18T21:35:28.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.490+0000 7f9609744700 1 -- 172.21.15.63:0/1452548406 reap_dead start 2020-05-18T21:35:28.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.490+0000 7f9609f45700 1 -- 172.21.15.63:0/1452548406 shutdown_connections 2020-05-18T21:35:28.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.490+0000 7f9609f45700 1 -- 172.21.15.63:0/1452548406 >> 172.21.15.63:0/1452548406 conn(0x7f9604061450 msgr2=0x7f9604143620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:28.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.490+0000 7f9609f45700 1 -- 172.21.15.63:0/1452548406 shutdown_connections 2020-05-18T21:35:28.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:28.490+0000 7f9609f45700 1 -- 172.21.15.63:0/1452548406 wait complete. 2020-05-18T21:35:28.497 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 98 2020-05-18T21:35:28.504 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2020-05-18T21:35:28.617 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:35:28.617 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-0": { 2020-05-18T21:35:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 40, 2020-05-18T21:35:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 35, 2020-05-18T21:35:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 80297, 2020-05-18T21:35:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 66992, 2020-05-18T21:35:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 5, 2020-05-18T21:35:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 0, 2020-05-18T21:35:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.012051737, 2020-05-18T21:35:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.002081454, 2020-05-18T21:35:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.011691825, 2020-05-18T21:35:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000861883, 2020-05-18T21:35:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:28.620 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 35, 2020-05-18T21:35:28.620 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.006328181, 2020-05-18T21:35:28.620 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000180805 2020-05-18T21:35:28.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.620 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:28.621 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.621 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.621 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.621 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:28.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.622 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-1": { 2020-05-18T21:35:28.622 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 1348, 2020-05-18T21:35:28.622 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 1360, 2020-05-18T21:35:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 317375, 2020-05-18T21:35:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 5178507, 2020-05-18T21:35:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 5, 2020-05-18T21:35:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 2, 2020-05-18T21:35:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.176517805, 2020-05-18T21:35:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.067063226, 2020-05-18T21:35:28.624 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.041030696, 2020-05-18T21:35:28.624 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.056508800, 2020-05-18T21:35:28.624 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:28.624 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1360, 2020-05-18T21:35:28.624 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.056415349, 2020-05-18T21:35:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000041481 2020-05-18T21:35:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.626 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:28.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.626 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-2": { 2020-05-18T21:35:28.626 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 9846, 2020-05-18T21:35:28.626 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 16559, 2020-05-18T21:35:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 2884687, 2020-05-18T21:35:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 15594304, 2020-05-18T21:35:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 5, 2020-05-18T21:35:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 2, 2020-05-18T21:35:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 1.534970523, 2020-05-18T21:35:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.728179968, 2020-05-18T21:35:28.628 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.831521818, 2020-05-18T21:35:28.628 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.103880924, 2020-05-18T21:35:28.628 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:28.628 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 16558, 2020-05-18T21:35:28.628 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.717363612, 2020-05-18T21:35:28.629 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000043324 2020-05-18T21:35:28.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.629 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:28.629 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 20676, 2020-05-18T21:35:28.629 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.007402122, 2020-05-18T21:35:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000358 2020-05-18T21:35:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: "cct": { 2020-05-18T21:35:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: "total_workers": 1, 2020-05-18T21:35:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: "unhealthy_workers": 0 2020-05-18T21:35:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-MDSRank": { 2020-05-18T21:35:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2020-05-18T21:35:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2020-05-18T21:35:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 6428, 2020-05-18T21:35:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 3.072920168, 2020-05-18T21:35:28.632 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000478052 2020-05-18T21:35:28.632 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:28.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.634 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-PurgeQueue": { 2020-05-18T21:35:28.634 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2020-05-18T21:35:28.634 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2020-05-18T21:35:28.635 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 4, 2020-05-18T21:35:28.635 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000135958, 2020-05-18T21:35:28.635 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000033989 2020-05-18T21:35:28.635 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:28.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.636 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2020-05-18T21:35:28.636 INFO:teuthology.orchestra.run.smithi063.stdout: "request": 2250, 2020-05-18T21:35:28.636 INFO:teuthology.orchestra.run.smithi063.stdout: "reply": 2248, 2020-05-18T21:35:28.636 INFO:teuthology.orchestra.run.smithi063.stdout: "reply_latency": { 2020-05-18T21:35:28.636 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 2248, 2020-05-18T21:35:28.637 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 3.359399729, 2020-05-18T21:35:28.637 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001494394 2020-05-18T21:35:28.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.637 INFO:teuthology.orchestra.run.smithi063.stdout: "forward": 0, 2020-05-18T21:35:28.637 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_fetch": 12, 2020-05-18T21:35:28.637 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_commit": 73, 2020-05-18T21:35:28.638 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_split": 9, 2020-05-18T21:35:28.638 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_merge": 0, 2020-05-18T21:35:28.638 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes": 1611, 2020-05-18T21:35:28.638 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_top": 0, 2020-05-18T21:35:28.638 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_bottom": 1611, 2020-05-18T21:35:28.639 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pin_tail": 0, 2020-05-18T21:35:28.639 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pinned": 1611, 2020-05-18T21:35:28.639 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_expired": 0, 2020-05-18T21:35:28.639 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_with_caps": 1602, 2020-05-18T21:35:28.639 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": 1602, 2020-05-18T21:35:28.639 INFO:teuthology.orchestra.run.smithi063.stdout: "subtrees": 2, 2020-05-18T21:35:28.640 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse": 2251, 2020-05-18T21:35:28.640 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_hit": 2249, 2020-05-18T21:35:28.640 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_forward": 0, 2020-05-18T21:35:28.640 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_discover": 0, 2020-05-18T21:35:28.640 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_dir_fetch": 0, 2020-05-18T21:35:28.641 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_remote_ino": 0, 2020-05-18T21:35:28.641 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_lock": 0, 2020-05-18T21:35:28.641 INFO:teuthology.orchestra.run.smithi063.stdout: "load_cent": 223899, 2020-05-18T21:35:28.641 INFO:teuthology.orchestra.run.smithi063.stdout: "q": 0, 2020-05-18T21:35:28.641 INFO:teuthology.orchestra.run.smithi063.stdout: "exported": 0, 2020-05-18T21:35:28.642 INFO:teuthology.orchestra.run.smithi063.stdout: "exported_inodes": 0, 2020-05-18T21:35:28.642 INFO:teuthology.orchestra.run.smithi063.stdout: "imported": 0, 2020-05-18T21:35:28.642 INFO:teuthology.orchestra.run.smithi063.stdout: "imported_inodes": 0, 2020-05-18T21:35:28.643 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_dir_fetch": 0, 2020-05-18T21:35:28.643 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_backtrace_fetch": 0, 2020-05-18T21:35:28.643 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_peer_discover": 0, 2020-05-18T21:35:28.643 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rfiles": 1432, 2020-05-18T21:35:28.644 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rbytes": 10896408576, 2020-05-18T21:35:28.644 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rsnaps": 0 2020-05-18T21:35:28.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.644 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:35:28.645 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays": 574, 2020-05-18T21:35:28.646 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_delayed": 0, 2020-05-18T21:35:28.647 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:35:28.648 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_created": 574, 2020-05-18T21:35:28.648 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 0, 2020-05-18T21:35:28.648 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_reintegrated": 0, 2020-05-18T21:35:28.648 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_migrated": 0, 2020-05-18T21:35:28.649 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_processing": 0, 2020-05-18T21:35:28.649 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:35:28.649 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:35:28.649 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_started": 0, 2020-05-18T21:35:28.649 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_completed": 0, 2020-05-18T21:35:28.650 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:35:28.650 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_exportdir": 0, 2020-05-18T21:35:28.650 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_flush": 0, 2020-05-18T21:35:28.650 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragmentdir": 9, 2020-05-18T21:35:28.650 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragstats": 0, 2020-05-18T21:35:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_inodestats": 0 2020-05-18T21:35:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log": { 2020-05-18T21:35:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: "evadd": 7335, 2020-05-18T21:35:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: "evex": 0, 2020-05-18T21:35:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: "evtrm": 0, 2020-05-18T21:35:28.652 INFO:teuthology.orchestra.run.smithi063.stdout: "ev": 7337, 2020-05-18T21:35:28.652 INFO:teuthology.orchestra.run.smithi063.stdout: "evexg": 0, 2020-05-18T21:35:28.652 INFO:teuthology.orchestra.run.smithi063.stdout: "evexd": 0, 2020-05-18T21:35:28.652 INFO:teuthology.orchestra.run.smithi063.stdout: "segadd": 9, 2020-05-18T21:35:28.652 INFO:teuthology.orchestra.run.smithi063.stdout: "segex": 0, 2020-05-18T21:35:28.653 INFO:teuthology.orchestra.run.smithi063.stdout: "segtrm": 0, 2020-05-18T21:35:28.653 INFO:teuthology.orchestra.run.smithi063.stdout: "seg": 10, 2020-05-18T21:35:28.654 INFO:teuthology.orchestra.run.smithi063.stdout: "segexg": 0, 2020-05-18T21:35:28.654 INFO:teuthology.orchestra.run.smithi063.stdout: "segexd": 0, 2020-05-18T21:35:28.655 INFO:teuthology.orchestra.run.smithi063.stdout: "expos": 4194304, 2020-05-18T21:35:28.655 INFO:teuthology.orchestra.run.smithi063.stdout: "wrpos": 18958312, 2020-05-18T21:35:28.655 INFO:teuthology.orchestra.run.smithi063.stdout: "rdpos": 4195196, 2020-05-18T21:35:28.655 INFO:teuthology.orchestra.run.smithi063.stdout: "jlat": { 2020-05-18T21:35:28.656 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 3620, 2020-05-18T21:35:28.656 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 19.428560976, 2020-05-18T21:35:28.656 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.005367005 2020-05-18T21:35:28.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.657 INFO:teuthology.orchestra.run.smithi063.stdout: "replayed": 2 2020-05-18T21:35:28.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.658 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_mem": { 2020-05-18T21:35:28.658 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1614, 2020-05-18T21:35:28.660 INFO:teuthology.orchestra.run.smithi063.stdout: "ino+": 1614, 2020-05-18T21:35:28.662 INFO:teuthology.orchestra.run.smithi063.stdout: "ino-": 0, 2020-05-18T21:35:28.662 INFO:teuthology.orchestra.run.smithi063.stdout: "dir": 76, 2020-05-18T21:35:28.662 INFO:teuthology.orchestra.run.smithi063.stdout: "dir+": 85, 2020-05-18T21:35:28.663 INFO:teuthology.orchestra.run.smithi063.stdout: "dir-": 9, 2020-05-18T21:35:28.663 INFO:teuthology.orchestra.run.smithi063.stdout: "dn": 2185, 2020-05-18T21:35:28.664 INFO:teuthology.orchestra.run.smithi063.stdout: "dn+": 2185, 2020-05-18T21:35:28.664 INFO:teuthology.orchestra.run.smithi063.stdout: "dn-": 0, 2020-05-18T21:35:28.665 INFO:teuthology.orchestra.run.smithi063.stdout: "cap": 1602, 2020-05-18T21:35:28.665 INFO:teuthology.orchestra.run.smithi063.stdout: "cap+": 1602, 2020-05-18T21:35:28.665 INFO:teuthology.orchestra.run.smithi063.stdout: "cap-": 0, 2020-05-18T21:35:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: "rss": 65120, 2020-05-18T21:35:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: "heap": 331932 2020-05-18T21:35:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_server": { 2020-05-18T21:35:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_client_request": 2321, 2020-05-18T21:35:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_server_request": 0, 2020-05-18T21:35:28.667 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_request": 2250, 2020-05-18T21:35:28.667 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_session": 3, 2020-05-18T21:35:28.667 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_slave_request": 0, 2020-05-18T21:35:28.667 INFO:teuthology.orchestra.run.smithi063.stdout: "req_create_latency": { 2020-05-18T21:35:28.667 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1600, 2020-05-18T21:35:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 2.331516366, 2020-05-18T21:35:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001457197 2020-05-18T21:35:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getattr_latency": { 2020-05-18T21:35:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 2, 2020-05-18T21:35:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000941751, 2020-05-18T21:35:28.669 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000470875 2020-05-18T21:35:28.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.669 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getfilelock_latency": { 2020-05-18T21:35:28.669 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.669 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: "req_link_latency": { 2020-05-18T21:35:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.671 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookup_latency": { 2020-05-18T21:35:28.671 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:28.671 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.001560520, 2020-05-18T21:35:28.671 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001560520 2020-05-18T21:35:28.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.678 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookuphash_latency": { 2020-05-18T21:35:28.679 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.679 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.679 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.680 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupino_latency": { 2020-05-18T21:35:28.681 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.681 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.681 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.681 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupname_latency": { 2020-05-18T21:35:28.682 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.682 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.682 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.682 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupparent_latency": { 2020-05-18T21:35:28.683 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.683 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.683 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.683 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupsnap_latency": { 2020-05-18T21:35:28.683 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.684 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.684 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.684 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lssnap_latency": { 2020-05-18T21:35:28.685 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.685 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.685 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.685 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mkdir_latency": { 2020-05-18T21:35:28.686 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:28.686 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.004721025, 2020-05-18T21:35:28.686 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.004721025 2020-05-18T21:35:28.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.686 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mknod_latency": { 2020-05-18T21:35:28.687 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.687 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.687 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.687 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mksnap_latency": { 2020-05-18T21:35:28.687 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.688 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.689 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.689 INFO:teuthology.orchestra.run.smithi063.stdout: "req_open_latency": { 2020-05-18T21:35:28.689 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.690 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.690 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.690 INFO:teuthology.orchestra.run.smithi063.stdout: "req_readdir_latency": { 2020-05-18T21:35:28.690 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 70, 2020-05-18T21:35:28.690 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.134635846, 2020-05-18T21:35:28.691 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001923369 2020-05-18T21:35:28.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.691 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rename_latency": { 2020-05-18T21:35:28.691 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.691 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.692 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.692 INFO:teuthology.orchestra.run.smithi063.stdout: "req_renamesnap_latency": { 2020-05-18T21:35:28.692 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.692 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.692 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.693 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmdir_latency": { 2020-05-18T21:35:28.693 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.693 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.693 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.694 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmsnap_latency": { 2020-05-18T21:35:28.694 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.694 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.694 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.695 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmxattr_latency": { 2020-05-18T21:35:28.695 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.695 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.695 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.696 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setattr_latency": { 2020-05-18T21:35:28.696 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.696 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.696 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.697 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setdirlayout_latency": { 2020-05-18T21:35:28.697 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.697 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.697 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.698 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setfilelock_latency": { 2020-05-18T21:35:28.698 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.698 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.698 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.699 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setlayout_latency": { 2020-05-18T21:35:28.699 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.699 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.699 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.700 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setxattr_latency": { 2020-05-18T21:35:28.700 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.700 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.700 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.701 INFO:teuthology.orchestra.run.smithi063.stdout: "req_symlink_latency": { 2020-05-18T21:35:28.701 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.701 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.701 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.702 INFO:teuthology.orchestra.run.smithi063.stdout: "req_unlink_latency": { 2020-05-18T21:35:28.702 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 574, 2020-05-18T21:35:28.702 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.886024221, 2020-05-18T21:35:28.702 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001543596 2020-05-18T21:35:28.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: "cap_revoke_eviction": 0 2020-05-18T21:35:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_sessions": { 2020-05-18T21:35:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: "session_count": 1, 2020-05-18T21:35:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: "session_add": 1, 2020-05-18T21:35:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: "session_remove": 0, 2020-05-18T21:35:28.704 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_open": 1, 2020-05-18T21:35:28.704 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_stale": 0, 2020-05-18T21:35:28.704 INFO:teuthology.orchestra.run.smithi063.stdout: "total_load": 1856, 2020-05-18T21:35:28.704 INFO:teuthology.orchestra.run.smithi063.stdout: "average_load": 1856, 2020-05-18T21:35:28.704 INFO:teuthology.orchestra.run.smithi063.stdout: "avg_session_uptime": 898 2020-05-18T21:35:28.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.705 INFO:teuthology.orchestra.run.smithi063.stdout: "mempool": { 2020-05-18T21:35:28.705 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_bytes": 0, 2020-05-18T21:35:28.705 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_items": 0, 2020-05-18T21:35:28.705 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_bytes": 0, 2020-05-18T21:35:28.706 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_items": 0, 2020-05-18T21:35:28.706 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_bytes": 0, 2020-05-18T21:35:28.706 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_items": 0, 2020-05-18T21:35:28.706 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_bytes": 0, 2020-05-18T21:35:28.706 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_items": 0, 2020-05-18T21:35:28.706 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_bytes": 0, 2020-05-18T21:35:28.707 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_items": 0, 2020-05-18T21:35:28.707 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_bytes": 0, 2020-05-18T21:35:28.707 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_items": 0, 2020-05-18T21:35:28.707 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_bytes": 0, 2020-05-18T21:35:28.707 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_items": 0, 2020-05-18T21:35:28.708 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_bytes": 0, 2020-05-18T21:35:28.708 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_items": 0, 2020-05-18T21:35:28.708 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_bytes": 0, 2020-05-18T21:35:28.708 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_items": 0, 2020-05-18T21:35:28.708 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_bytes": 0, 2020-05-18T21:35:28.708 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_items": 0, 2020-05-18T21:35:28.709 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_bytes": 116939, 2020-05-18T21:35:28.710 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_items": 77, 2020-05-18T21:35:28.710 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_bytes": 0, 2020-05-18T21:35:28.711 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_items": 0, 2020-05-18T21:35:28.711 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bytes": 0, 2020-05-18T21:35:28.711 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_items": 0, 2020-05-18T21:35:28.711 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_bytes": 0, 2020-05-18T21:35:28.711 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_items": 0, 2020-05-18T21:35:28.712 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_bytes": 0, 2020-05-18T21:35:28.712 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_items": 0, 2020-05-18T21:35:28.712 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_bytes": 6128, 2020-05-18T21:35:28.712 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_items": 93, 2020-05-18T21:35:28.712 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_bytes": 0, 2020-05-18T21:35:28.712 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_items": 0, 2020-05-18T21:35:28.713 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_bytes": 0, 2020-05-18T21:35:28.713 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_items": 0, 2020-05-18T21:35:28.713 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_bytes": 4821216, 2020-05-18T21:35:28.713 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_items": 31052, 2020-05-18T21:35:28.713 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_bytes": 0, 2020-05-18T21:35:28.714 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_items": 0, 2020-05-18T21:35:28.714 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_bytes": 0, 2020-05-18T21:35:28.714 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_items": 0 2020-05-18T21:35:28.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.714 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter": { 2020-05-18T21:35:28.715 INFO:teuthology.orchestra.run.smithi063.stdout: "op_active": 0, 2020-05-18T21:35:28.715 INFO:teuthology.orchestra.run.smithi063.stdout: "op_laggy": 0, 2020-05-18T21:35:28.716 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send": 3751, 2020-05-18T21:35:28.716 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send_bytes": 13548370, 2020-05-18T21:35:28.716 INFO:teuthology.orchestra.run.smithi063.stdout: "op_resend": 0, 2020-05-18T21:35:28.716 INFO:teuthology.orchestra.run.smithi063.stdout: "op_reply": 3751, 2020-05-18T21:35:28.717 INFO:teuthology.orchestra.run.smithi063.stdout: "op": 3751, 2020-05-18T21:35:28.717 INFO:teuthology.orchestra.run.smithi063.stdout: "op_r": 26, 2020-05-18T21:35:28.717 INFO:teuthology.orchestra.run.smithi063.stdout: "op_w": 3725, 2020-05-18T21:35:28.717 INFO:teuthology.orchestra.run.smithi063.stdout: "op_rmw": 0, 2020-05-18T21:35:28.717 INFO:teuthology.orchestra.run.smithi063.stdout: "op_pg": 0, 2020-05-18T21:35:28.718 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_stat": 2, 2020-05-18T21:35:28.718 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_create": 0, 2020-05-18T21:35:28.718 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_read": 8, 2020-05-18T21:35:28.718 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_write": 3620, 2020-05-18T21:35:28.719 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writefull": 4, 2020-05-18T21:35:28.719 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writesame": 0, 2020-05-18T21:35:28.719 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_append": 0, 2020-05-18T21:35:28.720 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_zero": 1, 2020-05-18T21:35:28.720 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_truncate": 1, 2020-05-18T21:35:28.720 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_delete": 16, 2020-05-18T21:35:28.721 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_mapext": 0, 2020-05-18T21:35:28.721 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_sparse_read": 0, 2020-05-18T21:35:28.721 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_clonerange": 0, 2020-05-18T21:35:28.721 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_getxattr": 14, 2020-05-18T21:35:28.721 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_setxattr": 0, 2020-05-18T21:35:28.722 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_cmpxattr": 0, 2020-05-18T21:35:28.722 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_rmxattr": 0, 2020-05-18T21:35:28.722 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_resetxattrs": 0, 2020-05-18T21:35:28.722 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_call": 0, 2020-05-18T21:35:28.722 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_watch": 0, 2020-05-18T21:35:28.723 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_notify": 0, 2020-05-18T21:35:28.723 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_src_cmpxattr": 0, 2020-05-18T21:35:28.723 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls": 0, 2020-05-18T21:35:28.723 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls_filter": 0, 2020-05-18T21:35:28.723 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_other": 0, 2020-05-18T21:35:28.723 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_active": 0, 2020-05-18T21:35:28.724 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_send": 0, 2020-05-18T21:35:28.724 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_resend": 0, 2020-05-18T21:35:28.725 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_ping": 0, 2020-05-18T21:35:28.725 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_active": 0, 2020-05-18T21:35:28.725 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_send": 0, 2020-05-18T21:35:28.725 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_resend": 0, 2020-05-18T21:35:28.726 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_active": 0, 2020-05-18T21:35:28.726 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_send": 0, 2020-05-18T21:35:28.726 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_resend": 0, 2020-05-18T21:35:28.726 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_active": 0, 2020-05-18T21:35:28.726 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_send": 0, 2020-05-18T21:35:28.727 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_resend": 0, 2020-05-18T21:35:28.727 INFO:teuthology.orchestra.run.smithi063.stdout: "command_active": 0, 2020-05-18T21:35:28.727 INFO:teuthology.orchestra.run.smithi063.stdout: "command_send": 0, 2020-05-18T21:35:28.728 INFO:teuthology.orchestra.run.smithi063.stdout: "command_resend": 0, 2020-05-18T21:35:28.728 INFO:teuthology.orchestra.run.smithi063.stdout: "map_epoch": 0, 2020-05-18T21:35:28.728 INFO:teuthology.orchestra.run.smithi063.stdout: "map_full": 0, 2020-05-18T21:35:28.728 INFO:teuthology.orchestra.run.smithi063.stdout: "map_inc": 0, 2020-05-18T21:35:28.729 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_sessions": 5, 2020-05-18T21:35:28.729 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_open": 5, 2020-05-18T21:35:28.729 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_close": 0, 2020-05-18T21:35:28.729 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_laggy": 0, 2020-05-18T21:35:28.729 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_wr": 165, 2020-05-18T21:35:28.730 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_rd": 28, 2020-05-18T21:35:28.730 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_del": 9 2020-05-18T21:35:28.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.731 INFO:teuthology.orchestra.run.smithi063.stdout: "oft": { 2020-05-18T21:35:28.731 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_objs": 0, 2020-05-18T21:35:28.731 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_kv_pairs": 0, 2020-05-18T21:35:28.731 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_updates": 0, 2020-05-18T21:35:28.732 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_removes": 0 2020-05-18T21:35:28.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.732 INFO:teuthology.orchestra.run.smithi063.stdout: "purge_queue": { 2020-05-18T21:35:28.732 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops": 0, 2020-05-18T21:35:28.732 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops_high_water": 0, 2020-05-18T21:35:28.733 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing": 0, 2020-05-18T21:35:28.733 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_high_water": 0, 2020-05-18T21:35:28.733 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executed": 0, 2020-05-18T21:35:28.733 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_item_in_journal": 0 2020-05-18T21:35:28.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.734 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-05-18T21:35:28.734 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:28.735 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2020-05-18T21:35:28.735 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:28.735 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 11231, 2020-05-18T21:35:28.735 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 2450273, 2020-05-18T21:35:28.736 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:28.736 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 11231, 2020-05-18T21:35:28.736 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:28.737 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:28.737 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 11231, 2020-05-18T21:35:28.737 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 2450273, 2020-05-18T21:35:28.738 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:28.738 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.738 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.739 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.739 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:28.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.740 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_bytes": { 2020-05-18T21:35:28.740 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:28.741 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2020-05-18T21:35:28.741 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:28.741 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2020-05-18T21:35:28.742 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2020-05-18T21:35:28.742 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:28.742 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2020-05-18T21:35:28.742 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 3751, 2020-05-18T21:35:28.743 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 13549476, 2020-05-18T21:35:28.743 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 3722, 2020-05-18T21:35:28.743 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 13549476, 2020-05-18T21:35:28.744 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:28.744 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.744 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.745 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.745 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:28.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.745 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_ops": { 2020-05-18T21:35:28.746 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:28.746 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 1024, 2020-05-18T21:35:28.747 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:28.747 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2020-05-18T21:35:28.747 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2020-05-18T21:35:28.748 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:28.748 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2020-05-18T21:35:28.748 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 3751, 2020-05-18T21:35:28.748 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 3751, 2020-05-18T21:35:28.748 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 3751, 2020-05-18T21:35:28.749 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 3751, 2020-05-18T21:35:28.749 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:28.749 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.749 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.749 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.749 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:28.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.750 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle": { 2020-05-18T21:35:28.750 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:28.750 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2020-05-18T21:35:28.750 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:28.751 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2020-05-18T21:35:28.751 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2020-05-18T21:35:28.751 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:28.751 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2020-05-18T21:35:28.751 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:28.752 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:28.752 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 0, 2020-05-18T21:35:28.752 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 0, 2020-05-18T21:35:28.752 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:28.752 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.752 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.753 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.753 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:28.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:28.753 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle-0x55eb89907c20": { 2020-05-18T21:35:28.753 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 2000519, 2020-05-18T21:35:28.754 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2020-05-18T21:35:28.754 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:28.754 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 7335, 2020-05-18T21:35:28.754 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 14762678, 2020-05-18T21:35:28.754 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:28.754 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 7335, 2020-05-18T21:35:28.755 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:28.755 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:28.755 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 3620, 2020-05-18T21:35:28.755 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 12762159, 2020-05-18T21:35:28.755 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:28.756 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:28.756 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:28.756 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:28.756 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:28.756 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:28.757 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:35:28.758 INFO:tasks.cephfs.filesystem:_json_asok output: { "AsyncMessenger::Worker-0": { "msgr_recv_messages": 40, "msgr_send_messages": 35, "msgr_recv_bytes": 80297, "msgr_send_bytes": 66992, "msgr_created_connections": 5, "msgr_active_connections": 0, "msgr_running_total_time": 0.012051737, "msgr_running_send_time": 0.002081454, "msgr_running_recv_time": 0.011691825, "msgr_running_fast_dispatch_time": 0.000861883, "msgr_send_messages_queue_lat": { "avgcount": 35, "sum": 0.006328181, "avgtime": 0.000180805 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-1": { "msgr_recv_messages": 1348, "msgr_send_messages": 1360, "msgr_recv_bytes": 317375, "msgr_send_bytes": 5178507, "msgr_created_connections": 5, "msgr_active_connections": 2, "msgr_running_total_time": 0.176517805, "msgr_running_send_time": 0.067063226, "msgr_running_recv_time": 0.041030696, "msgr_running_fast_dispatch_time": 0.056508800, "msgr_send_messages_queue_lat": { "avgcount": 1360, "sum": 0.056415349, "avgtime": 0.000041481 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-2": { "msgr_recv_messages": 9846, "msgr_send_messages": 16559, "msgr_recv_bytes": 2884687, "msgr_send_bytes": 15594304, "msgr_created_connections": 5, "msgr_active_connections": 2, "msgr_running_total_time": 1.534970523, "msgr_running_send_time": 0.728179968, "msgr_running_recv_time": 0.831521818, "msgr_running_fast_dispatch_time": 0.103880924, "msgr_send_messages_queue_lat": { "avgcount": 16558, "sum": 0.717363612, "avgtime": 0.000043324 }, "msgr_handle_ack_lat": { "avgcount": 20676, "sum": 0.007402122, "avgtime": 0.000000358 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "queue_len": 0, "complete_latency": { "avgcount": 6428, "sum": 3.072920168, "avgtime": 0.000478052 } }, "finisher-PurgeQueue": { "queue_len": 0, "complete_latency": { "avgcount": 4, "sum": 0.000135958, "avgtime": 0.000033989 } }, "mds": { "request": 2250, "reply": 2248, "reply_latency": { "avgcount": 2248, "sum": 3.359399729, "avgtime": 0.001494394 }, "forward": 0, "dir_fetch": 12, "dir_commit": 73, "dir_split": 9, "dir_merge": 0, "inodes": 1611, "inodes_top": 0, "inodes_bottom": 1611, "inodes_pin_tail": 0, "inodes_pinned": 1611, "inodes_expired": 0, "inodes_with_caps": 1602, "caps": 1602, "subtrees": 2, "traverse": 2251, "traverse_hit": 2249, "traverse_forward": 0, "traverse_discover": 0, "traverse_dir_fetch": 0, "traverse_remote_ino": 0, "traverse_lock": 0, "load_cent": 223899, "q": 0, "exported": 0, "exported_inodes": 0, "imported": 0, "imported_inodes": 0, "openino_dir_fetch": 0, "openino_backtrace_fetch": 0, "openino_peer_discover": 0, "root_rfiles": 1432, "root_rbytes": 10896408576, "root_rsnaps": 0 }, "mds_cache": { "num_strays": 574, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "strays_created": 574, "strays_enqueued": 0, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 9, "ireq_fragstats": 0, "ireq_inodestats": 0 }, "mds_log": { "evadd": 7335, "evex": 0, "evtrm": 0, "ev": 7337, "evexg": 0, "evexd": 0, "segadd": 9, "segex": 0, "segtrm": 0, "seg": 10, "segexg": 0, "segexd": 0, "expos": 4194304, "wrpos": 18958312, "rdpos": 4195196, "jlat": { "avgcount": 3620, "sum": 19.428560976, "avgtime": 0.005367005 }, "replayed": 2 }, "mds_mem": { "ino": 1614, "ino+": 1614, "ino-": 0, "dir": 76, "dir+": 85, "dir-": 9, "dn": 2185, "dn+": 2185, "dn-": 0, "cap": 1602, "cap+": 1602, "cap-": 0, "rss": 65120, "heap": 331932 }, "mds_server": { "dispatch_client_request": 2321, "dispatch_server_request": 0, "handle_client_request": 2250, "handle_client_session": 3, "handle_slave_request": 0, "req_create_latency": { "avgcount": 1600, "sum": 2.331516366, "avgtime": 0.001457197 }, "req_getattr_latency": { "avgcount": 2, "sum": 0.000941751, "avgtime": 0.000470875 }, "req_getfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_link_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookup_latency": { "avgcount": 1, "sum": 0.001560520, "avgtime": 0.001560520 }, "req_lookuphash_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupino_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupname_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupparent_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lssnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mkdir_latency": { "avgcount": 1, "sum": 0.004721025, "avgtime": 0.004721025 }, "req_mknod_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mksnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_open_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_readdir_latency": { "avgcount": 70, "sum": 0.134635846, "avgtime": 0.001923369 }, "req_rename_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_renamesnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmdir_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setdirlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_symlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_unlink_latency": { "avgcount": 574, "sum": 0.886024221, "avgtime": 0.001543596 }, "cap_revoke_eviction": 0 }, "mds_sessions": { "session_count": 1, "session_add": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1856, "average_load": 1856, "avg_session_uptime": 898 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "buffer_anon_bytes": 116939, "buffer_anon_items": 77, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6128, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 4821216, "mds_co_items": 31052, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "op_active": 0, "op_laggy": 0, "op_send": 3751, "op_send_bytes": 13548370, "op_resend": 0, "op_reply": 3751, "op": 3751, "op_r": 26, "op_w": 3725, "op_rmw": 0, "op_pg": 0, "osdop_stat": 2, "osdop_create": 0, "osdop_read": 8, "osdop_write": 3620, "osdop_writefull": 4, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 1, "osdop_truncate": 1, "osdop_delete": 16, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 14, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 5, "osd_session_open": 5, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 165, "omap_rd": 28, "omap_del": 9 }, "oft": { "omap_total_objs": 0, "omap_total_kv_pairs": 0, "omap_total_updates": 0, "omap_total_removes": 0 }, "purge_queue": { "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executed": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "val": 0, "max": 104857600, "get_started": 0, "get": 11231, "get_sum": 2450273, "get_or_fail_fail": 0, "get_or_fail_success": 11231, "take": 0, "take_sum": 0, "put": 11231, "put_sum": 2450273, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_bytes": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 3751, "take_sum": 13549476, "put": 3722, "put_sum": 13549476, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_ops": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 3751, "take_sum": 3751, "put": 3751, "put_sum": 3751, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle": { "val": 0, "max": 3758096384, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle-0x55eb89907c20": { "val": 2000519, "max": 3758096384, "get_started": 0, "get": 7335, "get_sum": 14762678, "get_or_fail_fail": 0, "get_or_fail_success": 7335, "take": 0, "take_sum": 0, "put": 3620, "put_sum": 12762159, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } 2020-05-18T21:35:28.760 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/574, 0/574 2020-05-18T21:35:29.761 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:35:29.859 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:35:29.862 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:35:29.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.870+0000 7f1ea57d2700 1 Processor -- start 2020-05-18T21:35:29.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.870+0000 7f1ea57d2700 1 -- start start 2020-05-18T21:35:29.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.870+0000 7f1ea57d2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1ea00b59e0 0x7f1ea00ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:29.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.874+0000 7f1ea57d2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1ea00ad0a0 0x7f1ea00ad500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:29.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.874+0000 7f1ea57d2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea005f040 con 0x7f1ea00ad960 2020-05-18T21:35:29.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.874+0000 7f1ea57d2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea0060a20 con 0x7f1ea00ad0a0 2020-05-18T21:35:29.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.874+0000 7f1ea57d2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea005f2e0 con 0x7f1ea00b59e0 2020-05-18T21:35:29.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.874+0000 7f1e9f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1ea00ad0a0 0x7f1ea00ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:29.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.874+0000 7f1e9f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1ea00ad0a0 0x7f1ea00ad500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34068/0 (socket says 172.21.15.63:34068) 2020-05-18T21:35:29.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.874+0000 7f1e9f7fe700 1 -- 172.21.15.63:0/392368588 learned_addr learned my addr 172.21.15.63:0/392368588 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:29.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.874+0000 7f1e9effd700 1 -- 172.21.15.63:0/392368588 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953813173 0 0) 0x7f1ea005f040 con 0x7f1ea00ad960 2020-05-18T21:35:29.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.890+0000 7f1e9effd700 1 -- 172.21.15.63:0/392368588 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e88003250 con 0x7f1ea00ad960 2020-05-18T21:35:29.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.890+0000 7f1e9f7fe700 1 -- 172.21.15.63:0/392368588 >> v2:172.21.15.155:3300/0 conn(0x7f1ea00b59e0 msgr2=0x7f1ea00ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:29.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.874+0000 7f1e9ffff700 1 --2- 172.21.15.63:0/392368588 >> v2:172.21.15.155:3300/0 conn(0x7f1ea00b59e0 0x7f1ea00ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:29.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.890+0000 7f1e9f7fe700 1 --2- 172.21.15.63:0/392368588 >> v2:172.21.15.155:3300/0 conn(0x7f1ea00b59e0 0x7f1ea00ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:29.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.890+0000 7f1e9f7fe700 1 -- 172.21.15.63:0/392368588 >> v1:172.21.15.155:6789/0 conn(0x7f1ea00ad960 legacy=0x7f1ea0061090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:29.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.890+0000 7f1e9f7fe700 1 -- 172.21.15.63:0/392368588 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea00b2f30 con 0x7f1ea00ad0a0 2020-05-18T21:35:29.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.890+0000 7f1e9f7fe700 1 --2- 172.21.15.63:0/392368588 >> v2:172.21.15.63:3300/0 conn(0x7f1ea00ad0a0 0x7f1ea00ad500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1e94002f70 tx=0x7f1e94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:29.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.890+0000 7f1e9f7fe700 1 --2- 172.21.15.63:0/392368588 >> v2:172.21.15.63:3300/0 conn(0x7f1ea00ad0a0 0x7f1ea00ad500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1e94002f70 tx=0x7f1e94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:29.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.890+0000 7f1e9f7fe700 1 --2- 172.21.15.63:0/392368588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea00ad0a0 0x7f1ea00ad500 secure :-1 s=READY pgs=1722 cs=0 l=1 rx=0x7f1e94002f70 tx=0x7f1e94007a80).ready entity=mon.0 client_cookie=7aed1e645f19fce3 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:29.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.890+0000 7f1e9ffff700 1 --2- 172.21.15.63:0/392368588 >> v2:172.21.15.155:3300/0 conn(0x7f1ea00b59e0 0x7f1ea00ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:35:29.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.890+0000 7f1e9f7fe700 1 --2- 172.21.15.63:0/392368588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea00ad0a0 0x7f1ea00ad500 secure :-1 s=THROTTLE_DONE pgs=1722 cs=0 l=1 rx=0x7f1e94002f70 tx=0x7f1e94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:29.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.890+0000 7f1e9f7fe700 1 --2- 172.21.15.63:0/392368588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea00ad0a0 0x7f1ea00ad500 secure :-1 s=THROTTLE_DONE pgs=1722 cs=0 l=1 rx=0x7f1e94002f70 tx=0x7f1e94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:29.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.890+0000 7f1e9effd700 1 -- 172.21.15.63:0/392368588 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e94015ac0 con 0x7f1ea00ad0a0 2020-05-18T21:35:29.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.890+0000 7f1e9f7fe700 1 --2- 172.21.15.63:0/392368588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea00ad0a0 0x7f1ea00ad500 secure :-1 s=THROTTLE_DONE pgs=1722 cs=0 l=1 rx=0x7f1e94002f70 tx=0x7f1e94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:29.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.890+0000 7f1e9effd700 1 -- 172.21.15.63:0/392368588 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e94015c20 con 0x7f1ea00ad0a0 2020-05-18T21:35:29.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.890+0000 7f1e9effd700 1 -- 172.21.15.63:0/392368588 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e9400a180 con 0x7f1ea00ad0a0 2020-05-18T21:35:29.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.890+0000 7f1ea57d2700 1 -- 172.21.15.63:0/392368588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea00ad0a0 msgr2=0x7f1ea00ad500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:29.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.890+0000 7f1ea57d2700 1 --2- 172.21.15.63:0/392368588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea00ad0a0 0x7f1ea00ad500 secure :-1 s=READY pgs=1722 cs=0 l=1 rx=0x7f1e94002f70 tx=0x7f1e94007a80).stop 2020-05-18T21:35:29.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.894+0000 7f1ea57d2700 1 -- 172.21.15.63:0/392368588 shutdown_connections 2020-05-18T21:35:29.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.894+0000 7f1ea57d2700 1 --2- 172.21.15.63:0/392368588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea00ad0a0 0x7f1ea00ad500 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:29.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.894+0000 7f1ea57d2700 1 --2- 172.21.15.63:0/392368588 >> v2:172.21.15.155:3300/0 conn(0x7f1ea00b59e0 0x7f1ea00ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:29.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.894+0000 7f1ea57d2700 1 -- 172.21.15.63:0/392368588 >> 172.21.15.63:0/392368588 conn(0x7f1ea00b8fc0 msgr2=0x7f1ea00b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:29.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.894+0000 7f1ea57d2700 1 -- 172.21.15.63:0/392368588 shutdown_connections 2020-05-18T21:35:29.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.894+0000 7f1ea57d2700 1 -- 172.21.15.63:0/392368588 wait complete. 2020-05-18T21:35:29.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.894+0000 7f1ea57d2700 1 Processor -- start 2020-05-18T21:35:29.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.894+0000 7f1ea57d2700 1 -- start start 2020-05-18T21:35:29.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.898+0000 7f1ea57d2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1ea00ad0a0 0x7f1ea006f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:29.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.898+0000 7f1ea57d2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1ea00ad960 0x7f1ea007f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:29.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.898+0000 7f1ea57d2700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea0062f50 con 0x7f1ea00b59e0 2020-05-18T21:35:29.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.898+0000 7f1ea57d2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea007f920 con 0x7f1ea00ad960 2020-05-18T21:35:29.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.898+0000 7f1ea57d2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea0155e50 con 0x7f1ea00ad0a0 2020-05-18T21:35:29.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.898+0000 7f1ea4fd1700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1ea00b59e0 0x7f1ea0062840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36262/0 (socket says 172.21.15.63:36262) 2020-05-18T21:35:29.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.898+0000 7f1ea4fd1700 1 -- 172.21.15.63:0/3863101953 learned_addr learned my addr 172.21.15.63:0/3863101953 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:29.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.898+0000 7f1e9f7fe700 1 --2- 172.21.15.63:0/3863101953 >> v2:172.21.15.63:3300/0 conn(0x7f1ea00ad960 0x7f1ea007f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:29.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.898+0000 7f1e9ffff700 1 --2- 172.21.15.63:0/3863101953 >> v2:172.21.15.155:3300/0 conn(0x7f1ea00ad0a0 0x7f1ea006f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:29.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.898+0000 7f1e9d7fa700 1 -- 172.21.15.63:0/3863101953 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898755995 0 0) 0x7f1ea0062f50 con 0x7f1ea00b59e0 2020-05-18T21:35:29.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.898+0000 7f1e9d7fa700 1 -- 172.21.15.63:0/3863101953 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e80002fe0 con 0x7f1ea00b59e0 2020-05-18T21:35:29.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.898+0000 7f1e9f7fe700 1 -- 172.21.15.63:0/3863101953 >> v2:172.21.15.155:3300/0 conn(0x7f1ea00ad0a0 msgr2=0x7f1ea006f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:29.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.898+0000 7f1e9f7fe700 1 --2- 172.21.15.63:0/3863101953 >> v2:172.21.15.155:3300/0 conn(0x7f1ea00ad0a0 0x7f1ea006f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:29.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.898+0000 7f1e9f7fe700 1 -- 172.21.15.63:0/3863101953 >> v1:172.21.15.63:6789/0 conn(0x7f1ea00b59e0 legacy=0x7f1ea0062840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:29.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.898+0000 7f1e9d7fa700 1 -- 172.21.15.63:0/3863101953 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3820500018 0 0) 0x7f1e80002fe0 con 0x7f1ea00b59e0 2020-05-18T21:35:29.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.898+0000 7f1e9f7fe700 1 -- 172.21.15.63:0/3863101953 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea01560f0 con 0x7f1ea00ad960 2020-05-18T21:35:29.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.898+0000 7f1e9f7fe700 1 --2- 172.21.15.63:0/3863101953 >> v2:172.21.15.63:3300/0 conn(0x7f1ea00ad960 0x7f1ea007f4c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1e98001ea0 tx=0x7f1e94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:29.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1e9f7fe700 1 --2- 172.21.15.63:0/3863101953 >> v2:172.21.15.63:3300/0 conn(0x7f1ea00ad960 0x7f1ea007f4c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1e98001ea0 tx=0x7f1e94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:29.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1e9f7fe700 1 --2- 172.21.15.63:0/3863101953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea00ad960 0x7f1ea007f4c0 secure :-1 s=READY pgs=1724 cs=0 l=1 rx=0x7f1e98001ea0 tx=0x7f1e94007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:29.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1e9f7fe700 1 --2- 172.21.15.63:0/3863101953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea00ad960 0x7f1ea007f4c0 secure :-1 s=THROTTLE_DONE pgs=1724 cs=0 l=1 rx=0x7f1e98001ea0 tx=0x7f1e94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:29.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1e9d7fa700 1 -- 172.21.15.63:0/3863101953 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e98001d00 con 0x7f1ea00ad960 2020-05-18T21:35:29.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1e9f7fe700 1 --2- 172.21.15.63:0/3863101953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea00ad960 0x7f1ea007f4c0 secure :-1 s=THROTTLE_DONE pgs=1724 cs=0 l=1 rx=0x7f1e98001ea0 tx=0x7f1e94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:29.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1e9f7fe700 1 --2- 172.21.15.63:0/3863101953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea00ad960 0x7f1ea007f4c0 secure :-1 s=THROTTLE_DONE pgs=1724 cs=0 l=1 rx=0x7f1e98001ea0 tx=0x7f1e94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:29.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1e9d7fa700 1 -- 172.21.15.63:0/3863101953 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e94014660 con 0x7f1ea00ad960 2020-05-18T21:35:29.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1e9d7fa700 1 -- 172.21.15.63:0/3863101953 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e9400abe0 con 0x7f1ea00ad960 2020-05-18T21:35:29.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1ea57d2700 1 -- 172.21.15.63:0/3863101953 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea0156390 con 0x7f1ea00ad960 2020-05-18T21:35:29.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1ea57d2700 1 -- 172.21.15.63:0/3863101953 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea0155a20 con 0x7f1ea00ad960 2020-05-18T21:35:29.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1e9f7fe700 1 --2- 172.21.15.63:0/3863101953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea00ad960 0x7f1ea007f4c0 secure :-1 s=THROTTLE_DONE pgs=1724 cs=0 l=1 rx=0x7f1e98001ea0 tx=0x7f1e94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:29.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1e9d7fa700 1 -- 172.21.15.63:0/3863101953 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1e94007170 con 0x7f1ea00ad960 2020-05-18T21:35:29.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1e9f7fe700 1 --2- 172.21.15.63:0/3863101953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea00ad960 0x7f1ea007f4c0 secure :-1 s=THROTTLE_DONE pgs=1724 cs=0 l=1 rx=0x7f1e98001ea0 tx=0x7f1e94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:29.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1e9d7fa700 1 --2- 172.21.15.63:0/3863101953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1e8004fd80 0x7f1e80052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:29.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1ea57d2700 1 -- 172.21.15.63:0/3863101953 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea00569e0 con 0x7f1ea00ad960 2020-05-18T21:35:29.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1e9d7fa700 1 -- 172.21.15.63:0/3863101953 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1e9406c7c0 con 0x7f1ea00ad960 2020-05-18T21:35:29.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1e9ffff700 1 --2- 172.21.15.63:0/3863101953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1e8004fd80 0x7f1e80052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:29.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1e9ffff700 1 --2- 172.21.15.63:0/3863101953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1e8004fd80 0x7f1e80052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1e90002f70 tx=0x7f1e9000e1d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:29.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1e9ffff700 1 --2- 172.21.15.63:0/3863101953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1e8004fd80 0x7f1e80052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1e90002f70 tx=0x7f1e9000e1d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:29.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.902+0000 7f1e9ffff700 1 --2- 172.21.15.63:0/3863101953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1e8004fd80 0x7f1e80052240 secure :-1 s=READY pgs=667 cs=0 l=1 rx=0x7f1e90002f70 tx=0x7f1e9000e1d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:29.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.906+0000 7f1e9f7fe700 1 --2- 172.21.15.63:0/3863101953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea00ad960 0x7f1ea007f4c0 secure :-1 s=THROTTLE_DONE pgs=1724 cs=0 l=1 rx=0x7f1e98001ea0 tx=0x7f1e94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:29.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:29.906+0000 7f1e9d7fa700 1 -- 172.21.15.63:0/3863101953 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f1e94046af0 con 0x7f1ea00ad960 2020-05-18T21:35:30.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:30.102+0000 7f1ea57d2700 1 -- 172.21.15.63:0/3863101953 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ea00806f0 con 0x7f1ea00ad960 2020-05-18T21:35:30.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:30.102+0000 7f1e9f7fe700 1 --2- 172.21.15.63:0/3863101953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea00ad960 0x7f1ea007f4c0 secure :-1 s=THROTTLE_DONE pgs=1724 cs=0 l=1 rx=0x7f1e98001ea0 tx=0x7f1e94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:30.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:30.102+0000 7f1e9d7fa700 1 -- 172.21.15.63:0/3863101953 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f1e9404a110 con 0x7f1ea00ad960 2020-05-18T21:35:30.108 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:30.108 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":98,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/3483934102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3483934102},{"type":"v1","addr":"172.21.15.155:6835","nonce":3483934102}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":98}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:34:27.767123+0000","modified":"2020-05-18T21:34:41.281280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"a","rank":0,"incarnation":94,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6833/1314928434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1314928434},{"type":"v1","addr":"172.21.15.63:6833","nonce":1314928434}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-05-18T21:35:30.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:30.106+0000 7f1ea57d2700 1 -- 172.21.15.63:0/3863101953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1e8004fd80 msgr2=0x7f1e80052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:30.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:30.106+0000 7f1ea57d2700 1 --2- 172.21.15.63:0/3863101953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1e8004fd80 0x7f1e80052240 secure :-1 s=READY pgs=667 cs=0 l=1 rx=0x7f1e90002f70 tx=0x7f1e9000e1d0).stop 2020-05-18T21:35:30.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:30.106+0000 7f1ea57d2700 1 -- 172.21.15.63:0/3863101953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea00ad960 msgr2=0x7f1ea007f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:30.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:30.106+0000 7f1ea57d2700 1 --2- 172.21.15.63:0/3863101953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea00ad960 0x7f1ea007f4c0 secure :-1 s=READY pgs=1724 cs=0 l=1 rx=0x7f1e98001ea0 tx=0x7f1e94007a80).stop 2020-05-18T21:35:30.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:30.106+0000 7f1ea57d2700 1 -- 172.21.15.63:0/3863101953 shutdown_connections 2020-05-18T21:35:30.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:30.106+0000 7f1ea57d2700 1 --2- 172.21.15.63:0/3863101953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1e8004fd80 0x7f1e80052240 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:30.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:30.106+0000 7f1ea57d2700 1 --2- 172.21.15.63:0/3863101953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea00ad960 0x7f1ea007f4c0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:30.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:30.106+0000 7f1ea57d2700 1 --2- 172.21.15.63:0/3863101953 >> v2:172.21.15.155:3300/0 conn(0x7f1ea00ad0a0 0x7f1ea006f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:30.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:30.106+0000 7f1ea57d2700 1 -- 172.21.15.63:0/3863101953 >> 172.21.15.63:0/3863101953 conn(0x7f1ea00b8fc0 msgr2=0x7f1ea00ae410 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:30.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:30.106+0000 7f1ea57d2700 1 -- 172.21.15.63:0/3863101953 shutdown_connections 2020-05-18T21:35:30.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:30.106+0000 7f1ea57d2700 1 -- 172.21.15.63:0/3863101953 wait complete. 2020-05-18T21:35:30.112 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 98 2020-05-18T21:35:30.122 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2020-05-18T21:35:30.227 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:35:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-0": { 2020-05-18T21:35:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 40, 2020-05-18T21:35:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 35, 2020-05-18T21:35:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 80297, 2020-05-18T21:35:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 66992, 2020-05-18T21:35:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 5, 2020-05-18T21:35:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 0, 2020-05-18T21:35:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.012051737, 2020-05-18T21:35:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.002081454, 2020-05-18T21:35:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.011691825, 2020-05-18T21:35:30.230 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000861883, 2020-05-18T21:35:30.230 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:30.230 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 35, 2020-05-18T21:35:30.230 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.006328181, 2020-05-18T21:35:30.230 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000180805 2020-05-18T21:35:30.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.231 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:30.231 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.231 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.231 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-1": { 2020-05-18T21:35:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 1348, 2020-05-18T21:35:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 1360, 2020-05-18T21:35:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 317375, 2020-05-18T21:35:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 5178507, 2020-05-18T21:35:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 5, 2020-05-18T21:35:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 2, 2020-05-18T21:35:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.176517805, 2020-05-18T21:35:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.067063226, 2020-05-18T21:35:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.041030696, 2020-05-18T21:35:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.056508800, 2020-05-18T21:35:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1360, 2020-05-18T21:35:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.056415349, 2020-05-18T21:35:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000041481 2020-05-18T21:35:30.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.235 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:30.235 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.236 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.236 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.236 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-2": { 2020-05-18T21:35:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 10364, 2020-05-18T21:35:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 17035, 2020-05-18T21:35:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 3048149, 2020-05-18T21:35:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 15842584, 2020-05-18T21:35:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 5, 2020-05-18T21:35:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 2, 2020-05-18T21:35:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 1.606264369, 2020-05-18T21:35:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.759835908, 2020-05-18T21:35:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.886523042, 2020-05-18T21:35:30.239 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.103880924, 2020-05-18T21:35:30.239 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:30.239 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 17034, 2020-05-18T21:35:30.239 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.733316340, 2020-05-18T21:35:30.239 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000043050 2020-05-18T21:35:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 21670, 2020-05-18T21:35:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.007684893, 2020-05-18T21:35:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000354 2020-05-18T21:35:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:30.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.241 INFO:teuthology.orchestra.run.smithi063.stdout: "cct": { 2020-05-18T21:35:30.241 INFO:teuthology.orchestra.run.smithi063.stdout: "total_workers": 1, 2020-05-18T21:35:30.241 INFO:teuthology.orchestra.run.smithi063.stdout: "unhealthy_workers": 0 2020-05-18T21:35:30.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.242 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-MDSRank": { 2020-05-18T21:35:30.242 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2020-05-18T21:35:30.242 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2020-05-18T21:35:30.242 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 6428, 2020-05-18T21:35:30.242 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 3.072920168, 2020-05-18T21:35:30.243 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000478052 2020-05-18T21:35:30.243 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:30.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.244 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-PurgeQueue": { 2020-05-18T21:35:30.244 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2020-05-18T21:35:30.244 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2020-05-18T21:35:30.244 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 4, 2020-05-18T21:35:30.245 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000135958, 2020-05-18T21:35:30.245 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000033989 2020-05-18T21:35:30.245 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:30.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.246 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2020-05-18T21:35:30.246 INFO:teuthology.orchestra.run.smithi063.stdout: "request": 2710, 2020-05-18T21:35:30.246 INFO:teuthology.orchestra.run.smithi063.stdout: "reply": 2707, 2020-05-18T21:35:30.246 INFO:teuthology.orchestra.run.smithi063.stdout: "reply_latency": { 2020-05-18T21:35:30.246 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 2707, 2020-05-18T21:35:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 4.134016602, 2020-05-18T21:35:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001527157 2020-05-18T21:35:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: "forward": 0, 2020-05-18T21:35:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_fetch": 12, 2020-05-18T21:35:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_commit": 73, 2020-05-18T21:35:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_split": 9, 2020-05-18T21:35:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_merge": 0, 2020-05-18T21:35:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes": 1611, 2020-05-18T21:35:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_top": 0, 2020-05-18T21:35:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_bottom": 1611, 2020-05-18T21:35:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pin_tail": 0, 2020-05-18T21:35:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pinned": 1611, 2020-05-18T21:35:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_expired": 0, 2020-05-18T21:35:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_with_caps": 1602, 2020-05-18T21:35:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": 1602, 2020-05-18T21:35:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "subtrees": 2, 2020-05-18T21:35:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse": 2711, 2020-05-18T21:35:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_hit": 2709, 2020-05-18T21:35:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_forward": 0, 2020-05-18T21:35:30.251 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_discover": 0, 2020-05-18T21:35:30.251 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_dir_fetch": 0, 2020-05-18T21:35:30.251 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_remote_ino": 0, 2020-05-18T21:35:30.251 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_lock": 0, 2020-05-18T21:35:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: "load_cent": 223899, 2020-05-18T21:35:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: "q": 0, 2020-05-18T21:35:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: "exported": 0, 2020-05-18T21:35:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: "exported_inodes": 0, 2020-05-18T21:35:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: "imported": 0, 2020-05-18T21:35:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: "imported_inodes": 0, 2020-05-18T21:35:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_dir_fetch": 0, 2020-05-18T21:35:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_backtrace_fetch": 0, 2020-05-18T21:35:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_peer_discover": 0, 2020-05-18T21:35:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rfiles": 1432, 2020-05-18T21:35:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rbytes": 10896408576, 2020-05-18T21:35:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rsnaps": 0 2020-05-18T21:35:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:35:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays": 1034, 2020-05-18T21:35:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_delayed": 0, 2020-05-18T21:35:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:35:30.255 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_created": 1034, 2020-05-18T21:35:30.255 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 0, 2020-05-18T21:35:30.255 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_reintegrated": 0, 2020-05-18T21:35:30.258 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_migrated": 0, 2020-05-18T21:35:30.258 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_processing": 0, 2020-05-18T21:35:30.258 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:35:30.258 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:35:30.258 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_started": 0, 2020-05-18T21:35:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_completed": 0, 2020-05-18T21:35:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:35:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_exportdir": 0, 2020-05-18T21:35:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_flush": 0, 2020-05-18T21:35:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragmentdir": 9, 2020-05-18T21:35:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragstats": 0, 2020-05-18T21:35:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_inodestats": 0 2020-05-18T21:35:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log": { 2020-05-18T21:35:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: "evadd": 7854, 2020-05-18T21:35:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: "evex": 0, 2020-05-18T21:35:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: "evtrm": 0, 2020-05-18T21:35:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: "ev": 7856, 2020-05-18T21:35:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: "evexg": 0, 2020-05-18T21:35:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: "evexd": 0, 2020-05-18T21:35:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: "segadd": 10, 2020-05-18T21:35:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: "segex": 0, 2020-05-18T21:35:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: "segtrm": 0, 2020-05-18T21:35:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: "seg": 11, 2020-05-18T21:35:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: "segexg": 0, 2020-05-18T21:35:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: "segexd": 0, 2020-05-18T21:35:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: "expos": 4194304, 2020-05-18T21:35:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: "wrpos": 20503455, 2020-05-18T21:35:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: "rdpos": 4195196, 2020-05-18T21:35:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: "jlat": { 2020-05-18T21:35:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 3620, 2020-05-18T21:35:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 19.428560976, 2020-05-18T21:35:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.005367005 2020-05-18T21:35:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: "replayed": 2 2020-05-18T21:35:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_mem": { 2020-05-18T21:35:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1614, 2020-05-18T21:35:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: "ino+": 1614, 2020-05-18T21:35:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: "ino-": 0, 2020-05-18T21:35:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: "dir": 76, 2020-05-18T21:35:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: "dir+": 85, 2020-05-18T21:35:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: "dir-": 9, 2020-05-18T21:35:30.266 INFO:teuthology.orchestra.run.smithi063.stdout: "dn": 2645, 2020-05-18T21:35:30.266 INFO:teuthology.orchestra.run.smithi063.stdout: "dn+": 2645, 2020-05-18T21:35:30.266 INFO:teuthology.orchestra.run.smithi063.stdout: "dn-": 0, 2020-05-18T21:35:30.266 INFO:teuthology.orchestra.run.smithi063.stdout: "cap": 1602, 2020-05-18T21:35:30.266 INFO:teuthology.orchestra.run.smithi063.stdout: "cap+": 1602, 2020-05-18T21:35:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: "cap-": 0, 2020-05-18T21:35:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: "rss": 74624, 2020-05-18T21:35:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: "heap": 331932 2020-05-18T21:35:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_server": { 2020-05-18T21:35:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_client_request": 2781, 2020-05-18T21:35:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_server_request": 0, 2020-05-18T21:35:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_request": 2710, 2020-05-18T21:35:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_session": 3, 2020-05-18T21:35:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_slave_request": 0, 2020-05-18T21:35:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: "req_create_latency": { 2020-05-18T21:35:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1600, 2020-05-18T21:35:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 2.331516366, 2020-05-18T21:35:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001457197 2020-05-18T21:35:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getattr_latency": { 2020-05-18T21:35:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 2, 2020-05-18T21:35:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000941751, 2020-05-18T21:35:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000470875 2020-05-18T21:35:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getfilelock_latency": { 2020-05-18T21:35:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: "req_link_latency": { 2020-05-18T21:35:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookup_latency": { 2020-05-18T21:35:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.001560520, 2020-05-18T21:35:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001560520 2020-05-18T21:35:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookuphash_latency": { 2020-05-18T21:35:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupino_latency": { 2020-05-18T21:35:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupname_latency": { 2020-05-18T21:35:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupparent_latency": { 2020-05-18T21:35:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupsnap_latency": { 2020-05-18T21:35:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.278 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lssnap_latency": { 2020-05-18T21:35:30.278 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.278 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.278 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mkdir_latency": { 2020-05-18T21:35:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.004721025, 2020-05-18T21:35:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.004721025 2020-05-18T21:35:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mknod_latency": { 2020-05-18T21:35:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mksnap_latency": { 2020-05-18T21:35:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: "req_open_latency": { 2020-05-18T21:35:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.283 INFO:teuthology.orchestra.run.smithi063.stdout: "req_readdir_latency": { 2020-05-18T21:35:30.283 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 70, 2020-05-18T21:35:30.283 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.134635846, 2020-05-18T21:35:30.283 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001923369 2020-05-18T21:35:30.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rename_latency": { 2020-05-18T21:35:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: "req_renamesnap_latency": { 2020-05-18T21:35:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmdir_latency": { 2020-05-18T21:35:30.286 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.286 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.286 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.286 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmsnap_latency": { 2020-05-18T21:35:30.287 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.287 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.287 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.287 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmxattr_latency": { 2020-05-18T21:35:30.287 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setattr_latency": { 2020-05-18T21:35:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setdirlayout_latency": { 2020-05-18T21:35:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.290 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.290 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setfilelock_latency": { 2020-05-18T21:35:30.290 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.290 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.291 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.291 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setlayout_latency": { 2020-05-18T21:35:30.291 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.291 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.291 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.292 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setxattr_latency": { 2020-05-18T21:35:30.292 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.292 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.292 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.293 INFO:teuthology.orchestra.run.smithi063.stdout: "req_symlink_latency": { 2020-05-18T21:35:30.293 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.293 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.294 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.294 INFO:teuthology.orchestra.run.smithi063.stdout: "req_unlink_latency": { 2020-05-18T21:35:30.294 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1034, 2020-05-18T21:35:30.294 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 1.661628598, 2020-05-18T21:35:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001606990 2020-05-18T21:35:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: "cap_revoke_eviction": 0 2020-05-18T21:35:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_sessions": { 2020-05-18T21:35:30.296 INFO:teuthology.orchestra.run.smithi063.stdout: "session_count": 1, 2020-05-18T21:35:30.296 INFO:teuthology.orchestra.run.smithi063.stdout: "session_add": 1, 2020-05-18T21:35:30.296 INFO:teuthology.orchestra.run.smithi063.stdout: "session_remove": 0, 2020-05-18T21:35:30.296 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_open": 1, 2020-05-18T21:35:30.296 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_stale": 0, 2020-05-18T21:35:30.297 INFO:teuthology.orchestra.run.smithi063.stdout: "total_load": 2278, 2020-05-18T21:35:30.297 INFO:teuthology.orchestra.run.smithi063.stdout: "average_load": 2278, 2020-05-18T21:35:30.297 INFO:teuthology.orchestra.run.smithi063.stdout: "avg_session_uptime": 898 2020-05-18T21:35:30.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.297 INFO:teuthology.orchestra.run.smithi063.stdout: "mempool": { 2020-05-18T21:35:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_bytes": 0, 2020-05-18T21:35:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_items": 0, 2020-05-18T21:35:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_bytes": 0, 2020-05-18T21:35:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_items": 0, 2020-05-18T21:35:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_bytes": 0, 2020-05-18T21:35:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_items": 0, 2020-05-18T21:35:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_bytes": 0, 2020-05-18T21:35:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_items": 0, 2020-05-18T21:35:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_bytes": 0, 2020-05-18T21:35:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_items": 0, 2020-05-18T21:35:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_bytes": 0, 2020-05-18T21:35:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_items": 0, 2020-05-18T21:35:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_bytes": 0, 2020-05-18T21:35:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_items": 0, 2020-05-18T21:35:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_bytes": 0, 2020-05-18T21:35:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_items": 0, 2020-05-18T21:35:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_bytes": 0, 2020-05-18T21:35:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_items": 0, 2020-05-18T21:35:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_bytes": 0, 2020-05-18T21:35:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_items": 0, 2020-05-18T21:35:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_bytes": 116939, 2020-05-18T21:35:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_items": 77, 2020-05-18T21:35:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_bytes": 0, 2020-05-18T21:35:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_items": 0, 2020-05-18T21:35:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bytes": 0, 2020-05-18T21:35:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_items": 0, 2020-05-18T21:35:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_bytes": 0, 2020-05-18T21:35:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_items": 0, 2020-05-18T21:35:30.303 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_bytes": 0, 2020-05-18T21:35:30.303 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_items": 0, 2020-05-18T21:35:30.303 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_bytes": 6128, 2020-05-18T21:35:30.303 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_items": 93, 2020-05-18T21:35:30.303 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_bytes": 0, 2020-05-18T21:35:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_items": 0, 2020-05-18T21:35:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_bytes": 0, 2020-05-18T21:35:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_items": 0, 2020-05-18T21:35:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_bytes": 4821216, 2020-05-18T21:35:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_items": 31052, 2020-05-18T21:35:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_bytes": 0, 2020-05-18T21:35:30.305 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_items": 0, 2020-05-18T21:35:30.305 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_bytes": 0, 2020-05-18T21:35:30.305 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_items": 0 2020-05-18T21:35:30.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.305 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter": { 2020-05-18T21:35:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: "op_active": 0, 2020-05-18T21:35:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: "op_laggy": 0, 2020-05-18T21:35:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send": 3751, 2020-05-18T21:35:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send_bytes": 13548370, 2020-05-18T21:35:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: "op_resend": 0, 2020-05-18T21:35:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: "op_reply": 3751, 2020-05-18T21:35:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: "op": 3751, 2020-05-18T21:35:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: "op_r": 26, 2020-05-18T21:35:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: "op_w": 3725, 2020-05-18T21:35:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: "op_rmw": 0, 2020-05-18T21:35:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: "op_pg": 0, 2020-05-18T21:35:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_stat": 2, 2020-05-18T21:35:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_create": 0, 2020-05-18T21:35:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_read": 8, 2020-05-18T21:35:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_write": 3620, 2020-05-18T21:35:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writefull": 4, 2020-05-18T21:35:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writesame": 0, 2020-05-18T21:35:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_append": 0, 2020-05-18T21:35:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_zero": 1, 2020-05-18T21:35:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_truncate": 1, 2020-05-18T21:35:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_delete": 16, 2020-05-18T21:35:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_mapext": 0, 2020-05-18T21:35:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_sparse_read": 0, 2020-05-18T21:35:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_clonerange": 0, 2020-05-18T21:35:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_getxattr": 14, 2020-05-18T21:35:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_setxattr": 0, 2020-05-18T21:35:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_cmpxattr": 0, 2020-05-18T21:35:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_rmxattr": 0, 2020-05-18T21:35:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_resetxattrs": 0, 2020-05-18T21:35:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_call": 0, 2020-05-18T21:35:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_watch": 0, 2020-05-18T21:35:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_notify": 0, 2020-05-18T21:35:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_src_cmpxattr": 0, 2020-05-18T21:35:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls": 0, 2020-05-18T21:35:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls_filter": 0, 2020-05-18T21:35:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_other": 0, 2020-05-18T21:35:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_active": 0, 2020-05-18T21:35:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_send": 0, 2020-05-18T21:35:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_resend": 0, 2020-05-18T21:35:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_ping": 0, 2020-05-18T21:35:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_active": 0, 2020-05-18T21:35:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_send": 0, 2020-05-18T21:35:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_resend": 0, 2020-05-18T21:35:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_active": 0, 2020-05-18T21:35:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_send": 0, 2020-05-18T21:35:30.314 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_resend": 0, 2020-05-18T21:35:30.314 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_active": 0, 2020-05-18T21:35:30.314 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_send": 0, 2020-05-18T21:35:30.314 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_resend": 0, 2020-05-18T21:35:30.314 INFO:teuthology.orchestra.run.smithi063.stdout: "command_active": 0, 2020-05-18T21:35:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: "command_send": 0, 2020-05-18T21:35:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: "command_resend": 0, 2020-05-18T21:35:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: "map_epoch": 0, 2020-05-18T21:35:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: "map_full": 0, 2020-05-18T21:35:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: "map_inc": 0, 2020-05-18T21:35:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_sessions": 5, 2020-05-18T21:35:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_open": 5, 2020-05-18T21:35:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_close": 0, 2020-05-18T21:35:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_laggy": 0, 2020-05-18T21:35:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_wr": 165, 2020-05-18T21:35:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_rd": 28, 2020-05-18T21:35:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_del": 9 2020-05-18T21:35:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: "oft": { 2020-05-18T21:35:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_objs": 0, 2020-05-18T21:35:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_kv_pairs": 0, 2020-05-18T21:35:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_updates": 0, 2020-05-18T21:35:30.318 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_removes": 0 2020-05-18T21:35:30.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.318 INFO:teuthology.orchestra.run.smithi063.stdout: "purge_queue": { 2020-05-18T21:35:30.318 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops": 0, 2020-05-18T21:35:30.318 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops_high_water": 0, 2020-05-18T21:35:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing": 0, 2020-05-18T21:35:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_high_water": 0, 2020-05-18T21:35:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executed": 0, 2020-05-18T21:35:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_item_in_journal": 0 2020-05-18T21:35:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-05-18T21:35:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2020-05-18T21:35:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 11749, 2020-05-18T21:35:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 2575403, 2020-05-18T21:35:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 11749, 2020-05-18T21:35:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 11749, 2020-05-18T21:35:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 2575403, 2020-05-18T21:35:30.322 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:30.322 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.322 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.322 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.322 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_bytes": { 2020-05-18T21:35:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2020-05-18T21:35:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2020-05-18T21:35:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2020-05-18T21:35:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2020-05-18T21:35:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 3751, 2020-05-18T21:35:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 13549476, 2020-05-18T21:35:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 3722, 2020-05-18T21:35:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 13549476, 2020-05-18T21:35:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.326 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:30.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.326 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_ops": { 2020-05-18T21:35:30.326 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:30.326 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 1024, 2020-05-18T21:35:30.327 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:30.327 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2020-05-18T21:35:30.327 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2020-05-18T21:35:30.327 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:30.327 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2020-05-18T21:35:30.327 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 3751, 2020-05-18T21:35:30.328 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 3751, 2020-05-18T21:35:30.328 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 3751, 2020-05-18T21:35:30.328 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 3751, 2020-05-18T21:35:30.328 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:30.328 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.329 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.329 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.329 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:30.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.329 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle": { 2020-05-18T21:35:30.329 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:30.330 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2020-05-18T21:35:30.330 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:30.330 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2020-05-18T21:35:30.330 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2020-05-18T21:35:30.330 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:30.331 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2020-05-18T21:35:30.331 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:30.331 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:30.331 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 0, 2020-05-18T21:35:30.331 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 0, 2020-05-18T21:35:30.331 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:30.332 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.332 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.332 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.332 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:30.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:30.332 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle-0x55eb89907c20": { 2020-05-18T21:35:30.333 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 3545662, 2020-05-18T21:35:30.333 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2020-05-18T21:35:30.333 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:30.333 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 7854, 2020-05-18T21:35:30.333 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 16307821, 2020-05-18T21:35:30.334 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:30.334 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 7854, 2020-05-18T21:35:30.334 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:30.334 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:30.334 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 3620, 2020-05-18T21:35:30.334 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 12762159, 2020-05-18T21:35:30.335 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:30.335 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:30.335 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:30.335 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:30.335 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:30.336 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:30.336 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:35:30.337 INFO:tasks.cephfs.filesystem:_json_asok output: { "AsyncMessenger::Worker-0": { "msgr_recv_messages": 40, "msgr_send_messages": 35, "msgr_recv_bytes": 80297, "msgr_send_bytes": 66992, "msgr_created_connections": 5, "msgr_active_connections": 0, "msgr_running_total_time": 0.012051737, "msgr_running_send_time": 0.002081454, "msgr_running_recv_time": 0.011691825, "msgr_running_fast_dispatch_time": 0.000861883, "msgr_send_messages_queue_lat": { "avgcount": 35, "sum": 0.006328181, "avgtime": 0.000180805 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-1": { "msgr_recv_messages": 1348, "msgr_send_messages": 1360, "msgr_recv_bytes": 317375, "msgr_send_bytes": 5178507, "msgr_created_connections": 5, "msgr_active_connections": 2, "msgr_running_total_time": 0.176517805, "msgr_running_send_time": 0.067063226, "msgr_running_recv_time": 0.041030696, "msgr_running_fast_dispatch_time": 0.056508800, "msgr_send_messages_queue_lat": { "avgcount": 1360, "sum": 0.056415349, "avgtime": 0.000041481 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-2": { "msgr_recv_messages": 10364, "msgr_send_messages": 17035, "msgr_recv_bytes": 3048149, "msgr_send_bytes": 15842584, "msgr_created_connections": 5, "msgr_active_connections": 2, "msgr_running_total_time": 1.606264369, "msgr_running_send_time": 0.759835908, "msgr_running_recv_time": 0.886523042, "msgr_running_fast_dispatch_time": 0.103880924, "msgr_send_messages_queue_lat": { "avgcount": 17034, "sum": 0.733316340, "avgtime": 0.000043050 }, "msgr_handle_ack_lat": { "avgcount": 21670, "sum": 0.007684893, "avgtime": 0.000000354 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "queue_len": 0, "complete_latency": { "avgcount": 6428, "sum": 3.072920168, "avgtime": 0.000478052 } }, "finisher-PurgeQueue": { "queue_len": 0, "complete_latency": { "avgcount": 4, "sum": 0.000135958, "avgtime": 0.000033989 } }, "mds": { "request": 2710, "reply": 2707, "reply_latency": { "avgcount": 2707, "sum": 4.134016602, "avgtime": 0.001527157 }, "forward": 0, "dir_fetch": 12, "dir_commit": 73, "dir_split": 9, "dir_merge": 0, "inodes": 1611, "inodes_top": 0, "inodes_bottom": 1611, "inodes_pin_tail": 0, "inodes_pinned": 1611, "inodes_expired": 0, "inodes_with_caps": 1602, "caps": 1602, "subtrees": 2, "traverse": 2711, "traverse_hit": 2709, "traverse_forward": 0, "traverse_discover": 0, "traverse_dir_fetch": 0, "traverse_remote_ino": 0, "traverse_lock": 0, "load_cent": 223899, "q": 0, "exported": 0, "exported_inodes": 0, "imported": 0, "imported_inodes": 0, "openino_dir_fetch": 0, "openino_backtrace_fetch": 0, "openino_peer_discover": 0, "root_rfiles": 1432, "root_rbytes": 10896408576, "root_rsnaps": 0 }, "mds_cache": { "num_strays": 1034, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "strays_created": 1034, "strays_enqueued": 0, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 9, "ireq_fragstats": 0, "ireq_inodestats": 0 }, "mds_log": { "evadd": 7854, "evex": 0, "evtrm": 0, "ev": 7856, "evexg": 0, "evexd": 0, "segadd": 10, "segex": 0, "segtrm": 0, "seg": 11, "segexg": 0, "segexd": 0, "expos": 4194304, "wrpos": 20503455, "rdpos": 4195196, "jlat": { "avgcount": 3620, "sum": 19.428560976, "avgtime": 0.005367005 }, "replayed": 2 }, "mds_mem": { "ino": 1614, "ino+": 1614, "ino-": 0, "dir": 76, "dir+": 85, "dir-": 9, "dn": 2645, "dn+": 2645, "dn-": 0, "cap": 1602, "cap+": 1602, "cap-": 0, "rss": 74624, "heap": 331932 }, "mds_server": { "dispatch_client_request": 2781, "dispatch_server_request": 0, "handle_client_request": 2710, "handle_client_session": 3, "handle_slave_request": 0, "req_create_latency": { "avgcount": 1600, "sum": 2.331516366, "avgtime": 0.001457197 }, "req_getattr_latency": { "avgcount": 2, "sum": 0.000941751, "avgtime": 0.000470875 }, "req_getfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_link_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookup_latency": { "avgcount": 1, "sum": 0.001560520, "avgtime": 0.001560520 }, "req_lookuphash_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupino_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupname_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupparent_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lssnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mkdir_latency": { "avgcount": 1, "sum": 0.004721025, "avgtime": 0.004721025 }, "req_mknod_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mksnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_open_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_readdir_latency": { "avgcount": 70, "sum": 0.134635846, "avgtime": 0.001923369 }, "req_rename_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_renamesnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmdir_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setdirlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_symlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_unlink_latency": { "avgcount": 1034, "sum": 1.661628598, "avgtime": 0.001606990 }, "cap_revoke_eviction": 0 }, "mds_sessions": { "session_count": 1, "session_add": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 2278, "average_load": 2278, "avg_session_uptime": 898 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "buffer_anon_bytes": 116939, "buffer_anon_items": 77, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6128, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 4821216, "mds_co_items": 31052, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "op_active": 0, "op_laggy": 0, "op_send": 3751, "op_send_bytes": 13548370, "op_resend": 0, "op_reply": 3751, "op": 3751, "op_r": 26, "op_w": 3725, "op_rmw": 0, "op_pg": 0, "osdop_stat": 2, "osdop_create": 0, "osdop_read": 8, "osdop_write": 3620, "osdop_writefull": 4, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 1, "osdop_truncate": 1, "osdop_delete": 16, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 14, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 5, "osd_session_open": 5, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 165, "omap_rd": 28, "omap_del": 9 }, "oft": { "omap_total_objs": 0, "omap_total_kv_pairs": 0, "omap_total_updates": 0, "omap_total_removes": 0 }, "purge_queue": { "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executed": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "val": 0, "max": 104857600, "get_started": 0, "get": 11749, "get_sum": 2575403, "get_or_fail_fail": 0, "get_or_fail_success": 11749, "take": 0, "take_sum": 0, "put": 11749, "put_sum": 2575403, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_bytes": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 3751, "take_sum": 13549476, "put": 3722, "put_sum": 13549476, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_ops": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 3751, "take_sum": 3751, "put": 3751, "put_sum": 3751, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle": { "val": 0, "max": 3758096384, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle-0x55eb89907c20": { "val": 3545662, "max": 3758096384, "get_started": 0, "get": 7854, "get_sum": 16307821, "get_or_fail_fail": 0, "get_or_fail_success": 7854, "take": 0, "take_sum": 0, "put": 3620, "put_sum": 12762159, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } 2020-05-18T21:35:30.338 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/1034, 0/1034 2020-05-18T21:35:31.339 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:35:31.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0e3ce700 1 Processor -- start 2020-05-18T21:35:31.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0e3ce700 1 -- start start 2020-05-18T21:35:31.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0e3ce700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efc08140000 0x7efc08061c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:31.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0e3ce700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efc08149f50 0x7efc081468a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:31.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0e3ce700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc080b5380 0x7efc080b5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:31.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0e3ce700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc08145f30 con 0x7efc08149f50 2020-05-18T21:35:31.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0e3ce700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc081403e0 con 0x7efc08140000 2020-05-18T21:35:31.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0e3ce700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc08146160 con 0x7efc080b5380 2020-05-18T21:35:31.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0cbcb700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efc08149f50 0x7efc081468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:31.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0cbcb700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efc08149f50 0x7efc081468a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34082/0 (socket says 172.21.15.63:34082) 2020-05-18T21:35:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0cbcb700 1 -- 172.21.15.63:0/2263687764 learned_addr learned my addr 172.21.15.63:0/2263687764 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0d3cc700 1 --2- 172.21.15.63:0/2263687764 >> v2:172.21.15.155:3300/0 conn(0x7efc08140000 0x7efc08061c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0dbcd700 1 --2- 172.21.15.63:0/2263687764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc080b5380 0x7efc080b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0cbcb700 1 -- 172.21.15.63:0/2263687764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc080b5380 msgr2=0x7efc080b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0cbcb700 1 --2- 172.21.15.63:0/2263687764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc080b5380 0x7efc080b5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:31.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0cbcb700 1 -- 172.21.15.63:0/2263687764 >> v2:172.21.15.155:3300/0 conn(0x7efc08140000 msgr2=0x7efc08061c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:31.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0cbcb700 1 --2- 172.21.15.63:0/2263687764 >> v2:172.21.15.155:3300/0 conn(0x7efc08140000 0x7efc08061c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:31.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0cbcb700 1 -- 172.21.15.63:0/2263687764 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc08146400 con 0x7efc08149f50 2020-05-18T21:35:31.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0d3cc700 1 --2- 172.21.15.63:0/2263687764 >> v2:172.21.15.155:3300/0 conn(0x7efc08140000 0x7efc08061c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:35:31.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0cbcb700 1 --2- 172.21.15.63:0/2263687764 >> v2:172.21.15.63:3300/0 conn(0x7efc08149f50 0x7efc081468a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efbf8002f70 tx=0x7efbf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0cbcb700 1 --2- 172.21.15.63:0/2263687764 >> v2:172.21.15.63:3300/0 conn(0x7efc08149f50 0x7efc081468a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efbf8002f70 tx=0x7efbf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0cbcb700 1 --2- 172.21.15.63:0/2263687764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc08149f50 0x7efc081468a0 secure :-1 s=READY pgs=1725 cs=0 l=1 rx=0x7efbf8002f70 tx=0x7efbf8007a80).ready entity=mon.0 client_cookie=462a1833d28ff04 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0cbcb700 1 --2- 172.21.15.63:0/2263687764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc08149f50 0x7efc081468a0 secure :-1 s=THROTTLE_DONE pgs=1725 cs=0 l=1 rx=0x7efbf8002f70 tx=0x7efbf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0cbcb700 1 --2- 172.21.15.63:0/2263687764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc08149f50 0x7efc081468a0 secure :-1 s=THROTTLE_DONE pgs=1725 cs=0 l=1 rx=0x7efbf8002f70 tx=0x7efbf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efbf7fff700 1 -- 172.21.15.63:0/2263687764 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbf8011760 con 0x7efc08149f50 2020-05-18T21:35:31.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0cbcb700 1 --2- 172.21.15.63:0/2263687764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc08149f50 0x7efc081468a0 secure :-1 s=THROTTLE_DONE pgs=1725 cs=0 l=1 rx=0x7efbf8002f70 tx=0x7efbf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:31.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efbf7fff700 1 -- 172.21.15.63:0/2263687764 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf80118c0 con 0x7efc08149f50 2020-05-18T21:35:31.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efbf7fff700 1 -- 172.21.15.63:0/2263687764 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbf8011ce0 con 0x7efc08149f50 2020-05-18T21:35:31.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0e3ce700 1 -- 172.21.15.63:0/2263687764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc08149f50 msgr2=0x7efc081468a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:31.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0e3ce700 1 --2- 172.21.15.63:0/2263687764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc08149f50 0x7efc081468a0 secure :-1 s=READY pgs=1725 cs=0 l=1 rx=0x7efbf8002f70 tx=0x7efbf8007a80).stop 2020-05-18T21:35:31.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0e3ce700 1 -- 172.21.15.63:0/2263687764 shutdown_connections 2020-05-18T21:35:31.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0e3ce700 1 --2- 172.21.15.63:0/2263687764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc080b5380 0x7efc080b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:31.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0e3ce700 1 --2- 172.21.15.63:0/2263687764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc08149f50 0x7efc081468a0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:31.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0e3ce700 1 --2- 172.21.15.63:0/2263687764 >> v2:172.21.15.155:3300/0 conn(0x7efc08140000 0x7efc08061c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:31.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.458+0000 7efc0e3ce700 1 -- 172.21.15.63:0/2263687764 >> 172.21.15.63:0/2263687764 conn(0x7efc080b95d0 msgr2=0x7efc080b99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:31.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0e3ce700 1 -- 172.21.15.63:0/2263687764 shutdown_connections 2020-05-18T21:35:31.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0e3ce700 1 -- 172.21.15.63:0/2263687764 wait complete. 2020-05-18T21:35:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0e3ce700 1 Processor -- start 2020-05-18T21:35:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0e3ce700 1 -- start start 2020-05-18T21:35:31.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0e3ce700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efc080b5380 0x7efc08141080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:31.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0e3ce700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc08140000 0x7efc08144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:31.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0e3ce700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc081467c0 con 0x7efc08149f50 2020-05-18T21:35:31.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0e3ce700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc080639d0 con 0x7efc080b5380 2020-05-18T21:35:31.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0e3ce700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc08145270 con 0x7efc08140000 2020-05-18T21:35:31.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0d3cc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efc080b5380 0x7efc08141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:31.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0dbcd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efc08149f50 0x7efc080632c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36278/0 (socket says 172.21.15.63:36278) 2020-05-18T21:35:31.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0dbcd700 1 -- 172.21.15.63:0/2001657718 learned_addr learned my addr 172.21.15.63:0/2001657718 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:31.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0cbcb700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc08140000 0x7efc08144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:31.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0d3cc700 1 -- 172.21.15.63:0/2001657718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc08140000 msgr2=0x7efc08144e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:31.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efbf67fc700 1 -- 172.21.15.63:0/2001657718 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627580975 0 0) 0x7efc081467c0 con 0x7efc08149f50 2020-05-18T21:35:31.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0d3cc700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc08140000 0x7efc08144e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:31.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0d3cc700 1 -- 172.21.15.63:0/2001657718 >> v1:172.21.15.63:6789/0 conn(0x7efc08149f50 legacy=0x7efc080632c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:31.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0d3cc700 1 -- 172.21.15.63:0/2001657718 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc08148400 con 0x7efc080b5380 2020-05-18T21:35:31.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0d3cc700 1 --2- 172.21.15.63:0/2001657718 >> v2:172.21.15.63:3300/0 conn(0x7efc080b5380 0x7efc08141080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc04002f70 tx=0x7efc04010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:31.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0d3cc700 1 --2- 172.21.15.63:0/2001657718 >> v2:172.21.15.63:3300/0 conn(0x7efc080b5380 0x7efc08141080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc04002f70 tx=0x7efc04010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:31.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0d3cc700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc080b5380 0x7efc08141080 secure :-1 s=READY pgs=1727 cs=0 l=1 rx=0x7efc04002f70 tx=0x7efc04010a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:31.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0d3cc700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc080b5380 0x7efc08141080 secure :-1 s=THROTTLE_DONE pgs=1727 cs=0 l=1 rx=0x7efc04002f70 tx=0x7efc04010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:31.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0d3cc700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc080b5380 0x7efc08141080 secure :-1 s=THROTTLE_DONE pgs=1727 cs=0 l=1 rx=0x7efc04002f70 tx=0x7efc04010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:31.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efbf67fc700 1 -- 172.21.15.63:0/2001657718 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc04005ae0 con 0x7efc080b5380 2020-05-18T21:35:31.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0d3cc700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc080b5380 0x7efc08141080 secure :-1 s=THROTTLE_DONE pgs=1727 cs=0 l=1 rx=0x7efc04002f70 tx=0x7efc04010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:31.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efbf67fc700 1 -- 172.21.15.63:0/2001657718 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc04005c40 con 0x7efc080b5380 2020-05-18T21:35:31.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efc0e3ce700 1 -- 172.21.15.63:0/2001657718 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc081486a0 con 0x7efc080b5380 2020-05-18T21:35:31.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.462+0000 7efbf67fc700 1 -- 172.21.15.63:0/2001657718 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc0400e4c0 con 0x7efc080b5380 2020-05-18T21:35:31.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.466+0000 7efc0e3ce700 1 -- 172.21.15.63:0/2001657718 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc08147f10 con 0x7efc080b5380 2020-05-18T21:35:31.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.466+0000 7efc0d3cc700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc080b5380 0x7efc08141080 secure :-1 s=THROTTLE_DONE pgs=1727 cs=0 l=1 rx=0x7efc04002f70 tx=0x7efc04010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:31.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.466+0000 7efbf67fc700 1 -- 172.21.15.63:0/2001657718 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7efc040071a0 con 0x7efc080b5380 2020-05-18T21:35:31.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.466+0000 7efc0d3cc700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc080b5380 0x7efc08141080 secure :-1 s=THROTTLE_DONE pgs=1727 cs=0 l=1 rx=0x7efc04002f70 tx=0x7efc04010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:31.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.466+0000 7efc0e3ce700 1 -- 172.21.15.63:0/2001657718 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc08148270 con 0x7efc080b5380 2020-05-18T21:35:31.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.466+0000 7efbf67fc700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efbe804f960 0x7efbe8051e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:31.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.466+0000 7efbf67fc700 1 -- 172.21.15.63:0/2001657718 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6159+0+0 (secure 0 0 0) 0x7efc04063b50 con 0x7efc080b5380 2020-05-18T21:35:31.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.470+0000 7efc0cbcb700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efbe804f960 0x7efbe8051e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:31.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.470+0000 7efc0cbcb700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efbe804f960 0x7efbe8051e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efbf8002f70 tx=0x7efbf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:31.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.470+0000 7efc0cbcb700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efbe804f960 0x7efbe8051e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efbf8002f70 tx=0x7efbf8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:31.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.470+0000 7efc0cbcb700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efbe804f960 0x7efbe8051e20 secure :-1 s=READY pgs=668 cs=0 l=1 rx=0x7efbf8002f70 tx=0x7efbf8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:31.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.474+0000 7efc0d3cc700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc080b5380 0x7efc08141080 secure :-1 s=THROTTLE_DONE pgs=1727 cs=0 l=1 rx=0x7efc04002f70 tx=0x7efc04010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:31.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.474+0000 7efbf67fc700 1 -- 172.21.15.63:0/2001657718 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7efc0403de80 con 0x7efc080b5380 2020-05-18T21:35:31.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.746+0000 7efc0e3ce700 1 -- 172.21.15.63:0/2001657718 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc080569e0 con 0x7efc080b5380 2020-05-18T21:35:31.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.746+0000 7efc0d3cc700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc080b5380 0x7efc08141080 secure :-1 s=THROTTLE_DONE pgs=1727 cs=0 l=1 rx=0x7efc04002f70 tx=0x7efc04010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:31.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.746+0000 7efbf67fc700 1 -- 172.21.15.63:0/2001657718 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+2147 (secure 0 0 0) 0x7efc040414a0 con 0x7efc080b5380 2020-05-18T21:35:31.750 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:31.751 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":98,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/3483934102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3483934102},{"type":"v1","addr":"172.21.15.155:6835","nonce":3483934102}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":98}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:34:27.767123+0000","modified":"2020-05-18T21:34:41.281280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"a","rank":0,"incarnation":94,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6833/1314928434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1314928434},{"type":"v1","addr":"172.21.15.63:6833","nonce":1314928434}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-05-18T21:35:31.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.746+0000 7efc0e3ce700 1 -- 172.21.15.63:0/2001657718 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efbe804f960 msgr2=0x7efbe8051e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:31.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.746+0000 7efc0e3ce700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efbe804f960 0x7efbe8051e20 secure :-1 s=READY pgs=668 cs=0 l=1 rx=0x7efbf8002f70 tx=0x7efbf8007a80).stop 2020-05-18T21:35:31.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.746+0000 7efc0e3ce700 1 -- 172.21.15.63:0/2001657718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc080b5380 msgr2=0x7efc08141080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:31.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.746+0000 7efc0e3ce700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc080b5380 0x7efc08141080 secure :-1 s=READY pgs=1727 cs=0 l=1 rx=0x7efc04002f70 tx=0x7efc04010a90).stop 2020-05-18T21:35:31.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.746+0000 7efc0e3ce700 1 -- 172.21.15.63:0/2001657718 shutdown_connections 2020-05-18T21:35:31.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.746+0000 7efc0e3ce700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efbe804f960 0x7efbe8051e20 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:31.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.746+0000 7efc0e3ce700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc08140000 0x7efc08144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:31.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.746+0000 7efc0e3ce700 1 --2- 172.21.15.63:0/2001657718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc080b5380 0x7efc08141080 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:31.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.746+0000 7efc0e3ce700 1 -- 172.21.15.63:0/2001657718 >> 172.21.15.63:0/2001657718 conn(0x7efc080b95d0 msgr2=0x7efc080b9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:31.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.746+0000 7efc0e3ce700 1 -- 172.21.15.63:0/2001657718 shutdown_connections 2020-05-18T21:35:31.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:31.746+0000 7efc0e3ce700 1 -- 172.21.15.63:0/2001657718 wait complete. 2020-05-18T21:35:31.754 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 98 2020-05-18T21:35:31.762 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2020-05-18T21:35:31.867 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:35:31.868 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-0": { 2020-05-18T21:35:31.868 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 162, 2020-05-18T21:35:31.868 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 157, 2020-05-18T21:35:31.869 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 122524, 2020-05-18T21:35:31.869 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 119101, 2020-05-18T21:35:31.869 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 6, 2020-05-18T21:35:31.869 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 1, 2020-05-18T21:35:31.869 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.020326222, 2020-05-18T21:35:31.870 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.004498258, 2020-05-18T21:35:31.870 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.014031920, 2020-05-18T21:35:31.870 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.003897628, 2020-05-18T21:35:31.870 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:31.870 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 157, 2020-05-18T21:35:31.871 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.018908121, 2020-05-18T21:35:31.871 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000120433 2020-05-18T21:35:31.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.871 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:31.871 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.872 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.872 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.872 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:31.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.872 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-1": { 2020-05-18T21:35:31.873 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 1423, 2020-05-18T21:35:31.873 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 1435, 2020-05-18T21:35:31.873 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 335241, 2020-05-18T21:35:31.873 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 5482563, 2020-05-18T21:35:31.873 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 6, 2020-05-18T21:35:31.874 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 3, 2020-05-18T21:35:31.874 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.182476635, 2020-05-18T21:35:31.874 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.069276820, 2020-05-18T21:35:31.874 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.042555521, 2020-05-18T21:35:31.874 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.058380455, 2020-05-18T21:35:31.875 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:31.875 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1435, 2020-05-18T21:35:31.875 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.072348908, 2020-05-18T21:35:31.875 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000050417 2020-05-18T21:35:31.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.876 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:31.876 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.876 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.876 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.876 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:31.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.877 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-2": { 2020-05-18T21:35:31.877 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 10846, 2020-05-18T21:35:31.877 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 20151, 2020-05-18T21:35:31.877 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 3204314, 2020-05-18T21:35:31.878 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 20692732, 2020-05-18T21:35:31.878 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 6, 2020-05-18T21:35:31.878 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 3, 2020-05-18T21:35:31.878 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 1.752675671, 2020-05-18T21:35:31.879 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.847629993, 2020-05-18T21:35:31.879 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.941094947, 2020-05-18T21:35:31.879 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.107908295, 2020-05-18T21:35:31.879 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:31.879 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 20150, 2020-05-18T21:35:31.880 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.927091278, 2020-05-18T21:35:31.880 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000046009 2020-05-18T21:35:31.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.888 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:31.888 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 23743, 2020-05-18T21:35:31.888 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.008393152, 2020-05-18T21:35:31.889 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000353 2020-05-18T21:35:31.889 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:31.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.889 INFO:teuthology.orchestra.run.smithi063.stdout: "cct": { 2020-05-18T21:35:31.889 INFO:teuthology.orchestra.run.smithi063.stdout: "total_workers": 1, 2020-05-18T21:35:31.890 INFO:teuthology.orchestra.run.smithi063.stdout: "unhealthy_workers": 0 2020-05-18T21:35:31.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.890 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-MDSRank": { 2020-05-18T21:35:31.890 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2020-05-18T21:35:31.890 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2020-05-18T21:35:31.891 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 6437, 2020-05-18T21:35:31.891 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 3.946775240, 2020-05-18T21:35:31.891 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000613138 2020-05-18T21:35:31.891 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:31.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.892 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-PurgeQueue": { 2020-05-18T21:35:31.892 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2020-05-18T21:35:31.892 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2020-05-18T21:35:31.892 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 356, 2020-05-18T21:35:31.892 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.193212901, 2020-05-18T21:35:31.893 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000542732 2020-05-18T21:35:31.893 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:31.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.893 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2020-05-18T21:35:31.893 INFO:teuthology.orchestra.run.smithi063.stdout: "request": 2988, 2020-05-18T21:35:31.894 INFO:teuthology.orchestra.run.smithi063.stdout: "reply": 2985, 2020-05-18T21:35:31.894 INFO:teuthology.orchestra.run.smithi063.stdout: "reply_latency": { 2020-05-18T21:35:31.894 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 2985, 2020-05-18T21:35:31.894 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 5.238762679, 2020-05-18T21:35:31.894 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001755029 2020-05-18T21:35:31.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.895 INFO:teuthology.orchestra.run.smithi063.stdout: "forward": 0, 2020-05-18T21:35:31.895 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_fetch": 12, 2020-05-18T21:35:31.895 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_commit": 73, 2020-05-18T21:35:31.895 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_split": 9, 2020-05-18T21:35:31.896 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_merge": 0, 2020-05-18T21:35:31.896 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes": 1480, 2020-05-18T21:35:31.896 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_top": 0, 2020-05-18T21:35:31.896 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_bottom": 1480, 2020-05-18T21:35:31.897 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pin_tail": 0, 2020-05-18T21:35:31.897 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pinned": 1480, 2020-05-18T21:35:31.897 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_expired": 0, 2020-05-18T21:35:31.897 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_with_caps": 402, 2020-05-18T21:35:31.897 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": 402, 2020-05-18T21:35:31.898 INFO:teuthology.orchestra.run.smithi063.stdout: "subtrees": 2, 2020-05-18T21:35:31.898 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse": 2989, 2020-05-18T21:35:31.898 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_hit": 2987, 2020-05-18T21:35:31.898 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_forward": 0, 2020-05-18T21:35:31.898 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_discover": 0, 2020-05-18T21:35:31.899 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_dir_fetch": 0, 2020-05-18T21:35:31.899 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_remote_ino": 0, 2020-05-18T21:35:31.899 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_lock": 0, 2020-05-18T21:35:31.899 INFO:teuthology.orchestra.run.smithi063.stdout: "load_cent": 223899, 2020-05-18T21:35:31.899 INFO:teuthology.orchestra.run.smithi063.stdout: "q": 0, 2020-05-18T21:35:31.900 INFO:teuthology.orchestra.run.smithi063.stdout: "exported": 0, 2020-05-18T21:35:31.900 INFO:teuthology.orchestra.run.smithi063.stdout: "exported_inodes": 0, 2020-05-18T21:35:31.900 INFO:teuthology.orchestra.run.smithi063.stdout: "imported": 0, 2020-05-18T21:35:31.900 INFO:teuthology.orchestra.run.smithi063.stdout: "imported_inodes": 0, 2020-05-18T21:35:31.900 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_dir_fetch": 0, 2020-05-18T21:35:31.901 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_backtrace_fetch": 0, 2020-05-18T21:35:31.901 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_peer_discover": 0, 2020-05-18T21:35:31.901 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rfiles": 375, 2020-05-18T21:35:31.901 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rbytes": 3028287488, 2020-05-18T21:35:31.901 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rsnaps": 0 2020-05-18T21:35:31.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.902 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:35:31.902 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays": 1181, 2020-05-18T21:35:31.903 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_delayed": 1106, 2020-05-18T21:35:31.903 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:35:31.903 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_created": 1312, 2020-05-18T21:35:31.903 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 131, 2020-05-18T21:35:31.903 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_reintegrated": 0, 2020-05-18T21:35:31.904 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_migrated": 0, 2020-05-18T21:35:31.904 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_processing": 0, 2020-05-18T21:35:31.904 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:35:31.904 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:35:31.904 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_started": 0, 2020-05-18T21:35:31.905 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_completed": 0, 2020-05-18T21:35:31.905 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:35:31.905 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_exportdir": 0, 2020-05-18T21:35:31.905 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_flush": 0, 2020-05-18T21:35:31.905 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragmentdir": 9, 2020-05-18T21:35:31.906 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragstats": 0, 2020-05-18T21:35:31.906 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_inodestats": 0 2020-05-18T21:35:31.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.906 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log": { 2020-05-18T21:35:31.906 INFO:teuthology.orchestra.run.smithi063.stdout: "evadd": 8282, 2020-05-18T21:35:31.907 INFO:teuthology.orchestra.run.smithi063.stdout: "evex": 0, 2020-05-18T21:35:31.907 INFO:teuthology.orchestra.run.smithi063.stdout: "evtrm": 0, 2020-05-18T21:35:31.907 INFO:teuthology.orchestra.run.smithi063.stdout: "ev": 8284, 2020-05-18T21:35:31.907 INFO:teuthology.orchestra.run.smithi063.stdout: "evexg": 0, 2020-05-18T21:35:31.907 INFO:teuthology.orchestra.run.smithi063.stdout: "evexd": 0, 2020-05-18T21:35:31.908 INFO:teuthology.orchestra.run.smithi063.stdout: "segadd": 11, 2020-05-18T21:35:31.908 INFO:teuthology.orchestra.run.smithi063.stdout: "segex": 0, 2020-05-18T21:35:31.908 INFO:teuthology.orchestra.run.smithi063.stdout: "segtrm": 0, 2020-05-18T21:35:31.908 INFO:teuthology.orchestra.run.smithi063.stdout: "seg": 12, 2020-05-18T21:35:31.908 INFO:teuthology.orchestra.run.smithi063.stdout: "segexg": 0, 2020-05-18T21:35:31.908 INFO:teuthology.orchestra.run.smithi063.stdout: "segexd": 0, 2020-05-18T21:35:31.909 INFO:teuthology.orchestra.run.smithi063.stdout: "expos": 4194304, 2020-05-18T21:35:31.909 INFO:teuthology.orchestra.run.smithi063.stdout: "wrpos": 21483118, 2020-05-18T21:35:31.909 INFO:teuthology.orchestra.run.smithi063.stdout: "rdpos": 4195196, 2020-05-18T21:35:31.909 INFO:teuthology.orchestra.run.smithi063.stdout: "jlat": { 2020-05-18T21:35:31.910 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 3624, 2020-05-18T21:35:31.910 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 19.689443989, 2020-05-18T21:35:31.910 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.005433069 2020-05-18T21:35:31.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.910 INFO:teuthology.orchestra.run.smithi063.stdout: "replayed": 2 2020-05-18T21:35:31.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.911 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_mem": { 2020-05-18T21:35:31.911 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 1483, 2020-05-18T21:35:31.911 INFO:teuthology.orchestra.run.smithi063.stdout: "ino+": 1614, 2020-05-18T21:35:31.911 INFO:teuthology.orchestra.run.smithi063.stdout: "ino-": 131, 2020-05-18T21:35:31.912 INFO:teuthology.orchestra.run.smithi063.stdout: "dir": 76, 2020-05-18T21:35:31.912 INFO:teuthology.orchestra.run.smithi063.stdout: "dir+": 85, 2020-05-18T21:35:31.912 INFO:teuthology.orchestra.run.smithi063.stdout: "dir-": 9, 2020-05-18T21:35:31.912 INFO:teuthology.orchestra.run.smithi063.stdout: "dn": 2791, 2020-05-18T21:35:31.912 INFO:teuthology.orchestra.run.smithi063.stdout: "dn+": 2922, 2020-05-18T21:35:31.913 INFO:teuthology.orchestra.run.smithi063.stdout: "dn-": 131, 2020-05-18T21:35:31.913 INFO:teuthology.orchestra.run.smithi063.stdout: "cap": 365, 2020-05-18T21:35:31.913 INFO:teuthology.orchestra.run.smithi063.stdout: "cap+": 1602, 2020-05-18T21:35:31.913 INFO:teuthology.orchestra.run.smithi063.stdout: "cap-": 1237, 2020-05-18T21:35:31.913 INFO:teuthology.orchestra.run.smithi063.stdout: "rss": 90200, 2020-05-18T21:35:31.914 INFO:teuthology.orchestra.run.smithi063.stdout: "heap": 331932 2020-05-18T21:35:31.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.914 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_server": { 2020-05-18T21:35:31.914 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_client_request": 3059, 2020-05-18T21:35:31.914 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_server_request": 0, 2020-05-18T21:35:31.915 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_request": 2988, 2020-05-18T21:35:31.915 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_session": 3, 2020-05-18T21:35:31.915 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_slave_request": 0, 2020-05-18T21:35:31.915 INFO:teuthology.orchestra.run.smithi063.stdout: "req_create_latency": { 2020-05-18T21:35:31.915 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1600, 2020-05-18T21:35:31.916 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 2.331516366, 2020-05-18T21:35:31.916 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001457197 2020-05-18T21:35:31.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.916 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getattr_latency": { 2020-05-18T21:35:31.917 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 2, 2020-05-18T21:35:31.917 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000941751, 2020-05-18T21:35:31.917 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000470875 2020-05-18T21:35:31.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.918 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getfilelock_latency": { 2020-05-18T21:35:31.918 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.918 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.918 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.919 INFO:teuthology.orchestra.run.smithi063.stdout: "req_link_latency": { 2020-05-18T21:35:31.919 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.919 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.919 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.920 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookup_latency": { 2020-05-18T21:35:31.920 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:31.920 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.001560520, 2020-05-18T21:35:31.920 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001560520 2020-05-18T21:35:31.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.921 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookuphash_latency": { 2020-05-18T21:35:31.921 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.921 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.921 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.922 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupino_latency": { 2020-05-18T21:35:31.922 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.922 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.922 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.923 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupname_latency": { 2020-05-18T21:35:31.923 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.923 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.923 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.924 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupparent_latency": { 2020-05-18T21:35:31.924 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.924 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.924 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.925 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupsnap_latency": { 2020-05-18T21:35:31.925 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.925 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.925 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.926 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lssnap_latency": { 2020-05-18T21:35:31.926 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.926 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.926 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.927 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mkdir_latency": { 2020-05-18T21:35:31.927 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:31.927 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.004721025, 2020-05-18T21:35:31.927 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.004721025 2020-05-18T21:35:31.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.927 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mknod_latency": { 2020-05-18T21:35:31.928 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.928 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.928 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.928 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mksnap_latency": { 2020-05-18T21:35:31.929 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.929 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.929 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.929 INFO:teuthology.orchestra.run.smithi063.stdout: "req_open_latency": { 2020-05-18T21:35:31.930 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.930 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.930 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.930 INFO:teuthology.orchestra.run.smithi063.stdout: "req_readdir_latency": { 2020-05-18T21:35:31.931 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 70, 2020-05-18T21:35:31.931 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.134635846, 2020-05-18T21:35:31.931 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001923369 2020-05-18T21:35:31.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.931 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rename_latency": { 2020-05-18T21:35:31.932 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.932 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.932 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.932 INFO:teuthology.orchestra.run.smithi063.stdout: "req_renamesnap_latency": { 2020-05-18T21:35:31.933 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.933 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.933 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.933 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmdir_latency": { 2020-05-18T21:35:31.934 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.934 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.934 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.934 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmsnap_latency": { 2020-05-18T21:35:31.934 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.935 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.935 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.935 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmxattr_latency": { 2020-05-18T21:35:31.936 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.936 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.936 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.936 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setattr_latency": { 2020-05-18T21:35:31.936 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.937 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.937 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.937 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setdirlayout_latency": { 2020-05-18T21:35:31.937 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.938 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.938 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.938 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setfilelock_latency": { 2020-05-18T21:35:31.938 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.939 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.939 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.939 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setlayout_latency": { 2020-05-18T21:35:31.939 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.940 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.940 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.940 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setxattr_latency": { 2020-05-18T21:35:31.940 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.941 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.941 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.941 INFO:teuthology.orchestra.run.smithi063.stdout: "req_symlink_latency": { 2020-05-18T21:35:31.942 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.942 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.942 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.942 INFO:teuthology.orchestra.run.smithi063.stdout: "req_unlink_latency": { 2020-05-18T21:35:31.942 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1312, 2020-05-18T21:35:31.943 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 2.767155339, 2020-05-18T21:35:31.943 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.002109112 2020-05-18T21:35:31.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.943 INFO:teuthology.orchestra.run.smithi063.stdout: "cap_revoke_eviction": 0 2020-05-18T21:35:31.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.944 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_sessions": { 2020-05-18T21:35:31.944 INFO:teuthology.orchestra.run.smithi063.stdout: "session_count": 1, 2020-05-18T21:35:31.944 INFO:teuthology.orchestra.run.smithi063.stdout: "session_add": 1, 2020-05-18T21:35:31.944 INFO:teuthology.orchestra.run.smithi063.stdout: "session_remove": 0, 2020-05-18T21:35:31.944 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_open": 1, 2020-05-18T21:35:31.945 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_stale": 0, 2020-05-18T21:35:31.945 INFO:teuthology.orchestra.run.smithi063.stdout: "total_load": 2510, 2020-05-18T21:35:31.945 INFO:teuthology.orchestra.run.smithi063.stdout: "average_load": 2510, 2020-05-18T21:35:31.945 INFO:teuthology.orchestra.run.smithi063.stdout: "avg_session_uptime": 903 2020-05-18T21:35:31.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.946 INFO:teuthology.orchestra.run.smithi063.stdout: "mempool": { 2020-05-18T21:35:31.946 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_bytes": 0, 2020-05-18T21:35:31.946 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_items": 0, 2020-05-18T21:35:31.946 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_bytes": 0, 2020-05-18T21:35:31.946 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_items": 0, 2020-05-18T21:35:31.947 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_bytes": 0, 2020-05-18T21:35:31.947 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_items": 0, 2020-05-18T21:35:31.947 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_bytes": 0, 2020-05-18T21:35:31.947 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_items": 0, 2020-05-18T21:35:31.947 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_bytes": 0, 2020-05-18T21:35:31.948 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_items": 0, 2020-05-18T21:35:31.948 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_bytes": 0, 2020-05-18T21:35:31.948 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_items": 0, 2020-05-18T21:35:31.948 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_bytes": 0, 2020-05-18T21:35:31.948 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_items": 0, 2020-05-18T21:35:31.949 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_bytes": 0, 2020-05-18T21:35:31.949 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_items": 0, 2020-05-18T21:35:31.949 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_bytes": 0, 2020-05-18T21:35:31.949 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_items": 0, 2020-05-18T21:35:31.949 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_bytes": 0, 2020-05-18T21:35:31.950 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_items": 0, 2020-05-18T21:35:31.950 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_bytes": 1143439, 2020-05-18T21:35:31.950 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_items": 654, 2020-05-18T21:35:31.950 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_bytes": 88, 2020-05-18T21:35:31.950 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_items": 1, 2020-05-18T21:35:31.951 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bytes": 0, 2020-05-18T21:35:31.951 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_items": 0, 2020-05-18T21:35:31.951 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_bytes": 0, 2020-05-18T21:35:31.951 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_items": 0, 2020-05-18T21:35:31.951 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_bytes": 0, 2020-05-18T21:35:31.952 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_items": 0, 2020-05-18T21:35:31.952 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_bytes": 6128, 2020-05-18T21:35:31.952 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_items": 93, 2020-05-18T21:35:31.952 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_bytes": 0, 2020-05-18T21:35:31.952 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_items": 0, 2020-05-18T21:35:31.952 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_bytes": 0, 2020-05-18T21:35:31.953 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_items": 0, 2020-05-18T21:35:31.953 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_bytes": 6338269, 2020-05-18T21:35:31.953 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_items": 79913, 2020-05-18T21:35:31.953 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_bytes": 0, 2020-05-18T21:35:31.954 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_items": 0, 2020-05-18T21:35:31.954 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_bytes": 0, 2020-05-18T21:35:31.954 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_items": 0 2020-05-18T21:35:31.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.954 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter": { 2020-05-18T21:35:31.954 INFO:teuthology.orchestra.run.smithi063.stdout: "op_active": 0, 2020-05-18T21:35:31.955 INFO:teuthology.orchestra.run.smithi063.stdout: "op_laggy": 0, 2020-05-18T21:35:31.955 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send": 4065, 2020-05-18T21:35:31.955 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send_bytes": 17855451, 2020-05-18T21:35:31.956 INFO:teuthology.orchestra.run.smithi063.stdout: "op_resend": 0, 2020-05-18T21:35:31.956 INFO:teuthology.orchestra.run.smithi063.stdout: "op_reply": 4065, 2020-05-18T21:35:31.956 INFO:teuthology.orchestra.run.smithi063.stdout: "op": 4065, 2020-05-18T21:35:31.956 INFO:teuthology.orchestra.run.smithi063.stdout: "op_r": 28, 2020-05-18T21:35:31.956 INFO:teuthology.orchestra.run.smithi063.stdout: "op_w": 4037, 2020-05-18T21:35:31.957 INFO:teuthology.orchestra.run.smithi063.stdout: "op_rmw": 0, 2020-05-18T21:35:31.957 INFO:teuthology.orchestra.run.smithi063.stdout: "op_pg": 0, 2020-05-18T21:35:31.957 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_stat": 2, 2020-05-18T21:35:31.957 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_create": 0, 2020-05-18T21:35:31.957 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_read": 10, 2020-05-18T21:35:31.958 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_write": 3626, 2020-05-18T21:35:31.958 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writefull": 6, 2020-05-18T21:35:31.958 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writesame": 0, 2020-05-18T21:35:31.958 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_append": 0, 2020-05-18T21:35:31.958 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_zero": 1, 2020-05-18T21:35:31.958 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_truncate": 1, 2020-05-18T21:35:31.959 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_delete": 319, 2020-05-18T21:35:31.959 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_mapext": 0, 2020-05-18T21:35:31.959 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_sparse_read": 0, 2020-05-18T21:35:31.959 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_clonerange": 0, 2020-05-18T21:35:31.959 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_getxattr": 14, 2020-05-18T21:35:31.960 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_setxattr": 0, 2020-05-18T21:35:31.960 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_cmpxattr": 0, 2020-05-18T21:35:31.960 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_rmxattr": 0, 2020-05-18T21:35:31.960 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_resetxattrs": 0, 2020-05-18T21:35:31.960 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_call": 0, 2020-05-18T21:35:31.961 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_watch": 0, 2020-05-18T21:35:31.961 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_notify": 0, 2020-05-18T21:35:31.961 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_src_cmpxattr": 0, 2020-05-18T21:35:31.961 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls": 0, 2020-05-18T21:35:31.962 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls_filter": 0, 2020-05-18T21:35:31.963 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_other": 0, 2020-05-18T21:35:31.963 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_active": 0, 2020-05-18T21:35:31.963 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_send": 0, 2020-05-18T21:35:31.963 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_resend": 0, 2020-05-18T21:35:31.963 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_ping": 0, 2020-05-18T21:35:31.964 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_active": 0, 2020-05-18T21:35:31.964 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_send": 0, 2020-05-18T21:35:31.964 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_resend": 0, 2020-05-18T21:35:31.964 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_active": 0, 2020-05-18T21:35:31.964 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_send": 0, 2020-05-18T21:35:31.965 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_resend": 0, 2020-05-18T21:35:31.965 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_active": 0, 2020-05-18T21:35:31.965 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_send": 0, 2020-05-18T21:35:31.965 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_resend": 0, 2020-05-18T21:35:31.965 INFO:teuthology.orchestra.run.smithi063.stdout: "command_active": 0, 2020-05-18T21:35:31.965 INFO:teuthology.orchestra.run.smithi063.stdout: "command_send": 0, 2020-05-18T21:35:31.966 INFO:teuthology.orchestra.run.smithi063.stdout: "command_resend": 0, 2020-05-18T21:35:31.966 INFO:teuthology.orchestra.run.smithi063.stdout: "map_epoch": 0, 2020-05-18T21:35:31.966 INFO:teuthology.orchestra.run.smithi063.stdout: "map_full": 0, 2020-05-18T21:35:31.966 INFO:teuthology.orchestra.run.smithi063.stdout: "map_inc": 0, 2020-05-18T21:35:31.966 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_sessions": 8, 2020-05-18T21:35:31.967 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_open": 8, 2020-05-18T21:35:31.967 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_close": 0, 2020-05-18T21:35:31.967 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_laggy": 0, 2020-05-18T21:35:31.967 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_wr": 167, 2020-05-18T21:35:31.967 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_rd": 28, 2020-05-18T21:35:31.967 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_del": 10 2020-05-18T21:35:31.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.968 INFO:teuthology.orchestra.run.smithi063.stdout: "oft": { 2020-05-18T21:35:31.968 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_objs": 0, 2020-05-18T21:35:31.968 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_kv_pairs": 0, 2020-05-18T21:35:31.968 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_updates": 0, 2020-05-18T21:35:31.969 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_removes": 0 2020-05-18T21:35:31.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.969 INFO:teuthology.orchestra.run.smithi063.stdout: "purge_queue": { 2020-05-18T21:35:31.969 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops": 0, 2020-05-18T21:35:31.969 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops_high_water": 20, 2020-05-18T21:35:31.970 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing": 0, 2020-05-18T21:35:31.970 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_high_water": 7, 2020-05-18T21:35:31.970 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executed": 131, 2020-05-18T21:35:31.970 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_item_in_journal": 0 2020-05-18T21:35:31.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.970 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-05-18T21:35:31.971 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:31.971 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2020-05-18T21:35:31.971 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:31.971 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 12428, 2020-05-18T21:35:31.971 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 2741415, 2020-05-18T21:35:31.972 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:31.972 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 12428, 2020-05-18T21:35:31.972 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:31.972 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:31.973 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 12428, 2020-05-18T21:35:31.973 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 2741415, 2020-05-18T21:35:31.973 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:31.973 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.974 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.974 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.974 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:31.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.975 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_bytes": { 2020-05-18T21:35:31.975 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:31.975 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2020-05-18T21:35:31.975 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:31.975 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2020-05-18T21:35:31.976 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2020-05-18T21:35:31.976 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:31.976 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2020-05-18T21:35:31.976 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 4065, 2020-05-18T21:35:31.976 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 17869788, 2020-05-18T21:35:31.977 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 3733, 2020-05-18T21:35:31.977 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 17869788, 2020-05-18T21:35:31.977 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:31.977 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.977 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.978 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.978 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:31.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.978 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_ops": { 2020-05-18T21:35:31.978 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:31.979 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 1024, 2020-05-18T21:35:31.979 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:31.979 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2020-05-18T21:35:31.979 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2020-05-18T21:35:31.980 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:31.980 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2020-05-18T21:35:31.980 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 4065, 2020-05-18T21:35:31.980 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 4065, 2020-05-18T21:35:31.981 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 4065, 2020-05-18T21:35:31.981 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 4065, 2020-05-18T21:35:31.981 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:31.981 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.981 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.982 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.982 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:31.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.982 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle": { 2020-05-18T21:35:31.982 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:31.982 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2020-05-18T21:35:31.984 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:31.984 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 131, 2020-05-18T21:35:31.984 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 13231, 2020-05-18T21:35:31.984 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:31.984 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 131, 2020-05-18T21:35:31.985 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:31.985 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:31.985 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 2, 2020-05-18T21:35:31.985 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 13231, 2020-05-18T21:35:31.985 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:31.986 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.986 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.986 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.986 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:31.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:31.987 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle-0x55eb89907c20": { 2020-05-18T21:35:31.987 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 237968, 2020-05-18T21:35:31.987 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2020-05-18T21:35:31.987 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:31.987 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 8283, 2020-05-18T21:35:31.988 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 17290598, 2020-05-18T21:35:31.988 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:31.988 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 8283, 2020-05-18T21:35:31.988 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:31.988 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:31.989 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 3624, 2020-05-18T21:35:31.989 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 17052630, 2020-05-18T21:35:31.989 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:31.989 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:31.989 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:31.990 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:31.990 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:31.990 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:31.990 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:35:31.991 INFO:tasks.cephfs.filesystem:_json_asok output: { "AsyncMessenger::Worker-0": { "msgr_recv_messages": 162, "msgr_send_messages": 157, "msgr_recv_bytes": 122524, "msgr_send_bytes": 119101, "msgr_created_connections": 6, "msgr_active_connections": 1, "msgr_running_total_time": 0.020326222, "msgr_running_send_time": 0.004498258, "msgr_running_recv_time": 0.014031920, "msgr_running_fast_dispatch_time": 0.003897628, "msgr_send_messages_queue_lat": { "avgcount": 157, "sum": 0.018908121, "avgtime": 0.000120433 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-1": { "msgr_recv_messages": 1423, "msgr_send_messages": 1435, "msgr_recv_bytes": 335241, "msgr_send_bytes": 5482563, "msgr_created_connections": 6, "msgr_active_connections": 3, "msgr_running_total_time": 0.182476635, "msgr_running_send_time": 0.069276820, "msgr_running_recv_time": 0.042555521, "msgr_running_fast_dispatch_time": 0.058380455, "msgr_send_messages_queue_lat": { "avgcount": 1435, "sum": 0.072348908, "avgtime": 0.000050417 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-2": { "msgr_recv_messages": 10846, "msgr_send_messages": 20151, "msgr_recv_bytes": 3204314, "msgr_send_bytes": 20692732, "msgr_created_connections": 6, "msgr_active_connections": 3, "msgr_running_total_time": 1.752675671, "msgr_running_send_time": 0.847629993, "msgr_running_recv_time": 0.941094947, "msgr_running_fast_dispatch_time": 0.107908295, "msgr_send_messages_queue_lat": { "avgcount": 20150, "sum": 0.927091278, "avgtime": 0.000046009 }, "msgr_handle_ack_lat": { "avgcount": 23743, "sum": 0.008393152, "avgtime": 0.000000353 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "queue_len": 0, "complete_latency": { "avgcount": 6437, "sum": 3.946775240, "avgtime": 0.000613138 } }, "finisher-PurgeQueue": { "queue_len": 0, "complete_latency": { "avgcount": 356, "sum": 0.193212901, "avgtime": 0.000542732 } }, "mds": { "request": 2988, "reply": 2985, "reply_latency": { "avgcount": 2985, "sum": 5.238762679, "avgtime": 0.001755029 }, "forward": 0, "dir_fetch": 12, "dir_commit": 73, "dir_split": 9, "dir_merge": 0, "inodes": 1480, "inodes_top": 0, "inodes_bottom": 1480, "inodes_pin_tail": 0, "inodes_pinned": 1480, "inodes_expired": 0, "inodes_with_caps": 402, "caps": 402, "subtrees": 2, "traverse": 2989, "traverse_hit": 2987, "traverse_forward": 0, "traverse_discover": 0, "traverse_dir_fetch": 0, "traverse_remote_ino": 0, "traverse_lock": 0, "load_cent": 223899, "q": 0, "exported": 0, "exported_inodes": 0, "imported": 0, "imported_inodes": 0, "openino_dir_fetch": 0, "openino_backtrace_fetch": 0, "openino_peer_discover": 0, "root_rfiles": 375, "root_rbytes": 3028287488, "root_rsnaps": 0 }, "mds_cache": { "num_strays": 1181, "num_strays_delayed": 1106, "num_strays_enqueuing": 0, "strays_created": 1312, "strays_enqueued": 131, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 9, "ireq_fragstats": 0, "ireq_inodestats": 0 }, "mds_log": { "evadd": 8282, "evex": 0, "evtrm": 0, "ev": 8284, "evexg": 0, "evexd": 0, "segadd": 11, "segex": 0, "segtrm": 0, "seg": 12, "segexg": 0, "segexd": 0, "expos": 4194304, "wrpos": 21483118, "rdpos": 4195196, "jlat": { "avgcount": 3624, "sum": 19.689443989, "avgtime": 0.005433069 }, "replayed": 2 }, "mds_mem": { "ino": 1483, "ino+": 1614, "ino-": 131, "dir": 76, "dir+": 85, "dir-": 9, "dn": 2791, "dn+": 2922, "dn-": 131, "cap": 365, "cap+": 1602, "cap-": 1237, "rss": 90200, "heap": 331932 }, "mds_server": { "dispatch_client_request": 3059, "dispatch_server_request": 0, "handle_client_request": 2988, "handle_client_session": 3, "handle_slave_request": 0, "req_create_latency": { "avgcount": 1600, "sum": 2.331516366, "avgtime": 0.001457197 }, "req_getattr_latency": { "avgcount": 2, "sum": 0.000941751, "avgtime": 0.000470875 }, "req_getfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_link_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookup_latency": { "avgcount": 1, "sum": 0.001560520, "avgtime": 0.001560520 }, "req_lookuphash_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupino_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupname_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupparent_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lssnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mkdir_latency": { "avgcount": 1, "sum": 0.004721025, "avgtime": 0.004721025 }, "req_mknod_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mksnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_open_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_readdir_latency": { "avgcount": 70, "sum": 0.134635846, "avgtime": 0.001923369 }, "req_rename_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_renamesnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmdir_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setdirlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_symlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_unlink_latency": { "avgcount": 1312, "sum": 2.767155339, "avgtime": 0.002109112 }, "cap_revoke_eviction": 0 }, "mds_sessions": { "session_count": 1, "session_add": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 2510, "average_load": 2510, "avg_session_uptime": 903 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "buffer_anon_bytes": 1143439, "buffer_anon_items": 654, "buffer_meta_bytes": 88, "buffer_meta_items": 1, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6128, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 6338269, "mds_co_items": 79913, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "op_active": 0, "op_laggy": 0, "op_send": 4065, "op_send_bytes": 17855451, "op_resend": 0, "op_reply": 4065, "op": 4065, "op_r": 28, "op_w": 4037, "op_rmw": 0, "op_pg": 0, "osdop_stat": 2, "osdop_create": 0, "osdop_read": 10, "osdop_write": 3626, "osdop_writefull": 6, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 1, "osdop_truncate": 1, "osdop_delete": 319, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 14, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 8, "osd_session_open": 8, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 167, "omap_rd": 28, "omap_del": 10 }, "oft": { "omap_total_objs": 0, "omap_total_kv_pairs": 0, "omap_total_updates": 0, "omap_total_removes": 0 }, "purge_queue": { "pq_executing_ops": 0, "pq_executing_ops_high_water": 20, "pq_executing": 0, "pq_executing_high_water": 7, "pq_executed": 131, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "val": 0, "max": 104857600, "get_started": 0, "get": 12428, "get_sum": 2741415, "get_or_fail_fail": 0, "get_or_fail_success": 12428, "take": 0, "take_sum": 0, "put": 12428, "put_sum": 2741415, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_bytes": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 4065, "take_sum": 17869788, "put": 3733, "put_sum": 17869788, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_ops": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 4065, "take_sum": 4065, "put": 4065, "put_sum": 4065, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle": { "val": 0, "max": 3758096384, "get_started": 0, "get": 131, "get_sum": 13231, "get_or_fail_fail": 0, "get_or_fail_success": 131, "take": 0, "take_sum": 0, "put": 2, "put_sum": 13231, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle-0x55eb89907c20": { "val": 237968, "max": 3758096384, "get_started": 0, "get": 8283, "get_sum": 17290598, "get_or_fail_fail": 0, "get_or_fail_success": 8283, "take": 0, "take_sum": 0, "put": 3624, "put_sum": 17052630, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } 2020-05-18T21:35:31.992 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/1181, 131/1312 2020-05-18T21:35:32.994 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:35:33.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.118+0000 7fedf8eb0700 1 Processor -- start 2020-05-18T21:35:33.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.118+0000 7fedf8eb0700 1 -- start start 2020-05-18T21:35:33.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.118+0000 7fedf8eb0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedf414a350 0x7fedf40b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:33.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.118+0000 7fedf8eb0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf4149740 con 0x7fedf40b30f0 2020-05-18T21:35:33.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.118+0000 7fedf8eb0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf4149970 con 0x7fedf40b9120 2020-05-18T21:35:33.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.118+0000 7fedf8eb0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf4149c10 con 0x7fedf414a350 2020-05-18T21:35:33.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf259c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fedf40b9120 0x7fedf412bd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:34604/0 (socket says 172.21.15.63:34604) 2020-05-18T21:35:33.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf259c700 1 -- 172.21.15.63:0/917681803 learned_addr learned my addr 172.21.15.63:0/917681803 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:33.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf159a700 1 -- 172.21.15.63:0/917681803 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720406127 0 0) 0x7fedf4149970 con 0x7fedf40b9120 2020-05-18T21:35:33.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf159a700 1 -- 172.21.15.63:0/917681803 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedd800ba80 con 0x7fedf40b9120 2020-05-18T21:35:33.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf2d9d700 1 --2- 172.21.15.63:0/917681803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedf414a350 0x7fedf40b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:33.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf159a700 1 -- 172.21.15.63:0/917681803 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4205741312 0 0) 0x7fedd800ba80 con 0x7fedf40b9120 2020-05-18T21:35:33.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf159a700 1 -- 172.21.15.63:0/917681803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedf414a350 msgr2=0x7fedf40b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:33.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf159a700 1 --2- 172.21.15.63:0/917681803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedf414a350 0x7fedf40b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:33.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf159a700 1 -- 172.21.15.63:0/917681803 >> v1:172.21.15.63:6789/0 conn(0x7fedf40b30f0 legacy=0x7fedf40ad7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:33.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf159a700 1 -- 172.21.15.63:0/917681803 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf4149eb0 con 0x7fedf40b9120 2020-05-18T21:35:33.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf159a700 1 -- 172.21.15.63:0/917681803 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fedec001a90 con 0x7fedf40b9120 2020-05-18T21:35:33.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf159a700 1 -- 172.21.15.63:0/917681803 >> v1:172.21.15.155:6789/0 conn(0x7fedf40b9120 legacy=0x7fedf412bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:33.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf159a700 1 --2- 172.21.15.63:0/917681803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedd800bf70 0x7fedd800c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:33.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf259c700 1 --2- 172.21.15.63:0/917681803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedd800bf70 0x7fedd800c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:33.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf159a700 1 --2- 172.21.15.63:0/917681803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedd800c820 0x7fedd800cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:33.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf159a700 1 --2- 172.21.15.63:0/917681803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedd800d270 0x7fedd800d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:33.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf159a700 1 -- 172.21.15.63:0/917681803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf4149c10 con 0x7fedd800bf70 2020-05-18T21:35:33.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf159a700 1 -- 172.21.15.63:0/917681803 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd8013fd0 con 0x7fedd800c820 2020-05-18T21:35:33.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf159a700 1 -- 172.21.15.63:0/917681803 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd8014190 con 0x7fedd800d270 2020-05-18T21:35:33.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf2d9d700 1 --2- 172.21.15.63:0/917681803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedf414a350 0x7fedf40b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:35:33.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf1d9b700 1 --2- 172.21.15.63:0/917681803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedd800c820 0x7fedd800cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:33.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf2d9d700 1 --2- 172.21.15.63:0/917681803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedd800d270 0x7fedd800d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:33.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf259c700 1 -- 172.21.15.63:0/917681803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedd800d270 msgr2=0x7fedd800d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:33.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf259c700 1 --2- 172.21.15.63:0/917681803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedd800d270 0x7fedd800d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:33.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf259c700 1 -- 172.21.15.63:0/917681803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedd800c820 msgr2=0x7fedd800cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:33.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf259c700 1 --2- 172.21.15.63:0/917681803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedd800c820 0x7fedd800cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:33.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf259c700 1 -- 172.21.15.63:0/917681803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd800ba80 con 0x7fedd800bf70 2020-05-18T21:35:33.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf259c700 1 --2- 172.21.15.63:0/917681803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedd800bf70 0x7fedd800c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fedec0017a0 tx=0x7fedf405cb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf259c700 1 --2- 172.21.15.63:0/917681803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedd800bf70 0x7fedd800c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fedec0017a0 tx=0x7fedf405cb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf259c700 1 --2- 172.21.15.63:0/917681803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedd800bf70 0x7fedd800c350 secure :-1 s=READY pgs=1729 cs=0 l=1 rx=0x7fedec0017a0 tx=0x7fedf405cb00).ready entity=mon.0 client_cookie=6f4066301ce9d43c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:33.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf259c700 1 --2- 172.21.15.63:0/917681803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedd800bf70 0x7fedd800c350 secure :-1 s=THROTTLE_DONE pgs=1729 cs=0 l=1 rx=0x7fedec0017a0 tx=0x7fedf405cb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf259c700 1 --2- 172.21.15.63:0/917681803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedd800bf70 0x7fedd800c350 secure :-1 s=THROTTLE_DONE pgs=1729 cs=0 l=1 rx=0x7fedec0017a0 tx=0x7fedf405cb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf259c700 1 --2- 172.21.15.63:0/917681803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedd800bf70 0x7fedd800c350 secure :-1 s=THROTTLE_DONE pgs=1729 cs=0 l=1 rx=0x7fedec0017a0 tx=0x7fedf405cb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf159a700 1 -- 172.21.15.63:0/917681803 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedec005e20 con 0x7fedd800bf70 2020-05-18T21:35:33.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf159a700 1 -- 172.21.15.63:0/917681803 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedec004d60 con 0x7fedd800bf70 2020-05-18T21:35:33.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf159a700 1 -- 172.21.15.63:0/917681803 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedec005180 con 0x7fedd800bf70 2020-05-18T21:35:33.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf8eb0700 1 -- 172.21.15.63:0/917681803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedd800bf70 msgr2=0x7fedd800c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:33.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf8eb0700 1 --2- 172.21.15.63:0/917681803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedd800bf70 0x7fedd800c350 secure :-1 s=READY pgs=1729 cs=0 l=1 rx=0x7fedec0017a0 tx=0x7fedf405cb00).stop 2020-05-18T21:35:33.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf2d9d700 1 -- 172.21.15.63:0/917681803 reap_dead start 2020-05-18T21:35:33.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf8eb0700 1 -- 172.21.15.63:0/917681803 shutdown_connections 2020-05-18T21:35:33.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf8eb0700 1 -- 172.21.15.63:0/917681803 >> 172.21.15.63:0/917681803 conn(0x7fedf405b290 msgr2=0x7fedf40b86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:33.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf8eb0700 1 -- 172.21.15.63:0/917681803 shutdown_connections 2020-05-18T21:35:33.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.122+0000 7fedf8eb0700 1 -- 172.21.15.63:0/917681803 wait complete. 2020-05-18T21:35:33.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.126+0000 7fedf8eb0700 1 Processor -- start 2020-05-18T21:35:33.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.126+0000 7fedf8eb0700 1 -- start start 2020-05-18T21:35:33.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.126+0000 7fedf8eb0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fedf41457b0 0x7fedf412d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:33.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.126+0000 7fedf8eb0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fedf4129240 0x7fedf4153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:33.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.126+0000 7fedf8eb0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf4152ff0 con 0x7fedf4153b90 2020-05-18T21:35:33.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.126+0000 7fedf8eb0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf4153290 con 0x7fedf41457b0 2020-05-18T21:35:33.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.126+0000 7fedf8eb0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf4145b90 con 0x7fedf4129240 2020-05-18T21:35:33.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.126+0000 7fedf259c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fedf41457b0 0x7fedf412d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:33.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.126+0000 7fedf259c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fedf41457b0 0x7fedf412d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34112/0 (socket says 172.21.15.63:34112) 2020-05-18T21:35:33.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.126+0000 7fedf259c700 1 -- 172.21.15.63:0/2446191668 learned_addr learned my addr 172.21.15.63:0/2446191668 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:33.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.130+0000 7fedf259c700 1 -- 172.21.15.63:0/2446191668 >> v2:172.21.15.155:3300/0 conn(0x7fedf4129240 msgr2=0x7fedf4153730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-05-18T21:35:33.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.130+0000 7fedf1d9b700 1 --2- 172.21.15.63:0/2446191668 >> v2:172.21.15.155:3300/0 conn(0x7fedf4129240 0x7fedf4153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:33.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.130+0000 7fedf259c700 1 --2- 172.21.15.63:0/2446191668 >> v2:172.21.15.155:3300/0 conn(0x7fedf4129240 0x7fedf4153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:33.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.130+0000 7fedf259c700 1 -- 172.21.15.63:0/2446191668 >> v1:172.21.15.63:6789/0 conn(0x7fedf4153b90 legacy=0x7fedf412a6e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-05-18T21:35:33.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.130+0000 7fedf259c700 1 -- 172.21.15.63:0/2446191668 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf4128f30 con 0x7fedf41457b0 2020-05-18T21:35:33.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.130+0000 7fedf259c700 1 --2- 172.21.15.63:0/2446191668 >> v2:172.21.15.63:3300/0 conn(0x7fedf41457b0 0x7fedf412d0e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fedf412b610 tx=0x7fedf405cb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.130+0000 7fedf259c700 1 --2- 172.21.15.63:0/2446191668 >> v2:172.21.15.63:3300/0 conn(0x7fedf41457b0 0x7fedf412d0e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fedf412b610 tx=0x7fedf405cb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.130+0000 7fedf259c700 1 --2- 172.21.15.63:0/2446191668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedf41457b0 0x7fedf412d0e0 secure :-1 s=READY pgs=1731 cs=0 l=1 rx=0x7fedf412b610 tx=0x7fedf405cb00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:33.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.130+0000 7fedf1d9b700 1 --2- 172.21.15.63:0/2446191668 >> v2:172.21.15.155:3300/0 conn(0x7fedf4129240 0x7fedf4153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:35:33.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.130+0000 7fedf259c700 1 --2- 172.21.15.63:0/2446191668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedf41457b0 0x7fedf412d0e0 secure :-1 s=THROTTLE_DONE pgs=1731 cs=0 l=1 rx=0x7fedf412b610 tx=0x7fedf405cb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.130+0000 7fedf259c700 1 --2- 172.21.15.63:0/2446191668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedf41457b0 0x7fedf412d0e0 secure :-1 s=THROTTLE_DONE pgs=1731 cs=0 l=1 rx=0x7fedf412b610 tx=0x7fedf405cb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.130+0000 7fedf259c700 1 --2- 172.21.15.63:0/2446191668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedf41457b0 0x7fedf412d0e0 secure :-1 s=THROTTLE_DONE pgs=1731 cs=0 l=1 rx=0x7fedf412b610 tx=0x7fedf405cb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.130+0000 7fede37fe700 1 -- 172.21.15.63:0/2446191668 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedec00cdb0 con 0x7fedf41457b0 2020-05-18T21:35:33.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.130+0000 7fede37fe700 1 -- 172.21.15.63:0/2446191668 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedec004f70 con 0x7fedf41457b0 2020-05-18T21:35:33.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.130+0000 7fede37fe700 1 -- 172.21.15.63:0/2446191668 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedec0052d0 con 0x7fedf41457b0 2020-05-18T21:35:33.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.130+0000 7fedf8eb0700 1 -- 172.21.15.63:0/2446191668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf412adf0 con 0x7fedf41457b0 2020-05-18T21:35:33.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.130+0000 7fedf8eb0700 1 -- 172.21.15.63:0/2446191668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf4146360 con 0x7fedf41457b0 2020-05-18T21:35:33.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.130+0000 7fedf259c700 1 --2- 172.21.15.63:0/2446191668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedf41457b0 0x7fedf412d0e0 secure :-1 s=THROTTLE_DONE pgs=1731 cs=0 l=1 rx=0x7fedf412b610 tx=0x7fedf405cb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.134+0000 7fede37fe700 1 -- 172.21.15.63:0/2446191668 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fedec005430 con 0x7fedf41457b0 2020-05-18T21:35:33.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.134+0000 7fedf259c700 1 --2- 172.21.15.63:0/2446191668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedf41457b0 0x7fedf412d0e0 secure :-1 s=THROTTLE_DONE pgs=1731 cs=0 l=1 rx=0x7fedf412b610 tx=0x7fedf405cb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.134+0000 7fede37fe700 1 --2- 172.21.15.63:0/2446191668 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fedd004f980 0x7fedd0051e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:33.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.134+0000 7fede37fe700 1 -- 172.21.15.63:0/2446191668 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fedec0645b0 con 0x7fedf41457b0 2020-05-18T21:35:33.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.134+0000 7fedf1d9b700 1 --2- 172.21.15.63:0/2446191668 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fedd004f980 0x7fedd0051e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:33.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.134+0000 7fedf1d9b700 1 --2- 172.21.15.63:0/2446191668 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fedd004f980 0x7fedd0051e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fede4001020 tx=0x7fede4001b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.134+0000 7fedf8eb0700 1 -- 172.21.15.63:0/2446191668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf412d540 con 0x7fedf41457b0 2020-05-18T21:35:33.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.134+0000 7fedf1d9b700 1 --2- 172.21.15.63:0/2446191668 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fedd004f980 0x7fedd0051e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fede4001020 tx=0x7fede4001b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.134+0000 7fedf1d9b700 1 --2- 172.21.15.63:0/2446191668 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fedd004f980 0x7fedd0051e40 secure :-1 s=READY pgs=669 cs=0 l=1 rx=0x7fede4001020 tx=0x7fede4001b30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:33.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.138+0000 7fedf259c700 1 --2- 172.21.15.63:0/2446191668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedf41457b0 0x7fedf412d0e0 secure :-1 s=THROTTLE_DONE pgs=1731 cs=0 l=1 rx=0x7fedf412b610 tx=0x7fedf405cb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.138+0000 7fede37fe700 1 -- 172.21.15.63:0/2446191668 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fedec03ea60 con 0x7fedf41457b0 2020-05-18T21:35:33.391 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:35:33.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.410+0000 7fedf8eb0700 1 -- 172.21.15.63:0/2446191668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedf40569e0 con 0x7fedf41457b0 2020-05-18T21:35:33.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.410+0000 7fedf259c700 1 --2- 172.21.15.63:0/2446191668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedf41457b0 0x7fedf412d0e0 secure :-1 s=THROTTLE_DONE pgs=1731 cs=0 l=1 rx=0x7fedf412b610 tx=0x7fedf405cb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.410+0000 7fede37fe700 1 -- 172.21.15.63:0/2446191668 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fedec042080 con 0x7fedf41457b0 2020-05-18T21:35:33.417 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:33.417 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":98,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/3483934102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3483934102},{"type":"v1","addr":"172.21.15.155:6835","nonce":3483934102}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":98}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:34:27.767123+0000","modified":"2020-05-18T21:34:41.281280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"a","rank":0,"incarnation":94,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6833/1314928434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1314928434},{"type":"v1","addr":"172.21.15.63:6833","nonce":1314928434}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-05-18T21:35:33.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.418+0000 7fedf8eb0700 1 -- 172.21.15.63:0/2446191668 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fedd004f980 msgr2=0x7fedd0051e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:33.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.418+0000 7fedf8eb0700 1 --2- 172.21.15.63:0/2446191668 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fedd004f980 0x7fedd0051e40 secure :-1 s=READY pgs=669 cs=0 l=1 rx=0x7fede4001020 tx=0x7fede4001b30).stop 2020-05-18T21:35:33.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.418+0000 7fedf8eb0700 1 -- 172.21.15.63:0/2446191668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedf41457b0 msgr2=0x7fedf412d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:33.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.418+0000 7fedf8eb0700 1 --2- 172.21.15.63:0/2446191668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedf41457b0 0x7fedf412d0e0 secure :-1 s=READY pgs=1731 cs=0 l=1 rx=0x7fedf412b610 tx=0x7fedf405cb00).stop 2020-05-18T21:35:33.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.418+0000 7fedf8eb0700 1 -- 172.21.15.63:0/2446191668 shutdown_connections 2020-05-18T21:35:33.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.418+0000 7fedf8eb0700 1 --2- 172.21.15.63:0/2446191668 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fedd004f980 0x7fedd0051e40 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:33.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.418+0000 7fedf8eb0700 1 --2- 172.21.15.63:0/2446191668 >> v2:172.21.15.155:3300/0 conn(0x7fedf4129240 0x7fedf4153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:33.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.418+0000 7fedf8eb0700 1 --2- 172.21.15.63:0/2446191668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedf41457b0 0x7fedf412d0e0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:33.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.418+0000 7fedf8eb0700 1 -- 172.21.15.63:0/2446191668 >> 172.21.15.63:0/2446191668 conn(0x7fedf405b290 msgr2=0x7fedf40b5080 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:33.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.418+0000 7fedf8eb0700 1 -- 172.21.15.63:0/2446191668 shutdown_connections 2020-05-18T21:35:33.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.418+0000 7fedf8eb0700 1 -- 172.21.15.63:0/2446191668 wait complete. 2020-05-18T21:35:33.425 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 98 2020-05-18T21:35:33.440 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2020-05-18T21:35:33.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.530+0000 7f18c7583700 1 Processor -- start 2020-05-18T21:35:33.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.530+0000 7f18c7583700 1 -- start start 2020-05-18T21:35:33.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.534+0000 7f18c7583700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f18c0141970 0x7f18c00b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:33.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.534+0000 7f18c7583700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c00b4010 con 0x7f18c005fbf0 2020-05-18T21:35:33.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.534+0000 7f18c7583700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c00b42b0 con 0x7f18c00b49f0 2020-05-18T21:35:33.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.534+0000 7f18c7583700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c00b4550 con 0x7f18c0141970 2020-05-18T21:35:33.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.534+0000 7f18c531f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f18c0141970 0x7f18c00b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:33.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.534+0000 7f18c531f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f18c0141970 0x7f18c00b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34120/0 (socket says 172.21.15.63:34120) 2020-05-18T21:35:33.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.534+0000 7f18c531f700 1 -- 172.21.15.63:0/715085976 learned_addr learned my addr 172.21.15.63:0/715085976 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:33.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.534+0000 7f18c531f700 1 -- 172.21.15.63:0/715085976 >> v1:172.21.15.155:6789/0 conn(0x7f18c00b49f0 legacy=0x7f18c0141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:33.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.534+0000 7f18c531f700 1 -- 172.21.15.63:0/715085976 >> v1:172.21.15.63:6789/0 conn(0x7f18c005fbf0 legacy=0x7f18c005eb50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-05-18T21:35:33.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.534+0000 7f18c531f700 1 -- 172.21.15.63:0/715085976 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c00b4ea0 con 0x7f18c0141970 2020-05-18T21:35:33.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.534+0000 7f18c531f700 1 --2- 172.21.15.63:0/715085976 >> v2:172.21.15.63:3300/0 conn(0x7f18c0141970 0x7f18c00b3ac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f18b80032f0 tx=0x7f18b800a660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.534+0000 7f18c531f700 1 --2- 172.21.15.63:0/715085976 >> v2:172.21.15.63:3300/0 conn(0x7f18c0141970 0x7f18c00b3ac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f18b80032f0 tx=0x7f18b800a660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.534+0000 7f18c531f700 1 --2- 172.21.15.63:0/715085976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c0141970 0x7f18c00b3ac0 secure :-1 s=READY pgs=1733 cs=0 l=1 rx=0x7f18b80032f0 tx=0x7f18b800a660).ready entity=mon.0 client_cookie=4eddac483b3dfc4e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:33.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.534+0000 7f18c531f700 1 --2- 172.21.15.63:0/715085976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c0141970 0x7f18c00b3ac0 secure :-1 s=THROTTLE_DONE pgs=1733 cs=0 l=1 rx=0x7f18b80032f0 tx=0x7f18b800a660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.534+0000 7f18c531f700 1 --2- 172.21.15.63:0/715085976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c0141970 0x7f18c00b3ac0 secure :-1 s=THROTTLE_DONE pgs=1733 cs=0 l=1 rx=0x7f18b80032f0 tx=0x7f18b800a660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.534+0000 7f18c531f700 1 --2- 172.21.15.63:0/715085976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c0141970 0x7f18c00b3ac0 secure :-1 s=THROTTLE_DONE pgs=1733 cs=0 l=1 rx=0x7f18b80032f0 tx=0x7f18b800a660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.546+0000 7f18affff700 1 -- 172.21.15.63:0/715085976 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18b800ee20 con 0x7f18c0141970 2020-05-18T21:35:33.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.546+0000 7f18affff700 1 -- 172.21.15.63:0/715085976 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b8010180 con 0x7f18c0141970 2020-05-18T21:35:33.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.546+0000 7f18affff700 1 -- 172.21.15.63:0/715085976 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18b8010560 con 0x7f18c0141970 2020-05-18T21:35:33.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.546+0000 7f18c7583700 1 -- 172.21.15.63:0/715085976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c0141970 msgr2=0x7f18c00b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:33.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.546+0000 7f18c7583700 1 --2- 172.21.15.63:0/715085976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c0141970 0x7f18c00b3ac0 secure :-1 s=READY pgs=1733 cs=0 l=1 rx=0x7f18b80032f0 tx=0x7f18b800a660).stop 2020-05-18T21:35:33.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.546+0000 7f18c7583700 1 -- 172.21.15.63:0/715085976 shutdown_connections 2020-05-18T21:35:33.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.546+0000 7f18c7583700 1 --2- 172.21.15.63:0/715085976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c0141970 0x7f18c00b3ac0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:33.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.546+0000 7f18c7583700 1 -- 172.21.15.63:0/715085976 >> 172.21.15.63:0/715085976 conn(0x7f18c005b290 msgr2=0x7f18c00b86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:33.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.546+0000 7f18c7583700 1 -- 172.21.15.63:0/715085976 shutdown_connections 2020-05-18T21:35:33.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.546+0000 7f18c7583700 1 -- 172.21.15.63:0/715085976 wait complete. 2020-05-18T21:35:33.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.550+0000 7f18c7583700 1 Processor -- start 2020-05-18T21:35:33.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.550+0000 7f18c7583700 1 -- start start 2020-05-18T21:35:33.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.550+0000 7f18c7583700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f18c00b49f0 0x7f18c0112a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:33.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.550+0000 7f18c7583700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f18c0141970 0x7f18c00b8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:33.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.550+0000 7f18c7583700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c0153730 con 0x7f18c005fbf0 2020-05-18T21:35:33.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.550+0000 7f18c7583700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c0145200 con 0x7f18c0141970 2020-05-18T21:35:33.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.550+0000 7f18c7583700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c0157020 con 0x7f18c00b49f0 2020-05-18T21:35:33.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.550+0000 7f18c4b1e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f18c00b49f0 0x7f18c0112a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:33.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.550+0000 7f18c4b1e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f18c00b49f0 0x7f18c0112a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:48974/0 (socket says 172.21.15.63:48974) 2020-05-18T21:35:33.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.550+0000 7f18c4b1e700 1 -- 172.21.15.63:0/3681120449 learned_addr learned my addr 172.21.15.63:0/3681120449 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:33.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.550+0000 7f18c5b20700 1 --2- 172.21.15.63:0/3681120449 >> v2:172.21.15.63:3300/0 conn(0x7f18c0141970 0x7f18c00b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:33.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.550+0000 7f18ae7fc700 1 -- 172.21.15.63:0/3681120449 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123247430 0 0) 0x7f18c0153730 con 0x7f18c005fbf0 2020-05-18T21:35:33.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.550+0000 7f18ae7fc700 1 -- 172.21.15.63:0/3681120449 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18a8001e60 con 0x7f18c005fbf0 2020-05-18T21:35:33.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.550+0000 7f18c4b1e700 1 -- 172.21.15.63:0/3681120449 >> v2:172.21.15.63:3300/0 conn(0x7f18c0141970 msgr2=0x7f18c00b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:33.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.550+0000 7f18c4b1e700 1 --2- 172.21.15.63:0/3681120449 >> v2:172.21.15.63:3300/0 conn(0x7f18c0141970 0x7f18c00b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:33.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.550+0000 7f18c4b1e700 1 -- 172.21.15.63:0/3681120449 >> v1:172.21.15.63:6789/0 conn(0x7f18c005fbf0 legacy=0x7f18c0153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:33.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.550+0000 7f18c4b1e700 1 -- 172.21.15.63:0/3681120449 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c01447a0 con 0x7f18c00b49f0 2020-05-18T21:35:33.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.550+0000 7f18c4b1e700 1 --2- 172.21.15.63:0/3681120449 >> v2:172.21.15.155:3300/0 conn(0x7f18c00b49f0 0x7f18c0112a00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18c01140a0 tx=0x7f18bc001e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.554+0000 7f18c4b1e700 1 --2- 172.21.15.63:0/3681120449 >> v2:172.21.15.155:3300/0 conn(0x7f18c00b49f0 0x7f18c0112a00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18c01140a0 tx=0x7f18bc001e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.554+0000 7f18c4b1e700 1 --2- 172.21.15.63:0/3681120449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18c00b49f0 0x7f18c0112a00 secure :-1 s=READY pgs=1140 cs=0 l=1 rx=0x7f18c01140a0 tx=0x7f18bc001e70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:33.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.554+0000 7f18c4b1e700 1 --2- 172.21.15.63:0/3681120449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18c00b49f0 0x7f18c0112a00 secure :-1 s=THROTTLE_DONE pgs=1140 cs=0 l=1 rx=0x7f18c01140a0 tx=0x7f18bc001e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.554+0000 7f18ae7fc700 1 -- 172.21.15.63:0/3681120449 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18bc00cc30 con 0x7f18c00b49f0 2020-05-18T21:35:33.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.554+0000 7f18c4b1e700 1 --2- 172.21.15.63:0/3681120449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18c00b49f0 0x7f18c0112a00 secure :-1 s=THROTTLE_DONE pgs=1140 cs=0 l=1 rx=0x7f18c01140a0 tx=0x7f18bc001e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.554+0000 7f18c4b1e700 1 --2- 172.21.15.63:0/3681120449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18c00b49f0 0x7f18c0112a00 secure :-1 s=THROTTLE_DONE pgs=1140 cs=0 l=1 rx=0x7f18c01140a0 tx=0x7f18bc001e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.554+0000 7f18ae7fc700 1 -- 172.21.15.63:0/3681120449 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18bc00cd90 con 0x7f18c00b49f0 2020-05-18T21:35:33.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.554+0000 7f18ae7fc700 1 -- 172.21.15.63:0/3681120449 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18bc011100 con 0x7f18c00b49f0 2020-05-18T21:35:33.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.554+0000 7f18c7583700 1 -- 172.21.15.63:0/3681120449 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c0144dd0 con 0x7f18c00b49f0 2020-05-18T21:35:33.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.554+0000 7f18c7583700 1 -- 172.21.15.63:0/3681120449 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c00b8a00 con 0x7f18c00b49f0 2020-05-18T21:35:33.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.554+0000 7f18c7583700 1 -- 172.21.15.63:0/3681120449 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c0156e30 con 0x7f18c00b49f0 2020-05-18T21:35:33.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.554+0000 7f18c4b1e700 1 --2- 172.21.15.63:0/3681120449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18c00b49f0 0x7f18c0112a00 secure :-1 s=THROTTLE_DONE pgs=1140 cs=0 l=1 rx=0x7f18c01140a0 tx=0x7f18bc001e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.554+0000 7f18ae7fc700 1 -- 172.21.15.63:0/3681120449 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f18bc006520 con 0x7f18c00b49f0 2020-05-18T21:35:33.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.554+0000 7f18c4b1e700 1 --2- 172.21.15.63:0/3681120449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18c00b49f0 0x7f18c0112a00 secure :-1 s=THROTTLE_DONE pgs=1140 cs=0 l=1 rx=0x7f18c01140a0 tx=0x7f18bc001e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.554+0000 7f18ae7fc700 1 --2- 172.21.15.63:0/3681120449 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f18a804fe60 0x7f18a8052320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:33.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.554+0000 7f18ae7fc700 1 -- 172.21.15.63:0/3681120449 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f18bc063680 con 0x7f18c00b49f0 2020-05-18T21:35:33.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.558+0000 7f18c531f700 1 --2- 172.21.15.63:0/3681120449 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f18a804fe60 0x7f18a8052320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:33.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.558+0000 7f18c531f700 1 --2- 172.21.15.63:0/3681120449 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f18a804fe60 0x7f18a8052320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18b80091f0 tx=0x7f18b800a660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.558+0000 7f18c531f700 1 --2- 172.21.15.63:0/3681120449 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f18a804fe60 0x7f18a8052320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18b80091f0 tx=0x7f18b800a660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.558+0000 7f18c531f700 1 --2- 172.21.15.63:0/3681120449 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f18a804fe60 0x7f18a8052320 secure :-1 s=READY pgs=670 cs=0 l=1 rx=0x7f18b80091f0 tx=0x7f18b800a660).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:33.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.562+0000 7f18c4b1e700 1 --2- 172.21.15.63:0/3681120449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18c00b49f0 0x7f18c0112a00 secure :-1 s=THROTTLE_DONE pgs=1140 cs=0 l=1 rx=0x7f18c01140a0 tx=0x7f18bc001e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.562+0000 7f18ae7fc700 1 -- 172.21.15.63:0/3681120449 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f18bc03da10 con 0x7f18c00b49f0 2020-05-18T21:35:33.622 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:35:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-0": { 2020-05-18T21:35:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 740, 2020-05-18T21:35:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 741, 2020-05-18T21:35:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 377235, 2020-05-18T21:35:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 422803, 2020-05-18T21:35:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 6, 2020-05-18T21:35:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 1, 2020-05-18T21:35:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.058684480, 2020-05-18T21:35:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.016483343, 2020-05-18T21:35:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.024593894, 2020-05-18T21:35:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.017193479, 2020-05-18T21:35:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 741, 2020-05-18T21:35:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.073251771, 2020-05-18T21:35:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000098855 2020-05-18T21:35:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-1": { 2020-05-18T21:35:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 1770, 2020-05-18T21:35:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 1784, 2020-05-18T21:35:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 417819, 2020-05-18T21:35:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 7396529, 2020-05-18T21:35:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 6, 2020-05-18T21:35:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 3, 2020-05-18T21:35:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.216430465, 2020-05-18T21:35:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.084529432, 2020-05-18T21:35:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.048808828, 2020-05-18T21:35:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.069135045, 2020-05-18T21:35:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1784, 2020-05-18T21:35:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.105915648, 2020-05-18T21:35:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000059369 2020-05-18T21:35:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-2": { 2020-05-18T21:35:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 11720, 2020-05-18T21:35:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 21759, 2020-05-18T21:35:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 3435730, 2020-05-18T21:35:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 21201561, 2020-05-18T21:35:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 6, 2020-05-18T21:35:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 3, 2020-05-18T21:35:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 1.846666040, 2020-05-18T21:35:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.888767012, 2020-05-18T21:35:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.979761611, 2020-05-18T21:35:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.121667185, 2020-05-18T21:35:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 21758, 2020-05-18T21:35:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 1.034864892, 2020-05-18T21:35:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000047562 2020-05-18T21:35:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 24770, 2020-05-18T21:35:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.008673663, 2020-05-18T21:35:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000350 2020-05-18T21:35:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "cct": { 2020-05-18T21:35:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "total_workers": 1, 2020-05-18T21:35:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "unhealthy_workers": 0 2020-05-18T21:35:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-MDSRank": { 2020-05-18T21:35:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2020-05-18T21:35:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2020-05-18T21:35:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 6439, 2020-05-18T21:35:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 4.376196531, 2020-05-18T21:35:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000679639 2020-05-18T21:35:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-PurgeQueue": { 2020-05-18T21:35:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2020-05-18T21:35:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2020-05-18T21:35:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 2048, 2020-05-18T21:35:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.390648728, 2020-05-18T21:35:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000190746 2020-05-18T21:35:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2020-05-18T21:35:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "request": 3277, 2020-05-18T21:35:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "reply": 3275, 2020-05-18T21:35:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "reply_latency": { 2020-05-18T21:35:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 3275, 2020-05-18T21:35:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 6.266216007, 2020-05-18T21:35:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001913348 2020-05-18T21:35:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "forward": 0, 2020-05-18T21:35:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_fetch": 12, 2020-05-18T21:35:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_commit": 73, 2020-05-18T21:35:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_split": 9, 2020-05-18T21:35:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_merge": 0, 2020-05-18T21:35:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes": 374, 2020-05-18T21:35:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_top": 0, 2020-05-18T21:35:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_bottom": 374, 2020-05-18T21:35:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pin_tail": 0, 2020-05-18T21:35:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pinned": 374, 2020-05-18T21:35:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_expired": 0, 2020-05-18T21:35:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_with_caps": 310, 2020-05-18T21:35:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": 310, 2020-05-18T21:35:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "subtrees": 2, 2020-05-18T21:35:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse": 3278, 2020-05-18T21:35:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_hit": 3276, 2020-05-18T21:35:33.652 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_forward": 0, 2020-05-18T21:35:33.652 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_discover": 0, 2020-05-18T21:35:33.652 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_dir_fetch": 0, 2020-05-18T21:35:33.652 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_remote_ino": 0, 2020-05-18T21:35:33.652 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_lock": 0, 2020-05-18T21:35:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: "load_cent": 223899, 2020-05-18T21:35:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: "q": 0, 2020-05-18T21:35:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: "exported": 0, 2020-05-18T21:35:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: "exported_inodes": 0, 2020-05-18T21:35:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: "imported": 0, 2020-05-18T21:35:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "imported_inodes": 0, 2020-05-18T21:35:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_dir_fetch": 0, 2020-05-18T21:35:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_backtrace_fetch": 0, 2020-05-18T21:35:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_peer_discover": 0, 2020-05-18T21:35:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rfiles": 363, 2020-05-18T21:35:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rbytes": 2946498560, 2020-05-18T21:35:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rsnaps": 0 2020-05-18T21:35:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:35:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays": 309, 2020-05-18T21:35:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_delayed": 0, 2020-05-18T21:35:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:35:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_created": 1601, 2020-05-18T21:35:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 1292, 2020-05-18T21:35:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_reintegrated": 0, 2020-05-18T21:35:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_migrated": 0, 2020-05-18T21:35:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_processing": 0, 2020-05-18T21:35:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:35:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:35:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_started": 0, 2020-05-18T21:35:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_completed": 0, 2020-05-18T21:35:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:35:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_exportdir": 0, 2020-05-18T21:35:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_flush": 0, 2020-05-18T21:35:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragmentdir": 9, 2020-05-18T21:35:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragstats": 0, 2020-05-18T21:35:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_inodestats": 0 2020-05-18T21:35:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log": { 2020-05-18T21:35:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "evadd": 9734, 2020-05-18T21:35:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "evex": 0, 2020-05-18T21:35:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "evtrm": 0, 2020-05-18T21:35:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "ev": 9736, 2020-05-18T21:35:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "evexg": 0, 2020-05-18T21:35:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "evexd": 0, 2020-05-18T21:35:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "segadd": 12, 2020-05-18T21:35:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "segex": 0, 2020-05-18T21:35:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "segtrm": 0, 2020-05-18T21:35:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "seg": 13, 2020-05-18T21:35:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "segexg": 0, 2020-05-18T21:35:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "segexd": 0, 2020-05-18T21:35:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "expos": 4194304, 2020-05-18T21:35:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "wrpos": 23085414, 2020-05-18T21:35:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "rdpos": 4195196, 2020-05-18T21:35:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "jlat": { 2020-05-18T21:35:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 3625, 2020-05-18T21:35:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 19.707301110, 2020-05-18T21:35:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.005436496 2020-05-18T21:35:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "replayed": 2 2020-05-18T21:35:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_mem": { 2020-05-18T21:35:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 377, 2020-05-18T21:35:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "ino+": 1614, 2020-05-18T21:35:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "ino-": 1237, 2020-05-18T21:35:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "dir": 76, 2020-05-18T21:35:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "dir+": 85, 2020-05-18T21:35:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "dir-": 9, 2020-05-18T21:35:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "dn": 1975, 2020-05-18T21:35:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "dn+": 3212, 2020-05-18T21:35:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "dn-": 1237, 2020-05-18T21:35:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "cap": 310, 2020-05-18T21:35:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: "cap+": 1602, 2020-05-18T21:35:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: "cap-": 1292, 2020-05-18T21:35:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: "rss": 90464, 2020-05-18T21:35:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: "heap": 331932 2020-05-18T21:35:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_server": { 2020-05-18T21:35:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_client_request": 3351, 2020-05-18T21:35:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_server_request": 0, 2020-05-18T21:35:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_request": 3277, 2020-05-18T21:35:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_session": 3, 2020-05-18T21:35:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_slave_request": 0, 2020-05-18T21:35:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "req_create_latency": { 2020-05-18T21:35:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1600, 2020-05-18T21:35:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 2.331516366, 2020-05-18T21:35:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001457197 2020-05-18T21:35:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getattr_latency": { 2020-05-18T21:35:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 2, 2020-05-18T21:35:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000941751, 2020-05-18T21:35:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000470875 2020-05-18T21:35:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getfilelock_latency": { 2020-05-18T21:35:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.671 INFO:teuthology.orchestra.run.smithi063.stdout: "req_link_latency": { 2020-05-18T21:35:33.671 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.671 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.671 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.671 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookup_latency": { 2020-05-18T21:35:33.672 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:33.672 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.001560520, 2020-05-18T21:35:33.672 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001560520 2020-05-18T21:35:33.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.672 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookuphash_latency": { 2020-05-18T21:35:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupino_latency": { 2020-05-18T21:35:33.674 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.674 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.674 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.675 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupname_latency": { 2020-05-18T21:35:33.675 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.675 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.675 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.676 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupparent_latency": { 2020-05-18T21:35:33.676 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.676 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupsnap_latency": { 2020-05-18T21:35:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lssnap_latency": { 2020-05-18T21:35:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mkdir_latency": { 2020-05-18T21:35:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.004721025, 2020-05-18T21:35:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.004721025 2020-05-18T21:35:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.680 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mknod_latency": { 2020-05-18T21:35:33.680 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.680 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.680 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.681 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mksnap_latency": { 2020-05-18T21:35:33.681 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.681 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.681 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.681 INFO:teuthology.orchestra.run.smithi063.stdout: "req_open_latency": { 2020-05-18T21:35:33.682 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.682 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.682 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.682 INFO:teuthology.orchestra.run.smithi063.stdout: "req_readdir_latency": { 2020-05-18T21:35:33.683 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 70, 2020-05-18T21:35:33.683 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.134635846, 2020-05-18T21:35:33.683 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001923369 2020-05-18T21:35:33.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.684 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rename_latency": { 2020-05-18T21:35:33.684 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.684 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.684 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.684 INFO:teuthology.orchestra.run.smithi063.stdout: "req_renamesnap_latency": { 2020-05-18T21:35:33.685 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.685 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.685 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.685 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmdir_latency": { 2020-05-18T21:35:33.686 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:33.686 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.451035564, 2020-05-18T21:35:33.686 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.451035564 2020-05-18T21:35:33.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.687 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmsnap_latency": { 2020-05-18T21:35:33.687 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.687 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.687 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.688 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmxattr_latency": { 2020-05-18T21:35:33.688 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.688 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.688 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.688 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setattr_latency": { 2020-05-18T21:35:33.689 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.689 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.689 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.689 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setdirlayout_latency": { 2020-05-18T21:35:33.690 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.690 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.690 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.691 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setfilelock_latency": { 2020-05-18T21:35:33.691 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.691 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.691 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.691 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setlayout_latency": { 2020-05-18T21:35:33.692 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.692 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.692 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.692 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setxattr_latency": { 2020-05-18T21:35:33.692 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.693 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.693 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.693 INFO:teuthology.orchestra.run.smithi063.stdout: "req_symlink_latency": { 2020-05-18T21:35:33.693 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.694 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.694 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.694 INFO:teuthology.orchestra.run.smithi063.stdout: "req_unlink_latency": { 2020-05-18T21:35:33.694 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1600, 2020-05-18T21:35:33.694 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 3.341804935, 2020-05-18T21:35:33.695 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.002088628 2020-05-18T21:35:33.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.695 INFO:teuthology.orchestra.run.smithi063.stdout: "cap_revoke_eviction": 0 2020-05-18T21:35:33.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.695 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_sessions": { 2020-05-18T21:35:33.696 INFO:teuthology.orchestra.run.smithi063.stdout: "session_count": 1, 2020-05-18T21:35:33.696 INFO:teuthology.orchestra.run.smithi063.stdout: "session_add": 1, 2020-05-18T21:35:33.696 INFO:teuthology.orchestra.run.smithi063.stdout: "session_remove": 0, 2020-05-18T21:35:33.696 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_open": 1, 2020-05-18T21:35:33.696 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_stale": 0, 2020-05-18T21:35:33.697 INFO:teuthology.orchestra.run.smithi063.stdout: "total_load": 2752, 2020-05-18T21:35:33.697 INFO:teuthology.orchestra.run.smithi063.stdout: "average_load": 2752, 2020-05-18T21:35:33.697 INFO:teuthology.orchestra.run.smithi063.stdout: "avg_session_uptime": 903 2020-05-18T21:35:33.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.698 INFO:teuthology.orchestra.run.smithi063.stdout: "mempool": { 2020-05-18T21:35:33.698 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_bytes": 0, 2020-05-18T21:35:33.698 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_items": 0, 2020-05-18T21:35:33.698 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_bytes": 0, 2020-05-18T21:35:33.699 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_items": 0, 2020-05-18T21:35:33.699 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_bytes": 0, 2020-05-18T21:35:33.699 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_items": 0, 2020-05-18T21:35:33.699 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_bytes": 0, 2020-05-18T21:35:33.699 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_items": 0, 2020-05-18T21:35:33.699 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_bytes": 0, 2020-05-18T21:35:33.700 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_items": 0, 2020-05-18T21:35:33.700 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_bytes": 0, 2020-05-18T21:35:33.700 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_items": 0, 2020-05-18T21:35:33.700 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_bytes": 0, 2020-05-18T21:35:33.700 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_items": 0, 2020-05-18T21:35:33.701 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_bytes": 0, 2020-05-18T21:35:33.701 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_items": 0, 2020-05-18T21:35:33.701 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_bytes": 0, 2020-05-18T21:35:33.701 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_items": 0, 2020-05-18T21:35:33.701 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_bytes": 0, 2020-05-18T21:35:33.701 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_items": 0, 2020-05-18T21:35:33.702 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_bytes": 1143439, 2020-05-18T21:35:33.702 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_items": 654, 2020-05-18T21:35:33.702 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_bytes": 88, 2020-05-18T21:35:33.702 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_items": 1, 2020-05-18T21:35:33.702 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bytes": 0, 2020-05-18T21:35:33.703 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_items": 0, 2020-05-18T21:35:33.703 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_bytes": 0, 2020-05-18T21:35:33.703 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_items": 0, 2020-05-18T21:35:33.703 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_bytes": 0, 2020-05-18T21:35:33.703 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_items": 0, 2020-05-18T21:35:33.703 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_bytes": 6128, 2020-05-18T21:35:33.704 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_items": 93, 2020-05-18T21:35:33.704 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_bytes": 0, 2020-05-18T21:35:33.704 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_items": 0, 2020-05-18T21:35:33.704 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_bytes": 0, 2020-05-18T21:35:33.704 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_items": 0, 2020-05-18T21:35:33.705 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_bytes": 6338269, 2020-05-18T21:35:33.705 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_items": 79913, 2020-05-18T21:35:33.705 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_bytes": 0, 2020-05-18T21:35:33.705 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_items": 0, 2020-05-18T21:35:33.705 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_bytes": 0, 2020-05-18T21:35:33.706 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_items": 0 2020-05-18T21:35:33.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.706 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter": { 2020-05-18T21:35:33.706 INFO:teuthology.orchestra.run.smithi063.stdout: "op_active": 9, 2020-05-18T21:35:33.706 INFO:teuthology.orchestra.run.smithi063.stdout: "op_laggy": 0, 2020-05-18T21:35:33.706 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send": 5581, 2020-05-18T21:35:33.707 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send_bytes": 19774090, 2020-05-18T21:35:33.707 INFO:teuthology.orchestra.run.smithi063.stdout: "op_resend": 0, 2020-05-18T21:35:33.707 INFO:teuthology.orchestra.run.smithi063.stdout: "op_reply": 5572, 2020-05-18T21:35:33.708 INFO:teuthology.orchestra.run.smithi063.stdout: "op": 5581, 2020-05-18T21:35:33.708 INFO:teuthology.orchestra.run.smithi063.stdout: "op_r": 33, 2020-05-18T21:35:33.708 INFO:teuthology.orchestra.run.smithi063.stdout: "op_w": 5548, 2020-05-18T21:35:33.708 INFO:teuthology.orchestra.run.smithi063.stdout: "op_rmw": 0, 2020-05-18T21:35:33.708 INFO:teuthology.orchestra.run.smithi063.stdout: "op_pg": 0, 2020-05-18T21:35:33.708 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_stat": 2, 2020-05-18T21:35:33.709 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_create": 0, 2020-05-18T21:35:33.709 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_read": 15, 2020-05-18T21:35:33.709 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_write": 3632, 2020-05-18T21:35:33.709 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writefull": 6, 2020-05-18T21:35:33.709 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writesame": 0, 2020-05-18T21:35:33.710 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_append": 0, 2020-05-18T21:35:33.710 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_zero": 1, 2020-05-18T21:35:33.710 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_truncate": 1, 2020-05-18T21:35:33.710 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_delete": 1824, 2020-05-18T21:35:33.710 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_mapext": 0, 2020-05-18T21:35:33.710 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_sparse_read": 0, 2020-05-18T21:35:33.711 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_clonerange": 0, 2020-05-18T21:35:33.711 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_getxattr": 14, 2020-05-18T21:35:33.711 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_setxattr": 0, 2020-05-18T21:35:33.711 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_cmpxattr": 0, 2020-05-18T21:35:33.711 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_rmxattr": 0, 2020-05-18T21:35:33.712 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_resetxattrs": 0, 2020-05-18T21:35:33.712 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_call": 0, 2020-05-18T21:35:33.712 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_watch": 0, 2020-05-18T21:35:33.712 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_notify": 0, 2020-05-18T21:35:33.712 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_src_cmpxattr": 0, 2020-05-18T21:35:33.712 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls": 0, 2020-05-18T21:35:33.713 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls_filter": 0, 2020-05-18T21:35:33.713 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_other": 0, 2020-05-18T21:35:33.713 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_active": 0, 2020-05-18T21:35:33.713 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_send": 0, 2020-05-18T21:35:33.713 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_resend": 0, 2020-05-18T21:35:33.714 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_ping": 0, 2020-05-18T21:35:33.714 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_active": 0, 2020-05-18T21:35:33.714 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_send": 0, 2020-05-18T21:35:33.714 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_resend": 0, 2020-05-18T21:35:33.714 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_active": 0, 2020-05-18T21:35:33.715 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_send": 0, 2020-05-18T21:35:33.715 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_resend": 0, 2020-05-18T21:35:33.715 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_active": 0, 2020-05-18T21:35:33.715 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_send": 0, 2020-05-18T21:35:33.715 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_resend": 0, 2020-05-18T21:35:33.716 INFO:teuthology.orchestra.run.smithi063.stdout: "command_active": 0, 2020-05-18T21:35:33.716 INFO:teuthology.orchestra.run.smithi063.stdout: "command_send": 0, 2020-05-18T21:35:33.716 INFO:teuthology.orchestra.run.smithi063.stdout: "command_resend": 0, 2020-05-18T21:35:33.716 INFO:teuthology.orchestra.run.smithi063.stdout: "map_epoch": 0, 2020-05-18T21:35:33.716 INFO:teuthology.orchestra.run.smithi063.stdout: "map_full": 0, 2020-05-18T21:35:33.716 INFO:teuthology.orchestra.run.smithi063.stdout: "map_inc": 0, 2020-05-18T21:35:33.717 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_sessions": 8, 2020-05-18T21:35:33.717 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_open": 8, 2020-05-18T21:35:33.717 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_close": 0, 2020-05-18T21:35:33.718 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_laggy": 0, 2020-05-18T21:35:33.718 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_wr": 167, 2020-05-18T21:35:33.718 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_rd": 28, 2020-05-18T21:35:33.718 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_del": 10 2020-05-18T21:35:33.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.719 INFO:teuthology.orchestra.run.smithi063.stdout: "oft": { 2020-05-18T21:35:33.719 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_objs": 0, 2020-05-18T21:35:33.719 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_kv_pairs": 0, 2020-05-18T21:35:33.719 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_updates": 0, 2020-05-18T21:35:33.719 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_removes": 0 2020-05-18T21:35:33.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.720 INFO:teuthology.orchestra.run.smithi063.stdout: "purge_queue": { 2020-05-18T21:35:33.720 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops": 17, 2020-05-18T21:35:33.720 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops_high_water": 22, 2020-05-18T21:35:33.720 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing": 6, 2020-05-18T21:35:33.721 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_high_water": 8, 2020-05-18T21:35:33.721 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executed": 778, 2020-05-18T21:35:33.721 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_item_in_journal": 516 2020-05-18T21:35:33.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.721 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-05-18T21:35:33.721 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:33.722 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2020-05-18T21:35:33.722 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:33.722 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 14228, 2020-05-18T21:35:33.722 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 3177158, 2020-05-18T21:35:33.722 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:33.723 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 14228, 2020-05-18T21:35:33.723 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:33.723 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:33.723 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 14228, 2020-05-18T21:35:33.723 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 3177158, 2020-05-18T21:35:33.724 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:33.724 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.724 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.725 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.725 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:33.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.725 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_bytes": { 2020-05-18T21:35:33.725 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:33.726 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2020-05-18T21:35:33.726 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:33.726 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2020-05-18T21:35:33.726 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2020-05-18T21:35:33.726 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:33.726 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2020-05-18T21:35:33.727 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 5581, 2020-05-18T21:35:33.727 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 19905688, 2020-05-18T21:35:33.727 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 3744, 2020-05-18T21:35:33.727 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 19905688, 2020-05-18T21:35:33.727 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:33.728 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.728 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.728 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.728 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:33.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.729 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_ops": { 2020-05-18T21:35:33.729 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 9, 2020-05-18T21:35:33.729 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 1024, 2020-05-18T21:35:33.729 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:33.730 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2020-05-18T21:35:33.730 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2020-05-18T21:35:33.730 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:33.730 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2020-05-18T21:35:33.730 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 5581, 2020-05-18T21:35:33.730 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 5581, 2020-05-18T21:35:33.731 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 5572, 2020-05-18T21:35:33.731 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 5572, 2020-05-18T21:35:33.731 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:33.731 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.731 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.732 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.732 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:33.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.732 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle": { 2020-05-18T21:35:33.732 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:33.732 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2020-05-18T21:35:33.733 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:33.733 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 1292, 2020-05-18T21:35:33.733 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 130492, 2020-05-18T21:35:33.733 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:33.733 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 1292, 2020-05-18T21:35:33.734 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:33.734 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:33.734 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 7, 2020-05-18T21:35:33.734 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 130492, 2020-05-18T21:35:33.734 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:33.734 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.735 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.735 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.735 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:33.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:33.735 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle-0x55eb89907c20": { 2020-05-18T21:35:33.736 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 35772, 2020-05-18T21:35:33.736 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2020-05-18T21:35:33.736 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:33.736 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 9734, 2020-05-18T21:35:33.736 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 18889780, 2020-05-18T21:35:33.736 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:33.737 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 9734, 2020-05-18T21:35:33.737 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:33.737 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:33.737 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 3625, 2020-05-18T21:35:33.737 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 18854008, 2020-05-18T21:35:33.738 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:33.738 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:33.738 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:33.738 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:33.739 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:33.739 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:33.739 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:35:33.740 INFO:tasks.cephfs.filesystem:_json_asok output: { "AsyncMessenger::Worker-0": { "msgr_recv_messages": 740, "msgr_send_messages": 741, "msgr_recv_bytes": 377235, "msgr_send_bytes": 422803, "msgr_created_connections": 6, "msgr_active_connections": 1, "msgr_running_total_time": 0.058684480, "msgr_running_send_time": 0.016483343, "msgr_running_recv_time": 0.024593894, "msgr_running_fast_dispatch_time": 0.017193479, "msgr_send_messages_queue_lat": { "avgcount": 741, "sum": 0.073251771, "avgtime": 0.000098855 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-1": { "msgr_recv_messages": 1770, "msgr_send_messages": 1784, "msgr_recv_bytes": 417819, "msgr_send_bytes": 7396529, "msgr_created_connections": 6, "msgr_active_connections": 3, "msgr_running_total_time": 0.216430465, "msgr_running_send_time": 0.084529432, "msgr_running_recv_time": 0.048808828, "msgr_running_fast_dispatch_time": 0.069135045, "msgr_send_messages_queue_lat": { "avgcount": 1784, "sum": 0.105915648, "avgtime": 0.000059369 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-2": { "msgr_recv_messages": 11720, "msgr_send_messages": 21759, "msgr_recv_bytes": 3435730, "msgr_send_bytes": 21201561, "msgr_created_connections": 6, "msgr_active_connections": 3, "msgr_running_total_time": 1.846666040, "msgr_running_send_time": 0.888767012, "msgr_running_recv_time": 0.979761611, "msgr_running_fast_dispatch_time": 0.121667185, "msgr_send_messages_queue_lat": { "avgcount": 21758, "sum": 1.034864892, "avgtime": 0.000047562 }, "msgr_handle_ack_lat": { "avgcount": 24770, "sum": 0.008673663, "avgtime": 0.000000350 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "queue_len": 0, "complete_latency": { "avgcount": 6439, "sum": 4.376196531, "avgtime": 0.000679639 } }, "finisher-PurgeQueue": { "queue_len": 0, "complete_latency": { "avgcount": 2048, "sum": 0.390648728, "avgtime": 0.000190746 } }, "mds": { "request": 3277, "reply": 3275, "reply_latency": { "avgcount": 3275, "sum": 6.266216007, "avgtime": 0.001913348 }, "forward": 0, "dir_fetch": 12, "dir_commit": 73, "dir_split": 9, "dir_merge": 0, "inodes": 374, "inodes_top": 0, "inodes_bottom": 374, "inodes_pin_tail": 0, "inodes_pinned": 374, "inodes_expired": 0, "inodes_with_caps": 310, "caps": 310, "subtrees": 2, "traverse": 3278, "traverse_hit": 3276, "traverse_forward": 0, "traverse_discover": 0, "traverse_dir_fetch": 0, "traverse_remote_ino": 0, "traverse_lock": 0, "load_cent": 223899, "q": 0, "exported": 0, "exported_inodes": 0, "imported": 0, "imported_inodes": 0, "openino_dir_fetch": 0, "openino_backtrace_fetch": 0, "openino_peer_discover": 0, "root_rfiles": 363, "root_rbytes": 2946498560, "root_rsnaps": 0 }, "mds_cache": { "num_strays": 309, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "strays_created": 1601, "strays_enqueued": 1292, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 9, "ireq_fragstats": 0, "ireq_inodestats": 0 }, "mds_log": { "evadd": 9734, "evex": 0, "evtrm": 0, "ev": 9736, "evexg": 0, "evexd": 0, "segadd": 12, "segex": 0, "segtrm": 0, "seg": 13, "segexg": 0, "segexd": 0, "expos": 4194304, "wrpos": 23085414, "rdpos": 4195196, "jlat": { "avgcount": 3625, "sum": 19.707301110, "avgtime": 0.005436496 }, "replayed": 2 }, "mds_mem": { "ino": 377, "ino+": 1614, "ino-": 1237, "dir": 76, "dir+": 85, "dir-": 9, "dn": 1975, "dn+": 3212, "dn-": 1237, "cap": 310, "cap+": 1602, "cap-": 1292, "rss": 90464, "heap": 331932 }, "mds_server": { "dispatch_client_request": 3351, "dispatch_server_request": 0, "handle_client_request": 3277, "handle_client_session": 3, "handle_slave_request": 0, "req_create_latency": { "avgcount": 1600, "sum": 2.331516366, "avgtime": 0.001457197 }, "req_getattr_latency": { "avgcount": 2, "sum": 0.000941751, "avgtime": 0.000470875 }, "req_getfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_link_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookup_latency": { "avgcount": 1, "sum": 0.001560520, "avgtime": 0.001560520 }, "req_lookuphash_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupino_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupname_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupparent_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lssnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mkdir_latency": { "avgcount": 1, "sum": 0.004721025, "avgtime": 0.004721025 }, "req_mknod_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mksnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_open_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_readdir_latency": { "avgcount": 70, "sum": 0.134635846, "avgtime": 0.001923369 }, "req_rename_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_renamesnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmdir_latency": { "avgcount": 1, "sum": 0.451035564, "avgtime": 0.451035564 }, "req_rmsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setdirlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_symlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_unlink_latency": { "avgcount": 1600, "sum": 3.341804935, "avgtime": 0.002088628 }, "cap_revoke_eviction": 0 }, "mds_sessions": { "session_count": 1, "session_add": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 2752, "average_load": 2752, "avg_session_uptime": 903 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "buffer_anon_bytes": 1143439, "buffer_anon_items": 654, "buffer_meta_bytes": 88, "buffer_meta_items": 1, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6128, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 6338269, "mds_co_items": 79913, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "op_active": 9, "op_laggy": 0, "op_send": 5581, "op_send_bytes": 19774090, "op_resend": 0, "op_reply": 5572, "op": 5581, "op_r": 33, "op_w": 5548, "op_rmw": 0, "op_pg": 0, "osdop_stat": 2, "osdop_create": 0, "osdop_read": 15, "osdop_write": 3632, "osdop_writefull": 6, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 1, "osdop_truncate": 1, "osdop_delete": 1824, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 14, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 8, "osd_session_open": 8, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 167, "omap_rd": 28, "omap_del": 10 }, "oft": { "omap_total_objs": 0, "omap_total_kv_pairs": 0, "omap_total_updates": 0, "omap_total_removes": 0 }, "purge_queue": { "pq_executing_ops": 17, "pq_executing_ops_high_water": 22, "pq_executing": 6, "pq_executing_high_water": 8, "pq_executed": 778, "pq_item_in_journal": 516 }, "throttle-msgr_dispatch_throttler-mds": { "val": 0, "max": 104857600, "get_started": 0, "get": 14228, "get_sum": 3177158, "get_or_fail_fail": 0, "get_or_fail_success": 14228, "take": 0, "take_sum": 0, "put": 14228, "put_sum": 3177158, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_bytes": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 5581, "take_sum": 19905688, "put": 3744, "put_sum": 19905688, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_ops": { "val": 9, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 5581, "take_sum": 5581, "put": 5572, "put_sum": 5572, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle": { "val": 0, "max": 3758096384, "get_started": 0, "get": 1292, "get_sum": 130492, "get_or_fail_fail": 0, "get_or_fail_success": 1292, "take": 0, "take_sum": 0, "put": 7, "put_sum": 130492, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle-0x55eb89907c20": { "val": 35772, "max": 3758096384, "get_started": 0, "get": 9734, "get_sum": 18889780, "get_or_fail_fail": 0, "get_or_fail_success": 9734, "take": 0, "take_sum": 0, "put": 3625, "put_sum": 18854008, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } 2020-05-18T21:35:33.741 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 6/309, 778/1601 2020-05-18T21:35:33.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.826+0000 7f18c7583700 1 -- 172.21.15.63:0/3681120449 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18c00569e0 con 0x7f18c00b49f0 2020-05-18T21:35:33.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.826+0000 7f18c4b1e700 1 --2- 172.21.15.63:0/3681120449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18c00b49f0 0x7f18c0112a00 secure :-1 s=THROTTLE_DONE pgs=1140 cs=0 l=1 rx=0x7f18c01140a0 tx=0x7f18bc001e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:33.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.826+0000 7f18ae7fc700 1 -- 172.21.15.63:0/3681120449 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f18bc041030 con 0x7f18c00b49f0 2020-05-18T21:35:33.834 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:33.834 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":98,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/3483934102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3483934102},{"type":"v1","addr":"172.21.15.155:6835","nonce":3483934102}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":98}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:34:27.767123+0000","modified":"2020-05-18T21:34:41.281280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"a","rank":0,"incarnation":94,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6833/1314928434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1314928434},{"type":"v1","addr":"172.21.15.63:6833","nonce":1314928434}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-05-18T21:35:33.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.830+0000 7f18c7583700 1 -- 172.21.15.63:0/3681120449 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f18a804fe60 msgr2=0x7f18a8052320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:33.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.830+0000 7f18c7583700 1 --2- 172.21.15.63:0/3681120449 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f18a804fe60 0x7f18a8052320 secure :-1 s=READY pgs=670 cs=0 l=1 rx=0x7f18b80091f0 tx=0x7f18b800a660).stop 2020-05-18T21:35:33.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.830+0000 7f18c7583700 1 -- 172.21.15.63:0/3681120449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18c00b49f0 msgr2=0x7f18c0112a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:33.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.830+0000 7f18c7583700 1 --2- 172.21.15.63:0/3681120449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18c00b49f0 0x7f18c0112a00 secure :-1 s=READY pgs=1140 cs=0 l=1 rx=0x7f18c01140a0 tx=0x7f18bc001e70).stop 2020-05-18T21:35:33.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.830+0000 7f18c7583700 1 -- 172.21.15.63:0/3681120449 shutdown_connections 2020-05-18T21:35:33.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.830+0000 7f18c7583700 1 --2- 172.21.15.63:0/3681120449 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f18a804fe60 0x7f18a8052320 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:33.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.830+0000 7f18c7583700 1 --2- 172.21.15.63:0/3681120449 >> v2:172.21.15.63:3300/0 conn(0x7f18c0141970 0x7f18c00b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:33.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.830+0000 7f18c7583700 1 --2- 172.21.15.63:0/3681120449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18c00b49f0 0x7f18c0112a00 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:33.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.830+0000 7f18c7583700 1 -- 172.21.15.63:0/3681120449 >> 172.21.15.63:0/3681120449 conn(0x7f18c005b290 msgr2=0x7f18c00b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:33.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.830+0000 7f18c7583700 1 -- 172.21.15.63:0/3681120449 shutdown_connections 2020-05-18T21:35:33.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:33.830+0000 7f18c7583700 1 -- 172.21.15.63:0/3681120449 wait complete. 2020-05-18T21:35:33.838 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 98 2020-05-18T21:35:33.850 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush journal 2020-05-18T21:35:34.117 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:35:34.117 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "", 2020-05-18T21:35:34.118 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0 2020-05-18T21:35:34.118 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:35:34.127 INFO:tasks.cephfs.filesystem:_json_asok output: { "message": "", "return_code": 0 } 2020-05-18T21:35:34.742 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:35:34.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7c33a700 1 Processor -- start 2020-05-18T21:35:34.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7c33a700 1 -- start start 2020-05-18T21:35:34.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7c33a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdd740b9e70 0x7fdd7405edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:34.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7c33a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd740623a0 0x7fdd740ba250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:34.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7c33a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd740b66b0 con 0x7fdd7414a2a0 2020-05-18T21:35:34.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7c33a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd7414a970 con 0x7fdd740b9e70 2020-05-18T21:35:34.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7c33a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7414ac10 con 0x7fdd740623a0 2020-05-18T21:35:34.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7a0d6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdd740b9e70 0x7fdd7405edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:34.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7a0d6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdd740b9e70 0x7fdd7405edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34134/0 (socket says 172.21.15.63:34134) 2020-05-18T21:35:34.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7a0d6700 1 -- 172.21.15.63:0/2244264382 learned_addr learned my addr 172.21.15.63:0/2244264382 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:34.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7a8d7700 1 --2- 172.21.15.63:0/2244264382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd740623a0 0x7fdd740ba250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:34.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7a0d6700 1 -- 172.21.15.63:0/2244264382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd740623a0 msgr2=0x7fdd740ba250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:34.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7a0d6700 1 --2- 172.21.15.63:0/2244264382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd740623a0 0x7fdd740ba250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:34.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7a0d6700 1 -- 172.21.15.63:0/2244264382 >> v1:172.21.15.63:6789/0 conn(0x7fdd7414a2a0 legacy=0x7fdd7405a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:34.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7a0d6700 1 -- 172.21.15.63:0/2244264382 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7414b0b0 con 0x7fdd740b9e70 2020-05-18T21:35:34.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7a0d6700 1 --2- 172.21.15.63:0/2244264382 >> v2:172.21.15.63:3300/0 conn(0x7fdd740b9e70 0x7fdd7405edd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdd68002f70 tx=0x7fdd68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:34.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7a0d6700 1 --2- 172.21.15.63:0/2244264382 >> v2:172.21.15.63:3300/0 conn(0x7fdd740b9e70 0x7fdd7405edd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdd68002f70 tx=0x7fdd68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:34.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7a0d6700 1 --2- 172.21.15.63:0/2244264382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd740b9e70 0x7fdd7405edd0 secure :-1 s=READY pgs=1736 cs=0 l=1 rx=0x7fdd68002f70 tx=0x7fdd68007a80).ready entity=mon.0 client_cookie=4c697a9190373789 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:34.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7a0d6700 1 --2- 172.21.15.63:0/2244264382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd740b9e70 0x7fdd7405edd0 secure :-1 s=THROTTLE_DONE pgs=1736 cs=0 l=1 rx=0x7fdd68002f70 tx=0x7fdd68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:34.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7a0d6700 1 --2- 172.21.15.63:0/2244264382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd740b9e70 0x7fdd7405edd0 secure :-1 s=THROTTLE_DONE pgs=1736 cs=0 l=1 rx=0x7fdd68002f70 tx=0x7fdd68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:34.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7a0d6700 1 --2- 172.21.15.63:0/2244264382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd740b9e70 0x7fdd7405edd0 secure :-1 s=THROTTLE_DONE pgs=1736 cs=0 l=1 rx=0x7fdd68002f70 tx=0x7fdd68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:34.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd790d4700 1 -- 172.21.15.63:0/2244264382 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd68008e50 con 0x7fdd740b9e70 2020-05-18T21:35:34.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd790d4700 1 -- 172.21.15.63:0/2244264382 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd68010800 con 0x7fdd740b9e70 2020-05-18T21:35:34.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd790d4700 1 -- 172.21.15.63:0/2244264382 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd68010be0 con 0x7fdd740b9e70 2020-05-18T21:35:34.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7c33a700 1 -- 172.21.15.63:0/2244264382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd740b9e70 msgr2=0x7fdd7405edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:34.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.866+0000 7fdd7c33a700 1 --2- 172.21.15.63:0/2244264382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd740b9e70 0x7fdd7405edd0 secure :-1 s=READY pgs=1736 cs=0 l=1 rx=0x7fdd68002f70 tx=0x7fdd68007a80).stop 2020-05-18T21:35:34.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.870+0000 7fdd7c33a700 1 -- 172.21.15.63:0/2244264382 shutdown_connections 2020-05-18T21:35:34.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.870+0000 7fdd7c33a700 1 --2- 172.21.15.63:0/2244264382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd740623a0 0x7fdd740ba250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:34.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.870+0000 7fdd7c33a700 1 --2- 172.21.15.63:0/2244264382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd740b9e70 0x7fdd7405edd0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:34.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.870+0000 7fdd7c33a700 1 -- 172.21.15.63:0/2244264382 >> 172.21.15.63:0/2244264382 conn(0x7fdd7409e8b0 msgr2=0x7fdd740b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:34.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.870+0000 7fdd7c33a700 1 -- 172.21.15.63:0/2244264382 shutdown_connections 2020-05-18T21:35:34.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.870+0000 7fdd7c33a700 1 -- 172.21.15.63:0/2244264382 wait complete. 2020-05-18T21:35:34.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.870+0000 7fdd7c33a700 1 Processor -- start 2020-05-18T21:35:34.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.870+0000 7fdd7c33a700 1 -- start start 2020-05-18T21:35:34.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.870+0000 7fdd7c33a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdd740623a0 0x7fdd740ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:34.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.870+0000 7fdd7c33a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdd740b9e70 0x7fdd740660f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:34.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.870+0000 7fdd7c33a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd7412f0e0 con 0x7fdd7414a2a0 2020-05-18T21:35:34.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.870+0000 7fdd7c33a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd7412f380 con 0x7fdd740623a0 2020-05-18T21:35:34.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.870+0000 7fdd7c33a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd7412f620 con 0x7fdd740b9e70 2020-05-18T21:35:34.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.870+0000 7fdd7a0d6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdd740623a0 0x7fdd740ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:34.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.870+0000 7fdd7a0d6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdd740623a0 0x7fdd740ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34140/0 (socket says 172.21.15.63:34140) 2020-05-18T21:35:34.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.870+0000 7fdd7a0d6700 1 -- 172.21.15.63:0/253118097 learned_addr learned my addr 172.21.15.63:0/253118097 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:34.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.870+0000 7fdd798d5700 1 --2- 172.21.15.63:0/253118097 >> v2:172.21.15.155:3300/0 conn(0x7fdd740b9e70 0x7fdd740660f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:34.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.874+0000 7fdd7a0d6700 1 -- 172.21.15.63:0/253118097 >> v2:172.21.15.155:3300/0 conn(0x7fdd740b9e70 msgr2=0x7fdd740660f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:34.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.874+0000 7fdd7a0d6700 1 --2- 172.21.15.63:0/253118097 >> v2:172.21.15.155:3300/0 conn(0x7fdd740b9e70 0x7fdd740660f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:34.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.874+0000 7fdd7a0d6700 1 -- 172.21.15.63:0/253118097 >> v1:172.21.15.155:6789/0 conn(0x7fdd7414a2a0 legacy=0x7fdd74130ab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-05-18T21:35:34.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.874+0000 7fdd7a0d6700 1 -- 172.21.15.63:0/253118097 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd74064820 con 0x7fdd740623a0 2020-05-18T21:35:34.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.874+0000 7fdd7a0d6700 1 --2- 172.21.15.63:0/253118097 >> v2:172.21.15.63:3300/0 conn(0x7fdd740623a0 0x7fdd740ae870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd74139560 tx=0x7fdd68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:34.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.874+0000 7fdd7a0d6700 1 --2- 172.21.15.63:0/253118097 >> v2:172.21.15.63:3300/0 conn(0x7fdd740623a0 0x7fdd740ae870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd74139560 tx=0x7fdd68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:34.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.874+0000 7fdd7a0d6700 1 --2- 172.21.15.63:0/253118097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd740623a0 0x7fdd740ae870 secure :-1 s=READY pgs=1737 cs=0 l=1 rx=0x7fdd74139560 tx=0x7fdd68007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:34.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.874+0000 7fdd7a0d6700 1 --2- 172.21.15.63:0/253118097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd740623a0 0x7fdd740ae870 secure :-1 s=THROTTLE_DONE pgs=1737 cs=0 l=1 rx=0x7fdd74139560 tx=0x7fdd68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:34.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.874+0000 7fdd7a0d6700 1 --2- 172.21.15.63:0/253118097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd740623a0 0x7fdd740ae870 secure :-1 s=THROTTLE_DONE pgs=1737 cs=0 l=1 rx=0x7fdd74139560 tx=0x7fdd68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:34.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.874+0000 7fdd7a0d6700 1 --2- 172.21.15.63:0/253118097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd740623a0 0x7fdd740ae870 secure :-1 s=THROTTLE_DONE pgs=1737 cs=0 l=1 rx=0x7fdd74139560 tx=0x7fdd68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:34.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.874+0000 7fdd677fe700 1 -- 172.21.15.63:0/253118097 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd68010300 con 0x7fdd740623a0 2020-05-18T21:35:34.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.874+0000 7fdd677fe700 1 -- 172.21.15.63:0/253118097 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd68007370 con 0x7fdd740623a0 2020-05-18T21:35:34.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.874+0000 7fdd677fe700 1 -- 172.21.15.63:0/253118097 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd68005700 con 0x7fdd740623a0 2020-05-18T21:35:34.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.874+0000 7fdd7c33a700 1 -- 172.21.15.63:0/253118097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd74064a10 con 0x7fdd740623a0 2020-05-18T21:35:34.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.874+0000 7fdd7c33a700 1 -- 172.21.15.63:0/253118097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd7412eb00 con 0x7fdd740623a0 2020-05-18T21:35:34.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.874+0000 7fdd7a0d6700 1 --2- 172.21.15.63:0/253118097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd740623a0 0x7fdd740ae870 secure :-1 s=THROTTLE_DONE pgs=1737 cs=0 l=1 rx=0x7fdd74139560 tx=0x7fdd68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:34.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.878+0000 7fdd677fe700 1 -- 172.21.15.63:0/253118097 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fdd68005860 con 0x7fdd740623a0 2020-05-18T21:35:34.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.878+0000 7fdd7a0d6700 1 --2- 172.21.15.63:0/253118097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd740623a0 0x7fdd740ae870 secure :-1 s=THROTTLE_DONE pgs=1737 cs=0 l=1 rx=0x7fdd74139560 tx=0x7fdd68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:34.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.878+0000 7fdd7c33a700 1 -- 172.21.15.63:0/253118097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd740569e0 con 0x7fdd740623a0 2020-05-18T21:35:34.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.878+0000 7fdd677fe700 1 --2- 172.21.15.63:0/253118097 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd5c04fb10 0x7fdd5c051fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:34.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.878+0000 7fdd677fe700 1 -- 172.21.15.63:0/253118097 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fdd68063c50 con 0x7fdd740623a0 2020-05-18T21:35:34.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.878+0000 7fdd798d5700 1 --2- 172.21.15.63:0/253118097 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd5c04fb10 0x7fdd5c051fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:34.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.882+0000 7fdd798d5700 1 --2- 172.21.15.63:0/253118097 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd5c04fb10 0x7fdd5c051fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd7405c980 tx=0x7fdd70003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:34.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.882+0000 7fdd798d5700 1 --2- 172.21.15.63:0/253118097 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd5c04fb10 0x7fdd5c051fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd7405c980 tx=0x7fdd70003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:34.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.882+0000 7fdd798d5700 1 --2- 172.21.15.63:0/253118097 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd5c04fb10 0x7fdd5c051fd0 secure :-1 s=READY pgs=671 cs=0 l=1 rx=0x7fdd7405c980 tx=0x7fdd70003e60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:34.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.882+0000 7fdd7a0d6700 1 --2- 172.21.15.63:0/253118097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd740623a0 0x7fdd740ae870 secure :-1 s=THROTTLE_DONE pgs=1737 cs=0 l=1 rx=0x7fdd74139560 tx=0x7fdd68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:34.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:34.882+0000 7fdd677fe700 1 -- 172.21.15.63:0/253118097 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fdd680150d0 con 0x7fdd740623a0 2020-05-18T21:35:35.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:35.098+0000 7fdd7c33a700 1 -- 172.21.15.63:0/253118097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd7412f790 con 0x7fdd740623a0 2020-05-18T21:35:35.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:35.098+0000 7fdd7a0d6700 1 --2- 172.21.15.63:0/253118097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd740623a0 0x7fdd740ae870 secure :-1 s=THROTTLE_DONE pgs=1737 cs=0 l=1 rx=0x7fdd74139560 tx=0x7fdd68007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:35.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:35.098+0000 7fdd677fe700 1 -- 172.21.15.63:0/253118097 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fdd6803e100 con 0x7fdd740623a0 2020-05-18T21:35:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:35.103 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":98,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/3483934102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3483934102},{"type":"v1","addr":"172.21.15.155:6835","nonce":3483934102}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":98}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:34:27.767123+0000","modified":"2020-05-18T21:34:41.281280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"a","rank":0,"incarnation":94,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6833/1314928434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1314928434},{"type":"v1","addr":"172.21.15.63:6833","nonce":1314928434}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-05-18T21:35:35.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:35.098+0000 7fdd7c33a700 1 -- 172.21.15.63:0/253118097 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd5c04fb10 msgr2=0x7fdd5c051fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:35.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:35.098+0000 7fdd7c33a700 1 --2- 172.21.15.63:0/253118097 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd5c04fb10 0x7fdd5c051fd0 secure :-1 s=READY pgs=671 cs=0 l=1 rx=0x7fdd7405c980 tx=0x7fdd70003e60).stop 2020-05-18T21:35:35.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:35.098+0000 7fdd7c33a700 1 -- 172.21.15.63:0/253118097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd740623a0 msgr2=0x7fdd740ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:35.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:35.098+0000 7fdd7c33a700 1 --2- 172.21.15.63:0/253118097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd740623a0 0x7fdd740ae870 secure :-1 s=READY pgs=1737 cs=0 l=1 rx=0x7fdd74139560 tx=0x7fdd68007a80).stop 2020-05-18T21:35:35.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:35.098+0000 7fdd7c33a700 1 -- 172.21.15.63:0/253118097 shutdown_connections 2020-05-18T21:35:35.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:35.098+0000 7fdd7c33a700 1 --2- 172.21.15.63:0/253118097 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd5c04fb10 0x7fdd5c051fd0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:35.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:35.098+0000 7fdd7c33a700 1 --2- 172.21.15.63:0/253118097 >> v2:172.21.15.155:3300/0 conn(0x7fdd740b9e70 0x7fdd740660f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:35.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:35.098+0000 7fdd7c33a700 1 --2- 172.21.15.63:0/253118097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd740623a0 0x7fdd740ae870 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:35.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:35.098+0000 7fdd7c33a700 1 -- 172.21.15.63:0/253118097 >> 172.21.15.63:0/253118097 conn(0x7fdd7409e8b0 msgr2=0x7fdd740b9650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:35.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:35.098+0000 7fdd7c33a700 1 -- 172.21.15.63:0/253118097 shutdown_connections 2020-05-18T21:35:35.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:35.098+0000 7fdd7c33a700 1 -- 172.21.15.63:0/253118097 wait complete. 2020-05-18T21:35:35.107 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 98 2020-05-18T21:35:35.116 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2020-05-18T21:35:35.210 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:35:35.210 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-0": { 2020-05-18T21:35:35.210 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 1598, 2020-05-18T21:35:35.211 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 1593, 2020-05-18T21:35:35.211 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 622931, 2020-05-18T21:35:35.211 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 752575, 2020-05-18T21:35:35.211 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 6, 2020-05-18T21:35:35.211 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 1, 2020-05-18T21:35:35.212 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.108313417, 2020-05-18T21:35:35.212 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.031043862, 2020-05-18T21:35:35.212 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.037037000, 2020-05-18T21:35:35.212 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.034412677, 2020-05-18T21:35:35.212 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:35.212 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1593, 2020-05-18T21:35:35.213 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.145451975, 2020-05-18T21:35:35.213 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000091306 2020-05-18T21:35:35.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.213 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:35.213 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.214 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.214 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.214 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:35.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.214 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-1": { 2020-05-18T21:35:35.215 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 2339, 2020-05-18T21:35:35.215 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 2352, 2020-05-18T21:35:35.215 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 560323, 2020-05-18T21:35:35.215 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 7638372, 2020-05-18T21:35:35.215 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 6, 2020-05-18T21:35:35.215 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 3, 2020-05-18T21:35:35.216 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.252606777, 2020-05-18T21:35:35.216 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.095666987, 2020-05-18T21:35:35.216 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.057945575, 2020-05-18T21:35:35.216 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.081944355, 2020-05-18T21:35:35.216 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:35.217 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 2352, 2020-05-18T21:35:35.217 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.144493677, 2020-05-18T21:35:35.217 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000061434 2020-05-18T21:35:35.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.218 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:35.218 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.218 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.218 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.219 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:35.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.219 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-2": { 2020-05-18T21:35:35.219 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 12570, 2020-05-18T21:35:35.219 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 22605, 2020-05-18T21:35:35.220 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 3654354, 2020-05-18T21:35:35.220 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 21660855, 2020-05-18T21:35:35.220 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 6, 2020-05-18T21:35:35.220 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 3, 2020-05-18T21:35:35.220 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 1.897614326, 2020-05-18T21:35:35.220 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.903400719, 2020-05-18T21:35:35.221 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.991278787, 2020-05-18T21:35:35.221 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.142504943, 2020-05-18T21:35:35.221 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:35.221 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 22604, 2020-05-18T21:35:35.221 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 1.092424972, 2020-05-18T21:35:35.222 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000048328 2020-05-18T21:35:35.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.222 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:35.222 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 24775, 2020-05-18T21:35:35.222 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.008674593, 2020-05-18T21:35:35.222 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000350 2020-05-18T21:35:35.223 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:35.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.223 INFO:teuthology.orchestra.run.smithi063.stdout: "cct": { 2020-05-18T21:35:35.223 INFO:teuthology.orchestra.run.smithi063.stdout: "total_workers": 1, 2020-05-18T21:35:35.223 INFO:teuthology.orchestra.run.smithi063.stdout: "unhealthy_workers": 0 2020-05-18T21:35:35.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.224 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-MDSRank": { 2020-05-18T21:35:35.224 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2020-05-18T21:35:35.224 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2020-05-18T21:35:35.224 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 6487, 2020-05-18T21:35:35.224 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 4.488002852, 2020-05-18T21:35:35.225 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000691845 2020-05-18T21:35:35.225 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:35.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.225 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-PurgeQueue": { 2020-05-18T21:35:35.225 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2020-05-18T21:35:35.226 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2020-05-18T21:35:35.226 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 4322, 2020-05-18T21:35:35.226 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.469052883, 2020-05-18T21:35:35.226 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000108526 2020-05-18T21:35:35.226 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:35.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.227 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2020-05-18T21:35:35.227 INFO:teuthology.orchestra.run.smithi063.stdout: "request": 3277, 2020-05-18T21:35:35.227 INFO:teuthology.orchestra.run.smithi063.stdout: "reply": 3275, 2020-05-18T21:35:35.227 INFO:teuthology.orchestra.run.smithi063.stdout: "reply_latency": { 2020-05-18T21:35:35.227 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 3275, 2020-05-18T21:35:35.228 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 6.266216007, 2020-05-18T21:35:35.228 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001913348 2020-05-18T21:35:35.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.228 INFO:teuthology.orchestra.run.smithi063.stdout: "forward": 0, 2020-05-18T21:35:35.228 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_fetch": 12, 2020-05-18T21:35:35.229 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_commit": 85, 2020-05-18T21:35:35.229 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_split": 9, 2020-05-18T21:35:35.229 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_merge": 0, 2020-05-18T21:35:35.229 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes": 319, 2020-05-18T21:35:35.229 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_top": 0, 2020-05-18T21:35:35.230 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_bottom": 319, 2020-05-18T21:35:35.230 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pin_tail": 0, 2020-05-18T21:35:35.230 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pinned": 319, 2020-05-18T21:35:35.230 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_expired": 0, 2020-05-18T21:35:35.230 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_with_caps": 2, 2020-05-18T21:35:35.230 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": 2, 2020-05-18T21:35:35.231 INFO:teuthology.orchestra.run.smithi063.stdout: "subtrees": 2, 2020-05-18T21:35:35.231 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse": 3278, 2020-05-18T21:35:35.231 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_hit": 3276, 2020-05-18T21:35:35.231 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_forward": 0, 2020-05-18T21:35:35.231 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_discover": 0, 2020-05-18T21:35:35.231 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_dir_fetch": 0, 2020-05-18T21:35:35.232 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_remote_ino": 0, 2020-05-18T21:35:35.232 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_lock": 0, 2020-05-18T21:35:35.232 INFO:teuthology.orchestra.run.smithi063.stdout: "load_cent": 223899, 2020-05-18T21:35:35.232 INFO:teuthology.orchestra.run.smithi063.stdout: "q": 0, 2020-05-18T21:35:35.232 INFO:teuthology.orchestra.run.smithi063.stdout: "exported": 0, 2020-05-18T21:35:35.233 INFO:teuthology.orchestra.run.smithi063.stdout: "exported_inodes": 0, 2020-05-18T21:35:35.233 INFO:teuthology.orchestra.run.smithi063.stdout: "imported": 0, 2020-05-18T21:35:35.233 INFO:teuthology.orchestra.run.smithi063.stdout: "imported_inodes": 0, 2020-05-18T21:35:35.233 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_dir_fetch": 0, 2020-05-18T21:35:35.233 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_backtrace_fetch": 0, 2020-05-18T21:35:35.234 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_peer_discover": 0, 2020-05-18T21:35:35.234 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rfiles": 363, 2020-05-18T21:35:35.234 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rbytes": 2946498560, 2020-05-18T21:35:35.234 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rsnaps": 0 2020-05-18T21:35:35.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.235 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:35:35.235 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays": 1, 2020-05-18T21:35:35.235 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_delayed": 1, 2020-05-18T21:35:35.235 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:35:35.236 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_created": 1601, 2020-05-18T21:35:35.236 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 1600, 2020-05-18T21:35:35.236 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_reintegrated": 0, 2020-05-18T21:35:35.236 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_migrated": 0, 2020-05-18T21:35:35.236 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_processing": 0, 2020-05-18T21:35:35.236 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:35:35.237 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:35:35.237 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_started": 0, 2020-05-18T21:35:35.237 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_completed": 0, 2020-05-18T21:35:35.237 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:35:35.237 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_exportdir": 0, 2020-05-18T21:35:35.238 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_flush": 0, 2020-05-18T21:35:35.238 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragmentdir": 9, 2020-05-18T21:35:35.238 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragstats": 0, 2020-05-18T21:35:35.238 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_inodestats": 0 2020-05-18T21:35:35.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.238 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log": { 2020-05-18T21:35:35.239 INFO:teuthology.orchestra.run.smithi063.stdout: "evadd": 10045, 2020-05-18T21:35:35.239 INFO:teuthology.orchestra.run.smithi063.stdout: "evex": 9736, 2020-05-18T21:35:35.239 INFO:teuthology.orchestra.run.smithi063.stdout: "evtrm": 9736, 2020-05-18T21:35:35.239 INFO:teuthology.orchestra.run.smithi063.stdout: "ev": 311, 2020-05-18T21:35:35.239 INFO:teuthology.orchestra.run.smithi063.stdout: "evexg": 0, 2020-05-18T21:35:35.240 INFO:teuthology.orchestra.run.smithi063.stdout: "evexd": 9736, 2020-05-18T21:35:35.240 INFO:teuthology.orchestra.run.smithi063.stdout: "segadd": 13, 2020-05-18T21:35:35.240 INFO:teuthology.orchestra.run.smithi063.stdout: "segex": 13, 2020-05-18T21:35:35.240 INFO:teuthology.orchestra.run.smithi063.stdout: "segtrm": 13, 2020-05-18T21:35:35.240 INFO:teuthology.orchestra.run.smithi063.stdout: "seg": 14, 2020-05-18T21:35:35.240 INFO:teuthology.orchestra.run.smithi063.stdout: "segexg": 0, 2020-05-18T21:35:35.241 INFO:teuthology.orchestra.run.smithi063.stdout: "segexd": 13, 2020-05-18T21:35:35.241 INFO:teuthology.orchestra.run.smithi063.stdout: "expos": 23085414, 2020-05-18T21:35:35.241 INFO:teuthology.orchestra.run.smithi063.stdout: "wrpos": 23274938, 2020-05-18T21:35:35.241 INFO:teuthology.orchestra.run.smithi063.stdout: "rdpos": 4195196, 2020-05-18T21:35:35.241 INFO:teuthology.orchestra.run.smithi063.stdout: "jlat": { 2020-05-18T21:35:35.242 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 3628, 2020-05-18T21:35:35.242 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 19.757546550, 2020-05-18T21:35:35.242 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.005445850 2020-05-18T21:35:35.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.242 INFO:teuthology.orchestra.run.smithi063.stdout: "replayed": 2 2020-05-18T21:35:35.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.243 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_mem": { 2020-05-18T21:35:35.243 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 322, 2020-05-18T21:35:35.243 INFO:teuthology.orchestra.run.smithi063.stdout: "ino+": 1614, 2020-05-18T21:35:35.243 INFO:teuthology.orchestra.run.smithi063.stdout: "ino-": 1292, 2020-05-18T21:35:35.243 INFO:teuthology.orchestra.run.smithi063.stdout: "dir": 76, 2020-05-18T21:35:35.244 INFO:teuthology.orchestra.run.smithi063.stdout: "dir+": 85, 2020-05-18T21:35:35.244 INFO:teuthology.orchestra.run.smithi063.stdout: "dir-": 9, 2020-05-18T21:35:35.244 INFO:teuthology.orchestra.run.smithi063.stdout: "dn": 320, 2020-05-18T21:35:35.244 INFO:teuthology.orchestra.run.smithi063.stdout: "dn+": 3212, 2020-05-18T21:35:35.244 INFO:teuthology.orchestra.run.smithi063.stdout: "dn-": 2892, 2020-05-18T21:35:35.245 INFO:teuthology.orchestra.run.smithi063.stdout: "cap": 1, 2020-05-18T21:35:35.245 INFO:teuthology.orchestra.run.smithi063.stdout: "cap+": 1602, 2020-05-18T21:35:35.245 INFO:teuthology.orchestra.run.smithi063.stdout: "cap-": 1601, 2020-05-18T21:35:35.245 INFO:teuthology.orchestra.run.smithi063.stdout: "rss": 90464, 2020-05-18T21:35:35.246 INFO:teuthology.orchestra.run.smithi063.stdout: "heap": 331932 2020-05-18T21:35:35.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.246 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_server": { 2020-05-18T21:35:35.246 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_client_request": 3351, 2020-05-18T21:35:35.246 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_server_request": 0, 2020-05-18T21:35:35.247 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_request": 3277, 2020-05-18T21:35:35.247 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_session": 4, 2020-05-18T21:35:35.247 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_slave_request": 0, 2020-05-18T21:35:35.247 INFO:teuthology.orchestra.run.smithi063.stdout: "req_create_latency": { 2020-05-18T21:35:35.247 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1600, 2020-05-18T21:35:35.248 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 2.331516366, 2020-05-18T21:35:35.248 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001457197 2020-05-18T21:35:35.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.248 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getattr_latency": { 2020-05-18T21:35:35.248 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 2, 2020-05-18T21:35:35.248 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000941751, 2020-05-18T21:35:35.249 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000470875 2020-05-18T21:35:35.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.249 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getfilelock_latency": { 2020-05-18T21:35:35.249 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.249 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.250 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.250 INFO:teuthology.orchestra.run.smithi063.stdout: "req_link_latency": { 2020-05-18T21:35:35.250 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.250 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.250 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.251 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookup_latency": { 2020-05-18T21:35:35.251 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:35.251 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.001560520, 2020-05-18T21:35:35.251 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001560520 2020-05-18T21:35:35.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.252 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookuphash_latency": { 2020-05-18T21:35:35.252 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.252 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.252 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.253 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupino_latency": { 2020-05-18T21:35:35.253 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.253 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.253 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.254 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupname_latency": { 2020-05-18T21:35:35.254 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.254 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.254 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.254 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupparent_latency": { 2020-05-18T21:35:35.255 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.255 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.255 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.255 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupsnap_latency": { 2020-05-18T21:35:35.255 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.256 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.256 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.256 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lssnap_latency": { 2020-05-18T21:35:35.256 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.257 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.257 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.257 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mkdir_latency": { 2020-05-18T21:35:35.257 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:35.257 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.004721025, 2020-05-18T21:35:35.258 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.004721025 2020-05-18T21:35:35.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.258 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mknod_latency": { 2020-05-18T21:35:35.258 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.258 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.259 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.259 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mksnap_latency": { 2020-05-18T21:35:35.259 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.259 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.259 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.260 INFO:teuthology.orchestra.run.smithi063.stdout: "req_open_latency": { 2020-05-18T21:35:35.260 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.260 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.260 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.261 INFO:teuthology.orchestra.run.smithi063.stdout: "req_readdir_latency": { 2020-05-18T21:35:35.261 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 70, 2020-05-18T21:35:35.261 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.134635846, 2020-05-18T21:35:35.261 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001923369 2020-05-18T21:35:35.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.262 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rename_latency": { 2020-05-18T21:35:35.262 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.262 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.262 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.263 INFO:teuthology.orchestra.run.smithi063.stdout: "req_renamesnap_latency": { 2020-05-18T21:35:35.263 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.263 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.263 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.264 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmdir_latency": { 2020-05-18T21:35:35.264 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:35.264 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.451035564, 2020-05-18T21:35:35.264 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.451035564 2020-05-18T21:35:35.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.265 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmsnap_latency": { 2020-05-18T21:35:35.265 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.265 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.265 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.265 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmxattr_latency": { 2020-05-18T21:35:35.266 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.266 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.266 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.266 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setattr_latency": { 2020-05-18T21:35:35.267 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.267 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.267 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.267 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setdirlayout_latency": { 2020-05-18T21:35:35.267 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.268 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.268 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.269 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setfilelock_latency": { 2020-05-18T21:35:35.270 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.270 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.270 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.270 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setlayout_latency": { 2020-05-18T21:35:35.271 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.271 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.271 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.271 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setxattr_latency": { 2020-05-18T21:35:35.272 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.272 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.272 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.272 INFO:teuthology.orchestra.run.smithi063.stdout: "req_symlink_latency": { 2020-05-18T21:35:35.272 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.273 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.273 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.273 INFO:teuthology.orchestra.run.smithi063.stdout: "req_unlink_latency": { 2020-05-18T21:35:35.273 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1600, 2020-05-18T21:35:35.274 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 3.341804935, 2020-05-18T21:35:35.274 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.002088628 2020-05-18T21:35:35.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.274 INFO:teuthology.orchestra.run.smithi063.stdout: "cap_revoke_eviction": 0 2020-05-18T21:35:35.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.274 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_sessions": { 2020-05-18T21:35:35.275 INFO:teuthology.orchestra.run.smithi063.stdout: "session_count": 1, 2020-05-18T21:35:35.275 INFO:teuthology.orchestra.run.smithi063.stdout: "session_add": 1, 2020-05-18T21:35:35.275 INFO:teuthology.orchestra.run.smithi063.stdout: "session_remove": 0, 2020-05-18T21:35:35.275 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_open": 1, 2020-05-18T21:35:35.275 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_stale": 0, 2020-05-18T21:35:35.276 INFO:teuthology.orchestra.run.smithi063.stdout: "total_load": 2752, 2020-05-18T21:35:35.277 INFO:teuthology.orchestra.run.smithi063.stdout: "average_load": 2752, 2020-05-18T21:35:35.277 INFO:teuthology.orchestra.run.smithi063.stdout: "avg_session_uptime": 903 2020-05-18T21:35:35.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.278 INFO:teuthology.orchestra.run.smithi063.stdout: "mempool": { 2020-05-18T21:35:35.278 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_bytes": 0, 2020-05-18T21:35:35.278 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_items": 0, 2020-05-18T21:35:35.279 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_bytes": 0, 2020-05-18T21:35:35.279 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_items": 0, 2020-05-18T21:35:35.279 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_bytes": 0, 2020-05-18T21:35:35.279 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_items": 0, 2020-05-18T21:35:35.279 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_bytes": 0, 2020-05-18T21:35:35.279 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_items": 0, 2020-05-18T21:35:35.280 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_bytes": 0, 2020-05-18T21:35:35.280 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_items": 0, 2020-05-18T21:35:35.280 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_bytes": 0, 2020-05-18T21:35:35.280 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_items": 0, 2020-05-18T21:35:35.280 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_bytes": 0, 2020-05-18T21:35:35.281 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_items": 0, 2020-05-18T21:35:35.281 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_bytes": 0, 2020-05-18T21:35:35.281 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_items": 0, 2020-05-18T21:35:35.281 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_bytes": 0, 2020-05-18T21:35:35.281 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_items": 0, 2020-05-18T21:35:35.282 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_bytes": 0, 2020-05-18T21:35:35.282 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_items": 0, 2020-05-18T21:35:35.282 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_bytes": 1143439, 2020-05-18T21:35:35.282 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_items": 654, 2020-05-18T21:35:35.282 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_bytes": 88, 2020-05-18T21:35:35.282 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_items": 1, 2020-05-18T21:35:35.283 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bytes": 0, 2020-05-18T21:35:35.283 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_items": 0, 2020-05-18T21:35:35.283 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_bytes": 0, 2020-05-18T21:35:35.283 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_items": 0, 2020-05-18T21:35:35.283 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_bytes": 0, 2020-05-18T21:35:35.284 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_items": 0, 2020-05-18T21:35:35.284 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_bytes": 6128, 2020-05-18T21:35:35.284 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_items": 93, 2020-05-18T21:35:35.284 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_bytes": 0, 2020-05-18T21:35:35.284 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_items": 0, 2020-05-18T21:35:35.284 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_bytes": 0, 2020-05-18T21:35:35.285 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_items": 0, 2020-05-18T21:35:35.285 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_bytes": 6338269, 2020-05-18T21:35:35.285 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_items": 79913, 2020-05-18T21:35:35.285 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_bytes": 0, 2020-05-18T21:35:35.285 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_items": 0, 2020-05-18T21:35:35.286 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_bytes": 0, 2020-05-18T21:35:35.286 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_items": 0 2020-05-18T21:35:35.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.286 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter": { 2020-05-18T21:35:35.286 INFO:teuthology.orchestra.run.smithi063.stdout: "op_active": 0, 2020-05-18T21:35:35.286 INFO:teuthology.orchestra.run.smithi063.stdout: "op_laggy": 0, 2020-05-18T21:35:35.287 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send": 7845, 2020-05-18T21:35:35.287 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send_bytes": 20058306, 2020-05-18T21:35:35.287 INFO:teuthology.orchestra.run.smithi063.stdout: "op_resend": 0, 2020-05-18T21:35:35.287 INFO:teuthology.orchestra.run.smithi063.stdout: "op_reply": 7845, 2020-05-18T21:35:35.287 INFO:teuthology.orchestra.run.smithi063.stdout: "op": 7845, 2020-05-18T21:35:35.288 INFO:teuthology.orchestra.run.smithi063.stdout: "op_r": 35, 2020-05-18T21:35:35.288 INFO:teuthology.orchestra.run.smithi063.stdout: "op_w": 7810, 2020-05-18T21:35:35.288 INFO:teuthology.orchestra.run.smithi063.stdout: "op_rmw": 0, 2020-05-18T21:35:35.288 INFO:teuthology.orchestra.run.smithi063.stdout: "op_pg": 0, 2020-05-18T21:35:35.288 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_stat": 12, 2020-05-18T21:35:35.288 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_create": 314, 2020-05-18T21:35:35.289 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_read": 17, 2020-05-18T21:35:35.289 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_write": 3637, 2020-05-18T21:35:35.289 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writefull": 10, 2020-05-18T21:35:35.289 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writesame": 0, 2020-05-18T21:35:35.289 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_append": 0, 2020-05-18T21:35:35.290 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_zero": 1, 2020-05-18T21:35:35.290 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_truncate": 1, 2020-05-18T21:35:35.290 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_delete": 3749, 2020-05-18T21:35:35.290 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_mapext": 0, 2020-05-18T21:35:35.290 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_sparse_read": 0, 2020-05-18T21:35:35.291 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_clonerange": 0, 2020-05-18T21:35:35.291 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_getxattr": 14, 2020-05-18T21:35:35.291 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_setxattr": 628, 2020-05-18T21:35:35.291 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_cmpxattr": 0, 2020-05-18T21:35:35.291 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_rmxattr": 0, 2020-05-18T21:35:35.291 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_resetxattrs": 0, 2020-05-18T21:35:35.292 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_call": 0, 2020-05-18T21:35:35.292 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_watch": 0, 2020-05-18T21:35:35.292 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_notify": 0, 2020-05-18T21:35:35.292 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_src_cmpxattr": 0, 2020-05-18T21:35:35.292 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls": 0, 2020-05-18T21:35:35.292 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls_filter": 0, 2020-05-18T21:35:35.293 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_other": 0, 2020-05-18T21:35:35.293 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_active": 0, 2020-05-18T21:35:35.293 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_send": 0, 2020-05-18T21:35:35.293 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_resend": 0, 2020-05-18T21:35:35.293 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_ping": 0, 2020-05-18T21:35:35.294 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_active": 0, 2020-05-18T21:35:35.294 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_send": 0, 2020-05-18T21:35:35.294 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_resend": 0, 2020-05-18T21:35:35.294 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_active": 0, 2020-05-18T21:35:35.294 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_send": 0, 2020-05-18T21:35:35.295 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_resend": 0, 2020-05-18T21:35:35.295 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_active": 0, 2020-05-18T21:35:35.295 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_send": 0, 2020-05-18T21:35:35.295 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_resend": 0, 2020-05-18T21:35:35.295 INFO:teuthology.orchestra.run.smithi063.stdout: "command_active": 0, 2020-05-18T21:35:35.296 INFO:teuthology.orchestra.run.smithi063.stdout: "command_send": 0, 2020-05-18T21:35:35.296 INFO:teuthology.orchestra.run.smithi063.stdout: "command_resend": 0, 2020-05-18T21:35:35.296 INFO:teuthology.orchestra.run.smithi063.stdout: "map_epoch": 0, 2020-05-18T21:35:35.296 INFO:teuthology.orchestra.run.smithi063.stdout: "map_full": 0, 2020-05-18T21:35:35.297 INFO:teuthology.orchestra.run.smithi063.stdout: "map_inc": 0, 2020-05-18T21:35:35.297 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_sessions": 8, 2020-05-18T21:35:35.297 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_open": 8, 2020-05-18T21:35:35.297 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_close": 0, 2020-05-18T21:35:35.297 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_laggy": 0, 2020-05-18T21:35:35.298 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_wr": 186, 2020-05-18T21:35:35.298 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_rd": 28, 2020-05-18T21:35:35.298 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_del": 12 2020-05-18T21:35:35.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.298 INFO:teuthology.orchestra.run.smithi063.stdout: "oft": { 2020-05-18T21:35:35.298 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_objs": 0, 2020-05-18T21:35:35.299 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_kv_pairs": 0, 2020-05-18T21:35:35.299 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_updates": 0, 2020-05-18T21:35:35.299 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_removes": 0 2020-05-18T21:35:35.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.299 INFO:teuthology.orchestra.run.smithi063.stdout: "purge_queue": { 2020-05-18T21:35:35.300 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops": 0, 2020-05-18T21:35:35.300 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops_high_water": 22, 2020-05-18T21:35:35.300 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing": 0, 2020-05-18T21:35:35.300 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_high_water": 8, 2020-05-18T21:35:35.300 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executed": 1600, 2020-05-18T21:35:35.300 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_item_in_journal": 0 2020-05-18T21:35:35.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.301 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-05-18T21:35:35.301 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:35.301 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2020-05-18T21:35:35.301 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:35.302 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 16504, 2020-05-18T21:35:35.302 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 3615320, 2020-05-18T21:35:35.302 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:35.302 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 16504, 2020-05-18T21:35:35.302 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:35.302 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:35.303 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 16504, 2020-05-18T21:35:35.303 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 3615320, 2020-05-18T21:35:35.303 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:35.303 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.303 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.303 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.304 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:35.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.304 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_bytes": { 2020-05-18T21:35:35.304 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:35.304 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2020-05-18T21:35:35.305 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:35.305 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2020-05-18T21:35:35.305 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2020-05-18T21:35:35.305 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:35.305 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2020-05-18T21:35:35.305 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 7845, 2020-05-18T21:35:35.306 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 20221012, 2020-05-18T21:35:35.306 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 4083, 2020-05-18T21:35:35.306 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 20221012, 2020-05-18T21:35:35.306 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:35.306 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.307 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.307 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.307 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:35.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.307 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_ops": { 2020-05-18T21:35:35.307 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:35.308 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 1024, 2020-05-18T21:35:35.308 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:35.308 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2020-05-18T21:35:35.308 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2020-05-18T21:35:35.308 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:35.309 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2020-05-18T21:35:35.309 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 7845, 2020-05-18T21:35:35.309 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 7845, 2020-05-18T21:35:35.309 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 7845, 2020-05-18T21:35:35.309 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 7845, 2020-05-18T21:35:35.309 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:35.310 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.310 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.310 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.310 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:35.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.311 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle": { 2020-05-18T21:35:35.311 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:35.311 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2020-05-18T21:35:35.311 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:35.311 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 1600, 2020-05-18T21:35:35.311 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 161600, 2020-05-18T21:35:35.312 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:35.312 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 1600, 2020-05-18T21:35:35.312 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:35.312 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:35.312 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 9, 2020-05-18T21:35:35.313 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 161600, 2020-05-18T21:35:35.314 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:35.314 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.314 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.314 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.314 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:35.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:35.315 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle-0x55eb89907c20": { 2020-05-18T21:35:35.315 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 184492, 2020-05-18T21:35:35.315 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2020-05-18T21:35:35.315 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:35.316 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 10045, 2020-05-18T21:35:35.316 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 19079304, 2020-05-18T21:35:35.316 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:35.316 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 10045, 2020-05-18T21:35:35.316 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:35.317 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:35.317 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 3628, 2020-05-18T21:35:35.317 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 18894812, 2020-05-18T21:35:35.317 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:35.317 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:35.317 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:35.318 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:35.318 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:35.318 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:35.318 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:35:35.320 INFO:tasks.cephfs.filesystem:_json_asok output: { "AsyncMessenger::Worker-0": { "msgr_recv_messages": 1598, "msgr_send_messages": 1593, "msgr_recv_bytes": 622931, "msgr_send_bytes": 752575, "msgr_created_connections": 6, "msgr_active_connections": 1, "msgr_running_total_time": 0.108313417, "msgr_running_send_time": 0.031043862, "msgr_running_recv_time": 0.037037000, "msgr_running_fast_dispatch_time": 0.034412677, "msgr_send_messages_queue_lat": { "avgcount": 1593, "sum": 0.145451975, "avgtime": 0.000091306 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-1": { "msgr_recv_messages": 2339, "msgr_send_messages": 2352, "msgr_recv_bytes": 560323, "msgr_send_bytes": 7638372, "msgr_created_connections": 6, "msgr_active_connections": 3, "msgr_running_total_time": 0.252606777, "msgr_running_send_time": 0.095666987, "msgr_running_recv_time": 0.057945575, "msgr_running_fast_dispatch_time": 0.081944355, "msgr_send_messages_queue_lat": { "avgcount": 2352, "sum": 0.144493677, "avgtime": 0.000061434 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-2": { "msgr_recv_messages": 12570, "msgr_send_messages": 22605, "msgr_recv_bytes": 3654354, "msgr_send_bytes": 21660855, "msgr_created_connections": 6, "msgr_active_connections": 3, "msgr_running_total_time": 1.897614326, "msgr_running_send_time": 0.903400719, "msgr_running_recv_time": 0.991278787, "msgr_running_fast_dispatch_time": 0.142504943, "msgr_send_messages_queue_lat": { "avgcount": 22604, "sum": 1.092424972, "avgtime": 0.000048328 }, "msgr_handle_ack_lat": { "avgcount": 24775, "sum": 0.008674593, "avgtime": 0.000000350 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "queue_len": 0, "complete_latency": { "avgcount": 6487, "sum": 4.488002852, "avgtime": 0.000691845 } }, "finisher-PurgeQueue": { "queue_len": 0, "complete_latency": { "avgcount": 4322, "sum": 0.469052883, "avgtime": 0.000108526 } }, "mds": { "request": 3277, "reply": 3275, "reply_latency": { "avgcount": 3275, "sum": 6.266216007, "avgtime": 0.001913348 }, "forward": 0, "dir_fetch": 12, "dir_commit": 85, "dir_split": 9, "dir_merge": 0, "inodes": 319, "inodes_top": 0, "inodes_bottom": 319, "inodes_pin_tail": 0, "inodes_pinned": 319, "inodes_expired": 0, "inodes_with_caps": 2, "caps": 2, "subtrees": 2, "traverse": 3278, "traverse_hit": 3276, "traverse_forward": 0, "traverse_discover": 0, "traverse_dir_fetch": 0, "traverse_remote_ino": 0, "traverse_lock": 0, "load_cent": 223899, "q": 0, "exported": 0, "exported_inodes": 0, "imported": 0, "imported_inodes": 0, "openino_dir_fetch": 0, "openino_backtrace_fetch": 0, "openino_peer_discover": 0, "root_rfiles": 363, "root_rbytes": 2946498560, "root_rsnaps": 0 }, "mds_cache": { "num_strays": 1, "num_strays_delayed": 1, "num_strays_enqueuing": 0, "strays_created": 1601, "strays_enqueued": 1600, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 9, "ireq_fragstats": 0, "ireq_inodestats": 0 }, "mds_log": { "evadd": 10045, "evex": 9736, "evtrm": 9736, "ev": 311, "evexg": 0, "evexd": 9736, "segadd": 13, "segex": 13, "segtrm": 13, "seg": 14, "segexg": 0, "segexd": 13, "expos": 23085414, "wrpos": 23274938, "rdpos": 4195196, "jlat": { "avgcount": 3628, "sum": 19.757546550, "avgtime": 0.005445850 }, "replayed": 2 }, "mds_mem": { "ino": 322, "ino+": 1614, "ino-": 1292, "dir": 76, "dir+": 85, "dir-": 9, "dn": 320, "dn+": 3212, "dn-": 2892, "cap": 1, "cap+": 1602, "cap-": 1601, "rss": 90464, "heap": 331932 }, "mds_server": { "dispatch_client_request": 3351, "dispatch_server_request": 0, "handle_client_request": 3277, "handle_client_session": 4, "handle_slave_request": 0, "req_create_latency": { "avgcount": 1600, "sum": 2.331516366, "avgtime": 0.001457197 }, "req_getattr_latency": { "avgcount": 2, "sum": 0.000941751, "avgtime": 0.000470875 }, "req_getfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_link_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookup_latency": { "avgcount": 1, "sum": 0.001560520, "avgtime": 0.001560520 }, "req_lookuphash_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupino_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupname_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupparent_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lssnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mkdir_latency": { "avgcount": 1, "sum": 0.004721025, "avgtime": 0.004721025 }, "req_mknod_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mksnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_open_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_readdir_latency": { "avgcount": 70, "sum": 0.134635846, "avgtime": 0.001923369 }, "req_rename_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_renamesnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmdir_latency": { "avgcount": 1, "sum": 0.451035564, "avgtime": 0.451035564 }, "req_rmsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setdirlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_symlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_unlink_latency": { "avgcount": 1600, "sum": 3.341804935, "avgtime": 0.002088628 }, "cap_revoke_eviction": 0 }, "mds_sessions": { "session_count": 1, "session_add": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 2752, "average_load": 2752, "avg_session_uptime": 903 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "buffer_anon_bytes": 1143439, "buffer_anon_items": 654, "buffer_meta_bytes": 88, "buffer_meta_items": 1, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6128, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 6338269, "mds_co_items": 79913, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "op_active": 0, "op_laggy": 0, "op_send": 7845, "op_send_bytes": 20058306, "op_resend": 0, "op_reply": 7845, "op": 7845, "op_r": 35, "op_w": 7810, "op_rmw": 0, "op_pg": 0, "osdop_stat": 12, "osdop_create": 314, "osdop_read": 17, "osdop_write": 3637, "osdop_writefull": 10, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 1, "osdop_truncate": 1, "osdop_delete": 3749, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 14, "osdop_setxattr": 628, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 8, "osd_session_open": 8, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 186, "omap_rd": 28, "omap_del": 12 }, "oft": { "omap_total_objs": 0, "omap_total_kv_pairs": 0, "omap_total_updates": 0, "omap_total_removes": 0 }, "purge_queue": { "pq_executing_ops": 0, "pq_executing_ops_high_water": 22, "pq_executing": 0, "pq_executing_high_water": 8, "pq_executed": 1600, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "val": 0, "max": 104857600, "get_started": 0, "get": 16504, "get_sum": 3615320, "get_or_fail_fail": 0, "get_or_fail_success": 16504, "take": 0, "take_sum": 0, "put": 16504, "put_sum": 3615320, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_bytes": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 7845, "take_sum": 20221012, "put": 4083, "put_sum": 20221012, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_ops": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 7845, "take_sum": 7845, "put": 7845, "put_sum": 7845, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle": { "val": 0, "max": 3758096384, "get_started": 0, "get": 1600, "get_sum": 161600, "get_or_fail_fail": 0, "get_or_fail_success": 1600, "take": 0, "take_sum": 0, "put": 9, "put_sum": 161600, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle-0x55eb89907c20": { "val": 184492, "max": 3758096384, "get_started": 0, "get": 10045, "get_sum": 19079304, "get_or_fail_fail": 0, "get_or_fail_success": 10045, "take": 0, "take_sum": 0, "put": 3628, "put_sum": 18894812, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } 2020-05-18T21:35:35.321 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/1, 1600/1601 2020-05-18T21:35:36.321 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:35:36.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.426+0000 7fea005c3700 1 Processor -- start 2020-05-18T21:35:36.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.426+0000 7fea005c3700 1 -- start start 2020-05-18T21:35:36.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fea005c3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe9f80b5050 0x7fe9f814da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:36.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fea005c3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f814aa50 con 0x7fe9f80648f0 2020-05-18T21:35:36.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fea005c3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f80b5430 con 0x7fe9f8065f70 2020-05-18T21:35:36.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fea005c3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f814a840 con 0x7fe9f80b5050 2020-05-18T21:35:36.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fdb5e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe9f80648f0 0x7fe9f814aef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36334/0 (socket says 172.21.15.63:36334) 2020-05-18T21:35:36.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fdb5e700 1 -- 172.21.15.63:0/2307119895 learned_addr learned my addr 172.21.15.63:0/2307119895 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:36.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fe35f700 1 --2- 172.21.15.63:0/2307119895 >> v2:172.21.15.63:3300/0 conn(0x7fe9f80b5050 0x7fe9f814da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:36.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fd35d700 1 -- 172.21.15.63:0/2307119895 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152439258 0 0) 0x7fe9f814aa50 con 0x7fe9f80648f0 2020-05-18T21:35:36.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fd35d700 1 -- 172.21.15.63:0/2307119895 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9e0003270 con 0x7fe9f80648f0 2020-05-18T21:35:36.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fd35d700 1 -- 172.21.15.63:0/2307119895 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3833329376 0 0) 0x7fe9e0003270 con 0x7fe9f80648f0 2020-05-18T21:35:36.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fd35d700 1 -- 172.21.15.63:0/2307119895 >> v2:172.21.15.63:3300/0 conn(0x7fe9f80b5050 msgr2=0x7fe9f814da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:36.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fd35d700 1 --2- 172.21.15.63:0/2307119895 >> v2:172.21.15.63:3300/0 conn(0x7fe9f80b5050 0x7fe9f814da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:36.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fd35d700 1 -- 172.21.15.63:0/2307119895 >> v1:172.21.15.155:6789/0 conn(0x7fe9f8065f70 legacy=0x7fe9f80663c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:36.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fd35d700 1 -- 172.21.15.63:0/2307119895 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f8066ad0 con 0x7fe9f80648f0 2020-05-18T21:35:36.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fd35d700 1 -- 172.21.15.63:0/2307119895 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fe9ec001710 con 0x7fe9f80648f0 2020-05-18T21:35:36.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fd35d700 1 -- 172.21.15.63:0/2307119895 >> v1:172.21.15.63:6789/0 conn(0x7fe9f80648f0 legacy=0x7fe9f814aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:36.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fd35d700 1 --2- 172.21.15.63:0/2307119895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9e0003760 0x7fe9e0003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:36.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fd35d700 1 --2- 172.21.15.63:0/2307119895 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9e0004510 0x7fe9e0004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:36.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fd35d700 1 --2- 172.21.15.63:0/2307119895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9e0004df0 0x7fe9e000b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:36.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fd35d700 1 -- 172.21.15.63:0/2307119895 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f814a840 con 0x7fe9e0004df0 2020-05-18T21:35:36.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fd35d700 1 -- 172.21.15.63:0/2307119895 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e0005300 con 0x7fe9e0003760 2020-05-18T21:35:36.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fd35d700 1 -- 172.21.15.63:0/2307119895 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e000bbc0 con 0x7fe9e0004510 2020-05-18T21:35:36.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fdb5e700 1 --2- 172.21.15.63:0/2307119895 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9e0004510 0x7fe9e0004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:36.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9feb60700 1 --2- 172.21.15.63:0/2307119895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9e0004df0 0x7fe9e000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:36.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fe35f700 1 --2- 172.21.15.63:0/2307119895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9e0003760 0x7fe9e0003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:36.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9feb60700 1 -- 172.21.15.63:0/2307119895 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9e0004510 msgr2=0x7fe9e0004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:36.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9feb60700 1 --2- 172.21.15.63:0/2307119895 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9e0004510 0x7fe9e0004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:36.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9feb60700 1 -- 172.21.15.63:0/2307119895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9e0003760 msgr2=0x7fe9e0003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:36.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9feb60700 1 --2- 172.21.15.63:0/2307119895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9e0003760 0x7fe9e0003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:36.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9feb60700 1 -- 172.21.15.63:0/2307119895 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e0003270 con 0x7fe9e0004df0 2020-05-18T21:35:36.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9feb60700 1 --2- 172.21.15.63:0/2307119895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9e0004df0 0x7fe9e000b760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe9f80b5b60 tx=0x7fe9e00054c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9feb60700 1 -- 172.21.15.63:0/2307119895 reap_dead start 2020-05-18T21:35:36.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9feb60700 1 --2- 172.21.15.63:0/2307119895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9e0004df0 0x7fe9e000b760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe9f80b5b60 tx=0x7fe9e00054c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9feb60700 1 --2- 172.21.15.63:0/2307119895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9e0004df0 0x7fe9e000b760 secure :-1 s=READY pgs=1739 cs=0 l=1 rx=0x7fe9f80b5b60 tx=0x7fe9e00054c0).ready entity=mon.0 client_cookie=334094d05cd26da4 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:36.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9feb60700 1 --2- 172.21.15.63:0/2307119895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9e0004df0 0x7fe9e000b760 secure :-1 s=THROTTLE_DONE pgs=1739 cs=0 l=1 rx=0x7fe9f80b5b60 tx=0x7fe9e00054c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fd35d700 1 -- 172.21.15.63:0/2307119895 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f0006c80 con 0x7fe9e0004df0 2020-05-18T21:35:36.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9feb60700 1 --2- 172.21.15.63:0/2307119895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9e0004df0 0x7fe9e000b760 secure :-1 s=THROTTLE_DONE pgs=1739 cs=0 l=1 rx=0x7fe9f80b5b60 tx=0x7fe9e00054c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fd35d700 1 -- 172.21.15.63:0/2307119895 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f0006de0 con 0x7fe9e0004df0 2020-05-18T21:35:36.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9feb60700 1 --2- 172.21.15.63:0/2307119895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9e0004df0 0x7fe9e000b760 secure :-1 s=THROTTLE_DONE pgs=1739 cs=0 l=1 rx=0x7fe9f80b5b60 tx=0x7fe9e00054c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fe9fd35d700 1 -- 172.21.15.63:0/2307119895 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f0002770 con 0x7fe9e0004df0 2020-05-18T21:35:36.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fea005c3700 1 -- 172.21.15.63:0/2307119895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9e0004df0 msgr2=0x7fe9e000b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:36.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.430+0000 7fea005c3700 1 --2- 172.21.15.63:0/2307119895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9e0004df0 0x7fe9e000b760 secure :-1 s=READY pgs=1739 cs=0 l=1 rx=0x7fe9f80b5b60 tx=0x7fe9e00054c0).stop 2020-05-18T21:35:36.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.434+0000 7fea005c3700 1 -- 172.21.15.63:0/2307119895 shutdown_connections 2020-05-18T21:35:36.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.434+0000 7fea005c3700 1 --2- 172.21.15.63:0/2307119895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9e0004df0 0x7fe9e000b760 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:36.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.434+0000 7fea005c3700 1 -- 172.21.15.63:0/2307119895 >> 172.21.15.63:0/2307119895 conn(0x7fe9f80b8630 msgr2=0x7fe9f80b8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:36.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.434+0000 7fea005c3700 1 -- 172.21.15.63:0/2307119895 shutdown_connections 2020-05-18T21:35:36.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.434+0000 7fea005c3700 1 -- 172.21.15.63:0/2307119895 wait complete. 2020-05-18T21:35:36.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.434+0000 7fea005c3700 1 Processor -- start 2020-05-18T21:35:36.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.434+0000 7fea005c3700 1 -- start start 2020-05-18T21:35:36.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.434+0000 7fea005c3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe9e0004df0 0x7fe9f80ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:36.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.434+0000 7fea005c3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe9f80af650 0x7fe9f815af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:36.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.434+0000 7fea005c3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f80b1c40 con 0x7fe9f815b390 2020-05-18T21:35:36.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.434+0000 7fea005c3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f80b1ee0 con 0x7fe9f80af650 2020-05-18T21:35:36.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.434+0000 7fea005c3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f80b6530 con 0x7fe9e0004df0 2020-05-18T21:35:36.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9fdb5e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe9f80af650 0x7fe9f815af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:36.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9fdb5e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe9f80af650 0x7fe9f815af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34160/0 (socket says 172.21.15.63:34160) 2020-05-18T21:35:36.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9fdb5e700 1 -- 172.21.15.63:0/2202398500 learned_addr learned my addr 172.21.15.63:0/2202398500 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:36.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9fe35f700 1 --2- 172.21.15.63:0/2202398500 >> v2:172.21.15.155:3300/0 conn(0x7fe9e0004df0 0x7fe9f80ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:36.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9fdb5e700 1 -- 172.21.15.63:0/2202398500 >> v2:172.21.15.155:3300/0 conn(0x7fe9e0004df0 msgr2=0x7fe9f80ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:36.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9fdb5e700 1 --2- 172.21.15.63:0/2202398500 >> v2:172.21.15.155:3300/0 conn(0x7fe9e0004df0 0x7fe9f80ae840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:36.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9fdb5e700 1 -- 172.21.15.63:0/2202398500 >> v1:172.21.15.155:6789/0 conn(0x7fe9f815b390 legacy=0x7fe9f8157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:36.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9fdb5e700 1 -- 172.21.15.63:0/2202398500 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f80afa90 con 0x7fe9f80af650 2020-05-18T21:35:36.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9fe35f700 1 --2- 172.21.15.63:0/2202398500 >> v2:172.21.15.155:3300/0 conn(0x7fe9e0004df0 0x7fe9f80ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:35:36.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9fdb5e700 1 --2- 172.21.15.63:0/2202398500 >> v2:172.21.15.63:3300/0 conn(0x7fe9f80af650 0x7fe9f815af30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9ec001c70 tx=0x7fe9f8066c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9fdb5e700 1 --2- 172.21.15.63:0/2202398500 >> v2:172.21.15.63:3300/0 conn(0x7fe9f80af650 0x7fe9f815af30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9ec001c70 tx=0x7fe9f8066c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9fdb5e700 1 --2- 172.21.15.63:0/2202398500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9f80af650 0x7fe9f815af30 secure :-1 s=READY pgs=1740 cs=0 l=1 rx=0x7fe9ec001c70 tx=0x7fe9f8066c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:36.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9fdb5e700 1 --2- 172.21.15.63:0/2202398500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9f80af650 0x7fe9f815af30 secure :-1 s=THROTTLE_DONE pgs=1740 cs=0 l=1 rx=0x7fe9ec001c70 tx=0x7fe9f8066c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9fdb5e700 1 --2- 172.21.15.63:0/2202398500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9f80af650 0x7fe9f815af30 secure :-1 s=THROTTLE_DONE pgs=1740 cs=0 l=1 rx=0x7fe9ec001c70 tx=0x7fe9f8066c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9eb7fe700 1 -- 172.21.15.63:0/2202398500 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9ec00ccb0 con 0x7fe9f80af650 2020-05-18T21:35:36.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9fdb5e700 1 --2- 172.21.15.63:0/2202398500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9f80af650 0x7fe9f815af30 secure :-1 s=THROTTLE_DONE pgs=1740 cs=0 l=1 rx=0x7fe9ec001c70 tx=0x7fe9f8066c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9eb7fe700 1 -- 172.21.15.63:0/2202398500 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec00ce10 con 0x7fe9f80af650 2020-05-18T21:35:36.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fea005c3700 1 -- 172.21.15.63:0/2202398500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f815bab0 con 0x7fe9f80af650 2020-05-18T21:35:36.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9eb7fe700 1 -- 172.21.15.63:0/2202398500 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9ec012a80 con 0x7fe9f80af650 2020-05-18T21:35:36.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fea005c3700 1 -- 172.21.15.63:0/2202398500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f80b79e0 con 0x7fe9f80af650 2020-05-18T21:35:36.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9fdb5e700 1 --2- 172.21.15.63:0/2202398500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9f80af650 0x7fe9f815af30 secure :-1 s=THROTTLE_DONE pgs=1740 cs=0 l=1 rx=0x7fe9ec001c70 tx=0x7fe9f8066c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9eb7fe700 1 -- 172.21.15.63:0/2202398500 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe9ec012cf0 con 0x7fe9f80af650 2020-05-18T21:35:36.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9fdb5e700 1 --2- 172.21.15.63:0/2202398500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9f80af650 0x7fe9f815af30 secure :-1 s=THROTTLE_DONE pgs=1740 cs=0 l=1 rx=0x7fe9ec001c70 tx=0x7fe9f8066c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fea005c3700 1 -- 172.21.15.63:0/2202398500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f80569e0 con 0x7fe9f80af650 2020-05-18T21:35:36.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9eb7fe700 1 --2- 172.21.15.63:0/2202398500 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9d804f9e0 0x7fe9d8051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:36.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9eb7fe700 1 -- 172.21.15.63:0/2202398500 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe9ec063e90 con 0x7fe9f80af650 2020-05-18T21:35:36.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9fe35f700 1 --2- 172.21.15.63:0/2202398500 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9d804f9e0 0x7fe9d8051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:36.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.438+0000 7fe9fe35f700 1 --2- 172.21.15.63:0/2202398500 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9d804f9e0 0x7fe9d8051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9f4002f70 tx=0x7fe9f805fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.442+0000 7fe9fe35f700 1 --2- 172.21.15.63:0/2202398500 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9d804f9e0 0x7fe9d8051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9f4002f70 tx=0x7fe9f805fbd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.442+0000 7fe9fe35f700 1 --2- 172.21.15.63:0/2202398500 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9d804f9e0 0x7fe9d8051ea0 secure :-1 s=READY pgs=672 cs=0 l=1 rx=0x7fe9f4002f70 tx=0x7fe9f805fbd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:36.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.446+0000 7fe9fdb5e700 1 --2- 172.21.15.63:0/2202398500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9f80af650 0x7fe9f815af30 secure :-1 s=THROTTLE_DONE pgs=1740 cs=0 l=1 rx=0x7fe9ec001c70 tx=0x7fe9f8066c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.446+0000 7fe9eb7fe700 1 -- 172.21.15.63:0/2202398500 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe9ec03e280 con 0x7fe9f80af650 2020-05-18T21:35:36.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.594+0000 7fea005c3700 1 -- 172.21.15.63:0/2202398500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9f8064120 con 0x7fe9f80af650 2020-05-18T21:35:36.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.598+0000 7fe9fdb5e700 1 --2- 172.21.15.63:0/2202398500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9f80af650 0x7fe9f815af30 secure :-1 s=THROTTLE_DONE pgs=1740 cs=0 l=1 rx=0x7fe9ec001c70 tx=0x7fe9f8066c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.598+0000 7fe9eb7fe700 1 -- 172.21.15.63:0/2202398500 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fe9ec0418a0 con 0x7fe9f80af650 2020-05-18T21:35:36.602 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:36.602 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":98,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/3483934102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3483934102},{"type":"v1","addr":"172.21.15.155:6835","nonce":3483934102}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":98}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:34:27.767123+0000","modified":"2020-05-18T21:34:41.281280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"a","rank":0,"incarnation":94,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6833/1314928434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1314928434},{"type":"v1","addr":"172.21.15.63:6833","nonce":1314928434}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-05-18T21:35:36.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.598+0000 7fea005c3700 1 -- 172.21.15.63:0/2202398500 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9d804f9e0 msgr2=0x7fe9d8051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:36.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.598+0000 7fea005c3700 1 --2- 172.21.15.63:0/2202398500 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9d804f9e0 0x7fe9d8051ea0 secure :-1 s=READY pgs=672 cs=0 l=1 rx=0x7fe9f4002f70 tx=0x7fe9f805fbd0).stop 2020-05-18T21:35:36.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.598+0000 7fea005c3700 1 -- 172.21.15.63:0/2202398500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9f80af650 msgr2=0x7fe9f815af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:36.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.598+0000 7fea005c3700 1 --2- 172.21.15.63:0/2202398500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9f80af650 0x7fe9f815af30 secure :-1 s=READY pgs=1740 cs=0 l=1 rx=0x7fe9ec001c70 tx=0x7fe9f8066c60).stop 2020-05-18T21:35:36.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.598+0000 7fea005c3700 1 -- 172.21.15.63:0/2202398500 shutdown_connections 2020-05-18T21:35:36.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.598+0000 7fea005c3700 1 --2- 172.21.15.63:0/2202398500 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe9d804f9e0 0x7fe9d8051ea0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:36.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.598+0000 7fea005c3700 1 --2- 172.21.15.63:0/2202398500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9f80af650 0x7fe9f815af30 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:36.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.598+0000 7fea005c3700 1 --2- 172.21.15.63:0/2202398500 >> v2:172.21.15.155:3300/0 conn(0x7fe9e0004df0 0x7fe9f80ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:36.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.598+0000 7fea005c3700 1 -- 172.21.15.63:0/2202398500 >> 172.21.15.63:0/2202398500 conn(0x7fe9f80b8630 msgr2=0x7fe9f805af60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:36.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.598+0000 7fea005c3700 1 -- 172.21.15.63:0/2202398500 shutdown_connections 2020-05-18T21:35:36.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.598+0000 7fea005c3700 1 -- 172.21.15.63:0/2202398500 wait complete. 2020-05-18T21:35:36.607 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 98 2020-05-18T21:35:36.619 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2020-05-18T21:35:36.719 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:35:36.719 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-0": { 2020-05-18T21:35:36.719 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 1607, 2020-05-18T21:35:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 1602, 2020-05-18T21:35:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 625132, 2020-05-18T21:35:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 755764, 2020-05-18T21:35:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 6, 2020-05-18T21:35:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 1, 2020-05-18T21:35:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.109232497, 2020-05-18T21:35:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.031333958, 2020-05-18T21:35:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.037306108, 2020-05-18T21:35:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.034711950, 2020-05-18T21:35:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:36.722 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1602, 2020-05-18T21:35:36.722 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.166567205, 2020-05-18T21:35:36.722 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000103974 2020-05-18T21:35:36.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.722 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-1": { 2020-05-18T21:35:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 2381, 2020-05-18T21:35:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 2394, 2020-05-18T21:35:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 570341, 2020-05-18T21:35:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 7837044, 2020-05-18T21:35:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 6, 2020-05-18T21:35:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 3, 2020-05-18T21:35:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.256599151, 2020-05-18T21:35:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.097932977, 2020-05-18T21:35:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.058407665, 2020-05-18T21:35:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.083040059, 2020-05-18T21:35:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 2394, 2020-05-18T21:35:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.148451972, 2020-05-18T21:35:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000062010 2020-05-18T21:35:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-2": { 2020-05-18T21:35:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 12590, 2020-05-18T21:35:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 22625, 2020-05-18T21:35:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 3659114, 2020-05-18T21:35:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 21667235, 2020-05-18T21:35:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 6, 2020-05-18T21:35:36.729 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 3, 2020-05-18T21:35:36.729 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 1.898943730, 2020-05-18T21:35:36.729 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.903864636, 2020-05-18T21:35:36.729 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.991665521, 2020-05-18T21:35:36.729 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.142911995, 2020-05-18T21:35:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 22624, 2020-05-18T21:35:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 1.141545952, 2020-05-18T21:35:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000050457 2020-05-18T21:35:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 24775, 2020-05-18T21:35:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.008674593, 2020-05-18T21:35:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000350 2020-05-18T21:35:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: "cct": { 2020-05-18T21:35:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: "total_workers": 1, 2020-05-18T21:35:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: "unhealthy_workers": 0 2020-05-18T21:35:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-MDSRank": { 2020-05-18T21:35:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2020-05-18T21:35:36.733 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2020-05-18T21:35:36.733 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 6490, 2020-05-18T21:35:36.733 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 4.505306491, 2020-05-18T21:35:36.733 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000694192 2020-05-18T21:35:36.733 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-PurgeQueue": { 2020-05-18T21:35:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2020-05-18T21:35:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2020-05-18T21:35:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 4328, 2020-05-18T21:35:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.471602044, 2020-05-18T21:35:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000108965 2020-05-18T21:35:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2020-05-18T21:35:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: "request": 3277, 2020-05-18T21:35:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: "reply": 3275, 2020-05-18T21:35:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: "reply_latency": { 2020-05-18T21:35:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 3275, 2020-05-18T21:35:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 6.266216007, 2020-05-18T21:35:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001913348 2020-05-18T21:35:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: "forward": 0, 2020-05-18T21:35:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_fetch": 12, 2020-05-18T21:35:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_commit": 85, 2020-05-18T21:35:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_split": 9, 2020-05-18T21:35:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_merge": 0, 2020-05-18T21:35:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes": 319, 2020-05-18T21:35:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_top": 0, 2020-05-18T21:35:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_bottom": 319, 2020-05-18T21:35:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pin_tail": 0, 2020-05-18T21:35:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pinned": 319, 2020-05-18T21:35:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_expired": 0, 2020-05-18T21:35:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_with_caps": 1, 2020-05-18T21:35:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": 1, 2020-05-18T21:35:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: "subtrees": 2, 2020-05-18T21:35:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse": 3278, 2020-05-18T21:35:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_hit": 3276, 2020-05-18T21:35:36.740 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_forward": 0, 2020-05-18T21:35:36.740 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_discover": 0, 2020-05-18T21:35:36.740 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_dir_fetch": 0, 2020-05-18T21:35:36.740 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_remote_ino": 0, 2020-05-18T21:35:36.740 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_lock": 0, 2020-05-18T21:35:36.740 INFO:teuthology.orchestra.run.smithi063.stdout: "load_cent": 12421, 2020-05-18T21:35:36.741 INFO:teuthology.orchestra.run.smithi063.stdout: "q": 0, 2020-05-18T21:35:36.741 INFO:teuthology.orchestra.run.smithi063.stdout: "exported": 0, 2020-05-18T21:35:36.741 INFO:teuthology.orchestra.run.smithi063.stdout: "exported_inodes": 0, 2020-05-18T21:35:36.741 INFO:teuthology.orchestra.run.smithi063.stdout: "imported": 0, 2020-05-18T21:35:36.741 INFO:teuthology.orchestra.run.smithi063.stdout: "imported_inodes": 0, 2020-05-18T21:35:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_dir_fetch": 0, 2020-05-18T21:35:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_backtrace_fetch": 0, 2020-05-18T21:35:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_peer_discover": 0, 2020-05-18T21:35:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rfiles": 0, 2020-05-18T21:35:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rbytes": 0, 2020-05-18T21:35:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rsnaps": 0 2020-05-18T21:35:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:35:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays": 0, 2020-05-18T21:35:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_delayed": 0, 2020-05-18T21:35:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:35:36.747 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_created": 1601, 2020-05-18T21:35:36.747 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 1601, 2020-05-18T21:35:36.747 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_reintegrated": 0, 2020-05-18T21:35:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_migrated": 0, 2020-05-18T21:35:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_processing": 0, 2020-05-18T21:35:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:35:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:35:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_started": 0, 2020-05-18T21:35:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_completed": 0, 2020-05-18T21:35:36.749 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:35:36.749 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_exportdir": 0, 2020-05-18T21:35:36.749 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_flush": 0, 2020-05-18T21:35:36.749 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragmentdir": 9, 2020-05-18T21:35:36.749 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragstats": 0, 2020-05-18T21:35:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_inodestats": 0 2020-05-18T21:35:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log": { 2020-05-18T21:35:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: "evadd": 10046, 2020-05-18T21:35:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: "evex": 9736, 2020-05-18T21:35:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: "evtrm": 9736, 2020-05-18T21:35:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: "ev": 312, 2020-05-18T21:35:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: "evexg": 0, 2020-05-18T21:35:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: "evexd": 9736, 2020-05-18T21:35:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: "segadd": 13, 2020-05-18T21:35:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: "segex": 13, 2020-05-18T21:35:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: "segtrm": 13, 2020-05-18T21:35:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: "seg": 14, 2020-05-18T21:35:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: "segexg": 0, 2020-05-18T21:35:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: "segexd": 13, 2020-05-18T21:35:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: "expos": 23085414, 2020-05-18T21:35:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: "wrpos": 23275537, 2020-05-18T21:35:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: "rdpos": 4195196, 2020-05-18T21:35:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: "jlat": { 2020-05-18T21:35:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 3629, 2020-05-18T21:35:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 19.764976717, 2020-05-18T21:35:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.005446397 2020-05-18T21:35:36.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.754 INFO:teuthology.orchestra.run.smithi063.stdout: "replayed": 2 2020-05-18T21:35:36.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.754 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_mem": { 2020-05-18T21:35:36.754 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 13, 2020-05-18T21:35:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: "ino+": 1614, 2020-05-18T21:35:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: "ino-": 1601, 2020-05-18T21:35:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: "dir": 12, 2020-05-18T21:35:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: "dir+": 85, 2020-05-18T21:35:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: "dir-": 73, 2020-05-18T21:35:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: "dn": 320, 2020-05-18T21:35:36.756 INFO:teuthology.orchestra.run.smithi063.stdout: "dn+": 3212, 2020-05-18T21:35:36.756 INFO:teuthology.orchestra.run.smithi063.stdout: "dn-": 2892, 2020-05-18T21:35:36.756 INFO:teuthology.orchestra.run.smithi063.stdout: "cap": 1, 2020-05-18T21:35:36.756 INFO:teuthology.orchestra.run.smithi063.stdout: "cap+": 1602, 2020-05-18T21:35:36.756 INFO:teuthology.orchestra.run.smithi063.stdout: "cap-": 1601, 2020-05-18T21:35:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: "rss": 90464, 2020-05-18T21:35:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: "heap": 331932 2020-05-18T21:35:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_server": { 2020-05-18T21:35:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_client_request": 3351, 2020-05-18T21:35:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_server_request": 0, 2020-05-18T21:35:36.758 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_request": 3277, 2020-05-18T21:35:36.758 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_session": 4, 2020-05-18T21:35:36.758 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_slave_request": 0, 2020-05-18T21:35:36.758 INFO:teuthology.orchestra.run.smithi063.stdout: "req_create_latency": { 2020-05-18T21:35:36.758 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1600, 2020-05-18T21:35:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 2.331516366, 2020-05-18T21:35:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001457197 2020-05-18T21:35:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getattr_latency": { 2020-05-18T21:35:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 2, 2020-05-18T21:35:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000941751, 2020-05-18T21:35:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000470875 2020-05-18T21:35:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getfilelock_latency": { 2020-05-18T21:35:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.761 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.761 INFO:teuthology.orchestra.run.smithi063.stdout: "req_link_latency": { 2020-05-18T21:35:36.761 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.761 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.762 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.762 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookup_latency": { 2020-05-18T21:35:36.762 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:36.763 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.001560520, 2020-05-18T21:35:36.763 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001560520 2020-05-18T21:35:36.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.763 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookuphash_latency": { 2020-05-18T21:35:36.763 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.763 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.764 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.764 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupino_latency": { 2020-05-18T21:35:36.764 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.764 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.765 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.765 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupname_latency": { 2020-05-18T21:35:36.765 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.765 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.766 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.767 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupparent_latency": { 2020-05-18T21:35:36.767 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.767 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.767 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.768 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupsnap_latency": { 2020-05-18T21:35:36.768 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.768 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.768 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.768 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lssnap_latency": { 2020-05-18T21:35:36.769 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.769 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.769 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.769 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mkdir_latency": { 2020-05-18T21:35:36.770 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:36.770 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.004721025, 2020-05-18T21:35:36.770 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.004721025 2020-05-18T21:35:36.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.770 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mknod_latency": { 2020-05-18T21:35:36.770 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.771 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.771 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.771 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mksnap_latency": { 2020-05-18T21:35:36.771 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.772 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.772 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.772 INFO:teuthology.orchestra.run.smithi063.stdout: "req_open_latency": { 2020-05-18T21:35:36.772 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.772 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.773 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.773 INFO:teuthology.orchestra.run.smithi063.stdout: "req_readdir_latency": { 2020-05-18T21:35:36.773 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 70, 2020-05-18T21:35:36.773 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.134635846, 2020-05-18T21:35:36.774 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001923369 2020-05-18T21:35:36.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.774 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rename_latency": { 2020-05-18T21:35:36.774 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.774 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.774 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.775 INFO:teuthology.orchestra.run.smithi063.stdout: "req_renamesnap_latency": { 2020-05-18T21:35:36.775 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.775 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.775 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.776 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmdir_latency": { 2020-05-18T21:35:36.776 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:36.776 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.451035564, 2020-05-18T21:35:36.776 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.451035564 2020-05-18T21:35:36.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.777 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmsnap_latency": { 2020-05-18T21:35:36.777 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.777 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.777 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.778 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmxattr_latency": { 2020-05-18T21:35:36.778 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.778 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.778 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.778 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.778 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setattr_latency": { 2020-05-18T21:35:36.779 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.779 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.779 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.779 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.779 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setdirlayout_latency": { 2020-05-18T21:35:36.780 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.780 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.780 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.780 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setfilelock_latency": { 2020-05-18T21:35:36.780 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.781 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.781 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.781 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.788 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setlayout_latency": { 2020-05-18T21:35:36.788 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.788 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.788 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.789 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setxattr_latency": { 2020-05-18T21:35:36.789 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.789 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.789 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.790 INFO:teuthology.orchestra.run.smithi063.stdout: "req_symlink_latency": { 2020-05-18T21:35:36.790 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.790 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.790 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.791 INFO:teuthology.orchestra.run.smithi063.stdout: "req_unlink_latency": { 2020-05-18T21:35:36.791 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1600, 2020-05-18T21:35:36.791 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 3.341804935, 2020-05-18T21:35:36.791 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.002088628 2020-05-18T21:35:36.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.792 INFO:teuthology.orchestra.run.smithi063.stdout: "cap_revoke_eviction": 0 2020-05-18T21:35:36.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.792 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_sessions": { 2020-05-18T21:35:36.792 INFO:teuthology.orchestra.run.smithi063.stdout: "session_count": 1, 2020-05-18T21:35:36.792 INFO:teuthology.orchestra.run.smithi063.stdout: "session_add": 1, 2020-05-18T21:35:36.793 INFO:teuthology.orchestra.run.smithi063.stdout: "session_remove": 0, 2020-05-18T21:35:36.793 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_open": 1, 2020-05-18T21:35:36.793 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_stale": 0, 2020-05-18T21:35:36.793 INFO:teuthology.orchestra.run.smithi063.stdout: "total_load": 2752, 2020-05-18T21:35:36.793 INFO:teuthology.orchestra.run.smithi063.stdout: "average_load": 2752, 2020-05-18T21:35:36.793 INFO:teuthology.orchestra.run.smithi063.stdout: "avg_session_uptime": 908 2020-05-18T21:35:36.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.794 INFO:teuthology.orchestra.run.smithi063.stdout: "mempool": { 2020-05-18T21:35:36.794 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_bytes": 0, 2020-05-18T21:35:36.794 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_items": 0, 2020-05-18T21:35:36.794 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_bytes": 0, 2020-05-18T21:35:36.795 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_items": 0, 2020-05-18T21:35:36.795 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_bytes": 0, 2020-05-18T21:35:36.795 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_items": 0, 2020-05-18T21:35:36.795 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_bytes": 0, 2020-05-18T21:35:36.795 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_items": 0, 2020-05-18T21:35:36.796 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_bytes": 0, 2020-05-18T21:35:36.796 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_items": 0, 2020-05-18T21:35:36.796 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_bytes": 0, 2020-05-18T21:35:36.796 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_items": 0, 2020-05-18T21:35:36.797 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_bytes": 0, 2020-05-18T21:35:36.797 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_items": 0, 2020-05-18T21:35:36.797 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_bytes": 0, 2020-05-18T21:35:36.797 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_items": 0, 2020-05-18T21:35:36.797 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_bytes": 0, 2020-05-18T21:35:36.798 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_items": 0, 2020-05-18T21:35:36.798 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_bytes": 0, 2020-05-18T21:35:36.798 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_items": 0, 2020-05-18T21:35:36.798 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_bytes": 2611091, 2020-05-18T21:35:36.798 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_items": 714, 2020-05-18T21:35:36.799 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_bytes": 0, 2020-05-18T21:35:36.799 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_items": 0, 2020-05-18T21:35:36.799 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bytes": 0, 2020-05-18T21:35:36.799 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_items": 0, 2020-05-18T21:35:36.799 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_bytes": 0, 2020-05-18T21:35:36.800 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_items": 0, 2020-05-18T21:35:36.800 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_bytes": 0, 2020-05-18T21:35:36.800 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_items": 0, 2020-05-18T21:35:36.800 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_bytes": 6128, 2020-05-18T21:35:36.800 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_items": 93, 2020-05-18T21:35:36.801 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_bytes": 0, 2020-05-18T21:35:36.801 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_items": 0, 2020-05-18T21:35:36.801 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_bytes": 0, 2020-05-18T21:35:36.801 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_items": 0, 2020-05-18T21:35:36.801 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_bytes": 937764, 2020-05-18T21:35:36.802 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_items": 15942, 2020-05-18T21:35:36.802 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_bytes": 0, 2020-05-18T21:35:36.802 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_items": 0, 2020-05-18T21:35:36.802 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_bytes": 0, 2020-05-18T21:35:36.802 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_items": 0 2020-05-18T21:35:36.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.803 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter": { 2020-05-18T21:35:36.804 INFO:teuthology.orchestra.run.smithi063.stdout: "op_active": 0, 2020-05-18T21:35:36.804 INFO:teuthology.orchestra.run.smithi063.stdout: "op_laggy": 0, 2020-05-18T21:35:36.804 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send": 7915, 2020-05-18T21:35:36.804 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send_bytes": 20243671, 2020-05-18T21:35:36.805 INFO:teuthology.orchestra.run.smithi063.stdout: "op_resend": 0, 2020-05-18T21:35:36.805 INFO:teuthology.orchestra.run.smithi063.stdout: "op_reply": 7915, 2020-05-18T21:35:36.805 INFO:teuthology.orchestra.run.smithi063.stdout: "op": 7915, 2020-05-18T21:35:36.805 INFO:teuthology.orchestra.run.smithi063.stdout: "op_r": 36, 2020-05-18T21:35:36.805 INFO:teuthology.orchestra.run.smithi063.stdout: "op_w": 7879, 2020-05-18T21:35:36.806 INFO:teuthology.orchestra.run.smithi063.stdout: "op_rmw": 0, 2020-05-18T21:35:36.806 INFO:teuthology.orchestra.run.smithi063.stdout: "op_pg": 0, 2020-05-18T21:35:36.806 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_stat": 12, 2020-05-18T21:35:36.806 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_create": 314, 2020-05-18T21:35:36.806 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_read": 18, 2020-05-18T21:35:36.807 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_write": 3639, 2020-05-18T21:35:36.807 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writefull": 11, 2020-05-18T21:35:36.807 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writesame": 0, 2020-05-18T21:35:36.807 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_append": 0, 2020-05-18T21:35:36.807 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_zero": 1, 2020-05-18T21:35:36.808 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_truncate": 1, 2020-05-18T21:35:36.808 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_delete": 3814, 2020-05-18T21:35:36.808 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_mapext": 0, 2020-05-18T21:35:36.808 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_sparse_read": 0, 2020-05-18T21:35:36.809 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_clonerange": 0, 2020-05-18T21:35:36.809 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_getxattr": 14, 2020-05-18T21:35:36.809 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_setxattr": 628, 2020-05-18T21:35:36.809 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_cmpxattr": 0, 2020-05-18T21:35:36.809 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_rmxattr": 0, 2020-05-18T21:35:36.809 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_resetxattrs": 0, 2020-05-18T21:35:36.810 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_call": 0, 2020-05-18T21:35:36.810 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_watch": 0, 2020-05-18T21:35:36.810 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_notify": 0, 2020-05-18T21:35:36.810 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_src_cmpxattr": 0, 2020-05-18T21:35:36.810 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls": 0, 2020-05-18T21:35:36.811 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls_filter": 0, 2020-05-18T21:35:36.811 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_other": 0, 2020-05-18T21:35:36.811 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_active": 0, 2020-05-18T21:35:36.811 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_send": 0, 2020-05-18T21:35:36.811 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_resend": 0, 2020-05-18T21:35:36.811 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_ping": 0, 2020-05-18T21:35:36.812 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_active": 0, 2020-05-18T21:35:36.812 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_send": 0, 2020-05-18T21:35:36.812 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_resend": 0, 2020-05-18T21:35:36.812 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_active": 0, 2020-05-18T21:35:36.812 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_send": 0, 2020-05-18T21:35:36.813 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_resend": 0, 2020-05-18T21:35:36.813 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_active": 0, 2020-05-18T21:35:36.813 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_send": 0, 2020-05-18T21:35:36.813 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_resend": 0, 2020-05-18T21:35:36.813 INFO:teuthology.orchestra.run.smithi063.stdout: "command_active": 0, 2020-05-18T21:35:36.813 INFO:teuthology.orchestra.run.smithi063.stdout: "command_send": 0, 2020-05-18T21:35:36.814 INFO:teuthology.orchestra.run.smithi063.stdout: "command_resend": 0, 2020-05-18T21:35:36.814 INFO:teuthology.orchestra.run.smithi063.stdout: "map_epoch": 0, 2020-05-18T21:35:36.814 INFO:teuthology.orchestra.run.smithi063.stdout: "map_full": 0, 2020-05-18T21:35:36.814 INFO:teuthology.orchestra.run.smithi063.stdout: "map_inc": 0, 2020-05-18T21:35:36.814 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_sessions": 8, 2020-05-18T21:35:36.815 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_open": 8, 2020-05-18T21:35:36.815 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_close": 0, 2020-05-18T21:35:36.815 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_laggy": 0, 2020-05-18T21:35:36.815 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_wr": 187, 2020-05-18T21:35:36.815 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_rd": 28, 2020-05-18T21:35:36.816 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_del": 13 2020-05-18T21:35:36.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.816 INFO:teuthology.orchestra.run.smithi063.stdout: "oft": { 2020-05-18T21:35:36.816 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_objs": 0, 2020-05-18T21:35:36.817 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_kv_pairs": 0, 2020-05-18T21:35:36.817 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_updates": 0, 2020-05-18T21:35:36.817 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_removes": 0 2020-05-18T21:35:36.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.817 INFO:teuthology.orchestra.run.smithi063.stdout: "purge_queue": { 2020-05-18T21:35:36.818 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops": 0, 2020-05-18T21:35:36.818 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops_high_water": 65, 2020-05-18T21:35:36.818 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing": 0, 2020-05-18T21:35:36.818 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_high_water": 8, 2020-05-18T21:35:36.818 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executed": 1601, 2020-05-18T21:35:36.818 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_item_in_journal": 0 2020-05-18T21:35:36.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.819 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-05-18T21:35:36.819 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:36.819 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2020-05-18T21:35:36.819 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:36.819 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 16575, 2020-05-18T21:35:36.820 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 3627045, 2020-05-18T21:35:36.820 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:36.820 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 16575, 2020-05-18T21:35:36.820 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:36.820 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:36.821 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 16575, 2020-05-18T21:35:36.821 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 3627045, 2020-05-18T21:35:36.821 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:36.821 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.821 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.821 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.822 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:36.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.822 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_bytes": { 2020-05-18T21:35:36.822 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:36.822 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2020-05-18T21:35:36.823 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:36.823 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2020-05-18T21:35:36.823 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2020-05-18T21:35:36.823 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:36.823 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2020-05-18T21:35:36.823 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 7915, 2020-05-18T21:35:36.824 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 20406486, 2020-05-18T21:35:36.824 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 4088, 2020-05-18T21:35:36.824 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 20406486, 2020-05-18T21:35:36.824 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:36.824 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.825 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.825 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.825 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:36.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.825 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_ops": { 2020-05-18T21:35:36.825 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:36.826 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 1024, 2020-05-18T21:35:36.826 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:36.826 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2020-05-18T21:35:36.826 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2020-05-18T21:35:36.826 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:36.827 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2020-05-18T21:35:36.827 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 7915, 2020-05-18T21:35:36.827 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 7915, 2020-05-18T21:35:36.827 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 7915, 2020-05-18T21:35:36.827 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 7915, 2020-05-18T21:35:36.827 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:36.828 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.828 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.828 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.828 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:36.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.829 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle": { 2020-05-18T21:35:36.829 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:36.829 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2020-05-18T21:35:36.829 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:36.829 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 1601, 2020-05-18T21:35:36.829 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 161709, 2020-05-18T21:35:36.830 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:36.830 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 1601, 2020-05-18T21:35:36.830 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:36.830 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:36.830 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 10, 2020-05-18T21:35:36.830 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 161709, 2020-05-18T21:35:36.831 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:36.831 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.831 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.831 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.831 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:36.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:36.832 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle-0x55eb89907c20": { 2020-05-18T21:35:36.832 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:36.833 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2020-05-18T21:35:36.833 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:36.833 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 10046, 2020-05-18T21:35:36.833 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 19079903, 2020-05-18T21:35:36.833 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:36.834 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 10046, 2020-05-18T21:35:36.834 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:36.834 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:36.834 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 3629, 2020-05-18T21:35:36.834 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 19079903, 2020-05-18T21:35:36.835 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:36.835 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:36.835 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:36.835 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:36.835 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:36.835 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:36.836 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:35:36.837 INFO:tasks.cephfs.filesystem:_json_asok output: { "AsyncMessenger::Worker-0": { "msgr_recv_messages": 1607, "msgr_send_messages": 1602, "msgr_recv_bytes": 625132, "msgr_send_bytes": 755764, "msgr_created_connections": 6, "msgr_active_connections": 1, "msgr_running_total_time": 0.109232497, "msgr_running_send_time": 0.031333958, "msgr_running_recv_time": 0.037306108, "msgr_running_fast_dispatch_time": 0.034711950, "msgr_send_messages_queue_lat": { "avgcount": 1602, "sum": 0.166567205, "avgtime": 0.000103974 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-1": { "msgr_recv_messages": 2381, "msgr_send_messages": 2394, "msgr_recv_bytes": 570341, "msgr_send_bytes": 7837044, "msgr_created_connections": 6, "msgr_active_connections": 3, "msgr_running_total_time": 0.256599151, "msgr_running_send_time": 0.097932977, "msgr_running_recv_time": 0.058407665, "msgr_running_fast_dispatch_time": 0.083040059, "msgr_send_messages_queue_lat": { "avgcount": 2394, "sum": 0.148451972, "avgtime": 0.000062010 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-2": { "msgr_recv_messages": 12590, "msgr_send_messages": 22625, "msgr_recv_bytes": 3659114, "msgr_send_bytes": 21667235, "msgr_created_connections": 6, "msgr_active_connections": 3, "msgr_running_total_time": 1.898943730, "msgr_running_send_time": 0.903864636, "msgr_running_recv_time": 0.991665521, "msgr_running_fast_dispatch_time": 0.142911995, "msgr_send_messages_queue_lat": { "avgcount": 22624, "sum": 1.141545952, "avgtime": 0.000050457 }, "msgr_handle_ack_lat": { "avgcount": 24775, "sum": 0.008674593, "avgtime": 0.000000350 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "queue_len": 0, "complete_latency": { "avgcount": 6490, "sum": 4.505306491, "avgtime": 0.000694192 } }, "finisher-PurgeQueue": { "queue_len": 0, "complete_latency": { "avgcount": 4328, "sum": 0.471602044, "avgtime": 0.000108965 } }, "mds": { "request": 3277, "reply": 3275, "reply_latency": { "avgcount": 3275, "sum": 6.266216007, "avgtime": 0.001913348 }, "forward": 0, "dir_fetch": 12, "dir_commit": 85, "dir_split": 9, "dir_merge": 0, "inodes": 319, "inodes_top": 0, "inodes_bottom": 319, "inodes_pin_tail": 0, "inodes_pinned": 319, "inodes_expired": 0, "inodes_with_caps": 1, "caps": 1, "subtrees": 2, "traverse": 3278, "traverse_hit": 3276, "traverse_forward": 0, "traverse_discover": 0, "traverse_dir_fetch": 0, "traverse_remote_ino": 0, "traverse_lock": 0, "load_cent": 12421, "q": 0, "exported": 0, "exported_inodes": 0, "imported": 0, "imported_inodes": 0, "openino_dir_fetch": 0, "openino_backtrace_fetch": 0, "openino_peer_discover": 0, "root_rfiles": 0, "root_rbytes": 0, "root_rsnaps": 0 }, "mds_cache": { "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "strays_created": 1601, "strays_enqueued": 1601, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 9, "ireq_fragstats": 0, "ireq_inodestats": 0 }, "mds_log": { "evadd": 10046, "evex": 9736, "evtrm": 9736, "ev": 312, "evexg": 0, "evexd": 9736, "segadd": 13, "segex": 13, "segtrm": 13, "seg": 14, "segexg": 0, "segexd": 13, "expos": 23085414, "wrpos": 23275537, "rdpos": 4195196, "jlat": { "avgcount": 3629, "sum": 19.764976717, "avgtime": 0.005446397 }, "replayed": 2 }, "mds_mem": { "ino": 13, "ino+": 1614, "ino-": 1601, "dir": 12, "dir+": 85, "dir-": 73, "dn": 320, "dn+": 3212, "dn-": 2892, "cap": 1, "cap+": 1602, "cap-": 1601, "rss": 90464, "heap": 331932 }, "mds_server": { "dispatch_client_request": 3351, "dispatch_server_request": 0, "handle_client_request": 3277, "handle_client_session": 4, "handle_slave_request": 0, "req_create_latency": { "avgcount": 1600, "sum": 2.331516366, "avgtime": 0.001457197 }, "req_getattr_latency": { "avgcount": 2, "sum": 0.000941751, "avgtime": 0.000470875 }, "req_getfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_link_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookup_latency": { "avgcount": 1, "sum": 0.001560520, "avgtime": 0.001560520 }, "req_lookuphash_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupino_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupname_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupparent_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lssnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mkdir_latency": { "avgcount": 1, "sum": 0.004721025, "avgtime": 0.004721025 }, "req_mknod_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mksnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_open_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_readdir_latency": { "avgcount": 70, "sum": 0.134635846, "avgtime": 0.001923369 }, "req_rename_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_renamesnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmdir_latency": { "avgcount": 1, "sum": 0.451035564, "avgtime": 0.451035564 }, "req_rmsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setdirlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_symlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_unlink_latency": { "avgcount": 1600, "sum": 3.341804935, "avgtime": 0.002088628 }, "cap_revoke_eviction": 0 }, "mds_sessions": { "session_count": 1, "session_add": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 2752, "average_load": 2752, "avg_session_uptime": 908 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "buffer_anon_bytes": 2611091, "buffer_anon_items": 714, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6128, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 937764, "mds_co_items": 15942, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "op_active": 0, "op_laggy": 0, "op_send": 7915, "op_send_bytes": 20243671, "op_resend": 0, "op_reply": 7915, "op": 7915, "op_r": 36, "op_w": 7879, "op_rmw": 0, "op_pg": 0, "osdop_stat": 12, "osdop_create": 314, "osdop_read": 18, "osdop_write": 3639, "osdop_writefull": 11, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 1, "osdop_truncate": 1, "osdop_delete": 3814, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 14, "osdop_setxattr": 628, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 8, "osd_session_open": 8, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 187, "omap_rd": 28, "omap_del": 13 }, "oft": { "omap_total_objs": 0, "omap_total_kv_pairs": 0, "omap_total_updates": 0, "omap_total_removes": 0 }, "purge_queue": { "pq_executing_ops": 0, "pq_executing_ops_high_water": 65, "pq_executing": 0, "pq_executing_high_water": 8, "pq_executed": 1601, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "val": 0, "max": 104857600, "get_started": 0, "get": 16575, "get_sum": 3627045, "get_or_fail_fail": 0, "get_or_fail_success": 16575, "take": 0, "take_sum": 0, "put": 16575, "put_sum": 3627045, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_bytes": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 7915, "take_sum": 20406486, "put": 4088, "put_sum": 20406486, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_ops": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 7915, "take_sum": 7915, "put": 7915, "put_sum": 7915, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle": { "val": 0, "max": 3758096384, "get_started": 0, "get": 1601, "get_sum": 161709, "get_or_fail_fail": 0, "get_or_fail_success": 1601, "take": 0, "take_sum": 0, "put": 10, "put_sum": 161709, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle-0x55eb89907c20": { "val": 0, "max": 3758096384, "get_started": 0, "get": 10046, "get_sum": 19079903, "get_or_fail_fail": 0, "get_or_fail_success": 10046, "take": 0, "take_sum": 0, "put": 3629, "put_sum": 19079903, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } 2020-05-18T21:35:36.838 INFO:tasks.cephfs.test_strays:Complete purge in 6 seconds 2020-05-18T21:35:36.838 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:35:36.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.946+0000 7ffb8487e700 1 Processor -- start 2020-05-18T21:35:36.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.946+0000 7ffb8487e700 1 -- start start 2020-05-18T21:35:36.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.946+0000 7ffb8487e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb800b8f40 0x7ffb800aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:36.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.946+0000 7ffb8487e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffb800666e0 0x7ffb800b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:36.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.946+0000 7ffb8487e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb8013da60 0x7ffb8013def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:36.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.946+0000 7ffb8487e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb800af9f0 con 0x7ffb8013da60 2020-05-18T21:35:36.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.946+0000 7ffb8487e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb800afbd0 con 0x7ffb800666e0 2020-05-18T21:35:36.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.946+0000 7ffb8487e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800afe70 con 0x7ffb800b8f40 2020-05-18T21:35:36.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.946+0000 7ffb7ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb8013da60 0x7ffb8013def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:36.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.946+0000 7ffb7ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb8013da60 0x7ffb8013def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34170/0 (socket says 172.21.15.63:34170) 2020-05-18T21:35:36.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.946+0000 7ffb7ffff700 1 -- 172.21.15.63:0/1346428440 learned_addr learned my addr 172.21.15.63:0/1346428440 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:36.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.946+0000 7ffb77fff700 1 --2- 172.21.15.63:0/1346428440 >> v2:172.21.15.155:3300/0 conn(0x7ffb800666e0 0x7ffb800b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:36.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.946+0000 7ffb7f7fe700 1 --2- 172.21.15.63:0/1346428440 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb800b8f40 0x7ffb800aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:36.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.946+0000 7ffb7ffff700 1 -- 172.21.15.63:0/1346428440 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb800b8f40 msgr2=0x7ffb800aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:36.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.946+0000 7ffb7ffff700 1 --2- 172.21.15.63:0/1346428440 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb800b8f40 0x7ffb800aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:36.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb7ffff700 1 -- 172.21.15.63:0/1346428440 >> v2:172.21.15.155:3300/0 conn(0x7ffb800666e0 msgr2=0x7ffb800b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:36.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb7ffff700 1 --2- 172.21.15.63:0/1346428440 >> v2:172.21.15.155:3300/0 conn(0x7ffb800666e0 0x7ffb800b0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:36.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb7ffff700 1 -- 172.21.15.63:0/1346428440 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb800b0770 con 0x7ffb8013da60 2020-05-18T21:35:36.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb7ffff700 1 --2- 172.21.15.63:0/1346428440 >> v2:172.21.15.63:3300/0 conn(0x7ffb8013da60 0x7ffb8013def0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffb780032f0 tx=0x7ffb78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb7ffff700 1 --2- 172.21.15.63:0/1346428440 >> v2:172.21.15.63:3300/0 conn(0x7ffb8013da60 0x7ffb8013def0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffb780032f0 tx=0x7ffb78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb7ffff700 1 --2- 172.21.15.63:0/1346428440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb8013da60 0x7ffb8013def0 secure :-1 s=READY pgs=1741 cs=0 l=1 rx=0x7ffb780032f0 tx=0x7ffb78007e00).ready entity=mon.0 client_cookie=fdd0c61a33bca9a6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb7ffff700 1 --2- 172.21.15.63:0/1346428440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb8013da60 0x7ffb8013def0 secure :-1 s=THROTTLE_DONE pgs=1741 cs=0 l=1 rx=0x7ffb780032f0 tx=0x7ffb78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb7effd700 1 -- 172.21.15.63:0/1346428440 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb78011c60 con 0x7ffb8013da60 2020-05-18T21:35:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb7ffff700 1 --2- 172.21.15.63:0/1346428440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb8013da60 0x7ffb8013def0 secure :-1 s=THROTTLE_DONE pgs=1741 cs=0 l=1 rx=0x7ffb780032f0 tx=0x7ffb78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb7effd700 1 -- 172.21.15.63:0/1346428440 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb78011dc0 con 0x7ffb8013da60 2020-05-18T21:35:36.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb7ffff700 1 --2- 172.21.15.63:0/1346428440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb8013da60 0x7ffb8013def0 secure :-1 s=THROTTLE_DONE pgs=1741 cs=0 l=1 rx=0x7ffb780032f0 tx=0x7ffb78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb8487e700 1 -- 172.21.15.63:0/1346428440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb8013da60 msgr2=0x7ffb8013def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:36.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb7effd700 1 -- 172.21.15.63:0/1346428440 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb7800a370 con 0x7ffb8013da60 2020-05-18T21:35:36.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb8487e700 1 --2- 172.21.15.63:0/1346428440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb8013da60 0x7ffb8013def0 secure :-1 s=READY pgs=1741 cs=0 l=1 rx=0x7ffb780032f0 tx=0x7ffb78007e00).stop 2020-05-18T21:35:36.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb8487e700 1 -- 172.21.15.63:0/1346428440 shutdown_connections 2020-05-18T21:35:36.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb8487e700 1 --2- 172.21.15.63:0/1346428440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb8013da60 0x7ffb8013def0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:36.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb8487e700 1 --2- 172.21.15.63:0/1346428440 >> v2:172.21.15.155:3300/0 conn(0x7ffb800666e0 0x7ffb800b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:36.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb8487e700 1 --2- 172.21.15.63:0/1346428440 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb800b8f40 0x7ffb800aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:36.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb8487e700 1 -- 172.21.15.63:0/1346428440 >> 172.21.15.63:0/1346428440 conn(0x7ffb8005f620 msgr2=0x7ffb800b84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:36.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb8487e700 1 -- 172.21.15.63:0/1346428440 shutdown_connections 2020-05-18T21:35:36.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.950+0000 7ffb8487e700 1 -- 172.21.15.63:0/1346428440 wait complete. 2020-05-18T21:35:36.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb8487e700 1 Processor -- start 2020-05-18T21:35:36.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb8487e700 1 -- start start 2020-05-18T21:35:36.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb8487e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb800666e0 0x7ffb801446d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:36.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb8487e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb800b8f40 0x7ffb80141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:36.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb8487e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffb8013da60 0x7ffb8013c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:36.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb8487e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb80065df0 con 0x7ffb800666e0 2020-05-18T21:35:36.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb8487e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb801423d0 con 0x7ffb8013da60 2020-05-18T21:35:36.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb8487e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb80065b50 con 0x7ffb800b8f40 2020-05-18T21:35:36.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb7f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb800666e0 0x7ffb801446d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:36.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb7f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb800666e0 0x7ffb801446d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34172/0 (socket says 172.21.15.63:34172) 2020-05-18T21:35:36.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb7f7fe700 1 -- 172.21.15.63:0/3618776314 learned_addr learned my addr 172.21.15.63:0/3618776314 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:36.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb77fff700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb800b8f40 0x7ffb80141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:36.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb7ffff700 1 --2- 172.21.15.63:0/3618776314 >> v2:172.21.15.155:3300/0 conn(0x7ffb8013da60 0x7ffb8013c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:36.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb7f7fe700 1 -- 172.21.15.63:0/3618776314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb800b8f40 msgr2=0x7ffb80141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:36.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb7f7fe700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb800b8f40 0x7ffb80141f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:36.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb7f7fe700 1 -- 172.21.15.63:0/3618776314 >> v2:172.21.15.155:3300/0 conn(0x7ffb8013da60 msgr2=0x7ffb8013c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:36.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb7f7fe700 1 --2- 172.21.15.63:0/3618776314 >> v2:172.21.15.155:3300/0 conn(0x7ffb8013da60 0x7ffb8013c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:36.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb7f7fe700 1 -- 172.21.15.63:0/3618776314 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb800628d0 con 0x7ffb800666e0 2020-05-18T21:35:36.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb7ffff700 1 --2- 172.21.15.63:0/3618776314 >> v2:172.21.15.155:3300/0 conn(0x7ffb8013da60 0x7ffb8013c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:35:36.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb7f7fe700 1 --2- 172.21.15.63:0/3618776314 >> v2:172.21.15.63:3300/0 conn(0x7ffb800666e0 0x7ffb801446d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb700030b0 tx=0x7ffb70010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb7f7fe700 1 --2- 172.21.15.63:0/3618776314 >> v2:172.21.15.63:3300/0 conn(0x7ffb800666e0 0x7ffb801446d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb700030b0 tx=0x7ffb70010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.954+0000 7ffb7f7fe700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb800666e0 0x7ffb801446d0 secure :-1 s=READY pgs=1742 cs=0 l=1 rx=0x7ffb700030b0 tx=0x7ffb70010c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:36.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.958+0000 7ffb7f7fe700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb800666e0 0x7ffb801446d0 secure :-1 s=THROTTLE_DONE pgs=1742 cs=0 l=1 rx=0x7ffb700030b0 tx=0x7ffb70010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.958+0000 7ffb7d7fa700 1 -- 172.21.15.63:0/3618776314 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb70007560 con 0x7ffb800666e0 2020-05-18T21:35:36.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.958+0000 7ffb7f7fe700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb800666e0 0x7ffb801446d0 secure :-1 s=THROTTLE_DONE pgs=1742 cs=0 l=1 rx=0x7ffb700030b0 tx=0x7ffb70010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.958+0000 7ffb7f7fe700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb800666e0 0x7ffb801446d0 secure :-1 s=THROTTLE_DONE pgs=1742 cs=0 l=1 rx=0x7ffb700030b0 tx=0x7ffb70010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.958+0000 7ffb7d7fa700 1 -- 172.21.15.63:0/3618776314 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb70005a00 con 0x7ffb800666e0 2020-05-18T21:35:36.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.958+0000 7ffb8487e700 1 -- 172.21.15.63:0/3618776314 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb80062d70 con 0x7ffb800666e0 2020-05-18T21:35:36.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.958+0000 7ffb7d7fa700 1 -- 172.21.15.63:0/3618776314 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb70005de0 con 0x7ffb800666e0 2020-05-18T21:35:36.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.958+0000 7ffb8487e700 1 -- 172.21.15.63:0/3618776314 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb80143e00 con 0x7ffb800666e0 2020-05-18T21:35:36.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.958+0000 7ffb7f7fe700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb800666e0 0x7ffb801446d0 secure :-1 s=THROTTLE_DONE pgs=1742 cs=0 l=1 rx=0x7ffb700030b0 tx=0x7ffb70010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.958+0000 7ffb8487e700 1 -- 172.21.15.63:0/3618776314 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb800569e0 con 0x7ffb800666e0 2020-05-18T21:35:36.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.958+0000 7ffb7d7fa700 1 -- 172.21.15.63:0/3618776314 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ffb7000e2e0 con 0x7ffb800666e0 2020-05-18T21:35:36.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.958+0000 7ffb7f7fe700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb800666e0 0x7ffb801446d0 secure :-1 s=THROTTLE_DONE pgs=1742 cs=0 l=1 rx=0x7ffb700030b0 tx=0x7ffb70010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.958+0000 7ffb7d7fa700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb5804fa10 0x7ffb58051ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:36.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.958+0000 7ffb7d7fa700 1 -- 172.21.15.63:0/3618776314 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ffb70064080 con 0x7ffb800666e0 2020-05-18T21:35:36.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.958+0000 7ffb77fff700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb5804fa10 0x7ffb58051ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:36.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.962+0000 7ffb77fff700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb5804fa10 0x7ffb58051ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb68002f70 tx=0x7ffb68006e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.962+0000 7ffb77fff700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb5804fa10 0x7ffb58051ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb68002f70 tx=0x7ffb68006e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.962+0000 7ffb77fff700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb5804fa10 0x7ffb58051ed0 secure :-1 s=READY pgs=673 cs=0 l=1 rx=0x7ffb68002f70 tx=0x7ffb68006e90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:36.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.966+0000 7ffb7f7fe700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb800666e0 0x7ffb801446d0 secure :-1 s=THROTTLE_DONE pgs=1742 cs=0 l=1 rx=0x7ffb700030b0 tx=0x7ffb70010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:36.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:36.966+0000 7ffb7d7fa700 1 -- 172.21.15.63:0/3618776314 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ffb7003e3b0 con 0x7ffb800666e0 2020-05-18T21:35:37.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:37.118+0000 7ffb8487e700 1 -- 172.21.15.63:0/3618776314 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb800b2ab0 con 0x7ffb800666e0 2020-05-18T21:35:37.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:37.118+0000 7ffb7f7fe700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb800666e0 0x7ffb801446d0 secure :-1 s=THROTTLE_DONE pgs=1742 cs=0 l=1 rx=0x7ffb700030b0 tx=0x7ffb70010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:37.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:37.118+0000 7ffb7d7fa700 1 -- 172.21.15.63:0/3618776314 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+2147 (secure 0 0 0) 0x7ffb700419d0 con 0x7ffb800666e0 2020-05-18T21:35:37.124 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:37.124 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":98,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/3483934102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3483934102},{"type":"v1","addr":"172.21.15.155:6835","nonce":3483934102}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":98}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:34:27.767123+0000","modified":"2020-05-18T21:34:41.281280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"a","rank":0,"incarnation":94,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6833/1314928434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1314928434},{"type":"v1","addr":"172.21.15.63:6833","nonce":1314928434}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-05-18T21:35:37.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:37.122+0000 7ffb8487e700 1 -- 172.21.15.63:0/3618776314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb5804fa10 msgr2=0x7ffb58051ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:37.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:37.122+0000 7ffb8487e700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb5804fa10 0x7ffb58051ed0 secure :-1 s=READY pgs=673 cs=0 l=1 rx=0x7ffb68002f70 tx=0x7ffb68006e90).stop 2020-05-18T21:35:37.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:37.122+0000 7ffb8487e700 1 -- 172.21.15.63:0/3618776314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb800666e0 msgr2=0x7ffb801446d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:37.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:37.122+0000 7ffb8487e700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb800666e0 0x7ffb801446d0 secure :-1 s=READY pgs=1742 cs=0 l=1 rx=0x7ffb700030b0 tx=0x7ffb70010c50).stop 2020-05-18T21:35:37.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:37.122+0000 7ffb8487e700 1 -- 172.21.15.63:0/3618776314 shutdown_connections 2020-05-18T21:35:37.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:37.122+0000 7ffb8487e700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb5804fa10 0x7ffb58051ed0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:37.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:37.122+0000 7ffb8487e700 1 --2- 172.21.15.63:0/3618776314 >> v2:172.21.15.155:3300/0 conn(0x7ffb8013da60 0x7ffb8013c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:37.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:37.122+0000 7ffb8487e700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb800b8f40 0x7ffb80141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:37.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:37.122+0000 7ffb8487e700 1 --2- 172.21.15.63:0/3618776314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb800666e0 0x7ffb801446d0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:37.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:37.122+0000 7ffb8487e700 1 -- 172.21.15.63:0/3618776314 >> 172.21.15.63:0/3618776314 conn(0x7ffb8005f620 msgr2=0x7ffb801410e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:37.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:37.122+0000 7ffb8487e700 1 -- 172.21.15.63:0/3618776314 shutdown_connections 2020-05-18T21:35:37.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:37.122+0000 7ffb8487e700 1 -- 172.21.15.63:0/3618776314 wait complete. 2020-05-18T21:35:37.129 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 98 2020-05-18T21:35:37.139 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2020-05-18T21:35:37.238 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:35:37.239 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-0": { 2020-05-18T21:35:37.239 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 1607, 2020-05-18T21:35:37.239 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 1602, 2020-05-18T21:35:37.240 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 625132, 2020-05-18T21:35:37.240 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 755764, 2020-05-18T21:35:37.240 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 6, 2020-05-18T21:35:37.241 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 1, 2020-05-18T21:35:37.241 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.109232497, 2020-05-18T21:35:37.241 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.031333958, 2020-05-18T21:35:37.241 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.037306108, 2020-05-18T21:35:37.249 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.034711950, 2020-05-18T21:35:37.249 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:37.250 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1602, 2020-05-18T21:35:37.250 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.166567205, 2020-05-18T21:35:37.250 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000103974 2020-05-18T21:35:37.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.251 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:37.251 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.251 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.252 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.252 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:37.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.254 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-1": { 2020-05-18T21:35:37.254 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 2381, 2020-05-18T21:35:37.254 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 2394, 2020-05-18T21:35:37.255 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 570341, 2020-05-18T21:35:37.255 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 7837044, 2020-05-18T21:35:37.255 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 6, 2020-05-18T21:35:37.255 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 3, 2020-05-18T21:35:37.256 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.256599151, 2020-05-18T21:35:37.256 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.097932977, 2020-05-18T21:35:37.256 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.058407665, 2020-05-18T21:35:37.256 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.083040059, 2020-05-18T21:35:37.257 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:37.257 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 2394, 2020-05-18T21:35:37.257 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.148451972, 2020-05-18T21:35:37.258 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000062010 2020-05-18T21:35:37.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.258 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:37.258 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.259 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.259 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.259 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:37.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.259 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-2": { 2020-05-18T21:35:37.260 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 12590, 2020-05-18T21:35:37.260 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 22625, 2020-05-18T21:35:37.260 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 3659114, 2020-05-18T21:35:37.261 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 21667235, 2020-05-18T21:35:37.261 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 6, 2020-05-18T21:35:37.261 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 3, 2020-05-18T21:35:37.261 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 1.898943730, 2020-05-18T21:35:37.265 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.903864636, 2020-05-18T21:35:37.265 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.991665521, 2020-05-18T21:35:37.265 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.142911995, 2020-05-18T21:35:37.266 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2020-05-18T21:35:37.266 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 22624, 2020-05-18T21:35:37.266 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 1.141545952, 2020-05-18T21:35:37.266 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000050457 2020-05-18T21:35:37.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.267 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2020-05-18T21:35:37.267 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 24775, 2020-05-18T21:35:37.267 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.008674593, 2020-05-18T21:35:37.268 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000350 2020-05-18T21:35:37.268 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:37.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.268 INFO:teuthology.orchestra.run.smithi063.stdout: "cct": { 2020-05-18T21:35:37.269 INFO:teuthology.orchestra.run.smithi063.stdout: "total_workers": 1, 2020-05-18T21:35:37.269 INFO:teuthology.orchestra.run.smithi063.stdout: "unhealthy_workers": 0 2020-05-18T21:35:37.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.269 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-MDSRank": { 2020-05-18T21:35:37.270 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2020-05-18T21:35:37.270 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2020-05-18T21:35:37.270 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 6490, 2020-05-18T21:35:37.270 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 4.505306491, 2020-05-18T21:35:37.271 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000694192 2020-05-18T21:35:37.271 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:37.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.271 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-PurgeQueue": { 2020-05-18T21:35:37.271 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2020-05-18T21:35:37.271 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2020-05-18T21:35:37.272 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 4328, 2020-05-18T21:35:37.272 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.471602044, 2020-05-18T21:35:37.272 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000108965 2020-05-18T21:35:37.272 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:37.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.273 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2020-05-18T21:35:37.273 INFO:teuthology.orchestra.run.smithi063.stdout: "request": 3277, 2020-05-18T21:35:37.273 INFO:teuthology.orchestra.run.smithi063.stdout: "reply": 3275, 2020-05-18T21:35:37.274 INFO:teuthology.orchestra.run.smithi063.stdout: "reply_latency": { 2020-05-18T21:35:37.274 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 3275, 2020-05-18T21:35:37.274 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 6.266216007, 2020-05-18T21:35:37.274 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001913348 2020-05-18T21:35:37.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.275 INFO:teuthology.orchestra.run.smithi063.stdout: "forward": 0, 2020-05-18T21:35:37.275 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_fetch": 12, 2020-05-18T21:35:37.275 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_commit": 85, 2020-05-18T21:35:37.275 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_split": 9, 2020-05-18T21:35:37.275 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_merge": 0, 2020-05-18T21:35:37.276 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes": 319, 2020-05-18T21:35:37.276 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_top": 0, 2020-05-18T21:35:37.276 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_bottom": 319, 2020-05-18T21:35:37.276 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pin_tail": 0, 2020-05-18T21:35:37.276 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pinned": 319, 2020-05-18T21:35:37.277 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_expired": 0, 2020-05-18T21:35:37.277 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_with_caps": 1, 2020-05-18T21:35:37.277 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": 1, 2020-05-18T21:35:37.277 INFO:teuthology.orchestra.run.smithi063.stdout: "subtrees": 2, 2020-05-18T21:35:37.277 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse": 3278, 2020-05-18T21:35:37.277 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_hit": 3276, 2020-05-18T21:35:37.278 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_forward": 0, 2020-05-18T21:35:37.278 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_discover": 0, 2020-05-18T21:35:37.278 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_dir_fetch": 0, 2020-05-18T21:35:37.278 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_remote_ino": 0, 2020-05-18T21:35:37.278 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_lock": 0, 2020-05-18T21:35:37.278 INFO:teuthology.orchestra.run.smithi063.stdout: "load_cent": 12421, 2020-05-18T21:35:37.279 INFO:teuthology.orchestra.run.smithi063.stdout: "q": 0, 2020-05-18T21:35:37.279 INFO:teuthology.orchestra.run.smithi063.stdout: "exported": 0, 2020-05-18T21:35:37.279 INFO:teuthology.orchestra.run.smithi063.stdout: "exported_inodes": 0, 2020-05-18T21:35:37.279 INFO:teuthology.orchestra.run.smithi063.stdout: "imported": 0, 2020-05-18T21:35:37.279 INFO:teuthology.orchestra.run.smithi063.stdout: "imported_inodes": 0, 2020-05-18T21:35:37.280 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_dir_fetch": 0, 2020-05-18T21:35:37.280 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_backtrace_fetch": 0, 2020-05-18T21:35:37.280 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_peer_discover": 0, 2020-05-18T21:35:37.280 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rfiles": 0, 2020-05-18T21:35:37.280 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rbytes": 0, 2020-05-18T21:35:37.280 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rsnaps": 0 2020-05-18T21:35:37.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.281 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2020-05-18T21:35:37.281 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays": 0, 2020-05-18T21:35:37.281 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_delayed": 0, 2020-05-18T21:35:37.281 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_enqueuing": 0, 2020-05-18T21:35:37.282 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_created": 1601, 2020-05-18T21:35:37.282 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 1601, 2020-05-18T21:35:37.282 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_reintegrated": 0, 2020-05-18T21:35:37.282 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_migrated": 0, 2020-05-18T21:35:37.282 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_processing": 0, 2020-05-18T21:35:37.282 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_enqueued": 0, 2020-05-18T21:35:37.283 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_prioritized": 0, 2020-05-18T21:35:37.283 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_started": 0, 2020-05-18T21:35:37.283 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_completed": 0, 2020-05-18T21:35:37.283 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_enqueue_scrub": 0, 2020-05-18T21:35:37.284 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_exportdir": 0, 2020-05-18T21:35:37.284 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_flush": 0, 2020-05-18T21:35:37.284 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragmentdir": 9, 2020-05-18T21:35:37.284 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragstats": 0, 2020-05-18T21:35:37.285 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_inodestats": 0 2020-05-18T21:35:37.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.285 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log": { 2020-05-18T21:35:37.285 INFO:teuthology.orchestra.run.smithi063.stdout: "evadd": 10046, 2020-05-18T21:35:37.285 INFO:teuthology.orchestra.run.smithi063.stdout: "evex": 9736, 2020-05-18T21:35:37.285 INFO:teuthology.orchestra.run.smithi063.stdout: "evtrm": 9736, 2020-05-18T21:35:37.286 INFO:teuthology.orchestra.run.smithi063.stdout: "ev": 312, 2020-05-18T21:35:37.286 INFO:teuthology.orchestra.run.smithi063.stdout: "evexg": 0, 2020-05-18T21:35:37.286 INFO:teuthology.orchestra.run.smithi063.stdout: "evexd": 9736, 2020-05-18T21:35:37.286 INFO:teuthology.orchestra.run.smithi063.stdout: "segadd": 13, 2020-05-18T21:35:37.286 INFO:teuthology.orchestra.run.smithi063.stdout: "segex": 13, 2020-05-18T21:35:37.287 INFO:teuthology.orchestra.run.smithi063.stdout: "segtrm": 13, 2020-05-18T21:35:37.287 INFO:teuthology.orchestra.run.smithi063.stdout: "seg": 14, 2020-05-18T21:35:37.287 INFO:teuthology.orchestra.run.smithi063.stdout: "segexg": 0, 2020-05-18T21:35:37.287 INFO:teuthology.orchestra.run.smithi063.stdout: "segexd": 13, 2020-05-18T21:35:37.287 INFO:teuthology.orchestra.run.smithi063.stdout: "expos": 23085414, 2020-05-18T21:35:37.287 INFO:teuthology.orchestra.run.smithi063.stdout: "wrpos": 23275537, 2020-05-18T21:35:37.288 INFO:teuthology.orchestra.run.smithi063.stdout: "rdpos": 4195196, 2020-05-18T21:35:37.288 INFO:teuthology.orchestra.run.smithi063.stdout: "jlat": { 2020-05-18T21:35:37.288 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 3629, 2020-05-18T21:35:37.288 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 19.764976717, 2020-05-18T21:35:37.288 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.005446397 2020-05-18T21:35:37.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.289 INFO:teuthology.orchestra.run.smithi063.stdout: "replayed": 2 2020-05-18T21:35:37.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.289 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_mem": { 2020-05-18T21:35:37.289 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 13, 2020-05-18T21:35:37.289 INFO:teuthology.orchestra.run.smithi063.stdout: "ino+": 1614, 2020-05-18T21:35:37.290 INFO:teuthology.orchestra.run.smithi063.stdout: "ino-": 1601, 2020-05-18T21:35:37.290 INFO:teuthology.orchestra.run.smithi063.stdout: "dir": 12, 2020-05-18T21:35:37.290 INFO:teuthology.orchestra.run.smithi063.stdout: "dir+": 85, 2020-05-18T21:35:37.290 INFO:teuthology.orchestra.run.smithi063.stdout: "dir-": 73, 2020-05-18T21:35:37.290 INFO:teuthology.orchestra.run.smithi063.stdout: "dn": 320, 2020-05-18T21:35:37.291 INFO:teuthology.orchestra.run.smithi063.stdout: "dn+": 3212, 2020-05-18T21:35:37.291 INFO:teuthology.orchestra.run.smithi063.stdout: "dn-": 2892, 2020-05-18T21:35:37.291 INFO:teuthology.orchestra.run.smithi063.stdout: "cap": 1, 2020-05-18T21:35:37.291 INFO:teuthology.orchestra.run.smithi063.stdout: "cap+": 1602, 2020-05-18T21:35:37.291 INFO:teuthology.orchestra.run.smithi063.stdout: "cap-": 1601, 2020-05-18T21:35:37.292 INFO:teuthology.orchestra.run.smithi063.stdout: "rss": 90464, 2020-05-18T21:35:37.292 INFO:teuthology.orchestra.run.smithi063.stdout: "heap": 331932 2020-05-18T21:35:37.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.292 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_server": { 2020-05-18T21:35:37.292 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_client_request": 3351, 2020-05-18T21:35:37.293 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_server_request": 0, 2020-05-18T21:35:37.294 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_request": 3277, 2020-05-18T21:35:37.294 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_session": 4, 2020-05-18T21:35:37.294 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_slave_request": 0, 2020-05-18T21:35:37.295 INFO:teuthology.orchestra.run.smithi063.stdout: "req_create_latency": { 2020-05-18T21:35:37.295 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1600, 2020-05-18T21:35:37.296 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 2.331516366, 2020-05-18T21:35:37.296 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001457197 2020-05-18T21:35:37.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.296 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getattr_latency": { 2020-05-18T21:35:37.296 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 2, 2020-05-18T21:35:37.297 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000941751, 2020-05-18T21:35:37.297 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000470875 2020-05-18T21:35:37.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.297 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getfilelock_latency": { 2020-05-18T21:35:37.297 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.298 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.298 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.298 INFO:teuthology.orchestra.run.smithi063.stdout: "req_link_latency": { 2020-05-18T21:35:37.298 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.299 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.299 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.300 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookup_latency": { 2020-05-18T21:35:37.300 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:37.300 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.001560520, 2020-05-18T21:35:37.301 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001560520 2020-05-18T21:35:37.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.301 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookuphash_latency": { 2020-05-18T21:35:37.301 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.301 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.302 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.302 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupino_latency": { 2020-05-18T21:35:37.303 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.303 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.303 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.303 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupname_latency": { 2020-05-18T21:35:37.304 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.304 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.304 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.305 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupparent_latency": { 2020-05-18T21:35:37.306 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.306 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.306 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.306 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupsnap_latency": { 2020-05-18T21:35:37.307 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.307 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.307 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.307 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lssnap_latency": { 2020-05-18T21:35:37.307 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.309 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.309 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.309 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mkdir_latency": { 2020-05-18T21:35:37.310 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:37.310 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.004721025, 2020-05-18T21:35:37.310 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.004721025 2020-05-18T21:35:37.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mknod_latency": { 2020-05-18T21:35:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mksnap_latency": { 2020-05-18T21:35:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: "req_open_latency": { 2020-05-18T21:35:37.313 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.313 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.313 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.313 INFO:teuthology.orchestra.run.smithi063.stdout: "req_readdir_latency": { 2020-05-18T21:35:37.314 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 70, 2020-05-18T21:35:37.314 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.134635846, 2020-05-18T21:35:37.314 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001923369 2020-05-18T21:35:37.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.314 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rename_latency": { 2020-05-18T21:35:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: "req_renamesnap_latency": { 2020-05-18T21:35:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.316 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.316 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.316 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmdir_latency": { 2020-05-18T21:35:37.316 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1, 2020-05-18T21:35:37.317 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.451035564, 2020-05-18T21:35:37.317 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.451035564 2020-05-18T21:35:37.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.317 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmsnap_latency": { 2020-05-18T21:35:37.317 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmxattr_latency": { 2020-05-18T21:35:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setattr_latency": { 2020-05-18T21:35:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.320 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.320 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setdirlayout_latency": { 2020-05-18T21:35:37.320 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.320 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.321 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.321 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setfilelock_latency": { 2020-05-18T21:35:37.321 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.321 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.321 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.322 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setlayout_latency": { 2020-05-18T21:35:37.322 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.322 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.322 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.323 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setxattr_latency": { 2020-05-18T21:35:37.323 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.323 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.323 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.324 INFO:teuthology.orchestra.run.smithi063.stdout: "req_symlink_latency": { 2020-05-18T21:35:37.324 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.324 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.324 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.325 INFO:teuthology.orchestra.run.smithi063.stdout: "req_unlink_latency": { 2020-05-18T21:35:37.325 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1600, 2020-05-18T21:35:37.325 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 3.341804935, 2020-05-18T21:35:37.325 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.002088628 2020-05-18T21:35:37.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.325 INFO:teuthology.orchestra.run.smithi063.stdout: "cap_revoke_eviction": 0 2020-05-18T21:35:37.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.326 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_sessions": { 2020-05-18T21:35:37.326 INFO:teuthology.orchestra.run.smithi063.stdout: "session_count": 1, 2020-05-18T21:35:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: "session_add": 1, 2020-05-18T21:35:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: "session_remove": 0, 2020-05-18T21:35:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_open": 1, 2020-05-18T21:35:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_stale": 0, 2020-05-18T21:35:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: "total_load": 2752, 2020-05-18T21:35:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: "average_load": 2752, 2020-05-18T21:35:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: "avg_session_uptime": 908 2020-05-18T21:35:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: "mempool": { 2020-05-18T21:35:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_bytes": 0, 2020-05-18T21:35:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_items": 0, 2020-05-18T21:35:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_bytes": 0, 2020-05-18T21:35:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_items": 0, 2020-05-18T21:35:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_bytes": 0, 2020-05-18T21:35:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_items": 0, 2020-05-18T21:35:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_bytes": 0, 2020-05-18T21:35:37.330 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_items": 0, 2020-05-18T21:35:37.330 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_bytes": 0, 2020-05-18T21:35:37.330 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_items": 0, 2020-05-18T21:35:37.330 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_bytes": 0, 2020-05-18T21:35:37.330 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_items": 0, 2020-05-18T21:35:37.331 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_bytes": 0, 2020-05-18T21:35:37.331 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_items": 0, 2020-05-18T21:35:37.331 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_bytes": 0, 2020-05-18T21:35:37.331 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_items": 0, 2020-05-18T21:35:37.331 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_bytes": 0, 2020-05-18T21:35:37.331 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_items": 0, 2020-05-18T21:35:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_bytes": 0, 2020-05-18T21:35:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_items": 0, 2020-05-18T21:35:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_bytes": 2611091, 2020-05-18T21:35:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_items": 714, 2020-05-18T21:35:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_bytes": 0, 2020-05-18T21:35:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_items": 0, 2020-05-18T21:35:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bytes": 0, 2020-05-18T21:35:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_items": 0, 2020-05-18T21:35:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_bytes": 0, 2020-05-18T21:35:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_items": 0, 2020-05-18T21:35:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_bytes": 0, 2020-05-18T21:35:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_items": 0, 2020-05-18T21:35:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_bytes": 6128, 2020-05-18T21:35:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_items": 93, 2020-05-18T21:35:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_bytes": 0, 2020-05-18T21:35:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_items": 0, 2020-05-18T21:35:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_bytes": 0, 2020-05-18T21:35:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_items": 0, 2020-05-18T21:35:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_bytes": 937764, 2020-05-18T21:35:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_items": 15942, 2020-05-18T21:35:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_bytes": 0, 2020-05-18T21:35:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_items": 0, 2020-05-18T21:35:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_bytes": 0, 2020-05-18T21:35:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_items": 0 2020-05-18T21:35:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter": { 2020-05-18T21:35:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: "op_active": 0, 2020-05-18T21:35:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: "op_laggy": 0, 2020-05-18T21:35:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send": 7915, 2020-05-18T21:35:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send_bytes": 20243671, 2020-05-18T21:35:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: "op_resend": 0, 2020-05-18T21:35:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: "op_reply": 7915, 2020-05-18T21:35:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: "op": 7915, 2020-05-18T21:35:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: "op_r": 36, 2020-05-18T21:35:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: "op_w": 7879, 2020-05-18T21:35:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: "op_rmw": 0, 2020-05-18T21:35:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: "op_pg": 0, 2020-05-18T21:35:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_stat": 12, 2020-05-18T21:35:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_create": 314, 2020-05-18T21:35:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_read": 18, 2020-05-18T21:35:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_write": 3639, 2020-05-18T21:35:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writefull": 11, 2020-05-18T21:35:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writesame": 0, 2020-05-18T21:35:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_append": 0, 2020-05-18T21:35:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_zero": 1, 2020-05-18T21:35:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_truncate": 1, 2020-05-18T21:35:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_delete": 3814, 2020-05-18T21:35:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_mapext": 0, 2020-05-18T21:35:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_sparse_read": 0, 2020-05-18T21:35:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_clonerange": 0, 2020-05-18T21:35:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_getxattr": 14, 2020-05-18T21:35:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_setxattr": 628, 2020-05-18T21:35:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_cmpxattr": 0, 2020-05-18T21:35:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_rmxattr": 0, 2020-05-18T21:35:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_resetxattrs": 0, 2020-05-18T21:35:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_call": 0, 2020-05-18T21:35:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_watch": 0, 2020-05-18T21:35:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_notify": 0, 2020-05-18T21:35:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_src_cmpxattr": 0, 2020-05-18T21:35:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls": 0, 2020-05-18T21:35:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls_filter": 0, 2020-05-18T21:35:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_other": 0, 2020-05-18T21:35:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_active": 0, 2020-05-18T21:35:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_send": 0, 2020-05-18T21:35:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_resend": 0, 2020-05-18T21:35:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_ping": 0, 2020-05-18T21:35:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_active": 0, 2020-05-18T21:35:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_send": 0, 2020-05-18T21:35:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_resend": 0, 2020-05-18T21:35:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_active": 0, 2020-05-18T21:35:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_send": 0, 2020-05-18T21:35:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_resend": 0, 2020-05-18T21:35:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_active": 0, 2020-05-18T21:35:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_send": 0, 2020-05-18T21:35:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_resend": 0, 2020-05-18T21:35:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: "command_active": 0, 2020-05-18T21:35:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: "command_send": 0, 2020-05-18T21:35:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: "command_resend": 0, 2020-05-18T21:35:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: "map_epoch": 0, 2020-05-18T21:35:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: "map_full": 0, 2020-05-18T21:35:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: "map_inc": 0, 2020-05-18T21:35:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_sessions": 8, 2020-05-18T21:35:37.347 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_open": 8, 2020-05-18T21:35:37.347 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_close": 0, 2020-05-18T21:35:37.347 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_laggy": 0, 2020-05-18T21:35:37.347 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_wr": 187, 2020-05-18T21:35:37.347 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_rd": 28, 2020-05-18T21:35:37.348 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_del": 13 2020-05-18T21:35:37.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.348 INFO:teuthology.orchestra.run.smithi063.stdout: "oft": { 2020-05-18T21:35:37.348 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_objs": 0, 2020-05-18T21:35:37.348 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_kv_pairs": 0, 2020-05-18T21:35:37.348 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_updates": 0, 2020-05-18T21:35:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_removes": 0 2020-05-18T21:35:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: "purge_queue": { 2020-05-18T21:35:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops": 0, 2020-05-18T21:35:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops_high_water": 65, 2020-05-18T21:35:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing": 0, 2020-05-18T21:35:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_high_water": 8, 2020-05-18T21:35:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executed": 1601, 2020-05-18T21:35:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_item_in_journal": 0 2020-05-18T21:35:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-05-18T21:35:37.351 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:37.351 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2020-05-18T21:35:37.351 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:37.351 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 16575, 2020-05-18T21:35:37.351 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 3627045, 2020-05-18T21:35:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 16575, 2020-05-18T21:35:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 16575, 2020-05-18T21:35:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 3627045, 2020-05-18T21:35:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.354 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_bytes": { 2020-05-18T21:35:37.354 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:37.354 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2020-05-18T21:35:37.354 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:37.354 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2020-05-18T21:35:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2020-05-18T21:35:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2020-05-18T21:35:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 7915, 2020-05-18T21:35:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 20406486, 2020-05-18T21:35:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 4088, 2020-05-18T21:35:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 20406486, 2020-05-18T21:35:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_ops": { 2020-05-18T21:35:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 1024, 2020-05-18T21:35:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:37.358 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2020-05-18T21:35:37.358 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2020-05-18T21:35:37.358 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:37.358 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2020-05-18T21:35:37.358 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 7915, 2020-05-18T21:35:37.358 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 7915, 2020-05-18T21:35:37.359 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 7915, 2020-05-18T21:35:37.359 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 7915, 2020-05-18T21:35:37.363 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:37.363 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.363 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.364 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.364 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:37.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.364 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle": { 2020-05-18T21:35:37.364 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2020-05-18T21:35:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 1601, 2020-05-18T21:35:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 161709, 2020-05-18T21:35:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 1601, 2020-05-18T21:35:37.366 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:37.366 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:37.366 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 10, 2020-05-18T21:35:37.366 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 161709, 2020-05-18T21:35:37.366 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle-0x55eb89907c20": { 2020-05-18T21:35:37.368 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2020-05-18T21:35:37.368 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2020-05-18T21:35:37.368 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2020-05-18T21:35:37.368 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 10046, 2020-05-18T21:35:37.368 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 19079903, 2020-05-18T21:35:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2020-05-18T21:35:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 10046, 2020-05-18T21:35:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2020-05-18T21:35:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2020-05-18T21:35:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 3629, 2020-05-18T21:35:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 19079903, 2020-05-18T21:35:37.370 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2020-05-18T21:35:37.370 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2020-05-18T21:35:37.370 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2020-05-18T21:35:37.370 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2020-05-18T21:35:37.370 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:37.371 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:37.371 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:35:37.372 INFO:tasks.cephfs.filesystem:_json_asok output: { "AsyncMessenger::Worker-0": { "msgr_recv_messages": 1607, "msgr_send_messages": 1602, "msgr_recv_bytes": 625132, "msgr_send_bytes": 755764, "msgr_created_connections": 6, "msgr_active_connections": 1, "msgr_running_total_time": 0.109232497, "msgr_running_send_time": 0.031333958, "msgr_running_recv_time": 0.037306108, "msgr_running_fast_dispatch_time": 0.034711950, "msgr_send_messages_queue_lat": { "avgcount": 1602, "sum": 0.166567205, "avgtime": 0.000103974 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-1": { "msgr_recv_messages": 2381, "msgr_send_messages": 2394, "msgr_recv_bytes": 570341, "msgr_send_bytes": 7837044, "msgr_created_connections": 6, "msgr_active_connections": 3, "msgr_running_total_time": 0.256599151, "msgr_running_send_time": 0.097932977, "msgr_running_recv_time": 0.058407665, "msgr_running_fast_dispatch_time": 0.083040059, "msgr_send_messages_queue_lat": { "avgcount": 2394, "sum": 0.148451972, "avgtime": 0.000062010 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "AsyncMessenger::Worker-2": { "msgr_recv_messages": 12590, "msgr_send_messages": 22625, "msgr_recv_bytes": 3659114, "msgr_send_bytes": 21667235, "msgr_created_connections": 6, "msgr_active_connections": 3, "msgr_running_total_time": 1.898943730, "msgr_running_send_time": 0.903864636, "msgr_running_recv_time": 0.991665521, "msgr_running_fast_dispatch_time": 0.142911995, "msgr_send_messages_queue_lat": { "avgcount": 22624, "sum": 1.141545952, "avgtime": 0.000050457 }, "msgr_handle_ack_lat": { "avgcount": 24775, "sum": 0.008674593, "avgtime": 0.000000350 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "queue_len": 0, "complete_latency": { "avgcount": 6490, "sum": 4.505306491, "avgtime": 0.000694192 } }, "finisher-PurgeQueue": { "queue_len": 0, "complete_latency": { "avgcount": 4328, "sum": 0.471602044, "avgtime": 0.000108965 } }, "mds": { "request": 3277, "reply": 3275, "reply_latency": { "avgcount": 3275, "sum": 6.266216007, "avgtime": 0.001913348 }, "forward": 0, "dir_fetch": 12, "dir_commit": 85, "dir_split": 9, "dir_merge": 0, "inodes": 319, "inodes_top": 0, "inodes_bottom": 319, "inodes_pin_tail": 0, "inodes_pinned": 319, "inodes_expired": 0, "inodes_with_caps": 1, "caps": 1, "subtrees": 2, "traverse": 3278, "traverse_hit": 3276, "traverse_forward": 0, "traverse_discover": 0, "traverse_dir_fetch": 0, "traverse_remote_ino": 0, "traverse_lock": 0, "load_cent": 12421, "q": 0, "exported": 0, "exported_inodes": 0, "imported": 0, "imported_inodes": 0, "openino_dir_fetch": 0, "openino_backtrace_fetch": 0, "openino_peer_discover": 0, "root_rfiles": 0, "root_rbytes": 0, "root_rsnaps": 0 }, "mds_cache": { "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "strays_created": 1601, "strays_enqueued": 1601, "strays_reintegrated": 0, "strays_migrated": 0, "num_recovering_processing": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "recovery_started": 0, "recovery_completed": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 9, "ireq_fragstats": 0, "ireq_inodestats": 0 }, "mds_log": { "evadd": 10046, "evex": 9736, "evtrm": 9736, "ev": 312, "evexg": 0, "evexd": 9736, "segadd": 13, "segex": 13, "segtrm": 13, "seg": 14, "segexg": 0, "segexd": 13, "expos": 23085414, "wrpos": 23275537, "rdpos": 4195196, "jlat": { "avgcount": 3629, "sum": 19.764976717, "avgtime": 0.005446397 }, "replayed": 2 }, "mds_mem": { "ino": 13, "ino+": 1614, "ino-": 1601, "dir": 12, "dir+": 85, "dir-": 73, "dn": 320, "dn+": 3212, "dn-": 2892, "cap": 1, "cap+": 1602, "cap-": 1601, "rss": 90464, "heap": 331932 }, "mds_server": { "dispatch_client_request": 3351, "dispatch_server_request": 0, "handle_client_request": 3277, "handle_client_session": 4, "handle_slave_request": 0, "req_create_latency": { "avgcount": 1600, "sum": 2.331516366, "avgtime": 0.001457197 }, "req_getattr_latency": { "avgcount": 2, "sum": 0.000941751, "avgtime": 0.000470875 }, "req_getfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_link_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookup_latency": { "avgcount": 1, "sum": 0.001560520, "avgtime": 0.001560520 }, "req_lookuphash_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupino_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupname_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupparent_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lookupsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_lssnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mkdir_latency": { "avgcount": 1, "sum": 0.004721025, "avgtime": 0.004721025 }, "req_mknod_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_mksnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_open_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_readdir_latency": { "avgcount": 70, "sum": 0.134635846, "avgtime": 0.001923369 }, "req_rename_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_renamesnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmdir_latency": { "avgcount": 1, "sum": 0.451035564, "avgtime": 0.451035564 }, "req_rmsnap_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_rmxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setdirlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setfilelock_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setlayout_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_setxattr_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_symlink_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "req_unlink_latency": { "avgcount": 1600, "sum": 3.341804935, "avgtime": 0.002088628 }, "cap_revoke_eviction": 0 }, "mds_sessions": { "session_count": 1, "session_add": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 2752, "average_load": 2752, "avg_session_uptime": 908 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "buffer_anon_bytes": 2611091, "buffer_anon_items": 714, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6128, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 937764, "mds_co_items": 15942, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "op_active": 0, "op_laggy": 0, "op_send": 7915, "op_send_bytes": 20243671, "op_resend": 0, "op_reply": 7915, "op": 7915, "op_r": 36, "op_w": 7879, "op_rmw": 0, "op_pg": 0, "osdop_stat": 12, "osdop_create": 314, "osdop_read": 18, "osdop_write": 3639, "osdop_writefull": 11, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 1, "osdop_truncate": 1, "osdop_delete": 3814, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 14, "osdop_setxattr": 628, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 8, "osd_session_open": 8, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 187, "omap_rd": 28, "omap_del": 13 }, "oft": { "omap_total_objs": 0, "omap_total_kv_pairs": 0, "omap_total_updates": 0, "omap_total_removes": 0 }, "purge_queue": { "pq_executing_ops": 0, "pq_executing_ops_high_water": 65, "pq_executing": 0, "pq_executing_high_water": 8, "pq_executed": 1601, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "val": 0, "max": 104857600, "get_started": 0, "get": 16575, "get_sum": 3627045, "get_or_fail_fail": 0, "get_or_fail_success": 16575, "take": 0, "take_sum": 0, "put": 16575, "put_sum": 3627045, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_bytes": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 7915, "take_sum": 20406486, "put": 4088, "put_sum": 20406486, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-objecter_ops": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 7915, "take_sum": 7915, "put": 7915, "put_sum": 7915, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle": { "val": 0, "max": 3758096384, "get_started": 0, "get": 1601, "get_sum": 161709, "get_or_fail_fail": 0, "get_or_fail_success": 1601, "take": 0, "take_sum": 0, "put": 10, "put_sum": 161709, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } }, "throttle-write_buf_throttle-0x55eb89907c20": { "val": 0, "max": 3758096384, "get_started": 0, "get": 10046, "get_sum": 19079903, "get_or_fail_fail": 0, "get_or_fail_success": 10046, "take": 0, "take_sum": 0, "put": 3629, "put_sum": 19079903, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } 2020-05-18T21:35:37.373 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:35:37.374 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:35:37.395 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:35:37.416 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:35:37.416 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:35:37.417 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:35:37.417 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:35:37.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:37.437 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:35:37.439 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[33973]: fuse finished with error 0 and tester_r 0 2020-05-18T21:35:37.445 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:35:37.446 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:35:37.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:37.447 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 down' 2020-05-18T21:35:37.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:37.513 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.0' 2020-05-18T21:35:37.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:37.599 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:35:37.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:37.620 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:35:37.668 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:35:37.668 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:35:37.668 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:35:37.668 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:35:37.669 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:35:37.669 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:35:37.669 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:35:37.669 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:37.670 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:35:37.670 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:37.670 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:35:37.670 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:37.670 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:35:37.671 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:37.671 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:35:37.671 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42305sec preferred_lft 42305sec 2020-05-18T21:35:37.671 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:35:37.672 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:35:37.672 INFO:teuthology.orchestra.run.smithi063.stdout:33: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-05-18T21:35:37.672 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:37.672 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:35:37.672 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:35:37.672 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::4059:a2ff:fe22:5bbe/64 scope link 2020-05-18T21:35:37.673 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:35:37.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:37.674 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:35:37.690 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:35:37.691 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:35:37.691 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:35:37.691 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:37.691 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:35:37.691 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:37.692 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:35:37.692 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:37.692 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:35:37.692 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:37.692 INFO:teuthology.orchestra.run.smithi063.stdout:33: ceph-brx: mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:35:37.693 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:37.693 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:35:37.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:37.694 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:35:37.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:37.712 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:35:37.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:37.852 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:35:37.861 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:35:37.861 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:35:37.861 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:35:37.861 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:35:37.862 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:35:37.862 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:35:37.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:37.864 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:35:37.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:37.882 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:35:37.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:37.946 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:35:37.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:37.966 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:35:38.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:38.017 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:35:38.023 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-05-18T21:35:38.024 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:35:38.025 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-05-18T21:35:38.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:38.027 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:35:38.033 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:35:38.035 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:35:38.035 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:35:38.035 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:35:38.035 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:35:38.035 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:35:38.035 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:35:38.036 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:38.036 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:35:38.036 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:38.036 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:35:38.036 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:38.037 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:35:38.037 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:38.038 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:35:38.038 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42305sec preferred_lft 42305sec 2020-05-18T21:35:38.038 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:35:38.038 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:35:38.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:38.039 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:35:38.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:38.084 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:35:38.092 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2020-05-18T21:35:38.093 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:35:38.095 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-05-18T21:35:38.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:38.097 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:35:38.104 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:35:38.104 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:35:38.104 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:35:38.105 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:35:38.105 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:35:38.105 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:35:38.105 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:35:38.105 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:38.106 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:35:38.106 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:38.106 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:35:38.107 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:38.107 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:35:38.107 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:38.107 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:35:38.107 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42309sec preferred_lft 42309sec 2020-05-18T21:35:38.108 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:35:38.108 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:35:38.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:38.109 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:35:38.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:38.162 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:35:38.170 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2020-05-18T21:35:38.171 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:35:38.172 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-05-18T21:35:38.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:38.173 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:35:38.222 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:35:38.223 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:35:38.223 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:35:38.223 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:35:38.223 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:35:38.224 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:35:38.224 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:35:38.224 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:38.224 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:35:38.225 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:38.225 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:35:38.225 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:38.225 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:35:38.225 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:38.226 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:35:38.226 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42309sec preferred_lft 42309sec 2020-05-18T21:35:38.226 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:35:38.226 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:35:38.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:38.228 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:35:38.235 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:35:38.238 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:35:38.273 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2020-05-18T21:35:38.274 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2020-05-18T21:35:38.274 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:35:38.274 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2020-05-18T21:35:38.275 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.275 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2020-05-18T21:35:38.275 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.275 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2020-05-18T21:35:38.275 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.276 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2020-05-18T21:35:38.276 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2020-05-18T21:35:38.276 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.276 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2020-05-18T21:35:38.277 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2020-05-18T21:35:38.277 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.277 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:35:38.277 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2020-05-18T21:35:38.277 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.277 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:35:38.278 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:35:38.278 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.278 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2020-05-18T21:35:38.278 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.278 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2020-05-18T21:35:38.279 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2020-05-18T21:35:38.279 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:35:38.279 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:35:38.280 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2020-05-18T21:35:38.280 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:35:38.280 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2020-05-18T21:35:38.280 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:35:38.280 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:35:38.281 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2020-05-18T21:35:38.281 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.281 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:35:38.281 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.281 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2020-05-18T21:35:38.281 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.282 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2020-05-18T21:35:38.282 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.282 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2020-05-18T21:35:38.282 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2020-05-18T21:35:38.282 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:35:38.283 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:35:38.283 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.283 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2020-05-18T21:35:38.283 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2020-05-18T21:35:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2020-05-18T21:35:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2020-05-18T21:35:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2020-05-18T21:35:38.286 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2020-05-18T21:35:38.286 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.286 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2020-05-18T21:35:38.286 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2020-05-18T21:35:38.286 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2020-05-18T21:35:38.287 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.287 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2020-05-18T21:35:38.287 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2020-05-18T21:35:38.287 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.287 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:35:38.288 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.288 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2020-05-18T21:35:38.288 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.288 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2020-05-18T21:35:38.288 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.289 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:35:38.289 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2020-05-18T21:35:38.289 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.289 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2020-05-18T21:35:38.290 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2020-05-18T21:35:38.290 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2020-05-18T21:35:38.290 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2020-05-18T21:35:38.290 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2020-05-18T21:35:38.290 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2020-05-18T21:35:38.291 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2020-05-18T21:35:38.291 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2020-05-18T21:35:38.291 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2020-05-18T21:35:38.291 INFO:teuthology.orchestra.run.smithi155.stdout: debug filestore = 20 2020-05-18T21:35:38.292 INFO:teuthology.orchestra.run.smithi155.stdout: debug journal = 20 2020-05-18T21:35:38.292 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 20 2020-05-18T21:35:38.293 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 25 2020-05-18T21:35:38.293 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2020-05-18T21:35:38.293 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:35:38.294 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2020-05-18T21:35:38.294 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:35:38.294 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:35:38.294 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2020-05-18T21:35:38.295 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:35:38.296 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.296 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2020-05-18T21:35:38.296 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:35:38.296 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2020-05-18T21:35:38.296 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:35:38.297 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:35:38.297 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:35:38.297 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:35:38.297 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2020-05-18T21:35:38.298 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.299 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2020-05-18T21:35:38.299 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:35:38.299 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:35:38.299 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2020-05-18T21:35:38.299 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:35:38.300 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2020-05-18T21:35:38.300 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2020-05-18T21:35:38.301 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:35:38.301 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2020-05-18T21:35:38.301 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2020-05-18T21:35:38.302 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:35:38.302 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2020-05-18T21:35:38.302 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.302 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2020-05-18T21:35:38.302 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2020-05-18T21:35:38.303 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2020-05-18T21:35:38.303 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2020-05-18T21:35:38.303 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:35:38.304 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:35:38.305 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2020-05-18T21:35:38.305 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2020-05-18T21:35:38.305 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:35:38.305 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2020-05-18T21:35:38.306 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2020-05-18T21:35:38.306 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2020-05-18T21:35:38.306 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2020-05-18T21:35:38.307 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2020-05-18T21:35:38.307 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2020-05-18T21:35:38.309 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2020-05-18T21:35:38.309 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2020-05-18T21:35:38.309 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:35:38.309 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal frag = True 2020-05-18T21:35:38.309 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2020-05-18T21:35:38.311 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2020-05-18T21:35:38.311 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2020-05-18T21:35:38.311 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2020-05-18T21:35:38.312 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2020-05-18T21:35:38.312 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2020-05-18T21:35:38.312 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2020-05-18T21:35:38.314 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2020-05-18T21:35:38.314 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:35:38.314 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_files = 100000000 2020-05-18T21:35:38.315 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_ops = 16 2020-05-18T21:35:38.320 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2020-05-18T21:35:38.321 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2020-05-18T21:35:38.322 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:35:38.323 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2020-05-18T21:35:38.323 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.323 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2020-05-18T21:35:38.324 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.324 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2020-05-18T21:35:38.324 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.325 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2020-05-18T21:35:38.325 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2020-05-18T21:35:38.325 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.326 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2020-05-18T21:35:38.326 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2020-05-18T21:35:38.326 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.327 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:35:38.327 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2020-05-18T21:35:38.327 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.328 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:35:38.328 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:35:38.328 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.329 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2020-05-18T21:35:38.329 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.329 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2020-05-18T21:35:38.330 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2020-05-18T21:35:38.330 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:35:38.330 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:35:38.330 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2020-05-18T21:35:38.331 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:35:38.331 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2020-05-18T21:35:38.332 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:35:38.332 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:35:38.333 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2020-05-18T21:35:38.333 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.333 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:35:38.334 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.334 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2020-05-18T21:35:38.334 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.335 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2020-05-18T21:35:38.335 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.335 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2020-05-18T21:35:38.336 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2020-05-18T21:35:38.336 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:35:38.336 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:35:38.336 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.337 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2020-05-18T21:35:38.337 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2020-05-18T21:35:38.337 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.338 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2020-05-18T21:35:38.338 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2020-05-18T21:35:38.338 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.339 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2020-05-18T21:35:38.339 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2020-05-18T21:35:38.339 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.340 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2020-05-18T21:35:38.340 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2020-05-18T21:35:38.340 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2020-05-18T21:35:38.341 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.341 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2020-05-18T21:35:38.341 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2020-05-18T21:35:38.342 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.343 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:35:38.343 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.343 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2020-05-18T21:35:38.344 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.344 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2020-05-18T21:35:38.345 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.345 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:35:38.345 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2020-05-18T21:35:38.346 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.346 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2020-05-18T21:35:38.346 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2020-05-18T21:35:38.347 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2020-05-18T21:35:38.347 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2020-05-18T21:35:38.347 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2020-05-18T21:35:38.348 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2020-05-18T21:35:38.348 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2020-05-18T21:35:38.348 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2020-05-18T21:35:38.349 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2020-05-18T21:35:38.349 INFO:teuthology.orchestra.run.smithi063.stdout: debug filestore = 20 2020-05-18T21:35:38.349 INFO:teuthology.orchestra.run.smithi063.stdout: debug journal = 20 2020-05-18T21:35:38.350 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 20 2020-05-18T21:35:38.350 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 25 2020-05-18T21:35:38.350 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2020-05-18T21:35:38.351 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:35:38.351 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2020-05-18T21:35:38.351 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:35:38.351 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:35:38.352 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2020-05-18T21:35:38.352 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:35:38.353 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.353 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2020-05-18T21:35:38.353 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:35:38.354 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2020-05-18T21:35:38.354 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:35:38.354 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:35:38.355 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:35:38.355 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:35:38.355 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2020-05-18T21:35:38.356 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.356 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2020-05-18T21:35:38.356 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:35:38.357 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:35:38.357 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2020-05-18T21:35:38.357 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:35:38.358 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2020-05-18T21:35:38.358 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2020-05-18T21:35:38.358 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:35:38.359 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2020-05-18T21:35:38.359 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2020-05-18T21:35:38.359 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:35:38.360 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2020-05-18T21:35:38.360 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.360 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2020-05-18T21:35:38.361 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2020-05-18T21:35:38.361 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2020-05-18T21:35:38.361 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2020-05-18T21:35:38.361 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:35:38.362 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:35:38.362 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2020-05-18T21:35:38.362 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2020-05-18T21:35:38.362 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:35:38.363 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2020-05-18T21:35:38.363 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2020-05-18T21:35:38.364 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2020-05-18T21:35:38.364 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2020-05-18T21:35:38.364 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2020-05-18T21:35:38.364 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2020-05-18T21:35:38.364 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2020-05-18T21:35:38.364 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2020-05-18T21:35:38.365 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:35:38.365 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal frag = True 2020-05-18T21:35:38.365 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal fragment size max = 10000 2020-05-18T21:35:38.365 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal merge size = 5 2020-05-18T21:35:38.365 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split bits = 3 2020-05-18T21:35:38.366 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split size = 100 2020-05-18T21:35:38.366 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2020-05-18T21:35:38.366 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2020-05-18T21:35:38.366 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2020-05-18T21:35:38.367 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2020-05-18T21:35:38.367 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:35:38.367 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_files = 100000000 2020-05-18T21:35:38.367 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_ops = 16 2020-05-18T21:35:38.369 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:35:38.414 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:35:38.448 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2020-05-18T21:35:38.449 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2020-05-18T21:35:38.449 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:35:38.450 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2020-05-18T21:35:38.450 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.450 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2020-05-18T21:35:38.451 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.451 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2020-05-18T21:35:38.451 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.451 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2020-05-18T21:35:38.452 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2020-05-18T21:35:38.452 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.452 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2020-05-18T21:35:38.453 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2020-05-18T21:35:38.453 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.453 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:35:38.454 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2020-05-18T21:35:38.454 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.454 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:35:38.454 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:35:38.455 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.455 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2020-05-18T21:35:38.455 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.455 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2020-05-18T21:35:38.456 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2020-05-18T21:35:38.456 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:35:38.456 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:35:38.456 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2020-05-18T21:35:38.456 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:35:38.457 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2020-05-18T21:35:38.458 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:35:38.458 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:35:38.459 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2020-05-18T21:35:38.459 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.459 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:35:38.460 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.460 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2020-05-18T21:35:38.460 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.461 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2020-05-18T21:35:38.461 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.461 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2020-05-18T21:35:38.461 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2020-05-18T21:35:38.462 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:35:38.462 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:35:38.462 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.463 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2020-05-18T21:35:38.463 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2020-05-18T21:35:38.463 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.463 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2020-05-18T21:35:38.464 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2020-05-18T21:35:38.464 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.464 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2020-05-18T21:35:38.464 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2020-05-18T21:35:38.464 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.464 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2020-05-18T21:35:38.465 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2020-05-18T21:35:38.465 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2020-05-18T21:35:38.465 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.465 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2020-05-18T21:35:38.466 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2020-05-18T21:35:38.466 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.466 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:35:38.466 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.466 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2020-05-18T21:35:38.467 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.467 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2020-05-18T21:35:38.467 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.468 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:35:38.468 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2020-05-18T21:35:38.468 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.469 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2020-05-18T21:35:38.469 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2020-05-18T21:35:38.469 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2020-05-18T21:35:38.469 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2020-05-18T21:35:38.470 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2020-05-18T21:35:38.470 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2020-05-18T21:35:38.470 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2020-05-18T21:35:38.470 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2020-05-18T21:35:38.470 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2020-05-18T21:35:38.470 INFO:teuthology.orchestra.run.smithi063.stdout: debug filestore = 20 2020-05-18T21:35:38.471 INFO:teuthology.orchestra.run.smithi063.stdout: debug journal = 20 2020-05-18T21:35:38.471 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 20 2020-05-18T21:35:38.471 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 25 2020-05-18T21:35:38.472 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2020-05-18T21:35:38.472 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:35:38.472 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2020-05-18T21:35:38.472 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:35:38.472 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:35:38.472 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2020-05-18T21:35:38.473 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:35:38.473 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.473 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2020-05-18T21:35:38.474 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:35:38.474 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2020-05-18T21:35:38.474 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:35:38.475 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:35:38.475 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:35:38.475 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:35:38.475 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2020-05-18T21:35:38.476 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.476 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2020-05-18T21:35:38.476 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:35:38.477 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:35:38.477 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2020-05-18T21:35:38.477 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:35:38.479 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2020-05-18T21:35:38.480 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2020-05-18T21:35:38.480 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:35:38.480 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2020-05-18T21:35:38.481 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2020-05-18T21:35:38.481 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:35:38.481 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2020-05-18T21:35:38.482 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.482 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2020-05-18T21:35:38.482 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2020-05-18T21:35:38.482 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2020-05-18T21:35:38.483 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2020-05-18T21:35:38.483 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:35:38.483 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:35:38.484 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2020-05-18T21:35:38.484 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2020-05-18T21:35:38.484 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:35:38.484 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2020-05-18T21:35:38.485 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2020-05-18T21:35:38.485 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2020-05-18T21:35:38.486 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2020-05-18T21:35:38.486 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2020-05-18T21:35:38.487 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2020-05-18T21:35:38.487 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2020-05-18T21:35:38.487 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2020-05-18T21:35:38.488 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:35:38.488 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal frag = True 2020-05-18T21:35:38.489 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal fragment size max = 10000 2020-05-18T21:35:38.489 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal merge size = 5 2020-05-18T21:35:38.490 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split bits = 3 2020-05-18T21:35:38.490 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split size = 100 2020-05-18T21:35:38.490 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2020-05-18T21:35:38.491 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2020-05-18T21:35:38.491 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2020-05-18T21:35:38.491 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2020-05-18T21:35:38.492 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:35:38.493 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_files = 100000000 2020-05-18T21:35:38.494 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2020-05-18T21:35:38.494 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2020-05-18T21:35:38.495 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:35:38.495 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2020-05-18T21:35:38.495 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.496 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2020-05-18T21:35:38.496 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.496 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2020-05-18T21:35:38.496 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.497 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2020-05-18T21:35:38.497 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2020-05-18T21:35:38.497 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.498 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2020-05-18T21:35:38.498 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2020-05-18T21:35:38.498 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.499 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:35:38.499 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2020-05-18T21:35:38.500 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.500 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:35:38.500 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:35:38.501 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.501 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2020-05-18T21:35:38.501 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.501 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2020-05-18T21:35:38.501 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2020-05-18T21:35:38.502 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:35:38.502 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:35:38.502 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2020-05-18T21:35:38.502 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:35:38.502 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2020-05-18T21:35:38.502 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:35:38.503 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:35:38.503 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2020-05-18T21:35:38.503 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.503 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:35:38.503 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.504 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2020-05-18T21:35:38.504 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.504 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2020-05-18T21:35:38.504 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.504 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2020-05-18T21:35:38.504 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2020-05-18T21:35:38.505 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:35:38.505 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:35:38.505 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.505 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2020-05-18T21:35:38.505 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2020-05-18T21:35:38.506 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.506 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2020-05-18T21:35:38.506 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2020-05-18T21:35:38.506 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.506 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2020-05-18T21:35:38.507 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2020-05-18T21:35:38.507 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.507 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2020-05-18T21:35:38.507 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2020-05-18T21:35:38.507 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2020-05-18T21:35:38.508 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.508 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2020-05-18T21:35:38.508 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2020-05-18T21:35:38.508 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.508 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:35:38.509 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.509 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2020-05-18T21:35:38.509 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.509 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2020-05-18T21:35:38.510 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.510 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:35:38.510 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2020-05-18T21:35:38.511 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.511 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2020-05-18T21:35:38.511 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2020-05-18T21:35:38.511 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2020-05-18T21:35:38.511 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2020-05-18T21:35:38.512 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2020-05-18T21:35:38.512 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2020-05-18T21:35:38.512 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2020-05-18T21:35:38.512 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2020-05-18T21:35:38.512 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2020-05-18T21:35:38.512 INFO:teuthology.orchestra.run.smithi155.stdout: debug filestore = 20 2020-05-18T21:35:38.513 INFO:teuthology.orchestra.run.smithi155.stdout: debug journal = 20 2020-05-18T21:35:38.513 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 20 2020-05-18T21:35:38.513 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 25 2020-05-18T21:35:38.513 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2020-05-18T21:35:38.513 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:35:38.513 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2020-05-18T21:35:38.514 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:35:38.514 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:35:38.514 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2020-05-18T21:35:38.514 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:35:38.514 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.515 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2020-05-18T21:35:38.515 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:35:38.515 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2020-05-18T21:35:38.515 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:35:38.515 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:35:38.515 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:35:38.516 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:35:38.516 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2020-05-18T21:35:38.516 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.516 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2020-05-18T21:35:38.516 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:35:38.517 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:35:38.517 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2020-05-18T21:35:38.517 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:35:38.517 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2020-05-18T21:35:38.517 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2020-05-18T21:35:38.517 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:35:38.518 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2020-05-18T21:35:38.518 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2020-05-18T21:35:38.518 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:35:38.518 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2020-05-18T21:35:38.518 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.519 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2020-05-18T21:35:38.519 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2020-05-18T21:35:38.519 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2020-05-18T21:35:38.519 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2020-05-18T21:35:38.519 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:35:38.520 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:35:38.520 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2020-05-18T21:35:38.520 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2020-05-18T21:35:38.521 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:35:38.521 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2020-05-18T21:35:38.521 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2020-05-18T21:35:38.521 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2020-05-18T21:35:38.521 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2020-05-18T21:35:38.522 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2020-05-18T21:35:38.522 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2020-05-18T21:35:38.522 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2020-05-18T21:35:38.522 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2020-05-18T21:35:38.522 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:35:38.523 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal frag = True 2020-05-18T21:35:38.523 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2020-05-18T21:35:38.523 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2020-05-18T21:35:38.524 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2020-05-18T21:35:38.524 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2020-05-18T21:35:38.524 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2020-05-18T21:35:38.524 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2020-05-18T21:35:38.525 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2020-05-18T21:35:38.525 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2020-05-18T21:35:38.525 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:35:38.525 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_files = 100000000 2020-05-18T21:35:38.527 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:35:38.530 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:35:38.565 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2020-05-18T21:35:38.566 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2020-05-18T21:35:38.566 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:35:38.566 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2020-05-18T21:35:38.566 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.567 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2020-05-18T21:35:38.567 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.567 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2020-05-18T21:35:38.567 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.567 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2020-05-18T21:35:38.568 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2020-05-18T21:35:38.568 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.568 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2020-05-18T21:35:38.568 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2020-05-18T21:35:38.568 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.569 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:35:38.569 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2020-05-18T21:35:38.569 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.569 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:35:38.569 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:35:38.570 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.570 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2020-05-18T21:35:38.570 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.570 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2020-05-18T21:35:38.570 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2020-05-18T21:35:38.570 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:35:38.571 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:35:38.571 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2020-05-18T21:35:38.571 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:35:38.571 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2020-05-18T21:35:38.572 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:35:38.572 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:35:38.572 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2020-05-18T21:35:38.572 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.572 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:35:38.573 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.573 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2020-05-18T21:35:38.573 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.573 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2020-05-18T21:35:38.573 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.574 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2020-05-18T21:35:38.574 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2020-05-18T21:35:38.574 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:35:38.574 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:35:38.574 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.574 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2020-05-18T21:35:38.575 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2020-05-18T21:35:38.575 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.575 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2020-05-18T21:35:38.575 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2020-05-18T21:35:38.575 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.576 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2020-05-18T21:35:38.576 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2020-05-18T21:35:38.576 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.576 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2020-05-18T21:35:38.576 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2020-05-18T21:35:38.576 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2020-05-18T21:35:38.577 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.577 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2020-05-18T21:35:38.577 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2020-05-18T21:35:38.577 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.577 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:35:38.577 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.578 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2020-05-18T21:35:38.578 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.578 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2020-05-18T21:35:38.578 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.578 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:35:38.579 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2020-05-18T21:35:38.579 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.579 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2020-05-18T21:35:38.579 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2020-05-18T21:35:38.579 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2020-05-18T21:35:38.579 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2020-05-18T21:35:38.580 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2020-05-18T21:35:38.580 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2020-05-18T21:35:38.580 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2020-05-18T21:35:38.580 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2020-05-18T21:35:38.580 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2020-05-18T21:35:38.581 INFO:teuthology.orchestra.run.smithi155.stdout: debug filestore = 20 2020-05-18T21:35:38.581 INFO:teuthology.orchestra.run.smithi155.stdout: debug journal = 20 2020-05-18T21:35:38.581 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 20 2020-05-18T21:35:38.581 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 25 2020-05-18T21:35:38.582 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2020-05-18T21:35:38.582 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:35:38.582 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2020-05-18T21:35:38.582 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:35:38.582 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:35:38.583 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2020-05-18T21:35:38.583 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:35:38.583 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.583 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2020-05-18T21:35:38.583 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:35:38.583 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2020-05-18T21:35:38.584 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:35:38.584 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:35:38.584 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:35:38.584 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:35:38.584 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2020-05-18T21:35:38.585 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.585 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2020-05-18T21:35:38.585 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:35:38.585 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:35:38.585 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2020-05-18T21:35:38.586 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:35:38.592 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2020-05-18T21:35:38.592 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2020-05-18T21:35:38.593 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:35:38.593 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2020-05-18T21:35:38.593 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2020-05-18T21:35:38.593 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:35:38.594 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2020-05-18T21:35:38.594 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:35:38.594 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2020-05-18T21:35:38.594 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2020-05-18T21:35:38.594 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2020-05-18T21:35:38.595 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2020-05-18T21:35:38.595 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:35:38.595 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:35:38.595 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2020-05-18T21:35:38.595 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2020-05-18T21:35:38.595 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:35:38.596 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2020-05-18T21:35:38.596 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2020-05-18T21:35:38.596 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2020-05-18T21:35:38.596 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2020-05-18T21:35:38.596 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2020-05-18T21:35:38.597 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2020-05-18T21:35:38.597 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2020-05-18T21:35:38.597 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2020-05-18T21:35:38.597 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:35:38.597 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal frag = True 2020-05-18T21:35:38.598 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2020-05-18T21:35:38.598 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2020-05-18T21:35:38.598 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2020-05-18T21:35:38.598 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2020-05-18T21:35:38.598 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2020-05-18T21:35:38.598 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2020-05-18T21:35:38.599 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2020-05-18T21:35:38.599 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2020-05-18T21:35:38.599 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:35:38.600 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2020-05-18T21:35:38.601 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2020-05-18T21:35:38.601 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:35:38.601 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2020-05-18T21:35:38.601 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.601 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2020-05-18T21:35:38.602 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.602 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2020-05-18T21:35:38.602 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.602 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2020-05-18T21:35:38.603 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2020-05-18T21:35:38.603 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.603 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2020-05-18T21:35:38.603 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2020-05-18T21:35:38.603 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.604 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:35:38.604 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2020-05-18T21:35:38.604 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.604 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:35:38.604 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:35:38.605 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.605 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2020-05-18T21:35:38.605 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.605 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2020-05-18T21:35:38.605 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2020-05-18T21:35:38.605 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:35:38.606 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:35:38.606 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2020-05-18T21:35:38.606 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:35:38.606 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2020-05-18T21:35:38.606 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:35:38.607 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:35:38.607 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2020-05-18T21:35:38.607 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.607 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:35:38.608 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.608 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2020-05-18T21:35:38.608 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.608 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2020-05-18T21:35:38.608 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.608 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2020-05-18T21:35:38.609 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2020-05-18T21:35:38.609 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:35:38.609 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:35:38.609 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.609 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2020-05-18T21:35:38.610 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2020-05-18T21:35:38.610 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.610 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2020-05-18T21:35:38.610 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2020-05-18T21:35:38.610 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.610 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2020-05-18T21:35:38.611 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2020-05-18T21:35:38.611 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.611 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2020-05-18T21:35:38.611 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2020-05-18T21:35:38.611 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2020-05-18T21:35:38.612 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.612 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2020-05-18T21:35:38.612 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2020-05-18T21:35:38.612 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.613 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:35:38.613 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.613 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2020-05-18T21:35:38.613 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.613 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2020-05-18T21:35:38.614 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.614 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:35:38.614 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2020-05-18T21:35:38.614 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.614 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2020-05-18T21:35:38.614 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2020-05-18T21:35:38.615 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2020-05-18T21:35:38.615 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2020-05-18T21:35:38.615 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2020-05-18T21:35:38.615 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2020-05-18T21:35:38.615 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2020-05-18T21:35:38.616 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2020-05-18T21:35:38.616 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2020-05-18T21:35:38.616 INFO:teuthology.orchestra.run.smithi063.stdout: debug filestore = 20 2020-05-18T21:35:38.616 INFO:teuthology.orchestra.run.smithi063.stdout: debug journal = 20 2020-05-18T21:35:38.616 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 20 2020-05-18T21:35:38.616 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 25 2020-05-18T21:35:38.617 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2020-05-18T21:35:38.617 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:35:38.617 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2020-05-18T21:35:38.617 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:35:38.617 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:35:38.617 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2020-05-18T21:35:38.618 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:35:38.618 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.618 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2020-05-18T21:35:38.618 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:35:38.618 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2020-05-18T21:35:38.619 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:35:38.619 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:35:38.619 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:35:38.619 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:35:38.619 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2020-05-18T21:35:38.619 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.620 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2020-05-18T21:35:38.620 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:35:38.620 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:35:38.620 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2020-05-18T21:35:38.620 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:35:38.621 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2020-05-18T21:35:38.621 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2020-05-18T21:35:38.621 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:35:38.621 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2020-05-18T21:35:38.622 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2020-05-18T21:35:38.622 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:35:38.622 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2020-05-18T21:35:38.622 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:38.622 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2020-05-18T21:35:38.623 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2020-05-18T21:35:38.624 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2020-05-18T21:35:38.624 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2020-05-18T21:35:38.624 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:35:38.624 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:35:38.625 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2020-05-18T21:35:38.625 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2020-05-18T21:35:38.625 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:35:38.625 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2020-05-18T21:35:38.625 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2020-05-18T21:35:38.626 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2020-05-18T21:35:38.626 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2020-05-18T21:35:38.626 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2020-05-18T21:35:38.626 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2020-05-18T21:35:38.626 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2020-05-18T21:35:38.627 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2020-05-18T21:35:38.627 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:35:38.627 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal frag = True 2020-05-18T21:35:38.627 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal fragment size max = 10000 2020-05-18T21:35:38.627 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal merge size = 5 2020-05-18T21:35:38.627 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split bits = 3 2020-05-18T21:35:38.628 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split size = 100 2020-05-18T21:35:38.628 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2020-05-18T21:35:38.628 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2020-05-18T21:35:38.628 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2020-05-18T21:35:38.628 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2020-05-18T21:35:38.629 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:35:38.629 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_strays.TestStrays.test_ops_throttle' 2020-05-18T21:35:38.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.746+0000 7fa9cfc3f700 1 Processor -- start 2020-05-18T21:35:38.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.746+0000 7fa9cfc3f700 1 -- start start 2020-05-18T21:35:38.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cfc3f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa9c8149610 0x7fa9c8146010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:38.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cfc3f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c80b4a20 con 0x7fa9c8061440 2020-05-18T21:35:38.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cfc3f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c81466e0 con 0x7fa9c80b8ee0 2020-05-18T21:35:38.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cfc3f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c8146500 con 0x7fa9c8149610 2020-05-18T21:35:38.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cd1da700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa9c8149610 0x7fa9c8146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:38.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cd1da700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa9c8149610 0x7fa9c8146010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34182/0 (socket says 172.21.15.63:34182) 2020-05-18T21:35:38.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cd1da700 1 -- 172.21.15.63:0/2446875548 learned_addr learned my addr 172.21.15.63:0/2446875548 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:38.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9ce1dc700 1 --1- 172.21.15.63:0/2446875548 >> v1:172.21.15.63:6789/0 conn(0x7fa9c8061440 0x7fa9c80618b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36372/0 (socket says 172.21.15.63:36372) 2020-05-18T21:35:38.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cd1da700 1 -- 172.21.15.63:0/2446875548 >> v1:172.21.15.155:6789/0 conn(0x7fa9c80b8ee0 legacy=0x7fa9c813fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:38.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cd1da700 1 -- 172.21.15.63:0/2446875548 >> v1:172.21.15.63:6789/0 conn(0x7fa9c8061440 legacy=0x7fa9c80618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:38.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cd1da700 1 -- 172.21.15.63:0/2446875548 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c8146980 con 0x7fa9c8149610 2020-05-18T21:35:38.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cd1da700 1 --2- 172.21.15.63:0/2446875548 >> v2:172.21.15.63:3300/0 conn(0x7fa9c8149610 0x7fa9c8146010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa9bc002f70 tx=0x7fa9bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:38.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cd1da700 1 --2- 172.21.15.63:0/2446875548 >> v2:172.21.15.63:3300/0 conn(0x7fa9c8149610 0x7fa9c8146010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa9bc002f70 tx=0x7fa9bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:38.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cd1da700 1 --2- 172.21.15.63:0/2446875548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9c8149610 0x7fa9c8146010 secure :-1 s=READY pgs=1744 cs=0 l=1 rx=0x7fa9bc002f70 tx=0x7fa9bc007a80).ready entity=mon.0 client_cookie=c703d669fdd79545 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:38.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cd1da700 1 --2- 172.21.15.63:0/2446875548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9c8149610 0x7fa9c8146010 secure :-1 s=THROTTLE_DONE pgs=1744 cs=0 l=1 rx=0x7fa9bc002f70 tx=0x7fa9bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:38.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cc9d9700 1 -- 172.21.15.63:0/2446875548 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9bc010800 con 0x7fa9c8149610 2020-05-18T21:35:38.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cd1da700 1 --2- 172.21.15.63:0/2446875548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9c8149610 0x7fa9c8146010 secure :-1 s=THROTTLE_DONE pgs=1744 cs=0 l=1 rx=0x7fa9bc002f70 tx=0x7fa9bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:38.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cc9d9700 1 -- 172.21.15.63:0/2446875548 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9bc010960 con 0x7fa9c8149610 2020-05-18T21:35:38.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cd1da700 1 --2- 172.21.15.63:0/2446875548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9c8149610 0x7fa9c8146010 secure :-1 s=THROTTLE_DONE pgs=1744 cs=0 l=1 rx=0x7fa9bc002f70 tx=0x7fa9bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:38.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cfc3f700 1 -- 172.21.15.63:0/2446875548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9c8149610 msgr2=0x7fa9c8146010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:38.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cc9d9700 1 -- 172.21.15.63:0/2446875548 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9bc010d80 con 0x7fa9c8149610 2020-05-18T21:35:38.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.750+0000 7fa9cfc3f700 1 --2- 172.21.15.63:0/2446875548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9c8149610 0x7fa9c8146010 secure :-1 s=READY pgs=1744 cs=0 l=1 rx=0x7fa9bc002f70 tx=0x7fa9bc007a80).stop 2020-05-18T21:35:38.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.754+0000 7fa9cfc3f700 1 -- 172.21.15.63:0/2446875548 shutdown_connections 2020-05-18T21:35:38.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.754+0000 7fa9cfc3f700 1 --2- 172.21.15.63:0/2446875548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9c8149610 0x7fa9c8146010 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:38.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.754+0000 7fa9cfc3f700 1 -- 172.21.15.63:0/2446875548 >> 172.21.15.63:0/2446875548 conn(0x7fa9c805a7c0 msgr2=0x7fa9c805aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:38.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.754+0000 7fa9cfc3f700 1 -- 172.21.15.63:0/2446875548 shutdown_connections 2020-05-18T21:35:38.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.754+0000 7fa9cfc3f700 1 -- 172.21.15.63:0/2446875548 wait complete. 2020-05-18T21:35:38.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.754+0000 7fa9cfc3f700 1 Processor -- start 2020-05-18T21:35:38.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.754+0000 7fa9cfc3f700 1 -- start start 2020-05-18T21:35:38.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.754+0000 7fa9cfc3f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa9c8061440 0x7fa9c809c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:38.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.754+0000 7fa9cfc3f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa9c8149610 0x7fa9c8069eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:38.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.754+0000 7fa9cfc3f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c809eb10 con 0x7fa9c80b8ee0 2020-05-18T21:35:38.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.754+0000 7fa9cfc3f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c806a310 con 0x7fa9c8061440 2020-05-18T21:35:38.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.754+0000 7fa9cfc3f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c8144d20 con 0x7fa9c8149610 2020-05-18T21:35:38.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.754+0000 7fa9cd9db700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa9c8061440 0x7fa9c809c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:38.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.754+0000 7fa9cd9db700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa9c8061440 0x7fa9c809c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34186/0 (socket says 172.21.15.63:34186) 2020-05-18T21:35:38.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.754+0000 7fa9cd9db700 1 -- 172.21.15.63:0/1038541699 learned_addr learned my addr 172.21.15.63:0/1038541699 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:38.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9ce1dc700 1 --2- 172.21.15.63:0/1038541699 >> v2:172.21.15.155:3300/0 conn(0x7fa9c8149610 0x7fa9c8069eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:38.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9cd9db700 1 -- 172.21.15.63:0/1038541699 >> v2:172.21.15.155:3300/0 conn(0x7fa9c8149610 msgr2=0x7fa9c8069eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:38.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9cd9db700 1 --2- 172.21.15.63:0/1038541699 >> v2:172.21.15.155:3300/0 conn(0x7fa9c8149610 0x7fa9c8069eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:38.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9cd9db700 1 -- 172.21.15.63:0/1038541699 >> v1:172.21.15.155:6789/0 conn(0x7fa9c80b8ee0 legacy=0x7fa9c8145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:38.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9cd9db700 1 -- 172.21.15.63:0/1038541699 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c8144fc0 con 0x7fa9c8061440 2020-05-18T21:35:38.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9cd9db700 1 --2- 172.21.15.63:0/1038541699 >> v2:172.21.15.63:3300/0 conn(0x7fa9c8061440 0x7fa9c809c1e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa9c805b660 tx=0x7fa9b800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:38.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9cd9db700 1 --2- 172.21.15.63:0/1038541699 >> v2:172.21.15.63:3300/0 conn(0x7fa9c8061440 0x7fa9c809c1e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa9c805b660 tx=0x7fa9b800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:38.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9cd9db700 1 --2- 172.21.15.63:0/1038541699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9c8061440 0x7fa9c809c1e0 secure :-1 s=READY pgs=1745 cs=0 l=1 rx=0x7fa9c805b660 tx=0x7fa9b800c820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:38.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9cd9db700 1 --2- 172.21.15.63:0/1038541699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9c8061440 0x7fa9c809c1e0 secure :-1 s=THROTTLE_DONE pgs=1745 cs=0 l=1 rx=0x7fa9c805b660 tx=0x7fa9b800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:38.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9cd9db700 1 --2- 172.21.15.63:0/1038541699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9c8061440 0x7fa9c809c1e0 secure :-1 s=THROTTLE_DONE pgs=1745 cs=0 l=1 rx=0x7fa9c805b660 tx=0x7fa9b800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:38.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9c6ffd700 1 -- 172.21.15.63:0/1038541699 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9b80101e0 con 0x7fa9c8061440 2020-05-18T21:35:38.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9cd9db700 1 --2- 172.21.15.63:0/1038541699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9c8061440 0x7fa9c809c1e0 secure :-1 s=THROTTLE_DONE pgs=1745 cs=0 l=1 rx=0x7fa9c805b660 tx=0x7fa9b800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:38.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9c6ffd700 1 -- 172.21.15.63:0/1038541699 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b8010340 con 0x7fa9c8061440 2020-05-18T21:35:38.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9cfc3f700 1 -- 172.21.15.63:0/1038541699 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c8145260 con 0x7fa9c8061440 2020-05-18T21:35:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9c6ffd700 1 -- 172.21.15.63:0/1038541699 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9b8010760 con 0x7fa9c8061440 2020-05-18T21:35:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9cfc3f700 1 -- 172.21.15.63:0/1038541699 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c80b2e50 con 0x7fa9c8061440 2020-05-18T21:35:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9cd9db700 1 --2- 172.21.15.63:0/1038541699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9c8061440 0x7fa9c809c1e0 secure :-1 s=THROTTLE_DONE pgs=1745 cs=0 l=1 rx=0x7fa9c805b660 tx=0x7fa9b800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9cfc3f700 1 -- 172.21.15.63:0/1038541699 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9c80569e0 con 0x7fa9c8061440 2020-05-18T21:35:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9c6ffd700 1 -- 172.21.15.63:0/1038541699 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa9b80068a0 con 0x7fa9c8061440 2020-05-18T21:35:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9cd9db700 1 --2- 172.21.15.63:0/1038541699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9c8061440 0x7fa9c809c1e0 secure :-1 s=THROTTLE_DONE pgs=1745 cs=0 l=1 rx=0x7fa9c805b660 tx=0x7fa9b800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9c6ffd700 1 --2- 172.21.15.63:0/1038541699 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa9a804fa60 0x7fa9a8051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9c6ffd700 1 -- 172.21.15.63:0/1038541699 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa9b8064180 con 0x7fa9c8061440 2020-05-18T21:35:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9cd1da700 1 --2- 172.21.15.63:0/1038541699 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa9a804fa60 0x7fa9a8051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.758+0000 7fa9cd1da700 1 --2- 172.21.15.63:0/1038541699 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa9a804fa60 0x7fa9a8051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa9c806a850 tx=0x7fa9bc010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:38.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.762+0000 7fa9cd1da700 1 --2- 172.21.15.63:0/1038541699 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa9a804fa60 0x7fa9a8051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa9c806a850 tx=0x7fa9bc010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:38.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.762+0000 7fa9cd1da700 1 --2- 172.21.15.63:0/1038541699 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa9a804fa60 0x7fa9a8051f20 secure :-1 s=READY pgs=674 cs=0 l=1 rx=0x7fa9c806a850 tx=0x7fa9bc010fa0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:38.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.762+0000 7fa9cd9db700 1 --2- 172.21.15.63:0/1038541699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9c8061440 0x7fa9c809c1e0 secure :-1 s=THROTTLE_DONE pgs=1745 cs=0 l=1 rx=0x7fa9c805b660 tx=0x7fa9b800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:38.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.762+0000 7fa9c6ffd700 1 -- 172.21.15.63:0/1038541699 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa9b803e4b0 con 0x7fa9c8061440 2020-05-18T21:35:38.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:38.914+0000 7fa9cfc3f700 1 -- 172.21.15.63:0/1038541699 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_ops_throttle"]} v 0) v1 -- 0x7fa9c809ecf0 con 0x7fa9c8061440 2020-05-18T21:35:39.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.754+0000 7fa9cd9db700 1 --2- 172.21.15.63:0/1038541699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9c8061440 0x7fa9c809c1e0 secure :-1 s=THROTTLE_DONE pgs=1745 cs=0 l=1 rx=0x7fa9c805b660 tx=0x7fa9b800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:39.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.754+0000 7fa9c6ffd700 1 -- 172.21.15.63:0/1038541699 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_ops_throttle"]}]=0 v433) v1 ==== 132+0+0 (secure 0 0 0) 0x7fa9b8041ad0 con 0x7fa9c8061440 2020-05-18T21:35:39.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.754+0000 7fa9cd9db700 1 --2- 172.21.15.63:0/1038541699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9c8061440 0x7fa9c809c1e0 secure :-1 s=READY pgs=1745 cs=0 l=1 rx=0x7fa9c805b660 tx=0x7fa9b800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:39.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.758+0000 7fa9cfc3f700 1 -- 172.21.15.63:0/1038541699 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa9a804fa60 msgr2=0x7fa9a8051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:39.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.758+0000 7fa9cfc3f700 1 --2- 172.21.15.63:0/1038541699 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa9a804fa60 0x7fa9a8051f20 secure :-1 s=READY pgs=674 cs=0 l=1 rx=0x7fa9c806a850 tx=0x7fa9bc010fa0).stop 2020-05-18T21:35:39.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.758+0000 7fa9cfc3f700 1 -- 172.21.15.63:0/1038541699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9c8061440 msgr2=0x7fa9c809c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:39.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.758+0000 7fa9cfc3f700 1 --2- 172.21.15.63:0/1038541699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9c8061440 0x7fa9c809c1e0 secure :-1 s=READY pgs=1745 cs=0 l=1 rx=0x7fa9c805b660 tx=0x7fa9b800c820).stop 2020-05-18T21:35:39.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.758+0000 7fa9cfc3f700 1 -- 172.21.15.63:0/1038541699 shutdown_connections 2020-05-18T21:35:39.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.758+0000 7fa9cfc3f700 1 --2- 172.21.15.63:0/1038541699 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa9a804fa60 0x7fa9a8051f20 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:39.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.758+0000 7fa9cfc3f700 1 --2- 172.21.15.63:0/1038541699 >> v2:172.21.15.155:3300/0 conn(0x7fa9c8149610 0x7fa9c8069eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:39.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.758+0000 7fa9cfc3f700 1 --2- 172.21.15.63:0/1038541699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9c8061440 0x7fa9c809c1e0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:39.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.758+0000 7fa9cfc3f700 1 -- 172.21.15.63:0/1038541699 >> 172.21.15.63:0/1038541699 conn(0x7fa9c805a7c0 msgr2=0x7fa9c805ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:39.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.758+0000 7fa9cfc3f700 1 -- 172.21.15.63:0/1038541699 shutdown_connections 2020-05-18T21:35:39.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.758+0000 7fa9cfc3f700 1 -- 172.21.15.63:0/1038541699 wait complete. 2020-05-18T21:35:39.777 INFO:tasks.cephfs_test_runner:test_ops_throttle (tasks.cephfs.test_strays.TestStrays) ... ok 2020-05-18T21:35:39.778 INFO:tasks.cephfs_test_runner:Starting test: test_purge_on_shutdown (tasks.cephfs.test_strays.TestStrays) 2020-05-18T21:35:39.778 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_strays.TestStrays.test_purge_on_shutdown' 2020-05-18T21:35:39.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.886+0000 7f75ea9ac700 1 Processor -- start 2020-05-18T21:35:39.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.886+0000 7f75ea9ac700 1 -- start start 2020-05-18T21:35:39.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.886+0000 7f75ea9ac700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f75e40614c0 0x7f75e414aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:39.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.886+0000 7f75ea9ac700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f75e4060850 0x7f75e4060c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:39.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.886+0000 7f75ea9ac700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e40ad9d0 con 0x7f75e4147ab0 2020-05-18T21:35:39.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.886+0000 7f75ea9ac700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e40adc70 con 0x7f75e4060850 2020-05-18T21:35:39.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.886+0000 7f75ea9ac700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e4147e90 con 0x7f75e40614c0 2020-05-18T21:35:39.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.886+0000 7f75e8f49700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f75e4060850 0x7f75e4060c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:39.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.886+0000 7f75e8f49700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f75e4060850 0x7f75e4060c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34198/0 (socket says 172.21.15.63:34198) 2020-05-18T21:35:39.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.886+0000 7f75e8f49700 1 -- 172.21.15.63:0/671010684 learned_addr learned my addr 172.21.15.63:0/671010684 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:39.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.886+0000 7f75e37fe700 1 --2- 172.21.15.63:0/671010684 >> v2:172.21.15.155:3300/0 conn(0x7f75e40614c0 0x7f75e414aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:39.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.886+0000 7f75e8f49700 1 -- 172.21.15.63:0/671010684 >> v2:172.21.15.155:3300/0 conn(0x7f75e40614c0 msgr2=0x7f75e414aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:39.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.886+0000 7f75e8f49700 1 --2- 172.21.15.63:0/671010684 >> v2:172.21.15.155:3300/0 conn(0x7f75e40614c0 0x7f75e414aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:39.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.886+0000 7f75e8f49700 1 -- 172.21.15.63:0/671010684 >> v1:172.21.15.155:6789/0 conn(0x7f75e4147ab0 legacy=0x7f75e40ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:39.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.886+0000 7f75e8f49700 1 -- 172.21.15.63:0/671010684 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e40ae820 con 0x7f75e4060850 2020-05-18T21:35:39.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.886+0000 7f75e37fe700 1 --2- 172.21.15.63:0/671010684 >> v2:172.21.15.155:3300/0 conn(0x7f75e40614c0 0x7f75e414aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:35:39.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.886+0000 7f75e8f49700 1 --2- 172.21.15.63:0/671010684 >> v2:172.21.15.63:3300/0 conn(0x7f75e4060850 0x7f75e4060c60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f75d4002f70 tx=0x7f75d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:39.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.886+0000 7f75e8f49700 1 --2- 172.21.15.63:0/671010684 >> v2:172.21.15.63:3300/0 conn(0x7f75e4060850 0x7f75e4060c60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f75d4002f70 tx=0x7f75d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:39.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.886+0000 7f75e8f49700 1 --2- 172.21.15.63:0/671010684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75e4060850 0x7f75e4060c60 secure :-1 s=READY pgs=1746 cs=0 l=1 rx=0x7f75d4002f70 tx=0x7f75d4007a80).ready entity=mon.0 client_cookie=fde7ae9ef359792 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:39.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75e8f49700 1 --2- 172.21.15.63:0/671010684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75e4060850 0x7f75e4060c60 secure :-1 s=THROTTLE_DONE pgs=1746 cs=0 l=1 rx=0x7f75d4002f70 tx=0x7f75d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:39.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75e2ffd700 1 -- 172.21.15.63:0/671010684 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d4011760 con 0x7f75e4060850 2020-05-18T21:35:39.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75e8f49700 1 --2- 172.21.15.63:0/671010684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75e4060850 0x7f75e4060c60 secure :-1 s=THROTTLE_DONE pgs=1746 cs=0 l=1 rx=0x7f75d4002f70 tx=0x7f75d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:39.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75e8f49700 1 --2- 172.21.15.63:0/671010684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75e4060850 0x7f75e4060c60 secure :-1 s=THROTTLE_DONE pgs=1746 cs=0 l=1 rx=0x7f75d4002f70 tx=0x7f75d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:39.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75e2ffd700 1 -- 172.21.15.63:0/671010684 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d40118c0 con 0x7f75e4060850 2020-05-18T21:35:39.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75e2ffd700 1 -- 172.21.15.63:0/671010684 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d4011ce0 con 0x7f75e4060850 2020-05-18T21:35:39.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75ea9ac700 1 -- 172.21.15.63:0/671010684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75e4060850 msgr2=0x7f75e4060c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:39.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75ea9ac700 1 --2- 172.21.15.63:0/671010684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75e4060850 0x7f75e4060c60 secure :-1 s=READY pgs=1746 cs=0 l=1 rx=0x7f75d4002f70 tx=0x7f75d4007a80).stop 2020-05-18T21:35:39.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75ea9ac700 1 -- 172.21.15.63:0/671010684 shutdown_connections 2020-05-18T21:35:39.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75ea9ac700 1 --2- 172.21.15.63:0/671010684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75e4060850 0x7f75e4060c60 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:39.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75ea9ac700 1 --2- 172.21.15.63:0/671010684 >> v2:172.21.15.155:3300/0 conn(0x7f75e40614c0 0x7f75e414aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:39.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75ea9ac700 1 -- 172.21.15.63:0/671010684 >> 172.21.15.63:0/671010684 conn(0x7f75e4069b70 msgr2=0x7f75e4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:39.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75ea9ac700 1 -- 172.21.15.63:0/671010684 shutdown_connections 2020-05-18T21:35:39.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75ea9ac700 1 -- 172.21.15.63:0/671010684 wait complete. 2020-05-18T21:35:39.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75ea9ac700 1 Processor -- start 2020-05-18T21:35:39.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75ea9ac700 1 -- start start 2020-05-18T21:35:39.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75ea9ac700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f75e4060850 0x7f75e40b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:39.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75ea9ac700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75e40614c0 0x7f75e40b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:39.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75ea9ac700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f75e4147ab0 0x7f75e40b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:39.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75ea9ac700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e40b1d40 con 0x7f75e4147ab0 2020-05-18T21:35:39.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75ea9ac700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e40b0230 con 0x7f75e4060850 2020-05-18T21:35:39.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.890+0000 7f75ea9ac700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e40b37b0 con 0x7f75e40614c0 2020-05-18T21:35:39.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e8f49700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f75e4147ab0 0x7f75e40b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:39.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e8f49700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f75e4147ab0 0x7f75e40b3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34204/0 (socket says 172.21.15.63:34204) 2020-05-18T21:35:39.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e8f49700 1 -- 172.21.15.63:0/1997135602 learned_addr learned my addr 172.21.15.63:0/1997135602 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:39.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e37fe700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75e40614c0 0x7f75e40b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:39.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e3fff700 1 --2- 172.21.15.63:0/1997135602 >> v2:172.21.15.155:3300/0 conn(0x7f75e4060850 0x7f75e40b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e8f49700 1 -- 172.21.15.63:0/1997135602 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75e40614c0 msgr2=0x7f75e40b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e8f49700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75e40614c0 0x7f75e40b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e8f49700 1 -- 172.21.15.63:0/1997135602 >> v2:172.21.15.155:3300/0 conn(0x7f75e4060850 msgr2=0x7f75e40b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e8f49700 1 --2- 172.21.15.63:0/1997135602 >> v2:172.21.15.155:3300/0 conn(0x7f75e4060850 0x7f75e40b1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e8f49700 1 -- 172.21.15.63:0/1997135602 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e40b2520 con 0x7f75e4147ab0 2020-05-18T21:35:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e3fff700 1 --2- 172.21.15.63:0/1997135602 >> v2:172.21.15.155:3300/0 conn(0x7f75e4060850 0x7f75e40b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:35:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e8f49700 1 --2- 172.21.15.63:0/1997135602 >> v2:172.21.15.63:3300/0 conn(0x7f75e4147ab0 0x7f75e40b3350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75d4002f70 tx=0x7f75d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e8f49700 1 --2- 172.21.15.63:0/1997135602 >> v2:172.21.15.63:3300/0 conn(0x7f75e4147ab0 0x7f75e40b3350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75d4002f70 tx=0x7f75d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e8f49700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75e4147ab0 0x7f75e40b3350 secure :-1 s=READY pgs=1747 cs=0 l=1 rx=0x7f75d4002f70 tx=0x7f75d4007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e8f49700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75e4147ab0 0x7f75e40b3350 secure :-1 s=THROTTLE_DONE pgs=1747 cs=0 l=1 rx=0x7f75d4002f70 tx=0x7f75d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e17fa700 1 -- 172.21.15.63:0/1997135602 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d4010300 con 0x7f75e4147ab0 2020-05-18T21:35:39.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e8f49700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75e4147ab0 0x7f75e40b3350 secure :-1 s=THROTTLE_DONE pgs=1747 cs=0 l=1 rx=0x7f75d4002f70 tx=0x7f75d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:39.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e17fa700 1 -- 172.21.15.63:0/1997135602 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d4007170 con 0x7f75e4147ab0 2020-05-18T21:35:39.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e8f49700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75e4147ab0 0x7f75e40b3350 secure :-1 s=THROTTLE_DONE pgs=1747 cs=0 l=1 rx=0x7f75d4002f70 tx=0x7f75d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:39.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75ea9ac700 1 -- 172.21.15.63:0/1997135602 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e40b04a0 con 0x7f75e4147ab0 2020-05-18T21:35:39.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e17fa700 1 -- 172.21.15.63:0/1997135602 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d40074d0 con 0x7f75e4147ab0 2020-05-18T21:35:39.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75ea9ac700 1 -- 172.21.15.63:0/1997135602 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e40b0ae0 con 0x7f75e4147ab0 2020-05-18T21:35:39.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e8f49700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75e4147ab0 0x7f75e40b3350 secure :-1 s=THROTTLE_DONE pgs=1747 cs=0 l=1 rx=0x7f75d4002f70 tx=0x7f75d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:39.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75ea9ac700 1 -- 172.21.15.63:0/1997135602 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e40b1130 con 0x7f75e4147ab0 2020-05-18T21:35:39.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e17fa700 1 -- 172.21.15.63:0/1997135602 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f75d4005700 con 0x7f75e4147ab0 2020-05-18T21:35:39.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.894+0000 7f75e8f49700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75e4147ab0 0x7f75e40b3350 secure :-1 s=THROTTLE_DONE pgs=1747 cs=0 l=1 rx=0x7f75d4002f70 tx=0x7f75d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:39.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.898+0000 7f75e17fa700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f75c804fa10 0x7f75c8051ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:39.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.898+0000 7f75e17fa700 1 -- 172.21.15.63:0/1997135602 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f75d4064350 con 0x7f75e4147ab0 2020-05-18T21:35:39.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.898+0000 7f75e3fff700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f75c804fa10 0x7f75c8051ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.898+0000 7f75e3fff700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f75c804fa10 0x7f75c8051ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75e405fb40 tx=0x7f75dc001b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.898+0000 7f75e3fff700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f75c804fa10 0x7f75c8051ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75e405fb40 tx=0x7f75dc001b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:39.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.898+0000 7f75e3fff700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f75c804fa10 0x7f75c8051ed0 secure :-1 s=READY pgs=675 cs=0 l=1 rx=0x7f75e405fb40 tx=0x7f75dc001b70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:39.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.906+0000 7f75e8f49700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75e4147ab0 0x7f75e40b3350 secure :-1 s=THROTTLE_DONE pgs=1747 cs=0 l=1 rx=0x7f75d4002f70 tx=0x7f75d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:39.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:39.906+0000 7f75e17fa700 1 -- 172.21.15.63:0/1997135602 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f75d403e740 con 0x7f75e4147ab0 2020-05-18T21:35:40.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.062+0000 7f75ea9ac700 1 -- 172.21.15.63:0/1997135602 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_purge_on_shutdown"]} v 0) v1 -- 0x7f75e40569e0 con 0x7f75e4147ab0 2020-05-18T21:35:40.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.758+0000 7f75e8f49700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75e4147ab0 0x7f75e40b3350 secure :-1 s=THROTTLE_DONE pgs=1747 cs=0 l=1 rx=0x7f75d4002f70 tx=0x7f75d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:40.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.758+0000 7f75e17fa700 1 -- 172.21.15.63:0/1997135602 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_purge_on_shutdown"]}]=0 v434) v1 ==== 140+0+0 (secure 0 0 0) 0x7f75d4041d60 con 0x7f75e4147ab0 2020-05-18T21:35:40.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.762+0000 7f75ea9ac700 1 -- 172.21.15.63:0/1997135602 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f75c804fa10 msgr2=0x7f75c8051ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:40.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.762+0000 7f75ea9ac700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f75c804fa10 0x7f75c8051ed0 secure :-1 s=READY pgs=675 cs=0 l=1 rx=0x7f75e405fb40 tx=0x7f75dc001b70).stop 2020-05-18T21:35:40.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.762+0000 7f75ea9ac700 1 -- 172.21.15.63:0/1997135602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75e4147ab0 msgr2=0x7f75e40b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:40.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.762+0000 7f75ea9ac700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75e4147ab0 0x7f75e40b3350 secure :-1 s=READY pgs=1747 cs=0 l=1 rx=0x7f75d4002f70 tx=0x7f75d4007a80).stop 2020-05-18T21:35:40.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.762+0000 7f75ea9ac700 1 -- 172.21.15.63:0/1997135602 shutdown_connections 2020-05-18T21:35:40.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.762+0000 7f75ea9ac700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f75c804fa10 0x7f75c8051ed0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:40.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.762+0000 7f75ea9ac700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75e4147ab0 0x7f75e40b3350 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:40.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.762+0000 7f75ea9ac700 1 --2- 172.21.15.63:0/1997135602 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75e40614c0 0x7f75e40b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:40.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.762+0000 7f75ea9ac700 1 --2- 172.21.15.63:0/1997135602 >> v2:172.21.15.155:3300/0 conn(0x7f75e4060850 0x7f75e40b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:40.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.762+0000 7f75ea9ac700 1 -- 172.21.15.63:0/1997135602 >> 172.21.15.63:0/1997135602 conn(0x7f75e4069b70 msgr2=0x7f75e40b71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:40.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.762+0000 7f75ea9ac700 1 -- 172.21.15.63:0/1997135602 shutdown_connections 2020-05-18T21:35:40.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.762+0000 7f75ea9ac700 1 -- 172.21.15.63:0/1997135602 wait complete. 2020-05-18T21:35:40.786 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:35:40.786 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:35:40.807 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:35:40.827 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:35:40.828 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-05-18T21:35:40.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.934+0000 7f27a6d91700 1 Processor -- start 2020-05-18T21:35:40.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.934+0000 7f27a6d91700 1 -- start start 2020-05-18T21:35:40.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.934+0000 7f27a6d91700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f27a013de20 0x7f27a00b6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:40.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.934+0000 7f27a6d91700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f27a0144810 0x7f27a006a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:40.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.934+0000 7f27a6d91700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a0069b70 con 0x7f27a00b4f60 2020-05-18T21:35:40.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.934+0000 7f27a6d91700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a0069e10 con 0x7f27a0144810 2020-05-18T21:35:40.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.934+0000 7f27a6d91700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a006a0b0 con 0x7f27a013de20 2020-05-18T21:35:40.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f279ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f27a0144810 0x7f27a006a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:40.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f27a532e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f27a00b4f60 0x7f27a0062a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36400/0 (socket says 172.21.15.63:36400) 2020-05-18T21:35:40.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f27a532e700 1 -- 172.21.15.63:0/791876058 learned_addr learned my addr 172.21.15.63:0/791876058 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:40.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f27a4b2d700 1 --2- 172.21.15.63:0/791876058 >> v2:172.21.15.155:3300/0 conn(0x7f27a013de20 0x7f27a00b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:40.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f279f7fe700 1 -- 172.21.15.63:0/791876058 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676788031 0 0) 0x7f27a0069b70 con 0x7f27a00b4f60 2020-05-18T21:35:40.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f279f7fe700 1 -- 172.21.15.63:0/791876058 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2784003270 con 0x7f27a00b4f60 2020-05-18T21:35:40.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f279ffff700 1 -- 172.21.15.63:0/791876058 >> v2:172.21.15.155:3300/0 conn(0x7f27a013de20 msgr2=0x7f27a00b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:40.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f279ffff700 1 --2- 172.21.15.63:0/791876058 >> v2:172.21.15.155:3300/0 conn(0x7f27a013de20 0x7f27a00b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f279f7fe700 1 -- 172.21.15.63:0/791876058 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 662881987 0 0) 0x7f2784003270 con 0x7f27a00b4f60 2020-05-18T21:35:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f279ffff700 1 -- 172.21.15.63:0/791876058 >> v1:172.21.15.63:6789/0 conn(0x7f27a00b4f60 legacy=0x7f27a0062a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f279ffff700 1 -- 172.21.15.63:0/791876058 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a0144c50 con 0x7f27a0144810 2020-05-18T21:35:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f279ffff700 1 --2- 172.21.15.63:0/791876058 >> v2:172.21.15.63:3300/0 conn(0x7f27a0144810 0x7f27a006a550 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2798001c30 tx=0x7f278c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f279ffff700 1 --2- 172.21.15.63:0/791876058 >> v2:172.21.15.63:3300/0 conn(0x7f27a0144810 0x7f27a006a550 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2798001c30 tx=0x7f278c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:40.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f279ffff700 1 --2- 172.21.15.63:0/791876058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27a0144810 0x7f27a006a550 secure :-1 s=READY pgs=1749 cs=0 l=1 rx=0x7f2798001c30 tx=0x7f278c007a80).ready entity=mon.0 client_cookie=410507a95e60fb24 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:40.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f279ffff700 1 --2- 172.21.15.63:0/791876058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27a0144810 0x7f27a006a550 secure :-1 s=THROTTLE_DONE pgs=1749 cs=0 l=1 rx=0x7f2798001c30 tx=0x7f278c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:40.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f279ffff700 1 --2- 172.21.15.63:0/791876058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27a0144810 0x7f27a006a550 secure :-1 s=THROTTLE_DONE pgs=1749 cs=0 l=1 rx=0x7f2798001c30 tx=0x7f278c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:40.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f279f7fe700 1 -- 172.21.15.63:0/791876058 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2798001a90 con 0x7f27a0144810 2020-05-18T21:35:40.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f279ffff700 1 --2- 172.21.15.63:0/791876058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27a0144810 0x7f27a006a550 secure :-1 s=THROTTLE_DONE pgs=1749 cs=0 l=1 rx=0x7f2798001c30 tx=0x7f278c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:40.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f279f7fe700 1 -- 172.21.15.63:0/791876058 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c008b80 con 0x7f27a0144810 2020-05-18T21:35:40.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f279f7fe700 1 -- 172.21.15.63:0/791876058 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f278c0113d0 con 0x7f27a0144810 2020-05-18T21:35:40.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f27a6d91700 1 -- 172.21.15.63:0/791876058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27a0144810 msgr2=0x7f27a006a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:40.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f27a6d91700 1 --2- 172.21.15.63:0/791876058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27a0144810 0x7f27a006a550 secure :-1 s=READY pgs=1749 cs=0 l=1 rx=0x7f2798001c30 tx=0x7f278c007a80).stop 2020-05-18T21:35:40.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f27a6d91700 1 -- 172.21.15.63:0/791876058 shutdown_connections 2020-05-18T21:35:40.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f27a6d91700 1 --2- 172.21.15.63:0/791876058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27a0144810 0x7f27a006a550 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:40.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f27a6d91700 1 --2- 172.21.15.63:0/791876058 >> v2:172.21.15.155:3300/0 conn(0x7f27a013de20 0x7f27a00b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:40.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f27a6d91700 1 -- 172.21.15.63:0/791876058 >> 172.21.15.63:0/791876058 conn(0x7f27a00ba5c0 msgr2=0x7f27a00ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:40.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f27a6d91700 1 -- 172.21.15.63:0/791876058 shutdown_connections 2020-05-18T21:35:40.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.938+0000 7f27a6d91700 1 -- 172.21.15.63:0/791876058 wait complete. 2020-05-18T21:35:40.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.942+0000 7f27a6d91700 1 Processor -- start 2020-05-18T21:35:40.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.942+0000 7f27a6d91700 1 -- start start 2020-05-18T21:35:40.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.942+0000 7f27a6d91700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f27a00b4f60 0x7f27a0140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:40.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.942+0000 7f27a6d91700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f27a0144810 0x7f27a0147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:40.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.942+0000 7f27a6d91700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a00b3420 con 0x7f27a013de20 2020-05-18T21:35:40.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.942+0000 7f27a6d91700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a00b3e90 con 0x7f27a00b4f60 2020-05-18T21:35:40.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.942+0000 7f27a6d91700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a00b36c0 con 0x7f27a0144810 2020-05-18T21:35:40.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.942+0000 7f27a4b2d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f27a00b4f60 0x7f27a0140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:40.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.942+0000 7f27a4b2d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f27a00b4f60 0x7f27a0140dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34214/0 (socket says 172.21.15.63:34214) 2020-05-18T21:35:40.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.942+0000 7f27a4b2d700 1 -- 172.21.15.63:0/880448725 learned_addr learned my addr 172.21.15.63:0/880448725 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:40.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.942+0000 7f27a532e700 1 --2- 172.21.15.63:0/880448725 >> v2:172.21.15.155:3300/0 conn(0x7f27a0144810 0x7f27a0147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:40.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f27a4b2d700 1 -- 172.21.15.63:0/880448725 >> v2:172.21.15.155:3300/0 conn(0x7f27a0144810 msgr2=0x7f27a0147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:40.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f27a4b2d700 1 --2- 172.21.15.63:0/880448725 >> v2:172.21.15.155:3300/0 conn(0x7f27a0144810 0x7f27a0147240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:40.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f27a4b2d700 1 -- 172.21.15.63:0/880448725 >> v1:172.21.15.155:6789/0 conn(0x7f27a013de20 legacy=0x7f27a013c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:40.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f27a4b2d700 1 -- 172.21.15.63:0/880448725 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a00b3960 con 0x7f27a00b4f60 2020-05-18T21:35:40.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f27a532e700 1 --2- 172.21.15.63:0/880448725 >> v2:172.21.15.155:3300/0 conn(0x7f27a0144810 0x7f27a0147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:35:40.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f27a4b2d700 1 --2- 172.21.15.63:0/880448725 >> v2:172.21.15.63:3300/0 conn(0x7f27a00b4f60 0x7f27a0140dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27940030b0 tx=0x7f2794010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:40.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f27a4b2d700 1 --2- 172.21.15.63:0/880448725 >> v2:172.21.15.63:3300/0 conn(0x7f27a00b4f60 0x7f27a0140dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27940030b0 tx=0x7f2794010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:40.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f27a4b2d700 1 --2- 172.21.15.63:0/880448725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27a00b4f60 0x7f27a0140dd0 secure :-1 s=READY pgs=1750 cs=0 l=1 rx=0x7f27940030b0 tx=0x7f2794010d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:40.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f27a4b2d700 1 --2- 172.21.15.63:0/880448725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27a00b4f60 0x7f27a0140dd0 secure :-1 s=THROTTLE_DONE pgs=1750 cs=0 l=1 rx=0x7f27940030b0 tx=0x7f2794010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:40.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f279dffb700 1 -- 172.21.15.63:0/880448725 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2794007180 con 0x7f27a00b4f60 2020-05-18T21:35:40.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f27a4b2d700 1 --2- 172.21.15.63:0/880448725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27a00b4f60 0x7f27a0140dd0 secure :-1 s=THROTTLE_DONE pgs=1750 cs=0 l=1 rx=0x7f27940030b0 tx=0x7f2794010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:40.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f279dffb700 1 -- 172.21.15.63:0/880448725 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27940072e0 con 0x7f27a00b4f60 2020-05-18T21:35:40.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f27a6d91700 1 -- 172.21.15.63:0/880448725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a013c850 con 0x7f27a00b4f60 2020-05-18T21:35:40.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f27a4b2d700 1 --2- 172.21.15.63:0/880448725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27a00b4f60 0x7f27a0140dd0 secure :-1 s=THROTTLE_DONE pgs=1750 cs=0 l=1 rx=0x7f27940030b0 tx=0x7f2794010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:40.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f279dffb700 1 -- 172.21.15.63:0/880448725 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27940123e0 con 0x7f27a00b4f60 2020-05-18T21:35:40.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f27a6d91700 1 -- 172.21.15.63:0/880448725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a01476a0 con 0x7f27a00b4f60 2020-05-18T21:35:40.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f27a4b2d700 1 --2- 172.21.15.63:0/880448725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27a00b4f60 0x7f27a0140dd0 secure :-1 s=THROTTLE_DONE pgs=1750 cs=0 l=1 rx=0x7f27940030b0 tx=0x7f2794010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:40.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f27a6d91700 1 -- 172.21.15.63:0/880448725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a00b3290 con 0x7f27a00b4f60 2020-05-18T21:35:40.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f279dffb700 1 -- 172.21.15.63:0/880448725 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2794012660 con 0x7f27a00b4f60 2020-05-18T21:35:40.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f27a4b2d700 1 --2- 172.21.15.63:0/880448725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27a00b4f60 0x7f27a0140dd0 secure :-1 s=THROTTLE_DONE pgs=1750 cs=0 l=1 rx=0x7f27940030b0 tx=0x7f2794010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:40.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f279dffb700 1 --2- 172.21.15.63:0/880448725 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f278804f9c0 0x7f2788051e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:40.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f279dffb700 1 -- 172.21.15.63:0/880448725 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f2794064480 con 0x7f27a00b4f60 2020-05-18T21:35:40.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.946+0000 7f279ffff700 1 --2- 172.21.15.63:0/880448725 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f278804f9c0 0x7f2788051e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:40.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.950+0000 7f279ffff700 1 --2- 172.21.15.63:0/880448725 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f278804f9c0 0x7f2788051e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27a00b99d0 tx=0x7f278c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:40.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.950+0000 7f279ffff700 1 --2- 172.21.15.63:0/880448725 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f278804f9c0 0x7f2788051e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27a00b99d0 tx=0x7f278c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:40.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.950+0000 7f279ffff700 1 --2- 172.21.15.63:0/880448725 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f278804f9c0 0x7f2788051e80 secure :-1 s=READY pgs=676 cs=0 l=1 rx=0x7f27a00b99d0 tx=0x7f278c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:40.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.954+0000 7f27a4b2d700 1 --2- 172.21.15.63:0/880448725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27a00b4f60 0x7f27a0140dd0 secure :-1 s=THROTTLE_DONE pgs=1750 cs=0 l=1 rx=0x7f27940030b0 tx=0x7f2794010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:40.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:40.954+0000 7f279dffb700 1 -- 172.21.15.63:0/880448725 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f279403e7b0 con 0x7f27a00b4f60 2020-05-18T21:35:41.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.070+0000 7f27a6d91700 1 -- 172.21.15.63:0/880448725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f27a00b3b60 con 0x7f27a00b4f60 2020-05-18T21:35:41.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.074+0000 7f27a4b2d700 1 --2- 172.21.15.63:0/880448725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27a00b4f60 0x7f27a0140dd0 secure :-1 s=THROTTLE_DONE pgs=1750 cs=0 l=1 rx=0x7f27940030b0 tx=0x7f2794010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.074+0000 7f279dffb700 1 -- 172.21.15.63:0/880448725 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v125) v1 ==== 81+0+33864 (secure 0 0 0) 0x7f27a00b3b60 con 0x7f27a00b4f60 2020-05-18T21:35:41.080 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:41.080 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:35:41.081 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 125, 2020-05-18T21:35:41.081 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:35:41.081 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2020-05-18T21:26:28.798650+0000", 2020-05-18T21:35:41.081 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2020-05-18T21:34:36.072130+0000", 2020-05-18T21:35:41.081 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:35:41.082 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:35:41.082 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-05-18T21:35:41.082 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5799936, 2020-05-18T21:35:41.082 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2020-05-18T21:35:41.083 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2020-05-18T21:35:41.083 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2020-05-18T21:35:41.083 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2020-05-18T21:35:41.083 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2020-05-18T21:35:41.084 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:35:41.084 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 4, 2020-05-18T21:35:41.084 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2020-05-18T21:35:41.084 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-05-18T21:35:41.084 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2020-05-18T21:35:41.085 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2020-05-18T21:35:41.085 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 24, 2020-05-18T21:35:41.085 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 8, 2020-05-18T21:35:41.085 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2020-05-18T21:35:41.085 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "jewel", 2020-05-18T21:35:41.086 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "pacific", 2020-05-18T21:35:41.086 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:35:41.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.086 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2020-05-18T21:35:41.086 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "device_health_metrics", 2020-05-18T21:35:41.087 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:33.080792+0000", 2020-05-18T21:35:41.087 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:35:41.087 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:35:41.087 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:35:41.088 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:35:41.088 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:35:41.088 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:35:41.088 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:35:41.088 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:35:41.088 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2020-05-18T21:35:41.089 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2020-05-18T21:35:41.089 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2020-05-18T21:35:41.089 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2020-05-18T21:35:41.089 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2020-05-18T21:35:41.090 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:35:41.090 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:35:41.090 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:35:41.090 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:35:41.090 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:35:41.091 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:35:41.091 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:35:41.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.091 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "15", 2020-05-18T21:35:41.091 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:35:41.091 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:35:41.092 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:35:41.092 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:35:41.092 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:35:41.092 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:35:41.092 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:35:41.093 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:35:41.093 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:35:41.093 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:35:41.093 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:35:41.093 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:35:41.094 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:35:41.094 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:35:41.094 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:35:41.094 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:35:41.094 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:35:41.095 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:35:41.095 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:35:41.095 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:35:41.095 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:35:41.096 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:35:41.096 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:35:41.096 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:35:41.096 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:35:41.097 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:35:41.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.097 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:35:41.097 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:35:41.097 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:35:41.098 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:35:41.098 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:35:41.098 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:35:41.098 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:35:41.099 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:35:41.099 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:35:41.099 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:35:41.099 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:35:41.100 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:35:41.100 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2020-05-18T21:35:41.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.100 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:35:41.100 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_devicehealth": {} 2020-05-18T21:35:41.101 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.101 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2020-05-18T21:35:41.101 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2020-05-18T21:35:41.101 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:40.149370+0000", 2020-05-18T21:35:41.102 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:35:41.102 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:35:41.102 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:35:41.102 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:35:41.102 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:35:41.103 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:35:41.103 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:35:41.103 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:35:41.103 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:35:41.103 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:35:41.103 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:35:41.104 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:35:41.104 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:35:41.104 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:35:41.104 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:35:41.104 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:35:41.105 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:35:41.105 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:35:41.105 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:35:41.105 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:35:41.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2020-05-18T21:35:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:35:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:35:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:35:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:35:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:35:41.107 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:35:41.107 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:35:41.107 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:35:41.107 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:35:41.107 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:35:41.108 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:35:41.108 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:35:41.108 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:35:41.108 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:35:41.108 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:35:41.109 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:35:41.109 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:35:41.109 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:35:41.109 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:35:41.109 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:35:41.110 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:35:41.110 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:35:41.110 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:35:41.110 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:35:41.110 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:35:41.111 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:35:41.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.111 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:35:41.111 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:35:41.111 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:35:41.112 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:35:41.112 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:35:41.112 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:35:41.112 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:35:41.112 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:35:41.113 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:35:41.113 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:35:41.113 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:35:41.113 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:35:41.114 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:35:41.114 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2020-05-18T21:35:41.114 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.115 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 23, 2020-05-18T21:35:41.115 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2020-05-18T21:35:41.115 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:34:26.108423+0000", 2020-05-18T21:35:41.115 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:35:41.115 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:35:41.116 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:35:41.116 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:35:41.116 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:35:41.116 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:35:41.116 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:35:41.116 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:35:41.117 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:35:41.117 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:35:41.117 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:35:41.117 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:35:41.117 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:35:41.118 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:35:41.118 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:35:41.118 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:35:41.118 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:35:41.118 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:35:41.118 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:35:41.119 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:35:41.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.119 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "122", 2020-05-18T21:35:41.119 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:35:41.119 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:35:41.120 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:35:41.120 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:35:41.120 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:35:41.120 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:35:41.121 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:35:41.121 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:35:41.121 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:35:41.121 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:35:41.122 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:35:41.122 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:35:41.122 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:35:41.122 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:35:41.122 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:35:41.122 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:35:41.123 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:35:41.123 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:35:41.123 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:35:41.123 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:35:41.123 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:35:41.124 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:35:41.124 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:35:41.124 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:35:41.124 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:35:41.124 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:35:41.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.125 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:35:41.125 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:35:41.125 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:35:41.125 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:35:41.125 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:35:41.126 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:35:41.126 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:35:41.126 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:35:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:35:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:35:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:35:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:35:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2020-05-18T21:35:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2020-05-18T21:35:41.128 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2020-05-18T21:35:41.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.128 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:35:41.129 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:35:41.129 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2020-05-18T21:35:41.129 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.129 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.130 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 24, 2020-05-18T21:35:41.130 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2020-05-18T21:35:41.130 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:34:26.753473+0000", 2020-05-18T21:35:41.131 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:35:41.131 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:35:41.131 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:35:41.131 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:35:41.131 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:35:41.132 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:35:41.132 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:35:41.132 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:35:41.132 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:35:41.132 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:35:41.133 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:35:41.133 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:35:41.133 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:35:41.133 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:35:41.133 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:35:41.134 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:35:41.134 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:35:41.134 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:35:41.135 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:35:41.135 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:35:41.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.135 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "123", 2020-05-18T21:35:41.136 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:35:41.136 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:35:41.136 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:35:41.136 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:35:41.136 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:35:41.136 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:35:41.137 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:35:41.137 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:35:41.137 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:35:41.137 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:35:41.137 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:35:41.138 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:35:41.138 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:35:41.138 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:35:41.138 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:35:41.138 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:35:41.139 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:35:41.139 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:35:41.139 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:35:41.139 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:35:41.139 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:35:41.140 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:35:41.140 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:35:41.140 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:35:41.140 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:35:41.140 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:35:41.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.141 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:35:41.141 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:35:41.141 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:35:41.142 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:35:41.142 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:35:41.142 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:35:41.142 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:35:41.142 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:35:41.143 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:35:41.143 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:35:41.143 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:35:41.143 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:35:41.143 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:35:41.144 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:35:41.144 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2020-05-18T21:35:41.144 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.144 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.144 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.145 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:35:41.145 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2020-05-18T21:35:41.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.145 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:35:41.145 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "c6ae0fbf-604c-4e8d-b1b8-6038821420e3", 2020-05-18T21:35:41.146 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:35:41.146 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:35:41.146 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:35:41.146 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:35:41.147 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:35:41.147 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:35:41.147 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:35:41.147 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 120, 2020-05-18T21:35:41.148 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:35:41.148 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:35:41.148 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:35:41.148 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.149 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.149 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2020-05-18T21:35:41.149 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:35:41.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.150 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.150 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2020-05-18T21:35:41.150 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:35:41.151 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.151 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.151 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:35:41.151 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.152 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.152 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6802", 2020-05-18T21:35:41.152 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:35:41.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.153 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.153 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6803", 2020-05-18T21:35:41.153 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:35:41.154 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.154 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.154 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:35:41.154 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.155 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.155 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6806", 2020-05-18T21:35:41.155 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:35:41.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.156 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.156 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6807", 2020-05-18T21:35:41.156 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:35:41.156 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.157 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.157 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:35:41.157 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.157 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.158 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6804", 2020-05-18T21:35:41.158 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:35:41.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.159 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.159 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6805", 2020-05-18T21:35:41.160 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:35:41.160 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.160 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.161 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6801/12803", 2020-05-18T21:35:41.161 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6803/12803", 2020-05-18T21:35:41.161 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6807/12803", 2020-05-18T21:35:41.161 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6805/12803", 2020-05-18T21:35:41.161 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:35:41.162 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:35:41.162 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:35:41.162 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.163 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:35:41.163 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6", 2020-05-18T21:35:41.164 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:35:41.164 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:35:41.164 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:35:41.164 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:35:41.164 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:35:41.165 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:35:41.165 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:35:41.165 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 120, 2020-05-18T21:35:41.165 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:35:41.166 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:35:41.166 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:35:41.166 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.167 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.167 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6808", 2020-05-18T21:35:41.167 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:35:41.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.168 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.168 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6809", 2020-05-18T21:35:41.168 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:35:41.168 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.169 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.169 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:35:41.169 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.170 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.170 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6810", 2020-05-18T21:35:41.170 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:35:41.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.171 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.171 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6811", 2020-05-18T21:35:41.171 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:35:41.171 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.171 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.172 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:35:41.172 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.172 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.173 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6815", 2020-05-18T21:35:41.173 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:35:41.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.173 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.174 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6817", 2020-05-18T21:35:41.174 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:35:41.174 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.174 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.175 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:35:41.175 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.175 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.175 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6812", 2020-05-18T21:35:41.176 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:35:41.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.177 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.177 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6813", 2020-05-18T21:35:41.177 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:35:41.177 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6809/12804", 2020-05-18T21:35:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6811/12804", 2020-05-18T21:35:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6817/12804", 2020-05-18T21:35:41.179 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6813/12804", 2020-05-18T21:35:41.179 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:35:41.179 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:35:41.179 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:35:41.179 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.180 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:35:41.180 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "ec8d9fa9-dae9-45f6-b286-735ab3801c27", 2020-05-18T21:35:41.180 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:35:41.181 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:35:41.181 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:35:41.181 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:35:41.181 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:35:41.181 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:35:41.182 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:35:41.182 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 119, 2020-05-18T21:35:41.182 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:35:41.182 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:35:41.182 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:35:41.183 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.183 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.184 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6822", 2020-05-18T21:35:41.184 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:35:41.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.185 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.185 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6824", 2020-05-18T21:35:41.185 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:35:41.185 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.186 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.186 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:35:41.186 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.187 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.187 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6826", 2020-05-18T21:35:41.187 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:35:41.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.188 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.188 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6827", 2020-05-18T21:35:41.188 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:35:41.189 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.189 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.189 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:35:41.189 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.190 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.190 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6830", 2020-05-18T21:35:41.190 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:35:41.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.191 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.191 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6831", 2020-05-18T21:35:41.191 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:35:41.191 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.192 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.192 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:35:41.192 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.193 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.193 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6828", 2020-05-18T21:35:41.193 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:35:41.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.194 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.194 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6829", 2020-05-18T21:35:41.194 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:35:41.195 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.195 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.196 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6824/12806", 2020-05-18T21:35:41.196 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6827/12806", 2020-05-18T21:35:41.196 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6831/12806", 2020-05-18T21:35:41.196 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6829/12806", 2020-05-18T21:35:41.196 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:35:41.197 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:35:41.197 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:35:41.197 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.197 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.198 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:35:41.198 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "1030fedf-adad-4e79-b839-59385d4d7d2a", 2020-05-18T21:35:41.198 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:35:41.198 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:35:41.198 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:35:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:35:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:35:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:35:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:35:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 120, 2020-05-18T21:35:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:35:41.200 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:35:41.200 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:35:41.200 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.200 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.201 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6814", 2020-05-18T21:35:41.201 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:35:41.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.201 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6816", 2020-05-18T21:35:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:35:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:35:41.203 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.203 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.203 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6818", 2020-05-18T21:35:41.203 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:35:41.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.204 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.204 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6819", 2020-05-18T21:35:41.204 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:35:41.204 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:35:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.206 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.206 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6823", 2020-05-18T21:35:41.206 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:35:41.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6825", 2020-05-18T21:35:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:35:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.208 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:35:41.208 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.208 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.208 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6820", 2020-05-18T21:35:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:35:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6821", 2020-05-18T21:35:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:35:41.210 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.210 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.210 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6816/12805", 2020-05-18T21:35:41.210 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6819/12805", 2020-05-18T21:35:41.211 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6825/12805", 2020-05-18T21:35:41.211 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6821/12805", 2020-05-18T21:35:41.211 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:35:41.211 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:35:41.211 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:35:41.212 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.212 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:35:41.213 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "8ad15a9b-97b4-4002-b1d4-7292e09b4ef6", 2020-05-18T21:35:41.213 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:35:41.213 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:35:41.214 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:35:41.214 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:35:41.214 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:35:41.214 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:35:41.215 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:35:41.215 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 119, 2020-05-18T21:35:41.215 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:35:41.215 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:35:41.216 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:35:41.216 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.216 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.216 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6800", 2020-05-18T21:35:41.217 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:35:41.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.217 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.217 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6801", 2020-05-18T21:35:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:35:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:35:41.219 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.219 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.219 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6802", 2020-05-18T21:35:41.219 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:35:41.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.220 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.220 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6803", 2020-05-18T21:35:41.220 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:35:41.220 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:35:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6806", 2020-05-18T21:35:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:35:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6807", 2020-05-18T21:35:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:35:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:35:41.224 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.224 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.224 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6804", 2020-05-18T21:35:41.224 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:35:41.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.225 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.225 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6805", 2020-05-18T21:35:41.225 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:35:41.225 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.226 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.226 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6801/13023", 2020-05-18T21:35:41.226 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6803/13023", 2020-05-18T21:35:41.226 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6807/13023", 2020-05-18T21:35:41.227 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6805/13023", 2020-05-18T21:35:41.227 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:35:41.227 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:35:41.227 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:35:41.227 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.228 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:35:41.228 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0dce88f8-b984-43e1-95e2-4132171102d2", 2020-05-18T21:35:41.228 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:35:41.228 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:35:41.229 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:35:41.229 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:35:41.229 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:35:41.229 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:35:41.229 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:35:41.230 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 120, 2020-05-18T21:35:41.230 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:35:41.230 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:35:41.230 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:35:41.230 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.231 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.231 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6808", 2020-05-18T21:35:41.231 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:35:41.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.232 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.232 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6809", 2020-05-18T21:35:41.232 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:35:41.232 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.232 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.233 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:35:41.233 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.233 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.233 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6810", 2020-05-18T21:35:41.234 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:35:41.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.234 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.234 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6811", 2020-05-18T21:35:41.234 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:35:41.235 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.235 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.235 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:35:41.235 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.236 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.236 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6814", 2020-05-18T21:35:41.236 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:35:41.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.237 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.237 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6816", 2020-05-18T21:35:41.237 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:35:41.237 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.237 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.238 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:35:41.238 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.238 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.238 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6812", 2020-05-18T21:35:41.239 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:35:41.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.239 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.239 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6813", 2020-05-18T21:35:41.240 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:35:41.240 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.240 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.240 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6809/13024", 2020-05-18T21:35:41.240 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6811/13024", 2020-05-18T21:35:41.241 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6816/13024", 2020-05-18T21:35:41.241 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6813/13024", 2020-05-18T21:35:41.241 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:35:41.241 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:35:41.241 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:35:41.242 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.242 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:35:41.242 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "e1bc92f8-3692-4483-b0fb-905c94fa1469", 2020-05-18T21:35:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:35:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:35:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:35:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:35:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:35:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:35:41.244 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:35:41.244 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 121, 2020-05-18T21:35:41.244 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:35:41.244 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:35:41.244 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:35:41.245 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.245 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.245 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6815", 2020-05-18T21:35:41.245 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:35:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6817", 2020-05-18T21:35:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:35:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.251 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.251 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:35:41.252 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.252 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.252 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6818", 2020-05-18T21:35:41.252 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:35:41.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.253 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.253 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6819", 2020-05-18T21:35:41.253 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:35:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:35:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6822", 2020-05-18T21:35:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:35:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.256 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.256 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6824", 2020-05-18T21:35:41.256 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:35:41.256 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.256 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.257 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:35:41.258 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.258 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.258 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6820", 2020-05-18T21:35:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:35:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6821", 2020-05-18T21:35:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:35:41.260 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.260 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.260 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6817/13025", 2020-05-18T21:35:41.260 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6819/13025", 2020-05-18T21:35:41.261 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6824/13025", 2020-05-18T21:35:41.261 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6821/13025", 2020-05-18T21:35:41.261 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:35:41.261 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:35:41.261 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:35:41.262 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.262 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:35:41.262 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "b76e000c-a078-48c4-9e1e-34d286a9992c", 2020-05-18T21:35:41.262 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:35:41.263 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:35:41.263 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:35:41.263 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:35:41.263 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:35:41.263 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:35:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:35:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 120, 2020-05-18T21:35:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:35:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:35:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:35:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.265 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.265 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6823", 2020-05-18T21:35:41.265 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:35:41.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.266 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.266 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6825", 2020-05-18T21:35:41.266 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:35:41.266 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:35:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.268 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6826", 2020-05-18T21:35:41.268 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:35:41.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.268 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.269 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6827", 2020-05-18T21:35:41.269 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:35:41.269 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.269 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.270 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:35:41.270 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.270 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.270 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6830", 2020-05-18T21:35:41.270 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:35:41.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.271 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.271 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6831", 2020-05-18T21:35:41.271 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:35:41.272 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.272 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.272 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:35:41.272 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:35:41.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.273 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:35:41.273 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6828", 2020-05-18T21:35:41.273 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:35:41.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6829", 2020-05-18T21:35:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:35:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.275 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6825/13026", 2020-05-18T21:35:41.275 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6827/13026", 2020-05-18T21:35:41.275 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6831/13026", 2020-05-18T21:35:41.275 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6829/13026", 2020-05-18T21:35:41.275 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:35:41.276 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:35:41.276 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:35:41.276 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:41.276 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.276 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:35:41.277 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2020-05-18T21:35:41.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.277 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:35:41.277 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:35:41.277 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:35:41.277 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:35:41.278 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:35:41.278 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:35:41.278 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.281434+0000", 2020-05-18T21:35:41.278 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:35:41.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.279 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:35:41.279 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:35:41.279 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:35:41.279 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:35:41.279 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:35:41.280 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:35:41.280 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.608518+0000", 2020-05-18T21:35:41.280 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:35:41.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.281 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:35:41.281 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:35:41.281 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:35:41.281 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:35:41.281 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:35:41.281 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:35:41.282 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.582386+0000", 2020-05-18T21:35:41.282 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:35:41.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.282 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:35:41.283 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:35:41.283 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:35:41.283 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:35:41.283 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:35:41.283 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:35:41.283 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.573488+0000", 2020-05-18T21:35:41.284 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:35:41.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.284 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:35:41.284 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:35:41.285 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:35:41.285 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:35:41.285 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:35:41.285 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:35:41.285 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.604174+0000", 2020-05-18T21:35:41.285 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:35:41.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.286 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:35:41.286 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:35:41.286 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:35:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:35:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:35:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:35:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.371004+0000", 2020-05-18T21:35:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:35:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.288 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:35:41.288 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:35:41.288 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:35:41.288 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:35:41.289 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:35:41.289 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:35:41.289 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.593070+0000", 2020-05-18T21:35:41.290 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:35:41.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:41.290 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:35:41.290 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:35:41.291 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:35:41.291 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:35:41.291 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:35:41.291 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:35:41.291 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.667677+0000", 2020-05-18T21:35:41.292 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:35:41.292 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.292 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:35:41.292 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2020-05-18T21:35:41.293 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2020-05-18T21:35:41.293 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2020-05-18T21:35:41.293 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2020-05-18T21:35:41.293 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklist": { 2020-05-18T21:35:41.293 INFO:teuthology.orchestra.run.smithi063.stdout: "172.21.15.63:6833/1197291437": "2020-05-19T21:34:36.060185+0000", 2020-05-18T21:35:41.294 INFO:teuthology.orchestra.run.smithi063.stdout: "172.21.15.63:6832/1197291437": "2020-05-19T21:34:36.060185+0000" 2020-05-18T21:35:41.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.294 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2020-05-18T21:35:41.294 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2020-05-18T21:35:41.294 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2020-05-18T21:35:41.295 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2020-05-18T21:35:41.295 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2020-05-18T21:35:41.295 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2020-05-18T21:35:41.295 INFO:teuthology.orchestra.run.smithi063.stdout: "ruleset-failure-domain": "osd", 2020-05-18T21:35:41.295 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2020-05-18T21:35:41.295 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:41.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:41.296 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2020-05-18T21:35:41.296 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2020-05-18T21:35:41.296 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2020-05-18T21:35:41.296 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2020-05-18T21:35:41.297 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {} 2020-05-18T21:35:41.297 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:35:41.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.078+0000 7f27a6d91700 1 -- 172.21.15.63:0/880448725 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f278804f9c0 msgr2=0x7f2788051e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:41.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.078+0000 7f27a6d91700 1 --2- 172.21.15.63:0/880448725 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f278804f9c0 0x7f2788051e80 secure :-1 s=READY pgs=676 cs=0 l=1 rx=0x7f27a00b99d0 tx=0x7f278c007a80).stop 2020-05-18T21:35:41.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.078+0000 7f27a6d91700 1 -- 172.21.15.63:0/880448725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27a00b4f60 msgr2=0x7f27a0140dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:41.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.078+0000 7f27a6d91700 1 --2- 172.21.15.63:0/880448725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27a00b4f60 0x7f27a0140dd0 secure :-1 s=READY pgs=1750 cs=0 l=1 rx=0x7f27940030b0 tx=0x7f2794010d80).stop 2020-05-18T21:35:41.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.078+0000 7f27a6d91700 1 -- 172.21.15.63:0/880448725 shutdown_connections 2020-05-18T21:35:41.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.078+0000 7f27a6d91700 1 --2- 172.21.15.63:0/880448725 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f278804f9c0 0x7f2788051e80 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:41.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.078+0000 7f27a6d91700 1 --2- 172.21.15.63:0/880448725 >> v2:172.21.15.155:3300/0 conn(0x7f27a0144810 0x7f27a0147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:41.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.078+0000 7f27a6d91700 1 --2- 172.21.15.63:0/880448725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27a00b4f60 0x7f27a0140dd0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:41.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.078+0000 7f27a6d91700 1 -- 172.21.15.63:0/880448725 >> 172.21.15.63:0/880448725 conn(0x7f27a00ba5c0 msgr2=0x7f27a0062a20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:41.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.078+0000 7f27a6d91700 1 -- 172.21.15.63:0/880448725 shutdown_connections 2020-05-18T21:35:41.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.078+0000 7f27a6d91700 1 -- 172.21.15.63:0/880448725 wait complete. 2020-05-18T21:35:41.301 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:35:41.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce31b3700 1 Processor -- start 2020-05-18T21:35:41.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce31b3700 1 -- start start 2020-05-18T21:35:41.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce31b3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7cdc0bb5e0 0x7f7cdc0acee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:41.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce31b3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7cdc12efd0 0x7f7cdc12f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:41.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce31b3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cdc0af6e0 con 0x7f7cdc0bbcd0 2020-05-18T21:35:41.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce31b3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cdc0af980 con 0x7f7cdc0bb5e0 2020-05-18T21:35:41.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce31b3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cdc0b0530 con 0x7f7cdc12efd0 2020-05-18T21:35:41.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce0f4f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7cdc0bb5e0 0x7f7cdc0acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:41.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce0f4f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7cdc0bb5e0 0x7f7cdc0acee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34222/0 (socket says 172.21.15.63:34222) 2020-05-18T21:35:41.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce0f4f700 1 -- 172.21.15.63:0/620151252 learned_addr learned my addr 172.21.15.63:0/620151252 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:41.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce1750700 1 --2- 172.21.15.63:0/620151252 >> v2:172.21.15.155:3300/0 conn(0x7f7cdc12efd0 0x7f7cdc12f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:41.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce0f4f700 1 -- 172.21.15.63:0/620151252 >> v2:172.21.15.155:3300/0 conn(0x7f7cdc12efd0 msgr2=0x7f7cdc12f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:41.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce0f4f700 1 --2- 172.21.15.63:0/620151252 >> v2:172.21.15.155:3300/0 conn(0x7f7cdc12efd0 0x7f7cdc12f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:41.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce0f4f700 1 -- 172.21.15.63:0/620151252 >> v1:172.21.15.155:6789/0 conn(0x7f7cdc0bbcd0 legacy=0x7f7cdc0afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:41.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce0f4f700 1 -- 172.21.15.63:0/620151252 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cdc0bb9c0 con 0x7f7cdc0bb5e0 2020-05-18T21:35:41.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce1750700 1 --2- 172.21.15.63:0/620151252 >> v2:172.21.15.155:3300/0 conn(0x7f7cdc12efd0 0x7f7cdc12f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:35:41.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce0f4f700 1 --2- 172.21.15.63:0/620151252 >> v2:172.21.15.63:3300/0 conn(0x7f7cdc0bb5e0 0x7f7cdc0acee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7cdc0ae780 tx=0x7f7cd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce0f4f700 1 --2- 172.21.15.63:0/620151252 >> v2:172.21.15.63:3300/0 conn(0x7f7cdc0bb5e0 0x7f7cdc0acee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7cdc0ae780 tx=0x7f7cd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce0f4f700 1 --2- 172.21.15.63:0/620151252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7cdc0bb5e0 0x7f7cdc0acee0 secure :-1 s=READY pgs=1751 cs=0 l=1 rx=0x7f7cdc0ae780 tx=0x7f7cd8007a80).ready entity=mon.0 client_cookie=7c4127eac24492a1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:41.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce0f4f700 1 --2- 172.21.15.63:0/620151252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7cdc0bb5e0 0x7f7cdc0acee0 secure :-1 s=THROTTLE_DONE pgs=1751 cs=0 l=1 rx=0x7f7cdc0ae780 tx=0x7f7cd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7cd37fe700 1 -- 172.21.15.63:0/620151252 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cd8011720 con 0x7f7cdc0bb5e0 2020-05-18T21:35:41.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce0f4f700 1 --2- 172.21.15.63:0/620151252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7cdc0bb5e0 0x7f7cdc0acee0 secure :-1 s=THROTTLE_DONE pgs=1751 cs=0 l=1 rx=0x7f7cdc0ae780 tx=0x7f7cd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7cd37fe700 1 -- 172.21.15.63:0/620151252 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd8011880 con 0x7f7cdc0bb5e0 2020-05-18T21:35:41.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce0f4f700 1 --2- 172.21.15.63:0/620151252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7cdc0bb5e0 0x7f7cdc0acee0 secure :-1 s=THROTTLE_DONE pgs=1751 cs=0 l=1 rx=0x7f7cdc0ae780 tx=0x7f7cd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7cd37fe700 1 -- 172.21.15.63:0/620151252 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cd8011c60 con 0x7f7cdc0bb5e0 2020-05-18T21:35:41.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce31b3700 1 -- 172.21.15.63:0/620151252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7cdc0bb5e0 msgr2=0x7f7cdc0acee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:41.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce31b3700 1 --2- 172.21.15.63:0/620151252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7cdc0bb5e0 0x7f7cdc0acee0 secure :-1 s=READY pgs=1751 cs=0 l=1 rx=0x7f7cdc0ae780 tx=0x7f7cd8007a80).stop 2020-05-18T21:35:41.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce31b3700 1 -- 172.21.15.63:0/620151252 shutdown_connections 2020-05-18T21:35:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce31b3700 1 --2- 172.21.15.63:0/620151252 >> v2:172.21.15.155:3300/0 conn(0x7f7cdc12efd0 0x7f7cdc12f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce31b3700 1 --2- 172.21.15.63:0/620151252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7cdc0bb5e0 0x7f7cdc0acee0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce31b3700 1 -- 172.21.15.63:0/620151252 >> 172.21.15.63:0/620151252 conn(0x7f7cdc069b70 msgr2=0x7f7cdc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce31b3700 1 -- 172.21.15.63:0/620151252 shutdown_connections 2020-05-18T21:35:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.410+0000 7f7ce31b3700 1 -- 172.21.15.63:0/620151252 wait complete. 2020-05-18T21:35:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.414+0000 7f7ce31b3700 1 Processor -- start 2020-05-18T21:35:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.414+0000 7f7ce31b3700 1 -- start start 2020-05-18T21:35:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.414+0000 7f7ce31b3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7cdc12efd0 0x7f7cdc0b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.414+0000 7f7ce31b3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cdc0b7840 con 0x7f7cdc0bbcd0 2020-05-18T21:35:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.414+0000 7f7ce31b3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cdc0b7ae0 con 0x7f7cdc0bb5e0 2020-05-18T21:35:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.414+0000 7f7ce31b3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cdc0b7d80 con 0x7f7cdc12efd0 2020-05-18T21:35:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7cd3fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7cdc0bbcd0 0x7f7cdc0b8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36418/0 (socket says 172.21.15.63:36418) 2020-05-18T21:35:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7cd3fff700 1 -- 172.21.15.63:0/3815359788 learned_addr learned my addr 172.21.15.63:0/3815359788 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7ce1750700 1 --2- 172.21.15.63:0/3815359788 >> v2:172.21.15.155:3300/0 conn(0x7f7cdc12efd0 0x7f7cdc0b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7cd1ffb700 1 -- 172.21.15.63:0/3815359788 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102549025 0 0) 0x7f7cdc0b7840 con 0x7f7cdc0bbcd0 2020-05-18T21:35:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7cd1ffb700 1 -- 172.21.15.63:0/3815359788 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cbc002fe0 con 0x7f7cdc0bbcd0 2020-05-18T21:35:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7cd1ffb700 1 -- 172.21.15.63:0/3815359788 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653492023 0 0) 0x7f7cdc0b7ae0 con 0x7f7cdc0bb5e0 2020-05-18T21:35:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7cd1ffb700 1 -- 172.21.15.63:0/3815359788 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cdc0b7840 con 0x7f7cdc0bb5e0 2020-05-18T21:35:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7ce1750700 1 -- 172.21.15.63:0/3815359788 >> v1:172.21.15.155:6789/0 conn(0x7f7cdc0bb5e0 legacy=0x7f7cdc0b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7ce1750700 1 -- 172.21.15.63:0/3815359788 >> v1:172.21.15.63:6789/0 conn(0x7f7cdc0bbcd0 legacy=0x7f7cdc0b8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7ce1750700 1 -- 172.21.15.63:0/3815359788 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cdc0b4a80 con 0x7f7cdc12efd0 2020-05-18T21:35:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7ce1750700 1 --2- 172.21.15.63:0/3815359788 >> v2:172.21.15.155:3300/0 conn(0x7f7cdc12efd0 0x7f7cdc0b72c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7cd40032f0 tx=0x7f7cd4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7ce1750700 1 --2- 172.21.15.63:0/3815359788 >> v2:172.21.15.155:3300/0 conn(0x7f7cdc12efd0 0x7f7cdc0b72c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7cd40032f0 tx=0x7f7cd4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7ce1750700 1 --2- 172.21.15.63:0/3815359788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cdc12efd0 0x7f7cdc0b72c0 secure :-1 s=READY pgs=1149 cs=0 l=1 rx=0x7f7cd40032f0 tx=0x7f7cd4010d20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7ce1750700 1 --2- 172.21.15.63:0/3815359788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cdc12efd0 0x7f7cdc0b72c0 secure :-1 s=THROTTLE_DONE pgs=1149 cs=0 l=1 rx=0x7f7cd40032f0 tx=0x7f7cd4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7cd1ffb700 1 -- 172.21.15.63:0/3815359788 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cd4012b30 con 0x7f7cdc12efd0 2020-05-18T21:35:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7ce31b3700 1 -- 172.21.15.63:0/3815359788 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cdc0b8930 con 0x7f7cdc12efd0 2020-05-18T21:35:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7ce1750700 1 --2- 172.21.15.63:0/3815359788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cdc12efd0 0x7f7cdc0b72c0 secure :-1 s=THROTTLE_DONE pgs=1149 cs=0 l=1 rx=0x7f7cd40032f0 tx=0x7f7cd4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7cd1ffb700 1 -- 172.21.15.63:0/3815359788 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd4012c90 con 0x7f7cdc12efd0 2020-05-18T21:35:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7ce1750700 1 --2- 172.21.15.63:0/3815359788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cdc12efd0 0x7f7cdc0b72c0 secure :-1 s=THROTTLE_DONE pgs=1149 cs=0 l=1 rx=0x7f7cd40032f0 tx=0x7f7cd4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7cd1ffb700 1 -- 172.21.15.63:0/3815359788 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cd4012e00 con 0x7f7cdc12efd0 2020-05-18T21:35:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7ce31b3700 1 -- 172.21.15.63:0/3815359788 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cdc12e7b0 con 0x7f7cdc12efd0 2020-05-18T21:35:41.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7ce1750700 1 --2- 172.21.15.63:0/3815359788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cdc12efd0 0x7f7cdc0b72c0 secure :-1 s=THROTTLE_DONE pgs=1149 cs=0 l=1 rx=0x7f7cd40032f0 tx=0x7f7cd4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.418+0000 7f7ce31b3700 1 -- 172.21.15.63:0/3815359788 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cdc0b7f50 con 0x7f7cdc12efd0 2020-05-18T21:35:41.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.422+0000 7f7cd1ffb700 1 -- 172.21.15.63:0/3815359788 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7cd4005a80 con 0x7f7cdc12efd0 2020-05-18T21:35:41.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.422+0000 7f7ce1750700 1 --2- 172.21.15.63:0/3815359788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cdc12efd0 0x7f7cdc0b72c0 secure :-1 s=THROTTLE_DONE pgs=1149 cs=0 l=1 rx=0x7f7cd40032f0 tx=0x7f7cd4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.422+0000 7f7cd1ffb700 1 --2- 172.21.15.63:0/3815359788 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7cbc04fe60 0x7f7cbc052320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:41.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.422+0000 7f7cd1ffb700 1 -- 172.21.15.63:0/3815359788 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f7cd4063e70 con 0x7f7cdc12efd0 2020-05-18T21:35:41.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.422+0000 7f7ce0f4f700 1 --2- 172.21.15.63:0/3815359788 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7cbc04fe60 0x7f7cbc052320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:41.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.422+0000 7f7ce0f4f700 1 --2- 172.21.15.63:0/3815359788 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7cbc04fe60 0x7f7cbc052320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7cd8008500 tx=0x7f7cd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.422+0000 7f7ce0f4f700 1 --2- 172.21.15.63:0/3815359788 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7cbc04fe60 0x7f7cbc052320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7cd8008500 tx=0x7f7cd8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.422+0000 7f7ce0f4f700 1 --2- 172.21.15.63:0/3815359788 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7cbc04fe60 0x7f7cbc052320 secure :-1 s=READY pgs=677 cs=0 l=1 rx=0x7f7cd8008500 tx=0x7f7cd8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:41.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.430+0000 7f7ce1750700 1 --2- 172.21.15.63:0/3815359788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cdc12efd0 0x7f7cdc0b72c0 secure :-1 s=THROTTLE_DONE pgs=1149 cs=0 l=1 rx=0x7f7cd40032f0 tx=0x7f7cd4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.430+0000 7f7cd1ffb700 1 -- 172.21.15.63:0/3815359788 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f7cd403e1a0 con 0x7f7cdc12efd0 2020-05-18T21:35:41.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.594+0000 7f7ce31b3700 1 -- 172.21.15.63:0/3815359788 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7cdc131ab0 con 0x7f7cdc12efd0 2020-05-18T21:35:41.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.594+0000 7f7ce1750700 1 --2- 172.21.15.63:0/3815359788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cdc12efd0 0x7f7cdc0b72c0 secure :-1 s=THROTTLE_DONE pgs=1149 cs=0 l=1 rx=0x7f7cd40032f0 tx=0x7f7cd4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.594+0000 7f7cd1ffb700 1 -- 172.21.15.63:0/3815359788 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f7cd4041e60 con 0x7f7cdc12efd0 2020-05-18T21:35:41.600 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:41.600 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":98,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/3483934102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3483934102},{"type":"v1","addr":"172.21.15.155:6835","nonce":3483934102}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":98}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:34:27.767123+0000","modified":"2020-05-18T21:34:41.281280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"a","rank":0,"incarnation":94,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6833/1314928434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1314928434},{"type":"v1","addr":"172.21.15.63:6833","nonce":1314928434}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-05-18T21:35:41.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.598+0000 7f7ce31b3700 1 -- 172.21.15.63:0/3815359788 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7cbc04fe60 msgr2=0x7f7cbc052320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:41.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.598+0000 7f7ce31b3700 1 --2- 172.21.15.63:0/3815359788 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7cbc04fe60 0x7f7cbc052320 secure :-1 s=READY pgs=677 cs=0 l=1 rx=0x7f7cd8008500 tx=0x7f7cd8007a80).stop 2020-05-18T21:35:41.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.598+0000 7f7ce31b3700 1 -- 172.21.15.63:0/3815359788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cdc12efd0 msgr2=0x7f7cdc0b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:41.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.598+0000 7f7ce31b3700 1 --2- 172.21.15.63:0/3815359788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cdc12efd0 0x7f7cdc0b72c0 secure :-1 s=READY pgs=1149 cs=0 l=1 rx=0x7f7cd40032f0 tx=0x7f7cd4010d20).stop 2020-05-18T21:35:41.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.598+0000 7f7ce31b3700 1 -- 172.21.15.63:0/3815359788 shutdown_connections 2020-05-18T21:35:41.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.598+0000 7f7ce31b3700 1 --2- 172.21.15.63:0/3815359788 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7cbc04fe60 0x7f7cbc052320 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:41.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.598+0000 7f7ce31b3700 1 --2- 172.21.15.63:0/3815359788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cdc12efd0 0x7f7cdc0b72c0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:41.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.598+0000 7f7ce31b3700 1 -- 172.21.15.63:0/3815359788 >> 172.21.15.63:0/3815359788 conn(0x7f7cdc069b70 msgr2=0x7f7cdc060590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:41.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.598+0000 7f7ce31b3700 1 -- 172.21.15.63:0/3815359788 shutdown_connections 2020-05-18T21:35:41.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.598+0000 7f7ce31b3700 1 -- 172.21.15.63:0/3815359788 wait complete. 2020-05-18T21:35:41.605 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 98 2020-05-18T21:35:41.618 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-05-18T21:35:41.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc576697700 1 Processor -- start 2020-05-18T21:35:41.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc576697700 1 -- start start 2020-05-18T21:35:41.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc576697700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc57006a280 0x7fc5700b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:41.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc576697700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5700b2d90 0x7fc5700b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:41.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc576697700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc570065d10 con 0x7fc57013f6f0 2020-05-18T21:35:41.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc576697700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc570142fb0 con 0x7fc57006a280 2020-05-18T21:35:41.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc576697700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc570065f40 con 0x7fc5700b2d90 2020-05-18T21:35:41.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc574e94700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc57006a280 0x7fc5700b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:41.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc574e94700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc57006a280 0x7fc5700b2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34238/0 (socket says 172.21.15.63:34238) 2020-05-18T21:35:41.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc574e94700 1 -- 172.21.15.63:0/3310522607 learned_addr learned my addr 172.21.15.63:0/3310522607 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:41.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc575695700 1 --1- 172.21.15.63:0/3310522607 >> v1:172.21.15.63:6789/0 conn(0x7fc57013f6f0 0x7fc570069b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36424/0 (socket says 172.21.15.63:36424) 2020-05-18T21:35:41.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc575e96700 1 --2- 172.21.15.63:0/3310522607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5700b2d90 0x7fc5700b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:41.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc574e94700 1 -- 172.21.15.63:0/3310522607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5700b2d90 msgr2=0x7fc5700b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:41.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc574e94700 1 --2- 172.21.15.63:0/3310522607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5700b2d90 0x7fc5700b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:41.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc574e94700 1 -- 172.21.15.63:0/3310522607 >> v1:172.21.15.63:6789/0 conn(0x7fc57013f6f0 legacy=0x7fc570069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:41.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc55bfff700 1 -- 172.21.15.63:0/3310522607 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153490886 0 0) 0x7fc570065d10 con 0x7fc57013f6f0 2020-05-18T21:35:41.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc574e94700 1 -- 172.21.15.63:0/3310522607 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57013fad0 con 0x7fc57006a280 2020-05-18T21:35:41.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc574e94700 1 --2- 172.21.15.63:0/3310522607 >> v2:172.21.15.63:3300/0 conn(0x7fc57006a280 0x7fc5700b2930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc56c002f70 tx=0x7fc56c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc574e94700 1 --2- 172.21.15.63:0/3310522607 >> v2:172.21.15.63:3300/0 conn(0x7fc57006a280 0x7fc5700b2930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc56c002f70 tx=0x7fc56c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.722+0000 7fc574e94700 1 --2- 172.21.15.63:0/3310522607 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc57006a280 0x7fc5700b2930 secure :-1 s=READY pgs=1754 cs=0 l=1 rx=0x7fc56c002f70 tx=0x7fc56c007a80).ready entity=mon.0 client_cookie=dd2b897835f1d9b0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:41.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.726+0000 7fc574e94700 1 --2- 172.21.15.63:0/3310522607 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc57006a280 0x7fc5700b2930 secure :-1 s=THROTTLE_DONE pgs=1754 cs=0 l=1 rx=0x7fc56c002f70 tx=0x7fc56c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.726+0000 7fc574e94700 1 --2- 172.21.15.63:0/3310522607 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc57006a280 0x7fc5700b2930 secure :-1 s=THROTTLE_DONE pgs=1754 cs=0 l=1 rx=0x7fc56c002f70 tx=0x7fc56c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.726+0000 7fc55bfff700 1 -- 172.21.15.63:0/3310522607 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc56c0116b0 con 0x7fc57006a280 2020-05-18T21:35:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.726+0000 7fc574e94700 1 --2- 172.21.15.63:0/3310522607 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc57006a280 0x7fc5700b2930 secure :-1 s=THROTTLE_DONE pgs=1754 cs=0 l=1 rx=0x7fc56c002f70 tx=0x7fc56c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.726+0000 7fc55bfff700 1 -- 172.21.15.63:0/3310522607 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c011810 con 0x7fc57006a280 2020-05-18T21:35:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.726+0000 7fc55bfff700 1 -- 172.21.15.63:0/3310522607 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc56c011bf0 con 0x7fc57006a280 2020-05-18T21:35:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.726+0000 7fc576697700 1 -- 172.21.15.63:0/3310522607 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc57006a280 msgr2=0x7fc5700b2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.726+0000 7fc576697700 1 --2- 172.21.15.63:0/3310522607 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc57006a280 0x7fc5700b2930 secure :-1 s=READY pgs=1754 cs=0 l=1 rx=0x7fc56c002f70 tx=0x7fc56c007a80).stop 2020-05-18T21:35:41.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.726+0000 7fc576697700 1 -- 172.21.15.63:0/3310522607 shutdown_connections 2020-05-18T21:35:41.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.726+0000 7fc576697700 1 --2- 172.21.15.63:0/3310522607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5700b2d90 0x7fc5700b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:41.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.726+0000 7fc576697700 1 --2- 172.21.15.63:0/3310522607 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc57006a280 0x7fc5700b2930 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:41.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.726+0000 7fc576697700 1 -- 172.21.15.63:0/3310522607 >> 172.21.15.63:0/3310522607 conn(0x7fc57005fb50 msgr2=0x7fc5700b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:41.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.726+0000 7fc576697700 1 -- 172.21.15.63:0/3310522607 shutdown_connections 2020-05-18T21:35:41.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.726+0000 7fc576697700 1 -- 172.21.15.63:0/3310522607 wait complete. 2020-05-18T21:35:41.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.726+0000 7fc576697700 1 Processor -- start 2020-05-18T21:35:41.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.726+0000 7fc576697700 1 -- start start 2020-05-18T21:35:41.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc576697700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc5700b2d90 0x7fc570060ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:41.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc576697700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5700b1950 con 0x7fc57006a280 2020-05-18T21:35:41.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc576697700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5700b1bf0 con 0x7fc57013f6f0 2020-05-18T21:35:41.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc576697700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57013e9c0 con 0x7fc5700b2d90 2020-05-18T21:35:41.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc575695700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc57006a280 0x7fc570062370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36430/0 (socket says 172.21.15.63:36430) 2020-05-18T21:35:41.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc575695700 1 -- 172.21.15.63:0/2161423422 learned_addr learned my addr 172.21.15.63:0/2161423422 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:41.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc574e94700 1 --2- 172.21.15.63:0/2161423422 >> v2:172.21.15.155:3300/0 conn(0x7fc5700b2d90 0x7fc570060ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:41.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc562ffd700 1 -- 172.21.15.63:0/2161423422 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299103504 0 0) 0x7fc5700b1950 con 0x7fc57006a280 2020-05-18T21:35:41.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc562ffd700 1 -- 172.21.15.63:0/2161423422 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc54c002fe0 con 0x7fc57006a280 2020-05-18T21:35:41.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc562ffd700 1 -- 172.21.15.63:0/2161423422 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3606086148 0 0) 0x7fc54c002fe0 con 0x7fc57006a280 2020-05-18T21:35:41.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc562ffd700 1 -- 172.21.15.63:0/2161423422 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc5700b1950 con 0x7fc57006a280 2020-05-18T21:35:41.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc562ffd700 1 -- 172.21.15.63:0/2161423422 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fc564001a20 con 0x7fc57006a280 2020-05-18T21:35:41.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc562ffd700 1 -- 172.21.15.63:0/2161423422 >> v2:172.21.15.155:3300/0 conn(0x7fc5700b2d90 msgr2=0x7fc570060ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:41.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc562ffd700 1 --2- 172.21.15.63:0/2161423422 >> v2:172.21.15.155:3300/0 conn(0x7fc5700b2d90 0x7fc570060ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:41.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc562ffd700 1 -- 172.21.15.63:0/2161423422 >> v1:172.21.15.155:6789/0 conn(0x7fc57013f6f0 legacy=0x7fc570062a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:41.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc562ffd700 1 -- 172.21.15.63:0/2161423422 >> v1:172.21.15.63:6789/0 conn(0x7fc57006a280 legacy=0x7fc570062370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:41.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc562ffd700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54c004a80 0x7fc54c004e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:41.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc562ffd700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c0039a0 0x7fc54c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:41.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc562ffd700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc54c004280 0x7fc54c00b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc562ffd700 1 -- 172.21.15.63:0/2161423422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57013e9c0 con 0x7fc54c0039a0 2020-05-18T21:35:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc562ffd700 1 -- 172.21.15.63:0/2161423422 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c004760 con 0x7fc54c004a80 2020-05-18T21:35:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc562ffd700 1 -- 172.21.15.63:0/2161423422 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c00bbc0 con 0x7fc54c004280 2020-05-18T21:35:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc574e94700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c0039a0 0x7fc54c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc575695700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54c004a80 0x7fc54c004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:41.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc575e96700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc54c004280 0x7fc54c00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:41.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc574e94700 1 -- 172.21.15.63:0/2161423422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc54c004280 msgr2=0x7fc54c00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:41.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc574e94700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc54c004280 0x7fc54c00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:41.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc574e94700 1 -- 172.21.15.63:0/2161423422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54c004a80 msgr2=0x7fc54c004e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:41.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc574e94700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54c004a80 0x7fc54c004e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:41.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc574e94700 1 -- 172.21.15.63:0/2161423422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57013ec60 con 0x7fc54c0039a0 2020-05-18T21:35:41.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc576697700 1 -- 172.21.15.63:0/2161423422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5700b08b0 con 0x7fc54c0039a0 2020-05-18T21:35:41.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc574e94700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c0039a0 0x7fc54c003e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc54c004970 tx=0x7fc56c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc575e96700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc54c004280 0x7fc54c00b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:35:41.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc575e96700 1 -- 172.21.15.63:0/2161423422 reap_dead start 2020-05-18T21:35:41.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc576697700 1 -- 172.21.15.63:0/2161423422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5700b2230 con 0x7fc54c0039a0 2020-05-18T21:35:41.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc574e94700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c0039a0 0x7fc54c003e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc54c004970 tx=0x7fc56c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc574e94700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c0039a0 0x7fc54c003e20 secure :-1 s=READY pgs=1756 cs=0 l=1 rx=0x7fc54c004970 tx=0x7fc56c007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:41.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc574e94700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c0039a0 0x7fc54c003e20 secure :-1 s=THROTTLE_DONE pgs=1756 cs=0 l=1 rx=0x7fc54c004970 tx=0x7fc56c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc562ffd700 1 -- 172.21.15.63:0/2161423422 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc56c007360 con 0x7fc54c0039a0 2020-05-18T21:35:41.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc574e94700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c0039a0 0x7fc54c003e20 secure :-1 s=THROTTLE_DONE pgs=1756 cs=0 l=1 rx=0x7fc54c004970 tx=0x7fc56c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc574e94700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c0039a0 0x7fc54c003e20 secure :-1 s=THROTTLE_DONE pgs=1756 cs=0 l=1 rx=0x7fc54c004970 tx=0x7fc56c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc562ffd700 1 -- 172.21.15.63:0/2161423422 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c0074c0 con 0x7fc54c0039a0 2020-05-18T21:35:41.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.730+0000 7fc562ffd700 1 -- 172.21.15.63:0/2161423422 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc56c0058f0 con 0x7fc54c0039a0 2020-05-18T21:35:41.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.734+0000 7fc574e94700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c0039a0 0x7fc54c003e20 secure :-1 s=THROTTLE_DONE pgs=1756 cs=0 l=1 rx=0x7fc54c004970 tx=0x7fc56c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.734+0000 7fc576697700 1 -- 172.21.15.63:0/2161423422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc550003380 con 0x7fc54c0039a0 2020-05-18T21:35:41.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.734+0000 7fc562ffd700 1 -- 172.21.15.63:0/2161423422 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc56c005a50 con 0x7fc54c0039a0 2020-05-18T21:35:41.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.734+0000 7fc574e94700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c0039a0 0x7fc54c003e20 secure :-1 s=THROTTLE_DONE pgs=1756 cs=0 l=1 rx=0x7fc54c004970 tx=0x7fc56c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.734+0000 7fc562ffd700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54c0538e0 0x7fc54c055da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:41.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.734+0000 7fc562ffd700 1 -- 172.21.15.63:0/2161423422 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc56c064480 con 0x7fc54c0039a0 2020-05-18T21:35:41.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.734+0000 7fc575695700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54c0538e0 0x7fc54c055da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:41.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.734+0000 7fc575695700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54c0538e0 0x7fc54c055da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc564001230 tx=0x7fc57005e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.734+0000 7fc575695700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54c0538e0 0x7fc54c055da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc564001230 tx=0x7fc57005e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.734+0000 7fc575695700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54c0538e0 0x7fc54c055da0 secure :-1 s=READY pgs=678 cs=0 l=1 rx=0x7fc564001230 tx=0x7fc57005e150).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:41.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.738+0000 7fc574e94700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c0039a0 0x7fc54c003e20 secure :-1 s=THROTTLE_DONE pgs=1756 cs=0 l=1 rx=0x7fc54c004970 tx=0x7fc56c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:41.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.738+0000 7fc562ffd700 1 -- 172.21.15.63:0/2161423422 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc56c03e930 con 0x7fc54c0039a0 2020-05-18T21:35:41.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:41.890+0000 7fc576697700 1 -- 172.21.15.63:0/2161423422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc550002210 con 0x7fc54c0039a0 2020-05-18T21:35:42.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.730+0000 7fc574e94700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c0039a0 0x7fc54c003e20 secure :-1 s=READY pgs=1756 cs=0 l=1 rx=0x7fc54c004970 tx=0x7fc56c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:42.771 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:35:42.766+0000 7fdb4592c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:35:42.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.774+0000 7fc574e94700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c0039a0 0x7fc54c003e20 secure :-1 s=THROTTLE_DONE pgs=1756 cs=0 l=1 rx=0x7fc54c004970 tx=0x7fc56c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:42.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.774+0000 7fc562ffd700 1 -- 172.21.15.63:0/2161423422 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v99) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc56c041f50 con 0x7fc54c0039a0 2020-05-18T21:35:42.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.778+0000 7fc576697700 1 -- 172.21.15.63:0/2161423422 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54c0538e0 msgr2=0x7fc54c055da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:42.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.778+0000 7fc576697700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54c0538e0 0x7fc54c055da0 secure :-1 s=READY pgs=678 cs=0 l=1 rx=0x7fc564001230 tx=0x7fc57005e150).stop 2020-05-18T21:35:42.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.778+0000 7fc576697700 1 -- 172.21.15.63:0/2161423422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c0039a0 msgr2=0x7fc54c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:42.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.778+0000 7fc576697700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c0039a0 0x7fc54c003e20 secure :-1 s=READY pgs=1756 cs=0 l=1 rx=0x7fc54c004970 tx=0x7fc56c007a80).stop 2020-05-18T21:35:42.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.778+0000 7fc576697700 1 -- 172.21.15.63:0/2161423422 shutdown_connections 2020-05-18T21:35:42.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.778+0000 7fc576697700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc54c0538e0 0x7fc54c055da0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:42.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.778+0000 7fc576697700 1 --2- 172.21.15.63:0/2161423422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c0039a0 0x7fc54c003e20 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:42.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.778+0000 7fc576697700 1 -- 172.21.15.63:0/2161423422 >> 172.21.15.63:0/2161423422 conn(0x7fc57005fb50 msgr2=0x7fc5700b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:42.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.778+0000 7fc576697700 1 -- 172.21.15.63:0/2161423422 shutdown_connections 2020-05-18T21:35:42.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.778+0000 7fc576697700 1 -- 172.21.15.63:0/2161423422 wait complete. 2020-05-18T21:35:42.786 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-05-18T21:35:42.796 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:35:42.817 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:35:42.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.902+0000 7f7cbc8b8700 1 Processor -- start 2020-05-18T21:35:42.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.902+0000 7f7cbc8b8700 1 -- start start 2020-05-18T21:35:42.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cbc8b8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7cb805f110 0x7f7cb80b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:42.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cbc8b8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cb8064fd0 0x7f7cb814d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:42.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cbc8b8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb814a330 con 0x7f7cb814aa70 2020-05-18T21:35:42.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cbc8b8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb814a140 con 0x7f7cb805f110 2020-05-18T21:35:42.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cbc8b8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8065460 con 0x7f7cb8064fd0 2020-05-18T21:35:42.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7caffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7cb814aa70 0x7f7cb80648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36466/0 (socket says 172.21.15.63:36466) 2020-05-18T21:35:42.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7caffff700 1 -- 172.21.15.63:0/593973330 learned_addr learned my addr 172.21.15.63:0/593973330 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:42.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/593973330 >> v2:172.21.15.155:3300/0 conn(0x7f7cb805f110 0x7f7cb80b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:42.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cb7fff700 1 --2- 172.21.15.63:0/593973330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cb8064fd0 0x7f7cb814d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:42.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cb6ffd700 1 -- 172.21.15.63:0/593973330 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627474943 0 0) 0x7f7cb814a330 con 0x7f7cb814aa70 2020-05-18T21:35:42.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cb6ffd700 1 -- 172.21.15.63:0/593973330 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c98003270 con 0x7f7cb814aa70 2020-05-18T21:35:42.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cb77fe700 1 -- 172.21.15.63:0/593973330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cb8064fd0 msgr2=0x7f7cb814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:42.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/593973330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cb8064fd0 0x7f7cb814d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:42.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cb77fe700 1 -- 172.21.15.63:0/593973330 >> v1:172.21.15.63:6789/0 conn(0x7f7cb814aa70 legacy=0x7f7cb80648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:42.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cb6ffd700 1 -- 172.21.15.63:0/593973330 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2810031403 0 0) 0x7f7c98003270 con 0x7f7cb814aa70 2020-05-18T21:35:42.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cb77fe700 1 -- 172.21.15.63:0/593973330 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb814a5d0 con 0x7f7cb805f110 2020-05-18T21:35:42.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cb7fff700 1 --2- 172.21.15.63:0/593973330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cb8064fd0 0x7f7cb814d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:35:42.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/593973330 >> v2:172.21.15.155:3300/0 conn(0x7f7cb805f110 0x7f7cb80b4760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7ca00018b0 tx=0x7f7ca8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:42.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/593973330 >> v2:172.21.15.155:3300/0 conn(0x7f7cb805f110 0x7f7cb80b4760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7ca00018b0 tx=0x7f7ca8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:42.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/593973330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cb805f110 0x7f7cb80b4760 secure :-1 s=READY pgs=1152 cs=0 l=1 rx=0x7f7ca00018b0 tx=0x7f7ca8008920).ready entity=mon.1 client_cookie=30905a72e803b35b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:42.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/593973330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cb805f110 0x7f7cb80b4760 secure :-1 s=THROTTLE_DONE pgs=1152 cs=0 l=1 rx=0x7f7ca00018b0 tx=0x7f7ca8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:42.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/593973330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cb805f110 0x7f7cb80b4760 secure :-1 s=THROTTLE_DONE pgs=1152 cs=0 l=1 rx=0x7f7ca00018b0 tx=0x7f7ca8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:42.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cb6ffd700 1 -- 172.21.15.63:0/593973330 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ca0001710 con 0x7f7cb805f110 2020-05-18T21:35:42.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/593973330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cb805f110 0x7f7cb80b4760 secure :-1 s=THROTTLE_DONE pgs=1152 cs=0 l=1 rx=0x7f7ca00018b0 tx=0x7f7ca8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:42.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cb6ffd700 1 -- 172.21.15.63:0/593973330 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca8008e80 con 0x7f7cb805f110 2020-05-18T21:35:42.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cb6ffd700 1 -- 172.21.15.63:0/593973330 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ca8011440 con 0x7f7cb805f110 2020-05-18T21:35:42.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cbc8b8700 1 -- 172.21.15.63:0/593973330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cb805f110 msgr2=0x7f7cb80b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:42.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cbc8b8700 1 --2- 172.21.15.63:0/593973330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cb805f110 0x7f7cb80b4760 secure :-1 s=READY pgs=1152 cs=0 l=1 rx=0x7f7ca00018b0 tx=0x7f7ca8008920).stop 2020-05-18T21:35:42.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cbc8b8700 1 -- 172.21.15.63:0/593973330 shutdown_connections 2020-05-18T21:35:42.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cbc8b8700 1 --2- 172.21.15.63:0/593973330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cb8064fd0 0x7f7cb814d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:42.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cbc8b8700 1 --2- 172.21.15.63:0/593973330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cb805f110 0x7f7cb80b4760 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:42.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cbc8b8700 1 -- 172.21.15.63:0/593973330 >> 172.21.15.63:0/593973330 conn(0x7f7cb8069fc0 msgr2=0x7f7cb806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:42.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cbc8b8700 1 -- 172.21.15.63:0/593973330 shutdown_connections 2020-05-18T21:35:42.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.906+0000 7f7cbc8b8700 1 -- 172.21.15.63:0/593973330 wait complete. 2020-05-18T21:35:42.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cbc8b8700 1 Processor -- start 2020-05-18T21:35:42.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cbc8b8700 1 -- start start 2020-05-18T21:35:42.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cbc8b8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cb8064fd0 0x7f7cb80ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:42.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cbc8b8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb8148050 con 0x7f7cb805f110 2020-05-18T21:35:42.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cbc8b8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb8148280 con 0x7f7cb814aa70 2020-05-18T21:35:42.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cbc8b8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8148520 con 0x7f7cb8064fd0 2020-05-18T21:35:42.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb77fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7cb805f110 0x7f7cb81578b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36468/0 (socket says 172.21.15.63:36468) 2020-05-18T21:35:42.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb77fe700 1 -- 172.21.15.63:0/3413336998 learned_addr learned my addr 172.21.15.63:0/3413336998 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:42.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7caffff700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cb8064fd0 0x7f7cb80ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:42.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3935324254 0 0) 0x7f7cb8148050 con 0x7f7cb805f110 2020-05-18T21:35:42.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c9c002fe0 con 0x7f7cb805f110 2020-05-18T21:35:42.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1645146190 0 0) 0x7f7cb8148280 con 0x7f7cb814aa70 2020-05-18T21:35:42.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cb8148050 con 0x7f7cb814aa70 2020-05-18T21:35:42.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 856926534 0 0) 0x7f7c9c002fe0 con 0x7f7cb805f110 2020-05-18T21:35:42.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7cb8148280 con 0x7f7cb805f110 2020-05-18T21:35:42.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f7ca8008620 con 0x7f7cb805f110 2020-05-18T21:35:42.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cb8064fd0 msgr2=0x7f7cb80ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:42.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cb8064fd0 0x7f7cb80ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:42.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 >> v1:172.21.15.155:6789/0 conn(0x7f7cb814aa70 legacy=0x7f7cb81431b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:42.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 >> v1:172.21.15.63:6789/0 conn(0x7f7cb805f110 legacy=0x7f7cb81578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:42.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c004bf0 0x7f7c9c004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:42.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c9c003b30 0x7f7c9c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:42.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c9c0043d0 0x7f7c9c00b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:42.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8148520 con 0x7f7c9c004bf0 2020-05-18T21:35:42.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c00bbc0 con 0x7f7c9c0043d0 2020-05-18T21:35:42.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c00bd00 con 0x7f7c9c003b30 2020-05-18T21:35:42.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c004bf0 0x7f7c9c004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:42.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb7fff700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c9c0043d0 0x7f7c9c00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:42.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7caffff700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c9c003b30 0x7f7c9c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:42.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb77fe700 1 -- 172.21.15.63:0/3413336998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c9c003b30 msgr2=0x7f7c9c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:42.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c9c003b30 0x7f7c9c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:42.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb77fe700 1 -- 172.21.15.63:0/3413336998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c9c0043d0 msgr2=0x7f7c9c00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:42.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c9c0043d0 0x7f7c9c00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:42.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb77fe700 1 -- 172.21.15.63:0/3413336998 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb8147a50 con 0x7f7c9c004bf0 2020-05-18T21:35:42.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cbc8b8700 1 -- 172.21.15.63:0/3413336998 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb80ae950 con 0x7f7c9c004bf0 2020-05-18T21:35:42.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c004bf0 0x7f7c9c004ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7ca8003070 tx=0x7f7cb80640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:42.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cbc8b8700 1 -- 172.21.15.63:0/3413336998 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb80ada00 con 0x7f7c9c004bf0 2020-05-18T21:35:42.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c004bf0 0x7f7c9c004ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7ca8003070 tx=0x7f7cb80640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:42.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c004bf0 0x7f7c9c004ff0 secure :-1 s=READY pgs=1762 cs=0 l=1 rx=0x7f7ca8003070 tx=0x7f7cb80640f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:42.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c004bf0 0x7f7c9c004ff0 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7f7ca8003070 tx=0x7f7cb80640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:42.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ca8007920 con 0x7f7c9c004bf0 2020-05-18T21:35:42.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c004bf0 0x7f7c9c004ff0 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7f7ca8003070 tx=0x7f7cb80640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:42.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c004bf0 0x7f7c9c004ff0 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7f7ca8003070 tx=0x7f7cb80640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:42.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca8007550 con 0x7f7c9c004bf0 2020-05-18T21:35:42.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.910+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ca80058f0 con 0x7f7c9c004bf0 2020-05-18T21:35:42.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.914+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c004bf0 0x7f7c9c004ff0 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7f7ca8003070 tx=0x7f7cb80640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:42.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.914+0000 7f7cbc8b8700 1 -- 172.21.15.63:0/3413336998 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c90003380 con 0x7f7c9c004bf0 2020-05-18T21:35:42.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.914+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7ca8005a50 con 0x7f7c9c004bf0 2020-05-18T21:35:42.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.914+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c004bf0 0x7f7c9c004ff0 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7f7ca8003070 tx=0x7f7cb80640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:42.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.914+0000 7f7cb57fa700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c9c0583c0 0x7f7c9c05a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:42.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.914+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f7ca8064a90 con 0x7f7c9c004bf0 2020-05-18T21:35:42.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.914+0000 7f7caffff700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c9c0583c0 0x7f7c9c05a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:42.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.914+0000 7f7caffff700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c9c0583c0 0x7f7c9c05a880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7ca0001970 tx=0x7f7ca00014c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:42.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.914+0000 7f7caffff700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c9c0583c0 0x7f7c9c05a880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7ca0001970 tx=0x7f7ca00014c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:42.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.914+0000 7f7caffff700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c9c0583c0 0x7f7c9c05a880 secure :-1 s=READY pgs=679 cs=0 l=1 rx=0x7f7ca0001970 tx=0x7f7ca00014c0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:42.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.922+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c004bf0 0x7f7c9c004ff0 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7f7ca8003070 tx=0x7f7cb80640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:42.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:42.922+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f7ca803ee80 con 0x7f7c9c004bf0 2020-05-18T21:35:43.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.074+0000 7f7cbc8b8700 1 -- 172.21.15.63:0/3413336998 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c90003720 con 0x7f7c9c004bf0 2020-05-18T21:35:43.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.074+0000 7f7cb77fe700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c004bf0 0x7f7c9c004ff0 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7f7ca8003070 tx=0x7f7cb80640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.074+0000 7f7cb57fa700 1 -- 172.21.15.63:0/3413336998 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+1785 (secure 0 0 0) 0x7f7ca80424a0 con 0x7f7c9c004bf0 2020-05-18T21:35:43.081 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:43.081 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":99,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/3483934102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3483934102},{"type":"v1","addr":"172.21.15.155:6835","nonce":3483934102}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":98}],"filesystems":[{"mdsmap":{"epoch":99,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:34:27.767123+0000","modified":"2020-05-18T21:35:42.769345+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-05-18T21:35:43.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.078+0000 7f7cbc8b8700 1 -- 172.21.15.63:0/3413336998 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c9c0583c0 msgr2=0x7f7c9c05a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:43.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.078+0000 7f7cbc8b8700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7c9c0583c0 0x7f7c9c05a880 secure :-1 s=READY pgs=679 cs=0 l=1 rx=0x7f7ca0001970 tx=0x7f7ca00014c0).stop 2020-05-18T21:35:43.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.078+0000 7f7cbc8b8700 1 -- 172.21.15.63:0/3413336998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c004bf0 msgr2=0x7f7c9c004ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:43.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.078+0000 7f7cbc8b8700 1 --2- 172.21.15.63:0/3413336998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c004bf0 0x7f7c9c004ff0 secure :-1 s=READY pgs=1762 cs=0 l=1 rx=0x7f7ca8003070 tx=0x7f7cb80640f0).stop 2020-05-18T21:35:43.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.078+0000 7f7cb7fff700 1 -- 172.21.15.63:0/3413336998 reap_dead start 2020-05-18T21:35:43.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.078+0000 7f7cbc8b8700 1 -- 172.21.15.63:0/3413336998 shutdown_connections 2020-05-18T21:35:43.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.078+0000 7f7cbc8b8700 1 -- 172.21.15.63:0/3413336998 >> 172.21.15.63:0/3413336998 conn(0x7f7cb8069fc0 msgr2=0x7f7cb8064850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:43.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.078+0000 7f7cbc8b8700 1 -- 172.21.15.63:0/3413336998 shutdown_connections 2020-05-18T21:35:43.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.078+0000 7f7cbc8b8700 1 -- 172.21.15.63:0/3413336998 wait complete. 2020-05-18T21:35:43.089 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 99 2020-05-18T21:35:43.098 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-05-18T21:35:43.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.242+0000 7fd228851700 1 Processor -- start 2020-05-18T21:35:43.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.242+0000 7fd228851700 1 -- start start 2020-05-18T21:35:43.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd228851700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd22406a5c0 0x7fd2240650d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:43.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd228851700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd224065fa0 0x7fd2241436d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:43.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd228851700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd224142b90 con 0x7fd224065b10 2020-05-18T21:35:43.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd228851700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd224063890 con 0x7fd22406a5c0 2020-05-18T21:35:43.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd228851700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd224063b30 con 0x7fd224065fa0 2020-05-18T21:35:43.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd22259c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd22406a5c0 0x7fd2240650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:43.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd22259c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd22406a5c0 0x7fd2240650d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34294/0 (socket says 172.21.15.63:34294) 2020-05-18T21:35:43.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd219d9b700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd224065b10 0x7fd224142fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:34798/0 (socket says 172.21.15.63:34798) 2020-05-18T21:35:43.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd222d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd224065fa0 0x7fd2241436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:43.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd219d9b700 1 -- 172.21.15.63:0/1162209313 learned_addr learned my addr 172.21.15.63:0/1162209313 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:43.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd221d9b700 1 -- 172.21.15.63:0/1162209313 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 951313939 0 0) 0x7fd224142b90 con 0x7fd224065b10 2020-05-18T21:35:43.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd221d9b700 1 -- 172.21.15.63:0/1162209313 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd204003270 con 0x7fd224065b10 2020-05-18T21:35:43.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd222d9d700 1 -- 172.21.15.63:0/1162209313 >> v2:172.21.15.63:3300/0 conn(0x7fd22406a5c0 msgr2=0x7fd2240650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:43.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd222d9d700 1 --2- 172.21.15.63:0/1162209313 >> v2:172.21.15.63:3300/0 conn(0x7fd22406a5c0 0x7fd2240650d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:43.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd222d9d700 1 -- 172.21.15.63:0/1162209313 >> v1:172.21.15.155:6789/0 conn(0x7fd224065b10 legacy=0x7fd224142fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:43.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd222d9d700 1 -- 172.21.15.63:0/1162209313 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd224143b30 con 0x7fd224065fa0 2020-05-18T21:35:43.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd22259c700 1 --2- 172.21.15.63:0/1162209313 >> v2:172.21.15.63:3300/0 conn(0x7fd22406a5c0 0x7fd2240650d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:35:43.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd222d9d700 1 --2- 172.21.15.63:0/1162209313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd224065fa0 0x7fd2241436d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd21c0032f0 tx=0x7fd21c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd222d9d700 1 --2- 172.21.15.63:0/1162209313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd224065fa0 0x7fd2241436d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd21c0032f0 tx=0x7fd21c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd222d9d700 1 --2- 172.21.15.63:0/1162209313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd224065fa0 0x7fd2241436d0 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fd21c0032f0 tx=0x7fd21c007e00).ready entity=mon.2 client_cookie=14e29d750014b9e5 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:43.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd222d9d700 1 --2- 172.21.15.63:0/1162209313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd224065fa0 0x7fd2241436d0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fd21c0032f0 tx=0x7fd21c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd221d9b700 1 -- 172.21.15.63:0/1162209313 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd21c011ea0 con 0x7fd224065fa0 2020-05-18T21:35:43.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd222d9d700 1 --2- 172.21.15.63:0/1162209313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd224065fa0 0x7fd2241436d0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fd21c0032f0 tx=0x7fd21c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd222d9d700 1 --2- 172.21.15.63:0/1162209313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd224065fa0 0x7fd2241436d0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fd21c0032f0 tx=0x7fd21c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd221d9b700 1 -- 172.21.15.63:0/1162209313 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c00a180 con 0x7fd224065fa0 2020-05-18T21:35:43.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd221d9b700 1 -- 172.21.15.63:0/1162209313 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd21c00a560 con 0x7fd224065fa0 2020-05-18T21:35:43.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd228851700 1 -- 172.21.15.63:0/1162209313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd224065fa0 msgr2=0x7fd2241436d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:43.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd228851700 1 --2- 172.21.15.63:0/1162209313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd224065fa0 0x7fd2241436d0 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fd21c0032f0 tx=0x7fd21c007e00).stop 2020-05-18T21:35:43.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd228851700 1 -- 172.21.15.63:0/1162209313 shutdown_connections 2020-05-18T21:35:43.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd228851700 1 --2- 172.21.15.63:0/1162209313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd224065fa0 0x7fd2241436d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:43.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd228851700 1 --2- 172.21.15.63:0/1162209313 >> v2:172.21.15.63:3300/0 conn(0x7fd22406a5c0 0x7fd2240650d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:43.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd228851700 1 -- 172.21.15.63:0/1162209313 >> 172.21.15.63:0/1162209313 conn(0x7fd2240b8ea0 msgr2=0x7fd224069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:43.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd228851700 1 -- 172.21.15.63:0/1162209313 shutdown_connections 2020-05-18T21:35:43.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.246+0000 7fd228851700 1 -- 172.21.15.63:0/1162209313 wait complete. 2020-05-18T21:35:43.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd228851700 1 Processor -- start 2020-05-18T21:35:43.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd228851700 1 -- start start 2020-05-18T21:35:43.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd228851700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd224065b10 0x7fd224144ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:43.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd228851700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd224145450 con 0x7fd224065fa0 2020-05-18T21:35:43.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd228851700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd224133c70 con 0x7fd22406a5c0 2020-05-18T21:35:43.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd228851700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2240ae240 con 0x7fd224065b10 2020-05-18T21:35:43.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd219d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd224065fa0 0x7fd2241313c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36492/0 (socket says 172.21.15.63:36492) 2020-05-18T21:35:43.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd219d9b700 1 -- 172.21.15.63:0/2039793221 learned_addr learned my addr 172.21.15.63:0/2039793221 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:43.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd22259c700 1 --2- 172.21.15.63:0/2039793221 >> v2:172.21.15.155:3300/0 conn(0x7fd224065b10 0x7fd224144ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:43.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd21bfff700 1 -- 172.21.15.63:0/2039793221 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154788252 0 0) 0x7fd224145450 con 0x7fd224065fa0 2020-05-18T21:35:43.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd21bfff700 1 -- 172.21.15.63:0/2039793221 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd208002fe0 con 0x7fd224065fa0 2020-05-18T21:35:43.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd21bfff700 1 -- 172.21.15.63:0/2039793221 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 12591793 0 0) 0x7fd224133c70 con 0x7fd22406a5c0 2020-05-18T21:35:43.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd21bfff700 1 -- 172.21.15.63:0/2039793221 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd224145450 con 0x7fd22406a5c0 2020-05-18T21:35:43.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd21bfff700 1 -- 172.21.15.63:0/2039793221 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2040974644 0 0) 0x7fd208002fe0 con 0x7fd224065fa0 2020-05-18T21:35:43.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd22259c700 1 -- 172.21.15.63:0/2039793221 >> v1:172.21.15.155:6789/0 conn(0x7fd22406a5c0 legacy=0x7fd224133130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:43.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd22259c700 1 -- 172.21.15.63:0/2039793221 >> v1:172.21.15.63:6789/0 conn(0x7fd224065fa0 legacy=0x7fd2241313c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:43.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd22259c700 1 -- 172.21.15.63:0/2039793221 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2241339d0 con 0x7fd224065b10 2020-05-18T21:35:43.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd22259c700 1 --2- 172.21.15.63:0/2039793221 >> v2:172.21.15.155:3300/0 conn(0x7fd224065b10 0x7fd224144ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd20c001ae0 tx=0x7fd214010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd22259c700 1 --2- 172.21.15.63:0/2039793221 >> v2:172.21.15.155:3300/0 conn(0x7fd224065b10 0x7fd224144ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd20c001ae0 tx=0x7fd214010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd22259c700 1 --2- 172.21.15.63:0/2039793221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd224065b10 0x7fd224144ff0 secure :-1 s=READY pgs=1156 cs=0 l=1 rx=0x7fd20c001ae0 tx=0x7fd214010db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:43.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd22259c700 1 --2- 172.21.15.63:0/2039793221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd224065b10 0x7fd224144ff0 secure :-1 s=THROTTLE_DONE pgs=1156 cs=0 l=1 rx=0x7fd20c001ae0 tx=0x7fd214010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd21bfff700 1 -- 172.21.15.63:0/2039793221 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd20c001980 con 0x7fd224065b10 2020-05-18T21:35:43.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd22259c700 1 --2- 172.21.15.63:0/2039793221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd224065b10 0x7fd224144ff0 secure :-1 s=THROTTLE_DONE pgs=1156 cs=0 l=1 rx=0x7fd20c001ae0 tx=0x7fd214010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd21bfff700 1 -- 172.21.15.63:0/2039793221 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd214007370 con 0x7fd224065b10 2020-05-18T21:35:43.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd22259c700 1 --2- 172.21.15.63:0/2039793221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd224065b10 0x7fd224144ff0 secure :-1 s=THROTTLE_DONE pgs=1156 cs=0 l=1 rx=0x7fd20c001ae0 tx=0x7fd214010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd21bfff700 1 -- 172.21.15.63:0/2039793221 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd214005a00 con 0x7fd224065b10 2020-05-18T21:35:43.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd228851700 1 -- 172.21.15.63:0/2039793221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2240ae490 con 0x7fd224065b10 2020-05-18T21:35:43.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.250+0000 7fd228851700 1 -- 172.21.15.63:0/2039793221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2240ae950 con 0x7fd224065b10 2020-05-18T21:35:43.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.254+0000 7fd22259c700 1 --2- 172.21.15.63:0/2039793221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd224065b10 0x7fd224144ff0 secure :-1 s=THROTTLE_DONE pgs=1156 cs=0 l=1 rx=0x7fd20c001ae0 tx=0x7fd214010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.254+0000 7fd228851700 1 -- 172.21.15.63:0/2039793221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2240569e0 con 0x7fd224065b10 2020-05-18T21:35:43.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.254+0000 7fd21bfff700 1 -- 172.21.15.63:0/2039793221 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd214013070 con 0x7fd224065b10 2020-05-18T21:35:43.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.254+0000 7fd22259c700 1 --2- 172.21.15.63:0/2039793221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd224065b10 0x7fd224144ff0 secure :-1 s=THROTTLE_DONE pgs=1156 cs=0 l=1 rx=0x7fd20c001ae0 tx=0x7fd214010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.254+0000 7fd21bfff700 1 --2- 172.21.15.63:0/2039793221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd20804fea0 0x7fd208052360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:43.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.254+0000 7fd21bfff700 1 -- 172.21.15.63:0/2039793221 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fd214063680 con 0x7fd224065b10 2020-05-18T21:35:43.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.254+0000 7fd219d9b700 1 --2- 172.21.15.63:0/2039793221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd20804fea0 0x7fd208052360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:43.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.254+0000 7fd219d9b700 1 --2- 172.21.15.63:0/2039793221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd20804fea0 0x7fd208052360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd20c001b20 tx=0x7fd20c0095e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.254+0000 7fd219d9b700 1 --2- 172.21.15.63:0/2039793221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd20804fea0 0x7fd208052360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd20c001b20 tx=0x7fd20c0095e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.254+0000 7fd219d9b700 1 --2- 172.21.15.63:0/2039793221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd20804fea0 0x7fd208052360 secure :-1 s=READY pgs=680 cs=0 l=1 rx=0x7fd20c001b20 tx=0x7fd20c0095e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:43.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.266+0000 7fd22259c700 1 --2- 172.21.15.63:0/2039793221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd224065b10 0x7fd224144ff0 secure :-1 s=THROTTLE_DONE pgs=1156 cs=0 l=1 rx=0x7fd20c001ae0 tx=0x7fd214010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.266+0000 7fd21bfff700 1 -- 172.21.15.63:0/2039793221 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd21403da10 con 0x7fd224065b10 2020-05-18T21:35:43.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.418+0000 7fd228851700 1 -- 172.21.15.63:0/2039793221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd224066920 con 0x7fd224065b10 2020-05-18T21:35:43.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.794+0000 7fd22259c700 1 --2- 172.21.15.63:0/2039793221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd224065b10 0x7fd224144ff0 secure :-1 s=THROTTLE_DONE pgs=1156 cs=0 l=1 rx=0x7fd20c001ae0 tx=0x7fd214010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.794+0000 7fd21bfff700 1 -- 172.21.15.63:0/2039793221 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v100) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd214041030 con 0x7fd224065b10 2020-05-18T21:35:43.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.798+0000 7fd228851700 1 -- 172.21.15.63:0/2039793221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd20804fea0 msgr2=0x7fd208052360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:43.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.798+0000 7fd228851700 1 --2- 172.21.15.63:0/2039793221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd20804fea0 0x7fd208052360 secure :-1 s=READY pgs=680 cs=0 l=1 rx=0x7fd20c001b20 tx=0x7fd20c0095e0).stop 2020-05-18T21:35:43.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.798+0000 7fd228851700 1 -- 172.21.15.63:0/2039793221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd224065b10 msgr2=0x7fd224144ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:43.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.798+0000 7fd228851700 1 --2- 172.21.15.63:0/2039793221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd224065b10 0x7fd224144ff0 secure :-1 s=READY pgs=1156 cs=0 l=1 rx=0x7fd20c001ae0 tx=0x7fd214010db0).stop 2020-05-18T21:35:43.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.798+0000 7fd228851700 1 -- 172.21.15.63:0/2039793221 shutdown_connections 2020-05-18T21:35:43.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.798+0000 7fd228851700 1 --2- 172.21.15.63:0/2039793221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd20804fea0 0x7fd208052360 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:43.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.798+0000 7fd228851700 1 --2- 172.21.15.63:0/2039793221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd224065b10 0x7fd224144ff0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:43.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.798+0000 7fd228851700 1 -- 172.21.15.63:0/2039793221 >> 172.21.15.63:0/2039793221 conn(0x7fd2240b8ea0 msgr2=0x7fd224063080 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:43.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.798+0000 7fd228851700 1 -- 172.21.15.63:0/2039793221 shutdown_connections 2020-05-18T21:35:43.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.798+0000 7fd228851700 1 -- 172.21.15.63:0/2039793221 wait complete. 2020-05-18T21:35:43.820 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-05-18T21:35:43.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.930+0000 7f62c12de700 1 Processor -- start 2020-05-18T21:35:43.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.930+0000 7f62c12de700 1 -- start start 2020-05-18T21:35:43.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62c12de700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f62bc0b6230 0x7f62bc146310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:43.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62c12de700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc141930 0x7f62bc141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:43.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62c12de700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62bc0b55d0 con 0x7f62bc069b70 2020-05-18T21:35:43.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62c12de700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62bc0b3930 con 0x7f62bc0b6230 2020-05-18T21:35:43.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62c12de700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0b3bd0 con 0x7f62bc141930 2020-05-18T21:35:43.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62bb7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f62bc069b70 0x7f62bc06a000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36500/0 (socket says 172.21.15.63:36500) 2020-05-18T21:35:43.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62bb7fe700 1 -- 172.21.15.63:0/268677053 learned_addr learned my addr 172.21.15.63:0/268677053 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:43.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62baffd700 1 --2- 172.21.15.63:0/268677053 >> v2:172.21.15.155:3300/0 conn(0x7f62bc0b6230 0x7f62bc146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:43.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62b27fc700 1 --2- 172.21.15.63:0/268677053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc141930 0x7f62bc141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:43.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62ba7fc700 1 -- 172.21.15.63:0/268677053 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460496708 0 0) 0x7f62bc0b55d0 con 0x7f62bc069b70 2020-05-18T21:35:43.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62ba7fc700 1 -- 172.21.15.63:0/268677053 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f629c003270 con 0x7f62bc069b70 2020-05-18T21:35:43.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62b27fc700 1 -- 172.21.15.63:0/268677053 >> v2:172.21.15.155:3300/0 conn(0x7f62bc0b6230 msgr2=0x7f62bc146310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:43.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62b27fc700 1 --2- 172.21.15.63:0/268677053 >> v2:172.21.15.155:3300/0 conn(0x7f62bc0b6230 0x7f62bc146310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:43.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62b27fc700 1 -- 172.21.15.63:0/268677053 >> v1:172.21.15.63:6789/0 conn(0x7f62bc069b70 legacy=0x7f62bc06a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:43.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62b27fc700 1 -- 172.21.15.63:0/268677053 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc0b3e70 con 0x7f62bc141930 2020-05-18T21:35:43.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62baffd700 1 --2- 172.21.15.63:0/268677053 >> v2:172.21.15.155:3300/0 conn(0x7f62bc0b6230 0x7f62bc146310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:35:43.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62b27fc700 1 --2- 172.21.15.63:0/268677053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc141930 0x7f62bc141dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f62bc0afa90 tx=0x7f62a4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62b27fc700 1 --2- 172.21.15.63:0/268677053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc141930 0x7f62bc141dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f62bc0afa90 tx=0x7f62a4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62b27fc700 1 --2- 172.21.15.63:0/268677053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc141930 0x7f62bc141dc0 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7f62bc0afa90 tx=0x7f62a4008920).ready entity=mon.2 client_cookie=dc2328691fdb1d4b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:43.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62b27fc700 1 --2- 172.21.15.63:0/268677053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc141930 0x7f62bc141dc0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f62bc0afa90 tx=0x7f62a4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62ba7fc700 1 -- 172.21.15.63:0/268677053 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62a4008e80 con 0x7f62bc141930 2020-05-18T21:35:43.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62b27fc700 1 --2- 172.21.15.63:0/268677053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc141930 0x7f62bc141dc0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f62bc0afa90 tx=0x7f62a4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62b27fc700 1 --2- 172.21.15.63:0/268677053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc141930 0x7f62bc141dc0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f62bc0afa90 tx=0x7f62a4008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62ba7fc700 1 -- 172.21.15.63:0/268677053 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a4011540 con 0x7f62bc141930 2020-05-18T21:35:43.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62ba7fc700 1 -- 172.21.15.63:0/268677053 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62a4011960 con 0x7f62bc141930 2020-05-18T21:35:43.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62c12de700 1 -- 172.21.15.63:0/268677053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc141930 msgr2=0x7f62bc141dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:43.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62c12de700 1 --2- 172.21.15.63:0/268677053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc141930 0x7f62bc141dc0 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7f62bc0afa90 tx=0x7f62a4008920).stop 2020-05-18T21:35:43.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62c12de700 1 -- 172.21.15.63:0/268677053 shutdown_connections 2020-05-18T21:35:43.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62c12de700 1 --2- 172.21.15.63:0/268677053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc141930 0x7f62bc141dc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:43.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62c12de700 1 --2- 172.21.15.63:0/268677053 >> v2:172.21.15.155:3300/0 conn(0x7f62bc0b6230 0x7f62bc146310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:43.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62c12de700 1 -- 172.21.15.63:0/268677053 >> 172.21.15.63:0/268677053 conn(0x7f62bc0b9770 msgr2=0x7f62bc0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:43.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62c12de700 1 -- 172.21.15.63:0/268677053 shutdown_connections 2020-05-18T21:35:43.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.934+0000 7f62c12de700 1 -- 172.21.15.63:0/268677053 wait complete. 2020-05-18T21:35:43.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62c12de700 1 Processor -- start 2020-05-18T21:35:43.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62c12de700 1 -- start start 2020-05-18T21:35:43.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62c12de700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc069b70 0x7f62bc0b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:43.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62c12de700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f62bc0b6230 0x7f62bc154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:43.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62c12de700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f62bc141930 0x7f62bc155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:43.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62c12de700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62bc0b8440 con 0x7f62bc0b6230 2020-05-18T21:35:43.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62c12de700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62bc0b4c90 con 0x7f62bc141930 2020-05-18T21:35:43.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62c12de700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc09e7f0 con 0x7f62bc069b70 2020-05-18T21:35:43.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62b27fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f62bc0b6230 0x7f62bc154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:43.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62b27fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f62bc0b6230 0x7f62bc154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34316/0 (socket says 172.21.15.63:34316) 2020-05-18T21:35:43.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62b27fc700 1 -- 172.21.15.63:0/3623376962 learned_addr learned my addr 172.21.15.63:0/3623376962 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:43.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62baffd700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc069b70 0x7f62bc0b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:43.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62bb7fe700 1 --2- 172.21.15.63:0/3623376962 >> v2:172.21.15.155:3300/0 conn(0x7f62bc141930 0x7f62bc155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:43.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62b27fc700 1 -- 172.21.15.63:0/3623376962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc069b70 msgr2=0x7f62bc0b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:43.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62b27fc700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc069b70 0x7f62bc0b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:43.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62b27fc700 1 -- 172.21.15.63:0/3623376962 >> v2:172.21.15.155:3300/0 conn(0x7f62bc141930 msgr2=0x7f62bc155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:43.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62b27fc700 1 --2- 172.21.15.63:0/3623376962 >> v2:172.21.15.155:3300/0 conn(0x7f62bc141930 0x7f62bc155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:43.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62b27fc700 1 -- 172.21.15.63:0/3623376962 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc09aed0 con 0x7f62bc0b6230 2020-05-18T21:35:43.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62bb7fe700 1 --2- 172.21.15.63:0/3623376962 >> v2:172.21.15.155:3300/0 conn(0x7f62bc141930 0x7f62bc155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:35:43.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62b27fc700 1 --2- 172.21.15.63:0/3623376962 >> v2:172.21.15.63:3300/0 conn(0x7f62bc0b6230 0x7f62bc154d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f62bc0afa90 tx=0x7f62a40112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62b27fc700 1 --2- 172.21.15.63:0/3623376962 >> v2:172.21.15.63:3300/0 conn(0x7f62bc0b6230 0x7f62bc154d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f62bc0afa90 tx=0x7f62a40112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62b27fc700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62bc0b6230 0x7f62bc154d30 secure :-1 s=READY pgs=1765 cs=0 l=1 rx=0x7f62bc0afa90 tx=0x7f62a40112f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:43.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62b27fc700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62bc0b6230 0x7f62bc154d30 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7f62bc0afa90 tx=0x7f62a40112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62b8ff9700 1 -- 172.21.15.63:0/3623376962 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62a4011ea0 con 0x7f62bc0b6230 2020-05-18T21:35:43.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62b27fc700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62bc0b6230 0x7f62bc154d30 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7f62bc0afa90 tx=0x7f62a40112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62b27fc700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62bc0b6230 0x7f62bc154d30 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7f62bc0afa90 tx=0x7f62a40112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62b8ff9700 1 -- 172.21.15.63:0/3623376962 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a400f860 con 0x7f62bc0b6230 2020-05-18T21:35:43.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62c12de700 1 -- 172.21.15.63:0/3623376962 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62bc09b370 con 0x7f62bc0b6230 2020-05-18T21:35:43.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.938+0000 7f62b8ff9700 1 -- 172.21.15.63:0/3623376962 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62a4007550 con 0x7f62bc0b6230 2020-05-18T21:35:43.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.942+0000 7f62c12de700 1 -- 172.21.15.63:0/3623376962 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62bc141e80 con 0x7f62bc0b6230 2020-05-18T21:35:43.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.942+0000 7f62b27fc700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62bc0b6230 0x7f62bc154d30 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7f62bc0afa90 tx=0x7f62a40112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.942+0000 7f62b8ff9700 1 -- 172.21.15.63:0/3623376962 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f62a4005700 con 0x7f62bc0b6230 2020-05-18T21:35:43.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.942+0000 7f62b27fc700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62bc0b6230 0x7f62bc154d30 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7f62bc0afa90 tx=0x7f62a40112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.942+0000 7f62c12de700 1 -- 172.21.15.63:0/3623376962 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62bc0569e0 con 0x7f62bc0b6230 2020-05-18T21:35:43.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.942+0000 7f62b8ff9700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f62a004f950 0x7f62a0051e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:43.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.942+0000 7f62b8ff9700 1 -- 172.21.15.63:0/3623376962 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f62a4064470 con 0x7f62bc0b6230 2020-05-18T21:35:43.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.942+0000 7f62baffd700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f62a004f950 0x7f62a0051e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:43.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.942+0000 7f62baffd700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f62a004f950 0x7f62a0051e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f62ac002f70 tx=0x7f62ac00ebe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.942+0000 7f62baffd700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f62a004f950 0x7f62a0051e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f62ac002f70 tx=0x7f62ac00ebe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.942+0000 7f62baffd700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f62a004f950 0x7f62a0051e10 secure :-1 s=READY pgs=681 cs=0 l=1 rx=0x7f62ac002f70 tx=0x7f62ac00ebe0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:43.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.950+0000 7f62b27fc700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62bc0b6230 0x7f62bc154d30 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7f62bc0afa90 tx=0x7f62a40112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:43.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:43.950+0000 7f62b8ff9700 1 -- 172.21.15.63:0/3623376962 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f62a403e8c0 con 0x7f62bc0b6230 2020-05-18T21:35:44.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.062+0000 7f62c12de700 1 -- 172.21.15.63:0/3623376962 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f62bc0b2400 con 0x7f62bc0b6230 2020-05-18T21:35:44.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.794+0000 7f62b27fc700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62bc0b6230 0x7f62bc154d30 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7f62bc0afa90 tx=0x7f62a40112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:44.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.794+0000 7f62b8ff9700 1 -- 172.21.15.63:0/3623376962 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v127) v1 ==== 185+0+0 (secure 0 0 0) 0x7f62a4041ee0 con 0x7f62bc0b6230 2020-05-18T21:35:44.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.802+0000 7f62c12de700 1 -- 172.21.15.63:0/3623376962 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f62a004f950 msgr2=0x7f62a0051e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:44.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.802+0000 7f62c12de700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f62a004f950 0x7f62a0051e10 secure :-1 s=READY pgs=681 cs=0 l=1 rx=0x7f62ac002f70 tx=0x7f62ac00ebe0).stop 2020-05-18T21:35:44.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.802+0000 7f62c12de700 1 -- 172.21.15.63:0/3623376962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62bc0b6230 msgr2=0x7f62bc154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:44.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.802+0000 7f62c12de700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62bc0b6230 0x7f62bc154d30 secure :-1 s=READY pgs=1765 cs=0 l=1 rx=0x7f62bc0afa90 tx=0x7f62a40112f0).stop 2020-05-18T21:35:44.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.802+0000 7f62c12de700 1 -- 172.21.15.63:0/3623376962 shutdown_connections 2020-05-18T21:35:44.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.802+0000 7f62c12de700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f62a004f950 0x7f62a0051e10 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:44.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.802+0000 7f62c12de700 1 --2- 172.21.15.63:0/3623376962 >> v2:172.21.15.155:3300/0 conn(0x7f62bc141930 0x7f62bc155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:44.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.802+0000 7f62c12de700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62bc0b6230 0x7f62bc154d30 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:44.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.802+0000 7f62c12de700 1 --2- 172.21.15.63:0/3623376962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc069b70 0x7f62bc0b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:44.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.802+0000 7f62c12de700 1 -- 172.21.15.63:0/3623376962 >> 172.21.15.63:0/3623376962 conn(0x7f62bc0b9770 msgr2=0x7f62bc0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:44.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.806+0000 7f62c12de700 1 -- 172.21.15.63:0/3623376962 shutdown_connections 2020-05-18T21:35:44.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.806+0000 7f62c12de700 1 -- 172.21.15.63:0/3623376962 wait complete. 2020-05-18T21:35:44.810 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2020-05-18T21:35:44.822 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-05-18T21:35:44.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e84288700 1 Processor -- start 2020-05-18T21:35:44.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e84288700 1 -- start start 2020-05-18T21:35:44.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e84288700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9e7c143430 0x7f9e7c145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:44.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e84288700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9e7c0b6d70 0x7f9e7c0b9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:44.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e84288700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e7c143810 con 0x7f9e7c0b7bf0 2020-05-18T21:35:44.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e84288700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e7c0b7210 con 0x7f9e7c143430 2020-05-18T21:35:44.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e84288700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e7c0b74b0 con 0x7f9e7c0b6d70 2020-05-18T21:35:44.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e82024700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9e7c143430 0x7f9e7c145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:44.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e82024700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9e7c143430 0x7f9e7c145dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34322/0 (socket says 172.21.15.63:34322) 2020-05-18T21:35:44.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e82024700 1 -- 172.21.15.63:0/2210748187 learned_addr learned my addr 172.21.15.63:0/2210748187 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:44.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e81823700 1 --2- 172.21.15.63:0/2210748187 >> v2:172.21.15.155:3300/0 conn(0x7f9e7c0b6d70 0x7f9e7c0b9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:44.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e82024700 1 -- 172.21.15.63:0/2210748187 >> v2:172.21.15.155:3300/0 conn(0x7f9e7c0b6d70 msgr2=0x7f9e7c0b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:44.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e82024700 1 --2- 172.21.15.63:0/2210748187 >> v2:172.21.15.155:3300/0 conn(0x7f9e7c0b6d70 0x7f9e7c0b9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:44.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e82024700 1 -- 172.21.15.63:0/2210748187 >> v1:172.21.15.155:6789/0 conn(0x7f9e7c0b7bf0 legacy=0x7f9e7c1493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:44.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e82024700 1 -- 172.21.15.63:0/2210748187 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c0b7750 con 0x7f9e7c143430 2020-05-18T21:35:44.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e81823700 1 --2- 172.21.15.63:0/2210748187 >> v2:172.21.15.155:3300/0 conn(0x7f9e7c0b6d70 0x7f9e7c0b9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:35:44.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e82024700 1 --2- 172.21.15.63:0/2210748187 >> v2:172.21.15.63:3300/0 conn(0x7f9e7c143430 0x7f9e7c145dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9e78002f70 tx=0x7f9e78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:44.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e82024700 1 --2- 172.21.15.63:0/2210748187 >> v2:172.21.15.63:3300/0 conn(0x7f9e7c143430 0x7f9e7c145dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9e78002f70 tx=0x7f9e78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:44.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e82024700 1 --2- 172.21.15.63:0/2210748187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c143430 0x7f9e7c145dd0 secure :-1 s=READY pgs=1766 cs=0 l=1 rx=0x7f9e78002f70 tx=0x7f9e78007a80).ready entity=mon.0 client_cookie=f8e0e44685d5e14d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:44.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e82024700 1 --2- 172.21.15.63:0/2210748187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c143430 0x7f9e7c145dd0 secure :-1 s=THROTTLE_DONE pgs=1766 cs=0 l=1 rx=0x7f9e78002f70 tx=0x7f9e78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:44.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e82024700 1 --2- 172.21.15.63:0/2210748187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c143430 0x7f9e7c145dd0 secure :-1 s=THROTTLE_DONE pgs=1766 cs=0 l=1 rx=0x7f9e78002f70 tx=0x7f9e78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:44.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e81022700 1 -- 172.21.15.63:0/2210748187 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e78011760 con 0x7f9e7c143430 2020-05-18T21:35:44.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e82024700 1 --2- 172.21.15.63:0/2210748187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c143430 0x7f9e7c145dd0 secure :-1 s=THROTTLE_DONE pgs=1766 cs=0 l=1 rx=0x7f9e78002f70 tx=0x7f9e78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:44.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e81022700 1 -- 172.21.15.63:0/2210748187 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e780118c0 con 0x7f9e7c143430 2020-05-18T21:35:44.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e81022700 1 -- 172.21.15.63:0/2210748187 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e78011ce0 con 0x7f9e7c143430 2020-05-18T21:35:44.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e84288700 1 -- 172.21.15.63:0/2210748187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c143430 msgr2=0x7f9e7c145dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:44.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.918+0000 7f9e84288700 1 --2- 172.21.15.63:0/2210748187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c143430 0x7f9e7c145dd0 secure :-1 s=READY pgs=1766 cs=0 l=1 rx=0x7f9e78002f70 tx=0x7f9e78007a80).stop 2020-05-18T21:35:44.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.922+0000 7f9e84288700 1 -- 172.21.15.63:0/2210748187 shutdown_connections 2020-05-18T21:35:44.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.922+0000 7f9e84288700 1 --2- 172.21.15.63:0/2210748187 >> v2:172.21.15.155:3300/0 conn(0x7f9e7c0b6d70 0x7f9e7c0b9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:44.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.922+0000 7f9e84288700 1 --2- 172.21.15.63:0/2210748187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c143430 0x7f9e7c145dd0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:44.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.922+0000 7f9e84288700 1 -- 172.21.15.63:0/2210748187 >> 172.21.15.63:0/2210748187 conn(0x7f9e7c069b70 msgr2=0x7f9e7c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:44.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.922+0000 7f9e84288700 1 -- 172.21.15.63:0/2210748187 shutdown_connections 2020-05-18T21:35:44.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.922+0000 7f9e84288700 1 -- 172.21.15.63:0/2210748187 wait complete. 2020-05-18T21:35:44.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.922+0000 7f9e84288700 1 Processor -- start 2020-05-18T21:35:44.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.922+0000 7f9e84288700 1 -- start start 2020-05-18T21:35:44.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.922+0000 7f9e84288700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9e7c0b6d70 0x7f9e7c141d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:44.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.922+0000 7f9e84288700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9e7c0b7bf0 0x7f9e7c0ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:44.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.922+0000 7f9e84288700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e7c143430 0x7f9e7c1536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:44.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.922+0000 7f9e84288700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e7c0af5c0 con 0x7f9e7c0b7bf0 2020-05-18T21:35:44.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.922+0000 7f9e84288700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e7c0af860 con 0x7f9e7c0b6d70 2020-05-18T21:35:44.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.922+0000 7f9e84288700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c0af2a0 con 0x7f9e7c143430 2020-05-18T21:35:44.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.922+0000 7f9e81823700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9e7c0b7bf0 0x7f9e7c0ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:44.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.922+0000 7f9e81823700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9e7c0b7bf0 0x7f9e7c0ace60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34328/0 (socket says 172.21.15.63:34328) 2020-05-18T21:35:44.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e81823700 1 -- 172.21.15.63:0/3443812088 learned_addr learned my addr 172.21.15.63:0/3443812088 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:44.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e82024700 1 --2- 172.21.15.63:0/3443812088 >> v2:172.21.15.155:3300/0 conn(0x7f9e7c0b6d70 0x7f9e7c141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:44.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e82825700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e7c143430 0x7f9e7c1536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:44.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e81823700 1 -- 172.21.15.63:0/3443812088 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e7c143430 msgr2=0x7f9e7c1536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:44.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e81823700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e7c143430 0x7f9e7c1536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:44.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e81823700 1 -- 172.21.15.63:0/3443812088 >> v2:172.21.15.155:3300/0 conn(0x7f9e7c0b6d70 msgr2=0x7f9e7c141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:44.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e81823700 1 --2- 172.21.15.63:0/3443812088 >> v2:172.21.15.155:3300/0 conn(0x7f9e7c0b6d70 0x7f9e7c141d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:44.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e81823700 1 -- 172.21.15.63:0/3443812088 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c0ad2c0 con 0x7f9e7c0b7bf0 2020-05-18T21:35:44.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e81823700 1 --2- 172.21.15.63:0/3443812088 >> v2:172.21.15.63:3300/0 conn(0x7f9e7c0b7bf0 0x7f9e7c0ace60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9e6c007960 tx=0x7f9e7c05ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:44.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e81823700 1 --2- 172.21.15.63:0/3443812088 >> v2:172.21.15.63:3300/0 conn(0x7f9e7c0b7bf0 0x7f9e7c0ace60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9e6c007960 tx=0x7f9e7c05ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:44.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e81823700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c0b7bf0 0x7f9e7c0ace60 secure :-1 s=READY pgs=1767 cs=0 l=1 rx=0x7f9e6c007960 tx=0x7f9e7c05ab60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:44.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e81823700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c0b7bf0 0x7f9e7c0ace60 secure :-1 s=THROTTLE_DONE pgs=1767 cs=0 l=1 rx=0x7f9e6c007960 tx=0x7f9e7c05ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:44.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e81823700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c0b7bf0 0x7f9e7c0ace60 secure :-1 s=THROTTLE_DONE pgs=1767 cs=0 l=1 rx=0x7f9e6c007960 tx=0x7f9e7c05ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:44.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e6b7fe700 1 -- 172.21.15.63:0/3443812088 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e6c013070 con 0x7f9e7c0b7bf0 2020-05-18T21:35:44.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e81823700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c0b7bf0 0x7f9e7c0ace60 secure :-1 s=THROTTLE_DONE pgs=1767 cs=0 l=1 rx=0x7f9e6c007960 tx=0x7f9e7c05ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:44.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e6b7fe700 1 -- 172.21.15.63:0/3443812088 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6c007180 con 0x7f9e7c0b7bf0 2020-05-18T21:35:44.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e84288700 1 -- 172.21.15.63:0/3443812088 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7c1541b0 con 0x7f9e7c0b7bf0 2020-05-18T21:35:44.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e6b7fe700 1 -- 172.21.15.63:0/3443812088 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e6c007560 con 0x7f9e7c0b7bf0 2020-05-18T21:35:44.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e84288700 1 -- 172.21.15.63:0/3443812088 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7c153d30 con 0x7f9e7c0b7bf0 2020-05-18T21:35:44.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e81823700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c0b7bf0 0x7f9e7c0ace60 secure :-1 s=THROTTLE_DONE pgs=1767 cs=0 l=1 rx=0x7f9e6c007960 tx=0x7f9e7c05ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:44.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e84288700 1 -- 172.21.15.63:0/3443812088 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7c0af410 con 0x7f9e7c0b7bf0 2020-05-18T21:35:44.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e6b7fe700 1 -- 172.21.15.63:0/3443812088 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9e6c00e300 con 0x7f9e7c0b7bf0 2020-05-18T21:35:44.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.926+0000 7f9e81823700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c0b7bf0 0x7f9e7c0ace60 secure :-1 s=THROTTLE_DONE pgs=1767 cs=0 l=1 rx=0x7f9e6c007960 tx=0x7f9e7c05ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:44.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.930+0000 7f9e6b7fe700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9e5c04fa50 0x7f9e5c051f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:44.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.930+0000 7f9e6b7fe700 1 -- 172.21.15.63:0/3443812088 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5807+0+0 (secure 0 0 0) 0x7f9e6c063af0 con 0x7f9e7c0b7bf0 2020-05-18T21:35:44.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.930+0000 7f9e82024700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9e5c04fa50 0x7f9e5c051f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:44.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.930+0000 7f9e82024700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9e5c04fa50 0x7f9e5c051f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9e78002f70 tx=0x7f9e78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:44.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.930+0000 7f9e82024700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9e5c04fa50 0x7f9e5c051f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9e78002f70 tx=0x7f9e78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:44.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.930+0000 7f9e82024700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9e5c04fa50 0x7f9e5c051f10 secure :-1 s=READY pgs=682 cs=0 l=1 rx=0x7f9e78002f70 tx=0x7f9e78007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:44.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.934+0000 7f9e81823700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c0b7bf0 0x7f9e7c0ace60 secure :-1 s=THROTTLE_DONE pgs=1767 cs=0 l=1 rx=0x7f9e6c007960 tx=0x7f9e7c05ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:44.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:44.938+0000 7f9e6b7fe700 1 -- 172.21.15.63:0/3443812088 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9e6c03de80 con 0x7f9e7c0b7bf0 2020-05-18T21:35:45.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.054+0000 7f9e84288700 1 -- 172.21.15.63:0/3443812088 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9e7c0569e0 con 0x7f9e7c0b7bf0 2020-05-18T21:35:45.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.810+0000 7f9e81823700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c0b7bf0 0x7f9e7c0ace60 secure :-1 s=THROTTLE_DONE pgs=1767 cs=0 l=1 rx=0x7f9e6c007960 tx=0x7f9e7c05ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:45.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.810+0000 7f9e6b7fe700 1 -- 172.21.15.63:0/3443812088 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v128) v1 ==== 173+0+0 (secure 0 0 0) 0x7f9e6c0414a0 con 0x7f9e7c0b7bf0 2020-05-18T21:35:45.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.814+0000 7f9e84288700 1 -- 172.21.15.63:0/3443812088 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9e5c04fa50 msgr2=0x7f9e5c051f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:45.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.814+0000 7f9e84288700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9e5c04fa50 0x7f9e5c051f10 secure :-1 s=READY pgs=682 cs=0 l=1 rx=0x7f9e78002f70 tx=0x7f9e78007a80).stop 2020-05-18T21:35:45.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.814+0000 7f9e84288700 1 -- 172.21.15.63:0/3443812088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c0b7bf0 msgr2=0x7f9e7c0ace60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:45.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.814+0000 7f9e84288700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c0b7bf0 0x7f9e7c0ace60 secure :-1 s=READY pgs=1767 cs=0 l=1 rx=0x7f9e6c007960 tx=0x7f9e7c05ab60).stop 2020-05-18T21:35:45.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.814+0000 7f9e84288700 1 -- 172.21.15.63:0/3443812088 shutdown_connections 2020-05-18T21:35:45.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.814+0000 7f9e84288700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9e5c04fa50 0x7f9e5c051f10 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:45.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.814+0000 7f9e84288700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e7c143430 0x7f9e7c1536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:45.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.814+0000 7f9e84288700 1 --2- 172.21.15.63:0/3443812088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c0b7bf0 0x7f9e7c0ace60 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:45.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.814+0000 7f9e84288700 1 --2- 172.21.15.63:0/3443812088 >> v2:172.21.15.155:3300/0 conn(0x7f9e7c0b6d70 0x7f9e7c141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:45.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.814+0000 7f9e84288700 1 -- 172.21.15.63:0/3443812088 >> 172.21.15.63:0/3443812088 conn(0x7f9e7c069b70 msgr2=0x7f9e7c060660 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:45.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.814+0000 7f9e84288700 1 -- 172.21.15.63:0/3443812088 shutdown_connections 2020-05-18T21:35:45.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.814+0000 7f9e84288700 1 -- 172.21.15.63:0/3443812088 wait complete. 2020-05-18T21:35:45.823 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2020-05-18T21:35:45.832 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:35:45.832 INFO:tasks.ceph.mds.a:Stopping old one... 2020-05-18T21:35:45.833 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:35:45.833 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:35:45.833 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:35:45.834 INFO:tasks.ceph.mds.b:Stopping old one... 2020-05-18T21:35:45.834 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:35:45.834 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:35:45.843 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:35:45.843 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:35:45.849 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:35:45.850 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:35:45.852 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:35:45.853 DEBUG:teuthology.parallel:result is None 2020-05-18T21:35:45.886 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:35:45.886 DEBUG:teuthology.parallel:result is None 2020-05-18T21:35:45.887 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-05-18T21:35:45.928 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:35:45.946 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:35:45.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7083fff700 1 Processor -- start 2020-05-18T21:35:45.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7083fff700 1 -- start start 2020-05-18T21:35:45.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7083fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7084141430 0x7f708405f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:45.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7083fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f708409da60 0x7f708405f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:45.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7083fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7084062a60 con 0x7f7084147190 2020-05-18T21:35:45.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7083fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70840b6760 con 0x7f708409da60 2020-05-18T21:35:45.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7083fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70840b6c00 con 0x7f7084141430 2020-05-18T21:35:45.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f70827fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f708409da60 0x7f708405f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:45.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f70827fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f708409da60 0x7f708405f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34352/0 (socket says 172.21.15.63:34352) 2020-05-18T21:35:45.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f70827fc700 1 -- 172.21.15.63:0/919635437 learned_addr learned my addr 172.21.15.63:0/919635437 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:45.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7082ffd700 1 --2- 172.21.15.63:0/919635437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7084141430 0x7f708405f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:45.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f70827fc700 1 -- 172.21.15.63:0/919635437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7084141430 msgr2=0x7f708405f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:45.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f70827fc700 1 --2- 172.21.15.63:0/919635437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7084141430 0x7f708405f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:45.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f70827fc700 1 -- 172.21.15.63:0/919635437 >> v1:172.21.15.155:6789/0 conn(0x7f7084147190 legacy=0x7f7084147620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:45.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f70827fc700 1 -- 172.21.15.63:0/919635437 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7084141810 con 0x7f708409da60 2020-05-18T21:35:45.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7082ffd700 1 --2- 172.21.15.63:0/919635437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7084141430 0x7f708405f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:35:45.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f70827fc700 1 --2- 172.21.15.63:0/919635437 >> v2:172.21.15.63:3300/0 conn(0x7f708409da60 0x7f708405f530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7074002f70 tx=0x7f7074007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:45.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f70827fc700 1 --2- 172.21.15.63:0/919635437 >> v2:172.21.15.63:3300/0 conn(0x7f708409da60 0x7f708405f530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7074002f70 tx=0x7f7074007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:45.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f70827fc700 1 --2- 172.21.15.63:0/919635437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f708409da60 0x7f708405f530 secure :-1 s=READY pgs=1771 cs=0 l=1 rx=0x7f7074002f70 tx=0x7f7074007a80).ready entity=mon.0 client_cookie=487cd8ddd711597a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:45.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f70827fc700 1 --2- 172.21.15.63:0/919635437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f708409da60 0x7f708405f530 secure :-1 s=THROTTLE_DONE pgs=1771 cs=0 l=1 rx=0x7f7074002f70 tx=0x7f7074007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:45.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f70827fc700 1 --2- 172.21.15.63:0/919635437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f708409da60 0x7f708405f530 secure :-1 s=THROTTLE_DONE pgs=1771 cs=0 l=1 rx=0x7f7074002f70 tx=0x7f7074007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:45.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f70827fc700 1 --2- 172.21.15.63:0/919635437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f708409da60 0x7f708405f530 secure :-1 s=THROTTLE_DONE pgs=1771 cs=0 l=1 rx=0x7f7074002f70 tx=0x7f7074007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:45.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7081ffb700 1 -- 172.21.15.63:0/919635437 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7074011760 con 0x7f708409da60 2020-05-18T21:35:45.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7081ffb700 1 -- 172.21.15.63:0/919635437 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70740118c0 con 0x7f708409da60 2020-05-18T21:35:45.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7081ffb700 1 -- 172.21.15.63:0/919635437 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7074011ce0 con 0x7f708409da60 2020-05-18T21:35:46.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7083fff700 1 -- 172.21.15.63:0/919635437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f708409da60 msgr2=0x7f708405f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:46.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7083fff700 1 --2- 172.21.15.63:0/919635437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f708409da60 0x7f708405f530 secure :-1 s=READY pgs=1771 cs=0 l=1 rx=0x7f7074002f70 tx=0x7f7074007a80).stop 2020-05-18T21:35:46.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7083fff700 1 -- 172.21.15.63:0/919635437 shutdown_connections 2020-05-18T21:35:46.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7083fff700 1 --2- 172.21.15.63:0/919635437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f708409da60 0x7f708405f530 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:46.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7083fff700 1 --2- 172.21.15.63:0/919635437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7084141430 0x7f708405f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:46.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7083fff700 1 -- 172.21.15.63:0/919635437 >> 172.21.15.63:0/919635437 conn(0x7f708406a640 msgr2=0x7f70840b6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:46.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7083fff700 1 -- 172.21.15.63:0/919635437 shutdown_connections 2020-05-18T21:35:46.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.986+0000 7f7083fff700 1 -- 172.21.15.63:0/919635437 wait complete. 2020-05-18T21:35:46.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7083fff700 1 Processor -- start 2020-05-18T21:35:46.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7083fff700 1 -- start start 2020-05-18T21:35:46.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7083fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f708409da60 0x7f7084061c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:46.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7083fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7084141430 0x7f70840b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:46.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7083fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7084147190 0x7f708412ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:46.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7083fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70840b41b0 con 0x7f7084147190 2020-05-18T21:35:46.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7083fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7084060740 con 0x7f708409da60 2020-05-18T21:35:46.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7083fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70840609e0 con 0x7f7084141430 2020-05-18T21:35:46.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f70837fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7084147190 0x7f708412ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:46.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7082ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f708409da60 0x7f7084061c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:46.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f70827fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7084141430 0x7f70840b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:46.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f70837fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7084147190 0x7f708412ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34358/0 (socket says 172.21.15.63:34358) 2020-05-18T21:35:46.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f70837fe700 1 -- 172.21.15.63:0/2357680797 learned_addr learned my addr 172.21.15.63:0/2357680797 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:46.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7082ffd700 1 -- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7084141430 msgr2=0x7f70840b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:46.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7082ffd700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7084141430 0x7f70840b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:46.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7082ffd700 1 -- 172.21.15.63:0/2357680797 >> v2:172.21.15.63:3300/0 conn(0x7f7084147190 msgr2=0x7f708412ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:46.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7082ffd700 1 --2- 172.21.15.63:0/2357680797 >> v2:172.21.15.63:3300/0 conn(0x7f7084147190 0x7f708412ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:46.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7082ffd700 1 -- 172.21.15.63:0/2357680797 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7084060c80 con 0x7f708409da60 2020-05-18T21:35:46.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f70837fe700 1 --2- 172.21.15.63:0/2357680797 >> v2:172.21.15.63:3300/0 conn(0x7f7084147190 0x7f708412ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:35:46.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f70827fc700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7084141430 0x7f70840b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:35:46.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7082ffd700 1 --2- 172.21.15.63:0/2357680797 >> v2:172.21.15.155:3300/0 conn(0x7f708409da60 0x7f7084061c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7084142990 tx=0x7f7078010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7082ffd700 1 --2- 172.21.15.63:0/2357680797 >> v2:172.21.15.155:3300/0 conn(0x7f708409da60 0x7f7084061c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7084142990 tx=0x7f7078010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7082ffd700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f708409da60 0x7f7084061c40 secure :-1 s=READY pgs=1162 cs=0 l=1 rx=0x7f7084142990 tx=0x7f7078010b10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:46.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7082ffd700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f708409da60 0x7f7084061c40 secure :-1 s=THROTTLE_DONE pgs=1162 cs=0 l=1 rx=0x7f7084142990 tx=0x7f7078010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7073fff700 1 -- 172.21.15.63:0/2357680797 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7078007180 con 0x7f708409da60 2020-05-18T21:35:46.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7083fff700 1 -- 172.21.15.63:0/2357680797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7084065b60 con 0x7f708409da60 2020-05-18T21:35:46.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7082ffd700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f708409da60 0x7f7084061c40 secure :-1 s=THROTTLE_DONE pgs=1162 cs=0 l=1 rx=0x7f7084142990 tx=0x7f7078010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7073fff700 1 -- 172.21.15.63:0/2357680797 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70780072e0 con 0x7f708409da60 2020-05-18T21:35:46.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7082ffd700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f708409da60 0x7f7084061c40 secure :-1 s=THROTTLE_DONE pgs=1162 cs=0 l=1 rx=0x7f7084142990 tx=0x7f7078010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7073fff700 1 -- 172.21.15.63:0/2357680797 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f707800e1a0 con 0x7f708409da60 2020-05-18T21:35:46.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.990+0000 7f7083fff700 1 -- 172.21.15.63:0/2357680797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7084060310 con 0x7f708409da60 2020-05-18T21:35:46.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.994+0000 7f7083fff700 1 -- 172.21.15.63:0/2357680797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70840569e0 con 0x7f708409da60 2020-05-18T21:35:46.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.994+0000 7f7082ffd700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f708409da60 0x7f7084061c40 secure :-1 s=THROTTLE_DONE pgs=1162 cs=0 l=1 rx=0x7f7084142990 tx=0x7f7078010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.994+0000 7f7073fff700 1 -- 172.21.15.63:0/2357680797 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f707800e460 con 0x7f708409da60 2020-05-18T21:35:46.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.994+0000 7f7082ffd700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f708409da60 0x7f7084061c40 secure :-1 s=THROTTLE_DONE pgs=1162 cs=0 l=1 rx=0x7f7084142990 tx=0x7f7078010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.994+0000 7f7073fff700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f706004f9b0 0x7f7060051e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:46.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.994+0000 7f7073fff700 1 -- 172.21.15.63:0/2357680797 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5425+0+0 (secure 0 0 0) 0x7f707800a0d0 con 0x7f708409da60 2020-05-18T21:35:46.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.994+0000 7f70827fc700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f706004f9b0 0x7f7060051e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:46.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.994+0000 7f70827fc700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f706004f9b0 0x7f7060051e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7074002f70 tx=0x7f7074007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.994+0000 7f70827fc700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f706004f9b0 0x7f7060051e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7074002f70 tx=0x7f7074007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:45.994+0000 7f70827fc700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f706004f9b0 0x7f7060051e70 secure :-1 s=READY pgs=683 cs=0 l=1 rx=0x7f7074002f70 tx=0x7f7074007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:46.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.002+0000 7f7082ffd700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f708409da60 0x7f7084061c40 secure :-1 s=THROTTLE_DONE pgs=1162 cs=0 l=1 rx=0x7f7084142990 tx=0x7f7078010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.002+0000 7f7073fff700 1 -- 172.21.15.63:0/2357680797 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f707803e160 con 0x7f708409da60 2020-05-18T21:35:46.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.130+0000 7f7083fff700 1 -- 172.21.15.63:0/2357680797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f7084140b50 con 0x7f708409da60 2020-05-18T21:35:46.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.810+0000 7f7082ffd700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f708409da60 0x7f7084061c40 secure :-1 s=THROTTLE_DONE pgs=1162 cs=0 l=1 rx=0x7f7084142990 tx=0x7f7078010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.810+0000 7f7073fff700 1 -- 172.21.15.63:0/2357680797 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v129) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7078041780 con 0x7f708409da60 2020-05-18T21:35:46.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.814+0000 7f7083fff700 1 -- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f706004f9b0 msgr2=0x7f7060051e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:46.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.814+0000 7f7083fff700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f706004f9b0 0x7f7060051e70 secure :-1 s=READY pgs=683 cs=0 l=1 rx=0x7f7074002f70 tx=0x7f7074007a80).stop 2020-05-18T21:35:46.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.814+0000 7f7083fff700 1 -- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f708409da60 msgr2=0x7f7084061c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:46.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.814+0000 7f7083fff700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f708409da60 0x7f7084061c40 secure :-1 s=READY pgs=1162 cs=0 l=1 rx=0x7f7084142990 tx=0x7f7078010b10).stop 2020-05-18T21:35:46.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.814+0000 7f7083fff700 1 -- 172.21.15.63:0/2357680797 shutdown_connections 2020-05-18T21:35:46.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.814+0000 7f7083fff700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f706004f9b0 0x7f7060051e70 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:46.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.814+0000 7f7083fff700 1 --2- 172.21.15.63:0/2357680797 >> v2:172.21.15.63:3300/0 conn(0x7f7084147190 0x7f708412ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:46.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.814+0000 7f7083fff700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7084141430 0x7f70840b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:46.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.814+0000 7f7083fff700 1 --2- 172.21.15.63:0/2357680797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f708409da60 0x7f7084061c40 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:46.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.814+0000 7f7083fff700 1 -- 172.21.15.63:0/2357680797 >> 172.21.15.63:0/2357680797 conn(0x7f708406a640 msgr2=0x7f7084145410 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:46.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.814+0000 7f7083fff700 1 -- 172.21.15.63:0/2357680797 shutdown_connections 2020-05-18T21:35:46.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.814+0000 7f7083fff700 1 -- 172.21.15.63:0/2357680797 wait complete. 2020-05-18T21:35:46.823 INFO:teuthology.orchestra.run.smithi063.stderr: removed all blacklist entries 2020-05-18T21:35:46.834 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-05-18T21:35:46.835 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-05-18T21:35:46.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1d14e4700 1 Processor -- start 2020-05-18T21:35:46.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1d14e4700 1 -- start start 2020-05-18T21:35:46.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1d14e4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff1cc0b2860 0x7ff1cc0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:46.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1d14e4700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc14d960 con 0x7ff1cc14e570 2020-05-18T21:35:46.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1d14e4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc14db90 con 0x7ff1cc060b90 2020-05-18T21:35:46.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1d14e4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1cc066210 con 0x7ff1cc0b2860 2020-05-18T21:35:46.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1ca7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff1cc0b2860 0x7ff1cc0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:46.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1ca7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff1cc0b2860 0x7ff1cc0615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34364/0 (socket says 172.21.15.63:34364) 2020-05-18T21:35:46.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1ca7fc700 1 -- 172.21.15.63:0/592443555 learned_addr learned my addr 172.21.15.63:0/592443555 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:46.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1cb7fe700 1 --1- 172.21.15.63:0/592443555 >> v1:172.21.15.63:6789/0 conn(0x7ff1cc14e570 0x7ff1cc14a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36554/0 (socket says 172.21.15.63:36554) 2020-05-18T21:35:46.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1ca7fc700 1 -- 172.21.15.63:0/592443555 >> v1:172.21.15.155:6789/0 conn(0x7ff1cc060b90 legacy=0x7ff1cc144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:46.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1ca7fc700 1 -- 172.21.15.63:0/592443555 >> v1:172.21.15.63:6789/0 conn(0x7ff1cc14e570 legacy=0x7ff1cc14a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:46.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1ca7fc700 1 -- 172.21.15.63:0/592443555 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc14de30 con 0x7ff1cc0b2860 2020-05-18T21:35:46.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1ca7fc700 1 --2- 172.21.15.63:0/592443555 >> v2:172.21.15.63:3300/0 conn(0x7ff1cc0b2860 0x7ff1cc0615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff1bc0032f0 tx=0x7ff1bc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1ca7fc700 1 --2- 172.21.15.63:0/592443555 >> v2:172.21.15.63:3300/0 conn(0x7ff1cc0b2860 0x7ff1cc0615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff1bc0032f0 tx=0x7ff1bc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1ca7fc700 1 --2- 172.21.15.63:0/592443555 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1cc0b2860 0x7ff1cc0615e0 secure :-1 s=READY pgs=1773 cs=0 l=1 rx=0x7ff1bc0032f0 tx=0x7ff1bc007e00).ready entity=mon.0 client_cookie=fa4a201a47deaa08 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:46.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1ca7fc700 1 --2- 172.21.15.63:0/592443555 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1cc0b2860 0x7ff1cc0615e0 secure :-1 s=THROTTLE_DONE pgs=1773 cs=0 l=1 rx=0x7ff1bc0032f0 tx=0x7ff1bc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1c9ffb700 1 -- 172.21.15.63:0/592443555 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1bc011dc0 con 0x7ff1cc0b2860 2020-05-18T21:35:46.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1ca7fc700 1 --2- 172.21.15.63:0/592443555 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1cc0b2860 0x7ff1cc0615e0 secure :-1 s=THROTTLE_DONE pgs=1773 cs=0 l=1 rx=0x7ff1bc0032f0 tx=0x7ff1bc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1ca7fc700 1 --2- 172.21.15.63:0/592443555 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1cc0b2860 0x7ff1cc0615e0 secure :-1 s=THROTTLE_DONE pgs=1773 cs=0 l=1 rx=0x7ff1bc0032f0 tx=0x7ff1bc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1c9ffb700 1 -- 172.21.15.63:0/592443555 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc00a180 con 0x7ff1cc0b2860 2020-05-18T21:35:46.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1c9ffb700 1 -- 172.21.15.63:0/592443555 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1bc00a5a0 con 0x7ff1cc0b2860 2020-05-18T21:35:46.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1d14e4700 1 -- 172.21.15.63:0/592443555 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1cc0b2860 msgr2=0x7ff1cc0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:46.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.934+0000 7ff1d14e4700 1 --2- 172.21.15.63:0/592443555 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1cc0b2860 0x7ff1cc0615e0 secure :-1 s=READY pgs=1773 cs=0 l=1 rx=0x7ff1bc0032f0 tx=0x7ff1bc007e00).stop 2020-05-18T21:35:46.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.938+0000 7ff1d14e4700 1 -- 172.21.15.63:0/592443555 shutdown_connections 2020-05-18T21:35:46.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.938+0000 7ff1d14e4700 1 --2- 172.21.15.63:0/592443555 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1cc0b2860 0x7ff1cc0615e0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:46.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.938+0000 7ff1d14e4700 1 -- 172.21.15.63:0/592443555 >> 172.21.15.63:0/592443555 conn(0x7ff1cc0b83d0 msgr2=0x7ff1cc0b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:46.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.938+0000 7ff1d14e4700 1 -- 172.21.15.63:0/592443555 shutdown_connections 2020-05-18T21:35:46.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.938+0000 7ff1d14e4700 1 -- 172.21.15.63:0/592443555 wait complete. 2020-05-18T21:35:46.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.938+0000 7ff1d14e4700 1 Processor -- start 2020-05-18T21:35:46.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.938+0000 7ff1d14e4700 1 -- start start 2020-05-18T21:35:46.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1d14e4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1cc0b2860 0x7ff1cc157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:46.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1d14e4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff1cc14e570 0x7ff1cc0ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:46.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1d14e4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc0accf0 con 0x7ff1cc060b90 2020-05-18T21:35:46.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1d14e4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1cc0acf90 con 0x7ff1cc14e570 2020-05-18T21:35:46.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1d14e4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1cc1489d0 con 0x7ff1cc0b2860 2020-05-18T21:35:46.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1cb7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff1cc14e570 0x7ff1cc0ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:46.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1ca7fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1cc0b2860 0x7ff1cc157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:46.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1ca7fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1cc0b2860 0x7ff1cc157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:49218/0 (socket says 172.21.15.63:49218) 2020-05-18T21:35:46.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1ca7fc700 1 -- 172.21.15.63:0/1604031232 learned_addr learned my addr 172.21.15.63:0/1604031232 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:46.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1caffd700 1 --1- 172.21.15.63:0/1604031232 >> v1:172.21.15.155:6789/0 conn(0x7ff1cc060b90 0x7ff1cc1361e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:34872/0 (socket says 172.21.15.63:34872) 2020-05-18T21:35:46.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1cb7fe700 1 -- 172.21.15.63:0/1604031232 >> v2:172.21.15.155:3300/0 conn(0x7ff1cc0b2860 msgr2=0x7ff1cc157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:46.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1cb7fe700 1 --2- 172.21.15.63:0/1604031232 >> v2:172.21.15.155:3300/0 conn(0x7ff1cc0b2860 0x7ff1cc157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:46.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1cb7fe700 1 -- 172.21.15.63:0/1604031232 >> v1:172.21.15.155:6789/0 conn(0x7ff1cc060b90 legacy=0x7ff1cc1361e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:46.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1cb7fe700 1 -- 172.21.15.63:0/1604031232 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc148b10 con 0x7ff1cc14e570 2020-05-18T21:35:46.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1cb7fe700 1 --2- 172.21.15.63:0/1604031232 >> v2:172.21.15.63:3300/0 conn(0x7ff1cc14e570 0x7ff1cc0ac4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff1cc067d20 tx=0x7ff1c4010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1cb7fe700 1 --2- 172.21.15.63:0/1604031232 >> v2:172.21.15.63:3300/0 conn(0x7ff1cc14e570 0x7ff1cc0ac4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff1cc067d20 tx=0x7ff1c4010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1cb7fe700 1 --2- 172.21.15.63:0/1604031232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1cc14e570 0x7ff1cc0ac4d0 secure :-1 s=READY pgs=1774 cs=0 l=1 rx=0x7ff1cc067d20 tx=0x7ff1c4010890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:46.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1cb7fe700 1 --2- 172.21.15.63:0/1604031232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1cc14e570 0x7ff1cc0ac4d0 secure :-1 s=THROTTLE_DONE pgs=1774 cs=0 l=1 rx=0x7ff1cc067d20 tx=0x7ff1c4010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1cb7fe700 1 --2- 172.21.15.63:0/1604031232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1cc14e570 0x7ff1cc0ac4d0 secure :-1 s=THROTTLE_DONE pgs=1774 cs=0 l=1 rx=0x7ff1cc067d20 tx=0x7ff1c4010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1cb7fe700 1 --2- 172.21.15.63:0/1604031232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1cc14e570 0x7ff1cc0ac4d0 secure :-1 s=THROTTLE_DONE pgs=1774 cs=0 l=1 rx=0x7ff1cc067d20 tx=0x7ff1c4010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1c3fff700 1 -- 172.21.15.63:0/1604031232 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1c40115a0 con 0x7ff1cc14e570 2020-05-18T21:35:46.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1c3fff700 1 -- 172.21.15.63:0/1604031232 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c4011740 con 0x7ff1cc14e570 2020-05-18T21:35:46.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1d14e4700 1 -- 172.21.15.63:0/1604031232 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1cc1368f0 con 0x7ff1cc14e570 2020-05-18T21:35:46.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1c3fff700 1 -- 172.21.15.63:0/1604031232 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1c4011b60 con 0x7ff1cc14e570 2020-05-18T21:35:46.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.942+0000 7ff1d14e4700 1 -- 172.21.15.63:0/1604031232 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1cc136ba0 con 0x7ff1cc14e570 2020-05-18T21:35:46.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.946+0000 7ff1cb7fe700 1 --2- 172.21.15.63:0/1604031232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1cc14e570 0x7ff1cc0ac4d0 secure :-1 s=THROTTLE_DONE pgs=1774 cs=0 l=1 rx=0x7ff1cc067d20 tx=0x7ff1c4010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.946+0000 7ff1d14e4700 1 -- 172.21.15.63:0/1604031232 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1cc0569e0 con 0x7ff1cc14e570 2020-05-18T21:35:46.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.946+0000 7ff1c3fff700 1 -- 172.21.15.63:0/1604031232 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff1c400b370 con 0x7ff1cc14e570 2020-05-18T21:35:46.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.946+0000 7ff1cb7fe700 1 --2- 172.21.15.63:0/1604031232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1cc14e570 0x7ff1cc0ac4d0 secure :-1 s=THROTTLE_DONE pgs=1774 cs=0 l=1 rx=0x7ff1cc067d20 tx=0x7ff1c4010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.946+0000 7ff1c3fff700 1 --2- 172.21.15.63:0/1604031232 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff1b004f9b0 0x7ff1b0051e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:46.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.946+0000 7ff1c3fff700 1 -- 172.21.15.63:0/1604031232 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff1c4063b70 con 0x7ff1cc14e570 2020-05-18T21:35:46.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.946+0000 7ff1caffd700 1 --2- 172.21.15.63:0/1604031232 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff1b004f9b0 0x7ff1b0051e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:46.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.946+0000 7ff1caffd700 1 --2- 172.21.15.63:0/1604031232 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff1b004f9b0 0x7ff1b0051e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff1cc149450 tx=0x7ff1b4001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.946+0000 7ff1caffd700 1 --2- 172.21.15.63:0/1604031232 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff1b004f9b0 0x7ff1b0051e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff1cc149450 tx=0x7ff1b4001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.946+0000 7ff1caffd700 1 --2- 172.21.15.63:0/1604031232 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff1b004f9b0 0x7ff1b0051e70 secure :-1 s=READY pgs=684 cs=0 l=1 rx=0x7ff1cc149450 tx=0x7ff1b4001590).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:46.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.950+0000 7ff1cb7fe700 1 --2- 172.21.15.63:0/1604031232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1cc14e570 0x7ff1cc0ac4d0 secure :-1 s=THROTTLE_DONE pgs=1774 cs=0 l=1 rx=0x7ff1cc067d20 tx=0x7ff1c4010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:46.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:46.950+0000 7ff1c3fff700 1 -- 172.21.15.63:0/1604031232 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff1c403dea0 con 0x7ff1cc14e570 2020-05-18T21:35:47.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.110+0000 7ff1d14e4700 1 -- 172.21.15.63:0/1604031232 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff1cc148b10 con 0x7ff1cc14e570 2020-05-18T21:35:47.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.110+0000 7ff1cb7fe700 1 --2- 172.21.15.63:0/1604031232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1cc14e570 0x7ff1cc0ac4d0 secure :-1 s=THROTTLE_DONE pgs=1774 cs=0 l=1 rx=0x7ff1cc067d20 tx=0x7ff1c4010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.110+0000 7ff1c3fff700 1 -- 172.21.15.63:0/1604031232 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v50) v1 ==== 80+0+4513 (secure 0 0 0) 0x7ff1cc148b10 con 0x7ff1cc14e570 2020-05-18T21:35:47.116 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:47.116 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:35:47.116 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_dump": [ 2020-05-18T21:35:47.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.a", 2020-05-18T21:35:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJekJyyLRAAfB5XJCsXTAmZdkFOaQrokg==", 2020-05-18T21:35:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:35:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:35:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:35:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:35:47.118 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:35:47.118 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:47.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:47.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:47.118 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.b", 2020-05-18T21:35:47.119 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeSVE8MRAAEEytuzLtcQMC+1uQ/yh8eA==", 2020-05-18T21:35:47.119 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:35:47.120 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:35:47.120 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:35:47.120 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:35:47.120 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:35:47.121 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:47.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:47.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:47.121 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.0", 2020-05-18T21:35:47.121 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBq/cJeIn7mJhAArx+YEdVbsfXXNOLWdaAgWw==", 2020-05-18T21:35:47.122 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:35:47.122 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:35:47.122 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:35:47.122 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:35:47.122 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:47.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:47.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:47.123 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.1", 2020-05-18T21:35:47.123 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBt/cJelHywCRAAFyQ3sPEE0RTSy4tKfsDfyw==", 2020-05-18T21:35:47.123 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:35:47.123 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:35:47.124 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:35:47.124 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:35:47.124 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:47.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:47.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:47.125 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.2", 2020-05-18T21:35:47.125 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBv/cJecexDLBAAxhlFq20MBkKvDjuM1yi8XQ==", 2020-05-18T21:35:47.125 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:35:47.125 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:35:47.125 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:35:47.125 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:35:47.126 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:47.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:47.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:47.126 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.3", 2020-05-18T21:35:47.126 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBy/cJe9IqwDxAAMg1In7bIITDcOZljzzTpDQ==", 2020-05-18T21:35:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:35:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:35:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:35:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:35:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:47.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:47.128 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.4", 2020-05-18T21:35:47.128 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB3/cJeLXgxFhAA/kMVV5hCRny2uXKvvbu8Og==", 2020-05-18T21:35:47.128 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:35:47.128 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:35:47.129 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:35:47.129 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:35:47.129 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:47.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:47.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:47.131 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.5", 2020-05-18T21:35:47.131 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB5/cJeucpsNRAAjGh+6yUC8Fji9PE4COi/Eg==", 2020-05-18T21:35:47.131 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:35:47.131 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:35:47.132 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:35:47.132 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:35:47.132 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:47.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:47.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:47.132 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.6", 2020-05-18T21:35:47.133 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB8/cJelSPpGhAAXobGqH9qaW1VZfEpH8bUbQ==", 2020-05-18T21:35:47.133 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:35:47.133 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:35:47.133 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:35:47.141 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:35:47.142 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:47.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:47.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:47.142 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.7", 2020-05-18T21:35:47.143 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB+/cJeUIl5OBAAPd8H8ohOWZw9ubO7uCB6zg==", 2020-05-18T21:35:47.143 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:35:47.143 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:35:47.143 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:35:47.143 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:35:47.143 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:47.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:47.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:47.144 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.0", 2020-05-18T21:35:47.144 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeap3RNhAAi2vKpsKtzSL1Uuqm8pWYJQ==", 2020-05-18T21:35:47.144 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:35:47.145 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:35:47.145 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:35:47.145 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:35:47.145 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:47.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:47.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:47.146 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.1", 2020-05-18T21:35:47.146 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJeekrQABAA5TmzWOt24C6hgZw/WTj5dw==", 2020-05-18T21:35:47.146 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:35:47.146 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:35:47.147 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:35:47.147 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:35:47.147 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:47.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:47.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:47.147 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.2", 2020-05-18T21:35:47.148 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJehSnFAxAAXUZwqNTXqAApEB3nXs4u6g==", 2020-05-18T21:35:47.148 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:35:47.148 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:35:47.148 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:35:47.148 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:35:47.149 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:47.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:47.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:47.149 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.3", 2020-05-18T21:35:47.149 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJe2HdDBhAA07y5pn/bKKa9TBbZFvIh9g==", 2020-05-18T21:35:47.150 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:35:47.150 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:35:47.150 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:35:47.150 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:35:47.151 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:47.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:47.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:47.151 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.admin", 2020-05-18T21:35:47.152 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJe/K4fGRAA+rP3BYuWiyx/fKmQ3bV6Lw==", 2020-05-18T21:35:47.152 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:35:47.152 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:35:47.153 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:35:47.153 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:35:47.153 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:35:47.153 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:47.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:47.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:47.154 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.x", 2020-05-18T21:35:47.160 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJemmqEKhAAe5ySRz8Id0ug4matQwL0uw==", 2020-05-18T21:35:47.160 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:35:47.160 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:35:47.160 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:35:47.160 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:35:47.161 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:47.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:47.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:47.161 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.y", 2020-05-18T21:35:47.161 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeF/BNJhAAi/vrldC6qoWJWnSHpE3ung==", 2020-05-18T21:35:47.167 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:35:47.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:35:47.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:35:47.167 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:35:47.167 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:47.168 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:47.168 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:35:47.168 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:35:47.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.114+0000 7ff1d14e4700 1 -- 172.21.15.63:0/1604031232 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff1b004f9b0 msgr2=0x7ff1b0051e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.114+0000 7ff1d14e4700 1 --2- 172.21.15.63:0/1604031232 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff1b004f9b0 0x7ff1b0051e70 secure :-1 s=READY pgs=684 cs=0 l=1 rx=0x7ff1cc149450 tx=0x7ff1b4001590).stop 2020-05-18T21:35:47.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.114+0000 7ff1d14e4700 1 -- 172.21.15.63:0/1604031232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1cc14e570 msgr2=0x7ff1cc0ac4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.114+0000 7ff1d14e4700 1 --2- 172.21.15.63:0/1604031232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1cc14e570 0x7ff1cc0ac4d0 secure :-1 s=READY pgs=1774 cs=0 l=1 rx=0x7ff1cc067d20 tx=0x7ff1c4010890).stop 2020-05-18T21:35:47.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.114+0000 7ff1d14e4700 1 -- 172.21.15.63:0/1604031232 shutdown_connections 2020-05-18T21:35:47.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.114+0000 7ff1d14e4700 1 --2- 172.21.15.63:0/1604031232 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff1b004f9b0 0x7ff1b0051e70 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:47.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.114+0000 7ff1d14e4700 1 --2- 172.21.15.63:0/1604031232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1cc14e570 0x7ff1cc0ac4d0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:47.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.114+0000 7ff1d14e4700 1 --2- 172.21.15.63:0/1604031232 >> v2:172.21.15.155:3300/0 conn(0x7ff1cc0b2860 0x7ff1cc157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:47.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.114+0000 7ff1d14e4700 1 -- 172.21.15.63:0/1604031232 >> 172.21.15.63:0/1604031232 conn(0x7ff1cc0b83d0 msgr2=0x7ff1cc069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:47.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.114+0000 7ff1d14e4700 1 -- 172.21.15.63:0/1604031232 shutdown_connections 2020-05-18T21:35:47.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.114+0000 7ff1d14e4700 1 -- 172.21.15.63:0/1604031232 wait complete. 2020-05-18T21:35:47.177 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:35:47.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.282+0000 7fe8d57ed700 1 Processor -- start 2020-05-18T21:35:47.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.282+0000 7fe8d57ed700 1 -- start start 2020-05-18T21:35:47.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.282+0000 7fe8d57ed700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe8d005f110 0x7fe8d00b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:47.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.282+0000 7fe8d57ed700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d014a330 con 0x7fe8d014aa70 2020-05-18T21:35:47.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.282+0000 7fe8d57ed700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d014a5d0 con 0x7fe8d0064fd0 2020-05-18T21:35:47.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.282+0000 7fe8d57ed700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d014a140 con 0x7fe8d005f110 2020-05-18T21:35:47.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.282+0000 7fe8cf7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe8d014aa70 0x7fe8d00648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36564/0 (socket says 172.21.15.63:36564) 2020-05-18T21:35:47.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.282+0000 7fe8cf7fe700 1 -- 172.21.15.63:0/2882219985 learned_addr learned my addr 172.21.15.63:0/2882219985 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:47.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.282+0000 7fe8cffff700 1 --2- 172.21.15.63:0/2882219985 >> v2:172.21.15.155:3300/0 conn(0x7fe8d005f110 0x7fe8d00b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:47.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.282+0000 7fe8ceffd700 1 -- 172.21.15.63:0/2882219985 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881271354 0 0) 0x7fe8d014a330 con 0x7fe8d014aa70 2020-05-18T21:35:47.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.282+0000 7fe8ceffd700 1 -- 172.21.15.63:0/2882219985 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8bc003270 con 0x7fe8d014aa70 2020-05-18T21:35:47.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.282+0000 7fe8ceffd700 1 -- 172.21.15.63:0/2882219985 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2112171279 0 0) 0x7fe8bc003270 con 0x7fe8d014aa70 2020-05-18T21:35:47.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.282+0000 7fe8ceffd700 1 -- 172.21.15.63:0/2882219985 >> v2:172.21.15.155:3300/0 conn(0x7fe8d005f110 msgr2=0x7fe8d00b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:47.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.282+0000 7fe8ceffd700 1 --2- 172.21.15.63:0/2882219985 >> v2:172.21.15.155:3300/0 conn(0x7fe8d005f110 0x7fe8d00b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:47.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.282+0000 7fe8ceffd700 1 -- 172.21.15.63:0/2882219985 >> v1:172.21.15.155:6789/0 conn(0x7fe8d0064fd0 legacy=0x7fe8d014d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.282+0000 7fe8ceffd700 1 -- 172.21.15.63:0/2882219985 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d0063430 con 0x7fe8d014aa70 2020-05-18T21:35:47.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8ceffd700 1 -- 172.21.15.63:0/2882219985 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fe8c0001710 con 0x7fe8d014aa70 2020-05-18T21:35:47.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8ceffd700 1 -- 172.21.15.63:0/2882219985 >> v1:172.21.15.63:6789/0 conn(0x7fe8d014aa70 legacy=0x7fe8d00648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8ceffd700 1 --2- 172.21.15.63:0/2882219985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8bc003760 0x7fe8bc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:47.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8ceffd700 1 --2- 172.21.15.63:0/2882219985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8bc004060 0x7fe8bc004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:47.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8ceffd700 1 --2- 172.21.15.63:0/2882219985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8bc004aa0 0x7fe8bc004f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:47.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8ceffd700 1 -- 172.21.15.63:0/2882219985 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc00b840 con 0x7fe8bc004aa0 2020-05-18T21:35:47.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8ceffd700 1 -- 172.21.15.63:0/2882219985 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc00b9b0 con 0x7fe8bc004060 2020-05-18T21:35:47.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8ceffd700 1 -- 172.21.15.63:0/2882219985 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc00bb70 con 0x7fe8bc003760 2020-05-18T21:35:47.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8cf7fe700 1 --2- 172.21.15.63:0/2882219985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8bc004060 0x7fe8bc004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:47.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8d4fec700 1 --2- 172.21.15.63:0/2882219985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8bc004aa0 0x7fe8bc004f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:47.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8cffff700 1 --2- 172.21.15.63:0/2882219985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8bc003760 0x7fe8bc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:47.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8cf7fe700 1 -- 172.21.15.63:0/2882219985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8bc003760 msgr2=0x7fe8bc003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:47.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8cf7fe700 1 --2- 172.21.15.63:0/2882219985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8bc003760 0x7fe8bc003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:47.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8cf7fe700 1 -- 172.21.15.63:0/2882219985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8bc004aa0 msgr2=0x7fe8bc004f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:47.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8cf7fe700 1 --2- 172.21.15.63:0/2882219985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8bc004aa0 0x7fe8bc004f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:47.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8d4fec700 1 -- 172.21.15.63:0/2882219985 reap_dead start 2020-05-18T21:35:47.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8cf7fe700 1 -- 172.21.15.63:0/2882219985 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc003270 con 0x7fe8bc004060 2020-05-18T21:35:47.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8cf7fe700 1 --2- 172.21.15.63:0/2882219985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8bc004060 0x7fe8bc004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe8c0001420 tx=0x7fe8d00635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8cf7fe700 1 --2- 172.21.15.63:0/2882219985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8bc004060 0x7fe8bc004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe8c0001420 tx=0x7fe8d00635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8cf7fe700 1 --2- 172.21.15.63:0/2882219985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8bc004060 0x7fe8bc004530 secure :-1 s=READY pgs=1166 cs=0 l=1 rx=0x7fe8c0001420 tx=0x7fe8d00635c0).ready entity=mon.1 client_cookie=ce1f1313fbc223b3 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:47.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8cf7fe700 1 --2- 172.21.15.63:0/2882219985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8bc004060 0x7fe8bc004530 secure :-1 s=THROTTLE_DONE pgs=1166 cs=0 l=1 rx=0x7fe8c0001420 tx=0x7fe8d00635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8ceffd700 1 -- 172.21.15.63:0/2882219985 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8c000ce20 con 0x7fe8bc004060 2020-05-18T21:35:47.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8cf7fe700 1 --2- 172.21.15.63:0/2882219985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8bc004060 0x7fe8bc004530 secure :-1 s=THROTTLE_DONE pgs=1166 cs=0 l=1 rx=0x7fe8c0001420 tx=0x7fe8d00635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8ceffd700 1 -- 172.21.15.63:0/2882219985 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c000e370 con 0x7fe8bc004060 2020-05-18T21:35:47.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8cf7fe700 1 --2- 172.21.15.63:0/2882219985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8bc004060 0x7fe8bc004530 secure :-1 s=THROTTLE_DONE pgs=1166 cs=0 l=1 rx=0x7fe8c0001420 tx=0x7fe8d00635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8ceffd700 1 -- 172.21.15.63:0/2882219985 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8c000e710 con 0x7fe8bc004060 2020-05-18T21:35:47.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8d57ed700 1 -- 172.21.15.63:0/2882219985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8bc004060 msgr2=0x7fe8bc004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8d57ed700 1 --2- 172.21.15.63:0/2882219985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8bc004060 0x7fe8bc004530 secure :-1 s=READY pgs=1166 cs=0 l=1 rx=0x7fe8c0001420 tx=0x7fe8d00635c0).stop 2020-05-18T21:35:47.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8d57ed700 1 -- 172.21.15.63:0/2882219985 shutdown_connections 2020-05-18T21:35:47.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8d57ed700 1 --2- 172.21.15.63:0/2882219985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8bc004060 0x7fe8bc004530 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:47.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8d57ed700 1 -- 172.21.15.63:0/2882219985 >> 172.21.15.63:0/2882219985 conn(0x7fe8d0069fc0 msgr2=0x7fe8d006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:47.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8d57ed700 1 -- 172.21.15.63:0/2882219985 shutdown_connections 2020-05-18T21:35:47.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.286+0000 7fe8d57ed700 1 -- 172.21.15.63:0/2882219985 wait complete. 2020-05-18T21:35:47.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.290+0000 7fe8d57ed700 1 Processor -- start 2020-05-18T21:35:47.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.290+0000 7fe8d57ed700 1 -- start start 2020-05-18T21:35:47.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.290+0000 7fe8d57ed700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe8bc004060 0x7fe8d014df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:47.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.290+0000 7fe8d57ed700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8d0142420 0x7fe8d014d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:47.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.290+0000 7fe8d57ed700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d0142880 con 0x7fe8d0140630 2020-05-18T21:35:47.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.290+0000 7fe8d57ed700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d014d910 con 0x7fe8bc004060 2020-05-18T21:35:47.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.290+0000 7fe8d57ed700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d0144790 con 0x7fe8d0142420 2020-05-18T21:35:47.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.290+0000 7fe8cffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe8bc004060 0x7fe8d014df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:47.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.290+0000 7fe8cffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe8bc004060 0x7fe8d014df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34388/0 (socket says 172.21.15.63:34388) 2020-05-18T21:35:47.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.290+0000 7fe8cffff700 1 -- 172.21.15.63:0/2295249860 learned_addr learned my addr 172.21.15.63:0/2295249860 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:47.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cf7fe700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8d0142420 0x7fe8d014d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:47.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cffff700 1 -- 172.21.15.63:0/2295249860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8d0142420 msgr2=0x7fe8d014d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cffff700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8d0142420 0x7fe8d014d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:47.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cffff700 1 -- 172.21.15.63:0/2295249860 >> v1:172.21.15.155:6789/0 conn(0x7fe8d0140630 legacy=0x7fe8d015a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cffff700 1 -- 172.21.15.63:0/2295249860 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d0144a30 con 0x7fe8bc004060 2020-05-18T21:35:47.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cffff700 1 --2- 172.21.15.63:0/2295249860 >> v2:172.21.15.63:3300/0 conn(0x7fe8bc004060 0x7fe8d014df30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe8d014c740 tx=0x7fe8c4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cffff700 1 --2- 172.21.15.63:0/2295249860 >> v2:172.21.15.63:3300/0 conn(0x7fe8bc004060 0x7fe8d014df30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe8d014c740 tx=0x7fe8c4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cffff700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8bc004060 0x7fe8d014df30 secure :-1 s=READY pgs=1776 cs=0 l=1 rx=0x7fe8d014c740 tx=0x7fe8c4010da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:47.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cffff700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8bc004060 0x7fe8d014df30 secure :-1 s=THROTTLE_DONE pgs=1776 cs=0 l=1 rx=0x7fe8d014c740 tx=0x7fe8c4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cffff700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8bc004060 0x7fe8d014df30 secure :-1 s=THROTTLE_DONE pgs=1776 cs=0 l=1 rx=0x7fe8d014c740 tx=0x7fe8c4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cffff700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8bc004060 0x7fe8d014df30 secure :-1 s=THROTTLE_DONE pgs=1776 cs=0 l=1 rx=0x7fe8d014c740 tx=0x7fe8c4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cd7fa700 1 -- 172.21.15.63:0/2295249860 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8c4012c50 con 0x7fe8bc004060 2020-05-18T21:35:47.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cd7fa700 1 -- 172.21.15.63:0/2295249860 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c4012db0 con 0x7fe8bc004060 2020-05-18T21:35:47.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cd7fa700 1 -- 172.21.15.63:0/2295249860 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8c40058f0 con 0x7fe8bc004060 2020-05-18T21:35:47.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8d57ed700 1 -- 172.21.15.63:0/2295249860 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d014d5f0 con 0x7fe8bc004060 2020-05-18T21:35:47.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8d57ed700 1 -- 172.21.15.63:0/2295249860 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d0146100 con 0x7fe8bc004060 2020-05-18T21:35:47.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cffff700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8bc004060 0x7fe8d014df30 secure :-1 s=THROTTLE_DONE pgs=1776 cs=0 l=1 rx=0x7fe8d014c740 tx=0x7fe8c4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8d57ed700 1 -- 172.21.15.63:0/2295249860 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d00569e0 con 0x7fe8bc004060 2020-05-18T21:35:47.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cd7fa700 1 -- 172.21.15.63:0/2295249860 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe8c4005b60 con 0x7fe8bc004060 2020-05-18T21:35:47.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cffff700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8bc004060 0x7fe8d014df30 secure :-1 s=THROTTLE_DONE pgs=1776 cs=0 l=1 rx=0x7fe8d014c740 tx=0x7fe8c4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cd7fa700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe8b004fa20 0x7fe8b0051ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:47.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cd7fa700 1 -- 172.21.15.63:0/2295249860 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe8c40640d0 con 0x7fe8bc004060 2020-05-18T21:35:47.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cf7fe700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe8b004fa20 0x7fe8b0051ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:47.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cf7fe700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe8b004fa20 0x7fe8b0051ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe8c0001420 tx=0x7fe8d00635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cf7fe700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe8b004fa20 0x7fe8b0051ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe8c0001420 tx=0x7fe8d00635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.294+0000 7fe8cf7fe700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe8b004fa20 0x7fe8b0051ee0 secure :-1 s=READY pgs=685 cs=0 l=1 rx=0x7fe8c0001420 tx=0x7fe8d00635c0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:47.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.298+0000 7fe8cffff700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8bc004060 0x7fe8d014df30 secure :-1 s=THROTTLE_DONE pgs=1776 cs=0 l=1 rx=0x7fe8d014c740 tx=0x7fe8c4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.298+0000 7fe8cd7fa700 1 -- 172.21.15.63:0/2295249860 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe8c403e400 con 0x7fe8bc004060 2020-05-18T21:35:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.414+0000 7fe8d57ed700 1 -- 172.21.15.63:0/2295249860 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8d014d780 con 0x7fe8bc004060 2020-05-18T21:35:47.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.418+0000 7fe8cffff700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8bc004060 0x7fe8d014df30 secure :-1 s=THROTTLE_DONE pgs=1776 cs=0 l=1 rx=0x7fe8d014c740 tx=0x7fe8c4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.418+0000 7fe8cd7fa700 1 -- 172.21.15.63:0/2295249860 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+13242 (secure 0 0 0) 0x7fe8c4041a20 con 0x7fe8bc004060 2020-05-18T21:35:47.423 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:47.423 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":129,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:35:46.806091+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:35:47.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.418+0000 7fe8d57ed700 1 -- 172.21.15.63:0/2295249860 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe8b004fa20 msgr2=0x7fe8b0051ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.418+0000 7fe8d57ed700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe8b004fa20 0x7fe8b0051ee0 secure :-1 s=READY pgs=685 cs=0 l=1 rx=0x7fe8c0001420 tx=0x7fe8d00635c0).stop 2020-05-18T21:35:47.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.418+0000 7fe8d57ed700 1 -- 172.21.15.63:0/2295249860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8bc004060 msgr2=0x7fe8d014df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.418+0000 7fe8d57ed700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8bc004060 0x7fe8d014df30 secure :-1 s=READY pgs=1776 cs=0 l=1 rx=0x7fe8d014c740 tx=0x7fe8c4010da0).stop 2020-05-18T21:35:47.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.418+0000 7fe8d57ed700 1 -- 172.21.15.63:0/2295249860 shutdown_connections 2020-05-18T21:35:47.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.418+0000 7fe8d57ed700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe8b004fa20 0x7fe8b0051ee0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:47.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.418+0000 7fe8d57ed700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8d0142420 0x7fe8d014d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:47.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.418+0000 7fe8d57ed700 1 --2- 172.21.15.63:0/2295249860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8bc004060 0x7fe8d014df30 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:47.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.418+0000 7fe8d57ed700 1 -- 172.21.15.63:0/2295249860 >> 172.21.15.63:0/2295249860 conn(0x7fe8d0069fc0 msgr2=0x7fe8d005c280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:47.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.418+0000 7fe8d57ed700 1 -- 172.21.15.63:0/2295249860 shutdown_connections 2020-05-18T21:35:47.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.418+0000 7fe8d57ed700 1 -- 172.21.15.63:0/2295249860 wait complete. 2020-05-18T21:35:47.437 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-05-18T21:35:47.437 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:35:47.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.542+0000 7f490e495700 1 Processor -- start 2020-05-18T21:35:47.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.542+0000 7f490e495700 1 -- start start 2020-05-18T21:35:47.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.542+0000 7f490e495700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4908143630 0x7f4908060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:47.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.542+0000 7f490e495700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4908145e30 0x7f490812e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:47.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.542+0000 7f490e495700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4908146420 con 0x7f49080bc8d0 2020-05-18T21:35:47.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.542+0000 7f490e495700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4908146e00 con 0x7f4908143630 2020-05-18T21:35:47.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.542+0000 7f490e495700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49081466c0 con 0x7f4908145e30 2020-05-18T21:35:47.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.542+0000 7f490cc92700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4908143630 0x7f4908060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:47.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.542+0000 7f490cc92700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4908143630 0x7f4908060b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34398/0 (socket says 172.21.15.63:34398) 2020-05-18T21:35:47.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.542+0000 7f490cc92700 1 -- 172.21.15.63:0/831914738 learned_addr learned my addr 172.21.15.63:0/831914738 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:47.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.542+0000 7f490dc94700 1 --2- 172.21.15.63:0/831914738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4908145e30 0x7f490812e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:47.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.542+0000 7f490cc92700 1 -- 172.21.15.63:0/831914738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4908145e30 msgr2=0x7f490812e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:47.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.542+0000 7f490cc92700 1 --2- 172.21.15.63:0/831914738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4908145e30 0x7f490812e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:47.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.542+0000 7f490cc92700 1 -- 172.21.15.63:0/831914738 >> v1:172.21.15.155:6789/0 conn(0x7f49080bc8d0 legacy=0x7f4908142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.542+0000 7f490cc92700 1 -- 172.21.15.63:0/831914738 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4908146960 con 0x7f4908143630 2020-05-18T21:35:47.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.542+0000 7f490dc94700 1 --2- 172.21.15.63:0/831914738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4908145e30 0x7f490812e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:35:47.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490cc92700 1 --2- 172.21.15.63:0/831914738 >> v2:172.21.15.63:3300/0 conn(0x7f4908143630 0x7f4908060b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4904002f70 tx=0x7f4908061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490cc92700 1 --2- 172.21.15.63:0/831914738 >> v2:172.21.15.63:3300/0 conn(0x7f4908143630 0x7f4908060b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4904002f70 tx=0x7f4908061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490cc92700 1 --2- 172.21.15.63:0/831914738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4908143630 0x7f4908060b00 secure :-1 s=READY pgs=1777 cs=0 l=1 rx=0x7f4904002f70 tx=0x7f4908061d60).ready entity=mon.0 client_cookie=c131844e2f077f34 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:47.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490cc92700 1 --2- 172.21.15.63:0/831914738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4908143630 0x7f4908060b00 secure :-1 s=THROTTLE_DONE pgs=1777 cs=0 l=1 rx=0x7f4904002f70 tx=0x7f4908061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f48fffff700 1 -- 172.21.15.63:0/831914738 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4904011760 con 0x7f4908143630 2020-05-18T21:35:47.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490cc92700 1 --2- 172.21.15.63:0/831914738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4908143630 0x7f4908060b00 secure :-1 s=THROTTLE_DONE pgs=1777 cs=0 l=1 rx=0x7f4904002f70 tx=0x7f4908061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490cc92700 1 --2- 172.21.15.63:0/831914738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4908143630 0x7f4908060b00 secure :-1 s=THROTTLE_DONE pgs=1777 cs=0 l=1 rx=0x7f4904002f70 tx=0x7f4908061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f48fffff700 1 -- 172.21.15.63:0/831914738 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49040118c0 con 0x7f4908143630 2020-05-18T21:35:47.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f48fffff700 1 -- 172.21.15.63:0/831914738 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4904011ce0 con 0x7f4908143630 2020-05-18T21:35:47.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490e495700 1 -- 172.21.15.63:0/831914738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4908143630 msgr2=0x7f4908060b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490e495700 1 --2- 172.21.15.63:0/831914738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4908143630 0x7f4908060b00 secure :-1 s=READY pgs=1777 cs=0 l=1 rx=0x7f4904002f70 tx=0x7f4908061d60).stop 2020-05-18T21:35:47.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490e495700 1 -- 172.21.15.63:0/831914738 shutdown_connections 2020-05-18T21:35:47.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490e495700 1 --2- 172.21.15.63:0/831914738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4908145e30 0x7f490812e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:47.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490e495700 1 --2- 172.21.15.63:0/831914738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4908143630 0x7f4908060b00 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:47.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490e495700 1 -- 172.21.15.63:0/831914738 >> 172.21.15.63:0/831914738 conn(0x7f490805f3b0 msgr2=0x7f490805f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:47.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490e495700 1 -- 172.21.15.63:0/831914738 shutdown_connections 2020-05-18T21:35:47.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490e495700 1 -- 172.21.15.63:0/831914738 wait complete. 2020-05-18T21:35:47.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490e495700 1 Processor -- start 2020-05-18T21:35:47.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490e495700 1 -- start start 2020-05-18T21:35:47.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490e495700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f49080bc8d0 0x7f4908145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:47.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490e495700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4908143630 0x7f49080bbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:47.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490e495700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49080bc130 con 0x7f4908145e30 2020-05-18T21:35:47.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490e495700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4908144d70 con 0x7f4908143630 2020-05-18T21:35:47.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490e495700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4908156ab0 con 0x7f49080bc8d0 2020-05-18T21:35:47.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490dc94700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4908145e30 0x7f4908153360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36594/0 (socket says 172.21.15.63:36594) 2020-05-18T21:35:47.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490cc92700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4908143630 0x7f49080bbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:47.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490dc94700 1 -- 172.21.15.63:0/716460912 learned_addr learned my addr 172.21.15.63:0/716460912 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:47.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f490d493700 1 --2- 172.21.15.63:0/716460912 >> v2:172.21.15.155:3300/0 conn(0x7f49080bc8d0 0x7f4908145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:47.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f48fe7fc700 1 -- 172.21.15.63:0/716460912 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050492596 0 0) 0x7f49080bc130 con 0x7f4908145e30 2020-05-18T21:35:47.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.546+0000 7f48fe7fc700 1 -- 172.21.15.63:0/716460912 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48f0002fe0 con 0x7f4908145e30 2020-05-18T21:35:47.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f490cc92700 1 -- 172.21.15.63:0/716460912 >> v2:172.21.15.155:3300/0 conn(0x7f49080bc8d0 msgr2=0x7f4908145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f490cc92700 1 --2- 172.21.15.63:0/716460912 >> v2:172.21.15.155:3300/0 conn(0x7f49080bc8d0 0x7f4908145760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:47.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f490cc92700 1 -- 172.21.15.63:0/716460912 >> v1:172.21.15.63:6789/0 conn(0x7f4908145e30 legacy=0x7f4908153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f490cc92700 1 -- 172.21.15.63:0/716460912 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4908153a70 con 0x7f4908143630 2020-05-18T21:35:47.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f490cc92700 1 --2- 172.21.15.63:0/716460912 >> v2:172.21.15.63:3300/0 conn(0x7f4908143630 0x7f49080bbcd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4904002f70 tx=0x7f4908061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f490cc92700 1 --2- 172.21.15.63:0/716460912 >> v2:172.21.15.63:3300/0 conn(0x7f4908143630 0x7f49080bbcd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4904002f70 tx=0x7f4908061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f490cc92700 1 --2- 172.21.15.63:0/716460912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4908143630 0x7f49080bbcd0 secure :-1 s=READY pgs=1779 cs=0 l=1 rx=0x7f4904002f70 tx=0x7f4908061d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:47.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f490cc92700 1 --2- 172.21.15.63:0/716460912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4908143630 0x7f49080bbcd0 secure :-1 s=THROTTLE_DONE pgs=1779 cs=0 l=1 rx=0x7f4904002f70 tx=0x7f4908061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f490cc92700 1 --2- 172.21.15.63:0/716460912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4908143630 0x7f49080bbcd0 secure :-1 s=THROTTLE_DONE pgs=1779 cs=0 l=1 rx=0x7f4904002f70 tx=0x7f4908061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f48fe7fc700 1 -- 172.21.15.63:0/716460912 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4904010320 con 0x7f4908143630 2020-05-18T21:35:47.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f490cc92700 1 --2- 172.21.15.63:0/716460912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4908143630 0x7f49080bbcd0 secure :-1 s=THROTTLE_DONE pgs=1779 cs=0 l=1 rx=0x7f4904002f70 tx=0x7f4908061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f48fe7fc700 1 -- 172.21.15.63:0/716460912 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4904007170 con 0x7f4908143630 2020-05-18T21:35:47.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f490e495700 1 -- 172.21.15.63:0/716460912 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49081448d0 con 0x7f4908143630 2020-05-18T21:35:47.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f48fe7fc700 1 -- 172.21.15.63:0/716460912 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4904007550 con 0x7f4908143630 2020-05-18T21:35:47.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f490e495700 1 -- 172.21.15.63:0/716460912 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4908157170 con 0x7f4908143630 2020-05-18T21:35:47.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f490cc92700 1 --2- 172.21.15.63:0/716460912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4908143630 0x7f49080bbcd0 secure :-1 s=THROTTLE_DONE pgs=1779 cs=0 l=1 rx=0x7f4904002f70 tx=0x7f4908061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f490e495700 1 -- 172.21.15.63:0/716460912 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4908144bb0 con 0x7f4908143630 2020-05-18T21:35:47.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f48fe7fc700 1 -- 172.21.15.63:0/716460912 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4904005700 con 0x7f4908143630 2020-05-18T21:35:47.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f490cc92700 1 --2- 172.21.15.63:0/716460912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4908143630 0x7f49080bbcd0 secure :-1 s=THROTTLE_DONE pgs=1779 cs=0 l=1 rx=0x7f4904002f70 tx=0x7f4908061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f48fe7fc700 1 --2- 172.21.15.63:0/716460912 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48f004fdd0 0x7f48f0052290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:47.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f48fe7fc700 1 -- 172.21.15.63:0/716460912 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f4904064200 con 0x7f4908143630 2020-05-18T21:35:47.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f490d493700 1 --2- 172.21.15.63:0/716460912 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48f004fdd0 0x7f48f0052290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:47.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.550+0000 7f490d493700 1 --2- 172.21.15.63:0/716460912 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48f004fdd0 0x7f48f0052290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49080bc550 tx=0x7f48f8003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.554+0000 7f490d493700 1 --2- 172.21.15.63:0/716460912 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48f004fdd0 0x7f48f0052290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49080bc550 tx=0x7f48f8003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.554+0000 7f490d493700 1 --2- 172.21.15.63:0/716460912 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48f004fdd0 0x7f48f0052290 secure :-1 s=READY pgs=686 cs=0 l=1 rx=0x7f49080bc550 tx=0x7f48f8003e60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:47.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.554+0000 7f490cc92700 1 --2- 172.21.15.63:0/716460912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4908143630 0x7f49080bbcd0 secure :-1 s=THROTTLE_DONE pgs=1779 cs=0 l=1 rx=0x7f4904002f70 tx=0x7f4908061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.558+0000 7f48fe7fc700 1 -- 172.21.15.63:0/716460912 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f490403e650 con 0x7f4908143630 2020-05-18T21:35:47.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.670+0000 7f490e495700 1 -- 172.21.15.63:0/716460912 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f49080569e0 con 0x7f4908143630 2020-05-18T21:35:47.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.670+0000 7f490cc92700 1 --2- 172.21.15.63:0/716460912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4908143630 0x7f49080bbcd0 secure :-1 s=THROTTLE_DONE pgs=1779 cs=0 l=1 rx=0x7f4904002f70 tx=0x7f4908061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.670+0000 7f48fe7fc700 1 -- 172.21.15.63:0/716460912 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v129) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4904041c70 con 0x7f4908143630 2020-05-18T21:35:47.677 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:35:47.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.674+0000 7f490e495700 1 -- 172.21.15.63:0/716460912 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48f004fdd0 msgr2=0x7f48f0052290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.674+0000 7f490e495700 1 --2- 172.21.15.63:0/716460912 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48f004fdd0 0x7f48f0052290 secure :-1 s=READY pgs=686 cs=0 l=1 rx=0x7f49080bc550 tx=0x7f48f8003e60).stop 2020-05-18T21:35:47.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.674+0000 7f490e495700 1 -- 172.21.15.63:0/716460912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4908143630 msgr2=0x7f49080bbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.674+0000 7f490e495700 1 --2- 172.21.15.63:0/716460912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4908143630 0x7f49080bbcd0 secure :-1 s=READY pgs=1779 cs=0 l=1 rx=0x7f4904002f70 tx=0x7f4908061d60).stop 2020-05-18T21:35:47.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.674+0000 7f490e495700 1 -- 172.21.15.63:0/716460912 shutdown_connections 2020-05-18T21:35:47.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.674+0000 7f490e495700 1 --2- 172.21.15.63:0/716460912 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f48f004fdd0 0x7f48f0052290 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:47.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.674+0000 7f490e495700 1 --2- 172.21.15.63:0/716460912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4908143630 0x7f49080bbcd0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:47.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.674+0000 7f490e495700 1 --2- 172.21.15.63:0/716460912 >> v2:172.21.15.155:3300/0 conn(0x7f49080bc8d0 0x7f4908145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:47.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.674+0000 7f490e495700 1 -- 172.21.15.63:0/716460912 >> 172.21.15.63:0/716460912 conn(0x7f490805f3b0 msgr2=0x7f49080ba500 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:47.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.674+0000 7f490e495700 1 -- 172.21.15.63:0/716460912 shutdown_connections 2020-05-18T21:35:47.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.674+0000 7f490e495700 1 -- 172.21.15.63:0/716460912 wait complete. 2020-05-18T21:35:47.695 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:35:47.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.806+0000 7feb4a35d700 1 Processor -- start 2020-05-18T21:35:47.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.806+0000 7feb4a35d700 1 -- start start 2020-05-18T21:35:47.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.806+0000 7feb4a35d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb441469b0 0x7feb44149d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:47.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.806+0000 7feb4a35d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb44145fd0 con 0x7feb440b68d0 2020-05-18T21:35:47.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.806+0000 7feb4a35d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb44146270 con 0x7feb440b99d0 2020-05-18T21:35:47.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.806+0000 7feb4a35d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb44146510 con 0x7feb441469b0 2020-05-18T21:35:47.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.806+0000 7feb4935b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7feb440b68d0 0x7feb440b8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36598/0 (socket says 172.21.15.63:36598) 2020-05-18T21:35:47.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.806+0000 7feb4935b700 1 -- 172.21.15.63:0/1179685319 learned_addr learned my addr 172.21.15.63:0/1179685319 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:47.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb49b5c700 1 --2- 172.21.15.63:0/1179685319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb441469b0 0x7feb44149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:47.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb33fff700 1 -- 172.21.15.63:0/1179685319 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586257253 0 0) 0x7feb44145fd0 con 0x7feb440b68d0 2020-05-18T21:35:47.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb33fff700 1 -- 172.21.15.63:0/1179685319 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb2c003270 con 0x7feb440b68d0 2020-05-18T21:35:47.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb33fff700 1 -- 172.21.15.63:0/1179685319 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546944627 0 0) 0x7feb44146270 con 0x7feb440b99d0 2020-05-18T21:35:47.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb33fff700 1 -- 172.21.15.63:0/1179685319 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb44145fd0 con 0x7feb440b99d0 2020-05-18T21:35:47.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb49b5c700 1 -- 172.21.15.63:0/1179685319 >> v1:172.21.15.155:6789/0 conn(0x7feb440b99d0 legacy=0x7feb44060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb49b5c700 1 -- 172.21.15.63:0/1179685319 >> v1:172.21.15.63:6789/0 conn(0x7feb440b68d0 legacy=0x7feb440b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb49b5c700 1 -- 172.21.15.63:0/1179685319 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb440b6cb0 con 0x7feb441469b0 2020-05-18T21:35:47.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb49b5c700 1 --2- 172.21.15.63:0/1179685319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb441469b0 0x7feb44149d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feb3c0032f0 tx=0x7feb3c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb49b5c700 1 --2- 172.21.15.63:0/1179685319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb441469b0 0x7feb44149d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feb3c0032f0 tx=0x7feb3c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb49b5c700 1 --2- 172.21.15.63:0/1179685319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb441469b0 0x7feb44149d40 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7feb3c0032f0 tx=0x7feb3c008ca0).ready entity=mon.2 client_cookie=cc11a8b60673486c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:47.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb49b5c700 1 --2- 172.21.15.63:0/1179685319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb441469b0 0x7feb44149d40 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7feb3c0032f0 tx=0x7feb3c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb33fff700 1 -- 172.21.15.63:0/1179685319 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb3c011df0 con 0x7feb441469b0 2020-05-18T21:35:47.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb49b5c700 1 --2- 172.21.15.63:0/1179685319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb441469b0 0x7feb44149d40 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7feb3c0032f0 tx=0x7feb3c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb33fff700 1 -- 172.21.15.63:0/1179685319 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3c00a180 con 0x7feb441469b0 2020-05-18T21:35:47.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb49b5c700 1 --2- 172.21.15.63:0/1179685319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb441469b0 0x7feb44149d40 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7feb3c0032f0 tx=0x7feb3c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb33fff700 1 -- 172.21.15.63:0/1179685319 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb3c00a520 con 0x7feb441469b0 2020-05-18T21:35:47.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb4a35d700 1 -- 172.21.15.63:0/1179685319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb441469b0 msgr2=0x7feb44149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb4a35d700 1 --2- 172.21.15.63:0/1179685319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb441469b0 0x7feb44149d40 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7feb3c0032f0 tx=0x7feb3c008ca0).stop 2020-05-18T21:35:47.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb4a35d700 1 -- 172.21.15.63:0/1179685319 shutdown_connections 2020-05-18T21:35:47.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb4a35d700 1 --2- 172.21.15.63:0/1179685319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb441469b0 0x7feb44149d40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:47.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb4a35d700 1 -- 172.21.15.63:0/1179685319 >> 172.21.15.63:0/1179685319 conn(0x7feb44069b70 msgr2=0x7feb44069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:47.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb4a35d700 1 -- 172.21.15.63:0/1179685319 shutdown_connections 2020-05-18T21:35:47.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.810+0000 7feb4a35d700 1 -- 172.21.15.63:0/1179685319 wait complete. 2020-05-18T21:35:47.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4a35d700 1 Processor -- start 2020-05-18T21:35:47.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4a35d700 1 -- start start 2020-05-18T21:35:47.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4a35d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7feb440b68d0 0x7feb44144e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:47.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4a35d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb440b99d0 0x7feb44144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:47.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4a35d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb44144470 con 0x7feb441469b0 2020-05-18T21:35:47.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4a35d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb441534b0 con 0x7feb440b68d0 2020-05-18T21:35:47.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4a35d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb44153750 con 0x7feb440b99d0 2020-05-18T21:35:47.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4935b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7feb440b68d0 0x7feb44144e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:47.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4935b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7feb440b68d0 0x7feb44144e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34416/0 (socket says 172.21.15.63:34416) 2020-05-18T21:35:47.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4935b700 1 -- 172.21.15.63:0/906137691 learned_addr learned my addr 172.21.15.63:0/906137691 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:47.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb48b5a700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb440b99d0 0x7feb44144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:47.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4935b700 1 -- 172.21.15.63:0/906137691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb440b99d0 msgr2=0x7feb44144010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4935b700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb440b99d0 0x7feb44144010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:47.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4935b700 1 -- 172.21.15.63:0/906137691 >> v1:172.21.15.155:6789/0 conn(0x7feb441469b0 legacy=0x7feb440ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4935b700 1 -- 172.21.15.63:0/906137691 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb441539f0 con 0x7feb440b68d0 2020-05-18T21:35:47.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb48b5a700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb440b99d0 0x7feb44144010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:35:47.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4935b700 1 --2- 172.21.15.63:0/906137691 >> v2:172.21.15.63:3300/0 conn(0x7feb440b68d0 0x7feb44144e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feb40001110 tx=0x7feb40010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4935b700 1 --2- 172.21.15.63:0/906137691 >> v2:172.21.15.63:3300/0 conn(0x7feb440b68d0 0x7feb44144e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feb40001110 tx=0x7feb40010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4935b700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb440b68d0 0x7feb44144e80 secure :-1 s=READY pgs=1781 cs=0 l=1 rx=0x7feb40001110 tx=0x7feb40010a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:47.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4935b700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb440b68d0 0x7feb44144e80 secure :-1 s=THROTTLE_DONE pgs=1781 cs=0 l=1 rx=0x7feb40001110 tx=0x7feb40010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb327fc700 1 -- 172.21.15.63:0/906137691 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb40005d00 con 0x7feb440b68d0 2020-05-18T21:35:47.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4935b700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb440b68d0 0x7feb44144e80 secure :-1 s=THROTTLE_DONE pgs=1781 cs=0 l=1 rx=0x7feb40001110 tx=0x7feb40010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb327fc700 1 -- 172.21.15.63:0/906137691 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb40005e60 con 0x7feb440b68d0 2020-05-18T21:35:47.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4935b700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb440b68d0 0x7feb44144e80 secure :-1 s=THROTTLE_DONE pgs=1781 cs=0 l=1 rx=0x7feb40001110 tx=0x7feb40010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb327fc700 1 -- 172.21.15.63:0/906137691 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb400122f0 con 0x7feb440b68d0 2020-05-18T21:35:47.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4a35d700 1 -- 172.21.15.63:0/906137691 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb44153e90 con 0x7feb440b68d0 2020-05-18T21:35:47.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.814+0000 7feb4a35d700 1 -- 172.21.15.63:0/906137691 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb44153230 con 0x7feb440b68d0 2020-05-18T21:35:47.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.818+0000 7feb4935b700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb440b68d0 0x7feb44144e80 secure :-1 s=THROTTLE_DONE pgs=1781 cs=0 l=1 rx=0x7feb40001110 tx=0x7feb40010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.818+0000 7feb327fc700 1 -- 172.21.15.63:0/906137691 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7feb40012530 con 0x7feb440b68d0 2020-05-18T21:35:47.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.818+0000 7feb4935b700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb440b68d0 0x7feb44144e80 secure :-1 s=THROTTLE_DONE pgs=1781 cs=0 l=1 rx=0x7feb40001110 tx=0x7feb40010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.818+0000 7feb327fc700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feb2404f8f0 0x7feb24051db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:47.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.818+0000 7feb327fc700 1 -- 172.21.15.63:0/906137691 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5253+0+0 (secure 0 0 0) 0x7feb400090c0 con 0x7feb440b68d0 2020-05-18T21:35:47.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.818+0000 7feb48b5a700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feb2404f8f0 0x7feb24051db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:47.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.818+0000 7feb4a35d700 1 -- 172.21.15.63:0/906137691 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb440569e0 con 0x7feb440b68d0 2020-05-18T21:35:47.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.818+0000 7feb48b5a700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feb2404f8f0 0x7feb24051db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feb34001110 tx=0x7feb34003860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.818+0000 7feb48b5a700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feb2404f8f0 0x7feb24051db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feb34001110 tx=0x7feb34003860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.818+0000 7feb48b5a700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feb2404f8f0 0x7feb24051db0 secure :-1 s=READY pgs=687 cs=0 l=1 rx=0x7feb34001110 tx=0x7feb34003860).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:47.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.826+0000 7feb4935b700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb440b68d0 0x7feb44144e80 secure :-1 s=THROTTLE_DONE pgs=1781 cs=0 l=1 rx=0x7feb40001110 tx=0x7feb40010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.826+0000 7feb327fc700 1 -- 172.21.15.63:0/906137691 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7feb4003e340 con 0x7feb440b68d0 2020-05-18T21:35:47.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.946+0000 7feb4a35d700 1 -- 172.21.15.63:0/906137691 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feb44153bf0 con 0x7feb440b68d0 2020-05-18T21:35:47.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.946+0000 7feb4935b700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb440b68d0 0x7feb44144e80 secure :-1 s=THROTTLE_DONE pgs=1781 cs=0 l=1 rx=0x7feb40001110 tx=0x7feb40010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:47.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.946+0000 7feb327fc700 1 -- 172.21.15.63:0/906137691 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v129) v1 ==== 92+0+10 (secure 0 0 0) 0x7feb40041960 con 0x7feb440b68d0 2020-05-18T21:35:47.951 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:35:47.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.946+0000 7feb4a35d700 1 -- 172.21.15.63:0/906137691 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feb2404f8f0 msgr2=0x7feb24051db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.946+0000 7feb4a35d700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feb2404f8f0 0x7feb24051db0 secure :-1 s=READY pgs=687 cs=0 l=1 rx=0x7feb34001110 tx=0x7feb34003860).stop 2020-05-18T21:35:47.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.946+0000 7feb4a35d700 1 -- 172.21.15.63:0/906137691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb440b68d0 msgr2=0x7feb44144e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:47.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.946+0000 7feb4a35d700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb440b68d0 0x7feb44144e80 secure :-1 s=READY pgs=1781 cs=0 l=1 rx=0x7feb40001110 tx=0x7feb40010a60).stop 2020-05-18T21:35:47.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.946+0000 7feb4a35d700 1 -- 172.21.15.63:0/906137691 shutdown_connections 2020-05-18T21:35:47.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.946+0000 7feb4a35d700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feb2404f8f0 0x7feb24051db0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:47.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.946+0000 7feb4a35d700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb440b99d0 0x7feb44144010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:47.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.946+0000 7feb4a35d700 1 --2- 172.21.15.63:0/906137691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb440b68d0 0x7feb44144e80 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:47.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.946+0000 7feb4a35d700 1 -- 172.21.15.63:0/906137691 >> 172.21.15.63:0/906137691 conn(0x7feb44069b70 msgr2=0x7feb440b7000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:47.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.946+0000 7feb4a35d700 1 -- 172.21.15.63:0/906137691 shutdown_connections 2020-05-18T21:35:47.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:47.946+0000 7feb4a35d700 1 -- 172.21.15.63:0/906137691 wait complete. 2020-05-18T21:35:47.964 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-05-18T21:35:48.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9317fff700 1 Processor -- start 2020-05-18T21:35:48.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9317fff700 1 -- start start 2020-05-18T21:35:48.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9317fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f931805f110 0x7f93180b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:48.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9317fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9318064fd0 0x7f931814d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:48.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9317fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f931814a330 con 0x7f931814aa70 2020-05-18T21:35:48.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9317fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f931814a140 con 0x7f931805f110 2020-05-18T21:35:48.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9317fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9318065460 con 0x7f9318064fd0 2020-05-18T21:35:48.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f93167fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f931814aa70 0x7f93180648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36612/0 (socket says 172.21.15.63:36612) 2020-05-18T21:35:48.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f93167fc700 1 -- 172.21.15.63:0/1915309564 learned_addr learned my addr 172.21.15.63:0/1915309564 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:48.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f93177fe700 1 --2- 172.21.15.63:0/1915309564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9318064fd0 0x7f931814d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:48.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9316ffd700 1 --2- 172.21.15.63:0/1915309564 >> v2:172.21.15.155:3300/0 conn(0x7f931805f110 0x7f93180b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:48.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9315ffb700 1 -- 172.21.15.63:0/1915309564 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176925081 0 0) 0x7f931814a330 con 0x7f931814aa70 2020-05-18T21:35:48.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9315ffb700 1 -- 172.21.15.63:0/1915309564 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92fc003270 con 0x7f931814aa70 2020-05-18T21:35:48.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9315ffb700 1 -- 172.21.15.63:0/1915309564 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2233781963 0 0) 0x7f92fc003270 con 0x7f931814aa70 2020-05-18T21:35:48.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9315ffb700 1 -- 172.21.15.63:0/1915309564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9318064fd0 msgr2=0x7f931814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:48.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9315ffb700 1 --2- 172.21.15.63:0/1915309564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9318064fd0 0x7f931814d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:48.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9315ffb700 1 -- 172.21.15.63:0/1915309564 >> v2:172.21.15.155:3300/0 conn(0x7f931805f110 msgr2=0x7f93180b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:48.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9315ffb700 1 --2- 172.21.15.63:0/1915309564 >> v2:172.21.15.155:3300/0 conn(0x7f931805f110 0x7f93180b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:48.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9315ffb700 1 -- 172.21.15.63:0/1915309564 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931814a5d0 con 0x7f931814aa70 2020-05-18T21:35:48.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9315ffb700 1 -- 172.21.15.63:0/1915309564 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f9300001710 con 0x7f931814aa70 2020-05-18T21:35:48.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9315ffb700 1 -- 172.21.15.63:0/1915309564 >> v1:172.21.15.63:6789/0 conn(0x7f931814aa70 legacy=0x7f93180648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:48.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9315ffb700 1 --2- 172.21.15.63:0/1915309564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9318064fd0 0x7f92fc003790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:48.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9315ffb700 1 --2- 172.21.15.63:0/1915309564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92fc003bf0 0x7f92fc004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:48.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9315ffb700 1 --2- 172.21.15.63:0/1915309564 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92fc004620 0x7f92fc004aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:48.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9315ffb700 1 -- 172.21.15.63:0/1915309564 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9318065460 con 0x7f92fc004620 2020-05-18T21:35:48.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9315ffb700 1 -- 172.21.15.63:0/1915309564 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc005050 con 0x7f92fc003bf0 2020-05-18T21:35:48.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9315ffb700 1 -- 172.21.15.63:0/1915309564 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc005210 con 0x7f9318064fd0 2020-05-18T21:35:48.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f93177fe700 1 --2- 172.21.15.63:0/1915309564 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92fc004620 0x7f92fc004aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:48.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f93167fc700 1 --2- 172.21.15.63:0/1915309564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92fc003bf0 0x7f92fc004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:48.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.062+0000 7f9316ffd700 1 --2- 172.21.15.63:0/1915309564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9318064fd0 0x7f92fc003790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:48.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9316ffd700 1 -- 172.21.15.63:0/1915309564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92fc003bf0 msgr2=0x7f92fc004050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:48.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9316ffd700 1 --2- 172.21.15.63:0/1915309564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92fc003bf0 0x7f92fc004050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:48.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9316ffd700 1 -- 172.21.15.63:0/1915309564 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92fc004620 msgr2=0x7f92fc004aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:48.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9316ffd700 1 --2- 172.21.15.63:0/1915309564 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92fc004620 0x7f92fc004aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:48.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9316ffd700 1 -- 172.21.15.63:0/1915309564 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc003270 con 0x7f9318064fd0 2020-05-18T21:35:48.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f93177fe700 1 --2- 172.21.15.63:0/1915309564 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92fc004620 0x7f92fc004aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:35:48.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9316ffd700 1 --2- 172.21.15.63:0/1915309564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9318064fd0 0x7f92fc003790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9308002f70 tx=0x7f9308010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9316ffd700 1 --2- 172.21.15.63:0/1915309564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9318064fd0 0x7f92fc003790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9308002f70 tx=0x7f9308010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9316ffd700 1 --2- 172.21.15.63:0/1915309564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9318064fd0 0x7f92fc003790 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7f9308002f70 tx=0x7f9308010060).ready entity=mon.2 client_cookie=9e96bfec7bcbee14 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:48.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9316ffd700 1 --2- 172.21.15.63:0/1915309564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9318064fd0 0x7f92fc003790 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f9308002f70 tx=0x7f9308010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9315ffb700 1 -- 172.21.15.63:0/1915309564 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9308008e30 con 0x7f9318064fd0 2020-05-18T21:35:48.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9316ffd700 1 --2- 172.21.15.63:0/1915309564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9318064fd0 0x7f92fc003790 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f9308002f70 tx=0x7f9308010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9316ffd700 1 --2- 172.21.15.63:0/1915309564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9318064fd0 0x7f92fc003790 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f9308002f70 tx=0x7f9308010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9315ffb700 1 -- 172.21.15.63:0/1915309564 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9308010910 con 0x7f9318064fd0 2020-05-18T21:35:48.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9315ffb700 1 -- 172.21.15.63:0/1915309564 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9308010c70 con 0x7f9318064fd0 2020-05-18T21:35:48.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9317fff700 1 -- 172.21.15.63:0/1915309564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9318064fd0 msgr2=0x7f92fc003790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:48.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9317fff700 1 --2- 172.21.15.63:0/1915309564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9318064fd0 0x7f92fc003790 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7f9308002f70 tx=0x7f9308010060).stop 2020-05-18T21:35:48.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f93177fe700 1 -- 172.21.15.63:0/1915309564 reap_dead start 2020-05-18T21:35:48.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9317fff700 1 -- 172.21.15.63:0/1915309564 shutdown_connections 2020-05-18T21:35:48.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9317fff700 1 -- 172.21.15.63:0/1915309564 >> 172.21.15.63:0/1915309564 conn(0x7f9318069fc0 msgr2=0x7f931806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:48.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9317fff700 1 -- 172.21.15.63:0/1915309564 shutdown_connections 2020-05-18T21:35:48.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9317fff700 1 -- 172.21.15.63:0/1915309564 wait complete. 2020-05-18T21:35:48.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9317fff700 1 Processor -- start 2020-05-18T21:35:48.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.066+0000 7f9317fff700 1 -- start start 2020-05-18T21:35:48.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f9317fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93180aece0 0x7f9318147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:48.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f9317fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93180ae880 con 0x7f9318149560 2020-05-18T21:35:48.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f9317fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93180b57f0 con 0x7f931815a990 2020-05-18T21:35:48.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f9317fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93180b5a90 con 0x7f93180aece0 2020-05-18T21:35:48.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f93177fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9318149560 0x7f9318145720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36628/0 (socket says 172.21.15.63:36628) 2020-05-18T21:35:48.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f93167fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93180aece0 0x7f9318147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:48.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f93177fe700 1 -- 172.21.15.63:0/3550639569 learned_addr learned my addr 172.21.15.63:0/3550639569 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:48.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f930ffff700 1 -- 172.21.15.63:0/3550639569 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699218449 0 0) 0x7f93180ae880 con 0x7f9318149560 2020-05-18T21:35:48.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f930ffff700 1 -- 172.21.15.63:0/3550639569 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92f0002fe0 con 0x7f9318149560 2020-05-18T21:35:48.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f930ffff700 1 -- 172.21.15.63:0/3550639569 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946340452 0 0) 0x7f93180b57f0 con 0x7f931815a990 2020-05-18T21:35:48.089 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f93167fc700 1 -- 172.21.15.63:0/3550639569 >> v1:172.21.15.155:6789/0 conn(0x7f931815a990 legacy=0x7f931815ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:48.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f93167fc700 1 -- 172.21.15.63:0/3550639569 >> v1:172.21.15.63:6789/0 conn(0x7f9318149560 legacy=0x7f9318145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:48.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f93167fc700 1 -- 172.21.15.63:0/3550639569 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93181499d0 con 0x7f93180aece0 2020-05-18T21:35:48.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f93167fc700 1 --2- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93180aece0 0x7f9318147f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9318063c70 tx=0x7f93180640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f93167fc700 1 --2- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93180aece0 0x7f9318147f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9318063c70 tx=0x7f93180640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.090 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f93167fc700 1 --2- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93180aece0 0x7f9318147f80 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7f9318063c70 tx=0x7f93180640f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:48.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f93167fc700 1 --2- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93180aece0 0x7f9318147f80 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f9318063c70 tx=0x7f93180640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f930ffff700 1 -- 172.21.15.63:0/3550639569 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f930000ccb0 con 0x7f93180aece0 2020-05-18T21:35:48.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f93167fc700 1 --2- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93180aece0 0x7f9318147f80 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f9318063c70 tx=0x7f93180640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f93167fc700 1 --2- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93180aece0 0x7f9318147f80 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f9318063c70 tx=0x7f93180640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f930ffff700 1 -- 172.21.15.63:0/3550639569 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930000ce10 con 0x7f93180aece0 2020-05-18T21:35:48.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f930ffff700 1 -- 172.21.15.63:0/3550639569 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f930000e360 con 0x7f93180aece0 2020-05-18T21:35:48.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.070+0000 7f9317fff700 1 -- 172.21.15.63:0/3550639569 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9318149b80 con 0x7f93180aece0 2020-05-18T21:35:48.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.074+0000 7f9317fff700 1 -- 172.21.15.63:0/3550639569 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9318145e30 con 0x7f93180aece0 2020-05-18T21:35:48.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.074+0000 7f9317fff700 1 -- 172.21.15.63:0/3550639569 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93180b5bd0 con 0x7f93180aece0 2020-05-18T21:35:48.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.074+0000 7f93167fc700 1 --2- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93180aece0 0x7f9318147f80 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f9318063c70 tx=0x7f93180640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.074+0000 7f930ffff700 1 -- 172.21.15.63:0/3550639569 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9300007290 con 0x7f93180aece0 2020-05-18T21:35:48.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.074+0000 7f93167fc700 1 --2- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93180aece0 0x7f9318147f80 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f9318063c70 tx=0x7f93180640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.074+0000 7f930ffff700 1 --2- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f92f004fd30 0x7f92f00521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:48.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.074+0000 7f930ffff700 1 -- 172.21.15.63:0/3550639569 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f93000070d0 con 0x7f93180aece0 2020-05-18T21:35:48.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.078+0000 7f9316ffd700 1 --2- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f92f004fd30 0x7f92f00521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:48.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.078+0000 7f9316ffd700 1 --2- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f92f004fd30 0x7f92f00521f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f93080083a0 tx=0x7f9308010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.078+0000 7f9316ffd700 1 --2- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f92f004fd30 0x7f92f00521f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f93080083a0 tx=0x7f9308010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.078+0000 7f9316ffd700 1 --2- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f92f004fd30 0x7f92f00521f0 secure :-1 s=READY pgs=688 cs=0 l=1 rx=0x7f93080083a0 tx=0x7f9308010060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:48.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.082+0000 7f93167fc700 1 --2- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93180aece0 0x7f9318147f80 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f9318063c70 tx=0x7f93180640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.082+0000 7f930ffff700 1 -- 172.21.15.63:0/3550639569 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f930003dd60 con 0x7f93180aece0 2020-05-18T21:35:48.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.198+0000 7f9317fff700 1 -- 172.21.15.63:0/3550639569 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f93180aea10 con 0x7f93180aece0 2020-05-18T21:35:48.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.198+0000 7f93167fc700 1 --2- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93180aece0 0x7f9318147f80 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f9318063c70 tx=0x7f93180640f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.198+0000 7f930ffff700 1 -- 172.21.15.63:0/3550639569 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v129) v1 ==== 84+0+143 (secure 0 0 0) 0x7f9300041380 con 0x7f93180aece0 2020-05-18T21:35:48.204 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:48.205 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:35:48.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:48.206 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2020-05-18T21:35:48.206 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "device_health_metrics" 2020-05-18T21:35:48.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:48.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:35:48.207 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 2, 2020-05-18T21:35:48.207 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "rbd" 2020-05-18T21:35:48.208 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:48.208 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:35:48.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.198+0000 7f9317fff700 1 -- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f92f004fd30 msgr2=0x7f92f00521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:48.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.198+0000 7f9317fff700 1 --2- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f92f004fd30 0x7f92f00521f0 secure :-1 s=READY pgs=688 cs=0 l=1 rx=0x7f93080083a0 tx=0x7f9308010060).stop 2020-05-18T21:35:48.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.198+0000 7f9317fff700 1 -- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93180aece0 msgr2=0x7f9318147f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:48.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.198+0000 7f9317fff700 1 --2- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93180aece0 0x7f9318147f80 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7f9318063c70 tx=0x7f93180640f0).stop 2020-05-18T21:35:48.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.202+0000 7f9317fff700 1 -- 172.21.15.63:0/3550639569 shutdown_connections 2020-05-18T21:35:48.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.202+0000 7f9317fff700 1 --2- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f92f004fd30 0x7f92f00521f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:48.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.202+0000 7f9317fff700 1 --2- 172.21.15.63:0/3550639569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93180aece0 0x7f9318147f80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:48.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.202+0000 7f9317fff700 1 -- 172.21.15.63:0/3550639569 >> 172.21.15.63:0/3550639569 conn(0x7f9318069fc0 msgr2=0x7f93180b81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:48.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.202+0000 7f9317fff700 1 -- 172.21.15.63:0/3550639569 shutdown_connections 2020-05-18T21:35:48.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.202+0000 7f9317fff700 1 -- 172.21.15.63:0/3550639569 wait complete. 2020-05-18T21:35:48.216 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-05-18T21:35:48.217 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-05-18T21:35:48.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.318+0000 7f5ae09f0700 1 Processor -- start 2020-05-18T21:35:48.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.318+0000 7f5ae09f0700 1 -- start start 2020-05-18T21:35:48.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.318+0000 7f5ae09f0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:48.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.318+0000 7f5ae09f0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5adc146420 con 0x7f5adc145e30 2020-05-18T21:35:48.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.318+0000 7f5ae09f0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5adc1466c0 con 0x7f5adc0bc8d0 2020-05-18T21:35:48.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.318+0000 7f5ae09f0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc146e00 con 0x7f5adc143630 2020-05-18T21:35:48.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5adb59e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5adc145e30 0x7f5adc12e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36636/0 (socket says 172.21.15.63:36636) 2020-05-18T21:35:48.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5adb59e700 1 -- 172.21.15.63:0/4281488571 learned_addr learned my addr 172.21.15.63:0/4281488571 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:48.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ada59c700 1 --2- 172.21.15.63:0/4281488571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:48.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ad9d9b700 1 -- 172.21.15.63:0/4281488571 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107479309 0 0) 0x7f5adc146420 con 0x7f5adc145e30 2020-05-18T21:35:48.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ad9d9b700 1 -- 172.21.15.63:0/4281488571 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5abc003270 con 0x7f5adc145e30 2020-05-18T21:35:48.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ad9d9b700 1 -- 172.21.15.63:0/4281488571 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821233286 0 0) 0x7f5adc1466c0 con 0x7f5adc0bc8d0 2020-05-18T21:35:48.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ada59c700 1 -- 172.21.15.63:0/4281488571 >> v1:172.21.15.155:6789/0 conn(0x7f5adc0bc8d0 legacy=0x7f5adc142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:48.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ada59c700 1 -- 172.21.15.63:0/4281488571 >> v1:172.21.15.63:6789/0 conn(0x7f5adc145e30 legacy=0x7f5adc12e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:48.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ada59c700 1 -- 172.21.15.63:0/4281488571 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc146960 con 0x7f5adc143630 2020-05-18T21:35:48.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ada59c700 1 --2- 172.21.15.63:0/4281488571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc060b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5acc002f70 tx=0x7f5adc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ada59c700 1 --2- 172.21.15.63:0/4281488571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc060b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5acc002f70 tx=0x7f5adc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ada59c700 1 --2- 172.21.15.63:0/4281488571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc060b00 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7f5acc002f70 tx=0x7f5adc061d60).ready entity=mon.2 client_cookie=7347506950c4f97d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:48.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ada59c700 1 --2- 172.21.15.63:0/4281488571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc060b00 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f5acc002f70 tx=0x7f5adc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ad9d9b700 1 -- 172.21.15.63:0/4281488571 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5acc011630 con 0x7f5adc143630 2020-05-18T21:35:48.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ada59c700 1 --2- 172.21.15.63:0/4281488571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc060b00 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f5acc002f70 tx=0x7f5adc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ad9d9b700 1 -- 172.21.15.63:0/4281488571 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc011790 con 0x7f5adc143630 2020-05-18T21:35:48.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ada59c700 1 --2- 172.21.15.63:0/4281488571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc060b00 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f5acc002f70 tx=0x7f5adc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ae09f0700 1 -- 172.21.15.63:0/4281488571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 msgr2=0x7f5adc060b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:48.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ad9d9b700 1 -- 172.21.15.63:0/4281488571 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5acc011b30 con 0x7f5adc143630 2020-05-18T21:35:48.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ae09f0700 1 --2- 172.21.15.63:0/4281488571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc060b00 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7f5acc002f70 tx=0x7f5adc061d60).stop 2020-05-18T21:35:48.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ae09f0700 1 -- 172.21.15.63:0/4281488571 shutdown_connections 2020-05-18T21:35:48.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ae09f0700 1 --2- 172.21.15.63:0/4281488571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc060b00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:48.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ae09f0700 1 -- 172.21.15.63:0/4281488571 >> 172.21.15.63:0/4281488571 conn(0x7f5adc05f3b0 msgr2=0x7f5adc05f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:48.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ae09f0700 1 -- 172.21.15.63:0/4281488571 shutdown_connections 2020-05-18T21:35:48.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.322+0000 7f5ae09f0700 1 -- 172.21.15.63:0/4281488571 wait complete. 2020-05-18T21:35:48.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.326+0000 7f5ae09f0700 1 Processor -- start 2020-05-18T21:35:48.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.326+0000 7f5ae09f0700 1 -- start start 2020-05-18T21:35:48.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.326+0000 7f5ae09f0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5adc0bc8d0 0x7f5adc1565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:48.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.326+0000 7f5ae09f0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc0b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:48.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.326+0000 7f5ae09f0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5adc0b30e0 con 0x7f5adc145e30 2020-05-18T21:35:48.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.326+0000 7f5ae09f0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5adc0ae140 con 0x7f5adc0bc8d0 2020-05-18T21:35:48.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.326+0000 7f5ae09f0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0ae330 con 0x7f5adc143630 2020-05-18T21:35:48.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.326+0000 7f5adad9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5adc0bc8d0 0x7f5adc1565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:48.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.326+0000 7f5ada59c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc0b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:48.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.326+0000 7f5adb59e700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f5adc145e30 0x7f5adc0aed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:34958/0 (socket says 172.21.15.63:34958) 2020-05-18T21:35:48.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.326+0000 7f5adb59e700 1 -- 172.21.15.63:0/3931457513 learned_addr learned my addr 172.21.15.63:0/3931457513 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:48.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5ada59c700 1 -- 172.21.15.63:0/3931457513 >> v2:172.21.15.155:3300/0 conn(0x7f5adc0bc8d0 msgr2=0x7f5adc1565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:48.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5ada59c700 1 --2- 172.21.15.63:0/3931457513 >> v2:172.21.15.155:3300/0 conn(0x7f5adc0bc8d0 0x7f5adc1565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:48.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5ada59c700 1 -- 172.21.15.63:0/3931457513 >> v1:172.21.15.155:6789/0 conn(0x7f5adc145e30 legacy=0x7f5adc0aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:48.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5ada59c700 1 -- 172.21.15.63:0/3931457513 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc0ae5d0 con 0x7f5adc143630 2020-05-18T21:35:48.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5adad9d700 1 --2- 172.21.15.63:0/3931457513 >> v2:172.21.15.155:3300/0 conn(0x7f5adc0bc8d0 0x7f5adc1565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:35:48.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5ada59c700 1 --2- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc0b2c80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5adc0ae050 tx=0x7f5adc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5ada59c700 1 --2- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc0b2c80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5adc0ae050 tx=0x7f5adc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5ada59c700 1 --2- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc0b2c80 secure :-1 s=READY pgs=264 cs=0 l=1 rx=0x7f5adc0ae050 tx=0x7f5adc061d60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:48.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5ada59c700 1 --2- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc0b2c80 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7f5adc0ae050 tx=0x7f5adc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5ad3fff700 1 -- 172.21.15.63:0/3931457513 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5acc011b70 con 0x7f5adc143630 2020-05-18T21:35:48.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5ada59c700 1 --2- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc0b2c80 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7f5adc0ae050 tx=0x7f5adc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5ada59c700 1 --2- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc0b2c80 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7f5adc0ae050 tx=0x7f5adc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5ad3fff700 1 -- 172.21.15.63:0/3931457513 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc007170 con 0x7f5adc143630 2020-05-18T21:35:48.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5ae09f0700 1 -- 172.21.15.63:0/3931457513 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5adc0ae870 con 0x7f5adc143630 2020-05-18T21:35:48.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5ad3fff700 1 -- 172.21.15.63:0/3931457513 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5acc007590 con 0x7f5adc143630 2020-05-18T21:35:48.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5ae09f0700 1 -- 172.21.15.63:0/3931457513 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5adc1475f0 con 0x7f5adc143630 2020-05-18T21:35:48.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5ada59c700 1 --2- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc0b2c80 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7f5adc0ae050 tx=0x7f5adc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5ae09f0700 1 -- 172.21.15.63:0/3931457513 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5adc0569e0 con 0x7f5adc143630 2020-05-18T21:35:48.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5ada59c700 1 --2- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc0b2c80 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7f5adc0ae050 tx=0x7f5adc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.330+0000 7f5ad3fff700 1 -- 172.21.15.63:0/3931457513 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5acc005700 con 0x7f5adc143630 2020-05-18T21:35:48.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.334+0000 7f5ad3fff700 1 --2- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ac004f8f0 0x7f5ac0051db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:48.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.334+0000 7f5ad3fff700 1 -- 172.21.15.63:0/3931457513 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5acc064280 con 0x7f5adc143630 2020-05-18T21:35:48.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.334+0000 7f5adad9d700 1 --2- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ac004f8f0 0x7f5ac0051db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:48.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.334+0000 7f5adad9d700 1 --2- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ac004f8f0 0x7f5ac0051db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5ac4000bc0 tx=0x7f5ac400cc50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.334+0000 7f5adad9d700 1 --2- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ac004f8f0 0x7f5ac0051db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5ac4000bc0 tx=0x7f5ac400cc50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.334+0000 7f5adad9d700 1 --2- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ac004f8f0 0x7f5ac0051db0 secure :-1 s=READY pgs=689 cs=0 l=1 rx=0x7f5ac4000bc0 tx=0x7f5ac400cc50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:48.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.342+0000 7f5ada59c700 1 --2- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc0b2c80 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7f5adc0ae050 tx=0x7f5adc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.342+0000 7f5ad3fff700 1 -- 172.21.15.63:0/3931457513 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f5acc03e570 con 0x7f5adc143630 2020-05-18T21:35:48.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.458+0000 7f5ae09f0700 1 -- 172.21.15.63:0/3931457513 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f5adc0008d0 con 0x7f5adc143630 2020-05-18T21:35:48.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.842+0000 7f5ada59c700 1 --2- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc0b2c80 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7f5adc0ae050 tx=0x7f5adc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.842+0000 7f5ad3fff700 1 -- 172.21.15.63:0/3931457513 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v130) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5acc041b90 con 0x7f5adc143630 2020-05-18T21:35:48.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.846+0000 7f5ae09f0700 1 -- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ac004f8f0 msgr2=0x7f5ac0051db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:48.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.846+0000 7f5ae09f0700 1 --2- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ac004f8f0 0x7f5ac0051db0 secure :-1 s=READY pgs=689 cs=0 l=1 rx=0x7f5ac4000bc0 tx=0x7f5ac400cc50).stop 2020-05-18T21:35:48.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.846+0000 7f5ae09f0700 1 -- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 msgr2=0x7f5adc0b2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:48.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.846+0000 7f5ae09f0700 1 --2- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc0b2c80 secure :-1 s=READY pgs=264 cs=0 l=1 rx=0x7f5adc0ae050 tx=0x7f5adc061d60).stop 2020-05-18T21:35:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.846+0000 7f5ae09f0700 1 -- 172.21.15.63:0/3931457513 shutdown_connections 2020-05-18T21:35:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.846+0000 7f5ae09f0700 1 --2- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5ac004f8f0 0x7f5ac0051db0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.846+0000 7f5ae09f0700 1 --2- 172.21.15.63:0/3931457513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5adc143630 0x7f5adc0b2c80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.846+0000 7f5ae09f0700 1 --2- 172.21.15.63:0/3931457513 >> v2:172.21.15.155:3300/0 conn(0x7f5adc0bc8d0 0x7f5adc1565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:48.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.846+0000 7f5ae09f0700 1 -- 172.21.15.63:0/3931457513 >> 172.21.15.63:0/3931457513 conn(0x7f5adc05f3b0 msgr2=0x7f5adc0b8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:48.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.846+0000 7f5ae09f0700 1 -- 172.21.15.63:0/3931457513 shutdown_connections 2020-05-18T21:35:48.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.850+0000 7f5ae09f0700 1 -- 172.21.15.63:0/3931457513 wait complete. 2020-05-18T21:35:48.854 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2020-05-18T21:35:48.868 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-05-18T21:35:48.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.974+0000 7f64a8dd8700 1 Processor -- start 2020-05-18T21:35:48.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.974+0000 7f64a8dd8700 1 -- start start 2020-05-18T21:35:48.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a8dd8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a40b47b0 0x7f64a41419b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:48.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a8dd8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a405fb20 con 0x7f64a40aef50 2020-05-18T21:35:48.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a8dd8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a4145a90 con 0x7f64a40b95a0 2020-05-18T21:35:48.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a8dd8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a4145d30 con 0x7f64a40b47b0 2020-05-18T21:35:48.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a2ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f64a40aef50 0x7f64a40b40a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36648/0 (socket says 172.21.15.63:36648) 2020-05-18T21:35:48.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a2ffd700 1 -- 172.21.15.63:0/623792380 learned_addr learned my addr 172.21.15.63:0/623792380 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:48.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a3fff700 1 --2- 172.21.15.63:0/623792380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a40b47b0 0x7f64a41419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:48.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a27fc700 1 -- 172.21.15.63:0/623792380 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496048551 0 0) 0x7f64a405fb20 con 0x7f64a40aef50 2020-05-18T21:35:48.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a27fc700 1 -- 172.21.15.63:0/623792380 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6490003270 con 0x7f64a40aef50 2020-05-18T21:35:48.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a27fc700 1 -- 172.21.15.63:0/623792380 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121137316 0 0) 0x7f64a4145a90 con 0x7f64a40b95a0 2020-05-18T21:35:48.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a27fc700 1 -- 172.21.15.63:0/623792380 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64a405fb20 con 0x7f64a40b95a0 2020-05-18T21:35:48.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a3fff700 1 -- 172.21.15.63:0/623792380 >> v1:172.21.15.155:6789/0 conn(0x7f64a40b95a0 legacy=0x7f64a41461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:48.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a3fff700 1 -- 172.21.15.63:0/623792380 >> v1:172.21.15.63:6789/0 conn(0x7f64a40aef50 legacy=0x7f64a40b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:48.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a3fff700 1 -- 172.21.15.63:0/623792380 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a41468e0 con 0x7f64a40b47b0 2020-05-18T21:35:48.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a3fff700 1 --2- 172.21.15.63:0/623792380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a40b47b0 0x7f64a41419b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f649c0032f0 tx=0x7f649c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a3fff700 1 --2- 172.21.15.63:0/623792380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a40b47b0 0x7f64a41419b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f649c0032f0 tx=0x7f649c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a3fff700 1 --2- 172.21.15.63:0/623792380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a40b47b0 0x7f64a41419b0 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f649c0032f0 tx=0x7f649c008ca0).ready entity=mon.2 client_cookie=d3d5fa33bae658d0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:48.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a3fff700 1 --2- 172.21.15.63:0/623792380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a40b47b0 0x7f64a41419b0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f649c0032f0 tx=0x7f649c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a27fc700 1 -- 172.21.15.63:0/623792380 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f649c011df0 con 0x7f64a40b47b0 2020-05-18T21:35:48.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a3fff700 1 --2- 172.21.15.63:0/623792380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a40b47b0 0x7f64a41419b0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f649c0032f0 tx=0x7f649c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a3fff700 1 --2- 172.21.15.63:0/623792380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a40b47b0 0x7f64a41419b0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f649c0032f0 tx=0x7f649c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a27fc700 1 -- 172.21.15.63:0/623792380 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649c00a180 con 0x7f64a40b47b0 2020-05-18T21:35:48.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a27fc700 1 -- 172.21.15.63:0/623792380 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f649c00a560 con 0x7f64a40b47b0 2020-05-18T21:35:48.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a8dd8700 1 -- 172.21.15.63:0/623792380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a40b47b0 msgr2=0x7f64a41419b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:48.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.978+0000 7f64a8dd8700 1 --2- 172.21.15.63:0/623792380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a40b47b0 0x7f64a41419b0 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f649c0032f0 tx=0x7f649c008ca0).stop 2020-05-18T21:35:48.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.982+0000 7f64a8dd8700 1 -- 172.21.15.63:0/623792380 shutdown_connections 2020-05-18T21:35:48.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.982+0000 7f64a8dd8700 1 --2- 172.21.15.63:0/623792380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a40b47b0 0x7f64a41419b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:48.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.982+0000 7f64a8dd8700 1 -- 172.21.15.63:0/623792380 >> 172.21.15.63:0/623792380 conn(0x7f64a406a640 msgr2=0x7f64a40b8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:48.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.982+0000 7f64a8dd8700 1 -- 172.21.15.63:0/623792380 shutdown_connections 2020-05-18T21:35:48.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.982+0000 7f64a8dd8700 1 -- 172.21.15.63:0/623792380 wait complete. 2020-05-18T21:35:48.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.982+0000 7f64a8dd8700 1 Processor -- start 2020-05-18T21:35:48.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.982+0000 7f64a8dd8700 1 -- start start 2020-05-18T21:35:48.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a8dd8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f64a40aef50 0x7f64a413e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:48.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a8dd8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a40b95a0 0x7f64a413f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:48.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a8dd8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a4140760 con 0x7f64a40b47b0 2020-05-18T21:35:48.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a8dd8700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a4065110 con 0x7f64a40aef50 2020-05-18T21:35:48.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a8dd8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a413fe00 con 0x7f64a40b95a0 2020-05-18T21:35:48.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a37fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f64a40aef50 0x7f64a413e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:48.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a37fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f64a40aef50 0x7f64a413e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34464/0 (socket says 172.21.15.63:34464) 2020-05-18T21:35:48.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a37fe700 1 -- 172.21.15.63:0/3257950191 learned_addr learned my addr 172.21.15.63:0/3257950191 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:48.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a3fff700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a40b95a0 0x7f64a413f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:48.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a0ff9700 1 -- 172.21.15.63:0/3257950191 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6395048 0 0) 0x7f64a4140760 con 0x7f64a40b47b0 2020-05-18T21:35:48.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a0ff9700 1 -- 172.21.15.63:0/3257950191 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6484002fe0 con 0x7f64a40b47b0 2020-05-18T21:35:48.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a37fe700 1 -- 172.21.15.63:0/3257950191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a40b95a0 msgr2=0x7f64a413f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:48.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a37fe700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a40b95a0 0x7f64a413f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:48.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a37fe700 1 -- 172.21.15.63:0/3257950191 >> v1:172.21.15.155:6789/0 conn(0x7f64a40b47b0 legacy=0x7f64a4140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:48.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a37fe700 1 -- 172.21.15.63:0/3257950191 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a4065340 con 0x7f64a40aef50 2020-05-18T21:35:48.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a37fe700 1 --2- 172.21.15.63:0/3257950191 >> v2:172.21.15.63:3300/0 conn(0x7f64a40aef50 0x7f64a413e490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f64940011d0 tx=0x7f64940024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a37fe700 1 --2- 172.21.15.63:0/3257950191 >> v2:172.21.15.63:3300/0 conn(0x7f64a40aef50 0x7f64a413e490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f64940011d0 tx=0x7f64940024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a37fe700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64a40aef50 0x7f64a413e490 secure :-1 s=READY pgs=1786 cs=0 l=1 rx=0x7f64940011d0 tx=0x7f64940024d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:48.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a37fe700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64a40aef50 0x7f64a413e490 secure :-1 s=THROTTLE_DONE pgs=1786 cs=0 l=1 rx=0x7f64940011d0 tx=0x7f64940024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a37fe700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64a40aef50 0x7f64a413e490 secure :-1 s=THROTTLE_DONE pgs=1786 cs=0 l=1 rx=0x7f64940011d0 tx=0x7f64940024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a0ff9700 1 -- 172.21.15.63:0/3257950191 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f649400cc60 con 0x7f64a40aef50 2020-05-18T21:35:48.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a37fe700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64a40aef50 0x7f64a413e490 secure :-1 s=THROTTLE_DONE pgs=1786 cs=0 l=1 rx=0x7f64940011d0 tx=0x7f64940024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:48.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a0ff9700 1 -- 172.21.15.63:0/3257950191 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649400ce00 con 0x7f64a40aef50 2020-05-18T21:35:48.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.986+0000 7f64a0ff9700 1 -- 172.21.15.63:0/3257950191 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f649400e370 con 0x7f64a40aef50 2020-05-18T21:35:49.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.990+0000 7f64a8dd8700 1 -- 172.21.15.63:0/3257950191 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a413dfb0 con 0x7f64a40aef50 2020-05-18T21:35:49.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.990+0000 7f64a8dd8700 1 -- 172.21.15.63:0/3257950191 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a413c3b0 con 0x7f64a40aef50 2020-05-18T21:35:49.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.990+0000 7f64a37fe700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64a40aef50 0x7f64a413e490 secure :-1 s=THROTTLE_DONE pgs=1786 cs=0 l=1 rx=0x7f64940011d0 tx=0x7f64940024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:49.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.990+0000 7f64a8dd8700 1 -- 172.21.15.63:0/3257950191 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a40569e0 con 0x7f64a40aef50 2020-05-18T21:35:49.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.990+0000 7f64a0ff9700 1 -- 172.21.15.63:0/3257950191 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f649400e5a0 con 0x7f64a40aef50 2020-05-18T21:35:49.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.990+0000 7f64a37fe700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64a40aef50 0x7f64a413e490 secure :-1 s=THROTTLE_DONE pgs=1786 cs=0 l=1 rx=0x7f64940011d0 tx=0x7f64940024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:49.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.990+0000 7f64a0ff9700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f648404fd10 0x7f64840521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:49.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.990+0000 7f64a0ff9700 1 -- 172.21.15.63:0/3257950191 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f64940639e0 con 0x7f64a40aef50 2020-05-18T21:35:49.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.990+0000 7f64a2ffd700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f648404fd10 0x7f64840521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:49.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.990+0000 7f64a2ffd700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f648404fd10 0x7f64840521d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6498000bc0 tx=0x7f6498001640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:49.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.990+0000 7f64a2ffd700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f648404fd10 0x7f64840521d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6498000bc0 tx=0x7f6498001640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:49.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.990+0000 7f64a2ffd700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f648404fd10 0x7f64840521d0 secure :-1 s=READY pgs=690 cs=0 l=1 rx=0x7f6498000bc0 tx=0x7f6498001640).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:49.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.998+0000 7f64a37fe700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64a40aef50 0x7f64a413e490 secure :-1 s=THROTTLE_DONE pgs=1786 cs=0 l=1 rx=0x7f64940011d0 tx=0x7f64940024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:49.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:48.998+0000 7f64a0ff9700 1 -- 172.21.15.63:0/3257950191 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f649403dd10 con 0x7f64a40aef50 2020-05-18T21:35:49.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.114+0000 7f64a8dd8700 1 -- 172.21.15.63:0/3257950191 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f64a4065a20 con 0x7f64a40aef50 2020-05-18T21:35:49.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.858+0000 7f64a37fe700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64a40aef50 0x7f64a413e490 secure :-1 s=THROTTLE_DONE pgs=1786 cs=0 l=1 rx=0x7f64940011d0 tx=0x7f64940024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:49.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.858+0000 7f64a0ff9700 1 -- 172.21.15.63:0/3257950191 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v131) v1 ==== 125+0+0 (secure 0 0 0) 0x7f6494041330 con 0x7f64a40aef50 2020-05-18T21:35:49.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.862+0000 7f64a8dd8700 1 -- 172.21.15.63:0/3257950191 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f648404fd10 msgr2=0x7f64840521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:49.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.862+0000 7f64a8dd8700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f648404fd10 0x7f64840521d0 secure :-1 s=READY pgs=690 cs=0 l=1 rx=0x7f6498000bc0 tx=0x7f6498001640).stop 2020-05-18T21:35:49.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.862+0000 7f64a8dd8700 1 -- 172.21.15.63:0/3257950191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64a40aef50 msgr2=0x7f64a413e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:49.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.862+0000 7f64a8dd8700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64a40aef50 0x7f64a413e490 secure :-1 s=READY pgs=1786 cs=0 l=1 rx=0x7f64940011d0 tx=0x7f64940024d0).stop 2020-05-18T21:35:49.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.866+0000 7f64a8dd8700 1 -- 172.21.15.63:0/3257950191 shutdown_connections 2020-05-18T21:35:49.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.866+0000 7f64a8dd8700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f648404fd10 0x7f64840521d0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:49.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.866+0000 7f64a8dd8700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a40b95a0 0x7f64a413f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:49.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.866+0000 7f64a8dd8700 1 --2- 172.21.15.63:0/3257950191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64a40aef50 0x7f64a413e490 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:49.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.866+0000 7f64a8dd8700 1 -- 172.21.15.63:0/3257950191 >> 172.21.15.63:0/3257950191 conn(0x7f64a406a640 msgr2=0x7f64a40b88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:49.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.866+0000 7f64a8dd8700 1 -- 172.21.15.63:0/3257950191 shutdown_connections 2020-05-18T21:35:49.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.870+0000 7f64a8dd8700 1 -- 172.21.15.63:0/3257950191 wait complete. 2020-05-18T21:35:49.874 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2020-05-18T21:35:49.885 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-05-18T21:35:49.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.990+0000 7fabf1a35700 1 Processor -- start 2020-05-18T21:35:49.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.990+0000 7fabf1a35700 1 -- start start 2020-05-18T21:35:49.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.990+0000 7fabf1a35700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fabec1437d0 0x7fabec147310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:49.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.990+0000 7fabf1a35700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabec143c20 con 0x7fabec098500 2020-05-18T21:35:49.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.990+0000 7fabf1a35700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabec069cf0 con 0x7fabec0b6230 2020-05-18T21:35:49.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.990+0000 7fabf1a35700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabec069f90 con 0x7fabec1437d0 2020-05-18T21:35:49.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.990+0000 7fabea7fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fabec098500 0x7fabec1430c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36662/0 (socket says 172.21.15.63:36662) 2020-05-18T21:35:49.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.990+0000 7fabea7fc700 1 -- 172.21.15.63:0/3845915948 learned_addr learned my addr 172.21.15.63:0/3845915948 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:49.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.990+0000 7fabeb7fe700 1 --2- 172.21.15.63:0/3845915948 >> v2:172.21.15.155:3300/0 conn(0x7fabec1437d0 0x7fabec147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:49.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.990+0000 7fabeb7fe700 1 -- 172.21.15.63:0/3845915948 >> v1:172.21.15.155:6789/0 conn(0x7fabec0b6230 legacy=0x7fabec06a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:49.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.990+0000 7fabeb7fe700 1 -- 172.21.15.63:0/3845915948 >> v1:172.21.15.63:6789/0 conn(0x7fabec098500 legacy=0x7fabec1430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:49.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.990+0000 7fabeb7fe700 1 -- 172.21.15.63:0/3845915948 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec0b6610 con 0x7fabec1437d0 2020-05-18T21:35:49.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.990+0000 7fabeb7fe700 1 --2- 172.21.15.63:0/3845915948 >> v2:172.21.15.155:3300/0 conn(0x7fabec1437d0 0x7fabec147310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fabdc002f70 tx=0x7fabdc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:49.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.990+0000 7fabeb7fe700 1 --2- 172.21.15.63:0/3845915948 >> v2:172.21.15.155:3300/0 conn(0x7fabec1437d0 0x7fabec147310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fabdc002f70 tx=0x7fabdc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:49.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.990+0000 7fabeb7fe700 1 --2- 172.21.15.63:0/3845915948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabec1437d0 0x7fabec147310 secure :-1 s=READY pgs=1177 cs=0 l=1 rx=0x7fabdc002f70 tx=0x7fabdc007a80).ready entity=mon.1 client_cookie=cb36cd5ec8f219c0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:50.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.994+0000 7fabeb7fe700 1 --2- 172.21.15.63:0/3845915948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabec1437d0 0x7fabec147310 secure :-1 s=THROTTLE_DONE pgs=1177 cs=0 l=1 rx=0x7fabdc002f70 tx=0x7fabdc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.994+0000 7fabeb7fe700 1 --2- 172.21.15.63:0/3845915948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabec1437d0 0x7fabec147310 secure :-1 s=THROTTLE_DONE pgs=1177 cs=0 l=1 rx=0x7fabdc002f70 tx=0x7fabdc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.994+0000 7fabe9ffb700 1 -- 172.21.15.63:0/3845915948 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabdc008e80 con 0x7fabec1437d0 2020-05-18T21:35:50.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.994+0000 7fabeb7fe700 1 --2- 172.21.15.63:0/3845915948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabec1437d0 0x7fabec147310 secure :-1 s=THROTTLE_DONE pgs=1177 cs=0 l=1 rx=0x7fabdc002f70 tx=0x7fabdc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.994+0000 7fabe9ffb700 1 -- 172.21.15.63:0/3845915948 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabdc0116a0 con 0x7fabec1437d0 2020-05-18T21:35:50.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.994+0000 7fabe9ffb700 1 -- 172.21.15.63:0/3845915948 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabdc011ac0 con 0x7fabec1437d0 2020-05-18T21:35:50.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.994+0000 7fabf1a35700 1 -- 172.21.15.63:0/3845915948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabec1437d0 msgr2=0x7fabec147310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.994+0000 7fabf1a35700 1 --2- 172.21.15.63:0/3845915948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabec1437d0 0x7fabec147310 secure :-1 s=READY pgs=1177 cs=0 l=1 rx=0x7fabdc002f70 tx=0x7fabdc007a80).stop 2020-05-18T21:35:50.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.994+0000 7fabf1a35700 1 -- 172.21.15.63:0/3845915948 shutdown_connections 2020-05-18T21:35:50.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.994+0000 7fabf1a35700 1 --2- 172.21.15.63:0/3845915948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabec1437d0 0x7fabec147310 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:50.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.994+0000 7fabf1a35700 1 -- 172.21.15.63:0/3845915948 >> 172.21.15.63:0/3845915948 conn(0x7fabec0b9770 msgr2=0x7fabec0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:50.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.994+0000 7fabf1a35700 1 -- 172.21.15.63:0/3845915948 shutdown_connections 2020-05-18T21:35:50.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.994+0000 7fabf1a35700 1 -- 172.21.15.63:0/3845915948 wait complete. 2020-05-18T21:35:50.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.994+0000 7fabf1a35700 1 Processor -- start 2020-05-18T21:35:50.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.994+0000 7fabf1a35700 1 -- start start 2020-05-18T21:35:50.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabf1a35700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fabec0b6230 0x7fabec0b2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:50.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabf1a35700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabec1437d0 0x7fabec065940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:50.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabf1a35700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabec065da0 con 0x7fabec098500 2020-05-18T21:35:50.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabf1a35700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabec141d20 con 0x7fabec0b6230 2020-05-18T21:35:50.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabf1a35700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec142220 con 0x7fabec1437d0 2020-05-18T21:35:50.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabeaffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fabec098500 0x7fabec0afbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36666/0 (socket says 172.21.15.63:36666) 2020-05-18T21:35:50.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabeaffd700 1 -- 172.21.15.63:0/3772571912 learned_addr learned my addr 172.21.15.63:0/3772571912 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:50.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabea7fc700 1 --2- 172.21.15.63:0/3772571912 >> v2:172.21.15.155:3300/0 conn(0x7fabec0b6230 0x7fabec0b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:50.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabeb7fe700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabec1437d0 0x7fabec065940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:50.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabdbfff700 1 -- 172.21.15.63:0/3772571912 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920043846 0 0) 0x7fabec065da0 con 0x7fabec098500 2020-05-18T21:35:50.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabdbfff700 1 -- 172.21.15.63:0/3772571912 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabc8002fe0 con 0x7fabec098500 2020-05-18T21:35:50.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabea7fc700 1 -- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabec1437d0 msgr2=0x7fabec065940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabea7fc700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabec1437d0 0x7fabec065940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:50.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabea7fc700 1 -- 172.21.15.63:0/3772571912 >> v1:172.21.15.63:6789/0 conn(0x7fabec098500 legacy=0x7fabec0afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabea7fc700 1 -- 172.21.15.63:0/3772571912 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec156ee0 con 0x7fabec0b6230 2020-05-18T21:35:50.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabeb7fe700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabec1437d0 0x7fabec065940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:35:50.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabea7fc700 1 --2- 172.21.15.63:0/3772571912 >> v2:172.21.15.155:3300/0 conn(0x7fabec0b6230 0x7fabec0b2730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fabec060a10 tx=0x7fabe4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabea7fc700 1 --2- 172.21.15.63:0/3772571912 >> v2:172.21.15.155:3300/0 conn(0x7fabec0b6230 0x7fabec0b2730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fabec060a10 tx=0x7fabe4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabea7fc700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabec0b6230 0x7fabec0b2730 secure :-1 s=READY pgs=1178 cs=0 l=1 rx=0x7fabec060a10 tx=0x7fabe4010c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:50.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabea7fc700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabec0b6230 0x7fabec0b2730 secure :-1 s=THROTTLE_DONE pgs=1178 cs=0 l=1 rx=0x7fabec060a10 tx=0x7fabe4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabea7fc700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabec0b6230 0x7fabec0b2730 secure :-1 s=THROTTLE_DONE pgs=1178 cs=0 l=1 rx=0x7fabec060a10 tx=0x7fabe4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabdbfff700 1 -- 172.21.15.63:0/3772571912 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabe4012410 con 0x7fabec0b6230 2020-05-18T21:35:50.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabea7fc700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabec0b6230 0x7fabec0b2730 secure :-1 s=THROTTLE_DONE pgs=1178 cs=0 l=1 rx=0x7fabec060a10 tx=0x7fabe4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabdbfff700 1 -- 172.21.15.63:0/3772571912 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe4012570 con 0x7fabec0b6230 2020-05-18T21:35:50.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabdbfff700 1 -- 172.21.15.63:0/3772571912 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabe4012990 con 0x7fabec0b6230 2020-05-18T21:35:50.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabf1a35700 1 -- 172.21.15.63:0/3772571912 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabec0b0300 con 0x7fabec0b6230 2020-05-18T21:35:50.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabf1a35700 1 -- 172.21.15.63:0/3772571912 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabec145900 con 0x7fabec0b6230 2020-05-18T21:35:50.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabea7fc700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabec0b6230 0x7fabec0b2730 secure :-1 s=THROTTLE_DONE pgs=1178 cs=0 l=1 rx=0x7fabec060a10 tx=0x7fabe4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabf1a35700 1 -- 172.21.15.63:0/3772571912 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabec157070 con 0x7fabec0b6230 2020-05-18T21:35:50.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabdbfff700 1 -- 172.21.15.63:0/3772571912 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fabe4012c00 con 0x7fabec0b6230 2020-05-18T21:35:50.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabea7fc700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabec0b6230 0x7fabec0b2730 secure :-1 s=THROTTLE_DONE pgs=1178 cs=0 l=1 rx=0x7fabec060a10 tx=0x7fabe4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabdbfff700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabc804fd80 0x7fabc8052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:50.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabdbfff700 1 -- 172.21.15.63:0/3772571912 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fabe40090c0 con 0x7fabec0b6230 2020-05-18T21:35:50.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabeaffd700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabc804fd80 0x7fabc8052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:50.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabeaffd700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabc804fd80 0x7fabc8052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fabe0001110 tx=0x7fabe0001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabeaffd700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabc804fd80 0x7fabc8052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fabe0001110 tx=0x7fabe0001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:49.998+0000 7fabeaffd700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabc804fd80 0x7fabc8052240 secure :-1 s=READY pgs=691 cs=0 l=1 rx=0x7fabe0001110 tx=0x7fabe0001800).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:50.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.002+0000 7fabea7fc700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabec0b6230 0x7fabec0b2730 secure :-1 s=THROTTLE_DONE pgs=1178 cs=0 l=1 rx=0x7fabec060a10 tx=0x7fabe4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.002+0000 7fabdbfff700 1 -- 172.21.15.63:0/3772571912 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fabe403e4e0 con 0x7fabec0b6230 2020-05-18T21:35:50.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.150+0000 7fabf1a35700 1 -- 172.21.15.63:0/3772571912 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fabec0569e0 con 0x7fabec0b6230 2020-05-18T21:35:50.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.166+0000 7fabea7fc700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabec0b6230 0x7fabec0b2730 secure :-1 s=THROTTLE_DONE pgs=1178 cs=0 l=1 rx=0x7fabec060a10 tx=0x7fabe4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.166+0000 7fabdbfff700 1 -- 172.21.15.63:0/3772571912 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 25 and data pool 26 v101) v1 ==== 189+0+0 (secure 0 0 0) 0x7fabe4041b00 con 0x7fabec0b6230 2020-05-18T21:35:50.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.170+0000 7fabf1a35700 1 -- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabc804fd80 msgr2=0x7fabc8052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.170+0000 7fabf1a35700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabc804fd80 0x7fabc8052240 secure :-1 s=READY pgs=691 cs=0 l=1 rx=0x7fabe0001110 tx=0x7fabe0001800).stop 2020-05-18T21:35:50.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.170+0000 7fabf1a35700 1 -- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabec0b6230 msgr2=0x7fabec0b2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.170+0000 7fabf1a35700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabec0b6230 0x7fabec0b2730 secure :-1 s=READY pgs=1178 cs=0 l=1 rx=0x7fabec060a10 tx=0x7fabe4010c30).stop 2020-05-18T21:35:50.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.174+0000 7fabf1a35700 1 -- 172.21.15.63:0/3772571912 shutdown_connections 2020-05-18T21:35:50.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.174+0000 7fabf1a35700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fabc804fd80 0x7fabc8052240 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:50.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.174+0000 7fabf1a35700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabec1437d0 0x7fabec065940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:50.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.174+0000 7fabf1a35700 1 --2- 172.21.15.63:0/3772571912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabec0b6230 0x7fabec0b2730 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:50.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.174+0000 7fabf1a35700 1 -- 172.21.15.63:0/3772571912 >> 172.21.15.63:0/3772571912 conn(0x7fabec0b9770 msgr2=0x7fabec0b55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:50.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.174+0000 7fabf1a35700 1 -- 172.21.15.63:0/3772571912 shutdown_connections 2020-05-18T21:35:50.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.174+0000 7fabf1a35700 1 -- 172.21.15.63:0/3772571912 wait complete. 2020-05-18T21:35:50.186 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 25 and data pool 26 2020-05-18T21:35:50.200 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:35:50.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.286+0000 7fc76016f700 1 Processor -- start 2020-05-18T21:35:50.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.286+0000 7fc76016f700 1 -- start start 2020-05-18T21:35:50.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc76016f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc75813ff80 0x7fc7581493d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:50.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc76016f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc7580b4660 0x7fc758145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:50.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc76016f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc758149950 con 0x7fc7580b8f10 2020-05-18T21:35:50.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc76016f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7580b4a90 con 0x7fc7580b4660 2020-05-18T21:35:50.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc76016f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580985f0 con 0x7fc75813ff80 2020-05-18T21:35:50.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75d70a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc75813ff80 0x7fc7581493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:50.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75e70c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc7580b4660 0x7fc758145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:50.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75df0b700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fc7580b8f10 0x7fc75813f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:35002/0 (socket says 172.21.15.63:35002) 2020-05-18T21:35:50.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75df0b700 1 -- 172.21.15.63:0/452965618 learned_addr learned my addr 172.21.15.63:0/452965618 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:50.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75cf09700 1 -- 172.21.15.63:0/452965618 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213626759 0 0) 0x7fc758149950 con 0x7fc7580b8f10 2020-05-18T21:35:50.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75cf09700 1 -- 172.21.15.63:0/452965618 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc740003270 con 0x7fc7580b8f10 2020-05-18T21:35:50.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75d70a700 1 -- 172.21.15.63:0/452965618 >> v2:172.21.15.155:3300/0 conn(0x7fc7580b4660 msgr2=0x7fc758145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:50.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75d70a700 1 --2- 172.21.15.63:0/452965618 >> v2:172.21.15.155:3300/0 conn(0x7fc7580b4660 0x7fc758145dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:50.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75d70a700 1 -- 172.21.15.63:0/452965618 >> v1:172.21.15.155:6789/0 conn(0x7fc7580b8f10 legacy=0x7fc75813f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75d70a700 1 -- 172.21.15.63:0/452965618 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc758149bf0 con 0x7fc75813ff80 2020-05-18T21:35:50.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75e70c700 1 --2- 172.21.15.63:0/452965618 >> v2:172.21.15.155:3300/0 conn(0x7fc7580b4660 0x7fc758145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:35:50.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75d70a700 1 --2- 172.21.15.63:0/452965618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc75813ff80 0x7fc7581493d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc748002f70 tx=0x7fc748007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75d70a700 1 --2- 172.21.15.63:0/452965618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc75813ff80 0x7fc7581493d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc748002f70 tx=0x7fc748007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75d70a700 1 --2- 172.21.15.63:0/452965618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc75813ff80 0x7fc7581493d0 secure :-1 s=READY pgs=266 cs=0 l=1 rx=0x7fc748002f70 tx=0x7fc748007a80).ready entity=mon.2 client_cookie=79727c0d30948939 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:50.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75d70a700 1 --2- 172.21.15.63:0/452965618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc75813ff80 0x7fc7581493d0 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7fc748002f70 tx=0x7fc748007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75cf09700 1 -- 172.21.15.63:0/452965618 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc748008e80 con 0x7fc75813ff80 2020-05-18T21:35:50.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75d70a700 1 --2- 172.21.15.63:0/452965618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc75813ff80 0x7fc7581493d0 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7fc748002f70 tx=0x7fc748007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75d70a700 1 --2- 172.21.15.63:0/452965618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc75813ff80 0x7fc7581493d0 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7fc748002f70 tx=0x7fc748007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75cf09700 1 -- 172.21.15.63:0/452965618 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc748011540 con 0x7fc75813ff80 2020-05-18T21:35:50.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc75cf09700 1 -- 172.21.15.63:0/452965618 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc748011960 con 0x7fc75813ff80 2020-05-18T21:35:50.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc76016f700 1 -- 172.21.15.63:0/452965618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc75813ff80 msgr2=0x7fc7581493d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc76016f700 1 --2- 172.21.15.63:0/452965618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc75813ff80 0x7fc7581493d0 secure :-1 s=READY pgs=266 cs=0 l=1 rx=0x7fc748002f70 tx=0x7fc748007a80).stop 2020-05-18T21:35:50.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc76016f700 1 -- 172.21.15.63:0/452965618 shutdown_connections 2020-05-18T21:35:50.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc76016f700 1 --2- 172.21.15.63:0/452965618 >> v2:172.21.15.155:3300/0 conn(0x7fc7580b4660 0x7fc758145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc76016f700 1 --2- 172.21.15.63:0/452965618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc75813ff80 0x7fc7581493d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc76016f700 1 -- 172.21.15.63:0/452965618 >> 172.21.15.63:0/452965618 conn(0x7fc75805a7c0 msgr2=0x7fc75805aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc76016f700 1 -- 172.21.15.63:0/452965618 shutdown_connections 2020-05-18T21:35:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.290+0000 7fc76016f700 1 -- 172.21.15.63:0/452965618 wait complete. 2020-05-18T21:35:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.294+0000 7fc76016f700 1 Processor -- start 2020-05-18T21:35:50.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.294+0000 7fc76016f700 1 -- start start 2020-05-18T21:35:50.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.294+0000 7fc76016f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc75813ff80 0x7fc758062410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:50.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.294+0000 7fc76016f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75809a090 con 0x7fc7580b8f10 2020-05-18T21:35:50.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.294+0000 7fc76016f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc758063cf0 con 0x7fc7580b4660 2020-05-18T21:35:50.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.294+0000 7fc76016f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc758063f90 con 0x7fc75813ff80 2020-05-18T21:35:50.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.294+0000 7fc75d70a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc7580b8f10 0x7fc758131000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36692/0 (socket says 172.21.15.63:36692) 2020-05-18T21:35:50.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.294+0000 7fc75d70a700 1 -- 172.21.15.63:0/3002359337 learned_addr learned my addr 172.21.15.63:0/3002359337 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:50.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.294+0000 7fc75e70c700 1 --2- 172.21.15.63:0/3002359337 >> v2:172.21.15.155:3300/0 conn(0x7fc75813ff80 0x7fc758062410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:50.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.294+0000 7fc746ffd700 1 -- 172.21.15.63:0/3002359337 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729800445 0 0) 0x7fc75809a090 con 0x7fc7580b8f10 2020-05-18T21:35:50.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.294+0000 7fc746ffd700 1 -- 172.21.15.63:0/3002359337 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc738002fe0 con 0x7fc7580b8f10 2020-05-18T21:35:50.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc75e70c700 1 -- 172.21.15.63:0/3002359337 >> v1:172.21.15.155:6789/0 conn(0x7fc7580b4660 legacy=0x7fc758153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc746ffd700 1 -- 172.21.15.63:0/3002359337 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146013353 0 0) 0x7fc758063cf0 con 0x7fc7580b4660 2020-05-18T21:35:50.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc75e70c700 1 -- 172.21.15.63:0/3002359337 >> v1:172.21.15.63:6789/0 conn(0x7fc7580b8f10 legacy=0x7fc758131000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc75e70c700 1 -- 172.21.15.63:0/3002359337 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7580639e0 con 0x7fc75813ff80 2020-05-18T21:35:50.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc75e70c700 1 --2- 172.21.15.63:0/3002359337 >> v2:172.21.15.155:3300/0 conn(0x7fc75813ff80 0x7fc758062410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc750002f70 tx=0x7fc750010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc75e70c700 1 --2- 172.21.15.63:0/3002359337 >> v2:172.21.15.155:3300/0 conn(0x7fc75813ff80 0x7fc758062410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc750002f70 tx=0x7fc750010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc75e70c700 1 --2- 172.21.15.63:0/3002359337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc75813ff80 0x7fc758062410 secure :-1 s=READY pgs=1181 cs=0 l=1 rx=0x7fc750002f70 tx=0x7fc750010d00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:50.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc75e70c700 1 --2- 172.21.15.63:0/3002359337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc75813ff80 0x7fc758062410 secure :-1 s=THROTTLE_DONE pgs=1181 cs=0 l=1 rx=0x7fc750002f70 tx=0x7fc750010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc746ffd700 1 -- 172.21.15.63:0/3002359337 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc750007180 con 0x7fc75813ff80 2020-05-18T21:35:50.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc75e70c700 1 --2- 172.21.15.63:0/3002359337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc75813ff80 0x7fc758062410 secure :-1 s=THROTTLE_DONE pgs=1181 cs=0 l=1 rx=0x7fc750002f70 tx=0x7fc750010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc746ffd700 1 -- 172.21.15.63:0/3002359337 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7500072e0 con 0x7fc75813ff80 2020-05-18T21:35:50.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc75e70c700 1 --2- 172.21.15.63:0/3002359337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc75813ff80 0x7fc758062410 secure :-1 s=THROTTLE_DONE pgs=1181 cs=0 l=1 rx=0x7fc750002f70 tx=0x7fc750010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc76016f700 1 -- 172.21.15.63:0/3002359337 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc758131710 con 0x7fc75813ff80 2020-05-18T21:35:50.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc746ffd700 1 -- 172.21.15.63:0/3002359337 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc75000c3e0 con 0x7fc75813ff80 2020-05-18T21:35:50.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc76016f700 1 -- 172.21.15.63:0/3002359337 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7580662a0 con 0x7fc75813ff80 2020-05-18T21:35:50.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc75e70c700 1 --2- 172.21.15.63:0/3002359337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc75813ff80 0x7fc758062410 secure :-1 s=THROTTLE_DONE pgs=1181 cs=0 l=1 rx=0x7fc750002f70 tx=0x7fc750010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc76016f700 1 -- 172.21.15.63:0/3002359337 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7580569e0 con 0x7fc75813ff80 2020-05-18T21:35:50.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc746ffd700 1 -- 172.21.15.63:0/3002359337 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc75000c5e0 con 0x7fc75813ff80 2020-05-18T21:35:50.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc75e70c700 1 --2- 172.21.15.63:0/3002359337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc75813ff80 0x7fc758062410 secure :-1 s=THROTTLE_DONE pgs=1181 cs=0 l=1 rx=0x7fc750002f70 tx=0x7fc750010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc746ffd700 1 --2- 172.21.15.63:0/3002359337 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc73804fce0 0x7fc7380521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:50.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.298+0000 7fc746ffd700 1 -- 172.21.15.63:0/3002359337 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc750064390 con 0x7fc75813ff80 2020-05-18T21:35:50.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.302+0000 7fc75df0b700 1 --2- 172.21.15.63:0/3002359337 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc73804fce0 0x7fc7380521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:50.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.302+0000 7fc75df0b700 1 --2- 172.21.15.63:0/3002359337 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc73804fce0 0x7fc7380521a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc754001410 tx=0x7fc754001a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.302+0000 7fc75df0b700 1 --2- 172.21.15.63:0/3002359337 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc73804fce0 0x7fc7380521a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc754001410 tx=0x7fc754001a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.302+0000 7fc75df0b700 1 --2- 172.21.15.63:0/3002359337 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc73804fce0 0x7fc7380521a0 secure :-1 s=READY pgs=694 cs=0 l=1 rx=0x7fc754001410 tx=0x7fc754001a10).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:50.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.310+0000 7fc75e70c700 1 --2- 172.21.15.63:0/3002359337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc75813ff80 0x7fc758062410 secure :-1 s=THROTTLE_DONE pgs=1181 cs=0 l=1 rx=0x7fc750002f70 tx=0x7fc750010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.310+0000 7fc746ffd700 1 -- 172.21.15.63:0/3002359337 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc75003e760 con 0x7fc75813ff80 2020-05-18T21:35:50.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.426+0000 7fc76016f700 1 -- 172.21.15.63:0/3002359337 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc758066be0 con 0x7fc75813ff80 2020-05-18T21:35:50.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.430+0000 7fc75e70c700 1 --2- 172.21.15.63:0/3002359337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc75813ff80 0x7fc758062410 secure :-1 s=THROTTLE_DONE pgs=1181 cs=0 l=1 rx=0x7fc750002f70 tx=0x7fc750010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.430+0000 7fc746ffd700 1 -- 172.21.15.63:0/3002359337 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+16116 (secure 0 0 0) 0x7fc750041d80 con 0x7fc75813ff80 2020-05-18T21:35:50.434 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:50.435 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":133,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:35:50.157407+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:35:48.494447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2020-05-18T21:35:49.149601+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:35:50.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.434+0000 7fc76016f700 1 -- 172.21.15.63:0/3002359337 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc73804fce0 msgr2=0x7fc7380521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.434+0000 7fc76016f700 1 --2- 172.21.15.63:0/3002359337 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc73804fce0 0x7fc7380521a0 secure :-1 s=READY pgs=694 cs=0 l=1 rx=0x7fc754001410 tx=0x7fc754001a10).stop 2020-05-18T21:35:50.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.434+0000 7fc76016f700 1 -- 172.21.15.63:0/3002359337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc75813ff80 msgr2=0x7fc758062410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.434+0000 7fc76016f700 1 --2- 172.21.15.63:0/3002359337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc75813ff80 0x7fc758062410 secure :-1 s=READY pgs=1181 cs=0 l=1 rx=0x7fc750002f70 tx=0x7fc750010d00).stop 2020-05-18T21:35:50.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.434+0000 7fc76016f700 1 -- 172.21.15.63:0/3002359337 shutdown_connections 2020-05-18T21:35:50.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.434+0000 7fc76016f700 1 --2- 172.21.15.63:0/3002359337 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc73804fce0 0x7fc7380521a0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:50.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.434+0000 7fc76016f700 1 --2- 172.21.15.63:0/3002359337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc75813ff80 0x7fc758062410 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:50.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.434+0000 7fc76016f700 1 -- 172.21.15.63:0/3002359337 >> 172.21.15.63:0/3002359337 conn(0x7fc75805a7c0 msgr2=0x7fc75809e260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:50.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.434+0000 7fc76016f700 1 -- 172.21.15.63:0/3002359337 shutdown_connections 2020-05-18T21:35:50.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.434+0000 7fc76016f700 1 -- 172.21.15.63:0/3002359337 wait complete. 2020-05-18T21:35:50.452 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:35:50.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.550+0000 7fd25359e700 1 Processor -- start 2020-05-18T21:35:50.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.550+0000 7fd25359e700 1 -- start start 2020-05-18T21:35:50.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.550+0000 7fd25359e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd254063ce0 0x7fd254147140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:50.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.550+0000 7fd25359e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2541476c0 con 0x7fd2540ad180 2020-05-18T21:35:50.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.550+0000 7fd25359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd254147960 con 0x7fd2541435d0 2020-05-18T21:35:50.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.550+0000 7fd25359e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd254148130 con 0x7fd254063ce0 2020-05-18T21:35:50.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.550+0000 7fd252d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd2540ad180 0x7fd2540ad5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36702/0 (socket says 172.21.15.63:36702) 2020-05-18T21:35:50.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.550+0000 7fd252d9d700 1 -- 172.21.15.63:0/1090138053 learned_addr learned my addr 172.21.15.63:0/1090138053 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:50.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd251d9b700 1 --2- 172.21.15.63:0/1090138053 >> v2:172.21.15.155:3300/0 conn(0x7fd254063ce0 0x7fd254147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:50.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd25159a700 1 -- 172.21.15.63:0/1090138053 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745424184 0 0) 0x7fd2541476c0 con 0x7fd2540ad180 2020-05-18T21:35:50.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd25159a700 1 -- 172.21.15.63:0/1090138053 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd234003270 con 0x7fd2540ad180 2020-05-18T21:35:50.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd251d9b700 1 -- 172.21.15.63:0/1090138053 >> v1:172.21.15.155:6789/0 conn(0x7fd2541435d0 legacy=0x7fd25405edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd251d9b700 1 -- 172.21.15.63:0/1090138053 >> v1:172.21.15.63:6789/0 conn(0x7fd2540ad180 legacy=0x7fd2540ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd251d9b700 1 -- 172.21.15.63:0/1090138053 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd254147c00 con 0x7fd254063ce0 2020-05-18T21:35:50.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd251d9b700 1 --2- 172.21.15.63:0/1090138053 >> v2:172.21.15.155:3300/0 conn(0x7fd254063ce0 0x7fd254147140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd23c0032f0 tx=0x7fd23c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd251d9b700 1 --2- 172.21.15.63:0/1090138053 >> v2:172.21.15.155:3300/0 conn(0x7fd254063ce0 0x7fd254147140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd23c0032f0 tx=0x7fd23c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd251d9b700 1 --2- 172.21.15.63:0/1090138053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd254063ce0 0x7fd254147140 secure :-1 s=READY pgs=1183 cs=0 l=1 rx=0x7fd23c0032f0 tx=0x7fd23c007e00).ready entity=mon.1 client_cookie=cd0a160cee366991 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:50.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd251d9b700 1 --2- 172.21.15.63:0/1090138053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd254063ce0 0x7fd254147140 secure :-1 s=THROTTLE_DONE pgs=1183 cs=0 l=1 rx=0x7fd23c0032f0 tx=0x7fd23c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd25159a700 1 -- 172.21.15.63:0/1090138053 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd23c011e60 con 0x7fd254063ce0 2020-05-18T21:35:50.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd251d9b700 1 --2- 172.21.15.63:0/1090138053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd254063ce0 0x7fd254147140 secure :-1 s=THROTTLE_DONE pgs=1183 cs=0 l=1 rx=0x7fd23c0032f0 tx=0x7fd23c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd251d9b700 1 --2- 172.21.15.63:0/1090138053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd254063ce0 0x7fd254147140 secure :-1 s=THROTTLE_DONE pgs=1183 cs=0 l=1 rx=0x7fd23c0032f0 tx=0x7fd23c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd25159a700 1 -- 172.21.15.63:0/1090138053 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c00a180 con 0x7fd254063ce0 2020-05-18T21:35:50.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd25159a700 1 -- 172.21.15.63:0/1090138053 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd23c00a520 con 0x7fd254063ce0 2020-05-18T21:35:50.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd25359e700 1 -- 172.21.15.63:0/1090138053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd254063ce0 msgr2=0x7fd254147140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd25359e700 1 --2- 172.21.15.63:0/1090138053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd254063ce0 0x7fd254147140 secure :-1 s=READY pgs=1183 cs=0 l=1 rx=0x7fd23c0032f0 tx=0x7fd23c007e00).stop 2020-05-18T21:35:50.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd25359e700 1 -- 172.21.15.63:0/1090138053 shutdown_connections 2020-05-18T21:35:50.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd25359e700 1 --2- 172.21.15.63:0/1090138053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd254063ce0 0x7fd254147140 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:50.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd25359e700 1 -- 172.21.15.63:0/1090138053 >> 172.21.15.63:0/1090138053 conn(0x7fd254069fc0 msgr2=0x7fd25406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:50.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd25359e700 1 -- 172.21.15.63:0/1090138053 shutdown_connections 2020-05-18T21:35:50.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd25359e700 1 -- 172.21.15.63:0/1090138053 wait complete. 2020-05-18T21:35:50.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd25359e700 1 Processor -- start 2020-05-18T21:35:50.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.554+0000 7fd25359e700 1 -- start start 2020-05-18T21:35:50.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd25359e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd254063ce0 0x7fd254132b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:50.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd25359e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd2540ad180 0x7fd254132fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:50.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd25359e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd2541435d0 0x7fd254131c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:50.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd25359e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2540b4ae0 con 0x7fd2541435d0 2020-05-18T21:35:50.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd25359e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2541462b0 con 0x7fd2540ad180 2020-05-18T21:35:50.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd25359e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd254146510 con 0x7fd254063ce0 2020-05-18T21:35:50.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd252d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd2541435d0 0x7fd254131c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:50.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd252d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd2541435d0 0x7fd254131c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34520/0 (socket says 172.21.15.63:34520) 2020-05-18T21:35:50.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd252d9d700 1 -- 172.21.15.63:0/636490963 learned_addr learned my addr 172.21.15.63:0/636490963 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:50.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd251d9b700 1 --2- 172.21.15.63:0/636490963 >> v2:172.21.15.155:3300/0 conn(0x7fd2540ad180 0x7fd254132fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:50.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd25259c700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd254063ce0 0x7fd254132b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:50.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd252d9d700 1 -- 172.21.15.63:0/636490963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd254063ce0 msgr2=0x7fd254132b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd252d9d700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd254063ce0 0x7fd254132b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:50.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd252d9d700 1 -- 172.21.15.63:0/636490963 >> v2:172.21.15.155:3300/0 conn(0x7fd2540ad180 msgr2=0x7fd254132fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd252d9d700 1 --2- 172.21.15.63:0/636490963 >> v2:172.21.15.155:3300/0 conn(0x7fd2540ad180 0x7fd254132fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:50.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd252d9d700 1 -- 172.21.15.63:0/636490963 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2541452f0 con 0x7fd2541435d0 2020-05-18T21:35:50.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd252d9d700 1 --2- 172.21.15.63:0/636490963 >> v2:172.21.15.63:3300/0 conn(0x7fd2541435d0 0x7fd254131c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd24c001110 tx=0x7fd24c010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd252d9d700 1 --2- 172.21.15.63:0/636490963 >> v2:172.21.15.63:3300/0 conn(0x7fd2541435d0 0x7fd254131c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd24c001110 tx=0x7fd24c010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd252d9d700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2541435d0 0x7fd254131c50 secure :-1 s=READY pgs=1791 cs=0 l=1 rx=0x7fd24c001110 tx=0x7fd24c010950).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:50.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd252d9d700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2541435d0 0x7fd254131c50 secure :-1 s=THROTTLE_DONE pgs=1791 cs=0 l=1 rx=0x7fd24c001110 tx=0x7fd24c010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd24b7fe700 1 -- 172.21.15.63:0/636490963 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd24c005d00 con 0x7fd2541435d0 2020-05-18T21:35:50.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd252d9d700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2541435d0 0x7fd254131c50 secure :-1 s=THROTTLE_DONE pgs=1791 cs=0 l=1 rx=0x7fd24c001110 tx=0x7fd24c010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd25359e700 1 -- 172.21.15.63:0/636490963 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2541455c0 con 0x7fd2541435d0 2020-05-18T21:35:50.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd24b7fe700 1 -- 172.21.15.63:0/636490963 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24c005e60 con 0x7fd2541435d0 2020-05-18T21:35:50.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd252d9d700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2541435d0 0x7fd254131c50 secure :-1 s=THROTTLE_DONE pgs=1791 cs=0 l=1 rx=0x7fd24c001110 tx=0x7fd24c010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd24b7fe700 1 -- 172.21.15.63:0/636490963 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd24c009470 con 0x7fd2541435d0 2020-05-18T21:35:50.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd25359e700 1 -- 172.21.15.63:0/636490963 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd254146cf0 con 0x7fd2541435d0 2020-05-18T21:35:50.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd252d9d700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2541435d0 0x7fd254131c50 secure :-1 s=THROTTLE_DONE pgs=1791 cs=0 l=1 rx=0x7fd24c001110 tx=0x7fd24c010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd24b7fe700 1 -- 172.21.15.63:0/636490963 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd24c0095d0 con 0x7fd2541435d0 2020-05-18T21:35:50.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd252d9d700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2541435d0 0x7fd254131c50 secure :-1 s=THROTTLE_DONE pgs=1791 cs=0 l=1 rx=0x7fd24c001110 tx=0x7fd24c010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd25359e700 1 -- 172.21.15.63:0/636490963 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2540569e0 con 0x7fd2541435d0 2020-05-18T21:35:50.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd24b7fe700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd23804fa90 0x7fd238051f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:50.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.558+0000 7fd24b7fe700 1 -- 172.21.15.63:0/636490963 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd24c0090c0 con 0x7fd2541435d0 2020-05-18T21:35:50.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.562+0000 7fd25259c700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd23804fa90 0x7fd238051f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:50.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.562+0000 7fd25259c700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd23804fa90 0x7fd238051f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd254060310 tx=0x7fd244003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.562+0000 7fd25259c700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd23804fa90 0x7fd238051f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd254060310 tx=0x7fd244003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.562+0000 7fd25259c700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd23804fa90 0x7fd238051f50 secure :-1 s=READY pgs=695 cs=0 l=1 rx=0x7fd254060310 tx=0x7fd244003e60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:50.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.566+0000 7fd252d9d700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2541435d0 0x7fd254131c50 secure :-1 s=THROTTLE_DONE pgs=1791 cs=0 l=1 rx=0x7fd24c001110 tx=0x7fd24c010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.566+0000 7fd24b7fe700 1 -- 172.21.15.63:0/636490963 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd24c03e0e0 con 0x7fd2541435d0 2020-05-18T21:35:50.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.682+0000 7fd25359e700 1 -- 172.21.15.63:0/636490963 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2541466e0 con 0x7fd2541435d0 2020-05-18T21:35:50.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.682+0000 7fd252d9d700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2541435d0 0x7fd254131c50 secure :-1 s=THROTTLE_DONE pgs=1791 cs=0 l=1 rx=0x7fd24c001110 tx=0x7fd24c010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.682+0000 7fd24b7fe700 1 -- 172.21.15.63:0/636490963 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+16116 (secure 0 0 0) 0x7fd24c041700 con 0x7fd2541435d0 2020-05-18T21:35:50.688 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:50.688 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":133,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:35:50.157407+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:35:48.494447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2020-05-18T21:35:49.149601+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:35:50.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.686+0000 7fd25359e700 1 -- 172.21.15.63:0/636490963 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd23804fa90 msgr2=0x7fd238051f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.686+0000 7fd25359e700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd23804fa90 0x7fd238051f50 secure :-1 s=READY pgs=695 cs=0 l=1 rx=0x7fd254060310 tx=0x7fd244003e60).stop 2020-05-18T21:35:50.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.686+0000 7fd25359e700 1 -- 172.21.15.63:0/636490963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2541435d0 msgr2=0x7fd254131c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.686+0000 7fd25359e700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2541435d0 0x7fd254131c50 secure :-1 s=READY pgs=1791 cs=0 l=1 rx=0x7fd24c001110 tx=0x7fd24c010950).stop 2020-05-18T21:35:50.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.686+0000 7fd25359e700 1 -- 172.21.15.63:0/636490963 shutdown_connections 2020-05-18T21:35:50.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.686+0000 7fd25359e700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd23804fa90 0x7fd238051f50 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:50.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.686+0000 7fd25359e700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2541435d0 0x7fd254131c50 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:50.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.686+0000 7fd25359e700 1 --2- 172.21.15.63:0/636490963 >> v2:172.21.15.155:3300/0 conn(0x7fd2540ad180 0x7fd254132fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:50.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.686+0000 7fd25359e700 1 --2- 172.21.15.63:0/636490963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd254063ce0 0x7fd254132b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:50.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.686+0000 7fd25359e700 1 -- 172.21.15.63:0/636490963 >> 172.21.15.63:0/636490963 conn(0x7fd254069fc0 msgr2=0x7fd25413f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:50.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.686+0000 7fd25359e700 1 -- 172.21.15.63:0/636490963 shutdown_connections 2020-05-18T21:35:50.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.686+0000 7fd25359e700 1 -- 172.21.15.63:0/636490963 wait complete. 2020-05-18T21:35:50.701 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-05-18T21:35:50.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.806+0000 7f4949447700 1 Processor -- start 2020-05-18T21:35:50.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.806+0000 7f4949447700 1 -- start start 2020-05-18T21:35:50.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4949447700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f49440b3d30 0x7f494405f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:50.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4949447700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49440660d0 0x7f49440b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:50.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4949447700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494405ed30 con 0x7f494413fab0 2020-05-18T21:35:50.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4949447700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494405efd0 con 0x7f49440b3d30 2020-05-18T21:35:50.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4949447700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494405f270 con 0x7f49440660d0 2020-05-18T21:35:50.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f49427fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49440660d0 0x7f49440b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:50.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4942ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f49440b3d30 0x7f494405f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:50.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f49437fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f494413fab0 0x7f4944149520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:35030/0 (socket says 172.21.15.63:35030) 2020-05-18T21:35:50.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f49427fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49440660d0 0x7f49440b4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:53460/0 (socket says 172.21.15.63:53460) 2020-05-18T21:35:50.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f49437fe700 1 -- 172.21.15.63:0/2116054853 learned_addr learned my addr 172.21.15.63:0/2116054853 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:50.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4941ffb700 1 -- 172.21.15.63:0/2116054853 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83011894 0 0) 0x7f494405ed30 con 0x7f494413fab0 2020-05-18T21:35:50.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4941ffb700 1 -- 172.21.15.63:0/2116054853 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4928003270 con 0x7f494413fab0 2020-05-18T21:35:50.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4942ffd700 1 -- 172.21.15.63:0/2116054853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49440660d0 msgr2=0x7f49440b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:50.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4942ffd700 1 --2- 172.21.15.63:0/2116054853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49440660d0 0x7f49440b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:50.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4942ffd700 1 -- 172.21.15.63:0/2116054853 >> v1:172.21.15.155:6789/0 conn(0x7f494413fab0 legacy=0x7f4944149520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4942ffd700 1 -- 172.21.15.63:0/2116054853 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49440b4570 con 0x7f49440b3d30 2020-05-18T21:35:50.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f49427fc700 1 --2- 172.21.15.63:0/2116054853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49440660d0 0x7f49440b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:35:50.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4942ffd700 1 --2- 172.21.15.63:0/2116054853 >> v2:172.21.15.155:3300/0 conn(0x7f49440b3d30 0x7f494405f710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f494405f5f0 tx=0x7f4938008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4942ffd700 1 --2- 172.21.15.63:0/2116054853 >> v2:172.21.15.155:3300/0 conn(0x7f49440b3d30 0x7f494405f710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f494405f5f0 tx=0x7f4938008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4942ffd700 1 --2- 172.21.15.63:0/2116054853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49440b3d30 0x7f494405f710 secure :-1 s=READY pgs=1185 cs=0 l=1 rx=0x7f494405f5f0 tx=0x7f4938008920).ready entity=mon.1 client_cookie=1fb8e80bca3199a9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:50.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4942ffd700 1 --2- 172.21.15.63:0/2116054853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49440b3d30 0x7f494405f710 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7f494405f5f0 tx=0x7f4938008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4941ffb700 1 -- 172.21.15.63:0/2116054853 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4938008e80 con 0x7f49440b3d30 2020-05-18T21:35:50.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4942ffd700 1 --2- 172.21.15.63:0/2116054853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49440b3d30 0x7f494405f710 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7f494405f5f0 tx=0x7f4938008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4942ffd700 1 --2- 172.21.15.63:0/2116054853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49440b3d30 0x7f494405f710 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7f494405f5f0 tx=0x7f4938008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4941ffb700 1 -- 172.21.15.63:0/2116054853 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4938011540 con 0x7f49440b3d30 2020-05-18T21:35:50.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4941ffb700 1 -- 172.21.15.63:0/2116054853 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4938011960 con 0x7f49440b3d30 2020-05-18T21:35:50.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4949447700 1 -- 172.21.15.63:0/2116054853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49440b3d30 msgr2=0x7f494405f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4949447700 1 --2- 172.21.15.63:0/2116054853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49440b3d30 0x7f494405f710 secure :-1 s=READY pgs=1185 cs=0 l=1 rx=0x7f494405f5f0 tx=0x7f4938008920).stop 2020-05-18T21:35:50.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4949447700 1 -- 172.21.15.63:0/2116054853 shutdown_connections 2020-05-18T21:35:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4949447700 1 --2- 172.21.15.63:0/2116054853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49440660d0 0x7f49440b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4949447700 1 --2- 172.21.15.63:0/2116054853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49440b3d30 0x7f494405f710 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4949447700 1 -- 172.21.15.63:0/2116054853 >> 172.21.15.63:0/2116054853 conn(0x7f49440b7080 msgr2=0x7f49440b7490 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4949447700 1 -- 172.21.15.63:0/2116054853 shutdown_connections 2020-05-18T21:35:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.810+0000 7f4949447700 1 -- 172.21.15.63:0/2116054853 wait complete. 2020-05-18T21:35:50.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f4949447700 1 Processor -- start 2020-05-18T21:35:50.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f4949447700 1 -- start start 2020-05-18T21:35:50.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f4949447700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f49440b3d30 0x7f4944065580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:50.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f4949447700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f494413fab0 0x7f49441428c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:50.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f4949447700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4944142d20 con 0x7f49440660d0 2020-05-18T21:35:50.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f4949447700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4944140f50 con 0x7f49440b3d30 2020-05-18T21:35:50.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f4949447700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49441536b0 con 0x7f494413fab0 2020-05-18T21:35:50.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f49427fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f49440b3d30 0x7f4944065580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:50.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f4942ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f49440660d0 0x7f4944152620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36716/0 (socket says 172.21.15.63:36716) 2020-05-18T21:35:50.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f49427fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f49440b3d30 0x7f4944065580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34530/0 (socket says 172.21.15.63:34530) 2020-05-18T21:35:50.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f4942ffd700 1 -- 172.21.15.63:0/3065265453 learned_addr learned my addr 172.21.15.63:0/3065265453 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:50.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f49437fe700 1 --2- 172.21.15.63:0/3065265453 >> v2:172.21.15.155:3300/0 conn(0x7f494413fab0 0x7f49441428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:50.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f4933fff700 1 -- 172.21.15.63:0/3065265453 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540206285 0 0) 0x7f4944142d20 con 0x7f49440660d0 2020-05-18T21:35:50.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f49427fc700 1 -- 172.21.15.63:0/3065265453 >> v2:172.21.15.155:3300/0 conn(0x7f494413fab0 msgr2=0x7f49441428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f49427fc700 1 --2- 172.21.15.63:0/3065265453 >> v2:172.21.15.155:3300/0 conn(0x7f494413fab0 0x7f49441428c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:50.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f49427fc700 1 -- 172.21.15.63:0/3065265453 >> v1:172.21.15.63:6789/0 conn(0x7f49440660d0 legacy=0x7f4944152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:50.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f49427fc700 1 -- 172.21.15.63:0/3065265453 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4944153950 con 0x7f49440b3d30 2020-05-18T21:35:50.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f49427fc700 1 --2- 172.21.15.63:0/3065265453 >> v2:172.21.15.63:3300/0 conn(0x7f49440b3d30 0x7f4944065580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4934002f70 tx=0x7f4934010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f49427fc700 1 --2- 172.21.15.63:0/3065265453 >> v2:172.21.15.63:3300/0 conn(0x7f49440b3d30 0x7f4944065580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4934002f70 tx=0x7f4934010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.814+0000 7f49427fc700 1 --2- 172.21.15.63:0/3065265453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49440b3d30 0x7f4944065580 secure :-1 s=READY pgs=1793 cs=0 l=1 rx=0x7f4934002f70 tx=0x7f4934010dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:50.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.818+0000 7f49427fc700 1 --2- 172.21.15.63:0/3065265453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49440b3d30 0x7f4944065580 secure :-1 s=THROTTLE_DONE pgs=1793 cs=0 l=1 rx=0x7f4934002f70 tx=0x7f4934010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.818+0000 7f4933fff700 1 -- 172.21.15.63:0/3065265453 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f493400c980 con 0x7f49440b3d30 2020-05-18T21:35:50.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.818+0000 7f49427fc700 1 --2- 172.21.15.63:0/3065265453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49440b3d30 0x7f4944065580 secure :-1 s=THROTTLE_DONE pgs=1793 cs=0 l=1 rx=0x7f4934002f70 tx=0x7f4934010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.818+0000 7f49427fc700 1 --2- 172.21.15.63:0/3065265453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49440b3d30 0x7f4944065580 secure :-1 s=THROTTLE_DONE pgs=1793 cs=0 l=1 rx=0x7f4934002f70 tx=0x7f4934010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.818+0000 7f4933fff700 1 -- 172.21.15.63:0/3065265453 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493400cae0 con 0x7f49440b3d30 2020-05-18T21:35:50.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.818+0000 7f4949447700 1 -- 172.21.15.63:0/3065265453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4944153bf0 con 0x7f49440b3d30 2020-05-18T21:35:50.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.818+0000 7f4933fff700 1 -- 172.21.15.63:0/3065265453 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4934005700 con 0x7f49440b3d30 2020-05-18T21:35:50.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.818+0000 7f4949447700 1 -- 172.21.15.63:0/3065265453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4944154090 con 0x7f49440b3d30 2020-05-18T21:35:50.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.818+0000 7f4949447700 1 -- 172.21.15.63:0/3065265453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49440569e0 con 0x7f49440b3d30 2020-05-18T21:35:50.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.818+0000 7f49427fc700 1 --2- 172.21.15.63:0/3065265453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49440b3d30 0x7f4944065580 secure :-1 s=THROTTLE_DONE pgs=1793 cs=0 l=1 rx=0x7f4934002f70 tx=0x7f4934010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.818+0000 7f4933fff700 1 -- 172.21.15.63:0/3065265453 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f49340101b0 con 0x7f49440b3d30 2020-05-18T21:35:50.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.818+0000 7f49427fc700 1 --2- 172.21.15.63:0/3065265453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49440b3d30 0x7f4944065580 secure :-1 s=THROTTLE_DONE pgs=1793 cs=0 l=1 rx=0x7f4934002f70 tx=0x7f4934010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.818+0000 7f4933fff700 1 --2- 172.21.15.63:0/3065265453 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f492004f7d0 0x7f4920051c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:50.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.818+0000 7f4933fff700 1 -- 172.21.15.63:0/3065265453 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4934063c70 con 0x7f49440b3d30 2020-05-18T21:35:50.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.818+0000 7f4942ffd700 1 --2- 172.21.15.63:0/3065265453 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f492004f7d0 0x7f4920051c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:50.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.818+0000 7f4942ffd700 1 --2- 172.21.15.63:0/3065265453 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f492004f7d0 0x7f4920051c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49380100e0 tx=0x7f4944143ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.818+0000 7f4942ffd700 1 --2- 172.21.15.63:0/3065265453 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f492004f7d0 0x7f4920051c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49380100e0 tx=0x7f4944143ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.818+0000 7f4942ffd700 1 --2- 172.21.15.63:0/3065265453 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f492004f7d0 0x7f4920051c90 secure :-1 s=READY pgs=696 cs=0 l=1 rx=0x7f49380100e0 tx=0x7f4944143ac0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:50.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.826+0000 7f49427fc700 1 --2- 172.21.15.63:0/3065265453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49440b3d30 0x7f4944065580 secure :-1 s=THROTTLE_DONE pgs=1793 cs=0 l=1 rx=0x7f4934002f70 tx=0x7f4934010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:50.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.826+0000 7f4933fff700 1 -- 172.21.15.63:0/3065265453 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f493403dfa0 con 0x7f49440b3d30 2020-05-18T21:35:50.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:50.978+0000 7f4949447700 1 -- 172.21.15.63:0/3065265453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f49440008d0 con 0x7f49440b3d30 2020-05-18T21:35:51.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.178+0000 7f49427fc700 1 --2- 172.21.15.63:0/3065265453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49440b3d30 0x7f4944065580 secure :-1 s=THROTTLE_DONE pgs=1793 cs=0 l=1 rx=0x7f4934002f70 tx=0x7f4934010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.178+0000 7f4933fff700 1 -- 172.21.15.63:0/3065265453 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v102) v1 ==== 118+0+0 (secure 0 0 0) 0x7f49340415c0 con 0x7f49440b3d30 2020-05-18T21:35:51.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.182+0000 7f4949447700 1 -- 172.21.15.63:0/3065265453 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f492004f7d0 msgr2=0x7f4920051c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:51.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.182+0000 7f4949447700 1 --2- 172.21.15.63:0/3065265453 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f492004f7d0 0x7f4920051c90 secure :-1 s=READY pgs=696 cs=0 l=1 rx=0x7f49380100e0 tx=0x7f4944143ac0).stop 2020-05-18T21:35:51.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.182+0000 7f4949447700 1 -- 172.21.15.63:0/3065265453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49440b3d30 msgr2=0x7f4944065580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:51.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.182+0000 7f4949447700 1 --2- 172.21.15.63:0/3065265453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49440b3d30 0x7f4944065580 secure :-1 s=READY pgs=1793 cs=0 l=1 rx=0x7f4934002f70 tx=0x7f4934010dc0).stop 2020-05-18T21:35:51.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.182+0000 7f4949447700 1 -- 172.21.15.63:0/3065265453 shutdown_connections 2020-05-18T21:35:51.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.182+0000 7f4949447700 1 --2- 172.21.15.63:0/3065265453 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f492004f7d0 0x7f4920051c90 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:51.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.182+0000 7f4949447700 1 --2- 172.21.15.63:0/3065265453 >> v2:172.21.15.155:3300/0 conn(0x7f494413fab0 0x7f49441428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:51.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.182+0000 7f4949447700 1 --2- 172.21.15.63:0/3065265453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49440b3d30 0x7f4944065580 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:51.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.182+0000 7f4949447700 1 -- 172.21.15.63:0/3065265453 >> 172.21.15.63:0/3065265453 conn(0x7f49440b7080 msgr2=0x7f49441433b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:51.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.182+0000 7f4949447700 1 -- 172.21.15.63:0/3065265453 shutdown_connections 2020-05-18T21:35:51.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.182+0000 7f4949447700 1 -- 172.21.15.63:0/3065265453 wait complete. 2020-05-18T21:35:51.204 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:35:51.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.306+0000 7fad45899700 1 Processor -- start 2020-05-18T21:35:51.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.306+0000 7fad45899700 1 -- start start 2020-05-18T21:35:51.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45899700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad4009d4a0 0x7fad4009b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:51.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45899700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fad400b4ef0 0x7fad400b5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:51.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45899700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4009bd20 con 0x7fad40099120 2020-05-18T21:35:51.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45899700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4009bfc0 con 0x7fad400b4ef0 2020-05-18T21:35:51.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45899700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4009c260 con 0x7fad4009d4a0 2020-05-18T21:35:51.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45098700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fad400b4ef0 0x7fad400b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:51.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45098700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fad400b4ef0 0x7fad400b5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34540/0 (socket says 172.21.15.63:34540) 2020-05-18T21:35:51.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45098700 1 -- 172.21.15.63:0/791050347 learned_addr learned my addr 172.21.15.63:0/791050347 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:51.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad44897700 1 --2- 172.21.15.63:0/791050347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad4009d4a0 0x7fad4009b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:51.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45098700 1 -- 172.21.15.63:0/791050347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad4009d4a0 msgr2=0x7fad4009b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:51.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45098700 1 --2- 172.21.15.63:0/791050347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad4009d4a0 0x7fad4009b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:51.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45098700 1 -- 172.21.15.63:0/791050347 >> v1:172.21.15.155:6789/0 conn(0x7fad40099120 legacy=0x7fad4009c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:51.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45098700 1 -- 172.21.15.63:0/791050347 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4009dbc0 con 0x7fad400b4ef0 2020-05-18T21:35:51.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad44897700 1 --2- 172.21.15.63:0/791050347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad4009d4a0 0x7fad4009b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:35:51.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45098700 1 --2- 172.21.15.63:0/791050347 >> v2:172.21.15.63:3300/0 conn(0x7fad400b4ef0 0x7fad400b5380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fad380032f0 tx=0x7fad38007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45098700 1 --2- 172.21.15.63:0/791050347 >> v2:172.21.15.63:3300/0 conn(0x7fad400b4ef0 0x7fad400b5380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fad380032f0 tx=0x7fad38007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45098700 1 --2- 172.21.15.63:0/791050347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad400b4ef0 0x7fad400b5380 secure :-1 s=READY pgs=1794 cs=0 l=1 rx=0x7fad380032f0 tx=0x7fad38007e00).ready entity=mon.0 client_cookie=aae437612e516185 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:51.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45098700 1 --2- 172.21.15.63:0/791050347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad400b4ef0 0x7fad400b5380 secure :-1 s=THROTTLE_DONE pgs=1794 cs=0 l=1 rx=0x7fad380032f0 tx=0x7fad38007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad3f7fe700 1 -- 172.21.15.63:0/791050347 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad38011dc0 con 0x7fad400b4ef0 2020-05-18T21:35:51.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45098700 1 --2- 172.21.15.63:0/791050347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad400b4ef0 0x7fad400b5380 secure :-1 s=THROTTLE_DONE pgs=1794 cs=0 l=1 rx=0x7fad380032f0 tx=0x7fad38007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45098700 1 --2- 172.21.15.63:0/791050347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad400b4ef0 0x7fad400b5380 secure :-1 s=THROTTLE_DONE pgs=1794 cs=0 l=1 rx=0x7fad380032f0 tx=0x7fad38007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad3f7fe700 1 -- 172.21.15.63:0/791050347 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3800a180 con 0x7fad400b4ef0 2020-05-18T21:35:51.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad3f7fe700 1 -- 172.21.15.63:0/791050347 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad3800a5a0 con 0x7fad400b4ef0 2020-05-18T21:35:51.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45899700 1 -- 172.21.15.63:0/791050347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad400b4ef0 msgr2=0x7fad400b5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:51.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45899700 1 --2- 172.21.15.63:0/791050347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad400b4ef0 0x7fad400b5380 secure :-1 s=READY pgs=1794 cs=0 l=1 rx=0x7fad380032f0 tx=0x7fad38007e00).stop 2020-05-18T21:35:51.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45899700 1 -- 172.21.15.63:0/791050347 shutdown_connections 2020-05-18T21:35:51.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45899700 1 --2- 172.21.15.63:0/791050347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad400b4ef0 0x7fad400b5380 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:51.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45899700 1 --2- 172.21.15.63:0/791050347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad4009d4a0 0x7fad4009b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:51.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45899700 1 -- 172.21.15.63:0/791050347 >> 172.21.15.63:0/791050347 conn(0x7fad4005f630 msgr2=0x7fad4005a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:51.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45899700 1 -- 172.21.15.63:0/791050347 shutdown_connections 2020-05-18T21:35:51.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45899700 1 -- 172.21.15.63:0/791050347 wait complete. 2020-05-18T21:35:51.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45899700 1 Processor -- start 2020-05-18T21:35:51.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.310+0000 7fad45899700 1 -- start start 2020-05-18T21:35:51.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad45899700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fad40099120 0x7fad401456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:51.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad45899700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad4009d4a0 0x7fad400b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:51.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad45899700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad40145b40 con 0x7fad400b4ef0 2020-05-18T21:35:51.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad45899700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad40157860 con 0x7fad40099120 2020-05-18T21:35:51.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad45899700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad400b49a0 con 0x7fad4009d4a0 2020-05-18T21:35:51.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad44897700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fad40099120 0x7fad401456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:51.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad44897700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fad40099120 0x7fad401456e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:49390/0 (socket says 172.21.15.63:49390) 2020-05-18T21:35:51.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad44897700 1 -- 172.21.15.63:0/3926726292 learned_addr learned my addr 172.21.15.63:0/3926726292 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:51.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad3ffff700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad4009d4a0 0x7fad400b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:51.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad44897700 1 -- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad4009d4a0 msgr2=0x7fad400b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:51.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad44897700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad4009d4a0 0x7fad400b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:51.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad44897700 1 -- 172.21.15.63:0/3926726292 >> v1:172.21.15.155:6789/0 conn(0x7fad400b4ef0 legacy=0x7fad40157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:51.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad44897700 1 -- 172.21.15.63:0/3926726292 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4005aa80 con 0x7fad40099120 2020-05-18T21:35:51.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad44897700 1 --2- 172.21.15.63:0/3926726292 >> v2:172.21.15.155:3300/0 conn(0x7fad40099120 0x7fad401456e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fad34007960 tx=0x7fad34010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad44897700 1 --2- 172.21.15.63:0/3926726292 >> v2:172.21.15.155:3300/0 conn(0x7fad40099120 0x7fad401456e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fad34007960 tx=0x7fad34010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad44897700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad40099120 0x7fad401456e0 secure :-1 s=READY pgs=1188 cs=0 l=1 rx=0x7fad34007960 tx=0x7fad34010b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:51.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad44897700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad40099120 0x7fad401456e0 secure :-1 s=THROTTLE_DONE pgs=1188 cs=0 l=1 rx=0x7fad34007960 tx=0x7fad34010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad3dffb700 1 -- 172.21.15.63:0/3926726292 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad34007180 con 0x7fad40099120 2020-05-18T21:35:51.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad44897700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad40099120 0x7fad401456e0 secure :-1 s=THROTTLE_DONE pgs=1188 cs=0 l=1 rx=0x7fad34007960 tx=0x7fad34010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad44897700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad40099120 0x7fad401456e0 secure :-1 s=THROTTLE_DONE pgs=1188 cs=0 l=1 rx=0x7fad34007960 tx=0x7fad34010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad3dffb700 1 -- 172.21.15.63:0/3926726292 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad340072e0 con 0x7fad40099120 2020-05-18T21:35:51.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad45899700 1 -- 172.21.15.63:0/3926726292 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad40156a10 con 0x7fad40099120 2020-05-18T21:35:51.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad3dffb700 1 -- 172.21.15.63:0/3926726292 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad3400e220 con 0x7fad40099120 2020-05-18T21:35:51.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.314+0000 7fad45899700 1 -- 172.21.15.63:0/3926726292 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad40145e00 con 0x7fad40099120 2020-05-18T21:35:51.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.318+0000 7fad44897700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad40099120 0x7fad401456e0 secure :-1 s=THROTTLE_DONE pgs=1188 cs=0 l=1 rx=0x7fad34007960 tx=0x7fad34010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.318+0000 7fad45899700 1 -- 172.21.15.63:0/3926726292 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad400569e0 con 0x7fad40099120 2020-05-18T21:35:51.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.318+0000 7fad44897700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad40099120 0x7fad401456e0 secure :-1 s=THROTTLE_DONE pgs=1188 cs=0 l=1 rx=0x7fad34007960 tx=0x7fad34010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.318+0000 7fad3dffb700 1 -- 172.21.15.63:0/3926726292 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fad3400e490 con 0x7fad40099120 2020-05-18T21:35:51.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.318+0000 7fad3dffb700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fad2804fa60 0x7fad28051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:51.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.318+0000 7fad3dffb700 1 -- 172.21.15.63:0/3926726292 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fad34063ed0 con 0x7fad40099120 2020-05-18T21:35:51.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.318+0000 7fad3ffff700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fad2804fa60 0x7fad28051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:51.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.318+0000 7fad3ffff700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fad2804fa60 0x7fad28051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fad4009ed70 tx=0x7fad2c00c860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.318+0000 7fad3ffff700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fad2804fa60 0x7fad28051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fad4009ed70 tx=0x7fad2c00c860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.318+0000 7fad3ffff700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fad2804fa60 0x7fad28051f20 secure :-1 s=READY pgs=697 cs=0 l=1 rx=0x7fad4009ed70 tx=0x7fad2c00c860).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:51.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.326+0000 7fad44897700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad40099120 0x7fad401456e0 secure :-1 s=THROTTLE_DONE pgs=1188 cs=0 l=1 rx=0x7fad34007960 tx=0x7fad34010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.326+0000 7fad3dffb700 1 -- 172.21.15.63:0/3926726292 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fad3403e1c0 con 0x7fad40099120 2020-05-18T21:35:51.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.478+0000 7fad45899700 1 -- 172.21.15.63:0/3926726292 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad40156e50 con 0x7fad40099120 2020-05-18T21:35:51.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.478+0000 7fad44897700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad40099120 0x7fad401456e0 secure :-1 s=THROTTLE_DONE pgs=1188 cs=0 l=1 rx=0x7fad34007960 tx=0x7fad34010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.478+0000 7fad3dffb700 1 -- 172.21.15.63:0/3926726292 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+2146 (secure 0 0 0) 0x7fad340417e0 con 0x7fad40099120 2020-05-18T21:35:51.483 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:51.483 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":102,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2822608544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2822608544},{"type":"v1","addr":"172.21.15.155:6835","nonce":2822608544}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":101}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:35:51.163874+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:35:51.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.478+0000 7fad45899700 1 -- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fad2804fa60 msgr2=0x7fad28051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:51.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.478+0000 7fad45899700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fad2804fa60 0x7fad28051f20 secure :-1 s=READY pgs=697 cs=0 l=1 rx=0x7fad4009ed70 tx=0x7fad2c00c860).stop 2020-05-18T21:35:51.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.478+0000 7fad45899700 1 -- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad40099120 msgr2=0x7fad401456e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:51.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.478+0000 7fad45899700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad40099120 0x7fad401456e0 secure :-1 s=READY pgs=1188 cs=0 l=1 rx=0x7fad34007960 tx=0x7fad34010b90).stop 2020-05-18T21:35:51.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.478+0000 7fad45899700 1 -- 172.21.15.63:0/3926726292 shutdown_connections 2020-05-18T21:35:51.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.478+0000 7fad45899700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fad2804fa60 0x7fad28051f20 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:51.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.478+0000 7fad45899700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad4009d4a0 0x7fad400b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:51.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.478+0000 7fad45899700 1 --2- 172.21.15.63:0/3926726292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad40099120 0x7fad401456e0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:51.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.478+0000 7fad45899700 1 -- 172.21.15.63:0/3926726292 >> 172.21.15.63:0/3926726292 conn(0x7fad4005f630 msgr2=0x7fad40141520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:51.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.478+0000 7fad45899700 1 -- 172.21.15.63:0/3926726292 shutdown_connections 2020-05-18T21:35:51.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.478+0000 7fad45899700 1 -- 172.21.15.63:0/3926726292 wait complete. 2020-05-18T21:35:51.487 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 102 2020-05-18T21:35:51.496 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:35:51.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.594+0000 7f3b7ffff700 1 Processor -- start 2020-05-18T21:35:51.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.598+0000 7f3b7ffff700 1 -- start start 2020-05-18T21:35:51.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.598+0000 7f3b7ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b8005b2b0 0x7f3b80145e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:51.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.598+0000 7f3b7ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3b801462d0 0x7f3b80099b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:51.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.598+0000 7f3b7ffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b800b51f0 con 0x7f3b800b8e20 2020-05-18T21:35:51.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.598+0000 7f3b7ffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b801428d0 con 0x7f3b801462d0 2020-05-18T21:35:51.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.598+0000 7f3b7ffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b80142b70 con 0x7f3b8005b2b0 2020-05-18T21:35:51.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.598+0000 7f3b7effd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3b800b8e20 0x7f3b80145760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36738/0 (socket says 172.21.15.63:36738) 2020-05-18T21:35:51.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.598+0000 7f3b7effd700 1 -- 172.21.15.63:0/3622209817 learned_addr learned my addr 172.21.15.63:0/3622209817 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:51.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.598+0000 7f3b7e7fc700 1 --2- 172.21.15.63:0/3622209817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b8005b2b0 0x7f3b80145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:51.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.598+0000 7f3b7f7fe700 1 --2- 172.21.15.63:0/3622209817 >> v2:172.21.15.155:3300/0 conn(0x7f3b801462d0 0x7f3b80099b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:51.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.598+0000 7f3b7dffb700 1 -- 172.21.15.63:0/3622209817 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436172178 0 0) 0x7f3b800b51f0 con 0x7f3b800b8e20 2020-05-18T21:35:51.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.598+0000 7f3b7dffb700 1 -- 172.21.15.63:0/3622209817 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b64003270 con 0x7f3b800b8e20 2020-05-18T21:35:51.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.598+0000 7f3b7e7fc700 1 -- 172.21.15.63:0/3622209817 >> v2:172.21.15.155:3300/0 conn(0x7f3b801462d0 msgr2=0x7f3b80099b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:51.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.598+0000 7f3b7e7fc700 1 --2- 172.21.15.63:0/3622209817 >> v2:172.21.15.155:3300/0 conn(0x7f3b801462d0 0x7f3b80099b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:51.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.598+0000 7f3b7e7fc700 1 -- 172.21.15.63:0/3622209817 >> v1:172.21.15.63:6789/0 conn(0x7f3b800b8e20 legacy=0x7f3b80145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:51.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.598+0000 7f3b7e7fc700 1 -- 172.21.15.63:0/3622209817 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b80142e10 con 0x7f3b8005b2b0 2020-05-18T21:35:51.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.598+0000 7f3b7e7fc700 1 --2- 172.21.15.63:0/3622209817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b8005b2b0 0x7f3b80145e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3b74002f70 tx=0x7f3b74007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.598+0000 7f3b7e7fc700 1 --2- 172.21.15.63:0/3622209817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b8005b2b0 0x7f3b80145e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3b74002f70 tx=0x7f3b74007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.598+0000 7f3b7e7fc700 1 --2- 172.21.15.63:0/3622209817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b8005b2b0 0x7f3b80145e70 secure :-1 s=READY pgs=267 cs=0 l=1 rx=0x7f3b74002f70 tx=0x7f3b74007a80).ready entity=mon.2 client_cookie=8f9ebcb7be7962f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:51.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.602+0000 7f3b7e7fc700 1 --2- 172.21.15.63:0/3622209817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b8005b2b0 0x7f3b80145e70 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7f3b74002f70 tx=0x7f3b74007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.602+0000 7f3b7dffb700 1 -- 172.21.15.63:0/3622209817 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b74008e80 con 0x7f3b8005b2b0 2020-05-18T21:35:51.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.602+0000 7f3b7e7fc700 1 --2- 172.21.15.63:0/3622209817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b8005b2b0 0x7f3b80145e70 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7f3b74002f70 tx=0x7f3b74007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.602+0000 7f3b7dffb700 1 -- 172.21.15.63:0/3622209817 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b74011540 con 0x7f3b8005b2b0 2020-05-18T21:35:51.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.602+0000 7f3b7e7fc700 1 --2- 172.21.15.63:0/3622209817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b8005b2b0 0x7f3b80145e70 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7f3b74002f70 tx=0x7f3b74007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.602+0000 7f3b7dffb700 1 -- 172.21.15.63:0/3622209817 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b74011920 con 0x7f3b8005b2b0 2020-05-18T21:35:51.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.602+0000 7f3b7ffff700 1 -- 172.21.15.63:0/3622209817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b8005b2b0 msgr2=0x7f3b80145e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:51.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.602+0000 7f3b7ffff700 1 --2- 172.21.15.63:0/3622209817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b8005b2b0 0x7f3b80145e70 secure :-1 s=READY pgs=267 cs=0 l=1 rx=0x7f3b74002f70 tx=0x7f3b74007a80).stop 2020-05-18T21:35:51.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.602+0000 7f3b7ffff700 1 -- 172.21.15.63:0/3622209817 shutdown_connections 2020-05-18T21:35:51.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.602+0000 7f3b7ffff700 1 --2- 172.21.15.63:0/3622209817 >> v2:172.21.15.155:3300/0 conn(0x7f3b801462d0 0x7f3b80099b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:51.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.602+0000 7f3b7ffff700 1 --2- 172.21.15.63:0/3622209817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b8005b2b0 0x7f3b80145e70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:51.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.602+0000 7f3b7ffff700 1 -- 172.21.15.63:0/3622209817 >> 172.21.15.63:0/3622209817 conn(0x7f3b8005f630 msgr2=0x7f3b8005a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:51.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.602+0000 7f3b7ffff700 1 -- 172.21.15.63:0/3622209817 shutdown_connections 2020-05-18T21:35:51.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.602+0000 7f3b7ffff700 1 -- 172.21.15.63:0/3622209817 wait complete. 2020-05-18T21:35:51.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.602+0000 7f3b7ffff700 1 Processor -- start 2020-05-18T21:35:51.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.602+0000 7f3b7ffff700 1 -- start start 2020-05-18T21:35:51.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b7ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b801462d0 0x7f3b80065ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:51.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b7ffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b80063e40 con 0x7f3b8005b2b0 2020-05-18T21:35:51.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b7ffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b800640e0 con 0x7f3b800b8e20 2020-05-18T21:35:51.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b7ffff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b80064380 con 0x7f3b801462d0 2020-05-18T21:35:51.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b7f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b801462d0 0x7f3b80065ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:51.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b7effd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3b8005b2b0 0x7f3b801538b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36744/0 (socket says 172.21.15.63:36744) 2020-05-18T21:35:51.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b7effd700 1 -- 172.21.15.63:0/3790380533 learned_addr learned my addr 172.21.15.63:0/3790380533 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:51.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b6ffff700 1 -- 172.21.15.63:0/3790380533 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509223316 0 0) 0x7f3b80063e40 con 0x7f3b8005b2b0 2020-05-18T21:35:51.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b6ffff700 1 -- 172.21.15.63:0/3790380533 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b5c002fe0 con 0x7f3b8005b2b0 2020-05-18T21:35:51.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b7f7fe700 1 -- 172.21.15.63:0/3790380533 >> v1:172.21.15.155:6789/0 conn(0x7f3b800b8e20 legacy=0x7f3b80156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:51.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b6ffff700 1 -- 172.21.15.63:0/3790380533 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277432584 0 0) 0x7f3b800640e0 con 0x7f3b800b8e20 2020-05-18T21:35:51.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b7f7fe700 1 -- 172.21.15.63:0/3790380533 >> v1:172.21.15.63:6789/0 conn(0x7f3b8005b2b0 legacy=0x7f3b801538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:51.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b7f7fe700 1 -- 172.21.15.63:0/3790380533 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b80063ac0 con 0x7f3b801462d0 2020-05-18T21:35:51.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b7f7fe700 1 --2- 172.21.15.63:0/3790380533 >> v2:172.21.15.63:3300/0 conn(0x7f3b801462d0 0x7f3b80065ae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b780032f0 tx=0x7f3b78010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b7f7fe700 1 --2- 172.21.15.63:0/3790380533 >> v2:172.21.15.63:3300/0 conn(0x7f3b801462d0 0x7f3b80065ae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b780032f0 tx=0x7f3b78010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b7f7fe700 1 --2- 172.21.15.63:0/3790380533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b801462d0 0x7f3b80065ae0 secure :-1 s=READY pgs=1797 cs=0 l=1 rx=0x7f3b780032f0 tx=0x7f3b78010f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:51.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b7f7fe700 1 --2- 172.21.15.63:0/3790380533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b801462d0 0x7f3b80065ae0 secure :-1 s=THROTTLE_DONE pgs=1797 cs=0 l=1 rx=0x7f3b780032f0 tx=0x7f3b78010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b6ffff700 1 -- 172.21.15.63:0/3790380533 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b78005a80 con 0x7f3b801462d0 2020-05-18T21:35:51.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b7f7fe700 1 --2- 172.21.15.63:0/3790380533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b801462d0 0x7f3b80065ae0 secure :-1 s=THROTTLE_DONE pgs=1797 cs=0 l=1 rx=0x7f3b780032f0 tx=0x7f3b78010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b7f7fe700 1 --2- 172.21.15.63:0/3790380533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b801462d0 0x7f3b80065ae0 secure :-1 s=THROTTLE_DONE pgs=1797 cs=0 l=1 rx=0x7f3b780032f0 tx=0x7f3b78010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b6ffff700 1 -- 172.21.15.63:0/3790380533 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b78005be0 con 0x7f3b801462d0 2020-05-18T21:35:51.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b6ffff700 1 -- 172.21.15.63:0/3790380533 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b78012950 con 0x7f3b801462d0 2020-05-18T21:35:51.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b7ffff700 1 -- 172.21.15.63:0/3790380533 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b800b7840 con 0x7f3b801462d0 2020-05-18T21:35:51.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b7ffff700 1 -- 172.21.15.63:0/3790380533 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b801541e0 con 0x7f3b801462d0 2020-05-18T21:35:51.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.606+0000 7f3b7f7fe700 1 --2- 172.21.15.63:0/3790380533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b801462d0 0x7f3b80065ae0 secure :-1 s=THROTTLE_DONE pgs=1797 cs=0 l=1 rx=0x7f3b780032f0 tx=0x7f3b78010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.610+0000 7f3b7ffff700 1 -- 172.21.15.63:0/3790380533 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b800569e0 con 0x7f3b801462d0 2020-05-18T21:35:51.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.610+0000 7f3b6ffff700 1 -- 172.21.15.63:0/3790380533 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3b78012b50 con 0x7f3b801462d0 2020-05-18T21:35:51.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.610+0000 7f3b7f7fe700 1 --2- 172.21.15.63:0/3790380533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b801462d0 0x7f3b80065ae0 secure :-1 s=THROTTLE_DONE pgs=1797 cs=0 l=1 rx=0x7f3b780032f0 tx=0x7f3b78010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.610+0000 7f3b6ffff700 1 --2- 172.21.15.63:0/3790380533 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b5c04fc70 0x7f3b5c052130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:51.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.610+0000 7f3b6ffff700 1 -- 172.21.15.63:0/3790380533 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3b78063a30 con 0x7f3b801462d0 2020-05-18T21:35:51.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.610+0000 7f3b7effd700 1 --2- 172.21.15.63:0/3790380533 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b5c04fc70 0x7f3b5c052130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:51.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.610+0000 7f3b7effd700 1 --2- 172.21.15.63:0/3790380533 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b5c04fc70 0x7f3b5c052130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b70001150 tx=0x7f3b70001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.610+0000 7f3b7effd700 1 --2- 172.21.15.63:0/3790380533 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b5c04fc70 0x7f3b5c052130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b70001150 tx=0x7f3b70001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.610+0000 7f3b7effd700 1 --2- 172.21.15.63:0/3790380533 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b5c04fc70 0x7f3b5c052130 secure :-1 s=READY pgs=698 cs=0 l=1 rx=0x7f3b70001150 tx=0x7f3b70001700).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:51.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.614+0000 7f3b7f7fe700 1 --2- 172.21.15.63:0/3790380533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b801462d0 0x7f3b80065ae0 secure :-1 s=THROTTLE_DONE pgs=1797 cs=0 l=1 rx=0x7f3b780032f0 tx=0x7f3b78010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.614+0000 7f3b6ffff700 1 -- 172.21.15.63:0/3790380533 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3b7803de20 con 0x7f3b801462d0 2020-05-18T21:35:51.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.730+0000 7f3b7ffff700 1 -- 172.21.15.63:0/3790380533 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b8009da70 con 0x7f3b801462d0 2020-05-18T21:35:51.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.730+0000 7f3b7f7fe700 1 --2- 172.21.15.63:0/3790380533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b801462d0 0x7f3b80065ae0 secure :-1 s=THROTTLE_DONE pgs=1797 cs=0 l=1 rx=0x7f3b780032f0 tx=0x7f3b78010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.730+0000 7f3b6ffff700 1 -- 172.21.15.63:0/3790380533 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f3b78041440 con 0x7f3b801462d0 2020-05-18T21:35:51.737 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:51.737 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":134,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:35:51.162837+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:35:48.494447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2020-05-18T21:35:49.149601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:35:51.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.734+0000 7f3b7ffff700 1 -- 172.21.15.63:0/3790380533 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b5c04fc70 msgr2=0x7f3b5c052130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:51.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.734+0000 7f3b7ffff700 1 --2- 172.21.15.63:0/3790380533 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b5c04fc70 0x7f3b5c052130 secure :-1 s=READY pgs=698 cs=0 l=1 rx=0x7f3b70001150 tx=0x7f3b70001700).stop 2020-05-18T21:35:51.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.734+0000 7f3b7ffff700 1 -- 172.21.15.63:0/3790380533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b801462d0 msgr2=0x7f3b80065ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:51.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.734+0000 7f3b7ffff700 1 --2- 172.21.15.63:0/3790380533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b801462d0 0x7f3b80065ae0 secure :-1 s=READY pgs=1797 cs=0 l=1 rx=0x7f3b780032f0 tx=0x7f3b78010f00).stop 2020-05-18T21:35:51.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.734+0000 7f3b7ffff700 1 -- 172.21.15.63:0/3790380533 shutdown_connections 2020-05-18T21:35:51.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.734+0000 7f3b7ffff700 1 --2- 172.21.15.63:0/3790380533 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b5c04fc70 0x7f3b5c052130 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:51.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.734+0000 7f3b7ffff700 1 --2- 172.21.15.63:0/3790380533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b801462d0 0x7f3b80065ae0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:51.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.734+0000 7f3b7ffff700 1 -- 172.21.15.63:0/3790380533 >> 172.21.15.63:0/3790380533 conn(0x7f3b8005f630 msgr2=0x7f3b8009a770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:51.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.734+0000 7f3b7ffff700 1 -- 172.21.15.63:0/3790380533 shutdown_connections 2020-05-18T21:35:51.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.734+0000 7f3b7ffff700 1 -- 172.21.15.63:0/3790380533 wait complete. 2020-05-18T21:35:51.750 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:35:51.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.854+0000 7fb82cfba700 1 Processor -- start 2020-05-18T21:35:51.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.854+0000 7fb82cfba700 1 -- start start 2020-05-18T21:35:51.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.854+0000 7fb82cfba700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8280b8c30 0x7fb8281566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:51.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.854+0000 7fb82cfba700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb828065a70 con 0x7fb828157260 2020-05-18T21:35:51.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.854+0000 7fb82cfba700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8280b9010 con 0x7fb8280ad070 2020-05-18T21:35:51.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.854+0000 7fb82cfba700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8280801d0 con 0x7fb8280b8c30 2020-05-18T21:35:51.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.854+0000 7fb82659c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fb8280ad070 0x7fb828156b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:35070/0 (socket says 172.21.15.63:35070) 2020-05-18T21:35:51.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.854+0000 7fb82659c700 1 -- 172.21.15.63:0/409739371 learned_addr learned my addr 172.21.15.63:0/409739371 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:51.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.854+0000 7fb826d9d700 1 --2- 172.21.15.63:0/409739371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8280b8c30 0x7fb8281566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:51.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.854+0000 7fb826d9d700 1 -- 172.21.15.63:0/409739371 >> v1:172.21.15.155:6789/0 conn(0x7fb8280ad070 legacy=0x7fb828156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:51.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.854+0000 7fb826d9d700 1 -- 172.21.15.63:0/409739371 >> v1:172.21.15.63:6789/0 conn(0x7fb828157260 legacy=0x7fb82815c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:51.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.854+0000 7fb826d9d700 1 -- 172.21.15.63:0/409739371 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82805bf00 con 0x7fb8280b8c30 2020-05-18T21:35:51.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.858+0000 7fb826d9d700 1 --2- 172.21.15.63:0/409739371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8280b8c30 0x7fb8281566f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb8180032f0 tx=0x7fb818008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.858+0000 7fb826d9d700 1 --2- 172.21.15.63:0/409739371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8280b8c30 0x7fb8281566f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb8180032f0 tx=0x7fb818008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.858+0000 7fb826d9d700 1 --2- 172.21.15.63:0/409739371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8280b8c30 0x7fb8281566f0 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7fb8180032f0 tx=0x7fb818008ca0).ready entity=mon.2 client_cookie=cd32fbe767a7aa64 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:51.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.862+0000 7fb826d9d700 1 --2- 172.21.15.63:0/409739371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8280b8c30 0x7fb8281566f0 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7fb8180032f0 tx=0x7fb818008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.862+0000 7fb826d9d700 1 --2- 172.21.15.63:0/409739371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8280b8c30 0x7fb8281566f0 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7fb8180032f0 tx=0x7fb818008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.862+0000 7fb826d9d700 1 --2- 172.21.15.63:0/409739371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8280b8c30 0x7fb8281566f0 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7fb8180032f0 tx=0x7fb818008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.862+0000 7fb825d9b700 1 -- 172.21.15.63:0/409739371 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb81800a180 con 0x7fb8280b8c30 2020-05-18T21:35:51.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.862+0000 7fb825d9b700 1 -- 172.21.15.63:0/409739371 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81800a2e0 con 0x7fb8280b8c30 2020-05-18T21:35:51.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.862+0000 7fb825d9b700 1 -- 172.21.15.63:0/409739371 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb81800a700 con 0x7fb8280b8c30 2020-05-18T21:35:51.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.862+0000 7fb82cfba700 1 -- 172.21.15.63:0/409739371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8280b8c30 msgr2=0x7fb8281566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:51.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.862+0000 7fb82cfba700 1 --2- 172.21.15.63:0/409739371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8280b8c30 0x7fb8281566f0 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7fb8180032f0 tx=0x7fb818008ca0).stop 2020-05-18T21:35:51.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.862+0000 7fb82cfba700 1 -- 172.21.15.63:0/409739371 shutdown_connections 2020-05-18T21:35:51.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.862+0000 7fb82cfba700 1 --2- 172.21.15.63:0/409739371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8280b8c30 0x7fb8281566f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:51.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.862+0000 7fb82cfba700 1 -- 172.21.15.63:0/409739371 >> 172.21.15.63:0/409739371 conn(0x7fb82806a640 msgr2=0x7fb8280b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:51.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.862+0000 7fb82cfba700 1 -- 172.21.15.63:0/409739371 shutdown_connections 2020-05-18T21:35:51.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.862+0000 7fb82cfba700 1 -- 172.21.15.63:0/409739371 wait complete. 2020-05-18T21:35:51.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82cfba700 1 Processor -- start 2020-05-18T21:35:51.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82cfba700 1 -- start start 2020-05-18T21:35:51.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82cfba700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb8280ad070 0x7fb828064ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:51.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82cfba700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb8280b8c30 0x7fb828159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:51.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82cfba700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb828157260 0x7fb82815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:51.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82cfba700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82815cb80 con 0x7fb8280b8c30 2020-05-18T21:35:51.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82cfba700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82815ce20 con 0x7fb8280ad070 2020-05-18T21:35:51.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82cfba700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82815ac50 con 0x7fb828157260 2020-05-18T21:35:51.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb8280b8c30 0x7fb828159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:51.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb8280b8c30 0x7fb828159500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34572/0 (socket says 172.21.15.63:34572) 2020-05-18T21:35:51.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82659c700 1 -- 172.21.15.63:0/4142999791 learned_addr learned my addr 172.21.15.63:0/4142999791 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:51.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb826d9d700 1 --2- 172.21.15.63:0/4142999791 >> v2:172.21.15.155:3300/0 conn(0x7fb8280ad070 0x7fb828064ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:51.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82759e700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb828157260 0x7fb82815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:51.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82659c700 1 -- 172.21.15.63:0/4142999791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb828157260 msgr2=0x7fb82815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:51.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82659c700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb828157260 0x7fb82815d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:51.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82659c700 1 -- 172.21.15.63:0/4142999791 >> v2:172.21.15.155:3300/0 conn(0x7fb8280ad070 msgr2=0x7fb828064ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:51.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82659c700 1 --2- 172.21.15.63:0/4142999791 >> v2:172.21.15.155:3300/0 conn(0x7fb8280ad070 0x7fb828064ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:51.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82659c700 1 -- 172.21.15.63:0/4142999791 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82815c7f0 con 0x7fb8280b8c30 2020-05-18T21:35:51.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82659c700 1 --2- 172.21.15.63:0/4142999791 >> v2:172.21.15.63:3300/0 conn(0x7fb8280b8c30 0x7fb828159500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb81c001040 tx=0x7fb81c0013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82659c700 1 --2- 172.21.15.63:0/4142999791 >> v2:172.21.15.63:3300/0 conn(0x7fb8280b8c30 0x7fb828159500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb81c001040 tx=0x7fb81c0013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.866+0000 7fb82659c700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280b8c30 0x7fb828159500 secure :-1 s=READY pgs=1799 cs=0 l=1 rx=0x7fb81c001040 tx=0x7fb81c0013e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:51.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.870+0000 7fb82659c700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280b8c30 0x7fb828159500 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7fb81c001040 tx=0x7fb81c0013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.870+0000 7fb82659c700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280b8c30 0x7fb828159500 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7fb81c001040 tx=0x7fb81c0013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.870+0000 7fb8177fe700 1 -- 172.21.15.63:0/4142999791 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb81c00c990 con 0x7fb8280b8c30 2020-05-18T21:35:51.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.870+0000 7fb82659c700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280b8c30 0x7fb828159500 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7fb81c001040 tx=0x7fb81c0013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.870+0000 7fb8177fe700 1 -- 172.21.15.63:0/4142999791 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c00caf0 con 0x7fb8280b8c30 2020-05-18T21:35:51.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.870+0000 7fb8177fe700 1 -- 172.21.15.63:0/4142999791 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb81c00ce90 con 0x7fb8280b8c30 2020-05-18T21:35:51.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.870+0000 7fb82cfba700 1 -- 172.21.15.63:0/4142999791 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb828157700 con 0x7fb8280b8c30 2020-05-18T21:35:51.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.870+0000 7fb82cfba700 1 -- 172.21.15.63:0/4142999791 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb828157bb0 con 0x7fb8280b8c30 2020-05-18T21:35:51.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.870+0000 7fb82659c700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280b8c30 0x7fb828159500 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7fb81c001040 tx=0x7fb81c0013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.870+0000 7fb82cfba700 1 -- 172.21.15.63:0/4142999791 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8280569e0 con 0x7fb8280b8c30 2020-05-18T21:35:51.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.870+0000 7fb8177fe700 1 -- 172.21.15.63:0/4142999791 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb81c005600 con 0x7fb8280b8c30 2020-05-18T21:35:51.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.870+0000 7fb82659c700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280b8c30 0x7fb828159500 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7fb81c001040 tx=0x7fb81c0013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.870+0000 7fb8177fe700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb80c04fa50 0x7fb80c051f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:51.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.870+0000 7fb8177fe700 1 -- 172.21.15.63:0/4142999791 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb81c0100c0 con 0x7fb8280b8c30 2020-05-18T21:35:51.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.870+0000 7fb826d9d700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb80c04fa50 0x7fb80c051f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:51.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.870+0000 7fb826d9d700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb80c04fa50 0x7fb80c051f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb8180032f0 tx=0x7fb828066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.870+0000 7fb826d9d700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb80c04fa50 0x7fb80c051f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb8180032f0 tx=0x7fb828066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.870+0000 7fb826d9d700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb80c04fa50 0x7fb80c051f10 secure :-1 s=READY pgs=699 cs=0 l=1 rx=0x7fb8180032f0 tx=0x7fb828066290).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:51.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.874+0000 7fb82659c700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280b8c30 0x7fb828159500 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7fb81c001040 tx=0x7fb81c0013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:51.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:51.874+0000 7fb8177fe700 1 -- 172.21.15.63:0/4142999791 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb81c03dab0 con 0x7fb8280b8c30 2020-05-18T21:35:52.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.030+0000 7fb82cfba700 1 -- 172.21.15.63:0/4142999791 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fb82815c980 con 0x7fb8280b8c30 2020-05-18T21:35:52.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.038+0000 7fb82659c700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280b8c30 0x7fb828159500 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7fb81c001040 tx=0x7fb81c0013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.038+0000 7fb8177fe700 1 -- 172.21.15.63:0/4142999791 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v51) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb81c0410d0 con 0x7fb8280b8c30 2020-05-18T21:35:52.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.038+0000 7fb82cfba700 1 -- 172.21.15.63:0/4142999791 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb80c04fa50 msgr2=0x7fb80c051f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:52.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.038+0000 7fb82cfba700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb80c04fa50 0x7fb80c051f10 secure :-1 s=READY pgs=699 cs=0 l=1 rx=0x7fb8180032f0 tx=0x7fb828066290).stop 2020-05-18T21:35:52.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.038+0000 7fb82cfba700 1 -- 172.21.15.63:0/4142999791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280b8c30 msgr2=0x7fb828159500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:52.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.038+0000 7fb82cfba700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280b8c30 0x7fb828159500 secure :-1 s=READY pgs=1799 cs=0 l=1 rx=0x7fb81c001040 tx=0x7fb81c0013e0).stop 2020-05-18T21:35:52.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.038+0000 7fb82cfba700 1 -- 172.21.15.63:0/4142999791 shutdown_connections 2020-05-18T21:35:52.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.038+0000 7fb82cfba700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb80c04fa50 0x7fb80c051f10 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:52.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.038+0000 7fb82cfba700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb828157260 0x7fb82815d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:52.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.038+0000 7fb82cfba700 1 --2- 172.21.15.63:0/4142999791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280b8c30 0x7fb828159500 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:52.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.038+0000 7fb82cfba700 1 --2- 172.21.15.63:0/4142999791 >> v2:172.21.15.155:3300/0 conn(0x7fb8280ad070 0x7fb828064ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:52.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.038+0000 7fb82cfba700 1 -- 172.21.15.63:0/4142999791 >> 172.21.15.63:0/4142999791 conn(0x7fb82806a640 msgr2=0x7fb8280b53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:52.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.038+0000 7fb82cfba700 1 -- 172.21.15.63:0/4142999791 shutdown_connections 2020-05-18T21:35:52.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.038+0000 7fb82cfba700 1 -- 172.21.15.63:0/4142999791 wait complete. 2020-05-18T21:35:52.049 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.0 2020-05-18T21:35:52.061 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:35:52.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.170+0000 7fcab0d06700 1 Processor -- start 2020-05-18T21:35:52.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.170+0000 7fcab0d06700 1 -- start start 2020-05-18T21:35:52.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.170+0000 7fcab0d06700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaac0b6410 0x7fcaac0b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:52.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.170+0000 7fcab0d06700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcaac0b5cb0 0x7fcaac061af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:52.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.170+0000 7fcab0d06700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaac025500 con 0x7fcaac151bc0 2020-05-18T21:35:52.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.170+0000 7fcab0d06700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac064ee0 con 0x7fcaac0b5cb0 2020-05-18T21:35:52.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.170+0000 7fcab0d06700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac0b67f0 con 0x7fcaac0b6410 2020-05-18T21:35:52.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.170+0000 7fcaab7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcaac0b5cb0 0x7fcaac061af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:52.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.170+0000 7fcaabfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaac0b6410 0x7fcaac0b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:52.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcaabfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaac0b6410 0x7fcaac0b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:53512/0 (socket says 172.21.15.63:53512) 2020-05-18T21:35:52.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcaabfff700 1 -- 172.21.15.63:0/3300887511 learned_addr learned my addr 172.21.15.63:0/3300887511 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:52.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcab1f68700 1 --1- 172.21.15.63:0/3300887511 >> v1:172.21.15.155:6789/0 conn(0x7fcaac151bc0 0x7fcaac152030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:35084/0 (socket says 172.21.15.63:35084) 2020-05-18T21:35:52.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcaabfff700 1 -- 172.21.15.63:0/3300887511 >> v2:172.21.15.155:3300/0 conn(0x7fcaac0b5cb0 msgr2=0x7fcaac061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:52.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcaabfff700 1 --2- 172.21.15.63:0/3300887511 >> v2:172.21.15.155:3300/0 conn(0x7fcaac0b5cb0 0x7fcaac061af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:52.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcaabfff700 1 -- 172.21.15.63:0/3300887511 >> v1:172.21.15.155:6789/0 conn(0x7fcaac151bc0 legacy=0x7fcaac152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:52.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcaabfff700 1 -- 172.21.15.63:0/3300887511 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac025180 con 0x7fcaac0b6410 2020-05-18T21:35:52.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcaabfff700 1 --2- 172.21.15.63:0/3300887511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaac0b6410 0x7fcaac0b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fca9c0032f0 tx=0x7fca9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcaabfff700 1 --2- 172.21.15.63:0/3300887511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaac0b6410 0x7fcaac0b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fca9c0032f0 tx=0x7fca9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcaabfff700 1 --2- 172.21.15.63:0/3300887511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaac0b6410 0x7fcaac0b6cd0 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7fca9c0032f0 tx=0x7fca9c007e00).ready entity=mon.2 client_cookie=389c52255b39acb5 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcaabfff700 1 --2- 172.21.15.63:0/3300887511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaac0b6410 0x7fcaac0b6cd0 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7fca9c0032f0 tx=0x7fca9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcaaaffd700 1 -- 172.21.15.63:0/3300887511 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca9c011d10 con 0x7fcaac0b6410 2020-05-18T21:35:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcaabfff700 1 --2- 172.21.15.63:0/3300887511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaac0b6410 0x7fcaac0b6cd0 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7fca9c0032f0 tx=0x7fca9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcaabfff700 1 --2- 172.21.15.63:0/3300887511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaac0b6410 0x7fcaac0b6cd0 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7fca9c0032f0 tx=0x7fca9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcaaaffd700 1 -- 172.21.15.63:0/3300887511 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c011e70 con 0x7fcaac0b6410 2020-05-18T21:35:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcaaaffd700 1 -- 172.21.15.63:0/3300887511 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca9c00a370 con 0x7fcaac0b6410 2020-05-18T21:35:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcab0d06700 1 -- 172.21.15.63:0/3300887511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaac0b6410 msgr2=0x7fcaac0b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcab0d06700 1 --2- 172.21.15.63:0/3300887511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaac0b6410 0x7fcaac0b6cd0 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7fca9c0032f0 tx=0x7fca9c007e00).stop 2020-05-18T21:35:52.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcab0d06700 1 -- 172.21.15.63:0/3300887511 shutdown_connections 2020-05-18T21:35:52.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcab0d06700 1 --2- 172.21.15.63:0/3300887511 >> v2:172.21.15.155:3300/0 conn(0x7fcaac0b5cb0 0x7fcaac061af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:52.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcab0d06700 1 --2- 172.21.15.63:0/3300887511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaac0b6410 0x7fcaac0b6cd0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:52.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcab0d06700 1 -- 172.21.15.63:0/3300887511 >> 172.21.15.63:0/3300887511 conn(0x7fcaac069b70 msgr2=0x7fcaac069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:52.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcab0d06700 1 -- 172.21.15.63:0/3300887511 shutdown_connections 2020-05-18T21:35:52.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.174+0000 7fcab0d06700 1 -- 172.21.15.63:0/3300887511 wait complete. 2020-05-18T21:35:52.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.178+0000 7fcab0d06700 1 Processor -- start 2020-05-18T21:35:52.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.178+0000 7fcab0d06700 1 -- start start 2020-05-18T21:35:52.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.178+0000 7fcab0d06700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcaac0b5cb0 0x7fcaac143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:52.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.178+0000 7fcab0d06700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaac114900 con 0x7fcaac0b6410 2020-05-18T21:35:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.178+0000 7fcab0d06700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaac114ba0 con 0x7fcaac151bc0 2020-05-18T21:35:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.178+0000 7fcab0d06700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac114e40 con 0x7fcaac0b5cb0 2020-05-18T21:35:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.178+0000 7fcaab7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcaac0b6410 0x7fcaac142ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36776/0 (socket says 172.21.15.63:36776) 2020-05-18T21:35:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.178+0000 7fcaab7fe700 1 -- 172.21.15.63:0/2553424916 learned_addr learned my addr 172.21.15.63:0/2553424916 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:52.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.178+0000 7fcaabfff700 1 --2- 172.21.15.63:0/2553424916 >> v2:172.21.15.155:3300/0 conn(0x7fcaac0b5cb0 0x7fcaac143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:52.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.178+0000 7fcaabfff700 1 -- 172.21.15.63:0/2553424916 >> v1:172.21.15.155:6789/0 conn(0x7fcaac151bc0 legacy=0x7fcaac13ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:52.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.178+0000 7fcaabfff700 1 -- 172.21.15.63:0/2553424916 >> v1:172.21.15.63:6789/0 conn(0x7fcaac0b6410 legacy=0x7fcaac142ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:52.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.178+0000 7fcaabfff700 1 -- 172.21.15.63:0/2553424916 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac119840 con 0x7fcaac0b5cb0 2020-05-18T21:35:52.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.178+0000 7fcaabfff700 1 --2- 172.21.15.63:0/2553424916 >> v2:172.21.15.155:3300/0 conn(0x7fcaac0b5cb0 0x7fcaac143a70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcaac0adaa0 tx=0x7fca9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.178+0000 7fcaabfff700 1 --2- 172.21.15.63:0/2553424916 >> v2:172.21.15.155:3300/0 conn(0x7fcaac0b5cb0 0x7fcaac143a70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcaac0adaa0 tx=0x7fca9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.178+0000 7fcaabfff700 1 --2- 172.21.15.63:0/2553424916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaac0b5cb0 0x7fcaac143a70 secure :-1 s=READY pgs=1193 cs=0 l=1 rx=0x7fcaac0adaa0 tx=0x7fca9c007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:52.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.182+0000 7fcaabfff700 1 --2- 172.21.15.63:0/2553424916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaac0b5cb0 0x7fcaac143a70 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fcaac0adaa0 tx=0x7fca9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.186+0000 7fcaabfff700 1 --2- 172.21.15.63:0/2553424916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaac0b5cb0 0x7fcaac143a70 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fcaac0adaa0 tx=0x7fca9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.186+0000 7fcaa8ff9700 1 -- 172.21.15.63:0/2553424916 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca9c00ae80 con 0x7fcaac0b5cb0 2020-05-18T21:35:52.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.186+0000 7fcaabfff700 1 --2- 172.21.15.63:0/2553424916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaac0b5cb0 0x7fcaac143a70 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fcaac0adaa0 tx=0x7fca9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.186+0000 7fcaa8ff9700 1 -- 172.21.15.63:0/2553424916 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c005c70 con 0x7fcaac0b5cb0 2020-05-18T21:35:52.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.186+0000 7fcab0d06700 1 -- 172.21.15.63:0/2553424916 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac1435d0 con 0x7fcaac0b5cb0 2020-05-18T21:35:52.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.186+0000 7fcaa8ff9700 1 -- 172.21.15.63:0/2553424916 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca9c007170 con 0x7fcaac0b5cb0 2020-05-18T21:35:52.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.186+0000 7fcab0d06700 1 -- 172.21.15.63:0/2553424916 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaac13f440 con 0x7fcaac0b5cb0 2020-05-18T21:35:52.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.186+0000 7fcaabfff700 1 --2- 172.21.15.63:0/2553424916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaac0b5cb0 0x7fcaac143a70 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fcaac0adaa0 tx=0x7fca9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.186+0000 7fcab0d06700 1 -- 172.21.15.63:0/2553424916 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaac0569e0 con 0x7fcaac0b5cb0 2020-05-18T21:35:52.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.186+0000 7fcaa8ff9700 1 -- 172.21.15.63:0/2553424916 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fca9c0073e0 con 0x7fcaac0b5cb0 2020-05-18T21:35:52.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.186+0000 7fcaabfff700 1 --2- 172.21.15.63:0/2553424916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaac0b5cb0 0x7fcaac143a70 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fcaac0adaa0 tx=0x7fca9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.186+0000 7fcaa8ff9700 1 --2- 172.21.15.63:0/2553424916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9004fa10 0x7fca90051ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:52.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.186+0000 7fcaa8ff9700 1 -- 172.21.15.63:0/2553424916 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fca9c0649d0 con 0x7fcaac0b5cb0 2020-05-18T21:35:52.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.186+0000 7fcaab7fe700 1 --2- 172.21.15.63:0/2553424916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9004fa10 0x7fca90051ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:52.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.190+0000 7fcaab7fe700 1 --2- 172.21.15.63:0/2553424916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9004fa10 0x7fca90051ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcaac118140 tx=0x7fca94009830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.190+0000 7fcaab7fe700 1 --2- 172.21.15.63:0/2553424916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9004fa10 0x7fca90051ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcaac118140 tx=0x7fca94009830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.190+0000 7fcaab7fe700 1 --2- 172.21.15.63:0/2553424916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9004fa10 0x7fca90051ed0 secure :-1 s=READY pgs=700 cs=0 l=1 rx=0x7fcaac118140 tx=0x7fca94009830).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:52.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.194+0000 7fcaabfff700 1 --2- 172.21.15.63:0/2553424916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaac0b5cb0 0x7fcaac143a70 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fcaac0adaa0 tx=0x7fca9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.194+0000 7fcaa8ff9700 1 -- 172.21.15.63:0/2553424916 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fca9c03ee80 con 0x7fcaac0b5cb0 2020-05-18T21:35:52.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.346+0000 7fcab0d06700 1 -- 172.21.15.63:0/2553424916 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fcaac115040 con 0x7fcaac0b5cb0 2020-05-18T21:35:52.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.354+0000 7fcaabfff700 1 --2- 172.21.15.63:0/2553424916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaac0b5cb0 0x7fcaac143a70 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fcaac0adaa0 tx=0x7fca9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.354+0000 7fcaa8ff9700 1 -- 172.21.15.63:0/2553424916 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v52) v1 ==== 184+0+0 (secure 0 0 0) 0x7fca9c0424a0 con 0x7fcaac0b5cb0 2020-05-18T21:35:52.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.358+0000 7fcab0d06700 1 -- 172.21.15.63:0/2553424916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9004fa10 msgr2=0x7fca90051ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:52.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.358+0000 7fcab0d06700 1 --2- 172.21.15.63:0/2553424916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9004fa10 0x7fca90051ed0 secure :-1 s=READY pgs=700 cs=0 l=1 rx=0x7fcaac118140 tx=0x7fca94009830).stop 2020-05-18T21:35:52.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.358+0000 7fcab0d06700 1 -- 172.21.15.63:0/2553424916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaac0b5cb0 msgr2=0x7fcaac143a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:52.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.358+0000 7fcab0d06700 1 --2- 172.21.15.63:0/2553424916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaac0b5cb0 0x7fcaac143a70 secure :-1 s=READY pgs=1193 cs=0 l=1 rx=0x7fcaac0adaa0 tx=0x7fca9c007e00).stop 2020-05-18T21:35:52.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.358+0000 7fcab0d06700 1 -- 172.21.15.63:0/2553424916 shutdown_connections 2020-05-18T21:35:52.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.358+0000 7fcab0d06700 1 --2- 172.21.15.63:0/2553424916 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca9004fa10 0x7fca90051ed0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:52.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.358+0000 7fcab0d06700 1 --2- 172.21.15.63:0/2553424916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaac0b5cb0 0x7fcaac143a70 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:52.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.358+0000 7fcab0d06700 1 -- 172.21.15.63:0/2553424916 >> 172.21.15.63:0/2553424916 conn(0x7fcaac069b70 msgr2=0x7fcaac062700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:52.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.358+0000 7fcab0d06700 1 -- 172.21.15.63:0/2553424916 shutdown_connections 2020-05-18T21:35:52.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.358+0000 7fcab0d06700 1 -- 172.21.15.63:0/2553424916 wait complete. 2020-05-18T21:35:52.365 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.1 2020-05-18T21:35:52.377 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:35:52.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.482+0000 7f8d707b5700 1 Processor -- start 2020-05-18T21:35:52.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.482+0000 7f8d707b5700 1 -- start start 2020-05-18T21:35:52.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.482+0000 7f8d707b5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d680b8c30 0x7f8d681566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:52.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.482+0000 7f8d707b5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d680ad070 0x7f8d68156b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:52.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.482+0000 7f8d707b5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8d68156fb0 0x7f8d6815b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:52.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.482+0000 7f8d707b5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d680801d0 con 0x7f8d68156fb0 2020-05-18T21:35:52.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.482+0000 7f8d707b5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d680b5ae0 con 0x7f8d680b8c30 2020-05-18T21:35:52.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.482+0000 7f8d707b5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68065a70 con 0x7f8d680ad070 2020-05-18T21:35:52.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.482+0000 7f8d6f553700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8d68156fb0 0x7f8d6815b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:52.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.482+0000 7f8d6f553700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8d68156fb0 0x7f8d6815b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34596/0 (socket says 172.21.15.63:34596) 2020-05-18T21:35:52.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.482+0000 7f8d6f553700 1 -- 172.21.15.63:0/1788815899 learned_addr learned my addr 172.21.15.63:0/1788815899 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:52.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.482+0000 7f8d6ed52700 1 --2- 172.21.15.63:0/1788815899 >> v2:172.21.15.155:3300/0 conn(0x7f8d680b8c30 0x7f8d681566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:52.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.482+0000 7f8d6e551700 1 --2- 172.21.15.63:0/1788815899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d680ad070 0x7f8d68156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:52.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d6f553700 1 -- 172.21.15.63:0/1788815899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d680ad070 msgr2=0x7f8d68156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:52.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d6f553700 1 --2- 172.21.15.63:0/1788815899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d680ad070 0x7f8d68156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:52.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d6f553700 1 -- 172.21.15.63:0/1788815899 >> v2:172.21.15.155:3300/0 conn(0x7f8d680b8c30 msgr2=0x7f8d681566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:52.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d6f553700 1 --2- 172.21.15.63:0/1788815899 >> v2:172.21.15.155:3300/0 conn(0x7f8d680b8c30 0x7f8d681566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:52.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d6f553700 1 -- 172.21.15.63:0/1788815899 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d680b9010 con 0x7f8d68156fb0 2020-05-18T21:35:52.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d6f553700 1 --2- 172.21.15.63:0/1788815899 >> v2:172.21.15.63:3300/0 conn(0x7f8d68156fb0 0x7f8d6815b9b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8d680b5c20 tx=0x7f8d60008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d6f553700 1 --2- 172.21.15.63:0/1788815899 >> v2:172.21.15.63:3300/0 conn(0x7f8d68156fb0 0x7f8d6815b9b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8d680b5c20 tx=0x7f8d60008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d6f553700 1 --2- 172.21.15.63:0/1788815899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d68156fb0 0x7f8d6815b9b0 secure :-1 s=READY pgs=1801 cs=0 l=1 rx=0x7f8d680b5c20 tx=0x7f8d60008920).ready entity=mon.0 client_cookie=d552ab06776d2eaf server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:52.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d6f553700 1 --2- 172.21.15.63:0/1788815899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d68156fb0 0x7f8d6815b9b0 secure :-1 s=THROTTLE_DONE pgs=1801 cs=0 l=1 rx=0x7f8d680b5c20 tx=0x7f8d60008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d6dd50700 1 -- 172.21.15.63:0/1788815899 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d60011600 con 0x7f8d68156fb0 2020-05-18T21:35:52.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d6f553700 1 --2- 172.21.15.63:0/1788815899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d68156fb0 0x7f8d6815b9b0 secure :-1 s=THROTTLE_DONE pgs=1801 cs=0 l=1 rx=0x7f8d680b5c20 tx=0x7f8d60008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d6dd50700 1 -- 172.21.15.63:0/1788815899 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d60011760 con 0x7f8d68156fb0 2020-05-18T21:35:52.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d6f553700 1 --2- 172.21.15.63:0/1788815899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d68156fb0 0x7f8d6815b9b0 secure :-1 s=THROTTLE_DONE pgs=1801 cs=0 l=1 rx=0x7f8d680b5c20 tx=0x7f8d60008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d707b5700 1 -- 172.21.15.63:0/1788815899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d68156fb0 msgr2=0x7f8d6815b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:52.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d6dd50700 1 -- 172.21.15.63:0/1788815899 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d60011b80 con 0x7f8d68156fb0 2020-05-18T21:35:52.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d707b5700 1 --2- 172.21.15.63:0/1788815899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d68156fb0 0x7f8d6815b9b0 secure :-1 s=READY pgs=1801 cs=0 l=1 rx=0x7f8d680b5c20 tx=0x7f8d60008920).stop 2020-05-18T21:35:52.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d707b5700 1 -- 172.21.15.63:0/1788815899 shutdown_connections 2020-05-18T21:35:52.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d707b5700 1 --2- 172.21.15.63:0/1788815899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d68156fb0 0x7f8d6815b9b0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:52.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d707b5700 1 --2- 172.21.15.63:0/1788815899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d680ad070 0x7f8d68156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:52.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d707b5700 1 --2- 172.21.15.63:0/1788815899 >> v2:172.21.15.155:3300/0 conn(0x7f8d680b8c30 0x7f8d681566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:52.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d707b5700 1 -- 172.21.15.63:0/1788815899 >> 172.21.15.63:0/1788815899 conn(0x7f8d6806a640 msgr2=0x7f8d680b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:52.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d707b5700 1 -- 172.21.15.63:0/1788815899 shutdown_connections 2020-05-18T21:35:52.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.486+0000 7f8d707b5700 1 -- 172.21.15.63:0/1788815899 wait complete. 2020-05-18T21:35:52.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d707b5700 1 Processor -- start 2020-05-18T21:35:52.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d707b5700 1 -- start start 2020-05-18T21:35:52.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d707b5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d68156fb0 0x7f8d68065150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:52.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d707b5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d68123b60 con 0x7f8d680ad070 2020-05-18T21:35:52.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d707b5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d68123180 con 0x7f8d680b8c30 2020-05-18T21:35:52.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d707b5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68123420 con 0x7f8d68156fb0 2020-05-18T21:35:52.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d6ed52700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8d680ad070 0x7f8d680b3770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36786/0 (socket says 172.21.15.63:36786) 2020-05-18T21:35:52.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d6ed52700 1 -- 172.21.15.63:0/2481288073 learned_addr learned my addr 172.21.15.63:0/2481288073 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:52.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d6f553700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d68156fb0 0x7f8d68065150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:52.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d677fe700 1 -- 172.21.15.63:0/2481288073 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403930252 0 0) 0x7f8d68123b60 con 0x7f8d680ad070 2020-05-18T21:35:52.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d677fe700 1 -- 172.21.15.63:0/2481288073 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d50003270 con 0x7f8d680ad070 2020-05-18T21:35:52.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d677fe700 1 -- 172.21.15.63:0/2481288073 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702358474 0 0) 0x7f8d68123180 con 0x7f8d680b8c30 2020-05-18T21:35:52.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d677fe700 1 -- 172.21.15.63:0/2481288073 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d68123b60 con 0x7f8d680b8c30 2020-05-18T21:35:52.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d6f553700 1 -- 172.21.15.63:0/2481288073 >> v1:172.21.15.155:6789/0 conn(0x7f8d680b8c30 legacy=0x7f8d68074aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:52.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d6f553700 1 -- 172.21.15.63:0/2481288073 >> v1:172.21.15.63:6789/0 conn(0x7f8d680ad070 legacy=0x7f8d680b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:52.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d6f553700 1 -- 172.21.15.63:0/2481288073 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d681236c0 con 0x7f8d68156fb0 2020-05-18T21:35:52.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d6f553700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d68156fb0 0x7f8d68065150 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d680749b0 tx=0x7f8d68066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d6f553700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d68156fb0 0x7f8d68065150 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d680749b0 tx=0x7f8d68066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d6f553700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d68156fb0 0x7f8d68065150 secure :-1 s=READY pgs=270 cs=0 l=1 rx=0x7f8d680749b0 tx=0x7f8d68066290).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:52.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d6f553700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d68156fb0 0x7f8d68065150 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7f8d680749b0 tx=0x7f8d68066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d677fe700 1 -- 172.21.15.63:0/2481288073 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d60011e40 con 0x7f8d68156fb0 2020-05-18T21:35:52.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d6f553700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d68156fb0 0x7f8d68065150 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7f8d680749b0 tx=0x7f8d68066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.490+0000 7f8d6f553700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d68156fb0 0x7f8d68065150 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7f8d680749b0 tx=0x7f8d68066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.494+0000 7f8d677fe700 1 -- 172.21.15.63:0/2481288073 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d60007170 con 0x7f8d68156fb0 2020-05-18T21:35:52.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.494+0000 7f8d707b5700 1 -- 172.21.15.63:0/2481288073 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d680631f0 con 0x7f8d68156fb0 2020-05-18T21:35:52.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.494+0000 7f8d677fe700 1 -- 172.21.15.63:0/2481288073 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d600074d0 con 0x7f8d68156fb0 2020-05-18T21:35:52.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.494+0000 7f8d707b5700 1 -- 172.21.15.63:0/2481288073 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d68122e20 con 0x7f8d68156fb0 2020-05-18T21:35:52.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.494+0000 7f8d6f553700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d68156fb0 0x7f8d68065150 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7f8d680749b0 tx=0x7f8d68066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.494+0000 7f8d707b5700 1 -- 172.21.15.63:0/2481288073 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d680569e0 con 0x7f8d68156fb0 2020-05-18T21:35:52.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.494+0000 7f8d677fe700 1 -- 172.21.15.63:0/2481288073 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8d60005700 con 0x7f8d68156fb0 2020-05-18T21:35:52.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.494+0000 7f8d6f553700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d68156fb0 0x7f8d68065150 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7f8d680749b0 tx=0x7f8d68066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.494+0000 7f8d677fe700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d5004fee0 0x7f8d500523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:52.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.494+0000 7f8d677fe700 1 -- 172.21.15.63:0/2481288073 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8d600a7ff0 con 0x7f8d68156fb0 2020-05-18T21:35:52.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.494+0000 7f8d6ed52700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d5004fee0 0x7f8d500523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:52.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.494+0000 7f8d6ed52700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d5004fee0 0x7f8d500523a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d5c0032f0 tx=0x7f8d5c009470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.494+0000 7f8d6ed52700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d5004fee0 0x7f8d500523a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d5c0032f0 tx=0x7f8d5c009470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.494+0000 7f8d6ed52700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d5004fee0 0x7f8d500523a0 secure :-1 s=READY pgs=701 cs=0 l=1 rx=0x7f8d5c0032f0 tx=0x7f8d5c009470).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:52.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.502+0000 7f8d6f553700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d68156fb0 0x7f8d68065150 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7f8d680749b0 tx=0x7f8d68066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.502+0000 7f8d677fe700 1 -- 172.21.15.63:0/2481288073 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f8d60082440 con 0x7f8d68156fb0 2020-05-18T21:35:52.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.658+0000 7f8d707b5700 1 -- 172.21.15.63:0/2481288073 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8d680b68d0 con 0x7f8d68156fb0 2020-05-18T21:35:52.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.666+0000 7f8d6f553700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d68156fb0 0x7f8d68065150 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7f8d680749b0 tx=0x7f8d68066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.666+0000 7f8d677fe700 1 -- 172.21.15.63:0/2481288073 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v53) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8d60085a60 con 0x7f8d68156fb0 2020-05-18T21:35:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.670+0000 7f8d707b5700 1 -- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d5004fee0 msgr2=0x7f8d500523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.670+0000 7f8d707b5700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d5004fee0 0x7f8d500523a0 secure :-1 s=READY pgs=701 cs=0 l=1 rx=0x7f8d5c0032f0 tx=0x7f8d5c009470).stop 2020-05-18T21:35:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.670+0000 7f8d707b5700 1 -- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d68156fb0 msgr2=0x7f8d68065150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:52.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.670+0000 7f8d707b5700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d68156fb0 0x7f8d68065150 secure :-1 s=READY pgs=270 cs=0 l=1 rx=0x7f8d680749b0 tx=0x7f8d68066290).stop 2020-05-18T21:35:52.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.670+0000 7f8d707b5700 1 -- 172.21.15.63:0/2481288073 shutdown_connections 2020-05-18T21:35:52.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.670+0000 7f8d707b5700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d5004fee0 0x7f8d500523a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:52.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.670+0000 7f8d707b5700 1 --2- 172.21.15.63:0/2481288073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d68156fb0 0x7f8d68065150 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:52.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.670+0000 7f8d707b5700 1 -- 172.21.15.63:0/2481288073 >> 172.21.15.63:0/2481288073 conn(0x7f8d6806a640 msgr2=0x7f8d680b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:52.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.670+0000 7f8d707b5700 1 -- 172.21.15.63:0/2481288073 shutdown_connections 2020-05-18T21:35:52.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.670+0000 7f8d707b5700 1 -- 172.21.15.63:0/2481288073 wait complete. 2020-05-18T21:35:52.676 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.2 2020-05-18T21:35:52.687 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:35:52.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25f540700 1 Processor -- start 2020-05-18T21:35:52.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25f540700 1 -- start start 2020-05-18T21:35:52.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25f540700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc2580b8c30 0x7fc2581566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:52.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25f540700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc258157260 0x7fc25815c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:52.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25f540700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc258065a70 con 0x7fc2580ad070 2020-05-18T21:35:52.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25f540700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2580801d0 con 0x7fc258157260 2020-05-18T21:35:52.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25f540700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2580b5ae0 con 0x7fc2580b8c30 2020-05-18T21:35:52.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25e2de700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc258157260 0x7fc25815c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:52.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25dadd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc2580b8c30 0x7fc2581566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:52.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25e2de700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc258157260 0x7fc25815c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34610/0 (socket says 172.21.15.63:34610) 2020-05-18T21:35:52.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25e2de700 1 -- 172.21.15.63:0/403752380 learned_addr learned my addr 172.21.15.63:0/403752380 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:52.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25d2dc700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fc2580ad070 0x7fc258156b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:35110/0 (socket says 172.21.15.63:35110) 2020-05-18T21:35:52.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25e2de700 1 -- 172.21.15.63:0/403752380 >> v2:172.21.15.155:3300/0 conn(0x7fc2580b8c30 msgr2=0x7fc2581566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:52.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25e2de700 1 --2- 172.21.15.63:0/403752380 >> v2:172.21.15.155:3300/0 conn(0x7fc2580b8c30 0x7fc2581566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:52.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25e2de700 1 -- 172.21.15.63:0/403752380 >> v1:172.21.15.155:6789/0 conn(0x7fc2580ad070 legacy=0x7fc258156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:52.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25e2de700 1 -- 172.21.15.63:0/403752380 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2580b9010 con 0x7fc258157260 2020-05-18T21:35:52.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25e2de700 1 --2- 172.21.15.63:0/403752380 >> v2:172.21.15.63:3300/0 conn(0x7fc258157260 0x7fc25815c9c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc2500032f0 tx=0x7fc250007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25e2de700 1 --2- 172.21.15.63:0/403752380 >> v2:172.21.15.63:3300/0 conn(0x7fc258157260 0x7fc25815c9c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc2500032f0 tx=0x7fc250007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25e2de700 1 --2- 172.21.15.63:0/403752380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc258157260 0x7fc25815c9c0 secure :-1 s=READY pgs=1803 cs=0 l=1 rx=0x7fc2500032f0 tx=0x7fc250007e00).ready entity=mon.0 client_cookie=42faab81a23c722 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:52.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25e2de700 1 --2- 172.21.15.63:0/403752380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc258157260 0x7fc25815c9c0 secure :-1 s=THROTTLE_DONE pgs=1803 cs=0 l=1 rx=0x7fc2500032f0 tx=0x7fc250007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25cadb700 1 -- 172.21.15.63:0/403752380 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc250011d10 con 0x7fc258157260 2020-05-18T21:35:52.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25e2de700 1 --2- 172.21.15.63:0/403752380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc258157260 0x7fc25815c9c0 secure :-1 s=THROTTLE_DONE pgs=1803 cs=0 l=1 rx=0x7fc2500032f0 tx=0x7fc250007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25e2de700 1 --2- 172.21.15.63:0/403752380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc258157260 0x7fc25815c9c0 secure :-1 s=THROTTLE_DONE pgs=1803 cs=0 l=1 rx=0x7fc2500032f0 tx=0x7fc250007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25cadb700 1 -- 172.21.15.63:0/403752380 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc250011e70 con 0x7fc258157260 2020-05-18T21:35:52.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25cadb700 1 -- 172.21.15.63:0/403752380 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc25000a370 con 0x7fc258157260 2020-05-18T21:35:52.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25f540700 1 -- 172.21.15.63:0/403752380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc258157260 msgr2=0x7fc25815c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:52.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.802+0000 7fc25f540700 1 --2- 172.21.15.63:0/403752380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc258157260 0x7fc25815c9c0 secure :-1 s=READY pgs=1803 cs=0 l=1 rx=0x7fc2500032f0 tx=0x7fc250007e00).stop 2020-05-18T21:35:52.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.806+0000 7fc25f540700 1 -- 172.21.15.63:0/403752380 shutdown_connections 2020-05-18T21:35:52.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.806+0000 7fc25f540700 1 --2- 172.21.15.63:0/403752380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc258157260 0x7fc25815c9c0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:52.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.806+0000 7fc25f540700 1 --2- 172.21.15.63:0/403752380 >> v2:172.21.15.155:3300/0 conn(0x7fc2580b8c30 0x7fc2581566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:52.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.806+0000 7fc25f540700 1 -- 172.21.15.63:0/403752380 >> 172.21.15.63:0/403752380 conn(0x7fc25806a640 msgr2=0x7fc2580b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:52.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.806+0000 7fc25f540700 1 -- 172.21.15.63:0/403752380 shutdown_connections 2020-05-18T21:35:52.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.806+0000 7fc25f540700 1 -- 172.21.15.63:0/403752380 wait complete. 2020-05-18T21:35:52.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.806+0000 7fc25f540700 1 Processor -- start 2020-05-18T21:35:52.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.806+0000 7fc25f540700 1 -- start start 2020-05-18T21:35:52.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25f540700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2580ad070 0x7fc25807ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:52.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25f540700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc258157260 0x7fc258134a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:52.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25f540700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc258134050 con 0x7fc2580b8c30 2020-05-18T21:35:52.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25f540700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2581342f0 con 0x7fc258157260 2020-05-18T21:35:52.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25f540700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc258134590 con 0x7fc2580ad070 2020-05-18T21:35:52.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25d2dc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc2580b8c30 0x7fc2580649c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36802/0 (socket says 172.21.15.63:36802) 2020-05-18T21:35:52.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25d2dc700 1 -- 172.21.15.63:0/3052231764 learned_addr learned my addr 172.21.15.63:0/3052231764 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:52.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25e2de700 1 --2- 172.21.15.63:0/3052231764 >> v2:172.21.15.155:3300/0 conn(0x7fc258157260 0x7fc258134a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:52.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25dadd700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2580ad070 0x7fc25807ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:52.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc24e7fc700 1 -- 172.21.15.63:0/3052231764 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013264852 0 0) 0x7fc258134050 con 0x7fc2580b8c30 2020-05-18T21:35:52.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc24e7fc700 1 -- 172.21.15.63:0/3052231764 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc240003270 con 0x7fc2580b8c30 2020-05-18T21:35:52.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc24e7fc700 1 -- 172.21.15.63:0/3052231764 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2511179128 0 0) 0x7fc240003270 con 0x7fc2580b8c30 2020-05-18T21:35:52.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25dadd700 1 -- 172.21.15.63:0/3052231764 >> v2:172.21.15.155:3300/0 conn(0x7fc258157260 msgr2=0x7fc258134a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:52.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25dadd700 1 --2- 172.21.15.63:0/3052231764 >> v2:172.21.15.155:3300/0 conn(0x7fc258157260 0x7fc258134a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:52.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25dadd700 1 -- 172.21.15.63:0/3052231764 >> v1:172.21.15.63:6789/0 conn(0x7fc2580b8c30 legacy=0x7fc2580649c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:52.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25dadd700 1 -- 172.21.15.63:0/3052231764 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2580650d0 con 0x7fc2580ad070 2020-05-18T21:35:52.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25e2de700 1 --2- 172.21.15.63:0/3052231764 >> v2:172.21.15.155:3300/0 conn(0x7fc258157260 0x7fc258134a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:35:52.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25dadd700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2580ad070 0x7fc25807ebf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc248001af0 tx=0x7fc254010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25dadd700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2580ad070 0x7fc25807ebf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc248001af0 tx=0x7fc254010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25dadd700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2580ad070 0x7fc25807ebf0 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7fc248001af0 tx=0x7fc254010bd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:52.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25dadd700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2580ad070 0x7fc25807ebf0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7fc248001af0 tx=0x7fc254010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc24e7fc700 1 -- 172.21.15.63:0/3052231764 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc248001950 con 0x7fc2580ad070 2020-05-18T21:35:52.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25dadd700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2580ad070 0x7fc25807ebf0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7fc248001af0 tx=0x7fc254010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25dadd700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2580ad070 0x7fc25807ebf0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7fc248001af0 tx=0x7fc254010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc24e7fc700 1 -- 172.21.15.63:0/3052231764 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25400e6c0 con 0x7fc2580ad070 2020-05-18T21:35:52.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25f540700 1 -- 172.21.15.63:0/3052231764 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc258133cd0 con 0x7fc2580ad070 2020-05-18T21:35:52.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc24e7fc700 1 -- 172.21.15.63:0/3052231764 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc25400ea20 con 0x7fc2580ad070 2020-05-18T21:35:52.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.810+0000 7fc25f540700 1 -- 172.21.15.63:0/3052231764 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc25807f290 con 0x7fc2580ad070 2020-05-18T21:35:52.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.814+0000 7fc25f540700 1 -- 172.21.15.63:0/3052231764 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc258134f20 con 0x7fc2580ad070 2020-05-18T21:35:52.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.814+0000 7fc25dadd700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2580ad070 0x7fc25807ebf0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7fc248001af0 tx=0x7fc254010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.814+0000 7fc24e7fc700 1 -- 172.21.15.63:0/3052231764 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc25400ec10 con 0x7fc2580ad070 2020-05-18T21:35:52.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.814+0000 7fc25dadd700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2580ad070 0x7fc25807ebf0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7fc248001af0 tx=0x7fc254010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.814+0000 7fc24e7fc700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc24004fd70 0x7fc240052230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:52.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.814+0000 7fc24e7fc700 1 -- 172.21.15.63:0/3052231764 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc2540634e0 con 0x7fc2580ad070 2020-05-18T21:35:52.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.814+0000 7fc25d2dc700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc24004fd70 0x7fc240052230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:52.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.814+0000 7fc25d2dc700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc24004fd70 0x7fc240052230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc248000fe0 tx=0x7fc2480095e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.814+0000 7fc25d2dc700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc24004fd70 0x7fc240052230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc248000fe0 tx=0x7fc2480095e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.814+0000 7fc25d2dc700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc24004fd70 0x7fc240052230 secure :-1 s=READY pgs=702 cs=0 l=1 rx=0x7fc248000fe0 tx=0x7fc2480095e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:52.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.822+0000 7fc25dadd700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2580ad070 0x7fc25807ebf0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7fc248001af0 tx=0x7fc254010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.822+0000 7fc24e7fc700 1 -- 172.21.15.63:0/3052231764 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc25403d810 con 0x7fc2580ad070 2020-05-18T21:35:52.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.974+0000 7fc25f540700 1 -- 172.21.15.63:0/3052231764 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fc258133e60 con 0x7fc2580ad070 2020-05-18T21:35:52.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.982+0000 7fc25dadd700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2580ad070 0x7fc25807ebf0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7fc248001af0 tx=0x7fc254010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:52.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.986+0000 7fc24e7fc700 1 -- 172.21.15.63:0/3052231764 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v54) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc254040e30 con 0x7fc2580ad070 2020-05-18T21:35:52.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.986+0000 7fc25f540700 1 -- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc24004fd70 msgr2=0x7fc240052230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:52.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.986+0000 7fc25f540700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc24004fd70 0x7fc240052230 secure :-1 s=READY pgs=702 cs=0 l=1 rx=0x7fc248000fe0 tx=0x7fc2480095e0).stop 2020-05-18T21:35:52.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.986+0000 7fc25f540700 1 -- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2580ad070 msgr2=0x7fc25807ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:52.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.986+0000 7fc25f540700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2580ad070 0x7fc25807ebf0 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7fc248001af0 tx=0x7fc254010bd0).stop 2020-05-18T21:35:52.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.986+0000 7fc25f540700 1 -- 172.21.15.63:0/3052231764 shutdown_connections 2020-05-18T21:35:52.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.986+0000 7fc25f540700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc24004fd70 0x7fc240052230 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:52.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.986+0000 7fc25f540700 1 --2- 172.21.15.63:0/3052231764 >> v2:172.21.15.155:3300/0 conn(0x7fc258157260 0x7fc258134a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:52.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.986+0000 7fc25f540700 1 --2- 172.21.15.63:0/3052231764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2580ad070 0x7fc25807ebf0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:52.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.986+0000 7fc25f540700 1 -- 172.21.15.63:0/3052231764 >> 172.21.15.63:0/3052231764 conn(0x7fc25806a640 msgr2=0x7fc2580b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:52.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.986+0000 7fc25f540700 1 -- 172.21.15.63:0/3052231764 shutdown_connections 2020-05-18T21:35:52.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:52.986+0000 7fc25f540700 1 -- 172.21.15.63:0/3052231764 wait complete. 2020-05-18T21:35:52.995 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.3 2020-05-18T21:35:53.009 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:35:53.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.110+0000 7f4461045700 1 Processor -- start 2020-05-18T21:35:53.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.110+0000 7f4461045700 1 -- start start 2020-05-18T21:35:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f4461045700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f445c13de20 0x7f445c0b6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f4461045700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445c069b70 con 0x7f445c144810 2020-05-18T21:35:53.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f4461045700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445c069e10 con 0x7f445c0b4f60 2020-05-18T21:35:53.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f4461045700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445c06a0b0 con 0x7f445c13de20 2020-05-18T21:35:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f445a59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f445c144810 0x7f445c06a550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36812/0 (socket says 172.21.15.63:36812) 2020-05-18T21:35:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f445a59c700 1 -- 172.21.15.63:0/3749966105 learned_addr learned my addr 172.21.15.63:0/3749966105 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f445ad9d700 1 --2- 172.21.15.63:0/3749966105 >> v2:172.21.15.155:3300/0 conn(0x7f445c13de20 0x7f445c0b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f4459d9b700 1 -- 172.21.15.63:0/3749966105 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930735025 0 0) 0x7f445c069b70 con 0x7f445c144810 2020-05-18T21:35:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f4459d9b700 1 -- 172.21.15.63:0/3749966105 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f443c003270 con 0x7f445c144810 2020-05-18T21:35:53.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f445ad9d700 1 -- 172.21.15.63:0/3749966105 >> v1:172.21.15.155:6789/0 conn(0x7f445c0b4f60 legacy=0x7f445c062a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:53.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f445ad9d700 1 -- 172.21.15.63:0/3749966105 >> v1:172.21.15.63:6789/0 conn(0x7f445c144810 legacy=0x7f445c06a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:53.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f445ad9d700 1 -- 172.21.15.63:0/3749966105 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c144c50 con 0x7f445c13de20 2020-05-18T21:35:53.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f445ad9d700 1 --2- 172.21.15.63:0/3749966105 >> v2:172.21.15.155:3300/0 conn(0x7f445c13de20 0x7f445c0b6180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f44540032f0 tx=0x7f4454007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f445ad9d700 1 --2- 172.21.15.63:0/3749966105 >> v2:172.21.15.155:3300/0 conn(0x7f445c13de20 0x7f445c0b6180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f44540032f0 tx=0x7f4454007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f445ad9d700 1 --2- 172.21.15.63:0/3749966105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445c13de20 0x7f445c0b6180 secure :-1 s=READY pgs=1197 cs=0 l=1 rx=0x7f44540032f0 tx=0x7f4454007e00).ready entity=mon.1 client_cookie=c9cec79225e8c5b2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:53.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f445ad9d700 1 --2- 172.21.15.63:0/3749966105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445c13de20 0x7f445c0b6180 secure :-1 s=THROTTLE_DONE pgs=1197 cs=0 l=1 rx=0x7f44540032f0 tx=0x7f4454007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f4459d9b700 1 -- 172.21.15.63:0/3749966105 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4454011e60 con 0x7f445c13de20 2020-05-18T21:35:53.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f445ad9d700 1 --2- 172.21.15.63:0/3749966105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445c13de20 0x7f445c0b6180 secure :-1 s=THROTTLE_DONE pgs=1197 cs=0 l=1 rx=0x7f44540032f0 tx=0x7f4454007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f445ad9d700 1 --2- 172.21.15.63:0/3749966105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445c13de20 0x7f445c0b6180 secure :-1 s=THROTTLE_DONE pgs=1197 cs=0 l=1 rx=0x7f44540032f0 tx=0x7f4454007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f4459d9b700 1 -- 172.21.15.63:0/3749966105 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445400a180 con 0x7f445c13de20 2020-05-18T21:35:53.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f4461045700 1 -- 172.21.15.63:0/3749966105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445c13de20 msgr2=0x7f445c0b6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:53.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f4461045700 1 --2- 172.21.15.63:0/3749966105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445c13de20 0x7f445c0b6180 secure :-1 s=READY pgs=1197 cs=0 l=1 rx=0x7f44540032f0 tx=0x7f4454007e00).stop 2020-05-18T21:35:53.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f4459d9b700 1 -- 172.21.15.63:0/3749966105 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f445400a520 con 0x7f445c13de20 2020-05-18T21:35:53.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f4461045700 1 -- 172.21.15.63:0/3749966105 shutdown_connections 2020-05-18T21:35:53.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f4461045700 1 --2- 172.21.15.63:0/3749966105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445c13de20 0x7f445c0b6180 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:53.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f4461045700 1 -- 172.21.15.63:0/3749966105 >> 172.21.15.63:0/3749966105 conn(0x7f445c0ba5c0 msgr2=0x7f445c0ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:53.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f4461045700 1 -- 172.21.15.63:0/3749966105 shutdown_connections 2020-05-18T21:35:53.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f4461045700 1 -- 172.21.15.63:0/3749966105 wait complete. 2020-05-18T21:35:53.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.114+0000 7f4461045700 1 Processor -- start 2020-05-18T21:35:53.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f4461045700 1 -- start start 2020-05-18T21:35:53.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f4461045700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f445c13de20 0x7f445c154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:53.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f4461045700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f445c144810 0x7f445c061b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:53.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f4461045700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445c060c30 con 0x7f445c0b4f60 2020-05-18T21:35:53.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f4461045700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445c0af610 con 0x7f445c13de20 2020-05-18T21:35:53.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f4461045700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0af800 con 0x7f445c144810 2020-05-18T21:35:53.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f445a59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f445c13de20 0x7f445c154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:53.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f445a59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f445c13de20 0x7f445c154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:49476/0 (socket says 172.21.15.63:49476) 2020-05-18T21:35:53.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f445ad9d700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f445c0b4f60 0x7f445c0ad940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:35130/0 (socket says 172.21.15.63:35130) 2020-05-18T21:35:53.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f445a59c700 1 -- 172.21.15.63:0/1343995546 learned_addr learned my addr 172.21.15.63:0/1343995546 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:53.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f445b59e700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f445c144810 0x7f445c061b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:53.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f445a59c700 1 -- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f445c144810 msgr2=0x7f445c061b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:53.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f445a59c700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f445c144810 0x7f445c061b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:53.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f445a59c700 1 -- 172.21.15.63:0/1343995546 >> v1:172.21.15.155:6789/0 conn(0x7f445c0b4f60 legacy=0x7f445c0ad940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:53.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f445a59c700 1 -- 172.21.15.63:0/1343995546 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c0afaa0 con 0x7f445c13de20 2020-05-18T21:35:53.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f4453fff700 1 -- 172.21.15.63:0/1343995546 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699397344 0 0) 0x7f445c060c30 con 0x7f445c0b4f60 2020-05-18T21:35:53.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f445a59c700 1 --2- 172.21.15.63:0/1343995546 >> v2:172.21.15.155:3300/0 conn(0x7f445c13de20 0x7f445c154140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f445c060340 tx=0x7f4444010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f445a59c700 1 --2- 172.21.15.63:0/1343995546 >> v2:172.21.15.155:3300/0 conn(0x7f445c13de20 0x7f445c154140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f445c060340 tx=0x7f4444010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f445a59c700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445c13de20 0x7f445c154140 secure :-1 s=READY pgs=1199 cs=0 l=1 rx=0x7f445c060340 tx=0x7f4444010980).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:53.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f445a59c700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445c13de20 0x7f445c154140 secure :-1 s=THROTTLE_DONE pgs=1199 cs=0 l=1 rx=0x7f445c060340 tx=0x7f4444010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f4453fff700 1 -- 172.21.15.63:0/1343995546 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4444005d00 con 0x7f445c13de20 2020-05-18T21:35:53.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f445a59c700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445c13de20 0x7f445c154140 secure :-1 s=THROTTLE_DONE pgs=1199 cs=0 l=1 rx=0x7f445c060340 tx=0x7f4444010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f4453fff700 1 -- 172.21.15.63:0/1343995546 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4444005e60 con 0x7f445c13de20 2020-05-18T21:35:53.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f4461045700 1 -- 172.21.15.63:0/1343995546 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445c061f80 con 0x7f445c13de20 2020-05-18T21:35:53.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f445a59c700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445c13de20 0x7f445c154140 secure :-1 s=THROTTLE_DONE pgs=1199 cs=0 l=1 rx=0x7f445c060340 tx=0x7f4444010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f4453fff700 1 -- 172.21.15.63:0/1343995546 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44440062c0 con 0x7f445c13de20 2020-05-18T21:35:53.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.118+0000 7f4461045700 1 -- 172.21.15.63:0/1343995546 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445c060ea0 con 0x7f445c13de20 2020-05-18T21:35:53.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.122+0000 7f445a59c700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445c13de20 0x7f445c154140 secure :-1 s=THROTTLE_DONE pgs=1199 cs=0 l=1 rx=0x7f445c060340 tx=0x7f4444010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.122+0000 7f4461045700 1 -- 172.21.15.63:0/1343995546 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445c0569e0 con 0x7f445c13de20 2020-05-18T21:35:53.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.122+0000 7f4453fff700 1 -- 172.21.15.63:0/1343995546 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4444006500 con 0x7f445c13de20 2020-05-18T21:35:53.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.122+0000 7f445a59c700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445c13de20 0x7f445c154140 secure :-1 s=THROTTLE_DONE pgs=1199 cs=0 l=1 rx=0x7f445c060340 tx=0x7f4444010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.122+0000 7f4453fff700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f444004f890 0x7f4440051d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:53.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.122+0000 7f4453fff700 1 -- 172.21.15.63:0/1343995546 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f44440090c0 con 0x7f445c13de20 2020-05-18T21:35:53.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.122+0000 7f445ad9d700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f444004f890 0x7f4440051d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:53.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.122+0000 7f445ad9d700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f444004f890 0x7f4440051d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4454008ca0 tx=0x7f4454007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.122+0000 7f445ad9d700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f444004f890 0x7f4440051d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4454008ca0 tx=0x7f4454007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.122+0000 7f445ad9d700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f444004f890 0x7f4440051d50 secure :-1 s=READY pgs=703 cs=0 l=1 rx=0x7f4454008ca0 tx=0x7f4454007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:53.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.130+0000 7f445a59c700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445c13de20 0x7f445c154140 secure :-1 s=THROTTLE_DONE pgs=1199 cs=0 l=1 rx=0x7f445c060340 tx=0x7f4444010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.130+0000 7f4453fff700 1 -- 172.21.15.63:0/1343995546 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f444403e090 con 0x7f445c13de20 2020-05-18T21:35:53.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.278+0000 7f4461045700 1 -- 172.21.15.63:0/1343995546 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f445c0bb4e0 con 0x7f445c13de20 2020-05-18T21:35:53.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.278+0000 7f445a59c700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445c13de20 0x7f445c154140 secure :-1 s=THROTTLE_DONE pgs=1199 cs=0 l=1 rx=0x7f445c060340 tx=0x7f4444010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.278+0000 7f4453fff700 1 -- 172.21.15.63:0/1343995546 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+2146 (secure 0 0 0) 0x7f44440416b0 con 0x7f445c13de20 2020-05-18T21:35:53.285 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:53.286 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":102,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2822608544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2822608544},{"type":"v1","addr":"172.21.15.155:6835","nonce":2822608544}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":101}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:35:51.163874+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:35:53.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.282+0000 7f4461045700 1 -- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f444004f890 msgr2=0x7f4440051d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:53.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.282+0000 7f4461045700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f444004f890 0x7f4440051d50 secure :-1 s=READY pgs=703 cs=0 l=1 rx=0x7f4454008ca0 tx=0x7f4454007e00).stop 2020-05-18T21:35:53.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.282+0000 7f4461045700 1 -- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445c13de20 msgr2=0x7f445c154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:53.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.282+0000 7f4461045700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445c13de20 0x7f445c154140 secure :-1 s=READY pgs=1199 cs=0 l=1 rx=0x7f445c060340 tx=0x7f4444010980).stop 2020-05-18T21:35:53.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.282+0000 7f4461045700 1 -- 172.21.15.63:0/1343995546 shutdown_connections 2020-05-18T21:35:53.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.282+0000 7f4461045700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f444004f890 0x7f4440051d50 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:53.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.282+0000 7f4461045700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f445c144810 0x7f445c061b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:53.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.282+0000 7f4461045700 1 --2- 172.21.15.63:0/1343995546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f445c13de20 0x7f445c154140 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:53.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.282+0000 7f4461045700 1 -- 172.21.15.63:0/1343995546 >> 172.21.15.63:0/1343995546 conn(0x7f445c0ba5c0 msgr2=0x7f445c0b53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:53.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.282+0000 7f4461045700 1 -- 172.21.15.63:0/1343995546 shutdown_connections 2020-05-18T21:35:53.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.282+0000 7f4461045700 1 -- 172.21.15.63:0/1343995546 wait complete. 2020-05-18T21:35:53.292 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 102 2020-05-18T21:35:53.500 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 102, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:35:50.157703+0000', 'modified': '2020-05-18T21:35:51.163874+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9501}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9501': {'gid': 9501, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/169345666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 169345666}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 169345666}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:35:53.500 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:35:53.501 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:35:53.610 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:35:53.611 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:35:53.611 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:35:53.611 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 9501, 2020-05-18T21:35:53.611 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:35:53.612 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:35:53.612 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 3.4455215539999999, 2020-05-18T21:35:53.612 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 102, 2020-05-18T21:35:53.612 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 134, 2020-05-18T21:35:53.612 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 134, 2020-05-18T21:35:53.612 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 7.6634152770000004 2020-05-18T21:35:53.613 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:35:53.619 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 9501, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.4455215539999999, "mdsmap_epoch": 102, "osdmap_epoch": 134, "osdmap_epoch_barrier": 134, "uptime": 7.6634152770000004 } 2020-05-18T21:35:53.620 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:35:53.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.714+0000 7fc5e902f700 1 Processor -- start 2020-05-18T21:35:53.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.714+0000 7fc5e902f700 1 -- start start 2020-05-18T21:35:53.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e902f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5e4060b90 0x7fc5e40615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:53.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e902f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc5e414e570 0x7fc5e414a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:53.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e902f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e414d960 con 0x7fc5e40b2860 2020-05-18T21:35:53.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e902f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e4066210 con 0x7fc5e414e570 2020-05-18T21:35:53.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e902f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e414db90 con 0x7fc5e4060b90 2020-05-18T21:35:53.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e259c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc5e40b2860 0x7fc5e4144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36822/0 (socket says 172.21.15.63:36822) 2020-05-18T21:35:53.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e259c700 1 -- 172.21.15.63:0/2738325752 learned_addr learned my addr 172.21.15.63:0/2738325752 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:53.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e2d9d700 1 --2- 172.21.15.63:0/2738325752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5e4060b90 0x7fc5e40615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:53.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e359e700 1 --2- 172.21.15.63:0/2738325752 >> v2:172.21.15.155:3300/0 conn(0x7fc5e414e570 0x7fc5e414a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:53.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e1d9b700 1 -- 172.21.15.63:0/2738325752 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660839212 0 0) 0x7fc5e414d960 con 0x7fc5e40b2860 2020-05-18T21:35:53.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e1d9b700 1 -- 172.21.15.63:0/2738325752 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5c8003270 con 0x7fc5e40b2860 2020-05-18T21:35:53.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e1d9b700 1 -- 172.21.15.63:0/2738325752 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2007417422 0 0) 0x7fc5c8003270 con 0x7fc5e40b2860 2020-05-18T21:35:53.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e359e700 1 -- 172.21.15.63:0/2738325752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5e4060b90 msgr2=0x7fc5e40615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:53.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e359e700 1 --2- 172.21.15.63:0/2738325752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5e4060b90 0x7fc5e40615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:53.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e359e700 1 -- 172.21.15.63:0/2738325752 >> v1:172.21.15.63:6789/0 conn(0x7fc5e40b2860 legacy=0x7fc5e4144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:53.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e359e700 1 -- 172.21.15.63:0/2738325752 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e414de30 con 0x7fc5e414e570 2020-05-18T21:35:53.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e2d9d700 1 --2- 172.21.15.63:0/2738325752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5e4060b90 0x7fc5e40615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:35:53.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e359e700 1 --2- 172.21.15.63:0/2738325752 >> v2:172.21.15.155:3300/0 conn(0x7fc5e414e570 0x7fc5e414a390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc5d40018b0 tx=0x7fc5dc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e359e700 1 --2- 172.21.15.63:0/2738325752 >> v2:172.21.15.155:3300/0 conn(0x7fc5e414e570 0x7fc5e414a390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc5d40018b0 tx=0x7fc5dc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e359e700 1 --2- 172.21.15.63:0/2738325752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5e414e570 0x7fc5e414a390 secure :-1 s=READY pgs=1200 cs=0 l=1 rx=0x7fc5d40018b0 tx=0x7fc5dc007e00).ready entity=mon.1 client_cookie=521d8c505b591b99 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:53.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e359e700 1 --2- 172.21.15.63:0/2738325752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5e414e570 0x7fc5e414a390 secure :-1 s=THROTTLE_DONE pgs=1200 cs=0 l=1 rx=0x7fc5d40018b0 tx=0x7fc5dc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e1d9b700 1 -- 172.21.15.63:0/2738325752 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5d4001710 con 0x7fc5e414e570 2020-05-18T21:35:53.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e359e700 1 --2- 172.21.15.63:0/2738325752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5e414e570 0x7fc5e414a390 secure :-1 s=THROTTLE_DONE pgs=1200 cs=0 l=1 rx=0x7fc5d40018b0 tx=0x7fc5dc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e1d9b700 1 -- 172.21.15.63:0/2738325752 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5dc011ac0 con 0x7fc5e414e570 2020-05-18T21:35:53.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e359e700 1 --2- 172.21.15.63:0/2738325752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5e414e570 0x7fc5e414a390 secure :-1 s=THROTTLE_DONE pgs=1200 cs=0 l=1 rx=0x7fc5d40018b0 tx=0x7fc5dc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e902f700 1 -- 172.21.15.63:0/2738325752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5e414e570 msgr2=0x7fc5e414a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:53.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e1d9b700 1 -- 172.21.15.63:0/2738325752 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5dc011e20 con 0x7fc5e414e570 2020-05-18T21:35:53.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e902f700 1 --2- 172.21.15.63:0/2738325752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5e414e570 0x7fc5e414a390 secure :-1 s=READY pgs=1200 cs=0 l=1 rx=0x7fc5d40018b0 tx=0x7fc5dc007e00).stop 2020-05-18T21:35:53.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e902f700 1 -- 172.21.15.63:0/2738325752 shutdown_connections 2020-05-18T21:35:53.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e902f700 1 --2- 172.21.15.63:0/2738325752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5e414e570 0x7fc5e414a390 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:53.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e902f700 1 --2- 172.21.15.63:0/2738325752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5e4060b90 0x7fc5e40615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:53.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e902f700 1 -- 172.21.15.63:0/2738325752 >> 172.21.15.63:0/2738325752 conn(0x7fc5e40b83d0 msgr2=0x7fc5e40b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:53.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e902f700 1 -- 172.21.15.63:0/2738325752 shutdown_connections 2020-05-18T21:35:53.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.718+0000 7fc5e902f700 1 -- 172.21.15.63:0/2738325752 wait complete. 2020-05-18T21:35:53.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e902f700 1 Processor -- start 2020-05-18T21:35:53.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e902f700 1 -- start start 2020-05-18T21:35:53.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e902f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc5e40b2860 0x7fc5e4147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:53.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e902f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5e414e570 0x7fc5e41575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:53.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e902f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e40ac900 con 0x7fc5e4060b90 2020-05-18T21:35:53.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e902f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e40acba0 con 0x7fc5e40b2860 2020-05-18T21:35:53.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e902f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e415aba0 con 0x7fc5e414e570 2020-05-18T21:35:53.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e259c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc5e40b2860 0x7fc5e4147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:53.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e2d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc5e4060b90 0x7fc5e414a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36828/0 (socket says 172.21.15.63:36828) 2020-05-18T21:35:53.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e2d9d700 1 -- 172.21.15.63:0/3872467310 learned_addr learned my addr 172.21.15.63:0/3872467310 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:53.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e359e700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5e414e570 0x7fc5e41575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:53.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e259c700 1 -- 172.21.15.63:0/3872467310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5e414e570 msgr2=0x7fc5e41575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:53.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e259c700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5e414e570 0x7fc5e41575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:53.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e259c700 1 -- 172.21.15.63:0/3872467310 >> v1:172.21.15.63:6789/0 conn(0x7fc5e4060b90 legacy=0x7fc5e414a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:53.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e259c700 1 -- 172.21.15.63:0/3872467310 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e4149090 con 0x7fc5e40b2860 2020-05-18T21:35:53.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5d3fff700 1 -- 172.21.15.63:0/3872467310 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205859324 0 0) 0x7fc5e40ac900 con 0x7fc5e4060b90 2020-05-18T21:35:53.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e259c700 1 --2- 172.21.15.63:0/3872467310 >> v2:172.21.15.63:3300/0 conn(0x7fc5e40b2860 0x7fc5e4147fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc5d4001970 tx=0x7fc5d4010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e259c700 1 --2- 172.21.15.63:0/3872467310 >> v2:172.21.15.63:3300/0 conn(0x7fc5e40b2860 0x7fc5e4147fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc5d4001970 tx=0x7fc5d4010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e259c700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40b2860 0x7fc5e4147fe0 secure :-1 s=READY pgs=1808 cs=0 l=1 rx=0x7fc5d4001970 tx=0x7fc5d4010be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:53.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e259c700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40b2860 0x7fc5e4147fe0 secure :-1 s=THROTTLE_DONE pgs=1808 cs=0 l=1 rx=0x7fc5d4001970 tx=0x7fc5d4010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5d3fff700 1 -- 172.21.15.63:0/3872467310 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5d400c990 con 0x7fc5e40b2860 2020-05-18T21:35:53.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e259c700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40b2860 0x7fc5e4147fe0 secure :-1 s=THROTTLE_DONE pgs=1808 cs=0 l=1 rx=0x7fc5d4001970 tx=0x7fc5d4010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e259c700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40b2860 0x7fc5e4147fe0 secure :-1 s=THROTTLE_DONE pgs=1808 cs=0 l=1 rx=0x7fc5d4001970 tx=0x7fc5d4010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5d3fff700 1 -- 172.21.15.63:0/3872467310 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d400caf0 con 0x7fc5e40b2860 2020-05-18T21:35:53.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e902f700 1 -- 172.21.15.63:0/3872467310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e40ac4d0 con 0x7fc5e40b2860 2020-05-18T21:35:53.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5d3fff700 1 -- 172.21.15.63:0/3872467310 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5d400ce50 con 0x7fc5e40b2860 2020-05-18T21:35:53.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.722+0000 7fc5e902f700 1 -- 172.21.15.63:0/3872467310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e4157bd0 con 0x7fc5e40b2860 2020-05-18T21:35:53.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.726+0000 7fc5e259c700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40b2860 0x7fc5e4147fe0 secure :-1 s=THROTTLE_DONE pgs=1808 cs=0 l=1 rx=0x7fc5d4001970 tx=0x7fc5d4010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.726+0000 7fc5e902f700 1 -- 172.21.15.63:0/3872467310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e40569e0 con 0x7fc5e40b2860 2020-05-18T21:35:53.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.726+0000 7fc5d3fff700 1 -- 172.21.15.63:0/3872467310 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc5d4012580 con 0x7fc5e40b2860 2020-05-18T21:35:53.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.726+0000 7fc5e259c700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40b2860 0x7fc5e4147fe0 secure :-1 s=THROTTLE_DONE pgs=1808 cs=0 l=1 rx=0x7fc5d4001970 tx=0x7fc5d4010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.726+0000 7fc5d3fff700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc5c004f8c0 0x7fc5c0051d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:53.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.726+0000 7fc5d3fff700 1 -- 172.21.15.63:0/3872467310 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc5d4063b90 con 0x7fc5e40b2860 2020-05-18T21:35:53.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.726+0000 7fc5e2d9d700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc5c004f8c0 0x7fc5c0051d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:53.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.726+0000 7fc5e2d9d700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc5c004f8c0 0x7fc5c0051d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc5d8007ac0 tx=0x7fc5d8009450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.726+0000 7fc5e2d9d700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc5c004f8c0 0x7fc5c0051d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc5d8007ac0 tx=0x7fc5d8009450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.726+0000 7fc5e2d9d700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc5c004f8c0 0x7fc5c0051d80 secure :-1 s=READY pgs=704 cs=0 l=1 rx=0x7fc5d8007ac0 tx=0x7fc5d8009450).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:53.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.730+0000 7fc5e259c700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40b2860 0x7fc5e4147fe0 secure :-1 s=THROTTLE_DONE pgs=1808 cs=0 l=1 rx=0x7fc5d4001970 tx=0x7fc5d4010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.730+0000 7fc5d3fff700 1 -- 172.21.15.63:0/3872467310 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc5d403df20 con 0x7fc5e40b2860 2020-05-18T21:35:53.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.846+0000 7fc5e902f700 1 -- 172.21.15.63:0/3872467310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5e4149220 con 0x7fc5e40b2860 2020-05-18T21:35:53.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.846+0000 7fc5e259c700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40b2860 0x7fc5e4147fe0 secure :-1 s=THROTTLE_DONE pgs=1808 cs=0 l=1 rx=0x7fc5d4001970 tx=0x7fc5d4010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.846+0000 7fc5d3fff700 1 -- 172.21.15.63:0/3872467310 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+16103 (secure 0 0 0) 0x7fc5d4041540 con 0x7fc5e40b2860 2020-05-18T21:35:53.853 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:53.853 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":134,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:35:51.162837+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:35:48.494447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2020-05-18T21:35:49.149601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:35:53.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.850+0000 7fc5e902f700 1 -- 172.21.15.63:0/3872467310 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc5c004f8c0 msgr2=0x7fc5c0051d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:53.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.850+0000 7fc5e902f700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc5c004f8c0 0x7fc5c0051d80 secure :-1 s=READY pgs=704 cs=0 l=1 rx=0x7fc5d8007ac0 tx=0x7fc5d8009450).stop 2020-05-18T21:35:53.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.850+0000 7fc5e902f700 1 -- 172.21.15.63:0/3872467310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40b2860 msgr2=0x7fc5e4147fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:53.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.850+0000 7fc5e902f700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40b2860 0x7fc5e4147fe0 secure :-1 s=READY pgs=1808 cs=0 l=1 rx=0x7fc5d4001970 tx=0x7fc5d4010be0).stop 2020-05-18T21:35:53.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.850+0000 7fc5e902f700 1 -- 172.21.15.63:0/3872467310 shutdown_connections 2020-05-18T21:35:53.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.850+0000 7fc5e902f700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc5c004f8c0 0x7fc5c0051d80 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:53.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.850+0000 7fc5e902f700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5e414e570 0x7fc5e41575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:53.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.850+0000 7fc5e902f700 1 --2- 172.21.15.63:0/3872467310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40b2860 0x7fc5e4147fe0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:53.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.850+0000 7fc5e902f700 1 -- 172.21.15.63:0/3872467310 >> 172.21.15.63:0/3872467310 conn(0x7fc5e40b83d0 msgr2=0x7fc5e4146980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:53.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.850+0000 7fc5e902f700 1 -- 172.21.15.63:0/3872467310 shutdown_connections 2020-05-18T21:35:53.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.850+0000 7fc5e902f700 1 -- 172.21.15.63:0/3872467310 wait complete. 2020-05-18T21:35:53.866 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:35:48.494447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '133', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:35:49.149601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '134', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:35:53.868 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:35:53.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.974+0000 7fccb9ace700 1 Processor -- start 2020-05-18T21:35:53.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.974+0000 7fccb9ace700 1 -- start start 2020-05-18T21:35:53.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.974+0000 7fccb9ace700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fccb40b5930 0x7fccb412b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:53.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.974+0000 7fccb9ace700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb412bd60 0x7fccb40b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:53.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.974+0000 7fccb9ace700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb412c1f0 con 0x7fccb40b4f60 2020-05-18T21:35:53.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.974+0000 7fccb9ace700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb4149630 con 0x7fccb40b5930 2020-05-18T21:35:53.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.974+0000 7fccb9ace700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb4145e60 con 0x7fccb412bd60 2020-05-18T21:35:53.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.974+0000 7fccb3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fccb40b5930 0x7fccb412b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:53.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.974+0000 7fccb3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fccb40b5930 0x7fccb412b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:49498/0 (socket says 172.21.15.63:49498) 2020-05-18T21:35:53.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.974+0000 7fccb92cd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb412bd60 0x7fccb40b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:53.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.974+0000 7fccb3fff700 1 -- 172.21.15.63:0/2023818573 learned_addr learned my addr 172.21.15.63:0/2023818573 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:53.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.974+0000 7fccb8acc700 1 --1- 172.21.15.63:0/2023818573 >> v1:172.21.15.155:6789/0 conn(0x7fccb40b4f60 0x7fccb41465a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:35152/0 (socket says 172.21.15.63:35152) 2020-05-18T21:35:53.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.974+0000 7fccb92cd700 1 -- 172.21.15.63:0/2023818573 >> v2:172.21.15.155:3300/0 conn(0x7fccb40b5930 msgr2=0x7fccb412b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:53.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.974+0000 7fccb92cd700 1 --2- 172.21.15.63:0/2023818573 >> v2:172.21.15.155:3300/0 conn(0x7fccb40b5930 0x7fccb412b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:53.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.974+0000 7fccb92cd700 1 -- 172.21.15.63:0/2023818573 >> v1:172.21.15.155:6789/0 conn(0x7fccb40b4f60 legacy=0x7fccb41465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:53.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.974+0000 7fccb92cd700 1 -- 172.21.15.63:0/2023818573 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb4146100 con 0x7fccb412bd60 2020-05-18T21:35:53.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.974+0000 7fccb3fff700 1 --2- 172.21.15.63:0/2023818573 >> v2:172.21.15.155:3300/0 conn(0x7fccb40b5930 0x7fccb412b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:35:53.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.974+0000 7fccb92cd700 1 --2- 172.21.15.63:0/2023818573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb412bd60 0x7fccb40b2890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fccac0032f0 tx=0x7fccac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.978+0000 7fccb92cd700 1 --2- 172.21.15.63:0/2023818573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb412bd60 0x7fccb40b2890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fccac0032f0 tx=0x7fccac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.978+0000 7fccb92cd700 1 --2- 172.21.15.63:0/2023818573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb412bd60 0x7fccb40b2890 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7fccac0032f0 tx=0x7fccac007e00).ready entity=mon.2 client_cookie=9b2e2ac57b3dd84f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:53.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.978+0000 7fccb92cd700 1 --2- 172.21.15.63:0/2023818573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb412bd60 0x7fccb40b2890 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fccac0032f0 tx=0x7fccac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.978+0000 7fccb37fe700 1 -- 172.21.15.63:0/2023818573 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccac011e60 con 0x7fccb412bd60 2020-05-18T21:35:53.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.978+0000 7fccb92cd700 1 --2- 172.21.15.63:0/2023818573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb412bd60 0x7fccb40b2890 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fccac0032f0 tx=0x7fccac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.978+0000 7fccb92cd700 1 --2- 172.21.15.63:0/2023818573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb412bd60 0x7fccb40b2890 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fccac0032f0 tx=0x7fccac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.978+0000 7fccb37fe700 1 -- 172.21.15.63:0/2023818573 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccac00a180 con 0x7fccb412bd60 2020-05-18T21:35:53.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.978+0000 7fccb37fe700 1 -- 172.21.15.63:0/2023818573 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccac00a560 con 0x7fccb412bd60 2020-05-18T21:35:53.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.978+0000 7fccb9ace700 1 -- 172.21.15.63:0/2023818573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb412bd60 msgr2=0x7fccb40b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:53.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.978+0000 7fccb9ace700 1 --2- 172.21.15.63:0/2023818573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb412bd60 0x7fccb40b2890 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7fccac0032f0 tx=0x7fccac007e00).stop 2020-05-18T21:35:53.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.978+0000 7fccb9ace700 1 -- 172.21.15.63:0/2023818573 shutdown_connections 2020-05-18T21:35:53.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.978+0000 7fccb9ace700 1 --2- 172.21.15.63:0/2023818573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb412bd60 0x7fccb40b2890 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:53.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.978+0000 7fccb9ace700 1 --2- 172.21.15.63:0/2023818573 >> v2:172.21.15.155:3300/0 conn(0x7fccb40b5930 0x7fccb412b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:53.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.978+0000 7fccb9ace700 1 -- 172.21.15.63:0/2023818573 >> 172.21.15.63:0/2023818573 conn(0x7fccb405fbd0 msgr2=0x7fccb4069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:53.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.978+0000 7fccb9ace700 1 -- 172.21.15.63:0/2023818573 shutdown_connections 2020-05-18T21:35:53.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.978+0000 7fccb9ace700 1 -- 172.21.15.63:0/2023818573 wait complete. 2020-05-18T21:35:53.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.978+0000 7fccb9ace700 1 Processor -- start 2020-05-18T21:35:53.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.978+0000 7fccb9ace700 1 -- start start 2020-05-18T21:35:53.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.982+0000 7fccb9ace700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fccb40b4f60 0x7fccb4153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:53.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.982+0000 7fccb9ace700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb412bd60 0x7fccb40adee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:53.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.982+0000 7fccb9ace700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb40ae510 con 0x7fccb40b5930 2020-05-18T21:35:53.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.982+0000 7fccb9ace700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb40ae7b0 con 0x7fccb40b4f60 2020-05-18T21:35:53.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.982+0000 7fccb9ace700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb40aea50 con 0x7fccb412bd60 2020-05-18T21:35:53.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.982+0000 7fccb3fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fccb40b5930 0x7fccb40b2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:35160/0 (socket says 172.21.15.63:35160) 2020-05-18T21:35:53.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.982+0000 7fccb92cd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb412bd60 0x7fccb40adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:53.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.982+0000 7fccb8acc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fccb40b4f60 0x7fccb4153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:53.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.982+0000 7fccb3fff700 1 -- 172.21.15.63:0/2351739529 learned_addr learned my addr 172.21.15.63:0/2351739529 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:53.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.982+0000 7fccb8acc700 1 -- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb412bd60 msgr2=0x7fccb40adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:53.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.982+0000 7fccb8acc700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb412bd60 0x7fccb40adee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:53.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.982+0000 7fccb8acc700 1 -- 172.21.15.63:0/2351739529 >> v1:172.21.15.155:6789/0 conn(0x7fccb40b5930 legacy=0x7fccb40b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:53.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.982+0000 7fccb8acc700 1 -- 172.21.15.63:0/2351739529 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb41137f0 con 0x7fccb40b4f60 2020-05-18T21:35:53.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.982+0000 7fccb92cd700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb412bd60 0x7fccb40adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:35:53.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.982+0000 7fccb8acc700 1 --2- 172.21.15.63:0/2351739529 >> v2:172.21.15.155:3300/0 conn(0x7fccb40b4f60 0x7fccb4153300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fccb4060430 tx=0x7fcca80108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.982+0000 7fccb8acc700 1 --2- 172.21.15.63:0/2351739529 >> v2:172.21.15.155:3300/0 conn(0x7fccb40b4f60 0x7fccb4153300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fccb4060430 tx=0x7fcca80108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.982+0000 7fccb8acc700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb40b4f60 0x7fccb4153300 secure :-1 s=READY pgs=1203 cs=0 l=1 rx=0x7fccb4060430 tx=0x7fcca80108b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:53.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.986+0000 7fccb8acc700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb40b4f60 0x7fccb4153300 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7fccb4060430 tx=0x7fcca80108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.986+0000 7fccb8acc700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb40b4f60 0x7fccb4153300 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7fccb4060430 tx=0x7fcca80108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.986+0000 7fccb1ffb700 1 -- 172.21.15.63:0/2351739529 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcca80116e0 con 0x7fccb40b4f60 2020-05-18T21:35:53.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.986+0000 7fccb8acc700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb40b4f60 0x7fccb4153300 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7fccb4060430 tx=0x7fcca80108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:53.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.986+0000 7fccb1ffb700 1 -- 172.21.15.63:0/2351739529 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca8011840 con 0x7fccb40b4f60 2020-05-18T21:35:53.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.986+0000 7fccb9ace700 1 -- 172.21.15.63:0/2351739529 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb40b2c10 con 0x7fccb40b4f60 2020-05-18T21:35:53.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.986+0000 7fccb1ffb700 1 -- 172.21.15.63:0/2351739529 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcca8011c60 con 0x7fccb40b4f60 2020-05-18T21:35:53.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.986+0000 7fccb9ace700 1 -- 172.21.15.63:0/2351739529 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb4153e30 con 0x7fccb40b4f60 2020-05-18T21:35:53.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.990+0000 7fccb8acc700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb40b4f60 0x7fccb4153300 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7fccb4060430 tx=0x7fcca80108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.990+0000 7fccb1ffb700 1 -- 172.21.15.63:0/2351739529 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fcca800b370 con 0x7fccb40b4f60 2020-05-18T21:35:54.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.990+0000 7fccb8acc700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb40b4f60 0x7fccb4153300 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7fccb4060430 tx=0x7fcca80108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.990+0000 7fccb9ace700 1 -- 172.21.15.63:0/2351739529 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb40ae340 con 0x7fccb40b4f60 2020-05-18T21:35:54.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.990+0000 7fccb1ffb700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc9404fa10 0x7fcc94051ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:54.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.990+0000 7fccb1ffb700 1 -- 172.21.15.63:0/2351739529 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcca8063c70 con 0x7fccb40b4f60 2020-05-18T21:35:54.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.990+0000 7fccb3fff700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc9404fa10 0x7fcc94051ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:54.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.990+0000 7fccb3fff700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc9404fa10 0x7fcc94051ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fccb406a850 tx=0x7fcca40093d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.990+0000 7fccb3fff700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc9404fa10 0x7fcc94051ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fccb406a850 tx=0x7fcca40093d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.990+0000 7fccb3fff700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc9404fa10 0x7fcc94051ed0 secure :-1 s=READY pgs=705 cs=0 l=1 rx=0x7fccb406a850 tx=0x7fcca40093d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:54.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.998+0000 7fccb8acc700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb40b4f60 0x7fccb4153300 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7fccb4060430 tx=0x7fcca80108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:53.998+0000 7fccb1ffb700 1 -- 172.21.15.63:0/2351739529 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fcca803e000 con 0x7fccb40b4f60 2020-05-18T21:35:54.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.114+0000 7fccb9ace700 1 -- 172.21.15.63:0/2351739529 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fccb40569e0 con 0x7fccb40b4f60 2020-05-18T21:35:54.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.114+0000 7fccb8acc700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb40b4f60 0x7fccb4153300 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7fccb4060430 tx=0x7fcca80108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.114+0000 7fccb1ffb700 1 -- 172.21.15.63:0/2351739529 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v134) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcca8041620 con 0x7fccb40b4f60 2020-05-18T21:35:54.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.118+0000 7fccb9ace700 1 -- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc9404fa10 msgr2=0x7fcc94051ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.118+0000 7fccb9ace700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc9404fa10 0x7fcc94051ed0 secure :-1 s=READY pgs=705 cs=0 l=1 rx=0x7fccb406a850 tx=0x7fcca40093d0).stop 2020-05-18T21:35:54.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.118+0000 7fccb9ace700 1 -- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb40b4f60 msgr2=0x7fccb4153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.118+0000 7fccb9ace700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb40b4f60 0x7fccb4153300 secure :-1 s=READY pgs=1203 cs=0 l=1 rx=0x7fccb4060430 tx=0x7fcca80108b0).stop 2020-05-18T21:35:54.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.118+0000 7fccb9ace700 1 -- 172.21.15.63:0/2351739529 shutdown_connections 2020-05-18T21:35:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.118+0000 7fccb9ace700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc9404fa10 0x7fcc94051ed0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.118+0000 7fccb9ace700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb412bd60 0x7fccb40adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.118+0000 7fccb9ace700 1 --2- 172.21.15.63:0/2351739529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb40b4f60 0x7fccb4153300 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.118+0000 7fccb9ace700 1 -- 172.21.15.63:0/2351739529 >> 172.21.15.63:0/2351739529 conn(0x7fccb405fbd0 msgr2=0x7fccb4148f10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.118+0000 7fccb9ace700 1 -- 172.21.15.63:0/2351739529 shutdown_connections 2020-05-18T21:35:54.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.118+0000 7fccb9ace700 1 -- 172.21.15.63:0/2351739529 wait complete. 2020-05-18T21:35:54.130 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:35:54.138 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:35:54.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.242+0000 7f6436c58700 1 Processor -- start 2020-05-18T21:35:54.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436c58700 1 -- start start 2020-05-18T21:35:54.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436c58700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f643005f410 0x7f6430062800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:54.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436c58700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6430143890 0x7f64300b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:54.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436c58700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643009dd80 con 0x7f643005bc50 2020-05-18T21:35:54.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436c58700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64300b6d20 con 0x7f6430143890 2020-05-18T21:35:54.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436c58700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6430062d80 con 0x7f643005f410 2020-05-18T21:35:54.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436457700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6430143890 0x7f64300b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:54.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6435c56700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f643005f410 0x7f6430062800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:54.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436457700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6430143890 0x7f64300b68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:49510/0 (socket says 172.21.15.63:49510) 2020-05-18T21:35:54.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436457700 1 -- 172.21.15.63:0/38632365 learned_addr learned my addr 172.21.15.63:0/38632365 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:54.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436457700 1 -- 172.21.15.63:0/38632365 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f643005f410 msgr2=0x7f6430062800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:54.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436457700 1 --2- 172.21.15.63:0/38632365 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f643005f410 0x7f6430062800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:54.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436457700 1 -- 172.21.15.63:0/38632365 >> v1:172.21.15.155:6789/0 conn(0x7f643005bc50 legacy=0x7f6430143180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436457700 1 -- 172.21.15.63:0/38632365 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64300b6180 con 0x7f6430143890 2020-05-18T21:35:54.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436457700 1 --2- 172.21.15.63:0/38632365 >> v2:172.21.15.155:3300/0 conn(0x7f6430143890 0x7f64300b68c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f64280032f0 tx=0x7f6428007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436457700 1 --2- 172.21.15.63:0/38632365 >> v2:172.21.15.155:3300/0 conn(0x7f6430143890 0x7f64300b68c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f64280032f0 tx=0x7f6428007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436457700 1 --2- 172.21.15.63:0/38632365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6430143890 0x7f64300b68c0 secure :-1 s=READY pgs=1205 cs=0 l=1 rx=0x7f64280032f0 tx=0x7f6428007e00).ready entity=mon.1 client_cookie=66048e03d1fe8866 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:54.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436457700 1 --2- 172.21.15.63:0/38632365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6430143890 0x7f64300b68c0 secure :-1 s=THROTTLE_DONE pgs=1205 cs=0 l=1 rx=0x7f64280032f0 tx=0x7f6428007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6434c54700 1 -- 172.21.15.63:0/38632365 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64280110d0 con 0x7f6430143890 2020-05-18T21:35:54.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436457700 1 --2- 172.21.15.63:0/38632365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6430143890 0x7f64300b68c0 secure :-1 s=THROTTLE_DONE pgs=1205 cs=0 l=1 rx=0x7f64280032f0 tx=0x7f6428007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436457700 1 --2- 172.21.15.63:0/38632365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6430143890 0x7f64300b68c0 secure :-1 s=THROTTLE_DONE pgs=1205 cs=0 l=1 rx=0x7f64280032f0 tx=0x7f6428007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6434c54700 1 -- 172.21.15.63:0/38632365 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6428011230 con 0x7f6430143890 2020-05-18T21:35:54.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6434c54700 1 -- 172.21.15.63:0/38632365 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6428011610 con 0x7f6430143890 2020-05-18T21:35:54.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436c58700 1 -- 172.21.15.63:0/38632365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6430143890 msgr2=0x7f64300b68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.246+0000 7f6436c58700 1 --2- 172.21.15.63:0/38632365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6430143890 0x7f64300b68c0 secure :-1 s=READY pgs=1205 cs=0 l=1 rx=0x7f64280032f0 tx=0x7f6428007e00).stop 2020-05-18T21:35:54.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6436c58700 1 -- 172.21.15.63:0/38632365 shutdown_connections 2020-05-18T21:35:54.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6436c58700 1 --2- 172.21.15.63:0/38632365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6430143890 0x7f64300b68c0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:54.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6436c58700 1 --2- 172.21.15.63:0/38632365 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f643005f410 0x7f6430062800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:54.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6436c58700 1 -- 172.21.15.63:0/38632365 >> 172.21.15.63:0/38632365 conn(0x7f643006a600 msgr2=0x7f64300b6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:54.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6436c58700 1 -- 172.21.15.63:0/38632365 shutdown_connections 2020-05-18T21:35:54.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6436c58700 1 -- 172.21.15.63:0/38632365 wait complete. 2020-05-18T21:35:54.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6436c58700 1 Processor -- start 2020-05-18T21:35:54.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6436c58700 1 -- start start 2020-05-18T21:35:54.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6436c58700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f643005bc50 0x7f6430061fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:54.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6436c58700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f643005f410 0x7f64300b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:54.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6436c58700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64300b4040 con 0x7f6430143890 2020-05-18T21:35:54.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6436c58700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643013f980 con 0x7f643005bc50 2020-05-18T21:35:54.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6436c58700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643013fc20 con 0x7f643005f410 2020-05-18T21:35:54.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6435c56700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f643005bc50 0x7f6430061fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:54.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6436457700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6430143890 0x7f643013ac20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36860/0 (socket says 172.21.15.63:36860) 2020-05-18T21:35:54.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6435c56700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f643005bc50 0x7f6430061fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34668/0 (socket says 172.21.15.63:34668) 2020-05-18T21:35:54.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6436457700 1 -- 172.21.15.63:0/1810288642 learned_addr learned my addr 172.21.15.63:0/1810288642 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:54.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6435455700 1 --2- 172.21.15.63:0/1810288642 >> v2:172.21.15.155:3300/0 conn(0x7f643005f410 0x7f64300b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:54.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6435c56700 1 -- 172.21.15.63:0/1810288642 >> v2:172.21.15.155:3300/0 conn(0x7f643005f410 msgr2=0x7f64300b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6435c56700 1 --2- 172.21.15.63:0/1810288642 >> v2:172.21.15.155:3300/0 conn(0x7f643005f410 0x7f64300b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:54.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6435c56700 1 -- 172.21.15.63:0/1810288642 >> v1:172.21.15.63:6789/0 conn(0x7f6430143890 legacy=0x7f643013ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6422ffd700 1 -- 172.21.15.63:0/1810288642 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140600625 0 0) 0x7f64300b4040 con 0x7f6430143890 2020-05-18T21:35:54.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6435c56700 1 -- 172.21.15.63:0/1810288642 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643013fec0 con 0x7f643005bc50 2020-05-18T21:35:54.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6435c56700 1 --2- 172.21.15.63:0/1810288642 >> v2:172.21.15.63:3300/0 conn(0x7f643005bc50 0x7f6430061fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f642c002f70 tx=0x7f642c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6435c56700 1 --2- 172.21.15.63:0/1810288642 >> v2:172.21.15.63:3300/0 conn(0x7f643005bc50 0x7f6430061fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f642c002f70 tx=0x7f642c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6435c56700 1 --2- 172.21.15.63:0/1810288642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f643005bc50 0x7f6430061fd0 secure :-1 s=READY pgs=1810 cs=0 l=1 rx=0x7f642c002f70 tx=0x7f642c010bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:54.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6435c56700 1 --2- 172.21.15.63:0/1810288642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f643005bc50 0x7f6430061fd0 secure :-1 s=THROTTLE_DONE pgs=1810 cs=0 l=1 rx=0x7f642c002f70 tx=0x7f642c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6435c56700 1 --2- 172.21.15.63:0/1810288642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f643005bc50 0x7f6430061fd0 secure :-1 s=THROTTLE_DONE pgs=1810 cs=0 l=1 rx=0x7f642c002f70 tx=0x7f642c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6422ffd700 1 -- 172.21.15.63:0/1810288642 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f642c0128f0 con 0x7f643005bc50 2020-05-18T21:35:54.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6435c56700 1 --2- 172.21.15.63:0/1810288642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f643005bc50 0x7f6430061fd0 secure :-1 s=THROTTLE_DONE pgs=1810 cs=0 l=1 rx=0x7f642c002f70 tx=0x7f642c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6422ffd700 1 -- 172.21.15.63:0/1810288642 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c012a50 con 0x7f643005bc50 2020-05-18T21:35:54.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6436c58700 1 -- 172.21.15.63:0/1810288642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643013b330 con 0x7f643005bc50 2020-05-18T21:35:54.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6422ffd700 1 -- 172.21.15.63:0/1810288642 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f642c012db0 con 0x7f643005bc50 2020-05-18T21:35:54.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.250+0000 7f6436c58700 1 -- 172.21.15.63:0/1810288642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643013f410 con 0x7f643005bc50 2020-05-18T21:35:54.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.254+0000 7f6435c56700 1 --2- 172.21.15.63:0/1810288642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f643005bc50 0x7f6430061fd0 secure :-1 s=THROTTLE_DONE pgs=1810 cs=0 l=1 rx=0x7f642c002f70 tx=0x7f642c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.254+0000 7f6436c58700 1 -- 172.21.15.63:0/1810288642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64300569e0 con 0x7f643005bc50 2020-05-18T21:35:54.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.254+0000 7f6422ffd700 1 -- 172.21.15.63:0/1810288642 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f642c007190 con 0x7f643005bc50 2020-05-18T21:35:54.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.254+0000 7f6435c56700 1 --2- 172.21.15.63:0/1810288642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f643005bc50 0x7f6430061fd0 secure :-1 s=THROTTLE_DONE pgs=1810 cs=0 l=1 rx=0x7f642c002f70 tx=0x7f642c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.254+0000 7f6422ffd700 1 --2- 172.21.15.63:0/1810288642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f641004f8b0 0x7f6410051d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:54.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.254+0000 7f6422ffd700 1 -- 172.21.15.63:0/1810288642 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f642c063dc0 con 0x7f643005bc50 2020-05-18T21:35:54.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.254+0000 7f6435455700 1 --2- 172.21.15.63:0/1810288642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f641004f8b0 0x7f6410051d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:54.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.254+0000 7f6435455700 1 --2- 172.21.15.63:0/1810288642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f641004f8b0 0x7f6410051d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f64300b5f30 tx=0x7f6424001450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.254+0000 7f6435455700 1 --2- 172.21.15.63:0/1810288642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f641004f8b0 0x7f6410051d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f64300b5f30 tx=0x7f6424001450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.254+0000 7f6435455700 1 --2- 172.21.15.63:0/1810288642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f641004f8b0 0x7f6410051d70 secure :-1 s=READY pgs=706 cs=0 l=1 rx=0x7f64300b5f30 tx=0x7f6424001450).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:54.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.258+0000 7f6435c56700 1 --2- 172.21.15.63:0/1810288642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f643005bc50 0x7f6430061fd0 secure :-1 s=THROTTLE_DONE pgs=1810 cs=0 l=1 rx=0x7f642c002f70 tx=0x7f642c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.258+0000 7f6422ffd700 1 -- 172.21.15.63:0/1810288642 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f642c03e0f0 con 0x7f643005bc50 2020-05-18T21:35:54.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.374+0000 7f6436c58700 1 -- 172.21.15.63:0/1810288642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f64300b8b40 con 0x7f643005bc50 2020-05-18T21:35:54.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.374+0000 7f6435c56700 1 --2- 172.21.15.63:0/1810288642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f643005bc50 0x7f6430061fd0 secure :-1 s=THROTTLE_DONE pgs=1810 cs=0 l=1 rx=0x7f642c002f70 tx=0x7f642c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.374+0000 7f6422ffd700 1 -- 172.21.15.63:0/1810288642 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v134) v1 ==== 92+0+10 (secure 0 0 0) 0x7f642c041710 con 0x7f643005bc50 2020-05-18T21:35:54.381 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:35:54.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.378+0000 7f6436c58700 1 -- 172.21.15.63:0/1810288642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f641004f8b0 msgr2=0x7f6410051d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.378+0000 7f6436c58700 1 --2- 172.21.15.63:0/1810288642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f641004f8b0 0x7f6410051d70 secure :-1 s=READY pgs=706 cs=0 l=1 rx=0x7f64300b5f30 tx=0x7f6424001450).stop 2020-05-18T21:35:54.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.378+0000 7f6436c58700 1 -- 172.21.15.63:0/1810288642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f643005bc50 msgr2=0x7f6430061fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.378+0000 7f6436c58700 1 --2- 172.21.15.63:0/1810288642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f643005bc50 0x7f6430061fd0 secure :-1 s=READY pgs=1810 cs=0 l=1 rx=0x7f642c002f70 tx=0x7f642c010bd0).stop 2020-05-18T21:35:54.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.378+0000 7f6436c58700 1 -- 172.21.15.63:0/1810288642 shutdown_connections 2020-05-18T21:35:54.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.378+0000 7f6436c58700 1 --2- 172.21.15.63:0/1810288642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f641004f8b0 0x7f6410051d70 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:54.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.378+0000 7f6436c58700 1 --2- 172.21.15.63:0/1810288642 >> v2:172.21.15.155:3300/0 conn(0x7f643005f410 0x7f64300b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:54.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.378+0000 7f6436c58700 1 --2- 172.21.15.63:0/1810288642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f643005bc50 0x7f6430061fd0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:54.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.378+0000 7f6436c58700 1 -- 172.21.15.63:0/1810288642 >> 172.21.15.63:0/1810288642 conn(0x7f643006a600 msgr2=0x7f6430147140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:54.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.378+0000 7f6436c58700 1 -- 172.21.15.63:0/1810288642 shutdown_connections 2020-05-18T21:35:54.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.378+0000 7f6436c58700 1 -- 172.21.15.63:0/1810288642 wait complete. 2020-05-18T21:35:54.393 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:35:54.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.498+0000 7fdacc9ca700 1 Processor -- start 2020-05-18T21:35:54.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.498+0000 7fdacc9ca700 1 -- start start 2020-05-18T21:35:54.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdacc9ca700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdac80b4f40 0x7fdac8061180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:54.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdacc9ca700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdac806a2c0 0x7fdac8132360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:54.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdacc9ca700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac8132c70 con 0x7fdac81327c0 2020-05-18T21:35:54.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdacc9ca700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac806a7d0 con 0x7fdac806a2c0 2020-05-18T21:35:54.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdacc9ca700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac80b2a10 con 0x7fdac80b4f40 2020-05-18T21:35:54.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdac6ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdac806a2c0 0x7fdac8132360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:54.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdac7fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdac81327c0 0x7fdac814d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36866/0 (socket says 172.21.15.63:36866) 2020-05-18T21:35:54.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdac7fff700 1 -- 172.21.15.63:0/3967927906 learned_addr learned my addr 172.21.15.63:0/3967927906 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:54.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdac77fe700 1 --2- 172.21.15.63:0/3967927906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdac80b4f40 0x7fdac8061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:54.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdac6ffd700 1 -- 172.21.15.63:0/3967927906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdac80b4f40 msgr2=0x7fdac8061180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:54.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdac6ffd700 1 --2- 172.21.15.63:0/3967927906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdac80b4f40 0x7fdac8061180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:54.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdac67fc700 1 -- 172.21.15.63:0/3967927906 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899766529 0 0) 0x7fdac8132c70 con 0x7fdac81327c0 2020-05-18T21:35:54.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdac6ffd700 1 -- 172.21.15.63:0/3967927906 >> v1:172.21.15.63:6789/0 conn(0x7fdac81327c0 legacy=0x7fdac814d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdac6ffd700 1 -- 172.21.15.63:0/3967927906 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac80b5320 con 0x7fdac806a2c0 2020-05-18T21:35:54.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdac6ffd700 1 --2- 172.21.15.63:0/3967927906 >> v2:172.21.15.63:3300/0 conn(0x7fdac806a2c0 0x7fdac8132360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdab80032f0 tx=0x7fdab8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdac6ffd700 1 --2- 172.21.15.63:0/3967927906 >> v2:172.21.15.63:3300/0 conn(0x7fdac806a2c0 0x7fdac8132360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdab80032f0 tx=0x7fdab8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdac6ffd700 1 --2- 172.21.15.63:0/3967927906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdac806a2c0 0x7fdac8132360 secure :-1 s=READY pgs=1812 cs=0 l=1 rx=0x7fdab80032f0 tx=0x7fdab8007e00).ready entity=mon.0 client_cookie=104ab5c1709ae0cc server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:54.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdac6ffd700 1 --2- 172.21.15.63:0/3967927906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdac806a2c0 0x7fdac8132360 secure :-1 s=THROTTLE_DONE pgs=1812 cs=0 l=1 rx=0x7fdab80032f0 tx=0x7fdab8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdac67fc700 1 -- 172.21.15.63:0/3967927906 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdab8011e60 con 0x7fdac806a2c0 2020-05-18T21:35:54.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdac6ffd700 1 --2- 172.21.15.63:0/3967927906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdac806a2c0 0x7fdac8132360 secure :-1 s=THROTTLE_DONE pgs=1812 cs=0 l=1 rx=0x7fdab80032f0 tx=0x7fdab8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdac67fc700 1 -- 172.21.15.63:0/3967927906 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab800a180 con 0x7fdac806a2c0 2020-05-18T21:35:54.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdac6ffd700 1 --2- 172.21.15.63:0/3967927906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdac806a2c0 0x7fdac8132360 secure :-1 s=THROTTLE_DONE pgs=1812 cs=0 l=1 rx=0x7fdab80032f0 tx=0x7fdab8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdac67fc700 1 -- 172.21.15.63:0/3967927906 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdab800a520 con 0x7fdac806a2c0 2020-05-18T21:35:54.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdacc9ca700 1 -- 172.21.15.63:0/3967927906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdac806a2c0 msgr2=0x7fdac8132360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdacc9ca700 1 --2- 172.21.15.63:0/3967927906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdac806a2c0 0x7fdac8132360 secure :-1 s=READY pgs=1812 cs=0 l=1 rx=0x7fdab80032f0 tx=0x7fdab8007e00).stop 2020-05-18T21:35:54.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdacc9ca700 1 -- 172.21.15.63:0/3967927906 shutdown_connections 2020-05-18T21:35:54.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdacc9ca700 1 --2- 172.21.15.63:0/3967927906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdac806a2c0 0x7fdac8132360 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:54.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdacc9ca700 1 --2- 172.21.15.63:0/3967927906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdac80b4f40 0x7fdac8061180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:54.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdacc9ca700 1 -- 172.21.15.63:0/3967927906 >> 172.21.15.63:0/3967927906 conn(0x7fdac805fbd0 msgr2=0x7fdac8069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:54.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdacc9ca700 1 -- 172.21.15.63:0/3967927906 shutdown_connections 2020-05-18T21:35:54.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.502+0000 7fdacc9ca700 1 -- 172.21.15.63:0/3967927906 wait complete. 2020-05-18T21:35:54.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdacc9ca700 1 Processor -- start 2020-05-18T21:35:54.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdacc9ca700 1 -- start start 2020-05-18T21:35:54.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdacc9ca700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdac806a2c0 0x7fdac80ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:54.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdacc9ca700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdac80b4f40 0x7fdac80ae740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:54.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdacc9ca700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac80ad290 con 0x7fdac81327c0 2020-05-18T21:35:54.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdacc9ca700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac814e080 con 0x7fdac806a2c0 2020-05-18T21:35:54.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdacc9ca700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac80af0c0 con 0x7fdac80b4f40 2020-05-18T21:35:54.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdac77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdac806a2c0 0x7fdac80ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:54.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdac77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdac806a2c0 0x7fdac80ace30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34682/0 (socket says 172.21.15.63:34682) 2020-05-18T21:35:54.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdac77fe700 1 -- 172.21.15.63:0/3945726828 learned_addr learned my addr 172.21.15.63:0/3945726828 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:54.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdac6ffd700 1 --2- 172.21.15.63:0/3945726828 >> v2:172.21.15.155:3300/0 conn(0x7fdac80b4f40 0x7fdac80ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:54.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdac77fe700 1 -- 172.21.15.63:0/3945726828 >> v2:172.21.15.155:3300/0 conn(0x7fdac80b4f40 msgr2=0x7fdac80ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdac77fe700 1 --2- 172.21.15.63:0/3945726828 >> v2:172.21.15.155:3300/0 conn(0x7fdac80b4f40 0x7fdac80ae740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:54.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdac77fe700 1 -- 172.21.15.63:0/3945726828 >> v1:172.21.15.155:6789/0 conn(0x7fdac81327c0 legacy=0x7fdac8157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdac77fe700 1 -- 172.21.15.63:0/3945726828 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac80af360 con 0x7fdac806a2c0 2020-05-18T21:35:54.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdac6ffd700 1 --2- 172.21.15.63:0/3945726828 >> v2:172.21.15.155:3300/0 conn(0x7fdac80b4f40 0x7fdac80ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:35:54.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdac77fe700 1 --2- 172.21.15.63:0/3945726828 >> v2:172.21.15.63:3300/0 conn(0x7fdac806a2c0 0x7fdac80ace30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdac814bb20 tx=0x7fdabc010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdac77fe700 1 --2- 172.21.15.63:0/3945726828 >> v2:172.21.15.63:3300/0 conn(0x7fdac806a2c0 0x7fdac80ace30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdac814bb20 tx=0x7fdabc010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdac77fe700 1 --2- 172.21.15.63:0/3945726828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdac806a2c0 0x7fdac80ace30 secure :-1 s=READY pgs=1813 cs=0 l=1 rx=0x7fdac814bb20 tx=0x7fdabc010d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:54.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdac77fe700 1 --2- 172.21.15.63:0/3945726828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdac806a2c0 0x7fdac80ace30 secure :-1 s=THROTTLE_DONE pgs=1813 cs=0 l=1 rx=0x7fdac814bb20 tx=0x7fdabc010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdac77fe700 1 --2- 172.21.15.63:0/3945726828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdac806a2c0 0x7fdac80ace30 secure :-1 s=THROTTLE_DONE pgs=1813 cs=0 l=1 rx=0x7fdac814bb20 tx=0x7fdabc010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdac4ff9700 1 -- 172.21.15.63:0/3945726828 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdabc007180 con 0x7fdac806a2c0 2020-05-18T21:35:54.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdac77fe700 1 --2- 172.21.15.63:0/3945726828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdac806a2c0 0x7fdac80ace30 secure :-1 s=THROTTLE_DONE pgs=1813 cs=0 l=1 rx=0x7fdac814bb20 tx=0x7fdabc010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdac4ff9700 1 -- 172.21.15.63:0/3945726828 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc0072e0 con 0x7fdac806a2c0 2020-05-18T21:35:54.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdacc9ca700 1 -- 172.21.15.63:0/3945726828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac8157700 con 0x7fdac806a2c0 2020-05-18T21:35:54.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdac4ff9700 1 -- 172.21.15.63:0/3945726828 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdabc0123a0 con 0x7fdac806a2c0 2020-05-18T21:35:54.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.506+0000 7fdacc9ca700 1 -- 172.21.15.63:0/3945726828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac8158530 con 0x7fdac806a2c0 2020-05-18T21:35:54.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.510+0000 7fdac77fe700 1 --2- 172.21.15.63:0/3945726828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdac806a2c0 0x7fdac80ace30 secure :-1 s=THROTTLE_DONE pgs=1813 cs=0 l=1 rx=0x7fdac814bb20 tx=0x7fdabc010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.510+0000 7fdacc9ca700 1 -- 172.21.15.63:0/3945726828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac80af800 con 0x7fdac806a2c0 2020-05-18T21:35:54.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.510+0000 7fdac4ff9700 1 -- 172.21.15.63:0/3945726828 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fdabc012610 con 0x7fdac806a2c0 2020-05-18T21:35:54.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.510+0000 7fdac77fe700 1 --2- 172.21.15.63:0/3945726828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdac806a2c0 0x7fdac80ace30 secure :-1 s=THROTTLE_DONE pgs=1813 cs=0 l=1 rx=0x7fdac814bb20 tx=0x7fdabc010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.510+0000 7fdac4ff9700 1 --2- 172.21.15.63:0/3945726828 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdaa804fac0 0x7fdaa8051f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:54.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.510+0000 7fdac4ff9700 1 -- 172.21.15.63:0/3945726828 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdabc064460 con 0x7fdac806a2c0 2020-05-18T21:35:54.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.510+0000 7fdac6ffd700 1 --2- 172.21.15.63:0/3945726828 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdaa804fac0 0x7fdaa8051f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:54.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.510+0000 7fdac6ffd700 1 --2- 172.21.15.63:0/3945726828 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdaa804fac0 0x7fdaa8051f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdab80032f0 tx=0x7fdab8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.510+0000 7fdac6ffd700 1 --2- 172.21.15.63:0/3945726828 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdaa804fac0 0x7fdaa8051f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdab80032f0 tx=0x7fdab8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.510+0000 7fdac6ffd700 1 --2- 172.21.15.63:0/3945726828 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdaa804fac0 0x7fdaa8051f80 secure :-1 s=READY pgs=707 cs=0 l=1 rx=0x7fdab80032f0 tx=0x7fdab8007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:54.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.514+0000 7fdac77fe700 1 --2- 172.21.15.63:0/3945726828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdac806a2c0 0x7fdac80ace30 secure :-1 s=THROTTLE_DONE pgs=1813 cs=0 l=1 rx=0x7fdac814bb20 tx=0x7fdabc010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.514+0000 7fdac4ff9700 1 -- 172.21.15.63:0/3945726828 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fdac80af800 con 0x7fdac806a2c0 2020-05-18T21:35:54.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.630+0000 7fdacc9ca700 1 -- 172.21.15.63:0/3945726828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdac80af800 con 0x7fdac806a2c0 2020-05-18T21:35:54.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.630+0000 7fdac77fe700 1 --2- 172.21.15.63:0/3945726828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdac806a2c0 0x7fdac80ace30 secure :-1 s=THROTTLE_DONE pgs=1813 cs=0 l=1 rx=0x7fdac814bb20 tx=0x7fdabc010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.630+0000 7fdac4ff9700 1 -- 172.21.15.63:0/3945726828 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v134) v1 ==== 104+0+10 (secure 0 0 0) 0x7fdac80af800 con 0x7fdac806a2c0 2020-05-18T21:35:54.635 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:35:54.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.630+0000 7fdacc9ca700 1 -- 172.21.15.63:0/3945726828 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdaa804fac0 msgr2=0x7fdaa8051f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.630+0000 7fdacc9ca700 1 --2- 172.21.15.63:0/3945726828 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdaa804fac0 0x7fdaa8051f80 secure :-1 s=READY pgs=707 cs=0 l=1 rx=0x7fdab80032f0 tx=0x7fdab8007e00).stop 2020-05-18T21:35:54.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.634+0000 7fdacc9ca700 1 -- 172.21.15.63:0/3945726828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdac806a2c0 msgr2=0x7fdac80ace30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.634+0000 7fdacc9ca700 1 --2- 172.21.15.63:0/3945726828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdac806a2c0 0x7fdac80ace30 secure :-1 s=READY pgs=1813 cs=0 l=1 rx=0x7fdac814bb20 tx=0x7fdabc010d80).stop 2020-05-18T21:35:54.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.634+0000 7fdacc9ca700 1 -- 172.21.15.63:0/3945726828 shutdown_connections 2020-05-18T21:35:54.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.634+0000 7fdacc9ca700 1 --2- 172.21.15.63:0/3945726828 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdaa804fac0 0x7fdaa8051f80 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:54.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.634+0000 7fdacc9ca700 1 --2- 172.21.15.63:0/3945726828 >> v2:172.21.15.155:3300/0 conn(0x7fdac80b4f40 0x7fdac80ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:54.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.634+0000 7fdacc9ca700 1 --2- 172.21.15.63:0/3945726828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdac806a2c0 0x7fdac80ace30 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:54.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.634+0000 7fdacc9ca700 1 -- 172.21.15.63:0/3945726828 >> 172.21.15.63:0/3945726828 conn(0x7fdac805fbd0 msgr2=0x7fdac8131240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:54.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.634+0000 7fdacc9ca700 1 -- 172.21.15.63:0/3945726828 shutdown_connections 2020-05-18T21:35:54.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.634+0000 7fdacc9ca700 1 -- 172.21.15.63:0/3945726828 wait complete. 2020-05-18T21:35:54.648 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:35:54.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.750+0000 7f99a7f05700 1 Processor -- start 2020-05-18T21:35:54.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.750+0000 7f99a7f05700 1 -- start start 2020-05-18T21:35:54.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.750+0000 7f99a7f05700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99a00b6d90 0x7f99a012ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:54.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.750+0000 7f99a7f05700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a0060660 con 0x7f99a00b9500 2020-05-18T21:35:54.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.750+0000 7f99a7f05700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a0060890 con 0x7f99a00b8630 2020-05-18T21:35:54.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.750+0000 7f99a7f05700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0060b30 con 0x7f99a00b6d90 2020-05-18T21:35:54.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.750+0000 7f99a5ca1700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f99a00b9500 0x7f99a0061270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36878/0 (socket says 172.21.15.63:36878) 2020-05-18T21:35:54.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.750+0000 7f99a5ca1700 1 -- 172.21.15.63:0/679117083 learned_addr learned my addr 172.21.15.63:0/679117083 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:54.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.750+0000 7f99a64a2700 1 --2- 172.21.15.63:0/679117083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99a00b6d90 0x7f99a012ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:54.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.750+0000 7f99a4c9f700 1 -- 172.21.15.63:0/679117083 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954517275 0 0) 0x7f99a0060660 con 0x7f99a00b9500 2020-05-18T21:35:54.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.750+0000 7f99a4c9f700 1 -- 172.21.15.63:0/679117083 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9988003270 con 0x7f99a00b9500 2020-05-18T21:35:54.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.750+0000 7f99a4c9f700 1 -- 172.21.15.63:0/679117083 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535723029 0 0) 0x7f99a0060890 con 0x7f99a00b8630 2020-05-18T21:35:54.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.750+0000 7f99a4c9f700 1 -- 172.21.15.63:0/679117083 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a0060660 con 0x7f99a00b8630 2020-05-18T21:35:54.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.750+0000 7f99a64a2700 1 -- 172.21.15.63:0/679117083 >> v1:172.21.15.155:6789/0 conn(0x7f99a00b8630 legacy=0x7f99a00b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.750+0000 7f99a64a2700 1 -- 172.21.15.63:0/679117083 >> v1:172.21.15.63:6789/0 conn(0x7f99a00b9500 legacy=0x7f99a0061270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.750+0000 7f99a64a2700 1 -- 172.21.15.63:0/679117083 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a0060dd0 con 0x7f99a00b6d90 2020-05-18T21:35:54.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.750+0000 7f99a4c9f700 1 -- 172.21.15.63:0/679117083 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3589287384 0 0) 0x7f9988003270 con 0x7f99a00b9500 2020-05-18T21:35:54.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.750+0000 7f99a64a2700 1 --2- 172.21.15.63:0/679117083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99a00b6d90 0x7f99a012ed60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f999c0018b0 tx=0x7f9998008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.754+0000 7f99a64a2700 1 --2- 172.21.15.63:0/679117083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99a00b6d90 0x7f99a012ed60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f999c0018b0 tx=0x7f9998008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.754+0000 7f99a64a2700 1 --2- 172.21.15.63:0/679117083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99a00b6d90 0x7f99a012ed60 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f999c0018b0 tx=0x7f9998008ca0).ready entity=mon.2 client_cookie=ad5504a31bf57f1a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:54.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.754+0000 7f99a64a2700 1 --2- 172.21.15.63:0/679117083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99a00b6d90 0x7f99a012ed60 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f999c0018b0 tx=0x7f9998008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.754+0000 7f99a4c9f700 1 -- 172.21.15.63:0/679117083 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f999c001710 con 0x7f99a00b6d90 2020-05-18T21:35:54.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.754+0000 7f99a64a2700 1 --2- 172.21.15.63:0/679117083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99a00b6d90 0x7f99a012ed60 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f999c0018b0 tx=0x7f9998008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.754+0000 7f99a64a2700 1 --2- 172.21.15.63:0/679117083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99a00b6d90 0x7f99a012ed60 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f999c0018b0 tx=0x7f9998008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.754+0000 7f99a4c9f700 1 -- 172.21.15.63:0/679117083 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9998011ac0 con 0x7f99a00b6d90 2020-05-18T21:35:54.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.754+0000 7f99a7f05700 1 -- 172.21.15.63:0/679117083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99a00b6d90 msgr2=0x7f99a012ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.754+0000 7f99a7f05700 1 --2- 172.21.15.63:0/679117083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99a00b6d90 0x7f99a012ed60 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f999c0018b0 tx=0x7f9998008ca0).stop 2020-05-18T21:35:54.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.754+0000 7f99a4c9f700 1 -- 172.21.15.63:0/679117083 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9998011e60 con 0x7f99a00b6d90 2020-05-18T21:35:54.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.754+0000 7f99a7f05700 1 -- 172.21.15.63:0/679117083 shutdown_connections 2020-05-18T21:35:54.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.754+0000 7f99a7f05700 1 --2- 172.21.15.63:0/679117083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99a00b6d90 0x7f99a012ed60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:54.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.754+0000 7f99a7f05700 1 -- 172.21.15.63:0/679117083 >> 172.21.15.63:0/679117083 conn(0x7f99a0069b70 msgr2=0x7f99a0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:54.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.754+0000 7f99a7f05700 1 -- 172.21.15.63:0/679117083 shutdown_connections 2020-05-18T21:35:54.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.754+0000 7f99a7f05700 1 -- 172.21.15.63:0/679117083 wait complete. 2020-05-18T21:35:54.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.754+0000 7f99a7f05700 1 Processor -- start 2020-05-18T21:35:54.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.754+0000 7f99a7f05700 1 -- start start 2020-05-18T21:35:54.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a7f05700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f99a00b9500 0x7f99a0156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:54.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a7f05700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a0130ff0 con 0x7f99a00b8630 2020-05-18T21:35:54.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a7f05700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a0131290 con 0x7f99a00b6d90 2020-05-18T21:35:54.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a7f05700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a0130ce0 con 0x7f99a00b9500 2020-05-18T21:35:54.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a54a0700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f99a00b8630 0x7f99a0131730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36886/0 (socket says 172.21.15.63:36886) 2020-05-18T21:35:54.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a54a0700 1 -- 172.21.15.63:0/3714913955 learned_addr learned my addr 172.21.15.63:0/3714913955 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:54.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a64a2700 1 --2- 172.21.15.63:0/3714913955 >> v2:172.21.15.155:3300/0 conn(0x7f99a00b9500 0x7f99a0156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:54.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007289993 0 0) 0x7f99a0130ff0 con 0x7f99a00b8630 2020-05-18T21:35:54.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9980002fe0 con 0x7f99a00b8630 2020-05-18T21:35:54.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466584186 0 0) 0x7f99a0131290 con 0x7f99a00b6d90 2020-05-18T21:35:54.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a0130ff0 con 0x7f99a00b6d90 2020-05-18T21:35:54.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3490695357 0 0) 0x7f9980002fe0 con 0x7f99a00b8630 2020-05-18T21:35:54.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f99a0131290 con 0x7f99a00b8630 2020-05-18T21:35:54.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f9990002a10 con 0x7f99a00b8630 2020-05-18T21:35:54.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 >> v2:172.21.15.155:3300/0 conn(0x7f99a00b9500 msgr2=0x7f99a0156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 --2- 172.21.15.63:0/3714913955 >> v2:172.21.15.155:3300/0 conn(0x7f99a00b9500 0x7f99a0156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:54.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 >> v1:172.21.15.155:6789/0 conn(0x7f99a00b6d90 legacy=0x7f99a01446d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 >> v1:172.21.15.63:6789/0 conn(0x7f99a00b8630 legacy=0x7f99a0131730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9980004b50 0x7f9980004f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:54.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9980003a90 0x7f9980003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:54.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9980004330 0x7f998000b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:54.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0130ce0 con 0x7f9980003a90 2020-05-18T21:35:54.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998000bbc0 con 0x7f9980004b50 2020-05-18T21:35:54.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998000bd00 con 0x7f9980004330 2020-05-18T21:35:54.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a64a2700 1 --2- 172.21.15.63:0/3714913955 >> v2:172.21.15.155:3300/0 conn(0x7f99a00b9500 0x7f99a0156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:35:54.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a54a0700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9980003a90 0x7f9980003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:54.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a5ca1700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9980004b50 0x7f9980004f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:54.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a64a2700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9980004330 0x7f998000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:54.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a54a0700 1 -- 172.21.15.63:0/3714913955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9980004330 msgr2=0x7f998000b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a54a0700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9980004330 0x7f998000b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:54.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a54a0700 1 -- 172.21.15.63:0/3714913955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9980004b50 msgr2=0x7f9980004f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a54a0700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9980004b50 0x7f9980004f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:54.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a54a0700 1 -- 172.21.15.63:0/3714913955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a012f840 con 0x7f9980003a90 2020-05-18T21:35:54.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a64a2700 1 -- 172.21.15.63:0/3714913955 reap_dead start 2020-05-18T21:35:54.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a7f05700 1 -- 172.21.15.63:0/3714913955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a0156920 con 0x7f9980003a90 2020-05-18T21:35:54.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a5ca1700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9980004b50 0x7f9980004f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:35:54.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a54a0700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9980003a90 0x7f9980003ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f99800056d0 tx=0x7f9990011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a7f05700 1 -- 172.21.15.63:0/3714913955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a012eb30 con 0x7f9980003a90 2020-05-18T21:35:54.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a54a0700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9980003a90 0x7f9980003ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f99800056d0 tx=0x7f9990011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a54a0700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9980003a90 0x7f9980003ed0 secure :-1 s=READY pgs=1816 cs=0 l=1 rx=0x7f99800056d0 tx=0x7f9990011420).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:54.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a54a0700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9980003a90 0x7f9980003ed0 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7f99800056d0 tx=0x7f9990011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a54a0700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9980003a90 0x7f9980003ed0 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7f99800056d0 tx=0x7f9990011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9990011d70 con 0x7f9980003a90 2020-05-18T21:35:54.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f99a54a0700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9980003a90 0x7f9980003ed0 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7f99800056d0 tx=0x7f9990011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99900101c0 con 0x7f9980003a90 2020-05-18T21:35:54.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.758+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9990010520 con 0x7f9980003a90 2020-05-18T21:35:54.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.762+0000 7f99a54a0700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9980003a90 0x7f9980003ed0 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7f99800056d0 tx=0x7f9990011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.762+0000 7f99a7f05700 1 -- 172.21.15.63:0/3714913955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f997c003380 con 0x7f9980003a90 2020-05-18T21:35:54.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.762+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9990010680 con 0x7f9980003a90 2020-05-18T21:35:54.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.762+0000 7f99a54a0700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9980003a90 0x7f9980003ed0 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7f99800056d0 tx=0x7f9990011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.762+0000 7f998effd700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9980053ac0 0x7f9980055f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:54.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.762+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9990063ea0 con 0x7f9980003a90 2020-05-18T21:35:54.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.762+0000 7f99a5ca1700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9980053ac0 0x7f9980055f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:54.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.762+0000 7f99a5ca1700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9980053ac0 0x7f9980055f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f999c0018f0 tx=0x7f999c001d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.762+0000 7f99a5ca1700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9980053ac0 0x7f9980055f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f999c0018f0 tx=0x7f999c001d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.762+0000 7f99a5ca1700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9980053ac0 0x7f9980055f80 secure :-1 s=READY pgs=708 cs=0 l=1 rx=0x7f999c0018f0 tx=0x7f999c001d50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:54.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.766+0000 7f99a54a0700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9980003a90 0x7f9980003ed0 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7f99800056d0 tx=0x7f9990011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.766+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f999003e2f0 con 0x7f9980003a90 2020-05-18T21:35:54.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.882+0000 7f99a7f05700 1 -- 172.21.15.63:0/3714913955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f997c002240 con 0x7f9980003a90 2020-05-18T21:35:54.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.882+0000 7f99a54a0700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9980003a90 0x7f9980003ed0 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7f99800056d0 tx=0x7f9990011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:54.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.882+0000 7f998effd700 1 -- 172.21.15.63:0/3714913955 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v134) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9990041910 con 0x7f9980003a90 2020-05-18T21:35:54.887 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:35:54.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.882+0000 7f99a7f05700 1 -- 172.21.15.63:0/3714913955 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9980053ac0 msgr2=0x7f9980055f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.882+0000 7f99a7f05700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9980053ac0 0x7f9980055f80 secure :-1 s=READY pgs=708 cs=0 l=1 rx=0x7f999c0018f0 tx=0x7f999c001d50).stop 2020-05-18T21:35:54.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.882+0000 7f99a7f05700 1 -- 172.21.15.63:0/3714913955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9980003a90 msgr2=0x7f9980003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:54.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.882+0000 7f99a7f05700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9980003a90 0x7f9980003ed0 secure :-1 s=READY pgs=1816 cs=0 l=1 rx=0x7f99800056d0 tx=0x7f9990011420).stop 2020-05-18T21:35:54.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.882+0000 7f99a7f05700 1 -- 172.21.15.63:0/3714913955 shutdown_connections 2020-05-18T21:35:54.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.882+0000 7f99a7f05700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9980053ac0 0x7f9980055f80 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:54.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.882+0000 7f99a7f05700 1 --2- 172.21.15.63:0/3714913955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9980003a90 0x7f9980003ed0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:54.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.882+0000 7f99a7f05700 1 -- 172.21.15.63:0/3714913955 >> 172.21.15.63:0/3714913955 conn(0x7f99a0069b70 msgr2=0x7f99a00b7270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:54.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.882+0000 7f99a7f05700 1 -- 172.21.15.63:0/3714913955 shutdown_connections 2020-05-18T21:35:54.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.882+0000 7f99a7f05700 1 -- 172.21.15.63:0/3714913955 wait complete. 2020-05-18T21:35:54.900 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:35:54.901 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:35:55.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.998+0000 7efdc01fa700 1 Processor -- start 2020-05-18T21:35:55.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.998+0000 7efdc01fa700 1 -- start start 2020-05-18T21:35:55.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.998+0000 7efdc01fa700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efdb8060b90 0x7efdb80615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:55.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.998+0000 7efdc01fa700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efdb814e570 0x7efdb814a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:55.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.998+0000 7efdc01fa700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb814d960 con 0x7efdb80b2860 2020-05-18T21:35:55.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.998+0000 7efdc01fa700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb8066210 con 0x7efdb814e570 2020-05-18T21:35:55.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.998+0000 7efdc01fa700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb814db90 con 0x7efdb8060b90 2020-05-18T21:35:55.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.998+0000 7efdbe797700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efdb814e570 0x7efdb814a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:55.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.998+0000 7efdbe797700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efdb814e570 0x7efdb814a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34712/0 (socket says 172.21.15.63:34712) 2020-05-18T21:35:55.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.998+0000 7efdbd795700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efdb80b2860 0x7efdb8144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36900/0 (socket says 172.21.15.63:36900) 2020-05-18T21:35:55.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.998+0000 7efdbe797700 1 -- 172.21.15.63:0/3427306600 learned_addr learned my addr 172.21.15.63:0/3427306600 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:55.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:54.998+0000 7efdbdf96700 1 --2- 172.21.15.63:0/3427306600 >> v2:172.21.15.155:3300/0 conn(0x7efdb8060b90 0x7efdb80615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:55.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdbe797700 1 -- 172.21.15.63:0/3427306600 >> v2:172.21.15.155:3300/0 conn(0x7efdb8060b90 msgr2=0x7efdb80615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:55.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdbe797700 1 --2- 172.21.15.63:0/3427306600 >> v2:172.21.15.155:3300/0 conn(0x7efdb8060b90 0x7efdb80615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:55.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdbe797700 1 -- 172.21.15.63:0/3427306600 >> v1:172.21.15.63:6789/0 conn(0x7efdb80b2860 legacy=0x7efdb8144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:55.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdbcf94700 1 -- 172.21.15.63:0/3427306600 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575110963 0 0) 0x7efdb814d960 con 0x7efdb80b2860 2020-05-18T21:35:55.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdbe797700 1 -- 172.21.15.63:0/3427306600 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb814de30 con 0x7efdb814e570 2020-05-18T21:35:55.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdbe797700 1 --2- 172.21.15.63:0/3427306600 >> v2:172.21.15.63:3300/0 conn(0x7efdb814e570 0x7efdb814a390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efdb8062dc0 tx=0x7efdb0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:55.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdbe797700 1 --2- 172.21.15.63:0/3427306600 >> v2:172.21.15.63:3300/0 conn(0x7efdb814e570 0x7efdb814a390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efdb8062dc0 tx=0x7efdb0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:55.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdbe797700 1 --2- 172.21.15.63:0/3427306600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdb814e570 0x7efdb814a390 secure :-1 s=READY pgs=1818 cs=0 l=1 rx=0x7efdb8062dc0 tx=0x7efdb0007e00).ready entity=mon.0 client_cookie=65994698cd70220a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:55.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdbe797700 1 --2- 172.21.15.63:0/3427306600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdb814e570 0x7efdb814a390 secure :-1 s=THROTTLE_DONE pgs=1818 cs=0 l=1 rx=0x7efdb8062dc0 tx=0x7efdb0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:55.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdbe797700 1 --2- 172.21.15.63:0/3427306600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdb814e570 0x7efdb814a390 secure :-1 s=THROTTLE_DONE pgs=1818 cs=0 l=1 rx=0x7efdb8062dc0 tx=0x7efdb0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:55.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdbcf94700 1 -- 172.21.15.63:0/3427306600 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdb0011cd0 con 0x7efdb814e570 2020-05-18T21:35:55.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdbe797700 1 --2- 172.21.15.63:0/3427306600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdb814e570 0x7efdb814a390 secure :-1 s=THROTTLE_DONE pgs=1818 cs=0 l=1 rx=0x7efdb8062dc0 tx=0x7efdb0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:55.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdbcf94700 1 -- 172.21.15.63:0/3427306600 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb0011e30 con 0x7efdb814e570 2020-05-18T21:35:55.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdbcf94700 1 -- 172.21.15.63:0/3427306600 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdb000a370 con 0x7efdb814e570 2020-05-18T21:35:55.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdc01fa700 1 -- 172.21.15.63:0/3427306600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdb814e570 msgr2=0x7efdb814a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:55.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdc01fa700 1 --2- 172.21.15.63:0/3427306600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdb814e570 0x7efdb814a390 secure :-1 s=READY pgs=1818 cs=0 l=1 rx=0x7efdb8062dc0 tx=0x7efdb0007e00).stop 2020-05-18T21:35:55.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdc01fa700 1 -- 172.21.15.63:0/3427306600 shutdown_connections 2020-05-18T21:35:55.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdc01fa700 1 --2- 172.21.15.63:0/3427306600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdb814e570 0x7efdb814a390 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:55.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdc01fa700 1 --2- 172.21.15.63:0/3427306600 >> v2:172.21.15.155:3300/0 conn(0x7efdb8060b90 0x7efdb80615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:55.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdc01fa700 1 -- 172.21.15.63:0/3427306600 >> 172.21.15.63:0/3427306600 conn(0x7efdb80b83d0 msgr2=0x7efdb80b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:55.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdc01fa700 1 -- 172.21.15.63:0/3427306600 shutdown_connections 2020-05-18T21:35:55.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdc01fa700 1 -- 172.21.15.63:0/3427306600 wait complete. 2020-05-18T21:35:55.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdc01fa700 1 Processor -- start 2020-05-18T21:35:55.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdc01fa700 1 -- start start 2020-05-18T21:35:55.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdc01fa700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efdb8060b90 0x7efdb80ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:55.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdc01fa700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdb80b2860 0x7efdb814bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:55.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdc01fa700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb8155140 con 0x7efdb814e570 2020-05-18T21:35:55.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdc01fa700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb8158530 con 0x7efdb8060b90 2020-05-18T21:35:55.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdc01fa700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb8149b90 con 0x7efdb80b2860 2020-05-18T21:35:55.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdbdf96700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efdb8060b90 0x7efdb80ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:55.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdbe797700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7efdb814e570 0x7efdb8157680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:35224/0 (socket says 172.21.15.63:35224) 2020-05-18T21:35:55.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdbd795700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdb80b2860 0x7efdb814bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:55.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.002+0000 7efdbe797700 1 -- 172.21.15.63:0/998422308 learned_addr learned my addr 172.21.15.63:0/998422308 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:55.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdbdf96700 1 -- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdb80b2860 msgr2=0x7efdb814bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:55.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdbdf96700 1 --2- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdb80b2860 0x7efdb814bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:55.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdaeffd700 1 -- 172.21.15.63:0/998422308 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929270851 0 0) 0x7efdb8155140 con 0x7efdb814e570 2020-05-18T21:35:55.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdbdf96700 1 -- 172.21.15.63:0/998422308 >> v1:172.21.15.155:6789/0 conn(0x7efdb814e570 legacy=0x7efdb8157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:55.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdbdf96700 1 -- 172.21.15.63:0/998422308 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb814a030 con 0x7efdb8060b90 2020-05-18T21:35:55.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdbdf96700 1 --2- 172.21.15.63:0/998422308 >> v2:172.21.15.155:3300/0 conn(0x7efdb8060b90 0x7efdb80ac890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efdb4002f70 tx=0x7efdb4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:55.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdbdf96700 1 --2- 172.21.15.63:0/998422308 >> v2:172.21.15.155:3300/0 conn(0x7efdb8060b90 0x7efdb80ac890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efdb4002f70 tx=0x7efdb4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:55.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdbdf96700 1 --2- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb8060b90 0x7efdb80ac890 secure :-1 s=READY pgs=1210 cs=0 l=1 rx=0x7efdb4002f70 tx=0x7efdb4010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:55.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdbdf96700 1 --2- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb8060b90 0x7efdb80ac890 secure :-1 s=THROTTLE_DONE pgs=1210 cs=0 l=1 rx=0x7efdb4002f70 tx=0x7efdb4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:55.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdaeffd700 1 -- 172.21.15.63:0/998422308 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdb4007550 con 0x7efdb8060b90 2020-05-18T21:35:55.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdbdf96700 1 --2- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb8060b90 0x7efdb80ac890 secure :-1 s=THROTTLE_DONE pgs=1210 cs=0 l=1 rx=0x7efdb4002f70 tx=0x7efdb4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:55.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdc01fa700 1 -- 172.21.15.63:0/998422308 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb8149880 con 0x7efdb8060b90 2020-05-18T21:35:55.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdaeffd700 1 -- 172.21.15.63:0/998422308 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb4005700 con 0x7efdb8060b90 2020-05-18T21:35:55.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdbdf96700 1 --2- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb8060b90 0x7efdb80ac890 secure :-1 s=THROTTLE_DONE pgs=1210 cs=0 l=1 rx=0x7efdb4002f70 tx=0x7efdb4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:55.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdaeffd700 1 -- 172.21.15.63:0/998422308 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdb4005a60 con 0x7efdb8060b90 2020-05-18T21:35:55.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdc01fa700 1 -- 172.21.15.63:0/998422308 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb814c410 con 0x7efdb8060b90 2020-05-18T21:35:55.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdc01fa700 1 -- 172.21.15.63:0/998422308 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb80569e0 con 0x7efdb8060b90 2020-05-18T21:35:55.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdbdf96700 1 --2- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb8060b90 0x7efdb80ac890 secure :-1 s=THROTTLE_DONE pgs=1210 cs=0 l=1 rx=0x7efdb4002f70 tx=0x7efdb4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:55.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdaeffd700 1 -- 172.21.15.63:0/998422308 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7efdb4005c60 con 0x7efdb8060b90 2020-05-18T21:35:55.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.006+0000 7efdbdf96700 1 --2- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb8060b90 0x7efdb80ac890 secure :-1 s=THROTTLE_DONE pgs=1210 cs=0 l=1 rx=0x7efdb4002f70 tx=0x7efdb4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:55.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.010+0000 7efdaeffd700 1 --2- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efda004f8d0 0x7efda0051d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:55.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.010+0000 7efdaeffd700 1 -- 172.21.15.63:0/998422308 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efdb4063e30 con 0x7efdb8060b90 2020-05-18T21:35:55.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.010+0000 7efdbd795700 1 --2- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efda004f8d0 0x7efda0051d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:55.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.010+0000 7efdbd795700 1 --2- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efda004f8d0 0x7efda0051d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efda8000bc0 tx=0x7efda800c940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:55.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.010+0000 7efdbd795700 1 --2- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efda004f8d0 0x7efda0051d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efda8000bc0 tx=0x7efda800c940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:55.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.010+0000 7efdbd795700 1 --2- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efda004f8d0 0x7efda0051d90 secure :-1 s=READY pgs=709 cs=0 l=1 rx=0x7efda8000bc0 tx=0x7efda800c940).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.018+0000 7efdbdf96700 1 --2- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb8060b90 0x7efdb80ac890 secure :-1 s=THROTTLE_DONE pgs=1210 cs=0 l=1 rx=0x7efdb4002f70 tx=0x7efdb4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.018+0000 7efdaeffd700 1 -- 172.21.15.63:0/998422308 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7efdb403e1c0 con 0x7efdb8060b90 2020-05-18T21:35:55.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.170+0000 7efdc01fa700 1 -- 172.21.15.63:0/998422308 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdb80008d0 con 0x7efdb8060b90 2020-05-18T21:35:55.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.170+0000 7efdbdf96700 1 --2- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb8060b90 0x7efdb80ac890 secure :-1 s=THROTTLE_DONE pgs=1210 cs=0 l=1 rx=0x7efdb4002f70 tx=0x7efdb4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:55.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.170+0000 7efdaeffd700 1 -- 172.21.15.63:0/998422308 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+2146 (secure 0 0 0) 0x7efdb40417e0 con 0x7efdb8060b90 2020-05-18T21:35:55.177 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:55.177 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":102,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/2822608544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2822608544},{"type":"v1","addr":"172.21.15.155:6835","nonce":2822608544}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":101}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:35:51.163874+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:35:55.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.174+0000 7efdc01fa700 1 -- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efda004f8d0 msgr2=0x7efda0051d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:55.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.174+0000 7efdc01fa700 1 --2- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efda004f8d0 0x7efda0051d90 secure :-1 s=READY pgs=709 cs=0 l=1 rx=0x7efda8000bc0 tx=0x7efda800c940).stop 2020-05-18T21:35:55.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.174+0000 7efdc01fa700 1 -- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb8060b90 msgr2=0x7efdb80ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:55.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.174+0000 7efdc01fa700 1 --2- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb8060b90 0x7efdb80ac890 secure :-1 s=READY pgs=1210 cs=0 l=1 rx=0x7efdb4002f70 tx=0x7efdb4010bd0).stop 2020-05-18T21:35:55.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.174+0000 7efdc01fa700 1 -- 172.21.15.63:0/998422308 shutdown_connections 2020-05-18T21:35:55.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.174+0000 7efdc01fa700 1 --2- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efda004f8d0 0x7efda0051d90 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:55.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.174+0000 7efdc01fa700 1 --2- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdb80b2860 0x7efdb814bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:55.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.174+0000 7efdc01fa700 1 --2- 172.21.15.63:0/998422308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb8060b90 0x7efdb80ac890 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:55.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.174+0000 7efdc01fa700 1 -- 172.21.15.63:0/998422308 >> 172.21.15.63:0/998422308 conn(0x7efdb80b83d0 msgr2=0x7efdb80b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:55.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.174+0000 7efdc01fa700 1 -- 172.21.15.63:0/998422308 shutdown_connections 2020-05-18T21:35:55.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:55.174+0000 7efdc01fa700 1 -- 172.21.15.63:0/998422308 wait complete. 2020-05-18T21:35:55.182 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 102 2020-05-18T21:35:55.393 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 102, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:35:50.157703+0000', 'modified': '2020-05-18T21:35:51.163874+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9501}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9501': {'gid': 9501, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/169345666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 169345666}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 169345666}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:35:55.394 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:35:55.394 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:35:55.504 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:35:55.504 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:35:55.504 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:35:55.505 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 9501, 2020-05-18T21:35:55.505 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:35:55.505 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:35:55.505 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 5.3389675490000004, 2020-05-18T21:35:55.505 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 102, 2020-05-18T21:35:55.506 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 134, 2020-05-18T21:35:55.506 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 134, 2020-05-18T21:35:55.506 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 9.5568640120000001 2020-05-18T21:35:55.506 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:35:55.513 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 9501, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.3389675490000004, "mdsmap_epoch": 102, "osdmap_epoch": 134, "osdmap_epoch_barrier": 134, "uptime": 9.5568640120000001 } 2020-05-18T21:35:55.514 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:35:55.514 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:35:55.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:55.516 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:35:55.521 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:35:55.521 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:35:55.522 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:35:55.522 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:35:55.522 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:35:55.523 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:35:55.523 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:35:55.523 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:55.523 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:35:55.523 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:55.523 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:35:55.524 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:55.524 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:35:55.524 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:35:55.525 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:35:55.525 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42287sec preferred_lft 42287sec 2020-05-18T21:35:55.525 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:35:55.525 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:35:55.526 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:35:55.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:55.527 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:35:55.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:55.543 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:35:55.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:55.609 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:35:55.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:55.628 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:35:55.643 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:35:55.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:55.645 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:35:55.697 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:35:55.698 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:35:55.698 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:35:55.698 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:35:55.699 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:35:55.699 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:35:55.699 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:35:55.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:55.700 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:35:55.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:55.717 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:35:55.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:55.735 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:35:55.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:55.795 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:35:55.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:55.805 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:35:55.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:55.813 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:35:55.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:55.877 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-05-18T21:35:55.893 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-05-18T21:35:55.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:55.895 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-05-18T21:35:55.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:55.958 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:35:55.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:55.981 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-05-18T21:35:56.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:56.048 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-05-18T21:35:56.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:56.064 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-05-18T21:35:56.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:56.083 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 up' 2020-05-18T21:35:56.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:35:56.143 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.0 master ceph-brx' 2020-05-18T21:35:56.171 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-05-18T21:35:56.172 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-05-18T21:35:56.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:35:56.173 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:35:56.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:35:56.181 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:35:56.196 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:35:56.197 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:35:56.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:35:56.199 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:35:56.247 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:35:56.248 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:35:56.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:35:56.253 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:35:56.267 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:35:56.269 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:35:56.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:35:56.270 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:35:56.340 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2020-05-18T21:35:56.334+0000 7f3455443080 -1 init, newargv = 0x56297abccde0 newargc=9 2020-05-18T21:35:56.340 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[36341]: starting ceph client 2020-05-18T21:35:56.348 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[36341]: starting fuse 2020-05-18T21:35:57.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:35:57.425 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:35:57.444 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:35:57.446 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:35:57.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:35:57.447 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:35:57.454 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:35:57.455 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:35:57.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:35:57.456 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:35:57.457 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:35:57.458 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:35:57.458 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:35:57.459 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:35:57.460 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:35:57.461 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:35:57.461 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:35:57.462 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:35:57.463 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:35:57.463 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:35:57.464 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:35:57.465 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:35:57.465 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:35:57.466 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:35:57.467 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:35:57.467 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:35:57.468 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:35:57.469 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:35:57.469 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:35:57.470 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:35:57.471 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:35:57.471 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:35:57.538 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.36341.asok 2020-05-18T21:35:57.543 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.36341.asok 2020-05-18T21:35:57.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:35:57.545 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.36341.asok status 2020-05-18T21:35:57.639 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:35:57.639 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:35:57.639 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:35:57.640 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:35:57.640 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:35:57.640 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:35:57.640 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:35:57.640 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "36341", 2020-05-18T21:35:57.641 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:35:57.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:57.641 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:35:57.641 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:35:57.641 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 9648, 2020-05-18T21:35:57.642 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:35:57.642 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:35:57.642 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:35:57.642 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 9648 2020-05-18T21:35:57.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:57.642 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:35:57.643 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:57.643 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:35:57.643 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1193132164 2020-05-18T21:35:57.644 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:35:57.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:57.644 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:35:57.644 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:35:57.644 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:35:57.644 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1193132164 2020-05-18T21:35:57.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:35:57.645 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.9648 192.168.0.1:0/1193132164", 2020-05-18T21:35:57.645 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/1193132164", 2020-05-18T21:35:57.645 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:35:57.645 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 102, 2020-05-18T21:35:57.646 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 134, 2020-05-18T21:35:57.646 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:35:57.646 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:35:57.646 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:35:57.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:35:57.648 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:35:57.648 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:35:57.660 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:35:57.661 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-05-18T21:35:57.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:35:57.662 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:35:57.728 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs max_mds 2 2020-05-18T21:35:57.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.834+0000 7f06f1955700 1 Processor -- start 2020-05-18T21:35:57.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.834+0000 7f06f1955700 1 -- start start 2020-05-18T21:35:57.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.834+0000 7f06f1955700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f06ec0b4460 0x7f06ec0b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:57.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.834+0000 7f06f1955700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06ec145ca0 0x7f06ec0b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:57.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.834+0000 7f06f1955700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f06ec0b0d40 0x7f06ec1492f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:57.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.834+0000 7f06f1955700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec146530 con 0x7f06ec0b0d40 2020-05-18T21:35:57.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.834+0000 7f06f1955700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec146740 con 0x7f06ec0b4460 2020-05-18T21:35:57.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.834+0000 7f06f1955700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec1469e0 con 0x7f06ec145ca0 2020-05-18T21:35:57.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.834+0000 7f06f1154700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f06ec0b0d40 0x7f06ec1492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:57.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.834+0000 7f06f1154700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f06ec0b0d40 0x7f06ec1492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34742/0 (socket says 172.21.15.63:34742) 2020-05-18T21:35:57.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.834+0000 7f06f1154700 1 -- 172.21.15.63:0/4293297870 learned_addr learned my addr 172.21.15.63:0/4293297870 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:35:57.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.834+0000 7f06f0953700 1 --2- 172.21.15.63:0/4293297870 >> v2:172.21.15.155:3300/0 conn(0x7f06ec0b4460 0x7f06ec0b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:57.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.834+0000 7f06ebfff700 1 --2- 172.21.15.63:0/4293297870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06ec145ca0 0x7f06ec0b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:57.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1154700 1 -- 172.21.15.63:0/4293297870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06ec145ca0 msgr2=0x7f06ec0b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:57.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1154700 1 --2- 172.21.15.63:0/4293297870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06ec145ca0 0x7f06ec0b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:57.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1154700 1 -- 172.21.15.63:0/4293297870 >> v2:172.21.15.155:3300/0 conn(0x7f06ec0b4460 msgr2=0x7f06ec0b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:57.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1154700 1 --2- 172.21.15.63:0/4293297870 >> v2:172.21.15.155:3300/0 conn(0x7f06ec0b4460 0x7f06ec0b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:57.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1154700 1 -- 172.21.15.63:0/4293297870 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec0b4840 con 0x7f06ec0b0d40 2020-05-18T21:35:57.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1154700 1 --2- 172.21.15.63:0/4293297870 >> v2:172.21.15.63:3300/0 conn(0x7f06ec0b0d40 0x7f06ec1492f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f06e40032f0 tx=0x7f06e4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:57.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1154700 1 --2- 172.21.15.63:0/4293297870 >> v2:172.21.15.63:3300/0 conn(0x7f06ec0b0d40 0x7f06ec1492f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f06e40032f0 tx=0x7f06e4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:57.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1154700 1 --2- 172.21.15.63:0/4293297870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec0b0d40 0x7f06ec1492f0 secure :-1 s=READY pgs=1822 cs=0 l=1 rx=0x7f06e40032f0 tx=0x7f06e4007e00).ready entity=mon.0 client_cookie=601fc8b08ce3ff5d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:57.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1154700 1 --2- 172.21.15.63:0/4293297870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec0b0d40 0x7f06ec1492f0 secure :-1 s=THROTTLE_DONE pgs=1822 cs=0 l=1 rx=0x7f06e40032f0 tx=0x7f06e4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:57.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1154700 1 --2- 172.21.15.63:0/4293297870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec0b0d40 0x7f06ec1492f0 secure :-1 s=THROTTLE_DONE pgs=1822 cs=0 l=1 rx=0x7f06e40032f0 tx=0x7f06e4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:57.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1154700 1 --2- 172.21.15.63:0/4293297870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec0b0d40 0x7f06ec1492f0 secure :-1 s=THROTTLE_DONE pgs=1822 cs=0 l=1 rx=0x7f06e40032f0 tx=0x7f06e4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:57.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06eb7fe700 1 -- 172.21.15.63:0/4293297870 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06e4011c60 con 0x7f06ec0b0d40 2020-05-18T21:35:57.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06eb7fe700 1 -- 172.21.15.63:0/4293297870 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e4011dc0 con 0x7f06ec0b0d40 2020-05-18T21:35:57.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06eb7fe700 1 -- 172.21.15.63:0/4293297870 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06e400a370 con 0x7f06ec0b0d40 2020-05-18T21:35:57.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1955700 1 -- 172.21.15.63:0/4293297870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec0b0d40 msgr2=0x7f06ec1492f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:57.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1955700 1 --2- 172.21.15.63:0/4293297870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec0b0d40 0x7f06ec1492f0 secure :-1 s=READY pgs=1822 cs=0 l=1 rx=0x7f06e40032f0 tx=0x7f06e4007e00).stop 2020-05-18T21:35:57.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1955700 1 -- 172.21.15.63:0/4293297870 shutdown_connections 2020-05-18T21:35:57.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1955700 1 --2- 172.21.15.63:0/4293297870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec0b0d40 0x7f06ec1492f0 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:57.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1955700 1 --2- 172.21.15.63:0/4293297870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06ec145ca0 0x7f06ec0b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:57.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1955700 1 --2- 172.21.15.63:0/4293297870 >> v2:172.21.15.155:3300/0 conn(0x7f06ec0b4460 0x7f06ec0b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:57.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1955700 1 -- 172.21.15.63:0/4293297870 >> 172.21.15.63:0/4293297870 conn(0x7f06ec069b70 msgr2=0x7f06ec069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:57.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1955700 1 -- 172.21.15.63:0/4293297870 shutdown_connections 2020-05-18T21:35:57.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1955700 1 -- 172.21.15.63:0/4293297870 wait complete. 2020-05-18T21:35:57.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1955700 1 Processor -- start 2020-05-18T21:35:57.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.838+0000 7f06f1955700 1 -- start start 2020-05-18T21:35:57.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06f1955700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f06ec0b4460 0x7f06ec062910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:57.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06f1955700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f06ec145ca0 0x7f06ec065920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:57.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06f1955700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ec0b3a10 con 0x7f06ec0b0d40 2020-05-18T21:35:57.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06f1955700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec0b3510 con 0x7f06ec0b4460 2020-05-18T21:35:57.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06f1955700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec065d80 con 0x7f06ec145ca0 2020-05-18T21:35:57.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06ebfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f06ec0b4460 0x7f06ec062910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:57.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06f0953700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f06ec0b0d40 0x7f06ec141ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36932/0 (socket says 172.21.15.63:36932) 2020-05-18T21:35:57.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06ebfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f06ec0b4460 0x7f06ec062910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34746/0 (socket says 172.21.15.63:34746) 2020-05-18T21:35:57.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06f0953700 1 -- 172.21.15.63:0/698603338 learned_addr learned my addr 172.21.15.63:0/698603338 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:57.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06f1154700 1 --2- 172.21.15.63:0/698603338 >> v2:172.21.15.155:3300/0 conn(0x7f06ec145ca0 0x7f06ec065920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:57.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06ebfff700 1 -- 172.21.15.63:0/698603338 >> v2:172.21.15.155:3300/0 conn(0x7f06ec145ca0 msgr2=0x7f06ec065920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:57.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06ebfff700 1 --2- 172.21.15.63:0/698603338 >> v2:172.21.15.155:3300/0 conn(0x7f06ec145ca0 0x7f06ec065920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:57.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06ebfff700 1 -- 172.21.15.63:0/698603338 >> v1:172.21.15.63:6789/0 conn(0x7f06ec0b0d40 legacy=0x7f06ec141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:57.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06ebfff700 1 -- 172.21.15.63:0/698603338 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec0b3770 con 0x7f06ec0b4460 2020-05-18T21:35:57.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06e9ffb700 1 -- 172.21.15.63:0/698603338 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115163347 0 0) 0x7f06ec0b3a10 con 0x7f06ec0b0d40 2020-05-18T21:35:57.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06f1154700 1 --2- 172.21.15.63:0/698603338 >> v2:172.21.15.155:3300/0 conn(0x7f06ec145ca0 0x7f06ec065920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:35:57.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06ebfff700 1 --2- 172.21.15.63:0/698603338 >> v2:172.21.15.63:3300/0 conn(0x7f06ec0b4460 0x7f06ec062910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f06dc002f70 tx=0x7f06dc010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:57.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06ebfff700 1 --2- 172.21.15.63:0/698603338 >> v2:172.21.15.63:3300/0 conn(0x7f06ec0b4460 0x7f06ec062910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f06dc002f70 tx=0x7f06dc010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:57.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06ebfff700 1 --2- 172.21.15.63:0/698603338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec0b4460 0x7f06ec062910 secure :-1 s=READY pgs=1824 cs=0 l=1 rx=0x7f06dc002f70 tx=0x7f06dc010c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:57.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06ebfff700 1 --2- 172.21.15.63:0/698603338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec0b4460 0x7f06ec062910 secure :-1 s=THROTTLE_DONE pgs=1824 cs=0 l=1 rx=0x7f06dc002f70 tx=0x7f06dc010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:57.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06e9ffb700 1 -- 172.21.15.63:0/698603338 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06dc007550 con 0x7f06ec0b4460 2020-05-18T21:35:57.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06ebfff700 1 --2- 172.21.15.63:0/698603338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec0b4460 0x7f06ec062910 secure :-1 s=THROTTLE_DONE pgs=1824 cs=0 l=1 rx=0x7f06dc002f70 tx=0x7f06dc010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:57.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06ebfff700 1 --2- 172.21.15.63:0/698603338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec0b4460 0x7f06ec062910 secure :-1 s=THROTTLE_DONE pgs=1824 cs=0 l=1 rx=0x7f06dc002f70 tx=0x7f06dc010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:57.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06e9ffb700 1 -- 172.21.15.63:0/698603338 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc005700 con 0x7f06ec0b4460 2020-05-18T21:35:57.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06f1955700 1 -- 172.21.15.63:0/698603338 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ec1425e0 con 0x7f06ec0b4460 2020-05-18T21:35:57.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06e9ffb700 1 -- 172.21.15.63:0/698603338 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06dc005ae0 con 0x7f06ec0b4460 2020-05-18T21:35:57.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06f1955700 1 -- 172.21.15.63:0/698603338 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec0b5c10 con 0x7f06ec0b4460 2020-05-18T21:35:57.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.842+0000 7f06ebfff700 1 --2- 172.21.15.63:0/698603338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec0b4460 0x7f06ec062910 secure :-1 s=THROTTLE_DONE pgs=1824 cs=0 l=1 rx=0x7f06dc002f70 tx=0x7f06dc010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:57.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.846+0000 7f06e9ffb700 1 -- 172.21.15.63:0/698603338 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f06dc005d50 con 0x7f06ec0b4460 2020-05-18T21:35:57.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.846+0000 7f06ebfff700 1 --2- 172.21.15.63:0/698603338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec0b4460 0x7f06ec062910 secure :-1 s=THROTTLE_DONE pgs=1824 cs=0 l=1 rx=0x7f06dc002f70 tx=0x7f06dc010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:57.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.846+0000 7f06f1955700 1 -- 172.21.15.63:0/698603338 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ec0b5f20 con 0x7f06ec0b4460 2020-05-18T21:35:57.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.846+0000 7f06e9ffb700 1 --2- 172.21.15.63:0/698603338 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f06cc04f8d0 0x7f06cc051d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:57.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.846+0000 7f06e9ffb700 1 -- 172.21.15.63:0/698603338 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f06dc063e80 con 0x7f06ec0b4460 2020-05-18T21:35:57.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.846+0000 7f06f0953700 1 --2- 172.21.15.63:0/698603338 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f06cc04f8d0 0x7f06cc051d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:57.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.846+0000 7f06f0953700 1 --2- 172.21.15.63:0/698603338 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f06cc04f8d0 0x7f06cc051d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f06e0007fe0 tx=0x7f06e00090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:57.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.846+0000 7f06f0953700 1 --2- 172.21.15.63:0/698603338 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f06cc04f8d0 0x7f06cc051d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f06e0007fe0 tx=0x7f06e00090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:57.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.846+0000 7f06f0953700 1 --2- 172.21.15.63:0/698603338 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f06cc04f8d0 0x7f06cc051d90 secure :-1 s=READY pgs=710 cs=0 l=1 rx=0x7f06e0007fe0 tx=0x7f06e00090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:57.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.850+0000 7f06ebfff700 1 --2- 172.21.15.63:0/698603338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec0b4460 0x7f06ec062910 secure :-1 s=THROTTLE_DONE pgs=1824 cs=0 l=1 rx=0x7f06dc002f70 tx=0x7f06dc010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:57.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:57.850+0000 7f06e9ffb700 1 -- 172.21.15.63:0/698603338 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f06dc03e1b0 con 0x7f06ec0b4460 2020-05-18T21:35:58.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.002+0000 7f06f1955700 1 -- 172.21.15.63:0/698603338 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f06ec0569e0 con 0x7f06ec0b4460 2020-05-18T21:35:58.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.250+0000 7f06ebfff700 1 --2- 172.21.15.63:0/698603338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec0b4460 0x7f06ec062910 secure :-1 s=THROTTLE_DONE pgs=1824 cs=0 l=1 rx=0x7f06dc002f70 tx=0x7f06dc010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:58.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.250+0000 7f06e9ffb700 1 -- 172.21.15.63:0/698603338 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v103) v1 ==== 105+0+0 (secure 0 0 0) 0x7f06dc0417d0 con 0x7f06ec0b4460 2020-05-18T21:35:58.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.254+0000 7f06f1955700 1 -- 172.21.15.63:0/698603338 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f06cc04f8d0 msgr2=0x7f06cc051d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:58.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.254+0000 7f06f1955700 1 --2- 172.21.15.63:0/698603338 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f06cc04f8d0 0x7f06cc051d90 secure :-1 s=READY pgs=710 cs=0 l=1 rx=0x7f06e0007fe0 tx=0x7f06e00090f0).stop 2020-05-18T21:35:58.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.254+0000 7f06f1955700 1 -- 172.21.15.63:0/698603338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec0b4460 msgr2=0x7f06ec062910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:58.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.254+0000 7f06f1955700 1 --2- 172.21.15.63:0/698603338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec0b4460 0x7f06ec062910 secure :-1 s=READY pgs=1824 cs=0 l=1 rx=0x7f06dc002f70 tx=0x7f06dc010c10).stop 2020-05-18T21:35:58.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.254+0000 7f06f1955700 1 -- 172.21.15.63:0/698603338 shutdown_connections 2020-05-18T21:35:58.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.258+0000 7f06f1955700 1 --2- 172.21.15.63:0/698603338 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f06cc04f8d0 0x7f06cc051d90 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:58.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.258+0000 7f06f1955700 1 --2- 172.21.15.63:0/698603338 >> v2:172.21.15.155:3300/0 conn(0x7f06ec145ca0 0x7f06ec065920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:58.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.258+0000 7f06f1955700 1 --2- 172.21.15.63:0/698603338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec0b4460 0x7f06ec062910 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:58.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.258+0000 7f06f1955700 1 -- 172.21.15.63:0/698603338 >> 172.21.15.63:0/698603338 conn(0x7f06ec069b70 msgr2=0x7f06ec0b9780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:58.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.258+0000 7f06f1955700 1 -- 172.21.15.63:0/698603338 shutdown_connections 2020-05-18T21:35:58.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.258+0000 7f06f1955700 1 -- 172.21.15.63:0/698603338 wait complete. 2020-05-18T21:35:58.283 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:35:58.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.374+0000 7ff8950bd700 1 Processor -- start 2020-05-18T21:35:58.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.374+0000 7ff8950bd700 1 -- start start 2020-05-18T21:35:58.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff8950bd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff89005f110 0x7ff8900acea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:58.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff8950bd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff8900659d0 0x7ff890146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:35:58.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff8950bd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8900b4af0 con 0x7ff890146c80 2020-05-18T21:35:58.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff8950bd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8901460e0 con 0x7ff89005f110 2020-05-18T21:35:58.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff8950bd700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff890146380 con 0x7ff8900659d0 2020-05-18T21:35:58.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff88ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff89005f110 0x7ff8900acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:58.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff8948bc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff890146c80 0x7ff89013c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36944/0 (socket says 172.21.15.63:36944) 2020-05-18T21:35:58.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff8948bc700 1 -- 172.21.15.63:0/3976637435 learned_addr learned my addr 172.21.15.63:0/3976637435 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:58.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff887fff700 1 --2- 172.21.15.63:0/3976637435 >> v2:172.21.15.155:3300/0 conn(0x7ff8900659d0 0x7ff890146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:58.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff88ffff700 1 -- 172.21.15.63:0/3976637435 >> v2:172.21.15.155:3300/0 conn(0x7ff8900659d0 msgr2=0x7ff890146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:35:58.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff88ffff700 1 --2- 172.21.15.63:0/3976637435 >> v2:172.21.15.155:3300/0 conn(0x7ff8900659d0 0x7ff890146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:58.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff88ffff700 1 -- 172.21.15.63:0/3976637435 >> v1:172.21.15.63:6789/0 conn(0x7ff890146c80 legacy=0x7ff89013c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:58.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff88f7fe700 1 -- 172.21.15.63:0/3976637435 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246231369 0 0) 0x7ff8900b4af0 con 0x7ff890146c80 2020-05-18T21:35:58.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff88ffff700 1 -- 172.21.15.63:0/3976637435 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89005f4f0 con 0x7ff89005f110 2020-05-18T21:35:58.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff88ffff700 1 --2- 172.21.15.63:0/3976637435 >> v2:172.21.15.63:3300/0 conn(0x7ff89005f110 0x7ff8900acea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff880002f70 tx=0x7ff880007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:58.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff88ffff700 1 --2- 172.21.15.63:0/3976637435 >> v2:172.21.15.63:3300/0 conn(0x7ff89005f110 0x7ff8900acea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff880002f70 tx=0x7ff880007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:58.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff88ffff700 1 --2- 172.21.15.63:0/3976637435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff89005f110 0x7ff8900acea0 secure :-1 s=READY pgs=1826 cs=0 l=1 rx=0x7ff880002f70 tx=0x7ff880007a80).ready entity=mon.0 client_cookie=a00e3c1c0ce26576 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:58.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff88ffff700 1 --2- 172.21.15.63:0/3976637435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff89005f110 0x7ff8900acea0 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7ff880002f70 tx=0x7ff880007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:58.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff88f7fe700 1 -- 172.21.15.63:0/3976637435 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff880008e50 con 0x7ff89005f110 2020-05-18T21:35:58.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff88ffff700 1 --2- 172.21.15.63:0/3976637435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff89005f110 0x7ff8900acea0 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7ff880002f70 tx=0x7ff880007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:58.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff88f7fe700 1 -- 172.21.15.63:0/3976637435 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8800115f0 con 0x7ff89005f110 2020-05-18T21:35:58.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff88ffff700 1 --2- 172.21.15.63:0/3976637435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff89005f110 0x7ff8900acea0 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7ff880002f70 tx=0x7ff880007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:58.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff8950bd700 1 -- 172.21.15.63:0/3976637435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff89005f110 msgr2=0x7ff8900acea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:58.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff8950bd700 1 --2- 172.21.15.63:0/3976637435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff89005f110 0x7ff8900acea0 secure :-1 s=READY pgs=1826 cs=0 l=1 rx=0x7ff880002f70 tx=0x7ff880007a80).stop 2020-05-18T21:35:58.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff88f7fe700 1 -- 172.21.15.63:0/3976637435 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8800119d0 con 0x7ff89005f110 2020-05-18T21:35:58.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff8950bd700 1 -- 172.21.15.63:0/3976637435 shutdown_connections 2020-05-18T21:35:58.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff8950bd700 1 --2- 172.21.15.63:0/3976637435 >> v2:172.21.15.155:3300/0 conn(0x7ff8900659d0 0x7ff890146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:35:58.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff8950bd700 1 --2- 172.21.15.63:0/3976637435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff89005f110 0x7ff8900acea0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:58.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff8950bd700 1 -- 172.21.15.63:0/3976637435 >> 172.21.15.63:0/3976637435 conn(0x7ff890069fc0 msgr2=0x7ff89006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:58.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff8950bd700 1 -- 172.21.15.63:0/3976637435 shutdown_connections 2020-05-18T21:35:58.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.378+0000 7ff8950bd700 1 -- 172.21.15.63:0/3976637435 wait complete. 2020-05-18T21:35:58.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.382+0000 7ff8950bd700 1 Processor -- start 2020-05-18T21:35:58.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.382+0000 7ff8950bd700 1 -- start start 2020-05-18T21:35:58.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.382+0000 7ff8950bd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff8900659d0 0x7ff89013c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:58.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.382+0000 7ff8950bd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff890141910 con 0x7ff89005f110 2020-05-18T21:35:58.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.382+0000 7ff8950bd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89013ec00 con 0x7ff890146c80 2020-05-18T21:35:58.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.382+0000 7ff8950bd700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89013b190 con 0x7ff8900659d0 2020-05-18T21:35:58.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.382+0000 7ff88ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff89005f110 0x7ff890140110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36946/0 (socket says 172.21.15.63:36946) 2020-05-18T21:35:58.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.382+0000 7ff88ffff700 1 -- 172.21.15.63:0/89244697 learned_addr learned my addr 172.21.15.63:0/89244697 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:35:58.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff887fff700 1 --2- 172.21.15.63:0/89244697 >> v2:172.21.15.155:3300/0 conn(0x7ff8900659d0 0x7ff89013c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:58.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff88dffb700 1 -- 172.21.15.63:0/89244697 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1480076104 0 0) 0x7ff890141910 con 0x7ff89005f110 2020-05-18T21:35:58.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff88dffb700 1 -- 172.21.15.63:0/89244697 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff874002fe0 con 0x7ff89005f110 2020-05-18T21:35:58.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff887fff700 1 -- 172.21.15.63:0/89244697 >> v1:172.21.15.155:6789/0 conn(0x7ff890146c80 legacy=0x7ff890140820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:58.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff88dffb700 1 -- 172.21.15.63:0/89244697 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836495534 0 0) 0x7ff89013ec00 con 0x7ff890146c80 2020-05-18T21:35:58.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff887fff700 1 -- 172.21.15.63:0/89244697 >> v1:172.21.15.63:6789/0 conn(0x7ff89005f110 legacy=0x7ff890140110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:58.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff887fff700 1 -- 172.21.15.63:0/89244697 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89013b430 con 0x7ff8900659d0 2020-05-18T21:35:58.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff887fff700 1 --2- 172.21.15.63:0/89244697 >> v2:172.21.15.155:3300/0 conn(0x7ff8900659d0 0x7ff89013c2e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff8800101b0 tx=0x7ff878010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:58.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff887fff700 1 --2- 172.21.15.63:0/89244697 >> v2:172.21.15.155:3300/0 conn(0x7ff8900659d0 0x7ff89013c2e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff8800101b0 tx=0x7ff878010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:58.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff887fff700 1 --2- 172.21.15.63:0/89244697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8900659d0 0x7ff89013c2e0 secure :-1 s=READY pgs=1213 cs=0 l=1 rx=0x7ff8800101b0 tx=0x7ff878010bf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:58.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff887fff700 1 --2- 172.21.15.63:0/89244697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8900659d0 0x7ff89013c2e0 secure :-1 s=THROTTLE_DONE pgs=1213 cs=0 l=1 rx=0x7ff8800101b0 tx=0x7ff878010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:58.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff88dffb700 1 -- 172.21.15.63:0/89244697 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff878007550 con 0x7ff8900659d0 2020-05-18T21:35:58.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff887fff700 1 --2- 172.21.15.63:0/89244697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8900659d0 0x7ff89013c2e0 secure :-1 s=THROTTLE_DONE pgs=1213 cs=0 l=1 rx=0x7ff8800101b0 tx=0x7ff878010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:58.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff88dffb700 1 -- 172.21.15.63:0/89244697 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff878005700 con 0x7ff8900659d0 2020-05-18T21:35:58.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff8950bd700 1 -- 172.21.15.63:0/89244697 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89013d910 con 0x7ff8900659d0 2020-05-18T21:35:58.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff887fff700 1 --2- 172.21.15.63:0/89244697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8900659d0 0x7ff89013c2e0 secure :-1 s=THROTTLE_DONE pgs=1213 cs=0 l=1 rx=0x7ff8800101b0 tx=0x7ff878010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:58.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff88dffb700 1 -- 172.21.15.63:0/89244697 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff878005a60 con 0x7ff8900659d0 2020-05-18T21:35:58.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff8950bd700 1 -- 172.21.15.63:0/89244697 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89013e8a0 con 0x7ff8900659d0 2020-05-18T21:35:58.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff887fff700 1 --2- 172.21.15.63:0/89244697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8900659d0 0x7ff89013c2e0 secure :-1 s=THROTTLE_DONE pgs=1213 cs=0 l=1 rx=0x7ff8800101b0 tx=0x7ff878010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:58.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.386+0000 7ff8950bd700 1 -- 172.21.15.63:0/89244697 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8900569e0 con 0x7ff8900659d0 2020-05-18T21:35:58.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.390+0000 7ff88dffb700 1 -- 172.21.15.63:0/89244697 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff878005c60 con 0x7ff8900659d0 2020-05-18T21:35:58.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.390+0000 7ff887fff700 1 --2- 172.21.15.63:0/89244697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8900659d0 0x7ff89013c2e0 secure :-1 s=THROTTLE_DONE pgs=1213 cs=0 l=1 rx=0x7ff8800101b0 tx=0x7ff878010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:58.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.390+0000 7ff88dffb700 1 --2- 172.21.15.63:0/89244697 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff87404fca0 0x7ff874052160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:35:58.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.390+0000 7ff88dffb700 1 -- 172.21.15.63:0/89244697 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff878063cc0 con 0x7ff8900659d0 2020-05-18T21:35:58.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.390+0000 7ff88ffff700 1 --2- 172.21.15.63:0/89244697 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff87404fca0 0x7ff874052160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:35:58.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.390+0000 7ff88ffff700 1 --2- 172.21.15.63:0/89244697 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff87404fca0 0x7ff874052160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff880008920 tx=0x7ff880007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:58.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.390+0000 7ff88ffff700 1 --2- 172.21.15.63:0/89244697 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff87404fca0 0x7ff874052160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff880008920 tx=0x7ff880007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:58.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.390+0000 7ff88ffff700 1 --2- 172.21.15.63:0/89244697 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff87404fca0 0x7ff874052160 secure :-1 s=READY pgs=711 cs=0 l=1 rx=0x7ff880008920 tx=0x7ff880007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:35:58.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.398+0000 7ff887fff700 1 --2- 172.21.15.63:0/89244697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8900659d0 0x7ff89013c2e0 secure :-1 s=THROTTLE_DONE pgs=1213 cs=0 l=1 rx=0x7ff8800101b0 tx=0x7ff878010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:58.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.398+0000 7ff88dffb700 1 -- 172.21.15.63:0/89244697 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff87803dff0 con 0x7ff8900659d0 2020-05-18T21:35:58.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.550+0000 7ff8950bd700 1 -- 172.21.15.63:0/89244697 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff890063700 con 0x7ff8900659d0 2020-05-18T21:35:58.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.550+0000 7ff887fff700 1 --2- 172.21.15.63:0/89244697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8900659d0 0x7ff89013c2e0 secure :-1 s=THROTTLE_DONE pgs=1213 cs=0 l=1 rx=0x7ff8800101b0 tx=0x7ff878010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:35:58.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.550+0000 7ff88dffb700 1 -- 172.21.15.63:0/89244697 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+2163 (secure 0 0 0) 0x7ff878041610 con 0x7ff8900659d0 2020-05-18T21:35:58.556 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:35:58.556 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":104,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:35:58.255654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":9501,"mds_1":9136},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9136":{"gid":9136,"name":"b","rank":1,"incarnation":104,"state":"up:creating","state_seq":2,"addr":"172.21.15.155:6835/2822608544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2822608544},{"type":"v1","addr":"172.21.15.155:6835","nonce":2822608544}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:35:58.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.554+0000 7ff8950bd700 1 -- 172.21.15.63:0/89244697 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff87404fca0 msgr2=0x7ff874052160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:58.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.554+0000 7ff8950bd700 1 --2- 172.21.15.63:0/89244697 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff87404fca0 0x7ff874052160 secure :-1 s=READY pgs=711 cs=0 l=1 rx=0x7ff880008920 tx=0x7ff880007a80).stop 2020-05-18T21:35:58.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.554+0000 7ff8950bd700 1 -- 172.21.15.63:0/89244697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8900659d0 msgr2=0x7ff89013c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:35:58.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.554+0000 7ff8950bd700 1 --2- 172.21.15.63:0/89244697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8900659d0 0x7ff89013c2e0 secure :-1 s=READY pgs=1213 cs=0 l=1 rx=0x7ff8800101b0 tx=0x7ff878010bf0).stop 2020-05-18T21:35:58.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.554+0000 7ff8950bd700 1 -- 172.21.15.63:0/89244697 shutdown_connections 2020-05-18T21:35:58.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.554+0000 7ff8950bd700 1 --2- 172.21.15.63:0/89244697 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff87404fca0 0x7ff874052160 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:58.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.554+0000 7ff8950bd700 1 --2- 172.21.15.63:0/89244697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8900659d0 0x7ff89013c2e0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:35:58.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.554+0000 7ff8950bd700 1 -- 172.21.15.63:0/89244697 >> 172.21.15.63:0/89244697 conn(0x7ff890069fc0 msgr2=0x7ff890060690 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:35:58.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.554+0000 7ff8950bd700 1 -- 172.21.15.63:0/89244697 shutdown_connections 2020-05-18T21:35:58.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:35:58.554+0000 7ff8950bd700 1 -- 172.21.15.63:0/89244697 wait complete. 2020-05-18T21:35:58.560 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 104 2020-05-18T21:35:58.569 DEBUG:tasks.ceph_test_case:wait_until_equal: 1 != 2, waiting (timeout=30)... 2020-05-18T21:36:00.193 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:36:00.196 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:36:03.570 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:36:03.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.678+0000 7f484ca53700 1 Processor -- start 2020-05-18T21:36:03.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.678+0000 7f484ca53700 1 -- start start 2020-05-18T21:36:03.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f484ca53700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4848060b90 0x7f48480615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:03.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f484ca53700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f48480b2860 0x7f484814e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:03.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f484ca53700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484814d960 con 0x7f4848144090 2020-05-18T21:36:03.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f484ca53700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4848066210 con 0x7f4848060b90 2020-05-18T21:36:03.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f484ca53700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484814db90 con 0x7f48480b2860 2020-05-18T21:36:03.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f4846d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4848144090 0x7f484814a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36960/0 (socket says 172.21.15.63:36960) 2020-05-18T21:36:03.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f4846d9d700 1 -- 172.21.15.63:0/1032443727 learned_addr learned my addr 172.21.15.63:0/1032443727 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:03.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f484659c700 1 --2- 172.21.15.63:0/1032443727 >> v2:172.21.15.63:3300/0 conn(0x7f4848060b90 0x7f48480615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:03.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f4845d9b700 1 --2- 172.21.15.63:0/1032443727 >> v2:172.21.15.155:3300/0 conn(0x7f48480b2860 0x7f484814e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:03.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f484559a700 1 -- 172.21.15.63:0/1032443727 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464789586 0 0) 0x7f484814d960 con 0x7f4848144090 2020-05-18T21:36:03.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f484559a700 1 -- 172.21.15.63:0/1032443727 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4828003270 con 0x7f4848144090 2020-05-18T21:36:03.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f4845d9b700 1 -- 172.21.15.63:0/1032443727 >> v2:172.21.15.63:3300/0 conn(0x7f4848060b90 msgr2=0x7f48480615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:03.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f4845d9b700 1 --2- 172.21.15.63:0/1032443727 >> v2:172.21.15.63:3300/0 conn(0x7f4848060b90 0x7f48480615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:03.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f4845d9b700 1 -- 172.21.15.63:0/1032443727 >> v1:172.21.15.63:6789/0 conn(0x7f4848144090 legacy=0x7f484814a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:03.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f4845d9b700 1 -- 172.21.15.63:0/1032443727 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484814de30 con 0x7f48480b2860 2020-05-18T21:36:03.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f4845d9b700 1 --2- 172.21.15.63:0/1032443727 >> v2:172.21.15.155:3300/0 conn(0x7f48480b2860 0x7f484814e570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4830002f70 tx=0x7f4830007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f4845d9b700 1 --2- 172.21.15.63:0/1032443727 >> v2:172.21.15.155:3300/0 conn(0x7f48480b2860 0x7f484814e570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4830002f70 tx=0x7f4830007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f4845d9b700 1 --2- 172.21.15.63:0/1032443727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48480b2860 0x7f484814e570 secure :-1 s=READY pgs=1214 cs=0 l=1 rx=0x7f4830002f70 tx=0x7f4830007a80).ready entity=mon.1 client_cookie=3e71f5a5dda5b756 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:03.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f4845d9b700 1 --2- 172.21.15.63:0/1032443727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48480b2860 0x7f484814e570 secure :-1 s=THROTTLE_DONE pgs=1214 cs=0 l=1 rx=0x7f4830002f70 tx=0x7f4830007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f484559a700 1 -- 172.21.15.63:0/1032443727 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4830008e50 con 0x7f48480b2860 2020-05-18T21:36:03.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f4845d9b700 1 --2- 172.21.15.63:0/1032443727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48480b2860 0x7f484814e570 secure :-1 s=THROTTLE_DONE pgs=1214 cs=0 l=1 rx=0x7f4830002f70 tx=0x7f4830007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f484559a700 1 -- 172.21.15.63:0/1032443727 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4830011540 con 0x7f48480b2860 2020-05-18T21:36:03.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f4845d9b700 1 --2- 172.21.15.63:0/1032443727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48480b2860 0x7f484814e570 secure :-1 s=THROTTLE_DONE pgs=1214 cs=0 l=1 rx=0x7f4830002f70 tx=0x7f4830007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f484559a700 1 -- 172.21.15.63:0/1032443727 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4830011960 con 0x7f48480b2860 2020-05-18T21:36:03.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f484ca53700 1 -- 172.21.15.63:0/1032443727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48480b2860 msgr2=0x7f484814e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:03.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f484ca53700 1 --2- 172.21.15.63:0/1032443727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48480b2860 0x7f484814e570 secure :-1 s=READY pgs=1214 cs=0 l=1 rx=0x7f4830002f70 tx=0x7f4830007a80).stop 2020-05-18T21:36:03.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f484ca53700 1 -- 172.21.15.63:0/1032443727 shutdown_connections 2020-05-18T21:36:03.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f484ca53700 1 --2- 172.21.15.63:0/1032443727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48480b2860 0x7f484814e570 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:03.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f484ca53700 1 --2- 172.21.15.63:0/1032443727 >> v2:172.21.15.63:3300/0 conn(0x7f4848060b90 0x7f48480615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:03.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f484ca53700 1 -- 172.21.15.63:0/1032443727 >> 172.21.15.63:0/1032443727 conn(0x7f48480b83d0 msgr2=0x7f48480b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:03.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f484ca53700 1 -- 172.21.15.63:0/1032443727 shutdown_connections 2020-05-18T21:36:03.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.682+0000 7f484ca53700 1 -- 172.21.15.63:0/1032443727 wait complete. 2020-05-18T21:36:03.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f484ca53700 1 Processor -- start 2020-05-18T21:36:03.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f484ca53700 1 -- start start 2020-05-18T21:36:03.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f484ca53700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f48480b2860 0x7f48480b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:03.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f484ca53700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4848144090 0x7f48480b6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:03.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f484ca53700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4848144560 con 0x7f4848060b90 2020-05-18T21:36:03.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f484ca53700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4848144800 con 0x7f48480b2860 2020-05-18T21:36:03.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f484ca53700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4848144aa0 con 0x7f4848144090 2020-05-18T21:36:03.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f4845d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f48480b2860 0x7f48480b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:03.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f4845d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f48480b2860 0x7f48480b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34776/0 (socket says 172.21.15.63:34776) 2020-05-18T21:36:03.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f4845d9b700 1 -- 172.21.15.63:0/975911048 learned_addr learned my addr 172.21.15.63:0/975911048 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:36:03.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f4846d9d700 1 --2- 172.21.15.63:0/975911048 >> v2:172.21.15.155:3300/0 conn(0x7f4848144090 0x7f48480b6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:03.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f4845d9b700 1 -- 172.21.15.63:0/975911048 >> v2:172.21.15.155:3300/0 conn(0x7f4848144090 msgr2=0x7f48480b6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:03.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f4845d9b700 1 --2- 172.21.15.63:0/975911048 >> v2:172.21.15.155:3300/0 conn(0x7f4848144090 0x7f48480b6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:03.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f4845d9b700 1 -- 172.21.15.63:0/975911048 >> v1:172.21.15.155:6789/0 conn(0x7f4848060b90 legacy=0x7f4848157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:03.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f4845d9b700 1 -- 172.21.15.63:0/975911048 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4848157e40 con 0x7f48480b2860 2020-05-18T21:36:03.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f4845d9b700 1 --2- 172.21.15.63:0/975911048 >> v2:172.21.15.63:3300/0 conn(0x7f48480b2860 0x7f48480b1710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4830002f70 tx=0x7f4830007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f4845d9b700 1 --2- 172.21.15.63:0/975911048 >> v2:172.21.15.63:3300/0 conn(0x7f48480b2860 0x7f48480b1710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4830002f70 tx=0x7f4830007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f4845d9b700 1 --2- 172.21.15.63:0/975911048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48480b2860 0x7f48480b1710 secure :-1 s=READY pgs=1829 cs=0 l=1 rx=0x7f4830002f70 tx=0x7f4830007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:03.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f4845d9b700 1 --2- 172.21.15.63:0/975911048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48480b2860 0x7f48480b1710 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7f4830002f70 tx=0x7f4830007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f483f7fe700 1 -- 172.21.15.63:0/975911048 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4830011a00 con 0x7f48480b2860 2020-05-18T21:36:03.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f4845d9b700 1 --2- 172.21.15.63:0/975911048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48480b2860 0x7f48480b1710 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7f4830002f70 tx=0x7f4830007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f4845d9b700 1 --2- 172.21.15.63:0/975911048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48480b2860 0x7f48480b1710 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7f4830002f70 tx=0x7f4830007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f483f7fe700 1 -- 172.21.15.63:0/975911048 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4830007170 con 0x7f48480b2860 2020-05-18T21:36:03.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f483f7fe700 1 -- 172.21.15.63:0/975911048 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4830007510 con 0x7f48480b2860 2020-05-18T21:36:03.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f484ca53700 1 -- 172.21.15.63:0/975911048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484815b670 con 0x7f48480b2860 2020-05-18T21:36:03.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.686+0000 7f484ca53700 1 -- 172.21.15.63:0/975911048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484815bb70 con 0x7f48480b2860 2020-05-18T21:36:03.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.690+0000 7f4845d9b700 1 --2- 172.21.15.63:0/975911048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48480b2860 0x7f48480b1710 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7f4830002f70 tx=0x7f4830007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.690+0000 7f484ca53700 1 -- 172.21.15.63:0/975911048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48480569e0 con 0x7f48480b2860 2020-05-18T21:36:03.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.690+0000 7f483f7fe700 1 -- 172.21.15.63:0/975911048 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4830005700 con 0x7f48480b2860 2020-05-18T21:36:03.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.690+0000 7f4845d9b700 1 --2- 172.21.15.63:0/975911048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48480b2860 0x7f48480b1710 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7f4830002f70 tx=0x7f4830007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.690+0000 7f483f7fe700 1 --2- 172.21.15.63:0/975911048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f482c04f960 0x7f482c051e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:03.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.690+0000 7f483f7fe700 1 -- 172.21.15.63:0/975911048 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f48300645e0 con 0x7f48480b2860 2020-05-18T21:36:03.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.690+0000 7f484659c700 1 --2- 172.21.15.63:0/975911048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f482c04f960 0x7f482c051e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:03.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.690+0000 7f484659c700 1 --2- 172.21.15.63:0/975911048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f482c04f960 0x7f482c051e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f48480b0f90 tx=0x7f4838007740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.690+0000 7f484659c700 1 --2- 172.21.15.63:0/975911048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f482c04f960 0x7f482c051e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f48480b0f90 tx=0x7f4838007740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.690+0000 7f484659c700 1 --2- 172.21.15.63:0/975911048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f482c04f960 0x7f482c051e20 secure :-1 s=READY pgs=712 cs=0 l=1 rx=0x7f48480b0f90 tx=0x7f4838007740).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:03.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.698+0000 7f4845d9b700 1 --2- 172.21.15.63:0/975911048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48480b2860 0x7f48480b1710 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7f4830002f70 tx=0x7f4830007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.698+0000 7f483f7fe700 1 -- 172.21.15.63:0/975911048 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f483003e9d0 con 0x7f48480b2860 2020-05-18T21:36:03.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.842+0000 7f484ca53700 1 -- 172.21.15.63:0/975911048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4848144c10 con 0x7f48480b2860 2020-05-18T21:36:03.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.842+0000 7f4845d9b700 1 --2- 172.21.15.63:0/975911048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48480b2860 0x7f48480b1710 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7f4830002f70 tx=0x7f4830007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.842+0000 7f483f7fe700 1 -- 172.21.15.63:0/975911048 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+2161 (secure 0 0 0) 0x7f4830041ff0 con 0x7f48480b2860 2020-05-18T21:36:03.849 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:03.849 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":105,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:35:59.258784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":9501,"mds_1":9136},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9136":{"gid":9136,"name":"b","rank":1,"incarnation":104,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/2822608544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2822608544},{"type":"v1","addr":"172.21.15.155:6835","nonce":2822608544}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:36:03.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.846+0000 7f484ca53700 1 -- 172.21.15.63:0/975911048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f482c04f960 msgr2=0x7f482c051e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:03.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.846+0000 7f484ca53700 1 --2- 172.21.15.63:0/975911048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f482c04f960 0x7f482c051e20 secure :-1 s=READY pgs=712 cs=0 l=1 rx=0x7f48480b0f90 tx=0x7f4838007740).stop 2020-05-18T21:36:03.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.846+0000 7f484ca53700 1 -- 172.21.15.63:0/975911048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48480b2860 msgr2=0x7f48480b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:03.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.846+0000 7f484ca53700 1 --2- 172.21.15.63:0/975911048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48480b2860 0x7f48480b1710 secure :-1 s=READY pgs=1829 cs=0 l=1 rx=0x7f4830002f70 tx=0x7f4830007a80).stop 2020-05-18T21:36:03.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.846+0000 7f484ca53700 1 -- 172.21.15.63:0/975911048 shutdown_connections 2020-05-18T21:36:03.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.846+0000 7f484ca53700 1 --2- 172.21.15.63:0/975911048 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f482c04f960 0x7f482c051e20 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:03.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.846+0000 7f484ca53700 1 --2- 172.21.15.63:0/975911048 >> v2:172.21.15.155:3300/0 conn(0x7f4848144090 0x7f48480b6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:03.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.846+0000 7f484ca53700 1 --2- 172.21.15.63:0/975911048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48480b2860 0x7f48480b1710 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:03.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.846+0000 7f484ca53700 1 -- 172.21.15.63:0/975911048 >> 172.21.15.63:0/975911048 conn(0x7f48480b83d0 msgr2=0x7f48480b5330 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:03.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.846+0000 7f484ca53700 1 -- 172.21.15.63:0/975911048 shutdown_connections 2020-05-18T21:36:03.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.846+0000 7f484ca53700 1 -- 172.21.15.63:0/975911048 wait complete. 2020-05-18T21:36:03.853 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 105 2020-05-18T21:36:03.862 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:36:03.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.954+0000 7fca9cf79700 1 Processor -- start 2020-05-18T21:36:03.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.954+0000 7fca9cf79700 1 -- start start 2020-05-18T21:36:03.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.954+0000 7fca9cf79700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fca9805f110 0x7fca980b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:03.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.954+0000 7fca9cf79700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca9814aa70 0x7fca980648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:03.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.954+0000 7fca9cf79700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9814a330 con 0x7fca98064d20 2020-05-18T21:36:03.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.954+0000 7fca9cf79700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9814a140 con 0x7fca9805f110 2020-05-18T21:36:03.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.954+0000 7fca9cf79700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9814a5d0 con 0x7fca9814aa70 2020-05-18T21:36:03.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.954+0000 7fca977fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fca9805f110 0x7fca980b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:03.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.954+0000 7fca977fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fca9805f110 0x7fca980b4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34782/0 (socket says 172.21.15.63:34782) 2020-05-18T21:36:03.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.954+0000 7fca977fe700 1 -- 172.21.15.63:0/1100235612 learned_addr learned my addr 172.21.15.63:0/1100235612 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:36:03.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.954+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1100235612 >> v2:172.21.15.155:3300/0 conn(0x7fca9814aa70 0x7fca980648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:03.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca96ffd700 1 -- 172.21.15.63:0/1100235612 >> v2:172.21.15.63:3300/0 conn(0x7fca9805f110 msgr2=0x7fca980b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:03.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1100235612 >> v2:172.21.15.63:3300/0 conn(0x7fca9805f110 0x7fca980b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:03.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca96ffd700 1 -- 172.21.15.63:0/1100235612 >> v1:172.21.15.155:6789/0 conn(0x7fca98064d20 legacy=0x7fca9814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:03.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca96ffd700 1 -- 172.21.15.63:0/1100235612 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca98063430 con 0x7fca9814aa70 2020-05-18T21:36:03.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca977fe700 1 --2- 172.21.15.63:0/1100235612 >> v2:172.21.15.63:3300/0 conn(0x7fca9805f110 0x7fca980b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:36:03.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1100235612 >> v2:172.21.15.155:3300/0 conn(0x7fca9814aa70 0x7fca980648c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fca8c002f70 tx=0x7fca8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1100235612 >> v2:172.21.15.155:3300/0 conn(0x7fca9814aa70 0x7fca980648c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fca8c002f70 tx=0x7fca8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1100235612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca9814aa70 0x7fca980648c0 secure :-1 s=READY pgs=1217 cs=0 l=1 rx=0x7fca8c002f70 tx=0x7fca8c007a80).ready entity=mon.1 client_cookie=e86e945f45e74103 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:03.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1100235612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca9814aa70 0x7fca980648c0 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7fca8c002f70 tx=0x7fca8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca967fc700 1 -- 172.21.15.63:0/1100235612 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca8c008e50 con 0x7fca9814aa70 2020-05-18T21:36:03.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1100235612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca9814aa70 0x7fca980648c0 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7fca8c002f70 tx=0x7fca8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca967fc700 1 -- 172.21.15.63:0/1100235612 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c0115f0 con 0x7fca9814aa70 2020-05-18T21:36:03.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1100235612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca9814aa70 0x7fca980648c0 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7fca8c002f70 tx=0x7fca8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca967fc700 1 -- 172.21.15.63:0/1100235612 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca8c011a10 con 0x7fca9814aa70 2020-05-18T21:36:03.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca9cf79700 1 -- 172.21.15.63:0/1100235612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca9814aa70 msgr2=0x7fca980648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:03.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca9cf79700 1 --2- 172.21.15.63:0/1100235612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca9814aa70 0x7fca980648c0 secure :-1 s=READY pgs=1217 cs=0 l=1 rx=0x7fca8c002f70 tx=0x7fca8c007a80).stop 2020-05-18T21:36:03.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca9cf79700 1 -- 172.21.15.63:0/1100235612 shutdown_connections 2020-05-18T21:36:03.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca9cf79700 1 --2- 172.21.15.63:0/1100235612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca9814aa70 0x7fca980648c0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:03.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca9cf79700 1 --2- 172.21.15.63:0/1100235612 >> v2:172.21.15.63:3300/0 conn(0x7fca9805f110 0x7fca980b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:03.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca9cf79700 1 -- 172.21.15.63:0/1100235612 >> 172.21.15.63:0/1100235612 conn(0x7fca98069fc0 msgr2=0x7fca9806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:03.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca9cf79700 1 -- 172.21.15.63:0/1100235612 shutdown_connections 2020-05-18T21:36:03.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.958+0000 7fca9cf79700 1 -- 172.21.15.63:0/1100235612 wait complete. 2020-05-18T21:36:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca9cf79700 1 Processor -- start 2020-05-18T21:36:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca9cf79700 1 -- start start 2020-05-18T21:36:03.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca9cf79700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fca98064d20 0x7fca981424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:03.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca9cf79700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca9814aa70 0x7fca98146410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:03.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca9cf79700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca98147640 con 0x7fca9805f110 2020-05-18T21:36:03.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca9cf79700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca981429a0 con 0x7fca98064d20 2020-05-18T21:36:03.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca9cf79700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9814ce40 con 0x7fca9814aa70 2020-05-18T21:36:03.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca977fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fca9805f110 0x7fca981331f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36976/0 (socket says 172.21.15.63:36976) 2020-05-18T21:36:03.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca977fe700 1 -- 172.21.15.63:0/1110753837 learned_addr learned my addr 172.21.15.63:0/1110753837 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:03.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1110753837 >> v2:172.21.15.63:3300/0 conn(0x7fca98064d20 0x7fca981424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:03.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca97fff700 1 --2- 172.21.15.63:0/1110753837 >> v2:172.21.15.155:3300/0 conn(0x7fca9814aa70 0x7fca98146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:03.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca94ff9700 1 -- 172.21.15.63:0/1110753837 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 851341835 0 0) 0x7fca98147640 con 0x7fca9805f110 2020-05-18T21:36:03.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca94ff9700 1 -- 172.21.15.63:0/1110753837 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca78002fe0 con 0x7fca9805f110 2020-05-18T21:36:03.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca96ffd700 1 -- 172.21.15.63:0/1110753837 >> v2:172.21.15.155:3300/0 conn(0x7fca9814aa70 msgr2=0x7fca98146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:03.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1110753837 >> v2:172.21.15.155:3300/0 conn(0x7fca9814aa70 0x7fca98146410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:03.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca96ffd700 1 -- 172.21.15.63:0/1110753837 >> v1:172.21.15.63:6789/0 conn(0x7fca9805f110 legacy=0x7fca981331f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:03.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca96ffd700 1 -- 172.21.15.63:0/1110753837 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca98145cd0 con 0x7fca98064d20 2020-05-18T21:36:03.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca97fff700 1 --2- 172.21.15.63:0/1110753837 >> v2:172.21.15.155:3300/0 conn(0x7fca9814aa70 0x7fca98146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:36:03.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1110753837 >> v2:172.21.15.63:3300/0 conn(0x7fca98064d20 0x7fca981424b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca8c002f70 tx=0x7fca8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1110753837 >> v2:172.21.15.63:3300/0 conn(0x7fca98064d20 0x7fca981424b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca8c002f70 tx=0x7fca8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1110753837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca98064d20 0x7fca981424b0 secure :-1 s=READY pgs=1831 cs=0 l=1 rx=0x7fca8c002f70 tx=0x7fca8c007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:03.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1110753837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca98064d20 0x7fca981424b0 secure :-1 s=THROTTLE_DONE pgs=1831 cs=0 l=1 rx=0x7fca8c002f70 tx=0x7fca8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca94ff9700 1 -- 172.21.15.63:0/1110753837 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca8c00f860 con 0x7fca98064d20 2020-05-18T21:36:03.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1110753837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca98064d20 0x7fca981424b0 secure :-1 s=THROTTLE_DONE pgs=1831 cs=0 l=1 rx=0x7fca8c002f70 tx=0x7fca8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1110753837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca98064d20 0x7fca981424b0 secure :-1 s=THROTTLE_DONE pgs=1831 cs=0 l=1 rx=0x7fca8c002f70 tx=0x7fca8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca94ff9700 1 -- 172.21.15.63:0/1110753837 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c007360 con 0x7fca98064d20 2020-05-18T21:36:03.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca9cf79700 1 -- 172.21.15.63:0/1110753837 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca98145f70 con 0x7fca98064d20 2020-05-18T21:36:03.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.962+0000 7fca94ff9700 1 -- 172.21.15.63:0/1110753837 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca8c005700 con 0x7fca98064d20 2020-05-18T21:36:03.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.966+0000 7fca9cf79700 1 -- 172.21.15.63:0/1110753837 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca98133980 con 0x7fca98064d20 2020-05-18T21:36:03.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.966+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1110753837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca98064d20 0x7fca981424b0 secure :-1 s=THROTTLE_DONE pgs=1831 cs=0 l=1 rx=0x7fca8c002f70 tx=0x7fca8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.966+0000 7fca94ff9700 1 -- 172.21.15.63:0/1110753837 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fca8c005970 con 0x7fca98064d20 2020-05-18T21:36:03.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.966+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1110753837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca98064d20 0x7fca981424b0 secure :-1 s=THROTTLE_DONE pgs=1831 cs=0 l=1 rx=0x7fca8c002f70 tx=0x7fca8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.966+0000 7fca9cf79700 1 -- 172.21.15.63:0/1110753837 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca98146130 con 0x7fca98064d20 2020-05-18T21:36:03.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.966+0000 7fca94ff9700 1 --2- 172.21.15.63:0/1110753837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca7804fdb0 0x7fca78052270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:03.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.966+0000 7fca94ff9700 1 -- 172.21.15.63:0/1110753837 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fca8c063ff0 con 0x7fca98064d20 2020-05-18T21:36:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.966+0000 7fca977fe700 1 --2- 172.21.15.63:0/1110753837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca7804fdb0 0x7fca78052270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.966+0000 7fca977fe700 1 --2- 172.21.15.63:0/1110753837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca7804fdb0 0x7fca78052270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca88002f70 tx=0x7fca880093f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.966+0000 7fca977fe700 1 --2- 172.21.15.63:0/1110753837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca7804fdb0 0x7fca78052270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca88002f70 tx=0x7fca880093f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.966+0000 7fca977fe700 1 --2- 172.21.15.63:0/1110753837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca7804fdb0 0x7fca78052270 secure :-1 s=READY pgs=713 cs=0 l=1 rx=0x7fca88002f70 tx=0x7fca880093f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:03.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.974+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1110753837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca98064d20 0x7fca981424b0 secure :-1 s=THROTTLE_DONE pgs=1831 cs=0 l=1 rx=0x7fca8c002f70 tx=0x7fca8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:03.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:03.974+0000 7fca94ff9700 1 -- 172.21.15.63:0/1110753837 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fca8c03e4a0 con 0x7fca98064d20 2020-05-18T21:36:04.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.122+0000 7fca9cf79700 1 -- 172.21.15.63:0/1110753837 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca980569e0 con 0x7fca98064d20 2020-05-18T21:36:04.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.122+0000 7fca96ffd700 1 --2- 172.21.15.63:0/1110753837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca98064d20 0x7fca981424b0 secure :-1 s=THROTTLE_DONE pgs=1831 cs=0 l=1 rx=0x7fca8c002f70 tx=0x7fca8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.122+0000 7fca94ff9700 1 -- 172.21.15.63:0/1110753837 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+2161 (secure 0 0 0) 0x7fca8c041ac0 con 0x7fca98064d20 2020-05-18T21:36:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.122+0000 7fca9cf79700 1 -- 172.21.15.63:0/1110753837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca7804fdb0 msgr2=0x7fca78052270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.122+0000 7fca9cf79700 1 --2- 172.21.15.63:0/1110753837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca7804fdb0 0x7fca78052270 secure :-1 s=READY pgs=713 cs=0 l=1 rx=0x7fca88002f70 tx=0x7fca880093f0).stop 2020-05-18T21:36:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.122+0000 7fca9cf79700 1 -- 172.21.15.63:0/1110753837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca98064d20 msgr2=0x7fca981424b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:04.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.122+0000 7fca9cf79700 1 --2- 172.21.15.63:0/1110753837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca98064d20 0x7fca981424b0 secure :-1 s=READY pgs=1831 cs=0 l=1 rx=0x7fca8c002f70 tx=0x7fca8c007a80).stop 2020-05-18T21:36:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.122+0000 7fca9cf79700 1 -- 172.21.15.63:0/1110753837 shutdown_connections 2020-05-18T21:36:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.122+0000 7fca9cf79700 1 --2- 172.21.15.63:0/1110753837 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fca7804fdb0 0x7fca78052270 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.122+0000 7fca9cf79700 1 --2- 172.21.15.63:0/1110753837 >> v2:172.21.15.155:3300/0 conn(0x7fca9814aa70 0x7fca98146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.122+0000 7fca9cf79700 1 --2- 172.21.15.63:0/1110753837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca98064d20 0x7fca981424b0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:04.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.122+0000 7fca9cf79700 1 -- 172.21.15.63:0/1110753837 >> 172.21.15.63:0/1110753837 conn(0x7fca98069fc0 msgr2=0x7fca9806a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:04.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.122+0000 7fca9cf79700 1 -- 172.21.15.63:0/1110753837 shutdown_connections 2020-05-18T21:36:04.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.122+0000 7fca9cf79700 1 -- 172.21.15.63:0/1110753837 wait complete. 2020-05-18T21:36:04.140 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 105 2020-05-18T21:36:04.140 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.140 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":105,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:35:59.258784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":9501,"mds_1":9136},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9136":{"gid":9136,"name":"b","rank":1,"incarnation":104,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/2822608544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2822608544},{"type":"v1","addr":"172.21.15.155:6835","nonce":2822608544}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:36:04.143 INFO:tasks.cephfs.test_strays:Ranks 0 and 1 are a and b 2020-05-18T21:36:04.145 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:36:04.147 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:36:04.175 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2020-05-18T21:36:04.175 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2020-05-18T21:36:04.176 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:36:04.176 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2020-05-18T21:36:04.176 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.176 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2020-05-18T21:36:04.176 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.177 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2020-05-18T21:36:04.177 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.177 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2020-05-18T21:36:04.177 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2020-05-18T21:36:04.177 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.178 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2020-05-18T21:36:04.178 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2020-05-18T21:36:04.178 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.178 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:36:04.178 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2020-05-18T21:36:04.179 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.179 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:36:04.179 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:36:04.179 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.179 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2020-05-18T21:36:04.179 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.180 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2020-05-18T21:36:04.180 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2020-05-18T21:36:04.180 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:36:04.180 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:36:04.180 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2020-05-18T21:36:04.181 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:36:04.181 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2020-05-18T21:36:04.181 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:36:04.181 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:36:04.181 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2020-05-18T21:36:04.181 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.182 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:36:04.182 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.182 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2020-05-18T21:36:04.182 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.182 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2020-05-18T21:36:04.183 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.183 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2020-05-18T21:36:04.183 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2020-05-18T21:36:04.183 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:36:04.183 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:36:04.183 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.184 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2020-05-18T21:36:04.184 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2020-05-18T21:36:04.184 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.184 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2020-05-18T21:36:04.184 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2020-05-18T21:36:04.185 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.185 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2020-05-18T21:36:04.185 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2020-05-18T21:36:04.185 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.185 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2020-05-18T21:36:04.185 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2020-05-18T21:36:04.186 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2020-05-18T21:36:04.186 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.186 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2020-05-18T21:36:04.186 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2020-05-18T21:36:04.186 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.186 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:36:04.187 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.187 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2020-05-18T21:36:04.187 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.187 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2020-05-18T21:36:04.187 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.188 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:36:04.188 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2020-05-18T21:36:04.188 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.188 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2020-05-18T21:36:04.188 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2020-05-18T21:36:04.189 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2020-05-18T21:36:04.189 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2020-05-18T21:36:04.189 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2020-05-18T21:36:04.189 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2020-05-18T21:36:04.189 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2020-05-18T21:36:04.190 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2020-05-18T21:36:04.190 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2020-05-18T21:36:04.190 INFO:teuthology.orchestra.run.smithi063.stdout: debug filestore = 20 2020-05-18T21:36:04.190 INFO:teuthology.orchestra.run.smithi063.stdout: debug journal = 20 2020-05-18T21:36:04.190 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 20 2020-05-18T21:36:04.191 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 25 2020-05-18T21:36:04.191 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2020-05-18T21:36:04.191 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:36:04.191 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2020-05-18T21:36:04.191 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:36:04.191 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:36:04.192 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2020-05-18T21:36:04.192 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:36:04.192 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.192 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2020-05-18T21:36:04.192 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:36:04.192 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2020-05-18T21:36:04.193 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:36:04.193 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:36:04.193 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:36:04.193 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:36:04.193 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2020-05-18T21:36:04.194 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.194 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2020-05-18T21:36:04.194 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:36:04.194 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:36:04.194 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2020-05-18T21:36:04.194 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:36:04.195 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2020-05-18T21:36:04.195 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2020-05-18T21:36:04.195 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:36:04.195 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2020-05-18T21:36:04.195 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2020-05-18T21:36:04.196 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:36:04.196 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2020-05-18T21:36:04.196 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:04.196 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2020-05-18T21:36:04.196 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2020-05-18T21:36:04.196 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2020-05-18T21:36:04.197 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2020-05-18T21:36:04.197 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:36:04.197 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:36:04.197 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2020-05-18T21:36:04.197 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2020-05-18T21:36:04.198 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:36:04.198 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2020-05-18T21:36:04.198 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2020-05-18T21:36:04.198 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2020-05-18T21:36:04.198 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2020-05-18T21:36:04.198 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2020-05-18T21:36:04.199 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2020-05-18T21:36:04.199 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_files = 0 2020-05-18T21:36:04.199 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2020-05-18T21:36:04.199 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2020-05-18T21:36:04.201 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:36:04.201 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal frag = True 2020-05-18T21:36:04.201 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal fragment size max = 10000 2020-05-18T21:36:04.201 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal merge size = 5 2020-05-18T21:36:04.202 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split bits = 3 2020-05-18T21:36:04.202 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split size = 100 2020-05-18T21:36:04.202 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2020-05-18T21:36:04.202 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2020-05-18T21:36:04.202 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2020-05-18T21:36:04.203 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2020-05-18T21:36:04.203 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:36:04.204 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2020-05-18T21:36:04.204 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2020-05-18T21:36:04.204 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:36:04.205 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2020-05-18T21:36:04.205 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.205 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2020-05-18T21:36:04.205 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.205 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2020-05-18T21:36:04.206 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.206 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2020-05-18T21:36:04.206 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2020-05-18T21:36:04.206 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.206 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2020-05-18T21:36:04.207 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2020-05-18T21:36:04.207 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.207 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:36:04.207 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2020-05-18T21:36:04.207 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.207 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:36:04.208 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:36:04.208 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.208 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2020-05-18T21:36:04.208 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.208 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2020-05-18T21:36:04.208 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2020-05-18T21:36:04.209 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:36:04.209 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:36:04.209 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2020-05-18T21:36:04.209 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:36:04.209 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2020-05-18T21:36:04.210 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:36:04.210 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:36:04.210 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2020-05-18T21:36:04.210 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.211 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:36:04.211 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.211 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2020-05-18T21:36:04.211 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.211 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2020-05-18T21:36:04.211 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.212 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2020-05-18T21:36:04.212 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2020-05-18T21:36:04.212 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:36:04.212 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:36:04.212 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.212 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2020-05-18T21:36:04.213 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2020-05-18T21:36:04.213 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.213 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2020-05-18T21:36:04.213 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2020-05-18T21:36:04.214 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.214 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2020-05-18T21:36:04.214 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2020-05-18T21:36:04.214 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.214 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2020-05-18T21:36:04.214 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2020-05-18T21:36:04.215 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2020-05-18T21:36:04.215 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.215 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2020-05-18T21:36:04.215 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2020-05-18T21:36:04.215 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.216 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:36:04.216 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.216 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2020-05-18T21:36:04.216 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.216 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2020-05-18T21:36:04.216 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.217 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:36:04.217 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2020-05-18T21:36:04.217 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.217 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2020-05-18T21:36:04.217 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2020-05-18T21:36:04.218 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2020-05-18T21:36:04.218 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2020-05-18T21:36:04.218 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2020-05-18T21:36:04.218 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2020-05-18T21:36:04.218 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2020-05-18T21:36:04.218 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2020-05-18T21:36:04.219 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2020-05-18T21:36:04.219 INFO:teuthology.orchestra.run.smithi155.stdout: debug filestore = 20 2020-05-18T21:36:04.219 INFO:teuthology.orchestra.run.smithi155.stdout: debug journal = 20 2020-05-18T21:36:04.219 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 20 2020-05-18T21:36:04.219 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 25 2020-05-18T21:36:04.220 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2020-05-18T21:36:04.220 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:36:04.220 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2020-05-18T21:36:04.220 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:36:04.220 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:36:04.220 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2020-05-18T21:36:04.221 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:36:04.221 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.221 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2020-05-18T21:36:04.221 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:36:04.221 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2020-05-18T21:36:04.221 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:36:04.222 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:36:04.222 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:36:04.222 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:36:04.222 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2020-05-18T21:36:04.222 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.223 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2020-05-18T21:36:04.223 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:36:04.223 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:36:04.223 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2020-05-18T21:36:04.223 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:36:04.223 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2020-05-18T21:36:04.224 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2020-05-18T21:36:04.224 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:36:04.224 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2020-05-18T21:36:04.224 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2020-05-18T21:36:04.224 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:36:04.225 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2020-05-18T21:36:04.225 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:36:04.225 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2020-05-18T21:36:04.225 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2020-05-18T21:36:04.225 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2020-05-18T21:36:04.225 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2020-05-18T21:36:04.226 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:36:04.226 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:36:04.226 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2020-05-18T21:36:04.226 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2020-05-18T21:36:04.231 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:36:04.232 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2020-05-18T21:36:04.232 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2020-05-18T21:36:04.238 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2020-05-18T21:36:04.239 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2020-05-18T21:36:04.239 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2020-05-18T21:36:04.239 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2020-05-18T21:36:04.239 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_files = 0 2020-05-18T21:36:04.239 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2020-05-18T21:36:04.239 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2020-05-18T21:36:04.240 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:36:04.240 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal frag = True 2020-05-18T21:36:04.240 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2020-05-18T21:36:04.240 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2020-05-18T21:36:04.240 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2020-05-18T21:36:04.241 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2020-05-18T21:36:04.241 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2020-05-18T21:36:04.241 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2020-05-18T21:36:04.241 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2020-05-18T21:36:04.241 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2020-05-18T21:36:04.242 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:36:04.242 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:36:04.243 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:36:04.259 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:36:04.260 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail b 2020-05-18T21:36:04.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.366+0000 7f2164b4d700 1 Processor -- start 2020-05-18T21:36:04.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.366+0000 7f2164b4d700 1 -- start start 2020-05-18T21:36:04.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f2164b4d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f21600b90a0 0x7f21600b9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:04.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f2164b4d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2160065eb0 con 0x7f216009eae0 2020-05-18T21:36:04.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f2164b4d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21600b8e60 con 0x7f2160145ac0 2020-05-18T21:36:04.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f2164b4d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21600b1fd0 con 0x7f21600b90a0 2020-05-18T21:36:04.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f215ed9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f21600b90a0 0x7f21600b9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:04.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f215ed9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f21600b90a0 0x7f21600b9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34798/0 (socket says 172.21.15.63:34798) 2020-05-18T21:36:04.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f215ed9d700 1 -- 172.21.15.63:0/3845894261 learned_addr learned my addr 172.21.15.63:0/3845894261 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:36:04.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f215d59a700 1 -- 172.21.15.63:0/3845894261 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873854435 0 0) 0x7f2160065eb0 con 0x7f216009eae0 2020-05-18T21:36:04.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f215d59a700 1 -- 172.21.15.63:0/3845894261 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2140003270 con 0x7f216009eae0 2020-05-18T21:36:04.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f215ed9d700 1 -- 172.21.15.63:0/3845894261 >> v1:172.21.15.155:6789/0 conn(0x7f2160145ac0 legacy=0x7f21600b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:04.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f215ed9d700 1 -- 172.21.15.63:0/3845894261 >> v1:172.21.15.63:6789/0 conn(0x7f216009eae0 legacy=0x7f21600b8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:04.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f215ed9d700 1 -- 172.21.15.63:0/3845894261 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21600669a0 con 0x7f21600b90a0 2020-05-18T21:36:04.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f215ed9d700 1 --2- 172.21.15.63:0/3845894261 >> v2:172.21.15.63:3300/0 conn(0x7f21600b90a0 0x7f21600b9530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f21580032f0 tx=0x7f2158007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:04.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f215ed9d700 1 --2- 172.21.15.63:0/3845894261 >> v2:172.21.15.63:3300/0 conn(0x7f21600b90a0 0x7f21600b9530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f21580032f0 tx=0x7f2158007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:04.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f215ed9d700 1 --2- 172.21.15.63:0/3845894261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21600b90a0 0x7f21600b9530 secure :-1 s=READY pgs=1833 cs=0 l=1 rx=0x7f21580032f0 tx=0x7f2158007e00).ready entity=mon.0 client_cookie=46ced1124cc5f46e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:04.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f215ed9d700 1 --2- 172.21.15.63:0/3845894261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21600b90a0 0x7f21600b9530 secure :-1 s=THROTTLE_DONE pgs=1833 cs=0 l=1 rx=0x7f21580032f0 tx=0x7f2158007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:04.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f215ed9d700 1 --2- 172.21.15.63:0/3845894261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21600b90a0 0x7f21600b9530 secure :-1 s=THROTTLE_DONE pgs=1833 cs=0 l=1 rx=0x7f21580032f0 tx=0x7f2158007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:04.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f215d59a700 1 -- 172.21.15.63:0/3845894261 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2158011d10 con 0x7f21600b90a0 2020-05-18T21:36:04.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f215ed9d700 1 --2- 172.21.15.63:0/3845894261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21600b90a0 0x7f21600b9530 secure :-1 s=THROTTLE_DONE pgs=1833 cs=0 l=1 rx=0x7f21580032f0 tx=0x7f2158007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:04.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f215d59a700 1 -- 172.21.15.63:0/3845894261 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2158011e70 con 0x7f21600b90a0 2020-05-18T21:36:04.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f215d59a700 1 -- 172.21.15.63:0/3845894261 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f215800a3b0 con 0x7f21600b90a0 2020-05-18T21:36:04.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f2164b4d700 1 -- 172.21.15.63:0/3845894261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21600b90a0 msgr2=0x7f21600b9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:04.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f2164b4d700 1 --2- 172.21.15.63:0/3845894261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21600b90a0 0x7f21600b9530 secure :-1 s=READY pgs=1833 cs=0 l=1 rx=0x7f21580032f0 tx=0x7f2158007e00).stop 2020-05-18T21:36:04.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f2164b4d700 1 -- 172.21.15.63:0/3845894261 shutdown_connections 2020-05-18T21:36:04.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f2164b4d700 1 --2- 172.21.15.63:0/3845894261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21600b90a0 0x7f21600b9530 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:04.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f2164b4d700 1 -- 172.21.15.63:0/3845894261 >> 172.21.15.63:0/3845894261 conn(0x7f216006a360 msgr2=0x7f216005a770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:04.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f2164b4d700 1 -- 172.21.15.63:0/3845894261 shutdown_connections 2020-05-18T21:36:04.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.370+0000 7f2164b4d700 1 -- 172.21.15.63:0/3845894261 wait complete. 2020-05-18T21:36:04.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f2164b4d700 1 Processor -- start 2020-05-18T21:36:04.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f2164b4d700 1 -- start start 2020-05-18T21:36:04.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f2164b4d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2160145ac0 0x7f21601427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:04.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f2164b4d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2160145ea0 con 0x7f216009eae0 2020-05-18T21:36:04.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f2164b4d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2160148890 con 0x7f21600b90a0 2020-05-18T21:36:04.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f2164b4d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2160148b30 con 0x7f2160145ac0 2020-05-18T21:36:04.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f215e59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f216009eae0 0x7f2160156f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36990/0 (socket says 172.21.15.63:36990) 2020-05-18T21:36:04.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f215e59c700 1 -- 172.21.15.63:0/308529729 learned_addr learned my addr 172.21.15.63:0/308529729 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:04.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f215ed9d700 1 --2- 172.21.15.63:0/308529729 >> v2:172.21.15.155:3300/0 conn(0x7f2160145ac0 0x7f21601427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:04.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018102991 0 0) 0x7f2160145ea0 con 0x7f216009eae0 2020-05-18T21:36:04.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2144002fe0 con 0x7f216009eae0 2020-05-18T21:36:04.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896183537 0 0) 0x7f2160148890 con 0x7f21600b90a0 2020-05-18T21:36:04.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2160145ea0 con 0x7f21600b90a0 2020-05-18T21:36:04.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2964817816 0 0) 0x7f2144002fe0 con 0x7f216009eae0 2020-05-18T21:36:04.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2160148890 con 0x7f216009eae0 2020-05-18T21:36:04.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f2150001970 con 0x7f216009eae0 2020-05-18T21:36:04.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 >> v2:172.21.15.155:3300/0 conn(0x7f2160145ac0 msgr2=0x7f21601427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:04.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f21577fe700 1 --2- 172.21.15.63:0/308529729 >> v2:172.21.15.155:3300/0 conn(0x7f2160145ac0 0x7f21601427d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:04.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 >> v1:172.21.15.155:6789/0 conn(0x7f21600b90a0 legacy=0x7f21601420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:04.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 >> v1:172.21.15.63:6789/0 conn(0x7f216009eae0 legacy=0x7f2160156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:04.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f21577fe700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2144004bf0 0x7f2144004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f21577fe700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2144003b30 0x7f2144003f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f21577fe700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21440043d0 0x7f214400b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2160148b30 con 0x7f2144004bf0 2020-05-18T21:36:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21440049c0 con 0x7f2144003b30 2020-05-18T21:36:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214400bc10 con 0x7f21440043d0 2020-05-18T21:36:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f215e59c700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2144004bf0 0x7f2144004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f215dd9b700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2144003b30 0x7f2144003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f215ed9d700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21440043d0 0x7f214400b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f215e59c700 1 -- 172.21.15.63:0/308529729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21440043d0 msgr2=0x7f214400b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f215e59c700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21440043d0 0x7f214400b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f215e59c700 1 -- 172.21.15.63:0/308529729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2144003b30 msgr2=0x7f2144003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f215e59c700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2144003b30 0x7f2144003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f215e59c700 1 -- 172.21.15.63:0/308529729 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2160157930 con 0x7f2144004bf0 2020-05-18T21:36:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f215ed9d700 1 -- 172.21.15.63:0/308529729 reap_dead start 2020-05-18T21:36:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f2164b4d700 1 -- 172.21.15.63:0/308529729 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2160157b80 con 0x7f2144004bf0 2020-05-18T21:36:04.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f215e59c700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2144004bf0 0x7f2144004ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2144004b00 tx=0x7f21500113c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:04.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f215e59c700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2144004bf0 0x7f2144004ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2144004b00 tx=0x7f21500113c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:04.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f215e59c700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2144004bf0 0x7f2144004ff0 secure :-1 s=READY pgs=1835 cs=0 l=1 rx=0x7f2144004b00 tx=0x7f21500113c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:04.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.374+0000 7f2164b4d700 1 -- 172.21.15.63:0/308529729 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21600b6570 con 0x7f2144004bf0 2020-05-18T21:36:04.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.378+0000 7f215e59c700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2144004bf0 0x7f2144004ff0 secure :-1 s=THROTTLE_DONE pgs=1835 cs=0 l=1 rx=0x7f2144004b00 tx=0x7f21500113c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.378+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2150011d10 con 0x7f2144004bf0 2020-05-18T21:36:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.378+0000 7f215e59c700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2144004bf0 0x7f2144004ff0 secure :-1 s=THROTTLE_DONE pgs=1835 cs=0 l=1 rx=0x7f2144004b00 tx=0x7f21500113c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.378+0000 7f215e59c700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2144004bf0 0x7f2144004ff0 secure :-1 s=THROTTLE_DONE pgs=1835 cs=0 l=1 rx=0x7f2144004b00 tx=0x7f21500113c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.378+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2150011e70 con 0x7f2144004bf0 2020-05-18T21:36:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.378+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21500103b0 con 0x7f2144004bf0 2020-05-18T21:36:04.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.378+0000 7f215e59c700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2144004bf0 0x7f2144004ff0 secure :-1 s=THROTTLE_DONE pgs=1835 cs=0 l=1 rx=0x7f2144004b00 tx=0x7f21500113c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:04.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.378+0000 7f2164b4d700 1 -- 172.21.15.63:0/308529729 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2138003380 con 0x7f2144004bf0 2020-05-18T21:36:04.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.378+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2150010510 con 0x7f2144004bf0 2020-05-18T21:36:04.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.378+0000 7f215e59c700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2144004bf0 0x7f2144004ff0 secure :-1 s=THROTTLE_DONE pgs=1835 cs=0 l=1 rx=0x7f2144004b00 tx=0x7f21500113c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:04.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.378+0000 7f21577fe700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f21440539d0 0x7f2144055e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:04.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.378+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2150063e70 con 0x7f2144004bf0 2020-05-18T21:36:04.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.378+0000 7f215dd9b700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f21440539d0 0x7f2144055e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:04.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.378+0000 7f215dd9b700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f21440539d0 0x7f2144055e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2148001370 tx=0x7f21480012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:04.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.378+0000 7f215dd9b700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f21440539d0 0x7f2144055e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2148001370 tx=0x7f21480012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:04.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.378+0000 7f215dd9b700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f21440539d0 0x7f2144055e90 secure :-1 s=READY pgs=714 cs=0 l=1 rx=0x7f2148001370 tx=0x7f21480012e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:04.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.386+0000 7f215e59c700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2144004bf0 0x7f2144004ff0 secure :-1 s=THROTTLE_DONE pgs=1835 cs=0 l=1 rx=0x7f2144004b00 tx=0x7f21500113c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:04.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.386+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f215003e220 con 0x7f2144004bf0 2020-05-18T21:36:04.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:04.538+0000 7f2164b4d700 1 -- 172.21.15.63:0/308529729 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f2138002210 con 0x7f2144004bf0 2020-05-18T21:36:05.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.298+0000 7f215e59c700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2144004bf0 0x7f2144004ff0 secure :-1 s=THROTTLE_DONE pgs=1835 cs=0 l=1 rx=0x7f2144004b00 tx=0x7f21500113c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:05.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.298+0000 7f21577fe700 1 -- 172.21.15.63:0/308529729 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 9136 v106) v1 ==== 95+0+0 (secure 0 0 0) 0x7f2150041840 con 0x7f2144004bf0 2020-05-18T21:36:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.302+0000 7f2164b4d700 1 -- 172.21.15.63:0/308529729 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f21440539d0 msgr2=0x7f2144055e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.302+0000 7f2164b4d700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f21440539d0 0x7f2144055e90 secure :-1 s=READY pgs=714 cs=0 l=1 rx=0x7f2148001370 tx=0x7f21480012e0).stop 2020-05-18T21:36:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.302+0000 7f2164b4d700 1 -- 172.21.15.63:0/308529729 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2144004bf0 msgr2=0x7f2144004ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.302+0000 7f2164b4d700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2144004bf0 0x7f2144004ff0 secure :-1 s=READY pgs=1835 cs=0 l=1 rx=0x7f2144004b00 tx=0x7f21500113c0).stop 2020-05-18T21:36:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.302+0000 7f2164b4d700 1 -- 172.21.15.63:0/308529729 shutdown_connections 2020-05-18T21:36:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.302+0000 7f2164b4d700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f21440539d0 0x7f2144055e90 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.302+0000 7f2164b4d700 1 --2- 172.21.15.63:0/308529729 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2144004bf0 0x7f2144004ff0 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:05.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.302+0000 7f2164b4d700 1 -- 172.21.15.63:0/308529729 >> 172.21.15.63:0/308529729 conn(0x7f216006a360 msgr2=0x7f216005eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:05.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.302+0000 7f2164b4d700 1 -- 172.21.15.63:0/308529729 shutdown_connections 2020-05-18T21:36:05.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.302+0000 7f2164b4d700 1 -- 172.21.15.63:0/308529729 wait complete. 2020-05-18T21:36:05.307 INFO:teuthology.orchestra.run.smithi063.stderr:failed mds gid 9136 2020-05-18T21:36:05.322 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:36:05.323 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:36:05.325 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:36:05.326 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:36:05.401 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:36:05.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22de98700 1 Processor -- start 2020-05-18T21:36:05.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22de98700 1 -- start start 2020-05-18T21:36:05.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22de98700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff228065b30 0x7ff2280b9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:05.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22de98700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff2281494e0 0x7ff228149970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:05.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22de98700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2280b92b0 con 0x7ff2280bc9b0 2020-05-18T21:36:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22de98700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2280b9550 con 0x7ff2281494e0 2020-05-18T21:36:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22de98700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2280b97f0 con 0x7ff228065b30 2020-05-18T21:36:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22d697700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff2281494e0 0x7ff228149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22d697700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff2281494e0 0x7ff228149970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34818/0 (socket says 172.21.15.63:34818) 2020-05-18T21:36:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22d697700 1 -- 172.21.15.63:0/2932618473 learned_addr learned my addr 172.21.15.63:0/2932618473 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:36:05.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff227fff700 1 --2- 172.21.15.63:0/2932618473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff228065b30 0x7ff2280b9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:05.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22d697700 1 -- 172.21.15.63:0/2932618473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff228065b30 msgr2=0x7ff2280b9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:05.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22d697700 1 --2- 172.21.15.63:0/2932618473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff228065b30 0x7ff2280b9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:05.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22d697700 1 -- 172.21.15.63:0/2932618473 >> v1:172.21.15.155:6789/0 conn(0x7ff2280bc9b0 legacy=0x7ff22812e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:05.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22d697700 1 -- 172.21.15.63:0/2932618473 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22812f620 con 0x7ff2281494e0 2020-05-18T21:36:05.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff2277fe700 1 -- 172.21.15.63:0/2932618473 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165396154 0 0) 0x7ff2280b92b0 con 0x7ff2280bc9b0 2020-05-18T21:36:05.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22d697700 1 --2- 172.21.15.63:0/2932618473 >> v2:172.21.15.63:3300/0 conn(0x7ff2281494e0 0x7ff228149970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff2200032f0 tx=0x7ff220007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:05.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22d697700 1 --2- 172.21.15.63:0/2932618473 >> v2:172.21.15.63:3300/0 conn(0x7ff2281494e0 0x7ff228149970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff2200032f0 tx=0x7ff220007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:05.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22d697700 1 --2- 172.21.15.63:0/2932618473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2281494e0 0x7ff228149970 secure :-1 s=READY pgs=1837 cs=0 l=1 rx=0x7ff2200032f0 tx=0x7ff220007e00).ready entity=mon.0 client_cookie=e1786b9d4be42bcb server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:05.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22d697700 1 --2- 172.21.15.63:0/2932618473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2281494e0 0x7ff228149970 secure :-1 s=THROTTLE_DONE pgs=1837 cs=0 l=1 rx=0x7ff2200032f0 tx=0x7ff220007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:05.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22d697700 1 --2- 172.21.15.63:0/2932618473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2281494e0 0x7ff228149970 secure :-1 s=THROTTLE_DONE pgs=1837 cs=0 l=1 rx=0x7ff2200032f0 tx=0x7ff220007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:05.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff2277fe700 1 -- 172.21.15.63:0/2932618473 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff220011d10 con 0x7ff2281494e0 2020-05-18T21:36:05.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22d697700 1 --2- 172.21.15.63:0/2932618473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2281494e0 0x7ff228149970 secure :-1 s=THROTTLE_DONE pgs=1837 cs=0 l=1 rx=0x7ff2200032f0 tx=0x7ff220007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:05.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff2277fe700 1 -- 172.21.15.63:0/2932618473 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff220011e70 con 0x7ff2281494e0 2020-05-18T21:36:05.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff2277fe700 1 -- 172.21.15.63:0/2932618473 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff22000a370 con 0x7ff2281494e0 2020-05-18T21:36:05.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22de98700 1 -- 172.21.15.63:0/2932618473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2281494e0 msgr2=0x7ff228149970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:05.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.430+0000 7ff22de98700 1 --2- 172.21.15.63:0/2932618473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2281494e0 0x7ff228149970 secure :-1 s=READY pgs=1837 cs=0 l=1 rx=0x7ff2200032f0 tx=0x7ff220007e00).stop 2020-05-18T21:36:05.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.434+0000 7ff22de98700 1 -- 172.21.15.63:0/2932618473 shutdown_connections 2020-05-18T21:36:05.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.434+0000 7ff22de98700 1 --2- 172.21.15.63:0/2932618473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2281494e0 0x7ff228149970 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:05.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.434+0000 7ff22de98700 1 --2- 172.21.15.63:0/2932618473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff228065b30 0x7ff2280b9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:05.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.434+0000 7ff22de98700 1 -- 172.21.15.63:0/2932618473 >> 172.21.15.63:0/2932618473 conn(0x7ff22806a360 msgr2=0x7ff22805a770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:05.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.434+0000 7ff22de98700 1 -- 172.21.15.63:0/2932618473 shutdown_connections 2020-05-18T21:36:05.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.434+0000 7ff22de98700 1 -- 172.21.15.63:0/2932618473 wait complete. 2020-05-18T21:36:05.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.434+0000 7ff22de98700 1 Processor -- start 2020-05-18T21:36:05.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.434+0000 7ff22de98700 1 -- start start 2020-05-18T21:36:05.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.434+0000 7ff22de98700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff2280bc9b0 0x7ff2280a2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:05.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.434+0000 7ff22de98700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff2281494e0 0x7ff2280a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:05.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.434+0000 7ff22de98700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff228157910 con 0x7ff228065b30 2020-05-18T21:36:05.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.434+0000 7ff22de98700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2280b5ba0 con 0x7ff2280bc9b0 2020-05-18T21:36:05.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.434+0000 7ff22de98700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2280b61e0 con 0x7ff2281494e0 2020-05-18T21:36:05.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.434+0000 7ff227fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff2280bc9b0 0x7ff2280a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:05.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff227fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff2280bc9b0 0x7ff2280a2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34824/0 (socket says 172.21.15.63:34824) 2020-05-18T21:36:05.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff227fff700 1 -- 172.21.15.63:0/3974771743 learned_addr learned my addr 172.21.15.63:0/3974771743 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:36:05.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff22d697700 1 --2- 172.21.15.63:0/3974771743 >> v2:172.21.15.155:3300/0 conn(0x7ff2281494e0 0x7ff2280a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:05.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff227fff700 1 -- 172.21.15.63:0/3974771743 >> v2:172.21.15.155:3300/0 conn(0x7ff2281494e0 msgr2=0x7ff2280a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:05.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff227fff700 1 --2- 172.21.15.63:0/3974771743 >> v2:172.21.15.155:3300/0 conn(0x7ff2281494e0 0x7ff2280a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:05.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff227fff700 1 -- 172.21.15.63:0/3974771743 >> v1:172.21.15.155:6789/0 conn(0x7ff228065b30 legacy=0x7ff2280b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:05.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff225ffb700 1 -- 172.21.15.63:0/3974771743 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240436217 0 0) 0x7ff228157910 con 0x7ff228065b30 2020-05-18T21:36:05.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff227fff700 1 -- 172.21.15.63:0/3974771743 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2280b6480 con 0x7ff2280bc9b0 2020-05-18T21:36:05.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff227fff700 1 --2- 172.21.15.63:0/3974771743 >> v2:172.21.15.63:3300/0 conn(0x7ff2280bc9b0 0x7ff2280a2270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff214002f70 tx=0x7ff214010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:05.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff227fff700 1 --2- 172.21.15.63:0/3974771743 >> v2:172.21.15.63:3300/0 conn(0x7ff2280bc9b0 0x7ff2280a2270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff214002f70 tx=0x7ff214010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:05.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff227fff700 1 --2- 172.21.15.63:0/3974771743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2280bc9b0 0x7ff2280a2270 secure :-1 s=READY pgs=1838 cs=0 l=1 rx=0x7ff214002f70 tx=0x7ff214010cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:05.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff227fff700 1 --2- 172.21.15.63:0/3974771743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2280bc9b0 0x7ff2280a2270 secure :-1 s=THROTTLE_DONE pgs=1838 cs=0 l=1 rx=0x7ff214002f70 tx=0x7ff214010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:05.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff225ffb700 1 -- 172.21.15.63:0/3974771743 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff214007550 con 0x7ff2280bc9b0 2020-05-18T21:36:05.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff227fff700 1 --2- 172.21.15.63:0/3974771743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2280bc9b0 0x7ff2280a2270 secure :-1 s=THROTTLE_DONE pgs=1838 cs=0 l=1 rx=0x7ff214002f70 tx=0x7ff214010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:05.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff227fff700 1 --2- 172.21.15.63:0/3974771743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2280bc9b0 0x7ff2280a2270 secure :-1 s=THROTTLE_DONE pgs=1838 cs=0 l=1 rx=0x7ff214002f70 tx=0x7ff214010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:05.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff22de98700 1 -- 172.21.15.63:0/3974771743 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2280a1d70 con 0x7ff2280bc9b0 2020-05-18T21:36:05.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff225ffb700 1 -- 172.21.15.63:0/3974771743 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff214012720 con 0x7ff2280bc9b0 2020-05-18T21:36:05.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff225ffb700 1 -- 172.21.15.63:0/3974771743 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff214012b00 con 0x7ff2280bc9b0 2020-05-18T21:36:05.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff22de98700 1 -- 172.21.15.63:0/3974771743 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22809f8c0 con 0x7ff2280bc9b0 2020-05-18T21:36:05.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff227fff700 1 --2- 172.21.15.63:0/3974771743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2280bc9b0 0x7ff2280a2270 secure :-1 s=THROTTLE_DONE pgs=1838 cs=0 l=1 rx=0x7ff214002f70 tx=0x7ff214010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:05.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff22de98700 1 -- 172.21.15.63:0/3974771743 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2280569e0 con 0x7ff2280bc9b0 2020-05-18T21:36:05.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff225ffb700 1 -- 172.21.15.63:0/3974771743 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff214012d70 con 0x7ff2280bc9b0 2020-05-18T21:36:05.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.438+0000 7ff227fff700 1 --2- 172.21.15.63:0/3974771743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2280bc9b0 0x7ff2280a2270 secure :-1 s=THROTTLE_DONE pgs=1838 cs=0 l=1 rx=0x7ff214002f70 tx=0x7ff214010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:05.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.442+0000 7ff225ffb700 1 --2- 172.21.15.63:0/3974771743 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff21004f8d0 0x7ff210051d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:05.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.442+0000 7ff225ffb700 1 -- 172.21.15.63:0/3974771743 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff214064300 con 0x7ff2280bc9b0 2020-05-18T21:36:05.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.442+0000 7ff22ce96700 1 --2- 172.21.15.63:0/3974771743 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff21004f8d0 0x7ff210051d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:05.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.442+0000 7ff22ce96700 1 --2- 172.21.15.63:0/3974771743 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff21004f8d0 0x7ff210051d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff21c001130 tx=0x7ff21c002790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:05.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.442+0000 7ff22ce96700 1 --2- 172.21.15.63:0/3974771743 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff21004f8d0 0x7ff210051d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff21c001130 tx=0x7ff21c002790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:05.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.442+0000 7ff22ce96700 1 --2- 172.21.15.63:0/3974771743 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff21004f8d0 0x7ff210051d90 secure :-1 s=READY pgs=715 cs=0 l=1 rx=0x7ff21c001130 tx=0x7ff21c002790).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:05.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.446+0000 7ff227fff700 1 --2- 172.21.15.63:0/3974771743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2280bc9b0 0x7ff2280a2270 secure :-1 s=THROTTLE_DONE pgs=1838 cs=0 l=1 rx=0x7ff214002f70 tx=0x7ff214010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:05.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.446+0000 7ff225ffb700 1 -- 172.21.15.63:0/3974771743 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff21403e630 con 0x7ff2280bc9b0 2020-05-18T21:36:05.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.598+0000 7ff22de98700 1 -- 172.21.15.63:0/3974771743 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2280a1f00 con 0x7ff2280bc9b0 2020-05-18T21:36:05.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.598+0000 7ff227fff700 1 --2- 172.21.15.63:0/3974771743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2280bc9b0 0x7ff2280a2270 secure :-1 s=THROTTLE_DONE pgs=1838 cs=0 l=1 rx=0x7ff214002f70 tx=0x7ff214010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:05.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.598+0000 7ff225ffb700 1 -- 172.21.15.63:0/3974771743 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+1795 (secure 0 0 0) 0x7ff214041c50 con 0x7ff2280bc9b0 2020-05-18T21:36:05.604 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:05.605 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":106,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:36:05.285925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":9501},"failed":[1],"damaged":[],"stopped":[],"info":{"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:36:05.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.602+0000 7ff22de98700 1 -- 172.21.15.63:0/3974771743 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff21004f8d0 msgr2=0x7ff210051d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:05.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.602+0000 7ff22de98700 1 --2- 172.21.15.63:0/3974771743 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff21004f8d0 0x7ff210051d90 secure :-1 s=READY pgs=715 cs=0 l=1 rx=0x7ff21c001130 tx=0x7ff21c002790).stop 2020-05-18T21:36:05.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.602+0000 7ff22de98700 1 -- 172.21.15.63:0/3974771743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2280bc9b0 msgr2=0x7ff2280a2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:05.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.602+0000 7ff22de98700 1 --2- 172.21.15.63:0/3974771743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2280bc9b0 0x7ff2280a2270 secure :-1 s=READY pgs=1838 cs=0 l=1 rx=0x7ff214002f70 tx=0x7ff214010cd0).stop 2020-05-18T21:36:05.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.602+0000 7ff22de98700 1 -- 172.21.15.63:0/3974771743 shutdown_connections 2020-05-18T21:36:05.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.602+0000 7ff22de98700 1 --2- 172.21.15.63:0/3974771743 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff21004f8d0 0x7ff210051d90 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:05.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.602+0000 7ff22de98700 1 --2- 172.21.15.63:0/3974771743 >> v2:172.21.15.155:3300/0 conn(0x7ff2281494e0 0x7ff2280a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:05.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.602+0000 7ff22de98700 1 --2- 172.21.15.63:0/3974771743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2280bc9b0 0x7ff2280a2270 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:05.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.602+0000 7ff22de98700 1 -- 172.21.15.63:0/3974771743 >> 172.21.15.63:0/3974771743 conn(0x7ff22806a360 msgr2=0x7ff22805eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:05.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.602+0000 7ff22de98700 1 -- 172.21.15.63:0/3974771743 shutdown_connections 2020-05-18T21:36:05.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:05.602+0000 7ff22de98700 1 -- 172.21.15.63:0/3974771743 wait complete. 2020-05-18T21:36:05.608 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 106 2020-05-18T21:36:05.819 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 106, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:35:50.157703+0000', 'modified': '2020-05-18T21:36:05.285925+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 135, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 9501}, 'failed': [1], 'damaged': [], 'stopped': [], 'info': {'gid_9501': {'gid': 9501, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/169345666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 169345666}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 169345666}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:36:05.819 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/2 2020-05-18T21:36:06.821 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:36:06.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.926+0000 7f8f54aad700 1 Processor -- start 2020-05-18T21:36:06.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.926+0000 7f8f54aad700 1 -- start start 2020-05-18T21:36:06.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.926+0000 7f8f54aad700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f5005ee90 0x7f8f500b8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:06.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.926+0000 7f8f54aad700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f50146380 con 0x7f8f500b63d0 2020-05-18T21:36:06.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.926+0000 7f8f54aad700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5005f270 con 0x7f8f50146820 2020-05-18T21:36:06.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.926+0000 7f8f54aad700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f501461a0 con 0x7f8f5005ee90 2020-05-18T21:36:06.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.926+0000 7f8f4ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8f500b63d0 0x7f8f500654c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37022/0 (socket says 172.21.15.63:37022) 2020-05-18T21:36:06.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.926+0000 7f8f4ffff700 1 -- 172.21.15.63:0/2822200510 learned_addr learned my addr 172.21.15.63:0/2822200510 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:06.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.926+0000 7f8f4f7fe700 1 --2- 172.21.15.63:0/2822200510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f5005ee90 0x7f8f500b8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:06.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.926+0000 7f8f4e7fc700 1 -- 172.21.15.63:0/2822200510 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900085792 0 0) 0x7f8f50146380 con 0x7f8f500b63d0 2020-05-18T21:36:06.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f4e7fc700 1 -- 172.21.15.63:0/2822200510 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f30003270 con 0x7f8f500b63d0 2020-05-18T21:36:06.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f4e7fc700 1 -- 172.21.15.63:0/2822200510 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580592447 0 0) 0x7f8f5005f270 con 0x7f8f50146820 2020-05-18T21:36:06.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f4e7fc700 1 -- 172.21.15.63:0/2822200510 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f50146380 con 0x7f8f50146820 2020-05-18T21:36:06.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f4f7fe700 1 -- 172.21.15.63:0/2822200510 >> v1:172.21.15.155:6789/0 conn(0x7f8f50146820 legacy=0x7f8f50149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:06.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f4f7fe700 1 -- 172.21.15.63:0/2822200510 >> v1:172.21.15.63:6789/0 conn(0x7f8f500b63d0 legacy=0x7f8f500654c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:06.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f4f7fe700 1 -- 172.21.15.63:0/2822200510 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f50145da0 con 0x7f8f5005ee90 2020-05-18T21:36:06.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f4f7fe700 1 --2- 172.21.15.63:0/2822200510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f5005ee90 0x7f8f500b8720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8f40002f70 tx=0x7f8f40008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:06.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f4f7fe700 1 --2- 172.21.15.63:0/2822200510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f5005ee90 0x7f8f500b8720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8f40002f70 tx=0x7f8f40008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:06.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f4f7fe700 1 --2- 172.21.15.63:0/2822200510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f5005ee90 0x7f8f500b8720 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7f8f40002f70 tx=0x7f8f40008920).ready entity=mon.2 client_cookie=fb0d9711063f3191 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:06.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f4f7fe700 1 --2- 172.21.15.63:0/2822200510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f5005ee90 0x7f8f500b8720 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f8f40002f70 tx=0x7f8f40008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:06.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f4e7fc700 1 -- 172.21.15.63:0/2822200510 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f40008e80 con 0x7f8f5005ee90 2020-05-18T21:36:06.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f4f7fe700 1 --2- 172.21.15.63:0/2822200510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f5005ee90 0x7f8f500b8720 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f8f40002f70 tx=0x7f8f40008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:06.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f4e7fc700 1 -- 172.21.15.63:0/2822200510 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f40011580 con 0x7f8f5005ee90 2020-05-18T21:36:06.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f4f7fe700 1 --2- 172.21.15.63:0/2822200510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f5005ee90 0x7f8f500b8720 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f8f40002f70 tx=0x7f8f40008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:06.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f4e7fc700 1 -- 172.21.15.63:0/2822200510 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f40011960 con 0x7f8f5005ee90 2020-05-18T21:36:06.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f54aad700 1 -- 172.21.15.63:0/2822200510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f5005ee90 msgr2=0x7f8f500b8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:06.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f54aad700 1 --2- 172.21.15.63:0/2822200510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f5005ee90 0x7f8f500b8720 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7f8f40002f70 tx=0x7f8f40008920).stop 2020-05-18T21:36:06.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f54aad700 1 -- 172.21.15.63:0/2822200510 shutdown_connections 2020-05-18T21:36:06.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f54aad700 1 --2- 172.21.15.63:0/2822200510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f5005ee90 0x7f8f500b8720 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:06.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f54aad700 1 -- 172.21.15.63:0/2822200510 >> 172.21.15.63:0/2822200510 conn(0x7f8f500bc730 msgr2=0x7f8f500bcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:06.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f54aad700 1 -- 172.21.15.63:0/2822200510 shutdown_connections 2020-05-18T21:36:06.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f54aad700 1 -- 172.21.15.63:0/2822200510 wait complete. 2020-05-18T21:36:06.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f54aad700 1 Processor -- start 2020-05-18T21:36:06.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.930+0000 7f8f54aad700 1 -- start start 2020-05-18T21:36:06.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f54aad700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8f5005ee90 0x7f8f50142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:06.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f54aad700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f501415b0 con 0x7f8f50146820 2020-05-18T21:36:06.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f54aad700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f500ad970 con 0x7f8f500b63d0 2020-05-18T21:36:06.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f54aad700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f500ad780 con 0x7f8f5005ee90 2020-05-18T21:36:06.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f4f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8f5005ee90 0x7f8f50142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:06.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f4ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8f50146820 0x7f8f5013df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37028/0 (socket says 172.21.15.63:37028) 2020-05-18T21:36:06.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f4ffff700 1 -- 172.21.15.63:0/4164640028 learned_addr learned my addr 172.21.15.63:0/4164640028 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:06.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f4f7fe700 1 -- 172.21.15.63:0/4164640028 >> v1:172.21.15.155:6789/0 conn(0x7f8f500b63d0 legacy=0x7f8f500ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:06.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f4f7fe700 1 -- 172.21.15.63:0/4164640028 >> v1:172.21.15.63:6789/0 conn(0x7f8f50146820 legacy=0x7f8f5013df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:06.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f4f7fe700 1 -- 172.21.15.63:0/4164640028 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5013e690 con 0x7f8f5005ee90 2020-05-18T21:36:06.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f4cff9700 1 -- 172.21.15.63:0/4164640028 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421028025 0 0) 0x7f8f501415b0 con 0x7f8f50146820 2020-05-18T21:36:06.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f4f7fe700 1 --2- 172.21.15.63:0/4164640028 >> v2:172.21.15.63:3300/0 conn(0x7f8f5005ee90 0x7f8f50142180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8f40002f70 tx=0x7f8f50145f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:06.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f4f7fe700 1 --2- 172.21.15.63:0/4164640028 >> v2:172.21.15.63:3300/0 conn(0x7f8f5005ee90 0x7f8f50142180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8f40002f70 tx=0x7f8f50145f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:06.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f4f7fe700 1 --2- 172.21.15.63:0/4164640028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f5005ee90 0x7f8f50142180 secure :-1 s=READY pgs=1841 cs=0 l=1 rx=0x7f8f40002f70 tx=0x7f8f50145f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:06.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f4f7fe700 1 --2- 172.21.15.63:0/4164640028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f5005ee90 0x7f8f50142180 secure :-1 s=THROTTLE_DONE pgs=1841 cs=0 l=1 rx=0x7f8f40002f70 tx=0x7f8f50145f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:06.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f4cff9700 1 -- 172.21.15.63:0/4164640028 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f40011a00 con 0x7f8f5005ee90 2020-05-18T21:36:06.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f4f7fe700 1 --2- 172.21.15.63:0/4164640028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f5005ee90 0x7f8f50142180 secure :-1 s=THROTTLE_DONE pgs=1841 cs=0 l=1 rx=0x7f8f40002f70 tx=0x7f8f50145f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:06.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f4f7fe700 1 --2- 172.21.15.63:0/4164640028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f5005ee90 0x7f8f50142180 secure :-1 s=THROTTLE_DONE pgs=1841 cs=0 l=1 rx=0x7f8f40002f70 tx=0x7f8f50145f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:06.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f4cff9700 1 -- 172.21.15.63:0/4164640028 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f40007170 con 0x7f8f5005ee90 2020-05-18T21:36:06.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f54aad700 1 -- 172.21.15.63:0/4164640028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f50140f80 con 0x7f8f5005ee90 2020-05-18T21:36:06.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f4cff9700 1 -- 172.21.15.63:0/4164640028 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f400074d0 con 0x7f8f5005ee90 2020-05-18T21:36:06.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f54aad700 1 -- 172.21.15.63:0/4164640028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f501489b0 con 0x7f8f5005ee90 2020-05-18T21:36:06.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f4f7fe700 1 --2- 172.21.15.63:0/4164640028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f5005ee90 0x7f8f50142180 secure :-1 s=THROTTLE_DONE pgs=1841 cs=0 l=1 rx=0x7f8f40002f70 tx=0x7f8f50145f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:06.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.934+0000 7f8f54aad700 1 -- 172.21.15.63:0/4164640028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f50148e60 con 0x7f8f5005ee90 2020-05-18T21:36:06.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.938+0000 7f8f4cff9700 1 -- 172.21.15.63:0/4164640028 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8f40005700 con 0x7f8f5005ee90 2020-05-18T21:36:06.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.938+0000 7f8f4f7fe700 1 --2- 172.21.15.63:0/4164640028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f5005ee90 0x7f8f50142180 secure :-1 s=THROTTLE_DONE pgs=1841 cs=0 l=1 rx=0x7f8f40002f70 tx=0x7f8f50145f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:06.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.938+0000 7f8f4cff9700 1 --2- 172.21.15.63:0/4164640028 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8f3404f8f0 0x7f8f34051db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:06.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.938+0000 7f8f4cff9700 1 -- 172.21.15.63:0/4164640028 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8f40064580 con 0x7f8f5005ee90 2020-05-18T21:36:06.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.938+0000 7f8f4effd700 1 --2- 172.21.15.63:0/4164640028 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8f3404f8f0 0x7f8f34051db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:06.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.938+0000 7f8f4effd700 1 --2- 172.21.15.63:0/4164640028 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8f3404f8f0 0x7f8f34051db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8f5013eca0 tx=0x7f8f380026c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:06.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.938+0000 7f8f4effd700 1 --2- 172.21.15.63:0/4164640028 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8f3404f8f0 0x7f8f34051db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8f5013eca0 tx=0x7f8f380026c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:06.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.938+0000 7f8f4effd700 1 --2- 172.21.15.63:0/4164640028 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8f3404f8f0 0x7f8f34051db0 secure :-1 s=READY pgs=717 cs=0 l=1 rx=0x7f8f5013eca0 tx=0x7f8f380026c0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:06.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.942+0000 7f8f4f7fe700 1 --2- 172.21.15.63:0/4164640028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f5005ee90 0x7f8f50142180 secure :-1 s=THROTTLE_DONE pgs=1841 cs=0 l=1 rx=0x7f8f40002f70 tx=0x7f8f50145f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:06.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:06.942+0000 7f8f4cff9700 1 -- 172.21.15.63:0/4164640028 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f8f4003e9d0 con 0x7f8f5005ee90 2020-05-18T21:36:07.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:07.090+0000 7f8f54aad700 1 -- 172.21.15.63:0/4164640028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f500adb00 con 0x7f8f5005ee90 2020-05-18T21:36:07.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:07.090+0000 7f8f4f7fe700 1 --2- 172.21.15.63:0/4164640028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f5005ee90 0x7f8f50142180 secure :-1 s=THROTTLE_DONE pgs=1841 cs=0 l=1 rx=0x7f8f40002f70 tx=0x7f8f50145f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:07.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:07.090+0000 7f8f4cff9700 1 -- 172.21.15.63:0/4164640028 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+2163 (secure 0 0 0) 0x7f8f40041ff0 con 0x7f8f5005ee90 2020-05-18T21:36:07.095 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:07.095 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":108,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:36:06.301235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":9501,"mds_1":9379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9379":{"gid":9379,"name":"b","rank":1,"incarnation":108,"state":"up:replay","state_seq":1,"addr":"172.21.15.155:6835/3918574447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3918574447},{"type":"v1","addr":"172.21.15.155:6835","nonce":3918574447}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:36:07.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:07.090+0000 7f8f54aad700 1 -- 172.21.15.63:0/4164640028 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8f3404f8f0 msgr2=0x7f8f34051db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:07.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:07.090+0000 7f8f54aad700 1 --2- 172.21.15.63:0/4164640028 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8f3404f8f0 0x7f8f34051db0 secure :-1 s=READY pgs=717 cs=0 l=1 rx=0x7f8f5013eca0 tx=0x7f8f380026c0).stop 2020-05-18T21:36:07.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:07.090+0000 7f8f54aad700 1 -- 172.21.15.63:0/4164640028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f5005ee90 msgr2=0x7f8f50142180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:07.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:07.090+0000 7f8f54aad700 1 --2- 172.21.15.63:0/4164640028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f5005ee90 0x7f8f50142180 secure :-1 s=READY pgs=1841 cs=0 l=1 rx=0x7f8f40002f70 tx=0x7f8f50145f90).stop 2020-05-18T21:36:07.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:07.090+0000 7f8f54aad700 1 -- 172.21.15.63:0/4164640028 shutdown_connections 2020-05-18T21:36:07.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:07.090+0000 7f8f54aad700 1 --2- 172.21.15.63:0/4164640028 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8f3404f8f0 0x7f8f34051db0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:07.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:07.090+0000 7f8f54aad700 1 --2- 172.21.15.63:0/4164640028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f5005ee90 0x7f8f50142180 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:07.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:07.090+0000 7f8f54aad700 1 -- 172.21.15.63:0/4164640028 >> 172.21.15.63:0/4164640028 conn(0x7f8f500bc730 msgr2=0x7f8f500bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:07.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:07.090+0000 7f8f54aad700 1 -- 172.21.15.63:0/4164640028 shutdown_connections 2020-05-18T21:36:07.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:07.090+0000 7f8f54aad700 1 -- 172.21.15.63:0/4164640028 wait complete. 2020-05-18T21:36:07.099 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 108 2020-05-18T21:36:07.309 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 108, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:35:50.157703+0000', 'modified': '2020-05-18T21:36:06.301235+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 135, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 9501, 'mds_1': 9379}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9379': {'gid': 9379, 'name': 'b', 'rank': 1, 'incarnation': 108, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.155:6835/3918574447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3918574447}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3918574447}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}, 'gid_9501': {'gid': 9501, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/169345666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 169345666}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 169345666}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:36:07.309 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9379:up:replay 2020-05-18T21:36:08.311 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:36:08.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa785d14700 1 Processor -- start 2020-05-18T21:36:08.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa785d14700 1 -- start start 2020-05-18T21:36:08.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa785d14700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa78005bbc0 0x7fa78005f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:08.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa785d14700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa780142ef0 con 0x7fa780062410 2020-05-18T21:36:08.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa785d14700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa780143190 con 0x7fa7801438d0 2020-05-18T21:36:08.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa785d14700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa780143d10 con 0x7fa78005bbc0 2020-05-18T21:36:08.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa77ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa780062410 0x7fa780062880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37038/0 (socket says 172.21.15.63:37038) 2020-05-18T21:36:08.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa77ffff700 1 -- 172.21.15.63:0/2262234276 learned_addr learned my addr 172.21.15.63:0/2262234276 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:08.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa77f7fe700 1 --2- 172.21.15.63:0/2262234276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa78005bbc0 0x7fa78005f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:08.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa77effd700 1 -- 172.21.15.63:0/2262234276 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290415495 0 0) 0x7fa780142ef0 con 0x7fa780062410 2020-05-18T21:36:08.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa77effd700 1 -- 172.21.15.63:0/2262234276 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa760003270 con 0x7fa780062410 2020-05-18T21:36:08.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa77effd700 1 -- 172.21.15.63:0/2262234276 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718705237 0 0) 0x7fa780143190 con 0x7fa7801438d0 2020-05-18T21:36:08.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa77effd700 1 -- 172.21.15.63:0/2262234276 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa780142ef0 con 0x7fa7801438d0 2020-05-18T21:36:08.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa77f7fe700 1 -- 172.21.15.63:0/2262234276 >> v1:172.21.15.155:6789/0 conn(0x7fa7801438d0 legacy=0x7fa78012bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:08.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa77f7fe700 1 -- 172.21.15.63:0/2262234276 >> v1:172.21.15.63:6789/0 conn(0x7fa780062410 legacy=0x7fa780062880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:08.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa77f7fe700 1 -- 172.21.15.63:0/2262234276 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa780143430 con 0x7fa78005bbc0 2020-05-18T21:36:08.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa77f7fe700 1 --2- 172.21.15.63:0/2262234276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa78005bbc0 0x7fa78005f060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa770002f70 tx=0x7fa770008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:08.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa77f7fe700 1 --2- 172.21.15.63:0/2262234276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa78005bbc0 0x7fa78005f060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa770002f70 tx=0x7fa770008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:08.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa77f7fe700 1 --2- 172.21.15.63:0/2262234276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa78005bbc0 0x7fa78005f060 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7fa770002f70 tx=0x7fa770008920).ready entity=mon.2 client_cookie=20246f9d6fa63ea6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:08.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa77f7fe700 1 --2- 172.21.15.63:0/2262234276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa78005bbc0 0x7fa78005f060 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fa770002f70 tx=0x7fa770008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:08.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa77effd700 1 -- 172.21.15.63:0/2262234276 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa770008e80 con 0x7fa78005bbc0 2020-05-18T21:36:08.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa77f7fe700 1 --2- 172.21.15.63:0/2262234276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa78005bbc0 0x7fa78005f060 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fa770002f70 tx=0x7fa770008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:08.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa77effd700 1 -- 172.21.15.63:0/2262234276 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa770013790 con 0x7fa78005bbc0 2020-05-18T21:36:08.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa77f7fe700 1 --2- 172.21.15.63:0/2262234276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa78005bbc0 0x7fa78005f060 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fa770002f70 tx=0x7fa770008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:08.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa77effd700 1 -- 172.21.15.63:0/2262234276 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa770013b70 con 0x7fa78005bbc0 2020-05-18T21:36:08.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa785d14700 1 -- 172.21.15.63:0/2262234276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa78005bbc0 msgr2=0x7fa78005f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:08.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.418+0000 7fa785d14700 1 --2- 172.21.15.63:0/2262234276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa78005bbc0 0x7fa78005f060 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7fa770002f70 tx=0x7fa770008920).stop 2020-05-18T21:36:08.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.422+0000 7fa785d14700 1 -- 172.21.15.63:0/2262234276 shutdown_connections 2020-05-18T21:36:08.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.422+0000 7fa785d14700 1 --2- 172.21.15.63:0/2262234276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa78005bbc0 0x7fa78005f060 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:08.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.422+0000 7fa785d14700 1 -- 172.21.15.63:0/2262234276 >> 172.21.15.63:0/2262234276 conn(0x7fa7800b95e0 msgr2=0x7fa7800b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:08.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.422+0000 7fa785d14700 1 -- 172.21.15.63:0/2262234276 shutdown_connections 2020-05-18T21:36:08.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.422+0000 7fa785d14700 1 -- 172.21.15.63:0/2262234276 wait complete. 2020-05-18T21:36:08.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.422+0000 7fa785d14700 1 Processor -- start 2020-05-18T21:36:08.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.422+0000 7fa785d14700 1 -- start start 2020-05-18T21:36:08.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.422+0000 7fa785d14700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa780062410 0x7fa7800b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:08.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.422+0000 7fa785d14700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa7801438d0 0x7fa780145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:08.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.422+0000 7fa785d14700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa780146470 con 0x7fa78005bbc0 2020-05-18T21:36:08.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.422+0000 7fa785d14700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa780146260 con 0x7fa7801438d0 2020-05-18T21:36:08.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.422+0000 7fa785d14700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa780146710 con 0x7fa780062410 2020-05-18T21:36:08.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.422+0000 7fa77f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa78005bbc0 0x7fa7800b2ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37040/0 (socket says 172.21.15.63:37040) 2020-05-18T21:36:08.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.422+0000 7fa77f7fe700 1 -- 172.21.15.63:0/1997941172 learned_addr learned my addr 172.21.15.63:0/1997941172 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:08.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.422+0000 7fa77ffff700 1 --2- 172.21.15.63:0/1997941172 >> v2:172.21.15.155:3300/0 conn(0x7fa7801438d0 0x7fa780145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:08.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.422+0000 7fa777fff700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa780062410 0x7fa7800b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:08.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa77d7fa700 1 -- 172.21.15.63:0/1997941172 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892588584 0 0) 0x7fa780146470 con 0x7fa78005bbc0 2020-05-18T21:36:08.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa77d7fa700 1 -- 172.21.15.63:0/1997941172 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa764002fe0 con 0x7fa78005bbc0 2020-05-18T21:36:08.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa77ffff700 1 -- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa780062410 msgr2=0x7fa7800b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:08.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa77ffff700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa780062410 0x7fa7800b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:08.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa77ffff700 1 -- 172.21.15.63:0/1997941172 >> v1:172.21.15.63:6789/0 conn(0x7fa78005bbc0 legacy=0x7fa7800b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:08.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa77ffff700 1 -- 172.21.15.63:0/1997941172 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7801259b0 con 0x7fa7801438d0 2020-05-18T21:36:08.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa77ffff700 1 --2- 172.21.15.63:0/1997941172 >> v2:172.21.15.155:3300/0 conn(0x7fa7801438d0 0x7fa780145c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa778001490 tx=0x7fa778010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:08.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa77ffff700 1 --2- 172.21.15.63:0/1997941172 >> v2:172.21.15.155:3300/0 conn(0x7fa7801438d0 0x7fa780145c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa778001490 tx=0x7fa778010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:08.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa77ffff700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7801438d0 0x7fa780145c50 secure :-1 s=READY pgs=1227 cs=0 l=1 rx=0x7fa778001490 tx=0x7fa778010c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:08.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa77ffff700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7801438d0 0x7fa780145c50 secure :-1 s=THROTTLE_DONE pgs=1227 cs=0 l=1 rx=0x7fa778001490 tx=0x7fa778010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:08.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa77d7fa700 1 -- 172.21.15.63:0/1997941172 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa778012420 con 0x7fa7801438d0 2020-05-18T21:36:08.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa77ffff700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7801438d0 0x7fa780145c50 secure :-1 s=THROTTLE_DONE pgs=1227 cs=0 l=1 rx=0x7fa778001490 tx=0x7fa778010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:08.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa77ffff700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7801438d0 0x7fa780145c50 secure :-1 s=THROTTLE_DONE pgs=1227 cs=0 l=1 rx=0x7fa778001490 tx=0x7fa778010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:08.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa77d7fa700 1 -- 172.21.15.63:0/1997941172 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7780125c0 con 0x7fa7801438d0 2020-05-18T21:36:08.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa77d7fa700 1 -- 172.21.15.63:0/1997941172 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7780129e0 con 0x7fa7801438d0 2020-05-18T21:36:08.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa785d14700 1 -- 172.21.15.63:0/1997941172 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa780125c00 con 0x7fa7801438d0 2020-05-18T21:36:08.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa785d14700 1 -- 172.21.15.63:0/1997941172 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa780065c30 con 0x7fa7801438d0 2020-05-18T21:36:08.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa77ffff700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7801438d0 0x7fa780145c50 secure :-1 s=THROTTLE_DONE pgs=1227 cs=0 l=1 rx=0x7fa778001490 tx=0x7fa778010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:08.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa785d14700 1 -- 172.21.15.63:0/1997941172 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa780146880 con 0x7fa7801438d0 2020-05-18T21:36:08.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa77d7fa700 1 -- 172.21.15.63:0/1997941172 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa778012ca0 con 0x7fa7801438d0 2020-05-18T21:36:08.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.426+0000 7fa77ffff700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7801438d0 0x7fa780145c50 secure :-1 s=THROTTLE_DONE pgs=1227 cs=0 l=1 rx=0x7fa778001490 tx=0x7fa778010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.430+0000 7fa77d7fa700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa76404fd80 0x7fa764052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.430+0000 7fa77d7fa700 1 -- 172.21.15.63:0/1997941172 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa7780090c0 con 0x7fa7801438d0 2020-05-18T21:36:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.430+0000 7fa77f7fe700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa76404fd80 0x7fa764052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.430+0000 7fa77f7fe700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa76404fd80 0x7fa764052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa770000bf0 tx=0x7fa770013540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.430+0000 7fa77f7fe700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa76404fd80 0x7fa764052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa770000bf0 tx=0x7fa770013540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.430+0000 7fa77f7fe700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa76404fd80 0x7fa764052240 secure :-1 s=READY pgs=718 cs=0 l=1 rx=0x7fa770000bf0 tx=0x7fa770013540).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:08.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.438+0000 7fa77ffff700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7801438d0 0x7fa780145c50 secure :-1 s=THROTTLE_DONE pgs=1227 cs=0 l=1 rx=0x7fa778001490 tx=0x7fa778010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:08.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.438+0000 7fa77d7fa700 1 -- 172.21.15.63:0/1997941172 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fa780146880 con 0x7fa7801438d0 2020-05-18T21:36:08.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.586+0000 7fa785d14700 1 -- 172.21.15.63:0/1997941172 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa780146880 con 0x7fa7801438d0 2020-05-18T21:36:08.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.590+0000 7fa77ffff700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7801438d0 0x7fa780145c50 secure :-1 s=THROTTLE_DONE pgs=1227 cs=0 l=1 rx=0x7fa778001490 tx=0x7fa778010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:08.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.590+0000 7fa77d7fa700 1 -- 172.21.15.63:0/1997941172 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+2166 (secure 0 0 0) 0x7fa780146880 con 0x7fa7801438d0 2020-05-18T21:36:08.594 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:08.594 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":110,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:36:08.320082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":9501,"mds_1":9379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9379":{"gid":9379,"name":"b","rank":1,"incarnation":108,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.155:6835/3918574447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3918574447},{"type":"v1","addr":"172.21.15.155:6835","nonce":3918574447}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:36:08.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.590+0000 7fa785d14700 1 -- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa76404fd80 msgr2=0x7fa764052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:08.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.590+0000 7fa785d14700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa76404fd80 0x7fa764052240 secure :-1 s=READY pgs=718 cs=0 l=1 rx=0x7fa770000bf0 tx=0x7fa770013540).stop 2020-05-18T21:36:08.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.590+0000 7fa785d14700 1 -- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7801438d0 msgr2=0x7fa780145c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:08.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.590+0000 7fa785d14700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7801438d0 0x7fa780145c50 secure :-1 s=READY pgs=1227 cs=0 l=1 rx=0x7fa778001490 tx=0x7fa778010c10).stop 2020-05-18T21:36:08.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.590+0000 7fa785d14700 1 -- 172.21.15.63:0/1997941172 shutdown_connections 2020-05-18T21:36:08.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.590+0000 7fa785d14700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa76404fd80 0x7fa764052240 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:08.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.590+0000 7fa785d14700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7801438d0 0x7fa780145c50 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:08.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.590+0000 7fa785d14700 1 --2- 172.21.15.63:0/1997941172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa780062410 0x7fa7800b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:08.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.590+0000 7fa785d14700 1 -- 172.21.15.63:0/1997941172 >> 172.21.15.63:0/1997941172 conn(0x7fa7800b95e0 msgr2=0x7fa7800b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:08.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.590+0000 7fa785d14700 1 -- 172.21.15.63:0/1997941172 shutdown_connections 2020-05-18T21:36:08.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:08.590+0000 7fa785d14700 1 -- 172.21.15.63:0/1997941172 wait complete. 2020-05-18T21:36:08.599 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 110 2020-05-18T21:36:08.810 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 110, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:35:50.157703+0000', 'modified': '2020-05-18T21:36:08.320082+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 135, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 9501, 'mds_1': 9379}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9379': {'gid': 9379, 'name': 'b', 'rank': 1, 'incarnation': 108, 'state': 'up:reconnect', 'state_seq': 3, 'addr': '172.21.15.155:6835/3918574447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3918574447}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3918574447}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}, 'gid_9501': {'gid': 9501, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/169345666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 169345666}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 169345666}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:36:08.811 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9379:up:reconnect 2020-05-18T21:36:09.812 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:36:09.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41593d2700 1 Processor -- start 2020-05-18T21:36:09.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41593d2700 1 -- start start 2020-05-18T21:36:09.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41593d2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f415405ee90 0x7f415409b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:09.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41593d2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f41540b4d70 0x7f415406a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:09.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41593d2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f415406a7c0 0x7f4154142b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:09.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41593d2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f415405f6e0 con 0x7f415406a7c0 2020-05-18T21:36:09.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41593d2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41541424b0 con 0x7f41540b4d70 2020-05-18T21:36:09.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41593d2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4154146840 con 0x7f415405ee90 2020-05-18T21:36:09.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41537fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f415406a7c0 0x7f4154142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:09.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41527fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f41540b4d70 0x7f415406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:09.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f4152ffd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f415405ee90 0x7f415409b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:09.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41537fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f415406a7c0 0x7f4154142b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34864/0 (socket says 172.21.15.63:34864) 2020-05-18T21:36:09.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41537fe700 1 -- 172.21.15.63:0/685319394 learned_addr learned my addr 172.21.15.63:0/685319394 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:36:09.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41537fe700 1 -- 172.21.15.63:0/685319394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f415405ee90 msgr2=0x7f415409b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:09.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41537fe700 1 --2- 172.21.15.63:0/685319394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f415405ee90 0x7f415409b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:09.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41537fe700 1 -- 172.21.15.63:0/685319394 >> v2:172.21.15.155:3300/0 conn(0x7f41540b4d70 msgr2=0x7f415406a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:09.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41537fe700 1 --2- 172.21.15.63:0/685319394 >> v2:172.21.15.155:3300/0 conn(0x7f41540b4d70 0x7f415406a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:09.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41537fe700 1 -- 172.21.15.63:0/685319394 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415405f910 con 0x7f415406a7c0 2020-05-18T21:36:09.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41537fe700 1 --2- 172.21.15.63:0/685319394 >> v2:172.21.15.63:3300/0 conn(0x7f415406a7c0 0x7f4154142b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f414c002f70 tx=0x7f414c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:09.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41537fe700 1 --2- 172.21.15.63:0/685319394 >> v2:172.21.15.63:3300/0 conn(0x7f415406a7c0 0x7f4154142b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f414c002f70 tx=0x7f414c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:09.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.918+0000 7f41537fe700 1 --2- 172.21.15.63:0/685319394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f415406a7c0 0x7f4154142b00 secure :-1 s=READY pgs=1844 cs=0 l=1 rx=0x7f414c002f70 tx=0x7f414c007a80).ready entity=mon.0 client_cookie=e3015ca250cf67d0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:09.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.922+0000 7f41537fe700 1 --2- 172.21.15.63:0/685319394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f415406a7c0 0x7f4154142b00 secure :-1 s=THROTTLE_DONE pgs=1844 cs=0 l=1 rx=0x7f414c002f70 tx=0x7f414c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:09.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.922+0000 7f4151ffb700 1 -- 172.21.15.63:0/685319394 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f414c011600 con 0x7f415406a7c0 2020-05-18T21:36:09.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.922+0000 7f41537fe700 1 --2- 172.21.15.63:0/685319394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f415406a7c0 0x7f4154142b00 secure :-1 s=THROTTLE_DONE pgs=1844 cs=0 l=1 rx=0x7f414c002f70 tx=0x7f414c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:09.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.922+0000 7f4151ffb700 1 -- 172.21.15.63:0/685319394 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414c011760 con 0x7f415406a7c0 2020-05-18T21:36:09.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.922+0000 7f41537fe700 1 --2- 172.21.15.63:0/685319394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f415406a7c0 0x7f4154142b00 secure :-1 s=THROTTLE_DONE pgs=1844 cs=0 l=1 rx=0x7f414c002f70 tx=0x7f414c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:09.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.922+0000 7f41593d2700 1 -- 172.21.15.63:0/685319394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f415406a7c0 msgr2=0x7f4154142b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:09.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.922+0000 7f4151ffb700 1 -- 172.21.15.63:0/685319394 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f414c011b80 con 0x7f415406a7c0 2020-05-18T21:36:09.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.922+0000 7f41593d2700 1 --2- 172.21.15.63:0/685319394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f415406a7c0 0x7f4154142b00 secure :-1 s=READY pgs=1844 cs=0 l=1 rx=0x7f414c002f70 tx=0x7f414c007a80).stop 2020-05-18T21:36:09.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.922+0000 7f41593d2700 1 -- 172.21.15.63:0/685319394 shutdown_connections 2020-05-18T21:36:09.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.922+0000 7f41593d2700 1 --2- 172.21.15.63:0/685319394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f415406a7c0 0x7f4154142b00 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:09.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.922+0000 7f41593d2700 1 --2- 172.21.15.63:0/685319394 >> v2:172.21.15.155:3300/0 conn(0x7f41540b4d70 0x7f415406a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:09.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.922+0000 7f41593d2700 1 --2- 172.21.15.63:0/685319394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f415405ee90 0x7f415409b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:09.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.922+0000 7f41593d2700 1 -- 172.21.15.63:0/685319394 >> 172.21.15.63:0/685319394 conn(0x7f41540b57b0 msgr2=0x7f41540b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:09.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.922+0000 7f41593d2700 1 -- 172.21.15.63:0/685319394 shutdown_connections 2020-05-18T21:36:09.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.922+0000 7f41593d2700 1 -- 172.21.15.63:0/685319394 wait complete. 2020-05-18T21:36:09.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.922+0000 7f41593d2700 1 Processor -- start 2020-05-18T21:36:09.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.922+0000 7f41593d2700 1 -- start start 2020-05-18T21:36:09.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f41593d2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f415405ee90 0x7f41540b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:09.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f41593d2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f41540b4d70 0x7f415413bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:09.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f41593d2700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41540b2930 con 0x7f415406a7c0 2020-05-18T21:36:09.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f41593d2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41540b04f0 con 0x7f415405ee90 2020-05-18T21:36:09.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f41593d2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41541401c0 con 0x7f41540b4d70 2020-05-18T21:36:09.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f4152ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f415405ee90 0x7f41540b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:09.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f4152ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f415405ee90 0x7f41540b0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34866/0 (socket says 172.21.15.63:34866) 2020-05-18T21:36:09.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f4152ffd700 1 -- 172.21.15.63:0/2096465867 learned_addr learned my addr 172.21.15.63:0/2096465867 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:36:09.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f41537fe700 1 --2- 172.21.15.63:0/2096465867 >> v2:172.21.15.155:3300/0 conn(0x7f41540b4d70 0x7f415413bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:09.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f4152ffd700 1 -- 172.21.15.63:0/2096465867 >> v2:172.21.15.155:3300/0 conn(0x7f41540b4d70 msgr2=0x7f415413bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:09.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f4152ffd700 1 --2- 172.21.15.63:0/2096465867 >> v2:172.21.15.155:3300/0 conn(0x7f41540b4d70 0x7f415413bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:09.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f4152ffd700 1 -- 172.21.15.63:0/2096465867 >> v1:172.21.15.63:6789/0 conn(0x7f415406a7c0 legacy=0x7f415413ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:09.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f4152ffd700 1 -- 172.21.15.63:0/2096465867 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415413f430 con 0x7f415405ee90 2020-05-18T21:36:09.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f4152ffd700 1 --2- 172.21.15.63:0/2096465867 >> v2:172.21.15.63:3300/0 conn(0x7f415405ee90 0x7f41540b0090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41440032f0 tx=0x7f41440154c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:09.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f4152ffd700 1 --2- 172.21.15.63:0/2096465867 >> v2:172.21.15.63:3300/0 conn(0x7f415405ee90 0x7f41540b0090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41440032f0 tx=0x7f41440154c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:09.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f4152ffd700 1 --2- 172.21.15.63:0/2096465867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f415405ee90 0x7f41540b0090 secure :-1 s=READY pgs=1846 cs=0 l=1 rx=0x7f41440032f0 tx=0x7f41440154c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:09.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f4152ffd700 1 --2- 172.21.15.63:0/2096465867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f415405ee90 0x7f41540b0090 secure :-1 s=THROTTLE_DONE pgs=1846 cs=0 l=1 rx=0x7f41440032f0 tx=0x7f41440154c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:09.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f4152ffd700 1 --2- 172.21.15.63:0/2096465867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f415405ee90 0x7f41540b0090 secure :-1 s=THROTTLE_DONE pgs=1846 cs=0 l=1 rx=0x7f41440032f0 tx=0x7f41440154c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:09.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f414bfff700 1 -- 172.21.15.63:0/2096465867 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4144016e60 con 0x7f415405ee90 2020-05-18T21:36:09.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f4152ffd700 1 --2- 172.21.15.63:0/2096465867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f415405ee90 0x7f41540b0090 secure :-1 s=THROTTLE_DONE pgs=1846 cs=0 l=1 rx=0x7f41440032f0 tx=0x7f41440154c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:09.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f414bfff700 1 -- 172.21.15.63:0/2096465867 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414400e0c0 con 0x7f415405ee90 2020-05-18T21:36:09.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f41593d2700 1 -- 172.21.15.63:0/2096465867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4154140460 con 0x7f415405ee90 2020-05-18T21:36:09.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f414bfff700 1 -- 172.21.15.63:0/2096465867 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4144005e60 con 0x7f415405ee90 2020-05-18T21:36:09.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f41593d2700 1 -- 172.21.15.63:0/2096465867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415413c3f0 con 0x7f415405ee90 2020-05-18T21:36:09.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f41593d2700 1 -- 172.21.15.63:0/2096465867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4154140660 con 0x7f415405ee90 2020-05-18T21:36:09.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f4152ffd700 1 --2- 172.21.15.63:0/2096465867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f415405ee90 0x7f41540b0090 secure :-1 s=THROTTLE_DONE pgs=1846 cs=0 l=1 rx=0x7f41440032f0 tx=0x7f41440154c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:09.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f414bfff700 1 -- 172.21.15.63:0/2096465867 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4144007370 con 0x7f415405ee90 2020-05-18T21:36:09.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.926+0000 7f4152ffd700 1 --2- 172.21.15.63:0/2096465867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f415405ee90 0x7f41540b0090 secure :-1 s=THROTTLE_DONE pgs=1846 cs=0 l=1 rx=0x7f41440032f0 tx=0x7f41440154c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:09.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.930+0000 7f414bfff700 1 --2- 172.21.15.63:0/2096465867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f412c04fa60 0x7f412c051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:09.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.930+0000 7f414bfff700 1 -- 172.21.15.63:0/2096465867 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f4144068710 con 0x7f415405ee90 2020-05-18T21:36:09.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.930+0000 7f41527fc700 1 --2- 172.21.15.63:0/2096465867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f412c04fa60 0x7f412c051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:09.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.930+0000 7f41527fc700 1 --2- 172.21.15.63:0/2096465867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f412c04fa60 0x7f412c051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41540b16e0 tx=0x7f413c007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:09.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.930+0000 7f41527fc700 1 --2- 172.21.15.63:0/2096465867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f412c04fa60 0x7f412c051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41540b16e0 tx=0x7f413c007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:09.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.930+0000 7f41527fc700 1 --2- 172.21.15.63:0/2096465867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f412c04fa60 0x7f412c051f20 secure :-1 s=READY pgs=719 cs=0 l=1 rx=0x7f41540b16e0 tx=0x7f413c007e70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:09.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.934+0000 7f4152ffd700 1 --2- 172.21.15.63:0/2096465867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f415405ee90 0x7f41540b0090 secure :-1 s=THROTTLE_DONE pgs=1846 cs=0 l=1 rx=0x7f41440032f0 tx=0x7f41440154c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:09.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:09.934+0000 7f414bfff700 1 -- 172.21.15.63:0/2096465867 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f4154140660 con 0x7f415405ee90 2020-05-18T21:36:10.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:10.086+0000 7f41593d2700 1 -- 172.21.15.63:0/2096465867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4154140660 con 0x7f415405ee90 2020-05-18T21:36:10.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:10.090+0000 7f4152ffd700 1 --2- 172.21.15.63:0/2096465867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f415405ee90 0x7f41540b0090 secure :-1 s=THROTTLE_DONE pgs=1846 cs=0 l=1 rx=0x7f41440032f0 tx=0x7f41440154c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:10.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:10.090+0000 7f414bfff700 1 -- 172.21.15.63:0/2096465867 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+2163 (secure 0 0 0) 0x7f4154140660 con 0x7f415405ee90 2020-05-18T21:36:10.094 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:10.094 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":111,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:36:09.323576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":9501,"mds_1":9379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9379":{"gid":9379,"name":"b","rank":1,"incarnation":108,"state":"up:rejoin","state_seq":4,"addr":"172.21.15.155:6835/3918574447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3918574447},{"type":"v1","addr":"172.21.15.155:6835","nonce":3918574447}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:36:10.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:10.090+0000 7f41593d2700 1 -- 172.21.15.63:0/2096465867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f412c04fa60 msgr2=0x7f412c051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:10.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:10.090+0000 7f41593d2700 1 --2- 172.21.15.63:0/2096465867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f412c04fa60 0x7f412c051f20 secure :-1 s=READY pgs=719 cs=0 l=1 rx=0x7f41540b16e0 tx=0x7f413c007e70).stop 2020-05-18T21:36:10.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:10.090+0000 7f41593d2700 1 -- 172.21.15.63:0/2096465867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f415405ee90 msgr2=0x7f41540b0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:10.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:10.090+0000 7f41593d2700 1 --2- 172.21.15.63:0/2096465867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f415405ee90 0x7f41540b0090 secure :-1 s=READY pgs=1846 cs=0 l=1 rx=0x7f41440032f0 tx=0x7f41440154c0).stop 2020-05-18T21:36:10.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:10.090+0000 7f41593d2700 1 -- 172.21.15.63:0/2096465867 shutdown_connections 2020-05-18T21:36:10.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:10.090+0000 7f41593d2700 1 --2- 172.21.15.63:0/2096465867 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f412c04fa60 0x7f412c051f20 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:10.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:10.090+0000 7f41593d2700 1 --2- 172.21.15.63:0/2096465867 >> v2:172.21.15.155:3300/0 conn(0x7f41540b4d70 0x7f415413bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:10.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:10.090+0000 7f41593d2700 1 --2- 172.21.15.63:0/2096465867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f415405ee90 0x7f41540b0090 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:10.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:10.090+0000 7f41593d2700 1 -- 172.21.15.63:0/2096465867 >> 172.21.15.63:0/2096465867 conn(0x7f41540b57b0 msgr2=0x7f41540b3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:10.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:10.090+0000 7f41593d2700 1 -- 172.21.15.63:0/2096465867 shutdown_connections 2020-05-18T21:36:10.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:10.090+0000 7f41593d2700 1 -- 172.21.15.63:0/2096465867 wait complete. 2020-05-18T21:36:10.098 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 111 2020-05-18T21:36:10.307 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 111, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:35:50.157703+0000', 'modified': '2020-05-18T21:36:09.323576+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 135, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 9501, 'mds_1': 9379}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9379': {'gid': 9379, 'name': 'b', 'rank': 1, 'incarnation': 108, 'state': 'up:rejoin', 'state_seq': 4, 'addr': '172.21.15.155:6835/3918574447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3918574447}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3918574447}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}, 'gid_9501': {'gid': 9501, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/169345666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 169345666}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 169345666}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:36:10.308 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9379:up:rejoin 2020-05-18T21:36:11.310 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:36:11.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.422+0000 7f34a6a92700 1 Processor -- start 2020-05-18T21:36:11.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.422+0000 7f34a6a92700 1 -- start start 2020-05-18T21:36:11.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a6a92700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f34a013cd20 0x7f34a005bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:11.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a6a92700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a0142b90 0x7f34a0143010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:11.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a6a92700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a00b5470 con 0x7f34a00b5000 2020-05-18T21:36:11.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a6a92700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a013d100 con 0x7f34a013cd20 2020-05-18T21:36:11.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a6a92700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a01462a0 con 0x7f34a0142b90 2020-05-18T21:36:11.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a5a90700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f34a013cd20 0x7f34a005bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:11.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a528f700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f34a00b5000 0x7f34a00b5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37064/0 (socket says 172.21.15.63:37064) 2020-05-18T21:36:11.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a5a90700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f34a013cd20 0x7f34a005bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34874/0 (socket says 172.21.15.63:34874) 2020-05-18T21:36:11.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a528f700 1 -- 172.21.15.63:0/2339757639 learned_addr learned my addr 172.21.15.63:0/2339757639 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:11.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a6291700 1 --2- 172.21.15.63:0/2339757639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a0142b90 0x7f34a0143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:11.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a5a90700 1 -- 172.21.15.63:0/2339757639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a0142b90 msgr2=0x7f34a0143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:11.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a5a90700 1 --2- 172.21.15.63:0/2339757639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a0142b90 0x7f34a0143010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:11.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a5a90700 1 -- 172.21.15.63:0/2339757639 >> v1:172.21.15.63:6789/0 conn(0x7f34a00b5000 legacy=0x7f34a00b5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:11.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a4a8e700 1 -- 172.21.15.63:0/2339757639 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129433427 0 0) 0x7f34a00b5470 con 0x7f34a00b5000 2020-05-18T21:36:11.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a5a90700 1 -- 172.21.15.63:0/2339757639 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0146540 con 0x7f34a013cd20 2020-05-18T21:36:11.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a5a90700 1 --2- 172.21.15.63:0/2339757639 >> v2:172.21.15.63:3300/0 conn(0x7f34a013cd20 0x7f34a005bab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f349c002f70 tx=0x7f349c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:11.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a5a90700 1 --2- 172.21.15.63:0/2339757639 >> v2:172.21.15.63:3300/0 conn(0x7f34a013cd20 0x7f34a005bab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f349c002f70 tx=0x7f349c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:11.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a5a90700 1 --2- 172.21.15.63:0/2339757639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a013cd20 0x7f34a005bab0 secure :-1 s=READY pgs=1848 cs=0 l=1 rx=0x7f349c002f70 tx=0x7f349c007a80).ready entity=mon.0 client_cookie=7c7e1b6a847d343a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:11.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a5a90700 1 --2- 172.21.15.63:0/2339757639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a013cd20 0x7f34a005bab0 secure :-1 s=THROTTLE_DONE pgs=1848 cs=0 l=1 rx=0x7f349c002f70 tx=0x7f349c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:11.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a5a90700 1 --2- 172.21.15.63:0/2339757639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a013cd20 0x7f34a005bab0 secure :-1 s=THROTTLE_DONE pgs=1848 cs=0 l=1 rx=0x7f349c002f70 tx=0x7f349c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:11.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a4a8e700 1 -- 172.21.15.63:0/2339757639 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f349c008e80 con 0x7f34a013cd20 2020-05-18T21:36:11.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a5a90700 1 --2- 172.21.15.63:0/2339757639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a013cd20 0x7f34a005bab0 secure :-1 s=THROTTLE_DONE pgs=1848 cs=0 l=1 rx=0x7f349c002f70 tx=0x7f349c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:11.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a4a8e700 1 -- 172.21.15.63:0/2339757639 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c0115f0 con 0x7f34a013cd20 2020-05-18T21:36:11.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a6a92700 1 -- 172.21.15.63:0/2339757639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a013cd20 msgr2=0x7f34a005bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:11.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a6a92700 1 --2- 172.21.15.63:0/2339757639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a013cd20 0x7f34a005bab0 secure :-1 s=READY pgs=1848 cs=0 l=1 rx=0x7f349c002f70 tx=0x7f349c007a80).stop 2020-05-18T21:36:11.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a4a8e700 1 -- 172.21.15.63:0/2339757639 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f349c0119d0 con 0x7f34a013cd20 2020-05-18T21:36:11.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a6a92700 1 -- 172.21.15.63:0/2339757639 shutdown_connections 2020-05-18T21:36:11.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a6a92700 1 --2- 172.21.15.63:0/2339757639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a0142b90 0x7f34a0143010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:11.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a6a92700 1 --2- 172.21.15.63:0/2339757639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a013cd20 0x7f34a005bab0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:11.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a6a92700 1 -- 172.21.15.63:0/2339757639 >> 172.21.15.63:0/2339757639 conn(0x7f34a00b9680 msgr2=0x7f34a00b5650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:11.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a6a92700 1 -- 172.21.15.63:0/2339757639 shutdown_connections 2020-05-18T21:36:11.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.426+0000 7f34a6a92700 1 -- 172.21.15.63:0/2339757639 wait complete. 2020-05-18T21:36:11.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f34a6a92700 1 Processor -- start 2020-05-18T21:36:11.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f34a6a92700 1 -- start start 2020-05-18T21:36:11.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f34a6a92700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a00b5000 0x7f34a00afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:11.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f34a6a92700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a0155640 con 0x7f34a013cd20 2020-05-18T21:36:11.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f34a6a92700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a0154e90 con 0x7f34a0142b90 2020-05-18T21:36:11.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f34a6a92700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a0155100 con 0x7f34a00b5000 2020-05-18T21:36:11.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f34a528f700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f34a013cd20 0x7f34a0154780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37070/0 (socket says 172.21.15.63:37070) 2020-05-18T21:36:11.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f34a528f700 1 -- 172.21.15.63:0/1749509552 learned_addr learned my addr 172.21.15.63:0/1749509552 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:11.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f34a5a90700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a00b5000 0x7f34a00afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:11.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f348effd700 1 -- 172.21.15.63:0/1749509552 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617809521 0 0) 0x7f34a0155640 con 0x7f34a013cd20 2020-05-18T21:36:11.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f348effd700 1 -- 172.21.15.63:0/1749509552 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3480002fe0 con 0x7f34a013cd20 2020-05-18T21:36:11.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f348effd700 1 -- 172.21.15.63:0/1749509552 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687751199 0 0) 0x7f34a0154e90 con 0x7f34a0142b90 2020-05-18T21:36:11.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f348effd700 1 -- 172.21.15.63:0/1749509552 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34a0155640 con 0x7f34a0142b90 2020-05-18T21:36:11.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f34a5a90700 1 -- 172.21.15.63:0/1749509552 >> v1:172.21.15.155:6789/0 conn(0x7f34a0142b90 legacy=0x7f34a013bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:11.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f34a5a90700 1 -- 172.21.15.63:0/1749509552 >> v1:172.21.15.63:6789/0 conn(0x7f34a013cd20 legacy=0x7f34a0154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:11.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f34a5a90700 1 -- 172.21.15.63:0/1749509552 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a01553a0 con 0x7f34a00b5000 2020-05-18T21:36:11.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f34a5a90700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a00b5000 0x7f34a00afc30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f349c002f70 tx=0x7f349c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:11.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f34a5a90700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a00b5000 0x7f34a00afc30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f349c002f70 tx=0x7f349c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:11.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f34a5a90700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a00b5000 0x7f34a00afc30 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7f349c002f70 tx=0x7f349c007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:11.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.430+0000 7f34a5a90700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a00b5000 0x7f34a00afc30 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7f349c002f70 tx=0x7f349c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:11.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.434+0000 7f348effd700 1 -- 172.21.15.63:0/1749509552 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f349c011980 con 0x7f34a00b5000 2020-05-18T21:36:11.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.434+0000 7f34a5a90700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a00b5000 0x7f34a00afc30 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7f349c002f70 tx=0x7f349c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:11.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.434+0000 7f34a5a90700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a00b5000 0x7f34a00afc30 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7f349c002f70 tx=0x7f349c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:11.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.434+0000 7f348effd700 1 -- 172.21.15.63:0/1749509552 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c007170 con 0x7f34a00b5000 2020-05-18T21:36:11.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.434+0000 7f34a6a92700 1 -- 172.21.15.63:0/1749509552 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a00b87b0 con 0x7f34a00b5000 2020-05-18T21:36:11.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.434+0000 7f348effd700 1 -- 172.21.15.63:0/1749509552 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f349c0074d0 con 0x7f34a00b5000 2020-05-18T21:36:11.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.434+0000 7f34a6a92700 1 -- 172.21.15.63:0/1749509552 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a013c510 con 0x7f34a00b5000 2020-05-18T21:36:11.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.434+0000 7f34a5a90700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a00b5000 0x7f34a00afc30 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7f349c002f70 tx=0x7f349c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:11.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.434+0000 7f34a6a92700 1 -- 172.21.15.63:0/1749509552 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a0063350 con 0x7f34a00b5000 2020-05-18T21:36:11.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.434+0000 7f348effd700 1 -- 172.21.15.63:0/1749509552 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f349c005700 con 0x7f34a00b5000 2020-05-18T21:36:11.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.434+0000 7f34a5a90700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a00b5000 0x7f34a00afc30 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7f349c002f70 tx=0x7f349c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:11.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.434+0000 7f348effd700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f348004fe60 0x7f3480052320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:11.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.434+0000 7f348effd700 1 -- 172.21.15.63:0/1749509552 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f349c064190 con 0x7f34a00b5000 2020-05-18T21:36:11.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.434+0000 7f34a528f700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f348004fe60 0x7f3480052320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:11.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.434+0000 7f34a528f700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f348004fe60 0x7f3480052320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f34900010c0 tx=0x7f34900017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:11.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.434+0000 7f34a528f700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f348004fe60 0x7f3480052320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f34900010c0 tx=0x7f34900017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:11.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.434+0000 7f34a528f700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f348004fe60 0x7f3480052320 secure :-1 s=READY pgs=720 cs=0 l=1 rx=0x7f34900010c0 tx=0x7f34900017a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:11.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.442+0000 7f34a5a90700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a00b5000 0x7f34a00afc30 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7f349c002f70 tx=0x7f349c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:11.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.442+0000 7f348effd700 1 -- 172.21.15.63:0/1749509552 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f349c03e520 con 0x7f34a00b5000 2020-05-18T21:36:11.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.594+0000 7f34a6a92700 1 -- 172.21.15.63:0/1749509552 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34a00569e0 con 0x7f34a00b5000 2020-05-18T21:36:11.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.598+0000 7f34a5a90700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a00b5000 0x7f34a00afc30 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7f349c002f70 tx=0x7f349c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:11.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.598+0000 7f348effd700 1 -- 172.21.15.63:0/1749509552 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+2163 (secure 0 0 0) 0x7f349c041b40 con 0x7f34a00b5000 2020-05-18T21:36:11.602 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:11.603 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":112,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:36:10.326334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":9501,"mds_1":9379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9379":{"gid":9379,"name":"b","rank":1,"incarnation":108,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/3918574447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3918574447},{"type":"v1","addr":"172.21.15.155:6835","nonce":3918574447}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:36:11.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.598+0000 7f34a6a92700 1 -- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f348004fe60 msgr2=0x7f3480052320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:11.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.598+0000 7f34a6a92700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f348004fe60 0x7f3480052320 secure :-1 s=READY pgs=720 cs=0 l=1 rx=0x7f34900010c0 tx=0x7f34900017a0).stop 2020-05-18T21:36:11.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.598+0000 7f34a6a92700 1 -- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a00b5000 msgr2=0x7f34a00afc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:11.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.598+0000 7f34a6a92700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a00b5000 0x7f34a00afc30 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7f349c002f70 tx=0x7f349c007a80).stop 2020-05-18T21:36:11.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.598+0000 7f34a6a92700 1 -- 172.21.15.63:0/1749509552 shutdown_connections 2020-05-18T21:36:11.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.598+0000 7f34a6a92700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f348004fe60 0x7f3480052320 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:11.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.598+0000 7f34a6a92700 1 --2- 172.21.15.63:0/1749509552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34a00b5000 0x7f34a00afc30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:11.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.598+0000 7f34a6a92700 1 -- 172.21.15.63:0/1749509552 >> 172.21.15.63:0/1749509552 conn(0x7f34a00b9680 msgr2=0x7f34a00b5650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:11.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.598+0000 7f34a6a92700 1 -- 172.21.15.63:0/1749509552 shutdown_connections 2020-05-18T21:36:11.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:11.598+0000 7f34a6a92700 1 -- 172.21.15.63:0/1749509552 wait complete. 2020-05-18T21:36:11.606 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 112 2020-05-18T21:36:11.818 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 112, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:35:50.157703+0000', 'modified': '2020-05-18T21:36:10.326334+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 135, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 9501, 'mds_1': 9379}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9379': {'gid': 9379, 'name': 'b', 'rank': 1, 'incarnation': 108, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.155:6835/3918574447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3918574447}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3918574447}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}, 'gid_9501': {'gid': 9501, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/169345666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 169345666}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 169345666}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:36:11.818 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2020-05-18T21:36:11.819 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:36:11.928 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:36:11.928 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:36:11.929 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 1, 2020-05-18T21:36:11.929 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 9379, 2020-05-18T21:36:11.929 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:36:11.930 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:36:11.930 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 5.6166596139999996, 2020-05-18T21:36:11.931 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 112, 2020-05-18T21:36:11.931 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 135, 2020-05-18T21:36:11.931 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 135, 2020-05-18T21:36:11.932 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 6.5230556359999996 2020-05-18T21:36:11.932 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:36:11.937 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 1, "id": 9379, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.6166596139999996, "mdsmap_epoch": 112, "osdmap_epoch": 135, "osdmap_epoch_barrier": 135, "uptime": 6.5230556359999996 } 2020-05-18T21:36:11.938 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:36:12.045 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:36:12.046 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:36:12.046 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:36:12.046 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 9501, 2020-05-18T21:36:12.046 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:36:12.047 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:36:12.047 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 21.880423625999999, 2020-05-18T21:36:12.047 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 112, 2020-05-18T21:36:12.047 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 135, 2020-05-18T21:36:12.047 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 135, 2020-05-18T21:36:12.047 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 26.098320215000001 2020-05-18T21:36:12.048 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:36:12.054 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 9501, "want_state": "up:active", "state": "up:active", "rank_uptime": 21.880423625999999, "mdsmap_epoch": 112, "osdmap_epoch": 135, "osdmap_epoch_barrier": 135, "uptime": 26.098320215000001 } 2020-05-18T21:36:12.055 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:36:12.056 INFO:teuthology.orchestra.run.smithi063:> import sys 2020-05-18T21:36:12.056 INFO:teuthology.orchestra.run.smithi063:> import time 2020-05-18T21:36:12.057 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:36:12.057 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:36:12.057 INFO:teuthology.orchestra.run.smithi063:> n = 5 2020-05-18T21:36:12.058 INFO:teuthology.orchestra.run.smithi063:> abs_path = "/home/ubuntu/cephtest/mnt.0/delete_me/file" 2020-05-18T21:36:12.058 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:36:12.059 INFO:teuthology.orchestra.run.smithi063:> if not os.path.exists(os.path.dirname(abs_path)): 2020-05-18T21:36:12.059 INFO:teuthology.orchestra.run.smithi063:> os.makedirs(os.path.dirname(abs_path)) 2020-05-18T21:36:12.060 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:36:12.060 INFO:teuthology.orchestra.run.smithi063:> for i in range(0, n): 2020-05-18T21:36:12.060 INFO:teuthology.orchestra.run.smithi063:> fname = "{0}_{1}".format(abs_path, i) 2020-05-18T21:36:12.061 INFO:teuthology.orchestra.run.smithi063:> with open(fname, '"'"'w'"'"') as f: 2020-05-18T21:36:12.061 INFO:teuthology.orchestra.run.smithi063:> f.write('"'"'content'"'"') 2020-05-18T21:36:12.062 INFO:teuthology.orchestra.run.smithi063:> if False: 2020-05-18T21:36:12.062 INFO:teuthology.orchestra.run.smithi063:> f.flush() 2020-05-18T21:36:12.064 INFO:teuthology.orchestra.run.smithi063:> os.fsync(f.fileno()) 2020-05-18T21:36:12.064 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:36:12.333 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:36:12.334 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:36:12.335 INFO:teuthology.orchestra.run.smithi063:> import stat 2020-05-18T21:36:12.336 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:36:12.336 INFO:teuthology.orchestra.run.smithi063:> print(os.stat("/home/ubuntu/cephtest/mnt.0/delete_me/file_0").st_ino) 2020-05-18T21:36:12.337 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:36:12.418 INFO:teuthology.orchestra.run.smithi063.stdout:1099511627777 2020-05-18T21:36:12.607 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.pin -v 1 delete_me) 2020-05-18T21:36:12.638 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok dump cache 2020-05-18T21:36:12.746 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2020-05-18T21:36:12.746 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:12.747 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1, 2020-05-18T21:36:12.747 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:12.747 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:12.747 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:50.165450+0000", 2020-05-18T21:36:12.748 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 17407, 2020-05-18T21:36:12.748 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:12.748 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:12.748 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:12.749 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:12.749 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:12.749 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:12.749 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:12.749 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:12.750 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.750 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:12.750 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:36:12.750 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:36:12.750 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:36:12.751 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 26, 2020-05-18T21:36:12.751 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:12.751 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.751 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:12.751 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:12.752 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:12.752 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:12.752 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:12.752 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:12.752 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:12.753 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:12.753 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:12.753 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:36:12.754 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:12.754 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:12.754 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:12.754 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.755 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:12.755 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:12.755 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 1, 2020-05-18T21:36:12.755 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1 2020-05-18T21:36:12.756 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.756 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:12.756 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.756 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:12.756 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:12.757 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:12.757 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:12.757 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:57.723581+0000" 2020-05-18T21:36:12.757 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.757 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:12.757 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.758 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:12.758 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:12.758 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:12.758 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:12.758 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:50.165450+0000" 2020-05-18T21:36:12.759 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.759 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 4, 2020-05-18T21:36:12.759 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:12.759 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:12.759 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 3, 2020-05-18T21:36:12.759 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:12.760 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:12.760 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:12.760 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:12.760 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:12.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.761 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:12.761 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:12.761 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:12.761 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:12.761 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:12.761 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:12.762 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.762 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:12.762 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:12.762 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:12.762 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:36:12.763 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:12.763 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:12.763 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.763 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:12.763 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:12.764 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:36:12.764 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:12.764 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.764 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:36:12.765 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.765 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:12.765 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:12.766 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:12.766 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:12.766 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": 0, 2020-05-18T21:36:12.766 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 0 2020-05-18T21:36:12.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.767 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:36:12.767 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:12.767 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:12.767 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:12.768 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:12.768 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:12.768 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:12.768 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:12.768 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:12.769 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.769 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:12.769 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:12.769 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:12.769 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:12.770 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:12.770 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:12.770 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:36:12.770 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:12.770 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:36:12.771 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:12.771 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:12.771 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:12.771 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:12.771 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:12.771 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.772 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:12.772 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:12.772 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [], 2020-05-18T21:36:12.772 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:12.772 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:12.773 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:12.774 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:12.774 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:36:12.774 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.774 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:12.774 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1546, 2020-05-18T21:36:12.775 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:12.775 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:12.775 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:12.775 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:12.775 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:12.775 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:12.776 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:12.776 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:12.776 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:12.776 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:12.776 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:12.777 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:12.777 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.777 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:12.777 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:12.777 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:12.778 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:12.778 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:12.778 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:12.778 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.778 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:12.778 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:12.780 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:12.780 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:12.780 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:12.780 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:12.780 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:12.780 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:12.781 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.781 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:12.781 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:12.781 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:12.781 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:12.783 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:12.783 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261727+0000" 2020-05-18T21:36:12.783 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.783 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:12.783 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.784 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:12.784 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:12.784 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:12.784 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:12.784 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261727+0000" 2020-05-18T21:36:12.784 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.785 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:12.785 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:12.785 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:12.785 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:12.785 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:12.786 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:12.786 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:12.786 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:12.786 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:12.786 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.786 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:12.787 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:12.787 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:12.787 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:12.787 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:12.787 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:12.788 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.788 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:12.788 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:12.788 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:12.788 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:12.790 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:12.790 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.790 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:12.790 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.790 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:12.792 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.792 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:12.792 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:12.792 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:12.792 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.794 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:12.794 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:12.794 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:12.794 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:12.794 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:12.796 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:12.796 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.796 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:12.796 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:12.796 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:12.797 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:12.797 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:12.797 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:12.797 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray0", 2020-05-18T21:36:12.798 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60a", 2020-05-18T21:36:12.798 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:12.798 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:12.798 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:12.798 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:12.799 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:12.799 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:12.799 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:12.799 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:12.801 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:12.801 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.801 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:12.801 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:12.801 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:12.802 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:12.802 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.802 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:12.802 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.802 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:12.802 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:12.803 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:12.803 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:12.803 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:12.803 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:12.803 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:12.805 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.805 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:12.805 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1547, 2020-05-18T21:36:12.805 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:12.805 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:12.805 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:12.806 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:12.806 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:12.806 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:12.806 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:12.806 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:12.808 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:12.808 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:12.808 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:12.808 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:12.808 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:12.809 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.809 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:12.809 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:12.809 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:12.809 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:12.810 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:12.810 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:12.810 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:12.810 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:12.810 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:12.810 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:12.811 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:12.811 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:12.811 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:12.811 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.811 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:12.812 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:12.812 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:12.812 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:12.812 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.812 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:12.812 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.813 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:12.813 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:12.813 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:12.813 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:12.813 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261988+0000" 2020-05-18T21:36:12.814 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.814 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:12.814 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.814 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:12.815 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:12.815 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:12.815 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:12.815 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261988+0000" 2020-05-18T21:36:12.815 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.815 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:12.816 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:12.816 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:12.816 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:12.816 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:12.816 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:12.817 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:12.817 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:12.817 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:12.817 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.817 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:12.817 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:12.818 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:12.818 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:12.818 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:12.818 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:12.818 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.819 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:12.819 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:12.819 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:12.819 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:12.819 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:12.819 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:12.820 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.820 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:12.820 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:12.820 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:12.820 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:12.820 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.821 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:12.821 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.821 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:12.821 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:12.821 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:12.822 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:12.822 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:12.822 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:12.822 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:12.822 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.822 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:12.823 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:12.823 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:12.823 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:12.823 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:12.823 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:12.824 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:12.824 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:12.824 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:12.824 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.824 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:12.824 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:12.825 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:12.825 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:12.825 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:12.825 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:12.825 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:12.826 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:12.826 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:12.826 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:12.826 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:12.826 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:12.826 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.827 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:12.827 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:12.827 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:12.827 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:12.827 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:12.828 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:12.828 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray1", 2020-05-18T21:36:12.828 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60b", 2020-05-18T21:36:12.828 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:12.828 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:12.828 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:12.829 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:12.829 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:12.829 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:12.829 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:12.829 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:12.830 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:12.830 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:12.830 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:12.830 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.830 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:12.830 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:12.831 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:12.831 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.831 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:12.831 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:12.831 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:12.831 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:12.832 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.832 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:12.832 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.832 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:12.832 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:12.833 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:12.833 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:12.833 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:12.833 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:12.833 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:12.833 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:12.834 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.834 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:12.834 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:12.834 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:12.834 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:12.835 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.835 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:12.835 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1548, 2020-05-18T21:36:12.835 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:12.835 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:12.835 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:12.836 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:12.836 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:12.836 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:12.836 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:12.836 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:12.837 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:12.837 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:12.837 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:12.837 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:12.837 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.837 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:12.838 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:12.838 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:12.838 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:12.838 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:12.838 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:12.839 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.839 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:12.839 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:12.839 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:12.839 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:12.839 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:12.840 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:12.840 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:12.840 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:12.840 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:12.840 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:12.841 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:12.841 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:12.841 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:12.841 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.841 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:12.841 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:12.842 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:12.842 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:12.842 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.842 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:12.842 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.843 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:12.843 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:12.843 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:12.843 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:12.843 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262165+0000" 2020-05-18T21:36:12.843 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.844 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:12.844 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.844 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:12.844 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:12.844 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:12.845 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:12.845 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262165+0000" 2020-05-18T21:36:12.845 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.845 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:12.845 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:12.845 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:12.846 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:12.846 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:12.846 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:12.846 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:12.846 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:12.847 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:12.847 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.847 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:12.847 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:12.847 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:12.847 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:12.848 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:12.848 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:12.848 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.848 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:12.848 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:12.848 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:12.849 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:12.849 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:12.849 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:12.849 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.849 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:12.850 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:12.850 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:12.850 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:12.850 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.850 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:12.850 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.851 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:12.851 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:12.851 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:12.851 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:12.851 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:12.852 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:12.852 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:12.852 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.852 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:12.852 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:12.852 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:12.853 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:12.853 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:12.853 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:12.853 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:12.853 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:12.854 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:12.854 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.854 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:12.854 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:12.855 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:12.855 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:12.855 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:12.855 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:12.855 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:12.855 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:12.856 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:12.856 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:12.856 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:12.856 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:12.856 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.857 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:12.857 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:12.857 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:12.857 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:12.857 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:12.857 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:12.858 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray2", 2020-05-18T21:36:12.858 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60c", 2020-05-18T21:36:12.858 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:12.858 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:12.858 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:12.859 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:12.859 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:12.859 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:12.859 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:12.859 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:12.859 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:12.860 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:12.860 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:12.860 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.860 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:12.861 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:12.862 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:12.862 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.862 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:12.862 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:12.862 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:12.863 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:12.863 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.863 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:12.863 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.863 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:12.864 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:12.864 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:12.864 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:12.864 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:12.864 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:12.864 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:12.865 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:12.865 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.865 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:12.865 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:12.866 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:12.866 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:12.866 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.866 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:12.866 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1551, 2020-05-18T21:36:12.866 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:12.867 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:12.867 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:12.868 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:12.868 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:12.868 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:12.868 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:12.868 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:12.869 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:12.869 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:12.869 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:12.869 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:12.870 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.870 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:12.870 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:12.870 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:12.870 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:12.871 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:12.871 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:12.871 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.871 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:12.871 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:12.871 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:12.872 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:12.872 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:12.872 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:12.872 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:12.872 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:12.873 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:12.873 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:12.873 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:12.873 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:12.873 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:12.873 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.874 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:12.874 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:12.874 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:12.874 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:12.874 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.875 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:12.875 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.875 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:12.875 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:12.875 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:12.875 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:12.876 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262725+0000" 2020-05-18T21:36:12.876 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.876 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:12.876 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.876 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:12.877 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:12.877 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:12.877 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:12.877 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262725+0000" 2020-05-18T21:36:12.878 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.878 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:12.878 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:12.878 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:12.878 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:12.879 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:12.879 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:12.879 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:12.879 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:12.879 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:12.881 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.881 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:12.881 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:12.881 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:12.881 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:12.882 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:12.882 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:12.882 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.882 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:12.882 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:12.882 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:12.883 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:12.883 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:12.883 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:12.883 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.883 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:12.884 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:12.884 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:12.884 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:12.884 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.884 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:12.885 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.885 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:12.885 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:12.886 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:12.886 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:12.886 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:12.886 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:12.886 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:12.887 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.887 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:12.887 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:12.887 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:12.887 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:12.887 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:12.888 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:12.888 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:12.888 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:12.889 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:12.889 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.889 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:12.889 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:12.890 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:12.890 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:12.890 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:12.890 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:12.890 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:12.890 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:12.891 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:12.891 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:12.891 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:12.891 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:12.891 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.892 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:12.892 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:12.892 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:12.892 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:12.892 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:12.892 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:12.893 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray5", 2020-05-18T21:36:12.893 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60f", 2020-05-18T21:36:12.893 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:12.893 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:12.893 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:12.894 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:12.894 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:12.894 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:12.894 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:12.894 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:12.894 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:12.895 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:12.895 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:12.895 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.895 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:12.895 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:12.896 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:12.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.896 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:12.896 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:12.896 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:12.896 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:12.897 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.897 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:12.897 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.897 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:12.897 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:12.898 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:12.898 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:12.898 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:12.898 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:12.899 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:12.899 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:12.899 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.899 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:12.899 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:12.900 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:12.900 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:12.900 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.900 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:12.901 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1552, 2020-05-18T21:36:12.901 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:12.901 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:12.901 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:12.901 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:12.901 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:12.902 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:12.902 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:12.902 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:12.902 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:12.902 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:12.903 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:12.903 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:12.903 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.903 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:12.904 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:12.905 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:12.905 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:12.905 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:12.905 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:12.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.906 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:12.906 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:12.906 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:12.906 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:12.907 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:12.907 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:12.907 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:12.907 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:12.908 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:12.908 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:12.908 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:12.908 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:12.909 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:12.909 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.909 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:12.909 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:12.909 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:12.910 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:12.910 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.910 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:12.910 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.911 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:12.911 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:12.911 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:12.911 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:12.912 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262910+0000" 2020-05-18T21:36:12.912 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.912 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:12.912 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.912 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:12.913 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:12.913 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:12.913 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:12.913 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262910+0000" 2020-05-18T21:36:12.919 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.919 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:12.919 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:12.919 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:12.920 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:12.920 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:12.920 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:12.920 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:12.920 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:12.921 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:12.921 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.921 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:12.921 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:12.921 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:12.922 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:12.922 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:12.922 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:12.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.922 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:12.923 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:12.923 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:12.923 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:12.923 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:12.923 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:12.923 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.924 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:12.924 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:12.924 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:12.924 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:12.924 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.925 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:12.925 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.925 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:12.925 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:12.925 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:12.925 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:12.926 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:12.926 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:12.926 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:12.926 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.926 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:12.927 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:12.927 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:12.927 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:12.927 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:12.927 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:12.927 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:12.928 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:12.928 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:12.928 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.928 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:12.928 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:12.928 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:12.929 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:12.929 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:12.929 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:12.929 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:12.929 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:12.930 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:12.930 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:12.930 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:12.930 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:12.930 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.930 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:12.931 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:12.931 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:12.931 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:12.931 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:12.931 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:12.932 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray6", 2020-05-18T21:36:12.932 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x610", 2020-05-18T21:36:12.932 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:12.932 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:12.932 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:12.933 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:12.933 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:12.933 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:12.934 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:12.934 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:12.935 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:12.935 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:12.935 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:12.935 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.936 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:12.936 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:12.936 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:12.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.937 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:12.937 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:12.937 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:12.937 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:12.938 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.938 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:12.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.938 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:12.939 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:12.939 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:12.939 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:12.940 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:12.940 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:12.940 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:12.941 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:12.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.942 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:12.942 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:12.942 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:12.943 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:12.943 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.944 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:12.944 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1549, 2020-05-18T21:36:12.944 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:12.944 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:12.945 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:12.945 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:12.945 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:12.946 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:12.946 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:12.946 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:12.947 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:12.947 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:12.947 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:12.947 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:12.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.948 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:12.948 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:12.948 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:12.948 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:12.948 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:12.949 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:12.949 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.949 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:12.949 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:12.949 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:12.950 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:12.950 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:12.950 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:12.950 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:12.950 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:12.951 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:12.951 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:12.951 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:12.951 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:12.952 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:12.952 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.952 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:12.952 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:12.952 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:12.952 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:12.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.953 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:12.953 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.953 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:12.953 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:12.954 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:12.954 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:12.954 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262345+0000" 2020-05-18T21:36:12.954 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.954 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:12.955 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.955 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:12.955 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:12.955 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:12.955 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:12.955 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262345+0000" 2020-05-18T21:36:12.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.956 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:12.956 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:12.956 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:12.956 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:12.957 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:12.957 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:12.957 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:12.957 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:12.957 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:12.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.958 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:12.958 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:12.958 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:12.959 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:12.959 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:12.959 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:12.959 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.960 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:12.960 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:12.960 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:12.960 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:12.960 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:12.960 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:12.961 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.961 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:12.961 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:12.961 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:12.962 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:12.962 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.962 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:12.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.963 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:12.963 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:12.963 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:12.963 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:12.963 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:12.964 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:12.964 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:12.964 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.964 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:12.965 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:12.965 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:12.965 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:12.965 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:12.965 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:12.965 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:12.966 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:12.966 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:12.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.967 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:12.967 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:12.967 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:12.967 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:12.968 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:12.968 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:12.968 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:12.968 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:12.968 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:12.968 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:12.969 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:12.969 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:12.969 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.969 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:12.969 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:12.970 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:12.970 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:12.970 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:12.970 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:12.970 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray3", 2020-05-18T21:36:12.971 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60d", 2020-05-18T21:36:12.971 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:12.971 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:12.971 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:12.971 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:12.971 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:12.972 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:12.972 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:12.972 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:12.972 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:12.972 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:12.973 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:12.973 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.973 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:12.973 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:12.973 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:12.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.974 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:12.974 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:12.974 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:12.974 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:12.975 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.975 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:12.975 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.975 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:12.975 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:12.976 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:12.976 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:12.976 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:12.976 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:12.976 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:12.977 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:12.977 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.977 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:12.977 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:12.978 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:12.978 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:12.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.978 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:12.978 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1553, 2020-05-18T21:36:12.978 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:12.979 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:12.979 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:12.979 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:12.979 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:12.979 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:12.980 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:12.980 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:12.980 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:12.980 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:12.980 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:12.981 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:12.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.981 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:12.981 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:12.981 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:12.982 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:12.982 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:12.982 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:12.982 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.982 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:12.983 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:12.983 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:12.983 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:12.983 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:12.983 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:12.983 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:12.984 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:12.984 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:12.985 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:12.985 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:12.985 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:12.985 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:12.986 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.986 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:12.986 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:12.986 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:12.986 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:12.987 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.987 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:12.987 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.987 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:12.987 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:12.988 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:12.988 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:12.988 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263085+0000" 2020-05-18T21:36:12.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.988 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:12.988 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:12.989 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:12.990 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:12.990 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:12.990 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:12.990 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263085+0000" 2020-05-18T21:36:12.991 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.991 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:12.991 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:12.991 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:12.991 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:12.992 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:12.992 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:12.992 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:12.992 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:12.992 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:12.992 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.993 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:12.993 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:12.993 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:12.993 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:12.993 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:12.994 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:12.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.994 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:12.994 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:12.994 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:12.994 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:12.995 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:12.995 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:12.995 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.995 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:12.995 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:12.996 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:12.996 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:12.996 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:12.996 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:12.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.996 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:12.997 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:12.997 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:12.997 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:12.997 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:12.997 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:12.998 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:12.998 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:12.998 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:12.998 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:12.998 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:12.998 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:12.999 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:12.999 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:12.999 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:12.999 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:12.999 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:13.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.000 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:13.000 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:13.000 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:13.000 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:13.000 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:13.001 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:13.001 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:13.001 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:13.001 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:13.001 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.002 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:13.002 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:13.002 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.002 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:13.002 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:13.002 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:13.003 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:13.003 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:13.003 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.003 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray7", 2020-05-18T21:36:13.003 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x611", 2020-05-18T21:36:13.004 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:13.004 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:13.004 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:13.004 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:13.004 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:13.005 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:13.005 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:13.005 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.005 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:13.005 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:13.005 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:13.006 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.006 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.006 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.006 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.007 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.007 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.007 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:13.007 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.007 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.007 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.008 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.008 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.008 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.008 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.008 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.009 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:13.009 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:13.009 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:13.009 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:13.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.009 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:13.010 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:13.010 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:13.010 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:13.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.010 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.011 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1554, 2020-05-18T21:36:13.011 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:13.011 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:13.011 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:13.011 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:13.011 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:13.012 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:13.012 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:13.012 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:13.012 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:13.012 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:13.013 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:13.013 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:13.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.013 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:13.013 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:13.014 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:13.014 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:13.014 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:13.014 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:13.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.014 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:13.015 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:13.015 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:13.015 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:13.015 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:13.015 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:13.016 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:13.016 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:13.016 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:13.016 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:13.016 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:13.016 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:13.017 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:13.017 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:13.017 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:13.017 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:13.017 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:13.018 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:13.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.018 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:13.018 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:13.018 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:13.018 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:13.019 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:13.019 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:13.019 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263263+0000" 2020-05-18T21:36:13.019 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.019 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:13.020 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:13.020 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:13.020 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:13.020 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:13.020 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:13.020 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263263+0000" 2020-05-18T21:36:13.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.021 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:13.021 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:13.021 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:13.021 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:13.022 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:13.022 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:13.022 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:13.022 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:13.022 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:13.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.023 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:13.023 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:13.023 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:13.023 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:13.023 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:13.024 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:13.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.024 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:13.024 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:13.024 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:13.024 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.025 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.025 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.025 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.025 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.026 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:13.026 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.026 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.026 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.026 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.027 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.027 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.027 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.027 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:13.027 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:13.028 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:13.028 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.028 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:13.028 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:13.028 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:13.028 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:13.029 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:13.029 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:13.029 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:13.029 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:13.029 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:13.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.030 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:13.030 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:13.030 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:13.030 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:13.030 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:13.031 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:13.031 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:13.031 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:13.031 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:13.031 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.031 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:13.032 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:13.032 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.032 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:13.032 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:13.032 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:13.033 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:13.033 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:13.033 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.033 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray8", 2020-05-18T21:36:13.033 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x612", 2020-05-18T21:36:13.033 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:13.034 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:13.034 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:13.034 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:13.034 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:13.034 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:13.035 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:13.035 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.035 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:13.035 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:13.035 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:13.035 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.036 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.036 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.036 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.036 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.037 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.037 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:13.037 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.037 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.037 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.038 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.038 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.038 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.038 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.038 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:13.038 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:13.039 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:13.039 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:13.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.039 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:13.039 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:13.040 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:13.040 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:13.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.040 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.040 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1550, 2020-05-18T21:36:13.040 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:13.041 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:13.041 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:13.041 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:13.041 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:13.041 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:13.042 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:13.042 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:13.042 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:13.042 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:13.042 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:13.042 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:13.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.043 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:13.043 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:13.043 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:13.043 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:13.044 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:13.044 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:13.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.044 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:13.044 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:13.044 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:13.045 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:13.045 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:13.045 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:13.046 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:13.046 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:13.046 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:13.046 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:13.046 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:13.046 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:13.047 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:13.047 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:13.047 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:13.047 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:13.047 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:13.047 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:13.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.048 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:13.048 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:13.048 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:13.048 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:13.049 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:13.049 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:13.049 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262533+0000" 2020-05-18T21:36:13.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.050 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:13.050 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:13.050 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:13.050 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:13.050 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:13.050 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:13.051 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262533+0000" 2020-05-18T21:36:13.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.051 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:13.051 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:13.051 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:13.052 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:13.052 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:13.052 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:13.052 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:13.052 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:13.052 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:13.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.053 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:13.053 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:13.053 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:13.053 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:13.054 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:13.054 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:13.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.054 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:13.054 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:13.054 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:13.055 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.055 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.055 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.055 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.056 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.056 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:13.056 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.056 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.056 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.057 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.057 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.057 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.057 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.057 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:13.057 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:13.058 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:13.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.058 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:13.058 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:13.058 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:13.059 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:13.059 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:13.059 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:13.059 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:13.059 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:13.059 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:13.060 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.060 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:13.060 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:13.060 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:13.060 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:13.061 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:13.061 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:13.061 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:13.061 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:13.061 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:13.062 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.062 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:13.062 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:13.062 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.062 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:13.062 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:13.063 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:13.063 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:13.063 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:13.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.063 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray4", 2020-05-18T21:36:13.063 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60e", 2020-05-18T21:36:13.064 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:13.064 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:13.064 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:13.064 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:13.064 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:13.065 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:13.065 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:13.065 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.065 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:13.065 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:13.065 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:13.066 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.066 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.066 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.066 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.067 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.067 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.067 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:13.067 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.067 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.067 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.068 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.068 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.068 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.068 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.069 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:13.069 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:13.069 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:13.069 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:13.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.069 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:13.070 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:13.070 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:13.070 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:13.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.071 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1555, 2020-05-18T21:36:13.071 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:13.071 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:13.071 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:13.071 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:13.071 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:13.072 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:13.072 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:13.072 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:13.072 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:13.072 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:13.073 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:13.073 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:13.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.073 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:13.073 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:13.073 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:13.074 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:13.074 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:13.074 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:13.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.074 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:13.075 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:13.075 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:13.075 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:13.075 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:13.075 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:13.075 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:13.076 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:13.076 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:13.076 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:13.076 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:13.076 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:13.077 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:13.077 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:13.077 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:13.077 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:13.077 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:13.077 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:13.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.078 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:13.078 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:13.078 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:13.078 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:13.079 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:13.079 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:13.079 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:13.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.079 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:13.079 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:13.080 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:13.080 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:13.080 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:13.080 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:13.080 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:13.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.081 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:13.081 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:13.081 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:13.081 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:13.082 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:13.082 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:13.082 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:13.082 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:13.082 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:13.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.083 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:13.083 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:13.083 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:13.083 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:13.083 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:13.083 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:13.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.084 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:13.084 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:13.084 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:13.084 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.085 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.085 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.085 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.085 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.085 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.086 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:13.086 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.086 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.086 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.086 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.086 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.087 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.087 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.087 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.087 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:13.087 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:13.087 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:13.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.088 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:13.088 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:13.088 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:13.088 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:13.089 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:13.089 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:13.089 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:13.089 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:13.090 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:13.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.090 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:13.090 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:13.090 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:13.091 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:13.091 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:13.091 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:13.091 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:13.091 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:13.092 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:13.092 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.092 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:13.092 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:13.092 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.092 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:13.093 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:13.093 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:13.093 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:13.093 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:13.093 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.094 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray9", 2020-05-18T21:36:13.094 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x613", 2020-05-18T21:36:13.094 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:13.094 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:13.094 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:13.094 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:13.095 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:13.095 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:13.095 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:13.095 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.095 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:13.096 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:13.096 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:13.096 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.096 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.096 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.096 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.097 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.097 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.097 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:13.097 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.098 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.098 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.098 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.098 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.098 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.099 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.099 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:13.099 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:13.099 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:13.099 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:13.100 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.100 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:13.100 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:13.100 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:13.100 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:13.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.101 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.101 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 3, 2020-05-18T21:36:13.101 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:13.101 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:13.101 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:13.102 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16877, 2020-05-18T21:36:13.102 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:13.102 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:13.102 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:13.102 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:13.103 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:13.103 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:13.103 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:13.103 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:13.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.104 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:13.104 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:13.104 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:13.104 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:13.104 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:13.104 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:13.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.105 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:13.105 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:13.105 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:13.105 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:13.106 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:13.106 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:13.106 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:13.106 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:13.106 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:13.106 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:13.107 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:13.107 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:13.107 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:13.107 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:13.107 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:13.108 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:13.108 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:13.108 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:13.108 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.108 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:13.108 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:13.109 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:13.109 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:13.109 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:13.109 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:13.109 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:06.317019+0000" 2020-05-18T21:36:13.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.110 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:13.110 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:13.110 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:13.110 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:13.111 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:13.111 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:13.111 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:06.317019+0000" 2020-05-18T21:36:13.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.111 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:13.111 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:13.112 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:13.112 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:13.112 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:13.112 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:13.112 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:13.113 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:13.113 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:13.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.114 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:13.114 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:13.114 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:13.114 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:13.114 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:13.115 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:13.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.115 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:13.115 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:13.115 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:13.115 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.116 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.116 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.116 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.116 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.117 INFO:teuthology.orchestra.run.smithi155.stdout: -2, 2020-05-18T21:36:13.117 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.117 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.117 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.118 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.123 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.123 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.124 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.124 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:36:13.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.124 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:36:13.124 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:13.125 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:13.125 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:13.125 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:13.125 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:13.125 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:13.125 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:13.126 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:13.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.126 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:13.126 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:13.126 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:13.127 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:13.127 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:13.127 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:13.127 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:13.127 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:13.128 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:13.128 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.128 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:13.128 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.128 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:13.128 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:13.129 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:13.129 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:13.129 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:36:13.129 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.129 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.130 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 257, 2020-05-18T21:36:13.130 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:13.130 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:13.130 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:13.130 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:13.131 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:13.131 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:13.131 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:13.131 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:13.131 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:13.131 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:13.132 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:13.132 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:13.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.132 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:13.132 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:13.133 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:13.133 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:13.133 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:13.133 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:13.133 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.133 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:13.134 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:13.134 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:13.134 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:13.134 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:13.134 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:13.135 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:13.135 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:13.135 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:13.135 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:13.135 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:13.136 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:13.136 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:13.136 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:13.136 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:13.136 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:13.136 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 10, 2020-05-18T21:36:13.137 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:13.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.137 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:13.137 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:13.137 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:13.138 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:13.138 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:36:13.138 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:13.138 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:13.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.138 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:13.139 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:13.139 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:13.139 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:13.139 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:36:13.139 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:13.140 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:13.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.140 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:13.140 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:13.140 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:13.141 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:13.141 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:13.141 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:13.141 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:13.141 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:13.141 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:13.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.142 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:13.142 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:13.142 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:13.142 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:13.143 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:13.143 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:13.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.143 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:13.143 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:13.143 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:13.144 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.144 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.144 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.144 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.144 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.145 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.145 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:13.145 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.145 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.146 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.146 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.146 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.147 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.147 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.147 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:13.147 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:36:13.147 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.147 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:13.148 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:13.148 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:13.148 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:13.148 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:13.148 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:13.149 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:13.149 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:13.149 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:13.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.149 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:13.150 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:13.150 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:13.150 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:13.150 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:13.150 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:13.151 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:13.151 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:13.151 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:13.151 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.151 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:13.152 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.152 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:13.152 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:13.152 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:13.152 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:13.153 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:13.153 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.153 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1", 2020-05-18T21:36:13.153 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x101", 2020-05-18T21:36:13.153 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:13.154 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:13.154 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:13.154 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "0", 2020-05-18T21:36:13.154 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "0", 2020-05-18T21:36:13.154 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:13.154 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "1", 2020-05-18T21:36:13.155 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.155 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:13.155 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:13.155 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:13.155 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.156 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.156 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.156 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.156 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.156 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.157 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:13.157 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.157 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.157 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.157 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.158 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.158 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.158 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.158 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.158 INFO:teuthology.orchestra.run.smithi155.stdout: "child": 1, 2020-05-18T21:36:13.158 INFO:teuthology.orchestra.run.smithi155.stdout: "subtree": 1, 2020-05-18T21:36:13.159 INFO:teuthology.orchestra.run.smithi155.stdout: "subtreetemp": 0, 2020-05-18T21:36:13.159 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:13.159 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:13.159 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:13.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.160 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:13.160 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [ 2020-05-18T21:36:13.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.160 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray6", 2020-05-18T21:36:13.160 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:13.161 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:13.161 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:13.161 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:13.161 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:13.161 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:13.161 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:13.162 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1552, 2020-05-18T21:36:13.162 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:13.162 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:13.162 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:13.162 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.163 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.163 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.163 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.163 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.163 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.164 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:13.164 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.164 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.164 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.165 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.165 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.165 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.165 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.165 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:13.165 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.166 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:13.166 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:13.166 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:13.166 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:13.166 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:13.167 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:13.167 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:13.167 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:13.167 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:13.167 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:13.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.168 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.168 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:13.168 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:13.168 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.168 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.169 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray7", 2020-05-18T21:36:13.169 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:13.169 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:13.169 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:13.169 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:13.169 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:13.170 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:13.170 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:13.170 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1553, 2020-05-18T21:36:13.170 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:13.170 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:13.171 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:13.171 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.171 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.171 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.171 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.172 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.172 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.172 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:13.172 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.172 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.173 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.173 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.173 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.173 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.173 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.174 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:13.174 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.174 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:13.174 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:13.174 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:13.175 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:13.175 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:13.175 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:13.175 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:13.175 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:13.176 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:13.176 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:13.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.176 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.176 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:13.176 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:13.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.177 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray0", 2020-05-18T21:36:13.177 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:13.177 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:13.178 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:13.178 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:13.178 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:13.178 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:13.178 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:13.178 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1546, 2020-05-18T21:36:13.179 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:13.179 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:13.179 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:13.179 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.179 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.180 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.180 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.180 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.180 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.181 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:13.181 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.181 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.181 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.181 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.182 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.182 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.182 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.182 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:13.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.183 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:13.183 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:13.183 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:13.183 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:13.183 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:13.183 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:13.184 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:13.184 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:13.184 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:13.184 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:13.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.185 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.185 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:13.185 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:13.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.185 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.185 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray9", 2020-05-18T21:36:13.186 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:13.186 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:13.186 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:13.186 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:13.186 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:13.187 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:13.187 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:13.187 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1555, 2020-05-18T21:36:13.187 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:13.187 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:13.187 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:13.188 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.188 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.188 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.188 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.189 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.189 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.189 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:13.189 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.189 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.190 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.190 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.191 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.191 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.191 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.191 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:13.191 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.191 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:13.192 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:13.192 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:13.192 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:13.192 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:13.192 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:13.193 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:13.193 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:13.193 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:13.193 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:13.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.193 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.194 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:13.194 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:13.194 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.194 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.194 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray5", 2020-05-18T21:36:13.195 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:13.195 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:13.195 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:13.195 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:13.195 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:13.195 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:13.196 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:13.196 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1551, 2020-05-18T21:36:13.196 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:13.196 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:13.196 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:13.197 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.197 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.197 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.197 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.197 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.198 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.198 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:13.198 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.198 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.198 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.199 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.199 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.199 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.199 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.199 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.199 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:13.200 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.200 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:13.200 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:13.200 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:13.200 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:13.201 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:13.201 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:13.201 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:13.201 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:13.201 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:13.201 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:13.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.202 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.202 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:13.202 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:13.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.203 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.203 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray2", 2020-05-18T21:36:13.203 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:13.203 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:13.203 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:13.203 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:13.204 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:13.204 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:13.204 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:13.204 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1548, 2020-05-18T21:36:13.204 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:13.205 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:13.205 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:13.205 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.205 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.205 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.206 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.206 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.206 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.206 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.206 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:13.206 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.207 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.207 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.207 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.207 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.208 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.208 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.208 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:13.208 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.208 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:13.208 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:13.209 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:13.209 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:13.209 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:13.209 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:13.209 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:13.210 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:13.210 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:13.210 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:13.210 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.210 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.210 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:13.211 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:13.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.211 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.211 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray1", 2020-05-18T21:36:13.211 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:13.212 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:13.212 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:13.212 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:13.212 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:13.212 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:13.213 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:13.213 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1547, 2020-05-18T21:36:13.213 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:13.213 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:13.213 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:13.213 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.214 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.214 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.214 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.214 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.215 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.215 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:13.215 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.215 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.215 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.215 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.216 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.216 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.216 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.216 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.216 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:13.217 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.217 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:13.217 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:13.217 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:13.217 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:13.217 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:13.218 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:13.218 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:13.218 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:13.218 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:13.218 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:13.219 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.219 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.219 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:13.219 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:13.219 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.219 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.220 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray8", 2020-05-18T21:36:13.220 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:13.220 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:13.220 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:13.220 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:13.221 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:13.221 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:13.221 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:13.221 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1554, 2020-05-18T21:36:13.221 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:13.221 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:13.222 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:13.222 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.222 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.222 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.222 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.223 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.223 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.223 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.223 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:13.223 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.224 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.224 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.224 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.224 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.224 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.224 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.225 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.225 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:13.225 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.225 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:13.225 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:13.226 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:13.226 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:13.226 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:13.226 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:13.226 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:13.226 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:13.227 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:13.227 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:13.227 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.227 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.227 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:13.228 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:13.228 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.228 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.228 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray3", 2020-05-18T21:36:13.228 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:13.229 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:13.229 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:13.229 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:13.229 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:13.229 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:13.229 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:13.230 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1549, 2020-05-18T21:36:13.230 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:13.230 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:13.230 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:13.230 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.231 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.231 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.231 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.231 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.232 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.232 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:13.232 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.232 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.233 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.233 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.233 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.233 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.233 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.234 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.234 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:13.234 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.234 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:13.234 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:13.234 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:13.235 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:13.235 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:13.235 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:13.235 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:13.235 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:13.236 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:13.236 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:13.236 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.236 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.236 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:13.236 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:13.237 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.237 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:13.237 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray4", 2020-05-18T21:36:13.237 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:13.237 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:13.238 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:13.238 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:13.238 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:13.238 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:13.238 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:13.238 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1550, 2020-05-18T21:36:13.239 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:13.239 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:13.239 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:13.239 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.239 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:13.240 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:13.240 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:13.240 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.240 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:13.240 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:13.240 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:13.241 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:13.241 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:13.241 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:13.241 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.241 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:13.242 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:13.242 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:13.242 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:13.242 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:13.242 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.242 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:13.243 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:13.243 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:13.243 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:13.243 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:13.243 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:13.243 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:13.244 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:13.244 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:13.244 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:13.244 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:13.244 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:13.245 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:13.245 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:13.245 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:13.245 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:13.245 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:13.246 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:13.246 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:13.246 INFO:teuthology.orchestra.run.smithi155.stdout:] 2020-05-18T21:36:13.248 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "ino": 1, "rdev": 0, "ctime": "2020-05-18T21:36:12.141787+0000", "btime": "2020-05-18T21:35:50.165450+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 26, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:12.141787+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:36:12.141787+0000", "num_files": 0, "num_subdirs": 1, "change_attr": 1 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:57.723581+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:50.165450+0000" }, "version": 4, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 3, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "dirfrag": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1546, "rdev": 0, "ctime": "2020-05-18T21:35:58.261727+0000", "btime": "2020-05-18T21:35:58.261727+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261727+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261727+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261727+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray0", "dirfrag": "0x60a", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1547, "rdev": 0, "ctime": "2020-05-18T21:35:58.261988+0000", "btime": "2020-05-18T21:35:58.261988+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261988+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261988+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261988+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray1", "dirfrag": "0x60b", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1548, "rdev": 0, "ctime": "2020-05-18T21:35:58.262165+0000", "btime": "2020-05-18T21:35:58.262165+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262165+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262165+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262165+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray2", "dirfrag": "0x60c", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1551, "rdev": 0, "ctime": "2020-05-18T21:35:58.262725+0000", "btime": "2020-05-18T21:35:58.262725+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262725+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262725+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262725+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray5", "dirfrag": "0x60f", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1552, "rdev": 0, "ctime": "2020-05-18T21:35:58.262910+0000", "btime": "2020-05-18T21:35:58.262910+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262910+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262910+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262910+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray6", "dirfrag": "0x610", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1549, "rdev": 0, "ctime": "2020-05-18T21:35:58.262345+0000", "btime": "2020-05-18T21:35:58.262345+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262345+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262345+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262345+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray3", "dirfrag": "0x60d", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1553, "rdev": 0, "ctime": "2020-05-18T21:35:58.263085+0000", "btime": "2020-05-18T21:35:58.263085+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263085+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263085+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263085+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray7", "dirfrag": "0x611", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1554, "rdev": 0, "ctime": "2020-05-18T21:35:58.263263+0000", "btime": "2020-05-18T21:35:58.263263+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263263+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263263+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263263+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray8", "dirfrag": "0x612", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1550, "rdev": 0, "ctime": "2020-05-18T21:35:58.262533+0000", "btime": "2020-05-18T21:35:58.262533+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262533+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262533+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262533+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray4", "dirfrag": "0x60e", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1555, "rdev": 0, "ctime": "2020-05-18T21:35:58.263460+0000", "btime": "2020-05-18T21:35:58.263460+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263460+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray9", "dirfrag": "0x613", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 3, "rdev": 0, "ctime": "2020-05-18T21:36:06.317019+0000", "btime": "2020-05-18T21:36:06.317019+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:06.317019+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:36:06.317019+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:36:06.317019+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ -2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "openingsnapparents": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 257, "rdev": 0, "ctime": "2020-05-18T21:35:58.261635+0000", "btime": "2020-05-18T21:35:58.261635+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261635+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 10, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "openingsnapparents": 0 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "subtreetemp": 0, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 3, "dentries": [ { "path": "stray6", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1552, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray7", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1553, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray0", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1546, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray9", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1555, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray5", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1551, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray2", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1548, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray1", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1547, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray8", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1554, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray3", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1549, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray4", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1550, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] } ] } ] } ] 2020-05-18T21:36:14.252 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok dump cache 2020-05-18T21:36:14.358 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2020-05-18T21:36:14.358 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.359 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1, 2020-05-18T21:36:14.359 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:14.359 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:14.359 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:50.165450+0000", 2020-05-18T21:36:14.359 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 17407, 2020-05-18T21:36:14.360 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:14.360 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:14.360 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:14.360 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:14.360 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:14.361 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:14.361 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:14.361 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:14.361 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.361 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:14.362 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:36:14.362 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:36:14.362 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:36:14.362 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 26, 2020-05-18T21:36:14.362 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:14.363 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.363 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:14.363 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:14.363 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:14.363 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:14.363 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:14.364 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:14.364 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:14.364 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:14.364 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:14.364 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:36:14.365 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:14.365 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:14.365 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:14.365 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.365 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:14.365 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:14.366 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 1, 2020-05-18T21:36:14.366 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1 2020-05-18T21:36:14.366 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.366 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:14.366 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.367 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.367 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.367 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.367 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.367 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:57.723581+0000" 2020-05-18T21:36:14.368 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.368 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:14.368 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.368 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.368 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.368 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.369 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.369 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:50.165450+0000" 2020-05-18T21:36:14.369 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.369 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 4, 2020-05-18T21:36:14.369 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:14.374 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:14.374 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 3, 2020-05-18T21:36:14.374 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:14.374 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:14.376 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:14.376 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:14.376 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:14.376 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:14.376 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.377 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:14.377 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:14.377 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:14.377 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:36:14.377 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.378 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.378 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.378 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.378 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.378 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:36:14.379 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.379 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.379 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:36:14.379 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.379 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.379 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.380 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.380 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.380 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": 0, 2020-05-18T21:36:14.380 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 0 2020-05-18T21:36:14.380 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.381 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:36:14.381 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.381 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.381 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.381 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.382 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.382 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.382 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.382 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.382 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.382 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:14.383 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:14.383 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:14.383 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:14.383 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:14.383 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:14.384 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:36:14.384 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.384 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:36:14.384 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.384 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.385 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.385 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.385 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.385 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.385 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:14.386 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:14.386 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [], 2020-05-18T21:36:14.386 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:14.386 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:14.386 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:14.386 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:14.387 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:36:14.387 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.387 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.387 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1546, 2020-05-18T21:36:14.388 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:14.388 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:14.388 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:14.388 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:14.389 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:14.389 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:14.389 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:14.389 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:14.389 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:14.390 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:14.390 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:14.390 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:14.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.390 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:14.391 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:14.391 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:14.391 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:14.391 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:14.391 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:14.392 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.392 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:14.392 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:14.392 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:14.393 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:14.393 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:14.393 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:14.393 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:14.393 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:14.394 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:14.394 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:14.394 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:14.394 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:14.394 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:14.395 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.395 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:14.395 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:14.395 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:14.395 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:14.395 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.396 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:14.396 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.396 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.396 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.396 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.397 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.397 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261727+0000" 2020-05-18T21:36:14.397 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.397 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:14.397 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.397 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.398 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.398 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.398 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.398 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261727+0000" 2020-05-18T21:36:14.398 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.399 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.399 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:14.399 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:14.400 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:14.400 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:14.400 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:14.400 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:14.400 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:14.401 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:14.401 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.401 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:14.401 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:14.401 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:14.402 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:14.402 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:14.402 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:14.402 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.404 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:14.404 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:14.404 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:14.405 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.405 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.405 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.405 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.405 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.405 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.406 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.406 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.406 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.406 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.406 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.407 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.407 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.407 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.407 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.407 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:14.408 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:14.408 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:14.408 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.408 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:14.408 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.408 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.409 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.409 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.409 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.409 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.409 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.410 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.410 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.410 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:14.410 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:14.410 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:14.410 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:14.411 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:14.411 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:14.411 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:14.411 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:14.411 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:14.412 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.412 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.412 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:14.412 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.412 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:14.412 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:14.413 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:14.413 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:14.413 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:14.413 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.413 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray0", 2020-05-18T21:36:14.414 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60a", 2020-05-18T21:36:14.414 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:14.414 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:14.414 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:14.414 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:14.415 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:14.415 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:14.415 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:14.415 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.415 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.415 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:14.416 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:14.416 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.416 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.416 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.416 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.417 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.417 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.417 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.417 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.417 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.417 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.418 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.418 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.418 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.418 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.419 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.419 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:14.419 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:14.419 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:14.419 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:14.419 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.420 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:14.420 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:14.420 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:14.420 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.420 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.421 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1547, 2020-05-18T21:36:14.421 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:14.421 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:14.421 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:14.421 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:14.422 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:14.422 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:14.422 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:14.422 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:14.422 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:14.423 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:14.423 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:14.423 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:14.423 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.424 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:14.424 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:14.425 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:14.425 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:14.425 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:14.425 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:14.425 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.426 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:14.426 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:14.426 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:14.426 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:14.426 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:14.427 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:14.427 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:14.427 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:14.427 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:14.427 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:14.428 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:14.428 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:14.428 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:14.428 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.428 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:14.429 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:14.429 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:14.429 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:14.429 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.429 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:14.430 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.430 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.430 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.430 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.430 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.430 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261988+0000" 2020-05-18T21:36:14.431 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.431 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:14.431 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.431 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.431 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.432 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.432 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.432 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261988+0000" 2020-05-18T21:36:14.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.432 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.432 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:14.433 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:14.433 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:14.433 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:14.433 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:14.433 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:14.434 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:14.434 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:14.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.434 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:14.434 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:14.434 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:14.435 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:14.435 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:14.435 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:14.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.435 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:14.436 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:14.436 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:14.436 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.436 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.436 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.437 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.437 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.437 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.437 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.437 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.438 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.438 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.438 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.439 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.439 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.439 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:14.439 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:14.439 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:14.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.440 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:14.440 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.440 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.440 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.440 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.441 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.441 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.441 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.441 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.442 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:14.442 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:14.442 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:14.442 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:14.442 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:14.443 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:14.443 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:14.443 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:14.443 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:14.443 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.443 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.444 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:14.444 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.444 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:14.444 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:14.444 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:14.445 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:14.445 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:14.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.445 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray1", 2020-05-18T21:36:14.445 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60b", 2020-05-18T21:36:14.445 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:14.446 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:14.446 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:14.446 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:14.446 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:14.446 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:14.447 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:14.447 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.447 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.447 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:14.447 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:14.447 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.448 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.448 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.448 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.448 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.448 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.449 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.449 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.449 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.449 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.449 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.450 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.450 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.450 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.450 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.450 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:14.451 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:14.451 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:14.451 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:14.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.451 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:14.451 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:14.452 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:14.452 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.452 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.452 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1548, 2020-05-18T21:36:14.453 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:14.453 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:14.453 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:14.453 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:14.453 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:14.453 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:14.454 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:14.454 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:14.454 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:14.454 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:14.454 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:14.455 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:14.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.455 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:14.455 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:14.455 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:14.455 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:14.456 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:14.456 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:14.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.456 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:14.456 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:14.457 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:14.457 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:14.457 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:14.457 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:14.457 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:14.457 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:14.458 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:14.458 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:14.458 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:14.458 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:14.458 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:14.459 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.459 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:14.459 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:14.459 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:14.459 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:14.459 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.460 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:14.460 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.460 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.460 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.460 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.461 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.461 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262165+0000" 2020-05-18T21:36:14.461 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.461 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:14.461 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.461 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.462 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.462 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.462 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.462 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262165+0000" 2020-05-18T21:36:14.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.463 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.463 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:14.463 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:14.463 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:14.463 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:14.464 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:14.464 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:14.464 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:14.464 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:14.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.464 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:14.465 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:14.465 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:14.465 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:14.465 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:14.465 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:14.466 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.466 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:14.466 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:14.466 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:14.466 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.466 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.467 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.467 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.467 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.467 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.467 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.468 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.468 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.468 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.468 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.468 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.468 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.469 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.469 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.469 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:14.469 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:14.469 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:14.470 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.470 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:14.470 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.470 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.470 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.470 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.471 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.471 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.471 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.471 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.471 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.472 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:14.472 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:14.472 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:14.472 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:14.472 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:14.472 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:14.473 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:14.473 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:14.473 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:14.473 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.473 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.474 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:14.474 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.474 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:14.474 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:14.474 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:14.474 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:14.475 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:14.475 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.475 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray2", 2020-05-18T21:36:14.475 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60c", 2020-05-18T21:36:14.475 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:14.475 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:14.476 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:14.476 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:14.476 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:14.476 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:14.476 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:14.477 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.477 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.477 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:14.477 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:14.477 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.477 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.478 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.478 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.478 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.478 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.478 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.479 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.479 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.479 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.479 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.479 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.480 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.480 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.480 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.480 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:14.480 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:14.481 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:14.481 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:14.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.481 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:14.483 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:14.483 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:14.483 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.484 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.484 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1551, 2020-05-18T21:36:14.484 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:14.484 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:14.484 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:14.485 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:14.485 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:14.485 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:14.485 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:14.485 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:14.485 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:14.486 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:14.486 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:14.486 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:14.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.486 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:14.487 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:14.487 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:14.487 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:14.487 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:14.488 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:14.488 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.488 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:14.488 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:14.488 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:14.489 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:14.489 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:14.489 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:14.489 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:14.490 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:14.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:14.490 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:14.490 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:14.490 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:14.491 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:14.491 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.491 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:14.491 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:14.491 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:14.491 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:14.492 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.492 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:14.492 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.492 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.492 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.493 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.493 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.493 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262725+0000" 2020-05-18T21:36:14.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.494 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:14.494 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.494 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.494 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.494 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.495 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.495 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262725+0000" 2020-05-18T21:36:14.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.495 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.495 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:14.496 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:14.496 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:14.496 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:14.496 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:14.496 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:14.497 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:14.497 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:14.497 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.497 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:14.497 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:14.497 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:14.498 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:14.498 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:14.498 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:14.498 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.498 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:14.499 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:14.499 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:14.499 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.499 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.499 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.500 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.500 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.501 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.501 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.501 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.501 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.501 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.502 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.502 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.502 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.502 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.502 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:14.503 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:14.503 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:14.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.503 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:14.503 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.504 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.504 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.504 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.504 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.504 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.505 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.505 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.505 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.505 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:14.505 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:14.505 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:14.506 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:14.506 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:14.506 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:14.506 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:14.506 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:14.507 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:14.507 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.507 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.507 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:14.507 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.507 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:14.508 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:14.508 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:14.508 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:14.508 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:14.508 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.509 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray5", 2020-05-18T21:36:14.509 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60f", 2020-05-18T21:36:14.509 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:14.509 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:14.509 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:14.509 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:14.510 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:14.510 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:14.510 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:14.510 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.510 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.511 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:14.511 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:14.511 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.511 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.511 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.511 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.512 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.512 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.512 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.512 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.512 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.513 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.513 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.513 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.513 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.513 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.514 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.514 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:14.514 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:14.514 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:14.514 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:14.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.515 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:14.515 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:14.515 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:14.515 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.516 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.516 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1552, 2020-05-18T21:36:14.516 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:14.516 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:14.516 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:14.517 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:14.517 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:14.517 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:14.517 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:14.517 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:14.517 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:14.518 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:14.518 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:14.518 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:14.518 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.518 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:14.519 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:14.519 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:14.519 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:14.519 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:14.519 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:14.519 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.520 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:14.520 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:14.520 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:14.520 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:14.520 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:14.521 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:14.521 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:14.521 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:14.521 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:14.521 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:14.521 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:14.522 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:14.522 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:14.522 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.522 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:14.522 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:14.523 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:14.523 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:14.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.523 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:14.524 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.524 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.524 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.524 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.525 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.525 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262910+0000" 2020-05-18T21:36:14.525 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.525 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:14.526 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.526 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.526 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.526 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.526 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.527 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262910+0000" 2020-05-18T21:36:14.527 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.527 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.527 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:14.527 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:14.528 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:14.528 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:14.528 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:14.528 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:14.528 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:14.529 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:14.529 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.529 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:14.529 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:14.529 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:14.529 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:14.530 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:14.530 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:14.530 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.530 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:14.530 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:14.531 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:14.531 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.531 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.531 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.531 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.531 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.532 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.532 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.532 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.532 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.532 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.532 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.533 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.533 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.533 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.533 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.533 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:14.534 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:14.534 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:14.534 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.534 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:14.534 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.535 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.535 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.535 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.535 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.535 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.535 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.536 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.536 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.536 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:14.536 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:14.536 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:14.536 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:14.537 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:14.537 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:14.537 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:14.537 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:14.537 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:14.538 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.538 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.538 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:14.538 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.538 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:14.538 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:14.539 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:14.539 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:14.539 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:14.539 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.539 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray6", 2020-05-18T21:36:14.540 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x610", 2020-05-18T21:36:14.540 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:14.540 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:14.540 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:14.540 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:14.540 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:14.541 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:14.541 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:14.541 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.541 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.541 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:14.542 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:14.542 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.542 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.542 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.542 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.542 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.543 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.543 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.543 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.543 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.543 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.544 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.544 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.544 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.544 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.544 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.544 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.545 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:14.545 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:14.545 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:14.545 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:14.545 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.546 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:14.546 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:14.546 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:14.546 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.546 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.546 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.547 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1549, 2020-05-18T21:36:14.547 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:14.547 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:14.547 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:14.547 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:14.548 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:14.548 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:14.548 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:14.548 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:14.548 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:14.548 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:14.549 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:14.549 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:14.549 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.549 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:14.549 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:14.550 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:14.550 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:14.550 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:14.550 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:14.550 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.550 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:14.551 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:14.551 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:14.551 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:14.551 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:14.551 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:14.551 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:14.552 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:14.552 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:14.552 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:14.552 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:14.552 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:14.553 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:14.553 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.553 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:14.553 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:14.553 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:14.553 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:14.554 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.554 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:14.554 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.554 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.554 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.555 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.555 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.555 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262345+0000" 2020-05-18T21:36:14.555 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.555 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:14.555 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.556 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.556 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.556 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.556 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.556 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262345+0000" 2020-05-18T21:36:14.559 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.559 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.559 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:14.559 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:14.559 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:14.559 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:14.560 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:14.560 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:14.560 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:14.560 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:14.560 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.561 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:14.561 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:14.561 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:14.561 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:14.561 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:14.561 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:14.562 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.562 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:14.562 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:14.562 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:14.562 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.563 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.563 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.563 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.563 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.563 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.564 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.564 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.564 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.564 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.564 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.565 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.565 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.565 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.565 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:14.565 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:14.565 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:14.566 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.566 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:14.566 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.566 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.566 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.567 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.567 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.567 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.567 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.567 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.567 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.568 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:14.568 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:14.568 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:14.568 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:14.568 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:14.568 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:14.569 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:14.569 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:14.569 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:14.569 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.569 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.570 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:14.570 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.570 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:14.570 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:14.570 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:14.570 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:14.571 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:14.571 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.571 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray3", 2020-05-18T21:36:14.571 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60d", 2020-05-18T21:36:14.571 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:14.572 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:14.572 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:14.572 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:14.572 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:14.572 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:14.572 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:14.573 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.573 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.573 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:14.573 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:14.573 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.574 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.574 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.574 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.574 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.574 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.574 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.575 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.575 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.575 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.575 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.576 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.576 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.576 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.576 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.576 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:14.576 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:14.577 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:14.577 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:14.577 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.577 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:14.577 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:14.578 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:14.578 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.578 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.578 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.578 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1553, 2020-05-18T21:36:14.578 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:14.579 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:14.579 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:14.579 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:14.579 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:14.579 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:14.580 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:14.580 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:14.580 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:14.580 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:14.580 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:14.580 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:14.581 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.581 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:14.581 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:14.581 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:14.581 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:14.582 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:14.582 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:14.582 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.582 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:14.582 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:14.582 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:14.583 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:14.583 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:14.583 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:14.583 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:14.583 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:14.583 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:14.584 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:14.584 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:14.584 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:14.584 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:14.584 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.585 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:14.585 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:14.585 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:14.585 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:14.585 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.585 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:14.586 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.586 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.586 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.586 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.586 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.587 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263085+0000" 2020-05-18T21:36:14.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.587 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:14.587 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.587 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.588 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.588 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.588 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.588 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263085+0000" 2020-05-18T21:36:14.588 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.588 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.589 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:14.589 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:14.589 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:14.589 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:14.590 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:14.590 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:14.590 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:14.590 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:14.590 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.591 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:14.591 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:14.591 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:14.591 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:14.592 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:14.592 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:14.592 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.592 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:14.592 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:14.593 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:14.593 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.593 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.593 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.593 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.594 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.594 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.594 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.595 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.595 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.595 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.595 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.595 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.595 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.596 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.596 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:14.596 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:14.596 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:14.596 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.597 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:14.597 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.597 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.597 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.597 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.597 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.598 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.598 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.598 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.598 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.598 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:14.598 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:14.599 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:14.599 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:14.599 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:14.599 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:14.599 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:14.600 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:14.600 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:14.600 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.600 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.600 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:14.601 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.601 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:14.601 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:14.602 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:14.602 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:14.602 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:14.602 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.602 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray7", 2020-05-18T21:36:14.603 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x611", 2020-05-18T21:36:14.603 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:14.603 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:14.603 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:14.604 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:14.604 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:14.604 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:14.604 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:14.604 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.604 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.605 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:14.605 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:14.605 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.605 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.605 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.606 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.606 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.606 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.606 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.606 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.606 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.607 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.607 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.607 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.607 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.607 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.608 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.608 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.608 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:14.608 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:14.608 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:14.608 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:14.609 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.609 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:14.609 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:14.609 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:14.609 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.610 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.610 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.610 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1554, 2020-05-18T21:36:14.610 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:14.610 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:14.610 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:14.611 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:14.611 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:14.611 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:14.611 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:14.611 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:14.611 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:14.612 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:14.612 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:14.612 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:14.612 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.612 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:14.613 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:14.613 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:14.613 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:14.613 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:14.613 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:14.614 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.614 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:14.614 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:14.614 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:14.614 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:14.614 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:14.615 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:14.615 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:14.615 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:14.615 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:14.615 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:14.616 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:14.616 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:14.616 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:14.616 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.616 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:14.616 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:14.617 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:14.617 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:14.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.617 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:14.617 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.617 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.618 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.618 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.618 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.618 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263263+0000" 2020-05-18T21:36:14.618 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.619 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:14.619 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.619 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.619 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.619 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.619 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.620 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263263+0000" 2020-05-18T21:36:14.620 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.620 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.620 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:14.620 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:14.621 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:14.621 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:14.621 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:14.621 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:14.621 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:14.621 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:14.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.622 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:14.622 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:14.622 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:14.622 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:14.623 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:14.623 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:14.623 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.623 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:14.623 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:14.624 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:14.624 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.624 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.624 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.625 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.625 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.625 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.626 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.626 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.626 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.626 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.626 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.627 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.627 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.627 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.627 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:14.627 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:14.627 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:14.628 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.628 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:14.628 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.628 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.628 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.629 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.629 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.629 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.629 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.629 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.629 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.630 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:14.630 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:14.630 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:14.630 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:14.630 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:14.631 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:14.631 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:14.631 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:14.631 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:14.631 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.631 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.632 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:14.632 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.632 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:14.632 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:14.632 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:14.633 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:14.633 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:14.633 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.633 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray8", 2020-05-18T21:36:14.633 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x612", 2020-05-18T21:36:14.633 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:14.634 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:14.634 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:14.634 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:14.634 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:14.634 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:14.635 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:14.635 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.635 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.635 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:14.635 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:14.635 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.636 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.636 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.636 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.636 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.637 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.637 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.637 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.637 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.637 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.637 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.638 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.638 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.638 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.638 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.638 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:14.638 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:14.639 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:14.639 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:14.639 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.639 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:14.639 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:14.640 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:14.640 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.640 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.640 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1550, 2020-05-18T21:36:14.640 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:14.641 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:14.641 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:14.641 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:14.641 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:14.641 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:14.642 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:14.642 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:14.642 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:14.642 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:14.642 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:14.642 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:14.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.643 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:14.643 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:14.643 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:14.643 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:14.644 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:14.644 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:14.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.644 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:14.644 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:14.644 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:14.645 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:14.645 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:14.645 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:14.645 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:14.645 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:14.646 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:14.646 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:14.646 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:14.646 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:14.646 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:14.646 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.647 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:14.647 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:14.647 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:14.647 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:14.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.648 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:14.648 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.648 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.648 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.648 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.648 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.649 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262533+0000" 2020-05-18T21:36:14.649 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.649 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:14.649 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.649 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.649 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.650 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.650 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.650 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262533+0000" 2020-05-18T21:36:14.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.650 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.651 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:14.651 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:14.651 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:14.651 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:14.651 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:14.651 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:14.652 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:14.652 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:14.652 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.652 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:14.652 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:14.653 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:14.653 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:14.653 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:14.653 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:14.653 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.653 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:14.654 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:14.654 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:14.654 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.654 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.654 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.655 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.655 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.655 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.655 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.655 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.655 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.656 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.656 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.656 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.656 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.656 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.656 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.657 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:14.657 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:14.657 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:14.657 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.657 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:14.658 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.658 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.658 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.658 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.658 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.658 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.659 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.659 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.659 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.659 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:14.659 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:14.660 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:14.660 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:14.660 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:14.660 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:14.660 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:14.660 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:14.661 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:14.661 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.661 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.661 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:14.661 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.662 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:14.662 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:14.662 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:14.662 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:14.662 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:14.663 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.663 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray4", 2020-05-18T21:36:14.663 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60e", 2020-05-18T21:36:14.663 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:14.663 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:14.663 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:14.664 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:14.664 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:14.664 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:14.664 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:14.664 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.664 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.665 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:14.665 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:14.665 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.665 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.665 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.666 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.666 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.666 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.666 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.666 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.666 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.667 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.667 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.667 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.667 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.668 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.668 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.668 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:14.668 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:14.668 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:14.668 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:14.669 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.669 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:14.669 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:14.669 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:14.669 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.670 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.670 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1555, 2020-05-18T21:36:14.670 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:14.670 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:14.670 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:14.671 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:14.671 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:14.671 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:14.671 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:14.671 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:14.672 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:14.672 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:14.672 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:14.672 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:14.672 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.672 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:14.673 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:14.673 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:14.673 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:14.673 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:14.673 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:14.674 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.674 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:14.674 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:14.674 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:14.674 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:14.674 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:14.675 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:14.675 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:14.675 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:14.675 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:14.675 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:14.675 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:14.676 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:14.676 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:14.676 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.676 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:14.676 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:14.677 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:14.677 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:14.677 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.677 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:14.677 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.677 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.678 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.678 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.678 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.678 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:14.678 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.679 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:14.679 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.679 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.679 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.679 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.679 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.680 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:14.680 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.680 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.680 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:14.680 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:14.681 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:14.681 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:14.681 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:14.681 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:14.681 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:14.681 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:14.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.682 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:14.682 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:14.682 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:14.682 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:14.683 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:14.683 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:14.683 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.683 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:14.683 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:14.683 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:14.684 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.684 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.684 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.684 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.685 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.685 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.685 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.685 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.685 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.685 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.686 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.686 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.686 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.686 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.686 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:14.687 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:14.687 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:14.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.687 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:14.687 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.687 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.688 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.688 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.688 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.688 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.688 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.689 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.689 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.689 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:14.689 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:14.689 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:14.689 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:14.690 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:14.690 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:14.690 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:14.690 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:14.691 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:14.691 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.691 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.691 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:14.691 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.692 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:14.692 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:14.692 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:14.692 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:14.693 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:14.693 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.693 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray9", 2020-05-18T21:36:14.693 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x613", 2020-05-18T21:36:14.693 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:14.693 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:14.694 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:14.694 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:14.694 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:14.694 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:14.695 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:14.695 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.695 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.695 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:14.695 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:14.696 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.696 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.696 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.696 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.697 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.697 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.697 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.697 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.697 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.697 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.698 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.698 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.698 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.698 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.699 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:14.699 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:14.699 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:14.699 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:14.699 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.699 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:14.700 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:14.700 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:14.700 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.700 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.701 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 3, 2020-05-18T21:36:14.701 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:14.701 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:14.702 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:14.702 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16877, 2020-05-18T21:36:14.702 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:14.702 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:14.702 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:14.703 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:14.703 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:14.703 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:14.703 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:14.703 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:14.704 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.704 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:14.704 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:14.704 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:14.704 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:14.705 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:14.705 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:14.705 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.705 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:14.705 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:14.706 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:14.706 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:14.706 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:14.706 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:14.706 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:14.706 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:14.707 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:14.707 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:14.707 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:14.707 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:14.707 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:14.708 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.708 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:14.708 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:14.708 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:14.708 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:14.708 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.709 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:14.709 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.709 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.709 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.709 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.710 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.710 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:06.317019+0000" 2020-05-18T21:36:14.710 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.710 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:14.710 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.710 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.711 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.711 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:14.711 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.711 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:06.317019+0000" 2020-05-18T21:36:14.711 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.712 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.712 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:14.712 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:14.712 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:14.712 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:14.712 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:14.713 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:14.713 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:14.713 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:14.713 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.713 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:14.713 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:14.714 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:14.714 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:14.714 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:14.714 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:14.714 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.715 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:14.715 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:14.715 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:14.715 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.715 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.715 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.716 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.716 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.716 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.716 INFO:teuthology.orchestra.run.smithi155.stdout: -2, 2020-05-18T21:36:14.716 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.717 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.717 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.717 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.717 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.717 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.718 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.718 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:36:14.718 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.718 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:36:14.718 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.719 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.719 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.719 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.719 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.719 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.719 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.720 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.720 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:14.720 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:14.720 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:14.721 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:14.721 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:14.721 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:14.721 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:14.721 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:14.721 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:14.722 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.722 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:14.722 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.722 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:14.722 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:14.723 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:14.723 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:14.723 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:36:14.723 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.723 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.723 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 257, 2020-05-18T21:36:14.724 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:14.724 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:14.724 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:14.724 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:14.725 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:14.725 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:14.725 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:14.725 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:14.726 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:14.726 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:14.726 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:14.726 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:14.727 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.727 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:14.727 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:14.727 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:14.727 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:14.727 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:14.728 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:14.728 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.728 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:14.728 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:14.728 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:14.729 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:14.729 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:14.729 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:14.729 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:14.729 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:14.729 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:14.730 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:14.730 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:14.730 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:14.730 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:14.730 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.731 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:14.731 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:14.731 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 10, 2020-05-18T21:36:14.731 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:14.731 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.731 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:14.732 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.732 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.732 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.732 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:36:14.732 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.733 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:14.733 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.733 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:14.733 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:14.733 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:14.733 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:14.734 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:36:14.734 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:14.734 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:14.734 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.734 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.735 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:14.735 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:14.735 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:14.735 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:14.735 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:14.735 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:14.736 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:14.736 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:14.736 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.736 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:14.736 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:14.737 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:14.737 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:14.737 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:14.737 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:14.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.737 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:14.738 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:14.738 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:14.738 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.738 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.738 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.739 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.739 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.739 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.739 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.739 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.739 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.740 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.740 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.740 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.740 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.740 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.741 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.741 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:14.741 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:36:14.741 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.741 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:14.741 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.742 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.742 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.742 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.742 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.742 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.743 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.743 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.743 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.743 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:14.743 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:14.743 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:14.744 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:14.744 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:14.744 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:14.744 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:14.744 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:14.745 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:14.745 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.745 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:14.745 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.745 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:14.745 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:14.746 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:14.746 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:14.746 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:14.746 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.746 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1", 2020-05-18T21:36:14.747 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x101", 2020-05-18T21:36:14.747 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:14.747 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:14.747 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:14.747 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "0", 2020-05-18T21:36:14.747 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "0", 2020-05-18T21:36:14.748 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:14.748 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "1", 2020-05-18T21:36:14.748 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.748 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:14.748 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:14.748 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:14.749 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.749 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.749 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.749 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.750 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.750 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.750 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.750 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.750 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.750 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.751 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.751 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.751 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.751 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.751 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.752 INFO:teuthology.orchestra.run.smithi155.stdout: "child": 1, 2020-05-18T21:36:14.752 INFO:teuthology.orchestra.run.smithi155.stdout: "subtree": 1, 2020-05-18T21:36:14.752 INFO:teuthology.orchestra.run.smithi155.stdout: "subtreetemp": 0, 2020-05-18T21:36:14.752 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:14.752 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:14.752 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:14.753 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.753 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:14.753 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [ 2020-05-18T21:36:14.753 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.753 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray6", 2020-05-18T21:36:14.754 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:14.754 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:14.754 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:14.754 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:14.754 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:14.754 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:14.755 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:14.755 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1552, 2020-05-18T21:36:14.755 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:14.755 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.755 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:14.755 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.756 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.756 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.756 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.756 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.756 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.757 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.757 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.757 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.757 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.757 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.757 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.758 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.758 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.758 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.758 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.758 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:14.759 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.759 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:14.759 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:14.759 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.759 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.759 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.760 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.760 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.760 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.760 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.760 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.761 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.761 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:14.761 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.761 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.761 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.762 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray7", 2020-05-18T21:36:14.762 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:14.762 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:14.762 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:14.762 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:14.762 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:14.763 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:14.763 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:14.763 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1553, 2020-05-18T21:36:14.763 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:14.763 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.764 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:14.764 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.764 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.764 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.764 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.764 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.765 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.765 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.765 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.765 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.765 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.766 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.766 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.766 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.766 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.766 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.767 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:14.767 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.767 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:14.767 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:14.767 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.768 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.768 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.768 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.768 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.768 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.768 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.769 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.769 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.769 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.769 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:14.769 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.770 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.770 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.770 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray0", 2020-05-18T21:36:14.770 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:14.770 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:14.770 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:14.771 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:14.771 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:14.771 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:14.771 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:14.771 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1546, 2020-05-18T21:36:14.772 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:14.772 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.772 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:14.772 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.772 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.772 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.773 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.773 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.773 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.773 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.773 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.774 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.774 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.774 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.774 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.774 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.774 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.775 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.775 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.775 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:14.775 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.775 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:14.776 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:14.776 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.776 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.776 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.776 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.776 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.777 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.777 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.777 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.777 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.777 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.778 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:14.778 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.778 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.778 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.778 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray9", 2020-05-18T21:36:14.778 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:14.779 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:14.779 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:14.779 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:14.779 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:14.779 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:14.780 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:14.780 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1555, 2020-05-18T21:36:14.780 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:14.780 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.780 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:14.781 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.781 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.781 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.781 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.781 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.781 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.782 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.782 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.782 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.782 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.782 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.783 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.783 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.783 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.783 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.783 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.783 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:14.784 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.784 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:14.784 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:14.784 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.784 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.785 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.785 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.785 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.785 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.785 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.785 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.786 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.786 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.786 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:14.786 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.786 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.787 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.787 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray5", 2020-05-18T21:36:14.787 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:14.787 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:14.787 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:14.787 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:14.788 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:14.788 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:14.788 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:14.788 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1551, 2020-05-18T21:36:14.788 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:14.789 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.789 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:14.789 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.789 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.789 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.789 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.790 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.790 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.790 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.790 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.790 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.791 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.791 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.791 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.792 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.792 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.792 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.792 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.792 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:14.793 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.793 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:14.793 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:14.793 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.794 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.794 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.794 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.794 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.794 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.794 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.795 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.795 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.795 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.796 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:14.796 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.796 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.796 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.796 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray2", 2020-05-18T21:36:14.797 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:14.797 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:14.797 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:14.797 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:14.797 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:14.797 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:14.798 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:14.798 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1548, 2020-05-18T21:36:14.798 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:14.798 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.798 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:14.799 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.799 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.799 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.799 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.799 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.799 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.800 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.800 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.800 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.800 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.800 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.802 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.802 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.802 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.802 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.803 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.803 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:14.803 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.803 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:14.803 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:14.804 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.804 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.804 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.804 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.804 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.805 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.805 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.805 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.805 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.805 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.806 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:14.806 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.806 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.806 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.806 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray1", 2020-05-18T21:36:14.807 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:14.807 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:14.807 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:14.807 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:14.807 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:14.808 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:14.808 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:14.808 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1547, 2020-05-18T21:36:14.808 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:14.808 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.808 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:14.809 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.809 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.809 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.809 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.809 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.810 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.810 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.810 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.810 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.810 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.810 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.811 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.811 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.811 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.811 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.811 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.812 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:14.812 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.812 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:14.812 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:14.812 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.812 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.813 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.813 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.813 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.813 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.813 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.814 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.814 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.814 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.814 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:14.814 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.814 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.815 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.815 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray8", 2020-05-18T21:36:14.815 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:14.815 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:14.815 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:14.815 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:14.816 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:14.816 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:14.816 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:14.816 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1554, 2020-05-18T21:36:14.816 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:14.817 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.817 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:14.817 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.817 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.817 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.817 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.818 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.818 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.818 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.818 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.818 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.819 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.819 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.819 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.819 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.819 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.819 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.820 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.820 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:14.820 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.820 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:14.820 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:14.821 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.821 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.821 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.821 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.821 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.821 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.822 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.822 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.822 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.822 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.822 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:14.823 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.823 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.823 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.823 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray3", 2020-05-18T21:36:14.823 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:14.823 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:14.824 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:14.824 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:14.824 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:14.824 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:14.824 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:14.825 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1549, 2020-05-18T21:36:14.825 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:14.825 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.825 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:14.825 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.826 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.826 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.826 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.826 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.827 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.827 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.827 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.827 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.828 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.828 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.828 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.828 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.828 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.829 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.829 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.829 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:14.829 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.829 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:14.829 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:14.830 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.830 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.830 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.830 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.830 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.831 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.831 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.831 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.831 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.831 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.831 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:14.832 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.832 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.832 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:14.832 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray4", 2020-05-18T21:36:14.832 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:14.832 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:14.833 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:14.833 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:14.833 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:14.833 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:14.833 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:14.834 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1550, 2020-05-18T21:36:14.834 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:14.834 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:14.834 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:14.834 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.834 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:14.835 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:14.835 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:14.835 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.835 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:14.835 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:14.836 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:14.836 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:14.836 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:14.836 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:14.836 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.836 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:14.837 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:14.837 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:14.837 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:14.837 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:14.837 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.838 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:14.838 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:14.838 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:14.838 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:14.838 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:14.838 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:14.839 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:14.839 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:14.839 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:14.839 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:14.839 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:14.840 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:14.840 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:14.840 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.840 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:14.840 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.840 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:14.841 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:14.841 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:14.841 INFO:teuthology.orchestra.run.smithi155.stdout:] 2020-05-18T21:36:14.841 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "ino": 1, "rdev": 0, "ctime": "2020-05-18T21:36:12.141787+0000", "btime": "2020-05-18T21:35:50.165450+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 26, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:12.141787+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:36:12.141787+0000", "num_files": 0, "num_subdirs": 1, "change_attr": 1 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:57.723581+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:50.165450+0000" }, "version": 4, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 3, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "dirfrag": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1546, "rdev": 0, "ctime": "2020-05-18T21:35:58.261727+0000", "btime": "2020-05-18T21:35:58.261727+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261727+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261727+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261727+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray0", "dirfrag": "0x60a", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1547, "rdev": 0, "ctime": "2020-05-18T21:35:58.261988+0000", "btime": "2020-05-18T21:35:58.261988+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261988+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261988+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261988+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray1", "dirfrag": "0x60b", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1548, "rdev": 0, "ctime": "2020-05-18T21:35:58.262165+0000", "btime": "2020-05-18T21:35:58.262165+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262165+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262165+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262165+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray2", "dirfrag": "0x60c", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1551, "rdev": 0, "ctime": "2020-05-18T21:35:58.262725+0000", "btime": "2020-05-18T21:35:58.262725+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262725+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262725+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262725+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray5", "dirfrag": "0x60f", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1552, "rdev": 0, "ctime": "2020-05-18T21:35:58.262910+0000", "btime": "2020-05-18T21:35:58.262910+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262910+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262910+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262910+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray6", "dirfrag": "0x610", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1549, "rdev": 0, "ctime": "2020-05-18T21:35:58.262345+0000", "btime": "2020-05-18T21:35:58.262345+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262345+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262345+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262345+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray3", "dirfrag": "0x60d", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1553, "rdev": 0, "ctime": "2020-05-18T21:35:58.263085+0000", "btime": "2020-05-18T21:35:58.263085+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263085+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263085+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263085+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray7", "dirfrag": "0x611", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1554, "rdev": 0, "ctime": "2020-05-18T21:35:58.263263+0000", "btime": "2020-05-18T21:35:58.263263+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263263+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263263+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263263+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray8", "dirfrag": "0x612", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1550, "rdev": 0, "ctime": "2020-05-18T21:35:58.262533+0000", "btime": "2020-05-18T21:35:58.262533+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262533+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262533+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262533+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray4", "dirfrag": "0x60e", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1555, "rdev": 0, "ctime": "2020-05-18T21:35:58.263460+0000", "btime": "2020-05-18T21:35:58.263460+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263460+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray9", "dirfrag": "0x613", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 3, "rdev": 0, "ctime": "2020-05-18T21:36:06.317019+0000", "btime": "2020-05-18T21:36:06.317019+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:06.317019+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:36:06.317019+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:36:06.317019+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ -2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "openingsnapparents": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 257, "rdev": 0, "ctime": "2020-05-18T21:35:58.261635+0000", "btime": "2020-05-18T21:35:58.261635+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261635+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 10, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "openingsnapparents": 0 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "subtreetemp": 0, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 3, "dentries": [ { "path": "stray6", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1552, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray7", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1553, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray0", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1546, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray9", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1555, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray5", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1551, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray2", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1548, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray1", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1547, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray8", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1554, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray3", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1549, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray4", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1550, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] } ] } ] } ] 2020-05-18T21:36:15.845 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok dump cache 2020-05-18T21:36:15.955 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2020-05-18T21:36:15.956 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:15.956 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1, 2020-05-18T21:36:15.956 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:15.956 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:15.956 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:50.165450+0000", 2020-05-18T21:36:15.957 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 17407, 2020-05-18T21:36:15.957 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:15.957 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:15.957 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:15.957 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:15.958 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:15.958 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:15.958 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:15.958 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:15.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.958 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:15.959 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:36:15.959 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:36:15.959 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:36:15.959 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 26, 2020-05-18T21:36:15.959 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:15.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.960 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:15.960 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:15.960 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:15.960 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:15.960 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:15.961 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:15.961 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:15.961 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:15.961 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:15.961 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:36:15.962 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:15.962 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:15.962 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:15.962 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:15.962 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:15.963 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:15.963 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 1, 2020-05-18T21:36:15.963 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1 2020-05-18T21:36:15.963 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.963 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:15.963 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:15.964 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:15.964 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:15.964 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:15.964 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:15.964 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:57.723581+0000" 2020-05-18T21:36:15.965 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.965 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:15.965 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:15.965 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:15.965 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:15.966 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:15.966 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:15.966 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:50.165450+0000" 2020-05-18T21:36:15.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.966 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 4, 2020-05-18T21:36:15.966 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:15.967 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:15.967 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 3, 2020-05-18T21:36:15.967 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:15.967 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:15.967 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:15.968 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:15.968 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:15.968 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.968 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:15.968 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:15.968 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:15.969 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:15.969 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:15.969 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:15.969 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.969 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:15.970 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:15.970 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:15.970 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:36:15.970 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:15.970 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:15.971 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.971 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:15.971 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:15.971 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:36:15.971 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:15.971 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:15.972 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:36:15.972 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.972 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:15.972 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:15.972 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:15.973 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:15.973 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": 0, 2020-05-18T21:36:15.973 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 0 2020-05-18T21:36:15.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.973 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:36:15.975 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:15.975 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:15.976 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:15.976 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:15.976 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:15.976 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:15.976 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:15.977 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:15.977 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.977 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:15.977 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:15.977 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:15.978 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:15.978 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:15.978 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:15.978 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:36:15.978 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:15.978 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:36:15.979 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:15.979 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:15.979 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:15.979 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:15.979 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:15.980 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.980 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:15.980 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:15.980 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [], 2020-05-18T21:36:15.980 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:15.980 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:15.981 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:15.981 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:15.981 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:36:15.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.981 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:15.982 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1546, 2020-05-18T21:36:15.982 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:15.982 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:15.982 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:15.982 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:15.982 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:15.983 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:15.983 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:15.983 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:15.983 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:15.983 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:15.984 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:15.984 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:15.984 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.984 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:15.984 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:15.985 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:15.985 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:15.985 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:15.985 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:15.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.985 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:15.986 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:15.986 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:15.986 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:15.986 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:15.986 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:15.987 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:15.987 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:15.987 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:15.987 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:15.987 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:15.987 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:15.988 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:15.988 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:15.988 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:15.988 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:15.988 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:15.989 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:15.989 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.989 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:15.989 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:15.989 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:15.989 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:15.990 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:15.990 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:15.990 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261727+0000" 2020-05-18T21:36:15.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.990 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:15.991 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:15.991 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:15.991 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:15.991 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:15.991 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:15.992 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261727+0000" 2020-05-18T21:36:15.992 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.992 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:15.992 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:15.992 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:15.992 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:15.993 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:15.993 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:15.993 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:15.993 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:15.993 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:15.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.994 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:15.994 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:15.994 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:15.994 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:15.994 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:15.995 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:15.995 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.995 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:15.995 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:15.995 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:15.996 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:15.996 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:15.996 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:15.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.996 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:15.996 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:15.997 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:15.997 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:15.997 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:15.997 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:15.997 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.998 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:15.998 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:15.998 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:15.998 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:15.998 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:15.999 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:15.999 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:15.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:15.999 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:15.999 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:15.999 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.000 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.000 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.000 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.000 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.000 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.001 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.001 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.001 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:16.001 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:16.001 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:16.002 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:16.002 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:16.002 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:16.002 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:16.003 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:16.003 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:16.003 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.003 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.003 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:16.004 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.004 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:16.004 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:16.004 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:16.004 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:16.005 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:16.005 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.005 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray0", 2020-05-18T21:36:16.005 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60a", 2020-05-18T21:36:16.005 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:16.006 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:16.006 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:16.006 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:16.007 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:16.007 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:16.007 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:16.007 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.007 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.008 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:16.008 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:16.008 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.008 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.009 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.009 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.009 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.009 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.009 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.010 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.010 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.010 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.010 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.011 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.011 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.011 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.011 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:16.011 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:16.012 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:16.012 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:16.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.012 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:16.012 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:16.012 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:16.013 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.013 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.013 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1547, 2020-05-18T21:36:16.014 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:16.014 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:16.014 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:16.014 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:16.014 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:16.015 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:16.015 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:16.015 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:16.015 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:16.015 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:16.016 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:16.016 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:16.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.016 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:16.016 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:16.016 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:16.017 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:16.017 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:16.017 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:16.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.018 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:16.018 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:16.018 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:16.018 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:16.018 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:16.019 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:16.019 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:16.019 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:16.019 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:16.019 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:16.019 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:16.020 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:16.020 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:16.020 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.020 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:16.020 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:16.021 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:16.021 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:16.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.021 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:16.021 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.022 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.022 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.022 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.022 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.022 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261988+0000" 2020-05-18T21:36:16.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.023 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:16.023 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.023 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.023 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.023 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.024 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.024 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261988+0000" 2020-05-18T21:36:16.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.024 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.024 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:16.024 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:16.025 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:16.025 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:16.025 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:16.025 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:16.025 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:16.026 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:16.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.026 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:16.026 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:16.026 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:16.026 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:16.027 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:16.027 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:16.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.027 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:16.027 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:16.028 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:16.028 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.028 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.028 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.028 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.028 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.029 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.029 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.029 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.029 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.029 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.030 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.030 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.030 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.030 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.031 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:16.031 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:16.031 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:16.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.031 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:16.031 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.032 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.032 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.032 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.032 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.032 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.033 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.033 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.033 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:16.033 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:16.033 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:16.034 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:16.034 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:16.034 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:16.034 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:16.034 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:16.035 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:16.035 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.035 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.035 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:16.036 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.036 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:16.036 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:16.036 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:16.036 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:16.037 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:16.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.037 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray1", 2020-05-18T21:36:16.037 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60b", 2020-05-18T21:36:16.037 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:16.038 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:16.038 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:16.038 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:16.038 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:16.038 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:16.039 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:16.039 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.039 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.039 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:16.039 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:16.039 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.040 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.040 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.040 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.040 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.041 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.041 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.041 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.041 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.041 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.042 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.042 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.042 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.042 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.042 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:16.043 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:16.043 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:16.043 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:16.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.043 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:16.043 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:16.044 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:16.044 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.044 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.044 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1548, 2020-05-18T21:36:16.045 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:16.045 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:16.045 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:16.045 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:16.045 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:16.046 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:16.046 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:16.046 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:16.046 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:16.046 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:16.046 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:16.047 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:16.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.047 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:16.047 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:16.047 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:16.047 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:16.048 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:16.048 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:16.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.048 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:16.048 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:16.049 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:16.049 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:16.049 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:16.049 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:16.049 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:16.049 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:16.050 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:16.050 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:16.050 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:16.050 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:16.050 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:16.051 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.051 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:16.051 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:16.051 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:16.051 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:16.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.052 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:16.052 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.052 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.052 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.052 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.053 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.053 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262165+0000" 2020-05-18T21:36:16.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.053 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:16.053 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.054 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.054 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.054 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.054 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.054 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262165+0000" 2020-05-18T21:36:16.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.055 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.055 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:16.055 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:16.055 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:16.055 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:16.056 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:16.056 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:16.056 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:16.056 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:16.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.056 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:16.057 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:16.057 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:16.057 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:16.057 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:16.057 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:16.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.058 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:16.058 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:16.058 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:16.058 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.058 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.059 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.059 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.059 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.059 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.059 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.060 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.060 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.060 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.060 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.060 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.061 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.061 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.061 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:16.061 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:16.061 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:16.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.062 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:16.062 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.062 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.062 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.062 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.063 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.063 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.063 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.063 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.063 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:16.064 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:16.064 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:16.064 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:16.064 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:16.064 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:16.065 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:16.065 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:16.065 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:16.065 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.065 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.065 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:16.066 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.066 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:16.066 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:16.066 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:16.066 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:16.067 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:16.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.067 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray2", 2020-05-18T21:36:16.067 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60c", 2020-05-18T21:36:16.067 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:16.067 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:16.068 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:16.068 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:16.068 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:16.068 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:16.068 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:16.069 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.069 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.069 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:16.069 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:16.069 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.069 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.070 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.070 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.070 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.070 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.071 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.071 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.071 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.071 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.071 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.072 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.072 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.072 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.072 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:16.072 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:16.072 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:16.073 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:16.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.073 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:16.073 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:16.074 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:16.074 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.074 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.074 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1551, 2020-05-18T21:36:16.074 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:16.075 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:16.075 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:16.075 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:16.075 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:16.076 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:16.076 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:16.076 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:16.076 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:16.076 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:16.077 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:16.077 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:16.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.077 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:16.077 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:16.077 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:16.078 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:16.079 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:16.079 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:16.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.080 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:16.080 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:16.080 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:16.080 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:16.080 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:16.081 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:16.081 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:16.081 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:16.081 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:16.081 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:16.081 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:16.082 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:16.082 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:16.082 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.082 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:16.082 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:16.083 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:16.083 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:16.083 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.083 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:16.083 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.083 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.084 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.084 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.084 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.084 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262725+0000" 2020-05-18T21:36:16.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.085 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:16.085 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.085 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.085 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.085 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.086 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.086 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262725+0000" 2020-05-18T21:36:16.086 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.086 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.086 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:16.086 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:16.087 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:16.087 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:16.087 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:16.087 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:16.087 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:16.088 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:16.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.088 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:16.088 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:16.088 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:16.088 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:16.089 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:16.089 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:16.089 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.089 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:16.089 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:16.090 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:16.090 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.090 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.090 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.091 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.091 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.091 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.091 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.091 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.091 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.092 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.092 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.092 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.092 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.092 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.093 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:16.093 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:16.093 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:16.093 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.093 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:16.093 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.094 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.094 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.094 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.094 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.094 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.095 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.095 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.095 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.095 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:16.095 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:16.095 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:16.096 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:16.096 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:16.096 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:16.096 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:16.096 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:16.097 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:16.097 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.097 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.097 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:16.097 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.098 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:16.098 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:16.098 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:16.098 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:16.098 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:16.098 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.099 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray5", 2020-05-18T21:36:16.099 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60f", 2020-05-18T21:36:16.099 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:16.099 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:16.099 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:16.100 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:16.100 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:16.100 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:16.100 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:16.100 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.100 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.101 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:16.101 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:16.101 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.101 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.101 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.102 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.102 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.102 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.102 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.102 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.103 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.103 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.103 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.103 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.104 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.104 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.104 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:16.104 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:16.104 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:16.104 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:16.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.105 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:16.105 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:16.105 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:16.105 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.106 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.106 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.106 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1552, 2020-05-18T21:36:16.106 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:16.106 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:16.107 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:16.107 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:16.107 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:16.107 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:16.107 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:16.107 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:16.108 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:16.108 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:16.108 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:16.108 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:16.108 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.109 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:16.109 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:16.109 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:16.109 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:16.109 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:16.109 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:16.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.110 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:16.110 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:16.110 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:16.110 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:16.111 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:16.111 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:16.111 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:16.111 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:16.111 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:16.111 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:16.112 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:16.112 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:16.112 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:16.112 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.112 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:16.112 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:16.113 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:16.113 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:16.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.113 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:16.113 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.114 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.114 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.114 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.114 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.114 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262910+0000" 2020-05-18T21:36:16.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.115 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:16.115 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.115 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.115 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.115 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.116 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.116 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262910+0000" 2020-05-18T21:36:16.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.116 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.116 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:16.117 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:16.117 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:16.117 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:16.117 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:16.117 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:16.117 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:16.118 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:16.118 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.118 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:16.118 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:16.118 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:16.119 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:16.119 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:16.119 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:16.119 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.119 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:16.119 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:16.120 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:16.120 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.120 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.120 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.120 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.121 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.121 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.121 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.121 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.121 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.122 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.122 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.122 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.122 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.122 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:16.123 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:16.123 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:16.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.123 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:16.123 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.124 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.124 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.124 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.124 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.124 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.124 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.125 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.125 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.125 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:16.125 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:16.125 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:16.126 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:16.126 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:16.126 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:16.126 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:16.126 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:16.126 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:16.127 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.127 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.127 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:16.127 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.128 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:16.128 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:16.128 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:16.128 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:16.129 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:16.129 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.129 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray6", 2020-05-18T21:36:16.129 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x610", 2020-05-18T21:36:16.129 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:16.129 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:16.130 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:16.130 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:16.130 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:16.130 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:16.130 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:16.131 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.131 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.131 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:16.131 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:16.131 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.131 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.132 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.132 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.132 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.132 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.133 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.133 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.133 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.133 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.133 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.134 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.134 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.134 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.134 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.134 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:16.134 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:16.135 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:16.135 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:16.135 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.135 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:16.135 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:16.136 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:16.136 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.136 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.136 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.136 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1549, 2020-05-18T21:36:16.136 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:16.137 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:16.137 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:16.137 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:16.137 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:16.137 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:16.138 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:16.138 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:16.138 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:16.138 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:16.138 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:16.138 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:16.139 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.139 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:16.139 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:16.139 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:16.139 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:16.140 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:16.140 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:16.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.140 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:16.140 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:16.140 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:16.141 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:16.141 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:16.141 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:16.141 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:16.141 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:16.142 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:16.142 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:16.142 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:16.142 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:16.142 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:16.142 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.143 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:16.143 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:16.143 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:16.143 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:16.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.144 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:16.144 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.144 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.144 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.144 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.144 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.145 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262345+0000" 2020-05-18T21:36:16.145 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.145 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:16.145 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.145 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.146 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.146 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.146 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.146 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262345+0000" 2020-05-18T21:36:16.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.147 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.147 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:16.147 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:16.147 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:16.147 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:16.147 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:16.148 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:16.148 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:16.148 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:16.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.148 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:16.149 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:16.149 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:16.149 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:16.149 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:16.149 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:16.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.150 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:16.150 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:16.150 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:16.150 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.150 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.151 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.151 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.151 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.151 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.152 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.152 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.152 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.152 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.152 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.153 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.153 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.153 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:16.153 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:16.153 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:16.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.154 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:16.154 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.154 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.154 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.154 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.155 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.155 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.155 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.155 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.156 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:16.156 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:16.156 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:16.156 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:16.156 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:16.156 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:16.157 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:16.157 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:16.157 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:16.157 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.157 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.158 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:16.158 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.158 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:16.158 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:16.158 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:16.159 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:16.159 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:16.159 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.159 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray3", 2020-05-18T21:36:16.160 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60d", 2020-05-18T21:36:16.160 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:16.160 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:16.160 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:16.160 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:16.160 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:16.161 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:16.161 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:16.161 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.161 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.161 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:16.162 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:16.162 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.162 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.162 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.162 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.163 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.163 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.163 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.163 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.163 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.164 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.164 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.164 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.165 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.165 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.165 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:16.165 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:16.165 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:16.166 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:16.166 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.166 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:16.166 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:16.166 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:16.166 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.167 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.167 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1553, 2020-05-18T21:36:16.167 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:16.167 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:16.168 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:16.168 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:16.168 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:16.168 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:16.168 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:16.168 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:16.169 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:16.169 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:16.169 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:16.169 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:16.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.170 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:16.170 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:16.170 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:16.170 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:16.170 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:16.170 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:16.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.171 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:16.171 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:16.171 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:16.171 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:16.172 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:16.172 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:16.172 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:16.172 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:16.172 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:16.172 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:16.173 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:16.173 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:16.173 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:16.173 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.173 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:16.174 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:16.174 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:16.174 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:16.174 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.174 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:16.174 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.175 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.175 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.175 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.175 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.175 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263085+0000" 2020-05-18T21:36:16.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.176 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:16.176 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.176 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.176 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.176 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.177 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.177 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263085+0000" 2020-05-18T21:36:16.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.177 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.177 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:16.178 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:16.178 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:16.178 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:16.178 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:16.178 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:16.178 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:16.179 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:16.179 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.179 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:16.179 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:16.179 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:16.180 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:16.180 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:16.180 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:16.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.180 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:16.180 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:16.181 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:16.181 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.181 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.181 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.182 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.182 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.182 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.182 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.182 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.182 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.183 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.183 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.183 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.183 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.184 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:16.184 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:16.184 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:16.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.184 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:16.184 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.185 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.185 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.185 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.185 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.185 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.186 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.186 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.186 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:16.186 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:16.186 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:16.187 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:16.187 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:16.187 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:16.187 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:16.187 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:16.188 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:16.188 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.188 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.188 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:16.188 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.188 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:16.189 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:16.189 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:16.189 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:16.189 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:16.189 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.190 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray7", 2020-05-18T21:36:16.190 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x611", 2020-05-18T21:36:16.190 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:16.190 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:16.190 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:16.195 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:16.195 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:16.195 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:16.195 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:16.196 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.196 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.196 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:16.196 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:16.196 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.197 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.197 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.197 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.197 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.197 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.198 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.198 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.198 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.198 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.199 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.199 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.199 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.199 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.199 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:16.199 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:16.200 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:16.200 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:16.200 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.200 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:16.200 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:16.201 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:16.201 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.201 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.201 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.201 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1554, 2020-05-18T21:36:16.201 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:16.202 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:16.202 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:16.202 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:16.202 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:16.202 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:16.203 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:16.203 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:16.203 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:16.203 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:16.203 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:16.203 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:16.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.204 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:16.204 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:16.204 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:16.204 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:16.205 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:16.205 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:16.205 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.205 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:16.205 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:16.205 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:16.206 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:16.206 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:16.206 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:16.206 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:16.206 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:16.207 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:16.207 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:16.207 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:16.207 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:16.207 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:16.207 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.208 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:16.208 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:16.208 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:16.208 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:16.208 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.209 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:16.209 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.209 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.209 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.209 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.209 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.210 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263263+0000" 2020-05-18T21:36:16.210 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.210 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:16.210 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.210 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.211 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.211 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.211 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.211 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263263+0000" 2020-05-18T21:36:16.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.211 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.212 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:16.212 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:16.212 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:16.212 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:16.212 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:16.213 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:16.213 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:16.213 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:16.213 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.213 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:16.214 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:16.214 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:16.214 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:16.214 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:16.214 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:16.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.215 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:16.215 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:16.215 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:16.215 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.215 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.216 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.216 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.216 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.216 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.216 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.216 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.217 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.217 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.217 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.217 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.217 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.218 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.218 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.218 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:16.218 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:16.218 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:16.218 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.219 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:16.219 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.219 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.219 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.219 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.220 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.220 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.220 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.220 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.220 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.220 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:16.221 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:16.221 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:16.221 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:16.221 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:16.221 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:16.222 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:16.222 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:16.222 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:16.222 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.222 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.222 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:16.223 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.223 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:16.223 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:16.223 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:16.223 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:16.223 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:16.224 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.224 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray8", 2020-05-18T21:36:16.224 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x612", 2020-05-18T21:36:16.224 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:16.224 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:16.225 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:16.225 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:16.225 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:16.225 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:16.225 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:16.225 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.226 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.226 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:16.226 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:16.226 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.226 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.227 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.227 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.227 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.227 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.228 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.228 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.228 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.228 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.228 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.229 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.229 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.229 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.229 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.229 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.230 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:16.230 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:16.230 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:16.230 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:16.230 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.231 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:16.231 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:16.231 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:16.231 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.231 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.232 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1550, 2020-05-18T21:36:16.232 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:16.232 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:16.232 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:16.232 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:16.233 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:16.233 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:16.233 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:16.233 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:16.233 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:16.233 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:16.234 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:16.234 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:16.234 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.234 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:16.234 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:16.235 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:16.235 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:16.235 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:16.235 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:16.235 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.235 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:16.236 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:16.236 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:16.236 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:16.236 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:16.236 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:16.237 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:16.237 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:16.237 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:16.237 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:16.237 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:16.237 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:16.238 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:16.238 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.238 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:16.238 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:16.238 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:16.239 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:16.239 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.239 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:16.239 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.239 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.239 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.240 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.240 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.240 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262533+0000" 2020-05-18T21:36:16.240 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.240 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:16.241 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.241 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.241 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.241 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.241 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.241 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262533+0000" 2020-05-18T21:36:16.242 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.242 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.242 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:16.242 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:16.242 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:16.243 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:16.243 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:16.243 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:16.243 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:16.243 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:16.243 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.244 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:16.244 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:16.244 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:16.244 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:16.244 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:16.245 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:16.245 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.245 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:16.245 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:16.245 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:16.245 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.246 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.246 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.246 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.246 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.246 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.247 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.247 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.247 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.247 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.247 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.247 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.248 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.248 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.248 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.248 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:16.248 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:16.248 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:16.249 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.249 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:16.249 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.249 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.249 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.250 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.250 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.250 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.250 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.250 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.251 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.251 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:16.251 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:16.251 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:16.251 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:16.251 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:16.252 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:16.252 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:16.252 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:16.252 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:16.252 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.253 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.253 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:16.253 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.253 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:16.253 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:16.253 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:16.254 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:16.254 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:16.254 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.254 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray4", 2020-05-18T21:36:16.254 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60e", 2020-05-18T21:36:16.255 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:16.255 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:16.255 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:16.255 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:16.255 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:16.255 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:16.256 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:16.256 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.256 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.256 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:16.256 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:16.257 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.257 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.257 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.257 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.257 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.257 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.258 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.258 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.258 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.258 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.258 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.259 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.259 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.259 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.259 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.259 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.260 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:16.260 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:16.260 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:16.260 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:16.261 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.261 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:16.261 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:16.261 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:16.261 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.262 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.262 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.262 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1555, 2020-05-18T21:36:16.262 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:16.262 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:16.262 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:16.263 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:16.263 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:16.263 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:16.263 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:16.263 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:16.264 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:16.264 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:16.264 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:16.264 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:16.264 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.264 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:16.265 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:16.265 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:16.265 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:16.265 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:16.266 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:16.266 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.266 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:16.266 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:16.266 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:16.267 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:16.267 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:16.267 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:16.267 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:16.267 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:16.267 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:16.268 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:16.268 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:16.268 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:16.268 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:16.268 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.269 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:16.269 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:16.269 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:16.269 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:16.269 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.270 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:16.270 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.270 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.270 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.270 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.270 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.271 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:16.271 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.271 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:16.271 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.271 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.271 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.272 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.272 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.272 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:16.272 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.272 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.273 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:16.273 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:16.273 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:16.273 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:16.273 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:16.273 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:16.274 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:16.274 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:16.274 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.274 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:16.274 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:16.275 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:16.275 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:16.275 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:16.275 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:16.275 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.275 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:16.276 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:16.276 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:16.276 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.276 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.276 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.277 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.277 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.277 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.277 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.277 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.278 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.278 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.278 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.278 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.278 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.278 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.279 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.279 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:16.279 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:16.279 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:16.279 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.280 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:16.280 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.280 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.280 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.280 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.280 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.281 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.281 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.281 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.281 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.281 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:16.282 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:16.282 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:16.282 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:16.282 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:16.282 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:16.282 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:16.283 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:16.283 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:16.283 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.283 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.283 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:16.284 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.284 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:16.284 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:16.284 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:16.284 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:16.284 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:16.285 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.285 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray9", 2020-05-18T21:36:16.285 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x613", 2020-05-18T21:36:16.285 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:16.285 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:16.286 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:16.286 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:16.286 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:16.286 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:16.286 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:16.286 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.287 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.287 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:16.287 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:16.287 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.287 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.288 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.288 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.288 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.288 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.288 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.288 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.289 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.289 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.289 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.289 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.289 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.290 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.290 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.290 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.290 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:16.290 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:16.290 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:16.291 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:16.291 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.291 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:16.291 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:16.291 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:16.292 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.292 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.292 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.292 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 3, 2020-05-18T21:36:16.292 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:16.292 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:16.293 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:16.293 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16877, 2020-05-18T21:36:16.293 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:16.293 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:16.293 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:16.294 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:16.294 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:16.294 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:16.294 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:16.294 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:16.294 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.295 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:16.295 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:16.295 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:16.295 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:16.295 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:16.295 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:16.296 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.296 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:16.296 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:16.296 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:16.296 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:16.297 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:16.297 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:16.297 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:16.297 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:16.297 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:16.297 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:16.298 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:16.298 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:16.298 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:16.298 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.298 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:16.299 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:16.299 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:16.299 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:16.299 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.299 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:16.299 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.300 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.300 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.300 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.300 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.300 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:06.317019+0000" 2020-05-18T21:36:16.301 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.301 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:16.301 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.301 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.301 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.301 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:16.302 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.302 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:06.317019+0000" 2020-05-18T21:36:16.302 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.302 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.302 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:16.303 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:16.303 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:16.303 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:16.303 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:16.303 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:16.303 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:16.304 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:16.305 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.305 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:16.306 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:16.306 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:16.306 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:16.306 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:16.306 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:16.307 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.307 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:16.307 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:16.307 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:16.307 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.308 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.308 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.308 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.308 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.308 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.308 INFO:teuthology.orchestra.run.smithi155.stdout: -2, 2020-05-18T21:36:16.309 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.309 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.309 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.309 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.309 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.310 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.310 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.310 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.310 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:36:16.310 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.311 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:36:16.311 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.311 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.311 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.311 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.311 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.312 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.312 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.312 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.312 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.312 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:16.313 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:16.313 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:16.313 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:16.313 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:16.313 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:16.313 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:16.314 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:16.314 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:16.314 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.314 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:16.314 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.315 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:16.315 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:16.315 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:16.315 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:16.315 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:36:16.316 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.316 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.316 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 257, 2020-05-18T21:36:16.316 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:16.317 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:16.317 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:16.317 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:16.317 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:16.317 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:16.317 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:16.318 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:16.318 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:16.318 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:16.318 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:16.318 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:16.319 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.319 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:16.319 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:16.319 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:16.319 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:16.319 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:16.320 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:16.320 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.320 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:16.320 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:16.320 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:16.321 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:16.321 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:16.321 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:16.321 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:16.321 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:16.321 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:16.322 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:16.322 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:16.322 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:16.322 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:16.322 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.323 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:16.323 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:16.323 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 10, 2020-05-18T21:36:16.323 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:16.323 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.323 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:16.324 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.324 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.324 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.324 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:36:16.324 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.325 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:16.325 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.325 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:16.325 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:16.325 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:16.325 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:16.326 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:36:16.326 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:16.326 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:16.326 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.326 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.327 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:16.327 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:16.327 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:16.327 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:16.327 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:16.327 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:16.328 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:16.328 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:16.328 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.328 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:16.328 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:16.329 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:16.329 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:16.329 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:16.329 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:16.329 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.329 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:16.330 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:16.330 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:16.330 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.330 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.330 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.331 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.331 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.331 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.331 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.332 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.332 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.332 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.332 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.333 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.333 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.333 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.333 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:16.333 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:36:16.334 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.334 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:16.334 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.334 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.334 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.335 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.335 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.335 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.335 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.335 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.336 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.336 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:16.336 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:16.336 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:16.336 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:16.336 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:16.337 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:16.337 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:16.337 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:16.337 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:16.337 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.338 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:16.338 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.338 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:16.338 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:16.338 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:16.338 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:16.339 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:16.339 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.339 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1", 2020-05-18T21:36:16.339 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x101", 2020-05-18T21:36:16.339 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:16.340 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:16.340 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:16.340 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "0", 2020-05-18T21:36:16.340 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "0", 2020-05-18T21:36:16.341 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:16.341 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "1", 2020-05-18T21:36:16.341 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.341 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:16.341 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:16.342 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:16.342 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.342 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.342 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.342 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.342 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.343 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.343 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.343 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.343 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.343 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.344 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.344 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.344 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.344 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.344 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.345 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.345 INFO:teuthology.orchestra.run.smithi155.stdout: "child": 1, 2020-05-18T21:36:16.345 INFO:teuthology.orchestra.run.smithi155.stdout: "subtree": 1, 2020-05-18T21:36:16.345 INFO:teuthology.orchestra.run.smithi155.stdout: "subtreetemp": 0, 2020-05-18T21:36:16.346 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:16.346 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:16.346 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:16.346 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.346 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:16.346 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [ 2020-05-18T21:36:16.347 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.347 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray6", 2020-05-18T21:36:16.347 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:16.347 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:16.347 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:16.348 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:16.348 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:16.348 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:16.348 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:16.348 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1552, 2020-05-18T21:36:16.348 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:16.349 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.349 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:16.349 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.349 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.349 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.350 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.350 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.350 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.350 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.350 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.350 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.351 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.351 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.351 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.351 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.351 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.352 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.352 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.352 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:16.352 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.352 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:16.352 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:16.353 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.353 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.353 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.353 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.353 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.354 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.354 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.354 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.354 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.354 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.355 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:16.355 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.355 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.355 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.355 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray7", 2020-05-18T21:36:16.355 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:16.356 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:16.356 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:16.356 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:16.356 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:16.356 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:16.357 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:16.357 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1553, 2020-05-18T21:36:16.357 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:16.357 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.357 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:16.358 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.358 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.358 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.358 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.358 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.359 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.359 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.359 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.359 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.359 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.359 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.360 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.360 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.360 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.360 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.361 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.361 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:16.361 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.361 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:16.361 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:16.362 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.362 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.362 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.362 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.362 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.363 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.363 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.363 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.363 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.363 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.364 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:16.364 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.364 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.364 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.365 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray0", 2020-05-18T21:36:16.365 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:16.365 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:16.365 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:16.365 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:16.366 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:16.366 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:16.366 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:16.366 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1546, 2020-05-18T21:36:16.366 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:16.367 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.367 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:16.367 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.367 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.367 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.367 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.368 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.368 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.368 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.368 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.368 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.369 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.369 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.369 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.369 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.369 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.370 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.370 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.370 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:16.370 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.370 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:16.370 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:16.371 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.371 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.371 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.371 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.371 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.372 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.372 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.372 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.372 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.372 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.372 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:16.373 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.373 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.373 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.373 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray9", 2020-05-18T21:36:16.373 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:16.374 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:16.374 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:16.374 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:16.374 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:16.374 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:16.374 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:16.375 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1555, 2020-05-18T21:36:16.375 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:16.375 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.375 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:16.375 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.376 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.376 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.376 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.376 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.376 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.376 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.377 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.377 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.377 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.377 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.377 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.378 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.378 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.378 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.378 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.378 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:16.379 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.379 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:16.379 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:16.379 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.379 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.379 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.380 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.380 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.380 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.380 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.380 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.380 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.381 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.381 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:16.381 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.381 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.381 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.382 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray5", 2020-05-18T21:36:16.382 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:16.382 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:16.382 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:16.382 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:16.383 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:16.383 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:16.383 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:16.383 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1551, 2020-05-18T21:36:16.383 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:16.384 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.384 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:16.384 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.384 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.384 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.385 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.385 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.385 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.385 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.385 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.386 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.386 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.386 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.386 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.386 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.386 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.387 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.387 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.387 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:16.387 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.387 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:16.388 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:16.388 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.388 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.388 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.388 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.388 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.389 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.389 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.389 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.389 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.389 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.390 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:16.390 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.390 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.390 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray2", 2020-05-18T21:36:16.391 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:16.391 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:16.391 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:16.391 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:16.391 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:16.391 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:16.392 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:16.392 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1548, 2020-05-18T21:36:16.392 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:16.392 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.392 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:16.392 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.393 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.393 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.393 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.393 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.393 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.394 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.394 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.394 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.394 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.394 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.394 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.395 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.395 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.395 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.395 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.395 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:16.396 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.396 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:16.396 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:16.396 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.396 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.396 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.397 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.397 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.397 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.397 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.397 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.398 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.398 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.398 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:16.398 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.398 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.399 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.399 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray1", 2020-05-18T21:36:16.399 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:16.399 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:16.399 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:16.399 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:16.400 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:16.400 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:16.400 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:16.400 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1547, 2020-05-18T21:36:16.400 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:16.401 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.401 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:16.401 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.401 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.401 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.401 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.402 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.402 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.402 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.402 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.402 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.403 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.403 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.403 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.403 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.403 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.403 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.404 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.404 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:16.404 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.404 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:16.404 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:16.405 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.405 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.405 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.405 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.405 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.405 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.406 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.406 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.406 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.406 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.406 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:16.407 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.407 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.407 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.407 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray8", 2020-05-18T21:36:16.407 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:16.407 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:16.408 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:16.408 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:16.408 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:16.408 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:16.409 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:16.409 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1554, 2020-05-18T21:36:16.409 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:16.409 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.409 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:16.410 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.410 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.410 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.410 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.410 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.410 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.411 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.411 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.411 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.411 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.411 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.412 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.412 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.412 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.412 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.412 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.412 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:16.413 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.413 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:16.413 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:16.413 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.413 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.414 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.414 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.414 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.414 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.414 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.414 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.415 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.415 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.415 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:16.415 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.415 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.416 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.416 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray3", 2020-05-18T21:36:16.416 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:16.416 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:16.417 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:16.417 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:16.417 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:16.417 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:16.417 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:16.417 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1549, 2020-05-18T21:36:16.418 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:16.418 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.418 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:16.418 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.418 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.419 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.419 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.419 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.419 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.419 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.419 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.420 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.420 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.420 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.420 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.420 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.421 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.421 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.421 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:16.421 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.421 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:16.422 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:16.422 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.422 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.422 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.422 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.422 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.423 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.423 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.423 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.423 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.423 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.424 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:16.424 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.424 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:16.424 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray4", 2020-05-18T21:36:16.424 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:16.425 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:16.425 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:16.425 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:16.425 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:16.425 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:16.426 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:16.426 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1550, 2020-05-18T21:36:16.426 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:16.426 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:16.426 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:16.426 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.427 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:16.427 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:16.427 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:16.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.427 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:16.427 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:16.428 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:16.428 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:16.428 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:16.428 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:16.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.429 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:16.429 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:16.429 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:16.429 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:16.430 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:16.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.430 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:16.430 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:16.431 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:16.431 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:16.431 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:16.432 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:16.432 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:16.432 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:16.433 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:16.433 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:16.433 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:16.433 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:16.434 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:16.434 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.434 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:16.435 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.435 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:16.435 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:16.436 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:16.436 INFO:teuthology.orchestra.run.smithi155.stdout:] 2020-05-18T21:36:16.438 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "ino": 1, "rdev": 0, "ctime": "2020-05-18T21:36:12.141787+0000", "btime": "2020-05-18T21:35:50.165450+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 26, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:12.141787+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:36:12.141787+0000", "num_files": 0, "num_subdirs": 1, "change_attr": 1 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:57.723581+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:50.165450+0000" }, "version": 4, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 3, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "dirfrag": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1546, "rdev": 0, "ctime": "2020-05-18T21:35:58.261727+0000", "btime": "2020-05-18T21:35:58.261727+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261727+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261727+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261727+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray0", "dirfrag": "0x60a", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1547, "rdev": 0, "ctime": "2020-05-18T21:35:58.261988+0000", "btime": "2020-05-18T21:35:58.261988+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261988+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261988+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261988+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray1", "dirfrag": "0x60b", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1548, "rdev": 0, "ctime": "2020-05-18T21:35:58.262165+0000", "btime": "2020-05-18T21:35:58.262165+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262165+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262165+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262165+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray2", "dirfrag": "0x60c", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1551, "rdev": 0, "ctime": "2020-05-18T21:35:58.262725+0000", "btime": "2020-05-18T21:35:58.262725+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262725+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262725+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262725+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray5", "dirfrag": "0x60f", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1552, "rdev": 0, "ctime": "2020-05-18T21:35:58.262910+0000", "btime": "2020-05-18T21:35:58.262910+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262910+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262910+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262910+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray6", "dirfrag": "0x610", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1549, "rdev": 0, "ctime": "2020-05-18T21:35:58.262345+0000", "btime": "2020-05-18T21:35:58.262345+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262345+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262345+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262345+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray3", "dirfrag": "0x60d", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1553, "rdev": 0, "ctime": "2020-05-18T21:35:58.263085+0000", "btime": "2020-05-18T21:35:58.263085+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263085+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263085+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263085+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray7", "dirfrag": "0x611", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1554, "rdev": 0, "ctime": "2020-05-18T21:35:58.263263+0000", "btime": "2020-05-18T21:35:58.263263+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263263+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263263+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263263+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray8", "dirfrag": "0x612", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1550, "rdev": 0, "ctime": "2020-05-18T21:35:58.262533+0000", "btime": "2020-05-18T21:35:58.262533+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262533+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262533+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262533+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray4", "dirfrag": "0x60e", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1555, "rdev": 0, "ctime": "2020-05-18T21:35:58.263460+0000", "btime": "2020-05-18T21:35:58.263460+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263460+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray9", "dirfrag": "0x613", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 3, "rdev": 0, "ctime": "2020-05-18T21:36:06.317019+0000", "btime": "2020-05-18T21:36:06.317019+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:06.317019+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:36:06.317019+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:36:06.317019+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ -2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "openingsnapparents": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 257, "rdev": 0, "ctime": "2020-05-18T21:35:58.261635+0000", "btime": "2020-05-18T21:35:58.261635+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261635+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 10, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "openingsnapparents": 0 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "subtreetemp": 0, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 3, "dentries": [ { "path": "stray6", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1552, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray7", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1553, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray0", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1546, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray9", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1555, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray5", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1551, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray2", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1548, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray1", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1547, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray8", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1554, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray3", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1549, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray4", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1550, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] } ] } ] } ] 2020-05-18T21:36:17.442 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok dump cache 2020-05-18T21:36:17.551 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2020-05-18T21:36:17.551 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.551 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1, 2020-05-18T21:36:17.551 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:17.552 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:17.552 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:50.165450+0000", 2020-05-18T21:36:17.552 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 17407, 2020-05-18T21:36:17.552 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:17.553 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:17.553 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:17.553 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:17.553 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:17.553 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:17.554 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:17.554 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:17.554 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.554 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:17.555 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:36:17.555 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:36:17.555 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:36:17.556 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 26, 2020-05-18T21:36:17.556 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:17.556 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.557 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:17.557 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:17.557 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:17.558 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:17.558 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:17.558 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:17.559 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:17.559 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:17.559 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:17.559 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:36:17.559 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:17.560 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:17.560 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:17.560 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.560 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:17.560 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:17.560 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 1, 2020-05-18T21:36:17.561 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1 2020-05-18T21:36:17.561 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.561 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:17.561 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.561 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.562 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.564 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.564 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.565 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:57.723581+0000" 2020-05-18T21:36:17.565 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.565 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:17.565 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.566 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.566 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.566 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.567 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.567 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:50.165450+0000" 2020-05-18T21:36:17.567 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.567 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 4, 2020-05-18T21:36:17.568 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:17.568 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:17.568 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 3, 2020-05-18T21:36:17.569 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:17.569 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:17.569 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:17.570 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:17.570 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:17.570 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.570 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:17.571 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:17.571 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:17.571 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:17.572 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:17.572 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:17.572 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.573 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:17.573 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:17.573 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:17.574 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:36:17.574 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.574 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.574 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.575 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.575 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.575 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:36:17.576 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.576 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.576 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:36:17.577 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.577 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.577 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.578 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.578 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.578 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": 0, 2020-05-18T21:36:17.579 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 0 2020-05-18T21:36:17.579 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.579 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:36:17.580 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:17.580 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:17.580 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:17.580 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:17.581 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:17.581 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:17.581 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:17.582 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:17.582 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.582 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:17.583 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:17.583 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:17.583 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:17.584 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:17.584 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:17.584 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:36:17.584 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:17.585 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:36:17.585 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:17.585 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:17.586 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:17.586 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:17.586 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:17.586 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.587 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:17.587 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:17.587 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [], 2020-05-18T21:36:17.588 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:17.588 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:17.588 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:17.588 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:17.589 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:36:17.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.589 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.590 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1546, 2020-05-18T21:36:17.590 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:17.590 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:17.591 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:17.591 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:17.591 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:17.591 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:17.592 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:17.592 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:17.592 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:17.593 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:17.593 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:17.593 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:17.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.594 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:17.594 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:17.594 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:17.595 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:17.595 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:17.595 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:17.595 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.596 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:17.596 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:17.596 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:17.596 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:17.596 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:17.597 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:17.597 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:17.597 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:17.597 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:17.597 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:17.597 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:17.598 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:17.598 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:17.598 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.598 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:17.599 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:17.599 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:17.599 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:17.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.599 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:17.599 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.600 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.600 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.600 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.600 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.600 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261727+0000" 2020-05-18T21:36:17.601 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.601 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:17.601 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.601 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.601 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.602 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.602 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.602 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261727+0000" 2020-05-18T21:36:17.602 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.602 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:17.603 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:17.603 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:17.603 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:17.603 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:17.603 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:17.603 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:17.604 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:17.604 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:17.604 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.604 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:17.604 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:17.605 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:17.605 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:17.605 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:17.605 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:17.605 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.605 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:17.606 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:17.606 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:17.606 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.606 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.606 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.607 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.607 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.607 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.607 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.608 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.608 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.608 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.608 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.608 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.608 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.609 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.609 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.609 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:17.609 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:17.609 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:17.610 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.610 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:17.610 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:17.610 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:17.610 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:17.611 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:17.611 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:17.611 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:17.611 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:17.611 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:17.611 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.612 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:17.612 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:17.612 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:17.612 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:17.612 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:17.613 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:17.613 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:17.613 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:17.613 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:17.613 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.613 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.614 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:17.614 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.614 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:17.614 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:17.614 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:17.615 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:17.615 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:17.615 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.615 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray0", 2020-05-18T21:36:17.615 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60a", 2020-05-18T21:36:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:17.617 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:17.617 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.617 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.617 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:17.617 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:17.618 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.618 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.618 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.618 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.618 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.619 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.619 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.619 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.619 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.619 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.620 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.620 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.620 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.620 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.620 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.622 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:17.622 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:17.622 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:17.622 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:17.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.623 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.623 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1547, 2020-05-18T21:36:17.623 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:17.623 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:17.623 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:17.623 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:17.624 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:17.624 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:17.624 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:17.624 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:17.624 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:17.625 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:17.625 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:17.625 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:17.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.625 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:17.626 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:17.626 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:17.626 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:17.626 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:17.626 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:17.627 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.627 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:17.627 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:17.627 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:17.628 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:17.628 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:17.628 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:17.628 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:17.629 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:17.629 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:17.629 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:17.629 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:17.629 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:17.630 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:17.630 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.630 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:17.630 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:17.630 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.632 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.632 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.632 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261988+0000" 2020-05-18T21:36:17.632 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.632 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:17.633 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.633 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.633 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.633 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.633 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.634 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261988+0000" 2020-05-18T21:36:17.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.634 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:17.634 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:17.635 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:17.635 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:17.635 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:17.635 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:17.635 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:17.637 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:17.637 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:17.637 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:17.637 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.637 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.639 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.639 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.639 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.639 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.639 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.640 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.640 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.640 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.640 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.640 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.641 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:17.641 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:17.641 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:17.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.641 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:17.642 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:17.642 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:17.642 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:17.642 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:17.642 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:17.642 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:17.643 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:17.643 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:17.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.643 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:17.643 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:17.644 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:17.644 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:17.644 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:17.644 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:17.645 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:17.645 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:17.645 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:17.645 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.645 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.646 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:17.646 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.646 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:17.646 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:17.646 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:17.647 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:17.647 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:17.647 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.647 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray1", 2020-05-18T21:36:17.647 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60b", 2020-05-18T21:36:17.648 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:17.648 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:17.648 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:17.648 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:17.648 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:17.649 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:17.649 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:17.649 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.649 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.649 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:17.650 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:17.650 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.650 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.650 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.650 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.651 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.651 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.651 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.651 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.651 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.652 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.652 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.652 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.652 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.653 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.653 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.653 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:17.653 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:17.654 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:17.654 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:17.654 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.654 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:17.654 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:17.655 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:17.655 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:17.655 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.655 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.655 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1548, 2020-05-18T21:36:17.656 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:17.656 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:17.656 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:17.656 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:17.656 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:17.657 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:17.657 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:17.657 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:17.657 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:17.657 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:17.658 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:17.658 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:17.658 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.658 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:17.658 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:17.659 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:17.659 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:17.659 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:17.659 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:17.659 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.660 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:17.660 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:17.660 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:17.660 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:17.660 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:17.661 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:17.661 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:17.661 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:17.661 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:17.661 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:17.661 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:17.662 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:17.662 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:17.662 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.662 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:17.662 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:17.663 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:17.663 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:17.663 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.663 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:17.663 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.663 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.664 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.664 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.664 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.664 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262165+0000" 2020-05-18T21:36:17.664 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.665 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:17.665 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.665 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.665 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.665 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.665 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.666 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262165+0000" 2020-05-18T21:36:17.666 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.666 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:17.666 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:17.666 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:17.668 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.668 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:17.668 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:17.668 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:17.668 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:17.668 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:17.669 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:17.669 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.669 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:17.669 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:17.669 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:17.670 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.670 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.670 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.670 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.671 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.671 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.671 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.671 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.671 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:17.673 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:17.673 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:17.673 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.673 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:17.673 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:17.674 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:17.674 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:17.674 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:17.674 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:17.674 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:17.674 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:17.675 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:17.675 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.675 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:17.675 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:17.675 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:17.675 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:17.676 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:17.676 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:17.676 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:17.677 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:17.677 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:17.677 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.678 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.678 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:17.678 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.679 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:17.679 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:17.679 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:17.680 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:17.680 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:17.680 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.680 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray2", 2020-05-18T21:36:17.680 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60c", 2020-05-18T21:36:17.681 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:17.681 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:17.681 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:17.681 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:17.681 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:17.682 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:17.682 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:17.682 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.682 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.682 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:17.683 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:17.683 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.683 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.683 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.684 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.684 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.684 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.685 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.685 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.685 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.685 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.686 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.686 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.686 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.686 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.687 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.687 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:17.687 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:17.687 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:17.687 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:17.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.688 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:17.688 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:17.688 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:17.688 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:17.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.689 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.689 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1551, 2020-05-18T21:36:17.689 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:17.689 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:17.689 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:17.690 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:17.690 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:17.690 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:17.690 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:17.690 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:17.691 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:17.691 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:17.691 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:17.691 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:17.691 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.691 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:17.692 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:17.692 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:17.692 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:17.692 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:17.692 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:17.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.693 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:17.693 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:17.693 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:17.693 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:17.693 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:17.694 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:17.694 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:17.694 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:17.694 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:17.694 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:17.695 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:17.695 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:17.695 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:17.695 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.696 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:17.696 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:17.696 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:17.696 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:17.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.697 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:17.697 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.697 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.697 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.697 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.698 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.698 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262725+0000" 2020-05-18T21:36:17.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.698 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:17.698 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.699 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.699 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.699 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.699 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.699 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262725+0000" 2020-05-18T21:36:17.699 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.700 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:17.700 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:17.700 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:17.700 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:17.700 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:17.701 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:17.701 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:17.701 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:17.701 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:17.701 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.701 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:17.702 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:17.702 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:17.702 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:17.702 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:17.702 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:17.703 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.703 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:17.703 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:17.703 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:17.703 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.703 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.704 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.704 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.704 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.704 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.704 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.705 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.705 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.705 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.705 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.705 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.705 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.706 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.706 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.706 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:17.706 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:17.706 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:17.707 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.707 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:17.707 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:17.707 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:17.707 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:17.708 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:17.708 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:17.708 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:17.708 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:17.708 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:17.709 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.709 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:17.709 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:17.709 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:17.709 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:17.710 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:17.710 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:17.710 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:17.710 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:17.710 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:17.711 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.711 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.711 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:17.711 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.712 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:17.712 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:17.712 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:17.712 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:17.712 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:17.713 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.713 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray5", 2020-05-18T21:36:17.713 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60f", 2020-05-18T21:36:17.714 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:17.714 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:17.714 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:17.714 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:17.714 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:17.715 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:17.715 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:17.715 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.715 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.715 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:17.716 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:17.716 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.716 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.716 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.716 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.717 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.717 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.717 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.717 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.717 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.718 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.718 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.718 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.718 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.718 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.719 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.719 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:17.719 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:17.719 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:17.719 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:17.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.720 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:17.720 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:17.720 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:17.720 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:17.721 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.721 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.721 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1552, 2020-05-18T21:36:17.721 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:17.721 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:17.722 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:17.722 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:17.722 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:17.722 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:17.722 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:17.723 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:17.723 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:17.723 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:17.723 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:17.723 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:17.723 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.724 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:17.724 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:17.724 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:17.724 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:17.724 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:17.725 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:17.725 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.725 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:17.725 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:17.725 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:17.725 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:17.726 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:17.726 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:17.726 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:17.726 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:17.726 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:17.727 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:17.727 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:17.727 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:17.727 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:17.728 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.728 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:17.728 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:17.728 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:17.728 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:17.729 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.729 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:17.729 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.730 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.730 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.730 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.730 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.730 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262910+0000" 2020-05-18T21:36:17.731 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.731 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:17.731 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.731 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.731 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.731 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.732 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.732 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262910+0000" 2020-05-18T21:36:17.732 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.732 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:17.732 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:17.733 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:17.733 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:17.733 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:17.733 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:17.733 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:17.734 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:17.734 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:17.734 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.734 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:17.734 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:17.735 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:17.735 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:17.735 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:17.735 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:17.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.736 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:17.736 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:17.736 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:17.736 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.736 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.736 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.737 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.737 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.737 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.737 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.738 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.738 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.738 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.738 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.738 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.739 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.739 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.739 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:17.739 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:17.739 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:17.740 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.740 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:17.740 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:17.740 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:17.740 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:17.741 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:17.741 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:17.741 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:17.741 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:17.741 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:17.741 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.742 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:17.742 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:17.742 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:17.742 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:17.742 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:17.743 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:17.743 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:17.743 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:17.743 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:17.743 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.743 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.744 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:17.744 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.744 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:17.744 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:17.744 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:17.745 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:17.745 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:17.745 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.745 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray6", 2020-05-18T21:36:17.746 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x610", 2020-05-18T21:36:17.746 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:17.746 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:17.746 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:17.746 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:17.747 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:17.747 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:17.747 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:17.747 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.747 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.748 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:17.748 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:17.748 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.748 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.748 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.749 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.749 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.749 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.749 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.750 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.750 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.750 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.750 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.750 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.751 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.751 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.751 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.751 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:17.751 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:17.752 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:17.752 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:17.752 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.752 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:17.752 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:17.752 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:17.753 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:17.753 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.753 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.753 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1549, 2020-05-18T21:36:17.754 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:17.754 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:17.754 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:17.754 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:17.755 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:17.755 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:17.755 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:17.755 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:17.755 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:17.756 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:17.756 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:17.756 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:17.756 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.756 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:17.756 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:17.757 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:17.757 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:17.757 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:17.758 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:17.758 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.758 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:17.758 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:17.758 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:17.758 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:17.759 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:17.759 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:17.759 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:17.759 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:17.760 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:17.760 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:17.760 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:17.760 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:17.760 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:17.761 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.761 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:17.761 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:17.761 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:17.761 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:17.761 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.762 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:17.762 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.762 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.762 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.762 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.763 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.763 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262345+0000" 2020-05-18T21:36:17.763 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.763 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:17.763 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.764 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.764 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.764 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.765 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.765 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262345+0000" 2020-05-18T21:36:17.765 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.765 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:17.765 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:17.766 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:17.766 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:17.766 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:17.766 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:17.766 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:17.767 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:17.767 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:17.767 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.767 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:17.767 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:17.767 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:17.768 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:17.768 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:17.768 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:17.768 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.768 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:17.769 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:17.769 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:17.769 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.769 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.769 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.769 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.770 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.770 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.770 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.770 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.770 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.771 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.771 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.771 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.771 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.771 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.772 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.772 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:17.772 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:17.772 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:17.772 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.773 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:17.773 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:17.773 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:17.773 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:17.774 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:17.774 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:17.774 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:17.774 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:17.775 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:17.775 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.775 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:17.775 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:17.775 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:17.776 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:17.776 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:17.776 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:17.776 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:17.777 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:17.777 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:17.777 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.777 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.777 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:17.778 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.778 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:17.778 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:17.778 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:17.778 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:17.779 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:17.779 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.779 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray3", 2020-05-18T21:36:17.779 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60d", 2020-05-18T21:36:17.779 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:17.780 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:17.780 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:17.780 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:17.780 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:17.780 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:17.781 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:17.781 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.781 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.781 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:17.781 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:17.782 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.782 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.782 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.782 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.782 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.783 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.783 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.783 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.783 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.783 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.784 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.784 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.784 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.784 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.785 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.785 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.785 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:17.785 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:17.786 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:17.786 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:17.786 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.786 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:17.786 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:17.787 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:17.787 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:17.787 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.787 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.787 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1553, 2020-05-18T21:36:17.788 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:17.788 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:17.788 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:17.788 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:17.788 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:17.789 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:17.789 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:17.789 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:17.789 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:17.789 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:17.789 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:17.790 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:17.790 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.790 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:17.790 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:17.790 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:17.791 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:17.791 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:17.791 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:17.791 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.791 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:17.791 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:17.792 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:17.792 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:17.792 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:17.792 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:17.792 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:17.793 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:17.793 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:17.793 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:17.793 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:17.793 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:17.794 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:17.794 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.794 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:17.794 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:17.794 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:17.795 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:17.795 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.795 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:17.795 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.796 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.796 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.796 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.796 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.797 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263085+0000" 2020-05-18T21:36:17.797 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.797 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:17.797 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.797 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.798 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.798 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.798 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.798 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263085+0000" 2020-05-18T21:36:17.798 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.799 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:17.799 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:17.799 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:17.799 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:17.799 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:17.799 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:17.800 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:17.800 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:17.800 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:17.800 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.800 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:17.801 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:17.801 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:17.801 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:17.801 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:17.801 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:17.802 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.802 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:17.802 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:17.802 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:17.802 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.802 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.803 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.803 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.803 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.803 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.803 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.804 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.804 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.804 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.804 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.804 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.804 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.805 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.805 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.805 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:17.805 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:17.805 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:17.806 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.806 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:17.806 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:17.806 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:17.806 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:17.806 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:17.807 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:17.807 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:17.807 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:17.807 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:17.807 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.808 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:17.808 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:17.808 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:17.808 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:17.808 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:17.809 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:17.809 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:17.809 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:17.809 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:17.809 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.810 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.810 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:17.810 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.810 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:17.810 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:17.811 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:17.811 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:17.811 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:17.811 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.811 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray7", 2020-05-18T21:36:17.811 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x611", 2020-05-18T21:36:17.812 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:17.812 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:17.812 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:17.812 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:17.812 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:17.813 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:17.813 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:17.813 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.813 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.813 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:17.813 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:17.814 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.814 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.814 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.814 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.814 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.815 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.815 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.815 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.815 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.815 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.815 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.816 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.816 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.816 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.816 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.816 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.817 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:17.817 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:17.817 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:17.817 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:17.818 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.818 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:17.818 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:17.818 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:17.818 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:17.819 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.819 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.819 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1554, 2020-05-18T21:36:17.819 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:17.820 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:17.820 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:17.820 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:17.820 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:17.820 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:17.821 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:17.821 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:17.821 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:17.821 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:17.821 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:17.822 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:17.822 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.822 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:17.822 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:17.822 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:17.822 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:17.823 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:17.823 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:17.823 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.823 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:17.823 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:17.824 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:17.824 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:17.824 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:17.824 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:17.824 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:17.824 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:17.825 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:17.827 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:17.827 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:17.827 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:17.828 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:17.828 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.828 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:17.829 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:17.829 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:17.829 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:17.829 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.830 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:17.830 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.830 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.831 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.831 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.831 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.831 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263263+0000" 2020-05-18T21:36:17.831 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.831 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:17.832 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.832 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.832 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.832 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.832 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.833 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263263+0000" 2020-05-18T21:36:17.833 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.833 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:17.833 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:17.833 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:17.833 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:17.834 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:17.834 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:17.834 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:17.834 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:17.835 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:17.835 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.835 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:17.836 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:17.836 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:17.836 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:17.837 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:17.837 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:17.837 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.838 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:17.838 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:17.838 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:17.839 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.839 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.839 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.840 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.840 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.840 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.841 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.841 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.841 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.842 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.842 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.842 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.843 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.843 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.843 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.844 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:17.844 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:17.844 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:17.845 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.846 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:17.846 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:17.846 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:17.846 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:17.846 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:17.847 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:17.847 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:17.847 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:17.847 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:17.847 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.848 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:17.848 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:17.848 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:17.848 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:17.848 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:17.849 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:17.849 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:17.849 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:17.849 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:17.849 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.850 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.850 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:17.850 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.850 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:17.850 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:17.850 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:17.851 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:17.851 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:17.851 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.851 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray8", 2020-05-18T21:36:17.851 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x612", 2020-05-18T21:36:17.852 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:17.852 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:17.852 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:17.852 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:17.853 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:17.853 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:17.853 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:17.853 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.853 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.854 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:17.854 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:17.854 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.854 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.854 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.854 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.855 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.855 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.855 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.855 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.855 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.856 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.856 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.856 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.856 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.856 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.856 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.857 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.857 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:17.857 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:17.857 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:17.857 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:17.858 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.858 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:17.858 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:17.858 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:17.858 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:17.858 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.859 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.859 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1550, 2020-05-18T21:36:17.859 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:17.859 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:17.859 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:17.860 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:17.860 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:17.860 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:17.860 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:17.860 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:17.860 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:17.861 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:17.861 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:17.861 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:17.861 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.861 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:17.862 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:17.862 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:17.862 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:17.862 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:17.862 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:17.862 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.863 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:17.863 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:17.863 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:17.863 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:17.864 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:17.864 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:17.864 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:17.864 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:17.864 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:17.865 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:17.865 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:17.865 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:17.865 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:17.865 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.866 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:17.866 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:17.866 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:17.866 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:17.866 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.867 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:17.867 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.867 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.867 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.867 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.868 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.868 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262533+0000" 2020-05-18T21:36:17.868 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.868 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:17.868 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.868 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.869 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.869 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.869 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.869 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262533+0000" 2020-05-18T21:36:17.869 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.870 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:17.870 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:17.870 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:17.870 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:17.870 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:17.870 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:17.871 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:17.871 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:17.871 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:17.871 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.871 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:17.871 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:17.872 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:17.872 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:17.872 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:17.872 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:17.872 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.873 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:17.873 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:17.873 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:17.873 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.873 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.873 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.874 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.874 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.874 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.874 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.874 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.875 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.875 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.875 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.875 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.875 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.875 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.876 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.876 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:17.876 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:17.876 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:17.876 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.876 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:17.877 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:17.877 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:17.877 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:17.877 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:17.877 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:17.878 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:17.878 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:17.878 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:17.878 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.878 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:17.879 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:17.879 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:17.879 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:17.879 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:17.879 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:17.879 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:17.880 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:17.880 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:17.880 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.880 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.880 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:17.881 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.881 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:17.881 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:17.881 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:17.881 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:17.881 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:17.882 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.882 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray4", 2020-05-18T21:36:17.882 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60e", 2020-05-18T21:36:17.882 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:17.882 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:17.883 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:17.883 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:17.883 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:17.883 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:17.883 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:17.883 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.884 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.884 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:17.884 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:17.884 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.884 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.885 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.885 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.885 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.885 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.885 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.885 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.886 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.886 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.886 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.886 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.886 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.887 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.887 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.887 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.887 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:17.887 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:17.887 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:17.888 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:17.888 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.888 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:17.888 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:17.888 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:17.889 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:17.889 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.889 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.890 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1555, 2020-05-18T21:36:17.890 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:17.890 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:17.890 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:17.890 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:17.891 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:17.891 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:17.891 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:17.891 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:17.892 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:17.892 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:17.892 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:17.892 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:17.893 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.893 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:17.893 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:17.893 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:17.893 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:17.894 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:17.894 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:17.894 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.894 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:17.894 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:17.894 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:17.895 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:17.895 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:17.895 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:17.895 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:17.895 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:17.896 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:17.896 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:17.896 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:17.896 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:17.896 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:17.897 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.897 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:17.897 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:17.897 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:17.897 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:17.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.899 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:17.899 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.899 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.900 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.900 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.900 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.900 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:17.900 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.901 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:17.901 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.901 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.901 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.902 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.902 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.902 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:17.902 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.902 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:17.903 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:17.903 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:17.903 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:17.903 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:17.903 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:17.904 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:17.904 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:17.904 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:17.904 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.904 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:17.905 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:17.905 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:17.905 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:17.905 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:17.905 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:17.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.906 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:17.906 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:17.906 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:17.906 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.907 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.907 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.907 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.907 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.907 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.907 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.908 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.908 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.908 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.908 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.908 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.909 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.909 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.909 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.909 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:17.909 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:17.910 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:17.910 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.910 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:17.911 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:17.912 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:17.912 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:17.912 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:17.912 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:17.912 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:17.913 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:17.913 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:17.913 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.913 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:17.913 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:17.914 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:17.914 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:17.914 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:17.914 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:17.914 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:17.915 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:17.915 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:17.915 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.915 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.915 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:17.915 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.916 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:17.916 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:17.916 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:17.916 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:17.916 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray9", 2020-05-18T21:36:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x613", 2020-05-18T21:36:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.920 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.920 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.920 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.920 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.920 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.920 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.921 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.921 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.921 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.921 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.921 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.922 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.922 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.922 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.922 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:17.922 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:17.923 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:17.923 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:17.923 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.923 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:17.923 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:17.923 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:17.924 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:17.924 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.924 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.924 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 3, 2020-05-18T21:36:17.924 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:17.925 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:17.925 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:17.925 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16877, 2020-05-18T21:36:17.925 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:17.925 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:17.925 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:17.926 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:17.926 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:17.926 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:17.926 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:17.926 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:17.927 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.927 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:17.927 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:17.927 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:17.928 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:17.928 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:17.928 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:17.928 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.928 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:17.928 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:17.929 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:17.929 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:17.929 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:17.929 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:17.929 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:17.930 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:17.930 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:17.930 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:17.930 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:17.930 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:17.931 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:17.931 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.931 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:17.931 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:17.931 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:17.931 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:17.932 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.932 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:17.932 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.932 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.932 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.933 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.933 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.933 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:06.317019+0000" 2020-05-18T21:36:17.933 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.933 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:17.934 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.934 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.934 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.934 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:17.934 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.934 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:06.317019+0000" 2020-05-18T21:36:17.935 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.935 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:17.935 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:17.935 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:17.935 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:17.936 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:17.936 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:17.936 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:17.936 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:17.936 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:17.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.937 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:17.937 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:17.937 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:17.937 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:17.937 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:17.938 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:17.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.938 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:17.938 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:17.938 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:17.938 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.939 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.939 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.939 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.939 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.939 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.940 INFO:teuthology.orchestra.run.smithi155.stdout: -2, 2020-05-18T21:36:17.940 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.940 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.940 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.940 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.940 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.941 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.941 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.941 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.941 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:36:17.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.942 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:36:17.942 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:17.942 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:17.942 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:17.942 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:17.943 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:17.943 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:17.943 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:17.943 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:17.943 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.943 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:17.944 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:17.944 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:17.944 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:17.944 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:17.944 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:17.945 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:17.945 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:17.946 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:17.946 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.946 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:17.947 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.947 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:17.948 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:17.948 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:17.948 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:17.948 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:36:17.949 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.949 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.949 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 257, 2020-05-18T21:36:17.949 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:17.949 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:17.950 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:17.950 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:17.950 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:17.951 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:17.951 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:17.952 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:17.952 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:17.952 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:17.952 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:17.953 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:17.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.953 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:17.953 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:17.954 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:17.954 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:17.954 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:17.954 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:17.954 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.955 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:17.955 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:17.955 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:17.957 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:17.957 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:17.957 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:17.957 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:17.957 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:17.958 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:17.958 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:17.958 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:17.958 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:17.958 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:17.959 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.959 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:17.959 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:17.959 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 10, 2020-05-18T21:36:17.959 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:17.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.960 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:17.960 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.960 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.960 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.960 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:36:17.961 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.961 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:17.961 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.961 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:17.961 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:17.962 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:17.962 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:17.962 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:36:17.962 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:17.962 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:17.963 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.963 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:17.963 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:17.963 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:17.963 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:17.963 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:17.964 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:17.964 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:17.964 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:17.964 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:17.964 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.964 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:17.965 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:17.965 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:17.965 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:17.965 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:17.965 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:17.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.966 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:17.966 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:17.966 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:17.966 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.967 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.967 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.967 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.967 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.968 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.968 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.968 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.968 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.968 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.969 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.969 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.969 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.969 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.969 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:17.970 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:36:17.970 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.970 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:17.970 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:17.970 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:17.970 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:17.971 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:17.971 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:17.971 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:17.971 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:17.971 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:17.972 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.972 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:17.972 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:17.972 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:17.972 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:17.972 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:17.973 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:17.973 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:17.973 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:17.973 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:17.973 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.974 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:17.974 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.974 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:17.974 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:17.974 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:17.974 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:17.975 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:17.975 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.975 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1", 2020-05-18T21:36:17.975 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x101", 2020-05-18T21:36:17.975 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:17.976 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:17.976 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:17.976 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "0", 2020-05-18T21:36:17.976 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "0", 2020-05-18T21:36:17.976 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:17.976 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "1", 2020-05-18T21:36:17.977 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.977 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:17.977 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:17.977 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:17.977 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.978 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.978 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.978 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.978 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.978 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.979 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.979 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.979 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.979 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.979 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.980 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.980 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.980 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.980 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.980 INFO:teuthology.orchestra.run.smithi155.stdout: "child": 1, 2020-05-18T21:36:17.980 INFO:teuthology.orchestra.run.smithi155.stdout: "subtree": 1, 2020-05-18T21:36:17.981 INFO:teuthology.orchestra.run.smithi155.stdout: "subtreetemp": 0, 2020-05-18T21:36:17.981 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:17.981 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:17.981 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:17.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.982 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:17.982 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [ 2020-05-18T21:36:17.982 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.982 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray6", 2020-05-18T21:36:17.982 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:17.983 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:17.983 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:17.983 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:17.983 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:17.983 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:17.984 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:17.984 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1552, 2020-05-18T21:36:17.984 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:17.984 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:17.984 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:17.984 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.985 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.985 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.985 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.985 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.986 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.986 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.986 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.986 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.986 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.987 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.987 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.987 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.987 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.987 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:17.987 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.988 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:17.988 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:17.988 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:17.988 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:17.988 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:17.989 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:17.989 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:17.989 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:17.989 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:17.989 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:17.989 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.990 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.990 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:17.990 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:17.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.990 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:17.991 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray7", 2020-05-18T21:36:17.991 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:17.991 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:17.991 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:17.991 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:17.992 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:17.992 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:17.992 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:17.992 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1553, 2020-05-18T21:36:17.992 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:17.992 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:17.993 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:17.994 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.994 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:17.994 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:17.994 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:17.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.995 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:17.995 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:17.995 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:17.995 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:17.995 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:17.996 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:17.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.996 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:17.996 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:17.996 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:17.997 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:17.997 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:17.997 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.997 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:17.997 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:17.997 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:17.998 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:17.998 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:17.998 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:17.998 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:17.998 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:17.999 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:17.999 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:17.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:17.999 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:17.999 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:18.000 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:18.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.000 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:18.000 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray0", 2020-05-18T21:36:18.000 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:18.001 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:18.001 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:18.001 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:18.001 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:18.001 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:18.002 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:18.002 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1546, 2020-05-18T21:36:18.002 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:18.003 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:18.003 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:18.003 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:18.004 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:18.004 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:18.004 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:18.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.004 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:18.005 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:18.005 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:18.005 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:18.005 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:18.005 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:18.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.006 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:18.006 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:18.006 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:18.006 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:18.006 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:18.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.007 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:18.007 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:18.007 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:18.007 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:18.008 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:18.008 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:18.008 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:18.008 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:18.008 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:18.009 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:18.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.010 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:18.010 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:18.010 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:18.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.011 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:18.011 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray9", 2020-05-18T21:36:18.011 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:18.011 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:18.011 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:18.011 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:18.012 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:18.012 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:18.012 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:18.012 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1555, 2020-05-18T21:36:18.012 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:18.013 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:18.013 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:18.013 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:18.013 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:18.013 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:18.014 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:18.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.014 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:18.014 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:18.014 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:18.014 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:18.015 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:18.015 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:18.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.015 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:18.015 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:18.016 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:18.016 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:18.016 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:18.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.016 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:18.016 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:18.017 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:18.017 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:18.017 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:18.017 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:18.017 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:18.018 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:18.018 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:18.018 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:18.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.018 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:18.018 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:18.019 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:18.019 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.019 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:18.019 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray5", 2020-05-18T21:36:18.019 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:18.020 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:18.020 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:18.020 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:18.020 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:18.020 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:18.020 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:18.021 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1551, 2020-05-18T21:36:18.021 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:18.021 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:18.021 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:18.021 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:18.022 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:18.022 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:18.022 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:18.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.022 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:18.022 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:18.023 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:18.023 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:18.023 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:18.023 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:18.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.024 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:18.024 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:18.024 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:18.024 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:18.024 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:18.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.025 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:18.025 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:18.025 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:18.025 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:18.026 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:18.026 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:18.026 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:18.026 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:18.031 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:18.031 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:18.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.031 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:18.032 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:18.032 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:18.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.032 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:18.032 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray2", 2020-05-18T21:36:18.032 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:18.033 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:18.033 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:18.033 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:18.033 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:18.033 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:18.034 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:18.034 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1548, 2020-05-18T21:36:18.034 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:18.034 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:18.034 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:18.036 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:18.036 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:18.036 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:18.036 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:18.036 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:18.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.037 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:18.037 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:18.037 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:18.037 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:18.037 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:18.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.038 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:18.038 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:18.038 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:18.038 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:18.039 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:18.039 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:18.039 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:18.039 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:18.039 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:18.039 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:18.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.040 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:18.040 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:18.040 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:18.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.041 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:18.041 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray1", 2020-05-18T21:36:18.041 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:18.041 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:18.041 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:18.041 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:18.042 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:18.042 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:18.042 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:18.042 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1547, 2020-05-18T21:36:18.042 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:18.043 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:18.043 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:18.043 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:18.044 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:18.044 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:18.044 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:18.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.044 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:18.044 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:18.045 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:18.045 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:18.045 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:18.045 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:18.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.046 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:18.046 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:18.046 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:18.046 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:18.046 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:18.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.047 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:18.047 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:18.047 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:18.047 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:18.047 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:18.048 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:18.048 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:18.048 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:18.048 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:18.048 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:18.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.049 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:18.049 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:18.049 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:18.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.049 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:18.050 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray8", 2020-05-18T21:36:18.050 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:18.050 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:18.050 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:18.050 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:18.051 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:18.051 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:18.051 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:18.051 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1554, 2020-05-18T21:36:18.051 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:18.051 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:18.052 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:18.052 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:18.052 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:18.052 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:18.052 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:18.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.053 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:18.053 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:18.053 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:18.053 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:18.053 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:18.054 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:18.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.054 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:18.054 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:18.054 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:18.055 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:18.055 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:18.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.055 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:18.055 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:18.055 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:18.056 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:18.056 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:18.056 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:18.056 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:18.056 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:18.057 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:18.057 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:18.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.057 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:18.057 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:18.057 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:18.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:18.058 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray3", 2020-05-18T21:36:18.058 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:18.058 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:18.059 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:18.059 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:18.059 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:18.059 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:18.059 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:18.059 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1549, 2020-05-18T21:36:18.060 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:18.060 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:18.060 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:18.060 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:18.060 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:18.061 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:18.061 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:18.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.061 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:18.061 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:18.061 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:18.062 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:18.062 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:18.062 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:18.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.062 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:18.063 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:18.063 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:18.063 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:18.063 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:18.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.064 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:18.064 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:18.064 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:18.064 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:18.065 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:18.065 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:18.065 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:18.065 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:18.065 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:18.065 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:18.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.066 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:18.066 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:18.066 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:18.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:18.067 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray4", 2020-05-18T21:36:18.067 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:18.067 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:18.067 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:18.067 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:18.068 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:18.068 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:18.068 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:18.068 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1550, 2020-05-18T21:36:18.068 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:18.069 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:18.069 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:18.069 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:18.069 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:18.069 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:18.069 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:18.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.070 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:18.070 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:18.070 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:18.070 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:18.071 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:18.071 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:18.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.071 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:18.071 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:18.071 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:18.072 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:18.072 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:18.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.072 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:18.072 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:18.073 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:18.073 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:18.073 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:18.074 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:18.074 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:18.074 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:18.074 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:18.074 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:18.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:18.075 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:18.075 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:18.075 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:18.076 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:18.076 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:18.076 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:18.076 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:18.076 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:18.076 INFO:teuthology.orchestra.run.smithi155.stdout:] 2020-05-18T21:36:18.078 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "ino": 1, "rdev": 0, "ctime": "2020-05-18T21:36:12.141787+0000", "btime": "2020-05-18T21:35:50.165450+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 26, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:12.141787+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:36:12.141787+0000", "num_files": 0, "num_subdirs": 1, "change_attr": 1 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:57.723581+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:50.165450+0000" }, "version": 4, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 3, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "dirfrag": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1546, "rdev": 0, "ctime": "2020-05-18T21:35:58.261727+0000", "btime": "2020-05-18T21:35:58.261727+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261727+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261727+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261727+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray0", "dirfrag": "0x60a", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1547, "rdev": 0, "ctime": "2020-05-18T21:35:58.261988+0000", "btime": "2020-05-18T21:35:58.261988+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261988+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261988+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261988+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray1", "dirfrag": "0x60b", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1548, "rdev": 0, "ctime": "2020-05-18T21:35:58.262165+0000", "btime": "2020-05-18T21:35:58.262165+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262165+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262165+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262165+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray2", "dirfrag": "0x60c", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1551, "rdev": 0, "ctime": "2020-05-18T21:35:58.262725+0000", "btime": "2020-05-18T21:35:58.262725+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262725+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262725+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262725+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray5", "dirfrag": "0x60f", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1552, "rdev": 0, "ctime": "2020-05-18T21:35:58.262910+0000", "btime": "2020-05-18T21:35:58.262910+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262910+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262910+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262910+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray6", "dirfrag": "0x610", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1549, "rdev": 0, "ctime": "2020-05-18T21:35:58.262345+0000", "btime": "2020-05-18T21:35:58.262345+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262345+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262345+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262345+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray3", "dirfrag": "0x60d", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1553, "rdev": 0, "ctime": "2020-05-18T21:35:58.263085+0000", "btime": "2020-05-18T21:35:58.263085+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263085+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263085+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263085+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray7", "dirfrag": "0x611", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1554, "rdev": 0, "ctime": "2020-05-18T21:35:58.263263+0000", "btime": "2020-05-18T21:35:58.263263+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263263+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263263+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263263+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray8", "dirfrag": "0x612", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1550, "rdev": 0, "ctime": "2020-05-18T21:35:58.262533+0000", "btime": "2020-05-18T21:35:58.262533+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262533+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262533+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262533+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray4", "dirfrag": "0x60e", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1555, "rdev": 0, "ctime": "2020-05-18T21:35:58.263460+0000", "btime": "2020-05-18T21:35:58.263460+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263460+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray9", "dirfrag": "0x613", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 3, "rdev": 0, "ctime": "2020-05-18T21:36:06.317019+0000", "btime": "2020-05-18T21:36:06.317019+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:06.317019+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:36:06.317019+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:36:06.317019+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ -2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "openingsnapparents": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 257, "rdev": 0, "ctime": "2020-05-18T21:35:58.261635+0000", "btime": "2020-05-18T21:35:58.261635+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261635+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 10, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "openingsnapparents": 0 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "subtreetemp": 0, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 3, "dentries": [ { "path": "stray6", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1552, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray7", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1553, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray0", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1546, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray9", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1555, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray5", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1551, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray2", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1548, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray1", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1547, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray8", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1554, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray3", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1549, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray4", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1550, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] } ] } ] } ] 2020-05-18T21:36:19.081 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok dump cache 2020-05-18T21:36:19.189 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2020-05-18T21:36:19.189 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.189 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1, 2020-05-18T21:36:19.190 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:19.190 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:19.190 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:50.165450+0000", 2020-05-18T21:36:19.190 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 17407, 2020-05-18T21:36:19.190 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:19.191 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:19.191 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:19.191 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:19.191 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:19.191 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:19.192 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:19.192 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:19.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.192 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:19.192 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:36:19.193 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:36:19.193 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:36:19.193 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 26, 2020-05-18T21:36:19.193 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:19.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.194 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:19.194 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:19.194 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:19.194 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:19.194 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:19.195 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:19.195 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:19.195 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:19.195 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:19.195 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:36:19.196 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:19.196 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:19.196 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:19.197 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.197 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:19.197 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:19.197 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 1, 2020-05-18T21:36:19.197 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1 2020-05-18T21:36:19.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.198 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:19.198 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.198 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.198 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.199 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.199 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.199 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:57.723581+0000" 2020-05-18T21:36:19.199 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.199 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:19.200 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.200 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.200 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.200 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.200 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.201 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:50.165450+0000" 2020-05-18T21:36:19.201 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.201 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 4, 2020-05-18T21:36:19.201 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:19.201 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:19.202 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 3, 2020-05-18T21:36:19.202 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:19.202 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:19.202 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:19.202 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:19.203 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:19.203 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.203 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:19.203 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:19.203 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:19.204 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:19.204 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:19.204 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:19.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.204 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:19.205 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:19.205 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:19.205 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:36:19.205 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.205 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.206 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.206 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.206 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.206 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:36:19.207 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.207 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.207 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:36:19.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.207 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.208 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.208 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.208 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.208 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": 0, 2020-05-18T21:36:19.208 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 0 2020-05-18T21:36:19.209 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.209 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:36:19.209 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.209 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.210 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.210 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.210 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.210 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.211 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.211 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.211 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:19.212 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:19.212 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:19.212 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:19.212 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:19.212 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:19.213 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:36:19.213 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.213 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:36:19.213 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.213 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.214 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.214 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.214 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.215 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:19.215 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:19.215 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [], 2020-05-18T21:36:19.215 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:19.216 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:19.216 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:19.216 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:19.216 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:36:19.216 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.217 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.217 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1546, 2020-05-18T21:36:19.217 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:19.218 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:19.218 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:19.218 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:19.218 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:19.218 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:19.219 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:19.219 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:19.219 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:19.219 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:19.219 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:19.220 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:19.220 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.220 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:19.221 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:19.221 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:19.221 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:19.221 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:19.222 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:19.222 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.222 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:19.222 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:19.222 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:19.223 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:19.223 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:19.223 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:19.223 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:19.223 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:19.224 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:19.224 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:19.224 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:19.224 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:19.224 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:19.224 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.225 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:19.225 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:19.225 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:19.225 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:19.225 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.226 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:19.226 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.226 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.226 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.226 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.227 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.227 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261727+0000" 2020-05-18T21:36:19.227 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.228 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:19.228 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.228 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.228 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.228 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.229 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.229 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261727+0000" 2020-05-18T21:36:19.229 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.229 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.229 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:19.230 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:19.230 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:19.230 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:19.230 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:19.230 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:19.231 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:19.231 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:19.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.231 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:19.231 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:19.232 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:19.232 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:19.232 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:19.232 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:19.232 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.233 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:19.233 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:19.233 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:19.233 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.233 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.234 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.234 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.234 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.234 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.234 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.234 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.235 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.235 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.235 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.235 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.235 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.236 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.236 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.236 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:19.236 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:19.236 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:19.237 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.237 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:19.237 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.237 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.238 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.238 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.238 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.238 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.239 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.239 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.239 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.239 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:19.239 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:19.240 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:19.240 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:19.240 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:19.240 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:19.240 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:19.240 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:19.241 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:19.241 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.241 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.241 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:19.241 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.242 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:19.242 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:19.242 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:19.242 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:19.242 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:19.243 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.243 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray0", 2020-05-18T21:36:19.243 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60a", 2020-05-18T21:36:19.243 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:19.243 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:19.244 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:19.244 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:19.244 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:19.244 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:19.244 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:19.245 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.245 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.245 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:19.245 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:19.245 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.246 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.246 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.246 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.246 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.246 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.247 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.247 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.247 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.247 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.248 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.248 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.249 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.249 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.250 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.250 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.250 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:19.250 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:19.251 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:19.251 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:19.251 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.251 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:19.251 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:19.252 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:19.252 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.252 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.252 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.252 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1547, 2020-05-18T21:36:19.253 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:19.253 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:19.253 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:19.253 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:19.254 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:19.254 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:19.254 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:19.254 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:19.254 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:19.255 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:19.255 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:19.255 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:19.255 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.255 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:19.256 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:19.256 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:19.256 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:19.257 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:19.257 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:19.257 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.258 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:19.258 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:19.258 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:19.258 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:19.259 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:19.259 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:19.259 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:19.259 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:19.259 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:19.260 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:19.260 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:19.260 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:19.260 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:19.261 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.261 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:19.261 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:19.261 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:19.262 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:19.262 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.262 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:19.263 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.263 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.263 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.263 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.263 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.264 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261988+0000" 2020-05-18T21:36:19.264 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.264 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:19.264 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.264 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.265 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.265 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.265 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.265 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261988+0000" 2020-05-18T21:36:19.265 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.266 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.266 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:19.266 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:19.266 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:19.266 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:19.267 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:19.267 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:19.267 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:19.267 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:19.267 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.268 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:19.268 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:19.269 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:19.269 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:19.269 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:19.270 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:19.270 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.270 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:19.270 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:19.270 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:19.271 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.271 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.271 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.271 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.271 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.271 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.272 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.272 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.272 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.272 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.272 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.273 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.273 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.273 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.273 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.273 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:19.274 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:19.274 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:19.274 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.274 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:19.274 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.275 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.275 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.275 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.275 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.275 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.276 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.276 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.276 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.276 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:19.276 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:19.277 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:19.277 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:19.277 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:19.277 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:19.277 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:19.278 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:19.278 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:19.278 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.279 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.279 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:19.279 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.279 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:19.280 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:19.280 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:19.280 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:19.280 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:19.281 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.281 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray1", 2020-05-18T21:36:19.281 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60b", 2020-05-18T21:36:19.281 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:19.281 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:19.282 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:19.282 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:19.282 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:19.282 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:19.283 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:19.283 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.283 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.283 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:19.283 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:19.284 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.284 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.284 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.284 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.284 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.285 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.285 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.285 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.285 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.285 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.286 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.286 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.286 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.286 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.286 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.287 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.287 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:19.287 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:19.287 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:19.287 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:19.288 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.288 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:19.288 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:19.289 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:19.289 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.289 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.289 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.290 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1548, 2020-05-18T21:36:19.290 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:19.290 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:19.290 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:19.290 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:19.291 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:19.291 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:19.291 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:19.291 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:19.291 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:19.292 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:19.292 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:19.292 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:19.292 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.292 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:19.293 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:19.293 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:19.293 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:19.293 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:19.293 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:19.294 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.294 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:19.294 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:19.294 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:19.294 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:19.295 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:19.295 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:19.295 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:19.295 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:19.295 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:19.295 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:19.296 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:19.296 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:19.296 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:19.296 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.296 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:19.297 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:19.297 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:19.297 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:19.297 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.297 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:19.298 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.298 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.298 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.298 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.298 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.299 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262165+0000" 2020-05-18T21:36:19.299 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.299 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:19.299 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.300 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.300 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.300 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.300 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.300 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262165+0000" 2020-05-18T21:36:19.301 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.301 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.301 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:19.301 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:19.301 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:19.302 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:19.302 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:19.302 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:19.302 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:19.302 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:19.303 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.303 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:19.303 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:19.303 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:19.303 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:19.304 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:19.304 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:19.304 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.304 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:19.304 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:19.305 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:19.305 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.305 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.305 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.305 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.306 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.306 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.306 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.306 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.306 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.307 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.307 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.307 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.307 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.307 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.308 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.308 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:19.308 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:19.308 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:19.308 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.308 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:19.309 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.309 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.309 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.310 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.310 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.310 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.310 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.310 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.311 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.311 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:19.311 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:19.312 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:19.312 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:19.312 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:19.312 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:19.312 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:19.313 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:19.313 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:19.313 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.313 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.313 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:19.314 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.314 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:19.314 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:19.314 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:19.314 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:19.315 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:19.315 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.315 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray2", 2020-05-18T21:36:19.315 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60c", 2020-05-18T21:36:19.315 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:19.316 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:19.316 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:19.316 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:19.316 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:19.316 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:19.317 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:19.317 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.317 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.317 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:19.317 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:19.318 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.318 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.318 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.318 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.318 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.318 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.319 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.319 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.319 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.319 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.320 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.320 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.320 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.320 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.321 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.321 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.321 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:19.321 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:19.321 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:19.322 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:19.322 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.322 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:19.322 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:19.322 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:19.323 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.323 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.323 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.323 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1551, 2020-05-18T21:36:19.323 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:19.324 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:19.324 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:19.324 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:19.324 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:19.324 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:19.324 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:19.325 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:19.325 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:19.325 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:19.325 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:19.325 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:19.326 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.326 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:19.326 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:19.326 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:19.326 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:19.327 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:19.327 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:19.327 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.327 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:19.327 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:19.328 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:19.328 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:19.328 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:19.328 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:19.328 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:19.329 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:19.329 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:19.329 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:19.329 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:19.329 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:19.330 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:19.330 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.330 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:19.330 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:19.331 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:19.331 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:19.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.331 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:19.331 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.332 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.332 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.332 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.332 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.332 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262725+0000" 2020-05-18T21:36:19.333 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.333 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:19.333 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.333 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.333 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.334 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.334 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.334 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262725+0000" 2020-05-18T21:36:19.334 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.334 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.335 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:19.335 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:19.335 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:19.335 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:19.335 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:19.336 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:19.336 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:19.336 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:19.336 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.336 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:19.337 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:19.337 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:19.337 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:19.337 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:19.337 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:19.338 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.338 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:19.338 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:19.338 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:19.338 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.339 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.339 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.339 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.339 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.339 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.340 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.340 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.340 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.340 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.341 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.341 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.341 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.341 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.341 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.342 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:19.342 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:19.342 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:19.342 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.342 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:19.343 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.343 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.343 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.343 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.343 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.344 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.344 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.344 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.344 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.344 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:19.345 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:19.345 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:19.345 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:19.345 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:19.345 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:19.346 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:19.346 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:19.346 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:19.346 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.346 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.346 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:19.347 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.347 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:19.347 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:19.347 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:19.347 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:19.348 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:19.348 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.348 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray5", 2020-05-18T21:36:19.348 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60f", 2020-05-18T21:36:19.349 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:19.349 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:19.349 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:19.350 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:19.350 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:19.350 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:19.350 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:19.351 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.351 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.351 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:19.351 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:19.351 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.352 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.352 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.352 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.352 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.352 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.353 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.353 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.353 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.353 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.353 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.354 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.354 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.354 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.355 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.355 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.355 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:19.355 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:19.355 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:19.355 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:19.356 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.356 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:19.356 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:19.356 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:19.356 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.357 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.357 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.357 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1552, 2020-05-18T21:36:19.358 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:19.358 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:19.358 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:19.358 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:19.359 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:19.359 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:19.359 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:19.359 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:19.359 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:19.360 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:19.360 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:19.360 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:19.360 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.361 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:19.361 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:19.361 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:19.361 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:19.362 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:19.362 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:19.362 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.362 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:19.363 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:19.363 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:19.363 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:19.364 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:19.364 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:19.364 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:19.364 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:19.364 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:19.365 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:19.365 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:19.365 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:19.365 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:19.365 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.366 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:19.366 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:19.366 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:19.366 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:19.366 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.366 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:19.367 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.367 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.367 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.367 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.368 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.368 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262910+0000" 2020-05-18T21:36:19.368 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.368 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:19.369 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.369 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.369 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.369 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.370 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.370 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262910+0000" 2020-05-18T21:36:19.370 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.370 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.370 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:19.371 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:19.371 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:19.371 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:19.372 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:19.372 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:19.372 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:19.372 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:19.372 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.373 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:19.373 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:19.373 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:19.373 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:19.373 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:19.374 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:19.374 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.374 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:19.374 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:19.374 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:19.375 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.375 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.375 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.375 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.375 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.375 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.376 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.376 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.376 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.376 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.376 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.377 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.377 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.377 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.377 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.377 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:19.378 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:19.378 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:19.378 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.378 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:19.378 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.379 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.379 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.379 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.379 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.379 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.380 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.380 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.380 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.381 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:19.381 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:19.381 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:19.381 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:19.382 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:19.382 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:19.382 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:19.382 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:19.383 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:19.383 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.383 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.383 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:19.384 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.384 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:19.384 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:19.384 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:19.384 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:19.385 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:19.385 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.385 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray6", 2020-05-18T21:36:19.385 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x610", 2020-05-18T21:36:19.385 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:19.386 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:19.386 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:19.386 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:19.386 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:19.386 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:19.387 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:19.387 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.387 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.387 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:19.387 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:19.388 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.388 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.388 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.388 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.389 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.389 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.389 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.389 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.389 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.390 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.390 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.395 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.396 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.396 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.396 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.396 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:19.396 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:19.398 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:19.398 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.398 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.398 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.398 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1549, 2020-05-18T21:36:19.399 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:19.399 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:19.399 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:19.399 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:19.399 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:19.400 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:19.400 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:19.400 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:19.400 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:19.400 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:19.401 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:19.401 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:19.401 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.401 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:19.401 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:19.402 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:19.402 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:19.402 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:19.402 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:19.402 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.403 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:19.403 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:19.403 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:19.403 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:19.403 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:19.404 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:19.404 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:19.404 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:19.404 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:19.404 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:19.405 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:19.405 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:19.405 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:19.405 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.406 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:19.406 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:19.406 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:19.406 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:19.406 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.407 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:19.407 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.407 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.407 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.407 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.408 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.408 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262345+0000" 2020-05-18T21:36:19.408 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.408 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:19.408 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.409 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.409 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.409 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.409 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.409 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262345+0000" 2020-05-18T21:36:19.410 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.410 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.410 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:19.410 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:19.410 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:19.411 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:19.411 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:19.411 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:19.411 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:19.412 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:19.412 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.412 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:19.413 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:19.413 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:19.413 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:19.413 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:19.413 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:19.414 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.414 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:19.414 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:19.414 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:19.414 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.415 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.415 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.415 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.415 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.415 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.416 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.416 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.416 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.416 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.417 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.417 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.417 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.417 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.417 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.418 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:19.418 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:19.418 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:19.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.418 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:19.419 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.419 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.419 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.419 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.419 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.420 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.420 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.420 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.420 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:19.421 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:19.421 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:19.421 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:19.421 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:19.421 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:19.422 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:19.422 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:19.422 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:19.422 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.422 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.422 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:19.423 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.423 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:19.423 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:19.423 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:19.423 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:19.424 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:19.424 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.424 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray3", 2020-05-18T21:36:19.424 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60d", 2020-05-18T21:36:19.424 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:19.425 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:19.425 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:19.425 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:19.425 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:19.425 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:19.426 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:19.426 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.426 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.427 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:19.427 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:19.427 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.427 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.427 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.428 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.428 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.428 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.428 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.429 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.429 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.429 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.429 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.429 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.430 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.430 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.430 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.430 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:19.430 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:19.431 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:19.431 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:19.431 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.431 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:19.431 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:19.431 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:19.432 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.432 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.432 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1553, 2020-05-18T21:36:19.432 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:19.433 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:19.433 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:19.433 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:19.433 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:19.433 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:19.434 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:19.434 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:19.434 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:19.434 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:19.434 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:19.435 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:19.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.435 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:19.435 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:19.435 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:19.436 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:19.436 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:19.436 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:19.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.437 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:19.437 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:19.437 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:19.437 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:19.437 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:19.438 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:19.438 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:19.438 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:19.438 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:19.438 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:19.439 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:19.439 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:19.439 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:19.439 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.439 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:19.440 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:19.440 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:19.440 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:19.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.440 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:19.441 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.441 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.441 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.441 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.441 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.442 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263085+0000" 2020-05-18T21:36:19.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.442 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:19.442 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.442 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.443 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.443 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.443 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.443 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263085+0000" 2020-05-18T21:36:19.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.444 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.444 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:19.444 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:19.444 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:19.444 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:19.444 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:19.445 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:19.445 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:19.445 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:19.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.445 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:19.446 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:19.446 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:19.446 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:19.447 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:19.447 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:19.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.448 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:19.448 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:19.448 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:19.448 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.449 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.449 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.449 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.449 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.450 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.450 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.450 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.450 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.451 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.451 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.451 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.451 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.452 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:19.452 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:19.452 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:19.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.452 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:19.452 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.453 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.453 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.453 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.453 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.454 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.454 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.454 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.454 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:19.455 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:19.455 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:19.455 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:19.455 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:19.456 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:19.456 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:19.456 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:19.456 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:19.456 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.457 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.457 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:19.457 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.457 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:19.458 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:19.458 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:19.458 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:19.458 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:19.458 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.459 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray7", 2020-05-18T21:36:19.459 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x611", 2020-05-18T21:36:19.459 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:19.459 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:19.460 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:19.460 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:19.460 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:19.460 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:19.461 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:19.461 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.461 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.462 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:19.462 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:19.462 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.462 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.462 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.463 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.463 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.463 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.464 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.464 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.464 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.465 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.465 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.465 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.465 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.466 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.466 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:19.466 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:19.466 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:19.466 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:19.467 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.467 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:19.467 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:19.467 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:19.468 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.468 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.468 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.468 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1554, 2020-05-18T21:36:19.469 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:19.469 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:19.469 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:19.469 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:19.470 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:19.470 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:19.470 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:19.471 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:19.471 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:19.471 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:19.471 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:19.471 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:19.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.472 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:19.472 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:19.472 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:19.472 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:19.473 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:19.473 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:19.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.473 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:19.473 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:19.474 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:19.474 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:19.474 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:19.474 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:19.474 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:19.475 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:19.475 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:19.475 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:19.475 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:19.475 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:19.475 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:19.476 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.476 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:19.476 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:19.476 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:19.476 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:19.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.477 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:19.477 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.477 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.478 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.478 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.478 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.478 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263263+0000" 2020-05-18T21:36:19.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.479 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:19.479 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.479 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.479 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.480 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.480 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.480 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263263+0000" 2020-05-18T21:36:19.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.481 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.481 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:19.481 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:19.481 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:19.482 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:19.482 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:19.482 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:19.482 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:19.482 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:19.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.483 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:19.483 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:19.483 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:19.483 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:19.484 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:19.484 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:19.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.484 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:19.485 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:19.485 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:19.485 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.485 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.485 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.486 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.486 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.486 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.486 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.487 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.487 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.487 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.487 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.488 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.488 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.488 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:19.489 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:19.489 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:19.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.489 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:19.490 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.490 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.490 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.490 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.491 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.491 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.491 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.491 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.492 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:19.492 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:19.492 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:19.492 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:19.492 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:19.493 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:19.493 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:19.493 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:19.493 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:19.493 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.494 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.494 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:19.494 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.494 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:19.494 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:19.495 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:19.495 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:19.495 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:19.495 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.495 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray8", 2020-05-18T21:36:19.496 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x612", 2020-05-18T21:36:19.496 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:19.496 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:19.496 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:19.496 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:19.497 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:19.497 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:19.497 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:19.497 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.497 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.498 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:19.498 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:19.498 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.499 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.499 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.499 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.499 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.499 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.500 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.500 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.500 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.500 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.500 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.501 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.501 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.501 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.501 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.501 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.502 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:19.502 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:19.502 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:19.502 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:19.502 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.502 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:19.503 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:19.503 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:19.503 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.503 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.504 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1550, 2020-05-18T21:36:19.504 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:19.504 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:19.504 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:19.505 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:19.505 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:19.505 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:19.506 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:19.506 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:19.506 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:19.506 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:19.506 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:19.507 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:19.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.507 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:19.507 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:19.507 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:19.508 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:19.508 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:19.508 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:19.508 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.508 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:19.509 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:19.509 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:19.509 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:19.509 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:19.510 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:19.510 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:19.510 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:19.510 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:19.510 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:19.511 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:19.511 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:19.511 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:19.511 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.511 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:19.512 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:19.512 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:19.512 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:19.512 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.512 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:19.513 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.513 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.513 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.513 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.514 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.514 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262533+0000" 2020-05-18T21:36:19.514 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.514 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:19.514 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.515 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.515 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.515 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.515 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.515 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262533+0000" 2020-05-18T21:36:19.516 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.516 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.516 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:19.516 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:19.516 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:19.517 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:19.517 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:19.517 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:19.517 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:19.517 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:19.518 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.518 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:19.518 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:19.518 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:19.518 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:19.518 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:19.519 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:19.519 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.519 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:19.520 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:19.520 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:19.520 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.520 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.520 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.521 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.521 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.521 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.521 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.521 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.522 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.522 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.522 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.522 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.522 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.522 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.523 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.523 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:19.523 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:19.523 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:19.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.524 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:19.524 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.524 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.524 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.524 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.525 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.525 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.525 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.525 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.525 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.526 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:19.526 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:19.526 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:19.526 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:19.526 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:19.527 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:19.527 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:19.527 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:19.527 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:19.527 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.528 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.528 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:19.528 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.528 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:19.528 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:19.529 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:19.529 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:19.529 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:19.529 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.530 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray4", 2020-05-18T21:36:19.530 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60e", 2020-05-18T21:36:19.530 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:19.530 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:19.530 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:19.531 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:19.531 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:19.531 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:19.531 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:19.531 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.532 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.532 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:19.532 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:19.532 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.532 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.533 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.533 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.533 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.533 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.533 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.534 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.534 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.534 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.534 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.534 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.535 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.535 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.535 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.535 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.535 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:19.536 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:19.536 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:19.536 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:19.536 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.536 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:19.536 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:19.537 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:19.537 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.537 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.537 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.537 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1555, 2020-05-18T21:36:19.538 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:19.538 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:19.538 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:19.538 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:19.538 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:19.539 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:19.539 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:19.539 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:19.539 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:19.540 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:19.540 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:19.540 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:19.540 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.540 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:19.541 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:19.541 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:19.541 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:19.541 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:19.541 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:19.542 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.542 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:19.542 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:19.542 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:19.542 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:19.543 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:19.543 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:19.543 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:19.543 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:19.543 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:19.544 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:19.544 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:19.544 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:19.544 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:19.544 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.545 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:19.545 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:19.545 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:19.545 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:19.545 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.546 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:19.546 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.546 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.546 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.546 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.547 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.547 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:19.547 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.547 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:19.547 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.547 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.548 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.548 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.548 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.548 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:19.548 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.549 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.549 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:19.549 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:19.549 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:19.550 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:19.550 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:19.550 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:19.551 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:19.551 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:19.551 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.551 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:19.551 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:19.552 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:19.552 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:19.552 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:19.552 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:19.552 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.553 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:19.553 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:19.553 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:19.553 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.553 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.554 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.554 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.554 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.554 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.554 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.555 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.555 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.555 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.555 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.556 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.556 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.556 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.556 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.556 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:19.557 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:19.557 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:19.557 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.557 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:19.557 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.558 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.558 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.558 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.558 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.558 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.559 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.559 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.559 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.559 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:19.559 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:19.560 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:19.560 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:19.560 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:19.561 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:19.561 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:19.561 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:19.561 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:19.561 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.562 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.562 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:19.562 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.562 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:19.563 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:19.563 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:19.563 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:19.563 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:19.564 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.564 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray9", 2020-05-18T21:36:19.564 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x613", 2020-05-18T21:36:19.564 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:19.565 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:19.565 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:19.565 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:19.565 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:19.565 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:19.566 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:19.566 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.566 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.566 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:19.566 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:19.567 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.567 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.567 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.567 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.567 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.568 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.568 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.568 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.568 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.568 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.569 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.569 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.569 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.569 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.569 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.570 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.571 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:19.571 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:19.571 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:19.571 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:19.571 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.572 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:19.572 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:19.572 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:19.572 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.572 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.573 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.573 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 3, 2020-05-18T21:36:19.573 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:19.573 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:19.573 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:19.574 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16877, 2020-05-18T21:36:19.574 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:19.574 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:19.574 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:19.574 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:19.575 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:19.575 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:19.575 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:19.575 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:19.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.576 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:19.576 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:19.576 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:19.576 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:19.576 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:19.577 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:19.577 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.577 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:19.577 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:19.577 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:19.578 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:19.578 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:19.578 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:19.578 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:19.578 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:19.579 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:19.579 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:19.579 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:19.579 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:19.579 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:19.579 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.580 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:19.580 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:19.580 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:19.580 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:19.581 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.581 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:19.582 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.582 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.582 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.582 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.582 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.583 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:06.317019+0000" 2020-05-18T21:36:19.583 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.583 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:19.583 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.583 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.584 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.584 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:19.584 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.584 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:06.317019+0000" 2020-05-18T21:36:19.585 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.585 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.585 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:19.585 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:19.586 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:19.586 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:19.586 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:19.586 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:19.586 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:19.587 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:19.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.587 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:19.587 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:19.587 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:19.588 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:19.588 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:19.588 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:19.588 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.588 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:19.589 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:19.589 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:19.589 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.589 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.589 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.590 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.590 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.590 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.590 INFO:teuthology.orchestra.run.smithi155.stdout: -2, 2020-05-18T21:36:19.591 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.591 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.591 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.591 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.592 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.592 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.592 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.592 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.592 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:36:19.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.593 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:36:19.593 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.593 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.593 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.594 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.594 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.594 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.594 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.594 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.595 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.595 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:19.595 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:19.595 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:19.595 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:19.596 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:19.596 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:19.596 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:19.596 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:19.596 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:19.597 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.597 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:19.597 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.597 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:19.597 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:19.598 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:19.598 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:19.598 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:36:19.598 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.598 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.599 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 257, 2020-05-18T21:36:19.599 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:19.599 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:19.599 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:19.599 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:19.600 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:19.600 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:19.600 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:19.600 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:19.600 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:19.600 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:19.601 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:19.601 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:19.601 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.602 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:19.602 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:19.602 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:19.602 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:19.602 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:19.603 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:19.603 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.603 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:19.603 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:19.603 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:19.604 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:19.604 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:19.604 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:19.604 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:19.604 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:19.605 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:19.605 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:19.605 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:19.605 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:19.606 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:19.606 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.606 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:19.606 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:19.606 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 10, 2020-05-18T21:36:19.607 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:19.607 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.607 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:19.607 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.607 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.608 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.608 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:36:19.608 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.608 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:19.608 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.609 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:19.609 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:19.609 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:19.609 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:19.609 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:36:19.609 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:19.610 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:19.610 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.610 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.610 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:19.610 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:19.611 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:19.611 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:19.611 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:19.611 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:19.612 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:19.612 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:19.612 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.612 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:19.613 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:19.613 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:19.613 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:19.613 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:19.613 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:19.614 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.614 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:19.614 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:19.614 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:19.615 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.615 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.615 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.615 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.616 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.616 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.616 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.616 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.616 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.617 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.617 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.617 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.617 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.618 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:19.618 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:36:19.618 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.618 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:19.618 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.619 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.619 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.619 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.619 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.619 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.620 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.620 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.620 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.620 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:19.620 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:19.620 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:19.621 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:19.621 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:19.621 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:19.621 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:19.621 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:19.622 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:19.622 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.622 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:19.623 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.623 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:19.623 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:19.623 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:19.623 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:19.624 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:19.624 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.624 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1", 2020-05-18T21:36:19.624 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x101", 2020-05-18T21:36:19.624 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:19.625 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:19.625 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:19.625 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "0", 2020-05-18T21:36:19.625 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "0", 2020-05-18T21:36:19.625 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:19.626 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "1", 2020-05-18T21:36:19.626 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.626 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:19.626 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:19.626 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:19.627 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.627 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.627 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.627 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.627 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.627 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.628 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.628 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.628 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.628 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.628 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.629 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.629 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.629 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.629 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.629 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.630 INFO:teuthology.orchestra.run.smithi155.stdout: "child": 1, 2020-05-18T21:36:19.630 INFO:teuthology.orchestra.run.smithi155.stdout: "subtree": 1, 2020-05-18T21:36:19.630 INFO:teuthology.orchestra.run.smithi155.stdout: "subtreetemp": 0, 2020-05-18T21:36:19.630 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:19.630 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:19.631 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:19.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.631 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:19.631 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [ 2020-05-18T21:36:19.631 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.632 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray6", 2020-05-18T21:36:19.632 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:19.632 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:19.632 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:19.633 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:19.633 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:19.633 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:19.633 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:19.633 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1552, 2020-05-18T21:36:19.634 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:19.634 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.634 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:19.634 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.634 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.635 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.635 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.635 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.635 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.635 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.636 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.636 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.636 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.636 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.637 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.637 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.637 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.637 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.637 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:19.638 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.638 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:19.638 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:19.638 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.638 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.639 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.639 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.639 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.639 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.639 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.640 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.640 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.640 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:19.640 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.641 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.641 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray7", 2020-05-18T21:36:19.641 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:19.641 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:19.642 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:19.642 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:19.642 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:19.642 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:19.643 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:19.643 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1553, 2020-05-18T21:36:19.643 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:19.643 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.643 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:19.644 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.644 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.644 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.644 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.645 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.645 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.645 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.645 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.645 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.646 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.646 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.646 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.646 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.646 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.647 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.647 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:19.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.647 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:19.647 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:19.648 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.648 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.648 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.648 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.648 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.649 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.649 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.649 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.649 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.649 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.650 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:19.650 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.650 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.650 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray0", 2020-05-18T21:36:19.651 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:19.651 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:19.651 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:19.651 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:19.652 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:19.652 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:19.652 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:19.652 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1546, 2020-05-18T21:36:19.652 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:19.653 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.653 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:19.653 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.653 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.654 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.654 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.654 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.654 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.654 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.655 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.655 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.655 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.655 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.656 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.656 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.656 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.656 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.656 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.657 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:19.657 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.657 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:19.657 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:19.658 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.658 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.658 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.658 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.659 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.659 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.659 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.659 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.659 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.660 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.660 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:19.660 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.660 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.660 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.661 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray9", 2020-05-18T21:36:19.661 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:19.661 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:19.661 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:19.662 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:19.662 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:19.667 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:19.667 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:19.668 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1555, 2020-05-18T21:36:19.668 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:19.669 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.669 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:19.669 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.670 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.670 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.670 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.670 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.671 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.671 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.671 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.671 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.671 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.672 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.672 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.672 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.672 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.672 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.672 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:19.673 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.673 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:19.673 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:19.673 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.673 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.674 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.674 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.674 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.674 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.674 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.675 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.675 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.675 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.675 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:19.675 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.675 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.676 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.676 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray5", 2020-05-18T21:36:19.676 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:19.676 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:19.676 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:19.677 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:19.677 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:19.677 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:19.677 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:19.677 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1551, 2020-05-18T21:36:19.677 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:19.678 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.678 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:19.678 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.678 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.678 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.679 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.679 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.679 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.679 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.679 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.680 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.680 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.680 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.680 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.680 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.680 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.681 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.681 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.681 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:19.681 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.681 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:19.682 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:19.682 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.682 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.682 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.683 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.683 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.683 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.684 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.684 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.684 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.684 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:19.685 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.685 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.685 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.685 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray2", 2020-05-18T21:36:19.685 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:19.686 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:19.686 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:19.686 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:19.686 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:19.686 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:19.687 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:19.687 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1548, 2020-05-18T21:36:19.687 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:19.687 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.687 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:19.687 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.688 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.688 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.688 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.688 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.688 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.689 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.689 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.689 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.689 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.689 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.690 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.690 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.690 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.690 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.690 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:19.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.691 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:19.691 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:19.691 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.691 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.691 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.692 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.692 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.692 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.692 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.692 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.693 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.693 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:19.693 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.693 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.694 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray1", 2020-05-18T21:36:19.694 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:19.694 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:19.694 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:19.694 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:19.695 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:19.695 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:19.695 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:19.695 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1547, 2020-05-18T21:36:19.695 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:19.695 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.696 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:19.696 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.696 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.696 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.696 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.697 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.697 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.697 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.697 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.697 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.698 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.698 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.699 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.699 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.699 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.699 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.699 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:19.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.700 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:19.700 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:19.700 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.700 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.701 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.701 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.701 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.701 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.701 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.702 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.702 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.702 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:19.702 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.703 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.703 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray8", 2020-05-18T21:36:19.703 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:19.703 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:19.703 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:19.703 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:19.704 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:19.704 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:19.704 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:19.704 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1554, 2020-05-18T21:36:19.704 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:19.705 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.705 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:19.705 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.705 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.705 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.705 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.706 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.706 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.706 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.706 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.706 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.707 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.707 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.707 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.707 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.707 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.708 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.708 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.708 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:19.708 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.708 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:19.709 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:19.709 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.709 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.710 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.710 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.710 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.710 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.710 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.711 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.711 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.711 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.711 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:19.711 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.711 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.712 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.712 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray3", 2020-05-18T21:36:19.712 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:19.712 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:19.712 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:19.713 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:19.713 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:19.713 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:19.713 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:19.713 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1549, 2020-05-18T21:36:19.713 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:19.714 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.714 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:19.714 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.714 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.715 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.715 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.715 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.715 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.715 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.715 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.716 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.716 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.716 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.716 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.716 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.717 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.717 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.717 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.717 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:19.718 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.718 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:19.718 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:19.718 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.719 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.719 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.719 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.719 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.719 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.720 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.720 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.720 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.720 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:19.721 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.721 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.721 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:19.721 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray4", 2020-05-18T21:36:19.721 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:19.721 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:19.722 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:19.722 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:19.722 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:19.722 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:19.722 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:19.723 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1550, 2020-05-18T21:36:19.723 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:19.723 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:19.723 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:19.723 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.723 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:19.724 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:19.724 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:19.724 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.724 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:19.724 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:19.725 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:19.725 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:19.725 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:19.725 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:19.725 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.725 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:19.727 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:19.727 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:19.727 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:19.728 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:19.728 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.728 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:19.728 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:19.728 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:19.729 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:19.729 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:19.729 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:19.729 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:19.729 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:19.730 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:19.730 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:19.730 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:19.730 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:19.730 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:19.731 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.731 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:19.731 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.731 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:19.731 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:19.731 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:19.732 INFO:teuthology.orchestra.run.smithi155.stdout:] 2020-05-18T21:36:19.733 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "ino": 1, "rdev": 0, "ctime": "2020-05-18T21:36:12.141787+0000", "btime": "2020-05-18T21:35:50.165450+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 26, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:12.141787+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:36:12.141787+0000", "num_files": 0, "num_subdirs": 1, "change_attr": 1 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:57.723581+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:50.165450+0000" }, "version": 4, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 3, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "dirfrag": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1546, "rdev": 0, "ctime": "2020-05-18T21:35:58.261727+0000", "btime": "2020-05-18T21:35:58.261727+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261727+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261727+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261727+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray0", "dirfrag": "0x60a", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1547, "rdev": 0, "ctime": "2020-05-18T21:35:58.261988+0000", "btime": "2020-05-18T21:35:58.261988+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261988+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261988+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261988+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray1", "dirfrag": "0x60b", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1548, "rdev": 0, "ctime": "2020-05-18T21:35:58.262165+0000", "btime": "2020-05-18T21:35:58.262165+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262165+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262165+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262165+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray2", "dirfrag": "0x60c", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1551, "rdev": 0, "ctime": "2020-05-18T21:35:58.262725+0000", "btime": "2020-05-18T21:35:58.262725+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262725+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262725+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262725+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray5", "dirfrag": "0x60f", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1552, "rdev": 0, "ctime": "2020-05-18T21:35:58.262910+0000", "btime": "2020-05-18T21:35:58.262910+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262910+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262910+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262910+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray6", "dirfrag": "0x610", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1549, "rdev": 0, "ctime": "2020-05-18T21:35:58.262345+0000", "btime": "2020-05-18T21:35:58.262345+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262345+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262345+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262345+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray3", "dirfrag": "0x60d", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1553, "rdev": 0, "ctime": "2020-05-18T21:35:58.263085+0000", "btime": "2020-05-18T21:35:58.263085+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263085+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263085+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263085+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray7", "dirfrag": "0x611", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1554, "rdev": 0, "ctime": "2020-05-18T21:35:58.263263+0000", "btime": "2020-05-18T21:35:58.263263+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263263+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263263+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263263+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray8", "dirfrag": "0x612", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1550, "rdev": 0, "ctime": "2020-05-18T21:35:58.262533+0000", "btime": "2020-05-18T21:35:58.262533+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262533+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262533+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262533+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray4", "dirfrag": "0x60e", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1555, "rdev": 0, "ctime": "2020-05-18T21:35:58.263460+0000", "btime": "2020-05-18T21:35:58.263460+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263460+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray9", "dirfrag": "0x613", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 3, "rdev": 0, "ctime": "2020-05-18T21:36:06.317019+0000", "btime": "2020-05-18T21:36:06.317019+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:06.317019+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:36:06.317019+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:36:06.317019+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ -2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "openingsnapparents": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 257, "rdev": 0, "ctime": "2020-05-18T21:35:58.261635+0000", "btime": "2020-05-18T21:35:58.261635+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261635+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 10, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "openingsnapparents": 0 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "subtreetemp": 0, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 3, "dentries": [ { "path": "stray6", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1552, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray7", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1553, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray0", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1546, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray9", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1555, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray5", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1551, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray2", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1548, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray1", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1547, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray8", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1554, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray3", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1549, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray4", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1550, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] } ] } ] } ] 2020-05-18T21:36:20.736 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok dump cache 2020-05-18T21:36:20.846 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2020-05-18T21:36:20.846 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:20.846 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1, 2020-05-18T21:36:20.847 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:20.847 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:20.847 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:50.165450+0000", 2020-05-18T21:36:20.847 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 17407, 2020-05-18T21:36:20.847 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:20.848 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:20.848 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:20.848 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:20.848 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:20.848 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:20.849 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:20.849 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:20.849 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.849 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:20.849 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:36:20.850 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:36:20.850 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:36:20.850 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 26, 2020-05-18T21:36:20.850 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:20.850 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.851 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:20.851 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:20.851 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:20.851 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:20.852 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:20.852 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:20.852 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:20.852 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:20.853 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:20.853 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:36:20.853 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:20.853 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:20.854 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:20.854 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:20.854 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:20.855 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:20.855 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 1, 2020-05-18T21:36:20.855 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1 2020-05-18T21:36:20.855 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.855 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:20.856 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:20.856 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:20.856 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:20.856 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:20.856 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:20.857 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:57.723581+0000" 2020-05-18T21:36:20.857 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.857 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:20.857 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:20.857 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:20.858 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:20.858 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:20.858 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:20.858 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:50.165450+0000" 2020-05-18T21:36:20.858 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.859 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 4, 2020-05-18T21:36:20.859 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:20.859 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:20.859 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 3, 2020-05-18T21:36:20.859 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:20.860 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:20.860 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:20.860 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:20.860 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:20.860 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.860 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:20.861 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:20.861 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:20.861 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:20.861 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:20.861 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:20.862 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.862 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:20.862 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:20.863 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:20.863 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:36:20.863 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:20.863 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:20.863 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.864 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:20.866 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:20.866 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:36:20.866 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:20.866 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:20.866 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:36:20.867 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.867 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:20.867 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:20.867 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:20.867 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:20.868 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": 0, 2020-05-18T21:36:20.868 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 0 2020-05-18T21:36:20.868 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.868 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:36:20.868 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:20.868 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:20.869 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:20.869 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:20.869 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:20.869 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:20.869 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:20.870 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:20.870 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.870 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:20.870 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:20.870 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:20.870 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:20.871 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:20.871 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:20.871 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:36:20.871 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:20.871 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:36:20.872 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:20.872 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:20.872 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:20.872 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:20.872 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:20.873 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.873 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:20.873 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:20.873 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [], 2020-05-18T21:36:20.873 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:20.873 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:20.874 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:20.874 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:20.874 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:36:20.874 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.874 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:20.875 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1546, 2020-05-18T21:36:20.875 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:20.875 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:20.875 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:20.875 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:20.875 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:20.876 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:20.876 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:20.876 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:20.876 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:20.876 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:20.877 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:20.877 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:20.877 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.877 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:20.877 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:20.878 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:20.878 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:20.878 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:20.878 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:20.878 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.879 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:20.879 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:20.879 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:20.879 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:20.879 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:20.879 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:20.880 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:20.880 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:20.880 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:20.880 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:20.880 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:20.881 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:20.881 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:20.881 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:20.881 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:20.881 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:20.881 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:20.882 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:20.882 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.882 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:20.882 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:20.882 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:20.883 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:20.883 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:20.883 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:20.883 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261727+0000" 2020-05-18T21:36:20.883 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.884 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:20.884 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:20.884 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:20.884 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:20.885 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:20.885 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:20.885 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261727+0000" 2020-05-18T21:36:20.885 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.885 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:20.886 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:20.886 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:20.886 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:20.886 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:20.887 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:20.887 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:20.887 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:20.887 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:20.887 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.888 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:20.888 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:20.888 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:20.888 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:20.888 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:20.888 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:20.889 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.889 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:20.889 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:20.889 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:20.889 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:20.890 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:20.890 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:20.890 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.890 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:20.891 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:20.891 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:20.891 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:20.891 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:20.892 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:20.892 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.892 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:20.892 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:20.892 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:20.893 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:20.893 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:20.893 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:20.893 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:20.893 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.893 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:20.894 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:20.894 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:20.894 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:20.894 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:20.894 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:20.895 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:20.895 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:20.895 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:20.895 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.895 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:20.896 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:20.896 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:20.896 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:20.896 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:20.896 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:20.896 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:20.897 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:20.897 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:20.897 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:20.897 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:20.897 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:20.898 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:20.898 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:20.898 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:20.898 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:20.898 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:20.898 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:20.899 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:20.899 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray0", 2020-05-18T21:36:20.899 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60a", 2020-05-18T21:36:20.899 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:20.899 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:20.900 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:20.900 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:20.900 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:20.900 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:20.900 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:20.900 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:20.901 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:20.901 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:20.901 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:20.901 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:20.901 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:20.902 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:20.902 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:20.902 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.902 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:20.902 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:20.903 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:20.903 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:20.903 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:20.903 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:20.903 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.903 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:20.904 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:20.904 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:20.904 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:20.904 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:20.904 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:20.905 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:20.905 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:20.905 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.905 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:20.905 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:20.905 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:20.906 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:20.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.906 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:20.906 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1547, 2020-05-18T21:36:20.906 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:20.907 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:20.907 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:20.907 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:20.907 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:20.907 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:20.907 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:20.908 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:20.908 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:20.908 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:20.908 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:20.908 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:20.909 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.909 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:20.909 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:20.909 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:20.909 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:20.910 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:20.910 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:20.910 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.910 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:20.910 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:20.910 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:20.911 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:20.911 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:20.911 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:20.911 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:20.911 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:20.912 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:20.912 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:20.912 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:20.912 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:20.912 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:20.912 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:20.913 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:20.913 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:20.913 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:20.913 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:20.913 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.914 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:20.914 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:20.914 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:20.914 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:20.914 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:20.914 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:20.915 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261988+0000" 2020-05-18T21:36:20.915 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.915 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:20.915 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:20.915 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:20.916 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:20.916 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:20.916 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:20.916 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261988+0000" 2020-05-18T21:36:20.916 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.916 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:20.917 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:20.917 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:20.917 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:20.917 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:20.917 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:20.918 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:20.918 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:20.918 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:20.918 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.918 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:20.919 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:20.919 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:20.919 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:20.919 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:20.919 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:20.919 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.920 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:20.920 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:20.920 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:20.920 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:20.920 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:20.921 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:20.921 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.921 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:20.921 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:20.921 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:20.921 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:20.922 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:20.922 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:20.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.922 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:20.922 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:20.923 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:20.923 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:20.923 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:20.923 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:20.923 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:20.923 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.924 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:20.924 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:20.924 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:20.924 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:20.924 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:20.925 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:20.925 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:20.925 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:20.925 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:20.925 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.926 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:20.926 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:20.926 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:20.926 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:20.926 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:20.927 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:20.927 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:20.927 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:20.927 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:20.928 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:20.928 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:20.928 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:20.928 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:20.929 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:20.929 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:20.929 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:20.929 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:20.930 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:20.930 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:20.930 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray1", 2020-05-18T21:36:20.930 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60b", 2020-05-18T21:36:20.931 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:20.931 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:20.931 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:20.932 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:20.932 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:20.932 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:20.933 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:20.933 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:20.933 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:20.934 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:20.934 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:20.934 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:20.935 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:20.935 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:20.935 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:20.935 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.936 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:20.936 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:20.936 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:20.937 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:20.937 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:20.937 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:20.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.938 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:20.938 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:20.938 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:20.939 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:20.939 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:20.939 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:20.939 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:20.939 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:20.939 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.940 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:20.940 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:20.940 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:20.940 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:20.940 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.941 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:20.941 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1548, 2020-05-18T21:36:20.941 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:20.941 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:20.941 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:20.942 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:20.942 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:20.942 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:20.942 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:20.942 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:20.943 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:20.943 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:20.943 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:20.943 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:20.943 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.943 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:20.944 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:20.944 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:20.944 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:20.944 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:20.944 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:20.945 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.945 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:20.945 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:20.945 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:20.945 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:20.946 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:20.946 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:20.946 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:20.946 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:20.947 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:20.947 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:20.947 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:20.947 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:20.947 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:20.948 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:20.948 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:20.948 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:20.948 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:20.948 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:20.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.949 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:20.949 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:20.949 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:20.949 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:20.949 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:20.950 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:20.950 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262165+0000" 2020-05-18T21:36:20.950 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.950 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:20.950 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:20.951 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:20.951 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:20.951 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:20.951 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:20.951 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262165+0000" 2020-05-18T21:36:20.951 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.952 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:20.952 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:20.952 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:20.952 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:20.952 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:20.953 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:20.953 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:20.953 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:20.953 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:20.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.954 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:20.954 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:20.954 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:20.954 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:20.954 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:20.954 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:20.955 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.955 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:20.955 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:20.955 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:20.955 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:20.956 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:20.956 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:20.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.956 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:20.956 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:20.956 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:20.957 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:20.957 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:20.957 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:20.957 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.957 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:20.958 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:20.958 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:20.958 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:20.958 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:20.958 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:20.959 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:20.959 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.959 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:20.959 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:20.959 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:20.959 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:20.960 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:20.960 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:20.960 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:20.960 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:20.960 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:20.961 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.961 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:20.961 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:20.961 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:20.961 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:20.961 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:20.962 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:20.962 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:20.962 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:20.962 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:20.962 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:20.963 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:20.963 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:20.963 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:20.963 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:20.963 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:20.963 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:20.964 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:20.964 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:20.964 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:20.964 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray2", 2020-05-18T21:36:20.964 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60c", 2020-05-18T21:36:20.965 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:20.965 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:20.965 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:20.965 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:20.965 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:20.965 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:20.966 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:20.966 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:20.966 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:20.966 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:20.966 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:20.967 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:20.967 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:20.967 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:20.967 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:20.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.967 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:20.968 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:20.968 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:20.968 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:20.968 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:20.968 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:20.969 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.969 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:20.969 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:20.969 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:20.969 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:20.969 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:20.970 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:20.970 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:20.970 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:20.970 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.970 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:20.971 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:20.971 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:20.971 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:20.971 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.971 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:20.972 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1551, 2020-05-18T21:36:20.972 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:20.972 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:20.972 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:20.972 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:20.972 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:20.973 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:20.973 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:20.973 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:20.973 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:20.973 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:20.974 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:20.974 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:20.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.974 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:20.974 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:20.975 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:20.975 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:20.975 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:20.975 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:20.975 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.975 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:20.976 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:20.976 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:20.976 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:20.976 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:20.976 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:20.977 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:20.977 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:20.977 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:20.977 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:20.977 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:20.977 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:20.978 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:20.978 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:20.978 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:20.978 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:20.978 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:20.979 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:20.979 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.979 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:20.979 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:20.979 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:20.979 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:20.980 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:20.980 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:20.980 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262725+0000" 2020-05-18T21:36:20.980 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.980 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:20.981 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:20.981 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:20.981 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:20.981 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:20.981 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:20.982 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262725+0000" 2020-05-18T21:36:20.982 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.982 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:20.982 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:20.983 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:20.983 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:20.983 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:20.983 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:20.984 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:20.984 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:20.984 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:20.984 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.985 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:20.985 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:20.985 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:20.985 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:20.986 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:20.986 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:20.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.986 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:20.986 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:20.987 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:20.987 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:20.987 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:20.987 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:20.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.988 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:20.988 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:20.988 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:20.988 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:20.989 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:20.989 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:20.989 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.989 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:20.989 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:20.990 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:20.990 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:20.990 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:20.990 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:20.990 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:20.991 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.991 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:20.991 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:20.991 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:20.992 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:20.992 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:20.992 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:20.992 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:20.992 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:20.993 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:20.993 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:20.993 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:20.993 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:20.993 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:20.994 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:20.994 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:20.994 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:20.994 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:20.994 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:20.994 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:20.995 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:20.995 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:20.995 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:20.995 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:20.995 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray5", 2020-05-18T21:36:20.997 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60f", 2020-05-18T21:36:20.997 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:20.997 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:20.997 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:20.997 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:20.998 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:20.998 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:20.998 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:20.998 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:20.998 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:20.999 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:20.999 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:20.999 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:20.999 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:20.999 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:20.999 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.000 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.000 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.000 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.000 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.000 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.001 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.001 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.001 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.001 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.001 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.002 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.002 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:21.002 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:21.002 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:21.002 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:21.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.003 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:21.003 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:21.003 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:21.003 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:21.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.004 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1552, 2020-05-18T21:36:21.004 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:21.004 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:21.004 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:21.005 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:21.005 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:21.005 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:21.005 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:21.005 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:21.006 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:21.006 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:21.006 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:21.006 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:21.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.006 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:21.007 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:21.007 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:21.007 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:21.007 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:21.007 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:21.008 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.008 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:21.008 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:21.008 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:21.008 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:21.008 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:21.009 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:21.009 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:21.009 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:21.009 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:21.009 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:21.010 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:21.010 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:21.010 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:21.010 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.010 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:21.010 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:21.011 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:21.011 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:21.011 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.011 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:21.011 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.012 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:21.012 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:21.012 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:21.012 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:21.012 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262910+0000" 2020-05-18T21:36:21.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.013 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:21.013 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.013 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:21.013 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:21.013 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:21.014 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:21.014 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262910+0000" 2020-05-18T21:36:21.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.014 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:21.014 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:21.014 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:21.015 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:21.015 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:21.015 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:21.015 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:21.015 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:21.016 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:21.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.016 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:21.016 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:21.016 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:21.016 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:21.017 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:21.017 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:21.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.017 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:21.017 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:21.018 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:21.018 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.018 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.018 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.018 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.019 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.019 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.019 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.019 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.019 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.020 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.020 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.020 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.020 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.020 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:21.021 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:21.021 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:21.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.021 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:21.021 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:21.022 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:21.022 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:21.022 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:21.022 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:21.022 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:21.023 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:21.023 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:21.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.023 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:21.023 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:21.023 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:21.024 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:21.024 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:21.024 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:21.024 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:21.024 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:21.024 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:21.025 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.025 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:21.025 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:21.025 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.025 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:21.026 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:21.026 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:21.026 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:21.026 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:21.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.027 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray6", 2020-05-18T21:36:21.027 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x610", 2020-05-18T21:36:21.027 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:21.027 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:21.027 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:21.027 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:21.028 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:21.028 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:21.028 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:21.028 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.028 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:21.029 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:21.029 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:21.029 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.029 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.029 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.029 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.030 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.030 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.030 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.030 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.031 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.031 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.031 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.031 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.032 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.032 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.032 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:21.032 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:21.032 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:21.032 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:21.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.033 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:21.033 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:21.033 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:21.033 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:21.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.034 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.034 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1549, 2020-05-18T21:36:21.034 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:21.034 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:21.035 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:21.035 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:21.035 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:21.035 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:21.035 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:21.036 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:21.036 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:21.036 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:21.036 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:21.036 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:21.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.037 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:21.037 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:21.037 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:21.037 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:21.037 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:21.038 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:21.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.038 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:21.038 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:21.038 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:21.039 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:21.039 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:21.039 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:21.039 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:21.039 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:21.039 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:21.040 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:21.040 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:21.040 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:21.040 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:21.040 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.041 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:21.041 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:21.041 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:21.041 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:21.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.042 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:21.042 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.042 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:21.042 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:21.042 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:21.043 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:21.043 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262345+0000" 2020-05-18T21:36:21.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.043 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:21.043 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.044 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:21.044 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:21.044 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:21.044 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:21.044 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262345+0000" 2020-05-18T21:36:21.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.045 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:21.045 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:21.045 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:21.045 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:21.045 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:21.046 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:21.046 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:21.046 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:21.046 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:21.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.047 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:21.047 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:21.047 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:21.048 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:21.048 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:21.048 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:21.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.048 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:21.048 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:21.049 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:21.049 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.049 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.049 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.050 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.050 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.050 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.050 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.050 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.051 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.051 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.051 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.051 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.052 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.052 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:21.052 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:21.052 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:21.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.053 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:21.053 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:21.053 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:21.053 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:21.053 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:21.054 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:21.054 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:21.054 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:21.054 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:21.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.055 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:21.055 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:21.055 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:21.055 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:21.055 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:21.055 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:21.056 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:21.056 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:21.056 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:21.056 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.056 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:21.057 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:21.057 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.057 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:21.057 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:21.057 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:21.058 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:21.058 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:21.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.058 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray3", 2020-05-18T21:36:21.058 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60d", 2020-05-18T21:36:21.058 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:21.059 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:21.059 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:21.059 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:21.059 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:21.059 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:21.060 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:21.060 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.060 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:21.060 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:21.060 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:21.060 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.061 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.061 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.061 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.061 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.062 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.062 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.062 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.062 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.062 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.063 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.063 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.063 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.063 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.063 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:21.064 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:21.064 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:21.064 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:21.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.064 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:21.065 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:21.065 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:21.065 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:21.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.065 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.065 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1553, 2020-05-18T21:36:21.066 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:21.066 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:21.066 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:21.066 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:21.066 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:21.067 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:21.067 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:21.067 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:21.067 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:21.067 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:21.067 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:21.068 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:21.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.068 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:21.068 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:21.068 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:21.069 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:21.069 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:21.069 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:21.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.069 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:21.070 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:21.070 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:21.070 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:21.070 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:21.070 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:21.070 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:21.071 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:21.071 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:21.071 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:21.071 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:21.071 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:21.072 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:21.072 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.072 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:21.072 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:21.072 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:21.072 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:21.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.073 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:21.073 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.073 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:21.073 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:21.074 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:21.074 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:21.074 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263085+0000" 2020-05-18T21:36:21.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.074 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:21.075 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.075 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:21.075 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:21.075 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:21.075 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:21.075 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263085+0000" 2020-05-18T21:36:21.076 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.076 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:21.076 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:21.076 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:21.076 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:21.077 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:21.077 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:21.077 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:21.077 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:21.077 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:21.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.078 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:21.078 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:21.078 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:21.078 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:21.078 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:21.079 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:21.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.079 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:21.079 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:21.079 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:21.079 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.080 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.080 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.080 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.080 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.081 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.081 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.081 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.081 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.081 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.082 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.082 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.082 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.082 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:21.082 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:21.083 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:21.083 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.083 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:21.083 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:21.083 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:21.083 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:21.084 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:21.084 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:21.084 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:21.084 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:21.084 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:21.085 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.085 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:21.085 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:21.086 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:21.086 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:21.086 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:21.086 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:21.086 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:21.087 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:21.087 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:21.087 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.087 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:21.087 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:21.088 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.088 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:21.088 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:21.088 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:21.089 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:21.089 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:21.089 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.089 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray7", 2020-05-18T21:36:21.089 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x611", 2020-05-18T21:36:21.090 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:21.090 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:21.090 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:21.090 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:21.090 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:21.091 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:21.091 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:21.091 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.091 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:21.091 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:21.091 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:21.092 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.092 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.092 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.093 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.093 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.093 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.093 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.093 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.094 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.094 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.094 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.094 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.094 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.095 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.095 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.095 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:21.095 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:21.095 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:21.096 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:21.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.096 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:21.096 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:21.096 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:21.096 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:21.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.097 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.097 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1554, 2020-05-18T21:36:21.097 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:21.097 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:21.103 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:21.104 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:21.104 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:21.104 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:21.104 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:21.104 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:21.105 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:21.105 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:21.105 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:21.105 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:21.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.106 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:21.106 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:21.106 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:21.106 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:21.106 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:21.107 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:21.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.107 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:21.107 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:21.107 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:21.107 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:21.108 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:21.108 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:21.108 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:21.108 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:21.108 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:21.109 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:21.109 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:21.109 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:21.109 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:21.109 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.109 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:21.110 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:21.110 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:21.110 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:21.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.110 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:21.111 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.111 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:21.111 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:21.111 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:21.111 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:21.111 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263263+0000" 2020-05-18T21:36:21.112 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.112 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:21.112 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.112 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:21.112 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:21.113 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:21.113 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:21.113 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263263+0000" 2020-05-18T21:36:21.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.114 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:21.114 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:21.114 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:21.114 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:21.115 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:21.115 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:21.115 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:21.115 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:21.116 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:21.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.116 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:21.116 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:21.116 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:21.116 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:21.117 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:21.117 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:21.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.117 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:21.117 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:21.118 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:21.118 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.118 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.118 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.118 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.118 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.119 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.119 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.119 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.119 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.119 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.120 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.120 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.120 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.120 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.120 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:21.121 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:21.121 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:21.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.121 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:21.121 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:21.122 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:21.122 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:21.122 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:21.122 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:21.122 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:21.122 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:21.123 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:21.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.123 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:21.123 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:21.123 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:21.124 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:21.124 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:21.124 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:21.124 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:21.124 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:21.124 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:21.125 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.125 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:21.125 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:21.125 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.125 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:21.126 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:21.126 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:21.126 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:21.126 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:21.126 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.127 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray8", 2020-05-18T21:36:21.127 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x612", 2020-05-18T21:36:21.127 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:21.127 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:21.128 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:21.128 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:21.128 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:21.128 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:21.128 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:21.129 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.129 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:21.129 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:21.129 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:21.129 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.129 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.130 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.130 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.130 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.130 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.130 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.131 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.131 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.131 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.131 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.131 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.132 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.132 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.132 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.132 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:21.132 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:21.133 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:21.133 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:21.133 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.133 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:21.133 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:21.133 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:21.134 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:21.134 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.134 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.134 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1550, 2020-05-18T21:36:21.134 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:21.135 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:21.135 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:21.135 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:21.135 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:21.135 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:21.135 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:21.136 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:21.136 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:21.136 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:21.136 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:21.136 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:21.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.137 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:21.137 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:21.137 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:21.137 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:21.137 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:21.138 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:21.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.138 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:21.138 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:21.138 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:21.139 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:21.139 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:21.139 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:21.139 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:21.139 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:21.139 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:21.140 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:21.140 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:21.140 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:21.140 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:21.140 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.141 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:21.141 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:21.141 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:21.141 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:21.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.141 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:21.142 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.142 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:21.142 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:21.142 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:21.142 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:21.143 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262533+0000" 2020-05-18T21:36:21.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.143 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:21.143 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.143 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:21.143 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:21.144 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:21.144 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:21.144 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262533+0000" 2020-05-18T21:36:21.144 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.144 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:21.145 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:21.145 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:21.145 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:21.145 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:21.145 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:21.145 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:21.146 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:21.146 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:21.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.146 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:21.146 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:21.147 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:21.147 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:21.147 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:21.147 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:21.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.148 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:21.148 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:21.148 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:21.148 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.149 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.149 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.149 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.149 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.150 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.150 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.150 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.150 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.150 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.150 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.151 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.151 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.151 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.151 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:21.151 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:21.151 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:21.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.152 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:21.152 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:21.152 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:21.152 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:21.153 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:21.153 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:21.153 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:21.153 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:21.153 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:21.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.154 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:21.154 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:21.154 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:21.154 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:21.154 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:21.155 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:21.155 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:21.155 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:21.155 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:21.155 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.156 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:21.156 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:21.156 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.156 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:21.156 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:21.156 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:21.157 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:21.157 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:21.157 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.157 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray4", 2020-05-18T21:36:21.157 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60e", 2020-05-18T21:36:21.158 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:21.158 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:21.158 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:21.158 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:21.158 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:21.158 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:21.159 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:21.159 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.159 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:21.159 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:21.159 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:21.160 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.160 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.160 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.160 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.160 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.161 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.161 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.161 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.161 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.161 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.162 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.162 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.162 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.162 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.162 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.162 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:21.163 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:21.163 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:21.163 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:21.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.163 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:21.164 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:21.164 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:21.164 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:21.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.164 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.164 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1555, 2020-05-18T21:36:21.165 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:21.165 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:21.165 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:21.165 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:21.165 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:21.166 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:21.166 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:21.166 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:21.166 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:21.166 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:21.166 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:21.167 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:21.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.167 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:21.167 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:21.167 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:21.168 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:21.168 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:21.168 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:21.168 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.168 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:21.168 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:21.169 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:21.169 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:21.169 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:21.169 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:21.169 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:21.170 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:21.170 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:21.170 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:21.170 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:21.170 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:21.170 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:21.171 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.171 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:21.171 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:21.171 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:21.171 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:21.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.172 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:21.172 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.172 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:21.172 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:21.172 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:21.173 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:21.173 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:21.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.173 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:21.173 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.174 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:21.174 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:21.174 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:21.174 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:21.174 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:21.174 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.175 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:21.175 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:21.175 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:21.175 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:21.175 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:21.176 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:21.176 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:21.176 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:21.176 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:21.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.176 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:21.177 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:21.177 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:21.177 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:21.177 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:21.177 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:21.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.178 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:21.178 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:21.178 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:21.178 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.178 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.179 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.179 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.179 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.179 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.179 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.180 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.180 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.180 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.180 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.180 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.181 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.181 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.181 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:21.181 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:21.181 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:21.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.182 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:21.182 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:21.182 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:21.182 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:21.182 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:21.183 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:21.183 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:21.183 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:21.183 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:21.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.184 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:21.184 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:21.184 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:21.184 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:21.184 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:21.184 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:21.185 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:21.185 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:21.185 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:21.185 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.185 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:21.186 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:21.186 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.186 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:21.186 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:21.186 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:21.186 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:21.187 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:21.187 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.187 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray9", 2020-05-18T21:36:21.187 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x613", 2020-05-18T21:36:21.187 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:21.188 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:21.188 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:21.188 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:21.188 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:21.188 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:21.188 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:21.189 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.189 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:21.189 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:21.189 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:21.189 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.190 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.190 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.190 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.190 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.190 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.191 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.191 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.191 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.191 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.191 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.192 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.192 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.192 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.192 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.192 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:21.192 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:21.193 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:21.193 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:21.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.193 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:21.193 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:21.194 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:21.194 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:21.194 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.194 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.194 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 3, 2020-05-18T21:36:21.195 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:21.195 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:21.195 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:21.195 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16877, 2020-05-18T21:36:21.195 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:21.195 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:21.196 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:21.196 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:21.196 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:21.196 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:21.196 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:21.196 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:21.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.197 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:21.197 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:21.197 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:21.197 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:21.198 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:21.198 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:21.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.198 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:21.198 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:21.198 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:21.199 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:21.199 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:21.199 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:21.199 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:21.199 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:21.200 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:21.200 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:21.200 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:21.200 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:21.200 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:21.200 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.201 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:21.201 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:21.201 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:21.201 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:21.201 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.202 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:21.202 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.202 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:21.202 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:21.202 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:21.202 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:21.203 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:06.317019+0000" 2020-05-18T21:36:21.203 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.203 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:21.203 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.203 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:21.204 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:21.204 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:21.204 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:21.204 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:06.317019+0000" 2020-05-18T21:36:21.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.204 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:21.205 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:21.205 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:21.205 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:21.205 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:21.205 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:21.206 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:21.206 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:21.206 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:21.206 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.206 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:21.206 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:21.207 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:21.207 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:21.207 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:21.207 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:21.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.207 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:21.208 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:21.208 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:21.208 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.208 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.208 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.209 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.209 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.209 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.209 INFO:teuthology.orchestra.run.smithi155.stdout: -2, 2020-05-18T21:36:21.209 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.210 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.210 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.210 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.210 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.210 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.210 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.211 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.211 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:36:21.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.211 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:36:21.211 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:21.212 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:21.212 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:21.212 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:21.212 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:21.212 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:21.212 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:21.213 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:21.213 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.213 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:21.213 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:21.213 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:21.214 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:21.214 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:21.214 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:21.214 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:21.214 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:21.214 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:21.215 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.215 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:21.215 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.215 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:21.215 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:21.216 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:21.216 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:21.216 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:36:21.216 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.216 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.216 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 257, 2020-05-18T21:36:21.217 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:21.217 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:21.217 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:21.217 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:21.217 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:21.218 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:21.218 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:21.218 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:21.218 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:21.218 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:21.218 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:21.219 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:21.219 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.219 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:21.219 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:21.219 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:21.220 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:21.220 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:21.220 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:21.220 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.220 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:21.220 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:21.221 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:21.221 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:21.221 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:21.221 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:21.221 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:21.222 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:21.222 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:21.222 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:21.222 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:21.222 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:21.222 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:21.223 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.223 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:21.223 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:21.223 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 10, 2020-05-18T21:36:21.223 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:21.224 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.224 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:21.224 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.224 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:21.224 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:21.224 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:36:21.225 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:21.225 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:21.225 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.225 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:21.225 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:21.225 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:21.226 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:21.226 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:36:21.226 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:21.226 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:21.226 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.227 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:21.227 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:21.227 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:21.227 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:21.228 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:21.228 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:21.228 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:21.228 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:21.228 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:21.229 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.229 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:21.229 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:21.229 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:21.229 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:21.230 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:21.230 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:21.230 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.230 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:21.230 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:21.230 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:21.231 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.231 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.231 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.231 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.232 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.232 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.232 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.232 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.232 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.232 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.233 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.233 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.233 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.233 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.233 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:21.234 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:36:21.234 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.234 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:21.234 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:21.234 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:21.234 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:21.235 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:21.235 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:21.235 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:21.235 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:21.235 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:21.236 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.236 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:21.236 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:21.236 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:21.236 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:21.236 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:21.237 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:21.237 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:21.237 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:21.237 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:21.237 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.238 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:21.238 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.238 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:21.238 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:21.238 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:21.238 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:21.239 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:21.239 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.239 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1", 2020-05-18T21:36:21.239 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x101", 2020-05-18T21:36:21.239 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:21.239 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:21.240 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:21.240 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "0", 2020-05-18T21:36:21.240 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "0", 2020-05-18T21:36:21.240 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:21.240 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "1", 2020-05-18T21:36:21.241 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.241 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:21.241 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:21.241 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:21.241 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.241 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.242 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.242 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.242 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.242 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.242 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.243 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.243 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.243 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.243 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.243 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.243 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.244 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.244 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.244 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.244 INFO:teuthology.orchestra.run.smithi155.stdout: "child": 1, 2020-05-18T21:36:21.244 INFO:teuthology.orchestra.run.smithi155.stdout: "subtree": 1, 2020-05-18T21:36:21.245 INFO:teuthology.orchestra.run.smithi155.stdout: "subtreetemp": 0, 2020-05-18T21:36:21.245 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:21.245 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:21.245 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:21.245 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.245 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:21.246 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [ 2020-05-18T21:36:21.246 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.246 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray6", 2020-05-18T21:36:21.246 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:21.246 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:21.247 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:21.247 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:21.247 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:21.247 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:21.247 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:21.247 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1552, 2020-05-18T21:36:21.248 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:21.248 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:21.248 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:21.248 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.248 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.248 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.249 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.249 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.249 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.249 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.249 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.250 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.250 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.250 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.250 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.250 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.250 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.251 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.251 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.251 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:21.251 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.251 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:21.252 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:21.252 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:21.252 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:21.252 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:21.252 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:21.252 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:21.253 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:21.253 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:21.253 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:21.253 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.253 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.254 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:21.254 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:21.254 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.254 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.254 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray7", 2020-05-18T21:36:21.254 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:21.255 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:21.255 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:21.255 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:21.255 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:21.255 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:21.256 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:21.256 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1553, 2020-05-18T21:36:21.256 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:21.256 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:21.256 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:21.256 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.257 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.257 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.257 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.257 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.257 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.258 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.258 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.258 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.258 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.258 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.258 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.259 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.259 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.259 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.259 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.259 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:21.260 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.260 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:21.260 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:21.260 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:21.260 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:21.260 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:21.261 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:21.261 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:21.261 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:21.261 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:21.261 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:21.262 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.262 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.262 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:21.262 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:21.262 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.263 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.263 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray0", 2020-05-18T21:36:21.263 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:21.263 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:21.263 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:21.263 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:21.264 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:21.264 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:21.264 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:21.264 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1546, 2020-05-18T21:36:21.264 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:21.265 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:21.265 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:21.265 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.265 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.265 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.265 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.266 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.266 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.266 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.266 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.266 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.267 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.267 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.267 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.267 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.267 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.267 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.268 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.268 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:21.268 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.268 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:21.268 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:21.269 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:21.269 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:21.269 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:21.269 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:21.269 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:21.269 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:21.270 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:21.270 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:21.270 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.270 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.270 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:21.271 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:21.271 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.271 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.271 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray9", 2020-05-18T21:36:21.271 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:21.271 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:21.272 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:21.272 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:21.272 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:21.272 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:21.272 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:21.272 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1555, 2020-05-18T21:36:21.273 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:21.273 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:21.273 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:21.273 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.273 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.274 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.274 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.274 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.274 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.274 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.274 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.275 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.275 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.275 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.275 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.275 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.276 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.276 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.276 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.276 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:21.276 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.276 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:21.277 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:21.277 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:21.277 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:21.277 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:21.277 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:21.278 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:21.278 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:21.278 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:21.278 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:21.278 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.278 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.279 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:21.279 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:21.279 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.279 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.279 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray5", 2020-05-18T21:36:21.280 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:21.280 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:21.280 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:21.280 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:21.280 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:21.280 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:21.281 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:21.281 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1551, 2020-05-18T21:36:21.281 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:21.281 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:21.281 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:21.282 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.282 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.282 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.282 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.282 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.282 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.283 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.283 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.283 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.283 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.283 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.283 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.284 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.284 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.284 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.284 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.284 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:21.285 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.285 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:21.285 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:21.285 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:21.285 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:21.285 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:21.286 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:21.286 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:21.286 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:21.286 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:21.286 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:21.287 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.287 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.287 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:21.287 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:21.287 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.287 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.288 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray2", 2020-05-18T21:36:21.288 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:21.288 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:21.288 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:21.288 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:21.289 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:21.289 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:21.289 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:21.289 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1548, 2020-05-18T21:36:21.289 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:21.289 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:21.290 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:21.290 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.290 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.290 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.290 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.290 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.291 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.291 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.291 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.291 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.291 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.292 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.292 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.292 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.292 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.292 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.292 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.293 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:21.293 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.293 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:21.293 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:21.293 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:21.294 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:21.294 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:21.294 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:21.294 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:21.294 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:21.294 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:21.295 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:21.295 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.295 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.295 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:21.295 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:21.296 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.296 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.296 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray1", 2020-05-18T21:36:21.296 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:21.296 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:21.296 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:21.297 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:21.297 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:21.297 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:21.297 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:21.297 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1547, 2020-05-18T21:36:21.298 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:21.298 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:21.298 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:21.298 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.298 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.298 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.299 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.299 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.299 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.299 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.299 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.299 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.300 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.300 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.300 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.300 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.300 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.301 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.301 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.301 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:21.301 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.301 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:21.301 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:21.302 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:21.302 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:21.302 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:21.302 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:21.302 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:21.303 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:21.303 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:21.303 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:21.303 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.303 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.303 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:21.304 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:21.304 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.304 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.304 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray8", 2020-05-18T21:36:21.304 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:21.305 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:21.305 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:21.305 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:21.305 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:21.305 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:21.305 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:21.306 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1554, 2020-05-18T21:36:21.306 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:21.306 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:21.306 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:21.306 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.307 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.307 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.307 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.307 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.307 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.307 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.308 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.308 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.308 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.308 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.308 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.308 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.309 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.309 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.309 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.309 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:21.309 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.310 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:21.310 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:21.310 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:21.310 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:21.310 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:21.310 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:21.311 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:21.311 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:21.311 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:21.311 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:21.311 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.312 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.312 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:21.312 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:21.312 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.312 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.312 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray3", 2020-05-18T21:36:21.313 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:21.313 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:21.313 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:21.313 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:21.313 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:21.314 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:21.314 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:21.314 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1549, 2020-05-18T21:36:21.314 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:21.314 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:21.314 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:21.315 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.315 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.315 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.315 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.315 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.315 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.316 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.316 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.316 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.316 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.316 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.317 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.317 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.317 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.317 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.317 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.317 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:21.318 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.318 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:21.318 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:21.318 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:21.318 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:21.319 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:21.319 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:21.319 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:21.319 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:21.319 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:21.319 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:21.320 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.320 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.320 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:21.320 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:21.320 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.321 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:21.321 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray4", 2020-05-18T21:36:21.321 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:21.321 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:21.321 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:21.321 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:21.322 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:21.322 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:21.322 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:21.322 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1550, 2020-05-18T21:36:21.322 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:21.322 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:21.323 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:21.323 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.323 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:21.323 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:21.323 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:21.324 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.324 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:21.324 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:21.324 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:21.324 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:21.324 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:21.325 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:21.325 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.325 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:21.325 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:21.325 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:21.326 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:21.326 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:21.326 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.326 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:21.326 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:21.326 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:21.327 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:21.327 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:21.327 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:21.327 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:21.327 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:21.328 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:21.328 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:21.328 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:21.328 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:21.329 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:21.329 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:21.329 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:21.329 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:21.329 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:21.330 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:21.330 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:21.330 INFO:teuthology.orchestra.run.smithi155.stdout:] 2020-05-18T21:36:21.331 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "ino": 1, "rdev": 0, "ctime": "2020-05-18T21:36:12.141787+0000", "btime": "2020-05-18T21:35:50.165450+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 26, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:12.141787+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:36:12.141787+0000", "num_files": 0, "num_subdirs": 1, "change_attr": 1 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:57.723581+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:50.165450+0000" }, "version": 4, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 3, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "dirfrag": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1546, "rdev": 0, "ctime": "2020-05-18T21:35:58.261727+0000", "btime": "2020-05-18T21:35:58.261727+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261727+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261727+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261727+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray0", "dirfrag": "0x60a", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1547, "rdev": 0, "ctime": "2020-05-18T21:35:58.261988+0000", "btime": "2020-05-18T21:35:58.261988+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261988+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261988+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261988+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray1", "dirfrag": "0x60b", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1548, "rdev": 0, "ctime": "2020-05-18T21:35:58.262165+0000", "btime": "2020-05-18T21:35:58.262165+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262165+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262165+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262165+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray2", "dirfrag": "0x60c", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1551, "rdev": 0, "ctime": "2020-05-18T21:35:58.262725+0000", "btime": "2020-05-18T21:35:58.262725+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262725+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262725+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262725+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray5", "dirfrag": "0x60f", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1552, "rdev": 0, "ctime": "2020-05-18T21:35:58.262910+0000", "btime": "2020-05-18T21:35:58.262910+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262910+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262910+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262910+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray6", "dirfrag": "0x610", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1549, "rdev": 0, "ctime": "2020-05-18T21:35:58.262345+0000", "btime": "2020-05-18T21:35:58.262345+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262345+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262345+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262345+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray3", "dirfrag": "0x60d", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1553, "rdev": 0, "ctime": "2020-05-18T21:35:58.263085+0000", "btime": "2020-05-18T21:35:58.263085+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263085+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263085+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263085+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray7", "dirfrag": "0x611", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1554, "rdev": 0, "ctime": "2020-05-18T21:35:58.263263+0000", "btime": "2020-05-18T21:35:58.263263+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263263+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263263+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263263+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray8", "dirfrag": "0x612", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1550, "rdev": 0, "ctime": "2020-05-18T21:35:58.262533+0000", "btime": "2020-05-18T21:35:58.262533+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262533+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262533+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262533+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray4", "dirfrag": "0x60e", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1555, "rdev": 0, "ctime": "2020-05-18T21:35:58.263460+0000", "btime": "2020-05-18T21:35:58.263460+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263460+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray9", "dirfrag": "0x613", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 3, "rdev": 0, "ctime": "2020-05-18T21:36:06.317019+0000", "btime": "2020-05-18T21:36:06.317019+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:06.317019+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:36:06.317019+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:36:06.317019+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ -2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "openingsnapparents": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 257, "rdev": 0, "ctime": "2020-05-18T21:35:58.261635+0000", "btime": "2020-05-18T21:35:58.261635+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261635+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 10, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "openingsnapparents": 0 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "subtreetemp": 0, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 3, "dentries": [ { "path": "stray6", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1552, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray7", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1553, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray0", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1546, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray9", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1555, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray5", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1551, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray2", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1548, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray1", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1547, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray8", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1554, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray3", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1549, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray4", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1550, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] } ] } ] } ] 2020-05-18T21:36:22.334 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok dump cache 2020-05-18T21:36:22.445 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2020-05-18T21:36:22.446 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.446 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1099511628280, 2020-05-18T21:36:22.446 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:22.446 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:12.167540+0000", 2020-05-18T21:36:22.447 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:36:12.165473+0000", 2020-05-18T21:36:22.447 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 33188, 2020-05-18T21:36:22.447 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:22.447 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:22.447 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:22.447 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:22.448 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 0, 2020-05-18T21:36:22.448 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:22.448 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:22.448 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:22.448 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.449 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:22.449 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:36:22.449 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:36:22.449 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:36:22.449 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 26, 2020-05-18T21:36:22.450 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:22.450 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.450 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:22.450 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 7, 2020-05-18T21:36:22.450 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 1, 2020-05-18T21:36:22.451 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:22.451 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:22.451 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:22.451 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.167540+0000", 2020-05-18T21:36:22.451 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "2020-05-18T21:36:12.165473+0000", 2020-05-18T21:36:22.451 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:22.452 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:36:22.452 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:22.452 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:22.452 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:22.453 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.453 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:22.453 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:22.453 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:22.453 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:22.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.454 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:22.454 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.454 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:36:22.455 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:36:22.455 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:36:22.455 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.455 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:12.167540+0000" 2020-05-18T21:36:22.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.455 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:22.456 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.456 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:36:22.456 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:36:22.456 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:36:22.456 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.457 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:12.167540+0000" 2020-05-18T21:36:22.457 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.457 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 18, 2020-05-18T21:36:22.457 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:22.457 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:22.457 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 8, 2020-05-18T21:36:22.458 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:22.458 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:22.458 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:22.458 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:22.459 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:22.459 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.459 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:22.459 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:22.459 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:22.459 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:22.460 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:22.460 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:22.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.460 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:22.460 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:22.461 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:22.461 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.461 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.461 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.461 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.461 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.462 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.462 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.462 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.462 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.462 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.463 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.463 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.463 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.463 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.464 INFO:teuthology.orchestra.run.smithi155.stdout: "importingcaps": 0, 2020-05-18T21:36:22.464 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1, 2020-05-18T21:36:22.464 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent": 1, 2020-05-18T21:36:22.464 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:36:22.464 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:36:22.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.465 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:22.465 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.465 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.465 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.465 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:22.468 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:36:22.468 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.468 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:36:22.468 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.468 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.468 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.469 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.469 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.469 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.469 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:22.469 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:22.470 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.470 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.470 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:22.470 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent", 2020-05-18T21:36:22.470 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtypool" 2020-05-18T21:36:22.471 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.471 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [ 2020-05-18T21:36:22.471 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.471 INFO:teuthology.orchestra.run.smithi155.stdout: "client_id": 9648, 2020-05-18T21:36:22.471 INFO:teuthology.orchestra.run.smithi155.stdout: "pending": "pAsLsXsFsc", 2020-05-18T21:36:22.471 INFO:teuthology.orchestra.run.smithi155.stdout: "issued": "pAsLsXsFsc", 2020-05-18T21:36:22.472 INFO:teuthology.orchestra.run.smithi155.stdout: "wanted": "-", 2020-05-18T21:36:22.472 INFO:teuthology.orchestra.run.smithi155.stdout: "last_sent": 1 2020-05-18T21:36:22.472 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:22.472 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.472 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:22.473 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:22.473 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:22.473 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:36:22.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.473 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.474 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1099511627777, 2020-05-18T21:36:22.474 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:22.474 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:12.158901+0000", 2020-05-18T21:36:22.474 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:36:12.151650+0000", 2020-05-18T21:36:22.474 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 33188, 2020-05-18T21:36:22.474 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:22.475 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:22.475 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:22.475 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:22.475 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 0, 2020-05-18T21:36:22.475 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:22.476 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:22.476 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:22.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.476 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:22.476 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:36:22.476 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:36:22.477 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:36:22.477 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 26, 2020-05-18T21:36:22.477 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:22.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.477 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:22.478 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 7, 2020-05-18T21:36:22.478 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 1, 2020-05-18T21:36:22.478 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:22.478 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:22.478 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:22.478 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.158901+0000", 2020-05-18T21:36:22.479 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "2020-05-18T21:36:12.151650+0000", 2020-05-18T21:36:22.479 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:22.479 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:36:22.479 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:22.479 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:22.480 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:22.480 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.480 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:22.480 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:22.480 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:22.480 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:22.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.481 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:22.481 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.481 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:36:22.481 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:36:22.482 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:36:22.482 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.482 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:12.158901+0000" 2020-05-18T21:36:22.482 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.482 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:22.483 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.483 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:36:22.483 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:36:22.483 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:36:22.483 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.483 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:12.158901+0000" 2020-05-18T21:36:22.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.484 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 12, 2020-05-18T21:36:22.484 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:22.484 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:22.484 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 2, 2020-05-18T21:36:22.485 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:22.485 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:22.485 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:22.485 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:22.485 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:22.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.486 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:22.486 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:22.486 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:22.486 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:22.486 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:22.487 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:22.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.487 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:22.487 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:22.487 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:22.487 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.488 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.488 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.488 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.488 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.488 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.489 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.489 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.489 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.489 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.489 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.490 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.490 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.490 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.490 INFO:teuthology.orchestra.run.smithi155.stdout: "importingcaps": 0, 2020-05-18T21:36:22.490 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1, 2020-05-18T21:36:22.491 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent": 1, 2020-05-18T21:36:22.491 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:36:22.491 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:36:22.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.491 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:22.491 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.492 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.492 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.492 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.492 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.492 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.493 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.493 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.493 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:22.493 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:22.493 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:22.494 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:22.494 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:22.494 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:22.494 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:36:22.494 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.495 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:36:22.495 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.495 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.495 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.495 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.496 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.496 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.496 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:22.496 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:22.496 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.496 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.497 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:22.497 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent", 2020-05-18T21:36:22.497 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtypool" 2020-05-18T21:36:22.497 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.497 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [ 2020-05-18T21:36:22.498 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.498 INFO:teuthology.orchestra.run.smithi155.stdout: "client_id": 9648, 2020-05-18T21:36:22.498 INFO:teuthology.orchestra.run.smithi155.stdout: "pending": "pAsLsXsFsc", 2020-05-18T21:36:22.498 INFO:teuthology.orchestra.run.smithi155.stdout: "issued": "pAsLsXsFsc", 2020-05-18T21:36:22.498 INFO:teuthology.orchestra.run.smithi155.stdout: "wanted": "-", 2020-05-18T21:36:22.498 INFO:teuthology.orchestra.run.smithi155.stdout: "last_sent": 1 2020-05-18T21:36:22.499 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:22.499 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.499 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:22.499 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:22.499 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:22.500 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:36:22.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.500 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.500 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1099511628281, 2020-05-18T21:36:22.500 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:22.501 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:12.169874+0000", 2020-05-18T21:36:22.501 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:36:12.168220+0000", 2020-05-18T21:36:22.501 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 33188, 2020-05-18T21:36:22.501 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:22.501 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:22.502 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:22.502 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:22.502 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 0, 2020-05-18T21:36:22.502 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:22.502 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:22.503 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:22.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.503 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:22.503 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:36:22.504 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:36:22.504 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:36:22.504 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 26, 2020-05-18T21:36:22.504 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:22.504 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.505 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:22.505 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 7, 2020-05-18T21:36:22.505 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 1, 2020-05-18T21:36:22.505 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:22.505 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:22.506 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:22.506 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.169874+0000", 2020-05-18T21:36:22.506 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "2020-05-18T21:36:12.168220+0000", 2020-05-18T21:36:22.506 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:22.506 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:36:22.507 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:22.507 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:22.507 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:22.507 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.507 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:22.507 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:22.508 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:22.508 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:22.508 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.508 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:22.508 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.509 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:36:22.509 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:36:22.509 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:36:22.509 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.509 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:12.169874+0000" 2020-05-18T21:36:22.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.510 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:22.510 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.510 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:36:22.510 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:36:22.510 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:36:22.511 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.511 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:12.169874+0000" 2020-05-18T21:36:22.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.511 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 20, 2020-05-18T21:36:22.512 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:22.512 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:22.512 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 10, 2020-05-18T21:36:22.512 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:22.512 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:22.513 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:22.513 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:22.513 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:22.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.513 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:22.514 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:22.514 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:22.514 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:22.514 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:22.514 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:22.514 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.515 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:22.515 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:22.515 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:22.515 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.515 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.516 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.516 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.516 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.516 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.516 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.517 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.517 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.517 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.517 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.517 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.518 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.518 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.518 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.518 INFO:teuthology.orchestra.run.smithi155.stdout: "importingcaps": 0, 2020-05-18T21:36:22.518 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1, 2020-05-18T21:36:22.519 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent": 1, 2020-05-18T21:36:22.519 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:36:22.519 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:36:22.519 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.519 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:22.520 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.520 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.520 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.520 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.520 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.520 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.521 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.521 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.521 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.521 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:22.521 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:22.522 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:22.522 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:22.522 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:22.522 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:22.522 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:36:22.523 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.523 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:36:22.523 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.523 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.523 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.523 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.524 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.524 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.524 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:22.524 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:22.524 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.525 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.525 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:22.525 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent", 2020-05-18T21:36:22.525 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtypool" 2020-05-18T21:36:22.525 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.525 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [ 2020-05-18T21:36:22.526 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.526 INFO:teuthology.orchestra.run.smithi155.stdout: "client_id": 9648, 2020-05-18T21:36:22.526 INFO:teuthology.orchestra.run.smithi155.stdout: "pending": "pAsLsXsFsc", 2020-05-18T21:36:22.526 INFO:teuthology.orchestra.run.smithi155.stdout: "issued": "pAsLsXsFsc", 2020-05-18T21:36:22.526 INFO:teuthology.orchestra.run.smithi155.stdout: "wanted": "-", 2020-05-18T21:36:22.527 INFO:teuthology.orchestra.run.smithi155.stdout: "last_sent": 1 2020-05-18T21:36:22.527 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:22.527 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.527 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:22.527 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:22.527 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:22.528 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:36:22.528 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.528 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.528 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1099511628278, 2020-05-18T21:36:22.528 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:22.529 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:12.161470+0000", 2020-05-18T21:36:22.529 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:36:12.159980+0000", 2020-05-18T21:36:22.529 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 33188, 2020-05-18T21:36:22.529 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:22.529 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:22.529 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:22.530 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:22.530 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 0, 2020-05-18T21:36:22.530 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:22.530 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:22.531 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:22.531 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.531 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:22.531 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:36:22.531 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:36:22.531 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:36:22.532 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 26, 2020-05-18T21:36:22.532 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:22.532 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.532 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:22.532 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 7, 2020-05-18T21:36:22.533 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 1, 2020-05-18T21:36:22.533 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:22.533 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:22.533 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:22.534 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.161470+0000", 2020-05-18T21:36:22.534 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "2020-05-18T21:36:12.159980+0000", 2020-05-18T21:36:22.534 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:22.534 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:36:22.534 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:22.535 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:22.535 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:22.535 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.535 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:22.535 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:22.536 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:22.536 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:22.536 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.536 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:22.536 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.536 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:36:22.537 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:36:22.537 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:36:22.537 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.537 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:12.161470+0000" 2020-05-18T21:36:22.537 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.538 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:22.538 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.538 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:36:22.538 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:36:22.538 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:36:22.539 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.539 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:12.161470+0000" 2020-05-18T21:36:22.539 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.539 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 14, 2020-05-18T21:36:22.539 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:22.539 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:22.540 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 4, 2020-05-18T21:36:22.540 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:22.540 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:22.540 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:22.540 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:22.541 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:22.541 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.541 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:22.541 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:22.541 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:22.541 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:22.542 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:22.542 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:22.542 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.542 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:22.542 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:22.543 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:22.543 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.543 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.543 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.543 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.544 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.544 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.544 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.544 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.544 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.544 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.545 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.545 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.545 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.545 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.545 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.546 INFO:teuthology.orchestra.run.smithi155.stdout: "importingcaps": 0, 2020-05-18T21:36:22.546 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1, 2020-05-18T21:36:22.546 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent": 1, 2020-05-18T21:36:22.546 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:36:22.546 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:36:22.547 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.547 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:22.547 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.547 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.547 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.547 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.548 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.548 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.548 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.548 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.548 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.549 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:22.549 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:22.549 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:22.549 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:22.549 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:22.549 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:22.550 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:36:22.550 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.550 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:36:22.550 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.550 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.551 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.551 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.551 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.551 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.551 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:22.551 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:22.552 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.552 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.552 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:22.552 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent", 2020-05-18T21:36:22.552 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtypool" 2020-05-18T21:36:22.553 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.553 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [ 2020-05-18T21:36:22.553 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.553 INFO:teuthology.orchestra.run.smithi155.stdout: "client_id": 9648, 2020-05-18T21:36:22.553 INFO:teuthology.orchestra.run.smithi155.stdout: "pending": "pAsLsXsFsc", 2020-05-18T21:36:22.554 INFO:teuthology.orchestra.run.smithi155.stdout: "issued": "pAsLsXsFsc", 2020-05-18T21:36:22.554 INFO:teuthology.orchestra.run.smithi155.stdout: "wanted": "-", 2020-05-18T21:36:22.554 INFO:teuthology.orchestra.run.smithi155.stdout: "last_sent": 1 2020-05-18T21:36:22.554 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:22.555 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.555 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:22.555 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:22.555 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:22.555 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:36:22.556 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.556 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.556 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1099511627776, 2020-05-18T21:36:22.556 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:22.556 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:12.625070+0000", 2020-05-18T21:36:22.556 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:22.557 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16877, 2020-05-18T21:36:22.557 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:22.557 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:22.557 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:22.557 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:22.558 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:22.558 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:22.558 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:22.558 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:22.558 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.559 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:22.559 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:22.559 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:22.559 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:22.559 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:22.559 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:22.560 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.560 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:22.560 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:22.560 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 1, 2020-05-18T21:36:22.560 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:22.561 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:22.561 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:22.561 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.168220+0000", 2020-05-18T21:36:22.561 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:22.561 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:22.561 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 6, 2020-05-18T21:36:22.562 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": 1, 2020-05-18T21:36:22.562 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:22.562 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:22.562 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.562 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.168220+0000", 2020-05-18T21:36:22.563 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 5, 2020-05-18T21:36:22.563 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:22.563 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 5 2020-05-18T21:36:22.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.563 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:22.563 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.564 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 35, 2020-05-18T21:36:22.564 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 5, 2020-05-18T21:36:22.564 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.564 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.564 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:12.625070+0000" 2020-05-18T21:36:22.565 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.565 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:22.565 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.565 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 35, 2020-05-18T21:36:22.565 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 5, 2020-05-18T21:36:22.566 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.566 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.566 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:12.625070+0000" 2020-05-18T21:36:22.566 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.566 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 24, 2020-05-18T21:36:22.566 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:22.567 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:22.567 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 2, 2020-05-18T21:36:22.567 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:22.567 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:22.567 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:22.568 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:22.568 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:22.568 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.568 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:22.568 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:22.568 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:22.569 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:22.569 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:22.569 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:22.569 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.569 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:22.570 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:22.570 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:22.570 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:36:22.570 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.570 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.571 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.571 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.571 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.571 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:36:22.571 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.572 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.572 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:36:22.572 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.572 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.572 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.572 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.573 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.573 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": 0, 2020-05-18T21:36:22.573 INFO:teuthology.orchestra.run.smithi155.stdout: "importing": 0, 2020-05-18T21:36:22.573 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1 2020-05-18T21:36:22.573 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.574 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:22.574 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.574 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.574 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.574 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.575 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.575 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.575 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.575 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.575 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:22.576 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:22.576 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:22.576 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": { 2020-05-18T21:36:22.576 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.576 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:36:22.577 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.577 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.577 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.577 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.577 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.578 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.578 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:22.578 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:22.578 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:36:22.578 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.578 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:36:22.579 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.579 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.579 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.579 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.579 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.580 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.580 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:22.580 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:22.580 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [], 2020-05-18T21:36:22.580 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:22.580 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:22.581 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:22.581 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:22.581 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:22.581 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.581 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "/delete_me", 2020-05-18T21:36:22.582 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x10000000000", 2020-05-18T21:36:22.582 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:22.582 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "21", 2020-05-18T21:36:22.582 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "21", 2020-05-18T21:36:22.582 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "0", 2020-05-18T21:36:22.582 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "0", 2020-05-18T21:36:22.583 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:22.583 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "1", 2020-05-18T21:36:22.583 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.583 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.583 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:22.584 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:22.584 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.584 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.584 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.584 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": { 2020-05-18T21:36:22.585 INFO:teuthology.orchestra.run.smithi155.stdout: "0": 1 2020-05-18T21:36:22.585 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:22.585 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.585 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.585 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.585 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.586 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.586 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.586 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.586 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.586 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.587 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.587 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.587 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.587 INFO:teuthology.orchestra.run.smithi155.stdout: "ptrwaiter": 0, 2020-05-18T21:36:22.587 INFO:teuthology.orchestra.run.smithi155.stdout: "child": 1, 2020-05-18T21:36:22.587 INFO:teuthology.orchestra.run.smithi155.stdout: "frozen": 0, 2020-05-18T21:36:22.588 INFO:teuthology.orchestra.run.smithi155.stdout: "subtree": 1, 2020-05-18T21:36:22.588 INFO:teuthology.orchestra.run.smithi155.stdout: "importing": 0, 2020-05-18T21:36:22.588 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 1, 2020-05-18T21:36:22.588 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:36:22.588 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.589 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 4, 2020-05-18T21:36:22.589 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [ 2020-05-18T21:36:22.589 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.589 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "delete_me/file_1", 2020-05-18T21:36:22.589 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 1, 2020-05-18T21:36:22.590 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:22.590 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:22.590 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:22.590 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:22.590 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:22.590 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:22.591 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1099511628278, 2020-05-18T21:36:22.591 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:22.591 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 14, 2020-05-18T21:36:22.591 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 14, 2020-05-18T21:36:22.591 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.592 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.592 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.592 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.592 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.592 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.592 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.593 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.593 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.593 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.593 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.594 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.594 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.594 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.594 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.594 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1, 2020-05-18T21:36:22.595 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:36:22.595 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:36:22.595 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.595 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:22.595 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:22.596 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.596 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.596 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.596 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.596 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.596 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.597 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.597 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.597 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.597 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.597 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.598 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty" 2020-05-18T21:36:22.598 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:22.598 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.598 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.598 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "delete_me/file_4", 2020-05-18T21:36:22.598 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 1, 2020-05-18T21:36:22.599 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:22.599 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:22.599 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:22.599 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:22.599 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:22.600 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:22.600 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1099511628281, 2020-05-18T21:36:22.600 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:22.600 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 20, 2020-05-18T21:36:22.600 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 20, 2020-05-18T21:36:22.601 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.601 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.601 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.601 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.601 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.601 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.602 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.602 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.602 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.602 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.603 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.603 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.603 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.603 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.603 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.604 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.604 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1, 2020-05-18T21:36:22.604 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:36:22.604 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:36:22.605 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.605 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:22.605 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:22.605 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.605 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.606 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.606 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.606 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.606 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.606 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.607 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.607 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.607 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.607 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.607 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty" 2020-05-18T21:36:22.607 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:22.608 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.608 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.608 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "delete_me/file_2", 2020-05-18T21:36:22.608 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 1, 2020-05-18T21:36:22.608 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:22.609 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:22.609 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:22.609 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:22.609 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:22.609 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:22.610 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1099511628279, 2020-05-18T21:36:22.610 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:22.610 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 16, 2020-05-18T21:36:22.610 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 16, 2020-05-18T21:36:22.610 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.610 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.611 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.611 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.611 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.611 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.611 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.612 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.612 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.612 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.612 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.612 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.613 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.613 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.613 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.613 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.613 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1, 2020-05-18T21:36:22.613 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:36:22.614 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:36:22.614 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.614 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:22.614 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:22.614 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.615 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.615 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.615 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.615 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.615 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.616 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.616 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.616 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.616 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.616 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.616 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty" 2020-05-18T21:36:22.617 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:22.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.617 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.617 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "delete_me/file_0", 2020-05-18T21:36:22.617 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 1, 2020-05-18T21:36:22.618 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:22.618 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:22.618 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:22.618 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:22.618 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:22.619 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:22.619 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1099511627777, 2020-05-18T21:36:22.619 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:22.619 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 12, 2020-05-18T21:36:22.619 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 12, 2020-05-18T21:36:22.620 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.620 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.620 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.620 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.620 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.621 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.621 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.621 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.621 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.621 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.621 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.622 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.622 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.622 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.622 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.623 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1, 2020-05-18T21:36:22.623 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:36:22.623 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:36:22.623 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.623 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:22.623 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:22.624 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.624 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.624 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.624 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.624 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.625 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.625 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.625 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.625 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.625 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.626 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty" 2020-05-18T21:36:22.626 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:22.626 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.626 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.626 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "delete_me/file_3", 2020-05-18T21:36:22.627 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 1, 2020-05-18T21:36:22.627 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:22.627 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:22.627 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:22.627 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:22.628 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:22.628 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:22.628 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1099511628280, 2020-05-18T21:36:22.628 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:22.628 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 18, 2020-05-18T21:36:22.628 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 18, 2020-05-18T21:36:22.629 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.629 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.629 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.629 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.629 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.630 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.630 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.630 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.630 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.630 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.631 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.631 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.631 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.631 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.631 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.632 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1, 2020-05-18T21:36:22.632 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:36:22.632 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:36:22.632 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.632 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:22.633 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:22.633 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.633 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.633 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.634 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.634 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.634 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.634 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.634 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.635 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.635 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.635 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.635 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty" 2020-05-18T21:36:22.635 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:22.636 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:22.636 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:22.636 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:22.636 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:22.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.636 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.637 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 3, 2020-05-18T21:36:22.637 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:22.637 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:22.637 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:22.637 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16877, 2020-05-18T21:36:22.638 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:22.638 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:22.638 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:22.638 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:22.638 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:22.639 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:22.639 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:22.639 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:22.639 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.639 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:22.640 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:22.640 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:22.640 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:22.640 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:22.640 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:22.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.641 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:22.641 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:22.641 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:22.641 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:22.641 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:22.642 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:22.642 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:06.317019+0000", 2020-05-18T21:36:22.642 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:22.642 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:22.642 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:22.643 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:22.643 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:22.643 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:22.643 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.643 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:22.644 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:22.644 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:22.644 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:22.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.644 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:22.644 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.645 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.645 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.645 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.645 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.645 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:06.317019+0000" 2020-05-18T21:36:22.646 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.646 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:22.646 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.646 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.646 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.646 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.647 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.647 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:06.317019+0000" 2020-05-18T21:36:22.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.647 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:22.647 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:22.647 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:22.648 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:22.648 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:22.648 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:22.648 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:22.648 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:22.649 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:22.649 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.649 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:22.649 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:22.649 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: -2, 2020-05-18T21:36:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.654 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:36:22.654 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.654 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:36:22.654 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.654 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.654 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.655 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.655 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.655 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.656 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.656 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.656 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.656 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:22.656 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:22.656 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:22.657 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:22.657 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:22.657 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:22.657 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:22.657 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:22.658 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:22.658 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.658 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:22.658 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.658 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:22.659 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:22.659 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:22.659 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:22.659 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:36:22.659 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.660 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.660 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1555, 2020-05-18T21:36:22.660 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:22.660 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:22.660 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:22.660 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:22.661 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:22.661 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:22.661 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:22.661 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:22.661 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:22.662 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:22.662 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:22.662 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:22.662 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.662 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:22.662 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:22.663 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:22.663 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:22.663 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:22.663 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:22.663 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.664 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:22.664 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:22.664 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:22.664 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:22.664 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:22.665 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:22.665 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263460+0000", 2020-05-18T21:36:22.665 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:22.665 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:22.665 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:22.665 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:22.666 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:22.666 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:22.666 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.666 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:22.666 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:22.667 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:22.667 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:22.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.667 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:22.667 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.668 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.668 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.668 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.668 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.668 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:22.668 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.669 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:22.669 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.669 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.669 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.669 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.670 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.670 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:22.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.670 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:22.670 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:22.670 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:22.671 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:22.671 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:22.671 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:22.671 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:22.671 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:22.672 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:22.672 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.672 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:22.672 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:22.672 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:22.672 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:22.673 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:22.673 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:22.673 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.673 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:22.673 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:22.674 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:22.674 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.674 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.674 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.674 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.674 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.675 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.675 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.675 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.675 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.675 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.676 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.676 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.676 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.676 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.676 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.676 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:22.677 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:22.677 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:22.677 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.677 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:22.677 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.678 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.678 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.678 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.678 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.678 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.678 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.679 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.679 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.679 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:22.679 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:22.679 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:22.680 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:22.680 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:22.680 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:22.680 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:22.680 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:22.680 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:22.681 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.681 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.681 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:22.681 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.681 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:22.682 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:22.682 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:22.682 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:22.682 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:22.682 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.682 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray9", 2020-05-18T21:36:22.683 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x613", 2020-05-18T21:36:22.683 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:22.683 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:22.683 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:22.683 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:22.684 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:22.684 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:22.684 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:22.684 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.684 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.684 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:22.685 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:22.685 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.685 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.685 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.685 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.686 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.686 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.686 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.686 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.686 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.687 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.687 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.687 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.687 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.687 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.688 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.688 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:22.688 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:22.688 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:22.688 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:22.689 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.689 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:22.689 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:22.689 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:22.689 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:22.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.690 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.690 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1550, 2020-05-18T21:36:22.690 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:22.690 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:22.690 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:22.691 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:22.691 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:22.691 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:22.691 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:22.691 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:22.692 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:22.692 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:22.692 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:22.692 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:22.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.692 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:22.693 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:22.693 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:22.693 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:22.693 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:22.693 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:22.694 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.694 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:22.694 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:22.694 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:22.694 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:22.694 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:22.695 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:22.695 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262533+0000", 2020-05-18T21:36:22.695 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:22.695 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:22.695 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:22.696 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:22.696 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:22.696 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:22.696 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.696 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:22.697 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:22.697 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:22.697 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:22.697 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.697 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:22.697 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.698 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.698 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.698 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.698 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.698 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262533+0000" 2020-05-18T21:36:22.699 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.699 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:22.699 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.699 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.699 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.699 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.700 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.700 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262533+0000" 2020-05-18T21:36:22.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.700 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:22.700 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:22.701 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:22.701 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:22.701 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:22.701 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:22.701 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:22.701 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:22.702 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:22.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.702 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:22.702 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:22.702 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:22.703 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:22.703 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:22.703 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:22.703 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.703 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:22.704 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:22.704 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:22.704 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.704 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.705 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.705 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.705 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.705 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.706 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.706 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.706 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.706 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.706 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.706 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.707 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.707 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.707 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.707 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:22.707 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:22.708 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:22.708 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.708 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:22.708 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.708 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.708 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.709 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.709 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.709 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.709 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.709 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.710 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.710 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:22.710 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:22.710 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:22.710 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:22.711 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:22.711 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:22.711 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:22.711 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:22.711 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:22.711 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.712 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.712 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:22.712 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.712 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:22.712 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:22.712 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:22.713 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:22.713 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:22.713 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.713 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray4", 2020-05-18T21:36:22.713 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60e", 2020-05-18T21:36:22.714 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:22.714 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:22.714 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:22.714 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:22.714 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:22.714 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:22.715 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:22.715 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.715 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.715 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:22.715 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:22.716 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.716 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.716 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.716 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.716 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.717 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.717 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.717 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.717 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.717 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.717 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.718 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.718 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.718 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.718 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.718 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.719 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:22.719 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:22.719 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:22.719 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:22.719 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.720 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:22.720 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:22.720 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:22.720 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:22.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.721 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.721 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1554, 2020-05-18T21:36:22.721 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:22.721 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:22.721 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:22.722 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:22.722 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:22.722 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:22.722 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:22.722 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:22.723 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:22.723 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:22.723 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:22.724 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:22.724 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.724 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:22.724 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:22.725 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:22.725 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:22.725 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:22.725 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:22.725 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.726 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:22.726 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:22.726 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:22.726 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:22.726 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:22.727 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:22.727 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263263+0000", 2020-05-18T21:36:22.727 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:22.727 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:22.727 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:22.727 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:22.728 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:22.728 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:22.728 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.728 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:22.728 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:22.729 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:22.729 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:22.729 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.729 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:22.729 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.729 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.730 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.730 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.730 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.730 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263263+0000" 2020-05-18T21:36:22.730 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.731 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:22.731 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.731 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.731 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.731 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.731 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.732 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263263+0000" 2020-05-18T21:36:22.732 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.732 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:22.732 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:22.732 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:22.733 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:22.733 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:22.733 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:22.733 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:22.733 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:22.734 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:22.734 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.734 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:22.735 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:22.735 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:22.735 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:22.735 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:22.735 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:22.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.736 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:22.736 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:22.736 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:22.736 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.736 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.737 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.737 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.737 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.737 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.738 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.738 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.738 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.738 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.738 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.739 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.739 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.739 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.739 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:22.739 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:22.740 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:22.740 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.740 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:22.740 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.740 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.740 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.741 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.741 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.741 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.741 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.741 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.742 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.742 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:22.742 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:22.742 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:22.742 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:22.742 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:22.743 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:22.743 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:22.743 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:22.743 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:22.743 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.744 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.744 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:22.744 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.744 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:22.744 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:22.744 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:22.745 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:22.745 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:22.745 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.745 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray8", 2020-05-18T21:36:22.745 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x612", 2020-05-18T21:36:22.746 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:22.746 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:22.746 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:22.746 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:22.746 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:22.747 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:22.747 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:22.747 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.747 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.747 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:22.747 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:22.748 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.748 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.748 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.748 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.748 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.748 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.749 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.749 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.749 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.749 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.749 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.750 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.750 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.750 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.750 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.750 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.751 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:22.751 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:22.751 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:22.751 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:22.751 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.751 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:22.752 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:22.752 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:22.752 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:22.752 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.752 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.753 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1099511628279, 2020-05-18T21:36:22.753 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:22.753 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:12.164748+0000", 2020-05-18T21:36:22.753 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:36:12.162343+0000", 2020-05-18T21:36:22.753 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 33188, 2020-05-18T21:36:22.753 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:22.754 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:22.754 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:22.754 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:22.754 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 0, 2020-05-18T21:36:22.754 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:22.755 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:22.755 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:22.755 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.755 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:22.755 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:36:22.756 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:36:22.756 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:36:22.756 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 26, 2020-05-18T21:36:22.756 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:22.757 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.757 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:22.757 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 7, 2020-05-18T21:36:22.757 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 1, 2020-05-18T21:36:22.757 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:22.757 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:22.758 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:22.758 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.164748+0000", 2020-05-18T21:36:22.758 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "2020-05-18T21:36:12.162343+0000", 2020-05-18T21:36:22.758 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:22.758 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:36:22.759 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:22.759 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:22.759 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:22.759 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.759 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:22.759 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:22.760 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:22.760 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:22.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.760 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:22.760 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.761 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:36:22.761 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:36:22.761 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:36:22.761 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.761 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:12.164748+0000" 2020-05-18T21:36:22.762 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.762 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:22.762 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.762 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:36:22.762 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:36:22.762 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:36:22.763 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.763 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:12.164748+0000" 2020-05-18T21:36:22.763 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.763 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 16, 2020-05-18T21:36:22.763 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:22.764 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:22.764 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 6, 2020-05-18T21:36:22.764 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:22.764 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:22.764 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:22.764 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:22.765 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:22.765 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.765 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:22.765 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:22.765 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:22.766 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:22.766 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:22.766 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:22.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.766 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:22.766 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:22.767 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:22.767 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.767 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.767 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.767 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.768 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.768 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.768 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.768 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.768 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.768 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.769 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.769 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.769 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.769 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.769 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.770 INFO:teuthology.orchestra.run.smithi155.stdout: "importingcaps": 0, 2020-05-18T21:36:22.770 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1, 2020-05-18T21:36:22.770 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent": 1, 2020-05-18T21:36:22.770 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:36:22.770 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:36:22.770 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.771 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:22.771 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.771 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.771 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.771 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.772 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.772 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.772 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.772 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.772 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.772 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:22.773 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:22.773 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:22.773 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:22.773 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:22.773 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:22.774 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:36:22.774 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.774 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:36:22.774 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.774 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.774 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.775 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.775 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.775 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.775 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:22.775 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:22.776 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.776 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.776 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:22.776 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent", 2020-05-18T21:36:22.776 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtypool" 2020-05-18T21:36:22.776 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.777 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [ 2020-05-18T21:36:22.777 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.777 INFO:teuthology.orchestra.run.smithi155.stdout: "client_id": 9648, 2020-05-18T21:36:22.777 INFO:teuthology.orchestra.run.smithi155.stdout: "pending": "pAsLsXsFsc", 2020-05-18T21:36:22.777 INFO:teuthology.orchestra.run.smithi155.stdout: "issued": "pAsLsXsFsc", 2020-05-18T21:36:22.778 INFO:teuthology.orchestra.run.smithi155.stdout: "wanted": "-", 2020-05-18T21:36:22.778 INFO:teuthology.orchestra.run.smithi155.stdout: "last_sent": 1 2020-05-18T21:36:22.778 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:22.778 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.778 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:22.778 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:22.779 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:22.779 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:36:22.779 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.779 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.779 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1553, 2020-05-18T21:36:22.780 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:22.780 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:22.780 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:22.780 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:22.780 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:22.781 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:22.781 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:22.781 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:22.781 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:22.781 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:22.781 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:22.782 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:22.782 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.782 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:22.782 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:22.782 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:22.783 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:22.783 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:22.783 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:22.784 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.784 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:22.784 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:22.785 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:22.785 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:22.785 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:22.786 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:22.786 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.263085+0000", 2020-05-18T21:36:22.786 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:22.787 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:22.787 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:22.787 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:22.788 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:22.788 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:22.788 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.789 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:22.789 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:22.789 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:22.790 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:22.790 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.790 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:22.791 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.791 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.791 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.791 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.791 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.792 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263085+0000" 2020-05-18T21:36:22.792 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.792 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:22.792 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.792 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.793 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.793 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.793 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.793 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263085+0000" 2020-05-18T21:36:22.793 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.793 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:22.794 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:22.794 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:22.794 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:22.794 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:22.794 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:22.795 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:22.795 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:22.795 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:22.795 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.795 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:22.795 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:22.796 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:22.796 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:22.796 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:22.796 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:22.797 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.797 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:22.797 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:22.798 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:22.798 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.798 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.799 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.799 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.799 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.800 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.800 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.800 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.801 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.801 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.801 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.801 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.801 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.802 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.802 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.802 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:22.803 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:22.803 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:22.803 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.803 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:22.804 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.804 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.804 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.804 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.804 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.805 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.805 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.805 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.805 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.805 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:22.806 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:22.806 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:22.806 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:22.806 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:22.807 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:22.807 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:22.807 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:22.807 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:22.807 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.808 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.808 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:22.808 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.808 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:22.808 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:22.808 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:22.809 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:22.809 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:22.809 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.809 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray7", 2020-05-18T21:36:22.809 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x611", 2020-05-18T21:36:22.810 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:22.810 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:22.810 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:22.810 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:22.810 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:22.810 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:22.811 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:22.811 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.811 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.811 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:22.811 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:22.812 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.812 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.812 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.812 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.812 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.812 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.813 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.813 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.813 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.813 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.813 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.814 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.814 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.814 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.814 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.814 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.814 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:22.815 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:22.815 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:22.815 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:22.815 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.815 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:22.816 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:22.816 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:22.816 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:22.816 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.816 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.816 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1552, 2020-05-18T21:36:22.817 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:22.817 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:22.817 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:22.817 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:22.817 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:22.818 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:22.818 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:22.818 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:22.818 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:22.818 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:22.818 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:22.819 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:22.819 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.819 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:22.819 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:22.819 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:22.820 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:22.820 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:22.820 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:22.820 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.820 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:22.821 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:22.821 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:22.821 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:22.821 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:22.821 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:22.822 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262910+0000", 2020-05-18T21:36:22.822 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:22.822 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:22.822 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:22.822 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:22.822 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:22.823 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:22.823 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.823 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:22.823 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:22.823 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:22.824 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:22.824 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.824 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:22.824 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.824 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.824 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.825 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.825 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.825 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262910+0000" 2020-05-18T21:36:22.825 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.825 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:22.826 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.826 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.826 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.826 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.826 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.826 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262910+0000" 2020-05-18T21:36:22.827 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.827 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:22.827 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:22.827 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:22.827 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:22.828 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:22.828 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:22.828 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:22.828 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:22.828 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:22.828 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.829 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:22.829 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:22.829 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:22.829 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:22.829 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:22.830 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:22.830 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.830 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:22.830 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:22.830 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:22.831 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.831 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.831 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.831 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.831 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.831 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.832 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.832 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.832 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.832 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.832 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.833 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.833 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.833 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.833 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.833 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:22.833 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:22.834 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:22.834 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.834 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:22.834 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.835 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.835 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.835 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.835 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.835 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.836 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.836 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.836 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.836 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:22.836 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:22.837 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:22.837 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:22.837 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:22.837 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:22.837 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:22.837 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:22.838 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:22.838 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.838 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.838 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:22.838 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.839 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:22.839 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:22.839 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:22.839 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:22.839 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:22.839 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.840 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray6", 2020-05-18T21:36:22.840 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x610", 2020-05-18T21:36:22.840 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:22.840 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:22.840 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:22.841 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:22.841 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:22.841 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:22.841 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:22.841 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.842 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.842 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:22.842 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:22.842 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.842 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.842 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.843 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.843 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.843 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.843 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.843 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.844 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.844 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.844 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.844 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.844 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.845 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.845 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.845 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.845 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:22.845 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:22.845 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:22.846 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:22.846 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.846 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:22.846 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:22.846 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:22.847 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:22.847 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.847 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.847 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1551, 2020-05-18T21:36:22.847 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:22.848 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:22.848 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:22.848 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:22.848 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:22.848 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:22.848 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:22.849 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:22.849 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:22.849 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:22.849 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:22.849 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:22.850 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.850 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:22.850 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:22.850 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:22.850 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:22.851 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:22.851 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:22.851 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.851 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:22.851 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:22.852 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:22.852 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:22.852 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:22.852 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:22.852 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262725+0000", 2020-05-18T21:36:22.852 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:22.853 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:22.853 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:22.853 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:22.853 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:22.853 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:22.854 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.854 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:22.854 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:22.854 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:22.854 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:22.854 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.855 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:22.855 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.855 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.855 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.855 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.856 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.856 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262725+0000" 2020-05-18T21:36:22.856 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.856 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:22.857 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.857 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.857 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.857 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.857 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.858 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262725+0000" 2020-05-18T21:36:22.858 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.858 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:22.858 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:22.858 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:22.859 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:22.859 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:22.859 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:22.859 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:22.859 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:22.860 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:22.860 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.860 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:22.860 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:22.860 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:22.860 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:22.861 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:22.861 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:22.861 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.861 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:22.861 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:22.862 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:22.862 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.862 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.862 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.862 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.862 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.863 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.863 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.863 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.863 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.863 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.864 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.864 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.864 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.864 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.864 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.864 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:22.865 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:22.865 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:22.865 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.865 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:22.865 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.866 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.866 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.866 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.866 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.866 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.866 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.867 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.867 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.867 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:22.867 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:22.867 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:22.868 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:22.868 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:22.868 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:22.868 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:22.868 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:22.868 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:22.869 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.869 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.869 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:22.869 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.869 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:22.870 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:22.870 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:22.870 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:22.870 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:22.870 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.870 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray5", 2020-05-18T21:36:22.871 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60f", 2020-05-18T21:36:22.871 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:22.871 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:22.871 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:22.871 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:22.872 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:22.872 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:22.872 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:22.872 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.872 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.872 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:22.873 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:22.873 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.873 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.873 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.873 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.874 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.874 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.874 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.874 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.874 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.874 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.875 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.875 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.875 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.875 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.875 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.876 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.876 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:22.876 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:22.876 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:22.876 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:22.876 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.877 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:22.877 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:22.877 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:22.877 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:22.877 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.878 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.878 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1548, 2020-05-18T21:36:22.878 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:22.878 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:22.878 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:22.878 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:22.879 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:22.879 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:22.879 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:22.879 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:22.879 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:22.879 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:22.880 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:22.880 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:22.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.880 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:22.880 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:22.881 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:22.881 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:22.881 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:22.881 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:22.881 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.881 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:22.882 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:22.882 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:22.882 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:22.882 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:22.882 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:22.883 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262165+0000", 2020-05-18T21:36:22.883 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:22.883 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:22.883 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:22.883 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:22.883 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:22.884 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:22.884 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.884 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:22.884 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:22.884 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:22.885 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:22.885 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.885 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:22.885 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.885 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.885 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.886 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.886 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.886 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262165+0000" 2020-05-18T21:36:22.886 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.886 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:22.887 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.887 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.887 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.887 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.887 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.887 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262165+0000" 2020-05-18T21:36:22.888 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.888 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:22.888 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:22.888 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:22.888 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:22.889 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:22.889 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:22.889 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:22.889 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:22.889 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:22.889 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.890 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:22.890 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:22.890 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:22.890 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:22.890 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:22.891 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:22.891 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.891 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:22.891 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:22.891 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:22.891 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.892 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.892 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.892 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.892 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.892 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.893 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.893 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.893 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.893 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.893 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.893 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.894 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.894 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.894 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.894 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:22.894 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:22.894 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:22.895 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.895 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:22.895 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.895 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.895 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.896 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.896 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.896 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.896 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.896 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.897 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:22.897 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:22.897 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:22.897 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:22.897 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:22.898 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:22.898 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:22.898 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:22.898 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:22.898 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.899 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.899 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:22.899 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.899 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:22.899 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:22.899 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:22.900 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:22.900 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:22.900 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.900 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray2", 2020-05-18T21:36:22.901 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60c", 2020-05-18T21:36:22.901 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:22.901 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:22.902 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:22.902 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:22.902 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:22.903 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:22.903 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:22.903 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.904 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.904 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:22.904 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:22.905 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.905 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.905 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.906 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.906 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.907 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.907 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.907 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.908 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.908 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.908 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.909 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.909 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.909 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.910 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.910 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:22.910 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:22.911 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:22.911 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:22.911 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.912 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:22.912 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:22.912 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:22.913 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:22.913 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.913 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.914 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1547, 2020-05-18T21:36:22.914 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:22.914 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:22.915 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:22.915 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:22.915 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:22.916 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:22.916 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:22.916 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:22.917 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:22.917 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:22.917 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:22.918 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:22.918 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.918 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:22.919 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:22.919 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:22.919 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:22.919 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:22.920 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:22.920 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.920 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:22.921 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:22.921 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:22.921 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:22.922 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:22.922 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:22.922 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261988+0000", 2020-05-18T21:36:22.923 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:22.923 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:22.923 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:22.924 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:22.924 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:22.924 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:22.925 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.925 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:22.925 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:22.926 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:22.926 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:22.926 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.927 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:22.927 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.927 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.928 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.928 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.928 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.929 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261988+0000" 2020-05-18T21:36:22.929 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.929 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:22.930 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.930 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.930 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.931 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.931 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.931 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261988+0000" 2020-05-18T21:36:22.932 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.932 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:22.932 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:22.933 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:22.933 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:22.933 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:22.934 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:22.934 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:22.934 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:22.935 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:22.935 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.936 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:22.936 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:22.936 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:22.937 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:22.937 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:22.937 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:22.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.938 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:22.938 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:22.939 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:22.939 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.939 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.940 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.940 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.940 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.941 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.941 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.941 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.942 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.942 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.948 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.948 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.949 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.949 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.949 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:22.950 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:22.950 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:22.950 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.951 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:22.951 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.951 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.951 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.951 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.952 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.952 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.952 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.952 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.952 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:22.953 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:22.953 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:22.953 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:22.953 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:22.953 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:22.954 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:22.954 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:22.954 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:22.954 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.954 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.954 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:22.955 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.955 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:22.955 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:22.955 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:22.955 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:22.956 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:22.956 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.956 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray1", 2020-05-18T21:36:22.956 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60b", 2020-05-18T21:36:22.956 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:22.957 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:22.957 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:22.957 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:22.957 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:22.958 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:22.958 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:22.958 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.958 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.958 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:22.959 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:22.959 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.959 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.959 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.959 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.960 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.960 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.960 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.960 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.960 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.961 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.961 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.961 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.961 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.961 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.962 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.962 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:22.962 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:22.962 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:22.962 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:22.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.963 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:22.963 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:22.963 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:22.963 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:22.963 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.964 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.964 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1549, 2020-05-18T21:36:22.964 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:22.964 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:22.964 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:22.964 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:22.965 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:22.965 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:22.965 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:22.965 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:22.965 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:22.966 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:22.966 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:22.966 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:22.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.966 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:22.966 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:22.967 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:22.967 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:22.967 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:22.967 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:22.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.968 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:22.968 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:22.968 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:22.968 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:22.968 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:22.968 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:22.969 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.262345+0000", 2020-05-18T21:36:22.969 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:22.969 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:22.969 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:22.969 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:22.970 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:22.970 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:22.970 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.970 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:22.970 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:22.970 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:22.971 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:22.971 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.971 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:22.971 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.971 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.972 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.972 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.972 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.972 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262345+0000" 2020-05-18T21:36:22.972 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.973 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:22.973 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:22.973 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:22.973 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:22.973 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:22.973 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:22.974 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.262345+0000" 2020-05-18T21:36:22.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.974 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:22.974 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:22.974 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:22.975 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:22.975 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:22.975 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:22.975 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:22.975 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:22.975 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:22.976 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.976 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:22.976 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:22.976 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:22.976 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:22.976 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:22.977 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:22.977 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.977 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:22.977 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:22.977 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:22.978 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.978 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.978 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.978 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.978 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.979 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.979 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.979 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.979 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.979 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.980 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.980 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.980 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.980 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.980 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:22.980 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:22.981 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:22.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.981 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:22.981 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:22.981 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:22.982 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:22.982 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:22.982 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:22.982 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:22.982 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:22.982 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:22.983 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.983 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:22.983 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:22.983 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:22.983 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:22.984 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:22.984 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:22.984 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:22.984 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:22.984 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:22.984 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.985 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.985 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:22.985 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.985 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:22.985 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:22.986 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:22.986 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:22.986 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:22.986 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.986 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray3", 2020-05-18T21:36:22.986 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60d", 2020-05-18T21:36:22.987 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:22.987 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:22.987 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:22.987 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:22.987 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:22.987 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:22.988 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:22.988 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:22.988 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:22.988 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:22.988 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:22.989 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.989 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:22.989 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:22.989 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:22.989 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.989 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:22.990 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:22.990 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:22.990 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:22.990 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:22.990 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:22.991 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.991 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:22.991 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:22.991 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:22.991 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:22.991 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:22.992 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:22.992 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:22.992 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:22.992 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.992 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:22.993 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:22.993 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:22.993 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:22.993 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.993 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:22.993 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1546, 2020-05-18T21:36:22.994 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:22.994 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:22.994 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:22.994 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:22.994 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:22.995 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:22.995 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:22.995 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:22.995 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:22.995 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:22.995 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:22.996 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:22.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.996 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:22.996 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:22.996 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:22.997 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:22.997 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:22.997 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:22.997 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:22.997 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:22.998 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:22.998 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:22.998 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:22.998 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:22.998 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:22.999 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261727+0000", 2020-05-18T21:36:22.999 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:22.999 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:22.999 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:22.999 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:22.999 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:23.000 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:23.000 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:23.000 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:23.000 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:23.000 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:36:23.001 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:23.001 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.001 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:23.001 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:23.001 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:23.002 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:23.002 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:23.002 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:23.002 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261727+0000" 2020-05-18T21:36:23.002 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.002 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:23.003 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:23.003 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:23.003 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:23.003 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:23.003 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:23.004 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.261727+0000" 2020-05-18T21:36:23.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.004 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:23.004 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:23.004 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:23.005 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:23.005 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:23.005 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:23.005 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:23.005 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:23.006 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:23.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.006 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:23.006 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:23.006 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:23.007 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:23.007 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:23.007 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:23.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.008 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:23.008 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:23.008 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:23.008 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:23.008 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:23.009 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:23.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.009 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:23.009 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:23.009 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:23.010 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:23.010 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.010 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:23.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.010 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.011 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:23.011 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:23.011 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:23.011 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:23.011 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:36:23.011 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:36:23.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.012 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:23.012 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:23.012 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:23.012 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:23.013 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:23.013 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:23.013 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:23.013 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:23.013 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:23.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.014 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:23.014 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:23.014 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:23.014 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:23.014 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:23.015 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:23.015 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:23.015 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:23.015 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:23.016 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:23.016 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:23.016 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:36:23.017 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.017 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:23.017 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:23.017 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:23.018 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:23.018 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:23.018 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:23.019 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray0", 2020-05-18T21:36:23.019 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60a", 2020-05-18T21:36:23.019 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:23.020 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:23.020 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:23.020 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:36:23.021 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:36:23.021 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:23.021 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:36:23.021 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:23.022 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:23.022 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:23.022 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:23.023 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.023 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:23.023 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:23.024 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:23.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.024 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:23.025 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:23.025 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:23.025 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:23.026 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.026 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:23.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.026 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.027 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:23.027 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:23.027 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:23.028 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:36:23.028 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:23.028 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:23.029 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:23.029 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.029 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:23.030 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:36:23.030 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:23.030 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:23.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.031 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:23.031 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 257, 2020-05-18T21:36:23.032 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:23.032 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:23.032 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:23.033 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:36:23.033 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:23.033 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:23.034 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:23.034 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:23.034 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:23.035 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:23.035 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:23.036 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:23.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.036 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:23.037 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:36:23.037 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:36:23.037 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:36:23.038 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:36:23.038 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:23.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.039 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:23.039 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:23.039 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:23.040 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:23.040 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:23.040 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:23.041 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:35:58.261635+0000", 2020-05-18T21:36:23.041 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:23.041 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:23.042 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:36:23.042 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:23.042 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:23.042 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:23.043 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:23.043 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:36:23.043 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:23.044 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 10, 2020-05-18T21:36:23.044 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:36:23.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.045 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:23.045 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:23.045 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:23.046 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:23.046 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:36:23.046 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:23.047 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:23.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.047 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:23.048 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:23.048 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:23.048 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:23.049 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:36:23.049 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:23.049 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:58.263460+0000" 2020-05-18T21:36:23.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.050 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:23.050 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:23.051 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:23.051 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:36:23.051 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:23.052 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:23.052 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:23.052 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:23.053 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:23.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.053 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:23.054 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:23.054 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:23.054 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:23.055 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:23.055 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:23.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.055 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:23.056 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:23.056 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:23.056 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:23.057 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:23.057 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:23.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.058 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:23.058 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:23.058 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:23.059 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:23.059 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.059 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:23.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.060 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.060 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:23.060 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:23.061 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:23.061 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:23.061 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:36:23.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.061 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:23.062 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:23.062 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:23.062 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:23.062 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:23.062 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:23.063 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:23.063 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:23.063 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:23.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.063 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:23.064 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:23.064 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:23.064 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:23.064 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:23.064 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:23.064 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:36:23.065 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:23.065 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:23.065 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:23.065 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:23.065 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.066 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:23.066 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:23.066 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:23.066 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:23.066 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:23.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:23.067 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1", 2020-05-18T21:36:23.067 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x101", 2020-05-18T21:36:23.067 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:23.067 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:36:23.067 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:36:23.068 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "0", 2020-05-18T21:36:23.068 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "0", 2020-05-18T21:36:23.068 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:36:23.068 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "1", 2020-05-18T21:36:23.068 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:23.069 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:36:23.069 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:36:23.069 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:36:23.069 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.069 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:23.069 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:23.070 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:23.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.070 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:23.070 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:23.070 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:23.071 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:23.071 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.071 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:23.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.071 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.071 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:23.072 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:23.072 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:23.072 INFO:teuthology.orchestra.run.smithi155.stdout: "child": 1, 2020-05-18T21:36:23.072 INFO:teuthology.orchestra.run.smithi155.stdout: "subtree": 1, 2020-05-18T21:36:23.072 INFO:teuthology.orchestra.run.smithi155.stdout: "subtreetemp": 0, 2020-05-18T21:36:23.073 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:36:23.073 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:36:23.073 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:36:23.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.073 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:36:23.074 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [ 2020-05-18T21:36:23.074 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:23.074 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray6", 2020-05-18T21:36:23.074 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:23.074 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:23.075 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:23.075 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:23.075 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:23.075 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:23.075 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:23.075 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1552, 2020-05-18T21:36:23.076 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:23.076 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:23.076 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:23.076 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.076 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:23.076 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:23.077 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:23.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.077 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:23.077 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:23.077 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:23.078 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:23.078 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.078 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:23.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.078 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.079 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:23.079 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:23.079 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:23.079 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:23.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.079 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:23.080 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:23.080 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:23.080 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:23.080 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:23.080 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:23.081 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:23.081 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:23.081 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:23.081 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:23.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.082 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:23.082 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:23.082 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:23.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.082 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:23.083 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray7", 2020-05-18T21:36:23.083 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:23.083 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:23.083 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:23.083 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:23.083 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:23.084 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:23.084 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:23.084 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1553, 2020-05-18T21:36:23.084 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:23.084 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:23.085 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:23.085 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.085 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:23.085 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:23.085 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:23.085 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.086 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:23.086 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:23.086 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:23.086 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:23.086 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.087 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:23.087 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.087 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.087 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:23.087 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:23.087 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:23.088 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:23.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.088 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:23.088 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:23.088 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:23.089 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:23.089 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:23.089 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:23.089 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:23.089 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:23.089 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:23.090 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:23.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.090 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:23.090 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:23.090 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:23.091 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.091 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:23.091 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray0", 2020-05-18T21:36:23.091 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:23.091 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:23.091 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:23.092 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:23.092 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:23.092 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:23.092 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:23.092 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1546, 2020-05-18T21:36:23.093 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:23.093 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:23.093 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:23.093 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.093 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:23.093 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:23.094 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:23.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.094 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:23.094 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:23.094 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:23.095 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:23.095 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.095 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:23.095 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.095 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.095 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:23.096 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:23.096 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:23.096 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:23.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.096 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:23.096 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:23.097 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:23.097 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:23.097 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:23.097 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:23.097 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:23.098 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:23.098 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:23.098 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:23.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.098 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:23.099 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:23.099 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:23.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.099 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:23.099 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray9", 2020-05-18T21:36:23.099 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:23.100 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:23.100 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:23.100 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:23.100 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:23.100 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:23.101 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:23.101 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1555, 2020-05-18T21:36:23.101 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:23.101 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:23.101 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:23.101 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.102 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:23.102 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:23.102 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:23.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.102 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:23.103 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:23.103 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:23.103 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:23.103 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.103 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:23.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.104 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.104 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:23.104 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:23.104 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:23.104 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:23.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.105 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:23.105 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:23.105 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:23.106 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:23.106 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:23.106 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:23.106 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:23.106 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:23.107 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:23.107 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:23.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.107 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:23.107 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:23.107 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:23.108 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.108 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:23.108 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray5", 2020-05-18T21:36:23.109 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:23.109 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:23.109 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:23.109 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:23.109 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:23.109 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:23.110 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:23.110 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1551, 2020-05-18T21:36:23.110 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:23.110 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:23.110 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:23.111 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.111 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:23.111 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:23.111 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:23.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.111 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:23.112 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:23.112 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:23.112 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:23.112 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.112 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:23.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.113 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.113 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:23.113 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:23.113 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:23.113 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:23.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.114 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:23.114 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:23.114 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:23.114 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:23.115 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:23.115 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:23.115 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:23.115 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:23.115 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:23.115 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:23.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.116 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:23.116 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:23.116 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:23.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.117 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:23.117 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray2", 2020-05-18T21:36:23.117 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:23.117 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:23.117 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:23.117 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:23.118 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:23.118 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:23.118 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:23.118 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1548, 2020-05-18T21:36:23.118 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:23.118 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:23.119 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:23.119 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.119 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:23.119 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:23.119 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:23.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.120 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:23.120 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:23.120 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:23.120 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:23.120 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.121 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:23.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.121 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.121 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:23.121 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:23.122 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:23.122 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:23.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.122 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:23.122 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:23.122 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:23.123 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:23.123 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:23.123 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:23.123 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:23.123 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:23.124 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:23.124 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:23.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.124 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:23.124 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:23.124 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:23.125 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.125 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:23.125 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray1", 2020-05-18T21:36:23.125 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:23.125 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:23.126 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:23.126 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:23.126 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:23.126 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:23.126 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:23.126 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1547, 2020-05-18T21:36:23.127 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:23.127 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:23.127 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:23.127 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.127 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:23.127 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:23.128 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:23.128 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.128 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:23.128 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:23.128 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:23.129 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:23.129 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.129 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:23.129 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.129 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.129 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:23.130 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:23.130 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:23.130 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:23.130 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.130 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:23.131 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:23.131 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:23.131 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:23.131 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:23.131 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:23.131 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:23.132 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:23.132 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:23.132 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:23.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.132 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:23.133 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:23.133 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:23.133 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.133 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:23.133 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray8", 2020-05-18T21:36:23.133 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:23.134 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:23.134 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:23.134 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:23.134 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:23.134 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:23.135 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:23.135 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1554, 2020-05-18T21:36:23.135 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:23.135 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:23.135 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:23.135 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.136 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:23.136 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:23.136 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:23.136 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.137 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:23.137 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:23.137 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:23.137 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:23.137 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.138 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:23.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.138 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.138 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:23.138 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:23.139 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:23.139 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:23.139 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.139 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:23.139 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:23.139 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:23.140 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:23.140 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:23.140 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:23.140 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:23.140 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:23.141 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:23.141 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:23.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.141 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:23.141 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:23.141 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:23.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.142 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:23.142 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray3", 2020-05-18T21:36:23.143 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:23.143 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:23.143 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:23.143 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:23.143 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:23.144 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:23.144 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:23.144 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1549, 2020-05-18T21:36:23.144 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:23.144 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:23.145 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:23.145 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.145 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:23.145 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:23.145 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:23.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.146 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:23.146 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:23.146 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:23.146 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:23.147 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.147 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:23.147 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.147 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.147 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:23.147 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:23.148 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:23.148 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:23.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.148 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:23.148 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:23.149 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:23.149 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:23.149 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:23.149 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:23.149 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:23.149 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:23.150 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:23.150 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:23.150 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.150 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:23.150 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:23.151 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:23.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.151 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:23.151 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray4", 2020-05-18T21:36:23.151 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:36:23.151 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:23.152 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:23.152 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:23.152 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:23.152 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:23.152 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:23.153 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1550, 2020-05-18T21:36:23.153 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:23.153 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:23.153 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:23.153 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.153 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:36:23.154 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:23.154 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:23.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.154 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:23.154 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:23.155 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:36:23.155 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:23.155 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.155 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:36:23.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.155 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.156 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:23.156 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:23.156 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:23.156 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:23.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.157 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:23.157 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:23.157 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:23.157 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:23.157 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:23.158 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:23.158 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:23.158 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:23.158 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:23.158 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:23.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.159 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:36:23.159 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:36:23.159 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:23.159 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:23.160 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:23.160 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:23.160 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:23.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:23.161 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1, 2020-05-18T21:36:23.161 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:36:23.161 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:23.161 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:35:50.165450+0000", 2020-05-18T21:36:23.162 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 17407, 2020-05-18T21:36:23.162 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:36:23.162 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:36:23.162 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:36:23.162 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:36:23.162 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:36:23.163 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:36:23.163 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:36:23.163 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:36:23.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.163 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:36:23.164 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:36:23.164 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:36:23.164 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:36:23.164 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 26, 2020-05-18T21:36:23.164 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:36:23.165 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.165 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:36:23.165 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:36:23.165 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:36:23.165 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:36:23.165 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:36:23.166 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:36:23.166 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:23.166 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:36:23.166 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:36:23.166 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:36:23.167 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:36:23.167 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:36:23.167 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:36:23.167 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:23.167 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:36:12.141787+0000", 2020-05-18T21:36:23.167 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:36:23.168 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 1, 2020-05-18T21:36:23.168 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1 2020-05-18T21:36:23.168 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.168 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:36:23.168 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:36:23.169 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 35, 2020-05-18T21:36:23.169 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 5, 2020-05-18T21:36:23.169 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 2, 2020-05-18T21:36:23.169 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:23.169 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:36:12.625070+0000" 2020-05-18T21:36:23.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.170 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:36:23.170 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:23.170 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:36:23.170 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:36:23.170 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:36:23.171 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:36:23.171 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:35:50.165450+0000" 2020-05-18T21:36:23.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.172 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 7, 2020-05-18T21:36:23.172 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:36:23.172 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:36:23.173 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 3, 2020-05-18T21:36:23.173 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:36:23.173 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:36:23.174 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:36:23.174 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:36:23.174 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:36:23.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.175 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:36:23.175 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:36:23.176 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:36:23.176 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:36:23.176 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:36:23.176 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:36:23.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.177 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:36:23.178 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:36:23.178 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:36:23.178 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:36:23.178 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:23.179 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:23.179 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.179 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:23.180 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:23.180 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:36:23.180 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:23.181 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.181 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:36:23.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.182 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.182 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:23.182 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:23.183 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:23.183 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": 0, 2020-05-18T21:36:23.183 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:36:23.184 INFO:teuthology.orchestra.run.smithi155.stdout: "dirwaiter": 0, 2020-05-18T21:36:23.184 INFO:teuthology.orchestra.run.smithi155.stdout: "discoverbase": 0 2020-05-18T21:36:23.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.185 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:23.185 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:23.185 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:23.186 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:23.186 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:23.186 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:23.187 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:23.187 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:23.187 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:23.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.188 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:36:23.188 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:36:23.189 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:36:23.189 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:36:23.189 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:36:23.190 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:36:23.190 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:36:23.190 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:23.191 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:36:23.191 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:23.191 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:23.192 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:23.192 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:23.192 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:23.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.193 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:36:23.193 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:36:23.194 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [], 2020-05-18T21:36:23.194 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:36:23.194 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:36:23.194 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:36:23.195 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:36:23.195 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:36:23.196 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:23.196 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "", 2020-05-18T21:36:23.196 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x1", 2020-05-18T21:36:23.197 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:36:23.197 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "0", 2020-05-18T21:36:23.197 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "26", 2020-05-18T21:36:23.197 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "0", 2020-05-18T21:36:23.198 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "0", 2020-05-18T21:36:23.198 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": true, 2020-05-18T21:36:23.198 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "0", 2020-05-18T21:36:23.199 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [], 2020-05-18T21:36:23.199 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:36:23.199 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:23.200 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:23.200 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.200 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:23.201 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:23.201 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:36:23.202 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:23.202 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.203 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:36:23.203 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.203 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.204 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:23.204 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:23.204 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:23.204 INFO:teuthology.orchestra.run.smithi155.stdout: "child": 1, 2020-05-18T21:36:23.205 INFO:teuthology.orchestra.run.smithi155.stdout: "subtree": 1 2020-05-18T21:36:23.205 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.205 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:36:23.206 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [ 2020-05-18T21:36:23.206 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:36:23.206 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "delete_me", 2020-05-18T21:36:23.206 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 1, 2020-05-18T21:36:23.207 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:36:23.207 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:36:23.207 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:36:23.207 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:36:23.207 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:36:23.208 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:36:23.208 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1099511627776, 2020-05-18T21:36:23.208 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:36:23.208 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:36:23.208 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:36:23.209 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.209 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:36:23.209 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:36:23.209 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:36:23.210 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.210 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:36:23.210 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:36:23.210 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:36:23.210 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:36:23.210 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:36:23.211 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:36:23.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.211 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:36:23.211 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:36:23.211 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:36:23.212 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:36:23.212 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:36:23.212 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.212 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:36:23.212 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:36:23.212 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:36:23.213 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:36:23.213 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:36:23.213 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:36:23.213 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:36:23.213 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:36:23.214 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:36:23.214 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:36:23.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:36:23.214 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [] 2020-05-18T21:36:23.214 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:23.214 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:23.215 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:23.215 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:36:23.215 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:23.215 INFO:teuthology.orchestra.run.smithi155.stdout:] 2020-05-18T21:36:23.216 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "ino": 1099511628280, "rdev": 0, "ctime": "2020-05-18T21:36:12.167540+0000", "btime": "2020-05-18T21:36:12.165473+0000", "mode": 33188, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 26, "pool_ns": "" }, "old_pools": [], "size": 7, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:12.167540+0000", "atime": "2020-05-18T21:36:12.165473+0000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:36:12.167540+0000" }, "accounted_rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:36:12.167540+0000" }, "version": 18, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 8, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "importingcaps": 0, "caps": 1, "dirtyparent": 1, "replicated": 0, "dirty": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 9648, "pending": "pAsLsXsFsc", "issued": "pAsLsXsFsc", "wanted": "-", "last_sent": 1 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1099511627777, "rdev": 0, "ctime": "2020-05-18T21:36:12.158901+0000", "btime": "2020-05-18T21:36:12.151650+0000", "mode": 33188, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 26, "pool_ns": "" }, "old_pools": [], "size": 7, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:12.158901+0000", "atime": "2020-05-18T21:36:12.151650+0000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:36:12.158901+0000" }, "accounted_rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:36:12.158901+0000" }, "version": 12, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 2, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "importingcaps": 0, "caps": 1, "dirtyparent": 1, "replicated": 0, "dirty": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 9648, "pending": "pAsLsXsFsc", "issued": "pAsLsXsFsc", "wanted": "-", "last_sent": 1 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1099511628281, "rdev": 0, "ctime": "2020-05-18T21:36:12.169874+0000", "btime": "2020-05-18T21:36:12.168220+0000", "mode": 33188, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 26, "pool_ns": "" }, "old_pools": [], "size": 7, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:12.169874+0000", "atime": "2020-05-18T21:36:12.168220+0000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:36:12.169874+0000" }, "accounted_rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:36:12.169874+0000" }, "version": 20, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 10, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "importingcaps": 0, "caps": 1, "dirtyparent": 1, "replicated": 0, "dirty": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 9648, "pending": "pAsLsXsFsc", "issued": "pAsLsXsFsc", "wanted": "-", "last_sent": 1 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1099511628278, "rdev": 0, "ctime": "2020-05-18T21:36:12.161470+0000", "btime": "2020-05-18T21:36:12.159980+0000", "mode": 33188, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 26, "pool_ns": "" }, "old_pools": [], "size": 7, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:12.161470+0000", "atime": "2020-05-18T21:36:12.159980+0000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:36:12.161470+0000" }, "accounted_rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:36:12.161470+0000" }, "version": 14, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 4, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "importingcaps": 0, "caps": 1, "dirtyparent": 1, "replicated": 0, "dirty": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 9648, "pending": "pAsLsXsFsc", "issued": "pAsLsXsFsc", "wanted": "-", "last_sent": 1 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1099511627776, "rdev": 0, "ctime": "2020-05-18T21:36:12.625070+0000", "btime": "2020-05-18T21:36:12.141787+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:12.168220+0000", "atime": "2020-05-18T21:36:12.141787+0000", "time_warp_seq": 0, "change_attr": 6, "export_pin": 1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:36:12.168220+0000", "num_files": 5, "num_subdirs": 0, "change_attr": 5 }, "rstat": { "version": 0, "rbytes": 35, "rfiles": 5, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:36:12.625070+0000" }, "accounted_rstat": { "version": 0, "rbytes": 35, "rfiles": 5, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:36:12.625070+0000" }, "version": 24, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 2, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "importing": 0, "dirfrag": 1 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "/delete_me", "dirfrag": "0x10000000000", "snapid_first": 2, "projected_version": "21", "version": "21", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1 }, "nref": 4, "dentries": [ { "path": "delete_me/file_1", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511628278, "remote_type": "", "version": 14, "projected_version": 14, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "replicated": 0, "dirty": 1 }, "nref": 2, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth", "dirty" ] }, { "path": "delete_me/file_4", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511628281, "remote_type": "", "version": 20, "projected_version": 20, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "replicated": 0, "dirty": 1 }, "nref": 2, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth", "dirty" ] }, { "path": "delete_me/file_2", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511628279, "remote_type": "", "version": 16, "projected_version": 16, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "replicated": 0, "dirty": 1 }, "nref": 2, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth", "dirty" ] }, { "path": "delete_me/file_0", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511627777, "remote_type": "", "version": 12, "projected_version": 12, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "replicated": 0, "dirty": 1 }, "nref": 2, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth", "dirty" ] }, { "path": "delete_me/file_3", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511628280, "remote_type": "", "version": 18, "projected_version": 18, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "replicated": 0, "dirty": 1 }, "nref": 2, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth", "dirty" ] } ] } ] }, { "ino": 3, "rdev": 0, "ctime": "2020-05-18T21:36:06.317019+0000", "btime": "2020-05-18T21:36:06.317019+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:06.317019+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:36:06.317019+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:36:06.317019+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ -2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "openingsnapparents": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1555, "rdev": 0, "ctime": "2020-05-18T21:35:58.263460+0000", "btime": "2020-05-18T21:35:58.263460+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263460+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray9", "dirfrag": "0x613", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1550, "rdev": 0, "ctime": "2020-05-18T21:35:58.262533+0000", "btime": "2020-05-18T21:35:58.262533+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262533+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262533+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262533+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray4", "dirfrag": "0x60e", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1554, "rdev": 0, "ctime": "2020-05-18T21:35:58.263263+0000", "btime": "2020-05-18T21:35:58.263263+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263263+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263263+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263263+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray8", "dirfrag": "0x612", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1099511628279, "rdev": 0, "ctime": "2020-05-18T21:36:12.164748+0000", "btime": "2020-05-18T21:36:12.162343+0000", "mode": 33188, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 26, "pool_ns": "" }, "old_pools": [], "size": 7, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:12.164748+0000", "atime": "2020-05-18T21:36:12.162343+0000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:36:12.164748+0000" }, "accounted_rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:36:12.164748+0000" }, "version": 16, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 6, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "importingcaps": 0, "caps": 1, "dirtyparent": 1, "replicated": 0, "dirty": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 9648, "pending": "pAsLsXsFsc", "issued": "pAsLsXsFsc", "wanted": "-", "last_sent": 1 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1553, "rdev": 0, "ctime": "2020-05-18T21:35:58.263085+0000", "btime": "2020-05-18T21:35:58.263085+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.263085+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263085+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263085+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray7", "dirfrag": "0x611", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1552, "rdev": 0, "ctime": "2020-05-18T21:35:58.262910+0000", "btime": "2020-05-18T21:35:58.262910+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262910+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262910+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262910+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray6", "dirfrag": "0x610", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1551, "rdev": 0, "ctime": "2020-05-18T21:35:58.262725+0000", "btime": "2020-05-18T21:35:58.262725+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262725+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262725+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262725+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray5", "dirfrag": "0x60f", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1548, "rdev": 0, "ctime": "2020-05-18T21:35:58.262165+0000", "btime": "2020-05-18T21:35:58.262165+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262165+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262165+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262165+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray2", "dirfrag": "0x60c", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1547, "rdev": 0, "ctime": "2020-05-18T21:35:58.261988+0000", "btime": "2020-05-18T21:35:58.261988+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261988+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261988+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261988+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray1", "dirfrag": "0x60b", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1549, "rdev": 0, "ctime": "2020-05-18T21:35:58.262345+0000", "btime": "2020-05-18T21:35:58.262345+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.262345+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262345+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.262345+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray3", "dirfrag": "0x60d", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1546, "rdev": 0, "ctime": "2020-05-18T21:35:58.261727+0000", "btime": "2020-05-18T21:35:58.261727+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261727+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261727+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.261727+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray0", "dirfrag": "0x60a", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 257, "rdev": 0, "ctime": "2020-05-18T21:35:58.261635+0000", "btime": "2020-05-18T21:35:58.261635+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:35:58.261635+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 10, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:35:58.263460+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "openingsnapparents": 0 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "subtreetemp": 0, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 3, "dentries": [ { "path": "stray6", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1552, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray7", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1553, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray0", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1546, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray9", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1555, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray5", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1551, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray2", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1548, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray1", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1547, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray8", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1554, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray3", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1549, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray4", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1550, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] } ] } ] }, { "ino": 1, "rdev": 0, "ctime": "2020-05-18T21:36:12.141787+0000", "btime": "2020-05-18T21:35:50.165450+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 26, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:12.141787+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:36:12.141787+0000", "num_files": 0, "num_subdirs": 1, "change_attr": 1 }, "rstat": { "version": 1, "rbytes": 35, "rfiles": 5, "rsubdirs": 2, "rsnaps": 0, "rctime": "2020-05-18T21:36:12.625070+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:35:50.165450+0000" }, "version": 7, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 3, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "dirfrag": 1, "dirwaiter": 0, "discoverbase": 0 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "0", "version": "26", "committing_version": "0", "committed_version": "0", "is_rep": true, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1 }, "nref": 2, "dentries": [ { "path": "delete_me", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511627776, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [] } ] } ] } ] 2020-05-18T21:36:23.220 DEBUG:tasks.cephfs.test_strays:Found ino in cache: { "ino": 1099511627777, "rdev": 0, "ctime": "2020-05-18T21:36:12.158901+0000", "btime": "2020-05-18T21:36:12.151650+0000", "mode": 33188, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 26, "pool_ns": "" }, "old_pools": [], "size": 7, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:36:12.158901+0000", "atime": "2020-05-18T21:36:12.151650+0000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:36:12.158901+0000" }, "accounted_rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:36:12.158901+0000" }, "version": 12, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 2, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "importingcaps": 0, "caps": 1, "dirtyparent": 1, "replicated": 0, "dirty": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 9648, "pending": "pAsLsXsFsc", "issued": "pAsLsXsFsc", "wanted": "-", "last_sent": 1 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] } 2020-05-18T21:36:23.220 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rm -rf delete_me/*) 2020-05-18T21:36:23.339 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:36:23.339 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:36:23.340 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:36:23.356 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[36341]: fuse finished with error 0 and tester_r 0 2020-05-18T21:36:23.358 INFO:teuthology.orchestra.run:waiting for 900 2020-05-18T21:36:29.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:36:29.462 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:36:29.471 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:36:29.471 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:36:29.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:36:29.472 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 down' 2020-05-18T21:36:29.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:36:29.536 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.0' 2020-05-18T21:36:29.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:36:29.627 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:36:29.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:36:29.647 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:36:29.696 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:36:29.697 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:36:29.697 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:36:29.697 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:36:29.698 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:36:29.698 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:36:29.698 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:36:29.699 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:36:29.699 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:36:29.699 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:36:29.700 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:36:29.700 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:36:29.700 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:36:29.701 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:36:29.701 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:36:29.701 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42253sec preferred_lft 42253sec 2020-05-18T21:36:29.702 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:36:29.702 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:36:29.702 INFO:teuthology.orchestra.run.smithi063.stdout:35: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-05-18T21:36:29.703 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:36:29.703 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:36:29.703 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:36:29.704 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::c4e:b1ff:fe0f:166b/64 scope link 2020-05-18T21:36:29.704 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:36:29.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:36:29.705 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:36:29.725 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:36:29.725 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:36:29.726 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:36:29.726 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:36:29.726 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:36:29.727 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:36:29.727 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:36:29.727 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:36:29.728 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:36:29.728 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:36:29.728 INFO:teuthology.orchestra.run.smithi063.stdout:35: ceph-brx: mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:36:29.729 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:36:29.730 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:36:29.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:36:29.732 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:36:29.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:36:29.797 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:36:29.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:36:29.911 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:36:29.921 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:36:29.921 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:36:29.921 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:36:29.921 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:36:29.922 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:36:29.922 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:36:29.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:36:29.923 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:36:29.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:36:29.983 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:36:30.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:36:30.002 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:36:30.020 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump mds_cache strays_created 2020-05-18T21:36:30.122 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:36:30.122 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:36:30.123 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 5 2020-05-18T21:36:30.123 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:30.123 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:36:30.131 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_created": 5 } } 2020-05-18T21:36:30.132 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump mds_cache strays_enqueued 2020-05-18T21:36:30.230 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:36:30.230 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:36:30.230 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 5 2020-05-18T21:36:30.230 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:30.231 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:36:30.238 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_enqueued": 5 } } 2020-05-18T21:36:30.238 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump mds_cache num_strays 2020-05-18T21:36:30.333 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:36:30.334 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:36:30.334 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 0 2020-05-18T21:36:30.334 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:30.334 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:36:30.342 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "num_strays": 0 } } 2020-05-18T21:36:30.377 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:36:30.379 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:36:40.343 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump purge_queue pq_executed 2020-05-18T21:36:40.450 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:36:40.450 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2020-05-18T21:36:40.450 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 0 2020-05-18T21:36:40.450 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:40.451 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:36:40.458 INFO:tasks.cephfs.filesystem:_json_asok output: { "purge_queue": { "pq_executed": 0 } } 2020-05-18T21:36:40.459 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs max_mds 1 2020-05-18T21:36:40.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.569+0000 7f10d96c0700 1 Processor -- start 2020-05-18T21:36:40.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.569+0000 7f10d96c0700 1 -- start start 2020-05-18T21:36:40.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d96c0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10d40661e0 0x7f10d409b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:40.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d96c0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f10d4149f50 0x7f10d40b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:40.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d96c0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d40b50b0 con 0x7f10d405a770 2020-05-18T21:36:40.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d96c0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d406aa90 con 0x7f10d4149f50 2020-05-18T21:36:40.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d96c0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d40b5350 con 0x7f10d40661e0 2020-05-18T21:36:40.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d27fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f10d405a770 0x7f10d41455b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37086/0 (socket says 172.21.15.63:37086) 2020-05-18T21:36:40.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d27fc700 1 -- 172.21.15.63:0/1698248710 learned_addr learned my addr 172.21.15.63:0/1698248710 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:40.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d2ffd700 1 --2- 172.21.15.63:0/1698248710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10d40661e0 0x7f10d409b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:40.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d37fe700 1 --2- 172.21.15.63:0/1698248710 >> v2:172.21.15.155:3300/0 conn(0x7f10d4149f50 0x7f10d40b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:40.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d1ffb700 1 -- 172.21.15.63:0/1698248710 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455089331 0 0) 0x7f10d40b50b0 con 0x7f10d405a770 2020-05-18T21:36:40.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d1ffb700 1 -- 172.21.15.63:0/1698248710 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10b8003270 con 0x7f10d405a770 2020-05-18T21:36:40.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d37fe700 1 -- 172.21.15.63:0/1698248710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10d40661e0 msgr2=0x7f10d409b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:40.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d37fe700 1 --2- 172.21.15.63:0/1698248710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10d40661e0 0x7f10d409b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:40.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d37fe700 1 -- 172.21.15.63:0/1698248710 >> v1:172.21.15.63:6789/0 conn(0x7f10d405a770 legacy=0x7f10d41455b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:40.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d37fe700 1 -- 172.21.15.63:0/1698248710 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d40665c0 con 0x7f10d4149f50 2020-05-18T21:36:40.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d37fe700 1 --2- 172.21.15.63:0/1698248710 >> v2:172.21.15.155:3300/0 conn(0x7f10d4149f50 0x7f10d40b3e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f10cc0032f0 tx=0x7f10cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:40.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d37fe700 1 --2- 172.21.15.63:0/1698248710 >> v2:172.21.15.155:3300/0 conn(0x7f10d4149f50 0x7f10d40b3e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f10cc0032f0 tx=0x7f10cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:40.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d37fe700 1 --2- 172.21.15.63:0/1698248710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10d4149f50 0x7f10d40b3e00 secure :-1 s=READY pgs=1229 cs=0 l=1 rx=0x7f10cc0032f0 tx=0x7f10cc007e00).ready entity=mon.1 client_cookie=b861e55864ab5f67 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:40.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d37fe700 1 --2- 172.21.15.63:0/1698248710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10d4149f50 0x7f10d40b3e00 secure :-1 s=THROTTLE_DONE pgs=1229 cs=0 l=1 rx=0x7f10cc0032f0 tx=0x7f10cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:40.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d1ffb700 1 -- 172.21.15.63:0/1698248710 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10cc011db0 con 0x7f10d4149f50 2020-05-18T21:36:40.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d37fe700 1 --2- 172.21.15.63:0/1698248710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10d4149f50 0x7f10d40b3e00 secure :-1 s=THROTTLE_DONE pgs=1229 cs=0 l=1 rx=0x7f10cc0032f0 tx=0x7f10cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:40.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d1ffb700 1 -- 172.21.15.63:0/1698248710 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc00a180 con 0x7f10d4149f50 2020-05-18T21:36:40.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d37fe700 1 --2- 172.21.15.63:0/1698248710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10d4149f50 0x7f10d40b3e00 secure :-1 s=THROTTLE_DONE pgs=1229 cs=0 l=1 rx=0x7f10cc0032f0 tx=0x7f10cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:40.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d1ffb700 1 -- 172.21.15.63:0/1698248710 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10cc00a5a0 con 0x7f10d4149f50 2020-05-18T21:36:40.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d96c0700 1 -- 172.21.15.63:0/1698248710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10d4149f50 msgr2=0x7f10d40b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:40.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.573+0000 7f10d96c0700 1 --2- 172.21.15.63:0/1698248710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10d4149f50 0x7f10d40b3e00 secure :-1 s=READY pgs=1229 cs=0 l=1 rx=0x7f10cc0032f0 tx=0x7f10cc007e00).stop 2020-05-18T21:36:40.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.577+0000 7f10d96c0700 1 -- 172.21.15.63:0/1698248710 shutdown_connections 2020-05-18T21:36:40.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.577+0000 7f10d96c0700 1 --2- 172.21.15.63:0/1698248710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10d4149f50 0x7f10d40b3e00 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:40.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.577+0000 7f10d96c0700 1 --2- 172.21.15.63:0/1698248710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10d40661e0 0x7f10d409b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:40.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.577+0000 7f10d96c0700 1 -- 172.21.15.63:0/1698248710 >> 172.21.15.63:0/1698248710 conn(0x7f10d40b57b0 msgr2=0x7f10d40b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:40.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.577+0000 7f10d96c0700 1 -- 172.21.15.63:0/1698248710 shutdown_connections 2020-05-18T21:36:40.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.577+0000 7f10d96c0700 1 -- 172.21.15.63:0/1698248710 wait complete. 2020-05-18T21:36:40.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.577+0000 7f10d96c0700 1 Processor -- start 2020-05-18T21:36:40.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.577+0000 7f10d96c0700 1 -- start start 2020-05-18T21:36:40.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d96c0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f10d405a770 0x7f10d4097930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:40.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d96c0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f10d4149f50 0x7f10d4149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:40.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d96c0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d4062a20 con 0x7f10d40661e0 2020-05-18T21:36:40.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d96c0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d4062cc0 con 0x7f10d4149f50 2020-05-18T21:36:40.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d96c0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d4062f60 con 0x7f10d405a770 2020-05-18T21:36:40.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d27fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f10d40661e0 0x7f10d41493c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37092/0 (socket says 172.21.15.63:37092) 2020-05-18T21:36:40.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d27fc700 1 -- 172.21.15.63:0/2524665328 learned_addr learned my addr 172.21.15.63:0/2524665328 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:40.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d37fe700 1 --2- 172.21.15.63:0/2524665328 >> v2:172.21.15.63:3300/0 conn(0x7f10d4149f50 0x7f10d4149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:40.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d2ffd700 1 --2- 172.21.15.63:0/2524665328 >> v2:172.21.15.155:3300/0 conn(0x7f10d405a770 0x7f10d4097930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:40.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10c3fff700 1 -- 172.21.15.63:0/2524665328 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408873839 0 0) 0x7f10d4062a20 con 0x7f10d40661e0 2020-05-18T21:36:40.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10c3fff700 1 -- 172.21.15.63:0/2524665328 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10b0002fe0 con 0x7f10d40661e0 2020-05-18T21:36:40.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d37fe700 1 -- 172.21.15.63:0/2524665328 >> v2:172.21.15.155:3300/0 conn(0x7f10d405a770 msgr2=0x7f10d4097930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:40.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d37fe700 1 --2- 172.21.15.63:0/2524665328 >> v2:172.21.15.155:3300/0 conn(0x7f10d405a770 0x7f10d4097930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:40.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d37fe700 1 -- 172.21.15.63:0/2524665328 >> v1:172.21.15.63:6789/0 conn(0x7f10d40661e0 legacy=0x7f10d41493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:40.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d37fe700 1 -- 172.21.15.63:0/2524665328 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d4062630 con 0x7f10d4149f50 2020-05-18T21:36:40.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d37fe700 1 --2- 172.21.15.63:0/2524665328 >> v2:172.21.15.63:3300/0 conn(0x7f10d4149f50 0x7f10d4149ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f10cc0032f0 tx=0x7f10cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:40.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d37fe700 1 --2- 172.21.15.63:0/2524665328 >> v2:172.21.15.63:3300/0 conn(0x7f10d4149f50 0x7f10d4149ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f10cc0032f0 tx=0x7f10cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:40.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d37fe700 1 --2- 172.21.15.63:0/2524665328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10d4149f50 0x7f10d4149ad0 secure :-1 s=READY pgs=1852 cs=0 l=1 rx=0x7f10cc0032f0 tx=0x7f10cc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:40.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d37fe700 1 --2- 172.21.15.63:0/2524665328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10d4149f50 0x7f10d4149ad0 secure :-1 s=THROTTLE_DONE pgs=1852 cs=0 l=1 rx=0x7f10cc0032f0 tx=0x7f10cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:40.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10c3fff700 1 -- 172.21.15.63:0/2524665328 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10cc010480 con 0x7f10d4149f50 2020-05-18T21:36:40.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d37fe700 1 --2- 172.21.15.63:0/2524665328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10d4149f50 0x7f10d4149ad0 secure :-1 s=THROTTLE_DONE pgs=1852 cs=0 l=1 rx=0x7f10cc0032f0 tx=0x7f10cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:40.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d37fe700 1 --2- 172.21.15.63:0/2524665328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10d4149f50 0x7f10d4149ad0 secure :-1 s=THROTTLE_DONE pgs=1852 cs=0 l=1 rx=0x7f10cc0032f0 tx=0x7f10cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:40.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10c3fff700 1 -- 172.21.15.63:0/2524665328 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc011e90 con 0x7f10d4149f50 2020-05-18T21:36:40.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d96c0700 1 -- 172.21.15.63:0/2524665328 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d4098820 con 0x7f10d4149f50 2020-05-18T21:36:40.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10c3fff700 1 -- 172.21.15.63:0/2524665328 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10cc005e60 con 0x7f10d4149f50 2020-05-18T21:36:40.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d96c0700 1 -- 172.21.15.63:0/2524665328 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d40635a0 con 0x7f10d4149f50 2020-05-18T21:36:40.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.581+0000 7f10d37fe700 1 --2- 172.21.15.63:0/2524665328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10d4149f50 0x7f10d4149ad0 secure :-1 s=THROTTLE_DONE pgs=1852 cs=0 l=1 rx=0x7f10cc0032f0 tx=0x7f10cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:40.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.585+0000 7f10d96c0700 1 -- 172.21.15.63:0/2524665328 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d4062880 con 0x7f10d4149f50 2020-05-18T21:36:40.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.585+0000 7f10c3fff700 1 -- 172.21.15.63:0/2524665328 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f10cc007170 con 0x7f10d4149f50 2020-05-18T21:36:40.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.585+0000 7f10d37fe700 1 --2- 172.21.15.63:0/2524665328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10d4149f50 0x7f10d4149ad0 secure :-1 s=THROTTLE_DONE pgs=1852 cs=0 l=1 rx=0x7f10cc0032f0 tx=0x7f10cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:40.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.585+0000 7f10c3fff700 1 --2- 172.21.15.63:0/2524665328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f10b004fd90 0x7f10b0052250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:40.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.585+0000 7f10c3fff700 1 -- 172.21.15.63:0/2524665328 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f10cc0648f0 con 0x7f10d4149f50 2020-05-18T21:36:40.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.585+0000 7f10d2ffd700 1 --2- 172.21.15.63:0/2524665328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f10b004fd90 0x7f10b0052250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:40.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.585+0000 7f10d2ffd700 1 --2- 172.21.15.63:0/2524665328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f10b004fd90 0x7f10b0052250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f10c8002f70 tx=0x7f10c800d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:40.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.585+0000 7f10d2ffd700 1 --2- 172.21.15.63:0/2524665328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f10b004fd90 0x7f10b0052250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f10c8002f70 tx=0x7f10c800d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:40.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.585+0000 7f10d2ffd700 1 --2- 172.21.15.63:0/2524665328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f10b004fd90 0x7f10b0052250 secure :-1 s=READY pgs=721 cs=0 l=1 rx=0x7f10c8002f70 tx=0x7f10c800d8f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:40.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.593+0000 7f10d37fe700 1 --2- 172.21.15.63:0/2524665328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10d4149f50 0x7f10d4149ad0 secure :-1 s=THROTTLE_DONE pgs=1852 cs=0 l=1 rx=0x7f10cc0032f0 tx=0x7f10cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:40.600 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.593+0000 7f10c3fff700 1 -- 172.21.15.63:0/2524665328 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f10d4062880 con 0x7f10d4149f50 2020-05-18T21:36:40.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.745+0000 7f10d96c0700 1 -- 172.21.15.63:0/2524665328 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f10d40569e0 con 0x7f10d4149f50 2020-05-18T21:36:40.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.785+0000 7f10d37fe700 1 --2- 172.21.15.63:0/2524665328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10d4149f50 0x7f10d4149ad0 secure :-1 s=THROTTLE_DONE pgs=1852 cs=0 l=1 rx=0x7f10cc0032f0 tx=0x7f10cc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:40.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.785+0000 7f10c3fff700 1 -- 172.21.15.63:0/2524665328 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v114) v1 ==== 105+0+0 (secure 0 0 0) 0x7f10cc03ed40 con 0x7f10d4149f50 2020-05-18T21:36:40.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.785+0000 7f10d96c0700 1 -- 172.21.15.63:0/2524665328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f10b004fd90 msgr2=0x7f10b0052250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:40.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.785+0000 7f10d96c0700 1 --2- 172.21.15.63:0/2524665328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f10b004fd90 0x7f10b0052250 secure :-1 s=READY pgs=721 cs=0 l=1 rx=0x7f10c8002f70 tx=0x7f10c800d8f0).stop 2020-05-18T21:36:40.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.785+0000 7f10d96c0700 1 -- 172.21.15.63:0/2524665328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10d4149f50 msgr2=0x7f10d4149ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:40.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.785+0000 7f10d96c0700 1 --2- 172.21.15.63:0/2524665328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10d4149f50 0x7f10d4149ad0 secure :-1 s=READY pgs=1852 cs=0 l=1 rx=0x7f10cc0032f0 tx=0x7f10cc007e00).stop 2020-05-18T21:36:40.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.785+0000 7f10d96c0700 1 -- 172.21.15.63:0/2524665328 shutdown_connections 2020-05-18T21:36:40.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.785+0000 7f10d96c0700 1 --2- 172.21.15.63:0/2524665328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f10b004fd90 0x7f10b0052250 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:40.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.785+0000 7f10d96c0700 1 --2- 172.21.15.63:0/2524665328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10d4149f50 0x7f10d4149ad0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:40.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.785+0000 7f10d96c0700 1 --2- 172.21.15.63:0/2524665328 >> v2:172.21.15.155:3300/0 conn(0x7f10d405a770 0x7f10d4097930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:40.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.785+0000 7f10d96c0700 1 -- 172.21.15.63:0/2524665328 >> 172.21.15.63:0/2524665328 conn(0x7f10d40b57b0 msgr2=0x7f10d40b8550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:40.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.785+0000 7f10d96c0700 1 -- 172.21.15.63:0/2524665328 shutdown_connections 2020-05-18T21:36:40.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:40.789+0000 7f10d96c0700 1 -- 172.21.15.63:0/2524665328 wait complete. 2020-05-18T21:36:50.807 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump purge_queue pq_executed 2020-05-18T21:36:50.913 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:36:50.913 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2020-05-18T21:36:50.913 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 0 2020-05-18T21:36:50.914 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:36:50.914 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:36:50.925 INFO:tasks.cephfs.filesystem:_json_asok output: { "purge_queue": { "pq_executed": 0 } } 2020-05-18T21:36:50.926 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:36:51.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.033+0000 7efe874d5700 1 Processor -- start 2020-05-18T21:36:51.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.033+0000 7efe874d5700 1 -- start start 2020-05-18T21:36:51.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.033+0000 7efe874d5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efe800b4780 0x7efe80064270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:51.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.033+0000 7efe874d5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe80141850 0x7efe80141ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:51.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.033+0000 7efe874d5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe800649c0 con 0x7efe8005b340 2020-05-18T21:36:51.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.033+0000 7efe874d5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe80062560 con 0x7efe80141850 2020-05-18T21:36:51.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.033+0000 7efe874d5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe800b2df0 con 0x7efe800b4780 2020-05-18T21:36:51.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe86cd4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe80141850 0x7efe80141ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe86cd4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe80141850 0x7efe80141ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34914/0 (socket says 172.21.15.63:34914) 2020-05-18T21:36:51.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe86cd4700 1 -- 172.21.15.63:0/3315760022 learned_addr learned my addr 172.21.15.63:0/3315760022 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:36:51.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe85cd2700 1 --2- 172.21.15.63:0/3315760022 >> v2:172.21.15.155:3300/0 conn(0x7efe800b4780 0x7efe80064270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe86cd4700 1 -- 172.21.15.63:0/3315760022 >> v2:172.21.15.155:3300/0 conn(0x7efe800b4780 msgr2=0x7efe80064270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:51.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe86cd4700 1 --2- 172.21.15.63:0/3315760022 >> v2:172.21.15.155:3300/0 conn(0x7efe800b4780 0x7efe80064270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:51.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe86cd4700 1 -- 172.21.15.63:0/3315760022 >> v1:172.21.15.63:6789/0 conn(0x7efe8005b340 legacy=0x7efe800610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe86cd4700 1 -- 172.21.15.63:0/3315760022 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe800b3090 con 0x7efe80141850 2020-05-18T21:36:51.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe85cd2700 1 --2- 172.21.15.63:0/3315760022 >> v2:172.21.15.155:3300/0 conn(0x7efe800b4780 0x7efe80064270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:36:51.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe86cd4700 1 --2- 172.21.15.63:0/3315760022 >> v2:172.21.15.63:3300/0 conn(0x7efe80141850 0x7efe80141ca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efe80063860 tx=0x7efe78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe86cd4700 1 --2- 172.21.15.63:0/3315760022 >> v2:172.21.15.63:3300/0 conn(0x7efe80141850 0x7efe80141ca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efe80063860 tx=0x7efe78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe86cd4700 1 --2- 172.21.15.63:0/3315760022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe80141850 0x7efe80141ca0 secure :-1 s=READY pgs=1854 cs=0 l=1 rx=0x7efe80063860 tx=0x7efe78007e00).ready entity=mon.0 client_cookie=30165a51d6aec654 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:51.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe86cd4700 1 --2- 172.21.15.63:0/3315760022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe80141850 0x7efe80141ca0 secure :-1 s=THROTTLE_DONE pgs=1854 cs=0 l=1 rx=0x7efe80063860 tx=0x7efe78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe854d1700 1 -- 172.21.15.63:0/3315760022 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe78011d80 con 0x7efe80141850 2020-05-18T21:36:51.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe86cd4700 1 --2- 172.21.15.63:0/3315760022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe80141850 0x7efe80141ca0 secure :-1 s=THROTTLE_DONE pgs=1854 cs=0 l=1 rx=0x7efe80063860 tx=0x7efe78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe854d1700 1 -- 172.21.15.63:0/3315760022 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7800a180 con 0x7efe80141850 2020-05-18T21:36:51.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe86cd4700 1 --2- 172.21.15.63:0/3315760022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe80141850 0x7efe80141ca0 secure :-1 s=THROTTLE_DONE pgs=1854 cs=0 l=1 rx=0x7efe80063860 tx=0x7efe78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe874d5700 1 -- 172.21.15.63:0/3315760022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe80141850 msgr2=0x7efe80141ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe854d1700 1 -- 172.21.15.63:0/3315760022 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe7800a5a0 con 0x7efe80141850 2020-05-18T21:36:51.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe874d5700 1 --2- 172.21.15.63:0/3315760022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe80141850 0x7efe80141ca0 secure :-1 s=READY pgs=1854 cs=0 l=1 rx=0x7efe80063860 tx=0x7efe78007e00).stop 2020-05-18T21:36:51.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe874d5700 1 -- 172.21.15.63:0/3315760022 shutdown_connections 2020-05-18T21:36:51.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe874d5700 1 --2- 172.21.15.63:0/3315760022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe80141850 0x7efe80141ca0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:51.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe874d5700 1 --2- 172.21.15.63:0/3315760022 >> v2:172.21.15.155:3300/0 conn(0x7efe800b4780 0x7efe80064270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:51.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe874d5700 1 -- 172.21.15.63:0/3315760022 >> 172.21.15.63:0/3315760022 conn(0x7efe800b8340 msgr2=0x7efe800b8750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:51.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe874d5700 1 -- 172.21.15.63:0/3315760022 shutdown_connections 2020-05-18T21:36:51.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe874d5700 1 -- 172.21.15.63:0/3315760022 wait complete. 2020-05-18T21:36:51.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe874d5700 1 Processor -- start 2020-05-18T21:36:51.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.037+0000 7efe874d5700 1 -- start start 2020-05-18T21:36:51.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe874d5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe800b4780 0x7efe8013b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:51.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe874d5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe80138d60 con 0x7efe80141850 2020-05-18T21:36:51.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe874d5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8013d560 con 0x7efe8005b340 2020-05-18T21:36:51.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe874d5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe80137bf0 con 0x7efe800b4780 2020-05-18T21:36:51.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe86cd4700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efe80141850 0x7efe8013da00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37108/0 (socket says 172.21.15.63:37108) 2020-05-18T21:36:51.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe86cd4700 1 -- 172.21.15.63:0/2672224997 learned_addr learned my addr 172.21.15.63:0/2672224997 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:51.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe85cd2700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe800b4780 0x7efe8013b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe6f7fe700 1 -- 172.21.15.63:0/2672224997 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765864540 0 0) 0x7efe80138d60 con 0x7efe80141850 2020-05-18T21:36:51.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe6f7fe700 1 -- 172.21.15.63:0/2672224997 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe60002fe0 con 0x7efe80141850 2020-05-18T21:36:51.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe6f7fe700 1 -- 172.21.15.63:0/2672224997 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3388248400 0 0) 0x7efe60002fe0 con 0x7efe80141850 2020-05-18T21:36:51.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe6f7fe700 1 -- 172.21.15.63:0/2672224997 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efe80138d60 con 0x7efe80141850 2020-05-18T21:36:51.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe6f7fe700 1 -- 172.21.15.63:0/2672224997 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7efe780032f0 con 0x7efe80141850 2020-05-18T21:36:51.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe6f7fe700 1 -- 172.21.15.63:0/2672224997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe800b4780 msgr2=0x7efe8013b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe6f7fe700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe800b4780 0x7efe8013b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:51.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe6f7fe700 1 -- 172.21.15.63:0/2672224997 >> v1:172.21.15.155:6789/0 conn(0x7efe8005b340 legacy=0x7efe801374e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe6f7fe700 1 -- 172.21.15.63:0/2672224997 >> v1:172.21.15.63:6789/0 conn(0x7efe80141850 legacy=0x7efe8013da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe6f7fe700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe60004a80 0x7efe60004e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:51.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe6f7fe700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe800b4780 0x7efe600039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:51.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe6f7fe700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe60003e00 0x7efe60004280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:51.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe6f7fe700 1 -- 172.21.15.63:0/2672224997 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe80137bf0 con 0x7efe60003e00 2020-05-18T21:36:51.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe6f7fe700 1 -- 172.21.15.63:0/2672224997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe600047d0 con 0x7efe60004a80 2020-05-18T21:36:51.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe6f7fe700 1 -- 172.21.15.63:0/2672224997 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe600053a0 con 0x7efe800b4780 2020-05-18T21:36:51.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe86cd4700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe60003e00 0x7efe60004280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe85cd2700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe800b4780 0x7efe600039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe864d3700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe60004a80 0x7efe60004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe86cd4700 1 -- 172.21.15.63:0/2672224997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe800b4780 msgr2=0x7efe600039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe86cd4700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe800b4780 0x7efe600039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:51.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe86cd4700 1 -- 172.21.15.63:0/2672224997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe60004a80 msgr2=0x7efe60004e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe86cd4700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe60004a80 0x7efe60004e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:51.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe86cd4700 1 -- 172.21.15.63:0/2672224997 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8013d250 con 0x7efe60003e00 2020-05-18T21:36:51.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe874d5700 1 -- 172.21.15.63:0/2672224997 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe801389e0 con 0x7efe60003e00 2020-05-18T21:36:51.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe874d5700 1 -- 172.21.15.63:0/2672224997 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8013e110 con 0x7efe60003e00 2020-05-18T21:36:51.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe86cd4700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe60003e00 0x7efe60004280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe780086e0 tx=0x7efe78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe86cd4700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe60003e00 0x7efe60004280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe780086e0 tx=0x7efe78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe86cd4700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe60003e00 0x7efe60004280 secure :-1 s=READY pgs=1856 cs=0 l=1 rx=0x7efe780086e0 tx=0x7efe78007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:51.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe86cd4700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe60003e00 0x7efe60004280 secure :-1 s=THROTTLE_DONE pgs=1856 cs=0 l=1 rx=0x7efe780086e0 tx=0x7efe78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe6f7fe700 1 -- 172.21.15.63:0/2672224997 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe7800ae70 con 0x7efe60003e00 2020-05-18T21:36:51.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe86cd4700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe60003e00 0x7efe60004280 secure :-1 s=THROTTLE_DONE pgs=1856 cs=0 l=1 rx=0x7efe780086e0 tx=0x7efe78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe86cd4700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe60003e00 0x7efe60004280 secure :-1 s=THROTTLE_DONE pgs=1856 cs=0 l=1 rx=0x7efe780086e0 tx=0x7efe78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe6f7fe700 1 -- 172.21.15.63:0/2672224997 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe78007f90 con 0x7efe60003e00 2020-05-18T21:36:51.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.041+0000 7efe6f7fe700 1 -- 172.21.15.63:0/2672224997 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe78005c70 con 0x7efe60003e00 2020-05-18T21:36:51.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.045+0000 7efe86cd4700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe60003e00 0x7efe60004280 secure :-1 s=THROTTLE_DONE pgs=1856 cs=0 l=1 rx=0x7efe780086e0 tx=0x7efe78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.045+0000 7efe6f7fe700 1 -- 172.21.15.63:0/2672224997 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7efe78007170 con 0x7efe60003e00 2020-05-18T21:36:51.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.045+0000 7efe86cd4700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe60003e00 0x7efe60004280 secure :-1 s=THROTTLE_DONE pgs=1856 cs=0 l=1 rx=0x7efe780086e0 tx=0x7efe78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.045+0000 7efe874d5700 1 -- 172.21.15.63:0/2672224997 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5c003380 con 0x7efe60003e00 2020-05-18T21:36:51.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.045+0000 7efe6f7fe700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe60057bd0 0x7efe6005a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:51.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.045+0000 7efe6f7fe700 1 -- 172.21.15.63:0/2672224997 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7efe78064e20 con 0x7efe60003e00 2020-05-18T21:36:51.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.045+0000 7efe864d3700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe60057bd0 0x7efe6005a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.045+0000 7efe864d3700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe60057bd0 0x7efe6005a090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe7c000f50 tx=0x7efe7c008860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.045+0000 7efe864d3700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe60057bd0 0x7efe6005a090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe7c000f50 tx=0x7efe7c008860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.045+0000 7efe864d3700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe60057bd0 0x7efe6005a090 secure :-1 s=READY pgs=722 cs=0 l=1 rx=0x7efe7c000f50 tx=0x7efe7c008860).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:51.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.049+0000 7efe86cd4700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe60003e00 0x7efe60004280 secure :-1 s=THROTTLE_DONE pgs=1856 cs=0 l=1 rx=0x7efe780086e0 tx=0x7efe78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.049+0000 7efe6f7fe700 1 -- 172.21.15.63:0/2672224997 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7efe7803f210 con 0x7efe60003e00 2020-05-18T21:36:51.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.197+0000 7efe874d5700 1 -- 172.21.15.63:0/2672224997 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe5c003720 con 0x7efe60003e00 2020-05-18T21:36:51.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.197+0000 7efe86cd4700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe60003e00 0x7efe60004280 secure :-1 s=THROTTLE_DONE pgs=1856 cs=0 l=1 rx=0x7efe780086e0 tx=0x7efe78007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.197+0000 7efe6f7fe700 1 -- 172.21.15.63:0/2672224997 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+2167 (secure 0 0 0) 0x7efe78042830 con 0x7efe60003e00 2020-05-18T21:36:51.205 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:51.206 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":116,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:36:46.268982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":9501,"mds_1":9379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9379":{"gid":9379,"name":"b","rank":1,"incarnation":108,"state":"up:stopping","state_seq":5,"addr":"172.21.15.155:6835/3918574447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3918574447},{"type":"v1","addr":"172.21.15.155:6835","nonce":3918574447}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[1],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:36:51.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.201+0000 7efe874d5700 1 -- 172.21.15.63:0/2672224997 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe60057bd0 msgr2=0x7efe6005a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.201+0000 7efe874d5700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe60057bd0 0x7efe6005a090 secure :-1 s=READY pgs=722 cs=0 l=1 rx=0x7efe7c000f50 tx=0x7efe7c008860).stop 2020-05-18T21:36:51.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.201+0000 7efe874d5700 1 -- 172.21.15.63:0/2672224997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe60003e00 msgr2=0x7efe60004280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.201+0000 7efe874d5700 1 --2- 172.21.15.63:0/2672224997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe60003e00 0x7efe60004280 secure :-1 s=READY pgs=1856 cs=0 l=1 rx=0x7efe780086e0 tx=0x7efe78007e00).stop 2020-05-18T21:36:51.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.201+0000 7efe86cd4700 1 -- 172.21.15.63:0/2672224997 reap_dead start 2020-05-18T21:36:51.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.201+0000 7efe86cd4700 1 -- 172.21.15.63:0/2672224997 reap_dead start 2020-05-18T21:36:51.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.201+0000 7efe874d5700 1 -- 172.21.15.63:0/2672224997 shutdown_connections 2020-05-18T21:36:51.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.201+0000 7efe874d5700 1 -- 172.21.15.63:0/2672224997 >> 172.21.15.63:0/2672224997 conn(0x7efe800b8340 msgr2=0x7efe80061890 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:51.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.201+0000 7efe874d5700 1 -- 172.21.15.63:0/2672224997 shutdown_connections 2020-05-18T21:36:51.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.201+0000 7efe874d5700 1 -- 172.21.15.63:0/2672224997 wait complete. 2020-05-18T21:36:51.209 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 116 2020-05-18T21:36:51.223 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mds.b injectargs '--mds_max_purge_files 100' 2020-05-18T21:36:51.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.321+0000 7f055a86a700 1 Processor -- start 2020-05-18T21:36:51.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.321+0000 7f055a86a700 1 -- start start 2020-05-18T21:36:51.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.321+0000 7f055a86a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05540acfe0 0x7f05540b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:51.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.321+0000 7f055a86a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05540b2220 con 0x7f055405aab0 2020-05-18T21:36:51.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.321+0000 7f055a86a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0554066410 con 0x7f05540b2cc0 2020-05-18T21:36:51.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.321+0000 7f055a86a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05540b2450 con 0x7f05540acfe0 2020-05-18T21:36:51.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.321+0000 7f0559868700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f055405aab0 0x7f05540b41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37120/0 (socket says 172.21.15.63:37120) 2020-05-18T21:36:51.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.321+0000 7f0559868700 1 -- 172.21.15.63:0/3882053345 learned_addr learned my addr 172.21.15.63:0/3882053345 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:51.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.321+0000 7f0559067700 1 --2- 172.21.15.63:0/3882053345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05540acfe0 0x7f05540b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.321+0000 7f0558866700 1 -- 172.21.15.63:0/3882053345 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699776681 0 0) 0x7f05540b2220 con 0x7f055405aab0 2020-05-18T21:36:51.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.321+0000 7f0558866700 1 -- 172.21.15.63:0/3882053345 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f053c003270 con 0x7f055405aab0 2020-05-18T21:36:51.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.321+0000 7f0559067700 1 -- 172.21.15.63:0/3882053345 >> v1:172.21.15.155:6789/0 conn(0x7f05540b2cc0 legacy=0x7f05540b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.321+0000 7f0559067700 1 -- 172.21.15.63:0/3882053345 >> v1:172.21.15.63:6789/0 conn(0x7f055405aab0 legacy=0x7f05540b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.321+0000 7f0559067700 1 -- 172.21.15.63:0/3882053345 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055405ae90 con 0x7f05540acfe0 2020-05-18T21:36:51.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.321+0000 7f0559067700 1 --2- 172.21.15.63:0/3882053345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05540acfe0 0x7f05540b4900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0548002f70 tx=0x7f0548008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f0559067700 1 --2- 172.21.15.63:0/3882053345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05540acfe0 0x7f05540b4900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0548002f70 tx=0x7f0548008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f0559067700 1 --2- 172.21.15.63:0/3882053345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05540acfe0 0x7f05540b4900 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7f0548002f70 tx=0x7f0548008920).ready entity=mon.2 client_cookie=f2494a330a2b5667 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:51.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f0559067700 1 --2- 172.21.15.63:0/3882053345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05540acfe0 0x7f05540b4900 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f0548002f70 tx=0x7f0548008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f0558866700 1 -- 172.21.15.63:0/3882053345 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0548008e80 con 0x7f05540acfe0 2020-05-18T21:36:51.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f0559067700 1 --2- 172.21.15.63:0/3882053345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05540acfe0 0x7f05540b4900 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f0548002f70 tx=0x7f0548008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f0559067700 1 --2- 172.21.15.63:0/3882053345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05540acfe0 0x7f05540b4900 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f0548002f70 tx=0x7f0548008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f0558866700 1 -- 172.21.15.63:0/3882053345 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0548011630 con 0x7f05540acfe0 2020-05-18T21:36:51.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f0558866700 1 -- 172.21.15.63:0/3882053345 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0548011a10 con 0x7f05540acfe0 2020-05-18T21:36:51.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f055a86a700 1 -- 172.21.15.63:0/3882053345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05540acfe0 msgr2=0x7f05540b4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f055a86a700 1 --2- 172.21.15.63:0/3882053345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05540acfe0 0x7f05540b4900 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7f0548002f70 tx=0x7f0548008920).stop 2020-05-18T21:36:51.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f055a86a700 1 -- 172.21.15.63:0/3882053345 shutdown_connections 2020-05-18T21:36:51.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f055a86a700 1 --2- 172.21.15.63:0/3882053345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05540acfe0 0x7f05540b4900 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:51.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f055a86a700 1 -- 172.21.15.63:0/3882053345 >> 172.21.15.63:0/3882053345 conn(0x7f05540b8320 msgr2=0x7f05540b8730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:51.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f055a86a700 1 -- 172.21.15.63:0/3882053345 shutdown_connections 2020-05-18T21:36:51.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f055a86a700 1 -- 172.21.15.63:0/3882053345 wait complete. 2020-05-18T21:36:51.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f055a86a700 1 Processor -- start 2020-05-18T21:36:51.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f055a86a700 1 -- start start 2020-05-18T21:36:51.345 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f055a86a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f05540acfe0 0x7f0554142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:51.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f055a86a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f05540b2cc0 0x7f05540af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:51.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f055a86a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05540afc00 con 0x7f055405aab0 2020-05-18T21:36:51.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f055a86a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055414dcc0 con 0x7f05540acfe0 2020-05-18T21:36:51.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.325+0000 7f055a86a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055414cda0 con 0x7f05540b2cc0 2020-05-18T21:36:51.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0559868700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f055405aab0 0x7f05541428c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37124/0 (socket says 172.21.15.63:37124) 2020-05-18T21:36:51.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0559868700 1 -- 172.21.15.63:0/414360516 learned_addr learned my addr 172.21.15.63:0/414360516 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:51.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0559067700 1 --2- 172.21.15.63:0/414360516 >> v2:172.21.15.63:3300/0 conn(0x7f05540acfe0 0x7f0554142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f055a069700 1 --2- 172.21.15.63:0/414360516 >> v2:172.21.15.155:3300/0 conn(0x7f05540b2cc0 0x7f05540af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0546ffd700 1 -- 172.21.15.63:0/414360516 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395034164 0 0) 0x7f05540afc00 con 0x7f055405aab0 2020-05-18T21:36:51.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0546ffd700 1 -- 172.21.15.63:0/414360516 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0534002fe0 con 0x7f055405aab0 2020-05-18T21:36:51.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0559067700 1 -- 172.21.15.63:0/414360516 >> v2:172.21.15.155:3300/0 conn(0x7f05540b2cc0 msgr2=0x7f05540af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0559067700 1 --2- 172.21.15.63:0/414360516 >> v2:172.21.15.155:3300/0 conn(0x7f05540b2cc0 0x7f05540af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:51.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0559067700 1 -- 172.21.15.63:0/414360516 >> v1:172.21.15.63:6789/0 conn(0x7f055405aab0 legacy=0x7f05541428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0559067700 1 -- 172.21.15.63:0/414360516 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055414d040 con 0x7f05540acfe0 2020-05-18T21:36:51.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f055a069700 1 --2- 172.21.15.63:0/414360516 >> v2:172.21.15.155:3300/0 conn(0x7f05540b2cc0 0x7f05540af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:36:51.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0559067700 1 --2- 172.21.15.63:0/414360516 >> v2:172.21.15.63:3300/0 conn(0x7f05540acfe0 0x7f0554142fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0548002f70 tx=0x7f055405b020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0559067700 1 --2- 172.21.15.63:0/414360516 >> v2:172.21.15.63:3300/0 conn(0x7f05540acfe0 0x7f0554142fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0548002f70 tx=0x7f055405b020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0559067700 1 --2- 172.21.15.63:0/414360516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05540acfe0 0x7f0554142fd0 secure :-1 s=READY pgs=1859 cs=0 l=1 rx=0x7f0548002f70 tx=0x7f055405b020).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:51.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0559067700 1 --2- 172.21.15.63:0/414360516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05540acfe0 0x7f0554142fd0 secure :-1 s=THROTTLE_DONE pgs=1859 cs=0 l=1 rx=0x7f0548002f70 tx=0x7f055405b020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0546ffd700 1 -- 172.21.15.63:0/414360516 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0548007170 con 0x7f05540acfe0 2020-05-18T21:36:51.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0559067700 1 --2- 172.21.15.63:0/414360516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05540acfe0 0x7f0554142fd0 secure :-1 s=THROTTLE_DONE pgs=1859 cs=0 l=1 rx=0x7f0548002f70 tx=0x7f055405b020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0559067700 1 --2- 172.21.15.63:0/414360516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05540acfe0 0x7f0554142fd0 secure :-1 s=THROTTLE_DONE pgs=1859 cs=0 l=1 rx=0x7f0548002f70 tx=0x7f055405b020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0546ffd700 1 -- 172.21.15.63:0/414360516 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05480072d0 con 0x7f05540acfe0 2020-05-18T21:36:51.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f055a86a700 1 -- 172.21.15.63:0/414360516 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055414d9b0 con 0x7f05540acfe0 2020-05-18T21:36:51.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0546ffd700 1 -- 172.21.15.63:0/414360516 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0548005700 con 0x7f05540acfe0 2020-05-18T21:36:51.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f055a86a700 1 -- 172.21.15.63:0/414360516 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055414a3c0 con 0x7f05540acfe0 2020-05-18T21:36:51.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0559067700 1 --2- 172.21.15.63:0/414360516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05540acfe0 0x7f0554142fd0 secure :-1 s=THROTTLE_DONE pgs=1859 cs=0 l=1 rx=0x7f0548002f70 tx=0x7f055405b020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0546ffd700 1 -- 172.21.15.63:0/414360516 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0548005970 con 0x7f05540acfe0 2020-05-18T21:36:51.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0559067700 1 --2- 172.21.15.63:0/414360516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05540acfe0 0x7f0554142fd0 secure :-1 s=THROTTLE_DONE pgs=1859 cs=0 l=1 rx=0x7f0548002f70 tx=0x7f055405b020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.329+0000 7f0546ffd700 1 --2- 172.21.15.63:0/414360516 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f053404fd90 0x7f0534052250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:51.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.333+0000 7f0546ffd700 1 -- 172.21.15.63:0/414360516 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0548064390 con 0x7f05540acfe0 2020-05-18T21:36:51.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.333+0000 7f0559868700 1 --2- 172.21.15.63:0/414360516 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f053404fd90 0x7f0534052250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.333+0000 7f0559868700 1 --2- 172.21.15.63:0/414360516 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f053404fd90 0x7f0534052250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0550000f50 tx=0x7f05500016c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.333+0000 7f0559868700 1 --2- 172.21.15.63:0/414360516 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f053404fd90 0x7f0534052250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0550000f50 tx=0x7f05500016c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.333+0000 7f0559868700 1 --2- 172.21.15.63:0/414360516 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f053404fd90 0x7f0534052250 secure :-1 s=READY pgs=723 cs=0 l=1 rx=0x7f0550000f50 tx=0x7f05500016c0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:51.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.333+0000 7f0565cf6740 1 Processor -- start 2020-05-18T21:36:51.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.333+0000 7f0565cf6740 1 -- start start 2020-05-18T21:36:51.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0565cf6740 1 --2- >> v2:172.21.15.155:3300/0 conn(0x10a0310 0x10e31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:51.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0565cf6740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x10a7030 0x10a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:51.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0565cf6740 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x104c720 con 0x10dc600 2020-05-18T21:36:51.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0565cf6740 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x1012450 con 0x10a0310 2020-05-18T21:36:51.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0565cf6740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x1012590 con 0x10a7030 2020-05-18T21:36:51.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0559067700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x10dc600 0x10a1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37136/0 (socket says 172.21.15.63:37136) 2020-05-18T21:36:51.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0559067700 1 -- 172.21.15.63:0/3405502577 learned_addr learned my addr 172.21.15.63:0/3405502577 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:51.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0559868700 1 --2- 172.21.15.63:0/3405502577 >> v2:172.21.15.155:3300/0 conn(0x10a0310 0x10e31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f055a069700 1 --2- 172.21.15.63:0/3405502577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x10a7030 0x10a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f055a86a700 1 -- 172.21.15.63:0/3405502577 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239283050 0 0) 0x104c720 con 0x10dc600 2020-05-18T21:36:51.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f055a86a700 1 -- 172.21.15.63:0/3405502577 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05540569e0 con 0x10dc600 2020-05-18T21:36:51.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0559868700 1 -- 172.21.15.63:0/3405502577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x10a7030 msgr2=0x10a1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:51.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0559868700 1 --2- 172.21.15.63:0/3405502577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x10a7030 0x10a1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:51.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0559868700 1 -- 172.21.15.63:0/3405502577 >> v1:172.21.15.63:6789/0 conn(0x10dc600 legacy=0x10a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f055a86a700 1 -- 172.21.15.63:0/3405502577 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 497560990 0 0) 0x7f05540569e0 con 0x10dc600 2020-05-18T21:36:51.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0559868700 1 -- 172.21.15.63:0/3405502577 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xfdaf30 con 0x10a0310 2020-05-18T21:36:51.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0559868700 1 --2- 172.21.15.63:0/3405502577 >> v2:172.21.15.155:3300/0 conn(0x10a0310 0x10e31b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0550001ec0 tx=0x7f055000dc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0559868700 1 --2- 172.21.15.63:0/3405502577 >> v2:172.21.15.155:3300/0 conn(0x10a0310 0x10e31b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0550001ec0 tx=0x7f055000dc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0559868700 1 --2- 172.21.15.63:0/3405502577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x10a0310 0x10e31b0 secure :-1 s=READY pgs=1232 cs=0 l=1 rx=0x7f0550001ec0 tx=0x7f055000dc30).ready entity=mon.1 client_cookie=7c55f0206ab9d2ad server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:51.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0559868700 1 --2- 172.21.15.63:0/3405502577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x10a0310 0x10e31b0 secure :-1 s=THROTTLE_DONE pgs=1232 cs=0 l=1 rx=0x7f0550001ec0 tx=0x7f055000dc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f055a86a700 1 -- 172.21.15.63:0/3405502577 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0550012ea0 con 0x10a0310 2020-05-18T21:36:51.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0559868700 1 --2- 172.21.15.63:0/3405502577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x10a0310 0x10e31b0 secure :-1 s=THROTTLE_DONE pgs=1232 cs=0 l=1 rx=0x7f0550001ec0 tx=0x7f055000dc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f055a86a700 1 -- 172.21.15.63:0/3405502577 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055000a0d0 con 0x10a0310 2020-05-18T21:36:51.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0559868700 1 --2- 172.21.15.63:0/3405502577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x10a0310 0x10e31b0 secure :-1 s=THROTTLE_DONE pgs=1232 cs=0 l=1 rx=0x7f0550001ec0 tx=0x7f055000dc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f055a86a700 1 -- 172.21.15.63:0/3405502577 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f055000a430 con 0x10a0310 2020-05-18T21:36:51.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0565cf6740 1 -- 172.21.15.63:0/3405502577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x10a0310 msgr2=0x10e31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0565cf6740 1 --2- 172.21.15.63:0/3405502577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x10a0310 0x10e31b0 secure :-1 s=READY pgs=1232 cs=0 l=1 rx=0x7f0550001ec0 tx=0x7f055000dc30).stop 2020-05-18T21:36:51.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0565cf6740 1 -- 172.21.15.63:0/3405502577 shutdown_connections 2020-05-18T21:36:51.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0565cf6740 1 --2- 172.21.15.63:0/3405502577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x10a7030 0x10a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:51.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0565cf6740 1 --2- 172.21.15.63:0/3405502577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x10a0310 0x10e31b0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:51.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0565cf6740 1 -- 172.21.15.63:0/3405502577 >> 172.21.15.63:0/3405502577 conn(0x10e26c0 msgr2=0x10e2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:51.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0565cf6740 1 -- 172.21.15.63:0/3405502577 shutdown_connections 2020-05-18T21:36:51.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.337+0000 7f0565cf6740 1 -- 172.21.15.63:0/3405502577 wait complete. 2020-05-18T21:36:51.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0565cf6740 1 -- start start 2020-05-18T21:36:51.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0565cf6740 1 Processor -- start 2020-05-18T21:36:51.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0565cf6740 1 --2- >> v2:172.21.15.63:3300/0 conn(0x10a7030 0x10e5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:51.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0565cf6740 1 --2- >> v2:172.21.15.155:3300/0 conn(0x10dc600 0x10e73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:51.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0565cf6740 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x1002c90 con 0x10a0310 2020-05-18T21:36:51.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0565cf6740 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x1013da0 con 0x10a7030 2020-05-18T21:36:51.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0565cf6740 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0xff4200 con 0x10dc600 2020-05-18T21:36:51.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0565cf6740 10 client.0 ll_register_callbacks cb 0x10088d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2020-05-18T21:36:51.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0559868700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x10a0310 0x10daf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37138/0 (socket says 172.21.15.63:37138) 2020-05-18T21:36:51.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0559868700 1 -- 172.21.15.63:0/1328094968 learned_addr learned my addr 172.21.15.63:0/1328094968 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:51.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0559067700 1 --2- 172.21.15.63:0/1328094968 >> v2:172.21.15.63:3300/0 conn(0x10a7030 0x10e5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0530ff9700 10 client.0 ms_handle_connect on v1:172.21.15.63:6789/0 2020-05-18T21:36:51.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f055a069700 1 --2- 172.21.15.63:0/1328094968 >> v2:172.21.15.155:3300/0 conn(0x10dc600 0x10e73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0530ff9700 1 -- 172.21.15.63:0/1328094968 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426529707 0 0) 0x1002c90 con 0x10a0310 2020-05-18T21:36:51.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0530ff9700 1 -- 172.21.15.63:0/1328094968 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05540569e0 con 0x10a0310 2020-05-18T21:36:51.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0559067700 1 -- 172.21.15.63:0/1328094968 >> v2:172.21.15.155:3300/0 conn(0x10dc600 msgr2=0x10e73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:51.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0530ff9700 1 -- 172.21.15.63:0/1328094968 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1502885340 0 0) 0x7f05540569e0 con 0x10a0310 2020-05-18T21:36:51.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0559067700 1 --2- 172.21.15.63:0/1328094968 >> v2:172.21.15.155:3300/0 conn(0x10dc600 0x10e73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:51.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0559067700 1 -- 172.21.15.63:0/1328094968 >> v1:172.21.15.63:6789/0 conn(0x10a0310 legacy=0x10daf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0559067700 1 -- 172.21.15.63:0/1328094968 --> v2:172.21.15.63:3300/0 -- mon_subscribe({osdmap=0}) v3 -- 0x100b5c0 con 0x10a7030 2020-05-18T21:36:51.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0559067700 1 --2- 172.21.15.63:0/1328094968 >> v2:172.21.15.63:3300/0 conn(0x10a7030 0x10e5370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f055000c620 tx=0x7f0548064280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0559067700 1 --2- 172.21.15.63:0/1328094968 >> v2:172.21.15.63:3300/0 conn(0x10a7030 0x10e5370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f055000c620 tx=0x7f0548064280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0530ff9700 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2020-05-18T21:36:51.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0559067700 1 --2- 172.21.15.63:0/1328094968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x10a7030 0x10e5370 secure :-1 s=READY pgs=1862 cs=0 l=1 rx=0x7f055000c620 tx=0x7f0548064280).ready entity=mon.0 client_cookie=8c27edb4f230b0a1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:51.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0559067700 1 --2- 172.21.15.63:0/1328094968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x10a7030 0x10e5370 secure :-1 s=THROTTLE_DONE pgs=1862 cs=0 l=1 rx=0x7f055000c620 tx=0x7f0548064280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0530ff9700 1 -- 172.21.15.63:0/1328094968 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05500018e0 con 0x10a7030 2020-05-18T21:36:51.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0559067700 1 --2- 172.21.15.63:0/1328094968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x10a7030 0x10e5370 secure :-1 s=THROTTLE_DONE pgs=1862 cs=0 l=1 rx=0x7f055000c620 tx=0x7f0548064280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0530ff9700 1 -- 172.21.15.63:0/1328094968 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0548041930 con 0x10a7030 2020-05-18T21:36:51.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0565cf6740 1 -- 172.21.15.63:0/1328094968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xf1f9d0 con 0x10a7030 2020-05-18T21:36:51.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0559067700 1 --2- 172.21.15.63:0/1328094968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x10a7030 0x10e5370 secure :-1 s=THROTTLE_DONE pgs=1862 cs=0 l=1 rx=0x7f055000c620 tx=0x7f0548064280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.341+0000 7f0530ff9700 1 -- 172.21.15.63:0/1328094968 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0548063fc0 con 0x10a7030 2020-05-18T21:36:51.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0565cf6740 10 client.9783 fetch_fsmap learned FSMap version 116 2020-05-18T21:36:51.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0565cf6740 1 -- 172.21.15.63:0/1328094968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) v3 -- 0x100c8d0 con 0x10a7030 2020-05-18T21:36:51.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0559067700 1 --2- 172.21.15.63:0/1328094968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x10a7030 0x10e5370 secure :-1 s=THROTTLE_DONE pgs=1862 cs=0 l=1 rx=0x7f055000c620 tx=0x7f0548064280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0530ff9700 1 -- 172.21.15.63:0/1328094968 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xf1f9d0 con 0x10a7030 2020-05-18T21:36:51.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0559067700 1 --2- 172.21.15.63:0/1328094968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x10a7030 0x10e5370 secure :-1 s=THROTTLE_DONE pgs=1862 cs=0 l=1 rx=0x7f055000c620 tx=0x7f0548064280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0530ff9700 1 -- 172.21.15.63:0/1328094968 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 116) v1 ==== 1267+0+0 (secure 0 0 0) 0x7f0548044c00 con 0x10a7030 2020-05-18T21:36:51.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0565cf6740 10 client.9783 fetch_fsmap finished waiting for FSMap version 116 2020-05-18T21:36:51.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0565cf6740 10 client.9783 resolve_mds: resolved ID 'b' to GID 9379 2020-05-18T21:36:51.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0565cf6740 20 client.9783 populate_metadata read hostname 'smithi063' 2020-05-18T21:36:51.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0565cf6740 1 --2- 172.21.15.63:0/1328094968 >> [v2:172.21.15.155:6834/3918574447,v1:172.21.15.155:6835/3918574447] conn(0x10e4c10 0x10e3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:51.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0565cf6740 4 client.9783 mds_command: new command op to 9379 tid=0[{"prefix": "get_command_descriptions"}] 2020-05-18T21:36:51.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0565cf6740 1 -- 172.21.15.63:0/1328094968 --> [v2:172.21.15.155:6834/3918574447,v1:172.21.15.155:6835/3918574447] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xf48310 con 0x10e4c10 2020-05-18T21:36:51.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0559868700 1 --2- 172.21.15.63:0/1328094968 >> [v2:172.21.15.155:6834/3918574447,v1:172.21.15.155:6835/3918574447] conn(0x10e4c10 0x10e3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0530ff9700 10 client.9783 ms_handle_connect on v2:172.21.15.155:6834/3918574447 2020-05-18T21:36:51.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0559868700 1 --2- 172.21.15.63:0/1328094968 >> [v2:172.21.15.155:6834/3918574447,v1:172.21.15.155:6835/3918574447] conn(0x10e4c10 0x10e3820 crc :-1 s=READY pgs=12 cs=0 l=0 rx=0 tx=0).ready entity=mds.1 client_cookie=927f08915a1eda5 server_cookie=f65bcfb0b1d56b01 in_seq=0 out_seq=0 2020-05-18T21:36:51.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0530ff9700 1 -- 172.21.15.63:0/1328094968 <== mds.1 v2:172.21.15.155:6834/3918574447 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16606 (crc 0 0 0) 0xf48310 con 0x10e4c10 2020-05-18T21:36:51.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0530ff9700 10 client.9783 handle_command_reply: tid=0 2020-05-18T21:36:51.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0565cf6740 1 client.9783 shutdown 2020-05-18T21:36:51.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0565cf6740 1 -- 172.21.15.63:0/1328094968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x10a7030 msgr2=0x10e5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0565cf6740 1 --2- 172.21.15.63:0/1328094968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x10a7030 0x10e5370 secure :-1 s=READY pgs=1862 cs=0 l=1 rx=0x7f055000c620 tx=0x7f0548064280).stop 2020-05-18T21:36:51.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0565cf6740 1 -- 172.21.15.63:0/1328094968 shutdown_connections 2020-05-18T21:36:51.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0565cf6740 1 --2- 172.21.15.63:0/1328094968 >> [v2:172.21.15.155:6834/3918574447,v1:172.21.15.155:6835/3918574447] conn(0x10e4c10 0x10e3820 crc :-1 s=READY pgs=12 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:51.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0565cf6740 1 --2- 172.21.15.63:0/1328094968 >> v2:172.21.15.155:3300/0 conn(0x10dc600 0x10e73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:51.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0530ff9700 0 client.9783 ms_handle_reset on v2:172.21.15.155:6834/3918574447 2020-05-18T21:36:51.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0565cf6740 1 --2- 172.21.15.63:0/1328094968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x10a7030 0x10e5370 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:51.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0565cf6740 1 -- 172.21.15.63:0/1328094968 >> 172.21.15.63:0/1328094968 conn(0x10e26c0 msgr2=0x10a3830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:51.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0565cf6740 1 -- 172.21.15.63:0/1328094968 shutdown_connections 2020-05-18T21:36:51.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0565cf6740 1 -- 172.21.15.63:0/1328094968 wait complete. 2020-05-18T21:36:51.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.345+0000 7f0565cf6740 20 client.9783 trim_cache size 0 max 16384 2020-05-18T21:36:51.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0565cf6740 1 Processor -- start 2020-05-18T21:36:51.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0565cf6740 1 -- start start 2020-05-18T21:36:51.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0565cf6740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x10a0310 0x10e2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:51.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0565cf6740 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05540569e0 con 0x10dc600 2020-05-18T21:36:51.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0565cf6740 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x1008160 con 0x10a7030 2020-05-18T21:36:51.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0565cf6740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x105c090 con 0x10a0310 2020-05-18T21:36:51.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f055a069700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x10dc600 0x10a3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37150/0 (socket says 172.21.15.63:37150) 2020-05-18T21:36:51.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f055a069700 1 -- 172.21.15.63:0/562476817 learned_addr learned my addr 172.21.15.63:0/562476817 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:51.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0559868700 1 --2- 172.21.15.63:0/562476817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x10a0310 0x10e2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0532ffd700 1 -- 172.21.15.63:0/562476817 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974477580 0 0) 0x7f05540569e0 con 0x10dc600 2020-05-18T21:36:51.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0532ffd700 1 -- 172.21.15.63:0/562476817 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f055405ba50 con 0x10dc600 2020-05-18T21:36:51.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0532ffd700 1 -- 172.21.15.63:0/562476817 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079638877 0 0) 0x1008160 con 0x10a7030 2020-05-18T21:36:51.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0532ffd700 1 -- 172.21.15.63:0/562476817 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05540569e0 con 0x10a7030 2020-05-18T21:36:51.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0532ffd700 1 -- 172.21.15.63:0/562476817 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1485016765 0 0) 0x7f055405ba50 con 0x10dc600 2020-05-18T21:36:51.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0532ffd700 1 -- 172.21.15.63:0/562476817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x10a0310 msgr2=0x10e2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:51.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0532ffd700 1 --2- 172.21.15.63:0/562476817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x10a0310 0x10e2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:51.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0532ffd700 1 -- 172.21.15.63:0/562476817 >> v1:172.21.15.155:6789/0 conn(0x10a7030 legacy=0x109f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0532ffd700 1 -- 172.21.15.63:0/562476817 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xfe8550 con 0x10dc600 2020-05-18T21:36:51.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0532ffd700 1 -- 172.21.15.63:0/562476817 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f054c00ce10 con 0x10dc600 2020-05-18T21:36:51.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0559868700 1 --2- 172.21.15.63:0/562476817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x10a0310 0x10e2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:36:51.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0532ffd700 1 -- 172.21.15.63:0/562476817 >> v1:172.21.15.63:6789/0 conn(0x10dc600 legacy=0x10a3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0532ffd700 1 --2- 172.21.15.63:0/562476817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05541479a0 0x7f05540b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:51.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0532ffd700 1 --2- 172.21.15.63:0/562476817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x10a0310 0x7f0554147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:51.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.365+0000 7f0532ffd700 1 --2- 172.21.15.63:0/562476817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05540b8700 0x7f05540b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:51.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0532ffd700 1 -- 172.21.15.63:0/562476817 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055414db40 con 0x7f05541479a0 2020-05-18T21:36:51.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0532ffd700 1 -- 172.21.15.63:0/562476817 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055414d240 con 0x7f05540b8700 2020-05-18T21:36:51.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0532ffd700 1 -- 172.21.15.63:0/562476817 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05540afd90 con 0x10a0310 2020-05-18T21:36:51.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0559868700 1 --2- 172.21.15.63:0/562476817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05541479a0 0x7f05540b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0559067700 1 --2- 172.21.15.63:0/562476817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x10a0310 0x7f0554147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f055a069700 1 --2- 172.21.15.63:0/562476817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05540b8700 0x7f05540b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0559868700 1 -- 172.21.15.63:0/562476817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x10a0310 msgr2=0x7f0554147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:51.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0559868700 1 --2- 172.21.15.63:0/562476817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x10a0310 0x7f0554147ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:51.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0559868700 1 -- 172.21.15.63:0/562476817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05540b8700 msgr2=0x7f05540b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:51.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0559868700 1 --2- 172.21.15.63:0/562476817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05540b8700 0x7f05540b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:51.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0559868700 1 -- 172.21.15.63:0/562476817 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055405ba50 con 0x7f05541479a0 2020-05-18T21:36:51.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0559067700 1 --2- 172.21.15.63:0/562476817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x10a0310 0x7f0554147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:36:51.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0559868700 1 --2- 172.21.15.63:0/562476817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05541479a0 0x7f05540b3150 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0550001ec0 tx=0x7f055414de00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0559868700 1 --2- 172.21.15.63:0/562476817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05541479a0 0x7f05540b3150 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0550001ec0 tx=0x7f055414de00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0559868700 1 --2- 172.21.15.63:0/562476817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05541479a0 0x7f05540b3150 secure :-1 s=READY pgs=1864 cs=0 l=1 rx=0x7f0550001ec0 tx=0x7f055414de00).ready entity=mon.0 client_cookie=8459ed48c66d03c2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:51.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0559868700 1 --2- 172.21.15.63:0/562476817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05541479a0 0x7f05540b3150 secure :-1 s=THROTTLE_DONE pgs=1864 cs=0 l=1 rx=0x7f0550001ec0 tx=0x7f055414de00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0532ffd700 1 -- 172.21.15.63:0/562476817 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05500018a0 con 0x7f05541479a0 2020-05-18T21:36:51.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0559868700 1 --2- 172.21.15.63:0/562476817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05541479a0 0x7f05540b3150 secure :-1 s=THROTTLE_DONE pgs=1864 cs=0 l=1 rx=0x7f0550001ec0 tx=0x7f055414de00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0559868700 1 --2- 172.21.15.63:0/562476817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05541479a0 0x7f05540b3150 secure :-1 s=THROTTLE_DONE pgs=1864 cs=0 l=1 rx=0x7f0550001ec0 tx=0x7f055414de00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0532ffd700 1 -- 172.21.15.63:0/562476817 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0550005600 con 0x7f05541479a0 2020-05-18T21:36:51.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0565cf6740 1 -- 172.21.15.63:0/562476817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05541479a0 msgr2=0x7f05540b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0532ffd700 1 -- 172.21.15.63:0/562476817 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0550005960 con 0x7f05541479a0 2020-05-18T21:36:51.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0565cf6740 1 --2- 172.21.15.63:0/562476817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05541479a0 0x7f05540b3150 secure :-1 s=READY pgs=1864 cs=0 l=1 rx=0x7f0550001ec0 tx=0x7f055414de00).stop 2020-05-18T21:36:51.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f055a069700 1 -- 172.21.15.63:0/562476817 reap_dead start 2020-05-18T21:36:51.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0565cf6740 1 -- 172.21.15.63:0/562476817 shutdown_connections 2020-05-18T21:36:51.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0565cf6740 1 -- 172.21.15.63:0/562476817 >> 172.21.15.63:0/562476817 conn(0x10e26c0 msgr2=0x10e5080 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:51.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0565cf6740 1 -- 172.21.15.63:0/562476817 shutdown_connections 2020-05-18T21:36:51.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0565cf6740 1 -- 172.21.15.63:0/562476817 wait complete. 2020-05-18T21:36:51.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0565cf6740 1 -- start start 2020-05-18T21:36:51.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0565cf6740 1 Processor -- start 2020-05-18T21:36:51.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0565cf6740 1 --2- >> v2:172.21.15.155:3300/0 conn(0x113e470 0x109e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:51.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0565cf6740 1 --2- >> v2:172.21.15.63:3300/0 conn(0x109edd0 0x1142b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:51.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0565cf6740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x1142fc0 0x10e3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:51.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0565cf6740 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x109f2f0 con 0x109edd0 2020-05-18T21:36:51.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0565cf6740 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x11426c0 con 0x113e470 2020-05-18T21:36:51.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.369+0000 7f0565cf6740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x1143470 con 0x1142fc0 2020-05-18T21:36:51.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0565cf6740 10 client.0 ll_register_callbacks cb 0x10e35b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2020-05-18T21:36:51.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559067700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x109edd0 0x1142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559067700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x109edd0 0x1142b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34972/0 (socket says 172.21.15.63:34972) 2020-05-18T21:36:51.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559067700 1 -- 172.21.15.63:0/2057390770 learned_addr learned my addr 172.21.15.63:0/2057390770 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:36:51.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f055a069700 1 --2- 172.21.15.63:0/2057390770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x1142fc0 0x10e3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559868700 1 --2- 172.21.15.63:0/2057390770 >> v2:172.21.15.155:3300/0 conn(0x113e470 0x109e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559067700 1 -- 172.21.15.63:0/2057390770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x1142fc0 msgr2=0x10e3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:51.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559067700 1 --2- 172.21.15.63:0/2057390770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x1142fc0 0x10e3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:51.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559067700 1 -- 172.21.15.63:0/2057390770 >> v2:172.21.15.155:3300/0 conn(0x113e470 msgr2=0x109e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:51.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559067700 1 --2- 172.21.15.63:0/2057390770 >> v2:172.21.15.155:3300/0 conn(0x113e470 0x109e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:51.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559067700 1 -- 172.21.15.63:0/2057390770 --> v2:172.21.15.63:3300/0 -- mon_subscribe({osdmap=0}) v3 -- 0x109f590 con 0x109edd0 2020-05-18T21:36:51.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559868700 1 --2- 172.21.15.63:0/2057390770 >> v2:172.21.15.155:3300/0 conn(0x113e470 0x109e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:36:51.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f055a069700 1 --2- 172.21.15.63:0/2057390770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x1142fc0 0x10e3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:36:51.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559067700 1 --2- 172.21.15.63:0/2057390770 >> v2:172.21.15.63:3300/0 conn(0x109edd0 0x1142b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0548064180 tx=0x7f0548010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559067700 1 --2- 172.21.15.63:0/2057390770 >> v2:172.21.15.63:3300/0 conn(0x109edd0 0x1142b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0548064180 tx=0x7f0548010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559067700 1 --2- 172.21.15.63:0/2057390770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x109edd0 0x1142b60 secure :-1 s=READY pgs=1865 cs=0 l=1 rx=0x7f0548064180 tx=0x7f0548010190).ready entity=mon.0 client_cookie=60f5b87cc470b530 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:51.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0531ffb700 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2020-05-18T21:36:51.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559067700 1 --2- 172.21.15.63:0/2057390770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x109edd0 0x1142b60 secure :-1 s=THROTTLE_DONE pgs=1865 cs=0 l=1 rx=0x7f0548064180 tx=0x7f0548010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0531ffb700 1 -- 172.21.15.63:0/2057390770 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0548063fc0 con 0x109edd0 2020-05-18T21:36:51.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559067700 1 --2- 172.21.15.63:0/2057390770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x109edd0 0x1142b60 secure :-1 s=THROTTLE_DONE pgs=1865 cs=0 l=1 rx=0x7f0548064180 tx=0x7f0548010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0531ffb700 1 -- 172.21.15.63:0/2057390770 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f054800f0d0 con 0x109edd0 2020-05-18T21:36:51.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0565cf6740 1 -- 172.21.15.63:0/2057390770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xe8ef20 con 0x109edd0 2020-05-18T21:36:51.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559067700 1 --2- 172.21.15.63:0/2057390770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x109edd0 0x1142b60 secure :-1 s=THROTTLE_DONE pgs=1865 cs=0 l=1 rx=0x7f0548064180 tx=0x7f0548010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0531ffb700 1 -- 172.21.15.63:0/2057390770 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0548041da0 con 0x109edd0 2020-05-18T21:36:51.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0565cf6740 10 client.9789 fetch_fsmap learned FSMap version 116 2020-05-18T21:36:51.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0565cf6740 1 -- 172.21.15.63:0/2057390770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) v3 -- 0x109f590 con 0x109edd0 2020-05-18T21:36:51.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559067700 1 --2- 172.21.15.63:0/2057390770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x109edd0 0x1142b60 secure :-1 s=THROTTLE_DONE pgs=1865 cs=0 l=1 rx=0x7f0548064180 tx=0x7f0548010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0531ffb700 1 -- 172.21.15.63:0/2057390770 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xe8ef20 con 0x109edd0 2020-05-18T21:36:51.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559067700 1 --2- 172.21.15.63:0/2057390770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x109edd0 0x1142b60 secure :-1 s=THROTTLE_DONE pgs=1865 cs=0 l=1 rx=0x7f0548064180 tx=0x7f0548010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0531ffb700 1 -- 172.21.15.63:0/2057390770 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 116) v1 ==== 1267+0+0 (secure 0 0 0) 0x7f0548041010 con 0x109edd0 2020-05-18T21:36:51.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0565cf6740 10 client.9789 fetch_fsmap finished waiting for FSMap version 116 2020-05-18T21:36:51.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0565cf6740 10 client.9789 resolve_mds: resolved ID 'b' to GID 9379 2020-05-18T21:36:51.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0565cf6740 20 client.9789 populate_metadata read hostname 'smithi063' 2020-05-18T21:36:51.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0565cf6740 1 --2- 172.21.15.63:0/2057390770 >> [v2:172.21.15.155:6834/3918574447,v1:172.21.15.155:6835/3918574447] conn(0x10e3c50 0x10e4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:51.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0565cf6740 4 client.9789 mds_command: new command op to 9379 tid=0[{"prefix": "injectargs", "injected_args": ["--mds_max_purge_files 100"]}] 2020-05-18T21:36:51.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0565cf6740 1 -- 172.21.15.63:0/2057390770 --> [v2:172.21.15.155:6834/3918574447,v1:172.21.15.155:6835/3918574447] -- command(tid 0: {"prefix": "injectargs", "injected_args": ["--mds_max_purge_files 100"]}) v1 -- 0xfd8050 con 0x10e3c50 2020-05-18T21:36:51.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559868700 1 --2- 172.21.15.63:0/2057390770 >> [v2:172.21.15.155:6834/3918574447,v1:172.21.15.155:6835/3918574447] conn(0x10e3c50 0x10e4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0531ffb700 10 client.9789 ms_handle_connect on v2:172.21.15.155:6834/3918574447 2020-05-18T21:36:51.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.373+0000 7f0559868700 1 --2- 172.21.15.63:0/2057390770 >> [v2:172.21.15.155:6834/3918574447,v1:172.21.15.155:6835/3918574447] conn(0x10e3c50 0x10e4030 crc :-1 s=READY pgs=13 cs=0 l=0 rx=0 tx=0).ready entity=mds.1 client_cookie=e0fe92a94ea698c6 server_cookie=a8fd8f6799b024f3 in_seq=0 out_seq=0 2020-05-18T21:36:51.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.377+0000 7f0531ffb700 1 -- 172.21.15.63:0/2057390770 <== mds.1 v2:172.21.15.155:6834/3918574447 1 ==== command_reply(tid 0: 0 mds_max_purge_files = '100' ) v1 ==== 36+0+3 (crc 0 0 0) 0xfd8050 con 0x10e3c50 2020-05-18T21:36:51.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.377+0000 7f0531ffb700 10 client.9789 handle_command_reply: tid=0 2020-05-18T21:36:51.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.377+0000 7f0565cf6740 1 client.9789 shutdown 2020-05-18T21:36:51.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.377+0000 7f0565cf6740 1 -- 172.21.15.63:0/2057390770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x109edd0 msgr2=0x1142b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.377+0000 7f0565cf6740 1 --2- 172.21.15.63:0/2057390770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x109edd0 0x1142b60 secure :-1 s=READY pgs=1865 cs=0 l=1 rx=0x7f0548064180 tx=0x7f0548010190).stop 2020-05-18T21:36:51.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.377+0000 7f0565cf6740 1 -- 172.21.15.63:0/2057390770 shutdown_connections 2020-05-18T21:36:51.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.377+0000 7f0565cf6740 1 --2- 172.21.15.63:0/2057390770 >> [v2:172.21.15.155:6834/3918574447,v1:172.21.15.155:6835/3918574447] conn(0x10e3c50 0x10e4030 crc :-1 s=READY pgs=13 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:51.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.377+0000 7f0565cf6740 1 --2- 172.21.15.63:0/2057390770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x1142fc0 0x10e3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:51.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.377+0000 7f0565cf6740 1 --2- 172.21.15.63:0/2057390770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x109edd0 0x1142b60 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:51.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.377+0000 7f0531ffb700 0 client.9789 ms_handle_reset on v2:172.21.15.155:6834/3918574447 2020-05-18T21:36:51.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.377+0000 7f0565cf6740 1 --2- 172.21.15.63:0/2057390770 >> v2:172.21.15.155:3300/0 conn(0x113e470 0x109e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:51.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.377+0000 7f0565cf6740 1 -- 172.21.15.63:0/2057390770 >> 172.21.15.63:0/2057390770 conn(0x10e26c0 msgr2=0x10a3670 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:51.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.377+0000 7f0565cf6740 1 -- 172.21.15.63:0/2057390770 shutdown_connections 2020-05-18T21:36:51.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.377+0000 7f0565cf6740 1 -- 172.21.15.63:0/2057390770 wait complete. 2020-05-18T21:36:51.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.377+0000 7f0565cf6740 20 client.9789 trim_cache size 0 max 16384 2020-05-18T21:36:51.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.377+0000 7f055a86a700 1 -- 172.21.15.63:0/414360516 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f053404fd90 msgr2=0x7f0534052250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.377+0000 7f055a86a700 1 --2- 172.21.15.63:0/414360516 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f053404fd90 0x7f0534052250 secure :-1 s=READY pgs=723 cs=0 l=1 rx=0x7f0550000f50 tx=0x7f05500016c0).stop 2020-05-18T21:36:51.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.377+0000 7f055a86a700 1 -- 172.21.15.63:0/414360516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05540acfe0 msgr2=0x7f0554142fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.377+0000 7f055a86a700 1 --2- 172.21.15.63:0/414360516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05540acfe0 0x7f0554142fd0 secure :-1 s=READY pgs=1859 cs=0 l=1 rx=0x7f0548002f70 tx=0x7f055405b020).stop 2020-05-18T21:36:51.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.381+0000 7f055a86a700 1 -- 172.21.15.63:0/414360516 shutdown_connections 2020-05-18T21:36:51.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.381+0000 7f055a86a700 1 --2- 172.21.15.63:0/414360516 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f053404fd90 0x7f0534052250 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:51.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.381+0000 7f055a86a700 1 --2- 172.21.15.63:0/414360516 >> v2:172.21.15.155:3300/0 conn(0x7f05540b2cc0 0x7f05540af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:51.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.381+0000 7f055a86a700 1 --2- 172.21.15.63:0/414360516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05540acfe0 0x7f0554142fd0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:51.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.381+0000 7f055a86a700 1 -- 172.21.15.63:0/414360516 >> 172.21.15.63:0/414360516 conn(0x7f05540b8320 msgr2=0x7f0554149540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:51.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.381+0000 7f055a86a700 1 -- 172.21.15.63:0/414360516 shutdown_connections 2020-05-18T21:36:51.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.381+0000 7f055a86a700 1 -- 172.21.15.63:0/414360516 wait complete. 2020-05-18T21:36:51.414 INFO:teuthology.orchestra.run.smithi063.stderr:mds_max_purge_files = '100' 2020-05-18T21:36:51.415 INFO:teuthology.orchestra.run.smithi063.stdout:{} 2020-05-18T21:36:51.416 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:36:51.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.517+0000 7f9a4b4a6700 1 Processor -- start 2020-05-18T21:36:51.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.517+0000 7f9a4b4a6700 1 -- start start 2020-05-18T21:36:51.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4b4a6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a4405abf0 0x7f9a44145a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:51.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4b4a6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9a4414a050 0x7f9a440b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:51.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4b4a6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a440b3e70 con 0x7f9a440b60a0 2020-05-18T21:36:51.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4b4a6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a440b4110 con 0x7f9a4414a050 2020-05-18T21:36:51.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4b4a6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a440b3bc0 con 0x7f9a4405abf0 2020-05-18T21:36:51.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4aca5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9a4414a050 0x7f9a440b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4aca5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9a4414a050 0x7f9a440b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34982/0 (socket says 172.21.15.63:34982) 2020-05-18T21:36:51.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4aca5700 1 -- 172.21.15.63:0/3506113828 learned_addr learned my addr 172.21.15.63:0/3506113828 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:36:51.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a49ca3700 1 --2- 172.21.15.63:0/3506113828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a4405abf0 0x7f9a44145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4aca5700 1 -- 172.21.15.63:0/3506113828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a4405abf0 msgr2=0x7f9a44145a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:51.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4aca5700 1 --2- 172.21.15.63:0/3506113828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a4405abf0 0x7f9a44145a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:51.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4aca5700 1 -- 172.21.15.63:0/3506113828 >> v1:172.21.15.155:6789/0 conn(0x7f9a440b60a0 legacy=0x7f9a44145310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4aca5700 1 -- 172.21.15.63:0/3506113828 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a440b6480 con 0x7f9a4414a050 2020-05-18T21:36:51.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4aca5700 1 --2- 172.21.15.63:0/3506113828 >> v2:172.21.15.63:3300/0 conn(0x7f9a4414a050 0x7f9a440b3760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9a3c0032f0 tx=0x7f9a3c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4aca5700 1 --2- 172.21.15.63:0/3506113828 >> v2:172.21.15.63:3300/0 conn(0x7f9a4414a050 0x7f9a440b3760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9a3c0032f0 tx=0x7f9a3c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4aca5700 1 --2- 172.21.15.63:0/3506113828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4414a050 0x7f9a440b3760 secure :-1 s=READY pgs=1866 cs=0 l=1 rx=0x7f9a3c0032f0 tx=0x7f9a3c007e00).ready entity=mon.0 client_cookie=a70411be5c44136d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:51.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4aca5700 1 --2- 172.21.15.63:0/3506113828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4414a050 0x7f9a440b3760 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7f9a3c0032f0 tx=0x7f9a3c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4aca5700 1 --2- 172.21.15.63:0/3506113828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4414a050 0x7f9a440b3760 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7f9a3c0032f0 tx=0x7f9a3c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4aca5700 1 --2- 172.21.15.63:0/3506113828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4414a050 0x7f9a440b3760 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7f9a3c0032f0 tx=0x7f9a3c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a494a2700 1 -- 172.21.15.63:0/3506113828 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a3c0110d0 con 0x7f9a4414a050 2020-05-18T21:36:51.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a494a2700 1 -- 172.21.15.63:0/3506113828 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c011230 con 0x7f9a4414a050 2020-05-18T21:36:51.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a494a2700 1 -- 172.21.15.63:0/3506113828 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a3c011650 con 0x7f9a4414a050 2020-05-18T21:36:51.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4b4a6700 1 -- 172.21.15.63:0/3506113828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4414a050 msgr2=0x7f9a440b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.521+0000 7f9a4b4a6700 1 --2- 172.21.15.63:0/3506113828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4414a050 0x7f9a440b3760 secure :-1 s=READY pgs=1866 cs=0 l=1 rx=0x7f9a3c0032f0 tx=0x7f9a3c007e00).stop 2020-05-18T21:36:51.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.525+0000 7f9a4b4a6700 1 -- 172.21.15.63:0/3506113828 shutdown_connections 2020-05-18T21:36:51.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.525+0000 7f9a4b4a6700 1 --2- 172.21.15.63:0/3506113828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4414a050 0x7f9a440b3760 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:51.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.525+0000 7f9a4b4a6700 1 --2- 172.21.15.63:0/3506113828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a4405abf0 0x7f9a44145a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:51.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.525+0000 7f9a4b4a6700 1 -- 172.21.15.63:0/3506113828 >> 172.21.15.63:0/3506113828 conn(0x7f9a440b9680 msgr2=0x7f9a440b5650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:51.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.525+0000 7f9a4b4a6700 1 -- 172.21.15.63:0/3506113828 shutdown_connections 2020-05-18T21:36:51.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.525+0000 7f9a4b4a6700 1 -- 172.21.15.63:0/3506113828 wait complete. 2020-05-18T21:36:51.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.525+0000 7f9a4b4a6700 1 Processor -- start 2020-05-18T21:36:51.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.525+0000 7f9a4b4a6700 1 -- start start 2020-05-18T21:36:51.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a4b4a6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a4409e600 0x7f9a4409cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:51.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a4b4a6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a440b0710 con 0x7f9a4414a050 2020-05-18T21:36:51.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a4b4a6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a440b09b0 con 0x7f9a440b60a0 2020-05-18T21:36:51.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a4b4a6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a440b0c50 con 0x7f9a4409e600 2020-05-18T21:36:51.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a49ca3700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9a4414a050 0x7f9a440afe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37176/0 (socket says 172.21.15.63:37176) 2020-05-18T21:36:51.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a49ca3700 1 -- 172.21.15.63:0/792773785 learned_addr learned my addr 172.21.15.63:0/792773785 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:51.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a4aca5700 1 --2- 172.21.15.63:0/792773785 >> v2:172.21.15.155:3300/0 conn(0x7f9a4409e600 0x7f9a4409cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a337fe700 1 -- 172.21.15.63:0/792773785 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394342121 0 0) 0x7f9a440b0710 con 0x7f9a4414a050 2020-05-18T21:36:51.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a337fe700 1 -- 172.21.15.63:0/792773785 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a24002fe0 con 0x7f9a4414a050 2020-05-18T21:36:51.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a337fe700 1 -- 172.21.15.63:0/792773785 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2398951988 0 0) 0x7f9a24002fe0 con 0x7f9a4414a050 2020-05-18T21:36:51.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a337fe700 1 -- 172.21.15.63:0/792773785 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9a440b0710 con 0x7f9a4414a050 2020-05-18T21:36:51.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a337fe700 1 -- 172.21.15.63:0/792773785 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f9a34002600 con 0x7f9a4414a050 2020-05-18T21:36:51.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a4aca5700 1 -- 172.21.15.63:0/792773785 >> v1:172.21.15.155:6789/0 conn(0x7f9a440b60a0 legacy=0x7f9a44066590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a4aca5700 1 -- 172.21.15.63:0/792773785 >> v1:172.21.15.63:6789/0 conn(0x7f9a4414a050 legacy=0x7f9a440afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a4aca5700 1 -- 172.21.15.63:0/792773785 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4409cfb0 con 0x7f9a4409e600 2020-05-18T21:36:51.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a4aca5700 1 --2- 172.21.15.63:0/792773785 >> v2:172.21.15.155:3300/0 conn(0x7f9a4409e600 0x7f9a4409cb50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a40001020 tx=0x7f9a3c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a4aca5700 1 --2- 172.21.15.63:0/792773785 >> v2:172.21.15.155:3300/0 conn(0x7f9a4409e600 0x7f9a4409cb50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a40001020 tx=0x7f9a3c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a4aca5700 1 --2- 172.21.15.63:0/792773785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a4409e600 0x7f9a4409cb50 secure :-1 s=READY pgs=1236 cs=0 l=1 rx=0x7f9a40001020 tx=0x7f9a3c007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:51.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a4aca5700 1 --2- 172.21.15.63:0/792773785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a4409e600 0x7f9a4409cb50 secure :-1 s=THROTTLE_DONE pgs=1236 cs=0 l=1 rx=0x7f9a40001020 tx=0x7f9a3c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a337fe700 1 -- 172.21.15.63:0/792773785 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a3c005c70 con 0x7f9a4409e600 2020-05-18T21:36:51.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a4b4a6700 1 -- 172.21.15.63:0/792773785 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4409d200 con 0x7f9a4409e600 2020-05-18T21:36:51.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a4aca5700 1 --2- 172.21.15.63:0/792773785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a4409e600 0x7f9a4409cb50 secure :-1 s=THROTTLE_DONE pgs=1236 cs=0 l=1 rx=0x7f9a40001020 tx=0x7f9a3c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a337fe700 1 -- 172.21.15.63:0/792773785 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c005dd0 con 0x7f9a4409e600 2020-05-18T21:36:51.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a4b4a6700 1 -- 172.21.15.63:0/792773785 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a44063770 con 0x7f9a4409e600 2020-05-18T21:36:51.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a4aca5700 1 --2- 172.21.15.63:0/792773785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a4409e600 0x7f9a4409cb50 secure :-1 s=THROTTLE_DONE pgs=1236 cs=0 l=1 rx=0x7f9a40001020 tx=0x7f9a3c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a337fe700 1 -- 172.21.15.63:0/792773785 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a3c0112c0 con 0x7f9a4409e600 2020-05-18T21:36:51.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a4aca5700 1 --2- 172.21.15.63:0/792773785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a4409e600 0x7f9a4409cb50 secure :-1 s=THROTTLE_DONE pgs=1236 cs=0 l=1 rx=0x7f9a40001020 tx=0x7f9a3c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.529+0000 7f9a4b4a6700 1 -- 172.21.15.63:0/792773785 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a44063dc0 con 0x7f9a4409e600 2020-05-18T21:36:51.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.533+0000 7f9a337fe700 1 -- 172.21.15.63:0/792773785 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9a3c011420 con 0x7f9a4409e600 2020-05-18T21:36:51.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.533+0000 7f9a4aca5700 1 --2- 172.21.15.63:0/792773785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a4409e600 0x7f9a4409cb50 secure :-1 s=THROTTLE_DONE pgs=1236 cs=0 l=1 rx=0x7f9a40001020 tx=0x7f9a3c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.533+0000 7f9a337fe700 1 --2- 172.21.15.63:0/792773785 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a24050010 0x7f9a240524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:51.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.533+0000 7f9a337fe700 1 -- 172.21.15.63:0/792773785 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9a3c063d50 con 0x7f9a4409e600 2020-05-18T21:36:51.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.533+0000 7f9a4a4a4700 1 --2- 172.21.15.63:0/792773785 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a24050010 0x7f9a240524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:51.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.533+0000 7f9a4a4a4700 1 --2- 172.21.15.63:0/792773785 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a24050010 0x7f9a240524d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a40000f50 tx=0x7f9a40007d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.533+0000 7f9a4a4a4700 1 --2- 172.21.15.63:0/792773785 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a24050010 0x7f9a240524d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a40000f50 tx=0x7f9a40007d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.533+0000 7f9a4a4a4700 1 --2- 172.21.15.63:0/792773785 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a24050010 0x7f9a240524d0 secure :-1 s=READY pgs=724 cs=0 l=1 rx=0x7f9a40000f50 tx=0x7f9a40007d10).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:51.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.541+0000 7f9a4aca5700 1 --2- 172.21.15.63:0/792773785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a4409e600 0x7f9a4409cb50 secure :-1 s=THROTTLE_DONE pgs=1236 cs=0 l=1 rx=0x7f9a40001020 tx=0x7f9a3c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.541+0000 7f9a337fe700 1 -- 172.21.15.63:0/792773785 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9a3c041e60 con 0x7f9a4409e600 2020-05-18T21:36:51.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.693+0000 7f9a4b4a6700 1 -- 172.21.15.63:0/792773785 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a4409d390 con 0x7f9a4409e600 2020-05-18T21:36:51.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.693+0000 7f9a4aca5700 1 --2- 172.21.15.63:0/792773785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a4409e600 0x7f9a4409cb50 secure :-1 s=THROTTLE_DONE pgs=1236 cs=0 l=1 rx=0x7f9a40001020 tx=0x7f9a3c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:51.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.693+0000 7f9a337fe700 1 -- 172.21.15.63:0/792773785 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+2167 (secure 0 0 0) 0x7f9a3c067e60 con 0x7f9a4409e600 2020-05-18T21:36:51.701 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:51.701 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":116,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:36:46.268982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":9501,"mds_1":9379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9379":{"gid":9379,"name":"b","rank":1,"incarnation":108,"state":"up:stopping","state_seq":5,"addr":"172.21.15.155:6835/3918574447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3918574447},{"type":"v1","addr":"172.21.15.155:6835","nonce":3918574447}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[1],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:36:51.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.697+0000 7f9a4b4a6700 1 -- 172.21.15.63:0/792773785 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a24050010 msgr2=0x7f9a240524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.697+0000 7f9a4b4a6700 1 --2- 172.21.15.63:0/792773785 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a24050010 0x7f9a240524d0 secure :-1 s=READY pgs=724 cs=0 l=1 rx=0x7f9a40000f50 tx=0x7f9a40007d10).stop 2020-05-18T21:36:51.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.697+0000 7f9a4b4a6700 1 -- 172.21.15.63:0/792773785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a4409e600 msgr2=0x7f9a4409cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:51.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.697+0000 7f9a4b4a6700 1 --2- 172.21.15.63:0/792773785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a4409e600 0x7f9a4409cb50 secure :-1 s=READY pgs=1236 cs=0 l=1 rx=0x7f9a40001020 tx=0x7f9a3c007e00).stop 2020-05-18T21:36:51.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.697+0000 7f9a4b4a6700 1 -- 172.21.15.63:0/792773785 shutdown_connections 2020-05-18T21:36:51.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.697+0000 7f9a4b4a6700 1 --2- 172.21.15.63:0/792773785 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9a24050010 0x7f9a240524d0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:51.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.697+0000 7f9a4b4a6700 1 --2- 172.21.15.63:0/792773785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a4409e600 0x7f9a4409cb50 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:51.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.697+0000 7f9a4b4a6700 1 -- 172.21.15.63:0/792773785 >> 172.21.15.63:0/792773785 conn(0x7f9a440b9680 msgr2=0x7f9a44144770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:51.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.697+0000 7f9a4b4a6700 1 -- 172.21.15.63:0/792773785 shutdown_connections 2020-05-18T21:36:51.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:51.697+0000 7f9a4b4a6700 1 -- 172.21.15.63:0/792773785 wait complete. 2020-05-18T21:36:51.706 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 116 2020-05-18T21:36:51.922 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 116, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:35:50.157703+0000', 'modified': '2020-05-18T21:36:46.268982+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 135, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 9501, 'mds_1': 9379}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9379': {'gid': 9379, 'name': 'b', 'rank': 1, 'incarnation': 108, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.155:6835/3918574447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3918574447}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3918574447}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_9501': {'gid': 9501, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/169345666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 169345666}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 169345666}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:36:51.922 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9379:up:stopping 2020-05-18T21:36:52.923 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:36:53.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.029+0000 7fd59759e700 1 Processor -- start 2020-05-18T21:36:53.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.029+0000 7fd59759e700 1 -- start start 2020-05-18T21:36:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd598066aa0 0x7fd5980b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:53.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5981421b0 0x7fd598142640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:53.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5980b3b40 con 0x7fd59805f3a0 2020-05-18T21:36:53.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd598142aa0 con 0x7fd598066aa0 2020-05-18T21:36:53.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd598062970 con 0x7fd5981421b0 2020-05-18T21:36:53.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59659c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd59805f3a0 0x7fd598063540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37182/0 (socket says 172.21.15.63:37182) 2020-05-18T21:36:53.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59659c700 1 -- 172.21.15.63:0/3789640901 learned_addr learned my addr 172.21.15.63:0/3789640901 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:53.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd595d9b700 1 --2- 172.21.15.63:0/3789640901 >> v2:172.21.15.155:3300/0 conn(0x7fd598066aa0 0x7fd5980b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:53.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd596d9d700 1 --2- 172.21.15.63:0/3789640901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5981421b0 0x7fd598142640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:53.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59559a700 1 -- 172.21.15.63:0/3789640901 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654859079 0 0) 0x7fd5980b3b40 con 0x7fd59805f3a0 2020-05-18T21:36:53.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59559a700 1 -- 172.21.15.63:0/3789640901 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd57c003270 con 0x7fd59805f3a0 2020-05-18T21:36:53.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd595d9b700 1 -- 172.21.15.63:0/3789640901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5981421b0 msgr2=0x7fd598142640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:53.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd595d9b700 1 --2- 172.21.15.63:0/3789640901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5981421b0 0x7fd598142640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:53.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd595d9b700 1 -- 172.21.15.63:0/3789640901 >> v1:172.21.15.63:6789/0 conn(0x7fd59805f3a0 legacy=0x7fd598063540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:53.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd595d9b700 1 -- 172.21.15.63:0/3789640901 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd598062b60 con 0x7fd598066aa0 2020-05-18T21:36:53.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd595d9b700 1 --2- 172.21.15.63:0/3789640901 >> v2:172.21.15.155:3300/0 conn(0x7fd598066aa0 0x7fd5980b5eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd58c002f70 tx=0x7fd58c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:53.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd595d9b700 1 --2- 172.21.15.63:0/3789640901 >> v2:172.21.15.155:3300/0 conn(0x7fd598066aa0 0x7fd5980b5eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd58c002f70 tx=0x7fd58c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:53.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd595d9b700 1 --2- 172.21.15.63:0/3789640901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd598066aa0 0x7fd5980b5eb0 secure :-1 s=READY pgs=1237 cs=0 l=1 rx=0x7fd58c002f70 tx=0x7fd58c007a80).ready entity=mon.1 client_cookie=7cf2c6bc59e1b066 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:53.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd595d9b700 1 --2- 172.21.15.63:0/3789640901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd598066aa0 0x7fd5980b5eb0 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fd58c002f70 tx=0x7fd58c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:53.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59559a700 1 -- 172.21.15.63:0/3789640901 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd58c008e80 con 0x7fd598066aa0 2020-05-18T21:36:53.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd595d9b700 1 --2- 172.21.15.63:0/3789640901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd598066aa0 0x7fd5980b5eb0 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fd58c002f70 tx=0x7fd58c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:53.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59559a700 1 -- 172.21.15.63:0/3789640901 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58c011540 con 0x7fd598066aa0 2020-05-18T21:36:53.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd595d9b700 1 --2- 172.21.15.63:0/3789640901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd598066aa0 0x7fd5980b5eb0 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fd58c002f70 tx=0x7fd58c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:53.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59559a700 1 -- 172.21.15.63:0/3789640901 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd58c011920 con 0x7fd598066aa0 2020-05-18T21:36:53.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59759e700 1 -- 172.21.15.63:0/3789640901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd598066aa0 msgr2=0x7fd5980b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:53.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59759e700 1 --2- 172.21.15.63:0/3789640901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd598066aa0 0x7fd5980b5eb0 secure :-1 s=READY pgs=1237 cs=0 l=1 rx=0x7fd58c002f70 tx=0x7fd58c007a80).stop 2020-05-18T21:36:53.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59759e700 1 -- 172.21.15.63:0/3789640901 shutdown_connections 2020-05-18T21:36:53.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59759e700 1 --2- 172.21.15.63:0/3789640901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5981421b0 0x7fd598142640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:53.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59759e700 1 --2- 172.21.15.63:0/3789640901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd598066aa0 0x7fd5980b5eb0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:53.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59759e700 1 -- 172.21.15.63:0/3789640901 >> 172.21.15.63:0/3789640901 conn(0x7fd59809db80 msgr2=0x7fd59809df90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:53.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59759e700 1 -- 172.21.15.63:0/3789640901 shutdown_connections 2020-05-18T21:36:53.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.033+0000 7fd59759e700 1 -- 172.21.15.63:0/3789640901 wait complete. 2020-05-18T21:36:53.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd59759e700 1 Processor -- start 2020-05-18T21:36:53.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd59759e700 1 -- start start 2020-05-18T21:36:53.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd59759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd59805f3a0 0x7fd5981541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:53.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd59759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd598066aa0 0x7fd5981575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:53.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd59759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd598153810 con 0x7fd5981421b0 2020-05-18T21:36:53.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd59759e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd598153620 con 0x7fd59805f3a0 2020-05-18T21:36:53.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd59759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd598153ab0 con 0x7fd598066aa0 2020-05-18T21:36:53.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd596d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd5981421b0 0x7fd5980b2930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37188/0 (socket says 172.21.15.63:37188) 2020-05-18T21:36:53.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd59659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd59805f3a0 0x7fd5981541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:53.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd596d9d700 1 -- 172.21.15.63:0/912909284 learned_addr learned my addr 172.21.15.63:0/912909284 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:53.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd595d9b700 1 --2- 172.21.15.63:0/912909284 >> v2:172.21.15.155:3300/0 conn(0x7fd598066aa0 0x7fd5981575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:53.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd5877fe700 1 -- 172.21.15.63:0/912909284 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185618977 0 0) 0x7fd598153810 con 0x7fd5981421b0 2020-05-18T21:36:53.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd5877fe700 1 -- 172.21.15.63:0/912909284 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd574002fe0 con 0x7fd5981421b0 2020-05-18T21:36:53.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd595d9b700 1 -- 172.21.15.63:0/912909284 >> v2:172.21.15.63:3300/0 conn(0x7fd59805f3a0 msgr2=0x7fd5981541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:53.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd595d9b700 1 --2- 172.21.15.63:0/912909284 >> v2:172.21.15.63:3300/0 conn(0x7fd59805f3a0 0x7fd5981541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:53.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd595d9b700 1 -- 172.21.15.63:0/912909284 >> v1:172.21.15.63:6789/0 conn(0x7fd5981421b0 legacy=0x7fd5980b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:53.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd595d9b700 1 -- 172.21.15.63:0/912909284 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd598153d50 con 0x7fd598066aa0 2020-05-18T21:36:53.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd595d9b700 1 --2- 172.21.15.63:0/912909284 >> v2:172.21.15.155:3300/0 conn(0x7fd598066aa0 0x7fd5981575c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd58c002f70 tx=0x7fd58c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:53.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd595d9b700 1 --2- 172.21.15.63:0/912909284 >> v2:172.21.15.155:3300/0 conn(0x7fd598066aa0 0x7fd5981575c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd58c002f70 tx=0x7fd58c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:53.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.037+0000 7fd595d9b700 1 --2- 172.21.15.63:0/912909284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd598066aa0 0x7fd5981575c0 secure :-1 s=READY pgs=1238 cs=0 l=1 rx=0x7fd58c002f70 tx=0x7fd58c007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:53.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.041+0000 7fd595d9b700 1 --2- 172.21.15.63:0/912909284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd598066aa0 0x7fd5981575c0 secure :-1 s=THROTTLE_DONE pgs=1238 cs=0 l=1 rx=0x7fd58c002f70 tx=0x7fd58c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:53.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.041+0000 7fd5877fe700 1 -- 172.21.15.63:0/912909284 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd58c011850 con 0x7fd598066aa0 2020-05-18T21:36:53.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.041+0000 7fd595d9b700 1 --2- 172.21.15.63:0/912909284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd598066aa0 0x7fd5981575c0 secure :-1 s=THROTTLE_DONE pgs=1238 cs=0 l=1 rx=0x7fd58c002f70 tx=0x7fd58c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:53.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.041+0000 7fd5877fe700 1 -- 172.21.15.63:0/912909284 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58c0119b0 con 0x7fd598066aa0 2020-05-18T21:36:53.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.041+0000 7fd595d9b700 1 --2- 172.21.15.63:0/912909284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd598066aa0 0x7fd5981575c0 secure :-1 s=THROTTLE_DONE pgs=1238 cs=0 l=1 rx=0x7fd58c002f70 tx=0x7fd58c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:53.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.041+0000 7fd59759e700 1 -- 172.21.15.63:0/912909284 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd598157a20 con 0x7fd598066aa0 2020-05-18T21:36:53.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.041+0000 7fd5877fe700 1 -- 172.21.15.63:0/912909284 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd58c007360 con 0x7fd598066aa0 2020-05-18T21:36:53.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.041+0000 7fd59759e700 1 -- 172.21.15.63:0/912909284 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5980b90e0 con 0x7fd598066aa0 2020-05-18T21:36:53.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.041+0000 7fd59759e700 1 -- 172.21.15.63:0/912909284 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5980569e0 con 0x7fd598066aa0 2020-05-18T21:36:53.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.041+0000 7fd595d9b700 1 --2- 172.21.15.63:0/912909284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd598066aa0 0x7fd5981575c0 secure :-1 s=THROTTLE_DONE pgs=1238 cs=0 l=1 rx=0x7fd58c002f70 tx=0x7fd58c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:53.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.041+0000 7fd5877fe700 1 -- 172.21.15.63:0/912909284 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd58c005700 con 0x7fd598066aa0 2020-05-18T21:36:53.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.041+0000 7fd595d9b700 1 --2- 172.21.15.63:0/912909284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd598066aa0 0x7fd5981575c0 secure :-1 s=THROTTLE_DONE pgs=1238 cs=0 l=1 rx=0x7fd58c002f70 tx=0x7fd58c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:53.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.041+0000 7fd5877fe700 1 --2- 172.21.15.63:0/912909284 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd57404fdd0 0x7fd574052290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:53.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.041+0000 7fd5877fe700 1 -- 172.21.15.63:0/912909284 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd58c064410 con 0x7fd598066aa0 2020-05-18T21:36:53.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.041+0000 7fd59659c700 1 --2- 172.21.15.63:0/912909284 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd57404fdd0 0x7fd574052290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:53.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.041+0000 7fd59659c700 1 --2- 172.21.15.63:0/912909284 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd57404fdd0 0x7fd574052290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd588001110 tx=0x7fd588001d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:53.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.041+0000 7fd59659c700 1 --2- 172.21.15.63:0/912909284 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd57404fdd0 0x7fd574052290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd588001110 tx=0x7fd588001d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:53.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.041+0000 7fd59659c700 1 --2- 172.21.15.63:0/912909284 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd57404fdd0 0x7fd574052290 secure :-1 s=READY pgs=725 cs=0 l=1 rx=0x7fd588001110 tx=0x7fd588001d80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:53.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.049+0000 7fd595d9b700 1 --2- 172.21.15.63:0/912909284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd598066aa0 0x7fd5981575c0 secure :-1 s=THROTTLE_DONE pgs=1238 cs=0 l=1 rx=0x7fd58c002f70 tx=0x7fd58c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:53.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.049+0000 7fd5877fe700 1 -- 172.21.15.63:0/912909284 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd58c03e700 con 0x7fd598066aa0 2020-05-18T21:36:53.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.197+0000 7fd59759e700 1 -- 172.21.15.63:0/912909284 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd598064b40 con 0x7fd598066aa0 2020-05-18T21:36:53.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.197+0000 7fd595d9b700 1 --2- 172.21.15.63:0/912909284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd598066aa0 0x7fd5981575c0 secure :-1 s=THROTTLE_DONE pgs=1238 cs=0 l=1 rx=0x7fd58c002f70 tx=0x7fd58c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:53.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.197+0000 7fd5877fe700 1 -- 172.21.15.63:0/912909284 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+2167 (secure 0 0 0) 0x7fd58c041d20 con 0x7fd598066aa0 2020-05-18T21:36:53.204 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:53.205 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":116,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:36:46.268982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":9501,"mds_1":9379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9379":{"gid":9379,"name":"b","rank":1,"incarnation":108,"state":"up:stopping","state_seq":5,"addr":"172.21.15.155:6835/3918574447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3918574447},{"type":"v1","addr":"172.21.15.155:6835","nonce":3918574447}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[1],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:36:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.201+0000 7fd59759e700 1 -- 172.21.15.63:0/912909284 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd57404fdd0 msgr2=0x7fd574052290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.201+0000 7fd59759e700 1 --2- 172.21.15.63:0/912909284 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd57404fdd0 0x7fd574052290 secure :-1 s=READY pgs=725 cs=0 l=1 rx=0x7fd588001110 tx=0x7fd588001d80).stop 2020-05-18T21:36:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.201+0000 7fd59759e700 1 -- 172.21.15.63:0/912909284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd598066aa0 msgr2=0x7fd5981575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.201+0000 7fd59759e700 1 --2- 172.21.15.63:0/912909284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd598066aa0 0x7fd5981575c0 secure :-1 s=READY pgs=1238 cs=0 l=1 rx=0x7fd58c002f70 tx=0x7fd58c007a80).stop 2020-05-18T21:36:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.201+0000 7fd59759e700 1 -- 172.21.15.63:0/912909284 shutdown_connections 2020-05-18T21:36:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.201+0000 7fd59759e700 1 --2- 172.21.15.63:0/912909284 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd57404fdd0 0x7fd574052290 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.201+0000 7fd59759e700 1 --2- 172.21.15.63:0/912909284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd598066aa0 0x7fd5981575c0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.201+0000 7fd59759e700 1 --2- 172.21.15.63:0/912909284 >> v2:172.21.15.63:3300/0 conn(0x7fd59805f3a0 0x7fd5981541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:53.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.201+0000 7fd59759e700 1 -- 172.21.15.63:0/912909284 >> 172.21.15.63:0/912909284 conn(0x7fd59809db80 msgr2=0x7fd598065540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:53.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.201+0000 7fd59759e700 1 -- 172.21.15.63:0/912909284 shutdown_connections 2020-05-18T21:36:53.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:53.201+0000 7fd59759e700 1 -- 172.21.15.63:0/912909284 wait complete. 2020-05-18T21:36:53.208 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 116 2020-05-18T21:36:53.419 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 116, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:35:50.157703+0000', 'modified': '2020-05-18T21:36:46.268982+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 135, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 9501, 'mds_1': 9379}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9379': {'gid': 9379, 'name': 'b', 'rank': 1, 'incarnation': 108, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.155:6835/3918574447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3918574447}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3918574447}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_9501': {'gid': 9501, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/169345666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 169345666}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 169345666}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:36:53.420 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9379:up:stopping 2020-05-18T21:36:54.421 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:36:54.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e55255700 1 Processor -- start 2020-05-18T21:36:54.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e55255700 1 -- start start 2020-05-18T21:36:54.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e55255700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e5005f3a0 0x7f2e500b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:54.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e55255700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2e501421b0 0x7f2e50142660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:54.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e55255700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e500b3b40 con 0x7f2e50066aa0 2020-05-18T21:36:54.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e55255700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e50062970 con 0x7f2e501421b0 2020-05-18T21:36:54.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e55255700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e50062b60 con 0x7f2e5005f3a0 2020-05-18T21:36:54.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e54a54700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2e501421b0 0x7f2e50142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:54.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e54a54700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2e501421b0 0x7f2e50142660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35010/0 (socket says 172.21.15.63:35010) 2020-05-18T21:36:54.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e54a54700 1 -- 172.21.15.63:0/74338253 learned_addr learned my addr 172.21.15.63:0/74338253 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:36:54.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e4ffff700 1 --2- 172.21.15.63:0/74338253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e5005f3a0 0x7f2e500b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:54.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e54a54700 1 -- 172.21.15.63:0/74338253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e5005f3a0 msgr2=0x7f2e500b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:54.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e54a54700 1 --2- 172.21.15.63:0/74338253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e5005f3a0 0x7f2e500b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:54.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e54a54700 1 -- 172.21.15.63:0/74338253 >> v1:172.21.15.155:6789/0 conn(0x7f2e50066aa0 legacy=0x7f2e50063540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:54.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e54a54700 1 -- 172.21.15.63:0/74338253 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e50062e00 con 0x7f2e501421b0 2020-05-18T21:36:54.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e4ffff700 1 --2- 172.21.15.63:0/74338253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e5005f3a0 0x7f2e500b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:36:54.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e54a54700 1 --2- 172.21.15.63:0/74338253 >> v2:172.21.15.63:3300/0 conn(0x7f2e501421b0 0x7f2e50142660 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2e40002f70 tx=0x7f2e40007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:54.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e54a54700 1 --2- 172.21.15.63:0/74338253 >> v2:172.21.15.63:3300/0 conn(0x7f2e501421b0 0x7f2e50142660 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2e40002f70 tx=0x7f2e40007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:54.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e54a54700 1 --2- 172.21.15.63:0/74338253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e501421b0 0x7f2e50142660 secure :-1 s=READY pgs=1870 cs=0 l=1 rx=0x7f2e40002f70 tx=0x7f2e40007a80).ready entity=mon.0 client_cookie=12d7e7176daa2846 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:54.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e54a54700 1 --2- 172.21.15.63:0/74338253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e501421b0 0x7f2e50142660 secure :-1 s=THROTTLE_DONE pgs=1870 cs=0 l=1 rx=0x7f2e40002f70 tx=0x7f2e40007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:54.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e4effd700 1 -- 172.21.15.63:0/74338253 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e40011760 con 0x7f2e501421b0 2020-05-18T21:36:54.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e54a54700 1 --2- 172.21.15.63:0/74338253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e501421b0 0x7f2e50142660 secure :-1 s=THROTTLE_DONE pgs=1870 cs=0 l=1 rx=0x7f2e40002f70 tx=0x7f2e40007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:54.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e54a54700 1 --2- 172.21.15.63:0/74338253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e501421b0 0x7f2e50142660 secure :-1 s=THROTTLE_DONE pgs=1870 cs=0 l=1 rx=0x7f2e40002f70 tx=0x7f2e40007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:54.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e4effd700 1 -- 172.21.15.63:0/74338253 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e400118c0 con 0x7f2e501421b0 2020-05-18T21:36:54.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e4effd700 1 -- 172.21.15.63:0/74338253 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e40011ce0 con 0x7f2e501421b0 2020-05-18T21:36:54.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e55255700 1 -- 172.21.15.63:0/74338253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e501421b0 msgr2=0x7f2e50142660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:54.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.521+0000 7f2e55255700 1 --2- 172.21.15.63:0/74338253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e501421b0 0x7f2e50142660 secure :-1 s=READY pgs=1870 cs=0 l=1 rx=0x7f2e40002f70 tx=0x7f2e40007a80).stop 2020-05-18T21:36:54.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e55255700 1 -- 172.21.15.63:0/74338253 shutdown_connections 2020-05-18T21:36:54.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e55255700 1 --2- 172.21.15.63:0/74338253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e501421b0 0x7f2e50142660 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:54.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e55255700 1 --2- 172.21.15.63:0/74338253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e5005f3a0 0x7f2e500b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:54.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e55255700 1 -- 172.21.15.63:0/74338253 >> 172.21.15.63:0/74338253 conn(0x7f2e5009db80 msgr2=0x7f2e5009df90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:54.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e55255700 1 -- 172.21.15.63:0/74338253 shutdown_connections 2020-05-18T21:36:54.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e55255700 1 -- 172.21.15.63:0/74338253 wait complete. 2020-05-18T21:36:54.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e55255700 1 Processor -- start 2020-05-18T21:36:54.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e55255700 1 -- start start 2020-05-18T21:36:54.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e55255700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2e501421b0 0x7f2e50143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:54.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e55255700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e500b30a0 con 0x7f2e50066aa0 2020-05-18T21:36:54.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e55255700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e500b32d0 con 0x7f2e5005f3a0 2020-05-18T21:36:54.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e55255700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e500b0ac0 con 0x7f2e501421b0 2020-05-18T21:36:54.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e4f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2e50066aa0 0x7f2e500b2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37202/0 (socket says 172.21.15.63:37202) 2020-05-18T21:36:54.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e4f7fe700 1 -- 172.21.15.63:0/2358517406 learned_addr learned my addr 172.21.15.63:0/2358517406 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:54.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e54a54700 1 --2- 172.21.15.63:0/2358517406 >> v2:172.21.15.155:3300/0 conn(0x7f2e501421b0 0x7f2e50143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:54.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e4d7fa700 1 -- 172.21.15.63:0/2358517406 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781359015 0 0) 0x7f2e500b30a0 con 0x7f2e50066aa0 2020-05-18T21:36:54.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e4d7fa700 1 -- 172.21.15.63:0/2358517406 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e34002fe0 con 0x7f2e50066aa0 2020-05-18T21:36:54.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e4d7fa700 1 -- 172.21.15.63:0/2358517406 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3320241151 0 0) 0x7f2e34002fe0 con 0x7f2e50066aa0 2020-05-18T21:36:54.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e4d7fa700 1 -- 172.21.15.63:0/2358517406 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2e500b30a0 con 0x7f2e50066aa0 2020-05-18T21:36:54.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e4d7fa700 1 -- 172.21.15.63:0/2358517406 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f2e38001910 con 0x7f2e50066aa0 2020-05-18T21:36:54.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e4d7fa700 1 -- 172.21.15.63:0/2358517406 >> v2:172.21.15.155:3300/0 conn(0x7f2e501421b0 msgr2=0x7f2e50143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:54.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e4d7fa700 1 --2- 172.21.15.63:0/2358517406 >> v2:172.21.15.155:3300/0 conn(0x7f2e501421b0 0x7f2e50143320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:54.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e4d7fa700 1 -- 172.21.15.63:0/2358517406 >> v1:172.21.15.155:6789/0 conn(0x7f2e5005f3a0 legacy=0x7f2e5005a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:54.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e4d7fa700 1 -- 172.21.15.63:0/2358517406 >> v1:172.21.15.63:6789/0 conn(0x7f2e50066aa0 legacy=0x7f2e500b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:54.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e4d7fa700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e34004a80 0x7f2e34004e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:54.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e4d7fa700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e340039a0 0x7f2e34003e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:54.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e4d7fa700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e34004280 0x7f2e3400b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:54.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e4d7fa700 1 -- 172.21.15.63:0/2358517406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e500b0ac0 con 0x7f2e340039a0 2020-05-18T21:36:54.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e4d7fa700 1 -- 172.21.15.63:0/2358517406 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34004700 con 0x7f2e34004a80 2020-05-18T21:36:54.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e4d7fa700 1 -- 172.21.15.63:0/2358517406 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34004890 con 0x7f2e34004280 2020-05-18T21:36:54.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e54a54700 1 --2- 172.21.15.63:0/2358517406 >> v2:172.21.15.155:3300/0 conn(0x7f2e501421b0 0x7f2e50143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:36:54.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.525+0000 7f2e4f7fe700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e340039a0 0x7f2e34003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:54.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4ffff700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e34004a80 0x7f2e34004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:54.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e54a54700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e34004280 0x7f2e3400b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:54.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4f7fe700 1 -- 172.21.15.63:0/2358517406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e34004280 msgr2=0x7f2e3400b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:54.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4f7fe700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e34004280 0x7f2e3400b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:54.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4f7fe700 1 -- 172.21.15.63:0/2358517406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e34004a80 msgr2=0x7f2e34004e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:54.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4f7fe700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e34004a80 0x7f2e34004e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:54.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4f7fe700 1 -- 172.21.15.63:0/2358517406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e500b2430 con 0x7f2e340039a0 2020-05-18T21:36:54.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e54a54700 1 -- 172.21.15.63:0/2358517406 reap_dead start 2020-05-18T21:36:54.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e55255700 1 -- 172.21.15.63:0/2358517406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5005a910 con 0x7f2e340039a0 2020-05-18T21:36:54.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4f7fe700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e340039a0 0x7f2e34003e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2e38001620 tx=0x7f2e380113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:54.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e55255700 1 -- 172.21.15.63:0/2358517406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5005ade0 con 0x7f2e340039a0 2020-05-18T21:36:54.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4f7fe700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e340039a0 0x7f2e34003e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2e38001620 tx=0x7f2e380113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:54.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4f7fe700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e340039a0 0x7f2e34003e20 secure :-1 s=READY pgs=1872 cs=0 l=1 rx=0x7f2e38001620 tx=0x7f2e380113e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:54.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4f7fe700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e340039a0 0x7f2e34003e20 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7f2e38001620 tx=0x7f2e380113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:54.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4f7fe700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e340039a0 0x7f2e34003e20 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7f2e38001620 tx=0x7f2e380113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:54.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4d7fa700 1 -- 172.21.15.63:0/2358517406 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e38011e20 con 0x7f2e340039a0 2020-05-18T21:36:54.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4f7fe700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e340039a0 0x7f2e34003e20 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7f2e38001620 tx=0x7f2e380113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:54.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4d7fa700 1 -- 172.21.15.63:0/2358517406 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e380101c0 con 0x7f2e340039a0 2020-05-18T21:36:54.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4d7fa700 1 -- 172.21.15.63:0/2358517406 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e38010560 con 0x7f2e340039a0 2020-05-18T21:36:54.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4f7fe700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e340039a0 0x7f2e34003e20 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7f2e38001620 tx=0x7f2e380113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:54.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e55255700 1 -- 172.21.15.63:0/2358517406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e28003380 con 0x7f2e340039a0 2020-05-18T21:36:54.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4d7fa700 1 -- 172.21.15.63:0/2358517406 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2e380106c0 con 0x7f2e340039a0 2020-05-18T21:36:54.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4f7fe700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e340039a0 0x7f2e34003e20 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7f2e38001620 tx=0x7f2e380113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:54.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4d7fa700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e34053880 0x7f2e34055d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:54.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4d7fa700 1 -- 172.21.15.63:0/2358517406 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f2e38063f60 con 0x7f2e340039a0 2020-05-18T21:36:54.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4ffff700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e34053880 0x7f2e34055d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:54.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.529+0000 7f2e4ffff700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e34053880 0x7f2e34055d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2e480032b0 tx=0x7f2e48007260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:54.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.533+0000 7f2e4ffff700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e34053880 0x7f2e34055d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2e480032b0 tx=0x7f2e48007260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:54.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.533+0000 7f2e4ffff700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e34053880 0x7f2e34055d40 secure :-1 s=READY pgs=726 cs=0 l=1 rx=0x7f2e480032b0 tx=0x7f2e48007260).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:54.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.537+0000 7f2e4f7fe700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e340039a0 0x7f2e34003e20 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7f2e38001620 tx=0x7f2e380113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:54.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.537+0000 7f2e4d7fa700 1 -- 172.21.15.63:0/2358517406 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2e3803e3b0 con 0x7f2e340039a0 2020-05-18T21:36:54.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.685+0000 7f2e55255700 1 -- 172.21.15.63:0/2358517406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e28003720 con 0x7f2e340039a0 2020-05-18T21:36:54.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.685+0000 7f2e4f7fe700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e340039a0 0x7f2e34003e20 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7f2e38001620 tx=0x7f2e380113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:54.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.685+0000 7f2e4d7fa700 1 -- 172.21.15.63:0/2358517406 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+2167 (secure 0 0 0) 0x7f2e380419d0 con 0x7f2e340039a0 2020-05-18T21:36:54.691 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:54.692 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":116,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:36:46.268982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":9501,"mds_1":9379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9379":{"gid":9379,"name":"b","rank":1,"incarnation":108,"state":"up:stopping","state_seq":5,"addr":"172.21.15.155:6835/3918574447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3918574447},{"type":"v1","addr":"172.21.15.155:6835","nonce":3918574447}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[1],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:36:54.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.685+0000 7f2e55255700 1 -- 172.21.15.63:0/2358517406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e34053880 msgr2=0x7f2e34055d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:54.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.685+0000 7f2e55255700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e34053880 0x7f2e34055d40 secure :-1 s=READY pgs=726 cs=0 l=1 rx=0x7f2e480032b0 tx=0x7f2e48007260).stop 2020-05-18T21:36:54.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.685+0000 7f2e55255700 1 -- 172.21.15.63:0/2358517406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e340039a0 msgr2=0x7f2e34003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:54.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.685+0000 7f2e55255700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e340039a0 0x7f2e34003e20 secure :-1 s=READY pgs=1872 cs=0 l=1 rx=0x7f2e38001620 tx=0x7f2e380113e0).stop 2020-05-18T21:36:54.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.685+0000 7f2e55255700 1 -- 172.21.15.63:0/2358517406 shutdown_connections 2020-05-18T21:36:54.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.685+0000 7f2e55255700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2e34053880 0x7f2e34055d40 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:54.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.685+0000 7f2e55255700 1 --2- 172.21.15.63:0/2358517406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e340039a0 0x7f2e34003e20 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:54.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.685+0000 7f2e55255700 1 -- 172.21.15.63:0/2358517406 >> 172.21.15.63:0/2358517406 conn(0x7f2e5009db80 msgr2=0x7f2e50065430 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:54.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.689+0000 7f2e55255700 1 -- 172.21.15.63:0/2358517406 shutdown_connections 2020-05-18T21:36:54.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:54.689+0000 7f2e55255700 1 -- 172.21.15.63:0/2358517406 wait complete. 2020-05-18T21:36:54.696 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 116 2020-05-18T21:36:54.906 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 116, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:35:50.157703+0000', 'modified': '2020-05-18T21:36:46.268982+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 135, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 9501, 'mds_1': 9379}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9379': {'gid': 9379, 'name': 'b', 'rank': 1, 'incarnation': 108, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.155:6835/3918574447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3918574447}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3918574447}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_9501': {'gid': 9501, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/169345666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 169345666}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 169345666}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:36:54.907 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9379:up:stopping 2020-05-18T21:36:55.908 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:36:56.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583f59e700 1 Processor -- start 2020-05-18T21:36:56.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583f59e700 1 -- start start 2020-05-18T21:36:56.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583f59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f584005aab0 0x7f584005b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:56.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5840147e60 0x7f5840140d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:56.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583f59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f58401411d0 0x7f5840143c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:56.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583f59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5840147250 con 0x7f58401411d0 2020-05-18T21:36:56.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583f59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5840147480 con 0x7f584005aab0 2020-05-18T21:36:56.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583f59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5840147720 con 0x7f5840147e60 2020-05-18T21:36:56.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583ed9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f58401411d0 0x7f5840143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:56.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583e59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f584005aab0 0x7f584005b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:56.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583dd9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5840147e60 0x7f5840140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:56.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583ed9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f58401411d0 0x7f5840143c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35030/0 (socket says 172.21.15.63:35030) 2020-05-18T21:36:56.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583e59c700 1 --2- 172.21.15.63:0/1492517319 >> v2:172.21.15.155:3300/0 conn(0x7f584005aab0 0x7f584005b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:49874/0 (socket says 172.21.15.63:49874) 2020-05-18T21:36:56.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583ed9d700 1 -- 172.21.15.63:0/1492517319 learned_addr learned my addr 172.21.15.63:0/1492517319 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:36:56.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583ed9d700 1 -- 172.21.15.63:0/1492517319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5840147e60 msgr2=0x7f5840140d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:56.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583ed9d700 1 --2- 172.21.15.63:0/1492517319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5840147e60 0x7f5840140d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:56.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583ed9d700 1 -- 172.21.15.63:0/1492517319 >> v2:172.21.15.155:3300/0 conn(0x7f584005aab0 msgr2=0x7f584005b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:56.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583ed9d700 1 --2- 172.21.15.63:0/1492517319 >> v2:172.21.15.155:3300/0 conn(0x7f584005aab0 0x7f584005b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:56.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583ed9d700 1 -- 172.21.15.63:0/1492517319 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58401479c0 con 0x7f58401411d0 2020-05-18T21:36:56.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583e59c700 1 --2- 172.21.15.63:0/1492517319 >> v2:172.21.15.155:3300/0 conn(0x7f584005aab0 0x7f584005b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:36:56.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583ed9d700 1 --2- 172.21.15.63:0/1492517319 >> v2:172.21.15.63:3300/0 conn(0x7f58401411d0 0x7f5840143c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5838002f70 tx=0x7f5838007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:56.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583ed9d700 1 --2- 172.21.15.63:0/1492517319 >> v2:172.21.15.63:3300/0 conn(0x7f58401411d0 0x7f5840143c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5838002f70 tx=0x7f5838007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:56.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583ed9d700 1 --2- 172.21.15.63:0/1492517319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58401411d0 0x7f5840143c40 secure :-1 s=READY pgs=1873 cs=0 l=1 rx=0x7f5838002f70 tx=0x7f5838007a80).ready entity=mon.0 client_cookie=4ef3940cf72cca57 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:56.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583ed9d700 1 --2- 172.21.15.63:0/1492517319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58401411d0 0x7f5840143c40 secure :-1 s=THROTTLE_DONE pgs=1873 cs=0 l=1 rx=0x7f5838002f70 tx=0x7f5838007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:56.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583d59a700 1 -- 172.21.15.63:0/1492517319 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5838011600 con 0x7f58401411d0 2020-05-18T21:36:56.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583ed9d700 1 --2- 172.21.15.63:0/1492517319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58401411d0 0x7f5840143c40 secure :-1 s=THROTTLE_DONE pgs=1873 cs=0 l=1 rx=0x7f5838002f70 tx=0x7f5838007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:56.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583d59a700 1 -- 172.21.15.63:0/1492517319 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5838011760 con 0x7f58401411d0 2020-05-18T21:36:56.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583ed9d700 1 --2- 172.21.15.63:0/1492517319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58401411d0 0x7f5840143c40 secure :-1 s=THROTTLE_DONE pgs=1873 cs=0 l=1 rx=0x7f5838002f70 tx=0x7f5838007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:56.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.017+0000 7f583f59e700 1 -- 172.21.15.63:0/1492517319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58401411d0 msgr2=0x7f5840143c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:56.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.021+0000 7f583d59a700 1 -- 172.21.15.63:0/1492517319 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5838011b80 con 0x7f58401411d0 2020-05-18T21:36:56.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.021+0000 7f583f59e700 1 --2- 172.21.15.63:0/1492517319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58401411d0 0x7f5840143c40 secure :-1 s=READY pgs=1873 cs=0 l=1 rx=0x7f5838002f70 tx=0x7f5838007a80).stop 2020-05-18T21:36:56.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.021+0000 7f583f59e700 1 -- 172.21.15.63:0/1492517319 shutdown_connections 2020-05-18T21:36:56.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.021+0000 7f583f59e700 1 --2- 172.21.15.63:0/1492517319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58401411d0 0x7f5840143c40 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:56.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.021+0000 7f583f59e700 1 --2- 172.21.15.63:0/1492517319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5840147e60 0x7f5840140d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:56.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.021+0000 7f583f59e700 1 --2- 172.21.15.63:0/1492517319 >> v2:172.21.15.155:3300/0 conn(0x7f584005aab0 0x7f584005b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:56.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.021+0000 7f583f59e700 1 -- 172.21.15.63:0/1492517319 >> 172.21.15.63:0/1492517319 conn(0x7f58400b8340 msgr2=0x7f58400b8750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:56.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.021+0000 7f583f59e700 1 -- 172.21.15.63:0/1492517319 shutdown_connections 2020-05-18T21:36:56.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.021+0000 7f583f59e700 1 -- 172.21.15.63:0/1492517319 wait complete. 2020-05-18T21:36:56.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.021+0000 7f583f59e700 1 Processor -- start 2020-05-18T21:36:56.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.021+0000 7f583f59e700 1 -- start start 2020-05-18T21:36:56.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.021+0000 7f583f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f584005aab0 0x7f5840142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:56.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.021+0000 7f583f59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f58401411d0 0x7f58400b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:56.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.021+0000 7f583f59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58400b2610 con 0x7f5840147e60 2020-05-18T21:36:56.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.021+0000 7f583f59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5840143e40 con 0x7f58401411d0 2020-05-18T21:36:56.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.021+0000 7f583f59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58401440e0 con 0x7f584005aab0 2020-05-18T21:36:56.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f583dd9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f58401411d0 0x7f58400b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:56.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f583dd9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f58401411d0 0x7f58400b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35034/0 (socket says 172.21.15.63:35034) 2020-05-18T21:36:56.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f583dd9b700 1 -- 172.21.15.63:0/504971314 learned_addr learned my addr 172.21.15.63:0/504971314 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:36:56.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f583e59c700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f584005aab0 0x7f5840142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:56.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f583dd9b700 1 -- 172.21.15.63:0/504971314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f584005aab0 msgr2=0x7f5840142a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:56.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f583dd9b700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f584005aab0 0x7f5840142a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:56.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f583dd9b700 1 -- 172.21.15.63:0/504971314 >> v1:172.21.15.155:6789/0 conn(0x7f5840147e60 legacy=0x7f584013d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:56.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f583dd9b700 1 -- 172.21.15.63:0/504971314 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58400ac6d0 con 0x7f58401411d0 2020-05-18T21:36:56.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f583dd9b700 1 --2- 172.21.15.63:0/504971314 >> v2:172.21.15.63:3300/0 conn(0x7f58401411d0 0x7f58400b21b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5838007f10 tx=0x7f5828010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:56.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f583dd9b700 1 --2- 172.21.15.63:0/504971314 >> v2:172.21.15.63:3300/0 conn(0x7f58401411d0 0x7f58400b21b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5838007f10 tx=0x7f5828010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:56.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f583dd9b700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58401411d0 0x7f58400b21b0 secure :-1 s=READY pgs=1874 cs=0 l=1 rx=0x7f5838007f10 tx=0x7f5828010d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:56.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f583dd9b700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58401411d0 0x7f58400b21b0 secure :-1 s=THROTTLE_DONE pgs=1874 cs=0 l=1 rx=0x7f5838007f10 tx=0x7f5828010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:56.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f58377fe700 1 -- 172.21.15.63:0/504971314 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5828008d90 con 0x7f58401411d0 2020-05-18T21:36:56.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f583dd9b700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58401411d0 0x7f58400b21b0 secure :-1 s=THROTTLE_DONE pgs=1874 cs=0 l=1 rx=0x7f5838007f10 tx=0x7f5828010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:56.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f583dd9b700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58401411d0 0x7f58400b21b0 secure :-1 s=THROTTLE_DONE pgs=1874 cs=0 l=1 rx=0x7f5838007f10 tx=0x7f5828010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:56.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f58377fe700 1 -- 172.21.15.63:0/504971314 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5828012660 con 0x7f58401411d0 2020-05-18T21:36:56.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f583f59e700 1 -- 172.21.15.63:0/504971314 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584013dac0 con 0x7f58401411d0 2020-05-18T21:36:56.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f58377fe700 1 -- 172.21.15.63:0/504971314 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58280129c0 con 0x7f58401411d0 2020-05-18T21:36:56.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f583f59e700 1 -- 172.21.15.63:0/504971314 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5840143b40 con 0x7f58401411d0 2020-05-18T21:36:56.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f583dd9b700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58401411d0 0x7f58400b21b0 secure :-1 s=THROTTLE_DONE pgs=1874 cs=0 l=1 rx=0x7f5838007f10 tx=0x7f5828010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:56.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f583f59e700 1 -- 172.21.15.63:0/504971314 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58400569e0 con 0x7f58401411d0 2020-05-18T21:36:56.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f58377fe700 1 -- 172.21.15.63:0/504971314 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f58280120d0 con 0x7f58401411d0 2020-05-18T21:36:56.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f583dd9b700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58401411d0 0x7f58400b21b0 secure :-1 s=THROTTLE_DONE pgs=1874 cs=0 l=1 rx=0x7f5838007f10 tx=0x7f5828010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:56.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f58377fe700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f582404fa90 0x7f5824051f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:56.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.025+0000 7f58377fe700 1 -- 172.21.15.63:0/504971314 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f5828063ad0 con 0x7f58401411d0 2020-05-18T21:36:56.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.029+0000 7f583e59c700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f582404fa90 0x7f5824051f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:56.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.029+0000 7f583e59c700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f582404fa90 0x7f5824051f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58300032f0 tx=0x7f583000ef60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:56.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.029+0000 7f583e59c700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f582404fa90 0x7f5824051f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58300032f0 tx=0x7f583000ef60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:56.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.029+0000 7f583e59c700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f582404fa90 0x7f5824051f50 secure :-1 s=READY pgs=727 cs=0 l=1 rx=0x7f58300032f0 tx=0x7f583000ef60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:56.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.037+0000 7f583dd9b700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58401411d0 0x7f58400b21b0 secure :-1 s=THROTTLE_DONE pgs=1874 cs=0 l=1 rx=0x7f5838007f10 tx=0x7f5828010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:56.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.037+0000 7f58377fe700 1 -- 172.21.15.63:0/504971314 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f582803de60 con 0x7f58401411d0 2020-05-18T21:36:56.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.189+0000 7f583f59e700 1 -- 172.21.15.63:0/504971314 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5840145390 con 0x7f58401411d0 2020-05-18T21:36:56.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.189+0000 7f583dd9b700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58401411d0 0x7f58400b21b0 secure :-1 s=THROTTLE_DONE pgs=1874 cs=0 l=1 rx=0x7f5838007f10 tx=0x7f5828010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:56.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.189+0000 7f58377fe700 1 -- 172.21.15.63:0/504971314 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+2167 (secure 0 0 0) 0x7f5828041480 con 0x7f58401411d0 2020-05-18T21:36:56.195 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:56.195 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":116,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:36:46.268982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":9501,"mds_1":9379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9379":{"gid":9379,"name":"b","rank":1,"incarnation":108,"state":"up:stopping","state_seq":5,"addr":"172.21.15.155:6835/3918574447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3918574447},{"type":"v1","addr":"172.21.15.155:6835","nonce":3918574447}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[1],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:36:56.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.189+0000 7f583f59e700 1 -- 172.21.15.63:0/504971314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f582404fa90 msgr2=0x7f5824051f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:56.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.189+0000 7f583f59e700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f582404fa90 0x7f5824051f50 secure :-1 s=READY pgs=727 cs=0 l=1 rx=0x7f58300032f0 tx=0x7f583000ef60).stop 2020-05-18T21:36:56.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.189+0000 7f583f59e700 1 -- 172.21.15.63:0/504971314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58401411d0 msgr2=0x7f58400b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:56.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.189+0000 7f583f59e700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58401411d0 0x7f58400b21b0 secure :-1 s=READY pgs=1874 cs=0 l=1 rx=0x7f5838007f10 tx=0x7f5828010d40).stop 2020-05-18T21:36:56.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.189+0000 7f583f59e700 1 -- 172.21.15.63:0/504971314 shutdown_connections 2020-05-18T21:36:56.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.189+0000 7f583f59e700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f582404fa90 0x7f5824051f50 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:56.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.189+0000 7f583f59e700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58401411d0 0x7f58400b21b0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:56.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.189+0000 7f583f59e700 1 --2- 172.21.15.63:0/504971314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f584005aab0 0x7f5840142a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.189+0000 7f583f59e700 1 -- 172.21.15.63:0/504971314 >> 172.21.15.63:0/504971314 conn(0x7f58400b8340 msgr2=0x7f58400b8850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.189+0000 7f583f59e700 1 -- 172.21.15.63:0/504971314 shutdown_connections 2020-05-18T21:36:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:56.189+0000 7f583f59e700 1 -- 172.21.15.63:0/504971314 wait complete. 2020-05-18T21:36:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 116 2020-05-18T21:36:56.409 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 116, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:35:50.157703+0000', 'modified': '2020-05-18T21:36:46.268982+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 135, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 9501, 'mds_1': 9379}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9379': {'gid': 9379, 'name': 'b', 'rank': 1, 'incarnation': 108, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.155:6835/3918574447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3918574447}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3918574447}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_9501': {'gid': 9501, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/169345666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 169345666}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 169345666}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:36:56.410 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9379:up:stopping 2020-05-18T21:36:57.411 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:36:57.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.513+0000 7f3a2359e700 1 Processor -- start 2020-05-18T21:36:57.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.513+0000 7f3a2359e700 1 -- start start 2020-05-18T21:36:57.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a2359e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3a24065b30 0x7f3a240b9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:57.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a2359e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a241494e0 0x7f3a24149970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:57.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a2359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a240b92b0 con 0x7f3a240bc9b0 2020-05-18T21:36:57.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a2359e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a240b9550 con 0x7f3a24065b30 2020-05-18T21:36:57.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a2359e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a240b97f0 con 0x7f3a241494e0 2020-05-18T21:36:57.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a21d9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3a24065b30 0x7f3a240b9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:57.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a22d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a241494e0 0x7f3a24149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:57.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a21d9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3a24065b30 0x7f3a240b9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:49890/0 (socket says 172.21.15.63:49890) 2020-05-18T21:36:57.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a21d9b700 1 -- 172.21.15.63:0/2596720129 learned_addr learned my addr 172.21.15.63:0/2596720129 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:36:57.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a2259c700 1 --1- 172.21.15.63:0/2596720129 >> v1:172.21.15.155:6789/0 conn(0x7f3a240bc9b0 0x7f3a2412e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:35544/0 (socket says 172.21.15.63:35544) 2020-05-18T21:36:57.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a22d9d700 1 -- 172.21.15.63:0/2596720129 >> v2:172.21.15.155:3300/0 conn(0x7f3a24065b30 msgr2=0x7f3a240b9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:36:57.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a22d9d700 1 --2- 172.21.15.63:0/2596720129 >> v2:172.21.15.155:3300/0 conn(0x7f3a24065b30 0x7f3a240b9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:57.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a22d9d700 1 -- 172.21.15.63:0/2596720129 >> v1:172.21.15.155:6789/0 conn(0x7f3a240bc9b0 legacy=0x7f3a2412e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:57.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a22d9d700 1 -- 172.21.15.63:0/2596720129 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2412f620 con 0x7f3a241494e0 2020-05-18T21:36:57.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a21d9b700 1 --2- 172.21.15.63:0/2596720129 >> v2:172.21.15.155:3300/0 conn(0x7f3a24065b30 0x7f3a240b9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:36:57.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a22d9d700 1 --2- 172.21.15.63:0/2596720129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a241494e0 0x7f3a24149970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3a240b7aa0 tx=0x7f3a1c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:57.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a22d9d700 1 --2- 172.21.15.63:0/2596720129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a241494e0 0x7f3a24149970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3a240b7aa0 tx=0x7f3a1c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:57.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a22d9d700 1 --2- 172.21.15.63:0/2596720129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a241494e0 0x7f3a24149970 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7f3a240b7aa0 tx=0x7f3a1c008ca0).ready entity=mon.2 client_cookie=1b0cce74df59ea38 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:57.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a22d9d700 1 --2- 172.21.15.63:0/2596720129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a241494e0 0x7f3a24149970 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f3a240b7aa0 tx=0x7f3a1c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:57.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a2159a700 1 -- 172.21.15.63:0/2596720129 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a1c011e60 con 0x7f3a241494e0 2020-05-18T21:36:57.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a22d9d700 1 --2- 172.21.15.63:0/2596720129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a241494e0 0x7f3a24149970 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f3a240b7aa0 tx=0x7f3a1c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:57.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a22d9d700 1 --2- 172.21.15.63:0/2596720129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a241494e0 0x7f3a24149970 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f3a240b7aa0 tx=0x7f3a1c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:57.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a2159a700 1 -- 172.21.15.63:0/2596720129 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1c00a180 con 0x7f3a241494e0 2020-05-18T21:36:57.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a2159a700 1 -- 172.21.15.63:0/2596720129 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a1c00a560 con 0x7f3a241494e0 2020-05-18T21:36:57.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a2359e700 1 -- 172.21.15.63:0/2596720129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a241494e0 msgr2=0x7f3a24149970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:57.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a2359e700 1 --2- 172.21.15.63:0/2596720129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a241494e0 0x7f3a24149970 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7f3a240b7aa0 tx=0x7f3a1c008ca0).stop 2020-05-18T21:36:57.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a2359e700 1 -- 172.21.15.63:0/2596720129 shutdown_connections 2020-05-18T21:36:57.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a2359e700 1 --2- 172.21.15.63:0/2596720129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a241494e0 0x7f3a24149970 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:57.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a2359e700 1 --2- 172.21.15.63:0/2596720129 >> v2:172.21.15.155:3300/0 conn(0x7f3a24065b30 0x7f3a240b9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:36:57.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a2359e700 1 -- 172.21.15.63:0/2596720129 >> 172.21.15.63:0/2596720129 conn(0x7f3a2406a360 msgr2=0x7f3a2405a770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:57.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a2359e700 1 -- 172.21.15.63:0/2596720129 shutdown_connections 2020-05-18T21:36:57.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.517+0000 7f3a2359e700 1 -- 172.21.15.63:0/2596720129 wait complete. 2020-05-18T21:36:57.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a2359e700 1 Processor -- start 2020-05-18T21:36:57.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a2359e700 1 -- start start 2020-05-18T21:36:57.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a2359e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a24065b30 0x7f3a240a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:57.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a2359e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3a240bc9b0 0x7f3a240a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:57.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a2359e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3a241494e0 0x7f3a24148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:57.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a2359e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a241489a0 con 0x7f3a241494e0 2020-05-18T21:36:57.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a2359e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a241539b0 con 0x7f3a240bc9b0 2020-05-18T21:36:57.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a2359e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a24153c50 con 0x7f3a24065b30 2020-05-18T21:36:57.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a22d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3a241494e0 0x7f3a24148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:57.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a21d9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3a240bc9b0 0x7f3a240a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:57.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a2259c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a24065b30 0x7f3a240a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:57.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a22d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3a241494e0 0x7f3a24148540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35050/0 (socket says 172.21.15.63:35050) 2020-05-18T21:36:57.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a21d9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3a240bc9b0 0x7f3a240a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:49896/0 (socket says 172.21.15.63:49896) 2020-05-18T21:36:57.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a22d9d700 1 -- 172.21.15.63:0/3079783588 learned_addr learned my addr 172.21.15.63:0/3079783588 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:36:57.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a22d9d700 1 -- 172.21.15.63:0/3079783588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a24065b30 msgr2=0x7f3a240a1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:57.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a22d9d700 1 --2- 172.21.15.63:0/3079783588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a24065b30 0x7f3a240a1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:57.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a22d9d700 1 -- 172.21.15.63:0/3079783588 >> v2:172.21.15.155:3300/0 conn(0x7f3a240bc9b0 msgr2=0x7f3a240a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:57.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a22d9d700 1 --2- 172.21.15.63:0/3079783588 >> v2:172.21.15.155:3300/0 conn(0x7f3a240bc9b0 0x7f3a240a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:57.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a22d9d700 1 -- 172.21.15.63:0/3079783588 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a241536a0 con 0x7f3a241494e0 2020-05-18T21:36:57.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a22d9d700 1 --2- 172.21.15.63:0/3079783588 >> v2:172.21.15.63:3300/0 conn(0x7f3a241494e0 0x7f3a24148540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3a240b7aa0 tx=0x7f3a2412f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:57.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a22d9d700 1 --2- 172.21.15.63:0/3079783588 >> v2:172.21.15.63:3300/0 conn(0x7f3a241494e0 0x7f3a24148540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3a240b7aa0 tx=0x7f3a2412f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:57.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a22d9d700 1 --2- 172.21.15.63:0/3079783588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a241494e0 0x7f3a24148540 secure :-1 s=READY pgs=1875 cs=0 l=1 rx=0x7f3a240b7aa0 tx=0x7f3a2412f7b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:57.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a22d9d700 1 --2- 172.21.15.63:0/3079783588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a241494e0 0x7f3a24148540 secure :-1 s=THROTTLE_DONE pgs=1875 cs=0 l=1 rx=0x7f3a240b7aa0 tx=0x7f3a2412f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:57.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a22d9d700 1 --2- 172.21.15.63:0/3079783588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a241494e0 0x7f3a24148540 secure :-1 s=THROTTLE_DONE pgs=1875 cs=0 l=1 rx=0x7f3a240b7aa0 tx=0x7f3a2412f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:57.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a137fe700 1 -- 172.21.15.63:0/3079783588 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a1c005c70 con 0x7f3a241494e0 2020-05-18T21:36:57.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a22d9d700 1 --2- 172.21.15.63:0/3079783588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a241494e0 0x7f3a24148540 secure :-1 s=THROTTLE_DONE pgs=1875 cs=0 l=1 rx=0x7f3a240b7aa0 tx=0x7f3a2412f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:57.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a137fe700 1 -- 172.21.15.63:0/3079783588 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1c005e10 con 0x7f3a241494e0 2020-05-18T21:36:57.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a137fe700 1 -- 172.21.15.63:0/3079783588 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a1c007360 con 0x7f3a241494e0 2020-05-18T21:36:57.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a2359e700 1 -- 172.21.15.63:0/3079783588 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a24148c60 con 0x7f3a241494e0 2020-05-18T21:36:57.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.521+0000 7f3a2359e700 1 -- 172.21.15.63:0/3079783588 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a24154310 con 0x7f3a241494e0 2020-05-18T21:36:57.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.525+0000 7f3a2359e700 1 -- 172.21.15.63:0/3079783588 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a240569e0 con 0x7f3a241494e0 2020-05-18T21:36:57.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.525+0000 7f3a22d9d700 1 --2- 172.21.15.63:0/3079783588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a241494e0 0x7f3a24148540 secure :-1 s=THROTTLE_DONE pgs=1875 cs=0 l=1 rx=0x7f3a240b7aa0 tx=0x7f3a2412f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:57.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.525+0000 7f3a137fe700 1 -- 172.21.15.63:0/3079783588 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3a1c0075d0 con 0x7f3a241494e0 2020-05-18T21:36:57.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.525+0000 7f3a22d9d700 1 --2- 172.21.15.63:0/3079783588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a241494e0 0x7f3a24148540 secure :-1 s=THROTTLE_DONE pgs=1875 cs=0 l=1 rx=0x7f3a240b7aa0 tx=0x7f3a2412f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:57.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.525+0000 7f3a137fe700 1 --2- 172.21.15.63:0/3079783588 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a0004fa50 0x7f3a00051f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:57.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.525+0000 7f3a137fe700 1 -- 172.21.15.63:0/3079783588 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f3a1c0649d0 con 0x7f3a241494e0 2020-05-18T21:36:57.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.525+0000 7f3a2259c700 1 --2- 172.21.15.63:0/3079783588 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a0004fa50 0x7f3a00051f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:57.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.525+0000 7f3a2259c700 1 --2- 172.21.15.63:0/3079783588 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a0004fa50 0x7f3a00051f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3a240b6c80 tx=0x7f3a18001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:57.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.525+0000 7f3a2259c700 1 --2- 172.21.15.63:0/3079783588 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a0004fa50 0x7f3a00051f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3a240b6c80 tx=0x7f3a18001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:57.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.525+0000 7f3a2259c700 1 --2- 172.21.15.63:0/3079783588 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a0004fa50 0x7f3a00051f10 secure :-1 s=READY pgs=728 cs=0 l=1 rx=0x7f3a240b6c80 tx=0x7f3a18001de0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:57.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.533+0000 7f3a22d9d700 1 --2- 172.21.15.63:0/3079783588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a241494e0 0x7f3a24148540 secure :-1 s=THROTTLE_DONE pgs=1875 cs=0 l=1 rx=0x7f3a240b7aa0 tx=0x7f3a2412f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:57.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.533+0000 7f3a137fe700 1 -- 172.21.15.63:0/3079783588 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3a1c03edc0 con 0x7f3a241494e0 2020-05-18T21:36:57.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.681+0000 7f3a2359e700 1 -- 172.21.15.63:0/3079783588 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a24065910 con 0x7f3a241494e0 2020-05-18T21:36:57.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.681+0000 7f3a22d9d700 1 --2- 172.21.15.63:0/3079783588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a241494e0 0x7f3a24148540 secure :-1 s=THROTTLE_DONE pgs=1875 cs=0 l=1 rx=0x7f3a240b7aa0 tx=0x7f3a2412f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:57.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.681+0000 7f3a137fe700 1 -- 172.21.15.63:0/3079783588 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+2167 (secure 0 0 0) 0x7f3a1c0423e0 con 0x7f3a241494e0 2020-05-18T21:36:57.687 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:57.687 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":116,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:36:46.268982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":9501,"mds_1":9379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9379":{"gid":9379,"name":"b","rank":1,"incarnation":108,"state":"up:stopping","state_seq":5,"addr":"172.21.15.155:6835/3918574447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3918574447},{"type":"v1","addr":"172.21.15.155:6835","nonce":3918574447}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[1],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:36:57.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.681+0000 7f3a2359e700 1 -- 172.21.15.63:0/3079783588 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a0004fa50 msgr2=0x7f3a00051f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:57.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.681+0000 7f3a2359e700 1 --2- 172.21.15.63:0/3079783588 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a0004fa50 0x7f3a00051f10 secure :-1 s=READY pgs=728 cs=0 l=1 rx=0x7f3a240b6c80 tx=0x7f3a18001de0).stop 2020-05-18T21:36:57.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.681+0000 7f3a2359e700 1 -- 172.21.15.63:0/3079783588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a241494e0 msgr2=0x7f3a24148540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:57.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.681+0000 7f3a2359e700 1 --2- 172.21.15.63:0/3079783588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a241494e0 0x7f3a24148540 secure :-1 s=READY pgs=1875 cs=0 l=1 rx=0x7f3a240b7aa0 tx=0x7f3a2412f7b0).stop 2020-05-18T21:36:57.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.681+0000 7f3a2359e700 1 -- 172.21.15.63:0/3079783588 shutdown_connections 2020-05-18T21:36:57.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.681+0000 7f3a2359e700 1 --2- 172.21.15.63:0/3079783588 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a0004fa50 0x7f3a00051f10 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:57.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.681+0000 7f3a2359e700 1 --2- 172.21.15.63:0/3079783588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a241494e0 0x7f3a24148540 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:57.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.681+0000 7f3a2359e700 1 --2- 172.21.15.63:0/3079783588 >> v2:172.21.15.155:3300/0 conn(0x7f3a240bc9b0 0x7f3a240a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:57.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.681+0000 7f3a2359e700 1 --2- 172.21.15.63:0/3079783588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a24065b30 0x7f3a240a1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:57.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.681+0000 7f3a2359e700 1 -- 172.21.15.63:0/3079783588 >> 172.21.15.63:0/3079783588 conn(0x7f3a2406a360 msgr2=0x7f3a2412ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:57.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.681+0000 7f3a2359e700 1 -- 172.21.15.63:0/3079783588 shutdown_connections 2020-05-18T21:36:57.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:57.681+0000 7f3a2359e700 1 -- 172.21.15.63:0/3079783588 wait complete. 2020-05-18T21:36:57.691 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 116 2020-05-18T21:36:57.902 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 116, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:35:50.157703+0000', 'modified': '2020-05-18T21:36:46.268982+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 135, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 9501, 'mds_1': 9379}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9379': {'gid': 9379, 'name': 'b', 'rank': 1, 'incarnation': 108, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.155:6835/3918574447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3918574447}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3918574447}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_9501': {'gid': 9501, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/169345666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 169345666}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 169345666}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:36:57.903 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9379:up:stopping 2020-05-18T21:36:58.904 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:36:59.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.009+0000 7ff824a3b700 1 Processor -- start 2020-05-18T21:36:59.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.009+0000 7ff824a3b700 1 -- start start 2020-05-18T21:36:59.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.009+0000 7ff824a3b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff82005aab0 0x7ff8200b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:36:59.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.009+0000 7ff824a3b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82005ba10 con 0x7ff820142f50 2020-05-18T21:36:59.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.009+0000 7ff824a3b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff820061190 con 0x7ff82005b300 2020-05-18T21:36:59.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.009+0000 7ff824a3b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff820061430 con 0x7ff82005aab0 2020-05-18T21:36:59.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.009+0000 7ff81ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff820142f50 0x7ff820149430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37246/0 (socket says 172.21.15.63:37246) 2020-05-18T21:36:59.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.009+0000 7ff81ffff700 1 -- 172.21.15.63:0/2703222276 learned_addr learned my addr 172.21.15.63:0/2703222276 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:36:59.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.009+0000 7ff81f7fe700 1 --2- 172.21.15.63:0/2703222276 >> v2:172.21.15.155:3300/0 conn(0x7ff82005aab0 0x7ff8200b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:59.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.009+0000 7ff81e7fc700 1 -- 172.21.15.63:0/2703222276 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797353524 0 0) 0x7ff82005ba10 con 0x7ff820142f50 2020-05-18T21:36:59.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.009+0000 7ff81e7fc700 1 -- 172.21.15.63:0/2703222276 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff800003270 con 0x7ff820142f50 2020-05-18T21:36:59.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.009+0000 7ff81e7fc700 1 -- 172.21.15.63:0/2703222276 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538748987 0 0) 0x7ff820061190 con 0x7ff82005b300 2020-05-18T21:36:59.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.009+0000 7ff81e7fc700 1 -- 172.21.15.63:0/2703222276 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff82005ba10 con 0x7ff82005b300 2020-05-18T21:36:59.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.009+0000 7ff81f7fe700 1 -- 172.21.15.63:0/2703222276 >> v1:172.21.15.155:6789/0 conn(0x7ff82005b300 legacy=0x7ff8200618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:59.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.009+0000 7ff81e7fc700 1 -- 172.21.15.63:0/2703222276 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3356614666 0 0) 0x7ff800003270 con 0x7ff820142f50 2020-05-18T21:36:59.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.009+0000 7ff81f7fe700 1 -- 172.21.15.63:0/2703222276 >> v1:172.21.15.63:6789/0 conn(0x7ff820142f50 legacy=0x7ff820149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:59.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.009+0000 7ff81f7fe700 1 -- 172.21.15.63:0/2703222276 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82005b740 con 0x7ff82005aab0 2020-05-18T21:36:59.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.009+0000 7ff81f7fe700 1 --2- 172.21.15.63:0/2703222276 >> v2:172.21.15.155:3300/0 conn(0x7ff82005aab0 0x7ff8200b0a00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff818001490 tx=0x7ff810007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:59.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.013+0000 7ff81f7fe700 1 --2- 172.21.15.63:0/2703222276 >> v2:172.21.15.155:3300/0 conn(0x7ff82005aab0 0x7ff8200b0a00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff818001490 tx=0x7ff810007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:59.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.013+0000 7ff81f7fe700 1 --2- 172.21.15.63:0/2703222276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff82005aab0 0x7ff8200b0a00 secure :-1 s=READY pgs=1244 cs=0 l=1 rx=0x7ff818001490 tx=0x7ff810007a80).ready entity=mon.1 client_cookie=caac0af79f5b326c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:59.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.013+0000 7ff81f7fe700 1 --2- 172.21.15.63:0/2703222276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff82005aab0 0x7ff8200b0a00 secure :-1 s=THROTTLE_DONE pgs=1244 cs=0 l=1 rx=0x7ff818001490 tx=0x7ff810007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:59.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.013+0000 7ff81e7fc700 1 -- 172.21.15.63:0/2703222276 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff818001a90 con 0x7ff82005aab0 2020-05-18T21:36:59.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.013+0000 7ff81f7fe700 1 --2- 172.21.15.63:0/2703222276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff82005aab0 0x7ff8200b0a00 secure :-1 s=THROTTLE_DONE pgs=1244 cs=0 l=1 rx=0x7ff818001490 tx=0x7ff810007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:59.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.013+0000 7ff81e7fc700 1 -- 172.21.15.63:0/2703222276 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff810008e40 con 0x7ff82005aab0 2020-05-18T21:36:59.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.013+0000 7ff81f7fe700 1 --2- 172.21.15.63:0/2703222276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff82005aab0 0x7ff8200b0a00 secure :-1 s=THROTTLE_DONE pgs=1244 cs=0 l=1 rx=0x7ff818001490 tx=0x7ff810007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:59.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.013+0000 7ff824a3b700 1 -- 172.21.15.63:0/2703222276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff82005aab0 msgr2=0x7ff8200b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:59.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.013+0000 7ff81e7fc700 1 -- 172.21.15.63:0/2703222276 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff810011440 con 0x7ff82005aab0 2020-05-18T21:36:59.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.013+0000 7ff824a3b700 1 --2- 172.21.15.63:0/2703222276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff82005aab0 0x7ff8200b0a00 secure :-1 s=READY pgs=1244 cs=0 l=1 rx=0x7ff818001490 tx=0x7ff810007a80).stop 2020-05-18T21:36:59.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.013+0000 7ff824a3b700 1 -- 172.21.15.63:0/2703222276 shutdown_connections 2020-05-18T21:36:59.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.013+0000 7ff824a3b700 1 --2- 172.21.15.63:0/2703222276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff82005aab0 0x7ff8200b0a00 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:59.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.013+0000 7ff824a3b700 1 -- 172.21.15.63:0/2703222276 >> 172.21.15.63:0/2703222276 conn(0x7ff8200b8340 msgr2=0x7ff8200b8750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:59.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.013+0000 7ff824a3b700 1 -- 172.21.15.63:0/2703222276 shutdown_connections 2020-05-18T21:36:59.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.013+0000 7ff824a3b700 1 -- 172.21.15.63:0/2703222276 wait complete. 2020-05-18T21:36:59.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.013+0000 7ff824a3b700 1 Processor -- start 2020-05-18T21:36:59.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.013+0000 7ff824a3b700 1 -- start start 2020-05-18T21:36:59.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.013+0000 7ff824a3b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff82005aab0 0x7ff820157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:59.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff824a3b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff82005b300 0x7ff8201461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:59.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff824a3b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff820142f50 0x7ff820147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:59.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff824a3b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff820146610 con 0x7ff82005b300 2020-05-18T21:36:59.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff824a3b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8201480d0 con 0x7ff820142f50 2020-05-18T21:36:59.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff824a3b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8201486e0 con 0x7ff82005aab0 2020-05-18T21:36:59.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff82005b300 0x7ff8201461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:59.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff82005b300 0x7ff8201461b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35062/0 (socket says 172.21.15.63:35062) 2020-05-18T21:36:59.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81effd700 1 -- 172.21.15.63:0/1143607600 learned_addr learned my addr 172.21.15.63:0/1143607600 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:36:59.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81ffff700 1 --2- 172.21.15.63:0/1143607600 >> v2:172.21.15.155:3300/0 conn(0x7ff820142f50 0x7ff820147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:59.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81f7fe700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff82005aab0 0x7ff820157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:59.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81effd700 1 -- 172.21.15.63:0/1143607600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff82005aab0 msgr2=0x7ff820157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:59.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81effd700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff82005aab0 0x7ff820157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:59.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81effd700 1 -- 172.21.15.63:0/1143607600 >> v2:172.21.15.155:3300/0 conn(0x7ff820142f50 msgr2=0x7ff820147c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:59.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81effd700 1 --2- 172.21.15.63:0/1143607600 >> v2:172.21.15.155:3300/0 conn(0x7ff820142f50 0x7ff820147c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:59.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81effd700 1 -- 172.21.15.63:0/1143607600 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8200b6a90 con 0x7ff82005b300 2020-05-18T21:36:59.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81effd700 1 --2- 172.21.15.63:0/1143607600 >> v2:172.21.15.63:3300/0 conn(0x7ff82005b300 0x7ff8201461b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff8080010d0 tx=0x7ff80800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:59.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81effd700 1 --2- 172.21.15.63:0/1143607600 >> v2:172.21.15.63:3300/0 conn(0x7ff82005b300 0x7ff8201461b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff8080010d0 tx=0x7ff80800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:59.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81effd700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff82005b300 0x7ff8201461b0 secure :-1 s=READY pgs=1877 cs=0 l=1 rx=0x7ff8080010d0 tx=0x7ff80800c4a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:59.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81effd700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff82005b300 0x7ff8201461b0 secure :-1 s=THROTTLE_DONE pgs=1877 cs=0 l=1 rx=0x7ff8080010d0 tx=0x7ff80800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:59.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81effd700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff82005b300 0x7ff8201461b0 secure :-1 s=THROTTLE_DONE pgs=1877 cs=0 l=1 rx=0x7ff8080010d0 tx=0x7ff80800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:59.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81effd700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff82005b300 0x7ff8201461b0 secure :-1 s=THROTTLE_DONE pgs=1877 cs=0 l=1 rx=0x7ff8080010d0 tx=0x7ff80800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:59.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81cff9700 1 -- 172.21.15.63:0/1143607600 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff80800cc60 con 0x7ff82005b300 2020-05-18T21:36:59.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81cff9700 1 -- 172.21.15.63:0/1143607600 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80800cdc0 con 0x7ff82005b300 2020-05-18T21:36:59.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff824a3b700 1 -- 172.21.15.63:0/1143607600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8200b6d30 con 0x7ff82005b300 2020-05-18T21:36:59.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81cff9700 1 -- 172.21.15.63:0/1143607600 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff80800e370 con 0x7ff82005b300 2020-05-18T21:36:59.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff824a3b700 1 -- 172.21.15.63:0/1143607600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82013fd70 con 0x7ff82005b300 2020-05-18T21:36:59.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81effd700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff82005b300 0x7ff8201461b0 secure :-1 s=THROTTLE_DONE pgs=1877 cs=0 l=1 rx=0x7ff8080010d0 tx=0x7ff80800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:59.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff824a3b700 1 -- 172.21.15.63:0/1143607600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8200569e0 con 0x7ff82005b300 2020-05-18T21:36:59.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81cff9700 1 -- 172.21.15.63:0/1143607600 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff80800e5e0 con 0x7ff82005b300 2020-05-18T21:36:59.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.017+0000 7ff81effd700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff82005b300 0x7ff8201461b0 secure :-1 s=THROTTLE_DONE pgs=1877 cs=0 l=1 rx=0x7ff8080010d0 tx=0x7ff80800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:59.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.021+0000 7ff81cff9700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff80404fb30 0x7ff804051ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:36:59.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.021+0000 7ff81cff9700 1 -- 172.21.15.63:0/1143607600 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff808063970 con 0x7ff82005b300 2020-05-18T21:36:59.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.021+0000 7ff81f7fe700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff80404fb30 0x7ff804051ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:36:59.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.021+0000 7ff81f7fe700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff80404fb30 0x7ff804051ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff818001490 tx=0x7ff810007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:59.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.021+0000 7ff81f7fe700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff80404fb30 0x7ff804051ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff818001490 tx=0x7ff810007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:59.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.021+0000 7ff81f7fe700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff80404fb30 0x7ff804051ff0 secure :-1 s=READY pgs=729 cs=0 l=1 rx=0x7ff818001490 tx=0x7ff810007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:36:59.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.025+0000 7ff81effd700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff82005b300 0x7ff8201461b0 secure :-1 s=THROTTLE_DONE pgs=1877 cs=0 l=1 rx=0x7ff8080010d0 tx=0x7ff80800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:59.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.025+0000 7ff81cff9700 1 -- 172.21.15.63:0/1143607600 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff80803dca0 con 0x7ff82005b300 2020-05-18T21:36:59.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.173+0000 7ff824a3b700 1 -- 172.21.15.63:0/1143607600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8200b9260 con 0x7ff82005b300 2020-05-18T21:36:59.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.173+0000 7ff81effd700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff82005b300 0x7ff8201461b0 secure :-1 s=THROTTLE_DONE pgs=1877 cs=0 l=1 rx=0x7ff8080010d0 tx=0x7ff80800c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:36:59.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.173+0000 7ff81cff9700 1 -- 172.21.15.63:0/1143607600 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+2167 (secure 0 0 0) 0x7ff8080412c0 con 0x7ff82005b300 2020-05-18T21:36:59.180 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:36:59.180 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":116,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:36:46.268982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":9501,"mds_1":9379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9379":{"gid":9379,"name":"b","rank":1,"incarnation":108,"state":"up:stopping","state_seq":5,"addr":"172.21.15.155:6835/3918574447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3918574447},{"type":"v1","addr":"172.21.15.155:6835","nonce":3918574447}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[1],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:36:59.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.173+0000 7ff824a3b700 1 -- 172.21.15.63:0/1143607600 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff80404fb30 msgr2=0x7ff804051ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:59.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.173+0000 7ff824a3b700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff80404fb30 0x7ff804051ff0 secure :-1 s=READY pgs=729 cs=0 l=1 rx=0x7ff818001490 tx=0x7ff810007a80).stop 2020-05-18T21:36:59.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.173+0000 7ff824a3b700 1 -- 172.21.15.63:0/1143607600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff82005b300 msgr2=0x7ff8201461b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:36:59.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.173+0000 7ff824a3b700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff82005b300 0x7ff8201461b0 secure :-1 s=READY pgs=1877 cs=0 l=1 rx=0x7ff8080010d0 tx=0x7ff80800c4a0).stop 2020-05-18T21:36:59.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.173+0000 7ff824a3b700 1 -- 172.21.15.63:0/1143607600 shutdown_connections 2020-05-18T21:36:59.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.173+0000 7ff824a3b700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff80404fb30 0x7ff804051ff0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:59.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.173+0000 7ff824a3b700 1 --2- 172.21.15.63:0/1143607600 >> v2:172.21.15.155:3300/0 conn(0x7ff820142f50 0x7ff820147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:59.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.173+0000 7ff824a3b700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff82005b300 0x7ff8201461b0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:59.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.173+0000 7ff824a3b700 1 --2- 172.21.15.63:0/1143607600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff82005aab0 0x7ff820157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:36:59.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.173+0000 7ff824a3b700 1 -- 172.21.15.63:0/1143607600 >> 172.21.15.63:0/1143607600 conn(0x7ff8200b8340 msgr2=0x7ff8200b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:36:59.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.173+0000 7ff824a3b700 1 -- 172.21.15.63:0/1143607600 shutdown_connections 2020-05-18T21:36:59.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:36:59.177+0000 7ff824a3b700 1 -- 172.21.15.63:0/1143607600 wait complete. 2020-05-18T21:36:59.184 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 116 2020-05-18T21:36:59.394 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 116, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:35:50.157703+0000', 'modified': '2020-05-18T21:36:46.268982+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 135, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 9501, 'mds_1': 9379}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9379': {'gid': 9379, 'name': 'b', 'rank': 1, 'incarnation': 108, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.155:6835/3918574447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3918574447}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3918574447}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_9501': {'gid': 9501, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/169345666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 169345666}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 169345666}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:36:59.394 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9379:up:stopping 2020-05-18T21:37:00.396 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:00.426 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:37:00.428 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:37:00.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f82a272a700 1 Processor -- start 2020-05-18T21:37:00.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f82a272a700 1 -- start start 2020-05-18T21:37:00.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f82a272a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c0b78e0 0x7f829c0b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:00.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f82a272a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f829c066330 0x7f829c145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:00.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f82a272a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f829c146430 0x7f829c0b8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:00.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f82a272a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829c066e00 con 0x7f829c066330 2020-05-18T21:37:00.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f82a272a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829c066b60 con 0x7f829c146430 2020-05-18T21:37:00.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f82a272a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c1496f0 con 0x7f829c0b78e0 2020-05-18T21:37:00.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f829b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f829c066330 0x7f829c145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:00.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f829b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f829c066330 0x7f829c145fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35068/0 (socket says 172.21.15.63:35068) 2020-05-18T21:37:00.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f829b7fe700 1 -- 172.21.15.63:0/3722072892 learned_addr learned my addr 172.21.15.63:0/3722072892 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:00.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f829bfff700 1 --2- 172.21.15.63:0/3722072892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c0b78e0 0x7f829c0b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:00.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f82a0cc7700 1 --2- 172.21.15.63:0/3722072892 >> v2:172.21.15.155:3300/0 conn(0x7f829c146430 0x7f829c0b8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:00.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f829b7fe700 1 -- 172.21.15.63:0/3722072892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c0b78e0 msgr2=0x7f829c0b7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:00.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f829b7fe700 1 --2- 172.21.15.63:0/3722072892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c0b78e0 0x7f829c0b7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:00.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f829b7fe700 1 -- 172.21.15.63:0/3722072892 >> v2:172.21.15.155:3300/0 conn(0x7f829c146430 msgr2=0x7f829c0b8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:00.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f829b7fe700 1 --2- 172.21.15.63:0/3722072892 >> v2:172.21.15.155:3300/0 conn(0x7f829c146430 0x7f829c0b8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:00.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f829b7fe700 1 -- 172.21.15.63:0/3722072892 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c0b8120 con 0x7f829c066330 2020-05-18T21:37:00.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f82a0cc7700 1 --2- 172.21.15.63:0/3722072892 >> v2:172.21.15.155:3300/0 conn(0x7f829c146430 0x7f829c0b8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:37:00.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f829b7fe700 1 --2- 172.21.15.63:0/3722072892 >> v2:172.21.15.63:3300/0 conn(0x7f829c066330 0x7f829c145fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8290002f70 tx=0x7f8290007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:00.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f829b7fe700 1 --2- 172.21.15.63:0/3722072892 >> v2:172.21.15.63:3300/0 conn(0x7f829c066330 0x7f829c145fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8290002f70 tx=0x7f8290007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:00.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f829b7fe700 1 --2- 172.21.15.63:0/3722072892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f829c066330 0x7f829c145fd0 secure :-1 s=READY pgs=1878 cs=0 l=1 rx=0x7f8290002f70 tx=0x7f8290007a80).ready entity=mon.0 client_cookie=3680b9d7204f785a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:00.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f829b7fe700 1 --2- 172.21.15.63:0/3722072892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f829c066330 0x7f829c145fd0 secure :-1 s=THROTTLE_DONE pgs=1878 cs=0 l=1 rx=0x7f8290002f70 tx=0x7f8290007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:00.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f829affd700 1 -- 172.21.15.63:0/3722072892 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8290011760 con 0x7f829c066330 2020-05-18T21:37:00.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f829b7fe700 1 --2- 172.21.15.63:0/3722072892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f829c066330 0x7f829c145fd0 secure :-1 s=THROTTLE_DONE pgs=1878 cs=0 l=1 rx=0x7f8290002f70 tx=0x7f8290007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:00.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f829affd700 1 -- 172.21.15.63:0/3722072892 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82900118c0 con 0x7f829c066330 2020-05-18T21:37:00.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f829b7fe700 1 --2- 172.21.15.63:0/3722072892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f829c066330 0x7f829c145fd0 secure :-1 s=THROTTLE_DONE pgs=1878 cs=0 l=1 rx=0x7f8290002f70 tx=0x7f8290007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:00.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f829affd700 1 -- 172.21.15.63:0/3722072892 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8290011ce0 con 0x7f829c066330 2020-05-18T21:37:00.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f82a272a700 1 -- 172.21.15.63:0/3722072892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f829c066330 msgr2=0x7f829c145fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:00.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.501+0000 7f82a272a700 1 --2- 172.21.15.63:0/3722072892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f829c066330 0x7f829c145fd0 secure :-1 s=READY pgs=1878 cs=0 l=1 rx=0x7f8290002f70 tx=0x7f8290007a80).stop 2020-05-18T21:37:00.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.505+0000 7f82a272a700 1 -- 172.21.15.63:0/3722072892 shutdown_connections 2020-05-18T21:37:00.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.505+0000 7f82a272a700 1 --2- 172.21.15.63:0/3722072892 >> v2:172.21.15.155:3300/0 conn(0x7f829c146430 0x7f829c0b8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:00.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.505+0000 7f82a272a700 1 --2- 172.21.15.63:0/3722072892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f829c066330 0x7f829c145fd0 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:00.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.505+0000 7f82a272a700 1 --2- 172.21.15.63:0/3722072892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c0b78e0 0x7f829c0b7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:00.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.505+0000 7f82a272a700 1 -- 172.21.15.63:0/3722072892 >> 172.21.15.63:0/3722072892 conn(0x7f829c05b1a0 msgr2=0x7f829c05b580 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:00.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.505+0000 7f82a272a700 1 -- 172.21.15.63:0/3722072892 shutdown_connections 2020-05-18T21:37:00.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.505+0000 7f82a272a700 1 -- 172.21.15.63:0/3722072892 wait complete. 2020-05-18T21:37:00.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.505+0000 7f82a272a700 1 Processor -- start 2020-05-18T21:37:00.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.505+0000 7f82a272a700 1 -- start start 2020-05-18T21:37:00.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f82a272a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c066330 0x7f829c141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:00.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f82a272a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f829c0b78e0 0x7f829c145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:00.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f82a272a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f829c146430 0x7f829c140070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:00.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f82a272a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829c143dc0 con 0x7f829c146430 2020-05-18T21:37:00.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f82a272a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829c144060 con 0x7f829c0b78e0 2020-05-18T21:37:00.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f82a272a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c153710 con 0x7f829c066330 2020-05-18T21:37:00.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f82a0cc7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f829c146430 0x7f829c140070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:00.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f829bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c066330 0x7f829c141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:00.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f82a0cc7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f829c146430 0x7f829c140070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35078/0 (socket says 172.21.15.63:35078) 2020-05-18T21:37:00.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f82a0cc7700 1 -- 172.21.15.63:0/3754266427 learned_addr learned my addr 172.21.15.63:0/3754266427 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:00.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f829b7fe700 1 --2- 172.21.15.63:0/3754266427 >> v2:172.21.15.155:3300/0 conn(0x7f829c0b78e0 0x7f829c145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:00.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f829bfff700 1 -- 172.21.15.63:0/3754266427 >> v2:172.21.15.155:3300/0 conn(0x7f829c0b78e0 msgr2=0x7f829c145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:00.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f829bfff700 1 --2- 172.21.15.63:0/3754266427 >> v2:172.21.15.155:3300/0 conn(0x7f829c0b78e0 0x7f829c145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:00.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f829bfff700 1 -- 172.21.15.63:0/3754266427 >> v2:172.21.15.63:3300/0 conn(0x7f829c146430 msgr2=0x7f829c140070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:00.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f829bfff700 1 --2- 172.21.15.63:0/3754266427 >> v2:172.21.15.63:3300/0 conn(0x7f829c146430 0x7f829c140070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:00.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f829bfff700 1 -- 172.21.15.63:0/3754266427 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c0ac960 con 0x7f829c066330 2020-05-18T21:37:00.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f82a0cc7700 1 --2- 172.21.15.63:0/3754266427 >> v2:172.21.15.63:3300/0 conn(0x7f829c146430 0x7f829c140070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:00.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f829bfff700 1 --2- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c066330 0x7f829c141880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f828c002f70 tx=0x7f828c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:00.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f829bfff700 1 --2- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c066330 0x7f829c141880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f828c002f70 tx=0x7f828c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:00.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f829bfff700 1 --2- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c066330 0x7f829c141880 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f828c002f70 tx=0x7f828c010bb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:00.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f829bfff700 1 --2- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c066330 0x7f829c141880 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f828c002f70 tx=0x7f828c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:00.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f82997fa700 1 -- 172.21.15.63:0/3754266427 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f828c007180 con 0x7f829c066330 2020-05-18T21:37:00.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f82a272a700 1 -- 172.21.15.63:0/3754266427 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829c143920 con 0x7f829c066330 2020-05-18T21:37:00.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f829bfff700 1 --2- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c066330 0x7f829c141880 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f828c002f70 tx=0x7f828c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:00.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f82997fa700 1 -- 172.21.15.63:0/3754266427 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c0072e0 con 0x7f829c066330 2020-05-18T21:37:00.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f829bfff700 1 --2- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c066330 0x7f829c141880 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f828c002f70 tx=0x7f828c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:00.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f82997fa700 1 -- 172.21.15.63:0/3754266427 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f828c00e240 con 0x7f829c066330 2020-05-18T21:37:00.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f82a272a700 1 -- 172.21.15.63:0/3754266427 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829c140670 con 0x7f829c066330 2020-05-18T21:37:00.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f829bfff700 1 --2- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c066330 0x7f829c141880 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f828c002f70 tx=0x7f828c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:00.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.509+0000 7f82a272a700 1 -- 172.21.15.63:0/3754266427 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f829c143c30 con 0x7f829c066330 2020-05-18T21:37:00.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.513+0000 7f82997fa700 1 -- 172.21.15.63:0/3754266427 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f828c00e4c0 con 0x7f829c066330 2020-05-18T21:37:00.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.513+0000 7f829bfff700 1 --2- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c066330 0x7f829c141880 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f828c002f70 tx=0x7f828c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:00.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.513+0000 7f82997fa700 1 --2- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f827c04f9e0 0x7f827c051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:00.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.513+0000 7f82997fa700 1 -- 172.21.15.63:0/3754266427 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f828c063ea0 con 0x7f829c066330 2020-05-18T21:37:00.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.513+0000 7f829b7fe700 1 --2- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f827c04f9e0 0x7f827c051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:00.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.513+0000 7f829b7fe700 1 --2- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f827c04f9e0 0x7f827c051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8290002f70 tx=0x7f8290007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:00.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.513+0000 7f829b7fe700 1 --2- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f827c04f9e0 0x7f827c051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8290002f70 tx=0x7f8290007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:00.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.513+0000 7f829b7fe700 1 --2- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f827c04f9e0 0x7f827c051ea0 secure :-1 s=READY pgs=730 cs=0 l=1 rx=0x7f8290002f70 tx=0x7f8290007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:00.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.521+0000 7f829bfff700 1 --2- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c066330 0x7f829c141880 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f828c002f70 tx=0x7f828c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:00.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.521+0000 7f82997fa700 1 -- 172.21.15.63:0/3754266427 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f828c03e230 con 0x7f829c066330 2020-05-18T21:37:00.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.669+0000 7f82a272a700 1 -- 172.21.15.63:0/3754266427 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f829c0569e0 con 0x7f829c066330 2020-05-18T21:37:00.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.673+0000 7f829bfff700 1 --2- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c066330 0x7f829c141880 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f828c002f70 tx=0x7f828c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:00.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.673+0000 7f82997fa700 1 -- 172.21.15.63:0/3754266427 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+2167 (secure 0 0 0) 0x7f828c041850 con 0x7f829c066330 2020-05-18T21:37:00.678 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:00.678 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":116,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:36:46.268982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":9501,"mds_1":9379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9379":{"gid":9379,"name":"b","rank":1,"incarnation":108,"state":"up:stopping","state_seq":5,"addr":"172.21.15.155:6835/3918574447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3918574447},{"type":"v1","addr":"172.21.15.155:6835","nonce":3918574447}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[1],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:37:00.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.673+0000 7f82a272a700 1 -- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f827c04f9e0 msgr2=0x7f827c051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:00.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.673+0000 7f82a272a700 1 --2- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f827c04f9e0 0x7f827c051ea0 secure :-1 s=READY pgs=730 cs=0 l=1 rx=0x7f8290002f70 tx=0x7f8290007a80).stop 2020-05-18T21:37:00.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.673+0000 7f82a272a700 1 -- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c066330 msgr2=0x7f829c141880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:00.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.673+0000 7f82a272a700 1 --2- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c066330 0x7f829c141880 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f828c002f70 tx=0x7f828c010bb0).stop 2020-05-18T21:37:00.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.673+0000 7f82a272a700 1 -- 172.21.15.63:0/3754266427 shutdown_connections 2020-05-18T21:37:00.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.673+0000 7f82a272a700 1 --2- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f827c04f9e0 0x7f827c051ea0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:00.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.673+0000 7f82a272a700 1 --2- 172.21.15.63:0/3754266427 >> v2:172.21.15.63:3300/0 conn(0x7f829c146430 0x7f829c140070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:00.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.673+0000 7f82a272a700 1 --2- 172.21.15.63:0/3754266427 >> v2:172.21.15.155:3300/0 conn(0x7f829c0b78e0 0x7f829c145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:00.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.673+0000 7f82a272a700 1 --2- 172.21.15.63:0/3754266427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f829c066330 0x7f829c141880 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:00.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.673+0000 7f82a272a700 1 -- 172.21.15.63:0/3754266427 >> 172.21.15.63:0/3754266427 conn(0x7f829c05b1a0 msgr2=0x7f829c146e30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:00.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.673+0000 7f82a272a700 1 -- 172.21.15.63:0/3754266427 shutdown_connections 2020-05-18T21:37:00.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:00.673+0000 7f82a272a700 1 -- 172.21.15.63:0/3754266427 wait complete. 2020-05-18T21:37:00.682 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 116 2020-05-18T21:37:00.893 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 116, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:35:50.157703+0000', 'modified': '2020-05-18T21:36:46.268982+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 135, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 9501, 'mds_1': 9379}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9379': {'gid': 9379, 'name': 'b', 'rank': 1, 'incarnation': 108, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.155:6835/3918574447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3918574447}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3918574447}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_9501': {'gid': 9501, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/169345666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 169345666}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 169345666}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:37:00.894 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9379:up:stopping 2020-05-18T21:37:01.896 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:02.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.001+0000 7f1d15365700 1 Processor -- start 2020-05-18T21:37:02.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.001+0000 7f1d15365700 1 -- start start 2020-05-18T21:37:02.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.001+0000 7f1d15365700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d100aeb40 0x7f1d10147500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:02.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.001+0000 7f1d15365700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d10143ef0 con 0x7f1d100af5f0 2020-05-18T21:37:02.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.001+0000 7f1d15365700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d10144120 con 0x7f1d10144b00 2020-05-18T21:37:02.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.001+0000 7f1d15365700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d101443c0 con 0x7f1d100aeb40 2020-05-18T21:37:02.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.001+0000 7f1d0e7fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1d100af5f0 0x7f1d10141150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37270/0 (socket says 172.21.15.63:37270) 2020-05-18T21:37:02.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.001+0000 7f1d0e7fc700 1 -- 172.21.15.63:0/1435270758 learned_addr learned my addr 172.21.15.63:0/1435270758 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:02.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.001+0000 7f1d0effd700 1 --2- 172.21.15.63:0/1435270758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d100aeb40 0x7f1d10147500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:02.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.001+0000 7f1d0dffb700 1 -- 172.21.15.63:0/1435270758 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549450823 0 0) 0x7f1d10143ef0 con 0x7f1d100af5f0 2020-05-18T21:37:02.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.001+0000 7f1d0dffb700 1 -- 172.21.15.63:0/1435270758 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cf0003270 con 0x7f1d100af5f0 2020-05-18T21:37:02.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.001+0000 7f1d0dffb700 1 -- 172.21.15.63:0/1435270758 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1715998632 0 0) 0x7f1d10144120 con 0x7f1d10144b00 2020-05-18T21:37:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.001+0000 7f1d0dffb700 1 -- 172.21.15.63:0/1435270758 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d10143ef0 con 0x7f1d10144b00 2020-05-18T21:37:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.001+0000 7f1d0effd700 1 -- 172.21.15.63:0/1435270758 >> v1:172.21.15.155:6789/0 conn(0x7f1d10144b00 legacy=0x7f1d100b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.001+0000 7f1d0dffb700 1 -- 172.21.15.63:0/1435270758 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2635869550 0 0) 0x7f1cf0003270 con 0x7f1d100af5f0 2020-05-18T21:37:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.001+0000 7f1d0effd700 1 -- 172.21.15.63:0/1435270758 >> v1:172.21.15.63:6789/0 conn(0x7f1d100af5f0 legacy=0x7f1d10141150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.005+0000 7f1d0effd700 1 -- 172.21.15.63:0/1435270758 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d10144660 con 0x7f1d100aeb40 2020-05-18T21:37:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.005+0000 7f1d0effd700 1 --2- 172.21.15.63:0/1435270758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d100aeb40 0x7f1d10147500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1d00001110 tx=0x7f1cf8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.005+0000 7f1d0effd700 1 --2- 172.21.15.63:0/1435270758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d100aeb40 0x7f1d10147500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1d00001110 tx=0x7f1cf8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.005+0000 7f1d0effd700 1 --2- 172.21.15.63:0/1435270758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d100aeb40 0x7f1d10147500 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7f1d00001110 tx=0x7f1cf8008920).ready entity=mon.2 client_cookie=3d3c8becaf1b7b9f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.005+0000 7f1d0effd700 1 --2- 172.21.15.63:0/1435270758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d100aeb40 0x7f1d10147500 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f1d00001110 tx=0x7f1cf8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.005+0000 7f1d0dffb700 1 -- 172.21.15.63:0/1435270758 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d00001710 con 0x7f1d100aeb40 2020-05-18T21:37:02.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.005+0000 7f1d0effd700 1 --2- 172.21.15.63:0/1435270758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d100aeb40 0x7f1d10147500 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f1d00001110 tx=0x7f1cf8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:02.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.005+0000 7f1d0effd700 1 --2- 172.21.15.63:0/1435270758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d100aeb40 0x7f1d10147500 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f1d00001110 tx=0x7f1cf8008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:02.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.005+0000 7f1d0dffb700 1 -- 172.21.15.63:0/1435270758 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf8008e80 con 0x7f1d100aeb40 2020-05-18T21:37:02.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.005+0000 7f1d0dffb700 1 -- 172.21.15.63:0/1435270758 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cf8011440 con 0x7f1d100aeb40 2020-05-18T21:37:02.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.005+0000 7f1d15365700 1 -- 172.21.15.63:0/1435270758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d100aeb40 msgr2=0x7f1d10147500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:02.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.005+0000 7f1d15365700 1 --2- 172.21.15.63:0/1435270758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d100aeb40 0x7f1d10147500 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7f1d00001110 tx=0x7f1cf8008920).stop 2020-05-18T21:37:02.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.005+0000 7f1d15365700 1 -- 172.21.15.63:0/1435270758 shutdown_connections 2020-05-18T21:37:02.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.005+0000 7f1d15365700 1 --2- 172.21.15.63:0/1435270758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d100aeb40 0x7f1d10147500 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:02.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.005+0000 7f1d15365700 1 -- 172.21.15.63:0/1435270758 >> 172.21.15.63:0/1435270758 conn(0x7f1d1006a500 msgr2=0x7f1d100b84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:02.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.005+0000 7f1d15365700 1 -- 172.21.15.63:0/1435270758 shutdown_connections 2020-05-18T21:37:02.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.005+0000 7f1d15365700 1 -- 172.21.15.63:0/1435270758 wait complete. 2020-05-18T21:37:02.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d15365700 1 Processor -- start 2020-05-18T21:37:02.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d15365700 1 -- start start 2020-05-18T21:37:02.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d15365700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1d100aeb40 0x7f1d10066f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:02.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d15365700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d10144b00 0x7f1d101463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:02.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d15365700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d10157b40 con 0x7f1d100af5f0 2020-05-18T21:37:02.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d15365700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d10146820 con 0x7f1d100aeb40 2020-05-18T21:37:02.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d15365700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d10147860 con 0x7f1d10144b00 2020-05-18T21:37:02.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d0effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1d100aeb40 0x7f1d10066f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:02.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d0effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1d100aeb40 0x7f1d10066f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35090/0 (socket says 172.21.15.63:35090) 2020-05-18T21:37:02.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d0effd700 1 -- 172.21.15.63:0/3463022685 learned_addr learned my addr 172.21.15.63:0/3463022685 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:02.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d0f7fe700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d10144b00 0x7f1d101463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:02.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d0effd700 1 -- 172.21.15.63:0/3463022685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d10144b00 msgr2=0x7f1d101463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:02.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d0effd700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d10144b00 0x7f1d101463c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:02.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d0effd700 1 -- 172.21.15.63:0/3463022685 >> v1:172.21.15.155:6789/0 conn(0x7f1d100af5f0 legacy=0x7f1d10146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:02.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d0effd700 1 -- 172.21.15.63:0/3463022685 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d10147b00 con 0x7f1d100aeb40 2020-05-18T21:37:02.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d0effd700 1 --2- 172.21.15.63:0/3463022685 >> v2:172.21.15.63:3300/0 conn(0x7f1d100aeb40 0x7f1d10066f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d00001110 tx=0x7f1cf80111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:02.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d0effd700 1 --2- 172.21.15.63:0/3463022685 >> v2:172.21.15.63:3300/0 conn(0x7f1d100aeb40 0x7f1d10066f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d00001110 tx=0x7f1cf80111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:02.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d0effd700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d100aeb40 0x7f1d10066f10 secure :-1 s=READY pgs=1880 cs=0 l=1 rx=0x7f1d00001110 tx=0x7f1cf80111f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:02.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d0effd700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d100aeb40 0x7f1d10066f10 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f1d00001110 tx=0x7f1cf80111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:02.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d07fff700 1 -- 172.21.15.63:0/3463022685 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cf8011cb0 con 0x7f1d100aeb40 2020-05-18T21:37:02.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d0effd700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d100aeb40 0x7f1d10066f10 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f1d00001110 tx=0x7f1cf80111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:02.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d0effd700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d100aeb40 0x7f1d10066f10 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f1d00001110 tx=0x7f1cf80111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:02.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d07fff700 1 -- 172.21.15.63:0/3463022685 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf8011e10 con 0x7f1d100aeb40 2020-05-18T21:37:02.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d07fff700 1 -- 172.21.15.63:0/3463022685 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cf8007360 con 0x7f1d100aeb40 2020-05-18T21:37:02.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d15365700 1 -- 172.21.15.63:0/3463022685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d100ae4b0 con 0x7f1d100aeb40 2020-05-18T21:37:02.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.009+0000 7f1d15365700 1 -- 172.21.15.63:0/3463022685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d101576a0 con 0x7f1d100aeb40 2020-05-18T21:37:02.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.013+0000 7f1d0effd700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d100aeb40 0x7f1d10066f10 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f1d00001110 tx=0x7f1cf80111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:02.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.013+0000 7f1d15365700 1 -- 172.21.15.63:0/3463022685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d10153730 con 0x7f1d100aeb40 2020-05-18T21:37:02.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.013+0000 7f1d07fff700 1 -- 172.21.15.63:0/3463022685 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1cf8005700 con 0x7f1d100aeb40 2020-05-18T21:37:02.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.013+0000 7f1d0effd700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d100aeb40 0x7f1d10066f10 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f1d00001110 tx=0x7f1cf80111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:02.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.013+0000 7f1d07fff700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cf404fa00 0x7f1cf4051ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:02.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.013+0000 7f1d07fff700 1 -- 172.21.15.63:0/3463022685 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1cf8064760 con 0x7f1d100aeb40 2020-05-18T21:37:02.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.013+0000 7f1d0e7fc700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cf404fa00 0x7f1cf4051ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:02.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.013+0000 7f1d0e7fc700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cf404fa00 0x7f1cf4051ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d101403d0 tx=0x7f1d000013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:02.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.013+0000 7f1d0e7fc700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cf404fa00 0x7f1cf4051ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d101403d0 tx=0x7f1d000013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:02.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.013+0000 7f1d0e7fc700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cf404fa00 0x7f1cf4051ec0 secure :-1 s=READY pgs=731 cs=0 l=1 rx=0x7f1d101403d0 tx=0x7f1d000013a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:02.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.021+0000 7f1d0effd700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d100aeb40 0x7f1d10066f10 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f1d00001110 tx=0x7f1cf80111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:02.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.021+0000 7f1d07fff700 1 -- 172.21.15.63:0/3463022685 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f1cf803eb50 con 0x7f1d100aeb40 2020-05-18T21:37:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.169+0000 7f1d15365700 1 -- 172.21.15.63:0/3463022685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d100569e0 con 0x7f1d100aeb40 2020-05-18T21:37:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.169+0000 7f1d0effd700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d100aeb40 0x7f1d10066f10 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f1d00001110 tx=0x7f1cf80111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.169+0000 7f1d07fff700 1 -- 172.21.15.63:0/3463022685 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+2167 (secure 0 0 0) 0x7f1cf8042170 con 0x7f1d100aeb40 2020-05-18T21:37:02.176 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:02.177 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":116,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:36:46.268982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":9501,"mds_1":9379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9379":{"gid":9379,"name":"b","rank":1,"incarnation":108,"state":"up:stopping","state_seq":5,"addr":"172.21.15.155:6835/3918574447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3918574447},{"type":"v1","addr":"172.21.15.155:6835","nonce":3918574447}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[1],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:37:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.173+0000 7f1d15365700 1 -- 172.21.15.63:0/3463022685 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cf404fa00 msgr2=0x7f1cf4051ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.173+0000 7f1d15365700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cf404fa00 0x7f1cf4051ec0 secure :-1 s=READY pgs=731 cs=0 l=1 rx=0x7f1d101403d0 tx=0x7f1d000013a0).stop 2020-05-18T21:37:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.173+0000 7f1d15365700 1 -- 172.21.15.63:0/3463022685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d100aeb40 msgr2=0x7f1d10066f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.173+0000 7f1d15365700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d100aeb40 0x7f1d10066f10 secure :-1 s=READY pgs=1880 cs=0 l=1 rx=0x7f1d00001110 tx=0x7f1cf80111f0).stop 2020-05-18T21:37:02.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.173+0000 7f1d15365700 1 -- 172.21.15.63:0/3463022685 shutdown_connections 2020-05-18T21:37:02.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.173+0000 7f1d15365700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1cf404fa00 0x7f1cf4051ec0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:02.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.173+0000 7f1d15365700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d10144b00 0x7f1d101463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:02.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.173+0000 7f1d15365700 1 --2- 172.21.15.63:0/3463022685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d100aeb40 0x7f1d10066f10 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:02.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.173+0000 7f1d15365700 1 -- 172.21.15.63:0/3463022685 >> 172.21.15.63:0/3463022685 conn(0x7f1d1006a500 msgr2=0x7f1d100b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:02.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.173+0000 7f1d15365700 1 -- 172.21.15.63:0/3463022685 shutdown_connections 2020-05-18T21:37:02.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:02.173+0000 7f1d15365700 1 -- 172.21.15.63:0/3463022685 wait complete. 2020-05-18T21:37:02.181 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 116 2020-05-18T21:37:02.392 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 116, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:35:50.157703+0000', 'modified': '2020-05-18T21:36:46.268982+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 135, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 9501, 'mds_1': 9379}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9379': {'gid': 9379, 'name': 'b', 'rank': 1, 'incarnation': 108, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.155:6835/3918574447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3918574447}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3918574447}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_9501': {'gid': 9501, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/169345666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 169345666}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 169345666}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:37:02.392 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9379:up:stopping 2020-05-18T21:37:03.394 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:03.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f6651fb1700 1 Processor -- start 2020-05-18T21:37:03.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f6651fb1700 1 -- start start 2020-05-18T21:37:03.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f6651fb1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f664c065c50 0x7f664c146b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:03.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f6651fb1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f664c12ef90 0x7f664c12f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:03.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f6651fb1700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664c146fd0 con 0x7f664c0b9660 2020-05-18T21:37:03.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f6651fb1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f664c146190 con 0x7f664c065c50 2020-05-18T21:37:03.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f6651fb1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f664c146430 con 0x7f664c12ef90 2020-05-18T21:37:03.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f664affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f664c065c50 0x7f664c146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:03.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f664affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f664c065c50 0x7f664c146b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35098/0 (socket says 172.21.15.63:35098) 2020-05-18T21:37:03.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f664affd700 1 -- 172.21.15.63:0/1293109539 learned_addr learned my addr 172.21.15.63:0/1293109539 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:03.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f664b7fe700 1 --1- 172.21.15.63:0/1293109539 >> v1:172.21.15.63:6789/0 conn(0x7f664c0b9660 0x7f664c149f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37284/0 (socket says 172.21.15.63:37284) 2020-05-18T21:37:03.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f664bfff700 1 --2- 172.21.15.63:0/1293109539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f664c12ef90 0x7f664c12f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:03.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f664affd700 1 -- 172.21.15.63:0/1293109539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f664c12ef90 msgr2=0x7f664c12f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:03.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f664affd700 1 --2- 172.21.15.63:0/1293109539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f664c12ef90 0x7f664c12f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:03.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f664affd700 1 -- 172.21.15.63:0/1293109539 >> v1:172.21.15.63:6789/0 conn(0x7f664c0b9660 legacy=0x7f664c149f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:03.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f664affd700 1 -- 172.21.15.63:0/1293109539 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664c1466d0 con 0x7f664c065c50 2020-05-18T21:37:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f664affd700 1 --2- 172.21.15.63:0/1293109539 >> v2:172.21.15.63:3300/0 conn(0x7f664c065c50 0x7f664c146b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f66440032f0 tx=0x7f6644007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f664affd700 1 --2- 172.21.15.63:0/1293109539 >> v2:172.21.15.63:3300/0 conn(0x7f664c065c50 0x7f664c146b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f66440032f0 tx=0x7f6644007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f664affd700 1 --2- 172.21.15.63:0/1293109539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f664c065c50 0x7f664c146b70 secure :-1 s=READY pgs=1882 cs=0 l=1 rx=0x7f66440032f0 tx=0x7f6644007e00).ready entity=mon.0 client_cookie=1412a69b58a81ef server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f664affd700 1 --2- 172.21.15.63:0/1293109539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f664c065c50 0x7f664c146b70 secure :-1 s=THROTTLE_DONE pgs=1882 cs=0 l=1 rx=0x7f66440032f0 tx=0x7f6644007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:03.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f664affd700 1 --2- 172.21.15.63:0/1293109539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f664c065c50 0x7f664c146b70 secure :-1 s=THROTTLE_DONE pgs=1882 cs=0 l=1 rx=0x7f66440032f0 tx=0x7f6644007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:03.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f664a7fc700 1 -- 172.21.15.63:0/1293109539 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6644011d10 con 0x7f664c065c50 2020-05-18T21:37:03.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f664affd700 1 --2- 172.21.15.63:0/1293109539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f664c065c50 0x7f664c146b70 secure :-1 s=THROTTLE_DONE pgs=1882 cs=0 l=1 rx=0x7f66440032f0 tx=0x7f6644007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:03.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f664a7fc700 1 -- 172.21.15.63:0/1293109539 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6644011e70 con 0x7f664c065c50 2020-05-18T21:37:03.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f664a7fc700 1 -- 172.21.15.63:0/1293109539 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f664400a370 con 0x7f664c065c50 2020-05-18T21:37:03.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f6651fb1700 1 -- 172.21.15.63:0/1293109539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f664c065c50 msgr2=0x7f664c146b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:03.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.497+0000 7f6651fb1700 1 --2- 172.21.15.63:0/1293109539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f664c065c50 0x7f664c146b70 secure :-1 s=READY pgs=1882 cs=0 l=1 rx=0x7f66440032f0 tx=0x7f6644007e00).stop 2020-05-18T21:37:03.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.501+0000 7f6651fb1700 1 -- 172.21.15.63:0/1293109539 shutdown_connections 2020-05-18T21:37:03.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.501+0000 7f6651fb1700 1 --2- 172.21.15.63:0/1293109539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f664c12ef90 0x7f664c12f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:03.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.501+0000 7f6651fb1700 1 --2- 172.21.15.63:0/1293109539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f664c065c50 0x7f664c146b70 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:03.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.501+0000 7f6651fb1700 1 -- 172.21.15.63:0/1293109539 >> 172.21.15.63:0/1293109539 conn(0x7f664c06a360 msgr2=0x7f664c05a770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:03.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.501+0000 7f6651fb1700 1 -- 172.21.15.63:0/1293109539 shutdown_connections 2020-05-18T21:37:03.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.501+0000 7f6651fb1700 1 -- 172.21.15.63:0/1293109539 wait complete. 2020-05-18T21:37:03.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.501+0000 7f6651fb1700 1 Processor -- start 2020-05-18T21:37:03.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.501+0000 7f6651fb1700 1 -- start start 2020-05-18T21:37:03.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f6651fb1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f664c12ef90 0x7f664c0b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:03.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f6651fb1700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664c0a1310 con 0x7f664c065c50 2020-05-18T21:37:03.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f6651fb1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664c09fbc0 con 0x7f664c0b9660 2020-05-18T21:37:03.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f6651fb1700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f664c09fe60 con 0x7f664c12ef90 2020-05-18T21:37:03.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f664b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f664c065c50 0x7f664c12cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37290/0 (socket says 172.21.15.63:37290) 2020-05-18T21:37:03.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f664b7fe700 1 -- 172.21.15.63:0/2363343364 learned_addr learned my addr 172.21.15.63:0/2363343364 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:03.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f664bfff700 1 --2- 172.21.15.63:0/2363343364 >> v2:172.21.15.155:3300/0 conn(0x7f664c12ef90 0x7f664c0b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:03.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f6648ff9700 1 -- 172.21.15.63:0/2363343364 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129646166 0 0) 0x7f664c0a1310 con 0x7f664c065c50 2020-05-18T21:37:03.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f6648ff9700 1 -- 172.21.15.63:0/2363343364 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f662c002fe0 con 0x7f664c065c50 2020-05-18T21:37:03.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f6648ff9700 1 -- 172.21.15.63:0/2363343364 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437733805 0 0) 0x7f664c09fbc0 con 0x7f664c0b9660 2020-05-18T21:37:03.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f664bfff700 1 -- 172.21.15.63:0/2363343364 >> v1:172.21.15.155:6789/0 conn(0x7f664c0b9660 legacy=0x7f664c153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:03.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f664bfff700 1 -- 172.21.15.63:0/2363343364 >> v1:172.21.15.63:6789/0 conn(0x7f664c065c50 legacy=0x7f664c12cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:03.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f664bfff700 1 -- 172.21.15.63:0/2363343364 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664c0b3070 con 0x7f664c12ef90 2020-05-18T21:37:03.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f664bfff700 1 --2- 172.21.15.63:0/2363343364 >> v2:172.21.15.155:3300/0 conn(0x7f664c12ef90 0x7f664c0b2c10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f663c002f70 tx=0x7f663c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:03.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f664bfff700 1 --2- 172.21.15.63:0/2363343364 >> v2:172.21.15.155:3300/0 conn(0x7f664c12ef90 0x7f664c0b2c10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f663c002f70 tx=0x7f663c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:03.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f664bfff700 1 --2- 172.21.15.63:0/2363343364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f664c12ef90 0x7f664c0b2c10 secure :-1 s=READY pgs=1248 cs=0 l=1 rx=0x7f663c002f70 tx=0x7f663c010b80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:03.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f664bfff700 1 --2- 172.21.15.63:0/2363343364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f664c12ef90 0x7f664c0b2c10 secure :-1 s=THROTTLE_DONE pgs=1248 cs=0 l=1 rx=0x7f663c002f70 tx=0x7f663c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:03.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f6648ff9700 1 -- 172.21.15.63:0/2363343364 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f663c007550 con 0x7f664c12ef90 2020-05-18T21:37:03.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f664bfff700 1 --2- 172.21.15.63:0/2363343364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f664c12ef90 0x7f664c0b2c10 secure :-1 s=THROTTLE_DONE pgs=1248 cs=0 l=1 rx=0x7f663c002f70 tx=0x7f663c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:03.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f6651fb1700 1 -- 172.21.15.63:0/2363343364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f664c1548c0 con 0x7f664c12ef90 2020-05-18T21:37:03.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f6648ff9700 1 -- 172.21.15.63:0/2363343364 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663c005700 con 0x7f664c12ef90 2020-05-18T21:37:03.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f664bfff700 1 --2- 172.21.15.63:0/2363343364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f664c12ef90 0x7f664c0b2c10 secure :-1 s=THROTTLE_DONE pgs=1248 cs=0 l=1 rx=0x7f663c002f70 tx=0x7f663c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:03.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f6648ff9700 1 -- 172.21.15.63:0/2363343364 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f663c005a60 con 0x7f664c12ef90 2020-05-18T21:37:03.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.505+0000 7f6651fb1700 1 -- 172.21.15.63:0/2363343364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f664c154270 con 0x7f664c12ef90 2020-05-18T21:37:03.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.509+0000 7f664bfff700 1 --2- 172.21.15.63:0/2363343364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f664c12ef90 0x7f664c0b2c10 secure :-1 s=THROTTLE_DONE pgs=1248 cs=0 l=1 rx=0x7f663c002f70 tx=0x7f663c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:03.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.509+0000 7f6651fb1700 1 -- 172.21.15.63:0/2363343364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f664c0569e0 con 0x7f664c12ef90 2020-05-18T21:37:03.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.509+0000 7f6648ff9700 1 -- 172.21.15.63:0/2363343364 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f663c005c60 con 0x7f664c12ef90 2020-05-18T21:37:03.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.509+0000 7f664bfff700 1 --2- 172.21.15.63:0/2363343364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f664c12ef90 0x7f664c0b2c10 secure :-1 s=THROTTLE_DONE pgs=1248 cs=0 l=1 rx=0x7f663c002f70 tx=0x7f663c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.509+0000 7f6648ff9700 1 --2- 172.21.15.63:0/2363343364 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f662c04fce0 0x7f662c0521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.509+0000 7f6648ff9700 1 -- 172.21.15.63:0/2363343364 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f663c063d40 con 0x7f664c12ef90 2020-05-18T21:37:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.509+0000 7f664b7fe700 1 --2- 172.21.15.63:0/2363343364 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f662c04fce0 0x7f662c0521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.509+0000 7f664b7fe700 1 --2- 172.21.15.63:0/2363343364 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f662c04fce0 0x7f662c0521a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6640000f30 tx=0x7f66400017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:03.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.509+0000 7f664b7fe700 1 --2- 172.21.15.63:0/2363343364 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f662c04fce0 0x7f662c0521a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6640000f30 tx=0x7f66400017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:03.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.509+0000 7f664b7fe700 1 --2- 172.21.15.63:0/2363343364 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f662c04fce0 0x7f662c0521a0 secure :-1 s=READY pgs=732 cs=0 l=1 rx=0x7f6640000f30 tx=0x7f66400017a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:03.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.517+0000 7f664bfff700 1 --2- 172.21.15.63:0/2363343364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f664c12ef90 0x7f664c0b2c10 secure :-1 s=THROTTLE_DONE pgs=1248 cs=0 l=1 rx=0x7f663c002f70 tx=0x7f663c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:03.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.517+0000 7f6648ff9700 1 -- 172.21.15.63:0/2363343364 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f663c03e0d0 con 0x7f664c12ef90 2020-05-18T21:37:03.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.673+0000 7f6651fb1700 1 -- 172.21.15.63:0/2363343364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f664c09ffa0 con 0x7f664c12ef90 2020-05-18T21:37:03.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.673+0000 7f664bfff700 1 --2- 172.21.15.63:0/2363343364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f664c12ef90 0x7f664c0b2c10 secure :-1 s=THROTTLE_DONE pgs=1248 cs=0 l=1 rx=0x7f663c002f70 tx=0x7f663c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:03.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.673+0000 7f6648ff9700 1 -- 172.21.15.63:0/2363343364 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+2167 (secure 0 0 0) 0x7f663c0416f0 con 0x7f664c12ef90 2020-05-18T21:37:03.680 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:03.680 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":116,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:36:46.268982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":9501,"mds_1":9379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9379":{"gid":9379,"name":"b","rank":1,"incarnation":108,"state":"up:stopping","state_seq":5,"addr":"172.21.15.155:6835/3918574447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3918574447},{"type":"v1","addr":"172.21.15.155:6835","nonce":3918574447}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[1],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:37:03.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.677+0000 7f6651fb1700 1 -- 172.21.15.63:0/2363343364 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f662c04fce0 msgr2=0x7f662c0521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:03.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.677+0000 7f6651fb1700 1 --2- 172.21.15.63:0/2363343364 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f662c04fce0 0x7f662c0521a0 secure :-1 s=READY pgs=732 cs=0 l=1 rx=0x7f6640000f30 tx=0x7f66400017a0).stop 2020-05-18T21:37:03.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.677+0000 7f6651fb1700 1 -- 172.21.15.63:0/2363343364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f664c12ef90 msgr2=0x7f664c0b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:03.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.677+0000 7f6651fb1700 1 --2- 172.21.15.63:0/2363343364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f664c12ef90 0x7f664c0b2c10 secure :-1 s=READY pgs=1248 cs=0 l=1 rx=0x7f663c002f70 tx=0x7f663c010b80).stop 2020-05-18T21:37:03.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.677+0000 7f6651fb1700 1 -- 172.21.15.63:0/2363343364 shutdown_connections 2020-05-18T21:37:03.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.677+0000 7f6651fb1700 1 --2- 172.21.15.63:0/2363343364 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f662c04fce0 0x7f662c0521a0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:03.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.677+0000 7f6651fb1700 1 --2- 172.21.15.63:0/2363343364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f664c12ef90 0x7f664c0b2c10 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:03.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.677+0000 7f6651fb1700 1 -- 172.21.15.63:0/2363343364 >> 172.21.15.63:0/2363343364 conn(0x7f664c06a360 msgr2=0x7f664c09e360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:03.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.677+0000 7f6651fb1700 1 -- 172.21.15.63:0/2363343364 shutdown_connections 2020-05-18T21:37:03.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:03.677+0000 7f6651fb1700 1 -- 172.21.15.63:0/2363343364 wait complete. 2020-05-18T21:37:03.684 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 116 2020-05-18T21:37:03.895 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 116, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:35:50.157703+0000', 'modified': '2020-05-18T21:36:46.268982+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 135, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 9501, 'mds_1': 9379}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9379': {'gid': 9379, 'name': 'b', 'rank': 1, 'incarnation': 108, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.155:6835/3918574447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3918574447}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3918574447}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_9501': {'gid': 9501, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/169345666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 169345666}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 169345666}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:37:03.896 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9379:up:stopping 2020-05-18T21:37:04.897 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:05.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.001+0000 7f58d6e33700 1 Processor -- start 2020-05-18T21:37:05.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.001+0000 7f58d6e33700 1 -- start start 2020-05-18T21:37:05.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d6e33700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f58d005f3a0 0x7f58d00b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d6e33700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d0064520 0x7f58d01441e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d6e33700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d0066d50 con 0x7f58d0144640 2020-05-18T21:37:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d6e33700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d00b9aa0 con 0x7f58d005f3a0 2020-05-18T21:37:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d6e33700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d0064aa0 con 0x7f58d0064520 2020-05-18T21:37:05.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d5e31700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f58d005f3a0 0x7f58d00b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:05.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d5630700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d0064520 0x7f58d01441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:05.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d6632700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f58d0144640 0x7f58d005a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:35618/0 (socket says 172.21.15.63:35618) 2020-05-18T21:37:05.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d6632700 1 -- 172.21.15.63:0/4024280421 learned_addr learned my addr 172.21.15.63:0/4024280421 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:05.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d4e2f700 1 -- 172.21.15.63:0/4024280421 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096123158 0 0) 0x7f58d0066d50 con 0x7f58d0144640 2020-05-18T21:37:05.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d4e2f700 1 -- 172.21.15.63:0/4024280421 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58b8003270 con 0x7f58d0144640 2020-05-18T21:37:05.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d5630700 1 -- 172.21.15.63:0/4024280421 >> v2:172.21.15.155:3300/0 conn(0x7f58d005f3a0 msgr2=0x7f58d00b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:05.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d5630700 1 --2- 172.21.15.63:0/4024280421 >> v2:172.21.15.155:3300/0 conn(0x7f58d005f3a0 0x7f58d00b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:05.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d5630700 1 -- 172.21.15.63:0/4024280421 >> v1:172.21.15.155:6789/0 conn(0x7f58d0144640 legacy=0x7f58d005a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:05.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d5630700 1 -- 172.21.15.63:0/4024280421 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d00b9360 con 0x7f58d0064520 2020-05-18T21:37:05.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d5630700 1 --2- 172.21.15.63:0/4024280421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d0064520 0x7f58d01441e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f58cc002f70 tx=0x7f58cc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:05.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d5630700 1 --2- 172.21.15.63:0/4024280421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d0064520 0x7f58d01441e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f58cc002f70 tx=0x7f58cc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:05.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d5630700 1 --2- 172.21.15.63:0/4024280421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d0064520 0x7f58d01441e0 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7f58cc002f70 tx=0x7f58cc007a80).ready entity=mon.2 client_cookie=e25b6365324b2484 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:05.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d5630700 1 --2- 172.21.15.63:0/4024280421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d0064520 0x7f58d01441e0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f58cc002f70 tx=0x7f58cc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:05.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d4e2f700 1 -- 172.21.15.63:0/4024280421 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58cc008e80 con 0x7f58d0064520 2020-05-18T21:37:05.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d5630700 1 --2- 172.21.15.63:0/4024280421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d0064520 0x7f58d01441e0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f58cc002f70 tx=0x7f58cc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:05.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d4e2f700 1 -- 172.21.15.63:0/4024280421 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc011540 con 0x7f58d0064520 2020-05-18T21:37:05.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d5630700 1 --2- 172.21.15.63:0/4024280421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d0064520 0x7f58d01441e0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f58cc002f70 tx=0x7f58cc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:05.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d4e2f700 1 -- 172.21.15.63:0/4024280421 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58cc011920 con 0x7f58d0064520 2020-05-18T21:37:05.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d6e33700 1 -- 172.21.15.63:0/4024280421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d0064520 msgr2=0x7f58d01441e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:05.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d6e33700 1 --2- 172.21.15.63:0/4024280421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d0064520 0x7f58d01441e0 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7f58cc002f70 tx=0x7f58cc007a80).stop 2020-05-18T21:37:05.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d6e33700 1 -- 172.21.15.63:0/4024280421 shutdown_connections 2020-05-18T21:37:05.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d6e33700 1 --2- 172.21.15.63:0/4024280421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d0064520 0x7f58d01441e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:05.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d6e33700 1 --2- 172.21.15.63:0/4024280421 >> v2:172.21.15.155:3300/0 conn(0x7f58d005f3a0 0x7f58d00b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:05.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d6e33700 1 -- 172.21.15.63:0/4024280421 >> 172.21.15.63:0/4024280421 conn(0x7f58d009db80 msgr2=0x7f58d009df90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:05.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d6e33700 1 -- 172.21.15.63:0/4024280421 shutdown_connections 2020-05-18T21:37:05.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.005+0000 7f58d6e33700 1 -- 172.21.15.63:0/4024280421 wait complete. 2020-05-18T21:37:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58d6e33700 1 Processor -- start 2020-05-18T21:37:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58d6e33700 1 -- start start 2020-05-18T21:37:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58d6e33700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f58d0144640 0x7f58d013f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58d6e33700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d0062a20 con 0x7f58d0064520 2020-05-18T21:37:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58d6e33700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d0062cc0 con 0x7f58d005f3a0 2020-05-18T21:37:05.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58d6e33700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d0062f60 con 0x7f58d0144640 2020-05-18T21:37:05.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58d5630700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f58d0064520 0x7f58d01454c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37306/0 (socket says 172.21.15.63:37306) 2020-05-18T21:37:05.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58d5630700 1 -- 172.21.15.63:0/2293569200 learned_addr learned my addr 172.21.15.63:0/2293569200 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:05.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58d6632700 1 --2- 172.21.15.63:0/2293569200 >> v2:172.21.15.155:3300/0 conn(0x7f58d0144640 0x7f58d013f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:05.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58beffd700 1 -- 172.21.15.63:0/2293569200 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900348194 0 0) 0x7f58d0062a20 con 0x7f58d0064520 2020-05-18T21:37:05.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58beffd700 1 -- 172.21.15.63:0/2293569200 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58b0002fe0 con 0x7f58d0064520 2020-05-18T21:37:05.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58beffd700 1 -- 172.21.15.63:0/2293569200 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4125013553 0 0) 0x7f58d0062cc0 con 0x7f58d005f3a0 2020-05-18T21:37:05.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58beffd700 1 -- 172.21.15.63:0/2293569200 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58d0062a20 con 0x7f58d005f3a0 2020-05-18T21:37:05.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58d6632700 1 -- 172.21.15.63:0/2293569200 >> v1:172.21.15.155:6789/0 conn(0x7f58d005f3a0 legacy=0x7f58d013e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:05.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58d6632700 1 -- 172.21.15.63:0/2293569200 >> v1:172.21.15.63:6789/0 conn(0x7f58d0064520 legacy=0x7f58d01454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:05.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58d6632700 1 -- 172.21.15.63:0/2293569200 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d013ec60 con 0x7f58d0144640 2020-05-18T21:37:05.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58d6632700 1 --2- 172.21.15.63:0/2293569200 >> v2:172.21.15.155:3300/0 conn(0x7f58d0144640 0x7f58d013f4b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58c8001490 tx=0x7f58c8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:05.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58d6632700 1 --2- 172.21.15.63:0/2293569200 >> v2:172.21.15.155:3300/0 conn(0x7f58d0144640 0x7f58d013f4b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58c8001490 tx=0x7f58c8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:05.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58d6632700 1 --2- 172.21.15.63:0/2293569200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d0144640 0x7f58d013f4b0 secure :-1 s=READY pgs=1251 cs=0 l=1 rx=0x7f58c8001490 tx=0x7f58c8010c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:05.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58d6632700 1 --2- 172.21.15.63:0/2293569200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d0144640 0x7f58d013f4b0 secure :-1 s=THROTTLE_DONE pgs=1251 cs=0 l=1 rx=0x7f58c8001490 tx=0x7f58c8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:05.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58beffd700 1 -- 172.21.15.63:0/2293569200 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58c8005e90 con 0x7f58d0144640 2020-05-18T21:37:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58d6632700 1 --2- 172.21.15.63:0/2293569200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d0144640 0x7f58d013f4b0 secure :-1 s=THROTTLE_DONE pgs=1251 cs=0 l=1 rx=0x7f58c8001490 tx=0x7f58c8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58d6632700 1 --2- 172.21.15.63:0/2293569200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d0144640 0x7f58d013f4b0 secure :-1 s=THROTTLE_DONE pgs=1251 cs=0 l=1 rx=0x7f58c8001490 tx=0x7f58c8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58beffd700 1 -- 172.21.15.63:0/2293569200 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c80123f0 con 0x7f58d0144640 2020-05-18T21:37:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58d6e33700 1 -- 172.21.15.63:0/2293569200 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d00b2c70 con 0x7f58d0144640 2020-05-18T21:37:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.009+0000 7f58beffd700 1 -- 172.21.15.63:0/2293569200 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58c80127d0 con 0x7f58d0144640 2020-05-18T21:37:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.013+0000 7f58d6e33700 1 -- 172.21.15.63:0/2293569200 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d00b30f0 con 0x7f58d0144640 2020-05-18T21:37:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.013+0000 7f58d6632700 1 --2- 172.21.15.63:0/2293569200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d0144640 0x7f58d013f4b0 secure :-1 s=THROTTLE_DONE pgs=1251 cs=0 l=1 rx=0x7f58c8001490 tx=0x7f58c8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.013+0000 7f58d6e33700 1 -- 172.21.15.63:0/2293569200 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d00569e0 con 0x7f58d0144640 2020-05-18T21:37:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.013+0000 7f58beffd700 1 -- 172.21.15.63:0/2293569200 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f58c8012a50 con 0x7f58d0144640 2020-05-18T21:37:05.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.013+0000 7f58d6632700 1 --2- 172.21.15.63:0/2293569200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d0144640 0x7f58d013f4b0 secure :-1 s=THROTTLE_DONE pgs=1251 cs=0 l=1 rx=0x7f58c8001490 tx=0x7f58c8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:05.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.013+0000 7f58beffd700 1 --2- 172.21.15.63:0/2293569200 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f58b004fe80 0x7f58b0052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:05.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.013+0000 7f58beffd700 1 -- 172.21.15.63:0/2293569200 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f58c80090c0 con 0x7f58d0144640 2020-05-18T21:37:05.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.013+0000 7f58d5e31700 1 --2- 172.21.15.63:0/2293569200 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f58b004fe80 0x7f58b0052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:05.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.013+0000 7f58d5e31700 1 --2- 172.21.15.63:0/2293569200 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f58b004fe80 0x7f58b0052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58c0002f30 tx=0x7f58c000c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.013+0000 7f58d5e31700 1 --2- 172.21.15.63:0/2293569200 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f58b004fe80 0x7f58b0052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58c0002f30 tx=0x7f58c000c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.013+0000 7f58d5e31700 1 --2- 172.21.15.63:0/2293569200 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f58b004fe80 0x7f58b0052340 secure :-1 s=READY pgs=733 cs=0 l=1 rx=0x7f58c0002f30 tx=0x7f58c000c8a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.021+0000 7f58d6632700 1 --2- 172.21.15.63:0/2293569200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d0144640 0x7f58d013f4b0 secure :-1 s=THROTTLE_DONE pgs=1251 cs=0 l=1 rx=0x7f58c8001490 tx=0x7f58c8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:05.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.021+0000 7f58beffd700 1 -- 172.21.15.63:0/2293569200 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f58c803e4a0 con 0x7f58d0144640 2020-05-18T21:37:05.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.173+0000 7f58d6e33700 1 -- 172.21.15.63:0/2293569200 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58d0066d10 con 0x7f58d0144640 2020-05-18T21:37:05.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.173+0000 7f58d6632700 1 --2- 172.21.15.63:0/2293569200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d0144640 0x7f58d013f4b0 secure :-1 s=THROTTLE_DONE pgs=1251 cs=0 l=1 rx=0x7f58c8001490 tx=0x7f58c8010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:05.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.173+0000 7f58beffd700 1 -- 172.21.15.63:0/2293569200 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+2167 (secure 0 0 0) 0x7f58c8041ac0 con 0x7f58d0144640 2020-05-18T21:37:05.180 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:05.180 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":116,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:36:46.268982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":9501,"mds_1":9379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9379":{"gid":9379,"name":"b","rank":1,"incarnation":108,"state":"up:stopping","state_seq":5,"addr":"172.21.15.155:6835/3918574447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3918574447},{"type":"v1","addr":"172.21.15.155:6835","nonce":3918574447}]},"join_fscid":-1,"export_targets":[0],"features":4540138292837744639,"flags":0},"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[1],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:37:05.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.177+0000 7f58d6e33700 1 -- 172.21.15.63:0/2293569200 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f58b004fe80 msgr2=0x7f58b0052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:05.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.177+0000 7f58d6e33700 1 --2- 172.21.15.63:0/2293569200 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f58b004fe80 0x7f58b0052340 secure :-1 s=READY pgs=733 cs=0 l=1 rx=0x7f58c0002f30 tx=0x7f58c000c8a0).stop 2020-05-18T21:37:05.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.177+0000 7f58d6e33700 1 -- 172.21.15.63:0/2293569200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d0144640 msgr2=0x7f58d013f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:05.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.177+0000 7f58d6e33700 1 --2- 172.21.15.63:0/2293569200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d0144640 0x7f58d013f4b0 secure :-1 s=READY pgs=1251 cs=0 l=1 rx=0x7f58c8001490 tx=0x7f58c8010c10).stop 2020-05-18T21:37:05.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.177+0000 7f58d6e33700 1 -- 172.21.15.63:0/2293569200 shutdown_connections 2020-05-18T21:37:05.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.177+0000 7f58d6e33700 1 --2- 172.21.15.63:0/2293569200 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f58b004fe80 0x7f58b0052340 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:05.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.177+0000 7f58d6e33700 1 --2- 172.21.15.63:0/2293569200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d0144640 0x7f58d013f4b0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:05.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.177+0000 7f58d6e33700 1 -- 172.21.15.63:0/2293569200 >> 172.21.15.63:0/2293569200 conn(0x7f58d009db80 msgr2=0x7f58d0140d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:05.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.177+0000 7f58d6e33700 1 -- 172.21.15.63:0/2293569200 shutdown_connections 2020-05-18T21:37:05.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:05.177+0000 7f58d6e33700 1 -- 172.21.15.63:0/2293569200 wait complete. 2020-05-18T21:37:05.185 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 116 2020-05-18T21:37:05.400 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 116, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:35:50.157703+0000', 'modified': '2020-05-18T21:36:46.268982+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 135, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 9501, 'mds_1': 9379}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9379': {'gid': 9379, 'name': 'b', 'rank': 1, 'incarnation': 108, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.155:6835/3918574447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3918574447}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3918574447}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292837744639, 'flags': 0}, 'gid_9501': {'gid': 9501, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/169345666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 169345666}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 169345666}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:37:05.401 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9379:up:stopping 2020-05-18T21:37:06.322 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:37:06.402 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:06.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dccb73700 1 Processor -- start 2020-05-18T21:37:06.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dccb73700 1 -- start start 2020-05-18T21:37:06.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dccb73700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dc805aab0 0x7f6dc80affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:06.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dccb73700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6dc81333c0 0x7f6dc8133870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:06.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dccb73700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc80b43f0 con 0x7f6dc80af0c0 2020-05-18T21:37:06.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dccb73700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc814ea20 con 0x7f6dc81333c0 2020-05-18T21:37:06.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dccb73700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc8133cd0 con 0x7f6dc805aab0 2020-05-18T21:37:06.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc5d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6dc80af0c0 0x7f6dc814e310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37312/0 (socket says 172.21.15.63:37312) 2020-05-18T21:37:06.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc5d9b700 1 -- 172.21.15.63:0/2776359536 learned_addr learned my addr 172.21.15.63:0/2776359536 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:06.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc6d9d700 1 --2- 172.21.15.63:0/2776359536 >> v2:172.21.15.63:3300/0 conn(0x7f6dc81333c0 0x7f6dc8133870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:06.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc659c700 1 --2- 172.21.15.63:0/2776359536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dc805aab0 0x7f6dc80affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:06.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc559a700 1 -- 172.21.15.63:0/2776359536 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932983744 0 0) 0x7f6dc80b43f0 con 0x7f6dc80af0c0 2020-05-18T21:37:06.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc559a700 1 -- 172.21.15.63:0/2776359536 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6da8003270 con 0x7f6dc80af0c0 2020-05-18T21:37:06.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc6d9d700 1 -- 172.21.15.63:0/2776359536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dc805aab0 msgr2=0x7f6dc80affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:06.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc6d9d700 1 --2- 172.21.15.63:0/2776359536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dc805aab0 0x7f6dc80affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:06.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc6d9d700 1 -- 172.21.15.63:0/2776359536 >> v1:172.21.15.63:6789/0 conn(0x7f6dc80af0c0 legacy=0x7f6dc814e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:06.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc6d9d700 1 -- 172.21.15.63:0/2776359536 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc814dbd0 con 0x7f6dc81333c0 2020-05-18T21:37:06.519 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc659c700 1 --2- 172.21.15.63:0/2776359536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dc805aab0 0x7f6dc80affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:06.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc6d9d700 1 --2- 172.21.15.63:0/2776359536 >> v2:172.21.15.63:3300/0 conn(0x7f6dc81333c0 0x7f6dc8133870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6dc00032f0 tx=0x7f6dc0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:06.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc6d9d700 1 --2- 172.21.15.63:0/2776359536 >> v2:172.21.15.63:3300/0 conn(0x7f6dc81333c0 0x7f6dc8133870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6dc00032f0 tx=0x7f6dc0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:06.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc6d9d700 1 --2- 172.21.15.63:0/2776359536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc81333c0 0x7f6dc8133870 secure :-1 s=READY pgs=1888 cs=0 l=1 rx=0x7f6dc00032f0 tx=0x7f6dc0007e00).ready entity=mon.0 client_cookie=f86f03d69f11f21e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:06.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc6d9d700 1 --2- 172.21.15.63:0/2776359536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc81333c0 0x7f6dc8133870 secure :-1 s=THROTTLE_DONE pgs=1888 cs=0 l=1 rx=0x7f6dc00032f0 tx=0x7f6dc0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:06.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc559a700 1 -- 172.21.15.63:0/2776359536 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6dc0011db0 con 0x7f6dc81333c0 2020-05-18T21:37:06.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc6d9d700 1 --2- 172.21.15.63:0/2776359536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc81333c0 0x7f6dc8133870 secure :-1 s=THROTTLE_DONE pgs=1888 cs=0 l=1 rx=0x7f6dc00032f0 tx=0x7f6dc0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:06.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc6d9d700 1 --2- 172.21.15.63:0/2776359536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc81333c0 0x7f6dc8133870 secure :-1 s=THROTTLE_DONE pgs=1888 cs=0 l=1 rx=0x7f6dc00032f0 tx=0x7f6dc0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:06.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc559a700 1 -- 172.21.15.63:0/2776359536 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc000a180 con 0x7f6dc81333c0 2020-05-18T21:37:06.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dc559a700 1 -- 172.21.15.63:0/2776359536 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6dc000a5a0 con 0x7f6dc81333c0 2020-05-18T21:37:06.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dccb73700 1 -- 172.21.15.63:0/2776359536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc81333c0 msgr2=0x7f6dc8133870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:06.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dccb73700 1 --2- 172.21.15.63:0/2776359536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc81333c0 0x7f6dc8133870 secure :-1 s=READY pgs=1888 cs=0 l=1 rx=0x7f6dc00032f0 tx=0x7f6dc0007e00).stop 2020-05-18T21:37:06.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dccb73700 1 -- 172.21.15.63:0/2776359536 shutdown_connections 2020-05-18T21:37:06.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dccb73700 1 --2- 172.21.15.63:0/2776359536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc81333c0 0x7f6dc8133870 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:06.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dccb73700 1 --2- 172.21.15.63:0/2776359536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dc805aab0 0x7f6dc80affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:06.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.509+0000 7f6dccb73700 1 -- 172.21.15.63:0/2776359536 >> 172.21.15.63:0/2776359536 conn(0x7f6dc806a500 msgr2=0x7f6dc80b84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:06.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.513+0000 7f6dccb73700 1 -- 172.21.15.63:0/2776359536 shutdown_connections 2020-05-18T21:37:06.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.513+0000 7f6dccb73700 1 -- 172.21.15.63:0/2776359536 wait complete. 2020-05-18T21:37:06.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.513+0000 7f6dccb73700 1 Processor -- start 2020-05-18T21:37:06.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.513+0000 7f6dccb73700 1 -- start start 2020-05-18T21:37:06.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.513+0000 7f6dccb73700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dc80af0c0 0x7f6dc8131f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:06.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.513+0000 7f6dccb73700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6dc81333c0 0x7f6dc814abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:06.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.513+0000 7f6dccb73700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc81323c0 con 0x7f6dc805aab0 2020-05-18T21:37:06.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.513+0000 7f6dccb73700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc8066930 con 0x7f6dc81333c0 2020-05-18T21:37:06.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.513+0000 7f6dccb73700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc8061790 con 0x7f6dc80af0c0 2020-05-18T21:37:06.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.513+0000 7f6dc6d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6dc81333c0 0x7f6dc814abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:06.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.513+0000 7f6dc6d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6dc81333c0 0x7f6dc814abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35134/0 (socket says 172.21.15.63:35134) 2020-05-18T21:37:06.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.513+0000 7f6dc6d9d700 1 -- 172.21.15.63:0/1468213906 learned_addr learned my addr 172.21.15.63:0/1468213906 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:06.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.513+0000 7f6dc5d9b700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dc80af0c0 0x7f6dc8131f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:06.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dc6d9d700 1 -- 172.21.15.63:0/1468213906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dc80af0c0 msgr2=0x7f6dc8131f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:06.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dc6d9d700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dc80af0c0 0x7f6dc8131f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:06.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dc6d9d700 1 -- 172.21.15.63:0/1468213906 >> v1:172.21.15.155:6789/0 conn(0x7f6dc805aab0 legacy=0x7f6dc80b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:06.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dc6d9d700 1 -- 172.21.15.63:0/1468213906 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc8061a30 con 0x7f6dc81333c0 2020-05-18T21:37:06.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dc6d9d700 1 --2- 172.21.15.63:0/1468213906 >> v2:172.21.15.63:3300/0 conn(0x7f6dc81333c0 0x7f6dc814abc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6dc00032f0 tx=0x7f6dc0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:06.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dc6d9d700 1 --2- 172.21.15.63:0/1468213906 >> v2:172.21.15.63:3300/0 conn(0x7f6dc81333c0 0x7f6dc814abc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6dc00032f0 tx=0x7f6dc0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:06.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dc6d9d700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc81333c0 0x7f6dc814abc0 secure :-1 s=READY pgs=1889 cs=0 l=1 rx=0x7f6dc00032f0 tx=0x7f6dc0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:06.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dc6d9d700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc81333c0 0x7f6dc814abc0 secure :-1 s=THROTTLE_DONE pgs=1889 cs=0 l=1 rx=0x7f6dc00032f0 tx=0x7f6dc0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:06.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dc6d9d700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc81333c0 0x7f6dc814abc0 secure :-1 s=THROTTLE_DONE pgs=1889 cs=0 l=1 rx=0x7f6dc00032f0 tx=0x7f6dc0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:06.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dbf7fe700 1 -- 172.21.15.63:0/1468213906 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6dc00114d0 con 0x7f6dc81333c0 2020-05-18T21:37:06.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dc6d9d700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc81333c0 0x7f6dc814abc0 secure :-1 s=THROTTLE_DONE pgs=1889 cs=0 l=1 rx=0x7f6dc00032f0 tx=0x7f6dc0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:06.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dbf7fe700 1 -- 172.21.15.63:0/1468213906 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc0005a80 con 0x7f6dc81333c0 2020-05-18T21:37:06.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dccb73700 1 -- 172.21.15.63:0/1468213906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc8061cd0 con 0x7f6dc81333c0 2020-05-18T21:37:06.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dbf7fe700 1 -- 172.21.15.63:0/1468213906 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6dc0005e20 con 0x7f6dc81333c0 2020-05-18T21:37:06.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dccb73700 1 -- 172.21.15.63:0/1468213906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc8061360 con 0x7f6dc81333c0 2020-05-18T21:37:06.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dc6d9d700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc81333c0 0x7f6dc814abc0 secure :-1 s=THROTTLE_DONE pgs=1889 cs=0 l=1 rx=0x7f6dc00032f0 tx=0x7f6dc0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:06.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dccb73700 1 -- 172.21.15.63:0/1468213906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc8061e60 con 0x7f6dc81333c0 2020-05-18T21:37:06.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dbf7fe700 1 -- 172.21.15.63:0/1468213906 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6dc0010560 con 0x7f6dc81333c0 2020-05-18T21:37:06.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dc6d9d700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc81333c0 0x7f6dc814abc0 secure :-1 s=THROTTLE_DONE pgs=1889 cs=0 l=1 rx=0x7f6dc00032f0 tx=0x7f6dc0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:06.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dbf7fe700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6dac04f9e0 0x7f6dac051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:06.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.517+0000 7f6dbf7fe700 1 -- 172.21.15.63:0/1468213906 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6dc00645b0 con 0x7f6dc81333c0 2020-05-18T21:37:06.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.521+0000 7f6dc659c700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6dac04f9e0 0x7f6dac051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:06.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.521+0000 7f6dc659c700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6dac04f9e0 0x7f6dac051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6dc8063c40 tx=0x7f6db000ca80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:06.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.521+0000 7f6dc659c700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6dac04f9e0 0x7f6dac051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6dc8063c40 tx=0x7f6db000ca80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:06.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.521+0000 7f6dc659c700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6dac04f9e0 0x7f6dac051ea0 secure :-1 s=READY pgs=734 cs=0 l=1 rx=0x7f6dc8063c40 tx=0x7f6db000ca80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:06.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.525+0000 7f6dc6d9d700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc81333c0 0x7f6dc814abc0 secure :-1 s=THROTTLE_DONE pgs=1889 cs=0 l=1 rx=0x7f6dc00032f0 tx=0x7f6dc0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:06.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.525+0000 7f6dbf7fe700 1 -- 172.21.15.63:0/1468213906 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6dc003e940 con 0x7f6dc81333c0 2020-05-18T21:37:06.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.677+0000 7f6dccb73700 1 -- 172.21.15.63:0/1468213906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6dc80569e0 con 0x7f6dc81333c0 2020-05-18T21:37:06.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.677+0000 7f6dc6d9d700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc81333c0 0x7f6dc814abc0 secure :-1 s=THROTTLE_DONE pgs=1889 cs=0 l=1 rx=0x7f6dc00032f0 tx=0x7f6dc0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:06.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.677+0000 7f6dbf7fe700 1 -- 172.21.15.63:0/1468213906 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+1794 (secure 0 0 0) 0x7f6dc0007c60 con 0x7f6dc81333c0 2020-05-18T21:37:06.682 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:06.683 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":117,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:37:06.268769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9501},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[1],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:37:06.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.677+0000 7f6dccb73700 1 -- 172.21.15.63:0/1468213906 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6dac04f9e0 msgr2=0x7f6dac051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:06.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.677+0000 7f6dccb73700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6dac04f9e0 0x7f6dac051ea0 secure :-1 s=READY pgs=734 cs=0 l=1 rx=0x7f6dc8063c40 tx=0x7f6db000ca80).stop 2020-05-18T21:37:06.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.677+0000 7f6dccb73700 1 -- 172.21.15.63:0/1468213906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc81333c0 msgr2=0x7f6dc814abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:06.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.677+0000 7f6dccb73700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc81333c0 0x7f6dc814abc0 secure :-1 s=READY pgs=1889 cs=0 l=1 rx=0x7f6dc00032f0 tx=0x7f6dc0007e00).stop 2020-05-18T21:37:06.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.677+0000 7f6dccb73700 1 -- 172.21.15.63:0/1468213906 shutdown_connections 2020-05-18T21:37:06.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.677+0000 7f6dccb73700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6dac04f9e0 0x7f6dac051ea0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:06.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.677+0000 7f6dccb73700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc81333c0 0x7f6dc814abc0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:06.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.677+0000 7f6dccb73700 1 --2- 172.21.15.63:0/1468213906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dc80af0c0 0x7f6dc8131f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:06.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.677+0000 7f6dccb73700 1 -- 172.21.15.63:0/1468213906 >> 172.21.15.63:0/1468213906 conn(0x7f6dc806a500 msgr2=0x7f6dc80b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:06.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.677+0000 7f6dccb73700 1 -- 172.21.15.63:0/1468213906 shutdown_connections 2020-05-18T21:37:06.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:06.677+0000 7f6dccb73700 1 -- 172.21.15.63:0/1468213906 wait complete. 2020-05-18T21:37:06.686 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 117 2020-05-18T21:37:06.896 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 117, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:35:50.157703+0000', 'modified': '2020-05-18T21:37:06.268769+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 135, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9501}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_9501': {'gid': 9501, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/169345666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 169345666}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 169345666}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:37:06.897 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:37:06.898 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:37:07.002 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:37:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:37:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:37:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 9501, 2020-05-18T21:37:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:37:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:37:07.004 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 76.837323851999997, 2020-05-18T21:37:07.004 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 117, 2020-05-18T21:37:07.004 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 135, 2020-05-18T21:37:07.004 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 135, 2020-05-18T21:37:07.004 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 81.055222129000001 2020-05-18T21:37:07.005 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:37:07.011 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 9501, "want_state": "up:active", "state": "up:active", "rank_uptime": 76.837323851999997, "mdsmap_epoch": 117, "osdmap_epoch": 135, "osdmap_epoch_barrier": 135, "uptime": 81.055222129000001 } 2020-05-18T21:37:07.012 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early df --format=json-pretty 2020-05-18T21:37:07.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.109+0000 7fef085eb700 1 Processor -- start 2020-05-18T21:37:07.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.109+0000 7fef085eb700 1 -- start start 2020-05-18T21:37:07.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.109+0000 7fef085eb700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fef0005aab0 0x7fef000affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:07.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.109+0000 7fef085eb700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef000b43f0 con 0x7fef001333c0 2020-05-18T21:37:07.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.109+0000 7fef085eb700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef0014dbd0 con 0x7fef000af0c0 2020-05-18T21:37:07.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.109+0000 7fef085eb700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef0014ea20 con 0x7fef0005aab0 2020-05-18T21:37:07.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.109+0000 7fef06b88700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fef001333c0 0x7fef0014a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37330/0 (socket says 172.21.15.63:37330) 2020-05-18T21:37:07.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.109+0000 7fef06b88700 1 -- 172.21.15.63:0/3636292985 learned_addr learned my addr 172.21.15.63:0/3636292985 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:07.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.109+0000 7fef06387700 1 --2- 172.21.15.63:0/3636292985 >> v2:172.21.15.155:3300/0 conn(0x7fef0005aab0 0x7fef000affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:07.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.109+0000 7fef05385700 1 -- 172.21.15.63:0/3636292985 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3461140535 0 0) 0x7fef000b43f0 con 0x7fef001333c0 2020-05-18T21:37:07.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.109+0000 7fef05385700 1 -- 172.21.15.63:0/3636292985 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feee8003270 con 0x7fef001333c0 2020-05-18T21:37:07.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef05385700 1 -- 172.21.15.63:0/3636292985 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1937634875 0 0) 0x7feee8003270 con 0x7fef001333c0 2020-05-18T21:37:07.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef05385700 1 -- 172.21.15.63:0/3636292985 >> v2:172.21.15.155:3300/0 conn(0x7fef0005aab0 msgr2=0x7fef000affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:07.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef05385700 1 --2- 172.21.15.63:0/3636292985 >> v2:172.21.15.155:3300/0 conn(0x7fef0005aab0 0x7fef000affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:07.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef05385700 1 -- 172.21.15.63:0/3636292985 >> v1:172.21.15.155:6789/0 conn(0x7fef000af0c0 legacy=0x7fef0014e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:07.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef05385700 1 -- 172.21.15.63:0/3636292985 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0014de70 con 0x7fef001333c0 2020-05-18T21:37:07.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef05385700 1 -- 172.21.15.63:0/3636292985 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7feef8001a90 con 0x7fef001333c0 2020-05-18T21:37:07.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef05385700 1 -- 172.21.15.63:0/3636292985 >> v1:172.21.15.63:6789/0 conn(0x7fef001333c0 legacy=0x7fef0014a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:07.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef05385700 1 --2- 172.21.15.63:0/3636292985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feee8003760 0x7feee8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:07.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef05385700 1 --2- 172.21.15.63:0/3636292985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feee80040b0 0x7feee8004590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:07.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef05385700 1 --2- 172.21.15.63:0/3636292985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feee8004b00 0x7feee8004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:07.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef05385700 1 -- 172.21.15.63:0/3636292985 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0014ea20 con 0x7feee8004b00 2020-05-18T21:37:07.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef05385700 1 -- 172.21.15.63:0/3636292985 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee800b8c0 con 0x7feee8003760 2020-05-18T21:37:07.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef05385700 1 -- 172.21.15.63:0/3636292985 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee800ba80 con 0x7feee80040b0 2020-05-18T21:37:07.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef06b88700 1 --2- 172.21.15.63:0/3636292985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feee8004b00 0x7feee8004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:07.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef06387700 1 --2- 172.21.15.63:0/3636292985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feee8003760 0x7feee8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:07.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef05b86700 1 --2- 172.21.15.63:0/3636292985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feee80040b0 0x7feee8004590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:07.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef06b88700 1 -- 172.21.15.63:0/3636292985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feee80040b0 msgr2=0x7feee8004590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:07.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef06b88700 1 --2- 172.21.15.63:0/3636292985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feee80040b0 0x7feee8004590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:07.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef06b88700 1 -- 172.21.15.63:0/3636292985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feee8003760 msgr2=0x7feee8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:07.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef06b88700 1 --2- 172.21.15.63:0/3636292985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feee8003760 0x7feee8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:07.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef06b88700 1 -- 172.21.15.63:0/3636292985 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee8003270 con 0x7feee8004b00 2020-05-18T21:37:07.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef06387700 1 --2- 172.21.15.63:0/3636292985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feee8003760 0x7feee8003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:07.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef06b88700 1 --2- 172.21.15.63:0/3636292985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feee8004b00 0x7feee8004fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feef8001380 tx=0x7feef8010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef06b88700 1 -- 172.21.15.63:0/3636292985 reap_dead start 2020-05-18T21:37:07.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef06b88700 1 --2- 172.21.15.63:0/3636292985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feee8004b00 0x7feee8004fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feef8001380 tx=0x7feef8010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef06b88700 1 --2- 172.21.15.63:0/3636292985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feee8004b00 0x7feee8004fb0 secure :-1 s=READY pgs=1891 cs=0 l=1 rx=0x7feef8001380 tx=0x7feef8010f70).ready entity=mon.0 client_cookie=3e0341b39790dcf1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:07.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef06b88700 1 --2- 172.21.15.63:0/3636292985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feee8004b00 0x7feee8004fb0 secure :-1 s=THROTTLE_DONE pgs=1891 cs=0 l=1 rx=0x7feef8001380 tx=0x7feef8010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef06b88700 1 --2- 172.21.15.63:0/3636292985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feee8004b00 0x7feee8004fb0 secure :-1 s=THROTTLE_DONE pgs=1891 cs=0 l=1 rx=0x7feef8001380 tx=0x7feef8010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef05385700 1 -- 172.21.15.63:0/3636292985 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feef800e4b0 con 0x7feee8004b00 2020-05-18T21:37:07.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef06b88700 1 --2- 172.21.15.63:0/3636292985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feee8004b00 0x7feee8004fb0 secure :-1 s=THROTTLE_DONE pgs=1891 cs=0 l=1 rx=0x7feef8001380 tx=0x7feef8010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef05385700 1 -- 172.21.15.63:0/3636292985 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef800e6b0 con 0x7feee8004b00 2020-05-18T21:37:07.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef05385700 1 -- 172.21.15.63:0/3636292985 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feef800ea10 con 0x7feee8004b00 2020-05-18T21:37:07.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef085eb700 1 -- 172.21.15.63:0/3636292985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feee8004b00 msgr2=0x7feee8004fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:07.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef085eb700 1 --2- 172.21.15.63:0/3636292985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feee8004b00 0x7feee8004fb0 secure :-1 s=READY pgs=1891 cs=0 l=1 rx=0x7feef8001380 tx=0x7feef8010f70).stop 2020-05-18T21:37:07.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef085eb700 1 -- 172.21.15.63:0/3636292985 shutdown_connections 2020-05-18T21:37:07.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef085eb700 1 --2- 172.21.15.63:0/3636292985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feee8004b00 0x7feee8004fb0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:07.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef085eb700 1 -- 172.21.15.63:0/3636292985 >> 172.21.15.63:0/3636292985 conn(0x7fef0006a500 msgr2=0x7fef000b84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:07.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef085eb700 1 -- 172.21.15.63:0/3636292985 shutdown_connections 2020-05-18T21:37:07.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.113+0000 7fef085eb700 1 -- 172.21.15.63:0/3636292985 wait complete. 2020-05-18T21:37:07.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7fef085eb700 1 Processor -- start 2020-05-18T21:37:07.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7fef085eb700 1 -- start start 2020-05-18T21:37:07.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7fef085eb700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fef000648e0 0x7fef00064450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:07.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7fef085eb700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef0015af00 0x7fef000b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:07.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7fef085eb700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef000660b0 con 0x7feee8004b00 2020-05-18T21:37:07.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7fef085eb700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef00066350 con 0x7fef000648e0 2020-05-18T21:37:07.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7fef085eb700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef000b1b90 con 0x7fef0015af00 2020-05-18T21:37:07.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7fef06387700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7feee8004b00 0x7fef000667f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37338/0 (socket says 172.21.15.63:37338) 2020-05-18T21:37:07.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7fef06387700 1 -- 172.21.15.63:0/3085459351 learned_addr learned my addr 172.21.15.63:0/3085459351 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:07.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7fef05b86700 1 --2- 172.21.15.63:0/3085459351 >> v2:172.21.15.155:3300/0 conn(0x7fef000648e0 0x7fef00064450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:07.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7fef06b88700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef0015af00 0x7fef000b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:07.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7feeef7fe700 1 -- 172.21.15.63:0/3085459351 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477419492 0 0) 0x7fef000660b0 con 0x7feee8004b00 2020-05-18T21:37:07.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7feeef7fe700 1 -- 172.21.15.63:0/3085459351 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feee0002fe0 con 0x7feee8004b00 2020-05-18T21:37:07.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7feeef7fe700 1 -- 172.21.15.63:0/3085459351 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4097934275 0 0) 0x7feee0002fe0 con 0x7feee8004b00 2020-05-18T21:37:07.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7feeef7fe700 1 -- 172.21.15.63:0/3085459351 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fef000660b0 con 0x7feee8004b00 2020-05-18T21:37:07.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7feeef7fe700 1 -- 172.21.15.63:0/3085459351 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7feefc0014d0 con 0x7feee8004b00 2020-05-18T21:37:07.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7feeef7fe700 1 -- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef0015af00 msgr2=0x7fef000b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:07.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7feeef7fe700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef0015af00 0x7fef000b1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:07.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7feeef7fe700 1 -- 172.21.15.63:0/3085459351 >> v2:172.21.15.155:3300/0 conn(0x7fef000648e0 msgr2=0x7fef00064450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:07.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7feeef7fe700 1 --2- 172.21.15.63:0/3085459351 >> v2:172.21.15.155:3300/0 conn(0x7fef000648e0 0x7fef00064450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:07.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7feeef7fe700 1 -- 172.21.15.63:0/3085459351 >> v1:172.21.15.63:6789/0 conn(0x7feee8004b00 legacy=0x7fef000667f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:07.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7feeef7fe700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feee0004a80 0x7feee0004ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:07.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7feeef7fe700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feee00039a0 0x7feee0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:07.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7feeef7fe700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feee0004260 0x7feee000b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:07.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7feeef7fe700 1 -- 172.21.15.63:0/3085459351 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef00066350 con 0x7feee0004260 2020-05-18T21:37:07.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7feeef7fe700 1 -- 172.21.15.63:0/3085459351 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef000b1b90 con 0x7feee00039a0 2020-05-18T21:37:07.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7feeef7fe700 1 -- 172.21.15.63:0/3085459351 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee0004760 con 0x7feee0004a80 2020-05-18T21:37:07.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7fef05b86700 1 --2- 172.21.15.63:0/3085459351 >> v2:172.21.15.155:3300/0 conn(0x7fef000648e0 0x7fef00064450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:07.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7fef06387700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feee0004a80 0x7feee0004ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:07.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7fef06b88700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feee0004260 0x7feee000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:07.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.117+0000 7fef05b86700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feee00039a0 0x7feee0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:07.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7fef06387700 1 -- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feee00039a0 msgr2=0x7feee0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:07.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7fef06387700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feee00039a0 0x7feee0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:07.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7fef06387700 1 -- 172.21.15.63:0/3085459351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feee0004260 msgr2=0x7feee000b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:07.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7fef06387700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feee0004260 0x7feee000b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:07.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7fef06387700 1 -- 172.21.15.63:0/3085459351 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef00066f00 con 0x7feee0004a80 2020-05-18T21:37:07.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7fef085eb700 1 -- 172.21.15.63:0/3085459351 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef000b1730 con 0x7feee0004a80 2020-05-18T21:37:07.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7fef06387700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feee0004a80 0x7feee0004ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feefc007960 tx=0x7feefc011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7fef085eb700 1 -- 172.21.15.63:0/3085459351 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef00157f50 con 0x7feee0004a80 2020-05-18T21:37:07.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7fef06387700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feee0004a80 0x7feee0004ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feefc007960 tx=0x7feefc011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7fef06387700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feee0004a80 0x7feee0004ea0 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7feefc007960 tx=0x7feefc011780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:07.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7fef06387700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feee0004a80 0x7feee0004ea0 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7feefc007960 tx=0x7feefc011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7feeef7fe700 1 -- 172.21.15.63:0/3085459351 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feefc007180 con 0x7feee0004a80 2020-05-18T21:37:07.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7fef06387700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feee0004a80 0x7feee0004ea0 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7feefc007960 tx=0x7feefc011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7feeef7fe700 1 -- 172.21.15.63:0/3085459351 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feefc0072e0 con 0x7feee0004a80 2020-05-18T21:37:07.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7fef06387700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feee0004a80 0x7feee0004ea0 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7feefc007960 tx=0x7feefc011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7feeef7fe700 1 -- 172.21.15.63:0/3085459351 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feefc007640 con 0x7feee0004a80 2020-05-18T21:37:07.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7fef085eb700 1 -- 172.21.15.63:0/3085459351 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feedc003380 con 0x7feee0004a80 2020-05-18T21:37:07.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7fef06387700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feee0004a80 0x7feee0004ea0 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7feefc007960 tx=0x7feefc011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7feeef7fe700 1 -- 172.21.15.63:0/3085459351 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7feefc008620 con 0x7feee0004a80 2020-05-18T21:37:07.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7fef06387700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feee0004a80 0x7feee0004ea0 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7feefc007960 tx=0x7feefc011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7feeef7fe700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feee0058040 0x7feee005a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:07.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7feeef7fe700 1 -- 172.21.15.63:0/3085459351 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7feefc064780 con 0x7feee0004a80 2020-05-18T21:37:07.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.121+0000 7fef05b86700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feee0058040 0x7feee005a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:07.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.125+0000 7fef05b86700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feee0058040 0x7feee005a500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fef00060150 tx=0x7feef00019c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.125+0000 7fef05b86700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feee0058040 0x7feee005a500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fef00060150 tx=0x7feef00019c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.125+0000 7fef05b86700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feee0058040 0x7feee005a500 secure :-1 s=READY pgs=735 cs=0 l=1 rx=0x7fef00060150 tx=0x7feef00019c0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:07.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.129+0000 7fef06387700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feee0004a80 0x7feee0004ea0 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7feefc007960 tx=0x7feefc011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.129+0000 7feeef7fe700 1 -- 172.21.15.63:0/3085459351 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7feefc03eb70 con 0x7feee0004a80 2020-05-18T21:37:07.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.281+0000 7fef085eb700 1 -- 172.21.15.63:0/3085459351 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7feedc002210 con 0x7feee0004a80 2020-05-18T21:37:07.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.285+0000 7fef06387700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feee0004a80 0x7feee0004ea0 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7feefc007960 tx=0x7feefc011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.285+0000 7feeef7fe700 1 -- 172.21.15.63:0/3085459351 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1939 (secure 0 0 0) 0x7feefc042190 con 0x7feee0004a80 2020-05-18T21:37:07.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.285+0000 7fef085eb700 1 -- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feee0058040 msgr2=0x7feee005a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:07.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.285+0000 7fef085eb700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feee0058040 0x7feee005a500 secure :-1 s=READY pgs=735 cs=0 l=1 rx=0x7fef00060150 tx=0x7feef00019c0).stop 2020-05-18T21:37:07.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.285+0000 7fef085eb700 1 -- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feee0004a80 msgr2=0x7feee0004ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:07.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.285+0000 7fef085eb700 1 --2- 172.21.15.63:0/3085459351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feee0004a80 0x7feee0004ea0 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7feefc007960 tx=0x7feefc011780).stop 2020-05-18T21:37:07.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.285+0000 7fef06b88700 1 -- 172.21.15.63:0/3085459351 reap_dead start 2020-05-18T21:37:07.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.285+0000 7fef06b88700 1 -- 172.21.15.63:0/3085459351 reap_dead start 2020-05-18T21:37:07.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.285+0000 7fef085eb700 1 -- 172.21.15.63:0/3085459351 shutdown_connections 2020-05-18T21:37:07.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.285+0000 7fef085eb700 1 -- 172.21.15.63:0/3085459351 >> 172.21.15.63:0/3085459351 conn(0x7fef0006a500 msgr2=0x7fef0014c190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:07.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.289+0000 7fef085eb700 1 -- 172.21.15.63:0/3085459351 shutdown_connections 2020-05-18T21:37:07.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.289+0000 7fef085eb700 1 -- 172.21.15.63:0/3085459351 wait complete. 2020-05-18T21:37:07.300 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.300 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:37:07.300 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:37:07.300 INFO:teuthology.orchestra.run.smithi063.stdout: "total_bytes": 773094113280, 2020-05-18T21:37:07.301 INFO:teuthology.orchestra.run.smithi063.stdout: "total_avail_bytes": 764490203136, 2020-05-18T21:37:07.301 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_bytes": 13975552, 2020-05-18T21:37:07.301 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_bytes": 8603910144, 2020-05-18T21:37:07.301 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_ratio": 0.011129188351333141, 2020-05-18T21:37:07.301 INFO:teuthology.orchestra.run.smithi063.stdout: "num_osds": 8, 2020-05-18T21:37:07.301 INFO:teuthology.orchestra.run.smithi063.stdout: "num_per_pool_osds": 8, 2020-05-18T21:37:07.302 INFO:teuthology.orchestra.run.smithi063.stdout: "num_per_pool_omap_osds": 8 2020-05-18T21:37:07.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:07.302 INFO:teuthology.orchestra.run.smithi063.stdout: "stats_by_class": { 2020-05-18T21:37:07.302 INFO:teuthology.orchestra.run.smithi063.stdout: "ssd": { 2020-05-18T21:37:07.302 INFO:teuthology.orchestra.run.smithi063.stdout: "total_bytes": 773094113280, 2020-05-18T21:37:07.303 INFO:teuthology.orchestra.run.smithi063.stdout: "total_avail_bytes": 764490203136, 2020-05-18T21:37:07.303 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_bytes": 13975552, 2020-05-18T21:37:07.303 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_bytes": 8603910144, 2020-05-18T21:37:07.303 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_ratio": 0.011129188351333141 2020-05-18T21:37:07.303 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:07.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:07.304 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:37:07.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:07.304 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_health_metrics", 2020-05-18T21:37:07.304 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 1, 2020-05-18T21:37:07.304 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:37:07.305 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 0, 2020-05-18T21:37:07.305 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 2, 2020-05-18T21:37:07.305 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 0, 2020-05-18T21:37:07.305 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 0, 2020-05-18T21:37:07.305 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 0, 2020-05-18T21:37:07.306 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362917593088 2020-05-18T21:37:07.306 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:07.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:07.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:07.313 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd", 2020-05-18T21:37:07.314 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 2, 2020-05-18T21:37:07.314 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:37:07.314 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 0, 2020-05-18T21:37:07.314 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 0, 2020-05-18T21:37:07.314 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 0, 2020-05-18T21:37:07.315 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 0, 2020-05-18T21:37:07.315 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 0, 2020-05-18T21:37:07.315 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362917593088 2020-05-18T21:37:07.315 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:07.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:07.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:07.316 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephfs_metadata", 2020-05-18T21:37:07.316 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 25, 2020-05-18T21:37:07.316 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:37:07.316 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 66973, 2020-05-18T21:37:07.317 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 42, 2020-05-18T21:37:07.317 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 240, 2020-05-18T21:37:07.317 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 245760, 2020-05-18T21:37:07.317 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 3.3858913184303674e-07, 2020-05-18T21:37:07.317 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362917593088 2020-05-18T21:37:07.317 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:07.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:07.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:07.318 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephfs_data", 2020-05-18T21:37:07.318 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 26, 2020-05-18T21:37:07.318 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:37:07.319 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 0, 2020-05-18T21:37:07.319 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 0, 2020-05-18T21:37:07.319 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 0, 2020-05-18T21:37:07.319 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 0, 2020-05-18T21:37:07.319 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 0, 2020-05-18T21:37:07.320 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362917593088 2020-05-18T21:37:07.320 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:07.320 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:07.320 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:07.320 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:37:07.322 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s 2020-05-18T21:37:07.322 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:37:07.323 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:37:07.340 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:37:07.361 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:37:07.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:07.363 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:37:07.369 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-05-18T21:37:07.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:37:07.371 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:37:07.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:07.372 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:37:07.379 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:37:07.379 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:37:07.379 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:37:07.379 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:07.380 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:37:07.380 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:07.380 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:07.380 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:07.380 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:07.381 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:07.381 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:07.381 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:07.381 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:37:07.381 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:07.382 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:37:07.382 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42215sec preferred_lft 42215sec 2020-05-18T21:37:07.382 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:37:07.382 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:07.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:07.383 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:37:07.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:07.428 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:37:07.434 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-05-18T21:37:07.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:37:07.436 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-05-18T21:37:07.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:07.437 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:37:07.443 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:37:07.443 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:37:07.443 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:37:07.444 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:07.444 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:37:07.444 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:07.444 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:07.444 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:07.445 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:07.445 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:07.445 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:07.445 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:07.445 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:37:07.446 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:07.446 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:37:07.446 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42215sec preferred_lft 42215sec 2020-05-18T21:37:07.446 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:37:07.446 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:07.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:07.447 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:37:07.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:07.492 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:37:07.500 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2020-05-18T21:37:07.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:37:07.501 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-05-18T21:37:07.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:07.502 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:37:07.509 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:37:07.509 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:37:07.510 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:37:07.510 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:07.510 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:37:07.510 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:07.511 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:07.511 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:07.511 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:07.511 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:07.511 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:07.512 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:07.512 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:37:07.512 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:07.512 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:37:07.512 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42219sec preferred_lft 42219sec 2020-05-18T21:37:07.513 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:37:07.513 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:07.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:07.514 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:37:07.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:07.521 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:37:07.569 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2020-05-18T21:37:07.570 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:37:07.571 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-05-18T21:37:07.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:07.572 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:37:07.579 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:37:07.579 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:37:07.580 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:37:07.580 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:07.580 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:37:07.580 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:07.580 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:07.581 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:07.581 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:07.581 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:07.581 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:07.581 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:07.582 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:37:07.582 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:07.582 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:37:07.582 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42219sec preferred_lft 42219sec 2020-05-18T21:37:07.582 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:37:07.583 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:07.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:07.584 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:37:07.593 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:37:07.596 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:37:07.634 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2020-05-18T21:37:07.634 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2020-05-18T21:37:07.635 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:37:07.635 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2020-05-18T21:37:07.637 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.637 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2020-05-18T21:37:07.638 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.638 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2020-05-18T21:37:07.639 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.639 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2020-05-18T21:37:07.639 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2020-05-18T21:37:07.639 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.640 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2020-05-18T21:37:07.640 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2020-05-18T21:37:07.640 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.640 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:37:07.641 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2020-05-18T21:37:07.641 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.641 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:37:07.641 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:37:07.642 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.642 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2020-05-18T21:37:07.642 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.642 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2020-05-18T21:37:07.642 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2020-05-18T21:37:07.642 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:37:07.643 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:37:07.643 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2020-05-18T21:37:07.643 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:37:07.643 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2020-05-18T21:37:07.644 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:37:07.644 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:37:07.644 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2020-05-18T21:37:07.644 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.645 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:37:07.645 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.645 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2020-05-18T21:37:07.645 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.645 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2020-05-18T21:37:07.646 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.646 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2020-05-18T21:37:07.646 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2020-05-18T21:37:07.646 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:37:07.646 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:37:07.647 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.647 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2020-05-18T21:37:07.647 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2020-05-18T21:37:07.647 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.647 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2020-05-18T21:37:07.648 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2020-05-18T21:37:07.648 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.648 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2020-05-18T21:37:07.648 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2020-05-18T21:37:07.648 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.649 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2020-05-18T21:37:07.649 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2020-05-18T21:37:07.649 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2020-05-18T21:37:07.649 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.649 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2020-05-18T21:37:07.650 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2020-05-18T21:37:07.650 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.650 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:37:07.650 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.651 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2020-05-18T21:37:07.651 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.651 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2020-05-18T21:37:07.651 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.652 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:37:07.652 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2020-05-18T21:37:07.652 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.652 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2020-05-18T21:37:07.652 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2020-05-18T21:37:07.653 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2020-05-18T21:37:07.653 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2020-05-18T21:37:07.653 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2020-05-18T21:37:07.653 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2020-05-18T21:37:07.653 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2020-05-18T21:37:07.654 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2020-05-18T21:37:07.654 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2020-05-18T21:37:07.654 INFO:teuthology.orchestra.run.smithi063.stdout: debug filestore = 20 2020-05-18T21:37:07.654 INFO:teuthology.orchestra.run.smithi063.stdout: debug journal = 20 2020-05-18T21:37:07.654 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 20 2020-05-18T21:37:07.655 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 25 2020-05-18T21:37:07.655 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2020-05-18T21:37:07.655 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:37:07.655 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2020-05-18T21:37:07.655 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:37:07.655 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:37:07.656 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2020-05-18T21:37:07.656 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:37:07.656 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.657 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2020-05-18T21:37:07.657 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:37:07.657 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2020-05-18T21:37:07.657 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:37:07.658 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:37:07.658 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:37:07.658 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:37:07.658 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2020-05-18T21:37:07.658 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.659 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2020-05-18T21:37:07.659 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:37:07.659 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:37:07.659 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2020-05-18T21:37:07.659 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:37:07.659 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2020-05-18T21:37:07.660 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2020-05-18T21:37:07.660 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:37:07.660 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2020-05-18T21:37:07.660 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2020-05-18T21:37:07.660 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:37:07.661 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2020-05-18T21:37:07.661 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:07.661 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2020-05-18T21:37:07.661 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2020-05-18T21:37:07.661 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2020-05-18T21:37:07.661 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2020-05-18T21:37:07.662 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:37:07.662 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:37:07.662 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2020-05-18T21:37:07.662 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2020-05-18T21:37:07.662 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:37:07.663 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2020-05-18T21:37:07.663 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2020-05-18T21:37:07.663 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2020-05-18T21:37:07.663 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2020-05-18T21:37:07.663 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2020-05-18T21:37:07.663 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2020-05-18T21:37:07.664 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2020-05-18T21:37:07.664 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2020-05-18T21:37:07.664 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:37:07.664 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal frag = True 2020-05-18T21:37:07.664 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal fragment size max = 10000 2020-05-18T21:37:07.665 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal merge size = 5 2020-05-18T21:37:07.665 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split bits = 3 2020-05-18T21:37:07.665 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split size = 100 2020-05-18T21:37:07.665 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2020-05-18T21:37:07.665 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2020-05-18T21:37:07.666 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2020-05-18T21:37:07.666 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2020-05-18T21:37:07.666 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:37:07.668 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2020-05-18T21:37:07.668 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2020-05-18T21:37:07.668 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:37:07.668 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2020-05-18T21:37:07.668 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.669 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2020-05-18T21:37:07.669 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.669 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2020-05-18T21:37:07.669 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.669 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2020-05-18T21:37:07.670 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2020-05-18T21:37:07.670 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.670 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2020-05-18T21:37:07.671 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2020-05-18T21:37:07.671 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.671 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:37:07.672 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2020-05-18T21:37:07.672 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.672 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:37:07.673 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:37:07.673 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.673 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2020-05-18T21:37:07.674 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.674 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2020-05-18T21:37:07.674 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2020-05-18T21:37:07.675 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:37:07.675 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:37:07.675 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2020-05-18T21:37:07.675 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:37:07.676 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2020-05-18T21:37:07.676 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:37:07.676 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:37:07.677 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2020-05-18T21:37:07.677 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.677 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:37:07.678 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.678 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2020-05-18T21:37:07.678 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.678 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2020-05-18T21:37:07.679 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.679 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2020-05-18T21:37:07.679 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2020-05-18T21:37:07.680 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:37:07.680 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:37:07.680 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.681 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2020-05-18T21:37:07.681 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2020-05-18T21:37:07.681 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.681 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2020-05-18T21:37:07.682 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2020-05-18T21:37:07.682 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.682 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2020-05-18T21:37:07.683 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2020-05-18T21:37:07.683 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.683 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2020-05-18T21:37:07.683 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2020-05-18T21:37:07.684 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2020-05-18T21:37:07.684 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.684 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2020-05-18T21:37:07.685 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2020-05-18T21:37:07.685 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.685 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:37:07.686 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.686 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2020-05-18T21:37:07.686 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.687 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2020-05-18T21:37:07.687 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.687 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:37:07.687 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2020-05-18T21:37:07.688 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.688 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2020-05-18T21:37:07.688 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2020-05-18T21:37:07.689 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2020-05-18T21:37:07.689 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2020-05-18T21:37:07.689 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2020-05-18T21:37:07.690 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2020-05-18T21:37:07.690 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2020-05-18T21:37:07.690 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2020-05-18T21:37:07.690 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2020-05-18T21:37:07.691 INFO:teuthology.orchestra.run.smithi155.stdout: debug filestore = 20 2020-05-18T21:37:07.691 INFO:teuthology.orchestra.run.smithi155.stdout: debug journal = 20 2020-05-18T21:37:07.691 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 20 2020-05-18T21:37:07.692 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 25 2020-05-18T21:37:07.692 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2020-05-18T21:37:07.693 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:37:07.694 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2020-05-18T21:37:07.694 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:37:07.694 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:37:07.694 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2020-05-18T21:37:07.695 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:37:07.695 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.695 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2020-05-18T21:37:07.695 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:37:07.695 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2020-05-18T21:37:07.696 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:37:07.696 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:37:07.697 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:37:07.697 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:37:07.698 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2020-05-18T21:37:07.698 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.698 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2020-05-18T21:37:07.698 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:37:07.699 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:37:07.699 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2020-05-18T21:37:07.699 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:37:07.699 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2020-05-18T21:37:07.699 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2020-05-18T21:37:07.699 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:37:07.700 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2020-05-18T21:37:07.700 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2020-05-18T21:37:07.700 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:37:07.700 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2020-05-18T21:37:07.700 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:07.701 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2020-05-18T21:37:07.701 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2020-05-18T21:37:07.701 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2020-05-18T21:37:07.701 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2020-05-18T21:37:07.701 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:37:07.701 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:37:07.702 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2020-05-18T21:37:07.702 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2020-05-18T21:37:07.702 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:37:07.702 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2020-05-18T21:37:07.702 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2020-05-18T21:37:07.703 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2020-05-18T21:37:07.703 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2020-05-18T21:37:07.703 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2020-05-18T21:37:07.703 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2020-05-18T21:37:07.703 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2020-05-18T21:37:07.703 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2020-05-18T21:37:07.704 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:37:07.704 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal frag = True 2020-05-18T21:37:07.704 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2020-05-18T21:37:07.704 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2020-05-18T21:37:07.704 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2020-05-18T21:37:07.705 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2020-05-18T21:37:07.705 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2020-05-18T21:37:07.705 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2020-05-18T21:37:07.705 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2020-05-18T21:37:07.705 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2020-05-18T21:37:07.705 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:37:07.707 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_strays.TestStrays.test_purge_on_shutdown' 2020-05-18T21:37:07.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.813+0000 7eff41495700 1 Processor -- start 2020-05-18T21:37:07.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.813+0000 7eff41495700 1 -- start start 2020-05-18T21:37:07.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff41495700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7eff3c05f110 0x7eff3c0b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:07.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff41495700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3c14aa70 0x7eff3c0648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:07.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff41495700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3c14a330 con 0x7eff3c064d20 2020-05-18T21:37:07.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff41495700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c14a140 con 0x7eff3c05f110 2020-05-18T21:37:07.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff41495700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c14a5d0 con 0x7eff3c14aa70 2020-05-18T21:37:07.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff40c94700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7eff3c064d20 0x7eff3c14d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37354/0 (socket says 172.21.15.63:37354) 2020-05-18T21:37:07.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff40c94700 1 -- 172.21.15.63:0/1946219197 learned_addr learned my addr 172.21.15.63:0/1946219197 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:07.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff3bfff700 1 --2- 172.21.15.63:0/1946219197 >> v2:172.21.15.155:3300/0 conn(0x7eff3c05f110 0x7eff3c0b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:07.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/1946219197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3c14aa70 0x7eff3c0648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:07.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff3affd700 1 -- 172.21.15.63:0/1946219197 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504696986 0 0) 0x7eff3c14a330 con 0x7eff3c064d20 2020-05-18T21:37:07.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff3affd700 1 -- 172.21.15.63:0/1946219197 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff1c003270 con 0x7eff3c064d20 2020-05-18T21:37:07.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff3b7fe700 1 -- 172.21.15.63:0/1946219197 >> v2:172.21.15.155:3300/0 conn(0x7eff3c05f110 msgr2=0x7eff3c0b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:07.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/1946219197 >> v2:172.21.15.155:3300/0 conn(0x7eff3c05f110 0x7eff3c0b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:07.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff3b7fe700 1 -- 172.21.15.63:0/1946219197 >> v1:172.21.15.63:6789/0 conn(0x7eff3c064d20 legacy=0x7eff3c14d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:07.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff3b7fe700 1 -- 172.21.15.63:0/1946219197 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c063430 con 0x7eff3c14aa70 2020-05-18T21:37:07.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/1946219197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3c14aa70 0x7eff3c0648c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7eff3c063c70 tx=0x7eff24008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/1946219197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3c14aa70 0x7eff3c0648c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7eff3c063c70 tx=0x7eff24008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/1946219197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3c14aa70 0x7eff3c0648c0 secure :-1 s=READY pgs=284 cs=0 l=1 rx=0x7eff3c063c70 tx=0x7eff24008920).ready entity=mon.2 client_cookie=36103f16f0fbbc67 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:07.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/1946219197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3c14aa70 0x7eff3c0648c0 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7eff3c063c70 tx=0x7eff24008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff3affd700 1 -- 172.21.15.63:0/1946219197 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff24008e80 con 0x7eff3c14aa70 2020-05-18T21:37:07.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/1946219197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3c14aa70 0x7eff3c0648c0 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7eff3c063c70 tx=0x7eff24008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/1946219197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3c14aa70 0x7eff3c0648c0 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7eff3c063c70 tx=0x7eff24008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff3affd700 1 -- 172.21.15.63:0/1946219197 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff24011540 con 0x7eff3c14aa70 2020-05-18T21:37:07.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff3affd700 1 -- 172.21.15.63:0/1946219197 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff24011960 con 0x7eff3c14aa70 2020-05-18T21:37:07.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff41495700 1 -- 172.21.15.63:0/1946219197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3c14aa70 msgr2=0x7eff3c0648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:07.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff41495700 1 --2- 172.21.15.63:0/1946219197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3c14aa70 0x7eff3c0648c0 secure :-1 s=READY pgs=284 cs=0 l=1 rx=0x7eff3c063c70 tx=0x7eff24008920).stop 2020-05-18T21:37:07.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff41495700 1 -- 172.21.15.63:0/1946219197 shutdown_connections 2020-05-18T21:37:07.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff41495700 1 --2- 172.21.15.63:0/1946219197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3c14aa70 0x7eff3c0648c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:07.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff41495700 1 --2- 172.21.15.63:0/1946219197 >> v2:172.21.15.155:3300/0 conn(0x7eff3c05f110 0x7eff3c0b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:07.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.817+0000 7eff41495700 1 -- 172.21.15.63:0/1946219197 >> 172.21.15.63:0/1946219197 conn(0x7eff3c069fc0 msgr2=0x7eff3c06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:07.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.821+0000 7eff41495700 1 -- 172.21.15.63:0/1946219197 shutdown_connections 2020-05-18T21:37:07.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.821+0000 7eff41495700 1 -- 172.21.15.63:0/1946219197 wait complete. 2020-05-18T21:37:07.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.821+0000 7eff41495700 1 Processor -- start 2020-05-18T21:37:07.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.821+0000 7eff41495700 1 -- start start 2020-05-18T21:37:07.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.821+0000 7eff41495700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3c05f110 0x7eff3c14c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:07.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.821+0000 7eff41495700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7eff3c064d20 0x7eff3c0b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:07.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.821+0000 7eff41495700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7eff3c14aa70 0x7eff3c13c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:07.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.821+0000 7eff41495700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c0b8120 con 0x7eff3c064d20 2020-05-18T21:37:07.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.821+0000 7eff41495700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c142d60 con 0x7eff3c14aa70 2020-05-18T21:37:07.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.821+0000 7eff41495700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c143000 con 0x7eff3c05f110 2020-05-18T21:37:07.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.821+0000 7eff3b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7eff3c064d20 0x7eff3c0b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:07.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.821+0000 7eff3b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7eff3c064d20 0x7eff3c0b7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35172/0 (socket says 172.21.15.63:35172) 2020-05-18T21:37:07.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.821+0000 7eff3b7fe700 1 -- 172.21.15.63:0/2457854904 learned_addr learned my addr 172.21.15.63:0/2457854904 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:07.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.821+0000 7eff40c94700 1 --2- 172.21.15.63:0/2457854904 >> v2:172.21.15.155:3300/0 conn(0x7eff3c14aa70 0x7eff3c13c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:07.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.821+0000 7eff3bfff700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3c05f110 0x7eff3c14c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:07.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.821+0000 7eff3b7fe700 1 -- 172.21.15.63:0/2457854904 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3c05f110 msgr2=0x7eff3c14c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:07.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.825+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3c05f110 0x7eff3c14c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:07.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.825+0000 7eff3b7fe700 1 -- 172.21.15.63:0/2457854904 >> v2:172.21.15.155:3300/0 conn(0x7eff3c14aa70 msgr2=0x7eff3c13c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:07.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.825+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/2457854904 >> v2:172.21.15.155:3300/0 conn(0x7eff3c14aa70 0x7eff3c13c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:07.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.825+0000 7eff3b7fe700 1 -- 172.21.15.63:0/2457854904 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c1432a0 con 0x7eff3c064d20 2020-05-18T21:37:07.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.825+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/2457854904 >> v2:172.21.15.63:3300/0 conn(0x7eff3c064d20 0x7eff3c0b7c30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7eff3c063c70 tx=0x7eff3c0635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.825+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/2457854904 >> v2:172.21.15.63:3300/0 conn(0x7eff3c064d20 0x7eff3c0b7c30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7eff3c063c70 tx=0x7eff3c0635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.825+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff3c064d20 0x7eff3c0b7c30 secure :-1 s=READY pgs=1894 cs=0 l=1 rx=0x7eff3c063c70 tx=0x7eff3c0635c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:07.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.825+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff3c064d20 0x7eff3c0b7c30 secure :-1 s=THROTTLE_DONE pgs=1894 cs=0 l=1 rx=0x7eff3c063c70 tx=0x7eff3c0635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.825+0000 7eff397fa700 1 -- 172.21.15.63:0/2457854904 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff240118d0 con 0x7eff3c064d20 2020-05-18T21:37:07.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.825+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff3c064d20 0x7eff3c0b7c30 secure :-1 s=THROTTLE_DONE pgs=1894 cs=0 l=1 rx=0x7eff3c063c70 tx=0x7eff3c0635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.825+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff3c064d20 0x7eff3c0b7c30 secure :-1 s=THROTTLE_DONE pgs=1894 cs=0 l=1 rx=0x7eff3c063c70 tx=0x7eff3c0635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.825+0000 7eff397fa700 1 -- 172.21.15.63:0/2457854904 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff24011a30 con 0x7eff3c064d20 2020-05-18T21:37:07.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.825+0000 7eff41495700 1 -- 172.21.15.63:0/2457854904 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3c146cc0 con 0x7eff3c064d20 2020-05-18T21:37:07.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.825+0000 7eff397fa700 1 -- 172.21.15.63:0/2457854904 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff24007360 con 0x7eff3c064d20 2020-05-18T21:37:07.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.825+0000 7eff41495700 1 -- 172.21.15.63:0/2457854904 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c1473c0 con 0x7eff3c064d20 2020-05-18T21:37:07.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.825+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff3c064d20 0x7eff3c0b7c30 secure :-1 s=THROTTLE_DONE pgs=1894 cs=0 l=1 rx=0x7eff3c063c70 tx=0x7eff3c0635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.825+0000 7eff41495700 1 -- 172.21.15.63:0/2457854904 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3c146ee0 con 0x7eff3c064d20 2020-05-18T21:37:07.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.825+0000 7eff397fa700 1 -- 172.21.15.63:0/2457854904 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7eff24005700 con 0x7eff3c064d20 2020-05-18T21:37:07.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.825+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff3c064d20 0x7eff3c0b7c30 secure :-1 s=THROTTLE_DONE pgs=1894 cs=0 l=1 rx=0x7eff3c063c70 tx=0x7eff3c0635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.829+0000 7eff397fa700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff2004fac0 0x7eff20051f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:07.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.829+0000 7eff397fa700 1 -- 172.21.15.63:0/2457854904 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7eff24064510 con 0x7eff3c064d20 2020-05-18T21:37:07.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.829+0000 7eff3bfff700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff2004fac0 0x7eff20051f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:07.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.829+0000 7eff3bfff700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff2004fac0 0x7eff20051f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7eff2c0032f0 tx=0x7eff2c00dc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.829+0000 7eff3bfff700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff2004fac0 0x7eff20051f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7eff2c0032f0 tx=0x7eff2c00dc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.829+0000 7eff3bfff700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff2004fac0 0x7eff20051f80 secure :-1 s=READY pgs=736 cs=0 l=1 rx=0x7eff2c0032f0 tx=0x7eff2c00dc70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.833+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff3c064d20 0x7eff3c0b7c30 secure :-1 s=THROTTLE_DONE pgs=1894 cs=0 l=1 rx=0x7eff3c063c70 tx=0x7eff3c0635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.833+0000 7eff397fa700 1 -- 172.21.15.63:0/2457854904 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7eff3c146ee0 con 0x7eff3c064d20 2020-05-18T21:37:07.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:07.985+0000 7eff41495700 1 -- 172.21.15.63:0/2457854904 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_purge_on_shutdown"]} v 0) v1 -- 0x7eff3c0569e0 con 0x7eff3c064d20 2020-05-18T21:37:08.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.293+0000 7eff3b7fe700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff3c064d20 0x7eff3c0b7c30 secure :-1 s=THROTTLE_DONE pgs=1894 cs=0 l=1 rx=0x7eff3c063c70 tx=0x7eff3c0635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:08.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.293+0000 7eff397fa700 1 -- 172.21.15.63:0/2457854904 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_purge_on_shutdown"]}]=0 v499) v1 ==== 137+0+0 (secure 0 0 0) 0x7eff2403e840 con 0x7eff3c064d20 2020-05-18T21:37:08.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.297+0000 7eff41495700 1 -- 172.21.15.63:0/2457854904 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff2004fac0 msgr2=0x7eff20051f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:08.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.297+0000 7eff41495700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff2004fac0 0x7eff20051f80 secure :-1 s=READY pgs=736 cs=0 l=1 rx=0x7eff2c0032f0 tx=0x7eff2c00dc70).stop 2020-05-18T21:37:08.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.297+0000 7eff41495700 1 -- 172.21.15.63:0/2457854904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff3c064d20 msgr2=0x7eff3c0b7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:08.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.297+0000 7eff41495700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff3c064d20 0x7eff3c0b7c30 secure :-1 s=READY pgs=1894 cs=0 l=1 rx=0x7eff3c063c70 tx=0x7eff3c0635c0).stop 2020-05-18T21:37:08.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.297+0000 7eff41495700 1 -- 172.21.15.63:0/2457854904 shutdown_connections 2020-05-18T21:37:08.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.297+0000 7eff41495700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff2004fac0 0x7eff20051f80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:08.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.297+0000 7eff41495700 1 --2- 172.21.15.63:0/2457854904 >> v2:172.21.15.155:3300/0 conn(0x7eff3c14aa70 0x7eff3c13c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:08.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.297+0000 7eff41495700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff3c064d20 0x7eff3c0b7c30 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:08.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.297+0000 7eff41495700 1 --2- 172.21.15.63:0/2457854904 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3c05f110 0x7eff3c14c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:08.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.297+0000 7eff41495700 1 -- 172.21.15.63:0/2457854904 >> 172.21.15.63:0/2457854904 conn(0x7eff3c069fc0 msgr2=0x7eff3c0b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:08.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.297+0000 7eff41495700 1 -- 172.21.15.63:0/2457854904 shutdown_connections 2020-05-18T21:37:08.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.297+0000 7eff41495700 1 -- 172.21.15.63:0/2457854904 wait complete. 2020-05-18T21:37:08.319 INFO:tasks.cephfs_test_runner:test_purge_on_shutdown (tasks.cephfs.test_strays.TestStrays) ... ok 2020-05-18T21:37:08.320 INFO:tasks.cephfs_test_runner:Starting test: test_purge_queue_upgrade (tasks.cephfs.test_strays.TestStrays) 2020-05-18T21:37:08.321 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_strays.TestStrays.test_purge_queue_upgrade' 2020-05-18T21:37:08.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.421+0000 7f0d83130700 1 Processor -- start 2020-05-18T21:37:08.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.421+0000 7f0d83130700 1 -- start start 2020-05-18T21:37:08.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.421+0000 7f0d83130700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0d7c05f110 0x7f0d7c0657a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:08.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d83130700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7c065060 con 0x7f0d7c0b4e70 2020-05-18T21:37:08.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d83130700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7c065300 con 0x7f0d7c063380 2020-05-18T21:37:08.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d83130700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7c064e80 con 0x7f0d7c05f110 2020-05-18T21:37:08.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d8292f700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0d7c0b4e70 0x7f0d7c14a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37370/0 (socket says 172.21.15.63:37370) 2020-05-18T21:37:08.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d8292f700 1 -- 172.21.15.63:0/2660867883 learned_addr learned my addr 172.21.15.63:0/2660867883 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:08.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d8212e700 1 --2- 172.21.15.63:0/2660867883 >> v2:172.21.15.63:3300/0 conn(0x7f0d7c05f110 0x7f0d7c0657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:08.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d8112c700 1 -- 172.21.15.63:0/2660867883 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297221846 0 0) 0x7f0d7c065060 con 0x7f0d7c0b4e70 2020-05-18T21:37:08.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d8112c700 1 -- 172.21.15.63:0/2660867883 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d64003270 con 0x7f0d7c0b4e70 2020-05-18T21:37:08.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d8112c700 1 -- 172.21.15.63:0/2660867883 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351776866 0 0) 0x7f0d7c065300 con 0x7f0d7c063380 2020-05-18T21:37:08.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d8112c700 1 -- 172.21.15.63:0/2660867883 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d7c065060 con 0x7f0d7c063380 2020-05-18T21:37:08.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d8212e700 1 -- 172.21.15.63:0/2660867883 >> v1:172.21.15.155:6789/0 conn(0x7f0d7c063380 legacy=0x7f0d7c0b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:08.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d8212e700 1 -- 172.21.15.63:0/2660867883 >> v1:172.21.15.63:6789/0 conn(0x7f0d7c0b4e70 legacy=0x7f0d7c14a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:08.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d8212e700 1 -- 172.21.15.63:0/2660867883 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c05f4f0 con 0x7f0d7c05f110 2020-05-18T21:37:08.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d8212e700 1 --2- 172.21.15.63:0/2660867883 >> v2:172.21.15.63:3300/0 conn(0x7f0d7c05f110 0x7f0d7c0657a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0d78002f70 tx=0x7f0d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:08.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d8212e700 1 --2- 172.21.15.63:0/2660867883 >> v2:172.21.15.63:3300/0 conn(0x7f0d7c05f110 0x7f0d7c0657a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0d78002f70 tx=0x7f0d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:08.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d8212e700 1 --2- 172.21.15.63:0/2660867883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d7c05f110 0x7f0d7c0657a0 secure :-1 s=READY pgs=1896 cs=0 l=1 rx=0x7f0d78002f70 tx=0x7f0d78007a80).ready entity=mon.0 client_cookie=42ee6e005b371740 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:08.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d8212e700 1 --2- 172.21.15.63:0/2660867883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d7c05f110 0x7f0d7c0657a0 secure :-1 s=THROTTLE_DONE pgs=1896 cs=0 l=1 rx=0x7f0d78002f70 tx=0x7f0d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:08.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d8212e700 1 --2- 172.21.15.63:0/2660867883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d7c05f110 0x7f0d7c0657a0 secure :-1 s=THROTTLE_DONE pgs=1896 cs=0 l=1 rx=0x7f0d78002f70 tx=0x7f0d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:08.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d8212e700 1 --2- 172.21.15.63:0/2660867883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d7c05f110 0x7f0d7c0657a0 secure :-1 s=THROTTLE_DONE pgs=1896 cs=0 l=1 rx=0x7f0d78002f70 tx=0x7f0d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:08.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d8112c700 1 -- 172.21.15.63:0/2660867883 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d78008e80 con 0x7f0d7c05f110 2020-05-18T21:37:08.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d8112c700 1 -- 172.21.15.63:0/2660867883 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d78011540 con 0x7f0d7c05f110 2020-05-18T21:37:08.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d83130700 1 -- 172.21.15.63:0/2660867883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d7c05f110 msgr2=0x7f0d7c0657a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:08.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d8112c700 1 -- 172.21.15.63:0/2660867883 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d78011920 con 0x7f0d7c05f110 2020-05-18T21:37:08.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d83130700 1 --2- 172.21.15.63:0/2660867883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d7c05f110 0x7f0d7c0657a0 secure :-1 s=READY pgs=1896 cs=0 l=1 rx=0x7f0d78002f70 tx=0x7f0d78007a80).stop 2020-05-18T21:37:08.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d83130700 1 -- 172.21.15.63:0/2660867883 shutdown_connections 2020-05-18T21:37:08.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d83130700 1 --2- 172.21.15.63:0/2660867883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d7c05f110 0x7f0d7c0657a0 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:08.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d83130700 1 -- 172.21.15.63:0/2660867883 >> 172.21.15.63:0/2660867883 conn(0x7f0d7c069fc0 msgr2=0x7f0d7c06a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:08.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d83130700 1 -- 172.21.15.63:0/2660867883 shutdown_connections 2020-05-18T21:37:08.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.425+0000 7f0d83130700 1 -- 172.21.15.63:0/2660867883 wait complete. 2020-05-18T21:37:08.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d83130700 1 Processor -- start 2020-05-18T21:37:08.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d83130700 1 -- start start 2020-05-18T21:37:08.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d83130700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d7c063380 0x7f0d7c0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:08.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d83130700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7c0b0f40 con 0x7f0d7c05f110 2020-05-18T21:37:08.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d83130700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7c15bab0 con 0x7f0d7c0b4e70 2020-05-18T21:37:08.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d83130700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c15bd50 con 0x7f0d7c063380 2020-05-18T21:37:08.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d8212e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0d7c05f110 0x7f0d7c0b2f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37372/0 (socket says 172.21.15.63:37372) 2020-05-18T21:37:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d8212e700 1 -- 172.21.15.63:0/3620519552 learned_addr learned my addr 172.21.15.63:0/3620519552 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d8192d700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d7c063380 0x7f0d7c0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d6f7fe700 1 -- 172.21.15.63:0/3620519552 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706988287 0 0) 0x7f0d7c0b0f40 con 0x7f0d7c05f110 2020-05-18T21:37:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d6f7fe700 1 -- 172.21.15.63:0/3620519552 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d5c002fe0 con 0x7f0d7c05f110 2020-05-18T21:37:08.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d6f7fe700 1 -- 172.21.15.63:0/3620519552 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2052604178 0 0) 0x7f0d5c002fe0 con 0x7f0d7c05f110 2020-05-18T21:37:08.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d6f7fe700 1 -- 172.21.15.63:0/3620519552 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0d7c0b0f40 con 0x7f0d7c05f110 2020-05-18T21:37:08.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d6f7fe700 1 -- 172.21.15.63:0/3620519552 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f0d78008e80 con 0x7f0d7c05f110 2020-05-18T21:37:08.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d6f7fe700 1 -- 172.21.15.63:0/3620519552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d7c063380 msgr2=0x7f0d7c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:08.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d6f7fe700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d7c063380 0x7f0d7c0b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:08.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d6f7fe700 1 -- 172.21.15.63:0/3620519552 >> v1:172.21.15.155:6789/0 conn(0x7f0d7c0b4e70 legacy=0x7f0d7c0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:08.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d6f7fe700 1 -- 172.21.15.63:0/3620519552 >> v1:172.21.15.63:6789/0 conn(0x7f0d7c05f110 legacy=0x7f0d7c0b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:08.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d6f7fe700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d5c004a80 0x7f0d5c004e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:08.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d6f7fe700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d7c063380 0x7f0d5c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:08.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d6f7fe700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d5c003e00 0x7f0d5c004280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:08.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d6f7fe700 1 -- 172.21.15.63:0/3620519552 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c15bd50 con 0x7f0d5c003e00 2020-05-18T21:37:08.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d6f7fe700 1 -- 172.21.15.63:0/3620519552 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c004860 con 0x7f0d5c004a80 2020-05-18T21:37:08.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d6f7fe700 1 -- 172.21.15.63:0/3620519552 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c005400 con 0x7f0d7c063380 2020-05-18T21:37:08.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d8292f700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d5c003e00 0x7f0d5c004280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:08.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d8212e700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d5c004a80 0x7f0d5c004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:08.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d8192d700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d7c063380 0x7f0d5c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:08.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d8292f700 1 -- 172.21.15.63:0/3620519552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d7c063380 msgr2=0x7f0d5c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:08.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d8292f700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d7c063380 0x7f0d5c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:08.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d8292f700 1 -- 172.21.15.63:0/3620519552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d5c004a80 msgr2=0x7f0d5c004e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:08.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d8292f700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d5c004a80 0x7f0d5c004e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:08.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d8292f700 1 -- 172.21.15.63:0/3620519552 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c0ae9f0 con 0x7f0d5c003e00 2020-05-18T21:37:08.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d83130700 1 -- 172.21.15.63:0/3620519552 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7c0b0a80 con 0x7f0d5c003e00 2020-05-18T21:37:08.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.429+0000 7f0d83130700 1 -- 172.21.15.63:0/3620519552 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7c0b0750 con 0x7f0d5c003e00 2020-05-18T21:37:08.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.433+0000 7f0d8292f700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d5c003e00 0x7f0d5c004280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0d74001450 tx=0x7f0d7400c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:08.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.433+0000 7f0d8292f700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d5c003e00 0x7f0d5c004280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0d74001450 tx=0x7f0d7400c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:08.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.433+0000 7f0d8292f700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d5c003e00 0x7f0d5c004280 secure :-1 s=READY pgs=1898 cs=0 l=1 rx=0x7f0d74001450 tx=0x7f0d7400c850).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:08.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.433+0000 7f0d8292f700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d5c003e00 0x7f0d5c004280 secure :-1 s=THROTTLE_DONE pgs=1898 cs=0 l=1 rx=0x7f0d74001450 tx=0x7f0d7400c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:08.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.433+0000 7f0d6f7fe700 1 -- 172.21.15.63:0/3620519552 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d7400ce20 con 0x7f0d5c003e00 2020-05-18T21:37:08.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.433+0000 7f0d8292f700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d5c003e00 0x7f0d5c004280 secure :-1 s=THROTTLE_DONE pgs=1898 cs=0 l=1 rx=0x7f0d74001450 tx=0x7f0d7400c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:08.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.433+0000 7f0d8292f700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d5c003e00 0x7f0d5c004280 secure :-1 s=THROTTLE_DONE pgs=1898 cs=0 l=1 rx=0x7f0d74001450 tx=0x7f0d7400c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:08.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.433+0000 7f0d6f7fe700 1 -- 172.21.15.63:0/3620519552 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d74004aa0 con 0x7f0d5c003e00 2020-05-18T21:37:08.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.433+0000 7f0d6f7fe700 1 -- 172.21.15.63:0/3620519552 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d74004e40 con 0x7f0d5c003e00 2020-05-18T21:37:08.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.433+0000 7f0d83130700 1 -- 172.21.15.63:0/3620519552 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d58003380 con 0x7f0d5c003e00 2020-05-18T21:37:08.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.433+0000 7f0d8292f700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d5c003e00 0x7f0d5c004280 secure :-1 s=THROTTLE_DONE pgs=1898 cs=0 l=1 rx=0x7f0d74001450 tx=0x7f0d7400c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:08.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.433+0000 7f0d6f7fe700 1 -- 172.21.15.63:0/3620519552 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0d74010290 con 0x7f0d5c003e00 2020-05-18T21:37:08.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.433+0000 7f0d8292f700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d5c003e00 0x7f0d5c004280 secure :-1 s=THROTTLE_DONE pgs=1898 cs=0 l=1 rx=0x7f0d74001450 tx=0x7f0d7400c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:08.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.437+0000 7f0d6f7fe700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d5c057c40 0x7f0d5c05a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:08.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.437+0000 7f0d6f7fe700 1 -- 172.21.15.63:0/3620519552 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0d740100d0 con 0x7f0d5c003e00 2020-05-18T21:37:08.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.437+0000 7f0d8212e700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d5c057c40 0x7f0d5c05a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:08.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.437+0000 7f0d8212e700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d5c057c40 0x7f0d5c05a100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0d78000bc0 tx=0x7f0d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:08.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.437+0000 7f0d8212e700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d5c057c40 0x7f0d5c05a100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0d78000bc0 tx=0x7f0d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:08.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.437+0000 7f0d8212e700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d5c057c40 0x7f0d5c05a100 secure :-1 s=READY pgs=737 cs=0 l=1 rx=0x7f0d78000bc0 tx=0x7f0d78007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:08.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.441+0000 7f0d8292f700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d5c003e00 0x7f0d5c004280 secure :-1 s=THROTTLE_DONE pgs=1898 cs=0 l=1 rx=0x7f0d74001450 tx=0x7f0d7400c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:08.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.441+0000 7f0d6f7fe700 1 -- 172.21.15.63:0/3620519552 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f0d7403e340 con 0x7f0d5c003e00 2020-05-18T21:37:08.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:08.597+0000 7f0d83130700 1 -- 172.21.15.63:0/3620519552 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_purge_queue_upgrade"]} v 0) v1 -- 0x7f0d580022a0 con 0x7f0d5c003e00 2020-05-18T21:37:09.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.297+0000 7f0d8292f700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d5c003e00 0x7f0d5c004280 secure :-1 s=THROTTLE_DONE pgs=1898 cs=0 l=1 rx=0x7f0d74001450 tx=0x7f0d7400c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.297+0000 7f0d6f7fe700 1 -- 172.21.15.63:0/3620519552 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_purge_queue_upgrade"]}]=0 v500) v1 ==== 142+0+0 (secure 0 0 0) 0x7f0d74041960 con 0x7f0d5c003e00 2020-05-18T21:37:09.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.297+0000 7f0d83130700 1 -- 172.21.15.63:0/3620519552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d5c057c40 msgr2=0x7f0d5c05a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:09.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.297+0000 7f0d83130700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0d5c057c40 0x7f0d5c05a100 secure :-1 s=READY pgs=737 cs=0 l=1 rx=0x7f0d78000bc0 tx=0x7f0d78007a80).stop 2020-05-18T21:37:09.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.297+0000 7f0d83130700 1 -- 172.21.15.63:0/3620519552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d5c003e00 msgr2=0x7f0d5c004280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:09.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.297+0000 7f0d83130700 1 --2- 172.21.15.63:0/3620519552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d5c003e00 0x7f0d5c004280 secure :-1 s=READY pgs=1898 cs=0 l=1 rx=0x7f0d74001450 tx=0x7f0d7400c850).stop 2020-05-18T21:37:09.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.297+0000 7f0d8292f700 1 -- 172.21.15.63:0/3620519552 reap_dead start 2020-05-18T21:37:09.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.297+0000 7f0d8292f700 1 -- 172.21.15.63:0/3620519552 reap_dead start 2020-05-18T21:37:09.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.301+0000 7f0d83130700 1 -- 172.21.15.63:0/3620519552 shutdown_connections 2020-05-18T21:37:09.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.301+0000 7f0d83130700 1 -- 172.21.15.63:0/3620519552 >> 172.21.15.63:0/3620519552 conn(0x7f0d7c069fc0 msgr2=0x7f0d7c0b61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:09.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.301+0000 7f0d83130700 1 -- 172.21.15.63:0/3620519552 shutdown_connections 2020-05-18T21:37:09.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.301+0000 7f0d83130700 1 -- 172.21.15.63:0/3620519552 wait complete. 2020-05-18T21:37:09.323 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:37:09.324 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:37:09.342 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:37:09.362 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:37:09.362 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-05-18T21:37:09.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16ad4ba700 1 Processor -- start 2020-05-18T21:37:09.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16ad4ba700 1 -- start start 2020-05-18T21:37:09.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16ad4ba700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f16a81467a0 0x7f16a80b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:09.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16ad4ba700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16a8147000 0x7f16a805a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:09.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16ad4ba700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a8063060 con 0x7f16a8146b80 2020-05-18T21:37:09.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16ad4ba700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a80632d0 con 0x7f16a81467a0 2020-05-18T21:37:09.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16ad4ba700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8063570 con 0x7f16a8147000 2020-05-18T21:37:09.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16a6ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f16a81467a0 0x7f16a80b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:09.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16a67fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f16a8146b80 0x7f16a813ff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37386/0 (socket says 172.21.15.63:37386) 2020-05-18T21:37:09.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16a67fc700 1 -- 172.21.15.63:0/3388829329 learned_addr learned my addr 172.21.15.63:0/3388829329 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:09.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16a77fe700 1 --2- 172.21.15.63:0/3388829329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16a8147000 0x7f16a805a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:09.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16a6ffd700 1 -- 172.21.15.63:0/3388829329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16a8147000 msgr2=0x7f16a805a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:09.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16a6ffd700 1 --2- 172.21.15.63:0/3388829329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16a8147000 0x7f16a805a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:09.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16a6ffd700 1 -- 172.21.15.63:0/3388829329 >> v1:172.21.15.63:6789/0 conn(0x7f16a8146b80 legacy=0x7f16a813ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:09.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16a6ffd700 1 -- 172.21.15.63:0/3388829329 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a8063a10 con 0x7f16a81467a0 2020-05-18T21:37:09.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16a6ffd700 1 --2- 172.21.15.63:0/3388829329 >> v2:172.21.15.63:3300/0 conn(0x7f16a81467a0 0x7f16a80b5bf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1690002f70 tx=0x7f1690007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16a6ffd700 1 --2- 172.21.15.63:0/3388829329 >> v2:172.21.15.63:3300/0 conn(0x7f16a81467a0 0x7f16a80b5bf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1690002f70 tx=0x7f1690007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16a6ffd700 1 --2- 172.21.15.63:0/3388829329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16a81467a0 0x7f16a80b5bf0 secure :-1 s=READY pgs=1900 cs=0 l=1 rx=0x7f1690002f70 tx=0x7f1690007a80).ready entity=mon.0 client_cookie=8c430871d8b5225f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:09.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16a6ffd700 1 --2- 172.21.15.63:0/3388829329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16a81467a0 0x7f16a80b5bf0 secure :-1 s=THROTTLE_DONE pgs=1900 cs=0 l=1 rx=0x7f1690002f70 tx=0x7f1690007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16a6ffd700 1 --2- 172.21.15.63:0/3388829329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16a81467a0 0x7f16a80b5bf0 secure :-1 s=THROTTLE_DONE pgs=1900 cs=0 l=1 rx=0x7f1690002f70 tx=0x7f1690007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16a6ffd700 1 --2- 172.21.15.63:0/3388829329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16a81467a0 0x7f16a80b5bf0 secure :-1 s=THROTTLE_DONE pgs=1900 cs=0 l=1 rx=0x7f1690002f70 tx=0x7f1690007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16a5ffb700 1 -- 172.21.15.63:0/3388829329 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1690008e80 con 0x7f16a81467a0 2020-05-18T21:37:09.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16a5ffb700 1 -- 172.21.15.63:0/3388829329 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1690013800 con 0x7f16a81467a0 2020-05-18T21:37:09.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16a5ffb700 1 -- 172.21.15.63:0/3388829329 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1690013c20 con 0x7f16a81467a0 2020-05-18T21:37:09.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16ad4ba700 1 -- 172.21.15.63:0/3388829329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16a81467a0 msgr2=0x7f16a80b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:09.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16ad4ba700 1 --2- 172.21.15.63:0/3388829329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16a81467a0 0x7f16a80b5bf0 secure :-1 s=READY pgs=1900 cs=0 l=1 rx=0x7f1690002f70 tx=0x7f1690007a80).stop 2020-05-18T21:37:09.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16ad4ba700 1 -- 172.21.15.63:0/3388829329 shutdown_connections 2020-05-18T21:37:09.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16ad4ba700 1 --2- 172.21.15.63:0/3388829329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16a8147000 0x7f16a805a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:09.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16ad4ba700 1 --2- 172.21.15.63:0/3388829329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16a81467a0 0x7f16a80b5bf0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:09.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16ad4ba700 1 -- 172.21.15.63:0/3388829329 >> 172.21.15.63:0/3388829329 conn(0x7f16a80b9700 msgr2=0x7f16a80b9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:09.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.489+0000 7f16ad4ba700 1 -- 172.21.15.63:0/3388829329 shutdown_connections 2020-05-18T21:37:09.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.493+0000 7f16ad4ba700 1 -- 172.21.15.63:0/3388829329 wait complete. 2020-05-18T21:37:09.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.493+0000 7f16ad4ba700 1 Processor -- start 2020-05-18T21:37:09.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.493+0000 7f16ad4ba700 1 -- start start 2020-05-18T21:37:09.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.493+0000 7f16ad4ba700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f16a8146b80 0x7f16a813ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:09.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.493+0000 7f16ad4ba700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f16a8147000 0x7f16a8137770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:09.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.493+0000 7f16ad4ba700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a8137bd0 con 0x7f16a81467a0 2020-05-18T21:37:09.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.493+0000 7f16ad4ba700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a8143190 con 0x7f16a8146b80 2020-05-18T21:37:09.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.493+0000 7f16ad4ba700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a8140e40 con 0x7f16a8147000 2020-05-18T21:37:09.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.493+0000 7f16a6ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f16a81467a0 0x7f16a81363f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37392/0 (socket says 172.21.15.63:37392) 2020-05-18T21:37:09.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.493+0000 7f16a6ffd700 1 -- 172.21.15.63:0/2009527994 learned_addr learned my addr 172.21.15.63:0/2009527994 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:09.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.493+0000 7f16a67fc700 1 --2- 172.21.15.63:0/2009527994 >> v2:172.21.15.63:3300/0 conn(0x7f16a8146b80 0x7f16a813ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:09.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.493+0000 7f16a77fe700 1 --2- 172.21.15.63:0/2009527994 >> v2:172.21.15.155:3300/0 conn(0x7f16a8147000 0x7f16a8137770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:09.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.493+0000 7f169ffff700 1 -- 172.21.15.63:0/2009527994 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877943551 0 0) 0x7f16a8137bd0 con 0x7f16a81467a0 2020-05-18T21:37:09.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f169ffff700 1 -- 172.21.15.63:0/2009527994 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1680002fe0 con 0x7f16a81467a0 2020-05-18T21:37:09.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f169ffff700 1 -- 172.21.15.63:0/2009527994 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3912367324 0 0) 0x7f1680002fe0 con 0x7f16a81467a0 2020-05-18T21:37:09.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f16a67fc700 1 -- 172.21.15.63:0/2009527994 >> v2:172.21.15.155:3300/0 conn(0x7f16a8147000 msgr2=0x7f16a8137770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:09.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f16a67fc700 1 --2- 172.21.15.63:0/2009527994 >> v2:172.21.15.155:3300/0 conn(0x7f16a8147000 0x7f16a8137770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:09.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f16a67fc700 1 -- 172.21.15.63:0/2009527994 >> v1:172.21.15.63:6789/0 conn(0x7f16a81467a0 legacy=0x7f16a81363f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:09.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f16a67fc700 1 -- 172.21.15.63:0/2009527994 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a8140ba0 con 0x7f16a8146b80 2020-05-18T21:37:09.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f16a67fc700 1 --2- 172.21.15.63:0/2009527994 >> v2:172.21.15.63:3300/0 conn(0x7f16a8146b80 0x7f16a813ccf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1690007ae0 tx=0x7f16a0010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f16a67fc700 1 --2- 172.21.15.63:0/2009527994 >> v2:172.21.15.63:3300/0 conn(0x7f16a8146b80 0x7f16a813ccf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1690007ae0 tx=0x7f16a0010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f16a67fc700 1 --2- 172.21.15.63:0/2009527994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16a8146b80 0x7f16a813ccf0 secure :-1 s=READY pgs=1902 cs=0 l=1 rx=0x7f1690007ae0 tx=0x7f16a0010c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:09.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f16a67fc700 1 --2- 172.21.15.63:0/2009527994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16a8146b80 0x7f16a813ccf0 secure :-1 s=THROTTLE_DONE pgs=1902 cs=0 l=1 rx=0x7f1690007ae0 tx=0x7f16a0010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f169ffff700 1 -- 172.21.15.63:0/2009527994 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1690008e80 con 0x7f16a8146b80 2020-05-18T21:37:09.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f16a67fc700 1 --2- 172.21.15.63:0/2009527994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16a8146b80 0x7f16a813ccf0 secure :-1 s=THROTTLE_DONE pgs=1902 cs=0 l=1 rx=0x7f1690007ae0 tx=0x7f16a0010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f16a67fc700 1 --2- 172.21.15.63:0/2009527994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16a8146b80 0x7f16a813ccf0 secure :-1 s=THROTTLE_DONE pgs=1902 cs=0 l=1 rx=0x7f1690007ae0 tx=0x7f16a0010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f169ffff700 1 -- 172.21.15.63:0/2009527994 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a0005e70 con 0x7f16a8146b80 2020-05-18T21:37:09.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f16ad4ba700 1 -- 172.21.15.63:0/2009527994 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a813d780 con 0x7f16a8146b80 2020-05-18T21:37:09.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f169ffff700 1 -- 172.21.15.63:0/2009527994 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16a00122f0 con 0x7f16a8146b80 2020-05-18T21:37:09.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f16ad4ba700 1 -- 172.21.15.63:0/2009527994 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a813dc20 con 0x7f16a8146b80 2020-05-18T21:37:09.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f16a67fc700 1 --2- 172.21.15.63:0/2009527994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16a8146b80 0x7f16a813ccf0 secure :-1 s=THROTTLE_DONE pgs=1902 cs=0 l=1 rx=0x7f1690007ae0 tx=0x7f16a0010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f16ad4ba700 1 -- 172.21.15.63:0/2009527994 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a8140a10 con 0x7f16a8146b80 2020-05-18T21:37:09.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f16a67fc700 1 --2- 172.21.15.63:0/2009527994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16a8146b80 0x7f16a813ccf0 secure :-1 s=THROTTLE_DONE pgs=1902 cs=0 l=1 rx=0x7f1690007ae0 tx=0x7f16a0010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.497+0000 7f169ffff700 1 -- 172.21.15.63:0/2009527994 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f16a0012560 con 0x7f16a8146b80 2020-05-18T21:37:09.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.501+0000 7f169ffff700 1 --2- 172.21.15.63:0/2009527994 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f168004fda0 0x7f1680052260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:09.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.501+0000 7f169ffff700 1 -- 172.21.15.63:0/2009527994 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f16a00090c0 con 0x7f16a8146b80 2020-05-18T21:37:09.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.501+0000 7f16a6ffd700 1 --2- 172.21.15.63:0/2009527994 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f168004fda0 0x7f1680052260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:09.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.501+0000 7f16a6ffd700 1 --2- 172.21.15.63:0/2009527994 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f168004fda0 0x7f1680052260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1690007b20 tx=0x7f1690007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.501+0000 7f16a6ffd700 1 --2- 172.21.15.63:0/2009527994 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f168004fda0 0x7f1680052260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1690007b20 tx=0x7f1690007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.501+0000 7f16a6ffd700 1 --2- 172.21.15.63:0/2009527994 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f168004fda0 0x7f1680052260 secure :-1 s=READY pgs=738 cs=0 l=1 rx=0x7f1690007b20 tx=0x7f1690007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:09.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.505+0000 7f16a67fc700 1 --2- 172.21.15.63:0/2009527994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16a8146b80 0x7f16a813ccf0 secure :-1 s=THROTTLE_DONE pgs=1902 cs=0 l=1 rx=0x7f1690007ae0 tx=0x7f16a0010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.505+0000 7f169ffff700 1 -- 172.21.15.63:0/2009527994 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f16a003df00 con 0x7f16a8146b80 2020-05-18T21:37:09.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.625+0000 7f16ad4ba700 1 -- 172.21.15.63:0/2009527994 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f16a80569e0 con 0x7f16a8146b80 2020-05-18T21:37:09.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.625+0000 7f16a67fc700 1 --2- 172.21.15.63:0/2009527994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16a8146b80 0x7f16a813ccf0 secure :-1 s=THROTTLE_DONE pgs=1902 cs=0 l=1 rx=0x7f1690007ae0 tx=0x7f16a0010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.625+0000 7f169ffff700 1 -- 172.21.15.63:0/2009527994 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v135) v1 ==== 81+0+33866 (secure 0 0 0) 0x7f16a0041520 con 0x7f16a8146b80 2020-05-18T21:37:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:09.632 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:37:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 135, 2020-05-18T21:37:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:37:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2020-05-18T21:26:28.798650+0000", 2020-05-18T21:37:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2020-05-18T21:36:04.543996+0000", 2020-05-18T21:37:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:37:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:37:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-05-18T21:37:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5799936, 2020-05-18T21:37:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2020-05-18T21:37:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2020-05-18T21:37:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2020-05-18T21:37:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2020-05-18T21:37:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2020-05-18T21:37:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:37:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 4, 2020-05-18T21:37:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2020-05-18T21:37:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-05-18T21:37:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2020-05-18T21:37:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2020-05-18T21:37:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 26, 2020-05-18T21:37:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 8, 2020-05-18T21:37:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2020-05-18T21:37:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "jewel", 2020-05-18T21:37:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "pacific", 2020-05-18T21:37:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:37:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2020-05-18T21:37:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "device_health_metrics", 2020-05-18T21:37:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:33.080792+0000", 2020-05-18T21:37:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:37:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:37:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:37:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:37:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:37:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:37:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:37:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:37:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2020-05-18T21:37:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2020-05-18T21:37:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2020-05-18T21:37:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2020-05-18T21:37:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2020-05-18T21:37:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:37:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:37:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:37:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:37:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:37:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:37:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:37:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "15", 2020-05-18T21:37:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:37:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:37:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:37:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:37:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:37:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:37:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:37:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:37:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:37:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:37:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:37:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:37:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:37:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:37:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:37:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:37:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:37:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:37:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:37:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:37:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:37:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:37:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:37:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:37:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:37:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:37:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:37:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:37:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:37:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:37:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:37:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:37:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:37:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:37:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:37:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:37:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:37:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:37:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2020-05-18T21:37:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:37:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_devicehealth": {} 2020-05-18T21:37:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2020-05-18T21:37:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2020-05-18T21:37:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:40.149370+0000", 2020-05-18T21:37:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:37:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:37:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:37:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:37:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:37:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:37:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:37:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:37:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:37:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:37:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:37:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:37:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:37:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:37:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:37:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:37:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:37:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:37:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:37:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:37:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2020-05-18T21:37:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:37:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:37:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:37:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:37:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:37:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:37:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:37:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:37:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:37:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:37:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:37:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:37:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:37:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:37:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:37:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:37:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:37:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:37:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:37:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:37:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:37:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:37:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:37:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:37:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:37:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:37:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:37:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:37:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:37:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:37:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:37:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:37:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:37:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:37:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:37:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:37:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:37:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:37:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:37:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2020-05-18T21:37:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 25, 2020-05-18T21:37:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2020-05-18T21:37:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:35:48.494447+0000", 2020-05-18T21:37:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:37:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:37:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:37:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:37:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:37:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:37:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:37:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:37:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:37:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:37:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:37:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:37:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:37:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:37:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:37:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:37:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:37:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:37:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:37:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:37:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "133", 2020-05-18T21:37:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:37:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:37:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:37:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:37:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:37:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:37:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:37:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:37:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:37:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:37:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:37:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:37:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:37:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:37:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:37:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:37:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:37:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:37:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:37:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:37:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:37:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:37:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:37:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:37:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:37:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:37:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:37:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:37:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:37:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:37:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:37:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:37:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:37:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:37:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:37:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:37:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:37:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:37:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2020-05-18T21:37:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2020-05-18T21:37:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2020-05-18T21:37:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:37:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:37:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2020-05-18T21:37:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 26, 2020-05-18T21:37:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2020-05-18T21:37:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:35:49.149601+0000", 2020-05-18T21:37:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:37:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:37:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:37:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:37:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:37:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:37:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:37:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:37:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:37:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:37:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:37:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:37:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:37:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:37:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:37:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:37:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:37:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:37:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:37:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:37:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "134", 2020-05-18T21:37:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:37:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:37:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:37:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:37:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:37:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:37:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:37:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:37:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:37:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:37:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:37:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:37:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:37:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:37:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:37:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:37:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:37:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:37:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:37:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:37:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:37:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:37:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:37:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:37:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:37:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:37:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:37:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:37:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:37:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:37:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:37:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:37:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:37:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:37:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:37:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:37:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:37:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:37:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:37:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:37:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2020-05-18T21:37:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:37:09.691 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2020-05-18T21:37:09.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.691 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:37:09.691 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "c6ae0fbf-604c-4e8d-b1b8-6038821420e3", 2020-05-18T21:37:09.691 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:37:09.692 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:37:09.692 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:37:09.692 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:37:09.692 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:37:09.692 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:37:09.692 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:37:09.693 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 130, 2020-05-18T21:37:09.693 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:37:09.693 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:37:09.693 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:37:09.693 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.694 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.694 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2020-05-18T21:37:09.694 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:37:09.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2020-05-18T21:37:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:37:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.696 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:37:09.696 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.696 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.697 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6802", 2020-05-18T21:37:09.697 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:37:09.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.697 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.697 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6803", 2020-05-18T21:37:09.698 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:37:09.698 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.698 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.698 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:37:09.699 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.699 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.699 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6806", 2020-05-18T21:37:09.699 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:37:09.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.700 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.700 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6807", 2020-05-18T21:37:09.700 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:37:09.700 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.701 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.701 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:37:09.701 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.701 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.702 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6804", 2020-05-18T21:37:09.702 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:37:09.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.702 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6805", 2020-05-18T21:37:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:37:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6801/12803", 2020-05-18T21:37:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6803/12803", 2020-05-18T21:37:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6807/12803", 2020-05-18T21:37:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6805/12803", 2020-05-18T21:37:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:37:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:37:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:37:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:37:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6", 2020-05-18T21:37:09.706 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:37:09.706 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:37:09.706 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:37:09.706 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:37:09.706 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:37:09.707 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:37:09.707 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:37:09.707 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 131, 2020-05-18T21:37:09.707 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:37:09.707 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:37:09.707 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:37:09.708 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.708 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.708 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6808", 2020-05-18T21:37:09.708 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:37:09.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.709 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.709 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6809", 2020-05-18T21:37:09.709 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:37:09.709 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:37:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.711 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.711 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6810", 2020-05-18T21:37:09.711 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:37:09.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.711 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.712 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6811", 2020-05-18T21:37:09.712 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:37:09.712 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.712 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:37:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6815", 2020-05-18T21:37:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:37:09.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.714 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.714 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6817", 2020-05-18T21:37:09.714 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:37:09.715 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.715 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.715 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:37:09.715 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.716 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.716 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6812", 2020-05-18T21:37:09.716 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:37:09.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.717 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.717 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6813", 2020-05-18T21:37:09.717 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:37:09.717 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.717 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.718 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6809/12804", 2020-05-18T21:37:09.718 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6811/12804", 2020-05-18T21:37:09.718 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6817/12804", 2020-05-18T21:37:09.718 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6813/12804", 2020-05-18T21:37:09.718 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:37:09.719 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:37:09.719 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:37:09.719 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.720 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:37:09.720 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "ec8d9fa9-dae9-45f6-b286-735ab3801c27", 2020-05-18T21:37:09.720 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:37:09.720 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:37:09.720 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:37:09.720 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:37:09.721 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:37:09.721 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:37:09.721 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:37:09.721 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 131, 2020-05-18T21:37:09.721 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:37:09.722 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:37:09.722 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:37:09.722 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.722 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.722 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6822", 2020-05-18T21:37:09.723 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:37:09.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.723 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.723 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6824", 2020-05-18T21:37:09.724 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:37:09.724 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.724 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.724 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:37:09.724 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.725 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.725 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6826", 2020-05-18T21:37:09.725 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:37:09.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.726 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.726 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6827", 2020-05-18T21:37:09.726 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:37:09.727 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.727 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.727 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:37:09.727 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.728 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.728 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6830", 2020-05-18T21:37:09.728 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:37:09.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.729 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.729 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6831", 2020-05-18T21:37:09.729 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:37:09.730 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.730 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.730 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:37:09.730 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.731 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.731 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6828", 2020-05-18T21:37:09.731 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:37:09.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.732 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.732 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6829", 2020-05-18T21:37:09.732 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:37:09.732 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.732 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.733 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6824/12806", 2020-05-18T21:37:09.733 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6827/12806", 2020-05-18T21:37:09.733 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6831/12806", 2020-05-18T21:37:09.733 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6829/12806", 2020-05-18T21:37:09.734 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:37:09.734 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:37:09.734 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:37:09.734 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.735 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:37:09.735 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "1030fedf-adad-4e79-b839-59385d4d7d2a", 2020-05-18T21:37:09.735 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:37:09.735 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:37:09.735 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:37:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:37:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:37:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:37:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:37:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 130, 2020-05-18T21:37:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:37:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:37:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:37:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.738 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6814", 2020-05-18T21:37:09.738 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:37:09.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.738 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.739 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6816", 2020-05-18T21:37:09.739 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:37:09.739 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.739 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.739 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:37:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6818", 2020-05-18T21:37:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:37:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6819", 2020-05-18T21:37:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:37:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.742 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.742 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:37:09.742 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.743 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.743 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6823", 2020-05-18T21:37:09.743 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:37:09.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.743 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.744 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6825", 2020-05-18T21:37:09.744 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:37:09.744 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.744 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:37:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6820", 2020-05-18T21:37:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:37:09.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.746 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.746 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6821", 2020-05-18T21:37:09.746 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:37:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6816/12805", 2020-05-18T21:37:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6819/12805", 2020-05-18T21:37:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6825/12805", 2020-05-18T21:37:09.748 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6821/12805", 2020-05-18T21:37:09.748 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:37:09.748 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:37:09.748 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:37:09.748 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.749 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:37:09.749 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "8ad15a9b-97b4-4002-b1d4-7292e09b4ef6", 2020-05-18T21:37:09.749 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:37:09.749 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:37:09.750 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:37:09.750 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:37:09.750 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:37:09.750 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:37:09.750 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:37:09.751 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 131, 2020-05-18T21:37:09.751 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:37:09.751 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:37:09.751 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:37:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6800", 2020-05-18T21:37:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:37:09.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.753 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.753 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6801", 2020-05-18T21:37:09.753 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:37:09.753 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.754 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.754 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:37:09.754 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.755 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.755 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6802", 2020-05-18T21:37:09.755 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:37:09.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6803", 2020-05-18T21:37:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:37:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.757 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:37:09.757 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.757 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.757 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6806", 2020-05-18T21:37:09.758 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:37:09.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.758 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.758 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6807", 2020-05-18T21:37:09.758 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:37:09.759 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.759 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.759 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:37:09.759 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.760 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.760 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6804", 2020-05-18T21:37:09.760 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:37:09.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.761 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.761 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6805", 2020-05-18T21:37:09.761 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:37:09.761 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.761 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.762 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6801/13023", 2020-05-18T21:37:09.762 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6803/13023", 2020-05-18T21:37:09.762 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6807/13023", 2020-05-18T21:37:09.762 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6805/13023", 2020-05-18T21:37:09.763 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:37:09.763 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:37:09.763 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:37:09.763 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.763 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.764 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:37:09.764 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0dce88f8-b984-43e1-95e2-4132171102d2", 2020-05-18T21:37:09.764 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:37:09.764 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:37:09.765 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:37:09.765 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:37:09.765 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:37:09.765 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:37:09.765 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:37:09.766 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 120, 2020-05-18T21:37:09.766 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:37:09.766 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:37:09.766 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:37:09.766 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.767 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.767 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6808", 2020-05-18T21:37:09.767 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:37:09.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.767 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.768 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.768 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6809", 2020-05-18T21:37:09.768 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:37:09.768 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.768 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.769 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:37:09.769 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.769 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.769 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.769 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6810", 2020-05-18T21:37:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:37:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6811", 2020-05-18T21:37:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:37:09.771 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.771 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.771 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:37:09.771 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.772 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.772 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6814", 2020-05-18T21:37:09.772 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:37:09.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6816", 2020-05-18T21:37:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:37:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.774 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:37:09.774 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.774 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.774 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6812", 2020-05-18T21:37:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:37:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6813", 2020-05-18T21:37:09.776 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:37:09.776 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.776 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.776 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6809/13024", 2020-05-18T21:37:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6811/13024", 2020-05-18T21:37:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6816/13024", 2020-05-18T21:37:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6813/13024", 2020-05-18T21:37:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:37:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:37:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:37:09.778 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.778 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.778 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.778 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:37:09.778 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "e1bc92f8-3692-4483-b0fb-905c94fa1469", 2020-05-18T21:37:09.779 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:37:09.779 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:37:09.779 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:37:09.779 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:37:09.779 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:37:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:37:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:37:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 131, 2020-05-18T21:37:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:37:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:37:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:37:09.781 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.781 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.781 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.781 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6815", 2020-05-18T21:37:09.781 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:37:09.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.782 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.782 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.782 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6817", 2020-05-18T21:37:09.782 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:37:09.782 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.783 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.783 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.783 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:37:09.783 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.783 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.784 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.784 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6818", 2020-05-18T21:37:09.784 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:37:09.784 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.784 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.784 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.785 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6819", 2020-05-18T21:37:09.785 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:37:09.785 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.785 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.786 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:37:09.786 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.787 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.787 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.787 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6822", 2020-05-18T21:37:09.787 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:37:09.787 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.787 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.788 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.788 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6824", 2020-05-18T21:37:09.788 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:37:09.788 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.788 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.789 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:37:09.789 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.790 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.790 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6820", 2020-05-18T21:37:09.791 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:37:09.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.791 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.794 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6821", 2020-05-18T21:37:09.794 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:37:09.794 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.795 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.795 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6817/13025", 2020-05-18T21:37:09.795 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6819/13025", 2020-05-18T21:37:09.795 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6824/13025", 2020-05-18T21:37:09.796 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6821/13025", 2020-05-18T21:37:09.796 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:37:09.796 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:37:09.796 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:37:09.796 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.797 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:37:09.797 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "b76e000c-a078-48c4-9e1e-34d286a9992c", 2020-05-18T21:37:09.797 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:37:09.797 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:37:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:37:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:37:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:37:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:37:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:37:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 131, 2020-05-18T21:37:09.799 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:37:09.799 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:37:09.799 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:37:09.799 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6823", 2020-05-18T21:37:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:37:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.801 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6825", 2020-05-18T21:37:09.801 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:37:09.801 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.801 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.802 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:37:09.802 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.802 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.802 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6826", 2020-05-18T21:37:09.803 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:37:09.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.803 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.803 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6827", 2020-05-18T21:37:09.803 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:37:09.804 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.804 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.804 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:37:09.804 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.805 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.805 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6830", 2020-05-18T21:37:09.805 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:37:09.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.806 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.806 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6831", 2020-05-18T21:37:09.806 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:37:09.806 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.806 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:37:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6828", 2020-05-18T21:37:09.808 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:37:09.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.808 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.808 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:09.808 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6829", 2020-05-18T21:37:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:37:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6825/13026", 2020-05-18T21:37:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6827/13026", 2020-05-18T21:37:09.810 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6831/13026", 2020-05-18T21:37:09.810 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6829/13026", 2020-05-18T21:37:09.810 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:37:09.810 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:37:09.810 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:37:09.811 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:09.811 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.811 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:37:09.811 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2020-05-18T21:37:09.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.811 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:37:09.812 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:37:09.812 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:37:09.812 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:37:09.812 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:37:09.812 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:37:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.281434+0000", 2020-05-18T21:37:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:37:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:37:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:37:09.814 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:37:09.814 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:37:09.814 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:37:09.814 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:37:09.814 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.608518+0000", 2020-05-18T21:37:09.815 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:37:09.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.815 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:37:09.815 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:37:09.816 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:37:09.816 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:37:09.816 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:37:09.816 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:37:09.816 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.582386+0000", 2020-05-18T21:37:09.816 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:37:09.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.817 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:37:09.817 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:37:09.817 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:37:09.818 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:37:09.818 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:37:09.818 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:37:09.818 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.573488+0000", 2020-05-18T21:37:09.818 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:37:09.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.819 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:37:09.819 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:37:09.819 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:37:09.819 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:37:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:37:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:37:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.604174+0000", 2020-05-18T21:37:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:37:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.821 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:37:09.821 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:37:09.821 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:37:09.821 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:37:09.821 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:37:09.822 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:37:09.822 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.371004+0000", 2020-05-18T21:37:09.822 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:37:09.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.822 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:37:09.823 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:37:09.823 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:37:09.823 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:37:09.823 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:37:09.823 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:37:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.593070+0000", 2020-05-18T21:37:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:37:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:37:09.825 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:37:09.825 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:37:09.825 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:37:09.825 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:37:09.825 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:37:09.825 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.667677+0000", 2020-05-18T21:37:09.826 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:37:09.826 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.826 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:37:09.826 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2020-05-18T21:37:09.826 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2020-05-18T21:37:09.827 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2020-05-18T21:37:09.827 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2020-05-18T21:37:09.827 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklist": { 2020-05-18T21:37:09.827 INFO:teuthology.orchestra.run.smithi063.stdout: "172.21.15.155:6835/2822608544": "2020-05-19T21:36:04.543902+0000", 2020-05-18T21:37:09.828 INFO:teuthology.orchestra.run.smithi063.stdout: "172.21.15.155:6834/2822608544": "2020-05-19T21:36:04.543902+0000" 2020-05-18T21:37:09.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.828 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2020-05-18T21:37:09.828 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2020-05-18T21:37:09.828 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2020-05-18T21:37:09.829 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2020-05-18T21:37:09.829 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2020-05-18T21:37:09.829 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2020-05-18T21:37:09.829 INFO:teuthology.orchestra.run.smithi063.stdout: "ruleset-failure-domain": "osd", 2020-05-18T21:37:09.829 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2020-05-18T21:37:09.830 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:09.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:09.830 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2020-05-18T21:37:09.830 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2020-05-18T21:37:09.831 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2020-05-18T21:37:09.831 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2020-05-18T21:37:09.831 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {} 2020-05-18T21:37:09.831 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:37:09.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.625+0000 7f16ad4ba700 1 -- 172.21.15.63:0/2009527994 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f168004fda0 msgr2=0x7f1680052260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:09.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.625+0000 7f16ad4ba700 1 --2- 172.21.15.63:0/2009527994 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f168004fda0 0x7f1680052260 secure :-1 s=READY pgs=738 cs=0 l=1 rx=0x7f1690007b20 tx=0x7f1690007a80).stop 2020-05-18T21:37:09.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.625+0000 7f16ad4ba700 1 -- 172.21.15.63:0/2009527994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16a8146b80 msgr2=0x7f16a813ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:09.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.625+0000 7f16ad4ba700 1 --2- 172.21.15.63:0/2009527994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16a8146b80 0x7f16a813ccf0 secure :-1 s=READY pgs=1902 cs=0 l=1 rx=0x7f1690007ae0 tx=0x7f16a0010c50).stop 2020-05-18T21:37:09.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.625+0000 7f16ad4ba700 1 -- 172.21.15.63:0/2009527994 shutdown_connections 2020-05-18T21:37:09.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.625+0000 7f16ad4ba700 1 --2- 172.21.15.63:0/2009527994 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f168004fda0 0x7f1680052260 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:09.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.625+0000 7f16ad4ba700 1 --2- 172.21.15.63:0/2009527994 >> v2:172.21.15.155:3300/0 conn(0x7f16a8147000 0x7f16a8137770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:09.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.625+0000 7f16ad4ba700 1 --2- 172.21.15.63:0/2009527994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16a8146b80 0x7f16a813ccf0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:09.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.625+0000 7f16ad4ba700 1 -- 172.21.15.63:0/2009527994 >> 172.21.15.63:0/2009527994 conn(0x7f16a80b9700 msgr2=0x7f16a813e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:09.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.629+0000 7f16ad4ba700 1 -- 172.21.15.63:0/2009527994 shutdown_connections 2020-05-18T21:37:09.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.629+0000 7f16ad4ba700 1 -- 172.21.15.63:0/2009527994 wait complete. 2020-05-18T21:37:09.836 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:09.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.945+0000 7faf76426700 1 Processor -- start 2020-05-18T21:37:09.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.945+0000 7faf76426700 1 -- start start 2020-05-18T21:37:09.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.945+0000 7faf76426700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faf701435d0 0x7faf70063ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:09.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.945+0000 7faf76426700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf70147140 0x7faf7005edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:09.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.945+0000 7faf76426700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf701480a0 con 0x7faf7005f230 2020-05-18T21:37:09.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.945+0000 7faf76426700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf701476c0 con 0x7faf701435d0 2020-05-18T21:37:09.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.945+0000 7faf76426700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf70147960 con 0x7faf70147140 2020-05-18T21:37:09.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.945+0000 7faf74c23700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf70147140 0x7faf7005edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:09.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.945+0000 7faf75424700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faf701435d0 0x7faf70063ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:09.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.945+0000 7faf75424700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faf701435d0 0x7faf70063ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:50062/0 (socket says 172.21.15.63:50062) 2020-05-18T21:37:09.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.945+0000 7faf75424700 1 -- 172.21.15.63:0/11051584 learned_addr learned my addr 172.21.15.63:0/11051584 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:09.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.945+0000 7faf75c25700 1 --1- 172.21.15.63:0/11051584 >> v1:172.21.15.155:6789/0 conn(0x7faf7005f230 0x7faf700b8200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:35720/0 (socket says 172.21.15.63:35720) 2020-05-18T21:37:09.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf74c23700 1 -- 172.21.15.63:0/11051584 >> v2:172.21.15.155:3300/0 conn(0x7faf701435d0 msgr2=0x7faf70063ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:09.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf74c23700 1 --2- 172.21.15.63:0/11051584 >> v2:172.21.15.155:3300/0 conn(0x7faf701435d0 0x7faf70063ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:09.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf74c23700 1 -- 172.21.15.63:0/11051584 >> v1:172.21.15.155:6789/0 conn(0x7faf7005f230 legacy=0x7faf700b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:09.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf74c23700 1 -- 172.21.15.63:0/11051584 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf70147c00 con 0x7faf70147140 2020-05-18T21:37:09.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf74c23700 1 --2- 172.21.15.63:0/11051584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf70147140 0x7faf7005edd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faf6c002f70 tx=0x7faf6c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf74c23700 1 --2- 172.21.15.63:0/11051584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf70147140 0x7faf7005edd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faf6c002f70 tx=0x7faf6c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf74c23700 1 --2- 172.21.15.63:0/11051584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf70147140 0x7faf7005edd0 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7faf6c002f70 tx=0x7faf6c007a80).ready entity=mon.2 client_cookie=ece813253ce53cd6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:09.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf74c23700 1 --2- 172.21.15.63:0/11051584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf70147140 0x7faf7005edd0 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7faf6c002f70 tx=0x7faf6c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf5bfff700 1 -- 172.21.15.63:0/11051584 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf6c008e80 con 0x7faf70147140 2020-05-18T21:37:09.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf74c23700 1 --2- 172.21.15.63:0/11051584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf70147140 0x7faf7005edd0 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7faf6c002f70 tx=0x7faf6c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf5bfff700 1 -- 172.21.15.63:0/11051584 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6c0115f0 con 0x7faf70147140 2020-05-18T21:37:09.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf74c23700 1 --2- 172.21.15.63:0/11051584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf70147140 0x7faf7005edd0 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7faf6c002f70 tx=0x7faf6c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf5bfff700 1 -- 172.21.15.63:0/11051584 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf6c011a10 con 0x7faf70147140 2020-05-18T21:37:09.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf76426700 1 -- 172.21.15.63:0/11051584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf70147140 msgr2=0x7faf7005edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:09.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf76426700 1 --2- 172.21.15.63:0/11051584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf70147140 0x7faf7005edd0 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7faf6c002f70 tx=0x7faf6c007a80).stop 2020-05-18T21:37:09.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf76426700 1 -- 172.21.15.63:0/11051584 shutdown_connections 2020-05-18T21:37:09.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf76426700 1 --2- 172.21.15.63:0/11051584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf70147140 0x7faf7005edd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:09.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf76426700 1 --2- 172.21.15.63:0/11051584 >> v2:172.21.15.155:3300/0 conn(0x7faf701435d0 0x7faf70063ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:09.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf76426700 1 -- 172.21.15.63:0/11051584 >> 172.21.15.63:0/11051584 conn(0x7faf70069fc0 msgr2=0x7faf7006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:09.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf76426700 1 -- 172.21.15.63:0/11051584 shutdown_connections 2020-05-18T21:37:09.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.949+0000 7faf76426700 1 -- 172.21.15.63:0/11051584 wait complete. 2020-05-18T21:37:09.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.953+0000 7faf76426700 1 Processor -- start 2020-05-18T21:37:09.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.953+0000 7faf76426700 1 -- start start 2020-05-18T21:37:09.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.953+0000 7faf76426700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faf70147140 0x7faf701439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:09.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.953+0000 7faf76426700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf701441d0 con 0x7faf701435d0 2020-05-18T21:37:09.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.953+0000 7faf76426700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf70144470 con 0x7faf7005f230 2020-05-18T21:37:09.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.953+0000 7faf76426700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf70143fc0 con 0x7faf70147140 2020-05-18T21:37:09.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.953+0000 7faf74c23700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7faf701435d0 0x7faf700af030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37408/0 (socket says 172.21.15.63:37408) 2020-05-18T21:37:09.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.953+0000 7faf74c23700 1 -- 172.21.15.63:0/237535236 learned_addr learned my addr 172.21.15.63:0/237535236 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:09.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.953+0000 7faf75c25700 1 --2- 172.21.15.63:0/237535236 >> v2:172.21.15.155:3300/0 conn(0x7faf70147140 0x7faf701439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:09.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.953+0000 7faf62ffd700 1 -- 172.21.15.63:0/237535236 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020283649 0 0) 0x7faf701441d0 con 0x7faf701435d0 2020-05-18T21:37:09.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.953+0000 7faf62ffd700 1 -- 172.21.15.63:0/237535236 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf4c002fe0 con 0x7faf701435d0 2020-05-18T21:37:09.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.953+0000 7faf62ffd700 1 -- 172.21.15.63:0/237535236 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519521801 0 0) 0x7faf70144470 con 0x7faf7005f230 2020-05-18T21:37:09.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.953+0000 7faf62ffd700 1 -- 172.21.15.63:0/237535236 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf701441d0 con 0x7faf7005f230 2020-05-18T21:37:09.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.953+0000 7faf75c25700 1 -- 172.21.15.63:0/237535236 >> v1:172.21.15.155:6789/0 conn(0x7faf7005f230 legacy=0x7faf700b7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:09.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.953+0000 7faf75c25700 1 -- 172.21.15.63:0/237535236 >> v1:172.21.15.63:6789/0 conn(0x7faf701435d0 legacy=0x7faf700af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:09.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.953+0000 7faf75c25700 1 -- 172.21.15.63:0/237535236 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf700ad7f0 con 0x7faf70147140 2020-05-18T21:37:09.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.953+0000 7faf75c25700 1 --2- 172.21.15.63:0/237535236 >> v2:172.21.15.155:3300/0 conn(0x7faf70147140 0x7faf701439b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf70147f80 tx=0x7faf68010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf75c25700 1 --2- 172.21.15.63:0/237535236 >> v2:172.21.15.155:3300/0 conn(0x7faf70147140 0x7faf701439b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf70147f80 tx=0x7faf68010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf75c25700 1 --2- 172.21.15.63:0/237535236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf70147140 0x7faf701439b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rx=0x7faf70147f80 tx=0x7faf68010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:09.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf75c25700 1 --2- 172.21.15.63:0/237535236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf70147140 0x7faf701439b0 secure :-1 s=THROTTLE_DONE pgs=1261 cs=0 l=1 rx=0x7faf70147f80 tx=0x7faf68010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf62ffd700 1 -- 172.21.15.63:0/237535236 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf68004aa0 con 0x7faf70147140 2020-05-18T21:37:09.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf75c25700 1 --2- 172.21.15.63:0/237535236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf70147140 0x7faf701439b0 secure :-1 s=THROTTLE_DONE pgs=1261 cs=0 l=1 rx=0x7faf70147f80 tx=0x7faf68010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf75c25700 1 --2- 172.21.15.63:0/237535236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf70147140 0x7faf701439b0 secure :-1 s=THROTTLE_DONE pgs=1261 cs=0 l=1 rx=0x7faf70147f80 tx=0x7faf68010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf62ffd700 1 -- 172.21.15.63:0/237535236 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf68004c00 con 0x7faf70147140 2020-05-18T21:37:09.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf76426700 1 -- 172.21.15.63:0/237535236 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf700b7810 con 0x7faf70147140 2020-05-18T21:37:09.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf62ffd700 1 -- 172.21.15.63:0/237535236 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf680124c0 con 0x7faf70147140 2020-05-18T21:37:09.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf76426700 1 -- 172.21.15.63:0/237535236 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf70150e50 con 0x7faf70147140 2020-05-18T21:37:09.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf75c25700 1 --2- 172.21.15.63:0/237535236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf70147140 0x7faf701439b0 secure :-1 s=THROTTLE_DONE pgs=1261 cs=0 l=1 rx=0x7faf70147f80 tx=0x7faf68010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf76426700 1 -- 172.21.15.63:0/237535236 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf70144600 con 0x7faf70147140 2020-05-18T21:37:09.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf62ffd700 1 -- 172.21.15.63:0/237535236 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7faf68012740 con 0x7faf70147140 2020-05-18T21:37:09.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf75c25700 1 --2- 172.21.15.63:0/237535236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf70147140 0x7faf701439b0 secure :-1 s=THROTTLE_DONE pgs=1261 cs=0 l=1 rx=0x7faf70147f80 tx=0x7faf68010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf62ffd700 1 --2- 172.21.15.63:0/237535236 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf4c04fe80 0x7faf4c052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:09.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf62ffd700 1 -- 172.21.15.63:0/237535236 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7faf68063ba0 con 0x7faf70147140 2020-05-18T21:37:09.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf75424700 1 --2- 172.21.15.63:0/237535236 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf4c04fe80 0x7faf4c052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:09.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf75424700 1 --2- 172.21.15.63:0/237535236 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf4c04fe80 0x7faf4c052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf64002f30 tx=0x7faf64008880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf75424700 1 --2- 172.21.15.63:0/237535236 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf4c04fe80 0x7faf4c052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf64002f30 tx=0x7faf64008880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.957+0000 7faf75424700 1 --2- 172.21.15.63:0/237535236 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf4c04fe80 0x7faf4c052340 secure :-1 s=READY pgs=739 cs=0 l=1 rx=0x7faf64002f30 tx=0x7faf64008880).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:09.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.969+0000 7faf75c25700 1 --2- 172.21.15.63:0/237535236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf70147140 0x7faf701439b0 secure :-1 s=THROTTLE_DONE pgs=1261 cs=0 l=1 rx=0x7faf70147f80 tx=0x7faf68010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:09.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:09.969+0000 7faf62ffd700 1 -- 172.21.15.63:0/237535236 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7faf6803df90 con 0x7faf70147140 2020-05-18T21:37:10.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.125+0000 7faf76426700 1 -- 172.21.15.63:0/237535236 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf700569e0 con 0x7faf70147140 2020-05-18T21:37:10.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.125+0000 7faf75c25700 1 --2- 172.21.15.63:0/237535236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf70147140 0x7faf701439b0 secure :-1 s=THROTTLE_DONE pgs=1261 cs=0 l=1 rx=0x7faf70147f80 tx=0x7faf68010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:10.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.125+0000 7faf62ffd700 1 -- 172.21.15.63:0/237535236 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+1794 (secure 0 0 0) 0x7faf680415b0 con 0x7faf70147140 2020-05-18T21:37:10.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.125+0000 7faf76426700 1 -- 172.21.15.63:0/237535236 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf4c04fe80 msgr2=0x7faf4c052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:10.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.125+0000 7faf76426700 1 --2- 172.21.15.63:0/237535236 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf4c04fe80 0x7faf4c052340 secure :-1 s=READY pgs=739 cs=0 l=1 rx=0x7faf64002f30 tx=0x7faf64008880).stop 2020-05-18T21:37:10.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.125+0000 7faf76426700 1 -- 172.21.15.63:0/237535236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf70147140 msgr2=0x7faf701439b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:10.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.125+0000 7faf76426700 1 --2- 172.21.15.63:0/237535236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf70147140 0x7faf701439b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rx=0x7faf70147f80 tx=0x7faf68010bd0).stop 2020-05-18T21:37:10.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.125+0000 7faf76426700 1 -- 172.21.15.63:0/237535236 shutdown_connections 2020-05-18T21:37:10.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.125+0000 7faf76426700 1 --2- 172.21.15.63:0/237535236 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7faf4c04fe80 0x7faf4c052340 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:10.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.125+0000 7faf76426700 1 --2- 172.21.15.63:0/237535236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf70147140 0x7faf701439b0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:10.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.125+0000 7faf76426700 1 -- 172.21.15.63:0/237535236 >> 172.21.15.63:0/237535236 conn(0x7faf70069fc0 msgr2=0x7faf7013f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:10.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.125+0000 7faf76426700 1 -- 172.21.15.63:0/237535236 shutdown_connections 2020-05-18T21:37:10.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.125+0000 7faf76426700 1 -- 172.21.15.63:0/237535236 wait complete. 2020-05-18T21:37:10.144 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 117 2020-05-18T21:37:10.145 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:10.145 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":117,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:37:06.268769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9501},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_9501":{"gid":9501,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/169345666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":169345666},{"type":"v1","addr":"172.21.15.63:6833","nonce":169345666}]},"join_fscid":-1,"export_targets":[1],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:37:10.146 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-05-18T21:37:10.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.245+0000 7fcb6759e700 1 Processor -- start 2020-05-18T21:37:10.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.245+0000 7fcb6759e700 1 -- start start 2020-05-18T21:37:10.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb6759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb6805ef00 0x7fcb68065ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:10.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb6759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcb680afee0 0x7fcb680b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:10.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb6759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb680b0650 con 0x7fcb68143250 2020-05-18T21:37:10.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb6759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb680b0470 con 0x7fcb680afee0 2020-05-18T21:37:10.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb6759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb680b08f0 con 0x7fcb6805ef00 2020-05-18T21:37:10.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb66d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcb68143250 0x7fcb6809dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37418/0 (socket says 172.21.15.63:37418) 2020-05-18T21:37:10.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb66d9d700 1 -- 172.21.15.63:0/2068936934 learned_addr learned my addr 172.21.15.63:0/2068936934 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:10.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2068936934 >> v2:172.21.15.155:3300/0 conn(0x7fcb680afee0 0x7fcb680b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:10.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb6659c700 1 --2- 172.21.15.63:0/2068936934 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb6805ef00 0x7fcb68065ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:10.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb65d9b700 1 -- 172.21.15.63:0/2068936934 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808377038 0 0) 0x7fcb680b0650 con 0x7fcb68143250 2020-05-18T21:37:10.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb65d9b700 1 -- 172.21.15.63:0/2068936934 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb48003270 con 0x7fcb68143250 2020-05-18T21:37:10.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb5dd9b700 1 -- 172.21.15.63:0/2068936934 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb6805ef00 msgr2=0x7fcb68065ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:10.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb65d9b700 1 -- 172.21.15.63:0/2068936934 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1694710809 0 0) 0x7fcb48003270 con 0x7fcb68143250 2020-05-18T21:37:10.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2068936934 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb6805ef00 0x7fcb68065ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:10.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb5dd9b700 1 -- 172.21.15.63:0/2068936934 >> v1:172.21.15.63:6789/0 conn(0x7fcb68143250 legacy=0x7fcb6809dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:10.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb5dd9b700 1 -- 172.21.15.63:0/2068936934 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6805f2e0 con 0x7fcb680afee0 2020-05-18T21:37:10.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb6659c700 1 --2- 172.21.15.63:0/2068936934 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb6805ef00 0x7fcb68065ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:10.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2068936934 >> v2:172.21.15.155:3300/0 conn(0x7fcb680afee0 0x7fcb680b0d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcb60001c30 tx=0x7fcb50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:10.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2068936934 >> v2:172.21.15.155:3300/0 conn(0x7fcb680afee0 0x7fcb680b0d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcb60001c30 tx=0x7fcb50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:10.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2068936934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb680afee0 0x7fcb680b0d90 secure :-1 s=READY pgs=1262 cs=0 l=1 rx=0x7fcb60001c30 tx=0x7fcb50007a80).ready entity=mon.1 client_cookie=3cf3d490e44266bc server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:10.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2068936934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb680afee0 0x7fcb680b0d90 secure :-1 s=THROTTLE_DONE pgs=1262 cs=0 l=1 rx=0x7fcb60001c30 tx=0x7fcb50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:10.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb65d9b700 1 -- 172.21.15.63:0/2068936934 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb60001a90 con 0x7fcb680afee0 2020-05-18T21:37:10.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2068936934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb680afee0 0x7fcb680b0d90 secure :-1 s=THROTTLE_DONE pgs=1262 cs=0 l=1 rx=0x7fcb60001c30 tx=0x7fcb50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:10.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb65d9b700 1 -- 172.21.15.63:0/2068936934 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb50008e40 con 0x7fcb680afee0 2020-05-18T21:37:10.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2068936934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb680afee0 0x7fcb680b0d90 secure :-1 s=THROTTLE_DONE pgs=1262 cs=0 l=1 rx=0x7fcb60001c30 tx=0x7fcb50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:10.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb65d9b700 1 -- 172.21.15.63:0/2068936934 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb50011440 con 0x7fcb680afee0 2020-05-18T21:37:10.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb6759e700 1 -- 172.21.15.63:0/2068936934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb680afee0 msgr2=0x7fcb680b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:10.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb6759e700 1 --2- 172.21.15.63:0/2068936934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb680afee0 0x7fcb680b0d90 secure :-1 s=READY pgs=1262 cs=0 l=1 rx=0x7fcb60001c30 tx=0x7fcb50007a80).stop 2020-05-18T21:37:10.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb6759e700 1 -- 172.21.15.63:0/2068936934 shutdown_connections 2020-05-18T21:37:10.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb6759e700 1 --2- 172.21.15.63:0/2068936934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb680afee0 0x7fcb680b0d90 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:10.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb6759e700 1 --2- 172.21.15.63:0/2068936934 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb6805ef00 0x7fcb68065ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:10.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb6759e700 1 -- 172.21.15.63:0/2068936934 >> 172.21.15.63:0/2068936934 conn(0x7fcb680b6f40 msgr2=0x7fcb680b7320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:10.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb6759e700 1 -- 172.21.15.63:0/2068936934 shutdown_connections 2020-05-18T21:37:10.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.249+0000 7fcb6759e700 1 -- 172.21.15.63:0/2068936934 wait complete. 2020-05-18T21:37:10.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.253+0000 7fcb6759e700 1 Processor -- start 2020-05-18T21:37:10.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.253+0000 7fcb6759e700 1 -- start start 2020-05-18T21:37:10.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.253+0000 7fcb6759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb680afee0 0x7fcb68154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:10.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb6759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb681516f0 con 0x7fcb6805ef00 2020-05-18T21:37:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb6759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb68151990 con 0x7fcb68143250 2020-05-18T21:37:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb6759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb681408f0 con 0x7fcb680afee0 2020-05-18T21:37:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb6659c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcb6805ef00 0x7fcb680b9530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37420/0 (socket says 172.21.15.63:37420) 2020-05-18T21:37:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb6659c700 1 -- 172.21.15.63:0/2849790142 learned_addr learned my addr 172.21.15.63:0/2849790142 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb680afee0 0x7fcb68154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5ffff700 1 -- 172.21.15.63:0/2849790142 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606809114 0 0) 0x7fcb681516f0 con 0x7fcb6805ef00 2020-05-18T21:37:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5ffff700 1 -- 172.21.15.63:0/2849790142 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb4c002fe0 con 0x7fcb6805ef00 2020-05-18T21:37:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5ffff700 1 -- 172.21.15.63:0/2849790142 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 320976477 0 0) 0x7fcb68151990 con 0x7fcb68143250 2020-05-18T21:37:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5ffff700 1 -- 172.21.15.63:0/2849790142 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb681516f0 con 0x7fcb68143250 2020-05-18T21:37:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5ffff700 1 -- 172.21.15.63:0/2849790142 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2205069920 0 0) 0x7fcb4c002fe0 con 0x7fcb6805ef00 2020-05-18T21:37:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5ffff700 1 -- 172.21.15.63:0/2849790142 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcb68151990 con 0x7fcb6805ef00 2020-05-18T21:37:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5ffff700 1 -- 172.21.15.63:0/2849790142 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fcb58002500 con 0x7fcb6805ef00 2020-05-18T21:37:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5dd9b700 1 -- 172.21.15.63:0/2849790142 >> v1:172.21.15.155:6789/0 conn(0x7fcb68143250 legacy=0x7fcb68063fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5dd9b700 1 -- 172.21.15.63:0/2849790142 >> v1:172.21.15.63:6789/0 conn(0x7fcb6805ef00 legacy=0x7fcb680b9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5dd9b700 1 -- 172.21.15.63:0/2849790142 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb68151c30 con 0x7fcb680afee0 2020-05-18T21:37:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb680afee0 0x7fcb68154620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcb60001c30 tx=0x7fcb50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb680afee0 0x7fcb68154620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcb60001c30 tx=0x7fcb50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb680afee0 0x7fcb68154620 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7fcb60001c30 tx=0x7fcb50007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb680afee0 0x7fcb68154620 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fcb60001c30 tx=0x7fcb50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5ffff700 1 -- 172.21.15.63:0/2849790142 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb50007360 con 0x7fcb680afee0 2020-05-18T21:37:10.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb680afee0 0x7fcb68154620 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fcb60001c30 tx=0x7fcb50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:10.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5ffff700 1 -- 172.21.15.63:0/2849790142 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb500074c0 con 0x7fcb680afee0 2020-05-18T21:37:10.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb680afee0 0x7fcb68154620 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fcb60001c30 tx=0x7fcb50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:10.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5ffff700 1 -- 172.21.15.63:0/2849790142 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb500058f0 con 0x7fcb680afee0 2020-05-18T21:37:10.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb6759e700 1 -- 172.21.15.63:0/2849790142 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb680b9c40 con 0x7fcb680afee0 2020-05-18T21:37:10.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb6759e700 1 -- 172.21.15.63:0/2849790142 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb68155280 con 0x7fcb680afee0 2020-05-18T21:37:10.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb680afee0 0x7fcb68154620 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fcb60001c30 tx=0x7fcb50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:10.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.257+0000 7fcb6759e700 1 -- 172.21.15.63:0/2849790142 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb68151dc0 con 0x7fcb680afee0 2020-05-18T21:37:10.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.261+0000 7fcb5ffff700 1 -- 172.21.15.63:0/2849790142 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fcb50005af0 con 0x7fcb680afee0 2020-05-18T21:37:10.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.261+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb680afee0 0x7fcb68154620 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fcb60001c30 tx=0x7fcb50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:10.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.261+0000 7fcb5ffff700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcb4c0500d0 0x7fcb4c052590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:10.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.261+0000 7fcb5ffff700 1 -- 172.21.15.63:0/2849790142 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fcb50063d40 con 0x7fcb680afee0 2020-05-18T21:37:10.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.261+0000 7fcb6659c700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcb4c0500d0 0x7fcb4c052590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:10.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.261+0000 7fcb6659c700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcb4c0500d0 0x7fcb4c052590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcb58007b00 tx=0x7fcb58007c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:10.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.261+0000 7fcb6659c700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcb4c0500d0 0x7fcb4c052590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcb58007b00 tx=0x7fcb58007c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:10.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.261+0000 7fcb6659c700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcb4c0500d0 0x7fcb4c052590 secure :-1 s=READY pgs=740 cs=0 l=1 rx=0x7fcb58007b00 tx=0x7fcb58007c30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:10.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.269+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb680afee0 0x7fcb68154620 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fcb60001c30 tx=0x7fcb50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:10.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.269+0000 7fcb5ffff700 1 -- 172.21.15.63:0/2849790142 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fcb5003e1f0 con 0x7fcb680afee0 2020-05-18T21:37:10.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:10.421+0000 7fcb6759e700 1 -- 172.21.15.63:0/2849790142 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcb680569e0 con 0x7fcb680afee0 2020-05-18T21:37:11.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.257+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb680afee0 0x7fcb68154620 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7fcb60001c30 tx=0x7fcb50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.300 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:37:11.297+0000 7fdb4592c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:37:11.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.305+0000 7fcb5dd9b700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb680afee0 0x7fcb68154620 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fcb60001c30 tx=0x7fcb50007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.305+0000 7fcb5ffff700 1 -- 172.21.15.63:0/2849790142 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v118) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcb50041810 con 0x7fcb680afee0 2020-05-18T21:37:11.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.309+0000 7fcb6759e700 1 -- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcb4c0500d0 msgr2=0x7fcb4c052590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.309+0000 7fcb6759e700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcb4c0500d0 0x7fcb4c052590 secure :-1 s=READY pgs=740 cs=0 l=1 rx=0x7fcb58007b00 tx=0x7fcb58007c30).stop 2020-05-18T21:37:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.309+0000 7fcb6759e700 1 -- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb680afee0 msgr2=0x7fcb68154620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.309+0000 7fcb6759e700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb680afee0 0x7fcb68154620 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7fcb60001c30 tx=0x7fcb50007a80).stop 2020-05-18T21:37:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.309+0000 7fcb6759e700 1 -- 172.21.15.63:0/2849790142 shutdown_connections 2020-05-18T21:37:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.309+0000 7fcb6759e700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcb4c0500d0 0x7fcb4c052590 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:11.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.309+0000 7fcb6759e700 1 --2- 172.21.15.63:0/2849790142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb680afee0 0x7fcb68154620 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:11.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.309+0000 7fcb6759e700 1 -- 172.21.15.63:0/2849790142 >> 172.21.15.63:0/2849790142 conn(0x7fcb680b6f40 msgr2=0x7fcb6805c160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:11.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.309+0000 7fcb6759e700 1 -- 172.21.15.63:0/2849790142 shutdown_connections 2020-05-18T21:37:11.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.309+0000 7fcb6759e700 1 -- 172.21.15.63:0/2849790142 wait complete. 2020-05-18T21:37:11.318 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-05-18T21:37:11.332 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:11.343 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:37:11.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.425+0000 7f7e0a7b1700 1 Processor -- start 2020-05-18T21:37:11.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.425+0000 7f7e0a7b1700 1 -- start start 2020-05-18T21:37:11.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.425+0000 7f7e0a7b1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7e040b5c00 0x7f7e04149f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:11.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.425+0000 7f7e0a7b1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7e040b4f60 0x7f7e040b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:11.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.425+0000 7f7e0a7b1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e040637b0 con 0x7f7e040b0d40 2020-05-18T21:37:11.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.425+0000 7f7e0a7b1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e040635a0 con 0x7f7e040b4f60 2020-05-18T21:37:11.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.425+0000 7f7e0a7b1700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e04063a50 con 0x7f7e040b5c00 2020-05-18T21:37:11.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.425+0000 7f7e037fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7e040b4f60 0x7f7e040b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:11.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.425+0000 7f7e037fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7e040b4f60 0x7f7e040b08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35254/0 (socket says 172.21.15.63:35254) 2020-05-18T21:37:11.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.425+0000 7f7e037fe700 1 -- 172.21.15.63:0/1925523992 learned_addr learned my addr 172.21.15.63:0/1925523992 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:11.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.425+0000 7f7e03fff700 1 --2- 172.21.15.63:0/1925523992 >> v2:172.21.15.155:3300/0 conn(0x7f7e040b5c00 0x7f7e04149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:11.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.429+0000 7f7e037fe700 1 -- 172.21.15.63:0/1925523992 >> v2:172.21.15.155:3300/0 conn(0x7f7e040b5c00 msgr2=0x7f7e04149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:11.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.429+0000 7f7e037fe700 1 --2- 172.21.15.63:0/1925523992 >> v2:172.21.15.155:3300/0 conn(0x7f7e040b5c00 0x7f7e04149f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:11.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.429+0000 7f7e037fe700 1 -- 172.21.15.63:0/1925523992 >> v1:172.21.15.155:6789/0 conn(0x7f7e040b0d40 legacy=0x7f7e04069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:11.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.429+0000 7f7e037fe700 1 -- 172.21.15.63:0/1925523992 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e040bb4a0 con 0x7f7e040b4f60 2020-05-18T21:37:11.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.429+0000 7f7e037fe700 1 --2- 172.21.15.63:0/1925523992 >> v2:172.21.15.63:3300/0 conn(0x7f7e040b4f60 0x7f7e040b08e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7df8002f70 tx=0x7f7df8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.429+0000 7f7e037fe700 1 --2- 172.21.15.63:0/1925523992 >> v2:172.21.15.63:3300/0 conn(0x7f7e040b4f60 0x7f7e040b08e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7df8002f70 tx=0x7f7df8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.429+0000 7f7e037fe700 1 --2- 172.21.15.63:0/1925523992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e040b4f60 0x7f7e040b08e0 secure :-1 s=READY pgs=1909 cs=0 l=1 rx=0x7f7df8002f70 tx=0x7f7df8007a80).ready entity=mon.0 client_cookie=8d65fc3f8f91c570 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:11.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.437+0000 7f7e037fe700 1 --2- 172.21.15.63:0/1925523992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e040b4f60 0x7f7e040b08e0 secure :-1 s=THROTTLE_DONE pgs=1909 cs=0 l=1 rx=0x7f7df8002f70 tx=0x7f7df8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.437+0000 7f7e02ffd700 1 -- 172.21.15.63:0/1925523992 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7df80116b0 con 0x7f7e040b4f60 2020-05-18T21:37:11.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.441+0000 7f7e037fe700 1 --2- 172.21.15.63:0/1925523992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e040b4f60 0x7f7e040b08e0 secure :-1 s=THROTTLE_DONE pgs=1909 cs=0 l=1 rx=0x7f7df8002f70 tx=0x7f7df8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.441+0000 7f7e037fe700 1 --2- 172.21.15.63:0/1925523992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e040b4f60 0x7f7e040b08e0 secure :-1 s=THROTTLE_DONE pgs=1909 cs=0 l=1 rx=0x7f7df8002f70 tx=0x7f7df8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.441+0000 7f7e02ffd700 1 -- 172.21.15.63:0/1925523992 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df8011810 con 0x7f7e040b4f60 2020-05-18T21:37:11.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.441+0000 7f7e02ffd700 1 -- 172.21.15.63:0/1925523992 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7df8011c30 con 0x7f7e040b4f60 2020-05-18T21:37:11.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.441+0000 7f7e0a7b1700 1 -- 172.21.15.63:0/1925523992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e040b4f60 msgr2=0x7f7e040b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:11.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.441+0000 7f7e0a7b1700 1 --2- 172.21.15.63:0/1925523992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e040b4f60 0x7f7e040b08e0 secure :-1 s=READY pgs=1909 cs=0 l=1 rx=0x7f7df8002f70 tx=0x7f7df8007a80).stop 2020-05-18T21:37:11.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.441+0000 7f7e0a7b1700 1 -- 172.21.15.63:0/1925523992 shutdown_connections 2020-05-18T21:37:11.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.441+0000 7f7e0a7b1700 1 --2- 172.21.15.63:0/1925523992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e040b4f60 0x7f7e040b08e0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:11.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.441+0000 7f7e0a7b1700 1 --2- 172.21.15.63:0/1925523992 >> v2:172.21.15.155:3300/0 conn(0x7f7e040b5c00 0x7f7e04149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:11.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.441+0000 7f7e0a7b1700 1 -- 172.21.15.63:0/1925523992 >> 172.21.15.63:0/1925523992 conn(0x7f7e040ba5c0 msgr2=0x7f7e040ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:11.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.441+0000 7f7e0a7b1700 1 -- 172.21.15.63:0/1925523992 shutdown_connections 2020-05-18T21:37:11.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.441+0000 7f7e0a7b1700 1 -- 172.21.15.63:0/1925523992 wait complete. 2020-05-18T21:37:11.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.441+0000 7f7e0a7b1700 1 Processor -- start 2020-05-18T21:37:11.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.441+0000 7f7e0a7b1700 1 -- start start 2020-05-18T21:37:11.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.441+0000 7f7e0a7b1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e040b4f60 0x7f7e04063e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:11.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.441+0000 7f7e0a7b1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7e040b5c00 0x7f7e040b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:11.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.441+0000 7f7e0a7b1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e04064e10 con 0x7f7e040b0d40 2020-05-18T21:37:11.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.441+0000 7f7e0a7b1700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e040b2530 con 0x7f7e040b5c00 2020-05-18T21:37:11.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.441+0000 7f7e0a7b1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e04156b00 con 0x7f7e040b4f60 2020-05-18T21:37:11.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.445+0000 7f7e037fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e040b4f60 0x7f7e04063e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:11.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.445+0000 7f7e08d4e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7e040b5c00 0x7f7e040b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:11.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.445+0000 7f7e03fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f7e040b0d40 0x7f7e040b9030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:35762/0 (socket says 172.21.15.63:35762) 2020-05-18T21:37:11.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.445+0000 7f7e03fff700 1 -- 172.21.15.63:0/75906576 learned_addr learned my addr 172.21.15.63:0/75906576 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:11.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.445+0000 7f7e037fe700 1 -- 172.21.15.63:0/75906576 >> v2:172.21.15.155:3300/0 conn(0x7f7e040b5c00 msgr2=0x7f7e040b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:11.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.445+0000 7f7e037fe700 1 --2- 172.21.15.63:0/75906576 >> v2:172.21.15.155:3300/0 conn(0x7f7e040b5c00 0x7f7e040b20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:11.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.445+0000 7f7e037fe700 1 -- 172.21.15.63:0/75906576 >> v1:172.21.15.155:6789/0 conn(0x7f7e040b0d40 legacy=0x7f7e040b9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:11.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.445+0000 7f7e037fe700 1 -- 172.21.15.63:0/75906576 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e04156da0 con 0x7f7e040b4f60 2020-05-18T21:37:11.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.445+0000 7f7e037fe700 1 --2- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e040b4f60 0x7f7e04063e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7df8002f70 tx=0x7f7df8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.445+0000 7f7e037fe700 1 --2- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e040b4f60 0x7f7e04063e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7df8002f70 tx=0x7f7df8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.445+0000 7f7e037fe700 1 --2- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e040b4f60 0x7f7e04063e40 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7f7df8002f70 tx=0x7f7df8007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:11.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.469+0000 7f7e037fe700 1 --2- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e040b4f60 0x7f7e04063e40 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f7df8002f70 tx=0x7f7df8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.469+0000 7f7e037fe700 1 --2- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e040b4f60 0x7f7e04063e40 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f7df8002f70 tx=0x7f7df8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.469+0000 7f7e037fe700 1 --2- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e040b4f60 0x7f7e04063e40 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f7df8002f70 tx=0x7f7df8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.469+0000 7f7e017fa700 1 -- 172.21.15.63:0/75906576 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7df8011cf0 con 0x7f7e040b4f60 2020-05-18T21:37:11.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.469+0000 7f7e017fa700 1 -- 172.21.15.63:0/75906576 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df8007360 con 0x7f7e040b4f60 2020-05-18T21:37:11.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.469+0000 7f7e0a7b1700 1 -- 172.21.15.63:0/75906576 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e04157040 con 0x7f7e040b4f60 2020-05-18T21:37:11.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.469+0000 7f7e017fa700 1 -- 172.21.15.63:0/75906576 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7df8005700 con 0x7f7e040b4f60 2020-05-18T21:37:11.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.469+0000 7f7e0a7b1700 1 -- 172.21.15.63:0/75906576 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e041577f0 con 0x7f7e040b4f60 2020-05-18T21:37:11.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.473+0000 7f7e037fe700 1 --2- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e040b4f60 0x7f7e04063e40 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f7df8002f70 tx=0x7f7df8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.473+0000 7f7e0a7b1700 1 -- 172.21.15.63:0/75906576 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e04157200 con 0x7f7e040b4f60 2020-05-18T21:37:11.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.473+0000 7f7e017fa700 1 -- 172.21.15.63:0/75906576 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7df8005970 con 0x7f7e040b4f60 2020-05-18T21:37:11.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.473+0000 7f7e017fa700 1 --2- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7de404fa20 0x7f7de4051ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:11.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.477+0000 7f7e03fff700 1 --2- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7de404fa20 0x7f7de4051ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:11.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.477+0000 7f7e03fff700 1 --2- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7de404fa20 0x7f7de4051ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7e040654a0 tx=0x7f7df400c840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.477+0000 7f7e03fff700 1 --2- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7de404fa20 0x7f7de4051ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7e040654a0 tx=0x7f7df400c840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.477+0000 7f7e03fff700 1 --2- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7de404fa20 0x7f7de4051ee0 secure :-1 s=READY pgs=742 cs=0 l=1 rx=0x7f7e040654a0 tx=0x7f7df400c840).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:11.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.477+0000 7f7e037fe700 1 --2- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e040b4f60 0x7f7e04063e40 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f7df8002f70 tx=0x7f7df8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.477+0000 7f7e017fa700 1 -- 172.21.15.63:0/75906576 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f7df80405f0 con 0x7f7e040b4f60 2020-05-18T21:37:11.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.485+0000 7f7e037fe700 1 --2- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e040b4f60 0x7f7e04063e40 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f7df8002f70 tx=0x7f7df8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.485+0000 7f7e017fa700 1 -- 172.21.15.63:0/75906576 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f7df803e7f0 con 0x7f7e040b4f60 2020-05-18T21:37:11.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.633+0000 7f7e0a7b1700 1 -- 172.21.15.63:0/75906576 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e040569e0 con 0x7f7e040b4f60 2020-05-18T21:37:11.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.633+0000 7f7e037fe700 1 --2- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e040b4f60 0x7f7e04063e40 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f7df8002f70 tx=0x7f7df8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.633+0000 7f7e017fa700 1 -- 172.21.15.63:0/75906576 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+1789 (secure 0 0 0) 0x7f7df8041e10 con 0x7f7e040b4f60 2020-05-18T21:37:11.641 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:11.641 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":118,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9529,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6835/1021626998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1021626998},{"type":"v1","addr":"172.21.15.155:6835","nonce":1021626998}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":118}],"filesystems":[{"mdsmap":{"epoch":118,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:35:50.157703+0000","modified":"2020-05-18T21:37:11.298703+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":136,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-05-18T21:37:11.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.637+0000 7f7e0a7b1700 1 -- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7de404fa20 msgr2=0x7f7de4051ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:11.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.637+0000 7f7e0a7b1700 1 --2- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7de404fa20 0x7f7de4051ee0 secure :-1 s=READY pgs=742 cs=0 l=1 rx=0x7f7e040654a0 tx=0x7f7df400c840).stop 2020-05-18T21:37:11.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.637+0000 7f7e0a7b1700 1 -- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e040b4f60 msgr2=0x7f7e04063e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:11.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.637+0000 7f7e0a7b1700 1 --2- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e040b4f60 0x7f7e04063e40 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7f7df8002f70 tx=0x7f7df8007a80).stop 2020-05-18T21:37:11.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.637+0000 7f7e0a7b1700 1 -- 172.21.15.63:0/75906576 shutdown_connections 2020-05-18T21:37:11.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.637+0000 7f7e0a7b1700 1 --2- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7de404fa20 0x7f7de4051ee0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:11.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.637+0000 7f7e0a7b1700 1 --2- 172.21.15.63:0/75906576 >> v2:172.21.15.155:3300/0 conn(0x7f7e040b5c00 0x7f7e040b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:11.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.637+0000 7f7e0a7b1700 1 --2- 172.21.15.63:0/75906576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e040b4f60 0x7f7e04063e40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:11.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.637+0000 7f7e0a7b1700 1 -- 172.21.15.63:0/75906576 >> 172.21.15.63:0/75906576 conn(0x7f7e040ba5c0 msgr2=0x7f7e04060900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:11.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.637+0000 7f7e0a7b1700 1 -- 172.21.15.63:0/75906576 shutdown_connections 2020-05-18T21:37:11.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.637+0000 7f7e0a7b1700 1 -- 172.21.15.63:0/75906576 wait complete. 2020-05-18T21:37:11.645 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 118 2020-05-18T21:37:11.654 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-05-18T21:37:11.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.757+0000 7f327e6ba700 1 Processor -- start 2020-05-18T21:37:11.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.757+0000 7f327e6ba700 1 -- start start 2020-05-18T21:37:11.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.757+0000 7f327e6ba700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3278140070 0x7f3278145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:11.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.757+0000 7f327e6ba700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f32781435b0 0x7f32780638f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:11.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.757+0000 7f327e6ba700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3278140450 con 0x7f3278062360 2020-05-18T21:37:11.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.757+0000 7f327e6ba700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3278142bd0 con 0x7f32781435b0 2020-05-18T21:37:11.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.757+0000 7f327e6ba700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3278142e70 con 0x7f3278140070 2020-05-18T21:37:11.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.757+0000 7f327deb9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f32781435b0 0x7f32780638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:11.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.757+0000 7f327deb9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f32781435b0 0x7f32780638f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35268/0 (socket says 172.21.15.63:35268) 2020-05-18T21:37:11.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.757+0000 7f327deb9700 1 -- 172.21.15.63:0/3057824173 learned_addr learned my addr 172.21.15.63:0/3057824173 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:11.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.757+0000 7f327d6b8700 1 --2- 172.21.15.63:0/3057824173 >> v2:172.21.15.155:3300/0 conn(0x7f3278140070 0x7f3278145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:11.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f327deb9700 1 -- 172.21.15.63:0/3057824173 >> v2:172.21.15.155:3300/0 conn(0x7f3278140070 msgr2=0x7f3278145fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:11.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f327deb9700 1 --2- 172.21.15.63:0/3057824173 >> v2:172.21.15.155:3300/0 conn(0x7f3278140070 0x7f3278145fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:11.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f327deb9700 1 -- 172.21.15.63:0/3057824173 >> v1:172.21.15.155:6789/0 conn(0x7f3278062360 legacy=0x7f32780b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:11.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f327deb9700 1 -- 172.21.15.63:0/3057824173 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3278143110 con 0x7f32781435b0 2020-05-18T21:37:11.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f327deb9700 1 --2- 172.21.15.63:0/3057824173 >> v2:172.21.15.63:3300/0 conn(0x7f32781435b0 0x7f32780638f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f32700032f0 tx=0x7f3270007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f327deb9700 1 --2- 172.21.15.63:0/3057824173 >> v2:172.21.15.63:3300/0 conn(0x7f32781435b0 0x7f32780638f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f32700032f0 tx=0x7f3270007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f327deb9700 1 --2- 172.21.15.63:0/3057824173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32781435b0 0x7f32780638f0 secure :-1 s=READY pgs=1910 cs=0 l=1 rx=0x7f32700032f0 tx=0x7f3270007e00).ready entity=mon.0 client_cookie=5aaa3a3550ff9790 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:11.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f327deb9700 1 --2- 172.21.15.63:0/3057824173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32781435b0 0x7f32780638f0 secure :-1 s=THROTTLE_DONE pgs=1910 cs=0 l=1 rx=0x7f32700032f0 tx=0x7f3270007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f327deb9700 1 --2- 172.21.15.63:0/3057824173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32781435b0 0x7f32780638f0 secure :-1 s=THROTTLE_DONE pgs=1910 cs=0 l=1 rx=0x7f32700032f0 tx=0x7f3270007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f327deb9700 1 --2- 172.21.15.63:0/3057824173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32781435b0 0x7f32780638f0 secure :-1 s=THROTTLE_DONE pgs=1910 cs=0 l=1 rx=0x7f32700032f0 tx=0x7f3270007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f3263fff700 1 -- 172.21.15.63:0/3057824173 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3270011d10 con 0x7f32781435b0 2020-05-18T21:37:11.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f3263fff700 1 -- 172.21.15.63:0/3057824173 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3270011e70 con 0x7f32781435b0 2020-05-18T21:37:11.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f3263fff700 1 -- 172.21.15.63:0/3057824173 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f327000a370 con 0x7f32781435b0 2020-05-18T21:37:11.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f327e6ba700 1 -- 172.21.15.63:0/3057824173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32781435b0 msgr2=0x7f32780638f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:11.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f327e6ba700 1 --2- 172.21.15.63:0/3057824173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32781435b0 0x7f32780638f0 secure :-1 s=READY pgs=1910 cs=0 l=1 rx=0x7f32700032f0 tx=0x7f3270007e00).stop 2020-05-18T21:37:11.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f327e6ba700 1 -- 172.21.15.63:0/3057824173 shutdown_connections 2020-05-18T21:37:11.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f327e6ba700 1 --2- 172.21.15.63:0/3057824173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32781435b0 0x7f32780638f0 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:11.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f327e6ba700 1 --2- 172.21.15.63:0/3057824173 >> v2:172.21.15.155:3300/0 conn(0x7f3278140070 0x7f3278145fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:11.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f327e6ba700 1 -- 172.21.15.63:0/3057824173 >> 172.21.15.63:0/3057824173 conn(0x7f3278069b70 msgr2=0x7f3278069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:11.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f327e6ba700 1 -- 172.21.15.63:0/3057824173 shutdown_connections 2020-05-18T21:37:11.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.761+0000 7f327e6ba700 1 -- 172.21.15.63:0/3057824173 wait complete. 2020-05-18T21:37:11.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327e6ba700 1 Processor -- start 2020-05-18T21:37:11.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327e6ba700 1 -- start start 2020-05-18T21:37:11.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327e6ba700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3278062360 0x7f327813ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:11.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327e6ba700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3278140070 0x7f3278141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:11.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327e6ba700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3278142030 con 0x7f32781435b0 2020-05-18T21:37:11.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327e6ba700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32780adff0 con 0x7f3278140070 2020-05-18T21:37:11.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327e6ba700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32780ae290 con 0x7f3278062360 2020-05-18T21:37:11.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327deb9700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f32781435b0 0x7f327813cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37464/0 (socket says 172.21.15.63:37464) 2020-05-18T21:37:11.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327deb9700 1 -- 172.21.15.63:0/2475345682 learned_addr learned my addr 172.21.15.63:0/2475345682 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:11.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327d6b8700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3278062360 0x7f327813ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:11.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327ceb7700 1 --2- 172.21.15.63:0/2475345682 >> v2:172.21.15.155:3300/0 conn(0x7f3278140070 0x7f3278141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:11.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f326affd700 1 -- 172.21.15.63:0/2475345682 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271334069 0 0) 0x7f3278142030 con 0x7f32781435b0 2020-05-18T21:37:11.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f326affd700 1 -- 172.21.15.63:0/2475345682 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3254002fe0 con 0x7f32781435b0 2020-05-18T21:37:11.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327ceb7700 1 -- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3278062360 msgr2=0x7f327813ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:11.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327ceb7700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3278062360 0x7f327813ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:11.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327ceb7700 1 -- 172.21.15.63:0/2475345682 >> v1:172.21.15.63:6789/0 conn(0x7f32781435b0 legacy=0x7f327813cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:11.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f326affd700 1 -- 172.21.15.63:0/2475345682 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 266147081 0 0) 0x7f3254002fe0 con 0x7f32781435b0 2020-05-18T21:37:11.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327ceb7700 1 -- 172.21.15.63:0/2475345682 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3278150490 con 0x7f3278140070 2020-05-18T21:37:11.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327d6b8700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3278062360 0x7f327813ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:11.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327ceb7700 1 --2- 172.21.15.63:0/2475345682 >> v2:172.21.15.155:3300/0 conn(0x7f3278140070 0x7f3278141bd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3270008b20 tx=0x7f326c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327ceb7700 1 --2- 172.21.15.63:0/2475345682 >> v2:172.21.15.155:3300/0 conn(0x7f3278140070 0x7f3278141bd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3270008b20 tx=0x7f326c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327ceb7700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3278140070 0x7f3278141bd0 secure :-1 s=READY pgs=1269 cs=0 l=1 rx=0x7f3270008b20 tx=0x7f326c0108c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:11.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327ceb7700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3278140070 0x7f3278141bd0 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7f3270008b20 tx=0x7f326c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f326affd700 1 -- 172.21.15.63:0/2475345682 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3270008980 con 0x7f3278140070 2020-05-18T21:37:11.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327ceb7700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3278140070 0x7f3278141bd0 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7f3270008b20 tx=0x7f326c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327ceb7700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3278140070 0x7f3278141bd0 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7f3270008b20 tx=0x7f326c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f326affd700 1 -- 172.21.15.63:0/2475345682 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c006a10 con 0x7f3278140070 2020-05-18T21:37:11.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f326affd700 1 -- 172.21.15.63:0/2475345682 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f326c006e30 con 0x7f3278140070 2020-05-18T21:37:11.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327e6ba700 1 -- 172.21.15.63:0/2475345682 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3278143d90 con 0x7f3278140070 2020-05-18T21:37:11.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.765+0000 7f327e6ba700 1 -- 172.21.15.63:0/2475345682 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32780addc0 con 0x7f3278140070 2020-05-18T21:37:11.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.769+0000 7f327ceb7700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3278140070 0x7f3278141bd0 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7f3270008b20 tx=0x7f326c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.769+0000 7f327e6ba700 1 -- 172.21.15.63:0/2475345682 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32780569e0 con 0x7f3278140070 2020-05-18T21:37:11.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.769+0000 7f326affd700 1 -- 172.21.15.63:0/2475345682 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f326c011d70 con 0x7f3278140070 2020-05-18T21:37:11.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.769+0000 7f327ceb7700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3278140070 0x7f3278141bd0 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7f3270008b20 tx=0x7f326c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.769+0000 7f326affd700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f325404fd40 0x7f3254052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:11.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.769+0000 7f326affd700 1 -- 172.21.15.63:0/2475345682 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f326c063420 con 0x7f3278140070 2020-05-18T21:37:11.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.769+0000 7f327d6b8700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f325404fd40 0x7f3254052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:11.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.769+0000 7f327d6b8700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f325404fd40 0x7f3254052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3274002f70 tx=0x7f3274007c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.769+0000 7f327d6b8700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f325404fd40 0x7f3254052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3274002f70 tx=0x7f3274007c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.769+0000 7f327d6b8700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f325404fd40 0x7f3254052200 secure :-1 s=READY pgs=743 cs=0 l=1 rx=0x7f3274002f70 tx=0x7f3274007c90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:11.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.781+0000 7f327ceb7700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3278140070 0x7f3278141bd0 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7f3270008b20 tx=0x7f326c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:11.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.781+0000 7f326affd700 1 -- 172.21.15.63:0/2475345682 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f326c03d750 con 0x7f3278140070 2020-05-18T21:37:11.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:11.929+0000 7f327e6ba700 1 -- 172.21.15.63:0/2475345682 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3278065fd0 con 0x7f3278140070 2020-05-18T21:37:12.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.305+0000 7f327ceb7700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3278140070 0x7f3278141bd0 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7f3270008b20 tx=0x7f326c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:12.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.305+0000 7f326affd700 1 -- 172.21.15.63:0/2475345682 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v119) v1 ==== 104+0+0 (secure 0 0 0) 0x7f326c040d70 con 0x7f3278140070 2020-05-18T21:37:12.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.309+0000 7f327e6ba700 1 -- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f325404fd40 msgr2=0x7f3254052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:12.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.309+0000 7f327e6ba700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f325404fd40 0x7f3254052200 secure :-1 s=READY pgs=743 cs=0 l=1 rx=0x7f3274002f70 tx=0x7f3274007c90).stop 2020-05-18T21:37:12.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.309+0000 7f327e6ba700 1 -- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3278140070 msgr2=0x7f3278141bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:12.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.309+0000 7f327e6ba700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3278140070 0x7f3278141bd0 secure :-1 s=READY pgs=1269 cs=0 l=1 rx=0x7f3270008b20 tx=0x7f326c0108c0).stop 2020-05-18T21:37:12.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.309+0000 7f327e6ba700 1 -- 172.21.15.63:0/2475345682 shutdown_connections 2020-05-18T21:37:12.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.309+0000 7f327e6ba700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f325404fd40 0x7f3254052200 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:12.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.309+0000 7f327e6ba700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3278140070 0x7f3278141bd0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:12.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.309+0000 7f327e6ba700 1 --2- 172.21.15.63:0/2475345682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3278062360 0x7f327813ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:12.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.309+0000 7f327e6ba700 1 -- 172.21.15.63:0/2475345682 >> 172.21.15.63:0/2475345682 conn(0x7f3278069b70 msgr2=0x7f3278064c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:12.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.309+0000 7f327e6ba700 1 -- 172.21.15.63:0/2475345682 shutdown_connections 2020-05-18T21:37:12.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.309+0000 7f327e6ba700 1 -- 172.21.15.63:0/2475345682 wait complete. 2020-05-18T21:37:12.332 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-05-18T21:37:12.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.445+0000 7f6ad7228700 1 Processor -- start 2020-05-18T21:37:12.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.445+0000 7f6ad7228700 1 -- start start 2020-05-18T21:37:12.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ad7228700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad0143ff0 0x7f6ad0144470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:12.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ad7228700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad0062a00 con 0x7f6ad00b9e00 2020-05-18T21:37:12.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ad7228700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad0062ca0 con 0x7f6ad0069fb0 2020-05-18T21:37:12.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ad7228700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad01475f0 con 0x7f6ad0143ff0 2020-05-18T21:37:12.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ad57c5700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6ad00b9e00 0x7f6ad0147a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37474/0 (socket says 172.21.15.63:37474) 2020-05-18T21:37:12.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ad57c5700 1 -- 172.21.15.63:0/1351421531 learned_addr learned my addr 172.21.15.63:0/1351421531 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:12.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ac7fff700 1 --2- 172.21.15.63:0/1351421531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad0143ff0 0x7f6ad0144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:12.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ac77fe700 1 -- 172.21.15.63:0/1351421531 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458115240 0 0) 0x7f6ad0062a00 con 0x7f6ad00b9e00 2020-05-18T21:37:12.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ac77fe700 1 -- 172.21.15.63:0/1351421531 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6abc003270 con 0x7f6ad00b9e00 2020-05-18T21:37:12.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ac77fe700 1 -- 172.21.15.63:0/1351421531 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180148700 0 0) 0x7f6ad0062ca0 con 0x7f6ad0069fb0 2020-05-18T21:37:12.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ac77fe700 1 -- 172.21.15.63:0/1351421531 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ad0062a00 con 0x7f6ad0069fb0 2020-05-18T21:37:12.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ac7fff700 1 -- 172.21.15.63:0/1351421531 >> v1:172.21.15.155:6789/0 conn(0x7f6ad0069fb0 legacy=0x7f6ad006a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:12.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ac77fe700 1 -- 172.21.15.63:0/1351421531 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1295979670 0 0) 0x7f6abc003270 con 0x7f6ad00b9e00 2020-05-18T21:37:12.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ac7fff700 1 -- 172.21.15.63:0/1351421531 >> v1:172.21.15.63:6789/0 conn(0x7f6ad00b9e00 legacy=0x7f6ad0147a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:12.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ac7fff700 1 -- 172.21.15.63:0/1351421531 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad009cf80 con 0x7f6ad0143ff0 2020-05-18T21:37:12.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ac7fff700 1 --2- 172.21.15.63:0/1351421531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad0143ff0 0x7f6ad0144470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ac8001490 tx=0x7f6ac0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:12.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ac7fff700 1 --2- 172.21.15.63:0/1351421531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad0143ff0 0x7f6ad0144470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ac8001490 tx=0x7f6ac0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:12.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ac7fff700 1 --2- 172.21.15.63:0/1351421531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad0143ff0 0x7f6ad0144470 secure :-1 s=READY pgs=288 cs=0 l=1 rx=0x7f6ac8001490 tx=0x7f6ac0008920).ready entity=mon.2 client_cookie=bfd606d4795f88e4 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:12.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ac7fff700 1 --2- 172.21.15.63:0/1351421531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad0143ff0 0x7f6ad0144470 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7f6ac8001490 tx=0x7f6ac0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:12.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ac77fe700 1 -- 172.21.15.63:0/1351421531 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ac8001a90 con 0x7f6ad0143ff0 2020-05-18T21:37:12.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ac7fff700 1 --2- 172.21.15.63:0/1351421531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad0143ff0 0x7f6ad0144470 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7f6ac8001490 tx=0x7f6ac0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:12.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ac77fe700 1 -- 172.21.15.63:0/1351421531 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac0008e80 con 0x7f6ad0143ff0 2020-05-18T21:37:12.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ac7fff700 1 --2- 172.21.15.63:0/1351421531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad0143ff0 0x7f6ad0144470 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7f6ac8001490 tx=0x7f6ac0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:12.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ac77fe700 1 -- 172.21.15.63:0/1351421531 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ac0011440 con 0x7f6ad0143ff0 2020-05-18T21:37:12.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ad7228700 1 -- 172.21.15.63:0/1351421531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad0143ff0 msgr2=0x7f6ad0144470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:12.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ad7228700 1 --2- 172.21.15.63:0/1351421531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad0143ff0 0x7f6ad0144470 secure :-1 s=READY pgs=288 cs=0 l=1 rx=0x7f6ac8001490 tx=0x7f6ac0008920).stop 2020-05-18T21:37:12.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ad7228700 1 -- 172.21.15.63:0/1351421531 shutdown_connections 2020-05-18T21:37:12.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ad7228700 1 --2- 172.21.15.63:0/1351421531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad0143ff0 0x7f6ad0144470 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:12.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ad7228700 1 -- 172.21.15.63:0/1351421531 >> 172.21.15.63:0/1351421531 conn(0x7f6ad005b290 msgr2=0x7f6ad00b96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:12.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ad7228700 1 -- 172.21.15.63:0/1351421531 shutdown_connections 2020-05-18T21:37:12.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.449+0000 7f6ad7228700 1 -- 172.21.15.63:0/1351421531 wait complete. 2020-05-18T21:37:12.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.453+0000 7f6ad7228700 1 Processor -- start 2020-05-18T21:37:12.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.453+0000 7f6ad7228700 1 -- start start 2020-05-18T21:37:12.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.453+0000 7f6ad7228700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6ad0143ff0 0x7f6ad00b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:12.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.453+0000 7f6ad7228700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad00b8f00 con 0x7f6ad0069fb0 2020-05-18T21:37:12.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.453+0000 7f6ad7228700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad00b91a0 con 0x7f6ad00b9e00 2020-05-18T21:37:12.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.453+0000 7f6ad7228700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad00b70e0 con 0x7f6ad0143ff0 2020-05-18T21:37:12.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.453+0000 7f6ad4fc4700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6ad0069fb0 0x7f6ad0150c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37476/0 (socket says 172.21.15.63:37476) 2020-05-18T21:37:12.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.453+0000 7f6ad4fc4700 1 -- 172.21.15.63:0/39686052 learned_addr learned my addr 172.21.15.63:0/39686052 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:12.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.453+0000 7f6ad57c5700 1 --2- 172.21.15.63:0/39686052 >> v2:172.21.15.63:3300/0 conn(0x7f6ad0143ff0 0x7f6ad00b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:12.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.453+0000 7f6ac5ffb700 1 -- 172.21.15.63:0/39686052 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703070725 0 0) 0x7f6ad00b8f00 con 0x7f6ad0069fb0 2020-05-18T21:37:12.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.453+0000 7f6ac5ffb700 1 -- 172.21.15.63:0/39686052 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ab0002fe0 con 0x7f6ad0069fb0 2020-05-18T21:37:12.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.453+0000 7f6ac5ffb700 1 -- 172.21.15.63:0/39686052 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154204339 0 0) 0x7f6ad00b91a0 con 0x7f6ad00b9e00 2020-05-18T21:37:12.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.453+0000 7f6ac5ffb700 1 -- 172.21.15.63:0/39686052 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ad00b8f00 con 0x7f6ad00b9e00 2020-05-18T21:37:12.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.453+0000 7f6ad57c5700 1 -- 172.21.15.63:0/39686052 >> v1:172.21.15.155:6789/0 conn(0x7f6ad00b9e00 legacy=0x7f6ad00b74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:12.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.453+0000 7f6ad57c5700 1 -- 172.21.15.63:0/39686052 >> v1:172.21.15.63:6789/0 conn(0x7f6ad0069fb0 legacy=0x7f6ad0150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:12.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.453+0000 7f6ad57c5700 1 -- 172.21.15.63:0/39686052 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad0151380 con 0x7f6ad0143ff0 2020-05-18T21:37:12.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.457+0000 7f6ad57c5700 1 --2- 172.21.15.63:0/39686052 >> v2:172.21.15.63:3300/0 conn(0x7f6ad0143ff0 0x7f6ad00b38c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ac8001360 tx=0x7f6ac8010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:12.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.457+0000 7f6ad57c5700 1 --2- 172.21.15.63:0/39686052 >> v2:172.21.15.63:3300/0 conn(0x7f6ad0143ff0 0x7f6ad00b38c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ac8001360 tx=0x7f6ac8010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:12.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.457+0000 7f6ad57c5700 1 --2- 172.21.15.63:0/39686052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ad0143ff0 0x7f6ad00b38c0 secure :-1 s=READY pgs=1914 cs=0 l=1 rx=0x7f6ac8001360 tx=0x7f6ac8010fe0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:12.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.457+0000 7f6ad57c5700 1 --2- 172.21.15.63:0/39686052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ad0143ff0 0x7f6ad00b38c0 secure :-1 s=THROTTLE_DONE pgs=1914 cs=0 l=1 rx=0x7f6ac8001360 tx=0x7f6ac8010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:12.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.457+0000 7f6ac5ffb700 1 -- 172.21.15.63:0/39686052 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ac800cd10 con 0x7f6ad0143ff0 2020-05-18T21:37:12.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.457+0000 7f6ad57c5700 1 --2- 172.21.15.63:0/39686052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ad0143ff0 0x7f6ad00b38c0 secure :-1 s=THROTTLE_DONE pgs=1914 cs=0 l=1 rx=0x7f6ac8001360 tx=0x7f6ac8010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:12.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.457+0000 7f6ac5ffb700 1 -- 172.21.15.63:0/39686052 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac800ce70 con 0x7f6ad0143ff0 2020-05-18T21:37:12.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.457+0000 7f6ad57c5700 1 --2- 172.21.15.63:0/39686052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ad0143ff0 0x7f6ad00b38c0 secure :-1 s=THROTTLE_DONE pgs=1914 cs=0 l=1 rx=0x7f6ac8001360 tx=0x7f6ac8010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:12.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.457+0000 7f6ad7228700 1 -- 172.21.15.63:0/39686052 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad00b5840 con 0x7f6ad0143ff0 2020-05-18T21:37:12.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.457+0000 7f6ac5ffb700 1 -- 172.21.15.63:0/39686052 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ac8004aa0 con 0x7f6ad0143ff0 2020-05-18T21:37:12.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.457+0000 7f6ad7228700 1 -- 172.21.15.63:0/39686052 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad00b8950 con 0x7f6ad0143ff0 2020-05-18T21:37:12.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.457+0000 7f6ad57c5700 1 --2- 172.21.15.63:0/39686052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ad0143ff0 0x7f6ad00b38c0 secure :-1 s=THROTTLE_DONE pgs=1914 cs=0 l=1 rx=0x7f6ac8001360 tx=0x7f6ac8010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:12.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.457+0000 7f6ad7228700 1 -- 172.21.15.63:0/39686052 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad00b7230 con 0x7f6ad0143ff0 2020-05-18T21:37:12.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.457+0000 7f6ac5ffb700 1 -- 172.21.15.63:0/39686052 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6ac8004ca0 con 0x7f6ad0143ff0 2020-05-18T21:37:12.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.457+0000 7f6ad57c5700 1 --2- 172.21.15.63:0/39686052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ad0143ff0 0x7f6ad00b38c0 secure :-1 s=THROTTLE_DONE pgs=1914 cs=0 l=1 rx=0x7f6ac8001360 tx=0x7f6ac8010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:12.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.461+0000 7f6ac5ffb700 1 --2- 172.21.15.63:0/39686052 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6ab004fe80 0x7f6ab0052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:12.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.461+0000 7f6ac5ffb700 1 -- 172.21.15.63:0/39686052 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f6ac8063bb0 con 0x7f6ad0143ff0 2020-05-18T21:37:12.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.461+0000 7f6ad4fc4700 1 --2- 172.21.15.63:0/39686052 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6ab004fe80 0x7f6ab0052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:12.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.461+0000 7f6ad4fc4700 1 --2- 172.21.15.63:0/39686052 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6ab004fe80 0x7f6ab0052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6acc001110 tx=0x7f6acc0027d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:12.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.461+0000 7f6ad4fc4700 1 --2- 172.21.15.63:0/39686052 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6ab004fe80 0x7f6ab0052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6acc001110 tx=0x7f6acc0027d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:12.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.461+0000 7f6ad4fc4700 1 --2- 172.21.15.63:0/39686052 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6ab004fe80 0x7f6ab0052340 secure :-1 s=READY pgs=745 cs=0 l=1 rx=0x7f6acc001110 tx=0x7f6acc0027d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:12.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.465+0000 7f6ad57c5700 1 --2- 172.21.15.63:0/39686052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ad0143ff0 0x7f6ad00b38c0 secure :-1 s=THROTTLE_DONE pgs=1914 cs=0 l=1 rx=0x7f6ac8001360 tx=0x7f6ac8010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:12.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.465+0000 7f6ac5ffb700 1 -- 172.21.15.63:0/39686052 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6ad00b7230 con 0x7f6ad0143ff0 2020-05-18T21:37:12.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:12.585+0000 7f6ad7228700 1 -- 172.21.15.63:0/39686052 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6ad00b7230 con 0x7f6ad0143ff0 2020-05-18T21:37:13.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.457+0000 7f6ad57c5700 1 --2- 172.21.15.63:0/39686052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ad0143ff0 0x7f6ad00b38c0 secure :-1 s=READY pgs=1914 cs=0 l=1 rx=0x7f6ac8001360 tx=0x7f6ac8010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:13.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.493+0000 7f6ad57c5700 1 --2- 172.21.15.63:0/39686052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ad0143ff0 0x7f6ad00b38c0 secure :-1 s=THROTTLE_DONE pgs=1914 cs=0 l=1 rx=0x7f6ac8001360 tx=0x7f6ac8010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:13.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.493+0000 7f6ac5ffb700 1 -- 172.21.15.63:0/39686052 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v137) v1 ==== 185+0+0 (secure 0 0 0) 0x7f6ad00b7230 con 0x7f6ad0143ff0 2020-05-18T21:37:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.497+0000 7f6ad7228700 1 -- 172.21.15.63:0/39686052 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6ab004fe80 msgr2=0x7f6ab0052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.497+0000 7f6ad7228700 1 --2- 172.21.15.63:0/39686052 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6ab004fe80 0x7f6ab0052340 secure :-1 s=READY pgs=745 cs=0 l=1 rx=0x7f6acc001110 tx=0x7f6acc0027d0).stop 2020-05-18T21:37:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.497+0000 7f6ad7228700 1 -- 172.21.15.63:0/39686052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ad0143ff0 msgr2=0x7f6ad00b38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.497+0000 7f6ad7228700 1 --2- 172.21.15.63:0/39686052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ad0143ff0 0x7f6ad00b38c0 secure :-1 s=READY pgs=1914 cs=0 l=1 rx=0x7f6ac8001360 tx=0x7f6ac8010fe0).stop 2020-05-18T21:37:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.497+0000 7f6ad7228700 1 -- 172.21.15.63:0/39686052 shutdown_connections 2020-05-18T21:37:13.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.497+0000 7f6ad7228700 1 --2- 172.21.15.63:0/39686052 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6ab004fe80 0x7f6ab0052340 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:13.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.497+0000 7f6ad7228700 1 --2- 172.21.15.63:0/39686052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ad0143ff0 0x7f6ad00b38c0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:13.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.497+0000 7f6ad7228700 1 -- 172.21.15.63:0/39686052 >> 172.21.15.63:0/39686052 conn(0x7f6ad005b290 msgr2=0x7f6ad01438c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:13.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.497+0000 7f6ad7228700 1 -- 172.21.15.63:0/39686052 shutdown_connections 2020-05-18T21:37:13.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.497+0000 7f6ad7228700 1 -- 172.21.15.63:0/39686052 wait complete. 2020-05-18T21:37:13.509 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2020-05-18T21:37:13.517 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-05-18T21:37:13.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.621+0000 7f55aae62700 1 Processor -- start 2020-05-18T21:37:13.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.621+0000 7f55aae62700 1 -- start start 2020-05-18T21:37:13.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.621+0000 7f55aae62700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f55a4061180 0x7f55a406a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:13.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55aae62700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55a40b2eb0 0x7f55a40b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:13.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55aae62700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a406a7d0 con 0x7f55a40b4f40 2020-05-18T21:37:13.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55aae62700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a40b2a10 con 0x7f55a4061180 2020-05-18T21:37:13.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55aae62700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a40b5320 con 0x7f55a40b2eb0 2020-05-18T21:37:13.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55a9e60700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f55a40b4f40 0x7f55a4132360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37484/0 (socket says 172.21.15.63:37484) 2020-05-18T21:37:13.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55a9e60700 1 -- 172.21.15.63:0/1754847816 learned_addr learned my addr 172.21.15.63:0/1754847816 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:13.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55a965f700 1 --2- 172.21.15.63:0/1754847816 >> v2:172.21.15.63:3300/0 conn(0x7f55a4061180 0x7f55a406a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:13.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55aa661700 1 --2- 172.21.15.63:0/1754847816 >> v2:172.21.15.155:3300/0 conn(0x7f55a40b2eb0 0x7f55a40b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:13.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55a8e5e700 1 -- 172.21.15.63:0/1754847816 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202403208 0 0) 0x7f55a406a7d0 con 0x7f55a40b4f40 2020-05-18T21:37:13.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55a8e5e700 1 -- 172.21.15.63:0/1754847816 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5590003270 con 0x7f55a40b4f40 2020-05-18T21:37:13.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55a965f700 1 -- 172.21.15.63:0/1754847816 >> v2:172.21.15.155:3300/0 conn(0x7f55a40b2eb0 msgr2=0x7f55a40b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:13.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55a965f700 1 --2- 172.21.15.63:0/1754847816 >> v2:172.21.15.155:3300/0 conn(0x7f55a40b2eb0 0x7f55a40b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:13.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55a965f700 1 -- 172.21.15.63:0/1754847816 >> v1:172.21.15.63:6789/0 conn(0x7f55a40b4f40 legacy=0x7f55a4132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:13.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55a965f700 1 -- 172.21.15.63:0/1754847816 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a41337f0 con 0x7f55a4061180 2020-05-18T21:37:13.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55a965f700 1 --2- 172.21.15.63:0/1754847816 >> v2:172.21.15.63:3300/0 conn(0x7f55a4061180 0x7f55a406a2c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5598002f70 tx=0x7f5598007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:13.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55a965f700 1 --2- 172.21.15.63:0/1754847816 >> v2:172.21.15.63:3300/0 conn(0x7f55a4061180 0x7f55a406a2c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5598002f70 tx=0x7f5598007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:13.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55a965f700 1 --2- 172.21.15.63:0/1754847816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a4061180 0x7f55a406a2c0 secure :-1 s=READY pgs=1916 cs=0 l=1 rx=0x7f5598002f70 tx=0x7f5598007a80).ready entity=mon.0 client_cookie=20cbfdf85dedf6a0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:13.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55a965f700 1 --2- 172.21.15.63:0/1754847816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a4061180 0x7f55a406a2c0 secure :-1 s=THROTTLE_DONE pgs=1916 cs=0 l=1 rx=0x7f5598002f70 tx=0x7f5598007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:13.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55a8e5e700 1 -- 172.21.15.63:0/1754847816 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5598008e50 con 0x7f55a4061180 2020-05-18T21:37:13.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55a965f700 1 --2- 172.21.15.63:0/1754847816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a4061180 0x7f55a406a2c0 secure :-1 s=THROTTLE_DONE pgs=1916 cs=0 l=1 rx=0x7f5598002f70 tx=0x7f5598007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:13.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55a965f700 1 --2- 172.21.15.63:0/1754847816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a4061180 0x7f55a406a2c0 secure :-1 s=THROTTLE_DONE pgs=1916 cs=0 l=1 rx=0x7f5598002f70 tx=0x7f5598007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:13.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55a8e5e700 1 -- 172.21.15.63:0/1754847816 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5598011540 con 0x7f55a4061180 2020-05-18T21:37:13.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55a8e5e700 1 -- 172.21.15.63:0/1754847816 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5598011920 con 0x7f55a4061180 2020-05-18T21:37:13.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55aae62700 1 -- 172.21.15.63:0/1754847816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a4061180 msgr2=0x7f55a406a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:13.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55aae62700 1 --2- 172.21.15.63:0/1754847816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a4061180 0x7f55a406a2c0 secure :-1 s=READY pgs=1916 cs=0 l=1 rx=0x7f5598002f70 tx=0x7f5598007a80).stop 2020-05-18T21:37:13.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55aae62700 1 -- 172.21.15.63:0/1754847816 shutdown_connections 2020-05-18T21:37:13.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55aae62700 1 --2- 172.21.15.63:0/1754847816 >> v2:172.21.15.155:3300/0 conn(0x7f55a40b2eb0 0x7f55a40b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:13.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55aae62700 1 --2- 172.21.15.63:0/1754847816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a4061180 0x7f55a406a2c0 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:13.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55aae62700 1 -- 172.21.15.63:0/1754847816 >> 172.21.15.63:0/1754847816 conn(0x7f55a405fbd0 msgr2=0x7f55a4069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:13.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55aae62700 1 -- 172.21.15.63:0/1754847816 shutdown_connections 2020-05-18T21:37:13.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55aae62700 1 -- 172.21.15.63:0/1754847816 wait complete. 2020-05-18T21:37:13.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.625+0000 7f55aae62700 1 Processor -- start 2020-05-18T21:37:13.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55aae62700 1 -- start start 2020-05-18T21:37:13.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55aae62700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55a4061180 0x7f55a414df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:13.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55aae62700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f55a40b2eb0 0x7f55a40ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:13.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55aae62700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55a40b4f40 0x7f55a414c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:13.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55aae62700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a41576d0 con 0x7f55a40b2eb0 2020-05-18T21:37:13.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55aae62700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a4157970 con 0x7f55a4061180 2020-05-18T21:37:13.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55aae62700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a4157c10 con 0x7f55a40b4f40 2020-05-18T21:37:13.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55a965f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f55a40b2eb0 0x7f55a40ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:13.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55a965f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f55a40b2eb0 0x7f55a40ac810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35304/0 (socket says 172.21.15.63:35304) 2020-05-18T21:37:13.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55a965f700 1 -- 172.21.15.63:0/167182801 learned_addr learned my addr 172.21.15.63:0/167182801 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:13.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55a9e60700 1 --2- 172.21.15.63:0/167182801 >> v2:172.21.15.155:3300/0 conn(0x7f55a4061180 0x7f55a414df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:13.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55aa661700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55a40b4f40 0x7f55a414c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:13.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55a965f700 1 -- 172.21.15.63:0/167182801 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55a40b4f40 msgr2=0x7f55a414c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:13.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55a965f700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55a40b4f40 0x7f55a414c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:13.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55a965f700 1 -- 172.21.15.63:0/167182801 >> v2:172.21.15.155:3300/0 conn(0x7f55a4061180 msgr2=0x7f55a414df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:13.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55a965f700 1 --2- 172.21.15.63:0/167182801 >> v2:172.21.15.155:3300/0 conn(0x7f55a4061180 0x7f55a414df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:13.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55a965f700 1 -- 172.21.15.63:0/167182801 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a41580b0 con 0x7f55a40b2eb0 2020-05-18T21:37:13.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55a965f700 1 --2- 172.21.15.63:0/167182801 >> v2:172.21.15.63:3300/0 conn(0x7f55a40b2eb0 0x7f55a40ac810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5598002f70 tx=0x7f5598007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:13.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55a965f700 1 --2- 172.21.15.63:0/167182801 >> v2:172.21.15.63:3300/0 conn(0x7f55a40b2eb0 0x7f55a40ac810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5598002f70 tx=0x7f5598007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:13.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55a965f700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a40b2eb0 0x7f55a40ac810 secure :-1 s=READY pgs=1917 cs=0 l=1 rx=0x7f5598002f70 tx=0x7f5598007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:13.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55a965f700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a40b2eb0 0x7f55a40ac810 secure :-1 s=THROTTLE_DONE pgs=1917 cs=0 l=1 rx=0x7f5598002f70 tx=0x7f5598007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:13.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55a2ffd700 1 -- 172.21.15.63:0/167182801 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5598011850 con 0x7f55a40b2eb0 2020-05-18T21:37:13.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55aae62700 1 -- 172.21.15.63:0/167182801 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a414a470 con 0x7f55a40b2eb0 2020-05-18T21:37:13.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55a965f700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a40b2eb0 0x7f55a40ac810 secure :-1 s=THROTTLE_DONE pgs=1917 cs=0 l=1 rx=0x7f5598002f70 tx=0x7f5598007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:13.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55a2ffd700 1 -- 172.21.15.63:0/167182801 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5598007170 con 0x7f55a40b2eb0 2020-05-18T21:37:13.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55a965f700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a40b2eb0 0x7f55a40ac810 secure :-1 s=THROTTLE_DONE pgs=1917 cs=0 l=1 rx=0x7f5598002f70 tx=0x7f5598007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:13.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55aae62700 1 -- 172.21.15.63:0/167182801 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a4157420 con 0x7f55a40b2eb0 2020-05-18T21:37:13.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55a2ffd700 1 -- 172.21.15.63:0/167182801 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5598007550 con 0x7f55a40b2eb0 2020-05-18T21:37:13.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55aae62700 1 -- 172.21.15.63:0/167182801 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a40569e0 con 0x7f55a40b2eb0 2020-05-18T21:37:13.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.629+0000 7f55a965f700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a40b2eb0 0x7f55a40ac810 secure :-1 s=THROTTLE_DONE pgs=1917 cs=0 l=1 rx=0x7f5598002f70 tx=0x7f5598007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:13.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.633+0000 7f55a2ffd700 1 -- 172.21.15.63:0/167182801 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5598005700 con 0x7f55a40b2eb0 2020-05-18T21:37:13.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.633+0000 7f55a965f700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a40b2eb0 0x7f55a40ac810 secure :-1 s=THROTTLE_DONE pgs=1917 cs=0 l=1 rx=0x7f5598002f70 tx=0x7f5598007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:13.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.633+0000 7f55a2ffd700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f558404fa90 0x7f5584051f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:13.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.633+0000 7f55a2ffd700 1 -- 172.21.15.63:0/167182801 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5807+0+0 (secure 0 0 0) 0x7f55980644c0 con 0x7f55a40b2eb0 2020-05-18T21:37:13.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.633+0000 7f55a9e60700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f558404fa90 0x7f5584051f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:13.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.633+0000 7f55a9e60700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f558404fa90 0x7f5584051f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5594001110 tx=0x7f5594001d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:13.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.633+0000 7f55a9e60700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f558404fa90 0x7f5584051f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5594001110 tx=0x7f5594001d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:13.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.633+0000 7f55a9e60700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f558404fa90 0x7f5584051f50 secure :-1 s=READY pgs=746 cs=0 l=1 rx=0x7f5594001110 tx=0x7f5594001d80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:13.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.637+0000 7f55a965f700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a40b2eb0 0x7f55a40ac810 secure :-1 s=THROTTLE_DONE pgs=1917 cs=0 l=1 rx=0x7f5598002f70 tx=0x7f5598007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:13.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.637+0000 7f55a2ffd700 1 -- 172.21.15.63:0/167182801 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f559803e970 con 0x7f55a40b2eb0 2020-05-18T21:37:13.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:13.753+0000 7f55aae62700 1 -- 172.21.15.63:0/167182801 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f55a414a600 con 0x7f55a40b2eb0 2020-05-18T21:37:14.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.501+0000 7f55a965f700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a40b2eb0 0x7f55a40ac810 secure :-1 s=THROTTLE_DONE pgs=1917 cs=0 l=1 rx=0x7f5598002f70 tx=0x7f5598007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:14.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.501+0000 7f55a2ffd700 1 -- 172.21.15.63:0/167182801 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v138) v1 ==== 173+0+0 (secure 0 0 0) 0x7f5598041f90 con 0x7f55a40b2eb0 2020-05-18T21:37:14.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.505+0000 7f55aae62700 1 -- 172.21.15.63:0/167182801 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f558404fa90 msgr2=0x7f5584051f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:14.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.505+0000 7f55aae62700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f558404fa90 0x7f5584051f50 secure :-1 s=READY pgs=746 cs=0 l=1 rx=0x7f5594001110 tx=0x7f5594001d80).stop 2020-05-18T21:37:14.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.505+0000 7f55aae62700 1 -- 172.21.15.63:0/167182801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a40b2eb0 msgr2=0x7f55a40ac810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:14.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.505+0000 7f55aae62700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a40b2eb0 0x7f55a40ac810 secure :-1 s=READY pgs=1917 cs=0 l=1 rx=0x7f5598002f70 tx=0x7f5598007a80).stop 2020-05-18T21:37:14.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.505+0000 7f55aae62700 1 -- 172.21.15.63:0/167182801 shutdown_connections 2020-05-18T21:37:14.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.505+0000 7f55aae62700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f558404fa90 0x7f5584051f50 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:14.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.505+0000 7f55aae62700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55a40b4f40 0x7f55a414c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:14.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.505+0000 7f55aae62700 1 --2- 172.21.15.63:0/167182801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a40b2eb0 0x7f55a40ac810 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:14.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.505+0000 7f55aae62700 1 --2- 172.21.15.63:0/167182801 >> v2:172.21.15.155:3300/0 conn(0x7f55a4061180 0x7f55a414df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:14.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.505+0000 7f55aae62700 1 -- 172.21.15.63:0/167182801 >> 172.21.15.63:0/167182801 conn(0x7f55a405fbd0 msgr2=0x7f55a41308a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:14.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.505+0000 7f55aae62700 1 -- 172.21.15.63:0/167182801 shutdown_connections 2020-05-18T21:37:14.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.505+0000 7f55aae62700 1 -- 172.21.15.63:0/167182801 wait complete. 2020-05-18T21:37:14.515 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2020-05-18T21:37:14.526 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:37:14.526 INFO:tasks.ceph.mds.a:Stopping old one... 2020-05-18T21:37:14.526 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:37:14.527 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:37:14.527 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:37:14.527 INFO:tasks.ceph.mds.b:Stopping old one... 2020-05-18T21:37:14.528 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:37:14.528 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:37:14.542 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:37:14.542 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:37:14.543 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:37:14.543 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:37:14.545 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:37:14.545 DEBUG:teuthology.parallel:result is None 2020-05-18T21:37:14.546 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:37:14.546 DEBUG:teuthology.parallel:result is None 2020-05-18T21:37:14.547 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-05-18T21:37:14.616 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:37:14.619 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:37:14.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.637+0000 7f698275f700 1 Processor -- start 2020-05-18T21:37:14.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.637+0000 7f698275f700 1 -- start start 2020-05-18T21:37:14.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.641+0000 7f698275f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f697c0b6c00 0x7f697c09f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:14.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.641+0000 7f698275f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f697c144840 0x7f697c144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:14.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.641+0000 7f698275f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697c148430 con 0x7f697c0b5cb0 2020-05-18T21:37:14.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.641+0000 7f698275f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697c1443a0 con 0x7f697c0b6c00 2020-05-18T21:37:14.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.641+0000 7f698275f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c05aed0 con 0x7f697c144840 2020-05-18T21:37:14.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.641+0000 7f697b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f697c0b5cb0 0x7f697c05a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37512/0 (socket says 172.21.15.63:37512) 2020-05-18T21:37:14.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.641+0000 7f697b7fe700 1 -- 172.21.15.63:0/64034654 learned_addr learned my addr 172.21.15.63:0/64034654 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:14.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.641+0000 7f697bfff700 1 --2- 172.21.15.63:0/64034654 >> v2:172.21.15.155:3300/0 conn(0x7f697c0b6c00 0x7f697c09f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:14.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.641+0000 7f6980cfc700 1 --2- 172.21.15.63:0/64034654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f697c144840 0x7f697c144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:14.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.641+0000 7f6980cfc700 1 -- 172.21.15.63:0/64034654 >> v2:172.21.15.155:3300/0 conn(0x7f697c0b6c00 msgr2=0x7f697c09f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:14.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.641+0000 7f6980cfc700 1 --2- 172.21.15.63:0/64034654 >> v2:172.21.15.155:3300/0 conn(0x7f697c0b6c00 0x7f697c09f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:14.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.641+0000 7f6980cfc700 1 -- 172.21.15.63:0/64034654 >> v1:172.21.15.63:6789/0 conn(0x7f697c0b5cb0 legacy=0x7f697c05a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:14.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.641+0000 7f6980cfc700 1 -- 172.21.15.63:0/64034654 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c148160 con 0x7f697c144840 2020-05-18T21:37:14.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.641+0000 7f697bfff700 1 --2- 172.21.15.63:0/64034654 >> v2:172.21.15.155:3300/0 conn(0x7f697c0b6c00 0x7f697c09f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:14.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.641+0000 7f6980cfc700 1 --2- 172.21.15.63:0/64034654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f697c144840 0x7f697c144cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f69740032f0 tx=0x7f6974007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:14.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.641+0000 7f6980cfc700 1 --2- 172.21.15.63:0/64034654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f697c144840 0x7f697c144cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f69740032f0 tx=0x7f6974007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:14.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.641+0000 7f6980cfc700 1 --2- 172.21.15.63:0/64034654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f697c144840 0x7f697c144cd0 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7f69740032f0 tx=0x7f6974007e00).ready entity=mon.2 client_cookie=9b85c74469a6125f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:14.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.645+0000 7f6980cfc700 1 --2- 172.21.15.63:0/64034654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f697c144840 0x7f697c144cd0 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f69740032f0 tx=0x7f6974007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:14.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.645+0000 7f697affd700 1 -- 172.21.15.63:0/64034654 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6974011e60 con 0x7f697c144840 2020-05-18T21:37:14.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.645+0000 7f6980cfc700 1 --2- 172.21.15.63:0/64034654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f697c144840 0x7f697c144cd0 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f69740032f0 tx=0x7f6974007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:14.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.645+0000 7f6980cfc700 1 --2- 172.21.15.63:0/64034654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f697c144840 0x7f697c144cd0 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f69740032f0 tx=0x7f6974007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:14.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.645+0000 7f697affd700 1 -- 172.21.15.63:0/64034654 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697400a180 con 0x7f697c144840 2020-05-18T21:37:14.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.645+0000 7f697affd700 1 -- 172.21.15.63:0/64034654 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f697400a560 con 0x7f697c144840 2020-05-18T21:37:14.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.645+0000 7f698275f700 1 -- 172.21.15.63:0/64034654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f697c144840 msgr2=0x7f697c144cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:14.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.645+0000 7f698275f700 1 --2- 172.21.15.63:0/64034654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f697c144840 0x7f697c144cd0 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7f69740032f0 tx=0x7f6974007e00).stop 2020-05-18T21:37:14.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.645+0000 7f698275f700 1 -- 172.21.15.63:0/64034654 shutdown_connections 2020-05-18T21:37:14.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.645+0000 7f698275f700 1 --2- 172.21.15.63:0/64034654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f697c144840 0x7f697c144cd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:14.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.645+0000 7f698275f700 1 --2- 172.21.15.63:0/64034654 >> v2:172.21.15.155:3300/0 conn(0x7f697c0b6c00 0x7f697c09f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:14.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.645+0000 7f698275f700 1 -- 172.21.15.63:0/64034654 >> 172.21.15.63:0/64034654 conn(0x7f697c0ba1e0 msgr2=0x7f697c0b61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:14.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.645+0000 7f698275f700 1 -- 172.21.15.63:0/64034654 shutdown_connections 2020-05-18T21:37:14.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.645+0000 7f698275f700 1 -- 172.21.15.63:0/64034654 wait complete. 2020-05-18T21:37:14.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.649+0000 7f698275f700 1 Processor -- start 2020-05-18T21:37:14.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.649+0000 7f698275f700 1 -- start start 2020-05-18T21:37:14.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.649+0000 7f698275f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f697c0b5cb0 0x7f697c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:14.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.649+0000 7f698275f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f697c144840 0x7f697c1578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:14.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.649+0000 7f698275f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697c0afda0 con 0x7f697c0b6c00 2020-05-18T21:37:14.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.649+0000 7f698275f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697c09e0a0 con 0x7f697c0b5cb0 2020-05-18T21:37:14.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.649+0000 7f698275f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c09e340 con 0x7f697c144840 2020-05-18T21:37:14.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.649+0000 7f697bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f697c0b5cb0 0x7f697c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:14.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.649+0000 7f697bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f697c0b5cb0 0x7f697c0af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35328/0 (socket says 172.21.15.63:35328) 2020-05-18T21:37:14.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.649+0000 7f697bfff700 1 -- 172.21.15.63:0/3461125494 learned_addr learned my addr 172.21.15.63:0/3461125494 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:14.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.649+0000 7f6980cfc700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f697c144840 0x7f697c1578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:14.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.649+0000 7f697bfff700 1 -- 172.21.15.63:0/3461125494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f697c144840 msgr2=0x7f697c1578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:14.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.649+0000 7f697bfff700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f697c144840 0x7f697c1578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:14.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.649+0000 7f697bfff700 1 -- 172.21.15.63:0/3461125494 >> v1:172.21.15.155:6789/0 conn(0x7f697c0b6c00 legacy=0x7f697c141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:14.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.649+0000 7f697bfff700 1 -- 172.21.15.63:0/3461125494 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c09e5e0 con 0x7f697c0b5cb0 2020-05-18T21:37:14.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.649+0000 7f697bfff700 1 --2- 172.21.15.63:0/3461125494 >> v2:172.21.15.63:3300/0 conn(0x7f697c0b5cb0 0x7f697c0af940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f696c002f30 tx=0x7f696c010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:14.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.649+0000 7f697bfff700 1 --2- 172.21.15.63:0/3461125494 >> v2:172.21.15.63:3300/0 conn(0x7f697c0b5cb0 0x7f697c0af940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f696c002f30 tx=0x7f696c010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:14.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.649+0000 7f697bfff700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f697c0b5cb0 0x7f697c0af940 secure :-1 s=READY pgs=1924 cs=0 l=1 rx=0x7f696c002f30 tx=0x7f696c010ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:14.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.653+0000 7f697bfff700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f697c0b5cb0 0x7f697c0af940 secure :-1 s=THROTTLE_DONE pgs=1924 cs=0 l=1 rx=0x7f696c002f30 tx=0x7f696c010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:14.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.653+0000 7f69797fa700 1 -- 172.21.15.63:0/3461125494 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f696c005e30 con 0x7f697c0b5cb0 2020-05-18T21:37:14.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.653+0000 7f697bfff700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f697c0b5cb0 0x7f697c0af940 secure :-1 s=THROTTLE_DONE pgs=1924 cs=0 l=1 rx=0x7f696c002f30 tx=0x7f696c010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:14.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.653+0000 7f697bfff700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f697c0b5cb0 0x7f697c0af940 secure :-1 s=THROTTLE_DONE pgs=1924 cs=0 l=1 rx=0x7f696c002f30 tx=0x7f696c010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:14.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.653+0000 7f698275f700 1 -- 172.21.15.63:0/3461125494 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697c157d20 con 0x7f697c0b5cb0 2020-05-18T21:37:14.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.653+0000 7f69797fa700 1 -- 172.21.15.63:0/3461125494 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c007180 con 0x7f697c0b5cb0 2020-05-18T21:37:14.661 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.653+0000 7f69797fa700 1 -- 172.21.15.63:0/3461125494 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f696c0075a0 con 0x7f697c0b5cb0 2020-05-18T21:37:14.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.653+0000 7f698275f700 1 -- 172.21.15.63:0/3461125494 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697c0b2c10 con 0x7f697c0b5cb0 2020-05-18T21:37:14.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.653+0000 7f697bfff700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f697c0b5cb0 0x7f697c0af940 secure :-1 s=THROTTLE_DONE pgs=1924 cs=0 l=1 rx=0x7f696c002f30 tx=0x7f696c010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:14.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.653+0000 7f69797fa700 1 -- 172.21.15.63:0/3461125494 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f696c0101a0 con 0x7f697c0b5cb0 2020-05-18T21:37:14.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.653+0000 7f697bfff700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f697c0b5cb0 0x7f697c0af940 secure :-1 s=THROTTLE_DONE pgs=1924 cs=0 l=1 rx=0x7f696c002f30 tx=0x7f696c010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:14.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.657+0000 7f698275f700 1 -- 172.21.15.63:0/3461125494 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697c0569e0 con 0x7f697c0b5cb0 2020-05-18T21:37:14.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.657+0000 7f69797fa700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f695c04f9e0 0x7f695c051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:14.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.657+0000 7f69797fa700 1 -- 172.21.15.63:0/3461125494 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5425+0+0 (secure 0 0 0) 0x7f696c063f40 con 0x7f697c0b5cb0 2020-05-18T21:37:14.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.657+0000 7f697b7fe700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f695c04f9e0 0x7f695c051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:14.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.657+0000 7f697b7fe700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f695c04f9e0 0x7f695c051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f697c0b73f0 tx=0x7f6970001500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:14.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.657+0000 7f697b7fe700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f695c04f9e0 0x7f695c051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f697c0b73f0 tx=0x7f6970001500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:14.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.657+0000 7f697b7fe700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f695c04f9e0 0x7f695c051ea0 secure :-1 s=READY pgs=747 cs=0 l=1 rx=0x7f697c0b73f0 tx=0x7f6970001500).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:14.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.661+0000 7f697bfff700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f697c0b5cb0 0x7f697c0af940 secure :-1 s=THROTTLE_DONE pgs=1924 cs=0 l=1 rx=0x7f696c002f30 tx=0x7f696c010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:14.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.661+0000 7f69797fa700 1 -- 172.21.15.63:0/3461125494 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f696c03e270 con 0x7f697c0b5cb0 2020-05-18T21:37:14.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:14.789+0000 7f698275f700 1 -- 172.21.15.63:0/3461125494 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f697c06ac80 con 0x7f697c0b5cb0 2020-05-18T21:37:15.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.653+0000 7f697bfff700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f697c0b5cb0 0x7f697c0af940 secure :-1 s=READY pgs=1924 cs=0 l=1 rx=0x7f696c002f30 tx=0x7f696c010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:15.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.661+0000 7f697bfff700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f697c0b5cb0 0x7f697c0af940 secure :-1 s=THROTTLE_DONE pgs=1924 cs=0 l=1 rx=0x7f696c002f30 tx=0x7f696c010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:15.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.661+0000 7f69797fa700 1 -- 172.21.15.63:0/3461125494 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v141) v1 ==== 97+0+0 (secure 0 0 0) 0x7f696c041890 con 0x7f697c0b5cb0 2020-05-18T21:37:15.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.665+0000 7f698275f700 1 -- 172.21.15.63:0/3461125494 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f695c04f9e0 msgr2=0x7f695c051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:15.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.665+0000 7f698275f700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f695c04f9e0 0x7f695c051ea0 secure :-1 s=READY pgs=747 cs=0 l=1 rx=0x7f697c0b73f0 tx=0x7f6970001500).stop 2020-05-18T21:37:15.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.665+0000 7f698275f700 1 -- 172.21.15.63:0/3461125494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f697c0b5cb0 msgr2=0x7f697c0af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:15.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.665+0000 7f698275f700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f697c0b5cb0 0x7f697c0af940 secure :-1 s=READY pgs=1924 cs=0 l=1 rx=0x7f696c002f30 tx=0x7f696c010ef0).stop 2020-05-18T21:37:15.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.665+0000 7f698275f700 1 -- 172.21.15.63:0/3461125494 shutdown_connections 2020-05-18T21:37:15.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.665+0000 7f698275f700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f695c04f9e0 0x7f695c051ea0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:15.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.665+0000 7f698275f700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f697c144840 0x7f697c1578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:15.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.665+0000 7f698275f700 1 --2- 172.21.15.63:0/3461125494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f697c0b5cb0 0x7f697c0af940 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:15.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.665+0000 7f698275f700 1 -- 172.21.15.63:0/3461125494 >> 172.21.15.63:0/3461125494 conn(0x7f697c0ba1e0 msgr2=0x7f697c05eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:15.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.665+0000 7f698275f700 1 -- 172.21.15.63:0/3461125494 shutdown_connections 2020-05-18T21:37:15.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.665+0000 7f698275f700 1 -- 172.21.15.63:0/3461125494 wait complete. 2020-05-18T21:37:15.675 INFO:teuthology.orchestra.run.smithi063.stderr: removed all blacklist entries 2020-05-18T21:37:15.687 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-05-18T21:37:15.688 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-05-18T21:37:15.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.793+0000 7f494759e700 1 Processor -- start 2020-05-18T21:37:15.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.793+0000 7f494759e700 1 -- start start 2020-05-18T21:37:15.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.793+0000 7f494759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f494805f110 0x7f49480acea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:15.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.793+0000 7f494759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f494813c710 0x7f494813cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:15.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.793+0000 7f494759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49480b4af0 con 0x7f49480659d0 2020-05-18T21:37:15.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.793+0000 7f494759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494813cfe0 con 0x7f494813c710 2020-05-18T21:37:15.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.793+0000 7f494759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49481460e0 con 0x7f494805f110 2020-05-18T21:37:15.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.793+0000 7f4945d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f49480659d0 0x7f4948146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37526/0 (socket says 172.21.15.63:37526) 2020-05-18T21:37:15.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.793+0000 7f4945d9b700 1 -- 172.21.15.63:0/2756527573 learned_addr learned my addr 172.21.15.63:0/2756527573 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:15.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.793+0000 7f494659c700 1 --2- 172.21.15.63:0/2756527573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f494805f110 0x7f49480acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:15.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.793+0000 7f4946d9d700 1 --2- 172.21.15.63:0/2756527573 >> v2:172.21.15.155:3300/0 conn(0x7f494813c710 0x7f494813cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:15.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494559a700 1 -- 172.21.15.63:0/2756527573 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922235015 0 0) 0x7f49480b4af0 con 0x7f49480659d0 2020-05-18T21:37:15.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494559a700 1 -- 172.21.15.63:0/2756527573 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f492c003270 con 0x7f49480659d0 2020-05-18T21:37:15.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494559a700 1 -- 172.21.15.63:0/2756527573 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4260717769 0 0) 0x7f492c003270 con 0x7f49480659d0 2020-05-18T21:37:15.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494559a700 1 -- 172.21.15.63:0/2756527573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f494805f110 msgr2=0x7f49480acea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:15.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494559a700 1 --2- 172.21.15.63:0/2756527573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f494805f110 0x7f49480acea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:15.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494559a700 1 -- 172.21.15.63:0/2756527573 >> v2:172.21.15.155:3300/0 conn(0x7f494813c710 msgr2=0x7f494813cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:15.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494559a700 1 --2- 172.21.15.63:0/2756527573 >> v2:172.21.15.155:3300/0 conn(0x7f494813c710 0x7f494813cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:15.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494559a700 1 -- 172.21.15.63:0/2756527573 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4948146380 con 0x7f49480659d0 2020-05-18T21:37:15.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494559a700 1 -- 172.21.15.63:0/2756527573 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f493c001710 con 0x7f49480659d0 2020-05-18T21:37:15.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494559a700 1 -- 172.21.15.63:0/2756527573 >> v1:172.21.15.63:6789/0 conn(0x7f49480659d0 legacy=0x7f4948146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:15.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494559a700 1 --2- 172.21.15.63:0/2756527573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f492c003760 0x7f492c003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:15.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494559a700 1 --2- 172.21.15.63:0/2756527573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f492c0040a0 0x7f492c004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:15.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494559a700 1 --2- 172.21.15.63:0/2756527573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f494805f110 0x7f492c004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:15.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494559a700 1 -- 172.21.15.63:0/2756527573 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494813cfe0 con 0x7f492c0040a0 2020-05-18T21:37:15.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494559a700 1 -- 172.21.15.63:0/2756527573 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49481460e0 con 0x7f492c003760 2020-05-18T21:37:15.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494559a700 1 -- 172.21.15.63:0/2756527573 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492c005030 con 0x7f494805f110 2020-05-18T21:37:15.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f4945d9b700 1 --2- 172.21.15.63:0/2756527573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f492c0040a0 0x7f492c004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:15.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f4946d9d700 1 --2- 172.21.15.63:0/2756527573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f494805f110 0x7f492c004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:15.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494659c700 1 --2- 172.21.15.63:0/2756527573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f492c003760 0x7f492c003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:15.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f4945d9b700 1 -- 172.21.15.63:0/2756527573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f494805f110 msgr2=0x7f492c004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:15.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f4945d9b700 1 --2- 172.21.15.63:0/2756527573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f494805f110 0x7f492c004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:15.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f4945d9b700 1 -- 172.21.15.63:0/2756527573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f492c003760 msgr2=0x7f492c003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:15.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f4945d9b700 1 --2- 172.21.15.63:0/2756527573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f492c003760 0x7f492c003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:15.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f4945d9b700 1 -- 172.21.15.63:0/2756527573 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c003270 con 0x7f492c0040a0 2020-05-18T21:37:15.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494659c700 1 --2- 172.21.15.63:0/2756527573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f492c003760 0x7f492c003b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:37:15.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f4945d9b700 1 --2- 172.21.15.63:0/2756527573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f492c0040a0 0x7f492c004570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f493c001420 tx=0x7f4948060630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:15.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f4945d9b700 1 --2- 172.21.15.63:0/2756527573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f492c0040a0 0x7f492c004570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f493c001420 tx=0x7f4948060630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:15.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f4945d9b700 1 --2- 172.21.15.63:0/2756527573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f492c0040a0 0x7f492c004570 secure :-1 s=READY pgs=1926 cs=0 l=1 rx=0x7f493c001420 tx=0x7f4948060630).ready entity=mon.0 client_cookie=b782675e469a063e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:15.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f4945d9b700 1 --2- 172.21.15.63:0/2756527573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f492c0040a0 0x7f492c004570 secure :-1 s=THROTTLE_DONE pgs=1926 cs=0 l=1 rx=0x7f493c001420 tx=0x7f4948060630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:15.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494559a700 1 -- 172.21.15.63:0/2756527573 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f493c00e370 con 0x7f492c0040a0 2020-05-18T21:37:15.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f4945d9b700 1 --2- 172.21.15.63:0/2756527573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f492c0040a0 0x7f492c004570 secure :-1 s=THROTTLE_DONE pgs=1926 cs=0 l=1 rx=0x7f493c001420 tx=0x7f4948060630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:15.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494559a700 1 -- 172.21.15.63:0/2756527573 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c00e4d0 con 0x7f492c0040a0 2020-05-18T21:37:15.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f4945d9b700 1 --2- 172.21.15.63:0/2756527573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f492c0040a0 0x7f492c004570 secure :-1 s=THROTTLE_DONE pgs=1926 cs=0 l=1 rx=0x7f493c001420 tx=0x7f4948060630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:15.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494559a700 1 -- 172.21.15.63:0/2756527573 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f493c0100c0 con 0x7f492c0040a0 2020-05-18T21:37:15.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494759e700 1 -- 172.21.15.63:0/2756527573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f492c0040a0 msgr2=0x7f492c004570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:15.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494759e700 1 --2- 172.21.15.63:0/2756527573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f492c0040a0 0x7f492c004570 secure :-1 s=READY pgs=1926 cs=0 l=1 rx=0x7f493c001420 tx=0x7f4948060630).stop 2020-05-18T21:37:15.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f4946d9d700 1 -- 172.21.15.63:0/2756527573 reap_dead start 2020-05-18T21:37:15.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494759e700 1 -- 172.21.15.63:0/2756527573 shutdown_connections 2020-05-18T21:37:15.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494759e700 1 -- 172.21.15.63:0/2756527573 >> 172.21.15.63:0/2756527573 conn(0x7f4948069fc0 msgr2=0x7f494806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:15.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494759e700 1 -- 172.21.15.63:0/2756527573 shutdown_connections 2020-05-18T21:37:15.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.797+0000 7f494759e700 1 -- 172.21.15.63:0/2756527573 wait complete. 2020-05-18T21:37:15.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494759e700 1 Processor -- start 2020-05-18T21:37:15.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494759e700 1 -- start start 2020-05-18T21:37:15.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f49481423b0 0x7f494812cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:15.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f494812bee0 0x7f4948140670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:15.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494813ffa0 con 0x7f494812ea80 2020-05-18T21:37:15.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494759e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494812d380 con 0x7f49481423b0 2020-05-18T21:37:15.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494812f040 con 0x7f494812bee0 2020-05-18T21:37:15.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f49481423b0 0x7f494812cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:15.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f4945d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f494812ea80 0x7f494812b7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37542/0 (socket says 172.21.15.63:37542) 2020-05-18T21:37:15.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f4945d9b700 1 -- 172.21.15.63:0/2915603046 learned_addr learned my addr 172.21.15.63:0/2915603046 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:15.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f4946d9d700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f494812bee0 0x7f4948140670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:15.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f49377fe700 1 -- 172.21.15.63:0/2915603046 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162946858 0 0) 0x7f494813ffa0 con 0x7f494812ea80 2020-05-18T21:37:15.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f49377fe700 1 -- 172.21.15.63:0/2915603046 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4924002fe0 con 0x7f494812ea80 2020-05-18T21:37:15.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494659c700 1 -- 172.21.15.63:0/2915603046 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f494812bee0 msgr2=0x7f4948140670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:15.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494659c700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f494812bee0 0x7f4948140670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:15.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494659c700 1 -- 172.21.15.63:0/2915603046 >> v1:172.21.15.63:6789/0 conn(0x7f494812ea80 legacy=0x7f494812b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:15.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494659c700 1 -- 172.21.15.63:0/2915603046 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49481401d0 con 0x7f49481423b0 2020-05-18T21:37:15.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f4946d9d700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f494812bee0 0x7f4948140670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:15.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494659c700 1 --2- 172.21.15.63:0/2915603046 >> v2:172.21.15.63:3300/0 conn(0x7f49481423b0 0x7f494812cbd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4938002f70 tx=0x7f4938010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:15.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494659c700 1 --2- 172.21.15.63:0/2915603046 >> v2:172.21.15.63:3300/0 conn(0x7f49481423b0 0x7f494812cbd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4938002f70 tx=0x7f4938010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:15.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494659c700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49481423b0 0x7f494812cbd0 secure :-1 s=READY pgs=1928 cs=0 l=1 rx=0x7f4938002f70 tx=0x7f4938010a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:15.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494659c700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49481423b0 0x7f494812cbd0 secure :-1 s=THROTTLE_DONE pgs=1928 cs=0 l=1 rx=0x7f4938002f70 tx=0x7f4938010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:15.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f49377fe700 1 -- 172.21.15.63:0/2915603046 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4938007180 con 0x7f49481423b0 2020-05-18T21:37:15.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494659c700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49481423b0 0x7f494812cbd0 secure :-1 s=THROTTLE_DONE pgs=1928 cs=0 l=1 rx=0x7f4938002f70 tx=0x7f4938010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:15.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494659c700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49481423b0 0x7f494812cbd0 secure :-1 s=THROTTLE_DONE pgs=1928 cs=0 l=1 rx=0x7f4938002f70 tx=0x7f4938010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:15.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f49377fe700 1 -- 172.21.15.63:0/2915603046 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49380072e0 con 0x7f49481423b0 2020-05-18T21:37:15.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494759e700 1 -- 172.21.15.63:0/2915603046 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4948142790 con 0x7f49481423b0 2020-05-18T21:37:15.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f49377fe700 1 -- 172.21.15.63:0/2915603046 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49380080e0 con 0x7f49481423b0 2020-05-18T21:37:15.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.801+0000 7f494759e700 1 -- 172.21.15.63:0/2915603046 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4948140cf0 con 0x7f49481423b0 2020-05-18T21:37:15.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.805+0000 7f494659c700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49481423b0 0x7f494812cbd0 secure :-1 s=THROTTLE_DONE pgs=1928 cs=0 l=1 rx=0x7f4938002f70 tx=0x7f4938010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:15.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.805+0000 7f494759e700 1 -- 172.21.15.63:0/2915603046 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494812f180 con 0x7f49481423b0 2020-05-18T21:37:15.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.805+0000 7f49377fe700 1 -- 172.21.15.63:0/2915603046 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4938008350 con 0x7f49481423b0 2020-05-18T21:37:15.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.805+0000 7f494659c700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49481423b0 0x7f494812cbd0 secure :-1 s=THROTTLE_DONE pgs=1928 cs=0 l=1 rx=0x7f4938002f70 tx=0x7f4938010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:15.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.805+0000 7f49377fe700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f492404fdb0 0x7f4924052270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:15.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.805+0000 7f49377fe700 1 -- 172.21.15.63:0/2915603046 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f4938063920 con 0x7f49481423b0 2020-05-18T21:37:15.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.805+0000 7f4945d9b700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f492404fdb0 0x7f4924052270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:15.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.805+0000 7f4945d9b700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f492404fdb0 0x7f4924052270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f493c00c7e0 tx=0x7f4948060630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:15.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.809+0000 7f4945d9b700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f492404fdb0 0x7f4924052270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f493c00c7e0 tx=0x7f4948060630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:15.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.809+0000 7f4945d9b700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f492404fdb0 0x7f4924052270 secure :-1 s=READY pgs=750 cs=0 l=1 rx=0x7f493c00c7e0 tx=0x7f4948060630).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:15.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.813+0000 7f494659c700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49481423b0 0x7f494812cbd0 secure :-1 s=THROTTLE_DONE pgs=1928 cs=0 l=1 rx=0x7f4938002f70 tx=0x7f4938010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:15.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.813+0000 7f49377fe700 1 -- 172.21.15.63:0/2915603046 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f493803dcb0 con 0x7f49481423b0 2020-05-18T21:37:15.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.965+0000 7f494759e700 1 -- 172.21.15.63:0/2915603046 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4948140380 con 0x7f49481423b0 2020-05-18T21:37:15.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.969+0000 7f494659c700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49481423b0 0x7f494812cbd0 secure :-1 s=THROTTLE_DONE pgs=1928 cs=0 l=1 rx=0x7f4938002f70 tx=0x7f4938010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:15.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.969+0000 7f49377fe700 1 -- 172.21.15.63:0/2915603046 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v54) v1 ==== 80+0+4513 (secure 0 0 0) 0x7f49380412d0 con 0x7f49481423b0 2020-05-18T21:37:15.974 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:15.974 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:37:15.974 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_dump": [ 2020-05-18T21:37:15.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:15.974 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.a", 2020-05-18T21:37:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJekJyyLRAAfB5XJCsXTAmZdkFOaQrokg==", 2020-05-18T21:37:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:37:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:15.976 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:15.976 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:15.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:15.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:15.976 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.b", 2020-05-18T21:37:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeSVE8MRAAEEytuzLtcQMC+1uQ/yh8eA==", 2020-05-18T21:37:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:37:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:15.978 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:15.978 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:15.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:15.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:15.978 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.0", 2020-05-18T21:37:15.979 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBq/cJeIn7mJhAArx+YEdVbsfXXNOLWdaAgWw==", 2020-05-18T21:37:15.979 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:15.979 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:15.979 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:15.979 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.1", 2020-05-18T21:37:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBt/cJelHywCRAAFyQ3sPEE0RTSy4tKfsDfyw==", 2020-05-18T21:37:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.2", 2020-05-18T21:37:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBv/cJecexDLBAAxhlFq20MBkKvDjuM1yi8XQ==", 2020-05-18T21:37:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:15.983 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:15.983 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:15.983 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:15.983 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.3", 2020-05-18T21:37:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBy/cJe9IqwDxAAMg1In7bIITDcOZljzzTpDQ==", 2020-05-18T21:37:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:15.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:15.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:15.986 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.4", 2020-05-18T21:37:15.986 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB3/cJeLXgxFhAA/kMVV5hCRny2uXKvvbu8Og==", 2020-05-18T21:37:15.987 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:15.987 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:15.987 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:15.987 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:15.988 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:15.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:15.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:15.988 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.5", 2020-05-18T21:37:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB5/cJeucpsNRAAjGh+6yUC8Fji9PE4COi/Eg==", 2020-05-18T21:37:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:15.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:15.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:15.990 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.6", 2020-05-18T21:37:15.990 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB8/cJelSPpGhAAXobGqH9qaW1VZfEpH8bUbQ==", 2020-05-18T21:37:15.990 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:15.992 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.7", 2020-05-18T21:37:15.992 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB+/cJeUIl5OBAAPd8H8ohOWZw9ubO7uCB6zg==", 2020-05-18T21:37:15.992 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:15.992 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.0", 2020-05-18T21:37:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeap3RNhAAi2vKpsKtzSL1Uuqm8pWYJQ==", 2020-05-18T21:37:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:37:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:37:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:37:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.1", 2020-05-18T21:37:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJeekrQABAA5TmzWOt24C6hgZw/WTj5dw==", 2020-05-18T21:37:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:37:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:37:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:37:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.2", 2020-05-18T21:37:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJehSnFAxAAXUZwqNTXqAApEB3nXs4u6g==", 2020-05-18T21:37:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:37:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:37:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:37:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:16.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:16.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:16.000 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.3", 2020-05-18T21:37:16.000 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJe2HdDBhAA07y5pn/bKKa9TBbZFvIh9g==", 2020-05-18T21:37:16.001 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:16.001 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:37:16.001 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:37:16.001 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:37:16.001 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:16.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:16.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:16.002 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.admin", 2020-05-18T21:37:16.002 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJe/K4fGRAA+rP3BYuWiyx/fKmQ3bV6Lw==", 2020-05-18T21:37:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:37:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:16.004 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:16.004 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:16.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:16.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:16.005 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.x", 2020-05-18T21:37:16.005 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJemmqEKhAAe5ySRz8Id0ug4matQwL0uw==", 2020-05-18T21:37:16.005 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:16.005 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:37:16.006 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:37:16.006 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:16.006 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:16.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.y", 2020-05-18T21:37:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeF/BNJhAAi/vrldC6qoWJWnSHpE3ung==", 2020-05-18T21:37:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:37:16.008 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:37:16.008 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:16.008 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:16.008 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:16.008 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:16.008 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:37:16.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.969+0000 7f494759e700 1 -- 172.21.15.63:0/2915603046 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f492404fdb0 msgr2=0x7f4924052270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.969+0000 7f494759e700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f492404fdb0 0x7f4924052270 secure :-1 s=READY pgs=750 cs=0 l=1 rx=0x7f493c00c7e0 tx=0x7f4948060630).stop 2020-05-18T21:37:16.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.969+0000 7f494759e700 1 -- 172.21.15.63:0/2915603046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49481423b0 msgr2=0x7f494812cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.969+0000 7f494759e700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49481423b0 0x7f494812cbd0 secure :-1 s=READY pgs=1928 cs=0 l=1 rx=0x7f4938002f70 tx=0x7f4938010a30).stop 2020-05-18T21:37:16.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.969+0000 7f494759e700 1 -- 172.21.15.63:0/2915603046 shutdown_connections 2020-05-18T21:37:16.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.969+0000 7f494759e700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f492404fdb0 0x7f4924052270 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:16.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.969+0000 7f494759e700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f494812bee0 0x7f4948140670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:16.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.969+0000 7f494759e700 1 --2- 172.21.15.63:0/2915603046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49481423b0 0x7f494812cbd0 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:16.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.969+0000 7f494759e700 1 -- 172.21.15.63:0/2915603046 >> 172.21.15.63:0/2915603046 conn(0x7f4948069fc0 msgr2=0x7f4948061ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:16.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.969+0000 7f494759e700 1 -- 172.21.15.63:0/2915603046 shutdown_connections 2020-05-18T21:37:16.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:15.969+0000 7f494759e700 1 -- 172.21.15.63:0/2915603046 wait complete. 2020-05-18T21:37:16.013 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:37:16.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d6dec700 1 Processor -- start 2020-05-18T21:37:16.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d6dec700 1 -- start start 2020-05-18T21:37:16.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d6dec700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb6d005bda0 0x7fb6d0142f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:16.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d6dec700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb6d012ba80 0x7fb6d012bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:16.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d6dec700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d005ab40 con 0x7fb6d00652b0 2020-05-18T21:37:16.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d6dec700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d00b6a10 con 0x7fb6d012ba80 2020-05-18T21:37:16.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d6dec700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d005ade0 con 0x7fb6d005bda0 2020-05-18T21:37:16.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d5389700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb6d012ba80 0x7fb6d012bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:16.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d5389700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb6d012ba80 0x7fb6d012bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35362/0 (socket says 172.21.15.63:35362) 2020-05-18T21:37:16.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6cffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb6d005bda0 0x7fb6d0142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:16.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d5389700 1 -- 172.21.15.63:0/2971608101 learned_addr learned my addr 172.21.15.63:0/2971608101 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:16.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d4b88700 1 --1- 172.21.15.63:0/2971608101 >> v1:172.21.15.155:6789/0 conn(0x7fb6d00652b0 0x7fb6d01400d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:35862/0 (socket says 172.21.15.63:35862) 2020-05-18T21:37:16.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6cf7fe700 1 -- 172.21.15.63:0/2971608101 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592077164 0 0) 0x7fb6d005ab40 con 0x7fb6d00652b0 2020-05-18T21:37:16.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d5389700 1 -- 172.21.15.63:0/2971608101 >> v2:172.21.15.155:3300/0 conn(0x7fb6d005bda0 msgr2=0x7fb6d0142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:16.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d5389700 1 --2- 172.21.15.63:0/2971608101 >> v2:172.21.15.155:3300/0 conn(0x7fb6d005bda0 0x7fb6d0142f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:16.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d5389700 1 -- 172.21.15.63:0/2971608101 >> v1:172.21.15.155:6789/0 conn(0x7fb6d00652b0 legacy=0x7fb6d01400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d5389700 1 -- 172.21.15.63:0/2971608101 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d005b080 con 0x7fb6d012ba80 2020-05-18T21:37:16.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d5389700 1 --2- 172.21.15.63:0/2971608101 >> v2:172.21.15.63:3300/0 conn(0x7fb6d012ba80 0x7fb6d012bf30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb6c0002f70 tx=0x7fb6c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d5389700 1 --2- 172.21.15.63:0/2971608101 >> v2:172.21.15.63:3300/0 conn(0x7fb6d012ba80 0x7fb6d012bf30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb6c0002f70 tx=0x7fb6c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d5389700 1 --2- 172.21.15.63:0/2971608101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6d012ba80 0x7fb6d012bf30 secure :-1 s=READY pgs=1929 cs=0 l=1 rx=0x7fb6c0002f70 tx=0x7fb6c0007a80).ready entity=mon.0 client_cookie=37c65e99a1c0e307 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:16.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d5389700 1 --2- 172.21.15.63:0/2971608101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6d012ba80 0x7fb6d012bf30 secure :-1 s=THROTTLE_DONE pgs=1929 cs=0 l=1 rx=0x7fb6c0002f70 tx=0x7fb6c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6cf7fe700 1 -- 172.21.15.63:0/2971608101 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6c00116b0 con 0x7fb6d012ba80 2020-05-18T21:37:16.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d5389700 1 --2- 172.21.15.63:0/2971608101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6d012ba80 0x7fb6d012bf30 secure :-1 s=THROTTLE_DONE pgs=1929 cs=0 l=1 rx=0x7fb6c0002f70 tx=0x7fb6c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6cf7fe700 1 -- 172.21.15.63:0/2971608101 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c0011810 con 0x7fb6d012ba80 2020-05-18T21:37:16.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d5389700 1 --2- 172.21.15.63:0/2971608101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6d012ba80 0x7fb6d012bf30 secure :-1 s=THROTTLE_DONE pgs=1929 cs=0 l=1 rx=0x7fb6c0002f70 tx=0x7fb6c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6cf7fe700 1 -- 172.21.15.63:0/2971608101 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6c0011bf0 con 0x7fb6d012ba80 2020-05-18T21:37:16.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d6dec700 1 -- 172.21.15.63:0/2971608101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6d012ba80 msgr2=0x7fb6d012bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d6dec700 1 --2- 172.21.15.63:0/2971608101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6d012ba80 0x7fb6d012bf30 secure :-1 s=READY pgs=1929 cs=0 l=1 rx=0x7fb6c0002f70 tx=0x7fb6c0007a80).stop 2020-05-18T21:37:16.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d6dec700 1 -- 172.21.15.63:0/2971608101 shutdown_connections 2020-05-18T21:37:16.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d6dec700 1 --2- 172.21.15.63:0/2971608101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6d012ba80 0x7fb6d012bf30 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:16.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d6dec700 1 --2- 172.21.15.63:0/2971608101 >> v2:172.21.15.155:3300/0 conn(0x7fb6d005bda0 0x7fb6d0142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:16.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.113+0000 7fb6d6dec700 1 -- 172.21.15.63:0/2971608101 >> 172.21.15.63:0/2971608101 conn(0x7fb6d0066ed0 msgr2=0x7fb6d00b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:16.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.117+0000 7fb6d6dec700 1 -- 172.21.15.63:0/2971608101 shutdown_connections 2020-05-18T21:37:16.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.117+0000 7fb6d6dec700 1 -- 172.21.15.63:0/2971608101 wait complete. 2020-05-18T21:37:16.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.117+0000 7fb6d6dec700 1 Processor -- start 2020-05-18T21:37:16.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.117+0000 7fb6d6dec700 1 -- start start 2020-05-18T21:37:16.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6d6dec700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6d00652b0 0x7fb6d01425d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:16.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6d6dec700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d0157880 con 0x7fb6d005bda0 2020-05-18T21:37:16.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6d6dec700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d0153580 con 0x7fb6d012ba80 2020-05-18T21:37:16.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6d6dec700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d01543d0 con 0x7fb6d00652b0 2020-05-18T21:37:16.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6d4b88700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb6d005bda0 0x7fb6d0153cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37552/0 (socket says 172.21.15.63:37552) 2020-05-18T21:37:16.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6d4b88700 1 -- 172.21.15.63:0/1226330324 learned_addr learned my addr 172.21.15.63:0/1226330324 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:16.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6cffff700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6d00652b0 0x7fb6d01425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:16.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6cdffb700 1 -- 172.21.15.63:0/1226330324 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2146250215 0 0) 0x7fb6d0157880 con 0x7fb6d005bda0 2020-05-18T21:37:16.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6cdffb700 1 -- 172.21.15.63:0/1226330324 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6b4002fe0 con 0x7fb6d005bda0 2020-05-18T21:37:16.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6cdffb700 1 -- 172.21.15.63:0/1226330324 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582268301 0 0) 0x7fb6d0153580 con 0x7fb6d012ba80 2020-05-18T21:37:16.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6cdffb700 1 -- 172.21.15.63:0/1226330324 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6d0157880 con 0x7fb6d012ba80 2020-05-18T21:37:16.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6cffff700 1 -- 172.21.15.63:0/1226330324 >> v1:172.21.15.155:6789/0 conn(0x7fb6d012ba80 legacy=0x7fb6d00af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6cffff700 1 -- 172.21.15.63:0/1226330324 >> v1:172.21.15.63:6789/0 conn(0x7fb6d005bda0 legacy=0x7fb6d0153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6cffff700 1 -- 172.21.15.63:0/1226330324 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d0153820 con 0x7fb6d00652b0 2020-05-18T21:37:16.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6cffff700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6d00652b0 0x7fb6d01425d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb6c80032f0 tx=0x7fb6c8010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6cffff700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6d00652b0 0x7fb6d01425d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb6c80032f0 tx=0x7fb6c8010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6cffff700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6d00652b0 0x7fb6d01425d0 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7fb6c80032f0 tx=0x7fb6c8010f80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:16.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6cffff700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6d00652b0 0x7fb6d01425d0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fb6c80032f0 tx=0x7fb6c8010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6cdffb700 1 -- 172.21.15.63:0/1226330324 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6c8005a80 con 0x7fb6d00652b0 2020-05-18T21:37:16.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6cffff700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6d00652b0 0x7fb6d01425d0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fb6c80032f0 tx=0x7fb6c8010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6d6dec700 1 -- 172.21.15.63:0/1226330324 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d00ae300 con 0x7fb6d00652b0 2020-05-18T21:37:16.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6cdffb700 1 -- 172.21.15.63:0/1226330324 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c8005be0 con 0x7fb6d00652b0 2020-05-18T21:37:16.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6cffff700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6d00652b0 0x7fb6d01425d0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fb6c80032f0 tx=0x7fb6c8010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6cdffb700 1 -- 172.21.15.63:0/1226330324 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6c8012990 con 0x7fb6d00652b0 2020-05-18T21:37:16.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6d6dec700 1 -- 172.21.15.63:0/1226330324 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d00b0070 con 0x7fb6d00652b0 2020-05-18T21:37:16.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6cffff700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6d00652b0 0x7fb6d01425d0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fb6c80032f0 tx=0x7fb6c8010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.121+0000 7fb6d6dec700 1 -- 172.21.15.63:0/1226330324 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d01539b0 con 0x7fb6d00652b0 2020-05-18T21:37:16.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.125+0000 7fb6cdffb700 1 -- 172.21.15.63:0/1226330324 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb6c8012af0 con 0x7fb6d00652b0 2020-05-18T21:37:16.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.125+0000 7fb6cffff700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6d00652b0 0x7fb6d01425d0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fb6c80032f0 tx=0x7fb6c8010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.125+0000 7fb6cdffb700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb6b404fe80 0x7fb6b4052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:16.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.125+0000 7fb6cdffb700 1 -- 172.21.15.63:0/1226330324 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb6c8063ae0 con 0x7fb6d00652b0 2020-05-18T21:37:16.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.125+0000 7fb6d4b88700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb6b404fe80 0x7fb6b4052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:16.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.125+0000 7fb6d4b88700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb6b404fe80 0x7fb6b4052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb6b8001030 tx=0x7fb6b80017c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.125+0000 7fb6d4b88700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb6b404fe80 0x7fb6b4052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb6b8001030 tx=0x7fb6b80017c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.125+0000 7fb6d4b88700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb6b404fe80 0x7fb6b4052340 secure :-1 s=READY pgs=751 cs=0 l=1 rx=0x7fb6b8001030 tx=0x7fb6b80017c0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:16.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.133+0000 7fb6cffff700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6d00652b0 0x7fb6d01425d0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fb6c80032f0 tx=0x7fb6c8010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.133+0000 7fb6cdffb700 1 -- 172.21.15.63:0/1226330324 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb6c803de10 con 0x7fb6d00652b0 2020-05-18T21:37:16.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.249+0000 7fb6d6dec700 1 -- 172.21.15.63:0/1226330324 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6d00569e0 con 0x7fb6d00652b0 2020-05-18T21:37:16.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.253+0000 7fb6cffff700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6d00652b0 0x7fb6d01425d0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fb6c80032f0 tx=0x7fb6c8010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.253+0000 7fb6cdffb700 1 -- 172.21.15.63:0/1226330324 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+13242 (secure 0 0 0) 0x7fb6c8041430 con 0x7fb6d00652b0 2020-05-18T21:37:16.259 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:16.259 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":141,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:37:15.654995+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:37:16.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.253+0000 7fb6d6dec700 1 -- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb6b404fe80 msgr2=0x7fb6b4052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.253+0000 7fb6d6dec700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb6b404fe80 0x7fb6b4052340 secure :-1 s=READY pgs=751 cs=0 l=1 rx=0x7fb6b8001030 tx=0x7fb6b80017c0).stop 2020-05-18T21:37:16.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.253+0000 7fb6d6dec700 1 -- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6d00652b0 msgr2=0x7fb6d01425d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.253+0000 7fb6d6dec700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6d00652b0 0x7fb6d01425d0 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7fb6c80032f0 tx=0x7fb6c8010f80).stop 2020-05-18T21:37:16.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.257+0000 7fb6d6dec700 1 -- 172.21.15.63:0/1226330324 shutdown_connections 2020-05-18T21:37:16.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.257+0000 7fb6d6dec700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb6b404fe80 0x7fb6b4052340 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:16.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.257+0000 7fb6d6dec700 1 --2- 172.21.15.63:0/1226330324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6d00652b0 0x7fb6d01425d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:16.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.257+0000 7fb6d6dec700 1 -- 172.21.15.63:0/1226330324 >> 172.21.15.63:0/1226330324 conn(0x7fb6d0066ed0 msgr2=0x7fb6d013f590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:16.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.257+0000 7fb6d6dec700 1 -- 172.21.15.63:0/1226330324 shutdown_connections 2020-05-18T21:37:16.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.257+0000 7fb6d6dec700 1 -- 172.21.15.63:0/1226330324 wait complete. 2020-05-18T21:37:16.276 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-05-18T21:37:16.277 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:37:16.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.377+0000 7f55b6788700 1 Processor -- start 2020-05-18T21:37:16.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.377+0000 7f55b6788700 1 -- start start 2020-05-18T21:37:16.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55b6788700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f55b00b6d70 0x7f55b0145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:16.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55b6788700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b0143810 con 0x7f55b00b7bf0 2020-05-18T21:37:16.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55b6788700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b00b7210 con 0x7f55b0143430 2020-05-18T21:37:16.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55b6788700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b00b74b0 con 0x7f55b00b6d70 2020-05-18T21:37:16.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55af7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f55b00b6d70 0x7f55b0145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:16.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55af7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f55b00b6d70 0x7f55b0145dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35374/0 (socket says 172.21.15.63:35374) 2020-05-18T21:37:16.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55af7fe700 1 -- 172.21.15.63:0/2624090920 learned_addr learned my addr 172.21.15.63:0/2624090920 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:16.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55af7fe700 1 -- 172.21.15.63:0/2624090920 >> v1:172.21.15.155:6789/0 conn(0x7f55b0143430 legacy=0x7f55b00b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55af7fe700 1 -- 172.21.15.63:0/2624090920 >> v1:172.21.15.63:6789/0 conn(0x7f55b00b7bf0 legacy=0x7f55b00b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55aeffd700 1 -- 172.21.15.63:0/2624090920 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158783070 0 0) 0x7f55b0143810 con 0x7f55b00b7bf0 2020-05-18T21:37:16.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55af7fe700 1 -- 172.21.15.63:0/2624090920 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b00b7750 con 0x7f55b00b6d70 2020-05-18T21:37:16.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55af7fe700 1 --2- 172.21.15.63:0/2624090920 >> v2:172.21.15.63:3300/0 conn(0x7f55b00b6d70 0x7f55b0145dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f55a4002f70 tx=0x7f55b005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55af7fe700 1 --2- 172.21.15.63:0/2624090920 >> v2:172.21.15.63:3300/0 conn(0x7f55b00b6d70 0x7f55b0145dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f55a4002f70 tx=0x7f55b005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55af7fe700 1 --2- 172.21.15.63:0/2624090920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55b00b6d70 0x7f55b0145dd0 secure :-1 s=READY pgs=1932 cs=0 l=1 rx=0x7f55a4002f70 tx=0x7f55b005ab60).ready entity=mon.0 client_cookie=84fa164769b31977 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:16.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55af7fe700 1 --2- 172.21.15.63:0/2624090920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55b00b6d70 0x7f55b0145dd0 secure :-1 s=THROTTLE_DONE pgs=1932 cs=0 l=1 rx=0x7f55a4002f70 tx=0x7f55b005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55af7fe700 1 --2- 172.21.15.63:0/2624090920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55b00b6d70 0x7f55b0145dd0 secure :-1 s=THROTTLE_DONE pgs=1932 cs=0 l=1 rx=0x7f55a4002f70 tx=0x7f55b005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55af7fe700 1 --2- 172.21.15.63:0/2624090920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55b00b6d70 0x7f55b0145dd0 secure :-1 s=THROTTLE_DONE pgs=1932 cs=0 l=1 rx=0x7f55a4002f70 tx=0x7f55b005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55aeffd700 1 -- 172.21.15.63:0/2624090920 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55a4011760 con 0x7f55b00b6d70 2020-05-18T21:37:16.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55aeffd700 1 -- 172.21.15.63:0/2624090920 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a40118c0 con 0x7f55b00b6d70 2020-05-18T21:37:16.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55aeffd700 1 -- 172.21.15.63:0/2624090920 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55a4011ce0 con 0x7f55b00b6d70 2020-05-18T21:37:16.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55b6788700 1 -- 172.21.15.63:0/2624090920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55b00b6d70 msgr2=0x7f55b0145dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55b6788700 1 --2- 172.21.15.63:0/2624090920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55b00b6d70 0x7f55b0145dd0 secure :-1 s=READY pgs=1932 cs=0 l=1 rx=0x7f55a4002f70 tx=0x7f55b005ab60).stop 2020-05-18T21:37:16.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55b6788700 1 -- 172.21.15.63:0/2624090920 shutdown_connections 2020-05-18T21:37:16.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55b6788700 1 --2- 172.21.15.63:0/2624090920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55b00b6d70 0x7f55b0145dd0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:16.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55b6788700 1 -- 172.21.15.63:0/2624090920 >> 172.21.15.63:0/2624090920 conn(0x7f55b0069b70 msgr2=0x7f55b0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:16.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55b6788700 1 -- 172.21.15.63:0/2624090920 shutdown_connections 2020-05-18T21:37:16.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.381+0000 7f55b6788700 1 -- 172.21.15.63:0/2624090920 wait complete. 2020-05-18T21:37:16.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55b6788700 1 Processor -- start 2020-05-18T21:37:16.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55b6788700 1 -- start start 2020-05-18T21:37:16.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55b6788700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55b00b6d70 0x7f55b00bbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:16.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55b6788700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b00b7bf0 0x7f55b00ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:16.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55b6788700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b00bc230 con 0x7f55b0143430 2020-05-18T21:37:16.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55b6788700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b0140e80 con 0x7f55b00b6d70 2020-05-18T21:37:16.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55b6788700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b0141120 con 0x7f55b00b7bf0 2020-05-18T21:37:16.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55b4d25700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f55b0143430 0x7f55b013e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37570/0 (socket says 172.21.15.63:37570) 2020-05-18T21:37:16.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55b4d25700 1 -- 172.21.15.63:0/1640683139 learned_addr learned my addr 172.21.15.63:0/1640683139 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:16.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55af7fe700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b00b7bf0 0x7f55b00ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:16.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55affff700 1 --2- 172.21.15.63:0/1640683139 >> v2:172.21.15.155:3300/0 conn(0x7f55b00b6d70 0x7f55b00bbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:16.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55ad7fa700 1 -- 172.21.15.63:0/1640683139 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646146033 0 0) 0x7f55b00bc230 con 0x7f55b0143430 2020-05-18T21:37:16.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55ad7fa700 1 -- 172.21.15.63:0/1640683139 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5590002fe0 con 0x7f55b0143430 2020-05-18T21:37:16.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55af7fe700 1 -- 172.21.15.63:0/1640683139 >> v2:172.21.15.155:3300/0 conn(0x7f55b00b6d70 msgr2=0x7f55b00bbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55af7fe700 1 --2- 172.21.15.63:0/1640683139 >> v2:172.21.15.155:3300/0 conn(0x7f55b00b6d70 0x7f55b00bbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:16.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55af7fe700 1 -- 172.21.15.63:0/1640683139 >> v1:172.21.15.63:6789/0 conn(0x7f55b0143430 legacy=0x7f55b013e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55ad7fa700 1 -- 172.21.15.63:0/1640683139 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2685647963 0 0) 0x7f5590002fe0 con 0x7f55b0143430 2020-05-18T21:37:16.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55af7fe700 1 -- 172.21.15.63:0/1640683139 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b01413c0 con 0x7f55b00b7bf0 2020-05-18T21:37:16.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55af7fe700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b00b7bf0 0x7f55b00ac4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f55a8001e00 tx=0x7f55b005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55af7fe700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b00b7bf0 0x7f55b00ac4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f55a8001e00 tx=0x7f55b005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55af7fe700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b00b7bf0 0x7f55b00ac4d0 secure :-1 s=READY pgs=292 cs=0 l=1 rx=0x7f55a8001e00 tx=0x7f55b005ab60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:16.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55af7fe700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b00b7bf0 0x7f55b00ac4d0 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f55a8001e00 tx=0x7f55b005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55ad7fa700 1 -- 172.21.15.63:0/1640683139 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55a8001c60 con 0x7f55b00b7bf0 2020-05-18T21:37:16.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55af7fe700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b00b7bf0 0x7f55b00ac4d0 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f55a8001e00 tx=0x7f55b005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55ad7fa700 1 -- 172.21.15.63:0/1640683139 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a4011e80 con 0x7f55b00b7bf0 2020-05-18T21:37:16.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55b6788700 1 -- 172.21.15.63:0/1640683139 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b00ac930 con 0x7f55b00b7bf0 2020-05-18T21:37:16.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55af7fe700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b00b7bf0 0x7f55b00ac4d0 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f55a8001e00 tx=0x7f55b005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.385+0000 7f55ad7fa700 1 -- 172.21.15.63:0/1640683139 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55a40087d0 con 0x7f55b00b7bf0 2020-05-18T21:37:16.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.389+0000 7f55b6788700 1 -- 172.21.15.63:0/1640683139 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b0141860 con 0x7f55b00b7bf0 2020-05-18T21:37:16.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.389+0000 7f55b6788700 1 -- 172.21.15.63:0/1640683139 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b0141550 con 0x7f55b00b7bf0 2020-05-18T21:37:16.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.389+0000 7f55af7fe700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b00b7bf0 0x7f55b00ac4d0 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f55a8001e00 tx=0x7f55b005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.389+0000 7f55af7fe700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b00b7bf0 0x7f55b00ac4d0 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f55a8001e00 tx=0x7f55b005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.389+0000 7f55ad7fa700 1 -- 172.21.15.63:0/1640683139 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f55a4007360 con 0x7f55b00b7bf0 2020-05-18T21:37:16.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.389+0000 7f55ad7fa700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f559004fcf0 0x7f55900521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:16.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.389+0000 7f55ad7fa700 1 -- 172.21.15.63:0/1640683139 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f55a4064040 con 0x7f55b00b7bf0 2020-05-18T21:37:16.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.389+0000 7f55affff700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f559004fcf0 0x7f55900521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:16.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.389+0000 7f55affff700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f559004fcf0 0x7f55900521b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f55b00b8cd0 tx=0x7f55a0003e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.389+0000 7f55affff700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f559004fcf0 0x7f55900521b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f55b00b8cd0 tx=0x7f55a0003e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.389+0000 7f55affff700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f559004fcf0 0x7f55900521b0 secure :-1 s=READY pgs=752 cs=0 l=1 rx=0x7f55b00b8cd0 tx=0x7f55a0003e20).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:16.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.397+0000 7f55af7fe700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b00b7bf0 0x7f55b00ac4d0 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f55a8001e00 tx=0x7f55b005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.397+0000 7f55ad7fa700 1 -- 172.21.15.63:0/1640683139 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f55a403e3f0 con 0x7f55b00b7bf0 2020-05-18T21:37:16.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.517+0000 7f55b6788700 1 -- 172.21.15.63:0/1640683139 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f55b00569e0 con 0x7f55b00b7bf0 2020-05-18T21:37:16.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.517+0000 7f55af7fe700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b00b7bf0 0x7f55b00ac4d0 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f55a8001e00 tx=0x7f55b005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.517+0000 7f55ad7fa700 1 -- 172.21.15.63:0/1640683139 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v141) v1 ==== 110+0+10 (secure 0 0 0) 0x7f55a4041a10 con 0x7f55b00b7bf0 2020-05-18T21:37:16.527 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:37:16.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.521+0000 7f55b6788700 1 -- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f559004fcf0 msgr2=0x7f55900521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.521+0000 7f55b6788700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f559004fcf0 0x7f55900521b0 secure :-1 s=READY pgs=752 cs=0 l=1 rx=0x7f55b00b8cd0 tx=0x7f55a0003e20).stop 2020-05-18T21:37:16.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.521+0000 7f55b6788700 1 -- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b00b7bf0 msgr2=0x7f55b00ac4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.521+0000 7f55b6788700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b00b7bf0 0x7f55b00ac4d0 secure :-1 s=READY pgs=292 cs=0 l=1 rx=0x7f55a8001e00 tx=0x7f55b005ab60).stop 2020-05-18T21:37:16.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.521+0000 7f55b6788700 1 -- 172.21.15.63:0/1640683139 shutdown_connections 2020-05-18T21:37:16.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.521+0000 7f55b6788700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f559004fcf0 0x7f55900521b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:16.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.521+0000 7f55b6788700 1 --2- 172.21.15.63:0/1640683139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b00b7bf0 0x7f55b00ac4d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:16.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.521+0000 7f55b6788700 1 --2- 172.21.15.63:0/1640683139 >> v2:172.21.15.155:3300/0 conn(0x7f55b00b6d70 0x7f55b00bbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:16.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.521+0000 7f55b6788700 1 -- 172.21.15.63:0/1640683139 >> 172.21.15.63:0/1640683139 conn(0x7f55b0069b70 msgr2=0x7f55b00b5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:16.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.521+0000 7f55b6788700 1 -- 172.21.15.63:0/1640683139 shutdown_connections 2020-05-18T21:37:16.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.521+0000 7f55b6788700 1 -- 172.21.15.63:0/1640683139 wait complete. 2020-05-18T21:37:16.537 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:37:16.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.629+0000 7f3f798dd700 1 Processor -- start 2020-05-18T21:37:16.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.629+0000 7f3f798dd700 1 -- start start 2020-05-18T21:37:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f798dd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f741469b0 0x7f3f74149d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f798dd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f74145fd0 con 0x7f3f740b99d0 2020-05-18T21:37:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f798dd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f74146270 con 0x7f3f740b68d0 2020-05-18T21:37:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f798dd700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f74146510 con 0x7f3f741469b0 2020-05-18T21:37:16.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f6bfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3f740b99d0 0x7f3f74060430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37576/0 (socket says 172.21.15.63:37576) 2020-05-18T21:37:16.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f6bfff700 1 -- 172.21.15.63:0/845369598 learned_addr learned my addr 172.21.15.63:0/845369598 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:16.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f790dc700 1 --2- 172.21.15.63:0/845369598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f741469b0 0x7f3f74149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:16.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f6b7fe700 1 -- 172.21.15.63:0/845369598 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091423063 0 0) 0x7f3f74145fd0 con 0x7f3f740b99d0 2020-05-18T21:37:16.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f6b7fe700 1 -- 172.21.15.63:0/845369598 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f60003270 con 0x7f3f740b99d0 2020-05-18T21:37:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f6b7fe700 1 -- 172.21.15.63:0/845369598 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945333399 0 0) 0x7f3f74146270 con 0x7f3f740b68d0 2020-05-18T21:37:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f6b7fe700 1 -- 172.21.15.63:0/845369598 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f74145fd0 con 0x7f3f740b68d0 2020-05-18T21:37:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f790dc700 1 -- 172.21.15.63:0/845369598 >> v1:172.21.15.155:6789/0 conn(0x7f3f740b68d0 legacy=0x7f3f740b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f790dc700 1 -- 172.21.15.63:0/845369598 >> v1:172.21.15.63:6789/0 conn(0x7f3f740b99d0 legacy=0x7f3f74060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f790dc700 1 -- 172.21.15.63:0/845369598 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f740b6cb0 con 0x7f3f741469b0 2020-05-18T21:37:16.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f790dc700 1 --2- 172.21.15.63:0/845369598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f741469b0 0x7f3f74149d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3f6c0032f0 tx=0x7f3f6c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f790dc700 1 --2- 172.21.15.63:0/845369598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f741469b0 0x7f3f74149d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3f6c0032f0 tx=0x7f3f6c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f790dc700 1 --2- 172.21.15.63:0/845369598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f741469b0 0x7f3f74149d40 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7f3f6c0032f0 tx=0x7f3f6c008ca0).ready entity=mon.2 client_cookie=85f0c6feed7057a5 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:16.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f790dc700 1 --2- 172.21.15.63:0/845369598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f741469b0 0x7f3f74149d40 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f3f6c0032f0 tx=0x7f3f6c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f6b7fe700 1 -- 172.21.15.63:0/845369598 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f6c011df0 con 0x7f3f741469b0 2020-05-18T21:37:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f790dc700 1 --2- 172.21.15.63:0/845369598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f741469b0 0x7f3f74149d40 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f3f6c0032f0 tx=0x7f3f6c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f6b7fe700 1 -- 172.21.15.63:0/845369598 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6c00a180 con 0x7f3f741469b0 2020-05-18T21:37:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f790dc700 1 --2- 172.21.15.63:0/845369598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f741469b0 0x7f3f74149d40 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f3f6c0032f0 tx=0x7f3f6c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f6b7fe700 1 -- 172.21.15.63:0/845369598 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f6c00a4e0 con 0x7f3f741469b0 2020-05-18T21:37:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f798dd700 1 -- 172.21.15.63:0/845369598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f741469b0 msgr2=0x7f3f74149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.633+0000 7f3f798dd700 1 --2- 172.21.15.63:0/845369598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f741469b0 0x7f3f74149d40 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7f3f6c0032f0 tx=0x7f3f6c008ca0).stop 2020-05-18T21:37:16.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.637+0000 7f3f798dd700 1 -- 172.21.15.63:0/845369598 shutdown_connections 2020-05-18T21:37:16.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.637+0000 7f3f798dd700 1 --2- 172.21.15.63:0/845369598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f741469b0 0x7f3f74149d40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:16.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.637+0000 7f3f798dd700 1 -- 172.21.15.63:0/845369598 >> 172.21.15.63:0/845369598 conn(0x7f3f74069b70 msgr2=0x7f3f74069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:16.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.637+0000 7f3f798dd700 1 -- 172.21.15.63:0/845369598 shutdown_connections 2020-05-18T21:37:16.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.637+0000 7f3f798dd700 1 -- 172.21.15.63:0/845369598 wait complete. 2020-05-18T21:37:16.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.637+0000 7f3f798dd700 1 Processor -- start 2020-05-18T21:37:16.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.637+0000 7f3f798dd700 1 -- start start 2020-05-18T21:37:16.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f798dd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3f740b68d0 0x7f3f74147640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:16.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f798dd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f740b5680 con 0x7f3f740b99d0 2020-05-18T21:37:16.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f798dd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f74147aa0 con 0x7f3f741469b0 2020-05-18T21:37:16.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f798dd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f740b58b0 con 0x7f3f740b68d0 2020-05-18T21:37:16.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f6bfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3f740b99d0 0x7f3f740af8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37582/0 (socket says 172.21.15.63:37582) 2020-05-18T21:37:16.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f6bfff700 1 -- 172.21.15.63:0/1915987507 learned_addr learned my addr 172.21.15.63:0/1915987507 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:16.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f788db700 1 --2- 172.21.15.63:0/1915987507 >> v2:172.21.15.63:3300/0 conn(0x7f3f740b68d0 0x7f3f74147640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:16.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f69ffb700 1 -- 172.21.15.63:0/1915987507 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129004417 0 0) 0x7f3f740b5680 con 0x7f3f740b99d0 2020-05-18T21:37:16.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f69ffb700 1 -- 172.21.15.63:0/1915987507 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f54002fe0 con 0x7f3f740b99d0 2020-05-18T21:37:16.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f788db700 1 -- 172.21.15.63:0/1915987507 >> v1:172.21.15.155:6789/0 conn(0x7f3f741469b0 legacy=0x7f3f741568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f788db700 1 -- 172.21.15.63:0/1915987507 >> v1:172.21.15.63:6789/0 conn(0x7f3f740b99d0 legacy=0x7f3f740af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f788db700 1 -- 172.21.15.63:0/1915987507 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f740b5b50 con 0x7f3f740b68d0 2020-05-18T21:37:16.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f788db700 1 --2- 172.21.15.63:0/1915987507 >> v2:172.21.15.63:3300/0 conn(0x7f3f740b68d0 0x7f3f74147640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3f74143880 tx=0x7f3f70010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f788db700 1 --2- 172.21.15.63:0/1915987507 >> v2:172.21.15.63:3300/0 conn(0x7f3f740b68d0 0x7f3f74147640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3f74143880 tx=0x7f3f70010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f788db700 1 --2- 172.21.15.63:0/1915987507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f740b68d0 0x7f3f74147640 secure :-1 s=READY pgs=1936 cs=0 l=1 rx=0x7f3f74143880 tx=0x7f3f70010890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:16.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f788db700 1 --2- 172.21.15.63:0/1915987507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f740b68d0 0x7f3f74147640 secure :-1 s=THROTTLE_DONE pgs=1936 cs=0 l=1 rx=0x7f3f74143880 tx=0x7f3f70010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f69ffb700 1 -- 172.21.15.63:0/1915987507 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f70011ea0 con 0x7f3f740b68d0 2020-05-18T21:37:16.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f788db700 1 --2- 172.21.15.63:0/1915987507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f740b68d0 0x7f3f74147640 secure :-1 s=THROTTLE_DONE pgs=1936 cs=0 l=1 rx=0x7f3f74143880 tx=0x7f3f70010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f69ffb700 1 -- 172.21.15.63:0/1915987507 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f70006cf0 con 0x7f3f740b68d0 2020-05-18T21:37:16.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f788db700 1 --2- 172.21.15.63:0/1915987507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f740b68d0 0x7f3f74147640 secure :-1 s=THROTTLE_DONE pgs=1936 cs=0 l=1 rx=0x7f3f74143880 tx=0x7f3f70010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f69ffb700 1 -- 172.21.15.63:0/1915987507 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f70006e60 con 0x7f3f740b68d0 2020-05-18T21:37:16.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f798dd700 1 -- 172.21.15.63:0/1915987507 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f740b5df0 con 0x7f3f740b68d0 2020-05-18T21:37:16.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.641+0000 7f3f798dd700 1 -- 172.21.15.63:0/1915987507 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f74144b10 con 0x7f3f740b68d0 2020-05-18T21:37:16.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.645+0000 7f3f788db700 1 --2- 172.21.15.63:0/1915987507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f740b68d0 0x7f3f74147640 secure :-1 s=THROTTLE_DONE pgs=1936 cs=0 l=1 rx=0x7f3f74143880 tx=0x7f3f70010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.645+0000 7f3f798dd700 1 -- 172.21.15.63:0/1915987507 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f740b5f80 con 0x7f3f740b68d0 2020-05-18T21:37:16.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.645+0000 7f3f69ffb700 1 -- 172.21.15.63:0/1915987507 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3f70008370 con 0x7f3f740b68d0 2020-05-18T21:37:16.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.645+0000 7f3f788db700 1 --2- 172.21.15.63:0/1915987507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f740b68d0 0x7f3f74147640 secure :-1 s=THROTTLE_DONE pgs=1936 cs=0 l=1 rx=0x7f3f74143880 tx=0x7f3f70010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.645+0000 7f3f69ffb700 1 --2- 172.21.15.63:0/1915987507 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3f5404fd30 0x7f3f540521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:16.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.645+0000 7f3f69ffb700 1 -- 172.21.15.63:0/1915987507 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3f70063bf0 con 0x7f3f740b68d0 2020-05-18T21:37:16.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.645+0000 7f3f6bfff700 1 --2- 172.21.15.63:0/1915987507 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3f5404fd30 0x7f3f540521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:16.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.645+0000 7f3f6bfff700 1 --2- 172.21.15.63:0/1915987507 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3f5404fd30 0x7f3f540521f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3f64000f30 tx=0x7f3f640016d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.645+0000 7f3f6bfff700 1 --2- 172.21.15.63:0/1915987507 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3f5404fd30 0x7f3f540521f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3f64000f30 tx=0x7f3f640016d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.645+0000 7f3f6bfff700 1 --2- 172.21.15.63:0/1915987507 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3f5404fd30 0x7f3f540521f0 secure :-1 s=READY pgs=753 cs=0 l=1 rx=0x7f3f64000f30 tx=0x7f3f640016d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:16.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.653+0000 7f3f788db700 1 --2- 172.21.15.63:0/1915987507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f740b68d0 0x7f3f74147640 secure :-1 s=THROTTLE_DONE pgs=1936 cs=0 l=1 rx=0x7f3f74143880 tx=0x7f3f70010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.653+0000 7f3f69ffb700 1 -- 172.21.15.63:0/1915987507 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3f7003df20 con 0x7f3f740b68d0 2020-05-18T21:37:16.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.769+0000 7f3f798dd700 1 -- 172.21.15.63:0/1915987507 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3f740569e0 con 0x7f3f740b68d0 2020-05-18T21:37:16.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.769+0000 7f3f788db700 1 --2- 172.21.15.63:0/1915987507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f740b68d0 0x7f3f74147640 secure :-1 s=THROTTLE_DONE pgs=1936 cs=0 l=1 rx=0x7f3f74143880 tx=0x7f3f70010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.769+0000 7f3f69ffb700 1 -- 172.21.15.63:0/1915987507 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v141) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3f70041540 con 0x7f3f740b68d0 2020-05-18T21:37:16.777 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:37:16.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.773+0000 7f3f798dd700 1 -- 172.21.15.63:0/1915987507 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3f5404fd30 msgr2=0x7f3f540521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.773+0000 7f3f798dd700 1 --2- 172.21.15.63:0/1915987507 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3f5404fd30 0x7f3f540521f0 secure :-1 s=READY pgs=753 cs=0 l=1 rx=0x7f3f64000f30 tx=0x7f3f640016d0).stop 2020-05-18T21:37:16.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.773+0000 7f3f798dd700 1 -- 172.21.15.63:0/1915987507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f740b68d0 msgr2=0x7f3f74147640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.773+0000 7f3f798dd700 1 --2- 172.21.15.63:0/1915987507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f740b68d0 0x7f3f74147640 secure :-1 s=READY pgs=1936 cs=0 l=1 rx=0x7f3f74143880 tx=0x7f3f70010890).stop 2020-05-18T21:37:16.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.773+0000 7f3f798dd700 1 -- 172.21.15.63:0/1915987507 shutdown_connections 2020-05-18T21:37:16.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.773+0000 7f3f798dd700 1 --2- 172.21.15.63:0/1915987507 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3f5404fd30 0x7f3f540521f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:16.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.773+0000 7f3f798dd700 1 --2- 172.21.15.63:0/1915987507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f740b68d0 0x7f3f74147640 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:16.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.773+0000 7f3f798dd700 1 -- 172.21.15.63:0/1915987507 >> 172.21.15.63:0/1915987507 conn(0x7f3f74069b70 msgr2=0x7f3f740b7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:16.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.773+0000 7f3f798dd700 1 -- 172.21.15.63:0/1915987507 shutdown_connections 2020-05-18T21:37:16.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.773+0000 7f3f798dd700 1 -- 172.21.15.63:0/1915987507 wait complete. 2020-05-18T21:37:16.790 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-05-18T21:37:16.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.889+0000 7f6584df2700 1 Processor -- start 2020-05-18T21:37:16.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.889+0000 7f6584df2700 1 -- start start 2020-05-18T21:37:16.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.889+0000 7f6584df2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6580149980 0x7f65800b5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:16.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.889+0000 7f6584df2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6580149d60 0x7f65800b5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:16.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.889+0000 7f6584df2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f658014e050 0x7f658009e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:16.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.889+0000 7f6584df2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658014d6b0 con 0x7f658014e050 2020-05-18T21:37:16.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.889+0000 7f6584df2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658009d010 con 0x7f6580149d60 2020-05-18T21:37:16.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.889+0000 7f6584df2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658014d910 con 0x7f6580149980 2020-05-18T21:37:16.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.889+0000 7f657ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f658014e050 0x7f658009e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:16.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.889+0000 7f657ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f658014e050 0x7f658009e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35402/0 (socket says 172.21.15.63:35402) 2020-05-18T21:37:16.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.889+0000 7f657f7fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6580149980 0x7f65800b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:16.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.889+0000 7f657effd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6580149d60 0x7f65800b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:16.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.889+0000 7f657ffff700 1 -- 172.21.15.63:0/1805545957 learned_addr learned my addr 172.21.15.63:0/1805545957 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:16.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.889+0000 7f657effd700 1 -- 172.21.15.63:0/1805545957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6580149980 msgr2=0x7f65800b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:16.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.889+0000 7f657effd700 1 --2- 172.21.15.63:0/1805545957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6580149980 0x7f65800b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:16.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.889+0000 7f657effd700 1 -- 172.21.15.63:0/1805545957 >> v2:172.21.15.63:3300/0 conn(0x7f658014e050 msgr2=0x7f658009e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:16.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.889+0000 7f657effd700 1 --2- 172.21.15.63:0/1805545957 >> v2:172.21.15.63:3300/0 conn(0x7f658014e050 0x7f658009e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:16.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.889+0000 7f657effd700 1 -- 172.21.15.63:0/1805545957 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658014dbb0 con 0x7f6580149d60 2020-05-18T21:37:16.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.889+0000 7f657effd700 1 --2- 172.21.15.63:0/1805545957 >> v2:172.21.15.155:3300/0 conn(0x7f6580149d60 0x7f65800b5340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f65700032f0 tx=0x7f6570007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.893+0000 7f657effd700 1 --2- 172.21.15.63:0/1805545957 >> v2:172.21.15.155:3300/0 conn(0x7f6580149d60 0x7f65800b5340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f65700032f0 tx=0x7f6570007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.893+0000 7f657effd700 1 --2- 172.21.15.63:0/1805545957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6580149d60 0x7f65800b5340 secure :-1 s=READY pgs=1281 cs=0 l=1 rx=0x7f65700032f0 tx=0x7f6570007e00).ready entity=mon.1 client_cookie=eef1622f170835d1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:16.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.893+0000 7f657effd700 1 --2- 172.21.15.63:0/1805545957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6580149d60 0x7f65800b5340 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f65700032f0 tx=0x7f6570007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.893+0000 7f657e7fc700 1 -- 172.21.15.63:0/1805545957 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6570011db0 con 0x7f6580149d60 2020-05-18T21:37:16.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.893+0000 7f657effd700 1 --2- 172.21.15.63:0/1805545957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6580149d60 0x7f65800b5340 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f65700032f0 tx=0x7f6570007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.893+0000 7f657effd700 1 --2- 172.21.15.63:0/1805545957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6580149d60 0x7f65800b5340 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f65700032f0 tx=0x7f6570007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.893+0000 7f657e7fc700 1 -- 172.21.15.63:0/1805545957 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657000a180 con 0x7f6580149d60 2020-05-18T21:37:16.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.893+0000 7f657e7fc700 1 -- 172.21.15.63:0/1805545957 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f657000a5a0 con 0x7f6580149d60 2020-05-18T21:37:16.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.893+0000 7f6584df2700 1 -- 172.21.15.63:0/1805545957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6580149d60 msgr2=0x7f65800b5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.893+0000 7f6584df2700 1 --2- 172.21.15.63:0/1805545957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6580149d60 0x7f65800b5340 secure :-1 s=READY pgs=1281 cs=0 l=1 rx=0x7f65700032f0 tx=0x7f6570007e00).stop 2020-05-18T21:37:16.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.893+0000 7f6584df2700 1 -- 172.21.15.63:0/1805545957 shutdown_connections 2020-05-18T21:37:16.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.893+0000 7f6584df2700 1 --2- 172.21.15.63:0/1805545957 >> v2:172.21.15.63:3300/0 conn(0x7f658014e050 0x7f658009e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:16.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.893+0000 7f6584df2700 1 --2- 172.21.15.63:0/1805545957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6580149d60 0x7f65800b5340 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:16.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.893+0000 7f6584df2700 1 --2- 172.21.15.63:0/1805545957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6580149980 0x7f65800b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:16.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.893+0000 7f6584df2700 1 -- 172.21.15.63:0/1805545957 >> 172.21.15.63:0/1805545957 conn(0x7f658005a7c0 msgr2=0x7f658005aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:16.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.893+0000 7f6584df2700 1 -- 172.21.15.63:0/1805545957 shutdown_connections 2020-05-18T21:37:16.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.893+0000 7f6584df2700 1 -- 172.21.15.63:0/1805545957 wait complete. 2020-05-18T21:37:16.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f6584df2700 1 Processor -- start 2020-05-18T21:37:16.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f6584df2700 1 -- start start 2020-05-18T21:37:16.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f6584df2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6580149980 0x7f6580097fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:16.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f6584df2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6580149d60 0x7f6580098f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:16.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f6584df2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f658014e050 0x7f6580099ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:16.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f6584df2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6580099360 con 0x7f658014e050 2020-05-18T21:37:16.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f6584df2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6580099f10 con 0x7f6580149d60 2020-05-18T21:37:16.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f6584df2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658014b250 con 0x7f6580149980 2020-05-18T21:37:16.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f657ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f658014e050 0x7f6580099ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:16.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f657ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f658014e050 0x7f6580099ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35408/0 (socket says 172.21.15.63:35408) 2020-05-18T21:37:16.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f657ffff700 1 -- 172.21.15.63:0/569654538 learned_addr learned my addr 172.21.15.63:0/569654538 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:16.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f657effd700 1 --2- 172.21.15.63:0/569654538 >> v2:172.21.15.155:3300/0 conn(0x7f6580149d60 0x7f6580098f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:16.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f657f7fe700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6580149980 0x7f6580097fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:16.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f657ffff700 1 -- 172.21.15.63:0/569654538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6580149980 msgr2=0x7f6580097fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f657ffff700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6580149980 0x7f6580097fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:16.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f657ffff700 1 -- 172.21.15.63:0/569654538 >> v2:172.21.15.155:3300/0 conn(0x7f6580149d60 msgr2=0x7f6580098f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:16.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f657ffff700 1 --2- 172.21.15.63:0/569654538 >> v2:172.21.15.155:3300/0 conn(0x7f6580149d60 0x7f6580098f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:16.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f657ffff700 1 -- 172.21.15.63:0/569654538 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658014b4f0 con 0x7f658014e050 2020-05-18T21:37:16.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f657ffff700 1 --2- 172.21.15.63:0/569654538 >> v2:172.21.15.63:3300/0 conn(0x7f658014e050 0x7f6580099ab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6578002f70 tx=0x7f6578010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f657ffff700 1 --2- 172.21.15.63:0/569654538 >> v2:172.21.15.63:3300/0 conn(0x7f658014e050 0x7f6580099ab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6578002f70 tx=0x7f6578010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f657ffff700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f658014e050 0x7f6580099ab0 secure :-1 s=READY pgs=1937 cs=0 l=1 rx=0x7f6578002f70 tx=0x7f6578010be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:16.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f657ffff700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f658014e050 0x7f6580099ab0 secure :-1 s=THROTTLE_DONE pgs=1937 cs=0 l=1 rx=0x7f6578002f70 tx=0x7f6578010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f657ffff700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f658014e050 0x7f6580099ab0 secure :-1 s=THROTTLE_DONE pgs=1937 cs=0 l=1 rx=0x7f6578002f70 tx=0x7f6578010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f657cff9700 1 -- 172.21.15.63:0/569654538 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65780123c0 con 0x7f658014e050 2020-05-18T21:37:16.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f657ffff700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f658014e050 0x7f6580099ab0 secure :-1 s=THROTTLE_DONE pgs=1937 cs=0 l=1 rx=0x7f6578002f70 tx=0x7f6578010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f657cff9700 1 -- 172.21.15.63:0/569654538 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6578012520 con 0x7f658014e050 2020-05-18T21:37:16.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f657cff9700 1 -- 172.21.15.63:0/569654538 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6578012900 con 0x7f658014e050 2020-05-18T21:37:16.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f6584df2700 1 -- 172.21.15.63:0/569654538 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f658014b790 con 0x7f658014e050 2020-05-18T21:37:16.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.897+0000 7f6584df2700 1 -- 172.21.15.63:0/569654538 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65801454c0 con 0x7f658014e050 2020-05-18T21:37:16.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.901+0000 7f657ffff700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f658014e050 0x7f6580099ab0 secure :-1 s=THROTTLE_DONE pgs=1937 cs=0 l=1 rx=0x7f6578002f70 tx=0x7f6578010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.901+0000 7f6584df2700 1 -- 172.21.15.63:0/569654538 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65800569e0 con 0x7f658014e050 2020-05-18T21:37:16.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.901+0000 7f657cff9700 1 -- 172.21.15.63:0/569654538 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6578012b70 con 0x7f658014e050 2020-05-18T21:37:16.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.901+0000 7f657ffff700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f658014e050 0x7f6580099ab0 secure :-1 s=THROTTLE_DONE pgs=1937 cs=0 l=1 rx=0x7f6578002f70 tx=0x7f6578010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.901+0000 7f657cff9700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f656404fb10 0x7f6564051fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:16.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.901+0000 7f657cff9700 1 -- 172.21.15.63:0/569654538 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6578064150 con 0x7f658014e050 2020-05-18T21:37:16.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.901+0000 7f657f7fe700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f656404fb10 0x7f6564051fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:16.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.901+0000 7f657f7fe700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f656404fb10 0x7f6564051fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6568002f70 tx=0x7f656800d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.901+0000 7f657f7fe700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f656404fb10 0x7f6564051fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6568002f70 tx=0x7f656800d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.901+0000 7f657f7fe700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f656404fb10 0x7f6564051fd0 secure :-1 s=READY pgs=754 cs=0 l=1 rx=0x7f6568002f70 tx=0x7f656800d8f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:16.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.909+0000 7f657ffff700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f658014e050 0x7f6580099ab0 secure :-1 s=THROTTLE_DONE pgs=1937 cs=0 l=1 rx=0x7f6578002f70 tx=0x7f6578010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:16.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:16.909+0000 7f657cff9700 1 -- 172.21.15.63:0/569654538 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f657803e480 con 0x7f658014e050 2020-05-18T21:37:17.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.025+0000 7f6584df2700 1 -- 172.21.15.63:0/569654538 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f658005b1d0 con 0x7f658014e050 2020-05-18T21:37:17.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.025+0000 7f657ffff700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f658014e050 0x7f6580099ab0 secure :-1 s=THROTTLE_DONE pgs=1937 cs=0 l=1 rx=0x7f6578002f70 tx=0x7f6578010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.025+0000 7f657cff9700 1 -- 172.21.15.63:0/569654538 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v141) v1 ==== 84+0+143 (secure 0 0 0) 0x7f6578041aa0 con 0x7f658014e050 2020-05-18T21:37:17.031 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:17.032 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:37:17.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:17.032 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2020-05-18T21:37:17.032 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "device_health_metrics" 2020-05-18T21:37:17.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:17.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:17.033 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 2, 2020-05-18T21:37:17.033 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "rbd" 2020-05-18T21:37:17.033 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:17.033 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:37:17.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.025+0000 7f6584df2700 1 -- 172.21.15.63:0/569654538 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f656404fb10 msgr2=0x7f6564051fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:17.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.025+0000 7f6584df2700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f656404fb10 0x7f6564051fd0 secure :-1 s=READY pgs=754 cs=0 l=1 rx=0x7f6568002f70 tx=0x7f656800d8f0).stop 2020-05-18T21:37:17.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.025+0000 7f6584df2700 1 -- 172.21.15.63:0/569654538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f658014e050 msgr2=0x7f6580099ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:17.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.025+0000 7f6584df2700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f658014e050 0x7f6580099ab0 secure :-1 s=READY pgs=1937 cs=0 l=1 rx=0x7f6578002f70 tx=0x7f6578010be0).stop 2020-05-18T21:37:17.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.025+0000 7f6584df2700 1 -- 172.21.15.63:0/569654538 shutdown_connections 2020-05-18T21:37:17.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.025+0000 7f6584df2700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f656404fb10 0x7f6564051fd0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:17.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.025+0000 7f6584df2700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f658014e050 0x7f6580099ab0 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:17.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.025+0000 7f6584df2700 1 --2- 172.21.15.63:0/569654538 >> v2:172.21.15.155:3300/0 conn(0x7f6580149d60 0x7f6580098f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:17.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.025+0000 7f6584df2700 1 --2- 172.21.15.63:0/569654538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6580149980 0x7f6580097fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:17.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.025+0000 7f6584df2700 1 -- 172.21.15.63:0/569654538 >> 172.21.15.63:0/569654538 conn(0x7f658005a7c0 msgr2=0x7f658009c270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:17.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.025+0000 7f6584df2700 1 -- 172.21.15.63:0/569654538 shutdown_connections 2020-05-18T21:37:17.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.025+0000 7f6584df2700 1 -- 172.21.15.63:0/569654538 wait complete. 2020-05-18T21:37:17.043 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-05-18T21:37:17.044 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-05-18T21:37:17.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d02029700 1 Processor -- start 2020-05-18T21:37:17.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d02029700 1 -- start start 2020-05-18T21:37:17.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d02029700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4cfc142110 0x7f4cfc061b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:17.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d02029700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cfc142620 con 0x7f4cfc146060 2020-05-18T21:37:17.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d02029700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cfc1428c0 con 0x7f4cfc05ef00 2020-05-18T21:37:17.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d02029700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc142b60 con 0x7f4cfc142110 2020-05-18T21:37:17.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d01828700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4cfc146060 0x7f4cfc0b3d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37606/0 (socket says 172.21.15.63:37606) 2020-05-18T21:37:17.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d01828700 1 -- 172.21.15.63:0/2280382089 learned_addr learned my addr 172.21.15.63:0/2280382089 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:17.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d00826700 1 --2- 172.21.15.63:0/2280382089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4cfc142110 0x7f4cfc061b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:17.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4cf3fff700 1 -- 172.21.15.63:0/2280382089 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173184176 0 0) 0x7f4cfc142620 con 0x7f4cfc146060 2020-05-18T21:37:17.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4cf3fff700 1 -- 172.21.15.63:0/2280382089 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ce0003270 con 0x7f4cfc146060 2020-05-18T21:37:17.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d00826700 1 -- 172.21.15.63:0/2280382089 >> v1:172.21.15.155:6789/0 conn(0x7f4cfc05ef00 legacy=0x7f4cfc145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:17.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4cf3fff700 1 -- 172.21.15.63:0/2280382089 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 948118213 0 0) 0x7f4cfc1428c0 con 0x7f4cfc05ef00 2020-05-18T21:37:17.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d00826700 1 -- 172.21.15.63:0/2280382089 >> v1:172.21.15.63:6789/0 conn(0x7f4cfc146060 legacy=0x7f4cfc0b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:17.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d00826700 1 -- 172.21.15.63:0/2280382089 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc143000 con 0x7f4cfc142110 2020-05-18T21:37:17.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d00826700 1 --2- 172.21.15.63:0/2280382089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4cfc142110 0x7f4cfc061b30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4cec002f70 tx=0x7f4cec008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d00826700 1 --2- 172.21.15.63:0/2280382089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4cfc142110 0x7f4cfc061b30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4cec002f70 tx=0x7f4cec008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d00826700 1 --2- 172.21.15.63:0/2280382089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4cfc142110 0x7f4cfc061b30 secure :-1 s=READY pgs=294 cs=0 l=1 rx=0x7f4cec002f70 tx=0x7f4cec008920).ready entity=mon.2 client_cookie=71f05a72edc4bb5c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:17.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d00826700 1 --2- 172.21.15.63:0/2280382089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4cfc142110 0x7f4cfc061b30 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7f4cec002f70 tx=0x7f4cec008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4cf3fff700 1 -- 172.21.15.63:0/2280382089 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cec008e80 con 0x7f4cfc142110 2020-05-18T21:37:17.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d00826700 1 --2- 172.21.15.63:0/2280382089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4cfc142110 0x7f4cfc061b30 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7f4cec002f70 tx=0x7f4cec008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4cf3fff700 1 -- 172.21.15.63:0/2280382089 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec011630 con 0x7f4cfc142110 2020-05-18T21:37:17.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d00826700 1 --2- 172.21.15.63:0/2280382089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4cfc142110 0x7f4cfc061b30 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7f4cec002f70 tx=0x7f4cec008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4cf3fff700 1 -- 172.21.15.63:0/2280382089 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cec011990 con 0x7f4cfc142110 2020-05-18T21:37:17.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d02029700 1 -- 172.21.15.63:0/2280382089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4cfc142110 msgr2=0x7f4cfc061b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:17.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.149+0000 7f4d02029700 1 --2- 172.21.15.63:0/2280382089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4cfc142110 0x7f4cfc061b30 secure :-1 s=READY pgs=294 cs=0 l=1 rx=0x7f4cec002f70 tx=0x7f4cec008920).stop 2020-05-18T21:37:17.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.153+0000 7f4d02029700 1 -- 172.21.15.63:0/2280382089 shutdown_connections 2020-05-18T21:37:17.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.153+0000 7f4d02029700 1 --2- 172.21.15.63:0/2280382089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4cfc142110 0x7f4cfc061b30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:17.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.153+0000 7f4d02029700 1 -- 172.21.15.63:0/2280382089 >> 172.21.15.63:0/2280382089 conn(0x7f4cfc0b8b10 msgr2=0x7f4cfc0b8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:17.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.153+0000 7f4d02029700 1 -- 172.21.15.63:0/2280382089 shutdown_connections 2020-05-18T21:37:17.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.153+0000 7f4d02029700 1 -- 172.21.15.63:0/2280382089 wait complete. 2020-05-18T21:37:17.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.153+0000 7f4d02029700 1 Processor -- start 2020-05-18T21:37:17.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.153+0000 7f4d02029700 1 -- start start 2020-05-18T21:37:17.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.153+0000 7f4d02029700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4cfc05ef00 0x7f4cfc13bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:17.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d02029700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4cfc146060 0x7f4cfc13ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:17.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d02029700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cfc13cd20 con 0x7f4cfc142110 2020-05-18T21:37:17.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d02029700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cfc13fab0 con 0x7f4cfc05ef00 2020-05-18T21:37:17.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d02029700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cfc13cf50 con 0x7f4cfc146060 2020-05-18T21:37:17.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d01027700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4cfc05ef00 0x7f4cfc13bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:17.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d01027700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4cfc05ef00 0x7f4cfc13bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35420/0 (socket says 172.21.15.63:35420) 2020-05-18T21:37:17.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d01027700 1 -- 172.21.15.63:0/2237217023 learned_addr learned my addr 172.21.15.63:0/2237217023 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:17.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d01828700 1 --2- 172.21.15.63:0/2237217023 >> v2:172.21.15.155:3300/0 conn(0x7f4cfc146060 0x7f4cfc13ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:17.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d01027700 1 -- 172.21.15.63:0/2237217023 >> v2:172.21.15.155:3300/0 conn(0x7f4cfc146060 msgr2=0x7f4cfc13ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:17.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d01027700 1 --2- 172.21.15.63:0/2237217023 >> v2:172.21.15.155:3300/0 conn(0x7f4cfc146060 0x7f4cfc13ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:17.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d01027700 1 -- 172.21.15.63:0/2237217023 >> v1:172.21.15.155:6789/0 conn(0x7f4cfc142110 legacy=0x7f4cfc09c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:17.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d01027700 1 -- 172.21.15.63:0/2237217023 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc09e5d0 con 0x7f4cfc05ef00 2020-05-18T21:37:17.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d01027700 1 --2- 172.21.15.63:0/2237217023 >> v2:172.21.15.63:3300/0 conn(0x7f4cfc05ef00 0x7f4cfc13bf60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4cfc13c440 tx=0x7f4cf800c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d01027700 1 --2- 172.21.15.63:0/2237217023 >> v2:172.21.15.63:3300/0 conn(0x7f4cfc05ef00 0x7f4cfc13bf60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4cfc13c440 tx=0x7f4cf800c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d01027700 1 --2- 172.21.15.63:0/2237217023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cfc05ef00 0x7f4cfc13bf60 secure :-1 s=READY pgs=1939 cs=0 l=1 rx=0x7f4cfc13c440 tx=0x7f4cf800c880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:17.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d01027700 1 --2- 172.21.15.63:0/2237217023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cfc05ef00 0x7f4cfc13bf60 secure :-1 s=THROTTLE_DONE pgs=1939 cs=0 l=1 rx=0x7f4cfc13c440 tx=0x7f4cf800c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4cf27fc700 1 -- 172.21.15.63:0/2237217023 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cf80101e0 con 0x7f4cfc05ef00 2020-05-18T21:37:17.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d01027700 1 --2- 172.21.15.63:0/2237217023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cfc05ef00 0x7f4cfc13bf60 secure :-1 s=THROTTLE_DONE pgs=1939 cs=0 l=1 rx=0x7f4cfc13c440 tx=0x7f4cf800c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d01027700 1 --2- 172.21.15.63:0/2237217023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cfc05ef00 0x7f4cfc13bf60 secure :-1 s=THROTTLE_DONE pgs=1939 cs=0 l=1 rx=0x7f4cfc13c440 tx=0x7f4cf800c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4cf27fc700 1 -- 172.21.15.63:0/2237217023 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf8010340 con 0x7f4cfc05ef00 2020-05-18T21:37:17.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d02029700 1 -- 172.21.15.63:0/2237217023 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cfc09e870 con 0x7f4cfc05ef00 2020-05-18T21:37:17.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4cf27fc700 1 -- 172.21.15.63:0/2237217023 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cf8010720 con 0x7f4cfc05ef00 2020-05-18T21:37:17.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d02029700 1 -- 172.21.15.63:0/2237217023 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cfc09cbf0 con 0x7f4cfc05ef00 2020-05-18T21:37:17.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d01027700 1 --2- 172.21.15.63:0/2237217023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cfc05ef00 0x7f4cfc13bf60 secure :-1 s=THROTTLE_DONE pgs=1939 cs=0 l=1 rx=0x7f4cfc13c440 tx=0x7f4cf800c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d02029700 1 -- 172.21.15.63:0/2237217023 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cfc0569e0 con 0x7f4cfc05ef00 2020-05-18T21:37:17.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4cf27fc700 1 -- 172.21.15.63:0/2237217023 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4cf80068a0 con 0x7f4cfc05ef00 2020-05-18T21:37:17.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4d01027700 1 --2- 172.21.15.63:0/2237217023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cfc05ef00 0x7f4cfc13bf60 secure :-1 s=THROTTLE_DONE pgs=1939 cs=0 l=1 rx=0x7f4cfc13c440 tx=0x7f4cf800c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4cf27fc700 1 --2- 172.21.15.63:0/2237217023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4ce404f950 0x7f4ce4051e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:17.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.157+0000 7f4cf27fc700 1 -- 172.21.15.63:0/2237217023 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f4cf8063e80 con 0x7f4cfc05ef00 2020-05-18T21:37:17.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.161+0000 7f4d00826700 1 --2- 172.21.15.63:0/2237217023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4ce404f950 0x7f4ce4051e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:17.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.161+0000 7f4d00826700 1 --2- 172.21.15.63:0/2237217023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4ce404f950 0x7f4ce4051e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4cfc13e5c0 tx=0x7f4cfc143190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.161+0000 7f4d00826700 1 --2- 172.21.15.63:0/2237217023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4ce404f950 0x7f4ce4051e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4cfc13e5c0 tx=0x7f4cfc143190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.161+0000 7f4d00826700 1 --2- 172.21.15.63:0/2237217023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4ce404f950 0x7f4ce4051e10 secure :-1 s=READY pgs=755 cs=0 l=1 rx=0x7f4cfc13e5c0 tx=0x7f4cfc143190).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:17.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.165+0000 7f4d01027700 1 --2- 172.21.15.63:0/2237217023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cfc05ef00 0x7f4cfc13bf60 secure :-1 s=THROTTLE_DONE pgs=1939 cs=0 l=1 rx=0x7f4cfc13c440 tx=0x7f4cf800c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.165+0000 7f4cf27fc700 1 -- 172.21.15.63:0/2237217023 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f4cf803e1b0 con 0x7f4cfc05ef00 2020-05-18T21:37:17.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.277+0000 7f4d02029700 1 -- 172.21.15.63:0/2237217023 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f4cfc05c860 con 0x7f4cfc05ef00 2020-05-18T21:37:17.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.529+0000 7f4d01027700 1 --2- 172.21.15.63:0/2237217023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cfc05ef00 0x7f4cfc13bf60 secure :-1 s=THROTTLE_DONE pgs=1939 cs=0 l=1 rx=0x7f4cfc13c440 tx=0x7f4cf800c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.529+0000 7f4cf27fc700 1 -- 172.21.15.63:0/2237217023 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v142) v1 ==== 133+0+0 (secure 0 0 0) 0x7f4cf80417d0 con 0x7f4cfc05ef00 2020-05-18T21:37:17.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.533+0000 7f4d02029700 1 -- 172.21.15.63:0/2237217023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4ce404f950 msgr2=0x7f4ce4051e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:17.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.533+0000 7f4d02029700 1 --2- 172.21.15.63:0/2237217023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4ce404f950 0x7f4ce4051e10 secure :-1 s=READY pgs=755 cs=0 l=1 rx=0x7f4cfc13e5c0 tx=0x7f4cfc143190).stop 2020-05-18T21:37:17.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.533+0000 7f4d02029700 1 -- 172.21.15.63:0/2237217023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cfc05ef00 msgr2=0x7f4cfc13bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:17.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.533+0000 7f4d02029700 1 --2- 172.21.15.63:0/2237217023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cfc05ef00 0x7f4cfc13bf60 secure :-1 s=READY pgs=1939 cs=0 l=1 rx=0x7f4cfc13c440 tx=0x7f4cf800c880).stop 2020-05-18T21:37:17.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.533+0000 7f4d02029700 1 -- 172.21.15.63:0/2237217023 shutdown_connections 2020-05-18T21:37:17.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.533+0000 7f4d02029700 1 --2- 172.21.15.63:0/2237217023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4ce404f950 0x7f4ce4051e10 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:17.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.533+0000 7f4d02029700 1 --2- 172.21.15.63:0/2237217023 >> v2:172.21.15.155:3300/0 conn(0x7f4cfc146060 0x7f4cfc13ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:17.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.533+0000 7f4d02029700 1 --2- 172.21.15.63:0/2237217023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cfc05ef00 0x7f4cfc13bf60 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:17.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.533+0000 7f4d02029700 1 -- 172.21.15.63:0/2237217023 >> 172.21.15.63:0/2237217023 conn(0x7f4cfc0b8b10 msgr2=0x7f4cfc0b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:17.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.533+0000 7f4d02029700 1 -- 172.21.15.63:0/2237217023 shutdown_connections 2020-05-18T21:37:17.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.533+0000 7f4d02029700 1 -- 172.21.15.63:0/2237217023 wait complete. 2020-05-18T21:37:17.542 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2020-05-18T21:37:17.555 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-05-18T21:37:17.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.657+0000 7fd8216a6700 1 Processor -- start 2020-05-18T21:37:17.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.657+0000 7fd8216a6700 1 -- start start 2020-05-18T21:37:17.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd8216a6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd81c0b9500 0x7fd81c0b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:17.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd8216a6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b42b0 0x7fd81c0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:17.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd8216a6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81c060660 con 0x7fd81c0b6d90 2020-05-18T21:37:17.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd8216a6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd81c0b4b80 con 0x7fd81c0b9500 2020-05-18T21:37:17.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd8216a6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c060890 con 0x7fd81c0b42b0 2020-05-18T21:37:17.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd81affd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd81c0b9500 0x7fd81c0b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:17.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd81a7fc700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd81c0b6d90 0x7fd81c061270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:35932/0 (socket says 172.21.15.63:35932) 2020-05-18T21:37:17.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd81a7fc700 1 -- 172.21.15.63:0/1123034974 learned_addr learned my addr 172.21.15.63:0/1123034974 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:17.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd81b7fe700 1 --2- 172.21.15.63:0/1123034974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b42b0 0x7fd81c0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:17.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd819ffb700 1 -- 172.21.15.63:0/1123034974 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286662179 0 0) 0x7fd81c060660 con 0x7fd81c0b6d90 2020-05-18T21:37:17.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd819ffb700 1 -- 172.21.15.63:0/1123034974 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7fc003270 con 0x7fd81c0b6d90 2020-05-18T21:37:17.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd81b7fe700 1 -- 172.21.15.63:0/1123034974 >> v2:172.21.15.155:3300/0 conn(0x7fd81c0b9500 msgr2=0x7fd81c0b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:17.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd81b7fe700 1 --2- 172.21.15.63:0/1123034974 >> v2:172.21.15.155:3300/0 conn(0x7fd81c0b9500 0x7fd81c0b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:17.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd81b7fe700 1 -- 172.21.15.63:0/1123034974 >> v1:172.21.15.155:6789/0 conn(0x7fd81c0b6d90 legacy=0x7fd81c061270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:17.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd81b7fe700 1 -- 172.21.15.63:0/1123034974 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81c060b30 con 0x7fd81c0b42b0 2020-05-18T21:37:17.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd81b7fe700 1 --2- 172.21.15.63:0/1123034974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b42b0 0x7fd81c0b4720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd8140032f0 tx=0x7fd814007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd81b7fe700 1 --2- 172.21.15.63:0/1123034974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b42b0 0x7fd81c0b4720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd8140032f0 tx=0x7fd814007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd81b7fe700 1 --2- 172.21.15.63:0/1123034974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b42b0 0x7fd81c0b4720 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7fd8140032f0 tx=0x7fd814007e00).ready entity=mon.2 client_cookie=942adca6434f5f28 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:17.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd81b7fe700 1 --2- 172.21.15.63:0/1123034974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b42b0 0x7fd81c0b4720 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7fd8140032f0 tx=0x7fd814007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd819ffb700 1 -- 172.21.15.63:0/1123034974 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd814011db0 con 0x7fd81c0b42b0 2020-05-18T21:37:17.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd81b7fe700 1 --2- 172.21.15.63:0/1123034974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b42b0 0x7fd81c0b4720 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7fd8140032f0 tx=0x7fd814007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd81b7fe700 1 --2- 172.21.15.63:0/1123034974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b42b0 0x7fd81c0b4720 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7fd8140032f0 tx=0x7fd814007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd819ffb700 1 -- 172.21.15.63:0/1123034974 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81400a180 con 0x7fd81c0b42b0 2020-05-18T21:37:17.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd819ffb700 1 -- 172.21.15.63:0/1123034974 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd81400a5a0 con 0x7fd81c0b42b0 2020-05-18T21:37:17.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd8216a6700 1 -- 172.21.15.63:0/1123034974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b42b0 msgr2=0x7fd81c0b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:17.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd8216a6700 1 --2- 172.21.15.63:0/1123034974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b42b0 0x7fd81c0b4720 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7fd8140032f0 tx=0x7fd814007e00).stop 2020-05-18T21:37:17.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd8216a6700 1 -- 172.21.15.63:0/1123034974 shutdown_connections 2020-05-18T21:37:17.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd8216a6700 1 --2- 172.21.15.63:0/1123034974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b42b0 0x7fd81c0b4720 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:17.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd8216a6700 1 --2- 172.21.15.63:0/1123034974 >> v2:172.21.15.155:3300/0 conn(0x7fd81c0b9500 0x7fd81c0b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:17.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd8216a6700 1 -- 172.21.15.63:0/1123034974 >> 172.21.15.63:0/1123034974 conn(0x7fd81c069b70 msgr2=0x7fd81c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:17.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd8216a6700 1 -- 172.21.15.63:0/1123034974 shutdown_connections 2020-05-18T21:37:17.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.661+0000 7fd8216a6700 1 -- 172.21.15.63:0/1123034974 wait complete. 2020-05-18T21:37:17.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.665+0000 7fd8216a6700 1 Processor -- start 2020-05-18T21:37:17.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.665+0000 7fd8216a6700 1 -- start start 2020-05-18T21:37:17.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.665+0000 7fd8216a6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b9500 0x7fd81c0bab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:17.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.665+0000 7fd8216a6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81c0acbe0 con 0x7fd81c0b6d90 2020-05-18T21:37:17.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.665+0000 7fd8216a6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81c0bafa0 con 0x7fd81c0b42b0 2020-05-18T21:37:17.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.665+0000 7fd8216a6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c0b2150 con 0x7fd81c0b9500 2020-05-18T21:37:17.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.665+0000 7fd81a7fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd81c0b6d90 0x7fd81c0ac4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37624/0 (socket says 172.21.15.63:37624) 2020-05-18T21:37:17.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.665+0000 7fd81a7fc700 1 -- 172.21.15.63:0/1786553561 learned_addr learned my addr 172.21.15.63:0/1786553561 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:17.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.665+0000 7fd81b7fe700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b9500 0x7fd81c0bab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:17.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.665+0000 7fd813fff700 1 -- 172.21.15.63:0/1786553561 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577187860 0 0) 0x7fd81c0acbe0 con 0x7fd81c0b6d90 2020-05-18T21:37:17.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.665+0000 7fd813fff700 1 -- 172.21.15.63:0/1786553561 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd800002fe0 con 0x7fd81c0b6d90 2020-05-18T21:37:17.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.665+0000 7fd813fff700 1 -- 172.21.15.63:0/1786553561 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852766008 0 0) 0x7fd81c0bafa0 con 0x7fd81c0b42b0 2020-05-18T21:37:17.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.665+0000 7fd813fff700 1 -- 172.21.15.63:0/1786553561 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd81c0acbe0 con 0x7fd81c0b42b0 2020-05-18T21:37:17.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.665+0000 7fd81b7fe700 1 -- 172.21.15.63:0/1786553561 >> v1:172.21.15.155:6789/0 conn(0x7fd81c0b42b0 legacy=0x7fd81c0b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:17.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.665+0000 7fd81b7fe700 1 -- 172.21.15.63:0/1786553561 >> v1:172.21.15.63:6789/0 conn(0x7fd81c0b6d90 legacy=0x7fd81c0ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:17.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.665+0000 7fd81b7fe700 1 -- 172.21.15.63:0/1786553561 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81c0b23f0 con 0x7fd81c0b9500 2020-05-18T21:37:17.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.665+0000 7fd81b7fe700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b9500 0x7fd81c0bab40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd81c0b0bc0 tx=0x7fd814007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.669+0000 7fd81b7fe700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b9500 0x7fd81c0bab40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd81c0b0bc0 tx=0x7fd814007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.669+0000 7fd81b7fe700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b9500 0x7fd81c0bab40 secure :-1 s=READY pgs=296 cs=0 l=1 rx=0x7fd81c0b0bc0 tx=0x7fd814007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:17.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.669+0000 7fd81b7fe700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b9500 0x7fd81c0bab40 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7fd81c0b0bc0 tx=0x7fd814007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.669+0000 7fd813fff700 1 -- 172.21.15.63:0/1786553561 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd814011e90 con 0x7fd81c0b9500 2020-05-18T21:37:17.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.669+0000 7fd81b7fe700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b9500 0x7fd81c0bab40 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7fd81c0b0bc0 tx=0x7fd814007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.669+0000 7fd81b7fe700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b9500 0x7fd81c0bab40 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7fd81c0b0bc0 tx=0x7fd814007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.669+0000 7fd813fff700 1 -- 172.21.15.63:0/1786553561 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd814005c70 con 0x7fd81c0b9500 2020-05-18T21:37:17.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.669+0000 7fd8216a6700 1 -- 172.21.15.63:0/1786553561 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd81c0b2690 con 0x7fd81c0b9500 2020-05-18T21:37:17.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.669+0000 7fd813fff700 1 -- 172.21.15.63:0/1786553561 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd814005e60 con 0x7fd81c0b9500 2020-05-18T21:37:17.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.669+0000 7fd8216a6700 1 -- 172.21.15.63:0/1786553561 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81c12c030 con 0x7fd81c0b9500 2020-05-18T21:37:17.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.669+0000 7fd81b7fe700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b9500 0x7fd81c0bab40 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7fd81c0b0bc0 tx=0x7fd814007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.669+0000 7fd8216a6700 1 -- 172.21.15.63:0/1786553561 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81c0569e0 con 0x7fd81c0b9500 2020-05-18T21:37:17.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.669+0000 7fd81b7fe700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b9500 0x7fd81c0bab40 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7fd81c0b0bc0 tx=0x7fd814007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.669+0000 7fd813fff700 1 -- 172.21.15.63:0/1786553561 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd814007360 con 0x7fd81c0b9500 2020-05-18T21:37:17.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.669+0000 7fd813fff700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd80004ff10 0x7fd8000523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:17.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.669+0000 7fd813fff700 1 -- 172.21.15.63:0/1786553561 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fd814064b30 con 0x7fd81c0b9500 2020-05-18T21:37:17.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.669+0000 7fd81affd700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd80004ff10 0x7fd8000523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:17.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.673+0000 7fd81affd700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd80004ff10 0x7fd8000523d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd804002f30 tx=0x7fd8040090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.673+0000 7fd81affd700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd80004ff10 0x7fd8000523d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd804002f30 tx=0x7fd8040090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.673+0000 7fd81affd700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd80004ff10 0x7fd8000523d0 secure :-1 s=READY pgs=756 cs=0 l=1 rx=0x7fd804002f30 tx=0x7fd8040090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:17.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.677+0000 7fd81b7fe700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b9500 0x7fd81c0bab40 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7fd81c0b0bc0 tx=0x7fd814007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:17.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.677+0000 7fd813fff700 1 -- 172.21.15.63:0/1786553561 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd81403ee20 con 0x7fd81c0b9500 2020-05-18T21:37:17.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:17.797+0000 7fd8216a6700 1 -- 172.21.15.63:0/1786553561 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fd81c0008d0 con 0x7fd81c0b9500 2020-05-18T21:37:18.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.545+0000 7fd81b7fe700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b9500 0x7fd81c0bab40 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7fd81c0b0bc0 tx=0x7fd814007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.549+0000 7fd813fff700 1 -- 172.21.15.63:0/1786553561 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v143) v1 ==== 125+0+0 (secure 0 0 0) 0x7fd814042440 con 0x7fd81c0b9500 2020-05-18T21:37:18.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.553+0000 7fd8216a6700 1 -- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd80004ff10 msgr2=0x7fd8000523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:18.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.553+0000 7fd8216a6700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd80004ff10 0x7fd8000523d0 secure :-1 s=READY pgs=756 cs=0 l=1 rx=0x7fd804002f30 tx=0x7fd8040090f0).stop 2020-05-18T21:37:18.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.553+0000 7fd8216a6700 1 -- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b9500 msgr2=0x7fd81c0bab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:18.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.553+0000 7fd8216a6700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b9500 0x7fd81c0bab40 secure :-1 s=READY pgs=296 cs=0 l=1 rx=0x7fd81c0b0bc0 tx=0x7fd814007e00).stop 2020-05-18T21:37:18.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.553+0000 7fd8216a6700 1 -- 172.21.15.63:0/1786553561 shutdown_connections 2020-05-18T21:37:18.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.553+0000 7fd8216a6700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd80004ff10 0x7fd8000523d0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:18.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.553+0000 7fd8216a6700 1 --2- 172.21.15.63:0/1786553561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd81c0b9500 0x7fd81c0bab40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:18.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.553+0000 7fd8216a6700 1 -- 172.21.15.63:0/1786553561 >> 172.21.15.63:0/1786553561 conn(0x7fd81c069b70 msgr2=0x7fd81c12e130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:18.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.553+0000 7fd8216a6700 1 -- 172.21.15.63:0/1786553561 shutdown_connections 2020-05-18T21:37:18.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.553+0000 7fd8216a6700 1 -- 172.21.15.63:0/1786553561 wait complete. 2020-05-18T21:37:18.563 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2020-05-18T21:37:18.572 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-05-18T21:37:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.673+0000 7f01132a7700 1 Processor -- start 2020-05-18T21:37:18.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.673+0000 7f01132a7700 1 -- start start 2020-05-18T21:37:18.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f01132a7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010c0b8630 0x7f010c0b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:18.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f01132a7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f010c0b42b0 0x7f010c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:18.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f01132a7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010c0b4ba0 con 0x7f010c0b9500 2020-05-18T21:37:18.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f01132a7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010c060890 con 0x7f010c0b42b0 2020-05-18T21:37:18.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f01132a7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010c060b30 con 0x7f010c0b8630 2020-05-18T21:37:18.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f0111844700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f010c0b42b0 0x7f010c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:18.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f0111844700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f010c0b42b0 0x7f010c0b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35446/0 (socket says 172.21.15.63:35446) 2020-05-18T21:37:18.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f0111844700 1 -- 172.21.15.63:0/1293922137 learned_addr learned my addr 172.21.15.63:0/1293922137 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:18.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f0110842700 1 --2- 172.21.15.63:0/1293922137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010c0b8630 0x7f010c0b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:18.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f0111844700 1 -- 172.21.15.63:0/1293922137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010c0b8630 msgr2=0x7f010c0b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:18.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f0111844700 1 --2- 172.21.15.63:0/1293922137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010c0b8630 0x7f010c0b6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:18.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f0111844700 1 -- 172.21.15.63:0/1293922137 >> v1:172.21.15.155:6789/0 conn(0x7f010c0b9500 legacy=0x7f010c061270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:18.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f0111844700 1 -- 172.21.15.63:0/1293922137 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c060dd0 con 0x7f010c0b42b0 2020-05-18T21:37:18.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f0111844700 1 --2- 172.21.15.63:0/1293922137 >> v2:172.21.15.63:3300/0 conn(0x7f010c0b42b0 0x7f010c0b4740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f010c0b8fd0 tx=0x7f0104008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f0111844700 1 --2- 172.21.15.63:0/1293922137 >> v2:172.21.15.63:3300/0 conn(0x7f010c0b42b0 0x7f010c0b4740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f010c0b8fd0 tx=0x7f0104008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f0111844700 1 --2- 172.21.15.63:0/1293922137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f010c0b42b0 0x7f010c0b4740 secure :-1 s=READY pgs=1941 cs=0 l=1 rx=0x7f010c0b8fd0 tx=0x7f0104008ca0).ready entity=mon.0 client_cookie=1d3d229a3c616fce server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:18.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f0111844700 1 --2- 172.21.15.63:0/1293922137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f010c0b42b0 0x7f010c0b4740 secure :-1 s=THROTTLE_DONE pgs=1941 cs=0 l=1 rx=0x7f010c0b8fd0 tx=0x7f0104008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f0111844700 1 --2- 172.21.15.63:0/1293922137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f010c0b42b0 0x7f010c0b4740 secure :-1 s=THROTTLE_DONE pgs=1941 cs=0 l=1 rx=0x7f010c0b8fd0 tx=0x7f0104008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f00fbfff700 1 -- 172.21.15.63:0/1293922137 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0104011d10 con 0x7f010c0b42b0 2020-05-18T21:37:18.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f0111844700 1 --2- 172.21.15.63:0/1293922137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f010c0b42b0 0x7f010c0b4740 secure :-1 s=THROTTLE_DONE pgs=1941 cs=0 l=1 rx=0x7f010c0b8fd0 tx=0x7f0104008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f00fbfff700 1 -- 172.21.15.63:0/1293922137 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0104011e70 con 0x7f010c0b42b0 2020-05-18T21:37:18.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f01132a7700 1 -- 172.21.15.63:0/1293922137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f010c0b42b0 msgr2=0x7f010c0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:18.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f00fbfff700 1 -- 172.21.15.63:0/1293922137 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f010400a370 con 0x7f010c0b42b0 2020-05-18T21:37:18.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f01132a7700 1 --2- 172.21.15.63:0/1293922137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f010c0b42b0 0x7f010c0b4740 secure :-1 s=READY pgs=1941 cs=0 l=1 rx=0x7f010c0b8fd0 tx=0x7f0104008ca0).stop 2020-05-18T21:37:18.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f01132a7700 1 -- 172.21.15.63:0/1293922137 shutdown_connections 2020-05-18T21:37:18.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f01132a7700 1 --2- 172.21.15.63:0/1293922137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f010c0b42b0 0x7f010c0b4740 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:18.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f01132a7700 1 --2- 172.21.15.63:0/1293922137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010c0b8630 0x7f010c0b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:18.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f01132a7700 1 -- 172.21.15.63:0/1293922137 >> 172.21.15.63:0/1293922137 conn(0x7f010c069b70 msgr2=0x7f010c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:18.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f01132a7700 1 -- 172.21.15.63:0/1293922137 shutdown_connections 2020-05-18T21:37:18.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.677+0000 7f01132a7700 1 -- 172.21.15.63:0/1293922137 wait complete. 2020-05-18T21:37:18.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f01132a7700 1 Processor -- start 2020-05-18T21:37:18.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f01132a7700 1 -- start start 2020-05-18T21:37:18.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f01132a7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f010c0b42b0 0x7f010c1530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:18.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f01132a7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010c131df0 con 0x7f010c0b9500 2020-05-18T21:37:18.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f01132a7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010c131410 con 0x7f010c0b8630 2020-05-18T21:37:18.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f01132a7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010c1316b0 con 0x7f010c0b42b0 2020-05-18T21:37:18.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f0111844700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f010c0b9500 0x7f010c12d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37640/0 (socket says 172.21.15.63:37640) 2020-05-18T21:37:18.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f0111844700 1 -- 172.21.15.63:0/1926720247 learned_addr learned my addr 172.21.15.63:0/1926720247 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:18.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f0111043700 1 --2- 172.21.15.63:0/1926720247 >> v2:172.21.15.155:3300/0 conn(0x7f010c0b42b0 0x7f010c1530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:18.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f00fa7fc700 1 -- 172.21.15.63:0/1926720247 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325037844 0 0) 0x7f010c131df0 con 0x7f010c0b9500 2020-05-18T21:37:18.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f00fa7fc700 1 -- 172.21.15.63:0/1926720247 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00ec002fe0 con 0x7f010c0b9500 2020-05-18T21:37:18.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f00fa7fc700 1 -- 172.21.15.63:0/1926720247 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 89665377 0 0) 0x7f00ec002fe0 con 0x7f010c0b9500 2020-05-18T21:37:18.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f00fa7fc700 1 -- 172.21.15.63:0/1926720247 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f010c131df0 con 0x7f010c0b9500 2020-05-18T21:37:18.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f00fa7fc700 1 -- 172.21.15.63:0/1926720247 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f0104008980 con 0x7f010c0b9500 2020-05-18T21:37:18.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f00fa7fc700 1 -- 172.21.15.63:0/1926720247 >> v2:172.21.15.155:3300/0 conn(0x7f010c0b42b0 msgr2=0x7f010c1530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:18.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f00fa7fc700 1 --2- 172.21.15.63:0/1926720247 >> v2:172.21.15.155:3300/0 conn(0x7f010c0b42b0 0x7f010c1530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:18.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f00fa7fc700 1 -- 172.21.15.63:0/1926720247 >> v1:172.21.15.155:6789/0 conn(0x7f010c0b8630 legacy=0x7f010c12f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:18.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f00fa7fc700 1 -- 172.21.15.63:0/1926720247 >> v1:172.21.15.63:6789/0 conn(0x7f010c0b9500 legacy=0x7f010c12d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:18.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f00fa7fc700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00ec004a80 0x7f00ec004e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:18.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f00fa7fc700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00ec0039a0 0x7f00ec003e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:18.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f00fa7fc700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00ec004280 0x7f00ec00b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:18.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f00fa7fc700 1 -- 172.21.15.63:0/1926720247 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c1316b0 con 0x7f00ec0039a0 2020-05-18T21:37:18.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f00fa7fc700 1 -- 172.21.15.63:0/1926720247 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec00bbc0 con 0x7f00ec004a80 2020-05-18T21:37:18.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f00fa7fc700 1 -- 172.21.15.63:0/1926720247 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec00bd00 con 0x7f00ec004280 2020-05-18T21:37:18.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f0110842700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00ec0039a0 0x7f00ec003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:18.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f0111043700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00ec004a80 0x7f00ec004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:18.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f0111844700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00ec004280 0x7f00ec00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:18.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f0110842700 1 -- 172.21.15.63:0/1926720247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00ec004280 msgr2=0x7f00ec00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:18.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f0110842700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00ec004280 0x7f00ec00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:18.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f0110842700 1 -- 172.21.15.63:0/1926720247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00ec004a80 msgr2=0x7f00ec004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:18.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f0110842700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00ec004a80 0x7f00ec004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:18.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f0111844700 1 -- 172.21.15.63:0/1926720247 reap_dead start 2020-05-18T21:37:18.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f0110842700 1 -- 172.21.15.63:0/1926720247 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c131950 con 0x7f00ec0039a0 2020-05-18T21:37:18.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f01132a7700 1 -- 172.21.15.63:0/1926720247 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010c1530a0 con 0x7f00ec0039a0 2020-05-18T21:37:18.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f01132a7700 1 -- 172.21.15.63:0/1926720247 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010c130c90 con 0x7f00ec0039a0 2020-05-18T21:37:18.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f0110842700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00ec0039a0 0x7f00ec003e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f010c0b0e30 tx=0x7f00fc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f0110842700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00ec0039a0 0x7f00ec003e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f010c0b0e30 tx=0x7f00fc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f0110842700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00ec0039a0 0x7f00ec003e20 secure :-1 s=READY pgs=1943 cs=0 l=1 rx=0x7f010c0b0e30 tx=0x7f00fc010bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:18.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.681+0000 7f0110842700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00ec0039a0 0x7f00ec003e20 secure :-1 s=THROTTLE_DONE pgs=1943 cs=0 l=1 rx=0x7f010c0b0e30 tx=0x7f00fc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.685+0000 7f00fa7fc700 1 -- 172.21.15.63:0/1926720247 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00fc007570 con 0x7f00ec0039a0 2020-05-18T21:37:18.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.685+0000 7f0110842700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00ec0039a0 0x7f00ec003e20 secure :-1 s=THROTTLE_DONE pgs=1943 cs=0 l=1 rx=0x7f010c0b0e30 tx=0x7f00fc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.685+0000 7f00fa7fc700 1 -- 172.21.15.63:0/1926720247 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc005700 con 0x7f00ec0039a0 2020-05-18T21:37:18.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.685+0000 7f0110842700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00ec0039a0 0x7f00ec003e20 secure :-1 s=THROTTLE_DONE pgs=1943 cs=0 l=1 rx=0x7f010c0b0e30 tx=0x7f00fc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.685+0000 7f00fa7fc700 1 -- 172.21.15.63:0/1926720247 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00fc005aa0 con 0x7f00ec0039a0 2020-05-18T21:37:18.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.685+0000 7f0110842700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00ec0039a0 0x7f00ec003e20 secure :-1 s=THROTTLE_DONE pgs=1943 cs=0 l=1 rx=0x7f010c0b0e30 tx=0x7f00fc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.685+0000 7f01132a7700 1 -- 172.21.15.63:0/1926720247 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e8003380 con 0x7f00ec0039a0 2020-05-18T21:37:18.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.685+0000 7f00fa7fc700 1 -- 172.21.15.63:0/1926720247 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f00fc005c00 con 0x7f00ec0039a0 2020-05-18T21:37:18.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.685+0000 7f0110842700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00ec0039a0 0x7f00ec003e20 secure :-1 s=THROTTLE_DONE pgs=1943 cs=0 l=1 rx=0x7f010c0b0e30 tx=0x7f00fc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.685+0000 7f00fa7fc700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f00ec053a50 0x7f00ec055f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:18.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.685+0000 7f00fa7fc700 1 -- 172.21.15.63:0/1926720247 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f00fc063bc0 con 0x7f00ec0039a0 2020-05-18T21:37:18.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.685+0000 7f0111043700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f00ec053a50 0x7f00ec055f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:18.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.685+0000 7f0111043700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f00ec053a50 0x7f00ec055f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f010c0b6b80 tx=0x7f0108003ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.685+0000 7f0111043700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f00ec053a50 0x7f00ec055f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f010c0b6b80 tx=0x7f0108003ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.685+0000 7f0111043700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f00ec053a50 0x7f00ec055f10 secure :-1 s=READY pgs=757 cs=0 l=1 rx=0x7f010c0b6b80 tx=0x7f0108003ea0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:18.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.689+0000 7f0110842700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00ec0039a0 0x7f00ec003e20 secure :-1 s=THROTTLE_DONE pgs=1943 cs=0 l=1 rx=0x7f010c0b0e30 tx=0x7f00fc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.689+0000 7f00fa7fc700 1 -- 172.21.15.63:0/1926720247 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f00fc03df50 con 0x7f00ec0039a0 2020-05-18T21:37:18.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.841+0000 7f01132a7700 1 -- 172.21.15.63:0/1926720247 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f00e80022a0 con 0x7f00ec0039a0 2020-05-18T21:37:18.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.849+0000 7f0110842700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00ec0039a0 0x7f00ec003e20 secure :-1 s=THROTTLE_DONE pgs=1943 cs=0 l=1 rx=0x7f010c0b0e30 tx=0x7f00fc010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.849+0000 7f00fa7fc700 1 -- 172.21.15.63:0/1926720247 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 27 and data pool 28 v121) v1 ==== 189+0+0 (secure 0 0 0) 0x7f00fc041570 con 0x7f00ec0039a0 2020-05-18T21:37:18.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.853+0000 7f01132a7700 1 -- 172.21.15.63:0/1926720247 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f00ec053a50 msgr2=0x7f00ec055f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:18.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.853+0000 7f01132a7700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f00ec053a50 0x7f00ec055f10 secure :-1 s=READY pgs=757 cs=0 l=1 rx=0x7f010c0b6b80 tx=0x7f0108003ea0).stop 2020-05-18T21:37:18.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.853+0000 7f01132a7700 1 -- 172.21.15.63:0/1926720247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00ec0039a0 msgr2=0x7f00ec003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:18.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.853+0000 7f01132a7700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00ec0039a0 0x7f00ec003e20 secure :-1 s=READY pgs=1943 cs=0 l=1 rx=0x7f010c0b0e30 tx=0x7f00fc010bb0).stop 2020-05-18T21:37:18.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.853+0000 7f01132a7700 1 -- 172.21.15.63:0/1926720247 shutdown_connections 2020-05-18T21:37:18.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.853+0000 7f01132a7700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f00ec053a50 0x7f00ec055f10 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:18.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.853+0000 7f01132a7700 1 --2- 172.21.15.63:0/1926720247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00ec0039a0 0x7f00ec003e20 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:18.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.853+0000 7f01132a7700 1 -- 172.21.15.63:0/1926720247 >> 172.21.15.63:0/1926720247 conn(0x7f010c069b70 msgr2=0x7f010c0b4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:18.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.853+0000 7f01132a7700 1 -- 172.21.15.63:0/1926720247 shutdown_connections 2020-05-18T21:37:18.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.853+0000 7f01132a7700 1 -- 172.21.15.63:0/1926720247 wait complete. 2020-05-18T21:37:18.865 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 27 and data pool 28 2020-05-18T21:37:18.877 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:37:18.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.961+0000 7f90b8001700 1 Processor -- start 2020-05-18T21:37:18.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.961+0000 7f90b8001700 1 -- start start 2020-05-18T21:37:18.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b8001700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f90b0069eb0 0x7f90b0146db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:18.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b8001700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f90b00b5ea0 0x7f90b014a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:18.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b8001700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b0147210 con 0x7f90b012f1a0 2020-05-18T21:37:18.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b8001700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b01463d0 con 0x7f90b0069eb0 2020-05-18T21:37:18.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b8001700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b0146670 con 0x7f90b00b5ea0 2020-05-18T21:37:18.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b5d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f90b0069eb0 0x7f90b0146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:18.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b659e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f90b012f1a0 0x7f90b00b8320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37662/0 (socket says 172.21.15.63:37662) 2020-05-18T21:37:18.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b659e700 1 -- 172.21.15.63:0/3820182086 learned_addr learned my addr 172.21.15.63:0/3820182086 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:18.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b559c700 1 --2- 172.21.15.63:0/3820182086 >> v2:172.21.15.155:3300/0 conn(0x7f90b00b5ea0 0x7f90b014a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:18.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b5d9d700 1 -- 172.21.15.63:0/3820182086 >> v2:172.21.15.155:3300/0 conn(0x7f90b00b5ea0 msgr2=0x7f90b014a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:18.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b5d9d700 1 --2- 172.21.15.63:0/3820182086 >> v2:172.21.15.155:3300/0 conn(0x7f90b00b5ea0 0x7f90b014a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:18.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b5d9d700 1 -- 172.21.15.63:0/3820182086 >> v1:172.21.15.63:6789/0 conn(0x7f90b012f1a0 legacy=0x7f90b00b8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:18.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b5d9d700 1 -- 172.21.15.63:0/3820182086 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b0146910 con 0x7f90b0069eb0 2020-05-18T21:37:18.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b4d9b700 1 -- 172.21.15.63:0/3820182086 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647385732 0 0) 0x7f90b0147210 con 0x7f90b012f1a0 2020-05-18T21:37:18.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b5d9d700 1 --2- 172.21.15.63:0/3820182086 >> v2:172.21.15.63:3300/0 conn(0x7f90b0069eb0 0x7f90b0146db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f90ac002f70 tx=0x7f90ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b5d9d700 1 --2- 172.21.15.63:0/3820182086 >> v2:172.21.15.63:3300/0 conn(0x7f90b0069eb0 0x7f90b0146db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f90ac002f70 tx=0x7f90ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b5d9d700 1 --2- 172.21.15.63:0/3820182086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90b0069eb0 0x7f90b0146db0 secure :-1 s=READY pgs=1945 cs=0 l=1 rx=0x7f90ac002f70 tx=0x7f90ac007a80).ready entity=mon.0 client_cookie=a9225debfa01a4e6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:18.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b5d9d700 1 --2- 172.21.15.63:0/3820182086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90b0069eb0 0x7f90b0146db0 secure :-1 s=THROTTLE_DONE pgs=1945 cs=0 l=1 rx=0x7f90ac002f70 tx=0x7f90ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b5d9d700 1 --2- 172.21.15.63:0/3820182086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90b0069eb0 0x7f90b0146db0 secure :-1 s=THROTTLE_DONE pgs=1945 cs=0 l=1 rx=0x7f90ac002f70 tx=0x7f90ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b4d9b700 1 -- 172.21.15.63:0/3820182086 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90ac008e50 con 0x7f90b0069eb0 2020-05-18T21:37:18.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b5d9d700 1 --2- 172.21.15.63:0/3820182086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90b0069eb0 0x7f90b0146db0 secure :-1 s=THROTTLE_DONE pgs=1945 cs=0 l=1 rx=0x7f90ac002f70 tx=0x7f90ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b4d9b700 1 -- 172.21.15.63:0/3820182086 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ac0115f0 con 0x7f90b0069eb0 2020-05-18T21:37:18.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b4d9b700 1 -- 172.21.15.63:0/3820182086 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90ac0119d0 con 0x7f90b0069eb0 2020-05-18T21:37:18.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b8001700 1 -- 172.21.15.63:0/3820182086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90b0069eb0 msgr2=0x7f90b0146db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:18.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b8001700 1 --2- 172.21.15.63:0/3820182086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90b0069eb0 0x7f90b0146db0 secure :-1 s=READY pgs=1945 cs=0 l=1 rx=0x7f90ac002f70 tx=0x7f90ac007a80).stop 2020-05-18T21:37:18.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b8001700 1 -- 172.21.15.63:0/3820182086 shutdown_connections 2020-05-18T21:37:18.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b8001700 1 --2- 172.21.15.63:0/3820182086 >> v2:172.21.15.155:3300/0 conn(0x7f90b00b5ea0 0x7f90b014a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:18.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b8001700 1 --2- 172.21.15.63:0/3820182086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90b0069eb0 0x7f90b0146db0 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:18.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b8001700 1 -- 172.21.15.63:0/3820182086 >> 172.21.15.63:0/3820182086 conn(0x7f90b0066ed0 msgr2=0x7f90b00b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:18.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b8001700 1 -- 172.21.15.63:0/3820182086 shutdown_connections 2020-05-18T21:37:18.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.965+0000 7f90b8001700 1 -- 172.21.15.63:0/3820182086 wait complete. 2020-05-18T21:37:18.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b8001700 1 Processor -- start 2020-05-18T21:37:18.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b8001700 1 -- start start 2020-05-18T21:37:18.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b8001700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f90b00b5ea0 0x7f90b0153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:18.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b8001700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90b012f1a0 0x7f90b0153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:18.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b8001700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b0063d30 con 0x7f90b0069eb0 2020-05-18T21:37:18.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b8001700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b0063fd0 con 0x7f90b00b5ea0 2020-05-18T21:37:18.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b8001700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b0064270 con 0x7f90b012f1a0 2020-05-18T21:37:18.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b559c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f90b00b5ea0 0x7f90b0153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:18.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b559c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f90b00b5ea0 0x7f90b0153320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35480/0 (socket says 172.21.15.63:35480) 2020-05-18T21:37:18.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b559c700 1 -- 172.21.15.63:0/4060637225 learned_addr learned my addr 172.21.15.63:0/4060637225 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:18.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b659e700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90b012f1a0 0x7f90b0153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:18.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b559c700 1 -- 172.21.15.63:0/4060637225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90b012f1a0 msgr2=0x7f90b0153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:18.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b559c700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90b012f1a0 0x7f90b0153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:18.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b559c700 1 -- 172.21.15.63:0/4060637225 >> v1:172.21.15.155:6789/0 conn(0x7f90b0069eb0 legacy=0x7f90b0152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:18.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b559c700 1 -- 172.21.15.63:0/4060637225 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b0065020 con 0x7f90b00b5ea0 2020-05-18T21:37:18.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b659e700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90b012f1a0 0x7f90b0153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:37:18.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b559c700 1 --2- 172.21.15.63:0/4060637225 >> v2:172.21.15.63:3300/0 conn(0x7f90b00b5ea0 0x7f90b0153320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f90a0002f70 tx=0x7f90a0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b559c700 1 --2- 172.21.15.63:0/4060637225 >> v2:172.21.15.63:3300/0 conn(0x7f90b00b5ea0 0x7f90b0153320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f90a0002f70 tx=0x7f90a0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b559c700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90b00b5ea0 0x7f90b0153320 secure :-1 s=READY pgs=1946 cs=0 l=1 rx=0x7f90a0002f70 tx=0x7f90a0010d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:18.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b559c700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90b00b5ea0 0x7f90b0153320 secure :-1 s=THROTTLE_DONE pgs=1946 cs=0 l=1 rx=0x7f90a0002f70 tx=0x7f90a0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f909effd700 1 -- 172.21.15.63:0/4060637225 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90a0007550 con 0x7f90b00b5ea0 2020-05-18T21:37:18.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b559c700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90b00b5ea0 0x7f90b0153320 secure :-1 s=THROTTLE_DONE pgs=1946 cs=0 l=1 rx=0x7f90a0002f70 tx=0x7f90a0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b559c700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90b00b5ea0 0x7f90b0153320 secure :-1 s=THROTTLE_DONE pgs=1946 cs=0 l=1 rx=0x7f90a0002f70 tx=0x7f90a0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f909effd700 1 -- 172.21.15.63:0/4060637225 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a00127f0 con 0x7f90b00b5ea0 2020-05-18T21:37:18.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f90b8001700 1 -- 172.21.15.63:0/4060637225 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b0153f20 con 0x7f90b00b5ea0 2020-05-18T21:37:18.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.969+0000 7f909effd700 1 -- 172.21.15.63:0/4060637225 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90a0012bd0 con 0x7f90b00b5ea0 2020-05-18T21:37:18.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.973+0000 7f90b8001700 1 -- 172.21.15.63:0/4060637225 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b0154450 con 0x7f90b00b5ea0 2020-05-18T21:37:18.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.973+0000 7f90b559c700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90b00b5ea0 0x7f90b0153320 secure :-1 s=THROTTLE_DONE pgs=1946 cs=0 l=1 rx=0x7f90a0002f70 tx=0x7f90a0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.973+0000 7f90b8001700 1 -- 172.21.15.63:0/4060637225 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b0063b90 con 0x7f90b00b5ea0 2020-05-18T21:37:18.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.973+0000 7f909effd700 1 -- 172.21.15.63:0/4060637225 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f90a0005700 con 0x7f90b00b5ea0 2020-05-18T21:37:18.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.973+0000 7f90b559c700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90b00b5ea0 0x7f90b0153320 secure :-1 s=THROTTLE_DONE pgs=1946 cs=0 l=1 rx=0x7f90a0002f70 tx=0x7f90a0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.973+0000 7f909effd700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f909004fb20 0x7f9090051fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:18.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.973+0000 7f909effd700 1 -- 172.21.15.63:0/4060637225 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f90a0063f30 con 0x7f90b00b5ea0 2020-05-18T21:37:18.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.973+0000 7f90b5d9d700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f909004fb20 0x7f9090051fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:18.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.973+0000 7f90b5d9d700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f909004fb20 0x7f9090051fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f90b00b97a0 tx=0x7f90ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.977+0000 7f90b5d9d700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f909004fb20 0x7f9090051fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f90b00b97a0 tx=0x7f90ac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.977+0000 7f90b5d9d700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f909004fb20 0x7f9090051fe0 secure :-1 s=READY pgs=758 cs=0 l=1 rx=0x7f90b00b97a0 tx=0x7f90ac007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:18.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.981+0000 7f90b559c700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90b00b5ea0 0x7f90b0153320 secure :-1 s=THROTTLE_DONE pgs=1946 cs=0 l=1 rx=0x7f90a0002f70 tx=0x7f90a0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:18.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:18.981+0000 7f909effd700 1 -- 172.21.15.63:0/4060637225 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f90b0063b90 con 0x7f90b00b5ea0 2020-05-18T21:37:19.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.097+0000 7f90b8001700 1 -- 172.21.15.63:0/4060637225 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90b0063b90 con 0x7f90b00b5ea0 2020-05-18T21:37:19.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.097+0000 7f90b559c700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90b00b5ea0 0x7f90b0153320 secure :-1 s=THROTTLE_DONE pgs=1946 cs=0 l=1 rx=0x7f90a0002f70 tx=0x7f90a0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.097+0000 7f909effd700 1 -- 172.21.15.63:0/4060637225 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+16116 (secure 0 0 0) 0x7f90b0063b90 con 0x7f90b00b5ea0 2020-05-18T21:37:19.105 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:19.106 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":144,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:37:18.846403+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:37:17.318681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2020-05-18T21:37:17.835103+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:37:19.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.101+0000 7f90b8001700 1 -- 172.21.15.63:0/4060637225 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f909004fb20 msgr2=0x7f9090051fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:19.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.101+0000 7f90b8001700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f909004fb20 0x7f9090051fe0 secure :-1 s=READY pgs=758 cs=0 l=1 rx=0x7f90b00b97a0 tx=0x7f90ac007a80).stop 2020-05-18T21:37:19.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.101+0000 7f90b8001700 1 -- 172.21.15.63:0/4060637225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90b00b5ea0 msgr2=0x7f90b0153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:19.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.101+0000 7f90b8001700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90b00b5ea0 0x7f90b0153320 secure :-1 s=READY pgs=1946 cs=0 l=1 rx=0x7f90a0002f70 tx=0x7f90a0010d60).stop 2020-05-18T21:37:19.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.101+0000 7f90b8001700 1 -- 172.21.15.63:0/4060637225 shutdown_connections 2020-05-18T21:37:19.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.101+0000 7f90b8001700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f909004fb20 0x7f9090051fe0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:19.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.101+0000 7f90b8001700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90b012f1a0 0x7f90b0153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:19.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.101+0000 7f90b8001700 1 --2- 172.21.15.63:0/4060637225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90b00b5ea0 0x7f90b0153320 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:19.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.101+0000 7f90b8001700 1 -- 172.21.15.63:0/4060637225 >> 172.21.15.63:0/4060637225 conn(0x7f90b0066ed0 msgr2=0x7f90b00b83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:19.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.101+0000 7f90b8001700 1 -- 172.21.15.63:0/4060637225 shutdown_connections 2020-05-18T21:37:19.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.101+0000 7f90b8001700 1 -- 172.21.15.63:0/4060637225 wait complete. 2020-05-18T21:37:19.119 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:37:19.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e759e700 1 Processor -- start 2020-05-18T21:37:19.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e759e700 1 -- start start 2020-05-18T21:37:19.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 0x7f90e80b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:19.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f90e8064fd0 0x7f90e814d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:19.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e814a330 con 0x7f90e814aa70 2020-05-18T21:37:19.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e814a140 con 0x7f90e8064fd0 2020-05-18T21:37:19.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e8065460 con 0x7f90e805f110 2020-05-18T21:37:19.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e6d9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f90e8064fd0 0x7f90e814d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:19.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e659c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 0x7f90e80b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:19.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e5d9b700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f90e814aa70 0x7f90e80648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:35990/0 (socket says 172.21.15.63:35990) 2020-05-18T21:37:19.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e5d9b700 1 -- 172.21.15.63:0/2403601069 learned_addr learned my addr 172.21.15.63:0/2403601069 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:19.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e6d9d700 1 -- 172.21.15.63:0/2403601069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 msgr2=0x7f90e80b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:19.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e6d9d700 1 --2- 172.21.15.63:0/2403601069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 0x7f90e80b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:19.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e6d9d700 1 -- 172.21.15.63:0/2403601069 >> v1:172.21.15.155:6789/0 conn(0x7f90e814aa70 legacy=0x7f90e80648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:19.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e6d9d700 1 -- 172.21.15.63:0/2403601069 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e814a5d0 con 0x7f90e8064fd0 2020-05-18T21:37:19.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e6d9d700 1 --2- 172.21.15.63:0/2403601069 >> v2:172.21.15.155:3300/0 conn(0x7f90e8064fd0 0x7f90e814d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f90e8063c70 tx=0x7f90e0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e6d9d700 1 --2- 172.21.15.63:0/2403601069 >> v2:172.21.15.155:3300/0 conn(0x7f90e8064fd0 0x7f90e814d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f90e8063c70 tx=0x7f90e0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e6d9d700 1 --2- 172.21.15.63:0/2403601069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90e8064fd0 0x7f90e814d710 secure :-1 s=READY pgs=1290 cs=0 l=1 rx=0x7f90e8063c70 tx=0x7f90e0008ca0).ready entity=mon.1 client_cookie=3115aac3c6a65e4e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:19.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e6d9d700 1 --2- 172.21.15.63:0/2403601069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90e8064fd0 0x7f90e814d710 secure :-1 s=THROTTLE_DONE pgs=1290 cs=0 l=1 rx=0x7f90e8063c70 tx=0x7f90e0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e559a700 1 -- 172.21.15.63:0/2403601069 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90e0011e60 con 0x7f90e8064fd0 2020-05-18T21:37:19.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e6d9d700 1 --2- 172.21.15.63:0/2403601069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90e8064fd0 0x7f90e814d710 secure :-1 s=THROTTLE_DONE pgs=1290 cs=0 l=1 rx=0x7f90e8063c70 tx=0x7f90e0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e6d9d700 1 --2- 172.21.15.63:0/2403601069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90e8064fd0 0x7f90e814d710 secure :-1 s=THROTTLE_DONE pgs=1290 cs=0 l=1 rx=0x7f90e8063c70 tx=0x7f90e0008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e559a700 1 -- 172.21.15.63:0/2403601069 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e000a180 con 0x7f90e8064fd0 2020-05-18T21:37:19.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e559a700 1 -- 172.21.15.63:0/2403601069 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90e000a560 con 0x7f90e8064fd0 2020-05-18T21:37:19.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e759e700 1 -- 172.21.15.63:0/2403601069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90e8064fd0 msgr2=0x7f90e814d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:19.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e759e700 1 --2- 172.21.15.63:0/2403601069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90e8064fd0 0x7f90e814d710 secure :-1 s=READY pgs=1290 cs=0 l=1 rx=0x7f90e8063c70 tx=0x7f90e0008ca0).stop 2020-05-18T21:37:19.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e759e700 1 -- 172.21.15.63:0/2403601069 shutdown_connections 2020-05-18T21:37:19.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e759e700 1 --2- 172.21.15.63:0/2403601069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90e8064fd0 0x7f90e814d710 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:19.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e759e700 1 --2- 172.21.15.63:0/2403601069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 0x7f90e80b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:19.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e759e700 1 -- 172.21.15.63:0/2403601069 >> 172.21.15.63:0/2403601069 conn(0x7f90e8069fc0 msgr2=0x7f90e806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:19.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e759e700 1 -- 172.21.15.63:0/2403601069 shutdown_connections 2020-05-18T21:37:19.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.221+0000 7f90e759e700 1 -- 172.21.15.63:0/2403601069 wait complete. 2020-05-18T21:37:19.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.225+0000 7f90e759e700 1 Processor -- start 2020-05-18T21:37:19.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.225+0000 7f90e759e700 1 -- start start 2020-05-18T21:37:19.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.225+0000 7f90e759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 0x7f90e8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:19.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.225+0000 7f90e759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e80b8640 con 0x7f90e814aa70 2020-05-18T21:37:19.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.225+0000 7f90e759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e80b88e0 con 0x7f90e8064fd0 2020-05-18T21:37:19.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.225+0000 7f90e759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e80b8460 con 0x7f90e805f110 2020-05-18T21:37:19.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.225+0000 7f90e6d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f90e814aa70 0x7f90e815b310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37684/0 (socket says 172.21.15.63:37684) 2020-05-18T21:37:19.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.225+0000 7f90e6d9d700 1 -- 172.21.15.63:0/2464559624 learned_addr learned my addr 172.21.15.63:0/2464559624 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:19.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.225+0000 7f90e659c700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 0x7f90e8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:19.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.225+0000 7f90d77fe700 1 -- 172.21.15.63:0/2464559624 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909307335 0 0) 0x7f90e80b8640 con 0x7f90e814aa70 2020-05-18T21:37:19.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.225+0000 7f90d77fe700 1 -- 172.21.15.63:0/2464559624 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90c4002fe0 con 0x7f90e814aa70 2020-05-18T21:37:19.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.225+0000 7f90d77fe700 1 -- 172.21.15.63:0/2464559624 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023274921 0 0) 0x7f90e80b88e0 con 0x7f90e8064fd0 2020-05-18T21:37:19.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.225+0000 7f90d77fe700 1 -- 172.21.15.63:0/2464559624 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90e80b8640 con 0x7f90e8064fd0 2020-05-18T21:37:19.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.225+0000 7f90e659c700 1 -- 172.21.15.63:0/2464559624 >> v1:172.21.15.155:6789/0 conn(0x7f90e8064fd0 legacy=0x7f90e815ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:19.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.225+0000 7f90e659c700 1 -- 172.21.15.63:0/2464559624 >> v1:172.21.15.63:6789/0 conn(0x7f90e814aa70 legacy=0x7f90e815b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:19.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.225+0000 7f90e659c700 1 -- 172.21.15.63:0/2464559624 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e8145d70 con 0x7f90e805f110 2020-05-18T21:37:19.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.225+0000 7f90e659c700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 0x7f90e8156e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f90dc002f70 tx=0x7f90dc010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.229+0000 7f90e659c700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 0x7f90e8156e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f90dc002f70 tx=0x7f90dc010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.229+0000 7f90e659c700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 0x7f90e8156e90 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7f90dc002f70 tx=0x7f90dc010c00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:19.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.229+0000 7f90e659c700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 0x7f90e8156e90 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f90dc002f70 tx=0x7f90dc010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.229+0000 7f90d77fe700 1 -- 172.21.15.63:0/2464559624 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90dc0126b0 con 0x7f90e805f110 2020-05-18T21:37:19.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.229+0000 7f90e759e700 1 -- 172.21.15.63:0/2464559624 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e80b8d80 con 0x7f90e805f110 2020-05-18T21:37:19.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.229+0000 7f90e659c700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 0x7f90e8156e90 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f90dc002f70 tx=0x7f90dc010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.229+0000 7f90e659c700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 0x7f90e8156e90 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f90dc002f70 tx=0x7f90dc010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.229+0000 7f90e759e700 1 -- 172.21.15.63:0/2464559624 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e81572f0 con 0x7f90e805f110 2020-05-18T21:37:19.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.229+0000 7f90d77fe700 1 -- 172.21.15.63:0/2464559624 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc012810 con 0x7f90e805f110 2020-05-18T21:37:19.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.229+0000 7f90d77fe700 1 -- 172.21.15.63:0/2464559624 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90dc012b70 con 0x7f90e805f110 2020-05-18T21:37:19.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.229+0000 7f90e759e700 1 -- 172.21.15.63:0/2464559624 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e80b8200 con 0x7f90e805f110 2020-05-18T21:37:19.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.229+0000 7f90e659c700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 0x7f90e8156e90 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f90dc002f70 tx=0x7f90dc010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.229+0000 7f90d77fe700 1 -- 172.21.15.63:0/2464559624 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f90dc012d70 con 0x7f90e805f110 2020-05-18T21:37:19.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.229+0000 7f90e659c700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 0x7f90e8156e90 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f90dc002f70 tx=0x7f90dc010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.229+0000 7f90d77fe700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f90c404fe80 0x7f90c4052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:19.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.229+0000 7f90d77fe700 1 -- 172.21.15.63:0/2464559624 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f90dc063af0 con 0x7f90e805f110 2020-05-18T21:37:19.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.229+0000 7f90e5d9b700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f90c404fe80 0x7f90c4052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:19.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.233+0000 7f90e5d9b700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f90c404fe80 0x7f90c4052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f90d8001020 tx=0x7f90d8001640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.233+0000 7f90e5d9b700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f90c404fe80 0x7f90c4052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f90d8001020 tx=0x7f90d8001640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.233+0000 7f90e5d9b700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f90c404fe80 0x7f90c4052340 secure :-1 s=READY pgs=759 cs=0 l=1 rx=0x7f90d8001020 tx=0x7f90d8001640).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:19.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.237+0000 7f90e659c700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 0x7f90e8156e90 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f90dc002f70 tx=0x7f90dc010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.237+0000 7f90d77fe700 1 -- 172.21.15.63:0/2464559624 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f90e80b8200 con 0x7f90e805f110 2020-05-18T21:37:19.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.357+0000 7f90e759e700 1 -- 172.21.15.63:0/2464559624 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90e80b8200 con 0x7f90e805f110 2020-05-18T21:37:19.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.357+0000 7f90e659c700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 0x7f90e8156e90 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f90dc002f70 tx=0x7f90dc010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.357+0000 7f90d77fe700 1 -- 172.21.15.63:0/2464559624 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+16116 (secure 0 0 0) 0x7f90e80b8200 con 0x7f90e805f110 2020-05-18T21:37:19.366 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:19.366 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":144,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:37:18.846403+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:37:17.318681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2020-05-18T21:37:17.835103+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:37:19.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.361+0000 7f90e759e700 1 -- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f90c404fe80 msgr2=0x7f90c4052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:19.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.361+0000 7f90e759e700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f90c404fe80 0x7f90c4052340 secure :-1 s=READY pgs=759 cs=0 l=1 rx=0x7f90d8001020 tx=0x7f90d8001640).stop 2020-05-18T21:37:19.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.361+0000 7f90e759e700 1 -- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 msgr2=0x7f90e8156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:19.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.361+0000 7f90e759e700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 0x7f90e8156e90 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7f90dc002f70 tx=0x7f90dc010c00).stop 2020-05-18T21:37:19.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.361+0000 7f90e759e700 1 -- 172.21.15.63:0/2464559624 shutdown_connections 2020-05-18T21:37:19.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.361+0000 7f90e759e700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f90c404fe80 0x7f90c4052340 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:19.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.361+0000 7f90e759e700 1 --2- 172.21.15.63:0/2464559624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90e805f110 0x7f90e8156e90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:19.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.361+0000 7f90e759e700 1 -- 172.21.15.63:0/2464559624 >> 172.21.15.63:0/2464559624 conn(0x7f90e8069fc0 msgr2=0x7f90e8143910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:19.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.361+0000 7f90e759e700 1 -- 172.21.15.63:0/2464559624 shutdown_connections 2020-05-18T21:37:19.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.361+0000 7f90e759e700 1 -- 172.21.15.63:0/2464559624 wait complete. 2020-05-18T21:37:19.379 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-05-18T21:37:19.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.489+0000 7f791997d700 1 Processor -- start 2020-05-18T21:37:19.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.489+0000 7f791997d700 1 -- start start 2020-05-18T21:37:19.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.489+0000 7f791997d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f79140b4df0 0x7f79140b2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:19.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.489+0000 7f791997d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79140b5770 con 0x7f79141437c0 2020-05-18T21:37:19.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.489+0000 7f791997d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79140b54d0 con 0x7f7914062a50 2020-05-18T21:37:19.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.489+0000 7f791997d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79140b51d0 con 0x7f79140b4df0 2020-05-18T21:37:19.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.489+0000 7f791897b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f79140b4df0 0x7f79140b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:19.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.489+0000 7f791917c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f79141437c0 0x7f79140b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37690/0 (socket says 172.21.15.63:37690) 2020-05-18T21:37:19.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.489+0000 7f791917c700 1 -- 172.21.15.63:0/2365881932 learned_addr learned my addr 172.21.15.63:0/2365881932 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:19.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.489+0000 7f791897b700 1 -- 172.21.15.63:0/2365881932 >> v1:172.21.15.155:6789/0 conn(0x7f7914062a50 legacy=0x7f79141430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:19.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.489+0000 7f791897b700 1 -- 172.21.15.63:0/2365881932 >> v1:172.21.15.63:6789/0 conn(0x7f79141437c0 legacy=0x7f79140b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:19.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.489+0000 7f791897b700 1 -- 172.21.15.63:0/2365881932 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7914062ec0 con 0x7f79140b4df0 2020-05-18T21:37:19.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.489+0000 7f791897b700 1 --2- 172.21.15.63:0/2365881932 >> v2:172.21.15.63:3300/0 conn(0x7f79140b4df0 0x7f79140b2070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7910002f70 tx=0x7f7910007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791897b700 1 --2- 172.21.15.63:0/2365881932 >> v2:172.21.15.63:3300/0 conn(0x7f79140b4df0 0x7f79140b2070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7910002f70 tx=0x7f7910007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791897b700 1 --2- 172.21.15.63:0/2365881932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79140b4df0 0x7f79140b2070 secure :-1 s=READY pgs=1949 cs=0 l=1 rx=0x7f7910002f70 tx=0x7f7910007a80).ready entity=mon.0 client_cookie=2023d682a1216d7d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:19.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791897b700 1 --2- 172.21.15.63:0/2365881932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79140b4df0 0x7f79140b2070 secure :-1 s=THROTTLE_DONE pgs=1949 cs=0 l=1 rx=0x7f7910002f70 tx=0x7f7910007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f790b7fe700 1 -- 172.21.15.63:0/2365881932 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7910008e80 con 0x7f79140b4df0 2020-05-18T21:37:19.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791897b700 1 --2- 172.21.15.63:0/2365881932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79140b4df0 0x7f79140b2070 secure :-1 s=THROTTLE_DONE pgs=1949 cs=0 l=1 rx=0x7f7910002f70 tx=0x7f7910007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791897b700 1 --2- 172.21.15.63:0/2365881932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79140b4df0 0x7f79140b2070 secure :-1 s=THROTTLE_DONE pgs=1949 cs=0 l=1 rx=0x7f7910002f70 tx=0x7f7910007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f790b7fe700 1 -- 172.21.15.63:0/2365881932 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79100116a0 con 0x7f79140b4df0 2020-05-18T21:37:19.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791997d700 1 -- 172.21.15.63:0/2365881932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79140b4df0 msgr2=0x7f79140b2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:19.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791997d700 1 --2- 172.21.15.63:0/2365881932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79140b4df0 0x7f79140b2070 secure :-1 s=READY pgs=1949 cs=0 l=1 rx=0x7f7910002f70 tx=0x7f7910007a80).stop 2020-05-18T21:37:19.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f790b7fe700 1 -- 172.21.15.63:0/2365881932 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7910011ac0 con 0x7f79140b4df0 2020-05-18T21:37:19.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791997d700 1 -- 172.21.15.63:0/2365881932 shutdown_connections 2020-05-18T21:37:19.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791997d700 1 --2- 172.21.15.63:0/2365881932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79140b4df0 0x7f79140b2070 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:19.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791997d700 1 -- 172.21.15.63:0/2365881932 >> 172.21.15.63:0/2365881932 conn(0x7f7914069b70 msgr2=0x7f7914069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:19.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791997d700 1 -- 172.21.15.63:0/2365881932 shutdown_connections 2020-05-18T21:37:19.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791997d700 1 -- 172.21.15.63:0/2365881932 wait complete. 2020-05-18T21:37:19.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791997d700 1 Processor -- start 2020-05-18T21:37:19.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791997d700 1 -- start start 2020-05-18T21:37:19.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791997d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7914062a50 0x7f79140b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:19.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791997d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f79140b4df0 0x7f7914141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:19.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791997d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79141437c0 0x7f7914154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:19.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791997d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79141421d0 con 0x7f79140b4df0 2020-05-18T21:37:19.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791997d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7914146b20 con 0x7f7914062a50 2020-05-18T21:37:19.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791997d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7914155410 con 0x7f79141437c0 2020-05-18T21:37:19.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f790bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f79140b4df0 0x7f7914141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:19.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f790bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f79140b4df0 0x7f7914141d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35508/0 (socket says 172.21.15.63:35508) 2020-05-18T21:37:19.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f790bfff700 1 -- 172.21.15.63:0/2132573773 learned_addr learned my addr 172.21.15.63:0/2132573773 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:19.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f791897b700 1 --2- 172.21.15.63:0/2132573773 >> v2:172.21.15.155:3300/0 conn(0x7f7914062a50 0x7f79140b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:19.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.493+0000 7f791917c700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79141437c0 0x7f7914154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:19.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f790bfff700 1 -- 172.21.15.63:0/2132573773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79141437c0 msgr2=0x7f7914154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:19.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f790bfff700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79141437c0 0x7f7914154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:19.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f790bfff700 1 -- 172.21.15.63:0/2132573773 >> v2:172.21.15.155:3300/0 conn(0x7f7914062a50 msgr2=0x7f79140b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:19.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f790bfff700 1 --2- 172.21.15.63:0/2132573773 >> v2:172.21.15.155:3300/0 conn(0x7f7914062a50 0x7f79140b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:19.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f790bfff700 1 -- 172.21.15.63:0/2132573773 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7914146d50 con 0x7f79140b4df0 2020-05-18T21:37:19.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f790bfff700 1 --2- 172.21.15.63:0/2132573773 >> v2:172.21.15.63:3300/0 conn(0x7f79140b4df0 0x7f7914141d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f791405c130 tx=0x7f790400c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f790bfff700 1 --2- 172.21.15.63:0/2132573773 >> v2:172.21.15.63:3300/0 conn(0x7f79140b4df0 0x7f7914141d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f791405c130 tx=0x7f790400c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f790bfff700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79140b4df0 0x7f7914141d70 secure :-1 s=READY pgs=1950 cs=0 l=1 rx=0x7f791405c130 tx=0x7f790400c4a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:19.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f790bfff700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79140b4df0 0x7f7914141d70 secure :-1 s=THROTTLE_DONE pgs=1950 cs=0 l=1 rx=0x7f791405c130 tx=0x7f790400c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f7909ffb700 1 -- 172.21.15.63:0/2132573773 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f790400cc60 con 0x7f79140b4df0 2020-05-18T21:37:19.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f790bfff700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79140b4df0 0x7f7914141d70 secure :-1 s=THROTTLE_DONE pgs=1950 cs=0 l=1 rx=0x7f791405c130 tx=0x7f790400c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f790bfff700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79140b4df0 0x7f7914141d70 secure :-1 s=THROTTLE_DONE pgs=1950 cs=0 l=1 rx=0x7f791405c130 tx=0x7f790400c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f791997d700 1 -- 172.21.15.63:0/2132573773 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79140b11c0 con 0x7f79140b4df0 2020-05-18T21:37:19.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f7909ffb700 1 -- 172.21.15.63:0/2132573773 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790400cdc0 con 0x7f79140b4df0 2020-05-18T21:37:19.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f7909ffb700 1 -- 172.21.15.63:0/2132573773 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7904011100 con 0x7f79140b4df0 2020-05-18T21:37:19.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f791997d700 1 -- 172.21.15.63:0/2132573773 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7914154c60 con 0x7f79140b4df0 2020-05-18T21:37:19.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f790bfff700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79140b4df0 0x7f7914141d70 secure :-1 s=THROTTLE_DONE pgs=1950 cs=0 l=1 rx=0x7f791405c130 tx=0x7f790400c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f790bfff700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79140b4df0 0x7f7914141d70 secure :-1 s=THROTTLE_DONE pgs=1950 cs=0 l=1 rx=0x7f791405c130 tx=0x7f790400c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f7909ffb700 1 -- 172.21.15.63:0/2132573773 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7904006520 con 0x7f79140b4df0 2020-05-18T21:37:19.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f791997d700 1 -- 172.21.15.63:0/2132573773 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7914146ee0 con 0x7f79140b4df0 2020-05-18T21:37:19.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f7909ffb700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78f404fa30 0x7f78f4051ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:19.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.497+0000 7f7909ffb700 1 -- 172.21.15.63:0/2132573773 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7904063870 con 0x7f79140b4df0 2020-05-18T21:37:19.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.501+0000 7f791897b700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78f404fa30 0x7f78f4051ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:19.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.501+0000 7f791897b700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78f404fa30 0x7f78f4051ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7910002f70 tx=0x7f7910007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.501+0000 7f791897b700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78f404fa30 0x7f78f4051ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7910002f70 tx=0x7f7910007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.501+0000 7f791897b700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78f404fa30 0x7f78f4051ef0 secure :-1 s=READY pgs=760 cs=0 l=1 rx=0x7f7910002f70 tx=0x7f7910007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:19.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.505+0000 7f790bfff700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79140b4df0 0x7f7914141d70 secure :-1 s=THROTTLE_DONE pgs=1950 cs=0 l=1 rx=0x7f791405c130 tx=0x7f790400c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.516 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.505+0000 7f7909ffb700 1 -- 172.21.15.63:0/2132573773 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f790403dba0 con 0x7f79140b4df0 2020-05-18T21:37:19.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.657+0000 7f791997d700 1 -- 172.21.15.63:0/2132573773 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f79140569e0 con 0x7f79140b4df0 2020-05-18T21:37:19.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.861+0000 7f790bfff700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79140b4df0 0x7f7914141d70 secure :-1 s=THROTTLE_DONE pgs=1950 cs=0 l=1 rx=0x7f791405c130 tx=0x7f790400c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:19.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.861+0000 7f7909ffb700 1 -- 172.21.15.63:0/2132573773 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v122) v1 ==== 118+0+0 (secure 0 0 0) 0x7f79040411c0 con 0x7f79140b4df0 2020-05-18T21:37:19.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.865+0000 7f791997d700 1 -- 172.21.15.63:0/2132573773 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78f404fa30 msgr2=0x7f78f4051ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:19.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.865+0000 7f791997d700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78f404fa30 0x7f78f4051ef0 secure :-1 s=READY pgs=760 cs=0 l=1 rx=0x7f7910002f70 tx=0x7f7910007a80).stop 2020-05-18T21:37:19.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.865+0000 7f791997d700 1 -- 172.21.15.63:0/2132573773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79140b4df0 msgr2=0x7f7914141d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:19.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.865+0000 7f791997d700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79140b4df0 0x7f7914141d70 secure :-1 s=READY pgs=1950 cs=0 l=1 rx=0x7f791405c130 tx=0x7f790400c4a0).stop 2020-05-18T21:37:19.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.865+0000 7f791997d700 1 -- 172.21.15.63:0/2132573773 shutdown_connections 2020-05-18T21:37:19.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.865+0000 7f791997d700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f78f404fa30 0x7f78f4051ef0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:19.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.865+0000 7f791997d700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79141437c0 0x7f7914154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:19.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.865+0000 7f791997d700 1 --2- 172.21.15.63:0/2132573773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79140b4df0 0x7f7914141d70 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:19.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.865+0000 7f791997d700 1 --2- 172.21.15.63:0/2132573773 >> v2:172.21.15.155:3300/0 conn(0x7f7914062a50 0x7f79140b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:19.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.865+0000 7f791997d700 1 -- 172.21.15.63:0/2132573773 >> 172.21.15.63:0/2132573773 conn(0x7f7914069b70 msgr2=0x7f79140652e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:19.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.865+0000 7f791997d700 1 -- 172.21.15.63:0/2132573773 shutdown_connections 2020-05-18T21:37:19.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.865+0000 7f791997d700 1 -- 172.21.15.63:0/2132573773 wait complete. 2020-05-18T21:37:19.885 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:19.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.993+0000 7fb2f6e0d700 1 Processor -- start 2020-05-18T21:37:19.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.993+0000 7fb2f6e0d700 1 -- start start 2020-05-18T21:37:20.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.993+0000 7fb2f6e0d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2f005b2b0 0x7fb2f0145e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:20.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.993+0000 7fb2f6e0d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb2f01462d0 0x7fb2f0099b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:20.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.993+0000 7fb2f6e0d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f00b51f0 con 0x7fb2f00b8e20 2020-05-18T21:37:20.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.993+0000 7fb2f6e0d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f01428d0 con 0x7fb2f01462d0 2020-05-18T21:37:20.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.993+0000 7fb2f6e0d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f0142b70 con 0x7fb2f005b2b0 2020-05-18T21:37:20.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.993+0000 7fb2f660c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb2f01462d0 0x7fb2f0099b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.993+0000 7fb2f5e0b700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fb2f00b8e20 0x7fb2f0145760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:36018/0 (socket says 172.21.15.63:36018) 2020-05-18T21:37:20.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.993+0000 7fb2f5e0b700 1 -- 172.21.15.63:0/4082594352 learned_addr learned my addr 172.21.15.63:0/4082594352 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:20.002 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.993+0000 7fb2f560a700 1 --2- 172.21.15.63:0/4082594352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2f005b2b0 0x7fb2f0145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.993+0000 7fb2f4e09700 1 -- 172.21.15.63:0/4082594352 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599580291 0 0) 0x7fb2f00b51f0 con 0x7fb2f00b8e20 2020-05-18T21:37:20.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.993+0000 7fb2f4e09700 1 -- 172.21.15.63:0/4082594352 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2d8003270 con 0x7fb2f00b8e20 2020-05-18T21:37:20.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.993+0000 7fb2f660c700 1 -- 172.21.15.63:0/4082594352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2f005b2b0 msgr2=0x7fb2f0145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:20.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.993+0000 7fb2f660c700 1 --2- 172.21.15.63:0/4082594352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2f005b2b0 0x7fb2f0145e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:20.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.997+0000 7fb2f660c700 1 -- 172.21.15.63:0/4082594352 >> v1:172.21.15.155:6789/0 conn(0x7fb2f00b8e20 legacy=0x7fb2f0145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.997+0000 7fb2f660c700 1 -- 172.21.15.63:0/4082594352 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f0142e10 con 0x7fb2f01462d0 2020-05-18T21:37:20.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.997+0000 7fb2f660c700 1 --2- 172.21.15.63:0/4082594352 >> v2:172.21.15.63:3300/0 conn(0x7fb2f01462d0 0x7fb2f0099b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb2e80032f0 tx=0x7fb2e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.997+0000 7fb2f660c700 1 --2- 172.21.15.63:0/4082594352 >> v2:172.21.15.63:3300/0 conn(0x7fb2f01462d0 0x7fb2f0099b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb2e80032f0 tx=0x7fb2e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.997+0000 7fb2f660c700 1 --2- 172.21.15.63:0/4082594352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f01462d0 0x7fb2f0099b00 secure :-1 s=READY pgs=1951 cs=0 l=1 rx=0x7fb2e80032f0 tx=0x7fb2e8007e00).ready entity=mon.0 client_cookie=c882594a29620b8d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:20.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.997+0000 7fb2f660c700 1 --2- 172.21.15.63:0/4082594352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f01462d0 0x7fb2f0099b00 secure :-1 s=THROTTLE_DONE pgs=1951 cs=0 l=1 rx=0x7fb2e80032f0 tx=0x7fb2e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.997+0000 7fb2f4e09700 1 -- 172.21.15.63:0/4082594352 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2e8011db0 con 0x7fb2f01462d0 2020-05-18T21:37:20.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.997+0000 7fb2f660c700 1 --2- 172.21.15.63:0/4082594352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f01462d0 0x7fb2f0099b00 secure :-1 s=THROTTLE_DONE pgs=1951 cs=0 l=1 rx=0x7fb2e80032f0 tx=0x7fb2e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.997+0000 7fb2f4e09700 1 -- 172.21.15.63:0/4082594352 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e800a180 con 0x7fb2f01462d0 2020-05-18T21:37:20.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.997+0000 7fb2f660c700 1 --2- 172.21.15.63:0/4082594352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f01462d0 0x7fb2f0099b00 secure :-1 s=THROTTLE_DONE pgs=1951 cs=0 l=1 rx=0x7fb2e80032f0 tx=0x7fb2e8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.997+0000 7fb2f4e09700 1 -- 172.21.15.63:0/4082594352 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2e800a5a0 con 0x7fb2f01462d0 2020-05-18T21:37:20.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.997+0000 7fb2f6e0d700 1 -- 172.21.15.63:0/4082594352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f01462d0 msgr2=0x7fb2f0099b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.997+0000 7fb2f6e0d700 1 --2- 172.21.15.63:0/4082594352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f01462d0 0x7fb2f0099b00 secure :-1 s=READY pgs=1951 cs=0 l=1 rx=0x7fb2e80032f0 tx=0x7fb2e8007e00).stop 2020-05-18T21:37:20.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.997+0000 7fb2f6e0d700 1 -- 172.21.15.63:0/4082594352 shutdown_connections 2020-05-18T21:37:20.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.997+0000 7fb2f6e0d700 1 --2- 172.21.15.63:0/4082594352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f01462d0 0x7fb2f0099b00 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:20.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.997+0000 7fb2f6e0d700 1 --2- 172.21.15.63:0/4082594352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2f005b2b0 0x7fb2f0145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:20.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.997+0000 7fb2f6e0d700 1 -- 172.21.15.63:0/4082594352 >> 172.21.15.63:0/4082594352 conn(0x7fb2f005f630 msgr2=0x7fb2f005a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:20.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.997+0000 7fb2f6e0d700 1 -- 172.21.15.63:0/4082594352 shutdown_connections 2020-05-18T21:37:20.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:19.997+0000 7fb2f6e0d700 1 -- 172.21.15.63:0/4082594352 wait complete. 2020-05-18T21:37:20.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.001+0000 7fb2f6e0d700 1 Processor -- start 2020-05-18T21:37:20.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.001+0000 7fb2f6e0d700 1 -- start start 2020-05-18T21:37:20.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.001+0000 7fb2f6e0d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb2f005b2b0 0x7fb2f0064730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:20.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.001+0000 7fb2f6e0d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2f01462d0 0x7fb2f01532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:20.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.001+0000 7fb2f6e0d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f0063d50 con 0x7fb2f00b8e20 2020-05-18T21:37:20.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.001+0000 7fb2f6e0d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f0141940 con 0x7fb2f005b2b0 2020-05-18T21:37:20.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.001+0000 7fb2f6e0d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f0063ff0 con 0x7fb2f01462d0 2020-05-18T21:37:20.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.001+0000 7fb2f5e0b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb2f005b2b0 0x7fb2f0064730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.001+0000 7fb2f560a700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fb2f00b8e20 0x7fb2f0065140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:36026/0 (socket says 172.21.15.63:36026) 2020-05-18T21:37:20.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.001+0000 7fb2f5e0b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb2f005b2b0 0x7fb2f0064730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35520/0 (socket says 172.21.15.63:35520) 2020-05-18T21:37:20.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.001+0000 7fb2f560a700 1 -- 172.21.15.63:0/2405087981 learned_addr learned my addr 172.21.15.63:0/2405087981 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:20.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.001+0000 7fb2f660c700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2f01462d0 0x7fb2f01532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2deffd700 1 -- 172.21.15.63:0/2405087981 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2561959911 0 0) 0x7fb2f0063d50 con 0x7fb2f00b8e20 2020-05-18T21:37:20.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2f5e0b700 1 -- 172.21.15.63:0/2405087981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2f01462d0 msgr2=0x7fb2f01532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2f5e0b700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2f01462d0 0x7fb2f01532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:20.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2f5e0b700 1 -- 172.21.15.63:0/2405087981 >> v1:172.21.15.155:6789/0 conn(0x7fb2f00b8e20 legacy=0x7fb2f0065140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2f5e0b700 1 -- 172.21.15.63:0/2405087981 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f0064290 con 0x7fb2f005b2b0 2020-05-18T21:37:20.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2f5e0b700 1 --2- 172.21.15.63:0/2405087981 >> v2:172.21.15.63:3300/0 conn(0x7fb2f005b2b0 0x7fb2f0064730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb2ec001110 tx=0x7fb2ec0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2f5e0b700 1 --2- 172.21.15.63:0/2405087981 >> v2:172.21.15.63:3300/0 conn(0x7fb2f005b2b0 0x7fb2f0064730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb2ec001110 tx=0x7fb2ec0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2f5e0b700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f005b2b0 0x7fb2f0064730 secure :-1 s=READY pgs=1952 cs=0 l=1 rx=0x7fb2ec001110 tx=0x7fb2ec0108f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:20.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2f5e0b700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f005b2b0 0x7fb2f0064730 secure :-1 s=THROTTLE_DONE pgs=1952 cs=0 l=1 rx=0x7fb2ec001110 tx=0x7fb2ec0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2deffd700 1 -- 172.21.15.63:0/2405087981 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2ec005d00 con 0x7fb2f005b2b0 2020-05-18T21:37:20.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2f5e0b700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f005b2b0 0x7fb2f0064730 secure :-1 s=THROTTLE_DONE pgs=1952 cs=0 l=1 rx=0x7fb2ec001110 tx=0x7fb2ec0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2deffd700 1 -- 172.21.15.63:0/2405087981 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ec005e60 con 0x7fb2f005b2b0 2020-05-18T21:37:20.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2f6e0d700 1 -- 172.21.15.63:0/2405087981 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f0065850 con 0x7fb2f005b2b0 2020-05-18T21:37:20.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2f5e0b700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f005b2b0 0x7fb2f0064730 secure :-1 s=THROTTLE_DONE pgs=1952 cs=0 l=1 rx=0x7fb2ec001110 tx=0x7fb2ec0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2deffd700 1 -- 172.21.15.63:0/2405087981 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2ec0062c0 con 0x7fb2f005b2b0 2020-05-18T21:37:20.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2f6e0d700 1 -- 172.21.15.63:0/2405087981 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f0153ff0 con 0x7fb2f005b2b0 2020-05-18T21:37:20.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2f5e0b700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f005b2b0 0x7fb2f0064730 secure :-1 s=THROTTLE_DONE pgs=1952 cs=0 l=1 rx=0x7fb2ec001110 tx=0x7fb2ec0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2deffd700 1 -- 172.21.15.63:0/2405087981 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb2ec0064c0 con 0x7fb2f005b2b0 2020-05-18T21:37:20.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2f5e0b700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f005b2b0 0x7fb2f0064730 secure :-1 s=THROTTLE_DONE pgs=1952 cs=0 l=1 rx=0x7fb2ec001110 tx=0x7fb2ec0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2f6e0d700 1 -- 172.21.15.63:0/2405087981 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f0064420 con 0x7fb2f005b2b0 2020-05-18T21:37:20.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2deffd700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb2d004f880 0x7fb2d0051d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:20.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2deffd700 1 -- 172.21.15.63:0/2405087981 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb2ec0090c0 con 0x7fb2f005b2b0 2020-05-18T21:37:20.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2f560a700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb2d004f880 0x7fb2d0051d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2f560a700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb2d004f880 0x7fb2d0051d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb2e00090f0 tx=0x7fb2e0009a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2f560a700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb2d004f880 0x7fb2d0051d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb2e00090f0 tx=0x7fb2e0009a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.005+0000 7fb2f560a700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb2d004f880 0x7fb2d0051d40 secure :-1 s=READY pgs=761 cs=0 l=1 rx=0x7fb2e00090f0 tx=0x7fb2e0009a20).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:20.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.013+0000 7fb2f5e0b700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f005b2b0 0x7fb2f0064730 secure :-1 s=THROTTLE_DONE pgs=1952 cs=0 l=1 rx=0x7fb2ec001110 tx=0x7fb2ec0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.013+0000 7fb2deffd700 1 -- 172.21.15.63:0/2405087981 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb2ec03e060 con 0x7fb2f005b2b0 2020-05-18T21:37:20.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.157+0000 7fb2f6e0d700 1 -- 172.21.15.63:0/2405087981 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2f00569e0 con 0x7fb2f005b2b0 2020-05-18T21:37:20.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.161+0000 7fb2f5e0b700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f005b2b0 0x7fb2f0064730 secure :-1 s=THROTTLE_DONE pgs=1952 cs=0 l=1 rx=0x7fb2ec001110 tx=0x7fb2ec0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.161+0000 7fb2deffd700 1 -- 172.21.15.63:0/2405087981 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 122 v122) v1 ==== 95+0+2149 (secure 0 0 0) 0x7fb2ec041680 con 0x7fb2f005b2b0 2020-05-18T21:37:20.167 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:20.167 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":122,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6953,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1677585089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1677585089},{"type":"v1","addr":"172.21.15.155:6835","nonce":1677585089}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":120}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:18.846766+0000","modified":"2020-05-18T21:37:19.851598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9628":{"gid":9628,"name":"a","rank":0,"incarnation":121,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/2601706233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2601706233},{"type":"v1","addr":"172.21.15.63:6833","nonce":2601706233}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-05-18T21:37:20.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.161+0000 7fb2f6e0d700 1 -- 172.21.15.63:0/2405087981 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb2d004f880 msgr2=0x7fb2d0051d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.161+0000 7fb2f6e0d700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb2d004f880 0x7fb2d0051d40 secure :-1 s=READY pgs=761 cs=0 l=1 rx=0x7fb2e00090f0 tx=0x7fb2e0009a20).stop 2020-05-18T21:37:20.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.161+0000 7fb2f6e0d700 1 -- 172.21.15.63:0/2405087981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f005b2b0 msgr2=0x7fb2f0064730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.161+0000 7fb2f6e0d700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f005b2b0 0x7fb2f0064730 secure :-1 s=READY pgs=1952 cs=0 l=1 rx=0x7fb2ec001110 tx=0x7fb2ec0108f0).stop 2020-05-18T21:37:20.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.161+0000 7fb2f6e0d700 1 -- 172.21.15.63:0/2405087981 shutdown_connections 2020-05-18T21:37:20.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.161+0000 7fb2f6e0d700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb2d004f880 0x7fb2d0051d40 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:20.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.161+0000 7fb2f6e0d700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2f01462d0 0x7fb2f01532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:20.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.161+0000 7fb2f6e0d700 1 --2- 172.21.15.63:0/2405087981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f005b2b0 0x7fb2f0064730 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:20.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.161+0000 7fb2f6e0d700 1 -- 172.21.15.63:0/2405087981 >> 172.21.15.63:0/2405087981 conn(0x7fb2f005f630 msgr2=0x7fb2f0142030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:20.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.161+0000 7fb2f6e0d700 1 -- 172.21.15.63:0/2405087981 shutdown_connections 2020-05-18T21:37:20.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.161+0000 7fb2f6e0d700 1 -- 172.21.15.63:0/2405087981 wait complete. 2020-05-18T21:37:20.172 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 122 2020-05-18T21:37:20.179 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:37:20.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.273+0000 7f55288d3700 1 Processor -- start 2020-05-18T21:37:20.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.273+0000 7f55288d3700 1 -- start start 2020-05-18T21:37:20.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.273+0000 7f55288d3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55240b4760 0x7f55240648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:20.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.273+0000 7f55288d3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5524064d20 0x7f552414d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:20.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.273+0000 7f55288d3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552414a330 con 0x7f552405f110 2020-05-18T21:37:20.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.273+0000 7f55288d3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552414a140 con 0x7f55240b4760 2020-05-18T21:37:20.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.273+0000 7f55288d3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552414a5d0 con 0x7f5524064d20 2020-05-18T21:37:20.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f5522d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f552405f110 0x7f552414aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37718/0 (socket says 172.21.15.63:37718) 2020-05-18T21:37:20.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f5522d9d700 1 -- 172.21.15.63:0/2348507409 learned_addr learned my addr 172.21.15.63:0/2348507409 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:20.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f552259c700 1 --2- 172.21.15.63:0/2348507409 >> v2:172.21.15.155:3300/0 conn(0x7f55240b4760 0x7f55240648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f552359e700 1 --2- 172.21.15.63:0/2348507409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5524064d20 0x7f552414d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f5521d9b700 1 -- 172.21.15.63:0/2348507409 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163917948 0 0) 0x7f552414a330 con 0x7f552405f110 2020-05-18T21:37:20.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f5521d9b700 1 -- 172.21.15.63:0/2348507409 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5504003270 con 0x7f552405f110 2020-05-18T21:37:20.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f552259c700 1 -- 172.21.15.63:0/2348507409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5524064d20 msgr2=0x7f552414d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:20.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f552259c700 1 --2- 172.21.15.63:0/2348507409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5524064d20 0x7f552414d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:20.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f552259c700 1 -- 172.21.15.63:0/2348507409 >> v1:172.21.15.63:6789/0 conn(0x7f552405f110 legacy=0x7f552414aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f552259c700 1 -- 172.21.15.63:0/2348507409 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5524063430 con 0x7f55240b4760 2020-05-18T21:37:20.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f552359e700 1 --2- 172.21.15.63:0/2348507409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5524064d20 0x7f552414d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:20.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f552259c700 1 --2- 172.21.15.63:0/2348507409 >> v2:172.21.15.155:3300/0 conn(0x7f55240b4760 0x7f55240648c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f550c002f70 tx=0x7f550c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f552259c700 1 --2- 172.21.15.63:0/2348507409 >> v2:172.21.15.155:3300/0 conn(0x7f55240b4760 0x7f55240648c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f550c002f70 tx=0x7f550c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f552259c700 1 --2- 172.21.15.63:0/2348507409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55240b4760 0x7f55240648c0 secure :-1 s=READY pgs=1295 cs=0 l=1 rx=0x7f550c002f70 tx=0x7f550c007a80).ready entity=mon.1 client_cookie=16a63aa69c108083 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:20.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f552259c700 1 --2- 172.21.15.63:0/2348507409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55240b4760 0x7f55240648c0 secure :-1 s=THROTTLE_DONE pgs=1295 cs=0 l=1 rx=0x7f550c002f70 tx=0x7f550c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f5521d9b700 1 -- 172.21.15.63:0/2348507409 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f550c008e80 con 0x7f55240b4760 2020-05-18T21:37:20.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f552259c700 1 --2- 172.21.15.63:0/2348507409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55240b4760 0x7f55240648c0 secure :-1 s=THROTTLE_DONE pgs=1295 cs=0 l=1 rx=0x7f550c002f70 tx=0x7f550c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f552259c700 1 --2- 172.21.15.63:0/2348507409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55240b4760 0x7f55240648c0 secure :-1 s=THROTTLE_DONE pgs=1295 cs=0 l=1 rx=0x7f550c002f70 tx=0x7f550c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f5521d9b700 1 -- 172.21.15.63:0/2348507409 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c011540 con 0x7f55240b4760 2020-05-18T21:37:20.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f5521d9b700 1 -- 172.21.15.63:0/2348507409 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f550c011960 con 0x7f55240b4760 2020-05-18T21:37:20.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f55288d3700 1 -- 172.21.15.63:0/2348507409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55240b4760 msgr2=0x7f55240648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f55288d3700 1 --2- 172.21.15.63:0/2348507409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55240b4760 0x7f55240648c0 secure :-1 s=READY pgs=1295 cs=0 l=1 rx=0x7f550c002f70 tx=0x7f550c007a80).stop 2020-05-18T21:37:20.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f55288d3700 1 -- 172.21.15.63:0/2348507409 shutdown_connections 2020-05-18T21:37:20.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f55288d3700 1 --2- 172.21.15.63:0/2348507409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5524064d20 0x7f552414d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:20.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f55288d3700 1 --2- 172.21.15.63:0/2348507409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55240b4760 0x7f55240648c0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:20.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f55288d3700 1 -- 172.21.15.63:0/2348507409 >> 172.21.15.63:0/2348507409 conn(0x7f5524069fc0 msgr2=0x7f552406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:20.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f55288d3700 1 -- 172.21.15.63:0/2348507409 shutdown_connections 2020-05-18T21:37:20.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.277+0000 7f55288d3700 1 -- 172.21.15.63:0/2348507409 wait complete. 2020-05-18T21:37:20.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.281+0000 7f55288d3700 1 Processor -- start 2020-05-18T21:37:20.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.281+0000 7f55288d3700 1 -- start start 2020-05-18T21:37:20.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.281+0000 7f55288d3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f552405f110 0x7f5524133120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:20.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.281+0000 7f55288d3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5524064d20 0x7f5524133580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:20.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.281+0000 7f55288d3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5524149f60 con 0x7f55240b4760 2020-05-18T21:37:20.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.281+0000 7f55288d3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5524149600 con 0x7f5524064d20 2020-05-18T21:37:20.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.281+0000 7f55288d3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55241498a0 con 0x7f552405f110 2020-05-18T21:37:20.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.281+0000 7f552259c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5524064d20 0x7f5524133580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.281+0000 7f552259c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5524064d20 0x7f5524133580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35534/0 (socket says 172.21.15.63:35534) 2020-05-18T21:37:20.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.281+0000 7f552259c700 1 -- 172.21.15.63:0/2503172276 learned_addr learned my addr 172.21.15.63:0/2503172276 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:20.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.281+0000 7f5522d9d700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f552405f110 0x7f5524133120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f552259c700 1 -- 172.21.15.63:0/2503172276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f552405f110 msgr2=0x7f5524133120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f552259c700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f552405f110 0x7f5524133120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:20.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f551bfff700 1 -- 172.21.15.63:0/2503172276 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038834935 0 0) 0x7f5524149f60 con 0x7f55240b4760 2020-05-18T21:37:20.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f552259c700 1 -- 172.21.15.63:0/2503172276 >> v1:172.21.15.155:6789/0 conn(0x7f55240b4760 legacy=0x7f55241427b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f552259c700 1 -- 172.21.15.63:0/2503172276 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5524149b40 con 0x7f5524064d20 2020-05-18T21:37:20.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f552259c700 1 --2- 172.21.15.63:0/2503172276 >> v2:172.21.15.63:3300/0 conn(0x7f5524064d20 0x7f5524133580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f550c002f70 tx=0x7f550c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f552259c700 1 --2- 172.21.15.63:0/2503172276 >> v2:172.21.15.63:3300/0 conn(0x7f5524064d20 0x7f5524133580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f550c002f70 tx=0x7f550c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f552259c700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5524064d20 0x7f5524133580 secure :-1 s=READY pgs=1954 cs=0 l=1 rx=0x7f550c002f70 tx=0x7f550c007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:20.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f552259c700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5524064d20 0x7f5524133580 secure :-1 s=THROTTLE_DONE pgs=1954 cs=0 l=1 rx=0x7f550c002f70 tx=0x7f550c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f551bfff700 1 -- 172.21.15.63:0/2503172276 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f550c0118d0 con 0x7f5524064d20 2020-05-18T21:37:20.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f552259c700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5524064d20 0x7f5524133580 secure :-1 s=THROTTLE_DONE pgs=1954 cs=0 l=1 rx=0x7f550c002f70 tx=0x7f550c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f552259c700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5524064d20 0x7f5524133580 secure :-1 s=THROTTLE_DONE pgs=1954 cs=0 l=1 rx=0x7f550c002f70 tx=0x7f550c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f551bfff700 1 -- 172.21.15.63:0/2503172276 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c011a30 con 0x7f5524064d20 2020-05-18T21:37:20.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f551bfff700 1 -- 172.21.15.63:0/2503172276 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f550c007360 con 0x7f5524064d20 2020-05-18T21:37:20.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f55288d3700 1 -- 172.21.15.63:0/2503172276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55241339e0 con 0x7f5524064d20 2020-05-18T21:37:20.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f55288d3700 1 -- 172.21.15.63:0/2503172276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5524143060 con 0x7f5524064d20 2020-05-18T21:37:20.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f552259c700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5524064d20 0x7f5524133580 secure :-1 s=THROTTLE_DONE pgs=1954 cs=0 l=1 rx=0x7f550c002f70 tx=0x7f550c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f55288d3700 1 -- 172.21.15.63:0/2503172276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55240569e0 con 0x7f5524064d20 2020-05-18T21:37:20.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f551bfff700 1 -- 172.21.15.63:0/2503172276 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f550c0080e0 con 0x7f5524064d20 2020-05-18T21:37:20.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f552259c700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5524064d20 0x7f5524133580 secure :-1 s=THROTTLE_DONE pgs=1954 cs=0 l=1 rx=0x7f550c002f70 tx=0x7f550c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f551bfff700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f550804f880 0x7f5508051d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:20.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f551bfff700 1 -- 172.21.15.63:0/2503172276 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f550c064140 con 0x7f5524064d20 2020-05-18T21:37:20.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.285+0000 7f5522d9d700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f550804f880 0x7f5508051d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.289+0000 7f5522d9d700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f550804f880 0x7f5508051d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5514001110 tx=0x7f5514001d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.289+0000 7f5522d9d700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f550804f880 0x7f5508051d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5514001110 tx=0x7f5514001d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.289+0000 7f5522d9d700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f550804f880 0x7f5508051d40 secure :-1 s=READY pgs=762 cs=0 l=1 rx=0x7f5514001110 tx=0x7f5514001d80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:20.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.293+0000 7f552259c700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5524064d20 0x7f5524133580 secure :-1 s=THROTTLE_DONE pgs=1954 cs=0 l=1 rx=0x7f550c002f70 tx=0x7f550c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.293+0000 7f551bfff700 1 -- 172.21.15.63:0/2503172276 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f550c03e5f0 con 0x7f5524064d20 2020-05-18T21:37:20.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.413+0000 7f55288d3700 1 -- 172.21.15.63:0/2503172276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f552414aea0 con 0x7f5524064d20 2020-05-18T21:37:20.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.413+0000 7f552259c700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5524064d20 0x7f5524133580 secure :-1 s=THROTTLE_DONE pgs=1954 cs=0 l=1 rx=0x7f550c002f70 tx=0x7f550c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.413+0000 7f551bfff700 1 -- 172.21.15.63:0/2503172276 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f550c041c10 con 0x7f5524064d20 2020-05-18T21:37:20.420 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:20.420 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":145,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:37:19.851196+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:37:17.318681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2020-05-18T21:37:17.835103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:37:20.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.417+0000 7f55288d3700 1 -- 172.21.15.63:0/2503172276 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f550804f880 msgr2=0x7f5508051d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.417+0000 7f55288d3700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f550804f880 0x7f5508051d40 secure :-1 s=READY pgs=762 cs=0 l=1 rx=0x7f5514001110 tx=0x7f5514001d80).stop 2020-05-18T21:37:20.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.417+0000 7f55288d3700 1 -- 172.21.15.63:0/2503172276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5524064d20 msgr2=0x7f5524133580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.417+0000 7f55288d3700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5524064d20 0x7f5524133580 secure :-1 s=READY pgs=1954 cs=0 l=1 rx=0x7f550c002f70 tx=0x7f550c007a80).stop 2020-05-18T21:37:20.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.417+0000 7f55288d3700 1 -- 172.21.15.63:0/2503172276 shutdown_connections 2020-05-18T21:37:20.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.417+0000 7f55288d3700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f550804f880 0x7f5508051d40 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:20.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.417+0000 7f55288d3700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5524064d20 0x7f5524133580 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:20.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.417+0000 7f55288d3700 1 --2- 172.21.15.63:0/2503172276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f552405f110 0x7f5524133120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:20.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.417+0000 7f55288d3700 1 -- 172.21.15.63:0/2503172276 >> 172.21.15.63:0/2503172276 conn(0x7f5524069fc0 msgr2=0x7f55240b55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:20.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.417+0000 7f55288d3700 1 -- 172.21.15.63:0/2503172276 shutdown_connections 2020-05-18T21:37:20.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.417+0000 7f55288d3700 1 -- 172.21.15.63:0/2503172276 wait complete. 2020-05-18T21:37:20.433 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:37:20.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.545+0000 7f867f59e700 1 Processor -- start 2020-05-18T21:37:20.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.545+0000 7f867f59e700 1 -- start start 2020-05-18T21:37:20.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.545+0000 7f867f59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f86800b6410 0x7f86800b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:20.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.545+0000 7f867f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8680151bc0 0x7f8680152030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:20.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.545+0000 7f867f59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8680025500 con 0x7f86800b5cb0 2020-05-18T21:37:20.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.545+0000 7f867f59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8680064ee0 con 0x7f86800b6410 2020-05-18T21:37:20.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.545+0000 7f867f59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86800b67f0 con 0x7f8680151bc0 2020-05-18T21:37:20.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.545+0000 7f867ed9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f86800b6410 0x7f86800b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.545+0000 7f8684af7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8680151bc0 0x7f8680152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.545+0000 7f867659c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f86800b5cb0 0x7f8680061af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:36048/0 (socket says 172.21.15.63:36048) 2020-05-18T21:37:20.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.545+0000 7f867659c700 1 -- 172.21.15.63:0/3991769229 learned_addr learned my addr 172.21.15.63:0/3991769229 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:20.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.549+0000 7f8684af7700 1 -- 172.21.15.63:0/3991769229 >> v2:172.21.15.155:3300/0 conn(0x7f86800b6410 msgr2=0x7f86800b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:20.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.549+0000 7f8684af7700 1 --2- 172.21.15.63:0/3991769229 >> v2:172.21.15.155:3300/0 conn(0x7f86800b6410 0x7f86800b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:20.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.549+0000 7f8684af7700 1 -- 172.21.15.63:0/3991769229 >> v1:172.21.15.155:6789/0 conn(0x7f86800b5cb0 legacy=0x7f8680061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.549+0000 7f8684af7700 1 -- 172.21.15.63:0/3991769229 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8680025180 con 0x7f8680151bc0 2020-05-18T21:37:20.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.549+0000 7f8684af7700 1 --2- 172.21.15.63:0/3991769229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8680151bc0 0x7f8680152030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f86780032f0 tx=0x7f8678007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.549+0000 7f8684af7700 1 --2- 172.21.15.63:0/3991769229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8680151bc0 0x7f8680152030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f86780032f0 tx=0x7f8678007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.549+0000 7f8684af7700 1 --2- 172.21.15.63:0/3991769229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8680151bc0 0x7f8680152030 secure :-1 s=READY pgs=298 cs=0 l=1 rx=0x7f86780032f0 tx=0x7f8678007e00).ready entity=mon.2 client_cookie=e389932f2c19541e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:20.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.549+0000 7f8684af7700 1 --2- 172.21.15.63:0/3991769229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8680151bc0 0x7f8680152030 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7f86780032f0 tx=0x7f8678007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.549+0000 7f867e59c700 1 -- 172.21.15.63:0/3991769229 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8678011e60 con 0x7f8680151bc0 2020-05-18T21:37:20.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.549+0000 7f8684af7700 1 --2- 172.21.15.63:0/3991769229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8680151bc0 0x7f8680152030 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7f86780032f0 tx=0x7f8678007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.549+0000 7f8684af7700 1 --2- 172.21.15.63:0/3991769229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8680151bc0 0x7f8680152030 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7f86780032f0 tx=0x7f8678007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.549+0000 7f867e59c700 1 -- 172.21.15.63:0/3991769229 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867800a180 con 0x7f8680151bc0 2020-05-18T21:37:20.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.549+0000 7f867e59c700 1 -- 172.21.15.63:0/3991769229 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f867800a560 con 0x7f8680151bc0 2020-05-18T21:37:20.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.549+0000 7f867f59e700 1 -- 172.21.15.63:0/3991769229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8680151bc0 msgr2=0x7f8680152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.549+0000 7f867f59e700 1 --2- 172.21.15.63:0/3991769229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8680151bc0 0x7f8680152030 secure :-1 s=READY pgs=298 cs=0 l=1 rx=0x7f86780032f0 tx=0x7f8678007e00).stop 2020-05-18T21:37:20.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.553+0000 7f867f59e700 1 -- 172.21.15.63:0/3991769229 shutdown_connections 2020-05-18T21:37:20.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.553+0000 7f867f59e700 1 --2- 172.21.15.63:0/3991769229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8680151bc0 0x7f8680152030 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:20.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.553+0000 7f867f59e700 1 --2- 172.21.15.63:0/3991769229 >> v2:172.21.15.155:3300/0 conn(0x7f86800b6410 0x7f86800b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:20.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.553+0000 7f867f59e700 1 -- 172.21.15.63:0/3991769229 >> 172.21.15.63:0/3991769229 conn(0x7f8680069b70 msgr2=0x7f8680069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:20.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.553+0000 7f867f59e700 1 -- 172.21.15.63:0/3991769229 shutdown_connections 2020-05-18T21:37:20.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.553+0000 7f867f59e700 1 -- 172.21.15.63:0/3991769229 wait complete. 2020-05-18T21:37:20.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.553+0000 7f867f59e700 1 Processor -- start 2020-05-18T21:37:20.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.553+0000 7f867f59e700 1 -- start start 2020-05-18T21:37:20.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867f59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f86800b6410 0x7f86800654e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:20.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8680151bc0 0x7f8680139e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:20.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867f59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8680131550 con 0x7f86800b5cb0 2020-05-18T21:37:20.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867f59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86801317f0 con 0x7f86800b6410 2020-05-18T21:37:20.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867f59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8680065940 con 0x7f8680151bc0 2020-05-18T21:37:20.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f86800b6410 0x7f86800654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867ed9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f86800b5cb0 0x7f8680130d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37736/0 (socket says 172.21.15.63:37736) 2020-05-18T21:37:20.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867ed9d700 1 -- 172.21.15.63:0/300536915 learned_addr learned my addr 172.21.15.63:0/300536915 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:20.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f8684af7700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8680151bc0 0x7f8680139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867659c700 1 -- 172.21.15.63:0/300536915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8680151bc0 msgr2=0x7f8680139e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867659c700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8680151bc0 0x7f8680139e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:20.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867659c700 1 -- 172.21.15.63:0/300536915 >> v1:172.21.15.63:6789/0 conn(0x7f86800b5cb0 legacy=0x7f8680130d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f8677fff700 1 -- 172.21.15.63:0/300536915 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461828560 0 0) 0x7f8680131550 con 0x7f86800b5cb0 2020-05-18T21:37:20.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867659c700 1 -- 172.21.15.63:0/300536915 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8680065ab0 con 0x7f86800b6410 2020-05-18T21:37:20.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867659c700 1 --2- 172.21.15.63:0/300536915 >> v2:172.21.15.63:3300/0 conn(0x7f86800b6410 0x7f86800654e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8680061560 tx=0x7f86680108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867659c700 1 --2- 172.21.15.63:0/300536915 >> v2:172.21.15.63:3300/0 conn(0x7f86800b6410 0x7f86800654e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8680061560 tx=0x7f86680108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867659c700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86800b6410 0x7f86800654e0 secure :-1 s=READY pgs=1956 cs=0 l=1 rx=0x7f8680061560 tx=0x7f86680108d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:20.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867659c700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86800b6410 0x7f86800654e0 secure :-1 s=THROTTLE_DONE pgs=1956 cs=0 l=1 rx=0x7f8680061560 tx=0x7f86680108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867659c700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86800b6410 0x7f86800654e0 secure :-1 s=THROTTLE_DONE pgs=1956 cs=0 l=1 rx=0x7f8680061560 tx=0x7f86680108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f8677fff700 1 -- 172.21.15.63:0/300536915 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8668005ce0 con 0x7f86800b6410 2020-05-18T21:37:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867659c700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86800b6410 0x7f86800654e0 secure :-1 s=THROTTLE_DONE pgs=1956 cs=0 l=1 rx=0x7f8680061560 tx=0x7f86680108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f8677fff700 1 -- 172.21.15.63:0/300536915 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8668005e40 con 0x7f86800b6410 2020-05-18T21:37:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867f59e700 1 -- 172.21.15.63:0/300536915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86800af0c0 con 0x7f86800b6410 2020-05-18T21:37:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f8677fff700 1 -- 172.21.15.63:0/300536915 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86680062c0 con 0x7f86800b6410 2020-05-18T21:37:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867f59e700 1 -- 172.21.15.63:0/300536915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868013a450 con 0x7f86800b6410 2020-05-18T21:37:20.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867659c700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86800b6410 0x7f86800654e0 secure :-1 s=THROTTLE_DONE pgs=1956 cs=0 l=1 rx=0x7f8680061560 tx=0x7f86680108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.557+0000 7f867f59e700 1 -- 172.21.15.63:0/300536915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868013aaf0 con 0x7f86800b6410 2020-05-18T21:37:20.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.561+0000 7f8677fff700 1 -- 172.21.15.63:0/300536915 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8668006420 con 0x7f86800b6410 2020-05-18T21:37:20.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.561+0000 7f867659c700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86800b6410 0x7f86800654e0 secure :-1 s=THROTTLE_DONE pgs=1956 cs=0 l=1 rx=0x7f8680061560 tx=0x7f86680108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.561+0000 7f8677fff700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f866404f860 0x7f8664051d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:20.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.561+0000 7f8677fff700 1 -- 172.21.15.63:0/300536915 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f86680090c0 con 0x7f86800b6410 2020-05-18T21:37:20.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.561+0000 7f867ed9d700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f866404f860 0x7f8664051d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.561+0000 7f867ed9d700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f866404f860 0x7f8664051d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8670007fe0 tx=0x7f86700090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.561+0000 7f867ed9d700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f866404f860 0x7f8664051d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8670007fe0 tx=0x7f86700090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.561+0000 7f867ed9d700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f866404f860 0x7f8664051d20 secure :-1 s=READY pgs=763 cs=0 l=1 rx=0x7f8670007fe0 tx=0x7f86700090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:20.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.565+0000 7f867659c700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86800b6410 0x7f86800654e0 secure :-1 s=THROTTLE_DONE pgs=1956 cs=0 l=1 rx=0x7f8680061560 tx=0x7f86680108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.565+0000 7f8677fff700 1 -- 172.21.15.63:0/300536915 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f866803dfa0 con 0x7f86800b6410 2020-05-18T21:37:20.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.721+0000 7f867f59e700 1 -- 172.21.15.63:0/300536915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8680131b70 con 0x7f86800b6410 2020-05-18T21:37:20.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.729+0000 7f867659c700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86800b6410 0x7f86800654e0 secure :-1 s=THROTTLE_DONE pgs=1956 cs=0 l=1 rx=0x7f8680061560 tx=0x7f86680108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.729+0000 7f8677fff700 1 -- 172.21.15.63:0/300536915 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v55) v1 ==== 184+0+0 (secure 0 0 0) 0x7f86680415c0 con 0x7f86800b6410 2020-05-18T21:37:20.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.733+0000 7f867f59e700 1 -- 172.21.15.63:0/300536915 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f866404f860 msgr2=0x7f8664051d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.733+0000 7f867f59e700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f866404f860 0x7f8664051d20 secure :-1 s=READY pgs=763 cs=0 l=1 rx=0x7f8670007fe0 tx=0x7f86700090f0).stop 2020-05-18T21:37:20.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.733+0000 7f867f59e700 1 -- 172.21.15.63:0/300536915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86800b6410 msgr2=0x7f86800654e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.733+0000 7f867f59e700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86800b6410 0x7f86800654e0 secure :-1 s=READY pgs=1956 cs=0 l=1 rx=0x7f8680061560 tx=0x7f86680108d0).stop 2020-05-18T21:37:20.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.733+0000 7f867f59e700 1 -- 172.21.15.63:0/300536915 shutdown_connections 2020-05-18T21:37:20.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.733+0000 7f867f59e700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f866404f860 0x7f8664051d20 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:20.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.733+0000 7f867f59e700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8680151bc0 0x7f8680139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:20.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.733+0000 7f867f59e700 1 --2- 172.21.15.63:0/300536915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86800b6410 0x7f86800654e0 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:20.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.733+0000 7f867f59e700 1 -- 172.21.15.63:0/300536915 >> 172.21.15.63:0/300536915 conn(0x7f8680069b70 msgr2=0x7f868012f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:20.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.733+0000 7f867f59e700 1 -- 172.21.15.63:0/300536915 shutdown_connections 2020-05-18T21:37:20.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.733+0000 7f867f59e700 1 -- 172.21.15.63:0/300536915 wait complete. 2020-05-18T21:37:20.744 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.0 2020-05-18T21:37:20.753 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:37:20.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f7557f07700 1 Processor -- start 2020-05-18T21:37:20.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f7557f07700 1 -- start start 2020-05-18T21:37:20.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f7557f07700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75500b8c30 0x7f75501566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:20.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f7557f07700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7550157260 0x7f755015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:20.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f7557f07700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7550065a70 con 0x7f75500ad070 2020-05-18T21:37:20.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f7557f07700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75500801d0 con 0x7f7550157260 2020-05-18T21:37:20.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f7557f07700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75500b5ae0 con 0x7f75500b8c30 2020-05-18T21:37:20.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f7555ca3700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f75500ad070 0x7f7550156b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37744/0 (socket says 172.21.15.63:37744) 2020-05-18T21:37:20.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f7555ca3700 1 -- 172.21.15.63:0/3198455949 learned_addr learned my addr 172.21.15.63:0/3198455949 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:20.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f7556ca5700 1 --2- 172.21.15.63:0/3198455949 >> v2:172.21.15.155:3300/0 conn(0x7f7550157260 0x7f755015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f75564a4700 1 --2- 172.21.15.63:0/3198455949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75500b8c30 0x7f75501566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f75554a2700 1 -- 172.21.15.63:0/3198455949 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895231591 0 0) 0x7f7550065a70 con 0x7f75500ad070 2020-05-18T21:37:20.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f75554a2700 1 -- 172.21.15.63:0/3198455949 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7538003270 con 0x7f75500ad070 2020-05-18T21:37:20.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f75554a2700 1 -- 172.21.15.63:0/3198455949 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1653400053 0 0) 0x7f7538003270 con 0x7f75500ad070 2020-05-18T21:37:20.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f75554a2700 1 -- 172.21.15.63:0/3198455949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75500b8c30 msgr2=0x7f75501566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:20.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f75554a2700 1 --2- 172.21.15.63:0/3198455949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75500b8c30 0x7f75501566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:20.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f75554a2700 1 -- 172.21.15.63:0/3198455949 >> v2:172.21.15.155:3300/0 conn(0x7f7550157260 msgr2=0x7f755015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:20.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f75554a2700 1 --2- 172.21.15.63:0/3198455949 >> v2:172.21.15.155:3300/0 conn(0x7f7550157260 0x7f755015c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:20.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f75554a2700 1 -- 172.21.15.63:0/3198455949 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75500b9010 con 0x7f75500ad070 2020-05-18T21:37:20.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f75564a4700 1 --2- 172.21.15.63:0/3198455949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75500b8c30 0x7f75501566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:20.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f75554a2700 1 -- 172.21.15.63:0/3198455949 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f7544001710 con 0x7f75500ad070 2020-05-18T21:37:20.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f75554a2700 1 -- 172.21.15.63:0/3198455949 >> v1:172.21.15.63:6789/0 conn(0x7f75500ad070 legacy=0x7f7550156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f75554a2700 1 --2- 172.21.15.63:0/3198455949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75500b8c30 0x7f7538003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:20.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f75554a2700 1 --2- 172.21.15.63:0/3198455949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7538003bc0 0x7f7538004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:20.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f75554a2700 1 --2- 172.21.15.63:0/3198455949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75380045b0 0x7f7538004a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:20.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f75554a2700 1 -- 172.21.15.63:0/3198455949 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75500801d0 con 0x7f7538003bc0 2020-05-18T21:37:20.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f75554a2700 1 -- 172.21.15.63:0/3198455949 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75500b5ae0 con 0x7f75380045b0 2020-05-18T21:37:20.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f75554a2700 1 -- 172.21.15.63:0/3198455949 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75380050d0 con 0x7f75500b8c30 2020-05-18T21:37:20.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.865+0000 7f7555ca3700 1 --2- 172.21.15.63:0/3198455949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7538003bc0 0x7f7538004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f7556ca5700 1 --2- 172.21.15.63:0/3198455949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75380045b0 0x7f7538004a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f75564a4700 1 --2- 172.21.15.63:0/3198455949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75500b8c30 0x7f7538003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f7555ca3700 1 -- 172.21.15.63:0/3198455949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75500b8c30 msgr2=0x7f7538003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:20.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f7555ca3700 1 --2- 172.21.15.63:0/3198455949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75500b8c30 0x7f7538003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:20.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f7555ca3700 1 -- 172.21.15.63:0/3198455949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75380045b0 msgr2=0x7f7538004a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:20.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f7555ca3700 1 --2- 172.21.15.63:0/3198455949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75380045b0 0x7f7538004a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:20.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f7555ca3700 1 -- 172.21.15.63:0/3198455949 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7538003270 con 0x7f7538003bc0 2020-05-18T21:37:20.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f75564a4700 1 --2- 172.21.15.63:0/3198455949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75500b8c30 0x7f7538003760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:37:20.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f7555ca3700 1 --2- 172.21.15.63:0/3198455949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7538003bc0 0x7f7538004020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7544001000 tx=0x7f7550066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f7555ca3700 1 --2- 172.21.15.63:0/3198455949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7538003bc0 0x7f7538004020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7544001000 tx=0x7f7550066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f7555ca3700 1 --2- 172.21.15.63:0/3198455949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7538003bc0 0x7f7538004020 secure :-1 s=READY pgs=1958 cs=0 l=1 rx=0x7f7544001000 tx=0x7f7550066290).ready entity=mon.0 client_cookie=fd9b6d0557bb2a5d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:20.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f7555ca3700 1 --2- 172.21.15.63:0/3198455949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7538003bc0 0x7f7538004020 secure :-1 s=THROTTLE_DONE pgs=1958 cs=0 l=1 rx=0x7f7544001000 tx=0x7f7550066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f75554a2700 1 -- 172.21.15.63:0/3198455949 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f754400e0d0 con 0x7f7538003bc0 2020-05-18T21:37:20.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f7555ca3700 1 --2- 172.21.15.63:0/3198455949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7538003bc0 0x7f7538004020 secure :-1 s=THROTTLE_DONE pgs=1958 cs=0 l=1 rx=0x7f7544001000 tx=0x7f7550066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f7555ca3700 1 --2- 172.21.15.63:0/3198455949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7538003bc0 0x7f7538004020 secure :-1 s=THROTTLE_DONE pgs=1958 cs=0 l=1 rx=0x7f7544001000 tx=0x7f7550066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f75554a2700 1 -- 172.21.15.63:0/3198455949 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754400e230 con 0x7f7538003bc0 2020-05-18T21:37:20.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f75554a2700 1 -- 172.21.15.63:0/3198455949 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f754400e610 con 0x7f7538003bc0 2020-05-18T21:37:20.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f7557f07700 1 -- 172.21.15.63:0/3198455949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7538003bc0 msgr2=0x7f7538004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f7557f07700 1 --2- 172.21.15.63:0/3198455949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7538003bc0 0x7f7538004020 secure :-1 s=READY pgs=1958 cs=0 l=1 rx=0x7f7544001000 tx=0x7f7550066290).stop 2020-05-18T21:37:20.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f7556ca5700 1 -- 172.21.15.63:0/3198455949 reap_dead start 2020-05-18T21:37:20.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f7557f07700 1 -- 172.21.15.63:0/3198455949 shutdown_connections 2020-05-18T21:37:20.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f7557f07700 1 -- 172.21.15.63:0/3198455949 >> 172.21.15.63:0/3198455949 conn(0x7f755006a640 msgr2=0x7f75500b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:20.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f7557f07700 1 -- 172.21.15.63:0/3198455949 shutdown_connections 2020-05-18T21:37:20.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.869+0000 7f7557f07700 1 -- 172.21.15.63:0/3198455949 wait complete. 2020-05-18T21:37:20.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.873+0000 7f7557f07700 1 Processor -- start 2020-05-18T21:37:20.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.873+0000 7f7557f07700 1 -- start start 2020-05-18T21:37:20.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.873+0000 7f7557f07700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f755011cf80 0x7f75500651f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:20.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.873+0000 7f7557f07700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7550062510 0x7f75500612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:20.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.873+0000 7f7557f07700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755011dba0 con 0x7f7550061730 2020-05-18T21:37:20.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.873+0000 7f7557f07700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75500629a0 con 0x7f755011cf80 2020-05-18T21:37:20.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.873+0000 7f7557f07700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755011d660 con 0x7f7550062510 2020-05-18T21:37:20.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.873+0000 7f7556ca5700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7550061730 0x7f75501330c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37758/0 (socket says 172.21.15.63:37758) 2020-05-18T21:37:20.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.873+0000 7f7556ca5700 1 -- 172.21.15.63:0/1296972318 learned_addr learned my addr 172.21.15.63:0/1296972318 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:20.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.873+0000 7f75564a4700 1 --2- 172.21.15.63:0/1296972318 >> v2:172.21.15.155:3300/0 conn(0x7f755011cf80 0x7f75500651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.873+0000 7f7555ca3700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7550062510 0x7f75500612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.873+0000 7f754effd700 1 -- 172.21.15.63:0/1296972318 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397797891 0 0) 0x7f755011dba0 con 0x7f7550061730 2020-05-18T21:37:20.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.873+0000 7f754effd700 1 -- 172.21.15.63:0/1296972318 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7530003270 con 0x7f7550061730 2020-05-18T21:37:20.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.873+0000 7f75564a4700 1 -- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7550062510 msgr2=0x7f75500612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.873+0000 7f75564a4700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7550062510 0x7f75500612d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.873+0000 7f75564a4700 1 -- 172.21.15.63:0/1296972318 >> v1:172.21.15.63:6789/0 conn(0x7f7550061730 legacy=0x7f75501330c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.877+0000 7f75564a4700 1 -- 172.21.15.63:0/1296972318 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755011d900 con 0x7f755011cf80 2020-05-18T21:37:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.877+0000 7f75564a4700 1 --2- 172.21.15.63:0/1296972318 >> v2:172.21.15.155:3300/0 conn(0x7f755011cf80 0x7f75500651f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75400032f0 tx=0x7f7540010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.877+0000 7f75564a4700 1 --2- 172.21.15.63:0/1296972318 >> v2:172.21.15.155:3300/0 conn(0x7f755011cf80 0x7f75500651f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75400032f0 tx=0x7f7540010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.877+0000 7f75564a4700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f755011cf80 0x7f75500651f0 secure :-1 s=READY pgs=1298 cs=0 l=1 rx=0x7f75400032f0 tx=0x7f7540010d90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:20.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.877+0000 7f75564a4700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f755011cf80 0x7f75500651f0 secure :-1 s=THROTTLE_DONE pgs=1298 cs=0 l=1 rx=0x7f75400032f0 tx=0x7f7540010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.877+0000 7f754effd700 1 -- 172.21.15.63:0/1296972318 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7540005e70 con 0x7f755011cf80 2020-05-18T21:37:20.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.877+0000 7f75564a4700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f755011cf80 0x7f75500651f0 secure :-1 s=THROTTLE_DONE pgs=1298 cs=0 l=1 rx=0x7f75400032f0 tx=0x7f7540010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.877+0000 7f7557f07700 1 -- 172.21.15.63:0/1296972318 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755011d360 con 0x7f755011cf80 2020-05-18T21:37:20.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.877+0000 7f754effd700 1 -- 172.21.15.63:0/1296972318 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7540007560 con 0x7f755011cf80 2020-05-18T21:37:20.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.877+0000 7f75564a4700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f755011cf80 0x7f75500651f0 secure :-1 s=THROTTLE_DONE pgs=1298 cs=0 l=1 rx=0x7f75400032f0 tx=0x7f7540010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.877+0000 7f754effd700 1 -- 172.21.15.63:0/1296972318 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7540008460 con 0x7f755011cf80 2020-05-18T21:37:20.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.877+0000 7f7557f07700 1 -- 172.21.15.63:0/1296972318 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7550133970 con 0x7f755011cf80 2020-05-18T21:37:20.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.877+0000 7f75564a4700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f755011cf80 0x7f75500651f0 secure :-1 s=THROTTLE_DONE pgs=1298 cs=0 l=1 rx=0x7f75400032f0 tx=0x7f7540010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.877+0000 7f7557f07700 1 -- 172.21.15.63:0/1296972318 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75500569e0 con 0x7f755011cf80 2020-05-18T21:37:20.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.877+0000 7f754effd700 1 -- 172.21.15.63:0/1296972318 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7540008720 con 0x7f755011cf80 2020-05-18T21:37:20.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.877+0000 7f75564a4700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f755011cf80 0x7f75500651f0 secure :-1 s=THROTTLE_DONE pgs=1298 cs=0 l=1 rx=0x7f75400032f0 tx=0x7f7540010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.877+0000 7f754effd700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7530050e50 0x7f7530053310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:20.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.877+0000 7f754effd700 1 -- 172.21.15.63:0/1296972318 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7540063f10 con 0x7f755011cf80 2020-05-18T21:37:20.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.877+0000 7f7555ca3700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7530050e50 0x7f7530053310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:20.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.881+0000 7f7555ca3700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7530050e50 0x7f7530053310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7544001000 tx=0x7f7550066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.881+0000 7f7555ca3700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7530050e50 0x7f7530053310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7544001000 tx=0x7f7550066290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.881+0000 7f7555ca3700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7530050e50 0x7f7530053310 secure :-1 s=READY pgs=764 cs=0 l=1 rx=0x7f7544001000 tx=0x7f7550066290).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:20.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.889+0000 7f75564a4700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f755011cf80 0x7f75500651f0 secure :-1 s=THROTTLE_DONE pgs=1298 cs=0 l=1 rx=0x7f75400032f0 tx=0x7f7540010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:20.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:20.889+0000 7f754effd700 1 -- 172.21.15.63:0/1296972318 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f754003e2a0 con 0x7f755011cf80 2020-05-18T21:37:21.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.041+0000 7f7557f07700 1 -- 172.21.15.63:0/1296972318 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f755005c7b0 con 0x7f755011cf80 2020-05-18T21:37:21.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.053+0000 7f75564a4700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f755011cf80 0x7f75500651f0 secure :-1 s=THROTTLE_DONE pgs=1298 cs=0 l=1 rx=0x7f75400032f0 tx=0x7f7540010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.053+0000 7f754effd700 1 -- 172.21.15.63:0/1296972318 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v56) v1 ==== 184+0+0 (secure 0 0 0) 0x7f75400418c0 con 0x7f755011cf80 2020-05-18T21:37:21.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.057+0000 7f7557f07700 1 -- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7530050e50 msgr2=0x7f7530053310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.057+0000 7f7557f07700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7530050e50 0x7f7530053310 secure :-1 s=READY pgs=764 cs=0 l=1 rx=0x7f7544001000 tx=0x7f7550066290).stop 2020-05-18T21:37:21.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.057+0000 7f7557f07700 1 -- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f755011cf80 msgr2=0x7f75500651f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.057+0000 7f7557f07700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f755011cf80 0x7f75500651f0 secure :-1 s=READY pgs=1298 cs=0 l=1 rx=0x7f75400032f0 tx=0x7f7540010d90).stop 2020-05-18T21:37:21.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.057+0000 7f7557f07700 1 -- 172.21.15.63:0/1296972318 shutdown_connections 2020-05-18T21:37:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.057+0000 7f7557f07700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7530050e50 0x7f7530053310 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.057+0000 7f7557f07700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7550062510 0x7f75500612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.057+0000 7f7557f07700 1 --2- 172.21.15.63:0/1296972318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f755011cf80 0x7f75500651f0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.057+0000 7f7557f07700 1 -- 172.21.15.63:0/1296972318 >> 172.21.15.63:0/1296972318 conn(0x7f755006a640 msgr2=0x7f755005f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.057+0000 7f7557f07700 1 -- 172.21.15.63:0/1296972318 shutdown_connections 2020-05-18T21:37:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.057+0000 7f7557f07700 1 -- 172.21.15.63:0/1296972318 wait complete. 2020-05-18T21:37:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.1 2020-05-18T21:37:21.075 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:37:21.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.185+0000 7f076ba69700 1 Processor -- start 2020-05-18T21:37:21.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.185+0000 7f076ba69700 1 -- start start 2020-05-18T21:37:21.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.185+0000 7f076ba69700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07640b8c30 0x7f07641566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:21.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.185+0000 7f076ba69700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f07640ad070 0x7f0764156b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:21.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.185+0000 7f076ba69700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0764065a70 con 0x7f0764156fb0 2020-05-18T21:37:21.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.185+0000 7f076ba69700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07640801d0 con 0x7f07640ad070 2020-05-18T21:37:21.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.185+0000 7f076ba69700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07640b5ae0 con 0x7f07640b8c30 2020-05-18T21:37:21.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.185+0000 7f0769805700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f07640ad070 0x7f0764156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:21.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.185+0000 7f076a006700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07640b8c30 0x7f07641566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:21.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.185+0000 7f0769805700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f07640ad070 0x7f0764156b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:50424/0 (socket says 172.21.15.63:50424) 2020-05-18T21:37:21.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.185+0000 7f0769805700 1 -- 172.21.15.63:0/2141188905 learned_addr learned my addr 172.21.15.63:0/2141188905 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:21.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.185+0000 7f076a006700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07640b8c30 0x7f07641566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:54508/0 (socket says 172.21.15.63:54508) 2020-05-18T21:37:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.185+0000 7f076a807700 1 --1- 172.21.15.63:0/2141188905 >> v1:172.21.15.155:6789/0 conn(0x7f0764156fb0 0x7f076415b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:36082/0 (socket says 172.21.15.63:36082) 2020-05-18T21:37:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f0769805700 1 -- 172.21.15.63:0/2141188905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07640b8c30 msgr2=0x7f07641566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f0769805700 1 --2- 172.21.15.63:0/2141188905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07640b8c30 0x7f07641566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f0769805700 1 -- 172.21.15.63:0/2141188905 >> v1:172.21.15.155:6789/0 conn(0x7f0764156fb0 legacy=0x7f076415b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f0769805700 1 -- 172.21.15.63:0/2141188905 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07640b9010 con 0x7f07640ad070 2020-05-18T21:37:21.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f0769004700 1 -- 172.21.15.63:0/2141188905 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224756084 0 0) 0x7f0764065a70 con 0x7f0764156fb0 2020-05-18T21:37:21.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f0769805700 1 --2- 172.21.15.63:0/2141188905 >> v2:172.21.15.155:3300/0 conn(0x7f07640ad070 0x7f0764156b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0754002f70 tx=0x7f0754007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f0769805700 1 --2- 172.21.15.63:0/2141188905 >> v2:172.21.15.155:3300/0 conn(0x7f07640ad070 0x7f0764156b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0754002f70 tx=0x7f0754007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f0769805700 1 --2- 172.21.15.63:0/2141188905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07640ad070 0x7f0764156b50 secure :-1 s=READY pgs=1300 cs=0 l=1 rx=0x7f0754002f70 tx=0x7f0754007a80).ready entity=mon.1 client_cookie=786855eb32221c54 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:21.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f0769805700 1 --2- 172.21.15.63:0/2141188905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07640ad070 0x7f0764156b50 secure :-1 s=THROTTLE_DONE pgs=1300 cs=0 l=1 rx=0x7f0754002f70 tx=0x7f0754007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f0769805700 1 --2- 172.21.15.63:0/2141188905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07640ad070 0x7f0764156b50 secure :-1 s=THROTTLE_DONE pgs=1300 cs=0 l=1 rx=0x7f0754002f70 tx=0x7f0754007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f0769004700 1 -- 172.21.15.63:0/2141188905 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07540116b0 con 0x7f07640ad070 2020-05-18T21:37:21.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f0769805700 1 --2- 172.21.15.63:0/2141188905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07640ad070 0x7f0764156b50 secure :-1 s=THROTTLE_DONE pgs=1300 cs=0 l=1 rx=0x7f0754002f70 tx=0x7f0754007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f0769004700 1 -- 172.21.15.63:0/2141188905 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0754011810 con 0x7f07640ad070 2020-05-18T21:37:21.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f0769004700 1 -- 172.21.15.63:0/2141188905 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0754011bf0 con 0x7f07640ad070 2020-05-18T21:37:21.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f076ba69700 1 -- 172.21.15.63:0/2141188905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07640ad070 msgr2=0x7f0764156b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f076ba69700 1 --2- 172.21.15.63:0/2141188905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07640ad070 0x7f0764156b50 secure :-1 s=READY pgs=1300 cs=0 l=1 rx=0x7f0754002f70 tx=0x7f0754007a80).stop 2020-05-18T21:37:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f076ba69700 1 -- 172.21.15.63:0/2141188905 shutdown_connections 2020-05-18T21:37:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f076ba69700 1 --2- 172.21.15.63:0/2141188905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07640ad070 0x7f0764156b50 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f076ba69700 1 --2- 172.21.15.63:0/2141188905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07640b8c30 0x7f07641566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f076ba69700 1 -- 172.21.15.63:0/2141188905 >> 172.21.15.63:0/2141188905 conn(0x7f076406a640 msgr2=0x7f07640b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f076ba69700 1 -- 172.21.15.63:0/2141188905 shutdown_connections 2020-05-18T21:37:21.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.189+0000 7f076ba69700 1 -- 172.21.15.63:0/2141188905 wait complete. 2020-05-18T21:37:21.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.193+0000 7f076ba69700 1 Processor -- start 2020-05-18T21:37:21.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.193+0000 7f076ba69700 1 -- start start 2020-05-18T21:37:21.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.193+0000 7f076ba69700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07640ad070 0x7f0764070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:21.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.193+0000 7f076ba69700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0764156fb0 0x7f07640626c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:21.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.193+0000 7f076ba69700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0764062b20 con 0x7f07640b8c30 2020-05-18T21:37:21.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.193+0000 7f076ba69700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0764062d60 con 0x7f07640ad070 2020-05-18T21:37:21.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.193+0000 7f076ba69700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0764063000 con 0x7f0764156fb0 2020-05-18T21:37:21.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.193+0000 7f0769805700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f07640b8c30 0x7f076411f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37768/0 (socket says 172.21.15.63:37768) 2020-05-18T21:37:21.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.193+0000 7f076a006700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07640ad070 0x7f0764070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:21.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.193+0000 7f0769805700 1 -- 172.21.15.63:0/2381292141 learned_addr learned my addr 172.21.15.63:0/2381292141 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:21.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.193+0000 7f076a807700 1 --2- 172.21.15.63:0/2381292141 >> v2:172.21.15.155:3300/0 conn(0x7f0764156fb0 0x7f07640626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:21.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.193+0000 7f075affd700 1 -- 172.21.15.63:0/2381292141 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646193612 0 0) 0x7f07640b9010 con 0x7f07640b8c30 2020-05-18T21:37:21.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f075affd700 1 -- 172.21.15.63:0/2381292141 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f074c003270 con 0x7f07640b8c30 2020-05-18T21:37:21.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f076a006700 1 -- 172.21.15.63:0/2381292141 >> v2:172.21.15.155:3300/0 conn(0x7f0764156fb0 msgr2=0x7f07640626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f076a006700 1 --2- 172.21.15.63:0/2381292141 >> v2:172.21.15.155:3300/0 conn(0x7f0764156fb0 0x7f07640626c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:21.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f076a006700 1 -- 172.21.15.63:0/2381292141 >> v1:172.21.15.63:6789/0 conn(0x7f07640b8c30 legacy=0x7f076411f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f076a006700 1 -- 172.21.15.63:0/2381292141 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0764072ba0 con 0x7f07640ad070 2020-05-18T21:37:21.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f076a006700 1 --2- 172.21.15.63:0/2381292141 >> v2:172.21.15.63:3300/0 conn(0x7f07640ad070 0x7f0764070470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0760002f70 tx=0x7f0760010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f076a006700 1 --2- 172.21.15.63:0/2381292141 >> v2:172.21.15.63:3300/0 conn(0x7f07640ad070 0x7f0764070470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0760002f70 tx=0x7f0760010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f076a006700 1 --2- 172.21.15.63:0/2381292141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07640ad070 0x7f0764070470 secure :-1 s=READY pgs=1961 cs=0 l=1 rx=0x7f0760002f70 tx=0x7f0760010bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:21.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f076a006700 1 --2- 172.21.15.63:0/2381292141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07640ad070 0x7f0764070470 secure :-1 s=THROTTLE_DONE pgs=1961 cs=0 l=1 rx=0x7f0760002f70 tx=0x7f0760010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f076a006700 1 --2- 172.21.15.63:0/2381292141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07640ad070 0x7f0764070470 secure :-1 s=THROTTLE_DONE pgs=1961 cs=0 l=1 rx=0x7f0760002f70 tx=0x7f0760010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f075affd700 1 -- 172.21.15.63:0/2381292141 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0760007360 con 0x7f07640ad070 2020-05-18T21:37:21.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f076a006700 1 --2- 172.21.15.63:0/2381292141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07640ad070 0x7f0764070470 secure :-1 s=THROTTLE_DONE pgs=1961 cs=0 l=1 rx=0x7f0760002f70 tx=0x7f0760010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f075affd700 1 -- 172.21.15.63:0/2381292141 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07600074c0 con 0x7f07640ad070 2020-05-18T21:37:21.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f076ba69700 1 -- 172.21.15.63:0/2381292141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07640b7530 con 0x7f07640ad070 2020-05-18T21:37:21.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f075affd700 1 -- 172.21.15.63:0/2381292141 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07600058f0 con 0x7f07640ad070 2020-05-18T21:37:21.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f076ba69700 1 -- 172.21.15.63:0/2381292141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07640b79b0 con 0x7f07640ad070 2020-05-18T21:37:21.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f076a006700 1 --2- 172.21.15.63:0/2381292141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07640ad070 0x7f0764070470 secure :-1 s=THROTTLE_DONE pgs=1961 cs=0 l=1 rx=0x7f0760002f70 tx=0x7f0760010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f076ba69700 1 -- 172.21.15.63:0/2381292141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07640569e0 con 0x7f07640ad070 2020-05-18T21:37:21.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f075affd700 1 -- 172.21.15.63:0/2381292141 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0760005b60 con 0x7f07640ad070 2020-05-18T21:37:21.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f076a006700 1 --2- 172.21.15.63:0/2381292141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07640ad070 0x7f0764070470 secure :-1 s=THROTTLE_DONE pgs=1961 cs=0 l=1 rx=0x7f0760002f70 tx=0x7f0760010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f075affd700 1 --2- 172.21.15.63:0/2381292141 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f074c04fdf0 0x7f074c0522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:21.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f075affd700 1 -- 172.21.15.63:0/2381292141 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0760063ac0 con 0x7f07640ad070 2020-05-18T21:37:21.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.197+0000 7f0769805700 1 --2- 172.21.15.63:0/2381292141 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f074c04fdf0 0x7f074c0522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:21.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.201+0000 7f0769805700 1 --2- 172.21.15.63:0/2381292141 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f074c04fdf0 0x7f074c0522b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0754008920 tx=0x7f0754007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.201+0000 7f0769805700 1 --2- 172.21.15.63:0/2381292141 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f074c04fdf0 0x7f074c0522b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0754008920 tx=0x7f0754007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.201+0000 7f0769805700 1 --2- 172.21.15.63:0/2381292141 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f074c04fdf0 0x7f074c0522b0 secure :-1 s=READY pgs=765 cs=0 l=1 rx=0x7f0754008920 tx=0x7f0754007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.205+0000 7f076a006700 1 --2- 172.21.15.63:0/2381292141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07640ad070 0x7f0764070470 secure :-1 s=THROTTLE_DONE pgs=1961 cs=0 l=1 rx=0x7f0760002f70 tx=0x7f0760010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.205+0000 7f075affd700 1 -- 172.21.15.63:0/2381292141 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f076003de50 con 0x7f07640ad070 2020-05-18T21:37:21.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.365+0000 7f076ba69700 1 -- 172.21.15.63:0/2381292141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0764072d30 con 0x7f07640ad070 2020-05-18T21:37:21.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.373+0000 7f076a006700 1 --2- 172.21.15.63:0/2381292141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07640ad070 0x7f0764070470 secure :-1 s=THROTTLE_DONE pgs=1961 cs=0 l=1 rx=0x7f0760002f70 tx=0x7f0760010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.373+0000 7f075affd700 1 -- 172.21.15.63:0/2381292141 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v57) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0764072d30 con 0x7f07640ad070 2020-05-18T21:37:21.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.377+0000 7f076ba69700 1 -- 172.21.15.63:0/2381292141 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f074c04fdf0 msgr2=0x7f074c0522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.377+0000 7f076ba69700 1 --2- 172.21.15.63:0/2381292141 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f074c04fdf0 0x7f074c0522b0 secure :-1 s=READY pgs=765 cs=0 l=1 rx=0x7f0754008920 tx=0x7f0754007a80).stop 2020-05-18T21:37:21.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.377+0000 7f076ba69700 1 -- 172.21.15.63:0/2381292141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07640ad070 msgr2=0x7f0764070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.377+0000 7f076ba69700 1 --2- 172.21.15.63:0/2381292141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07640ad070 0x7f0764070470 secure :-1 s=READY pgs=1961 cs=0 l=1 rx=0x7f0760002f70 tx=0x7f0760010bd0).stop 2020-05-18T21:37:21.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.377+0000 7f076ba69700 1 -- 172.21.15.63:0/2381292141 shutdown_connections 2020-05-18T21:37:21.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.377+0000 7f076ba69700 1 --2- 172.21.15.63:0/2381292141 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f074c04fdf0 0x7f074c0522b0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:21.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.377+0000 7f076ba69700 1 --2- 172.21.15.63:0/2381292141 >> v2:172.21.15.155:3300/0 conn(0x7f0764156fb0 0x7f07640626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:21.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.377+0000 7f076ba69700 1 --2- 172.21.15.63:0/2381292141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07640ad070 0x7f0764070470 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:21.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.377+0000 7f076ba69700 1 -- 172.21.15.63:0/2381292141 >> 172.21.15.63:0/2381292141 conn(0x7f076406a640 msgr2=0x7f07640ae570 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:21.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.377+0000 7f076ba69700 1 -- 172.21.15.63:0/2381292141 shutdown_connections 2020-05-18T21:37:21.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.377+0000 7f076ba69700 1 -- 172.21.15.63:0/2381292141 wait complete. 2020-05-18T21:37:21.391 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.2 2020-05-18T21:37:21.395 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:37:21.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.509+0000 7f5bede43700 1 Processor -- start 2020-05-18T21:37:21.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.509+0000 7f5bede43700 1 -- start start 2020-05-18T21:37:21.521 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.509+0000 7f5bede43700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5be80ad070 0x7f5be8156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:21.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.509+0000 7f5bede43700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5be8157260 0x7f5be815c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:21.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.509+0000 7f5bede43700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be8065a70 con 0x7f5be80b8c30 2020-05-18T21:37:21.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.509+0000 7f5bede43700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be80801d0 con 0x7f5be80ad070 2020-05-18T21:37:21.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.509+0000 7f5bede43700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be80b5ae0 con 0x7f5be8157260 2020-05-18T21:37:21.522 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.509+0000 7f5be7fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5be80b8c30 0x7f5be81566f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37776/0 (socket says 172.21.15.63:37776) 2020-05-18T21:37:21.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.509+0000 7f5be7fff700 1 -- 172.21.15.63:0/2251709854 learned_addr learned my addr 172.21.15.63:0/2251709854 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:21.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.509+0000 7f5becbe1700 1 --2- 172.21.15.63:0/2251709854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5be8157260 0x7f5be815c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:21.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.509+0000 7f5bdffff700 1 --2- 172.21.15.63:0/2251709854 >> v2:172.21.15.155:3300/0 conn(0x7f5be80ad070 0x7f5be8156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:21.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.509+0000 7f5be77fe700 1 -- 172.21.15.63:0/2251709854 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049931323 0 0) 0x7f5be8065a70 con 0x7f5be80b8c30 2020-05-18T21:37:21.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.509+0000 7f5be77fe700 1 -- 172.21.15.63:0/2251709854 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bd4003270 con 0x7f5be80b8c30 2020-05-18T21:37:21.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5becbe1700 1 -- 172.21.15.63:0/2251709854 >> v2:172.21.15.155:3300/0 conn(0x7f5be80ad070 msgr2=0x7f5be8156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:21.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5becbe1700 1 --2- 172.21.15.63:0/2251709854 >> v2:172.21.15.155:3300/0 conn(0x7f5be80ad070 0x7f5be8156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:21.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5becbe1700 1 -- 172.21.15.63:0/2251709854 >> v1:172.21.15.63:6789/0 conn(0x7f5be80b8c30 legacy=0x7f5be81566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5becbe1700 1 -- 172.21.15.63:0/2251709854 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be80b9010 con 0x7f5be8157260 2020-05-18T21:37:21.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5bdffff700 1 --2- 172.21.15.63:0/2251709854 >> v2:172.21.15.155:3300/0 conn(0x7f5be80ad070 0x7f5be8156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:21.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5becbe1700 1 --2- 172.21.15.63:0/2251709854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5be8157260 0x7f5be815c9c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5be00032f0 tx=0x7f5be0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5becbe1700 1 --2- 172.21.15.63:0/2251709854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5be8157260 0x7f5be815c9c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5be00032f0 tx=0x7f5be0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5becbe1700 1 --2- 172.21.15.63:0/2251709854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5be8157260 0x7f5be815c9c0 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f5be00032f0 tx=0x7f5be0007e00).ready entity=mon.2 client_cookie=48b0ebdf8bdc33c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:21.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5becbe1700 1 --2- 172.21.15.63:0/2251709854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5be8157260 0x7f5be815c9c0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f5be00032f0 tx=0x7f5be0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5be77fe700 1 -- 172.21.15.63:0/2251709854 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5be0011db0 con 0x7f5be8157260 2020-05-18T21:37:21.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5becbe1700 1 --2- 172.21.15.63:0/2251709854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5be8157260 0x7f5be815c9c0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f5be00032f0 tx=0x7f5be0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5becbe1700 1 --2- 172.21.15.63:0/2251709854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5be8157260 0x7f5be815c9c0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f5be00032f0 tx=0x7f5be0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5be77fe700 1 -- 172.21.15.63:0/2251709854 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be000a180 con 0x7f5be8157260 2020-05-18T21:37:21.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5be77fe700 1 -- 172.21.15.63:0/2251709854 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5be000a560 con 0x7f5be8157260 2020-05-18T21:37:21.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5bede43700 1 -- 172.21.15.63:0/2251709854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5be8157260 msgr2=0x7f5be815c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5bede43700 1 --2- 172.21.15.63:0/2251709854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5be8157260 0x7f5be815c9c0 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f5be00032f0 tx=0x7f5be0007e00).stop 2020-05-18T21:37:21.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5bede43700 1 -- 172.21.15.63:0/2251709854 shutdown_connections 2020-05-18T21:37:21.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5bede43700 1 --2- 172.21.15.63:0/2251709854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5be8157260 0x7f5be815c9c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:21.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5bede43700 1 --2- 172.21.15.63:0/2251709854 >> v2:172.21.15.155:3300/0 conn(0x7f5be80ad070 0x7f5be8156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:21.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5bede43700 1 -- 172.21.15.63:0/2251709854 >> 172.21.15.63:0/2251709854 conn(0x7f5be806a640 msgr2=0x7f5be80b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:21.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5bede43700 1 -- 172.21.15.63:0/2251709854 shutdown_connections 2020-05-18T21:37:21.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.513+0000 7f5bede43700 1 -- 172.21.15.63:0/2251709854 wait complete. 2020-05-18T21:37:21.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.517+0000 7f5bede43700 1 Processor -- start 2020-05-18T21:37:21.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.517+0000 7f5bede43700 1 -- start start 2020-05-18T21:37:21.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.517+0000 7f5bede43700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5be80ad070 0x7f5be8061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:21.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.517+0000 7f5bede43700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5be80b8c30 0x7f5be80750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:21.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.517+0000 7f5bede43700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be8074750 con 0x7f5be8157260 2020-05-18T21:37:21.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.517+0000 7f5bede43700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be80749b0 con 0x7f5be80ad070 2020-05-18T21:37:21.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.517+0000 7f5bede43700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be8074c50 con 0x7f5be80b8c30 2020-05-18T21:37:21.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.517+0000 7f5be7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5be80ad070 0x7f5be8061660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:21.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.517+0000 7f5becbe1700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5be8157260 0x7f5be80b60e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37786/0 (socket says 172.21.15.63:37786) 2020-05-18T21:37:21.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.517+0000 7f5becbe1700 1 -- 172.21.15.63:0/2236961823 learned_addr learned my addr 172.21.15.63:0/2236961823 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:21.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.517+0000 7f5bdffff700 1 --2- 172.21.15.63:0/2236961823 >> v2:172.21.15.155:3300/0 conn(0x7f5be80b8c30 0x7f5be80750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:21.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.517+0000 7f5be57fa700 1 -- 172.21.15.63:0/2236961823 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231984664 0 0) 0x7f5be8074750 con 0x7f5be8157260 2020-05-18T21:37:21.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.517+0000 7f5be57fa700 1 -- 172.21.15.63:0/2236961823 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bcc003270 con 0x7f5be8157260 2020-05-18T21:37:21.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.517+0000 7f5be7fff700 1 -- 172.21.15.63:0/2236961823 >> v2:172.21.15.155:3300/0 conn(0x7f5be80b8c30 msgr2=0x7f5be80750f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.517+0000 7f5be7fff700 1 --2- 172.21.15.63:0/2236961823 >> v2:172.21.15.155:3300/0 conn(0x7f5be80b8c30 0x7f5be80750f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:21.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.517+0000 7f5be7fff700 1 -- 172.21.15.63:0/2236961823 >> v1:172.21.15.63:6789/0 conn(0x7f5be8157260 legacy=0x7f5be80b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.517+0000 7f5be57fa700 1 -- 172.21.15.63:0/2236961823 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1483473984 0 0) 0x7f5bcc003270 con 0x7f5be8157260 2020-05-18T21:37:21.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.517+0000 7f5be7fff700 1 -- 172.21.15.63:0/2236961823 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be80b67f0 con 0x7f5be80ad070 2020-05-18T21:37:21.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.517+0000 7f5be7fff700 1 --2- 172.21.15.63:0/2236961823 >> v2:172.21.15.63:3300/0 conn(0x7f5be80ad070 0x7f5be8061660 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5be0008b40 tx=0x7f5bd80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.521+0000 7f5be7fff700 1 --2- 172.21.15.63:0/2236961823 >> v2:172.21.15.63:3300/0 conn(0x7f5be80ad070 0x7f5be8061660 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5be0008b40 tx=0x7f5bd80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.521+0000 7f5be7fff700 1 --2- 172.21.15.63:0/2236961823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5be80ad070 0x7f5be8061660 secure :-1 s=READY pgs=1964 cs=0 l=1 rx=0x7f5be0008b40 tx=0x7f5bd80108f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:21.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.521+0000 7f5be7fff700 1 --2- 172.21.15.63:0/2236961823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5be80ad070 0x7f5be8061660 secure :-1 s=THROTTLE_DONE pgs=1964 cs=0 l=1 rx=0x7f5be0008b40 tx=0x7f5bd80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.521+0000 7f5be57fa700 1 -- 172.21.15.63:0/2236961823 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5be00089a0 con 0x7f5be80ad070 2020-05-18T21:37:21.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.521+0000 7f5be7fff700 1 --2- 172.21.15.63:0/2236961823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5be80ad070 0x7f5be8061660 secure :-1 s=THROTTLE_DONE pgs=1964 cs=0 l=1 rx=0x7f5be0008b40 tx=0x7f5bd80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.521+0000 7f5be57fa700 1 -- 172.21.15.63:0/2236961823 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd8005b10 con 0x7f5be80ad070 2020-05-18T21:37:21.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.521+0000 7f5be7fff700 1 --2- 172.21.15.63:0/2236961823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5be80ad070 0x7f5be8061660 secure :-1 s=THROTTLE_DONE pgs=1964 cs=0 l=1 rx=0x7f5be0008b40 tx=0x7f5bd80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.521+0000 7f5bede43700 1 -- 172.21.15.63:0/2236961823 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be8134160 con 0x7f5be80ad070 2020-05-18T21:37:21.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.521+0000 7f5be57fa700 1 -- 172.21.15.63:0/2236961823 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bd8005e70 con 0x7f5be80ad070 2020-05-18T21:37:21.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.521+0000 7f5bede43700 1 -- 172.21.15.63:0/2236961823 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be8064a40 con 0x7f5be80ad070 2020-05-18T21:37:21.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.521+0000 7f5bede43700 1 -- 172.21.15.63:0/2236961823 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be80569e0 con 0x7f5be80ad070 2020-05-18T21:37:21.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.521+0000 7f5be7fff700 1 --2- 172.21.15.63:0/2236961823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5be80ad070 0x7f5be8061660 secure :-1 s=THROTTLE_DONE pgs=1964 cs=0 l=1 rx=0x7f5be0008b40 tx=0x7f5bd80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.521+0000 7f5be57fa700 1 -- 172.21.15.63:0/2236961823 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5bd800a360 con 0x7f5be80ad070 2020-05-18T21:37:21.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.521+0000 7f5be7fff700 1 --2- 172.21.15.63:0/2236961823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5be80ad070 0x7f5be8061660 secure :-1 s=THROTTLE_DONE pgs=1964 cs=0 l=1 rx=0x7f5be0008b40 tx=0x7f5bd80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.521+0000 7f5be57fa700 1 --2- 172.21.15.63:0/2236961823 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5bcc04fcf0 0x7f5bcc0521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:21.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.521+0000 7f5be57fa700 1 -- 172.21.15.63:0/2236961823 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5bd80090c0 con 0x7f5be80ad070 2020-05-18T21:37:21.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.521+0000 7f5bdffff700 1 --2- 172.21.15.63:0/2236961823 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5bcc04fcf0 0x7f5bcc0521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:21.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.521+0000 7f5bdffff700 1 --2- 172.21.15.63:0/2236961823 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5bcc04fcf0 0x7f5bcc0521b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5bd0002f70 tx=0x7f5bd000f590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.525+0000 7f5bdffff700 1 --2- 172.21.15.63:0/2236961823 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5bcc04fcf0 0x7f5bcc0521b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5bd0002f70 tx=0x7f5bd000f590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.525+0000 7f5bdffff700 1 --2- 172.21.15.63:0/2236961823 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5bcc04fcf0 0x7f5bcc0521b0 secure :-1 s=READY pgs=766 cs=0 l=1 rx=0x7f5bd0002f70 tx=0x7f5bd000f590).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:21.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.529+0000 7f5be7fff700 1 --2- 172.21.15.63:0/2236961823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5be80ad070 0x7f5be8061660 secure :-1 s=THROTTLE_DONE pgs=1964 cs=0 l=1 rx=0x7f5be0008b40 tx=0x7f5bd80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.529+0000 7f5be57fa700 1 -- 172.21.15.63:0/2236961823 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f5bd803deb0 con 0x7f5be80ad070 2020-05-18T21:37:21.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.677+0000 7f5bede43700 1 -- 172.21.15.63:0/2236961823 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f5be80008d0 con 0x7f5be80ad070 2020-05-18T21:37:21.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.685+0000 7f5be7fff700 1 --2- 172.21.15.63:0/2236961823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5be80ad070 0x7f5be8061660 secure :-1 s=THROTTLE_DONE pgs=1964 cs=0 l=1 rx=0x7f5be0008b40 tx=0x7f5bd80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.685+0000 7f5be57fa700 1 -- 172.21.15.63:0/2236961823 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v58) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5bd80414d0 con 0x7f5be80ad070 2020-05-18T21:37:21.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.689+0000 7f5bede43700 1 -- 172.21.15.63:0/2236961823 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5bcc04fcf0 msgr2=0x7f5bcc0521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.689+0000 7f5bede43700 1 --2- 172.21.15.63:0/2236961823 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5bcc04fcf0 0x7f5bcc0521b0 secure :-1 s=READY pgs=766 cs=0 l=1 rx=0x7f5bd0002f70 tx=0x7f5bd000f590).stop 2020-05-18T21:37:21.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.689+0000 7f5bede43700 1 -- 172.21.15.63:0/2236961823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5be80ad070 msgr2=0x7f5be8061660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.689+0000 7f5bede43700 1 --2- 172.21.15.63:0/2236961823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5be80ad070 0x7f5be8061660 secure :-1 s=READY pgs=1964 cs=0 l=1 rx=0x7f5be0008b40 tx=0x7f5bd80108f0).stop 2020-05-18T21:37:21.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.689+0000 7f5bede43700 1 -- 172.21.15.63:0/2236961823 shutdown_connections 2020-05-18T21:37:21.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.689+0000 7f5bede43700 1 --2- 172.21.15.63:0/2236961823 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5bcc04fcf0 0x7f5bcc0521b0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:21.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.689+0000 7f5bede43700 1 --2- 172.21.15.63:0/2236961823 >> v2:172.21.15.155:3300/0 conn(0x7f5be80b8c30 0x7f5be80750f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:21.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.689+0000 7f5bede43700 1 --2- 172.21.15.63:0/2236961823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5be80ad070 0x7f5be8061660 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:21.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.689+0000 7f5bede43700 1 -- 172.21.15.63:0/2236961823 >> 172.21.15.63:0/2236961823 conn(0x7f5be806a640 msgr2=0x7f5be8155f70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:21.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.689+0000 7f5bede43700 1 -- 172.21.15.63:0/2236961823 shutdown_connections 2020-05-18T21:37:21.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.689+0000 7f5bede43700 1 -- 172.21.15.63:0/2236961823 wait complete. 2020-05-18T21:37:21.699 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.3 2020-05-18T21:37:21.709 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:21.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.805+0000 7f2fcf882700 1 Processor -- start 2020-05-18T21:37:21.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.805+0000 7f2fcf882700 1 -- start start 2020-05-18T21:37:21.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.805+0000 7f2fcf882700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2fc806a620 0x7f2fc8065eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:21.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.805+0000 7f2fcf882700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2fc8149a00 0x7f2fc8149e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:21.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.805+0000 7f2fcf882700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc80b5a10 con 0x7f2fc814a2d0 2020-05-18T21:37:21.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.805+0000 7f2fcf882700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc81470c0 con 0x7f2fc806a620 2020-05-18T21:37:21.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.805+0000 7f2fcf882700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc80b5cb0 con 0x7f2fc8149a00 2020-05-18T21:37:21.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.805+0000 7f2fcde1f700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2fc814a2d0 0x7f2fc813f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37794/0 (socket says 172.21.15.63:37794) 2020-05-18T21:37:21.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.805+0000 7f2fcde1f700 1 -- 172.21.15.63:0/167628808 learned_addr learned my addr 172.21.15.63:0/167628808 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:21.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.805+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/167628808 >> v2:172.21.15.63:3300/0 conn(0x7f2fc806a620 0x7f2fc8065eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:21.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.805+0000 7f2fcce1d700 1 --2- 172.21.15.63:0/167628808 >> v2:172.21.15.155:3300/0 conn(0x7f2fc8149a00 0x7f2fc8149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:21.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.805+0000 7f2fb7fff700 1 -- 172.21.15.63:0/167628808 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218874086 0 0) 0x7f2fc80b5a10 con 0x7f2fc814a2d0 2020-05-18T21:37:21.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.805+0000 7f2fb7fff700 1 -- 172.21.15.63:0/167628808 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fb0003270 con 0x7f2fc814a2d0 2020-05-18T21:37:21.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.805+0000 7f2fb7fff700 1 -- 172.21.15.63:0/167628808 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2668188922 0 0) 0x7f2fb0003270 con 0x7f2fc814a2d0 2020-05-18T21:37:21.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.805+0000 7f2fcd61e700 1 -- 172.21.15.63:0/167628808 >> v2:172.21.15.155:3300/0 conn(0x7f2fc8149a00 msgr2=0x7f2fc8149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:21.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.805+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/167628808 >> v2:172.21.15.155:3300/0 conn(0x7f2fc8149a00 0x7f2fc8149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:21.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.805+0000 7f2fcd61e700 1 -- 172.21.15.63:0/167628808 >> v1:172.21.15.63:6789/0 conn(0x7f2fc814a2d0 legacy=0x7f2fc813f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.805+0000 7f2fcd61e700 1 -- 172.21.15.63:0/167628808 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc8066310 con 0x7f2fc806a620 2020-05-18T21:37:21.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.809+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/167628808 >> v2:172.21.15.63:3300/0 conn(0x7f2fc806a620 0x7f2fc8065eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2fc0001c30 tx=0x7f2fc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.809+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/167628808 >> v2:172.21.15.63:3300/0 conn(0x7f2fc806a620 0x7f2fc8065eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2fc0001c30 tx=0x7f2fc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.809+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/167628808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fc806a620 0x7f2fc8065eb0 secure :-1 s=READY pgs=1966 cs=0 l=1 rx=0x7f2fc0001c30 tx=0x7f2fc4007a80).ready entity=mon.0 client_cookie=4d540fb55e57c0e2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:21.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.809+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/167628808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fc806a620 0x7f2fc8065eb0 secure :-1 s=THROTTLE_DONE pgs=1966 cs=0 l=1 rx=0x7f2fc0001c30 tx=0x7f2fc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.809+0000 7f2fb7fff700 1 -- 172.21.15.63:0/167628808 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fc0001a90 con 0x7f2fc806a620 2020-05-18T21:37:21.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.809+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/167628808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fc806a620 0x7f2fc8065eb0 secure :-1 s=THROTTLE_DONE pgs=1966 cs=0 l=1 rx=0x7f2fc0001c30 tx=0x7f2fc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.809+0000 7f2fb7fff700 1 -- 172.21.15.63:0/167628808 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc4008b80 con 0x7f2fc806a620 2020-05-18T21:37:21.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.809+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/167628808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fc806a620 0x7f2fc8065eb0 secure :-1 s=THROTTLE_DONE pgs=1966 cs=0 l=1 rx=0x7f2fc0001c30 tx=0x7f2fc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.809+0000 7f2fb7fff700 1 -- 172.21.15.63:0/167628808 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fc40113d0 con 0x7f2fc806a620 2020-05-18T21:37:21.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.809+0000 7f2fcf882700 1 -- 172.21.15.63:0/167628808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fc806a620 msgr2=0x7f2fc8065eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.809+0000 7f2fcf882700 1 --2- 172.21.15.63:0/167628808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fc806a620 0x7f2fc8065eb0 secure :-1 s=READY pgs=1966 cs=0 l=1 rx=0x7f2fc0001c30 tx=0x7f2fc4007a80).stop 2020-05-18T21:37:21.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.809+0000 7f2fcf882700 1 -- 172.21.15.63:0/167628808 shutdown_connections 2020-05-18T21:37:21.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.809+0000 7f2fcf882700 1 --2- 172.21.15.63:0/167628808 >> v2:172.21.15.155:3300/0 conn(0x7f2fc8149a00 0x7f2fc8149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:21.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.809+0000 7f2fcf882700 1 --2- 172.21.15.63:0/167628808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fc806a620 0x7f2fc8065eb0 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:21.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.809+0000 7f2fcf882700 1 -- 172.21.15.63:0/167628808 >> 172.21.15.63:0/167628808 conn(0x7f2fc805a7c0 msgr2=0x7f2fc805abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:21.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.809+0000 7f2fcf882700 1 -- 172.21.15.63:0/167628808 shutdown_connections 2020-05-18T21:37:21.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.809+0000 7f2fcf882700 1 -- 172.21.15.63:0/167628808 wait complete. 2020-05-18T21:37:21.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.809+0000 7f2fcf882700 1 Processor -- start 2020-05-18T21:37:21.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.809+0000 7f2fcf882700 1 -- start start 2020-05-18T21:37:21.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcf882700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fc814a2d0 0x7f2fc813d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:21.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcf882700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc8144480 con 0x7f2fc806a620 2020-05-18T21:37:21.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcf882700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc8144720 con 0x7f2fc8149a00 2020-05-18T21:37:21.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcf882700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80afda0 con 0x7f2fc814a2d0 2020-05-18T21:37:21.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcd61e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2fc806a620 0x7f2fc813d180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37796/0 (socket says 172.21.15.63:37796) 2020-05-18T21:37:21.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcd61e700 1 -- 172.21.15.63:0/3554386474 learned_addr learned my addr 172.21.15.63:0/3554386474 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:21.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcde1f700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fc814a2d0 0x7f2fc813d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:21.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570692002 0 0) 0x7f2fc8144480 con 0x7f2fc806a620 2020-05-18T21:37:21.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fa8002fe0 con 0x7f2fc806a620 2020-05-18T21:37:21.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394197532 0 0) 0x7f2fc8144720 con 0x7f2fc8149a00 2020-05-18T21:37:21.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc8144480 con 0x7f2fc8149a00 2020-05-18T21:37:21.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 596712804 0 0) 0x7f2fa8002fe0 con 0x7f2fc806a620 2020-05-18T21:37:21.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2fc8144720 con 0x7f2fc806a620 2020-05-18T21:37:21.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f2fc40113d0 con 0x7f2fc806a620 2020-05-18T21:37:21.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fc814a2d0 msgr2=0x7f2fc813d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fc814a2d0 0x7f2fc813d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:21.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 >> v1:172.21.15.155:6789/0 conn(0x7f2fc8149a00 legacy=0x7f2fc809da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 >> v1:172.21.15.63:6789/0 conn(0x7f2fc806a620 legacy=0x7f2fc813d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa8004bf0 0x7f2fa8004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:21.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fc814a2d0 0x7f2fa8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:21.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fa8003f90 0x7f2fa8004410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:21.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80afda0 con 0x7f2fa8004bf0 2020-05-18T21:37:21.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa8004870 con 0x7f2fa8003f90 2020-05-18T21:37:21.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa800b760 con 0x7f2fc814a2d0 2020-05-18T21:37:21.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa8004bf0 0x7f2fa8004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:21.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcde1f700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fa8003f90 0x7f2fa8004410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:21.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcce1d700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fc814a2d0 0x7f2fa8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:21.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcd61e700 1 -- 172.21.15.63:0/3554386474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fc814a2d0 msgr2=0x7f2fa8003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fc814a2d0 0x7f2fa8003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:21.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcd61e700 1 -- 172.21.15.63:0/3554386474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fa8003f90 msgr2=0x7f2fa8004410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fa8003f90 0x7f2fa8004410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:21.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcd61e700 1 -- 172.21.15.63:0/3554386474 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc81449c0 con 0x7f2fa8004bf0 2020-05-18T21:37:21.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcf882700 1 -- 172.21.15.63:0/3554386474 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc813d890 con 0x7f2fa8004bf0 2020-05-18T21:37:21.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa8004bf0 0x7f2fa8004ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2fc4007c50 tx=0x7f2fc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcf882700 1 -- 172.21.15.63:0/3554386474 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc809d510 con 0x7f2fa8004bf0 2020-05-18T21:37:21.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa8004bf0 0x7f2fa8004ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2fc4007c50 tx=0x7f2fc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa8004bf0 0x7f2fa8004ff0 secure :-1 s=READY pgs=1968 cs=0 l=1 rx=0x7f2fc4007c50 tx=0x7f2fc4007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:21.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa8004bf0 0x7f2fa8004ff0 secure :-1 s=THROTTLE_DONE pgs=1968 cs=0 l=1 rx=0x7f2fc4007c50 tx=0x7f2fc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa8004bf0 0x7f2fa8004ff0 secure :-1 s=THROTTLE_DONE pgs=1968 cs=0 l=1 rx=0x7f2fc4007c50 tx=0x7f2fc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fc4008600 con 0x7f2fa8004bf0 2020-05-18T21:37:21.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa8004bf0 0x7f2fa8004ff0 secure :-1 s=THROTTLE_DONE pgs=1968 cs=0 l=1 rx=0x7f2fc4007c50 tx=0x7f2fc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc4007550 con 0x7f2fa8004bf0 2020-05-18T21:37:21.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.813+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fc40058f0 con 0x7f2fa8004bf0 2020-05-18T21:37:21.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.817+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa8004bf0 0x7f2fa8004ff0 secure :-1 s=THROTTLE_DONE pgs=1968 cs=0 l=1 rx=0x7f2fc4007c50 tx=0x7f2fc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.817+0000 7f2fcf882700 1 -- 172.21.15.63:0/3554386474 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa4003380 con 0x7f2fa8004bf0 2020-05-18T21:37:21.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.817+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2fc4005a50 con 0x7f2fa8004bf0 2020-05-18T21:37:21.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.817+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa8004bf0 0x7f2fa8004ff0 secure :-1 s=THROTTLE_DONE pgs=1968 cs=0 l=1 rx=0x7f2fc4007c50 tx=0x7f2fc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.817+0000 7f2fb67fc700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2fa8057cf0 0x7f2fa805a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:21.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.817+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2fc4064b00 con 0x7f2fa8004bf0 2020-05-18T21:37:21.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.817+0000 7f2fcce1d700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2fa8057cf0 0x7f2fa805a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:21.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.817+0000 7f2fcce1d700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2fa8057cf0 0x7f2fa805a1b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2fb8002f30 tx=0x7f2fb800a260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.817+0000 7f2fcce1d700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2fa8057cf0 0x7f2fa805a1b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2fb8002f30 tx=0x7f2fb800a260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.817+0000 7f2fcce1d700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2fa8057cf0 0x7f2fa805a1b0 secure :-1 s=READY pgs=767 cs=0 l=1 rx=0x7f2fb8002f30 tx=0x7f2fb800a260).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:21.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.821+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa8004bf0 0x7f2fa8004ff0 secure :-1 s=THROTTLE_DONE pgs=1968 cs=0 l=1 rx=0x7f2fc4007c50 tx=0x7f2fc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.821+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2fc403ef70 con 0x7f2fa8004bf0 2020-05-18T21:37:21.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.969+0000 7f2fcf882700 1 -- 172.21.15.63:0/3554386474 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fa4003720 con 0x7f2fa8004bf0 2020-05-18T21:37:21.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.969+0000 7f2fcd61e700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa8004bf0 0x7f2fa8004ff0 secure :-1 s=THROTTLE_DONE pgs=1968 cs=0 l=1 rx=0x7f2fc4007c50 tx=0x7f2fc4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:21.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.969+0000 7f2fb67fc700 1 -- 172.21.15.63:0/3554386474 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 122 v122) v1 ==== 95+0+2149 (secure 0 0 0) 0x7f2fc400b0e0 con 0x7f2fa8004bf0 2020-05-18T21:37:21.976 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:21.977 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":122,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6953,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1677585089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1677585089},{"type":"v1","addr":"172.21.15.155:6835","nonce":1677585089}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":120}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:18.846766+0000","modified":"2020-05-18T21:37:19.851598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9628":{"gid":9628,"name":"a","rank":0,"incarnation":121,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/2601706233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2601706233},{"type":"v1","addr":"172.21.15.63:6833","nonce":2601706233}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-05-18T21:37:21.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.973+0000 7f2fcf882700 1 -- 172.21.15.63:0/3554386474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2fa8057cf0 msgr2=0x7f2fa805a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.973+0000 7f2fcf882700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2fa8057cf0 0x7f2fa805a1b0 secure :-1 s=READY pgs=767 cs=0 l=1 rx=0x7f2fb8002f30 tx=0x7f2fb800a260).stop 2020-05-18T21:37:21.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.973+0000 7f2fcf882700 1 -- 172.21.15.63:0/3554386474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa8004bf0 msgr2=0x7f2fa8004ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:21.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.973+0000 7f2fcde1f700 1 -- 172.21.15.63:0/3554386474 reap_dead start 2020-05-18T21:37:21.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.973+0000 7f2fcf882700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa8004bf0 0x7f2fa8004ff0 secure :-1 s=READY pgs=1968 cs=0 l=1 rx=0x7f2fc4007c50 tx=0x7f2fc4007a80).stop 2020-05-18T21:37:21.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.973+0000 7f2fcf882700 1 -- 172.21.15.63:0/3554386474 shutdown_connections 2020-05-18T21:37:21.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.973+0000 7f2fcf882700 1 --2- 172.21.15.63:0/3554386474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa8004bf0 0x7f2fa8004ff0 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:21.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.973+0000 7f2fcf882700 1 -- 172.21.15.63:0/3554386474 >> 172.21.15.63:0/3554386474 conn(0x7f2fc805a7c0 msgr2=0x7f2fc80ae2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:21.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.973+0000 7f2fcf882700 1 -- 172.21.15.63:0/3554386474 shutdown_connections 2020-05-18T21:37:21.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:21.973+0000 7f2fcf882700 1 -- 172.21.15.63:0/3554386474 wait complete. 2020-05-18T21:37:21.982 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 122 2020-05-18T21:37:22.190 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 122, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:37:18.846766+0000', 'modified': '2020-05-18T21:37:19.851598+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9628}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9628': {'gid': 9628, 'name': 'a', 'rank': 0, 'incarnation': 121, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/2601706233', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 2601706233}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 2601706233}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:37:22.191 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:37:22.192 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:37:22.301 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:37:22.301 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:37:22.301 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:37:22.302 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 9628, 2020-05-18T21:37:22.302 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:37:22.302 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:37:22.302 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 3.4473286569999999, 2020-05-18T21:37:22.303 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 122, 2020-05-18T21:37:22.303 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 145, 2020-05-18T21:37:22.303 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 144, 2020-05-18T21:37:22.303 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 7.6787514430000003 2020-05-18T21:37:22.304 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:37:22.310 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 9628, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.4473286569999999, "mdsmap_epoch": 122, "osdmap_epoch": 145, "osdmap_epoch_barrier": 144, "uptime": 7.6787514430000003 } 2020-05-18T21:37:22.312 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:37:22.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.413+0000 7f073a8fa700 1 Processor -- start 2020-05-18T21:37:22.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.413+0000 7f073a8fa700 1 -- start start 2020-05-18T21:37:22.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f073a8fa700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0734060b90 0x7f07340615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:22.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f073a8fa700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07340b2860 0x7f073414e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:22.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f073a8fa700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0734144090 0x7f07341444e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:22.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f073a8fa700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0734144940 con 0x7f07340b2860 2020-05-18T21:37:22.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f073a8fa700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0734066210 con 0x7f0734144090 2020-05-18T21:37:22.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f073a8fa700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073414d960 con 0x7f0734060b90 2020-05-18T21:37:22.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f07337fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07340b2860 0x7f073414e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:22.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f07337fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07340b2860 0x7f073414e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35622/0 (socket says 172.21.15.63:35622) 2020-05-18T21:37:22.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f07337fe700 1 -- 172.21.15.63:0/1600015690 learned_addr learned my addr 172.21.15.63:0/1600015690 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:22.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f0738e97700 1 --2- 172.21.15.63:0/1600015690 >> v2:172.21.15.155:3300/0 conn(0x7f0734144090 0x7f07341444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:22.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f0733fff700 1 --2- 172.21.15.63:0/1600015690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0734060b90 0x7f07340615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:22.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f07337fe700 1 -- 172.21.15.63:0/1600015690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0734060b90 msgr2=0x7f07340615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:22.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f07337fe700 1 --2- 172.21.15.63:0/1600015690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0734060b90 0x7f07340615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f07337fe700 1 -- 172.21.15.63:0/1600015690 >> v2:172.21.15.155:3300/0 conn(0x7f0734144090 msgr2=0x7f07341444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f07337fe700 1 --2- 172.21.15.63:0/1600015690 >> v2:172.21.15.155:3300/0 conn(0x7f0734144090 0x7f07341444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f07337fe700 1 -- 172.21.15.63:0/1600015690 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073414db90 con 0x7f07340b2860 2020-05-18T21:37:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f0733fff700 1 --2- 172.21.15.63:0/1600015690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0734060b90 0x7f07340615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:37:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f07337fe700 1 --2- 172.21.15.63:0/1600015690 >> v2:172.21.15.63:3300/0 conn(0x7f07340b2860 0x7f073414e570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f07340b92c0 tx=0x7f0724008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f07337fe700 1 --2- 172.21.15.63:0/1600015690 >> v2:172.21.15.63:3300/0 conn(0x7f07340b2860 0x7f073414e570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f07340b92c0 tx=0x7f0724008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f07337fe700 1 --2- 172.21.15.63:0/1600015690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07340b2860 0x7f073414e570 secure :-1 s=READY pgs=1969 cs=0 l=1 rx=0x7f07340b92c0 tx=0x7f0724008920).ready entity=mon.0 client_cookie=d858255ba49bcbc server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:22.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f07337fe700 1 --2- 172.21.15.63:0/1600015690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07340b2860 0x7f073414e570 secure :-1 s=THROTTLE_DONE pgs=1969 cs=0 l=1 rx=0x7f07340b92c0 tx=0x7f0724008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f0732ffd700 1 -- 172.21.15.63:0/1600015690 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0724011720 con 0x7f07340b2860 2020-05-18T21:37:22.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f07337fe700 1 --2- 172.21.15.63:0/1600015690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07340b2860 0x7f073414e570 secure :-1 s=THROTTLE_DONE pgs=1969 cs=0 l=1 rx=0x7f07340b92c0 tx=0x7f0724008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f0732ffd700 1 -- 172.21.15.63:0/1600015690 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0724011880 con 0x7f07340b2860 2020-05-18T21:37:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f07337fe700 1 --2- 172.21.15.63:0/1600015690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07340b2860 0x7f073414e570 secure :-1 s=THROTTLE_DONE pgs=1969 cs=0 l=1 rx=0x7f07340b92c0 tx=0x7f0724008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f0732ffd700 1 -- 172.21.15.63:0/1600015690 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0724011ca0 con 0x7f07340b2860 2020-05-18T21:37:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f073a8fa700 1 -- 172.21.15.63:0/1600015690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07340b2860 msgr2=0x7f073414e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f073a8fa700 1 --2- 172.21.15.63:0/1600015690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07340b2860 0x7f073414e570 secure :-1 s=READY pgs=1969 cs=0 l=1 rx=0x7f07340b92c0 tx=0x7f0724008920).stop 2020-05-18T21:37:22.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f073a8fa700 1 -- 172.21.15.63:0/1600015690 shutdown_connections 2020-05-18T21:37:22.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f073a8fa700 1 --2- 172.21.15.63:0/1600015690 >> v2:172.21.15.155:3300/0 conn(0x7f0734144090 0x7f07341444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:22.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f073a8fa700 1 --2- 172.21.15.63:0/1600015690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07340b2860 0x7f073414e570 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:22.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f073a8fa700 1 --2- 172.21.15.63:0/1600015690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0734060b90 0x7f07340615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:22.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f073a8fa700 1 -- 172.21.15.63:0/1600015690 >> 172.21.15.63:0/1600015690 conn(0x7f07340b83d0 msgr2=0x7f07340b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:22.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f073a8fa700 1 -- 172.21.15.63:0/1600015690 shutdown_connections 2020-05-18T21:37:22.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.417+0000 7f073a8fa700 1 -- 172.21.15.63:0/1600015690 wait complete. 2020-05-18T21:37:22.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f073a8fa700 1 Processor -- start 2020-05-18T21:37:22.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f073a8fa700 1 -- start start 2020-05-18T21:37:22.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f073a8fa700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0734144090 0x7f07341423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:22.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f073a8fa700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0734145810 con 0x7f0734060b90 2020-05-18T21:37:22.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f073a8fa700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0734145ab0 con 0x7f07340b2860 2020-05-18T21:37:22.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f073a8fa700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0734145d50 con 0x7f0734144090 2020-05-18T21:37:22.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f0733fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0734060b90 0x7f07341573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37816/0 (socket says 172.21.15.63:37816) 2020-05-18T21:37:22.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f0733fff700 1 -- 172.21.15.63:0/3586987361 learned_addr learned my addr 172.21.15.63:0/3586987361 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:22.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f0738e97700 1 --2- 172.21.15.63:0/3586987361 >> v2:172.21.15.155:3300/0 conn(0x7f0734144090 0x7f07341423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:22.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f07317fa700 1 -- 172.21.15.63:0/3586987361 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171729448 0 0) 0x7f0734145810 con 0x7f0734060b90 2020-05-18T21:37:22.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f07317fa700 1 -- 172.21.15.63:0/3586987361 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0714002fe0 con 0x7f0734060b90 2020-05-18T21:37:22.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f07317fa700 1 -- 172.21.15.63:0/3586987361 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2138661998 0 0) 0x7f0734145ab0 con 0x7f07340b2860 2020-05-18T21:37:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f07317fa700 1 -- 172.21.15.63:0/3586987361 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0734145810 con 0x7f07340b2860 2020-05-18T21:37:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f0738e97700 1 -- 172.21.15.63:0/3586987361 >> v1:172.21.15.155:6789/0 conn(0x7f07340b2860 legacy=0x7f0734159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f0738e97700 1 -- 172.21.15.63:0/3586987361 >> v1:172.21.15.63:6789/0 conn(0x7f0734060b90 legacy=0x7f07341573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f0738e97700 1 -- 172.21.15.63:0/3586987361 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07341431a0 con 0x7f0734144090 2020-05-18T21:37:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f0738e97700 1 --2- 172.21.15.63:0/3586987361 >> v2:172.21.15.155:3300/0 conn(0x7f0734144090 0x7f07341423b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f072c0032f0 tx=0x7f072c010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f0738e97700 1 --2- 172.21.15.63:0/3586987361 >> v2:172.21.15.155:3300/0 conn(0x7f0734144090 0x7f07341423b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f072c0032f0 tx=0x7f072c010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f0738e97700 1 --2- 172.21.15.63:0/3586987361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0734144090 0x7f07341423b0 secure :-1 s=READY pgs=1303 cs=0 l=1 rx=0x7f072c0032f0 tx=0x7f072c010df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f0738e97700 1 --2- 172.21.15.63:0/3586987361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0734144090 0x7f07341423b0 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7f072c0032f0 tx=0x7f072c010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f07317fa700 1 -- 172.21.15.63:0/3586987361 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f072c012ac0 con 0x7f0734144090 2020-05-18T21:37:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f0738e97700 1 --2- 172.21.15.63:0/3586987361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0734144090 0x7f07341423b0 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7f072c0032f0 tx=0x7f072c010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f0738e97700 1 --2- 172.21.15.63:0/3586987361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0734144090 0x7f07341423b0 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7f072c0032f0 tx=0x7f072c010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f07317fa700 1 -- 172.21.15.63:0/3586987361 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072c012c20 con 0x7f0734144090 2020-05-18T21:37:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f07317fa700 1 -- 172.21.15.63:0/3586987361 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f072c00a180 con 0x7f0734144090 2020-05-18T21:37:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f073a8fa700 1 -- 172.21.15.63:0/3586987361 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0734145490 con 0x7f0734144090 2020-05-18T21:37:22.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.421+0000 7f073a8fa700 1 -- 172.21.15.63:0/3586987361 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073415a730 con 0x7f0734144090 2020-05-18T21:37:22.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.425+0000 7f073a8fa700 1 -- 172.21.15.63:0/3586987361 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07340569e0 con 0x7f0734144090 2020-05-18T21:37:22.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.425+0000 7f0738e97700 1 --2- 172.21.15.63:0/3586987361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0734144090 0x7f07341423b0 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7f072c0032f0 tx=0x7f072c010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.425+0000 7f0738e97700 1 --2- 172.21.15.63:0/3586987361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0734144090 0x7f07341423b0 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7f072c0032f0 tx=0x7f072c010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.425+0000 7f07317fa700 1 -- 172.21.15.63:0/3586987361 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f072c00d430 con 0x7f0734144090 2020-05-18T21:37:22.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.425+0000 7f07317fa700 1 --2- 172.21.15.63:0/3586987361 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f071404fe80 0x7f0714052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:22.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.425+0000 7f07317fa700 1 -- 172.21.15.63:0/3586987361 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f072c0647c0 con 0x7f0734144090 2020-05-18T21:37:22.440 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.425+0000 7f0733fff700 1 --2- 172.21.15.63:0/3586987361 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f071404fe80 0x7f0714052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:22.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.425+0000 7f0733fff700 1 --2- 172.21.15.63:0/3586987361 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f071404fe80 0x7f0714052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0728002f70 tx=0x7f0728002470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.425+0000 7f0733fff700 1 --2- 172.21.15.63:0/3586987361 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f071404fe80 0x7f0714052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0728002f70 tx=0x7f0728002470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.425+0000 7f0733fff700 1 --2- 172.21.15.63:0/3586987361 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f071404fe80 0x7f0714052340 secure :-1 s=READY pgs=768 cs=0 l=1 rx=0x7f0728002f70 tx=0x7f0728002470).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:22.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.433+0000 7f0738e97700 1 --2- 172.21.15.63:0/3586987361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0734144090 0x7f07341423b0 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7f072c0032f0 tx=0x7f072c010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.433+0000 7f07317fa700 1 -- 172.21.15.63:0/3586987361 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f072c03eb10 con 0x7f0734144090 2020-05-18T21:37:22.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.549+0000 7f073a8fa700 1 -- 172.21.15.63:0/3586987361 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0734145620 con 0x7f0734144090 2020-05-18T21:37:22.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.557+0000 7f0738e97700 1 --2- 172.21.15.63:0/3586987361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0734144090 0x7f07341423b0 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7f072c0032f0 tx=0x7f072c010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.557+0000 7f07317fa700 1 -- 172.21.15.63:0/3586987361 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f072c042130 con 0x7f0734144090 2020-05-18T21:37:22.564 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:22.565 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":145,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:37:19.851196+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:37:17.318681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2020-05-18T21:37:17.835103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:37:22.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.561+0000 7f073a8fa700 1 -- 172.21.15.63:0/3586987361 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f071404fe80 msgr2=0x7f0714052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:22.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.561+0000 7f073a8fa700 1 --2- 172.21.15.63:0/3586987361 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f071404fe80 0x7f0714052340 secure :-1 s=READY pgs=768 cs=0 l=1 rx=0x7f0728002f70 tx=0x7f0728002470).stop 2020-05-18T21:37:22.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.561+0000 7f073a8fa700 1 -- 172.21.15.63:0/3586987361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0734144090 msgr2=0x7f07341423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:22.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.561+0000 7f073a8fa700 1 --2- 172.21.15.63:0/3586987361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0734144090 0x7f07341423b0 secure :-1 s=READY pgs=1303 cs=0 l=1 rx=0x7f072c0032f0 tx=0x7f072c010df0).stop 2020-05-18T21:37:22.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.561+0000 7f073a8fa700 1 -- 172.21.15.63:0/3586987361 shutdown_connections 2020-05-18T21:37:22.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.561+0000 7f073a8fa700 1 --2- 172.21.15.63:0/3586987361 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f071404fe80 0x7f0714052340 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:22.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.561+0000 7f073a8fa700 1 --2- 172.21.15.63:0/3586987361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0734144090 0x7f07341423b0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:22.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.561+0000 7f073a8fa700 1 -- 172.21.15.63:0/3586987361 >> 172.21.15.63:0/3586987361 conn(0x7f07340b83d0 msgr2=0x7f0734143680 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:22.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.561+0000 7f073a8fa700 1 -- 172.21.15.63:0/3586987361 shutdown_connections 2020-05-18T21:37:22.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.561+0000 7f073a8fa700 1 -- 172.21.15.63:0/3586987361 wait complete. 2020-05-18T21:37:22.579 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:37:17.318681+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '144', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:37:17.835103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:37:22.580 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:37:22.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d9094a700 1 Processor -- start 2020-05-18T21:37:22.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d9094a700 1 -- start start 2020-05-18T21:37:22.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d9094a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6d8c0b20b0 0x7f6d8c0b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:22.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d9094a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d8c1459f0 0x7f6d8c0b4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:22.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d9094a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8c14a430 con 0x7f6d8c0b2490 2020-05-18T21:37:22.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d9094a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8c149ef0 con 0x7f6d8c0b20b0 2020-05-18T21:37:22.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d9094a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c14a190 con 0x7f6d8c1459f0 2020-05-18T21:37:22.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d8a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6d8c0b20b0 0x7f6d8c0b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:22.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d89d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6d8c0b2490 0x7f6d8c1452e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37824/0 (socket says 172.21.15.63:37824) 2020-05-18T21:37:22.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d89d9b700 1 -- 172.21.15.63:0/4276427105 learned_addr learned my addr 172.21.15.63:0/4276427105 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:22.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d8ad9d700 1 --2- 172.21.15.63:0/4276427105 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d8c1459f0 0x7f6d8c0b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:22.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d8a59c700 1 -- 172.21.15.63:0/4276427105 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d8c1459f0 msgr2=0x7f6d8c0b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:22.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d8a59c700 1 --2- 172.21.15.63:0/4276427105 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d8c1459f0 0x7f6d8c0b4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:22.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d8a59c700 1 -- 172.21.15.63:0/4276427105 >> v1:172.21.15.63:6789/0 conn(0x7f6d8c0b2490 legacy=0x7f6d8c1452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:22.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d8a59c700 1 -- 172.21.15.63:0/4276427105 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c0b3ec0 con 0x7f6d8c0b20b0 2020-05-18T21:37:22.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d8a59c700 1 --2- 172.21.15.63:0/4276427105 >> v2:172.21.15.63:3300/0 conn(0x7f6d8c0b20b0 0x7f6d8c0b8ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6d7c002f70 tx=0x7f6d8c05b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d8a59c700 1 --2- 172.21.15.63:0/4276427105 >> v2:172.21.15.63:3300/0 conn(0x7f6d8c0b20b0 0x7f6d8c0b8ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6d7c002f70 tx=0x7f6d8c05b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d8a59c700 1 --2- 172.21.15.63:0/4276427105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d8c0b20b0 0x7f6d8c0b8ed0 secure :-1 s=READY pgs=1972 cs=0 l=1 rx=0x7f6d7c002f70 tx=0x7f6d8c05b560).ready entity=mon.0 client_cookie=d5e45a912e5e0e73 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:22.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d8a59c700 1 --2- 172.21.15.63:0/4276427105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d8c0b20b0 0x7f6d8c0b8ed0 secure :-1 s=THROTTLE_DONE pgs=1972 cs=0 l=1 rx=0x7f6d7c002f70 tx=0x7f6d8c05b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.677+0000 7f6d8959a700 1 -- 172.21.15.63:0/4276427105 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d7c008e80 con 0x7f6d8c0b20b0 2020-05-18T21:37:22.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.681+0000 7f6d8a59c700 1 --2- 172.21.15.63:0/4276427105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d8c0b20b0 0x7f6d8c0b8ed0 secure :-1 s=THROTTLE_DONE pgs=1972 cs=0 l=1 rx=0x7f6d7c002f70 tx=0x7f6d8c05b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.681+0000 7f6d8959a700 1 -- 172.21.15.63:0/4276427105 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7c0116a0 con 0x7f6d8c0b20b0 2020-05-18T21:37:22.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.681+0000 7f6d8a59c700 1 --2- 172.21.15.63:0/4276427105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d8c0b20b0 0x7f6d8c0b8ed0 secure :-1 s=THROTTLE_DONE pgs=1972 cs=0 l=1 rx=0x7f6d7c002f70 tx=0x7f6d8c05b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.681+0000 7f6d8959a700 1 -- 172.21.15.63:0/4276427105 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d7c011ac0 con 0x7f6d8c0b20b0 2020-05-18T21:37:22.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.681+0000 7f6d9094a700 1 -- 172.21.15.63:0/4276427105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d8c0b20b0 msgr2=0x7f6d8c0b8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:22.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.681+0000 7f6d9094a700 1 --2- 172.21.15.63:0/4276427105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d8c0b20b0 0x7f6d8c0b8ed0 secure :-1 s=READY pgs=1972 cs=0 l=1 rx=0x7f6d7c002f70 tx=0x7f6d8c05b560).stop 2020-05-18T21:37:22.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.681+0000 7f6d9094a700 1 -- 172.21.15.63:0/4276427105 shutdown_connections 2020-05-18T21:37:22.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.681+0000 7f6d9094a700 1 --2- 172.21.15.63:0/4276427105 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d8c1459f0 0x7f6d8c0b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:22.692 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.681+0000 7f6d9094a700 1 --2- 172.21.15.63:0/4276427105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d8c0b20b0 0x7f6d8c0b8ed0 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:22.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.681+0000 7f6d9094a700 1 -- 172.21.15.63:0/4276427105 >> 172.21.15.63:0/4276427105 conn(0x7f6d8c0b83b0 msgr2=0x7f6d8c0b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:22.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.681+0000 7f6d9094a700 1 -- 172.21.15.63:0/4276427105 shutdown_connections 2020-05-18T21:37:22.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.681+0000 7f6d9094a700 1 -- 172.21.15.63:0/4276427105 wait complete. 2020-05-18T21:37:22.693 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.681+0000 7f6d9094a700 1 Processor -- start 2020-05-18T21:37:22.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.681+0000 7f6d9094a700 1 -- start start 2020-05-18T21:37:22.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d9094a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6d8c0b20b0 0x7f6d8c063d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:22.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d9094a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6d8c0b2490 0x7f6d8c0652e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:22.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d9094a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d8c1459f0 0x7f6d8c063450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:22.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d9094a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8c062d40 con 0x7f6d8c0b2490 2020-05-18T21:37:22.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d9094a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8c062fb0 con 0x7f6d8c0b20b0 2020-05-18T21:37:22.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d9094a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c065ba0 con 0x7f6d8c1459f0 2020-05-18T21:37:22.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d89d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6d8c0b2490 0x7f6d8c0652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:22.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d89d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6d8c0b2490 0x7f6d8c0652e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35646/0 (socket says 172.21.15.63:35646) 2020-05-18T21:37:22.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d8ad9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d8c1459f0 0x7f6d8c063450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:22.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d89d9b700 1 -- 172.21.15.63:0/3113495514 learned_addr learned my addr 172.21.15.63:0/3113495514 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:22.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d8a59c700 1 --2- 172.21.15.63:0/3113495514 >> v2:172.21.15.155:3300/0 conn(0x7f6d8c0b20b0 0x7f6d8c063d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:22.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d89d9b700 1 -- 172.21.15.63:0/3113495514 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d8c1459f0 msgr2=0x7f6d8c063450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:22.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d89d9b700 1 --2- 172.21.15.63:0/3113495514 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d8c1459f0 0x7f6d8c063450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:22.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d89d9b700 1 -- 172.21.15.63:0/3113495514 >> v2:172.21.15.155:3300/0 conn(0x7f6d8c0b20b0 msgr2=0x7f6d8c063d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:22.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d89d9b700 1 --2- 172.21.15.63:0/3113495514 >> v2:172.21.15.155:3300/0 conn(0x7f6d8c0b20b0 0x7f6d8c063d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:22.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d89d9b700 1 -- 172.21.15.63:0/3113495514 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c062a00 con 0x7f6d8c0b2490 2020-05-18T21:37:22.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d89d9b700 1 --2- 172.21.15.63:0/3113495514 >> v2:172.21.15.63:3300/0 conn(0x7f6d8c0b2490 0x7f6d8c0652e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6d8c069090 tx=0x7f6d800013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d89d9b700 1 --2- 172.21.15.63:0/3113495514 >> v2:172.21.15.63:3300/0 conn(0x7f6d8c0b2490 0x7f6d8c0652e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6d8c069090 tx=0x7f6d800013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d89d9b700 1 --2- 172.21.15.63:0/3113495514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d8c0b2490 0x7f6d8c0652e0 secure :-1 s=READY pgs=1973 cs=0 l=1 rx=0x7f6d8c069090 tx=0x7f6d800013e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:22.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d89d9b700 1 --2- 172.21.15.63:0/3113495514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d8c0b2490 0x7f6d8c0652e0 secure :-1 s=THROTTLE_DONE pgs=1973 cs=0 l=1 rx=0x7f6d8c069090 tx=0x7f6d800013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d89d9b700 1 --2- 172.21.15.63:0/3113495514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d8c0b2490 0x7f6d8c0652e0 secure :-1 s=THROTTLE_DONE pgs=1973 cs=0 l=1 rx=0x7f6d8c069090 tx=0x7f6d800013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d7b7fe700 1 -- 172.21.15.63:0/3113495514 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d8000c990 con 0x7f6d8c0b2490 2020-05-18T21:37:22.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d89d9b700 1 --2- 172.21.15.63:0/3113495514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d8c0b2490 0x7f6d8c0652e0 secure :-1 s=THROTTLE_DONE pgs=1973 cs=0 l=1 rx=0x7f6d8c069090 tx=0x7f6d800013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d7b7fe700 1 -- 172.21.15.63:0/3113495514 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8000caf0 con 0x7f6d8c0b2490 2020-05-18T21:37:22.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d9094a700 1 -- 172.21.15.63:0/3113495514 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d8c065740 con 0x7f6d8c0b2490 2020-05-18T21:37:22.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d7b7fe700 1 -- 172.21.15.63:0/3113495514 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d8000d0d0 con 0x7f6d8c0b2490 2020-05-18T21:37:22.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d9094a700 1 -- 172.21.15.63:0/3113495514 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d8c1403b0 con 0x7f6d8c0b2490 2020-05-18T21:37:22.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.685+0000 7f6d89d9b700 1 --2- 172.21.15.63:0/3113495514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d8c0b2490 0x7f6d8c0652e0 secure :-1 s=THROTTLE_DONE pgs=1973 cs=0 l=1 rx=0x7f6d8c069090 tx=0x7f6d800013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.689+0000 7f6d7b7fe700 1 -- 172.21.15.63:0/3113495514 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6d80005600 con 0x7f6d8c0b2490 2020-05-18T21:37:22.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.689+0000 7f6d89d9b700 1 --2- 172.21.15.63:0/3113495514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d8c0b2490 0x7f6d8c0652e0 secure :-1 s=THROTTLE_DONE pgs=1973 cs=0 l=1 rx=0x7f6d8c069090 tx=0x7f6d800013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.689+0000 7f6d9094a700 1 -- 172.21.15.63:0/3113495514 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8c0569e0 con 0x7f6d8c0b2490 2020-05-18T21:37:22.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.689+0000 7f6d7b7fe700 1 --2- 172.21.15.63:0/3113495514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d6804fa50 0x7f6d68051f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:22.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.689+0000 7f6d7b7fe700 1 -- 172.21.15.63:0/3113495514 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6d800100c0 con 0x7f6d8c0b2490 2020-05-18T21:37:22.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.689+0000 7f6d8a59c700 1 --2- 172.21.15.63:0/3113495514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d6804fa50 0x7f6d68051f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:22.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.689+0000 7f6d8a59c700 1 --2- 172.21.15.63:0/3113495514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d6804fa50 0x7f6d68051f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6d7c002f70 tx=0x7f6d8c05b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.689+0000 7f6d8a59c700 1 --2- 172.21.15.63:0/3113495514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d6804fa50 0x7f6d68051f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6d7c002f70 tx=0x7f6d8c05b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.689+0000 7f6d8a59c700 1 --2- 172.21.15.63:0/3113495514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d6804fa50 0x7f6d68051f10 secure :-1 s=READY pgs=769 cs=0 l=1 rx=0x7f6d7c002f70 tx=0x7f6d8c05b560).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:22.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.693+0000 7f6d89d9b700 1 --2- 172.21.15.63:0/3113495514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d8c0b2490 0x7f6d8c0652e0 secure :-1 s=THROTTLE_DONE pgs=1973 cs=0 l=1 rx=0x7f6d8c069090 tx=0x7f6d800013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.693+0000 7f6d7b7fe700 1 -- 172.21.15.63:0/3113495514 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6d8003da20 con 0x7f6d8c0b2490 2020-05-18T21:37:22.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.809+0000 7f6d9094a700 1 -- 172.21.15.63:0/3113495514 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6d8c065e30 con 0x7f6d8c0b2490 2020-05-18T21:37:22.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.809+0000 7f6d89d9b700 1 --2- 172.21.15.63:0/3113495514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d8c0b2490 0x7f6d8c0652e0 secure :-1 s=THROTTLE_DONE pgs=1973 cs=0 l=1 rx=0x7f6d8c069090 tx=0x7f6d800013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.809+0000 7f6d7b7fe700 1 -- 172.21.15.63:0/3113495514 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v145) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6d80041040 con 0x7f6d8c0b2490 2020-05-18T21:37:22.815 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:37:22.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.809+0000 7f6d9094a700 1 -- 172.21.15.63:0/3113495514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d6804fa50 msgr2=0x7f6d68051f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:22.817 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.809+0000 7f6d9094a700 1 --2- 172.21.15.63:0/3113495514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d6804fa50 0x7f6d68051f10 secure :-1 s=READY pgs=769 cs=0 l=1 rx=0x7f6d7c002f70 tx=0x7f6d8c05b560).stop 2020-05-18T21:37:22.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.809+0000 7f6d9094a700 1 -- 172.21.15.63:0/3113495514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d8c0b2490 msgr2=0x7f6d8c0652e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:22.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.809+0000 7f6d9094a700 1 --2- 172.21.15.63:0/3113495514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d8c0b2490 0x7f6d8c0652e0 secure :-1 s=READY pgs=1973 cs=0 l=1 rx=0x7f6d8c069090 tx=0x7f6d800013e0).stop 2020-05-18T21:37:22.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.813+0000 7f6d9094a700 1 -- 172.21.15.63:0/3113495514 shutdown_connections 2020-05-18T21:37:22.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.813+0000 7f6d9094a700 1 --2- 172.21.15.63:0/3113495514 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6d6804fa50 0x7f6d68051f10 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:22.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.813+0000 7f6d9094a700 1 --2- 172.21.15.63:0/3113495514 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d8c1459f0 0x7f6d8c063450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:22.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.813+0000 7f6d9094a700 1 --2- 172.21.15.63:0/3113495514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d8c0b2490 0x7f6d8c0652e0 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:22.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.813+0000 7f6d9094a700 1 --2- 172.21.15.63:0/3113495514 >> v2:172.21.15.155:3300/0 conn(0x7f6d8c0b20b0 0x7f6d8c063d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:22.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.813+0000 7f6d9094a700 1 -- 172.21.15.63:0/3113495514 >> 172.21.15.63:0/3113495514 conn(0x7f6d8c0b83b0 msgr2=0x7f6d8c0b62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:22.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.813+0000 7f6d9094a700 1 -- 172.21.15.63:0/3113495514 shutdown_connections 2020-05-18T21:37:22.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.813+0000 7f6d9094a700 1 -- 172.21.15.63:0/3113495514 wait complete. 2020-05-18T21:37:22.828 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:37:22.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.929+0000 7f34c042f700 1 Processor -- start 2020-05-18T21:37:22.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.929+0000 7f34c042f700 1 -- start start 2020-05-18T21:37:22.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.929+0000 7f34c042f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34b80b58e0 0x7f34b805ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:22.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.929+0000 7f34c042f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f34b80b49b0 0x7f34b80640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:22.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.929+0000 7f34c042f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b805ff60 con 0x7f34b8149990 2020-05-18T21:37:22.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.929+0000 7f34c042f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b80655f0 con 0x7f34b80b49b0 2020-05-18T21:37:22.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.929+0000 7f34c042f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b8065890 con 0x7f34b80b58e0 2020-05-18T21:37:22.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.929+0000 7f34be9cc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f34b8149990 0x7f34b8149df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37840/0 (socket says 172.21.15.63:37840) 2020-05-18T21:37:22.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.929+0000 7f34be9cc700 1 -- 172.21.15.63:0/1012131868 learned_addr learned my addr 172.21.15.63:0/1012131868 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:22.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.929+0000 7f34be1cb700 1 --2- 172.21.15.63:0/1012131868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34b80b58e0 0x7f34b805ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:22.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.929+0000 7f34bd9ca700 1 --2- 172.21.15.63:0/1012131868 >> v2:172.21.15.155:3300/0 conn(0x7f34b80b49b0 0x7f34b80640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:22.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.929+0000 7f34bd1c9700 1 -- 172.21.15.63:0/1012131868 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1271752776 0 0) 0x7f34b805ff60 con 0x7f34b8149990 2020-05-18T21:37:22.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.929+0000 7f34bd1c9700 1 -- 172.21.15.63:0/1012131868 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34a0003270 con 0x7f34b8149990 2020-05-18T21:37:22.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd1c9700 1 -- 172.21.15.63:0/1012131868 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2381741933 0 0) 0x7f34a0003270 con 0x7f34b8149990 2020-05-18T21:37:22.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd1c9700 1 -- 172.21.15.63:0/1012131868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34b80b58e0 msgr2=0x7f34b805ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:22.941 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd1c9700 1 --2- 172.21.15.63:0/1012131868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34b80b58e0 0x7f34b805ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd1c9700 1 -- 172.21.15.63:0/1012131868 >> v2:172.21.15.155:3300/0 conn(0x7f34b80b49b0 msgr2=0x7f34b80640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd1c9700 1 --2- 172.21.15.63:0/1012131868 >> v2:172.21.15.155:3300/0 conn(0x7f34b80b49b0 0x7f34b80640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd1c9700 1 -- 172.21.15.63:0/1012131868 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b8061cf0 con 0x7f34b8149990 2020-05-18T21:37:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd1c9700 1 -- 172.21.15.63:0/1012131868 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f34b0001a90 con 0x7f34b8149990 2020-05-18T21:37:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd1c9700 1 -- 172.21.15.63:0/1012131868 >> v1:172.21.15.63:6789/0 conn(0x7f34b8149990 legacy=0x7f34b8149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:22.942 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd1c9700 1 --2- 172.21.15.63:0/1012131868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34b80b58e0 0x7f34a0003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:22.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd1c9700 1 --2- 172.21.15.63:0/1012131868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0003bc0 0x7f34a0004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:22.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd1c9700 1 --2- 172.21.15.63:0/1012131868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34a0004600 0x7f34a0004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:22.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd1c9700 1 -- 172.21.15.63:0/1012131868 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b80655f0 con 0x7f34a0003bc0 2020-05-18T21:37:22.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd1c9700 1 -- 172.21.15.63:0/1012131868 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b8065890 con 0x7f34a0004600 2020-05-18T21:37:22.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd1c9700 1 -- 172.21.15.63:0/1012131868 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a0005090 con 0x7f34b80b58e0 2020-05-18T21:37:22.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd9ca700 1 --2- 172.21.15.63:0/1012131868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0003bc0 0x7f34a0004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:22.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34be1cb700 1 --2- 172.21.15.63:0/1012131868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34b80b58e0 0x7f34a0003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:22.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34be9cc700 1 --2- 172.21.15.63:0/1012131868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34a0004600 0x7f34a0004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:22.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd9ca700 1 -- 172.21.15.63:0/1012131868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34b80b58e0 msgr2=0x7f34a0003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:22.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd9ca700 1 --2- 172.21.15.63:0/1012131868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34b80b58e0 0x7f34a0003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:22.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd9ca700 1 -- 172.21.15.63:0/1012131868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34a0004600 msgr2=0x7f34a0004a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:22.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd9ca700 1 --2- 172.21.15.63:0/1012131868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34a0004600 0x7f34a0004a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:22.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd9ca700 1 -- 172.21.15.63:0/1012131868 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0003270 con 0x7f34a0003bc0 2020-05-18T21:37:22.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34be9cc700 1 --2- 172.21.15.63:0/1012131868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34a0004600 0x7f34a0004a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:37:22.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd9ca700 1 --2- 172.21.15.63:0/1012131868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0003bc0 0x7f34a0004020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f34b4002f70 tx=0x7f34b4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd9ca700 1 --2- 172.21.15.63:0/1012131868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0003bc0 0x7f34a0004020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f34b4002f70 tx=0x7f34b4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd9ca700 1 --2- 172.21.15.63:0/1012131868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0003bc0 0x7f34a0004020 secure :-1 s=READY pgs=1975 cs=0 l=1 rx=0x7f34b4002f70 tx=0x7f34b4010060).ready entity=mon.0 client_cookie=cbe9614e5e44add8 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:22.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd9ca700 1 --2- 172.21.15.63:0/1012131868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0003bc0 0x7f34a0004020 secure :-1 s=THROTTLE_DONE pgs=1975 cs=0 l=1 rx=0x7f34b4002f70 tx=0x7f34b4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd1c9700 1 -- 172.21.15.63:0/1012131868 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34b4008e30 con 0x7f34a0003bc0 2020-05-18T21:37:22.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd9ca700 1 --2- 172.21.15.63:0/1012131868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0003bc0 0x7f34a0004020 secure :-1 s=THROTTLE_DONE pgs=1975 cs=0 l=1 rx=0x7f34b4002f70 tx=0x7f34b4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd9ca700 1 --2- 172.21.15.63:0/1012131868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0003bc0 0x7f34a0004020 secure :-1 s=THROTTLE_DONE pgs=1975 cs=0 l=1 rx=0x7f34b4002f70 tx=0x7f34b4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd1c9700 1 -- 172.21.15.63:0/1012131868 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b4010990 con 0x7f34a0003bc0 2020-05-18T21:37:22.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34bd1c9700 1 -- 172.21.15.63:0/1012131868 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34b4010cf0 con 0x7f34a0003bc0 2020-05-18T21:37:22.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34c042f700 1 -- 172.21.15.63:0/1012131868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0003bc0 msgr2=0x7f34a0004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:22.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34c042f700 1 --2- 172.21.15.63:0/1012131868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0003bc0 0x7f34a0004020 secure :-1 s=READY pgs=1975 cs=0 l=1 rx=0x7f34b4002f70 tx=0x7f34b4010060).stop 2020-05-18T21:37:22.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34be9cc700 1 -- 172.21.15.63:0/1012131868 reap_dead start 2020-05-18T21:37:22.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34c042f700 1 -- 172.21.15.63:0/1012131868 shutdown_connections 2020-05-18T21:37:22.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34c042f700 1 -- 172.21.15.63:0/1012131868 >> 172.21.15.63:0/1012131868 conn(0x7f34b80b8ec0 msgr2=0x7f34b80b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:22.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34c042f700 1 -- 172.21.15.63:0/1012131868 shutdown_connections 2020-05-18T21:37:22.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34c042f700 1 -- 172.21.15.63:0/1012131868 wait complete. 2020-05-18T21:37:22.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34c042f700 1 Processor -- start 2020-05-18T21:37:22.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.933+0000 7f34c042f700 1 -- start start 2020-05-18T21:37:22.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34c042f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f34b8141ec0 0x7f34b80b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:22.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34c042f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f34b8144860 0x7f34b80b7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:22.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34c042f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b80b3ea0 con 0x7f34b80b7470 2020-05-18T21:37:22.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34c042f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b81422a0 con 0x7f34b8141ec0 2020-05-18T21:37:22.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34c042f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b80b4370 con 0x7f34b8144860 2020-05-18T21:37:22.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34be1cb700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f34b8141ec0 0x7f34b80b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:22.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34be1cb700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f34b8141ec0 0x7f34b80b3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35664/0 (socket says 172.21.15.63:35664) 2020-05-18T21:37:22.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34bd9ca700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f34b8144860 0x7f34b80b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:22.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34be1cb700 1 -- 172.21.15.63:0/3105206015 learned_addr learned my addr 172.21.15.63:0/3105206015 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:22.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34be1cb700 1 -- 172.21.15.63:0/3105206015 >> v2:172.21.15.155:3300/0 conn(0x7f34b8144860 msgr2=0x7f34b80b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:22.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34be1cb700 1 --2- 172.21.15.63:0/3105206015 >> v2:172.21.15.155:3300/0 conn(0x7f34b8144860 0x7f34b80b7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:22.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34be1cb700 1 -- 172.21.15.63:0/3105206015 >> v1:172.21.15.155:6789/0 conn(0x7f34b80b7470 legacy=0x7f34b80ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:22.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34be1cb700 1 -- 172.21.15.63:0/3105206015 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b80b40d0 con 0x7f34b8141ec0 2020-05-18T21:37:22.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34be1cb700 1 --2- 172.21.15.63:0/3105206015 >> v2:172.21.15.63:3300/0 conn(0x7f34b8141ec0 0x7f34b80b3870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f34a80030b0 tx=0x7f34a8010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34be1cb700 1 --2- 172.21.15.63:0/3105206015 >> v2:172.21.15.63:3300/0 conn(0x7f34b8141ec0 0x7f34b80b3870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f34a80030b0 tx=0x7f34a8010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34be1cb700 1 --2- 172.21.15.63:0/3105206015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8141ec0 0x7f34b80b3870 secure :-1 s=READY pgs=1976 cs=0 l=1 rx=0x7f34a80030b0 tx=0x7f34a8010df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:22.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34be1cb700 1 --2- 172.21.15.63:0/3105206015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8141ec0 0x7f34b80b3870 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7f34a80030b0 tx=0x7f34a8010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34be1cb700 1 --2- 172.21.15.63:0/3105206015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8141ec0 0x7f34b80b3870 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7f34a80030b0 tx=0x7f34a8010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34a77fe700 1 -- 172.21.15.63:0/3105206015 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34a8007180 con 0x7f34b8141ec0 2020-05-18T21:37:22.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34be1cb700 1 --2- 172.21.15.63:0/3105206015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8141ec0 0x7f34b80b3870 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7f34a80030b0 tx=0x7f34a8010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34a77fe700 1 -- 172.21.15.63:0/3105206015 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a80072e0 con 0x7f34b8141ec0 2020-05-18T21:37:22.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34a77fe700 1 -- 172.21.15.63:0/3105206015 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34a800c420 con 0x7f34b8141ec0 2020-05-18T21:37:22.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34c042f700 1 -- 172.21.15.63:0/3105206015 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b8144cf0 con 0x7f34b8141ec0 2020-05-18T21:37:22.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34c042f700 1 -- 172.21.15.63:0/3105206015 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b80b7aa0 con 0x7f34b8141ec0 2020-05-18T21:37:22.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.937+0000 7f34be1cb700 1 --2- 172.21.15.63:0/3105206015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8141ec0 0x7f34b80b3870 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7f34a80030b0 tx=0x7f34a8010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.941+0000 7f34c042f700 1 -- 172.21.15.63:0/3105206015 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b80b6d30 con 0x7f34b8141ec0 2020-05-18T21:37:22.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.941+0000 7f34a77fe700 1 -- 172.21.15.63:0/3105206015 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f34a800e1a0 con 0x7f34b8141ec0 2020-05-18T21:37:22.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.941+0000 7f34be1cb700 1 --2- 172.21.15.63:0/3105206015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8141ec0 0x7f34b80b3870 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7f34a80030b0 tx=0x7f34a8010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.941+0000 7f34a77fe700 1 --2- 172.21.15.63:0/3105206015 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f349804f9e0 0x7f3498051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:22.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.941+0000 7f34a77fe700 1 -- 172.21.15.63:0/3105206015 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f34a8063ab0 con 0x7f34b8141ec0 2020-05-18T21:37:22.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.941+0000 7f34bd9ca700 1 --2- 172.21.15.63:0/3105206015 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f349804f9e0 0x7f3498051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:22.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.941+0000 7f34bd9ca700 1 --2- 172.21.15.63:0/3105206015 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f349804f9e0 0x7f3498051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f34b4002f70 tx=0x7f34b4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.941+0000 7f34bd9ca700 1 --2- 172.21.15.63:0/3105206015 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f349804f9e0 0x7f3498051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f34b4002f70 tx=0x7f34b4010060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.941+0000 7f34bd9ca700 1 --2- 172.21.15.63:0/3105206015 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f349804f9e0 0x7f3498051ea0 secure :-1 s=READY pgs=770 cs=0 l=1 rx=0x7f34b4002f70 tx=0x7f34b4010060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:22.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.945+0000 7f34be1cb700 1 --2- 172.21.15.63:0/3105206015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8141ec0 0x7f34b80b3870 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7f34a80030b0 tx=0x7f34a8010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:22.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:22.945+0000 7f34a77fe700 1 -- 172.21.15.63:0/3105206015 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f34a803dde0 con 0x7f34b8141ec0 2020-05-18T21:37:23.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.061+0000 7f34c042f700 1 -- 172.21.15.63:0/3105206015 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f34b80569e0 con 0x7f34b8141ec0 2020-05-18T21:37:23.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.061+0000 7f34be1cb700 1 --2- 172.21.15.63:0/3105206015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8141ec0 0x7f34b80b3870 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7f34a80030b0 tx=0x7f34a8010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.061+0000 7f34a77fe700 1 -- 172.21.15.63:0/3105206015 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v145) v1 ==== 92+0+10 (secure 0 0 0) 0x7f34a8041400 con 0x7f34b8141ec0 2020-05-18T21:37:23.069 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:37:23.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.065+0000 7f34c042f700 1 -- 172.21.15.63:0/3105206015 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f349804f9e0 msgr2=0x7f3498051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.065+0000 7f34c042f700 1 --2- 172.21.15.63:0/3105206015 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f349804f9e0 0x7f3498051ea0 secure :-1 s=READY pgs=770 cs=0 l=1 rx=0x7f34b4002f70 tx=0x7f34b4010060).stop 2020-05-18T21:37:23.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.065+0000 7f34c042f700 1 -- 172.21.15.63:0/3105206015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8141ec0 msgr2=0x7f34b80b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.065+0000 7f34c042f700 1 --2- 172.21.15.63:0/3105206015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8141ec0 0x7f34b80b3870 secure :-1 s=READY pgs=1976 cs=0 l=1 rx=0x7f34a80030b0 tx=0x7f34a8010df0).stop 2020-05-18T21:37:23.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.065+0000 7f34c042f700 1 -- 172.21.15.63:0/3105206015 shutdown_connections 2020-05-18T21:37:23.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.065+0000 7f34c042f700 1 --2- 172.21.15.63:0/3105206015 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f349804f9e0 0x7f3498051ea0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:23.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.065+0000 7f34c042f700 1 --2- 172.21.15.63:0/3105206015 >> v2:172.21.15.155:3300/0 conn(0x7f34b8144860 0x7f34b80b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:23.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.065+0000 7f34c042f700 1 --2- 172.21.15.63:0/3105206015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8141ec0 0x7f34b80b3870 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:23.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.065+0000 7f34c042f700 1 -- 172.21.15.63:0/3105206015 >> 172.21.15.63:0/3105206015 conn(0x7f34b80b8ec0 msgr2=0x7f34b8064700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:23.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.065+0000 7f34c042f700 1 -- 172.21.15.63:0/3105206015 shutdown_connections 2020-05-18T21:37:23.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.065+0000 7f34c042f700 1 -- 172.21.15.63:0/3105206015 wait complete. 2020-05-18T21:37:23.081 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:37:23.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f83007700 1 Processor -- start 2020-05-18T21:37:23.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f83007700 1 -- start start 2020-05-18T21:37:23.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f83007700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6f7c0b4f40 0x7f6f7c061180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:23.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f83007700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c0b2eb0 0x7f6f7c0b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:23.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f83007700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7c06a7d0 con 0x7f6f7c06a2c0 2020-05-18T21:37:23.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f83007700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7c0b2a10 con 0x7f6f7c0b4f40 2020-05-18T21:37:23.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f83007700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c0b5320 con 0x7f6f7c0b2eb0 2020-05-18T21:37:23.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f82005700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6f7c0b4f40 0x7f6f7c061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:23.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f82005700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6f7c0b4f40 0x7f6f7c061180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35670/0 (socket says 172.21.15.63:35670) 2020-05-18T21:37:23.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f82005700 1 -- 172.21.15.63:0/2590811483 learned_addr learned my addr 172.21.15.63:0/2590811483 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:23.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f82806700 1 --2- 172.21.15.63:0/2590811483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c0b2eb0 0x7f6f7c0b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:23.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f82005700 1 -- 172.21.15.63:0/2590811483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c0b2eb0 msgr2=0x7f6f7c0b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:23.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f82005700 1 --2- 172.21.15.63:0/2590811483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c0b2eb0 0x7f6f7c0b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:23.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f82005700 1 -- 172.21.15.63:0/2590811483 >> v1:172.21.15.155:6789/0 conn(0x7f6f7c06a2c0 legacy=0x7f6f7c132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f82005700 1 -- 172.21.15.63:0/2590811483 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c1337f0 con 0x7f6f7c0b4f40 2020-05-18T21:37:23.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f82806700 1 --2- 172.21.15.63:0/2590811483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c0b2eb0 0x7f6f7c0b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:37:23.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f82005700 1 --2- 172.21.15.63:0/2590811483 >> v2:172.21.15.63:3300/0 conn(0x7f6f7c0b4f40 0x7f6f7c061180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6f6c002f70 tx=0x7f6f6c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f82005700 1 --2- 172.21.15.63:0/2590811483 >> v2:172.21.15.63:3300/0 conn(0x7f6f7c0b4f40 0x7f6f7c061180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6f6c002f70 tx=0x7f6f6c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f82005700 1 --2- 172.21.15.63:0/2590811483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f7c0b4f40 0x7f6f7c061180 secure :-1 s=READY pgs=1977 cs=0 l=1 rx=0x7f6f6c002f70 tx=0x7f6f6c007a80).ready entity=mon.0 client_cookie=24c2b99f4546adf7 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:23.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f82005700 1 --2- 172.21.15.63:0/2590811483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f7c0b4f40 0x7f6f7c061180 secure :-1 s=THROTTLE_DONE pgs=1977 cs=0 l=1 rx=0x7f6f6c002f70 tx=0x7f6f6c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f81003700 1 -- 172.21.15.63:0/2590811483 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6c011760 con 0x7f6f7c0b4f40 2020-05-18T21:37:23.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f82005700 1 --2- 172.21.15.63:0/2590811483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f7c0b4f40 0x7f6f7c061180 secure :-1 s=THROTTLE_DONE pgs=1977 cs=0 l=1 rx=0x7f6f6c002f70 tx=0x7f6f6c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f81003700 1 -- 172.21.15.63:0/2590811483 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c0118c0 con 0x7f6f7c0b4f40 2020-05-18T21:37:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f82005700 1 --2- 172.21.15.63:0/2590811483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f7c0b4f40 0x7f6f7c061180 secure :-1 s=THROTTLE_DONE pgs=1977 cs=0 l=1 rx=0x7f6f6c002f70 tx=0x7f6f6c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f81003700 1 -- 172.21.15.63:0/2590811483 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6c011ce0 con 0x7f6f7c0b4f40 2020-05-18T21:37:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f83007700 1 -- 172.21.15.63:0/2590811483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f7c0b4f40 msgr2=0x7f6f7c061180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f83007700 1 --2- 172.21.15.63:0/2590811483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f7c0b4f40 0x7f6f7c061180 secure :-1 s=READY pgs=1977 cs=0 l=1 rx=0x7f6f6c002f70 tx=0x7f6f6c007a80).stop 2020-05-18T21:37:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f83007700 1 -- 172.21.15.63:0/2590811483 shutdown_connections 2020-05-18T21:37:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f83007700 1 --2- 172.21.15.63:0/2590811483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c0b2eb0 0x7f6f7c0b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f83007700 1 --2- 172.21.15.63:0/2590811483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f7c0b4f40 0x7f6f7c061180 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f83007700 1 -- 172.21.15.63:0/2590811483 >> 172.21.15.63:0/2590811483 conn(0x7f6f7c05fbd0 msgr2=0x7f6f7c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f83007700 1 -- 172.21.15.63:0/2590811483 shutdown_connections 2020-05-18T21:37:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.181+0000 7f6f83007700 1 -- 172.21.15.63:0/2590811483 wait complete. 2020-05-18T21:37:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f83007700 1 Processor -- start 2020-05-18T21:37:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f83007700 1 -- start start 2020-05-18T21:37:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f83007700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c06a2c0 0x7f6f7c15b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f83007700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6f7c0b4f40 0x7f6f7c14b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f83007700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7c157a70 con 0x7f6f7c0b2eb0 2020-05-18T21:37:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f83007700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7c0b0bf0 con 0x7f6f7c0b4f40 2020-05-18T21:37:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f83007700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c157d10 con 0x7f6f7c06a2c0 2020-05-18T21:37:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f82806700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6f7c0b4f40 0x7f6f7c14b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f82005700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c06a2c0 0x7f6f7c15b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f81804700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f6f7c0b2eb0 0x7f6f7c14abf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:36180/0 (socket says 172.21.15.63:36180) 2020-05-18T21:37:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f81804700 1 -- 172.21.15.63:0/101250219 learned_addr learned my addr 172.21.15.63:0/101250219 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f6b7fe700 1 -- 172.21.15.63:0/101250219 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751409771 0 0) 0x7f6f7c157a70 con 0x7f6f7c0b2eb0 2020-05-18T21:37:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f6b7fe700 1 -- 172.21.15.63:0/101250219 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f5c002fe0 con 0x7f6f7c0b2eb0 2020-05-18T21:37:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f82005700 1 -- 172.21.15.63:0/101250219 >> v2:172.21.15.155:3300/0 conn(0x7f6f7c0b4f40 msgr2=0x7f6f7c14b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f82005700 1 --2- 172.21.15.63:0/101250219 >> v2:172.21.15.155:3300/0 conn(0x7f6f7c0b4f40 0x7f6f7c14b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f82005700 1 -- 172.21.15.63:0/101250219 >> v1:172.21.15.155:6789/0 conn(0x7f6f7c0b2eb0 legacy=0x7f6f7c14abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f82005700 1 -- 172.21.15.63:0/101250219 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c157fb0 con 0x7f6f7c06a2c0 2020-05-18T21:37:23.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f82005700 1 --2- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c06a2c0 0x7f6f7c15b7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f6c002f70 tx=0x7f6f6c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f82005700 1 --2- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c06a2c0 0x7f6f7c15b7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f6c002f70 tx=0x7f6f6c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f82005700 1 --2- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c06a2c0 0x7f6f7c15b7f0 secure :-1 s=READY pgs=300 cs=0 l=1 rx=0x7f6f6c002f70 tx=0x7f6f6c007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:23.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f82005700 1 --2- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c06a2c0 0x7f6f7c15b7f0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f6f6c002f70 tx=0x7f6f6c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f6b7fe700 1 -- 172.21.15.63:0/101250219 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6c011da0 con 0x7f6f7c06a2c0 2020-05-18T21:37:23.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f83007700 1 -- 172.21.15.63:0/101250219 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7c0ae6c0 con 0x7f6f7c06a2c0 2020-05-18T21:37:23.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f82005700 1 --2- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c06a2c0 0x7f6f7c15b7f0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f6f6c002f70 tx=0x7f6f6c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f6b7fe700 1 -- 172.21.15.63:0/101250219 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c007360 con 0x7f6f7c06a2c0 2020-05-18T21:37:23.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f82005700 1 --2- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c06a2c0 0x7f6f7c15b7f0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f6f6c002f70 tx=0x7f6f6c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f6b7fe700 1 -- 172.21.15.63:0/101250219 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6c005700 con 0x7f6f7c06a2c0 2020-05-18T21:37:23.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.185+0000 7f6f83007700 1 -- 172.21.15.63:0/101250219 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7c1577d0 con 0x7f6f7c06a2c0 2020-05-18T21:37:23.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.189+0000 7f6f83007700 1 -- 172.21.15.63:0/101250219 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f7c0569e0 con 0x7f6f7c06a2c0 2020-05-18T21:37:23.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.189+0000 7f6f82005700 1 --2- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c06a2c0 0x7f6f7c15b7f0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f6f6c002f70 tx=0x7f6f6c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.189+0000 7f6f6b7fe700 1 -- 172.21.15.63:0/101250219 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6f6c005900 con 0x7f6f7c06a2c0 2020-05-18T21:37:23.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.189+0000 7f6f82005700 1 --2- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c06a2c0 0x7f6f7c15b7f0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f6f6c002f70 tx=0x7f6f6c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.189+0000 7f6f6b7fe700 1 --2- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f5c04fd00 0x7f6f5c0521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:23.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.189+0000 7f6f6b7fe700 1 -- 172.21.15.63:0/101250219 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6f6c0643a0 con 0x7f6f7c06a2c0 2020-05-18T21:37:23.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.189+0000 7f6f81804700 1 --2- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f5c04fd00 0x7f6f5c0521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:23.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.189+0000 7f6f81804700 1 --2- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f5c04fd00 0x7f6f5c0521c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f78001110 tx=0x7f6f780017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.189+0000 7f6f81804700 1 --2- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f5c04fd00 0x7f6f5c0521c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f78001110 tx=0x7f6f780017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.189+0000 7f6f81804700 1 --2- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f5c04fd00 0x7f6f5c0521c0 secure :-1 s=READY pgs=771 cs=0 l=1 rx=0x7f6f78001110 tx=0x7f6f780017f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:23.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.197+0000 7f6f82005700 1 --2- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c06a2c0 0x7f6f7c15b7f0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f6f6c002f70 tx=0x7f6f6c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.197+0000 7f6f6b7fe700 1 -- 172.21.15.63:0/101250219 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6f6c03e810 con 0x7f6f7c06a2c0 2020-05-18T21:37:23.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.313+0000 7f6f83007700 1 -- 172.21.15.63:0/101250219 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6f7c0b5620 con 0x7f6f7c06a2c0 2020-05-18T21:37:23.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.313+0000 7f6f82005700 1 --2- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c06a2c0 0x7f6f7c15b7f0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f6f6c002f70 tx=0x7f6f6c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.313+0000 7f6f6b7fe700 1 -- 172.21.15.63:0/101250219 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v145) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6f6c041e30 con 0x7f6f7c06a2c0 2020-05-18T21:37:23.320 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:37:23.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.317+0000 7f6f83007700 1 -- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f5c04fd00 msgr2=0x7f6f5c0521c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.317+0000 7f6f83007700 1 --2- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f5c04fd00 0x7f6f5c0521c0 secure :-1 s=READY pgs=771 cs=0 l=1 rx=0x7f6f78001110 tx=0x7f6f780017f0).stop 2020-05-18T21:37:23.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.317+0000 7f6f83007700 1 -- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c06a2c0 msgr2=0x7f6f7c15b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.317+0000 7f6f83007700 1 --2- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c06a2c0 0x7f6f7c15b7f0 secure :-1 s=READY pgs=300 cs=0 l=1 rx=0x7f6f6c002f70 tx=0x7f6f6c007a80).stop 2020-05-18T21:37:23.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.317+0000 7f6f83007700 1 -- 172.21.15.63:0/101250219 shutdown_connections 2020-05-18T21:37:23.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.317+0000 7f6f83007700 1 --2- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f5c04fd00 0x7f6f5c0521c0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:23.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.317+0000 7f6f83007700 1 --2- 172.21.15.63:0/101250219 >> v2:172.21.15.155:3300/0 conn(0x7f6f7c0b4f40 0x7f6f7c14b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:23.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.317+0000 7f6f83007700 1 --2- 172.21.15.63:0/101250219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f7c06a2c0 0x7f6f7c15b7f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:23.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.317+0000 7f6f83007700 1 -- 172.21.15.63:0/101250219 >> 172.21.15.63:0/101250219 conn(0x7f6f7c05fbd0 msgr2=0x7f6f7c0b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:23.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.317+0000 7f6f83007700 1 -- 172.21.15.63:0/101250219 shutdown_connections 2020-05-18T21:37:23.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.317+0000 7f6f83007700 1 -- 172.21.15.63:0/101250219 wait complete. 2020-05-18T21:37:23.338 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:37:23.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.441+0000 7f9195b2e700 1 Processor -- start 2020-05-18T21:37:23.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9195b2e700 1 -- start start 2020-05-18T21:37:23.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9195b2e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91900b9fa0 0x7f919005f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:23.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9195b2e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f91900ba380 0x7f9190146d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:23.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9195b2e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91901432d0 con 0x7f9190143770 2020-05-18T21:37:23.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9195b2e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91901430c0 con 0x7f91900ba380 2020-05-18T21:37:23.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9195b2e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9190147160 con 0x7f91900b9fa0 2020-05-18T21:37:23.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f918f7fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91900b9fa0 0x7f919005f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:23.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9187fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f91900ba380 0x7f9190146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:23.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9187fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f91900ba380 0x7f9190146d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:50536/0 (socket says 172.21.15.63:50536) 2020-05-18T21:37:23.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9187fff700 1 -- 172.21.15.63:0/5634529 learned_addr learned my addr 172.21.15.63:0/5634529 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:23.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f918ffff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f9190143770 0x7f91900b4f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:36190/0 (socket says 172.21.15.63:36190) 2020-05-18T21:37:23.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9187fff700 1 -- 172.21.15.63:0/5634529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91900b9fa0 msgr2=0x7f919005f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:23.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9187fff700 1 --2- 172.21.15.63:0/5634529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91900b9fa0 0x7f919005f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:23.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9187fff700 1 -- 172.21.15.63:0/5634529 >> v1:172.21.15.155:6789/0 conn(0x7f9190143770 legacy=0x7f91900b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f918effd700 1 -- 172.21.15.63:0/5634529 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377443102 0 0) 0x7f91901432d0 con 0x7f9190143770 2020-05-18T21:37:23.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9187fff700 1 -- 172.21.15.63:0/5634529 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9190142cf0 con 0x7f91900ba380 2020-05-18T21:37:23.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f918f7fe700 1 --2- 172.21.15.63:0/5634529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91900b9fa0 0x7f919005f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:23.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9187fff700 1 --2- 172.21.15.63:0/5634529 >> v2:172.21.15.155:3300/0 conn(0x7f91900ba380 0x7f9190146d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9178002f70 tx=0x7f9178007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9187fff700 1 --2- 172.21.15.63:0/5634529 >> v2:172.21.15.155:3300/0 conn(0x7f91900ba380 0x7f9190146d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9178002f70 tx=0x7f9178007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9187fff700 1 --2- 172.21.15.63:0/5634529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91900ba380 0x7f9190146d00 secure :-1 s=READY pgs=1308 cs=0 l=1 rx=0x7f9178002f70 tx=0x7f9178007a80).ready entity=mon.1 client_cookie=3a79a0b624669789 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:23.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9187fff700 1 --2- 172.21.15.63:0/5634529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91900ba380 0x7f9190146d00 secure :-1 s=THROTTLE_DONE pgs=1308 cs=0 l=1 rx=0x7f9178002f70 tx=0x7f9178007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f918effd700 1 -- 172.21.15.63:0/5634529 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91780116b0 con 0x7f91900ba380 2020-05-18T21:37:23.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9187fff700 1 --2- 172.21.15.63:0/5634529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91900ba380 0x7f9190146d00 secure :-1 s=THROTTLE_DONE pgs=1308 cs=0 l=1 rx=0x7f9178002f70 tx=0x7f9178007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f918effd700 1 -- 172.21.15.63:0/5634529 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9178011810 con 0x7f91900ba380 2020-05-18T21:37:23.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9187fff700 1 --2- 172.21.15.63:0/5634529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91900ba380 0x7f9190146d00 secure :-1 s=THROTTLE_DONE pgs=1308 cs=0 l=1 rx=0x7f9178002f70 tx=0x7f9178007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f918effd700 1 -- 172.21.15.63:0/5634529 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9178011bf0 con 0x7f91900ba380 2020-05-18T21:37:23.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9195b2e700 1 -- 172.21.15.63:0/5634529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91900ba380 msgr2=0x7f9190146d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9195b2e700 1 --2- 172.21.15.63:0/5634529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91900ba380 0x7f9190146d00 secure :-1 s=READY pgs=1308 cs=0 l=1 rx=0x7f9178002f70 tx=0x7f9178007a80).stop 2020-05-18T21:37:23.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9195b2e700 1 -- 172.21.15.63:0/5634529 shutdown_connections 2020-05-18T21:37:23.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9195b2e700 1 --2- 172.21.15.63:0/5634529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91900ba380 0x7f9190146d00 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:23.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9195b2e700 1 --2- 172.21.15.63:0/5634529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91900b9fa0 0x7f919005f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:23.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.445+0000 7f9195b2e700 1 -- 172.21.15.63:0/5634529 >> 172.21.15.63:0/5634529 conn(0x7f919005b290 msgr2=0x7f91900b96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:23.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f9195b2e700 1 -- 172.21.15.63:0/5634529 shutdown_connections 2020-05-18T21:37:23.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f9195b2e700 1 -- 172.21.15.63:0/5634529 wait complete. 2020-05-18T21:37:23.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f9195b2e700 1 Processor -- start 2020-05-18T21:37:23.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f9195b2e700 1 -- start start 2020-05-18T21:37:23.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f9195b2e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9190143770 0x7f9190065400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:23.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f9195b2e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9190064a20 con 0x7f91900b9fa0 2020-05-18T21:37:23.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f9195b2e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9190064cc0 con 0x7f91900ba380 2020-05-18T21:37:23.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f9195b2e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9190064f60 con 0x7f9190143770 2020-05-18T21:37:23.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f918ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9190143770 0x7f9190065400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:23.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f918f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f91900b9fa0 0x7f9190153ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37880/0 (socket says 172.21.15.63:37880) 2020-05-18T21:37:23.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f918f7fe700 1 -- 172.21.15.63:0/740574641 learned_addr learned my addr 172.21.15.63:0/740574641 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:23.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f918ffff700 1 -- 172.21.15.63:0/740574641 >> v1:172.21.15.155:6789/0 conn(0x7f91900ba380 legacy=0x7f919013c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f918ffff700 1 -- 172.21.15.63:0/740574641 >> v1:172.21.15.63:6789/0 conn(0x7f91900b9fa0 legacy=0x7f9190153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f918d7fa700 1 -- 172.21.15.63:0/740574641 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227551448 0 0) 0x7f9190064a20 con 0x7f91900b9fa0 2020-05-18T21:37:23.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f918ffff700 1 -- 172.21.15.63:0/740574641 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9190064710 con 0x7f9190143770 2020-05-18T21:37:23.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f918ffff700 1 --2- 172.21.15.63:0/740574641 >> v2:172.21.15.63:3300/0 conn(0x7f9190143770 0x7f9190065400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9188001250 tx=0x7f9188010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f918ffff700 1 --2- 172.21.15.63:0/740574641 >> v2:172.21.15.63:3300/0 conn(0x7f9190143770 0x7f9190065400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9188001250 tx=0x7f9188010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f918ffff700 1 --2- 172.21.15.63:0/740574641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9190143770 0x7f9190065400 secure :-1 s=READY pgs=1979 cs=0 l=1 rx=0x7f9188001250 tx=0x7f9188010cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:23.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f918ffff700 1 --2- 172.21.15.63:0/740574641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9190143770 0x7f9190065400 secure :-1 s=THROTTLE_DONE pgs=1979 cs=0 l=1 rx=0x7f9188001250 tx=0x7f9188010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f918d7fa700 1 -- 172.21.15.63:0/740574641 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9188004c90 con 0x7f9190143770 2020-05-18T21:37:23.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f918ffff700 1 --2- 172.21.15.63:0/740574641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9190143770 0x7f9190065400 secure :-1 s=THROTTLE_DONE pgs=1979 cs=0 l=1 rx=0x7f9188001250 tx=0x7f9188010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f918ffff700 1 --2- 172.21.15.63:0/740574641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9190143770 0x7f9190065400 secure :-1 s=THROTTLE_DONE pgs=1979 cs=0 l=1 rx=0x7f9188001250 tx=0x7f9188010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f918d7fa700 1 -- 172.21.15.63:0/740574641 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9188004e30 con 0x7f9190143770 2020-05-18T21:37:23.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f9195b2e700 1 -- 172.21.15.63:0/740574641 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9190065ca0 con 0x7f9190143770 2020-05-18T21:37:23.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f918d7fa700 1 -- 172.21.15.63:0/740574641 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9188012870 con 0x7f9190143770 2020-05-18T21:37:23.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.449+0000 7f9195b2e700 1 -- 172.21.15.63:0/740574641 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919013d1b0 con 0x7f9190143770 2020-05-18T21:37:23.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.453+0000 7f918ffff700 1 --2- 172.21.15.63:0/740574641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9190143770 0x7f9190065400 secure :-1 s=THROTTLE_DONE pgs=1979 cs=0 l=1 rx=0x7f9188001250 tx=0x7f9188010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.453+0000 7f9195b2e700 1 -- 172.21.15.63:0/740574641 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91900569e0 con 0x7f9190143770 2020-05-18T21:37:23.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.453+0000 7f918d7fa700 1 -- 172.21.15.63:0/740574641 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9188012ae0 con 0x7f9190143770 2020-05-18T21:37:23.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.453+0000 7f918ffff700 1 --2- 172.21.15.63:0/740574641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9190143770 0x7f9190065400 secure :-1 s=THROTTLE_DONE pgs=1979 cs=0 l=1 rx=0x7f9188001250 tx=0x7f9188010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.453+0000 7f918d7fa700 1 --2- 172.21.15.63:0/740574641 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f916804f800 0x7f9168051cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:23.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.453+0000 7f918d7fa700 1 -- 172.21.15.63:0/740574641 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f91880641a0 con 0x7f9190143770 2020-05-18T21:37:23.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.453+0000 7f918f7fe700 1 --2- 172.21.15.63:0/740574641 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f916804f800 0x7f9168051cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:23.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.453+0000 7f918f7fe700 1 --2- 172.21.15.63:0/740574641 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f916804f800 0x7f9168051cc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9180007ac0 tx=0x7f9180009450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.453+0000 7f918f7fe700 1 --2- 172.21.15.63:0/740574641 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f916804f800 0x7f9168051cc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9180007ac0 tx=0x7f9180009450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.453+0000 7f918f7fe700 1 --2- 172.21.15.63:0/740574641 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f916804f800 0x7f9168051cc0 secure :-1 s=READY pgs=772 cs=0 l=1 rx=0x7f9180007ac0 tx=0x7f9180009450).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:23.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.461+0000 7f918ffff700 1 --2- 172.21.15.63:0/740574641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9190143770 0x7f9190065400 secure :-1 s=THROTTLE_DONE pgs=1979 cs=0 l=1 rx=0x7f9188001250 tx=0x7f9188010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.461+0000 7f918d7fa700 1 -- 172.21.15.63:0/740574641 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f918803e530 con 0x7f9190143770 2020-05-18T21:37:23.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.577+0000 7f9195b2e700 1 -- 172.21.15.63:0/740574641 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f919006ac80 con 0x7f9190143770 2020-05-18T21:37:23.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.577+0000 7f918ffff700 1 --2- 172.21.15.63:0/740574641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9190143770 0x7f9190065400 secure :-1 s=THROTTLE_DONE pgs=1979 cs=0 l=1 rx=0x7f9188001250 tx=0x7f9188010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.577+0000 7f918d7fa700 1 -- 172.21.15.63:0/740574641 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v145) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9188041b50 con 0x7f9190143770 2020-05-18T21:37:23.585 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:37:23.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.581+0000 7f9195b2e700 1 -- 172.21.15.63:0/740574641 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f916804f800 msgr2=0x7f9168051cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.581+0000 7f9195b2e700 1 --2- 172.21.15.63:0/740574641 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f916804f800 0x7f9168051cc0 secure :-1 s=READY pgs=772 cs=0 l=1 rx=0x7f9180007ac0 tx=0x7f9180009450).stop 2020-05-18T21:37:23.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.581+0000 7f9195b2e700 1 -- 172.21.15.63:0/740574641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9190143770 msgr2=0x7f9190065400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.581+0000 7f9195b2e700 1 --2- 172.21.15.63:0/740574641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9190143770 0x7f9190065400 secure :-1 s=READY pgs=1979 cs=0 l=1 rx=0x7f9188001250 tx=0x7f9188010cb0).stop 2020-05-18T21:37:23.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.581+0000 7f9195b2e700 1 -- 172.21.15.63:0/740574641 shutdown_connections 2020-05-18T21:37:23.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.581+0000 7f9195b2e700 1 --2- 172.21.15.63:0/740574641 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f916804f800 0x7f9168051cc0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:23.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.581+0000 7f9195b2e700 1 --2- 172.21.15.63:0/740574641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9190143770 0x7f9190065400 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:23.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.581+0000 7f9195b2e700 1 -- 172.21.15.63:0/740574641 >> 172.21.15.63:0/740574641 conn(0x7f919005b290 msgr2=0x7f91900b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:23.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.581+0000 7f9195b2e700 1 -- 172.21.15.63:0/740574641 shutdown_connections 2020-05-18T21:37:23.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.581+0000 7f9195b2e700 1 -- 172.21.15.63:0/740574641 wait complete. 2020-05-18T21:37:23.603 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:37:23.603 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:23.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74ed8fa700 1 Processor -- start 2020-05-18T21:37:23.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74ed8fa700 1 -- start start 2020-05-18T21:37:23.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74ed8fa700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74e8065e40 0x7f74e80649d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:23.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74ed8fa700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f74e8064e30 0x7f74e8145a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:23.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74ed8fa700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e81433a0 con 0x7f74e8061500 2020-05-18T21:37:23.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74ed8fa700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e813c9c0 con 0x7f74e8064e30 2020-05-18T21:37:23.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74ed8fa700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e8146850 con 0x7f74e8065e40 2020-05-18T21:37:23.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74e6ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f74e8061500 0x7f74e8142c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37886/0 (socket says 172.21.15.63:37886) 2020-05-18T21:37:23.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74e6ffd700 1 -- 172.21.15.63:0/2238359756 learned_addr learned my addr 172.21.15.63:0/2238359756 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:23.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74e77fe700 1 --2- 172.21.15.63:0/2238359756 >> v2:172.21.15.63:3300/0 conn(0x7f74e8064e30 0x7f74e8145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:23.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74de7fc700 1 --2- 172.21.15.63:0/2238359756 >> v2:172.21.15.155:3300/0 conn(0x7f74e8065e40 0x7f74e80649d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:23.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74e67fc700 1 -- 172.21.15.63:0/2238359756 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2829215249 0 0) 0x7f74e81433a0 con 0x7f74e8061500 2020-05-18T21:37:23.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74e67fc700 1 -- 172.21.15.63:0/2238359756 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74c8003270 con 0x7f74e8061500 2020-05-18T21:37:23.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74e67fc700 1 -- 172.21.15.63:0/2238359756 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 702821553 0 0) 0x7f74c8003270 con 0x7f74e8061500 2020-05-18T21:37:23.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74e77fe700 1 -- 172.21.15.63:0/2238359756 >> v2:172.21.15.155:3300/0 conn(0x7f74e8065e40 msgr2=0x7f74e80649d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:23.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74e77fe700 1 --2- 172.21.15.63:0/2238359756 >> v2:172.21.15.155:3300/0 conn(0x7f74e8065e40 0x7f74e80649d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:23.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74e77fe700 1 -- 172.21.15.63:0/2238359756 >> v1:172.21.15.63:6789/0 conn(0x7f74e8061500 legacy=0x7f74e8142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74e77fe700 1 -- 172.21.15.63:0/2238359756 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e8142550 con 0x7f74e8064e30 2020-05-18T21:37:23.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74e77fe700 1 --2- 172.21.15.63:0/2238359756 >> v2:172.21.15.63:3300/0 conn(0x7f74e8064e30 0x7f74e8145a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f74d80018b0 tx=0x7f74e0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74e77fe700 1 --2- 172.21.15.63:0/2238359756 >> v2:172.21.15.63:3300/0 conn(0x7f74e8064e30 0x7f74e8145a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f74d80018b0 tx=0x7f74e0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74e77fe700 1 --2- 172.21.15.63:0/2238359756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74e8064e30 0x7f74e8145a10 secure :-1 s=READY pgs=1981 cs=0 l=1 rx=0x7f74d80018b0 tx=0x7f74e0007e00).ready entity=mon.0 client_cookie=493299188cf91c43 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:23.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74e77fe700 1 --2- 172.21.15.63:0/2238359756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74e8064e30 0x7f74e8145a10 secure :-1 s=THROTTLE_DONE pgs=1981 cs=0 l=1 rx=0x7f74d80018b0 tx=0x7f74e0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74e67fc700 1 -- 172.21.15.63:0/2238359756 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74d8001710 con 0x7f74e8064e30 2020-05-18T21:37:23.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74e77fe700 1 --2- 172.21.15.63:0/2238359756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74e8064e30 0x7f74e8145a10 secure :-1 s=THROTTLE_DONE pgs=1981 cs=0 l=1 rx=0x7f74d80018b0 tx=0x7f74e0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74e67fc700 1 -- 172.21.15.63:0/2238359756 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e0010a50 con 0x7f74e8064e30 2020-05-18T21:37:23.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74e77fe700 1 --2- 172.21.15.63:0/2238359756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74e8064e30 0x7f74e8145a10 secure :-1 s=THROTTLE_DONE pgs=1981 cs=0 l=1 rx=0x7f74d80018b0 tx=0x7f74e0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74e67fc700 1 -- 172.21.15.63:0/2238359756 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74e0010df0 con 0x7f74e8064e30 2020-05-18T21:37:23.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74ed8fa700 1 -- 172.21.15.63:0/2238359756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74e8064e30 msgr2=0x7f74e8145a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74ed8fa700 1 --2- 172.21.15.63:0/2238359756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74e8064e30 0x7f74e8145a10 secure :-1 s=READY pgs=1981 cs=0 l=1 rx=0x7f74d80018b0 tx=0x7f74e0007e00).stop 2020-05-18T21:37:23.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74ed8fa700 1 -- 172.21.15.63:0/2238359756 shutdown_connections 2020-05-18T21:37:23.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74ed8fa700 1 --2- 172.21.15.63:0/2238359756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74e8064e30 0x7f74e8145a10 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:23.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74ed8fa700 1 --2- 172.21.15.63:0/2238359756 >> v2:172.21.15.155:3300/0 conn(0x7f74e8065e40 0x7f74e80649d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:23.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74ed8fa700 1 -- 172.21.15.63:0/2238359756 >> 172.21.15.63:0/2238359756 conn(0x7f74e80b83d0 msgr2=0x7f74e80b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:23.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74ed8fa700 1 -- 172.21.15.63:0/2238359756 shutdown_connections 2020-05-18T21:37:23.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.697+0000 7f74ed8fa700 1 -- 172.21.15.63:0/2238359756 wait complete. 2020-05-18T21:37:23.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.701+0000 7f74ed8fa700 1 Processor -- start 2020-05-18T21:37:23.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.701+0000 7f74ed8fa700 1 -- start start 2020-05-18T21:37:23.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.701+0000 7f74ed8fa700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74e8061500 0x7f74e8131910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:23.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.701+0000 7f74ed8fa700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e8133b30 con 0x7f74e8064e30 2020-05-18T21:37:23.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74ed8fa700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e8134240 con 0x7f74e8065e40 2020-05-18T21:37:23.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74ed8fa700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e8131130 con 0x7f74e8061500 2020-05-18T21:37:23.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74de7fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f74e8064e30 0x7f74e813cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37894/0 (socket says 172.21.15.63:37894) 2020-05-18T21:37:23.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74de7fc700 1 -- 172.21.15.63:0/760123304 learned_addr learned my addr 172.21.15.63:0/760123304 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:23.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e6ffd700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74e8061500 0x7f74e8131910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:23.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191392789 0 0) 0x7f74e8133b30 con 0x7f74e8064e30 2020-05-18T21:37:23.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74cc002fe0 con 0x7f74e8064e30 2020-05-18T21:37:23.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076640650 0 0) 0x7f74e8134240 con 0x7f74e8065e40 2020-05-18T21:37:23.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74e8133b30 con 0x7f74e8065e40 2020-05-18T21:37:23.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2849219778 0 0) 0x7f74cc002fe0 con 0x7f74e8064e30 2020-05-18T21:37:23.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f74e8134240 con 0x7f74e8064e30 2020-05-18T21:37:23.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f74d00014d0 con 0x7f74e8064e30 2020-05-18T21:37:23.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74e8061500 msgr2=0x7f74e8131910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74e8061500 0x7f74e8131910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:23.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 >> v1:172.21.15.155:6789/0 conn(0x7f74e8065e40 legacy=0x7f74e813d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 >> v1:172.21.15.63:6789/0 conn(0x7f74e8064e30 legacy=0x7f74e813cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74cc004bf0 0x7f74cc004fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:23.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74cc003880 0x7f74cc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:23.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74cc004160 0x7f74cc00b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:23.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e8131130 con 0x7f74cc003880 2020-05-18T21:37:23.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc0046f0 con 0x7f74cc004160 2020-05-18T21:37:23.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74de7fc700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74cc003880 0x7f74cc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:23.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc00bbf0 con 0x7f74cc004bf0 2020-05-18T21:37:23.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e6ffd700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74e8061500 0x7f74e8131910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:23.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e77fe700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74cc004160 0x7f74cc00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:23.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74de7fc700 1 -- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74cc004bf0 msgr2=0x7f74cc004fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e6ffd700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74cc004bf0 0x7f74cc004fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:23.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74de7fc700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74cc004bf0 0x7f74cc004fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:23.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74de7fc700 1 -- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74cc004160 msgr2=0x7f74cc00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74de7fc700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74cc004160 0x7f74cc00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:23.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74de7fc700 1 -- 172.21.15.63:0/760123304 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e813d950 con 0x7f74cc003880 2020-05-18T21:37:23.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e77fe700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74cc004160 0x7f74cc00b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:37:23.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74ed8fa700 1 -- 172.21.15.63:0/760123304 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e813c440 con 0x7f74cc003880 2020-05-18T21:37:23.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e6ffd700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74cc004bf0 0x7f74cc004fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:37:23.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74de7fc700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74cc003880 0x7f74cc003d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f74d0002f70 tx=0x7f74cc004830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74ed8fa700 1 -- 172.21.15.63:0/760123304 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e8131420 con 0x7f74cc003880 2020-05-18T21:37:23.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74de7fc700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74cc003880 0x7f74cc003d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f74d0002f70 tx=0x7f74cc004830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74de7fc700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74cc003880 0x7f74cc003d00 secure :-1 s=READY pgs=1983 cs=0 l=1 rx=0x7f74d0002f70 tx=0x7f74cc004830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:23.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74de7fc700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74cc003880 0x7f74cc003d00 secure :-1 s=THROTTLE_DONE pgs=1983 cs=0 l=1 rx=0x7f74d0002f70 tx=0x7f74cc004830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74d0007560 con 0x7f74cc003880 2020-05-18T21:37:23.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74de7fc700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74cc003880 0x7f74cc003d00 secure :-1 s=THROTTLE_DONE pgs=1983 cs=0 l=1 rx=0x7f74d0002f70 tx=0x7f74cc004830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74de7fc700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74cc003880 0x7f74cc003d00 secure :-1 s=THROTTLE_DONE pgs=1983 cs=0 l=1 rx=0x7f74d0002f70 tx=0x7f74cc004830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d000f0c0 con 0x7f74cc003880 2020-05-18T21:37:23.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74d0005bf0 con 0x7f74cc003880 2020-05-18T21:37:23.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74de7fc700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74cc003880 0x7f74cc003d00 secure :-1 s=THROTTLE_DONE pgs=1983 cs=0 l=1 rx=0x7f74d0002f70 tx=0x7f74cc004830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.705+0000 7f74ed8fa700 1 -- 172.21.15.63:0/760123304 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c0003380 con 0x7f74cc003880 2020-05-18T21:37:23.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.709+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f74d0005d50 con 0x7f74cc003880 2020-05-18T21:37:23.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.709+0000 7f74de7fc700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74cc003880 0x7f74cc003d00 secure :-1 s=THROTTLE_DONE pgs=1983 cs=0 l=1 rx=0x7f74d0002f70 tx=0x7f74cc004830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.709+0000 7f74e4ff9700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f74cc0583b0 0x7f74cc05a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:23.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.709+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f74d00647c0 con 0x7f74cc003880 2020-05-18T21:37:23.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.709+0000 7f74e6ffd700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f74cc0583b0 0x7f74cc05a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:23.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.709+0000 7f74e6ffd700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f74cc0583b0 0x7f74cc05a870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f74d8001970 tx=0x7f74d800cb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.709+0000 7f74e6ffd700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f74cc0583b0 0x7f74cc05a870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f74d8001970 tx=0x7f74d800cb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.709+0000 7f74e6ffd700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f74cc0583b0 0x7f74cc05a870 secure :-1 s=READY pgs=773 cs=0 l=1 rx=0x7f74d8001970 tx=0x7f74d800cb10).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:23.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.717+0000 7f74de7fc700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74cc003880 0x7f74cc003d00 secure :-1 s=THROTTLE_DONE pgs=1983 cs=0 l=1 rx=0x7f74d0002f70 tx=0x7f74cc004830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.717+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f74d003eb50 con 0x7f74cc003880 2020-05-18T21:37:23.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.865+0000 7f74ed8fa700 1 -- 172.21.15.63:0/760123304 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74c0003720 con 0x7f74cc003880 2020-05-18T21:37:23.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.869+0000 7f74de7fc700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74cc003880 0x7f74cc003d00 secure :-1 s=THROTTLE_DONE pgs=1983 cs=0 l=1 rx=0x7f74d0002f70 tx=0x7f74cc004830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:23.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.869+0000 7f74e4ff9700 1 -- 172.21.15.63:0/760123304 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 122 v122) v1 ==== 95+0+2149 (secure 0 0 0) 0x7f74d0042170 con 0x7f74cc003880 2020-05-18T21:37:23.874 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:23.874 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":122,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6953,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1677585089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1677585089},{"type":"v1","addr":"172.21.15.155:6835","nonce":1677585089}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":120}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:18.846766+0000","modified":"2020-05-18T21:37:19.851598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9628":{"gid":9628,"name":"a","rank":0,"incarnation":121,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/2601706233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2601706233},{"type":"v1","addr":"172.21.15.63:6833","nonce":2601706233}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-05-18T21:37:23.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.869+0000 7f74ed8fa700 1 -- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f74cc0583b0 msgr2=0x7f74cc05a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.869+0000 7f74ed8fa700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f74cc0583b0 0x7f74cc05a870 secure :-1 s=READY pgs=773 cs=0 l=1 rx=0x7f74d8001970 tx=0x7f74d800cb10).stop 2020-05-18T21:37:23.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.869+0000 7f74ed8fa700 1 -- 172.21.15.63:0/760123304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74cc003880 msgr2=0x7f74cc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:23.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.869+0000 7f74e77fe700 1 -- 172.21.15.63:0/760123304 reap_dead start 2020-05-18T21:37:23.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.869+0000 7f74ed8fa700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74cc003880 0x7f74cc003d00 secure :-1 s=READY pgs=1983 cs=0 l=1 rx=0x7f74d0002f70 tx=0x7f74cc004830).stop 2020-05-18T21:37:23.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.869+0000 7f74ed8fa700 1 -- 172.21.15.63:0/760123304 shutdown_connections 2020-05-18T21:37:23.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.869+0000 7f74ed8fa700 1 --2- 172.21.15.63:0/760123304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74cc003880 0x7f74cc003d00 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:23.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.869+0000 7f74ed8fa700 1 -- 172.21.15.63:0/760123304 >> 172.21.15.63:0/760123304 conn(0x7f74e80b83d0 msgr2=0x7f74e80b8940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:23.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.869+0000 7f74ed8fa700 1 -- 172.21.15.63:0/760123304 shutdown_connections 2020-05-18T21:37:23.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:23.869+0000 7f74ed8fa700 1 -- 172.21.15.63:0/760123304 wait complete. 2020-05-18T21:37:23.878 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 122 2020-05-18T21:37:24.088 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 122, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:37:18.846766+0000', 'modified': '2020-05-18T21:37:19.851598+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9628}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9628': {'gid': 9628, 'name': 'a', 'rank': 0, 'incarnation': 121, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/2601706233', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 2601706233}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 2601706233}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:37:24.089 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:37:24.090 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:37:24.195 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:37:24.196 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:37:24.196 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:37:24.196 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 9628, 2020-05-18T21:37:24.196 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:37:24.196 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:37:24.197 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 5.3418829629999998, 2020-05-18T21:37:24.197 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 122, 2020-05-18T21:37:24.197 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 145, 2020-05-18T21:37:24.197 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 144, 2020-05-18T21:37:24.197 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 9.5733056090000002 2020-05-18T21:37:24.198 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:37:24.204 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 9628, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.3418829629999998, "mdsmap_epoch": 122, "osdmap_epoch": 145, "osdmap_epoch_barrier": 144, "uptime": 9.5733056090000002 } 2020-05-18T21:37:24.205 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:37:24.205 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:37:24.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.207 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:37:24.214 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:37:24.215 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:37:24.215 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:37:24.215 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:24.215 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:37:24.216 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:24.216 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:24.216 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:24.216 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:24.216 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:24.217 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:24.217 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:24.217 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:37:24.217 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:24.217 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:37:24.218 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42198sec preferred_lft 42198sec 2020-05-18T21:37:24.218 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:37:24.218 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:24.218 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:37:24.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.219 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:37:24.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.239 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:37:24.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.300 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:37:24.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.316 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:37:24.329 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:37:24.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.331 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:37:24.381 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:37:24.382 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:37:24.382 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:37:24.382 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:37:24.382 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:37:24.383 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:37:24.383 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:37:24.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.384 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:37:24.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.402 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:37:24.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.420 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:37:24.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.479 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:37:24.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.487 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:37:24.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.494 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:37:24.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.510 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-05-18T21:37:24.527 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-05-18T21:37:24.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.528 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-05-18T21:37:24.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.542 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:37:24.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.603 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-05-18T21:37:24.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.622 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-05-18T21:37:24.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.637 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-05-18T21:37:24.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.655 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 up' 2020-05-18T21:37:24.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:24.721 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.0 master ceph-brx' 2020-05-18T21:37:24.740 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-05-18T21:37:24.741 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-05-18T21:37:24.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:24.742 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:37:24.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:24.749 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:37:24.805 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:37:24.806 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:37:24.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:24.807 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:37:24.812 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:37:24.813 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:37:24.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:24.816 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:37:24.833 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:37:24.834 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:37:24.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:24.835 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:37:24.900 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2020-05-18T21:37:24.893+0000 7f5824fdc080 -1 init, newargv = 0x55fcd5c54530 newargc=9 2020-05-18T21:37:24.901 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[38358]: starting ceph client 2020-05-18T21:37:24.911 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[38358]: starting fuse 2020-05-18T21:37:25.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:25.984 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:37:26.002 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:37:26.003 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:37:26.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:26.004 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:37:26.009 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:37:26.010 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:37:26.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:26.011 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:37:26.011 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:37:26.012 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:37:26.012 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:37:26.012 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:37:26.013 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:37:26.013 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:37:26.014 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:37:26.014 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:37:26.015 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:37:26.015 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:37:26.015 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:37:26.016 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:37:26.016 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:37:26.017 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:37:26.017 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:37:26.017 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:37:26.018 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:37:26.018 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:37:26.019 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:37:26.019 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:37:26.020 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:37:26.020 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:37:26.099 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.38358.asok 2020-05-18T21:37:26.104 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.38358.asok 2020-05-18T21:37:26.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:26.105 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.38358.asok status 2020-05-18T21:37:26.200 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:37:26.201 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:37:26.201 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:37:26.201 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:37:26.201 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:37:26.202 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:37:26.202 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:37:26.202 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "38358", 2020-05-18T21:37:26.202 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:37:26.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:26.203 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:37:26.203 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:37:26.203 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 7070, 2020-05-18T21:37:26.203 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:37:26.203 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:37:26.203 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:37:26.204 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 7070 2020-05-18T21:37:26.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:26.204 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:37:26.204 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:26.204 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:37:26.205 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3596350948 2020-05-18T21:37:26.205 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:26.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:26.205 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:37:26.206 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:26.206 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:37:26.206 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3596350948 2020-05-18T21:37:26.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:26.206 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.7070 192.168.0.1:0/3596350948", 2020-05-18T21:37:26.206 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/3596350948", 2020-05-18T21:37:26.207 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:37:26.207 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 122, 2020-05-18T21:37:26.207 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 145, 2020-05-18T21:37:26.207 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:37:26.207 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:37:26.208 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:37:26.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:26.209 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:37:26.210 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:37:26.217 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:37:26.218 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-05-18T21:37:26.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:26.219 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:37:26.281 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:37:26.282 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:37:26.282 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:37:26.283 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:37:26.297 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:37:26.297 DEBUG:teuthology.parallel:result is None 2020-05-18T21:37:26.299 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:37:26.299 DEBUG:teuthology.parallel:result is None 2020-05-18T21:37:26.300 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail a 2020-05-18T21:37:26.301 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail b 2020-05-18T21:37:26.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.437+0000 7f3ba3c0b700 1 Processor -- start 2020-05-18T21:37:26.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.437+0000 7f3ba3c0b700 1 -- start start 2020-05-18T21:37:26.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba3c0b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3b9c0b9150 0x7f3b9c0ba0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:26.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba3c0b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b9c142f30 0x7f3b9c1433c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:26.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba3c0b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b9c12e800 0x7f3b9c12ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:26.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba3c0b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9c146d00 con 0x7f3b9c142f30 2020-05-18T21:37:26.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba3c0b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9c147260 con 0x7f3b9c0b9150 2020-05-18T21:37:26.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba3c0b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0b9530 con 0x7f3b9c12e800 2020-05-18T21:37:26.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba11a6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b9c142f30 0x7f3b9c1433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba11a6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b9c142f30 0x7f3b9c1433c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35736/0 (socket says 172.21.15.63:35736) 2020-05-18T21:37:26.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba11a6700 1 -- 172.21.15.63:0/1482644240 learned_addr learned my addr 172.21.15.63:0/1482644240 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:26.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba21a8700 1 --2- 172.21.15.63:0/1482644240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b9c12e800 0x7f3b9c12ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba19a7700 1 --2- 172.21.15.63:0/1482644240 >> v2:172.21.15.155:3300/0 conn(0x7f3b9c0b9150 0x7f3b9c0ba0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba11a6700 1 -- 172.21.15.63:0/1482644240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b9c12e800 msgr2=0x7f3b9c12ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:26.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba11a6700 1 --2- 172.21.15.63:0/1482644240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b9c12e800 0x7f3b9c12ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:26.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba11a6700 1 -- 172.21.15.63:0/1482644240 >> v2:172.21.15.155:3300/0 conn(0x7f3b9c0b9150 msgr2=0x7f3b9c0ba0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:26.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba11a6700 1 --2- 172.21.15.63:0/1482644240 >> v2:172.21.15.155:3300/0 conn(0x7f3b9c0b9150 0x7f3b9c0ba0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:26.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba11a6700 1 -- 172.21.15.63:0/1482644240 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c143820 con 0x7f3b9c142f30 2020-05-18T21:37:26.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba11a6700 1 --2- 172.21.15.63:0/1482644240 >> v2:172.21.15.63:3300/0 conn(0x7f3b9c142f30 0x7f3b9c1433c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3b8c002f70 tx=0x7f3b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba11a6700 1 --2- 172.21.15.63:0/1482644240 >> v2:172.21.15.63:3300/0 conn(0x7f3b9c142f30 0x7f3b9c1433c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3b8c002f70 tx=0x7f3b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba11a6700 1 --2- 172.21.15.63:0/1482644240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b9c142f30 0x7f3b9c1433c0 secure :-1 s=READY pgs=1986 cs=0 l=1 rx=0x7f3b8c002f70 tx=0x7f3b8c007a80).ready entity=mon.0 client_cookie=24ee4b479d680259 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:26.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba11a6700 1 --2- 172.21.15.63:0/1482644240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b9c142f30 0x7f3b9c1433c0 secure :-1 s=THROTTLE_DONE pgs=1986 cs=0 l=1 rx=0x7f3b8c002f70 tx=0x7f3b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba11a6700 1 --2- 172.21.15.63:0/1482644240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b9c142f30 0x7f3b9c1433c0 secure :-1 s=THROTTLE_DONE pgs=1986 cs=0 l=1 rx=0x7f3b8c002f70 tx=0x7f3b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba09a5700 1 -- 172.21.15.63:0/1482644240 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b8c011600 con 0x7f3b9c142f30 2020-05-18T21:37:26.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba11a6700 1 --2- 172.21.15.63:0/1482644240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b9c142f30 0x7f3b9c1433c0 secure :-1 s=THROTTLE_DONE pgs=1986 cs=0 l=1 rx=0x7f3b8c002f70 tx=0x7f3b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba09a5700 1 -- 172.21.15.63:0/1482644240 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c011760 con 0x7f3b9c142f30 2020-05-18T21:37:26.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba09a5700 1 -- 172.21.15.63:0/1482644240 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b8c011b80 con 0x7f3b9c142f30 2020-05-18T21:37:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba3c0b700 1 -- 172.21.15.63:0/1482644240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b9c142f30 msgr2=0x7f3b9c1433c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba3c0b700 1 --2- 172.21.15.63:0/1482644240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b9c142f30 0x7f3b9c1433c0 secure :-1 s=READY pgs=1986 cs=0 l=1 rx=0x7f3b8c002f70 tx=0x7f3b8c007a80).stop 2020-05-18T21:37:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba3c0b700 1 -- 172.21.15.63:0/1482644240 shutdown_connections 2020-05-18T21:37:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba3c0b700 1 --2- 172.21.15.63:0/1482644240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b9c12e800 0x7f3b9c12ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba3c0b700 1 --2- 172.21.15.63:0/1482644240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b9c142f30 0x7f3b9c1433c0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:26.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba3c0b700 1 --2- 172.21.15.63:0/1482644240 >> v2:172.21.15.155:3300/0 conn(0x7f3b9c0b9150 0x7f3b9c0ba0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:26.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba3c0b700 1 -- 172.21.15.63:0/1482644240 >> 172.21.15.63:0/1482644240 conn(0x7f3b9c05f510 msgr2=0x7f3b9c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:26.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba3c0b700 1 -- 172.21.15.63:0/1482644240 shutdown_connections 2020-05-18T21:37:26.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.441+0000 7f3ba3c0b700 1 -- 172.21.15.63:0/1482644240 wait complete. 2020-05-18T21:37:26.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba3c0b700 1 Processor -- start 2020-05-18T21:37:26.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba3c0b700 1 -- start start 2020-05-18T21:37:26.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba3c0b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b9c0b9150 0x7f3b9c0b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:26.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba3c0b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3b9c12e800 0x7f3b9c1569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:26.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba3c0b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9c0b2e10 con 0x7f3b9c142f30 2020-05-18T21:37:26.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba3c0b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9c0ba6e0 con 0x7f3b9c12e800 2020-05-18T21:37:26.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba3c0b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0ba980 con 0x7f3b9c0b9150 2020-05-18T21:37:26.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba19a7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b9c0b9150 0x7f3b9c0b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba19a7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b9c0b9150 0x7f3b9c0b27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:54674/0 (socket says 172.21.15.63:54674) 2020-05-18T21:37:26.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba19a7700 1 -- 172.21.15.63:0/856833531 learned_addr learned my addr 172.21.15.63:0/856833531 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:26.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba11a6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3b9c12e800 0x7f3b9c1569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba11a6700 1 -- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b9c0b9150 msgr2=0x7f3b9c0b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba11a6700 1 --2- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b9c0b9150 0x7f3b9c0b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:26.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba11a6700 1 -- 172.21.15.63:0/856833531 >> v1:172.21.15.155:6789/0 conn(0x7f3b9c142f30 legacy=0x7f3b9c12acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba11a6700 1 -- 172.21.15.63:0/856833531 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c0bbe30 con 0x7f3b9c12e800 2020-05-18T21:37:26.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba11a6700 1 --2- 172.21.15.63:0/856833531 >> v2:172.21.15.155:3300/0 conn(0x7f3b9c12e800 0x7f3b9c1569e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b8c002f70 tx=0x7f3b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba11a6700 1 --2- 172.21.15.63:0/856833531 >> v2:172.21.15.155:3300/0 conn(0x7f3b9c12e800 0x7f3b9c1569e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b8c002f70 tx=0x7f3b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba11a6700 1 --2- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b9c12e800 0x7f3b9c1569e0 secure :-1 s=READY pgs=1314 cs=0 l=1 rx=0x7f3b8c002f70 tx=0x7f3b8c007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:26.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba11a6700 1 --2- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b9c12e800 0x7f3b9c1569e0 secure :-1 s=THROTTLE_DONE pgs=1314 cs=0 l=1 rx=0x7f3b8c002f70 tx=0x7f3b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3b8affd700 1 -- 172.21.15.63:0/856833531 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b8c0101a0 con 0x7f3b9c12e800 2020-05-18T21:37:26.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba11a6700 1 --2- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b9c12e800 0x7f3b9c1569e0 secure :-1 s=THROTTLE_DONE pgs=1314 cs=0 l=1 rx=0x7f3b8c002f70 tx=0x7f3b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba3c0b700 1 -- 172.21.15.63:0/856833531 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9c0bc080 con 0x7f3b9c12e800 2020-05-18T21:37:26.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3b8affd700 1 -- 172.21.15.63:0/856833531 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c011df0 con 0x7f3b9c12e800 2020-05-18T21:37:26.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba11a6700 1 --2- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b9c12e800 0x7f3b9c1569e0 secure :-1 s=THROTTLE_DONE pgs=1314 cs=0 l=1 rx=0x7f3b8c002f70 tx=0x7f3b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3b8affd700 1 -- 172.21.15.63:0/856833531 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b8c007360 con 0x7f3b9c12e800 2020-05-18T21:37:26.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f3ba3c0b700 1 -- 172.21.15.63:0/856833531 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9c12b620 con 0x7f3b9c12e800 2020-05-18T21:37:26.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f3ba11a6700 1 --2- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b9c12e800 0x7f3b9c1569e0 secure :-1 s=THROTTLE_DONE pgs=1314 cs=0 l=1 rx=0x7f3b8c002f70 tx=0x7f3b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f3ba3c0b700 1 -- 172.21.15.63:0/856833531 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9c0569e0 con 0x7f3b9c12e800 2020-05-18T21:37:26.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f3b8affd700 1 -- 172.21.15.63:0/856833531 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3b8c005700 con 0x7f3b9c12e800 2020-05-18T21:37:26.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f3ba11a6700 1 --2- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b9c12e800 0x7f3b9c1569e0 secure :-1 s=THROTTLE_DONE pgs=1314 cs=0 l=1 rx=0x7f3b8c002f70 tx=0x7f3b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f3b8affd700 1 --2- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b7c04f980 0x7f3b7c051e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:26.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f3b8affd700 1 -- 172.21.15.63:0/856833531 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3b8c064160 con 0x7f3b9c12e800 2020-05-18T21:37:26.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f3ba19a7700 1 --2- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b7c04f980 0x7f3b7c051e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f3ba19a7700 1 --2- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b7c04f980 0x7f3b7c051e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b94003430 tx=0x7f3b9400ddf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f3ba19a7700 1 --2- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b7c04f980 0x7f3b7c051e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b94003430 tx=0x7f3b9400ddf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f3ba19a7700 1 --2- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b7c04f980 0x7f3b7c051e40 secure :-1 s=READY pgs=774 cs=0 l=1 rx=0x7f3b94003430 tx=0x7f3b9400ddf0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:26.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.457+0000 7f3ba11a6700 1 --2- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b9c12e800 0x7f3b9c1569e0 secure :-1 s=THROTTLE_DONE pgs=1314 cs=0 l=1 rx=0x7f3b8c002f70 tx=0x7f3b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.457+0000 7f3b8affd700 1 -- 172.21.15.63:0/856833531 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3b8c03e610 con 0x7f3b9c12e800 2020-05-18T21:37:26.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61b68700 1 Processor -- start 2020-05-18T21:37:26.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61b68700 1 -- start start 2020-05-18T21:37:26.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61b68700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2d5c146d60 0x7f2d5c09df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:26.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61b68700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d5c143d60 0x7f2d5c1441c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:26.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61b68700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2d5c147310 0x7f2d5c1477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:26.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61b68700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5c144f90 con 0x7f2d5c147310 2020-05-18T21:37:26.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61b68700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5c144c90 con 0x7f2d5c146d60 2020-05-18T21:37:26.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61b68700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c1449f0 con 0x7f2d5c143d60 2020-05-18T21:37:26.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d60b66700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2d5c146d60 0x7f2d5c09df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61367700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2d5c147310 0x7f2d5c1477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d5bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d5c143d60 0x7f2d5c1441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d60b66700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2d5c146d60 0x7f2d5c09df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:50594/0 (socket says 172.21.15.63:50594) 2020-05-18T21:37:26.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d60b66700 1 -- 172.21.15.63:0/2233240875 learned_addr learned my addr 172.21.15.63:0/2233240875 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:26.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61367700 1 -- 172.21.15.63:0/2233240875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d5c143d60 msgr2=0x7f2d5c1441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:26.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61367700 1 --2- 172.21.15.63:0/2233240875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d5c143d60 0x7f2d5c1441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:26.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61367700 1 -- 172.21.15.63:0/2233240875 >> v2:172.21.15.155:3300/0 conn(0x7f2d5c146d60 msgr2=0x7f2d5c09df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:26.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61367700 1 --2- 172.21.15.63:0/2233240875 >> v2:172.21.15.155:3300/0 conn(0x7f2d5c146d60 0x7f2d5c09df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:26.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61367700 1 -- 172.21.15.63:0/2233240875 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c05f6e0 con 0x7f2d5c147310 2020-05-18T21:37:26.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61367700 1 --2- 172.21.15.63:0/2233240875 >> v2:172.21.15.63:3300/0 conn(0x7f2d5c147310 0x7f2d5c1477c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2d5c09e4e0 tx=0x7f2d44008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61367700 1 --2- 172.21.15.63:0/2233240875 >> v2:172.21.15.63:3300/0 conn(0x7f2d5c147310 0x7f2d5c1477c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2d5c09e4e0 tx=0x7f2d44008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61367700 1 --2- 172.21.15.63:0/2233240875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c147310 0x7f2d5c1477c0 secure :-1 s=READY pgs=1987 cs=0 l=1 rx=0x7f2d5c09e4e0 tx=0x7f2d44008920).ready entity=mon.0 client_cookie=2e07f96be2f10fbc server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:26.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61367700 1 --2- 172.21.15.63:0/2233240875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c147310 0x7f2d5c1477c0 secure :-1 s=THROTTLE_DONE pgs=1987 cs=0 l=1 rx=0x7f2d5c09e4e0 tx=0x7f2d44008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61367700 1 --2- 172.21.15.63:0/2233240875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c147310 0x7f2d5c1477c0 secure :-1 s=THROTTLE_DONE pgs=1987 cs=0 l=1 rx=0x7f2d5c09e4e0 tx=0x7f2d44008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d5b7fe700 1 -- 172.21.15.63:0/2233240875 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d44008d70 con 0x7f2d5c147310 2020-05-18T21:37:26.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61367700 1 --2- 172.21.15.63:0/2233240875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c147310 0x7f2d5c1477c0 secure :-1 s=THROTTLE_DONE pgs=1987 cs=0 l=1 rx=0x7f2d5c09e4e0 tx=0x7f2d44008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d5b7fe700 1 -- 172.21.15.63:0/2233240875 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d440116e0 con 0x7f2d5c147310 2020-05-18T21:37:26.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d5b7fe700 1 -- 172.21.15.63:0/2233240875 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d44011b00 con 0x7f2d5c147310 2020-05-18T21:37:26.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61b68700 1 -- 172.21.15.63:0/2233240875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c147310 msgr2=0x7f2d5c1477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.445+0000 7f2d61b68700 1 --2- 172.21.15.63:0/2233240875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c147310 0x7f2d5c1477c0 secure :-1 s=READY pgs=1987 cs=0 l=1 rx=0x7f2d5c09e4e0 tx=0x7f2d44008920).stop 2020-05-18T21:37:26.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d61b68700 1 -- 172.21.15.63:0/2233240875 shutdown_connections 2020-05-18T21:37:26.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d61b68700 1 --2- 172.21.15.63:0/2233240875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c147310 0x7f2d5c1477c0 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:26.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d61b68700 1 --2- 172.21.15.63:0/2233240875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d5c143d60 0x7f2d5c1441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:26.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d61b68700 1 --2- 172.21.15.63:0/2233240875 >> v2:172.21.15.155:3300/0 conn(0x7f2d5c146d60 0x7f2d5c09df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:26.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d61b68700 1 -- 172.21.15.63:0/2233240875 >> 172.21.15.63:0/2233240875 conn(0x7f2d5c0b9630 msgr2=0x7f2d5c0b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:26.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d61b68700 1 -- 172.21.15.63:0/2233240875 shutdown_connections 2020-05-18T21:37:26.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d61b68700 1 -- 172.21.15.63:0/2233240875 wait complete. 2020-05-18T21:37:26.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d61b68700 1 Processor -- start 2020-05-18T21:37:26.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d61b68700 1 -- start start 2020-05-18T21:37:26.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d61b68700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2d5c143d60 0x7f2d5c1512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:26.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d61b68700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d5c147310 0x7f2d5c061930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:26.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d61b68700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5c061d90 con 0x7f2d5c146d60 2020-05-18T21:37:26.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d61b68700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5c0b1a30 con 0x7f2d5c143d60 2020-05-18T21:37:26.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d61b68700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c153480 con 0x7f2d5c147310 2020-05-18T21:37:26.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d60b66700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2d5c143d60 0x7f2d5c1512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d5bfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2d5c146d60 0x7f2d5c09cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37944/0 (socket says 172.21.15.63:37944) 2020-05-18T21:37:26.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d5bfff700 1 -- 172.21.15.63:0/1685321454 learned_addr learned my addr 172.21.15.63:0/1685321454 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:26.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d61367700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d5c147310 0x7f2d5c061930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d60b66700 1 -- 172.21.15.63:0/1685321454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d5c147310 msgr2=0x7f2d5c061930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d60b66700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d5c147310 0x7f2d5c061930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:26.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d60b66700 1 -- 172.21.15.63:0/1685321454 >> v1:172.21.15.63:6789/0 conn(0x7f2d5c146d60 legacy=0x7f2d5c09cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d60b66700 1 -- 172.21.15.63:0/1685321454 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c061fd0 con 0x7f2d5c143d60 2020-05-18T21:37:26.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d60b66700 1 --2- 172.21.15.63:0/1685321454 >> v2:172.21.15.63:3300/0 conn(0x7f2d5c143d60 0x7f2d5c1512a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2d4c002f70 tx=0x7f2d54010f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d60b66700 1 --2- 172.21.15.63:0/1685321454 >> v2:172.21.15.63:3300/0 conn(0x7f2d5c143d60 0x7f2d5c1512a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2d4c002f70 tx=0x7f2d54010f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d60b66700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c143d60 0x7f2d5c1512a0 secure :-1 s=READY pgs=1989 cs=0 l=1 rx=0x7f2d4c002f70 tx=0x7f2d54010f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:26.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d60b66700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c143d60 0x7f2d5c1512a0 secure :-1 s=THROTTLE_DONE pgs=1989 cs=0 l=1 rx=0x7f2d4c002f70 tx=0x7f2d54010f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d60b66700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c143d60 0x7f2d5c1512a0 secure :-1 s=THROTTLE_DONE pgs=1989 cs=0 l=1 rx=0x7f2d4c002f70 tx=0x7f2d54010f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d59ffb700 1 -- 172.21.15.63:0/1685321454 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d5400eb90 con 0x7f2d5c143d60 2020-05-18T21:37:26.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.449+0000 7f2d60b66700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c143d60 0x7f2d5c1512a0 secure :-1 s=THROTTLE_DONE pgs=1989 cs=0 l=1 rx=0x7f2d4c002f70 tx=0x7f2d54010f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.453+0000 7f2d59ffb700 1 -- 172.21.15.63:0/1685321454 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5400ecf0 con 0x7f2d5c143d60 2020-05-18T21:37:26.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.453+0000 7f2d59ffb700 1 -- 172.21.15.63:0/1685321454 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d5400ee60 con 0x7f2d5c143d60 2020-05-18T21:37:26.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.453+0000 7f2d61b68700 1 -- 172.21.15.63:0/1685321454 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5c062270 con 0x7f2d5c143d60 2020-05-18T21:37:26.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.453+0000 7f2d61b68700 1 -- 172.21.15.63:0/1685321454 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5c09d2f0 con 0x7f2d5c143d60 2020-05-18T21:37:26.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.453+0000 7f2d60b66700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c143d60 0x7f2d5c1512a0 secure :-1 s=THROTTLE_DONE pgs=1989 cs=0 l=1 rx=0x7f2d4c002f70 tx=0x7f2d54010f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.453+0000 7f2d61b68700 1 -- 172.21.15.63:0/1685321454 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5c0569e0 con 0x7f2d5c143d60 2020-05-18T21:37:26.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.453+0000 7f2d59ffb700 1 -- 172.21.15.63:0/1685321454 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2d54005a80 con 0x7f2d5c143d60 2020-05-18T21:37:26.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.453+0000 7f2d60b66700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c143d60 0x7f2d5c1512a0 secure :-1 s=THROTTLE_DONE pgs=1989 cs=0 l=1 rx=0x7f2d4c002f70 tx=0x7f2d54010f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.453+0000 7f2d59ffb700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2d4004f9e0 0x7f2d40051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:26.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.453+0000 7f2d59ffb700 1 -- 172.21.15.63:0/1685321454 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2d54063920 con 0x7f2d5c143d60 2020-05-18T21:37:26.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.453+0000 7f2d5bfff700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2d4004f9e0 0x7f2d40051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.453+0000 7f2d5bfff700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2d4004f9e0 0x7f2d40051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2d4c007fe0 tx=0x7f2d4c001190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.453+0000 7f2d5bfff700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2d4004f9e0 0x7f2d40051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2d4c007fe0 tx=0x7f2d4c001190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.453+0000 7f2d5bfff700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2d4004f9e0 0x7f2d40051ea0 secure :-1 s=READY pgs=775 cs=0 l=1 rx=0x7f2d4c007fe0 tx=0x7f2d4c001190).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:26.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.457+0000 7f2d60b66700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c143d60 0x7f2d5c1512a0 secure :-1 s=THROTTLE_DONE pgs=1989 cs=0 l=1 rx=0x7f2d4c002f70 tx=0x7f2d54010f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.457+0000 7f2d59ffb700 1 -- 172.21.15.63:0/1685321454 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2d5403dc50 con 0x7f2d5c143d60 2020-05-18T21:37:26.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.613+0000 7f2d61b68700 1 -- 172.21.15.63:0/1685321454 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f2d5c066b50 con 0x7f2d5c143d60 2020-05-18T21:37:26.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.617+0000 7f3ba3c0b700 1 -- 172.21.15.63:0/856833531 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f3b9c0008d0 con 0x7f3b9c12e800 2020-05-18T21:37:26.669 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:37:26.661+0000 7fdb4592c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:37:26.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.669+0000 7f2d60b66700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c143d60 0x7f2d5c1512a0 secure :-1 s=THROTTLE_DONE pgs=1989 cs=0 l=1 rx=0x7f2d4c002f70 tx=0x7f2d54010f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.669+0000 7f2d59ffb700 1 -- 172.21.15.63:0/1685321454 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 9628 v123) v1 ==== 95+0+0 (secure 0 0 0) 0x7f2d54041270 con 0x7f2d5c143d60 2020-05-18T21:37:26.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.673+0000 7f3ba11a6700 1 --2- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b9c12e800 0x7f3b9c1569e0 secure :-1 s=THROTTLE_DONE pgs=1314 cs=0 l=1 rx=0x7f3b8c002f70 tx=0x7f3b8c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.673+0000 7f3b8affd700 1 -- 172.21.15.63:0/856833531 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6953 v123) v1 ==== 95+0+0 (secure 0 0 0) 0x7f3b8c041c30 con 0x7f3b9c12e800 2020-05-18T21:37:26.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.673+0000 7f2d61b68700 1 -- 172.21.15.63:0/1685321454 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2d4004f9e0 msgr2=0x7f2d40051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.673+0000 7f2d61b68700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2d4004f9e0 0x7f2d40051ea0 secure :-1 s=READY pgs=775 cs=0 l=1 rx=0x7f2d4c007fe0 tx=0x7f2d4c001190).stop 2020-05-18T21:37:26.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.673+0000 7f2d61b68700 1 -- 172.21.15.63:0/1685321454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c143d60 msgr2=0x7f2d5c1512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.673+0000 7f2d61b68700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c143d60 0x7f2d5c1512a0 secure :-1 s=READY pgs=1989 cs=0 l=1 rx=0x7f2d4c002f70 tx=0x7f2d54010f50).stop 2020-05-18T21:37:26.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.673+0000 7f2d61b68700 1 -- 172.21.15.63:0/1685321454 shutdown_connections 2020-05-18T21:37:26.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.673+0000 7f2d61b68700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2d4004f9e0 0x7f2d40051ea0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:26.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.673+0000 7f2d61b68700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d5c147310 0x7f2d5c061930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:26.682 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.673+0000 7f2d61b68700 1 --2- 172.21.15.63:0/1685321454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c143d60 0x7f2d5c1512a0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:26.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.673+0000 7f2d61b68700 1 -- 172.21.15.63:0/1685321454 >> 172.21.15.63:0/1685321454 conn(0x7f2d5c0b9630 msgr2=0x7f2d5c05c230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:26.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.677+0000 7f2d61b68700 1 -- 172.21.15.63:0/1685321454 shutdown_connections 2020-05-18T21:37:26.683 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.677+0000 7f2d61b68700 1 -- 172.21.15.63:0/1685321454 wait complete. 2020-05-18T21:37:26.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.677+0000 7f3ba3c0b700 1 -- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b7c04f980 msgr2=0x7f3b7c051e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.684 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.677+0000 7f3ba3c0b700 1 --2- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b7c04f980 0x7f3b7c051e40 secure :-1 s=READY pgs=774 cs=0 l=1 rx=0x7f3b94003430 tx=0x7f3b9400ddf0).stop 2020-05-18T21:37:26.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.677+0000 7f3ba3c0b700 1 -- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b9c12e800 msgr2=0x7f3b9c1569e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.677+0000 7f3ba3c0b700 1 --2- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b9c12e800 0x7f3b9c1569e0 secure :-1 s=READY pgs=1314 cs=0 l=1 rx=0x7f3b8c002f70 tx=0x7f3b8c007a80).stop 2020-05-18T21:37:26.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.677+0000 7f3ba3c0b700 1 -- 172.21.15.63:0/856833531 shutdown_connections 2020-05-18T21:37:26.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.677+0000 7f3ba3c0b700 1 --2- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b7c04f980 0x7f3b7c051e40 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:26.685 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.677+0000 7f3ba3c0b700 1 --2- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b9c12e800 0x7f3b9c1569e0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:26.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.677+0000 7f3ba3c0b700 1 --2- 172.21.15.63:0/856833531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b9c0b9150 0x7f3b9c0b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:26.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.677+0000 7f3ba3c0b700 1 -- 172.21.15.63:0/856833531 >> 172.21.15.63:0/856833531 conn(0x7f3b9c05f510 msgr2=0x7f3b9c12dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:26.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.677+0000 7f3ba3c0b700 1 -- 172.21.15.63:0/856833531 shutdown_connections 2020-05-18T21:37:26.686 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.677+0000 7f3ba3c0b700 1 -- 172.21.15.63:0/856833531 wait complete. 2020-05-18T21:37:26.686 INFO:teuthology.orchestra.run.smithi063.stderr:failed mds gid 6953 2020-05-18T21:37:26.687 INFO:teuthology.orchestra.run.smithi063.stderr:failed mds gid 9628 2020-05-18T21:37:26.700 DEBUG:teuthology.parallel:result is '' 2020-05-18T21:37:26.701 DEBUG:teuthology.parallel:result is '' 2020-05-18T21:37:26.701 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_metadata rm 500.00000000 2020-05-18T21:37:26.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.721+0000 7fe488ac3b80 1 Processor -- start 2020-05-18T21:37:26.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.721+0000 7fe488ac3b80 1 -- start start 2020-05-18T21:37:26.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.721+0000 7fe488ac3b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55fbca783c40 0x55fbca80f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:26.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.721+0000 7fe488ac3b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x55fbca810700 0x55fbca785e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:26.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.721+0000 7fe488ac3b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fbca814680 0x55fbca785630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:26.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.721+0000 7fe488ac3b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fbca6d0110 con 0x55fbca783c40 2020-05-18T21:37:26.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.721+0000 7fe488ac3b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fbca6c0a40 con 0x55fbca810700 2020-05-18T21:37:26.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.721+0000 7fe488ac3b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fbca813990 con 0x55fbca814680 2020-05-18T21:37:26.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.721+0000 7fe486f06700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55fbca783c40 0x55fbca80f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.721+0000 7fe486f06700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55fbca783c40 0x55fbca80f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35768/0 (socket says 172.21.15.63:35768) 2020-05-18T21:37:26.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe486f06700 1 -- 172.21.15.63:0/1704942406 learned_addr learned my addr 172.21.15.63:0/1704942406 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:26.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe486705700 1 --2- 172.21.15.63:0/1704942406 >> v2:172.21.15.155:3300/0 conn(0x55fbca810700 0x55fbca785e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe487707700 1 --2- 172.21.15.63:0/1704942406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fbca814680 0x55fbca785630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe486705700 1 -- 172.21.15.63:0/1704942406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fbca814680 msgr2=0x55fbca785630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:26.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe486705700 1 --2- 172.21.15.63:0/1704942406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fbca814680 0x55fbca785630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:26.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe486705700 1 -- 172.21.15.63:0/1704942406 >> v2:172.21.15.63:3300/0 conn(0x55fbca783c40 msgr2=0x55fbca80f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:26.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe486705700 1 --2- 172.21.15.63:0/1704942406 >> v2:172.21.15.63:3300/0 conn(0x55fbca783c40 0x55fbca80f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:26.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe486705700 1 -- 172.21.15.63:0/1704942406 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbca6e44b0 con 0x55fbca810700 2020-05-18T21:37:26.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe486f06700 1 --2- 172.21.15.63:0/1704942406 >> v2:172.21.15.63:3300/0 conn(0x55fbca783c40 0x55fbca80f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:26.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe486705700 1 --2- 172.21.15.63:0/1704942406 >> v2:172.21.15.155:3300/0 conn(0x55fbca810700 0x55fbca785e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe4780018b0 tx=0x7fe470002f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe486705700 1 --2- 172.21.15.63:0/1704942406 >> v2:172.21.15.155:3300/0 conn(0x55fbca810700 0x55fbca785e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe4780018b0 tx=0x7fe470002f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe486705700 1 --2- 172.21.15.63:0/1704942406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fbca810700 0x55fbca785e10 secure :-1 s=READY pgs=1315 cs=0 l=1 rx=0x7fe4780018b0 tx=0x7fe470002f50).ready entity=mon.1 client_cookie=3e9610fe6213e890 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:26.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe486705700 1 --2- 172.21.15.63:0/1704942406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fbca810700 0x55fbca785e10 secure :-1 s=THROTTLE_DONE pgs=1315 cs=0 l=1 rx=0x7fe4780018b0 tx=0x7fe470002f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe484f02700 1 -- 172.21.15.63:0/1704942406 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe470007e30 con 0x55fbca810700 2020-05-18T21:37:26.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe486705700 1 --2- 172.21.15.63:0/1704942406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fbca810700 0x55fbca785e10 secure :-1 s=THROTTLE_DONE pgs=1315 cs=0 l=1 rx=0x7fe4780018b0 tx=0x7fe470002f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe486705700 1 --2- 172.21.15.63:0/1704942406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fbca810700 0x55fbca785e10 secure :-1 s=THROTTLE_DONE pgs=1315 cs=0 l=1 rx=0x7fe4780018b0 tx=0x7fe470002f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe484f02700 1 -- 172.21.15.63:0/1704942406 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47000b370 con 0x55fbca810700 2020-05-18T21:37:26.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe488ac3b80 1 -- 172.21.15.63:0/1704942406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fbca810700 msgr2=0x55fbca785e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe484f02700 1 -- 172.21.15.63:0/1704942406 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe47000b710 con 0x55fbca810700 2020-05-18T21:37:26.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe488ac3b80 1 --2- 172.21.15.63:0/1704942406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fbca810700 0x55fbca785e10 secure :-1 s=READY pgs=1315 cs=0 l=1 rx=0x7fe4780018b0 tx=0x7fe470002f50).stop 2020-05-18T21:37:26.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe488ac3b80 1 -- 172.21.15.63:0/1704942406 shutdown_connections 2020-05-18T21:37:26.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe488ac3b80 1 --2- 172.21.15.63:0/1704942406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fbca814680 0x55fbca785630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:26.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe488ac3b80 1 --2- 172.21.15.63:0/1704942406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fbca810700 0x55fbca785e10 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:26.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe488ac3b80 1 --2- 172.21.15.63:0/1704942406 >> v2:172.21.15.63:3300/0 conn(0x55fbca783c40 0x55fbca80f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:26.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe488ac3b80 1 -- 172.21.15.63:0/1704942406 >> 172.21.15.63:0/1704942406 conn(0x55fbca787850 msgr2=0x55fbca7439e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:26.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe488ac3b80 1 -- 172.21.15.63:0/1704942406 shutdown_connections 2020-05-18T21:37:26.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe488ac3b80 1 -- 172.21.15.63:0/1704942406 wait complete. 2020-05-18T21:37:26.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe488ac3b80 1 Processor -- start 2020-05-18T21:37:26.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe488ac3b80 1 -- start start 2020-05-18T21:37:26.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe488ac3b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55fbca783c40 0x55fbca81f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:26.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe488ac3b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fbca6c4460 con 0x55fbca814680 2020-05-18T21:37:26.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe488ac3b80 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fbca786590 con 0x55fbca810700 2020-05-18T21:37:26.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.725+0000 7fe488ac3b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fbca7867f0 con 0x55fbca783c40 2020-05-18T21:37:26.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe486705700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x55fbca810700 0x55fbca742340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:36278/0 (socket says 172.21.15.63:36278) 2020-05-18T21:37:26.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe486705700 1 -- 172.21.15.63:0/1546978291 learned_addr learned my addr 172.21.15.63:0/1546978291 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:26.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe486f06700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55fbca783c40 0x55fbca81f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe487707700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x55fbca814680 0x55fbca743530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37966/0 (socket says 172.21.15.63:37966) 2020-05-18T21:37:26.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe47ffff700 1 -- 172.21.15.63:0/1546978291 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501679102 0 0) 0x55fbca6c4460 con 0x55fbca814680 2020-05-18T21:37:26.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe47ffff700 1 -- 172.21.15.63:0/1546978291 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe468002020 con 0x55fbca814680 2020-05-18T21:37:26.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe47ffff700 1 -- 172.21.15.63:0/1546978291 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001328741 0 0) 0x55fbca786590 con 0x55fbca810700 2020-05-18T21:37:26.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe486f06700 1 -- 172.21.15.63:0/1546978291 >> v1:172.21.15.155:6789/0 conn(0x55fbca810700 legacy=0x55fbca742340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe486f06700 1 -- 172.21.15.63:0/1546978291 >> v1:172.21.15.63:6789/0 conn(0x55fbca814680 legacy=0x55fbca743530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe486f06700 1 -- 172.21.15.63:0/1546978291 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbca786a90 con 0x55fbca783c40 2020-05-18T21:37:26.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe486f06700 1 --2- 172.21.15.63:0/1546978291 >> v2:172.21.15.63:3300/0 conn(0x55fbca783c40 0x55fbca81f300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe4780014e0 tx=0x7fe47800b3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe486f06700 1 --2- 172.21.15.63:0/1546978291 >> v2:172.21.15.63:3300/0 conn(0x55fbca783c40 0x55fbca81f300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe4780014e0 tx=0x7fe47800b3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe486f06700 1 --2- 172.21.15.63:0/1546978291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fbca783c40 0x55fbca81f300 secure :-1 s=READY pgs=1993 cs=0 l=1 rx=0x7fe4780014e0 tx=0x7fe47800b3a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:26.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe486f06700 1 --2- 172.21.15.63:0/1546978291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fbca783c40 0x55fbca81f300 secure :-1 s=THROTTLE_DONE pgs=1993 cs=0 l=1 rx=0x7fe4780014e0 tx=0x7fe47800b3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe47ffff700 1 -- 172.21.15.63:0/1546978291 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4780118b0 con 0x55fbca783c40 2020-05-18T21:37:26.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe486f06700 1 --2- 172.21.15.63:0/1546978291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fbca783c40 0x55fbca81f300 secure :-1 s=THROTTLE_DONE pgs=1993 cs=0 l=1 rx=0x7fe4780014e0 tx=0x7fe47800b3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe47ffff700 1 -- 172.21.15.63:0/1546978291 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe478011a10 con 0x55fbca783c40 2020-05-18T21:37:26.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe486f06700 1 --2- 172.21.15.63:0/1546978291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fbca783c40 0x55fbca81f300 secure :-1 s=THROTTLE_DONE pgs=1993 cs=0 l=1 rx=0x7fe4780014e0 tx=0x7fe47800b3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe488ac3b80 1 -- 172.21.15.63:0/1546978291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fbca81f760 con 0x55fbca783c40 2020-05-18T21:37:26.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe47ffff700 1 -- 172.21.15.63:0/1546978291 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe478011d70 con 0x55fbca783c40 2020-05-18T21:37:26.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe488ac3b80 1 -- 172.21.15.63:0/1546978291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbca81fcf0 con 0x55fbca783c40 2020-05-18T21:37:26.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe486f06700 1 --2- 172.21.15.63:0/1546978291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fbca783c40 0x55fbca81f300 secure :-1 s=THROTTLE_DONE pgs=1993 cs=0 l=1 rx=0x7fe4780014e0 tx=0x7fe47800b3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.729+0000 7fe47ffff700 1 -- 172.21.15.63:0/1546978291 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe47800b410 con 0x55fbca783c40 2020-05-18T21:37:26.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.733+0000 7fe486f06700 1 --2- 172.21.15.63:0/1546978291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fbca783c40 0x55fbca81f300 secure :-1 s=THROTTLE_DONE pgs=1993 cs=0 l=1 rx=0x7fe4780014e0 tx=0x7fe47800b3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.733+0000 7fe47ffff700 1 --2- 172.21.15.63:0/1546978291 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe46804e8f0 0x7fe468050db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:26.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.733+0000 7fe47ffff700 1 -- 172.21.15.63:0/1546978291 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe478062da0 con 0x55fbca783c40 2020-05-18T21:37:26.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.733+0000 7fe488ac3b80 1 --2- 172.21.15.63:0/1546978291 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x55fbca822f30 0x55fbca823370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:26.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.733+0000 7fe486705700 1 --2- 172.21.15.63:0/1546978291 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe46804e8f0 0x7fe468050db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.733+0000 7fe488ac3b80 1 -- 172.21.15.63:0/1546978291 --> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] -- osd_op(unknown.0.0:1 27.5 27:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected e147) v8 -- 0x55fbca82ca20 con 0x55fbca822f30 2020-05-18T21:37:26.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.733+0000 7fe487707700 1 --2- 172.21.15.63:0/1546978291 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x55fbca822f30 0x55fbca823370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.733+0000 7fe486705700 1 --2- 172.21.15.63:0/1546978291 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe46804e8f0 0x7fe468050db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe470006f00 tx=0x7fe470002f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.733+0000 7fe486705700 1 --2- 172.21.15.63:0/1546978291 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe46804e8f0 0x7fe468050db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe470006f00 tx=0x7fe470002f50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.733+0000 7fe486705700 1 --2- 172.21.15.63:0/1546978291 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe46804e8f0 0x7fe468050db0 secure :-1 s=READY pgs=776 cs=0 l=1 rx=0x7fe470006f00 tx=0x7fe470002f50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:26.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.733+0000 7fe487707700 1 --2- 172.21.15.63:0/1546978291 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x55fbca822f30 0x55fbca823370 crc :-1 s=READY pgs=32 cs=0 l=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:26.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.745+0000 7fe487707700 1 -- 172.21.15.63:0/1546978291 <== osd.4 v2:172.21.15.155:6800/13023 1 ==== osd_op_reply(1 500.00000000 [delete] v147'7 uv7 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe48000a960 con 0x55fbca822f30 2020-05-18T21:37:26.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.745+0000 7fe488ac3b80 1 -- 172.21.15.63:0/1546978291 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x55fbca822f30 msgr2=0x55fbca823370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.745+0000 7fe488ac3b80 1 --2- 172.21.15.63:0/1546978291 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x55fbca822f30 0x55fbca823370 crc :-1 s=READY pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:26.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.745+0000 7fe488ac3b80 1 -- 172.21.15.63:0/1546978291 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe46804e8f0 msgr2=0x7fe468050db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.745+0000 7fe488ac3b80 1 --2- 172.21.15.63:0/1546978291 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe46804e8f0 0x7fe468050db0 secure :-1 s=READY pgs=776 cs=0 l=1 rx=0x7fe470006f00 tx=0x7fe470002f50).stop 2020-05-18T21:37:26.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.745+0000 7fe488ac3b80 1 -- 172.21.15.63:0/1546978291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fbca783c40 msgr2=0x55fbca81f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.745+0000 7fe488ac3b80 1 --2- 172.21.15.63:0/1546978291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fbca783c40 0x55fbca81f300 secure :-1 s=READY pgs=1993 cs=0 l=1 rx=0x7fe4780014e0 tx=0x7fe47800b3a0).stop 2020-05-18T21:37:26.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.745+0000 7fe487707700 1 -- 172.21.15.63:0/1546978291 reap_dead start 2020-05-18T21:37:26.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.745+0000 7fe488ac3b80 1 -- 172.21.15.63:0/1546978291 shutdown_connections 2020-05-18T21:37:26.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.745+0000 7fe488ac3b80 1 --2- 172.21.15.63:0/1546978291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fbca783c40 0x55fbca81f300 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:26.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.745+0000 7fe488ac3b80 1 -- 172.21.15.63:0/1546978291 >> 172.21.15.63:0/1546978291 conn(0x55fbca787850 msgr2=0x55fbca80d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:26.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.745+0000 7fe488ac3b80 1 -- 172.21.15.63:0/1546978291 shutdown_connections 2020-05-18T21:37:26.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.745+0000 7fe488ac3b80 1 -- 172.21.15.63:0/1546978291 wait complete. 2020-05-18T21:37:26.754 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:37:26.754 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:37:26.755 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:37:26.755 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:37:26.757 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:37:26.757 DEBUG:teuthology.parallel:result is None 2020-05-18T21:37:26.758 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:37:26.758 DEBUG:teuthology.parallel:result is None 2020-05-18T21:37:26.759 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:26.825 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:37:26.833 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:37:26.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.853+0000 7f7228d83700 1 Processor -- start 2020-05-18T21:37:26.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.853+0000 7f7228d83700 1 -- start start 2020-05-18T21:37:26.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f7228d83700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72240b95b0 0x7f72240b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:26.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f7228d83700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f72240ae5b0 0x7f72241421a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:26.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f7228d83700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72240aea50 con 0x7f7224142600 2020-05-18T21:37:26.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f7228d83700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72240aecf0 con 0x7f72240ae5b0 2020-05-18T21:37:26.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f7228d83700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72240aef90 con 0x7f72240b95b0 2020-05-18T21:37:26.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f7223fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7224142600 0x7f7224146300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37988/0 (socket says 172.21.15.63:37988) 2020-05-18T21:37:26.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f7223fff700 1 -- 172.21.15.63:0/2010698716 learned_addr learned my addr 172.21.15.63:0/2010698716 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:26.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f7222ffd700 1 --2- 172.21.15.63:0/2010698716 >> v2:172.21.15.155:3300/0 conn(0x7f72240ae5b0 0x7f72241421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f72237fe700 1 --2- 172.21.15.63:0/2010698716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72240b95b0 0x7f72240b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f72227fc700 1 -- 172.21.15.63:0/2010698716 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436208297 0 0) 0x7f72240aea50 con 0x7f7224142600 2020-05-18T21:37:26.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f72227fc700 1 -- 172.21.15.63:0/2010698716 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7208003270 con 0x7f7224142600 2020-05-18T21:37:26.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f72237fe700 1 -- 172.21.15.63:0/2010698716 >> v2:172.21.15.155:3300/0 conn(0x7f72240ae5b0 msgr2=0x7f72241421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:26.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f72237fe700 1 --2- 172.21.15.63:0/2010698716 >> v2:172.21.15.155:3300/0 conn(0x7f72240ae5b0 0x7f72241421a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:26.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f72237fe700 1 -- 172.21.15.63:0/2010698716 >> v1:172.21.15.63:6789/0 conn(0x7f7224142600 legacy=0x7f7224146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f72237fe700 1 -- 172.21.15.63:0/2010698716 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72240b9990 con 0x7f72240b95b0 2020-05-18T21:37:26.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f72237fe700 1 --2- 172.21.15.63:0/2010698716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72240b95b0 0x7f72240b4ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7214002f70 tx=0x7f7214007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f72237fe700 1 --2- 172.21.15.63:0/2010698716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72240b95b0 0x7f72240b4ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7214002f70 tx=0x7f7214007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f72237fe700 1 --2- 172.21.15.63:0/2010698716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72240b95b0 0x7f72240b4ef0 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7f7214002f70 tx=0x7f7214007a80).ready entity=mon.2 client_cookie=601152b82257bbf9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:26.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f72237fe700 1 --2- 172.21.15.63:0/2010698716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72240b95b0 0x7f72240b4ef0 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7f7214002f70 tx=0x7f7214007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f72227fc700 1 -- 172.21.15.63:0/2010698716 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7214008e80 con 0x7f72240b95b0 2020-05-18T21:37:26.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f72237fe700 1 --2- 172.21.15.63:0/2010698716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72240b95b0 0x7f72240b4ef0 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7f7214002f70 tx=0x7f7214007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f72227fc700 1 -- 172.21.15.63:0/2010698716 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7214011540 con 0x7f72240b95b0 2020-05-18T21:37:26.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f72237fe700 1 --2- 172.21.15.63:0/2010698716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72240b95b0 0x7f72240b4ef0 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7f7214002f70 tx=0x7f7214007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f72227fc700 1 -- 172.21.15.63:0/2010698716 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7214011920 con 0x7f72240b95b0 2020-05-18T21:37:26.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f7228d83700 1 -- 172.21.15.63:0/2010698716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72240b95b0 msgr2=0x7f72240b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f7228d83700 1 --2- 172.21.15.63:0/2010698716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72240b95b0 0x7f72240b4ef0 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7f7214002f70 tx=0x7f7214007a80).stop 2020-05-18T21:37:26.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f7228d83700 1 -- 172.21.15.63:0/2010698716 shutdown_connections 2020-05-18T21:37:26.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f7228d83700 1 --2- 172.21.15.63:0/2010698716 >> v2:172.21.15.155:3300/0 conn(0x7f72240ae5b0 0x7f72241421a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:26.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f7228d83700 1 --2- 172.21.15.63:0/2010698716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72240b95b0 0x7f72240b4ef0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:26.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f7228d83700 1 -- 172.21.15.63:0/2010698716 >> 172.21.15.63:0/2010698716 conn(0x7f722406a640 msgr2=0x7f72240b8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:26.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f7228d83700 1 -- 172.21.15.63:0/2010698716 shutdown_connections 2020-05-18T21:37:26.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.857+0000 7f7228d83700 1 -- 172.21.15.63:0/2010698716 wait complete. 2020-05-18T21:37:26.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7228d83700 1 Processor -- start 2020-05-18T21:37:26.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7228d83700 1 -- start start 2020-05-18T21:37:26.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7228d83700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f72240ae5b0 0x7f7224140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:26.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7228d83700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72240b95b0 0x7f7224140520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:26.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7228d83700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7224142600 0x7f7224155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:26.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7228d83700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7224140980 con 0x7f7224142600 2020-05-18T21:37:26.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7228d83700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7224155470 con 0x7f72240ae5b0 2020-05-18T21:37:26.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7228d83700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7224151140 con 0x7f72240b95b0 2020-05-18T21:37:26.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7223fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7224142600 0x7f7224155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7223fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7224142600 0x7f7224155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35806/0 (socket says 172.21.15.63:35806) 2020-05-18T21:37:26.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7223fff700 1 -- 172.21.15.63:0/3402186175 learned_addr learned my addr 172.21.15.63:0/3402186175 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:26.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f72237fe700 1 --2- 172.21.15.63:0/3402186175 >> v2:172.21.15.155:3300/0 conn(0x7f72240ae5b0 0x7f7224140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7222ffd700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72240b95b0 0x7f7224140520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7223fff700 1 -- 172.21.15.63:0/3402186175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72240b95b0 msgr2=0x7f7224140520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7223fff700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72240b95b0 0x7f7224140520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:26.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7223fff700 1 -- 172.21.15.63:0/3402186175 >> v2:172.21.15.155:3300/0 conn(0x7f72240ae5b0 msgr2=0x7f7224140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:26.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7223fff700 1 --2- 172.21.15.63:0/3402186175 >> v2:172.21.15.155:3300/0 conn(0x7f72240ae5b0 0x7f7224140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:26.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7223fff700 1 -- 172.21.15.63:0/3402186175 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72241513e0 con 0x7f7224142600 2020-05-18T21:37:26.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7223fff700 1 --2- 172.21.15.63:0/3402186175 >> v2:172.21.15.63:3300/0 conn(0x7f7224142600 0x7f7224155010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f720c001110 tx=0x7f720c0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7223fff700 1 --2- 172.21.15.63:0/3402186175 >> v2:172.21.15.63:3300/0 conn(0x7f7224142600 0x7f7224155010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f720c001110 tx=0x7f720c0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7223fff700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7224142600 0x7f7224155010 secure :-1 s=READY pgs=1997 cs=0 l=1 rx=0x7f720c001110 tx=0x7f720c0108f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:26.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7223fff700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7224142600 0x7f7224155010 secure :-1 s=THROTTLE_DONE pgs=1997 cs=0 l=1 rx=0x7f720c001110 tx=0x7f720c0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7220ff9700 1 -- 172.21.15.63:0/3402186175 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f720c005d00 con 0x7f7224142600 2020-05-18T21:37:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7223fff700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7224142600 0x7f7224155010 secure :-1 s=THROTTLE_DONE pgs=1997 cs=0 l=1 rx=0x7f720c001110 tx=0x7f720c0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7223fff700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7224142600 0x7f7224155010 secure :-1 s=THROTTLE_DONE pgs=1997 cs=0 l=1 rx=0x7f720c001110 tx=0x7f720c0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7220ff9700 1 -- 172.21.15.63:0/3402186175 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c005e60 con 0x7f7224142600 2020-05-18T21:37:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7220ff9700 1 -- 172.21.15.63:0/3402186175 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f720c0062c0 con 0x7f7224142600 2020-05-18T21:37:26.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.861+0000 7f7228d83700 1 -- 172.21.15.63:0/3402186175 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7224151680 con 0x7f7224142600 2020-05-18T21:37:26.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.865+0000 7f7228d83700 1 -- 172.21.15.63:0/3402186175 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7224151d40 con 0x7f7224142600 2020-05-18T21:37:26.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.865+0000 7f7223fff700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7224142600 0x7f7224155010 secure :-1 s=THROTTLE_DONE pgs=1997 cs=0 l=1 rx=0x7f720c001110 tx=0x7f720c0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.865+0000 7f7228d83700 1 -- 172.21.15.63:0/3402186175 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7224151810 con 0x7f7224142600 2020-05-18T21:37:26.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.865+0000 7f7220ff9700 1 -- 172.21.15.63:0/3402186175 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f720c0064f0 con 0x7f7224142600 2020-05-18T21:37:26.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.865+0000 7f7223fff700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7224142600 0x7f7224155010 secure :-1 s=THROTTLE_DONE pgs=1997 cs=0 l=1 rx=0x7f720c001110 tx=0x7f720c0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.865+0000 7f7220ff9700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71fc04fa50 0x7f71fc051f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:26.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.865+0000 7f7220ff9700 1 -- 172.21.15.63:0/3402186175 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f720c0090c0 con 0x7f7224142600 2020-05-18T21:37:26.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.865+0000 7f72237fe700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71fc04fa50 0x7f71fc051f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:26.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.865+0000 7f72237fe700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71fc04fa50 0x7f71fc051f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7214002f70 tx=0x7f7214007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.865+0000 7f72237fe700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71fc04fa50 0x7f71fc051f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7214002f70 tx=0x7f7214007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.865+0000 7f72237fe700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71fc04fa50 0x7f71fc051f10 secure :-1 s=READY pgs=777 cs=0 l=1 rx=0x7f7214002f70 tx=0x7f7214007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:26.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.873+0000 7f7223fff700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7224142600 0x7f7224155010 secure :-1 s=THROTTLE_DONE pgs=1997 cs=0 l=1 rx=0x7f720c001110 tx=0x7f720c0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:26.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:26.873+0000 7f7220ff9700 1 -- 172.21.15.63:0/3402186175 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f720c03e0a0 con 0x7f7224142600 2020-05-18T21:37:27.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:27.029+0000 7f7228d83700 1 -- 172.21.15.63:0/3402186175 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72240569e0 con 0x7f7224142600 2020-05-18T21:37:27.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:27.029+0000 7f7223fff700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7224142600 0x7f7224155010 secure :-1 s=THROTTLE_DONE pgs=1997 cs=0 l=1 rx=0x7f720c001110 tx=0x7f720c0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:27.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:27.029+0000 7f7220ff9700 1 -- 172.21.15.63:0/3402186175 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f720c0416c0 con 0x7f7224142600 2020-05-18T21:37:27.036 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:27.037 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":123,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:18.846766+0000","modified":"2020-05-18T21:37:26.667608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":146,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-05-18T21:37:27.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:27.033+0000 7f7228d83700 1 -- 172.21.15.63:0/3402186175 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71fc04fa50 msgr2=0x7f71fc051f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:27.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:27.033+0000 7f7228d83700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71fc04fa50 0x7f71fc051f10 secure :-1 s=READY pgs=777 cs=0 l=1 rx=0x7f7214002f70 tx=0x7f7214007a80).stop 2020-05-18T21:37:27.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:27.033+0000 7f7228d83700 1 -- 172.21.15.63:0/3402186175 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7224142600 msgr2=0x7f7224155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:27.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:27.033+0000 7f7228d83700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7224142600 0x7f7224155010 secure :-1 s=READY pgs=1997 cs=0 l=1 rx=0x7f720c001110 tx=0x7f720c0108f0).stop 2020-05-18T21:37:27.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:27.033+0000 7f7228d83700 1 -- 172.21.15.63:0/3402186175 shutdown_connections 2020-05-18T21:37:27.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:27.033+0000 7f7228d83700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f71fc04fa50 0x7f71fc051f10 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:27.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:27.033+0000 7f7228d83700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7224142600 0x7f7224155010 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:27.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:27.033+0000 7f7228d83700 1 --2- 172.21.15.63:0/3402186175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72240b95b0 0x7f7224140520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:27.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:27.033+0000 7f7228d83700 1 --2- 172.21.15.63:0/3402186175 >> v2:172.21.15.155:3300/0 conn(0x7f72240ae5b0 0x7f7224140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:27.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:27.033+0000 7f7228d83700 1 -- 172.21.15.63:0/3402186175 >> 172.21.15.63:0/3402186175 conn(0x7f722406a640 msgr2=0x7f722413ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:27.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:27.033+0000 7f7228d83700 1 -- 172.21.15.63:0/3402186175 shutdown_connections 2020-05-18T21:37:27.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:27.033+0000 7f7228d83700 1 -- 172.21.15.63:0/3402186175 wait complete. 2020-05-18T21:37:27.041 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 123 2020-05-18T21:37:27.251 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 123, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:37:18.846766+0000', 'modified': '2020-05-18T21:37:26.667608+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 146, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:37:27.251 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2020-05-18T21:37:28.253 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:28.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.357+0000 7f0f9a8ca700 1 Processor -- start 2020-05-18T21:37:28.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.357+0000 7f0f9a8ca700 1 -- start start 2020-05-18T21:37:28.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.357+0000 7f0f9a8ca700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0f94069eb0 0x7f0f940b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:28.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.357+0000 7f0f9a8ca700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 0x7f0f941444a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:28.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.357+0000 7f0f9a8ca700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0f94147c30 0x7f0f94148090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:28.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f9a8ca700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f940b9250 con 0x7f0f94147c30 2020-05-18T21:37:28.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f9a8ca700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f94144900 con 0x7f0f94069eb0 2020-05-18T21:37:28.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f9a8ca700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f941484f0 con 0x7f0f94144040 2020-05-18T21:37:28.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f98e67700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0f94147c30 0x7f0f94148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:28.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f98e67700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0f94147c30 0x7f0f94148090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35814/0 (socket says 172.21.15.63:35814) 2020-05-18T21:37:28.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f98e67700 1 -- 172.21.15.63:0/3945851014 learned_addr learned my addr 172.21.15.63:0/3945851014 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:28.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f93fff700 1 --2- 172.21.15.63:0/3945851014 >> v2:172.21.15.155:3300/0 conn(0x7f0f94069eb0 0x7f0f940b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:28.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f937fe700 1 --2- 172.21.15.63:0/3945851014 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 0x7f0f941444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:28.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f98e67700 1 -- 172.21.15.63:0/3945851014 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 msgr2=0x7f0f941444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:28.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f98e67700 1 --2- 172.21.15.63:0/3945851014 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 0x7f0f941444a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:28.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f98e67700 1 -- 172.21.15.63:0/3945851014 >> v2:172.21.15.155:3300/0 conn(0x7f0f94069eb0 msgr2=0x7f0f940b8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:28.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f98e67700 1 --2- 172.21.15.63:0/3945851014 >> v2:172.21.15.155:3300/0 conn(0x7f0f94069eb0 0x7f0f940b8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:28.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f98e67700 1 -- 172.21.15.63:0/3945851014 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f94065950 con 0x7f0f94147c30 2020-05-18T21:37:28.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f93fff700 1 --2- 172.21.15.63:0/3945851014 >> v2:172.21.15.155:3300/0 conn(0x7f0f94069eb0 0x7f0f940b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:28.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f98e67700 1 --2- 172.21.15.63:0/3945851014 >> v2:172.21.15.63:3300/0 conn(0x7f0f94147c30 0x7f0f94148090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0f8c0032f0 tx=0x7f0f8c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:28.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f98e67700 1 --2- 172.21.15.63:0/3945851014 >> v2:172.21.15.63:3300/0 conn(0x7f0f94147c30 0x7f0f94148090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0f8c0032f0 tx=0x7f0f8c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:28.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f98e67700 1 --2- 172.21.15.63:0/3945851014 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f94147c30 0x7f0f94148090 secure :-1 s=READY pgs=1998 cs=0 l=1 rx=0x7f0f8c0032f0 tx=0x7f0f8c007e00).ready entity=mon.0 client_cookie=2911af80ebec6bb7 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:28.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f98e67700 1 --2- 172.21.15.63:0/3945851014 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f94147c30 0x7f0f94148090 secure :-1 s=THROTTLE_DONE pgs=1998 cs=0 l=1 rx=0x7f0f8c0032f0 tx=0x7f0f8c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:28.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f92ffd700 1 -- 172.21.15.63:0/3945851014 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f8c011c60 con 0x7f0f94147c30 2020-05-18T21:37:28.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f98e67700 1 --2- 172.21.15.63:0/3945851014 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f94147c30 0x7f0f94148090 secure :-1 s=THROTTLE_DONE pgs=1998 cs=0 l=1 rx=0x7f0f8c0032f0 tx=0x7f0f8c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:28.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f92ffd700 1 -- 172.21.15.63:0/3945851014 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8c011dc0 con 0x7f0f94147c30 2020-05-18T21:37:28.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f98e67700 1 --2- 172.21.15.63:0/3945851014 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f94147c30 0x7f0f94148090 secure :-1 s=THROTTLE_DONE pgs=1998 cs=0 l=1 rx=0x7f0f8c0032f0 tx=0x7f0f8c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:28.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f92ffd700 1 -- 172.21.15.63:0/3945851014 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f8c00a370 con 0x7f0f94147c30 2020-05-18T21:37:28.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f9a8ca700 1 -- 172.21.15.63:0/3945851014 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f94147c30 msgr2=0x7f0f94148090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:28.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f9a8ca700 1 --2- 172.21.15.63:0/3945851014 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f94147c30 0x7f0f94148090 secure :-1 s=READY pgs=1998 cs=0 l=1 rx=0x7f0f8c0032f0 tx=0x7f0f8c007e00).stop 2020-05-18T21:37:28.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f9a8ca700 1 -- 172.21.15.63:0/3945851014 shutdown_connections 2020-05-18T21:37:28.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f9a8ca700 1 --2- 172.21.15.63:0/3945851014 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f94147c30 0x7f0f94148090 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:28.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f9a8ca700 1 --2- 172.21.15.63:0/3945851014 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 0x7f0f941444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:28.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f9a8ca700 1 --2- 172.21.15.63:0/3945851014 >> v2:172.21.15.155:3300/0 conn(0x7f0f94069eb0 0x7f0f940b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:28.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f9a8ca700 1 -- 172.21.15.63:0/3945851014 >> 172.21.15.63:0/3945851014 conn(0x7f0f94066ed0 msgr2=0x7f0f940b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:28.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f9a8ca700 1 -- 172.21.15.63:0/3945851014 shutdown_connections 2020-05-18T21:37:28.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.361+0000 7f0f9a8ca700 1 -- 172.21.15.63:0/3945851014 wait complete. 2020-05-18T21:37:28.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.365+0000 7f0f9a8ca700 1 Processor -- start 2020-05-18T21:37:28.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.365+0000 7f0f9a8ca700 1 -- start start 2020-05-18T21:37:28.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.365+0000 7f0f9a8ca700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 0x7f0f9413d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:28.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.365+0000 7f0f9a8ca700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f940b50d0 con 0x7f0f94069eb0 2020-05-18T21:37:28.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.365+0000 7f0f9a8ca700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9413f650 con 0x7f0f94147c30 2020-05-18T21:37:28.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.365+0000 7f0f93fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0f94069eb0 0x7f0f941395b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38004/0 (socket says 172.21.15.63:38004) 2020-05-18T21:37:28.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.365+0000 7f0f9a8ca700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9413f460 con 0x7f0f94144040 2020-05-18T21:37:28.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.365+0000 7f0f93fff700 1 -- 172.21.15.63:0/3077319884 learned_addr learned my addr 172.21.15.63:0/3077319884 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:28.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.365+0000 7f0f937fe700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 0x7f0f9413d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:28.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.365+0000 7f0f917fa700 1 -- 172.21.15.63:0/3077319884 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246211205 0 0) 0x7f0f940b50d0 con 0x7f0f94069eb0 2020-05-18T21:37:28.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f917fa700 1 -- 172.21.15.63:0/3077319884 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f74002fe0 con 0x7f0f94069eb0 2020-05-18T21:37:28.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f917fa700 1 -- 172.21.15.63:0/3077319884 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2221804094 0 0) 0x7f0f9413f650 con 0x7f0f94147c30 2020-05-18T21:37:28.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f917fa700 1 -- 172.21.15.63:0/3077319884 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f940b50d0 con 0x7f0f94147c30 2020-05-18T21:37:28.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f937fe700 1 -- 172.21.15.63:0/3077319884 >> v1:172.21.15.155:6789/0 conn(0x7f0f94147c30 legacy=0x7f0f9415cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:28.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f937fe700 1 -- 172.21.15.63:0/3077319884 >> v1:172.21.15.63:6789/0 conn(0x7f0f94069eb0 legacy=0x7f0f941395b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:28.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f937fe700 1 -- 172.21.15.63:0/3077319884 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9413bef0 con 0x7f0f94144040 2020-05-18T21:37:28.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f937fe700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 0x7f0f9413d780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f84002f70 tx=0x7f0f84010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:28.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f937fe700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 0x7f0f9413d780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f84002f70 tx=0x7f0f84010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:28.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f937fe700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 0x7f0f9413d780 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7f0f84002f70 tx=0x7f0f84010bc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:28.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f937fe700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 0x7f0f9413d780 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f0f84002f70 tx=0x7f0f84010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:28.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f917fa700 1 -- 172.21.15.63:0/3077319884 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f84007550 con 0x7f0f94144040 2020-05-18T21:37:28.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f937fe700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 0x7f0f9413d780 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f0f84002f70 tx=0x7f0f84010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f9a8ca700 1 -- 172.21.15.63:0/3077319884 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9413faf0 con 0x7f0f94144040 2020-05-18T21:37:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f917fa700 1 -- 172.21.15.63:0/3077319884 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f84005700 con 0x7f0f94144040 2020-05-18T21:37:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f937fe700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 0x7f0f9413d780 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f0f84002f70 tx=0x7f0f84010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f917fa700 1 -- 172.21.15.63:0/3077319884 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f84005a60 con 0x7f0f94144040 2020-05-18T21:37:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f9a8ca700 1 -- 172.21.15.63:0/3077319884 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f940b4c30 con 0x7f0f94144040 2020-05-18T21:37:28.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f937fe700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 0x7f0f9413d780 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f0f84002f70 tx=0x7f0f84010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:28.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f9a8ca700 1 -- 172.21.15.63:0/3077319884 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9413f7e0 con 0x7f0f94144040 2020-05-18T21:37:28.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f917fa700 1 -- 172.21.15.63:0/3077319884 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0f84005c60 con 0x7f0f94144040 2020-05-18T21:37:28.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f937fe700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 0x7f0f9413d780 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f0f84002f70 tx=0x7f0f84010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:28.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f917fa700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0f7404fe80 0x7f0f74052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:28.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.369+0000 7f0f917fa700 1 -- 172.21.15.63:0/3077319884 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0f84063bb0 con 0x7f0f94144040 2020-05-18T21:37:28.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.373+0000 7f0f93fff700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0f7404fe80 0x7f0f74052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:28.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.373+0000 7f0f93fff700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0f7404fe80 0x7f0f74052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f88002f70 tx=0x7f0f880093f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:28.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.373+0000 7f0f93fff700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0f7404fe80 0x7f0f74052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f88002f70 tx=0x7f0f880093f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:28.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.373+0000 7f0f93fff700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0f7404fe80 0x7f0f74052340 secure :-1 s=READY pgs=779 cs=0 l=1 rx=0x7f0f88002f70 tx=0x7f0f880093f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:28.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.377+0000 7f0f937fe700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 0x7f0f9413d780 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f0f84002f70 tx=0x7f0f84010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:28.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.377+0000 7f0f917fa700 1 -- 172.21.15.63:0/3077319884 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f0f8403df40 con 0x7f0f94144040 2020-05-18T21:37:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.529+0000 7f0f9a8ca700 1 -- 172.21.15.63:0/3077319884 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f940569e0 con 0x7f0f94144040 2020-05-18T21:37:28.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.533+0000 7f0f937fe700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 0x7f0f9413d780 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f0f84002f70 tx=0x7f0f84010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:28.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.533+0000 7f0f917fa700 1 -- 172.21.15.63:0/3077319884 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) v1 ==== 95+0+1798 (secure 0 0 0) 0x7f0f84041560 con 0x7f0f94144040 2020-05-18T21:37:28.538 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:28.538 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":125,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:18.846766+0000","modified":"2020-05-18T21:37:27.686944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":146,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7097":{"gid":7097,"name":"b","rank":0,"incarnation":125,"state":"up:replay","state_seq":1,"addr":"172.21.15.155:6835/2945312151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2945312151},{"type":"v1","addr":"172.21.15.155:6835","nonce":2945312151}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-05-18T21:37:28.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.533+0000 7f0f9a8ca700 1 -- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0f7404fe80 msgr2=0x7f0f74052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:28.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.533+0000 7f0f9a8ca700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0f7404fe80 0x7f0f74052340 secure :-1 s=READY pgs=779 cs=0 l=1 rx=0x7f0f88002f70 tx=0x7f0f880093f0).stop 2020-05-18T21:37:28.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.533+0000 7f0f9a8ca700 1 -- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 msgr2=0x7f0f9413d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:28.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.533+0000 7f0f9a8ca700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 0x7f0f9413d780 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7f0f84002f70 tx=0x7f0f84010bc0).stop 2020-05-18T21:37:28.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.533+0000 7f0f9a8ca700 1 -- 172.21.15.63:0/3077319884 shutdown_connections 2020-05-18T21:37:28.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.533+0000 7f0f9a8ca700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0f7404fe80 0x7f0f74052340 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:28.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.533+0000 7f0f9a8ca700 1 --2- 172.21.15.63:0/3077319884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f94144040 0x7f0f9413d780 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:28.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.533+0000 7f0f9a8ca700 1 -- 172.21.15.63:0/3077319884 >> 172.21.15.63:0/3077319884 conn(0x7f0f94066ed0 msgr2=0x7f0f9405c020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:28.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.533+0000 7f0f9a8ca700 1 -- 172.21.15.63:0/3077319884 shutdown_connections 2020-05-18T21:37:28.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:28.533+0000 7f0f9a8ca700 1 -- 172.21.15.63:0/3077319884 wait complete. 2020-05-18T21:37:28.542 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 125 2020-05-18T21:37:28.751 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 125, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:37:18.846766+0000', 'modified': '2020-05-18T21:37:27.686944+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 146, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7097}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7097': {'gid': 7097, 'name': 'b', 'rank': 0, 'incarnation': 125, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.155:6835/2945312151', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 2945312151}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 2945312151}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:37:28.752 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7097:up:replay 2020-05-18T21:37:29.754 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:29.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.857+0000 7f8415aa9700 1 Processor -- start 2020-05-18T21:37:29.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.857+0000 7f8415aa9700 1 -- start start 2020-05-18T21:37:29.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f8415aa9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f84100b8f10 0x7f84100b3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:29.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f8415aa9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8410061d90 0x7f84100b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:29.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f8415aa9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84100b5940 con 0x7f84100b6240 2020-05-18T21:37:29.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f8415aa9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84100b53d0 con 0x7f84100b8f10 2020-05-18T21:37:29.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f8415aa9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84100b92f0 con 0x7f8410061d90 2020-05-18T21:37:29.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f840f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f84100b8f10 0x7f84100b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:29.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f840f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f84100b8f10 0x7f84100b3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35826/0 (socket says 172.21.15.63:35826) 2020-05-18T21:37:29.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f840f7fe700 1 -- 172.21.15.63:0/702020402 learned_addr learned my addr 172.21.15.63:0/702020402 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:29.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f8407fff700 1 --2- 172.21.15.63:0/702020402 >> v2:172.21.15.155:3300/0 conn(0x7f8410061d90 0x7f84100b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:29.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f840f7fe700 1 -- 172.21.15.63:0/702020402 >> v2:172.21.15.155:3300/0 conn(0x7f8410061d90 msgr2=0x7f84100b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:29.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f840f7fe700 1 --2- 172.21.15.63:0/702020402 >> v2:172.21.15.155:3300/0 conn(0x7f8410061d90 0x7f84100b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:29.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f840f7fe700 1 -- 172.21.15.63:0/702020402 >> v1:172.21.15.155:6789/0 conn(0x7f84100b6240 legacy=0x7f84100996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:29.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f840f7fe700 1 -- 172.21.15.63:0/702020402 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84100b3aa0 con 0x7f84100b8f10 2020-05-18T21:37:29.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f840f7fe700 1 --2- 172.21.15.63:0/702020402 >> v2:172.21.15.63:3300/0 conn(0x7f84100b8f10 0x7f84100b3640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8400002f70 tx=0x7f8400007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:29.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f840f7fe700 1 --2- 172.21.15.63:0/702020402 >> v2:172.21.15.63:3300/0 conn(0x7f84100b8f10 0x7f84100b3640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8400002f70 tx=0x7f8400007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:29.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f840f7fe700 1 --2- 172.21.15.63:0/702020402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84100b8f10 0x7f84100b3640 secure :-1 s=READY pgs=2000 cs=0 l=1 rx=0x7f8400002f70 tx=0x7f8400007a80).ready entity=mon.0 client_cookie=18c7aa56d5e21d38 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:29.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f840f7fe700 1 --2- 172.21.15.63:0/702020402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84100b8f10 0x7f84100b3640 secure :-1 s=THROTTLE_DONE pgs=2000 cs=0 l=1 rx=0x7f8400002f70 tx=0x7f8400007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:29.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f840effd700 1 -- 172.21.15.63:0/702020402 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8400008e50 con 0x7f84100b8f10 2020-05-18T21:37:29.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f840f7fe700 1 --2- 172.21.15.63:0/702020402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84100b8f10 0x7f84100b3640 secure :-1 s=THROTTLE_DONE pgs=2000 cs=0 l=1 rx=0x7f8400002f70 tx=0x7f8400007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:29.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f840f7fe700 1 --2- 172.21.15.63:0/702020402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84100b8f10 0x7f84100b3640 secure :-1 s=THROTTLE_DONE pgs=2000 cs=0 l=1 rx=0x7f8400002f70 tx=0x7f8400007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:29.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f840effd700 1 -- 172.21.15.63:0/702020402 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8400010750 con 0x7f84100b8f10 2020-05-18T21:37:29.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f840effd700 1 -- 172.21.15.63:0/702020402 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8400010b70 con 0x7f84100b8f10 2020-05-18T21:37:29.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f8415aa9700 1 -- 172.21.15.63:0/702020402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84100b8f10 msgr2=0x7f84100b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:29.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.861+0000 7f8415aa9700 1 --2- 172.21.15.63:0/702020402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84100b8f10 0x7f84100b3640 secure :-1 s=READY pgs=2000 cs=0 l=1 rx=0x7f8400002f70 tx=0x7f8400007a80).stop 2020-05-18T21:37:29.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.865+0000 7f8415aa9700 1 -- 172.21.15.63:0/702020402 shutdown_connections 2020-05-18T21:37:29.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.865+0000 7f8415aa9700 1 --2- 172.21.15.63:0/702020402 >> v2:172.21.15.155:3300/0 conn(0x7f8410061d90 0x7f84100b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:29.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.865+0000 7f8415aa9700 1 --2- 172.21.15.63:0/702020402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84100b8f10 0x7f84100b3640 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:29.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.865+0000 7f8415aa9700 1 -- 172.21.15.63:0/702020402 >> 172.21.15.63:0/702020402 conn(0x7f841005a7c0 msgr2=0x7f841005aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:29.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.865+0000 7f8415aa9700 1 -- 172.21.15.63:0/702020402 shutdown_connections 2020-05-18T21:37:29.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.865+0000 7f8415aa9700 1 -- 172.21.15.63:0/702020402 wait complete. 2020-05-18T21:37:29.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.865+0000 7f8415aa9700 1 Processor -- start 2020-05-18T21:37:29.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.865+0000 7f8415aa9700 1 -- start start 2020-05-18T21:37:29.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.865+0000 7f8415aa9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8410061d90 0x7f8410065040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:29.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.865+0000 7f8415aa9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f84100b8f10 0x7f8410157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:29.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.865+0000 7f8415aa9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8410098760 con 0x7f84100b6240 2020-05-18T21:37:29.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.865+0000 7f8415aa9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84100928a0 con 0x7f84100b8f10 2020-05-18T21:37:29.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.865+0000 7f8415aa9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84100657c0 con 0x7f8410061d90 2020-05-18T21:37:29.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.865+0000 7f840ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f84100b8f10 0x7f8410157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:29.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.865+0000 7f840ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f84100b8f10 0x7f8410157460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35836/0 (socket says 172.21.15.63:35836) 2020-05-18T21:37:29.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.865+0000 7f840ffff700 1 -- 172.21.15.63:0/1088913405 learned_addr learned my addr 172.21.15.63:0/1088913405 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:29.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.865+0000 7f840f7fe700 1 --2- 172.21.15.63:0/1088913405 >> v2:172.21.15.155:3300/0 conn(0x7f8410061d90 0x7f8410065040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:29.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840ffff700 1 -- 172.21.15.63:0/1088913405 >> v2:172.21.15.155:3300/0 conn(0x7f8410061d90 msgr2=0x7f8410065040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:29.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840ffff700 1 --2- 172.21.15.63:0/1088913405 >> v2:172.21.15.155:3300/0 conn(0x7f8410061d90 0x7f8410065040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:29.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840ffff700 1 -- 172.21.15.63:0/1088913405 >> v1:172.21.15.155:6789/0 conn(0x7f84100b6240 legacy=0x7f841014d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:29.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840d7fa700 1 -- 172.21.15.63:0/1088913405 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215580009 0 0) 0x7f8410098760 con 0x7f84100b6240 2020-05-18T21:37:29.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840ffff700 1 -- 172.21.15.63:0/1088913405 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8410065a60 con 0x7f84100b8f10 2020-05-18T21:37:29.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840f7fe700 1 --2- 172.21.15.63:0/1088913405 >> v2:172.21.15.155:3300/0 conn(0x7f8410061d90 0x7f8410065040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:29.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840ffff700 1 --2- 172.21.15.63:0/1088913405 >> v2:172.21.15.63:3300/0 conn(0x7f84100b8f10 0x7f8410157460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8410098a50 tx=0x7f84080021f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:29.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840ffff700 1 --2- 172.21.15.63:0/1088913405 >> v2:172.21.15.63:3300/0 conn(0x7f84100b8f10 0x7f8410157460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8410098a50 tx=0x7f84080021f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:29.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840ffff700 1 --2- 172.21.15.63:0/1088913405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84100b8f10 0x7f8410157460 secure :-1 s=READY pgs=2001 cs=0 l=1 rx=0x7f8410098a50 tx=0x7f84080021f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:29.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840ffff700 1 --2- 172.21.15.63:0/1088913405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84100b8f10 0x7f8410157460 secure :-1 s=THROTTLE_DONE pgs=2001 cs=0 l=1 rx=0x7f8410098a50 tx=0x7f84080021f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:29.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840ffff700 1 --2- 172.21.15.63:0/1088913405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84100b8f10 0x7f8410157460 secure :-1 s=THROTTLE_DONE pgs=2001 cs=0 l=1 rx=0x7f8410098a50 tx=0x7f84080021f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:29.884 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840d7fa700 1 -- 172.21.15.63:0/1088913405 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f840800cce0 con 0x7f84100b8f10 2020-05-18T21:37:29.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840ffff700 1 --2- 172.21.15.63:0/1088913405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84100b8f10 0x7f8410157460 secure :-1 s=THROTTLE_DONE pgs=2001 cs=0 l=1 rx=0x7f8410098a50 tx=0x7f84080021f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:29.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840d7fa700 1 -- 172.21.15.63:0/1088913405 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840800ce40 con 0x7f84100b8f10 2020-05-18T21:37:29.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f8415aa9700 1 -- 172.21.15.63:0/1088913405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8410063600 con 0x7f84100b8f10 2020-05-18T21:37:29.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840d7fa700 1 -- 172.21.15.63:0/1088913405 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8408010380 con 0x7f84100b8f10 2020-05-18T21:37:29.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f8415aa9700 1 -- 172.21.15.63:0/1088913405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841014dd40 con 0x7f84100b8f10 2020-05-18T21:37:29.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840ffff700 1 --2- 172.21.15.63:0/1088913405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84100b8f10 0x7f8410157460 secure :-1 s=THROTTLE_DONE pgs=2001 cs=0 l=1 rx=0x7f8410098a50 tx=0x7f84080021f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:29.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f8415aa9700 1 -- 172.21.15.63:0/1088913405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84100569e0 con 0x7f84100b8f10 2020-05-18T21:37:29.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840d7fa700 1 -- 172.21.15.63:0/1088913405 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f84080105b0 con 0x7f84100b8f10 2020-05-18T21:37:29.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840ffff700 1 --2- 172.21.15.63:0/1088913405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84100b8f10 0x7f8410157460 secure :-1 s=THROTTLE_DONE pgs=2001 cs=0 l=1 rx=0x7f8410098a50 tx=0x7f84080021f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:29.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840d7fa700 1 --2- 172.21.15.63:0/1088913405 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f83f404f8e0 0x7f83f4051da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:29.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840d7fa700 1 -- 172.21.15.63:0/1088913405 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8408063ee0 con 0x7f84100b8f10 2020-05-18T21:37:29.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.869+0000 7f840f7fe700 1 --2- 172.21.15.63:0/1088913405 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f83f404f8e0 0x7f83f4051da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:29.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.873+0000 7f840f7fe700 1 --2- 172.21.15.63:0/1088913405 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f83f404f8e0 0x7f83f4051da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8400002f70 tx=0x7f8400007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:29.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.873+0000 7f840f7fe700 1 --2- 172.21.15.63:0/1088913405 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f83f404f8e0 0x7f83f4051da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8400002f70 tx=0x7f8400007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:29.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.873+0000 7f840f7fe700 1 --2- 172.21.15.63:0/1088913405 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f83f404f8e0 0x7f83f4051da0 secure :-1 s=READY pgs=780 cs=0 l=1 rx=0x7f8400002f70 tx=0x7f8400007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:29.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.877+0000 7f840ffff700 1 --2- 172.21.15.63:0/1088913405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84100b8f10 0x7f8410157460 secure :-1 s=THROTTLE_DONE pgs=2001 cs=0 l=1 rx=0x7f8410098a50 tx=0x7f84080021f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:29.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:29.877+0000 7f840d7fa700 1 -- 172.21.15.63:0/1088913405 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f840803e270 con 0x7f84100b8f10 2020-05-18T21:37:30.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:30.025+0000 7f8415aa9700 1 -- 172.21.15.63:0/1088913405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f841005b5b0 con 0x7f84100b8f10 2020-05-18T21:37:30.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:30.025+0000 7f840ffff700 1 --2- 172.21.15.63:0/1088913405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84100b8f10 0x7f8410157460 secure :-1 s=THROTTLE_DONE pgs=2001 cs=0 l=1 rx=0x7f8410098a50 tx=0x7f84080021f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:30.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:30.025+0000 7f840d7fa700 1 -- 172.21.15.63:0/1088913405 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 127 v127) v1 ==== 95+0+1798 (secure 0 0 0) 0x7f8408041890 con 0x7f84100b8f10 2020-05-18T21:37:30.033 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:30.033 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":127,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:18.846766+0000","modified":"2020-05-18T21:37:29.702505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":146,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7097":{"gid":7097,"name":"b","rank":0,"incarnation":125,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.155:6835/2945312151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2945312151},{"type":"v1","addr":"172.21.15.155:6835","nonce":2945312151}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-05-18T21:37:30.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:30.029+0000 7f8415aa9700 1 -- 172.21.15.63:0/1088913405 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f83f404f8e0 msgr2=0x7f83f4051da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:30.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:30.029+0000 7f8415aa9700 1 --2- 172.21.15.63:0/1088913405 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f83f404f8e0 0x7f83f4051da0 secure :-1 s=READY pgs=780 cs=0 l=1 rx=0x7f8400002f70 tx=0x7f8400007a80).stop 2020-05-18T21:37:30.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:30.029+0000 7f8415aa9700 1 -- 172.21.15.63:0/1088913405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84100b8f10 msgr2=0x7f8410157460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:30.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:30.029+0000 7f8415aa9700 1 --2- 172.21.15.63:0/1088913405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84100b8f10 0x7f8410157460 secure :-1 s=READY pgs=2001 cs=0 l=1 rx=0x7f8410098a50 tx=0x7f84080021f0).stop 2020-05-18T21:37:30.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:30.029+0000 7f8415aa9700 1 -- 172.21.15.63:0/1088913405 shutdown_connections 2020-05-18T21:37:30.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:30.029+0000 7f8415aa9700 1 --2- 172.21.15.63:0/1088913405 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f83f404f8e0 0x7f83f4051da0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:30.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:30.029+0000 7f8415aa9700 1 --2- 172.21.15.63:0/1088913405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84100b8f10 0x7f8410157460 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:30.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:30.029+0000 7f8415aa9700 1 --2- 172.21.15.63:0/1088913405 >> v2:172.21.15.155:3300/0 conn(0x7f8410061d90 0x7f8410065040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:30.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:30.029+0000 7f8415aa9700 1 -- 172.21.15.63:0/1088913405 >> 172.21.15.63:0/1088913405 conn(0x7f841005a7c0 msgr2=0x7f841009dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:30.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:30.029+0000 7f8415aa9700 1 -- 172.21.15.63:0/1088913405 shutdown_connections 2020-05-18T21:37:30.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:30.029+0000 7f8415aa9700 1 -- 172.21.15.63:0/1088913405 wait complete. 2020-05-18T21:37:30.037 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 127 2020-05-18T21:37:30.246 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 127, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:37:18.846766+0000', 'modified': '2020-05-18T21:37:29.702505+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 146, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7097}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7097': {'gid': 7097, 'name': 'b', 'rank': 0, 'incarnation': 125, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.155:6835/2945312151', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 2945312151}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 2945312151}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:37:30.247 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7097:up:rejoin 2020-05-18T21:37:30.480 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:37:30.483 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:37:31.248 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8ae3d9700 1 Processor -- start 2020-05-18T21:37:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8ae3d9700 1 -- start start 2020-05-18T21:37:31.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8ae3d9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff8a80652b0 0x7ff8a8142f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:31.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8ae3d9700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a805ab40 con 0x7ff8a805bda0 2020-05-18T21:37:31.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8ae3d9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a805ade0 con 0x7ff8a812ba80 2020-05-18T21:37:31.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8ae3d9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a80b6a10 con 0x7ff8a80652b0 2020-05-18T21:37:31.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8a77fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff8a805bda0 0x7ff8a81400d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38028/0 (socket says 172.21.15.63:38028) 2020-05-18T21:37:31.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8a77fe700 1 -- 172.21.15.63:0/924580017 learned_addr learned my addr 172.21.15.63:0/924580017 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:31.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8a7fff700 1 --2- 172.21.15.63:0/924580017 >> v2:172.21.15.155:3300/0 conn(0x7ff8a80652b0 0x7ff8a8142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:31.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8a6ffd700 1 -- 172.21.15.63:0/924580017 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725451781 0 0) 0x7ff8a805ab40 con 0x7ff8a805bda0 2020-05-18T21:37:31.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8a6ffd700 1 -- 172.21.15.63:0/924580017 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff88c003270 con 0x7ff8a805bda0 2020-05-18T21:37:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8a7fff700 1 -- 172.21.15.63:0/924580017 >> v1:172.21.15.155:6789/0 conn(0x7ff8a812ba80 legacy=0x7ff8a812bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8a7fff700 1 -- 172.21.15.63:0/924580017 >> v1:172.21.15.63:6789/0 conn(0x7ff8a805bda0 legacy=0x7ff8a81400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8a7fff700 1 -- 172.21.15.63:0/924580017 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a805b080 con 0x7ff8a80652b0 2020-05-18T21:37:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8a7fff700 1 --2- 172.21.15.63:0/924580017 >> v2:172.21.15.155:3300/0 conn(0x7ff8a80652b0 0x7ff8a8142f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff8900032f0 tx=0x7ff890007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8a7fff700 1 --2- 172.21.15.63:0/924580017 >> v2:172.21.15.155:3300/0 conn(0x7ff8a80652b0 0x7ff8a8142f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff8900032f0 tx=0x7ff890007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:31.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8a7fff700 1 --2- 172.21.15.63:0/924580017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8a80652b0 0x7ff8a8142f30 secure :-1 s=READY pgs=1325 cs=0 l=1 rx=0x7ff8900032f0 tx=0x7ff890007e00).ready entity=mon.1 client_cookie=2774c8d42a88bf0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:31.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8a7fff700 1 --2- 172.21.15.63:0/924580017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8a80652b0 0x7ff8a8142f30 secure :-1 s=THROTTLE_DONE pgs=1325 cs=0 l=1 rx=0x7ff8900032f0 tx=0x7ff890007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:31.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8a6ffd700 1 -- 172.21.15.63:0/924580017 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff890011e60 con 0x7ff8a80652b0 2020-05-18T21:37:31.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8a7fff700 1 --2- 172.21.15.63:0/924580017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8a80652b0 0x7ff8a8142f30 secure :-1 s=THROTTLE_DONE pgs=1325 cs=0 l=1 rx=0x7ff8900032f0 tx=0x7ff890007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:31.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8a7fff700 1 --2- 172.21.15.63:0/924580017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8a80652b0 0x7ff8a8142f30 secure :-1 s=THROTTLE_DONE pgs=1325 cs=0 l=1 rx=0x7ff8900032f0 tx=0x7ff890007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:31.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8a6ffd700 1 -- 172.21.15.63:0/924580017 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89000a180 con 0x7ff8a80652b0 2020-05-18T21:37:31.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8a6ffd700 1 -- 172.21.15.63:0/924580017 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff89000a4e0 con 0x7ff8a80652b0 2020-05-18T21:37:31.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8ae3d9700 1 -- 172.21.15.63:0/924580017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8a80652b0 msgr2=0x7ff8a8142f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:31.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.353+0000 7ff8ae3d9700 1 --2- 172.21.15.63:0/924580017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8a80652b0 0x7ff8a8142f30 secure :-1 s=READY pgs=1325 cs=0 l=1 rx=0x7ff8900032f0 tx=0x7ff890007e00).stop 2020-05-18T21:37:31.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.357+0000 7ff8ae3d9700 1 -- 172.21.15.63:0/924580017 shutdown_connections 2020-05-18T21:37:31.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.357+0000 7ff8ae3d9700 1 --2- 172.21.15.63:0/924580017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8a80652b0 0x7ff8a8142f30 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:31.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.357+0000 7ff8ae3d9700 1 -- 172.21.15.63:0/924580017 >> 172.21.15.63:0/924580017 conn(0x7ff8a8066ed0 msgr2=0x7ff8a80b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:31.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.357+0000 7ff8ae3d9700 1 -- 172.21.15.63:0/924580017 shutdown_connections 2020-05-18T21:37:31.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.357+0000 7ff8ae3d9700 1 -- 172.21.15.63:0/924580017 wait complete. 2020-05-18T21:37:31.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.357+0000 7ff8ae3d9700 1 Processor -- start 2020-05-18T21:37:31.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8ae3d9700 1 -- start start 2020-05-18T21:37:31.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8ae3d9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff8a80652b0 0x7ff8a8141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:31.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8ae3d9700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a8141da0 con 0x7ff8a812ba80 2020-05-18T21:37:31.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8ae3d9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a813ff40 con 0x7ff8a805bda0 2020-05-18T21:37:31.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8ae3d9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a81401e0 con 0x7ff8a80652b0 2020-05-18T21:37:31.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8ac976700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff8a812ba80 0x7ff8a8140920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38034/0 (socket says 172.21.15.63:38034) 2020-05-18T21:37:31.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8ac976700 1 -- 172.21.15.63:0/2949694068 learned_addr learned my addr 172.21.15.63:0/2949694068 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:31.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8a77fe700 1 --2- 172.21.15.63:0/2949694068 >> v2:172.21.15.155:3300/0 conn(0x7ff8a80652b0 0x7ff8a8141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:31.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8a57fa700 1 -- 172.21.15.63:0/2949694068 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494309265 0 0) 0x7ff8a8141da0 con 0x7ff8a812ba80 2020-05-18T21:37:31.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8a57fa700 1 -- 172.21.15.63:0/2949694068 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff880002fe0 con 0x7ff8a812ba80 2020-05-18T21:37:31.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8a57fa700 1 -- 172.21.15.63:0/2949694068 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342111289 0 0) 0x7ff8a813ff40 con 0x7ff8a805bda0 2020-05-18T21:37:31.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8a57fa700 1 -- 172.21.15.63:0/2949694068 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8a8141da0 con 0x7ff8a805bda0 2020-05-18T21:37:31.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8a57fa700 1 -- 172.21.15.63:0/2949694068 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3333219006 0 0) 0x7ff880002fe0 con 0x7ff8a812ba80 2020-05-18T21:37:31.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8a77fe700 1 -- 172.21.15.63:0/2949694068 >> v1:172.21.15.155:6789/0 conn(0x7ff8a805bda0 legacy=0x7ff8a80ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:31.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8a77fe700 1 -- 172.21.15.63:0/2949694068 >> v1:172.21.15.63:6789/0 conn(0x7ff8a812ba80 legacy=0x7ff8a8140920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:31.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8a77fe700 1 -- 172.21.15.63:0/2949694068 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a8140480 con 0x7ff8a80652b0 2020-05-18T21:37:31.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8a77fe700 1 --2- 172.21.15.63:0/2949694068 >> v2:172.21.15.155:3300/0 conn(0x7ff8a80652b0 0x7ff8a8141940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff898001110 tx=0x7ff8a00108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:31.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8a77fe700 1 --2- 172.21.15.63:0/2949694068 >> v2:172.21.15.155:3300/0 conn(0x7ff8a80652b0 0x7ff8a8141940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff898001110 tx=0x7ff8a00108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:31.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8a77fe700 1 --2- 172.21.15.63:0/2949694068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8a80652b0 0x7ff8a8141940 secure :-1 s=READY pgs=1327 cs=0 l=1 rx=0x7ff898001110 tx=0x7ff8a00108f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:31.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8a77fe700 1 --2- 172.21.15.63:0/2949694068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8a80652b0 0x7ff8a8141940 secure :-1 s=THROTTLE_DONE pgs=1327 cs=0 l=1 rx=0x7ff898001110 tx=0x7ff8a00108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:31.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8a57fa700 1 -- 172.21.15.63:0/2949694068 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8980018f0 con 0x7ff8a80652b0 2020-05-18T21:37:31.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8a77fe700 1 --2- 172.21.15.63:0/2949694068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8a80652b0 0x7ff8a8141940 secure :-1 s=THROTTLE_DONE pgs=1327 cs=0 l=1 rx=0x7ff898001110 tx=0x7ff8a00108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:31.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8a77fe700 1 --2- 172.21.15.63:0/2949694068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8a80652b0 0x7ff8a8141940 secure :-1 s=THROTTLE_DONE pgs=1327 cs=0 l=1 rx=0x7ff898001110 tx=0x7ff8a00108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8a57fa700 1 -- 172.21.15.63:0/2949694068 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a0005b10 con 0x7ff8a80652b0 2020-05-18T21:37:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8ae3d9700 1 -- 172.21.15.63:0/2949694068 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a8141030 con 0x7ff8a80652b0 2020-05-18T21:37:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8a57fa700 1 -- 172.21.15.63:0/2949694068 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a0005e70 con 0x7ff8a80652b0 2020-05-18T21:37:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.361+0000 7ff8ae3d9700 1 -- 172.21.15.63:0/2949694068 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a8143a60 con 0x7ff8a80652b0 2020-05-18T21:37:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.365+0000 7ff8a77fe700 1 --2- 172.21.15.63:0/2949694068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8a80652b0 0x7ff8a8141940 secure :-1 s=THROTTLE_DONE pgs=1327 cs=0 l=1 rx=0x7ff898001110 tx=0x7ff8a00108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.365+0000 7ff8ae3d9700 1 -- 172.21.15.63:0/2949694068 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a8140610 con 0x7ff8a80652b0 2020-05-18T21:37:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.365+0000 7ff8a77fe700 1 --2- 172.21.15.63:0/2949694068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8a80652b0 0x7ff8a8141940 secure :-1 s=THROTTLE_DONE pgs=1327 cs=0 l=1 rx=0x7ff898001110 tx=0x7ff8a00108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.365+0000 7ff8a57fa700 1 -- 172.21.15.63:0/2949694068 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff8a000a360 con 0x7ff8a80652b0 2020-05-18T21:37:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.365+0000 7ff8a57fa700 1 --2- 172.21.15.63:0/2949694068 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff88004fe30 0x7ff8800522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.365+0000 7ff8a57fa700 1 -- 172.21.15.63:0/2949694068 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff8a00090c0 con 0x7ff8a80652b0 2020-05-18T21:37:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.365+0000 7ff8a7fff700 1 --2- 172.21.15.63:0/2949694068 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff88004fe30 0x7ff8800522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:31.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.365+0000 7ff8a7fff700 1 --2- 172.21.15.63:0/2949694068 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff88004fe30 0x7ff8800522f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff890003430 tx=0x7ff890007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:31.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.365+0000 7ff8a7fff700 1 --2- 172.21.15.63:0/2949694068 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff88004fe30 0x7ff8800522f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff890003430 tx=0x7ff890007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:31.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.365+0000 7ff8a7fff700 1 --2- 172.21.15.63:0/2949694068 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff88004fe30 0x7ff8800522f0 secure :-1 s=READY pgs=781 cs=0 l=1 rx=0x7ff890003430 tx=0x7ff890007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:31.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.373+0000 7ff8a77fe700 1 --2- 172.21.15.63:0/2949694068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8a80652b0 0x7ff8a8141940 secure :-1 s=THROTTLE_DONE pgs=1327 cs=0 l=1 rx=0x7ff898001110 tx=0x7ff8a00108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:31.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.373+0000 7ff8a57fa700 1 -- 172.21.15.63:0/2949694068 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff8a003dc00 con 0x7ff8a80652b0 2020-05-18T21:37:31.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.521+0000 7ff8ae3d9700 1 -- 172.21.15.63:0/2949694068 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8a80569e0 con 0x7ff8a80652b0 2020-05-18T21:37:31.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.521+0000 7ff8a77fe700 1 --2- 172.21.15.63:0/2949694068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8a80652b0 0x7ff8a8141940 secure :-1 s=THROTTLE_DONE pgs=1327 cs=0 l=1 rx=0x7ff898001110 tx=0x7ff8a00108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:31.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.521+0000 7ff8a57fa700 1 -- 172.21.15.63:0/2949694068 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) v1 ==== 95+0+1804 (secure 0 0 0) 0x7ff8a0041220 con 0x7ff8a80652b0 2020-05-18T21:37:31.528 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:31.529 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":128,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":128,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:18.846766+0000","modified":"2020-05-18T21:37:30.713502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":146,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7097":{"gid":7097,"name":"b","rank":0,"incarnation":125,"state":"up:clientreplay","state_seq":4,"addr":"172.21.15.155:6835/2945312151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2945312151},{"type":"v1","addr":"172.21.15.155:6835","nonce":2945312151}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-05-18T21:37:31.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.525+0000 7ff8ae3d9700 1 -- 172.21.15.63:0/2949694068 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff88004fe30 msgr2=0x7ff8800522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:31.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.525+0000 7ff8ae3d9700 1 --2- 172.21.15.63:0/2949694068 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff88004fe30 0x7ff8800522f0 secure :-1 s=READY pgs=781 cs=0 l=1 rx=0x7ff890003430 tx=0x7ff890007e00).stop 2020-05-18T21:37:31.530 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.525+0000 7ff8ae3d9700 1 -- 172.21.15.63:0/2949694068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8a80652b0 msgr2=0x7ff8a8141940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:31.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.525+0000 7ff8ae3d9700 1 --2- 172.21.15.63:0/2949694068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8a80652b0 0x7ff8a8141940 secure :-1 s=READY pgs=1327 cs=0 l=1 rx=0x7ff898001110 tx=0x7ff8a00108f0).stop 2020-05-18T21:37:31.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.525+0000 7ff8ae3d9700 1 -- 172.21.15.63:0/2949694068 shutdown_connections 2020-05-18T21:37:31.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.525+0000 7ff8ae3d9700 1 --2- 172.21.15.63:0/2949694068 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff88004fe30 0x7ff8800522f0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:31.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.525+0000 7ff8ae3d9700 1 --2- 172.21.15.63:0/2949694068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8a80652b0 0x7ff8a8141940 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:31.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.525+0000 7ff8ae3d9700 1 -- 172.21.15.63:0/2949694068 >> 172.21.15.63:0/2949694068 conn(0x7ff8a8066ed0 msgr2=0x7ff8a8146490 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:31.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.525+0000 7ff8ae3d9700 1 -- 172.21.15.63:0/2949694068 shutdown_connections 2020-05-18T21:37:31.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:31.525+0000 7ff8ae3d9700 1 -- 172.21.15.63:0/2949694068 wait complete. 2020-05-18T21:37:31.532 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 128 2020-05-18T21:37:31.743 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 128, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:37:18.846766+0000', 'modified': '2020-05-18T21:37:30.713502+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 146, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7097}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7097': {'gid': 7097, 'name': 'b', 'rank': 0, 'incarnation': 125, 'state': 'up:clientreplay', 'state_seq': 4, 'addr': '172.21.15.155:6835/2945312151', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 2945312151}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 2945312151}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:37:31.743 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7097:up:clientreplay 2020-05-18T21:37:32.745 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:32.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9ba07a4700 1 Processor -- start 2020-05-18T21:37:32.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9ba07a4700 1 -- start start 2020-05-18T21:37:32.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9ba07a4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9b98060b90 0x7f9b980615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:32.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9ba07a4700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b980b2860 0x7f9b9814e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:32.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9ba07a4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9b98144090 0x7f9b981444e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:32.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9ba07a4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b98144940 con 0x7f9b98060b90 2020-05-18T21:37:32.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9ba07a4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b98066210 con 0x7f9b98144090 2020-05-18T21:37:32.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9ba07a4700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9814d960 con 0x7f9b980b2860 2020-05-18T21:37:32.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9b9e540700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9b98060b90 0x7f9b980615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:32.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9b9e540700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9b98060b90 0x7f9b980615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35856/0 (socket says 172.21.15.63:35856) 2020-05-18T21:37:32.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9b9e540700 1 -- 172.21.15.63:0/4088289391 learned_addr learned my addr 172.21.15.63:0/4088289391 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:32.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9b9ed41700 1 --2- 172.21.15.63:0/4088289391 >> v2:172.21.15.155:3300/0 conn(0x7f9b98144090 0x7f9b981444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:32.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9b9dd3f700 1 --2- 172.21.15.63:0/4088289391 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b980b2860 0x7f9b9814e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:32.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9b9e540700 1 -- 172.21.15.63:0/4088289391 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b980b2860 msgr2=0x7f9b9814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:32.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9b9e540700 1 --2- 172.21.15.63:0/4088289391 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b980b2860 0x7f9b9814e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:32.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9b9e540700 1 -- 172.21.15.63:0/4088289391 >> v2:172.21.15.155:3300/0 conn(0x7f9b98144090 msgr2=0x7f9b981444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:32.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9b9e540700 1 --2- 172.21.15.63:0/4088289391 >> v2:172.21.15.155:3300/0 conn(0x7f9b98144090 0x7f9b981444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:32.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9b9e540700 1 -- 172.21.15.63:0/4088289391 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9814db90 con 0x7f9b98060b90 2020-05-18T21:37:32.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9b9e540700 1 --2- 172.21.15.63:0/4088289391 >> v2:172.21.15.63:3300/0 conn(0x7f9b98060b90 0x7f9b980615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9b980b92c0 tx=0x7f9b94008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:32.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9b9e540700 1 --2- 172.21.15.63:0/4088289391 >> v2:172.21.15.63:3300/0 conn(0x7f9b98060b90 0x7f9b980615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9b980b92c0 tx=0x7f9b94008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:32.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9b9e540700 1 --2- 172.21.15.63:0/4088289391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b98060b90 0x7f9b980615e0 secure :-1 s=READY pgs=2004 cs=0 l=1 rx=0x7f9b980b92c0 tx=0x7f9b94008920).ready entity=mon.0 client_cookie=fe8b833df8808128 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:32.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9b9e540700 1 --2- 172.21.15.63:0/4088289391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b98060b90 0x7f9b980615e0 secure :-1 s=THROTTLE_DONE pgs=2004 cs=0 l=1 rx=0x7f9b980b92c0 tx=0x7f9b94008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:32.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9b9e540700 1 --2- 172.21.15.63:0/4088289391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b98060b90 0x7f9b980615e0 secure :-1 s=THROTTLE_DONE pgs=2004 cs=0 l=1 rx=0x7f9b980b92c0 tx=0x7f9b94008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:32.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9b9d53e700 1 -- 172.21.15.63:0/4088289391 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b940115c0 con 0x7f9b98060b90 2020-05-18T21:37:32.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9b9e540700 1 --2- 172.21.15.63:0/4088289391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b98060b90 0x7f9b980615e0 secure :-1 s=THROTTLE_DONE pgs=2004 cs=0 l=1 rx=0x7f9b980b92c0 tx=0x7f9b94008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:32.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9b9d53e700 1 -- 172.21.15.63:0/4088289391 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b94011720 con 0x7f9b98060b90 2020-05-18T21:37:32.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9b9d53e700 1 -- 172.21.15.63:0/4088289391 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b94011b40 con 0x7f9b98060b90 2020-05-18T21:37:32.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9ba07a4700 1 -- 172.21.15.63:0/4088289391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b98060b90 msgr2=0x7f9b980615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:32.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.849+0000 7f9ba07a4700 1 --2- 172.21.15.63:0/4088289391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b98060b90 0x7f9b980615e0 secure :-1 s=READY pgs=2004 cs=0 l=1 rx=0x7f9b980b92c0 tx=0x7f9b94008920).stop 2020-05-18T21:37:32.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.853+0000 7f9ba07a4700 1 -- 172.21.15.63:0/4088289391 shutdown_connections 2020-05-18T21:37:32.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.853+0000 7f9ba07a4700 1 --2- 172.21.15.63:0/4088289391 >> v2:172.21.15.155:3300/0 conn(0x7f9b98144090 0x7f9b981444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:32.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.853+0000 7f9ba07a4700 1 --2- 172.21.15.63:0/4088289391 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b980b2860 0x7f9b9814e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:32.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.853+0000 7f9ba07a4700 1 --2- 172.21.15.63:0/4088289391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b98060b90 0x7f9b980615e0 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:32.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.853+0000 7f9ba07a4700 1 -- 172.21.15.63:0/4088289391 >> 172.21.15.63:0/4088289391 conn(0x7f9b980b83d0 msgr2=0x7f9b980b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:32.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.853+0000 7f9ba07a4700 1 -- 172.21.15.63:0/4088289391 shutdown_connections 2020-05-18T21:37:32.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.853+0000 7f9ba07a4700 1 -- 172.21.15.63:0/4088289391 wait complete. 2020-05-18T21:37:32.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.853+0000 7f9ba07a4700 1 Processor -- start 2020-05-18T21:37:32.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.853+0000 7f9ba07a4700 1 -- start start 2020-05-18T21:37:32.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9ba07a4700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b98060b90 0x7f9b98158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:32.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9ba07a4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9b98144090 0x7f9b98069eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:32.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9ba07a4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b9806a310 con 0x7f9b980b2860 2020-05-18T21:37:32.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9ba07a4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b9814a9f0 con 0x7f9b98144090 2020-05-18T21:37:32.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9ba07a4700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b98144d90 con 0x7f9b98060b90 2020-05-18T21:37:32.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b9ed41700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9b98144090 0x7f9b98069eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:32.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b9e540700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b98060b90 0x7f9b98158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:32.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b9ed41700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9b98144090 0x7f9b98069eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35864/0 (socket says 172.21.15.63:35864) 2020-05-18T21:37:32.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b9dd3f700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f9b980b2860 0x7f9b98147300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:36366/0 (socket says 172.21.15.63:36366) 2020-05-18T21:37:32.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b9ed41700 1 -- 172.21.15.63:0/3153039866 learned_addr learned my addr 172.21.15.63:0/3153039866 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:32.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b9ed41700 1 -- 172.21.15.63:0/3153039866 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b98060b90 msgr2=0x7f9b98158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:32.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b9ed41700 1 --2- 172.21.15.63:0/3153039866 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b98060b90 0x7f9b98158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:32.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b9ed41700 1 -- 172.21.15.63:0/3153039866 >> v1:172.21.15.155:6789/0 conn(0x7f9b980b2860 legacy=0x7f9b98147300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:32.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b9ed41700 1 -- 172.21.15.63:0/3153039866 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b98145030 con 0x7f9b98144090 2020-05-18T21:37:32.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b877fe700 1 -- 172.21.15.63:0/3153039866 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128013378 0 0) 0x7f9b9806a310 con 0x7f9b980b2860 2020-05-18T21:37:32.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b9ed41700 1 --2- 172.21.15.63:0/3153039866 >> v2:172.21.15.63:3300/0 conn(0x7f9b98144090 0x7f9b98069eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b900032f0 tx=0x7f9b90010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:32.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b9ed41700 1 --2- 172.21.15.63:0/3153039866 >> v2:172.21.15.63:3300/0 conn(0x7f9b98144090 0x7f9b98069eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b900032f0 tx=0x7f9b90010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:32.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b9ed41700 1 --2- 172.21.15.63:0/3153039866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b98144090 0x7f9b98069eb0 secure :-1 s=READY pgs=2005 cs=0 l=1 rx=0x7f9b900032f0 tx=0x7f9b90010f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:32.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b9ed41700 1 --2- 172.21.15.63:0/3153039866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b98144090 0x7f9b98069eb0 secure :-1 s=THROTTLE_DONE pgs=2005 cs=0 l=1 rx=0x7f9b900032f0 tx=0x7f9b90010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:32.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b877fe700 1 -- 172.21.15.63:0/3153039866 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b90012e00 con 0x7f9b98144090 2020-05-18T21:37:32.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b9ed41700 1 --2- 172.21.15.63:0/3153039866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b98144090 0x7f9b98069eb0 secure :-1 s=THROTTLE_DONE pgs=2005 cs=0 l=1 rx=0x7f9b900032f0 tx=0x7f9b90010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:32.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b9ed41700 1 --2- 172.21.15.63:0/3153039866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b98144090 0x7f9b98069eb0 secure :-1 s=THROTTLE_DONE pgs=2005 cs=0 l=1 rx=0x7f9b900032f0 tx=0x7f9b90010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:32.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b877fe700 1 -- 172.21.15.63:0/3153039866 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9000a180 con 0x7f9b98144090 2020-05-18T21:37:32.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9ba07a4700 1 -- 172.21.15.63:0/3153039866 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b981452d0 con 0x7f9b98144090 2020-05-18T21:37:32.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b877fe700 1 -- 172.21.15.63:0/3153039866 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b9000a520 con 0x7f9b98144090 2020-05-18T21:37:32.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9ba07a4700 1 -- 172.21.15.63:0/3153039866 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b98148620 con 0x7f9b98144090 2020-05-18T21:37:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9b9ed41700 1 --2- 172.21.15.63:0/3153039866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b98144090 0x7f9b98069eb0 secure :-1 s=THROTTLE_DONE pgs=2005 cs=0 l=1 rx=0x7f9b900032f0 tx=0x7f9b90010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.857+0000 7f9ba07a4700 1 -- 172.21.15.63:0/3153039866 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b980569e0 con 0x7f9b98144090 2020-05-18T21:37:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.861+0000 7f9b877fe700 1 -- 172.21.15.63:0/3153039866 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9b9000a790 con 0x7f9b98144090 2020-05-18T21:37:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.861+0000 7f9b9ed41700 1 --2- 172.21.15.63:0/3153039866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b98144090 0x7f9b98069eb0 secure :-1 s=THROTTLE_DONE pgs=2005 cs=0 l=1 rx=0x7f9b900032f0 tx=0x7f9b90010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.861+0000 7f9b877fe700 1 --2- 172.21.15.63:0/3153039866 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b7804f8d0 0x7f9b78051d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.861+0000 7f9b877fe700 1 -- 172.21.15.63:0/3153039866 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9b90064640 con 0x7f9b98144090 2020-05-18T21:37:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.861+0000 7f9b9e540700 1 --2- 172.21.15.63:0/3153039866 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b7804f8d0 0x7f9b78051d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.861+0000 7f9b9e540700 1 --2- 172.21.15.63:0/3153039866 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b7804f8d0 0x7f9b78051d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b980b92c0 tx=0x7f9b9805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.861+0000 7f9b9e540700 1 --2- 172.21.15.63:0/3153039866 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b7804f8d0 0x7f9b78051d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b980b92c0 tx=0x7f9b9805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.861+0000 7f9b9e540700 1 --2- 172.21.15.63:0/3153039866 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b7804f8d0 0x7f9b78051d90 secure :-1 s=READY pgs=783 cs=0 l=1 rx=0x7f9b980b92c0 tx=0x7f9b9805fa60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.865+0000 7f9b9ed41700 1 --2- 172.21.15.63:0/3153039866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b98144090 0x7f9b98069eb0 secure :-1 s=THROTTLE_DONE pgs=2005 cs=0 l=1 rx=0x7f9b900032f0 tx=0x7f9b90010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:32.865+0000 7f9b877fe700 1 -- 172.21.15.63:0/3153039866 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9b9003e970 con 0x7f9b98144090 2020-05-18T21:37:33.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:33.025+0000 7f9ba07a4700 1 -- 172.21.15.63:0/3153039866 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b980008d0 con 0x7f9b98144090 2020-05-18T21:37:33.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:33.025+0000 7f9b9ed41700 1 --2- 172.21.15.63:0/3153039866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b98144090 0x7f9b98069eb0 secure :-1 s=THROTTLE_DONE pgs=2005 cs=0 l=1 rx=0x7f9b900032f0 tx=0x7f9b90010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:33.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:33.025+0000 7f9b877fe700 1 -- 172.21.15.63:0/3153039866 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) v1 ==== 95+0+2151 (secure 0 0 0) 0x7f9b90041f90 con 0x7f9b98144090 2020-05-18T21:37:33.032 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:33.032 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":129,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7091,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/1955616817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1955616817},{"type":"v1","addr":"172.21.15.63:6833","nonce":1955616817}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":129}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:18.846766+0000","modified":"2020-05-18T21:37:31.725431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":146,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7097":{"gid":7097,"name":"b","rank":0,"incarnation":125,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/2945312151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2945312151},{"type":"v1","addr":"172.21.15.155:6835","nonce":2945312151}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-05-18T21:37:33.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:33.025+0000 7f9ba07a4700 1 -- 172.21.15.63:0/3153039866 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b7804f8d0 msgr2=0x7f9b78051d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:33.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:33.025+0000 7f9ba07a4700 1 --2- 172.21.15.63:0/3153039866 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b7804f8d0 0x7f9b78051d90 secure :-1 s=READY pgs=783 cs=0 l=1 rx=0x7f9b980b92c0 tx=0x7f9b9805fa60).stop 2020-05-18T21:37:33.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:33.025+0000 7f9ba07a4700 1 -- 172.21.15.63:0/3153039866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b98144090 msgr2=0x7f9b98069eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:33.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:33.025+0000 7f9ba07a4700 1 --2- 172.21.15.63:0/3153039866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b98144090 0x7f9b98069eb0 secure :-1 s=READY pgs=2005 cs=0 l=1 rx=0x7f9b900032f0 tx=0x7f9b90010f60).stop 2020-05-18T21:37:33.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:33.029+0000 7f9ba07a4700 1 -- 172.21.15.63:0/3153039866 shutdown_connections 2020-05-18T21:37:33.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:33.029+0000 7f9ba07a4700 1 --2- 172.21.15.63:0/3153039866 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b7804f8d0 0x7f9b78051d90 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:33.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:33.029+0000 7f9ba07a4700 1 --2- 172.21.15.63:0/3153039866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b98144090 0x7f9b98069eb0 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:33.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:33.029+0000 7f9ba07a4700 1 --2- 172.21.15.63:0/3153039866 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b98060b90 0x7f9b98158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:33.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:33.029+0000 7f9ba07a4700 1 -- 172.21.15.63:0/3153039866 >> 172.21.15.63:0/3153039866 conn(0x7f9b980b83d0 msgr2=0x7f9b98063710 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:33.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:33.029+0000 7f9ba07a4700 1 -- 172.21.15.63:0/3153039866 shutdown_connections 2020-05-18T21:37:33.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:33.029+0000 7f9ba07a4700 1 -- 172.21.15.63:0/3153039866 wait complete. 2020-05-18T21:37:33.036 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 129 2020-05-18T21:37:33.246 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 129, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:37:18.846766+0000', 'modified': '2020-05-18T21:37:31.725431+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 146, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7097}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7097': {'gid': 7097, 'name': 'b', 'rank': 0, 'incarnation': 125, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.155:6835/2945312151', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 2945312151}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 2945312151}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:37:33.246 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:37:33.247 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:37:33.352 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:37:33.352 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:37:33.352 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2020-05-18T21:37:33.353 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 7097, 2020-05-18T21:37:33.353 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:37:33.353 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:37:33.353 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 5.6529245210000001, 2020-05-18T21:37:33.353 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 129, 2020-05-18T21:37:33.354 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 147, 2020-05-18T21:37:33.354 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 147, 2020-05-18T21:37:33.354 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 6.517023901 2020-05-18T21:37:33.354 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:37:33.360 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 7097, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.6529245210000001, "mdsmap_epoch": 129, "osdmap_epoch": 147, "osdmap_epoch_barrier": 147, "uptime": 6.517023901 } 2020-05-18T21:37:33.361 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:37:33.362 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:37:33.382 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:37:33.403 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:37:33.403 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:37:33.404 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:37:33.404 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:37:33.439 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[38358]: fuse finished with error 0 and tester_r 0 2020-05-18T21:37:33.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:33.441 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:37:33.448 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:37:33.449 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:37:33.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:33.450 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 down' 2020-05-18T21:37:33.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:33.468 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.0' 2020-05-18T21:37:33.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:33.636 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:37:33.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:33.656 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:37:33.664 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:37:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:37:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:37:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:37:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:33.665 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:33.665 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:33.666 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:33.666 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:37:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:37:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42189sec preferred_lft 42189sec 2020-05-18T21:37:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:37:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:33.667 INFO:teuthology.orchestra.run.smithi063.stdout:37: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-05-18T21:37:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:37:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::64a5:34ff:fed0:7699/64 scope link 2020-05-18T21:37:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:33.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:33.669 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:37:33.722 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:37:33.722 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:37:33.722 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:37:33.723 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:33.723 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:37:33.723 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:33.723 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:37:33.723 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:33.724 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:37:33.724 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:33.724 INFO:teuthology.orchestra.run.smithi063.stdout:37: ceph-brx: mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:37:33.724 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:33.725 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:37:33.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:33.727 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:37:33.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:33.750 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:37:33.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:33.852 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:37:33.862 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:37:33.862 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:37:33.863 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:37:33.863 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:37:33.863 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:37:33.863 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:37:33.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:33.864 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:37:33.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:33.922 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:37:33.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:33.938 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:37:33.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:33.957 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:37:33.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:33.963 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:37:34.010 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-05-18T21:37:34.011 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:37:34.012 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-05-18T21:37:34.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:34.013 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:37:34.020 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:37:34.020 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:37:34.020 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:37:34.021 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:34.021 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:37:34.021 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:34.021 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:34.021 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:34.022 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:34.022 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:34.022 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:34.022 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:34.022 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:37:34.022 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:34.023 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:37:34.023 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42189sec preferred_lft 42189sec 2020-05-18T21:37:34.023 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:37:34.023 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:34.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:34.024 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:37:34.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:34.031 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:37:34.038 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2020-05-18T21:37:34.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:37:34.039 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-05-18T21:37:34.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:34.040 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:37:34.048 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:37:34.048 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:37:34.049 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:37:34.049 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:34.049 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:37:34.049 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:34.049 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:34.050 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:34.050 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:34.050 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:34.051 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:34.051 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:34.051 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:37:34.051 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:34.052 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:37:34.052 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42193sec preferred_lft 42193sec 2020-05-18T21:37:34.052 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:37:34.053 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:34.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:34.053 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:37:34.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:34.098 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:37:34.105 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2020-05-18T21:37:34.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:37:34.107 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-05-18T21:37:34.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:34.108 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:37:34.115 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:37:34.116 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:37:34.116 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:37:34.116 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:34.116 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:37:34.116 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:34.117 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:34.117 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:34.117 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:34.117 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:34.117 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:34.118 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:34.118 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:37:34.118 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:34.118 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:37:34.118 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42193sec preferred_lft 42193sec 2020-05-18T21:37:34.118 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:37:34.119 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:34.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:34.120 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:37:34.166 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_strays.TestStrays.test_purge_queue_upgrade' 2020-05-18T21:37:34.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.269+0000 7efe874c6700 1 Processor -- start 2020-05-18T21:37:34.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.269+0000 7efe874c6700 1 -- start start 2020-05-18T21:37:34.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe874c6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe800ac4d0 0x7efe80061c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:34.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe874c6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efe80142c50 0x7efe800b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:34.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe874c6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe80063390 con 0x7efe800629f0 2020-05-18T21:37:34.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe874c6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe80062dd0 con 0x7efe800ac4d0 2020-05-18T21:37:34.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe874c6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe80063630 con 0x7efe80142c50 2020-05-18T21:37:34.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe85cc3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe800ac4d0 0x7efe80061c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:34.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe85cc3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe800ac4d0 0x7efe80061c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35868/0 (socket says 172.21.15.63:35868) 2020-05-18T21:37:34.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe85cc3700 1 -- 172.21.15.63:0/2218946996 learned_addr learned my addr 172.21.15.63:0/2218946996 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:34.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe86cc5700 1 --2- 172.21.15.63:0/2218946996 >> v2:172.21.15.155:3300/0 conn(0x7efe80142c50 0x7efe800b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:34.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe85cc3700 1 -- 172.21.15.63:0/2218946996 >> v2:172.21.15.155:3300/0 conn(0x7efe80142c50 msgr2=0x7efe800b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:34.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe85cc3700 1 --2- 172.21.15.63:0/2218946996 >> v2:172.21.15.155:3300/0 conn(0x7efe80142c50 0x7efe800b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe85cc3700 1 -- 172.21.15.63:0/2218946996 >> v1:172.21.15.155:6789/0 conn(0x7efe800629f0 legacy=0x7efe80065210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe85cc3700 1 -- 172.21.15.63:0/2218946996 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe800638d0 con 0x7efe800ac4d0 2020-05-18T21:37:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe86cc5700 1 --2- 172.21.15.63:0/2218946996 >> v2:172.21.15.155:3300/0 conn(0x7efe80142c50 0x7efe800b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:37:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe85cc3700 1 --2- 172.21.15.63:0/2218946996 >> v2:172.21.15.63:3300/0 conn(0x7efe800ac4d0 0x7efe80061c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efe74002f70 tx=0x7efe74007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe85cc3700 1 --2- 172.21.15.63:0/2218946996 >> v2:172.21.15.63:3300/0 conn(0x7efe800ac4d0 0x7efe80061c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efe74002f70 tx=0x7efe74007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe85cc3700 1 --2- 172.21.15.63:0/2218946996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe800ac4d0 0x7efe80061c40 secure :-1 s=READY pgs=2006 cs=0 l=1 rx=0x7efe74002f70 tx=0x7efe74007a80).ready entity=mon.0 client_cookie=5ddbe427a751d270 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:34.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe85cc3700 1 --2- 172.21.15.63:0/2218946996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe800ac4d0 0x7efe80061c40 secure :-1 s=THROTTLE_DONE pgs=2006 cs=0 l=1 rx=0x7efe74002f70 tx=0x7efe74007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe854c2700 1 -- 172.21.15.63:0/2218946996 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe74011760 con 0x7efe800ac4d0 2020-05-18T21:37:34.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe85cc3700 1 --2- 172.21.15.63:0/2218946996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe800ac4d0 0x7efe80061c40 secure :-1 s=THROTTLE_DONE pgs=2006 cs=0 l=1 rx=0x7efe74002f70 tx=0x7efe74007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe854c2700 1 -- 172.21.15.63:0/2218946996 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe740118c0 con 0x7efe800ac4d0 2020-05-18T21:37:34.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe85cc3700 1 --2- 172.21.15.63:0/2218946996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe800ac4d0 0x7efe80061c40 secure :-1 s=THROTTLE_DONE pgs=2006 cs=0 l=1 rx=0x7efe74002f70 tx=0x7efe74007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe874c6700 1 -- 172.21.15.63:0/2218946996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe800ac4d0 msgr2=0x7efe80061c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:34.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe854c2700 1 -- 172.21.15.63:0/2218946996 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe74011ce0 con 0x7efe800ac4d0 2020-05-18T21:37:34.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe874c6700 1 --2- 172.21.15.63:0/2218946996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe800ac4d0 0x7efe80061c40 secure :-1 s=READY pgs=2006 cs=0 l=1 rx=0x7efe74002f70 tx=0x7efe74007a80).stop 2020-05-18T21:37:34.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe874c6700 1 -- 172.21.15.63:0/2218946996 shutdown_connections 2020-05-18T21:37:34.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe874c6700 1 --2- 172.21.15.63:0/2218946996 >> v2:172.21.15.155:3300/0 conn(0x7efe80142c50 0x7efe800b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:34.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe874c6700 1 --2- 172.21.15.63:0/2218946996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe800ac4d0 0x7efe80061c40 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:34.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe874c6700 1 -- 172.21.15.63:0/2218946996 >> 172.21.15.63:0/2218946996 conn(0x7efe80069fc0 msgr2=0x7efe8006a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:34.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe874c6700 1 -- 172.21.15.63:0/2218946996 shutdown_connections 2020-05-18T21:37:34.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.273+0000 7efe874c6700 1 -- 172.21.15.63:0/2218946996 wait complete. 2020-05-18T21:37:34.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe874c6700 1 Processor -- start 2020-05-18T21:37:34.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe874c6700 1 -- start start 2020-05-18T21:37:34.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe874c6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe800ac4d0 0x7efe8013e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:34.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe874c6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe800b83b0 con 0x7efe800629f0 2020-05-18T21:37:34.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe874c6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe800b7e70 con 0x7efe80142c50 2020-05-18T21:37:34.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe874c6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8013cd30 con 0x7efe800ac4d0 2020-05-18T21:37:34.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe85cc3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe800ac4d0 0x7efe8013e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:34.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe85cc3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe800ac4d0 0x7efe8013e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35876/0 (socket says 172.21.15.63:35876) 2020-05-18T21:37:34.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe85cc3700 1 -- 172.21.15.63:0/623259636 learned_addr learned my addr 172.21.15.63:0/623259636 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:34.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe85cc3700 1 -- 172.21.15.63:0/623259636 >> v1:172.21.15.155:6789/0 conn(0x7efe80142c50 legacy=0x7efe8013d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:34.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe85cc3700 1 -- 172.21.15.63:0/623259636 >> v1:172.21.15.63:6789/0 conn(0x7efe800629f0 legacy=0x7efe80124ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:34.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe737fe700 1 -- 172.21.15.63:0/623259636 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267191926 0 0) 0x7efe800b83b0 con 0x7efe800629f0 2020-05-18T21:37:34.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe85cc3700 1 -- 172.21.15.63:0/623259636 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe800b8110 con 0x7efe800ac4d0 2020-05-18T21:37:34.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe85cc3700 1 --2- 172.21.15.63:0/623259636 >> v2:172.21.15.63:3300/0 conn(0x7efe800ac4d0 0x7efe8013e0c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe74002f70 tx=0x7efe74007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe85cc3700 1 --2- 172.21.15.63:0/623259636 >> v2:172.21.15.63:3300/0 conn(0x7efe800ac4d0 0x7efe8013e0c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe74002f70 tx=0x7efe74007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe85cc3700 1 --2- 172.21.15.63:0/623259636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe800ac4d0 0x7efe8013e0c0 secure :-1 s=READY pgs=2008 cs=0 l=1 rx=0x7efe74002f70 tx=0x7efe74007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:34.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe85cc3700 1 --2- 172.21.15.63:0/623259636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe800ac4d0 0x7efe8013e0c0 secure :-1 s=THROTTLE_DONE pgs=2008 cs=0 l=1 rx=0x7efe74002f70 tx=0x7efe74007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe737fe700 1 -- 172.21.15.63:0/623259636 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe7400f960 con 0x7efe800ac4d0 2020-05-18T21:37:34.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe85cc3700 1 --2- 172.21.15.63:0/623259636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe800ac4d0 0x7efe8013e0c0 secure :-1 s=THROTTLE_DONE pgs=2008 cs=0 l=1 rx=0x7efe74002f70 tx=0x7efe74007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe85cc3700 1 --2- 172.21.15.63:0/623259636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe800ac4d0 0x7efe8013e0c0 secure :-1 s=THROTTLE_DONE pgs=2008 cs=0 l=1 rx=0x7efe74002f70 tx=0x7efe74007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe737fe700 1 -- 172.21.15.63:0/623259636 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe74007360 con 0x7efe800ac4d0 2020-05-18T21:37:34.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe874c6700 1 -- 172.21.15.63:0/623259636 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe801253f0 con 0x7efe800ac4d0 2020-05-18T21:37:34.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe737fe700 1 -- 172.21.15.63:0/623259636 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe74005700 con 0x7efe800ac4d0 2020-05-18T21:37:34.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe874c6700 1 -- 172.21.15.63:0/623259636 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe800b79e0 con 0x7efe800ac4d0 2020-05-18T21:37:34.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.277+0000 7efe85cc3700 1 --2- 172.21.15.63:0/623259636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe800ac4d0 0x7efe8013e0c0 secure :-1 s=THROTTLE_DONE pgs=2008 cs=0 l=1 rx=0x7efe74002f70 tx=0x7efe74007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.281+0000 7efe874c6700 1 -- 172.21.15.63:0/623259636 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe800569e0 con 0x7efe800ac4d0 2020-05-18T21:37:34.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.281+0000 7efe737fe700 1 -- 172.21.15.63:0/623259636 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7efe74005860 con 0x7efe800ac4d0 2020-05-18T21:37:34.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.281+0000 7efe85cc3700 1 --2- 172.21.15.63:0/623259636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe800ac4d0 0x7efe8013e0c0 secure :-1 s=THROTTLE_DONE pgs=2008 cs=0 l=1 rx=0x7efe74002f70 tx=0x7efe74007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.281+0000 7efe737fe700 1 --2- 172.21.15.63:0/623259636 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe6004f860 0x7efe60051d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:34.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.281+0000 7efe737fe700 1 -- 172.21.15.63:0/623259636 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6159+0+0 (secure 0 0 0) 0x7efe74064470 con 0x7efe800ac4d0 2020-05-18T21:37:34.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.281+0000 7efe864c4700 1 --2- 172.21.15.63:0/623259636 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe6004f860 0x7efe60051d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:34.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.281+0000 7efe864c4700 1 --2- 172.21.15.63:0/623259636 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe6004f860 0x7efe60051d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe7c0011a0 tx=0x7efe7c001750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.281+0000 7efe864c4700 1 --2- 172.21.15.63:0/623259636 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe6004f860 0x7efe60051d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe7c0011a0 tx=0x7efe7c001750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.281+0000 7efe864c4700 1 --2- 172.21.15.63:0/623259636 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe6004f860 0x7efe60051d20 secure :-1 s=READY pgs=784 cs=0 l=1 rx=0x7efe7c0011a0 tx=0x7efe7c001750).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:34.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.285+0000 7efe85cc3700 1 --2- 172.21.15.63:0/623259636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe800ac4d0 0x7efe8013e0c0 secure :-1 s=THROTTLE_DONE pgs=2008 cs=0 l=1 rx=0x7efe74002f70 tx=0x7efe74007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.285+0000 7efe737fe700 1 -- 172.21.15.63:0/623259636 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7efe7403e920 con 0x7efe800ac4d0 2020-05-18T21:37:34.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.437+0000 7efe874c6700 1 -- 172.21.15.63:0/623259636 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_purge_queue_upgrade"]} v 0) v1 -- 0x7efe8006aab0 con 0x7efe800ac4d0 2020-05-18T21:37:34.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.785+0000 7efe85cc3700 1 --2- 172.21.15.63:0/623259636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe800ac4d0 0x7efe8013e0c0 secure :-1 s=THROTTLE_DONE pgs=2008 cs=0 l=1 rx=0x7efe74002f70 tx=0x7efe74007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.785+0000 7efe737fe700 1 -- 172.21.15.63:0/623259636 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_purge_queue_upgrade"]}]=0 v525) v1 ==== 139+0+0 (secure 0 0 0) 0x7efe74041f40 con 0x7efe800ac4d0 2020-05-18T21:37:34.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.789+0000 7efe874c6700 1 -- 172.21.15.63:0/623259636 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe6004f860 msgr2=0x7efe60051d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:34.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.789+0000 7efe874c6700 1 --2- 172.21.15.63:0/623259636 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe6004f860 0x7efe60051d20 secure :-1 s=READY pgs=784 cs=0 l=1 rx=0x7efe7c0011a0 tx=0x7efe7c001750).stop 2020-05-18T21:37:34.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.789+0000 7efe874c6700 1 -- 172.21.15.63:0/623259636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe800ac4d0 msgr2=0x7efe8013e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:34.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.789+0000 7efe874c6700 1 --2- 172.21.15.63:0/623259636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe800ac4d0 0x7efe8013e0c0 secure :-1 s=READY pgs=2008 cs=0 l=1 rx=0x7efe74002f70 tx=0x7efe74007a80).stop 2020-05-18T21:37:34.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.789+0000 7efe874c6700 1 -- 172.21.15.63:0/623259636 shutdown_connections 2020-05-18T21:37:34.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.789+0000 7efe874c6700 1 --2- 172.21.15.63:0/623259636 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efe6004f860 0x7efe60051d20 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:34.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.789+0000 7efe874c6700 1 --2- 172.21.15.63:0/623259636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe800ac4d0 0x7efe8013e0c0 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:34.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.789+0000 7efe874c6700 1 -- 172.21.15.63:0/623259636 >> 172.21.15.63:0/623259636 conn(0x7efe80069fc0 msgr2=0x7efe80060770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:34.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.789+0000 7efe874c6700 1 -- 172.21.15.63:0/623259636 shutdown_connections 2020-05-18T21:37:34.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.789+0000 7efe874c6700 1 -- 172.21.15.63:0/623259636 wait complete. 2020-05-18T21:37:34.813 INFO:tasks.cephfs_test_runner:test_purge_queue_upgrade (tasks.cephfs.test_strays.TestStrays) ... ok 2020-05-18T21:37:34.813 INFO:tasks.cephfs_test_runner:Starting test: test_replicated_delete_speed (tasks.cephfs.test_strays.TestStrays) 2020-05-18T21:37:34.814 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_strays.TestStrays.test_replicated_delete_speed' 2020-05-18T21:37:34.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b18c83700 1 Processor -- start 2020-05-18T21:37:34.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b18c83700 1 -- start start 2020-05-18T21:37:34.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b18c83700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b141435a0 0x7f6b14060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:34.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b18c83700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b140b7020 con 0x7f6b14145df0 2020-05-18T21:37:34.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b18c83700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b140b72c0 con 0x7f6b140b93f0 2020-05-18T21:37:34.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b18c83700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140b7560 con 0x7f6b141435a0 2020-05-18T21:37:34.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b12ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6b14145df0 0x7f6b14142e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38072/0 (socket says 172.21.15.63:38072) 2020-05-18T21:37:34.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b12ffd700 1 -- 172.21.15.63:0/3699955427 learned_addr learned my addr 172.21.15.63:0/3699955427 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:34.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b13fff700 1 --2- 172.21.15.63:0/3699955427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b141435a0 0x7f6b14060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:34.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 -- 172.21.15.63:0/3699955427 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403464101 0 0) 0x7f6b140b7020 con 0x7f6b14145df0 2020-05-18T21:37:34.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 -- 172.21.15.63:0/3699955427 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6af8003270 con 0x7f6b14145df0 2020-05-18T21:37:34.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 -- 172.21.15.63:0/3699955427 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097220885 0 0) 0x7f6b140b72c0 con 0x7f6b140b93f0 2020-05-18T21:37:34.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 -- 172.21.15.63:0/3699955427 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b140b7020 con 0x7f6b140b93f0 2020-05-18T21:37:34.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 -- 172.21.15.63:0/3699955427 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3008648365 0 0) 0x7f6af8003270 con 0x7f6b14145df0 2020-05-18T21:37:34.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 -- 172.21.15.63:0/3699955427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b141435a0 msgr2=0x7f6b14060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:34.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 --2- 172.21.15.63:0/3699955427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b141435a0 0x7f6b14060430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:34.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 -- 172.21.15.63:0/3699955427 >> v1:172.21.15.155:6789/0 conn(0x7f6b140b93f0 legacy=0x7f6b140b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:34.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 -- 172.21.15.63:0/3699955427 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b140b7800 con 0x7f6b14145df0 2020-05-18T21:37:34.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 -- 172.21.15.63:0/3699955427 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f6b04001a10 con 0x7f6b14145df0 2020-05-18T21:37:34.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 -- 172.21.15.63:0/3699955427 >> v1:172.21.15.63:6789/0 conn(0x7f6b14145df0 legacy=0x7f6b14142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:34.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 --2- 172.21.15.63:0/3699955427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b141435a0 0x7f6af8003920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:34.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 --2- 172.21.15.63:0/3699955427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6af8003d80 0x7f6af8004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:34.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 --2- 172.21.15.63:0/3699955427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6af8004970 0x7f6af8004df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:34.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 -- 172.21.15.63:0/3699955427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140b7560 con 0x7f6af8004970 2020-05-18T21:37:34.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 -- 172.21.15.63:0/3699955427 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af8005250 con 0x7f6af8003d80 2020-05-18T21:37:34.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 -- 172.21.15.63:0/3699955427 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af800b760 con 0x7f6b141435a0 2020-05-18T21:37:34.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b13fff700 1 --2- 172.21.15.63:0/3699955427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6af8004970 0x7f6af8004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:34.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b12ffd700 1 --2- 172.21.15.63:0/3699955427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6af8003d80 0x7f6af8004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:34.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b13fff700 1 -- 172.21.15.63:0/3699955427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b141435a0 msgr2=0x7f6af8003920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2020-05-18T21:37:34.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b13fff700 1 --2- 172.21.15.63:0/3699955427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b141435a0 0x7f6af8003920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:34.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b13fff700 1 -- 172.21.15.63:0/3699955427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6af8003d80 msgr2=0x7f6af8004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:34.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b13fff700 1 --2- 172.21.15.63:0/3699955427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6af8003d80 0x7f6af8004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:34.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b13fff700 1 -- 172.21.15.63:0/3699955427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af8003270 con 0x7f6af8004970 2020-05-18T21:37:34.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b12ffd700 1 --2- 172.21.15.63:0/3699955427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6af8003d80 0x7f6af8004510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:37:34.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b13fff700 1 --2- 172.21.15.63:0/3699955427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6af8004970 0x7f6af8004df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6b0c002f70 tx=0x7f6b0c0100c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b13fff700 1 --2- 172.21.15.63:0/3699955427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6af8004970 0x7f6af8004df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6b0c002f70 tx=0x7f6b0c0100c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b13fff700 1 --2- 172.21.15.63:0/3699955427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6af8004970 0x7f6af8004df0 secure :-1 s=READY pgs=2010 cs=0 l=1 rx=0x7f6b0c002f70 tx=0x7f6b0c0100c0).ready entity=mon.0 client_cookie=f39a21f049efad08 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:34.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b13fff700 1 --2- 172.21.15.63:0/3699955427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6af8004970 0x7f6af8004df0 secure :-1 s=THROTTLE_DONE pgs=2010 cs=0 l=1 rx=0x7f6b0c002f70 tx=0x7f6b0c0100c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b13fff700 1 --2- 172.21.15.63:0/3699955427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6af8004970 0x7f6af8004df0 secure :-1 s=THROTTLE_DONE pgs=2010 cs=0 l=1 rx=0x7f6b0c002f70 tx=0x7f6b0c0100c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 -- 172.21.15.63:0/3699955427 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b0c010dd0 con 0x7f6af8004970 2020-05-18T21:37:34.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b13fff700 1 --2- 172.21.15.63:0/3699955427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6af8004970 0x7f6af8004df0 secure :-1 s=THROTTLE_DONE pgs=2010 cs=0 l=1 rx=0x7f6b0c002f70 tx=0x7f6b0c0100c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 -- 172.21.15.63:0/3699955427 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0c008990 con 0x7f6af8004970 2020-05-18T21:37:34.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b127fc700 1 -- 172.21.15.63:0/3699955427 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b0c008d30 con 0x7f6af8004970 2020-05-18T21:37:34.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b18c83700 1 -- 172.21.15.63:0/3699955427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6af8004970 msgr2=0x7f6af8004df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:34.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b18c83700 1 --2- 172.21.15.63:0/3699955427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6af8004970 0x7f6af8004df0 secure :-1 s=READY pgs=2010 cs=0 l=1 rx=0x7f6b0c002f70 tx=0x7f6b0c0100c0).stop 2020-05-18T21:37:34.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.921+0000 7f6b13fff700 1 -- 172.21.15.63:0/3699955427 reap_dead start 2020-05-18T21:37:34.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b18c83700 1 -- 172.21.15.63:0/3699955427 shutdown_connections 2020-05-18T21:37:34.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b18c83700 1 -- 172.21.15.63:0/3699955427 >> 172.21.15.63:0/3699955427 conn(0x7f6b14069b70 msgr2=0x7f6b14069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:34.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b18c83700 1 -- 172.21.15.63:0/3699955427 shutdown_connections 2020-05-18T21:37:34.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b18c83700 1 -- 172.21.15.63:0/3699955427 wait complete. 2020-05-18T21:37:34.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b18c83700 1 Processor -- start 2020-05-18T21:37:34.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b18c83700 1 -- start start 2020-05-18T21:37:34.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b18c83700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b1413bb10 0x7f6b140bc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:34.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b18c83700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6b140b4320 0x7f6b1413f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:34.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b18c83700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b140b6680 con 0x7f6b1413f490 2020-05-18T21:37:34.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b18c83700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b140b4780 con 0x7f6b140b4320 2020-05-18T21:37:34.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b18c83700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140bc6f0 con 0x7f6b1413bb10 2020-05-18T21:37:34.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b13fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6b1413f490 0x7f6b140bb280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38084/0 (socket says 172.21.15.63:38084) 2020-05-18T21:37:34.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b13fff700 1 -- 172.21.15.63:0/3083596665 learned_addr learned my addr 172.21.15.63:0/3083596665 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:34.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b12ffd700 1 --2- 172.21.15.63:0/3083596665 >> v2:172.21.15.155:3300/0 conn(0x7f6b140b4320 0x7f6b1413f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:34.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b137fe700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b1413bb10 0x7f6b140bc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:34.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b10ff9700 1 -- 172.21.15.63:0/3083596665 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52636923 0 0) 0x7f6af8003270 con 0x7f6b1413f490 2020-05-18T21:37:34.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b10ff9700 1 -- 172.21.15.63:0/3083596665 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aec002fe0 con 0x7f6b1413f490 2020-05-18T21:37:34.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b12ffd700 1 -- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b1413bb10 msgr2=0x7f6b140bc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:34.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b12ffd700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b1413bb10 0x7f6b140bc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:34.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b10ff9700 1 -- 172.21.15.63:0/3083596665 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2029383167 0 0) 0x7f6aec002fe0 con 0x7f6b1413f490 2020-05-18T21:37:34.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b12ffd700 1 -- 172.21.15.63:0/3083596665 >> v1:172.21.15.63:6789/0 conn(0x7f6b1413f490 legacy=0x7f6b140bb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:34.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b12ffd700 1 -- 172.21.15.63:0/3083596665 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1413fba0 con 0x7f6b140b4320 2020-05-18T21:37:34.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.925+0000 7f6b12ffd700 1 --2- 172.21.15.63:0/3083596665 >> v2:172.21.15.155:3300/0 conn(0x7f6b140b4320 0x7f6b1413f030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b0c0082a0 tx=0x7f6b04010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.929+0000 7f6b12ffd700 1 --2- 172.21.15.63:0/3083596665 >> v2:172.21.15.155:3300/0 conn(0x7f6b140b4320 0x7f6b1413f030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b0c0082a0 tx=0x7f6b04010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.929+0000 7f6b12ffd700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b140b4320 0x7f6b1413f030 secure :-1 s=READY pgs=1332 cs=0 l=1 rx=0x7f6b0c0082a0 tx=0x7f6b04010f20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:34.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.929+0000 7f6b12ffd700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b140b4320 0x7f6b1413f030 secure :-1 s=THROTTLE_DONE pgs=1332 cs=0 l=1 rx=0x7f6b0c0082a0 tx=0x7f6b04010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.929+0000 7f6b10ff9700 1 -- 172.21.15.63:0/3083596665 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b0c0078e0 con 0x7f6b140b4320 2020-05-18T21:37:34.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.929+0000 7f6b12ffd700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b140b4320 0x7f6b1413f030 secure :-1 s=THROTTLE_DONE pgs=1332 cs=0 l=1 rx=0x7f6b0c0082a0 tx=0x7f6b04010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.929+0000 7f6b18c83700 1 -- 172.21.15.63:0/3083596665 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1413bef0 con 0x7f6b140b4320 2020-05-18T21:37:34.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.929+0000 7f6b10ff9700 1 -- 172.21.15.63:0/3083596665 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0400cbb0 con 0x7f6b140b4320 2020-05-18T21:37:34.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.929+0000 7f6b12ffd700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b140b4320 0x7f6b1413f030 secure :-1 s=THROTTLE_DONE pgs=1332 cs=0 l=1 rx=0x7f6b0c0082a0 tx=0x7f6b04010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.929+0000 7f6b10ff9700 1 -- 172.21.15.63:0/3083596665 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b04004970 con 0x7f6b140b4320 2020-05-18T21:37:34.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.929+0000 7f6b18c83700 1 -- 172.21.15.63:0/3083596665 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b14140040 con 0x7f6b140b4320 2020-05-18T21:37:34.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.929+0000 7f6b18c83700 1 -- 172.21.15.63:0/3083596665 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1413fd30 con 0x7f6b140b4320 2020-05-18T21:37:34.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.929+0000 7f6b12ffd700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b140b4320 0x7f6b1413f030 secure :-1 s=THROTTLE_DONE pgs=1332 cs=0 l=1 rx=0x7f6b0c0082a0 tx=0x7f6b04010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.929+0000 7f6b10ff9700 1 -- 172.21.15.63:0/3083596665 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6b04004bb0 con 0x7f6b140b4320 2020-05-18T21:37:34.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.929+0000 7f6b12ffd700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b140b4320 0x7f6b1413f030 secure :-1 s=THROTTLE_DONE pgs=1332 cs=0 l=1 rx=0x7f6b0c0082a0 tx=0x7f6b04010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.929+0000 7f6b10ff9700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6aec04fcf0 0x7f6aec0521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:34.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.929+0000 7f6b10ff9700 1 -- 172.21.15.63:0/3083596665 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6b040638b0 con 0x7f6b140b4320 2020-05-18T21:37:34.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.929+0000 7f6b137fe700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6aec04fcf0 0x7f6aec0521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:34.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.929+0000 7f6b137fe700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6aec04fcf0 0x7f6aec0521b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6afc000f50 tx=0x7f6afc000ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.933+0000 7f6b137fe700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6aec04fcf0 0x7f6aec0521b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6afc000f50 tx=0x7f6afc000ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.933+0000 7f6b137fe700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6aec04fcf0 0x7f6aec0521b0 secure :-1 s=READY pgs=785 cs=0 l=1 rx=0x7f6afc000f50 tx=0x7f6afc000ef0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:34.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.937+0000 7f6b12ffd700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b140b4320 0x7f6b1413f030 secure :-1 s=THROTTLE_DONE pgs=1332 cs=0 l=1 rx=0x7f6b0c0082a0 tx=0x7f6b04010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:34.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:34.937+0000 7f6b10ff9700 1 -- 172.21.15.63:0/3083596665 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6b0403dbe0 con 0x7f6b140b4320 2020-05-18T21:37:35.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.089+0000 7f6b18c83700 1 -- 172.21.15.63:0/3083596665 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_replicated_delete_speed"]} v 0) v1 -- 0x7f6b140569e0 con 0x7f6b140b4320 2020-05-18T21:37:35.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.797+0000 7f6b12ffd700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b140b4320 0x7f6b1413f030 secure :-1 s=THROTTLE_DONE pgs=1332 cs=0 l=1 rx=0x7f6b0c0082a0 tx=0x7f6b04010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:35.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.797+0000 7f6b10ff9700 1 -- 172.21.15.63:0/3083596665 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_replicated_delete_speed"]}]=0 v526) v1 ==== 146+0+0 (secure 0 0 0) 0x7f6b04041200 con 0x7f6b140b4320 2020-05-18T21:37:35.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.801+0000 7f6b18c83700 1 -- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6aec04fcf0 msgr2=0x7f6aec0521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:35.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.801+0000 7f6b18c83700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6aec04fcf0 0x7f6aec0521b0 secure :-1 s=READY pgs=785 cs=0 l=1 rx=0x7f6afc000f50 tx=0x7f6afc000ef0).stop 2020-05-18T21:37:35.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.801+0000 7f6b18c83700 1 -- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b140b4320 msgr2=0x7f6b1413f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:35.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.801+0000 7f6b18c83700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b140b4320 0x7f6b1413f030 secure :-1 s=READY pgs=1332 cs=0 l=1 rx=0x7f6b0c0082a0 tx=0x7f6b04010f20).stop 2020-05-18T21:37:35.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.801+0000 7f6b18c83700 1 -- 172.21.15.63:0/3083596665 shutdown_connections 2020-05-18T21:37:35.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.801+0000 7f6b18c83700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6aec04fcf0 0x7f6aec0521b0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:35.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.801+0000 7f6b18c83700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b140b4320 0x7f6b1413f030 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:35.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.801+0000 7f6b18c83700 1 --2- 172.21.15.63:0/3083596665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b1413bb10 0x7f6b140bc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:35.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.801+0000 7f6b18c83700 1 -- 172.21.15.63:0/3083596665 >> 172.21.15.63:0/3083596665 conn(0x7f6b14069b70 msgr2=0x7f6b1405c280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:35.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.801+0000 7f6b18c83700 1 -- 172.21.15.63:0/3083596665 shutdown_connections 2020-05-18T21:37:35.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.801+0000 7f6b18c83700 1 -- 172.21.15.63:0/3083596665 wait complete. 2020-05-18T21:37:35.822 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:37:35.823 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:37:35.843 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:37:35.863 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:37:35.864 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-05-18T21:37:35.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.969+0000 7fb7ba086700 1 Processor -- start 2020-05-18T21:37:35.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.969+0000 7fb7ba086700 1 -- start start 2020-05-18T21:37:35.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.969+0000 7fb7ba086700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb7b40b4760 0x7fb7b40648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:35.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.969+0000 7fb7ba086700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b414a330 con 0x7fb7b4064d20 2020-05-18T21:37:35.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7ba086700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b414a5d0 con 0x7fb7b405f110 2020-05-18T21:37:35.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7ba086700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b414a140 con 0x7fb7b40b4760 2020-05-18T21:37:35.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7b9885700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb7b4064d20 0x7fb7b414d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38094/0 (socket says 172.21.15.63:38094) 2020-05-18T21:37:35.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7b9885700 1 -- 172.21.15.63:0/438312067 learned_addr learned my addr 172.21.15.63:0/438312067 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:35.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7b8883700 1 --2- 172.21.15.63:0/438312067 >> v2:172.21.15.155:3300/0 conn(0x7fb7b40b4760 0x7fb7b40648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:35.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7a7fff700 1 -- 172.21.15.63:0/438312067 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547382045 0 0) 0x7fb7b414a330 con 0x7fb7b4064d20 2020-05-18T21:37:35.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7a7fff700 1 -- 172.21.15.63:0/438312067 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb798003270 con 0x7fb7b4064d20 2020-05-18T21:37:35.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7a7fff700 1 -- 172.21.15.63:0/438312067 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1352411583 0 0) 0x7fb798003270 con 0x7fb7b4064d20 2020-05-18T21:37:35.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7a7fff700 1 -- 172.21.15.63:0/438312067 >> v2:172.21.15.155:3300/0 conn(0x7fb7b40b4760 msgr2=0x7fb7b40648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:35.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7a7fff700 1 --2- 172.21.15.63:0/438312067 >> v2:172.21.15.155:3300/0 conn(0x7fb7b40b4760 0x7fb7b40648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:35.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7a7fff700 1 -- 172.21.15.63:0/438312067 >> v1:172.21.15.155:6789/0 conn(0x7fb7b405f110 legacy=0x7fb7b414aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:35.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7a7fff700 1 -- 172.21.15.63:0/438312067 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b4063430 con 0x7fb7b4064d20 2020-05-18T21:37:35.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7a7fff700 1 -- 172.21.15.63:0/438312067 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fb7ac001a90 con 0x7fb7b4064d20 2020-05-18T21:37:35.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7b8883700 1 --2- 172.21.15.63:0/438312067 >> v2:172.21.15.155:3300/0 conn(0x7fb7b40b4760 0x7fb7b40648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:35.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7a7fff700 1 -- 172.21.15.63:0/438312067 >> v1:172.21.15.63:6789/0 conn(0x7fb7b4064d20 legacy=0x7fb7b414d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:35.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7a7fff700 1 --2- 172.21.15.63:0/438312067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb798003760 0x7fb798003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:35.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7a7fff700 1 --2- 172.21.15.63:0/438312067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb798004510 0x7fb798004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:35.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7a7fff700 1 --2- 172.21.15.63:0/438312067 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb798004df0 0x7fb79800b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:35.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7a7fff700 1 -- 172.21.15.63:0/438312067 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb798004200 con 0x7fb798004df0 2020-05-18T21:37:35.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7a7fff700 1 -- 172.21.15.63:0/438312067 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb798004370 con 0x7fb798003760 2020-05-18T21:37:35.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7a7fff700 1 -- 172.21.15.63:0/438312067 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79800bc10 con 0x7fb798004510 2020-05-18T21:37:35.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7b9885700 1 --2- 172.21.15.63:0/438312067 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb798004df0 0x7fb79800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:35.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7b9084700 1 --2- 172.21.15.63:0/438312067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb798003760 0x7fb798003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:35.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7b8883700 1 --2- 172.21.15.63:0/438312067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb798004510 0x7fb798004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:35.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7b9885700 1 -- 172.21.15.63:0/438312067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb798004510 msgr2=0x7fb798004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:35.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7b9885700 1 --2- 172.21.15.63:0/438312067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb798004510 0x7fb798004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:35.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7b9885700 1 -- 172.21.15.63:0/438312067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb798003760 msgr2=0x7fb798003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:35.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7b9885700 1 --2- 172.21.15.63:0/438312067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb798003760 0x7fb798003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:35.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7b9885700 1 -- 172.21.15.63:0/438312067 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb798003270 con 0x7fb798004df0 2020-05-18T21:37:35.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7b9885700 1 --2- 172.21.15.63:0/438312067 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb798004df0 0x7fb79800b760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb7980054e0 tx=0x7fb7b40635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:35.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7b9885700 1 -- 172.21.15.63:0/438312067 reap_dead start 2020-05-18T21:37:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7b9885700 1 --2- 172.21.15.63:0/438312067 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb798004df0 0x7fb79800b760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb7980054e0 tx=0x7fb7b40635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7b9885700 1 --2- 172.21.15.63:0/438312067 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb798004df0 0x7fb79800b760 secure :-1 s=READY pgs=2013 cs=0 l=1 rx=0x7fb7980054e0 tx=0x7fb7b40635c0).ready entity=mon.0 client_cookie=6c57047a5873b249 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7b9885700 1 --2- 172.21.15.63:0/438312067 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb798004df0 0x7fb79800b760 secure :-1 s=THROTTLE_DONE pgs=2013 cs=0 l=1 rx=0x7fb7980054e0 tx=0x7fb7b40635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7a7fff700 1 -- 172.21.15.63:0/438312067 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7ac005e20 con 0x7fb798004df0 2020-05-18T21:37:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7b9885700 1 --2- 172.21.15.63:0/438312067 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb798004df0 0x7fb79800b760 secure :-1 s=THROTTLE_DONE pgs=2013 cs=0 l=1 rx=0x7fb7980054e0 tx=0x7fb7b40635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:35.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7b9885700 1 --2- 172.21.15.63:0/438312067 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb798004df0 0x7fb79800b760 secure :-1 s=THROTTLE_DONE pgs=2013 cs=0 l=1 rx=0x7fb7980054e0 tx=0x7fb7b40635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:35.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7a7fff700 1 -- 172.21.15.63:0/438312067 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ac004b80 con 0x7fb798004df0 2020-05-18T21:37:35.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7a7fff700 1 -- 172.21.15.63:0/438312067 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7ac004ee0 con 0x7fb798004df0 2020-05-18T21:37:35.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7ba086700 1 -- 172.21.15.63:0/438312067 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb798004df0 msgr2=0x7fb79800b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:35.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.973+0000 7fb7ba086700 1 --2- 172.21.15.63:0/438312067 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb798004df0 0x7fb79800b760 secure :-1 s=READY pgs=2013 cs=0 l=1 rx=0x7fb7980054e0 tx=0x7fb7b40635c0).stop 2020-05-18T21:37:35.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.977+0000 7fb7ba086700 1 -- 172.21.15.63:0/438312067 shutdown_connections 2020-05-18T21:37:35.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.977+0000 7fb7ba086700 1 --2- 172.21.15.63:0/438312067 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb798004df0 0x7fb79800b760 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:35.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.977+0000 7fb7ba086700 1 -- 172.21.15.63:0/438312067 >> 172.21.15.63:0/438312067 conn(0x7fb7b4069fc0 msgr2=0x7fb7b406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:35.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.977+0000 7fb7ba086700 1 -- 172.21.15.63:0/438312067 shutdown_connections 2020-05-18T21:37:35.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.977+0000 7fb7ba086700 1 -- 172.21.15.63:0/438312067 wait complete. 2020-05-18T21:37:35.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.977+0000 7fb7ba086700 1 Processor -- start 2020-05-18T21:37:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.977+0000 7fb7ba086700 1 -- start start 2020-05-18T21:37:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.977+0000 7fb7ba086700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb798004df0 0x7fb7b4149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.977+0000 7fb7ba086700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb7b4146330 0x7fb7b40b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.977+0000 7fb7ba086700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b41496e0 con 0x7fb7b41467a0 2020-05-18T21:37:35.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.977+0000 7fb7ba086700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b4145950 con 0x7fb798004df0 2020-05-18T21:37:35.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.977+0000 7fb7ba086700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b4145bf0 con 0x7fb7b4146330 2020-05-18T21:37:35.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.977+0000 7fb7b9885700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb7b41467a0 0x7fb7b40b6380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38106/0 (socket says 172.21.15.63:38106) 2020-05-18T21:37:35.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.977+0000 7fb7b9084700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb798004df0 0x7fb7b4149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:35.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.977+0000 7fb7b9885700 1 -- 172.21.15.63:0/1132240118 learned_addr learned my addr 172.21.15.63:0/1132240118 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:35.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.977+0000 7fb7b8883700 1 --2- 172.21.15.63:0/1132240118 >> v2:172.21.15.155:3300/0 conn(0x7fb7b4146330 0x7fb7b40b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:35.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.977+0000 7fb7a67fc700 1 -- 172.21.15.63:0/1132240118 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246283514 0 0) 0x7fb7b41496e0 con 0x7fb7b41467a0 2020-05-18T21:37:35.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.977+0000 7fb7a67fc700 1 -- 172.21.15.63:0/1132240118 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb79c002fe0 con 0x7fb7b41467a0 2020-05-18T21:37:35.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7b8883700 1 -- 172.21.15.63:0/1132240118 >> v2:172.21.15.63:3300/0 conn(0x7fb798004df0 msgr2=0x7fb7b4149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:35.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7b8883700 1 --2- 172.21.15.63:0/1132240118 >> v2:172.21.15.63:3300/0 conn(0x7fb798004df0 0x7fb7b4149280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:35.995 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7b8883700 1 -- 172.21.15.63:0/1132240118 >> v1:172.21.15.63:6789/0 conn(0x7fb7b41467a0 legacy=0x7fb7b40b6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:35.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7b8883700 1 -- 172.21.15.63:0/1132240118 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b4145e90 con 0x7fb7b4146330 2020-05-18T21:37:35.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7b8883700 1 --2- 172.21.15.63:0/1132240118 >> v2:172.21.15.155:3300/0 conn(0x7fb7b4146330 0x7fb7b40b7020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb7b40b8be0 tx=0x7fb7b0010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:35.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7b8883700 1 --2- 172.21.15.63:0/1132240118 >> v2:172.21.15.155:3300/0 conn(0x7fb7b4146330 0x7fb7b40b7020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb7b40b8be0 tx=0x7fb7b0010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:35.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7b8883700 1 --2- 172.21.15.63:0/1132240118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7b4146330 0x7fb7b40b7020 secure :-1 s=READY pgs=1334 cs=0 l=1 rx=0x7fb7b40b8be0 tx=0x7fb7b0010cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:35.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7b8883700 1 --2- 172.21.15.63:0/1132240118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7b4146330 0x7fb7b40b7020 secure :-1 s=THROTTLE_DONE pgs=1334 cs=0 l=1 rx=0x7fb7b40b8be0 tx=0x7fb7b0010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:35.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7a67fc700 1 -- 172.21.15.63:0/1132240118 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7b0007180 con 0x7fb7b4146330 2020-05-18T21:37:35.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7b8883700 1 --2- 172.21.15.63:0/1132240118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7b4146330 0x7fb7b40b7020 secure :-1 s=THROTTLE_DONE pgs=1334 cs=0 l=1 rx=0x7fb7b40b8be0 tx=0x7fb7b0010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:35.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7a67fc700 1 -- 172.21.15.63:0/1132240118 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b00072e0 con 0x7fb7b4146330 2020-05-18T21:37:35.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7b8883700 1 --2- 172.21.15.63:0/1132240118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7b4146330 0x7fb7b40b7020 secure :-1 s=THROTTLE_DONE pgs=1334 cs=0 l=1 rx=0x7fb7b40b8be0 tx=0x7fb7b0010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:35.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7ba086700 1 -- 172.21.15.63:0/1132240118 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b40b8ed0 con 0x7fb7b4146330 2020-05-18T21:37:35.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7a67fc700 1 -- 172.21.15.63:0/1132240118 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7b000c490 con 0x7fb7b4146330 2020-05-18T21:37:35.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7ba086700 1 -- 172.21.15.63:0/1132240118 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b40b6cb0 con 0x7fb7b4146330 2020-05-18T21:37:35.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7b8883700 1 --2- 172.21.15.63:0/1132240118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7b4146330 0x7fb7b40b7020 secure :-1 s=THROTTLE_DONE pgs=1334 cs=0 l=1 rx=0x7fb7b40b8be0 tx=0x7fb7b0010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:35.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7ba086700 1 -- 172.21.15.63:0/1132240118 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b40569e0 con 0x7fb7b4146330 2020-05-18T21:37:35.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7a67fc700 1 -- 172.21.15.63:0/1132240118 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb7b0013070 con 0x7fb7b4146330 2020-05-18T21:37:35.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7b8883700 1 --2- 172.21.15.63:0/1132240118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7b4146330 0x7fb7b40b7020 secure :-1 s=THROTTLE_DONE pgs=1334 cs=0 l=1 rx=0x7fb7b40b8be0 tx=0x7fb7b0010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:35.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7a67fc700 1 --2- 172.21.15.63:0/1132240118 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb79c04fd80 0x7fb79c052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:35.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7a67fc700 1 -- 172.21.15.63:0/1132240118 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb7b0063c30 con 0x7fb7b4146330 2020-05-18T21:37:35.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.981+0000 7fb7b9084700 1 --2- 172.21.15.63:0/1132240118 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb79c04fd80 0x7fb79c052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.985+0000 7fb7b9084700 1 --2- 172.21.15.63:0/1132240118 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb79c04fd80 0x7fb79c052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb7b4060a90 tx=0x7fb7a800c860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.985+0000 7fb7b9084700 1 --2- 172.21.15.63:0/1132240118 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb79c04fd80 0x7fb79c052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb7b4060a90 tx=0x7fb7a800c860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.985+0000 7fb7b9084700 1 --2- 172.21.15.63:0/1132240118 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb79c04fd80 0x7fb79c052240 secure :-1 s=READY pgs=786 cs=0 l=1 rx=0x7fb7b4060a90 tx=0x7fb7a800c860).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:36.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.993+0000 7fb7b8883700 1 --2- 172.21.15.63:0/1132240118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7b4146330 0x7fb7b40b7020 secure :-1 s=THROTTLE_DONE pgs=1334 cs=0 l=1 rx=0x7fb7b40b8be0 tx=0x7fb7b0010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:35.993+0000 7fb7a67fc700 1 -- 172.21.15.63:0/1132240118 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb7b003dfc0 con 0x7fb7b4146330 2020-05-18T21:37:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.113+0000 7fb7ba086700 1 -- 172.21.15.63:0/1132240118 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb7b40625f0 con 0x7fb7b4146330 2020-05-18T21:37:36.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.113+0000 7fb7b8883700 1 --2- 172.21.15.63:0/1132240118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7b4146330 0x7fb7b40b7020 secure :-1 s=THROTTLE_DONE pgs=1334 cs=0 l=1 rx=0x7fb7b40b8be0 tx=0x7fb7b0010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.113+0000 7fb7a67fc700 1 -- 172.21.15.63:0/1132240118 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v147) v1 ==== 81+0+33864 (secure 0 0 0) 0x7fb7b000e1a0 con 0x7fb7b4146330 2020-05-18T21:37:36.121 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:36.122 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:37:36.122 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 147, 2020-05-18T21:37:36.122 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:37:36.122 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2020-05-18T21:26:28.798650+0000", 2020-05-18T21:37:36.122 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2020-05-18T21:37:26.625754+0000", 2020-05-18T21:37:36.123 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:37:36.123 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:37:36.123 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-05-18T21:37:36.123 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5799936, 2020-05-18T21:37:36.123 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2020-05-18T21:37:36.124 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2020-05-18T21:37:36.124 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2020-05-18T21:37:36.124 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2020-05-18T21:37:36.124 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2020-05-18T21:37:36.124 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:37:36.125 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 4, 2020-05-18T21:37:36.125 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2020-05-18T21:37:36.125 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-05-18T21:37:36.125 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2020-05-18T21:37:36.125 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2020-05-18T21:37:36.126 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 28, 2020-05-18T21:37:36.126 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 8, 2020-05-18T21:37:36.126 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2020-05-18T21:37:36.126 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "jewel", 2020-05-18T21:37:36.126 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "pacific", 2020-05-18T21:37:36.127 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:37:36.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.127 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2020-05-18T21:37:36.127 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "device_health_metrics", 2020-05-18T21:37:36.127 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:33.080792+0000", 2020-05-18T21:37:36.127 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:37:36.128 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:37:36.128 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:37:36.128 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:37:36.128 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:37:36.128 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:37:36.129 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:37:36.129 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:37:36.129 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2020-05-18T21:37:36.129 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2020-05-18T21:37:36.129 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2020-05-18T21:37:36.130 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2020-05-18T21:37:36.130 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2020-05-18T21:37:36.130 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:37:36.130 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:37:36.130 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:37:36.130 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:37:36.131 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:37:36.131 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:37:36.131 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:37:36.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.131 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "15", 2020-05-18T21:37:36.132 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:37:36.132 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:37:36.132 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:37:36.132 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:37:36.133 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:37:36.133 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:37:36.133 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:37:36.133 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:37:36.133 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:37:36.133 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:37:36.134 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:37:36.134 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:37:36.134 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:37:36.134 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:37:36.134 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:37:36.135 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:37:36.135 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:37:36.135 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:37:36.135 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:37:36.135 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:37:36.136 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:37:36.136 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:37:36.136 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:37:36.136 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:37:36.136 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:37:36.136 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:37:36.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.137 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:37:36.137 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:37:36.137 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:37:36.137 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:37:36.138 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:37:36.138 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:37:36.138 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:37:36.138 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:37:36.138 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:37:36.138 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:37:36.139 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:37:36.139 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:37:36.139 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2020-05-18T21:37:36.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.139 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:37:36.140 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_devicehealth": {} 2020-05-18T21:37:36.140 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.140 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2020-05-18T21:37:36.140 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2020-05-18T21:37:36.141 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:40.149370+0000", 2020-05-18T21:37:36.141 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:37:36.141 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:37:36.141 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:37:36.141 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:37:36.142 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:37:36.142 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:37:36.142 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:37:36.142 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:37:36.142 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:37:36.143 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:37:36.143 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:37:36.143 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:37:36.143 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:37:36.143 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:37:36.143 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:37:36.144 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:37:36.144 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:37:36.144 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:37:36.144 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:37:36.144 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:37:36.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.145 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2020-05-18T21:37:36.145 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:37:36.145 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:37:36.145 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:37:36.145 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:37:36.146 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:37:36.146 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:37:36.146 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:37:36.146 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:37:36.146 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:37:36.147 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:37:36.147 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:37:36.147 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:37:36.147 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:37:36.147 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:37:36.147 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:37:36.148 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:37:36.148 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:37:36.148 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:37:36.148 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:37:36.148 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:37:36.149 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:37:36.149 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:37:36.149 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:37:36.149 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:37:36.149 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:37:36.149 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:37:36.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.150 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:37:36.150 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:37:36.150 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:37:36.150 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:37:36.151 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:37:36.151 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:37:36.151 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:37:36.151 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:37:36.151 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:37:36.152 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:37:36.152 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:37:36.152 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:37:36.152 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:37:36.152 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2020-05-18T21:37:36.152 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.153 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 27, 2020-05-18T21:37:36.153 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2020-05-18T21:37:36.153 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:37:17.318681+0000", 2020-05-18T21:37:36.154 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:37:36.154 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:37:36.154 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:37:36.154 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:37:36.154 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:37:36.154 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:37:36.155 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:37:36.155 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:37:36.155 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:37:36.155 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:37:36.155 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:37:36.156 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:37:36.156 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:37:36.156 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:37:36.156 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:37:36.156 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:37:36.156 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:37:36.157 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:37:36.157 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:37:36.157 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:37:36.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.157 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "144", 2020-05-18T21:37:36.158 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:37:36.158 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:37:36.158 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:37:36.158 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:37:36.158 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:37:36.158 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:37:36.159 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:37:36.159 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:37:36.159 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:37:36.159 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:37:36.159 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:37:36.160 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:37:36.160 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:37:36.160 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:37:36.160 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:37:36.160 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:37:36.160 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:37:36.161 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:37:36.161 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:37:36.161 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:37:36.161 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:37:36.161 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:37:36.162 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:37:36.162 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:37:36.162 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:37:36.162 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:37:36.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.162 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:37:36.163 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:37:36.163 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:37:36.163 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:37:36.163 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:37:36.163 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:37:36.164 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:37:36.164 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:37:36.164 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:37:36.164 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:37:36.164 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:37:36.164 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:37:36.165 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2020-05-18T21:37:36.165 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2020-05-18T21:37:36.165 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2020-05-18T21:37:36.165 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.165 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:37:36.166 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:37:36.166 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2020-05-18T21:37:36.166 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.166 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.167 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 28, 2020-05-18T21:37:36.167 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2020-05-18T21:37:36.167 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:37:17.835103+0000", 2020-05-18T21:37:36.167 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:37:36.167 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:37:36.168 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:37:36.168 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:37:36.168 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:37:36.168 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:37:36.168 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:37:36.169 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:37:36.169 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:37:36.169 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:37:36.169 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:37:36.169 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:37:36.169 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:37:36.170 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:37:36.170 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:37:36.170 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:37:36.170 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:37:36.170 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:37:36.171 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:37:36.171 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:37:36.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.171 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "145", 2020-05-18T21:37:36.171 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:37:36.171 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:37:36.172 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:37:36.172 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:37:36.172 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:37:36.172 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:37:36.172 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:37:36.173 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:37:36.173 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:37:36.173 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:37:36.173 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:37:36.173 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:37:36.173 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:37:36.174 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:37:36.174 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:37:36.174 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:37:36.174 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:37:36.174 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:37:36.175 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:37:36.175 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:37:36.175 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:37:36.175 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:37:36.175 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:37:36.175 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:37:36.176 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:37:36.176 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:37:36.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.176 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:37:36.176 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:37:36.177 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:37:36.177 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:37:36.177 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:37:36.177 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:37:36.177 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:37:36.177 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:37:36.178 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:37:36.178 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:37:36.178 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:37:36.178 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:37:36.178 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:37:36.179 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:37:36.179 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2020-05-18T21:37:36.179 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.179 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.179 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.179 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:37:36.180 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2020-05-18T21:37:36.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.180 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:37:36.180 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "c6ae0fbf-604c-4e8d-b1b8-6038821420e3", 2020-05-18T21:37:36.180 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:37:36.181 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:37:36.181 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:37:36.181 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:37:36.181 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:37:36.182 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:37:36.182 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:37:36.182 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 143, 2020-05-18T21:37:36.182 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:37:36.182 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:37:36.183 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:37:36.183 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.183 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.183 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2020-05-18T21:37:36.184 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:37:36.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.184 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.184 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2020-05-18T21:37:36.184 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:37:36.185 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.185 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.185 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:37:36.185 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.186 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.186 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6802", 2020-05-18T21:37:36.186 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:37:36.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.187 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.187 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6803", 2020-05-18T21:37:36.187 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:37:36.187 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.187 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.188 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:37:36.188 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.188 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.189 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6806", 2020-05-18T21:37:36.189 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:37:36.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.189 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.189 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6807", 2020-05-18T21:37:36.190 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:37:36.190 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.190 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.190 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:37:36.191 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.191 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.191 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6804", 2020-05-18T21:37:36.191 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:37:36.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.192 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.192 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6805", 2020-05-18T21:37:36.192 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:37:36.192 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.193 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.193 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6801/12803", 2020-05-18T21:37:36.193 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6803/12803", 2020-05-18T21:37:36.193 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6807/12803", 2020-05-18T21:37:36.193 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6805/12803", 2020-05-18T21:37:36.194 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:37:36.194 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:37:36.194 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:37:36.194 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.195 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:37:36.195 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6", 2020-05-18T21:37:36.195 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:37:36.195 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:37:36.195 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:37:36.196 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:37:36.196 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:37:36.196 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:37:36.196 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:37:36.196 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 143, 2020-05-18T21:37:36.197 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:37:36.197 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:37:36.197 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:37:36.197 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.197 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.198 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.198 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6808", 2020-05-18T21:37:36.198 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:37:36.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.198 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.199 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6809", 2020-05-18T21:37:36.199 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:37:36.199 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.199 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.200 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:37:36.200 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.200 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.200 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6810", 2020-05-18T21:37:36.200 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:37:36.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.201 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.201 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6811", 2020-05-18T21:37:36.201 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:37:36.202 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.202 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.202 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:37:36.202 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.203 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.203 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6815", 2020-05-18T21:37:36.203 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:37:36.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.204 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.204 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6817", 2020-05-18T21:37:36.204 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:37:36.204 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.204 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.205 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:37:36.205 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.205 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.205 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6812", 2020-05-18T21:37:36.206 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:37:36.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.206 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.206 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6813", 2020-05-18T21:37:36.207 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:37:36.207 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.207 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.207 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6809/12804", 2020-05-18T21:37:36.207 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6811/12804", 2020-05-18T21:37:36.208 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6817/12804", 2020-05-18T21:37:36.208 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6813/12804", 2020-05-18T21:37:36.208 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:37:36.208 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:37:36.208 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:37:36.209 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:37:36.209 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "ec8d9fa9-dae9-45f6-b286-735ab3801c27", 2020-05-18T21:37:36.209 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:37:36.210 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:37:36.210 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:37:36.210 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:37:36.210 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:37:36.210 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:37:36.211 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:37:36.211 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 142, 2020-05-18T21:37:36.211 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:37:36.211 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:37:36.211 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:37:36.211 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.212 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.212 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6822", 2020-05-18T21:37:36.212 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:37:36.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.213 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.213 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6824", 2020-05-18T21:37:36.213 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:37:36.213 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.213 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.214 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:37:36.214 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.214 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.215 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6826", 2020-05-18T21:37:36.215 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:37:36.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.216 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.216 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6827", 2020-05-18T21:37:36.216 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:37:36.216 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.217 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.217 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:37:36.217 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.218 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.218 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6830", 2020-05-18T21:37:36.218 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:37:36.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.218 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.219 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6831", 2020-05-18T21:37:36.219 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:37:36.219 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.219 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.220 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:37:36.220 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.220 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.220 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6828", 2020-05-18T21:37:36.221 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:37:36.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.221 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.221 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6829", 2020-05-18T21:37:36.221 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:37:36.222 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.222 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.222 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6824/12806", 2020-05-18T21:37:36.222 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6827/12806", 2020-05-18T21:37:36.223 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6831/12806", 2020-05-18T21:37:36.223 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6829/12806", 2020-05-18T21:37:36.223 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:37:36.223 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:37:36.223 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:37:36.223 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.224 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:37:36.224 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "1030fedf-adad-4e79-b839-59385d4d7d2a", 2020-05-18T21:37:36.224 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:37:36.225 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:37:36.225 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:37:36.225 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:37:36.225 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:37:36.225 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:37:36.225 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:37:36.226 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 130, 2020-05-18T21:37:36.226 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:37:36.226 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:37:36.226 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:37:36.226 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.227 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.227 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6814", 2020-05-18T21:37:36.227 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:37:36.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.228 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.228 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6816", 2020-05-18T21:37:36.228 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:37:36.228 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.228 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.229 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:37:36.229 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.229 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.229 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6818", 2020-05-18T21:37:36.230 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:37:36.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.230 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.230 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6819", 2020-05-18T21:37:36.231 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:37:36.231 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.231 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.231 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:37:36.232 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.232 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.232 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6823", 2020-05-18T21:37:36.232 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:37:36.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.233 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.233 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6825", 2020-05-18T21:37:36.233 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:37:36.234 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.234 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.234 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:37:36.234 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.235 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.235 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6820", 2020-05-18T21:37:36.235 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:37:36.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.236 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.236 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6821", 2020-05-18T21:37:36.236 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:37:36.236 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.236 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.237 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6816/12805", 2020-05-18T21:37:36.237 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6819/12805", 2020-05-18T21:37:36.237 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6825/12805", 2020-05-18T21:37:36.237 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6821/12805", 2020-05-18T21:37:36.237 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:37:36.238 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:37:36.238 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:37:36.238 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.239 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:37:36.239 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "8ad15a9b-97b4-4002-b1d4-7292e09b4ef6", 2020-05-18T21:37:36.239 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:37:36.239 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:37:36.239 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:37:36.239 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:37:36.240 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:37:36.240 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:37:36.240 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:37:36.240 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 142, 2020-05-18T21:37:36.240 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:37:36.241 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:37:36.241 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:37:36.241 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.241 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.241 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6800", 2020-05-18T21:37:36.242 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:37:36.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.242 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.242 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6801", 2020-05-18T21:37:36.243 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:37:36.243 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.243 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.243 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:37:36.243 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.244 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.244 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6802", 2020-05-18T21:37:36.244 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:37:36.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.245 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.245 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6803", 2020-05-18T21:37:36.245 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:37:36.245 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.245 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.246 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:37:36.246 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.246 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.247 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6806", 2020-05-18T21:37:36.247 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:37:36.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.247 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.247 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6807", 2020-05-18T21:37:36.248 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:37:36.248 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.248 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.248 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:37:36.249 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.249 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.249 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6804", 2020-05-18T21:37:36.249 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:37:36.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.250 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.250 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6805", 2020-05-18T21:37:36.250 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:37:36.250 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.251 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.251 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6801/13023", 2020-05-18T21:37:36.251 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6803/13023", 2020-05-18T21:37:36.251 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6807/13023", 2020-05-18T21:37:36.252 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6805/13023", 2020-05-18T21:37:36.252 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:37:36.252 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:37:36.252 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:37:36.252 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.253 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:37:36.253 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0dce88f8-b984-43e1-95e2-4132171102d2", 2020-05-18T21:37:36.253 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:37:36.253 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:37:36.254 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:37:36.254 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:37:36.254 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:37:36.254 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:37:36.254 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:37:36.254 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 143, 2020-05-18T21:37:36.255 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:37:36.255 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:37:36.255 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:37:36.255 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.256 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.256 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6808", 2020-05-18T21:37:36.256 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:37:36.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.256 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.257 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6809", 2020-05-18T21:37:36.257 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:37:36.257 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.257 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.258 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:37:36.258 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.258 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.258 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6810", 2020-05-18T21:37:36.258 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:37:36.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.259 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.259 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6811", 2020-05-18T21:37:36.259 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:37:36.260 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.260 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.260 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:37:36.260 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.261 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.261 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6814", 2020-05-18T21:37:36.261 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:37:36.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.262 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.262 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6816", 2020-05-18T21:37:36.262 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:37:36.262 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.262 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.263 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:37:36.263 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.263 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.263 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6812", 2020-05-18T21:37:36.264 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:37:36.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.264 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.264 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.264 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6813", 2020-05-18T21:37:36.264 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:37:36.265 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.265 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.265 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6809/13024", 2020-05-18T21:37:36.265 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6811/13024", 2020-05-18T21:37:36.266 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6816/13024", 2020-05-18T21:37:36.266 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6813/13024", 2020-05-18T21:37:36.266 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:37:36.266 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:37:36.266 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:37:36.267 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.267 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:37:36.267 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "e1bc92f8-3692-4483-b0fb-905c94fa1469", 2020-05-18T21:37:36.268 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:37:36.268 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:37:36.268 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:37:36.268 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:37:36.268 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:37:36.268 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:37:36.269 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:37:36.269 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 143, 2020-05-18T21:37:36.269 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:37:36.269 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:37:36.269 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:37:36.270 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.270 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.270 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6815", 2020-05-18T21:37:36.270 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:37:36.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.271 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.271 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6817", 2020-05-18T21:37:36.271 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:37:36.271 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.272 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.272 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:37:36.272 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.272 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.273 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6818", 2020-05-18T21:37:36.273 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:37:36.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.273 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.274 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6819", 2020-05-18T21:37:36.274 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:37:36.274 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.274 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.274 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:37:36.275 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.275 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.275 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6822", 2020-05-18T21:37:36.275 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:37:36.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.276 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.276 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.276 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6824", 2020-05-18T21:37:36.276 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:37:36.276 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.277 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.277 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:37:36.277 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.278 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.278 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6820", 2020-05-18T21:37:36.278 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:37:36.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.279 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.279 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6821", 2020-05-18T21:37:36.279 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:37:36.279 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.279 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.280 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6817/13025", 2020-05-18T21:37:36.280 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6819/13025", 2020-05-18T21:37:36.280 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6824/13025", 2020-05-18T21:37:36.280 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6821/13025", 2020-05-18T21:37:36.280 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:37:36.281 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:37:36.281 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:37:36.281 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.281 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:37:36.282 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "b76e000c-a078-48c4-9e1e-34d286a9992c", 2020-05-18T21:37:36.282 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:37:36.282 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:37:36.283 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:37:36.283 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:37:36.283 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:37:36.283 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:37:36.283 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:37:36.283 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 143, 2020-05-18T21:37:36.284 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:37:36.284 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:37:36.284 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:37:36.284 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.285 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.285 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6823", 2020-05-18T21:37:36.285 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:37:36.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.285 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.286 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6825", 2020-05-18T21:37:36.286 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:37:36.286 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.286 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.287 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:37:36.287 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.287 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.287 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6826", 2020-05-18T21:37:36.287 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:37:36.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.288 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.288 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6827", 2020-05-18T21:37:36.288 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:37:36.289 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.289 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.289 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:37:36.290 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.290 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.290 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6830", 2020-05-18T21:37:36.290 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:37:36.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.291 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.291 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6831", 2020-05-18T21:37:36.291 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:37:36.291 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.292 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.292 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:37:36.292 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:37:36.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.293 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:37:36.293 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6828", 2020-05-18T21:37:36.293 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:37:36.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.294 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:36.294 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6829", 2020-05-18T21:37:36.294 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:37:36.294 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.294 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.295 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6825/13026", 2020-05-18T21:37:36.295 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6827/13026", 2020-05-18T21:37:36.295 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6831/13026", 2020-05-18T21:37:36.295 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6829/13026", 2020-05-18T21:37:36.295 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:37:36.296 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:37:36.296 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:37:36.296 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:36.296 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.296 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:37:36.296 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2020-05-18T21:37:36.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.297 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:37:36.297 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:37:36.297 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:37:36.297 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:37:36.298 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:37:36.298 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:37:36.298 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.281434+0000", 2020-05-18T21:37:36.298 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:37:36.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.299 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:37:36.299 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:37:36.299 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:37:36.300 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:37:36.300 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:37:36.300 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:37:36.300 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.608518+0000", 2020-05-18T21:37:36.301 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:37:36.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.301 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:37:36.301 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:37:36.302 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:37:36.302 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:37:36.302 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:37:36.302 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:37:36.303 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.582386+0000", 2020-05-18T21:37:36.303 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:37:36.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.303 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:37:36.304 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:37:36.304 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:37:36.304 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:37:36.304 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:37:36.304 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:37:36.305 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.573488+0000", 2020-05-18T21:37:36.305 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:37:36.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.305 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:37:36.305 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:37:36.306 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:37:36.306 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:37:36.306 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:37:36.306 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:37:36.306 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.604174+0000", 2020-05-18T21:37:36.307 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:37:36.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.307 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:37:36.307 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:37:36.307 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:37:36.308 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:37:36.308 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:37:36.308 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:37:36.308 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.371004+0000", 2020-05-18T21:37:36.308 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:37:36.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.309 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:37:36.309 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:37:36.309 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:37:36.310 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:37:36.310 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:37:36.310 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:37:36.310 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.593070+0000", 2020-05-18T21:37:36.310 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:37:36.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:36.311 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:37:36.311 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:37:36.311 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:37:36.311 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:37:36.312 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:37:36.312 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:37:36.312 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.667677+0000", 2020-05-18T21:37:36.312 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:37:36.312 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.312 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:37:36.313 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2020-05-18T21:37:36.313 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2020-05-18T21:37:36.313 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2020-05-18T21:37:36.313 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2020-05-18T21:37:36.313 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklist": { 2020-05-18T21:37:36.314 INFO:teuthology.orchestra.run.smithi063.stdout: "172.21.15.63:6833/2601706233": "2020-05-19T21:37:26.616548+0000", 2020-05-18T21:37:36.314 INFO:teuthology.orchestra.run.smithi063.stdout: "172.21.15.63:6832/2601706233": "2020-05-19T21:37:26.616548+0000" 2020-05-18T21:37:36.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.314 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2020-05-18T21:37:36.314 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2020-05-18T21:37:36.315 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2020-05-18T21:37:36.315 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2020-05-18T21:37:36.315 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2020-05-18T21:37:36.319 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2020-05-18T21:37:36.319 INFO:teuthology.orchestra.run.smithi063.stdout: "ruleset-failure-domain": "osd", 2020-05-18T21:37:36.319 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2020-05-18T21:37:36.320 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:36.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:36.320 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2020-05-18T21:37:36.320 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2020-05-18T21:37:36.320 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2020-05-18T21:37:36.321 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2020-05-18T21:37:36.321 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {} 2020-05-18T21:37:36.321 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:37:36.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.117+0000 7fb7ba086700 1 -- 172.21.15.63:0/1132240118 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb79c04fd80 msgr2=0x7fb79c052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:36.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.117+0000 7fb7ba086700 1 --2- 172.21.15.63:0/1132240118 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb79c04fd80 0x7fb79c052240 secure :-1 s=READY pgs=786 cs=0 l=1 rx=0x7fb7b4060a90 tx=0x7fb7a800c860).stop 2020-05-18T21:37:36.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.117+0000 7fb7ba086700 1 -- 172.21.15.63:0/1132240118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7b4146330 msgr2=0x7fb7b40b7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:36.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.117+0000 7fb7ba086700 1 --2- 172.21.15.63:0/1132240118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7b4146330 0x7fb7b40b7020 secure :-1 s=READY pgs=1334 cs=0 l=1 rx=0x7fb7b40b8be0 tx=0x7fb7b0010cb0).stop 2020-05-18T21:37:36.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.117+0000 7fb7ba086700 1 -- 172.21.15.63:0/1132240118 shutdown_connections 2020-05-18T21:37:36.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.117+0000 7fb7ba086700 1 --2- 172.21.15.63:0/1132240118 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb79c04fd80 0x7fb79c052240 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:36.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.117+0000 7fb7ba086700 1 --2- 172.21.15.63:0/1132240118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7b4146330 0x7fb7b40b7020 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:36.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.117+0000 7fb7ba086700 1 --2- 172.21.15.63:0/1132240118 >> v2:172.21.15.63:3300/0 conn(0x7fb798004df0 0x7fb7b4149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:36.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.117+0000 7fb7ba086700 1 -- 172.21.15.63:0/1132240118 >> 172.21.15.63:0/1132240118 conn(0x7fb7b4069fc0 msgr2=0x7fb7b40651d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:36.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.117+0000 7fb7ba086700 1 -- 172.21.15.63:0/1132240118 shutdown_connections 2020-05-18T21:37:36.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.117+0000 7fb7ba086700 1 -- 172.21.15.63:0/1132240118 wait complete. 2020-05-18T21:37:36.326 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:36.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22eeda2700 1 Processor -- start 2020-05-18T21:37:36.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22eeda2700 1 -- start start 2020-05-18T21:37:36.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22eeda2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22e8060b90 0x7f22e80615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:36.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22eeda2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f22e814e570 0x7f22e814a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:36.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22eeda2700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e814d960 con 0x7f22e80b2860 2020-05-18T21:37:36.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22eeda2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e8066210 con 0x7f22e814e570 2020-05-18T21:37:36.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22eeda2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e814db90 con 0x7f22e8060b90 2020-05-18T21:37:36.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e7fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f22e80b2860 0x7f22e8144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38110/0 (socket says 172.21.15.63:38110) 2020-05-18T21:37:36.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e7fff700 1 -- 172.21.15.63:0/3713979464 learned_addr learned my addr 172.21.15.63:0/3713979464 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:36.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22ed33f700 1 --2- 172.21.15.63:0/3713979464 >> v2:172.21.15.63:3300/0 conn(0x7f22e814e570 0x7f22e814a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:36.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22ecb3e700 1 --2- 172.21.15.63:0/3713979464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22e8060b90 0x7f22e80615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:36.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e77fe700 1 -- 172.21.15.63:0/3713979464 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199174641 0 0) 0x7f22e814d960 con 0x7f22e80b2860 2020-05-18T21:37:36.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e77fe700 1 -- 172.21.15.63:0/3713979464 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22d4003270 con 0x7f22e80b2860 2020-05-18T21:37:36.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e77fe700 1 -- 172.21.15.63:0/3713979464 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1436426326 0 0) 0x7f22d4003270 con 0x7f22e80b2860 2020-05-18T21:37:36.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e77fe700 1 -- 172.21.15.63:0/3713979464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22e8060b90 msgr2=0x7f22e80615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:36.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e77fe700 1 --2- 172.21.15.63:0/3713979464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22e8060b90 0x7f22e80615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:36.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e77fe700 1 -- 172.21.15.63:0/3713979464 >> v2:172.21.15.63:3300/0 conn(0x7f22e814e570 msgr2=0x7f22e814a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:36.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e77fe700 1 --2- 172.21.15.63:0/3713979464 >> v2:172.21.15.63:3300/0 conn(0x7f22e814e570 0x7f22e814a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:36.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e77fe700 1 -- 172.21.15.63:0/3713979464 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e814de30 con 0x7f22e80b2860 2020-05-18T21:37:36.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e77fe700 1 -- 172.21.15.63:0/3713979464 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f22dc001710 con 0x7f22e80b2860 2020-05-18T21:37:36.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e77fe700 1 -- 172.21.15.63:0/3713979464 >> v1:172.21.15.63:6789/0 conn(0x7f22e80b2860 legacy=0x7f22e8144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:36.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e77fe700 1 --2- 172.21.15.63:0/3713979464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22e8060b90 0x7f22d4003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:36.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e77fe700 1 --2- 172.21.15.63:0/3713979464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22d4003bc0 0x7f22d4004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:36.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e77fe700 1 --2- 172.21.15.63:0/3713979464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22d4004600 0x7f22d4004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:36.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e77fe700 1 -- 172.21.15.63:0/3713979464 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e8066210 con 0x7f22d4004600 2020-05-18T21:37:36.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e77fe700 1 -- 172.21.15.63:0/3713979464 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e814db90 con 0x7f22d4003bc0 2020-05-18T21:37:36.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e77fe700 1 -- 172.21.15.63:0/3713979464 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d4005090 con 0x7f22e8060b90 2020-05-18T21:37:36.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22ed33f700 1 --2- 172.21.15.63:0/3713979464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22d4004600 0x7f22d4004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:36.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e7fff700 1 --2- 172.21.15.63:0/3713979464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22d4003bc0 0x7f22d4004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:36.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22ecb3e700 1 --2- 172.21.15.63:0/3713979464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22e8060b90 0x7f22d4003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:36.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22ed33f700 1 -- 172.21.15.63:0/3713979464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22e8060b90 msgr2=0x7f22d4003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:36.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22ed33f700 1 --2- 172.21.15.63:0/3713979464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22e8060b90 0x7f22d4003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:36.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22ed33f700 1 -- 172.21.15.63:0/3713979464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22d4003bc0 msgr2=0x7f22d4004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:36.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22ed33f700 1 --2- 172.21.15.63:0/3713979464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22d4003bc0 0x7f22d4004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:36.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22ed33f700 1 -- 172.21.15.63:0/3713979464 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d4003270 con 0x7f22d4004600 2020-05-18T21:37:36.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e7fff700 1 --2- 172.21.15.63:0/3713979464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22d4003bc0 0x7f22d4004020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:37:36.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22ecb3e700 1 --2- 172.21.15.63:0/3713979464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22e8060b90 0x7f22d4003760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:37:36.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22ed33f700 1 --2- 172.21.15.63:0/3713979464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22d4004600 0x7f22d4004a60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f22e0002f70 tx=0x7f22e0010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22ed33f700 1 --2- 172.21.15.63:0/3713979464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22d4004600 0x7f22d4004a60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f22e0002f70 tx=0x7f22e0010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22ed33f700 1 --2- 172.21.15.63:0/3713979464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22d4004600 0x7f22d4004a60 secure :-1 s=READY pgs=2016 cs=0 l=1 rx=0x7f22e0002f70 tx=0x7f22e0010110).ready entity=mon.0 client_cookie=e5f24fae76d511f2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:36.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22ed33f700 1 --2- 172.21.15.63:0/3713979464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22d4004600 0x7f22d4004a60 secure :-1 s=THROTTLE_DONE pgs=2016 cs=0 l=1 rx=0x7f22e0002f70 tx=0x7f22e0010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e77fe700 1 -- 172.21.15.63:0/3713979464 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22e00089b0 con 0x7f22d4004600 2020-05-18T21:37:36.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22ed33f700 1 --2- 172.21.15.63:0/3713979464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22d4004600 0x7f22d4004a60 secure :-1 s=THROTTLE_DONE pgs=2016 cs=0 l=1 rx=0x7f22e0002f70 tx=0x7f22e0010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e77fe700 1 -- 172.21.15.63:0/3713979464 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e0008b10 con 0x7f22d4004600 2020-05-18T21:37:36.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22ed33f700 1 --2- 172.21.15.63:0/3713979464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22d4004600 0x7f22d4004a60 secure :-1 s=THROTTLE_DONE pgs=2016 cs=0 l=1 rx=0x7f22e0002f70 tx=0x7f22e0010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22e77fe700 1 -- 172.21.15.63:0/3713979464 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22e0008e70 con 0x7f22d4004600 2020-05-18T21:37:36.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22eeda2700 1 -- 172.21.15.63:0/3713979464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22d4004600 msgr2=0x7f22d4004a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:36.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.433+0000 7f22eeda2700 1 --2- 172.21.15.63:0/3713979464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22d4004600 0x7f22d4004a60 secure :-1 s=READY pgs=2016 cs=0 l=1 rx=0x7f22e0002f70 tx=0x7f22e0010110).stop 2020-05-18T21:37:36.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.437+0000 7f22ed33f700 1 -- 172.21.15.63:0/3713979464 reap_dead start 2020-05-18T21:37:36.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.437+0000 7f22eeda2700 1 -- 172.21.15.63:0/3713979464 shutdown_connections 2020-05-18T21:37:36.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.437+0000 7f22eeda2700 1 -- 172.21.15.63:0/3713979464 >> 172.21.15.63:0/3713979464 conn(0x7f22e80b83d0 msgr2=0x7f22e80b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:36.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.437+0000 7f22eeda2700 1 -- 172.21.15.63:0/3713979464 shutdown_connections 2020-05-18T21:37:36.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.437+0000 7f22eeda2700 1 -- 172.21.15.63:0/3713979464 wait complete. 2020-05-18T21:37:36.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.437+0000 7f22eeda2700 1 Processor -- start 2020-05-18T21:37:36.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22eeda2700 1 -- start start 2020-05-18T21:37:36.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22eeda2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f22e80b7790 0x7f22e80b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:36.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22eeda2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f22e814bea0 0x7f22e8157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:36.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22eeda2700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e81575d0 con 0x7f22e80b1570 2020-05-18T21:37:36.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22eeda2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e81573e0 con 0x7f22e80b7790 2020-05-18T21:37:36.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22eeda2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e8158410 con 0x7f22e814bea0 2020-05-18T21:37:36.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22ecb3e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f22e80b7790 0x7f22e80b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:36.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22e7fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f22e80b1570 0x7f22e814b790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38124/0 (socket says 172.21.15.63:38124) 2020-05-18T21:37:36.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22e7fff700 1 -- 172.21.15.63:0/975371918 learned_addr learned my addr 172.21.15.63:0/975371918 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:36.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22ed33f700 1 --2- 172.21.15.63:0/975371918 >> v2:172.21.15.155:3300/0 conn(0x7f22e814bea0 0x7f22e8157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:36.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22e5ffb700 1 -- 172.21.15.63:0/975371918 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923139684 0 0) 0x7f22e81575d0 con 0x7f22e80b1570 2020-05-18T21:37:36.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22e5ffb700 1 -- 172.21.15.63:0/975371918 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22c8002fe0 con 0x7f22e80b1570 2020-05-18T21:37:36.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22ecb3e700 1 -- 172.21.15.63:0/975371918 >> v2:172.21.15.155:3300/0 conn(0x7f22e814bea0 msgr2=0x7f22e8157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:36.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22ecb3e700 1 --2- 172.21.15.63:0/975371918 >> v2:172.21.15.155:3300/0 conn(0x7f22e814bea0 0x7f22e8157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:36.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22ecb3e700 1 -- 172.21.15.63:0/975371918 >> v1:172.21.15.63:6789/0 conn(0x7f22e80b1570 legacy=0x7f22e814b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:36.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22ecb3e700 1 -- 172.21.15.63:0/975371918 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e8157870 con 0x7f22e80b7790 2020-05-18T21:37:36.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22ecb3e700 1 --2- 172.21.15.63:0/975371918 >> v2:172.21.15.63:3300/0 conn(0x7f22e80b7790 0x7f22e80b39d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f22d80032f0 tx=0x7f22d8010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22ecb3e700 1 --2- 172.21.15.63:0/975371918 >> v2:172.21.15.63:3300/0 conn(0x7f22e80b7790 0x7f22e80b39d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f22d80032f0 tx=0x7f22d8010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22ecb3e700 1 --2- 172.21.15.63:0/975371918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22e80b7790 0x7f22e80b39d0 secure :-1 s=READY pgs=2018 cs=0 l=1 rx=0x7f22d80032f0 tx=0x7f22d8010db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:36.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22ecb3e700 1 --2- 172.21.15.63:0/975371918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22e80b7790 0x7f22e80b39d0 secure :-1 s=THROTTLE_DONE pgs=2018 cs=0 l=1 rx=0x7f22d80032f0 tx=0x7f22d8010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22ecb3e700 1 --2- 172.21.15.63:0/975371918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22e80b7790 0x7f22e80b39d0 secure :-1 s=THROTTLE_DONE pgs=2018 cs=0 l=1 rx=0x7f22d80032f0 tx=0x7f22d8010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22ecb3e700 1 --2- 172.21.15.63:0/975371918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22e80b7790 0x7f22e80b39d0 secure :-1 s=THROTTLE_DONE pgs=2018 cs=0 l=1 rx=0x7f22d80032f0 tx=0x7f22d8010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22e5ffb700 1 -- 172.21.15.63:0/975371918 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22d8005e70 con 0x7f22e80b7790 2020-05-18T21:37:36.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22e5ffb700 1 -- 172.21.15.63:0/975371918 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d8007560 con 0x7f22e80b7790 2020-05-18T21:37:36.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22e5ffb700 1 -- 172.21.15.63:0/975371918 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22d8007900 con 0x7f22e80b7790 2020-05-18T21:37:36.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22eeda2700 1 -- 172.21.15.63:0/975371918 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e8157b10 con 0x7f22e80b7790 2020-05-18T21:37:36.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.441+0000 7f22eeda2700 1 -- 172.21.15.63:0/975371918 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e811adb0 con 0x7f22e80b7790 2020-05-18T21:37:36.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.445+0000 7f22ecb3e700 1 --2- 172.21.15.63:0/975371918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22e80b7790 0x7f22e80b39d0 secure :-1 s=THROTTLE_DONE pgs=2018 cs=0 l=1 rx=0x7f22d80032f0 tx=0x7f22d8010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.445+0000 7f22eeda2700 1 -- 172.21.15.63:0/975371918 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e80569e0 con 0x7f22e80b7790 2020-05-18T21:37:36.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.445+0000 7f22e5ffb700 1 -- 172.21.15.63:0/975371918 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f22d8008460 con 0x7f22e80b7790 2020-05-18T21:37:36.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.445+0000 7f22ecb3e700 1 --2- 172.21.15.63:0/975371918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22e80b7790 0x7f22e80b39d0 secure :-1 s=THROTTLE_DONE pgs=2018 cs=0 l=1 rx=0x7f22d80032f0 tx=0x7f22d8010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.445+0000 7f22e5ffb700 1 --2- 172.21.15.63:0/975371918 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f22c804fdd0 0x7f22c8052290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:36.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.445+0000 7f22e5ffb700 1 -- 172.21.15.63:0/975371918 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f22d8064020 con 0x7f22e80b7790 2020-05-18T21:37:36.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.445+0000 7f22e7fff700 1 --2- 172.21.15.63:0/975371918 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f22c804fdd0 0x7f22c8052290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:36.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.445+0000 7f22e7fff700 1 --2- 172.21.15.63:0/975371918 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f22c804fdd0 0x7f22c8052290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f22dc001420 tx=0x7f22e805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.445+0000 7f22e7fff700 1 --2- 172.21.15.63:0/975371918 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f22c804fdd0 0x7f22c8052290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f22dc001420 tx=0x7f22e805fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.445+0000 7f22e7fff700 1 --2- 172.21.15.63:0/975371918 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f22c804fdd0 0x7f22c8052290 secure :-1 s=READY pgs=787 cs=0 l=1 rx=0x7f22dc001420 tx=0x7f22e805fa60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:36.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.449+0000 7f22ecb3e700 1 --2- 172.21.15.63:0/975371918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22e80b7790 0x7f22e80b39d0 secure :-1 s=THROTTLE_DONE pgs=2018 cs=0 l=1 rx=0x7f22d80032f0 tx=0x7f22d8010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.449+0000 7f22e5ffb700 1 -- 172.21.15.63:0/975371918 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f22d803e350 con 0x7f22e80b7790 2020-05-18T21:37:36.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.601+0000 7f22eeda2700 1 -- 172.21.15.63:0/975371918 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22e80008d0 con 0x7f22e80b7790 2020-05-18T21:37:36.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.601+0000 7f22ecb3e700 1 --2- 172.21.15.63:0/975371918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22e80b7790 0x7f22e80b39d0 secure :-1 s=THROTTLE_DONE pgs=2018 cs=0 l=1 rx=0x7f22d80032f0 tx=0x7f22d8010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.601+0000 7f22e5ffb700 1 -- 172.21.15.63:0/975371918 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) v1 ==== 95+0+2151 (secure 0 0 0) 0x7f22d8041970 con 0x7f22e80b7790 2020-05-18T21:37:36.609 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:36.609 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":129,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7091,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/1955616817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1955616817},{"type":"v1","addr":"172.21.15.63:6833","nonce":1955616817}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":129}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:18.846766+0000","modified":"2020-05-18T21:37:31.725431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":146,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7097":{"gid":7097,"name":"b","rank":0,"incarnation":125,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/2945312151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2945312151},{"type":"v1","addr":"172.21.15.155:6835","nonce":2945312151}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-05-18T21:37:36.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.605+0000 7f22eeda2700 1 -- 172.21.15.63:0/975371918 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f22c804fdd0 msgr2=0x7f22c8052290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:36.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.605+0000 7f22eeda2700 1 --2- 172.21.15.63:0/975371918 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f22c804fdd0 0x7f22c8052290 secure :-1 s=READY pgs=787 cs=0 l=1 rx=0x7f22dc001420 tx=0x7f22e805fa60).stop 2020-05-18T21:37:36.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.605+0000 7f22eeda2700 1 -- 172.21.15.63:0/975371918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22e80b7790 msgr2=0x7f22e80b39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:36.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.605+0000 7f22eeda2700 1 --2- 172.21.15.63:0/975371918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22e80b7790 0x7f22e80b39d0 secure :-1 s=READY pgs=2018 cs=0 l=1 rx=0x7f22d80032f0 tx=0x7f22d8010db0).stop 2020-05-18T21:37:36.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.605+0000 7f22eeda2700 1 -- 172.21.15.63:0/975371918 shutdown_connections 2020-05-18T21:37:36.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.605+0000 7f22eeda2700 1 --2- 172.21.15.63:0/975371918 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f22c804fdd0 0x7f22c8052290 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:36.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.605+0000 7f22eeda2700 1 --2- 172.21.15.63:0/975371918 >> v2:172.21.15.155:3300/0 conn(0x7f22e814bea0 0x7f22e8157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:36.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.605+0000 7f22eeda2700 1 --2- 172.21.15.63:0/975371918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22e80b7790 0x7f22e80b39d0 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:36.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.605+0000 7f22eeda2700 1 -- 172.21.15.63:0/975371918 >> 172.21.15.63:0/975371918 conn(0x7f22e80b83d0 msgr2=0x7f22e80b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:36.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.605+0000 7f22eeda2700 1 -- 172.21.15.63:0/975371918 shutdown_connections 2020-05-18T21:37:36.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.605+0000 7f22eeda2700 1 -- 172.21.15.63:0/975371918 wait complete. 2020-05-18T21:37:36.613 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 129 2020-05-18T21:37:36.626 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-05-18T21:37:36.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.725+0000 7f04250f0700 1 Processor -- start 2020-05-18T21:37:36.731 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.725+0000 7f04250f0700 1 -- start start 2020-05-18T21:37:36.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.725+0000 7f04250f0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0420065e60 0x7f04200b8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:36.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.725+0000 7f04250f0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04201475a0 0x7f0420147a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:36.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.725+0000 7f04250f0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0420147eb0 con 0x7f04200af830 2020-05-18T21:37:36.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.725+0000 7f04250f0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042014a490 con 0x7f0420065e60 2020-05-18T21:37:36.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.725+0000 7f04250f0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042014a730 con 0x7f04201475a0 2020-05-18T21:37:36.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.725+0000 7f041ed9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0420065e60 0x7f04200b8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:36.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.725+0000 7f041f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04201475a0 0x7f0420147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:36.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.725+0000 7f041e59c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f04200af830 0x7f042014ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:36446/0 (socket says 172.21.15.63:36446) 2020-05-18T21:37:36.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.725+0000 7f041e59c700 1 -- 172.21.15.63:0/3640023285 learned_addr learned my addr 172.21.15.63:0/3640023285 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:36.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.725+0000 7f041dd9b700 1 -- 172.21.15.63:0/3640023285 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798836775 0 0) 0x7f0420147eb0 con 0x7f04200af830 2020-05-18T21:37:36.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.725+0000 7f041dd9b700 1 -- 172.21.15.63:0/3640023285 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0404003270 con 0x7f04200af830 2020-05-18T21:37:36.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f041ed9d700 1 -- 172.21.15.63:0/3640023285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04201475a0 msgr2=0x7f0420147a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:36.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f041ed9d700 1 --2- 172.21.15.63:0/3640023285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04201475a0 0x7f0420147a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:36.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f041ed9d700 1 -- 172.21.15.63:0/3640023285 >> v1:172.21.15.155:6789/0 conn(0x7f04200af830 legacy=0x7f042014ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:36.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f041ed9d700 1 -- 172.21.15.63:0/3640023285 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042014a9d0 con 0x7f0420065e60 2020-05-18T21:37:36.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f041ed9d700 1 --2- 172.21.15.63:0/3640023285 >> v2:172.21.15.155:3300/0 conn(0x7f0420065e60 0x7f04200b8f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0410002f70 tx=0x7f0410007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f041ed9d700 1 --2- 172.21.15.63:0/3640023285 >> v2:172.21.15.155:3300/0 conn(0x7f0420065e60 0x7f04200b8f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0410002f70 tx=0x7f0410007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f041ed9d700 1 --2- 172.21.15.63:0/3640023285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0420065e60 0x7f04200b8f10 secure :-1 s=READY pgs=1336 cs=0 l=1 rx=0x7f0410002f70 tx=0x7f0410007a80).ready entity=mon.1 client_cookie=da5ba49c03bc565 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:36.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f041ed9d700 1 --2- 172.21.15.63:0/3640023285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0420065e60 0x7f04200b8f10 secure :-1 s=THROTTLE_DONE pgs=1336 cs=0 l=1 rx=0x7f0410002f70 tx=0x7f0410007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f041dd9b700 1 -- 172.21.15.63:0/3640023285 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0410008e80 con 0x7f0420065e60 2020-05-18T21:37:36.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f041ed9d700 1 --2- 172.21.15.63:0/3640023285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0420065e60 0x7f04200b8f10 secure :-1 s=THROTTLE_DONE pgs=1336 cs=0 l=1 rx=0x7f0410002f70 tx=0x7f0410007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f041ed9d700 1 --2- 172.21.15.63:0/3640023285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0420065e60 0x7f04200b8f10 secure :-1 s=THROTTLE_DONE pgs=1336 cs=0 l=1 rx=0x7f0410002f70 tx=0x7f0410007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f041dd9b700 1 -- 172.21.15.63:0/3640023285 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0410011540 con 0x7f0420065e60 2020-05-18T21:37:36.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f041dd9b700 1 -- 172.21.15.63:0/3640023285 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0410011960 con 0x7f0420065e60 2020-05-18T21:37:36.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f04250f0700 1 -- 172.21.15.63:0/3640023285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0420065e60 msgr2=0x7f04200b8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:36.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f04250f0700 1 --2- 172.21.15.63:0/3640023285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0420065e60 0x7f04200b8f10 secure :-1 s=READY pgs=1336 cs=0 l=1 rx=0x7f0410002f70 tx=0x7f0410007a80).stop 2020-05-18T21:37:36.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f04250f0700 1 -- 172.21.15.63:0/3640023285 shutdown_connections 2020-05-18T21:37:36.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f04250f0700 1 --2- 172.21.15.63:0/3640023285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04201475a0 0x7f0420147a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:36.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f04250f0700 1 --2- 172.21.15.63:0/3640023285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0420065e60 0x7f04200b8f10 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f04250f0700 1 -- 172.21.15.63:0/3640023285 >> 172.21.15.63:0/3640023285 conn(0x7f04200b83f0 msgr2=0x7f04200b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f04250f0700 1 -- 172.21.15.63:0/3640023285 shutdown_connections 2020-05-18T21:37:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f04250f0700 1 -- 172.21.15.63:0/3640023285 wait complete. 2020-05-18T21:37:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f04250f0700 1 Processor -- start 2020-05-18T21:37:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.729+0000 7f04250f0700 1 -- start start 2020-05-18T21:37:36.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f04250f0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f04200af830 0x7f0420064d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:36.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f04250f0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04201475a0 0x7f0420061fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:36.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f04250f0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0420062430 con 0x7f0420065e60 2020-05-18T21:37:36.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f04250f0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04200626b0 con 0x7f04200af830 2020-05-18T21:37:36.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f04250f0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04200629c0 con 0x7f04201475a0 2020-05-18T21:37:36.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f041f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04201475a0 0x7f0420061fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:36.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f041e59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f04200af830 0x7f0420064d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:36.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f041f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04201475a0 0x7f0420061fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:54886/0 (socket says 172.21.15.63:54886) 2020-05-18T21:37:36.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f041f59e700 1 -- 172.21.15.63:0/2131558760 learned_addr learned my addr 172.21.15.63:0/2131558760 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:36.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f041e59c700 1 -- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04201475a0 msgr2=0x7f0420061fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:36.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f041e59c700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04201475a0 0x7f0420061fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:36.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f041e59c700 1 -- 172.21.15.63:0/2131558760 >> v1:172.21.15.155:6789/0 conn(0x7f0420065e60 legacy=0x7f0420144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:36.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f040ffff700 1 -- 172.21.15.63:0/2131558760 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566481591 0 0) 0x7f0420062430 con 0x7f0420065e60 2020-05-18T21:37:36.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f041e59c700 1 -- 172.21.15.63:0/2131558760 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0420062c60 con 0x7f04200af830 2020-05-18T21:37:36.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f041e59c700 1 --2- 172.21.15.63:0/2131558760 >> v2:172.21.15.155:3300/0 conn(0x7f04200af830 0x7f0420064d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0414001110 tx=0x7f04140108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f041e59c700 1 --2- 172.21.15.63:0/2131558760 >> v2:172.21.15.155:3300/0 conn(0x7f04200af830 0x7f0420064d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0414001110 tx=0x7f04140108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f041e59c700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04200af830 0x7f0420064d80 secure :-1 s=READY pgs=1338 cs=0 l=1 rx=0x7f0414001110 tx=0x7f04140108f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:36.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f041e59c700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04200af830 0x7f0420064d80 secure :-1 s=THROTTLE_DONE pgs=1338 cs=0 l=1 rx=0x7f0414001110 tx=0x7f04140108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f040ffff700 1 -- 172.21.15.63:0/2131558760 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0414005d00 con 0x7f04200af830 2020-05-18T21:37:36.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f04250f0700 1 -- 172.21.15.63:0/2131558760 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0420145150 con 0x7f04200af830 2020-05-18T21:37:36.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f041e59c700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04200af830 0x7f0420064d80 secure :-1 s=THROTTLE_DONE pgs=1338 cs=0 l=1 rx=0x7f0414001110 tx=0x7f04140108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f040ffff700 1 -- 172.21.15.63:0/2131558760 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0414005e60 con 0x7f04200af830 2020-05-18T21:37:36.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f041e59c700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04200af830 0x7f0420064d80 secure :-1 s=THROTTLE_DONE pgs=1338 cs=0 l=1 rx=0x7f0414001110 tx=0x7f04140108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f040ffff700 1 -- 172.21.15.63:0/2131558760 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04140062c0 con 0x7f04200af830 2020-05-18T21:37:36.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f04250f0700 1 -- 172.21.15.63:0/2131558760 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042005fc90 con 0x7f04200af830 2020-05-18T21:37:36.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.733+0000 7f04250f0700 1 -- 172.21.15.63:0/2131558760 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04200569e0 con 0x7f04200af830 2020-05-18T21:37:36.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.737+0000 7f041e59c700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04200af830 0x7f0420064d80 secure :-1 s=THROTTLE_DONE pgs=1338 cs=0 l=1 rx=0x7f0414001110 tx=0x7f04140108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.737+0000 7f040ffff700 1 -- 172.21.15.63:0/2131558760 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f04140064c0 con 0x7f04200af830 2020-05-18T21:37:36.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.737+0000 7f041e59c700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04200af830 0x7f0420064d80 secure :-1 s=THROTTLE_DONE pgs=1338 cs=0 l=1 rx=0x7f0414001110 tx=0x7f04140108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.737+0000 7f040ffff700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f03fc04f840 0x7f03fc051d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:36.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.737+0000 7f040ffff700 1 -- 172.21.15.63:0/2131558760 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f04140090c0 con 0x7f04200af830 2020-05-18T21:37:36.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.737+0000 7f041ed9d700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f03fc04f840 0x7f03fc051d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:36.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.737+0000 7f041ed9d700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f03fc04f840 0x7f03fc051d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0410008920 tx=0x7f0410007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.737+0000 7f041ed9d700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f03fc04f840 0x7f03fc051d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0410008920 tx=0x7f0410007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.737+0000 7f041ed9d700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f03fc04f840 0x7f03fc051d00 secure :-1 s=READY pgs=788 cs=0 l=1 rx=0x7f0410008920 tx=0x7f0410007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:36.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.745+0000 7f041e59c700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04200af830 0x7f0420064d80 secure :-1 s=THROTTLE_DONE pgs=1338 cs=0 l=1 rx=0x7f0414001110 tx=0x7f04140108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:36.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.745+0000 7f040ffff700 1 -- 172.21.15.63:0/2131558760 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f041403e2b0 con 0x7f04200af830 2020-05-18T21:37:36.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:36.897+0000 7f04250f0700 1 -- 172.21.15.63:0/2131558760 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f04200b8130 con 0x7f04200af830 2020-05-18T21:37:37.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.733+0000 7f041e59c700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04200af830 0x7f0420064d80 secure :-1 s=READY pgs=1338 cs=0 l=1 rx=0x7f0414001110 tx=0x7f04140108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:37.800 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:37:37.793+0000 7fdb4592c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:37:37.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.809+0000 7f041e59c700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04200af830 0x7f0420064d80 secure :-1 s=THROTTLE_DONE pgs=1338 cs=0 l=1 rx=0x7f0414001110 tx=0x7f04140108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:37.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.809+0000 7f040ffff700 1 -- 172.21.15.63:0/2131558760 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v130) v1 ==== 161+0+0 (secure 0 0 0) 0x7f04140418d0 con 0x7f04200af830 2020-05-18T21:37:37.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.813+0000 7f04250f0700 1 -- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f03fc04f840 msgr2=0x7f03fc051d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:37.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.813+0000 7f04250f0700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f03fc04f840 0x7f03fc051d00 secure :-1 s=READY pgs=788 cs=0 l=1 rx=0x7f0410008920 tx=0x7f0410007a80).stop 2020-05-18T21:37:37.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.813+0000 7f04250f0700 1 -- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04200af830 msgr2=0x7f0420064d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:37.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.813+0000 7f04250f0700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04200af830 0x7f0420064d80 secure :-1 s=READY pgs=1338 cs=0 l=1 rx=0x7f0414001110 tx=0x7f04140108f0).stop 2020-05-18T21:37:37.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.813+0000 7f04250f0700 1 -- 172.21.15.63:0/2131558760 shutdown_connections 2020-05-18T21:37:37.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.813+0000 7f04250f0700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f03fc04f840 0x7f03fc051d00 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:37.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.813+0000 7f04250f0700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04201475a0 0x7f0420061fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:37.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.813+0000 7f04250f0700 1 --2- 172.21.15.63:0/2131558760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04200af830 0x7f0420064d80 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:37.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.813+0000 7f04250f0700 1 -- 172.21.15.63:0/2131558760 >> 172.21.15.63:0/2131558760 conn(0x7f04200b83f0 msgr2=0x7f04200b76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:37.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.813+0000 7f04250f0700 1 -- 172.21.15.63:0/2131558760 shutdown_connections 2020-05-18T21:37:37.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.813+0000 7f04250f0700 1 -- 172.21.15.63:0/2131558760 wait complete. 2020-05-18T21:37:37.821 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-05-18T21:37:37.834 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:37.839 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:37:37.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.933+0000 7f6af2882700 1 Processor -- start 2020-05-18T21:37:37.940 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.933+0000 7f6af2882700 1 -- start start 2020-05-18T21:37:37.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.933+0000 7f6af2882700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6aec05f110 0x7f6aec0b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:37.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.933+0000 7f6af2882700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6aec064fd0 0x7f6aec14d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:37.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.933+0000 7f6af2882700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec14a330 con 0x7f6aec14aa70 2020-05-18T21:37:37.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.933+0000 7f6af2882700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aec14a140 con 0x7f6aec05f110 2020-05-18T21:37:37.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.933+0000 7f6af2882700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec065460 con 0x7f6aec064fd0 2020-05-18T21:37:37.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af1880700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6aec05f110 0x7f6aec0b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:37.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af2081700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6aec064fd0 0x7f6aec14d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:37.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af107f700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f6aec14aa70 0x7f6aec0648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:36460/0 (socket says 172.21.15.63:36460) 2020-05-18T21:37:37.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af107f700 1 -- 172.21.15.63:0/290916017 learned_addr learned my addr 172.21.15.63:0/290916017 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:37.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af087e700 1 -- 172.21.15.63:0/290916017 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652647201 0 0) 0x7f6aec14a330 con 0x7f6aec14aa70 2020-05-18T21:37:37.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af087e700 1 -- 172.21.15.63:0/290916017 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ad4003270 con 0x7f6aec14aa70 2020-05-18T21:37:37.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af2081700 1 -- 172.21.15.63:0/290916017 >> v2:172.21.15.155:3300/0 conn(0x7f6aec05f110 msgr2=0x7f6aec0b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:37.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af2081700 1 --2- 172.21.15.63:0/290916017 >> v2:172.21.15.155:3300/0 conn(0x7f6aec05f110 0x7f6aec0b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:37.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af2081700 1 -- 172.21.15.63:0/290916017 >> v1:172.21.15.155:6789/0 conn(0x7f6aec14aa70 legacy=0x7f6aec0648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:37.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af2081700 1 -- 172.21.15.63:0/290916017 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec14a5d0 con 0x7f6aec064fd0 2020-05-18T21:37:37.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af2081700 1 --2- 172.21.15.63:0/290916017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6aec064fd0 0x7f6aec14d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ae40032f0 tx=0x7f6ae4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:37.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af2081700 1 --2- 172.21.15.63:0/290916017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6aec064fd0 0x7f6aec14d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ae40032f0 tx=0x7f6ae4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:37.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af2081700 1 --2- 172.21.15.63:0/290916017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6aec064fd0 0x7f6aec14d710 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7f6ae40032f0 tx=0x7f6ae4007e00).ready entity=mon.2 client_cookie=1b3a60453e23c22c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:37.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af2081700 1 --2- 172.21.15.63:0/290916017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6aec064fd0 0x7f6aec14d710 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f6ae40032f0 tx=0x7f6ae4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:37.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af087e700 1 -- 172.21.15.63:0/290916017 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ae4011db0 con 0x7f6aec064fd0 2020-05-18T21:37:37.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af2081700 1 --2- 172.21.15.63:0/290916017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6aec064fd0 0x7f6aec14d710 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f6ae40032f0 tx=0x7f6ae4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:37.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af2081700 1 --2- 172.21.15.63:0/290916017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6aec064fd0 0x7f6aec14d710 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f6ae40032f0 tx=0x7f6ae4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:37.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af087e700 1 -- 172.21.15.63:0/290916017 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae400a180 con 0x7f6aec064fd0 2020-05-18T21:37:37.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af087e700 1 -- 172.21.15.63:0/290916017 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ae400a520 con 0x7f6aec064fd0 2020-05-18T21:37:37.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af2882700 1 -- 172.21.15.63:0/290916017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6aec064fd0 msgr2=0x7f6aec14d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:37.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af2882700 1 --2- 172.21.15.63:0/290916017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6aec064fd0 0x7f6aec14d710 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7f6ae40032f0 tx=0x7f6ae4007e00).stop 2020-05-18T21:37:37.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af2882700 1 -- 172.21.15.63:0/290916017 shutdown_connections 2020-05-18T21:37:37.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af2882700 1 --2- 172.21.15.63:0/290916017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6aec064fd0 0x7f6aec14d710 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:37.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af2882700 1 --2- 172.21.15.63:0/290916017 >> v2:172.21.15.155:3300/0 conn(0x7f6aec05f110 0x7f6aec0b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:37.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af2882700 1 -- 172.21.15.63:0/290916017 >> 172.21.15.63:0/290916017 conn(0x7f6aec069fc0 msgr2=0x7f6aec06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:37.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af2882700 1 -- 172.21.15.63:0/290916017 shutdown_connections 2020-05-18T21:37:37.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.937+0000 7f6af2882700 1 -- 172.21.15.63:0/290916017 wait complete. 2020-05-18T21:37:37.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.941+0000 7f6af2882700 1 Processor -- start 2020-05-18T21:37:37.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.941+0000 7f6af2882700 1 -- start start 2020-05-18T21:37:37.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.941+0000 7f6af2882700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6aec05f110 0x7f6aec158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:37.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.941+0000 7f6af2882700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6aec064fd0 0x7f6aec13ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:37.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.941+0000 7f6af2882700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec1413b0 con 0x7f6aec14aa70 2020-05-18T21:37:37.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.941+0000 7f6af2882700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aec158630 con 0x7f6aec064fd0 2020-05-18T21:37:37.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.941+0000 7f6af2882700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec141650 con 0x7f6aec05f110 2020-05-18T21:37:37.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.941+0000 7f6af2081700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6aec14aa70 0x7f6aec13a280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38154/0 (socket says 172.21.15.63:38154) 2020-05-18T21:37:37.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.941+0000 7f6af2081700 1 -- 172.21.15.63:0/479637971 learned_addr learned my addr 172.21.15.63:0/479637971 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:37.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.941+0000 7f6af1880700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6aec05f110 0x7f6aec158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:37.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.941+0000 7f6af107f700 1 --2- 172.21.15.63:0/479637971 >> v2:172.21.15.155:3300/0 conn(0x7f6aec064fd0 0x7f6aec13ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:37.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.941+0000 7f6adeffd700 1 -- 172.21.15.63:0/479637971 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074902492 0 0) 0x7f6aec1413b0 con 0x7f6aec14aa70 2020-05-18T21:37:37.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.941+0000 7f6adeffd700 1 -- 172.21.15.63:0/479637971 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6acc002fe0 con 0x7f6aec14aa70 2020-05-18T21:37:37.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.941+0000 7f6af107f700 1 -- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6aec05f110 msgr2=0x7f6aec158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:37.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.941+0000 7f6af107f700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6aec05f110 0x7f6aec158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:37.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.941+0000 7f6af107f700 1 -- 172.21.15.63:0/479637971 >> v1:172.21.15.63:6789/0 conn(0x7f6aec14aa70 legacy=0x7f6aec13a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:37.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.941+0000 7f6af107f700 1 -- 172.21.15.63:0/479637971 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec140120 con 0x7f6aec064fd0 2020-05-18T21:37:37.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.941+0000 7f6af107f700 1 --2- 172.21.15.63:0/479637971 >> v2:172.21.15.155:3300/0 conn(0x7f6aec064fd0 0x7f6aec13ada0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ae0001110 tx=0x7f6ae0010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:37.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6af107f700 1 --2- 172.21.15.63:0/479637971 >> v2:172.21.15.155:3300/0 conn(0x7f6aec064fd0 0x7f6aec13ada0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ae0001110 tx=0x7f6ae0010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:37.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6af107f700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6aec064fd0 0x7f6aec13ada0 secure :-1 s=READY pgs=1342 cs=0 l=1 rx=0x7f6ae0001110 tx=0x7f6ae0010930).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:37.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6af107f700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6aec064fd0 0x7f6aec13ada0 secure :-1 s=THROTTLE_DONE pgs=1342 cs=0 l=1 rx=0x7f6ae0001110 tx=0x7f6ae0010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:37.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6adeffd700 1 -- 172.21.15.63:0/479637971 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ae0005d00 con 0x7f6aec064fd0 2020-05-18T21:37:37.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6af107f700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6aec064fd0 0x7f6aec13ada0 secure :-1 s=THROTTLE_DONE pgs=1342 cs=0 l=1 rx=0x7f6ae0001110 tx=0x7f6ae0010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:37.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6adeffd700 1 -- 172.21.15.63:0/479637971 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae0005e60 con 0x7f6aec064fd0 2020-05-18T21:37:37.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6af107f700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6aec064fd0 0x7f6aec13ada0 secure :-1 s=THROTTLE_DONE pgs=1342 cs=0 l=1 rx=0x7f6ae0001110 tx=0x7f6ae0010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:37.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6af2882700 1 -- 172.21.15.63:0/479637971 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aec13a990 con 0x7f6aec064fd0 2020-05-18T21:37:37.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6adeffd700 1 -- 172.21.15.63:0/479637971 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ae00062c0 con 0x7f6aec064fd0 2020-05-18T21:37:37.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6af2882700 1 -- 172.21.15.63:0/479637971 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aec13b3a0 con 0x7f6aec064fd0 2020-05-18T21:37:37.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6af107f700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6aec064fd0 0x7f6aec13ada0 secure :-1 s=THROTTLE_DONE pgs=1342 cs=0 l=1 rx=0x7f6ae0001110 tx=0x7f6ae0010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:37.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6af107f700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6aec064fd0 0x7f6aec13ada0 secure :-1 s=THROTTLE_DONE pgs=1342 cs=0 l=1 rx=0x7f6ae0001110 tx=0x7f6ae0010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:37.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6af2882700 1 -- 172.21.15.63:0/479637971 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aec0569e0 con 0x7f6aec064fd0 2020-05-18T21:37:37.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6adeffd700 1 -- 172.21.15.63:0/479637971 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6ae0006580 con 0x7f6aec064fd0 2020-05-18T21:37:37.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6adeffd700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6acc04fd00 0x7f6acc0521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:37.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6adeffd700 1 -- 172.21.15.63:0/479637971 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f6ae00090c0 con 0x7f6aec064fd0 2020-05-18T21:37:37.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6af1880700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6acc04fd00 0x7f6acc0521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:37.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6af1880700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6acc04fd00 0x7f6acc0521c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ae8002f70 tx=0x7f6ae800d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:37.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6af1880700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6acc04fd00 0x7f6acc0521c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ae8002f70 tx=0x7f6ae800d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:37.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.945+0000 7f6af1880700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6acc04fd00 0x7f6acc0521c0 secure :-1 s=READY pgs=789 cs=0 l=1 rx=0x7f6ae8002f70 tx=0x7f6ae800d8f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:37.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.953+0000 7f6af107f700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6aec064fd0 0x7f6aec13ada0 secure :-1 s=THROTTLE_DONE pgs=1342 cs=0 l=1 rx=0x7f6ae0001110 tx=0x7f6ae0010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:37.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:37.953+0000 7f6adeffd700 1 -- 172.21.15.63:0/479637971 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6ae003e050 con 0x7f6aec064fd0 2020-05-18T21:37:38.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.105+0000 7f6af2882700 1 -- 172.21.15.63:0/479637971 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6aec1417c0 con 0x7f6aec064fd0 2020-05-18T21:37:38.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.105+0000 7f6af107f700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6aec064fd0 0x7f6aec13ada0 secure :-1 s=THROTTLE_DONE pgs=1342 cs=0 l=1 rx=0x7f6ae0001110 tx=0x7f6ae0010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:38.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.105+0000 7f6adeffd700 1 -- 172.21.15.63:0/479637971 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) v1 ==== 95+0+1785 (secure 0 0 0) 0x7f6ae0041670 con 0x7f6aec064fd0 2020-05-18T21:37:38.113 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:38.115 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":130,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7091,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/1955616817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1955616817},{"type":"v1","addr":"172.21.15.63:6833","nonce":1955616817}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":129}],"filesystems":[{"mdsmap":{"epoch":130,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:18.846766+0000","modified":"2020-05-18T21:37:37.798119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":148,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-05-18T21:37:38.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.109+0000 7f6af2882700 1 -- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6acc04fd00 msgr2=0x7f6acc0521c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:38.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.109+0000 7f6af2882700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6acc04fd00 0x7f6acc0521c0 secure :-1 s=READY pgs=789 cs=0 l=1 rx=0x7f6ae8002f70 tx=0x7f6ae800d8f0).stop 2020-05-18T21:37:38.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.109+0000 7f6af2882700 1 -- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6aec064fd0 msgr2=0x7f6aec13ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:38.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.109+0000 7f6af2882700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6aec064fd0 0x7f6aec13ada0 secure :-1 s=READY pgs=1342 cs=0 l=1 rx=0x7f6ae0001110 tx=0x7f6ae0010930).stop 2020-05-18T21:37:38.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.109+0000 7f6af2882700 1 -- 172.21.15.63:0/479637971 shutdown_connections 2020-05-18T21:37:38.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.109+0000 7f6af2882700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6acc04fd00 0x7f6acc0521c0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:38.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.109+0000 7f6af2882700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6aec064fd0 0x7f6aec13ada0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:38.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.109+0000 7f6af2882700 1 --2- 172.21.15.63:0/479637971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6aec05f110 0x7f6aec158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:38.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.109+0000 7f6af2882700 1 -- 172.21.15.63:0/479637971 >> 172.21.15.63:0/479637971 conn(0x7f6aec069fc0 msgr2=0x7f6aec14d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:38.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.109+0000 7f6af2882700 1 -- 172.21.15.63:0/479637971 shutdown_connections 2020-05-18T21:37:38.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.109+0000 7f6af2882700 1 -- 172.21.15.63:0/479637971 wait complete. 2020-05-18T21:37:38.119 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 130 2020-05-18T21:37:38.126 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-05-18T21:37:38.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.229+0000 7fdad8b16700 1 Processor -- start 2020-05-18T21:37:38.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.229+0000 7fdad8b16700 1 -- start start 2020-05-18T21:37:38.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.229+0000 7fdad8b16700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdad41473d0 0x7fdad41477b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:38.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.229+0000 7fdad8b16700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdad4143ac0 0x7fdad4143f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:38.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.229+0000 7fdad8b16700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad4147f50 con 0x7fdad40b5870 2020-05-18T21:37:38.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.229+0000 7fdad8b16700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad4147d40 con 0x7fdad4143ac0 2020-05-18T21:37:38.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.229+0000 7fdad8b16700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad4065490 con 0x7fdad41473d0 2020-05-18T21:37:38.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.229+0000 7fdad3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdad4143ac0 0x7fdad4143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:38.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.229+0000 7fdad37fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdad41473d0 0x7fdad41477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:38.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.229+0000 7fdad3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdad4143ac0 0x7fdad4143f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:50818/0 (socket says 172.21.15.63:50818) 2020-05-18T21:37:38.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.229+0000 7fdad3fff700 1 -- 172.21.15.63:0/916196053 learned_addr learned my addr 172.21.15.63:0/916196053 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:38.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.229+0000 7fdad3fff700 1 -- 172.21.15.63:0/916196053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdad41473d0 msgr2=0x7fdad41477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:38.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.229+0000 7fdad3fff700 1 --2- 172.21.15.63:0/916196053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdad41473d0 0x7fdad41477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:38.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.229+0000 7fdad3fff700 1 -- 172.21.15.63:0/916196053 >> v1:172.21.15.155:6789/0 conn(0x7fdad40b5870 legacy=0x7fdad413d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:38.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.229+0000 7fdad3fff700 1 -- 172.21.15.63:0/916196053 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad40633b0 con 0x7fdad4143ac0 2020-05-18T21:37:38.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.229+0000 7fdad37fe700 1 --2- 172.21.15.63:0/916196053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdad41473d0 0x7fdad41477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:38.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.229+0000 7fdad3fff700 1 --2- 172.21.15.63:0/916196053 >> v2:172.21.15.155:3300/0 conn(0x7fdad4143ac0 0x7fdad4143f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdacc0032f0 tx=0x7fdacc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:38.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.233+0000 7fdad3fff700 1 --2- 172.21.15.63:0/916196053 >> v2:172.21.15.155:3300/0 conn(0x7fdad4143ac0 0x7fdad4143f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdacc0032f0 tx=0x7fdacc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:38.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.233+0000 7fdad3fff700 1 --2- 172.21.15.63:0/916196053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdad4143ac0 0x7fdad4143f50 secure :-1 s=READY pgs=1344 cs=0 l=1 rx=0x7fdacc0032f0 tx=0x7fdacc007e00).ready entity=mon.1 client_cookie=ec771103c8237a33 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:38.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.233+0000 7fdad3fff700 1 --2- 172.21.15.63:0/916196053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdad4143ac0 0x7fdad4143f50 secure :-1 s=THROTTLE_DONE pgs=1344 cs=0 l=1 rx=0x7fdacc0032f0 tx=0x7fdacc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:38.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.233+0000 7fdad2ffd700 1 -- 172.21.15.63:0/916196053 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdacc011d10 con 0x7fdad4143ac0 2020-05-18T21:37:38.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.233+0000 7fdad3fff700 1 --2- 172.21.15.63:0/916196053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdad4143ac0 0x7fdad4143f50 secure :-1 s=THROTTLE_DONE pgs=1344 cs=0 l=1 rx=0x7fdacc0032f0 tx=0x7fdacc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:38.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.233+0000 7fdad3fff700 1 --2- 172.21.15.63:0/916196053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdad4143ac0 0x7fdad4143f50 secure :-1 s=THROTTLE_DONE pgs=1344 cs=0 l=1 rx=0x7fdacc0032f0 tx=0x7fdacc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:38.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.233+0000 7fdad2ffd700 1 -- 172.21.15.63:0/916196053 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc011e70 con 0x7fdad4143ac0 2020-05-18T21:37:38.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.233+0000 7fdad2ffd700 1 -- 172.21.15.63:0/916196053 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdacc00a370 con 0x7fdad4143ac0 2020-05-18T21:37:38.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.233+0000 7fdad8b16700 1 -- 172.21.15.63:0/916196053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdad4143ac0 msgr2=0x7fdad4143f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:38.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.233+0000 7fdad8b16700 1 --2- 172.21.15.63:0/916196053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdad4143ac0 0x7fdad4143f50 secure :-1 s=READY pgs=1344 cs=0 l=1 rx=0x7fdacc0032f0 tx=0x7fdacc007e00).stop 2020-05-18T21:37:38.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.233+0000 7fdad8b16700 1 -- 172.21.15.63:0/916196053 shutdown_connections 2020-05-18T21:37:38.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.233+0000 7fdad8b16700 1 --2- 172.21.15.63:0/916196053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdad4143ac0 0x7fdad4143f50 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:38.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.233+0000 7fdad8b16700 1 --2- 172.21.15.63:0/916196053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdad41473d0 0x7fdad41477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:38.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.233+0000 7fdad8b16700 1 -- 172.21.15.63:0/916196053 >> 172.21.15.63:0/916196053 conn(0x7fdad4069b70 msgr2=0x7fdad4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:38.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.233+0000 7fdad8b16700 1 -- 172.21.15.63:0/916196053 shutdown_connections 2020-05-18T21:37:38.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.233+0000 7fdad8b16700 1 -- 172.21.15.63:0/916196053 wait complete. 2020-05-18T21:37:38.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.233+0000 7fdad8b16700 1 Processor -- start 2020-05-18T21:37:38.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.233+0000 7fdad8b16700 1 -- start start 2020-05-18T21:37:38.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad8b16700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdad40b5870 0x7fdad40b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:38.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad8b16700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdad4143ac0 0x7fdad4154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:38.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad8b16700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad4155440 con 0x7fdad41473d0 2020-05-18T21:37:38.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad8b16700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad40b7b80 con 0x7fdad40b5870 2020-05-18T21:37:38.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad8b16700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad40b7e20 con 0x7fdad4143ac0 2020-05-18T21:37:38.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad37fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdad40b5870 0x7fdad40b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:38.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad37fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdad40b5870 0x7fdad40b82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35974/0 (socket says 172.21.15.63:35974) 2020-05-18T21:37:38.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad37fe700 1 -- 172.21.15.63:0/140182194 learned_addr learned my addr 172.21.15.63:0/140182194 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:38.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdacbfff700 1 --2- 172.21.15.63:0/140182194 >> v2:172.21.15.155:3300/0 conn(0x7fdad4143ac0 0x7fdad4154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:38.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad37fe700 1 -- 172.21.15.63:0/140182194 >> v2:172.21.15.155:3300/0 conn(0x7fdad4143ac0 msgr2=0x7fdad4154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:38.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad37fe700 1 --2- 172.21.15.63:0/140182194 >> v2:172.21.15.155:3300/0 conn(0x7fdad4143ac0 0x7fdad4154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:38.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad37fe700 1 -- 172.21.15.63:0/140182194 >> v1:172.21.15.155:6789/0 conn(0x7fdad41473d0 legacy=0x7fdad412c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:38.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad17fa700 1 -- 172.21.15.63:0/140182194 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309028765 0 0) 0x7fdad4155440 con 0x7fdad41473d0 2020-05-18T21:37:38.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad37fe700 1 -- 172.21.15.63:0/140182194 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad40b8720 con 0x7fdad40b5870 2020-05-18T21:37:38.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad37fe700 1 --2- 172.21.15.63:0/140182194 >> v2:172.21.15.63:3300/0 conn(0x7fdad40b5870 0x7fdad40b82c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdac4002f30 tx=0x7fdac4010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:38.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad37fe700 1 --2- 172.21.15.63:0/140182194 >> v2:172.21.15.63:3300/0 conn(0x7fdad40b5870 0x7fdad40b82c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdac4002f30 tx=0x7fdac4010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:38.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad37fe700 1 --2- 172.21.15.63:0/140182194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdad40b5870 0x7fdad40b82c0 secure :-1 s=READY pgs=2022 cs=0 l=1 rx=0x7fdac4002f30 tx=0x7fdac4010ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:38.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad37fe700 1 --2- 172.21.15.63:0/140182194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdad40b5870 0x7fdad40b82c0 secure :-1 s=THROTTLE_DONE pgs=2022 cs=0 l=1 rx=0x7fdac4002f30 tx=0x7fdac4010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:38.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad17fa700 1 -- 172.21.15.63:0/140182194 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdac4005e80 con 0x7fdad40b5870 2020-05-18T21:37:38.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad37fe700 1 --2- 172.21.15.63:0/140182194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdad40b5870 0x7fdad40b82c0 secure :-1 s=THROTTLE_DONE pgs=2022 cs=0 l=1 rx=0x7fdac4002f30 tx=0x7fdac4010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:38.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad17fa700 1 -- 172.21.15.63:0/140182194 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac4007180 con 0x7fdad40b5870 2020-05-18T21:37:38.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad37fe700 1 --2- 172.21.15.63:0/140182194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdad40b5870 0x7fdad40b82c0 secure :-1 s=THROTTLE_DONE pgs=2022 cs=0 l=1 rx=0x7fdac4002f30 tx=0x7fdac4010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:38.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad8b16700 1 -- 172.21.15.63:0/140182194 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad413e7a0 con 0x7fdad40b5870 2020-05-18T21:37:38.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad17fa700 1 -- 172.21.15.63:0/140182194 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdac4007560 con 0x7fdad40b5870 2020-05-18T21:37:38.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad8b16700 1 -- 172.21.15.63:0/140182194 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad4141030 con 0x7fdad40b5870 2020-05-18T21:37:38.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad37fe700 1 --2- 172.21.15.63:0/140182194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdad40b5870 0x7fdad40b82c0 secure :-1 s=THROTTLE_DONE pgs=2022 cs=0 l=1 rx=0x7fdac4002f30 tx=0x7fdac4010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:38.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.237+0000 7fdad8b16700 1 -- 172.21.15.63:0/140182194 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad4155290 con 0x7fdad40b5870 2020-05-18T21:37:38.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.241+0000 7fdad17fa700 1 -- 172.21.15.63:0/140182194 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fdac40101a0 con 0x7fdad40b5870 2020-05-18T21:37:38.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.241+0000 7fdad37fe700 1 --2- 172.21.15.63:0/140182194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdad40b5870 0x7fdad40b82c0 secure :-1 s=THROTTLE_DONE pgs=2022 cs=0 l=1 rx=0x7fdac4002f30 tx=0x7fdac4010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:38.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.241+0000 7fdad17fa700 1 --2- 172.21.15.63:0/140182194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdaac04f7d0 0x7fdaac051c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:38.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.241+0000 7fdad17fa700 1 -- 172.21.15.63:0/140182194 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fdac4063ee0 con 0x7fdad40b5870 2020-05-18T21:37:38.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.241+0000 7fdacbfff700 1 --2- 172.21.15.63:0/140182194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdaac04f7d0 0x7fdaac051c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:38.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.241+0000 7fdacbfff700 1 --2- 172.21.15.63:0/140182194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdaac04f7d0 0x7fdaac051c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdad40b5620 tx=0x7fdabc001450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:38.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.241+0000 7fdacbfff700 1 --2- 172.21.15.63:0/140182194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdaac04f7d0 0x7fdaac051c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdad40b5620 tx=0x7fdabc001450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:38.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.241+0000 7fdacbfff700 1 --2- 172.21.15.63:0/140182194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdaac04f7d0 0x7fdaac051c90 secure :-1 s=READY pgs=790 cs=0 l=1 rx=0x7fdad40b5620 tx=0x7fdabc001450).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:38.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.245+0000 7fdad37fe700 1 --2- 172.21.15.63:0/140182194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdad40b5870 0x7fdad40b82c0 secure :-1 s=THROTTLE_DONE pgs=2022 cs=0 l=1 rx=0x7fdac4002f30 tx=0x7fdac4010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:38.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.245+0000 7fdad17fa700 1 -- 172.21.15.63:0/140182194 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fdac403e270 con 0x7fdad40b5870 2020-05-18T21:37:38.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.393+0000 7fdad8b16700 1 -- 172.21.15.63:0/140182194 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdad40569e0 con 0x7fdad40b5870 2020-05-18T21:37:38.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.913+0000 7fdad37fe700 1 --2- 172.21.15.63:0/140182194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdad40b5870 0x7fdad40b82c0 secure :-1 s=THROTTLE_DONE pgs=2022 cs=0 l=1 rx=0x7fdac4002f30 tx=0x7fdac4010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:38.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.913+0000 7fdad17fa700 1 -- 172.21.15.63:0/140182194 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v131) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdac4041890 con 0x7fdad40b5870 2020-05-18T21:37:38.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.917+0000 7fdad8b16700 1 -- 172.21.15.63:0/140182194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdaac04f7d0 msgr2=0x7fdaac051c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:38.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.917+0000 7fdad8b16700 1 --2- 172.21.15.63:0/140182194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdaac04f7d0 0x7fdaac051c90 secure :-1 s=READY pgs=790 cs=0 l=1 rx=0x7fdad40b5620 tx=0x7fdabc001450).stop 2020-05-18T21:37:38.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.917+0000 7fdad8b16700 1 -- 172.21.15.63:0/140182194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdad40b5870 msgr2=0x7fdad40b82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:38.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.917+0000 7fdad8b16700 1 --2- 172.21.15.63:0/140182194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdad40b5870 0x7fdad40b82c0 secure :-1 s=READY pgs=2022 cs=0 l=1 rx=0x7fdac4002f30 tx=0x7fdac4010ef0).stop 2020-05-18T21:37:38.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.917+0000 7fdad8b16700 1 -- 172.21.15.63:0/140182194 shutdown_connections 2020-05-18T21:37:38.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.917+0000 7fdad8b16700 1 --2- 172.21.15.63:0/140182194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdaac04f7d0 0x7fdaac051c90 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:38.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.917+0000 7fdad8b16700 1 --2- 172.21.15.63:0/140182194 >> v2:172.21.15.155:3300/0 conn(0x7fdad4143ac0 0x7fdad4154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:38.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.917+0000 7fdad8b16700 1 --2- 172.21.15.63:0/140182194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdad40b5870 0x7fdad40b82c0 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:38.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.917+0000 7fdad8b16700 1 -- 172.21.15.63:0/140182194 >> 172.21.15.63:0/140182194 conn(0x7fdad4069b70 msgr2=0x7fdad4143f40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:38.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.917+0000 7fdad8b16700 1 -- 172.21.15.63:0/140182194 shutdown_connections 2020-05-18T21:37:38.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:38.917+0000 7fdad8b16700 1 -- 172.21.15.63:0/140182194 wait complete. 2020-05-18T21:37:38.939 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-05-18T21:37:39.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.049+0000 7fcee359e700 1 Processor -- start 2020-05-18T21:37:39.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.049+0000 7fcee359e700 1 -- start start 2020-05-18T21:37:39.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.049+0000 7fcee359e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee40adb00 0x7fcee40b0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:39.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.049+0000 7fcee359e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee40b4db0 con 0x7fcee4143a70 2020-05-18T21:37:39.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.049+0000 7fcee359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee40b5050 con 0x7fcee40b54f0 2020-05-18T21:37:39.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.049+0000 7fcee359e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee40adfb0 con 0x7fcee40adb00 2020-05-18T21:37:39.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.049+0000 7fcee259c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcee4143a70 0x7fcee40ad3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38170/0 (socket says 172.21.15.63:38170) 2020-05-18T21:37:39.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.049+0000 7fcee259c700 1 -- 172.21.15.63:0/3346190768 learned_addr learned my addr 172.21.15.63:0/3346190768 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:39.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.049+0000 7fcee2d9d700 1 --2- 172.21.15.63:0/3346190768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee40adb00 0x7fcee40b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:39.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.049+0000 7fcee159a700 1 -- 172.21.15.63:0/3346190768 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2064655780 0 0) 0x7fcee40b4db0 con 0x7fcee4143a70 2020-05-18T21:37:39.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.049+0000 7fcee159a700 1 -- 172.21.15.63:0/3346190768 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcec8003270 con 0x7fcee4143a70 2020-05-18T21:37:39.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee159a700 1 -- 172.21.15.63:0/3346190768 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506974436 0 0) 0x7fcee40b5050 con 0x7fcee40b54f0 2020-05-18T21:37:39.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee159a700 1 -- 172.21.15.63:0/3346190768 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcee40b4db0 con 0x7fcee40b54f0 2020-05-18T21:37:39.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee2d9d700 1 -- 172.21.15.63:0/3346190768 >> v1:172.21.15.155:6789/0 conn(0x7fcee40b54f0 legacy=0x7fcee40b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:39.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee2d9d700 1 -- 172.21.15.63:0/3346190768 >> v1:172.21.15.63:6789/0 conn(0x7fcee4143a70 legacy=0x7fcee40ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:39.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee2d9d700 1 -- 172.21.15.63:0/3346190768 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee40ae400 con 0x7fcee40adb00 2020-05-18T21:37:39.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee2d9d700 1 --2- 172.21.15.63:0/3346190768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee40adb00 0x7fcee40b0260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcedc0032f0 tx=0x7fcedc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:39.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee2d9d700 1 --2- 172.21.15.63:0/3346190768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee40adb00 0x7fcee40b0260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcedc0032f0 tx=0x7fcedc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:39.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee2d9d700 1 --2- 172.21.15.63:0/3346190768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee40adb00 0x7fcee40b0260 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7fcedc0032f0 tx=0x7fcedc008ca0).ready entity=mon.2 client_cookie=f82ec5662c8c53d7 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:39.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee2d9d700 1 --2- 172.21.15.63:0/3346190768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee40adb00 0x7fcee40b0260 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7fcedc0032f0 tx=0x7fcedc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:39.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee159a700 1 -- 172.21.15.63:0/3346190768 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcedc011df0 con 0x7fcee40adb00 2020-05-18T21:37:39.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee2d9d700 1 --2- 172.21.15.63:0/3346190768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee40adb00 0x7fcee40b0260 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7fcedc0032f0 tx=0x7fcedc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:39.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee2d9d700 1 --2- 172.21.15.63:0/3346190768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee40adb00 0x7fcee40b0260 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7fcedc0032f0 tx=0x7fcedc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:39.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee159a700 1 -- 172.21.15.63:0/3346190768 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc00a180 con 0x7fcee40adb00 2020-05-18T21:37:39.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee159a700 1 -- 172.21.15.63:0/3346190768 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcedc00a560 con 0x7fcee40adb00 2020-05-18T21:37:39.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee359e700 1 -- 172.21.15.63:0/3346190768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee40adb00 msgr2=0x7fcee40b0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:39.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee359e700 1 --2- 172.21.15.63:0/3346190768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee40adb00 0x7fcee40b0260 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7fcedc0032f0 tx=0x7fcedc008ca0).stop 2020-05-18T21:37:39.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee359e700 1 -- 172.21.15.63:0/3346190768 shutdown_connections 2020-05-18T21:37:39.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee359e700 1 --2- 172.21.15.63:0/3346190768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee40adb00 0x7fcee40b0260 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:39.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee359e700 1 -- 172.21.15.63:0/3346190768 >> 172.21.15.63:0/3346190768 conn(0x7fcee405fb90 msgr2=0x7fcee4069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:39.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee359e700 1 -- 172.21.15.63:0/3346190768 shutdown_connections 2020-05-18T21:37:39.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.053+0000 7fcee359e700 1 -- 172.21.15.63:0/3346190768 wait complete. 2020-05-18T21:37:39.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee359e700 1 Processor -- start 2020-05-18T21:37:39.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee359e700 1 -- start start 2020-05-18T21:37:39.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee359e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcee40b54f0 0x7fcee4111570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:39.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee359e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcee4143a70 0x7fcee4137dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:39.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee41119d0 con 0x7fcee40adb00 2020-05-18T21:37:39.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee359e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee4138230 con 0x7fcee4143a70 2020-05-18T21:37:39.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee359e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee40b2910 con 0x7fcee40b54f0 2020-05-18T21:37:39.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee2d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcee4143a70 0x7fcee4137dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:39.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee2d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcee4143a70 0x7fcee4137dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35992/0 (socket says 172.21.15.63:35992) 2020-05-18T21:37:39.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee259c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fcee40adb00 0x7fcee4115be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:36492/0 (socket says 172.21.15.63:36492) 2020-05-18T21:37:39.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee2d9d700 1 -- 172.21.15.63:0/3870219023 learned_addr learned my addr 172.21.15.63:0/3870219023 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:39.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee1d9b700 1 --2- 172.21.15.63:0/3870219023 >> v2:172.21.15.155:3300/0 conn(0x7fcee40b54f0 0x7fcee4111570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:39.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fced37fe700 1 -- 172.21.15.63:0/3870219023 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 821831195 0 0) 0x7fcee41119d0 con 0x7fcee40adb00 2020-05-18T21:37:39.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee2d9d700 1 -- 172.21.15.63:0/3870219023 >> v2:172.21.15.155:3300/0 conn(0x7fcee40b54f0 msgr2=0x7fcee4111570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:39.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee2d9d700 1 --2- 172.21.15.63:0/3870219023 >> v2:172.21.15.155:3300/0 conn(0x7fcee40b54f0 0x7fcee4111570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:39.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee2d9d700 1 -- 172.21.15.63:0/3870219023 >> v1:172.21.15.155:6789/0 conn(0x7fcee40adb00 legacy=0x7fcee4115be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:39.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee2d9d700 1 -- 172.21.15.63:0/3870219023 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee40b2bb0 con 0x7fcee4143a70 2020-05-18T21:37:39.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee2d9d700 1 --2- 172.21.15.63:0/3870219023 >> v2:172.21.15.63:3300/0 conn(0x7fcee4143a70 0x7fcee4137dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcedc0032f0 tx=0x7fcee40ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:39.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee2d9d700 1 --2- 172.21.15.63:0/3870219023 >> v2:172.21.15.63:3300/0 conn(0x7fcee4143a70 0x7fcee4137dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcedc0032f0 tx=0x7fcee40ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:39.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee2d9d700 1 --2- 172.21.15.63:0/3870219023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcee4143a70 0x7fcee4137dd0 secure :-1 s=READY pgs=2024 cs=0 l=1 rx=0x7fcedc0032f0 tx=0x7fcee40ae590).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:39.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee2d9d700 1 --2- 172.21.15.63:0/3870219023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcee4143a70 0x7fcee4137dd0 secure :-1 s=THROTTLE_DONE pgs=2024 cs=0 l=1 rx=0x7fcedc0032f0 tx=0x7fcee40ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:39.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fced37fe700 1 -- 172.21.15.63:0/3870219023 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcedc005c70 con 0x7fcee4143a70 2020-05-18T21:37:39.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee2d9d700 1 --2- 172.21.15.63:0/3870219023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcee4143a70 0x7fcee4137dd0 secure :-1 s=THROTTLE_DONE pgs=2024 cs=0 l=1 rx=0x7fcedc0032f0 tx=0x7fcee40ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:39.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fced37fe700 1 -- 172.21.15.63:0/3870219023 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc005dd0 con 0x7fcee4143a70 2020-05-18T21:37:39.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee2d9d700 1 --2- 172.21.15.63:0/3870219023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcee4143a70 0x7fcee4137dd0 secure :-1 s=THROTTLE_DONE pgs=2024 cs=0 l=1 rx=0x7fcedc0032f0 tx=0x7fcee40ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:39.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fcee359e700 1 -- 172.21.15.63:0/3870219023 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee40b2e50 con 0x7fcee4143a70 2020-05-18T21:37:39.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.057+0000 7fced37fe700 1 -- 172.21.15.63:0/3870219023 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcedc0112c0 con 0x7fcee4143a70 2020-05-18T21:37:39.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.061+0000 7fcee359e700 1 -- 172.21.15.63:0/3870219023 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee4137050 con 0x7fcee4143a70 2020-05-18T21:37:39.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.061+0000 7fcee2d9d700 1 --2- 172.21.15.63:0/3870219023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcee4143a70 0x7fcee4137dd0 secure :-1 s=THROTTLE_DONE pgs=2024 cs=0 l=1 rx=0x7fcedc0032f0 tx=0x7fcee40ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:39.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.061+0000 7fcee359e700 1 -- 172.21.15.63:0/3870219023 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee40569e0 con 0x7fcee4143a70 2020-05-18T21:37:39.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.061+0000 7fced37fe700 1 -- 172.21.15.63:0/3870219023 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fcedc0105a0 con 0x7fcee4143a70 2020-05-18T21:37:39.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.061+0000 7fcee2d9d700 1 --2- 172.21.15.63:0/3870219023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcee4143a70 0x7fcee4137dd0 secure :-1 s=THROTTLE_DONE pgs=2024 cs=0 l=1 rx=0x7fcedc0032f0 tx=0x7fcee40ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:39.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.061+0000 7fced37fe700 1 --2- 172.21.15.63:0/3870219023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcec004f830 0x7fcec0051cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:39.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.061+0000 7fced37fe700 1 -- 172.21.15.63:0/3870219023 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fcedc064760 con 0x7fcee4143a70 2020-05-18T21:37:39.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.061+0000 7fcee259c700 1 --2- 172.21.15.63:0/3870219023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcec004f830 0x7fcec0051cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:39.078 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.061+0000 7fcee259c700 1 --2- 172.21.15.63:0/3870219023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcec004f830 0x7fcec0051cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fced4001020 tx=0x7fced40016b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:39.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.065+0000 7fcee259c700 1 --2- 172.21.15.63:0/3870219023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcec004f830 0x7fcec0051cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fced4001020 tx=0x7fced40016b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:39.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.065+0000 7fcee259c700 1 --2- 172.21.15.63:0/3870219023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcec004f830 0x7fcec0051cf0 secure :-1 s=READY pgs=791 cs=0 l=1 rx=0x7fced4001020 tx=0x7fced40016b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:39.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.069+0000 7fcee2d9d700 1 --2- 172.21.15.63:0/3870219023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcee4143a70 0x7fcee4137dd0 secure :-1 s=THROTTLE_DONE pgs=2024 cs=0 l=1 rx=0x7fcedc0032f0 tx=0x7fcee40ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:39.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.069+0000 7fced37fe700 1 -- 172.21.15.63:0/3870219023 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fcedc03ea90 con 0x7fcee4143a70 2020-05-18T21:37:39.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.181+0000 7fcee359e700 1 -- 172.21.15.63:0/3870219023 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcee4066690 con 0x7fcee4143a70 2020-05-18T21:37:39.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.925+0000 7fcee2d9d700 1 --2- 172.21.15.63:0/3870219023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcee4143a70 0x7fcee4137dd0 secure :-1 s=THROTTLE_DONE pgs=2024 cs=0 l=1 rx=0x7fcedc0032f0 tx=0x7fcee40ae590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:39.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.925+0000 7fced37fe700 1 -- 172.21.15.63:0/3870219023 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v149) v1 ==== 185+0+0 (secure 0 0 0) 0x7fcedc0420b0 con 0x7fcee4143a70 2020-05-18T21:37:39.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.929+0000 7fcee359e700 1 -- 172.21.15.63:0/3870219023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcec004f830 msgr2=0x7fcec0051cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:39.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.929+0000 7fcee359e700 1 --2- 172.21.15.63:0/3870219023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcec004f830 0x7fcec0051cf0 secure :-1 s=READY pgs=791 cs=0 l=1 rx=0x7fced4001020 tx=0x7fced40016b0).stop 2020-05-18T21:37:39.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.929+0000 7fcee359e700 1 -- 172.21.15.63:0/3870219023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcee4143a70 msgr2=0x7fcee4137dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:39.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.929+0000 7fcee359e700 1 --2- 172.21.15.63:0/3870219023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcee4143a70 0x7fcee4137dd0 secure :-1 s=READY pgs=2024 cs=0 l=1 rx=0x7fcedc0032f0 tx=0x7fcee40ae590).stop 2020-05-18T21:37:39.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.929+0000 7fcee359e700 1 -- 172.21.15.63:0/3870219023 shutdown_connections 2020-05-18T21:37:39.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.929+0000 7fcee359e700 1 --2- 172.21.15.63:0/3870219023 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcec004f830 0x7fcec0051cf0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:39.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.929+0000 7fcee359e700 1 --2- 172.21.15.63:0/3870219023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcee4143a70 0x7fcee4137dd0 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:39.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.929+0000 7fcee359e700 1 --2- 172.21.15.63:0/3870219023 >> v2:172.21.15.155:3300/0 conn(0x7fcee40b54f0 0x7fcee4111570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:39.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.929+0000 7fcee359e700 1 -- 172.21.15.63:0/3870219023 >> 172.21.15.63:0/3870219023 conn(0x7fcee405fb90 msgr2=0x7fcee40b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:39.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.929+0000 7fcee359e700 1 -- 172.21.15.63:0/3870219023 shutdown_connections 2020-05-18T21:37:39.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:39.929+0000 7fcee359e700 1 -- 172.21.15.63:0/3870219023 wait complete. 2020-05-18T21:37:39.939 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2020-05-18T21:37:39.950 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-05-18T21:37:40.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.045+0000 7f19cffff700 1 Processor -- start 2020-05-18T21:37:40.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.045+0000 7f19cffff700 1 -- start start 2020-05-18T21:37:40.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f19d0143890 0x7f19d00b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:40.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d00652c0 0x7f19d0065770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:40.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d0063700 con 0x7f19d00b14b0 2020-05-18T21:37:40.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d00b1340 con 0x7f19d0143890 2020-05-18T21:37:40.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d0064c30 con 0x7f19d00652c0 2020-05-18T21:37:40.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19ceffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f19d0143890 0x7f19d00b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:40.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cf7fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d00652c0 0x7f19d0065770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:40.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19ceffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f19d0143890 0x7f19d00b4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:50844/0 (socket says 172.21.15.63:50844) 2020-05-18T21:37:40.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19ce7fc700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f19d00b14b0 0x7f19d00ba320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:36502/0 (socket says 172.21.15.63:36502) 2020-05-18T21:37:40.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19ceffd700 1 -- 172.21.15.63:0/796458028 learned_addr learned my addr 172.21.15.63:0/796458028 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:40.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cf7fe700 1 -- 172.21.15.63:0/796458028 >> v2:172.21.15.155:3300/0 conn(0x7f19d0143890 msgr2=0x7f19d00b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:40.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cf7fe700 1 --2- 172.21.15.63:0/796458028 >> v2:172.21.15.155:3300/0 conn(0x7f19d0143890 0x7f19d00b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:40.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cf7fe700 1 -- 172.21.15.63:0/796458028 >> v1:172.21.15.155:6789/0 conn(0x7f19d00b14b0 legacy=0x7f19d00ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:40.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cf7fe700 1 -- 172.21.15.63:0/796458028 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d00639a0 con 0x7f19d00652c0 2020-05-18T21:37:40.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19ceffd700 1 --2- 172.21.15.63:0/796458028 >> v2:172.21.15.155:3300/0 conn(0x7f19d0143890 0x7f19d00b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:40.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cf7fe700 1 --2- 172.21.15.63:0/796458028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d00652c0 0x7f19d0065770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f19c80032f0 tx=0x7f19c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:40.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cf7fe700 1 --2- 172.21.15.63:0/796458028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d00652c0 0x7f19d0065770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f19c80032f0 tx=0x7f19c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:40.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cf7fe700 1 --2- 172.21.15.63:0/796458028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d00652c0 0x7f19d0065770 secure :-1 s=READY pgs=310 cs=0 l=1 rx=0x7f19c80032f0 tx=0x7f19c8007e00).ready entity=mon.2 client_cookie=483163e924686d00 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:40.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cf7fe700 1 --2- 172.21.15.63:0/796458028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d00652c0 0x7f19d0065770 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f19c80032f0 tx=0x7f19c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:40.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cdffb700 1 -- 172.21.15.63:0/796458028 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19c8011e60 con 0x7f19d00652c0 2020-05-18T21:37:40.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cf7fe700 1 --2- 172.21.15.63:0/796458028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d00652c0 0x7f19d0065770 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f19c80032f0 tx=0x7f19c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:40.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cf7fe700 1 --2- 172.21.15.63:0/796458028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d00652c0 0x7f19d0065770 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f19c80032f0 tx=0x7f19c8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:40.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cdffb700 1 -- 172.21.15.63:0/796458028 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c800a180 con 0x7f19d00652c0 2020-05-18T21:37:40.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cffff700 1 -- 172.21.15.63:0/796458028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d00652c0 msgr2=0x7f19d0065770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:40.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cdffb700 1 -- 172.21.15.63:0/796458028 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19c800a520 con 0x7f19d00652c0 2020-05-18T21:37:40.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cffff700 1 --2- 172.21.15.63:0/796458028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d00652c0 0x7f19d0065770 secure :-1 s=READY pgs=310 cs=0 l=1 rx=0x7f19c80032f0 tx=0x7f19c8007e00).stop 2020-05-18T21:37:40.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cffff700 1 -- 172.21.15.63:0/796458028 shutdown_connections 2020-05-18T21:37:40.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cffff700 1 --2- 172.21.15.63:0/796458028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d00652c0 0x7f19d0065770 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:40.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cffff700 1 --2- 172.21.15.63:0/796458028 >> v2:172.21.15.155:3300/0 conn(0x7f19d0143890 0x7f19d00b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:40.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cffff700 1 -- 172.21.15.63:0/796458028 >> 172.21.15.63:0/796458028 conn(0x7f19d005f310 msgr2=0x7f19d005f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:40.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cffff700 1 -- 172.21.15.63:0/796458028 shutdown_connections 2020-05-18T21:37:40.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.049+0000 7f19cffff700 1 -- 172.21.15.63:0/796458028 wait complete. 2020-05-18T21:37:40.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19cffff700 1 Processor -- start 2020-05-18T21:37:40.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19cffff700 1 -- start start 2020-05-18T21:37:40.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19cffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f19d00652c0 0x7f19d01556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:40.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19cffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f19d00b14b0 0x7f19d00b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:40.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19cffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d0143890 0x7f19d00b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:40.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19cffff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d00ac730 con 0x7f19d00652c0 2020-05-18T21:37:40.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19cffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d00b3b50 con 0x7f19d00b14b0 2020-05-18T21:37:40.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19cffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00ac920 con 0x7f19d0143890 2020-05-18T21:37:40.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19ceffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f19d00652c0 0x7f19d01556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:40.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19ceffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f19d00652c0 0x7f19d01556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36002/0 (socket says 172.21.15.63:36002) 2020-05-18T21:37:40.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19ceffd700 1 -- 172.21.15.63:0/2803985677 learned_addr learned my addr 172.21.15.63:0/2803985677 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:40.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19ce7fc700 1 --2- 172.21.15.63:0/2803985677 >> v2:172.21.15.155:3300/0 conn(0x7f19d00b14b0 0x7f19d00b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:40.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19cf7fe700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d0143890 0x7f19d00b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:40.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19ceffd700 1 -- 172.21.15.63:0/2803985677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d0143890 msgr2=0x7f19d00b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:40.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19ceffd700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d0143890 0x7f19d00b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:40.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19ceffd700 1 -- 172.21.15.63:0/2803985677 >> v2:172.21.15.155:3300/0 conn(0x7f19d00b14b0 msgr2=0x7f19d00b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:40.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19ceffd700 1 --2- 172.21.15.63:0/2803985677 >> v2:172.21.15.155:3300/0 conn(0x7f19d00b14b0 0x7f19d00b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:40.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19ceffd700 1 -- 172.21.15.63:0/2803985677 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d00b38a0 con 0x7f19d00652c0 2020-05-18T21:37:40.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19ceffd700 1 --2- 172.21.15.63:0/2803985677 >> v2:172.21.15.63:3300/0 conn(0x7f19d00652c0 0x7f19d01556a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f19b8002f30 tx=0x7f19b8010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:40.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19ceffd700 1 --2- 172.21.15.63:0/2803985677 >> v2:172.21.15.63:3300/0 conn(0x7f19d00652c0 0x7f19d01556a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f19b8002f30 tx=0x7f19b8010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:40.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19ceffd700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19d00652c0 0x7f19d01556a0 secure :-1 s=READY pgs=2025 cs=0 l=1 rx=0x7f19b8002f30 tx=0x7f19b8010ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:40.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19ceffd700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19d00652c0 0x7f19d01556a0 secure :-1 s=THROTTLE_DONE pgs=2025 cs=0 l=1 rx=0x7f19b8002f30 tx=0x7f19b8010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:40.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19ceffd700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19d00652c0 0x7f19d01556a0 secure :-1 s=THROTTLE_DONE pgs=2025 cs=0 l=1 rx=0x7f19b8002f30 tx=0x7f19b8010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:40.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19ceffd700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19d00652c0 0x7f19d01556a0 secure :-1 s=THROTTLE_DONE pgs=2025 cs=0 l=1 rx=0x7f19b8002f30 tx=0x7f19b8010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:40.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19c7fff700 1 -- 172.21.15.63:0/2803985677 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19b8007560 con 0x7f19d00652c0 2020-05-18T21:37:40.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19c7fff700 1 -- 172.21.15.63:0/2803985677 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b8005a00 con 0x7f19d00652c0 2020-05-18T21:37:40.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19cffff700 1 -- 172.21.15.63:0/2803985677 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d00b1d70 con 0x7f19d00652c0 2020-05-18T21:37:40.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19c7fff700 1 -- 172.21.15.63:0/2803985677 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19b8005e20 con 0x7f19d00652c0 2020-05-18T21:37:40.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.053+0000 7f19cffff700 1 -- 172.21.15.63:0/2803985677 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d013e840 con 0x7f19d00652c0 2020-05-18T21:37:40.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.057+0000 7f19ceffd700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19d00652c0 0x7f19d01556a0 secure :-1 s=THROTTLE_DONE pgs=2025 cs=0 l=1 rx=0x7f19b8002f30 tx=0x7f19b8010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:40.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.057+0000 7f19cffff700 1 -- 172.21.15.63:0/2803985677 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d00b3cc0 con 0x7f19d00652c0 2020-05-18T21:37:40.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.057+0000 7f19c7fff700 1 -- 172.21.15.63:0/2803985677 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f19b80101a0 con 0x7f19d00652c0 2020-05-18T21:37:40.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.057+0000 7f19ceffd700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19d00652c0 0x7f19d01556a0 secure :-1 s=THROTTLE_DONE pgs=2025 cs=0 l=1 rx=0x7f19b8002f30 tx=0x7f19b8010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:40.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.057+0000 7f19c7fff700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f19b404fb40 0x7f19b4052000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:40.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.057+0000 7f19c7fff700 1 -- 172.21.15.63:0/2803985677 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5807+0+0 (secure 0 0 0) 0x7f19b8063e80 con 0x7f19d00652c0 2020-05-18T21:37:40.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.057+0000 7f19ce7fc700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f19b404fb40 0x7f19b4052000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:40.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.057+0000 7f19ce7fc700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f19b404fb40 0x7f19b4052000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f19d00b8200 tx=0x7f19d00433a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:40.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.057+0000 7f19ce7fc700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f19b404fb40 0x7f19b4052000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f19d00b8200 tx=0x7f19d00433a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:40.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.057+0000 7f19ce7fc700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f19b404fb40 0x7f19b4052000 secure :-1 s=READY pgs=792 cs=0 l=1 rx=0x7f19d00b8200 tx=0x7f19d00433a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:40.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.061+0000 7f19ceffd700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19d00652c0 0x7f19d01556a0 secure :-1 s=THROTTLE_DONE pgs=2025 cs=0 l=1 rx=0x7f19b8002f30 tx=0x7f19b8010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:40.077 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.061+0000 7f19c7fff700 1 -- 172.21.15.63:0/2803985677 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f19d00b3cc0 con 0x7f19d00652c0 2020-05-18T21:37:40.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.177+0000 7f19cffff700 1 -- 172.21.15.63:0/2803985677 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f19d00b3cc0 con 0x7f19d00652c0 2020-05-18T21:37:40.943 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.937+0000 7f19ceffd700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19d00652c0 0x7f19d01556a0 secure :-1 s=THROTTLE_DONE pgs=2025 cs=0 l=1 rx=0x7f19b8002f30 tx=0x7f19b8010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:40.944 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.937+0000 7f19c7fff700 1 -- 172.21.15.63:0/2803985677 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v150) v1 ==== 173+0+0 (secure 0 0 0) 0x7f19d00b3cc0 con 0x7f19d00652c0 2020-05-18T21:37:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.941+0000 7f19cffff700 1 -- 172.21.15.63:0/2803985677 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f19b404fb40 msgr2=0x7f19b4052000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.941+0000 7f19cffff700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f19b404fb40 0x7f19b4052000 secure :-1 s=READY pgs=792 cs=0 l=1 rx=0x7f19d00b8200 tx=0x7f19d00433a0).stop 2020-05-18T21:37:40.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.941+0000 7f19cffff700 1 -- 172.21.15.63:0/2803985677 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19d00652c0 msgr2=0x7f19d01556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:40.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.941+0000 7f19cffff700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19d00652c0 0x7f19d01556a0 secure :-1 s=READY pgs=2025 cs=0 l=1 rx=0x7f19b8002f30 tx=0x7f19b8010ef0).stop 2020-05-18T21:37:40.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.941+0000 7f19cffff700 1 -- 172.21.15.63:0/2803985677 shutdown_connections 2020-05-18T21:37:40.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.941+0000 7f19cffff700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f19b404fb40 0x7f19b4052000 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:40.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.941+0000 7f19cffff700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d0143890 0x7f19d00b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:40.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.941+0000 7f19cffff700 1 --2- 172.21.15.63:0/2803985677 >> v2:172.21.15.155:3300/0 conn(0x7f19d00b14b0 0x7f19d00b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:40.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.941+0000 7f19cffff700 1 --2- 172.21.15.63:0/2803985677 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19d00652c0 0x7f19d01556a0 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:40.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.941+0000 7f19cffff700 1 -- 172.21.15.63:0/2803985677 >> 172.21.15.63:0/2803985677 conn(0x7f19d005f310 msgr2=0x7f19d00b06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:40.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.941+0000 7f19cffff700 1 -- 172.21.15.63:0/2803985677 shutdown_connections 2020-05-18T21:37:40.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:40.941+0000 7f19cffff700 1 -- 172.21.15.63:0/2803985677 wait complete. 2020-05-18T21:37:40.949 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2020-05-18T21:37:40.961 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:37:40.961 INFO:tasks.ceph.mds.a:Stopping old one... 2020-05-18T21:37:40.961 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:37:40.962 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:37:40.962 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:37:40.962 INFO:tasks.ceph.mds.b:Stopping old one... 2020-05-18T21:37:40.963 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:37:40.963 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:37:40.974 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:37:40.974 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:37:40.977 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:37:40.977 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:37:41.021 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:37:41.022 DEBUG:teuthology.parallel:result is None 2020-05-18T21:37:41.024 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:37:41.024 DEBUG:teuthology.parallel:result is None 2020-05-18T21:37:41.025 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-05-18T21:37:41.096 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:37:41.102 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:37:41.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.129+0000 7fd732b4a700 1 Processor -- start 2020-05-18T21:37:41.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.129+0000 7fd732b4a700 1 -- start start 2020-05-18T21:37:41.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd732b4a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd72c05ef00 0x7fd72c0b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:41.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd732b4a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c0661d0 0x7fd72c0af570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd732b4a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd72c09f250 con 0x7fd72c0af9d0 2020-05-18T21:37:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd732b4a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72c09f040 con 0x7fd72c05ef00 2020-05-18T21:37:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd732b4a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c09f4f0 con 0x7fd72c0661d0 2020-05-18T21:37:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd72bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c0661d0 0x7fd72c0af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd72bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c0661d0 0x7fd72c0af570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:54956/0 (socket says 172.21.15.63:54956) 2020-05-18T21:37:41.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd72bfff700 1 -- 172.21.15.63:0/541734733 learned_addr learned my addr 172.21.15.63:0/541734733 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:41.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd7310e7700 1 --1- 172.21.15.63:0/541734733 >> v1:172.21.15.63:6789/0 conn(0x7fd72c0af9d0 0x7fd72c1433f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38212/0 (socket says 172.21.15.63:38212) 2020-05-18T21:37:41.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd7308e6700 1 --2- 172.21.15.63:0/541734733 >> v2:172.21.15.155:3300/0 conn(0x7fd72c05ef00 0x7fd72c0b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:41.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd72bfff700 1 -- 172.21.15.63:0/541734733 >> v2:172.21.15.155:3300/0 conn(0x7fd72c05ef00 msgr2=0x7fd72c0b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:41.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd72bfff700 1 --2- 172.21.15.63:0/541734733 >> v2:172.21.15.155:3300/0 conn(0x7fd72c05ef00 0x7fd72c0b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:41.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd72bfff700 1 -- 172.21.15.63:0/541734733 >> v1:172.21.15.63:6789/0 conn(0x7fd72c0af9d0 legacy=0x7fd72c1433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:41.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd72bfff700 1 -- 172.21.15.63:0/541734733 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c05f2e0 con 0x7fd72c0661d0 2020-05-18T21:37:41.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd72bfff700 1 --2- 172.21.15.63:0/541734733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c0661d0 0x7fd72c0af570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd720002f70 tx=0x7fd720007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:41.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd72bfff700 1 --2- 172.21.15.63:0/541734733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c0661d0 0x7fd72c0af570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd720002f70 tx=0x7fd720007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd72bfff700 1 --2- 172.21.15.63:0/541734733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c0661d0 0x7fd72c0af570 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7fd720002f70 tx=0x7fd720007a80).ready entity=mon.2 client_cookie=180de30a0f321937 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd72bfff700 1 --2- 172.21.15.63:0/541734733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c0661d0 0x7fd72c0af570 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7fd720002f70 tx=0x7fd720007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd72b7fe700 1 -- 172.21.15.63:0/541734733 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7200116b0 con 0x7fd72c0661d0 2020-05-18T21:37:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd72bfff700 1 --2- 172.21.15.63:0/541734733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c0661d0 0x7fd72c0af570 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7fd720002f70 tx=0x7fd720007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:41.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd72b7fe700 1 -- 172.21.15.63:0/541734733 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd720011810 con 0x7fd72c0661d0 2020-05-18T21:37:41.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd72bfff700 1 --2- 172.21.15.63:0/541734733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c0661d0 0x7fd72c0af570 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7fd720002f70 tx=0x7fd720007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:41.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd72b7fe700 1 -- 172.21.15.63:0/541734733 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd720011c30 con 0x7fd72c0661d0 2020-05-18T21:37:41.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd732b4a700 1 -- 172.21.15.63:0/541734733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c0661d0 msgr2=0x7fd72c0af570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:41.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.133+0000 7fd732b4a700 1 --2- 172.21.15.63:0/541734733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c0661d0 0x7fd72c0af570 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7fd720002f70 tx=0x7fd720007a80).stop 2020-05-18T21:37:41.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.137+0000 7fd732b4a700 1 -- 172.21.15.63:0/541734733 shutdown_connections 2020-05-18T21:37:41.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.137+0000 7fd732b4a700 1 --2- 172.21.15.63:0/541734733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c0661d0 0x7fd72c0af570 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:41.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.137+0000 7fd732b4a700 1 --2- 172.21.15.63:0/541734733 >> v2:172.21.15.155:3300/0 conn(0x7fd72c05ef00 0x7fd72c0b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:41.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.137+0000 7fd732b4a700 1 -- 172.21.15.63:0/541734733 >> 172.21.15.63:0/541734733 conn(0x7fd72c0ba5d0 msgr2=0x7fd72c0ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:41.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.137+0000 7fd732b4a700 1 -- 172.21.15.63:0/541734733 shutdown_connections 2020-05-18T21:37:41.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.137+0000 7fd732b4a700 1 -- 172.21.15.63:0/541734733 wait complete. 2020-05-18T21:37:41.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.137+0000 7fd732b4a700 1 Processor -- start 2020-05-18T21:37:41.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.137+0000 7fd732b4a700 1 -- start start 2020-05-18T21:37:41.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.137+0000 7fd732b4a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c0661d0 0x7fd72c0b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:41.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.137+0000 7fd732b4a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd72c14f5d0 0x7fd72c0b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:41.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.137+0000 7fd732b4a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd72c0b4c80 con 0x7fd72c05ef00 2020-05-18T21:37:41.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.137+0000 7fd732b4a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72c0b4ec0 con 0x7fd72c14f5d0 2020-05-18T21:37:41.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.137+0000 7fd732b4a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c062840 con 0x7fd72c0661d0 2020-05-18T21:37:41.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.137+0000 7fd7308e6700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd72c05ef00 0x7fd72c135a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38216/0 (socket says 172.21.15.63:38216) 2020-05-18T21:37:41.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.137+0000 7fd7308e6700 1 -- 172.21.15.63:0/4115979001 learned_addr learned my addr 172.21.15.63:0/4115979001 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:41.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.137+0000 7fd7310e7700 1 --2- 172.21.15.63:0/4115979001 >> v2:172.21.15.155:3300/0 conn(0x7fd72c14f5d0 0x7fd72c0b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:41.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.137+0000 7fd72bfff700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c0661d0 0x7fd72c0b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:41.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd729ffb700 1 -- 172.21.15.63:0/4115979001 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511201940 0 0) 0x7fd71c001f00 con 0x7fd72c05ef00 2020-05-18T21:37:41.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd7310e7700 1 -- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c0661d0 msgr2=0x7fd72c0b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:41.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd7310e7700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c0661d0 0x7fd72c0b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:41.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd7310e7700 1 -- 172.21.15.63:0/4115979001 >> v1:172.21.15.63:6789/0 conn(0x7fd72c05ef00 legacy=0x7fd72c135a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:41.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd7310e7700 1 -- 172.21.15.63:0/4115979001 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c062ae0 con 0x7fd72c14f5d0 2020-05-18T21:37:41.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd7310e7700 1 --2- 172.21.15.63:0/4115979001 >> v2:172.21.15.155:3300/0 conn(0x7fd72c14f5d0 0x7fd72c0b4820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd72c05eaf0 tx=0x7fd724010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:41.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd7310e7700 1 --2- 172.21.15.63:0/4115979001 >> v2:172.21.15.155:3300/0 conn(0x7fd72c14f5d0 0x7fd72c0b4820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd72c05eaf0 tx=0x7fd724010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:41.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd7310e7700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd72c14f5d0 0x7fd72c0b4820 secure :-1 s=READY pgs=1354 cs=0 l=1 rx=0x7fd72c05eaf0 tx=0x7fd724010bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:41.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd7310e7700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd72c14f5d0 0x7fd72c0b4820 secure :-1 s=THROTTLE_DONE pgs=1354 cs=0 l=1 rx=0x7fd72c05eaf0 tx=0x7fd724010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:41.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd729ffb700 1 -- 172.21.15.63:0/4115979001 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd724004c90 con 0x7fd72c14f5d0 2020-05-18T21:37:41.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd7310e7700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd72c14f5d0 0x7fd72c0b4820 secure :-1 s=THROTTLE_DONE pgs=1354 cs=0 l=1 rx=0x7fd72c05eaf0 tx=0x7fd724010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:41.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd7310e7700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd72c14f5d0 0x7fd72c0b4820 secure :-1 s=THROTTLE_DONE pgs=1354 cs=0 l=1 rx=0x7fd72c05eaf0 tx=0x7fd724010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:41.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd729ffb700 1 -- 172.21.15.63:0/4115979001 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd724004df0 con 0x7fd72c14f5d0 2020-05-18T21:37:41.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd732b4a700 1 -- 172.21.15.63:0/4115979001 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72c136130 con 0x7fd72c14f5d0 2020-05-18T21:37:41.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd729ffb700 1 -- 172.21.15.63:0/4115979001 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd724012740 con 0x7fd72c14f5d0 2020-05-18T21:37:41.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd732b4a700 1 -- 172.21.15.63:0/4115979001 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72c065300 con 0x7fd72c14f5d0 2020-05-18T21:37:41.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd7310e7700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd72c14f5d0 0x7fd72c0b4820 secure :-1 s=THROTTLE_DONE pgs=1354 cs=0 l=1 rx=0x7fd72c05eaf0 tx=0x7fd724010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:41.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd732b4a700 1 -- 172.21.15.63:0/4115979001 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72c0569e0 con 0x7fd72c14f5d0 2020-05-18T21:37:41.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd729ffb700 1 -- 172.21.15.63:0/4115979001 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd7240129b0 con 0x7fd72c14f5d0 2020-05-18T21:37:41.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd7310e7700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd72c14f5d0 0x7fd72c0b4820 secure :-1 s=THROTTLE_DONE pgs=1354 cs=0 l=1 rx=0x7fd72c05eaf0 tx=0x7fd724010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:41.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd729ffb700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd70c0580a0 0x7fd70c05a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:41.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd729ffb700 1 -- 172.21.15.63:0/4115979001 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5425+0+0 (secure 0 0 0) 0x7fd724063ed0 con 0x7fd72c14f5d0 2020-05-18T21:37:41.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd7308e6700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd70c0580a0 0x7fd70c05a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:41.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.141+0000 7fd7308e6700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd70c0580a0 0x7fd70c05a560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd71c007fe0 tx=0x7fd71c002180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:41.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.145+0000 7fd7308e6700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd70c0580a0 0x7fd70c05a560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd71c007fe0 tx=0x7fd71c002180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:41.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.145+0000 7fd7308e6700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd70c0580a0 0x7fd70c05a560 secure :-1 s=READY pgs=793 cs=0 l=1 rx=0x7fd71c007fe0 tx=0x7fd71c002180).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:41.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.149+0000 7fd7310e7700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd72c14f5d0 0x7fd72c0b4820 secure :-1 s=THROTTLE_DONE pgs=1354 cs=0 l=1 rx=0x7fd72c05eaf0 tx=0x7fd724010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:41.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.149+0000 7fd729ffb700 1 -- 172.21.15.63:0/4115979001 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd72403e260 con 0x7fd72c14f5d0 2020-05-18T21:37:41.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:41.277+0000 7fd732b4a700 1 -- 172.21.15.63:0/4115979001 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fd72c0b0740 con 0x7fd72c14f5d0 2020-05-18T21:37:42.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.137+0000 7fd7310e7700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd72c14f5d0 0x7fd72c0b4820 secure :-1 s=READY pgs=1354 cs=0 l=1 rx=0x7fd72c05eaf0 tx=0x7fd724010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.149+0000 7fd7310e7700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd72c14f5d0 0x7fd72c0b4820 secure :-1 s=THROTTLE_DONE pgs=1354 cs=0 l=1 rx=0x7fd72c05eaf0 tx=0x7fd724010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.149+0000 7fd729ffb700 1 -- 172.21.15.63:0/4115979001 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v152) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd724041880 con 0x7fd72c14f5d0 2020-05-18T21:37:42.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.153+0000 7fd732b4a700 1 -- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd70c0580a0 msgr2=0x7fd70c05a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.153+0000 7fd732b4a700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd70c0580a0 0x7fd70c05a560 secure :-1 s=READY pgs=793 cs=0 l=1 rx=0x7fd71c007fe0 tx=0x7fd71c002180).stop 2020-05-18T21:37:42.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.153+0000 7fd732b4a700 1 -- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd72c14f5d0 msgr2=0x7fd72c0b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.153+0000 7fd732b4a700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd72c14f5d0 0x7fd72c0b4820 secure :-1 s=READY pgs=1354 cs=0 l=1 rx=0x7fd72c05eaf0 tx=0x7fd724010bb0).stop 2020-05-18T21:37:42.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.153+0000 7fd732b4a700 1 -- 172.21.15.63:0/4115979001 shutdown_connections 2020-05-18T21:37:42.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.153+0000 7fd732b4a700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd70c0580a0 0x7fd70c05a560 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:42.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.153+0000 7fd732b4a700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd72c14f5d0 0x7fd72c0b4820 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:42.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.153+0000 7fd732b4a700 1 --2- 172.21.15.63:0/4115979001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c0661d0 0x7fd72c0b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:42.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.153+0000 7fd732b4a700 1 -- 172.21.15.63:0/4115979001 >> 172.21.15.63:0/4115979001 conn(0x7fd72c0ba5d0 msgr2=0x7fd72c0afdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:42.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.153+0000 7fd732b4a700 1 -- 172.21.15.63:0/4115979001 shutdown_connections 2020-05-18T21:37:42.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.153+0000 7fd732b4a700 1 -- 172.21.15.63:0/4115979001 wait complete. 2020-05-18T21:37:42.161 INFO:teuthology.orchestra.run.smithi063.stderr: removed all blacklist entries 2020-05-18T21:37:42.172 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-05-18T21:37:42.173 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-05-18T21:37:42.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.273+0000 7f5dbb245700 1 Processor -- start 2020-05-18T21:37:42.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.273+0000 7f5dbb245700 1 -- start start 2020-05-18T21:37:42.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5dbb245700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5db4060b90 0x7f5db4145f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:42.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5dbb245700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5db4061670 0x7f5db4149770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:42.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5dbb245700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db40b2d70 con 0x7f5db4149bd0 2020-05-18T21:37:42.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5dbb245700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db4146e60 con 0x7f5db4061670 2020-05-18T21:37:42.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5dbb245700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db4146480 con 0x7f5db4060b90 2020-05-18T21:37:42.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5db3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5db4061670 0x7f5db4149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:42.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5db3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5db4061670 0x7f5db4149770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36038/0 (socket says 172.21.15.63:36038) 2020-05-18T21:37:42.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5db3fff700 1 -- 172.21.15.63:0/2555249415 learned_addr learned my addr 172.21.15.63:0/2555249415 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:42.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5db8fe1700 1 --2- 172.21.15.63:0/2555249415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5db4060b90 0x7f5db4145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:42.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5db3fff700 1 -- 172.21.15.63:0/2555249415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5db4060b90 msgr2=0x7f5db4145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:42.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2555249415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5db4060b90 0x7f5db4145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:42.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5db3fff700 1 -- 172.21.15.63:0/2555249415 >> v1:172.21.15.155:6789/0 conn(0x7f5db4149bd0 legacy=0x7f5db40b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5db3fff700 1 -- 172.21.15.63:0/2555249415 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db4146720 con 0x7f5db4061670 2020-05-18T21:37:42.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5db8fe1700 1 --2- 172.21.15.63:0/2555249415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5db4060b90 0x7f5db4145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:37:42.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2555249415 >> v2:172.21.15.63:3300/0 conn(0x7f5db4061670 0x7f5db4149770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5da4002f70 tx=0x7f5da4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2555249415 >> v2:172.21.15.63:3300/0 conn(0x7f5db4061670 0x7f5db4149770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5da4002f70 tx=0x7f5da4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2555249415 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5db4061670 0x7f5db4149770 secure :-1 s=READY pgs=2030 cs=0 l=1 rx=0x7f5da4002f70 tx=0x7f5da4007a80).ready entity=mon.0 client_cookie=fd14cad0cbcf6926 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:42.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2555249415 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5db4061670 0x7f5db4149770 secure :-1 s=THROTTLE_DONE pgs=2030 cs=0 l=1 rx=0x7f5da4002f70 tx=0x7f5da4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5db37fe700 1 -- 172.21.15.63:0/2555249415 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5da4011760 con 0x7f5db4061670 2020-05-18T21:37:42.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2555249415 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5db4061670 0x7f5db4149770 secure :-1 s=THROTTLE_DONE pgs=2030 cs=0 l=1 rx=0x7f5da4002f70 tx=0x7f5da4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5db37fe700 1 -- 172.21.15.63:0/2555249415 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da40118c0 con 0x7f5db4061670 2020-05-18T21:37:42.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2555249415 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5db4061670 0x7f5db4149770 secure :-1 s=THROTTLE_DONE pgs=2030 cs=0 l=1 rx=0x7f5da4002f70 tx=0x7f5da4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5db37fe700 1 -- 172.21.15.63:0/2555249415 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5da4011ce0 con 0x7f5db4061670 2020-05-18T21:37:42.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5dbb245700 1 -- 172.21.15.63:0/2555249415 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5db4061670 msgr2=0x7f5db4149770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5dbb245700 1 --2- 172.21.15.63:0/2555249415 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5db4061670 0x7f5db4149770 secure :-1 s=READY pgs=2030 cs=0 l=1 rx=0x7f5da4002f70 tx=0x7f5da4007a80).stop 2020-05-18T21:37:42.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5dbb245700 1 -- 172.21.15.63:0/2555249415 shutdown_connections 2020-05-18T21:37:42.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5dbb245700 1 --2- 172.21.15.63:0/2555249415 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5db4061670 0x7f5db4149770 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:42.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5dbb245700 1 --2- 172.21.15.63:0/2555249415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5db4060b90 0x7f5db4145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:42.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5dbb245700 1 -- 172.21.15.63:0/2555249415 >> 172.21.15.63:0/2555249415 conn(0x7f5db40b83d0 msgr2=0x7f5db40b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:42.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5dbb245700 1 -- 172.21.15.63:0/2555249415 shutdown_connections 2020-05-18T21:37:42.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.277+0000 7f5dbb245700 1 -- 172.21.15.63:0/2555249415 wait complete. 2020-05-18T21:37:42.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5dbb245700 1 Processor -- start 2020-05-18T21:37:42.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5dbb245700 1 -- start start 2020-05-18T21:37:42.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5dbb245700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5db4061670 0x7f5db4062080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:42.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5dbb245700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db4141da0 con 0x7f5db4060b90 2020-05-18T21:37:42.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5dbb245700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db41532e0 con 0x7f5db4149bd0 2020-05-18T21:37:42.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5dbb245700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db4153550 con 0x7f5db4061670 2020-05-18T21:37:42.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db8fe1700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5db4060b90 0x7f5db4153c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38232/0 (socket says 172.21.15.63:38232) 2020-05-18T21:37:42.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db8fe1700 1 -- 172.21.15.63:0/2621020790 learned_addr learned my addr 172.21.15.63:0/2621020790 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:42.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2621020790 >> v2:172.21.15.155:3300/0 conn(0x7f5db4061670 0x7f5db4062080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:42.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db1ffb700 1 -- 172.21.15.63:0/2621020790 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196859631 0 0) 0x7f5db4141da0 con 0x7f5db4060b90 2020-05-18T21:37:42.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db1ffb700 1 -- 172.21.15.63:0/2621020790 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d98002fe0 con 0x7f5db4060b90 2020-05-18T21:37:42.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db1ffb700 1 -- 172.21.15.63:0/2621020790 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2974934350 0 0) 0x7f5d98002fe0 con 0x7f5db4060b90 2020-05-18T21:37:42.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db1ffb700 1 -- 172.21.15.63:0/2621020790 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5db4141da0 con 0x7f5db4060b90 2020-05-18T21:37:42.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db1ffb700 1 -- 172.21.15.63:0/2621020790 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f5d9c002540 con 0x7f5db4060b90 2020-05-18T21:37:42.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db1ffb700 1 -- 172.21.15.63:0/2621020790 >> v2:172.21.15.155:3300/0 conn(0x7f5db4061670 msgr2=0x7f5db4062080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db1ffb700 1 --2- 172.21.15.63:0/2621020790 >> v2:172.21.15.155:3300/0 conn(0x7f5db4061670 0x7f5db4062080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:42.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db1ffb700 1 -- 172.21.15.63:0/2621020790 >> v1:172.21.15.155:6789/0 conn(0x7f5db4149bd0 legacy=0x7f5db4144aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db1ffb700 1 -- 172.21.15.63:0/2621020790 >> v1:172.21.15.63:6789/0 conn(0x7f5db4060b90 legacy=0x7f5db4153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db1ffb700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d98004a80 0x7f5d98004e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:42.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db1ffb700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d980039a0 0x7f5d98003e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:42.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db1ffb700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d98004260 0x7f5d9800b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:42.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db1ffb700 1 -- 172.21.15.63:0/2621020790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db4153550 con 0x7f5d980039a0 2020-05-18T21:37:42.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db1ffb700 1 -- 172.21.15.63:0/2621020790 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d980055c0 con 0x7f5d98004260 2020-05-18T21:37:42.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db1ffb700 1 -- 172.21.15.63:0/2621020790 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d98004760 con 0x7f5d98004a80 2020-05-18T21:37:42.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2621020790 >> v2:172.21.15.155:3300/0 conn(0x7f5db4061670 0x7f5db4062080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:42.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db8fe1700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d98004a80 0x7f5d98004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:42.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db97e2700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d98004260 0x7f5d9800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:42.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.281+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d980039a0 0x7f5d98003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:42.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5db3fff700 1 -- 172.21.15.63:0/2621020790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d98004a80 msgr2=0x7f5d98004e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d98004a80 0x7f5d98004e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:42.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5db3fff700 1 -- 172.21.15.63:0/2621020790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d98004260 msgr2=0x7f5d9800b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d98004260 0x7f5d9800b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:42.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5db3fff700 1 -- 172.21.15.63:0/2621020790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db41537f0 con 0x7f5d980039a0 2020-05-18T21:37:42.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5db97e2700 1 -- 172.21.15.63:0/2621020790 reap_dead start 2020-05-18T21:37:42.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5dbb245700 1 -- 172.21.15.63:0/2621020790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db4144aa0 con 0x7f5d980039a0 2020-05-18T21:37:42.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d980039a0 0x7f5d98003e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5da4002f70 tx=0x7f5da4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5dbb245700 1 -- 172.21.15.63:0/2621020790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db40622a0 con 0x7f5d980039a0 2020-05-18T21:37:42.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d980039a0 0x7f5d98003e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5da4002f70 tx=0x7f5da4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d980039a0 0x7f5d98003e00 secure :-1 s=READY pgs=2032 cs=0 l=1 rx=0x7f5da4002f70 tx=0x7f5da4007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:42.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d980039a0 0x7f5d98003e00 secure :-1 s=THROTTLE_DONE pgs=2032 cs=0 l=1 rx=0x7f5da4002f70 tx=0x7f5da4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5db1ffb700 1 -- 172.21.15.63:0/2621020790 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5da400f5b0 con 0x7f5d980039a0 2020-05-18T21:37:42.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d980039a0 0x7f5d98003e00 secure :-1 s=THROTTLE_DONE pgs=2032 cs=0 l=1 rx=0x7f5da4002f70 tx=0x7f5da4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d980039a0 0x7f5d98003e00 secure :-1 s=THROTTLE_DONE pgs=2032 cs=0 l=1 rx=0x7f5da4002f70 tx=0x7f5da4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5db1ffb700 1 -- 172.21.15.63:0/2621020790 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da4007360 con 0x7f5d980039a0 2020-05-18T21:37:42.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5db1ffb700 1 -- 172.21.15.63:0/2621020790 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5da4007550 con 0x7f5d980039a0 2020-05-18T21:37:42.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5dbb245700 1 -- 172.21.15.63:0/2621020790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8c003380 con 0x7f5d980039a0 2020-05-18T21:37:42.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d980039a0 0x7f5d98003e00 secure :-1 s=THROTTLE_DONE pgs=2032 cs=0 l=1 rx=0x7f5da4002f70 tx=0x7f5da4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5db1ffb700 1 -- 172.21.15.63:0/2621020790 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5da40058f0 con 0x7f5d980039a0 2020-05-18T21:37:42.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.285+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d980039a0 0x7f5d98003e00 secure :-1 s=THROTTLE_DONE pgs=2032 cs=0 l=1 rx=0x7f5da4002f70 tx=0x7f5da4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.289+0000 7f5db1ffb700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5d98053750 0x7f5d98055c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:42.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.289+0000 7f5db1ffb700 1 -- 172.21.15.63:0/2621020790 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5da40646f0 con 0x7f5d980039a0 2020-05-18T21:37:42.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.289+0000 7f5db8fe1700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5d98053750 0x7f5d98055c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:42.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.289+0000 7f5db8fe1700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5d98053750 0x7f5d98055c10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5d9c007a80 tx=0x7f5d9c0029d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.289+0000 7f5db8fe1700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5d98053750 0x7f5d98055c10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5d9c007a80 tx=0x7f5d9c0029d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.289+0000 7f5db8fe1700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5d98053750 0x7f5d98055c10 secure :-1 s=READY pgs=796 cs=0 l=1 rx=0x7f5d9c007a80 tx=0x7f5d9c0029d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:42.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.293+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d980039a0 0x7f5d98003e00 secure :-1 s=THROTTLE_DONE pgs=2032 cs=0 l=1 rx=0x7f5da4002f70 tx=0x7f5da4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.293+0000 7f5db1ffb700 1 -- 172.21.15.63:0/2621020790 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f5da403eba0 con 0x7f5d980039a0 2020-05-18T21:37:42.448 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.441+0000 7f5dbb245700 1 -- 172.21.15.63:0/2621020790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5d8c002210 con 0x7f5d980039a0 2020-05-18T21:37:42.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.445+0000 7f5db3fff700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d980039a0 0x7f5d98003e00 secure :-1 s=THROTTLE_DONE pgs=2032 cs=0 l=1 rx=0x7f5da4002f70 tx=0x7f5da4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.445+0000 7f5db1ffb700 1 -- 172.21.15.63:0/2621020790 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v58) v1 ==== 80+0+4513 (secure 0 0 0) 0x7f5da40421c0 con 0x7f5d980039a0 2020-05-18T21:37:42.450 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:42.450 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:37:42.450 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_dump": [ 2020-05-18T21:37:42.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:42.451 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.a", 2020-05-18T21:37:42.451 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJekJyyLRAAfB5XJCsXTAmZdkFOaQrokg==", 2020-05-18T21:37:42.451 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:42.451 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:37:42.451 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:42.452 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:42.452 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:42.452 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:42.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:42.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:42.453 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.b", 2020-05-18T21:37:42.453 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeSVE8MRAAEEytuzLtcQMC+1uQ/yh8eA==", 2020-05-18T21:37:42.453 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:42.453 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:37:42.453 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:42.453 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:42.454 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:42.454 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:42.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:42.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:42.454 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.0", 2020-05-18T21:37:42.455 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBq/cJeIn7mJhAArx+YEdVbsfXXNOLWdaAgWw==", 2020-05-18T21:37:42.455 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:42.455 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:42.455 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:42.455 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:42.456 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:42.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:42.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:42.456 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.1", 2020-05-18T21:37:42.456 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBt/cJelHywCRAAFyQ3sPEE0RTSy4tKfsDfyw==", 2020-05-18T21:37:42.456 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:42.457 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:42.457 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:42.457 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:42.457 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:42.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:42.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:42.458 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.2", 2020-05-18T21:37:42.458 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBv/cJecexDLBAAxhlFq20MBkKvDjuM1yi8XQ==", 2020-05-18T21:37:42.458 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:42.458 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:42.459 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:42.459 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:42.459 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:42.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:42.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:42.459 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.3", 2020-05-18T21:37:42.460 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBy/cJe9IqwDxAAMg1In7bIITDcOZljzzTpDQ==", 2020-05-18T21:37:42.460 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:42.460 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:42.460 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:42.460 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:42.461 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:42.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:42.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:42.461 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.4", 2020-05-18T21:37:42.461 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB3/cJeLXgxFhAA/kMVV5hCRny2uXKvvbu8Og==", 2020-05-18T21:37:42.461 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:42.462 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:42.462 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:42.462 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:42.462 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:42.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:42.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:42.463 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.5", 2020-05-18T21:37:42.463 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB5/cJeucpsNRAAjGh+6yUC8Fji9PE4COi/Eg==", 2020-05-18T21:37:42.463 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:42.463 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:42.463 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:42.464 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:42.464 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:42.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:42.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:42.464 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.6", 2020-05-18T21:37:42.465 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB8/cJelSPpGhAAXobGqH9qaW1VZfEpH8bUbQ==", 2020-05-18T21:37:42.465 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:42.465 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:42.465 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:42.465 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:42.466 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:42.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:42.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:42.466 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.7", 2020-05-18T21:37:42.466 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB+/cJeUIl5OBAAPd8H8ohOWZw9ubO7uCB6zg==", 2020-05-18T21:37:42.467 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:42.467 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:42.467 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:42.467 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:42.467 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:42.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:42.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:42.468 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.0", 2020-05-18T21:37:42.468 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeap3RNhAAi2vKpsKtzSL1Uuqm8pWYJQ==", 2020-05-18T21:37:42.468 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:42.468 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:37:42.469 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:37:42.469 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:37:42.469 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:42.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:42.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:42.469 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.1", 2020-05-18T21:37:42.470 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJeekrQABAA5TmzWOt24C6hgZw/WTj5dw==", 2020-05-18T21:37:42.470 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:42.470 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:37:42.470 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:37:42.470 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:37:42.471 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:42.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:42.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:42.471 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.2", 2020-05-18T21:37:42.471 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJehSnFAxAAXUZwqNTXqAApEB3nXs4u6g==", 2020-05-18T21:37:42.471 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:42.472 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:37:42.472 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:37:42.472 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:37:42.472 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:42.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:42.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:42.474 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.3", 2020-05-18T21:37:42.474 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJe2HdDBhAA07y5pn/bKKa9TBbZFvIh9g==", 2020-05-18T21:37:42.474 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:42.474 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:37:42.475 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:37:42.475 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:37:42.475 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:42.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:42.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:42.475 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.admin", 2020-05-18T21:37:42.476 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJe/K4fGRAA+rP3BYuWiyx/fKmQ3bV6Lw==", 2020-05-18T21:37:42.476 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:42.476 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:37:42.476 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:37:42.476 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:37:42.477 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:42.477 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:42.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:42.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:42.477 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.x", 2020-05-18T21:37:42.477 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJemmqEKhAAe5ySRz8Id0ug4matQwL0uw==", 2020-05-18T21:37:42.478 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:42.478 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:37:42.478 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:37:42.478 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:42.478 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:42.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:42.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:42.479 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.y", 2020-05-18T21:37:42.479 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeF/BNJhAAi/vrldC6qoWJWnSHpE3ung==", 2020-05-18T21:37:42.479 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:37:42.479 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:37:42.480 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:37:42.480 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:37:42.480 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:42.480 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:42.480 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:37:42.481 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:37:42.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.445+0000 7f5dbb245700 1 -- 172.21.15.63:0/2621020790 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5d98053750 msgr2=0x7f5d98055c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.445+0000 7f5dbb245700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5d98053750 0x7f5d98055c10 secure :-1 s=READY pgs=796 cs=0 l=1 rx=0x7f5d9c007a80 tx=0x7f5d9c0029d0).stop 2020-05-18T21:37:42.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.445+0000 7f5dbb245700 1 -- 172.21.15.63:0/2621020790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d980039a0 msgr2=0x7f5d98003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.445+0000 7f5dbb245700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d980039a0 0x7f5d98003e00 secure :-1 s=READY pgs=2032 cs=0 l=1 rx=0x7f5da4002f70 tx=0x7f5da4007a80).stop 2020-05-18T21:37:42.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.445+0000 7f5dbb245700 1 -- 172.21.15.63:0/2621020790 shutdown_connections 2020-05-18T21:37:42.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.445+0000 7f5dbb245700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5d98053750 0x7f5d98055c10 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:42.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.445+0000 7f5dbb245700 1 --2- 172.21.15.63:0/2621020790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d980039a0 0x7f5d98003e00 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.445+0000 7f5dbb245700 1 -- 172.21.15.63:0/2621020790 >> 172.21.15.63:0/2621020790 conn(0x7f5db40b83d0 msgr2=0x7f5db40b8840 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.445+0000 7f5dbb245700 1 -- 172.21.15.63:0/2621020790 shutdown_connections 2020-05-18T21:37:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.445+0000 7f5dbb245700 1 -- 172.21.15.63:0/2621020790 wait complete. 2020-05-18T21:37:42.485 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:37:42.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.585+0000 7f043ffff700 1 Processor -- start 2020-05-18T21:37:42.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.585+0000 7f043ffff700 1 -- start start 2020-05-18T21:37:42.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.585+0000 7f043ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0440142bf0 0x7f0440065130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:42.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.585+0000 7f043ffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0440143090 con 0x7f0440061d80 2020-05-18T21:37:42.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.585+0000 7f043ffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0440143330 con 0x7f04400acbe0 2020-05-18T21:37:42.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.585+0000 7f043ffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04400b6b10 con 0x7f0440142bf0 2020-05-18T21:37:42.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.585+0000 7f043effd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0440061d80 0x7f04400ac4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38248/0 (socket says 172.21.15.63:38248) 2020-05-18T21:37:42.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.585+0000 7f043effd700 1 -- 172.21.15.63:0/3736296239 learned_addr learned my addr 172.21.15.63:0/3736296239 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:42.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.585+0000 7f043e7fc700 1 --2- 172.21.15.63:0/3736296239 >> v2:172.21.15.155:3300/0 conn(0x7f0440142bf0 0x7f0440065130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:42.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.585+0000 7f043dffb700 1 -- 172.21.15.63:0/3736296239 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737437811 0 0) 0x7f0440143090 con 0x7f0440061d80 2020-05-18T21:37:42.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.585+0000 7f043dffb700 1 -- 172.21.15.63:0/3736296239 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0424003270 con 0x7f0440061d80 2020-05-18T21:37:42.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043e7fc700 1 -- 172.21.15.63:0/3736296239 >> v1:172.21.15.155:6789/0 conn(0x7f04400acbe0 legacy=0x7f044014c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043dffb700 1 -- 172.21.15.63:0/3736296239 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3212572469 0 0) 0x7f0424003270 con 0x7f0440061d80 2020-05-18T21:37:42.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043e7fc700 1 -- 172.21.15.63:0/3736296239 >> v1:172.21.15.63:6789/0 conn(0x7f0440061d80 legacy=0x7f04400ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043e7fc700 1 -- 172.21.15.63:0/3736296239 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04401435d0 con 0x7f0440142bf0 2020-05-18T21:37:42.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043e7fc700 1 --2- 172.21.15.63:0/3736296239 >> v2:172.21.15.155:3300/0 conn(0x7f0440142bf0 0x7f0440065130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f04300018b0 tx=0x7f0434007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043e7fc700 1 --2- 172.21.15.63:0/3736296239 >> v2:172.21.15.155:3300/0 conn(0x7f0440142bf0 0x7f0440065130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f04300018b0 tx=0x7f0434007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043e7fc700 1 --2- 172.21.15.63:0/3736296239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0440142bf0 0x7f0440065130 secure :-1 s=READY pgs=1358 cs=0 l=1 rx=0x7f04300018b0 tx=0x7f0434007a80).ready entity=mon.1 client_cookie=996e3621bf9174c1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:42.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043e7fc700 1 --2- 172.21.15.63:0/3736296239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0440142bf0 0x7f0440065130 secure :-1 s=THROTTLE_DONE pgs=1358 cs=0 l=1 rx=0x7f04300018b0 tx=0x7f0434007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043dffb700 1 -- 172.21.15.63:0/3736296239 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0430001710 con 0x7f0440142bf0 2020-05-18T21:37:42.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043e7fc700 1 --2- 172.21.15.63:0/3736296239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0440142bf0 0x7f0440065130 secure :-1 s=THROTTLE_DONE pgs=1358 cs=0 l=1 rx=0x7f04300018b0 tx=0x7f0434007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043dffb700 1 -- 172.21.15.63:0/3736296239 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0434008e40 con 0x7f0440142bf0 2020-05-18T21:37:42.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043e7fc700 1 --2- 172.21.15.63:0/3736296239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0440142bf0 0x7f0440065130 secure :-1 s=THROTTLE_DONE pgs=1358 cs=0 l=1 rx=0x7f04300018b0 tx=0x7f0434007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043ffff700 1 -- 172.21.15.63:0/3736296239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0440142bf0 msgr2=0x7f0440065130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043dffb700 1 -- 172.21.15.63:0/3736296239 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0434013700 con 0x7f0440142bf0 2020-05-18T21:37:42.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043ffff700 1 --2- 172.21.15.63:0/3736296239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0440142bf0 0x7f0440065130 secure :-1 s=READY pgs=1358 cs=0 l=1 rx=0x7f04300018b0 tx=0x7f0434007a80).stop 2020-05-18T21:37:42.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043ffff700 1 -- 172.21.15.63:0/3736296239 shutdown_connections 2020-05-18T21:37:42.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043ffff700 1 --2- 172.21.15.63:0/3736296239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0440142bf0 0x7f0440065130 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:42.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043ffff700 1 -- 172.21.15.63:0/3736296239 >> 172.21.15.63:0/3736296239 conn(0x7f0440066d00 msgr2=0x7f044005a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:42.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043ffff700 1 -- 172.21.15.63:0/3736296239 shutdown_connections 2020-05-18T21:37:42.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043ffff700 1 -- 172.21.15.63:0/3736296239 wait complete. 2020-05-18T21:37:42.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043ffff700 1 Processor -- start 2020-05-18T21:37:42.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.589+0000 7f043ffff700 1 -- start start 2020-05-18T21:37:42.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04400acbe0 0x7f0440141950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:42.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0440142bf0 0x7f04401525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:42.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043ffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f044013fb70 con 0x7f0440061d80 2020-05-18T21:37:42.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043ffff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0440141f10 con 0x7f0440142bf0 2020-05-18T21:37:42.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043ffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04401424d0 con 0x7f04400acbe0 2020-05-18T21:37:42.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0440142bf0 0x7f04401525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:42.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043effd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0440061d80 0x7f0440144d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38252/0 (socket says 172.21.15.63:38252) 2020-05-18T21:37:42.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043effd700 1 -- 172.21.15.63:0/3142336765 learned_addr learned my addr 172.21.15.63:0/3142336765 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:42.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043e7fc700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04400acbe0 0x7f0440141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:42.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043f7fe700 1 -- 172.21.15.63:0/3142336765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04400acbe0 msgr2=0x7f0440141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043f7fe700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04400acbe0 0x7f0440141950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:42.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043f7fe700 1 -- 172.21.15.63:0/3142336765 >> v1:172.21.15.63:6789/0 conn(0x7f0440061d80 legacy=0x7f0440144d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f042ffff700 1 -- 172.21.15.63:0/3142336765 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665871535 0 0) 0x7f044013fb70 con 0x7f0440061d80 2020-05-18T21:37:42.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043f7fe700 1 -- 172.21.15.63:0/3142336765 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0440142970 con 0x7f0440142bf0 2020-05-18T21:37:42.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043e7fc700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04400acbe0 0x7f0440141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:37:42.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043f7fe700 1 --2- 172.21.15.63:0/3142336765 >> v2:172.21.15.63:3300/0 conn(0x7f0440142bf0 0x7f04401525c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f04400b72a0 tx=0x7f0438010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043f7fe700 1 --2- 172.21.15.63:0/3142336765 >> v2:172.21.15.63:3300/0 conn(0x7f0440142bf0 0x7f04401525c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f04400b72a0 tx=0x7f0438010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043f7fe700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0440142bf0 0x7f04401525c0 secure :-1 s=READY pgs=2035 cs=0 l=1 rx=0x7f04400b72a0 tx=0x7f0438010c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:42.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043f7fe700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0440142bf0 0x7f04401525c0 secure :-1 s=THROTTLE_DONE pgs=2035 cs=0 l=1 rx=0x7f04400b72a0 tx=0x7f0438010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f042ffff700 1 -- 172.21.15.63:0/3142336765 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0438012330 con 0x7f0440142bf0 2020-05-18T21:37:42.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043f7fe700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0440142bf0 0x7f04401525c0 secure :-1 s=THROTTLE_DONE pgs=2035 cs=0 l=1 rx=0x7f04400b72a0 tx=0x7f0438010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043f7fe700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0440142bf0 0x7f04401525c0 secure :-1 s=THROTTLE_DONE pgs=2035 cs=0 l=1 rx=0x7f04400b72a0 tx=0x7f0438010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f042ffff700 1 -- 172.21.15.63:0/3142336765 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0438012490 con 0x7f0440142bf0 2020-05-18T21:37:42.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043ffff700 1 -- 172.21.15.63:0/3142336765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04401421b0 con 0x7f0440142bf0 2020-05-18T21:37:42.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f042ffff700 1 -- 172.21.15.63:0/3142336765 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0438012870 con 0x7f0440142bf0 2020-05-18T21:37:42.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043ffff700 1 -- 172.21.15.63:0/3142336765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0440152c40 con 0x7f0440142bf0 2020-05-18T21:37:42.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043f7fe700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0440142bf0 0x7f04401525c0 secure :-1 s=THROTTLE_DONE pgs=2035 cs=0 l=1 rx=0x7f04400b72a0 tx=0x7f0438010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043ffff700 1 -- 172.21.15.63:0/3142336765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0440153290 con 0x7f0440142bf0 2020-05-18T21:37:42.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f042ffff700 1 -- 172.21.15.63:0/3142336765 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0438012ae0 con 0x7f0440142bf0 2020-05-18T21:37:42.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.593+0000 7f043f7fe700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0440142bf0 0x7f04401525c0 secure :-1 s=THROTTLE_DONE pgs=2035 cs=0 l=1 rx=0x7f04400b72a0 tx=0x7f0438010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.597+0000 7f042ffff700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f041c04f890 0x7f041c051d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:42.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.597+0000 7f042ffff700 1 -- 172.21.15.63:0/3142336765 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f0438064330 con 0x7f0440142bf0 2020-05-18T21:37:42.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.597+0000 7f043effd700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f041c04f890 0x7f041c051d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:42.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.597+0000 7f043effd700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f041c04f890 0x7f041c051d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0430001830 tx=0x7f0430000f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.597+0000 7f043effd700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f041c04f890 0x7f041c051d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0430001830 tx=0x7f0430000f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.597+0000 7f043effd700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f041c04f890 0x7f041c051d50 secure :-1 s=READY pgs=797 cs=0 l=1 rx=0x7f0430001830 tx=0x7f0430000f30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.601+0000 7f043f7fe700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0440142bf0 0x7f04401525c0 secure :-1 s=THROTTLE_DONE pgs=2035 cs=0 l=1 rx=0x7f04400b72a0 tx=0x7f0438010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.601+0000 7f042ffff700 1 -- 172.21.15.63:0/3142336765 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f043803e6c0 con 0x7f0440142bf0 2020-05-18T21:37:42.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.717+0000 7f043ffff700 1 -- 172.21.15.63:0/3142336765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0440142340 con 0x7f0440142bf0 2020-05-18T21:37:42.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.721+0000 7f043f7fe700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0440142bf0 0x7f04401525c0 secure :-1 s=THROTTLE_DONE pgs=2035 cs=0 l=1 rx=0x7f04400b72a0 tx=0x7f0438010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.721+0000 7f042ffff700 1 -- 172.21.15.63:0/3142336765 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+13242 (secure 0 0 0) 0x7f0438041ce0 con 0x7f0440142bf0 2020-05-18T21:37:42.726 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:42.726 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":152,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:37:42.141141+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:37:42.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.721+0000 7f043ffff700 1 -- 172.21.15.63:0/3142336765 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f041c04f890 msgr2=0x7f041c051d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.721+0000 7f043ffff700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f041c04f890 0x7f041c051d50 secure :-1 s=READY pgs=797 cs=0 l=1 rx=0x7f0430001830 tx=0x7f0430000f30).stop 2020-05-18T21:37:42.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.721+0000 7f043ffff700 1 -- 172.21.15.63:0/3142336765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0440142bf0 msgr2=0x7f04401525c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.721+0000 7f043ffff700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0440142bf0 0x7f04401525c0 secure :-1 s=READY pgs=2035 cs=0 l=1 rx=0x7f04400b72a0 tx=0x7f0438010c90).stop 2020-05-18T21:37:42.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.721+0000 7f043ffff700 1 -- 172.21.15.63:0/3142336765 shutdown_connections 2020-05-18T21:37:42.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.721+0000 7f043ffff700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f041c04f890 0x7f041c051d50 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:42.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.721+0000 7f043ffff700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0440142bf0 0x7f04401525c0 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:42.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.721+0000 7f043ffff700 1 --2- 172.21.15.63:0/3142336765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04400acbe0 0x7f0440141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:42.729 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.721+0000 7f043ffff700 1 -- 172.21.15.63:0/3142336765 >> 172.21.15.63:0/3142336765 conn(0x7f0440066d00 msgr2=0x7f044013c930 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:42.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.721+0000 7f043ffff700 1 -- 172.21.15.63:0/3142336765 shutdown_connections 2020-05-18T21:37:42.730 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.721+0000 7f043ffff700 1 -- 172.21.15.63:0/3142336765 wait complete. 2020-05-18T21:37:42.739 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-05-18T21:37:42.740 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:37:42.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccbd8d9700 1 Processor -- start 2020-05-18T21:37:42.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccbd8d9700 1 -- start start 2020-05-18T21:37:42.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccbd8d9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb80bc8d0 0x7fccb8060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:42.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccbd8d9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fccb8145e30 0x7fccb8142f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:42.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccbd8d9700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb8146420 con 0x7fccb8143380 2020-05-18T21:37:42.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccbd8d9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb8146e00 con 0x7fccb8145e30 2020-05-18T21:37:42.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccbd8d9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb81466c0 con 0x7fccb80bc8d0 2020-05-18T21:37:42.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccb7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fccb8145e30 0x7fccb8142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:42.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccbd0d8700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fccb8143380 0x7fccb812e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38264/0 (socket says 172.21.15.63:38264) 2020-05-18T21:37:42.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccbd0d8700 1 -- 172.21.15.63:0/2955012106 learned_addr learned my addr 172.21.15.63:0/2955012106 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:42.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccbc8d7700 1 --2- 172.21.15.63:0/2955012106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb80bc8d0 0x7fccb8060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:42.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccb77fe700 1 -- 172.21.15.63:0/2955012106 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261272070 0 0) 0x7fccb8146420 con 0x7fccb8143380 2020-05-18T21:37:42.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccb77fe700 1 -- 172.21.15.63:0/2955012106 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcca4003270 con 0x7fccb8143380 2020-05-18T21:37:42.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccbc8d7700 1 -- 172.21.15.63:0/2955012106 >> v2:172.21.15.63:3300/0 conn(0x7fccb8145e30 msgr2=0x7fccb8142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:42.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccbc8d7700 1 --2- 172.21.15.63:0/2955012106 >> v2:172.21.15.63:3300/0 conn(0x7fccb8145e30 0x7fccb8142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:42.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccbc8d7700 1 -- 172.21.15.63:0/2955012106 >> v1:172.21.15.63:6789/0 conn(0x7fccb8143380 legacy=0x7fccb812e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccb77fe700 1 -- 172.21.15.63:0/2955012106 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1089829251 0 0) 0x7fcca4003270 con 0x7fccb8143380 2020-05-18T21:37:42.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccbc8d7700 1 -- 172.21.15.63:0/2955012106 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb8146960 con 0x7fccb80bc8d0 2020-05-18T21:37:42.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccb7fff700 1 --2- 172.21.15.63:0/2955012106 >> v2:172.21.15.63:3300/0 conn(0x7fccb8145e30 0x7fccb8142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:42.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccbc8d7700 1 --2- 172.21.15.63:0/2955012106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb80bc8d0 0x7fccb8060b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fccb0001c30 tx=0x7fccac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccbc8d7700 1 --2- 172.21.15.63:0/2955012106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb80bc8d0 0x7fccb8060b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fccb0001c30 tx=0x7fccac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.845+0000 7fccbc8d7700 1 --2- 172.21.15.63:0/2955012106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb80bc8d0 0x7fccb8060b00 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7fccb0001c30 tx=0x7fccac007a80).ready entity=mon.2 client_cookie=f6399218226a51a3 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:42.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.849+0000 7fccbc8d7700 1 --2- 172.21.15.63:0/2955012106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb80bc8d0 0x7fccb8060b00 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7fccb0001c30 tx=0x7fccac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.849+0000 7fccb77fe700 1 -- 172.21.15.63:0/2955012106 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccb0001a90 con 0x7fccb80bc8d0 2020-05-18T21:37:42.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.849+0000 7fccbc8d7700 1 --2- 172.21.15.63:0/2955012106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb80bc8d0 0x7fccb8060b00 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7fccb0001c30 tx=0x7fccac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.849+0000 7fccb77fe700 1 -- 172.21.15.63:0/2955012106 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccac008e40 con 0x7fccb80bc8d0 2020-05-18T21:37:42.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.849+0000 7fccbc8d7700 1 --2- 172.21.15.63:0/2955012106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb80bc8d0 0x7fccb8060b00 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7fccb0001c30 tx=0x7fccac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.849+0000 7fccb77fe700 1 -- 172.21.15.63:0/2955012106 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccac011440 con 0x7fccb80bc8d0 2020-05-18T21:37:42.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.849+0000 7fccbd8d9700 1 -- 172.21.15.63:0/2955012106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb80bc8d0 msgr2=0x7fccb8060b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.849+0000 7fccbd8d9700 1 --2- 172.21.15.63:0/2955012106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb80bc8d0 0x7fccb8060b00 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7fccb0001c30 tx=0x7fccac007a80).stop 2020-05-18T21:37:42.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.849+0000 7fccbd8d9700 1 -- 172.21.15.63:0/2955012106 shutdown_connections 2020-05-18T21:37:42.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.849+0000 7fccbd8d9700 1 --2- 172.21.15.63:0/2955012106 >> v2:172.21.15.63:3300/0 conn(0x7fccb8145e30 0x7fccb8142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:42.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.849+0000 7fccbd8d9700 1 --2- 172.21.15.63:0/2955012106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb80bc8d0 0x7fccb8060b00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:42.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.849+0000 7fccbd8d9700 1 -- 172.21.15.63:0/2955012106 >> 172.21.15.63:0/2955012106 conn(0x7fccb805f3b0 msgr2=0x7fccb805f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:42.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.849+0000 7fccbd8d9700 1 -- 172.21.15.63:0/2955012106 shutdown_connections 2020-05-18T21:37:42.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.849+0000 7fccbd8d9700 1 -- 172.21.15.63:0/2955012106 wait complete. 2020-05-18T21:37:42.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.849+0000 7fccbd8d9700 1 Processor -- start 2020-05-18T21:37:42.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.849+0000 7fccbd8d9700 1 -- start start 2020-05-18T21:37:42.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbd8d9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb8143380 0x7fccb80af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:42.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbd8d9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fccb8145e30 0x7fccb8148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:42.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbd8d9700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb80acd00 con 0x7fccb80bc8d0 2020-05-18T21:37:42.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbd8d9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb80acfa0 con 0x7fccb8145e30 2020-05-18T21:37:42.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbd8d9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb80ad240 con 0x7fccb8143380 2020-05-18T21:37:42.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbd0d8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fccb8145e30 0x7fccb8148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:42.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbc8d7700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fccb80bc8d0 0x7fccb80ac4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38266/0 (socket says 172.21.15.63:38266) 2020-05-18T21:37:42.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbc8d7700 1 -- 172.21.15.63:0/2432444282 learned_addr learned my addr 172.21.15.63:0/2432444282 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccb7fff700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb8143380 0x7fccb80af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccb5ffb700 1 -- 172.21.15.63:0/2432444282 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830964423 0 0) 0x7fccb80acd00 con 0x7fccb80bc8d0 2020-05-18T21:37:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbd0d8700 1 -- 172.21.15.63:0/2432444282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb8143380 msgr2=0x7fccb80af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbd0d8700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb8143380 0x7fccb80af680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbd0d8700 1 -- 172.21.15.63:0/2432444282 >> v1:172.21.15.63:6789/0 conn(0x7fccb80bc8d0 legacy=0x7fccb80ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbd0d8700 1 -- 172.21.15.63:0/2432444282 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb81484d0 con 0x7fccb8145e30 2020-05-18T21:37:42.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbd0d8700 1 --2- 172.21.15.63:0/2432444282 >> v2:172.21.15.63:3300/0 conn(0x7fccb8145e30 0x7fccb8148070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fccb0001cf0 tx=0x7fccb000c8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbd0d8700 1 --2- 172.21.15.63:0/2432444282 >> v2:172.21.15.63:3300/0 conn(0x7fccb8145e30 0x7fccb8148070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fccb0001cf0 tx=0x7fccb000c8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbd0d8700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccb8145e30 0x7fccb8148070 secure :-1 s=READY pgs=2038 cs=0 l=1 rx=0x7fccb0001cf0 tx=0x7fccb000c8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:42.868 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbd0d8700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccb8145e30 0x7fccb8148070 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7fccb0001cf0 tx=0x7fccb000c8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbd0d8700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccb8145e30 0x7fccb8148070 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7fccb0001cf0 tx=0x7fccb000c8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccb5ffb700 1 -- 172.21.15.63:0/2432444282 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccb000cd10 con 0x7fccb8145e30 2020-05-18T21:37:42.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbd0d8700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccb8145e30 0x7fccb8148070 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7fccb0001cf0 tx=0x7fccb000c8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccb5ffb700 1 -- 172.21.15.63:0/2432444282 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb000ce70 con 0x7fccb8145e30 2020-05-18T21:37:42.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbd8d9700 1 -- 172.21.15.63:0/2432444282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb81486c0 con 0x7fccb8145e30 2020-05-18T21:37:42.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccb5ffb700 1 -- 172.21.15.63:0/2432444282 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccb0004aa0 con 0x7fccb8145e30 2020-05-18T21:37:42.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbd8d9700 1 -- 172.21.15.63:0/2432444282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb80adbb0 con 0x7fccb8145e30 2020-05-18T21:37:42.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.853+0000 7fccbd0d8700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccb8145e30 0x7fccb8148070 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7fccb0001cf0 tx=0x7fccb000c8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.857+0000 7fccbd8d9700 1 -- 172.21.15.63:0/2432444282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb80ad3e0 con 0x7fccb8145e30 2020-05-18T21:37:42.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.857+0000 7fccb5ffb700 1 -- 172.21.15.63:0/2432444282 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fccb0004cd0 con 0x7fccb8145e30 2020-05-18T21:37:42.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.857+0000 7fccbd0d8700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccb8145e30 0x7fccb8148070 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7fccb0001cf0 tx=0x7fccb000c8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.857+0000 7fccb5ffb700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc9804f8b0 0x7fcc98051d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:42.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.857+0000 7fccb5ffb700 1 -- 172.21.15.63:0/2432444282 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fccb0063bb0 con 0x7fccb8145e30 2020-05-18T21:37:42.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.857+0000 7fccbc8d7700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc9804f8b0 0x7fcc98051d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:42.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.857+0000 7fccbc8d7700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc9804f8b0 0x7fcc98051d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fccac008360 tx=0x7fccac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.857+0000 7fccbc8d7700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc9804f8b0 0x7fcc98051d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fccac008360 tx=0x7fccac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.857+0000 7fccbc8d7700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc9804f8b0 0x7fcc98051d70 secure :-1 s=READY pgs=798 cs=0 l=1 rx=0x7fccac008360 tx=0x7fccac007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:42.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.861+0000 7fccbd0d8700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccb8145e30 0x7fccb8148070 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7fccb0001cf0 tx=0x7fccb000c8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.861+0000 7fccb5ffb700 1 -- 172.21.15.63:0/2432444282 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fccb003df40 con 0x7fccb8145e30 2020-05-18T21:37:42.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.981+0000 7fccbd8d9700 1 -- 172.21.15.63:0/2432444282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fccb80569e0 con 0x7fccb8145e30 2020-05-18T21:37:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.981+0000 7fccbd0d8700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccb8145e30 0x7fccb8148070 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7fccb0001cf0 tx=0x7fccb000c8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.981+0000 7fccb5ffb700 1 -- 172.21.15.63:0/2432444282 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v152) v1 ==== 110+0+10 (secure 0 0 0) 0x7fccb0041560 con 0x7fccb8145e30 2020-05-18T21:37:42.988 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:37:42.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.985+0000 7fccbd8d9700 1 -- 172.21.15.63:0/2432444282 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc9804f8b0 msgr2=0x7fcc98051d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.985+0000 7fccbd8d9700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc9804f8b0 0x7fcc98051d70 secure :-1 s=READY pgs=798 cs=0 l=1 rx=0x7fccac008360 tx=0x7fccac007a80).stop 2020-05-18T21:37:42.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.985+0000 7fccbd8d9700 1 -- 172.21.15.63:0/2432444282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccb8145e30 msgr2=0x7fccb8148070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:42.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.985+0000 7fccbd8d9700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccb8145e30 0x7fccb8148070 secure :-1 s=READY pgs=2038 cs=0 l=1 rx=0x7fccb0001cf0 tx=0x7fccb000c8d0).stop 2020-05-18T21:37:42.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.985+0000 7fccbd8d9700 1 -- 172.21.15.63:0/2432444282 shutdown_connections 2020-05-18T21:37:42.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.985+0000 7fccbd8d9700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc9804f8b0 0x7fcc98051d70 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.985+0000 7fccbd8d9700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccb8145e30 0x7fccb8148070 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.985+0000 7fccbd8d9700 1 --2- 172.21.15.63:0/2432444282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb8143380 0x7fccb80af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.985+0000 7fccbd8d9700 1 -- 172.21.15.63:0/2432444282 >> 172.21.15.63:0/2432444282 conn(0x7fccb805f3b0 msgr2=0x7fccb8061020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.985+0000 7fccbd8d9700 1 -- 172.21.15.63:0/2432444282 shutdown_connections 2020-05-18T21:37:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:42.985+0000 7fccbd8d9700 1 -- 172.21.15.63:0/2432444282 wait complete. 2020-05-18T21:37:43.001 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:37:43.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.097+0000 7f7d951b9700 1 Processor -- start 2020-05-18T21:37:43.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.097+0000 7f7d951b9700 1 -- start start 2020-05-18T21:37:43.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d951b9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7d90149d50 0x7f7d9006a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:43.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d951b9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7d900ad3f0 0x7f7d900ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:43.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d951b9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d900adcc0 0x7f7d90060660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:43.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d951b9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d900b3790 con 0x7f7d900ad3f0 2020-05-18T21:37:43.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d951b9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d900b39f0 con 0x7f7d90149d50 2020-05-18T21:37:43.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d951b9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d900b3c90 con 0x7f7d900adcc0 2020-05-18T21:37:43.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d8f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7d900ad3f0 0x7f7d900ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:43.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d8f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7d900ad3f0 0x7f7d900ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36086/0 (socket says 172.21.15.63:36086) 2020-05-18T21:37:43.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d8f7fe700 1 -- 172.21.15.63:0/2739011285 learned_addr learned my addr 172.21.15.63:0/2739011285 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:43.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d8ffff700 1 --2- 172.21.15.63:0/2739011285 >> v2:172.21.15.155:3300/0 conn(0x7f7d90149d50 0x7f7d9006a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:43.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d949b8700 1 --2- 172.21.15.63:0/2739011285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d900adcc0 0x7f7d90060660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:43.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d8f7fe700 1 -- 172.21.15.63:0/2739011285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d900adcc0 msgr2=0x7f7d90060660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:43.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d8f7fe700 1 --2- 172.21.15.63:0/2739011285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d900adcc0 0x7f7d90060660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:43.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d8f7fe700 1 -- 172.21.15.63:0/2739011285 >> v2:172.21.15.155:3300/0 conn(0x7f7d90149d50 msgr2=0x7f7d9006a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:43.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d8f7fe700 1 --2- 172.21.15.63:0/2739011285 >> v2:172.21.15.155:3300/0 conn(0x7f7d90149d50 0x7f7d9006a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:43.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d8f7fe700 1 -- 172.21.15.63:0/2739011285 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d900ae400 con 0x7f7d900ad3f0 2020-05-18T21:37:43.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d8f7fe700 1 --2- 172.21.15.63:0/2739011285 >> v2:172.21.15.63:3300/0 conn(0x7f7d900ad3f0 0x7f7d900ad860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7d78002f70 tx=0x7f7d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d8f7fe700 1 --2- 172.21.15.63:0/2739011285 >> v2:172.21.15.63:3300/0 conn(0x7f7d900ad3f0 0x7f7d900ad860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7d78002f70 tx=0x7f7d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d8f7fe700 1 --2- 172.21.15.63:0/2739011285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d900ad3f0 0x7f7d900ad860 secure :-1 s=READY pgs=2039 cs=0 l=1 rx=0x7f7d78002f70 tx=0x7f7d78007a80).ready entity=mon.0 client_cookie=1688ba6b7aeb3e57 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:43.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d8f7fe700 1 --2- 172.21.15.63:0/2739011285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d900ad3f0 0x7f7d900ad860 secure :-1 s=THROTTLE_DONE pgs=2039 cs=0 l=1 rx=0x7f7d78002f70 tx=0x7f7d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d8effd700 1 -- 172.21.15.63:0/2739011285 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d78008e50 con 0x7f7d900ad3f0 2020-05-18T21:37:43.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d8f7fe700 1 --2- 172.21.15.63:0/2739011285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d900ad3f0 0x7f7d900ad860 secure :-1 s=THROTTLE_DONE pgs=2039 cs=0 l=1 rx=0x7f7d78002f70 tx=0x7f7d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d8effd700 1 -- 172.21.15.63:0/2739011285 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d78010800 con 0x7f7d900ad3f0 2020-05-18T21:37:43.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d8f7fe700 1 --2- 172.21.15.63:0/2739011285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d900ad3f0 0x7f7d900ad860 secure :-1 s=THROTTLE_DONE pgs=2039 cs=0 l=1 rx=0x7f7d78002f70 tx=0x7f7d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d8effd700 1 -- 172.21.15.63:0/2739011285 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d78010c20 con 0x7f7d900ad3f0 2020-05-18T21:37:43.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d951b9700 1 -- 172.21.15.63:0/2739011285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d900ad3f0 msgr2=0x7f7d900ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:43.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d951b9700 1 --2- 172.21.15.63:0/2739011285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d900ad3f0 0x7f7d900ad860 secure :-1 s=READY pgs=2039 cs=0 l=1 rx=0x7f7d78002f70 tx=0x7f7d78007a80).stop 2020-05-18T21:37:43.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d951b9700 1 -- 172.21.15.63:0/2739011285 shutdown_connections 2020-05-18T21:37:43.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d951b9700 1 --2- 172.21.15.63:0/2739011285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d900adcc0 0x7f7d90060660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:43.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d951b9700 1 --2- 172.21.15.63:0/2739011285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d900ad3f0 0x7f7d900ad860 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:43.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d951b9700 1 --2- 172.21.15.63:0/2739011285 >> v2:172.21.15.155:3300/0 conn(0x7f7d90149d50 0x7f7d9006a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:43.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d951b9700 1 -- 172.21.15.63:0/2739011285 >> 172.21.15.63:0/2739011285 conn(0x7f7d9005fb90 msgr2=0x7f7d90069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:43.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d951b9700 1 -- 172.21.15.63:0/2739011285 shutdown_connections 2020-05-18T21:37:43.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.101+0000 7f7d951b9700 1 -- 172.21.15.63:0/2739011285 wait complete. 2020-05-18T21:37:43.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d951b9700 1 Processor -- start 2020-05-18T21:37:43.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d951b9700 1 -- start start 2020-05-18T21:37:43.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d951b9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d900ad3f0 0x7f7d90064000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:43.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d951b9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7d900adcc0 0x7f7d900649e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:43.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d951b9700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d90143c50 con 0x7f7d90149d50 2020-05-18T21:37:43.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d951b9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d90141e30 con 0x7f7d900adcc0 2020-05-18T21:37:43.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d951b9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d90061a70 con 0x7f7d900ad3f0 2020-05-18T21:37:43.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d8f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7d900adcc0 0x7f7d900649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:43.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d949b8700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7d90149d50 0x7f7d90062d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38284/0 (socket says 172.21.15.63:38284) 2020-05-18T21:37:43.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d949b8700 1 -- 172.21.15.63:0/2644499445 learned_addr learned my addr 172.21.15.63:0/2644499445 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:43.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d8ffff700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d900ad3f0 0x7f7d90064000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:43.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d8d7fa700 1 -- 172.21.15.63:0/2644499445 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642744535 0 0) 0x7f7d90143c50 con 0x7f7d90149d50 2020-05-18T21:37:43.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d8d7fa700 1 -- 172.21.15.63:0/2644499445 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d74002fe0 con 0x7f7d90149d50 2020-05-18T21:37:43.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d8f7fe700 1 -- 172.21.15.63:0/2644499445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d900ad3f0 msgr2=0x7f7d90064000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:43.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d8f7fe700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d900ad3f0 0x7f7d90064000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:43.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d8f7fe700 1 -- 172.21.15.63:0/2644499445 >> v1:172.21.15.63:6789/0 conn(0x7f7d90149d50 legacy=0x7f7d90062d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:43.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d8d7fa700 1 -- 172.21.15.63:0/2644499445 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3177540768 0 0) 0x7f7d74002fe0 con 0x7f7d90149d50 2020-05-18T21:37:43.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d8f7fe700 1 -- 172.21.15.63:0/2644499445 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d90061d10 con 0x7f7d900adcc0 2020-05-18T21:37:43.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d8ffff700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d900ad3f0 0x7f7d90064000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:43.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d8f7fe700 1 --2- 172.21.15.63:0/2644499445 >> v2:172.21.15.63:3300/0 conn(0x7f7d900adcc0 0x7f7d900649e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d78002f70 tx=0x7f7d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d8f7fe700 1 --2- 172.21.15.63:0/2644499445 >> v2:172.21.15.63:3300/0 conn(0x7f7d900adcc0 0x7f7d900649e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d78002f70 tx=0x7f7d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d8f7fe700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d900adcc0 0x7f7d900649e0 secure :-1 s=READY pgs=2041 cs=0 l=1 rx=0x7f7d78002f70 tx=0x7f7d78007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:43.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d8f7fe700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d900adcc0 0x7f7d900649e0 secure :-1 s=THROTTLE_DONE pgs=2041 cs=0 l=1 rx=0x7f7d78002f70 tx=0x7f7d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d8d7fa700 1 -- 172.21.15.63:0/2644499445 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d78007370 con 0x7f7d900adcc0 2020-05-18T21:37:43.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d8f7fe700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d900adcc0 0x7f7d900649e0 secure :-1 s=THROTTLE_DONE pgs=2041 cs=0 l=1 rx=0x7f7d78002f70 tx=0x7f7d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d8f7fe700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d900adcc0 0x7f7d900649e0 secure :-1 s=THROTTLE_DONE pgs=2041 cs=0 l=1 rx=0x7f7d78002f70 tx=0x7f7d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d8d7fa700 1 -- 172.21.15.63:0/2644499445 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d780074d0 con 0x7f7d900adcc0 2020-05-18T21:37:43.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d951b9700 1 -- 172.21.15.63:0/2644499445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d90063460 con 0x7f7d900adcc0 2020-05-18T21:37:43.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d8d7fa700 1 -- 172.21.15.63:0/2644499445 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d7800f6c0 con 0x7f7d900adcc0 2020-05-18T21:37:43.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.105+0000 7f7d951b9700 1 -- 172.21.15.63:0/2644499445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d901436b0 con 0x7f7d900adcc0 2020-05-18T21:37:43.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.109+0000 7f7d8f7fe700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d900adcc0 0x7f7d900649e0 secure :-1 s=THROTTLE_DONE pgs=2041 cs=0 l=1 rx=0x7f7d78002f70 tx=0x7f7d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.109+0000 7f7d951b9700 1 -- 172.21.15.63:0/2644499445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d900569e0 con 0x7f7d900adcc0 2020-05-18T21:37:43.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.109+0000 7f7d8d7fa700 1 -- 172.21.15.63:0/2644499445 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7d78005700 con 0x7f7d900adcc0 2020-05-18T21:37:43.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.109+0000 7f7d8f7fe700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d900adcc0 0x7f7d900649e0 secure :-1 s=THROTTLE_DONE pgs=2041 cs=0 l=1 rx=0x7f7d78002f70 tx=0x7f7d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.109+0000 7f7d8d7fa700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7d7404fd40 0x7f7d74052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:43.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.109+0000 7f7d8d7fa700 1 -- 172.21.15.63:0/2644499445 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7d78063800 con 0x7f7d900adcc0 2020-05-18T21:37:43.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.109+0000 7f7d8ffff700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7d7404fd40 0x7f7d74052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:43.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.109+0000 7f7d8ffff700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7d7404fd40 0x7f7d74052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d80002f70 tx=0x7f7d8000b4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.109+0000 7f7d8ffff700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7d7404fd40 0x7f7d74052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d80002f70 tx=0x7f7d8000b4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.109+0000 7f7d8ffff700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7d7404fd40 0x7f7d74052200 secure :-1 s=READY pgs=799 cs=0 l=1 rx=0x7f7d80002f70 tx=0x7f7d8000b4a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:43.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.117+0000 7f7d8f7fe700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d900adcc0 0x7f7d900649e0 secure :-1 s=THROTTLE_DONE pgs=2041 cs=0 l=1 rx=0x7f7d78002f70 tx=0x7f7d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.117+0000 7f7d8d7fa700 1 -- 172.21.15.63:0/2644499445 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f7d7803dc50 con 0x7f7d900adcc0 2020-05-18T21:37:43.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.233+0000 7f7d951b9700 1 -- 172.21.15.63:0/2644499445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7d90061ea0 con 0x7f7d900adcc0 2020-05-18T21:37:43.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.233+0000 7f7d8f7fe700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d900adcc0 0x7f7d900649e0 secure :-1 s=THROTTLE_DONE pgs=2041 cs=0 l=1 rx=0x7f7d78002f70 tx=0x7f7d78007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.233+0000 7f7d8d7fa700 1 -- 172.21.15.63:0/2644499445 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v152) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7d780150f0 con 0x7f7d900adcc0 2020-05-18T21:37:43.239 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:37:43.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.233+0000 7f7d951b9700 1 -- 172.21.15.63:0/2644499445 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7d7404fd40 msgr2=0x7f7d74052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:43.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.233+0000 7f7d951b9700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7d7404fd40 0x7f7d74052200 secure :-1 s=READY pgs=799 cs=0 l=1 rx=0x7f7d80002f70 tx=0x7f7d8000b4a0).stop 2020-05-18T21:37:43.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.233+0000 7f7d951b9700 1 -- 172.21.15.63:0/2644499445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d900adcc0 msgr2=0x7f7d900649e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:43.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.233+0000 7f7d951b9700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d900adcc0 0x7f7d900649e0 secure :-1 s=READY pgs=2041 cs=0 l=1 rx=0x7f7d78002f70 tx=0x7f7d78007a80).stop 2020-05-18T21:37:43.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.237+0000 7f7d951b9700 1 -- 172.21.15.63:0/2644499445 shutdown_connections 2020-05-18T21:37:43.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.237+0000 7f7d951b9700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7d7404fd40 0x7f7d74052200 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:43.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.237+0000 7f7d951b9700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d900adcc0 0x7f7d900649e0 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:43.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.237+0000 7f7d951b9700 1 --2- 172.21.15.63:0/2644499445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d900ad3f0 0x7f7d90064000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:43.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.237+0000 7f7d951b9700 1 -- 172.21.15.63:0/2644499445 >> 172.21.15.63:0/2644499445 conn(0x7f7d9005fb90 msgr2=0x7f7d900b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:43.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.237+0000 7f7d951b9700 1 -- 172.21.15.63:0/2644499445 shutdown_connections 2020-05-18T21:37:43.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.237+0000 7f7d951b9700 1 -- 172.21.15.63:0/2644499445 wait complete. 2020-05-18T21:37:43.256 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-05-18T21:37:43.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.353+0000 7effa359e700 1 Processor -- start 2020-05-18T21:37:43.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.353+0000 7effa359e700 1 -- start start 2020-05-18T21:37:43.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.353+0000 7effa359e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7effa405f110 0x7effa40b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:43.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.353+0000 7effa359e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa414a330 con 0x7effa4064fd0 2020-05-18T21:37:43.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.353+0000 7effa359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa414a5d0 con 0x7effa414aa70 2020-05-18T21:37:43.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.353+0000 7effa359e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa414a140 con 0x7effa405f110 2020-05-18T21:37:43.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.353+0000 7effa259c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7effa405f110 0x7effa40b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:43.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.353+0000 7effa2d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7effa4064fd0 0x7effa414d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38292/0 (socket says 172.21.15.63:38292) 2020-05-18T21:37:43.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.353+0000 7effa2d9d700 1 -- 172.21.15.63:0/3373666366 learned_addr learned my addr 172.21.15.63:0/3373666366 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:43.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.353+0000 7effa159a700 1 -- 172.21.15.63:0/3373666366 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606961451 0 0) 0x7effa414a330 con 0x7effa4064fd0 2020-05-18T21:37:43.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.353+0000 7effa159a700 1 -- 172.21.15.63:0/3373666366 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff88003270 con 0x7effa4064fd0 2020-05-18T21:37:43.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.353+0000 7effa159a700 1 -- 172.21.15.63:0/3373666366 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960848966 0 0) 0x7effa414a5d0 con 0x7effa414aa70 2020-05-18T21:37:43.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.353+0000 7effa159a700 1 -- 172.21.15.63:0/3373666366 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effa414a330 con 0x7effa414aa70 2020-05-18T21:37:43.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.353+0000 7effa259c700 1 -- 172.21.15.63:0/3373666366 >> v1:172.21.15.155:6789/0 conn(0x7effa414aa70 legacy=0x7effa40648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:43.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.353+0000 7effa259c700 1 -- 172.21.15.63:0/3373666366 >> v1:172.21.15.63:6789/0 conn(0x7effa4064fd0 legacy=0x7effa414d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:43.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.353+0000 7effa259c700 1 -- 172.21.15.63:0/3373666366 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa4063430 con 0x7effa405f110 2020-05-18T21:37:43.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.353+0000 7effa259c700 1 --2- 172.21.15.63:0/3373666366 >> v2:172.21.15.63:3300/0 conn(0x7effa405f110 0x7effa40b4760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7eff94002f70 tx=0x7eff94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa259c700 1 --2- 172.21.15.63:0/3373666366 >> v2:172.21.15.63:3300/0 conn(0x7effa405f110 0x7effa40b4760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7eff94002f70 tx=0x7eff94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa259c700 1 --2- 172.21.15.63:0/3373666366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effa405f110 0x7effa40b4760 secure :-1 s=READY pgs=2043 cs=0 l=1 rx=0x7eff94002f70 tx=0x7eff94007a80).ready entity=mon.0 client_cookie=be237cb41f1539e7 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:43.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa259c700 1 --2- 172.21.15.63:0/3373666366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effa405f110 0x7effa40b4760 secure :-1 s=THROTTLE_DONE pgs=2043 cs=0 l=1 rx=0x7eff94002f70 tx=0x7eff94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa159a700 1 -- 172.21.15.63:0/3373666366 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff94008e80 con 0x7effa405f110 2020-05-18T21:37:43.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa259c700 1 --2- 172.21.15.63:0/3373666366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effa405f110 0x7effa40b4760 secure :-1 s=THROTTLE_DONE pgs=2043 cs=0 l=1 rx=0x7eff94002f70 tx=0x7eff94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa259c700 1 --2- 172.21.15.63:0/3373666366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effa405f110 0x7effa40b4760 secure :-1 s=THROTTLE_DONE pgs=2043 cs=0 l=1 rx=0x7eff94002f70 tx=0x7eff94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa159a700 1 -- 172.21.15.63:0/3373666366 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff94011540 con 0x7effa405f110 2020-05-18T21:37:43.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa159a700 1 -- 172.21.15.63:0/3373666366 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff94011920 con 0x7effa405f110 2020-05-18T21:37:43.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa359e700 1 -- 172.21.15.63:0/3373666366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effa405f110 msgr2=0x7effa40b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:43.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa359e700 1 --2- 172.21.15.63:0/3373666366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effa405f110 0x7effa40b4760 secure :-1 s=READY pgs=2043 cs=0 l=1 rx=0x7eff94002f70 tx=0x7eff94007a80).stop 2020-05-18T21:37:43.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa359e700 1 -- 172.21.15.63:0/3373666366 shutdown_connections 2020-05-18T21:37:43.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa359e700 1 --2- 172.21.15.63:0/3373666366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effa405f110 0x7effa40b4760 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:43.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa359e700 1 -- 172.21.15.63:0/3373666366 >> 172.21.15.63:0/3373666366 conn(0x7effa4069fc0 msgr2=0x7effa406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:43.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa359e700 1 -- 172.21.15.63:0/3373666366 shutdown_connections 2020-05-18T21:37:43.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa359e700 1 -- 172.21.15.63:0/3373666366 wait complete. 2020-05-18T21:37:43.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa359e700 1 Processor -- start 2020-05-18T21:37:43.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa359e700 1 -- start start 2020-05-18T21:37:43.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa359e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7effa405f110 0x7effa414ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:43.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa359e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effa4064fd0 0x7effa4142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:43.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa359e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa41431e0 con 0x7effa414aa70 2020-05-18T21:37:43.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa359e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa414e3e0 con 0x7effa405f110 2020-05-18T21:37:43.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa359e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa40b3970 con 0x7effa4064fd0 2020-05-18T21:37:43.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa259c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7effa405f110 0x7effa414ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:43.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa2d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7effa414aa70 0x7effa4140b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38298/0 (socket says 172.21.15.63:38298) 2020-05-18T21:37:43.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.357+0000 7effa2d9d700 1 -- 172.21.15.63:0/891494151 learned_addr learned my addr 172.21.15.63:0/891494151 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:43.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7effa1d9b700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effa4064fd0 0x7effa4142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:43.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7eff9b7fe700 1 -- 172.21.15.63:0/891494151 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83998978 0 0) 0x7effa41431e0 con 0x7effa414aa70 2020-05-18T21:37:43.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7eff9b7fe700 1 -- 172.21.15.63:0/891494151 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff7c002fe0 con 0x7effa414aa70 2020-05-18T21:37:43.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7effa259c700 1 -- 172.21.15.63:0/891494151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effa4064fd0 msgr2=0x7effa4142d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:43.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7effa259c700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effa4064fd0 0x7effa4142d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:43.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7effa259c700 1 -- 172.21.15.63:0/891494151 >> v1:172.21.15.63:6789/0 conn(0x7effa414aa70 legacy=0x7effa4140b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:43.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7effa259c700 1 -- 172.21.15.63:0/891494151 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa40b3c10 con 0x7effa405f110 2020-05-18T21:37:43.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7effa259c700 1 --2- 172.21.15.63:0/891494151 >> v2:172.21.15.63:3300/0 conn(0x7effa405f110 0x7effa414ddf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7eff94002f70 tx=0x7eff94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7effa259c700 1 --2- 172.21.15.63:0/891494151 >> v2:172.21.15.63:3300/0 conn(0x7effa405f110 0x7effa414ddf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7eff94002f70 tx=0x7eff94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7effa259c700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effa405f110 0x7effa414ddf0 secure :-1 s=READY pgs=2045 cs=0 l=1 rx=0x7eff94002f70 tx=0x7eff94007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:43.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7effa259c700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effa405f110 0x7effa414ddf0 secure :-1 s=THROTTLE_DONE pgs=2045 cs=0 l=1 rx=0x7eff94002f70 tx=0x7eff94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7eff9b7fe700 1 -- 172.21.15.63:0/891494151 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff94011d20 con 0x7effa405f110 2020-05-18T21:37:43.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7effa259c700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effa405f110 0x7effa414ddf0 secure :-1 s=THROTTLE_DONE pgs=2045 cs=0 l=1 rx=0x7eff94002f70 tx=0x7eff94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7eff9b7fe700 1 -- 172.21.15.63:0/891494151 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff94011e80 con 0x7effa405f110 2020-05-18T21:37:43.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7effa359e700 1 -- 172.21.15.63:0/891494151 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa414b010 con 0x7effa405f110 2020-05-18T21:37:43.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7effa259c700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effa405f110 0x7effa414ddf0 secure :-1 s=THROTTLE_DONE pgs=2045 cs=0 l=1 rx=0x7eff94002f70 tx=0x7eff94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7eff9b7fe700 1 -- 172.21.15.63:0/891494151 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff94007360 con 0x7effa405f110 2020-05-18T21:37:43.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7effa359e700 1 -- 172.21.15.63:0/891494151 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa414bf10 con 0x7effa405f110 2020-05-18T21:37:43.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7effa359e700 1 -- 172.21.15.63:0/891494151 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa40569e0 con 0x7effa405f110 2020-05-18T21:37:43.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7effa259c700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effa405f110 0x7effa414ddf0 secure :-1 s=THROTTLE_DONE pgs=2045 cs=0 l=1 rx=0x7eff94002f70 tx=0x7eff94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7eff9b7fe700 1 -- 172.21.15.63:0/891494151 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7eff94005700 con 0x7effa405f110 2020-05-18T21:37:43.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.361+0000 7effa259c700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effa405f110 0x7effa414ddf0 secure :-1 s=THROTTLE_DONE pgs=2045 cs=0 l=1 rx=0x7eff94002f70 tx=0x7eff94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.365+0000 7eff9b7fe700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff7c04fd40 0x7eff7c052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:43.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.365+0000 7eff9b7fe700 1 -- 172.21.15.63:0/891494151 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5253+0+0 (secure 0 0 0) 0x7eff940646b0 con 0x7effa405f110 2020-05-18T21:37:43.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.365+0000 7effa1d9b700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff7c04fd40 0x7eff7c052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:43.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.365+0000 7effa1d9b700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff7c04fd40 0x7eff7c052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7eff8c001490 tx=0x7eff8c002800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.365+0000 7effa1d9b700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff7c04fd40 0x7eff7c052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7eff8c001490 tx=0x7eff8c002800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.365+0000 7effa1d9b700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff7c04fd40 0x7eff7c052200 secure :-1 s=READY pgs=800 cs=0 l=1 rx=0x7eff8c001490 tx=0x7eff8c002800).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:43.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.369+0000 7effa259c700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effa405f110 0x7effa414ddf0 secure :-1 s=THROTTLE_DONE pgs=2045 cs=0 l=1 rx=0x7eff94002f70 tx=0x7eff94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.369+0000 7eff9b7fe700 1 -- 172.21.15.63:0/891494151 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7eff9403eb00 con 0x7effa405f110 2020-05-18T21:37:43.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.489+0000 7effa359e700 1 -- 172.21.15.63:0/891494151 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7effa40625f0 con 0x7effa405f110 2020-05-18T21:37:43.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.489+0000 7effa259c700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effa405f110 0x7effa414ddf0 secure :-1 s=THROTTLE_DONE pgs=2045 cs=0 l=1 rx=0x7eff94002f70 tx=0x7eff94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.489+0000 7eff9b7fe700 1 -- 172.21.15.63:0/891494151 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v152) v1 ==== 84+0+143 (secure 0 0 0) 0x7eff94042120 con 0x7effa405f110 2020-05-18T21:37:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:43.496 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:37:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2020-05-18T21:37:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "device_health_metrics" 2020-05-18T21:37:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:37:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 2, 2020-05-18T21:37:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "rbd" 2020-05-18T21:37:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:43.498 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:37:43.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.493+0000 7effa359e700 1 -- 172.21.15.63:0/891494151 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff7c04fd40 msgr2=0x7eff7c052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:43.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.493+0000 7effa359e700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff7c04fd40 0x7eff7c052200 secure :-1 s=READY pgs=800 cs=0 l=1 rx=0x7eff8c001490 tx=0x7eff8c002800).stop 2020-05-18T21:37:43.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.493+0000 7effa359e700 1 -- 172.21.15.63:0/891494151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effa405f110 msgr2=0x7effa414ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:43.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.493+0000 7effa359e700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effa405f110 0x7effa414ddf0 secure :-1 s=READY pgs=2045 cs=0 l=1 rx=0x7eff94002f70 tx=0x7eff94007a80).stop 2020-05-18T21:37:43.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.493+0000 7effa359e700 1 -- 172.21.15.63:0/891494151 shutdown_connections 2020-05-18T21:37:43.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.493+0000 7effa359e700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7eff7c04fd40 0x7eff7c052200 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:43.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.493+0000 7effa359e700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effa4064fd0 0x7effa4142d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:43.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.493+0000 7effa359e700 1 --2- 172.21.15.63:0/891494151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effa405f110 0x7effa414ddf0 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:43.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.493+0000 7effa359e700 1 -- 172.21.15.63:0/891494151 >> 172.21.15.63:0/891494151 conn(0x7effa4069fc0 msgr2=0x7effa4060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:43.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.493+0000 7effa359e700 1 -- 172.21.15.63:0/891494151 shutdown_connections 2020-05-18T21:37:43.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.493+0000 7effa359e700 1 -- 172.21.15.63:0/891494151 wait complete. 2020-05-18T21:37:43.512 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-05-18T21:37:43.513 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-05-18T21:37:43.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f2994a71700 1 Processor -- start 2020-05-18T21:37:43.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f2994a71700 1 -- start start 2020-05-18T21:37:43.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f2994a71700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29900b6d70 0x7f2990145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:43.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f2994a71700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f29900b7bf0 0x7f29900b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:43.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f2994a71700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2990143810 con 0x7f2990143430 2020-05-18T21:37:43.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f2994a71700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29900b7210 con 0x7f29900b7bf0 2020-05-18T21:37:43.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f2994a71700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29900b74b0 con 0x7f29900b6d70 2020-05-18T21:37:43.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f298e59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2990143430 0x7f29900b9160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38302/0 (socket says 172.21.15.63:38302) 2020-05-18T21:37:43.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f298e59c700 1 -- 172.21.15.63:0/3894122864 learned_addr learned my addr 172.21.15.63:0/3894122864 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:43.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f298ed9d700 1 --2- 172.21.15.63:0/3894122864 >> v2:172.21.15.63:3300/0 conn(0x7f29900b7bf0 0x7f29900b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:43.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f298dd9b700 1 --2- 172.21.15.63:0/3894122864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29900b6d70 0x7f2990145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:43.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f298ed9d700 1 -- 172.21.15.63:0/3894122864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29900b6d70 msgr2=0x7f2990145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:43.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f298ed9d700 1 --2- 172.21.15.63:0/3894122864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29900b6d70 0x7f2990145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:43.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f298ed9d700 1 -- 172.21.15.63:0/3894122864 >> v1:172.21.15.63:6789/0 conn(0x7f2990143430 legacy=0x7f29900b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:43.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f298ed9d700 1 -- 172.21.15.63:0/3894122864 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29900b7750 con 0x7f29900b7bf0 2020-05-18T21:37:43.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f298ed9d700 1 --2- 172.21.15.63:0/3894122864 >> v2:172.21.15.63:3300/0 conn(0x7f29900b7bf0 0x7f29900b4290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f29880032f0 tx=0x7f2988007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f298ed9d700 1 --2- 172.21.15.63:0/3894122864 >> v2:172.21.15.63:3300/0 conn(0x7f29900b7bf0 0x7f29900b4290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f29880032f0 tx=0x7f2988007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f298ed9d700 1 --2- 172.21.15.63:0/3894122864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29900b7bf0 0x7f29900b4290 secure :-1 s=READY pgs=2047 cs=0 l=1 rx=0x7f29880032f0 tx=0x7f2988007e00).ready entity=mon.0 client_cookie=bbced04e1e633007 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:43.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f298ed9d700 1 --2- 172.21.15.63:0/3894122864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29900b7bf0 0x7f29900b4290 secure :-1 s=THROTTLE_DONE pgs=2047 cs=0 l=1 rx=0x7f29880032f0 tx=0x7f2988007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f298d59a700 1 -- 172.21.15.63:0/3894122864 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2988011e60 con 0x7f29900b7bf0 2020-05-18T21:37:43.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f298ed9d700 1 --2- 172.21.15.63:0/3894122864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29900b7bf0 0x7f29900b4290 secure :-1 s=THROTTLE_DONE pgs=2047 cs=0 l=1 rx=0x7f29880032f0 tx=0x7f2988007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f298d59a700 1 -- 172.21.15.63:0/3894122864 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298800a180 con 0x7f29900b7bf0 2020-05-18T21:37:43.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f298ed9d700 1 --2- 172.21.15.63:0/3894122864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29900b7bf0 0x7f29900b4290 secure :-1 s=THROTTLE_DONE pgs=2047 cs=0 l=1 rx=0x7f29880032f0 tx=0x7f2988007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f2994a71700 1 -- 172.21.15.63:0/3894122864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29900b7bf0 msgr2=0x7f29900b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:43.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f298d59a700 1 -- 172.21.15.63:0/3894122864 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f298800a560 con 0x7f29900b7bf0 2020-05-18T21:37:43.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.617+0000 7f2994a71700 1 --2- 172.21.15.63:0/3894122864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29900b7bf0 0x7f29900b4290 secure :-1 s=READY pgs=2047 cs=0 l=1 rx=0x7f29880032f0 tx=0x7f2988007e00).stop 2020-05-18T21:37:43.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.621+0000 7f2994a71700 1 -- 172.21.15.63:0/3894122864 shutdown_connections 2020-05-18T21:37:43.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.621+0000 7f2994a71700 1 --2- 172.21.15.63:0/3894122864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29900b7bf0 0x7f29900b4290 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:43.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.621+0000 7f2994a71700 1 --2- 172.21.15.63:0/3894122864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29900b6d70 0x7f2990145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:43.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.621+0000 7f2994a71700 1 -- 172.21.15.63:0/3894122864 >> 172.21.15.63:0/3894122864 conn(0x7f2990069b70 msgr2=0x7f2990069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:43.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.621+0000 7f2994a71700 1 -- 172.21.15.63:0/3894122864 shutdown_connections 2020-05-18T21:37:43.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.621+0000 7f2994a71700 1 -- 172.21.15.63:0/3894122864 wait complete. 2020-05-18T21:37:43.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.621+0000 7f2994a71700 1 Processor -- start 2020-05-18T21:37:43.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.621+0000 7f2994a71700 1 -- start start 2020-05-18T21:37:43.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.621+0000 7f2994a71700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29900b6d70 0x7f2990149480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:43.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.621+0000 7f2994a71700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f29900b7bf0 0x7f2990140fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:43.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.621+0000 7f2994a71700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29901405f0 con 0x7f2990143430 2020-05-18T21:37:43.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.621+0000 7f2994a71700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2990140880 con 0x7f29900b7bf0 2020-05-18T21:37:43.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.621+0000 7f2994a71700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2990140b20 con 0x7f29900b6d70 2020-05-18T21:37:43.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.621+0000 7f298dd9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f29900b7bf0 0x7f2990140fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:43.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.621+0000 7f298dd9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f29900b7bf0 0x7f2990140fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36122/0 (socket says 172.21.15.63:36122) 2020-05-18T21:37:43.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.621+0000 7f298dd9b700 1 -- 172.21.15.63:0/17409684 learned_addr learned my addr 172.21.15.63:0/17409684 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:43.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.621+0000 7f298e59c700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29900b6d70 0x7f2990149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:43.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f297f7fe700 1 -- 172.21.15.63:0/17409684 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37504921 0 0) 0x7f29901405f0 con 0x7f2990143430 2020-05-18T21:37:43.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f297f7fe700 1 -- 172.21.15.63:0/17409684 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f296c002fe0 con 0x7f2990143430 2020-05-18T21:37:43.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f298dd9b700 1 -- 172.21.15.63:0/17409684 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29900b6d70 msgr2=0x7f2990149480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:43.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f298dd9b700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29900b6d70 0x7f2990149480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:43.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f298dd9b700 1 -- 172.21.15.63:0/17409684 >> v1:172.21.15.155:6789/0 conn(0x7f2990143430 legacy=0x7f299013f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:43.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f298dd9b700 1 -- 172.21.15.63:0/17409684 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2990141420 con 0x7f29900b7bf0 2020-05-18T21:37:43.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f298dd9b700 1 --2- 172.21.15.63:0/17409684 >> v2:172.21.15.63:3300/0 conn(0x7f29900b7bf0 0x7f2990140fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f29840030b0 tx=0x7f299005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f298dd9b700 1 --2- 172.21.15.63:0/17409684 >> v2:172.21.15.63:3300/0 conn(0x7f29900b7bf0 0x7f2990140fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f29840030b0 tx=0x7f299005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f298dd9b700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29900b7bf0 0x7f2990140fc0 secure :-1 s=READY pgs=2048 cs=0 l=1 rx=0x7f29840030b0 tx=0x7f299005ab60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:43.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f298dd9b700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29900b7bf0 0x7f2990140fc0 secure :-1 s=THROTTLE_DONE pgs=2048 cs=0 l=1 rx=0x7f29840030b0 tx=0x7f299005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f297f7fe700 1 -- 172.21.15.63:0/17409684 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2984007180 con 0x7f29900b7bf0 2020-05-18T21:37:43.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f298dd9b700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29900b7bf0 0x7f2990140fc0 secure :-1 s=THROTTLE_DONE pgs=2048 cs=0 l=1 rx=0x7f29840030b0 tx=0x7f299005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f298dd9b700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29900b7bf0 0x7f2990140fc0 secure :-1 s=THROTTLE_DONE pgs=2048 cs=0 l=1 rx=0x7f29840030b0 tx=0x7f299005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f297f7fe700 1 -- 172.21.15.63:0/17409684 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29840072e0 con 0x7f29900b7bf0 2020-05-18T21:37:43.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f297f7fe700 1 -- 172.21.15.63:0/17409684 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29840122b0 con 0x7f29900b7bf0 2020-05-18T21:37:43.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f2994a71700 1 -- 172.21.15.63:0/17409684 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299013f780 con 0x7f29900b7bf0 2020-05-18T21:37:43.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f2994a71700 1 -- 172.21.15.63:0/17409684 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2990156c70 con 0x7f29900b7bf0 2020-05-18T21:37:43.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f298dd9b700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29900b7bf0 0x7f2990140fc0 secure :-1 s=THROTTLE_DONE pgs=2048 cs=0 l=1 rx=0x7f29840030b0 tx=0x7f299005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f2994a71700 1 -- 172.21.15.63:0/17409684 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29900569e0 con 0x7f29900b7bf0 2020-05-18T21:37:43.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f297f7fe700 1 -- 172.21.15.63:0/17409684 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2984010190 con 0x7f29900b7bf0 2020-05-18T21:37:43.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.625+0000 7f298dd9b700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29900b7bf0 0x7f2990140fc0 secure :-1 s=THROTTLE_DONE pgs=2048 cs=0 l=1 rx=0x7f29840030b0 tx=0x7f299005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.629+0000 7f297f7fe700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f296c04fd40 0x7f296c052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:43.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.629+0000 7f297f7fe700 1 -- 172.21.15.63:0/17409684 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f2984063dc0 con 0x7f29900b7bf0 2020-05-18T21:37:43.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.629+0000 7f298e59c700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f296c04fd40 0x7f296c052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:43.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.629+0000 7f298e59c700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f296c04fd40 0x7f296c052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f29900600b0 tx=0x7f29800018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.629+0000 7f298e59c700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f296c04fd40 0x7f296c052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f29900600b0 tx=0x7f29800018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.629+0000 7f298e59c700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f296c04fd40 0x7f296c052200 secure :-1 s=READY pgs=801 cs=0 l=1 rx=0x7f29900600b0 tx=0x7f29800018d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:43.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.637+0000 7f298dd9b700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29900b7bf0 0x7f2990140fc0 secure :-1 s=THROTTLE_DONE pgs=2048 cs=0 l=1 rx=0x7f29840030b0 tx=0x7f299005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.637+0000 7f297f7fe700 1 -- 172.21.15.63:0/17409684 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f298403e1b0 con 0x7f29900b7bf0 2020-05-18T21:37:43.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.753+0000 7f2994a71700 1 -- 172.21.15.63:0/17409684 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f2990140c90 con 0x7f29900b7bf0 2020-05-18T21:37:43.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.957+0000 7f298dd9b700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29900b7bf0 0x7f2990140fc0 secure :-1 s=THROTTLE_DONE pgs=2048 cs=0 l=1 rx=0x7f29840030b0 tx=0x7f299005ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:43.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.957+0000 7f297f7fe700 1 -- 172.21.15.63:0/17409684 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v153) v1 ==== 133+0+0 (secure 0 0 0) 0x7f29840417d0 con 0x7f29900b7bf0 2020-05-18T21:37:43.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.965+0000 7f2994a71700 1 -- 172.21.15.63:0/17409684 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f296c04fd40 msgr2=0x7f296c052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:43.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.965+0000 7f2994a71700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f296c04fd40 0x7f296c052200 secure :-1 s=READY pgs=801 cs=0 l=1 rx=0x7f29900600b0 tx=0x7f29800018d0).stop 2020-05-18T21:37:43.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.965+0000 7f2994a71700 1 -- 172.21.15.63:0/17409684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29900b7bf0 msgr2=0x7f2990140fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:43.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.965+0000 7f2994a71700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29900b7bf0 0x7f2990140fc0 secure :-1 s=READY pgs=2048 cs=0 l=1 rx=0x7f29840030b0 tx=0x7f299005ab60).stop 2020-05-18T21:37:43.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.965+0000 7f2994a71700 1 -- 172.21.15.63:0/17409684 shutdown_connections 2020-05-18T21:37:43.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.965+0000 7f2994a71700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f296c04fd40 0x7f296c052200 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:43.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.965+0000 7f2994a71700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29900b7bf0 0x7f2990140fc0 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:43.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.965+0000 7f2994a71700 1 --2- 172.21.15.63:0/17409684 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29900b6d70 0x7f2990149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:43.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.965+0000 7f2994a71700 1 -- 172.21.15.63:0/17409684 >> 172.21.15.63:0/17409684 conn(0x7f2990069b70 msgr2=0x7f29900b5620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:43.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.965+0000 7f2994a71700 1 -- 172.21.15.63:0/17409684 shutdown_connections 2020-05-18T21:37:43.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:43.965+0000 7f2994a71700 1 -- 172.21.15.63:0/17409684 wait complete. 2020-05-18T21:37:43.974 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2020-05-18T21:37:43.986 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-05-18T21:37:44.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.093+0000 7f2bd9b93700 1 Processor -- start 2020-05-18T21:37:44.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd9b93700 1 -- start start 2020-05-18T21:37:44.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd9b93700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2bd4062610 0x7f2bd414a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:44.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd9b93700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd4061c30 con 0x7f2bd4069be0 2020-05-18T21:37:44.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd9b93700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd4061ed0 con 0x7f2bd40b7d10 2020-05-18T21:37:44.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd9b93700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd4062170 con 0x7f2bd4062610 2020-05-18T21:37:44.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd2ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2bd4069be0 0x7f2bd40b56d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38318/0 (socket says 172.21.15.63:38318) 2020-05-18T21:37:44.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd2ffd700 1 -- 172.21.15.63:0/3552426262 learned_addr learned my addr 172.21.15.63:0/3552426262 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:44.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd3fff700 1 --2- 172.21.15.63:0/3552426262 >> v2:172.21.15.155:3300/0 conn(0x7f2bd4062610 0x7f2bd414a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:44.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd27fc700 1 -- 172.21.15.63:0/3552426262 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774373602 0 0) 0x7f2bd4061c30 con 0x7f2bd4069be0 2020-05-18T21:37:44.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd27fc700 1 -- 172.21.15.63:0/3552426262 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bc0003270 con 0x7f2bd4069be0 2020-05-18T21:37:44.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd3fff700 1 -- 172.21.15.63:0/3552426262 >> v1:172.21.15.155:6789/0 conn(0x7f2bd40b7d10 legacy=0x7f2bd40b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:44.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd27fc700 1 -- 172.21.15.63:0/3552426262 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638164602 0 0) 0x7f2bd4061ed0 con 0x7f2bd40b7d10 2020-05-18T21:37:44.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd3fff700 1 -- 172.21.15.63:0/3552426262 >> v1:172.21.15.63:6789/0 conn(0x7f2bd4069be0 legacy=0x7f2bd40b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:44.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd3fff700 1 -- 172.21.15.63:0/3552426262 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd414a4a0 con 0x7f2bd4062610 2020-05-18T21:37:44.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd3fff700 1 --2- 172.21.15.63:0/3552426262 >> v2:172.21.15.155:3300/0 conn(0x7f2bd4062610 0x7f2bd414a040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2bcc0032f0 tx=0x7f2bcc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:44.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd3fff700 1 --2- 172.21.15.63:0/3552426262 >> v2:172.21.15.155:3300/0 conn(0x7f2bd4062610 0x7f2bd414a040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2bcc0032f0 tx=0x7f2bcc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:44.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd3fff700 1 --2- 172.21.15.63:0/3552426262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd4062610 0x7f2bd414a040 secure :-1 s=READY pgs=1362 cs=0 l=1 rx=0x7f2bcc0032f0 tx=0x7f2bcc007e00).ready entity=mon.1 client_cookie=75f92ea99ce9fac0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:44.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd3fff700 1 --2- 172.21.15.63:0/3552426262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd4062610 0x7f2bd414a040 secure :-1 s=THROTTLE_DONE pgs=1362 cs=0 l=1 rx=0x7f2bcc0032f0 tx=0x7f2bcc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:44.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd27fc700 1 -- 172.21.15.63:0/3552426262 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bcc010e90 con 0x7f2bd4062610 2020-05-18T21:37:44.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd3fff700 1 --2- 172.21.15.63:0/3552426262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd4062610 0x7f2bd414a040 secure :-1 s=THROTTLE_DONE pgs=1362 cs=0 l=1 rx=0x7f2bcc0032f0 tx=0x7f2bcc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:44.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd27fc700 1 -- 172.21.15.63:0/3552426262 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc0110d0 con 0x7f2bd4062610 2020-05-18T21:37:44.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd3fff700 1 --2- 172.21.15.63:0/3552426262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd4062610 0x7f2bd414a040 secure :-1 s=THROTTLE_DONE pgs=1362 cs=0 l=1 rx=0x7f2bcc0032f0 tx=0x7f2bcc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:44.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd27fc700 1 -- 172.21.15.63:0/3552426262 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bcc011470 con 0x7f2bd4062610 2020-05-18T21:37:44.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd9b93700 1 -- 172.21.15.63:0/3552426262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd4062610 msgr2=0x7f2bd414a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:44.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.097+0000 7f2bd9b93700 1 --2- 172.21.15.63:0/3552426262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd4062610 0x7f2bd414a040 secure :-1 s=READY pgs=1362 cs=0 l=1 rx=0x7f2bcc0032f0 tx=0x7f2bcc007e00).stop 2020-05-18T21:37:44.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.101+0000 7f2bd9b93700 1 -- 172.21.15.63:0/3552426262 shutdown_connections 2020-05-18T21:37:44.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.101+0000 7f2bd9b93700 1 --2- 172.21.15.63:0/3552426262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd4062610 0x7f2bd414a040 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:44.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.101+0000 7f2bd9b93700 1 -- 172.21.15.63:0/3552426262 >> 172.21.15.63:0/3552426262 conn(0x7f2bd40b9700 msgr2=0x7f2bd40b9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:44.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.101+0000 7f2bd9b93700 1 -- 172.21.15.63:0/3552426262 shutdown_connections 2020-05-18T21:37:44.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.101+0000 7f2bd9b93700 1 -- 172.21.15.63:0/3552426262 wait complete. 2020-05-18T21:37:44.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.101+0000 7f2bd9b93700 1 Processor -- start 2020-05-18T21:37:44.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.101+0000 7f2bd9b93700 1 -- start start 2020-05-18T21:37:44.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.101+0000 7f2bd9b93700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2bd4062610 0x7f2bd40638f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:44.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.101+0000 7f2bd9b93700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2bd40b7d10 0x7f2bd409de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:44.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.101+0000 7f2bd9b93700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd41482d0 con 0x7f2bd4069be0 2020-05-18T21:37:44.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.101+0000 7f2bd9b93700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd4148570 con 0x7f2bd4062610 2020-05-18T21:37:44.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.101+0000 7f2bd9b93700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd4148810 con 0x7f2bd40b7d10 2020-05-18T21:37:44.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.101+0000 7f2bd37fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2bd4062610 0x7f2bd40638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:44.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.101+0000 7f2bd2ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2bd4069be0 0x7f2bd4155f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38324/0 (socket says 172.21.15.63:38324) 2020-05-18T21:37:44.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.101+0000 7f2bd37fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2bd4062610 0x7f2bd40638f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36134/0 (socket says 172.21.15.63:36134) 2020-05-18T21:37:44.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.101+0000 7f2bd2ffd700 1 -- 172.21.15.63:0/440972157 learned_addr learned my addr 172.21.15.63:0/440972157 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:44.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.101+0000 7f2bd3fff700 1 --2- 172.21.15.63:0/440972157 >> v2:172.21.15.155:3300/0 conn(0x7f2bd40b7d10 0x7f2bd409de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:44.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd37fe700 1 -- 172.21.15.63:0/440972157 >> v2:172.21.15.155:3300/0 conn(0x7f2bd40b7d10 msgr2=0x7f2bd409de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:44.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd37fe700 1 --2- 172.21.15.63:0/440972157 >> v2:172.21.15.155:3300/0 conn(0x7f2bd40b7d10 0x7f2bd409de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:44.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd37fe700 1 -- 172.21.15.63:0/440972157 >> v1:172.21.15.63:6789/0 conn(0x7f2bd4069be0 legacy=0x7f2bd4155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:44.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd0ff9700 1 -- 172.21.15.63:0/440972157 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613111392 0 0) 0x7f2bd41482d0 con 0x7f2bd4069be0 2020-05-18T21:37:44.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd37fe700 1 -- 172.21.15.63:0/440972157 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd4146530 con 0x7f2bd4062610 2020-05-18T21:37:44.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd3fff700 1 --2- 172.21.15.63:0/440972157 >> v2:172.21.15.155:3300/0 conn(0x7f2bd40b7d10 0x7f2bd409de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:37:44.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd37fe700 1 --2- 172.21.15.63:0/440972157 >> v2:172.21.15.63:3300/0 conn(0x7f2bd4062610 0x7f2bd40638f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2bc4000bc0 tx=0x7f2bc4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:44.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd37fe700 1 --2- 172.21.15.63:0/440972157 >> v2:172.21.15.63:3300/0 conn(0x7f2bd4062610 0x7f2bd40638f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2bc4000bc0 tx=0x7f2bc4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:44.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd37fe700 1 --2- 172.21.15.63:0/440972157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bd4062610 0x7f2bd40638f0 secure :-1 s=READY pgs=2051 cs=0 l=1 rx=0x7f2bc4000bc0 tx=0x7f2bc4010960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:44.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd37fe700 1 --2- 172.21.15.63:0/440972157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bd4062610 0x7f2bd40638f0 secure :-1 s=THROTTLE_DONE pgs=2051 cs=0 l=1 rx=0x7f2bc4000bc0 tx=0x7f2bc4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:44.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd0ff9700 1 -- 172.21.15.63:0/440972157 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bc4006c00 con 0x7f2bd4062610 2020-05-18T21:37:44.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd37fe700 1 --2- 172.21.15.63:0/440972157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bd4062610 0x7f2bd40638f0 secure :-1 s=THROTTLE_DONE pgs=2051 cs=0 l=1 rx=0x7f2bc4000bc0 tx=0x7f2bc4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:44.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd37fe700 1 --2- 172.21.15.63:0/440972157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bd4062610 0x7f2bd40638f0 secure :-1 s=THROTTLE_DONE pgs=2051 cs=0 l=1 rx=0x7f2bc4000bc0 tx=0x7f2bc4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:44.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd0ff9700 1 -- 172.21.15.63:0/440972157 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc4006d60 con 0x7f2bd4062610 2020-05-18T21:37:44.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd9b93700 1 -- 172.21.15.63:0/440972157 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd4156660 con 0x7f2bd4062610 2020-05-18T21:37:44.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd0ff9700 1 -- 172.21.15.63:0/440972157 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bc4011180 con 0x7f2bd4062610 2020-05-18T21:37:44.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd9b93700 1 -- 172.21.15.63:0/440972157 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd413dc80 con 0x7f2bd4062610 2020-05-18T21:37:44.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd37fe700 1 --2- 172.21.15.63:0/440972157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bd4062610 0x7f2bd40638f0 secure :-1 s=THROTTLE_DONE pgs=2051 cs=0 l=1 rx=0x7f2bc4000bc0 tx=0x7f2bc4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:44.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd9b93700 1 -- 172.21.15.63:0/440972157 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd4146720 con 0x7f2bd4062610 2020-05-18T21:37:44.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd0ff9700 1 -- 172.21.15.63:0/440972157 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2bc40113f0 con 0x7f2bd4062610 2020-05-18T21:37:44.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd37fe700 1 --2- 172.21.15.63:0/440972157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bd4062610 0x7f2bd40638f0 secure :-1 s=THROTTLE_DONE pgs=2051 cs=0 l=1 rx=0x7f2bc4000bc0 tx=0x7f2bc4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:44.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd0ff9700 1 --2- 172.21.15.63:0/440972157 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2bb404f970 0x7f2bb4051e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:44.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.105+0000 7f2bd0ff9700 1 -- 172.21.15.63:0/440972157 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f2bc4063b80 con 0x7f2bd4062610 2020-05-18T21:37:44.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.109+0000 7f2bd2ffd700 1 --2- 172.21.15.63:0/440972157 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2bb404f970 0x7f2bb4051e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:44.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.109+0000 7f2bd2ffd700 1 --2- 172.21.15.63:0/440972157 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2bb404f970 0x7f2bb4051e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2bc8001090 tx=0x7f2bc80016b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:44.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.109+0000 7f2bd2ffd700 1 --2- 172.21.15.63:0/440972157 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2bb404f970 0x7f2bb4051e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2bc8001090 tx=0x7f2bc80016b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:44.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.109+0000 7f2bd2ffd700 1 --2- 172.21.15.63:0/440972157 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2bb404f970 0x7f2bb4051e30 secure :-1 s=READY pgs=802 cs=0 l=1 rx=0x7f2bc8001090 tx=0x7f2bc80016b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:44.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.113+0000 7f2bd37fe700 1 --2- 172.21.15.63:0/440972157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bd4062610 0x7f2bd40638f0 secure :-1 s=THROTTLE_DONE pgs=2051 cs=0 l=1 rx=0x7f2bc4000bc0 tx=0x7f2bc4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:44.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.113+0000 7f2bd0ff9700 1 -- 172.21.15.63:0/440972157 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f2bc403deb0 con 0x7f2bd4062610 2020-05-18T21:37:44.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.225+0000 7f2bd9b93700 1 -- 172.21.15.63:0/440972157 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f2bd40569e0 con 0x7f2bd4062610 2020-05-18T21:37:44.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.965+0000 7f2bd37fe700 1 --2- 172.21.15.63:0/440972157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bd4062610 0x7f2bd40638f0 secure :-1 s=THROTTLE_DONE pgs=2051 cs=0 l=1 rx=0x7f2bc4000bc0 tx=0x7f2bc4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:44.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.965+0000 7f2bd0ff9700 1 -- 172.21.15.63:0/440972157 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v154) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2bc40414d0 con 0x7f2bd4062610 2020-05-18T21:37:44.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.969+0000 7f2bd9b93700 1 -- 172.21.15.63:0/440972157 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2bb404f970 msgr2=0x7f2bb4051e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:44.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.969+0000 7f2bd9b93700 1 --2- 172.21.15.63:0/440972157 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2bb404f970 0x7f2bb4051e30 secure :-1 s=READY pgs=802 cs=0 l=1 rx=0x7f2bc8001090 tx=0x7f2bc80016b0).stop 2020-05-18T21:37:44.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.969+0000 7f2bd9b93700 1 -- 172.21.15.63:0/440972157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bd4062610 msgr2=0x7f2bd40638f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:44.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.969+0000 7f2bd9b93700 1 --2- 172.21.15.63:0/440972157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bd4062610 0x7f2bd40638f0 secure :-1 s=READY pgs=2051 cs=0 l=1 rx=0x7f2bc4000bc0 tx=0x7f2bc4010960).stop 2020-05-18T21:37:44.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.969+0000 7f2bd9b93700 1 -- 172.21.15.63:0/440972157 shutdown_connections 2020-05-18T21:37:44.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.969+0000 7f2bd9b93700 1 --2- 172.21.15.63:0/440972157 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2bb404f970 0x7f2bb4051e30 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:44.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.969+0000 7f2bd9b93700 1 --2- 172.21.15.63:0/440972157 >> v2:172.21.15.155:3300/0 conn(0x7f2bd40b7d10 0x7f2bd409de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:44.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.969+0000 7f2bd9b93700 1 --2- 172.21.15.63:0/440972157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bd4062610 0x7f2bd40638f0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:44.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.969+0000 7f2bd9b93700 1 -- 172.21.15.63:0/440972157 >> 172.21.15.63:0/440972157 conn(0x7f2bd40b9700 msgr2=0x7f2bd40b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:44.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.969+0000 7f2bd9b93700 1 -- 172.21.15.63:0/440972157 shutdown_connections 2020-05-18T21:37:44.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:44.969+0000 7f2bd9b93700 1 -- 172.21.15.63:0/440972157 wait complete. 2020-05-18T21:37:44.982 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2020-05-18T21:37:44.992 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-05-18T21:37:45.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.089+0000 7fd08807e700 1 Processor -- start 2020-05-18T21:37:45.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.089+0000 7fd08807e700 1 -- start start 2020-05-18T21:37:45.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08807e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd080149510 0x7fd0800af600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:45.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08807e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd080065df0 0x7fd0801464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:45.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08807e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0801499b0 con 0x7fd0800b61d0 2020-05-18T21:37:45.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08807e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0800ae290 con 0x7fd080065df0 2020-05-18T21:37:45.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08807e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd080149c50 con 0x7fd080149510 2020-05-18T21:37:45.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08661b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd080065df0 0x7fd0801464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:45.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08661b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd080065df0 0x7fd0801464c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36146/0 (socket says 172.21.15.63:36146) 2020-05-18T21:37:45.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08661b700 1 -- 172.21.15.63:0/266544292 learned_addr learned my addr 172.21.15.63:0/266544292 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:45.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd085619700 1 --2- 172.21.15.63:0/266544292 >> v2:172.21.15.155:3300/0 conn(0x7fd080149510 0x7fd0800af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:45.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08661b700 1 -- 172.21.15.63:0/266544292 >> v2:172.21.15.155:3300/0 conn(0x7fd080149510 msgr2=0x7fd0800af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:45.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08661b700 1 --2- 172.21.15.63:0/266544292 >> v2:172.21.15.155:3300/0 conn(0x7fd080149510 0x7fd0800af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:45.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08661b700 1 -- 172.21.15.63:0/266544292 >> v1:172.21.15.155:6789/0 conn(0x7fd0800b61d0 legacy=0x7fd0800656e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08661b700 1 -- 172.21.15.63:0/266544292 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd080149ef0 con 0x7fd080065df0 2020-05-18T21:37:45.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08661b700 1 --2- 172.21.15.63:0/266544292 >> v2:172.21.15.63:3300/0 conn(0x7fd080065df0 0x7fd0801464c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd0780032f0 tx=0x7fd078007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08661b700 1 --2- 172.21.15.63:0/266544292 >> v2:172.21.15.63:3300/0 conn(0x7fd080065df0 0x7fd0801464c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd0780032f0 tx=0x7fd078007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08661b700 1 --2- 172.21.15.63:0/266544292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd080065df0 0x7fd0801464c0 secure :-1 s=READY pgs=2052 cs=0 l=1 rx=0x7fd0780032f0 tx=0x7fd078007e00).ready entity=mon.0 client_cookie=91a40447079bf275 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:45.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08661b700 1 --2- 172.21.15.63:0/266544292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd080065df0 0x7fd0801464c0 secure :-1 s=THROTTLE_DONE pgs=2052 cs=0 l=1 rx=0x7fd0780032f0 tx=0x7fd078007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08661b700 1 --2- 172.21.15.63:0/266544292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd080065df0 0x7fd0801464c0 secure :-1 s=THROTTLE_DONE pgs=2052 cs=0 l=1 rx=0x7fd0780032f0 tx=0x7fd078007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08661b700 1 --2- 172.21.15.63:0/266544292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd080065df0 0x7fd0801464c0 secure :-1 s=THROTTLE_DONE pgs=2052 cs=0 l=1 rx=0x7fd0780032f0 tx=0x7fd078007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd084e18700 1 -- 172.21.15.63:0/266544292 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd078011d10 con 0x7fd080065df0 2020-05-18T21:37:45.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd084e18700 1 -- 172.21.15.63:0/266544292 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd078011e70 con 0x7fd080065df0 2020-05-18T21:37:45.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08807e700 1 -- 172.21.15.63:0/266544292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd080065df0 msgr2=0x7fd0801464c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd084e18700 1 -- 172.21.15.63:0/266544292 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd07800a370 con 0x7fd080065df0 2020-05-18T21:37:45.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08807e700 1 --2- 172.21.15.63:0/266544292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd080065df0 0x7fd0801464c0 secure :-1 s=READY pgs=2052 cs=0 l=1 rx=0x7fd0780032f0 tx=0x7fd078007e00).stop 2020-05-18T21:37:45.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08807e700 1 -- 172.21.15.63:0/266544292 shutdown_connections 2020-05-18T21:37:45.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08807e700 1 --2- 172.21.15.63:0/266544292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd080065df0 0x7fd0801464c0 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:45.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08807e700 1 --2- 172.21.15.63:0/266544292 >> v2:172.21.15.155:3300/0 conn(0x7fd080149510 0x7fd0800af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:45.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08807e700 1 -- 172.21.15.63:0/266544292 >> 172.21.15.63:0/266544292 conn(0x7fd0800b9770 msgr2=0x7fd0800b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:45.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08807e700 1 -- 172.21.15.63:0/266544292 shutdown_connections 2020-05-18T21:37:45.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.093+0000 7fd08807e700 1 -- 172.21.15.63:0/266544292 wait complete. 2020-05-18T21:37:45.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd08807e700 1 Processor -- start 2020-05-18T21:37:45.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd08807e700 1 -- start start 2020-05-18T21:37:45.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd08807e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd080065df0 0x7fd0800afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:45.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd08807e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd0800b61d0 0x7fd080153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:45.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd08807e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd080149510 0x7fd08009c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:45.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd08807e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08009e700 con 0x7fd0800b61d0 2020-05-18T21:37:45.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd08807e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08009e9a0 con 0x7fd080065df0 2020-05-18T21:37:45.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd08807e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd080154080 con 0x7fd080149510 2020-05-18T21:37:45.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd085619700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd0800b61d0 0x7fd080153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:45.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd085619700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd0800b61d0 0x7fd080153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36150/0 (socket says 172.21.15.63:36150) 2020-05-18T21:37:45.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd085619700 1 -- 172.21.15.63:0/267783431 learned_addr learned my addr 172.21.15.63:0/267783431 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:45.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd085e1a700 1 --2- 172.21.15.63:0/267783431 >> v2:172.21.15.155:3300/0 conn(0x7fd080065df0 0x7fd0800afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:45.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd08661b700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd080149510 0x7fd08009c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:45.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd085619700 1 -- 172.21.15.63:0/267783431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd080149510 msgr2=0x7fd08009c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd085619700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd080149510 0x7fd08009c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:45.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd085619700 1 -- 172.21.15.63:0/267783431 >> v2:172.21.15.155:3300/0 conn(0x7fd080065df0 msgr2=0x7fd0800afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd085619700 1 --2- 172.21.15.63:0/267783431 >> v2:172.21.15.155:3300/0 conn(0x7fd080065df0 0x7fd0800afd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:45.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd085619700 1 -- 172.21.15.63:0/267783431 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08009cdd0 con 0x7fd0800b61d0 2020-05-18T21:37:45.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd085619700 1 --2- 172.21.15.63:0/267783431 >> v2:172.21.15.63:3300/0 conn(0x7fd0800b61d0 0x7fd080153c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd0700030b0 tx=0x7fd070010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd085619700 1 --2- 172.21.15.63:0/267783431 >> v2:172.21.15.63:3300/0 conn(0x7fd0800b61d0 0x7fd080153c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd0700030b0 tx=0x7fd070010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.097+0000 7fd085619700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0800b61d0 0x7fd080153c20 secure :-1 s=READY pgs=2053 cs=0 l=1 rx=0x7fd0700030b0 tx=0x7fd070010d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:45.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.101+0000 7fd085619700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0800b61d0 0x7fd080153c20 secure :-1 s=THROTTLE_DONE pgs=2053 cs=0 l=1 rx=0x7fd0700030b0 tx=0x7fd070010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.101+0000 7fd085619700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0800b61d0 0x7fd080153c20 secure :-1 s=THROTTLE_DONE pgs=2053 cs=0 l=1 rx=0x7fd0700030b0 tx=0x7fd070010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.101+0000 7fd085619700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0800b61d0 0x7fd080153c20 secure :-1 s=THROTTLE_DONE pgs=2053 cs=0 l=1 rx=0x7fd0700030b0 tx=0x7fd070010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.101+0000 7fd06effd700 1 -- 172.21.15.63:0/267783431 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd07000eb70 con 0x7fd0800b61d0 2020-05-18T21:37:45.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.101+0000 7fd06effd700 1 -- 172.21.15.63:0/267783431 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07000ecd0 con 0x7fd0800b61d0 2020-05-18T21:37:45.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.101+0000 7fd08807e700 1 -- 172.21.15.63:0/267783431 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08009be40 con 0x7fd0800b61d0 2020-05-18T21:37:45.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.101+0000 7fd06effd700 1 -- 172.21.15.63:0/267783431 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0700058f0 con 0x7fd0800b61d0 2020-05-18T21:37:45.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.101+0000 7fd08807e700 1 -- 172.21.15.63:0/267783431 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08009e400 con 0x7fd0800b61d0 2020-05-18T21:37:45.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.101+0000 7fd085619700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0800b61d0 0x7fd080153c20 secure :-1 s=THROTTLE_DONE pgs=2053 cs=0 l=1 rx=0x7fd0700030b0 tx=0x7fd070010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.101+0000 7fd08807e700 1 -- 172.21.15.63:0/267783431 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08009cf60 con 0x7fd0800b61d0 2020-05-18T21:37:45.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.101+0000 7fd06effd700 1 -- 172.21.15.63:0/267783431 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd0700071a0 con 0x7fd0800b61d0 2020-05-18T21:37:45.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.101+0000 7fd085619700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0800b61d0 0x7fd080153c20 secure :-1 s=THROTTLE_DONE pgs=2053 cs=0 l=1 rx=0x7fd0700030b0 tx=0x7fd070010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.101+0000 7fd06effd700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd06004fac0 0x7fd060051f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:45.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.101+0000 7fd06effd700 1 -- 172.21.15.63:0/267783431 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fd070064240 con 0x7fd0800b61d0 2020-05-18T21:37:45.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.101+0000 7fd085e1a700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd06004fac0 0x7fd060051f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:45.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.101+0000 7fd085e1a700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd06004fac0 0x7fd060051f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd0800b4d80 tx=0x7fd07c003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.101+0000 7fd085e1a700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd06004fac0 0x7fd060051f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd0800b4d80 tx=0x7fd07c003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.101+0000 7fd085e1a700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd06004fac0 0x7fd060051f80 secure :-1 s=READY pgs=803 cs=0 l=1 rx=0x7fd0800b4d80 tx=0x7fd07c003e60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:45.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.109+0000 7fd085619700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0800b61d0 0x7fd080153c20 secure :-1 s=THROTTLE_DONE pgs=2053 cs=0 l=1 rx=0x7fd0700030b0 tx=0x7fd070010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.109+0000 7fd06effd700 1 -- 172.21.15.63:0/267783431 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd07003e630 con 0x7fd0800b61d0 2020-05-18T21:37:45.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.257+0000 7fd08807e700 1 -- 172.21.15.63:0/267783431 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fd0800569e0 con 0x7fd0800b61d0 2020-05-18T21:37:45.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.269+0000 7fd085619700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0800b61d0 0x7fd080153c20 secure :-1 s=THROTTLE_DONE pgs=2053 cs=0 l=1 rx=0x7fd0700030b0 tx=0x7fd070010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.269+0000 7fd06effd700 1 -- 172.21.15.63:0/267783431 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 29 and data pool 30 v133) v1 ==== 189+0+0 (secure 0 0 0) 0x7fd070041c50 con 0x7fd0800b61d0 2020-05-18T21:37:45.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.273+0000 7fd08807e700 1 -- 172.21.15.63:0/267783431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd06004fac0 msgr2=0x7fd060051f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.273+0000 7fd08807e700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd06004fac0 0x7fd060051f80 secure :-1 s=READY pgs=803 cs=0 l=1 rx=0x7fd0800b4d80 tx=0x7fd07c003e60).stop 2020-05-18T21:37:45.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.273+0000 7fd08807e700 1 -- 172.21.15.63:0/267783431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0800b61d0 msgr2=0x7fd080153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.273+0000 7fd08807e700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0800b61d0 0x7fd080153c20 secure :-1 s=READY pgs=2053 cs=0 l=1 rx=0x7fd0700030b0 tx=0x7fd070010d10).stop 2020-05-18T21:37:45.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.277+0000 7fd08807e700 1 -- 172.21.15.63:0/267783431 shutdown_connections 2020-05-18T21:37:45.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.277+0000 7fd08807e700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd06004fac0 0x7fd060051f80 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:45.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.277+0000 7fd08807e700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd080149510 0x7fd08009c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:45.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.277+0000 7fd08807e700 1 --2- 172.21.15.63:0/267783431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0800b61d0 0x7fd080153c20 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:45.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.277+0000 7fd08807e700 1 --2- 172.21.15.63:0/267783431 >> v2:172.21.15.155:3300/0 conn(0x7fd080065df0 0x7fd0800afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:45.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.277+0000 7fd08807e700 1 -- 172.21.15.63:0/267783431 >> 172.21.15.63:0/267783431 conn(0x7fd0800b9770 msgr2=0x7fd08005eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:45.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.277+0000 7fd08807e700 1 -- 172.21.15.63:0/267783431 shutdown_connections 2020-05-18T21:37:45.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.277+0000 7fd08807e700 1 -- 172.21.15.63:0/267783431 wait complete. 2020-05-18T21:37:45.289 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 29 and data pool 30 2020-05-18T21:37:45.295 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:37:45.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.381+0000 7f21516d8700 1 Processor -- start 2020-05-18T21:37:45.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.381+0000 7f21516d8700 1 -- start start 2020-05-18T21:37:45.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f21516d8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f214c0b2860 0x7f214c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:45.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f21516d8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f214c14e570 0x7f214c14a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:45.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f21516d8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c14d960 con 0x7f214c060b90 2020-05-18T21:37:45.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f21516d8700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214c066210 con 0x7f214c0b2860 2020-05-18T21:37:45.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f21516d8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214c14db90 con 0x7f214c14e570 2020-05-18T21:37:45.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f214a7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f214c0b2860 0x7f214c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:45.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f214a7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f214c0b2860 0x7f214c0615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36164/0 (socket says 172.21.15.63:36164) 2020-05-18T21:37:45.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f214a7fc700 1 -- 172.21.15.63:0/2279088409 learned_addr learned my addr 172.21.15.63:0/2279088409 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:45.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f214b7fe700 1 --2- 172.21.15.63:0/2279088409 >> v2:172.21.15.155:3300/0 conn(0x7f214c14e570 0x7f214c14a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:45.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f214a7fc700 1 -- 172.21.15.63:0/2279088409 >> v2:172.21.15.155:3300/0 conn(0x7f214c14e570 msgr2=0x7f214c14a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:45.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f214a7fc700 1 --2- 172.21.15.63:0/2279088409 >> v2:172.21.15.155:3300/0 conn(0x7f214c14e570 0x7f214c14a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:45.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f214a7fc700 1 -- 172.21.15.63:0/2279088409 >> v1:172.21.15.155:6789/0 conn(0x7f214c060b90 legacy=0x7f214c144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f214a7fc700 1 -- 172.21.15.63:0/2279088409 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c14de30 con 0x7f214c0b2860 2020-05-18T21:37:45.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f214b7fe700 1 --2- 172.21.15.63:0/2279088409 >> v2:172.21.15.155:3300/0 conn(0x7f214c14e570 0x7f214c14a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:37:45.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f214a7fc700 1 --2- 172.21.15.63:0/2279088409 >> v2:172.21.15.63:3300/0 conn(0x7f214c0b2860 0x7f214c0615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2140002f70 tx=0x7f2140007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f214a7fc700 1 --2- 172.21.15.63:0/2279088409 >> v2:172.21.15.63:3300/0 conn(0x7f214c0b2860 0x7f214c0615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2140002f70 tx=0x7f2140007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f214a7fc700 1 --2- 172.21.15.63:0/2279088409 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f214c0b2860 0x7f214c0615e0 secure :-1 s=READY pgs=2054 cs=0 l=1 rx=0x7f2140002f70 tx=0x7f2140007a80).ready entity=mon.0 client_cookie=dfae3dbfd1fa8f6e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:45.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f214a7fc700 1 --2- 172.21.15.63:0/2279088409 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f214c0b2860 0x7f214c0615e0 secure :-1 s=THROTTLE_DONE pgs=2054 cs=0 l=1 rx=0x7f2140002f70 tx=0x7f2140007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f2149ffb700 1 -- 172.21.15.63:0/2279088409 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2140011760 con 0x7f214c0b2860 2020-05-18T21:37:45.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f214a7fc700 1 --2- 172.21.15.63:0/2279088409 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f214c0b2860 0x7f214c0615e0 secure :-1 s=THROTTLE_DONE pgs=2054 cs=0 l=1 rx=0x7f2140002f70 tx=0x7f2140007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f2149ffb700 1 -- 172.21.15.63:0/2279088409 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21400118c0 con 0x7f214c0b2860 2020-05-18T21:37:45.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f214a7fc700 1 --2- 172.21.15.63:0/2279088409 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f214c0b2860 0x7f214c0615e0 secure :-1 s=THROTTLE_DONE pgs=2054 cs=0 l=1 rx=0x7f2140002f70 tx=0x7f2140007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f21516d8700 1 -- 172.21.15.63:0/2279088409 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f214c0b2860 msgr2=0x7f214c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f2149ffb700 1 -- 172.21.15.63:0/2279088409 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2140011ce0 con 0x7f214c0b2860 2020-05-18T21:37:45.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f21516d8700 1 --2- 172.21.15.63:0/2279088409 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f214c0b2860 0x7f214c0615e0 secure :-1 s=READY pgs=2054 cs=0 l=1 rx=0x7f2140002f70 tx=0x7f2140007a80).stop 2020-05-18T21:37:45.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f21516d8700 1 -- 172.21.15.63:0/2279088409 shutdown_connections 2020-05-18T21:37:45.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f21516d8700 1 --2- 172.21.15.63:0/2279088409 >> v2:172.21.15.155:3300/0 conn(0x7f214c14e570 0x7f214c14a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:45.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f21516d8700 1 --2- 172.21.15.63:0/2279088409 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f214c0b2860 0x7f214c0615e0 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:45.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f21516d8700 1 -- 172.21.15.63:0/2279088409 >> 172.21.15.63:0/2279088409 conn(0x7f214c0b83d0 msgr2=0x7f214c0b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:45.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f21516d8700 1 -- 172.21.15.63:0/2279088409 shutdown_connections 2020-05-18T21:37:45.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.385+0000 7f21516d8700 1 -- 172.21.15.63:0/2279088409 wait complete. 2020-05-18T21:37:45.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.389+0000 7f21516d8700 1 Processor -- start 2020-05-18T21:37:45.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.389+0000 7f21516d8700 1 -- start start 2020-05-18T21:37:45.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.389+0000 7f21516d8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f214c060b90 0x7f214c0b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:45.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.389+0000 7f21516d8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c147310 con 0x7f214c0b2860 2020-05-18T21:37:45.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.389+0000 7f21516d8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c0b7480 con 0x7f214c14e570 2020-05-18T21:37:45.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.389+0000 7f21516d8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214c149430 con 0x7f214c060b90 2020-05-18T21:37:45.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.389+0000 7f214a7fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f214c0b2860 0x7f214c148c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38358/0 (socket says 172.21.15.63:38358) 2020-05-18T21:37:45.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.389+0000 7f214a7fc700 1 -- 172.21.15.63:0/3039744970 learned_addr learned my addr 172.21.15.63:0/3039744970 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:45.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.389+0000 7f214affd700 1 --2- 172.21.15.63:0/3039744970 >> v2:172.21.15.155:3300/0 conn(0x7f214c060b90 0x7f214c0b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:45.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.389+0000 7f213bfff700 1 -- 172.21.15.63:0/3039744970 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069463997 0 0) 0x7f214c147310 con 0x7f214c0b2860 2020-05-18T21:37:45.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.389+0000 7f213bfff700 1 -- 172.21.15.63:0/3039744970 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2128002fe0 con 0x7f214c0b2860 2020-05-18T21:37:45.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.389+0000 7f214affd700 1 -- 172.21.15.63:0/3039744970 >> v1:172.21.15.155:6789/0 conn(0x7f214c14e570 legacy=0x7f214c1479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.389+0000 7f213bfff700 1 -- 172.21.15.63:0/3039744970 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487245092 0 0) 0x7f214c0b7480 con 0x7f214c14e570 2020-05-18T21:37:45.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.389+0000 7f214affd700 1 -- 172.21.15.63:0/3039744970 >> v1:172.21.15.63:6789/0 conn(0x7f214c0b2860 legacy=0x7f214c148c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.389+0000 7f214affd700 1 -- 172.21.15.63:0/3039744970 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c147540 con 0x7f214c060b90 2020-05-18T21:37:45.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.389+0000 7f214affd700 1 --2- 172.21.15.63:0/3039744970 >> v2:172.21.15.155:3300/0 conn(0x7f214c060b90 0x7f214c0b7020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f214c067d20 tx=0x7f213c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.389+0000 7f214affd700 1 --2- 172.21.15.63:0/3039744970 >> v2:172.21.15.155:3300/0 conn(0x7f214c060b90 0x7f214c0b7020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f214c067d20 tx=0x7f213c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.389+0000 7f214affd700 1 --2- 172.21.15.63:0/3039744970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f214c060b90 0x7f214c0b7020 secure :-1 s=READY pgs=1366 cs=0 l=1 rx=0x7f214c067d20 tx=0x7f213c0108c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:45.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.393+0000 7f214affd700 1 --2- 172.21.15.63:0/3039744970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f214c060b90 0x7f214c0b7020 secure :-1 s=THROTTLE_DONE pgs=1366 cs=0 l=1 rx=0x7f214c067d20 tx=0x7f213c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.393+0000 7f213bfff700 1 -- 172.21.15.63:0/3039744970 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f213c006c00 con 0x7f214c060b90 2020-05-18T21:37:45.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.393+0000 7f214affd700 1 --2- 172.21.15.63:0/3039744970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f214c060b90 0x7f214c0b7020 secure :-1 s=THROTTLE_DONE pgs=1366 cs=0 l=1 rx=0x7f214c067d20 tx=0x7f213c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.393+0000 7f214affd700 1 --2- 172.21.15.63:0/3039744970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f214c060b90 0x7f214c0b7020 secure :-1 s=THROTTLE_DONE pgs=1366 cs=0 l=1 rx=0x7f214c067d20 tx=0x7f213c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.393+0000 7f213bfff700 1 -- 172.21.15.63:0/3039744970 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c006d60 con 0x7f214c060b90 2020-05-18T21:37:45.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.393+0000 7f213bfff700 1 -- 172.21.15.63:0/3039744970 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f213c011110 con 0x7f214c060b90 2020-05-18T21:37:45.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.393+0000 7f21516d8700 1 -- 172.21.15.63:0/3039744970 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214c148150 con 0x7f214c060b90 2020-05-18T21:37:45.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.393+0000 7f21516d8700 1 -- 172.21.15.63:0/3039744970 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c1467a0 con 0x7f214c060b90 2020-05-18T21:37:45.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.393+0000 7f214affd700 1 --2- 172.21.15.63:0/3039744970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f214c060b90 0x7f214c0b7020 secure :-1 s=THROTTLE_DONE pgs=1366 cs=0 l=1 rx=0x7f214c067d20 tx=0x7f213c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.393+0000 7f21516d8700 1 -- 172.21.15.63:0/3039744970 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214c0569e0 con 0x7f214c060b90 2020-05-18T21:37:45.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.393+0000 7f214affd700 1 --2- 172.21.15.63:0/3039744970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f214c060b90 0x7f214c0b7020 secure :-1 s=THROTTLE_DONE pgs=1366 cs=0 l=1 rx=0x7f214c067d20 tx=0x7f213c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.393+0000 7f213bfff700 1 -- 172.21.15.63:0/3039744970 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f213c011310 con 0x7f214c060b90 2020-05-18T21:37:45.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.393+0000 7f213bfff700 1 --2- 172.21.15.63:0/3039744970 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f212804fca0 0x7f2128052160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:45.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.393+0000 7f213bfff700 1 -- 172.21.15.63:0/3039744970 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f213c063b30 con 0x7f214c060b90 2020-05-18T21:37:45.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.393+0000 7f214a7fc700 1 --2- 172.21.15.63:0/3039744970 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f212804fca0 0x7f2128052160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:45.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.397+0000 7f214a7fc700 1 --2- 172.21.15.63:0/3039744970 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f212804fca0 0x7f2128052160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2140008500 tx=0x7f2140007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.397+0000 7f214a7fc700 1 --2- 172.21.15.63:0/3039744970 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f212804fca0 0x7f2128052160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2140008500 tx=0x7f2140007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.397+0000 7f214a7fc700 1 --2- 172.21.15.63:0/3039744970 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f212804fca0 0x7f2128052160 secure :-1 s=READY pgs=804 cs=0 l=1 rx=0x7f2140008500 tx=0x7f2140007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:45.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.401+0000 7f214affd700 1 --2- 172.21.15.63:0/3039744970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f214c060b90 0x7f214c0b7020 secure :-1 s=THROTTLE_DONE pgs=1366 cs=0 l=1 rx=0x7f214c067d20 tx=0x7f213c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.401+0000 7f213bfff700 1 -- 172.21.15.63:0/3039744970 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f213c03de80 con 0x7f214c060b90 2020-05-18T21:37:45.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.517+0000 7f21516d8700 1 -- 172.21.15.63:0/3039744970 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f214c0b8fa0 con 0x7f214c060b90 2020-05-18T21:37:45.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.521+0000 7f214affd700 1 --2- 172.21.15.63:0/3039744970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f214c060b90 0x7f214c0b7020 secure :-1 s=THROTTLE_DONE pgs=1366 cs=0 l=1 rx=0x7f214c067d20 tx=0x7f213c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.521+0000 7f213bfff700 1 -- 172.21.15.63:0/3039744970 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+16116 (secure 0 0 0) 0x7f213c0414a0 con 0x7f214c060b90 2020-05-18T21:37:45.526 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:45.526 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":155,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:37:45.262439+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:37:43.788191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2020-05-18T21:37:44.262734+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:37:45.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.521+0000 7f21516d8700 1 -- 172.21.15.63:0/3039744970 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f212804fca0 msgr2=0x7f2128052160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.521+0000 7f21516d8700 1 --2- 172.21.15.63:0/3039744970 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f212804fca0 0x7f2128052160 secure :-1 s=READY pgs=804 cs=0 l=1 rx=0x7f2140008500 tx=0x7f2140007a80).stop 2020-05-18T21:37:45.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.521+0000 7f21516d8700 1 -- 172.21.15.63:0/3039744970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f214c060b90 msgr2=0x7f214c0b7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.521+0000 7f21516d8700 1 --2- 172.21.15.63:0/3039744970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f214c060b90 0x7f214c0b7020 secure :-1 s=READY pgs=1366 cs=0 l=1 rx=0x7f214c067d20 tx=0x7f213c0108c0).stop 2020-05-18T21:37:45.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.521+0000 7f21516d8700 1 -- 172.21.15.63:0/3039744970 shutdown_connections 2020-05-18T21:37:45.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.521+0000 7f21516d8700 1 --2- 172.21.15.63:0/3039744970 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f212804fca0 0x7f2128052160 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:45.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.521+0000 7f21516d8700 1 --2- 172.21.15.63:0/3039744970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f214c060b90 0x7f214c0b7020 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:45.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.521+0000 7f21516d8700 1 -- 172.21.15.63:0/3039744970 >> 172.21.15.63:0/3039744970 conn(0x7f214c0b83d0 msgr2=0x7f214c064bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:45.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.521+0000 7f21516d8700 1 -- 172.21.15.63:0/3039744970 shutdown_connections 2020-05-18T21:37:45.529 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.521+0000 7f21516d8700 1 -- 172.21.15.63:0/3039744970 wait complete. 2020-05-18T21:37:45.539 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:37:45.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.633+0000 7fb11e010700 1 Processor -- start 2020-05-18T21:37:45.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.633+0000 7fb11e010700 1 -- start start 2020-05-18T21:37:45.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.633+0000 7fb11e010700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1180b4760 0x7fb1180648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:45.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.633+0000 7fb11e010700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11814a330 con 0x7fb118064d20 2020-05-18T21:37:45.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.633+0000 7fb11e010700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11814a5d0 con 0x7fb11805f110 2020-05-18T21:37:45.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.633+0000 7fb11e010700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11814a140 con 0x7fb1180b4760 2020-05-18T21:37:45.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.633+0000 7fb11d00e700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fb11805f110 0x7fb11814aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:36680/0 (socket says 172.21.15.63:36680) 2020-05-18T21:37:45.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.633+0000 7fb11d00e700 1 -- 172.21.15.63:0/2383588453 learned_addr learned my addr 172.21.15.63:0/2383588453 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:45.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.633+0000 7fb11d80f700 1 --1- 172.21.15.63:0/2383588453 >> v1:172.21.15.63:6789/0 conn(0x7fb118064d20 0x7fb11814d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38366/0 (socket says 172.21.15.63:38366) 2020-05-18T21:37:45.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.633+0000 7fb11c80d700 1 --2- 172.21.15.63:0/2383588453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1180b4760 0x7fb1180648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:45.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb10ffff700 1 -- 172.21.15.63:0/2383588453 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449270984 0 0) 0x7fb11814a5d0 con 0x7fb11805f110 2020-05-18T21:37:45.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb10ffff700 1 -- 172.21.15.63:0/2383588453 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0fc003270 con 0x7fb11805f110 2020-05-18T21:37:45.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb11c80d700 1 -- 172.21.15.63:0/2383588453 >> v1:172.21.15.155:6789/0 conn(0x7fb11805f110 legacy=0x7fb11814aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb11c80d700 1 -- 172.21.15.63:0/2383588453 >> v1:172.21.15.63:6789/0 conn(0x7fb118064d20 legacy=0x7fb11814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb11c80d700 1 -- 172.21.15.63:0/2383588453 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb118063430 con 0x7fb1180b4760 2020-05-18T21:37:45.644 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb11c80d700 1 --2- 172.21.15.63:0/2383588453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1180b4760 0x7fb1180648c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb118060a90 tx=0x7fb108008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb11c80d700 1 --2- 172.21.15.63:0/2383588453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1180b4760 0x7fb1180648c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb118060a90 tx=0x7fb108008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb11c80d700 1 --2- 172.21.15.63:0/2383588453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1180b4760 0x7fb1180648c0 secure :-1 s=READY pgs=315 cs=0 l=1 rx=0x7fb118060a90 tx=0x7fb108008920).ready entity=mon.2 client_cookie=4ef4f12eaa39da87 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:45.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb11c80d700 1 --2- 172.21.15.63:0/2383588453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1180b4760 0x7fb1180648c0 secure :-1 s=THROTTLE_DONE pgs=315 cs=0 l=1 rx=0x7fb118060a90 tx=0x7fb108008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb10ffff700 1 -- 172.21.15.63:0/2383588453 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb108008e80 con 0x7fb1180b4760 2020-05-18T21:37:45.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb11c80d700 1 --2- 172.21.15.63:0/2383588453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1180b4760 0x7fb1180648c0 secure :-1 s=THROTTLE_DONE pgs=315 cs=0 l=1 rx=0x7fb118060a90 tx=0x7fb108008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.645 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb10ffff700 1 -- 172.21.15.63:0/2383588453 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb108011620 con 0x7fb1180b4760 2020-05-18T21:37:45.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb11c80d700 1 --2- 172.21.15.63:0/2383588453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1180b4760 0x7fb1180648c0 secure :-1 s=THROTTLE_DONE pgs=315 cs=0 l=1 rx=0x7fb118060a90 tx=0x7fb108008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb10ffff700 1 -- 172.21.15.63:0/2383588453 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb108011a00 con 0x7fb1180b4760 2020-05-18T21:37:45.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb11e010700 1 -- 172.21.15.63:0/2383588453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1180b4760 msgr2=0x7fb1180648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.646 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb11e010700 1 --2- 172.21.15.63:0/2383588453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1180b4760 0x7fb1180648c0 secure :-1 s=READY pgs=315 cs=0 l=1 rx=0x7fb118060a90 tx=0x7fb108008920).stop 2020-05-18T21:37:45.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb11e010700 1 -- 172.21.15.63:0/2383588453 shutdown_connections 2020-05-18T21:37:45.649 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb11e010700 1 --2- 172.21.15.63:0/2383588453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1180b4760 0x7fb1180648c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:45.650 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb11e010700 1 -- 172.21.15.63:0/2383588453 >> 172.21.15.63:0/2383588453 conn(0x7fb118069fc0 msgr2=0x7fb11806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:45.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb11e010700 1 -- 172.21.15.63:0/2383588453 shutdown_connections 2020-05-18T21:37:45.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb11e010700 1 -- 172.21.15.63:0/2383588453 wait complete. 2020-05-18T21:37:45.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb11e010700 1 Processor -- start 2020-05-18T21:37:45.651 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.637+0000 7fb11e010700 1 -- start start 2020-05-18T21:37:45.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11e010700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb11805f110 0x7fb118148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:45.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11e010700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb118064d20 0x7fb118147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:45.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11e010700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1181475b0 con 0x7fb1180b4760 2020-05-18T21:37:45.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11e010700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb118145440 con 0x7fb118064d20 2020-05-18T21:37:45.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11e010700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1181456e0 con 0x7fb11805f110 2020-05-18T21:37:45.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11d80f700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb1180b4760 0x7fb1181460c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38374/0 (socket says 172.21.15.63:38374) 2020-05-18T21:37:45.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11d80f700 1 -- 172.21.15.63:0/925460879 learned_addr learned my addr 172.21.15.63:0/925460879 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:45.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11d00e700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb11805f110 0x7fb118148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:45.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11c80d700 1 --2- 172.21.15.63:0/925460879 >> v2:172.21.15.155:3300/0 conn(0x7fb118064d20 0x7fb118147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:45.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb10e7fc700 1 -- 172.21.15.63:0/925460879 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120131537 0 0) 0x7fb1181475b0 con 0x7fb1180b4760 2020-05-18T21:37:45.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb10e7fc700 1 -- 172.21.15.63:0/925460879 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb100002fe0 con 0x7fb1180b4760 2020-05-18T21:37:45.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11d00e700 1 -- 172.21.15.63:0/925460879 >> v2:172.21.15.155:3300/0 conn(0x7fb118064d20 msgr2=0x7fb118147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11d00e700 1 --2- 172.21.15.63:0/925460879 >> v2:172.21.15.155:3300/0 conn(0x7fb118064d20 0x7fb118147150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:45.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11d00e700 1 -- 172.21.15.63:0/925460879 >> v1:172.21.15.63:6789/0 conn(0x7fb1180b4760 legacy=0x7fb1181460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.654 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11d00e700 1 -- 172.21.15.63:0/925460879 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb118145980 con 0x7fb11805f110 2020-05-18T21:37:45.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11d00e700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb11805f110 0x7fb118148bf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb114001490 tx=0x7fb114010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11d00e700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb11805f110 0x7fb118148bf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb114001490 tx=0x7fb114010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11d00e700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb11805f110 0x7fb118148bf0 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7fb114001490 tx=0x7fb114010c70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:45.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11d00e700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb11805f110 0x7fb118148bf0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fb114001490 tx=0x7fb114010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb10e7fc700 1 -- 172.21.15.63:0/925460879 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb114005e90 con 0x7fb11805f110 2020-05-18T21:37:45.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11d00e700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb11805f110 0x7fb118148bf0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fb114001490 tx=0x7fb114010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11d00e700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb11805f110 0x7fb118148bf0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fb114001490 tx=0x7fb114010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb10e7fc700 1 -- 172.21.15.63:0/925460879 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb114012480 con 0x7fb11805f110 2020-05-18T21:37:45.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11e010700 1 -- 172.21.15.63:0/925460879 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb118145c20 con 0x7fb11805f110 2020-05-18T21:37:45.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb10e7fc700 1 -- 172.21.15.63:0/925460879 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb114012820 con 0x7fb11805f110 2020-05-18T21:37:45.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11e010700 1 -- 172.21.15.63:0/925460879 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb118144f90 con 0x7fb11805f110 2020-05-18T21:37:45.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11d00e700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb11805f110 0x7fb118148bf0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fb114001490 tx=0x7fb114010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11e010700 1 -- 172.21.15.63:0/925460879 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1180569e0 con 0x7fb11805f110 2020-05-18T21:37:45.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb11d00e700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb11805f110 0x7fb118148bf0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fb114001490 tx=0x7fb114010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.641+0000 7fb10e7fc700 1 -- 172.21.15.63:0/925460879 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb114012a20 con 0x7fb11805f110 2020-05-18T21:37:45.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.645+0000 7fb10e7fc700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb10004fd40 0x7fb100052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:45.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.645+0000 7fb10e7fc700 1 -- 172.21.15.63:0/925460879 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb1140090c0 con 0x7fb11805f110 2020-05-18T21:37:45.658 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.645+0000 7fb11c80d700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb10004fd40 0x7fb100052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:45.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.645+0000 7fb11c80d700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb10004fd40 0x7fb100052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb118060a90 tx=0x7fb118063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.645+0000 7fb11c80d700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb10004fd40 0x7fb100052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb118060a90 tx=0x7fb118063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.659 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.645+0000 7fb11c80d700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb10004fd40 0x7fb100052200 secure :-1 s=READY pgs=805 cs=0 l=1 rx=0x7fb118060a90 tx=0x7fb118063c50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:45.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.649+0000 7fb11d00e700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb11805f110 0x7fb118148bf0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fb114001490 tx=0x7fb114010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.660 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.649+0000 7fb10e7fc700 1 -- 172.21.15.63:0/925460879 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb11403e6c0 con 0x7fb11805f110 2020-05-18T21:37:45.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.769+0000 7fb11e010700 1 -- 172.21.15.63:0/925460879 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb11805c870 con 0x7fb11805f110 2020-05-18T21:37:45.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.769+0000 7fb11d00e700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb11805f110 0x7fb118148bf0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fb114001490 tx=0x7fb114010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.769+0000 7fb10e7fc700 1 -- 172.21.15.63:0/925460879 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+16116 (secure 0 0 0) 0x7fb114012cb0 con 0x7fb11805f110 2020-05-18T21:37:45.776 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:45.776 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":155,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:37:45.262439+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:37:43.788191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2020-05-18T21:37:44.262734+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:37:45.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.773+0000 7fb11e010700 1 -- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb10004fd40 msgr2=0x7fb100052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.773+0000 7fb11e010700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb10004fd40 0x7fb100052200 secure :-1 s=READY pgs=805 cs=0 l=1 rx=0x7fb118060a90 tx=0x7fb118063c50).stop 2020-05-18T21:37:45.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.773+0000 7fb11e010700 1 -- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb11805f110 msgr2=0x7fb118148bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.773+0000 7fb11e010700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb11805f110 0x7fb118148bf0 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7fb114001490 tx=0x7fb114010c70).stop 2020-05-18T21:37:45.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.773+0000 7fb11e010700 1 -- 172.21.15.63:0/925460879 shutdown_connections 2020-05-18T21:37:45.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.773+0000 7fb11e010700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb10004fd40 0x7fb100052200 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:45.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.773+0000 7fb11e010700 1 --2- 172.21.15.63:0/925460879 >> v2:172.21.15.155:3300/0 conn(0x7fb118064d20 0x7fb118147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:45.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.773+0000 7fb11e010700 1 --2- 172.21.15.63:0/925460879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb11805f110 0x7fb118148bf0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:45.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.773+0000 7fb11e010700 1 -- 172.21.15.63:0/925460879 >> 172.21.15.63:0/925460879 conn(0x7fb118069fc0 msgr2=0x7fb1180651d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:45.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.773+0000 7fb11e010700 1 -- 172.21.15.63:0/925460879 shutdown_connections 2020-05-18T21:37:45.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.773+0000 7fb11e010700 1 -- 172.21.15.63:0/925460879 wait complete. 2020-05-18T21:37:45.789 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-05-18T21:37:45.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.897+0000 7f37ad714700 1 Processor -- start 2020-05-18T21:37:45.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.897+0000 7f37ad714700 1 -- start start 2020-05-18T21:37:45.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37ad714700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37a80b62a0 0x7f37a80b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:45.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37ad714700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f37a812bd70 0x7f37a812c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:45.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37ad714700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a8146580 con 0x7f37a809f4c0 2020-05-18T21:37:45.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37ad714700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a8062300 con 0x7f37a812bd70 2020-05-18T21:37:45.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37ad714700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a81467b0 con 0x7f37a80b62a0 2020-05-18T21:37:45.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37acf13700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f37a812bd70 0x7f37a812c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:45.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37acf13700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f37a812bd70 0x7f37a812c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:51040/0 (socket says 172.21.15.63:51040) 2020-05-18T21:37:45.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37a7fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37a80b62a0 0x7f37a80b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:45.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37acf13700 1 -- 172.21.15.63:0/4031976037 learned_addr learned my addr 172.21.15.63:0/4031976037 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:45.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37acf13700 1 -- 172.21.15.63:0/4031976037 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37a80b62a0 msgr2=0x7f37a80b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:45.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37acf13700 1 --2- 172.21.15.63:0/4031976037 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37a80b62a0 0x7f37a80b5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:45.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37acf13700 1 -- 172.21.15.63:0/4031976037 >> v1:172.21.15.155:6789/0 conn(0x7f37a809f4c0 legacy=0x7f37a8146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37acf13700 1 -- 172.21.15.63:0/4031976037 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a8147360 con 0x7f37a812bd70 2020-05-18T21:37:45.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37a77fe700 1 -- 172.21.15.63:0/4031976037 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3412903157 0 0) 0x7f37a8146580 con 0x7f37a809f4c0 2020-05-18T21:37:45.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37acf13700 1 --2- 172.21.15.63:0/4031976037 >> v2:172.21.15.155:3300/0 conn(0x7f37a812bd70 0x7f37a812c1c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f37a00032f0 tx=0x7f37a0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37acf13700 1 --2- 172.21.15.63:0/4031976037 >> v2:172.21.15.155:3300/0 conn(0x7f37a812bd70 0x7f37a812c1c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f37a00032f0 tx=0x7f37a0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37acf13700 1 --2- 172.21.15.63:0/4031976037 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37a812bd70 0x7f37a812c1c0 secure :-1 s=READY pgs=1369 cs=0 l=1 rx=0x7f37a00032f0 tx=0x7f37a0007e00).ready entity=mon.1 client_cookie=6254e3635ce710b9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:45.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37acf13700 1 --2- 172.21.15.63:0/4031976037 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37a812bd70 0x7f37a812c1c0 secure :-1 s=THROTTLE_DONE pgs=1369 cs=0 l=1 rx=0x7f37a00032f0 tx=0x7f37a0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37a77fe700 1 -- 172.21.15.63:0/4031976037 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37a000c370 con 0x7f37a812bd70 2020-05-18T21:37:45.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37acf13700 1 --2- 172.21.15.63:0/4031976037 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37a812bd70 0x7f37a812c1c0 secure :-1 s=THROTTLE_DONE pgs=1369 cs=0 l=1 rx=0x7f37a00032f0 tx=0x7f37a0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37acf13700 1 --2- 172.21.15.63:0/4031976037 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37a812bd70 0x7f37a812c1c0 secure :-1 s=THROTTLE_DONE pgs=1369 cs=0 l=1 rx=0x7f37a00032f0 tx=0x7f37a0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37a77fe700 1 -- 172.21.15.63:0/4031976037 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a000c4d0 con 0x7f37a812bd70 2020-05-18T21:37:45.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37a77fe700 1 -- 172.21.15.63:0/4031976037 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37a000c8b0 con 0x7f37a812bd70 2020-05-18T21:37:45.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37ad714700 1 -- 172.21.15.63:0/4031976037 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37a812bd70 msgr2=0x7f37a812c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.901+0000 7f37ad714700 1 --2- 172.21.15.63:0/4031976037 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37a812bd70 0x7f37a812c1c0 secure :-1 s=READY pgs=1369 cs=0 l=1 rx=0x7f37a00032f0 tx=0x7f37a0007e00).stop 2020-05-18T21:37:45.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.905+0000 7f37ad714700 1 -- 172.21.15.63:0/4031976037 shutdown_connections 2020-05-18T21:37:45.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.905+0000 7f37ad714700 1 --2- 172.21.15.63:0/4031976037 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37a812bd70 0x7f37a812c1c0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:45.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.905+0000 7f37ad714700 1 --2- 172.21.15.63:0/4031976037 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37a80b62a0 0x7f37a80b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:45.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.905+0000 7f37ad714700 1 -- 172.21.15.63:0/4031976037 >> 172.21.15.63:0/4031976037 conn(0x7f37a805a7c0 msgr2=0x7f37a805aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:45.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.905+0000 7f37ad714700 1 -- 172.21.15.63:0/4031976037 shutdown_connections 2020-05-18T21:37:45.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.905+0000 7f37ad714700 1 -- 172.21.15.63:0/4031976037 wait complete. 2020-05-18T21:37:45.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.905+0000 7f37ad714700 1 Processor -- start 2020-05-18T21:37:45.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.905+0000 7f37ad714700 1 -- start start 2020-05-18T21:37:45.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37ad714700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f37a809f4c0 0x7f37a8064d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:45.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37ad714700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a8153580 con 0x7f37a80b62a0 2020-05-18T21:37:45.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37ad714700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a8157930 con 0x7f37a812bd70 2020-05-18T21:37:45.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37ad714700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a80651a0 con 0x7f37a809f4c0 2020-05-18T21:37:45.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37a7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f37a809f4c0 0x7f37a8064d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:45.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f379ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f37a80b62a0 0x7f37a80b2b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38384/0 (socket says 172.21.15.63:38384) 2020-05-18T21:37:45.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37a7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f37a809f4c0 0x7f37a8064d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36194/0 (socket says 172.21.15.63:36194) 2020-05-18T21:37:45.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f379ffff700 1 -- 172.21.15.63:0/1068624221 learned_addr learned my addr 172.21.15.63:0/1068624221 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:45.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37a7fff700 1 -- 172.21.15.63:0/1068624221 >> v1:172.21.15.155:6789/0 conn(0x7f37a812bd70 legacy=0x7f37a813ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37a7fff700 1 -- 172.21.15.63:0/1068624221 >> v1:172.21.15.63:6789/0 conn(0x7f37a80b62a0 legacy=0x7f37a80b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:45.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37a7fff700 1 -- 172.21.15.63:0/1068624221 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a81537c0 con 0x7f37a809f4c0 2020-05-18T21:37:45.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37a7fff700 1 --2- 172.21.15.63:0/1068624221 >> v2:172.21.15.63:3300/0 conn(0x7f37a809f4c0 0x7f37a8064d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3798002f70 tx=0x7f3798010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37a7fff700 1 --2- 172.21.15.63:0/1068624221 >> v2:172.21.15.63:3300/0 conn(0x7f37a809f4c0 0x7f37a8064d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3798002f70 tx=0x7f3798010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37a7fff700 1 --2- 172.21.15.63:0/1068624221 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37a809f4c0 0x7f37a8064d40 secure :-1 s=READY pgs=2059 cs=0 l=1 rx=0x7f3798002f70 tx=0x7f3798010c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:45.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37a7fff700 1 --2- 172.21.15.63:0/1068624221 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37a809f4c0 0x7f37a8064d40 secure :-1 s=THROTTLE_DONE pgs=2059 cs=0 l=1 rx=0x7f3798002f70 tx=0x7f3798010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37a5ffb700 1 -- 172.21.15.63:0/1068624221 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3798012a70 con 0x7f37a809f4c0 2020-05-18T21:37:45.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37ad714700 1 -- 172.21.15.63:0/1068624221 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a81406b0 con 0x7f37a809f4c0 2020-05-18T21:37:45.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37a7fff700 1 --2- 172.21.15.63:0/1068624221 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37a809f4c0 0x7f37a8064d40 secure :-1 s=THROTTLE_DONE pgs=2059 cs=0 l=1 rx=0x7f3798002f70 tx=0x7f3798010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37a5ffb700 1 -- 172.21.15.63:0/1068624221 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3798012bd0 con 0x7f37a809f4c0 2020-05-18T21:37:45.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37a7fff700 1 --2- 172.21.15.63:0/1068624221 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37a809f4c0 0x7f37a8064d40 secure :-1 s=THROTTLE_DONE pgs=2059 cs=0 l=1 rx=0x7f3798002f70 tx=0x7f3798010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37ad714700 1 -- 172.21.15.63:0/1068624221 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a8157560 con 0x7f37a809f4c0 2020-05-18T21:37:45.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37a5ffb700 1 -- 172.21.15.63:0/1068624221 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3798005700 con 0x7f37a809f4c0 2020-05-18T21:37:45.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37a7fff700 1 --2- 172.21.15.63:0/1068624221 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37a809f4c0 0x7f37a8064d40 secure :-1 s=THROTTLE_DONE pgs=2059 cs=0 l=1 rx=0x7f3798002f70 tx=0x7f3798010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37a5ffb700 1 -- 172.21.15.63:0/1068624221 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3798007190 con 0x7f37a809f4c0 2020-05-18T21:37:45.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37a7fff700 1 --2- 172.21.15.63:0/1068624221 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37a809f4c0 0x7f37a8064d40 secure :-1 s=THROTTLE_DONE pgs=2059 cs=0 l=1 rx=0x7f3798002f70 tx=0x7f3798010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37ad714700 1 -- 172.21.15.63:0/1068624221 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a80569e0 con 0x7f37a809f4c0 2020-05-18T21:37:45.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37a5ffb700 1 --2- 172.21.15.63:0/1068624221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f378004f940 0x7f3780051e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:45.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.909+0000 7f37a5ffb700 1 -- 172.21.15.63:0/1068624221 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3798064160 con 0x7f37a809f4c0 2020-05-18T21:37:45.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.913+0000 7f379ffff700 1 --2- 172.21.15.63:0/1068624221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f378004f940 0x7f3780051e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:45.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.913+0000 7f379ffff700 1 --2- 172.21.15.63:0/1068624221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f378004f940 0x7f3780051e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f37a8065c20 tx=0x7f3790001670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.913+0000 7f379ffff700 1 --2- 172.21.15.63:0/1068624221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f378004f940 0x7f3780051e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f37a8065c20 tx=0x7f3790001670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.913+0000 7f379ffff700 1 --2- 172.21.15.63:0/1068624221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f378004f940 0x7f3780051e00 secure :-1 s=READY pgs=806 cs=0 l=1 rx=0x7f37a8065c20 tx=0x7f3790001670).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:45.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.913+0000 7f37a7fff700 1 --2- 172.21.15.63:0/1068624221 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37a809f4c0 0x7f37a8064d40 secure :-1 s=THROTTLE_DONE pgs=2059 cs=0 l=1 rx=0x7f3798002f70 tx=0x7f3798010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:45.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:45.913+0000 7f37a5ffb700 1 -- 172.21.15.63:0/1068624221 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f379803e490 con 0x7f37a809f4c0 2020-05-18T21:37:46.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.065+0000 7f37ad714700 1 -- 172.21.15.63:0/1068624221 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f37a80620e0 con 0x7f37a809f4c0 2020-05-18T21:37:46.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.277+0000 7f37a7fff700 1 --2- 172.21.15.63:0/1068624221 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37a809f4c0 0x7f37a8064d40 secure :-1 s=THROTTLE_DONE pgs=2059 cs=0 l=1 rx=0x7f3798002f70 tx=0x7f3798010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.277+0000 7f37a5ffb700 1 -- 172.21.15.63:0/1068624221 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v134) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3798041ab0 con 0x7f37a809f4c0 2020-05-18T21:37:46.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.281+0000 7f37ad714700 1 -- 172.21.15.63:0/1068624221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f378004f940 msgr2=0x7f3780051e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:46.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.281+0000 7f37ad714700 1 --2- 172.21.15.63:0/1068624221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f378004f940 0x7f3780051e00 secure :-1 s=READY pgs=806 cs=0 l=1 rx=0x7f37a8065c20 tx=0x7f3790001670).stop 2020-05-18T21:37:46.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.281+0000 7f37ad714700 1 -- 172.21.15.63:0/1068624221 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37a809f4c0 msgr2=0x7f37a8064d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:46.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.281+0000 7f37ad714700 1 --2- 172.21.15.63:0/1068624221 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37a809f4c0 0x7f37a8064d40 secure :-1 s=READY pgs=2059 cs=0 l=1 rx=0x7f3798002f70 tx=0x7f3798010c80).stop 2020-05-18T21:37:46.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.281+0000 7f37ad714700 1 -- 172.21.15.63:0/1068624221 shutdown_connections 2020-05-18T21:37:46.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.281+0000 7f37ad714700 1 --2- 172.21.15.63:0/1068624221 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f378004f940 0x7f3780051e00 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:46.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.281+0000 7f37ad714700 1 --2- 172.21.15.63:0/1068624221 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37a809f4c0 0x7f37a8064d40 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:46.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.281+0000 7f37ad714700 1 -- 172.21.15.63:0/1068624221 >> 172.21.15.63:0/1068624221 conn(0x7f37a805a7c0 msgr2=0x7f37a8143290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:46.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.281+0000 7f37ad714700 1 -- 172.21.15.63:0/1068624221 shutdown_connections 2020-05-18T21:37:46.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.281+0000 7f37ad714700 1 -- 172.21.15.63:0/1068624221 wait complete. 2020-05-18T21:37:46.301 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:46.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feab180e700 1 Processor -- start 2020-05-18T21:37:46.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feab180e700 1 -- start start 2020-05-18T21:37:46.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feab180e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7feaac0b5990 0x7feaac0b8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:46.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feab180e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac0b87c0 0x7feaac149a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:46.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feab180e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac14a940 con 0x7feaac069eb0 2020-05-18T21:37:46.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feab180e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaac14eb00 con 0x7feaac0b5990 2020-05-18T21:37:46.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feab180e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac06a290 con 0x7feaac0b87c0 2020-05-18T21:37:46.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feaaa7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7feaac0b5990 0x7feaac0b8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:46.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feaaaffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7feaac069eb0 0x7feaac14ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38390/0 (socket says 172.21.15.63:38390) 2020-05-18T21:37:46.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feaaa7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7feaac0b5990 0x7feaac0b8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36204/0 (socket says 172.21.15.63:36204) 2020-05-18T21:37:46.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feaaaffd700 1 -- 172.21.15.63:0/1177669846 learned_addr learned my addr 172.21.15.63:0/1177669846 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:46.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feaab7fe700 1 --2- 172.21.15.63:0/1177669846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac0b87c0 0x7feaac149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:46.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feaaa7fc700 1 -- 172.21.15.63:0/1177669846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac0b87c0 msgr2=0x7feaac149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:46.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feaaa7fc700 1 --2- 172.21.15.63:0/1177669846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac0b87c0 0x7feaac149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:46.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feaaa7fc700 1 -- 172.21.15.63:0/1177669846 >> v1:172.21.15.63:6789/0 conn(0x7feaac069eb0 legacy=0x7feaac14ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:46.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feaaa7fc700 1 -- 172.21.15.63:0/1177669846 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac0b6e80 con 0x7feaac0b5990 2020-05-18T21:37:46.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feaa9ffb700 1 -- 172.21.15.63:0/1177669846 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519596450 0 0) 0x7feaac14a940 con 0x7feaac069eb0 2020-05-18T21:37:46.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feaaa7fc700 1 --2- 172.21.15.63:0/1177669846 >> v2:172.21.15.63:3300/0 conn(0x7feaac0b5990 0x7feaac0b8360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fea9c0032f0 tx=0x7fea9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feaaa7fc700 1 --2- 172.21.15.63:0/1177669846 >> v2:172.21.15.63:3300/0 conn(0x7feaac0b5990 0x7feaac0b8360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fea9c0032f0 tx=0x7fea9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feaaa7fc700 1 --2- 172.21.15.63:0/1177669846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feaac0b5990 0x7feaac0b8360 secure :-1 s=READY pgs=2061 cs=0 l=1 rx=0x7fea9c0032f0 tx=0x7fea9c007e00).ready entity=mon.0 client_cookie=82d945b2017a8d37 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:46.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feaaa7fc700 1 --2- 172.21.15.63:0/1177669846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feaac0b5990 0x7feaac0b8360 secure :-1 s=THROTTLE_DONE pgs=2061 cs=0 l=1 rx=0x7fea9c0032f0 tx=0x7fea9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feaa9ffb700 1 -- 172.21.15.63:0/1177669846 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea9c011e60 con 0x7feaac0b5990 2020-05-18T21:37:46.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feaaa7fc700 1 --2- 172.21.15.63:0/1177669846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feaac0b5990 0x7feaac0b8360 secure :-1 s=THROTTLE_DONE pgs=2061 cs=0 l=1 rx=0x7fea9c0032f0 tx=0x7fea9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feaa9ffb700 1 -- 172.21.15.63:0/1177669846 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c00a180 con 0x7feaac0b5990 2020-05-18T21:37:46.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feaaa7fc700 1 --2- 172.21.15.63:0/1177669846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feaac0b5990 0x7feaac0b8360 secure :-1 s=THROTTLE_DONE pgs=2061 cs=0 l=1 rx=0x7fea9c0032f0 tx=0x7fea9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feab180e700 1 -- 172.21.15.63:0/1177669846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feaac0b5990 msgr2=0x7feaac0b8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:46.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feaa9ffb700 1 -- 172.21.15.63:0/1177669846 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea9c00a520 con 0x7feaac0b5990 2020-05-18T21:37:46.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.401+0000 7feab180e700 1 --2- 172.21.15.63:0/1177669846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feaac0b5990 0x7feaac0b8360 secure :-1 s=READY pgs=2061 cs=0 l=1 rx=0x7fea9c0032f0 tx=0x7fea9c007e00).stop 2020-05-18T21:37:46.416 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feab180e700 1 -- 172.21.15.63:0/1177669846 shutdown_connections 2020-05-18T21:37:46.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feab180e700 1 --2- 172.21.15.63:0/1177669846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac0b87c0 0x7feaac149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:46.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feab180e700 1 --2- 172.21.15.63:0/1177669846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feaac0b5990 0x7feaac0b8360 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:46.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feab180e700 1 -- 172.21.15.63:0/1177669846 >> 172.21.15.63:0/1177669846 conn(0x7feaac066ed0 msgr2=0x7feaac0b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:46.417 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feab180e700 1 -- 172.21.15.63:0/1177669846 shutdown_connections 2020-05-18T21:37:46.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feab180e700 1 -- 172.21.15.63:0/1177669846 wait complete. 2020-05-18T21:37:46.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feab180e700 1 Processor -- start 2020-05-18T21:37:46.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feab180e700 1 -- start start 2020-05-18T21:37:46.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feab180e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac069eb0 0x7feaac0ac540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:46.418 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feab180e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac062f10 con 0x7feaac0b87c0 2020-05-18T21:37:46.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feab180e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac158710 con 0x7feaac0b5990 2020-05-18T21:37:46.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feab180e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac145930 con 0x7feaac069eb0 2020-05-18T21:37:46.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feaab7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7feaac0b87c0 0x7feaac065180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38400/0 (socket says 172.21.15.63:38400) 2020-05-18T21:37:46.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feaab7fe700 1 -- 172.21.15.63:0/2100869172 learned_addr learned my addr 172.21.15.63:0/2100869172 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:46.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feaaaffd700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac069eb0 0x7feaac0ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:46.419 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feaa3fff700 1 -- 172.21.15.63:0/2100869172 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2309072141 0 0) 0x7feaac062f10 con 0x7feaac0b87c0 2020-05-18T21:37:46.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feaa3fff700 1 -- 172.21.15.63:0/2100869172 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea84002fe0 con 0x7feaac0b87c0 2020-05-18T21:37:46.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feaaaffd700 1 -- 172.21.15.63:0/2100869172 >> v1:172.21.15.155:6789/0 conn(0x7feaac0b5990 legacy=0x7feaac157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:46.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feaa3fff700 1 -- 172.21.15.63:0/2100869172 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018335036 0 0) 0x7feaac158710 con 0x7feaac0b5990 2020-05-18T21:37:46.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feaaaffd700 1 -- 172.21.15.63:0/2100869172 >> v1:172.21.15.63:6789/0 conn(0x7feaac0b87c0 legacy=0x7feaac065180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:46.420 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feaaaffd700 1 -- 172.21.15.63:0/2100869172 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac1589b0 con 0x7feaac069eb0 2020-05-18T21:37:46.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feaaaffd700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac069eb0 0x7feaac0ac540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fea94000bc0 tx=0x7fea94010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feaaaffd700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac069eb0 0x7feaac0ac540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fea94000bc0 tx=0x7fea94010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.405+0000 7feaaaffd700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac069eb0 0x7feaac0ac540 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7fea94000bc0 tx=0x7fea94010940).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:46.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.409+0000 7feaaaffd700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac069eb0 0x7feaac0ac540 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7fea94000bc0 tx=0x7fea94010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.421 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.409+0000 7feaa3fff700 1 -- 172.21.15.63:0/2100869172 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea94005ce0 con 0x7feaac069eb0 2020-05-18T21:37:46.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.409+0000 7feaaaffd700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac069eb0 0x7feaac0ac540 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7fea94000bc0 tx=0x7fea94010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.409+0000 7feaa3fff700 1 -- 172.21.15.63:0/2100869172 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea94005e40 con 0x7feaac069eb0 2020-05-18T21:37:46.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.409+0000 7feab180e700 1 -- 172.21.15.63:0/2100869172 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac065890 con 0x7feaac069eb0 2020-05-18T21:37:46.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.409+0000 7feaaaffd700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac069eb0 0x7feaac0ac540 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7fea94000bc0 tx=0x7fea94010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.409+0000 7feaa3fff700 1 -- 172.21.15.63:0/2100869172 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea940062c0 con 0x7feaac069eb0 2020-05-18T21:37:46.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.409+0000 7feab180e700 1 -- 172.21.15.63:0/2100869172 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac0b4e70 con 0x7feaac069eb0 2020-05-18T21:37:46.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.409+0000 7feaaaffd700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac069eb0 0x7feaac0ac540 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7fea94000bc0 tx=0x7fea94010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.409+0000 7feab180e700 1 -- 172.21.15.63:0/2100869172 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaac0569e0 con 0x7feaac069eb0 2020-05-18T21:37:46.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.409+0000 7feaaaffd700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac069eb0 0x7feaac0ac540 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7fea94000bc0 tx=0x7fea94010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.409+0000 7feaa3fff700 1 -- 172.21.15.63:0/2100869172 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fea94006540 con 0x7feaac069eb0 2020-05-18T21:37:46.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.409+0000 7feaa3fff700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fea8404fc70 0x7fea84052130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:46.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.409+0000 7feaa3fff700 1 -- 172.21.15.63:0/2100869172 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fea940090c0 con 0x7feaac069eb0 2020-05-18T21:37:46.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.409+0000 7feaaa7fc700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fea8404fc70 0x7fea84052130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:46.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.413+0000 7feaaa7fc700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fea8404fc70 0x7fea84052130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fea9c008ca0 tx=0x7fea9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.413+0000 7feaaa7fc700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fea8404fc70 0x7fea84052130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fea9c008ca0 tx=0x7fea9c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.413+0000 7feaaa7fc700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fea8404fc70 0x7fea84052130 secure :-1 s=READY pgs=807 cs=0 l=1 rx=0x7fea9c008ca0 tx=0x7fea9c007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:46.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.421+0000 7feaaaffd700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac069eb0 0x7feaac0ac540 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7fea94000bc0 tx=0x7fea94010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.421+0000 7feaa3fff700 1 -- 172.21.15.63:0/2100869172 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fea9403e060 con 0x7feaac069eb0 2020-05-18T21:37:46.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.569+0000 7feab180e700 1 -- 172.21.15.63:0/2100869172 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feaac14a7c0 con 0x7feaac069eb0 2020-05-18T21:37:46.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.569+0000 7feaaaffd700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac069eb0 0x7feaac0ac540 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7fea94000bc0 tx=0x7fea94010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.569+0000 7feaa3fff700 1 -- 172.21.15.63:0/2100869172 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 134 v134) v1 ==== 95+0+2152 (secure 0 0 0) 0x7fea94041680 con 0x7feaac069eb0 2020-05-18T21:37:46.576 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:46.576 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":134,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7157,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4038166667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4038166667},{"type":"v1","addr":"172.21.15.155:6835","nonce":4038166667}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":132}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:45.262609+0000","modified":"2020-05-18T21:37:46.266342+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10281":{"gid":10281,"name":"a","rank":0,"incarnation":133,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/2149589625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2149589625},{"type":"v1","addr":"172.21.15.63:6833","nonce":2149589625}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2020-05-18T21:37:46.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.573+0000 7feab180e700 1 -- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fea8404fc70 msgr2=0x7fea84052130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:46.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.573+0000 7feab180e700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fea8404fc70 0x7fea84052130 secure :-1 s=READY pgs=807 cs=0 l=1 rx=0x7fea9c008ca0 tx=0x7fea9c007e00).stop 2020-05-18T21:37:46.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.573+0000 7feab180e700 1 -- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac069eb0 msgr2=0x7feaac0ac540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:46.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.573+0000 7feab180e700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac069eb0 0x7feaac0ac540 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7fea94000bc0 tx=0x7fea94010940).stop 2020-05-18T21:37:46.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.573+0000 7feab180e700 1 -- 172.21.15.63:0/2100869172 shutdown_connections 2020-05-18T21:37:46.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.573+0000 7feab180e700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fea8404fc70 0x7fea84052130 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:46.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.573+0000 7feab180e700 1 --2- 172.21.15.63:0/2100869172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feaac069eb0 0x7feaac0ac540 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:46.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.573+0000 7feab180e700 1 -- 172.21.15.63:0/2100869172 >> 172.21.15.63:0/2100869172 conn(0x7feaac066ed0 msgr2=0x7feaac14dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:46.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.573+0000 7feab180e700 1 -- 172.21.15.63:0/2100869172 shutdown_connections 2020-05-18T21:37:46.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.573+0000 7feab180e700 1 -- 172.21.15.63:0/2100869172 wait complete. 2020-05-18T21:37:46.581 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 134 2020-05-18T21:37:46.594 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:37:46.694 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.689+0000 7fcc67fff700 1 Processor -- start 2020-05-18T21:37:46.695 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.689+0000 7fcc67fff700 1 -- start start 2020-05-18T21:37:46.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.689+0000 7fcc67fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcc68069eb0 0x7fcc68062f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:46.696 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.689+0000 7fcc67fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc681453d0 0x7fcc68145860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:46.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.689+0000 7fcc67fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc68149690 con 0x7fcc680b6500 2020-05-18T21:37:46.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.689+0000 7fcc67fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc6814a4e0 con 0x7fcc68069eb0 2020-05-18T21:37:46.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.689+0000 7fcc67fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc68149930 con 0x7fcc681453d0 2020-05-18T21:37:46.697 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.689+0000 7fcc667fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcc680b6500 0x7fcc68149dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38408/0 (socket says 172.21.15.63:38408) 2020-05-18T21:37:46.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.689+0000 7fcc667fc700 1 -- 172.21.15.63:0/3455947739 learned_addr learned my addr 172.21.15.63:0/3455947739 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:46.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.689+0000 7fcc677fe700 1 --2- 172.21.15.63:0/3455947739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc681453d0 0x7fcc68145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:46.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.689+0000 7fcc66ffd700 1 --2- 172.21.15.63:0/3455947739 >> v2:172.21.15.155:3300/0 conn(0x7fcc68069eb0 0x7fcc68062f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:46.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.689+0000 7fcc65ffb700 1 -- 172.21.15.63:0/3455947739 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854504619 0 0) 0x7fcc68149690 con 0x7fcc680b6500 2020-05-18T21:37:46.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc65ffb700 1 -- 172.21.15.63:0/3455947739 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc48003270 con 0x7fcc680b6500 2020-05-18T21:37:46.700 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc677fe700 1 -- 172.21.15.63:0/3455947739 >> v2:172.21.15.155:3300/0 conn(0x7fcc68069eb0 msgr2=0x7fcc68062f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:46.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc677fe700 1 --2- 172.21.15.63:0/3455947739 >> v2:172.21.15.155:3300/0 conn(0x7fcc68069eb0 0x7fcc68062f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:46.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc677fe700 1 -- 172.21.15.63:0/3455947739 >> v1:172.21.15.63:6789/0 conn(0x7fcc680b6500 legacy=0x7fcc68149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:46.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc677fe700 1 -- 172.21.15.63:0/3455947739 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc68064450 con 0x7fcc681453d0 2020-05-18T21:37:46.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc677fe700 1 --2- 172.21.15.63:0/3455947739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc681453d0 0x7fcc68145860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcc600032f0 tx=0x7fcc60007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc677fe700 1 --2- 172.21.15.63:0/3455947739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc681453d0 0x7fcc68145860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcc600032f0 tx=0x7fcc60007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc677fe700 1 --2- 172.21.15.63:0/3455947739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc681453d0 0x7fcc68145860 secure :-1 s=READY pgs=318 cs=0 l=1 rx=0x7fcc600032f0 tx=0x7fcc60007e00).ready entity=mon.2 client_cookie=6cd4c48256114d1a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:46.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc677fe700 1 --2- 172.21.15.63:0/3455947739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc681453d0 0x7fcc68145860 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7fcc600032f0 tx=0x7fcc60007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc65ffb700 1 -- 172.21.15.63:0/3455947739 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc60011db0 con 0x7fcc681453d0 2020-05-18T21:37:46.702 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc677fe700 1 --2- 172.21.15.63:0/3455947739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc681453d0 0x7fcc68145860 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7fcc600032f0 tx=0x7fcc60007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc677fe700 1 --2- 172.21.15.63:0/3455947739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc681453d0 0x7fcc68145860 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7fcc600032f0 tx=0x7fcc60007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc65ffb700 1 -- 172.21.15.63:0/3455947739 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6000a180 con 0x7fcc681453d0 2020-05-18T21:37:46.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc65ffb700 1 -- 172.21.15.63:0/3455947739 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc6000a5a0 con 0x7fcc681453d0 2020-05-18T21:37:46.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc67fff700 1 -- 172.21.15.63:0/3455947739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc681453d0 msgr2=0x7fcc68145860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:46.703 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc67fff700 1 --2- 172.21.15.63:0/3455947739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc681453d0 0x7fcc68145860 secure :-1 s=READY pgs=318 cs=0 l=1 rx=0x7fcc600032f0 tx=0x7fcc60007e00).stop 2020-05-18T21:37:46.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc67fff700 1 -- 172.21.15.63:0/3455947739 shutdown_connections 2020-05-18T21:37:46.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc67fff700 1 --2- 172.21.15.63:0/3455947739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc681453d0 0x7fcc68145860 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:46.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc67fff700 1 --2- 172.21.15.63:0/3455947739 >> v2:172.21.15.155:3300/0 conn(0x7fcc68069eb0 0x7fcc68062f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:46.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc67fff700 1 -- 172.21.15.63:0/3455947739 >> 172.21.15.63:0/3455947739 conn(0x7fcc68066d00 msgr2=0x7fcc6805a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:46.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc67fff700 1 -- 172.21.15.63:0/3455947739 shutdown_connections 2020-05-18T21:37:46.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc67fff700 1 -- 172.21.15.63:0/3455947739 wait complete. 2020-05-18T21:37:46.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc67fff700 1 Processor -- start 2020-05-18T21:37:46.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.693+0000 7fcc67fff700 1 -- start start 2020-05-18T21:37:46.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc67fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc680b6500 0x7fcc68142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:46.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc67fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcc681453d0 0x7fcc681445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:46.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc67fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc68141010 con 0x7fcc68069eb0 2020-05-18T21:37:46.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc67fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc68157580 con 0x7fcc681453d0 2020-05-18T21:37:46.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc67fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc68141dd0 con 0x7fcc680b6500 2020-05-18T21:37:46.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc66ffd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fcc68069eb0 0x7fcc6813f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:36726/0 (socket says 172.21.15.63:36726) 2020-05-18T21:37:46.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc66ffd700 1 -- 172.21.15.63:0/1179989945 learned_addr learned my addr 172.21.15.63:0/1179989945 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:46.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc667fc700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc680b6500 0x7fcc68142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:46.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc677fe700 1 --2- 172.21.15.63:0/1179989945 >> v2:172.21.15.155:3300/0 conn(0x7fcc681453d0 0x7fcc681445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:46.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc5ffff700 1 -- 172.21.15.63:0/1179989945 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249858682 0 0) 0x7fcc68141010 con 0x7fcc68069eb0 2020-05-18T21:37:46.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc5ffff700 1 -- 172.21.15.63:0/1179989945 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc4c002fe0 con 0x7fcc68069eb0 2020-05-18T21:37:46.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc677fe700 1 -- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc680b6500 msgr2=0x7fcc68142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:46.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc677fe700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc680b6500 0x7fcc68142f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:46.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc677fe700 1 -- 172.21.15.63:0/1179989945 >> v1:172.21.15.155:6789/0 conn(0x7fcc68069eb0 legacy=0x7fcc6813f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:46.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc677fe700 1 -- 172.21.15.63:0/1179989945 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc681572e0 con 0x7fcc681453d0 2020-05-18T21:37:46.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc667fc700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc680b6500 0x7fcc68142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:46.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc677fe700 1 --2- 172.21.15.63:0/1179989945 >> v2:172.21.15.155:3300/0 conn(0x7fcc681453d0 0x7fcc681445d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcc600032f0 tx=0x7fcc60007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc677fe700 1 --2- 172.21.15.63:0/1179989945 >> v2:172.21.15.155:3300/0 conn(0x7fcc681453d0 0x7fcc681445d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcc600032f0 tx=0x7fcc60007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc677fe700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc681453d0 0x7fcc681445d0 secure :-1 s=READY pgs=1373 cs=0 l=1 rx=0x7fcc600032f0 tx=0x7fcc60007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:46.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc677fe700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc681453d0 0x7fcc681445d0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7fcc600032f0 tx=0x7fcc60007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc5ffff700 1 -- 172.21.15.63:0/1179989945 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc60010480 con 0x7fcc681453d0 2020-05-18T21:37:46.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc677fe700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc681453d0 0x7fcc681445d0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7fcc600032f0 tx=0x7fcc60007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc677fe700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc681453d0 0x7fcc681445d0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7fcc600032f0 tx=0x7fcc60007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc5ffff700 1 -- 172.21.15.63:0/1179989945 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc60005c70 con 0x7fcc681453d0 2020-05-18T21:37:46.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc5ffff700 1 -- 172.21.15.63:0/1179989945 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc60005e20 con 0x7fcc681453d0 2020-05-18T21:37:46.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc67fff700 1 -- 172.21.15.63:0/1179989945 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6813f780 con 0x7fcc681453d0 2020-05-18T21:37:46.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.697+0000 7fcc67fff700 1 -- 172.21.15.63:0/1179989945 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc681423d0 con 0x7fcc681453d0 2020-05-18T21:37:46.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.701+0000 7fcc67fff700 1 -- 172.21.15.63:0/1179989945 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc68141c10 con 0x7fcc681453d0 2020-05-18T21:37:46.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.701+0000 7fcc677fe700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc681453d0 0x7fcc681445d0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7fcc600032f0 tx=0x7fcc60007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.714 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.701+0000 7fcc5ffff700 1 -- 172.21.15.63:0/1179989945 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fcc60007360 con 0x7fcc681453d0 2020-05-18T21:37:46.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.701+0000 7fcc677fe700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc681453d0 0x7fcc681445d0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7fcc600032f0 tx=0x7fcc60007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.701+0000 7fcc5ffff700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc4c04fd70 0x7fcc4c052230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:46.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.701+0000 7fcc5ffff700 1 -- 172.21.15.63:0/1179989945 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcc60064a20 con 0x7fcc681453d0 2020-05-18T21:37:46.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.701+0000 7fcc66ffd700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc4c04fd70 0x7fcc4c052230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:46.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.701+0000 7fcc66ffd700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc4c04fd70 0x7fcc4c052230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcc50002f70 tx=0x7fcc500090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.701+0000 7fcc66ffd700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc4c04fd70 0x7fcc4c052230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcc50002f70 tx=0x7fcc500090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.701+0000 7fcc66ffd700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc4c04fd70 0x7fcc4c052230 secure :-1 s=READY pgs=808 cs=0 l=1 rx=0x7fcc50002f70 tx=0x7fcc500090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:46.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.709+0000 7fcc677fe700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc681453d0 0x7fcc681445d0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7fcc600032f0 tx=0x7fcc60007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.709+0000 7fcc5ffff700 1 -- 172.21.15.63:0/1179989945 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fcc6003eed0 con 0x7fcc681453d0 2020-05-18T21:37:46.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.825+0000 7fcc67fff700 1 -- 172.21.15.63:0/1179989945 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc680569e0 con 0x7fcc681453d0 2020-05-18T21:37:46.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.829+0000 7fcc677fe700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc681453d0 0x7fcc681445d0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7fcc600032f0 tx=0x7fcc60007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.829+0000 7fcc5ffff700 1 -- 172.21.15.63:0/1179989945 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+16116 (secure 0 0 0) 0x7fcc600424f0 con 0x7fcc681453d0 2020-05-18T21:37:46.834 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:46.834 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":156,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:37:46.265219+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:37:43.788191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2020-05-18T21:37:44.262734+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:37:46.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.829+0000 7fcc67fff700 1 -- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc4c04fd70 msgr2=0x7fcc4c052230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:46.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.829+0000 7fcc67fff700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc4c04fd70 0x7fcc4c052230 secure :-1 s=READY pgs=808 cs=0 l=1 rx=0x7fcc50002f70 tx=0x7fcc500090f0).stop 2020-05-18T21:37:46.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.829+0000 7fcc67fff700 1 -- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc681453d0 msgr2=0x7fcc681445d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:46.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.829+0000 7fcc67fff700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc681453d0 0x7fcc681445d0 secure :-1 s=READY pgs=1373 cs=0 l=1 rx=0x7fcc600032f0 tx=0x7fcc60007e00).stop 2020-05-18T21:37:46.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.829+0000 7fcc67fff700 1 -- 172.21.15.63:0/1179989945 shutdown_connections 2020-05-18T21:37:46.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.829+0000 7fcc67fff700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fcc4c04fd70 0x7fcc4c052230 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:46.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.829+0000 7fcc67fff700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc681453d0 0x7fcc681445d0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:46.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.829+0000 7fcc67fff700 1 --2- 172.21.15.63:0/1179989945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc680b6500 0x7fcc68142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:46.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.829+0000 7fcc67fff700 1 -- 172.21.15.63:0/1179989945 >> 172.21.15.63:0/1179989945 conn(0x7fcc68066d00 msgr2=0x7fcc6805a770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:46.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.829+0000 7fcc67fff700 1 -- 172.21.15.63:0/1179989945 shutdown_connections 2020-05-18T21:37:46.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.829+0000 7fcc67fff700 1 -- 172.21.15.63:0/1179989945 wait complete. 2020-05-18T21:37:46.847 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:37:46.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538c0d4700 1 Processor -- start 2020-05-18T21:37:46.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538c0d4700 1 -- start start 2020-05-18T21:37:46.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538c0d4700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b8c30 0x7f53841566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:46.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538c0d4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f53840ad070 0x7f5384156b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:46.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538c0d4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5384065a70 con 0x7f5384156fb0 2020-05-18T21:37:46.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538c0d4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53840801d0 con 0x7f53840ad070 2020-05-18T21:37:46.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538c0d4700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53840b5ae0 con 0x7f53840b8c30 2020-05-18T21:37:46.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f5389e70700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f53840ad070 0x7f5384156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:46.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538ae72700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f5384156fb0 0x7f538415b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:36738/0 (socket says 172.21.15.63:36738) 2020-05-18T21:37:46.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538ae72700 1 -- 172.21.15.63:0/821241275 learned_addr learned my addr 172.21.15.63:0/821241275 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:46.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f5389e70700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f53840ad070 0x7f5384156b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:51080/0 (socket says 172.21.15.63:51080) 2020-05-18T21:37:46.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538a671700 1 --2- 172.21.15.63:0/821241275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b8c30 0x7f53841566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:46.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538966f700 1 -- 172.21.15.63:0/821241275 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031310437 0 0) 0x7f5384065a70 con 0x7f5384156fb0 2020-05-18T21:37:46.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538966f700 1 -- 172.21.15.63:0/821241275 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5370003270 con 0x7f5384156fb0 2020-05-18T21:37:46.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538a671700 1 -- 172.21.15.63:0/821241275 >> v2:172.21.15.155:3300/0 conn(0x7f53840ad070 msgr2=0x7f5384156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:46.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538a671700 1 --2- 172.21.15.63:0/821241275 >> v2:172.21.15.155:3300/0 conn(0x7f53840ad070 0x7f5384156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:46.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538a671700 1 -- 172.21.15.63:0/821241275 >> v1:172.21.15.155:6789/0 conn(0x7f5384156fb0 legacy=0x7f538415b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:46.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538a671700 1 -- 172.21.15.63:0/821241275 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53840b9010 con 0x7f53840b8c30 2020-05-18T21:37:46.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f5389e70700 1 --2- 172.21.15.63:0/821241275 >> v2:172.21.15.155:3300/0 conn(0x7f53840ad070 0x7f5384156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:46.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538a671700 1 --2- 172.21.15.63:0/821241275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b8c30 0x7f53841566f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5380002f70 tx=0x7f5380007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538a671700 1 --2- 172.21.15.63:0/821241275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b8c30 0x7f53841566f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5380002f70 tx=0x7f5380007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538a671700 1 --2- 172.21.15.63:0/821241275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b8c30 0x7f53841566f0 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f5380002f70 tx=0x7f5380007a80).ready entity=mon.2 client_cookie=b7f23b66a06daaa6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:46.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538a671700 1 --2- 172.21.15.63:0/821241275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b8c30 0x7f53841566f0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f5380002f70 tx=0x7f5380007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538a671700 1 --2- 172.21.15.63:0/821241275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b8c30 0x7f53841566f0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f5380002f70 tx=0x7f5380007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538966f700 1 -- 172.21.15.63:0/821241275 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5380008e80 con 0x7f53840b8c30 2020-05-18T21:37:46.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.953+0000 7f538a671700 1 --2- 172.21.15.63:0/821241275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b8c30 0x7f53841566f0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f5380002f70 tx=0x7f5380007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.957+0000 7f538966f700 1 -- 172.21.15.63:0/821241275 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5380011540 con 0x7f53840b8c30 2020-05-18T21:37:46.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.957+0000 7f538966f700 1 -- 172.21.15.63:0/821241275 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5380011960 con 0x7f53840b8c30 2020-05-18T21:37:46.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.957+0000 7f538c0d4700 1 -- 172.21.15.63:0/821241275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b8c30 msgr2=0x7f53841566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:46.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.957+0000 7f538c0d4700 1 --2- 172.21.15.63:0/821241275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b8c30 0x7f53841566f0 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f5380002f70 tx=0x7f5380007a80).stop 2020-05-18T21:37:46.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.957+0000 7f538c0d4700 1 -- 172.21.15.63:0/821241275 shutdown_connections 2020-05-18T21:37:46.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.957+0000 7f538c0d4700 1 --2- 172.21.15.63:0/821241275 >> v2:172.21.15.155:3300/0 conn(0x7f53840ad070 0x7f5384156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:46.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.957+0000 7f538c0d4700 1 --2- 172.21.15.63:0/821241275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53840b8c30 0x7f53841566f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:46.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.957+0000 7f538c0d4700 1 -- 172.21.15.63:0/821241275 >> 172.21.15.63:0/821241275 conn(0x7f538406a640 msgr2=0x7f53840b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:46.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.957+0000 7f538c0d4700 1 -- 172.21.15.63:0/821241275 shutdown_connections 2020-05-18T21:37:46.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.957+0000 7f538c0d4700 1 -- 172.21.15.63:0/821241275 wait complete. 2020-05-18T21:37:46.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.957+0000 7f538c0d4700 1 Processor -- start 2020-05-18T21:37:46.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.957+0000 7f538c0d4700 1 -- start start 2020-05-18T21:37:46.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.957+0000 7f538c0d4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f53840b8c30 0x7f5384064bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:46.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.957+0000 7f538c0d4700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5384124930 con 0x7f53840ad070 2020-05-18T21:37:46.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.957+0000 7f538c0d4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5384124bd0 con 0x7f5384156fb0 2020-05-18T21:37:46.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.957+0000 7f538c0d4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53840b5630 con 0x7f53840b8c30 2020-05-18T21:37:46.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f538a671700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f53840ad070 0x7f5384124170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38424/0 (socket says 172.21.15.63:38424) 2020-05-18T21:37:46.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f538a671700 1 -- 172.21.15.63:0/1572593342 learned_addr learned my addr 172.21.15.63:0/1572593342 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:46.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f5389e70700 1 --2- 172.21.15.63:0/1572593342 >> v2:172.21.15.63:3300/0 conn(0x7f53840b8c30 0x7f5384064bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:46.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f537affd700 1 -- 172.21.15.63:0/1572593342 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395688011 0 0) 0x7f5384124930 con 0x7f53840ad070 2020-05-18T21:37:46.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f537affd700 1 -- 172.21.15.63:0/1572593342 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f536c003270 con 0x7f53840ad070 2020-05-18T21:37:46.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f537affd700 1 -- 172.21.15.63:0/1572593342 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938506520 0 0) 0x7f5384124bd0 con 0x7f5384156fb0 2020-05-18T21:37:46.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f537affd700 1 -- 172.21.15.63:0/1572593342 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5384124930 con 0x7f5384156fb0 2020-05-18T21:37:46.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f5389e70700 1 -- 172.21.15.63:0/1572593342 >> v1:172.21.15.155:6789/0 conn(0x7f5384156fb0 legacy=0x7f53840b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:46.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f5389e70700 1 -- 172.21.15.63:0/1572593342 >> v1:172.21.15.63:6789/0 conn(0x7f53840ad070 legacy=0x7f5384124170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:46.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f5389e70700 1 -- 172.21.15.63:0/1572593342 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53840b3d60 con 0x7f53840b8c30 2020-05-18T21:37:46.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f5389e70700 1 --2- 172.21.15.63:0/1572593342 >> v2:172.21.15.63:3300/0 conn(0x7f53840b8c30 0x7f5384064bf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5374002f70 tx=0x7f5374010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f5389e70700 1 --2- 172.21.15.63:0/1572593342 >> v2:172.21.15.63:3300/0 conn(0x7f53840b8c30 0x7f5384064bf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5374002f70 tx=0x7f5374010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f5389e70700 1 --2- 172.21.15.63:0/1572593342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b8c30 0x7f5384064bf0 secure :-1 s=READY pgs=2065 cs=0 l=1 rx=0x7f5374002f70 tx=0x7f5374010dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:46.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f5389e70700 1 --2- 172.21.15.63:0/1572593342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b8c30 0x7f5384064bf0 secure :-1 s=THROTTLE_DONE pgs=2065 cs=0 l=1 rx=0x7f5374002f70 tx=0x7f5374010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f537affd700 1 -- 172.21.15.63:0/1572593342 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f537400c9d0 con 0x7f53840b8c30 2020-05-18T21:37:46.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f5389e70700 1 --2- 172.21.15.63:0/1572593342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b8c30 0x7f5384064bf0 secure :-1 s=THROTTLE_DONE pgs=2065 cs=0 l=1 rx=0x7f5374002f70 tx=0x7f5374010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f537affd700 1 -- 172.21.15.63:0/1572593342 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537400cb30 con 0x7f53840b8c30 2020-05-18T21:37:46.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f538c0d4700 1 -- 172.21.15.63:0/1572593342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5384063750 con 0x7f53840b8c30 2020-05-18T21:37:46.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f5389e70700 1 --2- 172.21.15.63:0/1572593342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b8c30 0x7f5384064bf0 secure :-1 s=THROTTLE_DONE pgs=2065 cs=0 l=1 rx=0x7f5374002f70 tx=0x7f5374010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f537affd700 1 -- 172.21.15.63:0/1572593342 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5374005700 con 0x7f53840b8c30 2020-05-18T21:37:46.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f538c0d4700 1 -- 172.21.15.63:0/1572593342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5384065450 con 0x7f53840b8c30 2020-05-18T21:37:46.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f5389e70700 1 --2- 172.21.15.63:0/1572593342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b8c30 0x7f5384064bf0 secure :-1 s=THROTTLE_DONE pgs=2065 cs=0 l=1 rx=0x7f5374002f70 tx=0x7f5374010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f537affd700 1 -- 172.21.15.63:0/1572593342 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f53740071a0 con 0x7f53840b8c30 2020-05-18T21:37:46.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f5389e70700 1 --2- 172.21.15.63:0/1572593342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b8c30 0x7f5384064bf0 secure :-1 s=THROTTLE_DONE pgs=2065 cs=0 l=1 rx=0x7f5374002f70 tx=0x7f5374010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.961+0000 7f538c0d4700 1 -- 172.21.15.63:0/1572593342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5384063940 con 0x7f53840b8c30 2020-05-18T21:37:46.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.965+0000 7f537affd700 1 --2- 172.21.15.63:0/1572593342 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f536c04feb0 0x7f536c052370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:46.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.965+0000 7f537affd700 1 -- 172.21.15.63:0/1572593342 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5374063d10 con 0x7f53840b8c30 2020-05-18T21:37:46.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.965+0000 7f538a671700 1 --2- 172.21.15.63:0/1572593342 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f536c04feb0 0x7f536c052370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:46.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.965+0000 7f538a671700 1 --2- 172.21.15.63:0/1572593342 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f536c04feb0 0x7f536c052370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5380008920 tx=0x7f5380007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.965+0000 7f538a671700 1 --2- 172.21.15.63:0/1572593342 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f536c04feb0 0x7f536c052370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5380008920 tx=0x7f5380007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.965+0000 7f538a671700 1 --2- 172.21.15.63:0/1572593342 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f536c04feb0 0x7f536c052370 secure :-1 s=READY pgs=809 cs=0 l=1 rx=0x7f5380008920 tx=0x7f5380007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:46.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.969+0000 7f5389e70700 1 --2- 172.21.15.63:0/1572593342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b8c30 0x7f5384064bf0 secure :-1 s=THROTTLE_DONE pgs=2065 cs=0 l=1 rx=0x7f5374002f70 tx=0x7f5374010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:46.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:46.969+0000 7f537affd700 1 -- 172.21.15.63:0/1572593342 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f537403e100 con 0x7f53840b8c30 2020-05-18T21:37:47.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.125+0000 7f538c0d4700 1 -- 172.21.15.63:0/1572593342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f53840569e0 con 0x7f53840b8c30 2020-05-18T21:37:47.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.133+0000 7f5389e70700 1 --2- 172.21.15.63:0/1572593342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b8c30 0x7f5384064bf0 secure :-1 s=THROTTLE_DONE pgs=2065 cs=0 l=1 rx=0x7f5374002f70 tx=0x7f5374010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.133+0000 7f537affd700 1 -- 172.21.15.63:0/1572593342 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v59) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5374041720 con 0x7f53840b8c30 2020-05-18T21:37:47.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.133+0000 7f538c0d4700 1 -- 172.21.15.63:0/1572593342 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f536c04feb0 msgr2=0x7f536c052370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:47.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.133+0000 7f538c0d4700 1 --2- 172.21.15.63:0/1572593342 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f536c04feb0 0x7f536c052370 secure :-1 s=READY pgs=809 cs=0 l=1 rx=0x7f5380008920 tx=0x7f5380007a80).stop 2020-05-18T21:37:47.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.133+0000 7f538c0d4700 1 -- 172.21.15.63:0/1572593342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b8c30 msgr2=0x7f5384064bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:47.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.133+0000 7f538c0d4700 1 --2- 172.21.15.63:0/1572593342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b8c30 0x7f5384064bf0 secure :-1 s=READY pgs=2065 cs=0 l=1 rx=0x7f5374002f70 tx=0x7f5374010dc0).stop 2020-05-18T21:37:47.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.133+0000 7f538c0d4700 1 -- 172.21.15.63:0/1572593342 shutdown_connections 2020-05-18T21:37:47.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.133+0000 7f538c0d4700 1 --2- 172.21.15.63:0/1572593342 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f536c04feb0 0x7f536c052370 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:47.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.133+0000 7f538c0d4700 1 --2- 172.21.15.63:0/1572593342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53840b8c30 0x7f5384064bf0 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:47.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.133+0000 7f538c0d4700 1 -- 172.21.15.63:0/1572593342 >> 172.21.15.63:0/1572593342 conn(0x7f538406a640 msgr2=0x7f53841358a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:47.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.133+0000 7f538c0d4700 1 -- 172.21.15.63:0/1572593342 shutdown_connections 2020-05-18T21:37:47.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.133+0000 7f538c0d4700 1 -- 172.21.15.63:0/1572593342 wait complete. 2020-05-18T21:37:47.143 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.0 2020-05-18T21:37:47.154 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:37:47.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.265+0000 7ff214f19700 1 Processor -- start 2020-05-18T21:37:47.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.265+0000 7ff214f19700 1 -- start start 2020-05-18T21:37:47.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff214f19700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2100b5cb0 0x7ff2100b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:47.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff214f19700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff210151bc0 0x7ff210152050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:47.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff214f19700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff210025500 con 0x7ff2100b6410 2020-05-18T21:37:47.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff214f19700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff210064ee0 con 0x7ff210151bc0 2020-05-18T21:37:47.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff214f19700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2100b67f0 con 0x7ff2100b5cb0 2020-05-18T21:37:47.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff2100b6410 0x7ff210061af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38432/0 (socket says 172.21.15.63:38432) 2020-05-18T21:37:47.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20ffff700 1 -- 172.21.15.63:0/1406489147 learned_addr learned my addr 172.21.15.63:0/1406489147 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:47.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff21617b700 1 --2- 172.21.15.63:0/1406489147 >> v2:172.21.15.63:3300/0 conn(0x7ff210151bc0 0x7ff210152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:47.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20f7fe700 1 --2- 172.21.15.63:0/1406489147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2100b5cb0 0x7ff2100b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:47.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20effd700 1 -- 172.21.15.63:0/1406489147 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969659339 0 0) 0x7ff210025500 con 0x7ff2100b6410 2020-05-18T21:37:47.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20effd700 1 -- 172.21.15.63:0/1406489147 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1f8003270 con 0x7ff2100b6410 2020-05-18T21:37:47.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20effd700 1 -- 172.21.15.63:0/1406489147 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 80066479 0 0) 0x7ff1f8003270 con 0x7ff2100b6410 2020-05-18T21:37:47.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20effd700 1 -- 172.21.15.63:0/1406489147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2100b5cb0 msgr2=0x7ff2100b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:47.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20effd700 1 --2- 172.21.15.63:0/1406489147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2100b5cb0 0x7ff2100b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:47.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20effd700 1 -- 172.21.15.63:0/1406489147 >> v2:172.21.15.63:3300/0 conn(0x7ff210151bc0 msgr2=0x7ff210152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:47.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20effd700 1 --2- 172.21.15.63:0/1406489147 >> v2:172.21.15.63:3300/0 conn(0x7ff210151bc0 0x7ff210152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:47.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20effd700 1 -- 172.21.15.63:0/1406489147 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff210025180 con 0x7ff2100b6410 2020-05-18T21:37:47.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20effd700 1 -- 172.21.15.63:0/1406489147 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7ff200001a90 con 0x7ff2100b6410 2020-05-18T21:37:47.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20effd700 1 -- 172.21.15.63:0/1406489147 >> v1:172.21.15.63:6789/0 conn(0x7ff2100b6410 legacy=0x7ff210061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:47.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20effd700 1 --2- 172.21.15.63:0/1406489147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1f8003760 0x7ff1f8003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:47.285 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20effd700 1 --2- 172.21.15.63:0/1406489147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1f80040a0 0x7ff1f8004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:47.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20effd700 1 --2- 172.21.15.63:0/1406489147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2100b5cb0 0x7ff1f8004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:47.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20effd700 1 -- 172.21.15.63:0/1406489147 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff210064ee0 con 0x7ff1f80040a0 2020-05-18T21:37:47.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20effd700 1 -- 172.21.15.63:0/1406489147 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2100b67f0 con 0x7ff1f8003760 2020-05-18T21:37:47.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20effd700 1 -- 172.21.15.63:0/1406489147 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f8005030 con 0x7ff2100b5cb0 2020-05-18T21:37:47.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff21617b700 1 --2- 172.21.15.63:0/1406489147 >> v2:172.21.15.63:3300/0 conn(0x7ff210151bc0 0x7ff210152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:47.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20f7fe700 1 --2- 172.21.15.63:0/1406489147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1f80040a0 0x7ff1f8004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:47.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20ffff700 1 --2- 172.21.15.63:0/1406489147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1f8003760 0x7ff1f8003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:47.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff21617b700 1 --2- 172.21.15.63:0/1406489147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2100b5cb0 0x7ff1f8004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:47.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20f7fe700 1 -- 172.21.15.63:0/1406489147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2100b5cb0 msgr2=0x7ff1f8004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:47.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20f7fe700 1 --2- 172.21.15.63:0/1406489147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2100b5cb0 0x7ff1f8004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:47.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20f7fe700 1 -- 172.21.15.63:0/1406489147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1f8003760 msgr2=0x7ff1f8003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:47.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20f7fe700 1 --2- 172.21.15.63:0/1406489147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1f8003760 0x7ff1f8003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:47.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20f7fe700 1 -- 172.21.15.63:0/1406489147 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f8003270 con 0x7ff1f80040a0 2020-05-18T21:37:47.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20ffff700 1 --2- 172.21.15.63:0/1406489147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1f8003760 0x7ff1f8003b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:37:47.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20f7fe700 1 --2- 172.21.15.63:0/1406489147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1f80040a0 0x7ff1f8004570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff204008950 tx=0x7ff204010140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20f7fe700 1 --2- 172.21.15.63:0/1406489147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1f80040a0 0x7ff1f8004570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff204008950 tx=0x7ff204010140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20f7fe700 1 --2- 172.21.15.63:0/1406489147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1f80040a0 0x7ff1f8004570 secure :-1 s=READY pgs=2067 cs=0 l=1 rx=0x7ff204008950 tx=0x7ff204010140).ready entity=mon.0 client_cookie=65c494088294d497 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:47.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20f7fe700 1 --2- 172.21.15.63:0/1406489147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1f80040a0 0x7ff1f8004570 secure :-1 s=THROTTLE_DONE pgs=2067 cs=0 l=1 rx=0x7ff204008950 tx=0x7ff204010140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20f7fe700 1 --2- 172.21.15.63:0/1406489147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1f80040a0 0x7ff1f8004570 secure :-1 s=THROTTLE_DONE pgs=2067 cs=0 l=1 rx=0x7ff204008950 tx=0x7ff204010140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20effd700 1 -- 172.21.15.63:0/1406489147 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff204010e40 con 0x7ff1f80040a0 2020-05-18T21:37:47.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20f7fe700 1 --2- 172.21.15.63:0/1406489147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1f80040a0 0x7ff1f8004570 secure :-1 s=THROTTLE_DONE pgs=2067 cs=0 l=1 rx=0x7ff204008950 tx=0x7ff204010140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20effd700 1 -- 172.21.15.63:0/1406489147 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff204008990 con 0x7ff1f80040a0 2020-05-18T21:37:47.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff20effd700 1 -- 172.21.15.63:0/1406489147 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff204008cf0 con 0x7ff1f80040a0 2020-05-18T21:37:47.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff214f19700 1 -- 172.21.15.63:0/1406489147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1f80040a0 msgr2=0x7ff1f8004570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:47.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff214f19700 1 --2- 172.21.15.63:0/1406489147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1f80040a0 0x7ff1f8004570 secure :-1 s=READY pgs=2067 cs=0 l=1 rx=0x7ff204008950 tx=0x7ff204010140).stop 2020-05-18T21:37:47.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.269+0000 7ff21617b700 1 -- 172.21.15.63:0/1406489147 reap_dead start 2020-05-18T21:37:47.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.273+0000 7ff214f19700 1 -- 172.21.15.63:0/1406489147 shutdown_connections 2020-05-18T21:37:47.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.273+0000 7ff214f19700 1 -- 172.21.15.63:0/1406489147 >> 172.21.15.63:0/1406489147 conn(0x7ff210069b70 msgr2=0x7ff210069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:47.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.273+0000 7ff214f19700 1 -- 172.21.15.63:0/1406489147 shutdown_connections 2020-05-18T21:37:47.291 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.273+0000 7ff214f19700 1 -- 172.21.15.63:0/1406489147 wait complete. 2020-05-18T21:37:47.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.273+0000 7ff214f19700 1 Processor -- start 2020-05-18T21:37:47.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.273+0000 7ff214f19700 1 -- start start 2020-05-18T21:37:47.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.277+0000 7ff214f19700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff210129e50 0x7ff21012a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:47.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.277+0000 7ff214f19700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff210125f70 0x7ff210071a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:47.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.277+0000 7ff214f19700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2100b3c10 con 0x7ff210125b10 2020-05-18T21:37:47.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.277+0000 7ff214f19700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2100b1720 con 0x7ff210125f70 2020-05-18T21:37:47.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.277+0000 7ff214f19700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2100b19c0 con 0x7ff210129e50 2020-05-18T21:37:47.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.277+0000 7ff20f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff210125b10 0x7ff210071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38446/0 (socket says 172.21.15.63:38446) 2020-05-18T21:37:47.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.277+0000 7ff20f7fe700 1 -- 172.21.15.63:0/3230412285 learned_addr learned my addr 172.21.15.63:0/3230412285 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:47.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.277+0000 7ff21617b700 1 --2- 172.21.15.63:0/3230412285 >> v2:172.21.15.63:3300/0 conn(0x7ff210125f70 0x7ff210071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:47.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.277+0000 7ff20ffff700 1 --2- 172.21.15.63:0/3230412285 >> v2:172.21.15.155:3300/0 conn(0x7ff210129e50 0x7ff21012a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:47.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.277+0000 7ff21617b700 1 -- 172.21.15.63:0/3230412285 >> v2:172.21.15.155:3300/0 conn(0x7ff210129e50 msgr2=0x7ff21012a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:47.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.277+0000 7ff21617b700 1 --2- 172.21.15.63:0/3230412285 >> v2:172.21.15.155:3300/0 conn(0x7ff210129e50 0x7ff21012a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:47.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.281+0000 7ff21617b700 1 -- 172.21.15.63:0/3230412285 >> v1:172.21.15.63:6789/0 conn(0x7ff210125b10 legacy=0x7ff210071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:47.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.281+0000 7ff21617b700 1 -- 172.21.15.63:0/3230412285 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2100b1c60 con 0x7ff210125f70 2020-05-18T21:37:47.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.281+0000 7ff21617b700 1 --2- 172.21.15.63:0/3230412285 >> v2:172.21.15.63:3300/0 conn(0x7ff210125f70 0x7ff210071a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff200001cf0 tx=0x7ff208010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.281+0000 7ff21617b700 1 --2- 172.21.15.63:0/3230412285 >> v2:172.21.15.63:3300/0 conn(0x7ff210125f70 0x7ff210071a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff200001cf0 tx=0x7ff208010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.281+0000 7ff21617b700 1 --2- 172.21.15.63:0/3230412285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff210125f70 0x7ff210071a50 secure :-1 s=READY pgs=2069 cs=0 l=1 rx=0x7ff200001cf0 tx=0x7ff208010bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:47.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.281+0000 7ff21617b700 1 --2- 172.21.15.63:0/3230412285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff210125f70 0x7ff210071a50 secure :-1 s=THROTTLE_DONE pgs=2069 cs=0 l=1 rx=0x7ff200001cf0 tx=0x7ff208010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.281+0000 7ff21617b700 1 --2- 172.21.15.63:0/3230412285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff210125f70 0x7ff210071a50 secure :-1 s=THROTTLE_DONE pgs=2069 cs=0 l=1 rx=0x7ff200001cf0 tx=0x7ff208010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.281+0000 7ff20cff9700 1 -- 172.21.15.63:0/3230412285 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff208005ae0 con 0x7ff210125f70 2020-05-18T21:37:47.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.281+0000 7ff21617b700 1 --2- 172.21.15.63:0/3230412285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff210125f70 0x7ff210071a50 secure :-1 s=THROTTLE_DONE pgs=2069 cs=0 l=1 rx=0x7ff200001cf0 tx=0x7ff208010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.281+0000 7ff20cff9700 1 -- 172.21.15.63:0/3230412285 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2080120d0 con 0x7ff210125f70 2020-05-18T21:37:47.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.281+0000 7ff214f19700 1 -- 172.21.15.63:0/3230412285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff210126390 con 0x7ff210125f70 2020-05-18T21:37:47.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.281+0000 7ff20cff9700 1 -- 172.21.15.63:0/3230412285 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff208005e30 con 0x7ff210125f70 2020-05-18T21:37:47.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.281+0000 7ff214f19700 1 -- 172.21.15.63:0/3230412285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2100b2100 con 0x7ff210125f70 2020-05-18T21:37:47.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.281+0000 7ff21617b700 1 --2- 172.21.15.63:0/3230412285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff210125f70 0x7ff210071a50 secure :-1 s=THROTTLE_DONE pgs=2069 cs=0 l=1 rx=0x7ff200001cf0 tx=0x7ff208010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.285+0000 7ff20cff9700 1 -- 172.21.15.63:0/3230412285 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff208007160 con 0x7ff210125f70 2020-05-18T21:37:47.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.285+0000 7ff21617b700 1 --2- 172.21.15.63:0/3230412285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff210125f70 0x7ff210071a50 secure :-1 s=THROTTLE_DONE pgs=2069 cs=0 l=1 rx=0x7ff200001cf0 tx=0x7ff208010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.285+0000 7ff20cff9700 1 --2- 172.21.15.63:0/3230412285 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff1f004fa40 0x7ff1f0051f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:47.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.285+0000 7ff214f19700 1 -- 172.21.15.63:0/3230412285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2100b1e10 con 0x7ff210125f70 2020-05-18T21:37:47.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.285+0000 7ff20cff9700 1 -- 172.21.15.63:0/3230412285 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff2080639e0 con 0x7ff210125f70 2020-05-18T21:37:47.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.285+0000 7ff20ffff700 1 --2- 172.21.15.63:0/3230412285 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff1f004fa40 0x7ff1f0051f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:47.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.285+0000 7ff20ffff700 1 --2- 172.21.15.63:0/3230412285 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff1f004fa40 0x7ff1f0051f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff2000017a0 tx=0x7ff210025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.285+0000 7ff20ffff700 1 --2- 172.21.15.63:0/3230412285 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff1f004fa40 0x7ff1f0051f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff2000017a0 tx=0x7ff210025310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.285+0000 7ff20ffff700 1 --2- 172.21.15.63:0/3230412285 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff1f004fa40 0x7ff1f0051f00 secure :-1 s=READY pgs=810 cs=0 l=1 rx=0x7ff2000017a0 tx=0x7ff210025310).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:47.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.289+0000 7ff21617b700 1 --2- 172.21.15.63:0/3230412285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff210125f70 0x7ff210071a50 secure :-1 s=THROTTLE_DONE pgs=2069 cs=0 l=1 rx=0x7ff200001cf0 tx=0x7ff208010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.289+0000 7ff20cff9700 1 -- 172.21.15.63:0/3230412285 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff20803dd10 con 0x7ff210125f70 2020-05-18T21:37:47.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.445+0000 7ff214f19700 1 -- 172.21.15.63:0/3230412285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff2100569e0 con 0x7ff210125f70 2020-05-18T21:37:47.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.453+0000 7ff21617b700 1 --2- 172.21.15.63:0/3230412285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff210125f70 0x7ff210071a50 secure :-1 s=THROTTLE_DONE pgs=2069 cs=0 l=1 rx=0x7ff200001cf0 tx=0x7ff208010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.453+0000 7ff20cff9700 1 -- 172.21.15.63:0/3230412285 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v60) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff208041330 con 0x7ff210125f70 2020-05-18T21:37:47.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.453+0000 7ff214f19700 1 -- 172.21.15.63:0/3230412285 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff1f004fa40 msgr2=0x7ff1f0051f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:47.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.453+0000 7ff214f19700 1 --2- 172.21.15.63:0/3230412285 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff1f004fa40 0x7ff1f0051f00 secure :-1 s=READY pgs=810 cs=0 l=1 rx=0x7ff2000017a0 tx=0x7ff210025310).stop 2020-05-18T21:37:47.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.453+0000 7ff214f19700 1 -- 172.21.15.63:0/3230412285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff210125f70 msgr2=0x7ff210071a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:47.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.453+0000 7ff214f19700 1 --2- 172.21.15.63:0/3230412285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff210125f70 0x7ff210071a50 secure :-1 s=READY pgs=2069 cs=0 l=1 rx=0x7ff200001cf0 tx=0x7ff208010bd0).stop 2020-05-18T21:37:47.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.453+0000 7ff214f19700 1 -- 172.21.15.63:0/3230412285 shutdown_connections 2020-05-18T21:37:47.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.453+0000 7ff214f19700 1 --2- 172.21.15.63:0/3230412285 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff1f004fa40 0x7ff1f0051f00 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:47.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.453+0000 7ff214f19700 1 --2- 172.21.15.63:0/3230412285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff210125f70 0x7ff210071a50 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:47.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.453+0000 7ff214f19700 1 --2- 172.21.15.63:0/3230412285 >> v2:172.21.15.155:3300/0 conn(0x7ff210129e50 0x7ff21012a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:47.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.453+0000 7ff214f19700 1 -- 172.21.15.63:0/3230412285 >> 172.21.15.63:0/3230412285 conn(0x7ff210069b70 msgr2=0x7ff210061af0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:47.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.457+0000 7ff214f19700 1 -- 172.21.15.63:0/3230412285 shutdown_connections 2020-05-18T21:37:47.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.457+0000 7ff214f19700 1 -- 172.21.15.63:0/3230412285 wait complete. 2020-05-18T21:37:47.463 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.1 2020-05-18T21:37:47.473 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:37:47.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb66694700 1 Processor -- start 2020-05-18T21:37:47.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb66694700 1 -- start start 2020-05-18T21:37:47.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb66694700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb600b6410 0x7fbb600b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:47.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb66694700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbb600b5cb0 0x7fbb60061af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:47.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb66694700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbb60151bc0 0x7fbb60152030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:47.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb66694700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb60025500 con 0x7fbb60151bc0 2020-05-18T21:37:47.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb66694700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb60064ee0 con 0x7fbb600b5cb0 2020-05-18T21:37:47.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb66694700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb600b67f0 con 0x7fbb600b6410 2020-05-18T21:37:47.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb678f6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbb60151bc0 0x7fbb60152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:47.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb678f6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbb60151bc0 0x7fbb60152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36268/0 (socket says 172.21.15.63:36268) 2020-05-18T21:37:47.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb678f6700 1 -- 172.21.15.63:0/1325359880 learned_addr learned my addr 172.21.15.63:0/1325359880 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:47.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb65692700 1 --2- 172.21.15.63:0/1325359880 >> v2:172.21.15.155:3300/0 conn(0x7fbb600b5cb0 0x7fbb60061af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:47.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb65e93700 1 --2- 172.21.15.63:0/1325359880 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb600b6410 0x7fbb600b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:47.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb678f6700 1 -- 172.21.15.63:0/1325359880 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb600b6410 msgr2=0x7fbb600b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:47.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb678f6700 1 --2- 172.21.15.63:0/1325359880 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb600b6410 0x7fbb600b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:47.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb678f6700 1 -- 172.21.15.63:0/1325359880 >> v2:172.21.15.155:3300/0 conn(0x7fbb600b5cb0 msgr2=0x7fbb60061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:47.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb678f6700 1 --2- 172.21.15.63:0/1325359880 >> v2:172.21.15.155:3300/0 conn(0x7fbb600b5cb0 0x7fbb60061af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:47.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb678f6700 1 -- 172.21.15.63:0/1325359880 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb60025180 con 0x7fbb60151bc0 2020-05-18T21:37:47.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb678f6700 1 --2- 172.21.15.63:0/1325359880 >> v2:172.21.15.63:3300/0 conn(0x7fbb60151bc0 0x7fbb60152030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbb580032f0 tx=0x7fbb58007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb678f6700 1 --2- 172.21.15.63:0/1325359880 >> v2:172.21.15.63:3300/0 conn(0x7fbb60151bc0 0x7fbb60152030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbb580032f0 tx=0x7fbb58007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb678f6700 1 --2- 172.21.15.63:0/1325359880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb60151bc0 0x7fbb60152030 secure :-1 s=READY pgs=2070 cs=0 l=1 rx=0x7fbb580032f0 tx=0x7fbb58007e00).ready entity=mon.0 client_cookie=3644826e3e8cfa68 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:47.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb678f6700 1 --2- 172.21.15.63:0/1325359880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb60151bc0 0x7fbb60152030 secure :-1 s=THROTTLE_DONE pgs=2070 cs=0 l=1 rx=0x7fbb580032f0 tx=0x7fbb58007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb64e91700 1 -- 172.21.15.63:0/1325359880 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb58011c60 con 0x7fbb60151bc0 2020-05-18T21:37:47.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb678f6700 1 --2- 172.21.15.63:0/1325359880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb60151bc0 0x7fbb60152030 secure :-1 s=THROTTLE_DONE pgs=2070 cs=0 l=1 rx=0x7fbb580032f0 tx=0x7fbb58007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb678f6700 1 --2- 172.21.15.63:0/1325359880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb60151bc0 0x7fbb60152030 secure :-1 s=THROTTLE_DONE pgs=2070 cs=0 l=1 rx=0x7fbb580032f0 tx=0x7fbb58007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb64e91700 1 -- 172.21.15.63:0/1325359880 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb58011dc0 con 0x7fbb60151bc0 2020-05-18T21:37:47.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb64e91700 1 -- 172.21.15.63:0/1325359880 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb5800a370 con 0x7fbb60151bc0 2020-05-18T21:37:47.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb66694700 1 -- 172.21.15.63:0/1325359880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb60151bc0 msgr2=0x7fbb60152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:47.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.581+0000 7fbb66694700 1 --2- 172.21.15.63:0/1325359880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb60151bc0 0x7fbb60152030 secure :-1 s=READY pgs=2070 cs=0 l=1 rx=0x7fbb580032f0 tx=0x7fbb58007e00).stop 2020-05-18T21:37:47.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.585+0000 7fbb66694700 1 -- 172.21.15.63:0/1325359880 shutdown_connections 2020-05-18T21:37:47.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.585+0000 7fbb66694700 1 --2- 172.21.15.63:0/1325359880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb60151bc0 0x7fbb60152030 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:47.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.585+0000 7fbb66694700 1 --2- 172.21.15.63:0/1325359880 >> v2:172.21.15.155:3300/0 conn(0x7fbb600b5cb0 0x7fbb60061af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:47.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.585+0000 7fbb66694700 1 --2- 172.21.15.63:0/1325359880 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb600b6410 0x7fbb600b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:47.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.585+0000 7fbb66694700 1 -- 172.21.15.63:0/1325359880 >> 172.21.15.63:0/1325359880 conn(0x7fbb60069b70 msgr2=0x7fbb60069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:47.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.585+0000 7fbb66694700 1 -- 172.21.15.63:0/1325359880 shutdown_connections 2020-05-18T21:37:47.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.585+0000 7fbb66694700 1 -- 172.21.15.63:0/1325359880 wait complete. 2020-05-18T21:37:47.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.585+0000 7fbb66694700 1 Processor -- start 2020-05-18T21:37:47.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.585+0000 7fbb66694700 1 -- start start 2020-05-18T21:37:47.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb66694700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb600b6410 0x7fbb60123990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:47.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb66694700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbb60151bc0 0x7fbb600b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:47.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb66694700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb600b3560 con 0x7fbb600b5cb0 2020-05-18T21:37:47.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb66694700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb600b3800 con 0x7fbb60151bc0 2020-05-18T21:37:47.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb66694700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb600b3aa0 con 0x7fbb600b6410 2020-05-18T21:37:47.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb678f6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbb60151bc0 0x7fbb600b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:47.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb65692700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb600b6410 0x7fbb60123990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:47.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb65e93700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fbb600b5cb0 0x7fbb600b0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:36774/0 (socket says 172.21.15.63:36774) 2020-05-18T21:37:47.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb65e93700 1 -- 172.21.15.63:0/1831836953 learned_addr learned my addr 172.21.15.63:0/1831836953 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:47.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb527fc700 1 -- 172.21.15.63:0/1831836953 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131676974 0 0) 0x7fbb600b3560 con 0x7fbb600b5cb0 2020-05-18T21:37:47.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb527fc700 1 -- 172.21.15.63:0/1831836953 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb48003270 con 0x7fbb600b5cb0 2020-05-18T21:37:47.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb678f6700 1 -- 172.21.15.63:0/1831836953 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb600b6410 msgr2=0x7fbb60123990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:47.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb678f6700 1 --2- 172.21.15.63:0/1831836953 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb600b6410 0x7fbb60123990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:47.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb678f6700 1 -- 172.21.15.63:0/1831836953 >> v1:172.21.15.155:6789/0 conn(0x7fbb600b5cb0 legacy=0x7fbb600b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:47.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb678f6700 1 -- 172.21.15.63:0/1831836953 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb60121ad0 con 0x7fbb60151bc0 2020-05-18T21:37:47.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb678f6700 1 --2- 172.21.15.63:0/1831836953 >> v2:172.21.15.63:3300/0 conn(0x7fbb60151bc0 0x7fbb600b4460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb580032f0 tx=0x7fbb58007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb678f6700 1 --2- 172.21.15.63:0/1831836953 >> v2:172.21.15.63:3300/0 conn(0x7fbb60151bc0 0x7fbb600b4460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb580032f0 tx=0x7fbb58007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb678f6700 1 --2- 172.21.15.63:0/1831836953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb60151bc0 0x7fbb600b4460 secure :-1 s=READY pgs=2071 cs=0 l=1 rx=0x7fbb580032f0 tx=0x7fbb58007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:47.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb678f6700 1 --2- 172.21.15.63:0/1831836953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb60151bc0 0x7fbb600b4460 secure :-1 s=THROTTLE_DONE pgs=2071 cs=0 l=1 rx=0x7fbb580032f0 tx=0x7fbb58007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb527fc700 1 -- 172.21.15.63:0/1831836953 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb5800fcf0 con 0x7fbb60151bc0 2020-05-18T21:37:47.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb678f6700 1 --2- 172.21.15.63:0/1831836953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb60151bc0 0x7fbb600b4460 secure :-1 s=THROTTLE_DONE pgs=2071 cs=0 l=1 rx=0x7fbb580032f0 tx=0x7fbb58007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb678f6700 1 --2- 172.21.15.63:0/1831836953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb60151bc0 0x7fbb600b4460 secure :-1 s=THROTTLE_DONE pgs=2071 cs=0 l=1 rx=0x7fbb580032f0 tx=0x7fbb58007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb527fc700 1 -- 172.21.15.63:0/1831836953 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb58005c70 con 0x7fbb60151bc0 2020-05-18T21:37:47.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb66694700 1 -- 172.21.15.63:0/1831836953 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb60121ce0 con 0x7fbb60151bc0 2020-05-18T21:37:47.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb527fc700 1 -- 172.21.15.63:0/1831836953 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb58005e60 con 0x7fbb60151bc0 2020-05-18T21:37:47.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.589+0000 7fbb66694700 1 -- 172.21.15.63:0/1831836953 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb600b10d0 con 0x7fbb60151bc0 2020-05-18T21:37:47.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.593+0000 7fbb678f6700 1 --2- 172.21.15.63:0/1831836953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb60151bc0 0x7fbb600b4460 secure :-1 s=THROTTLE_DONE pgs=2071 cs=0 l=1 rx=0x7fbb580032f0 tx=0x7fbb58007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.593+0000 7fbb66694700 1 -- 172.21.15.63:0/1831836953 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb600569e0 con 0x7fbb60151bc0 2020-05-18T21:37:47.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.593+0000 7fbb527fc700 1 -- 172.21.15.63:0/1831836953 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fbb580112c0 con 0x7fbb60151bc0 2020-05-18T21:37:47.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.593+0000 7fbb678f6700 1 --2- 172.21.15.63:0/1831836953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb60151bc0 0x7fbb600b4460 secure :-1 s=THROTTLE_DONE pgs=2071 cs=0 l=1 rx=0x7fbb580032f0 tx=0x7fbb58007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.593+0000 7fbb527fc700 1 --2- 172.21.15.63:0/1831836953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbb4804fdb0 0x7fbb48052270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:47.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.593+0000 7fbb527fc700 1 -- 172.21.15.63:0/1831836953 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbb580a7fb0 con 0x7fbb60151bc0 2020-05-18T21:37:47.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.593+0000 7fbb65e93700 1 --2- 172.21.15.63:0/1831836953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbb4804fdb0 0x7fbb48052270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:47.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.593+0000 7fbb65e93700 1 --2- 172.21.15.63:0/1831836953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbb4804fdb0 0x7fbb48052270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb54002f70 tx=0x7fbb54007740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.593+0000 7fbb65e93700 1 --2- 172.21.15.63:0/1831836953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbb4804fdb0 0x7fbb48052270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb54002f70 tx=0x7fbb54007740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.593+0000 7fbb65e93700 1 --2- 172.21.15.63:0/1831836953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbb4804fdb0 0x7fbb48052270 secure :-1 s=READY pgs=811 cs=0 l=1 rx=0x7fbb54002f70 tx=0x7fbb54007740).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:47.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.601+0000 7fbb678f6700 1 --2- 172.21.15.63:0/1831836953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb60151bc0 0x7fbb600b4460 secure :-1 s=THROTTLE_DONE pgs=2071 cs=0 l=1 rx=0x7fbb580032f0 tx=0x7fbb58007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.601+0000 7fbb527fc700 1 -- 172.21.15.63:0/1831836953 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fbb58082460 con 0x7fbb60151bc0 2020-05-18T21:37:47.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.753+0000 7fbb66694700 1 -- 172.21.15.63:0/1831836953 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fbb600008d0 con 0x7fbb60151bc0 2020-05-18T21:37:47.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.761+0000 7fbb678f6700 1 --2- 172.21.15.63:0/1831836953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb60151bc0 0x7fbb600b4460 secure :-1 s=THROTTLE_DONE pgs=2071 cs=0 l=1 rx=0x7fbb580032f0 tx=0x7fbb58007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.761+0000 7fbb527fc700 1 -- 172.21.15.63:0/1831836953 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v61) v1 ==== 184+0+0 (secure 0 0 0) 0x7fbb58085a80 con 0x7fbb60151bc0 2020-05-18T21:37:47.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.761+0000 7fbb66694700 1 -- 172.21.15.63:0/1831836953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbb4804fdb0 msgr2=0x7fbb48052270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:47.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.761+0000 7fbb66694700 1 --2- 172.21.15.63:0/1831836953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbb4804fdb0 0x7fbb48052270 secure :-1 s=READY pgs=811 cs=0 l=1 rx=0x7fbb54002f70 tx=0x7fbb54007740).stop 2020-05-18T21:37:47.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.761+0000 7fbb66694700 1 -- 172.21.15.63:0/1831836953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb60151bc0 msgr2=0x7fbb600b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:47.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.761+0000 7fbb66694700 1 --2- 172.21.15.63:0/1831836953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb60151bc0 0x7fbb600b4460 secure :-1 s=READY pgs=2071 cs=0 l=1 rx=0x7fbb580032f0 tx=0x7fbb58007e00).stop 2020-05-18T21:37:47.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.761+0000 7fbb66694700 1 -- 172.21.15.63:0/1831836953 shutdown_connections 2020-05-18T21:37:47.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.761+0000 7fbb66694700 1 --2- 172.21.15.63:0/1831836953 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbb4804fdb0 0x7fbb48052270 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:47.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.761+0000 7fbb66694700 1 --2- 172.21.15.63:0/1831836953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb60151bc0 0x7fbb600b4460 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:47.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.761+0000 7fbb66694700 1 --2- 172.21.15.63:0/1831836953 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb600b6410 0x7fbb60123990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:47.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.761+0000 7fbb66694700 1 -- 172.21.15.63:0/1831836953 >> 172.21.15.63:0/1831836953 conn(0x7fbb60069b70 msgr2=0x7fbb600b7160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:47.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.761+0000 7fbb66694700 1 -- 172.21.15.63:0/1831836953 shutdown_connections 2020-05-18T21:37:47.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.761+0000 7fbb66694700 1 -- 172.21.15.63:0/1831836953 wait complete. 2020-05-18T21:37:47.772 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.2 2020-05-18T21:37:47.785 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:37:47.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebcba3700 1 Processor -- start 2020-05-18T21:37:47.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebcba3700 1 -- start start 2020-05-18T21:37:47.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebcba3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b6410 0x7fbeb80b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:47.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebcba3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbeb8151bc0 0x7fbeb8152050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:47.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebcba3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb8025500 con 0x7fbeb80b5cb0 2020-05-18T21:37:47.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebcba3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb8064ee0 con 0x7fbeb8151bc0 2020-05-18T21:37:47.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebcba3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb80b67f0 con 0x7fbeb80b6410 2020-05-18T21:37:47.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebde05700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbeb8151bc0 0x7fbeb8152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:47.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebde05700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbeb8151bc0 0x7fbeb8152050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36282/0 (socket says 172.21.15.63:36282) 2020-05-18T21:37:47.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebde05700 1 -- 172.21.15.63:0/955482115 learned_addr learned my addr 172.21.15.63:0/955482115 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:47.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbeb7fff700 1 --2- 172.21.15.63:0/955482115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b6410 0x7fbeb80b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:47.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebde05700 1 -- 172.21.15.63:0/955482115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b6410 msgr2=0x7fbeb80b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:47.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebde05700 1 --2- 172.21.15.63:0/955482115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b6410 0x7fbeb80b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:47.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebde05700 1 -- 172.21.15.63:0/955482115 >> v1:172.21.15.155:6789/0 conn(0x7fbeb80b5cb0 legacy=0x7fbeb8061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:47.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebde05700 1 -- 172.21.15.63:0/955482115 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb8025180 con 0x7fbeb8151bc0 2020-05-18T21:37:47.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebde05700 1 --2- 172.21.15.63:0/955482115 >> v2:172.21.15.63:3300/0 conn(0x7fbeb8151bc0 0x7fbeb8152050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbeb8061560 tx=0x7fbeb0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebde05700 1 --2- 172.21.15.63:0/955482115 >> v2:172.21.15.63:3300/0 conn(0x7fbeb8151bc0 0x7fbeb8152050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbeb8061560 tx=0x7fbeb0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebde05700 1 --2- 172.21.15.63:0/955482115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeb8151bc0 0x7fbeb8152050 secure :-1 s=READY pgs=2072 cs=0 l=1 rx=0x7fbeb8061560 tx=0x7fbeb0007e00).ready entity=mon.0 client_cookie=3de66deb4edc0b5e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:47.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebde05700 1 --2- 172.21.15.63:0/955482115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeb8151bc0 0x7fbeb8152050 secure :-1 s=THROTTLE_DONE pgs=2072 cs=0 l=1 rx=0x7fbeb8061560 tx=0x7fbeb0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebde05700 1 --2- 172.21.15.63:0/955482115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeb8151bc0 0x7fbeb8152050 secure :-1 s=THROTTLE_DONE pgs=2072 cs=0 l=1 rx=0x7fbeb8061560 tx=0x7fbeb0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbeb6ffd700 1 -- 172.21.15.63:0/955482115 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbeb0011d80 con 0x7fbeb8151bc0 2020-05-18T21:37:47.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebde05700 1 --2- 172.21.15.63:0/955482115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeb8151bc0 0x7fbeb8152050 secure :-1 s=THROTTLE_DONE pgs=2072 cs=0 l=1 rx=0x7fbeb8061560 tx=0x7fbeb0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbeb6ffd700 1 -- 172.21.15.63:0/955482115 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb000a180 con 0x7fbeb8151bc0 2020-05-18T21:37:47.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbeb6ffd700 1 -- 172.21.15.63:0/955482115 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbeb000a560 con 0x7fbeb8151bc0 2020-05-18T21:37:47.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebcba3700 1 -- 172.21.15.63:0/955482115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeb8151bc0 msgr2=0x7fbeb8152050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:47.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.897+0000 7fbebcba3700 1 --2- 172.21.15.63:0/955482115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeb8151bc0 0x7fbeb8152050 secure :-1 s=READY pgs=2072 cs=0 l=1 rx=0x7fbeb8061560 tx=0x7fbeb0007e00).stop 2020-05-18T21:37:47.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.901+0000 7fbebcba3700 1 -- 172.21.15.63:0/955482115 shutdown_connections 2020-05-18T21:37:47.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.901+0000 7fbebcba3700 1 --2- 172.21.15.63:0/955482115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbeb8151bc0 0x7fbeb8152050 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:47.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.901+0000 7fbebcba3700 1 --2- 172.21.15.63:0/955482115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b6410 0x7fbeb80b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:47.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.901+0000 7fbebcba3700 1 -- 172.21.15.63:0/955482115 >> 172.21.15.63:0/955482115 conn(0x7fbeb8069b70 msgr2=0x7fbeb8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:47.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.901+0000 7fbebcba3700 1 -- 172.21.15.63:0/955482115 shutdown_connections 2020-05-18T21:37:47.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.901+0000 7fbebcba3700 1 -- 172.21.15.63:0/955482115 wait complete. 2020-05-18T21:37:47.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.901+0000 7fbebcba3700 1 Processor -- start 2020-05-18T21:37:47.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.901+0000 7fbebcba3700 1 -- start start 2020-05-18T21:37:47.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.901+0000 7fbebcba3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b5cb0 0x7fbeb80b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:47.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.901+0000 7fbebcba3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbeb80b6410 0x7fbeb8158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:47.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.901+0000 7fbebcba3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb8157750 con 0x7fbeb8151bc0 2020-05-18T21:37:47.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.901+0000 7fbebcba3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb81579f0 con 0x7fbeb80b6410 2020-05-18T21:37:47.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.901+0000 7fbebcba3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb8157c90 con 0x7fbeb80b5cb0 2020-05-18T21:37:47.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.901+0000 7fbeb7fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b5cb0 0x7fbeb80b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:47.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.901+0000 7fbeb77fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbeb80b6410 0x7fbeb8158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:47.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.901+0000 7fbeb7fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b5cb0 0x7fbeb80b4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:55220/0 (socket says 172.21.15.63:55220) 2020-05-18T21:37:47.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.901+0000 7fbeb7fff700 1 -- 172.21.15.63:0/3865714463 learned_addr learned my addr 172.21.15.63:0/3865714463 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:47.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbeb7fff700 1 -- 172.21.15.63:0/3865714463 >> v2:172.21.15.155:3300/0 conn(0x7fbeb80b6410 msgr2=0x7fbeb8158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:47.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbeb7fff700 1 --2- 172.21.15.63:0/3865714463 >> v2:172.21.15.155:3300/0 conn(0x7fbeb80b6410 0x7fbeb8158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:47.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbeb7fff700 1 -- 172.21.15.63:0/3865714463 >> v1:172.21.15.155:6789/0 conn(0x7fbeb8151bc0 legacy=0x7fbeb80b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:47.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbeb7fff700 1 -- 172.21.15.63:0/3865714463 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb80801e0 con 0x7fbeb80b5cb0 2020-05-18T21:37:47.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbeb7fff700 1 --2- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b5cb0 0x7fbeb80b4540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbeb80b7ac0 tx=0x7fbea8010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbeb7fff700 1 --2- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b5cb0 0x7fbeb80b4540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbeb80b7ac0 tx=0x7fbea8010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbeb7fff700 1 --2- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b5cb0 0x7fbeb80b4540 secure :-1 s=READY pgs=320 cs=0 l=1 rx=0x7fbeb80b7ac0 tx=0x7fbea8010ca0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:47.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbeb7fff700 1 --2- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b5cb0 0x7fbeb80b4540 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7fbeb80b7ac0 tx=0x7fbea8010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbeb4ff9700 1 -- 172.21.15.63:0/3865714463 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbea8012b00 con 0x7fbeb80b5cb0 2020-05-18T21:37:47.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbeb7fff700 1 --2- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b5cb0 0x7fbeb80b4540 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7fbeb80b7ac0 tx=0x7fbea8010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbeb4ff9700 1 -- 172.21.15.63:0/3865714463 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea8012c60 con 0x7fbeb80b5cb0 2020-05-18T21:37:47.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbeb7fff700 1 --2- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b5cb0 0x7fbeb80b4540 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7fbeb80b7ac0 tx=0x7fbea8010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbebcba3700 1 -- 172.21.15.63:0/3865714463 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb8158590 con 0x7fbeb80b5cb0 2020-05-18T21:37:47.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbeb4ff9700 1 -- 172.21.15.63:0/3865714463 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbea80091c0 con 0x7fbeb80b5cb0 2020-05-18T21:37:47.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbebcba3700 1 -- 172.21.15.63:0/3865714463 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb80b8f00 con 0x7fbeb80b5cb0 2020-05-18T21:37:47.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbeb7fff700 1 --2- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b5cb0 0x7fbeb80b4540 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7fbeb80b7ac0 tx=0x7fbea8010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbebcba3700 1 -- 172.21.15.63:0/3865714463 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb80569e0 con 0x7fbeb80b5cb0 2020-05-18T21:37:47.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbeb4ff9700 1 -- 172.21.15.63:0/3865714463 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fbea8007190 con 0x7fbeb80b5cb0 2020-05-18T21:37:47.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbeb7fff700 1 --2- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b5cb0 0x7fbeb80b4540 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7fbeb80b7ac0 tx=0x7fbea8010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbeb4ff9700 1 --2- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbe9804fa10 0x7fbe98051ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:47.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.905+0000 7fbeb4ff9700 1 -- 172.21.15.63:0/3865714463 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbea80641f0 con 0x7fbeb80b5cb0 2020-05-18T21:37:47.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.909+0000 7fbeb77fe700 1 --2- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbe9804fa10 0x7fbe98051ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:47.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.909+0000 7fbeb77fe700 1 --2- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbe9804fa10 0x7fbe98051ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbeac001f90 tx=0x7fbeac003a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.909+0000 7fbeb77fe700 1 --2- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbe9804fa10 0x7fbe98051ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbeac001f90 tx=0x7fbeac003a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.909+0000 7fbeb77fe700 1 --2- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbe9804fa10 0x7fbe98051ed0 secure :-1 s=READY pgs=812 cs=0 l=1 rx=0x7fbeac001f90 tx=0x7fbeac003a30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:47.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.917+0000 7fbeb7fff700 1 --2- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b5cb0 0x7fbeb80b4540 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7fbeb80b7ac0 tx=0x7fbea8010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:47.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:47.917+0000 7fbeb4ff9700 1 -- 172.21.15.63:0/3865714463 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fbea803e5c0 con 0x7fbeb80b5cb0 2020-05-18T21:37:48.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.073+0000 7fbebcba3700 1 -- 172.21.15.63:0/3865714463 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fbeb80008d0 con 0x7fbeb80b5cb0 2020-05-18T21:37:48.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.089+0000 7fbeb7fff700 1 --2- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b5cb0 0x7fbeb80b4540 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7fbeb80b7ac0 tx=0x7fbea8010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.089+0000 7fbeb4ff9700 1 -- 172.21.15.63:0/3865714463 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v62) v1 ==== 184+0+0 (secure 0 0 0) 0x7fbea8041be0 con 0x7fbeb80b5cb0 2020-05-18T21:37:48.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.089+0000 7fbebcba3700 1 -- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbe9804fa10 msgr2=0x7fbe98051ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:48.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.089+0000 7fbebcba3700 1 --2- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbe9804fa10 0x7fbe98051ed0 secure :-1 s=READY pgs=812 cs=0 l=1 rx=0x7fbeac001f90 tx=0x7fbeac003a30).stop 2020-05-18T21:37:48.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.089+0000 7fbebcba3700 1 -- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b5cb0 msgr2=0x7fbeb80b4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:48.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.089+0000 7fbebcba3700 1 --2- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b5cb0 0x7fbeb80b4540 secure :-1 s=READY pgs=320 cs=0 l=1 rx=0x7fbeb80b7ac0 tx=0x7fbea8010ca0).stop 2020-05-18T21:37:48.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.093+0000 7fbebcba3700 1 -- 172.21.15.63:0/3865714463 shutdown_connections 2020-05-18T21:37:48.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.093+0000 7fbebcba3700 1 --2- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbe9804fa10 0x7fbe98051ed0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:48.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.093+0000 7fbebcba3700 1 --2- 172.21.15.63:0/3865714463 >> v2:172.21.15.155:3300/0 conn(0x7fbeb80b6410 0x7fbeb8158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:48.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.093+0000 7fbebcba3700 1 --2- 172.21.15.63:0/3865714463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb80b5cb0 0x7fbeb80b4540 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:48.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.093+0000 7fbebcba3700 1 -- 172.21.15.63:0/3865714463 >> 172.21.15.63:0/3865714463 conn(0x7fbeb8069b70 msgr2=0x7fbeb815c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:48.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.093+0000 7fbebcba3700 1 -- 172.21.15.63:0/3865714463 shutdown_connections 2020-05-18T21:37:48.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.093+0000 7fbebcba3700 1 -- 172.21.15.63:0/3865714463 wait complete. 2020-05-18T21:37:48.104 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.3 2020-05-18T21:37:48.111 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:48.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.209+0000 7fe8a358d700 1 Processor -- start 2020-05-18T21:37:48.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.209+0000 7fe8a358d700 1 -- start start 2020-05-18T21:37:48.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.209+0000 7fe8a358d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe89c060b90 0x7fe89c0b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:48.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.209+0000 7fe8a358d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c147210 con 0x7fe89c146c90 2020-05-18T21:37:48.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.209+0000 7fe8a358d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c061d60 con 0x7fe89c0b2d70 2020-05-18T21:37:48.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.209+0000 7fe8a358d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89c062000 con 0x7fe89c060b90 2020-05-18T21:37:48.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.209+0000 7fe8a0b28700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe89c146c90 0x7fe89c0624a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38480/0 (socket says 172.21.15.63:38480) 2020-05-18T21:37:48.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.209+0000 7fe8a0b28700 1 -- 172.21.15.63:0/415275783 learned_addr learned my addr 172.21.15.63:0/415275783 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:48.217 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.209+0000 7fe8a1329700 1 --2- 172.21.15.63:0/415275783 >> v2:172.21.15.155:3300/0 conn(0x7fe89c060b90 0x7fe89c0b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:48.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.209+0000 7fe88bfff700 1 -- 172.21.15.63:0/415275783 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891576241 0 0) 0x7fe89c147210 con 0x7fe89c146c90 2020-05-18T21:37:48.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.209+0000 7fe88bfff700 1 -- 172.21.15.63:0/415275783 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe884003270 con 0x7fe89c146c90 2020-05-18T21:37:48.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe8a1329700 1 -- 172.21.15.63:0/415275783 >> v1:172.21.15.155:6789/0 conn(0x7fe89c0b2d70 legacy=0x7fe89c142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:48.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe8a1329700 1 -- 172.21.15.63:0/415275783 >> v1:172.21.15.63:6789/0 conn(0x7fe89c146c90 legacy=0x7fe89c0624a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:48.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe8a1329700 1 -- 172.21.15.63:0/415275783 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c060f70 con 0x7fe89c060b90 2020-05-18T21:37:48.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe8a1329700 1 --2- 172.21.15.63:0/415275783 >> v2:172.21.15.155:3300/0 conn(0x7fe89c060b90 0x7fe89c0b3f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe898002f70 tx=0x7fe898007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe8a1329700 1 --2- 172.21.15.63:0/415275783 >> v2:172.21.15.155:3300/0 conn(0x7fe89c060b90 0x7fe89c0b3f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe898002f70 tx=0x7fe898007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe8a1329700 1 --2- 172.21.15.63:0/415275783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe89c060b90 0x7fe89c0b3f70 secure :-1 s=READY pgs=1380 cs=0 l=1 rx=0x7fe898002f70 tx=0x7fe898007a80).ready entity=mon.1 client_cookie=a005ca173818e0fb server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:48.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe8a1329700 1 --2- 172.21.15.63:0/415275783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe89c060b90 0x7fe89c0b3f70 secure :-1 s=THROTTLE_DONE pgs=1380 cs=0 l=1 rx=0x7fe898002f70 tx=0x7fe898007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe88bfff700 1 -- 172.21.15.63:0/415275783 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe898008e10 con 0x7fe89c060b90 2020-05-18T21:37:48.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe8a1329700 1 --2- 172.21.15.63:0/415275783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe89c060b90 0x7fe89c0b3f70 secure :-1 s=THROTTLE_DONE pgs=1380 cs=0 l=1 rx=0x7fe898002f70 tx=0x7fe898007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe8a1329700 1 --2- 172.21.15.63:0/415275783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe89c060b90 0x7fe89c0b3f70 secure :-1 s=THROTTLE_DONE pgs=1380 cs=0 l=1 rx=0x7fe898002f70 tx=0x7fe898007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe88bfff700 1 -- 172.21.15.63:0/415275783 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe898011790 con 0x7fe89c060b90 2020-05-18T21:37:48.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe8a358d700 1 -- 172.21.15.63:0/415275783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe89c060b90 msgr2=0x7fe89c0b3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:48.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe88bfff700 1 -- 172.21.15.63:0/415275783 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe898011b70 con 0x7fe89c060b90 2020-05-18T21:37:48.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe8a358d700 1 --2- 172.21.15.63:0/415275783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe89c060b90 0x7fe89c0b3f70 secure :-1 s=READY pgs=1380 cs=0 l=1 rx=0x7fe898002f70 tx=0x7fe898007a80).stop 2020-05-18T21:37:48.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe8a358d700 1 -- 172.21.15.63:0/415275783 shutdown_connections 2020-05-18T21:37:48.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe8a358d700 1 --2- 172.21.15.63:0/415275783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe89c060b90 0x7fe89c0b3f70 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:48.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe8a358d700 1 -- 172.21.15.63:0/415275783 >> 172.21.15.63:0/415275783 conn(0x7fe89c0b83d0 msgr2=0x7fe89c0b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:48.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe8a358d700 1 -- 172.21.15.63:0/415275783 shutdown_connections 2020-05-18T21:37:48.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe8a358d700 1 -- 172.21.15.63:0/415275783 wait complete. 2020-05-18T21:37:48.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe8a358d700 1 Processor -- start 2020-05-18T21:37:48.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.213+0000 7fe8a358d700 1 -- start start 2020-05-18T21:37:48.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a358d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c060b90 0x7fe89c0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:48.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a358d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe89c0b2d70 0x7fe89c0b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:48.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a358d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c1421b0 con 0x7fe89c146c90 2020-05-18T21:37:48.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a358d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89c0b5610 con 0x7fe89c0b2d70 2020-05-18T21:37:48.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a358d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c1452c0 con 0x7fe89c060b90 2020-05-18T21:37:48.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a1b2a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe89c146c90 0x7fe89c13bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38490/0 (socket says 172.21.15.63:38490) 2020-05-18T21:37:48.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a1b2a700 1 -- 172.21.15.63:0/2796665937 learned_addr learned my addr 172.21.15.63:0/2796665937 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:48.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a0b28700 1 --2- 172.21.15.63:0/2796665937 >> v2:172.21.15.155:3300/0 conn(0x7fe89c0b2d70 0x7fe89c0b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:48.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a1329700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c060b90 0x7fe89c0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:48.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe88a7fc700 1 -- 172.21.15.63:0/2796665937 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392703368 0 0) 0x7fe89c1421b0 con 0x7fe89c146c90 2020-05-18T21:37:48.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe88a7fc700 1 -- 172.21.15.63:0/2796665937 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe87c002fe0 con 0x7fe89c146c90 2020-05-18T21:37:48.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a1329700 1 -- 172.21.15.63:0/2796665937 >> v2:172.21.15.155:3300/0 conn(0x7fe89c0b2d70 msgr2=0x7fe89c0b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:48.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a1329700 1 --2- 172.21.15.63:0/2796665937 >> v2:172.21.15.155:3300/0 conn(0x7fe89c0b2d70 0x7fe89c0b12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:48.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a1329700 1 -- 172.21.15.63:0/2796665937 >> v1:172.21.15.63:6789/0 conn(0x7fe89c146c90 legacy=0x7fe89c13bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:48.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a1329700 1 -- 172.21.15.63:0/2796665937 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c145560 con 0x7fe89c060b90 2020-05-18T21:37:48.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a1329700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c060b90 0x7fe89c0b51b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe898002f70 tx=0x7fe898007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a1329700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c060b90 0x7fe89c0b51b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe898002f70 tx=0x7fe898007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a1329700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c060b90 0x7fe89c0b51b0 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7fe898002f70 tx=0x7fe898007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:48.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a1329700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c060b90 0x7fe89c0b51b0 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fe898002f70 tx=0x7fe898007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe88a7fc700 1 -- 172.21.15.63:0/2796665937 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe89800f780 con 0x7fe89c060b90 2020-05-18T21:37:48.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a1329700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c060b90 0x7fe89c0b51b0 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fe898002f70 tx=0x7fe898007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a358d700 1 -- 172.21.15.63:0/2796665937 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89c145800 con 0x7fe89c060b90 2020-05-18T21:37:48.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe88a7fc700 1 -- 172.21.15.63:0/2796665937 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe898007170 con 0x7fe89c060b90 2020-05-18T21:37:48.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a1329700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c060b90 0x7fe89c0b51b0 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fe898002f70 tx=0x7fe898007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe88a7fc700 1 -- 172.21.15.63:0/2796665937 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe898007550 con 0x7fe89c060b90 2020-05-18T21:37:48.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a358d700 1 -- 172.21.15.63:0/2796665937 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89c0b1710 con 0x7fe89c060b90 2020-05-18T21:37:48.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a358d700 1 -- 172.21.15.63:0/2796665937 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89c0569e0 con 0x7fe89c060b90 2020-05-18T21:37:48.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.217+0000 7fe8a1329700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c060b90 0x7fe89c0b51b0 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fe898002f70 tx=0x7fe898007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.221+0000 7fe88a7fc700 1 -- 172.21.15.63:0/2796665937 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe898005700 con 0x7fe89c060b90 2020-05-18T21:37:48.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.221+0000 7fe8a1329700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c060b90 0x7fe89c0b51b0 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fe898002f70 tx=0x7fe898007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.221+0000 7fe88a7fc700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe87c04fd70 0x7fe87c052230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:48.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.221+0000 7fe88a7fc700 1 -- 172.21.15.63:0/2796665937 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe8980643a0 con 0x7fe89c060b90 2020-05-18T21:37:48.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.221+0000 7fe8a0b28700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe87c04fd70 0x7fe87c052230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:48.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.221+0000 7fe8a0b28700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe87c04fd70 0x7fe87c052230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe88c001110 tx=0x7fe88c001da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.221+0000 7fe8a0b28700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe87c04fd70 0x7fe87c052230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe88c001110 tx=0x7fe88c001da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.221+0000 7fe8a0b28700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe87c04fd70 0x7fe87c052230 secure :-1 s=READY pgs=813 cs=0 l=1 rx=0x7fe88c001110 tx=0x7fe88c001da0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:48.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.229+0000 7fe8a1329700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c060b90 0x7fe89c0b51b0 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fe898002f70 tx=0x7fe898007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.229+0000 7fe88a7fc700 1 -- 172.21.15.63:0/2796665937 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe89803e750 con 0x7fe89c060b90 2020-05-18T21:37:48.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.381+0000 7fe8a358d700 1 -- 172.21.15.63:0/2796665937 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe89c0b4800 con 0x7fe89c060b90 2020-05-18T21:37:48.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.381+0000 7fe8a1329700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c060b90 0x7fe89c0b51b0 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fe898002f70 tx=0x7fe898007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.381+0000 7fe88a7fc700 1 -- 172.21.15.63:0/2796665937 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 134 v134) v1 ==== 95+0+2152 (secure 0 0 0) 0x7fe898041d70 con 0x7fe89c060b90 2020-05-18T21:37:48.388 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:48.389 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":134,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7157,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4038166667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4038166667},{"type":"v1","addr":"172.21.15.155:6835","nonce":4038166667}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":132}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:45.262609+0000","modified":"2020-05-18T21:37:46.266342+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10281":{"gid":10281,"name":"a","rank":0,"incarnation":133,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/2149589625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2149589625},{"type":"v1","addr":"172.21.15.63:6833","nonce":2149589625}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2020-05-18T21:37:48.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.385+0000 7fe8a358d700 1 -- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe87c04fd70 msgr2=0x7fe87c052230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:48.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.385+0000 7fe8a358d700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe87c04fd70 0x7fe87c052230 secure :-1 s=READY pgs=813 cs=0 l=1 rx=0x7fe88c001110 tx=0x7fe88c001da0).stop 2020-05-18T21:37:48.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.385+0000 7fe8a358d700 1 -- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c060b90 msgr2=0x7fe89c0b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:48.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.385+0000 7fe8a358d700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c060b90 0x7fe89c0b51b0 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7fe898002f70 tx=0x7fe898007a80).stop 2020-05-18T21:37:48.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.385+0000 7fe8a358d700 1 -- 172.21.15.63:0/2796665937 shutdown_connections 2020-05-18T21:37:48.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.385+0000 7fe8a358d700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe87c04fd70 0x7fe87c052230 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:48.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.385+0000 7fe8a358d700 1 --2- 172.21.15.63:0/2796665937 >> v2:172.21.15.155:3300/0 conn(0x7fe89c0b2d70 0x7fe89c0b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:48.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.385+0000 7fe8a358d700 1 --2- 172.21.15.63:0/2796665937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c060b90 0x7fe89c0b51b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:48.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.385+0000 7fe8a358d700 1 -- 172.21.15.63:0/2796665937 >> 172.21.15.63:0/2796665937 conn(0x7fe89c0b83d0 msgr2=0x7fe89c065880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:48.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.385+0000 7fe8a358d700 1 -- 172.21.15.63:0/2796665937 shutdown_connections 2020-05-18T21:37:48.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.385+0000 7fe8a358d700 1 -- 172.21.15.63:0/2796665937 wait complete. 2020-05-18T21:37:48.392 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 134 2020-05-18T21:37:48.602 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 134, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:37:45.262609+0000', 'modified': '2020-05-18T21:37:46.266342+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10281': {'gid': 10281, 'name': 'a', 'rank': 0, 'incarnation': 133, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/2149589625', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 2149589625}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 2149589625}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:37:48.603 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:37:48.604 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:37:48.712 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:37:48.713 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:37:48.713 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:37:48.713 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 10281, 2020-05-18T21:37:48.713 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:37:48.713 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:37:48.714 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 3.4448240640000001, 2020-05-18T21:37:48.714 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 134, 2020-05-18T21:37:48.714 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 157, 2020-05-18T21:37:48.714 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 156, 2020-05-18T21:37:48.714 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 7.6082187059999997 2020-05-18T21:37:48.715 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:37:48.721 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 10281, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.4448240640000001, "mdsmap_epoch": 134, "osdmap_epoch": 157, "osdmap_epoch_barrier": 156, "uptime": 7.6082187059999997 } 2020-05-18T21:37:48.722 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:37:48.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b759e700 1 Processor -- start 2020-05-18T21:37:48.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b759e700 1 -- start start 2020-05-18T21:37:48.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3b80b4760 0x7fb3b80648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:48.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b814a330 con 0x7fb3b805f110 2020-05-18T21:37:48.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b814a5d0 con 0x7fb3b8064d20 2020-05-18T21:37:48.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b814a140 con 0x7fb3b80b4760 2020-05-18T21:37:48.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b659c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb3b805f110 0x7fb3b814aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38494/0 (socket says 172.21.15.63:38494) 2020-05-18T21:37:48.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b659c700 1 -- 172.21.15.63:0/2136166135 learned_addr learned my addr 172.21.15.63:0/2136166135 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:48.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3affff700 1 --2- 172.21.15.63:0/2136166135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3b80b4760 0x7fb3b80648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:48.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b5d9b700 1 -- 172.21.15.63:0/2136166135 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861853170 0 0) 0x7fb3b814a330 con 0x7fb3b805f110 2020-05-18T21:37:48.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b5d9b700 1 -- 172.21.15.63:0/2136166135 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb398003270 con 0x7fb3b805f110 2020-05-18T21:37:48.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b5d9b700 1 -- 172.21.15.63:0/2136166135 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639874355 0 0) 0x7fb3b814a5d0 con 0x7fb3b8064d20 2020-05-18T21:37:48.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3affff700 1 -- 172.21.15.63:0/2136166135 >> v1:172.21.15.155:6789/0 conn(0x7fb3b8064d20 legacy=0x7fb3b814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:48.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3affff700 1 -- 172.21.15.63:0/2136166135 >> v1:172.21.15.63:6789/0 conn(0x7fb3b805f110 legacy=0x7fb3b814aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:48.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3affff700 1 -- 172.21.15.63:0/2136166135 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b8063430 con 0x7fb3b80b4760 2020-05-18T21:37:48.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3affff700 1 --2- 172.21.15.63:0/2136166135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3b80b4760 0x7fb3b80648c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb3b8060a90 tx=0x7fb3a0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3affff700 1 --2- 172.21.15.63:0/2136166135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3b80b4760 0x7fb3b80648c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb3b8060a90 tx=0x7fb3a0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3affff700 1 --2- 172.21.15.63:0/2136166135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3b80b4760 0x7fb3b80648c0 secure :-1 s=READY pgs=322 cs=0 l=1 rx=0x7fb3b8060a90 tx=0x7fb3a0008920).ready entity=mon.2 client_cookie=68d1857e83e205d4 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:48.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3affff700 1 --2- 172.21.15.63:0/2136166135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3b80b4760 0x7fb3b80648c0 secure :-1 s=THROTTLE_DONE pgs=322 cs=0 l=1 rx=0x7fb3b8060a90 tx=0x7fb3a0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b5d9b700 1 -- 172.21.15.63:0/2136166135 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3a0011620 con 0x7fb3b80b4760 2020-05-18T21:37:48.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3affff700 1 --2- 172.21.15.63:0/2136166135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3b80b4760 0x7fb3b80648c0 secure :-1 s=THROTTLE_DONE pgs=322 cs=0 l=1 rx=0x7fb3b8060a90 tx=0x7fb3a0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3affff700 1 --2- 172.21.15.63:0/2136166135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3b80b4760 0x7fb3b80648c0 secure :-1 s=THROTTLE_DONE pgs=322 cs=0 l=1 rx=0x7fb3b8060a90 tx=0x7fb3a0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b5d9b700 1 -- 172.21.15.63:0/2136166135 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a0011780 con 0x7fb3b80b4760 2020-05-18T21:37:48.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b5d9b700 1 -- 172.21.15.63:0/2136166135 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3a0011b60 con 0x7fb3b80b4760 2020-05-18T21:37:48.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b759e700 1 -- 172.21.15.63:0/2136166135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3b80b4760 msgr2=0x7fb3b80648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:48.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b759e700 1 --2- 172.21.15.63:0/2136166135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3b80b4760 0x7fb3b80648c0 secure :-1 s=READY pgs=322 cs=0 l=1 rx=0x7fb3b8060a90 tx=0x7fb3a0008920).stop 2020-05-18T21:37:48.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b759e700 1 -- 172.21.15.63:0/2136166135 shutdown_connections 2020-05-18T21:37:48.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b759e700 1 --2- 172.21.15.63:0/2136166135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3b80b4760 0x7fb3b80648c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:48.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b759e700 1 -- 172.21.15.63:0/2136166135 >> 172.21.15.63:0/2136166135 conn(0x7fb3b8069fc0 msgr2=0x7fb3b806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:48.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b759e700 1 -- 172.21.15.63:0/2136166135 shutdown_connections 2020-05-18T21:37:48.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.825+0000 7fb3b759e700 1 -- 172.21.15.63:0/2136166135 wait complete. 2020-05-18T21:37:48.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b759e700 1 Processor -- start 2020-05-18T21:37:48.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b759e700 1 -- start start 2020-05-18T21:37:48.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb3b805f110 0x7fb3b8146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:48.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3b80b4760 0x7fb3b8144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:48.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b81470c0 con 0x7fb3b8064d20 2020-05-18T21:37:48.845 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b8146000 con 0x7fb3b805f110 2020-05-18T21:37:48.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b8149960 con 0x7fb3b80b4760 2020-05-18T21:37:48.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3affff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb3b8064d20 0x7fb3b81458f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38502/0 (socket says 172.21.15.63:38502) 2020-05-18T21:37:48.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3affff700 1 -- 172.21.15.63:0/402831870 learned_addr learned my addr 172.21.15.63:0/402831870 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:48.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b659c700 1 --2- 172.21.15.63:0/402831870 >> v2:172.21.15.155:3300/0 conn(0x7fb3b805f110 0x7fb3b8146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:48.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b6d9d700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3b80b4760 0x7fb3b8144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:48.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3af7fe700 1 -- 172.21.15.63:0/402831870 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978277846 0 0) 0x7fb3b81470c0 con 0x7fb3b8064d20 2020-05-18T21:37:48.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3af7fe700 1 -- 172.21.15.63:0/402831870 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb39c002fe0 con 0x7fb3b8064d20 2020-05-18T21:37:48.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3af7fe700 1 -- 172.21.15.63:0/402831870 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1993131671 0 0) 0x7fb39c002fe0 con 0x7fb3b8064d20 2020-05-18T21:37:48.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3af7fe700 1 -- 172.21.15.63:0/402831870 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb3b81470c0 con 0x7fb3b8064d20 2020-05-18T21:37:48.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3af7fe700 1 -- 172.21.15.63:0/402831870 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fb3a0011de0 con 0x7fb3b8064d20 2020-05-18T21:37:48.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3af7fe700 1 -- 172.21.15.63:0/402831870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3b80b4760 msgr2=0x7fb3b8144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:48.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3af7fe700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3b80b4760 0x7fb3b8144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:48.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3af7fe700 1 -- 172.21.15.63:0/402831870 >> v2:172.21.15.155:3300/0 conn(0x7fb3b805f110 msgr2=0x7fb3b8146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:48.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3af7fe700 1 --2- 172.21.15.63:0/402831870 >> v2:172.21.15.155:3300/0 conn(0x7fb3b805f110 0x7fb3b8146bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:48.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3af7fe700 1 -- 172.21.15.63:0/402831870 >> v1:172.21.15.63:6789/0 conn(0x7fb3b8064d20 legacy=0x7fb3b81458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:48.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3af7fe700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb39c004b50 0x7fb39c004f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:48.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3af7fe700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb39c0039a0 0x7fb39c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:48.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3af7fe700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3b80b4760 0x7fb39c004240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:48.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3af7fe700 1 -- 172.21.15.63:0/402831870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b8149960 con 0x7fb39c004b50 2020-05-18T21:37:48.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3af7fe700 1 -- 172.21.15.63:0/402831870 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c0046a0 con 0x7fb39c0039a0 2020-05-18T21:37:48.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3af7fe700 1 -- 172.21.15.63:0/402831870 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c004860 con 0x7fb3b80b4760 2020-05-18T21:37:48.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b659c700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb39c004b50 0x7fb39c004f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:48.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3affff700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb39c0039a0 0x7fb39c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:48.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b6d9d700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3b80b4760 0x7fb39c004240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:48.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b659c700 1 -- 172.21.15.63:0/402831870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3b80b4760 msgr2=0x7fb39c004240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:48.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b659c700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3b80b4760 0x7fb39c004240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:48.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b659c700 1 -- 172.21.15.63:0/402831870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb39c0039a0 msgr2=0x7fb39c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b659c700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb39c0039a0 0x7fb39c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b659c700 1 -- 172.21.15.63:0/402831870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b8149c00 con 0x7fb39c004b50 2020-05-18T21:37:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b759e700 1 -- 172.21.15.63:0/402831870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b815b850 con 0x7fb39c004b50 2020-05-18T21:37:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b659c700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb39c004b50 0x7fb39c004f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb3a8001110 tx=0x7fb39c0056b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b759e700 1 -- 172.21.15.63:0/402831870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b8144ac0 con 0x7fb39c004b50 2020-05-18T21:37:48.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b659c700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb39c004b50 0x7fb39c004f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb3a8001110 tx=0x7fb39c0056b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b659c700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb39c004b50 0x7fb39c004f50 secure :-1 s=READY pgs=2077 cs=0 l=1 rx=0x7fb3a8001110 tx=0x7fb39c0056b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:48.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b659c700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb39c004b50 0x7fb39c004f50 secure :-1 s=THROTTLE_DONE pgs=2077 cs=0 l=1 rx=0x7fb3a8001110 tx=0x7fb39c0056b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3af7fe700 1 -- 172.21.15.63:0/402831870 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3a800c670 con 0x7fb39c004b50 2020-05-18T21:37:48.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b659c700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb39c004b50 0x7fb39c004f50 secure :-1 s=THROTTLE_DONE pgs=2077 cs=0 l=1 rx=0x7fb3a8001110 tx=0x7fb39c0056b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3af7fe700 1 -- 172.21.15.63:0/402831870 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a800c7d0 con 0x7fb39c004b50 2020-05-18T21:37:48.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3b659c700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb39c004b50 0x7fb39c004f50 secure :-1 s=THROTTLE_DONE pgs=2077 cs=0 l=1 rx=0x7fb3a8001110 tx=0x7fb39c0056b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.829+0000 7fb3af7fe700 1 -- 172.21.15.63:0/402831870 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3a800cbb0 con 0x7fb39c004b50 2020-05-18T21:37:48.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.833+0000 7fb3b659c700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb39c004b50 0x7fb39c004f50 secure :-1 s=THROTTLE_DONE pgs=2077 cs=0 l=1 rx=0x7fb3a8001110 tx=0x7fb39c0056b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.833+0000 7fb3b759e700 1 -- 172.21.15.63:0/402831870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb390003380 con 0x7fb39c004b50 2020-05-18T21:37:48.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.833+0000 7fb3af7fe700 1 -- 172.21.15.63:0/402831870 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb3a800cd10 con 0x7fb39c004b50 2020-05-18T21:37:48.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.833+0000 7fb3b659c700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb39c004b50 0x7fb39c004f50 secure :-1 s=THROTTLE_DONE pgs=2077 cs=0 l=1 rx=0x7fb3a8001110 tx=0x7fb39c0056b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.833+0000 7fb3af7fe700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb39c057df0 0x7fb39c05a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:48.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.833+0000 7fb3af7fe700 1 -- 172.21.15.63:0/402831870 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb3a8063c10 con 0x7fb39c004b50 2020-05-18T21:37:48.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.833+0000 7fb3affff700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb39c057df0 0x7fb39c05a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:48.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.833+0000 7fb3affff700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb39c057df0 0x7fb39c05a2b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb3a0007f10 tx=0x7fb3b8063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.833+0000 7fb3affff700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb39c057df0 0x7fb39c05a2b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb3a0007f10 tx=0x7fb3b8063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.833+0000 7fb3affff700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb39c057df0 0x7fb39c05a2b0 secure :-1 s=READY pgs=814 cs=0 l=1 rx=0x7fb3a0007f10 tx=0x7fb3b8063c50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:48.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.837+0000 7fb3b659c700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb39c004b50 0x7fb39c004f50 secure :-1 s=THROTTLE_DONE pgs=2077 cs=0 l=1 rx=0x7fb3a8001110 tx=0x7fb39c0056b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.837+0000 7fb3af7fe700 1 -- 172.21.15.63:0/402831870 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb3a803e0c0 con 0x7fb39c004b50 2020-05-18T21:37:48.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.957+0000 7fb3b759e700 1 -- 172.21.15.63:0/402831870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb390002210 con 0x7fb39c004b50 2020-05-18T21:37:48.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.957+0000 7fb3b659c700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb39c004b50 0x7fb39c004f50 secure :-1 s=THROTTLE_DONE pgs=2077 cs=0 l=1 rx=0x7fb3a8001110 tx=0x7fb39c0056b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:48.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.957+0000 7fb3af7fe700 1 -- 172.21.15.63:0/402831870 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+16103 (secure 0 0 0) 0x7fb3a80416e0 con 0x7fb39c004b50 2020-05-18T21:37:48.963 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:48.964 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":157,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:37:47.278574+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:37:43.788191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2020-05-18T21:37:44.262734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:37:48.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.957+0000 7fb3b759e700 1 -- 172.21.15.63:0/402831870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb39c057df0 msgr2=0x7fb39c05a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:48.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.957+0000 7fb3b759e700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb39c057df0 0x7fb39c05a2b0 secure :-1 s=READY pgs=814 cs=0 l=1 rx=0x7fb3a0007f10 tx=0x7fb3b8063c50).stop 2020-05-18T21:37:48.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.957+0000 7fb3b6d9d700 1 -- 172.21.15.63:0/402831870 reap_dead start 2020-05-18T21:37:48.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.957+0000 7fb3b759e700 1 -- 172.21.15.63:0/402831870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb39c004b50 msgr2=0x7fb39c004f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:48.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.957+0000 7fb3b759e700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb39c004b50 0x7fb39c004f50 secure :-1 s=READY pgs=2077 cs=0 l=1 rx=0x7fb3a8001110 tx=0x7fb39c0056b0).stop 2020-05-18T21:37:48.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.957+0000 7fb3b759e700 1 -- 172.21.15.63:0/402831870 shutdown_connections 2020-05-18T21:37:48.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.957+0000 7fb3b759e700 1 --2- 172.21.15.63:0/402831870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb39c004b50 0x7fb39c004f50 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:48.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.957+0000 7fb3b759e700 1 -- 172.21.15.63:0/402831870 >> 172.21.15.63:0/402831870 conn(0x7fb3b8069fc0 msgr2=0x7fb3b805c280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:48.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.957+0000 7fb3b759e700 1 -- 172.21.15.63:0/402831870 shutdown_connections 2020-05-18T21:37:48.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:48.957+0000 7fb3b759e700 1 -- 172.21.15.63:0/402831870 wait complete. 2020-05-18T21:37:48.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:37:43.788191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '155', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:37:44.262734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:37:48.982 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:37:49.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.089+0000 7f3ee89bf700 1 Processor -- start 2020-05-18T21:37:49.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.089+0000 7f3ee89bf700 1 -- start start 2020-05-18T21:37:49.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.089+0000 7f3ee89bf700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3ee40b50e0 0x7f3ee4142970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:49.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.089+0000 7f3ee89bf700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3ee409b330 0x7f3ee40aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:49.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.089+0000 7f3ee89bf700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee413ce30 con 0x7f3ee413ca50 2020-05-18T21:37:49.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.089+0000 7f3ee89bf700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee41438a0 con 0x7f3ee409b330 2020-05-18T21:37:49.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.089+0000 7f3ee89bf700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee4142ec0 con 0x7f3ee40b50e0 2020-05-18T21:37:49.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.089+0000 7f3ee37fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3ee413ca50 0x7f3ee405ebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38514/0 (socket says 172.21.15.63:38514) 2020-05-18T21:37:49.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.089+0000 7f3ee37fe700 1 -- 172.21.15.63:0/1503854629 learned_addr learned my addr 172.21.15.63:0/1503854629 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:49.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.089+0000 7f3ee3fff700 1 --2- 172.21.15.63:0/1503854629 >> v2:172.21.15.63:3300/0 conn(0x7f3ee409b330 0x7f3ee40aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee2ffd700 1 --2- 172.21.15.63:0/1503854629 >> v2:172.21.15.155:3300/0 conn(0x7f3ee40b50e0 0x7f3ee4142970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.100 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee27fc700 1 -- 172.21.15.63:0/1503854629 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582640347 0 0) 0x7f3ee413ce30 con 0x7f3ee413ca50 2020-05-18T21:37:49.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee27fc700 1 -- 172.21.15.63:0/1503854629 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed0003270 con 0x7f3ee413ca50 2020-05-18T21:37:49.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee3fff700 1 -- 172.21.15.63:0/1503854629 >> v2:172.21.15.155:3300/0 conn(0x7f3ee40b50e0 msgr2=0x7f3ee4142970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:49.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee3fff700 1 --2- 172.21.15.63:0/1503854629 >> v2:172.21.15.155:3300/0 conn(0x7f3ee40b50e0 0x7f3ee4142970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:49.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee3fff700 1 -- 172.21.15.63:0/1503854629 >> v1:172.21.15.63:6789/0 conn(0x7f3ee413ca50 legacy=0x7f3ee405ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.101 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee27fc700 1 -- 172.21.15.63:0/1503854629 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3343656528 0 0) 0x7f3ed0003270 con 0x7f3ee413ca50 2020-05-18T21:37:49.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee3fff700 1 -- 172.21.15.63:0/1503854629 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee4143160 con 0x7f3ee409b330 2020-05-18T21:37:49.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee2ffd700 1 --2- 172.21.15.63:0/1503854629 >> v2:172.21.15.155:3300/0 conn(0x7f3ee40b50e0 0x7f3ee4142970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:49.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee3fff700 1 --2- 172.21.15.63:0/1503854629 >> v2:172.21.15.63:3300/0 conn(0x7f3ee409b330 0x7f3ee40aeba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3ed40018d0 tx=0x7f3edc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee3fff700 1 --2- 172.21.15.63:0/1503854629 >> v2:172.21.15.63:3300/0 conn(0x7f3ee409b330 0x7f3ee40aeba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3ed40018d0 tx=0x7f3edc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.102 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee3fff700 1 --2- 172.21.15.63:0/1503854629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ee409b330 0x7f3ee40aeba0 secure :-1 s=READY pgs=2079 cs=0 l=1 rx=0x7f3ed40018d0 tx=0x7f3edc007e00).ready entity=mon.0 client_cookie=6ffe5caf88f9683 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:49.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee3fff700 1 --2- 172.21.15.63:0/1503854629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ee409b330 0x7f3ee40aeba0 secure :-1 s=THROTTLE_DONE pgs=2079 cs=0 l=1 rx=0x7f3ed40018d0 tx=0x7f3edc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee27fc700 1 -- 172.21.15.63:0/1503854629 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ed4001730 con 0x7f3ee409b330 2020-05-18T21:37:49.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee3fff700 1 --2- 172.21.15.63:0/1503854629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ee409b330 0x7f3ee40aeba0 secure :-1 s=THROTTLE_DONE pgs=2079 cs=0 l=1 rx=0x7f3ed40018d0 tx=0x7f3edc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee27fc700 1 -- 172.21.15.63:0/1503854629 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc010a50 con 0x7f3ee409b330 2020-05-18T21:37:49.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee3fff700 1 --2- 172.21.15.63:0/1503854629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ee409b330 0x7f3ee40aeba0 secure :-1 s=THROTTLE_DONE pgs=2079 cs=0 l=1 rx=0x7f3ed40018d0 tx=0x7f3edc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee27fc700 1 -- 172.21.15.63:0/1503854629 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3edc010df0 con 0x7f3ee409b330 2020-05-18T21:37:49.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee89bf700 1 -- 172.21.15.63:0/1503854629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ee409b330 msgr2=0x7f3ee40aeba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee89bf700 1 --2- 172.21.15.63:0/1503854629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ee409b330 0x7f3ee40aeba0 secure :-1 s=READY pgs=2079 cs=0 l=1 rx=0x7f3ed40018d0 tx=0x7f3edc007e00).stop 2020-05-18T21:37:49.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee89bf700 1 -- 172.21.15.63:0/1503854629 shutdown_connections 2020-05-18T21:37:49.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee89bf700 1 --2- 172.21.15.63:0/1503854629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ee409b330 0x7f3ee40aeba0 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:49.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee89bf700 1 --2- 172.21.15.63:0/1503854629 >> v2:172.21.15.155:3300/0 conn(0x7f3ee40b50e0 0x7f3ee4142970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:49.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee89bf700 1 -- 172.21.15.63:0/1503854629 >> 172.21.15.63:0/1503854629 conn(0x7f3ee40b8b10 msgr2=0x7f3ee40b8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:49.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee89bf700 1 -- 172.21.15.63:0/1503854629 shutdown_connections 2020-05-18T21:37:49.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee89bf700 1 -- 172.21.15.63:0/1503854629 wait complete. 2020-05-18T21:37:49.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.093+0000 7f3ee89bf700 1 Processor -- start 2020-05-18T21:37:49.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee89bf700 1 -- start start 2020-05-18T21:37:49.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee89bf700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee409b330 0x7f3ee41547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:49.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee89bf700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee409c1e0 con 0x7f3ee413ca50 2020-05-18T21:37:49.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee89bf700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee409c480 con 0x7f3ee40b50e0 2020-05-18T21:37:49.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee89bf700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee409c000 con 0x7f3ee409b330 2020-05-18T21:37:49.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee3fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3ee413ca50 0x7f3ee413ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38522/0 (socket says 172.21.15.63:38522) 2020-05-18T21:37:49.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee3fff700 1 -- 172.21.15.63:0/1411257477 learned_addr learned my addr 172.21.15.63:0/1411257477 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:49.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee37fe700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee409b330 0x7f3ee41547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee0ff9700 1 -- 172.21.15.63:0/1411257477 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348663515 0 0) 0x7f3ee409c1e0 con 0x7f3ee413ca50 2020-05-18T21:37:49.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee0ff9700 1 -- 172.21.15.63:0/1411257477 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ec4002fe0 con 0x7f3ee413ca50 2020-05-18T21:37:49.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee0ff9700 1 -- 172.21.15.63:0/1411257477 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937162386 0 0) 0x7f3ee409c480 con 0x7f3ee40b50e0 2020-05-18T21:37:49.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee0ff9700 1 -- 172.21.15.63:0/1411257477 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ee409c1e0 con 0x7f3ee40b50e0 2020-05-18T21:37:49.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee37fe700 1 -- 172.21.15.63:0/1411257477 >> v1:172.21.15.155:6789/0 conn(0x7f3ee40b50e0 legacy=0x7f3ee413bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee37fe700 1 -- 172.21.15.63:0/1411257477 >> v1:172.21.15.63:6789/0 conn(0x7f3ee413ca50 legacy=0x7f3ee413ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee37fe700 1 -- 172.21.15.63:0/1411257477 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee413c460 con 0x7f3ee409b330 2020-05-18T21:37:49.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee37fe700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee409b330 0x7f3ee41547f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ed4001990 tx=0x7f3ed4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee37fe700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee409b330 0x7f3ee41547f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ed4001990 tx=0x7f3ed4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee37fe700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee409b330 0x7f3ee41547f0 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7f3ed4001990 tx=0x7f3ed4010c30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:49.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee37fe700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee409b330 0x7f3ee41547f0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f3ed4001990 tx=0x7f3ed4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee0ff9700 1 -- 172.21.15.63:0/1411257477 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ed400c960 con 0x7f3ee409b330 2020-05-18T21:37:49.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee37fe700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee409b330 0x7f3ee41547f0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f3ed4001990 tx=0x7f3ed4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee0ff9700 1 -- 172.21.15.63:0/1411257477 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed400cac0 con 0x7f3ee409b330 2020-05-18T21:37:49.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee37fe700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee409b330 0x7f3ee41547f0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f3ed4001990 tx=0x7f3ed4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee89bf700 1 -- 172.21.15.63:0/1411257477 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee413d6f0 con 0x7f3ee409b330 2020-05-18T21:37:49.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee0ff9700 1 -- 172.21.15.63:0/1411257477 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ed400ce20 con 0x7f3ee409b330 2020-05-18T21:37:49.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.097+0000 7f3ee89bf700 1 -- 172.21.15.63:0/1411257477 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee409bcb0 con 0x7f3ee409b330 2020-05-18T21:37:49.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.101+0000 7f3ee89bf700 1 -- 172.21.15.63:0/1411257477 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee409c640 con 0x7f3ee409b330 2020-05-18T21:37:49.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.101+0000 7f3ee37fe700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee409b330 0x7f3ee41547f0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f3ed4001990 tx=0x7f3ed4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.101+0000 7f3ee0ff9700 1 -- 172.21.15.63:0/1411257477 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3ed40101e0 con 0x7f3ee409b330 2020-05-18T21:37:49.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.101+0000 7f3ee37fe700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee409b330 0x7f3ee41547f0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f3ed4001990 tx=0x7f3ed4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.101+0000 7f3ee0ff9700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3ec404fe80 0x7f3ec4052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:49.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.101+0000 7f3ee0ff9700 1 -- 172.21.15.63:0/1411257477 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3ed4063b40 con 0x7f3ee409b330 2020-05-18T21:37:49.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.101+0000 7f3ee2ffd700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3ec404fe80 0x7f3ec4052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.101+0000 7f3ee2ffd700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3ec404fe80 0x7f3ec4052340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ed8007760 tx=0x7f3ed8009b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.101+0000 7f3ee2ffd700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3ec404fe80 0x7f3ec4052340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ed8007760 tx=0x7f3ed8009b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.101+0000 7f3ee2ffd700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3ec404fe80 0x7f3ec4052340 secure :-1 s=READY pgs=815 cs=0 l=1 rx=0x7f3ed8007760 tx=0x7f3ed8009b30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:49.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.109+0000 7f3ee37fe700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee409b330 0x7f3ee41547f0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f3ed4001990 tx=0x7f3ed4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.109+0000 7f3ee0ff9700 1 -- 172.21.15.63:0/1411257477 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3ed403df90 con 0x7f3ee409b330 2020-05-18T21:37:49.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.225+0000 7f3ee89bf700 1 -- 172.21.15.63:0/1411257477 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3ee40569e0 con 0x7f3ee409b330 2020-05-18T21:37:49.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.229+0000 7f3ee37fe700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee409b330 0x7f3ee41547f0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f3ed4001990 tx=0x7f3ed4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.229+0000 7f3ee0ff9700 1 -- 172.21.15.63:0/1411257477 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v157) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3ed40415b0 con 0x7f3ee409b330 2020-05-18T21:37:49.234 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:37:49.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.229+0000 7f3ee89bf700 1 -- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3ec404fe80 msgr2=0x7f3ec4052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.229+0000 7f3ee89bf700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3ec404fe80 0x7f3ec4052340 secure :-1 s=READY pgs=815 cs=0 l=1 rx=0x7f3ed8007760 tx=0x7f3ed8009b30).stop 2020-05-18T21:37:49.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.229+0000 7f3ee89bf700 1 -- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee409b330 msgr2=0x7f3ee41547f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.229+0000 7f3ee89bf700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee409b330 0x7f3ee41547f0 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7f3ed4001990 tx=0x7f3ed4010c30).stop 2020-05-18T21:37:49.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.229+0000 7f3ee89bf700 1 -- 172.21.15.63:0/1411257477 shutdown_connections 2020-05-18T21:37:49.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.229+0000 7f3ee89bf700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3ec404fe80 0x7f3ec4052340 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:49.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.229+0000 7f3ee89bf700 1 --2- 172.21.15.63:0/1411257477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee409b330 0x7f3ee41547f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:49.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.229+0000 7f3ee89bf700 1 -- 172.21.15.63:0/1411257477 >> 172.21.15.63:0/1411257477 conn(0x7f3ee40b8b10 msgr2=0x7f3ee40b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:49.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.229+0000 7f3ee89bf700 1 -- 172.21.15.63:0/1411257477 shutdown_connections 2020-05-18T21:37:49.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.229+0000 7f3ee89bf700 1 -- 172.21.15.63:0/1411257477 wait complete. 2020-05-18T21:37:49.246 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:37:49.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.345+0000 7f715dad6700 1 Processor -- start 2020-05-18T21:37:49.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.345+0000 7f715dad6700 1 -- start start 2020-05-18T21:37:49.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.345+0000 7f715dad6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f71581458b0 0x7f7158063770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:49.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.345+0000 7f715dad6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71580b5c90 0x7f71580b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:49.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.345+0000 7f715dad6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71580a0680 con 0x7f715806a690 2020-05-18T21:37:49.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.345+0000 7f715dad6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71580b42c0 con 0x7f71581458b0 2020-05-18T21:37:49.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.345+0000 7f715dad6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71580b4560 con 0x7f71580b5c90 2020-05-18T21:37:49.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.345+0000 7f714ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f715806a690 0x7f71580b38a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38528/0 (socket says 172.21.15.63:38528) 2020-05-18T21:37:49.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.345+0000 7f714ffff700 1 -- 172.21.15.63:0/3308440808 learned_addr learned my addr 172.21.15.63:0/3308440808 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:49.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.345+0000 7f715cad4700 1 --2- 172.21.15.63:0/3308440808 >> v2:172.21.15.155:3300/0 conn(0x7f71581458b0 0x7f7158063770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.345+0000 7f715d2d5700 1 --2- 172.21.15.63:0/3308440808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71580b5c90 0x7f71580b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f714f7fe700 1 -- 172.21.15.63:0/3308440808 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212430637 0 0) 0x7f71580a0680 con 0x7f715806a690 2020-05-18T21:37:49.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f714f7fe700 1 -- 172.21.15.63:0/3308440808 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7144003270 con 0x7f715806a690 2020-05-18T21:37:49.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715cad4700 1 -- 172.21.15.63:0/3308440808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71580b5c90 msgr2=0x7f71580b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:49.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715cad4700 1 --2- 172.21.15.63:0/3308440808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71580b5c90 0x7f71580b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:49.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715cad4700 1 -- 172.21.15.63:0/3308440808 >> v1:172.21.15.63:6789/0 conn(0x7f715806a690 legacy=0x7f71580b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715cad4700 1 -- 172.21.15.63:0/3308440808 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71580b3fb0 con 0x7f71581458b0 2020-05-18T21:37:49.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715cad4700 1 --2- 172.21.15.63:0/3308440808 >> v2:172.21.15.155:3300/0 conn(0x7f71581458b0 0x7f7158063770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7154002f70 tx=0x7f7154007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715cad4700 1 --2- 172.21.15.63:0/3308440808 >> v2:172.21.15.155:3300/0 conn(0x7f71581458b0 0x7f7158063770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7154002f70 tx=0x7f7154007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715cad4700 1 --2- 172.21.15.63:0/3308440808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71581458b0 0x7f7158063770 secure :-1 s=READY pgs=1383 cs=0 l=1 rx=0x7f7154002f70 tx=0x7f7154007a80).ready entity=mon.1 client_cookie=29990fb0594646d7 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:49.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715cad4700 1 --2- 172.21.15.63:0/3308440808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71581458b0 0x7f7158063770 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7f7154002f70 tx=0x7f7154007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f714f7fe700 1 -- 172.21.15.63:0/3308440808 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7154008e80 con 0x7f71581458b0 2020-05-18T21:37:49.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715cad4700 1 --2- 172.21.15.63:0/3308440808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71581458b0 0x7f7158063770 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7f7154002f70 tx=0x7f7154007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f714f7fe700 1 -- 172.21.15.63:0/3308440808 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7154011540 con 0x7f71581458b0 2020-05-18T21:37:49.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715cad4700 1 --2- 172.21.15.63:0/3308440808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71581458b0 0x7f7158063770 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7f7154002f70 tx=0x7f7154007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f714f7fe700 1 -- 172.21.15.63:0/3308440808 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7154011960 con 0x7f71581458b0 2020-05-18T21:37:49.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715dad6700 1 -- 172.21.15.63:0/3308440808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71581458b0 msgr2=0x7f7158063770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715dad6700 1 --2- 172.21.15.63:0/3308440808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71581458b0 0x7f7158063770 secure :-1 s=READY pgs=1383 cs=0 l=1 rx=0x7f7154002f70 tx=0x7f7154007a80).stop 2020-05-18T21:37:49.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715dad6700 1 -- 172.21.15.63:0/3308440808 shutdown_connections 2020-05-18T21:37:49.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715dad6700 1 --2- 172.21.15.63:0/3308440808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71580b5c90 0x7f71580b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:49.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715dad6700 1 --2- 172.21.15.63:0/3308440808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71581458b0 0x7f7158063770 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:49.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715dad6700 1 -- 172.21.15.63:0/3308440808 >> 172.21.15.63:0/3308440808 conn(0x7f715805fbd0 msgr2=0x7f7158069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:49.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715dad6700 1 -- 172.21.15.63:0/3308440808 shutdown_connections 2020-05-18T21:37:49.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715dad6700 1 -- 172.21.15.63:0/3308440808 wait complete. 2020-05-18T21:37:49.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715dad6700 1 Processor -- start 2020-05-18T21:37:49.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.349+0000 7f715dad6700 1 -- start start 2020-05-18T21:37:49.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715dad6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f715806a690 0x7f7158153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:49.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715dad6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f71580b5c90 0x7f7158152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:49.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715dad6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7158154080 con 0x7f71581458b0 2020-05-18T21:37:49.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715dad6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7158140880 con 0x7f715806a690 2020-05-18T21:37:49.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715dad6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7158153240 con 0x7f71580b5c90 2020-05-18T21:37:49.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715cad4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f715806a690 0x7f7158153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715cad4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f715806a690 0x7f7158153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36344/0 (socket says 172.21.15.63:36344) 2020-05-18T21:37:49.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715cad4700 1 -- 172.21.15.63:0/3012487509 learned_addr learned my addr 172.21.15.63:0/3012487509 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:49.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f714ffff700 1 --2- 172.21.15.63:0/3012487509 >> v2:172.21.15.155:3300/0 conn(0x7f71580b5c90 0x7f7158152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715cad4700 1 -- 172.21.15.63:0/3012487509 >> v2:172.21.15.155:3300/0 conn(0x7f71580b5c90 msgr2=0x7f7158152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715cad4700 1 --2- 172.21.15.63:0/3012487509 >> v2:172.21.15.155:3300/0 conn(0x7f71580b5c90 0x7f7158152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:49.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715cad4700 1 -- 172.21.15.63:0/3012487509 >> v1:172.21.15.155:6789/0 conn(0x7f71581458b0 legacy=0x7f715809e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715cad4700 1 -- 172.21.15.63:0/3012487509 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71581534e0 con 0x7f715806a690 2020-05-18T21:37:49.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f714ffff700 1 --2- 172.21.15.63:0/3012487509 >> v2:172.21.15.155:3300/0 conn(0x7f71580b5c90 0x7f7158152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:37:49.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715cad4700 1 --2- 172.21.15.63:0/3012487509 >> v2:172.21.15.63:3300/0 conn(0x7f715806a690 0x7f7158153c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7154002f70 tx=0x7f7154007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715cad4700 1 --2- 172.21.15.63:0/3012487509 >> v2:172.21.15.63:3300/0 conn(0x7f715806a690 0x7f7158153c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7154002f70 tx=0x7f7154007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715cad4700 1 --2- 172.21.15.63:0/3012487509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f715806a690 0x7f7158153c20 secure :-1 s=READY pgs=2082 cs=0 l=1 rx=0x7f7154002f70 tx=0x7f7154007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:49.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715cad4700 1 --2- 172.21.15.63:0/3012487509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f715806a690 0x7f7158153c20 secure :-1 s=THROTTLE_DONE pgs=2082 cs=0 l=1 rx=0x7f7154002f70 tx=0x7f7154007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f714dffb700 1 -- 172.21.15.63:0/3012487509 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7154007170 con 0x7f715806a690 2020-05-18T21:37:49.369 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715cad4700 1 --2- 172.21.15.63:0/3012487509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f715806a690 0x7f7158153c20 secure :-1 s=THROTTLE_DONE pgs=2082 cs=0 l=1 rx=0x7f7154002f70 tx=0x7f7154007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715cad4700 1 --2- 172.21.15.63:0/3012487509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f715806a690 0x7f7158153c20 secure :-1 s=THROTTLE_DONE pgs=2082 cs=0 l=1 rx=0x7f7154002f70 tx=0x7f7154007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f714dffb700 1 -- 172.21.15.63:0/3012487509 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71540072d0 con 0x7f715806a690 2020-05-18T21:37:49.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715dad6700 1 -- 172.21.15.63:0/3012487509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7158153780 con 0x7f715806a690 2020-05-18T21:37:49.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f714dffb700 1 -- 172.21.15.63:0/3012487509 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7154005700 con 0x7f715806a690 2020-05-18T21:37:49.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715dad6700 1 -- 172.21.15.63:0/3012487509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71580ba670 con 0x7f715806a690 2020-05-18T21:37:49.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715cad4700 1 --2- 172.21.15.63:0/3012487509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f715806a690 0x7f7158153c20 secure :-1 s=THROTTLE_DONE pgs=2082 cs=0 l=1 rx=0x7f7154002f70 tx=0x7f7154007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715dad6700 1 -- 172.21.15.63:0/3012487509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7158153080 con 0x7f715806a690 2020-05-18T21:37:49.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f714dffb700 1 -- 172.21.15.63:0/3012487509 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7154005970 con 0x7f715806a690 2020-05-18T21:37:49.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f715cad4700 1 --2- 172.21.15.63:0/3012487509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f715806a690 0x7f7158153c20 secure :-1 s=THROTTLE_DONE pgs=2082 cs=0 l=1 rx=0x7f7154002f70 tx=0x7f7154007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.353+0000 7f714dffb700 1 --2- 172.21.15.63:0/3012487509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f713804f9c0 0x7f7138051e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:49.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.357+0000 7f714dffb700 1 -- 172.21.15.63:0/3012487509 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f71540646c0 con 0x7f715806a690 2020-05-18T21:37:49.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.357+0000 7f714ffff700 1 --2- 172.21.15.63:0/3012487509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f713804f9c0 0x7f7138051e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.357+0000 7f714ffff700 1 --2- 172.21.15.63:0/3012487509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f713804f9c0 0x7f7138051e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7148001110 tx=0x7f7148001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.357+0000 7f714ffff700 1 --2- 172.21.15.63:0/3012487509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f713804f9c0 0x7f7138051e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7148001110 tx=0x7f7148001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.357+0000 7f714ffff700 1 --2- 172.21.15.63:0/3012487509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f713804f9c0 0x7f7138051e80 secure :-1 s=READY pgs=816 cs=0 l=1 rx=0x7f7148001110 tx=0x7f7148001840).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:49.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.361+0000 7f715cad4700 1 --2- 172.21.15.63:0/3012487509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f715806a690 0x7f7158153c20 secure :-1 s=THROTTLE_DONE pgs=2082 cs=0 l=1 rx=0x7f7154002f70 tx=0x7f7154007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.361+0000 7f714dffb700 1 -- 172.21.15.63:0/3012487509 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f715403ea50 con 0x7f715806a690 2020-05-18T21:37:49.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.477+0000 7f715dad6700 1 -- 172.21.15.63:0/3012487509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7158153980 con 0x7f715806a690 2020-05-18T21:37:49.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.477+0000 7f715cad4700 1 --2- 172.21.15.63:0/3012487509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f715806a690 0x7f7158153c20 secure :-1 s=THROTTLE_DONE pgs=2082 cs=0 l=1 rx=0x7f7154002f70 tx=0x7f7154007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.477+0000 7f714dffb700 1 -- 172.21.15.63:0/3012487509 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v157) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7158153980 con 0x7f715806a690 2020-05-18T21:37:49.484 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:37:49.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.481+0000 7f715dad6700 1 -- 172.21.15.63:0/3012487509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f713804f9c0 msgr2=0x7f7138051e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.481+0000 7f715dad6700 1 --2- 172.21.15.63:0/3012487509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f713804f9c0 0x7f7138051e80 secure :-1 s=READY pgs=816 cs=0 l=1 rx=0x7f7148001110 tx=0x7f7148001840).stop 2020-05-18T21:37:49.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.481+0000 7f715dad6700 1 -- 172.21.15.63:0/3012487509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f715806a690 msgr2=0x7f7158153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.481+0000 7f715dad6700 1 --2- 172.21.15.63:0/3012487509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f715806a690 0x7f7158153c20 secure :-1 s=READY pgs=2082 cs=0 l=1 rx=0x7f7154002f70 tx=0x7f7154007a80).stop 2020-05-18T21:37:49.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.481+0000 7f715dad6700 1 -- 172.21.15.63:0/3012487509 shutdown_connections 2020-05-18T21:37:49.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.481+0000 7f715dad6700 1 --2- 172.21.15.63:0/3012487509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f713804f9c0 0x7f7138051e80 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:49.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.481+0000 7f715dad6700 1 --2- 172.21.15.63:0/3012487509 >> v2:172.21.15.155:3300/0 conn(0x7f71580b5c90 0x7f7158152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:49.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.481+0000 7f715dad6700 1 --2- 172.21.15.63:0/3012487509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f715806a690 0x7f7158153c20 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:49.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.481+0000 7f715dad6700 1 -- 172.21.15.63:0/3012487509 >> 172.21.15.63:0/3012487509 conn(0x7f715805fbd0 msgr2=0x7f71580b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:49.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.481+0000 7f715dad6700 1 -- 172.21.15.63:0/3012487509 shutdown_connections 2020-05-18T21:37:49.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.481+0000 7f715dad6700 1 -- 172.21.15.63:0/3012487509 wait complete. 2020-05-18T21:37:49.498 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:37:49.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbe973700 1 Processor -- start 2020-05-18T21:37:49.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbe973700 1 -- start start 2020-05-18T21:37:49.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbe973700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fb80b4f40 0x7f4fb8061180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:49.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbe973700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4fb806a2c0 0x7f4fb8132360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:49.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbe973700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4fb81327c0 0x7f4fb814d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:49.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbe973700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb8132c70 con 0x7f4fb81327c0 2020-05-18T21:37:49.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbe973700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb806a7d0 con 0x7f4fb806a2c0 2020-05-18T21:37:49.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbe973700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80b2a10 con 0x7f4fb80b4f40 2020-05-18T21:37:49.612 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbe172700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4fb81327c0 0x7f4fb814d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbd170700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4fb806a2c0 0x7f4fb8132360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbe172700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4fb81327c0 0x7f4fb814d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36356/0 (socket says 172.21.15.63:36356) 2020-05-18T21:37:49.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbd971700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fb80b4f40 0x7f4fb8061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbe172700 1 -- 172.21.15.63:0/2312924841 learned_addr learned my addr 172.21.15.63:0/2312924841 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:49.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbd170700 1 -- 172.21.15.63:0/2312924841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fb80b4f40 msgr2=0x7f4fb8061180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:49.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbd170700 1 --2- 172.21.15.63:0/2312924841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fb80b4f40 0x7f4fb8061180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:49.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbd170700 1 -- 172.21.15.63:0/2312924841 >> v2:172.21.15.63:3300/0 conn(0x7f4fb81327c0 msgr2=0x7f4fb814d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:49.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbd170700 1 --2- 172.21.15.63:0/2312924841 >> v2:172.21.15.63:3300/0 conn(0x7f4fb81327c0 0x7f4fb814d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:49.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbd170700 1 -- 172.21.15.63:0/2312924841 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb80b5320 con 0x7f4fb806a2c0 2020-05-18T21:37:49.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbe172700 1 --2- 172.21.15.63:0/2312924841 >> v2:172.21.15.63:3300/0 conn(0x7f4fb81327c0 0x7f4fb814d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:49.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbd170700 1 --2- 172.21.15.63:0/2312924841 >> v2:172.21.15.155:3300/0 conn(0x7f4fb806a2c0 0x7f4fb8132360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4fac002f70 tx=0x7f4fac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbd170700 1 --2- 172.21.15.63:0/2312924841 >> v2:172.21.15.155:3300/0 conn(0x7f4fb806a2c0 0x7f4fb8132360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4fac002f70 tx=0x7f4fac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbd170700 1 --2- 172.21.15.63:0/2312924841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb806a2c0 0x7f4fb8132360 secure :-1 s=READY pgs=1385 cs=0 l=1 rx=0x7f4fac002f70 tx=0x7f4fac007a80).ready entity=mon.1 client_cookie=7a5fff1a7f4c12ee server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbd170700 1 --2- 172.21.15.63:0/2312924841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb806a2c0 0x7f4fb8132360 secure :-1 s=THROTTLE_DONE pgs=1385 cs=0 l=1 rx=0x7f4fac002f70 tx=0x7f4fac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbd170700 1 --2- 172.21.15.63:0/2312924841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb806a2c0 0x7f4fb8132360 secure :-1 s=THROTTLE_DONE pgs=1385 cs=0 l=1 rx=0x7f4fac002f70 tx=0x7f4fac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbc96f700 1 -- 172.21.15.63:0/2312924841 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fac008e50 con 0x7f4fb806a2c0 2020-05-18T21:37:49.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbd170700 1 --2- 172.21.15.63:0/2312924841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb806a2c0 0x7f4fb8132360 secure :-1 s=THROTTLE_DONE pgs=1385 cs=0 l=1 rx=0x7f4fac002f70 tx=0x7f4fac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbc96f700 1 -- 172.21.15.63:0/2312924841 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac011540 con 0x7f4fb806a2c0 2020-05-18T21:37:49.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbe973700 1 -- 172.21.15.63:0/2312924841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb806a2c0 msgr2=0x7f4fb8132360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbc96f700 1 -- 172.21.15.63:0/2312924841 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fac011960 con 0x7f4fb806a2c0 2020-05-18T21:37:49.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.605+0000 7f4fbe973700 1 --2- 172.21.15.63:0/2312924841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb806a2c0 0x7f4fb8132360 secure :-1 s=READY pgs=1385 cs=0 l=1 rx=0x7f4fac002f70 tx=0x7f4fac007a80).stop 2020-05-18T21:37:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.609+0000 7f4fbe973700 1 -- 172.21.15.63:0/2312924841 shutdown_connections 2020-05-18T21:37:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.609+0000 7f4fbe973700 1 --2- 172.21.15.63:0/2312924841 >> v2:172.21.15.63:3300/0 conn(0x7f4fb81327c0 0x7f4fb814d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.609+0000 7f4fbe973700 1 --2- 172.21.15.63:0/2312924841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb806a2c0 0x7f4fb8132360 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.609+0000 7f4fbe973700 1 --2- 172.21.15.63:0/2312924841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fb80b4f40 0x7f4fb8061180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.609+0000 7f4fbe973700 1 -- 172.21.15.63:0/2312924841 >> 172.21.15.63:0/2312924841 conn(0x7f4fb805fbd0 msgr2=0x7f4fb8069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.609+0000 7f4fbe973700 1 -- 172.21.15.63:0/2312924841 shutdown_connections 2020-05-18T21:37:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.609+0000 7f4fbe973700 1 -- 172.21.15.63:0/2312924841 wait complete. 2020-05-18T21:37:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.609+0000 7f4fbe973700 1 Processor -- start 2020-05-18T21:37:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.609+0000 7f4fbe973700 1 -- start start 2020-05-18T21:37:49.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.609+0000 7f4fbe973700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4fb80b4f40 0x7f4fb8149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:49.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.609+0000 7f4fbe973700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb8130f40 con 0x7f4fb806a2c0 2020-05-18T21:37:49.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.609+0000 7f4fbe973700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb81496e0 con 0x7f4fb81327c0 2020-05-18T21:37:49.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.609+0000 7f4fbe973700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb815ae90 con 0x7f4fb80b4f40 2020-05-18T21:37:49.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.609+0000 7f4fbd971700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4fb806a2c0 0x7f4fb80af740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38546/0 (socket says 172.21.15.63:38546) 2020-05-18T21:37:49.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.609+0000 7f4fbd971700 1 -- 172.21.15.63:0/2974356028 learned_addr learned my addr 172.21.15.63:0/2974356028 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:49.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.609+0000 7f4fbd170700 1 --2- 172.21.15.63:0/2974356028 >> v2:172.21.15.155:3300/0 conn(0x7f4fb80b4f40 0x7f4fb8149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fab7fe700 1 -- 172.21.15.63:0/2974356028 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901576415 0 0) 0x7f4fb8130f40 con 0x7f4fb806a2c0 2020-05-18T21:37:49.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fab7fe700 1 -- 172.21.15.63:0/2974356028 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f94002fe0 con 0x7f4fb806a2c0 2020-05-18T21:37:49.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fbd170700 1 -- 172.21.15.63:0/2974356028 >> v1:172.21.15.155:6789/0 conn(0x7f4fb81327c0 legacy=0x7f4fb80b71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fbd170700 1 -- 172.21.15.63:0/2974356028 >> v1:172.21.15.63:6789/0 conn(0x7f4fb806a2c0 legacy=0x7f4fb80af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fab7fe700 1 -- 172.21.15.63:0/2974356028 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 558016894 0 0) 0x7f4fb81496e0 con 0x7f4fb81327c0 2020-05-18T21:37:49.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fbd170700 1 -- 172.21.15.63:0/2974356028 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb815b130 con 0x7f4fb80b4f40 2020-05-18T21:37:49.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fbd170700 1 --2- 172.21.15.63:0/2974356028 >> v2:172.21.15.155:3300/0 conn(0x7f4fb80b4f40 0x7f4fb8149280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4fac002f70 tx=0x7f4fac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fbd170700 1 --2- 172.21.15.63:0/2974356028 >> v2:172.21.15.155:3300/0 conn(0x7f4fb80b4f40 0x7f4fb8149280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4fac002f70 tx=0x7f4fac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fbd170700 1 --2- 172.21.15.63:0/2974356028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb80b4f40 0x7f4fb8149280 secure :-1 s=READY pgs=1387 cs=0 l=1 rx=0x7f4fac002f70 tx=0x7f4fac007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:49.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fbd170700 1 --2- 172.21.15.63:0/2974356028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb80b4f40 0x7f4fb8149280 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f4fac002f70 tx=0x7f4fac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fbd170700 1 --2- 172.21.15.63:0/2974356028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb80b4f40 0x7f4fb8149280 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f4fac002f70 tx=0x7f4fac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fab7fe700 1 -- 172.21.15.63:0/2974356028 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fac011dd0 con 0x7f4fb80b4f40 2020-05-18T21:37:49.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fbd170700 1 --2- 172.21.15.63:0/2974356028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb80b4f40 0x7f4fb8149280 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f4fac002f70 tx=0x7f4fac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fab7fe700 1 -- 172.21.15.63:0/2974356028 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac007170 con 0x7f4fb80b4f40 2020-05-18T21:37:49.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fbe973700 1 -- 172.21.15.63:0/2974356028 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb815b3d0 con 0x7f4fb80b4f40 2020-05-18T21:37:49.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fab7fe700 1 -- 172.21.15.63:0/2974356028 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fac0074d0 con 0x7f4fb80b4f40 2020-05-18T21:37:49.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fbe973700 1 -- 172.21.15.63:0/2974356028 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb815b8f0 con 0x7f4fb80b4f40 2020-05-18T21:37:49.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fbd170700 1 --2- 172.21.15.63:0/2974356028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb80b4f40 0x7f4fb8149280 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f4fac002f70 tx=0x7f4fac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fbe973700 1 -- 172.21.15.63:0/2974356028 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb80569e0 con 0x7f4fb80b4f40 2020-05-18T21:37:49.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fab7fe700 1 -- 172.21.15.63:0/2974356028 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4fac005700 con 0x7f4fb80b4f40 2020-05-18T21:37:49.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.613+0000 7f4fbd170700 1 --2- 172.21.15.63:0/2974356028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb80b4f40 0x7f4fb8149280 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f4fac002f70 tx=0x7f4fac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.617+0000 7f4fab7fe700 1 --2- 172.21.15.63:0/2974356028 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f9404fcc0 0x7f4f94052180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:49.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.617+0000 7f4fab7fe700 1 -- 172.21.15.63:0/2974356028 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4fac064220 con 0x7f4fb80b4f40 2020-05-18T21:37:49.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.617+0000 7f4fbd971700 1 --2- 172.21.15.63:0/2974356028 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f9404fcc0 0x7f4f94052180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.617+0000 7f4fbd971700 1 --2- 172.21.15.63:0/2974356028 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f9404fcc0 0x7f4f94052180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4fb4002f70 tx=0x7f4fb40090d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.617+0000 7f4fbd971700 1 --2- 172.21.15.63:0/2974356028 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f9404fcc0 0x7f4f94052180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4fb4002f70 tx=0x7f4fb40090d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.631 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.617+0000 7f4fbd971700 1 --2- 172.21.15.63:0/2974356028 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f9404fcc0 0x7f4f94052180 secure :-1 s=READY pgs=817 cs=0 l=1 rx=0x7f4fb4002f70 tx=0x7f4fb40090d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:49.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.625+0000 7f4fbd170700 1 --2- 172.21.15.63:0/2974356028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb80b4f40 0x7f4fb8149280 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f4fac002f70 tx=0x7f4fac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.625+0000 7f4fab7fe700 1 -- 172.21.15.63:0/2974356028 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f4fac03e550 con 0x7f4fb80b4f40 2020-05-18T21:37:49.749 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.741+0000 7f4fbe973700 1 -- 172.21.15.63:0/2974356028 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4fb80b25a0 con 0x7f4fb80b4f40 2020-05-18T21:37:49.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.745+0000 7f4fbd170700 1 --2- 172.21.15.63:0/2974356028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb80b4f40 0x7f4fb8149280 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f4fac002f70 tx=0x7f4fac007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.745+0000 7f4fab7fe700 1 -- 172.21.15.63:0/2974356028 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v157) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4fac041b70 con 0x7f4fb80b4f40 2020-05-18T21:37:49.750 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:37:49.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.745+0000 7f4fbe973700 1 -- 172.21.15.63:0/2974356028 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f9404fcc0 msgr2=0x7f4f94052180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.745+0000 7f4fbe973700 1 --2- 172.21.15.63:0/2974356028 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f9404fcc0 0x7f4f94052180 secure :-1 s=READY pgs=817 cs=0 l=1 rx=0x7f4fb4002f70 tx=0x7f4fb40090d0).stop 2020-05-18T21:37:49.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.745+0000 7f4fbe973700 1 -- 172.21.15.63:0/2974356028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb80b4f40 msgr2=0x7f4fb8149280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.745+0000 7f4fbe973700 1 --2- 172.21.15.63:0/2974356028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb80b4f40 0x7f4fb8149280 secure :-1 s=READY pgs=1387 cs=0 l=1 rx=0x7f4fac002f70 tx=0x7f4fac007a80).stop 2020-05-18T21:37:49.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.745+0000 7f4fbe973700 1 -- 172.21.15.63:0/2974356028 shutdown_connections 2020-05-18T21:37:49.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.745+0000 7f4fbe973700 1 --2- 172.21.15.63:0/2974356028 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4f9404fcc0 0x7f4f94052180 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:49.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.745+0000 7f4fbe973700 1 --2- 172.21.15.63:0/2974356028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb80b4f40 0x7f4fb8149280 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:49.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.745+0000 7f4fbe973700 1 -- 172.21.15.63:0/2974356028 >> 172.21.15.63:0/2974356028 conn(0x7f4fb805fbd0 msgr2=0x7f4fb8131750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:49.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.745+0000 7f4fbe973700 1 -- 172.21.15.63:0/2974356028 shutdown_connections 2020-05-18T21:37:49.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.745+0000 7f4fbe973700 1 -- 172.21.15.63:0/2974356028 wait complete. 2020-05-18T21:37:49.764 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:37:49.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.865+0000 7efdf09bd700 1 Processor -- start 2020-05-18T21:37:49.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.865+0000 7efdf09bd700 1 -- start start 2020-05-18T21:37:49.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.865+0000 7efdf09bd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efdec0ad730 0x7efdec145570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:49.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.865+0000 7efdf09bd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdec05ebf0 0x7efdec1459d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:49.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.865+0000 7efdf09bd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdec0b39c0 con 0x7efdec060660 2020-05-18T21:37:49.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.865+0000 7efdf09bd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdec0b3bf0 con 0x7efdec0ad730 2020-05-18T21:37:49.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.865+0000 7efdf09bd700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0adb10 con 0x7efdec05ebf0 2020-05-18T21:37:49.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.865+0000 7efdead9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efdec0ad730 0x7efdec145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.865+0000 7efdead9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efdec0ad730 0x7efdec145570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36370/0 (socket says 172.21.15.63:36370) 2020-05-18T21:37:49.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.865+0000 7efdeb59e700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7efdec060660 0x7efdec060af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:36872/0 (socket says 172.21.15.63:36872) 2020-05-18T21:37:49.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.865+0000 7efdea59c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdec05ebf0 0x7efdec1459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.865+0000 7efdead9d700 1 -- 172.21.15.63:0/305133269 learned_addr learned my addr 172.21.15.63:0/305133269 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:49.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.865+0000 7efde9d9b700 1 -- 172.21.15.63:0/305133269 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056914064 0 0) 0x7efdec0b39c0 con 0x7efdec060660 2020-05-18T21:37:49.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.865+0000 7efde9d9b700 1 -- 172.21.15.63:0/305133269 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdcc003270 con 0x7efdec060660 2020-05-18T21:37:49.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.865+0000 7efdead9d700 1 -- 172.21.15.63:0/305133269 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdec05ebf0 msgr2=0x7efdec1459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:49.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.865+0000 7efdead9d700 1 --2- 172.21.15.63:0/305133269 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdec05ebf0 0x7efdec1459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:49.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.865+0000 7efdead9d700 1 -- 172.21.15.63:0/305133269 >> v1:172.21.15.155:6789/0 conn(0x7efdec060660 legacy=0x7efdec060af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efdead9d700 1 -- 172.21.15.63:0/305133269 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec0b2990 con 0x7efdec0ad730 2020-05-18T21:37:49.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efdead9d700 1 --2- 172.21.15.63:0/305133269 >> v2:172.21.15.63:3300/0 conn(0x7efdec0ad730 0x7efdec145570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efdd4002f70 tx=0x7efdd4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efdead9d700 1 --2- 172.21.15.63:0/305133269 >> v2:172.21.15.63:3300/0 conn(0x7efdec0ad730 0x7efdec145570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efdd4002f70 tx=0x7efdd4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efdead9d700 1 --2- 172.21.15.63:0/305133269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdec0ad730 0x7efdec145570 secure :-1 s=READY pgs=2084 cs=0 l=1 rx=0x7efdd4002f70 tx=0x7efdd4007a80).ready entity=mon.0 client_cookie=b17ea6871dd5fb47 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:49.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efdead9d700 1 --2- 172.21.15.63:0/305133269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdec0ad730 0x7efdec145570 secure :-1 s=THROTTLE_DONE pgs=2084 cs=0 l=1 rx=0x7efdd4002f70 tx=0x7efdd4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efde9d9b700 1 -- 172.21.15.63:0/305133269 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd4011600 con 0x7efdec0ad730 2020-05-18T21:37:49.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efdead9d700 1 --2- 172.21.15.63:0/305133269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdec0ad730 0x7efdec145570 secure :-1 s=THROTTLE_DONE pgs=2084 cs=0 l=1 rx=0x7efdd4002f70 tx=0x7efdd4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efde9d9b700 1 -- 172.21.15.63:0/305133269 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd4011760 con 0x7efdec0ad730 2020-05-18T21:37:49.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efdead9d700 1 --2- 172.21.15.63:0/305133269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdec0ad730 0x7efdec145570 secure :-1 s=THROTTLE_DONE pgs=2084 cs=0 l=1 rx=0x7efdd4002f70 tx=0x7efdd4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efdf09bd700 1 -- 172.21.15.63:0/305133269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdec0ad730 msgr2=0x7efdec145570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efde9d9b700 1 -- 172.21.15.63:0/305133269 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd4011b80 con 0x7efdec0ad730 2020-05-18T21:37:49.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efdf09bd700 1 --2- 172.21.15.63:0/305133269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdec0ad730 0x7efdec145570 secure :-1 s=READY pgs=2084 cs=0 l=1 rx=0x7efdd4002f70 tx=0x7efdd4007a80).stop 2020-05-18T21:37:49.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efdf09bd700 1 -- 172.21.15.63:0/305133269 shutdown_connections 2020-05-18T21:37:49.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efdf09bd700 1 --2- 172.21.15.63:0/305133269 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdec05ebf0 0x7efdec1459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:49.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efdf09bd700 1 --2- 172.21.15.63:0/305133269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdec0ad730 0x7efdec145570 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:49.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efdf09bd700 1 -- 172.21.15.63:0/305133269 >> 172.21.15.63:0/305133269 conn(0x7efdec05fb90 msgr2=0x7efdec069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:49.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efdf09bd700 1 -- 172.21.15.63:0/305133269 shutdown_connections 2020-05-18T21:37:49.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efdf09bd700 1 -- 172.21.15.63:0/305133269 wait complete. 2020-05-18T21:37:49.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efdf09bd700 1 Processor -- start 2020-05-18T21:37:49.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.869+0000 7efdf09bd700 1 -- start start 2020-05-18T21:37:49.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdf09bd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdec0ad730 0x7efdec0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:49.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdf09bd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdec0b0050 con 0x7efdec060660 2020-05-18T21:37:49.885 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdf09bd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdec0b02f0 con 0x7efdec05ebf0 2020-05-18T21:37:49.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdf09bd700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0b0590 con 0x7efdec0ad730 2020-05-18T21:37:49.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdea59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efdec060660 0x7efdec146e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38562/0 (socket says 172.21.15.63:38562) 2020-05-18T21:37:49.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdea59c700 1 -- 172.21.15.63:0/663428506 learned_addr learned my addr 172.21.15.63:0/663428506 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:49.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdeb59e700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdec0ad730 0x7efdec0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803340438 0 0) 0x7efdec0b0050 con 0x7efdec060660 2020-05-18T21:37:49.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdd0002fe0 con 0x7efdec060660 2020-05-18T21:37:49.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924064441 0 0) 0x7efdec0b02f0 con 0x7efdec05ebf0 2020-05-18T21:37:49.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdec0b0050 con 0x7efdec05ebf0 2020-05-18T21:37:49.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 39150430 0 0) 0x7efdd0002fe0 con 0x7efdec060660 2020-05-18T21:37:49.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efdec0b02f0 con 0x7efdec060660 2020-05-18T21:37:49.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7efddc0014d0 con 0x7efdec060660 2020-05-18T21:37:49.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdec0ad730 msgr2=0x7efdec0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdec0ad730 0x7efdec0b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:49.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 >> v1:172.21.15.155:6789/0 conn(0x7efdec05ebf0 legacy=0x7efdec13fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 >> v1:172.21.15.63:6789/0 conn(0x7efdec060660 legacy=0x7efdec146e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdd0004bf0 0x7efdd0004fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:49.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdec0ad730 0x7efdd0003880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:49.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd0003ce0 0x7efdd0004160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:49.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0b0590 con 0x7efdd0004bf0 2020-05-18T21:37:49.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00045c0 con 0x7efdd0003ce0 2020-05-18T21:37:49.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd000b760 con 0x7efdec0ad730 2020-05-18T21:37:49.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdead9d700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdd0004bf0 0x7efdd0004fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdea59c700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdec0ad730 0x7efdd0003880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdeb59e700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd0003ce0 0x7efdd0004160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdead9d700 1 -- 172.21.15.63:0/663428506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdec0ad730 msgr2=0x7efdd0003880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdead9d700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdec0ad730 0x7efdd0003880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:49.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdead9d700 1 -- 172.21.15.63:0/663428506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd0003ce0 msgr2=0x7efdd0004160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:49.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdead9d700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd0003ce0 0x7efdd0004160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:49.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdead9d700 1 -- 172.21.15.63:0/663428506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec140400 con 0x7efdd0004bf0 2020-05-18T21:37:49.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdead9d700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdd0004bf0 0x7efdd0004fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efdd4008500 tx=0x7efdd4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdf09bd700 1 -- 172.21.15.63:0/663428506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdec111c20 con 0x7efdd0004bf0 2020-05-18T21:37:49.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdead9d700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdd0004bf0 0x7efdd0004fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efdd4008500 tx=0x7efdd4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdead9d700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdd0004bf0 0x7efdd0004fd0 secure :-1 s=READY pgs=2086 cs=0 l=1 rx=0x7efdd4008500 tx=0x7efdd4007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:49.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdf09bd700 1 -- 172.21.15.63:0/663428506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdec0afdc0 con 0x7efdd0004bf0 2020-05-18T21:37:49.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdead9d700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdd0004bf0 0x7efdd0004fd0 secure :-1 s=THROTTLE_DONE pgs=2086 cs=0 l=1 rx=0x7efdd4008500 tx=0x7efdd4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd4007360 con 0x7efdd0004bf0 2020-05-18T21:37:49.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdead9d700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdd0004bf0 0x7efdd0004fd0 secure :-1 s=THROTTLE_DONE pgs=2086 cs=0 l=1 rx=0x7efdd4008500 tx=0x7efdd4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd4007500 con 0x7efdd0004bf0 2020-05-18T21:37:49.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdead9d700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdd0004bf0 0x7efdd0004fd0 secure :-1 s=THROTTLE_DONE pgs=2086 cs=0 l=1 rx=0x7efdd4008500 tx=0x7efdd4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd40058f0 con 0x7efdd0004bf0 2020-05-18T21:37:49.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdf09bd700 1 -- 172.21.15.63:0/663428506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdec0b2030 con 0x7efdd0004bf0 2020-05-18T21:37:49.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.873+0000 7efdead9d700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdd0004bf0 0x7efdd0004fd0 secure :-1 s=THROTTLE_DONE pgs=2086 cs=0 l=1 rx=0x7efdd4008500 tx=0x7efdd4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.877+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7efdd4005a50 con 0x7efdd0004bf0 2020-05-18T21:37:49.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.877+0000 7efdead9d700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdd0004bf0 0x7efdd0004fd0 secure :-1 s=THROTTLE_DONE pgs=2086 cs=0 l=1 rx=0x7efdd4008500 tx=0x7efdd4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.877+0000 7efde3fff700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdd0057ce0 0x7efdd005a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:49.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.877+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efdd4064170 con 0x7efdd0004bf0 2020-05-18T21:37:49.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.877+0000 7efdea59c700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdd0057ce0 0x7efdd005a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:49.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.877+0000 7efdea59c700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdd0057ce0 0x7efdd005a1a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efddc002f70 tx=0x7efddc001a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.877+0000 7efdea59c700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdd0057ce0 0x7efdd005a1a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efddc002f70 tx=0x7efddc001a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.877+0000 7efdea59c700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdd0057ce0 0x7efdd005a1a0 secure :-1 s=READY pgs=818 cs=0 l=1 rx=0x7efddc002f70 tx=0x7efddc001a70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:49.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.881+0000 7efdead9d700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdd0004bf0 0x7efdd0004fd0 secure :-1 s=THROTTLE_DONE pgs=2086 cs=0 l=1 rx=0x7efdd4008500 tx=0x7efdd4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:49.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.881+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7efdd403e620 con 0x7efdd0004bf0 2020-05-18T21:37:50.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.993+0000 7efdf09bd700 1 -- 172.21.15.63:0/663428506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efdec0569e0 con 0x7efdd0004bf0 2020-05-18T21:37:50.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.997+0000 7efdead9d700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdd0004bf0 0x7efdd0004fd0 secure :-1 s=THROTTLE_DONE pgs=2086 cs=0 l=1 rx=0x7efdd4008500 tx=0x7efdd4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:50.003 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.997+0000 7efde3fff700 1 -- 172.21.15.63:0/663428506 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v157) v1 ==== 100+0+10 (secure 0 0 0) 0x7efdd4041c40 con 0x7efdd0004bf0 2020-05-18T21:37:50.003 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:37:50.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.997+0000 7efdf09bd700 1 -- 172.21.15.63:0/663428506 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdd0057ce0 msgr2=0x7efdd005a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:50.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.997+0000 7efdf09bd700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efdd0057ce0 0x7efdd005a1a0 secure :-1 s=READY pgs=818 cs=0 l=1 rx=0x7efddc002f70 tx=0x7efddc001a70).stop 2020-05-18T21:37:50.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.997+0000 7efdf09bd700 1 -- 172.21.15.63:0/663428506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdd0004bf0 msgr2=0x7efdd0004fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:50.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.997+0000 7efdf09bd700 1 --2- 172.21.15.63:0/663428506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdd0004bf0 0x7efdd0004fd0 secure :-1 s=READY pgs=2086 cs=0 l=1 rx=0x7efdd4008500 tx=0x7efdd4007a80).stop 2020-05-18T21:37:50.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.997+0000 7efdeb59e700 1 -- 172.21.15.63:0/663428506 reap_dead start 2020-05-18T21:37:50.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.997+0000 7efdeb59e700 1 -- 172.21.15.63:0/663428506 reap_dead start 2020-05-18T21:37:50.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.997+0000 7efdf09bd700 1 -- 172.21.15.63:0/663428506 shutdown_connections 2020-05-18T21:37:50.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.997+0000 7efdf09bd700 1 -- 172.21.15.63:0/663428506 >> 172.21.15.63:0/663428506 conn(0x7efdec05fb90 msgr2=0x7efdec0b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:50.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.997+0000 7efdf09bd700 1 -- 172.21.15.63:0/663428506 shutdown_connections 2020-05-18T21:37:50.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:49.997+0000 7efdf09bd700 1 -- 172.21.15.63:0/663428506 wait complete. 2020-05-18T21:37:50.016 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:37:50.016 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:50.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173359e700 1 Processor -- start 2020-05-18T21:37:50.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173359e700 1 -- start start 2020-05-18T21:37:50.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173359e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1734062f30 0x7f1734061ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:50.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173359e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1734142a50 0x7f1734065890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:50.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173359e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1734143400 con 0x7f17340b6320 2020-05-18T21:37:50.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173359e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1734143220 con 0x7f1734062f30 2020-05-18T21:37:50.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173359e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17341436a0 con 0x7f1734142a50 2020-05-18T21:37:50.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173259c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f17340b6320 0x7f1734142340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38574/0 (socket says 172.21.15.63:38574) 2020-05-18T21:37:50.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173259c700 1 -- 172.21.15.63:0/3887247459 learned_addr learned my addr 172.21.15.63:0/3887247459 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:50.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1729d9b700 1 --2- 172.21.15.63:0/3887247459 >> v2:172.21.15.63:3300/0 conn(0x7f1734062f30 0x7f1734061ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:50.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1732d9d700 1 --2- 172.21.15.63:0/3887247459 >> v2:172.21.15.155:3300/0 conn(0x7f1734142a50 0x7f1734065890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:50.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1731d9b700 1 -- 172.21.15.63:0/3887247459 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419278224 0 0) 0x7f1734143400 con 0x7f17340b6320 2020-05-18T21:37:50.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1731d9b700 1 -- 172.21.15.63:0/3887247459 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1714003270 con 0x7f17340b6320 2020-05-18T21:37:50.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1731d9b700 1 -- 172.21.15.63:0/3887247459 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 117863032 0 0) 0x7f1714003270 con 0x7f17340b6320 2020-05-18T21:37:50.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1731d9b700 1 -- 172.21.15.63:0/3887247459 >> v2:172.21.15.155:3300/0 conn(0x7f1734142a50 msgr2=0x7f1734065890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:50.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1731d9b700 1 --2- 172.21.15.63:0/3887247459 >> v2:172.21.15.155:3300/0 conn(0x7f1734142a50 0x7f1734065890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:50.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1731d9b700 1 -- 172.21.15.63:0/3887247459 >> v2:172.21.15.63:3300/0 conn(0x7f1734062f30 msgr2=0x7f1734061ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:50.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1731d9b700 1 --2- 172.21.15.63:0/3887247459 >> v2:172.21.15.63:3300/0 conn(0x7f1734062f30 0x7f1734061ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:50.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1731d9b700 1 -- 172.21.15.63:0/3887247459 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1734142ea0 con 0x7f17340b6320 2020-05-18T21:37:50.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1731d9b700 1 -- 172.21.15.63:0/3887247459 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f1724001710 con 0x7f17340b6320 2020-05-18T21:37:50.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1731d9b700 1 -- 172.21.15.63:0/3887247459 >> v1:172.21.15.63:6789/0 conn(0x7f17340b6320 legacy=0x7f1734142340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:50.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1731d9b700 1 --2- 172.21.15.63:0/3887247459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1714003760 0x7f1714003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:50.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1731d9b700 1 --2- 172.21.15.63:0/3887247459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1714004510 0x7f1714004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:50.123 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1731d9b700 1 --2- 172.21.15.63:0/3887247459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1714004df0 0x7f171400b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1731d9b700 1 -- 172.21.15.63:0/3887247459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1734143220 con 0x7f1714003760 2020-05-18T21:37:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1731d9b700 1 -- 172.21.15.63:0/3887247459 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17341436a0 con 0x7f1714004df0 2020-05-18T21:37:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1731d9b700 1 -- 172.21.15.63:0/3887247459 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1714004280 con 0x7f1714004510 2020-05-18T21:37:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173259c700 1 --2- 172.21.15.63:0/3887247459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1714003760 0x7f1714003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1732d9d700 1 --2- 172.21.15.63:0/3887247459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1714004df0 0x7f171400b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1729d9b700 1 --2- 172.21.15.63:0/3887247459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1714004510 0x7f1714004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173259c700 1 -- 172.21.15.63:0/3887247459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1714004510 msgr2=0x7f1714004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173259c700 1 --2- 172.21.15.63:0/3887247459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1714004510 0x7f1714004990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173259c700 1 -- 172.21.15.63:0/3887247459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1714004df0 msgr2=0x7f171400b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173259c700 1 --2- 172.21.15.63:0/3887247459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1714004df0 0x7f171400b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1732d9d700 1 -- 172.21.15.63:0/3887247459 reap_dead start 2020-05-18T21:37:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173259c700 1 -- 172.21.15.63:0/3887247459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1714003270 con 0x7f1714003760 2020-05-18T21:37:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173259c700 1 --2- 172.21.15.63:0/3887247459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1714003760 0x7f1714003b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1724001420 tx=0x7f173405e7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173259c700 1 --2- 172.21.15.63:0/3887247459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1714003760 0x7f1714003b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1724001420 tx=0x7f173405e7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173259c700 1 --2- 172.21.15.63:0/3887247459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1714003760 0x7f1714003b80 secure :-1 s=READY pgs=2088 cs=0 l=1 rx=0x7f1724001420 tx=0x7f173405e7b0).ready entity=mon.0 client_cookie=41bd0dff3ed0d2bd server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173259c700 1 --2- 172.21.15.63:0/3887247459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1714003760 0x7f1714003b80 secure :-1 s=THROTTLE_DONE pgs=2088 cs=0 l=1 rx=0x7f1724001420 tx=0x7f173405e7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1731d9b700 1 -- 172.21.15.63:0/3887247459 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f172400ce20 con 0x7f1714003760 2020-05-18T21:37:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173259c700 1 --2- 172.21.15.63:0/3887247459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1714003760 0x7f1714003b80 secure :-1 s=THROTTLE_DONE pgs=2088 cs=0 l=1 rx=0x7f1724001420 tx=0x7f173405e7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173259c700 1 --2- 172.21.15.63:0/3887247459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1714003760 0x7f1714003b80 secure :-1 s=THROTTLE_DONE pgs=2088 cs=0 l=1 rx=0x7f1724001420 tx=0x7f173405e7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:50.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1731d9b700 1 -- 172.21.15.63:0/3887247459 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172400e370 con 0x7f1714003760 2020-05-18T21:37:50.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f1731d9b700 1 -- 172.21.15.63:0/3887247459 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f172400e710 con 0x7f1714003760 2020-05-18T21:37:50.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173359e700 1 -- 172.21.15.63:0/3887247459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1714003760 msgr2=0x7f1714003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:50.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.109+0000 7f173359e700 1 --2- 172.21.15.63:0/3887247459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1714003760 0x7f1714003b80 secure :-1 s=READY pgs=2088 cs=0 l=1 rx=0x7f1724001420 tx=0x7f173405e7b0).stop 2020-05-18T21:37:50.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f173359e700 1 -- 172.21.15.63:0/3887247459 shutdown_connections 2020-05-18T21:37:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f173359e700 1 --2- 172.21.15.63:0/3887247459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1714003760 0x7f1714003b80 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f173359e700 1 -- 172.21.15.63:0/3887247459 >> 172.21.15.63:0/3887247459 conn(0x7f173405a7c0 msgr2=0x7f173405abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f173359e700 1 -- 172.21.15.63:0/3887247459 shutdown_connections 2020-05-18T21:37:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f173359e700 1 -- 172.21.15.63:0/3887247459 wait complete. 2020-05-18T21:37:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f173359e700 1 Processor -- start 2020-05-18T21:37:50.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f173359e700 1 -- start start 2020-05-18T21:37:50.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f173359e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1734138190 0x7f1734132970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:50.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f173359e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1734132dd0 con 0x7f1714003760 2020-05-18T21:37:50.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f173359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17341370a0 con 0x7f17341344b0 2020-05-18T21:37:50.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f173359e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1734137340 con 0x7f1734138190 2020-05-18T21:37:50.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f173259c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1714003760 0x7f1734130880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38584/0 (socket says 172.21.15.63:38584) 2020-05-18T21:37:50.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f173259c700 1 -- 172.21.15.63:0/950698001 learned_addr learned my addr 172.21.15.63:0/950698001 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:50.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f1732d9d700 1 --2- 172.21.15.63:0/950698001 >> v2:172.21.15.155:3300/0 conn(0x7f1734138190 0x7f1734132970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:50.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f172bfff700 1 -- 172.21.15.63:0/950698001 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249378343 0 0) 0x7f1734132dd0 con 0x7f1714003760 2020-05-18T21:37:50.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f172bfff700 1 -- 172.21.15.63:0/950698001 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1718002fe0 con 0x7f1714003760 2020-05-18T21:37:50.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f172bfff700 1 -- 172.21.15.63:0/950698001 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3996836957 0 0) 0x7f1718002fe0 con 0x7f1714003760 2020-05-18T21:37:50.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f172bfff700 1 -- 172.21.15.63:0/950698001 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1734132dd0 con 0x7f1714003760 2020-05-18T21:37:50.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f172bfff700 1 -- 172.21.15.63:0/950698001 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f172400ce20 con 0x7f1714003760 2020-05-18T21:37:50.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f172bfff700 1 -- 172.21.15.63:0/950698001 >> v2:172.21.15.155:3300/0 conn(0x7f1734138190 msgr2=0x7f1734132970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:50.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f172bfff700 1 --2- 172.21.15.63:0/950698001 >> v2:172.21.15.155:3300/0 conn(0x7f1734138190 0x7f1734132970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:50.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f172bfff700 1 -- 172.21.15.63:0/950698001 >> v1:172.21.15.155:6789/0 conn(0x7f17341344b0 legacy=0x7f1734137a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:50.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f172bfff700 1 -- 172.21.15.63:0/950698001 >> v1:172.21.15.63:6789/0 conn(0x7f1714003760 legacy=0x7f1734130880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:50.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f172bfff700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1718004a80 0x7f1718004e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:50.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f172bfff700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17180039a0 0x7f1718003e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:50.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f172bfff700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1718004280 0x7f171800b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:50.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f172bfff700 1 -- 172.21.15.63:0/950698001 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1734137340 con 0x7f1718004280 2020-05-18T21:37:50.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f172bfff700 1 -- 172.21.15.63:0/950698001 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17180047f0 con 0x7f1718004a80 2020-05-18T21:37:50.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f172bfff700 1 -- 172.21.15.63:0/950698001 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171800bbc0 con 0x7f17180039a0 2020-05-18T21:37:50.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.113+0000 7f1732d9d700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1718004280 0x7f171800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:50.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f1729d9b700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17180039a0 0x7f1718003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:50.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f173259c700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1718004a80 0x7f1718004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:50.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f1732d9d700 1 -- 172.21.15.63:0/950698001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17180039a0 msgr2=0x7f1718003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:50.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f1732d9d700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17180039a0 0x7f1718003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:50.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f1732d9d700 1 -- 172.21.15.63:0/950698001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1718004a80 msgr2=0x7f1718004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:50.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f1732d9d700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1718004a80 0x7f1718004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:50.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f1732d9d700 1 -- 172.21.15.63:0/950698001 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17341375e0 con 0x7f1718004280 2020-05-18T21:37:50.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f173359e700 1 -- 172.21.15.63:0/950698001 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1734138590 con 0x7f1718004280 2020-05-18T21:37:50.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f1732d9d700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1718004280 0x7f171800b760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1734061480 tx=0x7f172c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:50.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f1732d9d700 1 -- 172.21.15.63:0/950698001 reap_dead start 2020-05-18T21:37:50.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f173359e700 1 -- 172.21.15.63:0/950698001 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1734135440 con 0x7f1718004280 2020-05-18T21:37:50.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f1732d9d700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1718004280 0x7f171800b760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1734061480 tx=0x7f172c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:50.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f1732d9d700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1718004280 0x7f171800b760 secure :-1 s=READY pgs=2090 cs=0 l=1 rx=0x7f1734061480 tx=0x7f172c010cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:50.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f1732d9d700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1718004280 0x7f171800b760 secure :-1 s=THROTTLE_DONE pgs=2090 cs=0 l=1 rx=0x7f1734061480 tx=0x7f172c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:50.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f1732d9d700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1718004280 0x7f171800b760 secure :-1 s=THROTTLE_DONE pgs=2090 cs=0 l=1 rx=0x7f1734061480 tx=0x7f172c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:50.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f172bfff700 1 -- 172.21.15.63:0/950698001 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f172c005c70 con 0x7f1718004280 2020-05-18T21:37:50.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f1732d9d700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1718004280 0x7f171800b760 secure :-1 s=THROTTLE_DONE pgs=2090 cs=0 l=1 rx=0x7f1734061480 tx=0x7f172c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:50.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f172bfff700 1 -- 172.21.15.63:0/950698001 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172c005dd0 con 0x7f1718004280 2020-05-18T21:37:50.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f172bfff700 1 -- 172.21.15.63:0/950698001 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f172c012890 con 0x7f1718004280 2020-05-18T21:37:50.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f1732d9d700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1718004280 0x7f171800b760 secure :-1 s=THROTTLE_DONE pgs=2090 cs=0 l=1 rx=0x7f1734061480 tx=0x7f172c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:50.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f173359e700 1 -- 172.21.15.63:0/950698001 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170c003380 con 0x7f1718004280 2020-05-18T21:37:50.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f172bfff700 1 -- 172.21.15.63:0/950698001 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f172c0129f0 con 0x7f1718004280 2020-05-18T21:37:50.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f1732d9d700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1718004280 0x7f171800b760 secure :-1 s=THROTTLE_DONE pgs=2090 cs=0 l=1 rx=0x7f1734061480 tx=0x7f172c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:50.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f172bfff700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1718053120 0x7f17180555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:50.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f172bfff700 1 -- 172.21.15.63:0/950698001 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f172c063710 con 0x7f1718004280 2020-05-18T21:37:50.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f173259c700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1718053120 0x7f17180555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:50.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.117+0000 7f173259c700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1718053120 0x7f17180555e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f172400c720 tx=0x7f173405e7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:50.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.121+0000 7f173259c700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1718053120 0x7f17180555e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f172400c720 tx=0x7f173405e7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:50.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.121+0000 7f173259c700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1718053120 0x7f17180555e0 secure :-1 s=READY pgs=819 cs=0 l=1 rx=0x7f172400c720 tx=0x7f173405e7b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:50.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.121+0000 7f1732d9d700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1718004280 0x7f171800b760 secure :-1 s=THROTTLE_DONE pgs=2090 cs=0 l=1 rx=0x7f1734061480 tx=0x7f172c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:50.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.121+0000 7f172bfff700 1 -- 172.21.15.63:0/950698001 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f172c03db80 con 0x7f1718004280 2020-05-18T21:37:50.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.265+0000 7f173359e700 1 -- 172.21.15.63:0/950698001 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f170c003720 con 0x7f1718004280 2020-05-18T21:37:50.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.265+0000 7f1732d9d700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1718004280 0x7f171800b760 secure :-1 s=THROTTLE_DONE pgs=2090 cs=0 l=1 rx=0x7f1734061480 tx=0x7f172c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:50.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.265+0000 7f172bfff700 1 -- 172.21.15.63:0/950698001 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 134 v134) v1 ==== 95+0+2152 (secure 0 0 0) 0x7f172c0411a0 con 0x7f1718004280 2020-05-18T21:37:50.273 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:50.273 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":134,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7157,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4038166667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4038166667},{"type":"v1","addr":"172.21.15.155:6835","nonce":4038166667}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":132}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:45.262609+0000","modified":"2020-05-18T21:37:46.266342+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10281":{"gid":10281,"name":"a","rank":0,"incarnation":133,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/2149589625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2149589625},{"type":"v1","addr":"172.21.15.63:6833","nonce":2149589625}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2020-05-18T21:37:50.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.269+0000 7f173359e700 1 -- 172.21.15.63:0/950698001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1718053120 msgr2=0x7f17180555e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:50.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.269+0000 7f173359e700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1718053120 0x7f17180555e0 secure :-1 s=READY pgs=819 cs=0 l=1 rx=0x7f172400c720 tx=0x7f173405e7b0).stop 2020-05-18T21:37:50.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.269+0000 7f173359e700 1 -- 172.21.15.63:0/950698001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1718004280 msgr2=0x7f171800b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:50.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.269+0000 7f173359e700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1718004280 0x7f171800b760 secure :-1 s=READY pgs=2090 cs=0 l=1 rx=0x7f1734061480 tx=0x7f172c010cf0).stop 2020-05-18T21:37:50.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.269+0000 7f173359e700 1 -- 172.21.15.63:0/950698001 shutdown_connections 2020-05-18T21:37:50.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.269+0000 7f173359e700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1718053120 0x7f17180555e0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:50.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.269+0000 7f173359e700 1 --2- 172.21.15.63:0/950698001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1718004280 0x7f171800b760 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:50.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.269+0000 7f173359e700 1 -- 172.21.15.63:0/950698001 >> 172.21.15.63:0/950698001 conn(0x7f173405a7c0 msgr2=0x7f1734141fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:50.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.269+0000 7f173359e700 1 -- 172.21.15.63:0/950698001 shutdown_connections 2020-05-18T21:37:50.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:50.269+0000 7f173359e700 1 -- 172.21.15.63:0/950698001 wait complete. 2020-05-18T21:37:50.277 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 134 2020-05-18T21:37:50.487 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 134, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:37:45.262609+0000', 'modified': '2020-05-18T21:37:46.266342+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10281': {'gid': 10281, 'name': 'a', 'rank': 0, 'incarnation': 133, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/2149589625', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 2149589625}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 2149589625}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:37:50.488 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:37:50.488 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:37:50.600 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:37:50.600 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:37:50.600 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:37:50.600 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 10281, 2020-05-18T21:37:50.601 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:37:50.601 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:37:50.601 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 5.3321948360000002, 2020-05-18T21:37:50.601 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 134, 2020-05-18T21:37:50.601 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 157, 2020-05-18T21:37:50.602 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 156, 2020-05-18T21:37:50.602 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 9.4955877789999992 2020-05-18T21:37:50.602 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:37:50.609 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 10281, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.3321948360000002, "mdsmap_epoch": 134, "osdmap_epoch": 157, "osdmap_epoch_barrier": 156, "uptime": 9.4955877789999992 } 2020-05-18T21:37:50.609 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:37:50.610 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:37:50.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:50.611 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:37:50.616 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:37:50.616 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:37:50.616 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:37:50.616 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:50.617 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:37:50.617 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:50.617 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:50.617 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:50.617 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:50.618 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:50.618 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:37:50.618 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:50.618 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:37:50.618 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:37:50.619 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:37:50.619 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42172sec preferred_lft 42172sec 2020-05-18T21:37:50.619 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:37:50.619 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:37:50.620 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:37:50.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:50.620 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:37:50.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:50.676 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:37:50.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:50.693 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:37:50.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:50.707 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:37:50.765 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:37:50.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:50.767 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:37:50.774 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:37:50.774 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:37:50.774 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:37:50.775 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:37:50.775 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:37:50.775 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:37:50.776 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:37:50.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:50.776 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:37:50.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:50.795 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:37:50.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:50.810 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:37:50.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:50.872 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:37:50.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:50.879 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:37:50.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:50.887 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:37:50.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:50.904 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-05-18T21:37:50.919 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-05-18T21:37:50.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:50.919 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-05-18T21:37:50.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:50.981 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:37:50.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:50.994 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-05-18T21:37:51.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:51.015 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-05-18T21:37:51.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:51.077 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-05-18T21:37:51.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:51.093 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 up' 2020-05-18T21:37:51.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:37:51.107 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.0 master ceph-brx' 2020-05-18T21:37:51.168 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-05-18T21:37:51.169 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-05-18T21:37:51.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:51.170 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:37:51.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:51.177 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:37:51.239 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:37:51.240 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:37:51.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:51.241 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:37:51.247 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:37:51.248 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:37:51.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:51.291 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:37:51.308 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:37:51.309 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:37:51.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:51.311 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:37:51.379 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2020-05-18T21:37:51.372+0000 7fd46148c080 -1 init, newargv = 0x559b8b7e8530 newargc=9 2020-05-18T21:37:51.380 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[39805]: starting ceph client 2020-05-18T21:37:51.390 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[39805]: starting fuse 2020-05-18T21:37:52.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:52.425 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:37:52.441 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:37:52.442 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:37:52.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:52.443 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:37:52.450 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:37:52.457 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:37:52.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:52.458 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:37:52.458 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:37:52.459 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:37:52.459 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:37:52.460 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:37:52.460 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:37:52.460 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:37:52.461 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:37:52.461 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:37:52.462 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:37:52.462 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:37:52.462 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:37:52.463 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:37:52.463 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:37:52.464 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:37:52.464 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:37:52.464 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:37:52.465 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:37:52.465 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:37:52.466 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:37:52.466 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:37:52.467 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:37:52.467 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:37:52.512 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.39805.asok 2020-05-18T21:37:52.517 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39805.asok 2020-05-18T21:37:52.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:52.518 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39805.asok status 2020-05-18T21:37:52.654 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:37:52.655 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:37:52.655 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:37:52.655 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:37:52.655 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:37:52.655 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:37:52.656 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:37:52.656 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "39805", 2020-05-18T21:37:52.656 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:37:52.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:52.657 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:37:52.657 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:37:52.658 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 7277, 2020-05-18T21:37:52.658 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:37:52.658 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:37:52.659 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:37:52.659 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 7277 2020-05-18T21:37:52.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:52.659 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:37:52.659 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:52.659 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:0", 2020-05-18T21:37:52.660 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3215905323 2020-05-18T21:37:52.660 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:37:52.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:52.660 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:37:52.660 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:37:52.661 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:0", 2020-05-18T21:37:52.661 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3215905323 2020-05-18T21:37:52.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:37:52.661 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.7277 172.21.15.63:0/3215905323", 2020-05-18T21:37:52.661 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "172.21.15.63:0/3215905323", 2020-05-18T21:37:52.661 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:37:52.662 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 134, 2020-05-18T21:37:52.662 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 157, 2020-05-18T21:37:52.662 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:37:52.662 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:37:52.662 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:37:52.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:52.664 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:37:52.665 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:37:52.672 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:37:52.672 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-05-18T21:37:52.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:37:52.673 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:37:52.688 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs max_mds 2 2020-05-18T21:37:52.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.840+0000 7f0cf2c7e700 1 Processor -- start 2020-05-18T21:37:52.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.840+0000 7f0cf2c7e700 1 -- start start 2020-05-18T21:37:52.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.840+0000 7f0cf2c7e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cec0ad0f0 0x7f0cec0b8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:52.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.840+0000 7f0cf2c7e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0cec145dd0 0x7f0cec146210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:52.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.840+0000 7f0cf2c7e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cec0ba3e0 con 0x7f0cec1459f0 2020-05-18T21:37:52.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.840+0000 7f0cf2c7e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cec0ae270 con 0x7f0cec145dd0 2020-05-18T21:37:52.849 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.840+0000 7f0cf2c7e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0b9ea0 con 0x7f0cec0ad0f0 2020-05-18T21:37:52.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.840+0000 7f0cebfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cec0ad0f0 0x7f0cec0b8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:52.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.840+0000 7f0cf121b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0cec145dd0 0x7f0cec146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:52.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.840+0000 7f0cebfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cec0ad0f0 0x7f0cec0b8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:55368/0 (socket says 172.21.15.63:55368) 2020-05-18T21:37:52.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.840+0000 7f0cf121b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0cec145dd0 0x7f0cec146210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:51280/0 (socket says 172.21.15.63:51280) 2020-05-18T21:37:52.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.840+0000 7f0cebfff700 1 -- 172.21.15.63:0/1365782556 learned_addr learned my addr 172.21.15.63:0/1365782556 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:52.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.840+0000 7f0cf0a1a700 1 --1- 172.21.15.63:0/1365782556 >> v1:172.21.15.155:6789/0 conn(0x7f0cec1459f0 0x7f0cec0bc750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:36934/0 (socket says 172.21.15.63:36934) 2020-05-18T21:37:52.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.840+0000 7f0ceb7fe700 1 -- 172.21.15.63:0/1365782556 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324391633 0 0) 0x7f0cec0ba3e0 con 0x7f0cec1459f0 2020-05-18T21:37:52.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.840+0000 7f0ceb7fe700 1 -- 172.21.15.63:0/1365782556 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ccc003270 con 0x7f0cec1459f0 2020-05-18T21:37:52.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.840+0000 7f0cf121b700 1 -- 172.21.15.63:0/1365782556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cec0ad0f0 msgr2=0x7f0cec0b8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:52.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.840+0000 7f0cf121b700 1 --2- 172.21.15.63:0/1365782556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cec0ad0f0 0x7f0cec0b8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:52.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0cf121b700 1 -- 172.21.15.63:0/1365782556 >> v1:172.21.15.155:6789/0 conn(0x7f0cec1459f0 legacy=0x7f0cec0bc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:52.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0cf121b700 1 -- 172.21.15.63:0/1365782556 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec0ba140 con 0x7f0cec145dd0 2020-05-18T21:37:52.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0cebfff700 1 --2- 172.21.15.63:0/1365782556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cec0ad0f0 0x7f0cec0b8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:52.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0cf121b700 1 --2- 172.21.15.63:0/1365782556 >> v2:172.21.15.155:3300/0 conn(0x7f0cec145dd0 0x7f0cec146210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0ce40032f0 tx=0x7f0ce4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:52.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0cf121b700 1 --2- 172.21.15.63:0/1365782556 >> v2:172.21.15.155:3300/0 conn(0x7f0cec145dd0 0x7f0cec146210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0ce40032f0 tx=0x7f0ce4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:52.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0cf121b700 1 --2- 172.21.15.63:0/1365782556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec145dd0 0x7f0cec146210 secure :-1 s=READY pgs=1394 cs=0 l=1 rx=0x7f0ce40032f0 tx=0x7f0ce4007e00).ready entity=mon.1 client_cookie=c10d7bd1b4461a9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:52.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0cf121b700 1 --2- 172.21.15.63:0/1365782556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec145dd0 0x7f0cec146210 secure :-1 s=THROTTLE_DONE pgs=1394 cs=0 l=1 rx=0x7f0ce40032f0 tx=0x7f0ce4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:52.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0cf121b700 1 --2- 172.21.15.63:0/1365782556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec145dd0 0x7f0cec146210 secure :-1 s=THROTTLE_DONE pgs=1394 cs=0 l=1 rx=0x7f0ce40032f0 tx=0x7f0ce4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:52.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0ceb7fe700 1 -- 172.21.15.63:0/1365782556 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ce4011db0 con 0x7f0cec145dd0 2020-05-18T21:37:52.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0cf121b700 1 --2- 172.21.15.63:0/1365782556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec145dd0 0x7f0cec146210 secure :-1 s=THROTTLE_DONE pgs=1394 cs=0 l=1 rx=0x7f0ce40032f0 tx=0x7f0ce4007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:52.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0ceb7fe700 1 -- 172.21.15.63:0/1365782556 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce400a180 con 0x7f0cec145dd0 2020-05-18T21:37:52.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0ceb7fe700 1 -- 172.21.15.63:0/1365782556 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ce400a5a0 con 0x7f0cec145dd0 2020-05-18T21:37:52.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0cf2c7e700 1 -- 172.21.15.63:0/1365782556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec145dd0 msgr2=0x7f0cec146210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:52.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0cf2c7e700 1 --2- 172.21.15.63:0/1365782556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec145dd0 0x7f0cec146210 secure :-1 s=READY pgs=1394 cs=0 l=1 rx=0x7f0ce40032f0 tx=0x7f0ce4007e00).stop 2020-05-18T21:37:52.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0cf2c7e700 1 -- 172.21.15.63:0/1365782556 shutdown_connections 2020-05-18T21:37:52.860 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0cf2c7e700 1 --2- 172.21.15.63:0/1365782556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec145dd0 0x7f0cec146210 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:52.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0cf2c7e700 1 --2- 172.21.15.63:0/1365782556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cec0ad0f0 0x7f0cec0b8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:52.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0cf2c7e700 1 -- 172.21.15.63:0/1365782556 >> 172.21.15.63:0/1365782556 conn(0x7f0cec05f540 msgr2=0x7f0cec05f920 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:52.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0cf2c7e700 1 -- 172.21.15.63:0/1365782556 shutdown_connections 2020-05-18T21:37:52.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0cf2c7e700 1 -- 172.21.15.63:0/1365782556 wait complete. 2020-05-18T21:37:52.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0cf2c7e700 1 Processor -- start 2020-05-18T21:37:52.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.844+0000 7f0cf2c7e700 1 -- start start 2020-05-18T21:37:52.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cf2c7e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0cec1459f0 0x7f0cec13d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:52.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cf2c7e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0cec145dd0 0x7f0cec12fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:52.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cf2c7e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cec13dd50 con 0x7f0cec0ad0f0 2020-05-18T21:37:52.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cf2c7e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cec153ee0 con 0x7f0cec145dd0 2020-05-18T21:37:52.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cf2c7e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cec154180 con 0x7f0cec1459f0 2020-05-18T21:37:52.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cf121b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0cec145dd0 0x7f0cec12fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:52.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cf121b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0cec145dd0 0x7f0cec12fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36440/0 (socket says 172.21.15.63:36440) 2020-05-18T21:37:52.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cf121b700 1 -- 172.21.15.63:0/3166009626 learned_addr learned my addr 172.21.15.63:0/3166009626 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:52.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cebfff700 1 --2- 172.21.15.63:0/3166009626 >> v2:172.21.15.155:3300/0 conn(0x7f0cec1459f0 0x7f0cec13d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:52.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0ce9ffb700 1 -- 172.21.15.63:0/3166009626 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318363674 0 0) 0x7f0cec13dd50 con 0x7f0cec0ad0f0 2020-05-18T21:37:52.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0ce9ffb700 1 -- 172.21.15.63:0/3166009626 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cd0002fe0 con 0x7f0cec0ad0f0 2020-05-18T21:37:52.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cebfff700 1 -- 172.21.15.63:0/3166009626 >> v2:172.21.15.63:3300/0 conn(0x7f0cec145dd0 msgr2=0x7f0cec12fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:52.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cebfff700 1 --2- 172.21.15.63:0/3166009626 >> v2:172.21.15.63:3300/0 conn(0x7f0cec145dd0 0x7f0cec12fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:52.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cebfff700 1 -- 172.21.15.63:0/3166009626 >> v1:172.21.15.155:6789/0 conn(0x7f0cec0ad0f0 legacy=0x7f0cec153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:52.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cebfff700 1 -- 172.21.15.63:0/3166009626 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec154420 con 0x7f0cec1459f0 2020-05-18T21:37:52.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cf121b700 1 --2- 172.21.15.63:0/3166009626 >> v2:172.21.15.63:3300/0 conn(0x7f0cec145dd0 0x7f0cec12fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:52.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cebfff700 1 --2- 172.21.15.63:0/3166009626 >> v2:172.21.15.155:3300/0 conn(0x7f0cec1459f0 0x7f0cec13d8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0cdc002f70 tx=0x7f0cdc010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:52.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cebfff700 1 --2- 172.21.15.63:0/3166009626 >> v2:172.21.15.155:3300/0 conn(0x7f0cec1459f0 0x7f0cec13d8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0cdc002f70 tx=0x7f0cdc010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:52.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cebfff700 1 --2- 172.21.15.63:0/3166009626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec1459f0 0x7f0cec13d8f0 secure :-1 s=READY pgs=1396 cs=0 l=1 rx=0x7f0cdc002f70 tx=0x7f0cdc010dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:52.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cebfff700 1 --2- 172.21.15.63:0/3166009626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec1459f0 0x7f0cec13d8f0 secure :-1 s=THROTTLE_DONE pgs=1396 cs=0 l=1 rx=0x7f0cdc002f70 tx=0x7f0cdc010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:52.866 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0ce9ffb700 1 -- 172.21.15.63:0/3166009626 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cdc00c980 con 0x7f0cec1459f0 2020-05-18T21:37:52.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cebfff700 1 --2- 172.21.15.63:0/3166009626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec1459f0 0x7f0cec13d8f0 secure :-1 s=THROTTLE_DONE pgs=1396 cs=0 l=1 rx=0x7f0cdc002f70 tx=0x7f0cdc010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:52.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0ce9ffb700 1 -- 172.21.15.63:0/3166009626 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc00cae0 con 0x7f0cec1459f0 2020-05-18T21:37:52.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cebfff700 1 --2- 172.21.15.63:0/3166009626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec1459f0 0x7f0cec13d8f0 secure :-1 s=THROTTLE_DONE pgs=1396 cs=0 l=1 rx=0x7f0cdc002f70 tx=0x7f0cdc010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:52.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cf2c7e700 1 -- 172.21.15.63:0/3166009626 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cec1461b0 con 0x7f0cec1459f0 2020-05-18T21:37:52.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0ce9ffb700 1 -- 172.21.15.63:0/3166009626 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cdc005700 con 0x7f0cec1459f0 2020-05-18T21:37:52.867 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.848+0000 7f0cf2c7e700 1 -- 172.21.15.63:0/3166009626 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cec156ec0 con 0x7f0cec1459f0 2020-05-18T21:37:52.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.852+0000 7f0cebfff700 1 --2- 172.21.15.63:0/3166009626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec1459f0 0x7f0cec13d8f0 secure :-1 s=THROTTLE_DONE pgs=1396 cs=0 l=1 rx=0x7f0cdc002f70 tx=0x7f0cdc010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:52.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.852+0000 7f0cf2c7e700 1 -- 172.21.15.63:0/3166009626 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cec0569e0 con 0x7f0cec1459f0 2020-05-18T21:37:52.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.852+0000 7f0ce9ffb700 1 -- 172.21.15.63:0/3166009626 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0cdc0071a0 con 0x7f0cec1459f0 2020-05-18T21:37:52.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.852+0000 7f0cebfff700 1 --2- 172.21.15.63:0/3166009626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec1459f0 0x7f0cec13d8f0 secure :-1 s=THROTTLE_DONE pgs=1396 cs=0 l=1 rx=0x7f0cdc002f70 tx=0x7f0cdc010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:52.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.852+0000 7f0ce9ffb700 1 --2- 172.21.15.63:0/3166009626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0cd004fd80 0x7f0cd0052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:52.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.852+0000 7f0ce9ffb700 1 -- 172.21.15.63:0/3166009626 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0cdc063d40 con 0x7f0cec1459f0 2020-05-18T21:37:52.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.852+0000 7f0cf0a1a700 1 --2- 172.21.15.63:0/3166009626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0cd004fd80 0x7f0cd0052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:52.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.852+0000 7f0cf0a1a700 1 --2- 172.21.15.63:0/3166009626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0cd004fd80 0x7f0cd0052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0cd4000ed0 tx=0x7f0cd4001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:52.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.852+0000 7f0cf0a1a700 1 --2- 172.21.15.63:0/3166009626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0cd004fd80 0x7f0cd0052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0cd4000ed0 tx=0x7f0cd4001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:52.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.852+0000 7f0cf0a1a700 1 --2- 172.21.15.63:0/3166009626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0cd004fd80 0x7f0cd0052240 secure :-1 s=READY pgs=820 cs=0 l=1 rx=0x7f0cd4000ed0 tx=0x7f0cd4001720).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:52.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.860+0000 7f0cebfff700 1 --2- 172.21.15.63:0/3166009626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec1459f0 0x7f0cec13d8f0 secure :-1 s=THROTTLE_DONE pgs=1396 cs=0 l=1 rx=0x7f0cdc002f70 tx=0x7f0cdc010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:52.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:52.860+0000 7f0ce9ffb700 1 -- 172.21.15.63:0/3166009626 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f0cdc03e130 con 0x7f0cec1459f0 2020-05-18T21:37:53.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.012+0000 7f0cf2c7e700 1 -- 172.21.15.63:0/3166009626 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f0cec130730 con 0x7f0cec1459f0 2020-05-18T21:37:53.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.072+0000 7f0cebfff700 1 --2- 172.21.15.63:0/3166009626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec1459f0 0x7f0cec13d8f0 secure :-1 s=THROTTLE_DONE pgs=1396 cs=0 l=1 rx=0x7f0cdc002f70 tx=0x7f0cdc010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:53.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.072+0000 7f0ce9ffb700 1 -- 172.21.15.63:0/3166009626 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v135) v1 ==== 105+0+0 (secure 0 0 0) 0x7f0cdc041750 con 0x7f0cec1459f0 2020-05-18T21:37:53.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.076+0000 7f0cf2c7e700 1 -- 172.21.15.63:0/3166009626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0cd004fd80 msgr2=0x7f0cd0052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:53.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.076+0000 7f0cf2c7e700 1 --2- 172.21.15.63:0/3166009626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0cd004fd80 0x7f0cd0052240 secure :-1 s=READY pgs=820 cs=0 l=1 rx=0x7f0cd4000ed0 tx=0x7f0cd4001720).stop 2020-05-18T21:37:53.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.076+0000 7f0cf2c7e700 1 -- 172.21.15.63:0/3166009626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec1459f0 msgr2=0x7f0cec13d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:53.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.076+0000 7f0cf2c7e700 1 --2- 172.21.15.63:0/3166009626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec1459f0 0x7f0cec13d8f0 secure :-1 s=READY pgs=1396 cs=0 l=1 rx=0x7f0cdc002f70 tx=0x7f0cdc010dc0).stop 2020-05-18T21:37:53.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.076+0000 7f0cf2c7e700 1 -- 172.21.15.63:0/3166009626 shutdown_connections 2020-05-18T21:37:53.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.076+0000 7f0cf2c7e700 1 --2- 172.21.15.63:0/3166009626 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0cd004fd80 0x7f0cd0052240 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:53.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.076+0000 7f0cf2c7e700 1 --2- 172.21.15.63:0/3166009626 >> v2:172.21.15.63:3300/0 conn(0x7f0cec145dd0 0x7f0cec12fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:53.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.076+0000 7f0cf2c7e700 1 --2- 172.21.15.63:0/3166009626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec1459f0 0x7f0cec13d8f0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:53.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.076+0000 7f0cf2c7e700 1 -- 172.21.15.63:0/3166009626 >> 172.21.15.63:0/3166009626 conn(0x7f0cec05f540 msgr2=0x7f0cec0bc750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:53.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.076+0000 7f0cf2c7e700 1 -- 172.21.15.63:0/3166009626 shutdown_connections 2020-05-18T21:37:53.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.076+0000 7f0cf2c7e700 1 -- 172.21.15.63:0/3166009626 wait complete. 2020-05-18T21:37:53.100 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:53.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.188+0000 7f9242d4e700 1 Processor -- start 2020-05-18T21:37:53.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.188+0000 7f9242d4e700 1 -- start start 2020-05-18T21:37:53.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.188+0000 7f9242d4e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f923c05f110 0x7f923c0acea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:53.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.188+0000 7f9242d4e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f923c0659d0 0x7f923c146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:53.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.188+0000 7f9242d4e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923c0b4af0 con 0x7f923c146c80 2020-05-18T21:37:53.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.188+0000 7f9242d4e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923c1460e0 con 0x7f923c05f110 2020-05-18T21:37:53.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.188+0000 7f9242d4e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c146380 con 0x7f923c0659d0 2020-05-18T21:37:53.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.188+0000 7f9241d4c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f923c05f110 0x7f923c0acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:53.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.188+0000 7f924254d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f923c146c80 0x7f923c13c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38636/0 (socket says 172.21.15.63:38636) 2020-05-18T21:37:53.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.188+0000 7f924254d700 1 -- 172.21.15.63:0/2646805807 learned_addr learned my addr 172.21.15.63:0/2646805807 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:53.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.188+0000 7f924154b700 1 --2- 172.21.15.63:0/2646805807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f923c0659d0 0x7f923c146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:53.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.188+0000 7f9240d4a700 1 -- 172.21.15.63:0/2646805807 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014463925 0 0) 0x7f923c0b4af0 con 0x7f923c146c80 2020-05-18T21:37:53.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.188+0000 7f9240d4a700 1 -- 172.21.15.63:0/2646805807 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9224003270 con 0x7f923c146c80 2020-05-18T21:37:53.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.188+0000 7f9241d4c700 1 -- 172.21.15.63:0/2646805807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f923c0659d0 msgr2=0x7f923c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:53.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.188+0000 7f9241d4c700 1 --2- 172.21.15.63:0/2646805807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f923c0659d0 0x7f923c146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:53.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.188+0000 7f9241d4c700 1 -- 172.21.15.63:0/2646805807 >> v1:172.21.15.63:6789/0 conn(0x7f923c146c80 legacy=0x7f923c13c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:53.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.188+0000 7f9241d4c700 1 -- 172.21.15.63:0/2646805807 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c05f4f0 con 0x7f923c05f110 2020-05-18T21:37:53.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.192+0000 7f9241d4c700 1 --2- 172.21.15.63:0/2646805807 >> v2:172.21.15.63:3300/0 conn(0x7f923c05f110 0x7f923c0acea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9230002f70 tx=0x7f9230007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:53.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.192+0000 7f9241d4c700 1 --2- 172.21.15.63:0/2646805807 >> v2:172.21.15.63:3300/0 conn(0x7f923c05f110 0x7f923c0acea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9230002f70 tx=0x7f9230007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:53.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.192+0000 7f9241d4c700 1 --2- 172.21.15.63:0/2646805807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f923c05f110 0x7f923c0acea0 secure :-1 s=READY pgs=2093 cs=0 l=1 rx=0x7f9230002f70 tx=0x7f9230007a80).ready entity=mon.0 client_cookie=874420abf66bcc03 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:53.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.192+0000 7f9241d4c700 1 --2- 172.21.15.63:0/2646805807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f923c05f110 0x7f923c0acea0 secure :-1 s=THROTTLE_DONE pgs=2093 cs=0 l=1 rx=0x7f9230002f70 tx=0x7f9230007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:53.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.192+0000 7f9240d4a700 1 -- 172.21.15.63:0/2646805807 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9230008e80 con 0x7f923c05f110 2020-05-18T21:37:53.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.192+0000 7f9241d4c700 1 --2- 172.21.15.63:0/2646805807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f923c05f110 0x7f923c0acea0 secure :-1 s=THROTTLE_DONE pgs=2093 cs=0 l=1 rx=0x7f9230002f70 tx=0x7f9230007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:53.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.192+0000 7f9241d4c700 1 --2- 172.21.15.63:0/2646805807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f923c05f110 0x7f923c0acea0 secure :-1 s=THROTTLE_DONE pgs=2093 cs=0 l=1 rx=0x7f9230002f70 tx=0x7f9230007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:53.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.192+0000 7f9240d4a700 1 -- 172.21.15.63:0/2646805807 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9230011540 con 0x7f923c05f110 2020-05-18T21:37:53.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.192+0000 7f9240d4a700 1 -- 172.21.15.63:0/2646805807 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9230011960 con 0x7f923c05f110 2020-05-18T21:37:53.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.192+0000 7f9242d4e700 1 -- 172.21.15.63:0/2646805807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f923c05f110 msgr2=0x7f923c0acea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:53.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.192+0000 7f9242d4e700 1 --2- 172.21.15.63:0/2646805807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f923c05f110 0x7f923c0acea0 secure :-1 s=READY pgs=2093 cs=0 l=1 rx=0x7f9230002f70 tx=0x7f9230007a80).stop 2020-05-18T21:37:53.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.192+0000 7f9242d4e700 1 -- 172.21.15.63:0/2646805807 shutdown_connections 2020-05-18T21:37:53.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.192+0000 7f9242d4e700 1 --2- 172.21.15.63:0/2646805807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f923c0659d0 0x7f923c146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.192+0000 7f9242d4e700 1 --2- 172.21.15.63:0/2646805807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f923c05f110 0x7f923c0acea0 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.192+0000 7f9242d4e700 1 -- 172.21.15.63:0/2646805807 >> 172.21.15.63:0/2646805807 conn(0x7f923c069fc0 msgr2=0x7f923c06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.192+0000 7f9242d4e700 1 -- 172.21.15.63:0/2646805807 shutdown_connections 2020-05-18T21:37:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.192+0000 7f9242d4e700 1 -- 172.21.15.63:0/2646805807 wait complete. 2020-05-18T21:37:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.192+0000 7f9242d4e700 1 Processor -- start 2020-05-18T21:37:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.192+0000 7f9242d4e700 1 -- start start 2020-05-18T21:37:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9242d4e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f923c05f110 0x7f923c130560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9242d4e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f923c0659d0 0x7f923c131b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9242d4e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923c132690 con 0x7f923c146c80 2020-05-18T21:37:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9242d4e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923c0b8d60 con 0x7f923c05f110 2020-05-18T21:37:53.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9242d4e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c12f100 con 0x7f923c0659d0 2020-05-18T21:37:53.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9241d4c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f923c05f110 0x7f923c130560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:53.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9241d4c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f923c05f110 0x7f923c130560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36450/0 (socket says 172.21.15.63:36450) 2020-05-18T21:37:53.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9241d4c700 1 -- 172.21.15.63:0/2259771272 learned_addr learned my addr 172.21.15.63:0/2259771272 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:53.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f924154b700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f923c0659d0 0x7f923c131b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:53.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9241d4c700 1 -- 172.21.15.63:0/2259771272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f923c0659d0 msgr2=0x7f923c131b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:53.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9241d4c700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f923c0659d0 0x7f923c131b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:53.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9241d4c700 1 -- 172.21.15.63:0/2259771272 >> v1:172.21.15.155:6789/0 conn(0x7f923c146c80 legacy=0x7f923c12e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:53.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9241d4c700 1 -- 172.21.15.63:0/2259771272 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c12eac0 con 0x7f923c05f110 2020-05-18T21:37:53.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f924154b700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f923c0659d0 0x7f923c131b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:37:53.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9241d4c700 1 --2- 172.21.15.63:0/2259771272 >> v2:172.21.15.63:3300/0 conn(0x7f923c05f110 0x7f923c130560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9230002f70 tx=0x7f9230007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:53.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9241d4c700 1 --2- 172.21.15.63:0/2259771272 >> v2:172.21.15.63:3300/0 conn(0x7f923c05f110 0x7f923c130560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9230002f70 tx=0x7f9230007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:53.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9241d4c700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f923c05f110 0x7f923c130560 secure :-1 s=READY pgs=2094 cs=0 l=1 rx=0x7f9230002f70 tx=0x7f9230007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:53.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9241d4c700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f923c05f110 0x7f923c130560 secure :-1 s=THROTTLE_DONE pgs=2094 cs=0 l=1 rx=0x7f9230002f70 tx=0x7f9230007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:53.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9241d4c700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f923c05f110 0x7f923c130560 secure :-1 s=THROTTLE_DONE pgs=2094 cs=0 l=1 rx=0x7f9230002f70 tx=0x7f9230007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:53.210 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f922effd700 1 -- 172.21.15.63:0/2259771272 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9230011a00 con 0x7f923c05f110 2020-05-18T21:37:53.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9241d4c700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f923c05f110 0x7f923c130560 secure :-1 s=THROTTLE_DONE pgs=2094 cs=0 l=1 rx=0x7f9230002f70 tx=0x7f9230007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:53.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f922effd700 1 -- 172.21.15.63:0/2259771272 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9230007170 con 0x7f923c05f110 2020-05-18T21:37:53.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9242d4e700 1 -- 172.21.15.63:0/2259771272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923c12ed10 con 0x7f923c05f110 2020-05-18T21:37:53.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f922effd700 1 -- 172.21.15.63:0/2259771272 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9230007510 con 0x7f923c05f110 2020-05-18T21:37:53.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.196+0000 7f9242d4e700 1 -- 172.21.15.63:0/2259771272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923c132190 con 0x7f923c05f110 2020-05-18T21:37:53.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.200+0000 7f9241d4c700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f923c05f110 0x7f923c130560 secure :-1 s=THROTTLE_DONE pgs=2094 cs=0 l=1 rx=0x7f9230002f70 tx=0x7f9230007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.200+0000 7f9242d4e700 1 -- 172.21.15.63:0/2259771272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f923c132490 con 0x7f923c05f110 2020-05-18T21:37:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.200+0000 7f922effd700 1 -- 172.21.15.63:0/2259771272 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9230005700 con 0x7f923c05f110 2020-05-18T21:37:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.200+0000 7f9241d4c700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f923c05f110 0x7f923c130560 secure :-1 s=THROTTLE_DONE pgs=2094 cs=0 l=1 rx=0x7f9230002f70 tx=0x7f9230007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.200+0000 7f922effd700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f921c04f990 0x7f921c051e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.200+0000 7f922effd700 1 -- 172.21.15.63:0/2259771272 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f92300645d0 con 0x7f923c05f110 2020-05-18T21:37:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.200+0000 7f924154b700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f921c04f990 0x7f921c051e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.200+0000 7f924154b700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f921c04f990 0x7f921c051e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9238002f70 tx=0x7f9238007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.200+0000 7f924154b700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f921c04f990 0x7f921c051e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9238002f70 tx=0x7f9238007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.200+0000 7f924154b700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f921c04f990 0x7f921c051e50 secure :-1 s=READY pgs=821 cs=0 l=1 rx=0x7f9238002f70 tx=0x7f9238007720).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.204+0000 7f9241d4c700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f923c05f110 0x7f923c130560 secure :-1 s=THROTTLE_DONE pgs=2094 cs=0 l=1 rx=0x7f9230002f70 tx=0x7f9230007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.204+0000 7f922effd700 1 -- 172.21.15.63:0/2259771272 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f923003ea80 con 0x7f923c05f110 2020-05-18T21:37:53.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.352+0000 7f9242d4e700 1 -- 172.21.15.63:0/2259771272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f923c0569e0 con 0x7f923c05f110 2020-05-18T21:37:53.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.352+0000 7f9241d4c700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f923c05f110 0x7f923c130560 secure :-1 s=THROTTLE_DONE pgs=2094 cs=0 l=1 rx=0x7f9230002f70 tx=0x7f9230007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:53.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.352+0000 7f922effd700 1 -- 172.21.15.63:0/2259771272 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) v1 ==== 95+0+2169 (secure 0 0 0) 0x7f92300420a0 con 0x7f923c05f110 2020-05-18T21:37:53.361 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:53.361 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":136,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:45.262609+0000","modified":"2020-05-18T21:37:53.077242+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":10281,"mds_1":7157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7157":{"gid":7157,"name":"b","rank":1,"incarnation":136,"state":"up:creating","state_seq":1,"addr":"172.21.15.155:6835/4038166667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4038166667},{"type":"v1","addr":"172.21.15.155:6835","nonce":4038166667}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_10281":{"gid":10281,"name":"a","rank":0,"incarnation":133,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/2149589625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2149589625},{"type":"v1","addr":"172.21.15.63:6833","nonce":2149589625}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2020-05-18T21:37:53.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.356+0000 7f9242d4e700 1 -- 172.21.15.63:0/2259771272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f921c04f990 msgr2=0x7f921c051e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:53.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.356+0000 7f9242d4e700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f921c04f990 0x7f921c051e50 secure :-1 s=READY pgs=821 cs=0 l=1 rx=0x7f9238002f70 tx=0x7f9238007720).stop 2020-05-18T21:37:53.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.356+0000 7f9242d4e700 1 -- 172.21.15.63:0/2259771272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f923c05f110 msgr2=0x7f923c130560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:53.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.356+0000 7f9242d4e700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f923c05f110 0x7f923c130560 secure :-1 s=READY pgs=2094 cs=0 l=1 rx=0x7f9230002f70 tx=0x7f9230007a80).stop 2020-05-18T21:37:53.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.356+0000 7f9242d4e700 1 -- 172.21.15.63:0/2259771272 shutdown_connections 2020-05-18T21:37:53.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.356+0000 7f9242d4e700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f921c04f990 0x7f921c051e50 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:53.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.356+0000 7f9242d4e700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f923c0659d0 0x7f923c131b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:53.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.356+0000 7f9242d4e700 1 --2- 172.21.15.63:0/2259771272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f923c05f110 0x7f923c130560 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:53.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.356+0000 7f9242d4e700 1 -- 172.21.15.63:0/2259771272 >> 172.21.15.63:0/2259771272 conn(0x7f923c069fc0 msgr2=0x7f923c0b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:53.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.356+0000 7f9242d4e700 1 -- 172.21.15.63:0/2259771272 shutdown_connections 2020-05-18T21:37:53.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:53.356+0000 7f9242d4e700 1 -- 172.21.15.63:0/2259771272 wait complete. 2020-05-18T21:37:53.365 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 136 2020-05-18T21:37:53.378 DEBUG:tasks.ceph_test_case:wait_until_equal: 1 != 2, waiting (timeout=30)... 2020-05-18T21:37:58.379 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:58.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.484+0000 7f075a72c700 1 Processor -- start 2020-05-18T21:37:58.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.484+0000 7f075a72c700 1 -- start start 2020-05-18T21:37:58.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.484+0000 7f075a72c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07540ac4d0 0x7f07540b3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:58.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.484+0000 7f075a72c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07540b13a0 0x7f07540b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:58.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.484+0000 7f075a72c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07540b0f40 con 0x7f07541402e0 2020-05-18T21:37:58.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.484+0000 7f075a72c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07541406c0 con 0x7f07540b13a0 2020-05-18T21:37:58.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.484+0000 7f075a72c700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07540b0410 con 0x7f07540ac4d0 2020-05-18T21:37:58.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.484+0000 7f0759f2b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07540b13a0 0x7f07540b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:58.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.484+0000 7f075972a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f07541402e0 0x7f075405a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38648/0 (socket says 172.21.15.63:38648) 2020-05-18T21:37:58.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.484+0000 7f075972a700 1 -- 172.21.15.63:0/4225524922 learned_addr learned my addr 172.21.15.63:0/4225524922 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:58.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.484+0000 7f0758f29700 1 --2- 172.21.15.63:0/4225524922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07540ac4d0 0x7f07540b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:58.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.484+0000 7f0759f2b700 1 -- 172.21.15.63:0/4225524922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07540ac4d0 msgr2=0x7f07540b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:58.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.484+0000 7f0743fff700 1 -- 172.21.15.63:0/4225524922 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372717200 0 0) 0x7f07540b0f40 con 0x7f07541402e0 2020-05-18T21:37:58.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.484+0000 7f0759f2b700 1 --2- 172.21.15.63:0/4225524922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07540ac4d0 0x7f07540b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:58.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.484+0000 7f0759f2b700 1 -- 172.21.15.63:0/4225524922 >> v1:172.21.15.63:6789/0 conn(0x7f07541402e0 legacy=0x7f075405a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:58.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.484+0000 7f0759f2b700 1 -- 172.21.15.63:0/4225524922 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07540b35f0 con 0x7f07540b13a0 2020-05-18T21:37:58.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.484+0000 7f0758f29700 1 --2- 172.21.15.63:0/4225524922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07540ac4d0 0x7f07540b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:37:58.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.488+0000 7f0759f2b700 1 --2- 172.21.15.63:0/4225524922 >> v2:172.21.15.63:3300/0 conn(0x7f07540b13a0 0x7f07540b1850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f074c0032f0 tx=0x7f074c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.488+0000 7f0759f2b700 1 --2- 172.21.15.63:0/4225524922 >> v2:172.21.15.63:3300/0 conn(0x7f07540b13a0 0x7f07540b1850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f074c0032f0 tx=0x7f074c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.488+0000 7f0759f2b700 1 --2- 172.21.15.63:0/4225524922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07540b13a0 0x7f07540b1850 secure :-1 s=READY pgs=2096 cs=0 l=1 rx=0x7f074c0032f0 tx=0x7f074c007e00).ready entity=mon.0 client_cookie=5f4d0d97fa3c1e4a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:58.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.488+0000 7f0759f2b700 1 --2- 172.21.15.63:0/4225524922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07540b13a0 0x7f07540b1850 secure :-1 s=THROTTLE_DONE pgs=2096 cs=0 l=1 rx=0x7f074c0032f0 tx=0x7f074c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.488+0000 7f0743fff700 1 -- 172.21.15.63:0/4225524922 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f074c00a180 con 0x7f07540b13a0 2020-05-18T21:37:58.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.488+0000 7f0759f2b700 1 --2- 172.21.15.63:0/4225524922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07540b13a0 0x7f07540b1850 secure :-1 s=THROTTLE_DONE pgs=2096 cs=0 l=1 rx=0x7f074c0032f0 tx=0x7f074c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.488+0000 7f0743fff700 1 -- 172.21.15.63:0/4225524922 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074c00a2e0 con 0x7f07540b13a0 2020-05-18T21:37:58.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.488+0000 7f0759f2b700 1 --2- 172.21.15.63:0/4225524922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07540b13a0 0x7f07540b1850 secure :-1 s=THROTTLE_DONE pgs=2096 cs=0 l=1 rx=0x7f074c0032f0 tx=0x7f074c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.488+0000 7f075a72c700 1 -- 172.21.15.63:0/4225524922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07540b13a0 msgr2=0x7f07540b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:58.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.488+0000 7f0743fff700 1 -- 172.21.15.63:0/4225524922 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f074c00a6c0 con 0x7f07540b13a0 2020-05-18T21:37:58.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.488+0000 7f075a72c700 1 --2- 172.21.15.63:0/4225524922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07540b13a0 0x7f07540b1850 secure :-1 s=READY pgs=2096 cs=0 l=1 rx=0x7f074c0032f0 tx=0x7f074c007e00).stop 2020-05-18T21:37:58.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.488+0000 7f075a72c700 1 -- 172.21.15.63:0/4225524922 shutdown_connections 2020-05-18T21:37:58.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.488+0000 7f075a72c700 1 --2- 172.21.15.63:0/4225524922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07540b13a0 0x7f07540b1850 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:58.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.488+0000 7f075a72c700 1 --2- 172.21.15.63:0/4225524922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07540ac4d0 0x7f07540b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:58.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.488+0000 7f075a72c700 1 -- 172.21.15.63:0/4225524922 >> 172.21.15.63:0/4225524922 conn(0x7f0754066d00 msgr2=0x7f07540b9590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:58.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.488+0000 7f075a72c700 1 -- 172.21.15.63:0/4225524922 shutdown_connections 2020-05-18T21:37:58.501 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.488+0000 7f075a72c700 1 -- 172.21.15.63:0/4225524922 wait complete. 2020-05-18T21:37:58.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.488+0000 7f075a72c700 1 Processor -- start 2020-05-18T21:37:58.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.488+0000 7f075a72c700 1 -- start start 2020-05-18T21:37:58.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f075a72c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07540ac4d0 0x7f075413e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:58.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f075a72c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0754063860 con 0x7f07541402e0 2020-05-18T21:37:58.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f075a72c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075413e950 con 0x7f07540b13a0 2020-05-18T21:37:58.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f075a72c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0754063320 con 0x7f07540ac4d0 2020-05-18T21:37:58.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f075972a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07540ac4d0 0x7f075413e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:58.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f0759f2b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f07541402e0 0x7f075413d200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38656/0 (socket says 172.21.15.63:38656) 2020-05-18T21:37:58.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f0759f2b700 1 -- 172.21.15.63:0/184919978 learned_addr learned my addr 172.21.15.63:0/184919978 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:58.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f07427fc700 1 -- 172.21.15.63:0/184919978 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206610603 0 0) 0x7f0754063860 con 0x7f07541402e0 2020-05-18T21:37:58.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f075972a700 1 -- 172.21.15.63:0/184919978 >> v1:172.21.15.155:6789/0 conn(0x7f07540b13a0 legacy=0x7f0754066320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:58.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f075972a700 1 -- 172.21.15.63:0/184919978 >> v1:172.21.15.63:6789/0 conn(0x7f07541402e0 legacy=0x7f075413d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:58.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f075972a700 1 -- 172.21.15.63:0/184919978 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07540635c0 con 0x7f07540ac4d0 2020-05-18T21:37:58.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f075972a700 1 --2- 172.21.15.63:0/184919978 >> v2:172.21.15.63:3300/0 conn(0x7f07540ac4d0 0x7f075413e4f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0750000bc0 tx=0x7f0750010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f075972a700 1 --2- 172.21.15.63:0/184919978 >> v2:172.21.15.63:3300/0 conn(0x7f07540ac4d0 0x7f075413e4f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0750000bc0 tx=0x7f0750010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f075972a700 1 --2- 172.21.15.63:0/184919978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07540ac4d0 0x7f075413e4f0 secure :-1 s=READY pgs=2098 cs=0 l=1 rx=0x7f0750000bc0 tx=0x7f0750010a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:58.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f075972a700 1 --2- 172.21.15.63:0/184919978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07540ac4d0 0x7f075413e4f0 secure :-1 s=THROTTLE_DONE pgs=2098 cs=0 l=1 rx=0x7f0750000bc0 tx=0x7f0750010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f07427fc700 1 -- 172.21.15.63:0/184919978 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0750005ce0 con 0x7f07540ac4d0 2020-05-18T21:37:58.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f075972a700 1 --2- 172.21.15.63:0/184919978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07540ac4d0 0x7f075413e4f0 secure :-1 s=THROTTLE_DONE pgs=2098 cs=0 l=1 rx=0x7f0750000bc0 tx=0x7f0750010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f07427fc700 1 -- 172.21.15.63:0/184919978 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0750005e40 con 0x7f07540ac4d0 2020-05-18T21:37:58.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f075972a700 1 --2- 172.21.15.63:0/184919978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07540ac4d0 0x7f075413e4f0 secure :-1 s=THROTTLE_DONE pgs=2098 cs=0 l=1 rx=0x7f0750000bc0 tx=0x7f0750010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f07427fc700 1 -- 172.21.15.63:0/184919978 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07500062c0 con 0x7f07540ac4d0 2020-05-18T21:37:58.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f075a72c700 1 -- 172.21.15.63:0/184919978 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0754065fd0 con 0x7f07540ac4d0 2020-05-18T21:37:58.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f075a72c700 1 -- 172.21.15.63:0/184919978 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07541422d0 con 0x7f07540ac4d0 2020-05-18T21:37:58.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f075972a700 1 --2- 172.21.15.63:0/184919978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07540ac4d0 0x7f075413e4f0 secure :-1 s=THROTTLE_DONE pgs=2098 cs=0 l=1 rx=0x7f0750000bc0 tx=0x7f0750010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f075a72c700 1 -- 172.21.15.63:0/184919978 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07540569e0 con 0x7f07540ac4d0 2020-05-18T21:37:58.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f07427fc700 1 -- 172.21.15.63:0/184919978 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0750006540 con 0x7f07540ac4d0 2020-05-18T21:37:58.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.492+0000 7f075972a700 1 --2- 172.21.15.63:0/184919978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07540ac4d0 0x7f075413e4f0 secure :-1 s=THROTTLE_DONE pgs=2098 cs=0 l=1 rx=0x7f0750000bc0 tx=0x7f0750010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.496+0000 7f07427fc700 1 --2- 172.21.15.63:0/184919978 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f073404f810 0x7f0734051cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:58.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.496+0000 7f07427fc700 1 -- 172.21.15.63:0/184919978 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f07500090c0 con 0x7f07540ac4d0 2020-05-18T21:37:58.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.496+0000 7f0758f29700 1 --2- 172.21.15.63:0/184919978 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f073404f810 0x7f0734051cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:58.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.496+0000 7f0758f29700 1 --2- 172.21.15.63:0/184919978 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f073404f810 0x7f0734051cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f075413e080 tx=0x7f0744009530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.496+0000 7f0758f29700 1 --2- 172.21.15.63:0/184919978 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f073404f810 0x7f0734051cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f075413e080 tx=0x7f0744009530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.496+0000 7f0758f29700 1 --2- 172.21.15.63:0/184919978 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f073404f810 0x7f0734051cd0 secure :-1 s=READY pgs=822 cs=0 l=1 rx=0x7f075413e080 tx=0x7f0744009530).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:58.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.500+0000 7f075972a700 1 --2- 172.21.15.63:0/184919978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07540ac4d0 0x7f075413e4f0 secure :-1 s=THROTTLE_DONE pgs=2098 cs=0 l=1 rx=0x7f0750000bc0 tx=0x7f0750010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.511 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.500+0000 7f07427fc700 1 -- 172.21.15.63:0/184919978 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f075003e2e0 con 0x7f07540ac4d0 2020-05-18T21:37:58.662 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.656+0000 7f075a72c700 1 -- 172.21.15.63:0/184919978 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07540afd70 con 0x7f07540ac4d0 2020-05-18T21:37:58.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.656+0000 7f075972a700 1 --2- 172.21.15.63:0/184919978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07540ac4d0 0x7f075413e4f0 secure :-1 s=THROTTLE_DONE pgs=2098 cs=0 l=1 rx=0x7f0750000bc0 tx=0x7f0750010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.656+0000 7f07427fc700 1 -- 172.21.15.63:0/184919978 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) v1 ==== 95+0+2167 (secure 0 0 0) 0x7f0750041900 con 0x7f07540ac4d0 2020-05-18T21:37:58.664 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:58.664 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":137,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":137,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:45.262609+0000","modified":"2020-05-18T21:37:54.083248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":10281,"mds_1":7157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7157":{"gid":7157,"name":"b","rank":1,"incarnation":136,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6835/4038166667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4038166667},{"type":"v1","addr":"172.21.15.155:6835","nonce":4038166667}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_10281":{"gid":10281,"name":"a","rank":0,"incarnation":133,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/2149589625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2149589625},{"type":"v1","addr":"172.21.15.63:6833","nonce":2149589625}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2020-05-18T21:37:58.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.656+0000 7f075a72c700 1 -- 172.21.15.63:0/184919978 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f073404f810 msgr2=0x7f0734051cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:58.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.656+0000 7f075a72c700 1 --2- 172.21.15.63:0/184919978 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f073404f810 0x7f0734051cd0 secure :-1 s=READY pgs=822 cs=0 l=1 rx=0x7f075413e080 tx=0x7f0744009530).stop 2020-05-18T21:37:58.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.656+0000 7f075a72c700 1 -- 172.21.15.63:0/184919978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07540ac4d0 msgr2=0x7f075413e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:58.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.656+0000 7f075a72c700 1 --2- 172.21.15.63:0/184919978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07540ac4d0 0x7f075413e4f0 secure :-1 s=READY pgs=2098 cs=0 l=1 rx=0x7f0750000bc0 tx=0x7f0750010a10).stop 2020-05-18T21:37:58.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.660+0000 7f075a72c700 1 -- 172.21.15.63:0/184919978 shutdown_connections 2020-05-18T21:37:58.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.660+0000 7f075a72c700 1 --2- 172.21.15.63:0/184919978 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f073404f810 0x7f0734051cd0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:58.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.660+0000 7f075a72c700 1 --2- 172.21.15.63:0/184919978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07540ac4d0 0x7f075413e4f0 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:58.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.660+0000 7f075a72c700 1 -- 172.21.15.63:0/184919978 >> 172.21.15.63:0/184919978 conn(0x7f0754066d00 msgr2=0x7f07540b9570 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:58.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.660+0000 7f075a72c700 1 -- 172.21.15.63:0/184919978 shutdown_connections 2020-05-18T21:37:58.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.660+0000 7f075a72c700 1 -- 172.21.15.63:0/184919978 wait complete. 2020-05-18T21:37:58.668 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 137 2020-05-18T21:37:58.676 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:37:58.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.772+0000 7fd973fff700 1 Processor -- start 2020-05-18T21:37:58.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.772+0000 7fd973fff700 1 -- start start 2020-05-18T21:37:58.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.772+0000 7fd973fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd97405f110 0x7fd9740b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:58.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.772+0000 7fd973fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd97414a330 con 0x7fd97414aa70 2020-05-18T21:37:58.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.772+0000 7fd973fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd97414a5d0 con 0x7fd974064fd0 2020-05-18T21:37:58.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.772+0000 7fd973fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd97414a140 con 0x7fd97405f110 2020-05-18T21:37:58.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.772+0000 7fd96bfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd97414aa70 0x7fd9740648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38662/0 (socket says 172.21.15.63:38662) 2020-05-18T21:37:58.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd96bfff700 1 -- 172.21.15.63:0/2658352098 learned_addr learned my addr 172.21.15.63:0/2658352098 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:37:58.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.772+0000 7fd972ffd700 1 --2- 172.21.15.63:0/2658352098 >> v2:172.21.15.63:3300/0 conn(0x7fd97405f110 0x7fd9740b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:58.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd9727fc700 1 -- 172.21.15.63:0/2658352098 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053613411 0 0) 0x7fd97414a330 con 0x7fd97414aa70 2020-05-18T21:37:58.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd9727fc700 1 -- 172.21.15.63:0/2658352098 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd954003270 con 0x7fd97414aa70 2020-05-18T21:37:58.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd9727fc700 1 -- 172.21.15.63:0/2658352098 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4892393 0 0) 0x7fd97414a5d0 con 0x7fd974064fd0 2020-05-18T21:37:58.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd9727fc700 1 -- 172.21.15.63:0/2658352098 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd97414a330 con 0x7fd974064fd0 2020-05-18T21:37:58.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd972ffd700 1 -- 172.21.15.63:0/2658352098 >> v1:172.21.15.155:6789/0 conn(0x7fd974064fd0 legacy=0x7fd97414d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:58.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd972ffd700 1 -- 172.21.15.63:0/2658352098 >> v1:172.21.15.63:6789/0 conn(0x7fd97414aa70 legacy=0x7fd9740648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:58.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd9727fc700 1 -- 172.21.15.63:0/2658352098 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3467552358 0 0) 0x7fd954003270 con 0x7fd97414aa70 2020-05-18T21:37:58.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd972ffd700 1 -- 172.21.15.63:0/2658352098 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd974063430 con 0x7fd97405f110 2020-05-18T21:37:58.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd972ffd700 1 --2- 172.21.15.63:0/2658352098 >> v2:172.21.15.63:3300/0 conn(0x7fd97405f110 0x7fd9740b4760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd95c001110 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd972ffd700 1 --2- 172.21.15.63:0/2658352098 >> v2:172.21.15.63:3300/0 conn(0x7fd97405f110 0x7fd9740b4760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd95c001110 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd972ffd700 1 --2- 172.21.15.63:0/2658352098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd97405f110 0x7fd9740b4760 secure :-1 s=READY pgs=2100 cs=0 l=1 rx=0x7fd95c001110 tx=0x7fd964007a80).ready entity=mon.0 client_cookie=c16bd752185e8a98 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:58.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd972ffd700 1 --2- 172.21.15.63:0/2658352098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd97405f110 0x7fd9740b4760 secure :-1 s=THROTTLE_DONE pgs=2100 cs=0 l=1 rx=0x7fd95c001110 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd9727fc700 1 -- 172.21.15.63:0/2658352098 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd95c001710 con 0x7fd97405f110 2020-05-18T21:37:58.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd972ffd700 1 --2- 172.21.15.63:0/2658352098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd97405f110 0x7fd9740b4760 secure :-1 s=THROTTLE_DONE pgs=2100 cs=0 l=1 rx=0x7fd95c001110 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd9727fc700 1 -- 172.21.15.63:0/2658352098 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd964008e40 con 0x7fd97405f110 2020-05-18T21:37:58.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd972ffd700 1 --2- 172.21.15.63:0/2658352098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd97405f110 0x7fd9740b4760 secure :-1 s=THROTTLE_DONE pgs=2100 cs=0 l=1 rx=0x7fd95c001110 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd9727fc700 1 -- 172.21.15.63:0/2658352098 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd964011440 con 0x7fd97405f110 2020-05-18T21:37:58.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd973fff700 1 -- 172.21.15.63:0/2658352098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd97405f110 msgr2=0x7fd9740b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:58.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd973fff700 1 --2- 172.21.15.63:0/2658352098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd97405f110 0x7fd9740b4760 secure :-1 s=READY pgs=2100 cs=0 l=1 rx=0x7fd95c001110 tx=0x7fd964007a80).stop 2020-05-18T21:37:58.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd973fff700 1 -- 172.21.15.63:0/2658352098 shutdown_connections 2020-05-18T21:37:58.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd973fff700 1 --2- 172.21.15.63:0/2658352098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd97405f110 0x7fd9740b4760 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:58.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd973fff700 1 -- 172.21.15.63:0/2658352098 >> 172.21.15.63:0/2658352098 conn(0x7fd974069fc0 msgr2=0x7fd97406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:58.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd973fff700 1 -- 172.21.15.63:0/2658352098 shutdown_connections 2020-05-18T21:37:58.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.776+0000 7fd973fff700 1 -- 172.21.15.63:0/2658352098 wait complete. 2020-05-18T21:37:58.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.780+0000 7fd973fff700 1 Processor -- start 2020-05-18T21:37:58.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.780+0000 7fd973fff700 1 -- start start 2020-05-18T21:37:58.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.780+0000 7fd973fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd97405f110 0x7fd9741449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:58.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.780+0000 7fd973fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd974064fd0 0x7fd9741578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:58.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.780+0000 7fd973fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9741450e0 con 0x7fd97414aa70 2020-05-18T21:37:58.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.780+0000 7fd973fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd974145380 con 0x7fd97405f110 2020-05-18T21:37:58.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.780+0000 7fd973fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd974145620 con 0x7fd974064fd0 2020-05-18T21:37:58.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.780+0000 7fd972ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd97405f110 0x7fd9741449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:58.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.780+0000 7fd96bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd974064fd0 0x7fd9741578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:58.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.780+0000 7fd972ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd97405f110 0x7fd9741449d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:51328/0 (socket says 172.21.15.63:51328) 2020-05-18T21:37:58.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.780+0000 7fd972ffd700 1 -- 172.21.15.63:0/2160200845 learned_addr learned my addr 172.21.15.63:0/2160200845 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:58.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.780+0000 7fd9737fe700 1 --1- 172.21.15.63:0/2160200845 >> v1:172.21.15.155:6789/0 conn(0x7fd97414aa70 0x7fd9741351a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:36988/0 (socket says 172.21.15.63:36988) 2020-05-18T21:37:58.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd972ffd700 1 -- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd974064fd0 msgr2=0x7fd9741578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:58.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd970ff9700 1 -- 172.21.15.63:0/2160200845 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596383239 0 0) 0x7fd9741450e0 con 0x7fd97414aa70 2020-05-18T21:37:58.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd972ffd700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd974064fd0 0x7fd9741578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:58.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd972ffd700 1 -- 172.21.15.63:0/2160200845 >> v1:172.21.15.155:6789/0 conn(0x7fd97414aa70 legacy=0x7fd9741351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:58.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd972ffd700 1 -- 172.21.15.63:0/2160200845 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd974144e30 con 0x7fd97405f110 2020-05-18T21:37:58.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd96bfff700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd974064fd0 0x7fd9741578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:58.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd972ffd700 1 --2- 172.21.15.63:0/2160200845 >> v2:172.21.15.155:3300/0 conn(0x7fd97405f110 0x7fd9741449d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd95c001110 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd972ffd700 1 --2- 172.21.15.63:0/2160200845 >> v2:172.21.15.155:3300/0 conn(0x7fd97405f110 0x7fd9741449d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd95c001110 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd972ffd700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97405f110 0x7fd9741449d0 secure :-1 s=READY pgs=1401 cs=0 l=1 rx=0x7fd95c001110 tx=0x7fd964007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:58.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd972ffd700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97405f110 0x7fd9741449d0 secure :-1 s=THROTTLE_DONE pgs=1401 cs=0 l=1 rx=0x7fd95c001110 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd970ff9700 1 -- 172.21.15.63:0/2160200845 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd964011c20 con 0x7fd97405f110 2020-05-18T21:37:58.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd972ffd700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97405f110 0x7fd9741449d0 secure :-1 s=THROTTLE_DONE pgs=1401 cs=0 l=1 rx=0x7fd95c001110 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd970ff9700 1 -- 172.21.15.63:0/2160200845 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd964011d80 con 0x7fd97405f110 2020-05-18T21:37:58.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd973fff700 1 -- 172.21.15.63:0/2160200845 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd974157d30 con 0x7fd97405f110 2020-05-18T21:37:58.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd972ffd700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97405f110 0x7fd9741449d0 secure :-1 s=THROTTLE_DONE pgs=1401 cs=0 l=1 rx=0x7fd95c001110 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd970ff9700 1 -- 172.21.15.63:0/2160200845 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd964007360 con 0x7fd97405f110 2020-05-18T21:37:58.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd973fff700 1 -- 172.21.15.63:0/2160200845 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9740ad290 con 0x7fd97405f110 2020-05-18T21:37:58.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd972ffd700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97405f110 0x7fd9741449d0 secure :-1 s=THROTTLE_DONE pgs=1401 cs=0 l=1 rx=0x7fd95c001110 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd973fff700 1 -- 172.21.15.63:0/2160200845 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9740569e0 con 0x7fd97405f110 2020-05-18T21:37:58.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd970ff9700 1 -- 172.21.15.63:0/2160200845 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd964005700 con 0x7fd97405f110 2020-05-18T21:37:58.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd972ffd700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97405f110 0x7fd9741449d0 secure :-1 s=THROTTLE_DONE pgs=1401 cs=0 l=1 rx=0x7fd95c001110 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd970ff9700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd95804f880 0x7fd958051d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:58.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.784+0000 7fd970ff9700 1 -- 172.21.15.63:0/2160200845 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd964064540 con 0x7fd97405f110 2020-05-18T21:37:58.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.788+0000 7fd96bfff700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd95804f880 0x7fd958051d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:58.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.788+0000 7fd96bfff700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd95804f880 0x7fd958051d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd95c000fe0 tx=0x7fd95c00cf70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.788+0000 7fd96bfff700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd95804f880 0x7fd958051d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd95c000fe0 tx=0x7fd95c00cf70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.788+0000 7fd96bfff700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd95804f880 0x7fd958051d40 secure :-1 s=READY pgs=823 cs=0 l=1 rx=0x7fd95c000fe0 tx=0x7fd95c00cf70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:58.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.796+0000 7fd972ffd700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97405f110 0x7fd9741449d0 secure :-1 s=THROTTLE_DONE pgs=1401 cs=0 l=1 rx=0x7fd95c001110 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.796+0000 7fd970ff9700 1 -- 172.21.15.63:0/2160200845 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd96403e9f0 con 0x7fd97405f110 2020-05-18T21:37:58.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.944+0000 7fd973fff700 1 -- 172.21.15.63:0/2160200845 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9740625f0 con 0x7fd97405f110 2020-05-18T21:37:58.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.948+0000 7fd972ffd700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97405f110 0x7fd9741449d0 secure :-1 s=THROTTLE_DONE pgs=1401 cs=0 l=1 rx=0x7fd95c001110 tx=0x7fd964007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:58.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.948+0000 7fd970ff9700 1 -- 172.21.15.63:0/2160200845 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) v1 ==== 95+0+2167 (secure 0 0 0) 0x7fd964042010 con 0x7fd97405f110 2020-05-18T21:37:58.954 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:58.955 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":137,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":137,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:45.262609+0000","modified":"2020-05-18T21:37:54.083248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":10281,"mds_1":7157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7157":{"gid":7157,"name":"b","rank":1,"incarnation":136,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6835/4038166667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4038166667},{"type":"v1","addr":"172.21.15.155:6835","nonce":4038166667}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_10281":{"gid":10281,"name":"a","rank":0,"incarnation":133,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/2149589625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2149589625},{"type":"v1","addr":"172.21.15.63:6833","nonce":2149589625}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2020-05-18T21:37:58.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.948+0000 7fd973fff700 1 -- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd95804f880 msgr2=0x7fd958051d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:58.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.948+0000 7fd973fff700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd95804f880 0x7fd958051d40 secure :-1 s=READY pgs=823 cs=0 l=1 rx=0x7fd95c000fe0 tx=0x7fd95c00cf70).stop 2020-05-18T21:37:58.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.948+0000 7fd973fff700 1 -- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97405f110 msgr2=0x7fd9741449d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:58.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.948+0000 7fd973fff700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97405f110 0x7fd9741449d0 secure :-1 s=READY pgs=1401 cs=0 l=1 rx=0x7fd95c001110 tx=0x7fd964007a80).stop 2020-05-18T21:37:58.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.948+0000 7fd973fff700 1 -- 172.21.15.63:0/2160200845 shutdown_connections 2020-05-18T21:37:58.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.948+0000 7fd973fff700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd95804f880 0x7fd958051d40 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:58.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.948+0000 7fd973fff700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd974064fd0 0x7fd9741578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:58.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.948+0000 7fd973fff700 1 --2- 172.21.15.63:0/2160200845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97405f110 0x7fd9741449d0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:58.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.948+0000 7fd973fff700 1 -- 172.21.15.63:0/2160200845 >> 172.21.15.63:0/2160200845 conn(0x7fd974069fc0 msgr2=0x7fd9741437b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:58.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.948+0000 7fd973fff700 1 -- 172.21.15.63:0/2160200845 shutdown_connections 2020-05-18T21:37:58.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:58.948+0000 7fd973fff700 1 -- 172.21.15.63:0/2160200845 wait complete. 2020-05-18T21:37:58.959 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 137 2020-05-18T21:37:58.967 INFO:tasks.cephfs.test_strays:Ranks 0 and 1 are a and b 2020-05-18T21:37:58.968 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:37:58.971 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:37:59.003 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2020-05-18T21:37:59.003 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2020-05-18T21:37:59.003 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:37:59.003 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2020-05-18T21:37:59.004 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.004 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2020-05-18T21:37:59.004 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.004 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2020-05-18T21:37:59.004 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.005 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2020-05-18T21:37:59.005 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2020-05-18T21:37:59.005 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.005 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2020-05-18T21:37:59.005 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2020-05-18T21:37:59.006 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.006 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:37:59.006 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2020-05-18T21:37:59.006 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.006 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:37:59.007 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:37:59.007 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.007 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2020-05-18T21:37:59.007 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.007 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2020-05-18T21:37:59.008 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2020-05-18T21:37:59.008 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:37:59.008 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:37:59.008 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2020-05-18T21:37:59.008 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:37:59.008 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2020-05-18T21:37:59.009 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:37:59.009 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:37:59.009 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2020-05-18T21:37:59.009 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.009 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:37:59.010 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.010 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2020-05-18T21:37:59.010 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.010 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2020-05-18T21:37:59.010 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.010 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2020-05-18T21:37:59.011 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2020-05-18T21:37:59.011 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:37:59.011 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:37:59.011 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.011 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2020-05-18T21:37:59.012 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2020-05-18T21:37:59.012 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.012 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2020-05-18T21:37:59.012 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2020-05-18T21:37:59.013 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.013 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2020-05-18T21:37:59.013 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2020-05-18T21:37:59.013 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.013 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2020-05-18T21:37:59.013 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2020-05-18T21:37:59.014 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2020-05-18T21:37:59.014 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.014 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2020-05-18T21:37:59.014 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2020-05-18T21:37:59.014 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.015 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:37:59.015 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.015 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2020-05-18T21:37:59.015 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.015 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2020-05-18T21:37:59.015 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.016 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:37:59.016 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2020-05-18T21:37:59.016 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.016 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2020-05-18T21:37:59.016 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2020-05-18T21:37:59.017 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2020-05-18T21:37:59.017 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2020-05-18T21:37:59.017 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2020-05-18T21:37:59.017 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2020-05-18T21:37:59.017 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2020-05-18T21:37:59.017 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2020-05-18T21:37:59.018 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2020-05-18T21:37:59.018 INFO:teuthology.orchestra.run.smithi063.stdout: debug filestore = 20 2020-05-18T21:37:59.018 INFO:teuthology.orchestra.run.smithi063.stdout: debug journal = 20 2020-05-18T21:37:59.018 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 20 2020-05-18T21:37:59.018 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 25 2020-05-18T21:37:59.019 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2020-05-18T21:37:59.019 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:37:59.019 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2020-05-18T21:37:59.019 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:37:59.019 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:37:59.019 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2020-05-18T21:37:59.020 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:37:59.020 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.020 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2020-05-18T21:37:59.020 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:37:59.020 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2020-05-18T21:37:59.021 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:37:59.021 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:37:59.021 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:37:59.021 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:37:59.021 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2020-05-18T21:37:59.021 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.022 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2020-05-18T21:37:59.022 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:37:59.022 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:37:59.022 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2020-05-18T21:37:59.023 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:37:59.023 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2020-05-18T21:37:59.023 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2020-05-18T21:37:59.023 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:37:59.023 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2020-05-18T21:37:59.024 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2020-05-18T21:37:59.024 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:37:59.024 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2020-05-18T21:37:59.024 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:37:59.024 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2020-05-18T21:37:59.024 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2020-05-18T21:37:59.025 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2020-05-18T21:37:59.025 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2020-05-18T21:37:59.025 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:37:59.025 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:37:59.025 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2020-05-18T21:37:59.026 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2020-05-18T21:37:59.026 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:37:59.026 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2020-05-18T21:37:59.026 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2020-05-18T21:37:59.026 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2020-05-18T21:37:59.027 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2020-05-18T21:37:59.027 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2020-05-18T21:37:59.027 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2020-05-18T21:37:59.027 INFO:teuthology.orchestra.run.smithi063.stdout: mds_max_purge_files = 0 2020-05-18T21:37:59.027 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2020-05-18T21:37:59.028 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2020-05-18T21:37:59.028 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:37:59.028 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal frag = True 2020-05-18T21:37:59.028 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal fragment size max = 10000 2020-05-18T21:37:59.028 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal merge size = 5 2020-05-18T21:37:59.029 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split bits = 3 2020-05-18T21:37:59.029 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split size = 100 2020-05-18T21:37:59.029 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2020-05-18T21:37:59.029 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2020-05-18T21:37:59.029 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2020-05-18T21:37:59.030 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2020-05-18T21:37:59.030 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:37:59.031 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2020-05-18T21:37:59.031 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2020-05-18T21:37:59.032 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:37:59.032 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2020-05-18T21:37:59.032 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.032 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2020-05-18T21:37:59.032 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.033 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2020-05-18T21:37:59.033 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.033 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2020-05-18T21:37:59.033 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2020-05-18T21:37:59.034 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.034 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2020-05-18T21:37:59.034 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2020-05-18T21:37:59.034 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.034 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:37:59.035 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2020-05-18T21:37:59.035 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.035 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:37:59.035 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:37:59.035 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.036 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2020-05-18T21:37:59.036 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.036 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2020-05-18T21:37:59.036 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2020-05-18T21:37:59.036 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:37:59.036 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:37:59.037 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2020-05-18T21:37:59.037 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:37:59.037 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2020-05-18T21:37:59.037 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:37:59.037 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:37:59.038 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2020-05-18T21:37:59.038 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.038 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:37:59.038 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.038 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2020-05-18T21:37:59.038 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.039 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2020-05-18T21:37:59.039 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.039 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2020-05-18T21:37:59.039 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2020-05-18T21:37:59.039 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:37:59.039 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:37:59.040 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.040 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2020-05-18T21:37:59.040 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2020-05-18T21:37:59.040 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.040 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2020-05-18T21:37:59.041 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2020-05-18T21:37:59.041 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.041 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2020-05-18T21:37:59.041 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2020-05-18T21:37:59.041 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.041 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2020-05-18T21:37:59.042 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2020-05-18T21:37:59.042 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2020-05-18T21:37:59.042 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.042 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2020-05-18T21:37:59.042 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2020-05-18T21:37:59.043 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.043 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:37:59.043 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.043 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2020-05-18T21:37:59.043 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.044 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2020-05-18T21:37:59.044 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.044 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:37:59.044 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2020-05-18T21:37:59.045 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.045 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2020-05-18T21:37:59.045 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2020-05-18T21:37:59.045 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2020-05-18T21:37:59.045 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2020-05-18T21:37:59.045 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2020-05-18T21:37:59.046 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2020-05-18T21:37:59.046 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2020-05-18T21:37:59.046 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2020-05-18T21:37:59.046 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2020-05-18T21:37:59.047 INFO:teuthology.orchestra.run.smithi155.stdout: debug filestore = 20 2020-05-18T21:37:59.047 INFO:teuthology.orchestra.run.smithi155.stdout: debug journal = 20 2020-05-18T21:37:59.047 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 20 2020-05-18T21:37:59.047 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 25 2020-05-18T21:37:59.047 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2020-05-18T21:37:59.047 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:37:59.048 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2020-05-18T21:37:59.048 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:37:59.048 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:37:59.048 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2020-05-18T21:37:59.048 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:37:59.049 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.049 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2020-05-18T21:37:59.049 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:37:59.050 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2020-05-18T21:37:59.050 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:37:59.050 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:37:59.051 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:37:59.051 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:37:59.051 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2020-05-18T21:37:59.052 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.052 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2020-05-18T21:37:59.052 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:37:59.052 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:37:59.053 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2020-05-18T21:37:59.053 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:37:59.053 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2020-05-18T21:37:59.054 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2020-05-18T21:37:59.054 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:37:59.054 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2020-05-18T21:37:59.055 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2020-05-18T21:37:59.055 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:37:59.055 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2020-05-18T21:37:59.056 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:37:59.056 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2020-05-18T21:37:59.056 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2020-05-18T21:37:59.057 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2020-05-18T21:37:59.057 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2020-05-18T21:37:59.057 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:37:59.058 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:37:59.058 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2020-05-18T21:37:59.058 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2020-05-18T21:37:59.058 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:37:59.058 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2020-05-18T21:37:59.058 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2020-05-18T21:37:59.059 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2020-05-18T21:37:59.059 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2020-05-18T21:37:59.059 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2020-05-18T21:37:59.059 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2020-05-18T21:37:59.059 INFO:teuthology.orchestra.run.smithi155.stdout: mds_max_purge_files = 0 2020-05-18T21:37:59.060 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2020-05-18T21:37:59.060 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2020-05-18T21:37:59.060 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:37:59.060 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal frag = True 2020-05-18T21:37:59.060 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2020-05-18T21:37:59.061 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2020-05-18T21:37:59.061 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2020-05-18T21:37:59.061 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2020-05-18T21:37:59.061 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2020-05-18T21:37:59.061 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2020-05-18T21:37:59.062 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2020-05-18T21:37:59.062 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2020-05-18T21:37:59.062 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:37:59.062 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:37:59.063 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:37:59.090 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:37:59.091 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail b 2020-05-18T21:37:59.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.196+0000 7f02672e5700 1 Processor -- start 2020-05-18T21:37:59.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.196+0000 7f02672e5700 1 -- start start 2020-05-18T21:37:59.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f02672e5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02600b3ee0 0x7f02600b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:59.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f02672e5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0260141f40 0x7f0260145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:37:59.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f02672e5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02600b37e0 con 0x7f026005b340 2020-05-18T21:37:59.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f02672e5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02600adb50 con 0x7f0260141f40 2020-05-18T21:37:59.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f02672e5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02600ad8b0 con 0x7f02600b3ee0 2020-05-18T21:37:59.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f0266ae4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0260141f40 0x7f0260145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:59.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f0266ae4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0260141f40 0x7f0260145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36492/0 (socket says 172.21.15.63:36492) 2020-05-18T21:37:59.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f0266ae4700 1 -- 172.21.15.63:0/3979784446 learned_addr learned my addr 172.21.15.63:0/3979784446 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:59.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f0265ae2700 1 --2- 172.21.15.63:0/3979784446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02600b3ee0 0x7f02600b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:59.211 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f02652e1700 1 -- 172.21.15.63:0/3979784446 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707544245 0 0) 0x7f02600b37e0 con 0x7f026005b340 2020-05-18T21:37:59.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f0266ae4700 1 -- 172.21.15.63:0/3979784446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02600b3ee0 msgr2=0x7f02600b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:37:59.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3979784446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02600b3ee0 0x7f02600b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:59.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f0266ae4700 1 -- 172.21.15.63:0/3979784446 >> v1:172.21.15.155:6789/0 conn(0x7f026005b340 legacy=0x7f0260141830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:59.212 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f0266ae4700 1 -- 172.21.15.63:0/3979784446 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026005b720 con 0x7f0260141f40 2020-05-18T21:37:59.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3979784446 >> v2:172.21.15.63:3300/0 conn(0x7f0260141f40 0x7f0260145950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f02580032f0 tx=0x7f0258007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:59.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3979784446 >> v2:172.21.15.63:3300/0 conn(0x7f0260141f40 0x7f0260145950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f02580032f0 tx=0x7f0258007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:59.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3979784446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0260141f40 0x7f0260145950 secure :-1 s=READY pgs=2101 cs=0 l=1 rx=0x7f02580032f0 tx=0x7f0258007e00).ready entity=mon.0 client_cookie=a0f15510044c78e7 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:59.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3979784446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0260141f40 0x7f0260145950 secure :-1 s=THROTTLE_DONE pgs=2101 cs=0 l=1 rx=0x7f02580032f0 tx=0x7f0258007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:59.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f02652e1700 1 -- 172.21.15.63:0/3979784446 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0258011d10 con 0x7f0260141f40 2020-05-18T21:37:59.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3979784446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0260141f40 0x7f0260145950 secure :-1 s=THROTTLE_DONE pgs=2101 cs=0 l=1 rx=0x7f02580032f0 tx=0x7f0258007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:59.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3979784446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0260141f40 0x7f0260145950 secure :-1 s=THROTTLE_DONE pgs=2101 cs=0 l=1 rx=0x7f02580032f0 tx=0x7f0258007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:59.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f02652e1700 1 -- 172.21.15.63:0/3979784446 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0258011e70 con 0x7f0260141f40 2020-05-18T21:37:59.214 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f02652e1700 1 -- 172.21.15.63:0/3979784446 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f025800a370 con 0x7f0260141f40 2020-05-18T21:37:59.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f02672e5700 1 -- 172.21.15.63:0/3979784446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0260141f40 msgr2=0x7f0260145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:59.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.200+0000 7f02672e5700 1 --2- 172.21.15.63:0/3979784446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0260141f40 0x7f0260145950 secure :-1 s=READY pgs=2101 cs=0 l=1 rx=0x7f02580032f0 tx=0x7f0258007e00).stop 2020-05-18T21:37:59.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.204+0000 7f02672e5700 1 -- 172.21.15.63:0/3979784446 shutdown_connections 2020-05-18T21:37:59.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.204+0000 7f02672e5700 1 --2- 172.21.15.63:0/3979784446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0260141f40 0x7f0260145950 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:59.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.204+0000 7f02672e5700 1 --2- 172.21.15.63:0/3979784446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02600b3ee0 0x7f02600b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:37:59.215 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.204+0000 7f02672e5700 1 -- 172.21.15.63:0/3979784446 >> 172.21.15.63:0/3979784446 conn(0x7f02600b8320 msgr2=0x7f02600b8730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:37:59.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.204+0000 7f02672e5700 1 -- 172.21.15.63:0/3979784446 shutdown_connections 2020-05-18T21:37:59.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.204+0000 7f02672e5700 1 -- 172.21.15.63:0/3979784446 wait complete. 2020-05-18T21:37:59.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.204+0000 7f02672e5700 1 Processor -- start 2020-05-18T21:37:59.216 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.204+0000 7f02672e5700 1 -- start start 2020-05-18T21:37:59.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.204+0000 7f02672e5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f026005b340 0x7f0260155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:59.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.204+0000 7f02672e5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02600b3ee0 0x7f0260154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:59.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.204+0000 7f02672e5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0260141f40 0x7f0260062310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:59.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.204+0000 7f02672e5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0260155a90 con 0x7f0260141f40 2020-05-18T21:37:59.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.204+0000 7f02672e5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0260155370 con 0x7f026005b340 2020-05-18T21:37:59.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.204+0000 7f02672e5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0260112830 con 0x7f02600b3ee0 2020-05-18T21:37:59.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.204+0000 7f0266ae4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0260141f40 0x7f0260062310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:59.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f02662e3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f026005b340 0x7f0260155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:59.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f0265ae2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02600b3ee0 0x7f0260154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:59.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f0266ae4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0260141f40 0x7f0260062310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36498/0 (socket says 172.21.15.63:36498) 2020-05-18T21:37:59.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f0266ae4700 1 -- 172.21.15.63:0/3565405709 learned_addr learned my addr 172.21.15.63:0/3565405709 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:37:59.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f0266ae4700 1 -- 172.21.15.63:0/3565405709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02600b3ee0 msgr2=0x7f0260154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:59.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02600b3ee0 0x7f0260154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:59.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f0266ae4700 1 -- 172.21.15.63:0/3565405709 >> v2:172.21.15.155:3300/0 conn(0x7f026005b340 msgr2=0x7f0260155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:37:59.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3565405709 >> v2:172.21.15.155:3300/0 conn(0x7f026005b340 0x7f0260155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:37:59.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f0266ae4700 1 -- 172.21.15.63:0/3565405709 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0260112ad0 con 0x7f0260141f40 2020-05-18T21:37:59.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f02662e3700 1 --2- 172.21.15.63:0/3565405709 >> v2:172.21.15.155:3300/0 conn(0x7f026005b340 0x7f0260155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:37:59.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3565405709 >> v2:172.21.15.63:3300/0 conn(0x7f0260141f40 0x7f0260062310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f02580032f0 tx=0x7f0258007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:59.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3565405709 >> v2:172.21.15.63:3300/0 conn(0x7f0260141f40 0x7f0260062310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f02580032f0 tx=0x7f0258007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:59.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0260141f40 0x7f0260062310 secure :-1 s=READY pgs=2102 cs=0 l=1 rx=0x7f02580032f0 tx=0x7f0258007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:59.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0260141f40 0x7f0260062310 secure :-1 s=THROTTLE_DONE pgs=2102 cs=0 l=1 rx=0x7f02580032f0 tx=0x7f0258007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:59.223 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0260141f40 0x7f0260062310 secure :-1 s=THROTTLE_DONE pgs=2102 cs=0 l=1 rx=0x7f02580032f0 tx=0x7f0258007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:59.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f024f7fe700 1 -- 172.21.15.63:0/3565405709 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0258005a80 con 0x7f0260141f40 2020-05-18T21:37:59.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0260141f40 0x7f0260062310 secure :-1 s=THROTTLE_DONE pgs=2102 cs=0 l=1 rx=0x7f02580032f0 tx=0x7f0258007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:59.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f024f7fe700 1 -- 172.21.15.63:0/3565405709 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0258005be0 con 0x7f0260141f40 2020-05-18T21:37:59.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f02672e5700 1 -- 172.21.15.63:0/3565405709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0260112530 con 0x7f0260141f40 2020-05-18T21:37:59.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f024f7fe700 1 -- 172.21.15.63:0/3565405709 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0258007170 con 0x7f0260141f40 2020-05-18T21:37:59.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f02672e5700 1 -- 172.21.15.63:0/3565405709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0260065d20 con 0x7f0260141f40 2020-05-18T21:37:59.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0260141f40 0x7f0260062310 secure :-1 s=THROTTLE_DONE pgs=2102 cs=0 l=1 rx=0x7f02580032f0 tx=0x7f0258007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:59.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f02672e5700 1 -- 172.21.15.63:0/3565405709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02600569e0 con 0x7f0260141f40 2020-05-18T21:37:59.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.208+0000 7f024f7fe700 1 -- 172.21.15.63:0/3565405709 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f02580072d0 con 0x7f0260141f40 2020-05-18T21:37:59.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.212+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0260141f40 0x7f0260062310 secure :-1 s=THROTTLE_DONE pgs=2102 cs=0 l=1 rx=0x7f02580032f0 tx=0x7f0258007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.212+0000 7f024f7fe700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024004fb40 0x7f0240052000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:37:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.212+0000 7f024f7fe700 1 -- 172.21.15.63:0/3565405709 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f02580648e0 con 0x7f0260141f40 2020-05-18T21:37:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.212+0000 7f02662e3700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024004fb40 0x7f0240052000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:37:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.212+0000 7f02662e3700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024004fb40 0x7f0240052000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0250000ed0 tx=0x7f025000cc80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.212+0000 7f02662e3700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024004fb40 0x7f0240052000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0250000ed0 tx=0x7f025000cc80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.212+0000 7f02662e3700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024004fb40 0x7f0240052000 secure :-1 s=READY pgs=824 cs=0 l=1 rx=0x7f0250000ed0 tx=0x7f025000cc80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:37:59.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.220+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0260141f40 0x7f0260062310 secure :-1 s=THROTTLE_DONE pgs=2102 cs=0 l=1 rx=0x7f02580032f0 tx=0x7f0258007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:37:59.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.220+0000 7f024f7fe700 1 -- 172.21.15.63:0/3565405709 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f025803ed30 con 0x7f0260141f40 2020-05-18T21:37:59.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:37:59.372+0000 7f02672e5700 1 -- 172.21.15.63:0/3565405709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f02600af220 con 0x7f0260141f40 2020-05-18T21:38:00.213 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.208+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0260141f40 0x7f0260062310 secure :-1 s=READY pgs=2102 cs=0 l=1 rx=0x7f02580032f0 tx=0x7f0258007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:00.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.300+0000 7f0266ae4700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0260141f40 0x7f0260062310 secure :-1 s=THROTTLE_DONE pgs=2102 cs=0 l=1 rx=0x7f02580032f0 tx=0x7f0258007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:00.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.300+0000 7f024f7fe700 1 -- 172.21.15.63:0/3565405709 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 7157 v138) v1 ==== 95+0+0 (secure 0 0 0) 0x7f0258042350 con 0x7f0260141f40 2020-05-18T21:38:00.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.304+0000 7f02672e5700 1 -- 172.21.15.63:0/3565405709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024004fb40 msgr2=0x7f0240052000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:00.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.304+0000 7f02672e5700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024004fb40 0x7f0240052000 secure :-1 s=READY pgs=824 cs=0 l=1 rx=0x7f0250000ed0 tx=0x7f025000cc80).stop 2020-05-18T21:38:00.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.304+0000 7f02672e5700 1 -- 172.21.15.63:0/3565405709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0260141f40 msgr2=0x7f0260062310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:00.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.304+0000 7f02672e5700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0260141f40 0x7f0260062310 secure :-1 s=READY pgs=2102 cs=0 l=1 rx=0x7f02580032f0 tx=0x7f0258007e00).stop 2020-05-18T21:38:00.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.304+0000 7f02672e5700 1 -- 172.21.15.63:0/3565405709 shutdown_connections 2020-05-18T21:38:00.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.304+0000 7f02672e5700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f024004fb40 0x7f0240052000 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:00.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.304+0000 7f02672e5700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0260141f40 0x7f0260062310 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:00.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.304+0000 7f02672e5700 1 --2- 172.21.15.63:0/3565405709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02600b3ee0 0x7f0260154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:00.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.304+0000 7f02672e5700 1 --2- 172.21.15.63:0/3565405709 >> v2:172.21.15.155:3300/0 conn(0x7f026005b340 0x7f0260155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:00.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.304+0000 7f02672e5700 1 -- 172.21.15.63:0/3565405709 >> 172.21.15.63:0/3565405709 conn(0x7f02600b8320 msgr2=0x7f0260141490 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:00.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.304+0000 7f02672e5700 1 -- 172.21.15.63:0/3565405709 shutdown_connections 2020-05-18T21:38:00.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.304+0000 7f02672e5700 1 -- 172.21.15.63:0/3565405709 wait complete. 2020-05-18T21:38:00.315 INFO:teuthology.orchestra.run.smithi063.stderr:failed mds gid 7157 2020-05-18T21:38:00.329 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:38:00.330 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:38:00.333 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:38:00.333 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:38:00.411 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:38:00.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.436+0000 7fe21f0b8700 1 Processor -- start 2020-05-18T21:38:00.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.436+0000 7fe21f0b8700 1 -- start start 2020-05-18T21:38:00.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.436+0000 7fe21f0b8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe2180b97d0 0x7fe218146f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:00.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.436+0000 7fe21f0b8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe2180b9bb0 0x7fe21809c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:00.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.436+0000 7fe21f0b8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21809eb60 con 0x7fe2181424a0 2020-05-18T21:38:00.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.436+0000 7fe21f0b8700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe21809e900 con 0x7fe2180b97d0 2020-05-18T21:38:00.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.436+0000 7fe21f0b8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe218063a80 con 0x7fe2180b9bb0 2020-05-18T21:38:00.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21ce54700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe2180b97d0 0x7fe218146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:00.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21d655700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe2181424a0 0x7fe218063f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38692/0 (socket says 172.21.15.63:38692) 2020-05-18T21:38:00.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21d655700 1 -- 172.21.15.63:0/882019034 learned_addr learned my addr 172.21.15.63:0/882019034 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:00.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21ce54700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe2180b97d0 0x7fe218146f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36506/0 (socket says 172.21.15.63:36506) 2020-05-18T21:38:00.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe217fff700 1 --2- 172.21.15.63:0/882019034 >> v2:172.21.15.155:3300/0 conn(0x7fe2180b9bb0 0x7fe21809c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:00.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21ce54700 1 -- 172.21.15.63:0/882019034 >> v2:172.21.15.155:3300/0 conn(0x7fe2180b9bb0 msgr2=0x7fe21809c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:00.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21ce54700 1 --2- 172.21.15.63:0/882019034 >> v2:172.21.15.155:3300/0 conn(0x7fe2180b9bb0 0x7fe21809c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:00.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21ce54700 1 -- 172.21.15.63:0/882019034 >> v1:172.21.15.63:6789/0 conn(0x7fe2181424a0 legacy=0x7fe218063f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:00.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21ce54700 1 -- 172.21.15.63:0/882019034 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2181473c0 con 0x7fe2180b97d0 2020-05-18T21:38:00.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe2177fe700 1 -- 172.21.15.63:0/882019034 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880660512 0 0) 0x7fe21809eb60 con 0x7fe2181424a0 2020-05-18T21:38:00.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe217fff700 1 --2- 172.21.15.63:0/882019034 >> v2:172.21.15.155:3300/0 conn(0x7fe2180b9bb0 0x7fe21809c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:38:00.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21ce54700 1 --2- 172.21.15.63:0/882019034 >> v2:172.21.15.63:3300/0 conn(0x7fe2180b97d0 0x7fe218146f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe20c002f70 tx=0x7fe20c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:00.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21ce54700 1 --2- 172.21.15.63:0/882019034 >> v2:172.21.15.63:3300/0 conn(0x7fe2180b97d0 0x7fe218146f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe20c002f70 tx=0x7fe20c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:00.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21ce54700 1 --2- 172.21.15.63:0/882019034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2180b97d0 0x7fe218146f60 secure :-1 s=READY pgs=2104 cs=0 l=1 rx=0x7fe20c002f70 tx=0x7fe20c007a80).ready entity=mon.0 client_cookie=f49bece4ff4f763d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:00.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21ce54700 1 --2- 172.21.15.63:0/882019034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2180b97d0 0x7fe218146f60 secure :-1 s=THROTTLE_DONE pgs=2104 cs=0 l=1 rx=0x7fe20c002f70 tx=0x7fe20c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:00.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe2177fe700 1 -- 172.21.15.63:0/882019034 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe20c008e50 con 0x7fe2180b97d0 2020-05-18T21:38:00.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21ce54700 1 --2- 172.21.15.63:0/882019034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2180b97d0 0x7fe218146f60 secure :-1 s=THROTTLE_DONE pgs=2104 cs=0 l=1 rx=0x7fe20c002f70 tx=0x7fe20c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:00.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21ce54700 1 --2- 172.21.15.63:0/882019034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2180b97d0 0x7fe218146f60 secure :-1 s=THROTTLE_DONE pgs=2104 cs=0 l=1 rx=0x7fe20c002f70 tx=0x7fe20c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:00.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe2177fe700 1 -- 172.21.15.63:0/882019034 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20c0115f0 con 0x7fe2180b97d0 2020-05-18T21:38:00.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe2177fe700 1 -- 172.21.15.63:0/882019034 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe20c0119d0 con 0x7fe2180b97d0 2020-05-18T21:38:00.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21f0b8700 1 -- 172.21.15.63:0/882019034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2180b97d0 msgr2=0x7fe218146f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:00.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21f0b8700 1 --2- 172.21.15.63:0/882019034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2180b97d0 0x7fe218146f60 secure :-1 s=READY pgs=2104 cs=0 l=1 rx=0x7fe20c002f70 tx=0x7fe20c007a80).stop 2020-05-18T21:38:00.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21f0b8700 1 -- 172.21.15.63:0/882019034 shutdown_connections 2020-05-18T21:38:00.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21f0b8700 1 --2- 172.21.15.63:0/882019034 >> v2:172.21.15.155:3300/0 conn(0x7fe2180b9bb0 0x7fe21809c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:00.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21f0b8700 1 --2- 172.21.15.63:0/882019034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2180b97d0 0x7fe218146f60 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:00.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21f0b8700 1 -- 172.21.15.63:0/882019034 >> 172.21.15.63:0/882019034 conn(0x7fe21805f060 msgr2=0x7fe21805f470 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:00.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21f0b8700 1 -- 172.21.15.63:0/882019034 shutdown_connections 2020-05-18T21:38:00.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.440+0000 7fe21f0b8700 1 -- 172.21.15.63:0/882019034 wait complete. 2020-05-18T21:38:00.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.444+0000 7fe21f0b8700 1 Processor -- start 2020-05-18T21:38:00.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.444+0000 7fe21f0b8700 1 -- start start 2020-05-18T21:38:00.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.444+0000 7fe21f0b8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2180b97d0 0x7fe2181443c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:00.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.444+0000 7fe21f0b8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe2180b9bb0 0x7fe218066910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:00.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.444+0000 7fe21f0b8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2181465b0 con 0x7fe2181424a0 2020-05-18T21:38:00.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.444+0000 7fe21f0b8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe218146850 con 0x7fe2180b9bb0 2020-05-18T21:38:00.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.444+0000 7fe21f0b8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21814d0f0 con 0x7fe2180b97d0 2020-05-18T21:38:00.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.444+0000 7fe21d655700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe2181424a0 0x7fe21814c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38700/0 (socket says 172.21.15.63:38700) 2020-05-18T21:38:00.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.444+0000 7fe21d655700 1 -- 172.21.15.63:0/3317546080 learned_addr learned my addr 172.21.15.63:0/3317546080 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:00.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.444+0000 7fe217fff700 1 --2- 172.21.15.63:0/3317546080 >> v2:172.21.15.155:3300/0 conn(0x7fe2180b9bb0 0x7fe218066910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:00.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.444+0000 7fe21ce54700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2180b97d0 0x7fe2181443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:00.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.444+0000 7fe215ffb700 1 -- 172.21.15.63:0/3317546080 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 586047703 0 0) 0x7fe2181465b0 con 0x7fe2181424a0 2020-05-18T21:38:00.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.444+0000 7fe215ffb700 1 -- 172.21.15.63:0/3317546080 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe200002fe0 con 0x7fe2181424a0 2020-05-18T21:38:00.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe215ffb700 1 -- 172.21.15.63:0/3317546080 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1844162803 0 0) 0x7fe200002fe0 con 0x7fe2181424a0 2020-05-18T21:38:00.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe215ffb700 1 -- 172.21.15.63:0/3317546080 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe2181465b0 con 0x7fe2181424a0 2020-05-18T21:38:00.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe215ffb700 1 -- 172.21.15.63:0/3317546080 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fe210001c20 con 0x7fe2181424a0 2020-05-18T21:38:00.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe215ffb700 1 -- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2180b97d0 msgr2=0x7fe2181443c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:00.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe215ffb700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2180b97d0 0x7fe2181443c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:00.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe215ffb700 1 -- 172.21.15.63:0/3317546080 >> v2:172.21.15.155:3300/0 conn(0x7fe2180b9bb0 msgr2=0x7fe218066910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:00.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe215ffb700 1 --2- 172.21.15.63:0/3317546080 >> v2:172.21.15.155:3300/0 conn(0x7fe2180b9bb0 0x7fe218066910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:00.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe215ffb700 1 -- 172.21.15.63:0/3317546080 >> v1:172.21.15.63:6789/0 conn(0x7fe2181424a0 legacy=0x7fe21814c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:00.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe215ffb700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe200004a80 0x7fe200004e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:00.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe215ffb700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000039a0 0x7fe200003de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:00.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe215ffb700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe200004240 0x7fe20000b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:00.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe215ffb700 1 -- 172.21.15.63:0/3317546080 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe218146850 con 0x7fe200004a80 2020-05-18T21:38:00.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe215ffb700 1 -- 172.21.15.63:0/3317546080 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21814d0f0 con 0x7fe200004240 2020-05-18T21:38:00.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe215ffb700 1 -- 172.21.15.63:0/3317546080 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20000bbc0 con 0x7fe2000039a0 2020-05-18T21:38:00.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe217fff700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000039a0 0x7fe200003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:00.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe21ce54700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe200004a80 0x7fe200004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:00.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe21d655700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe200004240 0x7fe20000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:00.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe217fff700 1 -- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe200004240 msgr2=0x7fe20000b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:00.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe217fff700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe200004240 0x7fe20000b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:00.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe217fff700 1 -- 172.21.15.63:0/3317546080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe200004a80 msgr2=0x7fe200004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:00.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe217fff700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe200004a80 0x7fe200004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:00.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe217fff700 1 -- 172.21.15.63:0/3317546080 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21814d260 con 0x7fe2000039a0 2020-05-18T21:38:00.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe21f0b8700 1 -- 172.21.15.63:0/3317546080 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2181443c0 con 0x7fe2000039a0 2020-05-18T21:38:00.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe217fff700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000039a0 0x7fe200003de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe204002f70 tx=0x7fe204008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:00.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe21f0b8700 1 -- 172.21.15.63:0/3317546080 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe218150ca0 con 0x7fe2000039a0 2020-05-18T21:38:00.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe217fff700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000039a0 0x7fe200003de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe204002f70 tx=0x7fe204008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:00.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe217fff700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000039a0 0x7fe200003de0 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7fe204002f70 tx=0x7fe204008020).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:00.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe217fff700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000039a0 0x7fe200003de0 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7fe204002f70 tx=0x7fe204008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:00.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe217fff700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000039a0 0x7fe200003de0 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7fe204002f70 tx=0x7fe204008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:00.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe215ffb700 1 -- 172.21.15.63:0/3317546080 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe204011ac0 con 0x7fe2000039a0 2020-05-18T21:38:00.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe217fff700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000039a0 0x7fe200003de0 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7fe204002f70 tx=0x7fe204008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:00.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe215ffb700 1 -- 172.21.15.63:0/3317546080 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe204011c20 con 0x7fe2000039a0 2020-05-18T21:38:00.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe215ffb700 1 -- 172.21.15.63:0/3317546080 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe204007170 con 0x7fe2000039a0 2020-05-18T21:38:00.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe21f0b8700 1 -- 172.21.15.63:0/3317546080 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f4003380 con 0x7fe2000039a0 2020-05-18T21:38:00.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe217fff700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000039a0 0x7fe200003de0 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7fe204002f70 tx=0x7fe204008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:00.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe215ffb700 1 -- 172.21.15.63:0/3317546080 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe2040072d0 con 0x7fe2000039a0 2020-05-18T21:38:00.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.448+0000 7fe217fff700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000039a0 0x7fe200003de0 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7fe204002f70 tx=0x7fe204008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:00.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.452+0000 7fe215ffb700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe2000581d0 0x7fe20005a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:00.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.452+0000 7fe215ffb700 1 -- 172.21.15.63:0/3317546080 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe204063ac0 con 0x7fe2000039a0 2020-05-18T21:38:00.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.452+0000 7fe21ce54700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe2000581d0 0x7fe20005a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:00.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.452+0000 7fe21ce54700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe2000581d0 0x7fe20005a690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe20c002f70 tx=0x7fe20c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:00.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.452+0000 7fe21ce54700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe2000581d0 0x7fe20005a690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe20c002f70 tx=0x7fe20c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:00.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.452+0000 7fe21ce54700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe2000581d0 0x7fe20005a690 secure :-1 s=READY pgs=825 cs=0 l=1 rx=0x7fe20c002f70 tx=0x7fe20c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:00.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.460+0000 7fe217fff700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000039a0 0x7fe200003de0 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7fe204002f70 tx=0x7fe204008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:00.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.460+0000 7fe215ffb700 1 -- 172.21.15.63:0/3317546080 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe20403df70 con 0x7fe2000039a0 2020-05-18T21:38:00.537 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:38:00.540 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:38:00.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.608+0000 7fe21f0b8700 1 -- 172.21.15.63:0/3317546080 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1f4003720 con 0x7fe2000039a0 2020-05-18T21:38:00.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.612+0000 7fe217fff700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000039a0 0x7fe200003de0 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7fe204002f70 tx=0x7fe204008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:00.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.612+0000 7fe215ffb700 1 -- 172.21.15.63:0/3317546080 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 138 v138) v1 ==== 95+0+1801 (secure 0 0 0) 0x7fe204041590 con 0x7fe2000039a0 2020-05-18T21:38:00.618 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:00.618 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":138,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":138,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:45.262609+0000","modified":"2020-05-18T21:38:00.291058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":158,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":10281},"failed":[1],"damaged":[],"stopped":[],"info":{"gid_10281":{"gid":10281,"name":"a","rank":0,"incarnation":133,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/2149589625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2149589625},{"type":"v1","addr":"172.21.15.63:6833","nonce":2149589625}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2020-05-18T21:38:00.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.612+0000 7fe21f0b8700 1 -- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe2000581d0 msgr2=0x7fe20005a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:00.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.612+0000 7fe21f0b8700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe2000581d0 0x7fe20005a690 secure :-1 s=READY pgs=825 cs=0 l=1 rx=0x7fe20c002f70 tx=0x7fe20c007a80).stop 2020-05-18T21:38:00.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.612+0000 7fe21f0b8700 1 -- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000039a0 msgr2=0x7fe200003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:00.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.612+0000 7fe21f0b8700 1 --2- 172.21.15.63:0/3317546080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2000039a0 0x7fe200003de0 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7fe204002f70 tx=0x7fe204008020).stop 2020-05-18T21:38:00.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.612+0000 7fe21d655700 1 -- 172.21.15.63:0/3317546080 reap_dead start 2020-05-18T21:38:00.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.612+0000 7fe21f0b8700 1 -- 172.21.15.63:0/3317546080 shutdown_connections 2020-05-18T21:38:00.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.612+0000 7fe21f0b8700 1 -- 172.21.15.63:0/3317546080 >> 172.21.15.63:0/3317546080 conn(0x7fe21805f060 msgr2=0x7fe2180b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:00.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.612+0000 7fe21f0b8700 1 -- 172.21.15.63:0/3317546080 shutdown_connections 2020-05-18T21:38:00.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:00.612+0000 7fe21f0b8700 1 -- 172.21.15.63:0/3317546080 wait complete. 2020-05-18T21:38:00.623 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 138 2020-05-18T21:38:00.838 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 138, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:37:45.262609+0000', 'modified': '2020-05-18T21:38:00.291058+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 158, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 10281}, 'failed': [1], 'damaged': [], 'stopped': [], 'info': {'gid_10281': {'gid': 10281, 'name': 'a', 'rank': 0, 'incarnation': 133, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/2149589625', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 2149589625}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 2149589625}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:38:00.842 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/2 2020-05-18T21:38:01.844 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:38:01.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f622c04b700 1 Processor -- start 2020-05-18T21:38:01.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f622c04b700 1 -- start start 2020-05-18T21:38:01.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f622c04b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f62240b78e0 0x7f62240b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:01.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f622c04b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6224066330 0x7f6224145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:01.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f622c04b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6224066e00 con 0x7f6224146430 2020-05-18T21:38:01.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f622c04b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6224066b60 con 0x7f6224066330 2020-05-18T21:38:01.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f622c04b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62241496f0 con 0x7f62240b78e0 2020-05-18T21:38:01.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f62295e6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6224066330 0x7f6224145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:01.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f622a5e8700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6224146430 0x7f62240b8fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38714/0 (socket says 172.21.15.63:38714) 2020-05-18T21:38:01.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f622a5e8700 1 -- 172.21.15.63:0/354690435 learned_addr learned my addr 172.21.15.63:0/354690435 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:01.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f6229de7700 1 --2- 172.21.15.63:0/354690435 >> v2:172.21.15.155:3300/0 conn(0x7f62240b78e0 0x7f62240b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:01.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f62295e6700 1 -- 172.21.15.63:0/354690435 >> v2:172.21.15.155:3300/0 conn(0x7f62240b78e0 msgr2=0x7f62240b7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:01.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f62295e6700 1 --2- 172.21.15.63:0/354690435 >> v2:172.21.15.155:3300/0 conn(0x7f62240b78e0 0x7f62240b7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:01.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f62295e6700 1 -- 172.21.15.63:0/354690435 >> v1:172.21.15.63:6789/0 conn(0x7f6224146430 legacy=0x7f62240b8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:01.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f62295e6700 1 -- 172.21.15.63:0/354690435 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62240b8120 con 0x7f6224066330 2020-05-18T21:38:01.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f62295e6700 1 --2- 172.21.15.63:0/354690435 >> v2:172.21.15.63:3300/0 conn(0x7f6224066330 0x7f6224145fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6214002f70 tx=0x7f6214007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:01.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f62295e6700 1 --2- 172.21.15.63:0/354690435 >> v2:172.21.15.63:3300/0 conn(0x7f6224066330 0x7f6224145fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6214002f70 tx=0x7f6214007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:01.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f62295e6700 1 --2- 172.21.15.63:0/354690435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6224066330 0x7f6224145fd0 secure :-1 s=READY pgs=2107 cs=0 l=1 rx=0x7f6214002f70 tx=0x7f6214007a80).ready entity=mon.0 client_cookie=2b424190e8b4d696 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:01.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f62295e6700 1 --2- 172.21.15.63:0/354690435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6224066330 0x7f6224145fd0 secure :-1 s=THROTTLE_DONE pgs=2107 cs=0 l=1 rx=0x7f6214002f70 tx=0x7f6214007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:01.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f62295e6700 1 --2- 172.21.15.63:0/354690435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6224066330 0x7f6224145fd0 secure :-1 s=THROTTLE_DONE pgs=2107 cs=0 l=1 rx=0x7f6214002f70 tx=0x7f6214007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:01.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f6228de5700 1 -- 172.21.15.63:0/354690435 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6214008e50 con 0x7f6224066330 2020-05-18T21:38:01.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f62295e6700 1 --2- 172.21.15.63:0/354690435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6224066330 0x7f6224145fd0 secure :-1 s=THROTTLE_DONE pgs=2107 cs=0 l=1 rx=0x7f6214002f70 tx=0x7f6214007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:01.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f6228de5700 1 -- 172.21.15.63:0/354690435 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62140115f0 con 0x7f6224066330 2020-05-18T21:38:01.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f6228de5700 1 -- 172.21.15.63:0/354690435 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6214011a10 con 0x7f6224066330 2020-05-18T21:38:01.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f622c04b700 1 -- 172.21.15.63:0/354690435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6224066330 msgr2=0x7f6224145fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:01.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.952+0000 7f622c04b700 1 --2- 172.21.15.63:0/354690435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6224066330 0x7f6224145fd0 secure :-1 s=READY pgs=2107 cs=0 l=1 rx=0x7f6214002f70 tx=0x7f6214007a80).stop 2020-05-18T21:38:01.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622c04b700 1 -- 172.21.15.63:0/354690435 shutdown_connections 2020-05-18T21:38:01.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622c04b700 1 --2- 172.21.15.63:0/354690435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6224066330 0x7f6224145fd0 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:01.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622c04b700 1 --2- 172.21.15.63:0/354690435 >> v2:172.21.15.155:3300/0 conn(0x7f62240b78e0 0x7f62240b7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:01.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622c04b700 1 -- 172.21.15.63:0/354690435 >> 172.21.15.63:0/354690435 conn(0x7f622405b1a0 msgr2=0x7f622405b580 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:01.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622c04b700 1 -- 172.21.15.63:0/354690435 shutdown_connections 2020-05-18T21:38:01.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622c04b700 1 -- 172.21.15.63:0/354690435 wait complete. 2020-05-18T21:38:01.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622c04b700 1 Processor -- start 2020-05-18T21:38:01.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622c04b700 1 -- start start 2020-05-18T21:38:01.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622c04b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6224066330 0x7f6224145230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:01.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622c04b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f62240b78e0 0x7f62240ad620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:01.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622c04b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6224146430 0x7f6224157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:01.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622c04b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6224142d90 con 0x7f6224146430 2020-05-18T21:38:01.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622c04b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6224140700 con 0x7f62240b78e0 2020-05-18T21:38:01.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622c04b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6224157690 con 0x7f6224066330 2020-05-18T21:38:01.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622a5e8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6224146430 0x7f6224157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:01.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622a5e8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6224146430 0x7f6224157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36532/0 (socket says 172.21.15.63:36532) 2020-05-18T21:38:01.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622a5e8700 1 -- 172.21.15.63:0/3721007740 learned_addr learned my addr 172.21.15.63:0/3721007740 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:01.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f6229de7700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6224066330 0x7f6224145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:01.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f62295e6700 1 --2- 172.21.15.63:0/3721007740 >> v2:172.21.15.155:3300/0 conn(0x7f62240b78e0 0x7f62240ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:01.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622a5e8700 1 -- 172.21.15.63:0/3721007740 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6224066330 msgr2=0x7f6224145230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:01.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622a5e8700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6224066330 0x7f6224145230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:01.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622a5e8700 1 -- 172.21.15.63:0/3721007740 >> v2:172.21.15.155:3300/0 conn(0x7f62240b78e0 msgr2=0x7f62240ad620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:01.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622a5e8700 1 --2- 172.21.15.63:0/3721007740 >> v2:172.21.15.155:3300/0 conn(0x7f62240b78e0 0x7f62240ad620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:01.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622a5e8700 1 -- 172.21.15.63:0/3721007740 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62240adbe0 con 0x7f6224146430 2020-05-18T21:38:01.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f6229de7700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6224066330 0x7f6224145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:38:01.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f62295e6700 1 --2- 172.21.15.63:0/3721007740 >> v2:172.21.15.155:3300/0 conn(0x7f62240b78e0 0x7f62240ad620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:38:01.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622a5e8700 1 --2- 172.21.15.63:0/3721007740 >> v2:172.21.15.63:3300/0 conn(0x7f6224146430 0x7f6224157230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6224145d30 tx=0x7f621c010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:01.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622a5e8700 1 --2- 172.21.15.63:0/3721007740 >> v2:172.21.15.63:3300/0 conn(0x7f6224146430 0x7f6224157230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6224145d30 tx=0x7f621c010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:01.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.956+0000 7f622a5e8700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6224146430 0x7f6224157230 secure :-1 s=READY pgs=2108 cs=0 l=1 rx=0x7f6224145d30 tx=0x7f621c010d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:01.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.960+0000 7f622a5e8700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6224146430 0x7f6224157230 secure :-1 s=THROTTLE_DONE pgs=2108 cs=0 l=1 rx=0x7f6224145d30 tx=0x7f621c010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:01.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.960+0000 7f6212ffd700 1 -- 172.21.15.63:0/3721007740 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f621c005e30 con 0x7f6224146430 2020-05-18T21:38:01.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.960+0000 7f622a5e8700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6224146430 0x7f6224157230 secure :-1 s=THROTTLE_DONE pgs=2108 cs=0 l=1 rx=0x7f6224145d30 tx=0x7f621c010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:01.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.960+0000 7f6212ffd700 1 -- 172.21.15.63:0/3721007740 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c0125c0 con 0x7f6224146430 2020-05-18T21:38:01.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.960+0000 7f622a5e8700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6224146430 0x7f6224157230 secure :-1 s=THROTTLE_DONE pgs=2108 cs=0 l=1 rx=0x7f6224145d30 tx=0x7f621c010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:01.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.960+0000 7f622c04b700 1 -- 172.21.15.63:0/3721007740 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6224140930 con 0x7f6224146430 2020-05-18T21:38:01.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.960+0000 7f6212ffd700 1 -- 172.21.15.63:0/3721007740 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f621c0129e0 con 0x7f6224146430 2020-05-18T21:38:01.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.960+0000 7f622c04b700 1 -- 172.21.15.63:0/3721007740 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6224150cc0 con 0x7f6224146430 2020-05-18T21:38:01.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.960+0000 7f622c04b700 1 -- 172.21.15.63:0/3721007740 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62240569e0 con 0x7f6224146430 2020-05-18T21:38:01.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.960+0000 7f622a5e8700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6224146430 0x7f6224157230 secure :-1 s=THROTTLE_DONE pgs=2108 cs=0 l=1 rx=0x7f6224145d30 tx=0x7f621c010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:01.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.960+0000 7f6212ffd700 1 -- 172.21.15.63:0/3721007740 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f621c012c60 con 0x7f6224146430 2020-05-18T21:38:01.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.960+0000 7f622a5e8700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6224146430 0x7f6224157230 secure :-1 s=THROTTLE_DONE pgs=2108 cs=0 l=1 rx=0x7f6224145d30 tx=0x7f621c010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:01.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.960+0000 7f6212ffd700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f620404f9e0 0x7f6204051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:01.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.960+0000 7f6212ffd700 1 -- 172.21.15.63:0/3721007740 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f621c0090c0 con 0x7f6224146430 2020-05-18T21:38:01.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.960+0000 7f6229de7700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f620404f9e0 0x7f6204051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:01.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.964+0000 7f6229de7700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f620404f9e0 0x7f6204051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6220002f70 tx=0x7f622000c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:01.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.964+0000 7f6229de7700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f620404f9e0 0x7f6204051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6220002f70 tx=0x7f622000c8a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:01.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.964+0000 7f6229de7700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f620404f9e0 0x7f6204051ea0 secure :-1 s=READY pgs=827 cs=0 l=1 rx=0x7f6220002f70 tx=0x7f622000c8a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:01.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.968+0000 7f622a5e8700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6224146430 0x7f6224157230 secure :-1 s=THROTTLE_DONE pgs=2108 cs=0 l=1 rx=0x7f6224145d30 tx=0x7f621c010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:01.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:01.968+0000 7f6212ffd700 1 -- 172.21.15.63:0/3721007740 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f621c03e930 con 0x7f6224146430 2020-05-18T21:38:02.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:02.120+0000 7f622c04b700 1 -- 172.21.15.63:0/3721007740 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62240b5080 con 0x7f6224146430 2020-05-18T21:38:02.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:02.120+0000 7f622a5e8700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6224146430 0x7f6224157230 secure :-1 s=THROTTLE_DONE pgs=2108 cs=0 l=1 rx=0x7f6224145d30 tx=0x7f621c010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:02.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:02.120+0000 7f6212ffd700 1 -- 172.21.15.63:0/3721007740 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 140 v140) v1 ==== 95+0+2169 (secure 0 0 0) 0x7f621c041f50 con 0x7f6224146430 2020-05-18T21:38:02.128 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:02.128 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":140,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":140,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:45.262609+0000","modified":"2020-05-18T21:38:01.310248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":158,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":10281,"mds_1":10222},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10222":{"gid":10222,"name":"b","rank":1,"incarnation":140,"state":"up:replay","state_seq":1,"addr":"172.21.15.155:6835/942326202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":942326202},{"type":"v1","addr":"172.21.15.155:6835","nonce":942326202}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_10281":{"gid":10281,"name":"a","rank":0,"incarnation":133,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/2149589625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2149589625},{"type":"v1","addr":"172.21.15.63:6833","nonce":2149589625}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2020-05-18T21:38:02.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:02.120+0000 7f622c04b700 1 -- 172.21.15.63:0/3721007740 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f620404f9e0 msgr2=0x7f6204051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:02.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:02.120+0000 7f622c04b700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f620404f9e0 0x7f6204051ea0 secure :-1 s=READY pgs=827 cs=0 l=1 rx=0x7f6220002f70 tx=0x7f622000c8a0).stop 2020-05-18T21:38:02.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:02.120+0000 7f622c04b700 1 -- 172.21.15.63:0/3721007740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6224146430 msgr2=0x7f6224157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:02.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:02.120+0000 7f622c04b700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6224146430 0x7f6224157230 secure :-1 s=READY pgs=2108 cs=0 l=1 rx=0x7f6224145d30 tx=0x7f621c010d70).stop 2020-05-18T21:38:02.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:02.120+0000 7f622c04b700 1 -- 172.21.15.63:0/3721007740 shutdown_connections 2020-05-18T21:38:02.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:02.120+0000 7f622c04b700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f620404f9e0 0x7f6204051ea0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:02.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:02.120+0000 7f622c04b700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6224146430 0x7f6224157230 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:02.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:02.120+0000 7f622c04b700 1 --2- 172.21.15.63:0/3721007740 >> v2:172.21.15.155:3300/0 conn(0x7f62240b78e0 0x7f62240ad620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:02.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:02.120+0000 7f622c04b700 1 --2- 172.21.15.63:0/3721007740 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6224066330 0x7f6224145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:02.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:02.120+0000 7f622c04b700 1 -- 172.21.15.63:0/3721007740 >> 172.21.15.63:0/3721007740 conn(0x7f622405b1a0 msgr2=0x7f62240b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:02.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:02.120+0000 7f622c04b700 1 -- 172.21.15.63:0/3721007740 shutdown_connections 2020-05-18T21:38:02.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:02.120+0000 7f622c04b700 1 -- 172.21.15.63:0/3721007740 wait complete. 2020-05-18T21:38:02.133 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 140 2020-05-18T21:38:02.341 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 140, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:37:45.262609+0000', 'modified': '2020-05-18T21:38:01.310248+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 158, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 10281, 'mds_1': 10222}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10222': {'gid': 10222, 'name': 'b', 'rank': 1, 'incarnation': 140, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.155:6835/942326202', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 942326202}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 942326202}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}, 'gid_10281': {'gid': 10281, 'name': 'a', 'rank': 0, 'incarnation': 133, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/2149589625', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 2149589625}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 2149589625}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:38:02.341 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_10222:up:replay 2020-05-18T21:38:03.342 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:38:03.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.448+0000 7f985bfff700 1 Processor -- start 2020-05-18T21:38:03.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.448+0000 7f985bfff700 1 -- start start 2020-05-18T21:38:03.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.448+0000 7f985bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f985c0b60a0 0x7f985c05b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:03.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.448+0000 7f985bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f985c141800 0x7f985c141c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:03.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.448+0000 7f985bfff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985c0b2fe0 con 0x7f985c145930 2020-05-18T21:38:03.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.448+0000 7f985bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985c0ae600 con 0x7f985c141800 2020-05-18T21:38:03.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.448+0000 7f985bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985c0ae7f0 con 0x7f985c0b60a0 2020-05-18T21:38:03.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.448+0000 7f985a7fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f985c145930 0x7f985c0af1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38728/0 (socket says 172.21.15.63:38728) 2020-05-18T21:38:03.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.448+0000 7f985a7fc700 1 -- 172.21.15.63:0/1665895448 learned_addr learned my addr 172.21.15.63:0/1665895448 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:03.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.448+0000 7f985b7fe700 1 --2- 172.21.15.63:0/1665895448 >> v2:172.21.15.63:3300/0 conn(0x7f985c141800 0x7f985c141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:03.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.448+0000 7f985affd700 1 --2- 172.21.15.63:0/1665895448 >> v2:172.21.15.155:3300/0 conn(0x7f985c0b60a0 0x7f985c05b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:03.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f9859ffb700 1 -- 172.21.15.63:0/1665895448 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705410319 0 0) 0x7f985c0b2fe0 con 0x7f985c145930 2020-05-18T21:38:03.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f9859ffb700 1 -- 172.21.15.63:0/1665895448 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9840003270 con 0x7f985c145930 2020-05-18T21:38:03.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f985affd700 1 -- 172.21.15.63:0/1665895448 >> v2:172.21.15.63:3300/0 conn(0x7f985c141800 msgr2=0x7f985c141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:03.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f985affd700 1 --2- 172.21.15.63:0/1665895448 >> v2:172.21.15.63:3300/0 conn(0x7f985c141800 0x7f985c141c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:03.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f985affd700 1 -- 172.21.15.63:0/1665895448 >> v1:172.21.15.63:6789/0 conn(0x7f985c145930 legacy=0x7f985c0af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:03.461 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f9859ffb700 1 -- 172.21.15.63:0/1665895448 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 618334417 0 0) 0x7f9840003270 con 0x7f985c145930 2020-05-18T21:38:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f985affd700 1 -- 172.21.15.63:0/1665895448 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c0aea90 con 0x7f985c0b60a0 2020-05-18T21:38:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f985affd700 1 --2- 172.21.15.63:0/1665895448 >> v2:172.21.15.155:3300/0 conn(0x7f985c0b60a0 0x7f985c05b460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f98500018b0 tx=0x7f984c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f985affd700 1 --2- 172.21.15.63:0/1665895448 >> v2:172.21.15.155:3300/0 conn(0x7f985c0b60a0 0x7f985c05b460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f98500018b0 tx=0x7f984c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f985affd700 1 --2- 172.21.15.63:0/1665895448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c0b60a0 0x7f985c05b460 secure :-1 s=READY pgs=1407 cs=0 l=1 rx=0x7f98500018b0 tx=0x7f984c007a80).ready entity=mon.1 client_cookie=b38fc550f98a41ca server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f985affd700 1 --2- 172.21.15.63:0/1665895448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c0b60a0 0x7f985c05b460 secure :-1 s=THROTTLE_DONE pgs=1407 cs=0 l=1 rx=0x7f98500018b0 tx=0x7f984c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:03.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f9859ffb700 1 -- 172.21.15.63:0/1665895448 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9850001710 con 0x7f985c0b60a0 2020-05-18T21:38:03.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f985affd700 1 --2- 172.21.15.63:0/1665895448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c0b60a0 0x7f985c05b460 secure :-1 s=THROTTLE_DONE pgs=1407 cs=0 l=1 rx=0x7f98500018b0 tx=0x7f984c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:03.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f9859ffb700 1 -- 172.21.15.63:0/1665895448 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984c008b80 con 0x7f985c0b60a0 2020-05-18T21:38:03.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f985affd700 1 --2- 172.21.15.63:0/1665895448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c0b60a0 0x7f985c05b460 secure :-1 s=THROTTLE_DONE pgs=1407 cs=0 l=1 rx=0x7f98500018b0 tx=0x7f984c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:03.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f9859ffb700 1 -- 172.21.15.63:0/1665895448 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f984c0113d0 con 0x7f985c0b60a0 2020-05-18T21:38:03.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f985bfff700 1 -- 172.21.15.63:0/1665895448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c0b60a0 msgr2=0x7f985c05b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:03.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f985bfff700 1 --2- 172.21.15.63:0/1665895448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c0b60a0 0x7f985c05b460 secure :-1 s=READY pgs=1407 cs=0 l=1 rx=0x7f98500018b0 tx=0x7f984c007a80).stop 2020-05-18T21:38:03.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f985bfff700 1 -- 172.21.15.63:0/1665895448 shutdown_connections 2020-05-18T21:38:03.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f985bfff700 1 --2- 172.21.15.63:0/1665895448 >> v2:172.21.15.63:3300/0 conn(0x7f985c141800 0x7f985c141c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:03.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f985bfff700 1 --2- 172.21.15.63:0/1665895448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c0b60a0 0x7f985c05b460 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:03.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f985bfff700 1 -- 172.21.15.63:0/1665895448 >> 172.21.15.63:0/1665895448 conn(0x7f985c0b9680 msgr2=0x7f985c0b5650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:03.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f985bfff700 1 -- 172.21.15.63:0/1665895448 shutdown_connections 2020-05-18T21:38:03.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.452+0000 7f985bfff700 1 -- 172.21.15.63:0/1665895448 wait complete. 2020-05-18T21:38:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985bfff700 1 Processor -- start 2020-05-18T21:38:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985bfff700 1 -- start start 2020-05-18T21:38:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f985c0b60a0 0x7f985c153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:03.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f985c141800 0x7f985c1540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:03.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985bfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985c09cd40 con 0x7f985c145930 2020-05-18T21:38:03.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985c13eaa0 con 0x7f985c0b60a0 2020-05-18T21:38:03.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985bfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c153e90 con 0x7f985c141800 2020-05-18T21:38:03.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985a7fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f985c141800 0x7f985c1540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985affd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f985c0b60a0 0x7f985c153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985b7fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f985c145930 0x7f985c09a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:37052/0 (socket says 172.21.15.63:37052) 2020-05-18T21:38:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985a7fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f985c141800 0x7f985c1540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:55480/0 (socket says 172.21.15.63:55480) 2020-05-18T21:38:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985affd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f985c0b60a0 0x7f985c153a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:51392/0 (socket says 172.21.15.63:51392) 2020-05-18T21:38:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985b7fe700 1 -- 172.21.15.63:0/2471334308 learned_addr learned my addr 172.21.15.63:0/2471334308 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f984bfff700 1 -- 172.21.15.63:0/2471334308 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209538491 0 0) 0x7f985c09cd40 con 0x7f985c145930 2020-05-18T21:38:03.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f984bfff700 1 -- 172.21.15.63:0/2471334308 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9838002fe0 con 0x7f985c145930 2020-05-18T21:38:03.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985affd700 1 -- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f985c141800 msgr2=0x7f985c1540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:03.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985affd700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f985c141800 0x7f985c1540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:03.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985affd700 1 -- 172.21.15.63:0/2471334308 >> v1:172.21.15.155:6789/0 conn(0x7f985c145930 legacy=0x7f985c09a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:03.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985affd700 1 -- 172.21.15.63:0/2471334308 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c143240 con 0x7f985c0b60a0 2020-05-18T21:38:03.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985a7fc700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f985c141800 0x7f985c1540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:38:03.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985affd700 1 --2- 172.21.15.63:0/2471334308 >> v2:172.21.15.155:3300/0 conn(0x7f985c0b60a0 0x7f985c153a30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f98500018b0 tx=0x7f984c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:03.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985affd700 1 --2- 172.21.15.63:0/2471334308 >> v2:172.21.15.155:3300/0 conn(0x7f985c0b60a0 0x7f985c153a30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f98500018b0 tx=0x7f984c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:03.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.456+0000 7f985affd700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c0b60a0 0x7f985c153a30 secure :-1 s=READY pgs=1409 cs=0 l=1 rx=0x7f98500018b0 tx=0x7f984c007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:03.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.460+0000 7f985affd700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c0b60a0 0x7f985c153a30 secure :-1 s=THROTTLE_DONE pgs=1409 cs=0 l=1 rx=0x7f98500018b0 tx=0x7f984c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.460+0000 7f984bfff700 1 -- 172.21.15.63:0/2471334308 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f984c007360 con 0x7f985c0b60a0 2020-05-18T21:38:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.460+0000 7f985affd700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c0b60a0 0x7f985c153a30 secure :-1 s=THROTTLE_DONE pgs=1409 cs=0 l=1 rx=0x7f98500018b0 tx=0x7f984c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.460+0000 7f985affd700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c0b60a0 0x7f985c153a30 secure :-1 s=THROTTLE_DONE pgs=1409 cs=0 l=1 rx=0x7f98500018b0 tx=0x7f984c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.460+0000 7f984bfff700 1 -- 172.21.15.63:0/2471334308 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984c0074c0 con 0x7f985c0b60a0 2020-05-18T21:38:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.460+0000 7f985bfff700 1 -- 172.21.15.63:0/2471334308 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985c1434e0 con 0x7f985c0b60a0 2020-05-18T21:38:03.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.460+0000 7f984bfff700 1 -- 172.21.15.63:0/2471334308 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f984c007630 con 0x7f985c0b60a0 2020-05-18T21:38:03.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.460+0000 7f985bfff700 1 -- 172.21.15.63:0/2471334308 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985c154540 con 0x7f985c0b60a0 2020-05-18T21:38:03.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.460+0000 7f985bfff700 1 -- 172.21.15.63:0/2471334308 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985c143c30 con 0x7f985c0b60a0 2020-05-18T21:38:03.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.460+0000 7f985affd700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c0b60a0 0x7f985c153a30 secure :-1 s=THROTTLE_DONE pgs=1409 cs=0 l=1 rx=0x7f98500018b0 tx=0x7f984c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:03.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.460+0000 7f984bfff700 1 -- 172.21.15.63:0/2471334308 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f984c0119d0 con 0x7f985c0b60a0 2020-05-18T21:38:03.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.460+0000 7f985affd700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c0b60a0 0x7f985c153a30 secure :-1 s=THROTTLE_DONE pgs=1409 cs=0 l=1 rx=0x7f98500018b0 tx=0x7f984c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:03.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.460+0000 7f984bfff700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f983804fd50 0x7f9838052210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:03.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.460+0000 7f984bfff700 1 -- 172.21.15.63:0/2471334308 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f984c0642f0 con 0x7f985c0b60a0 2020-05-18T21:38:03.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.460+0000 7f985a7fc700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f983804fd50 0x7f9838052210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:03.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.460+0000 7f985a7fc700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f983804fd50 0x7f9838052210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9850001970 tx=0x7f985000cf50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:03.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.460+0000 7f985a7fc700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f983804fd50 0x7f9838052210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9850001970 tx=0x7f985000cf50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:03.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.460+0000 7f985a7fc700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f983804fd50 0x7f9838052210 secure :-1 s=READY pgs=828 cs=0 l=1 rx=0x7f9850001970 tx=0x7f985000cf50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:03.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.468+0000 7f985affd700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c0b60a0 0x7f985c153a30 secure :-1 s=THROTTLE_DONE pgs=1409 cs=0 l=1 rx=0x7f98500018b0 tx=0x7f984c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:03.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.468+0000 7f984bfff700 1 -- 172.21.15.63:0/2471334308 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f985c143c30 con 0x7f985c0b60a0 2020-05-18T21:38:03.623 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.616+0000 7f985bfff700 1 -- 172.21.15.63:0/2471334308 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f985c143c30 con 0x7f985c0b60a0 2020-05-18T21:38:03.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.616+0000 7f985affd700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c0b60a0 0x7f985c153a30 secure :-1 s=THROTTLE_DONE pgs=1409 cs=0 l=1 rx=0x7f98500018b0 tx=0x7f984c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:03.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.616+0000 7f984bfff700 1 -- 172.21.15.63:0/2471334308 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 142 v142) v1 ==== 95+0+2172 (secure 0 0 0) 0x7f985c143c30 con 0x7f985c0b60a0 2020-05-18T21:38:03.624 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:03.625 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":142,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":142,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:45.262609+0000","modified":"2020-05-18T21:38:03.321178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":158,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":10281,"mds_1":10222},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10222":{"gid":10222,"name":"b","rank":1,"incarnation":140,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.155:6835/942326202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":942326202},{"type":"v1","addr":"172.21.15.155:6835","nonce":942326202}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_10281":{"gid":10281,"name":"a","rank":0,"incarnation":133,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/2149589625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2149589625},{"type":"v1","addr":"172.21.15.63:6833","nonce":2149589625}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2020-05-18T21:38:03.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.620+0000 7f985bfff700 1 -- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f983804fd50 msgr2=0x7f9838052210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:03.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.620+0000 7f985bfff700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f983804fd50 0x7f9838052210 secure :-1 s=READY pgs=828 cs=0 l=1 rx=0x7f9850001970 tx=0x7f985000cf50).stop 2020-05-18T21:38:03.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.620+0000 7f985bfff700 1 -- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c0b60a0 msgr2=0x7f985c153a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:03.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.620+0000 7f985bfff700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c0b60a0 0x7f985c153a30 secure :-1 s=READY pgs=1409 cs=0 l=1 rx=0x7f98500018b0 tx=0x7f984c007a80).stop 2020-05-18T21:38:03.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.620+0000 7f985bfff700 1 -- 172.21.15.63:0/2471334308 shutdown_connections 2020-05-18T21:38:03.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.620+0000 7f985bfff700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f983804fd50 0x7f9838052210 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:03.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.620+0000 7f985bfff700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f985c141800 0x7f985c1540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:03.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.620+0000 7f985bfff700 1 --2- 172.21.15.63:0/2471334308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c0b60a0 0x7f985c153a30 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:03.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.620+0000 7f985bfff700 1 -- 172.21.15.63:0/2471334308 >> 172.21.15.63:0/2471334308 conn(0x7f985c0b9680 msgr2=0x7f985c0618c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:03.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.620+0000 7f985bfff700 1 -- 172.21.15.63:0/2471334308 shutdown_connections 2020-05-18T21:38:03.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:03.620+0000 7f985bfff700 1 -- 172.21.15.63:0/2471334308 wait complete. 2020-05-18T21:38:03.629 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 142 2020-05-18T21:38:03.840 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 142, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:37:45.262609+0000', 'modified': '2020-05-18T21:38:03.321178+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 158, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 10281, 'mds_1': 10222}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10222': {'gid': 10222, 'name': 'b', 'rank': 1, 'incarnation': 140, 'state': 'up:reconnect', 'state_seq': 3, 'addr': '172.21.15.155:6835/942326202', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 942326202}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 942326202}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}, 'gid_10281': {'gid': 10281, 'name': 'a', 'rank': 0, 'incarnation': 133, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/2149589625', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 2149589625}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 2149589625}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:38:03.840 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_10222:up:reconnect 2020-05-18T21:38:04.841 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:38:04.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.944+0000 7fe37cc7d700 1 Processor -- start 2020-05-18T21:38:04.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.944+0000 7fe37cc7d700 1 -- start start 2020-05-18T21:38:04.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe37cc7d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe37805aab0 0x7fe3780affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:04.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe37cc7d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe3780af0c0 0x7fe37814e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:04.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe37cc7d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3780b43f0 con 0x7fe37814e770 2020-05-18T21:38:04.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe37cc7d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37814dbd0 con 0x7fe3780af0c0 2020-05-18T21:38:04.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe37cc7d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37814de70 con 0x7fe37805aab0 2020-05-18T21:38:04.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe375d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe3780af0c0 0x7fe37814e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:04.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe376d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe37814e770 0x7fe3781333c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38742/0 (socket says 172.21.15.63:38742) 2020-05-18T21:38:04.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe376d9d700 1 -- 172.21.15.63:0/690059542 learned_addr learned my addr 172.21.15.63:0/690059542 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:04.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe37659c700 1 --2- 172.21.15.63:0/690059542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe37805aab0 0x7fe3780affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:04.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe375d9b700 1 -- 172.21.15.63:0/690059542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe37805aab0 msgr2=0x7fe3780affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:04.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe375d9b700 1 --2- 172.21.15.63:0/690059542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe37805aab0 0x7fe3780affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:04.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe375d9b700 1 -- 172.21.15.63:0/690059542 >> v1:172.21.15.63:6789/0 conn(0x7fe37814e770 legacy=0x7fe3781333c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:04.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe375d9b700 1 -- 172.21.15.63:0/690059542 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37805ae90 con 0x7fe3780af0c0 2020-05-18T21:38:04.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe37659c700 1 --2- 172.21.15.63:0/690059542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe37805aab0 0x7fe3780affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:38:04.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe375d9b700 1 --2- 172.21.15.63:0/690059542 >> v2:172.21.15.63:3300/0 conn(0x7fe3780af0c0 0x7fe37814e310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe360002f70 tx=0x7fe360007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:04.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe375d9b700 1 --2- 172.21.15.63:0/690059542 >> v2:172.21.15.63:3300/0 conn(0x7fe3780af0c0 0x7fe37814e310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe360002f70 tx=0x7fe360007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:04.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe375d9b700 1 --2- 172.21.15.63:0/690059542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3780af0c0 0x7fe37814e310 secure :-1 s=READY pgs=2111 cs=0 l=1 rx=0x7fe360002f70 tx=0x7fe360007a80).ready entity=mon.0 client_cookie=3c0b9d7c4cf2fc61 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:04.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe375d9b700 1 --2- 172.21.15.63:0/690059542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3780af0c0 0x7fe37814e310 secure :-1 s=THROTTLE_DONE pgs=2111 cs=0 l=1 rx=0x7fe360002f70 tx=0x7fe360007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:04.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe37559a700 1 -- 172.21.15.63:0/690059542 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe360008e80 con 0x7fe3780af0c0 2020-05-18T21:38:04.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe375d9b700 1 --2- 172.21.15.63:0/690059542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3780af0c0 0x7fe37814e310 secure :-1 s=THROTTLE_DONE pgs=2111 cs=0 l=1 rx=0x7fe360002f70 tx=0x7fe360007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:04.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe375d9b700 1 --2- 172.21.15.63:0/690059542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3780af0c0 0x7fe37814e310 secure :-1 s=THROTTLE_DONE pgs=2111 cs=0 l=1 rx=0x7fe360002f70 tx=0x7fe360007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:04.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe37559a700 1 -- 172.21.15.63:0/690059542 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3600116a0 con 0x7fe3780af0c0 2020-05-18T21:38:04.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe37559a700 1 -- 172.21.15.63:0/690059542 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe360011ac0 con 0x7fe3780af0c0 2020-05-18T21:38:04.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe37cc7d700 1 -- 172.21.15.63:0/690059542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3780af0c0 msgr2=0x7fe37814e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:04.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe37cc7d700 1 --2- 172.21.15.63:0/690059542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3780af0c0 0x7fe37814e310 secure :-1 s=READY pgs=2111 cs=0 l=1 rx=0x7fe360002f70 tx=0x7fe360007a80).stop 2020-05-18T21:38:04.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe37cc7d700 1 -- 172.21.15.63:0/690059542 shutdown_connections 2020-05-18T21:38:04.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe37cc7d700 1 --2- 172.21.15.63:0/690059542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3780af0c0 0x7fe37814e310 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:04.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe37cc7d700 1 --2- 172.21.15.63:0/690059542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe37805aab0 0x7fe3780affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:04.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe37cc7d700 1 -- 172.21.15.63:0/690059542 >> 172.21.15.63:0/690059542 conn(0x7fe37806a500 msgr2=0x7fe3780b84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:04.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe37cc7d700 1 -- 172.21.15.63:0/690059542 shutdown_connections 2020-05-18T21:38:04.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.948+0000 7fe37cc7d700 1 -- 172.21.15.63:0/690059542 wait complete. 2020-05-18T21:38:04.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe37cc7d700 1 Processor -- start 2020-05-18T21:38:04.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe37cc7d700 1 -- start start 2020-05-18T21:38:04.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe37cc7d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe3780af0c0 0x7fe3780630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:04.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe37cc7d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe378063500 0x7fe378131ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:04.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe37cc7d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe378062100 con 0x7fe37805aab0 2020-05-18T21:38:04.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe37cc7d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3780623a0 con 0x7fe3780af0c0 2020-05-18T21:38:04.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe37cc7d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe378062cc0 con 0x7fe378063500 2020-05-18T21:38:04.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe375d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe3780af0c0 0x7fe3780630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:04.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe375d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe3780af0c0 0x7fe3780630a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36560/0 (socket says 172.21.15.63:36560) 2020-05-18T21:38:04.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe375d9b700 1 -- 172.21.15.63:0/22793056 learned_addr learned my addr 172.21.15.63:0/22793056 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:04.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe376d9d700 1 --2- 172.21.15.63:0/22793056 >> v2:172.21.15.155:3300/0 conn(0x7fe378063500 0x7fe378131ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:04.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe375d9b700 1 -- 172.21.15.63:0/22793056 >> v2:172.21.15.155:3300/0 conn(0x7fe378063500 msgr2=0x7fe378131ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:04.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe375d9b700 1 --2- 172.21.15.63:0/22793056 >> v2:172.21.15.155:3300/0 conn(0x7fe378063500 0x7fe378131ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:04.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe375d9b700 1 -- 172.21.15.63:0/22793056 >> v1:172.21.15.155:6789/0 conn(0x7fe37805aab0 legacy=0x7fe3780616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:04.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe375d9b700 1 -- 172.21.15.63:0/22793056 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe378065aa0 con 0x7fe3780af0c0 2020-05-18T21:38:04.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe375d9b700 1 --2- 172.21.15.63:0/22793056 >> v2:172.21.15.63:3300/0 conn(0x7fe3780af0c0 0x7fe3780630a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe360002f70 tx=0x7fe360007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:04.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe375d9b700 1 --2- 172.21.15.63:0/22793056 >> v2:172.21.15.63:3300/0 conn(0x7fe3780af0c0 0x7fe3780630a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe360002f70 tx=0x7fe360007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:04.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe375d9b700 1 --2- 172.21.15.63:0/22793056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3780af0c0 0x7fe3780630a0 secure :-1 s=READY pgs=2112 cs=0 l=1 rx=0x7fe360002f70 tx=0x7fe360007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:04.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe375d9b700 1 --2- 172.21.15.63:0/22793056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3780af0c0 0x7fe3780630a0 secure :-1 s=THROTTLE_DONE pgs=2112 cs=0 l=1 rx=0x7fe360002f70 tx=0x7fe360007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:04.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe36f7fe700 1 -- 172.21.15.63:0/22793056 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe360008770 con 0x7fe3780af0c0 2020-05-18T21:38:04.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe375d9b700 1 --2- 172.21.15.63:0/22793056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3780af0c0 0x7fe3780630a0 secure :-1 s=THROTTLE_DONE pgs=2112 cs=0 l=1 rx=0x7fe360002f70 tx=0x7fe360007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:04.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe36f7fe700 1 -- 172.21.15.63:0/22793056 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe360007360 con 0x7fe3780af0c0 2020-05-18T21:38:04.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.952+0000 7fe375d9b700 1 --2- 172.21.15.63:0/22793056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3780af0c0 0x7fe3780630a0 secure :-1 s=THROTTLE_DONE pgs=2112 cs=0 l=1 rx=0x7fe360002f70 tx=0x7fe360007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:04.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.956+0000 7fe37cc7d700 1 -- 172.21.15.63:0/22793056 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe378065cf0 con 0x7fe3780af0c0 2020-05-18T21:38:04.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.956+0000 7fe36f7fe700 1 -- 172.21.15.63:0/22793056 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe360005700 con 0x7fe3780af0c0 2020-05-18T21:38:04.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.956+0000 7fe37cc7d700 1 -- 172.21.15.63:0/22793056 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe378132140 con 0x7fe3780af0c0 2020-05-18T21:38:04.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.956+0000 7fe375d9b700 1 --2- 172.21.15.63:0/22793056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3780af0c0 0x7fe3780630a0 secure :-1 s=THROTTLE_DONE pgs=2112 cs=0 l=1 rx=0x7fe360002f70 tx=0x7fe360007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:04.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.956+0000 7fe36f7fe700 1 -- 172.21.15.63:0/22793056 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe360005940 con 0x7fe3780af0c0 2020-05-18T21:38:04.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.956+0000 7fe37cc7d700 1 -- 172.21.15.63:0/22793056 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3780569e0 con 0x7fe3780af0c0 2020-05-18T21:38:04.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.956+0000 7fe375d9b700 1 --2- 172.21.15.63:0/22793056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3780af0c0 0x7fe3780630a0 secure :-1 s=THROTTLE_DONE pgs=2112 cs=0 l=1 rx=0x7fe360002f70 tx=0x7fe360007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:04.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.956+0000 7fe36f7fe700 1 --2- 172.21.15.63:0/22793056 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe35c04f990 0x7fe35c051e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:04.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.956+0000 7fe36f7fe700 1 -- 172.21.15.63:0/22793056 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe360064530 con 0x7fe3780af0c0 2020-05-18T21:38:04.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.956+0000 7fe37659c700 1 --2- 172.21.15.63:0/22793056 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe35c04f990 0x7fe35c051e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:04.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.956+0000 7fe37659c700 1 --2- 172.21.15.63:0/22793056 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe35c04f990 0x7fe35c051e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe378062870 tx=0x7fe368009130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:04.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.956+0000 7fe37659c700 1 --2- 172.21.15.63:0/22793056 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe35c04f990 0x7fe35c051e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe378062870 tx=0x7fe368009130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:04.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.956+0000 7fe37659c700 1 --2- 172.21.15.63:0/22793056 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe35c04f990 0x7fe35c051e50 secure :-1 s=READY pgs=829 cs=0 l=1 rx=0x7fe378062870 tx=0x7fe368009130).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:04.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.960+0000 7fe375d9b700 1 --2- 172.21.15.63:0/22793056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3780af0c0 0x7fe3780630a0 secure :-1 s=THROTTLE_DONE pgs=2112 cs=0 l=1 rx=0x7fe360002f70 tx=0x7fe360007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:04.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:04.960+0000 7fe36f7fe700 1 -- 172.21.15.63:0/22793056 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe36003e9e0 con 0x7fe3780af0c0 2020-05-18T21:38:05.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:05.108+0000 7fe37cc7d700 1 -- 172.21.15.63:0/22793056 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe378062570 con 0x7fe3780af0c0 2020-05-18T21:38:05.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:05.108+0000 7fe375d9b700 1 --2- 172.21.15.63:0/22793056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3780af0c0 0x7fe3780630a0 secure :-1 s=THROTTLE_DONE pgs=2112 cs=0 l=1 rx=0x7fe360002f70 tx=0x7fe360007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:05.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:05.108+0000 7fe36f7fe700 1 -- 172.21.15.63:0/22793056 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2169 (secure 0 0 0) 0x7fe360042000 con 0x7fe3780af0c0 2020-05-18T21:38:05.117 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:05.117 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:45.262609+0000","modified":"2020-05-18T21:38:04.331070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":158,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":10281,"mds_1":10222},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10222":{"gid":10222,"name":"b","rank":1,"incarnation":140,"state":"up:rejoin","state_seq":4,"addr":"172.21.15.155:6835/942326202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":942326202},{"type":"v1","addr":"172.21.15.155:6835","nonce":942326202}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_10281":{"gid":10281,"name":"a","rank":0,"incarnation":133,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/2149589625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2149589625},{"type":"v1","addr":"172.21.15.63:6833","nonce":2149589625}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2020-05-18T21:38:05.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:05.112+0000 7fe37cc7d700 1 -- 172.21.15.63:0/22793056 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe35c04f990 msgr2=0x7fe35c051e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:05.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:05.112+0000 7fe37cc7d700 1 --2- 172.21.15.63:0/22793056 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe35c04f990 0x7fe35c051e50 secure :-1 s=READY pgs=829 cs=0 l=1 rx=0x7fe378062870 tx=0x7fe368009130).stop 2020-05-18T21:38:05.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:05.112+0000 7fe37cc7d700 1 -- 172.21.15.63:0/22793056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3780af0c0 msgr2=0x7fe3780630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:05.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:05.112+0000 7fe37cc7d700 1 --2- 172.21.15.63:0/22793056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3780af0c0 0x7fe3780630a0 secure :-1 s=READY pgs=2112 cs=0 l=1 rx=0x7fe360002f70 tx=0x7fe360007a80).stop 2020-05-18T21:38:05.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:05.112+0000 7fe37cc7d700 1 -- 172.21.15.63:0/22793056 shutdown_connections 2020-05-18T21:38:05.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:05.112+0000 7fe37cc7d700 1 --2- 172.21.15.63:0/22793056 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe35c04f990 0x7fe35c051e50 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:05.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:05.112+0000 7fe37cc7d700 1 --2- 172.21.15.63:0/22793056 >> v2:172.21.15.155:3300/0 conn(0x7fe378063500 0x7fe378131ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:05.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:05.112+0000 7fe37cc7d700 1 --2- 172.21.15.63:0/22793056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3780af0c0 0x7fe3780630a0 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:05.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:05.112+0000 7fe37cc7d700 1 -- 172.21.15.63:0/22793056 >> 172.21.15.63:0/22793056 conn(0x7fe37806a500 msgr2=0x7fe3780b6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:05.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:05.112+0000 7fe37cc7d700 1 -- 172.21.15.63:0/22793056 shutdown_connections 2020-05-18T21:38:05.120 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:05.112+0000 7fe37cc7d700 1 -- 172.21.15.63:0/22793056 wait complete. 2020-05-18T21:38:05.121 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 143 2020-05-18T21:38:05.331 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 143, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:37:45.262609+0000', 'modified': '2020-05-18T21:38:04.331070+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 158, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 10281, 'mds_1': 10222}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10222': {'gid': 10222, 'name': 'b', 'rank': 1, 'incarnation': 140, 'state': 'up:rejoin', 'state_seq': 4, 'addr': '172.21.15.155:6835/942326202', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 942326202}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 942326202}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}, 'gid_10281': {'gid': 10281, 'name': 'a', 'rank': 0, 'incarnation': 133, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/2149589625', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 2149589625}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 2149589625}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:38:05.332 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_10222:up:rejoin 2020-05-18T21:38:06.333 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:38:06.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93e59e2700 1 Processor -- start 2020-05-18T21:38:06.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93e59e2700 1 -- start start 2020-05-18T21:38:06.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93e59e2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f93e005aab0 0x7f93e014e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:06.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93e59e2700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e014e7b0 con 0x7f93e005b300 2020-05-18T21:38:06.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93e59e2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e00612b0 con 0x7f93e01479d0 2020-05-18T21:38:06.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93e59e2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e00b4010 con 0x7f93e005aab0 2020-05-18T21:38:06.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93dffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f93e005b300 0x7f93e01472c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38754/0 (socket says 172.21.15.63:38754) 2020-05-18T21:38:06.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93dffff700 1 -- 172.21.15.63:0/3772754338 learned_addr learned my addr 172.21.15.63:0/3772754338 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:06.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93e49e0700 1 --2- 172.21.15.63:0/3772754338 >> v2:172.21.15.155:3300/0 conn(0x7f93e005aab0 0x7f93e014e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:06.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93df7fe700 1 -- 172.21.15.63:0/3772754338 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3666846753 0 0) 0x7f93e014e7b0 con 0x7f93e005b300 2020-05-18T21:38:06.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93df7fe700 1 -- 172.21.15.63:0/3772754338 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93c4003270 con 0x7f93e005b300 2020-05-18T21:38:06.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93df7fe700 1 -- 172.21.15.63:0/3772754338 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255597755 0 0) 0x7f93e00612b0 con 0x7f93e01479d0 2020-05-18T21:38:06.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93df7fe700 1 -- 172.21.15.63:0/3772754338 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93e014e7b0 con 0x7f93e01479d0 2020-05-18T21:38:06.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93e49e0700 1 -- 172.21.15.63:0/3772754338 >> v1:172.21.15.155:6789/0 conn(0x7f93e01479d0 legacy=0x7f93e014a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:06.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93e49e0700 1 -- 172.21.15.63:0/3772754338 >> v1:172.21.15.63:6789/0 conn(0x7f93e005b300 legacy=0x7f93e01472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:06.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93df7fe700 1 -- 172.21.15.63:0/3772754338 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3049041727 0 0) 0x7f93c4003270 con 0x7f93e005b300 2020-05-18T21:38:06.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93e49e0700 1 -- 172.21.15.63:0/3772754338 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e00b42b0 con 0x7f93e005aab0 2020-05-18T21:38:06.455 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93e49e0700 1 --2- 172.21.15.63:0/3772754338 >> v2:172.21.15.155:3300/0 conn(0x7f93e005aab0 0x7f93e014e230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f93d8001490 tx=0x7f93c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:06.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93e49e0700 1 --2- 172.21.15.63:0/3772754338 >> v2:172.21.15.155:3300/0 conn(0x7f93e005aab0 0x7f93e014e230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f93d8001490 tx=0x7f93c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:06.456 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93e49e0700 1 --2- 172.21.15.63:0/3772754338 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93e005aab0 0x7f93e014e230 secure :-1 s=READY pgs=1412 cs=0 l=1 rx=0x7f93d8001490 tx=0x7f93c8007a80).ready entity=mon.1 client_cookie=336728c0a5ad012b server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:06.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93e49e0700 1 --2- 172.21.15.63:0/3772754338 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93e005aab0 0x7f93e014e230 secure :-1 s=THROTTLE_DONE pgs=1412 cs=0 l=1 rx=0x7f93d8001490 tx=0x7f93c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:06.457 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93e49e0700 1 --2- 172.21.15.63:0/3772754338 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93e005aab0 0x7f93e014e230 secure :-1 s=THROTTLE_DONE pgs=1412 cs=0 l=1 rx=0x7f93d8001490 tx=0x7f93c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:06.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93df7fe700 1 -- 172.21.15.63:0/3772754338 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93d8001a90 con 0x7f93e005aab0 2020-05-18T21:38:06.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93e49e0700 1 --2- 172.21.15.63:0/3772754338 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93e005aab0 0x7f93e014e230 secure :-1 s=THROTTLE_DONE pgs=1412 cs=0 l=1 rx=0x7f93d8001490 tx=0x7f93c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:06.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93df7fe700 1 -- 172.21.15.63:0/3772754338 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c8008e40 con 0x7f93e005aab0 2020-05-18T21:38:06.458 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93df7fe700 1 -- 172.21.15.63:0/3772754338 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93c8011440 con 0x7f93e005aab0 2020-05-18T21:38:06.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93e59e2700 1 -- 172.21.15.63:0/3772754338 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93e005aab0 msgr2=0x7f93e014e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:06.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.444+0000 7f93e59e2700 1 --2- 172.21.15.63:0/3772754338 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93e005aab0 0x7f93e014e230 secure :-1 s=READY pgs=1412 cs=0 l=1 rx=0x7f93d8001490 tx=0x7f93c8007a80).stop 2020-05-18T21:38:06.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.448+0000 7f93e59e2700 1 -- 172.21.15.63:0/3772754338 shutdown_connections 2020-05-18T21:38:06.459 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.448+0000 7f93e59e2700 1 --2- 172.21.15.63:0/3772754338 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93e005aab0 0x7f93e014e230 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:06.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.448+0000 7f93e59e2700 1 -- 172.21.15.63:0/3772754338 >> 172.21.15.63:0/3772754338 conn(0x7f93e00b8340 msgr2=0x7f93e00b8750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:06.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.448+0000 7f93e59e2700 1 -- 172.21.15.63:0/3772754338 shutdown_connections 2020-05-18T21:38:06.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.448+0000 7f93e59e2700 1 -- 172.21.15.63:0/3772754338 wait complete. 2020-05-18T21:38:06.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.448+0000 7f93e59e2700 1 Processor -- start 2020-05-18T21:38:06.460 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.448+0000 7f93e59e2700 1 -- start start 2020-05-18T21:38:06.463 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e59e2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f93e005b300 0x7f93e015b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:06.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e59e2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f93e01479d0 0x7f93e00b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:06.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e59e2700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e0148f60 con 0x7f93e005aab0 2020-05-18T21:38:06.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e59e2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e00b58d0 con 0x7f93e01479d0 2020-05-18T21:38:06.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e59e2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e014bf30 con 0x7f93e005b300 2020-05-18T21:38:06.464 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e49e0700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f93e005aab0 0x7f93e0143180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38760/0 (socket says 172.21.15.63:38760) 2020-05-18T21:38:06.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e49e0700 1 -- 172.21.15.63:0/3850694726 learned_addr learned my addr 172.21.15.63:0/3850694726 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:06.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e51e1700 1 --2- 172.21.15.63:0/3850694726 >> v2:172.21.15.63:3300/0 conn(0x7f93e01479d0 0x7f93e00b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:06.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93dffff700 1 --2- 172.21.15.63:0/3850694726 >> v2:172.21.15.155:3300/0 conn(0x7f93e005b300 0x7f93e015b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:06.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93ddffb700 1 -- 172.21.15.63:0/3850694726 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418424871 0 0) 0x7f93e0148f60 con 0x7f93e005aab0 2020-05-18T21:38:06.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93ddffb700 1 -- 172.21.15.63:0/3850694726 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93b8002fe0 con 0x7f93e005aab0 2020-05-18T21:38:06.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93ddffb700 1 -- 172.21.15.63:0/3850694726 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2447544108 0 0) 0x7f93b8002fe0 con 0x7f93e005aab0 2020-05-18T21:38:06.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e51e1700 1 -- 172.21.15.63:0/3850694726 >> v2:172.21.15.155:3300/0 conn(0x7f93e005b300 msgr2=0x7f93e015b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:06.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e51e1700 1 --2- 172.21.15.63:0/3850694726 >> v2:172.21.15.155:3300/0 conn(0x7f93e005b300 0x7f93e015b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:06.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e51e1700 1 -- 172.21.15.63:0/3850694726 >> v1:172.21.15.63:6789/0 conn(0x7f93e005aab0 legacy=0x7f93e0143180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:06.466 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e51e1700 1 -- 172.21.15.63:0/3850694726 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e014c1d0 con 0x7f93e01479d0 2020-05-18T21:38:06.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e51e1700 1 --2- 172.21.15.63:0/3850694726 >> v2:172.21.15.63:3300/0 conn(0x7f93e01479d0 0x7f93e00b5470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f93c8008840 tx=0x7f93d0010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:06.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e51e1700 1 --2- 172.21.15.63:0/3850694726 >> v2:172.21.15.63:3300/0 conn(0x7f93e01479d0 0x7f93e00b5470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f93c8008840 tx=0x7f93d0010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:06.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e51e1700 1 --2- 172.21.15.63:0/3850694726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93e01479d0 0x7f93e00b5470 secure :-1 s=READY pgs=2115 cs=0 l=1 rx=0x7f93c8008840 tx=0x7f93d0010820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:06.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e51e1700 1 --2- 172.21.15.63:0/3850694726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93e01479d0 0x7f93e00b5470 secure :-1 s=THROTTLE_DONE pgs=2115 cs=0 l=1 rx=0x7f93c8008840 tx=0x7f93d0010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:06.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e51e1700 1 --2- 172.21.15.63:0/3850694726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93e01479d0 0x7f93e00b5470 secure :-1 s=THROTTLE_DONE pgs=2115 cs=0 l=1 rx=0x7f93c8008840 tx=0x7f93d0010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:06.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93ddffb700 1 -- 172.21.15.63:0/3850694726 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93c80086a0 con 0x7f93e01479d0 2020-05-18T21:38:06.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e51e1700 1 --2- 172.21.15.63:0/3850694726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93e01479d0 0x7f93e00b5470 secure :-1 s=THROTTLE_DONE pgs=2115 cs=0 l=1 rx=0x7f93c8008840 tx=0x7f93d0010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:06.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93ddffb700 1 -- 172.21.15.63:0/3850694726 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d0006ab0 con 0x7f93e01479d0 2020-05-18T21:38:06.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e59e2700 1 -- 172.21.15.63:0/3850694726 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e014c470 con 0x7f93e01479d0 2020-05-18T21:38:06.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93ddffb700 1 -- 172.21.15.63:0/3850694726 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93d0006e10 con 0x7f93e01479d0 2020-05-18T21:38:06.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e59e2700 1 -- 172.21.15.63:0/3850694726 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e0148ad0 con 0x7f93e01479d0 2020-05-18T21:38:06.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e51e1700 1 --2- 172.21.15.63:0/3850694726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93e01479d0 0x7f93e00b5470 secure :-1 s=THROTTLE_DONE pgs=2115 cs=0 l=1 rx=0x7f93c8008840 tx=0x7f93d0010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:06.469 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93ddffb700 1 -- 172.21.15.63:0/3850694726 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f93d000a350 con 0x7f93e01479d0 2020-05-18T21:38:06.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e51e1700 1 --2- 172.21.15.63:0/3850694726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93e01479d0 0x7f93e00b5470 secure :-1 s=THROTTLE_DONE pgs=2115 cs=0 l=1 rx=0x7f93c8008840 tx=0x7f93d0010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:06.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.452+0000 7f93e59e2700 1 -- 172.21.15.63:0/3850694726 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e00569e0 con 0x7f93e01479d0 2020-05-18T21:38:06.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.456+0000 7f93ddffb700 1 --2- 172.21.15.63:0/3850694726 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f93b804fd80 0x7f93b8052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:06.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.456+0000 7f93ddffb700 1 -- 172.21.15.63:0/3850694726 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f93d0063970 con 0x7f93e01479d0 2020-05-18T21:38:06.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.456+0000 7f93e49e0700 1 --2- 172.21.15.63:0/3850694726 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f93b804fd80 0x7f93b8052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:06.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.456+0000 7f93e49e0700 1 --2- 172.21.15.63:0/3850694726 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f93b804fd80 0x7f93b8052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f93c8003080 tx=0x7f93c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:06.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.456+0000 7f93e49e0700 1 --2- 172.21.15.63:0/3850694726 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f93b804fd80 0x7f93b8052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f93c8003080 tx=0x7f93c8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:06.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.456+0000 7f93e49e0700 1 --2- 172.21.15.63:0/3850694726 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f93b804fd80 0x7f93b8052240 secure :-1 s=READY pgs=830 cs=0 l=1 rx=0x7f93c8003080 tx=0x7f93c8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:06.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.460+0000 7f93e51e1700 1 --2- 172.21.15.63:0/3850694726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93e01479d0 0x7f93e00b5470 secure :-1 s=THROTTLE_DONE pgs=2115 cs=0 l=1 rx=0x7f93c8008840 tx=0x7f93d0010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:06.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.460+0000 7f93ddffb700 1 -- 172.21.15.63:0/3850694726 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f93d003dca0 con 0x7f93e01479d0 2020-05-18T21:38:06.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.608+0000 7f93e59e2700 1 -- 172.21.15.63:0/3850694726 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93e0066340 con 0x7f93e01479d0 2020-05-18T21:38:06.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.608+0000 7f93e51e1700 1 --2- 172.21.15.63:0/3850694726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93e01479d0 0x7f93e00b5470 secure :-1 s=THROTTLE_DONE pgs=2115 cs=0 l=1 rx=0x7f93c8008840 tx=0x7f93d0010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:06.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.608+0000 7f93ddffb700 1 -- 172.21.15.63:0/3850694726 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 144 v144) v1 ==== 95+0+2169 (secure 0 0 0) 0x7f93d00412c0 con 0x7f93e01479d0 2020-05-18T21:38:06.615 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:06.616 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":144,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":144,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:45.262609+0000","modified":"2020-05-18T21:38:05.341702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":158,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":10281,"mds_1":10222},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10222":{"gid":10222,"name":"b","rank":1,"incarnation":140,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/942326202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":942326202},{"type":"v1","addr":"172.21.15.155:6835","nonce":942326202}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_10281":{"gid":10281,"name":"a","rank":0,"incarnation":133,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/2149589625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2149589625},{"type":"v1","addr":"172.21.15.63:6833","nonce":2149589625}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2020-05-18T21:38:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.608+0000 7f93e59e2700 1 -- 172.21.15.63:0/3850694726 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f93b804fd80 msgr2=0x7f93b8052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.608+0000 7f93e59e2700 1 --2- 172.21.15.63:0/3850694726 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f93b804fd80 0x7f93b8052240 secure :-1 s=READY pgs=830 cs=0 l=1 rx=0x7f93c8003080 tx=0x7f93c8007a80).stop 2020-05-18T21:38:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.608+0000 7f93e59e2700 1 -- 172.21.15.63:0/3850694726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93e01479d0 msgr2=0x7f93e00b5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.608+0000 7f93e59e2700 1 --2- 172.21.15.63:0/3850694726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93e01479d0 0x7f93e00b5470 secure :-1 s=READY pgs=2115 cs=0 l=1 rx=0x7f93c8008840 tx=0x7f93d0010820).stop 2020-05-18T21:38:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.608+0000 7f93e59e2700 1 -- 172.21.15.63:0/3850694726 shutdown_connections 2020-05-18T21:38:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.608+0000 7f93e59e2700 1 --2- 172.21.15.63:0/3850694726 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f93b804fd80 0x7f93b8052240 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.608+0000 7f93e59e2700 1 --2- 172.21.15.63:0/3850694726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93e01479d0 0x7f93e00b5470 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.608+0000 7f93e59e2700 1 --2- 172.21.15.63:0/3850694726 >> v2:172.21.15.155:3300/0 conn(0x7f93e005b300 0x7f93e015b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:06.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.608+0000 7f93e59e2700 1 -- 172.21.15.63:0/3850694726 >> 172.21.15.63:0/3850694726 conn(0x7f93e00b8340 msgr2=0x7f93e0146710 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:06.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.612+0000 7f93e59e2700 1 -- 172.21.15.63:0/3850694726 shutdown_connections 2020-05-18T21:38:06.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:06.612+0000 7f93e59e2700 1 -- 172.21.15.63:0/3850694726 wait complete. 2020-05-18T21:38:06.619 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 144 2020-05-18T21:38:06.831 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 144, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:37:45.262609+0000', 'modified': '2020-05-18T21:38:05.341702+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 158, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 10281, 'mds_1': 10222}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10222': {'gid': 10222, 'name': 'b', 'rank': 1, 'incarnation': 140, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.155:6835/942326202', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 942326202}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 942326202}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}, 'gid_10281': {'gid': 10281, 'name': 'a', 'rank': 0, 'incarnation': 133, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6833/2149589625', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 2149589625}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 2149589625}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:38:06.832 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2020-05-18T21:38:06.832 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:38:06.936 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:38:06.936 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:38:06.937 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 1, 2020-05-18T21:38:06.937 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 10222, 2020-05-18T21:38:06.937 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:38:06.937 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:38:06.937 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 5.6146028000000001, 2020-05-18T21:38:06.938 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 144, 2020-05-18T21:38:06.938 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 158, 2020-05-18T21:38:06.938 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 158, 2020-05-18T21:38:06.938 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 6.5229773160000004 2020-05-18T21:38:06.938 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:38:06.945 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 1, "id": 10222, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.6146028000000001, "mdsmap_epoch": 144, "osdmap_epoch": 158, "osdmap_epoch_barrier": 158, "uptime": 6.5229773160000004 } 2020-05-18T21:38:06.946 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-05-18T21:38:07.053 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:38:07.053 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:38:07.054 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2020-05-18T21:38:07.054 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 10281, 2020-05-18T21:38:07.054 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2020-05-18T21:38:07.054 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2020-05-18T21:38:07.054 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 21.785428491000001, 2020-05-18T21:38:07.055 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 144, 2020-05-18T21:38:07.055 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 158, 2020-05-18T21:38:07.055 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 158, 2020-05-18T21:38:07.055 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 25.948825873000001 2020-05-18T21:38:07.055 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:38:07.062 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 10281, "want_state": "up:active", "state": "up:active", "rank_uptime": 21.785428491000001, "mdsmap_epoch": 144, "osdmap_epoch": 158, "osdmap_epoch_barrier": 158, "uptime": 25.948825873000001 } 2020-05-18T21:38:07.063 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:38:07.064 INFO:teuthology.orchestra.run.smithi063:> import sys 2020-05-18T21:38:07.064 INFO:teuthology.orchestra.run.smithi063:> import time 2020-05-18T21:38:07.065 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:38:07.065 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:38:07.065 INFO:teuthology.orchestra.run.smithi063:> n = 10 2020-05-18T21:38:07.066 INFO:teuthology.orchestra.run.smithi063:> abs_path = "/home/ubuntu/cephtest/mnt.0/delete_me/file" 2020-05-18T21:38:07.066 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:38:07.067 INFO:teuthology.orchestra.run.smithi063:> if not os.path.exists(os.path.dirname(abs_path)): 2020-05-18T21:38:07.067 INFO:teuthology.orchestra.run.smithi063:> os.makedirs(os.path.dirname(abs_path)) 2020-05-18T21:38:07.067 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:38:07.068 INFO:teuthology.orchestra.run.smithi063:> for i in range(0, n): 2020-05-18T21:38:07.068 INFO:teuthology.orchestra.run.smithi063:> fname = "{0}_{1}".format(abs_path, i) 2020-05-18T21:38:07.069 INFO:teuthology.orchestra.run.smithi063:> with open(fname, '"'"'w'"'"') as f: 2020-05-18T21:38:07.069 INFO:teuthology.orchestra.run.smithi063:> f.write('"'"'content'"'"') 2020-05-18T21:38:07.070 INFO:teuthology.orchestra.run.smithi063:> if False: 2020-05-18T21:38:07.070 INFO:teuthology.orchestra.run.smithi063:> f.flush() 2020-05-18T21:38:07.070 INFO:teuthology.orchestra.run.smithi063:> os.fsync(f.fileno()) 2020-05-18T21:38:07.071 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:38:07.336 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:38:07.336 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:38:07.337 INFO:teuthology.orchestra.run.smithi063:> import stat 2020-05-18T21:38:07.337 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:38:07.338 INFO:teuthology.orchestra.run.smithi063:> print(os.stat("/home/ubuntu/cephtest/mnt.0/delete_me/file_0").st_ino) 2020-05-18T21:38:07.338 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:38:07.462 INFO:teuthology.orchestra.run.smithi063.stdout:1099511627777 2020-05-18T21:38:07.651 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.pin -v 1 delete_me) 2020-05-18T21:38:07.683 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok dump cache 2020-05-18T21:38:07.797 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2020-05-18T21:38:07.798 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:07.798 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1, 2020-05-18T21:38:07.798 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:07.799 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:07.799 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:45.267427+0000", 2020-05-18T21:38:07.799 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 17407, 2020-05-18T21:38:07.799 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:07.800 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:07.800 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:07.800 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:07.800 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:07.800 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:07.801 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:07.801 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:07.801 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.801 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:07.801 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:38:07.802 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:38:07.802 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:38:07.802 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 30, 2020-05-18T21:38:07.802 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:07.802 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.803 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:07.803 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:07.803 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:07.803 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:07.803 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:07.803 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:07.804 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:07.804 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:07.804 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:07.804 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:38:07.804 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:07.805 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:07.805 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:07.805 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.805 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:07.805 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:07.805 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 1, 2020-05-18T21:38:07.806 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1 2020-05-18T21:38:07.806 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.806 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:07.806 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.806 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:07.807 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:07.807 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:07.807 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:07.807 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:52.684697+0000" 2020-05-18T21:38:07.807 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.808 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:07.808 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.808 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:07.808 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:07.808 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:07.808 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:07.809 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:45.267427+0000" 2020-05-18T21:38:07.809 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.809 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 4, 2020-05-18T21:38:07.809 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:07.809 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:07.810 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 3, 2020-05-18T21:38:07.810 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:07.810 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:07.810 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:07.810 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:07.811 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:07.811 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.811 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:07.811 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:07.811 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:07.811 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:07.812 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:07.812 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:07.812 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.812 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:07.812 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:07.813 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:07.813 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:38:07.813 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:07.813 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:07.813 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.813 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:07.814 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:07.814 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:38:07.814 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:07.814 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.814 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:38:07.815 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.815 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:07.815 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:07.815 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:07.815 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:07.816 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": 0, 2020-05-18T21:38:07.816 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 0 2020-05-18T21:38:07.816 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.816 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:38:07.816 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:07.816 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:07.817 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:07.817 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:07.817 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:07.817 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:07.817 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:07.818 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:07.818 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.818 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:07.818 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:07.818 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:07.818 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:07.819 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:07.819 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:07.819 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:38:07.819 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:07.819 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:38:07.820 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:07.820 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:07.820 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:07.820 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:07.820 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:07.820 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.821 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:07.821 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:07.821 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [], 2020-05-18T21:38:07.821 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:07.821 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:07.822 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:07.822 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:07.822 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:07.822 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.822 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:07.823 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1546, 2020-05-18T21:38:07.823 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:07.823 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:07.823 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:07.823 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:07.823 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:07.824 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:07.824 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:07.824 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:07.824 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:07.824 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:07.825 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:07.825 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:07.825 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.825 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:07.825 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:07.826 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:07.826 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:07.826 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:07.826 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:07.826 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.826 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:07.827 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:07.827 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:07.827 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:07.827 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:07.827 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:07.828 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:07.828 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:07.828 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:07.828 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:07.828 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:07.829 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:07.829 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:07.829 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.829 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:07.830 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:07.830 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:07.830 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:07.830 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.830 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:07.831 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.831 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:07.831 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:07.831 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:07.831 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:07.831 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086518+0000" 2020-05-18T21:38:07.832 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.832 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:07.832 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.832 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:07.832 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:07.833 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:07.833 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:07.833 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086518+0000" 2020-05-18T21:38:07.833 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.833 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:07.833 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:07.834 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:07.834 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:07.834 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:07.834 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:07.834 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:07.835 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:07.835 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:07.835 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.835 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:07.835 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:07.835 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:07.836 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:07.836 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:07.836 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:07.836 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.836 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:07.837 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:07.837 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:07.837 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:07.837 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:07.837 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:07.838 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.838 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:07.838 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:07.838 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:07.838 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:07.838 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.839 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:07.839 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.839 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:07.839 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:07.839 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:07.840 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:07.840 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:07.840 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:07.840 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:07.840 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.840 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:07.841 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:07.841 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:07.841 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:07.841 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:07.841 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:07.842 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:07.842 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:07.842 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:07.842 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.843 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:07.843 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:07.843 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:07.843 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:07.843 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:07.844 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:07.844 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:07.844 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:07.844 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:07.844 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:07.845 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:07.845 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:07.845 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.845 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:07.845 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:07.846 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:07.846 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:07.846 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:07.846 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:07.846 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray0", 2020-05-18T21:38:07.846 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60a", 2020-05-18T21:38:07.847 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:07.847 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:07.847 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:07.847 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:07.847 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:07.848 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:07.848 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:07.848 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:07.848 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:07.848 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:07.848 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:07.849 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.849 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:07.849 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:07.849 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:07.849 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.850 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:07.850 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:07.850 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:07.850 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:07.850 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.850 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:07.851 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.851 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:07.851 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:07.851 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:07.851 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:07.852 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:07.852 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:07.852 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:07.852 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:07.852 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.852 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:07.853 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:07.853 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:07.853 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:07.853 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.853 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:07.854 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1547, 2020-05-18T21:38:07.854 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:07.854 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:07.854 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:07.854 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:07.854 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:07.855 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:07.855 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:07.855 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:07.855 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:07.855 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:07.856 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:07.856 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:07.856 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.856 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:07.856 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:07.856 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:07.857 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:07.857 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:07.857 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:07.857 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.857 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:07.858 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:07.858 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:07.858 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:07.858 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:07.858 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:07.859 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:07.859 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:07.859 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:07.859 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:07.859 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:07.859 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:07.860 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:07.860 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.860 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:07.860 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:07.860 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:07.861 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:07.861 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.861 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:07.861 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.861 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:07.861 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:07.862 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:07.862 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:07.862 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086853+0000" 2020-05-18T21:38:07.862 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.862 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:07.863 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.863 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:07.863 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:07.863 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:07.863 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:07.863 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086853+0000" 2020-05-18T21:38:07.864 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.864 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:07.864 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:07.864 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:07.864 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:07.865 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:07.865 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:07.865 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:07.865 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:07.865 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:07.866 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.866 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:07.866 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:07.866 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:07.866 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:07.866 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:07.867 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:07.867 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.867 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:07.867 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:07.867 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:07.868 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:07.868 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:07.868 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:07.868 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.868 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:07.868 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:07.869 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:07.869 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:07.869 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.869 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:07.869 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.870 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:07.870 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:07.870 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:07.870 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:07.870 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:07.870 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:07.871 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:07.871 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.871 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:07.871 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:07.871 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:07.872 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:07.872 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:07.872 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:07.872 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:07.872 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:07.872 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:07.873 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.873 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:07.873 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:07.873 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:07.873 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:07.874 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:07.874 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:07.874 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:07.874 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:07.874 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:07.875 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:07.875 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:07.875 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:07.875 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.875 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:07.875 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:07.876 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:07.876 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:07.876 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:07.876 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:07.876 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray1", 2020-05-18T21:38:07.877 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60b", 2020-05-18T21:38:07.877 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:07.877 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:07.877 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:07.877 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:07.877 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:07.878 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:07.878 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:07.878 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:07.878 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:07.878 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:07.879 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:07.879 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.879 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:07.879 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:07.879 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:07.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.880 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:07.880 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:07.880 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:07.880 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:07.880 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.881 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:07.881 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.881 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:07.881 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:07.881 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:07.882 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:07.882 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:07.882 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:07.882 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:07.882 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:07.882 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.883 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:07.883 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:07.883 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:07.883 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:07.883 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.884 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:07.884 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1548, 2020-05-18T21:38:07.884 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:07.884 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:07.884 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:07.884 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:07.885 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:07.885 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:07.885 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:07.885 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:07.885 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:07.886 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:07.886 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:07.886 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:07.886 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.886 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:07.886 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:07.887 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:07.887 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:07.887 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:07.887 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:07.887 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.888 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:07.888 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:07.888 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:07.888 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:07.888 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:07.888 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:07.889 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:07.889 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:07.889 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:07.889 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:07.889 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:07.890 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:07.890 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:07.890 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.890 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:07.890 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:07.890 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:07.891 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:07.891 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.891 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:07.891 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.891 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:07.892 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:07.892 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:07.892 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:07.892 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087103+0000" 2020-05-18T21:38:07.892 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.893 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:07.893 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.893 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:07.893 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:07.893 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:07.893 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:07.894 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087103+0000" 2020-05-18T21:38:07.894 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.894 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:07.894 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:07.894 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:07.895 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:07.895 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:07.895 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:07.895 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:07.895 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:07.895 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:07.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.896 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:07.896 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:07.896 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:07.896 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:07.897 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:07.897 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:07.897 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.897 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:07.897 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:07.897 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:07.898 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:07.898 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:07.898 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:07.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.898 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:07.899 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:07.899 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:07.899 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:07.899 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.899 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:07.899 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.900 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:07.900 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:07.900 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:07.900 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:07.900 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:07.901 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:07.901 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:07.901 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.901 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:07.901 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:07.901 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:07.902 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:07.902 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:07.902 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:07.902 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:07.902 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:07.903 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:07.903 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.903 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:07.903 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:07.903 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:07.903 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:07.904 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:07.904 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:07.904 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:07.904 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:07.904 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:07.904 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:07.905 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:07.905 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:07.905 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.905 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:07.905 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:07.906 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:07.906 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:07.906 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:07.906 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:07.906 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray2", 2020-05-18T21:38:07.907 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60c", 2020-05-18T21:38:07.907 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:07.907 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:07.907 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:07.907 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:07.907 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:07.908 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:07.908 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:07.908 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:07.908 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:07.908 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:07.908 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:07.909 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.909 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:07.909 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:07.909 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:07.909 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.910 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:07.910 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:07.910 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:07.910 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:07.910 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.911 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:07.911 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.911 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:07.911 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:07.911 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:07.911 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:07.912 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:07.912 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:07.912 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:07.912 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:07.912 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.912 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:07.913 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:07.913 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:07.913 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:07.913 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.913 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:07.914 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1551, 2020-05-18T21:38:07.914 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:07.914 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:07.914 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:07.914 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:07.915 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:07.915 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:07.915 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:07.915 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:07.915 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:07.916 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:07.916 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:07.916 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:07.916 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.916 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:07.916 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:07.917 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:07.917 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:07.917 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:07.917 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:07.917 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.918 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:07.918 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:07.918 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:07.918 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:07.918 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:07.918 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:07.919 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:07.919 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:07.919 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:07.919 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:07.919 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:07.920 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:07.920 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:07.920 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.920 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:07.920 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:07.921 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:07.921 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:07.921 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.921 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:07.921 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.922 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:07.922 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:07.922 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:07.922 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:07.922 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087783+0000" 2020-05-18T21:38:07.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.923 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:07.923 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.923 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:07.923 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:07.923 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:07.924 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:07.924 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087783+0000" 2020-05-18T21:38:07.924 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.924 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:07.924 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:07.924 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:07.925 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:07.925 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:07.925 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:07.925 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:07.925 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:07.926 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:07.926 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.926 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:07.926 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:07.926 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:07.926 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:07.927 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:07.927 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:07.927 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.927 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:07.927 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:07.928 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:07.928 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:07.928 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:07.928 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:07.928 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.929 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:07.929 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:07.929 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:07.929 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:07.930 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.930 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:07.930 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.930 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:07.930 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:07.930 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:07.931 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:07.931 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:07.931 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:07.931 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:07.931 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.932 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:07.932 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:07.932 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:07.932 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:07.932 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:07.932 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:07.933 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:07.933 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:07.933 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:07.933 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.933 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:07.934 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:07.934 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:07.934 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:07.934 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:07.934 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:07.935 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:07.935 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:07.935 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:07.935 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:07.935 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:07.935 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:07.936 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.936 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:07.936 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:07.936 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:07.936 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:07.937 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:07.937 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:07.937 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray5", 2020-05-18T21:38:07.937 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60f", 2020-05-18T21:38:07.937 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:07.938 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:07.938 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:07.938 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:07.938 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:07.938 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:07.938 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:07.939 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:07.939 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:07.939 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:07.939 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:07.939 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.940 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:07.940 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:07.940 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:07.940 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.940 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:07.940 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:07.941 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:07.941 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:07.941 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.941 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:07.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.942 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:07.942 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:07.942 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:07.942 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:07.942 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:07.942 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:07.943 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:07.943 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:07.943 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.943 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:07.944 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:07.944 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:07.944 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:07.944 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.944 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:07.945 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1552, 2020-05-18T21:38:07.945 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:07.945 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:07.945 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:07.945 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:07.945 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:07.946 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:07.946 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:07.946 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:07.946 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:07.946 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:07.947 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:07.947 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:07.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.947 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:07.947 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:07.947 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:07.948 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:07.948 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:07.948 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:07.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.948 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:07.949 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:07.949 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:07.949 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:07.949 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:07.949 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:07.949 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:07.950 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:07.950 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:07.950 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:07.950 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:07.950 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:07.951 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:07.951 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.951 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:07.951 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:07.951 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:07.951 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:07.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.952 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:07.952 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.952 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:07.952 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:07.953 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:07.953 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:07.953 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088334+0000" 2020-05-18T21:38:07.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.953 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:07.953 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.954 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:07.954 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:07.954 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:07.954 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:07.954 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088334+0000" 2020-05-18T21:38:07.955 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.955 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:07.955 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:07.955 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:07.955 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:07.955 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:07.956 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:07.956 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:07.956 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:07.956 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:07.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.957 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:07.957 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:07.957 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:07.957 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:07.957 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:07.957 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:07.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.958 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:07.958 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:07.958 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:07.958 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:07.959 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:07.959 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:07.959 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.959 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:07.959 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:07.959 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:07.960 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:07.960 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.960 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:07.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.960 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:07.961 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:07.961 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:07.961 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:07.961 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:07.961 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:07.962 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:07.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.962 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:07.962 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:07.962 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:07.962 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:07.963 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:07.963 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:07.963 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:07.963 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:07.963 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:07.964 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.964 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:07.964 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:07.964 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:07.964 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:07.964 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:07.965 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:07.965 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:07.965 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:07.965 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:07.965 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:07.966 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:07.966 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:07.966 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.966 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:07.966 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:07.966 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:07.967 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:07.967 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:07.967 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:07.967 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray6", 2020-05-18T21:38:07.967 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x610", 2020-05-18T21:38:07.968 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:07.968 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:07.968 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:07.968 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:07.968 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:07.968 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:07.969 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:07.969 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:07.969 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:07.969 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:07.969 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:07.970 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.970 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:07.970 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:07.970 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:07.970 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.970 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:07.971 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:07.971 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:07.971 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:07.971 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.971 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:07.972 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.972 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:07.972 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:07.972 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:07.972 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:07.972 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:07.973 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:07.973 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:07.973 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:07.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.973 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:07.974 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:07.974 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:07.974 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:07.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.974 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:07.974 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1549, 2020-05-18T21:38:07.975 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:07.975 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:07.975 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:07.975 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:07.975 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:07.976 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:07.976 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:07.976 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:07.976 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:07.976 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:07.976 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:07.977 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:07.977 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.977 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:07.977 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:07.977 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:07.978 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:07.978 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:07.978 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:07.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.978 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:07.978 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:07.979 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:07.979 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:07.979 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:07.979 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:07.979 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:07.980 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:07.980 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:07.980 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:07.980 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:07.980 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:07.980 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:07.981 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.981 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:07.981 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:07.981 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:07.981 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:07.982 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.982 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:07.982 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.982 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:07.982 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:07.983 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:07.983 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:07.983 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087329+0000" 2020-05-18T21:38:07.983 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.983 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:07.983 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:07.984 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:07.984 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:07.984 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:07.984 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:07.984 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087329+0000" 2020-05-18T21:38:07.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.985 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:07.985 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:07.985 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:07.985 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:07.985 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:07.986 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:07.986 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:07.986 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:07.986 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:07.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.987 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:07.987 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:07.987 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:07.987 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:07.987 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:07.987 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:07.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.988 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:07.988 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:07.988 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:07.988 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:07.989 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:07.989 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:07.989 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.989 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:07.989 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:07.989 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:07.990 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:07.990 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.990 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:07.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.990 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:07.991 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:07.991 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:07.991 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:07.991 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:07.991 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:07.991 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:07.992 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.992 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:07.992 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:07.992 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:07.992 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:07.993 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:07.993 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:07.993 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:07.993 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:07.993 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:07.993 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:07.994 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:07.994 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:07.994 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:07.994 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:07.994 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:07.995 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:07.995 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:07.995 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:07.995 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:07.995 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:07.996 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:07.996 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:07.996 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:07.996 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:07.996 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:07.996 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:07.997 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:07.997 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:07.997 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:07.997 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray3", 2020-05-18T21:38:07.997 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60d", 2020-05-18T21:38:07.998 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:07.998 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:07.998 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:07.998 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:07.998 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:07.998 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:07.999 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:07.999 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:07.999 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:07.999 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:07.999 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:08.000 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.000 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.000 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.000 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.000 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.001 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.001 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.001 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.001 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.001 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.002 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.002 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.002 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.002 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.002 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.002 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:08.003 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:08.003 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:08.003 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:08.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.003 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:08.004 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:08.004 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:08.004 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:08.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.004 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1553, 2020-05-18T21:38:08.005 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:08.005 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:08.005 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:08.005 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:08.005 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:08.006 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:08.006 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:08.006 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:08.006 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:08.006 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:08.006 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:08.007 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:08.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.007 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:08.007 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:08.007 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:08.008 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:08.008 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:08.008 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:08.008 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.008 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:08.008 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:08.009 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:08.009 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:08.009 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:08.009 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:08.009 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:08.010 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:08.010 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:08.010 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:08.010 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:08.010 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:08.010 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:08.011 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:08.011 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:08.011 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:08.011 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:08.011 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:08.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.012 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:08.012 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:08.012 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:08.012 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:08.012 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:08.013 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:08.013 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088498+0000" 2020-05-18T21:38:08.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.013 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:08.013 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:08.014 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:08.014 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:08.014 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:08.014 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:08.014 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088498+0000" 2020-05-18T21:38:08.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.015 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:08.015 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:08.015 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:08.015 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:08.015 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:08.016 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:08.016 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:08.016 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:08.016 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:08.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.016 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:08.017 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:08.017 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:08.017 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:08.017 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:08.017 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:08.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.018 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:08.018 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:08.018 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:08.018 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.019 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.019 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.019 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.019 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.019 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.019 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.020 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.020 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.020 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.020 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.021 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.021 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.021 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.021 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:08.021 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:08.021 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:08.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.022 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:08.022 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:08.022 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:08.022 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:08.023 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:08.023 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:08.023 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:08.023 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:08.023 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:08.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.024 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:08.024 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:08.024 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:08.024 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:08.024 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:08.025 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:08.025 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:08.025 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:08.025 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:08.025 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.025 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:08.026 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:08.026 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.026 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:08.026 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:08.026 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:08.027 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:08.027 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:08.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.027 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray7", 2020-05-18T21:38:08.027 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x611", 2020-05-18T21:38:08.027 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:08.028 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:08.028 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:08.028 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:08.028 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:08.028 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:08.029 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:08.029 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.029 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:08.029 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:08.030 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:08.030 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.030 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.030 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.030 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.031 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.031 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.031 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.031 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.031 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.032 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.032 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.032 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.032 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.033 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.033 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:08.033 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:08.033 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:08.033 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:08.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.034 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:08.034 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:08.034 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:08.034 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:08.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.035 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.035 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1554, 2020-05-18T21:38:08.035 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:08.035 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:08.035 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:08.035 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:08.036 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:08.036 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:08.036 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:08.036 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:08.036 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:08.037 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:08.037 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:08.037 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:08.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.037 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:08.037 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:08.038 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:08.038 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:08.038 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:08.038 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:08.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.039 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:08.039 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:08.039 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:08.039 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:08.039 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:08.039 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:08.040 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:08.040 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:08.040 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:08.040 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:08.040 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:08.041 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:08.041 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:08.041 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:08.041 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:08.041 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:08.041 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:08.042 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:08.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.042 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:08.042 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:08.042 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:08.043 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:08.043 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:08.043 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:08.043 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088676+0000" 2020-05-18T21:38:08.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.044 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:08.044 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:08.044 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:08.044 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:08.044 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:08.045 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:08.045 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088676+0000" 2020-05-18T21:38:08.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.045 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:08.045 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:08.046 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:08.046 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:08.046 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:08.046 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:08.046 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:08.047 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:08.047 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:08.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.047 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:08.047 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:08.047 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:08.048 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:08.048 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:08.048 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:08.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.048 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:08.049 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:08.049 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:08.049 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.049 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.049 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.050 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.050 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.050 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.050 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.050 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.051 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.051 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.051 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.051 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.052 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.052 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:08.052 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:08.052 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:08.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.052 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:08.053 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:08.053 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:08.053 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:08.053 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:08.053 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:08.054 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:08.054 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:08.054 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:08.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.054 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:08.055 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:08.055 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:08.055 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:08.055 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:08.055 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:08.055 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:08.056 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:08.056 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:08.056 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.056 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:08.056 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:08.057 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.057 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:08.057 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:08.057 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:08.057 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:08.057 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:08.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.058 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray8", 2020-05-18T21:38:08.058 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x612", 2020-05-18T21:38:08.058 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:08.058 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:08.059 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:08.059 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:08.059 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:08.059 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:08.059 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:08.060 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.060 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:08.060 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:08.060 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:08.060 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.060 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.061 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.061 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.061 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.061 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.062 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.062 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.062 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.062 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.062 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.063 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.063 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.063 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.063 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:08.063 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:08.064 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:08.064 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:08.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.064 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:08.064 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:08.064 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:08.065 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:08.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.065 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.065 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1550, 2020-05-18T21:38:08.065 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:08.066 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:08.066 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:08.066 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:08.066 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:08.066 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:08.066 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:08.067 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:08.067 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:08.067 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:08.067 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:08.067 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:08.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.068 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:08.068 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:08.068 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:08.068 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:08.068 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:08.069 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:08.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.069 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:08.069 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:08.069 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:08.070 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:08.070 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:08.070 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:08.070 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:08.070 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:08.070 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:08.071 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:08.071 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:08.071 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:08.071 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:08.071 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:08.072 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:08.072 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:08.072 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:08.072 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:08.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.072 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:08.073 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:08.073 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:08.073 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:08.073 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:08.073 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:08.074 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087546+0000" 2020-05-18T21:38:08.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.074 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:08.074 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:08.074 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:08.074 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:08.075 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:08.075 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:08.075 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087546+0000" 2020-05-18T21:38:08.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.075 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:08.076 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:08.076 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:08.076 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:08.076 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:08.076 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:08.076 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:08.077 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:08.077 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:08.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.077 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:08.077 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:08.078 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:08.078 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:08.078 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:08.078 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:08.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.078 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:08.079 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:08.079 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:08.079 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.079 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.079 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.080 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.080 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.080 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.080 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.080 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.081 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.081 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.081 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.081 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.082 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.082 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:08.082 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:08.082 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:08.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.082 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:08.083 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:08.083 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:08.083 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:08.083 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:08.083 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:08.083 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:08.084 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:08.084 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:08.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.084 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:08.084 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:08.085 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:08.085 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:08.085 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:08.085 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:08.085 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:08.086 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:08.086 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:08.086 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.086 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:08.086 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:08.086 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.087 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:08.087 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:08.087 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:08.087 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:08.087 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:08.088 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.088 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray4", 2020-05-18T21:38:08.088 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60e", 2020-05-18T21:38:08.088 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:08.088 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:08.088 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:08.089 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:08.089 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:08.089 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:08.089 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:08.089 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.090 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:08.090 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:08.090 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:08.090 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.090 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.090 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.091 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.091 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.091 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.091 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.091 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.092 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.092 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.092 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.092 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.092 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.092 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.093 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.093 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.093 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:08.093 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:08.093 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:08.094 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:08.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.094 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:08.094 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:08.094 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:08.094 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:08.095 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.095 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.095 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1555, 2020-05-18T21:38:08.095 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:08.095 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:08.096 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:08.096 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:08.096 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:08.096 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:08.096 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:08.097 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:08.097 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:08.097 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:08.097 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:08.097 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:08.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.098 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:08.098 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:08.098 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:08.098 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:08.098 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:08.099 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:08.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.099 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:08.099 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:08.099 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:08.100 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:08.100 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:08.100 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:08.100 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:08.100 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:08.100 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:08.101 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:08.101 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:08.101 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:08.101 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:08.101 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:08.102 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:08.102 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:08.102 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:08.102 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:08.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.102 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:08.103 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:08.103 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:08.103 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:08.103 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:08.103 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:08.104 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:08.104 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.104 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:08.104 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:08.104 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:08.105 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:08.105 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:08.105 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:08.105 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:08.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.105 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:08.106 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:08.106 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:08.106 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:08.106 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:08.106 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:08.107 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:08.107 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:08.107 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:08.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.107 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:08.107 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:08.108 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:08.108 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:08.108 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:08.108 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:08.108 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.109 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:08.109 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:08.109 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:08.109 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.109 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.109 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.110 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.110 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.110 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.110 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.111 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.111 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.111 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.111 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.111 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.112 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.112 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:08.112 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:08.112 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:08.112 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.113 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:08.113 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:08.113 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:08.113 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:08.113 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:08.113 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:08.114 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:08.114 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:08.114 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:08.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.114 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:08.115 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:08.115 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:08.115 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:08.115 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:08.115 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:08.115 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:08.116 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:08.116 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:08.116 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.116 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:08.116 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:08.117 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.117 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:08.117 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:08.117 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:08.117 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:08.118 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:08.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.118 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray9", 2020-05-18T21:38:08.118 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x613", 2020-05-18T21:38:08.118 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:08.118 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:08.119 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:08.119 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:08.119 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:08.119 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:08.119 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:08.119 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.120 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:08.120 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:08.120 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:08.120 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.120 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.121 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.121 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.121 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.121 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.121 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.122 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.122 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.122 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.122 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.123 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.123 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.123 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.123 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:08.123 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:08.123 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:08.124 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:08.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.124 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:08.124 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:08.124 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:08.125 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:08.125 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.125 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.125 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 3, 2020-05-18T21:38:08.125 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:08.126 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:08.126 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:08.126 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16877, 2020-05-18T21:38:08.126 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:08.126 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:08.126 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:08.127 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:08.127 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:08.127 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:08.127 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:08.127 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:08.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.128 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:08.128 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:08.128 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:08.128 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:08.128 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:08.129 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:08.129 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.129 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:08.129 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:08.129 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:08.130 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:08.130 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:08.130 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:08.130 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:08.130 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:08.131 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:08.131 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:08.131 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:08.131 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:08.131 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:08.132 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:08.132 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:08.132 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:08.132 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:08.132 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:08.133 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.133 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:08.133 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:08.133 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:08.133 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:08.133 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:08.134 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:08.134 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:01.329092+0000" 2020-05-18T21:38:08.134 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.134 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:08.134 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:08.135 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:08.135 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:08.135 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:08.135 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:08.135 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:01.329092+0000" 2020-05-18T21:38:08.135 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.136 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:08.136 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:08.136 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:08.136 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:08.136 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:08.136 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:08.137 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:08.137 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:08.137 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:08.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.137 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:08.138 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:08.138 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:08.138 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:08.138 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:08.138 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:08.139 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.139 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:08.139 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:08.139 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:08.139 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.139 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.140 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.140 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.140 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.140 INFO:teuthology.orchestra.run.smithi155.stdout: -2, 2020-05-18T21:38:08.141 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.141 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.141 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.141 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.141 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.142 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.142 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.142 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:38:08.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.142 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:38:08.143 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:08.143 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:08.143 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:08.143 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:08.144 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:08.144 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:08.144 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:08.144 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:08.144 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.144 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:08.145 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:08.145 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:08.145 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:08.145 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:08.145 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:08.146 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:08.146 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:08.146 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:08.146 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.146 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:08.147 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.147 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:08.147 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:08.147 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:08.147 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:08.147 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:08.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.148 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.148 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 257, 2020-05-18T21:38:08.148 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:08.148 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:08.149 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:08.149 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:08.149 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:08.149 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:08.149 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:08.149 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:08.150 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:08.150 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:08.150 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:08.150 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:08.150 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.151 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:08.151 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:08.151 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:08.151 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:08.151 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:08.151 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:08.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.152 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:08.152 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:08.152 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:08.152 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:08.153 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:08.153 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:08.153 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:08.153 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:08.153 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:08.153 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:08.154 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:08.154 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:08.154 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:08.154 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:08.154 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:08.155 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:08.155 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 10, 2020-05-18T21:38:08.155 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:08.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.155 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:08.156 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:08.156 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:08.156 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:08.156 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:38:08.156 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:08.156 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:08.157 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.157 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:08.157 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:08.157 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:08.157 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:08.158 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:38:08.158 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:08.158 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:08.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.158 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:08.158 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:08.159 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:08.159 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:08.159 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:08.159 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:08.159 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:08.160 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:08.160 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:08.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.160 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:08.160 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:08.160 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:08.161 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:08.161 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:08.161 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:08.161 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.161 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:08.162 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:08.162 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:08.162 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.162 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.162 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.162 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.163 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.163 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.163 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.163 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.163 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.164 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.164 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.164 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.164 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.165 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.165 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:08.165 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:38:08.165 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.165 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:08.165 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:08.166 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:08.166 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:08.166 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:08.166 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:08.166 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:08.167 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:08.167 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:08.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.167 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:08.167 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:08.167 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:08.168 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:08.168 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:08.168 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:08.168 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:08.168 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:08.169 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:08.169 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.169 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:08.169 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.169 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:08.169 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:08.170 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:08.170 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:08.170 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:08.170 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.170 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1", 2020-05-18T21:38:08.171 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x101", 2020-05-18T21:38:08.171 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:08.171 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:08.171 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:08.171 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "0", 2020-05-18T21:38:08.171 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "0", 2020-05-18T21:38:08.172 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:08.172 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "1", 2020-05-18T21:38:08.172 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.172 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:08.172 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:08.173 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:08.173 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.173 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.173 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.173 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.174 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.174 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.174 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.174 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.174 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.175 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.175 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.175 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.175 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.175 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.176 INFO:teuthology.orchestra.run.smithi155.stdout: "child": 1, 2020-05-18T21:38:08.176 INFO:teuthology.orchestra.run.smithi155.stdout: "subtree": 1, 2020-05-18T21:38:08.176 INFO:teuthology.orchestra.run.smithi155.stdout: "subtreetemp": 0, 2020-05-18T21:38:08.176 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:08.176 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:08.176 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:08.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.177 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:08.177 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [ 2020-05-18T21:38:08.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.177 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray6", 2020-05-18T21:38:08.178 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:08.178 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:08.178 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:08.178 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:08.178 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:08.178 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:08.179 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:08.179 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1552, 2020-05-18T21:38:08.179 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:08.179 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:08.179 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:08.180 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.180 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.180 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.180 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.180 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.181 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.181 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.181 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.181 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.181 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.182 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.182 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.182 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.182 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.182 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:08.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.183 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:08.183 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:08.183 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:08.183 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:08.184 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:08.184 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:08.184 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:08.184 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:08.184 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:08.184 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:08.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.185 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.185 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:08.185 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:08.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.186 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.186 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray7", 2020-05-18T21:38:08.186 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:08.186 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:08.186 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:08.186 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:08.187 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:08.187 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:08.187 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:08.187 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1553, 2020-05-18T21:38:08.187 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:08.188 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:08.188 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:08.188 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.188 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.188 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.188 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.189 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.189 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.189 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.189 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.189 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.190 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.190 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.190 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.190 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.190 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.191 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.191 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:08.191 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.191 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:08.191 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:08.192 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:08.192 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:08.192 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:08.192 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:08.192 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:08.192 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:08.193 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:08.193 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:08.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.193 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.193 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:08.194 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:08.194 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.194 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.194 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray0", 2020-05-18T21:38:08.194 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:08.194 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:08.195 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:08.195 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:08.195 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:08.195 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:08.195 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:08.196 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1546, 2020-05-18T21:38:08.196 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:08.196 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:08.196 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:08.196 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.196 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.197 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.197 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.197 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.197 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.198 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.198 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.198 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.198 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.198 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.199 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.199 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.199 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.199 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:08.199 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.200 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:08.200 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:08.200 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:08.200 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:08.200 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:08.200 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:08.201 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:08.201 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:08.201 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:08.201 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:08.201 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.202 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.202 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:08.202 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:08.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.202 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.202 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray9", 2020-05-18T21:38:08.203 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:08.203 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:08.203 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:08.203 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:08.203 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:08.204 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:08.204 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:08.204 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1555, 2020-05-18T21:38:08.204 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:08.204 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:08.204 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:08.205 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.205 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.205 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.205 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.205 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.206 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.206 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.206 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.206 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.206 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.206 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.207 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.207 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.207 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.207 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.208 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:08.208 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.208 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:08.208 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:08.208 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:08.208 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:08.209 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:08.209 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:08.209 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:08.209 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:08.209 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:08.210 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:08.210 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.210 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.210 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:08.210 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:08.210 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.211 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.211 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray5", 2020-05-18T21:38:08.211 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:08.211 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:08.211 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:08.212 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:08.212 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:08.212 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:08.212 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:08.212 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1551, 2020-05-18T21:38:08.212 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:08.213 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:08.213 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:08.213 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.213 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.213 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.214 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.214 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.214 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.214 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.214 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.215 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.215 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.215 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.215 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.215 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.216 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.216 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.216 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:08.216 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.216 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:08.216 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:08.217 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:08.217 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:08.217 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:08.217 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:08.217 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:08.218 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:08.218 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:08.218 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:08.218 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.218 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.218 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:08.219 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:08.219 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.219 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.219 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray2", 2020-05-18T21:38:08.219 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:08.219 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:08.220 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:08.220 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:08.220 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:08.220 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:08.220 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:08.221 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1548, 2020-05-18T21:38:08.221 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:08.221 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:08.221 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:08.221 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.221 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.222 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.222 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.222 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.222 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.222 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.223 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.223 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.223 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.223 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.223 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.223 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.224 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.224 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.224 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.224 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:08.224 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.225 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:08.225 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:08.225 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:08.225 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:08.225 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:08.225 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:08.226 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:08.226 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:08.226 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:08.226 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:08.226 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.227 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.227 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:08.227 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:08.227 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.227 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.227 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray1", 2020-05-18T21:38:08.228 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:08.228 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:08.228 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:08.228 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:08.228 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:08.229 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:08.229 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:08.229 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1547, 2020-05-18T21:38:08.229 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:08.229 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:08.230 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:08.230 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.230 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.230 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.230 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.231 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.231 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.231 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.231 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.232 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.232 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.232 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.232 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.232 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.233 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.233 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.233 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:08.233 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.233 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:08.234 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:08.234 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:08.234 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:08.234 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:08.234 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:08.235 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:08.235 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:08.235 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:08.235 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:08.235 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.236 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.236 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:08.236 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:08.236 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.236 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.236 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray8", 2020-05-18T21:38:08.237 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:08.237 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:08.237 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:08.237 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:08.237 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:08.238 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:08.238 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:08.238 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1554, 2020-05-18T21:38:08.238 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:08.238 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:08.238 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:08.239 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.239 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.239 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.239 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.239 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.240 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.240 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.240 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.240 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.240 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.240 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.241 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.241 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.241 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.241 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.241 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.242 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:08.242 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.242 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:08.242 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:08.242 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:08.242 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:08.243 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:08.243 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:08.243 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:08.243 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:08.243 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:08.244 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:08.244 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.244 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.244 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:08.244 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:08.245 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.245 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.245 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray3", 2020-05-18T21:38:08.245 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:08.245 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:08.246 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:08.246 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:08.246 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:08.246 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:08.246 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:08.246 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1549, 2020-05-18T21:38:08.247 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:08.247 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:08.247 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:08.247 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.247 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.248 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.248 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.248 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.248 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.248 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.248 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.249 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.249 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.249 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.249 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.249 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.250 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.250 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.250 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.250 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:08.250 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.251 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:08.251 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:08.251 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:08.251 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:08.251 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:08.252 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:08.252 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:08.252 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:08.252 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:08.252 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:08.252 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.253 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.253 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:08.253 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:08.253 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.253 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:08.254 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray4", 2020-05-18T21:38:08.254 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:08.254 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:08.254 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:08.254 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:08.254 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:08.255 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:08.255 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:08.255 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1550, 2020-05-18T21:38:08.255 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:08.255 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:08.256 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:08.258 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.259 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:08.259 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:08.259 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:08.259 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.259 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:08.260 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:08.260 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:08.260 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:08.260 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:08.260 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:08.260 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.261 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:08.261 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:08.261 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:08.261 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:08.261 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:08.262 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.262 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:08.262 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:08.262 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:08.262 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:08.262 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:08.263 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:08.263 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:08.263 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:08.263 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:08.263 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:08.264 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:08.264 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:08.264 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:08.264 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:08.264 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:08.264 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:08.265 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:08.265 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:08.265 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:08.265 INFO:teuthology.orchestra.run.smithi155.stdout:] 2020-05-18T21:38:08.267 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "ino": 1, "rdev": 0, "ctime": "2020-05-18T21:38:07.145016+0000", "btime": "2020-05-18T21:37:45.267427+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 30, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:07.145016+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:38:07.145016+0000", "num_files": 0, "num_subdirs": 1, "change_attr": 1 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:52.684697+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:45.267427+0000" }, "version": 4, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 3, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "dirfrag": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1546, "rdev": 0, "ctime": "2020-05-18T21:37:53.086518+0000", "btime": "2020-05-18T21:37:53.086518+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086518+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086518+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086518+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray0", "dirfrag": "0x60a", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1547, "rdev": 0, "ctime": "2020-05-18T21:37:53.086853+0000", "btime": "2020-05-18T21:37:53.086853+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086853+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086853+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086853+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray1", "dirfrag": "0x60b", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1548, "rdev": 0, "ctime": "2020-05-18T21:37:53.087103+0000", "btime": "2020-05-18T21:37:53.087103+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087103+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087103+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087103+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray2", "dirfrag": "0x60c", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1551, "rdev": 0, "ctime": "2020-05-18T21:37:53.087783+0000", "btime": "2020-05-18T21:37:53.087783+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087783+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087783+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087783+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray5", "dirfrag": "0x60f", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1552, "rdev": 0, "ctime": "2020-05-18T21:37:53.088334+0000", "btime": "2020-05-18T21:37:53.088334+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088334+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088334+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088334+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray6", "dirfrag": "0x610", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1549, "rdev": 0, "ctime": "2020-05-18T21:37:53.087329+0000", "btime": "2020-05-18T21:37:53.087329+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087329+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087329+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087329+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray3", "dirfrag": "0x60d", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1553, "rdev": 0, "ctime": "2020-05-18T21:37:53.088498+0000", "btime": "2020-05-18T21:37:53.088498+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088498+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088498+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088498+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray7", "dirfrag": "0x611", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1554, "rdev": 0, "ctime": "2020-05-18T21:37:53.088676+0000", "btime": "2020-05-18T21:37:53.088676+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088676+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088676+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088676+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray8", "dirfrag": "0x612", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1550, "rdev": 0, "ctime": "2020-05-18T21:37:53.087546+0000", "btime": "2020-05-18T21:37:53.087546+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087546+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087546+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087546+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray4", "dirfrag": "0x60e", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1555, "rdev": 0, "ctime": "2020-05-18T21:37:53.088993+0000", "btime": "2020-05-18T21:37:53.088993+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088993+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray9", "dirfrag": "0x613", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 3, "rdev": 0, "ctime": "2020-05-18T21:38:01.329092+0000", "btime": "2020-05-18T21:38:01.329092+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:01.329092+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:38:01.329092+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:38:01.329092+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ -2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "openingsnapparents": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 257, "rdev": 0, "ctime": "2020-05-18T21:37:53.086401+0000", "btime": "2020-05-18T21:37:53.086401+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086401+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 10, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "openingsnapparents": 0 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "subtreetemp": 0, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 3, "dentries": [ { "path": "stray6", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1552, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray7", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1553, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray0", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1546, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray9", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1555, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray5", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1551, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray2", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1548, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray1", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1547, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray8", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1554, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray3", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1549, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray4", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1550, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] } ] } ] } ] 2020-05-18T21:38:09.271 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok dump cache 2020-05-18T21:38:09.373 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2020-05-18T21:38:09.373 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.374 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1, 2020-05-18T21:38:09.374 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:09.374 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:09.374 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:45.267427+0000", 2020-05-18T21:38:09.374 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 17407, 2020-05-18T21:38:09.375 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:09.375 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:09.375 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:09.375 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:09.375 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:09.376 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:09.376 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:09.376 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:09.376 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.376 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:09.376 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:38:09.378 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:38:09.378 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:38:09.378 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 30, 2020-05-18T21:38:09.378 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:09.378 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.379 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:09.379 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:09.379 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:09.379 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:09.379 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:09.380 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:09.380 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:09.380 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:09.380 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:09.381 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:38:09.381 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:09.381 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:09.381 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:09.381 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.381 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:09.382 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:09.382 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 1, 2020-05-18T21:38:09.382 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1 2020-05-18T21:38:09.382 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.382 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:09.383 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.383 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.383 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.383 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.383 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.384 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:52.684697+0000" 2020-05-18T21:38:09.384 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.384 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:09.384 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.384 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.384 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.385 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.385 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.385 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:45.267427+0000" 2020-05-18T21:38:09.385 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.386 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 4, 2020-05-18T21:38:09.386 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:09.386 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:09.386 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 3, 2020-05-18T21:38:09.387 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:09.387 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:09.387 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:09.387 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:09.387 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:09.388 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.388 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:09.388 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:09.388 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:09.388 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:09.388 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:09.389 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:09.389 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.389 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:09.389 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:09.390 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:09.390 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:38:09.390 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.390 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.391 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.391 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.391 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:38:09.391 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.391 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.392 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:38:09.392 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.392 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.392 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.392 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.392 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.393 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": 0, 2020-05-18T21:38:09.393 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 0 2020-05-18T21:38:09.393 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.393 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:38:09.393 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.394 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.394 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.394 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.394 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.395 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.395 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.395 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.395 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.395 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:09.395 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:09.396 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:09.396 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:09.396 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:09.396 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:09.396 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:38:09.397 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.398 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:38:09.398 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.398 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.398 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.398 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.399 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.399 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.399 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:09.399 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:09.399 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [], 2020-05-18T21:38:09.400 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:09.400 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:09.400 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:09.400 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:09.400 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:09.400 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.401 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.401 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1546, 2020-05-18T21:38:09.401 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:09.401 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:09.402 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:09.402 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:09.402 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:09.402 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:09.402 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:09.402 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:09.403 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:09.403 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:09.403 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:09.403 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:09.403 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.404 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:09.404 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:09.404 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:09.405 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:09.405 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:09.405 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:09.405 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.406 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:09.406 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:09.406 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:09.407 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:09.407 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:09.407 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:09.407 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:09.408 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:09.408 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:09.408 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:09.408 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:09.408 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:09.409 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:09.409 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.409 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:09.409 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:09.409 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:09.409 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:09.410 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.410 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:09.410 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.410 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.410 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.411 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.411 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.411 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086518+0000" 2020-05-18T21:38:09.411 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.411 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:09.411 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.412 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.412 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.412 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.412 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.412 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086518+0000" 2020-05-18T21:38:09.413 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.413 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.413 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:09.413 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:09.413 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:09.414 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:09.418 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:09.419 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:09.419 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:09.419 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:09.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.420 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:09.420 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:09.421 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:09.421 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:09.421 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:09.421 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:09.421 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.422 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:09.422 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:09.422 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:09.423 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.423 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.423 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.423 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.423 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.424 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.424 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.424 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.424 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.424 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.425 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.425 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.425 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.425 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.425 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.426 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:09.426 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:09.426 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:09.426 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.427 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:09.428 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.428 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.428 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.428 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.428 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.429 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.429 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.429 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.429 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.429 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:09.430 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:09.430 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:09.430 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:09.430 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:09.430 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:09.430 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:09.431 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:09.431 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:09.431 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.431 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.431 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:09.432 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.432 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:09.432 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:09.432 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:09.432 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:09.432 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:09.433 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.433 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray0", 2020-05-18T21:38:09.433 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60a", 2020-05-18T21:38:09.433 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:09.433 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:09.434 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:09.434 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:09.434 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:09.434 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:09.435 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:09.435 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.435 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.435 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:09.435 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:09.436 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.436 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.436 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.436 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.437 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.437 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.437 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.437 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.437 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.438 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.438 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.438 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.438 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.438 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.439 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.439 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:09.439 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:09.439 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:09.440 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:09.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.440 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:09.440 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:09.440 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:09.441 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.441 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.441 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1547, 2020-05-18T21:38:09.441 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:09.442 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:09.442 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:09.442 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:09.442 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:09.442 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:09.443 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:09.443 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:09.443 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:09.443 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:09.443 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:09.444 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:09.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.444 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:09.444 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:09.444 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:09.445 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:09.445 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:09.445 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:09.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.445 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:09.446 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:09.446 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:09.446 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:09.446 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:09.446 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:09.447 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:09.447 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:09.447 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:09.447 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:09.447 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:09.448 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:09.448 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:09.448 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.448 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:09.448 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:09.449 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:09.449 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:09.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.449 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:09.450 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.450 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.450 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.450 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.450 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.451 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086853+0000" 2020-05-18T21:38:09.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.451 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:09.451 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.451 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.452 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.452 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.452 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.452 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086853+0000" 2020-05-18T21:38:09.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.452 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.453 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:09.453 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:09.453 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:09.453 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:09.453 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:09.454 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:09.454 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:09.454 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:09.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.454 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:09.454 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:09.455 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:09.455 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:09.455 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:09.455 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:09.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.456 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:09.456 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:09.456 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:09.456 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.456 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.456 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.457 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.457 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.457 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.457 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.457 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.458 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.458 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.458 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.458 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.459 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.459 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.459 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.459 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:09.460 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:09.460 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:09.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.460 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:09.460 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.461 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.461 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.461 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.461 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.461 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.462 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.462 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.462 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:09.462 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:09.463 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:09.463 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:09.463 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:09.463 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:09.464 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:09.464 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:09.464 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:09.464 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.464 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.465 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:09.465 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.465 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:09.465 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:09.465 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:09.466 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:09.466 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:09.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.466 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray1", 2020-05-18T21:38:09.466 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60b", 2020-05-18T21:38:09.467 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:09.467 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:09.467 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:09.467 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:09.468 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:09.468 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:09.468 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:09.468 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.468 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.469 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:09.469 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:09.469 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.469 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.469 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.470 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.470 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.470 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.470 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.471 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.471 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.471 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.471 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.471 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.472 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.472 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.472 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.472 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.472 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:09.473 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:09.473 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:09.473 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:09.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.473 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:09.474 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:09.474 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:09.474 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.474 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1548, 2020-05-18T21:38:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:09.480 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:09.480 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087103+0000" 2020-05-18T21:38:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087103+0000" 2020-05-18T21:38:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.491 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.491 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.491 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.491 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.491 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.495 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.495 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.495 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.495 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.495 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:09.497 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:09.497 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:09.497 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:09.497 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:09.497 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.497 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.498 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:09.498 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.498 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:09.498 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:09.498 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:09.499 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:09.499 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:09.499 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.499 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray2", 2020-05-18T21:38:09.499 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60c", 2020-05-18T21:38:09.499 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:09.500 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:09.500 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:09.500 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:09.500 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:09.500 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:09.501 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:09.501 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.501 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.501 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:09.501 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:09.501 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.504 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.504 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.504 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.504 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:09.507 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:09.507 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.507 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1551, 2020-05-18T21:38:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:09.510 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:09.510 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:09.510 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.510 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:09.510 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:09.510 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087783+0000" 2020-05-18T21:38:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.517 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.517 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.517 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.517 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.517 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087783+0000" 2020-05-18T21:38:09.518 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.518 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.518 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:09.518 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:09.518 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:09.518 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:09.519 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:09.519 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:09.519 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:09.519 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:09.519 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.520 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:09.520 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:09.520 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:09.521 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:09.521 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:09.521 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:09.521 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.522 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:09.522 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:09.522 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:09.522 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.523 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.523 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.523 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.523 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.523 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.524 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.524 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.524 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.524 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.524 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.525 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.525 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.525 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.525 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:09.525 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:09.526 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:09.526 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.526 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:09.526 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.526 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.526 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.527 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.527 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.527 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.528 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.528 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.528 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.528 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:09.528 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:09.528 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:09.529 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:09.529 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:09.529 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:09.529 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:09.529 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:09.530 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:09.530 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.530 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.530 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:09.530 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.530 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:09.531 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:09.531 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:09.531 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:09.531 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:09.531 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.532 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray5", 2020-05-18T21:38:09.532 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60f", 2020-05-18T21:38:09.532 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:09.532 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:09.532 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:09.533 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:09.533 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:09.533 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:09.533 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:09.534 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.534 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.534 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:09.534 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:09.534 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.535 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.535 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.535 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.535 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.536 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.536 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.536 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.536 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.537 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.537 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.537 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.537 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.537 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.538 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.538 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.538 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:09.538 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:09.538 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:09.538 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:09.539 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.539 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:09.539 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:09.539 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:09.539 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.540 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.540 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.540 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1552, 2020-05-18T21:38:09.540 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:09.540 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:09.541 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:09.541 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:09.541 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:09.541 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:09.542 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:09.542 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:09.542 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:09.542 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:09.542 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:09.542 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:09.543 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.543 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:09.543 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:09.543 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:09.543 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:09.544 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:09.544 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:09.544 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.544 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:09.544 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:09.544 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:09.545 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:09.545 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:09.545 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:09.545 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:09.545 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:09.546 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:09.546 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:09.546 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:09.546 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:09.546 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:09.547 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.547 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:09.547 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:09.547 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:09.547 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:09.548 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.548 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:09.548 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.548 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.548 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.548 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.549 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.549 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088334+0000" 2020-05-18T21:38:09.549 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.549 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:09.549 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.550 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.550 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.550 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.550 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.551 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088334+0000" 2020-05-18T21:38:09.551 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.551 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.551 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:09.551 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:09.552 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:09.552 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:09.552 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:09.552 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:09.552 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:09.553 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:09.553 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.553 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:09.553 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:09.553 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:09.554 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:09.554 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:09.554 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:09.554 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.554 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:09.554 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:09.555 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:09.555 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.555 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.555 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.555 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.555 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.556 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.556 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.556 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.556 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.556 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.557 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.557 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.557 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.557 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.557 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.558 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:09.558 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:09.558 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:09.558 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.558 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:09.559 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.559 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.559 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.560 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.560 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.560 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.560 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.561 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.561 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.561 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:09.561 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:09.561 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:09.562 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:09.562 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:09.562 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:09.562 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:09.562 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:09.563 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:09.563 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.563 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.563 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:09.563 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.564 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:09.564 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:09.564 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:09.564 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:09.564 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:09.565 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.565 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray6", 2020-05-18T21:38:09.565 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x610", 2020-05-18T21:38:09.565 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:09.565 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:09.565 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:09.566 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:09.566 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:09.566 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:09.566 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:09.566 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.567 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.567 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:09.567 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:09.567 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.567 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.568 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.568 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.568 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.568 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.568 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.569 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.569 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.569 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.569 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.570 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.570 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.570 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.570 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.570 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.571 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:09.571 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:09.571 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:09.571 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:09.571 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.571 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:09.572 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:09.572 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:09.572 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.572 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.572 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.573 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1549, 2020-05-18T21:38:09.573 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:09.573 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:09.573 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:09.573 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:09.573 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:09.574 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:09.574 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:09.574 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:09.574 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:09.574 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:09.575 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:09.575 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:09.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.575 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:09.575 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:09.575 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:09.576 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:09.576 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:09.576 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:09.576 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.576 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:09.576 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:09.577 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:09.577 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:09.577 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:09.577 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:09.577 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:09.578 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:09.578 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:09.578 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:09.578 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:09.578 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:09.578 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:09.579 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.579 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:09.579 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:09.579 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:09.579 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:09.580 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.580 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:09.580 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.580 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.580 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.581 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.581 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.581 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087329+0000" 2020-05-18T21:38:09.581 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.581 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:09.582 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.582 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.582 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.582 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.582 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.583 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087329+0000" 2020-05-18T21:38:09.583 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.583 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.583 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:09.583 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:09.583 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:09.584 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:09.584 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:09.584 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:09.584 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:09.584 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:09.585 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.585 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:09.585 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:09.585 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:09.585 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:09.586 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:09.586 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:09.586 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.586 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:09.586 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:09.587 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:09.587 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.587 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.587 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.588 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.588 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.588 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.588 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.588 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.589 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.589 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.589 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.590 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.590 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.590 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:09.590 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:09.590 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:09.590 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.591 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:09.591 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.591 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.591 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.591 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.592 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.592 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.592 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.592 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.592 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.592 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:09.593 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:09.593 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:09.593 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:09.593 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:09.593 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:09.594 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:09.594 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:09.594 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:09.594 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.595 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.595 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:09.595 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.595 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:09.595 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:09.596 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:09.596 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:09.596 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:09.596 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.596 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray3", 2020-05-18T21:38:09.596 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60d", 2020-05-18T21:38:09.597 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:09.597 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:09.597 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:09.597 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:09.597 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:09.598 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:09.598 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:09.598 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.598 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.598 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:09.598 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:09.599 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.599 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.599 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.599 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.600 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.600 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.600 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.600 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.600 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.600 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.601 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.601 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.601 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.601 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.601 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.602 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:09.602 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:09.602 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:09.602 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:09.602 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.603 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:09.603 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:09.603 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:09.603 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.603 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.604 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.604 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1553, 2020-05-18T21:38:09.604 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:09.604 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:09.604 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:09.605 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:09.605 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:09.605 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:09.605 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:09.605 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:09.606 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:09.606 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:09.607 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:09.607 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:09.607 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.607 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:09.607 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:09.608 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:09.608 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:09.608 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:09.608 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:09.608 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.609 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:09.609 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:09.609 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:09.609 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:09.609 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:09.610 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:09.610 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:09.610 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:09.610 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:09.610 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:09.611 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:09.611 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:09.611 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:09.611 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.611 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:09.611 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:09.612 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:09.612 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:09.612 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.612 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:09.612 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.613 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.613 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.613 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.613 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.613 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088498+0000" 2020-05-18T21:38:09.613 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.614 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:09.614 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.614 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.614 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.614 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.615 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.615 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088498+0000" 2020-05-18T21:38:09.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.615 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.615 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:09.616 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:09.616 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:09.616 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:09.616 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:09.616 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:09.616 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:09.617 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:09.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.617 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:09.617 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:09.617 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:09.618 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:09.618 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:09.618 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:09.623 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.623 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:09.623 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:09.623 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:09.623 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.624 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.624 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.624 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.624 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.624 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.625 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.625 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.625 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.625 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.625 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.626 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.626 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.626 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.626 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:09.626 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:09.627 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:09.627 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.627 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:09.627 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.628 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.628 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.628 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.628 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.628 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.629 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.629 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.629 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.629 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:09.629 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:09.630 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:09.630 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:09.630 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:09.630 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:09.630 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:09.630 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:09.631 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:09.631 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.631 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.631 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:09.631 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.632 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:09.632 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:09.632 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:09.632 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:09.632 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:09.632 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.633 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray7", 2020-05-18T21:38:09.633 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x611", 2020-05-18T21:38:09.633 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:09.633 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:09.633 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:09.634 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:09.634 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:09.634 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:09.634 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:09.634 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.635 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.635 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:09.635 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:09.635 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.635 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.635 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.636 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.636 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.636 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.637 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.637 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.637 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.637 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.638 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.638 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.638 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.638 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.638 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.639 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:09.639 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:09.639 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:09.639 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:09.639 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.639 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:09.640 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:09.640 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:09.640 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.642 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.642 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1554, 2020-05-18T21:38:09.642 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:09.642 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:09.643 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:09.643 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:09.643 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:09.643 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:09.643 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:09.644 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:09.644 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:09.644 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:09.644 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:09.644 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:09.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.645 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:09.645 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:09.645 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:09.645 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:09.645 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:09.646 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:09.646 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.646 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:09.646 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:09.646 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:09.647 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:09.647 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:09.647 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:09.647 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:09.647 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:09.647 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:09.648 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:09.648 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:09.648 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:09.648 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:09.648 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.649 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:09.649 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:09.649 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:09.649 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:09.649 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.649 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:09.650 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.650 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.650 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.650 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.650 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.651 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088676+0000" 2020-05-18T21:38:09.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.651 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:09.651 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.651 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.651 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.652 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.652 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.652 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088676+0000" 2020-05-18T21:38:09.652 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.652 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.653 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:09.653 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:09.653 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:09.653 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:09.654 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:09.654 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:09.654 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:09.654 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:09.654 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.654 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:09.655 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:09.655 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:09.655 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:09.655 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:09.655 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:09.656 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.656 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:09.656 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:09.656 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:09.656 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.656 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.657 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.657 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.657 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.657 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.657 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.658 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.658 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.658 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.658 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.658 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.658 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.659 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.659 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.659 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:09.659 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:09.659 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:09.660 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.660 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:09.661 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.661 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.661 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.662 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.662 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.662 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.662 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.663 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.663 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.663 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:09.663 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:09.663 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:09.664 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:09.664 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:09.664 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:09.664 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:09.664 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:09.665 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:09.665 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.665 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.665 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:09.665 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.665 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:09.666 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:09.666 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:09.666 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:09.666 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:09.666 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.667 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray8", 2020-05-18T21:38:09.667 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x612", 2020-05-18T21:38:09.667 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:09.667 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:09.667 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:09.667 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:09.668 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:09.668 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:09.668 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:09.668 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.668 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.669 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:09.669 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:09.669 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.669 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.669 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.670 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.670 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.670 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.670 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.670 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.671 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.671 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.671 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.671 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.671 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.672 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.672 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.672 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:09.672 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:09.672 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:09.672 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:09.673 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.673 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:09.673 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:09.673 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:09.673 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.674 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.674 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.674 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1550, 2020-05-18T21:38:09.674 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:09.674 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:09.674 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:09.675 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:09.675 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:09.675 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:09.675 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:09.675 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:09.676 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:09.676 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:09.676 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:09.676 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:09.676 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.676 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:09.677 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:09.677 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:09.677 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:09.677 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:09.677 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:09.678 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.678 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:09.678 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:09.678 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:09.678 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:09.679 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:09.679 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:09.679 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:09.679 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:09.679 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:09.680 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:09.680 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:09.680 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:09.680 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:09.680 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.680 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:09.681 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:09.681 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:09.681 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:09.681 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.681 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:09.682 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.682 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.682 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.682 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.682 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.683 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087546+0000" 2020-05-18T21:38:09.683 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.683 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:09.683 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.683 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.683 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.684 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.684 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.684 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087546+0000" 2020-05-18T21:38:09.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.684 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.685 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:09.685 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:09.685 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:09.685 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:09.685 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:09.685 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:09.686 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:09.686 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:09.686 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.686 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:09.686 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:09.687 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:09.687 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:09.687 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:09.687 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:09.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.687 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:09.688 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:09.688 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:09.688 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.688 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.688 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.689 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.689 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.689 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.689 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.689 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.689 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.690 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.690 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.690 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.690 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.691 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.691 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:09.691 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:09.691 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:09.691 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.691 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:09.692 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.692 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.692 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.692 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.692 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.693 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.693 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.693 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.693 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:09.694 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:09.694 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:09.694 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:09.694 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:09.694 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:09.694 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:09.695 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:09.695 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:09.695 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.695 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.695 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:09.696 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.696 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:09.696 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:09.696 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:09.696 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:09.696 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:09.697 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.697 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray4", 2020-05-18T21:38:09.697 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60e", 2020-05-18T21:38:09.697 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:09.697 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:09.698 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:09.698 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:09.698 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:09.698 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:09.698 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:09.698 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.699 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.699 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:09.699 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:09.699 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.699 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.700 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.700 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.700 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.700 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.701 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.701 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.701 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.701 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.701 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.701 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.702 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.702 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.702 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.702 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:09.702 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:09.703 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:09.703 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:09.703 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.703 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:09.703 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:09.703 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:09.704 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.704 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.704 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.704 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1555, 2020-05-18T21:38:09.705 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:09.705 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:09.705 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:09.705 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:09.705 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:09.706 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:09.706 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:09.706 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:09.706 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:09.706 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:09.706 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:09.707 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:09.707 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.707 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:09.707 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:09.707 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:09.708 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:09.708 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:09.708 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:09.708 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.708 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:09.709 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:09.709 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:09.709 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:09.709 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:09.709 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:09.710 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:09.710 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:09.710 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:09.710 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:09.710 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:09.710 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:09.711 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:09.711 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.711 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:09.711 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:09.711 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:09.712 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:09.712 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.712 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:09.712 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.712 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.712 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.713 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.713 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.713 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:09.713 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.713 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:09.714 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.714 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.714 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.714 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.714 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.715 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:09.715 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.715 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.715 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:09.715 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:09.715 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:09.716 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:09.716 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:09.716 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:09.716 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:09.716 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:09.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.717 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:09.717 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:09.717 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:09.717 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:09.717 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:09.718 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:09.718 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.718 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:09.718 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:09.718 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:09.719 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.719 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.719 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.719 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.719 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.719 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.720 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.720 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.720 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.720 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.721 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.721 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.721 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.721 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.721 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:09.722 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:09.722 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:09.722 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.722 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:09.722 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.722 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.723 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.723 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.723 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.723 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.723 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.724 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.724 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.724 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:09.724 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:09.724 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:09.724 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:09.725 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:09.725 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:09.725 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:09.725 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:09.725 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:09.726 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.726 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.726 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:09.726 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.726 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:09.726 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:09.727 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:09.727 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:09.727 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:09.727 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.727 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray9", 2020-05-18T21:38:09.728 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x613", 2020-05-18T21:38:09.728 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:09.728 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:09.728 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:09.729 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:09.730 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:09.730 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:09.730 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:09.730 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.730 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.731 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:09.731 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:09.731 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.731 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.731 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.732 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.732 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.732 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.732 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.732 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.733 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.733 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.733 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.733 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.733 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.734 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.734 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.734 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.734 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:09.734 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:09.735 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:09.735 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:09.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.735 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:09.735 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:09.735 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:09.736 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.736 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.736 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.736 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 3, 2020-05-18T21:38:09.736 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:09.737 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:09.737 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:09.737 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16877, 2020-05-18T21:38:09.738 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:09.738 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:09.738 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:09.738 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:09.738 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:09.739 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:09.739 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:09.739 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:09.739 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.739 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:09.739 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:09.740 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:09.740 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:09.740 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:09.740 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:09.740 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.741 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:09.741 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:09.741 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:09.741 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:09.741 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:09.741 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:09.742 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:09.742 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:09.744 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:09.744 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:09.744 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:09.744 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:09.745 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:09.745 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.745 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:09.745 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:09.745 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:09.746 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:09.746 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.746 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:09.746 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.746 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.747 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.747 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.747 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.747 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:01.329092+0000" 2020-05-18T21:38:09.747 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.748 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:09.748 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.748 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.748 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.748 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:09.749 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.749 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:01.329092+0000" 2020-05-18T21:38:09.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.749 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.749 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:09.750 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:09.750 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:09.750 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:09.750 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:09.750 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:09.751 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:09.751 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:09.751 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.751 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:09.752 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:09.752 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:09.752 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:09.752 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:09.752 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:09.753 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.753 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:09.753 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:09.753 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:09.754 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.754 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.754 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.754 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.754 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.755 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.755 INFO:teuthology.orchestra.run.smithi155.stdout: -2, 2020-05-18T21:38:09.755 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.755 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.755 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.756 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.756 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.756 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.756 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.756 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.756 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:38:09.757 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.757 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:38:09.757 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.757 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.757 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.758 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.758 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.758 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.758 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.758 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.758 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.759 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:09.759 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:09.759 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:09.759 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:09.759 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:09.760 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:09.760 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:09.760 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:09.760 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:09.760 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.761 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:09.761 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.761 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:09.761 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:09.761 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:09.762 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:09.762 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:09.762 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.762 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.762 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 257, 2020-05-18T21:38:09.763 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:09.763 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:09.763 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:09.763 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:09.764 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:09.764 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:09.764 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:09.764 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:09.764 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:09.765 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:09.765 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:09.765 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:09.765 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.765 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:09.765 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:09.766 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:09.766 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:09.766 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:09.766 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:09.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.767 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:09.767 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:09.767 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:09.767 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:09.767 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:09.767 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:09.768 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:09.768 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:09.768 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:09.768 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:09.769 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:09.769 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:09.769 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:09.769 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.769 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:09.770 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:09.770 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 10, 2020-05-18T21:38:09.770 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:09.770 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.770 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:09.770 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.771 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.771 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.771 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:38:09.771 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.771 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:09.772 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.772 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:09.772 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:09.772 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:09.772 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:09.772 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:38:09.773 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:09.773 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:09.773 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.773 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.774 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:09.774 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:09.774 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:09.774 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:09.774 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:09.775 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:09.775 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:09.775 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:09.775 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.775 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:09.776 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:09.776 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:09.776 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:09.776 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:09.776 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:09.776 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.777 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:09.777 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:09.777 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:09.777 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.777 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.778 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.778 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.778 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.778 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.778 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.779 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.779 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.779 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.779 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.779 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.779 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.780 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.780 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.780 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:09.780 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:38:09.780 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.781 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:09.781 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.781 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.781 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.781 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.781 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.782 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.782 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.782 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.782 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.782 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:09.784 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:09.784 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:09.784 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.784 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:09.785 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.785 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:09.785 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:09.785 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:09.785 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:09.786 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:09.786 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.786 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1", 2020-05-18T21:38:09.786 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x101", 2020-05-18T21:38:09.786 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "0", 2020-05-18T21:38:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "0", 2020-05-18T21:38:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "1", 2020-05-18T21:38:09.788 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.788 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:09.788 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:09.788 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:09.788 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.789 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.789 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.789 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.789 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.790 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.790 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.790 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.790 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.790 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.790 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.791 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.791 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.791 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.791 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.791 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.792 INFO:teuthology.orchestra.run.smithi155.stdout: "child": 1, 2020-05-18T21:38:09.792 INFO:teuthology.orchestra.run.smithi155.stdout: "subtree": 1, 2020-05-18T21:38:09.792 INFO:teuthology.orchestra.run.smithi155.stdout: "subtreetemp": 0, 2020-05-18T21:38:09.792 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:09.792 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:09.792 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:09.793 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.793 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:09.793 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [ 2020-05-18T21:38:09.793 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.793 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray6", 2020-05-18T21:38:09.794 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:09.794 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:09.794 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:09.794 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:09.795 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:09.795 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:09.795 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:09.795 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1552, 2020-05-18T21:38:09.795 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:09.796 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.796 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:09.796 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.796 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.796 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.797 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.797 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.797 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.797 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.797 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.797 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.798 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.798 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.798 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.798 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.798 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.799 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.799 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.799 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:09.799 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.799 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:09.799 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:09.800 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.800 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.800 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.800 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.800 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.801 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.801 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.801 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.801 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.801 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.801 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:09.802 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.802 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.802 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.802 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray7", 2020-05-18T21:38:09.802 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:09.803 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:09.803 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:09.803 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:09.803 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:09.803 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:09.804 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:09.804 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1553, 2020-05-18T21:38:09.804 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:09.804 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.805 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:09.805 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.805 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.805 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.805 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.806 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.806 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.806 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.806 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.806 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.806 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.807 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.807 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.807 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.807 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.807 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.808 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.808 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:09.808 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.808 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:09.808 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:09.809 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.809 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.809 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.809 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.809 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.810 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.810 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.810 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.810 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.810 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.810 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:09.811 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.811 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.811 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.811 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray0", 2020-05-18T21:38:09.811 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:09.812 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:09.812 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:09.812 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:09.812 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:09.812 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:09.812 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:09.813 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1546, 2020-05-18T21:38:09.813 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:09.813 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.813 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:09.813 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.814 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.814 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.814 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.814 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.814 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.815 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.815 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.815 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.815 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.815 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.816 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.816 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.816 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.816 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.816 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.817 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:09.817 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.817 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:09.817 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:09.817 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.818 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.818 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.818 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.818 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.818 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.818 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.819 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.819 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.819 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.819 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:09.819 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.820 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.820 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.820 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray9", 2020-05-18T21:38:09.820 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:09.820 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:09.820 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:09.821 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:09.821 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:09.821 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:09.821 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:09.821 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1555, 2020-05-18T21:38:09.822 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:09.822 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.822 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:09.822 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.822 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.822 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.823 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.823 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.823 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.823 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.823 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.824 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.824 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.824 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.824 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.825 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.825 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.825 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.825 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.826 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:09.826 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.826 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:09.826 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:09.826 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.826 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.827 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.827 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.827 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.827 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.827 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.828 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.828 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.828 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.828 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:09.828 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.829 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.829 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.829 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray5", 2020-05-18T21:38:09.829 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:09.829 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:09.830 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:09.830 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:09.830 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:09.830 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:09.830 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:09.831 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1551, 2020-05-18T21:38:09.831 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:09.831 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.831 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:09.831 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.832 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.832 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.832 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.832 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.832 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.832 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.833 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.833 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.833 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.833 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.834 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.834 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.834 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.834 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.834 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.835 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:09.835 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.835 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:09.835 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:09.836 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.836 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.836 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.836 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.837 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.837 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.837 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.837 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.837 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.838 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.838 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:09.838 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.838 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.838 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.839 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray2", 2020-05-18T21:38:09.839 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:09.839 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:09.839 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:09.839 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:09.840 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:09.840 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:09.840 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:09.840 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1548, 2020-05-18T21:38:09.840 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:09.840 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.841 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:09.841 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.841 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.841 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.841 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.842 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.842 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.842 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.842 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.842 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.842 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.843 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.843 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.843 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.843 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.843 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.844 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.844 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:09.844 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.845 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:09.845 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:09.845 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.846 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.846 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.846 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.846 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.846 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.847 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.847 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.847 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.847 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.847 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:09.847 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.848 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.848 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.848 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray1", 2020-05-18T21:38:09.848 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:09.848 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:09.849 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:09.849 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:09.849 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:09.849 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:09.849 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:09.850 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1547, 2020-05-18T21:38:09.850 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:09.850 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.850 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:09.850 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.850 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.851 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.851 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.851 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.851 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.852 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.852 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.852 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.852 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.852 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.853 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.853 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.853 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.853 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.853 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.853 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:09.854 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.854 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:09.854 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:09.854 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.854 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.855 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.855 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.855 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.855 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.856 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.856 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.856 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.856 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.856 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:09.856 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.857 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.857 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.857 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray8", 2020-05-18T21:38:09.857 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:09.857 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:09.858 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:09.858 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:09.858 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:09.858 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:09.858 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:09.859 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1554, 2020-05-18T21:38:09.859 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:09.859 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.859 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:09.859 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.859 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.860 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.860 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.860 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.860 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.860 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.861 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.861 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.861 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.861 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.861 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.861 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.862 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.862 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.862 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.862 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:09.862 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.863 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:09.863 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:09.863 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.863 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.863 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.864 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.864 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.864 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.864 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.864 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.865 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.865 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.865 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:09.865 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.865 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.866 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.866 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray3", 2020-05-18T21:38:09.866 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:09.866 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:09.867 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:09.867 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:09.867 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:09.867 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:09.867 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:09.867 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1549, 2020-05-18T21:38:09.868 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:09.868 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.868 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:09.868 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.868 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.869 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.869 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.869 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.869 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.869 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.869 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.870 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.870 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.870 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.870 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.870 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.871 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.871 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.871 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.871 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:09.871 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.871 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:09.872 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:09.872 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.872 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.872 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.872 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.873 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.873 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.873 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.873 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.873 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.873 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.874 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:09.874 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.874 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.874 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:09.874 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray4", 2020-05-18T21:38:09.875 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:09.875 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:09.875 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:09.875 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:09.875 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:09.875 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:09.876 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:09.876 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1550, 2020-05-18T21:38:09.876 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:09.876 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:09.877 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:09.877 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.877 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:09.877 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:09.877 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:09.878 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.878 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:09.878 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:09.878 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:09.878 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:09.878 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:09.879 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:09.879 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.879 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:09.879 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:09.879 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:09.881 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:09.881 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:09.881 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:09.881 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:09.881 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:09.882 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:09.882 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:09.882 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:09.882 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:09.882 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:09.882 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.883 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:09.883 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.883 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:09.883 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:09.883 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:09.884 INFO:teuthology.orchestra.run.smithi155.stdout:] 2020-05-18T21:38:09.885 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "ino": 1, "rdev": 0, "ctime": "2020-05-18T21:38:07.145016+0000", "btime": "2020-05-18T21:37:45.267427+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 30, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:07.145016+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:38:07.145016+0000", "num_files": 0, "num_subdirs": 1, "change_attr": 1 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:52.684697+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:45.267427+0000" }, "version": 4, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 3, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "dirfrag": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1546, "rdev": 0, "ctime": "2020-05-18T21:37:53.086518+0000", "btime": "2020-05-18T21:37:53.086518+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086518+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086518+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086518+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray0", "dirfrag": "0x60a", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1547, "rdev": 0, "ctime": "2020-05-18T21:37:53.086853+0000", "btime": "2020-05-18T21:37:53.086853+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086853+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086853+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086853+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray1", "dirfrag": "0x60b", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1548, "rdev": 0, "ctime": "2020-05-18T21:37:53.087103+0000", "btime": "2020-05-18T21:37:53.087103+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087103+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087103+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087103+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray2", "dirfrag": "0x60c", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1551, "rdev": 0, "ctime": "2020-05-18T21:37:53.087783+0000", "btime": "2020-05-18T21:37:53.087783+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087783+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087783+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087783+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray5", "dirfrag": "0x60f", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1552, "rdev": 0, "ctime": "2020-05-18T21:37:53.088334+0000", "btime": "2020-05-18T21:37:53.088334+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088334+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088334+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088334+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray6", "dirfrag": "0x610", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1549, "rdev": 0, "ctime": "2020-05-18T21:37:53.087329+0000", "btime": "2020-05-18T21:37:53.087329+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087329+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087329+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087329+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray3", "dirfrag": "0x60d", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1553, "rdev": 0, "ctime": "2020-05-18T21:37:53.088498+0000", "btime": "2020-05-18T21:37:53.088498+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088498+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088498+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088498+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray7", "dirfrag": "0x611", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1554, "rdev": 0, "ctime": "2020-05-18T21:37:53.088676+0000", "btime": "2020-05-18T21:37:53.088676+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088676+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088676+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088676+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray8", "dirfrag": "0x612", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1550, "rdev": 0, "ctime": "2020-05-18T21:37:53.087546+0000", "btime": "2020-05-18T21:37:53.087546+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087546+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087546+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087546+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray4", "dirfrag": "0x60e", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1555, "rdev": 0, "ctime": "2020-05-18T21:37:53.088993+0000", "btime": "2020-05-18T21:37:53.088993+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088993+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray9", "dirfrag": "0x613", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 3, "rdev": 0, "ctime": "2020-05-18T21:38:01.329092+0000", "btime": "2020-05-18T21:38:01.329092+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:01.329092+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:38:01.329092+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:38:01.329092+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ -2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "openingsnapparents": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 257, "rdev": 0, "ctime": "2020-05-18T21:37:53.086401+0000", "btime": "2020-05-18T21:37:53.086401+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086401+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 10, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "openingsnapparents": 0 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "subtreetemp": 0, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 3, "dentries": [ { "path": "stray6", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1552, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray7", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1553, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray0", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1546, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray9", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1555, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray5", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1551, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray2", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1548, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray1", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1547, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray8", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1554, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray3", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1549, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray4", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1550, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] } ] } ] } ] 2020-05-18T21:38:10.889 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok dump cache 2020-05-18T21:38:10.996 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2020-05-18T21:38:10.996 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:10.996 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1, 2020-05-18T21:38:10.996 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:10.997 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:10.997 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:45.267427+0000", 2020-05-18T21:38:10.997 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 17407, 2020-05-18T21:38:10.997 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:10.997 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:10.999 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:10.999 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:10.999 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:10.999 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:11.000 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:11.000 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:11.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.000 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:11.001 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:38:11.001 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:38:11.001 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:38:11.001 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 30, 2020-05-18T21:38:11.001 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:11.002 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.002 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:11.002 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:11.002 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:11.002 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:11.003 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:11.003 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:11.003 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:11.003 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:11.003 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:11.003 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:38:11.004 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:11.004 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:11.004 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:11.004 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.005 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:11.005 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:11.005 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 1, 2020-05-18T21:38:11.005 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1 2020-05-18T21:38:11.005 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.006 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:11.006 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.006 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.006 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.006 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.006 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.007 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:52.684697+0000" 2020-05-18T21:38:11.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.007 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:11.007 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.007 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.008 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.008 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.008 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.008 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:45.267427+0000" 2020-05-18T21:38:11.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.009 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 4, 2020-05-18T21:38:11.009 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:11.009 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:11.009 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 3, 2020-05-18T21:38:11.009 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:11.010 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:11.010 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:11.010 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:11.010 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:11.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.011 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:11.011 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:11.011 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:11.011 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:11.011 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:11.012 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:11.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.012 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:11.012 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:11.012 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:11.012 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:38:11.013 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.013 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.013 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.013 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.014 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:38:11.014 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.014 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.014 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:38:11.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.015 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.015 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.015 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.015 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.015 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": 0, 2020-05-18T21:38:11.015 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 0 2020-05-18T21:38:11.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.016 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:38:11.016 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.016 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.016 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.017 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.017 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.017 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.017 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.017 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.018 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:11.018 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:11.018 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:11.018 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:11.019 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:11.019 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:11.019 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:38:11.019 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.019 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:38:11.020 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.020 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.020 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.020 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.020 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.021 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:11.021 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:11.021 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [], 2020-05-18T21:38:11.021 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:11.021 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:11.022 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:11.022 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:11.022 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:11.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.022 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.023 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1546, 2020-05-18T21:38:11.023 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:11.023 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:11.023 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:11.023 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:11.023 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:11.024 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:11.024 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:11.024 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:11.024 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:11.025 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:11.025 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:11.025 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:11.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.025 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:11.026 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:11.026 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:11.026 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:11.026 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:11.026 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:11.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.027 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:11.027 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:11.027 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:11.027 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:11.028 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:11.028 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:11.028 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:11.028 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:11.028 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:11.029 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:11.029 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:11.029 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:11.029 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:11.029 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.030 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:11.030 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:11.030 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:11.030 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:11.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.030 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:11.031 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.031 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.031 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.031 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.031 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.032 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086518+0000" 2020-05-18T21:38:11.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.032 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:11.032 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.032 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.033 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.033 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.033 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.033 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086518+0000" 2020-05-18T21:38:11.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.034 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.034 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:11.034 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:11.034 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:11.034 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:11.035 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:11.035 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:11.035 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:11.035 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:11.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.036 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:11.036 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:11.036 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:11.036 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:11.036 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:11.037 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:11.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.037 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:11.037 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:11.037 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:11.037 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.038 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.038 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.038 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.038 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.039 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.039 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.039 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.039 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.039 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.040 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.040 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.040 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.040 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:11.040 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:11.041 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:11.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.041 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:11.041 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.041 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.041 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.042 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.042 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.042 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.042 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.042 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.043 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:11.043 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:11.043 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:11.043 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:11.044 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:11.044 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:11.044 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:11.044 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:11.044 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:11.044 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.045 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.045 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:11.045 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.045 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:11.045 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:11.046 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:11.046 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:11.046 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:11.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.046 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray0", 2020-05-18T21:38:11.046 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60a", 2020-05-18T21:38:11.047 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:11.047 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:11.047 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:11.047 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:11.047 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:11.048 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:11.048 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:11.048 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.048 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.049 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:11.049 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:11.049 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.049 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.049 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.050 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.050 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.050 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.050 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.051 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.051 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.051 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.052 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.052 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.052 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.052 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.052 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:11.053 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:11.053 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:11.053 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:11.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.053 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:11.054 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:11.054 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:11.054 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.055 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1547, 2020-05-18T21:38:11.055 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:11.055 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:11.055 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:11.055 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:11.056 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:11.056 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:11.056 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:11.056 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:11.056 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:11.057 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:11.057 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:11.057 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:11.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.057 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:11.058 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:11.058 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:11.058 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:11.058 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:11.058 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:11.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.059 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:11.059 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:11.059 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:11.059 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:11.060 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:11.060 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:11.060 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:11.060 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:11.060 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:11.061 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:11.061 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:11.061 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:11.061 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:11.061 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.062 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:11.062 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:11.062 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:11.062 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:11.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.063 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:11.063 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.063 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.063 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.063 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.064 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.064 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086853+0000" 2020-05-18T21:38:11.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.064 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:11.064 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.064 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.065 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.065 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.065 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.065 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086853+0000" 2020-05-18T21:38:11.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.066 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.066 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:11.066 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:11.066 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:11.066 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:11.067 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:11.067 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:11.067 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:11.067 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:11.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.068 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:11.068 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:11.068 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:11.068 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:11.068 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:11.068 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:11.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.069 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:11.069 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:11.069 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:11.069 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.070 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.070 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.070 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.070 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.070 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.071 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.071 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.071 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.071 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.072 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.072 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.072 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.072 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:11.072 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:11.073 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:11.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.073 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:11.073 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.073 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.073 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.074 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.074 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.074 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.074 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.074 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.075 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:11.075 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:11.075 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:11.075 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:11.076 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:11.076 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:11.076 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:11.076 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:11.076 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:11.077 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.077 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.077 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:11.077 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.077 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:11.078 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:11.078 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:11.078 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:11.078 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:11.078 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.079 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray1", 2020-05-18T21:38:11.079 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60b", 2020-05-18T21:38:11.079 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:11.079 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:11.079 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:11.079 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:11.080 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:11.080 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:11.080 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:11.080 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.080 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.081 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:11.081 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:11.081 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.081 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.082 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.083 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.083 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.083 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.083 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.083 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.084 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.084 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.084 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.084 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.085 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.085 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.085 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.085 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:11.085 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:11.086 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:11.086 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:11.086 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.086 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:11.087 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:11.087 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:11.087 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.087 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.088 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.088 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1548, 2020-05-18T21:38:11.088 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:11.088 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:11.088 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:11.089 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:11.089 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:11.089 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:11.089 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:11.089 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:11.090 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:11.090 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:11.090 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:11.090 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:11.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.091 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:11.091 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:11.091 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:11.091 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:11.091 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:11.092 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:11.092 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.092 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:11.092 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:11.092 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:11.093 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:11.093 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:11.093 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:11.093 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:11.093 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:11.094 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:11.094 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:11.094 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:11.094 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:11.094 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:11.094 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.095 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:11.095 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:11.095 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:11.095 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:11.095 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.096 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:11.096 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.096 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.096 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.096 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.096 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.097 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087103+0000" 2020-05-18T21:38:11.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.097 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:11.097 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.098 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.098 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.098 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.098 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.099 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087103+0000" 2020-05-18T21:38:11.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.099 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.099 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:11.099 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:11.100 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:11.100 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:11.100 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:11.100 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:11.101 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:11.101 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:11.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.101 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:11.101 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:11.102 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:11.102 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:11.102 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:11.102 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:11.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.103 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:11.103 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:11.104 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:11.104 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.104 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.105 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.105 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.105 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.106 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.106 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.106 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.106 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.106 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.107 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.107 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.107 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.107 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.107 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:11.108 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:11.108 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:11.108 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.108 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:11.108 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.109 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.109 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.109 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.109 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.109 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.110 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.110 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.110 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:11.110 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:11.111 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:11.111 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:11.111 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:11.111 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:11.111 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:11.112 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:11.112 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:11.112 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.112 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.112 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:11.113 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.113 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:11.113 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:11.114 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:11.115 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:11.115 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:11.115 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.116 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray2", 2020-05-18T21:38:11.116 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60c", 2020-05-18T21:38:11.117 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:11.117 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:11.117 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:11.118 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:11.118 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:11.118 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:11.118 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:11.118 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.119 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.119 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:11.119 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:11.119 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.119 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.119 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.120 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.120 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.120 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.120 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.121 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.121 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.121 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.122 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.122 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.122 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.123 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.123 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:11.123 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:11.123 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:11.123 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:11.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.124 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:11.124 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:11.124 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:11.124 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.125 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.125 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1551, 2020-05-18T21:38:11.125 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:11.125 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:11.125 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:11.126 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:11.126 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:11.126 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:11.126 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:11.126 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:11.126 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:11.127 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:11.127 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:11.127 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:11.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.127 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:11.128 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:11.128 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:11.128 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:11.128 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:11.128 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:11.129 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.129 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:11.129 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:11.129 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:11.129 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:11.129 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:11.130 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:11.130 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:11.130 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:11.130 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:11.130 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:11.131 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:11.131 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:11.131 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:11.131 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.131 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:11.131 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:11.132 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:11.132 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:11.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.132 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:11.132 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.133 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.133 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.133 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.133 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.133 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087783+0000" 2020-05-18T21:38:11.133 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.134 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:11.134 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.134 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.134 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.134 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.135 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.135 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087783+0000" 2020-05-18T21:38:11.135 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.135 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.135 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:11.136 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:11.136 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:11.136 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:11.136 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:11.136 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:11.137 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:11.137 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:11.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.137 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:11.137 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:11.138 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:11.138 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:11.138 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:11.138 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:11.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.139 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:11.139 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:11.139 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:11.139 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.139 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.139 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.140 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.140 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.140 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.141 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.141 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.141 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.141 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.141 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.142 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.142 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.142 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:11.142 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:11.142 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:11.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.143 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:11.143 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.143 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.143 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.143 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.144 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.144 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.144 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.144 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.144 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.145 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:11.145 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:11.145 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:11.145 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:11.145 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:11.145 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:11.146 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:11.146 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:11.146 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:11.146 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.146 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.147 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:11.147 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.147 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:11.147 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:11.147 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:11.147 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:11.148 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:11.148 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.148 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray5", 2020-05-18T21:38:11.148 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60f", 2020-05-18T21:38:11.148 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:11.149 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:11.149 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:11.149 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:11.149 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:11.149 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:11.149 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:11.150 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.150 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.150 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:11.150 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:11.150 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.151 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.151 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.151 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.151 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.151 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.152 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.152 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.152 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.152 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.152 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.153 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.153 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.153 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.153 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:11.153 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:11.154 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:11.154 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:11.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.154 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:11.154 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:11.154 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:11.155 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.155 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.155 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1552, 2020-05-18T21:38:11.155 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:11.156 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:11.156 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:11.156 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:11.156 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:11.156 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:11.156 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:11.157 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:11.157 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:11.157 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:11.157 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:11.157 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:11.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.158 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:11.158 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:11.158 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:11.158 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:11.158 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:11.159 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:11.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.159 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:11.159 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:11.159 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:11.160 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:11.160 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:11.160 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:11.160 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:11.160 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:11.160 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:11.161 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:11.161 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:11.161 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:11.161 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:11.161 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.161 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:11.162 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:11.162 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:11.162 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:11.162 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.162 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:11.163 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.163 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.163 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.163 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.163 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.163 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088334+0000" 2020-05-18T21:38:11.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.164 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:11.164 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.164 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.164 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.165 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.165 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.165 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088334+0000" 2020-05-18T21:38:11.165 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.165 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.165 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:11.166 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:11.166 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:11.166 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:11.166 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:11.166 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:11.167 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:11.167 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:11.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.167 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:11.167 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:11.167 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:11.168 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:11.168 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:11.168 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:11.168 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.168 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:11.169 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:11.169 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:11.169 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.169 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.169 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.170 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.170 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.170 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.170 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.170 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.171 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.171 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.171 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.171 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.171 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.172 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:11.172 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:11.172 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:11.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.172 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:11.172 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.173 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.173 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.173 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.173 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.173 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.174 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.174 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.174 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.174 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:11.174 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:11.175 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:11.175 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:11.175 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:11.175 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:11.175 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:11.175 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:11.176 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:11.176 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.176 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.176 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:11.176 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.176 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:11.177 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:11.177 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:11.177 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:11.177 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:11.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.178 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray6", 2020-05-18T21:38:11.178 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x610", 2020-05-18T21:38:11.178 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:11.178 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:11.178 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:11.179 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:11.179 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:11.179 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:11.179 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:11.179 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.179 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.180 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:11.180 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:11.180 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.180 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.180 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.180 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.181 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.181 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.181 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.181 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.182 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.182 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.182 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.182 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.183 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.183 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.183 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:11.183 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:11.183 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:11.183 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:11.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.184 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:11.184 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:11.184 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:11.184 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.185 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.185 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1549, 2020-05-18T21:38:11.185 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:11.185 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:11.185 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:11.186 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:11.186 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:11.186 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:11.186 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:11.186 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:11.186 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:11.187 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:11.187 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:11.187 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:11.187 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.187 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:11.188 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:11.188 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:11.188 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:11.188 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:11.188 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:11.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.189 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:11.189 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:11.189 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:11.189 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:11.189 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:11.190 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:11.190 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:11.190 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:11.190 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:11.190 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:11.190 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:11.191 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:11.191 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:11.191 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.191 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:11.191 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:11.192 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:11.192 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:11.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.192 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:11.192 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.192 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.193 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.193 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.193 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.193 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087329+0000" 2020-05-18T21:38:11.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.194 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:11.194 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.194 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.194 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.194 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.194 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.195 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087329+0000" 2020-05-18T21:38:11.195 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.195 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.195 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:11.195 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:11.196 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:11.196 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:11.196 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:11.196 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:11.196 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:11.196 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:11.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.197 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:11.197 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:11.197 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:11.197 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:11.198 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:11.198 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:11.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.198 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:11.198 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:11.198 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:11.199 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.199 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.199 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.199 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.199 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.200 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.200 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.200 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.200 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.200 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.200 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.201 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.201 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.201 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.201 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.202 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:11.202 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:11.202 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:11.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.202 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:11.203 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.203 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.203 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.203 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.203 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.203 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.204 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.204 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.204 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:11.204 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:11.204 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:11.205 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:11.205 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:11.205 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:11.205 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:11.205 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:11.206 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:11.206 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.206 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.206 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:11.206 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.206 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:11.207 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:11.207 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:11.207 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:11.207 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:11.207 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.208 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray3", 2020-05-18T21:38:11.208 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60d", 2020-05-18T21:38:11.208 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:11.208 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:11.208 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:11.208 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:11.209 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:11.209 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:11.209 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:11.209 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.209 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.210 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:11.210 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:11.210 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.210 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.210 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.210 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.211 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.211 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.211 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.211 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.212 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.212 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.212 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.212 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.212 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.212 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.213 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.213 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:11.213 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:11.213 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:11.213 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:11.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.214 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:11.214 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:11.214 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:11.214 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.215 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.215 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1553, 2020-05-18T21:38:11.215 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:11.215 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:11.215 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:11.216 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:11.216 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:11.216 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:11.216 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:11.216 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:11.216 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:11.217 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:11.217 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:11.217 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:11.217 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.217 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:11.218 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:11.218 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:11.218 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:11.218 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:11.218 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:11.218 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.219 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:11.219 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:11.219 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:11.219 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:11.219 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:11.219 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:11.220 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:11.220 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:11.220 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:11.220 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:11.220 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:11.221 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:11.221 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:11.221 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.221 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:11.221 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:11.221 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:11.222 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:11.222 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.222 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:11.222 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.222 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.223 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.223 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.223 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.223 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088498+0000" 2020-05-18T21:38:11.223 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.223 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:11.224 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.224 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.224 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.224 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.224 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.225 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088498+0000" 2020-05-18T21:38:11.225 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.225 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.225 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:11.225 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:11.225 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:11.226 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:11.226 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:11.226 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:11.226 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:11.226 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:11.227 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.227 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:11.227 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:11.227 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:11.227 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:11.227 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:11.228 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:11.228 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.228 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:11.228 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:11.228 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:11.228 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.229 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.229 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.229 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.229 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.229 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.230 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.230 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.230 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.230 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.230 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.230 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.231 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.231 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.231 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.231 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:11.231 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:11.232 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:11.232 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.232 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:11.232 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.232 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.232 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.233 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.233 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.233 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.233 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.233 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.234 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.234 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:11.234 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:11.234 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:11.234 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:11.234 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:11.235 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:11.235 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:11.235 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:11.235 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:11.235 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.235 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.236 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:11.236 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.236 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:11.236 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:11.236 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:11.237 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:11.237 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:11.237 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.237 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray7", 2020-05-18T21:38:11.238 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x611", 2020-05-18T21:38:11.238 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:11.238 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:11.238 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:11.238 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:11.239 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:11.239 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:11.239 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:11.239 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.239 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.239 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:11.240 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:11.240 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.240 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.240 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.240 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.241 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.241 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.241 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.241 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.241 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.241 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.242 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.242 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.242 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.242 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.242 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.243 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.243 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:11.243 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:11.243 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:11.243 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:11.243 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.244 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:11.244 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:11.244 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:11.244 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.244 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.245 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.245 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1554, 2020-05-18T21:38:11.245 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:11.245 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:11.245 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:11.245 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:11.246 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:11.246 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:11.246 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:11.246 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:11.246 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:11.247 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:11.247 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:11.247 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:11.247 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.247 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:11.247 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:11.248 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:11.248 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:11.248 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:11.248 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:11.248 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.249 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:11.249 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:11.249 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:11.249 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:11.249 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:11.250 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:11.250 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:11.250 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:11.250 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:11.250 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:11.250 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:11.251 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:11.251 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:11.251 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.251 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:11.251 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:11.252 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:11.252 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:11.252 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.252 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:11.252 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.252 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.253 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.253 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.253 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.253 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088676+0000" 2020-05-18T21:38:11.253 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.254 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:11.254 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.254 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.254 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.254 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.254 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.255 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088676+0000" 2020-05-18T21:38:11.255 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.255 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.255 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:11.255 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:11.256 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:11.256 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:11.256 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:11.256 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:11.256 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:11.256 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:11.257 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.257 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:11.257 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:11.257 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:11.257 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:11.258 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:11.258 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:11.258 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.258 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:11.258 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:11.258 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:11.259 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.259 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.259 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.259 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.259 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.260 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.260 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.260 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.260 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.260 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.260 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.261 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.261 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.261 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.261 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.261 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:11.262 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:11.262 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:11.262 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.262 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:11.262 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.263 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.263 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.263 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.263 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.263 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.263 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.264 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.264 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.264 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:11.264 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:11.264 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:11.265 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:11.265 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:11.265 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:11.265 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:11.265 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:11.265 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:11.266 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.266 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.266 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:11.266 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.266 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:11.267 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:11.267 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:11.267 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:11.267 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:11.267 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.267 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray8", 2020-05-18T21:38:11.268 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x612", 2020-05-18T21:38:11.268 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:11.268 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:11.268 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:11.268 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:11.269 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:11.269 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:11.269 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:11.269 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.269 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.269 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:11.270 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:11.270 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.270 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.270 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.270 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.271 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.271 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.271 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.271 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.271 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.271 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.272 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.272 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.272 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.272 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.272 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.273 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.273 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:11.273 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:11.273 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:11.273 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:11.273 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.274 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:11.274 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:11.274 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:11.274 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.274 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.275 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.275 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1550, 2020-05-18T21:38:11.275 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:11.275 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:11.275 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:11.275 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:11.276 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:11.276 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:11.276 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:11.276 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:11.276 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:11.277 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:11.277 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:11.277 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:11.277 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.277 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:11.277 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:11.278 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:11.278 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:11.278 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:11.278 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:11.278 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.279 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:11.279 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:11.279 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:11.279 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:11.279 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:11.279 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:11.280 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:11.280 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:11.280 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:11.280 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:11.280 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:11.281 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:11.281 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:11.281 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.281 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:11.281 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:11.281 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:11.282 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:11.282 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.282 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:11.282 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.282 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.283 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.283 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.283 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.283 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087546+0000" 2020-05-18T21:38:11.283 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.283 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:11.284 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.284 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.284 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.284 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.284 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.285 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087546+0000" 2020-05-18T21:38:11.285 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.285 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.285 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:11.285 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:11.285 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:11.286 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:11.286 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:11.286 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:11.286 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:11.286 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:11.287 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.287 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:11.287 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:11.287 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:11.287 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:11.287 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:11.288 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:11.288 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.288 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:11.288 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:11.288 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:11.288 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.289 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.289 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.289 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.289 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.289 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.290 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.290 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.290 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.290 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.290 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.290 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.291 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.291 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.291 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.291 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:11.291 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:11.292 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:11.292 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.292 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:11.292 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.292 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.292 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.293 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.293 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.293 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.293 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.293 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.294 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.294 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:11.294 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:11.294 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:11.294 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:11.295 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:11.295 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:11.295 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:11.295 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:11.295 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:11.295 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.296 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.296 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:11.296 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.296 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:11.296 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:11.297 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:11.297 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:11.297 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:11.297 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.297 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray4", 2020-05-18T21:38:11.297 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60e", 2020-05-18T21:38:11.298 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:11.298 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:11.298 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:11.298 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:11.298 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:11.299 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:11.299 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:11.299 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.299 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.299 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:11.299 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:11.300 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.300 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.300 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.300 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.300 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.301 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.301 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.301 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.301 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.301 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.302 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.302 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.302 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.302 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.303 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.303 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.303 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:11.303 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:11.303 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:11.303 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:11.304 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.304 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:11.304 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:11.304 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:11.304 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.305 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.305 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.305 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1555, 2020-05-18T21:38:11.305 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:11.305 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:11.305 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:11.306 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:11.306 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:11.306 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:11.306 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:11.306 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:11.307 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:11.307 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:11.307 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:11.307 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:11.307 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.307 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:11.308 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:11.308 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:11.308 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:11.308 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:11.308 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:11.309 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.309 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:11.309 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:11.309 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:11.309 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:11.309 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:11.310 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:11.310 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:11.310 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:11.310 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:11.310 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:11.311 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:11.311 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:11.311 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:11.311 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.311 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:11.311 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:11.312 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:11.312 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:11.312 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.312 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:11.312 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.313 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.313 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.313 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.313 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.313 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:11.313 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.314 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:11.314 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.314 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.314 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.314 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.315 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.315 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:11.315 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.315 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.315 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:11.315 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:11.316 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:11.316 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:11.316 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:11.316 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:11.316 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:11.317 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:11.317 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.317 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:11.317 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:11.317 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:11.317 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:11.318 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:11.318 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:11.318 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.318 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:11.318 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:11.319 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:11.319 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.319 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.319 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.319 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.319 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.320 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.320 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.320 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.320 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.320 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.321 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.321 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.321 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.321 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.321 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.321 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:11.322 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:11.322 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:11.322 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.322 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:11.322 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.323 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.323 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.323 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.323 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.323 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.323 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.324 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.324 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.324 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:11.324 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:11.324 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:11.325 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:11.325 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:11.325 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:11.326 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:11.326 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:11.326 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:11.326 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.326 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.327 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:11.327 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.327 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:11.327 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:11.327 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:11.328 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:11.328 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:11.328 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.328 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray9", 2020-05-18T21:38:11.328 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x613", 2020-05-18T21:38:11.328 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:11.329 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:11.329 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:11.329 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:11.329 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:11.329 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:11.330 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:11.330 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.330 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.330 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:11.330 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:11.331 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.331 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.331 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.331 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.331 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.332 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.332 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.332 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.332 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.332 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.333 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.333 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.333 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.333 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.333 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.333 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:11.334 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:11.334 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:11.334 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:11.334 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.334 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:11.335 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:11.335 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:11.335 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.335 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.335 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.336 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 3, 2020-05-18T21:38:11.336 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:11.336 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:11.336 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:11.336 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16877, 2020-05-18T21:38:11.336 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:11.337 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:11.337 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:11.337 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:11.337 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:11.337 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:11.338 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:11.338 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:11.338 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.338 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:11.339 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:11.339 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:11.339 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:11.339 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:11.339 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:11.340 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.340 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:11.340 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:11.340 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:11.340 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:11.340 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:11.341 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:11.341 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:11.341 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:11.341 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:11.341 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:11.342 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:11.342 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:11.342 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:11.342 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.342 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:11.343 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:11.343 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:11.343 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:11.343 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.343 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:11.343 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.344 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.344 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.344 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.344 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.344 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:01.329092+0000" 2020-05-18T21:38:11.345 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.345 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:11.345 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.345 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.345 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.345 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:11.346 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.346 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:01.329092+0000" 2020-05-18T21:38:11.346 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.346 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.346 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:11.347 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:11.347 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:11.347 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:11.347 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:11.347 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:11.347 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:11.348 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:11.348 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.348 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:11.348 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:11.348 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:11.349 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:11.349 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:11.349 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:11.349 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.349 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:11.350 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:11.350 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:11.350 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.350 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.350 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.350 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.351 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.351 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.351 INFO:teuthology.orchestra.run.smithi155.stdout: -2, 2020-05-18T21:38:11.351 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.351 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.352 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.352 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.352 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.352 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.352 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.352 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.353 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:38:11.353 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.353 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:38:11.353 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.353 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.354 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.354 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.354 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.354 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.354 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.355 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.355 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.355 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:11.355 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:11.355 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:11.355 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:11.356 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:11.356 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:11.356 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:11.356 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:11.356 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:11.357 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.357 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:11.357 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.357 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:11.357 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:11.357 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:11.358 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:11.358 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:11.358 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.358 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.358 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 257, 2020-05-18T21:38:11.359 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:11.360 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:11.360 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:11.361 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:11.361 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:11.361 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:11.361 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:11.361 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:11.362 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:11.362 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:11.362 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:11.362 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:11.362 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.363 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:11.363 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:11.363 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:11.363 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:11.363 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:11.364 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:11.364 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.364 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:11.364 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:11.364 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:11.364 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:11.365 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:11.365 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:11.365 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:11.365 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:11.365 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:11.366 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:11.366 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:11.366 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:11.366 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:11.366 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.367 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:11.367 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:11.367 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 10, 2020-05-18T21:38:11.367 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:11.367 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.367 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:11.368 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.368 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.368 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.368 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:38:11.368 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.368 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:11.369 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.369 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:11.369 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:11.369 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:11.370 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:11.370 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:38:11.370 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:11.370 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:11.370 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.370 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.371 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:11.371 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:11.371 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:11.371 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:11.371 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:11.372 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:11.372 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:11.372 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:11.372 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.372 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:11.372 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:11.373 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:11.373 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:11.373 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:11.373 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:11.373 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.374 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:11.374 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:11.374 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:11.374 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.374 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.375 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.375 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.375 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.375 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.375 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.376 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.376 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.376 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.376 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.376 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.376 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.377 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.377 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.377 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:11.377 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:38:11.377 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.378 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:11.378 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.378 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.378 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.378 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.378 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.379 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.379 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.379 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.379 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.379 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:11.380 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:11.380 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:11.380 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:11.380 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:11.380 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:11.381 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:11.381 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:11.381 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:11.381 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.381 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:11.382 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.382 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:11.382 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:11.382 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:11.382 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:11.383 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:11.383 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.383 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1", 2020-05-18T21:38:11.383 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x101", 2020-05-18T21:38:11.383 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:11.384 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:11.384 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:11.384 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "0", 2020-05-18T21:38:11.385 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "0", 2020-05-18T21:38:11.385 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:11.385 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "1", 2020-05-18T21:38:11.385 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.385 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:11.386 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:11.386 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:11.386 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.386 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.386 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.387 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.387 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.387 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.387 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.387 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.387 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.388 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.388 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.388 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.388 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.388 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.389 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.389 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.389 INFO:teuthology.orchestra.run.smithi155.stdout: "child": 1, 2020-05-18T21:38:11.389 INFO:teuthology.orchestra.run.smithi155.stdout: "subtree": 1, 2020-05-18T21:38:11.389 INFO:teuthology.orchestra.run.smithi155.stdout: "subtreetemp": 0, 2020-05-18T21:38:11.390 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:11.390 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:11.390 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:11.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.390 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:11.391 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [ 2020-05-18T21:38:11.391 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.391 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray6", 2020-05-18T21:38:11.391 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:11.391 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:11.391 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:11.392 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:11.392 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:11.392 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:11.392 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:11.392 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1552, 2020-05-18T21:38:11.393 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:11.393 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.393 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:11.393 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.393 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.394 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.394 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.394 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.394 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.394 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.395 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.395 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.395 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.395 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.395 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.395 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.396 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.396 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.396 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.396 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:11.396 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.397 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:11.397 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:11.397 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.397 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.398 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.398 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.398 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.398 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.399 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.399 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.399 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.399 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.400 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:11.400 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.400 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.400 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.400 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray7", 2020-05-18T21:38:11.401 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:11.401 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:11.401 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:11.401 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:11.401 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:11.402 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:11.402 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:11.402 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1553, 2020-05-18T21:38:11.402 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:11.402 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.404 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.404 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.404 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.404 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.404 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.404 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.405 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.405 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.405 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.405 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.405 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.406 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.406 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:11.406 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.407 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:11.407 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:11.407 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.407 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.408 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.408 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.408 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.408 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.408 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.408 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.409 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.409 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.409 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:11.409 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.409 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.410 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.410 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray0", 2020-05-18T21:38:11.410 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:11.410 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:11.410 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:11.411 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:11.411 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:11.411 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:11.411 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:11.411 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1546, 2020-05-18T21:38:11.412 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:11.412 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.412 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:11.412 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.412 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.413 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.413 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.413 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.413 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.413 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.414 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.414 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.414 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.414 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.414 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.414 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.415 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.415 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.415 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.415 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:11.415 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.416 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:11.416 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:11.416 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.416 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.416 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.416 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.417 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.417 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.417 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.417 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.417 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.418 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.418 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:11.418 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.418 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.419 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray9", 2020-05-18T21:38:11.419 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:11.419 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:11.419 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:11.419 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:11.420 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:11.420 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:11.420 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:11.420 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1555, 2020-05-18T21:38:11.421 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:11.421 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.421 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:11.421 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.421 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.422 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.422 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.422 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.422 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.422 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.422 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.423 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.423 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.423 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.423 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.423 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.424 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.424 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.424 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.424 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:11.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.425 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:11.425 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:11.425 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.425 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.426 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.426 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.426 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.426 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.426 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.427 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.427 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.427 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:11.427 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.428 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.428 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray5", 2020-05-18T21:38:11.428 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:11.428 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:11.429 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:11.429 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:11.429 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:11.429 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:11.430 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:11.430 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1551, 2020-05-18T21:38:11.430 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:11.430 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.431 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:11.431 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.432 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.432 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.432 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.432 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.433 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.433 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.433 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.433 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.434 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.434 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.434 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.435 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.435 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.435 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:11.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.436 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:11.436 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:11.436 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.436 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.436 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.437 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.437 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.437 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.437 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.437 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.438 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.438 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:11.438 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.438 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.439 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray2", 2020-05-18T21:38:11.439 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:11.439 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:11.439 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:11.439 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:11.440 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:11.440 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:11.440 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:11.440 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1548, 2020-05-18T21:38:11.440 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:11.440 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.441 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:11.441 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.441 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.441 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.441 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.442 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.442 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.442 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.443 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.443 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.443 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.443 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.443 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.444 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.444 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.444 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:11.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.444 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:11.444 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:11.445 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.445 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.445 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.445 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.445 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.446 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.446 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.446 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.446 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.446 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:11.447 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.447 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray1", 2020-05-18T21:38:11.447 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:11.448 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:11.448 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:11.448 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:11.448 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:11.448 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:11.448 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:11.449 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1547, 2020-05-18T21:38:11.449 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:11.449 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.449 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:11.449 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.450 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.450 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.450 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.450 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.451 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.451 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.451 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.451 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.451 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.452 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.452 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.452 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.452 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.453 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.453 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:11.453 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.453 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:11.453 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:11.454 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.454 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.454 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.454 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.454 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.455 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.455 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.455 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.456 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.456 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:11.456 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.457 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.457 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.457 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray8", 2020-05-18T21:38:11.457 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:11.457 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:11.458 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:11.458 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:11.458 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:11.458 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:11.458 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:11.459 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1554, 2020-05-18T21:38:11.459 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:11.459 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.459 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:11.459 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.460 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.460 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.460 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.460 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.460 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.461 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.461 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.461 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.461 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.461 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.462 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.462 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.462 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.462 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.462 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:11.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.463 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:11.463 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:11.463 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.463 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.463 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.464 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.464 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.464 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.464 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.464 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.465 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.465 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:11.465 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.465 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.466 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray3", 2020-05-18T21:38:11.466 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:11.466 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:11.466 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:11.466 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:11.467 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:11.467 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:11.467 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:11.467 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1549, 2020-05-18T21:38:11.467 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:11.468 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.468 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:11.468 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.468 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.468 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.468 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.469 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.469 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.469 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.469 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.469 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.469 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.470 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.470 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.470 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.470 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.470 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.471 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.471 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:11.471 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.471 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:11.471 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:11.471 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.472 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.472 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.472 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.472 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.472 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.473 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.473 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.473 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.473 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:11.473 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:11.474 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray4", 2020-05-18T21:38:11.474 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:11.474 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:11.475 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:11.475 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:11.475 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:11.475 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:11.475 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:11.476 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1550, 2020-05-18T21:38:11.476 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:11.476 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:11.476 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:11.476 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.477 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:11.477 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:11.477 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:11.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.477 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:11.477 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:11.478 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:11.478 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:11.478 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:11.478 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:11.478 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.479 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:11.479 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:11.479 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:11.479 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:11.479 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:11.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.480 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:11.480 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:11.480 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:11.480 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:11.480 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:11.481 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:11.481 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:11.481 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:11.481 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:11.481 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:11.482 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:11.482 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:11.482 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:11.482 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.482 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:11.482 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.483 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:11.483 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:11.483 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:11.483 INFO:teuthology.orchestra.run.smithi155.stdout:] 2020-05-18T21:38:11.485 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "ino": 1, "rdev": 0, "ctime": "2020-05-18T21:38:07.145016+0000", "btime": "2020-05-18T21:37:45.267427+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 30, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:07.145016+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:38:07.145016+0000", "num_files": 0, "num_subdirs": 1, "change_attr": 1 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:52.684697+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:45.267427+0000" }, "version": 4, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 3, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "dirfrag": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1546, "rdev": 0, "ctime": "2020-05-18T21:37:53.086518+0000", "btime": "2020-05-18T21:37:53.086518+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086518+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086518+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086518+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray0", "dirfrag": "0x60a", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1547, "rdev": 0, "ctime": "2020-05-18T21:37:53.086853+0000", "btime": "2020-05-18T21:37:53.086853+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086853+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086853+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086853+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray1", "dirfrag": "0x60b", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1548, "rdev": 0, "ctime": "2020-05-18T21:37:53.087103+0000", "btime": "2020-05-18T21:37:53.087103+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087103+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087103+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087103+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray2", "dirfrag": "0x60c", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1551, "rdev": 0, "ctime": "2020-05-18T21:37:53.087783+0000", "btime": "2020-05-18T21:37:53.087783+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087783+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087783+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087783+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray5", "dirfrag": "0x60f", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1552, "rdev": 0, "ctime": "2020-05-18T21:37:53.088334+0000", "btime": "2020-05-18T21:37:53.088334+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088334+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088334+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088334+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray6", "dirfrag": "0x610", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1549, "rdev": 0, "ctime": "2020-05-18T21:37:53.087329+0000", "btime": "2020-05-18T21:37:53.087329+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087329+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087329+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087329+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray3", "dirfrag": "0x60d", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1553, "rdev": 0, "ctime": "2020-05-18T21:37:53.088498+0000", "btime": "2020-05-18T21:37:53.088498+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088498+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088498+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088498+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray7", "dirfrag": "0x611", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1554, "rdev": 0, "ctime": "2020-05-18T21:37:53.088676+0000", "btime": "2020-05-18T21:37:53.088676+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088676+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088676+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088676+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray8", "dirfrag": "0x612", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1550, "rdev": 0, "ctime": "2020-05-18T21:37:53.087546+0000", "btime": "2020-05-18T21:37:53.087546+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087546+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087546+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087546+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray4", "dirfrag": "0x60e", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1555, "rdev": 0, "ctime": "2020-05-18T21:37:53.088993+0000", "btime": "2020-05-18T21:37:53.088993+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088993+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray9", "dirfrag": "0x613", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 3, "rdev": 0, "ctime": "2020-05-18T21:38:01.329092+0000", "btime": "2020-05-18T21:38:01.329092+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:01.329092+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:38:01.329092+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:38:01.329092+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ -2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "openingsnapparents": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 257, "rdev": 0, "ctime": "2020-05-18T21:37:53.086401+0000", "btime": "2020-05-18T21:37:53.086401+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086401+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 10, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "openingsnapparents": 0 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "subtreetemp": 0, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 3, "dentries": [ { "path": "stray6", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1552, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray7", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1553, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray0", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1546, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray9", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1555, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray5", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1551, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray2", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1548, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray1", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1547, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray8", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1554, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray3", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1549, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray4", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1550, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] } ] } ] } ] 2020-05-18T21:38:12.487 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok dump cache 2020-05-18T21:38:12.595 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2020-05-18T21:38:12.595 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.595 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1, 2020-05-18T21:38:12.596 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:12.596 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:12.596 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:45.267427+0000", 2020-05-18T21:38:12.596 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 17407, 2020-05-18T21:38:12.596 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:12.596 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:12.597 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:12.597 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:12.597 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:12.597 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:12.597 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:12.598 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:12.598 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.598 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:12.598 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:38:12.599 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:38:12.599 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:38:12.599 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 30, 2020-05-18T21:38:12.599 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:12.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.599 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:12.600 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:12.600 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:12.600 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:12.600 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:12.600 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:12.601 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:12.601 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:12.601 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:12.601 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:38:12.601 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:12.602 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:12.602 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:12.602 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.602 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:12.603 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:12.603 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 1, 2020-05-18T21:38:12.603 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1 2020-05-18T21:38:12.603 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.603 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:12.604 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.604 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.604 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.604 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.604 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.605 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:52.684697+0000" 2020-05-18T21:38:12.605 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.605 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:12.605 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.605 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.606 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.606 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.607 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.607 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:45.267427+0000" 2020-05-18T21:38:12.608 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.608 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 4, 2020-05-18T21:38:12.608 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:12.609 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:12.609 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 3, 2020-05-18T21:38:12.609 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:12.610 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:12.610 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:12.610 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:12.611 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:12.611 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.611 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:12.612 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:12.612 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:12.612 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:12.613 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:12.613 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:12.614 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.614 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:12.614 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:12.615 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:12.615 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:38:12.616 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.617 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.617 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.618 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.618 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:38:12.618 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.618 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.619 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:38:12.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.619 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.620 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.620 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.620 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.621 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": 0, 2020-05-18T21:38:12.621 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 0 2020-05-18T21:38:12.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.622 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:38:12.622 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:12.622 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:12.623 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:12.623 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:12.623 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:12.624 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:12.624 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:12.624 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:12.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.625 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:12.626 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:12.627 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:12.627 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:12.627 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:12.628 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:12.628 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:38:12.628 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:12.629 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:38:12.629 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:12.629 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:12.630 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:12.630 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:12.630 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:12.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.631 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:12.631 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:12.631 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [], 2020-05-18T21:38:12.632 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:12.632 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:12.633 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:12.633 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:12.633 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:12.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.634 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.634 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1546, 2020-05-18T21:38:12.635 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:12.635 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:12.635 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:12.636 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:12.636 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:12.636 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:12.637 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:12.637 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:12.638 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:12.638 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:12.639 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:12.639 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:12.639 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.639 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:12.639 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:12.640 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:12.640 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:12.640 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:12.640 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:12.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.641 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:12.641 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:12.641 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:12.641 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:12.642 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:12.642 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:12.642 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:12.642 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:12.642 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:12.642 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:12.643 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:12.643 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:12.643 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:12.643 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.643 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:12.644 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:12.644 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:12.644 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:12.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.644 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:12.644 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.645 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.645 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.645 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.645 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.645 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086518+0000" 2020-05-18T21:38:12.646 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.646 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:12.646 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.646 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.646 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.647 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.647 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.647 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086518+0000" 2020-05-18T21:38:12.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.648 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:12.648 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:12.648 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:12.648 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:12.649 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:12.649 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:12.649 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:12.649 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:12.649 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:12.649 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.650 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:12.650 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:12.650 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:12.650 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:12.651 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:12.651 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:12.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.651 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:12.652 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:12.652 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:12.652 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.652 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.652 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.653 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.653 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.653 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.653 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.653 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.654 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.654 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.654 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.654 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.654 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.654 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.655 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.655 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:12.655 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:12.655 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:12.655 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.656 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:12.656 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:12.656 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:12.656 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:12.656 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:12.656 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:12.657 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:12.657 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:12.657 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:12.657 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.658 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:12.658 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:12.658 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:12.658 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:12.658 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:12.659 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:12.659 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:12.659 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:12.659 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:12.660 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.660 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.660 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:12.660 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.661 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:12.661 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:12.661 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:12.661 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:12.661 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:12.662 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.662 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray0", 2020-05-18T21:38:12.662 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60a", 2020-05-18T21:38:12.663 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:12.663 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:12.663 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:12.663 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:12.663 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:12.664 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:12.664 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:12.664 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.664 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.664 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:12.665 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:12.665 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.665 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.665 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.665 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.665 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.666 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.666 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.666 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.666 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.667 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.667 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.667 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.667 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.668 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.669 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.669 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:12.669 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:12.669 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:12.669 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:12.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.670 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:12.670 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:12.671 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:12.671 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:12.671 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.671 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.671 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1547, 2020-05-18T21:38:12.671 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:12.672 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:12.672 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:12.672 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:12.672 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:12.673 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:12.673 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:12.673 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:12.673 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:12.673 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:12.674 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:12.674 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:12.674 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.674 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:12.674 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:12.675 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:12.675 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:12.675 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:12.675 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:12.675 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.675 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:12.676 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:12.676 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:12.676 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:12.676 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:12.676 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:12.677 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:12.677 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:12.677 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:12.677 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:12.677 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:12.677 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:12.678 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:12.678 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.678 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:12.678 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:12.678 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:12.679 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:12.679 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.679 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:12.679 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.679 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.679 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.680 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.680 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.680 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086853+0000" 2020-05-18T21:38:12.680 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.680 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:12.681 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.681 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.681 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.681 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.682 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.682 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086853+0000" 2020-05-18T21:38:12.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.682 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:12.682 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:12.683 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:12.683 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:12.683 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:12.683 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:12.683 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:12.683 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:12.684 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:12.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.684 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:12.684 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:12.684 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:12.685 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:12.685 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:12.685 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:12.685 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.685 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:12.686 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:12.686 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:12.686 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.686 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.687 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.687 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.687 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.687 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.688 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.688 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.688 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.688 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.689 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.689 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.689 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.689 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:12.689 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:12.689 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:12.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.690 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:12.690 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:12.690 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:12.690 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:12.691 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:12.691 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:12.691 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:12.691 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:12.691 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:12.691 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.692 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:12.692 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:12.692 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:12.692 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:12.692 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:12.693 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:12.693 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:12.693 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:12.693 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:12.693 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.693 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.694 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:12.694 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.694 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:12.694 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:12.694 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:12.695 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:12.695 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:12.695 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.695 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray1", 2020-05-18T21:38:12.695 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60b", 2020-05-18T21:38:12.695 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:12.696 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:12.696 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:12.696 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:12.696 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:12.696 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:12.696 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:12.697 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.697 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.697 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:12.697 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:12.697 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.698 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.698 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.698 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.698 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.698 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.699 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.699 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.699 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.699 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.699 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.700 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.700 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.700 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.700 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.700 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:12.700 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:12.701 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:12.701 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:12.701 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.701 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:12.702 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:12.702 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:12.702 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:12.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.702 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.703 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1548, 2020-05-18T21:38:12.703 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:12.703 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:12.703 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:12.703 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:12.703 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:12.704 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:12.704 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:12.704 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:12.704 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:12.704 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:12.705 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:12.705 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:12.705 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.705 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:12.705 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:12.705 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:12.706 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:12.706 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:12.706 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:12.706 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.706 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:12.707 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:12.707 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:12.707 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:12.707 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:12.707 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:12.707 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:12.708 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:12.708 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:12.708 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:12.708 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:12.708 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:12.709 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:12.709 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.709 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:12.709 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:12.709 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:12.710 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:12.710 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.710 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:12.710 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.710 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.711 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.711 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.711 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.711 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087103+0000" 2020-05-18T21:38:12.711 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.711 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:12.712 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.712 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.712 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.712 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.712 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.713 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087103+0000" 2020-05-18T21:38:12.713 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.713 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:12.713 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:12.714 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:12.714 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:12.714 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:12.714 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:12.714 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:12.714 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:12.715 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:12.715 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.715 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:12.715 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:12.715 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:12.716 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:12.716 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:12.716 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:12.716 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.716 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:12.716 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:12.717 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:12.717 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.717 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.717 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.718 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.718 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.718 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.718 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.718 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.718 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.719 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.719 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.719 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.719 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.720 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.720 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:12.720 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:12.720 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:12.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.721 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:12.721 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:12.721 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:12.721 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:12.721 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:12.721 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:12.722 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:12.722 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:12.722 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:12.722 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.722 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:12.723 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:12.723 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:12.723 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:12.723 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:12.723 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:12.723 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:12.724 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:12.724 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:12.724 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.724 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.724 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:12.724 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.725 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:12.725 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:12.725 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:12.725 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:12.725 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:12.726 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.726 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray2", 2020-05-18T21:38:12.726 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60c", 2020-05-18T21:38:12.726 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:12.726 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:12.726 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:12.727 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:12.727 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:12.727 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:12.727 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:12.727 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.728 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.728 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:12.728 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:12.728 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.728 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.728 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.729 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.729 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.729 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.729 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.729 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.730 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.730 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.730 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.730 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.730 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.730 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.731 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.731 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.731 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:12.731 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:12.731 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:12.731 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:12.732 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.732 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:12.732 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:12.732 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:12.732 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:12.733 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.733 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.733 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1551, 2020-05-18T21:38:12.733 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:12.733 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:12.734 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:12.734 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:12.734 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:12.734 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:12.734 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:12.734 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:12.735 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:12.735 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:12.735 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:12.735 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:12.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.735 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:12.736 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:12.736 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:12.736 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:12.736 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:12.736 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:12.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.737 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:12.737 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:12.737 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:12.737 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:12.737 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:12.738 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:12.738 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:12.738 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:12.738 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:12.738 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:12.739 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:12.739 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:12.739 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:12.739 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.739 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:12.739 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:12.740 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:12.740 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:12.740 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.740 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:12.740 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.741 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.741 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.741 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.741 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.741 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087783+0000" 2020-05-18T21:38:12.741 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.742 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:12.742 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.742 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.742 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.742 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.743 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.743 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087783+0000" 2020-05-18T21:38:12.743 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.743 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:12.743 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:12.743 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:12.744 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:12.744 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:12.744 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:12.744 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:12.744 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:12.745 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:12.745 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.745 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:12.745 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:12.745 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:12.745 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:12.746 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:12.746 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:12.746 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.746 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:12.746 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:12.747 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:12.747 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.747 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.747 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.747 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.747 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.748 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.748 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.748 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.748 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.748 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.749 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.749 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.749 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.749 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.749 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:12.750 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:12.750 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:12.750 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.750 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:12.750 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:12.751 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:12.751 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:12.751 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:12.751 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:12.751 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:12.751 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:12.752 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:12.752 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.752 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:12.752 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:12.752 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:12.753 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:12.753 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:12.753 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:12.753 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:12.753 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:12.753 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:12.754 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.754 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.754 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:12.754 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.754 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:12.755 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:12.755 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:12.755 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:12.755 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:12.755 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.755 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray5", 2020-05-18T21:38:12.756 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60f", 2020-05-18T21:38:12.756 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:12.756 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:12.756 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:12.756 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:12.757 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:12.757 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:12.757 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:12.757 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.757 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.757 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:12.758 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:12.758 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.758 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.758 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.758 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.758 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.759 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.759 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.759 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.759 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.759 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.760 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.760 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.760 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.760 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.760 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.761 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:12.761 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:12.761 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:12.761 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:12.761 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.762 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:12.762 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:12.762 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:12.762 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:12.762 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.762 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.763 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1552, 2020-05-18T21:38:12.763 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:12.763 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:12.763 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:12.763 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:12.764 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:12.764 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:12.764 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:12.764 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:12.764 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:12.764 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:12.765 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:12.765 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:12.765 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.765 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:12.765 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:12.766 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:12.766 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:12.766 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:12.766 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:12.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.766 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:12.767 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:12.767 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:12.767 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:12.767 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:12.767 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:12.768 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:12.768 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:12.768 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:12.768 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:12.769 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:12.769 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:12.769 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:12.769 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.769 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:12.770 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:12.770 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:12.770 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:12.770 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.770 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:12.771 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.771 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.771 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.771 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.772 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.772 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088334+0000" 2020-05-18T21:38:12.772 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.772 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:12.773 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.773 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.773 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.773 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.773 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.774 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088334+0000" 2020-05-18T21:38:12.774 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.774 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:12.774 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:12.774 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:12.774 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:12.775 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:12.775 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:12.775 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:12.775 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:12.775 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:12.776 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.776 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:12.776 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:12.776 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:12.776 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:12.776 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:12.777 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:12.777 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.777 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:12.777 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:12.777 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:12.778 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.778 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.778 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.778 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.778 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.778 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.780 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.780 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.780 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.780 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:12.780 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:12.781 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:12.781 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.781 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:12.781 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:12.783 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:12.783 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:12.783 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.783 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:12.783 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:12.783 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:12.784 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:12.784 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:12.784 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:12.784 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:12.784 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:12.784 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:12.785 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.785 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.785 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:12.785 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.785 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:12.786 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:12.786 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:12.786 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:12.786 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:12.786 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.787 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray6", 2020-05-18T21:38:12.787 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x610", 2020-05-18T21:38:12.787 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:12.787 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:12.787 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:12.788 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:12.788 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:12.788 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:12.788 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.790 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.790 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.790 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.790 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.790 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.792 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.792 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.792 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.792 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:12.792 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:12.794 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:12.794 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.794 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.794 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1549, 2020-05-18T21:38:12.794 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:12.796 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:12.796 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:12.796 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:12.796 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:12.796 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:12.797 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.797 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:12.797 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:12.797 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:12.797 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:12.797 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:12.798 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:12.798 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.798 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:12.798 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:12.798 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:12.799 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:12.799 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:12.799 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:12.799 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:12.799 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:12.799 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:12.801 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:12.801 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:12.801 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:12.801 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.801 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:12.802 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.802 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.802 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.802 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.803 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.803 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087329+0000" 2020-05-18T21:38:12.803 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.803 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:12.803 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087329+0000" 2020-05-18T21:38:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.805 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:12.805 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:12.805 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:12.805 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:12.805 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:12.805 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:12.806 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:12.806 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:12.806 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:12.806 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.806 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.808 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:12.808 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:12.808 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:12.808 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.808 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.809 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.809 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.809 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.809 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.809 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.810 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.810 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.810 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.810 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.810 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.811 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.811 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.811 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.811 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:12.811 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:12.811 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:12.812 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.812 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:12.812 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:12.812 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:12.812 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:12.813 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:12.813 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:12.813 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:12.813 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:12.813 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:12.813 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.814 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:12.814 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:12.814 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:12.814 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:12.815 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:12.815 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:12.815 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:12.815 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:12.815 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:12.815 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.816 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.816 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:12.816 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.816 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:12.816 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:12.817 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:12.817 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:12.817 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:12.817 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.817 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray3", 2020-05-18T21:38:12.818 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60d", 2020-05-18T21:38:12.818 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:12.818 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:12.818 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:12.818 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:12.818 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:12.819 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:12.819 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:12.819 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.819 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.819 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:12.820 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:12.820 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.820 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.820 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.821 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.821 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.821 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.821 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.821 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.821 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.822 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.822 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.822 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.822 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.822 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.823 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.823 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.823 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:12.823 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:12.823 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:12.823 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:12.824 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.824 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:12.824 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:12.824 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:12.824 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:12.824 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.825 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.825 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1553, 2020-05-18T21:38:12.825 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:12.825 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:12.825 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:12.826 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:12.826 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:12.826 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:12.826 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:12.826 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:12.826 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:12.827 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:12.827 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:12.827 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:12.827 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.827 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:12.828 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:12.828 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:12.828 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:12.828 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:12.828 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:12.828 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.829 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:12.829 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:12.829 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:12.829 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:12.829 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:12.830 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:12.830 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:12.830 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:12.830 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:12.830 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:12.830 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:12.831 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:12.831 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:12.831 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.831 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:12.831 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:12.832 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:12.832 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:12.832 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.832 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:12.832 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.832 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.833 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.833 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.833 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.833 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088498+0000" 2020-05-18T21:38:12.833 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.834 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:12.834 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.834 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.834 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.834 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.834 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.835 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088498+0000" 2020-05-18T21:38:12.835 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.835 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:12.835 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:12.835 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:12.835 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:12.836 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:12.836 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:12.836 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:12.836 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:12.836 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:12.837 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.837 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:12.837 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:12.837 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:12.837 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:12.837 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:12.838 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:12.838 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.838 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:12.838 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:12.838 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:12.839 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.839 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.839 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.839 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.839 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.839 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.840 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.840 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.840 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.840 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.840 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.841 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.841 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.841 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.841 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.841 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:12.841 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:12.842 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:12.842 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.842 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:12.842 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:12.842 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:12.842 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:12.843 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:12.843 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:12.843 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:12.843 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:12.843 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:12.844 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.844 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:12.844 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:12.844 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:12.844 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:12.844 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:12.845 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:12.845 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:12.845 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:12.845 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:12.845 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.845 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.846 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:12.846 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.846 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:12.846 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:12.846 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:12.847 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:12.847 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:12.847 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.847 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray7", 2020-05-18T21:38:12.847 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x611", 2020-05-18T21:38:12.847 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:12.848 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:12.848 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:12.848 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:12.848 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:12.848 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:12.849 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:12.849 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.849 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.849 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:12.849 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:12.849 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.850 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.850 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.850 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.850 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.850 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.851 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.851 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.851 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.851 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.851 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.851 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.852 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.852 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.852 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.852 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.852 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:12.853 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:12.853 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:12.853 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:12.853 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.853 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:12.853 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:12.854 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:12.854 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:12.854 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.854 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.854 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1554, 2020-05-18T21:38:12.855 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:12.855 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:12.855 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:12.855 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:12.855 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:12.855 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:12.856 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:12.856 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:12.856 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:12.856 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:12.856 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:12.856 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:12.857 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.857 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:12.857 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:12.857 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:12.857 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:12.858 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:12.858 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:12.858 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.858 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:12.858 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:12.858 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:12.859 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:12.859 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:12.859 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:12.859 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:12.859 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:12.860 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:12.860 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:12.860 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:12.860 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:12.860 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:12.860 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.861 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:12.861 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:12.861 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:12.861 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:12.861 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.862 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:12.862 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.862 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.862 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.862 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.862 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.863 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088676+0000" 2020-05-18T21:38:12.863 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.863 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:12.863 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.863 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.864 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.864 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.864 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.864 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088676+0000" 2020-05-18T21:38:12.864 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.864 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:12.865 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:12.865 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:12.865 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:12.865 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:12.865 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:12.865 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:12.866 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:12.866 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:12.866 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.866 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:12.866 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:12.867 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:12.867 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:12.867 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:12.867 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:12.867 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.868 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:12.868 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:12.868 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:12.868 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.868 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.868 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.869 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.869 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.869 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.870 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.870 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.870 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.870 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.870 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.871 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.871 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.871 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.871 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.871 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:12.872 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:12.872 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:12.872 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.872 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:12.873 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:12.873 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:12.873 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:12.873 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:12.874 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:12.874 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:12.874 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:12.874 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:12.874 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.874 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:12.875 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:12.875 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:12.875 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:12.875 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:12.875 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:12.876 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:12.876 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:12.876 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:12.876 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.876 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.876 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:12.877 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.877 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:12.877 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:12.877 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:12.877 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:12.878 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:12.878 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.878 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray8", 2020-05-18T21:38:12.878 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x612", 2020-05-18T21:38:12.878 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:12.878 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:12.879 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:12.879 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:12.879 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:12.879 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:12.879 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:12.879 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.880 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.880 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:12.880 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:12.880 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.880 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.881 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.881 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.881 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.881 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.881 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.882 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.882 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.882 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.882 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.883 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.883 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.883 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.883 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.883 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.883 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:12.884 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:12.884 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:12.884 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:12.884 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.884 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:12.885 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:12.885 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:12.885 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:12.885 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.885 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.885 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1550, 2020-05-18T21:38:12.886 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:12.886 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:12.886 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:12.886 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:12.890 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:12.891 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:12.891 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:12.891 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:12.891 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:12.891 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:12.892 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:12.892 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:12.892 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.892 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:12.892 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:12.893 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:12.893 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:12.893 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:12.893 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:12.893 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.894 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:12.894 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:12.894 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:12.894 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:12.894 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:12.894 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:12.895 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:12.895 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:12.895 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:12.895 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:12.895 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:12.896 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:12.896 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:12.896 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.896 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:12.896 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:12.896 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:12.897 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:12.897 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.897 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:12.897 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.897 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.898 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.898 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.898 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.898 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087546+0000" 2020-05-18T21:38:12.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.898 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:12.899 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.899 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.899 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.899 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.899 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.900 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087546+0000" 2020-05-18T21:38:12.900 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.900 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:12.900 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:12.901 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:12.901 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:12.901 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:12.902 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:12.902 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:12.902 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:12.902 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:12.902 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.903 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:12.903 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:12.903 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:12.903 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:12.903 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:12.903 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:12.904 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.904 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:12.906 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:12.906 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:12.906 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.906 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.907 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.907 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.907 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.907 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.907 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.908 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.908 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.908 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.908 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.908 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.909 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.909 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.909 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.909 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:12.909 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:12.909 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:12.910 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.910 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:12.910 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:12.910 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:12.910 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:12.911 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:12.911 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:12.911 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:12.911 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:12.911 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:12.911 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.912 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:12.912 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:12.912 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:12.912 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:12.912 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:12.913 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:12.913 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:12.913 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:12.913 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:12.913 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.913 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.914 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:12.914 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.914 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:12.914 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:12.914 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:12.915 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:12.915 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:12.915 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.915 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray4", 2020-05-18T21:38:12.915 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60e", 2020-05-18T21:38:12.915 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:12.916 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:12.916 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:12.916 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:12.916 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:12.916 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:12.917 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:12.917 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.917 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.917 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:12.917 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:12.917 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.918 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.918 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.918 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.918 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.918 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.919 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.919 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.919 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.919 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.919 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.919 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.920 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.920 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.920 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.920 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.920 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:12.921 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:12.921 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:12.921 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:12.921 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.921 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:12.921 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:12.922 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:12.922 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:12.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.922 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.922 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1555, 2020-05-18T21:38:12.923 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:12.923 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:12.923 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:12.923 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:12.923 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:12.923 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:12.924 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:12.924 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:12.924 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:12.924 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:12.924 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:12.925 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:12.925 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.925 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:12.925 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:12.925 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:12.926 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:12.926 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:12.926 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:12.926 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.926 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:12.926 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:12.927 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:12.927 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:12.927 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:12.927 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:12.927 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:12.928 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:12.928 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:12.928 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:12.928 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:12.928 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:12.928 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:12.929 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.929 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:12.929 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:12.929 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:12.929 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:12.930 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.930 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:12.930 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.930 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.930 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.931 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.931 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.931 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:12.931 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.931 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:12.931 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.932 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.932 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.932 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.932 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.932 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:12.933 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.933 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:12.933 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:12.933 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:12.933 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:12.933 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:12.934 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:12.934 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:12.934 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:12.934 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:12.934 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.935 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:12.935 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:12.935 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:12.935 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:12.935 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:12.935 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:12.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.936 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:12.936 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:12.936 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:12.936 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.937 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.937 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.937 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.937 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.938 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.938 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.938 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.938 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.938 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.939 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.939 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.939 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.939 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:12.939 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:12.940 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:12.940 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.940 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:12.940 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:12.940 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:12.940 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:12.941 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:12.941 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:12.941 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:12.941 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:12.941 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:12.942 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.942 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:12.942 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:12.942 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:12.942 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:12.942 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:12.943 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:12.943 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:12.943 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:12.943 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:12.943 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.944 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.944 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:12.944 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.944 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:12.944 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:12.944 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:12.945 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:12.945 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:12.945 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.945 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray9", 2020-05-18T21:38:12.945 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x613", 2020-05-18T21:38:12.946 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:12.946 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:12.946 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:12.946 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:12.946 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:12.947 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:12.947 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:12.947 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.947 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:12.947 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:12.948 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:12.948 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.948 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.948 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.948 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.949 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.949 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.949 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.949 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.950 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.950 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.950 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.950 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.950 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.950 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.951 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.951 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.951 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:12.951 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:12.951 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:12.952 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:12.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.952 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:12.952 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:12.952 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:12.952 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:12.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.953 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.953 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 3, 2020-05-18T21:38:12.953 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:12.953 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:12.954 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:12.954 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16877, 2020-05-18T21:38:12.954 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:12.954 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:12.954 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:12.954 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:12.955 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:12.955 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:12.955 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:12.955 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:12.955 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.956 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:12.956 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:12.956 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:12.956 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:12.956 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:12.956 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:12.957 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.957 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:12.957 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:12.957 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:12.957 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:12.958 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:12.958 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:12.958 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:12.958 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:12.958 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:12.959 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:12.959 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:12.959 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:12.959 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:12.959 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.959 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:12.960 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:12.960 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:12.960 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:12.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.960 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:12.960 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.961 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.961 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.961 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.961 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.961 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:01.329092+0000" 2020-05-18T21:38:12.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.962 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:12.962 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.962 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.962 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.962 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:12.963 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.963 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:01.329092+0000" 2020-05-18T21:38:12.963 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.963 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:12.963 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:12.964 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:12.964 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:12.964 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:12.964 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:12.964 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:12.964 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:12.965 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:12.965 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.965 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:12.965 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:12.965 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:12.966 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:12.966 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:12.966 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:12.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.966 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:12.966 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:12.967 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:12.967 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.967 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.967 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.968 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.968 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.968 INFO:teuthology.orchestra.run.smithi155.stdout: -2, 2020-05-18T21:38:12.968 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.968 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.969 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.969 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.969 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.969 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.969 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.969 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.970 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:38:12.970 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.970 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:38:12.970 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:12.970 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:12.971 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:12.971 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:12.971 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:12.971 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:12.971 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:12.971 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:12.972 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.972 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:12.972 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:12.972 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:12.972 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:12.973 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:12.973 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:12.973 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:12.973 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:12.973 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:12.973 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.974 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:12.974 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.974 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:12.974 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:12.974 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:12.975 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:12.975 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:12.975 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.975 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.975 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 257, 2020-05-18T21:38:12.975 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:12.976 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:12.976 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:12.976 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:12.976 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:12.976 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:12.977 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:12.977 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:12.977 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:12.977 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:12.977 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:12.978 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:12.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.978 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:12.978 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:12.978 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:12.978 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:12.979 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:12.979 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:12.979 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.979 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:12.979 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:12.980 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:12.980 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:12.980 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:12.980 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:12.980 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:12.980 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:12.981 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:12.981 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:12.981 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:12.981 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:12.981 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:12.982 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.982 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:12.982 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:12.982 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 10, 2020-05-18T21:38:12.982 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:12.982 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.983 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:12.983 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.983 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.983 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.983 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:38:12.983 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.984 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:12.984 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.984 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:12.984 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:12.984 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:12.985 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:12.985 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:38:12.985 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:12.985 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:12.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.985 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:12.986 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:12.986 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:12.986 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:12.986 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:12.986 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:12.987 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:12.987 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:12.987 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:12.987 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.987 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:12.987 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:12.988 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:12.988 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:12.988 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:12.988 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:12.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.989 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:12.989 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:12.989 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:12.989 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:12.989 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:12.990 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:12.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.990 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:12.990 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:12.990 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:12.990 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:12.991 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.991 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:12.991 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.991 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:12.991 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:12.992 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:12.992 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:12.992 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:12.992 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:38:12.992 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.992 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:12.993 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:12.993 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:12.993 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:12.993 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:12.993 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:12.994 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:12.994 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:12.994 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:12.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:12.994 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:12.994 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:12.995 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:12.995 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:12.995 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:12.995 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:12.995 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:12.996 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:12.996 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:12.996 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.996 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:12.996 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:12.996 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:12.997 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:12.997 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:12.997 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:12.997 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:12.997 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:12.998 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1", 2020-05-18T21:38:12.998 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x101", 2020-05-18T21:38:12.998 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:12.998 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:12.998 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:12.998 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "0", 2020-05-18T21:38:12.999 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "0", 2020-05-18T21:38:12.999 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:12.999 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "1", 2020-05-18T21:38:12.999 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:12.999 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:13.000 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:13.000 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:13.000 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:13.000 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:13.000 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:13.000 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:13.001 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.001 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:13.001 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:13.001 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:13.001 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:13.002 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:13.002 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:13.002 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.002 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.002 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:13.002 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:13.003 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:13.003 INFO:teuthology.orchestra.run.smithi155.stdout: "child": 1, 2020-05-18T21:38:13.003 INFO:teuthology.orchestra.run.smithi155.stdout: "subtree": 1, 2020-05-18T21:38:13.003 INFO:teuthology.orchestra.run.smithi155.stdout: "subtreetemp": 0, 2020-05-18T21:38:13.003 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:13.004 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:13.004 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:13.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.004 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:13.004 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [ 2020-05-18T21:38:13.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:13.005 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray6", 2020-05-18T21:38:13.005 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:13.005 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:13.005 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:13.005 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:13.005 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:13.006 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:13.006 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:13.006 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1552, 2020-05-18T21:38:13.006 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:13.006 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:13.007 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:13.007 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.007 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:13.007 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:13.007 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:13.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.008 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:13.008 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:13.008 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:13.008 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:13.008 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:13.009 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:13.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.009 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.009 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:13.009 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:13.009 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:13.010 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:13.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.010 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:13.010 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:13.010 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:13.011 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:13.011 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:13.011 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:13.011 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:13.011 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:13.011 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:13.012 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:13.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.012 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:13.012 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:13.012 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:13.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.013 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:13.013 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray7", 2020-05-18T21:38:13.013 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:13.013 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:13.013 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:13.014 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:13.014 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:13.014 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:13.014 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:13.014 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1553, 2020-05-18T21:38:13.015 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:13.015 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:13.015 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:13.015 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.015 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:13.015 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:13.016 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:13.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.016 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:13.016 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:13.016 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:13.017 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:13.017 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:13.017 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:13.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.017 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.017 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:13.018 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:13.018 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:13.018 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:13.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.018 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:13.019 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:13.019 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:13.019 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:13.019 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:13.019 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:13.019 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:13.020 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:13.020 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:13.020 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:13.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.020 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:13.021 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:13.021 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:13.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.021 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:13.021 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray0", 2020-05-18T21:38:13.021 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:13.022 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:13.022 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:13.022 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:13.022 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:13.022 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:13.023 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:13.023 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1546, 2020-05-18T21:38:13.023 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:13.023 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:13.023 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:13.023 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.024 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:13.024 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:13.024 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:13.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.024 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:13.025 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:13.025 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:13.025 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:13.025 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:13.025 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:13.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.026 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.026 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:13.026 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:13.026 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:13.026 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:13.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.027 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:13.027 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:13.027 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:13.027 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:13.027 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:13.028 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:13.028 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:13.028 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:13.028 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:13.028 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:13.029 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.029 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:13.029 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:13.029 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:13.029 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.030 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:13.030 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray9", 2020-05-18T21:38:13.030 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:13.030 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:13.030 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:13.030 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:13.031 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:13.031 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:13.031 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:13.031 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1555, 2020-05-18T21:38:13.031 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:13.031 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:13.032 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:13.032 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.032 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:13.032 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:13.032 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:13.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.033 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:13.033 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:13.033 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:13.033 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:13.033 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:13.034 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:13.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.034 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.034 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:13.034 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:13.035 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:13.035 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:13.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.035 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:13.035 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:13.035 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:13.036 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:13.036 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:13.036 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:13.036 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:13.036 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:13.037 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:13.037 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:13.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.037 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:13.037 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:13.037 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:13.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:13.038 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray5", 2020-05-18T21:38:13.038 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:13.038 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:13.039 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:13.039 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:13.039 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:13.039 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:13.039 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:13.039 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1551, 2020-05-18T21:38:13.040 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:13.040 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:13.040 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:13.040 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.040 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:13.040 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:13.041 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:13.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.041 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:13.041 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:13.041 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:13.042 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:13.042 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:13.042 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:13.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.042 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.043 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:13.043 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:13.043 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:13.043 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:13.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.043 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:13.044 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:13.044 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:13.044 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:13.044 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:13.044 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:13.044 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:13.045 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:13.045 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:13.045 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:13.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.045 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:13.046 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:13.046 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:13.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:13.046 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray2", 2020-05-18T21:38:13.047 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:13.047 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:13.047 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:13.047 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:13.047 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:13.047 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:13.048 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:13.048 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1548, 2020-05-18T21:38:13.048 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:13.048 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:13.049 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:13.049 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.049 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:13.049 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:13.049 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:13.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.050 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:13.050 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:13.050 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:13.050 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:13.051 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:13.051 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:13.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.051 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.051 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:13.052 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:13.052 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:13.052 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:13.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.052 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:13.052 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:13.053 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:13.053 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:13.053 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:13.053 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:13.053 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:13.054 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:13.054 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:13.054 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:13.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.054 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:13.054 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:13.055 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:13.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:13.055 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray1", 2020-05-18T21:38:13.055 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:13.056 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:13.056 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:13.056 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:13.056 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:13.056 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:13.056 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:13.057 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1547, 2020-05-18T21:38:13.057 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:13.057 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:13.057 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:13.057 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.058 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:13.058 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:13.058 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:13.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.058 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:13.058 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:13.059 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:13.059 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:13.059 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:13.059 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:13.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.060 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.060 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:13.060 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:13.060 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:13.060 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:13.060 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.061 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:13.061 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:13.061 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:13.061 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:13.061 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:13.062 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:13.062 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:13.062 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:13.062 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:13.062 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:13.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.063 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:13.063 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:13.063 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:13.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:13.064 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray8", 2020-05-18T21:38:13.064 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:13.064 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:13.064 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:13.064 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:13.064 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:13.065 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:13.065 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:13.065 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1554, 2020-05-18T21:38:13.065 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:13.065 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:13.066 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:13.066 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.066 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:13.066 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:13.066 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:13.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.067 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:13.067 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:13.067 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:13.067 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:13.067 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:13.068 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:13.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.068 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.068 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:13.068 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:13.068 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:13.069 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:13.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.069 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:13.069 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:13.069 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:13.070 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:13.070 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:13.070 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:13.070 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:13.070 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:13.070 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:13.071 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:13.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.071 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:13.071 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:13.071 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:13.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.072 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:13.072 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray3", 2020-05-18T21:38:13.072 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:13.072 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:13.072 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:13.073 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:13.073 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:13.073 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:13.073 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:13.073 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1549, 2020-05-18T21:38:13.073 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:13.074 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:13.074 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:13.074 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.074 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:13.074 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:13.075 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:13.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.075 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:13.075 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:13.075 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:13.075 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:13.076 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:13.076 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:13.076 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.076 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.076 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:13.077 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:13.077 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:13.077 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:13.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.077 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:13.077 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:13.078 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:13.078 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:13.078 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:13.078 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:13.078 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:13.079 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:13.079 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:13.079 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:13.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.079 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:13.079 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:13.080 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:13.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.080 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:13.080 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray4", 2020-05-18T21:38:13.080 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:13.080 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:13.081 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:13.081 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:13.081 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:13.081 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:13.081 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:13.082 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1550, 2020-05-18T21:38:13.082 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:13.082 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:13.082 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:13.082 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.082 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:13.083 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:13.083 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:13.083 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.083 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:13.083 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:13.084 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:13.084 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:13.084 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:13.084 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:13.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.084 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:13.085 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:13.085 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:13.085 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:13.085 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:13.085 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.086 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:13.086 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:13.086 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:13.086 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:13.086 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:13.086 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:13.087 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:13.087 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:13.087 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:13.087 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:13.087 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:13.088 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:13.088 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:13.088 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:13.088 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:13.088 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:13.088 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:13.089 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:13.089 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:13.089 INFO:teuthology.orchestra.run.smithi155.stdout:] 2020-05-18T21:38:13.090 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "ino": 1, "rdev": 0, "ctime": "2020-05-18T21:38:07.145016+0000", "btime": "2020-05-18T21:37:45.267427+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 30, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:07.145016+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:38:07.145016+0000", "num_files": 0, "num_subdirs": 1, "change_attr": 1 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:52.684697+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:45.267427+0000" }, "version": 4, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 3, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "dirfrag": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1546, "rdev": 0, "ctime": "2020-05-18T21:37:53.086518+0000", "btime": "2020-05-18T21:37:53.086518+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086518+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086518+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086518+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray0", "dirfrag": "0x60a", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1547, "rdev": 0, "ctime": "2020-05-18T21:37:53.086853+0000", "btime": "2020-05-18T21:37:53.086853+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086853+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086853+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086853+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray1", "dirfrag": "0x60b", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1548, "rdev": 0, "ctime": "2020-05-18T21:37:53.087103+0000", "btime": "2020-05-18T21:37:53.087103+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087103+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087103+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087103+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray2", "dirfrag": "0x60c", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1551, "rdev": 0, "ctime": "2020-05-18T21:37:53.087783+0000", "btime": "2020-05-18T21:37:53.087783+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087783+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087783+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087783+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray5", "dirfrag": "0x60f", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1552, "rdev": 0, "ctime": "2020-05-18T21:37:53.088334+0000", "btime": "2020-05-18T21:37:53.088334+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088334+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088334+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088334+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray6", "dirfrag": "0x610", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1549, "rdev": 0, "ctime": "2020-05-18T21:37:53.087329+0000", "btime": "2020-05-18T21:37:53.087329+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087329+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087329+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087329+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray3", "dirfrag": "0x60d", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1553, "rdev": 0, "ctime": "2020-05-18T21:37:53.088498+0000", "btime": "2020-05-18T21:37:53.088498+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088498+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088498+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088498+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray7", "dirfrag": "0x611", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1554, "rdev": 0, "ctime": "2020-05-18T21:37:53.088676+0000", "btime": "2020-05-18T21:37:53.088676+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088676+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088676+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088676+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray8", "dirfrag": "0x612", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1550, "rdev": 0, "ctime": "2020-05-18T21:37:53.087546+0000", "btime": "2020-05-18T21:37:53.087546+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087546+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087546+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087546+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray4", "dirfrag": "0x60e", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1555, "rdev": 0, "ctime": "2020-05-18T21:37:53.088993+0000", "btime": "2020-05-18T21:37:53.088993+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088993+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray9", "dirfrag": "0x613", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 3, "rdev": 0, "ctime": "2020-05-18T21:38:01.329092+0000", "btime": "2020-05-18T21:38:01.329092+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:01.329092+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:38:01.329092+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:38:01.329092+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ -2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "openingsnapparents": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 257, "rdev": 0, "ctime": "2020-05-18T21:37:53.086401+0000", "btime": "2020-05-18T21:37:53.086401+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086401+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 10, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "openingsnapparents": 0 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "subtreetemp": 0, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 3, "dentries": [ { "path": "stray6", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1552, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray7", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1553, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray0", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1546, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray9", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1555, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray5", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1551, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray2", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1548, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray1", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1547, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray8", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1554, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray3", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1549, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray4", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1550, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] } ] } ] } ] 2020-05-18T21:38:14.093 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok dump cache 2020-05-18T21:38:14.202 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2020-05-18T21:38:14.202 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.202 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1, 2020-05-18T21:38:14.202 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:14.203 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:14.203 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:45.267427+0000", 2020-05-18T21:38:14.203 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 17407, 2020-05-18T21:38:14.203 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:14.203 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:14.204 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:14.204 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:14.204 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:14.204 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:14.204 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:14.205 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:14.205 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.205 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:14.205 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:38:14.205 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:38:14.205 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:38:14.206 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 30, 2020-05-18T21:38:14.206 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:14.206 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.206 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:14.206 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:14.207 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:14.207 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:14.207 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:14.207 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:14.207 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:14.207 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:14.208 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:14.208 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:38:14.208 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:14.208 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:14.208 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:14.209 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.209 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:14.209 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:14.209 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 1, 2020-05-18T21:38:14.209 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1 2020-05-18T21:38:14.210 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.210 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:14.210 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.210 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.210 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.211 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.211 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.211 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:52.684697+0000" 2020-05-18T21:38:14.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.211 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:14.211 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.212 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.212 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.212 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.212 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.212 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:45.267427+0000" 2020-05-18T21:38:14.213 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.213 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 4, 2020-05-18T21:38:14.213 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:14.213 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:14.213 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 3, 2020-05-18T21:38:14.213 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:14.214 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:14.214 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:14.214 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:14.214 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:14.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.215 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:14.215 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:14.215 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:14.215 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:14.215 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:14.215 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:14.216 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.216 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:14.216 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:14.216 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:14.216 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:38:14.217 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.217 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.217 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.217 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.217 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.217 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:38:14.218 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.218 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.218 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:38:14.218 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.218 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.219 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.219 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.219 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.219 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": 0, 2020-05-18T21:38:14.219 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 0 2020-05-18T21:38:14.219 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.220 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:38:14.220 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.220 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.220 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.220 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.220 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.221 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.221 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.221 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.221 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.221 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:14.222 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:14.222 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:14.222 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:14.222 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:14.222 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:14.222 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:38:14.223 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.223 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:38:14.223 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.223 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.223 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.224 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.224 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.224 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.224 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:14.224 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:14.224 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [], 2020-05-18T21:38:14.225 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:14.225 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:14.225 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:14.225 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:14.225 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:14.226 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.226 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.226 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1546, 2020-05-18T21:38:14.226 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:14.226 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:14.226 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:14.227 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:14.227 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:14.227 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:14.227 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:14.227 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:14.228 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:14.228 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:14.228 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:14.228 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:14.228 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.228 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:14.229 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:14.229 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:14.229 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:14.229 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:14.229 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:14.230 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.230 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:14.230 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:14.230 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:14.230 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:14.230 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:14.231 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:14.231 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:14.231 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:14.231 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:14.231 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:14.232 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:14.232 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:14.232 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:14.232 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.232 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:14.232 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:14.233 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:14.233 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:14.233 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.233 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:14.233 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.234 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.234 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.234 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.234 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.234 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086518+0000" 2020-05-18T21:38:14.234 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.235 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:14.235 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.235 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.235 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.235 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.235 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.236 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086518+0000" 2020-05-18T21:38:14.236 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.236 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.236 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:14.236 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:14.237 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:14.237 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:14.237 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:14.237 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:14.237 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:14.237 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:14.238 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.238 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:14.238 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:14.238 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:14.238 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:14.239 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:14.239 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:14.239 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.239 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:14.239 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:14.239 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:14.240 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.240 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.240 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.240 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.240 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.241 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.241 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.241 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.241 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.241 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.241 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.242 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.242 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.242 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.242 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.242 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:14.243 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:14.243 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:14.243 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.243 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:14.243 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.243 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.244 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.244 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.244 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.244 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.244 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.244 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.245 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.245 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:14.245 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:14.245 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:14.245 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:14.246 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:14.246 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:14.246 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:14.246 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:14.246 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:14.246 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.247 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.247 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:14.247 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.247 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:14.247 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:14.248 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:14.248 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:14.248 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:14.248 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.248 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray0", 2020-05-18T21:38:14.248 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60a", 2020-05-18T21:38:14.249 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:14.249 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:14.249 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:14.249 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:14.249 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:14.250 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:14.250 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:14.250 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.250 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.250 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:14.250 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:14.251 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.251 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.251 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.251 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.251 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.252 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.252 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.252 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.252 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.252 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.252 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.253 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.253 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.253 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.253 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.253 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.254 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:14.254 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:14.254 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:14.254 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:14.254 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.254 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:14.255 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:14.255 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:14.255 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.255 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.255 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.255 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1547, 2020-05-18T21:38:14.256 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:14.256 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:14.256 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:14.256 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:14.256 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:14.257 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:14.257 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:14.257 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:14.257 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:14.257 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:14.257 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:14.258 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:14.258 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.258 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:14.258 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:14.258 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:14.259 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:14.259 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:14.259 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:14.259 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.259 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:14.260 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:14.260 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:14.260 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:14.260 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:14.260 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:14.260 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:14.261 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:14.261 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:14.261 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:14.261 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:14.261 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:14.262 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:14.262 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.262 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:14.262 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:14.262 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:14.262 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:14.263 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.263 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:14.263 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.263 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.263 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.263 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.264 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.264 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086853+0000" 2020-05-18T21:38:14.264 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.264 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:14.264 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.265 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.265 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.265 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.265 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.265 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086853+0000" 2020-05-18T21:38:14.265 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.266 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.266 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:14.266 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:14.266 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:14.266 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:14.267 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:14.267 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:14.267 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:14.267 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:14.267 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.267 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:14.268 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:14.268 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:14.268 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:14.268 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:14.268 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:14.269 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.269 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:14.269 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:14.269 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:14.269 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.269 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.270 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.270 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.270 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.270 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.270 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.271 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.271 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.271 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.271 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.271 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.271 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.272 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.272 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.272 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:14.272 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:14.272 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:14.273 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.273 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:14.273 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.273 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.273 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.273 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.274 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.274 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.274 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.274 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.274 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.274 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:14.275 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:14.275 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:14.275 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:14.275 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:14.275 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:14.276 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:14.276 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:14.276 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:14.276 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.276 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.276 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:14.277 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.277 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:14.277 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:14.277 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:14.277 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:14.278 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:14.278 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.278 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray1", 2020-05-18T21:38:14.278 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60b", 2020-05-18T21:38:14.278 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:14.278 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:14.279 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:14.279 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:14.279 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:14.279 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:14.279 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:14.280 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.280 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.280 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:14.280 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:14.280 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.280 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.281 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.281 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.281 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.281 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.281 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.282 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.282 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.282 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.282 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.282 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.282 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.283 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.283 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.283 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.283 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:14.283 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:14.284 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:14.284 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:14.284 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.284 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:14.284 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:14.284 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:14.285 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.285 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.285 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.285 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1548, 2020-05-18T21:38:14.285 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:14.286 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:14.286 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:14.286 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:14.286 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:14.286 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:14.286 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:14.287 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:14.287 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:14.287 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:14.287 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:14.287 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:14.287 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.288 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:14.288 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:14.288 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:14.288 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:14.288 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:14.289 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:14.289 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.289 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:14.289 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:14.289 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:14.290 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:14.290 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:14.290 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:14.290 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:14.290 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:14.290 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:14.291 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:14.291 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:14.291 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:14.291 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:14.291 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.291 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:14.292 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:14.292 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:14.292 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:14.292 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.292 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:14.293 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.293 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.293 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.293 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.293 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.293 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087103+0000" 2020-05-18T21:38:14.294 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.294 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:14.294 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.294 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.294 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.295 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.295 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.295 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087103+0000" 2020-05-18T21:38:14.295 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.295 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.295 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:14.296 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:14.296 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:14.296 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:14.296 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:14.296 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:14.297 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:14.297 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:14.297 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.297 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:14.297 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:14.297 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:14.298 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:14.298 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:14.298 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:14.298 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.298 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:14.299 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:14.299 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:14.299 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.299 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.299 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.299 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.300 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.300 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.300 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.300 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.300 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.301 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.301 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.301 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.301 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.301 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.301 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.302 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:14.302 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:14.306 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:14.307 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.307 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:14.307 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.307 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.307 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.308 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.308 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.308 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.308 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.308 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.309 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.309 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:14.309 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:14.309 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:14.309 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:14.309 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:14.310 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:14.310 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:14.310 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:14.310 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:14.310 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.311 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.311 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:14.311 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.311 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:14.311 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:14.311 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:14.312 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:14.312 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:14.312 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.312 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray2", 2020-05-18T21:38:14.312 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60c", 2020-05-18T21:38:14.312 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:14.313 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:14.313 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:14.313 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:14.313 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:14.313 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:14.314 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:14.314 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.314 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.314 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:14.314 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:14.314 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.315 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.315 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.315 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.315 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.315 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.316 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.316 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.316 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.316 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.316 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.316 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.317 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.317 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.317 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.317 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.317 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:14.318 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:14.318 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:14.318 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:14.318 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.318 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:14.318 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:14.319 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:14.319 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.319 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.319 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.319 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1551, 2020-05-18T21:38:14.320 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:14.320 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:14.320 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:14.320 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:14.320 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:14.320 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:14.321 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:14.321 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:14.321 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:14.321 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:14.321 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:14.322 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:14.322 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.322 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:14.322 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:14.322 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:14.322 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:14.323 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:14.323 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:14.323 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.323 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:14.323 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:14.323 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:14.324 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:14.324 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:14.324 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:14.324 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:14.324 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:14.325 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:14.325 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:14.325 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:14.325 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:14.325 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:14.325 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.326 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:14.326 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:14.326 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:14.326 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:14.326 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.327 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:14.327 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.327 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.327 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.327 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.327 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.328 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087783+0000" 2020-05-18T21:38:14.328 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.328 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:14.328 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.328 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.329 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.329 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.329 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.329 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087783+0000" 2020-05-18T21:38:14.329 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.329 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.330 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:14.330 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:14.330 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:14.330 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:14.330 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:14.331 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:14.331 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:14.331 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:14.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.331 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:14.331 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:14.332 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:14.332 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:14.332 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:14.332 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:14.332 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.333 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:14.333 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:14.333 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:14.333 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.333 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.333 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.334 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.334 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.334 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.334 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.334 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.335 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.335 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.335 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.335 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.335 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.335 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.336 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.336 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:14.336 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:14.336 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:14.336 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.337 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:14.337 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.337 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.337 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.337 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.337 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.338 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.338 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.338 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.338 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.338 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:14.339 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:14.339 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:14.339 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:14.339 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:14.339 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:14.339 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:14.340 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:14.340 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:14.340 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.340 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.340 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:14.340 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.341 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:14.341 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:14.341 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:14.341 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:14.341 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:14.342 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.342 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray5", 2020-05-18T21:38:14.342 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60f", 2020-05-18T21:38:14.342 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:14.342 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:14.342 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:14.343 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:14.343 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:14.343 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:14.343 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:14.343 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.344 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.344 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:14.344 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:14.344 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.344 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.344 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.345 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.345 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.345 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.345 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.345 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.346 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.346 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.346 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.346 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.346 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.346 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.347 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.347 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.347 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:14.347 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:14.347 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:14.347 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:14.348 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.348 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:14.348 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:14.348 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:14.348 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.349 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.349 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.349 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1552, 2020-05-18T21:38:14.349 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:14.349 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:14.349 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:14.350 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:14.350 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:14.350 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:14.350 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:14.350 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:14.351 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:14.351 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:14.351 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:14.351 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:14.351 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.351 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:14.352 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:14.352 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:14.352 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:14.352 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:14.352 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:14.353 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.353 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:14.353 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:14.353 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:14.353 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:14.353 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:14.354 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:14.354 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:14.354 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:14.354 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:14.354 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:14.355 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:14.355 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:14.355 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:14.355 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.355 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:14.355 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:14.356 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:14.356 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:14.356 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.356 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:14.356 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.357 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.357 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.357 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.357 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.357 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088334+0000" 2020-05-18T21:38:14.357 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.358 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:14.358 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.358 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.358 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.358 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.359 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.359 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088334+0000" 2020-05-18T21:38:14.359 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.359 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.359 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:14.359 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:14.360 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:14.360 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:14.360 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:14.360 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:14.360 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:14.360 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:14.361 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.361 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:14.361 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:14.361 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:14.361 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:14.362 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:14.362 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:14.362 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.362 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:14.362 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:14.362 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:14.363 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.363 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.363 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.363 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.363 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.364 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.364 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.364 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.364 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.364 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.364 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.365 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.365 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.365 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.365 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.365 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:14.366 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:14.366 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:14.366 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.366 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:14.366 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.366 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.367 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.367 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.367 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.367 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.367 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.367 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.368 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.368 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:14.368 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:14.368 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:14.368 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:14.369 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:14.369 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:14.369 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:14.369 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:14.369 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:14.369 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.370 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.370 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:14.370 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.370 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:14.370 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:14.371 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:14.371 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:14.371 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:14.371 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.371 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray6", 2020-05-18T21:38:14.371 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x610", 2020-05-18T21:38:14.372 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:14.372 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:14.372 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:14.372 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:14.372 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:14.372 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:14.373 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:14.373 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.373 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.373 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:14.373 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:14.374 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.374 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.374 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.374 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.374 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.376 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.376 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.376 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.376 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.376 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.376 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:14.377 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:14.377 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:14.377 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:14.377 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.377 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:14.378 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:14.378 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:14.378 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.378 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.378 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.378 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1549, 2020-05-18T21:38:14.379 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:14.379 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:14.379 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:14.379 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:14.379 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:14.380 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:14.380 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:14.380 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:14.380 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:14.380 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:14.380 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:14.381 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:14.381 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.381 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:14.381 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:14.381 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:14.382 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:14.382 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:14.382 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:14.382 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.382 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:14.382 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:14.383 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:14.383 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:14.383 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:14.383 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:14.383 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:14.384 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:14.384 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:14.384 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:14.384 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:14.384 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:14.384 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:14.385 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.385 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:14.385 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:14.385 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:14.385 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:14.386 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.386 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:14.386 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.386 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.386 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.386 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.387 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.387 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087329+0000" 2020-05-18T21:38:14.387 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.387 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:14.387 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.387 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.388 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.388 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.388 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.388 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087329+0000" 2020-05-18T21:38:14.388 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.389 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.389 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:14.389 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:14.389 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:14.389 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:14.389 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:14.390 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:14.390 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:14.390 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:14.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.390 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:14.391 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:14.391 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:14.391 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:14.391 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:14.391 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:14.391 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.392 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:14.392 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:14.392 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:14.392 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.392 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.393 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.393 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.393 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.393 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.393 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.393 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.394 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.394 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.394 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.394 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.394 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.395 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.395 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.395 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:14.395 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:14.395 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:14.395 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.396 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:14.396 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.396 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.396 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.396 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.396 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.397 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.397 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.397 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.397 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.397 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:14.398 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:14.398 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:14.398 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:14.398 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:14.398 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:14.398 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:14.399 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:14.399 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:14.399 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.399 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.399 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:14.400 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.400 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:14.400 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:14.400 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:14.400 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:14.400 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:14.401 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.401 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray3", 2020-05-18T21:38:14.401 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60d", 2020-05-18T21:38:14.401 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:14.401 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:14.402 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:14.402 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:14.402 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:14.402 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:14.402 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:14.402 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.403 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.403 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:14.403 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:14.403 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.403 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.404 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.404 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.404 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.404 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.404 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.404 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.405 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.405 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.405 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.405 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.405 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.405 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.406 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.406 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.406 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:14.406 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:14.406 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:14.407 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:14.407 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.407 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:14.407 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:14.407 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:14.407 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.408 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.408 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.408 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1553, 2020-05-18T21:38:14.408 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:14.408 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:14.409 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:14.409 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:14.409 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:14.409 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:14.409 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:14.409 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:14.410 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:14.410 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:14.410 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:14.410 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:14.410 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.411 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:14.411 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:14.411 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:14.411 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:14.411 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:14.411 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:14.412 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.412 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:14.412 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:14.412 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:14.412 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:14.413 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:14.413 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:14.413 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:14.413 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:14.413 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:14.413 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:14.414 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:14.414 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:14.414 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:14.414 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.414 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:14.415 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:14.415 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:14.415 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:14.415 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.415 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:14.415 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.416 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.416 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.416 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.416 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.416 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088498+0000" 2020-05-18T21:38:14.417 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.417 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:14.417 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.417 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.417 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.417 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.418 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.418 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088498+0000" 2020-05-18T21:38:14.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.418 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.418 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:14.418 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:14.419 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:14.419 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:14.419 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:14.419 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:14.419 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:14.420 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:14.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.420 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:14.420 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:14.420 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:14.420 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:14.421 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:14.421 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:14.421 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.421 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:14.421 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:14.422 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:14.422 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.422 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.422 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.422 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.422 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.423 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.423 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.423 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.423 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.423 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.424 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.424 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.424 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.424 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.424 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:14.425 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:14.425 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:14.425 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.425 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:14.425 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.426 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.426 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.426 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.426 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.426 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.426 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.427 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.427 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:14.427 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:14.427 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:14.427 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:14.428 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:14.428 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:14.428 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:14.428 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:14.428 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:14.429 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.429 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.429 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:14.429 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.429 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:14.429 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:14.430 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:14.430 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:14.430 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:14.430 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.430 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray7", 2020-05-18T21:38:14.431 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x611", 2020-05-18T21:38:14.431 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:14.431 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:14.431 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:14.431 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:14.431 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:14.432 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:14.432 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:14.432 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.432 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.432 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:14.433 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:14.433 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.433 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.433 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.433 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.433 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.434 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.434 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.434 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.434 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.434 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.435 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.435 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.435 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.435 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.435 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.436 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:14.436 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:14.436 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:14.436 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:14.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.437 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:14.437 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:14.437 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:14.437 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.437 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.437 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.438 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1554, 2020-05-18T21:38:14.438 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:14.438 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:14.438 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:14.438 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:14.439 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:14.439 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:14.439 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:14.439 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:14.439 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:14.439 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:14.440 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:14.440 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:14.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.440 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:14.440 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:14.441 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:14.441 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:14.441 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:14.441 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:14.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.441 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:14.442 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:14.442 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:14.442 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:14.442 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:14.442 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:14.443 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:14.443 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:14.443 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:14.443 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:14.443 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:14.443 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:14.444 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:14.444 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.444 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:14.444 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:14.444 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:14.444 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:14.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.445 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:14.445 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.445 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.445 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.446 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.446 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.446 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088676+0000" 2020-05-18T21:38:14.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.446 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:14.446 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.447 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.447 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.447 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.447 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.447 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088676+0000" 2020-05-18T21:38:14.448 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.448 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.448 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:14.448 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:14.448 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:14.448 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:14.449 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:14.449 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:14.449 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:14.449 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:14.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.450 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:14.450 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:14.450 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:14.450 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:14.450 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:14.450 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:14.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.451 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:14.451 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:14.451 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:14.451 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.452 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.452 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.452 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.452 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.452 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.453 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.453 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.453 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.453 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.453 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.453 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.454 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.454 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.454 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:14.454 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:14.454 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:14.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.455 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:14.455 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.455 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.455 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.455 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.456 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.456 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.456 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.456 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.457 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:14.457 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:14.457 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:14.457 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:14.457 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:14.457 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:14.458 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:14.458 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:14.458 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:14.458 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.458 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.459 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:14.459 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.459 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:14.459 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:14.459 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:14.459 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:14.460 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:14.460 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.460 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray8", 2020-05-18T21:38:14.460 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x612", 2020-05-18T21:38:14.460 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:14.460 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:14.461 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:14.461 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:14.461 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:14.461 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:14.461 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:14.462 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.462 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.462 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:14.462 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:14.462 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.462 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.463 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.463 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.463 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.463 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.464 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.464 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.464 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.464 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.464 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.465 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.465 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.465 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.465 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:14.465 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:14.465 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:14.466 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:14.466 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.466 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:14.466 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:14.466 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:14.467 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.467 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.467 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.467 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1550, 2020-05-18T21:38:14.467 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:14.467 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:14.468 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:14.468 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:14.468 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:14.468 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:14.468 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:14.469 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:14.469 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:14.469 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:14.469 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:14.469 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:14.469 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.470 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:14.470 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:14.470 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:14.470 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:14.470 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:14.471 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:14.471 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.471 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:14.471 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:14.471 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:14.471 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:14.472 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:14.472 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:14.472 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:14.472 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:14.472 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:14.472 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:14.473 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:14.473 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:14.473 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:14.473 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.473 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:14.474 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:14.474 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:14.474 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:14.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.474 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:14.474 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.475 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.475 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.475 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.475 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.475 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087546+0000" 2020-05-18T21:38:14.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.476 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:14.476 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.476 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.476 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.476 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.477 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.477 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087546+0000" 2020-05-18T21:38:14.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.477 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.477 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:14.477 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:14.478 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:14.478 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:14.478 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:14.478 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:14.478 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:14.479 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:14.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.479 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:14.479 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:14.479 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:14.479 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:14.480 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:14.480 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:14.480 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.480 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:14.480 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:14.481 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:14.481 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.481 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.481 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.481 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.482 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.482 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.482 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.482 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.482 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.482 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.483 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.483 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.483 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.483 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.483 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:14.484 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:14.484 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:14.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.484 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:14.484 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.484 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.485 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.485 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.485 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.485 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.485 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.486 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.486 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:14.486 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:14.486 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:14.486 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:14.487 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:14.487 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:14.487 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:14.487 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:14.487 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:14.488 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.488 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.488 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:14.488 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.488 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:14.488 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:14.489 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:14.489 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:14.489 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:14.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.489 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray4", 2020-05-18T21:38:14.490 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60e", 2020-05-18T21:38:14.490 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:14.490 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:14.490 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:14.490 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:14.490 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:14.491 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:14.491 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:14.491 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.491 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.491 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:14.492 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:14.492 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.492 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.492 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.492 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.492 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.493 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.493 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.493 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.493 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.493 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.494 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.494 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.494 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.494 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.494 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.495 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:14.495 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:14.495 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:14.495 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:14.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.495 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:14.496 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:14.496 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:14.496 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.496 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.496 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.497 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1555, 2020-05-18T21:38:14.497 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:14.497 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:14.497 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:14.497 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:14.497 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:14.498 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:14.498 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:14.498 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:14.498 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:14.498 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:14.499 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:14.499 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:14.499 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.499 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:14.499 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:14.499 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:14.500 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:14.500 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:14.500 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:14.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.500 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:14.501 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:14.501 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:14.501 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:14.501 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:14.501 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:14.501 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:14.502 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:14.502 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:14.502 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:14.502 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:14.502 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:14.503 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:14.503 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.503 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:14.503 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:14.503 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:14.503 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:14.504 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.504 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:14.504 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.504 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.504 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.504 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.505 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.505 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:14.505 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.505 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:14.505 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.506 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.506 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.506 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.506 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.506 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:14.506 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.507 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.507 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:14.507 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:14.507 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:14.507 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:14.508 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:14.508 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:14.508 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:14.508 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:14.508 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.508 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:14.509 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:14.509 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:14.509 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:14.509 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:14.509 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:14.510 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.510 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:14.510 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:14.510 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:14.510 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.510 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.511 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.511 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.511 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.511 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.512 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.512 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.512 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.512 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.512 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.512 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.513 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.513 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.513 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:14.513 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:14.513 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:14.514 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.514 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:14.514 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.514 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.514 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.514 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.515 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.515 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.515 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.515 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.516 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:14.516 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:14.516 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:14.516 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:14.516 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:14.516 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:14.517 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:14.517 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:14.517 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:14.517 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.517 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.517 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:14.518 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.518 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:14.518 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:14.518 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:14.518 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:14.519 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:14.519 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.519 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray9", 2020-05-18T21:38:14.519 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x613", 2020-05-18T21:38:14.519 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:14.519 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:14.520 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:14.520 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:14.520 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:14.520 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:14.520 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:14.521 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.521 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.521 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:14.521 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:14.521 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.521 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.522 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.522 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.522 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.522 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.522 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.522 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.523 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.523 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.523 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.523 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.524 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.524 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.524 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.524 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:14.524 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:14.525 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:14.525 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:14.525 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.525 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:14.525 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:14.525 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:14.526 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.526 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.526 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.526 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 3, 2020-05-18T21:38:14.526 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:14.527 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:14.527 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:14.527 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16877, 2020-05-18T21:38:14.527 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:14.527 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:14.527 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:14.528 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:14.528 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:14.528 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:14.528 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:14.528 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:14.529 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.529 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:14.529 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:14.529 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:14.529 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:14.529 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:14.530 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:14.530 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.530 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:14.530 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:14.530 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:14.531 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:14.531 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:14.531 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:14.531 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:14.531 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:14.531 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:14.532 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:14.532 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:14.532 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:14.532 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:14.532 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.532 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:14.533 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:14.533 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:14.533 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:14.533 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.533 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:14.534 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.534 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.534 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.534 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.534 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.534 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:01.329092+0000" 2020-05-18T21:38:14.535 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.535 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:14.535 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.535 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.535 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.536 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:14.536 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.536 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:01.329092+0000" 2020-05-18T21:38:14.536 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.536 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.536 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:14.537 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:14.537 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:14.537 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:14.537 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:14.537 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:14.538 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:14.538 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:14.538 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.538 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:14.538 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:14.538 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:14.539 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:14.539 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:14.539 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:14.539 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.539 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:14.539 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:14.540 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:14.540 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.540 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.540 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.540 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.541 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.541 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.541 INFO:teuthology.orchestra.run.smithi155.stdout: -2, 2020-05-18T21:38:14.541 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.541 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.541 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.542 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.542 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.542 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.542 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.542 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.543 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:38:14.543 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.543 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:38:14.543 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.543 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.543 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.544 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.544 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.544 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.544 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.544 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.545 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.545 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:14.545 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:14.545 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:14.545 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:14.545 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:14.546 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:14.546 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:14.546 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:14.546 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:14.546 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.547 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:14.547 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.547 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:14.547 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:14.547 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:14.547 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:14.548 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:14.548 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.548 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.548 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 257, 2020-05-18T21:38:14.548 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:14.548 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:14.549 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:14.549 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:14.549 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:14.549 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:14.549 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:14.550 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:14.550 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:14.550 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:14.550 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:14.550 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:14.550 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.551 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:14.551 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:14.551 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:14.551 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:14.551 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:14.552 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:14.552 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.552 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:14.552 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:14.552 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:14.552 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:14.553 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:14.553 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:14.553 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:14.553 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:14.553 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:14.554 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:14.554 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:14.554 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:14.554 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:14.554 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.554 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:14.555 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:14.555 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 10, 2020-05-18T21:38:14.555 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:14.555 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.555 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:14.556 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.556 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.556 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.556 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:38:14.556 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.556 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:14.557 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.557 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:14.557 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:14.557 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:14.557 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:14.558 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:38:14.558 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:14.558 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:14.558 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.558 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.558 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:14.559 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:14.559 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:14.559 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:14.559 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:14.559 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:14.560 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:14.560 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:14.560 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.560 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:14.560 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:14.560 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:14.561 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:14.561 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:14.561 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:14.561 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.561 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:14.562 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:14.562 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:14.562 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.562 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.562 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.562 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.563 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.563 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.563 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.563 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.563 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.563 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.564 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.564 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.564 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.564 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.564 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.565 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:14.565 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:38:14.565 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.565 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:14.565 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.565 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.566 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.566 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.566 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.566 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.566 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.567 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.567 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.567 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:14.567 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:14.567 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:14.567 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:14.568 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:14.568 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:14.568 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:14.568 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:14.568 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:14.569 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.569 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:14.569 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.569 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:14.569 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:14.569 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:14.570 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:14.570 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:14.570 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.570 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1", 2020-05-18T21:38:14.570 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x101", 2020-05-18T21:38:14.570 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:14.571 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:14.571 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:14.571 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "0", 2020-05-18T21:38:14.571 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "0", 2020-05-18T21:38:14.571 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:14.572 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "1", 2020-05-18T21:38:14.572 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.572 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:14.572 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:14.572 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:14.572 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.573 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.573 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.573 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.573 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.573 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.574 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.574 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.574 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.574 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.574 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.574 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.575 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.575 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.575 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.575 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.575 INFO:teuthology.orchestra.run.smithi155.stdout: "child": 1, 2020-05-18T21:38:14.576 INFO:teuthology.orchestra.run.smithi155.stdout: "subtree": 1, 2020-05-18T21:38:14.576 INFO:teuthology.orchestra.run.smithi155.stdout: "subtreetemp": 0, 2020-05-18T21:38:14.576 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:14.576 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:14.576 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:14.576 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.577 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:14.577 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [ 2020-05-18T21:38:14.577 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.577 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray6", 2020-05-18T21:38:14.577 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:14.577 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:14.578 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:14.578 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:14.578 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:14.578 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:14.578 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:14.579 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1552, 2020-05-18T21:38:14.579 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:14.579 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.579 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:14.579 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.579 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.580 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.580 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.580 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.580 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.580 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.580 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.581 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.581 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.581 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.581 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.581 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.582 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.582 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.582 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.582 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:14.582 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.582 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:14.583 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:14.583 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.583 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.583 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.583 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.584 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.584 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.584 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.584 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.584 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.584 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.585 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:14.585 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.585 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.585 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.585 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray7", 2020-05-18T21:38:14.586 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:14.586 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:14.586 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:14.586 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:14.586 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:14.586 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:14.587 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:14.587 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1553, 2020-05-18T21:38:14.587 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:14.587 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.587 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:14.587 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.588 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.588 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.588 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.588 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.588 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.589 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.589 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.589 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.589 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.589 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.590 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.590 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.590 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.590 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.590 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:14.591 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.591 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:14.591 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:14.591 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.591 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.591 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.592 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.592 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.592 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.592 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.592 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.593 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.593 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:14.593 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.593 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.594 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray0", 2020-05-18T21:38:14.594 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:14.594 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:14.594 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:14.594 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:14.595 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:14.595 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:14.595 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:14.595 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1546, 2020-05-18T21:38:14.595 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:14.595 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.596 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:14.596 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.596 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.596 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.596 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.597 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.597 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.597 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.597 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.597 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.597 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.598 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.598 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.598 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.598 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.598 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.599 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.599 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:14.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.599 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:14.599 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:14.599 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.600 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.600 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.600 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.600 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.600 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.600 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.601 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.601 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.601 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.601 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:14.601 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.602 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.602 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.602 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray9", 2020-05-18T21:38:14.602 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:14.602 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:14.602 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:14.603 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:14.603 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:14.603 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:14.603 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:14.603 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1555, 2020-05-18T21:38:14.604 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:14.604 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.604 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:14.604 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.604 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.604 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.605 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.605 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.605 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.605 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.605 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.605 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.606 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.606 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.606 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.606 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.606 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.607 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.607 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.607 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:14.607 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.607 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:14.607 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:14.608 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.608 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.608 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.608 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.608 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.609 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.609 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.609 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.609 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.609 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.609 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:14.610 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.610 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.610 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.610 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray5", 2020-05-18T21:38:14.610 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:14.610 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:14.611 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:14.611 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:14.611 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:14.611 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:14.611 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:14.612 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1551, 2020-05-18T21:38:14.612 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:14.612 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.612 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:14.612 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.612 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.613 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.613 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.613 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.613 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.613 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.614 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.614 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.614 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.614 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.614 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.614 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.615 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.615 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.615 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.615 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:14.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.615 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:14.616 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:14.616 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.616 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.616 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.616 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.617 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.617 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.617 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.617 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.617 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.618 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:14.618 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.618 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.618 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.618 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray2", 2020-05-18T21:38:14.619 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:14.619 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:14.619 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:14.619 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:14.619 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:14.619 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:14.620 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:14.620 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1548, 2020-05-18T21:38:14.620 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:14.620 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.620 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:14.620 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.621 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.621 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.621 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.621 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.622 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.622 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.622 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.622 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.622 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.623 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.623 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.623 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.623 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.623 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:14.624 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.624 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:14.624 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:14.624 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.624 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.624 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.625 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.625 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.625 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.625 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.625 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.626 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.626 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:14.626 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.626 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.626 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.627 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray1", 2020-05-18T21:38:14.627 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:14.627 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:14.627 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:14.627 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:14.627 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:14.628 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:14.628 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:14.628 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1547, 2020-05-18T21:38:14.628 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:14.628 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.629 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:14.629 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.629 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.629 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.629 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.629 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.630 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.630 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.630 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.630 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.630 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.631 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.631 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.631 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.631 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.631 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.632 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:14.632 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.632 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:14.632 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:14.632 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.632 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.633 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.633 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.633 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.633 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.633 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.634 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.634 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.634 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:14.634 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.635 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.635 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray8", 2020-05-18T21:38:14.635 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:14.635 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:14.635 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:14.636 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:14.636 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:14.636 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:14.636 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:14.636 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1554, 2020-05-18T21:38:14.636 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:14.637 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.637 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:14.637 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.637 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.637 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.638 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.638 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.638 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.638 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.638 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.638 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.639 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.639 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.639 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.639 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.639 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.639 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.640 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.640 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:14.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.640 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:14.640 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:14.641 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.641 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.641 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.641 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.641 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.641 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.642 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.642 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.642 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.642 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.642 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:14.643 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.643 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.643 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray3", 2020-05-18T21:38:14.643 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:14.643 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:14.644 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:14.644 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:14.644 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:14.644 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:14.644 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:14.644 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1549, 2020-05-18T21:38:14.645 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:14.645 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.645 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:14.645 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.645 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.646 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.646 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.646 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.646 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.646 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.646 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.647 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.647 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.647 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.647 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.648 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.648 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.648 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.648 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:14.648 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.648 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:14.649 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:14.649 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.649 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.649 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.649 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.649 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.650 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.650 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.650 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.650 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.651 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:14.651 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:14.651 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray4", 2020-05-18T21:38:14.651 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:14.652 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:14.652 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:14.652 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:14.652 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:14.652 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:14.652 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:14.653 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1550, 2020-05-18T21:38:14.653 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:14.653 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:14.653 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:14.653 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.654 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:14.654 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:14.654 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:14.654 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.654 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:14.654 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:14.655 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:14.655 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:14.655 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:14.655 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:14.655 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.656 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:14.656 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:14.656 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:14.656 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:14.656 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:14.656 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.657 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:14.657 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:14.657 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:14.657 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:14.657 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:14.657 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:14.658 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:14.658 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:14.658 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:14.658 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:14.658 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:14.659 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:14.659 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:14.659 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.659 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:14.659 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.659 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:14.660 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:14.660 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:14.660 INFO:teuthology.orchestra.run.smithi155.stdout:] 2020-05-18T21:38:14.661 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "ino": 1, "rdev": 0, "ctime": "2020-05-18T21:38:07.145016+0000", "btime": "2020-05-18T21:37:45.267427+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 30, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:07.145016+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:38:07.145016+0000", "num_files": 0, "num_subdirs": 1, "change_attr": 1 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:52.684697+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:45.267427+0000" }, "version": 4, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 3, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "dirfrag": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1546, "rdev": 0, "ctime": "2020-05-18T21:37:53.086518+0000", "btime": "2020-05-18T21:37:53.086518+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086518+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086518+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086518+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray0", "dirfrag": "0x60a", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1547, "rdev": 0, "ctime": "2020-05-18T21:37:53.086853+0000", "btime": "2020-05-18T21:37:53.086853+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086853+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086853+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086853+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray1", "dirfrag": "0x60b", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1548, "rdev": 0, "ctime": "2020-05-18T21:37:53.087103+0000", "btime": "2020-05-18T21:37:53.087103+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087103+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087103+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087103+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray2", "dirfrag": "0x60c", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1551, "rdev": 0, "ctime": "2020-05-18T21:37:53.087783+0000", "btime": "2020-05-18T21:37:53.087783+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087783+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087783+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087783+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray5", "dirfrag": "0x60f", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1552, "rdev": 0, "ctime": "2020-05-18T21:37:53.088334+0000", "btime": "2020-05-18T21:37:53.088334+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088334+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088334+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088334+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray6", "dirfrag": "0x610", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1549, "rdev": 0, "ctime": "2020-05-18T21:37:53.087329+0000", "btime": "2020-05-18T21:37:53.087329+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087329+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087329+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087329+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray3", "dirfrag": "0x60d", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1553, "rdev": 0, "ctime": "2020-05-18T21:37:53.088498+0000", "btime": "2020-05-18T21:37:53.088498+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088498+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088498+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088498+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray7", "dirfrag": "0x611", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1554, "rdev": 0, "ctime": "2020-05-18T21:37:53.088676+0000", "btime": "2020-05-18T21:37:53.088676+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088676+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088676+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088676+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray8", "dirfrag": "0x612", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1550, "rdev": 0, "ctime": "2020-05-18T21:37:53.087546+0000", "btime": "2020-05-18T21:37:53.087546+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087546+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087546+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087546+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray4", "dirfrag": "0x60e", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1555, "rdev": 0, "ctime": "2020-05-18T21:37:53.088993+0000", "btime": "2020-05-18T21:37:53.088993+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088993+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray9", "dirfrag": "0x613", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 3, "rdev": 0, "ctime": "2020-05-18T21:38:01.329092+0000", "btime": "2020-05-18T21:38:01.329092+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:01.329092+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:38:01.329092+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:38:01.329092+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ -2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "openingsnapparents": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 257, "rdev": 0, "ctime": "2020-05-18T21:37:53.086401+0000", "btime": "2020-05-18T21:37:53.086401+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086401+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 10, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "openingsnapparents": 0 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "subtreetemp": 0, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 3, "dentries": [ { "path": "stray6", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1552, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray7", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1553, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray0", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1546, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray9", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1555, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray5", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1551, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray2", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1548, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray1", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1547, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray8", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1554, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray3", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1549, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray4", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1550, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] } ] } ] } ] 2020-05-18T21:38:15.664 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok dump cache 2020-05-18T21:38:15.771 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2020-05-18T21:38:15.772 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:15.772 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1, 2020-05-18T21:38:15.772 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:15.772 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:15.773 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:45.267427+0000", 2020-05-18T21:38:15.773 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 17407, 2020-05-18T21:38:15.773 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:15.773 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:15.773 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:15.774 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:15.774 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:15.774 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:15.774 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:15.774 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:15.774 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.775 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:15.775 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:38:15.775 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:38:15.775 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:38:15.775 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 30, 2020-05-18T21:38:15.776 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:15.776 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.776 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:15.776 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:15.776 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:15.777 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:15.777 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:15.777 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:15.777 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:15.777 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:15.778 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:15.778 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:38:15.778 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:15.778 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:15.778 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:15.779 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.779 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:15.779 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:15.779 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 1, 2020-05-18T21:38:15.779 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1 2020-05-18T21:38:15.780 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.780 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:15.780 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.780 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:15.780 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:15.780 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:15.781 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:15.781 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:52.684697+0000" 2020-05-18T21:38:15.781 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.781 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:15.781 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.782 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:15.782 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:15.782 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:15.782 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:15.782 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:45.267427+0000" 2020-05-18T21:38:15.782 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.783 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 4, 2020-05-18T21:38:15.783 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:15.783 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:15.783 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 3, 2020-05-18T21:38:15.783 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:15.784 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:15.784 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:15.784 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:15.784 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:15.784 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.784 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:15.785 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:15.785 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:15.785 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:15.785 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:15.785 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:15.786 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.786 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:15.786 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:15.786 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:15.786 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:38:15.786 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:15.787 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:15.787 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.787 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:15.787 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:15.787 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:38:15.788 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:15.788 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.788 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:38:15.788 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.788 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:15.788 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:15.789 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:15.789 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:15.789 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": 0, 2020-05-18T21:38:15.789 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 0 2020-05-18T21:38:15.789 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.790 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:38:15.790 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:15.790 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:15.790 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:15.790 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:15.790 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:15.791 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:15.791 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:15.791 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:15.791 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.791 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:15.792 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:15.792 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:15.792 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:15.792 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:15.792 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:15.792 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:38:15.793 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:15.793 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:38:15.793 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:15.793 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:15.793 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:15.794 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:15.794 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:15.794 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.794 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:15.794 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:15.794 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [], 2020-05-18T21:38:15.795 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:15.795 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:15.795 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:15.795 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:15.795 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:15.796 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.796 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:15.796 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1546, 2020-05-18T21:38:15.796 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:15.797 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:15.797 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:15.797 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:15.797 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:15.797 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:15.798 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:15.798 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:15.798 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:15.798 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:15.799 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:15.799 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:15.799 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.799 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:15.799 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:15.800 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:15.800 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:15.800 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:15.800 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:15.800 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.800 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:15.801 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:15.801 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:15.801 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:15.801 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:15.801 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:15.802 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:15.802 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:15.802 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:15.802 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:15.802 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:15.803 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:15.803 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:15.803 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.803 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:15.803 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:15.804 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:15.804 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:15.804 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.804 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:15.804 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.805 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:15.805 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:15.805 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:15.805 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:15.805 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086518+0000" 2020-05-18T21:38:15.805 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.806 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:15.806 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.806 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:15.806 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:15.806 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:15.807 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:15.807 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086518+0000" 2020-05-18T21:38:15.807 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.807 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:15.807 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:15.807 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:15.808 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:15.808 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:15.808 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:15.808 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:15.808 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:15.809 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:15.809 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.809 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:15.809 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:15.809 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:15.809 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:15.810 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:15.810 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:15.810 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.810 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:15.810 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:15.811 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:15.811 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:15.811 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:15.811 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:15.811 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.811 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:15.812 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:15.812 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:15.812 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:15.812 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.812 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:15.813 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.813 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:15.813 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:15.813 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:15.813 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:15.814 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:15.814 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:15.814 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:15.814 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.814 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:15.815 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:15.815 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:15.815 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:15.815 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:15.815 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:15.815 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:15.816 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:15.816 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:15.816 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.816 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:15.816 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:15.817 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:15.817 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:15.817 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:15.817 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:15.817 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:15.817 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:15.818 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:15.818 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:15.818 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:15.818 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:15.818 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.819 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:15.819 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:15.819 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:15.819 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:15.819 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:15.819 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:15.820 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray0", 2020-05-18T21:38:15.820 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60a", 2020-05-18T21:38:15.820 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:15.820 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:15.820 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:15.821 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:15.821 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:15.821 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:15.821 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:15.821 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:15.821 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:15.822 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:15.822 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:15.822 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.822 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:15.823 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:15.823 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:15.823 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.823 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:15.823 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:15.823 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:15.824 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:15.824 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.824 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:15.824 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.824 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:15.824 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:15.825 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:15.825 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:15.825 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:15.825 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:15.825 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:15.826 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:15.826 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.826 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:15.826 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:15.826 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:15.827 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:15.827 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.827 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:15.827 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1547, 2020-05-18T21:38:15.827 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:15.828 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:15.828 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:15.828 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:15.828 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:15.828 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:15.828 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:15.829 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:15.829 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:15.829 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:15.829 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:15.829 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:15.830 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.830 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:15.830 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:15.830 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:15.830 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:15.831 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:15.831 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:15.831 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.831 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:15.831 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:15.831 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:15.832 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:15.832 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:15.832 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:15.832 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:15.832 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:15.833 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:15.833 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:15.833 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:15.833 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:15.833 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:15.834 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.834 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:15.834 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:15.834 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:15.834 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:15.835 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.835 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:15.835 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.835 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:15.836 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:15.836 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:15.836 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:15.836 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086853+0000" 2020-05-18T21:38:15.836 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.836 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:15.837 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.837 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:15.837 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:15.837 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:15.837 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:15.838 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086853+0000" 2020-05-18T21:38:15.838 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.838 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:15.838 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:15.838 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:15.838 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:15.839 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:15.839 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:15.839 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:15.839 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:15.839 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:15.840 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.840 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:15.840 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:15.840 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:15.841 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:15.841 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:15.841 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:15.841 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.841 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:15.842 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:15.842 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:15.842 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:15.842 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:15.842 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:15.842 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.843 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:15.843 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:15.843 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:15.843 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:15.843 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.844 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:15.844 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.844 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:15.844 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:15.844 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:15.844 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:15.845 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:15.845 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:15.845 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:15.845 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.845 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:15.846 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:15.846 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:15.846 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:15.846 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:15.846 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:15.847 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:15.847 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:15.847 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:15.847 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.847 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:15.847 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:15.848 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:15.848 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:15.848 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:15.848 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:15.848 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:15.849 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:15.849 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:15.849 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:15.849 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:15.849 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:15.849 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.850 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:15.850 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:15.850 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:15.850 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:15.851 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:15.851 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:15.851 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray1", 2020-05-18T21:38:15.851 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60b", 2020-05-18T21:38:15.851 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:15.851 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:15.852 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:15.852 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:15.852 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:15.852 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:15.852 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:15.853 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:15.853 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:15.853 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:15.853 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:15.853 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.854 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:15.854 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:15.854 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:15.854 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.854 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:15.854 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:15.855 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:15.855 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:15.855 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.855 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:15.855 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.856 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:15.856 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:15.856 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:15.856 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:15.856 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:15.857 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:15.857 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:15.857 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:15.857 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.857 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:15.858 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:15.858 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:15.858 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:15.858 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.858 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:15.858 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1548, 2020-05-18T21:38:15.859 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:15.859 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:15.859 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:15.859 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:15.859 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:15.860 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:15.860 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:15.860 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:15.860 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:15.860 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:15.861 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:15.861 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:15.861 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.861 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:15.861 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:15.862 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:15.862 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:15.862 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:15.862 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:15.862 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.862 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:15.863 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:15.863 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:15.863 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:15.863 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:15.863 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:15.864 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:15.864 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:15.864 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:15.864 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:15.864 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:15.864 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:15.865 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:15.865 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.865 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:15.865 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:15.865 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:15.866 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:15.866 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.866 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:15.866 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.867 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:15.867 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:15.867 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:15.867 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:15.867 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087103+0000" 2020-05-18T21:38:15.867 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.868 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:15.868 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.868 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:15.868 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:15.868 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:15.869 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:15.869 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087103+0000" 2020-05-18T21:38:15.869 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.869 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:15.869 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:15.869 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:15.870 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:15.870 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:15.870 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:15.870 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:15.870 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:15.871 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:15.871 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.871 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:15.871 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:15.871 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:15.871 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:15.872 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:15.872 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:15.872 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.872 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:15.872 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:15.873 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:15.873 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:15.873 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:15.873 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:15.873 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.873 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:15.874 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:15.874 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:15.874 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:15.874 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.874 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:15.874 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.875 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:15.875 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:15.875 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:15.875 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:15.875 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:15.876 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:15.876 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:15.876 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.876 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:15.876 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:15.877 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:15.877 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:15.877 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:15.877 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:15.877 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:15.878 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:15.878 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:15.878 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.878 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:15.878 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:15.878 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:15.879 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:15.879 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:15.879 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:15.879 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:15.879 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:15.880 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:15.880 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:15.880 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:15.880 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:15.880 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.880 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:15.881 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:15.881 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:15.881 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:15.881 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:15.881 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:15.882 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray2", 2020-05-18T21:38:15.882 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60c", 2020-05-18T21:38:15.882 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:15.882 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:15.882 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:15.882 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:15.883 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:15.883 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:15.883 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:15.883 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:15.883 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:15.884 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:15.884 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:15.884 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.884 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:15.884 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:15.884 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:15.885 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.885 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:15.885 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:15.885 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:15.885 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:15.886 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.886 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:15.886 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.886 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:15.886 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:15.886 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:15.887 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:15.887 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:15.887 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:15.887 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:15.887 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:15.887 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.888 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:15.888 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:15.888 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:15.888 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:15.888 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.889 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:15.889 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1551, 2020-05-18T21:38:15.889 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:15.889 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:15.889 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:15.890 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:15.890 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:15.890 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:15.890 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:15.890 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:15.890 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:15.891 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:15.891 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:15.891 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:15.891 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.891 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:15.892 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:15.892 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:15.892 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:15.892 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:15.892 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:15.892 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.893 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:15.893 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:15.893 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:15.893 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:15.893 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:15.894 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:15.894 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:15.894 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:15.894 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:15.894 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:15.894 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:15.895 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:15.895 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:15.895 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.895 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:15.895 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:15.896 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:15.896 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:15.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.896 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:15.896 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.897 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:15.897 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:15.897 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:15.897 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:15.898 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087783+0000" 2020-05-18T21:38:15.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.898 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:15.898 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.898 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:15.899 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:15.899 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:15.899 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:15.899 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087783+0000" 2020-05-18T21:38:15.900 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.900 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:15.900 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:15.900 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:15.900 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:15.901 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:15.901 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:15.901 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:15.901 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:15.901 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:15.902 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.902 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:15.902 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:15.902 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:15.902 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:15.903 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:15.903 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:15.903 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.903 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:15.903 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:15.904 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:15.904 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:15.904 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:15.904 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:15.904 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.905 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:15.905 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:15.905 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:15.905 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:15.906 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.906 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:15.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.906 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:15.906 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:15.907 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:15.907 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:15.907 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:15.907 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:15.907 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:15.907 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.908 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:15.908 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:15.908 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:15.908 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:15.908 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:15.908 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:15.909 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:15.909 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:15.909 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:15.909 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.909 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:15.910 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:15.910 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:15.910 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:15.910 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:15.910 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:15.911 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:15.911 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:15.911 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:15.911 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:15.911 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:15.911 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:15.912 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.912 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:15.912 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:15.912 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:15.912 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:15.912 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:15.913 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:15.913 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray5", 2020-05-18T21:38:15.913 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60f", 2020-05-18T21:38:15.913 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:15.913 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:15.914 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:15.914 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:15.914 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:15.914 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:15.915 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:15.915 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:15.915 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:15.916 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:15.916 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:15.916 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.917 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:15.917 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:15.917 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:15.917 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.917 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:15.918 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:15.918 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:15.918 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:15.918 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.918 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:15.919 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.919 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:15.919 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:15.919 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:15.919 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:15.919 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:15.920 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:15.920 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:15.920 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:15.920 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.920 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:15.921 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:15.921 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:15.921 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:15.921 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.921 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:15.922 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1552, 2020-05-18T21:38:15.922 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:15.922 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:15.922 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:15.922 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:15.922 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:15.923 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:15.923 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:15.923 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:15.923 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:15.923 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:15.924 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:15.924 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:15.924 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.924 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:15.924 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:15.924 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:15.925 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:15.925 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:15.925 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:15.925 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.925 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:15.926 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:15.926 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:15.926 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:15.926 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:15.926 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:15.927 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:15.927 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:15.927 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:15.927 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:15.927 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:15.927 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:15.928 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:15.928 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.928 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:15.928 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:15.928 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:15.929 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:15.929 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.929 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:15.929 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.929 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:15.929 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:15.930 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:15.930 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:15.930 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088334+0000" 2020-05-18T21:38:15.930 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.930 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:15.931 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.931 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:15.931 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:15.931 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:15.931 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:15.931 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088334+0000" 2020-05-18T21:38:15.932 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.932 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:15.932 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:15.932 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:15.932 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:15.933 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:15.933 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:15.933 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:15.933 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:15.933 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:15.933 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.934 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:15.934 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:15.934 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:15.934 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:15.934 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:15.935 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:15.935 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.935 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:15.935 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:15.935 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:15.935 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:15.936 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:15.936 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:15.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.936 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:15.936 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:15.937 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:15.937 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:15.937 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.937 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:15.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.937 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:15.938 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:15.938 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:15.938 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:15.938 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:15.938 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:15.939 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:15.939 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.939 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:15.939 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:15.939 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:15.939 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:15.940 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:15.940 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:15.940 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:15.940 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:15.940 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:15.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.941 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:15.941 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:15.941 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:15.941 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:15.941 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:15.942 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:15.942 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:15.942 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:15.942 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:15.942 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:15.943 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:15.943 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:15.943 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.943 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:15.943 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:15.943 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:15.944 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:15.944 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:15.944 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:15.944 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray6", 2020-05-18T21:38:15.944 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x610", 2020-05-18T21:38:15.944 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:15.945 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:15.945 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:15.946 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:15.946 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:15.946 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:15.946 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:15.947 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:15.947 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:15.947 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:15.947 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:15.947 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.948 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:15.948 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:15.948 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:15.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.948 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:15.949 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:15.949 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:15.949 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:15.949 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.949 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:15.950 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.950 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:15.950 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:15.950 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:15.950 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:15.951 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:15.951 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:15.951 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:15.951 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:15.951 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.951 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:15.952 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:15.952 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:15.952 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:15.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.952 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:15.953 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1549, 2020-05-18T21:38:15.953 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:15.953 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:15.953 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:15.954 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:15.954 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:15.959 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:15.959 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:15.959 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:15.959 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:15.959 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:15.960 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:15.960 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:15.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.960 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:15.960 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:15.961 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:15.961 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:15.961 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:15.961 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:15.961 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.962 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:15.962 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:15.962 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:15.962 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:15.962 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:15.963 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:15.963 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:15.963 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:15.963 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:15.963 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:15.963 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:15.964 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:15.964 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:15.964 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.964 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:15.964 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:15.965 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:15.965 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:15.965 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.965 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:15.966 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.966 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:15.966 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:15.966 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:15.966 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:15.967 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087329+0000" 2020-05-18T21:38:15.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.967 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:15.967 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.967 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:15.967 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:15.968 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:15.968 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:15.968 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087329+0000" 2020-05-18T21:38:15.968 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.968 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:15.969 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:15.969 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:15.969 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:15.969 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:15.969 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:15.969 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:15.970 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:15.970 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:15.970 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.970 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:15.970 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:15.971 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:15.971 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:15.971 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:15.971 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:15.971 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.971 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:15.972 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:15.972 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:15.972 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:15.972 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:15.972 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:15.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.973 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:15.973 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:15.973 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:15.973 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:15.974 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.974 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:15.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.974 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:15.974 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:15.974 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:15.975 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:15.975 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:15.975 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:15.975 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:15.975 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.976 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:15.976 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:15.976 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:15.976 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:15.977 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:15.977 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:15.977 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:15.977 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:15.977 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:15.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.978 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:15.978 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:15.978 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:15.978 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:15.978 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:15.979 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:15.979 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:15.979 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:15.979 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:15.979 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:15.980 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:15.980 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:15.980 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.980 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:15.980 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:15.980 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:15.981 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:15.981 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:15.981 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:15.981 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray3", 2020-05-18T21:38:15.981 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60d", 2020-05-18T21:38:15.982 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:15.982 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:15.982 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:15.982 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:15.983 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:15.983 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:15.984 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:15.984 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:15.984 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:15.984 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:15.985 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:15.985 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.985 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:15.986 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:15.986 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:15.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.987 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:15.987 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:15.987 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:15.987 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:15.987 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:15.988 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:15.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.988 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:15.988 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:15.988 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:15.989 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:15.989 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:15.989 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:15.989 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:15.989 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:15.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.990 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:15.990 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:15.990 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:15.990 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:15.991 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.991 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:15.991 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1553, 2020-05-18T21:38:15.991 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:15.992 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:15.992 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:15.992 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:15.992 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:15.992 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:15.992 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:15.993 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:15.993 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:15.993 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:15.993 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:15.993 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:15.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.994 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:15.994 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:15.994 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:15.994 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:15.995 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:15.995 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:15.995 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:15.995 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:15.995 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:15.995 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:15.996 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:15.996 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:15.996 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:15.996 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:15.997 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:15.997 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:15.997 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:15.997 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:15.997 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:15.998 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:15.998 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:15.998 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:15.998 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:15.999 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:15.999 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:15.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.000 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:16.000 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:16.000 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:16.000 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:16.001 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:16.001 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:16.001 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088498+0000" 2020-05-18T21:38:16.001 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.001 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:16.002 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:16.002 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:16.002 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:16.002 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:16.002 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:16.002 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088498+0000" 2020-05-18T21:38:16.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.003 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:16.003 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:16.003 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:16.003 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:16.004 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:16.004 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:16.004 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:16.004 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:16.004 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:16.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.005 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:16.005 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:16.005 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:16.005 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:16.005 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:16.006 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:16.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.006 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:16.006 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:16.006 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:16.006 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.007 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.007 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.007 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.007 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.008 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.008 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.008 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.008 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.008 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.008 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.009 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.009 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.009 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.009 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:16.009 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:16.010 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:16.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.010 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:16.010 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:16.010 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:16.010 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:16.011 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:16.011 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:16.011 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:16.011 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:16.011 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:16.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.012 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:16.012 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:16.012 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:16.013 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:16.013 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:16.013 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:16.013 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:16.013 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:16.014 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:16.014 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.014 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:16.014 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:16.014 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.015 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:16.015 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:16.015 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:16.015 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:16.015 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:16.016 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.016 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray7", 2020-05-18T21:38:16.016 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x611", 2020-05-18T21:38:16.016 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:16.016 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:16.017 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:16.017 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:16.017 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:16.017 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:16.017 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:16.017 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.018 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:16.018 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:16.018 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:16.018 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.018 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.019 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.019 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.019 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.019 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.019 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.019 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.020 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.020 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.020 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.020 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.021 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.021 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.021 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.021 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:16.021 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:16.021 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:16.022 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:16.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.022 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:16.022 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:16.022 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:16.023 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:16.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.023 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1554, 2020-05-18T21:38:16.023 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:16.023 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:16.024 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:16.024 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:16.024 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:16.024 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:16.024 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:16.025 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:16.025 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:16.025 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:16.025 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:16.025 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:16.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.026 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:16.026 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:16.026 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:16.026 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:16.026 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:16.027 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:16.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.027 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:16.027 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:16.027 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:16.027 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:16.028 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:16.028 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:16.028 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:16.028 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:16.028 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:16.029 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:16.029 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:16.029 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:16.029 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:16.030 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:16.030 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:16.030 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:16.030 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:16.030 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:16.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.031 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:16.031 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:16.031 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:16.031 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:16.031 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:16.032 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:16.032 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088676+0000" 2020-05-18T21:38:16.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.032 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:16.032 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:16.032 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:16.033 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:16.033 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:16.033 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:16.033 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088676+0000" 2020-05-18T21:38:16.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.034 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:16.034 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:16.034 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:16.034 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:16.034 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:16.034 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:16.035 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:16.035 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:16.035 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:16.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.035 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:16.036 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:16.036 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:16.036 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:16.036 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:16.036 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:16.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.037 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:16.037 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:16.037 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:16.037 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.037 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.038 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.038 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.038 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.038 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.038 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.039 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.039 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.039 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.039 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.040 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.040 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.040 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:16.040 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:16.040 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:16.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.041 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:16.041 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:16.041 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:16.041 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:16.041 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:16.042 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:16.042 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:16.042 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:16.042 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:16.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.042 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:16.043 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:16.043 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:16.043 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:16.043 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:16.043 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:16.044 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:16.044 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:16.044 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:16.044 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.044 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:16.044 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:16.045 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.045 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:16.045 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:16.045 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:16.045 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:16.046 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:16.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.046 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray8", 2020-05-18T21:38:16.046 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x612", 2020-05-18T21:38:16.046 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:16.046 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:16.047 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:16.047 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:16.047 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:16.047 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:16.047 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:16.047 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.048 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:16.048 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:16.048 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:16.048 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.048 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.049 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.049 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.049 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.049 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.049 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.050 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.050 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.050 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.050 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.051 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.051 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.051 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.051 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:16.051 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:16.051 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:16.052 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:16.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.052 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:16.052 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:16.052 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:16.053 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:16.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.053 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1550, 2020-05-18T21:38:16.053 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:16.053 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:16.054 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:16.054 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:16.054 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:16.054 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:16.054 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:16.055 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:16.055 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:16.055 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:16.055 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:16.055 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:16.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.056 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:16.056 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:16.056 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:16.056 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:16.056 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:16.057 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:16.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.057 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:16.057 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:16.057 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:16.057 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:16.058 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:16.058 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:16.058 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:16.058 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:16.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:16.059 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:16.059 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:16.059 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:16.059 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:16.059 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:16.060 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:16.060 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:16.060 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:16.060 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:16.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.061 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:16.061 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:16.061 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:16.061 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:16.061 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:16.062 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:16.062 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087546+0000" 2020-05-18T21:38:16.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.062 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:16.062 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:16.063 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:16.063 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:16.063 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:16.063 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:16.063 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087546+0000" 2020-05-18T21:38:16.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.064 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:16.064 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:16.064 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:16.064 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:16.064 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:16.065 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:16.065 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:16.065 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:16.065 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:16.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.065 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:16.066 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:16.066 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:16.066 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:16.066 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:16.066 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:16.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.067 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:16.067 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:16.067 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:16.067 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.067 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.068 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.068 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.068 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.068 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.069 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.069 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.069 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.069 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.069 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.070 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.070 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.070 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:16.070 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:16.070 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:16.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.071 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:16.071 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:16.071 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:16.071 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:16.071 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:16.072 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:16.072 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:16.072 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:16.072 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:16.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.073 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:16.073 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:16.073 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:16.073 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:16.073 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:16.073 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:16.074 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:16.074 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:16.074 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:16.074 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.074 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:16.075 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:16.075 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.075 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:16.075 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:16.075 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:16.076 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:16.076 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:16.076 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.076 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray4", 2020-05-18T21:38:16.076 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60e", 2020-05-18T21:38:16.076 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:16.077 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:16.077 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:16.077 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:16.077 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:16.078 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:16.078 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:16.078 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.078 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:16.078 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:16.079 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:16.079 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.079 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.079 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.079 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.080 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.080 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.080 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.080 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.080 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.081 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.081 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.081 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.081 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.082 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.082 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:16.082 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:16.082 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:16.082 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:16.083 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.083 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:16.083 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:16.083 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:16.084 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:16.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.084 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.084 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1555, 2020-05-18T21:38:16.084 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:16.085 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:16.085 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:16.085 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:16.086 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:16.087 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:16.087 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:16.087 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:16.088 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:16.088 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:16.088 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:16.088 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:16.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.089 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:16.089 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:16.089 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:16.089 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:16.089 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:16.090 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:16.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.090 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:16.090 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:16.090 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:16.091 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:16.091 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:16.091 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:16.091 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:16.091 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:16.092 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:16.092 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:16.092 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:16.092 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:16.093 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:16.093 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:16.093 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:16.093 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:16.093 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:16.093 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:16.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.094 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:16.094 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:16.094 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:16.095 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:16.095 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:16.095 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:16.095 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:16.095 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.096 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:16.096 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:16.096 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:16.096 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:16.096 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:16.097 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:16.097 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:16.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.097 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:16.097 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:16.098 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:16.098 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:16.098 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:16.098 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:16.098 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:16.099 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:16.099 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:16.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.099 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:16.100 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:16.100 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:16.100 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:16.100 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:16.100 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:16.100 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.101 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:16.101 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:16.101 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:16.101 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.102 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.102 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.102 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.102 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.103 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.103 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.103 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.103 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.103 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.104 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.104 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.104 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.104 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:16.104 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:16.105 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:16.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.105 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:16.105 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:16.105 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:16.105 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:16.106 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:16.106 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:16.106 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:16.106 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:16.106 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:16.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.107 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:16.107 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:16.107 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:16.107 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:16.107 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:16.108 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:16.108 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:16.108 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:16.108 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:16.108 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.109 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:16.109 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:16.109 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.109 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:16.109 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:16.109 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:16.110 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:16.110 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:16.110 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.110 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray9", 2020-05-18T21:38:16.110 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x613", 2020-05-18T21:38:16.111 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:16.111 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:16.111 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:16.111 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:16.111 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:16.111 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:16.112 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:16.112 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.112 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:16.112 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:16.113 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:16.113 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.113 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.113 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.114 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.114 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.114 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.114 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.115 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.115 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.115 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.115 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.116 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.116 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.116 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.116 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:16.116 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:16.116 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:16.117 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:16.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.117 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:16.117 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:16.117 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:16.118 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:16.118 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.118 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 3, 2020-05-18T21:38:16.118 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:16.118 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:16.119 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:16.119 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16877, 2020-05-18T21:38:16.119 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:16.119 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:16.119 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:16.120 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:16.120 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:16.120 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:16.120 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:16.120 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:16.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.121 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:16.121 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:16.121 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:16.121 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:16.121 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:16.122 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:16.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.122 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:16.122 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:16.122 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:16.123 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:16.123 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:16.123 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:16.123 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:16.123 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:16.124 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:16.124 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:16.124 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:16.124 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:16.124 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:16.124 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:16.125 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:16.125 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:16.125 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:16.125 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:16.125 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.126 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:16.126 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:16.126 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:16.126 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:16.126 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:16.126 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:16.127 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:01.329092+0000" 2020-05-18T21:38:16.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.127 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:16.127 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:16.127 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:16.128 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:16.128 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:16.128 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:16.128 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:01.329092+0000" 2020-05-18T21:38:16.128 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.128 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:16.129 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:16.129 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:16.129 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:16.129 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:16.129 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:16.130 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:16.130 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:16.130 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:16.130 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.130 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:16.130 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:16.131 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:16.131 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:16.131 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:16.131 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:16.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.132 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:16.132 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:16.132 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:16.132 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.132 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.132 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.133 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.133 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.133 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.133 INFO:teuthology.orchestra.run.smithi155.stdout: -2, 2020-05-18T21:38:16.133 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.134 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.134 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.134 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.134 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.134 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.135 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.135 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.135 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:38:16.135 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.135 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:38:16.135 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:16.136 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:16.136 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:16.136 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:16.136 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:16.136 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:16.137 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:16.137 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:16.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.137 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:16.137 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:16.137 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:16.138 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:16.138 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:16.138 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:16.138 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:16.138 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:16.139 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:16.139 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.139 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:16.139 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.139 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:16.139 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:16.140 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:16.140 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:16.140 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:16.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.140 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.141 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 257, 2020-05-18T21:38:16.141 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:16.141 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:16.141 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:16.141 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:16.141 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:16.142 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:16.142 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:16.142 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:16.142 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:16.142 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:16.143 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:16.143 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:16.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.143 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:16.143 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:16.143 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:16.144 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:16.144 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:16.144 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:16.144 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.144 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:16.145 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:16.145 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:16.145 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:16.145 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:16.145 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:16.145 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:16.146 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:16.146 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:16.146 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:16.146 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:16.146 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:16.147 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:16.147 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:16.147 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:16.147 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:16.147 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 10, 2020-05-18T21:38:16.147 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:16.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.148 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:16.148 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:16.148 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:16.148 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:16.148 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:38:16.149 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:16.149 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:16.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.149 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:16.149 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:16.150 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:16.150 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:16.150 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:38:16.150 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:16.150 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:16.150 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.151 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:16.151 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:16.151 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:16.151 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:16.151 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:16.152 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:16.152 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:16.152 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:16.152 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:16.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.152 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:16.153 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:16.153 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:16.153 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:16.153 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:16.153 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:16.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.154 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:16.154 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:16.154 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:16.154 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.154 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.155 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.155 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.155 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.155 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.156 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.156 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.156 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.156 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.156 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.157 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.157 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.157 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:16.157 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:38:16.157 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.158 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:16.158 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:16.158 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:16.158 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:16.158 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:16.158 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:16.159 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:16.159 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:16.159 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:16.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.159 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:16.159 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:16.160 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:16.160 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:16.160 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:16.160 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:16.160 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:16.161 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:16.161 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:16.161 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.161 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:16.161 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.161 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:16.162 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:16.162 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:16.162 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:16.162 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:16.162 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.163 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1", 2020-05-18T21:38:16.163 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x101", 2020-05-18T21:38:16.163 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:16.163 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:16.163 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:16.163 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "0", 2020-05-18T21:38:16.164 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "0", 2020-05-18T21:38:16.164 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:16.164 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "1", 2020-05-18T21:38:16.164 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.164 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:16.165 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:16.165 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:16.165 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.165 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.165 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.165 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.166 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.166 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.166 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.166 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.166 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.167 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.167 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.167 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.167 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.167 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.168 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.168 INFO:teuthology.orchestra.run.smithi155.stdout: "child": 1, 2020-05-18T21:38:16.168 INFO:teuthology.orchestra.run.smithi155.stdout: "subtree": 1, 2020-05-18T21:38:16.168 INFO:teuthology.orchestra.run.smithi155.stdout: "subtreetemp": 0, 2020-05-18T21:38:16.168 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:16.169 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:16.169 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:16.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.169 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:16.169 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [ 2020-05-18T21:38:16.169 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.170 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray6", 2020-05-18T21:38:16.170 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:16.170 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:16.170 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:16.170 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:16.170 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:16.171 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:16.171 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:16.171 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1552, 2020-05-18T21:38:16.171 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:16.171 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:16.172 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:16.172 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.172 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.172 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.172 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.173 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.173 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.173 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.173 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.173 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.174 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.174 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.174 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.174 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.174 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.174 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.175 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:16.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.175 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:16.175 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:16.175 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:16.176 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:16.176 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:16.176 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:16.176 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:16.176 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:16.176 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:16.177 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:16.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.177 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.177 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:16.177 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:16.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.178 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.178 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray7", 2020-05-18T21:38:16.178 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:16.178 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:16.178 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:16.179 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:16.179 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:16.179 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:16.179 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:16.179 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1553, 2020-05-18T21:38:16.179 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:16.180 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:16.180 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:16.180 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.180 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.180 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.181 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.181 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.181 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.181 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.181 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.182 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.182 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.182 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.182 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.183 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.183 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.183 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:16.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.184 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:16.184 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:16.184 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:16.184 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:16.184 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:16.184 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:16.185 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:16.185 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:16.185 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:16.185 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:16.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.186 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.186 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:16.186 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:16.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.186 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.186 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray0", 2020-05-18T21:38:16.187 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:16.187 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:16.187 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:16.187 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:16.187 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:16.188 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:16.188 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:16.188 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1546, 2020-05-18T21:38:16.188 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:16.188 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:16.188 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:16.189 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.189 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.189 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.189 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.189 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.190 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.190 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.190 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.190 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.190 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.190 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.191 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.191 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.191 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.191 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.191 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.192 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:16.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.192 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:16.192 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:16.192 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:16.192 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:16.193 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:16.193 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:16.193 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:16.193 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:16.193 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:16.194 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:16.194 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.194 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.194 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:16.194 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:16.194 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.195 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.195 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray9", 2020-05-18T21:38:16.195 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:16.195 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:16.195 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:16.196 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:16.196 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:16.196 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:16.196 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:16.196 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1555, 2020-05-18T21:38:16.196 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:16.197 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:16.197 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:16.197 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.197 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.197 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.198 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.198 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.198 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.198 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.198 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.199 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.199 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.199 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.199 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.199 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.199 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.200 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.200 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:16.200 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.200 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:16.200 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:16.201 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:16.201 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:16.201 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:16.201 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:16.201 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:16.201 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:16.202 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:16.202 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:16.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.202 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.202 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:16.203 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:16.203 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.203 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.203 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray5", 2020-05-18T21:38:16.203 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:16.203 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:16.204 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:16.204 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:16.204 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:16.204 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:16.204 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:16.205 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1551, 2020-05-18T21:38:16.205 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:16.205 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:16.205 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:16.205 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.205 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.206 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.206 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.206 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.206 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.206 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.207 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.207 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.207 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.207 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.207 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.208 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.208 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.208 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.208 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:16.208 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.208 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:16.209 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:16.209 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:16.209 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:16.209 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:16.209 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:16.210 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:16.210 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:16.210 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:16.210 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:16.210 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.210 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.211 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:16.211 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:16.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.211 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.211 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray2", 2020-05-18T21:38:16.212 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:16.212 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:16.212 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:16.212 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:16.212 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:16.213 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:16.213 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:16.213 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1548, 2020-05-18T21:38:16.213 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:16.213 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:16.214 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:16.214 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.214 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.214 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.214 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.215 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.215 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.215 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.215 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.215 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.215 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.216 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.216 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.216 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.216 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.216 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.217 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.217 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:16.217 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.217 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:16.217 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:16.217 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:16.218 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:16.218 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:16.218 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:16.218 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:16.218 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:16.219 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:16.219 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:16.219 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.219 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.219 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:16.219 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:16.220 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.220 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.220 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray1", 2020-05-18T21:38:16.220 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:16.220 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:16.220 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:16.221 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:16.221 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:16.221 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:16.221 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:16.221 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1547, 2020-05-18T21:38:16.222 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:16.222 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:16.222 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:16.222 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.222 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.223 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.223 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.223 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.223 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.223 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.223 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.224 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.224 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.224 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.224 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.224 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.224 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.225 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.225 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.225 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:16.225 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.225 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:16.226 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:16.226 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:16.226 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:16.226 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:16.226 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:16.226 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:16.227 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:16.227 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:16.227 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:16.227 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.227 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.228 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:16.228 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:16.228 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.228 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.228 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray8", 2020-05-18T21:38:16.228 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:16.229 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:16.229 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:16.229 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:16.229 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:16.229 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:16.230 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:16.230 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1554, 2020-05-18T21:38:16.230 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:16.230 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:16.230 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:16.230 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.231 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.231 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.231 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.231 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.232 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.232 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.232 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.232 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.232 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.232 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.233 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.233 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.233 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.233 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.233 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:16.234 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.234 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:16.234 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:16.234 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:16.234 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:16.234 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:16.235 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:16.235 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:16.235 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:16.235 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:16.235 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:16.235 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.236 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.236 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:16.236 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:16.236 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.236 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.237 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray3", 2020-05-18T21:38:16.237 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:16.237 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:16.237 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:16.237 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:16.237 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:16.238 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:16.238 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:16.238 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1549, 2020-05-18T21:38:16.238 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:16.238 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:16.239 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:16.239 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.239 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.239 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.239 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.239 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.240 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.240 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.240 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.240 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.240 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.240 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.241 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.241 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.241 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.241 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.241 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.242 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:16.242 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.242 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:16.242 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:16.242 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:16.242 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:16.243 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:16.243 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:16.243 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:16.243 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:16.243 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:16.244 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:16.244 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.244 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.244 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:16.244 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:16.244 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.245 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:16.245 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray4", 2020-05-18T21:38:16.245 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:16.245 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:16.245 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:16.246 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:16.246 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:16.246 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:16.246 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:16.246 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1550, 2020-05-18T21:38:16.246 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:16.247 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:16.247 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:16.247 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.247 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:16.247 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:16.247 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:16.248 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.248 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:16.248 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:16.248 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:16.248 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:16.249 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:16.249 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:16.249 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.249 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:16.249 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:16.249 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:16.250 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:16.250 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:16.250 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.250 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:16.250 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:16.251 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:16.251 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:16.251 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:16.251 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:16.251 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:16.251 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:16.252 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:16.252 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:16.252 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:16.252 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:16.252 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:16.252 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:16.253 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:16.253 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:16.253 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:16.253 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:16.253 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:16.254 INFO:teuthology.orchestra.run.smithi155.stdout:] 2020-05-18T21:38:16.255 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "ino": 1, "rdev": 0, "ctime": "2020-05-18T21:38:07.145016+0000", "btime": "2020-05-18T21:37:45.267427+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 30, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:07.145016+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:38:07.145016+0000", "num_files": 0, "num_subdirs": 1, "change_attr": 1 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:52.684697+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:45.267427+0000" }, "version": 4, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 3, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "dirfrag": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1546, "rdev": 0, "ctime": "2020-05-18T21:37:53.086518+0000", "btime": "2020-05-18T21:37:53.086518+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086518+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086518+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086518+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray0", "dirfrag": "0x60a", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1547, "rdev": 0, "ctime": "2020-05-18T21:37:53.086853+0000", "btime": "2020-05-18T21:37:53.086853+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086853+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086853+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086853+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray1", "dirfrag": "0x60b", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1548, "rdev": 0, "ctime": "2020-05-18T21:37:53.087103+0000", "btime": "2020-05-18T21:37:53.087103+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087103+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087103+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087103+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray2", "dirfrag": "0x60c", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1551, "rdev": 0, "ctime": "2020-05-18T21:37:53.087783+0000", "btime": "2020-05-18T21:37:53.087783+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087783+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087783+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087783+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray5", "dirfrag": "0x60f", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1552, "rdev": 0, "ctime": "2020-05-18T21:37:53.088334+0000", "btime": "2020-05-18T21:37:53.088334+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088334+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088334+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088334+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray6", "dirfrag": "0x610", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1549, "rdev": 0, "ctime": "2020-05-18T21:37:53.087329+0000", "btime": "2020-05-18T21:37:53.087329+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087329+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087329+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087329+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray3", "dirfrag": "0x60d", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1553, "rdev": 0, "ctime": "2020-05-18T21:37:53.088498+0000", "btime": "2020-05-18T21:37:53.088498+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088498+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088498+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088498+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray7", "dirfrag": "0x611", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1554, "rdev": 0, "ctime": "2020-05-18T21:37:53.088676+0000", "btime": "2020-05-18T21:37:53.088676+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088676+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088676+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088676+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray8", "dirfrag": "0x612", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1550, "rdev": 0, "ctime": "2020-05-18T21:37:53.087546+0000", "btime": "2020-05-18T21:37:53.087546+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087546+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087546+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087546+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray4", "dirfrag": "0x60e", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1555, "rdev": 0, "ctime": "2020-05-18T21:37:53.088993+0000", "btime": "2020-05-18T21:37:53.088993+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088993+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray9", "dirfrag": "0x613", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 3, "rdev": 0, "ctime": "2020-05-18T21:38:01.329092+0000", "btime": "2020-05-18T21:38:01.329092+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:01.329092+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:38:01.329092+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:38:01.329092+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ -2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "openingsnapparents": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 257, "rdev": 0, "ctime": "2020-05-18T21:37:53.086401+0000", "btime": "2020-05-18T21:37:53.086401+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086401+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 10, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "openingsnapparents": 0 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "subtreetemp": 0, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 3, "dentries": [ { "path": "stray6", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1552, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray7", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1553, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray0", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1546, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray9", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1555, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray5", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1551, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray2", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1548, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray1", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1547, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray8", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1554, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray3", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1549, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray4", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1550, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] } ] } ] } ] 2020-05-18T21:38:17.257 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok dump cache 2020-05-18T21:38:17.369 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2020-05-18T21:38:17.370 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.370 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1099511628285, 2020-05-18T21:38:17.370 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:17.370 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:07.185291+0000", 2020-05-18T21:38:17.370 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:38:07.183028+0000", 2020-05-18T21:38:17.371 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 33188, 2020-05-18T21:38:17.371 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:17.371 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:17.371 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:17.371 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:17.372 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 0, 2020-05-18T21:38:17.372 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:17.372 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:17.372 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:17.372 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.373 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:17.373 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:38:17.373 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:38:17.373 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:38:17.373 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 30, 2020-05-18T21:38:17.374 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:17.374 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.374 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:17.374 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 7, 2020-05-18T21:38:17.374 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 1, 2020-05-18T21:38:17.375 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:17.375 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:17.375 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:17.375 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.185291+0000", 2020-05-18T21:38:17.375 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "2020-05-18T21:38:07.183028+0000", 2020-05-18T21:38:17.375 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:17.376 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:38:17.376 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:17.376 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:17.376 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:17.376 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.377 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:17.377 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:17.377 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:17.377 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:17.377 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.377 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:17.378 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.378 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.378 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.378 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.378 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.379 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.185291+0000" 2020-05-18T21:38:17.379 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.379 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:17.379 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.379 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.379 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.380 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.380 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.380 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.185291+0000" 2020-05-18T21:38:17.380 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.380 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 38, 2020-05-18T21:38:17.381 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:17.381 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:17.381 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 18, 2020-05-18T21:38:17.381 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:17.382 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:17.382 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:17.382 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:17.382 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:17.382 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.383 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:17.383 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:17.383 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:17.383 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:17.383 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:17.383 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:17.384 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.384 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:17.384 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:17.384 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:17.384 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.385 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.385 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.385 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.385 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.385 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.385 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.386 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.386 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.386 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.386 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.386 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.387 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.387 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.387 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.387 INFO:teuthology.orchestra.run.smithi155.stdout: "importingcaps": 0, 2020-05-18T21:38:17.387 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1, 2020-05-18T21:38:17.388 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent": 1, 2020-05-18T21:38:17.388 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.388 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.388 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.388 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:17.388 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.389 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.389 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.389 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.389 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.389 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.390 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.390 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.390 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:17.390 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:17.390 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:17.391 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:17.391 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:17.391 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:17.391 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:38:17.391 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.392 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:38:17.392 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.392 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.392 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.392 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.392 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.393 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.393 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:17.393 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:17.393 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.393 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.394 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:17.394 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent", 2020-05-18T21:38:17.394 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtypool" 2020-05-18T21:38:17.394 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.394 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [ 2020-05-18T21:38:17.394 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.395 INFO:teuthology.orchestra.run.smithi155.stdout: "client_id": 7277, 2020-05-18T21:38:17.395 INFO:teuthology.orchestra.run.smithi155.stdout: "pending": "pAsLsXsFsc", 2020-05-18T21:38:17.395 INFO:teuthology.orchestra.run.smithi155.stdout: "issued": "pAsLsXsFsc", 2020-05-18T21:38:17.395 INFO:teuthology.orchestra.run.smithi155.stdout: "wanted": "-", 2020-05-18T21:38:17.395 INFO:teuthology.orchestra.run.smithi155.stdout: "last_sent": 1 2020-05-18T21:38:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:17.397 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.397 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.397 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1099511628286, 2020-05-18T21:38:17.397 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:17.397 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:07.187908+0000", 2020-05-18T21:38:17.398 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:38:07.186031+0000", 2020-05-18T21:38:17.398 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 33188, 2020-05-18T21:38:17.398 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:17.398 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:17.398 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:17.399 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:17.399 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 0, 2020-05-18T21:38:17.399 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:17.399 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:17.399 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:17.399 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.400 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:17.400 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:38:17.400 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:38:17.400 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:38:17.400 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 30, 2020-05-18T21:38:17.401 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:17.401 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.401 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:17.401 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 7, 2020-05-18T21:38:17.401 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 1, 2020-05-18T21:38:17.401 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:17.402 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:17.402 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:17.402 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.187908+0000", 2020-05-18T21:38:17.402 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "2020-05-18T21:38:07.186031+0000", 2020-05-18T21:38:17.402 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:17.403 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:38:17.403 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:17.403 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:17.403 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:17.403 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.403 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:17.404 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:17.404 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:17.404 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:17.404 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.404 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:17.405 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.405 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.405 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.405 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.405 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.405 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.187908+0000" 2020-05-18T21:38:17.406 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.406 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:17.406 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.406 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.406 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.407 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.407 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.407 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.187908+0000" 2020-05-18T21:38:17.407 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.407 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 40, 2020-05-18T21:38:17.407 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:17.408 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:17.408 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 20, 2020-05-18T21:38:17.408 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:17.408 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:17.408 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:17.409 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:17.409 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:17.409 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.409 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:17.409 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:17.410 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:17.410 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:17.410 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:17.410 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:17.410 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.410 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:17.411 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:17.411 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:17.411 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.411 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.411 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.411 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.412 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.412 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.412 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.412 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.412 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.413 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.413 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.413 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.413 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.413 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.413 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.414 INFO:teuthology.orchestra.run.smithi155.stdout: "importingcaps": 0, 2020-05-18T21:38:17.414 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1, 2020-05-18T21:38:17.414 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent": 1, 2020-05-18T21:38:17.414 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.414 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.415 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.415 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:17.415 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.415 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.415 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.415 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.416 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.416 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.416 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.416 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.416 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.417 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:17.417 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:17.417 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:17.417 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:17.417 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:17.417 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:17.418 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:38:17.418 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.418 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:38:17.418 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.418 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.419 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.419 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.419 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.419 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.419 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:17.419 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:17.420 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.420 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.420 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:17.420 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent", 2020-05-18T21:38:17.420 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtypool" 2020-05-18T21:38:17.421 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.421 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [ 2020-05-18T21:38:17.421 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.421 INFO:teuthology.orchestra.run.smithi155.stdout: "client_id": 7277, 2020-05-18T21:38:17.422 INFO:teuthology.orchestra.run.smithi155.stdout: "pending": "pAsLsXsFsc", 2020-05-18T21:38:17.422 INFO:teuthology.orchestra.run.smithi155.stdout: "issued": "pAsLsXsFsc", 2020-05-18T21:38:17.422 INFO:teuthology.orchestra.run.smithi155.stdout: "wanted": "-", 2020-05-18T21:38:17.422 INFO:teuthology.orchestra.run.smithi155.stdout: "last_sent": 1 2020-05-18T21:38:17.422 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:17.423 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.423 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:17.423 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:17.423 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:17.423 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:17.423 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.424 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.424 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1099511628280, 2020-05-18T21:38:17.424 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:17.424 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:07.172443+0000", 2020-05-18T21:38:17.425 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:38:07.170645+0000", 2020-05-18T21:38:17.425 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 33188, 2020-05-18T21:38:17.425 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:17.425 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:17.425 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:17.425 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:17.426 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 0, 2020-05-18T21:38:17.426 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:17.426 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:17.426 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:17.426 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.427 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:17.427 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:38:17.427 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:38:17.427 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:38:17.427 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 30, 2020-05-18T21:38:17.427 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:17.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.428 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:17.428 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 7, 2020-05-18T21:38:17.428 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 1, 2020-05-18T21:38:17.428 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:17.429 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:17.429 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:17.429 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.172443+0000", 2020-05-18T21:38:17.429 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "2020-05-18T21:38:07.170645+0000", 2020-05-18T21:38:17.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:17.430 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:38:17.430 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:17.430 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:17.430 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:17.430 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.430 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:17.431 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:17.431 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:17.431 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:17.431 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.431 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:17.432 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.432 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.432 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.432 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.432 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.432 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.172443+0000" 2020-05-18T21:38:17.433 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.433 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:17.433 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.433 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.433 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.434 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.434 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.434 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.172443+0000" 2020-05-18T21:38:17.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.434 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 28, 2020-05-18T21:38:17.434 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:17.435 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:17.435 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 8, 2020-05-18T21:38:17.435 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:17.435 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:17.435 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:17.436 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:17.436 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:17.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.436 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:17.436 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:17.436 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:17.437 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:17.437 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:17.437 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:17.437 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.437 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:17.438 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:17.438 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:17.438 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.438 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.438 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.439 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.439 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.439 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.439 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.439 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.440 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.440 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.440 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.440 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.440 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.441 INFO:teuthology.orchestra.run.smithi155.stdout: "importingcaps": 0, 2020-05-18T21:38:17.441 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1, 2020-05-18T21:38:17.441 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent": 1, 2020-05-18T21:38:17.441 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.441 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.442 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:17.442 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.442 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.442 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.442 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.443 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.443 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.443 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.443 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.444 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:17.444 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:17.444 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:17.444 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:17.444 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:17.444 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:17.445 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:38:17.445 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.445 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:38:17.445 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.445 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.446 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.446 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.446 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.446 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:17.446 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:17.447 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.447 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.447 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:17.447 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent", 2020-05-18T21:38:17.447 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtypool" 2020-05-18T21:38:17.448 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.448 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [ 2020-05-18T21:38:17.448 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.448 INFO:teuthology.orchestra.run.smithi155.stdout: "client_id": 7277, 2020-05-18T21:38:17.448 INFO:teuthology.orchestra.run.smithi155.stdout: "pending": "pAsLsXsFsc", 2020-05-18T21:38:17.448 INFO:teuthology.orchestra.run.smithi155.stdout: "issued": "pAsLsXsFsc", 2020-05-18T21:38:17.449 INFO:teuthology.orchestra.run.smithi155.stdout: "wanted": "-", 2020-05-18T21:38:17.449 INFO:teuthology.orchestra.run.smithi155.stdout: "last_sent": 1 2020-05-18T21:38:17.449 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:17.449 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.449 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:17.450 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:17.450 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:17.450 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:17.450 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.450 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.450 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1099511627777, 2020-05-18T21:38:17.451 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:17.451 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:07.162519+0000", 2020-05-18T21:38:17.451 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:38:07.153991+0000", 2020-05-18T21:38:17.451 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 33188, 2020-05-18T21:38:17.451 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:17.452 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:17.452 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:17.452 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:17.452 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 0, 2020-05-18T21:38:17.452 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:17.452 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:17.453 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:17.453 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.453 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:17.453 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:38:17.453 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:38:17.454 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:38:17.454 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 30, 2020-05-18T21:38:17.454 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:17.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.454 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:17.454 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 7, 2020-05-18T21:38:17.455 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 1, 2020-05-18T21:38:17.455 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:17.455 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:17.455 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:17.455 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.162519+0000", 2020-05-18T21:38:17.456 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "2020-05-18T21:38:07.153991+0000", 2020-05-18T21:38:17.456 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:17.456 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:38:17.456 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:17.456 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:17.456 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:17.457 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.457 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:17.457 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:17.457 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:17.457 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:17.458 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.458 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:17.458 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.458 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.458 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.458 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.459 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.459 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.162519+0000" 2020-05-18T21:38:17.459 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.459 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:17.459 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.460 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.460 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.460 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.460 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.460 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.162519+0000" 2020-05-18T21:38:17.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.461 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 22, 2020-05-18T21:38:17.461 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:17.461 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:17.461 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 2, 2020-05-18T21:38:17.461 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:17.462 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:17.462 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:17.462 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:17.462 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:17.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.462 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:17.463 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:17.463 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:17.463 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:17.463 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:17.463 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:17.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.464 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:17.464 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:17.464 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:17.464 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.464 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.465 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.465 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.465 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.465 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.466 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.466 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.466 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.466 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.466 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.466 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.467 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.467 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.467 INFO:teuthology.orchestra.run.smithi155.stdout: "importingcaps": 0, 2020-05-18T21:38:17.467 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1, 2020-05-18T21:38:17.467 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent": 1, 2020-05-18T21:38:17.468 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.468 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.468 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.468 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:17.468 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.468 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.469 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.469 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.469 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.469 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.469 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.470 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.470 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.470 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:17.470 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:17.470 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:17.470 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:17.471 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:17.471 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:17.471 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:38:17.471 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.471 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:38:17.472 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.472 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.472 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.472 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.472 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.473 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:17.473 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:17.473 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.473 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.473 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:17.474 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent", 2020-05-18T21:38:17.474 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtypool" 2020-05-18T21:38:17.474 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.474 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [ 2020-05-18T21:38:17.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.474 INFO:teuthology.orchestra.run.smithi155.stdout: "client_id": 7277, 2020-05-18T21:38:17.475 INFO:teuthology.orchestra.run.smithi155.stdout: "pending": "pAsLsXsFsc", 2020-05-18T21:38:17.475 INFO:teuthology.orchestra.run.smithi155.stdout: "issued": "pAsLsXsFsc", 2020-05-18T21:38:17.475 INFO:teuthology.orchestra.run.smithi155.stdout: "wanted": "-", 2020-05-18T21:38:17.475 INFO:teuthology.orchestra.run.smithi155.stdout: "last_sent": 1 2020-05-18T21:38:17.475 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:17.476 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.476 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:17.476 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:17.476 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:17.476 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:17.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.477 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.477 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1099511628283, 2020-05-18T21:38:17.477 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:17.477 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:07.180027+0000", 2020-05-18T21:38:17.477 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:38:07.177977+0000", 2020-05-18T21:38:17.478 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 33188, 2020-05-18T21:38:17.478 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:17.478 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:17.478 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:17.478 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:17.478 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 0, 2020-05-18T21:38:17.479 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:17.479 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:17.479 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:17.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.479 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:17.480 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:38:17.480 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:38:17.480 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:38:17.480 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 30, 2020-05-18T21:38:17.480 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:17.480 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.481 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:17.481 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 7, 2020-05-18T21:38:17.481 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 1, 2020-05-18T21:38:17.481 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:17.481 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:17.482 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:17.482 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.180027+0000", 2020-05-18T21:38:17.482 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "2020-05-18T21:38:07.177977+0000", 2020-05-18T21:38:17.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:17.482 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:38:17.483 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:17.483 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:17.483 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:17.483 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.483 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:17.484 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:17.484 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:17.484 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:17.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.484 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:17.484 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.485 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.485 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.485 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.485 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.485 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.180027+0000" 2020-05-18T21:38:17.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.486 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:17.486 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.486 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.486 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.487 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.487 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.487 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.180027+0000" 2020-05-18T21:38:17.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.487 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 34, 2020-05-18T21:38:17.487 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:17.488 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:17.488 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 14, 2020-05-18T21:38:17.488 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:17.488 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:17.488 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:17.489 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:17.489 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:17.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.489 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:17.489 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:17.489 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:17.490 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:17.490 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:17.490 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:17.490 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.490 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:17.491 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:17.491 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:17.491 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.491 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.491 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.492 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.492 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.492 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.492 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.492 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.493 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.493 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.493 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.493 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.494 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.494 INFO:teuthology.orchestra.run.smithi155.stdout: "importingcaps": 0, 2020-05-18T21:38:17.494 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1, 2020-05-18T21:38:17.494 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent": 1, 2020-05-18T21:38:17.494 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.494 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.495 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:17.495 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.495 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.495 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.496 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.496 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.496 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.496 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.496 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.496 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.497 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:17.497 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:17.497 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:17.497 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:17.497 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:17.498 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:17.498 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:38:17.498 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.498 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:38:17.498 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.498 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.499 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.499 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.499 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.499 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.499 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:17.500 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:17.500 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.500 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.500 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:17.500 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent", 2020-05-18T21:38:17.500 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtypool" 2020-05-18T21:38:17.501 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.501 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [ 2020-05-18T21:38:17.501 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.501 INFO:teuthology.orchestra.run.smithi155.stdout: "client_id": 7277, 2020-05-18T21:38:17.501 INFO:teuthology.orchestra.run.smithi155.stdout: "pending": "pAsLsXsFsc", 2020-05-18T21:38:17.502 INFO:teuthology.orchestra.run.smithi155.stdout: "issued": "pAsLsXsFsc", 2020-05-18T21:38:17.502 INFO:teuthology.orchestra.run.smithi155.stdout: "wanted": "-", 2020-05-18T21:38:17.502 INFO:teuthology.orchestra.run.smithi155.stdout: "last_sent": 1 2020-05-18T21:38:17.502 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:17.502 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.502 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:17.503 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:17.503 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:17.503 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:17.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.503 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.504 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1099511628282, 2020-05-18T21:38:17.504 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:17.504 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:07.177141+0000", 2020-05-18T21:38:17.504 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:38:07.175260+0000", 2020-05-18T21:38:17.504 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 33188, 2020-05-18T21:38:17.504 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:17.505 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:17.505 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:17.505 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:17.505 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 0, 2020-05-18T21:38:17.505 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:17.506 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:17.506 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:17.506 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.506 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:17.506 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:38:17.506 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:38:17.507 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:38:17.507 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 30, 2020-05-18T21:38:17.507 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:17.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.507 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:17.508 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 7, 2020-05-18T21:38:17.508 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 1, 2020-05-18T21:38:17.508 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:17.508 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:17.508 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:17.508 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.177141+0000", 2020-05-18T21:38:17.509 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "2020-05-18T21:38:07.175260+0000", 2020-05-18T21:38:17.509 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:17.509 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:38:17.509 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:17.509 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:17.510 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:17.510 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.510 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:17.510 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:17.510 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:17.510 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:17.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.511 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:17.511 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.511 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.511 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.512 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.512 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.512 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.177141+0000" 2020-05-18T21:38:17.512 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.512 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:17.512 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.513 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.513 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.513 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.513 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.513 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.177141+0000" 2020-05-18T21:38:17.514 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.514 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 32, 2020-05-18T21:38:17.514 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:17.514 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:17.514 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 12, 2020-05-18T21:38:17.514 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:17.515 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:17.515 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:17.515 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:17.515 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:17.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.516 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:17.516 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:17.516 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:17.516 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:17.516 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:17.516 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:17.517 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.517 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:17.517 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:17.517 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:17.517 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.518 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.518 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.518 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.518 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.518 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.518 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.519 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.519 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.519 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.519 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.519 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.520 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.520 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.520 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.520 INFO:teuthology.orchestra.run.smithi155.stdout: "importingcaps": 0, 2020-05-18T21:38:17.520 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1, 2020-05-18T21:38:17.520 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent": 1, 2020-05-18T21:38:17.521 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.521 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.521 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.521 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:17.521 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.522 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.522 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.522 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.522 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.523 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.523 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.523 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.523 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:17.524 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:17.524 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:17.524 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:17.524 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:17.524 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:17.525 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:38:17.525 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.525 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:38:17.525 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.525 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.526 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.526 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.526 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.526 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.526 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:17.526 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:17.527 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.527 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.527 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:17.527 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent", 2020-05-18T21:38:17.527 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtypool" 2020-05-18T21:38:17.528 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.528 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [ 2020-05-18T21:38:17.528 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.528 INFO:teuthology.orchestra.run.smithi155.stdout: "client_id": 7277, 2020-05-18T21:38:17.528 INFO:teuthology.orchestra.run.smithi155.stdout: "pending": "pAsLsXsFsc", 2020-05-18T21:38:17.528 INFO:teuthology.orchestra.run.smithi155.stdout: "issued": "pAsLsXsFsc", 2020-05-18T21:38:17.529 INFO:teuthology.orchestra.run.smithi155.stdout: "wanted": "-", 2020-05-18T21:38:17.529 INFO:teuthology.orchestra.run.smithi155.stdout: "last_sent": 1 2020-05-18T21:38:17.529 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:17.529 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.529 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:17.530 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:17.530 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:17.530 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:17.530 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.530 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.530 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1099511628281, 2020-05-18T21:38:17.531 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:17.531 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:07.174698+0000", 2020-05-18T21:38:17.531 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:38:07.173065+0000", 2020-05-18T21:38:17.531 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 33188, 2020-05-18T21:38:17.531 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:17.532 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:17.532 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:17.532 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:17.532 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 0, 2020-05-18T21:38:17.532 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:17.532 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:17.533 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:17.533 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.533 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:17.533 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:38:17.533 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:38:17.534 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:38:17.534 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 30, 2020-05-18T21:38:17.534 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:17.534 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.534 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:17.534 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 7, 2020-05-18T21:38:17.535 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 1, 2020-05-18T21:38:17.535 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:17.535 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:17.535 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:17.535 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.174698+0000", 2020-05-18T21:38:17.536 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "2020-05-18T21:38:07.173065+0000", 2020-05-18T21:38:17.536 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:17.536 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:38:17.536 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:17.536 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:17.536 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:17.537 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.537 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:17.537 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:17.537 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:17.537 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:17.538 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.538 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:17.538 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.538 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.538 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.538 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.539 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.539 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.174698+0000" 2020-05-18T21:38:17.539 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.539 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:17.539 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.539 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.540 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.540 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.540 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.540 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.174698+0000" 2020-05-18T21:38:17.540 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.541 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 30, 2020-05-18T21:38:17.541 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:17.541 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:17.541 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 10, 2020-05-18T21:38:17.541 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:17.542 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:17.542 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:17.542 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:17.542 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:17.542 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.542 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:17.543 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:17.543 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:17.543 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:17.543 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:17.543 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:17.544 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.544 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:17.544 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:17.544 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:17.544 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.544 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.545 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.545 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.545 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.545 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.545 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.546 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.546 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.546 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.546 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.546 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.546 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.547 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.547 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.547 INFO:teuthology.orchestra.run.smithi155.stdout: "importingcaps": 0, 2020-05-18T21:38:17.547 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1, 2020-05-18T21:38:17.547 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent": 1, 2020-05-18T21:38:17.548 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.548 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.548 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.548 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:17.548 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.548 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.549 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.549 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.549 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.549 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.549 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.550 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.550 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.550 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:17.550 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:17.550 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:17.550 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:17.551 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:17.551 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:17.551 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:38:17.551 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.551 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:38:17.552 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.552 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.552 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.552 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.552 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.552 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.553 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:17.553 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:17.553 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.553 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.553 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:17.554 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent", 2020-05-18T21:38:17.554 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtypool" 2020-05-18T21:38:17.554 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.554 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [ 2020-05-18T21:38:17.554 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.554 INFO:teuthology.orchestra.run.smithi155.stdout: "client_id": 7277, 2020-05-18T21:38:17.555 INFO:teuthology.orchestra.run.smithi155.stdout: "pending": "pAsLsXsFsc", 2020-05-18T21:38:17.555 INFO:teuthology.orchestra.run.smithi155.stdout: "issued": "pAsLsXsFsc", 2020-05-18T21:38:17.555 INFO:teuthology.orchestra.run.smithi155.stdout: "wanted": "-", 2020-05-18T21:38:17.555 INFO:teuthology.orchestra.run.smithi155.stdout: "last_sent": 1 2020-05-18T21:38:17.555 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:17.556 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.556 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:17.556 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:17.556 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:17.556 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:17.556 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.557 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.557 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1099511628278, 2020-05-18T21:38:17.557 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:17.557 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:07.166162+0000", 2020-05-18T21:38:17.557 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:38:07.163718+0000", 2020-05-18T21:38:17.558 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 33188, 2020-05-18T21:38:17.558 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:17.558 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:17.558 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:17.558 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:17.558 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 0, 2020-05-18T21:38:17.559 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:17.559 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:17.559 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:17.559 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.559 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:17.560 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:38:17.560 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:38:17.560 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:38:17.560 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 30, 2020-05-18T21:38:17.560 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:17.560 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.561 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:17.561 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 7, 2020-05-18T21:38:17.561 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 1, 2020-05-18T21:38:17.561 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:17.561 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:17.562 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:17.562 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.166162+0000", 2020-05-18T21:38:17.562 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "2020-05-18T21:38:07.163718+0000", 2020-05-18T21:38:17.562 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:17.562 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:38:17.562 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:17.563 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:17.563 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:17.563 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.563 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:17.563 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:17.563 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:17.564 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:17.564 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.564 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:17.564 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.564 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.565 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.565 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.565 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.565 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.166162+0000" 2020-05-18T21:38:17.565 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.565 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:17.566 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.566 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.566 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.566 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.566 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.567 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.166162+0000" 2020-05-18T21:38:17.567 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.567 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 24, 2020-05-18T21:38:17.567 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:17.567 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:17.567 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 4, 2020-05-18T21:38:17.568 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:17.568 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:17.568 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:17.568 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:17.568 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:17.569 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.569 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:17.569 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:17.569 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:17.569 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:17.569 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:17.570 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:17.570 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.570 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:17.570 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:17.570 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:17.571 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.571 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.571 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.571 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.571 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.571 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.572 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.572 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.572 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.572 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.572 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.573 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.573 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.573 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.573 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.573 INFO:teuthology.orchestra.run.smithi155.stdout: "importingcaps": 0, 2020-05-18T21:38:17.573 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1, 2020-05-18T21:38:17.574 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent": 1, 2020-05-18T21:38:17.574 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.574 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.574 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.574 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:17.575 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.575 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.575 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.575 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.575 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.575 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.576 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.576 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.576 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.576 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:17.576 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:17.577 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:17.577 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:17.577 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:17.577 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:17.577 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:38:17.577 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.578 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:38:17.578 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.578 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.578 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.578 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.578 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.579 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.579 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:17.579 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:17.579 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.579 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.580 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:17.580 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent", 2020-05-18T21:38:17.580 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtypool" 2020-05-18T21:38:17.580 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.580 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [ 2020-05-18T21:38:17.580 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.581 INFO:teuthology.orchestra.run.smithi155.stdout: "client_id": 7277, 2020-05-18T21:38:17.581 INFO:teuthology.orchestra.run.smithi155.stdout: "pending": "pAsLsXsFsc", 2020-05-18T21:38:17.581 INFO:teuthology.orchestra.run.smithi155.stdout: "issued": "pAsLsXsFsc", 2020-05-18T21:38:17.581 INFO:teuthology.orchestra.run.smithi155.stdout: "wanted": "-", 2020-05-18T21:38:17.581 INFO:teuthology.orchestra.run.smithi155.stdout: "last_sent": 1 2020-05-18T21:38:17.582 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:17.582 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.582 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:17.582 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:17.582 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:17.583 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:17.583 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.583 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.583 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1099511627776, 2020-05-18T21:38:17.583 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:17.584 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:07.667894+0000", 2020-05-18T21:38:17.584 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:17.584 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16877, 2020-05-18T21:38:17.584 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:17.584 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:17.584 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:17.585 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:17.585 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:17.585 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:17.585 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:17.585 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:17.586 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.586 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:17.586 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:17.586 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:17.586 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:17.586 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:17.587 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:17.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.587 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:17.587 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:17.587 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 1, 2020-05-18T21:38:17.588 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:17.588 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:17.588 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:17.588 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.186031+0000", 2020-05-18T21:38:17.588 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:17.588 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:17.589 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 11, 2020-05-18T21:38:17.589 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": 1, 2020-05-18T21:38:17.589 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:17.589 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:17.589 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.590 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.186031+0000", 2020-05-18T21:38:17.590 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 10, 2020-05-18T21:38:17.590 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:17.590 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 10 2020-05-18T21:38:17.590 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.590 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:17.591 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.591 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 70, 2020-05-18T21:38:17.591 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 10, 2020-05-18T21:38:17.591 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:17.591 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.592 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.667894+0000" 2020-05-18T21:38:17.592 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.592 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:17.592 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.592 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 70, 2020-05-18T21:38:17.592 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 10, 2020-05-18T21:38:17.593 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:17.593 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.593 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.667894+0000" 2020-05-18T21:38:17.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.593 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 44, 2020-05-18T21:38:17.594 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:17.594 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:17.594 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 2, 2020-05-18T21:38:17.594 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:17.594 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:17.594 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:17.595 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:17.595 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:17.595 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.595 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:17.595 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:17.595 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:17.596 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:17.596 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:17.596 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:17.596 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.596 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:17.597 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:17.597 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:17.597 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:38:17.597 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.597 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.597 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.598 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.598 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.598 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:38:17.598 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.598 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.599 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:38:17.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.599 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.599 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.599 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.599 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.600 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": 0, 2020-05-18T21:38:17.600 INFO:teuthology.orchestra.run.smithi155.stdout: "importing": 0, 2020-05-18T21:38:17.600 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1 2020-05-18T21:38:17.600 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.600 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:17.600 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.601 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.601 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.601 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.601 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.601 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.602 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.602 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.602 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.602 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:17.602 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:17.603 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:17.603 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": { 2020-05-18T21:38:17.603 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.603 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:38:17.603 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.604 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.604 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.604 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.604 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.604 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.604 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:17.605 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:17.605 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:38:17.605 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.605 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:38:17.605 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.606 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.606 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.606 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.606 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.606 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.606 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:17.607 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:17.607 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [], 2020-05-18T21:38:17.607 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:17.607 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:17.607 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:17.608 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:17.608 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:17.608 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.608 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "/delete_me", 2020-05-18T21:38:17.608 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x10000000000", 2020-05-18T21:38:17.608 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:17.609 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "41", 2020-05-18T21:38:17.609 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "41", 2020-05-18T21:38:17.609 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "0", 2020-05-18T21:38:17.609 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "0", 2020-05-18T21:38:17.609 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:17.610 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "1", 2020-05-18T21:38:17.610 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.610 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.610 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:17.610 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:17.610 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.611 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.611 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.611 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": { 2020-05-18T21:38:17.611 INFO:teuthology.orchestra.run.smithi155.stdout: "0": 1 2020-05-18T21:38:17.611 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:17.612 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.612 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.612 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.612 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.612 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.612 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.613 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.613 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.613 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.613 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.613 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.614 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.614 INFO:teuthology.orchestra.run.smithi155.stdout: "ptrwaiter": 0, 2020-05-18T21:38:17.614 INFO:teuthology.orchestra.run.smithi155.stdout: "child": 1, 2020-05-18T21:38:17.614 INFO:teuthology.orchestra.run.smithi155.stdout: "frozen": 0, 2020-05-18T21:38:17.614 INFO:teuthology.orchestra.run.smithi155.stdout: "subtree": 1, 2020-05-18T21:38:17.614 INFO:teuthology.orchestra.run.smithi155.stdout: "importing": 0, 2020-05-18T21:38:17.615 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 1, 2020-05-18T21:38:17.615 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.615 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 4, 2020-05-18T21:38:17.615 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [ 2020-05-18T21:38:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "delete_me/file_1", 2020-05-18T21:38:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 1, 2020-05-18T21:38:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:17.617 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:17.617 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:17.617 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:17.617 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1099511628278, 2020-05-18T21:38:17.617 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:17.617 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 24, 2020-05-18T21:38:17.618 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 24, 2020-05-18T21:38:17.618 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.618 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.618 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.618 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.619 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.619 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.619 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.619 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.619 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.620 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.620 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.620 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.620 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.620 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1, 2020-05-18T21:38:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:17.622 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:17.622 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.622 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.622 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.622 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.623 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.623 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.623 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.623 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.624 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.624 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.624 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.624 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty" 2020-05-18T21:38:17.624 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:17.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.625 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.625 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "delete_me/file_4", 2020-05-18T21:38:17.625 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 1, 2020-05-18T21:38:17.625 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:17.626 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:17.626 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:17.626 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:17.626 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:17.626 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:17.627 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1099511628281, 2020-05-18T21:38:17.627 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:17.627 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 30, 2020-05-18T21:38:17.627 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 30, 2020-05-18T21:38:17.627 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.627 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.628 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.628 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.628 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.628 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.628 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.629 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.629 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.629 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.629 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.629 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.629 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.630 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.630 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.630 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.630 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1, 2020-05-18T21:38:17.630 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.632 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.632 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.632 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.632 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.632 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.632 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.633 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.633 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.633 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.633 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty" 2020-05-18T21:38:17.633 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:17.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.634 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.634 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "delete_me/file_5", 2020-05-18T21:38:17.634 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 1, 2020-05-18T21:38:17.634 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:17.634 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:17.635 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:17.635 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:17.635 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:17.635 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:17.635 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1099511628282, 2020-05-18T21:38:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 32, 2020-05-18T21:38:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 32, 2020-05-18T21:38:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.637 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.637 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.637 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.637 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.637 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.639 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.639 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.639 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1, 2020-05-18T21:38:17.639 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.639 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.639 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.640 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:17.640 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:17.640 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.640 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.640 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.641 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.641 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.641 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.641 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.641 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.642 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.642 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.642 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty" 2020-05-18T21:38:17.642 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:17.642 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.643 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.643 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "delete_me/file_6", 2020-05-18T21:38:17.643 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 1, 2020-05-18T21:38:17.643 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:17.643 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:17.643 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:17.644 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:17.644 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:17.644 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:17.644 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1099511628283, 2020-05-18T21:38:17.644 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:17.645 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 34, 2020-05-18T21:38:17.645 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 34, 2020-05-18T21:38:17.645 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.645 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.645 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.645 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.646 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.646 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.646 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.646 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.646 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.647 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.647 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.647 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.647 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.647 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.648 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.648 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1, 2020-05-18T21:38:17.648 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.648 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.648 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.649 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:17.649 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:17.649 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.649 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.649 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.649 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.650 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.650 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.650 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.650 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.651 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.651 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.651 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty" 2020-05-18T21:38:17.651 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:17.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.652 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "delete_me/file_2", 2020-05-18T21:38:17.652 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 1, 2020-05-18T21:38:17.652 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:17.652 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:17.652 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:17.653 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:17.653 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:17.653 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:17.653 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1099511628279, 2020-05-18T21:38:17.653 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:17.653 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 26, 2020-05-18T21:38:17.654 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 26, 2020-05-18T21:38:17.654 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.654 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.654 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.654 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.655 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.655 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.655 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.655 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.655 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.655 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.656 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.656 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.656 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.656 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.656 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.656 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.657 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1, 2020-05-18T21:38:17.657 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.657 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.657 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.657 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:17.658 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:17.658 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.658 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.658 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.658 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.658 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.659 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.659 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.659 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.659 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.659 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.660 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.660 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty" 2020-05-18T21:38:17.660 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:17.660 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.660 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.660 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "delete_me/file_0", 2020-05-18T21:38:17.661 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 1, 2020-05-18T21:38:17.661 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:17.661 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:17.661 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:17.661 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:17.662 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:17.662 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:17.662 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1099511627777, 2020-05-18T21:38:17.662 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:17.662 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 22, 2020-05-18T21:38:17.662 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 22, 2020-05-18T21:38:17.663 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.663 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.663 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.663 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.663 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.664 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.664 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.664 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.664 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.664 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.664 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.665 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.665 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.665 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.665 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.665 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.666 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1, 2020-05-18T21:38:17.666 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.666 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.666 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.666 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:17.666 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.668 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.668 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.668 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.668 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.668 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.669 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty" 2020-05-18T21:38:17.669 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:17.669 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.669 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.669 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "delete_me/file_3", 2020-05-18T21:38:17.669 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 1, 2020-05-18T21:38:17.670 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:17.670 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:17.670 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:17.670 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:17.670 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:17.671 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:17.671 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1099511628280, 2020-05-18T21:38:17.671 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:17.671 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 28, 2020-05-18T21:38:17.671 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 28, 2020-05-18T21:38:17.671 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.673 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.673 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.673 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.673 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.673 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.674 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.674 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.674 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.674 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.674 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1, 2020-05-18T21:38:17.674 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.675 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.675 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.675 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:17.675 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:17.675 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.676 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.676 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.676 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.676 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.676 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.676 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.677 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.677 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.677 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.677 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.677 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty" 2020-05-18T21:38:17.678 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:17.678 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.678 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.678 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "delete_me/file_9", 2020-05-18T21:38:17.678 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 1, 2020-05-18T21:38:17.678 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:17.679 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:17.679 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:17.679 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:17.679 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:17.679 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:17.679 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1099511628286, 2020-05-18T21:38:17.680 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:17.680 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 40, 2020-05-18T21:38:17.680 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 40, 2020-05-18T21:38:17.680 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.680 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.681 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.681 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.681 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.681 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.681 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.682 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.682 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.682 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.682 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.682 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.683 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.683 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.683 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.683 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1, 2020-05-18T21:38:17.683 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.684 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.684 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:17.684 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:17.684 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.685 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.685 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.685 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.685 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.685 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.686 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.686 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.686 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.686 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.686 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.686 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty" 2020-05-18T21:38:17.687 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:17.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.687 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.687 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "delete_me/file_8", 2020-05-18T21:38:17.687 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 1, 2020-05-18T21:38:17.688 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:17.688 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:17.688 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:17.688 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:17.688 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:17.688 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:17.689 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1099511628285, 2020-05-18T21:38:17.689 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:17.689 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 38, 2020-05-18T21:38:17.689 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 38, 2020-05-18T21:38:17.689 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.690 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.690 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.690 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.690 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.690 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.691 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.691 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.691 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.691 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.691 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.691 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.692 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.692 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.692 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.692 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1, 2020-05-18T21:38:17.692 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.693 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.693 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:17.693 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:17.693 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.693 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.694 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.694 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.694 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.694 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.694 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.695 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.695 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.695 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.695 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.695 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty" 2020-05-18T21:38:17.695 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:17.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.696 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.696 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "delete_me/file_7", 2020-05-18T21:38:17.696 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 1, 2020-05-18T21:38:17.696 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:17.697 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:17.697 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:17.697 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:17.697 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:17.697 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:17.697 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1099511628284, 2020-05-18T21:38:17.698 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:17.698 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 36, 2020-05-18T21:38:17.698 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 36, 2020-05-18T21:38:17.698 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.698 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.699 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.699 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.699 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.699 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.699 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.699 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.700 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.700 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.700 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.700 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.700 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.701 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.701 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.701 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1, 2020-05-18T21:38:17.701 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.701 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.702 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:17.702 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:17.702 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.702 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.702 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.703 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.703 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.703 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.703 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.703 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.704 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.704 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.704 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.704 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty" 2020-05-18T21:38:17.704 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:17.704 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:17.705 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:17.705 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:17.705 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:17.705 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.705 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.706 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 3, 2020-05-18T21:38:17.706 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:17.706 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:17.706 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:17.706 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16877, 2020-05-18T21:38:17.706 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:17.707 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:17.707 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:17.707 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:17.707 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:17.707 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:17.707 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:17.708 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:17.708 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.708 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:17.708 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:17.708 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:17.709 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:17.709 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:17.709 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:17.709 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.709 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:17.709 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:17.710 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:17.710 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:17.710 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:17.710 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:17.710 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:01.329092+0000", 2020-05-18T21:38:17.711 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:17.711 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:17.711 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:17.711 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:17.711 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:17.711 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:17.712 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.712 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:17.712 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:17.712 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:17.712 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:17.713 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.713 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:17.713 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.713 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:17.713 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:17.713 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:17.714 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.714 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:01.329092+0000" 2020-05-18T21:38:17.714 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.714 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:17.714 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.715 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:17.715 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:17.715 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:17.715 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.715 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:01.329092+0000" 2020-05-18T21:38:17.715 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.716 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:17.716 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:17.716 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:17.716 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:17.716 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:17.716 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:17.717 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:17.717 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:17.717 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:17.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.717 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:17.718 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:17.718 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:17.718 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:17.718 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:17.718 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:17.718 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.719 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:17.719 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:17.719 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:17.719 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.719 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.720 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.720 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.720 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.720 INFO:teuthology.orchestra.run.smithi155.stdout: -2, 2020-05-18T21:38:17.720 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.721 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.721 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.721 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.721 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.721 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.722 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.722 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.722 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:38:17.722 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.722 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 0, 2020-05-18T21:38:17.722 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.723 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.723 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.723 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.723 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.723 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.724 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.724 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.724 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.724 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:17.725 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:17.725 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:17.725 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:17.725 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:17.725 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:17.726 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:17.726 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:17.726 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:17.726 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.726 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:17.727 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.727 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:17.727 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:17.727 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:17.727 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:17.728 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:17.728 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.728 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.728 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1555, 2020-05-18T21:38:17.728 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:17.728 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:17.729 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:17.729 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:17.729 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:17.729 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:17.729 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:17.730 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:17.730 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:17.730 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:17.730 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:17.730 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:17.730 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.731 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:17.731 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:17.731 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:17.731 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:17.731 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:17.732 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:17.732 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.732 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:17.732 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:17.732 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:17.732 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:17.733 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:17.733 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:17.733 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088993+0000", 2020-05-18T21:38:17.733 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:17.733 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:17.734 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:17.734 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:17.734 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:17.734 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:17.734 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.735 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:17.735 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:17.735 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:17.735 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:17.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.735 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:17.736 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.736 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:17.736 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:17.736 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:17.736 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.737 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:17.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.737 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:17.737 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.737 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:17.737 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:17.738 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:17.738 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.738 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:17.738 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.738 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:17.739 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:17.739 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:17.739 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:17.739 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:17.739 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:17.739 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:17.740 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:17.740 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:17.740 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.740 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:17.740 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:17.741 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:17.741 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:17.741 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:17.741 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:17.741 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.741 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:17.742 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:17.742 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:17.742 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.742 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.742 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.743 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.743 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.743 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.743 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.743 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.743 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.744 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.744 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.744 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.744 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.744 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.745 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.745 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:17.745 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:17.745 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:17.745 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.745 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:17.746 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.746 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.746 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.746 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.746 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.747 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.747 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.747 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.747 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.747 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:17.748 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:17.749 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:17.749 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:17.749 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:17.749 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:17.750 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:17.750 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:17.750 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:17.750 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.750 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.751 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:17.751 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.751 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:17.751 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:17.751 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:17.752 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:17.752 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:17.752 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.753 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray9", 2020-05-18T21:38:17.753 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x613", 2020-05-18T21:38:17.753 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:17.754 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:17.754 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:17.754 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:17.755 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:17.755 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:17.755 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:17.756 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.756 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.756 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:17.757 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:17.757 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.757 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.758 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.758 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.758 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.758 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.758 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.759 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.759 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.759 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.759 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.759 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.759 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.760 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.760 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.760 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.760 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:17.760 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:17.761 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:17.761 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:17.761 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.761 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:17.761 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:17.762 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:17.762 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:17.762 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.762 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.762 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1550, 2020-05-18T21:38:17.763 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:17.763 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:17.763 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:17.763 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:17.764 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:17.764 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:17.764 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:17.764 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:17.765 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:17.765 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:17.765 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:17.765 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:17.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.766 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:17.766 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:17.766 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:17.766 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:17.767 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:17.767 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:17.767 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.767 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:17.768 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:17.768 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:17.768 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:17.768 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:17.769 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:17.769 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087546+0000", 2020-05-18T21:38:17.769 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:17.769 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:17.769 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:17.770 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:17.770 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:17.770 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:17.770 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.770 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:17.771 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:17.771 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:17.771 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:17.771 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.771 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:17.771 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.772 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:17.772 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:17.772 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:17.772 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.772 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087546+0000" 2020-05-18T21:38:17.773 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.773 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:17.773 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.773 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:17.773 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:17.774 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:17.774 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.774 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087546+0000" 2020-05-18T21:38:17.774 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.774 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:17.775 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:17.775 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:17.775 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:17.775 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:17.776 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:17.776 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:17.776 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:17.776 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:17.776 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.777 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:17.777 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:17.778 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:17.778 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:17.779 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:17.779 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:17.779 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.779 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:17.779 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:17.780 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:17.780 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.780 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.780 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.780 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.780 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.781 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.781 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.781 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.781 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.781 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.782 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.782 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.782 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.782 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.782 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.782 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:17.783 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:17.783 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:17.783 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.783 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:17.783 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.784 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.784 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.784 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.784 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.784 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.784 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.785 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.785 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.785 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:17.785 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:17.785 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:17.786 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:17.786 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:17.786 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:17.786 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:17.786 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:17.786 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:17.787 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.787 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.787 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:17.787 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.787 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:17.788 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:17.788 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:17.788 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:17.788 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:17.788 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.788 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray4", 2020-05-18T21:38:17.789 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60e", 2020-05-18T21:38:17.789 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:17.789 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:17.789 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:17.789 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:17.790 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:17.790 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:17.790 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:17.790 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.790 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.791 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:17.791 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:17.791 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.791 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.791 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.791 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.792 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.792 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.792 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.792 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.792 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.793 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.793 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.793 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.793 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.793 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.793 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.794 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.794 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:17.794 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:17.794 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:17.794 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:17.795 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.795 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:17.795 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:17.795 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:17.795 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:17.795 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.796 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.796 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1554, 2020-05-18T21:38:17.796 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:17.796 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:17.796 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:17.797 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:17.797 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:17.797 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:17.797 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:17.797 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:17.798 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:17.798 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:17.798 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:17.798 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:17.798 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.798 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:17.799 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:17.799 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:17.799 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:17.799 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:17.799 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:17.800 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.800 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:17.800 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:17.800 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:17.800 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:17.800 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:17.801 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:17.801 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088676+0000", 2020-05-18T21:38:17.801 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:17.801 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:17.801 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:17.802 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:17.802 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:17.802 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:17.802 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.802 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:17.802 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:17.803 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:17.803 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:17.803 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.803 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:17.804 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.804 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:17.804 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:17.804 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:17.804 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.804 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088676+0000" 2020-05-18T21:38:17.805 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.805 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:17.805 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.805 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:17.805 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:17.806 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:17.806 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.806 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088676+0000" 2020-05-18T21:38:17.806 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.806 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:17.807 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:17.807 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:17.807 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:17.807 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:17.807 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:17.807 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:17.808 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:17.808 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:17.808 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.808 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:17.808 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:17.809 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:17.809 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:17.809 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:17.809 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:17.809 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.809 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:17.810 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:17.810 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:17.810 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.810 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.810 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.811 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.811 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.811 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.811 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.811 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.811 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.812 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.812 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.812 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.812 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.812 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.813 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.813 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:17.813 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:17.813 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:17.813 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.813 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:17.814 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.814 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.814 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.814 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.814 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.815 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.815 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.815 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.815 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.815 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:17.815 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:17.816 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:17.816 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:17.816 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:17.816 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:17.816 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:17.817 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:17.817 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:17.817 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.817 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.818 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:17.818 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.818 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:17.818 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:17.818 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:17.819 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:17.819 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:17.819 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.819 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray8", 2020-05-18T21:38:17.819 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x612", 2020-05-18T21:38:17.819 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:17.820 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:17.820 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:17.820 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:17.820 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:17.820 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:17.821 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:17.821 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.821 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.821 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:17.821 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:17.821 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.822 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.822 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.822 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.822 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.822 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.823 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.823 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.823 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.823 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.823 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.824 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.824 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.824 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.824 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.824 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.824 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:17.825 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:17.825 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:17.825 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:17.825 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.825 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:17.826 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:17.826 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:17.826 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:17.826 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.826 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.826 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1099511628279, 2020-05-18T21:38:17.827 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:17.827 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:07.169818+0000", 2020-05-18T21:38:17.827 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:38:07.167082+0000", 2020-05-18T21:38:17.827 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 33188, 2020-05-18T21:38:17.827 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:17.828 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:17.828 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:17.828 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:17.828 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 0, 2020-05-18T21:38:17.828 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:17.828 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:17.829 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:17.829 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.829 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:17.829 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:38:17.829 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:38:17.830 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:38:17.830 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 30, 2020-05-18T21:38:17.830 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:17.830 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.830 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:17.830 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 7, 2020-05-18T21:38:17.831 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 1, 2020-05-18T21:38:17.831 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:17.831 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:17.831 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:17.831 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.169818+0000", 2020-05-18T21:38:17.832 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "2020-05-18T21:38:07.167082+0000", 2020-05-18T21:38:17.832 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:17.832 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:38:17.832 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:17.832 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:17.832 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:17.833 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.833 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:17.833 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:17.833 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:17.833 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:17.834 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.834 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:17.834 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.834 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.834 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.834 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.835 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.835 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.169818+0000" 2020-05-18T21:38:17.835 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.835 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:17.835 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.835 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.836 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.836 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.836 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.836 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.169818+0000" 2020-05-18T21:38:17.836 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.837 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 26, 2020-05-18T21:38:17.837 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:17.837 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:17.837 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 6, 2020-05-18T21:38:17.837 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:17.837 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:17.838 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:17.838 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:17.838 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:17.838 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.838 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:17.839 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:17.839 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:17.839 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:17.839 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:17.839 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:17.839 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.840 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:17.840 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:17.840 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:17.840 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.840 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.841 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.841 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.841 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.841 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.841 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.841 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.842 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.842 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.842 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.842 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.842 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.843 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.843 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.843 INFO:teuthology.orchestra.run.smithi155.stdout: "importingcaps": 0, 2020-05-18T21:38:17.843 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1, 2020-05-18T21:38:17.843 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent": 1, 2020-05-18T21:38:17.843 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.844 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.844 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.844 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:17.844 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.844 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.844 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.845 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.845 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.845 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.845 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.845 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.846 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.846 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:17.846 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:17.846 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:17.846 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:17.847 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:17.847 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:17.847 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:38:17.847 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.847 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:38:17.847 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.848 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.848 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.848 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.848 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.848 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.849 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:17.849 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:17.849 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.849 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.849 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:17.849 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent", 2020-05-18T21:38:17.850 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtypool" 2020-05-18T21:38:17.850 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.850 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [ 2020-05-18T21:38:17.850 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.850 INFO:teuthology.orchestra.run.smithi155.stdout: "client_id": 7277, 2020-05-18T21:38:17.851 INFO:teuthology.orchestra.run.smithi155.stdout: "pending": "pAsLsXsFsc", 2020-05-18T21:38:17.851 INFO:teuthology.orchestra.run.smithi155.stdout: "issued": "pAsLsXsFsc", 2020-05-18T21:38:17.851 INFO:teuthology.orchestra.run.smithi155.stdout: "wanted": "-", 2020-05-18T21:38:17.851 INFO:teuthology.orchestra.run.smithi155.stdout: "last_sent": 1 2020-05-18T21:38:17.851 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:17.851 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.852 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:17.852 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:17.852 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:17.852 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:17.852 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.852 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.853 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1553, 2020-05-18T21:38:17.853 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:17.853 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:17.853 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:17.853 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:17.854 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:17.854 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:17.854 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:17.854 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:17.855 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:17.855 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:17.855 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:17.855 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:17.855 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.856 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:17.856 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:17.856 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:17.856 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:17.856 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:17.857 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:17.857 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.857 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:17.857 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:17.857 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:17.857 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:17.858 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:17.858 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:17.858 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088498+0000", 2020-05-18T21:38:17.858 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:17.858 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:17.859 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:17.859 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:17.859 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:17.859 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:17.859 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.859 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:17.860 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:17.860 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:17.860 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:17.860 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.860 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:17.861 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.861 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:17.861 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:17.861 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:17.861 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.861 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088498+0000" 2020-05-18T21:38:17.862 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.862 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:17.862 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.862 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:17.862 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:17.863 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:17.863 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.863 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088498+0000" 2020-05-18T21:38:17.863 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.863 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:17.863 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:17.864 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:17.864 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:17.864 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:17.864 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:17.864 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:17.864 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:17.865 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:17.865 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.865 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:17.865 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:17.865 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:17.866 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:17.866 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:17.866 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:17.866 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.866 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:17.867 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:17.867 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:17.867 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.867 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.868 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.868 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.868 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.868 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.868 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.868 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.869 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.869 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.869 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.869 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.869 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.870 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.870 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.870 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:17.870 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:17.871 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:17.871 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.871 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:17.871 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.871 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.871 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.872 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.872 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.872 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.872 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.872 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.873 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.873 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:17.873 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:17.873 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:17.873 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:17.873 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:17.874 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:17.874 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:17.874 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:17.874 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:17.874 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.875 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.875 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:17.875 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.875 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:17.875 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:17.875 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:17.876 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:17.876 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:17.876 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.876 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray7", 2020-05-18T21:38:17.876 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x611", 2020-05-18T21:38:17.876 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:17.877 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:17.877 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:17.877 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:17.877 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:17.877 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:17.878 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:17.878 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.878 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.878 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:17.879 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:17.879 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.879 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.879 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.879 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.880 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.880 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.880 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.880 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.881 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.881 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.881 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.881 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.881 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.881 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.882 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.882 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:17.882 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:17.882 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:17.882 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:17.883 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.883 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:17.883 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:17.883 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:17.883 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:17.883 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.884 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.884 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1099511628284, 2020-05-18T21:38:17.884 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:17.884 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:07.182489+0000", 2020-05-18T21:38:17.884 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:38:07.180865+0000", 2020-05-18T21:38:17.885 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 33188, 2020-05-18T21:38:17.885 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:17.885 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:17.885 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:17.885 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:17.885 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 0, 2020-05-18T21:38:17.886 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:17.886 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:17.886 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:17.886 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.886 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:17.886 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:38:17.887 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:38:17.887 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:38:17.887 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 30, 2020-05-18T21:38:17.887 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:17.887 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.888 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:17.888 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 7, 2020-05-18T21:38:17.888 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 1, 2020-05-18T21:38:17.888 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:17.888 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:17.888 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:17.889 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.182489+0000", 2020-05-18T21:38:17.889 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "2020-05-18T21:38:07.180865+0000", 2020-05-18T21:38:17.889 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:17.889 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:38:17.889 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:17.890 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:17.890 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:17.890 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.890 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:17.890 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:17.890 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:17.891 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:17.891 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.891 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:17.891 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.891 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.892 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.892 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.892 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.892 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.182489+0000" 2020-05-18T21:38:17.892 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.892 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:17.893 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.893 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 7, 2020-05-18T21:38:17.893 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 1, 2020-05-18T21:38:17.893 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 0, 2020-05-18T21:38:17.893 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.894 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.182489+0000" 2020-05-18T21:38:17.894 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.894 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 36, 2020-05-18T21:38:17.894 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:17.894 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:17.894 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 16, 2020-05-18T21:38:17.895 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:17.895 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:17.895 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:17.895 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:17.895 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:17.895 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.896 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:17.896 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:17.896 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:17.896 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:17.896 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:17.897 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:17.897 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.897 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:17.897 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:17.897 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:17.897 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.898 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.898 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.898 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.898 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.899 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.899 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.899 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.899 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.899 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.899 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.900 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.900 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.900 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.900 INFO:teuthology.orchestra.run.smithi155.stdout: "importingcaps": 0, 2020-05-18T21:38:17.900 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1, 2020-05-18T21:38:17.900 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent": 1, 2020-05-18T21:38:17.901 INFO:teuthology.orchestra.run.smithi155.stdout: "replicated": 0, 2020-05-18T21:38:17.901 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1 2020-05-18T21:38:17.901 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.901 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:17.901 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.902 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.902 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.902 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.902 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.902 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.903 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.903 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.903 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.903 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:17.903 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:17.904 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:17.904 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:17.904 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:17.904 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:17.904 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:38:17.905 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.905 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:38:17.905 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.905 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.905 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.905 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.906 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.906 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:17.906 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:17.906 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.906 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.907 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:17.907 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtyparent", 2020-05-18T21:38:17.907 INFO:teuthology.orchestra.run.smithi155.stdout: "dirtypool" 2020-05-18T21:38:17.907 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.907 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [ 2020-05-18T21:38:17.908 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.908 INFO:teuthology.orchestra.run.smithi155.stdout: "client_id": 7277, 2020-05-18T21:38:17.908 INFO:teuthology.orchestra.run.smithi155.stdout: "pending": "pAsLsXsFsc", 2020-05-18T21:38:17.908 INFO:teuthology.orchestra.run.smithi155.stdout: "issued": "pAsLsXsFsc", 2020-05-18T21:38:17.908 INFO:teuthology.orchestra.run.smithi155.stdout: "wanted": "-", 2020-05-18T21:38:17.908 INFO:teuthology.orchestra.run.smithi155.stdout: "last_sent": 1 2020-05-18T21:38:17.909 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:17.909 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.909 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:17.909 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:17.909 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:17.910 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [] 2020-05-18T21:38:17.910 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.910 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.910 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1552, 2020-05-18T21:38:17.910 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:17.910 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:17.911 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:17.911 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:17.911 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:17.911 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:17.911 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:17.912 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:17.912 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:17.912 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:17.912 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:17.912 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:17.912 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.913 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:17.913 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:17.913 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:17.913 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:17.913 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:17.914 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:17.914 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.914 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:17.914 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:17.914 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:17.914 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:17.915 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:17.915 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:17.915 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.088334+0000", 2020-05-18T21:38:17.915 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:17.915 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:17.916 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:17.916 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:17.916 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:17.916 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:17.916 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.916 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088334+0000" 2020-05-18T21:38:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.920 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:17.920 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:17.920 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:17.920 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.920 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088334+0000" 2020-05-18T21:38:17.920 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.921 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:17.921 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:17.921 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:17.921 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:17.921 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:17.922 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:17.922 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:17.922 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:17.922 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:17.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.922 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:17.923 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:17.923 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:17.923 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:17.923 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:17.923 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:17.924 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.924 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:17.924 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:17.924 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:17.924 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.924 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.925 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.925 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.925 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.925 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.925 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.925 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.926 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.926 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.926 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.926 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.926 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.927 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.927 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.927 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:17.927 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:17.927 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:17.927 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.928 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:17.928 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.928 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.928 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.928 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.929 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.929 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.929 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.929 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.929 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.929 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:17.930 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:17.930 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:17.930 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:17.930 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:17.930 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:17.930 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:17.931 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:17.931 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:17.931 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.931 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.931 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:17.932 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.932 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:17.932 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:17.932 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:17.932 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:17.932 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:17.933 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.933 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray6", 2020-05-18T21:38:17.933 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x610", 2020-05-18T21:38:17.933 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:17.933 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:17.934 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:17.934 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:17.934 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:17.934 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:17.934 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:17.934 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.935 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.935 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:17.935 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:17.935 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.935 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.936 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.936 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.936 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.936 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.936 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.937 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.937 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.937 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.937 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.937 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.938 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.938 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.938 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:17.938 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:17.938 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:17.939 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:17.939 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.939 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:17.939 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:17.939 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:17.939 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:17.940 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.940 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.940 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1551, 2020-05-18T21:38:17.940 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:17.940 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:17.941 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:17.941 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:17.941 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:17.941 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:17.941 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:17.941 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:17.942 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:17.942 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:17.942 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:17.942 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:17.942 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.942 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:17.943 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:17.943 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:17.943 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:17.943 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:17.943 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:17.944 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.944 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:17.944 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:17.944 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:17.944 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:17.944 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:17.945 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:17.945 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087783+0000", 2020-05-18T21:38:17.945 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:17.945 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:17.945 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:17.946 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:17.946 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:17.946 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:17.946 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.946 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:17.946 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:17.947 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:17.947 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:17.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.947 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:17.947 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.947 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:17.948 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:17.948 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:17.948 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.948 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087783+0000" 2020-05-18T21:38:17.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.949 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:17.949 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.949 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:17.949 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:17.949 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:17.950 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.950 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087783+0000" 2020-05-18T21:38:17.950 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.950 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:17.950 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:17.950 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:17.951 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:17.951 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:17.951 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:17.951 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:17.951 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:17.951 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:17.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.952 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:17.952 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:17.952 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:17.952 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:17.953 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:17.953 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:17.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.953 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:17.953 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:17.953 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:17.954 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.954 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.954 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.954 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.954 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.955 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.955 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.955 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.955 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.956 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.956 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.956 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.956 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.957 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.957 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:17.957 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:17.957 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:17.957 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.957 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:17.958 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.958 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.958 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.958 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.958 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.959 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.959 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.959 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.959 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.959 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:17.959 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:17.960 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:17.960 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:17.960 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:17.960 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:17.960 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:17.960 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:17.961 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:17.961 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.961 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.961 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:17.961 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.962 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:17.962 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:17.962 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:17.962 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:17.962 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:17.963 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.963 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray5", 2020-05-18T21:38:17.963 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60f", 2020-05-18T21:38:17.963 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:17.963 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:17.963 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:17.964 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:17.964 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:17.964 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:17.964 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:17.964 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.964 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.965 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:17.965 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:17.965 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.965 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.965 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.966 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.966 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.966 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.966 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.967 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.967 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.967 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.967 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.967 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.968 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.968 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.968 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:17.968 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:17.969 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:17.969 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:17.969 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.969 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:17.969 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:17.970 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:17.970 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:17.970 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.970 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.970 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1548, 2020-05-18T21:38:17.971 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:17.971 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:17.971 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:17.971 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:17.971 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:17.972 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:17.972 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:17.972 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:17.972 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:17.972 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:17.973 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:17.973 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:17.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.973 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:17.973 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:17.973 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:17.974 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:17.974 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:17.974 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:17.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.974 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:17.975 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:17.975 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:17.975 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:17.975 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:17.975 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:17.975 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087103+0000", 2020-05-18T21:38:17.976 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:17.976 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:17.976 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:17.976 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:17.976 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:17.976 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:17.977 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.977 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:17.977 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:17.977 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:17.977 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:17.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.978 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:17.978 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.978 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:17.978 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:17.978 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:17.979 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.979 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087103+0000" 2020-05-18T21:38:17.979 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.980 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:17.980 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:17.980 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:17.980 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:17.980 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:17.980 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:17.981 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087103+0000" 2020-05-18T21:38:17.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.981 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:17.981 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:17.981 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:17.982 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:17.982 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:17.982 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:17.982 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:17.982 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:17.982 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:17.983 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.983 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:17.983 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:17.983 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:17.983 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:17.983 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:17.984 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:17.984 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.984 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:17.984 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:17.984 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:17.985 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.985 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.985 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.985 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.985 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.986 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.986 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.986 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.986 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.987 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.987 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.987 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.987 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.987 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:17.987 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:17.988 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:17.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.988 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:17.988 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:17.988 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:17.989 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:17.989 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:17.989 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:17.989 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:17.989 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:17.989 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:17.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.990 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:17.990 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:17.990 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:17.990 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:17.991 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:17.991 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:17.991 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:17.991 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:17.991 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:17.991 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.992 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.992 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:17.992 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.992 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:17.992 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:17.992 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:17.993 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:17.993 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:17.993 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:17.993 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray2", 2020-05-18T21:38:17.993 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60c", 2020-05-18T21:38:17.994 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:17.994 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:17.994 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:17.994 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:17.994 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:17.994 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:17.995 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:17.995 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:17.995 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:17.995 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:17.995 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:17.996 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.996 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:17.996 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:17.996 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:17.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.996 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:17.997 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:17.997 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:17.997 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:17.997 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:17.997 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:17.997 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.998 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:17.998 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:17.998 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:17.998 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:17.998 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:17.999 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:17.999 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:17.999 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:17.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:17.999 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:17.999 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:18.000 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:18.000 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:18.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.000 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.000 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1547, 2020-05-18T21:38:18.001 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:18.001 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:18.001 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:18.001 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:18.001 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:18.001 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:18.002 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:18.002 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:18.002 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:18.002 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:18.006 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:18.007 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:18.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.007 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:18.007 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:18.008 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:18.008 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:18.008 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:18.008 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:18.008 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.009 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:18.009 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:18.009 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:18.009 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:18.009 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:18.010 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:18.010 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086853+0000", 2020-05-18T21:38:18.010 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:18.010 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:18.010 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:18.011 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:18.011 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:18.011 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:18.011 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:18.011 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:18.011 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:18.012 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:18.012 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:18.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.012 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:18.012 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:18.013 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:18.013 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:18.013 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:18.013 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:18.013 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086853+0000" 2020-05-18T21:38:18.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.014 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:18.014 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:18.014 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:18.014 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:18.015 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:18.015 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:18.015 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086853+0000" 2020-05-18T21:38:18.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.015 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:18.015 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:18.016 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:18.016 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:18.016 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:18.016 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:18.016 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:18.017 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:18.017 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:18.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.017 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:18.017 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:18.017 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:18.018 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:18.018 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:18.018 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:18.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.019 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:18.019 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:18.019 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:18.019 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:18.020 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.020 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.020 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.020 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.020 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:18.021 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.021 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.021 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:18.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.021 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.022 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.022 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.022 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.022 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:18.022 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:18.022 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:18.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.023 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:18.023 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:18.023 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:18.023 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:18.024 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:18.024 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:18.024 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:18.024 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:18.024 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:18.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.025 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:18.025 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:18.025 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:18.025 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:18.025 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:18.026 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:18.026 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:18.026 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:18.026 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:18.026 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:18.027 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:18.027 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:18.027 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.027 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:18.027 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:18.028 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:18.028 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:18.028 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:18.028 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.028 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray1", 2020-05-18T21:38:18.028 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60b", 2020-05-18T21:38:18.029 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:18.029 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:18.029 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:18.029 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:18.029 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:18.030 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:18.030 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:18.030 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:18.030 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:18.030 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:18.030 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:18.031 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.031 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:18.031 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.031 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.032 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.032 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.032 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:18.032 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.032 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.032 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:18.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.033 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.033 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.033 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.033 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.034 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:18.034 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:18.034 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:18.034 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:18.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.034 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.036 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1549, 2020-05-18T21:38:18.036 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:18.036 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:18.036 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:18.036 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:18.036 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:18.037 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:18.037 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:18.037 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:18.037 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:18.037 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:18.038 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:18.038 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:18.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.038 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:18.038 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:18.039 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:18.039 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:18.039 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:18.039 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:18.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.039 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:18.040 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:18.040 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:18.040 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:18.040 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:18.040 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:18.040 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.087329+0000", 2020-05-18T21:38:18.041 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:18.041 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:18.041 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:18.041 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:18.041 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:18.042 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:18.042 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:18.042 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:18.042 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:18.042 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:18.043 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:18.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.043 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:18.043 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:18.043 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:18.043 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:18.044 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:18.044 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:18.044 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087329+0000" 2020-05-18T21:38:18.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.044 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:18.045 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:18.045 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:18.045 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:18.045 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:18.045 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:18.045 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.087329+0000" 2020-05-18T21:38:18.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.046 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:18.046 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:18.046 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:18.046 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:18.047 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:18.047 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:18.047 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:18.047 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:18.047 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:18.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.048 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:18.048 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:18.048 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:18.048 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:18.048 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:18.049 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:18.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.049 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:18.049 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:18.049 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:18.049 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:18.050 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.050 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.050 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.050 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.051 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:18.051 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.051 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.051 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:18.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.051 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.052 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.052 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.052 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.052 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:18.052 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:18.053 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:18.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.053 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:18.053 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:18.053 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:18.053 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:18.054 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:18.054 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:18.054 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:18.054 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:18.054 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:18.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.055 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:18.055 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:18.055 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:18.056 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:18.056 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:18.056 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:18.056 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:18.056 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:18.057 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:18.057 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:18.057 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:18.057 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:18.057 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.058 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:18.058 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:18.058 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:18.058 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:18.058 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:18.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.059 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray3", 2020-05-18T21:38:18.059 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60d", 2020-05-18T21:38:18.059 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:18.059 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:18.059 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:18.060 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:18.060 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:18.060 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:18.060 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:18.060 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:18.061 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:18.061 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:18.061 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:18.061 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.061 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:18.061 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.062 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.062 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.062 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.062 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:18.063 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.063 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.063 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:18.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.063 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.063 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.064 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.064 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.064 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:18.064 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:18.064 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:18.065 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:18.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.065 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:18.065 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:18.065 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:18.066 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:18.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.066 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1546, 2020-05-18T21:38:18.066 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:18.066 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:18.067 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:18.067 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:18.067 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:18.067 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:18.067 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:18.068 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:18.068 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:18.068 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:18.069 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:18.069 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:18.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.069 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:18.069 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:18.070 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:18.070 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:18.070 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:18.070 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:18.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.071 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:18.071 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:18.071 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:18.071 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:18.071 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:18.072 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:18.072 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086518+0000", 2020-05-18T21:38:18.072 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:18.072 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:18.073 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:18.073 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:18.073 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:18.073 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:18.073 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:18.073 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:18.074 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:18.074 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 0, 2020-05-18T21:38:18.074 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:18.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.074 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:18.075 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:18.075 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:18.075 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:18.075 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:18.075 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:18.076 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086518+0000" 2020-05-18T21:38:18.076 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.076 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:18.076 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:18.076 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:18.076 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:18.077 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:18.077 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:18.077 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.086518+0000" 2020-05-18T21:38:18.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.077 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:18.078 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:18.078 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:18.078 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:18.078 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:18.078 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:18.079 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:18.079 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:18.079 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:18.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.080 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:18.080 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:18.080 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:18.081 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:18.081 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:18.081 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:18.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.081 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:18.082 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:18.082 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:18.082 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:18.082 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.082 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.083 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.083 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.083 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.083 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:18.083 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.083 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.084 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:18.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.084 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.084 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.084 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.085 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.085 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:18.085 INFO:teuthology.orchestra.run.smithi155.stdout: "stickydirs": 1, 2020-05-18T21:38:18.085 INFO:teuthology.orchestra.run.smithi155.stdout: "stray": 1 2020-05-18T21:38:18.086 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.086 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:18.086 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:18.086 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:18.086 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:18.087 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:18.087 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:18.087 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:18.088 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:18.088 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:18.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.088 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:18.088 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:18.088 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:18.089 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:18.089 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:18.089 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:18.089 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:18.089 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:18.090 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:18.090 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:18.090 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:18.090 INFO:teuthology.orchestra.run.smithi155.stdout: "straypinned" 2020-05-18T21:38:18.090 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.090 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:18.091 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:18.091 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:18.091 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:18.091 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:18.091 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.092 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1/stray0", 2020-05-18T21:38:18.092 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x60a", 2020-05-18T21:38:18.092 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:18.092 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:18.092 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:18.092 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "1", 2020-05-18T21:38:18.093 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "1", 2020-05-18T21:38:18.093 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:18.093 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "", 2020-05-18T21:38:18.093 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:18.093 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:18.094 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:18.094 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:18.094 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.094 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:18.094 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.095 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.095 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.095 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.095 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.095 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:18.096 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.096 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.096 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:18.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.096 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.097 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.097 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.097 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.097 INFO:teuthology.orchestra.run.smithi155.stdout: "sticky": 1, 2020-05-18T21:38:18.097 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:18.097 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:18.098 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:18.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.098 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:18.098 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [] 2020-05-18T21:38:18.098 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:18.099 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:18.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.099 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.099 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 257, 2020-05-18T21:38:18.099 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:18.099 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:18.100 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:18.100 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 16704, 2020-05-18T21:38:18.100 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:18.100 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:18.100 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:18.101 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:18.101 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:18.101 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:18.101 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:18.101 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:18.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.102 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:18.102 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 0, 2020-05-18T21:38:18.102 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 0, 2020-05-18T21:38:18.102 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 0, 2020-05-18T21:38:18.102 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": -1, 2020-05-18T21:38:18.103 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:18.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.103 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:18.103 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:18.103 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:18.103 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:18.104 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:18.104 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:18.104 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:37:53.086401+0000", 2020-05-18T21:38:18.104 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:18.104 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:18.105 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0, 2020-05-18T21:38:18.105 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:18.105 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:18.105 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:18.105 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:18.105 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "0.000000", 2020-05-18T21:38:18.106 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:18.106 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 10, 2020-05-18T21:38:18.106 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 0 2020-05-18T21:38:18.106 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.106 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:18.107 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:18.107 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:18.107 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:18.107 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:38:18.108 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:18.108 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:18.108 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.108 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:18.108 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:18.109 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:18.109 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:18.109 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 11, 2020-05-18T21:38:18.109 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:18.109 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:53.088993+0000" 2020-05-18T21:38:18.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.110 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:18.110 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:18.110 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:18.110 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 0, 2020-05-18T21:38:18.111 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:18.111 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:18.111 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:18.111 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:18.111 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:18.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.112 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:18.112 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:18.112 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:18.112 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:18.112 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:18.113 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:18.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.113 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:18.113 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:18.113 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:18.113 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:18.114 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.114 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.114 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.114 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.115 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:18.115 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.115 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.115 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:18.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.116 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.116 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.116 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.116 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.116 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:18.117 INFO:teuthology.orchestra.run.smithi155.stdout: "openingsnapparents": 0 2020-05-18T21:38:18.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.117 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:18.117 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:18.117 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:18.117 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:18.118 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:18.118 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:18.118 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:18.118 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:18.118 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:18.119 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.119 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:18.119 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:18.120 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:18.120 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:18.120 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:18.120 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:18.120 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": {}, 2020-05-18T21:38:18.120 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:18.121 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:18.121 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:18.121 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:18.121 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.121 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:18.122 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:18.122 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:18.122 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:18.122 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:18.122 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.123 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "~mds1", 2020-05-18T21:38:18.123 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x101", 2020-05-18T21:38:18.123 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:18.123 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "2", 2020-05-18T21:38:18.123 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "2", 2020-05-18T21:38:18.124 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "0", 2020-05-18T21:38:18.124 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "0", 2020-05-18T21:38:18.124 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": false, 2020-05-18T21:38:18.124 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "1", 2020-05-18T21:38:18.124 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:18.124 INFO:teuthology.orchestra.run.smithi155.stdout: "auth", 2020-05-18T21:38:18.125 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty", 2020-05-18T21:38:18.125 INFO:teuthology.orchestra.run.smithi155.stdout: "complete" 2020-05-18T21:38:18.125 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.125 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:18.125 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.126 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.126 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.126 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.126 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:18.126 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.127 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.127 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:18.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.127 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.127 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.128 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.128 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.128 INFO:teuthology.orchestra.run.smithi155.stdout: "child": 1, 2020-05-18T21:38:18.128 INFO:teuthology.orchestra.run.smithi155.stdout: "subtree": 1, 2020-05-18T21:38:18.128 INFO:teuthology.orchestra.run.smithi155.stdout: "subtreetemp": 0, 2020-05-18T21:38:18.128 INFO:teuthology.orchestra.run.smithi155.stdout: "dirty": 1, 2020-05-18T21:38:18.129 INFO:teuthology.orchestra.run.smithi155.stdout: "waiter": 0, 2020-05-18T21:38:18.129 INFO:teuthology.orchestra.run.smithi155.stdout: "authpin": 0 2020-05-18T21:38:18.129 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.129 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 3, 2020-05-18T21:38:18.129 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [ 2020-05-18T21:38:18.130 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.130 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray6", 2020-05-18T21:38:18.130 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:18.130 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:18.130 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:18.131 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:18.131 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:18.131 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:18.131 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:18.131 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1552, 2020-05-18T21:38:18.131 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:18.132 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:18.132 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:18.132 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.132 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:18.132 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.132 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.133 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.133 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.133 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.133 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:18.133 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.134 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.134 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:18.134 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.134 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.134 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.135 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.135 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.135 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:18.135 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.135 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:18.135 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:18.136 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:18.136 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:18.136 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:18.136 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:18.136 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:18.137 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:18.137 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:18.137 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:18.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.137 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:18.137 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:18.138 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:18.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.138 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.138 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray7", 2020-05-18T21:38:18.138 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:18.139 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:18.139 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:18.139 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:18.139 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:18.139 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:18.139 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:18.140 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1553, 2020-05-18T21:38:18.140 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:18.140 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:18.140 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:18.140 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.141 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:18.141 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.141 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.141 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.141 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.142 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:18.142 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.142 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.142 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:18.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.143 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.143 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.143 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.143 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.143 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:18.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.144 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:18.144 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:18.144 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:18.144 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:18.144 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:18.144 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:18.145 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:18.145 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:18.145 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:18.145 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:18.145 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.146 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:18.146 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:18.146 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:18.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.146 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.147 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray0", 2020-05-18T21:38:18.147 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:18.147 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:18.147 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:18.147 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:18.147 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:18.148 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:18.148 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:18.148 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1546, 2020-05-18T21:38:18.148 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:18.148 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:18.148 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:18.149 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.149 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:18.149 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.149 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.150 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.150 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.150 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:18.150 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.150 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.151 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:18.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.151 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.151 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.151 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.151 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.152 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:18.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.152 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:18.152 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:18.152 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:18.153 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:18.153 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:18.153 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:18.153 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:18.153 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:18.153 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:18.154 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:18.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.154 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:18.154 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:18.154 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:18.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.155 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.155 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray9", 2020-05-18T21:38:18.155 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:18.155 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:18.155 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:18.156 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:18.156 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:18.156 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:18.157 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:18.157 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1555, 2020-05-18T21:38:18.157 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:18.157 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:18.157 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:18.158 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.158 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:18.158 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.158 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.159 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.159 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.159 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:18.159 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.159 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.159 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:18.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.160 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.160 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.160 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.160 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.161 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:18.161 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.161 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:18.161 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:18.161 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:18.161 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:18.162 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:18.162 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:18.162 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:18.162 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:18.162 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:18.163 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:18.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.163 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:18.163 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:18.163 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:18.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.164 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.164 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray5", 2020-05-18T21:38:18.164 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:18.164 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:18.164 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:18.165 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:18.165 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:18.165 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:18.165 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:18.165 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1551, 2020-05-18T21:38:18.166 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:18.166 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:18.166 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:18.166 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.166 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:18.166 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.167 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.167 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.167 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.167 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:18.168 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.168 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.168 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:18.168 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.168 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.169 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.169 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.169 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.169 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:18.170 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.170 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:18.170 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:18.170 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:18.170 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:18.171 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:18.171 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:18.171 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:18.171 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:18.171 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:18.171 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:18.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.172 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:18.172 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:18.172 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:18.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.173 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.173 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray2", 2020-05-18T21:38:18.173 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:18.173 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:18.174 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:18.174 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:18.174 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:18.174 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:18.174 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:18.174 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1548, 2020-05-18T21:38:18.175 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:18.175 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:18.175 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:18.175 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.175 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:18.176 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.176 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.176 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.176 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.177 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:18.177 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.177 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.177 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:18.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.177 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.178 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.178 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.178 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.178 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:18.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.179 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:18.179 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:18.179 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:18.179 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:18.179 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:18.179 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:18.180 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:18.180 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:18.180 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:18.180 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:18.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.181 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:18.181 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:18.181 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:18.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.182 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.182 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray1", 2020-05-18T21:38:18.182 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:18.182 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:18.182 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:18.183 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:18.183 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:18.183 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:18.183 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:18.183 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1547, 2020-05-18T21:38:18.184 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:18.184 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:18.184 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:18.184 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.184 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:18.185 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.185 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.185 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.185 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.186 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:18.186 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.186 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.186 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:18.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.187 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.187 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.187 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.187 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.187 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:18.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.188 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:18.188 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:18.188 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:18.188 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:18.189 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:18.189 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:18.189 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:18.189 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:18.189 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:18.189 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:18.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.190 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:18.190 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:18.190 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:18.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.191 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.191 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray8", 2020-05-18T21:38:18.191 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:18.191 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:18.191 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:18.191 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:18.192 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:18.192 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:18.192 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:18.192 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1554, 2020-05-18T21:38:18.192 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:18.193 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:18.193 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:18.193 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.193 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:18.193 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.193 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.194 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.194 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.194 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.194 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:18.194 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.195 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.195 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:18.195 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.195 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.195 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.196 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.196 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.196 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:18.196 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.196 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:18.196 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:18.197 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:18.197 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:18.197 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:18.197 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:18.197 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:18.198 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:18.198 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:18.198 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:18.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.198 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:18.199 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:18.199 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:18.199 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.199 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.199 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray3", 2020-05-18T21:38:18.200 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:18.200 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:18.200 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:18.200 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:18.200 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:18.200 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:18.201 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:18.201 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1549, 2020-05-18T21:38:18.201 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:18.201 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:18.201 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:18.202 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.202 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:18.202 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.202 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.203 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.203 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.203 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:18.203 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.203 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.203 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:18.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.204 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.204 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.204 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.204 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.204 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:18.205 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.205 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:18.205 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:18.205 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:18.205 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:18.206 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:18.206 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:18.206 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:18.206 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:18.206 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:18.207 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:18.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.207 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:18.207 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:18.207 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:18.208 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.208 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.208 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "stray4", 2020-05-18T21:38:18.208 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 257, 2020-05-18T21:38:18.208 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:18.209 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:18.209 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:18.209 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:18.209 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:18.209 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:18.210 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1550, 2020-05-18T21:38:18.210 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:18.210 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:18.210 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:18.210 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.210 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": true, 2020-05-18T21:38:18.211 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.211 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.211 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.211 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.212 INFO:teuthology.orchestra.run.smithi155.stdout: 1, 2020-05-18T21:38:18.212 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.212 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.212 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 0 2020-05-18T21:38:18.212 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.212 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.213 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.213 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.213 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.213 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:18.213 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.214 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:18.214 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:18.214 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:18.214 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:18.214 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:18.214 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:18.215 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:18.215 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:18.215 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:18.215 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:18.215 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.216 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [ 2020-05-18T21:38:18.216 INFO:teuthology.orchestra.run.smithi155.stdout: "auth" 2020-05-18T21:38:18.216 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:18.216 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:18.216 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:18.216 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:18.217 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:18.217 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.217 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.217 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 1, 2020-05-18T21:38:18.217 INFO:teuthology.orchestra.run.smithi155.stdout: "rdev": 0, 2020-05-18T21:38:18.218 INFO:teuthology.orchestra.run.smithi155.stdout: "ctime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:18.218 INFO:teuthology.orchestra.run.smithi155.stdout: "btime": "2020-05-18T21:37:45.267427+0000", 2020-05-18T21:38:18.218 INFO:teuthology.orchestra.run.smithi155.stdout: "mode": 17407, 2020-05-18T21:38:18.218 INFO:teuthology.orchestra.run.smithi155.stdout: "uid": 0, 2020-05-18T21:38:18.218 INFO:teuthology.orchestra.run.smithi155.stdout: "gid": 0, 2020-05-18T21:38:18.219 INFO:teuthology.orchestra.run.smithi155.stdout: "nlink": 1, 2020-05-18T21:38:18.219 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_layout": { 2020-05-18T21:38:18.219 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_hash": 2, 2020-05-18T21:38:18.219 INFO:teuthology.orchestra.run.smithi155.stdout: "unused1": 0, 2020-05-18T21:38:18.219 INFO:teuthology.orchestra.run.smithi155.stdout: "unused2": 0, 2020-05-18T21:38:18.220 INFO:teuthology.orchestra.run.smithi155.stdout: "unused3": 0 2020-05-18T21:38:18.220 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.220 INFO:teuthology.orchestra.run.smithi155.stdout: "layout": { 2020-05-18T21:38:18.220 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_unit": 4194304, 2020-05-18T21:38:18.221 INFO:teuthology.orchestra.run.smithi155.stdout: "stripe_count": 1, 2020-05-18T21:38:18.221 INFO:teuthology.orchestra.run.smithi155.stdout: "object_size": 4194304, 2020-05-18T21:38:18.221 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_id": 30, 2020-05-18T21:38:18.221 INFO:teuthology.orchestra.run.smithi155.stdout: "pool_ns": "" 2020-05-18T21:38:18.221 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.222 INFO:teuthology.orchestra.run.smithi155.stdout: "old_pools": [], 2020-05-18T21:38:18.222 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2020-05-18T21:38:18.222 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_seq": 0, 2020-05-18T21:38:18.222 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_size": 18446744073709551615, 2020-05-18T21:38:18.222 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_from": 0, 2020-05-18T21:38:18.222 INFO:teuthology.orchestra.run.smithi155.stdout: "truncate_pending": 0, 2020-05-18T21:38:18.223 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:18.223 INFO:teuthology.orchestra.run.smithi155.stdout: "atime": "0.000000", 2020-05-18T21:38:18.223 INFO:teuthology.orchestra.run.smithi155.stdout: "time_warp_seq": 0, 2020-05-18T21:38:18.223 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1, 2020-05-18T21:38:18.223 INFO:teuthology.orchestra.run.smithi155.stdout: "export_pin": -1, 2020-05-18T21:38:18.224 INFO:teuthology.orchestra.run.smithi155.stdout: "client_ranges": [], 2020-05-18T21:38:18.224 INFO:teuthology.orchestra.run.smithi155.stdout: "dirstat": { 2020-05-18T21:38:18.224 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:18.224 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2020-05-18T21:38:07.145016+0000", 2020-05-18T21:38:18.224 INFO:teuthology.orchestra.run.smithi155.stdout: "num_files": 0, 2020-05-18T21:38:18.225 INFO:teuthology.orchestra.run.smithi155.stdout: "num_subdirs": 1, 2020-05-18T21:38:18.225 INFO:teuthology.orchestra.run.smithi155.stdout: "change_attr": 1 2020-05-18T21:38:18.225 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.225 INFO:teuthology.orchestra.run.smithi155.stdout: "rstat": { 2020-05-18T21:38:18.225 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 1, 2020-05-18T21:38:18.225 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 70, 2020-05-18T21:38:18.226 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 10, 2020-05-18T21:38:18.226 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 2, 2020-05-18T21:38:18.226 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:18.226 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:38:07.667894+0000" 2020-05-18T21:38:18.226 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.227 INFO:teuthology.orchestra.run.smithi155.stdout: "accounted_rstat": { 2020-05-18T21:38:18.227 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:18.227 INFO:teuthology.orchestra.run.smithi155.stdout: "rbytes": 0, 2020-05-18T21:38:18.227 INFO:teuthology.orchestra.run.smithi155.stdout: "rfiles": 0, 2020-05-18T21:38:18.227 INFO:teuthology.orchestra.run.smithi155.stdout: "rsubdirs": 1, 2020-05-18T21:38:18.227 INFO:teuthology.orchestra.run.smithi155.stdout: "rsnaps": 0, 2020-05-18T21:38:18.228 INFO:teuthology.orchestra.run.smithi155.stdout: "rctime": "2020-05-18T21:37:45.267427+0000" 2020-05-18T21:38:18.228 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.228 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 7, 2020-05-18T21:38:18.228 INFO:teuthology.orchestra.run.smithi155.stdout: "file_data_version": 0, 2020-05-18T21:38:18.228 INFO:teuthology.orchestra.run.smithi155.stdout: "xattr_version": 1, 2020-05-18T21:38:18.229 INFO:teuthology.orchestra.run.smithi155.stdout: "backtrace_version": 3, 2020-05-18T21:38:18.229 INFO:teuthology.orchestra.run.smithi155.stdout: "stray_prior_path": "", 2020-05-18T21:38:18.229 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_ever": 0, 2020-05-18T21:38:18.229 INFO:teuthology.orchestra.run.smithi155.stdout: "quota": { 2020-05-18T21:38:18.229 INFO:teuthology.orchestra.run.smithi155.stdout: "max_bytes": 0, 2020-05-18T21:38:18.229 INFO:teuthology.orchestra.run.smithi155.stdout: "max_files": 0 2020-05-18T21:38:18.230 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.230 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_stamp": "0.000000", 2020-05-18T21:38:18.230 INFO:teuthology.orchestra.run.smithi155.stdout: "last_scrub_version": 0, 2020-05-18T21:38:18.230 INFO:teuthology.orchestra.run.smithi155.stdout: "symlink": "", 2020-05-18T21:38:18.230 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrs": [], 2020-05-18T21:38:18.231 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtree": { 2020-05-18T21:38:18.231 INFO:teuthology.orchestra.run.smithi155.stdout: "splits": [] 2020-05-18T21:38:18.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.231 INFO:teuthology.orchestra.run.smithi155.stdout: "old_inodes": [], 2020-05-18T21:38:18.231 INFO:teuthology.orchestra.run.smithi155.stdout: "oldest_snap": 18446744073709551614, 2020-05-18T21:38:18.231 INFO:teuthology.orchestra.run.smithi155.stdout: "damage_flags": 0, 2020-05-18T21:38:18.232 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:38:18.232 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.232 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.232 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.232 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.233 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.233 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:38:18.233 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.233 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.233 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:38:18.234 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.234 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.234 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.234 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.234 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.234 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": 0, 2020-05-18T21:38:18.235 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": 1, 2020-05-18T21:38:18.235 INFO:teuthology.orchestra.run.smithi155.stdout: "dirwaiter": 0, 2020-05-18T21:38:18.235 INFO:teuthology.orchestra.run.smithi155.stdout: "discoverbase": 0 2020-05-18T21:38:18.235 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.235 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:18.236 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:18.236 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:18.236 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:18.236 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:18.236 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:18.236 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:18.237 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:18.237 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:18.237 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.237 INFO:teuthology.orchestra.run.smithi155.stdout: "authlock": {}, 2020-05-18T21:38:18.237 INFO:teuthology.orchestra.run.smithi155.stdout: "linklock": {}, 2020-05-18T21:38:18.238 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfragtreelock": {}, 2020-05-18T21:38:18.238 INFO:teuthology.orchestra.run.smithi155.stdout: "filelock": {}, 2020-05-18T21:38:18.238 INFO:teuthology.orchestra.run.smithi155.stdout: "xattrlock": {}, 2020-05-18T21:38:18.238 INFO:teuthology.orchestra.run.smithi155.stdout: "snaplock": {}, 2020-05-18T21:38:18.238 INFO:teuthology.orchestra.run.smithi155.stdout: "nestlock": { 2020-05-18T21:38:18.239 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:18.239 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "mix", 2020-05-18T21:38:18.239 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:18.239 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:18.239 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:18.239 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:18.240 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:18.240 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.240 INFO:teuthology.orchestra.run.smithi155.stdout: "flocklock": {}, 2020-05-18T21:38:18.240 INFO:teuthology.orchestra.run.smithi155.stdout: "policylock": {}, 2020-05-18T21:38:18.240 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [], 2020-05-18T21:38:18.241 INFO:teuthology.orchestra.run.smithi155.stdout: "client_caps": [], 2020-05-18T21:38:18.241 INFO:teuthology.orchestra.run.smithi155.stdout: "loner": -1, 2020-05-18T21:38:18.241 INFO:teuthology.orchestra.run.smithi155.stdout: "want_loner": -1, 2020-05-18T21:38:18.241 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_caps_wanted": [], 2020-05-18T21:38:18.241 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrags": [ 2020-05-18T21:38:18.241 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.242 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "", 2020-05-18T21:38:18.242 INFO:teuthology.orchestra.run.smithi155.stdout: "dirfrag": "0x1", 2020-05-18T21:38:18.242 INFO:teuthology.orchestra.run.smithi155.stdout: "snapid_first": 2, 2020-05-18T21:38:18.242 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": "0", 2020-05-18T21:38:18.242 INFO:teuthology.orchestra.run.smithi155.stdout: "version": "46", 2020-05-18T21:38:18.243 INFO:teuthology.orchestra.run.smithi155.stdout: "committing_version": "0", 2020-05-18T21:38:18.243 INFO:teuthology.orchestra.run.smithi155.stdout: "committed_version": "0", 2020-05-18T21:38:18.243 INFO:teuthology.orchestra.run.smithi155.stdout: "is_rep": true, 2020-05-18T21:38:18.243 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_auth": "0", 2020-05-18T21:38:18.243 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [], 2020-05-18T21:38:18.243 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:38:18.244 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.244 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.244 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.244 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.244 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.245 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:38:18.245 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.245 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.245 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:38:18.245 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.245 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.246 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.246 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.246 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.246 INFO:teuthology.orchestra.run.smithi155.stdout: "child": 1, 2020-05-18T21:38:18.246 INFO:teuthology.orchestra.run.smithi155.stdout: "subtree": 1 2020-05-18T21:38:18.247 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.247 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 2, 2020-05-18T21:38:18.247 INFO:teuthology.orchestra.run.smithi155.stdout: "dentries": [ 2020-05-18T21:38:18.247 INFO:teuthology.orchestra.run.smithi155.stdout: { 2020-05-18T21:38:18.247 INFO:teuthology.orchestra.run.smithi155.stdout: "path": "delete_me", 2020-05-18T21:38:18.247 INFO:teuthology.orchestra.run.smithi155.stdout: "path_ino": 1, 2020-05-18T21:38:18.248 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_first": 2, 2020-05-18T21:38:18.248 INFO:teuthology.orchestra.run.smithi155.stdout: "snap_last": 18446744073709551614, 2020-05-18T21:38:18.248 INFO:teuthology.orchestra.run.smithi155.stdout: "is_primary": true, 2020-05-18T21:38:18.248 INFO:teuthology.orchestra.run.smithi155.stdout: "is_remote": false, 2020-05-18T21:38:18.248 INFO:teuthology.orchestra.run.smithi155.stdout: "is_null": false, 2020-05-18T21:38:18.249 INFO:teuthology.orchestra.run.smithi155.stdout: "is_new": false, 2020-05-18T21:38:18.249 INFO:teuthology.orchestra.run.smithi155.stdout: "inode": 1099511627776, 2020-05-18T21:38:18.249 INFO:teuthology.orchestra.run.smithi155.stdout: "remote_type": "", 2020-05-18T21:38:18.249 INFO:teuthology.orchestra.run.smithi155.stdout: "version": 0, 2020-05-18T21:38:18.249 INFO:teuthology.orchestra.run.smithi155.stdout: "projected_version": 0, 2020-05-18T21:38:18.249 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.250 INFO:teuthology.orchestra.run.smithi155.stdout: "is_auth": false, 2020-05-18T21:38:18.250 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_state": { 2020-05-18T21:38:18.250 INFO:teuthology.orchestra.run.smithi155.stdout: "replicas": {} 2020-05-18T21:38:18.250 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.250 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_state": { 2020-05-18T21:38:18.251 INFO:teuthology.orchestra.run.smithi155.stdout: "authority": [ 2020-05-18T21:38:18.251 INFO:teuthology.orchestra.run.smithi155.stdout: 0, 2020-05-18T21:38:18.251 INFO:teuthology.orchestra.run.smithi155.stdout: -2 2020-05-18T21:38:18.251 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2020-05-18T21:38:18.251 INFO:teuthology.orchestra.run.smithi155.stdout: "replica_nonce": 1 2020-05-18T21:38:18.251 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.252 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_pins": 0, 2020-05-18T21:38:18.252 INFO:teuthology.orchestra.run.smithi155.stdout: "is_frozen": false, 2020-05-18T21:38:18.252 INFO:teuthology.orchestra.run.smithi155.stdout: "is_freezing": false, 2020-05-18T21:38:18.252 INFO:teuthology.orchestra.run.smithi155.stdout: "pins": { 2020-05-18T21:38:18.252 INFO:teuthology.orchestra.run.smithi155.stdout: "inodepin": 1 2020-05-18T21:38:18.253 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.253 INFO:teuthology.orchestra.run.smithi155.stdout: "nref": 1, 2020-05-18T21:38:18.253 INFO:teuthology.orchestra.run.smithi155.stdout: "lock": {}, 2020-05-18T21:38:18.253 INFO:teuthology.orchestra.run.smithi155.stdout: "versionlock": { 2020-05-18T21:38:18.253 INFO:teuthology.orchestra.run.smithi155.stdout: "gather_set": [], 2020-05-18T21:38:18.253 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "lock", 2020-05-18T21:38:18.254 INFO:teuthology.orchestra.run.smithi155.stdout: "is_leased": false, 2020-05-18T21:38:18.254 INFO:teuthology.orchestra.run.smithi155.stdout: "num_rdlocks": 0, 2020-05-18T21:38:18.254 INFO:teuthology.orchestra.run.smithi155.stdout: "num_wrlocks": 0, 2020-05-18T21:38:18.254 INFO:teuthology.orchestra.run.smithi155.stdout: "num_xlocks": 0, 2020-05-18T21:38:18.254 INFO:teuthology.orchestra.run.smithi155.stdout: "xlock_by": {} 2020-05-18T21:38:18.255 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2020-05-18T21:38:18.255 INFO:teuthology.orchestra.run.smithi155.stdout: "states": [] 2020-05-18T21:38:18.255 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:18.255 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:18.255 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:18.256 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2020-05-18T21:38:18.256 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:18.256 INFO:teuthology.orchestra.run.smithi155.stdout:] 2020-05-18T21:38:18.258 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "ino": 1099511628285, "rdev": 0, "ctime": "2020-05-18T21:38:07.185291+0000", "btime": "2020-05-18T21:38:07.183028+0000", "mode": 33188, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 30, "pool_ns": "" }, "old_pools": [], "size": 7, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:07.185291+0000", "atime": "2020-05-18T21:38:07.183028+0000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.185291+0000" }, "accounted_rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.185291+0000" }, "version": 38, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 18, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "importingcaps": 0, "caps": 1, "dirtyparent": 1, "replicated": 0, "dirty": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 7277, "pending": "pAsLsXsFsc", "issued": "pAsLsXsFsc", "wanted": "-", "last_sent": 1 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1099511628286, "rdev": 0, "ctime": "2020-05-18T21:38:07.187908+0000", "btime": "2020-05-18T21:38:07.186031+0000", "mode": 33188, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 30, "pool_ns": "" }, "old_pools": [], "size": 7, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:07.187908+0000", "atime": "2020-05-18T21:38:07.186031+0000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.187908+0000" }, "accounted_rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.187908+0000" }, "version": 40, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 20, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "importingcaps": 0, "caps": 1, "dirtyparent": 1, "replicated": 0, "dirty": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 7277, "pending": "pAsLsXsFsc", "issued": "pAsLsXsFsc", "wanted": "-", "last_sent": 1 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1099511628280, "rdev": 0, "ctime": "2020-05-18T21:38:07.172443+0000", "btime": "2020-05-18T21:38:07.170645+0000", "mode": 33188, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 30, "pool_ns": "" }, "old_pools": [], "size": 7, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:07.172443+0000", "atime": "2020-05-18T21:38:07.170645+0000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.172443+0000" }, "accounted_rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.172443+0000" }, "version": 28, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 8, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "importingcaps": 0, "caps": 1, "dirtyparent": 1, "replicated": 0, "dirty": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 7277, "pending": "pAsLsXsFsc", "issued": "pAsLsXsFsc", "wanted": "-", "last_sent": 1 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1099511627777, "rdev": 0, "ctime": "2020-05-18T21:38:07.162519+0000", "btime": "2020-05-18T21:38:07.153991+0000", "mode": 33188, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 30, "pool_ns": "" }, "old_pools": [], "size": 7, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:07.162519+0000", "atime": "2020-05-18T21:38:07.153991+0000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.162519+0000" }, "accounted_rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.162519+0000" }, "version": 22, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 2, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "importingcaps": 0, "caps": 1, "dirtyparent": 1, "replicated": 0, "dirty": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 7277, "pending": "pAsLsXsFsc", "issued": "pAsLsXsFsc", "wanted": "-", "last_sent": 1 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1099511628283, "rdev": 0, "ctime": "2020-05-18T21:38:07.180027+0000", "btime": "2020-05-18T21:38:07.177977+0000", "mode": 33188, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 30, "pool_ns": "" }, "old_pools": [], "size": 7, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:07.180027+0000", "atime": "2020-05-18T21:38:07.177977+0000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.180027+0000" }, "accounted_rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.180027+0000" }, "version": 34, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 14, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "importingcaps": 0, "caps": 1, "dirtyparent": 1, "replicated": 0, "dirty": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 7277, "pending": "pAsLsXsFsc", "issued": "pAsLsXsFsc", "wanted": "-", "last_sent": 1 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1099511628282, "rdev": 0, "ctime": "2020-05-18T21:38:07.177141+0000", "btime": "2020-05-18T21:38:07.175260+0000", "mode": 33188, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 30, "pool_ns": "" }, "old_pools": [], "size": 7, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:07.177141+0000", "atime": "2020-05-18T21:38:07.175260+0000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.177141+0000" }, "accounted_rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.177141+0000" }, "version": 32, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 12, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "importingcaps": 0, "caps": 1, "dirtyparent": 1, "replicated": 0, "dirty": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 7277, "pending": "pAsLsXsFsc", "issued": "pAsLsXsFsc", "wanted": "-", "last_sent": 1 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1099511628281, "rdev": 0, "ctime": "2020-05-18T21:38:07.174698+0000", "btime": "2020-05-18T21:38:07.173065+0000", "mode": 33188, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 30, "pool_ns": "" }, "old_pools": [], "size": 7, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:07.174698+0000", "atime": "2020-05-18T21:38:07.173065+0000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.174698+0000" }, "accounted_rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.174698+0000" }, "version": 30, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 10, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "importingcaps": 0, "caps": 1, "dirtyparent": 1, "replicated": 0, "dirty": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 7277, "pending": "pAsLsXsFsc", "issued": "pAsLsXsFsc", "wanted": "-", "last_sent": 1 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1099511628278, "rdev": 0, "ctime": "2020-05-18T21:38:07.166162+0000", "btime": "2020-05-18T21:38:07.163718+0000", "mode": 33188, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 30, "pool_ns": "" }, "old_pools": [], "size": 7, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:07.166162+0000", "atime": "2020-05-18T21:38:07.163718+0000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.166162+0000" }, "accounted_rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.166162+0000" }, "version": 24, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 4, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "importingcaps": 0, "caps": 1, "dirtyparent": 1, "replicated": 0, "dirty": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 7277, "pending": "pAsLsXsFsc", "issued": "pAsLsXsFsc", "wanted": "-", "last_sent": 1 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1099511627776, "rdev": 0, "ctime": "2020-05-18T21:38:07.667894+0000", "btime": "2020-05-18T21:38:07.145016+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:07.186031+0000", "atime": "2020-05-18T21:38:07.145016+0000", "time_warp_seq": 0, "change_attr": 11, "export_pin": 1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:38:07.186031+0000", "num_files": 10, "num_subdirs": 0, "change_attr": 10 }, "rstat": { "version": 0, "rbytes": 70, "rfiles": 10, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.667894+0000" }, "accounted_rstat": { "version": 0, "rbytes": 70, "rfiles": 10, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.667894+0000" }, "version": 44, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 2, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "importing": 0, "dirfrag": 1 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "/delete_me", "dirfrag": "0x10000000000", "snapid_first": 2, "projected_version": "41", "version": "41", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1 }, "nref": 4, "dentries": [ { "path": "delete_me/file_1", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511628278, "remote_type": "", "version": 24, "projected_version": 24, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "replicated": 0, "dirty": 1 }, "nref": 2, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth", "dirty" ] }, { "path": "delete_me/file_4", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511628281, "remote_type": "", "version": 30, "projected_version": 30, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "replicated": 0, "dirty": 1 }, "nref": 2, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth", "dirty" ] }, { "path": "delete_me/file_5", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511628282, "remote_type": "", "version": 32, "projected_version": 32, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "replicated": 0, "dirty": 1 }, "nref": 2, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth", "dirty" ] }, { "path": "delete_me/file_6", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511628283, "remote_type": "", "version": 34, "projected_version": 34, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "replicated": 0, "dirty": 1 }, "nref": 2, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth", "dirty" ] }, { "path": "delete_me/file_2", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511628279, "remote_type": "", "version": 26, "projected_version": 26, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "replicated": 0, "dirty": 1 }, "nref": 2, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth", "dirty" ] }, { "path": "delete_me/file_0", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511627777, "remote_type": "", "version": 22, "projected_version": 22, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "replicated": 0, "dirty": 1 }, "nref": 2, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth", "dirty" ] }, { "path": "delete_me/file_3", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511628280, "remote_type": "", "version": 28, "projected_version": 28, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "replicated": 0, "dirty": 1 }, "nref": 2, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth", "dirty" ] }, { "path": "delete_me/file_9", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511628286, "remote_type": "", "version": 40, "projected_version": 40, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "replicated": 0, "dirty": 1 }, "nref": 2, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth", "dirty" ] }, { "path": "delete_me/file_8", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511628285, "remote_type": "", "version": 38, "projected_version": 38, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "replicated": 0, "dirty": 1 }, "nref": 2, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth", "dirty" ] }, { "path": "delete_me/file_7", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511628284, "remote_type": "", "version": 36, "projected_version": 36, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1, "replicated": 0, "dirty": 1 }, "nref": 2, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth", "dirty" ] } ] } ] }, { "ino": 3, "rdev": 0, "ctime": "2020-05-18T21:38:01.329092+0000", "btime": "2020-05-18T21:38:01.329092+0000", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:01.329092+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:38:01.329092+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:38:01.329092+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ -2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "openingsnapparents": 0 }, "nref": 0, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1555, "rdev": 0, "ctime": "2020-05-18T21:37:53.088993+0000", "btime": "2020-05-18T21:37:53.088993+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088993+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray9", "dirfrag": "0x613", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1550, "rdev": 0, "ctime": "2020-05-18T21:37:53.087546+0000", "btime": "2020-05-18T21:37:53.087546+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087546+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087546+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087546+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray4", "dirfrag": "0x60e", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1554, "rdev": 0, "ctime": "2020-05-18T21:37:53.088676+0000", "btime": "2020-05-18T21:37:53.088676+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088676+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088676+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088676+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray8", "dirfrag": "0x612", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1099511628279, "rdev": 0, "ctime": "2020-05-18T21:38:07.169818+0000", "btime": "2020-05-18T21:38:07.167082+0000", "mode": 33188, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 30, "pool_ns": "" }, "old_pools": [], "size": 7, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:07.169818+0000", "atime": "2020-05-18T21:38:07.167082+0000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.169818+0000" }, "accounted_rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.169818+0000" }, "version": 26, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 6, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "importingcaps": 0, "caps": 1, "dirtyparent": 1, "replicated": 0, "dirty": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 7277, "pending": "pAsLsXsFsc", "issued": "pAsLsXsFsc", "wanted": "-", "last_sent": 1 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1553, "rdev": 0, "ctime": "2020-05-18T21:37:53.088498+0000", "btime": "2020-05-18T21:37:53.088498+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088498+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088498+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088498+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray7", "dirfrag": "0x611", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1099511628284, "rdev": 0, "ctime": "2020-05-18T21:38:07.182489+0000", "btime": "2020-05-18T21:38:07.180865+0000", "mode": 33188, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 30, "pool_ns": "" }, "old_pools": [], "size": 7, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:07.182489+0000", "atime": "2020-05-18T21:38:07.180865+0000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.182489+0000" }, "accounted_rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.182489+0000" }, "version": 36, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 16, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "importingcaps": 0, "caps": 1, "dirtyparent": 1, "replicated": 0, "dirty": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 7277, "pending": "pAsLsXsFsc", "issued": "pAsLsXsFsc", "wanted": "-", "last_sent": 1 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] }, { "ino": 1552, "rdev": 0, "ctime": "2020-05-18T21:37:53.088334+0000", "btime": "2020-05-18T21:37:53.088334+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.088334+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088334+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088334+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray6", "dirfrag": "0x610", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1551, "rdev": 0, "ctime": "2020-05-18T21:37:53.087783+0000", "btime": "2020-05-18T21:37:53.087783+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087783+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087783+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087783+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray5", "dirfrag": "0x60f", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1548, "rdev": 0, "ctime": "2020-05-18T21:37:53.087103+0000", "btime": "2020-05-18T21:37:53.087103+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087103+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087103+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087103+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray2", "dirfrag": "0x60c", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1547, "rdev": 0, "ctime": "2020-05-18T21:37:53.086853+0000", "btime": "2020-05-18T21:37:53.086853+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086853+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086853+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086853+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray1", "dirfrag": "0x60b", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1549, "rdev": 0, "ctime": "2020-05-18T21:37:53.087329+0000", "btime": "2020-05-18T21:37:53.087329+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.087329+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087329+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.087329+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray3", "dirfrag": "0x60d", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 1546, "rdev": 0, "ctime": "2020-05-18T21:37:53.086518+0000", "btime": "2020-05-18T21:37:53.086518+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086518+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086518+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.086518+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "stickydirs": 1, "stray": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "straypinned" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1/stray0", "dirfrag": "0x60a", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "sticky": 1, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 2, "dentries": [] } ] }, { "ino": 257, "rdev": 0, "ctime": "2020-05-18T21:37:53.086401+0000", "btime": "2020-05-18T21:37:53.086401+0000", "mode": 16704, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:37:53.086401+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 10, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 11, "rsnaps": 0, "rctime": "2020-05-18T21:37:53.088993+0000" }, "version": 1, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 0, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dirfrag": 1, "openingsnapparents": 0 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth" ], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "2", "version": "2", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "subtreetemp": 0, "dirty": 1, "waiter": 0, "authpin": 0 }, "nref": 3, "dentries": [ { "path": "stray6", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1552, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray7", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1553, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray0", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1546, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray9", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1555, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray5", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1551, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray2", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1548, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray1", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1547, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray8", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1554, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray3", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1549, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "stray4", "path_ino": 257, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1550, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] } ] } ] }, { "ino": 1, "rdev": 0, "ctime": "2020-05-18T21:38:07.145016+0000", "btime": "2020-05-18T21:37:45.267427+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 30, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:07.145016+0000", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2020-05-18T21:38:07.145016+0000", "num_files": 0, "num_subdirs": 1, "change_attr": 1 }, "rstat": { "version": 1, "rbytes": 70, "rfiles": 10, "rsubdirs": 2, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.667894+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2020-05-18T21:37:45.267427+0000" }, "version": 7, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 3, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "dirfrag": 1, "dirwaiter": 0, "discoverbase": 0 }, "nref": 1, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [], "client_caps": [], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "0", "version": "46", "committing_version": "0", "committed_version": "0", "is_rep": true, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1 }, "nref": 2, "dentries": [ { "path": "delete_me", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511627776, "remote_type": "", "version": 0, "projected_version": 0, "auth_pins": 0, "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "inodepin": 1 }, "nref": 1, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [] } ] } ] } ] 2020-05-18T21:38:18.262 DEBUG:tasks.cephfs.test_strays:Found ino in cache: { "ino": 1099511627777, "rdev": 0, "ctime": "2020-05-18T21:38:07.162519+0000", "btime": "2020-05-18T21:38:07.153991+0000", "mode": 33188, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 30, "pool_ns": "" }, "old_pools": [], "size": 7, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2020-05-18T21:38:07.162519+0000", "atime": "2020-05-18T21:38:07.153991+0000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.162519+0000" }, "accounted_rstat": { "version": 0, "rbytes": 7, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2020-05-18T21:38:07.162519+0000" }, "version": 22, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 2, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "importingcaps": 0, "caps": 1, "dirtyparent": 1, "replicated": 0, "dirty": 1 }, "nref": 3, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "mix", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 7277, "pending": "pAsLsXsFsc", "issued": "pAsLsXsFsc", "wanted": "-", "last_sent": 1 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [] } 2020-05-18T21:38:18.263 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rm -rf delete_me/*) 2020-05-18T21:38:18.477 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get mds_tick_interval 2020-05-18T21:38:18.582 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:38:18.582 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_tick_interval": "5.000000" 2020-05-18T21:38:18.582 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:38:18.591 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_tick_interval": "5.000000" } 2020-05-18T21:38:18.592 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:38:18.593 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:38:18.614 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:38:18.635 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:38:18.636 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:38:18.636 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:38:18.637 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:38:18.671 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[39805]: fuse finished with error 0 and tester_r 0 2020-05-18T21:38:18.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:18.674 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:38:18.680 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:38:18.681 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:38:18.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:18.682 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 down' 2020-05-18T21:38:18.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:18.701 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.0' 2020-05-18T21:38:18.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:18.788 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:38:18.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:18.807 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:38:18.813 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:38:18.814 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:38:18.814 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:38:18.814 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:18.814 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:38:18.814 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:18.815 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:18.815 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:18.815 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:18.815 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:18.815 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:18.816 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:18.816 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:38:18.816 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:18.816 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:38:18.816 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42144sec preferred_lft 42144sec 2020-05-18T21:38:18.817 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:38:18.817 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:18.817 INFO:teuthology.orchestra.run.smithi063.stdout:39: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-05-18T21:38:18.817 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:18.817 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:38:18.817 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:18.818 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::2c9b:62ff:fed4:ee0f/64 scope link 2020-05-18T21:38:18.818 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:18.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:18.819 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:38:18.831 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:38:18.831 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:38:18.831 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:38:18.831 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:18.832 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:38:18.832 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:18.832 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:38:18.832 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:18.832 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:38:18.833 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:18.833 INFO:teuthology.orchestra.run.smithi063.stdout:39: ceph-brx: mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:38:18.833 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:18.834 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:38:18.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:18.835 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:38:18.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:18.898 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:38:19.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:19.024 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:38:19.033 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:38:19.034 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:38:19.034 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:38:19.034 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:38:19.034 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:38:19.034 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:38:19.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:19.035 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:38:19.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:19.052 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:38:19.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:19.112 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:38:19.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:19.124 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:38:19.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:19.132 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:38:19.183 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-05-18T21:38:19.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:38:19.184 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-05-18T21:38:19.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:19.185 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:38:19.192 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:38:19.193 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:38:19.193 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:38:19.193 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:19.193 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:38:19.194 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:19.194 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:19.194 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:19.194 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:19.194 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:19.195 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:19.195 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:19.195 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:38:19.195 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:19.195 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:38:19.196 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42143sec preferred_lft 42143sec 2020-05-18T21:38:19.196 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:38:19.196 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:19.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:19.197 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:38:19.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:19.248 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:38:19.255 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2020-05-18T21:38:19.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:38:19.257 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-05-18T21:38:19.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:19.258 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:38:19.265 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:38:19.265 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:38:19.266 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:38:19.266 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:19.266 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:38:19.266 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:19.266 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:19.267 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:19.267 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:19.267 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:19.267 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:19.267 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:19.268 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:38:19.268 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:19.268 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:38:19.268 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42148sec preferred_lft 42148sec 2020-05-18T21:38:19.268 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:38:19.268 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:19.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:19.269 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:38:19.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:19.314 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:38:19.321 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2020-05-18T21:38:19.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:38:19.322 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-05-18T21:38:19.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:19.323 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:38:19.330 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:38:19.330 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:38:19.330 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:38:19.330 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:19.331 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:38:19.331 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:19.331 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:19.331 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:19.331 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:19.332 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:19.332 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:19.332 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:19.332 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:38:19.333 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:19.333 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:38:19.333 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42148sec preferred_lft 42148sec 2020-05-18T21:38:19.333 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:38:19.334 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:19.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:19.334 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:38:19.378 INFO:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:38:19.380 INFO:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-05-18T21:38:19.417 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2020-05-18T21:38:19.417 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2020-05-18T21:38:19.417 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:38:19.417 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2020-05-18T21:38:19.418 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.418 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2020-05-18T21:38:19.418 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2020-05-18T21:38:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2020-05-18T21:38:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2020-05-18T21:38:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2020-05-18T21:38:19.420 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2020-05-18T21:38:19.420 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.420 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:38:19.420 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2020-05-18T21:38:19.420 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:38:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:38:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2020-05-18T21:38:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.422 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2020-05-18T21:38:19.422 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2020-05-18T21:38:19.422 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:38:19.422 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:38:19.422 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2020-05-18T21:38:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:38:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2020-05-18T21:38:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:38:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:38:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2020-05-18T21:38:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.424 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:38:19.424 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.424 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2020-05-18T21:38:19.424 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.424 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2020-05-18T21:38:19.425 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.425 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2020-05-18T21:38:19.425 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2020-05-18T21:38:19.425 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:38:19.425 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:38:19.425 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.426 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2020-05-18T21:38:19.426 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2020-05-18T21:38:19.426 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.426 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2020-05-18T21:38:19.426 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2020-05-18T21:38:19.427 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.427 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2020-05-18T21:38:19.427 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2020-05-18T21:38:19.427 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.427 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2020-05-18T21:38:19.427 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2020-05-18T21:38:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2020-05-18T21:38:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2020-05-18T21:38:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2020-05-18T21:38:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:38:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2020-05-18T21:38:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2020-05-18T21:38:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:38:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2020-05-18T21:38:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2020-05-18T21:38:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2020-05-18T21:38:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2020-05-18T21:38:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2020-05-18T21:38:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2020-05-18T21:38:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2020-05-18T21:38:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2020-05-18T21:38:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2020-05-18T21:38:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2020-05-18T21:38:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: debug filestore = 20 2020-05-18T21:38:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: debug journal = 20 2020-05-18T21:38:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 20 2020-05-18T21:38:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 25 2020-05-18T21:38:19.433 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2020-05-18T21:38:19.433 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:38:19.433 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2020-05-18T21:38:19.433 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:38:19.434 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:38:19.434 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2020-05-18T21:38:19.434 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:38:19.434 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.435 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2020-05-18T21:38:19.435 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:38:19.435 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2020-05-18T21:38:19.435 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:38:19.435 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:38:19.435 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:38:19.436 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:38:19.436 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2020-05-18T21:38:19.436 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.436 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2020-05-18T21:38:19.436 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:38:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2020-05-18T21:38:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2020-05-18T21:38:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2020-05-18T21:38:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2020-05-18T21:38:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2020-05-18T21:38:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:38:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2020-05-18T21:38:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2020-05-18T21:38:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:38:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2020-05-18T21:38:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:19.439 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2020-05-18T21:38:19.439 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2020-05-18T21:38:19.439 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2020-05-18T21:38:19.439 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2020-05-18T21:38:19.439 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:38:19.439 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:38:19.440 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2020-05-18T21:38:19.440 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2020-05-18T21:38:19.440 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:38:19.440 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2020-05-18T21:38:19.440 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2020-05-18T21:38:19.441 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2020-05-18T21:38:19.441 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2020-05-18T21:38:19.441 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2020-05-18T21:38:19.441 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2020-05-18T21:38:19.441 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2020-05-18T21:38:19.441 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2020-05-18T21:38:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2020-05-18T21:38:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal frag = True 2020-05-18T21:38:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal fragment size max = 10000 2020-05-18T21:38:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal merge size = 5 2020-05-18T21:38:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split bits = 3 2020-05-18T21:38:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split size = 100 2020-05-18T21:38:19.443 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2020-05-18T21:38:19.443 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2020-05-18T21:38:19.443 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2020-05-18T21:38:19.443 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2020-05-18T21:38:19.443 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2020-05-18T21:38:19.445 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2020-05-18T21:38:19.445 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2020-05-18T21:38:19.445 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-05-18T21:38:19.445 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2020-05-18T21:38:19.446 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.446 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2020-05-18T21:38:19.446 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.446 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2020-05-18T21:38:19.446 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.446 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2020-05-18T21:38:19.447 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2020-05-18T21:38:19.447 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.447 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2020-05-18T21:38:19.447 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2020-05-18T21:38:19.447 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.448 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2020-05-18T21:38:19.448 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2020-05-18T21:38:19.448 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.448 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2020-05-18T21:38:19.448 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2020-05-18T21:38:19.448 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.449 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2020-05-18T21:38:19.449 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.449 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2020-05-18T21:38:19.449 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2020-05-18T21:38:19.450 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2020-05-18T21:38:19.450 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2020-05-18T21:38:19.450 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2020-05-18T21:38:19.450 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2020-05-18T21:38:19.450 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2020-05-18T21:38:19.450 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-05-18T21:38:19.451 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2020-05-18T21:38:19.451 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2020-05-18T21:38:19.451 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.451 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-05-18T21:38:19.451 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.452 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2020-05-18T21:38:19.452 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.452 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2020-05-18T21:38:19.452 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.452 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2020-05-18T21:38:19.452 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2020-05-18T21:38:19.453 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.63,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2020-05-18T21:38:19.453 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 463d54c2-4027-4807-bf42-f25cd6c63d51 2020-05-18T21:38:19.453 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.453 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2020-05-18T21:38:19.453 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2020-05-18T21:38:19.454 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.454 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2020-05-18T21:38:19.454 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2020-05-18T21:38:19.454 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.454 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2020-05-18T21:38:19.455 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2020-05-18T21:38:19.455 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.455 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2020-05-18T21:38:19.455 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2020-05-18T21:38:19.455 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2020-05-18T21:38:19.456 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.456 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2020-05-18T21:38:19.456 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2020-05-18T21:38:19.456 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.456 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2020-05-18T21:38:19.456 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.457 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2020-05-18T21:38:19.457 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.457 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2020-05-18T21:38:19.457 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.457 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2020-05-18T21:38:19.458 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2020-05-18T21:38:19.458 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.458 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2020-05-18T21:38:19.458 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2020-05-18T21:38:19.458 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2020-05-18T21:38:19.458 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2020-05-18T21:38:19.459 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2020-05-18T21:38:19.459 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2020-05-18T21:38:19.459 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2020-05-18T21:38:19.459 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2020-05-18T21:38:19.459 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2020-05-18T21:38:19.460 INFO:teuthology.orchestra.run.smithi155.stdout: debug filestore = 20 2020-05-18T21:38:19.460 INFO:teuthology.orchestra.run.smithi155.stdout: debug journal = 20 2020-05-18T21:38:19.460 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 20 2020-05-18T21:38:19.460 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 25 2020-05-18T21:38:19.460 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2020-05-18T21:38:19.460 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2020-05-18T21:38:19.461 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2020-05-18T21:38:19.461 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2020-05-18T21:38:19.461 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2020-05-18T21:38:19.461 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2020-05-18T21:38:19.461 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:38:19.462 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.462 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2020-05-18T21:38:19.462 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:38:19.462 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2020-05-18T21:38:19.462 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:38:19.463 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:38:19.463 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:38:19.463 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:38:19.463 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2020-05-18T21:38:19.463 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.464 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2020-05-18T21:38:19.464 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:38:19.464 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2020-05-18T21:38:19.464 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2020-05-18T21:38:19.464 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2020-05-18T21:38:19.465 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2020-05-18T21:38:19.465 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2020-05-18T21:38:19.465 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2020-05-18T21:38:19.465 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2020-05-18T21:38:19.465 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2020-05-18T21:38:19.466 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2020-05-18T21:38:19.466 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2020-05-18T21:38:19.466 INFO:teuthology.orchestra.run.smithi155.stdout: 2020-05-18T21:38:19.466 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2020-05-18T21:38:19.466 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2020-05-18T21:38:19.467 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2020-05-18T21:38:19.467 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2020-05-18T21:38:19.467 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-05-18T21:38:19.467 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-05-18T21:38:19.467 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2020-05-18T21:38:19.468 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2020-05-18T21:38:19.468 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:38:19.468 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2020-05-18T21:38:19.468 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2020-05-18T21:38:19.468 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2020-05-18T21:38:19.469 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2020-05-18T21:38:19.469 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2020-05-18T21:38:19.469 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2020-05-18T21:38:19.469 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2020-05-18T21:38:19.469 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2020-05-18T21:38:19.469 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2020-05-18T21:38:19.470 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal frag = True 2020-05-18T21:38:19.470 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2020-05-18T21:38:19.470 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2020-05-18T21:38:19.470 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2020-05-18T21:38:19.470 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2020-05-18T21:38:19.470 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2020-05-18T21:38:19.471 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2020-05-18T21:38:19.471 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2020-05-18T21:38:19.471 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2020-05-18T21:38:19.471 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2020-05-18T21:38:19.472 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_strays.TestStrays.test_replicated_delete_speed' 2020-05-18T21:38:19.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6a21d700 1 Processor -- start 2020-05-18T21:38:19.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6a21d700 1 -- start start 2020-05-18T21:38:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6a21d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b6412f2d0 0x7f3b64145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6a21d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3b640b7ee0 0x7f3b640604d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6a21d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b640b77a0 con 0x7f3b640b7060 2020-05-18T21:38:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6a21d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b640b7590 con 0x7f3b6412f2d0 2020-05-18T21:38:19.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6a21d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b640b7a40 con 0x7f3b640b7ee0 2020-05-18T21:38:19.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6921b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b6412f2d0 0x7f3b64145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:19.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6921b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b6412f2d0 0x7f3b64145dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36592/0 (socket says 172.21.15.63:36592) 2020-05-18T21:38:19.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6921b700 1 -- 172.21.15.63:0/1781242608 learned_addr learned my addr 172.21.15.63:0/1781242608 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:19.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b69a1c700 1 --2- 172.21.15.63:0/1781242608 >> v2:172.21.15.155:3300/0 conn(0x7f3b640b7ee0 0x7f3b640604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6921b700 1 -- 172.21.15.63:0/1781242608 >> v2:172.21.15.155:3300/0 conn(0x7f3b640b7ee0 msgr2=0x7f3b640604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6921b700 1 --2- 172.21.15.63:0/1781242608 >> v2:172.21.15.155:3300/0 conn(0x7f3b640b7ee0 0x7f3b640604d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6921b700 1 -- 172.21.15.63:0/1781242608 >> v1:172.21.15.155:6789/0 conn(0x7f3b640b7060 legacy=0x7f3b640b8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6921b700 1 -- 172.21.15.63:0/1781242608 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b640b8340 con 0x7f3b6412f2d0 2020-05-18T21:38:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b69a1c700 1 --2- 172.21.15.63:0/1781242608 >> v2:172.21.15.155:3300/0 conn(0x7f3b640b7ee0 0x7f3b640604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:38:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6921b700 1 --2- 172.21.15.63:0/1781242608 >> v2:172.21.15.63:3300/0 conn(0x7f3b6412f2d0 0x7f3b64145dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3b60002f70 tx=0x7f3b60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6921b700 1 --2- 172.21.15.63:0/1781242608 >> v2:172.21.15.63:3300/0 conn(0x7f3b6412f2d0 0x7f3b64145dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3b60002f70 tx=0x7f3b60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6921b700 1 --2- 172.21.15.63:0/1781242608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b6412f2d0 0x7f3b64145dc0 secure :-1 s=READY pgs=2116 cs=0 l=1 rx=0x7f3b60002f70 tx=0x7f3b60007a80).ready entity=mon.0 client_cookie=6f1d718aaf9e6bc1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6921b700 1 --2- 172.21.15.63:0/1781242608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b6412f2d0 0x7f3b64145dc0 secure :-1 s=THROTTLE_DONE pgs=2116 cs=0 l=1 rx=0x7f3b60002f70 tx=0x7f3b60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b4ffff700 1 -- 172.21.15.63:0/1781242608 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b60011760 con 0x7f3b6412f2d0 2020-05-18T21:38:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6921b700 1 --2- 172.21.15.63:0/1781242608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b6412f2d0 0x7f3b64145dc0 secure :-1 s=THROTTLE_DONE pgs=2116 cs=0 l=1 rx=0x7f3b60002f70 tx=0x7f3b60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b4ffff700 1 -- 172.21.15.63:0/1781242608 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b600118c0 con 0x7f3b6412f2d0 2020-05-18T21:38:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6921b700 1 --2- 172.21.15.63:0/1781242608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b6412f2d0 0x7f3b64145dc0 secure :-1 s=THROTTLE_DONE pgs=2116 cs=0 l=1 rx=0x7f3b60002f70 tx=0x7f3b60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b4ffff700 1 -- 172.21.15.63:0/1781242608 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b60011ce0 con 0x7f3b6412f2d0 2020-05-18T21:38:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6a21d700 1 -- 172.21.15.63:0/1781242608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b6412f2d0 msgr2=0x7f3b64145dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:19.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.596+0000 7f3b6a21d700 1 --2- 172.21.15.63:0/1781242608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b6412f2d0 0x7f3b64145dc0 secure :-1 s=READY pgs=2116 cs=0 l=1 rx=0x7f3b60002f70 tx=0x7f3b60007a80).stop 2020-05-18T21:38:19.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b6a21d700 1 -- 172.21.15.63:0/1781242608 shutdown_connections 2020-05-18T21:38:19.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b6a21d700 1 --2- 172.21.15.63:0/1781242608 >> v2:172.21.15.155:3300/0 conn(0x7f3b640b7ee0 0x7f3b640604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:19.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b6a21d700 1 --2- 172.21.15.63:0/1781242608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b6412f2d0 0x7f3b64145dc0 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:19.613 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b6a21d700 1 -- 172.21.15.63:0/1781242608 >> 172.21.15.63:0/1781242608 conn(0x7f3b64069b70 msgr2=0x7f3b64069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:19.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b6a21d700 1 -- 172.21.15.63:0/1781242608 shutdown_connections 2020-05-18T21:38:19.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b6a21d700 1 -- 172.21.15.63:0/1781242608 wait complete. 2020-05-18T21:38:19.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b6a21d700 1 Processor -- start 2020-05-18T21:38:19.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b6a21d700 1 -- start start 2020-05-18T21:38:19.614 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b6a21d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b640b7ee0 0x7f3b64148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b6a21d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b6412f2d0 0x7f3b6412cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b6a21d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b64153c10 con 0x7f3b640b7060 2020-05-18T21:38:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b6a21d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b640ac570 con 0x7f3b6412f2d0 2020-05-18T21:38:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b6a21d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b64148970 con 0x7f3b640b7ee0 2020-05-18T21:38:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b69a1c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b6412f2d0 0x7f3b6412cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b6921b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3b640b7060 0x7f3b64153500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38786/0 (socket says 172.21.15.63:38786) 2020-05-18T21:38:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b6921b700 1 -- 172.21.15.63:0/840270501 learned_addr learned my addr 172.21.15.63:0/840270501 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b68a1a700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b640b7ee0 0x7f3b64148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b69a1c700 1 -- 172.21.15.63:0/840270501 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b640b7ee0 msgr2=0x7f3b64148510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b69a1c700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b640b7ee0 0x7f3b64148510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:19.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b69a1c700 1 -- 172.21.15.63:0/840270501 >> v1:172.21.15.63:6789/0 conn(0x7f3b640b7060 legacy=0x7f3b64153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:19.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b69a1c700 1 -- 172.21.15.63:0/840270501 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b640ac7d0 con 0x7f3b6412f2d0 2020-05-18T21:38:19.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b68a1a700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b640b7ee0 0x7f3b64148510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:38:19.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b69a1c700 1 --2- 172.21.15.63:0/840270501 >> v2:172.21.15.63:3300/0 conn(0x7f3b6412f2d0 0x7f3b6412cd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b5c003340 tx=0x7f3b64060110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.600+0000 7f3b69a1c700 1 --2- 172.21.15.63:0/840270501 >> v2:172.21.15.63:3300/0 conn(0x7f3b6412f2d0 0x7f3b6412cd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b5c003340 tx=0x7f3b64060110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.617 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.604+0000 7f3b69a1c700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b6412f2d0 0x7f3b6412cd40 secure :-1 s=READY pgs=2118 cs=0 l=1 rx=0x7f3b5c003340 tx=0x7f3b64060110).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:19.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.604+0000 7f3b69a1c700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b6412f2d0 0x7f3b6412cd40 secure :-1 s=THROTTLE_DONE pgs=2118 cs=0 l=1 rx=0x7f3b5c003340 tx=0x7f3b64060110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.604+0000 7f3b69a1c700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b6412f2d0 0x7f3b6412cd40 secure :-1 s=THROTTLE_DONE pgs=2118 cs=0 l=1 rx=0x7f3b5c003340 tx=0x7f3b64060110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.604+0000 7f3b69a1c700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b6412f2d0 0x7f3b6412cd40 secure :-1 s=THROTTLE_DONE pgs=2118 cs=0 l=1 rx=0x7f3b5c003340 tx=0x7f3b64060110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.618 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.604+0000 7f3b56ffd700 1 -- 172.21.15.63:0/840270501 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b5c007560 con 0x7f3b6412f2d0 2020-05-18T21:38:19.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.604+0000 7f3b56ffd700 1 -- 172.21.15.63:0/840270501 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5c0076c0 con 0x7f3b6412f2d0 2020-05-18T21:38:19.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.604+0000 7f3b6a21d700 1 -- 172.21.15.63:0/840270501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b640af1c0 con 0x7f3b6412f2d0 2020-05-18T21:38:19.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.604+0000 7f3b56ffd700 1 -- 172.21.15.63:0/840270501 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b5c0124d0 con 0x7f3b6412f2d0 2020-05-18T21:38:19.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.604+0000 7f3b6a21d700 1 -- 172.21.15.63:0/840270501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b640afe50 con 0x7f3b6412f2d0 2020-05-18T21:38:19.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.604+0000 7f3b69a1c700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b6412f2d0 0x7f3b6412cd40 secure :-1 s=THROTTLE_DONE pgs=2118 cs=0 l=1 rx=0x7f3b5c003340 tx=0x7f3b64060110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.619 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.604+0000 7f3b6a21d700 1 -- 172.21.15.63:0/840270501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b640569e0 con 0x7f3b6412f2d0 2020-05-18T21:38:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.604+0000 7f3b56ffd700 1 -- 172.21.15.63:0/840270501 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3b5c0101a0 con 0x7f3b6412f2d0 2020-05-18T21:38:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.604+0000 7f3b69a1c700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b6412f2d0 0x7f3b6412cd40 secure :-1 s=THROTTLE_DONE pgs=2118 cs=0 l=1 rx=0x7f3b5c003340 tx=0x7f3b64060110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.604+0000 7f3b56ffd700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b4004fa60 0x7f3b40051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.604+0000 7f3b56ffd700 1 -- 172.21.15.63:0/840270501 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f3b5c063e00 con 0x7f3b6412f2d0 2020-05-18T21:38:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.604+0000 7f3b6921b700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b4004fa60 0x7f3b40051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.608+0000 7f3b6921b700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b4004fa60 0x7f3b40051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b6414aad0 tx=0x7f3b60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.608+0000 7f3b6921b700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b4004fa60 0x7f3b40051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b6414aad0 tx=0x7f3b60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.608+0000 7f3b6921b700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b4004fa60 0x7f3b40051f20 secure :-1 s=READY pgs=831 cs=0 l=1 rx=0x7f3b6414aad0 tx=0x7f3b60007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.612+0000 7f3b69a1c700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b6412f2d0 0x7f3b6412cd40 secure :-1 s=THROTTLE_DONE pgs=2118 cs=0 l=1 rx=0x7f3b5c003340 tx=0x7f3b64060110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.612+0000 7f3b56ffd700 1 -- 172.21.15.63:0/840270501 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3b5c03e130 con 0x7f3b6412f2d0 2020-05-18T21:38:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.760+0000 7f3b6a21d700 1 -- 172.21.15.63:0/840270501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_replicated_delete_speed"]} v 0) v1 -- 0x7f3b640ba1b0 con 0x7f3b6412f2d0 2020-05-18T21:38:19.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.812+0000 7f3b69a1c700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b6412f2d0 0x7f3b6412cd40 secure :-1 s=THROTTLE_DONE pgs=2118 cs=0 l=1 rx=0x7f3b5c003340 tx=0x7f3b64060110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.812+0000 7f3b56ffd700 1 -- 172.21.15.63:0/840270501 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_replicated_delete_speed"]}]=0 v563) v1 ==== 143+0+0 (secure 0 0 0) 0x7f3b5c041750 con 0x7f3b6412f2d0 2020-05-18T21:38:19.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.812+0000 7f3b6a21d700 1 -- 172.21.15.63:0/840270501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b4004fa60 msgr2=0x7f3b40051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:19.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.812+0000 7f3b6a21d700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b4004fa60 0x7f3b40051f20 secure :-1 s=READY pgs=831 cs=0 l=1 rx=0x7f3b6414aad0 tx=0x7f3b60007a80).stop 2020-05-18T21:38:19.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.812+0000 7f3b6a21d700 1 -- 172.21.15.63:0/840270501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b6412f2d0 msgr2=0x7f3b6412cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:19.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.812+0000 7f3b6a21d700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b6412f2d0 0x7f3b6412cd40 secure :-1 s=READY pgs=2118 cs=0 l=1 rx=0x7f3b5c003340 tx=0x7f3b64060110).stop 2020-05-18T21:38:19.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.812+0000 7f3b6a21d700 1 -- 172.21.15.63:0/840270501 shutdown_connections 2020-05-18T21:38:19.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.812+0000 7f3b6a21d700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3b4004fa60 0x7f3b40051f20 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:19.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.812+0000 7f3b6a21d700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b6412f2d0 0x7f3b6412cd40 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:19.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.812+0000 7f3b6a21d700 1 --2- 172.21.15.63:0/840270501 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b640b7ee0 0x7f3b64148510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:19.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.812+0000 7f3b6a21d700 1 -- 172.21.15.63:0/840270501 >> 172.21.15.63:0/840270501 conn(0x7f3b64069b70 msgr2=0x7f3b640b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:19.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.812+0000 7f3b6a21d700 1 -- 172.21.15.63:0/840270501 shutdown_connections 2020-05-18T21:38:19.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.812+0000 7f3b6a21d700 1 -- 172.21.15.63:0/840270501 wait complete. 2020-05-18T21:38:19.833 INFO:tasks.cephfs_test_runner:test_replicated_delete_speed (tasks.cephfs.test_strays.TestStrays) ... ok 2020-05-18T21:38:19.839 INFO:tasks.cephfs_test_runner:Starting test: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays) 2020-05-18T21:38:19.840 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_strays.TestStrays.test_snapshot_remove' 2020-05-18T21:38:19.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe27474d700 1 Processor -- start 2020-05-18T21:38:19.947 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe27474d700 1 -- start start 2020-05-18T21:38:19.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe27474d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe26c0b9350 0x7fe26c0b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:19.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe27474d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe26c14a0d0 0x7fe26c145340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:19.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe27474d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe26c1457a0 0x7fe26c069b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:19.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe27474d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26c149990 con 0x7fe26c14a0d0 2020-05-18T21:38:19.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe27474d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26c149c30 con 0x7fe26c0b9350 2020-05-18T21:38:19.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe27474d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c1493e0 con 0x7fe26c1457a0 2020-05-18T21:38:19.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe271ce8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe26c14a0d0 0x7fe26c145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:19.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe271ce8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe26c14a0d0 0x7fe26c145340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36608/0 (socket says 172.21.15.63:36608) 2020-05-18T21:38:19.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe271ce8700 1 -- 172.21.15.63:0/3857074283 learned_addr learned my addr 172.21.15.63:0/3857074283 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:19.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe2724e9700 1 --2- 172.21.15.63:0/3857074283 >> v2:172.21.15.155:3300/0 conn(0x7fe26c0b9350 0x7fe26c0b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:19.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe272cea700 1 --2- 172.21.15.63:0/3857074283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe26c1457a0 0x7fe26c069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:19.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe271ce8700 1 -- 172.21.15.63:0/3857074283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe26c1457a0 msgr2=0x7fe26c069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:19.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe271ce8700 1 --2- 172.21.15.63:0/3857074283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe26c1457a0 0x7fe26c069b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:19.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe271ce8700 1 -- 172.21.15.63:0/3857074283 >> v2:172.21.15.155:3300/0 conn(0x7fe26c0b9350 msgr2=0x7fe26c0b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:19.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe271ce8700 1 --2- 172.21.15.63:0/3857074283 >> v2:172.21.15.155:3300/0 conn(0x7fe26c0b9350 0x7fe26c0b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:19.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe271ce8700 1 -- 172.21.15.63:0/3857074283 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c145c10 con 0x7fe26c14a0d0 2020-05-18T21:38:19.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe271ce8700 1 --2- 172.21.15.63:0/3857074283 >> v2:172.21.15.63:3300/0 conn(0x7fe26c14a0d0 0x7fe26c145340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe268002f70 tx=0x7fe268007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.940+0000 7fe271ce8700 1 --2- 172.21.15.63:0/3857074283 >> v2:172.21.15.63:3300/0 conn(0x7fe26c14a0d0 0x7fe26c145340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe268002f70 tx=0x7fe268007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe271ce8700 1 --2- 172.21.15.63:0/3857074283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe26c14a0d0 0x7fe26c145340 secure :-1 s=READY pgs=2119 cs=0 l=1 rx=0x7fe268002f70 tx=0x7fe268007a80).ready entity=mon.0 client_cookie=ac870741f7c19d3d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:19.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe271ce8700 1 --2- 172.21.15.63:0/3857074283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe26c14a0d0 0x7fe26c145340 secure :-1 s=THROTTLE_DONE pgs=2119 cs=0 l=1 rx=0x7fe268002f70 tx=0x7fe268007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe271ce8700 1 --2- 172.21.15.63:0/3857074283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe26c14a0d0 0x7fe26c145340 secure :-1 s=THROTTLE_DONE pgs=2119 cs=0 l=1 rx=0x7fe268002f70 tx=0x7fe268007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe2714e7700 1 -- 172.21.15.63:0/3857074283 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe268011600 con 0x7fe26c14a0d0 2020-05-18T21:38:19.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe271ce8700 1 --2- 172.21.15.63:0/3857074283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe26c14a0d0 0x7fe26c145340 secure :-1 s=THROTTLE_DONE pgs=2119 cs=0 l=1 rx=0x7fe268002f70 tx=0x7fe268007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe2714e7700 1 -- 172.21.15.63:0/3857074283 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe268011760 con 0x7fe26c14a0d0 2020-05-18T21:38:19.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe2714e7700 1 -- 172.21.15.63:0/3857074283 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe268011b80 con 0x7fe26c14a0d0 2020-05-18T21:38:19.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe27474d700 1 -- 172.21.15.63:0/3857074283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe26c14a0d0 msgr2=0x7fe26c145340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:19.955 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe27474d700 1 --2- 172.21.15.63:0/3857074283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe26c14a0d0 0x7fe26c145340 secure :-1 s=READY pgs=2119 cs=0 l=1 rx=0x7fe268002f70 tx=0x7fe268007a80).stop 2020-05-18T21:38:19.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe27474d700 1 -- 172.21.15.63:0/3857074283 shutdown_connections 2020-05-18T21:38:19.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe27474d700 1 --2- 172.21.15.63:0/3857074283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe26c1457a0 0x7fe26c069b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:19.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe27474d700 1 --2- 172.21.15.63:0/3857074283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe26c14a0d0 0x7fe26c145340 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:19.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe27474d700 1 --2- 172.21.15.63:0/3857074283 >> v2:172.21.15.155:3300/0 conn(0x7fe26c0b9350 0x7fe26c0b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:19.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe27474d700 1 -- 172.21.15.63:0/3857074283 >> 172.21.15.63:0/3857074283 conn(0x7fe26c05f210 msgr2=0x7fe26c066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:19.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe27474d700 1 -- 172.21.15.63:0/3857074283 shutdown_connections 2020-05-18T21:38:19.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe27474d700 1 -- 172.21.15.63:0/3857074283 wait complete. 2020-05-18T21:38:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe27474d700 1 Processor -- start 2020-05-18T21:38:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe27474d700 1 -- start start 2020-05-18T21:38:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe27474d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe26c0b9350 0x7fe26c0afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe27474d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe26c14a0d0 0x7fe26c148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe27474d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26c0aeea0 con 0x7fe26c1457a0 2020-05-18T21:38:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe27474d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26c148670 con 0x7fe26c14a0d0 2020-05-18T21:38:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.944+0000 7fe27474d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c0af140 con 0x7fe26c0b9350 2020-05-18T21:38:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe271ce8700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe26c1457a0 0x7fe26c153580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38802/0 (socket says 172.21.15.63:38802) 2020-05-18T21:38:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe271ce8700 1 -- 172.21.15.63:0/101263565 learned_addr learned my addr 172.21.15.63:0/101263565 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe2724e9700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe26c0b9350 0x7fe26c0afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe272cea700 1 --2- 172.21.15.63:0/101263565 >> v2:172.21.15.155:3300/0 conn(0x7fe26c14a0d0 0x7fe26c148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe25b7fe700 1 -- 172.21.15.63:0/101263565 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859487065 0 0) 0x7fe26c0aeea0 con 0x7fe26c1457a0 2020-05-18T21:38:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe25b7fe700 1 -- 172.21.15.63:0/101263565 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe24c002fe0 con 0x7fe26c1457a0 2020-05-18T21:38:19.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe25b7fe700 1 -- 172.21.15.63:0/101263565 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1103176999 0 0) 0x7fe24c002fe0 con 0x7fe26c1457a0 2020-05-18T21:38:19.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe25b7fe700 1 -- 172.21.15.63:0/101263565 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe26c0aeea0 con 0x7fe26c1457a0 2020-05-18T21:38:19.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe25b7fe700 1 -- 172.21.15.63:0/101263565 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fe268008620 con 0x7fe26c1457a0 2020-05-18T21:38:19.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe272cea700 1 -- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe26c0b9350 msgr2=0x7fe26c0afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:19.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe272cea700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe26c0b9350 0x7fe26c0afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:19.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe272cea700 1 -- 172.21.15.63:0/101263565 >> v1:172.21.15.63:6789/0 conn(0x7fe26c1457a0 legacy=0x7fe26c153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:19.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe272cea700 1 -- 172.21.15.63:0/101263565 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c1405a0 con 0x7fe26c14a0d0 2020-05-18T21:38:19.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe2724e9700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe26c0b9350 0x7fe26c0afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:38:19.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe272cea700 1 --2- 172.21.15.63:0/101263565 >> v2:172.21.15.155:3300/0 conn(0x7fe26c14a0d0 0x7fe26c148840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe26c0b1330 tx=0x7fe264010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe272cea700 1 --2- 172.21.15.63:0/101263565 >> v2:172.21.15.155:3300/0 conn(0x7fe26c14a0d0 0x7fe26c148840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe26c0b1330 tx=0x7fe264010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe272cea700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe26c14a0d0 0x7fe26c148840 secure :-1 s=READY pgs=1414 cs=0 l=1 rx=0x7fe26c0b1330 tx=0x7fe264010f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:19.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe272cea700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe26c14a0d0 0x7fe26c148840 secure :-1 s=THROTTLE_DONE pgs=1414 cs=0 l=1 rx=0x7fe26c0b1330 tx=0x7fe264010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe25b7fe700 1 -- 172.21.15.63:0/101263565 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe264005a80 con 0x7fe26c14a0d0 2020-05-18T21:38:19.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe272cea700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe26c14a0d0 0x7fe26c148840 secure :-1 s=THROTTLE_DONE pgs=1414 cs=0 l=1 rx=0x7fe26c0b1330 tx=0x7fe264010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe27474d700 1 -- 172.21.15.63:0/101263565 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26c140730 con 0x7fe26c14a0d0 2020-05-18T21:38:19.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe25b7fe700 1 -- 172.21.15.63:0/101263565 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe264005be0 con 0x7fe26c14a0d0 2020-05-18T21:38:19.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe272cea700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe26c14a0d0 0x7fe26c148840 secure :-1 s=THROTTLE_DONE pgs=1414 cs=0 l=1 rx=0x7fe26c0b1330 tx=0x7fe264010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe25b7fe700 1 -- 172.21.15.63:0/101263565 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe26400c730 con 0x7fe26c14a0d0 2020-05-18T21:38:19.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe27474d700 1 -- 172.21.15.63:0/101263565 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26c0ae490 con 0x7fe26c14a0d0 2020-05-18T21:38:19.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.948+0000 7fe272cea700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe26c14a0d0 0x7fe26c148840 secure :-1 s=THROTTLE_DONE pgs=1414 cs=0 l=1 rx=0x7fe26c0b1330 tx=0x7fe264010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.952+0000 7fe27474d700 1 -- 172.21.15.63:0/101263565 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26c0569e0 con 0x7fe26c14a0d0 2020-05-18T21:38:19.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.952+0000 7fe25b7fe700 1 -- 172.21.15.63:0/101263565 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe26400c930 con 0x7fe26c14a0d0 2020-05-18T21:38:19.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.952+0000 7fe272cea700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe26c14a0d0 0x7fe26c148840 secure :-1 s=THROTTLE_DONE pgs=1414 cs=0 l=1 rx=0x7fe26c0b1330 tx=0x7fe264010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.952+0000 7fe25b7fe700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe24c050050 0x7fe24c052510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:19.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.952+0000 7fe25b7fe700 1 -- 172.21.15.63:0/101263565 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe2640637a0 con 0x7fe26c14a0d0 2020-05-18T21:38:19.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.952+0000 7fe2724e9700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe24c050050 0x7fe24c052510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:19.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.952+0000 7fe2724e9700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe24c050050 0x7fe24c052510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe25c002f70 tx=0x7fe25c00bda0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.952+0000 7fe2724e9700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe24c050050 0x7fe24c052510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe25c002f70 tx=0x7fe25c00bda0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.952+0000 7fe2724e9700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe24c050050 0x7fe24c052510 secure :-1 s=READY pgs=832 cs=0 l=1 rx=0x7fe25c002f70 tx=0x7fe25c00bda0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:19.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.960+0000 7fe272cea700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe26c14a0d0 0x7fe26c148840 secure :-1 s=THROTTLE_DONE pgs=1414 cs=0 l=1 rx=0x7fe26c0b1330 tx=0x7fe264010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:19.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:19.960+0000 7fe25b7fe700 1 -- 172.21.15.63:0/101263565 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fe26403db50 con 0x7fe26c14a0d0 2020-05-18T21:38:20.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:20.112+0000 7fe27474d700 1 -- 172.21.15.63:0/101263565 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_snapshot_remove"]} v 0) v1 -- 0x7fe26c0ad700 con 0x7fe26c14a0d0 2020-05-18T21:38:20.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:20.820+0000 7fe272cea700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe26c14a0d0 0x7fe26c148840 secure :-1 s=THROTTLE_DONE pgs=1414 cs=0 l=1 rx=0x7fe26c0b1330 tx=0x7fe264010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:20.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:20.820+0000 7fe25b7fe700 1 -- 172.21.15.63:0/101263565 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_snapshot_remove"]}]=0 v564) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe264041170 con 0x7fe26c14a0d0 2020-05-18T21:38:20.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:20.824+0000 7fe27474d700 1 -- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe24c050050 msgr2=0x7fe24c052510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:20.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:20.824+0000 7fe27474d700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe24c050050 0x7fe24c052510 secure :-1 s=READY pgs=832 cs=0 l=1 rx=0x7fe25c002f70 tx=0x7fe25c00bda0).stop 2020-05-18T21:38:20.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:20.824+0000 7fe27474d700 1 -- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe26c14a0d0 msgr2=0x7fe26c148840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:20.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:20.824+0000 7fe27474d700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe26c14a0d0 0x7fe26c148840 secure :-1 s=READY pgs=1414 cs=0 l=1 rx=0x7fe26c0b1330 tx=0x7fe264010f60).stop 2020-05-18T21:38:20.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:20.824+0000 7fe27474d700 1 -- 172.21.15.63:0/101263565 shutdown_connections 2020-05-18T21:38:20.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:20.824+0000 7fe27474d700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe24c050050 0x7fe24c052510 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:20.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:20.824+0000 7fe27474d700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe26c14a0d0 0x7fe26c148840 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:20.831 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:20.824+0000 7fe27474d700 1 --2- 172.21.15.63:0/101263565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe26c0b9350 0x7fe26c0afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:20.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:20.824+0000 7fe27474d700 1 -- 172.21.15.63:0/101263565 >> 172.21.15.63:0/101263565 conn(0x7fe26c05f210 msgr2=0x7fe26c0ad920 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:20.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:20.824+0000 7fe27474d700 1 -- 172.21.15.63:0/101263565 shutdown_connections 2020-05-18T21:38:20.832 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:20.824+0000 7fe27474d700 1 -- 172.21.15.63:0/101263565 wait complete. 2020-05-18T21:38:20.847 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:38:20.848 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:38:20.863 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:38:20.884 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:38:20.884 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-05-18T21:38:21.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.004+0000 7fb0ed75f700 1 Processor -- start 2020-05-18T21:38:21.013 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.004+0000 7fb0ed75f700 1 -- start start 2020-05-18T21:38:21.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0ed75f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0e80b2860 0x7fb0e80615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:21.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0ed75f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb0e814e570 0x7fb0e814a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:21.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0ed75f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e814d960 con 0x7fb0e8060b90 2020-05-18T21:38:21.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0ed75f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e8066210 con 0x7fb0e814e570 2020-05-18T21:38:21.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0ed75f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e814db90 con 0x7fb0e80b2860 2020-05-18T21:38:21.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0e77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb0e814e570 0x7fb0e814a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:21.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0e77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb0e814e570 0x7fb0e814a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36624/0 (socket says 172.21.15.63:36624) 2020-05-18T21:38:21.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0e77fe700 1 -- 172.21.15.63:0/3246801840 learned_addr learned my addr 172.21.15.63:0/3246801840 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:21.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0e67fc700 1 --2- 172.21.15.63:0/3246801840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0e80b2860 0x7fb0e80615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:21.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0e77fe700 1 -- 172.21.15.63:0/3246801840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0e80b2860 msgr2=0x7fb0e80615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:21.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0e77fe700 1 --2- 172.21.15.63:0/3246801840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0e80b2860 0x7fb0e80615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:21.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0e77fe700 1 -- 172.21.15.63:0/3246801840 >> v1:172.21.15.155:6789/0 conn(0x7fb0e8060b90 legacy=0x7fb0e8144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:21.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0e77fe700 1 -- 172.21.15.63:0/3246801840 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e814de30 con 0x7fb0e814e570 2020-05-18T21:38:21.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0e77fe700 1 --2- 172.21.15.63:0/3246801840 >> v2:172.21.15.63:3300/0 conn(0x7fb0e814e570 0x7fb0e814a390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb0e00032f0 tx=0x7fb0e0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0e77fe700 1 --2- 172.21.15.63:0/3246801840 >> v2:172.21.15.63:3300/0 conn(0x7fb0e814e570 0x7fb0e814a390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb0e00032f0 tx=0x7fb0e0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0e77fe700 1 --2- 172.21.15.63:0/3246801840 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0e814e570 0x7fb0e814a390 secure :-1 s=READY pgs=2121 cs=0 l=1 rx=0x7fb0e00032f0 tx=0x7fb0e0007e00).ready entity=mon.0 client_cookie=2fdbbfd5c8b0aa40 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:21.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0e77fe700 1 --2- 172.21.15.63:0/3246801840 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0e814e570 0x7fb0e814a390 secure :-1 s=THROTTLE_DONE pgs=2121 cs=0 l=1 rx=0x7fb0e00032f0 tx=0x7fb0e0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0e5ffb700 1 -- 172.21.15.63:0/3246801840 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0e0011d10 con 0x7fb0e814e570 2020-05-18T21:38:21.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0e77fe700 1 --2- 172.21.15.63:0/3246801840 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0e814e570 0x7fb0e814a390 secure :-1 s=THROTTLE_DONE pgs=2121 cs=0 l=1 rx=0x7fb0e00032f0 tx=0x7fb0e0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0e77fe700 1 --2- 172.21.15.63:0/3246801840 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0e814e570 0x7fb0e814a390 secure :-1 s=THROTTLE_DONE pgs=2121 cs=0 l=1 rx=0x7fb0e00032f0 tx=0x7fb0e0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0e5ffb700 1 -- 172.21.15.63:0/3246801840 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e0011e70 con 0x7fb0e814e570 2020-05-18T21:38:21.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0e5ffb700 1 -- 172.21.15.63:0/3246801840 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0e000a370 con 0x7fb0e814e570 2020-05-18T21:38:21.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0ed75f700 1 -- 172.21.15.63:0/3246801840 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0e814e570 msgr2=0x7fb0e814a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:21.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0ed75f700 1 --2- 172.21.15.63:0/3246801840 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0e814e570 0x7fb0e814a390 secure :-1 s=READY pgs=2121 cs=0 l=1 rx=0x7fb0e00032f0 tx=0x7fb0e0007e00).stop 2020-05-18T21:38:21.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0ed75f700 1 -- 172.21.15.63:0/3246801840 shutdown_connections 2020-05-18T21:38:21.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0ed75f700 1 --2- 172.21.15.63:0/3246801840 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0e814e570 0x7fb0e814a390 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:21.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0ed75f700 1 --2- 172.21.15.63:0/3246801840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0e80b2860 0x7fb0e80615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:21.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.008+0000 7fb0ed75f700 1 -- 172.21.15.63:0/3246801840 >> 172.21.15.63:0/3246801840 conn(0x7fb0e80b83d0 msgr2=0x7fb0e80b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:21.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.012+0000 7fb0ed75f700 1 -- 172.21.15.63:0/3246801840 shutdown_connections 2020-05-18T21:38:21.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.012+0000 7fb0ed75f700 1 -- 172.21.15.63:0/3246801840 wait complete. 2020-05-18T21:38:21.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.012+0000 7fb0ed75f700 1 Processor -- start 2020-05-18T21:38:21.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.012+0000 7fb0ed75f700 1 -- start start 2020-05-18T21:38:21.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.012+0000 7fb0ed75f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0e8060b90 0x7fb0e80ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:21.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.012+0000 7fb0ed75f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb0e80b2860 0x7fb0e80b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:21.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.012+0000 7fb0ed75f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb0e814e570 0x7fb0e814ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:21.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.012+0000 7fb0ed75f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e80b7a00 con 0x7fb0e80b2860 2020-05-18T21:38:21.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.012+0000 7fb0ed75f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e814a510 con 0x7fb0e814e570 2020-05-18T21:38:21.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.012+0000 7fb0ed75f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e814a7b0 con 0x7fb0e8060b90 2020-05-18T21:38:21.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.012+0000 7fb0e67fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb0e80b2860 0x7fb0e80b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:21.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.012+0000 7fb0e67fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb0e80b2860 0x7fb0e80b75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36628/0 (socket says 172.21.15.63:36628) 2020-05-18T21:38:21.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.012+0000 7fb0e67fc700 1 -- 172.21.15.63:0/2372901092 learned_addr learned my addr 172.21.15.63:0/2372901092 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:21.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.012+0000 7fb0e6ffd700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0e8060b90 0x7fb0e80ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:21.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.012+0000 7fb0e77fe700 1 --2- 172.21.15.63:0/2372901092 >> v2:172.21.15.155:3300/0 conn(0x7fb0e814e570 0x7fb0e814ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:21.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0e67fc700 1 -- 172.21.15.63:0/2372901092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0e8060b90 msgr2=0x7fb0e80ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:21.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0e67fc700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0e8060b90 0x7fb0e80ac4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:21.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0e67fc700 1 -- 172.21.15.63:0/2372901092 >> v2:172.21.15.155:3300/0 conn(0x7fb0e814e570 msgr2=0x7fb0e814ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:21.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0e67fc700 1 --2- 172.21.15.63:0/2372901092 >> v2:172.21.15.155:3300/0 conn(0x7fb0e814e570 0x7fb0e814ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:21.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0e67fc700 1 -- 172.21.15.63:0/2372901092 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e80ad5b0 con 0x7fb0e80b2860 2020-05-18T21:38:21.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0e67fc700 1 --2- 172.21.15.63:0/2372901092 >> v2:172.21.15.63:3300/0 conn(0x7fb0e80b2860 0x7fb0e80b75a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb0d80030b0 tx=0x7fb0d8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0e67fc700 1 --2- 172.21.15.63:0/2372901092 >> v2:172.21.15.63:3300/0 conn(0x7fb0e80b2860 0x7fb0e80b75a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb0d80030b0 tx=0x7fb0d8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0e67fc700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0e80b2860 0x7fb0e80b75a0 secure :-1 s=READY pgs=2122 cs=0 l=1 rx=0x7fb0d80030b0 tx=0x7fb0d8010ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:21.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0e67fc700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0e80b2860 0x7fb0e80b75a0 secure :-1 s=THROTTLE_DONE pgs=2122 cs=0 l=1 rx=0x7fb0d80030b0 tx=0x7fb0d8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0e67fc700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0e80b2860 0x7fb0e80b75a0 secure :-1 s=THROTTLE_DONE pgs=2122 cs=0 l=1 rx=0x7fb0d80030b0 tx=0x7fb0d8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0d7fff700 1 -- 172.21.15.63:0/2372901092 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0d8007560 con 0x7fb0e80b2860 2020-05-18T21:38:21.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0e67fc700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0e80b2860 0x7fb0e80b75a0 secure :-1 s=THROTTLE_DONE pgs=2122 cs=0 l=1 rx=0x7fb0d80030b0 tx=0x7fb0d8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0d7fff700 1 -- 172.21.15.63:0/2372901092 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d8005a00 con 0x7fb0e80b2860 2020-05-18T21:38:21.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0ed75f700 1 -- 172.21.15.63:0/2372901092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e814b0b0 con 0x7fb0e80b2860 2020-05-18T21:38:21.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0d7fff700 1 -- 172.21.15.63:0/2372901092 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0d8008000 con 0x7fb0e80b2860 2020-05-18T21:38:21.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0ed75f700 1 -- 172.21.15.63:0/2372901092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e80aeb20 con 0x7fb0e80b2860 2020-05-18T21:38:21.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0e67fc700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0e80b2860 0x7fb0e80b75a0 secure :-1 s=THROTTLE_DONE pgs=2122 cs=0 l=1 rx=0x7fb0d80030b0 tx=0x7fb0d8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0ed75f700 1 -- 172.21.15.63:0/2372901092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e80569e0 con 0x7fb0e80b2860 2020-05-18T21:38:21.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0d7fff700 1 -- 172.21.15.63:0/2372901092 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb0d80089b0 con 0x7fb0e80b2860 2020-05-18T21:38:21.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0e67fc700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0e80b2860 0x7fb0e80b75a0 secure :-1 s=THROTTLE_DONE pgs=2122 cs=0 l=1 rx=0x7fb0d80030b0 tx=0x7fb0d8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0d7fff700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0c404fac0 0x7fb0c4051f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:21.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0d7fff700 1 -- 172.21.15.63:0/2372901092 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb0d8063cd0 con 0x7fb0e80b2860 2020-05-18T21:38:21.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.016+0000 7fb0e6ffd700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0c404fac0 0x7fb0c4051f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:21.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.020+0000 7fb0e6ffd700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0c404fac0 0x7fb0c4051f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb0e8060650 tx=0x7fb0dc003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.020+0000 7fb0e6ffd700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0c404fac0 0x7fb0c4051f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb0e8060650 tx=0x7fb0dc003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.020+0000 7fb0e6ffd700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0c404fac0 0x7fb0c4051f80 secure :-1 s=READY pgs=833 cs=0 l=1 rx=0x7fb0e8060650 tx=0x7fb0dc003e60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:21.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.024+0000 7fb0e67fc700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0e80b2860 0x7fb0e80b75a0 secure :-1 s=THROTTLE_DONE pgs=2122 cs=0 l=1 rx=0x7fb0d80030b0 tx=0x7fb0d8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.024+0000 7fb0d7fff700 1 -- 172.21.15.63:0/2372901092 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb0d803e0c0 con 0x7fb0e80b2860 2020-05-18T21:38:21.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.140+0000 7fb0ed75f700 1 -- 172.21.15.63:0/2372901092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb0e814a920 con 0x7fb0e80b2860 2020-05-18T21:38:21.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.144+0000 7fb0e67fc700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0e80b2860 0x7fb0e80b75a0 secure :-1 s=THROTTLE_DONE pgs=2122 cs=0 l=1 rx=0x7fb0d80030b0 tx=0x7fb0d8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.144+0000 7fb0d7fff700 1 -- 172.21.15.63:0/2372901092 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v158) v1 ==== 81+0+33866 (secure 0 0 0) 0x7fb0d80416e0 con 0x7fb0e80b2860 2020-05-18T21:38:21.151 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:21.151 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:38:21.151 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 158, 2020-05-18T21:38:21.151 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:38:21.152 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2020-05-18T21:26:28.798650+0000", 2020-05-18T21:38:21.152 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2020-05-18T21:37:59.378279+0000", 2020-05-18T21:38:21.152 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:38:21.152 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2020-05-18T21:26:36.039314+0000", 2020-05-18T21:38:21.152 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-05-18T21:38:21.153 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5799936, 2020-05-18T21:38:21.153 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2020-05-18T21:38:21.153 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2020-05-18T21:38:21.153 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2020-05-18T21:38:21.153 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2020-05-18T21:38:21.154 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2020-05-18T21:38:21.154 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:38:21.154 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 4, 2020-05-18T21:38:21.154 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2020-05-18T21:38:21.154 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-05-18T21:38:21.155 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2020-05-18T21:38:21.155 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2020-05-18T21:38:21.155 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 30, 2020-05-18T21:38:21.155 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 8, 2020-05-18T21:38:21.155 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2020-05-18T21:38:21.155 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "jewel", 2020-05-18T21:38:21.156 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "pacific", 2020-05-18T21:38:21.156 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:38:21.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.156 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2020-05-18T21:38:21.156 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "device_health_metrics", 2020-05-18T21:38:21.157 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:33.080792+0000", 2020-05-18T21:38:21.157 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:38:21.157 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:38:21.157 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:38:21.158 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:38:21.158 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:38:21.158 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:38:21.158 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:38:21.158 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:38:21.159 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2020-05-18T21:38:21.159 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2020-05-18T21:38:21.159 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2020-05-18T21:38:21.159 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2020-05-18T21:38:21.159 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2020-05-18T21:38:21.160 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:38:21.160 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:38:21.160 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:38:21.160 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:38:21.160 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:38:21.160 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:38:21.161 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:38:21.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.161 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "15", 2020-05-18T21:38:21.161 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:38:21.161 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:38:21.162 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:38:21.162 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:38:21.162 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:38:21.162 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:38:21.162 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:38:21.162 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:38:21.163 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:38:21.163 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:38:21.163 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:38:21.163 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:38:21.163 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:38:21.164 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:38:21.164 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:38:21.164 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:38:21.164 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:38:21.164 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:38:21.165 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:38:21.165 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:38:21.165 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:38:21.165 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:38:21.165 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:38:21.166 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:38:21.166 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:38:21.166 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:38:21.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.166 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:38:21.167 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:38:21.167 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:38:21.167 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:38:21.167 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:38:21.167 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:38:21.168 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:38:21.168 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:38:21.168 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:38:21.168 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:38:21.168 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:38:21.169 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:38:21.169 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2020-05-18T21:38:21.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.169 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:38:21.169 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_devicehealth": {} 2020-05-18T21:38:21.169 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.170 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2020-05-18T21:38:21.170 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2020-05-18T21:38:21.170 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:26:40.149370+0000", 2020-05-18T21:38:21.171 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:38:21.171 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:38:21.171 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:38:21.171 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:38:21.171 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:38:21.172 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:38:21.172 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:38:21.172 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:38:21.172 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:38:21.172 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:38:21.172 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:38:21.173 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:38:21.173 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:38:21.173 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:38:21.173 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:38:21.173 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:38:21.174 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:38:21.174 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:38:21.174 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:38:21.174 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:38:21.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.174 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2020-05-18T21:38:21.175 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:38:21.175 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:38:21.175 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:38:21.175 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:38:21.175 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:38:21.176 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:38:21.176 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:38:21.176 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:38:21.176 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:38:21.176 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:38:21.176 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:38:21.177 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:38:21.177 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:38:21.177 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:38:21.177 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:38:21.177 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:38:21.178 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:38:21.178 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:38:21.178 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:38:21.178 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:38:21.178 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:38:21.179 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:38:21.179 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:38:21.179 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:38:21.179 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:38:21.179 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:38:21.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.180 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:38:21.180 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:38:21.180 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:38:21.180 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:38:21.180 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:38:21.181 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:38:21.181 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:38:21.181 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:38:21.181 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:38:21.181 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:38:21.181 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:38:21.182 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:38:21.182 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:38:21.182 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2020-05-18T21:38:21.182 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.183 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 29, 2020-05-18T21:38:21.183 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2020-05-18T21:38:21.183 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:37:43.788191+0000", 2020-05-18T21:38:21.183 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:38:21.183 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:38:21.184 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:38:21.184 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:38:21.184 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:38:21.184 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:38:21.184 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:38:21.185 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:38:21.185 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:38:21.185 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:38:21.185 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:38:21.185 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:38:21.185 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:38:21.186 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:38:21.186 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:38:21.186 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:38:21.186 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:38:21.186 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:38:21.187 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:38:21.187 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:38:21.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.187 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "155", 2020-05-18T21:38:21.187 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:38:21.187 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:38:21.188 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:38:21.188 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:38:21.188 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:38:21.188 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:38:21.188 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:38:21.189 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:38:21.189 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:38:21.189 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:38:21.189 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:38:21.189 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:38:21.190 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:38:21.190 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:38:21.190 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:38:21.190 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:38:21.190 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:38:21.190 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:38:21.191 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:38:21.191 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:38:21.191 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:38:21.191 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:38:21.191 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:38:21.192 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:38:21.192 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:38:21.192 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:38:21.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.192 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:38:21.192 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:38:21.193 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:38:21.193 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:38:21.193 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:38:21.193 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:38:21.193 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:38:21.194 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:38:21.194 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:38:21.194 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:38:21.194 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:38:21.194 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2020-05-18T21:38:21.195 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2020-05-18T21:38:21.195 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2020-05-18T21:38:21.195 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2020-05-18T21:38:21.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.195 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:38:21.196 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:38:21.196 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2020-05-18T21:38:21.196 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.196 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.197 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.197 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 30, 2020-05-18T21:38:21.197 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2020-05-18T21:38:21.197 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2020-05-18T21:37:44.262734+0000", 2020-05-18T21:38:21.197 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2020-05-18T21:38:21.198 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2020-05-18T21:38:21.198 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2020-05-18T21:38:21.198 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2020-05-18T21:38:21.198 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2020-05-18T21:38:21.198 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2020-05-18T21:38:21.198 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2020-05-18T21:38:21.199 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2020-05-18T21:38:21.199 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2020-05-18T21:38:21.199 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2020-05-18T21:38:21.199 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2020-05-18T21:38:21.199 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2020-05-18T21:38:21.200 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2020-05-18T21:38:21.200 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2020-05-18T21:38:21.200 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2020-05-18T21:38:21.200 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2020-05-18T21:38:21.200 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2020-05-18T21:38:21.200 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2020-05-18T21:38:21.201 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2020-05-18T21:38:21.201 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2020-05-18T21:38:21.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.201 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "157", 2020-05-18T21:38:21.201 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2020-05-18T21:38:21.202 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2020-05-18T21:38:21.202 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2020-05-18T21:38:21.202 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2020-05-18T21:38:21.202 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2020-05-18T21:38:21.202 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2020-05-18T21:38:21.203 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2020-05-18T21:38:21.203 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2020-05-18T21:38:21.203 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2020-05-18T21:38:21.203 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2020-05-18T21:38:21.203 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2020-05-18T21:38:21.204 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2020-05-18T21:38:21.204 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2020-05-18T21:38:21.204 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2020-05-18T21:38:21.204 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2020-05-18T21:38:21.204 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2020-05-18T21:38:21.205 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2020-05-18T21:38:21.205 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2020-05-18T21:38:21.205 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-05-18T21:38:21.205 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-05-18T21:38:21.205 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2020-05-18T21:38:21.206 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2020-05-18T21:38:21.206 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2020-05-18T21:38:21.206 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2020-05-18T21:38:21.206 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2020-05-18T21:38:21.206 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2020-05-18T21:38:21.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.207 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2020-05-18T21:38:21.207 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2020-05-18T21:38:21.207 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2020-05-18T21:38:21.207 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2020-05-18T21:38:21.207 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2020-05-18T21:38:21.208 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2020-05-18T21:38:21.208 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2020-05-18T21:38:21.208 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2020-05-18T21:38:21.208 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2020-05-18T21:38:21.208 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2020-05-18T21:38:21.209 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2020-05-18T21:38:21.209 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2020-05-18T21:38:21.209 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2020-05-18T21:38:21.209 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2020-05-18T21:38:21.209 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2020-05-18T21:38:21.209 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.210 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.210 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.210 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:38:21.210 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2020-05-18T21:38:21.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.211 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:38:21.211 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "c6ae0fbf-604c-4e8d-b1b8-6038821420e3", 2020-05-18T21:38:21.211 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:38:21.211 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:38:21.211 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:38:21.211 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:38:21.212 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:38:21.212 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:38:21.212 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:38:21.212 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 154, 2020-05-18T21:38:21.212 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:38:21.213 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:38:21.213 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:38:21.213 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.213 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.214 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2020-05-18T21:38:21.214 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:38:21.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.214 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.214 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2020-05-18T21:38:21.215 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:38:21.215 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.215 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.215 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:38:21.216 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.216 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.216 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6802", 2020-05-18T21:38:21.216 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:38:21.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.217 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.217 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6803", 2020-05-18T21:38:21.217 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:38:21.217 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.218 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.218 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:38:21.218 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.219 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.219 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6806", 2020-05-18T21:38:21.219 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:38:21.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.219 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.220 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6807", 2020-05-18T21:38:21.220 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:38:21.220 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.220 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.221 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:38:21.221 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.221 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.221 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6804", 2020-05-18T21:38:21.222 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:38:21.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.222 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.222 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6805", 2020-05-18T21:38:21.222 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12803 2020-05-18T21:38:21.223 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.223 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.223 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6801/12803", 2020-05-18T21:38:21.223 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6803/12803", 2020-05-18T21:38:21.224 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6807/12803", 2020-05-18T21:38:21.224 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6805/12803", 2020-05-18T21:38:21.224 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:38:21.224 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:38:21.224 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:38:21.224 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.225 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:38:21.225 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6", 2020-05-18T21:38:21.225 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:38:21.226 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:38:21.226 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:38:21.226 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:38:21.226 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:38:21.226 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:38:21.226 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:38:21.227 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 153, 2020-05-18T21:38:21.227 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:38:21.227 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:38:21.227 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:38:21.227 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.228 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.228 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6808", 2020-05-18T21:38:21.228 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:38:21.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.229 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.229 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6809", 2020-05-18T21:38:21.229 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:38:21.229 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.229 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.230 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:38:21.230 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.230 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.230 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6810", 2020-05-18T21:38:21.231 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:38:21.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.231 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.231 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6811", 2020-05-18T21:38:21.232 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:38:21.232 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.232 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.232 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:38:21.232 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.233 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.233 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6815", 2020-05-18T21:38:21.233 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:38:21.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.234 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.234 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6817", 2020-05-18T21:38:21.234 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:38:21.234 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.235 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.235 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:38:21.235 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.235 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.236 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6812", 2020-05-18T21:38:21.236 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:38:21.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.236 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.237 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6813", 2020-05-18T21:38:21.237 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12804 2020-05-18T21:38:21.237 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.237 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.237 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6809/12804", 2020-05-18T21:38:21.238 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6811/12804", 2020-05-18T21:38:21.238 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6817/12804", 2020-05-18T21:38:21.238 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6813/12804", 2020-05-18T21:38:21.238 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:38:21.238 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:38:21.239 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:38:21.239 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.239 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:38:21.239 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "ec8d9fa9-dae9-45f6-b286-735ab3801c27", 2020-05-18T21:38:21.240 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:38:21.240 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:38:21.240 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:38:21.240 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:38:21.240 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:38:21.241 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:38:21.241 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:38:21.241 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 154, 2020-05-18T21:38:21.241 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:38:21.241 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:38:21.241 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:38:21.242 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.242 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.242 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6822", 2020-05-18T21:38:21.242 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:38:21.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.243 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.243 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6824", 2020-05-18T21:38:21.243 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:38:21.244 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.244 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.244 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:38:21.244 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.245 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.245 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6826", 2020-05-18T21:38:21.245 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:38:21.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.246 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.246 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6827", 2020-05-18T21:38:21.246 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:38:21.246 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.246 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.247 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:38:21.247 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.247 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.247 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6830", 2020-05-18T21:38:21.248 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:38:21.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.248 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.248 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6831", 2020-05-18T21:38:21.248 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:38:21.249 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.249 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.249 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:38:21.249 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.250 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.250 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6828", 2020-05-18T21:38:21.250 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:38:21.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.251 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.251 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6829", 2020-05-18T21:38:21.251 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12806 2020-05-18T21:38:21.252 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.252 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.252 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6824/12806", 2020-05-18T21:38:21.252 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6827/12806", 2020-05-18T21:38:21.252 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6831/12806", 2020-05-18T21:38:21.253 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6829/12806", 2020-05-18T21:38:21.253 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:38:21.253 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:38:21.253 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:38:21.253 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.254 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:38:21.254 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "1030fedf-adad-4e79-b839-59385d4d7d2a", 2020-05-18T21:38:21.254 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:38:21.254 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:38:21.255 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:38:21.255 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:38:21.255 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:38:21.255 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:38:21.255 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:38:21.256 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 155, 2020-05-18T21:38:21.256 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:38:21.256 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:38:21.256 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:38:21.256 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.257 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.257 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6814", 2020-05-18T21:38:21.257 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:38:21.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.258 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.258 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6816", 2020-05-18T21:38:21.258 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:38:21.258 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.259 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.259 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:38:21.259 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.260 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.260 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6818", 2020-05-18T21:38:21.260 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:38:21.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.260 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.261 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6819", 2020-05-18T21:38:21.261 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:38:21.261 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.261 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.262 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:38:21.262 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.262 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.262 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6823", 2020-05-18T21:38:21.263 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:38:21.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.263 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.263 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6825", 2020-05-18T21:38:21.263 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:38:21.264 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.264 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.264 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:38:21.264 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.265 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.265 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6820", 2020-05-18T21:38:21.265 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:38:21.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.266 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.266 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6821", 2020-05-18T21:38:21.266 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 12805 2020-05-18T21:38:21.266 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.267 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.267 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6816/12805", 2020-05-18T21:38:21.267 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6819/12805", 2020-05-18T21:38:21.267 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6825/12805", 2020-05-18T21:38:21.268 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6821/12805", 2020-05-18T21:38:21.268 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:38:21.268 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:38:21.268 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:38:21.268 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.269 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.269 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:38:21.269 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "8ad15a9b-97b4-4002-b1d4-7292e09b4ef6", 2020-05-18T21:38:21.269 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:38:21.270 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:38:21.270 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:38:21.270 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:38:21.270 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:38:21.270 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:38:21.270 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:38:21.271 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 153, 2020-05-18T21:38:21.271 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:38:21.271 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:38:21.271 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:38:21.271 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.272 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.272 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6800", 2020-05-18T21:38:21.272 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:38:21.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.273 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.273 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6801", 2020-05-18T21:38:21.273 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:38:21.273 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.273 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.274 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:38:21.274 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.274 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.274 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6802", 2020-05-18T21:38:21.275 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:38:21.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.275 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.275 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6803", 2020-05-18T21:38:21.276 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:38:21.276 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.276 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.276 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:38:21.276 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.277 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.277 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6806", 2020-05-18T21:38:21.277 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:38:21.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.278 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.278 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6807", 2020-05-18T21:38:21.278 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:38:21.278 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.279 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.279 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:38:21.279 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.279 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.282 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6804", 2020-05-18T21:38:21.282 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:38:21.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.283 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.283 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6805", 2020-05-18T21:38:21.283 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13023 2020-05-18T21:38:21.284 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.284 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.284 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6801/13023", 2020-05-18T21:38:21.284 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6803/13023", 2020-05-18T21:38:21.285 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6807/13023", 2020-05-18T21:38:21.285 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6805/13023", 2020-05-18T21:38:21.285 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:38:21.285 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:38:21.285 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:38:21.286 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.286 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:38:21.286 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0dce88f8-b984-43e1-95e2-4132171102d2", 2020-05-18T21:38:21.287 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:38:21.287 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:38:21.287 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:38:21.287 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:38:21.287 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:38:21.288 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:38:21.288 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:38:21.288 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 155, 2020-05-18T21:38:21.288 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:38:21.288 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:38:21.289 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:38:21.289 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.289 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.289 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6808", 2020-05-18T21:38:21.290 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:38:21.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.290 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.290 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6809", 2020-05-18T21:38:21.290 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:38:21.291 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.291 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.291 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:38:21.291 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.292 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.292 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6810", 2020-05-18T21:38:21.292 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:38:21.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.293 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.293 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6811", 2020-05-18T21:38:21.293 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:38:21.293 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.294 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.294 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:38:21.294 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.295 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.295 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6814", 2020-05-18T21:38:21.295 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:38:21.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.296 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.296 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6816", 2020-05-18T21:38:21.296 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:38:21.296 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.297 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.297 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:38:21.297 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.298 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.298 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6812", 2020-05-18T21:38:21.298 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:38:21.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.299 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.299 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6813", 2020-05-18T21:38:21.299 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13024 2020-05-18T21:38:21.299 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.299 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.300 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6809/13024", 2020-05-18T21:38:21.300 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6811/13024", 2020-05-18T21:38:21.300 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6816/13024", 2020-05-18T21:38:21.300 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6813/13024", 2020-05-18T21:38:21.301 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:38:21.301 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:38:21.301 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:38:21.301 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.302 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:38:21.302 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "e1bc92f8-3692-4483-b0fb-905c94fa1469", 2020-05-18T21:38:21.302 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:38:21.302 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:38:21.303 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:38:21.303 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:38:21.303 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:38:21.303 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:38:21.303 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:38:21.304 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 154, 2020-05-18T21:38:21.304 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:38:21.304 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:38:21.304 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:38:21.305 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.305 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.305 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6815", 2020-05-18T21:38:21.305 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:38:21.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.306 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.306 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6817", 2020-05-18T21:38:21.306 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:38:21.307 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.307 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.307 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:38:21.307 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.308 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.308 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6818", 2020-05-18T21:38:21.308 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:38:21.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.309 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.309 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6819", 2020-05-18T21:38:21.309 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:38:21.309 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.309 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.310 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:38:21.310 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.310 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.311 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6822", 2020-05-18T21:38:21.311 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:38:21.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.311 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.312 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6824", 2020-05-18T21:38:21.312 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:38:21.312 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.312 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.313 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:38:21.313 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.313 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.313 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6820", 2020-05-18T21:38:21.314 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:38:21.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.314 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.314 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6821", 2020-05-18T21:38:21.315 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13025 2020-05-18T21:38:21.315 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.315 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.315 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6817/13025", 2020-05-18T21:38:21.315 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6819/13025", 2020-05-18T21:38:21.316 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6824/13025", 2020-05-18T21:38:21.316 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6821/13025", 2020-05-18T21:38:21.316 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:38:21.316 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:38:21.316 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:38:21.317 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.317 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:38:21.317 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "b76e000c-a078-48c4-9e1e-34d286a9992c", 2020-05-18T21:38:21.318 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2020-05-18T21:38:21.318 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2020-05-18T21:38:21.318 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2020-05-18T21:38:21.318 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2020-05-18T21:38:21.318 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2020-05-18T21:38:21.319 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2020-05-18T21:38:21.319 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2020-05-18T21:38:21.319 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 154, 2020-05-18T21:38:21.319 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2020-05-18T21:38:21.319 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2020-05-18T21:38:21.320 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2020-05-18T21:38:21.320 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.320 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.320 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6823", 2020-05-18T21:38:21.321 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:38:21.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.321 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.321 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6825", 2020-05-18T21:38:21.322 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:38:21.322 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.322 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.322 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2020-05-18T21:38:21.323 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.323 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.323 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6826", 2020-05-18T21:38:21.323 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:38:21.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.324 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.324 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6827", 2020-05-18T21:38:21.324 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:38:21.324 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.325 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.325 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2020-05-18T21:38:21.325 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.326 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.326 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6830", 2020-05-18T21:38:21.326 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:38:21.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.327 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.327 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6831", 2020-05-18T21:38:21.327 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:38:21.327 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.327 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.328 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2020-05-18T21:38:21.328 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2020-05-18T21:38:21.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.328 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2020-05-18T21:38:21.329 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6828", 2020-05-18T21:38:21.329 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:38:21.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.329 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:21.330 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.155:6829", 2020-05-18T21:38:21.330 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 13026 2020-05-18T21:38:21.330 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.330 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.331 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.155:6825/13026", 2020-05-18T21:38:21.331 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.155:6827/13026", 2020-05-18T21:38:21.331 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.155:6831/13026", 2020-05-18T21:38:21.331 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.155:6829/13026", 2020-05-18T21:38:21.331 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2020-05-18T21:38:21.332 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2020-05-18T21:38:21.332 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2020-05-18T21:38:21.332 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:21.332 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.332 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:38:21.332 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2020-05-18T21:38:21.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.333 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2020-05-18T21:38:21.333 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:38:21.333 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:38:21.333 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:38:21.334 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:38:21.334 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:38:21.334 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.281434+0000", 2020-05-18T21:38:21.334 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:38:21.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.335 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2020-05-18T21:38:21.335 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:38:21.335 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:38:21.335 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:38:21.336 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:38:21.336 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:38:21.336 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.608518+0000", 2020-05-18T21:38:21.336 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:38:21.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.337 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2020-05-18T21:38:21.337 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:38:21.337 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:38:21.337 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:38:21.338 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:38:21.338 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:38:21.338 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.582386+0000", 2020-05-18T21:38:21.338 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:38:21.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.339 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2020-05-18T21:38:21.339 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:38:21.339 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:38:21.339 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:38:21.339 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:38:21.340 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:38:21.340 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.573488+0000", 2020-05-18T21:38:21.340 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:38:21.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.341 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2020-05-18T21:38:21.341 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:38:21.341 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:38:21.341 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:38:21.341 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:38:21.342 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:38:21.342 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.604174+0000", 2020-05-18T21:38:21.342 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:38:21.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.343 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2020-05-18T21:38:21.343 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:38:21.343 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:38:21.343 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:38:21.343 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:38:21.344 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:38:21.344 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.371004+0000", 2020-05-18T21:38:21.344 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:38:21.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.344 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2020-05-18T21:38:21.345 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:38:21.345 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:38:21.345 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:38:21.345 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:38:21.345 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:38:21.346 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.593070+0000", 2020-05-18T21:38:21.346 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:38:21.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:21.346 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2020-05-18T21:38:21.347 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2020-05-18T21:38:21.347 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2020-05-18T21:38:21.347 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2020-05-18T21:38:21.347 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138292837744639, 2020-05-18T21:38:21.347 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2020-05-18T21:38:21.348 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2020-05-18T21:26:34.667677+0000", 2020-05-18T21:38:21.348 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2020-05-18T21:38:21.348 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.348 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2020-05-18T21:38:21.348 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2020-05-18T21:38:21.349 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2020-05-18T21:38:21.349 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2020-05-18T21:38:21.349 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2020-05-18T21:38:21.349 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklist": { 2020-05-18T21:38:21.349 INFO:teuthology.orchestra.run.smithi063.stdout: "172.21.15.155:6835/4038166667": "2020-05-19T21:37:59.378255+0000", 2020-05-18T21:38:21.350 INFO:teuthology.orchestra.run.smithi063.stdout: "172.21.15.155:6834/4038166667": "2020-05-19T21:37:59.378255+0000" 2020-05-18T21:38:21.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.350 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2020-05-18T21:38:21.350 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2020-05-18T21:38:21.350 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2020-05-18T21:38:21.351 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2020-05-18T21:38:21.351 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2020-05-18T21:38:21.351 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2020-05-18T21:38:21.351 INFO:teuthology.orchestra.run.smithi063.stdout: "ruleset-failure-domain": "osd", 2020-05-18T21:38:21.352 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2020-05-18T21:38:21.352 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:21.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:21.352 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2020-05-18T21:38:21.352 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2020-05-18T21:38:21.353 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2020-05-18T21:38:21.353 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2020-05-18T21:38:21.353 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {} 2020-05-18T21:38:21.353 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:38:21.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.144+0000 7fb0ed75f700 1 -- 172.21.15.63:0/2372901092 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0c404fac0 msgr2=0x7fb0c4051f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:21.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.144+0000 7fb0ed75f700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0c404fac0 0x7fb0c4051f80 secure :-1 s=READY pgs=833 cs=0 l=1 rx=0x7fb0e8060650 tx=0x7fb0dc003e60).stop 2020-05-18T21:38:21.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.144+0000 7fb0ed75f700 1 -- 172.21.15.63:0/2372901092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0e80b2860 msgr2=0x7fb0e80b75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:21.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.144+0000 7fb0ed75f700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0e80b2860 0x7fb0e80b75a0 secure :-1 s=READY pgs=2122 cs=0 l=1 rx=0x7fb0d80030b0 tx=0x7fb0d8010ce0).stop 2020-05-18T21:38:21.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.144+0000 7fb0ed75f700 1 -- 172.21.15.63:0/2372901092 shutdown_connections 2020-05-18T21:38:21.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.144+0000 7fb0ed75f700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb0c404fac0 0x7fb0c4051f80 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:21.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.144+0000 7fb0ed75f700 1 --2- 172.21.15.63:0/2372901092 >> v2:172.21.15.155:3300/0 conn(0x7fb0e814e570 0x7fb0e814ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:21.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.144+0000 7fb0ed75f700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0e80b2860 0x7fb0e80b75a0 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:21.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.144+0000 7fb0ed75f700 1 --2- 172.21.15.63:0/2372901092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0e8060b90 0x7fb0e80ac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:21.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.144+0000 7fb0ed75f700 1 -- 172.21.15.63:0/2372901092 >> 172.21.15.63:0/2372901092 conn(0x7fb0e80b83d0 msgr2=0x7fb0e80b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:21.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.144+0000 7fb0ed75f700 1 -- 172.21.15.63:0/2372901092 shutdown_connections 2020-05-18T21:38:21.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.144+0000 7fb0ed75f700 1 -- 172.21.15.63:0/2372901092 wait complete. 2020-05-18T21:38:21.359 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:38:21.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.464+0000 7feb0cb13700 1 Processor -- start 2020-05-18T21:38:21.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.464+0000 7feb0cb13700 1 -- start start 2020-05-18T21:38:21.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb0cb13700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 0x7feb080648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:21.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb0cb13700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7feb08064d20 0x7feb0814d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:21.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb0cb13700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb0814a330 con 0x7feb0805f110 2020-05-18T21:38:21.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb0cb13700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb0814a140 con 0x7feb08064d20 2020-05-18T21:38:21.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb0cb13700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0814a5d0 con 0x7feb080b4760 2020-05-18T21:38:21.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb06ffd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 0x7feb080648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:21.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb07fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7feb08064d20 0x7feb0814d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:21.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb07fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7feb08064d20 0x7feb0814d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:51486/0 (socket says 172.21.15.63:51486) 2020-05-18T21:38:21.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb07fff700 1 -- 172.21.15.63:0/1807587956 learned_addr learned my addr 172.21.15.63:0/1807587956 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:21.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb07fff700 1 -- 172.21.15.63:0/1807587956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 msgr2=0x7feb080648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:21.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb07fff700 1 --2- 172.21.15.63:0/1807587956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 0x7feb080648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:21.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb07fff700 1 -- 172.21.15.63:0/1807587956 >> v1:172.21.15.155:6789/0 conn(0x7feb0805f110 legacy=0x7feb0814aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:21.477 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb07fff700 1 -- 172.21.15.63:0/1807587956 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb08063430 con 0x7feb08064d20 2020-05-18T21:38:21.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb06ffd700 1 --2- 172.21.15.63:0/1807587956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 0x7feb080648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:38:21.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb07fff700 1 --2- 172.21.15.63:0/1807587956 >> v2:172.21.15.155:3300/0 conn(0x7feb08064d20 0x7feb0814d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feb08060a90 tx=0x7feb00008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb07fff700 1 --2- 172.21.15.63:0/1807587956 >> v2:172.21.15.155:3300/0 conn(0x7feb08064d20 0x7feb0814d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feb08060a90 tx=0x7feb00008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb07fff700 1 --2- 172.21.15.63:0/1807587956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb08064d20 0x7feb0814d710 secure :-1 s=READY pgs=1417 cs=0 l=1 rx=0x7feb08060a90 tx=0x7feb00008ca0).ready entity=mon.1 client_cookie=682406b889dc0de6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:21.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb07fff700 1 --2- 172.21.15.63:0/1807587956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb08064d20 0x7feb0814d710 secure :-1 s=THROTTLE_DONE pgs=1417 cs=0 l=1 rx=0x7feb08060a90 tx=0x7feb00008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb067fc700 1 -- 172.21.15.63:0/1807587956 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb00011d10 con 0x7feb08064d20 2020-05-18T21:38:21.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb07fff700 1 --2- 172.21.15.63:0/1807587956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb08064d20 0x7feb0814d710 secure :-1 s=THROTTLE_DONE pgs=1417 cs=0 l=1 rx=0x7feb08060a90 tx=0x7feb00008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb07fff700 1 --2- 172.21.15.63:0/1807587956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb08064d20 0x7feb0814d710 secure :-1 s=THROTTLE_DONE pgs=1417 cs=0 l=1 rx=0x7feb08060a90 tx=0x7feb00008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb067fc700 1 -- 172.21.15.63:0/1807587956 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb00011e70 con 0x7feb08064d20 2020-05-18T21:38:21.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb067fc700 1 -- 172.21.15.63:0/1807587956 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb0000a370 con 0x7feb08064d20 2020-05-18T21:38:21.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb0cb13700 1 -- 172.21.15.63:0/1807587956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb08064d20 msgr2=0x7feb0814d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:21.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb0cb13700 1 --2- 172.21.15.63:0/1807587956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb08064d20 0x7feb0814d710 secure :-1 s=READY pgs=1417 cs=0 l=1 rx=0x7feb08060a90 tx=0x7feb00008ca0).stop 2020-05-18T21:38:21.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb0cb13700 1 -- 172.21.15.63:0/1807587956 shutdown_connections 2020-05-18T21:38:21.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb0cb13700 1 --2- 172.21.15.63:0/1807587956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb08064d20 0x7feb0814d710 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:21.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb0cb13700 1 --2- 172.21.15.63:0/1807587956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 0x7feb080648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:21.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb0cb13700 1 -- 172.21.15.63:0/1807587956 >> 172.21.15.63:0/1807587956 conn(0x7feb08069fc0 msgr2=0x7feb0806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:21.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb0cb13700 1 -- 172.21.15.63:0/1807587956 shutdown_connections 2020-05-18T21:38:21.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.468+0000 7feb0cb13700 1 -- 172.21.15.63:0/1807587956 wait complete. 2020-05-18T21:38:21.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.472+0000 7feb0cb13700 1 Processor -- start 2020-05-18T21:38:21.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.472+0000 7feb0cb13700 1 -- start start 2020-05-18T21:38:21.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.472+0000 7feb0cb13700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 0x7feb080adae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:21.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.472+0000 7feb0cb13700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb08147130 con 0x7feb08064d20 2020-05-18T21:38:21.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.472+0000 7feb0cb13700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb081473d0 con 0x7feb0805f110 2020-05-18T21:38:21.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.472+0000 7feb0cb13700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb08147670 con 0x7feb080b4760 2020-05-18T21:38:21.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.472+0000 7feb06ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7feb08064d20 0x7feb08147db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38830/0 (socket says 172.21.15.63:38830) 2020-05-18T21:38:21.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.472+0000 7feb06ffd700 1 -- 172.21.15.63:0/715516476 learned_addr learned my addr 172.21.15.63:0/715516476 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:21.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.472+0000 7feb07fff700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 0x7feb080adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:21.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.472+0000 7feb04ff9700 1 -- 172.21.15.63:0/715516476 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213540582 0 0) 0x7feb08147130 con 0x7feb08064d20 2020-05-18T21:38:21.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.472+0000 7feb04ff9700 1 -- 172.21.15.63:0/715516476 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaec002fe0 con 0x7feb08064d20 2020-05-18T21:38:21.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.472+0000 7feb04ff9700 1 -- 172.21.15.63:0/715516476 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206354208 0 0) 0x7feb081473d0 con 0x7feb0805f110 2020-05-18T21:38:21.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.472+0000 7feb04ff9700 1 -- 172.21.15.63:0/715516476 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb08147130 con 0x7feb0805f110 2020-05-18T21:38:21.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.472+0000 7feb07fff700 1 -- 172.21.15.63:0/715516476 >> v1:172.21.15.155:6789/0 conn(0x7feb0805f110 legacy=0x7feb08143470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:21.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.472+0000 7feb07fff700 1 -- 172.21.15.63:0/715516476 >> v1:172.21.15.63:6789/0 conn(0x7feb08064d20 legacy=0x7feb08147db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:21.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.472+0000 7feb07fff700 1 -- 172.21.15.63:0/715516476 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb08147910 con 0x7feb080b4760 2020-05-18T21:38:21.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.472+0000 7feb07fff700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 0x7feb080adae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feb08060a90 tx=0x7feb08063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.472+0000 7feb07fff700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 0x7feb080adae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feb08060a90 tx=0x7feb08063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.472+0000 7feb07fff700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 0x7feb080adae0 secure :-1 s=READY pgs=327 cs=0 l=1 rx=0x7feb08060a90 tx=0x7feb08063c50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:21.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.476+0000 7feb07fff700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 0x7feb080adae0 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7feb08060a90 tx=0x7feb08063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.476+0000 7feb04ff9700 1 -- 172.21.15.63:0/715516476 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb000105f0 con 0x7feb080b4760 2020-05-18T21:38:21.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.476+0000 7feb07fff700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 0x7feb080adae0 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7feb08060a90 tx=0x7feb08063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.476+0000 7feb07fff700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 0x7feb080adae0 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7feb08060a90 tx=0x7feb08063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.476+0000 7feb04ff9700 1 -- 172.21.15.63:0/715516476 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb00005a80 con 0x7feb080b4760 2020-05-18T21:38:21.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.476+0000 7feb0cb13700 1 -- 172.21.15.63:0/715516476 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb08143b80 con 0x7feb080b4760 2020-05-18T21:38:21.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.476+0000 7feb04ff9700 1 -- 172.21.15.63:0/715516476 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb00005ea0 con 0x7feb080b4760 2020-05-18T21:38:21.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.476+0000 7feb0cb13700 1 -- 172.21.15.63:0/715516476 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb080ac6f0 con 0x7feb080b4760 2020-05-18T21:38:21.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.476+0000 7feb07fff700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 0x7feb080adae0 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7feb08060a90 tx=0x7feb08063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.476+0000 7feb0cb13700 1 -- 172.21.15.63:0/715516476 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb080569e0 con 0x7feb080b4760 2020-05-18T21:38:21.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.476+0000 7feb04ff9700 1 -- 172.21.15.63:0/715516476 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7feb00007170 con 0x7feb080b4760 2020-05-18T21:38:21.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.476+0000 7feb07fff700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 0x7feb080adae0 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7feb08060a90 tx=0x7feb08063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.476+0000 7feb04ff9700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feaec04fe30 0x7feaec0522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:21.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.476+0000 7feb04ff9700 1 -- 172.21.15.63:0/715516476 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6159+0+0 (secure 0 0 0) 0x7feb00064460 con 0x7feb080b4760 2020-05-18T21:38:21.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.476+0000 7feb077fe700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feaec04fe30 0x7feaec0522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:21.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.480+0000 7feb077fe700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feaec04fe30 0x7feaec0522f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feaf0001020 tx=0x7feaf0002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.480+0000 7feb077fe700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feaec04fe30 0x7feaec0522f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feaf0001020 tx=0x7feaf0002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.480+0000 7feb077fe700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feaec04fe30 0x7feaec0522f0 secure :-1 s=READY pgs=834 cs=0 l=1 rx=0x7feaf0001020 tx=0x7feaf0002740).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:21.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.484+0000 7feb07fff700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 0x7feb080adae0 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7feb08060a90 tx=0x7feb08063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.484+0000 7feb04ff9700 1 -- 172.21.15.63:0/715516476 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7feb0003e790 con 0x7feb080b4760 2020-05-18T21:38:21.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.636+0000 7feb0cb13700 1 -- 172.21.15.63:0/715516476 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb080ac6f0 con 0x7feb080b4760 2020-05-18T21:38:21.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.636+0000 7feb07fff700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 0x7feb080adae0 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7feb08060a90 tx=0x7feb08063c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.636+0000 7feb04ff9700 1 -- 172.21.15.63:0/715516476 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 145 v145) v1 ==== 95+0+2170 (secure 0 0 0) 0x7feb080ac6f0 con 0x7feb080b4760 2020-05-18T21:38:21.644 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:21.644 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":145,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":145,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:45.262609+0000","modified":"2020-05-18T21:38:16.299824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":158,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":10281,"mds_1":10222},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10222":{"gid":10222,"name":"b","rank":1,"incarnation":140,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6835/942326202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":942326202},{"type":"v1","addr":"172.21.15.155:6835","nonce":942326202}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0},"gid_10281":{"gid":10281,"name":"a","rank":0,"incarnation":133,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6833/2149589625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2149589625},{"type":"v1","addr":"172.21.15.63:6833","nonce":2149589625}]},"join_fscid":-1,"export_targets":[1],"features":4540138292837744639,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2020-05-18T21:38:21.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.640+0000 7feb0cb13700 1 -- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feaec04fe30 msgr2=0x7feaec0522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:21.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.640+0000 7feb0cb13700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feaec04fe30 0x7feaec0522f0 secure :-1 s=READY pgs=834 cs=0 l=1 rx=0x7feaf0001020 tx=0x7feaf0002740).stop 2020-05-18T21:38:21.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.640+0000 7feb0cb13700 1 -- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 msgr2=0x7feb080adae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:21.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.640+0000 7feb0cb13700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 0x7feb080adae0 secure :-1 s=READY pgs=327 cs=0 l=1 rx=0x7feb08060a90 tx=0x7feb08063c50).stop 2020-05-18T21:38:21.647 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.640+0000 7feb0cb13700 1 -- 172.21.15.63:0/715516476 shutdown_connections 2020-05-18T21:38:21.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.640+0000 7feb0cb13700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7feaec04fe30 0x7feaec0522f0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:21.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.640+0000 7feb0cb13700 1 --2- 172.21.15.63:0/715516476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb080b4760 0x7feb080adae0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:21.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.640+0000 7feb0cb13700 1 -- 172.21.15.63:0/715516476 >> 172.21.15.63:0/715516476 conn(0x7feb08069fc0 msgr2=0x7feb081499f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:21.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.640+0000 7feb0cb13700 1 -- 172.21.15.63:0/715516476 shutdown_connections 2020-05-18T21:38:21.648 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.640+0000 7feb0cb13700 1 -- 172.21.15.63:0/715516476 wait complete. 2020-05-18T21:38:21.649 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 145 2020-05-18T21:38:21.662 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-05-18T21:38:21.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.760+0000 7f17412bc700 1 Processor -- start 2020-05-18T21:38:21.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.760+0000 7f17412bc700 1 -- start start 2020-05-18T21:38:21.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.760+0000 7f17412bc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f173c0b6c00 0x7f173c0b5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:21.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.760+0000 7f17412bc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f173c14dda0 0x7f173c14b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:21.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.760+0000 7f17412bc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f173c14a8e0 con 0x7f173c09efa0 2020-05-18T21:38:21.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.760+0000 7f17412bc700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f173c14ab80 con 0x7f173c14dda0 2020-05-18T21:38:21.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.760+0000 7f17412bc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173c14ae20 con 0x7f173c0b6c00 2020-05-18T21:38:21.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.760+0000 7f173a7fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f173c14dda0 0x7f173c14b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:21.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.760+0000 7f173a7fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f173c14dda0 0x7f173c14b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:51496/0 (socket says 172.21.15.63:51496) 2020-05-18T21:38:21.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.760+0000 7f173a7fc700 1 -- 172.21.15.63:0/3725157344 learned_addr learned my addr 172.21.15.63:0/3725157344 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:21.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.760+0000 7f173affd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f173c0b6c00 0x7f173c0b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:21.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.760+0000 7f173a7fc700 1 -- 172.21.15.63:0/3725157344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f173c0b6c00 msgr2=0x7f173c0b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:21.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.760+0000 7f173a7fc700 1 --2- 172.21.15.63:0/3725157344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f173c0b6c00 0x7f173c0b5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:21.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.760+0000 7f173a7fc700 1 -- 172.21.15.63:0/3725157344 >> v1:172.21.15.155:6789/0 conn(0x7f173c09efa0 legacy=0x7f173c0b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:21.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.760+0000 7f173a7fc700 1 -- 172.21.15.63:0/3725157344 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c0b6fe0 con 0x7f173c14dda0 2020-05-18T21:38:21.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.760+0000 7f1739ffb700 1 -- 172.21.15.63:0/3725157344 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523785828 0 0) 0x7f173c14a8e0 con 0x7f173c09efa0 2020-05-18T21:38:21.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.760+0000 7f173a7fc700 1 --2- 172.21.15.63:0/3725157344 >> v2:172.21.15.155:3300/0 conn(0x7f173c14dda0 0x7f173c14b2c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1724002f70 tx=0x7f1724007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.764+0000 7f173a7fc700 1 --2- 172.21.15.63:0/3725157344 >> v2:172.21.15.155:3300/0 conn(0x7f173c14dda0 0x7f173c14b2c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1724002f70 tx=0x7f1724007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.764+0000 7f173a7fc700 1 --2- 172.21.15.63:0/3725157344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f173c14dda0 0x7f173c14b2c0 secure :-1 s=READY pgs=1420 cs=0 l=1 rx=0x7f1724002f70 tx=0x7f1724007a80).ready entity=mon.1 client_cookie=21a920294658ecad server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:21.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.764+0000 7f173a7fc700 1 --2- 172.21.15.63:0/3725157344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f173c14dda0 0x7f173c14b2c0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7f1724002f70 tx=0x7f1724007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.764+0000 7f1739ffb700 1 -- 172.21.15.63:0/3725157344 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17240116b0 con 0x7f173c14dda0 2020-05-18T21:38:21.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.764+0000 7f173a7fc700 1 --2- 172.21.15.63:0/3725157344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f173c14dda0 0x7f173c14b2c0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7f1724002f70 tx=0x7f1724007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.764+0000 7f1739ffb700 1 -- 172.21.15.63:0/3725157344 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1724011810 con 0x7f173c14dda0 2020-05-18T21:38:21.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.764+0000 7f173a7fc700 1 --2- 172.21.15.63:0/3725157344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f173c14dda0 0x7f173c14b2c0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7f1724002f70 tx=0x7f1724007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.764+0000 7f1739ffb700 1 -- 172.21.15.63:0/3725157344 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1724011bf0 con 0x7f173c14dda0 2020-05-18T21:38:21.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.764+0000 7f17412bc700 1 -- 172.21.15.63:0/3725157344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f173c14dda0 msgr2=0x7f173c14b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:21.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.764+0000 7f17412bc700 1 --2- 172.21.15.63:0/3725157344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f173c14dda0 0x7f173c14b2c0 secure :-1 s=READY pgs=1420 cs=0 l=1 rx=0x7f1724002f70 tx=0x7f1724007a80).stop 2020-05-18T21:38:21.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.764+0000 7f17412bc700 1 -- 172.21.15.63:0/3725157344 shutdown_connections 2020-05-18T21:38:21.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.764+0000 7f17412bc700 1 --2- 172.21.15.63:0/3725157344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f173c14dda0 0x7f173c14b2c0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:21.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.764+0000 7f17412bc700 1 --2- 172.21.15.63:0/3725157344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f173c0b6c00 0x7f173c0b5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:21.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.764+0000 7f17412bc700 1 -- 172.21.15.63:0/3725157344 >> 172.21.15.63:0/3725157344 conn(0x7f173c0ba1e0 msgr2=0x7f173c0b61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:21.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.764+0000 7f17412bc700 1 -- 172.21.15.63:0/3725157344 shutdown_connections 2020-05-18T21:38:21.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.764+0000 7f17412bc700 1 -- 172.21.15.63:0/3725157344 wait complete. 2020-05-18T21:38:21.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.764+0000 7f17412bc700 1 Processor -- start 2020-05-18T21:38:21.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.764+0000 7f17412bc700 1 -- start start 2020-05-18T21:38:21.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f17412bc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f173c0b6c00 0x7f173c065670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:21.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f17412bc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f173c14dda0 0x7f173c0b88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:21.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f17412bc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f173c0b8d40 con 0x7f173c09efa0 2020-05-18T21:38:21.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f17412bc700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f173c065350 con 0x7f173c14dda0 2020-05-18T21:38:21.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f17412bc700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f173c064320 con 0x7f173c0b6c00 2020-05-18T21:38:21.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f173b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f173c14dda0 0x7f173c0b88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:21.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f173b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f173c14dda0 0x7f173c0b88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36658/0 (socket says 172.21.15.63:36658) 2020-05-18T21:38:21.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f173b7fe700 1 -- 172.21.15.63:0/108725113 learned_addr learned my addr 172.21.15.63:0/108725113 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:21.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f173a7fc700 1 --2- 172.21.15.63:0/108725113 >> v2:172.21.15.155:3300/0 conn(0x7f173c0b6c00 0x7f173c065670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:21.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f173b7fe700 1 -- 172.21.15.63:0/108725113 >> v2:172.21.15.155:3300/0 conn(0x7f173c0b6c00 msgr2=0x7f173c065670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:21.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f173b7fe700 1 --2- 172.21.15.63:0/108725113 >> v2:172.21.15.155:3300/0 conn(0x7f173c0b6c00 0x7f173c065670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:21.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f173b7fe700 1 -- 172.21.15.63:0/108725113 >> v1:172.21.15.155:6789/0 conn(0x7f173c09efa0 legacy=0x7f173c1477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:21.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f173b7fe700 1 -- 172.21.15.63:0/108725113 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c0645c0 con 0x7f173c14dda0 2020-05-18T21:38:21.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f173b7fe700 1 --2- 172.21.15.63:0/108725113 >> v2:172.21.15.63:3300/0 conn(0x7f173c14dda0 0x7f173c0b88e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1734000f40 tx=0x7f1734010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f173b7fe700 1 --2- 172.21.15.63:0/108725113 >> v2:172.21.15.63:3300/0 conn(0x7f173c14dda0 0x7f173c0b88e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1734000f40 tx=0x7f1734010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f173b7fe700 1 --2- 172.21.15.63:0/108725113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f173c14dda0 0x7f173c0b88e0 secure :-1 s=READY pgs=2124 cs=0 l=1 rx=0x7f1734000f40 tx=0x7f1734010c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:21.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f173b7fe700 1 --2- 172.21.15.63:0/108725113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f173c14dda0 0x7f173c0b88e0 secure :-1 s=THROTTLE_DONE pgs=2124 cs=0 l=1 rx=0x7f1734000f40 tx=0x7f1734010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f1733fff700 1 -- 172.21.15.63:0/108725113 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1734012310 con 0x7f173c14dda0 2020-05-18T21:38:21.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f173b7fe700 1 --2- 172.21.15.63:0/108725113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f173c14dda0 0x7f173c0b88e0 secure :-1 s=THROTTLE_DONE pgs=2124 cs=0 l=1 rx=0x7f1734000f40 tx=0x7f1734010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f17412bc700 1 -- 172.21.15.63:0/108725113 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173c064fd0 con 0x7f173c14dda0 2020-05-18T21:38:21.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f1733fff700 1 -- 172.21.15.63:0/108725113 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17340124b0 con 0x7f173c14dda0 2020-05-18T21:38:21.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f173b7fe700 1 --2- 172.21.15.63:0/108725113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f173c14dda0 0x7f173c0b88e0 secure :-1 s=THROTTLE_DONE pgs=2124 cs=0 l=1 rx=0x7f1734000f40 tx=0x7f1734010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f17412bc700 1 -- 172.21.15.63:0/108725113 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173c147f00 con 0x7f173c14dda0 2020-05-18T21:38:21.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f1733fff700 1 -- 172.21.15.63:0/108725113 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1734012920 con 0x7f173c14dda0 2020-05-18T21:38:21.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f173b7fe700 1 --2- 172.21.15.63:0/108725113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f173c14dda0 0x7f173c0b88e0 secure :-1 s=THROTTLE_DONE pgs=2124 cs=0 l=1 rx=0x7f1734000f40 tx=0x7f1734010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f17412bc700 1 -- 172.21.15.63:0/108725113 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f173c0569e0 con 0x7f173c14dda0 2020-05-18T21:38:21.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f1733fff700 1 -- 172.21.15.63:0/108725113 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1734012a80 con 0x7f173c14dda0 2020-05-18T21:38:21.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.768+0000 7f173b7fe700 1 --2- 172.21.15.63:0/108725113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f173c14dda0 0x7f173c0b88e0 secure :-1 s=THROTTLE_DONE pgs=2124 cs=0 l=1 rx=0x7f1734000f40 tx=0x7f1734010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.772+0000 7f1733fff700 1 --2- 172.21.15.63:0/108725113 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f171404f900 0x7f1714051dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:21.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.772+0000 7f1733fff700 1 -- 172.21.15.63:0/108725113 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1734064410 con 0x7f173c14dda0 2020-05-18T21:38:21.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.772+0000 7f173affd700 1 --2- 172.21.15.63:0/108725113 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f171404f900 0x7f1714051dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:21.785 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.772+0000 7f173affd700 1 --2- 172.21.15.63:0/108725113 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f171404f900 0x7f1714051dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f173c0637b0 tx=0x7f172c007740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.772+0000 7f173affd700 1 --2- 172.21.15.63:0/108725113 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f171404f900 0x7f1714051dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f173c0637b0 tx=0x7f172c007740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.772+0000 7f173affd700 1 --2- 172.21.15.63:0/108725113 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f171404f900 0x7f1714051dc0 secure :-1 s=READY pgs=835 cs=0 l=1 rx=0x7f173c0637b0 tx=0x7f172c007740).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:21.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.776+0000 7f173b7fe700 1 --2- 172.21.15.63:0/108725113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f173c14dda0 0x7f173c0b88e0 secure :-1 s=THROTTLE_DONE pgs=2124 cs=0 l=1 rx=0x7f1734000f40 tx=0x7f1734010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:21.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.776+0000 7f1733fff700 1 -- 172.21.15.63:0/108725113 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f173403e7a0 con 0x7f173c14dda0 2020-05-18T21:38:21.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:21.928+0000 7f17412bc700 1 -- 172.21.15.63:0/108725113 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f173c065160 con 0x7f173c14dda0 2020-05-18T21:38:22.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.768+0000 7f173b7fe700 1 --2- 172.21.15.63:0/108725113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f173c14dda0 0x7f173c0b88e0 secure :-1 s=READY pgs=2124 cs=0 l=1 rx=0x7f1734000f40 tx=0x7f1734010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:22.832 INFO:tasks.ceph.mon.a.smithi063.stderr:2020-05-18T21:38:22.824+0000 7fdb4592c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-05-18T21:38:22.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.840+0000 7f173b7fe700 1 --2- 172.21.15.63:0/108725113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f173c14dda0 0x7f173c0b88e0 secure :-1 s=THROTTLE_DONE pgs=2124 cs=0 l=1 rx=0x7f1734000f40 tx=0x7f1734010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:22.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.840+0000 7f1733fff700 1 -- 172.21.15.63:0/108725113 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v146) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1734041dc0 con 0x7f173c14dda0 2020-05-18T21:38:22.850 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.844+0000 7f17412bc700 1 -- 172.21.15.63:0/108725113 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f171404f900 msgr2=0x7f1714051dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:22.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.844+0000 7f17412bc700 1 --2- 172.21.15.63:0/108725113 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f171404f900 0x7f1714051dc0 secure :-1 s=READY pgs=835 cs=0 l=1 rx=0x7f173c0637b0 tx=0x7f172c007740).stop 2020-05-18T21:38:22.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.844+0000 7f17412bc700 1 -- 172.21.15.63:0/108725113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f173c14dda0 msgr2=0x7f173c0b88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:22.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.844+0000 7f17412bc700 1 --2- 172.21.15.63:0/108725113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f173c14dda0 0x7f173c0b88e0 secure :-1 s=READY pgs=2124 cs=0 l=1 rx=0x7f1734000f40 tx=0x7f1734010c70).stop 2020-05-18T21:38:22.851 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.844+0000 7f17412bc700 1 -- 172.21.15.63:0/108725113 shutdown_connections 2020-05-18T21:38:22.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.844+0000 7f17412bc700 1 --2- 172.21.15.63:0/108725113 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f171404f900 0x7f1714051dc0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:22.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.844+0000 7f17412bc700 1 --2- 172.21.15.63:0/108725113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f173c14dda0 0x7f173c0b88e0 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:22.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.844+0000 7f17412bc700 1 --2- 172.21.15.63:0/108725113 >> v2:172.21.15.155:3300/0 conn(0x7f173c0b6c00 0x7f173c065670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:22.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.844+0000 7f17412bc700 1 -- 172.21.15.63:0/108725113 >> 172.21.15.63:0/108725113 conn(0x7f173c0ba1e0 msgr2=0x7f173c1499b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:22.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.844+0000 7f17412bc700 1 -- 172.21.15.63:0/108725113 shutdown_connections 2020-05-18T21:38:22.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.844+0000 7f17412bc700 1 -- 172.21.15.63:0/108725113 wait complete. 2020-05-18T21:38:22.853 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-05-18T21:38:22.864 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:38:22.886 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:38:22.888 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:38:22.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0dcfe700 1 Processor -- start 2020-05-18T21:38:22.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0dcfe700 1 -- start start 2020-05-18T21:38:22.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0dcfe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb08069eb0 0x7fbb08062f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:22.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0dcfe700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb08149690 con 0x7fbb081453d0 2020-05-18T21:38:22.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0dcfe700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb08149930 con 0x7fbb080b6500 2020-05-18T21:38:22.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0dcfe700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0814a4e0 con 0x7fbb08069eb0 2020-05-18T21:38:22.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0d4fd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbb081453d0 0x7fbb08145860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38872/0 (socket says 172.21.15.63:38872) 2020-05-18T21:38:22.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0d4fd700 1 -- 172.21.15.63:0/1988348512 learned_addr learned my addr 172.21.15.63:0/1988348512 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:22.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0ccfc700 1 --2- 172.21.15.63:0/1988348512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb08069eb0 0x7fbb08062f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:22.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb077fe700 1 -- 172.21.15.63:0/1988348512 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199488450 0 0) 0x7fbb08149690 con 0x7fbb081453d0 2020-05-18T21:38:22.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb077fe700 1 -- 172.21.15.63:0/1988348512 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaec003270 con 0x7fbb081453d0 2020-05-18T21:38:22.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb077fe700 1 -- 172.21.15.63:0/1988348512 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820859678 0 0) 0x7fbb08149930 con 0x7fbb080b6500 2020-05-18T21:38:22.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb077fe700 1 -- 172.21.15.63:0/1988348512 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb08149690 con 0x7fbb080b6500 2020-05-18T21:38:22.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0ccfc700 1 -- 172.21.15.63:0/1988348512 >> v1:172.21.15.155:6789/0 conn(0x7fbb080b6500 legacy=0x7fbb08149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:22.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0ccfc700 1 -- 172.21.15.63:0/1988348512 >> v1:172.21.15.63:6789/0 conn(0x7fbb081453d0 legacy=0x7fbb08145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:22.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0ccfc700 1 -- 172.21.15.63:0/1988348512 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb08064450 con 0x7fbb08069eb0 2020-05-18T21:38:22.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0ccfc700 1 --2- 172.21.15.63:0/1988348512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb08069eb0 0x7fbb08062f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbafc002f70 tx=0x7fbafc008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:22.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0ccfc700 1 --2- 172.21.15.63:0/1988348512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb08069eb0 0x7fbb08062f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbafc002f70 tx=0x7fbafc008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:22.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0ccfc700 1 --2- 172.21.15.63:0/1988348512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb08069eb0 0x7fbb08062f20 secure :-1 s=READY pgs=329 cs=0 l=1 rx=0x7fbafc002f70 tx=0x7fbafc008920).ready entity=mon.2 client_cookie=bd3fecf6eabfb3b6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:22.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0ccfc700 1 --2- 172.21.15.63:0/1988348512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb08069eb0 0x7fbb08062f20 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7fbafc002f70 tx=0x7fbafc008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:22.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb077fe700 1 -- 172.21.15.63:0/1988348512 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbafc008e80 con 0x7fbb08069eb0 2020-05-18T21:38:22.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0ccfc700 1 --2- 172.21.15.63:0/1988348512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb08069eb0 0x7fbb08062f20 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7fbafc002f70 tx=0x7fbafc008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:22.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0ccfc700 1 --2- 172.21.15.63:0/1988348512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb08069eb0 0x7fbb08062f20 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7fbafc002f70 tx=0x7fbafc008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:22.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb077fe700 1 -- 172.21.15.63:0/1988348512 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbafc011580 con 0x7fbb08069eb0 2020-05-18T21:38:22.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb077fe700 1 -- 172.21.15.63:0/1988348512 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbafc011960 con 0x7fbb08069eb0 2020-05-18T21:38:22.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0dcfe700 1 -- 172.21.15.63:0/1988348512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb08069eb0 msgr2=0x7fbb08062f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:22.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.964+0000 7fbb0dcfe700 1 --2- 172.21.15.63:0/1988348512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb08069eb0 0x7fbb08062f20 secure :-1 s=READY pgs=329 cs=0 l=1 rx=0x7fbafc002f70 tx=0x7fbafc008920).stop 2020-05-18T21:38:22.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.968+0000 7fbb0dcfe700 1 -- 172.21.15.63:0/1988348512 shutdown_connections 2020-05-18T21:38:22.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.968+0000 7fbb0dcfe700 1 --2- 172.21.15.63:0/1988348512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb08069eb0 0x7fbb08062f20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:22.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.968+0000 7fbb0dcfe700 1 -- 172.21.15.63:0/1988348512 >> 172.21.15.63:0/1988348512 conn(0x7fbb08066d00 msgr2=0x7fbb0805a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:22.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.968+0000 7fbb0dcfe700 1 -- 172.21.15.63:0/1988348512 shutdown_connections 2020-05-18T21:38:22.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.968+0000 7fbb0dcfe700 1 -- 172.21.15.63:0/1988348512 wait complete. 2020-05-18T21:38:22.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.968+0000 7fbb0dcfe700 1 Processor -- start 2020-05-18T21:38:22.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.968+0000 7fbb0dcfe700 1 -- start start 2020-05-18T21:38:22.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.968+0000 7fbb0dcfe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbb080b6500 0x7fbb08143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:22.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.968+0000 7fbb0dcfe700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb08156e50 con 0x7fbb08069eb0 2020-05-18T21:38:22.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.968+0000 7fbb0dcfe700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb08143570 con 0x7fbb081453d0 2020-05-18T21:38:22.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.968+0000 7fbb0dcfe700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb080b19f0 con 0x7fbb080b6500 2020-05-18T21:38:22.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.968+0000 7fbb07fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbb080b6500 0x7fbb08143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:22.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.968+0000 7fbb0ccfc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbb08069eb0 0x7fbb080b1150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38874/0 (socket says 172.21.15.63:38874) 2020-05-18T21:38:22.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.968+0000 7fbb0ccfc700 1 -- 172.21.15.63:0/3151003578 learned_addr learned my addr 172.21.15.63:0/3151003578 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:22.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb05ffb700 1 -- 172.21.15.63:0/3151003578 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551501613 0 0) 0x7fbb08156e50 con 0x7fbb08069eb0 2020-05-18T21:38:22.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb05ffb700 1 -- 172.21.15.63:0/3151003578 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf0002fe0 con 0x7fbb08069eb0 2020-05-18T21:38:22.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb05ffb700 1 -- 172.21.15.63:0/3151003578 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490388910 0 0) 0x7fbb08143570 con 0x7fbb081453d0 2020-05-18T21:38:22.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb07fff700 1 -- 172.21.15.63:0/3151003578 >> v1:172.21.15.155:6789/0 conn(0x7fbb081453d0 legacy=0x7fbb08157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:22.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb07fff700 1 -- 172.21.15.63:0/3151003578 >> v1:172.21.15.63:6789/0 conn(0x7fbb08069eb0 legacy=0x7fbb080b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:22.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb07fff700 1 -- 172.21.15.63:0/3151003578 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb081570b0 con 0x7fbb080b6500 2020-05-18T21:38:22.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb07fff700 1 --2- 172.21.15.63:0/3151003578 >> v2:172.21.15.63:3300/0 conn(0x7fbb080b6500 0x7fbb08143110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb08156d30 tx=0x7fbaf4002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:22.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb07fff700 1 --2- 172.21.15.63:0/3151003578 >> v2:172.21.15.63:3300/0 conn(0x7fbb080b6500 0x7fbb08143110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb08156d30 tx=0x7fbaf4002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:22.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb07fff700 1 --2- 172.21.15.63:0/3151003578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb080b6500 0x7fbb08143110 secure :-1 s=READY pgs=2132 cs=0 l=1 rx=0x7fbb08156d30 tx=0x7fbaf4002eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:22.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb07fff700 1 --2- 172.21.15.63:0/3151003578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb080b6500 0x7fbb08143110 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7fbb08156d30 tx=0x7fbaf4002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:22.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb05ffb700 1 -- 172.21.15.63:0/3151003578 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbaf400cc60 con 0x7fbb080b6500 2020-05-18T21:38:22.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb07fff700 1 --2- 172.21.15.63:0/3151003578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb080b6500 0x7fbb08143110 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7fbb08156d30 tx=0x7fbaf4002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:22.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb07fff700 1 --2- 172.21.15.63:0/3151003578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb080b6500 0x7fbb08143110 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7fbb08156d30 tx=0x7fbaf4002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:22.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb05ffb700 1 -- 172.21.15.63:0/3151003578 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf400cdc0 con 0x7fbb080b6500 2020-05-18T21:38:22.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb0dcfe700 1 -- 172.21.15.63:0/3151003578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb08157c60 con 0x7fbb080b6500 2020-05-18T21:38:22.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb05ffb700 1 -- 172.21.15.63:0/3151003578 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbaf400e370 con 0x7fbb080b6500 2020-05-18T21:38:22.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb0dcfe700 1 -- 172.21.15.63:0/3151003578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0813fec0 con 0x7fbb080b6500 2020-05-18T21:38:22.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb07fff700 1 --2- 172.21.15.63:0/3151003578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb080b6500 0x7fbb08143110 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7fbb08156d30 tx=0x7fbaf4002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:22.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb0dcfe700 1 -- 172.21.15.63:0/3151003578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb080569e0 con 0x7fbb080b6500 2020-05-18T21:38:22.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb05ffb700 1 -- 172.21.15.63:0/3151003578 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fbaf400e5a0 con 0x7fbb080b6500 2020-05-18T21:38:22.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.972+0000 7fbb07fff700 1 --2- 172.21.15.63:0/3151003578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb080b6500 0x7fbb08143110 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7fbb08156d30 tx=0x7fbaf4002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:22.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.976+0000 7fbb05ffb700 1 --2- 172.21.15.63:0/3151003578 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbaf004fcf0 0x7fbaf00521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:22.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.976+0000 7fbb05ffb700 1 -- 172.21.15.63:0/3151003578 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6331+0+0 (secure 0 0 0) 0x7fbaf4063880 con 0x7fbb080b6500 2020-05-18T21:38:22.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.976+0000 7fbb0ccfc700 1 --2- 172.21.15.63:0/3151003578 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbaf004fcf0 0x7fbaf00521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:22.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.976+0000 7fbb0ccfc700 1 --2- 172.21.15.63:0/3151003578 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbaf004fcf0 0x7fbaf00521b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbafc000bc0 tx=0x7fbb080645e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:22.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.976+0000 7fbb0ccfc700 1 --2- 172.21.15.63:0/3151003578 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbaf004fcf0 0x7fbaf00521b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbafc000bc0 tx=0x7fbb080645e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:22.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.976+0000 7fbb0ccfc700 1 --2- 172.21.15.63:0/3151003578 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbaf004fcf0 0x7fbaf00521b0 secure :-1 s=READY pgs=836 cs=0 l=1 rx=0x7fbafc000bc0 tx=0x7fbb080645e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:22.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.980+0000 7fbb07fff700 1 --2- 172.21.15.63:0/3151003578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb080b6500 0x7fbb08143110 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7fbb08156d30 tx=0x7fbaf4002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:22.990 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:22.980+0000 7fbb05ffb700 1 -- 172.21.15.63:0/3151003578 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fbaf403dbb0 con 0x7fbb080b6500 2020-05-18T21:38:23.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.124+0000 7fbb0dcfe700 1 -- 172.21.15.63:0/3151003578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb0806a390 con 0x7fbb080b6500 2020-05-18T21:38:23.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.128+0000 7fbb07fff700 1 --2- 172.21.15.63:0/3151003578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb080b6500 0x7fbb08143110 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7fbb08156d30 tx=0x7fbaf4002eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.128+0000 7fbb05ffb700 1 -- 172.21.15.63:0/3151003578 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 146 v146) v1 ==== 95+0+1436 (secure 0 0 0) 0x7fbaf40411d0 con 0x7fbb080b6500 2020-05-18T21:38:23.134 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:23.135 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":146,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":146,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:37:45.262609+0000","modified":"2020-05-18T21:38:22.830815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":159,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2020-05-18T21:38:23.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.128+0000 7fbb0dcfe700 1 -- 172.21.15.63:0/3151003578 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbaf004fcf0 msgr2=0x7fbaf00521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:23.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.128+0000 7fbb0dcfe700 1 --2- 172.21.15.63:0/3151003578 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbaf004fcf0 0x7fbaf00521b0 secure :-1 s=READY pgs=836 cs=0 l=1 rx=0x7fbafc000bc0 tx=0x7fbb080645e0).stop 2020-05-18T21:38:23.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.128+0000 7fbb0dcfe700 1 -- 172.21.15.63:0/3151003578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb080b6500 msgr2=0x7fbb08143110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:23.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.128+0000 7fbb0dcfe700 1 --2- 172.21.15.63:0/3151003578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb080b6500 0x7fbb08143110 secure :-1 s=READY pgs=2132 cs=0 l=1 rx=0x7fbb08156d30 tx=0x7fbaf4002eb0).stop 2020-05-18T21:38:23.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.128+0000 7fbb0dcfe700 1 -- 172.21.15.63:0/3151003578 shutdown_connections 2020-05-18T21:38:23.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.128+0000 7fbb0dcfe700 1 --2- 172.21.15.63:0/3151003578 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fbaf004fcf0 0x7fbaf00521b0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:23.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.128+0000 7fbb0dcfe700 1 --2- 172.21.15.63:0/3151003578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb080b6500 0x7fbb08143110 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:23.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.128+0000 7fbb0dcfe700 1 -- 172.21.15.63:0/3151003578 >> 172.21.15.63:0/3151003578 conn(0x7fbb08066d00 msgr2=0x7fbb08061a00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:23.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.128+0000 7fbb0dcfe700 1 -- 172.21.15.63:0/3151003578 shutdown_connections 2020-05-18T21:38:23.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.128+0000 7fbb0dcfe700 1 -- 172.21.15.63:0/3151003578 wait complete. 2020-05-18T21:38:23.138 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 146 2020-05-18T21:38:23.147 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-05-18T21:38:23.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.292+0000 7f47e67e8700 1 Processor -- start 2020-05-18T21:38:23.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.292+0000 7f47e67e8700 1 -- start start 2020-05-18T21:38:23.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.292+0000 7f47e67e8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f47e0061960 0x7f47e0064ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:23.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.292+0000 7f47e67e8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e0065350 con 0x7f47e0060be0 2020-05-18T21:38:23.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.292+0000 7f47e67e8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e0061160 con 0x7f47e0060800 2020-05-18T21:38:23.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.292+0000 7f47e67e8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e0061400 con 0x7f47e0061960 2020-05-18T21:38:23.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.292+0000 7f47e4fe5700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f47e0060be0 0x7f47e0063000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38882/0 (socket says 172.21.15.63:38882) 2020-05-18T21:38:23.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.292+0000 7f47e4fe5700 1 -- 172.21.15.63:0/161560161 learned_addr learned my addr 172.21.15.63:0/161560161 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:23.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47e5fe7700 1 --2- 172.21.15.63:0/161560161 >> v2:172.21.15.155:3300/0 conn(0x7f47e0061960 0x7f47e0064ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:23.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47d3fff700 1 -- 172.21.15.63:0/161560161 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965219693 0 0) 0x7f47e0065350 con 0x7f47e0060be0 2020-05-18T21:38:23.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47d3fff700 1 -- 172.21.15.63:0/161560161 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47c8003270 con 0x7f47e0060be0 2020-05-18T21:38:23.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47d3fff700 1 -- 172.21.15.63:0/161560161 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645741828 0 0) 0x7f47e0061160 con 0x7f47e0060800 2020-05-18T21:38:23.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47d3fff700 1 -- 172.21.15.63:0/161560161 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47e0065350 con 0x7f47e0060800 2020-05-18T21:38:23.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47e5fe7700 1 -- 172.21.15.63:0/161560161 >> v1:172.21.15.155:6789/0 conn(0x7f47e0060800 legacy=0x7f47e0141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:23.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47e5fe7700 1 -- 172.21.15.63:0/161560161 >> v1:172.21.15.63:6789/0 conn(0x7f47e0060be0 legacy=0x7f47e0063000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:23.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47e5fe7700 1 -- 172.21.15.63:0/161560161 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e0065b30 con 0x7f47e0061960 2020-05-18T21:38:23.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47e5fe7700 1 --2- 172.21.15.63:0/161560161 >> v2:172.21.15.155:3300/0 conn(0x7f47e0061960 0x7f47e0064ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f47d80032f0 tx=0x7f47d8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47e5fe7700 1 --2- 172.21.15.63:0/161560161 >> v2:172.21.15.155:3300/0 conn(0x7f47e0061960 0x7f47e0064ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f47d80032f0 tx=0x7f47d8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47e5fe7700 1 --2- 172.21.15.63:0/161560161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47e0061960 0x7f47e0064ef0 secure :-1 s=READY pgs=1427 cs=0 l=1 rx=0x7f47d80032f0 tx=0x7f47d8007e00).ready entity=mon.1 client_cookie=7f0f1e2676ce3534 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:23.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47e5fe7700 1 --2- 172.21.15.63:0/161560161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47e0061960 0x7f47e0064ef0 secure :-1 s=THROTTLE_DONE pgs=1427 cs=0 l=1 rx=0x7f47d80032f0 tx=0x7f47d8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47e5fe7700 1 --2- 172.21.15.63:0/161560161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47e0061960 0x7f47e0064ef0 secure :-1 s=THROTTLE_DONE pgs=1427 cs=0 l=1 rx=0x7f47d80032f0 tx=0x7f47d8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47d3fff700 1 -- 172.21.15.63:0/161560161 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47d8011db0 con 0x7f47e0061960 2020-05-18T21:38:23.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47e5fe7700 1 --2- 172.21.15.63:0/161560161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47e0061960 0x7f47e0064ef0 secure :-1 s=THROTTLE_DONE pgs=1427 cs=0 l=1 rx=0x7f47d80032f0 tx=0x7f47d8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47d3fff700 1 -- 172.21.15.63:0/161560161 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d800a180 con 0x7f47e0061960 2020-05-18T21:38:23.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47d3fff700 1 -- 172.21.15.63:0/161560161 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47d800a560 con 0x7f47e0061960 2020-05-18T21:38:23.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47e67e8700 1 -- 172.21.15.63:0/161560161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47e0061960 msgr2=0x7f47e0064ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:23.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47e67e8700 1 --2- 172.21.15.63:0/161560161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47e0061960 0x7f47e0064ef0 secure :-1 s=READY pgs=1427 cs=0 l=1 rx=0x7f47d80032f0 tx=0x7f47d8007e00).stop 2020-05-18T21:38:23.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47e67e8700 1 -- 172.21.15.63:0/161560161 shutdown_connections 2020-05-18T21:38:23.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47e67e8700 1 --2- 172.21.15.63:0/161560161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47e0061960 0x7f47e0064ef0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:23.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47e67e8700 1 -- 172.21.15.63:0/161560161 >> 172.21.15.63:0/161560161 conn(0x7f47e0069b70 msgr2=0x7f47e0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:23.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47e67e8700 1 -- 172.21.15.63:0/161560161 shutdown_connections 2020-05-18T21:38:23.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.296+0000 7f47e67e8700 1 -- 172.21.15.63:0/161560161 wait complete. 2020-05-18T21:38:23.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e67e8700 1 Processor -- start 2020-05-18T21:38:23.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e67e8700 1 -- start start 2020-05-18T21:38:23.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e67e8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47e0060be0 0x7f47e0111290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:23.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e67e8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f47e0061960 0x7f47e00af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:23.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e67e8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e0153f50 con 0x7f47e0060800 2020-05-18T21:38:23.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e67e8700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e0153d40 con 0x7f47e0061960 2020-05-18T21:38:23.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e67e8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e01541f0 con 0x7f47e0060be0 2020-05-18T21:38:23.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e57e6700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f47e0060800 0x7f47e0140360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38886/0 (socket says 172.21.15.63:38886) 2020-05-18T21:38:23.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e57e6700 1 -- 172.21.15.63:0/3406555059 learned_addr learned my addr 172.21.15.63:0/3406555059 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:23.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e5fe7700 1 --2- 172.21.15.63:0/3406555059 >> v2:172.21.15.63:3300/0 conn(0x7f47e0061960 0x7f47e00af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:23.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e4fe5700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47e0060be0 0x7f47e0111290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:23.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e5fe7700 1 -- 172.21.15.63:0/3406555059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47e0060be0 msgr2=0x7f47e0111290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:23.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e5fe7700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47e0060be0 0x7f47e0111290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:23.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47d27fc700 1 -- 172.21.15.63:0/3406555059 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104205162 0 0) 0x7f47e0153f50 con 0x7f47e0060800 2020-05-18T21:38:23.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e5fe7700 1 -- 172.21.15.63:0/3406555059 >> v1:172.21.15.63:6789/0 conn(0x7f47e0060800 legacy=0x7f47e0140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:23.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e5fe7700 1 -- 172.21.15.63:0/3406555059 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e0140a70 con 0x7f47e0061960 2020-05-18T21:38:23.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e5fe7700 1 --2- 172.21.15.63:0/3406555059 >> v2:172.21.15.63:3300/0 conn(0x7f47e0061960 0x7f47e00af1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f47d80032f0 tx=0x7f47d8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e5fe7700 1 --2- 172.21.15.63:0/3406555059 >> v2:172.21.15.63:3300/0 conn(0x7f47e0061960 0x7f47e00af1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f47d80032f0 tx=0x7f47d8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e5fe7700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47e0061960 0x7f47e00af1f0 secure :-1 s=READY pgs=2135 cs=0 l=1 rx=0x7f47d80032f0 tx=0x7f47d8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:23.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e5fe7700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47e0061960 0x7f47e00af1f0 secure :-1 s=THROTTLE_DONE pgs=2135 cs=0 l=1 rx=0x7f47d80032f0 tx=0x7f47d8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47d27fc700 1 -- 172.21.15.63:0/3406555059 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47d8005a80 con 0x7f47e0061960 2020-05-18T21:38:23.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e5fe7700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47e0061960 0x7f47e00af1f0 secure :-1 s=THROTTLE_DONE pgs=2135 cs=0 l=1 rx=0x7f47d80032f0 tx=0x7f47d8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e5fe7700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47e0061960 0x7f47e00af1f0 secure :-1 s=THROTTLE_DONE pgs=2135 cs=0 l=1 rx=0x7f47d80032f0 tx=0x7f47d8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47d27fc700 1 -- 172.21.15.63:0/3406555059 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d8005be0 con 0x7f47e0061960 2020-05-18T21:38:23.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e67e8700 1 -- 172.21.15.63:0/3406555059 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e00b66e0 con 0x7f47e0061960 2020-05-18T21:38:23.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47d27fc700 1 -- 172.21.15.63:0/3406555059 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47d8010560 con 0x7f47e0061960 2020-05-18T21:38:23.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.300+0000 7f47e67e8700 1 -- 172.21.15.63:0/3406555059 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e00b6b60 con 0x7f47e0061960 2020-05-18T21:38:23.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.304+0000 7f47e5fe7700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47e0061960 0x7f47e00af1f0 secure :-1 s=THROTTLE_DONE pgs=2135 cs=0 l=1 rx=0x7f47d80032f0 tx=0x7f47d8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.304+0000 7f47e67e8700 1 -- 172.21.15.63:0/3406555059 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e00569e0 con 0x7f47e0061960 2020-05-18T21:38:23.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.304+0000 7f47d27fc700 1 -- 172.21.15.63:0/3406555059 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f47d80107d0 con 0x7f47e0061960 2020-05-18T21:38:23.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.304+0000 7f47e5fe7700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47e0061960 0x7f47e00af1f0 secure :-1 s=THROTTLE_DONE pgs=2135 cs=0 l=1 rx=0x7f47d80032f0 tx=0x7f47d8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.304+0000 7f47d27fc700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47c004f880 0x7f47c0051d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:23.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.304+0000 7f47d27fc700 1 -- 172.21.15.63:0/3406555059 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f47d80644f0 con 0x7f47e0061960 2020-05-18T21:38:23.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.304+0000 7f47e57e6700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47c004f880 0x7f47c0051d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:23.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.304+0000 7f47e57e6700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47c004f880 0x7f47c0051d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f47dc0023e0 tx=0x7f47dc0028a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.304+0000 7f47e57e6700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47c004f880 0x7f47c0051d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f47dc0023e0 tx=0x7f47dc0028a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.304+0000 7f47e57e6700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47c004f880 0x7f47c0051d40 secure :-1 s=READY pgs=837 cs=0 l=1 rx=0x7f47dc0023e0 tx=0x7f47dc0028a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:23.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.308+0000 7f47e5fe7700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47e0061960 0x7f47e00af1f0 secure :-1 s=THROTTLE_DONE pgs=2135 cs=0 l=1 rx=0x7f47d80032f0 tx=0x7f47d8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.308+0000 7f47d27fc700 1 -- 172.21.15.63:0/3406555059 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f47d803e9a0 con 0x7f47e0061960 2020-05-18T21:38:23.465 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.456+0000 7f47e67e8700 1 -- 172.21.15.63:0/3406555059 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f47e00660a0 con 0x7f47e0061960 2020-05-18T21:38:23.852 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.844+0000 7f47e5fe7700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47e0061960 0x7f47e00af1f0 secure :-1 s=THROTTLE_DONE pgs=2135 cs=0 l=1 rx=0x7f47d80032f0 tx=0x7f47d8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.853 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.844+0000 7f47d27fc700 1 -- 172.21.15.63:0/3406555059 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v147) v1 ==== 104+0+0 (secure 0 0 0) 0x7f47d8041fc0 con 0x7f47e0061960 2020-05-18T21:38:23.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.848+0000 7f47e67e8700 1 -- 172.21.15.63:0/3406555059 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47c004f880 msgr2=0x7f47c0051d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:23.856 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.848+0000 7f47e67e8700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47c004f880 0x7f47c0051d40 secure :-1 s=READY pgs=837 cs=0 l=1 rx=0x7f47dc0023e0 tx=0x7f47dc0028a0).stop 2020-05-18T21:38:23.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.848+0000 7f47e67e8700 1 -- 172.21.15.63:0/3406555059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47e0061960 msgr2=0x7f47e00af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:23.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.848+0000 7f47e67e8700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47e0061960 0x7f47e00af1f0 secure :-1 s=READY pgs=2135 cs=0 l=1 rx=0x7f47d80032f0 tx=0x7f47d8007e00).stop 2020-05-18T21:38:23.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.848+0000 7f47e67e8700 1 -- 172.21.15.63:0/3406555059 shutdown_connections 2020-05-18T21:38:23.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.848+0000 7f47e67e8700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47c004f880 0x7f47c0051d40 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:23.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.848+0000 7f47e67e8700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47e0061960 0x7f47e00af1f0 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:23.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.848+0000 7f47e67e8700 1 --2- 172.21.15.63:0/3406555059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47e0060be0 0x7f47e0111290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:23.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.848+0000 7f47e67e8700 1 -- 172.21.15.63:0/3406555059 >> 172.21.15.63:0/3406555059 conn(0x7f47e0069b70 msgr2=0x7f47e00b4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:23.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.848+0000 7f47e67e8700 1 -- 172.21.15.63:0/3406555059 shutdown_connections 2020-05-18T21:38:23.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.848+0000 7f47e67e8700 1 -- 172.21.15.63:0/3406555059 wait complete. 2020-05-18T21:38:23.874 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-05-18T21:38:23.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.984+0000 7f238759e700 1 Processor -- start 2020-05-18T21:38:23.991 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.984+0000 7f238759e700 1 -- start start 2020-05-18T21:38:23.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.984+0000 7f238759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f238809dfb0 0x7f238806a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:23.992 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.984+0000 7f238759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2388145e10 0x7f23880b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:23.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.984+0000 7f238759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23880b5f10 con 0x7f23880b65e0 2020-05-18T21:38:23.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.984+0000 7f238759e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23880b6140 con 0x7f238809dfb0 2020-05-18T21:38:23.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.984+0000 7f238759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f238809e390 con 0x7f2388145e10 2020-05-18T21:38:23.993 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.984+0000 7f238659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f238809dfb0 0x7f238806a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:23.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.984+0000 7f2385d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f23880b65e0 0x7f2388145700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38898/0 (socket says 172.21.15.63:38898) 2020-05-18T21:38:23.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.984+0000 7f238659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f238809dfb0 0x7f238806a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36706/0 (socket says 172.21.15.63:36706) 2020-05-18T21:38:23.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.984+0000 7f2385d9b700 1 -- 172.21.15.63:0/1588987422 learned_addr learned my addr 172.21.15.63:0/1588987422 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:23.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.984+0000 7f2386d9d700 1 --2- 172.21.15.63:0/1588987422 >> v2:172.21.15.155:3300/0 conn(0x7f2388145e10 0x7f23880b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:23.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238659c700 1 -- 172.21.15.63:0/1588987422 >> v2:172.21.15.155:3300/0 conn(0x7f2388145e10 msgr2=0x7f23880b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:23.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238659c700 1 --2- 172.21.15.63:0/1588987422 >> v2:172.21.15.155:3300/0 conn(0x7f2388145e10 0x7f23880b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:23.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238559a700 1 -- 172.21.15.63:0/1588987422 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689551430 0 0) 0x7f23880b5f10 con 0x7f23880b65e0 2020-05-18T21:38:23.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238659c700 1 -- 172.21.15.63:0/1588987422 >> v1:172.21.15.63:6789/0 conn(0x7f23880b65e0 legacy=0x7f2388145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:23.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238659c700 1 -- 172.21.15.63:0/1588987422 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238806aa10 con 0x7f238809dfb0 2020-05-18T21:38:23.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238659c700 1 --2- 172.21.15.63:0/1588987422 >> v2:172.21.15.63:3300/0 conn(0x7f238809dfb0 0x7f238806a170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f23780032f0 tx=0x7f2378007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.997 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238659c700 1 --2- 172.21.15.63:0/1588987422 >> v2:172.21.15.63:3300/0 conn(0x7f238809dfb0 0x7f238806a170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f23780032f0 tx=0x7f2378007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238659c700 1 --2- 172.21.15.63:0/1588987422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f238809dfb0 0x7f238806a170 secure :-1 s=READY pgs=2137 cs=0 l=1 rx=0x7f23780032f0 tx=0x7f2378007e00).ready entity=mon.0 client_cookie=cc6b89929e7f1e05 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:23.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238659c700 1 --2- 172.21.15.63:0/1588987422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f238809dfb0 0x7f238806a170 secure :-1 s=THROTTLE_DONE pgs=2137 cs=0 l=1 rx=0x7f23780032f0 tx=0x7f2378007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238559a700 1 -- 172.21.15.63:0/1588987422 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2378011e60 con 0x7f238809dfb0 2020-05-18T21:38:23.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238659c700 1 --2- 172.21.15.63:0/1588987422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f238809dfb0 0x7f238806a170 secure :-1 s=THROTTLE_DONE pgs=2137 cs=0 l=1 rx=0x7f23780032f0 tx=0x7f2378007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238559a700 1 -- 172.21.15.63:0/1588987422 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237800a180 con 0x7f238809dfb0 2020-05-18T21:38:23.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238659c700 1 --2- 172.21.15.63:0/1588987422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f238809dfb0 0x7f238806a170 secure :-1 s=THROTTLE_DONE pgs=2137 cs=0 l=1 rx=0x7f23780032f0 tx=0x7f2378007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:23.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238759e700 1 -- 172.21.15.63:0/1588987422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f238809dfb0 msgr2=0x7f238806a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:23.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238759e700 1 --2- 172.21.15.63:0/1588987422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f238809dfb0 0x7f238806a170 secure :-1 s=READY pgs=2137 cs=0 l=1 rx=0x7f23780032f0 tx=0x7f2378007e00).stop 2020-05-18T21:38:23.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238559a700 1 -- 172.21.15.63:0/1588987422 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f237800a520 con 0x7f238809dfb0 2020-05-18T21:38:23.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238759e700 1 -- 172.21.15.63:0/1588987422 shutdown_connections 2020-05-18T21:38:24.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238759e700 1 --2- 172.21.15.63:0/1588987422 >> v2:172.21.15.155:3300/0 conn(0x7f2388145e10 0x7f23880b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:24.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238759e700 1 --2- 172.21.15.63:0/1588987422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f238809dfb0 0x7f238806a170 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:24.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238759e700 1 -- 172.21.15.63:0/1588987422 >> 172.21.15.63:0/1588987422 conn(0x7f238805a7c0 msgr2=0x7f238805aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:24.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238759e700 1 -- 172.21.15.63:0/1588987422 shutdown_connections 2020-05-18T21:38:24.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238759e700 1 -- 172.21.15.63:0/1588987422 wait complete. 2020-05-18T21:38:24.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238759e700 1 Processor -- start 2020-05-18T21:38:24.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.988+0000 7f238759e700 1 -- start start 2020-05-18T21:38:24.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f238809dfb0 0x7f23880b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:24.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2388145e10 0x7f23881533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:24.004 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23880b1260 con 0x7f23880b65e0 2020-05-18T21:38:24.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238759e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23880b1500 con 0x7f238809dfb0 2020-05-18T21:38:24.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23880b17a0 con 0x7f2388145e10 2020-05-18T21:38:24.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f238809dfb0 0x7f23880b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:24.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f238809dfb0 0x7f23880b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36712/0 (socket says 172.21.15.63:36712) 2020-05-18T21:38:24.005 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238659c700 1 -- 172.21.15.63:0/2975748164 learned_addr learned my addr 172.21.15.63:0/2975748164 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:24.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f2386d9d700 1 --2- 172.21.15.63:0/2975748164 >> v2:172.21.15.155:3300/0 conn(0x7f2388145e10 0x7f23881533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:24.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f237f7fe700 1 -- 172.21.15.63:0/2975748164 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070336717 0 0) 0x7f23880b1260 con 0x7f23880b65e0 2020-05-18T21:38:24.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f237f7fe700 1 -- 172.21.15.63:0/2975748164 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f236c002fe0 con 0x7f23880b65e0 2020-05-18T21:38:24.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238659c700 1 -- 172.21.15.63:0/2975748164 >> v2:172.21.15.155:3300/0 conn(0x7f2388145e10 msgr2=0x7f23881533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:24.006 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238659c700 1 --2- 172.21.15.63:0/2975748164 >> v2:172.21.15.155:3300/0 conn(0x7f2388145e10 0x7f23881533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:24.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238659c700 1 -- 172.21.15.63:0/2975748164 >> v1:172.21.15.155:6789/0 conn(0x7f23880b65e0 legacy=0x7f238813c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:24.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238659c700 1 -- 172.21.15.63:0/2975748164 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238813c880 con 0x7f238809dfb0 2020-05-18T21:38:24.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238659c700 1 --2- 172.21.15.63:0/2975748164 >> v2:172.21.15.63:3300/0 conn(0x7f238809dfb0 0x7f23880b1c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f23780032f0 tx=0x7f2378007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:24.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238659c700 1 --2- 172.21.15.63:0/2975748164 >> v2:172.21.15.63:3300/0 conn(0x7f238809dfb0 0x7f23880b1c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f23780032f0 tx=0x7f2378007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:24.007 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238659c700 1 --2- 172.21.15.63:0/2975748164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f238809dfb0 0x7f23880b1c40 secure :-1 s=READY pgs=2138 cs=0 l=1 rx=0x7f23780032f0 tx=0x7f2378007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:24.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238659c700 1 --2- 172.21.15.63:0/2975748164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f238809dfb0 0x7f23880b1c40 secure :-1 s=THROTTLE_DONE pgs=2138 cs=0 l=1 rx=0x7f23780032f0 tx=0x7f2378007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:24.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f237f7fe700 1 -- 172.21.15.63:0/2975748164 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2378005a80 con 0x7f238809dfb0 2020-05-18T21:38:24.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238759e700 1 -- 172.21.15.63:0/2975748164 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238813f750 con 0x7f238809dfb0 2020-05-18T21:38:24.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238659c700 1 --2- 172.21.15.63:0/2975748164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f238809dfb0 0x7f23880b1c40 secure :-1 s=THROTTLE_DONE pgs=2138 cs=0 l=1 rx=0x7f23780032f0 tx=0x7f2378007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:24.008 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f237f7fe700 1 -- 172.21.15.63:0/2975748164 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2378005be0 con 0x7f238809dfb0 2020-05-18T21:38:24.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238659c700 1 --2- 172.21.15.63:0/2975748164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f238809dfb0 0x7f23880b1c40 secure :-1 s=THROTTLE_DONE pgs=2138 cs=0 l=1 rx=0x7f23780032f0 tx=0x7f2378007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:24.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238759e700 1 -- 172.21.15.63:0/2975748164 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23880b0fe0 con 0x7f238809dfb0 2020-05-18T21:38:24.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f237f7fe700 1 -- 172.21.15.63:0/2975748164 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f237800f5b0 con 0x7f238809dfb0 2020-05-18T21:38:24.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238659c700 1 --2- 172.21.15.63:0/2975748164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f238809dfb0 0x7f23880b1c40 secure :-1 s=THROTTLE_DONE pgs=2138 cs=0 l=1 rx=0x7f23780032f0 tx=0x7f2378007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:24.009 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238759e700 1 -- 172.21.15.63:0/2975748164 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23880569e0 con 0x7f238809dfb0 2020-05-18T21:38:24.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f237f7fe700 1 -- 172.21.15.63:0/2975748164 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f237800f710 con 0x7f238809dfb0 2020-05-18T21:38:24.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.992+0000 7f238659c700 1 --2- 172.21.15.63:0/2975748164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f238809dfb0 0x7f23880b1c40 secure :-1 s=THROTTLE_DONE pgs=2138 cs=0 l=1 rx=0x7f23780032f0 tx=0x7f2378007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:24.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.996+0000 7f237f7fe700 1 --2- 172.21.15.63:0/2975748164 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f236c04fd30 0x7f236c0521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:24.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.996+0000 7f237f7fe700 1 -- 172.21.15.63:0/2975748164 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f2378064bd0 con 0x7f238809dfb0 2020-05-18T21:38:24.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.996+0000 7f2385d9b700 1 --2- 172.21.15.63:0/2975748164 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f236c04fd30 0x7f236c0521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:24.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.996+0000 7f2385d9b700 1 --2- 172.21.15.63:0/2975748164 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f236c04fd30 0x7f236c0521f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2370001070 tx=0x7f2370001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:24.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.996+0000 7f2385d9b700 1 --2- 172.21.15.63:0/2975748164 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f236c04fd30 0x7f236c0521f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2370001070 tx=0x7f2370001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:24.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:23.996+0000 7f2385d9b700 1 --2- 172.21.15.63:0/2975748164 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f236c04fd30 0x7f236c0521f0 secure :-1 s=READY pgs=839 cs=0 l=1 rx=0x7f2370001070 tx=0x7f2370001710).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:24.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:24.000+0000 7f238659c700 1 --2- 172.21.15.63:0/2975748164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f238809dfb0 0x7f23880b1c40 secure :-1 s=THROTTLE_DONE pgs=2138 cs=0 l=1 rx=0x7f23780032f0 tx=0x7f2378007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:24.012 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:24.000+0000 7f237f7fe700 1 -- 172.21.15.63:0/2975748164 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f237803f020 con 0x7f238809dfb0 2020-05-18T21:38:24.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:24.116+0000 7f238759e700 1 -- 172.21.15.63:0/2975748164 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f238805b7d0 con 0x7f238809dfb0 2020-05-18T21:38:24.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:24.924+0000 7f238659c700 1 --2- 172.21.15.63:0/2975748164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f238809dfb0 0x7f23880b1c40 secure :-1 s=THROTTLE_DONE pgs=2138 cs=0 l=1 rx=0x7f23780032f0 tx=0x7f2378007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:24.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:24.924+0000 7f237f7fe700 1 -- 172.21.15.63:0/2975748164 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v160) v1 ==== 185+0+0 (secure 0 0 0) 0x7f2378042640 con 0x7f238809dfb0 2020-05-18T21:38:24.936 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:24.928+0000 7f238759e700 1 -- 172.21.15.63:0/2975748164 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f236c04fd30 msgr2=0x7f236c0521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:24.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:24.928+0000 7f238759e700 1 --2- 172.21.15.63:0/2975748164 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f236c04fd30 0x7f236c0521f0 secure :-1 s=READY pgs=839 cs=0 l=1 rx=0x7f2370001070 tx=0x7f2370001710).stop 2020-05-18T21:38:24.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:24.928+0000 7f238759e700 1 -- 172.21.15.63:0/2975748164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f238809dfb0 msgr2=0x7f23880b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:24.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:24.928+0000 7f238759e700 1 --2- 172.21.15.63:0/2975748164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f238809dfb0 0x7f23880b1c40 secure :-1 s=READY pgs=2138 cs=0 l=1 rx=0x7f23780032f0 tx=0x7f2378007e00).stop 2020-05-18T21:38:24.937 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:24.928+0000 7f238759e700 1 -- 172.21.15.63:0/2975748164 shutdown_connections 2020-05-18T21:38:24.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:24.928+0000 7f238759e700 1 --2- 172.21.15.63:0/2975748164 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f236c04fd30 0x7f236c0521f0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:24.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:24.928+0000 7f238759e700 1 --2- 172.21.15.63:0/2975748164 >> v2:172.21.15.155:3300/0 conn(0x7f2388145e10 0x7f23881533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:24.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:24.928+0000 7f238759e700 1 --2- 172.21.15.63:0/2975748164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f238809dfb0 0x7f23880b1c40 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:24.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:24.928+0000 7f238759e700 1 -- 172.21.15.63:0/2975748164 >> 172.21.15.63:0/2975748164 conn(0x7f238805a7c0 msgr2=0x7f238805aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:24.938 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:24.928+0000 7f238759e700 1 -- 172.21.15.63:0/2975748164 shutdown_connections 2020-05-18T21:38:24.939 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:24.928+0000 7f238759e700 1 -- 172.21.15.63:0/2975748164 wait complete. 2020-05-18T21:38:24.939 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2020-05-18T21:38:24.952 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-05-18T21:38:25.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.060+0000 7f6338a06700 1 Processor -- start 2020-05-18T21:38:25.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.060+0000 7f6338a06700 1 -- start start 2020-05-18T21:38:25.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.060+0000 7f6338a06700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6334143430 0x7f6334145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:25.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.060+0000 7f6338a06700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f63340b6d70 0x7f63340b9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:25.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.060+0000 7f6338a06700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6334143810 con 0x7f63340b7bf0 2020-05-18T21:38:25.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.060+0000 7f6338a06700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63340b7210 con 0x7f63340b6d70 2020-05-18T21:38:25.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.060+0000 7f6338a06700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63340b74b0 con 0x7f6334143430 2020-05-18T21:38:25.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.060+0000 7f6331d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f63340b6d70 0x7f63340b9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:25.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.060+0000 7f6331d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f63340b6d70 0x7f63340b9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36724/0 (socket says 172.21.15.63:36724) 2020-05-18T21:38:25.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.060+0000 7f6331d9b700 1 -- 172.21.15.63:0/478946683 learned_addr learned my addr 172.21.15.63:0/478946683 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:25.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f633259c700 1 --2- 172.21.15.63:0/478946683 >> v2:172.21.15.155:3300/0 conn(0x7f6334143430 0x7f6334145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:25.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f633259c700 1 -- 172.21.15.63:0/478946683 >> v2:172.21.15.63:3300/0 conn(0x7f63340b6d70 msgr2=0x7f63340b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:25.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f633259c700 1 --2- 172.21.15.63:0/478946683 >> v2:172.21.15.63:3300/0 conn(0x7f63340b6d70 0x7f63340b9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:25.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f633259c700 1 -- 172.21.15.63:0/478946683 >> v1:172.21.15.155:6789/0 conn(0x7f63340b7bf0 legacy=0x7f63341493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:25.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f633259c700 1 -- 172.21.15.63:0/478946683 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63340b7750 con 0x7f6334143430 2020-05-18T21:38:25.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f633259c700 1 --2- 172.21.15.63:0/478946683 >> v2:172.21.15.155:3300/0 conn(0x7f6334143430 0x7f6334145dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f631c002f70 tx=0x7f631c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:25.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f633259c700 1 --2- 172.21.15.63:0/478946683 >> v2:172.21.15.155:3300/0 conn(0x7f6334143430 0x7f6334145dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f631c002f70 tx=0x7f631c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:25.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f633259c700 1 --2- 172.21.15.63:0/478946683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6334143430 0x7f6334145dd0 secure :-1 s=READY pgs=1430 cs=0 l=1 rx=0x7f631c002f70 tx=0x7f631c007a80).ready entity=mon.1 client_cookie=fc344c742a418c03 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:25.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f633259c700 1 --2- 172.21.15.63:0/478946683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6334143430 0x7f6334145dd0 secure :-1 s=THROTTLE_DONE pgs=1430 cs=0 l=1 rx=0x7f631c002f70 tx=0x7f631c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:25.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f633159a700 1 -- 172.21.15.63:0/478946683 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f631c008e50 con 0x7f6334143430 2020-05-18T21:38:25.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f633259c700 1 --2- 172.21.15.63:0/478946683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6334143430 0x7f6334145dd0 secure :-1 s=THROTTLE_DONE pgs=1430 cs=0 l=1 rx=0x7f631c002f70 tx=0x7f631c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:25.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f633259c700 1 --2- 172.21.15.63:0/478946683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6334143430 0x7f6334145dd0 secure :-1 s=THROTTLE_DONE pgs=1430 cs=0 l=1 rx=0x7f631c002f70 tx=0x7f631c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:25.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f633159a700 1 -- 172.21.15.63:0/478946683 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c0115f0 con 0x7f6334143430 2020-05-18T21:38:25.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f633159a700 1 -- 172.21.15.63:0/478946683 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f631c011a10 con 0x7f6334143430 2020-05-18T21:38:25.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f6338a06700 1 -- 172.21.15.63:0/478946683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6334143430 msgr2=0x7f6334145dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:25.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f6338a06700 1 --2- 172.21.15.63:0/478946683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6334143430 0x7f6334145dd0 secure :-1 s=READY pgs=1430 cs=0 l=1 rx=0x7f631c002f70 tx=0x7f631c007a80).stop 2020-05-18T21:38:25.075 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f6338a06700 1 -- 172.21.15.63:0/478946683 shutdown_connections 2020-05-18T21:38:25.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f6338a06700 1 --2- 172.21.15.63:0/478946683 >> v2:172.21.15.63:3300/0 conn(0x7f63340b6d70 0x7f63340b9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:25.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f6338a06700 1 --2- 172.21.15.63:0/478946683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6334143430 0x7f6334145dd0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:25.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f6338a06700 1 -- 172.21.15.63:0/478946683 >> 172.21.15.63:0/478946683 conn(0x7f6334069b70 msgr2=0x7f6334069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:25.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f6338a06700 1 -- 172.21.15.63:0/478946683 shutdown_connections 2020-05-18T21:38:25.076 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.064+0000 7f6338a06700 1 -- 172.21.15.63:0/478946683 wait complete. 2020-05-18T21:38:25.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.068+0000 7f6338a06700 1 Processor -- start 2020-05-18T21:38:25.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.068+0000 7f6338a06700 1 -- start start 2020-05-18T21:38:25.079 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.068+0000 7f6338a06700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63340b6d70 0x7f63341535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:25.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.068+0000 7f6338a06700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6334143430 0x7f6334156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:25.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.068+0000 7f6338a06700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6334157020 con 0x7f63340b7bf0 2020-05-18T21:38:25.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.068+0000 7f6338a06700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6334157260 con 0x7f6334143430 2020-05-18T21:38:25.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.068+0000 7f6338a06700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6334157500 con 0x7f63340b6d70 2020-05-18T21:38:25.080 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.068+0000 7f6331d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f63340b7bf0 0x7f63340af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38914/0 (socket says 172.21.15.63:38914) 2020-05-18T21:38:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.068+0000 7f6331d9b700 1 -- 172.21.15.63:0/4079334728 learned_addr learned my addr 172.21.15.63:0/4079334728 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.068+0000 7f633259c700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63340b6d70 0x7f63341535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.068+0000 7f6332d9d700 1 --2- 172.21.15.63:0/4079334728 >> v2:172.21.15.155:3300/0 conn(0x7f6334143430 0x7f6334156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.068+0000 7f632b7fe700 1 -- 172.21.15.63:0/4079334728 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347961021 0 0) 0x7f6324001f00 con 0x7f63340b7bf0 2020-05-18T21:38:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.068+0000 7f632b7fe700 1 -- 172.21.15.63:0/4079334728 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6318002fe0 con 0x7f63340b7bf0 2020-05-18T21:38:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.068+0000 7f633259c700 1 -- 172.21.15.63:0/4079334728 >> v2:172.21.15.155:3300/0 conn(0x7f6334143430 msgr2=0x7f6334156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.068+0000 7f633259c700 1 --2- 172.21.15.63:0/4079334728 >> v2:172.21.15.155:3300/0 conn(0x7f6334143430 0x7f6334156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.068+0000 7f633259c700 1 -- 172.21.15.63:0/4079334728 >> v1:172.21.15.63:6789/0 conn(0x7f63340b7bf0 legacy=0x7f63340af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.068+0000 7f633259c700 1 -- 172.21.15.63:0/4079334728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63341577a0 con 0x7f63340b6d70 2020-05-18T21:38:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.068+0000 7f633259c700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63340b6d70 0x7f63341535e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f631c002f70 tx=0x7f631c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:25.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.072+0000 7f633259c700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63340b6d70 0x7f63341535e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f631c002f70 tx=0x7f631c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:25.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.072+0000 7f633259c700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63340b6d70 0x7f63341535e0 secure :-1 s=READY pgs=330 cs=0 l=1 rx=0x7f631c002f70 tx=0x7f631c007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:25.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.072+0000 7f633259c700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63340b6d70 0x7f63341535e0 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f631c002f70 tx=0x7f631c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:25.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.072+0000 7f632b7fe700 1 -- 172.21.15.63:0/4079334728 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f631c011d10 con 0x7f63340b6d70 2020-05-18T21:38:25.083 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.072+0000 7f633259c700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63340b6d70 0x7f63341535e0 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f631c002f70 tx=0x7f631c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:25.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.072+0000 7f633259c700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63340b6d70 0x7f63341535e0 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f631c002f70 tx=0x7f631c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:25.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.072+0000 7f632b7fe700 1 -- 172.21.15.63:0/4079334728 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c011e70 con 0x7f63340b6d70 2020-05-18T21:38:25.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.072+0000 7f6338a06700 1 -- 172.21.15.63:0/4079334728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63340b0050 con 0x7f63340b6d70 2020-05-18T21:38:25.084 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.072+0000 7f632b7fe700 1 -- 172.21.15.63:0/4079334728 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f631c007360 con 0x7f63340b6d70 2020-05-18T21:38:25.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.072+0000 7f6338a06700 1 -- 172.21.15.63:0/4079334728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6334146400 con 0x7f63340b6d70 2020-05-18T21:38:25.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.072+0000 7f633259c700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63340b6d70 0x7f63341535e0 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f631c002f70 tx=0x7f631c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:25.085 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.072+0000 7f6338a06700 1 -- 172.21.15.63:0/4079334728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63341579a0 con 0x7f63340b6d70 2020-05-18T21:38:25.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.072+0000 7f632b7fe700 1 -- 172.21.15.63:0/4079334728 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f631c005700 con 0x7f63340b6d70 2020-05-18T21:38:25.086 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.072+0000 7f633259c700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63340b6d70 0x7f63341535e0 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f631c002f70 tx=0x7f631c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:25.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.072+0000 7f632b7fe700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f631804fd80 0x7f6318052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:25.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.072+0000 7f632b7fe700 1 -- 172.21.15.63:0/4079334728 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5893+0+0 (secure 0 0 0) 0x7f631c0641b0 con 0x7f63340b6d70 2020-05-18T21:38:25.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.072+0000 7f6331d9b700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f631804fd80 0x7f6318052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:25.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.076+0000 7f6331d9b700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f631804fd80 0x7f6318052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6324002f70 tx=0x7f633405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:25.087 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.076+0000 7f6331d9b700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f631804fd80 0x7f6318052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6324002f70 tx=0x7f633405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:25.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.076+0000 7f6331d9b700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f631804fd80 0x7f6318052240 secure :-1 s=READY pgs=840 cs=0 l=1 rx=0x7f6324002f70 tx=0x7f633405ab60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:25.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.080+0000 7f633259c700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63340b6d70 0x7f63341535e0 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f631c002f70 tx=0x7f631c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:25.088 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.080+0000 7f632b7fe700 1 -- 172.21.15.63:0/4079334728 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f63341579a0 con 0x7f63340b6d70 2020-05-18T21:38:25.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.200+0000 7f6338a06700 1 -- 172.21.15.63:0/4079334728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f63341579a0 con 0x7f63340b6d70 2020-05-18T21:38:25.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.936+0000 7f633259c700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63340b6d70 0x7f63341535e0 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f631c002f70 tx=0x7f631c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:25.945 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.936+0000 7f632b7fe700 1 -- 172.21.15.63:0/4079334728 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v161) v1 ==== 173+0+0 (secure 0 0 0) 0x7f63341579a0 con 0x7f63340b6d70 2020-05-18T21:38:25.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.940+0000 7f6338a06700 1 -- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f631804fd80 msgr2=0x7f6318052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:25.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.940+0000 7f6338a06700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f631804fd80 0x7f6318052240 secure :-1 s=READY pgs=840 cs=0 l=1 rx=0x7f6324002f70 tx=0x7f633405ab60).stop 2020-05-18T21:38:25.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.940+0000 7f6338a06700 1 -- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63340b6d70 msgr2=0x7f63341535e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:25.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.940+0000 7f6338a06700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63340b6d70 0x7f63341535e0 secure :-1 s=READY pgs=330 cs=0 l=1 rx=0x7f631c002f70 tx=0x7f631c007a80).stop 2020-05-18T21:38:25.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.940+0000 7f6338a06700 1 -- 172.21.15.63:0/4079334728 shutdown_connections 2020-05-18T21:38:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.940+0000 7f6338a06700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f631804fd80 0x7f6318052240 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.940+0000 7f6338a06700 1 --2- 172.21.15.63:0/4079334728 >> v2:172.21.15.155:3300/0 conn(0x7f6334143430 0x7f6334156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.940+0000 7f6338a06700 1 --2- 172.21.15.63:0/4079334728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63340b6d70 0x7f63341535e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.940+0000 7f6338a06700 1 -- 172.21.15.63:0/4079334728 >> 172.21.15.63:0/4079334728 conn(0x7f6334069b70 msgr2=0x7f6334060660 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.940+0000 7f6338a06700 1 -- 172.21.15.63:0/4079334728 shutdown_connections 2020-05-18T21:38:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:25.940+0000 7f6338a06700 1 -- 172.21.15.63:0/4079334728 wait complete. 2020-05-18T21:38:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2020-05-18T21:38:25.964 INFO:tasks.ceph.mds.a:Restarting daemon 2020-05-18T21:38:25.965 INFO:tasks.ceph.mds.a:Stopping old one... 2020-05-18T21:38:25.965 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:38:25.965 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:38:25.966 INFO:tasks.ceph.mds.b:Restarting daemon 2020-05-18T21:38:25.966 INFO:tasks.ceph.mds.b:Stopping old one... 2020-05-18T21:38:25.966 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:38:25.967 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:38:25.979 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:38:25.980 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-05-18T21:38:25.981 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:38:25.981 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-05-18T21:38:25.983 INFO:tasks.ceph.mds.b:Started 2020-05-18T21:38:25.984 DEBUG:teuthology.parallel:result is None 2020-05-18T21:38:26.022 INFO:tasks.ceph.mds.a:Started 2020-05-18T21:38:26.023 DEBUG:teuthology.parallel:result is None 2020-05-18T21:38:26.023 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-05-18T21:38:26.057 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2020-05-18T21:38:26.099 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2020-05-18T21:38:26.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.124+0000 7f51db1f4700 1 Processor -- start 2020-05-18T21:38:26.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.124+0000 7f51db1f4700 1 -- start start 2020-05-18T21:38:26.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.124+0000 7f51db1f4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f51d409b530 0x7f51d4099c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:26.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.124+0000 7f51db1f4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f51d40b5e30 0x7f51d40b6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.124+0000 7f51db1f4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d409b9d0 con 0x7f51d409e620 2020-05-18T21:38:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.124+0000 7f51db1f4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d4145ea0 con 0x7f51d409b530 2020-05-18T21:38:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.124+0000 7f51db1f4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d4099880 con 0x7f51d40b5e30 2020-05-18T21:38:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.124+0000 7f51d3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f51d409b530 0x7f51d4099c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.124+0000 7f51d3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f51d409b530 0x7f51d4099c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36748/0 (socket says 172.21.15.63:36748) 2020-05-18T21:38:26.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.124+0000 7f51d3fff700 1 -- 172.21.15.63:0/1949827151 learned_addr learned my addr 172.21.15.63:0/1949827151 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:26.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.124+0000 7f51d9791700 1 --2- 172.21.15.63:0/1949827151 >> v2:172.21.15.155:3300/0 conn(0x7f51d40b5e30 0x7f51d40b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:26.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.124+0000 7f51d3fff700 1 -- 172.21.15.63:0/1949827151 >> v2:172.21.15.155:3300/0 conn(0x7f51d40b5e30 msgr2=0x7f51d40b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:26.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.124+0000 7f51d3fff700 1 --2- 172.21.15.63:0/1949827151 >> v2:172.21.15.155:3300/0 conn(0x7f51d40b5e30 0x7f51d40b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:26.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.124+0000 7f51d3fff700 1 -- 172.21.15.63:0/1949827151 >> v1:172.21.15.155:6789/0 conn(0x7f51d409e620 legacy=0x7f51d4099170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:26.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.124+0000 7f51d3fff700 1 -- 172.21.15.63:0/1949827151 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d4098a30 con 0x7f51d409b530 2020-05-18T21:38:26.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.128+0000 7f51d3fff700 1 --2- 172.21.15.63:0/1949827151 >> v2:172.21.15.63:3300/0 conn(0x7f51d409b530 0x7f51d4099c10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f51d4145fe0 tx=0x7f51c0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:26.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.128+0000 7f51d3fff700 1 --2- 172.21.15.63:0/1949827151 >> v2:172.21.15.63:3300/0 conn(0x7f51d409b530 0x7f51d4099c10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f51d4145fe0 tx=0x7f51c0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:26.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.128+0000 7f51d3fff700 1 --2- 172.21.15.63:0/1949827151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51d409b530 0x7f51d4099c10 secure :-1 s=READY pgs=2144 cs=0 l=1 rx=0x7f51d4145fe0 tx=0x7f51c0008920).ready entity=mon.0 client_cookie=89038bbeeb8b7a4c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:26.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.128+0000 7f51d3fff700 1 --2- 172.21.15.63:0/1949827151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51d409b530 0x7f51d4099c10 secure :-1 s=THROTTLE_DONE pgs=2144 cs=0 l=1 rx=0x7f51d4145fe0 tx=0x7f51c0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:26.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.128+0000 7f51d37fe700 1 -- 172.21.15.63:0/1949827151 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51c00116b0 con 0x7f51d409b530 2020-05-18T21:38:26.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.128+0000 7f51d3fff700 1 --2- 172.21.15.63:0/1949827151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51d409b530 0x7f51d4099c10 secure :-1 s=THROTTLE_DONE pgs=2144 cs=0 l=1 rx=0x7f51d4145fe0 tx=0x7f51c0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:26.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.128+0000 7f51d3fff700 1 --2- 172.21.15.63:0/1949827151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51d409b530 0x7f51d4099c10 secure :-1 s=THROTTLE_DONE pgs=2144 cs=0 l=1 rx=0x7f51d4145fe0 tx=0x7f51c0008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:26.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.128+0000 7f51d37fe700 1 -- 172.21.15.63:0/1949827151 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c0011810 con 0x7f51d409b530 2020-05-18T21:38:26.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.128+0000 7f51d37fe700 1 -- 172.21.15.63:0/1949827151 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51c0011c30 con 0x7f51d409b530 2020-05-18T21:38:26.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.128+0000 7f51db1f4700 1 -- 172.21.15.63:0/1949827151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51d409b530 msgr2=0x7f51d4099c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:26.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.128+0000 7f51db1f4700 1 --2- 172.21.15.63:0/1949827151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51d409b530 0x7f51d4099c10 secure :-1 s=READY pgs=2144 cs=0 l=1 rx=0x7f51d4145fe0 tx=0x7f51c0008920).stop 2020-05-18T21:38:26.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.128+0000 7f51db1f4700 1 -- 172.21.15.63:0/1949827151 shutdown_connections 2020-05-18T21:38:26.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.128+0000 7f51db1f4700 1 --2- 172.21.15.63:0/1949827151 >> v2:172.21.15.155:3300/0 conn(0x7f51d40b5e30 0x7f51d40b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:26.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.128+0000 7f51db1f4700 1 --2- 172.21.15.63:0/1949827151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51d409b530 0x7f51d4099c10 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:26.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.128+0000 7f51db1f4700 1 -- 172.21.15.63:0/1949827151 >> 172.21.15.63:0/1949827151 conn(0x7f51d40b9750 msgr2=0x7f51d40b5720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:26.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.128+0000 7f51db1f4700 1 -- 172.21.15.63:0/1949827151 shutdown_connections 2020-05-18T21:38:26.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.128+0000 7f51db1f4700 1 -- 172.21.15.63:0/1949827151 wait complete. 2020-05-18T21:38:26.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.128+0000 7f51db1f4700 1 Processor -- start 2020-05-18T21:38:26.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.128+0000 7f51db1f4700 1 -- start start 2020-05-18T21:38:26.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51db1f4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f51d409b530 0x7f51d40b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:26.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51db1f4700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51d409e620 0x7f51d40b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:26.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51db1f4700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d40afd10 con 0x7f51d40b5e30 2020-05-18T21:38:26.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51db1f4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d40b8000 con 0x7f51d409b530 2020-05-18T21:38:26.144 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51db1f4700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d40afa70 con 0x7f51d409e620 2020-05-18T21:38:26.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d9791700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f51d40b5e30 0x7f51d41416a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38944/0 (socket says 172.21.15.63:38944) 2020-05-18T21:38:26.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d9791700 1 -- 172.21.15.63:0/787571276 learned_addr learned my addr 172.21.15.63:0/787571276 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:26.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d8f90700 1 --2- 172.21.15.63:0/787571276 >> v2:172.21.15.155:3300/0 conn(0x7f51d409b530 0x7f51d40b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:26.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d3fff700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51d409e620 0x7f51d40b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:26.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d1ffb700 1 -- 172.21.15.63:0/787571276 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509355297 0 0) 0x7f51d40afd10 con 0x7f51d40b5e30 2020-05-18T21:38:26.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d1ffb700 1 -- 172.21.15.63:0/787571276 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51bc002fe0 con 0x7f51d40b5e30 2020-05-18T21:38:26.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d1ffb700 1 -- 172.21.15.63:0/787571276 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 394600081 0 0) 0x7f51bc002fe0 con 0x7f51d40b5e30 2020-05-18T21:38:26.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d3fff700 1 -- 172.21.15.63:0/787571276 >> v2:172.21.15.155:3300/0 conn(0x7f51d409b530 msgr2=0x7f51d40b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:26.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d3fff700 1 --2- 172.21.15.63:0/787571276 >> v2:172.21.15.155:3300/0 conn(0x7f51d409b530 0x7f51d40b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:26.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d3fff700 1 -- 172.21.15.63:0/787571276 >> v1:172.21.15.63:6789/0 conn(0x7f51d40b5e30 legacy=0x7f51d41416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:26.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d3fff700 1 -- 172.21.15.63:0/787571276 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d4147a10 con 0x7f51d409e620 2020-05-18T21:38:26.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d8f90700 1 --2- 172.21.15.63:0/787571276 >> v2:172.21.15.155:3300/0 conn(0x7f51d409b530 0x7f51d40b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:38:26.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d3fff700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51d409e620 0x7f51d40b7ba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51cc0019f0 tx=0x7f51d409a9d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:26.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d3fff700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51d409e620 0x7f51d40b7ba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51cc0019f0 tx=0x7f51d409a9d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:26.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d3fff700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51d409e620 0x7f51d40b7ba0 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f51cc0019f0 tx=0x7f51d409a9d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:26.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d3fff700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51d409e620 0x7f51d40b7ba0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f51cc0019f0 tx=0x7f51d409a9d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:26.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d1ffb700 1 -- 172.21.15.63:0/787571276 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51cc001850 con 0x7f51d409e620 2020-05-18T21:38:26.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d3fff700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51d409e620 0x7f51d40b7ba0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f51cc0019f0 tx=0x7f51d409a9d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:26.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51db1f4700 1 -- 172.21.15.63:0/787571276 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d40b44d0 con 0x7f51d409e620 2020-05-18T21:38:26.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d3fff700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51d409e620 0x7f51d40b7ba0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f51cc0019f0 tx=0x7f51d409a9d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:26.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d1ffb700 1 -- 172.21.15.63:0/787571276 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c0011b00 con 0x7f51d409e620 2020-05-18T21:38:26.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d1ffb700 1 -- 172.21.15.63:0/787571276 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51c0011c70 con 0x7f51d409e620 2020-05-18T21:38:26.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51db1f4700 1 -- 172.21.15.63:0/787571276 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d40af5d0 con 0x7f51d409e620 2020-05-18T21:38:26.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.132+0000 7f51d3fff700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51d409e620 0x7f51d40b7ba0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f51cc0019f0 tx=0x7f51d409a9d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:26.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.136+0000 7f51db1f4700 1 -- 172.21.15.63:0/787571276 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d40569e0 con 0x7f51d409e620 2020-05-18T21:38:26.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.136+0000 7f51d1ffb700 1 -- 172.21.15.63:0/787571276 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f51c0007360 con 0x7f51d409e620 2020-05-18T21:38:26.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.136+0000 7f51d3fff700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51d409e620 0x7f51d40b7ba0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f51cc0019f0 tx=0x7f51d409a9d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:26.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.136+0000 7f51d1ffb700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51bc04fd60 0x7f51bc052220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:26.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.136+0000 7f51d1ffb700 1 -- 172.21.15.63:0/787571276 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5511+0+0 (secure 0 0 0) 0x7f51c0063dd0 con 0x7f51d409e620 2020-05-18T21:38:26.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.136+0000 7f51d8f90700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51bc04fd60 0x7f51bc052220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:26.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.136+0000 7f51d8f90700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51bc04fd60 0x7f51bc052220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51d4060ab0 tx=0x7f51c80013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:26.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.136+0000 7f51d8f90700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51bc04fd60 0x7f51bc052220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51d4060ab0 tx=0x7f51c80013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:26.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.136+0000 7f51d8f90700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51bc04fd60 0x7f51bc052220 secure :-1 s=READY pgs=841 cs=0 l=1 rx=0x7f51d4060ab0 tx=0x7f51c80013e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:26.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.144+0000 7f51d3fff700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51d409e620 0x7f51d40b7ba0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f51cc0019f0 tx=0x7f51d409a9d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:26.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.144+0000 7f51d1ffb700 1 -- 172.21.15.63:0/787571276 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f51c003e220 con 0x7f51d409e620 2020-05-18T21:38:26.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:26.280+0000 7f51db1f4700 1 -- 172.21.15.63:0/787571276 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f51d405c060 con 0x7f51d409e620 2020-05-18T21:38:27.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.084+0000 7f51d3fff700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51d409e620 0x7f51d40b7ba0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f51cc0019f0 tx=0x7f51d409a9d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.084+0000 7f51d1ffb700 1 -- 172.21.15.63:0/787571276 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v163) v1 ==== 97+0+0 (secure 0 0 0) 0x7f51c0041840 con 0x7f51d409e620 2020-05-18T21:38:27.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.088+0000 7f51db1f4700 1 -- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51bc04fd60 msgr2=0x7f51bc052220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.088+0000 7f51db1f4700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51bc04fd60 0x7f51bc052220 secure :-1 s=READY pgs=841 cs=0 l=1 rx=0x7f51d4060ab0 tx=0x7f51c80013e0).stop 2020-05-18T21:38:27.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.088+0000 7f51db1f4700 1 -- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51d409e620 msgr2=0x7f51d40b7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.088+0000 7f51db1f4700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51d409e620 0x7f51d40b7ba0 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f51cc0019f0 tx=0x7f51d409a9d0).stop 2020-05-18T21:38:27.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.088+0000 7f51db1f4700 1 -- 172.21.15.63:0/787571276 shutdown_connections 2020-05-18T21:38:27.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.088+0000 7f51db1f4700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51bc04fd60 0x7f51bc052220 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:27.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.088+0000 7f51db1f4700 1 --2- 172.21.15.63:0/787571276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51d409e620 0x7f51d40b7ba0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:27.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.088+0000 7f51db1f4700 1 --2- 172.21.15.63:0/787571276 >> v2:172.21.15.155:3300/0 conn(0x7f51d409b530 0x7f51d40b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:27.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.088+0000 7f51db1f4700 1 -- 172.21.15.63:0/787571276 >> 172.21.15.63:0/787571276 conn(0x7f51d40b9750 msgr2=0x7f51d406a590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:27.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.088+0000 7f51db1f4700 1 -- 172.21.15.63:0/787571276 shutdown_connections 2020-05-18T21:38:27.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.088+0000 7f51db1f4700 1 -- 172.21.15.63:0/787571276 wait complete. 2020-05-18T21:38:27.098 INFO:teuthology.orchestra.run.smithi063.stderr: removed all blacklist entries 2020-05-18T21:38:27.111 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-05-18T21:38:27.111 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-05-18T21:38:27.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb0917cf700 1 Processor -- start 2020-05-18T21:38:27.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb0917cf700 1 -- start start 2020-05-18T21:38:27.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb0917cf700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb08c0b2860 0x7fb08c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:27.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb0917cf700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb08c14e570 0x7fb08c14a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:27.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb0917cf700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c14d960 con 0x7fb08c060b90 2020-05-18T21:38:27.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb0917cf700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08c066210 con 0x7fb08c14e570 2020-05-18T21:38:27.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb0917cf700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c14db90 con 0x7fb08c0b2860 2020-05-18T21:38:27.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb08b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb08c14e570 0x7fb08c14a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:27.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb08affd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fb08c060b90 0x7fb08c144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:37264/0 (socket says 172.21.15.63:37264) 2020-05-18T21:38:27.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb08affd700 1 -- 172.21.15.63:0/950126075 learned_addr learned my addr 172.21.15.63:0/950126075 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:27.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb08a7fc700 1 --2- 172.21.15.63:0/950126075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb08c0b2860 0x7fb08c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:27.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb08b7fe700 1 -- 172.21.15.63:0/950126075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb08c0b2860 msgr2=0x7fb08c0615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:27.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb08b7fe700 1 --2- 172.21.15.63:0/950126075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb08c0b2860 0x7fb08c0615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:27.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb08b7fe700 1 -- 172.21.15.63:0/950126075 >> v1:172.21.15.155:6789/0 conn(0x7fb08c060b90 legacy=0x7fb08c144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb08b7fe700 1 -- 172.21.15.63:0/950126075 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c14de30 con 0x7fb08c14e570 2020-05-18T21:38:27.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb08b7fe700 1 --2- 172.21.15.63:0/950126075 >> v2:172.21.15.63:3300/0 conn(0x7fb08c14e570 0x7fb08c14a390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb084002f70 tx=0x7fb084007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb08b7fe700 1 --2- 172.21.15.63:0/950126075 >> v2:172.21.15.63:3300/0 conn(0x7fb08c14e570 0x7fb08c14a390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb084002f70 tx=0x7fb084007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb08b7fe700 1 --2- 172.21.15.63:0/950126075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb08c14e570 0x7fb08c14a390 secure :-1 s=READY pgs=2146 cs=0 l=1 rx=0x7fb084002f70 tx=0x7fb084007a80).ready entity=mon.0 client_cookie=a8099156f82641b4 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:27.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb08b7fe700 1 --2- 172.21.15.63:0/950126075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb08c14e570 0x7fb08c14a390 secure :-1 s=THROTTLE_DONE pgs=2146 cs=0 l=1 rx=0x7fb084002f70 tx=0x7fb084007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb089ffb700 1 -- 172.21.15.63:0/950126075 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb084008e80 con 0x7fb08c14e570 2020-05-18T21:38:27.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb08b7fe700 1 --2- 172.21.15.63:0/950126075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb08c14e570 0x7fb08c14a390 secure :-1 s=THROTTLE_DONE pgs=2146 cs=0 l=1 rx=0x7fb084002f70 tx=0x7fb084007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb089ffb700 1 -- 172.21.15.63:0/950126075 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0840115f0 con 0x7fb08c14e570 2020-05-18T21:38:27.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb08b7fe700 1 --2- 172.21.15.63:0/950126075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb08c14e570 0x7fb08c14a390 secure :-1 s=THROTTLE_DONE pgs=2146 cs=0 l=1 rx=0x7fb084002f70 tx=0x7fb084007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb089ffb700 1 -- 172.21.15.63:0/950126075 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb084011a10 con 0x7fb08c14e570 2020-05-18T21:38:27.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb0917cf700 1 -- 172.21.15.63:0/950126075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb08c14e570 msgr2=0x7fb08c14a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb0917cf700 1 --2- 172.21.15.63:0/950126075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb08c14e570 0x7fb08c14a390 secure :-1 s=READY pgs=2146 cs=0 l=1 rx=0x7fb084002f70 tx=0x7fb084007a80).stop 2020-05-18T21:38:27.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb0917cf700 1 -- 172.21.15.63:0/950126075 shutdown_connections 2020-05-18T21:38:27.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb0917cf700 1 --2- 172.21.15.63:0/950126075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb08c14e570 0x7fb08c14a390 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:27.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb0917cf700 1 --2- 172.21.15.63:0/950126075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb08c0b2860 0x7fb08c0615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:27.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb0917cf700 1 -- 172.21.15.63:0/950126075 >> 172.21.15.63:0/950126075 conn(0x7fb08c0b83d0 msgr2=0x7fb08c0b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:27.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.216+0000 7fb0917cf700 1 -- 172.21.15.63:0/950126075 shutdown_connections 2020-05-18T21:38:27.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.220+0000 7fb0917cf700 1 -- 172.21.15.63:0/950126075 wait complete. 2020-05-18T21:38:27.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.220+0000 7fb0917cf700 1 Processor -- start 2020-05-18T21:38:27.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.220+0000 7fb0917cf700 1 -- start start 2020-05-18T21:38:27.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.220+0000 7fb0917cf700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb08c060b90 0x7fb08c0ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:27.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.220+0000 7fb0917cf700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb08c0b2860 0x7fb08c0b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:27.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.220+0000 7fb0917cf700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c14b360 con 0x7fb08c14e570 2020-05-18T21:38:27.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.220+0000 7fb0917cf700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08c0b7a00 con 0x7fb08c060b90 2020-05-18T21:38:27.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.220+0000 7fb0917cf700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c14a510 con 0x7fb08c0b2860 2020-05-18T21:38:27.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.220+0000 7fb08affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb08c060b90 0x7fb08c0ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:27.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.220+0000 7fb08b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb08c14e570 0x7fb08c14ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38958/0 (socket says 172.21.15.63:38958) 2020-05-18T21:38:27.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.220+0000 7fb08b7fe700 1 -- 172.21.15.63:0/961649180 learned_addr learned my addr 172.21.15.63:0/961649180 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:27.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.220+0000 7fb08a7fc700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb08c0b2860 0x7fb08c0b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:27.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.220+0000 7fb07bfff700 1 -- 172.21.15.63:0/961649180 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270349779 0 0) 0x7fb08c14b360 con 0x7fb08c14e570 2020-05-18T21:38:27.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.220+0000 7fb07bfff700 1 -- 172.21.15.63:0/961649180 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb068002fe0 con 0x7fb08c14e570 2020-05-18T21:38:27.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.220+0000 7fb08affd700 1 -- 172.21.15.63:0/961649180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb08c0b2860 msgr2=0x7fb08c0b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.220+0000 7fb08affd700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb08c0b2860 0x7fb08c0b75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:27.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.220+0000 7fb08affd700 1 -- 172.21.15.63:0/961649180 >> v1:172.21.15.63:6789/0 conn(0x7fb08c14e570 legacy=0x7fb08c14ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.220+0000 7fb08affd700 1 -- 172.21.15.63:0/961649180 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c14a7b0 con 0x7fb08c060b90 2020-05-18T21:38:27.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.220+0000 7fb08affd700 1 --2- 172.21.15.63:0/961649180 >> v2:172.21.15.63:3300/0 conn(0x7fb08c060b90 0x7fb08c0ac4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb08c060650 tx=0x7fb07c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.224+0000 7fb08affd700 1 --2- 172.21.15.63:0/961649180 >> v2:172.21.15.63:3300/0 conn(0x7fb08c060b90 0x7fb08c0ac4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb08c060650 tx=0x7fb07c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.224+0000 7fb08affd700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb08c060b90 0x7fb08c0ac4d0 secure :-1 s=READY pgs=2148 cs=0 l=1 rx=0x7fb08c060650 tx=0x7fb07c010c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:27.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.224+0000 7fb08affd700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb08c060b90 0x7fb08c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=2148 cs=0 l=1 rx=0x7fb08c060650 tx=0x7fb07c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.224+0000 7fb07bfff700 1 -- 172.21.15.63:0/961649180 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb07c005e70 con 0x7fb08c060b90 2020-05-18T21:38:27.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.224+0000 7fb08affd700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb08c060b90 0x7fb08c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=2148 cs=0 l=1 rx=0x7fb08c060650 tx=0x7fb07c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.224+0000 7fb08affd700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb08c060b90 0x7fb08c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=2148 cs=0 l=1 rx=0x7fb08c060650 tx=0x7fb07c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.224+0000 7fb07bfff700 1 -- 172.21.15.63:0/961649180 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c012460 con 0x7fb08c060b90 2020-05-18T21:38:27.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.224+0000 7fb0917cf700 1 -- 172.21.15.63:0/961649180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08c0ad5b0 con 0x7fb08c060b90 2020-05-18T21:38:27.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.224+0000 7fb07bfff700 1 -- 172.21.15.63:0/961649180 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb07c012880 con 0x7fb08c060b90 2020-05-18T21:38:27.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.224+0000 7fb0917cf700 1 -- 172.21.15.63:0/961649180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08c0aeba0 con 0x7fb08c060b90 2020-05-18T21:38:27.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.224+0000 7fb0917cf700 1 -- 172.21.15.63:0/961649180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08c0569e0 con 0x7fb08c060b90 2020-05-18T21:38:27.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.224+0000 7fb08affd700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb08c060b90 0x7fb08c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=2148 cs=0 l=1 rx=0x7fb08c060650 tx=0x7fb07c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.224+0000 7fb07bfff700 1 -- 172.21.15.63:0/961649180 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb07c012af0 con 0x7fb08c060b90 2020-05-18T21:38:27.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.224+0000 7fb08affd700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb08c060b90 0x7fb08c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=2148 cs=0 l=1 rx=0x7fb08c060650 tx=0x7fb07c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.224+0000 7fb07bfff700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb06804fd90 0x7fb068052250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:27.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.224+0000 7fb07bfff700 1 -- 172.21.15.63:0/961649180 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb07c0090c0 con 0x7fb08c060b90 2020-05-18T21:38:27.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.224+0000 7fb08a7fc700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb06804fd90 0x7fb068052250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:27.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.228+0000 7fb08a7fc700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb06804fd90 0x7fb068052250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb080002f70 tx=0x7fb080008440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.228+0000 7fb08a7fc700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb06804fd90 0x7fb068052250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb080002f70 tx=0x7fb080008440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.228+0000 7fb08a7fc700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb06804fd90 0x7fb068052250 secure :-1 s=READY pgs=843 cs=0 l=1 rx=0x7fb080002f70 tx=0x7fb080008440).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:27.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.232+0000 7fb08affd700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb08c060b90 0x7fb08c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=2148 cs=0 l=1 rx=0x7fb08c060650 tx=0x7fb07c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.232+0000 7fb07bfff700 1 -- 172.21.15.63:0/961649180 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb07c03e580 con 0x7fb08c060b90 2020-05-18T21:38:27.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.384+0000 7fb0917cf700 1 -- 172.21.15.63:0/961649180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb08c0b4060 con 0x7fb08c060b90 2020-05-18T21:38:27.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.384+0000 7fb08affd700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb08c060b90 0x7fb08c0ac4d0 secure :-1 s=THROTTLE_DONE pgs=2148 cs=0 l=1 rx=0x7fb08c060650 tx=0x7fb07c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.384+0000 7fb07bfff700 1 -- 172.21.15.63:0/961649180 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v62) v1 ==== 80+0+4513 (secure 0 0 0) 0x7fb07c041ba0 con 0x7fb08c060b90 2020-05-18T21:38:27.391 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:27.392 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:38:27.392 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_dump": [ 2020-05-18T21:38:27.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:27.392 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.a", 2020-05-18T21:38:27.392 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJekJyyLRAAfB5XJCsXTAmZdkFOaQrokg==", 2020-05-18T21:38:27.393 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:38:27.393 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:38:27.393 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:38:27.393 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:38:27.393 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:38:27.394 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:27.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:27.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:27.394 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.b", 2020-05-18T21:38:27.395 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeSVE8MRAAEEytuzLtcQMC+1uQ/yh8eA==", 2020-05-18T21:38:27.395 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:38:27.395 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:38:27.395 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:38:27.395 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:38:27.396 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:38:27.396 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:27.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:27.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:27.396 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.0", 2020-05-18T21:38:27.396 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBq/cJeIn7mJhAArx+YEdVbsfXXNOLWdaAgWw==", 2020-05-18T21:38:27.397 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:38:27.397 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:38:27.397 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:38:27.397 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:38:27.397 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:27.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:27.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:27.398 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.1", 2020-05-18T21:38:27.398 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBt/cJelHywCRAAFyQ3sPEE0RTSy4tKfsDfyw==", 2020-05-18T21:38:27.398 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:38:27.399 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:38:27.399 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:38:27.399 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:38:27.399 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:27.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:27.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:27.400 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.2", 2020-05-18T21:38:27.400 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBv/cJecexDLBAAxhlFq20MBkKvDjuM1yi8XQ==", 2020-05-18T21:38:27.400 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:38:27.400 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:38:27.400 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:38:27.401 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:38:27.401 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:27.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:27.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:27.401 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.3", 2020-05-18T21:38:27.401 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBy/cJe9IqwDxAAMg1In7bIITDcOZljzzTpDQ==", 2020-05-18T21:38:27.402 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:38:27.402 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:38:27.402 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:38:27.402 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:38:27.402 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:27.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:27.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:27.403 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.4", 2020-05-18T21:38:27.403 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB3/cJeLXgxFhAA/kMVV5hCRny2uXKvvbu8Og==", 2020-05-18T21:38:27.403 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:38:27.404 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:38:27.404 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:38:27.404 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:38:27.404 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:27.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:27.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:27.405 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.5", 2020-05-18T21:38:27.405 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB5/cJeucpsNRAAjGh+6yUC8Fji9PE4COi/Eg==", 2020-05-18T21:38:27.405 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:38:27.405 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:38:27.405 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:38:27.406 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:38:27.406 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:27.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:27.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:27.406 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.6", 2020-05-18T21:38:27.406 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB8/cJelSPpGhAAXobGqH9qaW1VZfEpH8bUbQ==", 2020-05-18T21:38:27.407 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:38:27.407 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:38:27.407 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:38:27.407 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:38:27.407 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:27.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:27.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:27.408 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.7", 2020-05-18T21:38:27.408 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQB+/cJeUIl5OBAAPd8H8ohOWZw9ubO7uCB6zg==", 2020-05-18T21:38:27.408 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:38:27.408 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:38:27.409 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:38:27.409 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:38:27.409 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:27.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:27.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:27.410 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.0", 2020-05-18T21:38:27.410 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeap3RNhAAi2vKpsKtzSL1Uuqm8pWYJQ==", 2020-05-18T21:38:27.410 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:38:27.410 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:38:27.410 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:38:27.410 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:38:27.411 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:27.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:27.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:27.411 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.1", 2020-05-18T21:38:27.411 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJeekrQABAA5TmzWOt24C6hgZw/WTj5dw==", 2020-05-18T21:38:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:38:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:38:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:38:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:38:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:27.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:27.413 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.2", 2020-05-18T21:38:27.413 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJehSnFAxAAXUZwqNTXqAApEB3nXs4u6g==", 2020-05-18T21:38:27.413 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:38:27.413 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:38:27.414 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:38:27.414 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:38:27.414 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:27.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:27.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:27.415 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.3", 2020-05-18T21:38:27.415 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBo/cJe2HdDBhAA07y5pn/bKKa9TBbZFvIh9g==", 2020-05-18T21:38:27.415 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:38:27.415 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2020-05-18T21:38:27.415 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow r", 2020-05-18T21:38:27.415 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rw pool=cephfs_data" 2020-05-18T21:38:27.416 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:27.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:27.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:27.416 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.admin", 2020-05-18T21:38:27.416 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJe/K4fGRAA+rP3BYuWiyx/fKmQ3bV6Lw==", 2020-05-18T21:38:27.417 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:38:27.417 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:38:27.417 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2020-05-18T21:38:27.417 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2020-05-18T21:38:27.417 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:38:27.417 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:27.418 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:27.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:27.418 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.x", 2020-05-18T21:38:27.418 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJemmqEKhAAe5ySRz8Id0ug4matQwL0uw==", 2020-05-18T21:38:27.418 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:38:27.419 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:38:27.419 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:38:27.419 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:38:27.419 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:27.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:27.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:27.420 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.y", 2020-05-18T21:38:27.420 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBn/cJeF/BNJhAAi/vrldC6qoWJWnSHpE3ung==", 2020-05-18T21:38:27.420 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2020-05-18T21:38:27.420 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2020-05-18T21:38:27.420 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2020-05-18T21:38:27.421 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2020-05-18T21:38:27.421 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:27.421 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:27.421 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:38:27.422 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:38:27.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.384+0000 7fb0917cf700 1 -- 172.21.15.63:0/961649180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb06804fd90 msgr2=0x7fb068052250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.384+0000 7fb0917cf700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb06804fd90 0x7fb068052250 secure :-1 s=READY pgs=843 cs=0 l=1 rx=0x7fb080002f70 tx=0x7fb080008440).stop 2020-05-18T21:38:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.384+0000 7fb0917cf700 1 -- 172.21.15.63:0/961649180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb08c060b90 msgr2=0x7fb08c0ac4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.384+0000 7fb0917cf700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb08c060b90 0x7fb08c0ac4d0 secure :-1 s=READY pgs=2148 cs=0 l=1 rx=0x7fb08c060650 tx=0x7fb07c010c50).stop 2020-05-18T21:38:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.384+0000 7fb0917cf700 1 -- 172.21.15.63:0/961649180 shutdown_connections 2020-05-18T21:38:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.384+0000 7fb0917cf700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb06804fd90 0x7fb068052250 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:27.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.384+0000 7fb0917cf700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb08c0b2860 0x7fb08c0b75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:27.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.384+0000 7fb0917cf700 1 --2- 172.21.15.63:0/961649180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb08c060b90 0x7fb08c0ac4d0 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:27.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.384+0000 7fb0917cf700 1 -- 172.21.15.63:0/961649180 >> 172.21.15.63:0/961649180 conn(0x7fb08c0b83d0 msgr2=0x7fb08c0b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:27.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.388+0000 7fb0917cf700 1 -- 172.21.15.63:0/961649180 shutdown_connections 2020-05-18T21:38:27.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.388+0000 7fb0917cf700 1 -- 172.21.15.63:0/961649180 wait complete. 2020-05-18T21:38:27.426 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:38:27.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d21da700 1 Processor -- start 2020-05-18T21:38:27.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d21da700 1 -- start start 2020-05-18T21:38:27.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d21da700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f42cc05f110 0x7f42cc0b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:27.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d21da700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f42cc064fd0 0x7f42cc14d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:27.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d21da700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42cc14a330 con 0x7f42cc14aa70 2020-05-18T21:38:27.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d21da700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42cc14a140 con 0x7f42cc064fd0 2020-05-18T21:38:27.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d21da700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42cc065460 con 0x7f42cc05f110 2020-05-18T21:38:27.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d09d7700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f42cc14aa70 0x7f42cc0648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38962/0 (socket says 172.21.15.63:38962) 2020-05-18T21:38:27.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d09d7700 1 -- 172.21.15.63:0/44683944 learned_addr learned my addr 172.21.15.63:0/44683944 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:27.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d19d9700 1 --2- 172.21.15.63:0/44683944 >> v2:172.21.15.63:3300/0 conn(0x7f42cc064fd0 0x7f42cc14d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:27.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d11d8700 1 --2- 172.21.15.63:0/44683944 >> v2:172.21.15.155:3300/0 conn(0x7f42cc05f110 0x7f42cc0b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:27.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42c3fff700 1 -- 172.21.15.63:0/44683944 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049227335 0 0) 0x7f42cc14a330 con 0x7f42cc14aa70 2020-05-18T21:38:27.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42c3fff700 1 -- 172.21.15.63:0/44683944 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42b0003270 con 0x7f42cc14aa70 2020-05-18T21:38:27.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d19d9700 1 -- 172.21.15.63:0/44683944 >> v2:172.21.15.155:3300/0 conn(0x7f42cc05f110 msgr2=0x7f42cc0b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:27.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d19d9700 1 --2- 172.21.15.63:0/44683944 >> v2:172.21.15.155:3300/0 conn(0x7f42cc05f110 0x7f42cc0b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:27.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d19d9700 1 -- 172.21.15.63:0/44683944 >> v1:172.21.15.63:6789/0 conn(0x7f42cc14aa70 legacy=0x7f42cc0648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d19d9700 1 -- 172.21.15.63:0/44683944 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc14a5d0 con 0x7f42cc064fd0 2020-05-18T21:38:27.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d19d9700 1 --2- 172.21.15.63:0/44683944 >> v2:172.21.15.63:3300/0 conn(0x7f42cc064fd0 0x7f42cc14d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f42cc063f10 tx=0x7f42c4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d19d9700 1 --2- 172.21.15.63:0/44683944 >> v2:172.21.15.63:3300/0 conn(0x7f42cc064fd0 0x7f42cc14d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f42cc063f10 tx=0x7f42c4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d19d9700 1 --2- 172.21.15.63:0/44683944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42cc064fd0 0x7f42cc14d710 secure :-1 s=READY pgs=2150 cs=0 l=1 rx=0x7f42cc063f10 tx=0x7f42c4008ca0).ready entity=mon.0 client_cookie=c1d4fe1e859e67a1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:27.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d19d9700 1 --2- 172.21.15.63:0/44683944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42cc064fd0 0x7f42cc14d710 secure :-1 s=THROTTLE_DONE pgs=2150 cs=0 l=1 rx=0x7f42cc063f10 tx=0x7f42c4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42c3fff700 1 -- 172.21.15.63:0/44683944 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42c4011db0 con 0x7f42cc064fd0 2020-05-18T21:38:27.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d19d9700 1 --2- 172.21.15.63:0/44683944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42cc064fd0 0x7f42cc14d710 secure :-1 s=THROTTLE_DONE pgs=2150 cs=0 l=1 rx=0x7f42cc063f10 tx=0x7f42c4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d19d9700 1 --2- 172.21.15.63:0/44683944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42cc064fd0 0x7f42cc14d710 secure :-1 s=THROTTLE_DONE pgs=2150 cs=0 l=1 rx=0x7f42cc063f10 tx=0x7f42c4008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42c3fff700 1 -- 172.21.15.63:0/44683944 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c400a180 con 0x7f42cc064fd0 2020-05-18T21:38:27.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42c3fff700 1 -- 172.21.15.63:0/44683944 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42c400a560 con 0x7f42cc064fd0 2020-05-18T21:38:27.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d21da700 1 -- 172.21.15.63:0/44683944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42cc064fd0 msgr2=0x7f42cc14d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d21da700 1 --2- 172.21.15.63:0/44683944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42cc064fd0 0x7f42cc14d710 secure :-1 s=READY pgs=2150 cs=0 l=1 rx=0x7f42cc063f10 tx=0x7f42c4008ca0).stop 2020-05-18T21:38:27.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d21da700 1 -- 172.21.15.63:0/44683944 shutdown_connections 2020-05-18T21:38:27.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d21da700 1 --2- 172.21.15.63:0/44683944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42cc064fd0 0x7f42cc14d710 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:27.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d21da700 1 --2- 172.21.15.63:0/44683944 >> v2:172.21.15.155:3300/0 conn(0x7f42cc05f110 0x7f42cc0b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:27.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d21da700 1 -- 172.21.15.63:0/44683944 >> 172.21.15.63:0/44683944 conn(0x7f42cc069fc0 msgr2=0x7f42cc06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:27.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d21da700 1 -- 172.21.15.63:0/44683944 shutdown_connections 2020-05-18T21:38:27.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.528+0000 7f42d21da700 1 -- 172.21.15.63:0/44683944 wait complete. 2020-05-18T21:38:27.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.532+0000 7f42d21da700 1 Processor -- start 2020-05-18T21:38:27.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.532+0000 7f42d21da700 1 -- start start 2020-05-18T21:38:27.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.532+0000 7f42d21da700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f42cc064fd0 0x7f42cc146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:27.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.532+0000 7f42d21da700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42cc142aa0 con 0x7f42cc14aa70 2020-05-18T21:38:27.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.532+0000 7f42d21da700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42cc146680 con 0x7f42cc05f110 2020-05-18T21:38:27.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.532+0000 7f42d21da700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42cc140190 con 0x7f42cc064fd0 2020-05-18T21:38:27.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.532+0000 7f42d19d9700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f42cc14aa70 0x7f42cc146b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38972/0 (socket says 172.21.15.63:38972) 2020-05-18T21:38:27.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.532+0000 7f42d19d9700 1 -- 172.21.15.63:0/1533650997 learned_addr learned my addr 172.21.15.63:0/1533650997 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:27.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.532+0000 7f42d09d7700 1 --2- 172.21.15.63:0/1533650997 >> v2:172.21.15.155:3300/0 conn(0x7f42cc064fd0 0x7f42cc146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:27.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.532+0000 7f42c27fc700 1 -- 172.21.15.63:0/1533650997 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108245120 0 0) 0x7f42cc142aa0 con 0x7f42cc14aa70 2020-05-18T21:38:27.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.532+0000 7f42c27fc700 1 -- 172.21.15.63:0/1533650997 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42b4002fe0 con 0x7f42cc14aa70 2020-05-18T21:38:27.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.532+0000 7f42c27fc700 1 -- 172.21.15.63:0/1533650997 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089165967 0 0) 0x7f42cc146680 con 0x7f42cc05f110 2020-05-18T21:38:27.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.532+0000 7f42c27fc700 1 -- 172.21.15.63:0/1533650997 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42cc142aa0 con 0x7f42cc05f110 2020-05-18T21:38:27.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.532+0000 7f42c27fc700 1 -- 172.21.15.63:0/1533650997 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1532202247 0 0) 0x7f42b4002fe0 con 0x7f42cc14aa70 2020-05-18T21:38:27.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.532+0000 7f42d09d7700 1 -- 172.21.15.63:0/1533650997 >> v1:172.21.15.155:6789/0 conn(0x7f42cc05f110 legacy=0x7f42cc0b8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.532+0000 7f42d09d7700 1 -- 172.21.15.63:0/1533650997 >> v1:172.21.15.63:6789/0 conn(0x7f42cc14aa70 legacy=0x7f42cc146b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.532+0000 7f42d09d7700 1 -- 172.21.15.63:0/1533650997 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc140430 con 0x7f42cc064fd0 2020-05-18T21:38:27.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.536+0000 7f42d09d7700 1 --2- 172.21.15.63:0/1533650997 >> v2:172.21.15.155:3300/0 conn(0x7f42cc064fd0 0x7f42cc146010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f42c4007cc0 tx=0x7f42c8010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.536+0000 7f42d09d7700 1 --2- 172.21.15.63:0/1533650997 >> v2:172.21.15.155:3300/0 conn(0x7f42cc064fd0 0x7f42cc146010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f42c4007cc0 tx=0x7f42c8010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.536+0000 7f42d09d7700 1 --2- 172.21.15.63:0/1533650997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42cc064fd0 0x7f42cc146010 secure :-1 s=READY pgs=1439 cs=0 l=1 rx=0x7f42c4007cc0 tx=0x7f42c8010950).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:27.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.536+0000 7f42d09d7700 1 --2- 172.21.15.63:0/1533650997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42cc064fd0 0x7f42cc146010 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7f42c4007cc0 tx=0x7f42c8010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.536+0000 7f42c27fc700 1 -- 172.21.15.63:0/1533650997 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42c40032f0 con 0x7f42cc064fd0 2020-05-18T21:38:27.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.536+0000 7f42d09d7700 1 --2- 172.21.15.63:0/1533650997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42cc064fd0 0x7f42cc146010 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7f42c4007cc0 tx=0x7f42c8010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.536+0000 7f42d09d7700 1 --2- 172.21.15.63:0/1533650997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42cc064fd0 0x7f42cc146010 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7f42c4007cc0 tx=0x7f42c8010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.536+0000 7f42c27fc700 1 -- 172.21.15.63:0/1533650997 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c8005b10 con 0x7f42cc064fd0 2020-05-18T21:38:27.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.536+0000 7f42d21da700 1 -- 172.21.15.63:0/1533650997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42cc0b8b90 con 0x7f42cc064fd0 2020-05-18T21:38:27.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.536+0000 7f42c27fc700 1 -- 172.21.15.63:0/1533650997 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42c80060d0 con 0x7f42cc064fd0 2020-05-18T21:38:27.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.536+0000 7f42d21da700 1 -- 172.21.15.63:0/1533650997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42cc141b00 con 0x7f42cc064fd0 2020-05-18T21:38:27.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.536+0000 7f42d21da700 1 -- 172.21.15.63:0/1533650997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42cc1405c0 con 0x7f42cc064fd0 2020-05-18T21:38:27.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.536+0000 7f42d09d7700 1 --2- 172.21.15.63:0/1533650997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42cc064fd0 0x7f42cc146010 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7f42c4007cc0 tx=0x7f42c8010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.536+0000 7f42c27fc700 1 -- 172.21.15.63:0/1533650997 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f42c800a360 con 0x7f42cc064fd0 2020-05-18T21:38:27.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.536+0000 7f42d09d7700 1 --2- 172.21.15.63:0/1533650997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42cc064fd0 0x7f42cc146010 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7f42c4007cc0 tx=0x7f42c8010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.536+0000 7f42c27fc700 1 --2- 172.21.15.63:0/1533650997 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f42b404fe60 0x7f42b4052320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:27.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.540+0000 7f42c27fc700 1 -- 172.21.15.63:0/1533650997 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f42c80090c0 con 0x7f42cc064fd0 2020-05-18T21:38:27.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.540+0000 7f42d11d8700 1 --2- 172.21.15.63:0/1533650997 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f42b404fe60 0x7f42b4052320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:27.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.540+0000 7f42d11d8700 1 --2- 172.21.15.63:0/1533650997 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f42b404fe60 0x7f42b4052320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f42bc002f30 tx=0x7f42bc0090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.540+0000 7f42d11d8700 1 --2- 172.21.15.63:0/1533650997 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f42b404fe60 0x7f42b4052320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f42bc002f30 tx=0x7f42bc0090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.540+0000 7f42d11d8700 1 --2- 172.21.15.63:0/1533650997 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f42b404fe60 0x7f42b4052320 secure :-1 s=READY pgs=844 cs=0 l=1 rx=0x7f42bc002f30 tx=0x7f42bc0090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:27.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.548+0000 7f42d09d7700 1 --2- 172.21.15.63:0/1533650997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42cc064fd0 0x7f42cc146010 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7f42c4007cc0 tx=0x7f42c8010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.559 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.548+0000 7f42c27fc700 1 -- 172.21.15.63:0/1533650997 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f42c803df10 con 0x7f42cc064fd0 2020-05-18T21:38:27.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.664+0000 7f42d21da700 1 -- 172.21.15.63:0/1533650997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42cc0569e0 con 0x7f42cc064fd0 2020-05-18T21:38:27.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.664+0000 7f42d09d7700 1 --2- 172.21.15.63:0/1533650997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42cc064fd0 0x7f42cc146010 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7f42c4007cc0 tx=0x7f42c8010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.664+0000 7f42c27fc700 1 -- 172.21.15.63:0/1533650997 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+13242 (secure 0 0 0) 0x7f42c8041530 con 0x7f42cc064fd0 2020-05-18T21:38:27.673 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:27.673 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":163,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:38:27.076774+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:38:27.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.668+0000 7f42d21da700 1 -- 172.21.15.63:0/1533650997 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f42b404fe60 msgr2=0x7f42b4052320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.668+0000 7f42d21da700 1 --2- 172.21.15.63:0/1533650997 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f42b404fe60 0x7f42b4052320 secure :-1 s=READY pgs=844 cs=0 l=1 rx=0x7f42bc002f30 tx=0x7f42bc0090f0).stop 2020-05-18T21:38:27.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.668+0000 7f42d21da700 1 -- 172.21.15.63:0/1533650997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42cc064fd0 msgr2=0x7f42cc146010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.668+0000 7f42d21da700 1 --2- 172.21.15.63:0/1533650997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42cc064fd0 0x7f42cc146010 secure :-1 s=READY pgs=1439 cs=0 l=1 rx=0x7f42c4007cc0 tx=0x7f42c8010950).stop 2020-05-18T21:38:27.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.668+0000 7f42d21da700 1 -- 172.21.15.63:0/1533650997 shutdown_connections 2020-05-18T21:38:27.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.668+0000 7f42d21da700 1 --2- 172.21.15.63:0/1533650997 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f42b404fe60 0x7f42b4052320 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:27.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.668+0000 7f42d21da700 1 --2- 172.21.15.63:0/1533650997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42cc064fd0 0x7f42cc146010 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:27.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.668+0000 7f42d21da700 1 -- 172.21.15.63:0/1533650997 >> 172.21.15.63:0/1533650997 conn(0x7f42cc069fc0 msgr2=0x7f42cc13f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:27.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.668+0000 7f42d21da700 1 -- 172.21.15.63:0/1533650997 shutdown_connections 2020-05-18T21:38:27.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.668+0000 7f42d21da700 1 -- 172.21.15.63:0/1533650997 wait complete. 2020-05-18T21:38:27.686 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-05-18T21:38:27.687 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:38:27.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.788+0000 7f49d094c700 1 Processor -- start 2020-05-18T21:38:27.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.788+0000 7f49d094c700 1 -- start start 2020-05-18T21:38:27.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49d094c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f49cc06a490 0x7f49cc0653f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:27.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49d094c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f49cc060e10 0x7f49cc061210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:27.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49d094c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49cc065a50 con 0x7f49cc0b4f60 2020-05-18T21:38:27.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49d094c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49cc065850 con 0x7f49cc06a490 2020-05-18T21:38:27.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49d094c700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49cc0606d0 con 0x7f49cc060e10 2020-05-18T21:38:27.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49ca59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f49cc06a490 0x7f49cc0653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:27.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49cad9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f49cc0b4f60 0x7f49cc129880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38976/0 (socket says 172.21.15.63:38976) 2020-05-18T21:38:27.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49cad9d700 1 -- 172.21.15.63:0/1332607268 learned_addr learned my addr 172.21.15.63:0/1332607268 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:27.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49cb59e700 1 --2- 172.21.15.63:0/1332607268 >> v2:172.21.15.155:3300/0 conn(0x7f49cc060e10 0x7f49cc061210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:27.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49c9d9b700 1 -- 172.21.15.63:0/1332607268 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500889732 0 0) 0x7f49cc065a50 con 0x7f49cc0b4f60 2020-05-18T21:38:27.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49c9d9b700 1 -- 172.21.15.63:0/1332607268 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49ac003270 con 0x7f49cc0b4f60 2020-05-18T21:38:27.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49ca59c700 1 -- 172.21.15.63:0/1332607268 >> v2:172.21.15.155:3300/0 conn(0x7f49cc060e10 msgr2=0x7f49cc061210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:27.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49ca59c700 1 --2- 172.21.15.63:0/1332607268 >> v2:172.21.15.155:3300/0 conn(0x7f49cc060e10 0x7f49cc061210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:27.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49ca59c700 1 -- 172.21.15.63:0/1332607268 >> v1:172.21.15.63:6789/0 conn(0x7f49cc0b4f60 legacy=0x7f49cc129880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49ca59c700 1 -- 172.21.15.63:0/1332607268 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc060970 con 0x7f49cc06a490 2020-05-18T21:38:27.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49ca59c700 1 --2- 172.21.15.63:0/1332607268 >> v2:172.21.15.63:3300/0 conn(0x7f49cc06a490 0x7f49cc0653f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f49bc002f70 tx=0x7f49bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49ca59c700 1 --2- 172.21.15.63:0/1332607268 >> v2:172.21.15.63:3300/0 conn(0x7f49cc06a490 0x7f49cc0653f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f49bc002f70 tx=0x7f49bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49ca59c700 1 --2- 172.21.15.63:0/1332607268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49cc06a490 0x7f49cc0653f0 secure :-1 s=READY pgs=2153 cs=0 l=1 rx=0x7f49bc002f70 tx=0x7f49bc007a80).ready entity=mon.0 client_cookie=d5d695c51eae85c7 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:27.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49ca59c700 1 --2- 172.21.15.63:0/1332607268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49cc06a490 0x7f49cc0653f0 secure :-1 s=THROTTLE_DONE pgs=2153 cs=0 l=1 rx=0x7f49bc002f70 tx=0x7f49bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49c9d9b700 1 -- 172.21.15.63:0/1332607268 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49bc008e50 con 0x7f49cc06a490 2020-05-18T21:38:27.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49ca59c700 1 --2- 172.21.15.63:0/1332607268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49cc06a490 0x7f49cc0653f0 secure :-1 s=THROTTLE_DONE pgs=2153 cs=0 l=1 rx=0x7f49bc002f70 tx=0x7f49bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49c9d9b700 1 -- 172.21.15.63:0/1332607268 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49bc011540 con 0x7f49cc06a490 2020-05-18T21:38:27.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49ca59c700 1 --2- 172.21.15.63:0/1332607268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49cc06a490 0x7f49cc0653f0 secure :-1 s=THROTTLE_DONE pgs=2153 cs=0 l=1 rx=0x7f49bc002f70 tx=0x7f49bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49c9d9b700 1 -- 172.21.15.63:0/1332607268 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49bc011960 con 0x7f49cc06a490 2020-05-18T21:38:27.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49d094c700 1 -- 172.21.15.63:0/1332607268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49cc06a490 msgr2=0x7f49cc0653f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49d094c700 1 --2- 172.21.15.63:0/1332607268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49cc06a490 0x7f49cc0653f0 secure :-1 s=READY pgs=2153 cs=0 l=1 rx=0x7f49bc002f70 tx=0x7f49bc007a80).stop 2020-05-18T21:38:27.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49d094c700 1 -- 172.21.15.63:0/1332607268 shutdown_connections 2020-05-18T21:38:27.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49d094c700 1 --2- 172.21.15.63:0/1332607268 >> v2:172.21.15.155:3300/0 conn(0x7f49cc060e10 0x7f49cc061210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:27.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49d094c700 1 --2- 172.21.15.63:0/1332607268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49cc06a490 0x7f49cc0653f0 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:27.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49d094c700 1 -- 172.21.15.63:0/1332607268 >> 172.21.15.63:0/1332607268 conn(0x7f49cc05fbd0 msgr2=0x7f49cc069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:27.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49d094c700 1 -- 172.21.15.63:0/1332607268 shutdown_connections 2020-05-18T21:38:27.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.792+0000 7f49d094c700 1 -- 172.21.15.63:0/1332607268 wait complete. 2020-05-18T21:38:27.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49d094c700 1 Processor -- start 2020-05-18T21:38:27.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49d094c700 1 -- start start 2020-05-18T21:38:27.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49d094c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f49cc060e10 0x7f49cc12ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:27.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49d094c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49cc129bd0 con 0x7f49cc0b4f60 2020-05-18T21:38:27.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49d094c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49cc129e70 con 0x7f49cc06a490 2020-05-18T21:38:27.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49d094c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49cc12a5b0 con 0x7f49cc060e10 2020-05-18T21:38:27.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49cad9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f49cc060e10 0x7f49cc12ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:27.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49cad9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f49cc060e10 0x7f49cc12ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36794/0 (socket says 172.21.15.63:36794) 2020-05-18T21:38:27.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49cad9d700 1 -- 172.21.15.63:0/3006618509 learned_addr learned my addr 172.21.15.63:0/3006618509 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:27.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49cad9d700 1 -- 172.21.15.63:0/3006618509 >> v1:172.21.15.155:6789/0 conn(0x7f49cc06a490 legacy=0x7f49cc151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49cad9d700 1 -- 172.21.15.63:0/3006618509 >> v1:172.21.15.63:6789/0 conn(0x7f49cc0b4f60 legacy=0x7f49cc0ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49cad9d700 1 -- 172.21.15.63:0/3006618509 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc12a110 con 0x7f49cc060e10 2020-05-18T21:38:27.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49c3fff700 1 -- 172.21.15.63:0/3006618509 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1698486829 0 0) 0x7f49cc129bd0 con 0x7f49cc0b4f60 2020-05-18T21:38:27.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49cad9d700 1 --2- 172.21.15.63:0/3006618509 >> v2:172.21.15.63:3300/0 conn(0x7f49cc060e10 0x7f49cc12ce80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49b4001110 tx=0x7f49b4010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49cad9d700 1 --2- 172.21.15.63:0/3006618509 >> v2:172.21.15.63:3300/0 conn(0x7f49cc060e10 0x7f49cc12ce80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49b4001110 tx=0x7f49b4010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49cad9d700 1 --2- 172.21.15.63:0/3006618509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49cc060e10 0x7f49cc12ce80 secure :-1 s=READY pgs=2155 cs=0 l=1 rx=0x7f49b4001110 tx=0x7f49b4010a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:27.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49cad9d700 1 --2- 172.21.15.63:0/3006618509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49cc060e10 0x7f49cc12ce80 secure :-1 s=THROTTLE_DONE pgs=2155 cs=0 l=1 rx=0x7f49b4001110 tx=0x7f49b4010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49c3fff700 1 -- 172.21.15.63:0/3006618509 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b4005d00 con 0x7f49cc060e10 2020-05-18T21:38:27.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49cad9d700 1 --2- 172.21.15.63:0/3006618509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49cc060e10 0x7f49cc12ce80 secure :-1 s=THROTTLE_DONE pgs=2155 cs=0 l=1 rx=0x7f49b4001110 tx=0x7f49b4010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49cad9d700 1 --2- 172.21.15.63:0/3006618509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49cc060e10 0x7f49cc12ce80 secure :-1 s=THROTTLE_DONE pgs=2155 cs=0 l=1 rx=0x7f49b4001110 tx=0x7f49b4010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49c3fff700 1 -- 172.21.15.63:0/3006618509 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b4005e60 con 0x7f49cc060e10 2020-05-18T21:38:27.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49c3fff700 1 -- 172.21.15.63:0/3006618509 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b4012310 con 0x7f49cc060e10 2020-05-18T21:38:27.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49d094c700 1 -- 172.21.15.63:0/3006618509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49cc1296b0 con 0x7f49cc060e10 2020-05-18T21:38:27.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49d094c700 1 -- 172.21.15.63:0/3006618509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49cc151df0 con 0x7f49cc060e10 2020-05-18T21:38:27.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.796+0000 7f49cad9d700 1 --2- 172.21.15.63:0/3006618509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49cc060e10 0x7f49cc12ce80 secure :-1 s=THROTTLE_DONE pgs=2155 cs=0 l=1 rx=0x7f49b4001110 tx=0x7f49b4010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.800+0000 7f49c3fff700 1 -- 172.21.15.63:0/3006618509 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f49b4012540 con 0x7f49cc060e10 2020-05-18T21:38:27.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.800+0000 7f49cad9d700 1 --2- 172.21.15.63:0/3006618509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49cc060e10 0x7f49cc12ce80 secure :-1 s=THROTTLE_DONE pgs=2155 cs=0 l=1 rx=0x7f49b4001110 tx=0x7f49b4010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.800+0000 7f49c3fff700 1 --2- 172.21.15.63:0/3006618509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f49b004f810 0x7f49b0051cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:27.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.800+0000 7f49d094c700 1 -- 172.21.15.63:0/3006618509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49cc1299c0 con 0x7f49cc060e10 2020-05-18T21:38:27.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.800+0000 7f49c3fff700 1 -- 172.21.15.63:0/3006618509 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f49b40090c0 con 0x7f49cc060e10 2020-05-18T21:38:27.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.800+0000 7f49ca59c700 1 --2- 172.21.15.63:0/3006618509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f49b004f810 0x7f49b0051cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:27.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.800+0000 7f49ca59c700 1 --2- 172.21.15.63:0/3006618509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f49b004f810 0x7f49b0051cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49cc0b7fc0 tx=0x7f49bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.800+0000 7f49ca59c700 1 --2- 172.21.15.63:0/3006618509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f49b004f810 0x7f49b0051cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49cc0b7fc0 tx=0x7f49bc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.800+0000 7f49ca59c700 1 --2- 172.21.15.63:0/3006618509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f49b004f810 0x7f49b0051cd0 secure :-1 s=READY pgs=845 cs=0 l=1 rx=0x7f49cc0b7fc0 tx=0x7f49bc007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:27.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.804+0000 7f49cad9d700 1 --2- 172.21.15.63:0/3006618509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49cc060e10 0x7f49cc12ce80 secure :-1 s=THROTTLE_DONE pgs=2155 cs=0 l=1 rx=0x7f49b4001110 tx=0x7f49b4010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.816 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.804+0000 7f49c3fff700 1 -- 172.21.15.63:0/3006618509 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f49b4041e30 con 0x7f49cc060e10 2020-05-18T21:38:27.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.912+0000 7f49d094c700 1 -- 172.21.15.63:0/3006618509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f49cc0569e0 con 0x7f49cc060e10 2020-05-18T21:38:27.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.916+0000 7f49cad9d700 1 --2- 172.21.15.63:0/3006618509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49cc060e10 0x7f49cc12ce80 secure :-1 s=THROTTLE_DONE pgs=2155 cs=0 l=1 rx=0x7f49b4001110 tx=0x7f49b4010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:27.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.916+0000 7f49c3fff700 1 -- 172.21.15.63:0/3006618509 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v163) v1 ==== 110+0+10 (secure 0 0 0) 0x7f49b403e3a0 con 0x7f49cc060e10 2020-05-18T21:38:27.922 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:38:27.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.916+0000 7f49d094c700 1 -- 172.21.15.63:0/3006618509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f49b004f810 msgr2=0x7f49b0051cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.916+0000 7f49d094c700 1 --2- 172.21.15.63:0/3006618509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f49b004f810 0x7f49b0051cd0 secure :-1 s=READY pgs=845 cs=0 l=1 rx=0x7f49cc0b7fc0 tx=0x7f49bc007a80).stop 2020-05-18T21:38:27.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.916+0000 7f49d094c700 1 -- 172.21.15.63:0/3006618509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49cc060e10 msgr2=0x7f49cc12ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:27.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.916+0000 7f49d094c700 1 --2- 172.21.15.63:0/3006618509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49cc060e10 0x7f49cc12ce80 secure :-1 s=READY pgs=2155 cs=0 l=1 rx=0x7f49b4001110 tx=0x7f49b4010a80).stop 2020-05-18T21:38:27.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.916+0000 7f49d094c700 1 -- 172.21.15.63:0/3006618509 shutdown_connections 2020-05-18T21:38:27.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.916+0000 7f49d094c700 1 --2- 172.21.15.63:0/3006618509 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f49b004f810 0x7f49b0051cd0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:27.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.916+0000 7f49d094c700 1 --2- 172.21.15.63:0/3006618509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49cc060e10 0x7f49cc12ce80 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:27.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.916+0000 7f49d094c700 1 -- 172.21.15.63:0/3006618509 >> 172.21.15.63:0/3006618509 conn(0x7f49cc05fbd0 msgr2=0x7f49cc05c260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:27.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.916+0000 7f49d094c700 1 -- 172.21.15.63:0/3006618509 shutdown_connections 2020-05-18T21:38:27.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:27.916+0000 7f49d094c700 1 -- 172.21.15.63:0/3006618509 wait complete. 2020-05-18T21:38:27.935 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:38:28.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.036+0000 7ff77c4fa700 1 Processor -- start 2020-05-18T21:38:28.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.036+0000 7ff77c4fa700 1 -- start start 2020-05-18T21:38:28.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.036+0000 7ff77c4fa700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7740b6d90 0x7ff77412ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:28.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.036+0000 7ff77c4fa700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff774060660 con 0x7ff7740b8630 2020-05-18T21:38:28.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.036+0000 7ff77c4fa700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff774060890 con 0x7ff7740b9500 2020-05-18T21:38:28.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.036+0000 7ff77c4fa700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff774060b30 con 0x7ff7740b6d90 2020-05-18T21:38:28.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.036+0000 7ff779a95700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff7740b8630 0x7ff7740b42b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38992/0 (socket says 172.21.15.63:38992) 2020-05-18T21:38:28.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.036+0000 7ff779a95700 1 -- 172.21.15.63:0/391687268 learned_addr learned my addr 172.21.15.63:0/391687268 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:28.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.036+0000 7ff77aa97700 1 --2- 172.21.15.63:0/391687268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7740b6d90 0x7ff77412ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:28.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff779294700 1 -- 172.21.15.63:0/391687268 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204559653 0 0) 0x7ff774060660 con 0x7ff7740b8630 2020-05-18T21:38:28.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff779294700 1 -- 172.21.15.63:0/391687268 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff75c003270 con 0x7ff7740b8630 2020-05-18T21:38:28.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff779294700 1 -- 172.21.15.63:0/391687268 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818477790 0 0) 0x7ff774060890 con 0x7ff7740b9500 2020-05-18T21:38:28.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff779294700 1 -- 172.21.15.63:0/391687268 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff774060660 con 0x7ff7740b9500 2020-05-18T21:38:28.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff77aa97700 1 -- 172.21.15.63:0/391687268 >> v1:172.21.15.155:6789/0 conn(0x7ff7740b9500 legacy=0x7ff774061270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff77aa97700 1 -- 172.21.15.63:0/391687268 >> v1:172.21.15.63:6789/0 conn(0x7ff7740b8630 legacy=0x7ff7740b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff779294700 1 -- 172.21.15.63:0/391687268 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 245155570 0 0) 0x7ff75c003270 con 0x7ff7740b8630 2020-05-18T21:38:28.049 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff77aa97700 1 -- 172.21.15.63:0/391687268 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff774060dd0 con 0x7ff7740b6d90 2020-05-18T21:38:28.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff77aa97700 1 --2- 172.21.15.63:0/391687268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7740b6d90 0x7ff77412ed60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff770001110 tx=0x7ff76c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff77aa97700 1 --2- 172.21.15.63:0/391687268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7740b6d90 0x7ff77412ed60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff770001110 tx=0x7ff76c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff77aa97700 1 --2- 172.21.15.63:0/391687268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7740b6d90 0x7ff77412ed60 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7ff770001110 tx=0x7ff76c008ca0).ready entity=mon.2 client_cookie=4dd337251447361f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:28.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff77aa97700 1 --2- 172.21.15.63:0/391687268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7740b6d90 0x7ff77412ed60 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7ff770001110 tx=0x7ff76c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff779294700 1 -- 172.21.15.63:0/391687268 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff770001710 con 0x7ff7740b6d90 2020-05-18T21:38:28.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff77aa97700 1 --2- 172.21.15.63:0/391687268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7740b6d90 0x7ff77412ed60 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7ff770001110 tx=0x7ff76c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff779294700 1 -- 172.21.15.63:0/391687268 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76c011ac0 con 0x7ff7740b6d90 2020-05-18T21:38:28.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff77aa97700 1 --2- 172.21.15.63:0/391687268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7740b6d90 0x7ff77412ed60 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7ff770001110 tx=0x7ff76c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff779294700 1 -- 172.21.15.63:0/391687268 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff76c011e60 con 0x7ff7740b6d90 2020-05-18T21:38:28.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff77c4fa700 1 -- 172.21.15.63:0/391687268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7740b6d90 msgr2=0x7ff77412ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff77c4fa700 1 --2- 172.21.15.63:0/391687268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7740b6d90 0x7ff77412ed60 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7ff770001110 tx=0x7ff76c008ca0).stop 2020-05-18T21:38:28.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff77c4fa700 1 -- 172.21.15.63:0/391687268 shutdown_connections 2020-05-18T21:38:28.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff77c4fa700 1 --2- 172.21.15.63:0/391687268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7740b6d90 0x7ff77412ed60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:28.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff77c4fa700 1 -- 172.21.15.63:0/391687268 >> 172.21.15.63:0/391687268 conn(0x7ff774069b70 msgr2=0x7ff774069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:28.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff77c4fa700 1 -- 172.21.15.63:0/391687268 shutdown_connections 2020-05-18T21:38:28.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.040+0000 7ff77c4fa700 1 -- 172.21.15.63:0/391687268 wait complete. 2020-05-18T21:38:28.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.044+0000 7ff77c4fa700 1 Processor -- start 2020-05-18T21:38:28.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.044+0000 7ff77c4fa700 1 -- start start 2020-05-18T21:38:28.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.044+0000 7ff77c4fa700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff7740b6d90 0x7ff7740b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:28.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.044+0000 7ff77c4fa700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7740b8630 0x7ff7740b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:28.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.044+0000 7ff77c4fa700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7740b26c0 con 0x7ff7740b9500 2020-05-18T21:38:28.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.044+0000 7ff77c4fa700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77412ffa0 con 0x7ff7740b6d90 2020-05-18T21:38:28.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.044+0000 7ff77c4fa700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7741569a0 con 0x7ff7740b8630 2020-05-18T21:38:28.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.044+0000 7ff77a296700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff7740b6d90 0x7ff7740b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:28.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.044+0000 7ff77a296700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff7740b6d90 0x7ff7740b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36808/0 (socket says 172.21.15.63:36808) 2020-05-18T21:38:28.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.044+0000 7ff77a296700 1 -- 172.21.15.63:0/2201543951 learned_addr learned my addr 172.21.15.63:0/2201543951 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:28.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.044+0000 7ff779a95700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7740b8630 0x7ff7740b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:28.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.044+0000 7ff7677fe700 1 -- 172.21.15.63:0/2201543951 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932554368 0 0) 0x7ff7740b26c0 con 0x7ff7740b9500 2020-05-18T21:38:28.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.044+0000 7ff7677fe700 1 -- 172.21.15.63:0/2201543951 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff754002fe0 con 0x7ff7740b9500 2020-05-18T21:38:28.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.044+0000 7ff77a296700 1 -- 172.21.15.63:0/2201543951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7740b8630 msgr2=0x7ff7740b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.044+0000 7ff77a296700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7740b8630 0x7ff7740b2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:28.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.044+0000 7ff77a296700 1 -- 172.21.15.63:0/2201543951 >> v1:172.21.15.155:6789/0 conn(0x7ff7740b9500 legacy=0x7ff77412cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff77a296700 1 -- 172.21.15.63:0/2201543951 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77412d4b0 con 0x7ff7740b6d90 2020-05-18T21:38:28.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff779a95700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7740b8630 0x7ff7740b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:38:28.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff77a296700 1 --2- 172.21.15.63:0/2201543951 >> v2:172.21.15.63:3300/0 conn(0x7ff7740b6d90 0x7ff7740b2140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7680011d0 tx=0x7ff7680024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff77a296700 1 --2- 172.21.15.63:0/2201543951 >> v2:172.21.15.63:3300/0 conn(0x7ff7740b6d90 0x7ff7740b2140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7680011d0 tx=0x7ff7680024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff77a296700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7740b6d90 0x7ff7740b2140 secure :-1 s=READY pgs=2157 cs=0 l=1 rx=0x7ff7680011d0 tx=0x7ff7680024d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:28.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff77a296700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7740b6d90 0x7ff7740b2140 secure :-1 s=THROTTLE_DONE pgs=2157 cs=0 l=1 rx=0x7ff7680011d0 tx=0x7ff7680024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff7677fe700 1 -- 172.21.15.63:0/2201543951 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff76800cc60 con 0x7ff7740b6d90 2020-05-18T21:38:28.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff77a296700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7740b6d90 0x7ff7740b2140 secure :-1 s=THROTTLE_DONE pgs=2157 cs=0 l=1 rx=0x7ff7680011d0 tx=0x7ff7680024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff77a296700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7740b6d90 0x7ff7740b2140 secure :-1 s=THROTTLE_DONE pgs=2157 cs=0 l=1 rx=0x7ff7680011d0 tx=0x7ff7680024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff7677fe700 1 -- 172.21.15.63:0/2201543951 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76800ce00 con 0x7ff7740b6d90 2020-05-18T21:38:28.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff77c4fa700 1 -- 172.21.15.63:0/2201543951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7740af820 con 0x7ff7740b6d90 2020-05-18T21:38:28.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff7677fe700 1 -- 172.21.15.63:0/2201543951 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff76800e370 con 0x7ff7740b6d90 2020-05-18T21:38:28.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff77c4fa700 1 -- 172.21.15.63:0/2201543951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7740afcd0 con 0x7ff7740b6d90 2020-05-18T21:38:28.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff77a296700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7740b6d90 0x7ff7740b2140 secure :-1 s=THROTTLE_DONE pgs=2157 cs=0 l=1 rx=0x7ff7680011d0 tx=0x7ff7680024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.061 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff77c4fa700 1 -- 172.21.15.63:0/2201543951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7740569e0 con 0x7ff7740b6d90 2020-05-18T21:38:28.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff7677fe700 1 -- 172.21.15.63:0/2201543951 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff76800e5a0 con 0x7ff7740b6d90 2020-05-18T21:38:28.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff77a296700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7740b6d90 0x7ff7740b2140 secure :-1 s=THROTTLE_DONE pgs=2157 cs=0 l=1 rx=0x7ff7680011d0 tx=0x7ff7680024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff7677fe700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff75404fd40 0x7ff754052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:28.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff7677fe700 1 -- 172.21.15.63:0/2201543951 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff768063990 con 0x7ff7740b6d90 2020-05-18T21:38:28.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff779a95700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff75404fd40 0x7ff754052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:28.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff779a95700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff75404fd40 0x7ff754052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff770000fe0 tx=0x7ff77000d030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff779a95700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff75404fd40 0x7ff754052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff770000fe0 tx=0x7ff77000d030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.048+0000 7ff779a95700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff75404fd40 0x7ff754052200 secure :-1 s=READY pgs=846 cs=0 l=1 rx=0x7ff770000fe0 tx=0x7ff77000d030).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:28.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.056+0000 7ff77a296700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7740b6d90 0x7ff7740b2140 secure :-1 s=THROTTLE_DONE pgs=2157 cs=0 l=1 rx=0x7ff7680011d0 tx=0x7ff7680024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.056+0000 7ff7677fe700 1 -- 172.21.15.63:0/2201543951 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff76803dcc0 con 0x7ff7740b6d90 2020-05-18T21:38:28.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.176+0000 7ff77c4fa700 1 -- 172.21.15.63:0/2201543951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff774156b10 con 0x7ff7740b6d90 2020-05-18T21:38:28.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.176+0000 7ff77a296700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7740b6d90 0x7ff7740b2140 secure :-1 s=THROTTLE_DONE pgs=2157 cs=0 l=1 rx=0x7ff7680011d0 tx=0x7ff7680024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.176+0000 7ff7677fe700 1 -- 172.21.15.63:0/2201543951 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v163) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff7680412e0 con 0x7ff7740b6d90 2020-05-18T21:38:28.185 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:38:28.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.180+0000 7ff77c4fa700 1 -- 172.21.15.63:0/2201543951 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff75404fd40 msgr2=0x7ff754052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.180+0000 7ff77c4fa700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff75404fd40 0x7ff754052200 secure :-1 s=READY pgs=846 cs=0 l=1 rx=0x7ff770000fe0 tx=0x7ff77000d030).stop 2020-05-18T21:38:28.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.180+0000 7ff77c4fa700 1 -- 172.21.15.63:0/2201543951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7740b6d90 msgr2=0x7ff7740b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.180+0000 7ff77c4fa700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7740b6d90 0x7ff7740b2140 secure :-1 s=READY pgs=2157 cs=0 l=1 rx=0x7ff7680011d0 tx=0x7ff7680024d0).stop 2020-05-18T21:38:28.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.180+0000 7ff77c4fa700 1 -- 172.21.15.63:0/2201543951 shutdown_connections 2020-05-18T21:38:28.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.180+0000 7ff77c4fa700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff75404fd40 0x7ff754052200 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:28.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.180+0000 7ff77c4fa700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7740b8630 0x7ff7740b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:28.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.180+0000 7ff77c4fa700 1 --2- 172.21.15.63:0/2201543951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7740b6d90 0x7ff7740b2140 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:28.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.180+0000 7ff77c4fa700 1 -- 172.21.15.63:0/2201543951 >> 172.21.15.63:0/2201543951 conn(0x7ff774069b70 msgr2=0x7ff7740b7270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:28.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.180+0000 7ff77c4fa700 1 -- 172.21.15.63:0/2201543951 shutdown_connections 2020-05-18T21:38:28.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.180+0000 7ff77c4fa700 1 -- 172.21.15.63:0/2201543951 wait complete. 2020-05-18T21:38:28.202 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-05-18T21:38:28.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.300+0000 7f24e99b9700 1 Processor -- start 2020-05-18T21:38:28.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.300+0000 7f24e99b9700 1 -- start start 2020-05-18T21:38:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.300+0000 7f24e99b9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24e4145250 0x7f24e409c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.300+0000 7f24e99b9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f24e40623c0 0x7f24e4062840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.300+0000 7f24e99b9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e4061b00 con 0x7f24e409cb50 2020-05-18T21:38:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.300+0000 7f24e99b9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e40634b0 con 0x7f24e40623c0 2020-05-18T21:38:28.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.300+0000 7f24e99b9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e40663d0 con 0x7f24e4145250 2020-05-18T21:38:28.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.300+0000 7f24e91b8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f24e40623c0 0x7f24e4062840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.300+0000 7f24e3fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f24e409cb50 0x7f24e40b5510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:37322/0 (socket says 172.21.15.63:37322) 2020-05-18T21:38:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.300+0000 7f24e89b7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24e4145250 0x7f24e409c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.300+0000 7f24e3fff700 1 -- 172.21.15.63:0/3342038497 learned_addr learned my addr 172.21.15.63:0/3342038497 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e37fe700 1 -- 172.21.15.63:0/3342038497 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664101889 0 0) 0x7f24e4061b00 con 0x7f24e409cb50 2020-05-18T21:38:28.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e37fe700 1 -- 172.21.15.63:0/3342038497 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24d0003270 con 0x7f24e409cb50 2020-05-18T21:38:28.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e89b7700 1 -- 172.21.15.63:0/3342038497 >> v2:172.21.15.155:3300/0 conn(0x7f24e40623c0 msgr2=0x7f24e4062840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:28.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e89b7700 1 --2- 172.21.15.63:0/3342038497 >> v2:172.21.15.155:3300/0 conn(0x7f24e40623c0 0x7f24e4062840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:28.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e89b7700 1 -- 172.21.15.63:0/3342038497 >> v1:172.21.15.155:6789/0 conn(0x7f24e409cb50 legacy=0x7f24e40b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e89b7700 1 -- 172.21.15.63:0/3342038497 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e409d320 con 0x7f24e4145250 2020-05-18T21:38:28.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e91b8700 1 --2- 172.21.15.63:0/3342038497 >> v2:172.21.15.155:3300/0 conn(0x7f24e40623c0 0x7f24e4062840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:38:28.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e89b7700 1 --2- 172.21.15.63:0/3342038497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24e4145250 0x7f24e409c610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f24d4002f70 tx=0x7f24d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e89b7700 1 --2- 172.21.15.63:0/3342038497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24e4145250 0x7f24e409c610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f24d4002f70 tx=0x7f24d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e89b7700 1 --2- 172.21.15.63:0/3342038497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24e4145250 0x7f24e409c610 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7f24d4002f70 tx=0x7f24d4007a80).ready entity=mon.2 client_cookie=f80813a6d467f3d4 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:28.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e89b7700 1 --2- 172.21.15.63:0/3342038497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24e4145250 0x7f24e409c610 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f24d4002f70 tx=0x7f24d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e37fe700 1 -- 172.21.15.63:0/3342038497 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24d4008e80 con 0x7f24e4145250 2020-05-18T21:38:28.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e89b7700 1 --2- 172.21.15.63:0/3342038497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24e4145250 0x7f24e409c610 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f24d4002f70 tx=0x7f24d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e37fe700 1 -- 172.21.15.63:0/3342038497 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d4011540 con 0x7f24e4145250 2020-05-18T21:38:28.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e89b7700 1 --2- 172.21.15.63:0/3342038497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24e4145250 0x7f24e409c610 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f24d4002f70 tx=0x7f24d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e37fe700 1 -- 172.21.15.63:0/3342038497 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24d4011920 con 0x7f24e4145250 2020-05-18T21:38:28.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e99b9700 1 -- 172.21.15.63:0/3342038497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24e4145250 msgr2=0x7f24e409c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e99b9700 1 --2- 172.21.15.63:0/3342038497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24e4145250 0x7f24e409c610 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7f24d4002f70 tx=0x7f24d4007a80).stop 2020-05-18T21:38:28.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e99b9700 1 -- 172.21.15.63:0/3342038497 shutdown_connections 2020-05-18T21:38:28.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e99b9700 1 --2- 172.21.15.63:0/3342038497 >> v2:172.21.15.155:3300/0 conn(0x7f24e40623c0 0x7f24e4062840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e99b9700 1 --2- 172.21.15.63:0/3342038497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24e4145250 0x7f24e409c610 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e99b9700 1 -- 172.21.15.63:0/3342038497 >> 172.21.15.63:0/3342038497 conn(0x7f24e405a7c0 msgr2=0x7f24e405aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e99b9700 1 -- 172.21.15.63:0/3342038497 shutdown_connections 2020-05-18T21:38:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e99b9700 1 -- 172.21.15.63:0/3342038497 wait complete. 2020-05-18T21:38:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e99b9700 1 Processor -- start 2020-05-18T21:38:28.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.304+0000 7f24e99b9700 1 -- start start 2020-05-18T21:38:28.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e99b9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f24e40623c0 0x7f24e409ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:28.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e99b9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f24e409cb50 0x7f24e40aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:28.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e99b9700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e409b0d0 con 0x7f24e4145250 2020-05-18T21:38:28.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e99b9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e40af630 con 0x7f24e409cb50 2020-05-18T21:38:28.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e99b9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e40af8d0 con 0x7f24e40623c0 2020-05-18T21:38:28.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f24e409cb50 0x7f24e40aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:28.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e91b8700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f24e4145250 0x7f24e40b2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39014/0 (socket says 172.21.15.63:39014) 2020-05-18T21:38:28.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e91b8700 1 -- 172.21.15.63:0/2725257704 learned_addr learned my addr 172.21.15.63:0/2725257704 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:28.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e89b7700 1 --2- 172.21.15.63:0/2725257704 >> v2:172.21.15.155:3300/0 conn(0x7f24e40623c0 0x7f24e409ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:28.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e3fff700 1 -- 172.21.15.63:0/2725257704 >> v2:172.21.15.155:3300/0 conn(0x7f24e40623c0 msgr2=0x7f24e409ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e3fff700 1 --2- 172.21.15.63:0/2725257704 >> v2:172.21.15.155:3300/0 conn(0x7f24e40623c0 0x7f24e409ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:28.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e1ffb700 1 -- 172.21.15.63:0/2725257704 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206112688 0 0) 0x7f24e409b0d0 con 0x7f24e4145250 2020-05-18T21:38:28.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e3fff700 1 -- 172.21.15.63:0/2725257704 >> v1:172.21.15.63:6789/0 conn(0x7f24e4145250 legacy=0x7f24e40b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e3fff700 1 -- 172.21.15.63:0/2725257704 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e40afb70 con 0x7f24e409cb50 2020-05-18T21:38:28.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e3fff700 1 --2- 172.21.15.63:0/2725257704 >> v2:172.21.15.63:3300/0 conn(0x7f24e409cb50 0x7f24e40aecb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f24d8001110 tx=0x7f24d8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e3fff700 1 --2- 172.21.15.63:0/2725257704 >> v2:172.21.15.63:3300/0 conn(0x7f24e409cb50 0x7f24e40aecb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f24d8001110 tx=0x7f24d8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e3fff700 1 --2- 172.21.15.63:0/2725257704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24e409cb50 0x7f24e40aecb0 secure :-1 s=READY pgs=2159 cs=0 l=1 rx=0x7f24d8001110 tx=0x7f24d8010910).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:28.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e3fff700 1 --2- 172.21.15.63:0/2725257704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24e409cb50 0x7f24e40aecb0 secure :-1 s=THROTTLE_DONE pgs=2159 cs=0 l=1 rx=0x7f24d8001110 tx=0x7f24d8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e1ffb700 1 -- 172.21.15.63:0/2725257704 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24d8006e10 con 0x7f24e409cb50 2020-05-18T21:38:28.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e3fff700 1 --2- 172.21.15.63:0/2725257704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24e409cb50 0x7f24e40aecb0 secure :-1 s=THROTTLE_DONE pgs=2159 cs=0 l=1 rx=0x7f24d8001110 tx=0x7f24d8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e1ffb700 1 -- 172.21.15.63:0/2725257704 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d8004530 con 0x7f24e409cb50 2020-05-18T21:38:28.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e99b9700 1 -- 172.21.15.63:0/2725257704 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e40b4f30 con 0x7f24e409cb50 2020-05-18T21:38:28.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e3fff700 1 --2- 172.21.15.63:0/2725257704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24e409cb50 0x7f24e40aecb0 secure :-1 s=THROTTLE_DONE pgs=2159 cs=0 l=1 rx=0x7f24d8001110 tx=0x7f24d8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e1ffb700 1 -- 172.21.15.63:0/2725257704 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24d8004910 con 0x7f24e409cb50 2020-05-18T21:38:28.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e99b9700 1 -- 172.21.15.63:0/2725257704 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e40b2eb0 con 0x7f24e409cb50 2020-05-18T21:38:28.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.308+0000 7f24e3fff700 1 --2- 172.21.15.63:0/2725257704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24e409cb50 0x7f24e40aecb0 secure :-1 s=THROTTLE_DONE pgs=2159 cs=0 l=1 rx=0x7f24d8001110 tx=0x7f24d8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.312+0000 7f24e99b9700 1 -- 172.21.15.63:0/2725257704 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e40b02a0 con 0x7f24e409cb50 2020-05-18T21:38:28.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.312+0000 7f24e1ffb700 1 -- 172.21.15.63:0/2725257704 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f24d8004b90 con 0x7f24e409cb50 2020-05-18T21:38:28.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.312+0000 7f24e3fff700 1 --2- 172.21.15.63:0/2725257704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24e409cb50 0x7f24e40aecb0 secure :-1 s=THROTTLE_DONE pgs=2159 cs=0 l=1 rx=0x7f24d8001110 tx=0x7f24d8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.312+0000 7f24e1ffb700 1 --2- 172.21.15.63:0/2725257704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f24c404f850 0x7f24c4051d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:28.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.312+0000 7f24e1ffb700 1 -- 172.21.15.63:0/2725257704 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f24d80639d0 con 0x7f24e409cb50 2020-05-18T21:38:28.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.312+0000 7f24e89b7700 1 --2- 172.21.15.63:0/2725257704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f24c404f850 0x7f24c4051d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:28.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.312+0000 7f24e89b7700 1 --2- 172.21.15.63:0/2725257704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f24c404f850 0x7f24c4051d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f24d4002f70 tx=0x7f24d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.312+0000 7f24e89b7700 1 --2- 172.21.15.63:0/2725257704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f24c404f850 0x7f24c4051d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f24d4002f70 tx=0x7f24d4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.312+0000 7f24e89b7700 1 --2- 172.21.15.63:0/2725257704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f24c404f850 0x7f24c4051d10 secure :-1 s=READY pgs=847 cs=0 l=1 rx=0x7f24d4002f70 tx=0x7f24d4007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:28.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.320+0000 7f24e3fff700 1 --2- 172.21.15.63:0/2725257704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24e409cb50 0x7f24e40aecb0 secure :-1 s=THROTTLE_DONE pgs=2159 cs=0 l=1 rx=0x7f24d8001110 tx=0x7f24d8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.320+0000 7f24e1ffb700 1 -- 172.21.15.63:0/2725257704 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f24d803dd60 con 0x7f24e409cb50 2020-05-18T21:38:28.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.440+0000 7f24e99b9700 1 -- 172.21.15.63:0/2725257704 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f24e40569e0 con 0x7f24e409cb50 2020-05-18T21:38:28.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.440+0000 7f24e3fff700 1 --2- 172.21.15.63:0/2725257704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24e409cb50 0x7f24e40aecb0 secure :-1 s=THROTTLE_DONE pgs=2159 cs=0 l=1 rx=0x7f24d8001110 tx=0x7f24d8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.440+0000 7f24e1ffb700 1 -- 172.21.15.63:0/2725257704 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v163) v1 ==== 84+0+143 (secure 0 0 0) 0x7f24d8041380 con 0x7f24e409cb50 2020-05-18T21:38:28.447 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:28.447 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2020-05-18T21:38:28.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:28.448 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2020-05-18T21:38:28.448 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "device_health_metrics" 2020-05-18T21:38:28.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:28.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:38:28.449 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 2, 2020-05-18T21:38:28.449 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "rbd" 2020-05-18T21:38:28.449 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:28.449 INFO:teuthology.orchestra.run.smithi063.stdout:] 2020-05-18T21:38:28.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.440+0000 7f24e99b9700 1 -- 172.21.15.63:0/2725257704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f24c404f850 msgr2=0x7f24c4051d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.440+0000 7f24e99b9700 1 --2- 172.21.15.63:0/2725257704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f24c404f850 0x7f24c4051d10 secure :-1 s=READY pgs=847 cs=0 l=1 rx=0x7f24d4002f70 tx=0x7f24d4007a80).stop 2020-05-18T21:38:28.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.440+0000 7f24e99b9700 1 -- 172.21.15.63:0/2725257704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24e409cb50 msgr2=0x7f24e40aecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.440+0000 7f24e99b9700 1 --2- 172.21.15.63:0/2725257704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24e409cb50 0x7f24e40aecb0 secure :-1 s=READY pgs=2159 cs=0 l=1 rx=0x7f24d8001110 tx=0x7f24d8010910).stop 2020-05-18T21:38:28.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.440+0000 7f24e99b9700 1 -- 172.21.15.63:0/2725257704 shutdown_connections 2020-05-18T21:38:28.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.440+0000 7f24e99b9700 1 --2- 172.21.15.63:0/2725257704 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f24c404f850 0x7f24c4051d10 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:28.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.440+0000 7f24e99b9700 1 --2- 172.21.15.63:0/2725257704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24e409cb50 0x7f24e40aecb0 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:28.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.440+0000 7f24e99b9700 1 --2- 172.21.15.63:0/2725257704 >> v2:172.21.15.155:3300/0 conn(0x7f24e40623c0 0x7f24e409ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:28.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.440+0000 7f24e99b9700 1 -- 172.21.15.63:0/2725257704 >> 172.21.15.63:0/2725257704 conn(0x7f24e405a7c0 msgr2=0x7f24e4065810 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:28.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.440+0000 7f24e99b9700 1 -- 172.21.15.63:0/2725257704 shutdown_connections 2020-05-18T21:38:28.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.440+0000 7f24e99b9700 1 -- 172.21.15.63:0/2725257704 wait complete. 2020-05-18T21:38:28.459 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-05-18T21:38:28.459 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-05-18T21:38:28.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.556+0000 7f3efec88700 1 Processor -- start 2020-05-18T21:38:28.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.556+0000 7f3efec88700 1 -- start start 2020-05-18T21:38:28.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.556+0000 7f3efec88700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3ef814e3d0 0x7f3ef81507c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:28.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.556+0000 7f3efec88700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef8146740 con 0x7f3ef80b1550 2020-05-18T21:38:28.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.556+0000 7f3efec88700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef81469e0 con 0x7f3ef80b4460 2020-05-18T21:38:28.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.556+0000 7f3efec88700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef8146530 con 0x7f3ef814e3d0 2020-05-18T21:38:28.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efd485700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3ef80b1550 0x7f3ef80b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39018/0 (socket says 172.21.15.63:39018) 2020-05-18T21:38:28.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efd485700 1 -- 172.21.15.63:0/164835565 learned_addr learned my addr 172.21.15.63:0/164835565 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:28.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efe487700 1 --2- 172.21.15.63:0/164835565 >> v2:172.21.15.155:3300/0 conn(0x7f3ef814e3d0 0x7f3ef81507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:28.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efcc84700 1 -- 172.21.15.63:0/164835565 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154888495 0 0) 0x7f3ef8146740 con 0x7f3ef80b1550 2020-05-18T21:38:28.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efcc84700 1 -- 172.21.15.63:0/164835565 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ee0003270 con 0x7f3ef80b1550 2020-05-18T21:38:28.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efe487700 1 -- 172.21.15.63:0/164835565 >> v1:172.21.15.155:6789/0 conn(0x7f3ef80b4460 legacy=0x7f3ef8145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efcc84700 1 -- 172.21.15.63:0/164835565 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223134956 0 0) 0x7f3ef81469e0 con 0x7f3ef80b4460 2020-05-18T21:38:28.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efe487700 1 -- 172.21.15.63:0/164835565 >> v1:172.21.15.63:6789/0 conn(0x7f3ef80b1550 legacy=0x7f3ef80b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efe487700 1 -- 172.21.15.63:0/164835565 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef80b4840 con 0x7f3ef814e3d0 2020-05-18T21:38:28.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efe487700 1 --2- 172.21.15.63:0/164835565 >> v2:172.21.15.155:3300/0 conn(0x7f3ef814e3d0 0x7f3ef81507c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3ef00032f0 tx=0x7f3ef0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efe487700 1 --2- 172.21.15.63:0/164835565 >> v2:172.21.15.155:3300/0 conn(0x7f3ef814e3d0 0x7f3ef81507c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3ef00032f0 tx=0x7f3ef0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efe487700 1 --2- 172.21.15.63:0/164835565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ef814e3d0 0x7f3ef81507c0 secure :-1 s=READY pgs=1445 cs=0 l=1 rx=0x7f3ef00032f0 tx=0x7f3ef0007e00).ready entity=mon.1 client_cookie=602f28356f366939 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:28.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efe487700 1 --2- 172.21.15.63:0/164835565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ef814e3d0 0x7f3ef81507c0 secure :-1 s=THROTTLE_DONE pgs=1445 cs=0 l=1 rx=0x7f3ef00032f0 tx=0x7f3ef0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efcc84700 1 -- 172.21.15.63:0/164835565 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ef0011e60 con 0x7f3ef814e3d0 2020-05-18T21:38:28.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efe487700 1 --2- 172.21.15.63:0/164835565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ef814e3d0 0x7f3ef81507c0 secure :-1 s=THROTTLE_DONE pgs=1445 cs=0 l=1 rx=0x7f3ef00032f0 tx=0x7f3ef0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efe487700 1 --2- 172.21.15.63:0/164835565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ef814e3d0 0x7f3ef81507c0 secure :-1 s=THROTTLE_DONE pgs=1445 cs=0 l=1 rx=0x7f3ef00032f0 tx=0x7f3ef0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efcc84700 1 -- 172.21.15.63:0/164835565 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef000a180 con 0x7f3ef814e3d0 2020-05-18T21:38:28.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efcc84700 1 -- 172.21.15.63:0/164835565 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ef000a4e0 con 0x7f3ef814e3d0 2020-05-18T21:38:28.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efec88700 1 -- 172.21.15.63:0/164835565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ef814e3d0 msgr2=0x7f3ef81507c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efec88700 1 --2- 172.21.15.63:0/164835565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ef814e3d0 0x7f3ef81507c0 secure :-1 s=READY pgs=1445 cs=0 l=1 rx=0x7f3ef00032f0 tx=0x7f3ef0007e00).stop 2020-05-18T21:38:28.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efec88700 1 -- 172.21.15.63:0/164835565 shutdown_connections 2020-05-18T21:38:28.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efec88700 1 --2- 172.21.15.63:0/164835565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ef814e3d0 0x7f3ef81507c0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:28.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efec88700 1 -- 172.21.15.63:0/164835565 >> 172.21.15.63:0/164835565 conn(0x7f3ef8069b70 msgr2=0x7f3ef8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:28.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efec88700 1 -- 172.21.15.63:0/164835565 shutdown_connections 2020-05-18T21:38:28.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.560+0000 7f3efec88700 1 -- 172.21.15.63:0/164835565 wait complete. 2020-05-18T21:38:28.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efec88700 1 Processor -- start 2020-05-18T21:38:28.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efec88700 1 -- start start 2020-05-18T21:38:28.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efec88700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3ef80b4460 0x7f3ef8145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:28.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efec88700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef8065b30 con 0x7f3ef80b1550 2020-05-18T21:38:28.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efec88700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef8065dd0 con 0x7f3ef814e3d0 2020-05-18T21:38:28.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efec88700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef8066070 con 0x7f3ef80b4460 2020-05-18T21:38:28.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efdc86700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3ef80b1550 0x7f3ef8063090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39026/0 (socket says 172.21.15.63:39026) 2020-05-18T21:38:28.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efdc86700 1 -- 172.21.15.63:0/3628849441 learned_addr learned my addr 172.21.15.63:0/3628849441 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:28.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efd485700 1 --2- 172.21.15.63:0/3628849441 >> v2:172.21.15.155:3300/0 conn(0x7f3ef80b4460 0x7f3ef8145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:28.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3ee6ffd700 1 -- 172.21.15.63:0/3628849441 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718731680 0 0) 0x7f3ef8065b30 con 0x7f3ef80b1550 2020-05-18T21:38:28.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3ee6ffd700 1 -- 172.21.15.63:0/3628849441 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed8002fe0 con 0x7f3ef80b1550 2020-05-18T21:38:28.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3ee6ffd700 1 -- 172.21.15.63:0/3628849441 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 828063696 0 0) 0x7f3ed8002fe0 con 0x7f3ef80b1550 2020-05-18T21:38:28.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3ee6ffd700 1 -- 172.21.15.63:0/3628849441 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3ef8065b30 con 0x7f3ef80b1550 2020-05-18T21:38:28.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3ee6ffd700 1 -- 172.21.15.63:0/3628849441 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f3ee8001960 con 0x7f3ef80b1550 2020-05-18T21:38:28.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3ee6ffd700 1 -- 172.21.15.63:0/3628849441 >> v2:172.21.15.155:3300/0 conn(0x7f3ef80b4460 msgr2=0x7f3ef8145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3ee6ffd700 1 --2- 172.21.15.63:0/3628849441 >> v2:172.21.15.155:3300/0 conn(0x7f3ef80b4460 0x7f3ef8145020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:28.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3ee6ffd700 1 -- 172.21.15.63:0/3628849441 >> v1:172.21.15.155:6789/0 conn(0x7f3ef814e3d0 legacy=0x7f3ef814b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3ee6ffd700 1 -- 172.21.15.63:0/3628849441 >> v1:172.21.15.63:6789/0 conn(0x7f3ef80b1550 legacy=0x7f3ef8063090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3ee6ffd700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ed8004ad0 0x7f3ed8004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:28.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3ee6ffd700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed80039a0 0x7f3ed8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:28.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3ee6ffd700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ed8004280 0x7f3ed800b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:28.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3ee6ffd700 1 -- 172.21.15.63:0/3628849441 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef8066070 con 0x7f3ed80039a0 2020-05-18T21:38:28.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3ee6ffd700 1 -- 172.21.15.63:0/3628849441 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed8004720 con 0x7f3ed8004ad0 2020-05-18T21:38:28.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3ee6ffd700 1 -- 172.21.15.63:0/3628849441 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed800bbc0 con 0x7f3ed8004280 2020-05-18T21:38:28.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efd485700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed80039a0 0x7f3ed8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:28.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efdc86700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ed8004ad0 0x7f3ed8004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:28.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efe487700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ed8004280 0x7f3ed800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:28.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efd485700 1 -- 172.21.15.63:0/3628849441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ed8004280 msgr2=0x7f3ed800b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efd485700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ed8004280 0x7f3ed800b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:28.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efd485700 1 -- 172.21.15.63:0/3628849441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ed8004ad0 msgr2=0x7f3ed8004ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:28.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efd485700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ed8004ad0 0x7f3ed8004ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:28.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efe487700 1 -- 172.21.15.63:0/3628849441 reap_dead start 2020-05-18T21:38:28.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efd485700 1 -- 172.21.15.63:0/3628849441 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef80637a0 con 0x7f3ed80039a0 2020-05-18T21:38:28.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efec88700 1 -- 172.21.15.63:0/3628849441 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef80657b0 con 0x7f3ed80039a0 2020-05-18T21:38:28.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efdc86700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ed8004ad0 0x7f3ed8004ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:38:28.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efec88700 1 -- 172.21.15.63:0/3628849441 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef814c950 con 0x7f3ed80039a0 2020-05-18T21:38:28.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efd485700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed80039a0 0x7f3ed8003e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ef4001110 tx=0x7f3ef4001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efd485700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed80039a0 0x7f3ed8003e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ef4001110 tx=0x7f3ef4001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efd485700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed80039a0 0x7f3ed8003e20 secure :-1 s=READY pgs=2162 cs=0 l=1 rx=0x7f3ef4001110 tx=0x7f3ef4001710).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:28.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efd485700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed80039a0 0x7f3ed8003e20 secure :-1 s=THROTTLE_DONE pgs=2162 cs=0 l=1 rx=0x7f3ef4001110 tx=0x7f3ef4001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3ee6ffd700 1 -- 172.21.15.63:0/3628849441 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ef400c670 con 0x7f3ed80039a0 2020-05-18T21:38:28.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efd485700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed80039a0 0x7f3ed8003e20 secure :-1 s=THROTTLE_DONE pgs=2162 cs=0 l=1 rx=0x7f3ef4001110 tx=0x7f3ef4001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3efd485700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed80039a0 0x7f3ed8003e20 secure :-1 s=THROTTLE_DONE pgs=2162 cs=0 l=1 rx=0x7f3ef4001110 tx=0x7f3ef4001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3ee6ffd700 1 -- 172.21.15.63:0/3628849441 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef400c7d0 con 0x7f3ed80039a0 2020-05-18T21:38:28.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.564+0000 7f3ee6ffd700 1 -- 172.21.15.63:0/3628849441 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ef400cb70 con 0x7f3ed80039a0 2020-05-18T21:38:28.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.568+0000 7f3efd485700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed80039a0 0x7f3ed8003e20 secure :-1 s=THROTTLE_DONE pgs=2162 cs=0 l=1 rx=0x7f3ef4001110 tx=0x7f3ef4001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.568+0000 7f3ee6ffd700 1 -- 172.21.15.63:0/3628849441 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3ef4013070 con 0x7f3ed80039a0 2020-05-18T21:38:28.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.568+0000 7f3efd485700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed80039a0 0x7f3ed8003e20 secure :-1 s=THROTTLE_DONE pgs=2162 cs=0 l=1 rx=0x7f3ef4001110 tx=0x7f3ef4001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.568+0000 7f3efec88700 1 -- 172.21.15.63:0/3628849441 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed4003380 con 0x7f3ed80039a0 2020-05-18T21:38:28.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.568+0000 7f3ee6ffd700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3ed8053880 0x7f3ed8055d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:28.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.568+0000 7f3ee6ffd700 1 -- 172.21.15.63:0/3628849441 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3ef4063800 con 0x7f3ed80039a0 2020-05-18T21:38:28.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.568+0000 7f3efdc86700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3ed8053880 0x7f3ed8055d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:28.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.568+0000 7f3efdc86700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3ed8053880 0x7f3ed8055d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ee80011b0 tx=0x7f3ee800b780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.568+0000 7f3efdc86700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3ed8053880 0x7f3ed8055d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ee80011b0 tx=0x7f3ee800b780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.568+0000 7f3efdc86700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3ed8053880 0x7f3ed8055d40 secure :-1 s=READY pgs=848 cs=0 l=1 rx=0x7f3ee80011b0 tx=0x7f3ee800b780).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:28.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.572+0000 7f3efd485700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed80039a0 0x7f3ed8003e20 secure :-1 s=THROTTLE_DONE pgs=2162 cs=0 l=1 rx=0x7f3ef4001110 tx=0x7f3ef4001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:28.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.572+0000 7f3ee6ffd700 1 -- 172.21.15.63:0/3628849441 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3ef403dbf0 con 0x7f3ed80039a0 2020-05-18T21:38:28.698 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:28.692+0000 7f3efec88700 1 -- 172.21.15.63:0/3628849441 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f3ed4002240 con 0x7f3ed80039a0 2020-05-18T21:38:29.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.096+0000 7f3efd485700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed80039a0 0x7f3ed8003e20 secure :-1 s=THROTTLE_DONE pgs=2162 cs=0 l=1 rx=0x7f3ef4001110 tx=0x7f3ef4001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:29.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.096+0000 7f3ee6ffd700 1 -- 172.21.15.63:0/3628849441 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v164) v1 ==== 133+0+0 (secure 0 0 0) 0x7f3ef4041210 con 0x7f3ed80039a0 2020-05-18T21:38:29.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.104+0000 7f3efec88700 1 -- 172.21.15.63:0/3628849441 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3ed8053880 msgr2=0x7f3ed8055d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:29.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.104+0000 7f3efec88700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3ed8053880 0x7f3ed8055d40 secure :-1 s=READY pgs=848 cs=0 l=1 rx=0x7f3ee80011b0 tx=0x7f3ee800b780).stop 2020-05-18T21:38:29.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.104+0000 7f3efec88700 1 -- 172.21.15.63:0/3628849441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed80039a0 msgr2=0x7f3ed8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:29.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.104+0000 7f3efec88700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed80039a0 0x7f3ed8003e20 secure :-1 s=READY pgs=2162 cs=0 l=1 rx=0x7f3ef4001110 tx=0x7f3ef4001710).stop 2020-05-18T21:38:29.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.104+0000 7f3efec88700 1 -- 172.21.15.63:0/3628849441 shutdown_connections 2020-05-18T21:38:29.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.104+0000 7f3efec88700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3ed8053880 0x7f3ed8055d40 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:29.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.104+0000 7f3efec88700 1 --2- 172.21.15.63:0/3628849441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed80039a0 0x7f3ed8003e20 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:29.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.104+0000 7f3efec88700 1 -- 172.21.15.63:0/3628849441 >> 172.21.15.63:0/3628849441 conn(0x7f3ef8069b70 msgr2=0x7f3ef805c260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:29.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.104+0000 7f3efec88700 1 -- 172.21.15.63:0/3628849441 shutdown_connections 2020-05-18T21:38:29.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.104+0000 7f3efec88700 1 -- 172.21.15.63:0/3628849441 wait complete. 2020-05-18T21:38:29.114 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2020-05-18T21:38:29.125 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-05-18T21:38:29.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.228+0000 7f24baa8a700 1 Processor -- start 2020-05-18T21:38:29.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.228+0000 7f24baa8a700 1 -- start start 2020-05-18T21:38:29.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24baa8a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f24b40b58e0 0x7f24b405ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:29.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24baa8a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f24b4149990 0x7f24b4149e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:29.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24baa8a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b405ff60 con 0x7f24b40b49b0 2020-05-18T21:38:29.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24baa8a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b40655f0 con 0x7f24b4149990 2020-05-18T21:38:29.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24baa8a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b4065890 con 0x7f24b40b58e0 2020-05-18T21:38:29.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24b9027700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f24b4149990 0x7f24b4149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:29.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24b3fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f24b40b49b0 0x7f24b40640e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39038/0 (socket says 172.21.15.63:39038) 2020-05-18T21:38:29.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24b3fff700 1 -- 172.21.15.63:0/4284948114 learned_addr learned my addr 172.21.15.63:0/4284948114 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:29.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24b8826700 1 --2- 172.21.15.63:0/4284948114 >> v2:172.21.15.155:3300/0 conn(0x7f24b40b58e0 0x7f24b405ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:29.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24b9027700 1 -- 172.21.15.63:0/4284948114 >> v2:172.21.15.155:3300/0 conn(0x7f24b40b58e0 msgr2=0x7f24b405ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:29.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24b9027700 1 --2- 172.21.15.63:0/4284948114 >> v2:172.21.15.155:3300/0 conn(0x7f24b40b58e0 0x7f24b405ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:29.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24b9027700 1 -- 172.21.15.63:0/4284948114 >> v1:172.21.15.63:6789/0 conn(0x7f24b40b49b0 legacy=0x7f24b40640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:29.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24b37fe700 1 -- 172.21.15.63:0/4284948114 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126770103 0 0) 0x7f24b405ff60 con 0x7f24b40b49b0 2020-05-18T21:38:29.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24b9027700 1 -- 172.21.15.63:0/4284948114 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b4061cf0 con 0x7f24b4149990 2020-05-18T21:38:29.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24b9027700 1 --2- 172.21.15.63:0/4284948114 >> v2:172.21.15.63:3300/0 conn(0x7f24b4149990 0x7f24b4149e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f24ac0032f0 tx=0x7f24ac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:29.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24b9027700 1 --2- 172.21.15.63:0/4284948114 >> v2:172.21.15.63:3300/0 conn(0x7f24b4149990 0x7f24b4149e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f24ac0032f0 tx=0x7f24ac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:29.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24b9027700 1 --2- 172.21.15.63:0/4284948114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b4149990 0x7f24b4149e00 secure :-1 s=READY pgs=2164 cs=0 l=1 rx=0x7f24ac0032f0 tx=0x7f24ac007e00).ready entity=mon.0 client_cookie=1c9522ef93fd4859 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:29.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24b9027700 1 --2- 172.21.15.63:0/4284948114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b4149990 0x7f24b4149e00 secure :-1 s=THROTTLE_DONE pgs=2164 cs=0 l=1 rx=0x7f24ac0032f0 tx=0x7f24ac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:29.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24b37fe700 1 -- 172.21.15.63:0/4284948114 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24ac011e60 con 0x7f24b4149990 2020-05-18T21:38:29.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24b9027700 1 --2- 172.21.15.63:0/4284948114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b4149990 0x7f24b4149e00 secure :-1 s=THROTTLE_DONE pgs=2164 cs=0 l=1 rx=0x7f24ac0032f0 tx=0x7f24ac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:29.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24b9027700 1 --2- 172.21.15.63:0/4284948114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b4149990 0x7f24b4149e00 secure :-1 s=THROTTLE_DONE pgs=2164 cs=0 l=1 rx=0x7f24ac0032f0 tx=0x7f24ac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:29.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24b37fe700 1 -- 172.21.15.63:0/4284948114 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ac00a180 con 0x7f24b4149990 2020-05-18T21:38:29.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24b37fe700 1 -- 172.21.15.63:0/4284948114 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24ac00a520 con 0x7f24b4149990 2020-05-18T21:38:29.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24baa8a700 1 -- 172.21.15.63:0/4284948114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b4149990 msgr2=0x7f24b4149e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:29.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24baa8a700 1 --2- 172.21.15.63:0/4284948114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b4149990 0x7f24b4149e00 secure :-1 s=READY pgs=2164 cs=0 l=1 rx=0x7f24ac0032f0 tx=0x7f24ac007e00).stop 2020-05-18T21:38:29.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24baa8a700 1 -- 172.21.15.63:0/4284948114 shutdown_connections 2020-05-18T21:38:29.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24baa8a700 1 --2- 172.21.15.63:0/4284948114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b4149990 0x7f24b4149e00 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:29.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24baa8a700 1 --2- 172.21.15.63:0/4284948114 >> v2:172.21.15.155:3300/0 conn(0x7f24b40b58e0 0x7f24b405ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:29.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24baa8a700 1 -- 172.21.15.63:0/4284948114 >> 172.21.15.63:0/4284948114 conn(0x7f24b40b8ec0 msgr2=0x7f24b40b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:29.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24baa8a700 1 -- 172.21.15.63:0/4284948114 shutdown_connections 2020-05-18T21:38:29.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.232+0000 7f24baa8a700 1 -- 172.21.15.63:0/4284948114 wait complete. 2020-05-18T21:38:29.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.236+0000 7f24baa8a700 1 Processor -- start 2020-05-18T21:38:29.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.236+0000 7f24baa8a700 1 -- start start 2020-05-18T21:38:29.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24baa8a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f24b40b49b0 0x7f24b406a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:29.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24baa8a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b4149990 0x7f24b41365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:29.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24baa8a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b4137310 con 0x7f24b40b58e0 2020-05-18T21:38:29.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24baa8a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b41375b0 con 0x7f24b40b49b0 2020-05-18T21:38:29.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24baa8a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b414cbc0 con 0x7f24b4149990 2020-05-18T21:38:29.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24b8826700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f24b40b49b0 0x7f24b406a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:29.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24b8826700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f24b40b49b0 0x7f24b406a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:51704/0 (socket says 172.21.15.63:51704) 2020-05-18T21:38:29.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24b8826700 1 -- 172.21.15.63:0/2478210 learned_addr learned my addr 172.21.15.63:0/2478210 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:29.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24b9027700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b4149990 0x7f24b41365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:29.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24b8826700 1 -- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b4149990 msgr2=0x7f24b41365a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:29.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24b8826700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b4149990 0x7f24b41365a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:29.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24b8826700 1 -- 172.21.15.63:0/2478210 >> v1:172.21.15.155:6789/0 conn(0x7f24b40b58e0 legacy=0x7f24b40af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:29.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24b8826700 1 -- 172.21.15.63:0/2478210 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b4137a50 con 0x7f24b40b49b0 2020-05-18T21:38:29.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24b1ffb700 1 -- 172.21.15.63:0/2478210 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119734664 0 0) 0x7f24b4137310 con 0x7f24b40b58e0 2020-05-18T21:38:29.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24b8826700 1 --2- 172.21.15.63:0/2478210 >> v2:172.21.15.155:3300/0 conn(0x7f24b40b49b0 0x7f24b406a3c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f24a80030b0 tx=0x7f24a8010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:29.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24b8826700 1 --2- 172.21.15.63:0/2478210 >> v2:172.21.15.155:3300/0 conn(0x7f24b40b49b0 0x7f24b406a3c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f24a80030b0 tx=0x7f24a8010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:29.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24b8826700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b40b49b0 0x7f24b406a3c0 secure :-1 s=READY pgs=1448 cs=0 l=1 rx=0x7f24a80030b0 tx=0x7f24a8010cd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:29.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24b8826700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b40b49b0 0x7f24b406a3c0 secure :-1 s=THROTTLE_DONE pgs=1448 cs=0 l=1 rx=0x7f24a80030b0 tx=0x7f24a8010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:29.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24b1ffb700 1 -- 172.21.15.63:0/2478210 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24a8007180 con 0x7f24b40b49b0 2020-05-18T21:38:29.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24b8826700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b40b49b0 0x7f24b406a3c0 secure :-1 s=THROTTLE_DONE pgs=1448 cs=0 l=1 rx=0x7f24a80030b0 tx=0x7f24a8010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:29.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24b8826700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b40b49b0 0x7f24b406a3c0 secure :-1 s=THROTTLE_DONE pgs=1448 cs=0 l=1 rx=0x7f24a80030b0 tx=0x7f24a8010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:29.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24b1ffb700 1 -- 172.21.15.63:0/2478210 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a80072e0 con 0x7f24b40b49b0 2020-05-18T21:38:29.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24baa8a700 1 -- 172.21.15.63:0/2478210 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b414b780 con 0x7f24b40b49b0 2020-05-18T21:38:29.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24b1ffb700 1 -- 172.21.15.63:0/2478210 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24a8012360 con 0x7f24b40b49b0 2020-05-18T21:38:29.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.240+0000 7f24baa8a700 1 -- 172.21.15.63:0/2478210 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b4136c20 con 0x7f24b40b49b0 2020-05-18T21:38:29.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.244+0000 7f24b8826700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b40b49b0 0x7f24b406a3c0 secure :-1 s=THROTTLE_DONE pgs=1448 cs=0 l=1 rx=0x7f24a80030b0 tx=0x7f24a8010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:29.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.244+0000 7f24baa8a700 1 -- 172.21.15.63:0/2478210 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b4137120 con 0x7f24b40b49b0 2020-05-18T21:38:29.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.244+0000 7f24b1ffb700 1 -- 172.21.15.63:0/2478210 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f24a80125d0 con 0x7f24b40b49b0 2020-05-18T21:38:29.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.244+0000 7f24b8826700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b40b49b0 0x7f24b406a3c0 secure :-1 s=THROTTLE_DONE pgs=1448 cs=0 l=1 rx=0x7f24a80030b0 tx=0x7f24a8010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:29.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.244+0000 7f24b1ffb700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f249404f8e0 0x7f2494051da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:29.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.244+0000 7f24b1ffb700 1 -- 172.21.15.63:0/2478210 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f24a8064120 con 0x7f24b40b49b0 2020-05-18T21:38:29.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.244+0000 7f24b3fff700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f249404f8e0 0x7f2494051da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:29.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.244+0000 7f24b3fff700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f249404f8e0 0x7f2494051da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f24a4000f20 tx=0x7f24a4001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:29.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.244+0000 7f24b3fff700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f249404f8e0 0x7f2494051da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f24a4000f20 tx=0x7f24a4001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:29.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.244+0000 7f24b3fff700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f249404f8e0 0x7f2494051da0 secure :-1 s=READY pgs=849 cs=0 l=1 rx=0x7f24a4000f20 tx=0x7f24a4001730).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:29.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.252+0000 7f24b8826700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b40b49b0 0x7f24b406a3c0 secure :-1 s=THROTTLE_DONE pgs=1448 cs=0 l=1 rx=0x7f24a80030b0 tx=0x7f24a8010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:29.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.252+0000 7f24b1ffb700 1 -- 172.21.15.63:0/2478210 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f24a803e4b0 con 0x7f24b40b49b0 2020-05-18T21:38:29.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:29.376+0000 7f24baa8a700 1 -- 172.21.15.63:0/2478210 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f24b40569e0 con 0x7f24b40b49b0 2020-05-18T21:38:30.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.112+0000 7f24b8826700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b40b49b0 0x7f24b406a3c0 secure :-1 s=THROTTLE_DONE pgs=1448 cs=0 l=1 rx=0x7f24a80030b0 tx=0x7f24a8010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.112+0000 7f24b1ffb700 1 -- 172.21.15.63:0/2478210 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v165) v1 ==== 125+0+0 (secure 0 0 0) 0x7f24a8041ad0 con 0x7f24b40b49b0 2020-05-18T21:38:30.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.120+0000 7f24baa8a700 1 -- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f249404f8e0 msgr2=0x7f2494051da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.120+0000 7f24baa8a700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f249404f8e0 0x7f2494051da0 secure :-1 s=READY pgs=849 cs=0 l=1 rx=0x7f24a4000f20 tx=0x7f24a4001730).stop 2020-05-18T21:38:30.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.120+0000 7f24baa8a700 1 -- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b40b49b0 msgr2=0x7f24b406a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.120+0000 7f24baa8a700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b40b49b0 0x7f24b406a3c0 secure :-1 s=READY pgs=1448 cs=0 l=1 rx=0x7f24a80030b0 tx=0x7f24a8010cd0).stop 2020-05-18T21:38:30.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.120+0000 7f24baa8a700 1 -- 172.21.15.63:0/2478210 shutdown_connections 2020-05-18T21:38:30.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.120+0000 7f24baa8a700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f249404f8e0 0x7f2494051da0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:30.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.120+0000 7f24baa8a700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b4149990 0x7f24b41365a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:30.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.120+0000 7f24baa8a700 1 --2- 172.21.15.63:0/2478210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b40b49b0 0x7f24b406a3c0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:30.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.120+0000 7f24baa8a700 1 -- 172.21.15.63:0/2478210 >> 172.21.15.63:0/2478210 conn(0x7f24b40b8ec0 msgr2=0x7f24b40620b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:30.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.120+0000 7f24baa8a700 1 -- 172.21.15.63:0/2478210 shutdown_connections 2020-05-18T21:38:30.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.120+0000 7f24baa8a700 1 -- 172.21.15.63:0/2478210 wait complete. 2020-05-18T21:38:30.130 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2020-05-18T21:38:30.142 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-05-18T21:38:30.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.244+0000 7fdd42a0f700 1 Processor -- start 2020-05-18T21:38:30.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.244+0000 7fdd42a0f700 1 -- start start 2020-05-18T21:38:30.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd42a0f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdd3c0b99d0 0x7fdd3c1469b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:30.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd42a0f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd3c149d40 0x7fdd3c060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:30.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd42a0f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3c145fd0 con 0x7fdd3c0b68d0 2020-05-18T21:38:30.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd42a0f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3c146270 con 0x7fdd3c0b99d0 2020-05-18T21:38:30.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd42a0f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c146510 con 0x7fdd3c149d40 2020-05-18T21:38:30.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd41a0d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdd3c0b68d0 0x7fdd3c0b8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39052/0 (socket says 172.21.15.63:39052) 2020-05-18T21:38:30.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd41a0d700 1 -- 172.21.15.63:0/94644590 learned_addr learned my addr 172.21.15.63:0/94644590 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:30.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd4120c700 1 --2- 172.21.15.63:0/94644590 >> v2:172.21.15.155:3300/0 conn(0x7fdd3c0b99d0 0x7fdd3c1469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:30.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd4220e700 1 --2- 172.21.15.63:0/94644590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd3c149d40 0x7fdd3c060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:30.257 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd40a0b700 1 -- 172.21.15.63:0/94644590 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267323014 0 0) 0x7fdd3c145fd0 con 0x7fdd3c0b68d0 2020-05-18T21:38:30.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd40a0b700 1 -- 172.21.15.63:0/94644590 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd24003270 con 0x7fdd3c0b68d0 2020-05-18T21:38:30.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd4120c700 1 -- 172.21.15.63:0/94644590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd3c149d40 msgr2=0x7fdd3c060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:30.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd4120c700 1 --2- 172.21.15.63:0/94644590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd3c149d40 0x7fdd3c060430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:30.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd4120c700 1 -- 172.21.15.63:0/94644590 >> v1:172.21.15.63:6789/0 conn(0x7fdd3c0b68d0 legacy=0x7fdd3c0b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd4120c700 1 -- 172.21.15.63:0/94644590 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3c14a1f0 con 0x7fdd3c0b99d0 2020-05-18T21:38:30.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd4220e700 1 --2- 172.21.15.63:0/94644590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd3c149d40 0x7fdd3c060430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:38:30.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd4120c700 1 --2- 172.21.15.63:0/94644590 >> v2:172.21.15.155:3300/0 conn(0x7fdd3c0b99d0 0x7fdd3c1469b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdd30002f70 tx=0x7fdd30007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd4120c700 1 --2- 172.21.15.63:0/94644590 >> v2:172.21.15.155:3300/0 conn(0x7fdd3c0b99d0 0x7fdd3c1469b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdd30002f70 tx=0x7fdd30007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd4120c700 1 --2- 172.21.15.63:0/94644590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd3c0b99d0 0x7fdd3c1469b0 secure :-1 s=READY pgs=1449 cs=0 l=1 rx=0x7fdd30002f70 tx=0x7fdd30007a80).ready entity=mon.1 client_cookie=22a6ec216f15cb61 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:30.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd4120c700 1 --2- 172.21.15.63:0/94644590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd3c0b99d0 0x7fdd3c1469b0 secure :-1 s=THROTTLE_DONE pgs=1449 cs=0 l=1 rx=0x7fdd30002f70 tx=0x7fdd30007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd4120c700 1 --2- 172.21.15.63:0/94644590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd3c0b99d0 0x7fdd3c1469b0 secure :-1 s=THROTTLE_DONE pgs=1449 cs=0 l=1 rx=0x7fdd30002f70 tx=0x7fdd30007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd40a0b700 1 -- 172.21.15.63:0/94644590 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd30008e80 con 0x7fdd3c0b99d0 2020-05-18T21:38:30.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd4120c700 1 --2- 172.21.15.63:0/94644590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd3c0b99d0 0x7fdd3c1469b0 secure :-1 s=THROTTLE_DONE pgs=1449 cs=0 l=1 rx=0x7fdd30002f70 tx=0x7fdd30007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd40a0b700 1 -- 172.21.15.63:0/94644590 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd30011540 con 0x7fdd3c0b99d0 2020-05-18T21:38:30.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd40a0b700 1 -- 172.21.15.63:0/94644590 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd30011960 con 0x7fdd3c0b99d0 2020-05-18T21:38:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd42a0f700 1 -- 172.21.15.63:0/94644590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd3c0b99d0 msgr2=0x7fdd3c1469b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd42a0f700 1 --2- 172.21.15.63:0/94644590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd3c0b99d0 0x7fdd3c1469b0 secure :-1 s=READY pgs=1449 cs=0 l=1 rx=0x7fdd30002f70 tx=0x7fdd30007a80).stop 2020-05-18T21:38:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd42a0f700 1 -- 172.21.15.63:0/94644590 shutdown_connections 2020-05-18T21:38:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd42a0f700 1 --2- 172.21.15.63:0/94644590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd3c149d40 0x7fdd3c060430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd42a0f700 1 --2- 172.21.15.63:0/94644590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd3c0b99d0 0x7fdd3c1469b0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd42a0f700 1 -- 172.21.15.63:0/94644590 >> 172.21.15.63:0/94644590 conn(0x7fdd3c069b70 msgr2=0x7fdd3c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:30.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd42a0f700 1 -- 172.21.15.63:0/94644590 shutdown_connections 2020-05-18T21:38:30.262 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.248+0000 7fdd42a0f700 1 -- 172.21.15.63:0/94644590 wait complete. 2020-05-18T21:38:30.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.252+0000 7fdd42a0f700 1 Processor -- start 2020-05-18T21:38:30.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.252+0000 7fdd42a0f700 1 -- start start 2020-05-18T21:38:30.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.252+0000 7fdd42a0f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd3c0b68d0 0x7fdd3c0adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:30.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.252+0000 7fdd42a0f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdd3c0b99d0 0x7fdd3c143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:30.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.252+0000 7fdd42a0f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdd3c149d40 0x7fdd3c156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:30.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.252+0000 7fdd42a0f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3c0ad380 con 0x7fdd3c149d40 2020-05-18T21:38:30.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.252+0000 7fdd42a0f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3c0b0400 con 0x7fdd3c0b99d0 2020-05-18T21:38:30.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.252+0000 7fdd42a0f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c0b06a0 con 0x7fdd3c0b68d0 2020-05-18T21:38:30.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.252+0000 7fdd4220e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdd3c149d40 0x7fdd3c156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:30.266 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.252+0000 7fdd4220e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdd3c149d40 0x7fdd3c156550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36872/0 (socket says 172.21.15.63:36872) 2020-05-18T21:38:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.252+0000 7fdd4120c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdd3c0b99d0 0x7fdd3c143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:30.267 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.252+0000 7fdd4220e700 1 -- 172.21.15.63:0/355111117 learned_addr learned my addr 172.21.15.63:0/355111117 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:30.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.252+0000 7fdd41a0d700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd3c0b68d0 0x7fdd3c0adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:30.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.252+0000 7fdd4120c700 1 -- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd3c0b68d0 msgr2=0x7fdd3c0adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd4120c700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd3c0b68d0 0x7fdd3c0adb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:30.271 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd4120c700 1 -- 172.21.15.63:0/355111117 >> v2:172.21.15.63:3300/0 conn(0x7fdd3c149d40 msgr2=0x7fdd3c156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd4120c700 1 --2- 172.21.15.63:0/355111117 >> v2:172.21.15.63:3300/0 conn(0x7fdd3c149d40 0x7fdd3c156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:30.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd4120c700 1 -- 172.21.15.63:0/355111117 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3c0ae0b0 con 0x7fdd3c0b99d0 2020-05-18T21:38:30.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd41a0d700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd3c0b68d0 0x7fdd3c0adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:38:30.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd4120c700 1 --2- 172.21.15.63:0/355111117 >> v2:172.21.15.155:3300/0 conn(0x7fdd3c0b99d0 0x7fdd3c143ba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd30002f70 tx=0x7fdd30007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.272 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd4120c700 1 --2- 172.21.15.63:0/355111117 >> v2:172.21.15.155:3300/0 conn(0x7fdd3c0b99d0 0x7fdd3c143ba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd30002f70 tx=0x7fdd30007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd4120c700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd3c0b99d0 0x7fdd3c143ba0 secure :-1 s=READY pgs=1450 cs=0 l=1 rx=0x7fdd30002f70 tx=0x7fdd30007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:30.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd4120c700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd3c0b99d0 0x7fdd3c143ba0 secure :-1 s=THROTTLE_DONE pgs=1450 cs=0 l=1 rx=0x7fdd30002f70 tx=0x7fdd30007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd2effd700 1 -- 172.21.15.63:0/355111117 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd30010100 con 0x7fdd3c0b99d0 2020-05-18T21:38:30.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd4120c700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd3c0b99d0 0x7fdd3c143ba0 secure :-1 s=THROTTLE_DONE pgs=1450 cs=0 l=1 rx=0x7fdd30002f70 tx=0x7fdd30007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.273 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd4120c700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd3c0b99d0 0x7fdd3c143ba0 secure :-1 s=THROTTLE_DONE pgs=1450 cs=0 l=1 rx=0x7fdd30002f70 tx=0x7fdd30007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd2effd700 1 -- 172.21.15.63:0/355111117 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd30007170 con 0x7fdd3c0b99d0 2020-05-18T21:38:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd42a0f700 1 -- 172.21.15.63:0/355111117 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3c1569b0 con 0x7fdd3c0b99d0 2020-05-18T21:38:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd2effd700 1 -- 172.21.15.63:0/355111117 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd300074d0 con 0x7fdd3c0b99d0 2020-05-18T21:38:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd42a0f700 1 -- 172.21.15.63:0/355111117 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3c156e60 con 0x7fdd3c0b99d0 2020-05-18T21:38:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd4120c700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd3c0b99d0 0x7fdd3c143ba0 secure :-1 s=THROTTLE_DONE pgs=1450 cs=0 l=1 rx=0x7fdd30002f70 tx=0x7fdd30007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd42a0f700 1 -- 172.21.15.63:0/355111117 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3c0569e0 con 0x7fdd3c0b99d0 2020-05-18T21:38:30.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd2effd700 1 -- 172.21.15.63:0/355111117 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fdd30005700 con 0x7fdd3c0b99d0 2020-05-18T21:38:30.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd4120c700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd3c0b99d0 0x7fdd3c143ba0 secure :-1 s=THROTTLE_DONE pgs=1450 cs=0 l=1 rx=0x7fdd30002f70 tx=0x7fdd30007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd2effd700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd1c04fa50 0x7fdd1c051f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:30.275 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.256+0000 7fdd2effd700 1 -- 172.21.15.63:0/355111117 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fdd30064150 con 0x7fdd3c0b99d0 2020-05-18T21:38:30.276 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.260+0000 7fdd41a0d700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd1c04fa50 0x7fdd1c051f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:30.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.260+0000 7fdd41a0d700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd1c04fa50 0x7fdd1c051f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd38001110 tx=0x7fdd38001770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.260+0000 7fdd41a0d700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd1c04fa50 0x7fdd1c051f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd38001110 tx=0x7fdd38001770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.260+0000 7fdd41a0d700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd1c04fa50 0x7fdd1c051f10 secure :-1 s=READY pgs=850 cs=0 l=1 rx=0x7fdd38001110 tx=0x7fdd38001770).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:30.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.264+0000 7fdd4120c700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd3c0b99d0 0x7fdd3c143ba0 secure :-1 s=THROTTLE_DONE pgs=1450 cs=0 l=1 rx=0x7fdd30002f70 tx=0x7fdd30007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.277 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.264+0000 7fdd2effd700 1 -- 172.21.15.63:0/355111117 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fdd3003e540 con 0x7fdd3c0b99d0 2020-05-18T21:38:30.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.420+0000 7fdd42a0f700 1 -- 172.21.15.63:0/355111117 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fdd3c0b0810 con 0x7fdd3c0b99d0 2020-05-18T21:38:30.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.432+0000 7fdd4120c700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd3c0b99d0 0x7fdd3c143ba0 secure :-1 s=THROTTLE_DONE pgs=1450 cs=0 l=1 rx=0x7fdd30002f70 tx=0x7fdd30007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.432+0000 7fdd2effd700 1 -- 172.21.15.63:0/355111117 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 31 and data pool 32 v149) v1 ==== 189+0+0 (secure 0 0 0) 0x7fdd30041b60 con 0x7fdd3c0b99d0 2020-05-18T21:38:30.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.444+0000 7fdd42a0f700 1 -- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd1c04fa50 msgr2=0x7fdd1c051f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.449 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.444+0000 7fdd42a0f700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd1c04fa50 0x7fdd1c051f10 secure :-1 s=READY pgs=850 cs=0 l=1 rx=0x7fdd38001110 tx=0x7fdd38001770).stop 2020-05-18T21:38:30.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.444+0000 7fdd42a0f700 1 -- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd3c0b99d0 msgr2=0x7fdd3c143ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.444+0000 7fdd42a0f700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd3c0b99d0 0x7fdd3c143ba0 secure :-1 s=READY pgs=1450 cs=0 l=1 rx=0x7fdd30002f70 tx=0x7fdd30007a80).stop 2020-05-18T21:38:30.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.444+0000 7fdd42a0f700 1 -- 172.21.15.63:0/355111117 shutdown_connections 2020-05-18T21:38:30.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.444+0000 7fdd42a0f700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fdd1c04fa50 0x7fdd1c051f10 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:30.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.444+0000 7fdd42a0f700 1 --2- 172.21.15.63:0/355111117 >> v2:172.21.15.63:3300/0 conn(0x7fdd3c149d40 0x7fdd3c156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:30.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.444+0000 7fdd42a0f700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd3c0b99d0 0x7fdd3c143ba0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:30.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.444+0000 7fdd42a0f700 1 --2- 172.21.15.63:0/355111117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd3c0b68d0 0x7fdd3c0adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:30.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.444+0000 7fdd42a0f700 1 -- 172.21.15.63:0/355111117 >> 172.21.15.63:0/355111117 conn(0x7fdd3c069b70 msgr2=0x7fdd3c0603f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:30.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.444+0000 7fdd42a0f700 1 -- 172.21.15.63:0/355111117 shutdown_connections 2020-05-18T21:38:30.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.444+0000 7fdd42a0f700 1 -- 172.21.15.63:0/355111117 wait complete. 2020-05-18T21:38:30.454 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 31 and data pool 32 2020-05-18T21:38:30.464 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:38:30.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc59634e700 1 Processor -- start 2020-05-18T21:38:30.558 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc59634e700 1 -- start start 2020-05-18T21:38:30.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc59634e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc590144810 0x7fc590062a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:30.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc59634e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc590069b70 con 0x7fc59013de20 2020-05-18T21:38:30.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc59634e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc590069e10 con 0x7fc5900b6180 2020-05-18T21:38:30.560 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc59634e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59006a0b0 con 0x7fc590144810 2020-05-18T21:38:30.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc5948eb700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc590144810 0x7fc590062a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:30.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc5948eb700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc590144810 0x7fc590062a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36882/0 (socket says 172.21.15.63:36882) 2020-05-18T21:38:30.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc58ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc59013de20 0x7fc59006a550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39066/0 (socket says 172.21.15.63:39066) 2020-05-18T21:38:30.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc5948eb700 1 -- 172.21.15.63:0/3068581290 learned_addr learned my addr 172.21.15.63:0/3068581290 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:30.561 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc5948eb700 1 -- 172.21.15.63:0/3068581290 >> v1:172.21.15.155:6789/0 conn(0x7fc5900b6180 legacy=0x7fc5900b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc5948eb700 1 -- 172.21.15.63:0/3068581290 >> v1:172.21.15.63:6789/0 conn(0x7fc59013de20 legacy=0x7fc59006a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc58effd700 1 -- 172.21.15.63:0/3068581290 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988105088 0 0) 0x7fc590069b70 con 0x7fc59013de20 2020-05-18T21:38:30.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc5948eb700 1 -- 172.21.15.63:0/3068581290 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc590144c70 con 0x7fc590144810 2020-05-18T21:38:30.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc5948eb700 1 --2- 172.21.15.63:0/3068581290 >> v2:172.21.15.63:3300/0 conn(0x7fc590144810 0x7fc590062a60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc588002f70 tx=0x7fc588007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc5948eb700 1 --2- 172.21.15.63:0/3068581290 >> v2:172.21.15.63:3300/0 conn(0x7fc590144810 0x7fc590062a60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc588002f70 tx=0x7fc588007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc5948eb700 1 --2- 172.21.15.63:0/3068581290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc590144810 0x7fc590062a60 secure :-1 s=READY pgs=2167 cs=0 l=1 rx=0x7fc588002f70 tx=0x7fc588007a80).ready entity=mon.0 client_cookie=496d69f936dc5ee4 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:30.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc5948eb700 1 --2- 172.21.15.63:0/3068581290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc590144810 0x7fc590062a60 secure :-1 s=THROTTLE_DONE pgs=2167 cs=0 l=1 rx=0x7fc588002f70 tx=0x7fc588007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc5948eb700 1 --2- 172.21.15.63:0/3068581290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc590144810 0x7fc590062a60 secure :-1 s=THROTTLE_DONE pgs=2167 cs=0 l=1 rx=0x7fc588002f70 tx=0x7fc588007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc5948eb700 1 --2- 172.21.15.63:0/3068581290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc590144810 0x7fc590062a60 secure :-1 s=THROTTLE_DONE pgs=2167 cs=0 l=1 rx=0x7fc588002f70 tx=0x7fc588007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc58effd700 1 -- 172.21.15.63:0/3068581290 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc588011760 con 0x7fc590144810 2020-05-18T21:38:30.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc58effd700 1 -- 172.21.15.63:0/3068581290 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5880118c0 con 0x7fc590144810 2020-05-18T21:38:30.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc58effd700 1 -- 172.21.15.63:0/3068581290 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc588011ce0 con 0x7fc590144810 2020-05-18T21:38:30.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc59634e700 1 -- 172.21.15.63:0/3068581290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc590144810 msgr2=0x7fc590062a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc59634e700 1 --2- 172.21.15.63:0/3068581290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc590144810 0x7fc590062a60 secure :-1 s=READY pgs=2167 cs=0 l=1 rx=0x7fc588002f70 tx=0x7fc588007a80).stop 2020-05-18T21:38:30.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc59634e700 1 -- 172.21.15.63:0/3068581290 shutdown_connections 2020-05-18T21:38:30.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc59634e700 1 --2- 172.21.15.63:0/3068581290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc590144810 0x7fc590062a60 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:30.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc59634e700 1 -- 172.21.15.63:0/3068581290 >> 172.21.15.63:0/3068581290 conn(0x7fc5900ba5c0 msgr2=0x7fc5900ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:30.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc59634e700 1 -- 172.21.15.63:0/3068581290 shutdown_connections 2020-05-18T21:38:30.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.552+0000 7fc59634e700 1 -- 172.21.15.63:0/3068581290 wait complete. 2020-05-18T21:38:30.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.556+0000 7fc59634e700 1 Processor -- start 2020-05-18T21:38:30.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.556+0000 7fc59634e700 1 -- start start 2020-05-18T21:38:30.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.556+0000 7fc59634e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc59013de20 0x7fc5900b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:30.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.556+0000 7fc59634e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5900b2e30 con 0x7fc590144810 2020-05-18T21:38:30.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.556+0000 7fc59634e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc590147640 con 0x7fc5900b6180 2020-05-18T21:38:30.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.556+0000 7fc59634e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5901478e0 con 0x7fc59013de20 2020-05-18T21:38:30.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.556+0000 7fc5948eb700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc590144810 0x7fc59013e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39076/0 (socket says 172.21.15.63:39076) 2020-05-18T21:38:30.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.556+0000 7fc5948eb700 1 -- 172.21.15.63:0/2769565431 learned_addr learned my addr 172.21.15.63:0/2769565431 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:30.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.556+0000 7fc58f7fe700 1 --2- 172.21.15.63:0/2769565431 >> v2:172.21.15.155:3300/0 conn(0x7fc59013de20 0x7fc5900b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:30.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.556+0000 7fc58d7fa700 1 -- 172.21.15.63:0/2769565431 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081504973 0 0) 0x7fc5900b2e30 con 0x7fc590144810 2020-05-18T21:38:30.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.556+0000 7fc58d7fa700 1 -- 172.21.15.63:0/2769565431 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc570002fe0 con 0x7fc590144810 2020-05-18T21:38:30.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.556+0000 7fc58d7fa700 1 -- 172.21.15.63:0/2769565431 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968604192 0 0) 0x7fc590147640 con 0x7fc5900b6180 2020-05-18T21:38:30.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.556+0000 7fc58d7fa700 1 -- 172.21.15.63:0/2769565431 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5900b2e30 con 0x7fc5900b6180 2020-05-18T21:38:30.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.560+0000 7fc58d7fa700 1 -- 172.21.15.63:0/2769565431 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3149890019 0 0) 0x7fc570002fe0 con 0x7fc590144810 2020-05-18T21:38:30.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.560+0000 7fc58d7fa700 1 -- 172.21.15.63:0/2769565431 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc590147640 con 0x7fc590144810 2020-05-18T21:38:30.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.560+0000 7fc58d7fa700 1 -- 172.21.15.63:0/2769565431 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fc588008600 con 0x7fc590144810 2020-05-18T21:38:30.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.560+0000 7fc58f7fe700 1 -- 172.21.15.63:0/2769565431 >> v1:172.21.15.155:6789/0 conn(0x7fc5900b6180 legacy=0x7fc5901482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.560+0000 7fc58f7fe700 1 -- 172.21.15.63:0/2769565431 >> v1:172.21.15.63:6789/0 conn(0x7fc590144810 legacy=0x7fc59013e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.560+0000 7fc58f7fe700 1 -- 172.21.15.63:0/2769565431 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc590147b80 con 0x7fc59013de20 2020-05-18T21:38:30.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.560+0000 7fc58f7fe700 1 --2- 172.21.15.63:0/2769565431 >> v2:172.21.15.155:3300/0 conn(0x7fc59013de20 0x7fc5900b29d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc5900626e0 tx=0x7fc580010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.560+0000 7fc58f7fe700 1 --2- 172.21.15.63:0/2769565431 >> v2:172.21.15.155:3300/0 conn(0x7fc59013de20 0x7fc5900b29d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc5900626e0 tx=0x7fc580010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.560+0000 7fc58f7fe700 1 --2- 172.21.15.63:0/2769565431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc59013de20 0x7fc5900b29d0 secure :-1 s=READY pgs=1453 cs=0 l=1 rx=0x7fc5900626e0 tx=0x7fc580010c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:30.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.560+0000 7fc58f7fe700 1 --2- 172.21.15.63:0/2769565431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc59013de20 0x7fc5900b29d0 secure :-1 s=THROTTLE_DONE pgs=1453 cs=0 l=1 rx=0x7fc5900626e0 tx=0x7fc580010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.560+0000 7fc58d7fa700 1 -- 172.21.15.63:0/2769565431 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc580006d70 con 0x7fc59013de20 2020-05-18T21:38:30.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.560+0000 7fc58f7fe700 1 --2- 172.21.15.63:0/2769565431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc59013de20 0x7fc5900b29d0 secure :-1 s=THROTTLE_DONE pgs=1453 cs=0 l=1 rx=0x7fc5900626e0 tx=0x7fc580010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.560+0000 7fc58d7fa700 1 -- 172.21.15.63:0/2769565431 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc580002260 con 0x7fc59013de20 2020-05-18T21:38:30.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.560+0000 7fc58f7fe700 1 --2- 172.21.15.63:0/2769565431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc59013de20 0x7fc5900b29d0 secure :-1 s=THROTTLE_DONE pgs=1453 cs=0 l=1 rx=0x7fc5900626e0 tx=0x7fc580010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.560+0000 7fc59634e700 1 -- 172.21.15.63:0/2769565431 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc590147e20 con 0x7fc59013de20 2020-05-18T21:38:30.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.560+0000 7fc58d7fa700 1 -- 172.21.15.63:0/2769565431 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc580002640 con 0x7fc59013de20 2020-05-18T21:38:30.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.560+0000 7fc59634e700 1 -- 172.21.15.63:0/2769565431 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5901489d0 con 0x7fc59013de20 2020-05-18T21:38:30.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.560+0000 7fc59634e700 1 -- 172.21.15.63:0/2769565431 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5900569e0 con 0x7fc59013de20 2020-05-18T21:38:30.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.560+0000 7fc58f7fe700 1 --2- 172.21.15.63:0/2769565431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc59013de20 0x7fc5900b29d0 secure :-1 s=THROTTLE_DONE pgs=1453 cs=0 l=1 rx=0x7fc5900626e0 tx=0x7fc580010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.564+0000 7fc58d7fa700 1 -- 172.21.15.63:0/2769565431 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc580003080 con 0x7fc59013de20 2020-05-18T21:38:30.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.564+0000 7fc58f7fe700 1 --2- 172.21.15.63:0/2769565431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc59013de20 0x7fc5900b29d0 secure :-1 s=THROTTLE_DONE pgs=1453 cs=0 l=1 rx=0x7fc5900626e0 tx=0x7fc580010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.564+0000 7fc58d7fa700 1 --2- 172.21.15.63:0/2769565431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc570050110 0x7fc5700525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:30.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.564+0000 7fc58d7fa700 1 -- 172.21.15.63:0/2769565431 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc580063c10 con 0x7fc59013de20 2020-05-18T21:38:30.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.564+0000 7fc58ffff700 1 --2- 172.21.15.63:0/2769565431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc570050110 0x7fc5700525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:30.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.564+0000 7fc58ffff700 1 --2- 172.21.15.63:0/2769565431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc570050110 0x7fc5700525d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc584000f20 tx=0x7fc584001740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.564+0000 7fc58ffff700 1 --2- 172.21.15.63:0/2769565431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc570050110 0x7fc5700525d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc584000f20 tx=0x7fc584001740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.579 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.564+0000 7fc58ffff700 1 --2- 172.21.15.63:0/2769565431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc570050110 0x7fc5700525d0 secure :-1 s=READY pgs=852 cs=0 l=1 rx=0x7fc584000f20 tx=0x7fc584001740).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:30.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.572+0000 7fc58f7fe700 1 --2- 172.21.15.63:0/2769565431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc59013de20 0x7fc5900b29d0 secure :-1 s=THROTTLE_DONE pgs=1453 cs=0 l=1 rx=0x7fc5900626e0 tx=0x7fc580010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.580 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.572+0000 7fc58d7fa700 1 -- 172.21.15.63:0/2769565431 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc58003df40 con 0x7fc59013de20 2020-05-18T21:38:30.593 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:38:30.596 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:38:30.699 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.692+0000 7fc59634e700 1 -- 172.21.15.63:0/2769565431 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5900b6e40 con 0x7fc59013de20 2020-05-18T21:38:30.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.692+0000 7fc58f7fe700 1 --2- 172.21.15.63:0/2769565431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc59013de20 0x7fc5900b29d0 secure :-1 s=THROTTLE_DONE pgs=1453 cs=0 l=1 rx=0x7fc5900626e0 tx=0x7fc580010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.701 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.692+0000 7fc58d7fa700 1 -- 172.21.15.63:0/2769565431 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+16116 (secure 0 0 0) 0x7fc580041560 con 0x7fc59013de20 2020-05-18T21:38:30.702 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:30.702 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":166,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:38:30.427145+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:38:28.730444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2020-05-18T21:38:29.414568+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:38:30.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.696+0000 7fc59634e700 1 -- 172.21.15.63:0/2769565431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc570050110 msgr2=0x7fc5700525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.696+0000 7fc59634e700 1 --2- 172.21.15.63:0/2769565431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc570050110 0x7fc5700525d0 secure :-1 s=READY pgs=852 cs=0 l=1 rx=0x7fc584000f20 tx=0x7fc584001740).stop 2020-05-18T21:38:30.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.696+0000 7fc59634e700 1 -- 172.21.15.63:0/2769565431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc59013de20 msgr2=0x7fc5900b29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.696+0000 7fc59634e700 1 --2- 172.21.15.63:0/2769565431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc59013de20 0x7fc5900b29d0 secure :-1 s=READY pgs=1453 cs=0 l=1 rx=0x7fc5900626e0 tx=0x7fc580010c40).stop 2020-05-18T21:38:30.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.696+0000 7fc59634e700 1 -- 172.21.15.63:0/2769565431 shutdown_connections 2020-05-18T21:38:30.705 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.696+0000 7fc59634e700 1 --2- 172.21.15.63:0/2769565431 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc570050110 0x7fc5700525d0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:30.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.696+0000 7fc59634e700 1 --2- 172.21.15.63:0/2769565431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc59013de20 0x7fc5900b29d0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:30.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.696+0000 7fc59634e700 1 -- 172.21.15.63:0/2769565431 >> 172.21.15.63:0/2769565431 conn(0x7fc5900ba5c0 msgr2=0x7fc5901439a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:30.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.696+0000 7fc59634e700 1 -- 172.21.15.63:0/2769565431 shutdown_connections 2020-05-18T21:38:30.706 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.696+0000 7fc59634e700 1 -- 172.21.15.63:0/2769565431 wait complete. 2020-05-18T21:38:30.720 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:38:30.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.812+0000 7f9fcdb98700 1 Processor -- start 2020-05-18T21:38:30.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.812+0000 7f9fcdb98700 1 -- start start 2020-05-18T21:38:30.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fcdb98700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9fc8143da0 0x7f9fc812a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:30.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fcdb98700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fc8147e60 0x7f9fc80650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:30.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fcdb98700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc8144240 con 0x7f9fc8060b90 2020-05-18T21:38:30.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fcdb98700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc81444e0 con 0x7f9fc8143da0 2020-05-18T21:38:30.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fcdb98700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc8144780 con 0x7f9fc8147e60 2020-05-18T21:38:30.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fc6ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9fc8143da0 0x7f9fc812a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:30.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fc6ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9fc8143da0 0x7f9fc812a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36892/0 (socket says 172.21.15.63:36892) 2020-05-18T21:38:30.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fc6ffd700 1 -- 172.21.15.63:0/1610249199 learned_addr learned my addr 172.21.15.63:0/1610249199 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:30.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fc7fff700 1 --2- 172.21.15.63:0/1610249199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fc8147e60 0x7f9fc80650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:30.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fc6ffd700 1 -- 172.21.15.63:0/1610249199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fc8147e60 msgr2=0x7f9fc80650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:30.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fc6ffd700 1 --2- 172.21.15.63:0/1610249199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fc8147e60 0x7f9fc80650c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:30.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fc6ffd700 1 -- 172.21.15.63:0/1610249199 >> v1:172.21.15.155:6789/0 conn(0x7f9fc8060b90 legacy=0x7f9fc81299d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fc6ffd700 1 -- 172.21.15.63:0/1610249199 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc8144c20 con 0x7f9fc8143da0 2020-05-18T21:38:30.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fc7fff700 1 --2- 172.21.15.63:0/1610249199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fc8147e60 0x7f9fc80650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:38:30.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fc6ffd700 1 --2- 172.21.15.63:0/1610249199 >> v2:172.21.15.63:3300/0 conn(0x7f9fc8143da0 0x7f9fc812a0e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9fb0002f70 tx=0x7f9fb0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fc6ffd700 1 --2- 172.21.15.63:0/1610249199 >> v2:172.21.15.63:3300/0 conn(0x7f9fc8143da0 0x7f9fc812a0e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9fb0002f70 tx=0x7f9fb0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fc6ffd700 1 --2- 172.21.15.63:0/1610249199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fc8143da0 0x7f9fc812a0e0 secure :-1 s=READY pgs=2169 cs=0 l=1 rx=0x7f9fb0002f70 tx=0x7f9fb0007a80).ready entity=mon.0 client_cookie=c3c12b4f6f034b1e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:30.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fc6ffd700 1 --2- 172.21.15.63:0/1610249199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fc8143da0 0x7f9fc812a0e0 secure :-1 s=THROTTLE_DONE pgs=2169 cs=0 l=1 rx=0x7f9fb0002f70 tx=0x7f9fb0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fc67fc700 1 -- 172.21.15.63:0/1610249199 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fb0011760 con 0x7f9fc8143da0 2020-05-18T21:38:30.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fc6ffd700 1 --2- 172.21.15.63:0/1610249199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fc8143da0 0x7f9fc812a0e0 secure :-1 s=THROTTLE_DONE pgs=2169 cs=0 l=1 rx=0x7f9fb0002f70 tx=0x7f9fb0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fc67fc700 1 -- 172.21.15.63:0/1610249199 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb00118c0 con 0x7f9fc8143da0 2020-05-18T21:38:30.828 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fc6ffd700 1 --2- 172.21.15.63:0/1610249199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fc8143da0 0x7f9fc812a0e0 secure :-1 s=THROTTLE_DONE pgs=2169 cs=0 l=1 rx=0x7f9fb0002f70 tx=0x7f9fb0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fc67fc700 1 -- 172.21.15.63:0/1610249199 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fb0011ce0 con 0x7f9fc8143da0 2020-05-18T21:38:30.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fcdb98700 1 -- 172.21.15.63:0/1610249199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fc8143da0 msgr2=0x7f9fc812a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fcdb98700 1 --2- 172.21.15.63:0/1610249199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fc8143da0 0x7f9fc812a0e0 secure :-1 s=READY pgs=2169 cs=0 l=1 rx=0x7f9fb0002f70 tx=0x7f9fb0007a80).stop 2020-05-18T21:38:30.829 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fcdb98700 1 -- 172.21.15.63:0/1610249199 shutdown_connections 2020-05-18T21:38:30.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fcdb98700 1 --2- 172.21.15.63:0/1610249199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fc8147e60 0x7f9fc80650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:30.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fcdb98700 1 --2- 172.21.15.63:0/1610249199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fc8143da0 0x7f9fc812a0e0 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:30.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fcdb98700 1 -- 172.21.15.63:0/1610249199 >> 172.21.15.63:0/1610249199 conn(0x7f9fc80b83d0 msgr2=0x7f9fc80b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:30.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fcdb98700 1 -- 172.21.15.63:0/1610249199 shutdown_connections 2020-05-18T21:38:30.830 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.816+0000 7f9fcdb98700 1 -- 172.21.15.63:0/1610249199 wait complete. 2020-05-18T21:38:30.833 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.820+0000 7f9fcdb98700 1 Processor -- start 2020-05-18T21:38:30.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.820+0000 7f9fcdb98700 1 -- start start 2020-05-18T21:38:30.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.820+0000 7f9fcdb98700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fc8060b90 0x7f9fc8128e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:30.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.820+0000 7f9fcdb98700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9fc8147e60 0x7f9fc8128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:30.834 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.820+0000 7f9fcdb98700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc8128aa0 con 0x7f9fc8143da0 2020-05-18T21:38:30.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.820+0000 7f9fcdb98700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc814a010 con 0x7f9fc8147e60 2020-05-18T21:38:30.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.820+0000 7f9fcdb98700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc814a2b0 con 0x7f9fc8060b90 2020-05-18T21:38:30.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.820+0000 7f9fc6ffd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f9fc8143da0 0x7f9fc80b5520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:37402/0 (socket says 172.21.15.63:37402) 2020-05-18T21:38:30.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.820+0000 7f9fc6ffd700 1 -- 172.21.15.63:0/576891328 learned_addr learned my addr 172.21.15.63:0/576891328 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:30.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.820+0000 7f9fc7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9fc8147e60 0x7f9fc8128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:30.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.820+0000 7f9fc77fe700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fc8060b90 0x7f9fc8128e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:30.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fc4ff9700 1 -- 172.21.15.63:0/576891328 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2771411087 0 0) 0x7f9fc8128aa0 con 0x7f9fc8143da0 2020-05-18T21:38:30.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fc4ff9700 1 -- 172.21.15.63:0/576891328 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fac002fe0 con 0x7f9fc8143da0 2020-05-18T21:38:30.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fc7fff700 1 -- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fc8060b90 msgr2=0x7f9fc8128e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fc7fff700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fc8060b90 0x7f9fc8128e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:30.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fc7fff700 1 -- 172.21.15.63:0/576891328 >> v1:172.21.15.155:6789/0 conn(0x7f9fc8143da0 legacy=0x7f9fc80b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fc7fff700 1 -- 172.21.15.63:0/576891328 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc8149d30 con 0x7f9fc8147e60 2020-05-18T21:38:30.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fc7fff700 1 --2- 172.21.15.63:0/576891328 >> v2:172.21.15.155:3300/0 conn(0x7f9fc8147e60 0x7f9fc8128640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9fc00032f0 tx=0x7f9fc0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.837 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fc7fff700 1 --2- 172.21.15.63:0/576891328 >> v2:172.21.15.155:3300/0 conn(0x7f9fc8147e60 0x7f9fc8128640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9fc00032f0 tx=0x7f9fc0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fc7fff700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc8147e60 0x7f9fc8128640 secure :-1 s=READY pgs=1456 cs=0 l=1 rx=0x7f9fc00032f0 tx=0x7f9fc0010d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:30.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fc7fff700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc8147e60 0x7f9fc8128640 secure :-1 s=THROTTLE_DONE pgs=1456 cs=0 l=1 rx=0x7f9fc00032f0 tx=0x7f9fc0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fc4ff9700 1 -- 172.21.15.63:0/576891328 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fc0005e70 con 0x7f9fc8147e60 2020-05-18T21:38:30.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fc7fff700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc8147e60 0x7f9fc8128640 secure :-1 s=THROTTLE_DONE pgs=1456 cs=0 l=1 rx=0x7f9fc00032f0 tx=0x7f9fc0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fc7fff700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc8147e60 0x7f9fc8128640 secure :-1 s=THROTTLE_DONE pgs=1456 cs=0 l=1 rx=0x7f9fc00032f0 tx=0x7f9fc0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fc4ff9700 1 -- 172.21.15.63:0/576891328 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc0007560 con 0x7f9fc8147e60 2020-05-18T21:38:30.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fc4ff9700 1 -- 172.21.15.63:0/576891328 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fc0007900 con 0x7f9fc8147e60 2020-05-18T21:38:30.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fcdb98700 1 -- 172.21.15.63:0/576891328 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc812a440 con 0x7f9fc8147e60 2020-05-18T21:38:30.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fcdb98700 1 -- 172.21.15.63:0/576891328 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc812a8f0 con 0x7f9fc8147e60 2020-05-18T21:38:30.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fcdb98700 1 -- 172.21.15.63:0/576891328 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc80569e0 con 0x7f9fc8147e60 2020-05-18T21:38:30.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fc7fff700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc8147e60 0x7f9fc8128640 secure :-1 s=THROTTLE_DONE pgs=1456 cs=0 l=1 rx=0x7f9fc00032f0 tx=0x7f9fc0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fc4ff9700 1 -- 172.21.15.63:0/576891328 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9fc00101a0 con 0x7f9fc8147e60 2020-05-18T21:38:30.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.824+0000 7f9fc7fff700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc8147e60 0x7f9fc8128640 secure :-1 s=THROTTLE_DONE pgs=1456 cs=0 l=1 rx=0x7f9fc00032f0 tx=0x7f9fc0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.828+0000 7f9fc4ff9700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9fac04fd40 0x7f9fac052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:30.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.828+0000 7f9fc4ff9700 1 -- 172.21.15.63:0/576891328 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9fc0063fb0 con 0x7f9fc8147e60 2020-05-18T21:38:30.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.828+0000 7f9fc77fe700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9fac04fd40 0x7f9fac052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:30.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.828+0000 7f9fc77fe700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9fac04fd40 0x7f9fac052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9fc8060650 tx=0x7f9fb8003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.828+0000 7f9fc77fe700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9fac04fd40 0x7f9fac052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9fc8060650 tx=0x7f9fb8003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.828+0000 7f9fc77fe700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9fac04fd40 0x7f9fac052200 secure :-1 s=READY pgs=853 cs=0 l=1 rx=0x7f9fc8060650 tx=0x7f9fb8003e60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:30.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.836+0000 7f9fc7fff700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc8147e60 0x7f9fc8128640 secure :-1 s=THROTTLE_DONE pgs=1456 cs=0 l=1 rx=0x7f9fc00032f0 tx=0x7f9fc0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.842 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.836+0000 7f9fc4ff9700 1 -- 172.21.15.63:0/576891328 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9fc003e2e0 con 0x7f9fc8147e60 2020-05-18T21:38:30.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.952+0000 7f9fcdb98700 1 -- 172.21.15.63:0/576891328 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fc8066060 con 0x7f9fc8147e60 2020-05-18T21:38:30.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.956+0000 7f9fc7fff700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc8147e60 0x7f9fc8128640 secure :-1 s=THROTTLE_DONE pgs=1456 cs=0 l=1 rx=0x7f9fc00032f0 tx=0x7f9fc0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:30.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.956+0000 7f9fc4ff9700 1 -- 172.21.15.63:0/576891328 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+16116 (secure 0 0 0) 0x7f9fc0041900 con 0x7f9fc8147e60 2020-05-18T21:38:30.964 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:30.964 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":166,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:38:30.427145+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:38:28.730444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2020-05-18T21:38:29.414568+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:38:30.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.960+0000 7f9fcdb98700 1 -- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9fac04fd40 msgr2=0x7f9fac052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.960+0000 7f9fcdb98700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9fac04fd40 0x7f9fac052200 secure :-1 s=READY pgs=853 cs=0 l=1 rx=0x7f9fc8060650 tx=0x7f9fb8003e60).stop 2020-05-18T21:38:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.960+0000 7f9fcdb98700 1 -- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc8147e60 msgr2=0x7f9fc8128640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.960+0000 7f9fcdb98700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc8147e60 0x7f9fc8128640 secure :-1 s=READY pgs=1456 cs=0 l=1 rx=0x7f9fc00032f0 tx=0x7f9fc0010d60).stop 2020-05-18T21:38:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.960+0000 7f9fcdb98700 1 -- 172.21.15.63:0/576891328 shutdown_connections 2020-05-18T21:38:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.960+0000 7f9fcdb98700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9fac04fd40 0x7f9fac052200 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.960+0000 7f9fcdb98700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fc8147e60 0x7f9fc8128640 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:30.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.960+0000 7f9fcdb98700 1 --2- 172.21.15.63:0/576891328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fc8060b90 0x7f9fc8128e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:30.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.960+0000 7f9fcdb98700 1 -- 172.21.15.63:0/576891328 >> 172.21.15.63:0/576891328 conn(0x7f9fc80b83d0 msgr2=0x7f9fc80b7900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:30.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.960+0000 7f9fcdb98700 1 -- 172.21.15.63:0/576891328 shutdown_connections 2020-05-18T21:38:30.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:30.960+0000 7f9fcdb98700 1 -- 172.21.15.63:0/576891328 wait complete. 2020-05-18T21:38:30.981 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-05-18T21:38:31.091 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.084+0000 7fc9b8928700 1 Processor -- start 2020-05-18T21:38:31.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.084+0000 7fc9b8928700 1 -- start start 2020-05-18T21:38:31.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.084+0000 7fc9b8928700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc9b4061180 0x7fc9b406a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:31.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.084+0000 7fc9b8928700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b406a7d0 con 0x7fc9b40b4f40 2020-05-18T21:38:31.094 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.084+0000 7fc9b8928700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b40b2a10 con 0x7fc9b40b2eb0 2020-05-18T21:38:31.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.084+0000 7fc9b8928700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b40b5320 con 0x7fc9b4061180 2020-05-18T21:38:31.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.084+0000 7fc9b2ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc9b4061180 0x7fc9b406a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:31.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.084+0000 7fc9b37fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc9b40b4f40 0x7fc9b4132360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39094/0 (socket says 172.21.15.63:39094) 2020-05-18T21:38:31.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.084+0000 7fc9b37fe700 1 -- 172.21.15.63:0/1933389786 learned_addr learned my addr 172.21.15.63:0/1933389786 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:31.095 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b2ffd700 1 -- 172.21.15.63:0/1933389786 >> v1:172.21.15.155:6789/0 conn(0x7fc9b40b2eb0 legacy=0x7fc9b40b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:31.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b2ffd700 1 -- 172.21.15.63:0/1933389786 >> v1:172.21.15.63:6789/0 conn(0x7fc9b40b4f40 legacy=0x7fc9b4132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:31.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b27fc700 1 -- 172.21.15.63:0/1933389786 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436094036 0 0) 0x7fc9b406a7d0 con 0x7fc9b40b4f40 2020-05-18T21:38:31.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b2ffd700 1 -- 172.21.15.63:0/1933389786 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b41337f0 con 0x7fc9b4061180 2020-05-18T21:38:31.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b2ffd700 1 --2- 172.21.15.63:0/1933389786 >> v2:172.21.15.63:3300/0 conn(0x7fc9b4061180 0x7fc9b406a2c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc9a4002f70 tx=0x7fc9a4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b2ffd700 1 --2- 172.21.15.63:0/1933389786 >> v2:172.21.15.63:3300/0 conn(0x7fc9b4061180 0x7fc9b406a2c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc9a4002f70 tx=0x7fc9a4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b2ffd700 1 --2- 172.21.15.63:0/1933389786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b4061180 0x7fc9b406a2c0 secure :-1 s=READY pgs=2171 cs=0 l=1 rx=0x7fc9a4002f70 tx=0x7fc9a4007a80).ready entity=mon.0 client_cookie=471fa3a53fe40c3f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:31.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b2ffd700 1 --2- 172.21.15.63:0/1933389786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b4061180 0x7fc9b406a2c0 secure :-1 s=THROTTLE_DONE pgs=2171 cs=0 l=1 rx=0x7fc9a4002f70 tx=0x7fc9a4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b2ffd700 1 --2- 172.21.15.63:0/1933389786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b4061180 0x7fc9b406a2c0 secure :-1 s=THROTTLE_DONE pgs=2171 cs=0 l=1 rx=0x7fc9a4002f70 tx=0x7fc9a4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b27fc700 1 -- 172.21.15.63:0/1933389786 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9a4008e80 con 0x7fc9b4061180 2020-05-18T21:38:31.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b2ffd700 1 --2- 172.21.15.63:0/1933389786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b4061180 0x7fc9b406a2c0 secure :-1 s=THROTTLE_DONE pgs=2171 cs=0 l=1 rx=0x7fc9a4002f70 tx=0x7fc9a4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b27fc700 1 -- 172.21.15.63:0/1933389786 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a40116a0 con 0x7fc9b4061180 2020-05-18T21:38:31.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b27fc700 1 -- 172.21.15.63:0/1933389786 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9a4011ac0 con 0x7fc9b4061180 2020-05-18T21:38:31.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b8928700 1 -- 172.21.15.63:0/1933389786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b4061180 msgr2=0x7fc9b406a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:31.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b8928700 1 --2- 172.21.15.63:0/1933389786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b4061180 0x7fc9b406a2c0 secure :-1 s=READY pgs=2171 cs=0 l=1 rx=0x7fc9a4002f70 tx=0x7fc9a4007a80).stop 2020-05-18T21:38:31.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b8928700 1 -- 172.21.15.63:0/1933389786 shutdown_connections 2020-05-18T21:38:31.103 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b8928700 1 --2- 172.21.15.63:0/1933389786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b4061180 0x7fc9b406a2c0 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:31.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b8928700 1 -- 172.21.15.63:0/1933389786 >> 172.21.15.63:0/1933389786 conn(0x7fc9b405fbd0 msgr2=0x7fc9b4069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:31.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b8928700 1 -- 172.21.15.63:0/1933389786 shutdown_connections 2020-05-18T21:38:31.104 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b8928700 1 -- 172.21.15.63:0/1933389786 wait complete. 2020-05-18T21:38:31.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b8928700 1 Processor -- start 2020-05-18T21:38:31.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b8928700 1 -- start start 2020-05-18T21:38:31.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b8928700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b40b4f40 0x7fc9b414cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:31.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b8928700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b40ae1c0 con 0x7fc9b40b2eb0 2020-05-18T21:38:31.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b8928700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b40b1ed0 con 0x7fc9b4061180 2020-05-18T21:38:31.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b8928700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b40b2170 con 0x7fc9b40b4f40 2020-05-18T21:38:31.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b2ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc9b40b2eb0 0x7fc9b412e3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39102/0 (socket says 172.21.15.63:39102) 2020-05-18T21:38:31.106 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b2ffd700 1 -- 172.21.15.63:0/3003802163 learned_addr learned my addr 172.21.15.63:0/3003802163 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:31.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.088+0000 7fc9b3fff700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b40b4f40 0x7fc9b414cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:31.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b0ff9700 1 -- 172.21.15.63:0/3003802163 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601119077 0 0) 0x7fc9b41337f0 con 0x7fc9b40b2eb0 2020-05-18T21:38:31.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b0ff9700 1 -- 172.21.15.63:0/3003802163 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc998002fe0 con 0x7fc9b40b2eb0 2020-05-18T21:38:31.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b0ff9700 1 -- 172.21.15.63:0/3003802163 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778439339 0 0) 0x7fc9b40b1ed0 con 0x7fc9b4061180 2020-05-18T21:38:31.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b0ff9700 1 -- 172.21.15.63:0/3003802163 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9b41337f0 con 0x7fc9b4061180 2020-05-18T21:38:31.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b0ff9700 1 -- 172.21.15.63:0/3003802163 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3528734407 0 0) 0x7fc998002fe0 con 0x7fc9b40b2eb0 2020-05-18T21:38:31.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b0ff9700 1 -- 172.21.15.63:0/3003802163 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc9b40b1ed0 con 0x7fc9b40b2eb0 2020-05-18T21:38:31.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b0ff9700 1 -- 172.21.15.63:0/3003802163 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fc9a4008e80 con 0x7fc9b40b2eb0 2020-05-18T21:38:31.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b3fff700 1 -- 172.21.15.63:0/3003802163 >> v1:172.21.15.155:6789/0 conn(0x7fc9b4061180 legacy=0x7fc9b40adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:31.108 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b3fff700 1 -- 172.21.15.63:0/3003802163 >> v1:172.21.15.63:6789/0 conn(0x7fc9b40b2eb0 legacy=0x7fc9b412e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:31.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b3fff700 1 -- 172.21.15.63:0/3003802163 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b40b1bc0 con 0x7fc9b40b4f40 2020-05-18T21:38:31.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b3fff700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b40b4f40 0x7fc9b414cab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9b4060430 tx=0x7fc9ac010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b3fff700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b40b4f40 0x7fc9b414cab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9b4060430 tx=0x7fc9ac010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b3fff700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b40b4f40 0x7fc9b414cab0 secure :-1 s=READY pgs=335 cs=0 l=1 rx=0x7fc9b4060430 tx=0x7fc9ac010be0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:31.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b3fff700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b40b4f40 0x7fc9b414cab0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fc9b4060430 tx=0x7fc9ac010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b0ff9700 1 -- 172.21.15.63:0/3003802163 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9ac006d70 con 0x7fc9b40b4f40 2020-05-18T21:38:31.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b3fff700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b40b4f40 0x7fc9b414cab0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fc9b4060430 tx=0x7fc9ac010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b3fff700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b40b4f40 0x7fc9b414cab0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fc9b4060430 tx=0x7fc9ac010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b0ff9700 1 -- 172.21.15.63:0/3003802163 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac002260 con 0x7fc9b40b4f40 2020-05-18T21:38:31.110 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b8928700 1 -- 172.21.15.63:0/3003802163 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b412eac0 con 0x7fc9b40b4f40 2020-05-18T21:38:31.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b0ff9700 1 -- 172.21.15.63:0/3003802163 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9ac002600 con 0x7fc9b40b4f40 2020-05-18T21:38:31.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b8928700 1 -- 172.21.15.63:0/3003802163 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b4063b30 con 0x7fc9b40b4f40 2020-05-18T21:38:31.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b3fff700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b40b4f40 0x7fc9b414cab0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fc9b4060430 tx=0x7fc9ac010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b8928700 1 -- 172.21.15.63:0/3003802163 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b40569e0 con 0x7fc9b40b4f40 2020-05-18T21:38:31.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b0ff9700 1 -- 172.21.15.63:0/3003802163 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fc9ac003080 con 0x7fc9b40b4f40 2020-05-18T21:38:31.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b3fff700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b40b4f40 0x7fc9b414cab0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fc9b4060430 tx=0x7fc9ac010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b0ff9700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc998050160 0x7fc998052620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:31.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.092+0000 7fc9b0ff9700 1 -- 172.21.15.63:0/3003802163 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc9ac063980 con 0x7fc9b40b4f40 2020-05-18T21:38:31.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.096+0000 7fc9b37fe700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc998050160 0x7fc998052620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:31.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.096+0000 7fc9b37fe700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc998050160 0x7fc998052620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc99c000f20 tx=0x7fc99c001690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.096+0000 7fc9b37fe700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc998050160 0x7fc998052620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc99c000f20 tx=0x7fc99c001690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.096+0000 7fc9b37fe700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc998050160 0x7fc998052620 secure :-1 s=READY pgs=854 cs=0 l=1 rx=0x7fc99c000f20 tx=0x7fc99c001690).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:31.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.104+0000 7fc9b3fff700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b40b4f40 0x7fc9b414cab0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fc9b4060430 tx=0x7fc9ac010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.104+0000 7fc9b0ff9700 1 -- 172.21.15.63:0/3003802163 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fc9ac03dcb0 con 0x7fc9b40b4f40 2020-05-18T21:38:31.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.252+0000 7fc9b8928700 1 -- 172.21.15.63:0/3003802163 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc9b40b22b0 con 0x7fc9b40b4f40 2020-05-18T21:38:31.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.432+0000 7fc9b3fff700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b40b4f40 0x7fc9b414cab0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fc9b4060430 tx=0x7fc9ac010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.441 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.432+0000 7fc9b0ff9700 1 -- 172.21.15.63:0/3003802163 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v150) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc9ac0412d0 con 0x7fc9b40b4f40 2020-05-18T21:38:31.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.436+0000 7fc9b8928700 1 -- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc998050160 msgr2=0x7fc998052620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:31.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.436+0000 7fc9b8928700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc998050160 0x7fc998052620 secure :-1 s=READY pgs=854 cs=0 l=1 rx=0x7fc99c000f20 tx=0x7fc99c001690).stop 2020-05-18T21:38:31.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.436+0000 7fc9b8928700 1 -- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b40b4f40 msgr2=0x7fc9b414cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:31.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.436+0000 7fc9b8928700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b40b4f40 0x7fc9b414cab0 secure :-1 s=READY pgs=335 cs=0 l=1 rx=0x7fc9b4060430 tx=0x7fc9ac010be0).stop 2020-05-18T21:38:31.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.436+0000 7fc9b8928700 1 -- 172.21.15.63:0/3003802163 shutdown_connections 2020-05-18T21:38:31.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.436+0000 7fc9b8928700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fc998050160 0x7fc998052620 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:31.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.436+0000 7fc9b8928700 1 --2- 172.21.15.63:0/3003802163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b40b4f40 0x7fc9b414cab0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:31.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.436+0000 7fc9b8928700 1 -- 172.21.15.63:0/3003802163 >> 172.21.15.63:0/3003802163 conn(0x7fc9b405fbd0 msgr2=0x7fc9b40b82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:31.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.436+0000 7fc9b8928700 1 -- 172.21.15.63:0/3003802163 shutdown_connections 2020-05-18T21:38:31.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.436+0000 7fc9b8928700 1 -- 172.21.15.63:0/3003802163 wait complete. 2020-05-18T21:38:31.460 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:38:31.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d8ddbe700 1 Processor -- start 2020-05-18T21:38:31.574 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d8ddbe700 1 -- start start 2020-05-18T21:38:31.581 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d8ddbe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8d880b5ea0 0x7f8d88146db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:31.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d8ddbe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d8814a230 0x7f8d880b8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:31.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d8ddbe700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d88147210 con 0x7f8d88069eb0 2020-05-18T21:38:31.582 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d8ddbe700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d881463d0 con 0x7f8d880b5ea0 2020-05-18T21:38:31.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d8ddbe700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d88146670 con 0x7f8d8814a230 2020-05-18T21:38:31.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d877fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8d88069eb0 0x7f8d8812f1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39108/0 (socket says 172.21.15.63:39108) 2020-05-18T21:38:31.583 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d86ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8d880b5ea0 0x7f8d88146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:31.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d877fe700 1 -- 172.21.15.63:0/3088213816 learned_addr learned my addr 172.21.15.63:0/3088213816 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:31.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d87fff700 1 --2- 172.21.15.63:0/3088213816 >> v2:172.21.15.155:3300/0 conn(0x7f8d8814a230 0x7f8d880b8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:31.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d86ffd700 1 -- 172.21.15.63:0/3088213816 >> v2:172.21.15.155:3300/0 conn(0x7f8d8814a230 msgr2=0x7f8d880b8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:31.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d86ffd700 1 --2- 172.21.15.63:0/3088213816 >> v2:172.21.15.155:3300/0 conn(0x7f8d8814a230 0x7f8d880b8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:31.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d86ffd700 1 -- 172.21.15.63:0/3088213816 >> v1:172.21.15.63:6789/0 conn(0x7f8d88069eb0 legacy=0x7f8d8812f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:31.585 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d86ffd700 1 -- 172.21.15.63:0/3088213816 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d88146910 con 0x7f8d880b5ea0 2020-05-18T21:38:31.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d86ffd700 1 --2- 172.21.15.63:0/3088213816 >> v2:172.21.15.63:3300/0 conn(0x7f8d880b5ea0 0x7f8d88146db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8d7c002f70 tx=0x7f8d7c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d86ffd700 1 --2- 172.21.15.63:0/3088213816 >> v2:172.21.15.63:3300/0 conn(0x7f8d880b5ea0 0x7f8d88146db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8d7c002f70 tx=0x7f8d7c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.586 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d86ffd700 1 --2- 172.21.15.63:0/3088213816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d880b5ea0 0x7f8d88146db0 secure :-1 s=READY pgs=2174 cs=0 l=1 rx=0x7f8d7c002f70 tx=0x7f8d7c007a80).ready entity=mon.0 client_cookie=7c8a3b233c3a0ac1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:31.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d86ffd700 1 --2- 172.21.15.63:0/3088213816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d880b5ea0 0x7f8d88146db0 secure :-1 s=THROTTLE_DONE pgs=2174 cs=0 l=1 rx=0x7f8d7c002f70 tx=0x7f8d7c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d86ffd700 1 --2- 172.21.15.63:0/3088213816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d880b5ea0 0x7f8d88146db0 secure :-1 s=THROTTLE_DONE pgs=2174 cs=0 l=1 rx=0x7f8d7c002f70 tx=0x7f8d7c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d867fc700 1 -- 172.21.15.63:0/3088213816 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d7c008e50 con 0x7f8d880b5ea0 2020-05-18T21:38:31.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d86ffd700 1 --2- 172.21.15.63:0/3088213816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d880b5ea0 0x7f8d88146db0 secure :-1 s=THROTTLE_DONE pgs=2174 cs=0 l=1 rx=0x7f8d7c002f70 tx=0x7f8d7c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d867fc700 1 -- 172.21.15.63:0/3088213816 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7c0116a0 con 0x7f8d880b5ea0 2020-05-18T21:38:31.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d867fc700 1 -- 172.21.15.63:0/3088213816 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d7c011ac0 con 0x7f8d880b5ea0 2020-05-18T21:38:31.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d8ddbe700 1 -- 172.21.15.63:0/3088213816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d880b5ea0 msgr2=0x7f8d88146db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:31.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d8ddbe700 1 --2- 172.21.15.63:0/3088213816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d880b5ea0 0x7f8d88146db0 secure :-1 s=READY pgs=2174 cs=0 l=1 rx=0x7f8d7c002f70 tx=0x7f8d7c007a80).stop 2020-05-18T21:38:31.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d8ddbe700 1 -- 172.21.15.63:0/3088213816 shutdown_connections 2020-05-18T21:38:31.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d8ddbe700 1 --2- 172.21.15.63:0/3088213816 >> v2:172.21.15.155:3300/0 conn(0x7f8d8814a230 0x7f8d880b8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:31.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d8ddbe700 1 --2- 172.21.15.63:0/3088213816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d880b5ea0 0x7f8d88146db0 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:31.590 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d8ddbe700 1 -- 172.21.15.63:0/3088213816 >> 172.21.15.63:0/3088213816 conn(0x7f8d88066ed0 msgr2=0x7f8d880b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:31.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d8ddbe700 1 -- 172.21.15.63:0/3088213816 shutdown_connections 2020-05-18T21:38:31.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.568+0000 7f8d8ddbe700 1 -- 172.21.15.63:0/3088213816 wait complete. 2020-05-18T21:38:31.591 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d8ddbe700 1 Processor -- start 2020-05-18T21:38:31.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d8ddbe700 1 -- start start 2020-05-18T21:38:31.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d8ddbe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8d8814a230 0x7f8d88156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:31.592 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d8ddbe700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d88154720 con 0x7f8d88069eb0 2020-05-18T21:38:31.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d8ddbe700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d881541e0 con 0x7f8d880b5ea0 2020-05-18T21:38:31.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d8ddbe700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8812be50 con 0x7f8d8814a230 2020-05-18T21:38:31.593 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d87fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8d8814a230 0x7f8d88156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:31.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d877fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8d88069eb0 0x7f8d881486f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39114/0 (socket says 172.21.15.63:39114) 2020-05-18T21:38:31.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d877fe700 1 -- 172.21.15.63:0/4106420659 learned_addr learned my addr 172.21.15.63:0/4106420659 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:31.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d87fff700 1 -- 172.21.15.63:0/4106420659 >> v1:172.21.15.155:6789/0 conn(0x7f8d880b5ea0 legacy=0x7f8d881538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:31.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d87fff700 1 -- 172.21.15.63:0/4106420659 >> v1:172.21.15.63:6789/0 conn(0x7f8d88069eb0 legacy=0x7f8d881486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:31.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d87fff700 1 -- 172.21.15.63:0/4106420659 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d88154480 con 0x7f8d8814a230 2020-05-18T21:38:31.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d84ff9700 1 -- 172.21.15.63:0/4106420659 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590388539 0 0) 0x7f8d88154720 con 0x7f8d88069eb0 2020-05-18T21:38:31.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d87fff700 1 --2- 172.21.15.63:0/4106420659 >> v2:172.21.15.63:3300/0 conn(0x7f8d8814a230 0x7f8d88156f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d78002f70 tx=0x7f8d78010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d87fff700 1 --2- 172.21.15.63:0/4106420659 >> v2:172.21.15.63:3300/0 conn(0x7f8d8814a230 0x7f8d88156f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d78002f70 tx=0x7f8d78010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d87fff700 1 --2- 172.21.15.63:0/4106420659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d8814a230 0x7f8d88156f80 secure :-1 s=READY pgs=2176 cs=0 l=1 rx=0x7f8d78002f70 tx=0x7f8d78010bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:31.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d87fff700 1 --2- 172.21.15.63:0/4106420659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d8814a230 0x7f8d88156f80 secure :-1 s=THROTTLE_DONE pgs=2176 cs=0 l=1 rx=0x7f8d78002f70 tx=0x7f8d78010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d84ff9700 1 -- 172.21.15.63:0/4106420659 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d78005ae0 con 0x7f8d8814a230 2020-05-18T21:38:31.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d87fff700 1 --2- 172.21.15.63:0/4106420659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d8814a230 0x7f8d88156f80 secure :-1 s=THROTTLE_DONE pgs=2176 cs=0 l=1 rx=0x7f8d78002f70 tx=0x7f8d78010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d87fff700 1 --2- 172.21.15.63:0/4106420659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d8814a230 0x7f8d88156f80 secure :-1 s=THROTTLE_DONE pgs=2176 cs=0 l=1 rx=0x7f8d78002f70 tx=0x7f8d78010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d84ff9700 1 -- 172.21.15.63:0/4106420659 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d78005c40 con 0x7f8d8814a230 2020-05-18T21:38:31.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d8ddbe700 1 -- 172.21.15.63:0/4106420659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d881573e0 con 0x7f8d8814a230 2020-05-18T21:38:31.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d84ff9700 1 -- 172.21.15.63:0/4106420659 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d78012670 con 0x7f8d8814a230 2020-05-18T21:38:31.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.572+0000 7f8d8ddbe700 1 -- 172.21.15.63:0/4106420659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d88157910 con 0x7f8d8814a230 2020-05-18T21:38:31.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.576+0000 7f8d87fff700 1 --2- 172.21.15.63:0/4106420659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d8814a230 0x7f8d88156f80 secure :-1 s=THROTTLE_DONE pgs=2176 cs=0 l=1 rx=0x7f8d78002f70 tx=0x7f8d78010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.601 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.576+0000 7f8d8ddbe700 1 -- 172.21.15.63:0/4106420659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d88153fe0 con 0x7f8d8814a230 2020-05-18T21:38:31.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.576+0000 7f8d84ff9700 1 -- 172.21.15.63:0/4106420659 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8d780071a0 con 0x7f8d8814a230 2020-05-18T21:38:31.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.576+0000 7f8d87fff700 1 --2- 172.21.15.63:0/4106420659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d8814a230 0x7f8d88156f80 secure :-1 s=THROTTLE_DONE pgs=2176 cs=0 l=1 rx=0x7f8d78002f70 tx=0x7f8d78010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.602 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.576+0000 7f8d84ff9700 1 --2- 172.21.15.63:0/4106420659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d6804f920 0x7f8d68051de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:31.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.576+0000 7f8d84ff9700 1 -- 172.21.15.63:0/4106420659 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8d7800f0b0 con 0x7f8d8814a230 2020-05-18T21:38:31.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.576+0000 7f8d877fe700 1 --2- 172.21.15.63:0/4106420659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d6804f920 0x7f8d68051de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:31.603 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.576+0000 7f8d877fe700 1 --2- 172.21.15.63:0/4106420659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d6804f920 0x7f8d68051de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d800058c0 tx=0x7f8d80001a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.576+0000 7f8d877fe700 1 --2- 172.21.15.63:0/4106420659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d6804f920 0x7f8d68051de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d800058c0 tx=0x7f8d80001a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.576+0000 7f8d877fe700 1 --2- 172.21.15.63:0/4106420659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d6804f920 0x7f8d68051de0 secure :-1 s=READY pgs=855 cs=0 l=1 rx=0x7f8d800058c0 tx=0x7f8d80001a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:31.604 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.584+0000 7f8d87fff700 1 --2- 172.21.15.63:0/4106420659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d8814a230 0x7f8d88156f80 secure :-1 s=THROTTLE_DONE pgs=2176 cs=0 l=1 rx=0x7f8d78002f70 tx=0x7f8d78010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.605 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.584+0000 7f8d84ff9700 1 -- 172.21.15.63:0/4106420659 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f8d7803e0e0 con 0x7f8d8814a230 2020-05-18T21:38:31.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.732+0000 7f8d8ddbe700 1 -- 172.21.15.63:0/4106420659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d880569e0 con 0x7f8d8814a230 2020-05-18T21:38:31.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.732+0000 7f8d87fff700 1 --2- 172.21.15.63:0/4106420659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d8814a230 0x7f8d88156f80 secure :-1 s=THROTTLE_DONE pgs=2176 cs=0 l=1 rx=0x7f8d78002f70 tx=0x7f8d78010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.732+0000 7f8d84ff9700 1 -- 172.21.15.63:0/4106420659 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) v1 ==== 95+0+2149 (secure 0 0 0) 0x7f8d78041700 con 0x7f8d8814a230 2020-05-18T21:38:31.741 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:31.742 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":150,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7370,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/726870500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":726870500},{"type":"v1","addr":"172.21.15.63:6833","nonce":726870500}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":149}],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:38:30.427505+0000","modified":"2020-05-18T21:38:31.430511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10348":{"gid":10348,"name":"b","rank":0,"incarnation":149,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/3932257542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3932257542},{"type":"v1","addr":"172.21.15.155:6835","nonce":3932257542}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2020-05-18T21:38:31.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.736+0000 7f8d8ddbe700 1 -- 172.21.15.63:0/4106420659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d6804f920 msgr2=0x7f8d68051de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:31.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.736+0000 7f8d8ddbe700 1 --2- 172.21.15.63:0/4106420659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d6804f920 0x7f8d68051de0 secure :-1 s=READY pgs=855 cs=0 l=1 rx=0x7f8d800058c0 tx=0x7f8d80001a80).stop 2020-05-18T21:38:31.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.736+0000 7f8d8ddbe700 1 -- 172.21.15.63:0/4106420659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d8814a230 msgr2=0x7f8d88156f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:31.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.736+0000 7f8d8ddbe700 1 --2- 172.21.15.63:0/4106420659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d8814a230 0x7f8d88156f80 secure :-1 s=READY pgs=2176 cs=0 l=1 rx=0x7f8d78002f70 tx=0x7f8d78010bb0).stop 2020-05-18T21:38:31.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.736+0000 7f8d8ddbe700 1 -- 172.21.15.63:0/4106420659 shutdown_connections 2020-05-18T21:38:31.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.736+0000 7f8d8ddbe700 1 --2- 172.21.15.63:0/4106420659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8d6804f920 0x7f8d68051de0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:31.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.736+0000 7f8d8ddbe700 1 --2- 172.21.15.63:0/4106420659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d8814a230 0x7f8d88156f80 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:31.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.736+0000 7f8d8ddbe700 1 -- 172.21.15.63:0/4106420659 >> 172.21.15.63:0/4106420659 conn(0x7f8d88066ed0 msgr2=0x7f8d8812c170 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:31.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.736+0000 7f8d8ddbe700 1 -- 172.21.15.63:0/4106420659 shutdown_connections 2020-05-18T21:38:31.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.736+0000 7f8d8ddbe700 1 -- 172.21.15.63:0/4106420659 wait complete. 2020-05-18T21:38:31.745 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 150 2020-05-18T21:38:31.753 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:38:31.854 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47fdd3b700 1 Processor -- start 2020-05-18T21:38:31.855 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47fdd3b700 1 -- start start 2020-05-18T21:38:31.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47fdd3b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f47f80b71b0 0x7f47f80632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:31.857 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47fdd3b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8147100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:31.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47fdd3b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f81440e0 con 0x7f47f8140b60 2020-05-18T21:38:31.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47fdd3b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f8143f00 con 0x7f47f80b71b0 2020-05-18T21:38:31.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47fdd3b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f8144380 con 0x7f47f8144820 2020-05-18T21:38:31.858 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47f7fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:31.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47fd53a700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f47f8140b60 0x7f47f8141010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:37442/0 (socket says 172.21.15.63:37442) 2020-05-18T21:38:31.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47fd53a700 1 -- 172.21.15.63:0/1253314872 learned_addr learned my addr 172.21.15.63:0/1253314872 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:31.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47fcd39700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f47f80b71b0 0x7f47f80632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:31.859 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47f77fe700 1 -- 172.21.15.63:0/1253314872 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919111085 0 0) 0x7f47f81440e0 con 0x7f47f8140b60 2020-05-18T21:38:31.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47f77fe700 1 -- 172.21.15.63:0/1253314872 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47dc003270 con 0x7f47f8140b60 2020-05-18T21:38:31.861 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47f7fff700 1 -- 172.21.15.63:0/1253314872 >> v2:172.21.15.155:3300/0 conn(0x7f47f80b71b0 msgr2=0x7f47f80632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:31.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47f7fff700 1 --2- 172.21.15.63:0/1253314872 >> v2:172.21.15.155:3300/0 conn(0x7f47f80b71b0 0x7f47f80632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:31.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47f7fff700 1 -- 172.21.15.63:0/1253314872 >> v1:172.21.15.155:6789/0 conn(0x7f47f8140b60 legacy=0x7f47f8141010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:31.862 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47f7fff700 1 -- 172.21.15.63:0/1253314872 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f80b7590 con 0x7f47f8144820 2020-05-18T21:38:31.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47f7fff700 1 --2- 172.21.15.63:0/1253314872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8147100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f47e0002f70 tx=0x7f47e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47f7fff700 1 --2- 172.21.15.63:0/1253314872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8147100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f47e0002f70 tx=0x7f47e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.848+0000 7f47f7fff700 1 --2- 172.21.15.63:0/1253314872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8147100 secure :-1 s=READY pgs=336 cs=0 l=1 rx=0x7f47e0002f70 tx=0x7f47e0007a80).ready entity=mon.2 client_cookie=3382bd424aa474dc server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:31.863 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.852+0000 7f47f7fff700 1 --2- 172.21.15.63:0/1253314872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8147100 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f47e0002f70 tx=0x7f47e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.852+0000 7f47f77fe700 1 -- 172.21.15.63:0/1253314872 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47e0008e80 con 0x7f47f8144820 2020-05-18T21:38:31.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.852+0000 7f47f7fff700 1 --2- 172.21.15.63:0/1253314872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8147100 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f47e0002f70 tx=0x7f47e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.852+0000 7f47f7fff700 1 --2- 172.21.15.63:0/1253314872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8147100 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f47e0002f70 tx=0x7f47e0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.852+0000 7f47f77fe700 1 -- 172.21.15.63:0/1253314872 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e0011540 con 0x7f47f8144820 2020-05-18T21:38:31.864 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.852+0000 7f47f77fe700 1 -- 172.21.15.63:0/1253314872 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47e0011920 con 0x7f47f8144820 2020-05-18T21:38:31.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.852+0000 7f47fdd3b700 1 -- 172.21.15.63:0/1253314872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 msgr2=0x7f47f8147100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:31.865 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.852+0000 7f47fdd3b700 1 --2- 172.21.15.63:0/1253314872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8147100 secure :-1 s=READY pgs=336 cs=0 l=1 rx=0x7f47e0002f70 tx=0x7f47e0007a80).stop 2020-05-18T21:38:31.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.852+0000 7f47fdd3b700 1 -- 172.21.15.63:0/1253314872 shutdown_connections 2020-05-18T21:38:31.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.852+0000 7f47fdd3b700 1 --2- 172.21.15.63:0/1253314872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8147100 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:31.869 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.852+0000 7f47fdd3b700 1 --2- 172.21.15.63:0/1253314872 >> v2:172.21.15.155:3300/0 conn(0x7f47f80b71b0 0x7f47f80632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:31.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.852+0000 7f47fdd3b700 1 -- 172.21.15.63:0/1253314872 >> 172.21.15.63:0/1253314872 conn(0x7f47f805eee0 msgr2=0x7f47f805f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:31.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.852+0000 7f47fdd3b700 1 -- 172.21.15.63:0/1253314872 shutdown_connections 2020-05-18T21:38:31.870 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.852+0000 7f47fdd3b700 1 -- 172.21.15.63:0/1253314872 wait complete. 2020-05-18T21:38:31.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.852+0000 7f47fdd3b700 1 Processor -- start 2020-05-18T21:38:31.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.852+0000 7f47fdd3b700 1 -- start start 2020-05-18T21:38:31.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47fdd3b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f47f8140b60 0x7f47f8151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:31.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47fdd3b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8069eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:31.871 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47fdd3b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f80af780 con 0x7f47f80b71b0 2020-05-18T21:38:31.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47fdd3b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f80b0f50 con 0x7f47f8140b60 2020-05-18T21:38:31.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47fdd3b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f8152690 con 0x7f47f8144820 2020-05-18T21:38:31.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47f7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f47f8140b60 0x7f47f8151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:31.872 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47fd53a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8069eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:31.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47f7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f47f8140b60 0x7f47f8151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:51790/0 (socket says 172.21.15.63:51790) 2020-05-18T21:38:31.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47f7fff700 1 -- 172.21.15.63:0/195232717 learned_addr learned my addr 172.21.15.63:0/195232717 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:31.873 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47fd53a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8069eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:55878/0 (socket says 172.21.15.63:55878) 2020-05-18T21:38:31.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47fd53a700 1 -- 172.21.15.63:0/195232717 >> v2:172.21.15.155:3300/0 conn(0x7f47f8140b60 msgr2=0x7f47f8151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:31.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47fd53a700 1 --2- 172.21.15.63:0/195232717 >> v2:172.21.15.155:3300/0 conn(0x7f47f8140b60 0x7f47f8151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:31.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47fd53a700 1 -- 172.21.15.63:0/195232717 >> v1:172.21.15.155:6789/0 conn(0x7f47f80b71b0 legacy=0x7f47f8151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:31.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47fd53a700 1 -- 172.21.15.63:0/195232717 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f80b0c40 con 0x7f47f8144820 2020-05-18T21:38:31.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47f7fff700 1 --2- 172.21.15.63:0/195232717 >> v2:172.21.15.155:3300/0 conn(0x7f47f8140b60 0x7f47f8151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:38:31.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47fd53a700 1 --2- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8069eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f47f0001490 tx=0x7f47f0010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47fd53a700 1 --2- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8069eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f47f0001490 tx=0x7f47f0010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47fd53a700 1 --2- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8069eb0 secure :-1 s=READY pgs=337 cs=0 l=1 rx=0x7f47f0001490 tx=0x7f47f0010c30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:31.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47fd53a700 1 --2- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8069eb0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7f47f0001490 tx=0x7f47f0010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47fd53a700 1 --2- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8069eb0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7f47f0001490 tx=0x7f47f0010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47f5ffb700 1 -- 172.21.15.63:0/195232717 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47f0005e90 con 0x7f47f8144820 2020-05-18T21:38:31.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47fd53a700 1 --2- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8069eb0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7f47f0001490 tx=0x7f47f0010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47f5ffb700 1 -- 172.21.15.63:0/195232717 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f00124c0 con 0x7f47f8144820 2020-05-18T21:38:31.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47fdd3b700 1 -- 172.21.15.63:0/195232717 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f80af070 con 0x7f47f8144820 2020-05-18T21:38:31.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47f5ffb700 1 -- 172.21.15.63:0/195232717 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47f00128e0 con 0x7f47f8144820 2020-05-18T21:38:31.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.856+0000 7f47fdd3b700 1 -- 172.21.15.63:0/195232717 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f80af520 con 0x7f47f8144820 2020-05-18T21:38:31.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.860+0000 7f47fd53a700 1 --2- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8069eb0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7f47f0001490 tx=0x7f47f0010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.860+0000 7f47fdd3b700 1 -- 172.21.15.63:0/195232717 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f80569e0 con 0x7f47f8144820 2020-05-18T21:38:31.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.860+0000 7f47f5ffb700 1 -- 172.21.15.63:0/195232717 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f47f0012b50 con 0x7f47f8144820 2020-05-18T21:38:31.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.860+0000 7f47fd53a700 1 --2- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8069eb0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7f47f0001490 tx=0x7f47f0010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.860+0000 7f47f5ffb700 1 --2- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47d004f9e0 0x7f47d0051ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:31.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.860+0000 7f47f5ffb700 1 -- 172.21.15.63:0/195232717 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f47f00090c0 con 0x7f47f8144820 2020-05-18T21:38:31.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.860+0000 7f47fcd39700 1 --2- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47d004f9e0 0x7f47d0051ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:31.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.860+0000 7f47fcd39700 1 --2- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47d004f9e0 0x7f47d0051ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f47f806a570 tx=0x7f47f8043b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.860+0000 7f47fcd39700 1 --2- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47d004f9e0 0x7f47d0051ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f47f806a570 tx=0x7f47f8043b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.860+0000 7f47fcd39700 1 --2- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47d004f9e0 0x7f47d0051ea0 secure :-1 s=READY pgs=856 cs=0 l=1 rx=0x7f47f806a570 tx=0x7f47f8043b60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:31.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.868+0000 7f47fd53a700 1 --2- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8069eb0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7f47f0001490 tx=0x7f47f0010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.868+0000 7f47f5ffb700 1 -- 172.21.15.63:0/195232717 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f47f003e660 con 0x7f47f8144820 2020-05-18T21:38:31.994 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.988+0000 7f47fdd3b700 1 -- 172.21.15.63:0/195232717 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47f80008d0 con 0x7f47f8144820 2020-05-18T21:38:31.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.988+0000 7f47fd53a700 1 --2- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8069eb0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7f47f0001490 tx=0x7f47f0010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:31.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.988+0000 7f47f5ffb700 1 -- 172.21.15.63:0/195232717 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f47f0041c80 con 0x7f47f8144820 2020-05-18T21:38:31.997 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:31.997 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":167,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:38:31.431168+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:38:28.730444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2020-05-18T21:38:29.414568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:38:31.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.992+0000 7f47fdd3b700 1 -- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47d004f9e0 msgr2=0x7f47d0051ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:31.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.992+0000 7f47fdd3b700 1 --2- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47d004f9e0 0x7f47d0051ea0 secure :-1 s=READY pgs=856 cs=0 l=1 rx=0x7f47f806a570 tx=0x7f47f8043b60).stop 2020-05-18T21:38:31.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.992+0000 7f47fdd3b700 1 -- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 msgr2=0x7f47f8069eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:31.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.992+0000 7f47fdd3b700 1 --2- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8069eb0 secure :-1 s=READY pgs=337 cs=0 l=1 rx=0x7f47f0001490 tx=0x7f47f0010c30).stop 2020-05-18T21:38:31.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.992+0000 7f47fdd3b700 1 -- 172.21.15.63:0/195232717 shutdown_connections 2020-05-18T21:38:31.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.992+0000 7f47fdd3b700 1 --2- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f47d004f9e0 0x7f47d0051ea0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:31.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.992+0000 7f47fdd3b700 1 --2- 172.21.15.63:0/195232717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f8144820 0x7f47f8069eb0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:32.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.992+0000 7f47fdd3b700 1 --2- 172.21.15.63:0/195232717 >> v2:172.21.15.155:3300/0 conn(0x7f47f8140b60 0x7f47f8151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:32.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.992+0000 7f47fdd3b700 1 -- 172.21.15.63:0/195232717 >> 172.21.15.63:0/195232717 conn(0x7f47f805eee0 msgr2=0x7f47f80b5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:32.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.992+0000 7f47fdd3b700 1 -- 172.21.15.63:0/195232717 shutdown_connections 2020-05-18T21:38:32.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:31.992+0000 7f47fdd3b700 1 -- 172.21.15.63:0/195232717 wait complete. 2020-05-18T21:38:32.010 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:38:32.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.112+0000 7f0482950700 1 Processor -- start 2020-05-18T21:38:32.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.112+0000 7f0482950700 1 -- start start 2020-05-18T21:38:32.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f0482950700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f047c0b5cb0 0x7f047c0b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:32.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f0482950700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f047c151bc0 0x7f047c152030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:32.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f0482950700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047c025500 con 0x7f047c0b6410 2020-05-18T21:38:32.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f0482950700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047c064ee0 con 0x7f047c0b5cb0 2020-05-18T21:38:32.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f0482950700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047c0b67f0 con 0x7f047c151bc0 2020-05-18T21:38:32.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f048194e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f047c0b5cb0 0x7f047c0b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:32.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f048194e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f047c0b5cb0 0x7f047c0b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36948/0 (socket says 172.21.15.63:36948) 2020-05-18T21:38:32.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f048194e700 1 -- 172.21.15.63:0/2709563582 learned_addr learned my addr 172.21.15.63:0/2709563582 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:32.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f0483bb2700 1 --2- 172.21.15.63:0/2709563582 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f047c151bc0 0x7f047c152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:32.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f048194e700 1 -- 172.21.15.63:0/2709563582 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f047c151bc0 msgr2=0x7f047c152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:32.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f048194e700 1 --2- 172.21.15.63:0/2709563582 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f047c151bc0 0x7f047c152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:32.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f048194e700 1 -- 172.21.15.63:0/2709563582 >> v1:172.21.15.155:6789/0 conn(0x7f047c0b6410 legacy=0x7f047c061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f048194e700 1 -- 172.21.15.63:0/2709563582 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c025180 con 0x7f047c0b5cb0 2020-05-18T21:38:32.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f048194e700 1 --2- 172.21.15.63:0/2709563582 >> v2:172.21.15.63:3300/0 conn(0x7f047c0b5cb0 0x7f047c0b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0470002f70 tx=0x7f0470007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f048194e700 1 --2- 172.21.15.63:0/2709563582 >> v2:172.21.15.63:3300/0 conn(0x7f047c0b5cb0 0x7f047c0b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0470002f70 tx=0x7f0470007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f048194e700 1 --2- 172.21.15.63:0/2709563582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f047c0b5cb0 0x7f047c0b6cd0 secure :-1 s=READY pgs=2177 cs=0 l=1 rx=0x7f0470002f70 tx=0x7f0470007a80).ready entity=mon.0 client_cookie=8f6c8ec68273378a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:32.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f048194e700 1 --2- 172.21.15.63:0/2709563582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f047c0b5cb0 0x7f047c0b6cd0 secure :-1 s=THROTTLE_DONE pgs=2177 cs=0 l=1 rx=0x7f0470002f70 tx=0x7f0470007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f048114d700 1 -- 172.21.15.63:0/2709563582 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04700116b0 con 0x7f047c0b5cb0 2020-05-18T21:38:32.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f048194e700 1 --2- 172.21.15.63:0/2709563582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f047c0b5cb0 0x7f047c0b6cd0 secure :-1 s=THROTTLE_DONE pgs=2177 cs=0 l=1 rx=0x7f0470002f70 tx=0x7f0470007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f048194e700 1 --2- 172.21.15.63:0/2709563582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f047c0b5cb0 0x7f047c0b6cd0 secure :-1 s=THROTTLE_DONE pgs=2177 cs=0 l=1 rx=0x7f0470002f70 tx=0x7f0470007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f048114d700 1 -- 172.21.15.63:0/2709563582 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0470011810 con 0x7f047c0b5cb0 2020-05-18T21:38:32.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f048114d700 1 -- 172.21.15.63:0/2709563582 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0470011c30 con 0x7f047c0b5cb0 2020-05-18T21:38:32.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f0482950700 1 -- 172.21.15.63:0/2709563582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f047c0b5cb0 msgr2=0x7f047c0b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f0482950700 1 --2- 172.21.15.63:0/2709563582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f047c0b5cb0 0x7f047c0b6cd0 secure :-1 s=READY pgs=2177 cs=0 l=1 rx=0x7f0470002f70 tx=0x7f0470007a80).stop 2020-05-18T21:38:32.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f0482950700 1 -- 172.21.15.63:0/2709563582 shutdown_connections 2020-05-18T21:38:32.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f0482950700 1 --2- 172.21.15.63:0/2709563582 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f047c151bc0 0x7f047c152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:32.130 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f0482950700 1 --2- 172.21.15.63:0/2709563582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f047c0b5cb0 0x7f047c0b6cd0 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:32.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f0482950700 1 -- 172.21.15.63:0/2709563582 >> 172.21.15.63:0/2709563582 conn(0x7f047c069b70 msgr2=0x7f047c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:32.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f0482950700 1 -- 172.21.15.63:0/2709563582 shutdown_connections 2020-05-18T21:38:32.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.116+0000 7f0482950700 1 -- 172.21.15.63:0/2709563582 wait complete. 2020-05-18T21:38:32.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f0482950700 1 Processor -- start 2020-05-18T21:38:32.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f0482950700 1 -- start start 2020-05-18T21:38:32.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f0482950700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f047c0b6410 0x7f047c0654b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:32.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f0482950700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f047c151bc0 0x7f047c071a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:32.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f0482950700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047c0b4670 con 0x7f047c0b5cb0 2020-05-18T21:38:32.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f0482950700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047c0b19f0 con 0x7f047c151bc0 2020-05-18T21:38:32.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f0482950700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047c065910 con 0x7f047c0b6410 2020-05-18T21:38:32.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f0483bb2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f047c151bc0 0x7f047c071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:32.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f048214f700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f047c0b5cb0 0x7f047c0b3e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39142/0 (socket says 172.21.15.63:39142) 2020-05-18T21:38:32.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f048214f700 1 -- 172.21.15.63:0/3879566271 learned_addr learned my addr 172.21.15.63:0/3879566271 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:32.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f048194e700 1 --2- 172.21.15.63:0/3879566271 >> v2:172.21.15.155:3300/0 conn(0x7f047c0b6410 0x7f047c0654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:32.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f0483bb2700 1 -- 172.21.15.63:0/3879566271 >> v2:172.21.15.155:3300/0 conn(0x7f047c0b6410 msgr2=0x7f047c0654b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f0483bb2700 1 --2- 172.21.15.63:0/3879566271 >> v2:172.21.15.155:3300/0 conn(0x7f047c0b6410 0x7f047c0654b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:32.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f0483bb2700 1 -- 172.21.15.63:0/3879566271 >> v1:172.21.15.63:6789/0 conn(0x7f047c0b5cb0 legacy=0x7f047c0b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f0483bb2700 1 -- 172.21.15.63:0/3879566271 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c065a80 con 0x7f047c151bc0 2020-05-18T21:38:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f0483bb2700 1 --2- 172.21.15.63:0/3879566271 >> v2:172.21.15.63:3300/0 conn(0x7f047c151bc0 0x7f047c071a30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f046c002f70 tx=0x7f046c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f0483bb2700 1 --2- 172.21.15.63:0/3879566271 >> v2:172.21.15.63:3300/0 conn(0x7f047c151bc0 0x7f047c071a30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f046c002f70 tx=0x7f046c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f0483bb2700 1 --2- 172.21.15.63:0/3879566271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f047c151bc0 0x7f047c071a30 secure :-1 s=READY pgs=2179 cs=0 l=1 rx=0x7f046c002f70 tx=0x7f046c010bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f0483bb2700 1 --2- 172.21.15.63:0/3879566271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f047c151bc0 0x7f047c071a30 secure :-1 s=THROTTLE_DONE pgs=2179 cs=0 l=1 rx=0x7f046c002f70 tx=0x7f046c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.124+0000 7f0483bb2700 1 --2- 172.21.15.63:0/3879566271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f047c151bc0 0x7f047c071a30 secure :-1 s=THROTTLE_DONE pgs=2179 cs=0 l=1 rx=0x7f046c002f70 tx=0x7f046c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.120+0000 7f047affd700 1 -- 172.21.15.63:0/3879566271 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f046c00e8b0 con 0x7f047c151bc0 2020-05-18T21:38:32.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.124+0000 7f0483bb2700 1 --2- 172.21.15.63:0/3879566271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f047c151bc0 0x7f047c071a30 secure :-1 s=THROTTLE_DONE pgs=2179 cs=0 l=1 rx=0x7f046c002f70 tx=0x7f046c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.124+0000 7f047affd700 1 -- 172.21.15.63:0/3879566271 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c00ea10 con 0x7f047c151bc0 2020-05-18T21:38:32.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.124+0000 7f047affd700 1 -- 172.21.15.63:0/3879566271 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f046c00edf0 con 0x7f047c151bc0 2020-05-18T21:38:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.124+0000 7f0482950700 1 -- 172.21.15.63:0/3879566271 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f047c0701c0 con 0x7f047c151bc0 2020-05-18T21:38:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.124+0000 7f0482950700 1 -- 172.21.15.63:0/3879566271 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f047c072030 con 0x7f047c151bc0 2020-05-18T21:38:32.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.124+0000 7f0483bb2700 1 --2- 172.21.15.63:0/3879566271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f047c151bc0 0x7f047c071a30 secure :-1 s=THROTTLE_DONE pgs=2179 cs=0 l=1 rx=0x7f046c002f70 tx=0x7f046c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.124+0000 7f047affd700 1 -- 172.21.15.63:0/3879566271 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f046c007190 con 0x7f047c151bc0 2020-05-18T21:38:32.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.124+0000 7f0482950700 1 -- 172.21.15.63:0/3879566271 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f047c0569e0 con 0x7f047c151bc0 2020-05-18T21:38:32.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.124+0000 7f0483bb2700 1 --2- 172.21.15.63:0/3879566271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f047c151bc0 0x7f047c071a30 secure :-1 s=THROTTLE_DONE pgs=2179 cs=0 l=1 rx=0x7f046c002f70 tx=0x7f046c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.124+0000 7f047affd700 1 --2- 172.21.15.63:0/3879566271 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f045c04fa00 0x7f045c051ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:32.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.124+0000 7f047affd700 1 -- 172.21.15.63:0/3879566271 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f046c063ba0 con 0x7f047c151bc0 2020-05-18T21:38:32.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.124+0000 7f048214f700 1 --2- 172.21.15.63:0/3879566271 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f045c04fa00 0x7f045c051ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:32.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.124+0000 7f048214f700 1 --2- 172.21.15.63:0/3879566271 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f045c04fa00 0x7f045c051ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f047c066130 tx=0x7f04740019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.124+0000 7f048214f700 1 --2- 172.21.15.63:0/3879566271 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f045c04fa00 0x7f045c051ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f047c066130 tx=0x7f04740019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.124+0000 7f048214f700 1 --2- 172.21.15.63:0/3879566271 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f045c04fa00 0x7f045c051ec0 secure :-1 s=READY pgs=857 cs=0 l=1 rx=0x7f047c066130 tx=0x7f04740019d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:32.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.128+0000 7f0483bb2700 1 --2- 172.21.15.63:0/3879566271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f047c151bc0 0x7f047c071a30 secure :-1 s=THROTTLE_DONE pgs=2179 cs=0 l=1 rx=0x7f046c002f70 tx=0x7f046c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.143 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.128+0000 7f047affd700 1 -- 172.21.15.63:0/3879566271 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f046c03df90 con 0x7f047c151bc0 2020-05-18T21:38:32.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.284+0000 7f0482950700 1 -- 172.21.15.63:0/3879566271 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f047c0008d0 con 0x7f047c151bc0 2020-05-18T21:38:32.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.292+0000 7f0483bb2700 1 --2- 172.21.15.63:0/3879566271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f047c151bc0 0x7f047c071a30 secure :-1 s=THROTTLE_DONE pgs=2179 cs=0 l=1 rx=0x7f046c002f70 tx=0x7f046c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.292+0000 7f047affd700 1 -- 172.21.15.63:0/3879566271 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v63) v1 ==== 184+0+0 (secure 0 0 0) 0x7f046c0415b0 con 0x7f047c151bc0 2020-05-18T21:38:32.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.296+0000 7f0482950700 1 -- 172.21.15.63:0/3879566271 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f045c04fa00 msgr2=0x7f045c051ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.296+0000 7f0482950700 1 --2- 172.21.15.63:0/3879566271 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f045c04fa00 0x7f045c051ec0 secure :-1 s=READY pgs=857 cs=0 l=1 rx=0x7f047c066130 tx=0x7f04740019d0).stop 2020-05-18T21:38:32.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.296+0000 7f0482950700 1 -- 172.21.15.63:0/3879566271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f047c151bc0 msgr2=0x7f047c071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.296+0000 7f0482950700 1 --2- 172.21.15.63:0/3879566271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f047c151bc0 0x7f047c071a30 secure :-1 s=READY pgs=2179 cs=0 l=1 rx=0x7f046c002f70 tx=0x7f046c010bb0).stop 2020-05-18T21:38:32.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.296+0000 7f0482950700 1 -- 172.21.15.63:0/3879566271 shutdown_connections 2020-05-18T21:38:32.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.296+0000 7f0482950700 1 --2- 172.21.15.63:0/3879566271 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f045c04fa00 0x7f045c051ec0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:32.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.296+0000 7f0482950700 1 --2- 172.21.15.63:0/3879566271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f047c151bc0 0x7f047c071a30 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:32.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.296+0000 7f0482950700 1 --2- 172.21.15.63:0/3879566271 >> v2:172.21.15.155:3300/0 conn(0x7f047c0b6410 0x7f047c0654b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:32.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.296+0000 7f0482950700 1 -- 172.21.15.63:0/3879566271 >> 172.21.15.63:0/3879566271 conn(0x7f047c069b70 msgr2=0x7f047c024770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:32.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.296+0000 7f0482950700 1 -- 172.21.15.63:0/3879566271 shutdown_connections 2020-05-18T21:38:32.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.296+0000 7f0482950700 1 -- 172.21.15.63:0/3879566271 wait complete. 2020-05-18T21:38:32.305 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.0 2020-05-18T21:38:32.315 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:38:32.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.420+0000 7efda6f99700 1 Processor -- start 2020-05-18T21:38:32.433 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.420+0000 7efda6f99700 1 -- start start 2020-05-18T21:38:32.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.420+0000 7efda6f99700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda00ad070 0x7efda0156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:32.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.420+0000 7efda6f99700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda0065a70 con 0x7efda0157260 2020-05-18T21:38:32.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.420+0000 7efda6f99700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda00b9010 con 0x7efda00b8c30 2020-05-18T21:38:32.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.420+0000 7efda6f99700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda00801d0 con 0x7efda00ad070 2020-05-18T21:38:32.434 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.420+0000 7efda5d37700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efda0157260 0x7efda015c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39154/0 (socket says 172.21.15.63:39154) 2020-05-18T21:38:32.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.420+0000 7efda5d37700 1 -- 172.21.15.63:0/1662673504 learned_addr learned my addr 172.21.15.63:0/1662673504 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:32.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.420+0000 7efda4d35700 1 --2- 172.21.15.63:0/1662673504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda00ad070 0x7efda0156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:32.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efd9ffff700 1 -- 172.21.15.63:0/1662673504 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026205847 0 0) 0x7efda0065a70 con 0x7efda0157260 2020-05-18T21:38:32.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efd9ffff700 1 -- 172.21.15.63:0/1662673504 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd88003270 con 0x7efda0157260 2020-05-18T21:38:32.435 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efd9ffff700 1 -- 172.21.15.63:0/1662673504 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877986430 0 0) 0x7efda00b9010 con 0x7efda00b8c30 2020-05-18T21:38:32.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efd9ffff700 1 -- 172.21.15.63:0/1662673504 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efda0065a70 con 0x7efda00b8c30 2020-05-18T21:38:32.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efd9ffff700 1 -- 172.21.15.63:0/1662673504 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1816287907 0 0) 0x7efd88003270 con 0x7efda0157260 2020-05-18T21:38:32.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efda4d35700 1 -- 172.21.15.63:0/1662673504 >> v1:172.21.15.155:6789/0 conn(0x7efda00b8c30 legacy=0x7efda01566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efda4d35700 1 -- 172.21.15.63:0/1662673504 >> v1:172.21.15.63:6789/0 conn(0x7efda0157260 legacy=0x7efda015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.436 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efda4d35700 1 -- 172.21.15.63:0/1662673504 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda005bf00 con 0x7efda00ad070 2020-05-18T21:38:32.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efda4d35700 1 --2- 172.21.15.63:0/1662673504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda00ad070 0x7efda0156e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efd98001110 tx=0x7efd94008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efda4d35700 1 --2- 172.21.15.63:0/1662673504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda00ad070 0x7efda0156e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efd98001110 tx=0x7efd94008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efda4d35700 1 --2- 172.21.15.63:0/1662673504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda00ad070 0x7efda0156e00 secure :-1 s=READY pgs=338 cs=0 l=1 rx=0x7efd98001110 tx=0x7efd94008920).ready entity=mon.2 client_cookie=9cd4d7db3ffe245d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:32.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efda4d35700 1 --2- 172.21.15.63:0/1662673504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda00ad070 0x7efda0156e00 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7efd98001110 tx=0x7efd94008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.437 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efd9ffff700 1 -- 172.21.15.63:0/1662673504 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd98001710 con 0x7efda00ad070 2020-05-18T21:38:32.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efda4d35700 1 --2- 172.21.15.63:0/1662673504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda00ad070 0x7efda0156e00 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7efd98001110 tx=0x7efd94008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efd9ffff700 1 -- 172.21.15.63:0/1662673504 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd94008e80 con 0x7efda00ad070 2020-05-18T21:38:32.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efda4d35700 1 --2- 172.21.15.63:0/1662673504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda00ad070 0x7efda0156e00 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7efd98001110 tx=0x7efd94008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efd9ffff700 1 -- 172.21.15.63:0/1662673504 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd94011440 con 0x7efda00ad070 2020-05-18T21:38:32.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efda6f99700 1 -- 172.21.15.63:0/1662673504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda00ad070 msgr2=0x7efda0156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.438 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efda6f99700 1 --2- 172.21.15.63:0/1662673504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda00ad070 0x7efda0156e00 secure :-1 s=READY pgs=338 cs=0 l=1 rx=0x7efd98001110 tx=0x7efd94008920).stop 2020-05-18T21:38:32.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efda6f99700 1 -- 172.21.15.63:0/1662673504 shutdown_connections 2020-05-18T21:38:32.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efda6f99700 1 --2- 172.21.15.63:0/1662673504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda00ad070 0x7efda0156e00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:32.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efda6f99700 1 -- 172.21.15.63:0/1662673504 >> 172.21.15.63:0/1662673504 conn(0x7efda006a640 msgr2=0x7efda00b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:32.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efda6f99700 1 -- 172.21.15.63:0/1662673504 shutdown_connections 2020-05-18T21:38:32.439 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.424+0000 7efda6f99700 1 -- 172.21.15.63:0/1662673504 wait complete. 2020-05-18T21:38:32.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda6f99700 1 Processor -- start 2020-05-18T21:38:32.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda6f99700 1 -- start start 2020-05-18T21:38:32.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda6f99700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efda00b8c30 0x7efda0062eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:32.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda6f99700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efda0157260 0x7efda014cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:32.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda6f99700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda014d380 con 0x7efda00ad070 2020-05-18T21:38:32.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda6f99700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda0074b80 con 0x7efda0157260 2020-05-18T21:38:32.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda6f99700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda014d620 con 0x7efda00b8c30 2020-05-18T21:38:32.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda5536700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efda00ad070 0x7efda0154c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39156/0 (socket says 172.21.15.63:39156) 2020-05-18T21:38:32.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda5536700 1 -- 172.21.15.63:0/3067141170 learned_addr learned my addr 172.21.15.63:0/3067141170 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:32.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda5d37700 1 --2- 172.21.15.63:0/3067141170 >> v2:172.21.15.63:3300/0 conn(0x7efda0157260 0x7efda014cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:32.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda4d35700 1 --2- 172.21.15.63:0/3067141170 >> v2:172.21.15.155:3300/0 conn(0x7efda00b8c30 0x7efda0062eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:32.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efd9dffb700 1 -- 172.21.15.63:0/3067141170 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307311961 0 0) 0x7efda014d380 con 0x7efda00ad070 2020-05-18T21:38:32.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efd9dffb700 1 -- 172.21.15.63:0/3067141170 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd80003270 con 0x7efda00ad070 2020-05-18T21:38:32.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda5d37700 1 -- 172.21.15.63:0/3067141170 >> v2:172.21.15.155:3300/0 conn(0x7efda00b8c30 msgr2=0x7efda0062eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda5d37700 1 --2- 172.21.15.63:0/3067141170 >> v2:172.21.15.155:3300/0 conn(0x7efda00b8c30 0x7efda0062eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:32.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda5d37700 1 -- 172.21.15.63:0/3067141170 >> v1:172.21.15.63:6789/0 conn(0x7efda00ad070 legacy=0x7efda0154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda5d37700 1 -- 172.21.15.63:0/3067141170 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda0123790 con 0x7efda0157260 2020-05-18T21:38:32.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda5d37700 1 --2- 172.21.15.63:0/3067141170 >> v2:172.21.15.63:3300/0 conn(0x7efda0157260 0x7efda014cd50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efd98000fe0 tx=0x7efd98010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda5d37700 1 --2- 172.21.15.63:0/3067141170 >> v2:172.21.15.63:3300/0 conn(0x7efda0157260 0x7efda014cd50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efd98000fe0 tx=0x7efd98010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda5d37700 1 --2- 172.21.15.63:0/3067141170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efda0157260 0x7efda014cd50 secure :-1 s=READY pgs=2182 cs=0 l=1 rx=0x7efd98000fe0 tx=0x7efd98010c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:32.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda5d37700 1 --2- 172.21.15.63:0/3067141170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efda0157260 0x7efda014cd50 secure :-1 s=THROTTLE_DONE pgs=2182 cs=0 l=1 rx=0x7efd98000fe0 tx=0x7efd98010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda5d37700 1 --2- 172.21.15.63:0/3067141170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efda0157260 0x7efda014cd50 secure :-1 s=THROTTLE_DONE pgs=2182 cs=0 l=1 rx=0x7efd98000fe0 tx=0x7efd98010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efd9dffb700 1 -- 172.21.15.63:0/3067141170 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd9800cc90 con 0x7efda0157260 2020-05-18T21:38:32.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda5d37700 1 --2- 172.21.15.63:0/3067141170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efda0157260 0x7efda014cd50 secure :-1 s=THROTTLE_DONE pgs=2182 cs=0 l=1 rx=0x7efd98000fe0 tx=0x7efd98010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.447 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efd9dffb700 1 -- 172.21.15.63:0/3067141170 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9800cdf0 con 0x7efda0157260 2020-05-18T21:38:32.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda6f99700 1 -- 172.21.15.63:0/3067141170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda01239e0 con 0x7efda0157260 2020-05-18T21:38:32.450 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efd9dffb700 1 -- 172.21.15.63:0/3067141170 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd98004720 con 0x7efda0157260 2020-05-18T21:38:32.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.428+0000 7efda6f99700 1 -- 172.21.15.63:0/3067141170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda00b4fd0 con 0x7efda0157260 2020-05-18T21:38:32.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.432+0000 7efda5d37700 1 --2- 172.21.15.63:0/3067141170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efda0157260 0x7efda014cd50 secure :-1 s=THROTTLE_DONE pgs=2182 cs=0 l=1 rx=0x7efd98000fe0 tx=0x7efd98010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.432+0000 7efda6f99700 1 -- 172.21.15.63:0/3067141170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda00b52e0 con 0x7efda0157260 2020-05-18T21:38:32.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.432+0000 7efd9dffb700 1 -- 172.21.15.63:0/3067141170 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7efd98004990 con 0x7efda0157260 2020-05-18T21:38:32.451 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.432+0000 7efda5d37700 1 --2- 172.21.15.63:0/3067141170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efda0157260 0x7efda014cd50 secure :-1 s=THROTTLE_DONE pgs=2182 cs=0 l=1 rx=0x7efd98000fe0 tx=0x7efd98010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.432+0000 7efd9dffb700 1 --2- 172.21.15.63:0/3067141170 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd8004fd80 0x7efd80052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:32.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.432+0000 7efd9dffb700 1 -- 172.21.15.63:0/3067141170 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efd98063b50 con 0x7efda0157260 2020-05-18T21:38:32.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.432+0000 7efda5536700 1 --2- 172.21.15.63:0/3067141170 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd8004fd80 0x7efd80052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:32.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.432+0000 7efda5536700 1 --2- 172.21.15.63:0/3067141170 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd8004fd80 0x7efd80052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efd90001490 tx=0x7efd90002b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.452 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.436+0000 7efda5536700 1 --2- 172.21.15.63:0/3067141170 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd8004fd80 0x7efd80052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efd90001490 tx=0x7efd90002b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.436+0000 7efda5536700 1 --2- 172.21.15.63:0/3067141170 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd8004fd80 0x7efd80052240 secure :-1 s=READY pgs=858 cs=0 l=1 rx=0x7efd90001490 tx=0x7efd90002b50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:32.453 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.436+0000 7efda5d37700 1 --2- 172.21.15.63:0/3067141170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efda0157260 0x7efda014cd50 secure :-1 s=THROTTLE_DONE pgs=2182 cs=0 l=1 rx=0x7efd98000fe0 tx=0x7efd98010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.454 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.436+0000 7efd9dffb700 1 -- 172.21.15.63:0/3067141170 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7efd9803dee0 con 0x7efda0157260 2020-05-18T21:38:32.596 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.588+0000 7efda6f99700 1 -- 172.21.15.63:0/3067141170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7efda014d1b0 con 0x7efda0157260 2020-05-18T21:38:32.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.600+0000 7efda5d37700 1 --2- 172.21.15.63:0/3067141170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efda0157260 0x7efda014cd50 secure :-1 s=THROTTLE_DONE pgs=2182 cs=0 l=1 rx=0x7efd98000fe0 tx=0x7efd98010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.606 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.600+0000 7efd9dffb700 1 -- 172.21.15.63:0/3067141170 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v64) v1 ==== 184+0+0 (secure 0 0 0) 0x7efd98041500 con 0x7efda0157260 2020-05-18T21:38:32.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.600+0000 7efda6f99700 1 -- 172.21.15.63:0/3067141170 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd8004fd80 msgr2=0x7efd80052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.600+0000 7efda6f99700 1 --2- 172.21.15.63:0/3067141170 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd8004fd80 0x7efd80052240 secure :-1 s=READY pgs=858 cs=0 l=1 rx=0x7efd90001490 tx=0x7efd90002b50).stop 2020-05-18T21:38:32.608 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.600+0000 7efda6f99700 1 -- 172.21.15.63:0/3067141170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efda0157260 msgr2=0x7efda014cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.600+0000 7efda6f99700 1 --2- 172.21.15.63:0/3067141170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efda0157260 0x7efda014cd50 secure :-1 s=READY pgs=2182 cs=0 l=1 rx=0x7efd98000fe0 tx=0x7efd98010c60).stop 2020-05-18T21:38:32.609 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.600+0000 7efda6f99700 1 -- 172.21.15.63:0/3067141170 shutdown_connections 2020-05-18T21:38:32.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.600+0000 7efda6f99700 1 --2- 172.21.15.63:0/3067141170 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd8004fd80 0x7efd80052240 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:32.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.600+0000 7efda6f99700 1 --2- 172.21.15.63:0/3067141170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efda0157260 0x7efda014cd50 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:32.610 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.600+0000 7efda6f99700 1 --2- 172.21.15.63:0/3067141170 >> v2:172.21.15.155:3300/0 conn(0x7efda00b8c30 0x7efda0062eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:32.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.600+0000 7efda6f99700 1 -- 172.21.15.63:0/3067141170 >> 172.21.15.63:0/3067141170 conn(0x7efda006a640 msgr2=0x7efda0135130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:32.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.600+0000 7efda6f99700 1 -- 172.21.15.63:0/3067141170 shutdown_connections 2020-05-18T21:38:32.611 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.600+0000 7efda6f99700 1 -- 172.21.15.63:0/3067141170 wait complete. 2020-05-18T21:38:32.612 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.1 2020-05-18T21:38:32.621 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:38:32.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.724+0000 7f1655bd8700 1 Processor -- start 2020-05-18T21:38:32.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.724+0000 7f1655bd8700 1 -- start start 2020-05-18T21:38:32.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.724+0000 7f1655bd8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f16500b6cd0 0x7f16501522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:32.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.724+0000 7f1655bd8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1650025500 con 0x7f16500b5cb0 2020-05-18T21:38:32.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.724+0000 7f1655bd8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1650064ee0 con 0x7f16500b6410 2020-05-18T21:38:32.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.724+0000 7f1655bd8700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16500b67f0 con 0x7f16500b6cd0 2020-05-18T21:38:32.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.724+0000 7f1656e3a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f16500b6cd0 0x7f16501522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:32.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.724+0000 7f1656e3a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f16500b6cd0 0x7f16501522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36978/0 (socket says 172.21.15.63:36978) 2020-05-18T21:38:32.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.724+0000 7f1654bd6700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f16500b5cb0 0x7f1650151bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39166/0 (socket says 172.21.15.63:39166) 2020-05-18T21:38:32.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.724+0000 7f1656e3a700 1 -- 172.21.15.63:0/860186980 learned_addr learned my addr 172.21.15.63:0/860186980 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:32.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1656e3a700 1 -- 172.21.15.63:0/860186980 >> v1:172.21.15.155:6789/0 conn(0x7f16500b6410 legacy=0x7f1650061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1656e3a700 1 -- 172.21.15.63:0/860186980 >> v1:172.21.15.63:6789/0 conn(0x7f16500b5cb0 legacy=0x7f1650151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1647fff700 1 -- 172.21.15.63:0/860186980 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712204463 0 0) 0x7f1650064ee0 con 0x7f16500b6410 2020-05-18T21:38:32.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1656e3a700 1 -- 172.21.15.63:0/860186980 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1650025180 con 0x7f16500b6cd0 2020-05-18T21:38:32.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1656e3a700 1 --2- 172.21.15.63:0/860186980 >> v2:172.21.15.63:3300/0 conn(0x7f16500b6cd0 0x7f16501522d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1640001110 tx=0x7f1648007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1656e3a700 1 --2- 172.21.15.63:0/860186980 >> v2:172.21.15.63:3300/0 conn(0x7f16500b6cd0 0x7f16501522d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1640001110 tx=0x7f1648007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.742 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1656e3a700 1 --2- 172.21.15.63:0/860186980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16500b6cd0 0x7f16501522d0 secure :-1 s=READY pgs=2184 cs=0 l=1 rx=0x7f1640001110 tx=0x7f1648007e00).ready entity=mon.0 client_cookie=e188b80627b3fd36 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:32.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1656e3a700 1 --2- 172.21.15.63:0/860186980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16500b6cd0 0x7f16501522d0 secure :-1 s=THROTTLE_DONE pgs=2184 cs=0 l=1 rx=0x7f1640001110 tx=0x7f1648007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.743 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1647fff700 1 -- 172.21.15.63:0/860186980 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1648010e60 con 0x7f16500b6cd0 2020-05-18T21:38:32.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1656e3a700 1 --2- 172.21.15.63:0/860186980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16500b6cd0 0x7f16501522d0 secure :-1 s=THROTTLE_DONE pgs=2184 cs=0 l=1 rx=0x7f1640001110 tx=0x7f1648007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1656e3a700 1 --2- 172.21.15.63:0/860186980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16500b6cd0 0x7f16501522d0 secure :-1 s=THROTTLE_DONE pgs=2184 cs=0 l=1 rx=0x7f1640001110 tx=0x7f1648007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.744 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1647fff700 1 -- 172.21.15.63:0/860186980 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16480110d0 con 0x7f16500b6cd0 2020-05-18T21:38:32.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1647fff700 1 -- 172.21.15.63:0/860186980 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1648011430 con 0x7f16500b6cd0 2020-05-18T21:38:32.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1655bd8700 1 -- 172.21.15.63:0/860186980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16500b6cd0 msgr2=0x7f16501522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.745 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1655bd8700 1 --2- 172.21.15.63:0/860186980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16500b6cd0 0x7f16501522d0 secure :-1 s=READY pgs=2184 cs=0 l=1 rx=0x7f1640001110 tx=0x7f1648007e00).stop 2020-05-18T21:38:32.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1655bd8700 1 -- 172.21.15.63:0/860186980 shutdown_connections 2020-05-18T21:38:32.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1655bd8700 1 --2- 172.21.15.63:0/860186980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16500b6cd0 0x7f16501522d0 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:32.746 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1655bd8700 1 -- 172.21.15.63:0/860186980 >> 172.21.15.63:0/860186980 conn(0x7f1650069b70 msgr2=0x7f1650069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:32.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1655bd8700 1 -- 172.21.15.63:0/860186980 shutdown_connections 2020-05-18T21:38:32.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.728+0000 7f1655bd8700 1 -- 172.21.15.63:0/860186980 wait complete. 2020-05-18T21:38:32.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1655bd8700 1 Processor -- start 2020-05-18T21:38:32.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1655bd8700 1 -- start start 2020-05-18T21:38:32.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1655bd8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f16500b5cb0 0x7f16500aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:32.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1655bd8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f16500b6cd0 0x7f1650080060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:32.753 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1655bd8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16501205c0 con 0x7f16500b6410 2020-05-18T21:38:32.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1655bd8700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16500ace80 con 0x7f16500b6cd0 2020-05-18T21:38:32.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1655bd8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165011f780 con 0x7f16500b5cb0 2020-05-18T21:38:32.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1656e3a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f16500b6cd0 0x7f1650080060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:32.754 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1656e3a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f16500b6cd0 0x7f1650080060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36986/0 (socket says 172.21.15.63:36986) 2020-05-18T21:38:32.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1656e3a700 1 -- 172.21.15.63:0/1368463926 learned_addr learned my addr 172.21.15.63:0/1368463926 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:32.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f16553d7700 1 --2- 172.21.15.63:0/1368463926 >> v2:172.21.15.155:3300/0 conn(0x7f16500b5cb0 0x7f16500aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:32.755 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1656e3a700 1 -- 172.21.15.63:0/1368463926 >> v2:172.21.15.155:3300/0 conn(0x7f16500b5cb0 msgr2=0x7f16500aca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1656e3a700 1 --2- 172.21.15.63:0/1368463926 >> v2:172.21.15.155:3300/0 conn(0x7f16500b5cb0 0x7f16500aca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:32.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1656e3a700 1 -- 172.21.15.63:0/1368463926 >> v1:172.21.15.155:6789/0 conn(0x7f16500b6410 legacy=0x7f165007f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.756 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1656e3a700 1 -- 172.21.15.63:0/1368463926 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165011fa20 con 0x7f16500b6cd0 2020-05-18T21:38:32.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f16553d7700 1 --2- 172.21.15.63:0/1368463926 >> v2:172.21.15.155:3300/0 conn(0x7f16500b5cb0 0x7f16500aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:38:32.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1656e3a700 1 --2- 172.21.15.63:0/1368463926 >> v2:172.21.15.63:3300/0 conn(0x7f16500b6cd0 0x7f1650080060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1640001110 tx=0x7f1648007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.757 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1656e3a700 1 --2- 172.21.15.63:0/1368463926 >> v2:172.21.15.63:3300/0 conn(0x7f16500b6cd0 0x7f1650080060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1640001110 tx=0x7f1648007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1656e3a700 1 --2- 172.21.15.63:0/1368463926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16500b6cd0 0x7f1650080060 secure :-1 s=READY pgs=2185 cs=0 l=1 rx=0x7f1640001110 tx=0x7f1648007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:32.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1656e3a700 1 --2- 172.21.15.63:0/1368463926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16500b6cd0 0x7f1650080060 secure :-1 s=THROTTLE_DONE pgs=2185 cs=0 l=1 rx=0x7f1640001110 tx=0x7f1648007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1656e3a700 1 --2- 172.21.15.63:0/1368463926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16500b6cd0 0x7f1650080060 secure :-1 s=THROTTLE_DONE pgs=2185 cs=0 l=1 rx=0x7f1640001110 tx=0x7f1648007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1645ffb700 1 -- 172.21.15.63:0/1368463926 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1648008aa0 con 0x7f16500b6cd0 2020-05-18T21:38:32.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1656e3a700 1 --2- 172.21.15.63:0/1368463926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16500b6cd0 0x7f1650080060 secure :-1 s=THROTTLE_DONE pgs=2185 cs=0 l=1 rx=0x7f1640001110 tx=0x7f1648007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1645ffb700 1 -- 172.21.15.63:0/1368463926 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164800f4a0 con 0x7f16500b6cd0 2020-05-18T21:38:32.759 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1645ffb700 1 -- 172.21.15.63:0/1368463926 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f164800f800 con 0x7f16500b6cd0 2020-05-18T21:38:32.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1655bd8700 1 -- 172.21.15.63:0/1368463926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f165011f440 con 0x7f16500b6cd0 2020-05-18T21:38:32.760 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1655bd8700 1 -- 172.21.15.63:0/1368463926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16500b98b0 con 0x7f16500b6cd0 2020-05-18T21:38:32.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.732+0000 7f1656e3a700 1 --2- 172.21.15.63:0/1368463926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16500b6cd0 0x7f1650080060 secure :-1 s=THROTTLE_DONE pgs=2185 cs=0 l=1 rx=0x7f1640001110 tx=0x7f1648007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.736+0000 7f1655bd8700 1 -- 172.21.15.63:0/1368463926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16500569e0 con 0x7f16500b6cd0 2020-05-18T21:38:32.761 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.736+0000 7f1645ffb700 1 -- 172.21.15.63:0/1368463926 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f164800fa00 con 0x7f16500b6cd0 2020-05-18T21:38:32.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.736+0000 7f1656e3a700 1 --2- 172.21.15.63:0/1368463926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16500b6cd0 0x7f1650080060 secure :-1 s=THROTTLE_DONE pgs=2185 cs=0 l=1 rx=0x7f1640001110 tx=0x7f1648007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.736+0000 7f1645ffb700 1 --2- 172.21.15.63:0/1368463926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f163004f910 0x7f1630051dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:32.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.736+0000 7f1645ffb700 1 -- 172.21.15.63:0/1368463926 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1648064450 con 0x7f16500b6cd0 2020-05-18T21:38:32.762 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.736+0000 7f16553d7700 1 --2- 172.21.15.63:0/1368463926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f163004f910 0x7f1630051dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:32.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.736+0000 7f16553d7700 1 --2- 172.21.15.63:0/1368463926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f163004f910 0x7f1630051dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f164c000bc0 tx=0x7f164c0017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.736+0000 7f16553d7700 1 --2- 172.21.15.63:0/1368463926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f163004f910 0x7f1630051dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f164c000bc0 tx=0x7f164c0017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.763 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.736+0000 7f16553d7700 1 --2- 172.21.15.63:0/1368463926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f163004f910 0x7f1630051dd0 secure :-1 s=READY pgs=859 cs=0 l=1 rx=0x7f164c000bc0 tx=0x7f164c0017b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:32.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.744+0000 7f1656e3a700 1 --2- 172.21.15.63:0/1368463926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16500b6cd0 0x7f1650080060 secure :-1 s=THROTTLE_DONE pgs=2185 cs=0 l=1 rx=0x7f1640001110 tx=0x7f1648007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.744+0000 7f1645ffb700 1 -- 172.21.15.63:0/1368463926 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f164803e900 con 0x7f16500b6cd0 2020-05-18T21:38:32.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.896+0000 7f1655bd8700 1 -- 172.21.15.63:0/1368463926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f165011f5d0 con 0x7f16500b6cd0 2020-05-18T21:38:32.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.904+0000 7f1656e3a700 1 --2- 172.21.15.63:0/1368463926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16500b6cd0 0x7f1650080060 secure :-1 s=THROTTLE_DONE pgs=2185 cs=0 l=1 rx=0x7f1640001110 tx=0x7f1648007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:32.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.904+0000 7f1645ffb700 1 -- 172.21.15.63:0/1368463926 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v65) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1648041f20 con 0x7f16500b6cd0 2020-05-18T21:38:32.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.908+0000 7f1655bd8700 1 -- 172.21.15.63:0/1368463926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f163004f910 msgr2=0x7f1630051dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.908+0000 7f1655bd8700 1 --2- 172.21.15.63:0/1368463926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f163004f910 0x7f1630051dd0 secure :-1 s=READY pgs=859 cs=0 l=1 rx=0x7f164c000bc0 tx=0x7f164c0017b0).stop 2020-05-18T21:38:32.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.908+0000 7f1655bd8700 1 -- 172.21.15.63:0/1368463926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16500b6cd0 msgr2=0x7f1650080060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:32.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.908+0000 7f1655bd8700 1 --2- 172.21.15.63:0/1368463926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16500b6cd0 0x7f1650080060 secure :-1 s=READY pgs=2185 cs=0 l=1 rx=0x7f1640001110 tx=0x7f1648007e00).stop 2020-05-18T21:38:32.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.908+0000 7f1655bd8700 1 -- 172.21.15.63:0/1368463926 shutdown_connections 2020-05-18T21:38:32.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.908+0000 7f1655bd8700 1 --2- 172.21.15.63:0/1368463926 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f163004f910 0x7f1630051dd0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:32.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.908+0000 7f1655bd8700 1 --2- 172.21.15.63:0/1368463926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16500b6cd0 0x7f1650080060 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:32.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.908+0000 7f1655bd8700 1 --2- 172.21.15.63:0/1368463926 >> v2:172.21.15.155:3300/0 conn(0x7f16500b5cb0 0x7f16500aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.908+0000 7f1655bd8700 1 -- 172.21.15.63:0/1368463926 >> 172.21.15.63:0/1368463926 conn(0x7f1650069b70 msgr2=0x7f16500b7260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.908+0000 7f1655bd8700 1 -- 172.21.15.63:0/1368463926 shutdown_connections 2020-05-18T21:38:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:32.908+0000 7f1655bd8700 1 -- 172.21.15.63:0/1368463926 wait complete. 2020-05-18T21:38:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.2 2020-05-18T21:38:32.927 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-05-18T21:38:33.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4fa25c700 1 Processor -- start 2020-05-18T21:38:33.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4fa25c700 1 -- start start 2020-05-18T21:38:33.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4fa25c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd4f40b6410 0x7fd4f40b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:33.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4fa25c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4f40b5cb0 0x7fd4f4061af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:33.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4fa25c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f4025500 con 0x7fd4f4151bc0 2020-05-18T21:38:33.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4fa25c700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f4064ee0 con 0x7fd4f40b6410 2020-05-18T21:38:33.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4fa25c700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f40b67f0 con 0x7fd4f40b5cb0 2020-05-18T21:38:33.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4fb4be700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd4f4151bc0 0x7fd4f4152030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39182/0 (socket says 172.21.15.63:39182) 2020-05-18T21:38:33.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4fb4be700 1 -- 172.21.15.63:0/2968223784 learned_addr learned my addr 172.21.15.63:0/2968223784 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:33.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4f925a700 1 --2- 172.21.15.63:0/2968223784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4f40b5cb0 0x7fd4f4061af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:33.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4f9a5b700 1 --2- 172.21.15.63:0/2968223784 >> v2:172.21.15.155:3300/0 conn(0x7fd4f40b6410 0x7fd4f40b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:33.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4f8a59700 1 -- 172.21.15.63:0/2968223784 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198050200 0 0) 0x7fd4f4025500 con 0x7fd4f4151bc0 2020-05-18T21:38:33.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4f8a59700 1 -- 172.21.15.63:0/2968223784 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4e0003270 con 0x7fd4f4151bc0 2020-05-18T21:38:33.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4f9a5b700 1 -- 172.21.15.63:0/2968223784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4f40b5cb0 msgr2=0x7fd4f4061af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:33.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4f9a5b700 1 --2- 172.21.15.63:0/2968223784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4f40b5cb0 0x7fd4f4061af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:33.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4f9a5b700 1 -- 172.21.15.63:0/2968223784 >> v1:172.21.15.63:6789/0 conn(0x7fd4f4151bc0 legacy=0x7fd4f4152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:33.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4f9a5b700 1 -- 172.21.15.63:0/2968223784 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f4025180 con 0x7fd4f40b6410 2020-05-18T21:38:33.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4f925a700 1 --2- 172.21.15.63:0/2968223784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4f40b5cb0 0x7fd4f4061af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:38:33.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4f9a5b700 1 --2- 172.21.15.63:0/2968223784 >> v2:172.21.15.155:3300/0 conn(0x7fd4f40b6410 0x7fd4f40b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd4f0002f70 tx=0x7fd4f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4f9a5b700 1 --2- 172.21.15.63:0/2968223784 >> v2:172.21.15.155:3300/0 conn(0x7fd4f40b6410 0x7fd4f40b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd4f0002f70 tx=0x7fd4f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.040+0000 7fd4f9a5b700 1 --2- 172.21.15.63:0/2968223784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4f40b6410 0x7fd4f40b6cd0 secure :-1 s=READY pgs=1466 cs=0 l=1 rx=0x7fd4f0002f70 tx=0x7fd4f0007a80).ready entity=mon.1 client_cookie=96795da81a047074 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:33.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.044+0000 7fd4f9a5b700 1 --2- 172.21.15.63:0/2968223784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4f40b6410 0x7fd4f40b6cd0 secure :-1 s=THROTTLE_DONE pgs=1466 cs=0 l=1 rx=0x7fd4f0002f70 tx=0x7fd4f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.044+0000 7fd4f8a59700 1 -- 172.21.15.63:0/2968223784 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4f0011540 con 0x7fd4f40b6410 2020-05-18T21:38:33.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.044+0000 7fd4f9a5b700 1 --2- 172.21.15.63:0/2968223784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4f40b6410 0x7fd4f40b6cd0 secure :-1 s=THROTTLE_DONE pgs=1466 cs=0 l=1 rx=0x7fd4f0002f70 tx=0x7fd4f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.044+0000 7fd4f9a5b700 1 --2- 172.21.15.63:0/2968223784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4f40b6410 0x7fd4f40b6cd0 secure :-1 s=THROTTLE_DONE pgs=1466 cs=0 l=1 rx=0x7fd4f0002f70 tx=0x7fd4f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.044+0000 7fd4f8a59700 1 -- 172.21.15.63:0/2968223784 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f00116a0 con 0x7fd4f40b6410 2020-05-18T21:38:33.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.044+0000 7fd4f8a59700 1 -- 172.21.15.63:0/2968223784 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4f0011ac0 con 0x7fd4f40b6410 2020-05-18T21:38:33.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.044+0000 7fd4fa25c700 1 -- 172.21.15.63:0/2968223784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4f40b6410 msgr2=0x7fd4f40b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:33.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.044+0000 7fd4fa25c700 1 --2- 172.21.15.63:0/2968223784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4f40b6410 0x7fd4f40b6cd0 secure :-1 s=READY pgs=1466 cs=0 l=1 rx=0x7fd4f0002f70 tx=0x7fd4f0007a80).stop 2020-05-18T21:38:33.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.044+0000 7fd4fa25c700 1 -- 172.21.15.63:0/2968223784 shutdown_connections 2020-05-18T21:38:33.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.044+0000 7fd4fa25c700 1 --2- 172.21.15.63:0/2968223784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4f40b5cb0 0x7fd4f4061af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:33.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.044+0000 7fd4fa25c700 1 --2- 172.21.15.63:0/2968223784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4f40b6410 0x7fd4f40b6cd0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:33.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.044+0000 7fd4fa25c700 1 -- 172.21.15.63:0/2968223784 >> 172.21.15.63:0/2968223784 conn(0x7fd4f4069b70 msgr2=0x7fd4f4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:33.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.044+0000 7fd4fa25c700 1 -- 172.21.15.63:0/2968223784 shutdown_connections 2020-05-18T21:38:33.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.044+0000 7fd4fa25c700 1 -- 172.21.15.63:0/2968223784 wait complete. 2020-05-18T21:38:33.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.044+0000 7fd4fa25c700 1 Processor -- start 2020-05-18T21:38:33.062 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4fa25c700 1 -- start start 2020-05-18T21:38:33.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4fa25c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd4f40b5cb0 0x7fd4f40b3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:33.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4fa25c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4f4151bc0 0x7fd4f40b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:33.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4fa25c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f40b2e40 con 0x7fd4f40b6410 2020-05-18T21:38:33.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4fa25c700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f40b2c60 con 0x7fd4f40b5cb0 2020-05-18T21:38:33.063 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4fa25c700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f40b30e0 con 0x7fd4f4151bc0 2020-05-18T21:38:33.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4f9a5b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd4f40b5cb0 0x7fd4f40b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:33.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4f9a5b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd4f40b5cb0 0x7fd4f40b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36996/0 (socket says 172.21.15.63:36996) 2020-05-18T21:38:33.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4f9a5b700 1 -- 172.21.15.63:0/1361202746 learned_addr learned my addr 172.21.15.63:0/1361202746 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:33.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4fb4be700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4f4151bc0 0x7fd4f40b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:33.064 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4ea7fc700 1 -- 172.21.15.63:0/1361202746 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992845892 0 0) 0x7fd4f40b2e40 con 0x7fd4f40b6410 2020-05-18T21:38:33.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4ea7fc700 1 -- 172.21.15.63:0/1361202746 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4dc003270 con 0x7fd4f40b6410 2020-05-18T21:38:33.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4f9a5b700 1 -- 172.21.15.63:0/1361202746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4f4151bc0 msgr2=0x7fd4f40b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:33.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4f9a5b700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4f4151bc0 0x7fd4f40b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:33.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4f9a5b700 1 -- 172.21.15.63:0/1361202746 >> v1:172.21.15.155:6789/0 conn(0x7fd4f40b6410 legacy=0x7fd4f4126fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:33.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4f9a5b700 1 -- 172.21.15.63:0/1361202746 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f40b46b0 con 0x7fd4f40b5cb0 2020-05-18T21:38:33.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4f9a5b700 1 --2- 172.21.15.63:0/1361202746 >> v2:172.21.15.63:3300/0 conn(0x7fd4f40b5cb0 0x7fd4f40b3580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4f0002f70 tx=0x7fd4f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4f9a5b700 1 --2- 172.21.15.63:0/1361202746 >> v2:172.21.15.63:3300/0 conn(0x7fd4f40b5cb0 0x7fd4f40b3580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4f0002f70 tx=0x7fd4f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4f9a5b700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f40b5cb0 0x7fd4f40b3580 secure :-1 s=READY pgs=2187 cs=0 l=1 rx=0x7fd4f0002f70 tx=0x7fd4f0007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:33.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4f9a5b700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f40b5cb0 0x7fd4f40b3580 secure :-1 s=THROTTLE_DONE pgs=2187 cs=0 l=1 rx=0x7fd4f0002f70 tx=0x7fd4f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4ea7fc700 1 -- 172.21.15.63:0/1361202746 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4f00100e0 con 0x7fd4f40b5cb0 2020-05-18T21:38:33.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4fa25c700 1 -- 172.21.15.63:0/1361202746 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f40b2890 con 0x7fd4f40b5cb0 2020-05-18T21:38:33.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4fa25c700 1 -- 172.21.15.63:0/1361202746 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f40b1430 con 0x7fd4f40b5cb0 2020-05-18T21:38:33.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4f9a5b700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f40b5cb0 0x7fd4f40b3580 secure :-1 s=THROTTLE_DONE pgs=2187 cs=0 l=1 rx=0x7fd4f0002f70 tx=0x7fd4f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4f9a5b700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f40b5cb0 0x7fd4f40b3580 secure :-1 s=THROTTLE_DONE pgs=2187 cs=0 l=1 rx=0x7fd4f0002f70 tx=0x7fd4f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4ea7fc700 1 -- 172.21.15.63:0/1361202746 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f0011a90 con 0x7fd4f40b5cb0 2020-05-18T21:38:33.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.048+0000 7fd4ea7fc700 1 -- 172.21.15.63:0/1361202746 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4f0007360 con 0x7fd4f40b5cb0 2020-05-18T21:38:33.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.052+0000 7fd4f9a5b700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f40b5cb0 0x7fd4f40b3580 secure :-1 s=THROTTLE_DONE pgs=2187 cs=0 l=1 rx=0x7fd4f0002f70 tx=0x7fd4f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.052+0000 7fd4fa25c700 1 -- 172.21.15.63:0/1361202746 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4f40569e0 con 0x7fd4f40b5cb0 2020-05-18T21:38:33.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.052+0000 7fd4ea7fc700 1 -- 172.21.15.63:0/1361202746 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd4f0005700 con 0x7fd4f40b5cb0 2020-05-18T21:38:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.052+0000 7fd4f9a5b700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f40b5cb0 0x7fd4f40b3580 secure :-1 s=THROTTLE_DONE pgs=2187 cs=0 l=1 rx=0x7fd4f0002f70 tx=0x7fd4f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.052+0000 7fd4ea7fc700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4dc04fd70 0x7fd4dc052230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.052+0000 7fd4ea7fc700 1 -- 172.21.15.63:0/1361202746 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd4f00640f0 con 0x7fd4f40b5cb0 2020-05-18T21:38:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.052+0000 7fd4f925a700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4dc04fd70 0x7fd4dc052230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.052+0000 7fd4f925a700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4dc04fd70 0x7fd4dc052230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4e4007760 tx=0x7fd4e4009b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.052+0000 7fd4f925a700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4dc04fd70 0x7fd4dc052230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4e4007760 tx=0x7fd4e4009b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.052+0000 7fd4f925a700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4dc04fd70 0x7fd4dc052230 secure :-1 s=READY pgs=860 cs=0 l=1 rx=0x7fd4e4007760 tx=0x7fd4e4009b30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:33.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.060+0000 7fd4f9a5b700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f40b5cb0 0x7fd4f40b3580 secure :-1 s=THROTTLE_DONE pgs=2187 cs=0 l=1 rx=0x7fd4f0002f70 tx=0x7fd4f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.060+0000 7fd4ea7fc700 1 -- 172.21.15.63:0/1361202746 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fd4f003e5a0 con 0x7fd4f40b5cb0 2020-05-18T21:38:33.218 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.212+0000 7fd4fa25c700 1 -- 172.21.15.63:0/1361202746 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd4f40b5700 con 0x7fd4f40b5cb0 2020-05-18T21:38:33.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.220+0000 7fd4f9a5b700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f40b5cb0 0x7fd4f40b3580 secure :-1 s=THROTTLE_DONE pgs=2187 cs=0 l=1 rx=0x7fd4f0002f70 tx=0x7fd4f0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.220+0000 7fd4ea7fc700 1 -- 172.21.15.63:0/1361202746 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v66) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd4f0041bc0 con 0x7fd4f40b5cb0 2020-05-18T21:38:33.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.224+0000 7fd4fa25c700 1 -- 172.21.15.63:0/1361202746 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4dc04fd70 msgr2=0x7fd4dc052230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:33.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.224+0000 7fd4fa25c700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4dc04fd70 0x7fd4dc052230 secure :-1 s=READY pgs=860 cs=0 l=1 rx=0x7fd4e4007760 tx=0x7fd4e4009b30).stop 2020-05-18T21:38:33.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.224+0000 7fd4fa25c700 1 -- 172.21.15.63:0/1361202746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f40b5cb0 msgr2=0x7fd4f40b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:33.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.224+0000 7fd4fa25c700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f40b5cb0 0x7fd4f40b3580 secure :-1 s=READY pgs=2187 cs=0 l=1 rx=0x7fd4f0002f70 tx=0x7fd4f0007a80).stop 2020-05-18T21:38:33.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.224+0000 7fd4fa25c700 1 -- 172.21.15.63:0/1361202746 shutdown_connections 2020-05-18T21:38:33.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.224+0000 7fd4fa25c700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd4dc04fd70 0x7fd4dc052230 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:33.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.224+0000 7fd4fa25c700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4f4151bc0 0x7fd4f40b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:33.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.224+0000 7fd4fa25c700 1 --2- 172.21.15.63:0/1361202746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f40b5cb0 0x7fd4f40b3580 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:33.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.224+0000 7fd4fa25c700 1 -- 172.21.15.63:0/1361202746 >> 172.21.15.63:0/1361202746 conn(0x7fd4f4069b70 msgr2=0x7fd4f40b7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:33.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.224+0000 7fd4fa25c700 1 -- 172.21.15.63:0/1361202746 shutdown_connections 2020-05-18T21:38:33.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.224+0000 7fd4fa25c700 1 -- 172.21.15.63:0/1361202746 wait complete. 2020-05-18T21:38:33.232 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.3 2020-05-18T21:38:33.242 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:38:33.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.340+0000 7f3a7cacd700 1 Processor -- start 2020-05-18T21:38:33.347 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.340+0000 7f3a7cacd700 1 -- start start 2020-05-18T21:38:33.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.340+0000 7f3a7cacd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3a7805f110 0x7f3a780b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:33.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.340+0000 7f3a7cacd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3a7814aa70 0x7f3a780648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:33.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.340+0000 7f3a7cacd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a7814a330 con 0x7f3a78064d20 2020-05-18T21:38:33.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.340+0000 7f3a7cacd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7814a140 con 0x7f3a7805f110 2020-05-18T21:38:33.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.340+0000 7f3a7cacd700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7814a5d0 con 0x7f3a7814aa70 2020-05-18T21:38:33.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.340+0000 7f3a777fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3a7805f110 0x7f3a780b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:33.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.340+0000 7f3a777fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3a7805f110 0x7f3a780b4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37006/0 (socket says 172.21.15.63:37006) 2020-05-18T21:38:33.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.340+0000 7f3a777fe700 1 -- 172.21.15.63:0/1862268548 learned_addr learned my addr 172.21.15.63:0/1862268548 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:33.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.340+0000 7f3a76ffd700 1 --2- 172.21.15.63:0/1862268548 >> v2:172.21.15.155:3300/0 conn(0x7f3a7814aa70 0x7f3a780648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:33.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.340+0000 7f3a777fe700 1 -- 172.21.15.63:0/1862268548 >> v2:172.21.15.155:3300/0 conn(0x7f3a7814aa70 msgr2=0x7f3a780648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:33.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.340+0000 7f3a777fe700 1 --2- 172.21.15.63:0/1862268548 >> v2:172.21.15.155:3300/0 conn(0x7f3a7814aa70 0x7f3a780648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:33.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.340+0000 7f3a777fe700 1 -- 172.21.15.63:0/1862268548 >> v1:172.21.15.155:6789/0 conn(0x7f3a78064d20 legacy=0x7f3a7814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:33.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.340+0000 7f3a777fe700 1 -- 172.21.15.63:0/1862268548 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a78063430 con 0x7f3a7805f110 2020-05-18T21:38:33.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.340+0000 7f3a777fe700 1 --2- 172.21.15.63:0/1862268548 >> v2:172.21.15.63:3300/0 conn(0x7f3a7805f110 0x7f3a780b4760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3a60002f70 tx=0x7f3a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.340+0000 7f3a777fe700 1 --2- 172.21.15.63:0/1862268548 >> v2:172.21.15.63:3300/0 conn(0x7f3a7805f110 0x7f3a780b4760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3a60002f70 tx=0x7f3a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.344+0000 7f3a777fe700 1 --2- 172.21.15.63:0/1862268548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a7805f110 0x7f3a780b4760 secure :-1 s=READY pgs=2188 cs=0 l=1 rx=0x7f3a60002f70 tx=0x7f3a60007a80).ready entity=mon.0 client_cookie=8c39ee722dc59e55 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:33.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.344+0000 7f3a777fe700 1 --2- 172.21.15.63:0/1862268548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a7805f110 0x7f3a780b4760 secure :-1 s=THROTTLE_DONE pgs=2188 cs=0 l=1 rx=0x7f3a60002f70 tx=0x7f3a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.344+0000 7f3a777fe700 1 --2- 172.21.15.63:0/1862268548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a7805f110 0x7f3a780b4760 secure :-1 s=THROTTLE_DONE pgs=2188 cs=0 l=1 rx=0x7f3a60002f70 tx=0x7f3a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.344+0000 7f3a767fc700 1 -- 172.21.15.63:0/1862268548 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a600116b0 con 0x7f3a7805f110 2020-05-18T21:38:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.344+0000 7f3a777fe700 1 --2- 172.21.15.63:0/1862268548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a7805f110 0x7f3a780b4760 secure :-1 s=THROTTLE_DONE pgs=2188 cs=0 l=1 rx=0x7f3a60002f70 tx=0x7f3a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.344+0000 7f3a767fc700 1 -- 172.21.15.63:0/1862268548 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a60011810 con 0x7f3a7805f110 2020-05-18T21:38:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.344+0000 7f3a767fc700 1 -- 172.21.15.63:0/1862268548 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a60011c30 con 0x7f3a7805f110 2020-05-18T21:38:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.344+0000 7f3a7cacd700 1 -- 172.21.15.63:0/1862268548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a7805f110 msgr2=0x7f3a780b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.344+0000 7f3a7cacd700 1 --2- 172.21.15.63:0/1862268548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a7805f110 0x7f3a780b4760 secure :-1 s=READY pgs=2188 cs=0 l=1 rx=0x7f3a60002f70 tx=0x7f3a60007a80).stop 2020-05-18T21:38:33.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.344+0000 7f3a7cacd700 1 -- 172.21.15.63:0/1862268548 shutdown_connections 2020-05-18T21:38:33.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.344+0000 7f3a7cacd700 1 --2- 172.21.15.63:0/1862268548 >> v2:172.21.15.155:3300/0 conn(0x7f3a7814aa70 0x7f3a780648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:33.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.344+0000 7f3a7cacd700 1 --2- 172.21.15.63:0/1862268548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a7805f110 0x7f3a780b4760 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:33.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.344+0000 7f3a7cacd700 1 -- 172.21.15.63:0/1862268548 >> 172.21.15.63:0/1862268548 conn(0x7f3a78069fc0 msgr2=0x7f3a7806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:33.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.344+0000 7f3a7cacd700 1 -- 172.21.15.63:0/1862268548 shutdown_connections 2020-05-18T21:38:33.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.344+0000 7f3a7cacd700 1 -- 172.21.15.63:0/1862268548 wait complete. 2020-05-18T21:38:33.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.344+0000 7f3a7cacd700 1 Processor -- start 2020-05-18T21:38:33.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.344+0000 7f3a7cacd700 1 -- start start 2020-05-18T21:38:33.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a7cacd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3a7805f110 0x7f3a7814b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:33.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a7cacd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a78145eb0 con 0x7f3a78064d20 2020-05-18T21:38:33.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a7cacd700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a78146150 con 0x7f3a7814aa70 2020-05-18T21:38:33.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a7cacd700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a781578d0 con 0x7f3a7805f110 2020-05-18T21:38:33.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a777fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3a7805f110 0x7f3a7814b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:33.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a76ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3a78064d20 0x7f3a7814d940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39200/0 (socket says 172.21.15.63:39200) 2020-05-18T21:38:33.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a76ffd700 1 -- 172.21.15.63:0/1533316337 learned_addr learned my addr 172.21.15.63:0/1533316337 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:33.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a777fe700 1 -- 172.21.15.63:0/1533316337 >> v1:172.21.15.155:6789/0 conn(0x7f3a7814aa70 legacy=0x7f3a78133190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:33.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a777fe700 1 -- 172.21.15.63:0/1533316337 >> v1:172.21.15.63:6789/0 conn(0x7f3a78064d20 legacy=0x7f3a7814d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:33.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a74ff9700 1 -- 172.21.15.63:0/1533316337 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759646803 0 0) 0x7f3a78145eb0 con 0x7f3a78064d20 2020-05-18T21:38:33.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a777fe700 1 -- 172.21.15.63:0/1533316337 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a78147600 con 0x7f3a7805f110 2020-05-18T21:38:33.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a777fe700 1 --2- 172.21.15.63:0/1533316337 >> v2:172.21.15.63:3300/0 conn(0x7f3a7805f110 0x7f3a7814b840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3a60002f70 tx=0x7f3a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a777fe700 1 --2- 172.21.15.63:0/1533316337 >> v2:172.21.15.63:3300/0 conn(0x7f3a7805f110 0x7f3a7814b840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3a60002f70 tx=0x7f3a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a777fe700 1 --2- 172.21.15.63:0/1533316337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a7805f110 0x7f3a7814b840 secure :-1 s=READY pgs=2190 cs=0 l=1 rx=0x7f3a60002f70 tx=0x7f3a60007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:33.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a777fe700 1 --2- 172.21.15.63:0/1533316337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a7805f110 0x7f3a7814b840 secure :-1 s=THROTTLE_DONE pgs=2190 cs=0 l=1 rx=0x7f3a60002f70 tx=0x7f3a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a777fe700 1 --2- 172.21.15.63:0/1533316337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a7805f110 0x7f3a7814b840 secure :-1 s=THROTTLE_DONE pgs=2190 cs=0 l=1 rx=0x7f3a60002f70 tx=0x7f3a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a74ff9700 1 -- 172.21.15.63:0/1533316337 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a60007360 con 0x7f3a7805f110 2020-05-18T21:38:33.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a777fe700 1 --2- 172.21.15.63:0/1533316337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a7805f110 0x7f3a7814b840 secure :-1 s=THROTTLE_DONE pgs=2190 cs=0 l=1 rx=0x7f3a60002f70 tx=0x7f3a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a74ff9700 1 -- 172.21.15.63:0/1533316337 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a600074c0 con 0x7f3a7805f110 2020-05-18T21:38:33.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a7cacd700 1 -- 172.21.15.63:0/1533316337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a781338a0 con 0x7f3a7805f110 2020-05-18T21:38:33.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a74ff9700 1 -- 172.21.15.63:0/1533316337 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a600058f0 con 0x7f3a7805f110 2020-05-18T21:38:33.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a7cacd700 1 -- 172.21.15.63:0/1533316337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a780b8760 con 0x7f3a7805f110 2020-05-18T21:38:33.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a777fe700 1 --2- 172.21.15.63:0/1533316337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a7805f110 0x7f3a7814b840 secure :-1 s=THROTTLE_DONE pgs=2190 cs=0 l=1 rx=0x7f3a60002f70 tx=0x7f3a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.348+0000 7f3a7cacd700 1 -- 172.21.15.63:0/1533316337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a780b8a70 con 0x7f3a7805f110 2020-05-18T21:38:33.365 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.352+0000 7f3a74ff9700 1 -- 172.21.15.63:0/1533316337 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f3a60005b60 con 0x7f3a7805f110 2020-05-18T21:38:33.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.352+0000 7f3a777fe700 1 --2- 172.21.15.63:0/1533316337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a7805f110 0x7f3a7814b840 secure :-1 s=THROTTLE_DONE pgs=2190 cs=0 l=1 rx=0x7f3a60002f70 tx=0x7f3a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.352+0000 7f3a74ff9700 1 --2- 172.21.15.63:0/1533316337 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a5c04f850 0x7f3a5c051d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:33.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.352+0000 7f3a74ff9700 1 -- 172.21.15.63:0/1533316337 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3a600642f0 con 0x7f3a7805f110 2020-05-18T21:38:33.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.352+0000 7f3a76ffd700 1 --2- 172.21.15.63:0/1533316337 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a5c04f850 0x7f3a5c051d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:33.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.352+0000 7f3a76ffd700 1 --2- 172.21.15.63:0/1533316337 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a5c04f850 0x7f3a5c051d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3a68008360 tx=0x7f3a680085e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.352+0000 7f3a76ffd700 1 --2- 172.21.15.63:0/1533316337 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a5c04f850 0x7f3a5c051d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3a68008360 tx=0x7f3a680085e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.352+0000 7f3a76ffd700 1 --2- 172.21.15.63:0/1533316337 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a5c04f850 0x7f3a5c051d10 secure :-1 s=READY pgs=861 cs=0 l=1 rx=0x7f3a68008360 tx=0x7f3a680085e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:33.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.356+0000 7f3a777fe700 1 --2- 172.21.15.63:0/1533316337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a7805f110 0x7f3a7814b840 secure :-1 s=THROTTLE_DONE pgs=2190 cs=0 l=1 rx=0x7f3a60002f70 tx=0x7f3a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.356+0000 7f3a74ff9700 1 -- 172.21.15.63:0/1533316337 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f3a6003e7a0 con 0x7f3a7805f110 2020-05-18T21:38:33.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.508+0000 7f3a7cacd700 1 -- 172.21.15.63:0/1533316337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a7814e060 con 0x7f3a7805f110 2020-05-18T21:38:33.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.508+0000 7f3a777fe700 1 --2- 172.21.15.63:0/1533316337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a7805f110 0x7f3a7814b840 secure :-1 s=THROTTLE_DONE pgs=2190 cs=0 l=1 rx=0x7f3a60002f70 tx=0x7f3a60007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.508+0000 7f3a74ff9700 1 -- 172.21.15.63:0/1533316337 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) v1 ==== 95+0+2149 (secure 0 0 0) 0x7f3a60041dc0 con 0x7f3a7805f110 2020-05-18T21:38:33.515 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:33.515 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":150,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7370,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/726870500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":726870500},{"type":"v1","addr":"172.21.15.63:6833","nonce":726870500}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":149}],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:38:30.427505+0000","modified":"2020-05-18T21:38:31.430511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10348":{"gid":10348,"name":"b","rank":0,"incarnation":149,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/3932257542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3932257542},{"type":"v1","addr":"172.21.15.155:6835","nonce":3932257542}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2020-05-18T21:38:33.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.508+0000 7f3a7cacd700 1 -- 172.21.15.63:0/1533316337 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a5c04f850 msgr2=0x7f3a5c051d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:33.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.508+0000 7f3a7cacd700 1 --2- 172.21.15.63:0/1533316337 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a5c04f850 0x7f3a5c051d10 secure :-1 s=READY pgs=861 cs=0 l=1 rx=0x7f3a68008360 tx=0x7f3a680085e0).stop 2020-05-18T21:38:33.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.508+0000 7f3a7cacd700 1 -- 172.21.15.63:0/1533316337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a7805f110 msgr2=0x7f3a7814b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:33.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.508+0000 7f3a7cacd700 1 --2- 172.21.15.63:0/1533316337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a7805f110 0x7f3a7814b840 secure :-1 s=READY pgs=2190 cs=0 l=1 rx=0x7f3a60002f70 tx=0x7f3a60007a80).stop 2020-05-18T21:38:33.517 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.508+0000 7f3a7cacd700 1 -- 172.21.15.63:0/1533316337 shutdown_connections 2020-05-18T21:38:33.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.508+0000 7f3a7cacd700 1 --2- 172.21.15.63:0/1533316337 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f3a5c04f850 0x7f3a5c051d10 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:33.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.508+0000 7f3a7cacd700 1 --2- 172.21.15.63:0/1533316337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a7805f110 0x7f3a7814b840 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:33.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.508+0000 7f3a7cacd700 1 -- 172.21.15.63:0/1533316337 >> 172.21.15.63:0/1533316337 conn(0x7f3a78069fc0 msgr2=0x7f3a78060c90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:33.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.508+0000 7f3a7cacd700 1 -- 172.21.15.63:0/1533316337 shutdown_connections 2020-05-18T21:38:33.518 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.508+0000 7f3a7cacd700 1 -- 172.21.15.63:0/1533316337 wait complete. 2020-05-18T21:38:33.519 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 150 2020-05-18T21:38:33.738 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 150, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:38:30.427505+0000', 'modified': '2020-05-18T21:38:31.430511+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10348}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10348': {'gid': 10348, 'name': 'b', 'rank': 0, 'incarnation': 149, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6835/3932257542', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3932257542}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3932257542}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [32], 'metadata_pool': 31, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:38:33.739 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:38:33.739 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:38:33.845 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:38:33.845 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:38:33.846 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2020-05-18T21:38:33.846 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 10348, 2020-05-18T21:38:33.846 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:38:33.846 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:38:33.846 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 3.4108781559999999, 2020-05-18T21:38:33.847 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 150, 2020-05-18T21:38:33.847 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 167, 2020-05-18T21:38:33.847 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 166, 2020-05-18T21:38:33.847 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 7.7850309649999998 2020-05-18T21:38:33.847 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:38:33.854 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 10348, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.4108781559999999, "mdsmap_epoch": 150, "osdmap_epoch": 167, "osdmap_epoch_barrier": 166, "uptime": 7.7850309649999998 } 2020-05-18T21:38:33.854 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:38:33.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.960+0000 7f9b7f11e700 1 Processor -- start 2020-05-18T21:38:33.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.960+0000 7f9b7f11e700 1 -- start start 2020-05-18T21:38:33.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.960+0000 7f9b7f11e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b78060b90 0x7f9b78147e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:33.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.960+0000 7f9b7f11e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b78144240 con 0x7f9b78143da0 2020-05-18T21:38:33.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.960+0000 7f9b7f11e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b781444e0 con 0x7f9b7812a0e0 2020-05-18T21:38:33.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.960+0000 7f9b7f11e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b78144780 con 0x7f9b78060b90 2020-05-18T21:38:33.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.960+0000 7f9b77fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9b78143da0 0x7f9b781299d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39206/0 (socket says 172.21.15.63:39206) 2020-05-18T21:38:33.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.960+0000 7f9b77fff700 1 -- 172.21.15.63:0/2026169174 learned_addr learned my addr 172.21.15.63:0/2026169174 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:33.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.960+0000 7f9b7ceba700 1 --2- 172.21.15.63:0/2026169174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b78060b90 0x7f9b78147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:33.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.960+0000 7f9b777fe700 1 -- 172.21.15.63:0/2026169174 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235026548 0 0) 0x7f9b78144240 con 0x7f9b78143da0 2020-05-18T21:38:33.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.960+0000 7f9b777fe700 1 -- 172.21.15.63:0/2026169174 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b58003270 con 0x7f9b78143da0 2020-05-18T21:38:33.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.960+0000 7f9b777fe700 1 -- 172.21.15.63:0/2026169174 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244987655 0 0) 0x7f9b781444e0 con 0x7f9b7812a0e0 2020-05-18T21:38:33.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.960+0000 7f9b777fe700 1 -- 172.21.15.63:0/2026169174 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b78144240 con 0x7f9b7812a0e0 2020-05-18T21:38:33.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.960+0000 7f9b7ceba700 1 -- 172.21.15.63:0/2026169174 >> v1:172.21.15.155:6789/0 conn(0x7f9b7812a0e0 legacy=0x7f9b780650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:33.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.960+0000 7f9b7ceba700 1 -- 172.21.15.63:0/2026169174 >> v1:172.21.15.63:6789/0 conn(0x7f9b78143da0 legacy=0x7f9b781299d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:33.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.960+0000 7f9b7ceba700 1 -- 172.21.15.63:0/2026169174 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b78144c20 con 0x7f9b78060b90 2020-05-18T21:38:33.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.960+0000 7f9b7ceba700 1 --2- 172.21.15.63:0/2026169174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b78060b90 0x7f9b78147e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9b60002f70 tx=0x7f9b60008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.964+0000 7f9b7ceba700 1 --2- 172.21.15.63:0/2026169174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b78060b90 0x7f9b78147e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9b60002f70 tx=0x7f9b60008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.964+0000 7f9b7ceba700 1 --2- 172.21.15.63:0/2026169174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b78060b90 0x7f9b78147e60 secure :-1 s=READY pgs=339 cs=0 l=1 rx=0x7f9b60002f70 tx=0x7f9b60008920).ready entity=mon.2 client_cookie=98ca48892d99bc84 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:33.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.964+0000 7f9b7ceba700 1 --2- 172.21.15.63:0/2026169174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b78060b90 0x7f9b78147e60 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7f9b60002f70 tx=0x7f9b60008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.964+0000 7f9b777fe700 1 -- 172.21.15.63:0/2026169174 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b60008e80 con 0x7f9b78060b90 2020-05-18T21:38:33.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.964+0000 7f9b7ceba700 1 --2- 172.21.15.63:0/2026169174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b78060b90 0x7f9b78147e60 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7f9b60002f70 tx=0x7f9b60008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.964+0000 7f9b7ceba700 1 --2- 172.21.15.63:0/2026169174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b78060b90 0x7f9b78147e60 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7f9b60002f70 tx=0x7f9b60008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.964+0000 7f9b777fe700 1 -- 172.21.15.63:0/2026169174 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b60011580 con 0x7f9b78060b90 2020-05-18T21:38:33.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.964+0000 7f9b777fe700 1 -- 172.21.15.63:0/2026169174 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b60011960 con 0x7f9b78060b90 2020-05-18T21:38:33.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.964+0000 7f9b7f11e700 1 -- 172.21.15.63:0/2026169174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b78060b90 msgr2=0x7f9b78147e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:33.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.964+0000 7f9b7f11e700 1 --2- 172.21.15.63:0/2026169174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b78060b90 0x7f9b78147e60 secure :-1 s=READY pgs=339 cs=0 l=1 rx=0x7f9b60002f70 tx=0x7f9b60008920).stop 2020-05-18T21:38:33.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.964+0000 7f9b7f11e700 1 -- 172.21.15.63:0/2026169174 shutdown_connections 2020-05-18T21:38:33.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.964+0000 7f9b7f11e700 1 --2- 172.21.15.63:0/2026169174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b78060b90 0x7f9b78147e60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:33.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.964+0000 7f9b7f11e700 1 -- 172.21.15.63:0/2026169174 >> 172.21.15.63:0/2026169174 conn(0x7f9b780b83d0 msgr2=0x7f9b780b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:33.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.964+0000 7f9b7f11e700 1 -- 172.21.15.63:0/2026169174 shutdown_connections 2020-05-18T21:38:33.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.964+0000 7f9b7f11e700 1 -- 172.21.15.63:0/2026169174 wait complete. 2020-05-18T21:38:33.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.964+0000 7f9b7f11e700 1 Processor -- start 2020-05-18T21:38:33.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.964+0000 7f9b7f11e700 1 -- start start 2020-05-18T21:38:33.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7f11e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9b78060b90 0x7f9b7812c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:33.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7f11e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b7812a0e0 0x7f9b7812a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:33.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7f11e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9b78143da0 0x7f9b78142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:33.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7f11e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b7812ad70 con 0x7f9b78060b90 2020-05-18T21:38:33.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7f11e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b7812bc20 con 0x7f9b78143da0 2020-05-18T21:38:33.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7f11e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b78127fa0 con 0x7f9b7812a0e0 2020-05-18T21:38:33.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7ceba700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9b78060b90 0x7f9b7812c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:33.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7ceba700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9b78060b90 0x7f9b7812c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37024/0 (socket says 172.21.15.63:37024) 2020-05-18T21:38:33.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7ceba700 1 -- 172.21.15.63:0/4264604289 learned_addr learned my addr 172.21.15.63:0/4264604289 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:33.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b77fff700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b7812a0e0 0x7f9b7812a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:33.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7d6bb700 1 --2- 172.21.15.63:0/4264604289 >> v2:172.21.15.155:3300/0 conn(0x7f9b78143da0 0x7f9b78142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:33.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7ceba700 1 -- 172.21.15.63:0/4264604289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b7812a0e0 msgr2=0x7f9b7812a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:33.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7ceba700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b7812a0e0 0x7f9b7812a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:33.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7ceba700 1 -- 172.21.15.63:0/4264604289 >> v2:172.21.15.155:3300/0 conn(0x7f9b78143da0 msgr2=0x7f9b78142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:33.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7ceba700 1 --2- 172.21.15.63:0/4264604289 >> v2:172.21.15.155:3300/0 conn(0x7f9b78143da0 0x7f9b78142b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:33.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7ceba700 1 -- 172.21.15.63:0/4264604289 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b78128240 con 0x7f9b78060b90 2020-05-18T21:38:33.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7d6bb700 1 --2- 172.21.15.63:0/4264604289 >> v2:172.21.15.155:3300/0 conn(0x7f9b78143da0 0x7f9b78142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:38:33.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b77fff700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b7812a0e0 0x7f9b7812a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:38:33.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7ceba700 1 --2- 172.21.15.63:0/4264604289 >> v2:172.21.15.63:3300/0 conn(0x7f9b78060b90 0x7f9b7812c510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b60002f70 tx=0x7f9b78144db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7ceba700 1 --2- 172.21.15.63:0/4264604289 >> v2:172.21.15.63:3300/0 conn(0x7f9b78060b90 0x7f9b7812c510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b60002f70 tx=0x7f9b78144db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7ceba700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b78060b90 0x7f9b7812c510 secure :-1 s=READY pgs=2192 cs=0 l=1 rx=0x7f9b60002f70 tx=0x7f9b78144db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:33.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7ceba700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b78060b90 0x7f9b7812c510 secure :-1 s=THROTTLE_DONE pgs=2192 cs=0 l=1 rx=0x7f9b60002f70 tx=0x7f9b78144db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b75ffb700 1 -- 172.21.15.63:0/4264604289 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b60011a00 con 0x7f9b78060b90 2020-05-18T21:38:33.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7ceba700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b78060b90 0x7f9b7812c510 secure :-1 s=THROTTLE_DONE pgs=2192 cs=0 l=1 rx=0x7f9b60002f70 tx=0x7f9b78144db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7ceba700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b78060b90 0x7f9b7812c510 secure :-1 s=THROTTLE_DONE pgs=2192 cs=0 l=1 rx=0x7f9b60002f70 tx=0x7f9b78144db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b75ffb700 1 -- 172.21.15.63:0/4264604289 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b60007170 con 0x7f9b78060b90 2020-05-18T21:38:33.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7f11e700 1 -- 172.21.15.63:0/4264604289 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b780ad0f0 con 0x7f9b78060b90 2020-05-18T21:38:33.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b75ffb700 1 -- 172.21.15.63:0/4264604289 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b60007590 con 0x7f9b78060b90 2020-05-18T21:38:33.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7f11e700 1 -- 172.21.15.63:0/4264604289 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b78127c70 con 0x7f9b78060b90 2020-05-18T21:38:33.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7ceba700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b78060b90 0x7f9b7812c510 secure :-1 s=THROTTLE_DONE pgs=2192 cs=0 l=1 rx=0x7f9b60002f70 tx=0x7f9b78144db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.968+0000 7f9b7f11e700 1 -- 172.21.15.63:0/4264604289 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b780569e0 con 0x7f9b78060b90 2020-05-18T21:38:33.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.972+0000 7f9b75ffb700 1 -- 172.21.15.63:0/4264604289 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f9b60005700 con 0x7f9b78060b90 2020-05-18T21:38:33.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.972+0000 7f9b7ceba700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b78060b90 0x7f9b7812c510 secure :-1 s=THROTTLE_DONE pgs=2192 cs=0 l=1 rx=0x7f9b60002f70 tx=0x7f9b78144db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.972+0000 7f9b75ffb700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b5c04fa50 0x7f9b5c051f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:33.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.972+0000 7f9b75ffb700 1 -- 172.21.15.63:0/4264604289 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9b60064700 con 0x7f9b78060b90 2020-05-18T21:38:33.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.972+0000 7f9b77fff700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b5c04fa50 0x7f9b5c051f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:33.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.972+0000 7f9b77fff700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b5c04fa50 0x7f9b5c051f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b68001110 tx=0x7f9b68001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.972+0000 7f9b77fff700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b5c04fa50 0x7f9b5c051f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b68001110 tx=0x7f9b68001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.972+0000 7f9b77fff700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b5c04fa50 0x7f9b5c051f10 secure :-1 s=READY pgs=862 cs=0 l=1 rx=0x7f9b68001110 tx=0x7f9b68001790).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:33.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.976+0000 7f9b7ceba700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b78060b90 0x7f9b7812c510 secure :-1 s=THROTTLE_DONE pgs=2192 cs=0 l=1 rx=0x7f9b60002f70 tx=0x7f9b78144db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:33.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:33.976+0000 7f9b75ffb700 1 -- 172.21.15.63:0/4264604289 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f9b6003ea30 con 0x7f9b78060b90 2020-05-18T21:38:34.105 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.100+0000 7f9b7f11e700 1 -- 172.21.15.63:0/4264604289 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b78143b80 con 0x7f9b78060b90 2020-05-18T21:38:34.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.100+0000 7f9b7ceba700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b78060b90 0x7f9b7812c510 secure :-1 s=THROTTLE_DONE pgs=2192 cs=0 l=1 rx=0x7f9b60002f70 tx=0x7f9b78144db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.107 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.100+0000 7f9b75ffb700 1 -- 172.21.15.63:0/4264604289 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f9b60042050 con 0x7f9b78060b90 2020-05-18T21:38:34.108 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:34.108 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":167,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:38:31.431168+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:38:28.730444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2020-05-18T21:38:29.414568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:38:34.109 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.100+0000 7f9b7f11e700 1 -- 172.21.15.63:0/4264604289 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b5c04fa50 msgr2=0x7f9b5c051f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.100+0000 7f9b7f11e700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b5c04fa50 0x7f9b5c051f10 secure :-1 s=READY pgs=862 cs=0 l=1 rx=0x7f9b68001110 tx=0x7f9b68001790).stop 2020-05-18T21:38:34.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.100+0000 7f9b7f11e700 1 -- 172.21.15.63:0/4264604289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b78060b90 msgr2=0x7f9b7812c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.100+0000 7f9b7f11e700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b78060b90 0x7f9b7812c510 secure :-1 s=READY pgs=2192 cs=0 l=1 rx=0x7f9b60002f70 tx=0x7f9b78144db0).stop 2020-05-18T21:38:34.111 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.100+0000 7f9b7f11e700 1 -- 172.21.15.63:0/4264604289 shutdown_connections 2020-05-18T21:38:34.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.100+0000 7f9b7f11e700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f9b5c04fa50 0x7f9b5c051f10 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.100+0000 7f9b7f11e700 1 --2- 172.21.15.63:0/4264604289 >> v2:172.21.15.155:3300/0 conn(0x7f9b78143da0 0x7f9b78142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.100+0000 7f9b7f11e700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b7812a0e0 0x7f9b7812a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.100+0000 7f9b7f11e700 1 --2- 172.21.15.63:0/4264604289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b78060b90 0x7f9b7812c510 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.112 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.100+0000 7f9b7f11e700 1 -- 172.21.15.63:0/4264604289 >> 172.21.15.63:0/4264604289 conn(0x7f9b780b83d0 msgr2=0x7f9b78147850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:34.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.104+0000 7f9b7f11e700 1 -- 172.21.15.63:0/4264604289 shutdown_connections 2020-05-18T21:38:34.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.104+0000 7f9b7f11e700 1 -- 172.21.15.63:0/4264604289 wait complete. 2020-05-18T21:38:34.120 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 31, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:38:28.730444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '166', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 32, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:38:29.414568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:38:34.121 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:38:34.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.220+0000 7f51bbfff700 1 Processor -- start 2020-05-18T21:38:34.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.220+0000 7f51bbfff700 1 -- start start 2020-05-18T21:38:34.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51bbfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f51bc0bc8d0 0x7f51bc060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:34.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51bbfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f51bc145e30 0x7f51bc142f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:34.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51bbfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51bc146420 con 0x7f51bc143380 2020-05-18T21:38:34.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51bbfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc146e00 con 0x7f51bc0bc8d0 2020-05-18T21:38:34.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51bbfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc1466c0 con 0x7f51bc145e30 2020-05-18T21:38:34.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51baffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f51bc0bc8d0 0x7f51bc060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:34.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51baffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f51bc0bc8d0 0x7f51bc060b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37032/0 (socket says 172.21.15.63:37032) 2020-05-18T21:38:34.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51baffd700 1 -- 172.21.15.63:0/499550301 learned_addr learned my addr 172.21.15.63:0/499550301 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:34.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51ba7fc700 1 --2- 172.21.15.63:0/499550301 >> v2:172.21.15.155:3300/0 conn(0x7f51bc145e30 0x7f51bc142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:34.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51baffd700 1 -- 172.21.15.63:0/499550301 >> v2:172.21.15.155:3300/0 conn(0x7f51bc145e30 msgr2=0x7f51bc142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:34.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51baffd700 1 --2- 172.21.15.63:0/499550301 >> v2:172.21.15.155:3300/0 conn(0x7f51bc145e30 0x7f51bc142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:34.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51baffd700 1 -- 172.21.15.63:0/499550301 >> v1:172.21.15.155:6789/0 conn(0x7f51bc143380 legacy=0x7f51bc12e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51baffd700 1 -- 172.21.15.63:0/499550301 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc146960 con 0x7f51bc0bc8d0 2020-05-18T21:38:34.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51baffd700 1 --2- 172.21.15.63:0/499550301 >> v2:172.21.15.63:3300/0 conn(0x7f51bc0bc8d0 0x7f51bc060b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f51ac0032f0 tx=0x7f51ac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51baffd700 1 --2- 172.21.15.63:0/499550301 >> v2:172.21.15.63:3300/0 conn(0x7f51bc0bc8d0 0x7f51bc060b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f51ac0032f0 tx=0x7f51ac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51baffd700 1 --2- 172.21.15.63:0/499550301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51bc0bc8d0 0x7f51bc060b00 secure :-1 s=READY pgs=2193 cs=0 l=1 rx=0x7f51ac0032f0 tx=0x7f51ac007e00).ready entity=mon.0 client_cookie=14d542492690db1f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:34.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51baffd700 1 --2- 172.21.15.63:0/499550301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51bc0bc8d0 0x7f51bc060b00 secure :-1 s=THROTTLE_DONE pgs=2193 cs=0 l=1 rx=0x7f51ac0032f0 tx=0x7f51ac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51b9ffb700 1 -- 172.21.15.63:0/499550301 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51ac011dc0 con 0x7f51bc0bc8d0 2020-05-18T21:38:34.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51baffd700 1 --2- 172.21.15.63:0/499550301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51bc0bc8d0 0x7f51bc060b00 secure :-1 s=THROTTLE_DONE pgs=2193 cs=0 l=1 rx=0x7f51ac0032f0 tx=0x7f51ac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51b9ffb700 1 -- 172.21.15.63:0/499550301 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac00a180 con 0x7f51bc0bc8d0 2020-05-18T21:38:34.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51baffd700 1 --2- 172.21.15.63:0/499550301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51bc0bc8d0 0x7f51bc060b00 secure :-1 s=THROTTLE_DONE pgs=2193 cs=0 l=1 rx=0x7f51ac0032f0 tx=0x7f51ac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51b9ffb700 1 -- 172.21.15.63:0/499550301 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51ac00a5a0 con 0x7f51bc0bc8d0 2020-05-18T21:38:34.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51bbfff700 1 -- 172.21.15.63:0/499550301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51bc0bc8d0 msgr2=0x7f51bc060b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51bbfff700 1 --2- 172.21.15.63:0/499550301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51bc0bc8d0 0x7f51bc060b00 secure :-1 s=READY pgs=2193 cs=0 l=1 rx=0x7f51ac0032f0 tx=0x7f51ac007e00).stop 2020-05-18T21:38:34.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51bbfff700 1 -- 172.21.15.63:0/499550301 shutdown_connections 2020-05-18T21:38:34.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51bbfff700 1 --2- 172.21.15.63:0/499550301 >> v2:172.21.15.155:3300/0 conn(0x7f51bc145e30 0x7f51bc142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:34.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51bbfff700 1 --2- 172.21.15.63:0/499550301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51bc0bc8d0 0x7f51bc060b00 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51bbfff700 1 -- 172.21.15.63:0/499550301 >> 172.21.15.63:0/499550301 conn(0x7f51bc05f3b0 msgr2=0x7f51bc05f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:34.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51bbfff700 1 -- 172.21.15.63:0/499550301 shutdown_connections 2020-05-18T21:38:34.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51bbfff700 1 -- 172.21.15.63:0/499550301 wait complete. 2020-05-18T21:38:34.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51bbfff700 1 Processor -- start 2020-05-18T21:38:34.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.224+0000 7f51bbfff700 1 -- start start 2020-05-18T21:38:34.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51bbfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f51bc0bc8d0 0x7f51bc1353c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:34.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51bbfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f51bc143380 0x7f51bc0acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:34.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51bbfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51bc135820 con 0x7f51bc145e30 2020-05-18T21:38:34.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51bbfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc135eb0 con 0x7f51bc143380 2020-05-18T21:38:34.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51bbfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc136150 con 0x7f51bc0bc8d0 2020-05-18T21:38:34.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51ba7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f51bc143380 0x7f51bc0acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:34.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51baffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f51bc0bc8d0 0x7f51bc1353c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:34.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51ba7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f51bc143380 0x7f51bc0acf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37040/0 (socket says 172.21.15.63:37040) 2020-05-18T21:38:34.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51ba7fc700 1 -- 172.21.15.63:0/2827938854 learned_addr learned my addr 172.21.15.63:0/2827938854 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:34.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51ba7fc700 1 -- 172.21.15.63:0/2827938854 >> v2:172.21.15.155:3300/0 conn(0x7f51bc0bc8d0 msgr2=0x7f51bc1353c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51ba7fc700 1 --2- 172.21.15.63:0/2827938854 >> v2:172.21.15.155:3300/0 conn(0x7f51bc0bc8d0 0x7f51bc1353c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51ba7fc700 1 -- 172.21.15.63:0/2827938854 >> v1:172.21.15.155:6789/0 conn(0x7f51bc145e30 legacy=0x7f51bc0b5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51ba7fc700 1 -- 172.21.15.63:0/2827938854 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc1363f0 con 0x7f51bc143380 2020-05-18T21:38:34.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51ba7fc700 1 --2- 172.21.15.63:0/2827938854 >> v2:172.21.15.63:3300/0 conn(0x7f51bc143380 0x7f51bc0acf10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51a4002f70 tx=0x7f51bc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51ba7fc700 1 --2- 172.21.15.63:0/2827938854 >> v2:172.21.15.63:3300/0 conn(0x7f51bc143380 0x7f51bc0acf10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51a4002f70 tx=0x7f51bc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51ba7fc700 1 --2- 172.21.15.63:0/2827938854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51bc143380 0x7f51bc0acf10 secure :-1 s=READY pgs=2194 cs=0 l=1 rx=0x7f51a4002f70 tx=0x7f51bc061d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:34.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51ba7fc700 1 --2- 172.21.15.63:0/2827938854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51bc143380 0x7f51bc0acf10 secure :-1 s=THROTTLE_DONE pgs=2194 cs=0 l=1 rx=0x7f51a4002f70 tx=0x7f51bc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51ba7fc700 1 --2- 172.21.15.63:0/2827938854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51bc143380 0x7f51bc0acf10 secure :-1 s=THROTTLE_DONE pgs=2194 cs=0 l=1 rx=0x7f51a4002f70 tx=0x7f51bc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51b3fff700 1 -- 172.21.15.63:0/2827938854 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51a4009ea0 con 0x7f51bc143380 2020-05-18T21:38:34.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51ba7fc700 1 --2- 172.21.15.63:0/2827938854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51bc143380 0x7f51bc0acf10 secure :-1 s=THROTTLE_DONE pgs=2194 cs=0 l=1 rx=0x7f51a4002f70 tx=0x7f51bc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51b3fff700 1 -- 172.21.15.63:0/2827938854 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a4012ad0 con 0x7f51bc143380 2020-05-18T21:38:34.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51bbfff700 1 -- 172.21.15.63:0/2827938854 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51bc0b0f80 con 0x7f51bc143380 2020-05-18T21:38:34.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51b3fff700 1 -- 172.21.15.63:0/2827938854 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51a40091c0 con 0x7f51bc143380 2020-05-18T21:38:34.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51bbfff700 1 -- 172.21.15.63:0/2827938854 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51bc0ad370 con 0x7f51bc143380 2020-05-18T21:38:34.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51ba7fc700 1 --2- 172.21.15.63:0/2827938854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51bc143380 0x7f51bc0acf10 secure :-1 s=THROTTLE_DONE pgs=2194 cs=0 l=1 rx=0x7f51a4002f70 tx=0x7f51bc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.228+0000 7f51bbfff700 1 -- 172.21.15.63:0/2827938854 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51bc136580 con 0x7f51bc143380 2020-05-18T21:38:34.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.232+0000 7f51b3fff700 1 -- 172.21.15.63:0/2827938854 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f51a4007190 con 0x7f51bc143380 2020-05-18T21:38:34.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.232+0000 7f51ba7fc700 1 --2- 172.21.15.63:0/2827938854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51bc143380 0x7f51bc0acf10 secure :-1 s=THROTTLE_DONE pgs=2194 cs=0 l=1 rx=0x7f51a4002f70 tx=0x7f51bc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.232+0000 7f51b3fff700 1 --2- 172.21.15.63:0/2827938854 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51a004fa90 0x7f51a0051f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:34.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.232+0000 7f51b3fff700 1 -- 172.21.15.63:0/2827938854 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f51a4063c50 con 0x7f51bc143380 2020-05-18T21:38:34.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.232+0000 7f51baffd700 1 --2- 172.21.15.63:0/2827938854 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51a004fa90 0x7f51a0051f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:34.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.232+0000 7f51baffd700 1 --2- 172.21.15.63:0/2827938854 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51a004fa90 0x7f51a0051f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51ac0032f0 tx=0x7f51ac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.232+0000 7f51baffd700 1 --2- 172.21.15.63:0/2827938854 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51a004fa90 0x7f51a0051f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51ac0032f0 tx=0x7f51ac007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.232+0000 7f51baffd700 1 --2- 172.21.15.63:0/2827938854 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51a004fa90 0x7f51a0051f50 secure :-1 s=READY pgs=863 cs=0 l=1 rx=0x7f51ac0032f0 tx=0x7f51ac007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:34.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.236+0000 7f51ba7fc700 1 --2- 172.21.15.63:0/2827938854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51bc143380 0x7f51bc0acf10 secure :-1 s=THROTTLE_DONE pgs=2194 cs=0 l=1 rx=0x7f51a4002f70 tx=0x7f51bc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.240+0000 7f51b3fff700 1 -- 172.21.15.63:0/2827938854 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f51a403dfe0 con 0x7f51bc143380 2020-05-18T21:38:34.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.356+0000 7f51bbfff700 1 -- 172.21.15.63:0/2827938854 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f51bc0569e0 con 0x7f51bc143380 2020-05-18T21:38:34.363 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.356+0000 7f51ba7fc700 1 --2- 172.21.15.63:0/2827938854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51bc143380 0x7f51bc0acf10 secure :-1 s=THROTTLE_DONE pgs=2194 cs=0 l=1 rx=0x7f51a4002f70 tx=0x7f51bc061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.364 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.356+0000 7f51b3fff700 1 -- 172.21.15.63:0/2827938854 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v167) v1 ==== 110+0+10 (secure 0 0 0) 0x7f51a4007e60 con 0x7f51bc143380 2020-05-18T21:38:34.364 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:38:34.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.360+0000 7f51bbfff700 1 -- 172.21.15.63:0/2827938854 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51a004fa90 msgr2=0x7f51a0051f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.360+0000 7f51bbfff700 1 --2- 172.21.15.63:0/2827938854 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51a004fa90 0x7f51a0051f50 secure :-1 s=READY pgs=863 cs=0 l=1 rx=0x7f51ac0032f0 tx=0x7f51ac007e00).stop 2020-05-18T21:38:34.366 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.360+0000 7f51bbfff700 1 -- 172.21.15.63:0/2827938854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51bc143380 msgr2=0x7f51bc0acf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.360+0000 7f51bbfff700 1 --2- 172.21.15.63:0/2827938854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51bc143380 0x7f51bc0acf10 secure :-1 s=READY pgs=2194 cs=0 l=1 rx=0x7f51a4002f70 tx=0x7f51bc061d60).stop 2020-05-18T21:38:34.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.360+0000 7f51bbfff700 1 -- 172.21.15.63:0/2827938854 shutdown_connections 2020-05-18T21:38:34.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.360+0000 7f51bbfff700 1 --2- 172.21.15.63:0/2827938854 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f51a004fa90 0x7f51a0051f50 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.360+0000 7f51bbfff700 1 --2- 172.21.15.63:0/2827938854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51bc143380 0x7f51bc0acf10 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.367 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.360+0000 7f51bbfff700 1 --2- 172.21.15.63:0/2827938854 >> v2:172.21.15.155:3300/0 conn(0x7f51bc0bc8d0 0x7f51bc1353c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.360+0000 7f51bbfff700 1 -- 172.21.15.63:0/2827938854 >> 172.21.15.63:0/2827938854 conn(0x7f51bc05f3b0 msgr2=0x7f51bc0b8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:34.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.360+0000 7f51bbfff700 1 -- 172.21.15.63:0/2827938854 shutdown_connections 2020-05-18T21:38:34.368 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.360+0000 7f51bbfff700 1 -- 172.21.15.63:0/2827938854 wait complete. 2020-05-18T21:38:34.376 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:38:34.488 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.480+0000 7f499599f700 1 Processor -- start 2020-05-18T21:38:34.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.480+0000 7f499599f700 1 -- start start 2020-05-18T21:38:34.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f499599f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f49900ba380 0x7f499005f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:34.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f499599f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49901432d0 con 0x7f4990146d00 2020-05-18T21:38:34.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f499599f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4990147140 con 0x7f49900b9fa0 2020-05-18T21:38:34.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f499599f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49901430c0 con 0x7f49900ba380 2020-05-18T21:38:34.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f498f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4990146d00 0x7f49900b4f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39236/0 (socket says 172.21.15.63:39236) 2020-05-18T21:38:34.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f498e7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f49900ba380 0x7f499005f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:34.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f498f7fe700 1 -- 172.21.15.63:0/1628000912 learned_addr learned my addr 172.21.15.63:0/1628000912 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:34.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f498e7fc700 1 -- 172.21.15.63:0/1628000912 >> v1:172.21.15.155:6789/0 conn(0x7f49900b9fa0 legacy=0x7f4990143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f498e7fc700 1 -- 172.21.15.63:0/1628000912 >> v1:172.21.15.63:6789/0 conn(0x7f4990146d00 legacy=0x7f49900b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f498e7fc700 1 -- 172.21.15.63:0/1628000912 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4990142cf0 con 0x7f49900ba380 2020-05-18T21:38:34.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f498e7fc700 1 --2- 172.21.15.63:0/1628000912 >> v2:172.21.15.63:3300/0 conn(0x7f49900ba380 0x7f499005f200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4980002f70 tx=0x7f4980007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f498e7fc700 1 --2- 172.21.15.63:0/1628000912 >> v2:172.21.15.63:3300/0 conn(0x7f49900ba380 0x7f499005f200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4980002f70 tx=0x7f4980007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f498e7fc700 1 --2- 172.21.15.63:0/1628000912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49900ba380 0x7f499005f200 secure :-1 s=READY pgs=2196 cs=0 l=1 rx=0x7f4980002f70 tx=0x7f4980007a80).ready entity=mon.0 client_cookie=160417387510f811 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:34.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f498e7fc700 1 --2- 172.21.15.63:0/1628000912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49900ba380 0x7f499005f200 secure :-1 s=THROTTLE_DONE pgs=2196 cs=0 l=1 rx=0x7f4980002f70 tx=0x7f4980007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f498dffb700 1 -- 172.21.15.63:0/1628000912 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4980008e80 con 0x7f49900ba380 2020-05-18T21:38:34.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f498e7fc700 1 --2- 172.21.15.63:0/1628000912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49900ba380 0x7f499005f200 secure :-1 s=THROTTLE_DONE pgs=2196 cs=0 l=1 rx=0x7f4980002f70 tx=0x7f4980007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f498dffb700 1 -- 172.21.15.63:0/1628000912 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49800116a0 con 0x7f49900ba380 2020-05-18T21:38:34.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f498e7fc700 1 --2- 172.21.15.63:0/1628000912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49900ba380 0x7f499005f200 secure :-1 s=THROTTLE_DONE pgs=2196 cs=0 l=1 rx=0x7f4980002f70 tx=0x7f4980007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f499599f700 1 -- 172.21.15.63:0/1628000912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49900ba380 msgr2=0x7f499005f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f498dffb700 1 -- 172.21.15.63:0/1628000912 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4980011ac0 con 0x7f49900ba380 2020-05-18T21:38:34.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f499599f700 1 --2- 172.21.15.63:0/1628000912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49900ba380 0x7f499005f200 secure :-1 s=READY pgs=2196 cs=0 l=1 rx=0x7f4980002f70 tx=0x7f4980007a80).stop 2020-05-18T21:38:34.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f499599f700 1 -- 172.21.15.63:0/1628000912 shutdown_connections 2020-05-18T21:38:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f499599f700 1 --2- 172.21.15.63:0/1628000912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49900ba380 0x7f499005f200 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f499599f700 1 -- 172.21.15.63:0/1628000912 >> 172.21.15.63:0/1628000912 conn(0x7f499005b290 msgr2=0x7f49900b96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f499599f700 1 -- 172.21.15.63:0/1628000912 shutdown_connections 2020-05-18T21:38:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.484+0000 7f499599f700 1 -- 172.21.15.63:0/1628000912 wait complete. 2020-05-18T21:38:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.488+0000 7f499599f700 1 Processor -- start 2020-05-18T21:38:34.499 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.488+0000 7f499599f700 1 -- start start 2020-05-18T21:38:34.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.488+0000 7f499599f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f49900b9fa0 0x7f499013f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:34.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.488+0000 7f499599f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49900ba380 0x7f499013de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:34.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.488+0000 7f499599f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f499013e260 con 0x7f4990146d00 2020-05-18T21:38:34.502 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.488+0000 7f499599f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499013e4e0 con 0x7f49900b9fa0 2020-05-18T21:38:34.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.488+0000 7f499599f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499013e780 con 0x7f49900ba380 2020-05-18T21:38:34.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.488+0000 7f498f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4990146d00 0x7f4990139b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39244/0 (socket says 172.21.15.63:39244) 2020-05-18T21:38:34.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.488+0000 7f498f7fe700 1 -- 172.21.15.63:0/813363673 learned_addr learned my addr 172.21.15.63:0/813363673 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:34.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.488+0000 7f498e7fc700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49900ba380 0x7f499013de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:34.503 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.488+0000 7f498effd700 1 --2- 172.21.15.63:0/813363673 >> v2:172.21.15.155:3300/0 conn(0x7f49900b9fa0 0x7f499013f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:34.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.488+0000 7f4987fff700 1 -- 172.21.15.63:0/813363673 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836753019 0 0) 0x7f499013e260 con 0x7f4990146d00 2020-05-18T21:38:34.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.488+0000 7f4987fff700 1 -- 172.21.15.63:0/813363673 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4974002fe0 con 0x7f4990146d00 2020-05-18T21:38:34.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.488+0000 7f498e7fc700 1 -- 172.21.15.63:0/813363673 >> v2:172.21.15.155:3300/0 conn(0x7f49900b9fa0 msgr2=0x7f499013f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.488+0000 7f4987fff700 1 -- 172.21.15.63:0/813363673 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1866821582 0 0) 0x7f4974002fe0 con 0x7f4990146d00 2020-05-18T21:38:34.504 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.488+0000 7f498e7fc700 1 --2- 172.21.15.63:0/813363673 >> v2:172.21.15.155:3300/0 conn(0x7f49900b9fa0 0x7f499013f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f498e7fc700 1 -- 172.21.15.63:0/813363673 >> v1:172.21.15.63:6789/0 conn(0x7f4990146d00 legacy=0x7f4990139b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f498e7fc700 1 -- 172.21.15.63:0/813363673 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499013ea20 con 0x7f49900ba380 2020-05-18T21:38:34.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f498e7fc700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49900ba380 0x7f499013de00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4988001cf0 tx=0x7f4980007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.505 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f498e7fc700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49900ba380 0x7f499013de00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4988001cf0 tx=0x7f4980007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f498e7fc700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49900ba380 0x7f499013de00 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7f4988001cf0 tx=0x7f4980007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:34.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f498e7fc700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49900ba380 0x7f499013de00 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f4988001cf0 tx=0x7f4980007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f4987fff700 1 -- 172.21.15.63:0/813363673 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4988001b50 con 0x7f49900ba380 2020-05-18T21:38:34.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f498e7fc700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49900ba380 0x7f499013de00 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f4988001cf0 tx=0x7f4980007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.506 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f499599f700 1 -- 172.21.15.63:0/813363673 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499013a250 con 0x7f49900ba380 2020-05-18T21:38:34.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f4987fff700 1 -- 172.21.15.63:0/813363673 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4980007170 con 0x7f49900ba380 2020-05-18T21:38:34.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f498e7fc700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49900ba380 0x7f499013de00 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f4988001cf0 tx=0x7f4980007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f4987fff700 1 -- 172.21.15.63:0/813363673 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49800074d0 con 0x7f49900ba380 2020-05-18T21:38:34.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f499599f700 1 -- 172.21.15.63:0/813363673 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49900b8ad0 con 0x7f49900ba380 2020-05-18T21:38:34.507 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f498e7fc700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49900ba380 0x7f499013de00 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f4988001cf0 tx=0x7f4980007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f4987fff700 1 -- 172.21.15.63:0/813363673 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4980005700 con 0x7f49900ba380 2020-05-18T21:38:34.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f498e7fc700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49900ba380 0x7f499013de00 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f4988001cf0 tx=0x7f4980007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f499599f700 1 -- 172.21.15.63:0/813363673 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49900569e0 con 0x7f49900ba380 2020-05-18T21:38:34.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f4987fff700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4974051ed0 0x7f4974054390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:34.508 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f4987fff700 1 -- 172.21.15.63:0/813363673 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4980064080 con 0x7f49900ba380 2020-05-18T21:38:34.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.492+0000 7f498effd700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4974051ed0 0x7f4974054390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:34.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.496+0000 7f498effd700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4974051ed0 0x7f4974054390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4990066520 tx=0x7f4978003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.496+0000 7f498effd700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4974051ed0 0x7f4974054390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4990066520 tx=0x7f4978003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.496+0000 7f498effd700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4974051ed0 0x7f4974054390 secure :-1 s=READY pgs=864 cs=0 l=1 rx=0x7f4990066520 tx=0x7f4978003e60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:34.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.504+0000 7f498e7fc700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49900ba380 0x7f499013de00 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f4988001cf0 tx=0x7f4980007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.504+0000 7f4987fff700 1 -- 172.21.15.63:0/813363673 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f498003e530 con 0x7f49900ba380 2020-05-18T21:38:34.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.624+0000 7f499599f700 1 -- 172.21.15.63:0/813363673 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f49900008d0 con 0x7f49900ba380 2020-05-18T21:38:34.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.624+0000 7f498e7fc700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49900ba380 0x7f499013de00 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f4988001cf0 tx=0x7f4980007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.630 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.624+0000 7f4987fff700 1 -- 172.21.15.63:0/813363673 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v167) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4980041b50 con 0x7f49900ba380 2020-05-18T21:38:34.631 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:38:34.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.624+0000 7f499599f700 1 -- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4974051ed0 msgr2=0x7f4974054390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.624+0000 7f499599f700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4974051ed0 0x7f4974054390 secure :-1 s=READY pgs=864 cs=0 l=1 rx=0x7f4990066520 tx=0x7f4978003e60).stop 2020-05-18T21:38:34.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.624+0000 7f499599f700 1 -- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49900ba380 msgr2=0x7f499013de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.624+0000 7f499599f700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49900ba380 0x7f499013de00 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7f4988001cf0 tx=0x7f4980007a80).stop 2020-05-18T21:38:34.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.624+0000 7f499599f700 1 -- 172.21.15.63:0/813363673 shutdown_connections 2020-05-18T21:38:34.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.624+0000 7f499599f700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4974051ed0 0x7f4974054390 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.624+0000 7f499599f700 1 --2- 172.21.15.63:0/813363673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49900ba380 0x7f499013de00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.624+0000 7f499599f700 1 --2- 172.21.15.63:0/813363673 >> v2:172.21.15.155:3300/0 conn(0x7f49900b9fa0 0x7f499013f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.624+0000 7f499599f700 1 -- 172.21.15.63:0/813363673 >> 172.21.15.63:0/813363673 conn(0x7f499005b290 msgr2=0x7f49900b5160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:34.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.624+0000 7f499599f700 1 -- 172.21.15.63:0/813363673 shutdown_connections 2020-05-18T21:38:34.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.624+0000 7f499599f700 1 -- 172.21.15.63:0/813363673 wait complete. 2020-05-18T21:38:34.644 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:38:34.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.748+0000 7f74a7fff700 1 Processor -- start 2020-05-18T21:38:34.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.748+0000 7f74a7fff700 1 -- start start 2020-05-18T21:38:34.764 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.748+0000 7f74a7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74a812b950 0x7f74a8146020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:34.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.748+0000 7f74a7fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74a80621f0 0x7f74a80612e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:34.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.748+0000 7f74a7fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a80606d0 con 0x7f74a8061740 2020-05-18T21:38:34.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.748+0000 7f74a7fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a8060900 con 0x7f74a812b950 2020-05-18T21:38:34.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.748+0000 7f74a7fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8060ba0 con 0x7f74a80621f0 2020-05-18T21:38:34.765 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.748+0000 7f74a77fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f74a8061740 0x7f74a812aaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39248/0 (socket says 172.21.15.63:39248) 2020-05-18T21:38:34.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a77fe700 1 -- 172.21.15.63:0/861858456 learned_addr learned my addr 172.21.15.63:0/861858456 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:34.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a6ffd700 1 --2- 172.21.15.63:0/861858456 >> v2:172.21.15.155:3300/0 conn(0x7f74a812b950 0x7f74a8146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:34.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f749ffff700 1 --2- 172.21.15.63:0/861858456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74a80621f0 0x7f74a80612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:34.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a67fc700 1 -- 172.21.15.63:0/861858456 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555906956 0 0) 0x7f74a80606d0 con 0x7f74a8061740 2020-05-18T21:38:34.766 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a67fc700 1 -- 172.21.15.63:0/861858456 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7488003270 con 0x7f74a8061740 2020-05-18T21:38:34.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a67fc700 1 -- 172.21.15.63:0/861858456 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1607804571 0 0) 0x7f7488003270 con 0x7f74a8061740 2020-05-18T21:38:34.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a67fc700 1 -- 172.21.15.63:0/861858456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74a80621f0 msgr2=0x7f74a80612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:34.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a67fc700 1 --2- 172.21.15.63:0/861858456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74a80621f0 0x7f74a80612e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:34.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a67fc700 1 -- 172.21.15.63:0/861858456 >> v2:172.21.15.155:3300/0 conn(0x7f74a812b950 msgr2=0x7f74a8146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:34.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a67fc700 1 --2- 172.21.15.63:0/861858456 >> v2:172.21.15.155:3300/0 conn(0x7f74a812b950 0x7f74a8146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:34.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a67fc700 1 -- 172.21.15.63:0/861858456 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8060e40 con 0x7f74a8061740 2020-05-18T21:38:34.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a67fc700 1 -- 172.21.15.63:0/861858456 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f74a0001a90 con 0x7f74a8061740 2020-05-18T21:38:34.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a67fc700 1 -- 172.21.15.63:0/861858456 >> v1:172.21.15.63:6789/0 conn(0x7f74a8061740 legacy=0x7f74a812aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a67fc700 1 --2- 172.21.15.63:0/861858456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74a80621f0 0x7f7488003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:34.768 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a67fc700 1 --2- 172.21.15.63:0/861858456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7488003bc0 0x7f7488004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:34.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a67fc700 1 --2- 172.21.15.63:0/861858456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7488004600 0x7f7488004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:34.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a67fc700 1 -- 172.21.15.63:0/861858456 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8060900 con 0x7f7488003bc0 2020-05-18T21:38:34.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a67fc700 1 -- 172.21.15.63:0/861858456 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8060ba0 con 0x7f7488004600 2020-05-18T21:38:34.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a67fc700 1 -- 172.21.15.63:0/861858456 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7488005090 con 0x7f74a80621f0 2020-05-18T21:38:34.769 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f749ffff700 1 --2- 172.21.15.63:0/861858456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7488003bc0 0x7f7488004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:34.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a77fe700 1 --2- 172.21.15.63:0/861858456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7488004600 0x7f7488004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:34.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a6ffd700 1 --2- 172.21.15.63:0/861858456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74a80621f0 0x7f7488003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:34.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f749ffff700 1 -- 172.21.15.63:0/861858456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74a80621f0 msgr2=0x7f7488003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:34.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f749ffff700 1 --2- 172.21.15.63:0/861858456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74a80621f0 0x7f7488003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:34.770 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f749ffff700 1 -- 172.21.15.63:0/861858456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7488004600 msgr2=0x7f7488004a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f749ffff700 1 --2- 172.21.15.63:0/861858456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7488004600 0x7f7488004a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f749ffff700 1 -- 172.21.15.63:0/861858456 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7488003270 con 0x7f7488003bc0 2020-05-18T21:38:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a77fe700 1 --2- 172.21.15.63:0/861858456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7488004600 0x7f7488004a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:38:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f749ffff700 1 --2- 172.21.15.63:0/861858456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7488003bc0 0x7f7488004020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7490002f70 tx=0x7f7490010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f749ffff700 1 --2- 172.21.15.63:0/861858456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7488003bc0 0x7f7488004020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7490002f70 tx=0x7f7490010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f749ffff700 1 --2- 172.21.15.63:0/861858456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7488003bc0 0x7f7488004020 secure :-1 s=READY pgs=2199 cs=0 l=1 rx=0x7f7490002f70 tx=0x7f7490010110).ready entity=mon.0 client_cookie=3217162dcb06a9fa server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:34.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f749ffff700 1 --2- 172.21.15.63:0/861858456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7488003bc0 0x7f7488004020 secure :-1 s=THROTTLE_DONE pgs=2199 cs=0 l=1 rx=0x7f7490002f70 tx=0x7f7490010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a67fc700 1 -- 172.21.15.63:0/861858456 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7490010e20 con 0x7f7488003bc0 2020-05-18T21:38:34.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f749ffff700 1 --2- 172.21.15.63:0/861858456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7488003bc0 0x7f7488004020 secure :-1 s=THROTTLE_DONE pgs=2199 cs=0 l=1 rx=0x7f7490002f70 tx=0x7f7490010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a67fc700 1 -- 172.21.15.63:0/861858456 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7490008990 con 0x7f7488003bc0 2020-05-18T21:38:34.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f749ffff700 1 --2- 172.21.15.63:0/861858456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7488003bc0 0x7f7488004020 secure :-1 s=THROTTLE_DONE pgs=2199 cs=0 l=1 rx=0x7f7490002f70 tx=0x7f7490010110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a67fc700 1 -- 172.21.15.63:0/861858456 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7490008cf0 con 0x7f7488003bc0 2020-05-18T21:38:34.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a7fff700 1 -- 172.21.15.63:0/861858456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7488003bc0 msgr2=0x7f7488004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a7fff700 1 --2- 172.21.15.63:0/861858456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7488003bc0 0x7f7488004020 secure :-1 s=READY pgs=2199 cs=0 l=1 rx=0x7f7490002f70 tx=0x7f7490010110).stop 2020-05-18T21:38:34.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a77fe700 1 -- 172.21.15.63:0/861858456 reap_dead start 2020-05-18T21:38:34.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a7fff700 1 -- 172.21.15.63:0/861858456 shutdown_connections 2020-05-18T21:38:34.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a7fff700 1 -- 172.21.15.63:0/861858456 >> 172.21.15.63:0/861858456 conn(0x7f74a805fbd0 msgr2=0x7f74a8069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:34.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a7fff700 1 -- 172.21.15.63:0/861858456 shutdown_connections 2020-05-18T21:38:34.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.752+0000 7f74a7fff700 1 -- 172.21.15.63:0/861858456 wait complete. 2020-05-18T21:38:34.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a7fff700 1 Processor -- start 2020-05-18T21:38:34.774 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a7fff700 1 -- start start 2020-05-18T21:38:34.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a7fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74a8064da0 0x7f74a8141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:34.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74a81421d0 0x7f74a8145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:34.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f74a81455c0 0x7f74a8145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:34.775 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a7fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a80b1c10 con 0x7f74a81455c0 2020-05-18T21:38:34.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a7fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a80b1e40 con 0x7f74a81421d0 2020-05-18T21:38:34.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a7fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a811db90 con 0x7f74a8064da0 2020-05-18T21:38:34.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f74a81455c0 0x7f74a8145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:34.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f74a81455c0 0x7f74a8145a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37074/0 (socket says 172.21.15.63:37074) 2020-05-18T21:38:34.776 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a77fe700 1 -- 172.21.15.63:0/3337978272 learned_addr learned my addr 172.21.15.63:0/3337978272 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:34.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f749ffff700 1 --2- 172.21.15.63:0/3337978272 >> v2:172.21.15.155:3300/0 conn(0x7f74a81421d0 0x7f74a8145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:34.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a6ffd700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74a8064da0 0x7f74a8141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:34.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a77fe700 1 -- 172.21.15.63:0/3337978272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74a8064da0 msgr2=0x7f74a8141d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a77fe700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74a8064da0 0x7f74a8141d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a77fe700 1 -- 172.21.15.63:0/3337978272 >> v2:172.21.15.155:3300/0 conn(0x7f74a81421d0 msgr2=0x7f74a8145160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.777 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a77fe700 1 --2- 172.21.15.63:0/3337978272 >> v2:172.21.15.155:3300/0 conn(0x7f74a81421d0 0x7f74a8145160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a77fe700 1 -- 172.21.15.63:0/3337978272 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8142610 con 0x7f74a81455c0 2020-05-18T21:38:34.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a77fe700 1 --2- 172.21.15.63:0/3337978272 >> v2:172.21.15.63:3300/0 conn(0x7f74a81455c0 0x7f74a8145a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f74a0001490 tx=0x7f74a0001b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a77fe700 1 --2- 172.21.15.63:0/3337978272 >> v2:172.21.15.63:3300/0 conn(0x7f74a81455c0 0x7f74a8145a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f74a0001490 tx=0x7f74a0001b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a77fe700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74a81455c0 0x7f74a8145a50 secure :-1 s=READY pgs=2200 cs=0 l=1 rx=0x7f74a0001490 tx=0x7f74a0001b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:34.778 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a77fe700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74a81455c0 0x7f74a8145a50 secure :-1 s=THROTTLE_DONE pgs=2200 cs=0 l=1 rx=0x7f74a0001490 tx=0x7f74a0001b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a77fe700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74a81455c0 0x7f74a8145a50 secure :-1 s=THROTTLE_DONE pgs=2200 cs=0 l=1 rx=0x7f74a0001490 tx=0x7f74a0001b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a4ff9700 1 -- 172.21.15.63:0/3337978272 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74a0004b60 con 0x7f74a81455c0 2020-05-18T21:38:34.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a77fe700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74a81455c0 0x7f74a8145a50 secure :-1 s=THROTTLE_DONE pgs=2200 cs=0 l=1 rx=0x7f74a0001490 tx=0x7f74a0001b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a4ff9700 1 -- 172.21.15.63:0/3337978272 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a0004cc0 con 0x7f74a81455c0 2020-05-18T21:38:34.779 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a7fff700 1 -- 172.21.15.63:0/3337978272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a80ae5d0 con 0x7f74a81455c0 2020-05-18T21:38:34.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a4ff9700 1 -- 172.21.15.63:0/3337978272 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74a0004e70 con 0x7f74a81455c0 2020-05-18T21:38:34.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a7fff700 1 -- 172.21.15.63:0/3337978272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a8065180 con 0x7f74a81455c0 2020-05-18T21:38:34.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.756+0000 7f74a77fe700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74a81455c0 0x7f74a8145a50 secure :-1 s=THROTTLE_DONE pgs=2200 cs=0 l=1 rx=0x7f74a0001490 tx=0x7f74a0001b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.760+0000 7f74a7fff700 1 -- 172.21.15.63:0/3337978272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a80ad050 con 0x7f74a81455c0 2020-05-18T21:38:34.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.760+0000 7f74a4ff9700 1 -- 172.21.15.63:0/3337978272 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f74a000d2c0 con 0x7f74a81455c0 2020-05-18T21:38:34.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.760+0000 7f74a77fe700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74a81455c0 0x7f74a8145a50 secure :-1 s=THROTTLE_DONE pgs=2200 cs=0 l=1 rx=0x7f74a0001490 tx=0x7f74a0001b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.760+0000 7f74a4ff9700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f748c04fae0 0x7f748c051fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:34.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.760+0000 7f74a4ff9700 1 -- 172.21.15.63:0/3337978272 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f74a0063ae0 con 0x7f74a81455c0 2020-05-18T21:38:34.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.760+0000 7f74a6ffd700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f748c04fae0 0x7f748c051fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:34.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.760+0000 7f74a6ffd700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f748c04fae0 0x7f748c051fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7498002f70 tx=0x7f749800d910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.760+0000 7f74a6ffd700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f748c04fae0 0x7f748c051fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7498002f70 tx=0x7f749800d910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.760+0000 7f74a6ffd700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f748c04fae0 0x7f748c051fa0 secure :-1 s=READY pgs=865 cs=0 l=1 rx=0x7f7498002f70 tx=0x7f749800d910).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:34.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.764+0000 7f74a77fe700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74a81455c0 0x7f74a8145a50 secure :-1 s=THROTTLE_DONE pgs=2200 cs=0 l=1 rx=0x7f74a0001490 tx=0x7f74a0001b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.764+0000 7f74a4ff9700 1 -- 172.21.15.63:0/3337978272 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f74a003de10 con 0x7f74a81455c0 2020-05-18T21:38:34.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.884+0000 7f74a7fff700 1 -- 172.21.15.63:0/3337978272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f74a80ae760 con 0x7f74a81455c0 2020-05-18T21:38:34.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.884+0000 7f74a77fe700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74a81455c0 0x7f74a8145a50 secure :-1 s=THROTTLE_DONE pgs=2200 cs=0 l=1 rx=0x7f74a0001490 tx=0x7f74a0001b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:34.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.884+0000 7f74a4ff9700 1 -- 172.21.15.63:0/3337978272 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v167) v1 ==== 104+0+10 (secure 0 0 0) 0x7f74a0041430 con 0x7f74a81455c0 2020-05-18T21:38:34.891 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:38:34.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.884+0000 7f74a7fff700 1 -- 172.21.15.63:0/3337978272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f748c04fae0 msgr2=0x7f748c051fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.884+0000 7f74a7fff700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f748c04fae0 0x7f748c051fa0 secure :-1 s=READY pgs=865 cs=0 l=1 rx=0x7f7498002f70 tx=0x7f749800d910).stop 2020-05-18T21:38:34.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.884+0000 7f74a7fff700 1 -- 172.21.15.63:0/3337978272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74a81455c0 msgr2=0x7f74a8145a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:34.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.884+0000 7f74a7fff700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74a81455c0 0x7f74a8145a50 secure :-1 s=READY pgs=2200 cs=0 l=1 rx=0x7f74a0001490 tx=0x7f74a0001b90).stop 2020-05-18T21:38:34.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.884+0000 7f74a7fff700 1 -- 172.21.15.63:0/3337978272 shutdown_connections 2020-05-18T21:38:34.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.884+0000 7f74a7fff700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f748c04fae0 0x7f748c051fa0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.884+0000 7f74a7fff700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74a81455c0 0x7f74a8145a50 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.884+0000 7f74a7fff700 1 --2- 172.21.15.63:0/3337978272 >> v2:172.21.15.155:3300/0 conn(0x7f74a81421d0 0x7f74a8145160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.884+0000 7f74a7fff700 1 --2- 172.21.15.63:0/3337978272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74a8064da0 0x7f74a8141d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:34.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.884+0000 7f74a7fff700 1 -- 172.21.15.63:0/3337978272 >> 172.21.15.63:0/3337978272 conn(0x7f74a805fbd0 msgr2=0x7f74a811f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:34.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.888+0000 7f74a7fff700 1 -- 172.21.15.63:0/3337978272 shutdown_connections 2020-05-18T21:38:34.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:34.888+0000 7f74a7fff700 1 -- 172.21.15.63:0/3337978272 wait complete. 2020-05-18T21:38:34.909 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:38:35.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.008+0000 7efca060b700 1 Processor -- start 2020-05-18T21:38:35.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efca060b700 1 -- start start 2020-05-18T21:38:35.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efca060b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efc980b58e0 0x7efc9805ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:35.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efca060b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efc980b49b0 0x7efc980640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:35.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efca060b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9805ff60 con 0x7efc98149990 2020-05-18T21:38:35.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efca060b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc980655f0 con 0x7efc980b58e0 2020-05-18T21:38:35.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efca060b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc98065890 con 0x7efc980b49b0 2020-05-18T21:38:35.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9e3a7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efc980b58e0 0x7efc9805ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:35.020 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9dba6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efc980b49b0 0x7efc980640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:35.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9e3a7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efc980b58e0 0x7efc9805ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37080/0 (socket says 172.21.15.63:37080) 2020-05-18T21:38:35.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9dba6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efc980b49b0 0x7efc980640e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:51926/0 (socket says 172.21.15.63:51926) 2020-05-18T21:38:35.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9e3a7700 1 -- 172.21.15.63:0/2398374591 learned_addr learned my addr 172.21.15.63:0/2398374591 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:35.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9eba8700 1 --1- 172.21.15.63:0/2398374591 >> v1:172.21.15.155:6789/0 conn(0x7efc98149990 0x7efc98149e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:37586/0 (socket says 172.21.15.63:37586) 2020-05-18T21:38:35.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9dba6700 1 -- 172.21.15.63:0/2398374591 >> v2:172.21.15.63:3300/0 conn(0x7efc980b58e0 msgr2=0x7efc9805ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:35.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9dba6700 1 --2- 172.21.15.63:0/2398374591 >> v2:172.21.15.63:3300/0 conn(0x7efc980b58e0 0x7efc9805ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:35.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9dba6700 1 -- 172.21.15.63:0/2398374591 >> v1:172.21.15.155:6789/0 conn(0x7efc98149990 legacy=0x7efc98149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:35.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9dba6700 1 -- 172.21.15.63:0/2398374591 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc98061cf0 con 0x7efc980b49b0 2020-05-18T21:38:35.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9d3a5700 1 -- 172.21.15.63:0/2398374591 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297784421 0 0) 0x7efc9805ff60 con 0x7efc98149990 2020-05-18T21:38:35.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9e3a7700 1 --2- 172.21.15.63:0/2398374591 >> v2:172.21.15.63:3300/0 conn(0x7efc980b58e0 0x7efc9805ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:38:35.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9dba6700 1 --2- 172.21.15.63:0/2398374591 >> v2:172.21.15.155:3300/0 conn(0x7efc980b49b0 0x7efc980640e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9dba6700 1 --2- 172.21.15.63:0/2398374591 >> v2:172.21.15.155:3300/0 conn(0x7efc980b49b0 0x7efc980640e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9dba6700 1 --2- 172.21.15.63:0/2398374591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc980b49b0 0x7efc980640e0 secure :-1 s=READY pgs=1475 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).ready entity=mon.1 client_cookie=f6fb180f61e8b275 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:35.025 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9dba6700 1 --2- 172.21.15.63:0/2398374591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc980b49b0 0x7efc980640e0 secure :-1 s=THROTTLE_DONE pgs=1475 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9d3a5700 1 -- 172.21.15.63:0/2398374591 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc940115f0 con 0x7efc980b49b0 2020-05-18T21:38:35.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9dba6700 1 --2- 172.21.15.63:0/2398374591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc980b49b0 0x7efc980640e0 secure :-1 s=THROTTLE_DONE pgs=1475 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9dba6700 1 --2- 172.21.15.63:0/2398374591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc980b49b0 0x7efc980640e0 secure :-1 s=THROTTLE_DONE pgs=1475 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9d3a5700 1 -- 172.21.15.63:0/2398374591 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc94011750 con 0x7efc980b49b0 2020-05-18T21:38:35.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efc9d3a5700 1 -- 172.21.15.63:0/2398374591 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc94011b30 con 0x7efc980b49b0 2020-05-18T21:38:35.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efca060b700 1 -- 172.21.15.63:0/2398374591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc980b49b0 msgr2=0x7efc980640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:35.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efca060b700 1 --2- 172.21.15.63:0/2398374591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc980b49b0 0x7efc980640e0 secure :-1 s=READY pgs=1475 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).stop 2020-05-18T21:38:35.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efca060b700 1 -- 172.21.15.63:0/2398374591 shutdown_connections 2020-05-18T21:38:35.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efca060b700 1 --2- 172.21.15.63:0/2398374591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc980b49b0 0x7efc980640e0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:35.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efca060b700 1 --2- 172.21.15.63:0/2398374591 >> v2:172.21.15.63:3300/0 conn(0x7efc980b58e0 0x7efc9805ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:35.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.012+0000 7efca060b700 1 -- 172.21.15.63:0/2398374591 >> 172.21.15.63:0/2398374591 conn(0x7efc980b8ec0 msgr2=0x7efc980b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:35.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.016+0000 7efca060b700 1 -- 172.21.15.63:0/2398374591 shutdown_connections 2020-05-18T21:38:35.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.016+0000 7efca060b700 1 -- 172.21.15.63:0/2398374591 wait complete. 2020-05-18T21:38:35.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.016+0000 7efca060b700 1 Processor -- start 2020-05-18T21:38:35.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.016+0000 7efca060b700 1 -- start start 2020-05-18T21:38:35.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efca060b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc980b58e0 0x7efc9814b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:35.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efca060b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efc98149990 0x7efc98144020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:35.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efca060b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9815b170 con 0x7efc980b49b0 2020-05-18T21:38:35.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efca060b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc980af3f0 con 0x7efc98149990 2020-05-18T21:38:35.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efca060b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9815b410 con 0x7efc980b58e0 2020-05-18T21:38:35.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efc9dba6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc980b58e0 0x7efc9814b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:35.033 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efc9eba8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efc98149990 0x7efc98144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:35.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efc9e3a7700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7efc980b49b0 0x7efc9805f260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:37588/0 (socket says 172.21.15.63:37588) 2020-05-18T21:38:35.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efc9e3a7700 1 -- 172.21.15.63:0/1190811371 learned_addr learned my addr 172.21.15.63:0/1190811371 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:35.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efc9dba6700 1 -- 172.21.15.63:0/1190811371 >> v2:172.21.15.155:3300/0 conn(0x7efc98149990 msgr2=0x7efc98144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:35.034 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efc9dba6700 1 --2- 172.21.15.63:0/1190811371 >> v2:172.21.15.155:3300/0 conn(0x7efc98149990 0x7efc98144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:35.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efc9dba6700 1 -- 172.21.15.63:0/1190811371 >> v1:172.21.15.155:6789/0 conn(0x7efc980b49b0 legacy=0x7efc9805f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:35.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efc9dba6700 1 -- 172.21.15.63:0/1190811371 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9815b6b0 con 0x7efc980b58e0 2020-05-18T21:38:35.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efc9dba6700 1 --2- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc980b58e0 0x7efc9814b860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efc9dba6700 1 --2- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc980b58e0 0x7efc9814b860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.035 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efc9dba6700 1 --2- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc980b58e0 0x7efc9814b860 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:35.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efc9dba6700 1 --2- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc980b58e0 0x7efc9814b860 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efc877fe700 1 -- 172.21.15.63:0/1190811371 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc94011bf0 con 0x7efc980b58e0 2020-05-18T21:38:35.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efc9dba6700 1 --2- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc980b58e0 0x7efc9814b860 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efc9dba6700 1 --2- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc980b58e0 0x7efc9814b860 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efc877fe700 1 -- 172.21.15.63:0/1190811371 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc94010190 con 0x7efc980b58e0 2020-05-18T21:38:35.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efc877fe700 1 -- 172.21.15.63:0/1190811371 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc94007550 con 0x7efc980b58e0 2020-05-18T21:38:35.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efca060b700 1 -- 172.21.15.63:0/1190811371 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9815bbb0 con 0x7efc980b58e0 2020-05-18T21:38:35.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.020+0000 7efca060b700 1 -- 172.21.15.63:0/1190811371 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc980adeb0 con 0x7efc980b58e0 2020-05-18T21:38:35.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.024+0000 7efc9dba6700 1 --2- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc980b58e0 0x7efc9814b860 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.024+0000 7efca060b700 1 -- 172.21.15.63:0/1190811371 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc980569e0 con 0x7efc980b58e0 2020-05-18T21:38:35.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.024+0000 7efc877fe700 1 -- 172.21.15.63:0/1190811371 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7efc94005700 con 0x7efc980b58e0 2020-05-18T21:38:35.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.024+0000 7efc9dba6700 1 --2- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc980b58e0 0x7efc9814b860 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.024+0000 7efc877fe700 1 --2- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efc7804fa60 0x7efc78051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:35.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.024+0000 7efc877fe700 1 -- 172.21.15.63:0/1190811371 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efc940640c0 con 0x7efc980b58e0 2020-05-18T21:38:35.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.024+0000 7efc9e3a7700 1 --2- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efc7804fa60 0x7efc78051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:35.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.024+0000 7efc9e3a7700 1 --2- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efc7804fa60 0x7efc78051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc9805ff70 tx=0x7efc880093b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.024+0000 7efc9e3a7700 1 --2- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efc7804fa60 0x7efc78051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc9805ff70 tx=0x7efc880093b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.024+0000 7efc9e3a7700 1 --2- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efc7804fa60 0x7efc78051f20 secure :-1 s=READY pgs=866 cs=0 l=1 rx=0x7efc9805ff70 tx=0x7efc880093b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:35.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.032+0000 7efc9dba6700 1 --2- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc980b58e0 0x7efc9814b860 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.032+0000 7efc877fe700 1 -- 172.21.15.63:0/1190811371 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7efc9403e450 con 0x7efc980b58e0 2020-05-18T21:38:35.156 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.148+0000 7efca060b700 1 -- 172.21.15.63:0/1190811371 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc980b7b30 con 0x7efc980b58e0 2020-05-18T21:38:35.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.152+0000 7efc9dba6700 1 --2- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc980b58e0 0x7efc9814b860 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.152+0000 7efc877fe700 1 -- 172.21.15.63:0/1190811371 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v167) v1 ==== 100+0+10 (secure 0 0 0) 0x7efc94041a70 con 0x7efc980b58e0 2020-05-18T21:38:35.158 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:38:35.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.152+0000 7efca060b700 1 -- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efc7804fa60 msgr2=0x7efc78051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:35.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.152+0000 7efca060b700 1 --2- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efc7804fa60 0x7efc78051f20 secure :-1 s=READY pgs=866 cs=0 l=1 rx=0x7efc9805ff70 tx=0x7efc880093b0).stop 2020-05-18T21:38:35.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.152+0000 7efca060b700 1 -- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc980b58e0 msgr2=0x7efc9814b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:35.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.152+0000 7efca060b700 1 --2- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc980b58e0 0x7efc9814b860 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7efc94002f70 tx=0x7efc94007a80).stop 2020-05-18T21:38:35.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.152+0000 7efca060b700 1 -- 172.21.15.63:0/1190811371 shutdown_connections 2020-05-18T21:38:35.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.152+0000 7efca060b700 1 --2- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efc7804fa60 0x7efc78051f20 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:35.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.152+0000 7efca060b700 1 --2- 172.21.15.63:0/1190811371 >> v2:172.21.15.155:3300/0 conn(0x7efc98149990 0x7efc98144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:35.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.152+0000 7efca060b700 1 --2- 172.21.15.63:0/1190811371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc980b58e0 0x7efc9814b860 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:35.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.152+0000 7efca060b700 1 -- 172.21.15.63:0/1190811371 >> 172.21.15.63:0/1190811371 conn(0x7efc980b8ec0 msgr2=0x7efc98148b30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:35.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.152+0000 7efca060b700 1 -- 172.21.15.63:0/1190811371 shutdown_connections 2020-05-18T21:38:35.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.152+0000 7efca060b700 1 -- 172.21.15.63:0/1190811371 wait complete. 2020-05-18T21:38:35.177 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:38:35.178 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:38:35.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b59c29700 1 Processor -- start 2020-05-18T21:38:35.278 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b59c29700 1 -- start start 2020-05-18T21:38:35.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b59c29700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8b54145df0 0x7f8b54142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:35.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b59c29700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b541432f0 0x7f8b54060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:35.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b59c29700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b540b7020 con 0x7f8b540b93f0 2020-05-18T21:38:35.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b59c29700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b540b72c0 con 0x7f8b54145df0 2020-05-18T21:38:35.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b59c29700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b540b7560 con 0x7f8b541432f0 2020-05-18T21:38:35.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b53fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8b54145df0 0x7f8b54142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:35.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b58c27700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f8b540b93f0 0x7f8b540b7ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:37596/0 (socket says 172.21.15.63:37596) 2020-05-18T21:38:35.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b53fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8b54145df0 0x7f8b54142e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37096/0 (socket says 172.21.15.63:37096) 2020-05-18T21:38:35.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b58c27700 1 -- 172.21.15.63:0/3808630928 learned_addr learned my addr 172.21.15.63:0/3808630928 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:35.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b59428700 1 --2- 172.21.15.63:0/3808630928 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b541432f0 0x7f8b54060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:35.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b537fe700 1 -- 172.21.15.63:0/3808630928 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427591478 0 0) 0x7f8b540b7020 con 0x7f8b540b93f0 2020-05-18T21:38:35.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b537fe700 1 -- 172.21.15.63:0/3808630928 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b34003270 con 0x7f8b540b93f0 2020-05-18T21:38:35.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b53fff700 1 -- 172.21.15.63:0/3808630928 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b541432f0 msgr2=0x7f8b54060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:35.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b53fff700 1 --2- 172.21.15.63:0/3808630928 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b541432f0 0x7f8b54060430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:35.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b53fff700 1 -- 172.21.15.63:0/3808630928 >> v1:172.21.15.155:6789/0 conn(0x7f8b540b93f0 legacy=0x7f8b540b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:35.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b53fff700 1 -- 172.21.15.63:0/3808630928 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b540b7800 con 0x7f8b54145df0 2020-05-18T21:38:35.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b53fff700 1 --2- 172.21.15.63:0/3808630928 >> v2:172.21.15.63:3300/0 conn(0x7f8b54145df0 0x7f8b54142e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8b3c002f70 tx=0x7f8b3c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b53fff700 1 --2- 172.21.15.63:0/3808630928 >> v2:172.21.15.63:3300/0 conn(0x7f8b54145df0 0x7f8b54142e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8b3c002f70 tx=0x7f8b3c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.272+0000 7f8b53fff700 1 --2- 172.21.15.63:0/3808630928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b54145df0 0x7f8b54142e90 secure :-1 s=READY pgs=2201 cs=0 l=1 rx=0x7f8b3c002f70 tx=0x7f8b3c007a80).ready entity=mon.0 client_cookie=f2b3cb57290a173c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:35.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.276+0000 7f8b53fff700 1 --2- 172.21.15.63:0/3808630928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b54145df0 0x7f8b54142e90 secure :-1 s=THROTTLE_DONE pgs=2201 cs=0 l=1 rx=0x7f8b3c002f70 tx=0x7f8b3c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.276+0000 7f8b537fe700 1 -- 172.21.15.63:0/3808630928 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b3c008e80 con 0x7f8b54145df0 2020-05-18T21:38:35.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.276+0000 7f8b53fff700 1 --2- 172.21.15.63:0/3808630928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b54145df0 0x7f8b54142e90 secure :-1 s=THROTTLE_DONE pgs=2201 cs=0 l=1 rx=0x7f8b3c002f70 tx=0x7f8b3c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.276+0000 7f8b53fff700 1 --2- 172.21.15.63:0/3808630928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b54145df0 0x7f8b54142e90 secure :-1 s=THROTTLE_DONE pgs=2201 cs=0 l=1 rx=0x7f8b3c002f70 tx=0x7f8b3c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.286 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.276+0000 7f8b537fe700 1 -- 172.21.15.63:0/3808630928 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c011540 con 0x7f8b54145df0 2020-05-18T21:38:35.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.276+0000 7f8b537fe700 1 -- 172.21.15.63:0/3808630928 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b3c011960 con 0x7f8b54145df0 2020-05-18T21:38:35.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.276+0000 7f8b59c29700 1 -- 172.21.15.63:0/3808630928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b54145df0 msgr2=0x7f8b54142e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:35.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.276+0000 7f8b59c29700 1 --2- 172.21.15.63:0/3808630928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b54145df0 0x7f8b54142e90 secure :-1 s=READY pgs=2201 cs=0 l=1 rx=0x7f8b3c002f70 tx=0x7f8b3c007a80).stop 2020-05-18T21:38:35.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.276+0000 7f8b59c29700 1 -- 172.21.15.63:0/3808630928 shutdown_connections 2020-05-18T21:38:35.287 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.276+0000 7f8b59c29700 1 --2- 172.21.15.63:0/3808630928 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b541432f0 0x7f8b54060430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:35.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.276+0000 7f8b59c29700 1 --2- 172.21.15.63:0/3808630928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b54145df0 0x7f8b54142e90 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:35.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.276+0000 7f8b59c29700 1 -- 172.21.15.63:0/3808630928 >> 172.21.15.63:0/3808630928 conn(0x7f8b54069b70 msgr2=0x7f8b54069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:35.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.276+0000 7f8b59c29700 1 -- 172.21.15.63:0/3808630928 shutdown_connections 2020-05-18T21:38:35.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.276+0000 7f8b59c29700 1 -- 172.21.15.63:0/3808630928 wait complete. 2020-05-18T21:38:35.288 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.276+0000 7f8b59c29700 1 Processor -- start 2020-05-18T21:38:35.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.276+0000 7f8b59c29700 1 -- start start 2020-05-18T21:38:35.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b59c29700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b541432f0 0x7f8b540bbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:35.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b59c29700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b540b3360 con 0x7f8b540b93f0 2020-05-18T21:38:35.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b59c29700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b540b2e20 con 0x7f8b54145df0 2020-05-18T21:38:35.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b59c29700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b540b30c0 con 0x7f8b541432f0 2020-05-18T21:38:35.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b58c27700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8b540b93f0 0x7f8b5413ef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39286/0 (socket says 172.21.15.63:39286) 2020-05-18T21:38:35.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b58c27700 1 -- 172.21.15.63:0/2494838814 learned_addr learned my addr 172.21.15.63:0/2494838814 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:35.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b53fff700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b541432f0 0x7f8b540bbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:35.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379332619 0 0) 0x7f8b540b3360 con 0x7f8b540b93f0 2020-05-18T21:38:35.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b38002fe0 con 0x7f8b540b93f0 2020-05-18T21:38:35.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287344793 0 0) 0x7f8b540b2e20 con 0x7f8b54145df0 2020-05-18T21:38:35.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b540b3360 con 0x7f8b54145df0 2020-05-18T21:38:35.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3722153623 0 0) 0x7f8b38002fe0 con 0x7f8b540b93f0 2020-05-18T21:38:35.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8b540b2e20 con 0x7f8b540b93f0 2020-05-18T21:38:35.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f8b44001c40 con 0x7f8b540b93f0 2020-05-18T21:38:35.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b541432f0 msgr2=0x7f8b540bbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:35.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b51ffb700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b541432f0 0x7f8b540bbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:35.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 >> v1:172.21.15.155:6789/0 conn(0x7f8b54145df0 legacy=0x7f8b540ba580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:35.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 >> v1:172.21.15.63:6789/0 conn(0x7f8b540b93f0 legacy=0x7f8b5413ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:35.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b51ffb700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b38004bf0 0x7f8b38004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:35.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b51ffb700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b38003880 0x7f8b38003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:35.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b51ffb700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b38004120 0x7f8b3800b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:35.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b540b30c0 con 0x7f8b38004bf0 2020-05-18T21:38:35.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b38004710 con 0x7f8b38003880 2020-05-18T21:38:35.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3800bc10 con 0x7f8b38004120 2020-05-18T21:38:35.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b53fff700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b541432f0 0x7f8b540bbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:38:35.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b58c27700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b38004bf0 0x7f8b38004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:35.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b59428700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b38004120 0x7f8b3800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:35.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b53fff700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b38003880 0x7f8b38003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:35.299 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b58c27700 1 -- 172.21.15.63:0/2494838814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b38004120 msgr2=0x7f8b3800b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:35.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b58c27700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b38004120 0x7f8b3800b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:35.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b58c27700 1 -- 172.21.15.63:0/2494838814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b38003880 msgr2=0x7f8b38003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:35.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b58c27700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b38003880 0x7f8b38003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:35.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b58c27700 1 -- 172.21.15.63:0/2494838814 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b540b29f0 con 0x7f8b38004bf0 2020-05-18T21:38:35.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.280+0000 7f8b59c29700 1 -- 172.21.15.63:0/2494838814 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b540bbb30 con 0x7f8b38004bf0 2020-05-18T21:38:35.300 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b58c27700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b38004bf0 0x7f8b38004ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8b38004850 tx=0x7f8b440117b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b59c29700 1 -- 172.21.15.63:0/2494838814 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5413f670 con 0x7f8b38004bf0 2020-05-18T21:38:35.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b58c27700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b38004bf0 0x7f8b38004ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8b38004850 tx=0x7f8b440117b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.301 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b58c27700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b38004bf0 0x7f8b38004ff0 secure :-1 s=READY pgs=2203 cs=0 l=1 rx=0x7f8b38004850 tx=0x7f8b440117b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:35.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b58c27700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b38004bf0 0x7f8b38004ff0 secure :-1 s=THROTTLE_DONE pgs=2203 cs=0 l=1 rx=0x7f8b38004850 tx=0x7f8b440117b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b58c27700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b38004bf0 0x7f8b38004ff0 secure :-1 s=THROTTLE_DONE pgs=2203 cs=0 l=1 rx=0x7f8b38004850 tx=0x7f8b440117b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b44005e20 con 0x7f8b38004bf0 2020-05-18T21:38:35.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b58c27700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b38004bf0 0x7f8b38004ff0 secure :-1 s=THROTTLE_DONE pgs=2203 cs=0 l=1 rx=0x7f8b38004850 tx=0x7f8b440117b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b44004ca0 con 0x7f8b38004bf0 2020-05-18T21:38:35.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b44005080 con 0x7f8b38004bf0 2020-05-18T21:38:35.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b59c29700 1 -- 172.21.15.63:0/2494838814 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b2c003380 con 0x7f8b38004bf0 2020-05-18T21:38:35.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b58c27700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b38004bf0 0x7f8b38004ff0 secure :-1 s=THROTTLE_DONE pgs=2203 cs=0 l=1 rx=0x7f8b38004850 tx=0x7f8b440117b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8b440051e0 con 0x7f8b38004bf0 2020-05-18T21:38:35.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b58c27700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b38004bf0 0x7f8b38004ff0 secure :-1 s=THROTTLE_DONE pgs=2203 cs=0 l=1 rx=0x7f8b38004850 tx=0x7f8b440117b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b51ffb700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8b38058380 0x7f8b3805a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:35.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8b4400ee40 con 0x7f8b38004bf0 2020-05-18T21:38:35.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b53fff700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8b38058380 0x7f8b3805a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:35.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b53fff700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8b38058380 0x7f8b3805a840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8b3c002f70 tx=0x7f8b3c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b53fff700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8b38058380 0x7f8b3805a840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8b3c002f70 tx=0x7f8b3c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.284+0000 7f8b53fff700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8b38058380 0x7f8b3805a840 secure :-1 s=READY pgs=867 cs=0 l=1 rx=0x7f8b3c002f70 tx=0x7f8b3c007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:35.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.288+0000 7f8b58c27700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b38004bf0 0x7f8b38004ff0 secure :-1 s=THROTTLE_DONE pgs=2203 cs=0 l=1 rx=0x7f8b38004850 tx=0x7f8b440117b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.288+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f8b44042920 con 0x7f8b38004bf0 2020-05-18T21:38:35.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.436+0000 7f8b59c29700 1 -- 172.21.15.63:0/2494838814 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b2c003640 con 0x7f8b38004bf0 2020-05-18T21:38:35.442 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.436+0000 7f8b58c27700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b38004bf0 0x7f8b38004ff0 secure :-1 s=THROTTLE_DONE pgs=2203 cs=0 l=1 rx=0x7f8b38004850 tx=0x7f8b440117b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:35.443 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.436+0000 7f8b51ffb700 1 -- 172.21.15.63:0/2494838814 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) v1 ==== 95+0+2149 (secure 0 0 0) 0x7f8b44042510 con 0x7f8b38004bf0 2020-05-18T21:38:35.443 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:35.443 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":150,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7370,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/726870500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":726870500},{"type":"v1","addr":"172.21.15.63:6833","nonce":726870500}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":149}],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-05-18T21:38:30.427505+0000","modified":"2020-05-18T21:38:31.430511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10348":{"gid":10348,"name":"b","rank":0,"incarnation":149,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/3932257542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3932257542},{"type":"v1","addr":"172.21.15.155:6835","nonce":3932257542}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2020-05-18T21:38:35.444 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.436+0000 7f8b59c29700 1 -- 172.21.15.63:0/2494838814 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8b38058380 msgr2=0x7f8b3805a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:35.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.436+0000 7f8b59c29700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8b38058380 0x7f8b3805a840 secure :-1 s=READY pgs=867 cs=0 l=1 rx=0x7f8b3c002f70 tx=0x7f8b3c007a80).stop 2020-05-18T21:38:35.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.436+0000 7f8b59428700 1 -- 172.21.15.63:0/2494838814 reap_dead start 2020-05-18T21:38:35.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.436+0000 7f8b59c29700 1 -- 172.21.15.63:0/2494838814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b38004bf0 msgr2=0x7f8b38004ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:35.445 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.436+0000 7f8b59c29700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b38004bf0 0x7f8b38004ff0 secure :-1 s=READY pgs=2203 cs=0 l=1 rx=0x7f8b38004850 tx=0x7f8b440117b0).stop 2020-05-18T21:38:35.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.436+0000 7f8b59c29700 1 -- 172.21.15.63:0/2494838814 shutdown_connections 2020-05-18T21:38:35.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.436+0000 7f8b59c29700 1 --2- 172.21.15.63:0/2494838814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b38004bf0 0x7f8b38004ff0 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:35.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.436+0000 7f8b59c29700 1 -- 172.21.15.63:0/2494838814 >> 172.21.15.63:0/2494838814 conn(0x7f8b54069b70 msgr2=0x7f8b54060da0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:35.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.436+0000 7f8b59c29700 1 -- 172.21.15.63:0/2494838814 shutdown_connections 2020-05-18T21:38:35.446 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:35.436+0000 7f8b59c29700 1 -- 172.21.15.63:0/2494838814 wait complete. 2020-05-18T21:38:35.447 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 150 2020-05-18T21:38:35.657 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 150, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-05-18T21:38:30.427505+0000', 'modified': '2020-05-18T21:38:31.430511+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10348}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10348': {'gid': 10348, 'name': 'b', 'rank': 0, 'incarnation': 149, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6835/3932257542', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3932257542}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3932257542}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [32], 'metadata_pool': 31, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:38:35.658 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:38:35.658 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:38:35.766 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:38:35.767 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:38:35.767 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2020-05-18T21:38:35.768 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 10348, 2020-05-18T21:38:35.768 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:38:35.768 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:38:35.769 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 5.3322552239999998, 2020-05-18T21:38:35.769 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 150, 2020-05-18T21:38:35.769 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 167, 2020-05-18T21:38:35.770 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 166, 2020-05-18T21:38:35.770 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 9.7064085969999994 2020-05-18T21:38:35.770 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:38:35.775 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 10348, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.3322552239999998, "mdsmap_epoch": 150, "osdmap_epoch": 167, "osdmap_epoch_barrier": 166, "uptime": 9.7064085969999994 } 2020-05-18T21:38:35.776 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:38:35.777 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:38:35.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:35.779 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:38:35.788 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:38:35.788 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:38:35.788 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:38:35.789 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:35.790 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:38:35.790 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:35.790 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:35.790 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:35.791 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:35.791 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:35.791 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:35.791 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:35.791 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:38:35.792 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:35.792 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:38:35.792 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42127sec preferred_lft 42127sec 2020-05-18T21:38:35.792 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:38:35.792 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:35.793 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:38:35.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:35.794 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:38:35.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:35.853 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:38:35.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:35.871 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:38:35.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:35.884 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:38:35.896 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:38:35.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:35.898 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:38:35.950 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:38:35.950 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:38:35.951 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:38:35.951 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:38:35.952 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:38:35.952 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:38:35.952 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:38:35.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:35.953 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:38:35.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:35.970 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:38:35.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:35.984 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:38:36.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:36.044 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:38:36.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:36.050 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:38:36.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:36.056 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:38:36.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:36.117 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-05-18T21:38:36.132 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-05-18T21:38:36.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:36.133 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-05-18T21:38:36.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:36.150 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:38:36.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:36.218 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-05-18T21:38:36.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:36.243 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-05-18T21:38:36.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:36.259 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-05-18T21:38:36.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:36.277 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 up' 2020-05-18T21:38:36.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:36.339 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.0 master ceph-brx' 2020-05-18T21:38:36.357 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-05-18T21:38:36.357 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-05-18T21:38:36.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:36.358 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:38:36.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:36.366 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:38:36.425 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:38:36.426 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:38:36.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:36.427 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:38:36.432 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:38:36.433 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:38:36.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:36.436 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:38:36.452 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:38:36.453 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:38:36.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:36.455 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:38:36.519 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2020-05-18T21:38:36.512+0000 7fc22457b080 -1 init, newargv = 0x55b23f1a0de0 newargc=9 2020-05-18T21:38:36.519 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[41332]: starting ceph client 2020-05-18T21:38:36.529 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[41332]: starting fuse 2020-05-18T21:38:37.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:37.605 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:38:37.620 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:38:37.622 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:38:37.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:37.623 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:38:37.630 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:38:37.630 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:38:37.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:37.631 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:38:37.631 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:38:37.632 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:38:37.632 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:38:37.633 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:38:37.633 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:38:37.634 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:38:37.634 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:38:37.634 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:38:37.635 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:38:37.635 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:38:37.636 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:38:37.636 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:38:37.636 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:38:37.637 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:38:37.637 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:38:37.638 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:38:37.639 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:38:37.640 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:38:37.641 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:38:37.641 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:38:37.642 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:38:37.643 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:38:37.719 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.41332.asok 2020-05-18T21:38:37.724 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.41332.asok 2020-05-18T21:38:37.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:37.725 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.41332.asok status 2020-05-18T21:38:37.823 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:38:37.823 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:38:37.823 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:38:37.824 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:38:37.824 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:38:37.824 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:38:37.824 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:38:37.825 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "41332", 2020-05-18T21:38:37.825 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:38:37.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:37.825 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:38:37.825 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:38:37.826 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 10842, 2020-05-18T21:38:37.826 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:38:37.826 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:38:37.826 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:38:37.826 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 10842 2020-05-18T21:38:37.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:37.827 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:38:37.827 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:37.827 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:38:37.827 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2804511571 2020-05-18T21:38:37.828 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:37.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:37.828 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:38:37.828 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:37.828 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:38:37.828 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2804511571 2020-05-18T21:38:37.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:37.829 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.10842 192.168.0.1:0/2804511571", 2020-05-18T21:38:37.829 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/2804511571", 2020-05-18T21:38:37.829 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:38:37.829 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 150, 2020-05-18T21:38:37.830 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 167, 2020-05-18T21:38:37.830 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:38:37.830 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:38:37.830 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:38:37.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:37.832 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:38:37.832 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:38:37.841 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:38:37.841 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-05-18T21:38:37.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:37.842 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:38:37.899 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2020-05-18T21:38:38.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.008+0000 7f5eb36dc700 1 Processor -- start 2020-05-18T21:38:38.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.008+0000 7f5eb36dc700 1 -- start start 2020-05-18T21:38:38.017 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb36dc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5eac147390 0x7f5eac1477f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:38.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb36dc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5eac0b60e0 0x7f5eac0b6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:38.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb36dc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eac147d10 con 0x7f5eac062da0 2020-05-18T21:38:38.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb36dc700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eac147fb0 con 0x7f5eac147390 2020-05-18T21:38:38.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb36dc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac0b69c0 con 0x7f5eac0b60e0 2020-05-18T21:38:38.018 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb0c77700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5eac147390 0x7f5eac1477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:38.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb0c77700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5eac147390 0x7f5eac1477f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37134/0 (socket says 172.21.15.63:37134) 2020-05-18T21:38:38.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb0c77700 1 -- 172.21.15.63:0/3764368537 learned_addr learned my addr 172.21.15.63:0/3764368537 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:38.019 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb1c79700 1 --2- 172.21.15.63:0/3764368537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5eac0b60e0 0x7f5eac0b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:38.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb0c77700 1 -- 172.21.15.63:0/3764368537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5eac0b60e0 msgr2=0x7f5eac0b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:38.021 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb0c77700 1 --2- 172.21.15.63:0/3764368537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5eac0b60e0 0x7f5eac0b6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:38.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb0c77700 1 -- 172.21.15.63:0/3764368537 >> v1:172.21.15.155:6789/0 conn(0x7f5eac062da0 legacy=0x7f5eac143c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:38.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb0c77700 1 -- 172.21.15.63:0/3764368537 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac063180 con 0x7f5eac147390 2020-05-18T21:38:38.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb1c79700 1 --2- 172.21.15.63:0/3764368537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5eac0b60e0 0x7f5eac0b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:38:38.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb0c77700 1 --2- 172.21.15.63:0/3764368537 >> v2:172.21.15.63:3300/0 conn(0x7f5eac147390 0x7f5eac1477f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5ea8002f70 tx=0x7f5ea8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:38.023 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb0c77700 1 --2- 172.21.15.63:0/3764368537 >> v2:172.21.15.63:3300/0 conn(0x7f5eac147390 0x7f5eac1477f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5ea8002f70 tx=0x7f5ea8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:38.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb0c77700 1 --2- 172.21.15.63:0/3764368537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5eac147390 0x7f5eac1477f0 secure :-1 s=READY pgs=2208 cs=0 l=1 rx=0x7f5ea8002f70 tx=0x7f5ea8007a80).ready entity=mon.0 client_cookie=862ffa835711c80d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:38.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb0c77700 1 --2- 172.21.15.63:0/3764368537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5eac147390 0x7f5eac1477f0 secure :-1 s=THROTTLE_DONE pgs=2208 cs=0 l=1 rx=0x7f5ea8002f70 tx=0x7f5ea8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:38.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5e9bfff700 1 -- 172.21.15.63:0/3764368537 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ea8011760 con 0x7f5eac147390 2020-05-18T21:38:38.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb0c77700 1 --2- 172.21.15.63:0/3764368537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5eac147390 0x7f5eac1477f0 secure :-1 s=THROTTLE_DONE pgs=2208 cs=0 l=1 rx=0x7f5ea8002f70 tx=0x7f5ea8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:38.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5e9bfff700 1 -- 172.21.15.63:0/3764368537 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea80118c0 con 0x7f5eac147390 2020-05-18T21:38:38.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb0c77700 1 --2- 172.21.15.63:0/3764368537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5eac147390 0x7f5eac1477f0 secure :-1 s=THROTTLE_DONE pgs=2208 cs=0 l=1 rx=0x7f5ea8002f70 tx=0x7f5ea8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:38.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb36dc700 1 -- 172.21.15.63:0/3764368537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5eac147390 msgr2=0x7f5eac1477f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:38.029 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5e9bfff700 1 -- 172.21.15.63:0/3764368537 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ea8011ce0 con 0x7f5eac147390 2020-05-18T21:38:38.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb36dc700 1 --2- 172.21.15.63:0/3764368537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5eac147390 0x7f5eac1477f0 secure :-1 s=READY pgs=2208 cs=0 l=1 rx=0x7f5ea8002f70 tx=0x7f5ea8007a80).stop 2020-05-18T21:38:38.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb36dc700 1 -- 172.21.15.63:0/3764368537 shutdown_connections 2020-05-18T21:38:38.030 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb36dc700 1 --2- 172.21.15.63:0/3764368537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5eac0b60e0 0x7f5eac0b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:38.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb36dc700 1 --2- 172.21.15.63:0/3764368537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5eac147390 0x7f5eac1477f0 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:38.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb36dc700 1 -- 172.21.15.63:0/3764368537 >> 172.21.15.63:0/3764368537 conn(0x7f5eac0b70a0 msgr2=0x7f5eac0b74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:38.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb36dc700 1 -- 172.21.15.63:0/3764368537 shutdown_connections 2020-05-18T21:38:38.031 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.012+0000 7f5eb36dc700 1 -- 172.21.15.63:0/3764368537 wait complete. 2020-05-18T21:38:38.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb36dc700 1 Processor -- start 2020-05-18T21:38:38.032 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb36dc700 1 -- start start 2020-05-18T21:38:38.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb36dc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5eac0b60e0 0x7f5eac09d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:38.036 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb36dc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5eac147390 0x7f5eac09d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:38.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb36dc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eac09df80 con 0x7f5eac062da0 2020-05-18T21:38:38.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb36dc700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eac09dd70 con 0x7f5eac147390 2020-05-18T21:38:38.037 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb36dc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac09e220 con 0x7f5eac0b60e0 2020-05-18T21:38:38.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb1c79700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5eac147390 0x7f5eac09d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:38.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb1c79700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5eac147390 0x7f5eac09d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37142/0 (socket says 172.21.15.63:37142) 2020-05-18T21:38:38.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb1c79700 1 -- 172.21.15.63:0/3576789208 learned_addr learned my addr 172.21.15.63:0/3576789208 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:38.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb0c77700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5eac0b60e0 0x7f5eac09d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:38.038 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5e9a7fc700 1 -- 172.21.15.63:0/3576789208 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469824092 0 0) 0x7f5eac09df80 con 0x7f5eac062da0 2020-05-18T21:38:38.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb1c79700 1 -- 172.21.15.63:0/3576789208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5eac0b60e0 msgr2=0x7f5eac09d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:38.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb1c79700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5eac0b60e0 0x7f5eac09d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:38.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb1c79700 1 -- 172.21.15.63:0/3576789208 >> v1:172.21.15.155:6789/0 conn(0x7f5eac062da0 legacy=0x7f5eac138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:38.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb1c79700 1 -- 172.21.15.63:0/3576789208 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac146d80 con 0x7f5eac147390 2020-05-18T21:38:38.039 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb1c79700 1 --2- 172.21.15.63:0/3576789208 >> v2:172.21.15.63:3300/0 conn(0x7f5eac147390 0x7f5eac09d7c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5ea40032f0 tx=0x7f5ea4010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:38.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb1c79700 1 --2- 172.21.15.63:0/3576789208 >> v2:172.21.15.63:3300/0 conn(0x7f5eac147390 0x7f5eac09d7c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5ea40032f0 tx=0x7f5ea4010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:38.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb1c79700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5eac147390 0x7f5eac09d7c0 secure :-1 s=READY pgs=2209 cs=0 l=1 rx=0x7f5ea40032f0 tx=0x7f5ea4010e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:38.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb1c79700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5eac147390 0x7f5eac09d7c0 secure :-1 s=THROTTLE_DONE pgs=2209 cs=0 l=1 rx=0x7f5ea40032f0 tx=0x7f5ea4010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:38.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5e9a7fc700 1 -- 172.21.15.63:0/3576789208 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ea4005e70 con 0x7f5eac147390 2020-05-18T21:38:38.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb1c79700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5eac147390 0x7f5eac09d7c0 secure :-1 s=THROTTLE_DONE pgs=2209 cs=0 l=1 rx=0x7f5ea40032f0 tx=0x7f5ea4010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:38.040 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb1c79700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5eac147390 0x7f5eac09d7c0 secure :-1 s=THROTTLE_DONE pgs=2209 cs=0 l=1 rx=0x7f5ea40032f0 tx=0x7f5ea4010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:38.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5e9a7fc700 1 -- 172.21.15.63:0/3576789208 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea4007560 con 0x7f5eac147390 2020-05-18T21:38:38.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb36dc700 1 -- 172.21.15.63:0/3576789208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eac13a160 con 0x7f5eac147390 2020-05-18T21:38:38.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5e9a7fc700 1 -- 172.21.15.63:0/3576789208 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ea40078c0 con 0x7f5eac147390 2020-05-18T21:38:38.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb36dc700 1 -- 172.21.15.63:0/3576789208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eac13a690 con 0x7f5eac147390 2020-05-18T21:38:38.041 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.016+0000 7f5eb1c79700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5eac147390 0x7f5eac09d7c0 secure :-1 s=THROTTLE_DONE pgs=2209 cs=0 l=1 rx=0x7f5ea40032f0 tx=0x7f5ea4010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:38.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.020+0000 7f5e9a7fc700 1 -- 172.21.15.63:0/3576789208 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5ea40101a0 con 0x7f5eac147390 2020-05-18T21:38:38.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.020+0000 7f5eb1c79700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5eac147390 0x7f5eac09d7c0 secure :-1 s=THROTTLE_DONE pgs=2209 cs=0 l=1 rx=0x7f5ea40032f0 tx=0x7f5ea4010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:38.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.020+0000 7f5e9a7fc700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e8c04f850 0x7f5e8c051d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:38.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.020+0000 7f5e9a7fc700 1 -- 172.21.15.63:0/3576789208 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5ea4063c60 con 0x7f5eac147390 2020-05-18T21:38:38.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.020+0000 7f5eb36dc700 1 -- 172.21.15.63:0/3576789208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eac0569e0 con 0x7f5eac147390 2020-05-18T21:38:38.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.020+0000 7f5eb1478700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e8c04f850 0x7f5e8c051d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:38.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.020+0000 7f5eb1478700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e8c04f850 0x7f5e8c051d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e9c0021b0 tx=0x7f5e9c002760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:38.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.020+0000 7f5eb1478700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e8c04f850 0x7f5e8c051d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e9c0021b0 tx=0x7f5e9c002760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:38.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.020+0000 7f5eb1478700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e8c04f850 0x7f5e8c051d10 secure :-1 s=READY pgs=868 cs=0 l=1 rx=0x7f5e9c0021b0 tx=0x7f5e9c002760).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:38.043 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.024+0000 7f5eb1c79700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5eac147390 0x7f5eac09d7c0 secure :-1 s=THROTTLE_DONE pgs=2209 cs=0 l=1 rx=0x7f5ea40032f0 tx=0x7f5ea4010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:38.044 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.024+0000 7f5e9a7fc700 1 -- 172.21.15.63:0/3576789208 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f5ea403dff0 con 0x7f5eac147390 2020-05-18T21:38:38.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.176+0000 7f5eb36dc700 1 -- 172.21.15.63:0/3576789208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5eac0a0640 con 0x7f5eac147390 2020-05-18T21:38:38.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.296+0000 7f5eb1c79700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5eac147390 0x7f5eac09d7c0 secure :-1 s=THROTTLE_DONE pgs=2209 cs=0 l=1 rx=0x7f5ea40032f0 tx=0x7f5ea4010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:38.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.296+0000 7f5e9a7fc700 1 -- 172.21.15.63:0/3576789208 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v151) v1 ==== 167+0+0 (secure 0 0 0) 0x7f5ea4041610 con 0x7f5eac147390 2020-05-18T21:38:38.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.300+0000 7f5eb36dc700 1 -- 172.21.15.63:0/3576789208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e8c04f850 msgr2=0x7f5e8c051d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:38.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.300+0000 7f5eb36dc700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e8c04f850 0x7f5e8c051d10 secure :-1 s=READY pgs=868 cs=0 l=1 rx=0x7f5e9c0021b0 tx=0x7f5e9c002760).stop 2020-05-18T21:38:38.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.300+0000 7f5eb36dc700 1 -- 172.21.15.63:0/3576789208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5eac147390 msgr2=0x7f5eac09d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:38.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.300+0000 7f5eb36dc700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5eac147390 0x7f5eac09d7c0 secure :-1 s=READY pgs=2209 cs=0 l=1 rx=0x7f5ea40032f0 tx=0x7f5ea4010e10).stop 2020-05-18T21:38:38.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.300+0000 7f5eb36dc700 1 -- 172.21.15.63:0/3576789208 shutdown_connections 2020-05-18T21:38:38.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.300+0000 7f5eb36dc700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f5e8c04f850 0x7f5e8c051d10 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:38.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.300+0000 7f5eb36dc700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5eac147390 0x7f5eac09d7c0 unknown :-1 s=CLOSED pgs=2209 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.300+0000 7f5eb36dc700 1 --2- 172.21.15.63:0/3576789208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5eac0b60e0 0x7f5eac09d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.300+0000 7f5eb36dc700 1 -- 172.21.15.63:0/3576789208 >> 172.21.15.63:0/3576789208 conn(0x7f5eac0b70a0 msgr2=0x7f5eac0b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.300+0000 7f5eb36dc700 1 -- 172.21.15.63:0/3576789208 shutdown_connections 2020-05-18T21:38:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:38.300+0000 7f5eb36dc700 1 -- 172.21.15.63:0/3576789208 wait complete. 2020-05-18T21:38:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:enabled new snapshots 2020-05-18T21:38:38.320 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir snapdir) 2020-05-18T21:38:38.349 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir snapdir/subdir) 2020-05-18T21:38:38.416 INFO:tasks.cephfs.mount:Writing 8388608 bytes to snapdir/subdir/file_a 2020-05-18T21:38:38.417 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:38:38.417 INFO:teuthology.orchestra.run.smithi063:> import zlib 2020-05-18T21:38:38.418 INFO:teuthology.orchestra.run.smithi063:> path = "/home/ubuntu/cephtest/mnt.0/snapdir/subdir/file_a" 2020-05-18T21:38:38.418 INFO:teuthology.orchestra.run.smithi063:> with open(path, '"'"'w'"'"') as f: 2020-05-18T21:38:38.419 INFO:teuthology.orchestra.run.smithi063:> for i in range(0, 8388608): 2020-05-18T21:38:38.419 INFO:teuthology.orchestra.run.smithi063:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2020-05-18T21:38:38.419 INFO:teuthology.orchestra.run.smithi063:> f.write(chr(val)) 2020-05-18T21:38:38.420 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:38:42.696 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:38:42.697 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:38:42.697 INFO:teuthology.orchestra.run.smithi063:> import stat 2020-05-18T21:38:42.698 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:38:42.698 INFO:teuthology.orchestra.run.smithi063:> print(os.stat("/home/ubuntu/cephtest/mnt.0/snapdir/subdir/file_a").st_ino) 2020-05-18T21:38:42.698 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:38:42.778 INFO:teuthology.orchestra.run.smithi063.stdout:1099511627778 2020-05-18T21:38:42.968 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir snapdir/.snap/snap1) 2020-05-18T21:38:43.049 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo dd if=/dev/urandom of=snapdir/subdir/file_a bs=1M conv=fdatasync count=8 seek=0) 2020-05-18T21:38:43.224 INFO:teuthology.orchestra.run.smithi063.stderr:8+0 records in 2020-05-18T21:38:43.224 INFO:teuthology.orchestra.run.smithi063.stderr:8+0 records out 2020-05-18T21:38:43.224 INFO:teuthology.orchestra.run.smithi063.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.0910351 s, 92.1 MB/s 2020-05-18T21:38:43.226 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:38:43.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.320+0000 7ff39ceb5700 1 Processor -- start 2020-05-18T21:38:43.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.320+0000 7ff39ceb5700 1 -- start start 2020-05-18T21:38:43.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.320+0000 7ff39ceb5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff39809e270 0x7ff39809c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:43.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.320+0000 7ff39ceb5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff39809c960 0x7ff39809cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:43.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.320+0000 7ff39ceb5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39809db30 con 0x7ff3980b3940 2020-05-18T21:38:43.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.320+0000 7ff39ceb5700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff39809ddd0 con 0x7ff39809e270 2020-05-18T21:38:43.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.320+0000 7ff39ceb5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39809d870 con 0x7ff39809c960 2020-05-18T21:38:43.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.320+0000 7ff39659c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff3980b3940 0x7ff3980b3d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39338/0 (socket says 172.21.15.63:39338) 2020-05-18T21:38:43.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.320+0000 7ff39659c700 1 -- 172.21.15.63:0/2889970628 learned_addr learned my addr 172.21.15.63:0/2889970628 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:43.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.320+0000 7ff38ffff700 1 --2- 172.21.15.63:0/2889970628 >> v2:172.21.15.63:3300/0 conn(0x7ff39809e270 0x7ff39809c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:43.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff396d9d700 1 --2- 172.21.15.63:0/2889970628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff39809c960 0x7ff39809cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:43.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff395d9b700 1 -- 172.21.15.63:0/2889970628 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110274065 0 0) 0x7ff39809db30 con 0x7ff3980b3940 2020-05-18T21:38:43.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff395d9b700 1 -- 172.21.15.63:0/2889970628 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff378003270 con 0x7ff3980b3940 2020-05-18T21:38:43.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff396d9d700 1 -- 172.21.15.63:0/2889970628 >> v2:172.21.15.63:3300/0 conn(0x7ff39809e270 msgr2=0x7ff39809c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:43.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff396d9d700 1 --2- 172.21.15.63:0/2889970628 >> v2:172.21.15.63:3300/0 conn(0x7ff39809e270 0x7ff39809c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:43.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff396d9d700 1 -- 172.21.15.63:0/2889970628 >> v1:172.21.15.63:6789/0 conn(0x7ff3980b3940 legacy=0x7ff3980b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:43.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff396d9d700 1 -- 172.21.15.63:0/2889970628 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39809e6d0 con 0x7ff39809c960 2020-05-18T21:38:43.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff396d9d700 1 --2- 172.21.15.63:0/2889970628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff39809c960 0x7ff39809cdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff3900032f0 tx=0x7ff390007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:43.338 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff396d9d700 1 --2- 172.21.15.63:0/2889970628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff39809c960 0x7ff39809cdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff3900032f0 tx=0x7ff390007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:43.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff396d9d700 1 --2- 172.21.15.63:0/2889970628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff39809c960 0x7ff39809cdb0 secure :-1 s=READY pgs=342 cs=0 l=1 rx=0x7ff3900032f0 tx=0x7ff390007e00).ready entity=mon.2 client_cookie=67e63f5ddafcdc58 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:43.339 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff396d9d700 1 --2- 172.21.15.63:0/2889970628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff39809c960 0x7ff39809cdb0 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7ff3900032f0 tx=0x7ff390007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:43.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff395d9b700 1 -- 172.21.15.63:0/2889970628 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff390011db0 con 0x7ff39809c960 2020-05-18T21:38:43.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff396d9d700 1 --2- 172.21.15.63:0/2889970628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff39809c960 0x7ff39809cdb0 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7ff3900032f0 tx=0x7ff390007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:43.340 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff395d9b700 1 -- 172.21.15.63:0/2889970628 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39000a180 con 0x7ff39809c960 2020-05-18T21:38:43.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff396d9d700 1 --2- 172.21.15.63:0/2889970628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff39809c960 0x7ff39809cdb0 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7ff3900032f0 tx=0x7ff390007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:43.341 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff395d9b700 1 -- 172.21.15.63:0/2889970628 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff39000a560 con 0x7ff39809c960 2020-05-18T21:38:43.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff39ceb5700 1 -- 172.21.15.63:0/2889970628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff39809c960 msgr2=0x7ff39809cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:43.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff39ceb5700 1 --2- 172.21.15.63:0/2889970628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff39809c960 0x7ff39809cdb0 secure :-1 s=READY pgs=342 cs=0 l=1 rx=0x7ff3900032f0 tx=0x7ff390007e00).stop 2020-05-18T21:38:43.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff39ceb5700 1 -- 172.21.15.63:0/2889970628 shutdown_connections 2020-05-18T21:38:43.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff39ceb5700 1 --2- 172.21.15.63:0/2889970628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff39809c960 0x7ff39809cdb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:43.342 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff39ceb5700 1 --2- 172.21.15.63:0/2889970628 >> v2:172.21.15.63:3300/0 conn(0x7ff39809e270 0x7ff39809c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:43.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff39ceb5700 1 -- 172.21.15.63:0/2889970628 >> 172.21.15.63:0/2889970628 conn(0x7ff39805a7c0 msgr2=0x7ff39805abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:43.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff39ceb5700 1 -- 172.21.15.63:0/2889970628 shutdown_connections 2020-05-18T21:38:43.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.324+0000 7ff39ceb5700 1 -- 172.21.15.63:0/2889970628 wait complete. 2020-05-18T21:38:43.343 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff39ceb5700 1 Processor -- start 2020-05-18T21:38:43.344 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff39ceb5700 1 -- start start 2020-05-18T21:38:43.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff39ceb5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff39809e270 0x7ff398150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:43.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff39ceb5700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff398142ee0 con 0x7ff39809c960 2020-05-18T21:38:43.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff39ceb5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff398143180 con 0x7ff3980b3940 2020-05-18T21:38:43.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff39ceb5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff398143420 con 0x7ff39809e270 2020-05-18T21:38:43.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff39659c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff39809c960 0x7ff398061030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39344/0 (socket says 172.21.15.63:39344) 2020-05-18T21:38:43.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff39659c700 1 -- 172.21.15.63:0/365163891 learned_addr learned my addr 172.21.15.63:0/365163891 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:43.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38ffff700 1 --2- 172.21.15.63:0/365163891 >> v2:172.21.15.155:3300/0 conn(0x7ff39809e270 0x7ff398150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:43.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125698949 0 0) 0x7ff398142ee0 con 0x7ff39809c960 2020-05-18T21:38:43.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff37c002fe0 con 0x7ff39809c960 2020-05-18T21:38:43.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517613396 0 0) 0x7ff398143180 con 0x7ff3980b3940 2020-05-18T21:38:43.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff398142ee0 con 0x7ff3980b3940 2020-05-18T21:38:43.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1682011710 0 0) 0x7ff37c002fe0 con 0x7ff39809c960 2020-05-18T21:38:43.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff398143180 con 0x7ff39809c960 2020-05-18T21:38:43.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7ff3880018c0 con 0x7ff39809c960 2020-05-18T21:38:43.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 >> v2:172.21.15.155:3300/0 conn(0x7ff39809e270 msgr2=0x7ff398150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:43.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 --2- 172.21.15.63:0/365163891 >> v2:172.21.15.155:3300/0 conn(0x7ff39809e270 0x7ff398150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:43.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 >> v1:172.21.15.155:6789/0 conn(0x7ff3980b3940 legacy=0x7ff398154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:43.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 >> v1:172.21.15.63:6789/0 conn(0x7ff39809c960 legacy=0x7ff398061030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:43.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff37c004bf0 0x7ff37c004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:43.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff37c003b30 0x7ff37c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:43.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff37c0043d0 0x7ff37c00b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:43.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff398143420 con 0x7ff37c0043d0 2020-05-18T21:38:43.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c004900 con 0x7ff37c004bf0 2020-05-18T21:38:43.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c00bbc0 con 0x7ff37c003b30 2020-05-18T21:38:43.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38ffff700 1 --2- 172.21.15.63:0/365163891 >> v2:172.21.15.155:3300/0 conn(0x7ff39809e270 0x7ff398150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:38:43.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff396d9d700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff37c0043d0 0x7ff37c00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:43.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff39659c700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff37c004bf0 0x7ff37c004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:43.353 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38ffff700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff37c003b30 0x7ff37c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:43.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff396d9d700 1 -- 172.21.15.63:0/365163891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff37c003b30 msgr2=0x7ff37c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:43.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff396d9d700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff37c003b30 0x7ff37c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:43.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff396d9d700 1 -- 172.21.15.63:0/365163891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff37c004bf0 msgr2=0x7ff37c004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:43.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff396d9d700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff37c004bf0 0x7ff37c004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:43.354 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff396d9d700 1 -- 172.21.15.63:0/365163891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff398061740 con 0x7ff37c0043d0 2020-05-18T21:38:43.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff39ceb5700 1 -- 172.21.15.63:0/365163891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff398146f90 con 0x7ff37c0043d0 2020-05-18T21:38:43.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff396d9d700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff37c0043d0 0x7ff37c00b760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff390008880 tx=0x7ff390007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:43.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38ffff700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff37c003b30 0x7ff37c003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:38:43.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff396d9d700 1 -- 172.21.15.63:0/365163891 reap_dead start 2020-05-18T21:38:43.355 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff39ceb5700 1 -- 172.21.15.63:0/365163891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff398142be0 con 0x7ff37c0043d0 2020-05-18T21:38:43.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff396d9d700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff37c0043d0 0x7ff37c00b760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff390008880 tx=0x7ff390007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:43.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff396d9d700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff37c0043d0 0x7ff37c00b760 secure :-1 s=READY pgs=2212 cs=0 l=1 rx=0x7ff390008880 tx=0x7ff390007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:43.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff396d9d700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff37c0043d0 0x7ff37c00b760 secure :-1 s=THROTTLE_DONE pgs=2212 cs=0 l=1 rx=0x7ff390008880 tx=0x7ff390007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:43.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff396d9d700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff37c0043d0 0x7ff37c00b760 secure :-1 s=THROTTLE_DONE pgs=2212 cs=0 l=1 rx=0x7ff390008880 tx=0x7ff390007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:43.356 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff390005c70 con 0x7ff37c0043d0 2020-05-18T21:38:43.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff396d9d700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff37c0043d0 0x7ff37c00b760 secure :-1 s=THROTTLE_DONE pgs=2212 cs=0 l=1 rx=0x7ff390008880 tx=0x7ff390007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:43.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff390005dd0 con 0x7ff37c0043d0 2020-05-18T21:38:43.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.328+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff39000f590 con 0x7ff37c0043d0 2020-05-18T21:38:43.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.332+0000 7ff396d9d700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff37c0043d0 0x7ff37c00b760 secure :-1 s=THROTTLE_DONE pgs=2212 cs=0 l=1 rx=0x7ff390008880 tx=0x7ff390007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:43.357 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.332+0000 7ff39ceb5700 1 -- 172.21.15.63:0/365163891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff370003380 con 0x7ff37c0043d0 2020-05-18T21:38:43.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.332+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff39000f6f0 con 0x7ff37c0043d0 2020-05-18T21:38:43.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.332+0000 7ff396d9d700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff37c0043d0 0x7ff37c00b760 secure :-1 s=THROTTLE_DONE pgs=2212 cs=0 l=1 rx=0x7ff390008880 tx=0x7ff390007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:43.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.332+0000 7ff38f7fe700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff37c0538d0 0x7ff37c055d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:43.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.332+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff390064780 con 0x7ff37c0043d0 2020-05-18T21:38:43.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.332+0000 7ff39659c700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff37c0538d0 0x7ff37c055d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:43.358 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.332+0000 7ff39659c700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff37c0538d0 0x7ff37c055d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff3880055c0 tx=0x7ff388009c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:43.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.332+0000 7ff39659c700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff37c0538d0 0x7ff37c055d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff3880055c0 tx=0x7ff388009c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:43.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.332+0000 7ff39659c700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff37c0538d0 0x7ff37c055d90 secure :-1 s=READY pgs=869 cs=0 l=1 rx=0x7ff3880055c0 tx=0x7ff388009c00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:43.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.336+0000 7ff396d9d700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff37c0043d0 0x7ff37c00b760 secure :-1 s=THROTTLE_DONE pgs=2212 cs=0 l=1 rx=0x7ff390008880 tx=0x7ff390007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:43.359 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.336+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ff39003ec30 con 0x7ff37c0043d0 2020-05-18T21:38:43.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.480+0000 7ff39ceb5700 1 -- 172.21.15.63:0/365163891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff370003720 con 0x7ff37c0043d0 2020-05-18T21:38:43.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.480+0000 7ff396d9d700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff37c0043d0 0x7ff37c00b760 secure :-1 s=THROTTLE_DONE pgs=2212 cs=0 l=1 rx=0x7ff390008880 tx=0x7ff390007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:43.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.480+0000 7ff38f7fe700 1 -- 172.21.15.63:0/365163891 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 151 v151) v1 ==== 95+0+2149 (secure 0 0 0) 0x7ff390042250 con 0x7ff37c0043d0 2020-05-18T21:38:43.487 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:43.488 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":151,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7370,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/726870500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":726870500},{"type":"v1","addr":"172.21.15.63:6833","nonce":726870500}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":149}],"filesystems":[{"mdsmap":{"epoch":151,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-05-18T21:38:30.427505+0000","modified":"2020-05-18T21:38:38.296029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10348":{"gid":10348,"name":"b","rank":0,"incarnation":149,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/3932257542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3932257542},{"type":"v1","addr":"172.21.15.155:6835","nonce":3932257542}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2020-05-18T21:38:43.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.480+0000 7ff39ceb5700 1 -- 172.21.15.63:0/365163891 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff37c0538d0 msgr2=0x7ff37c055d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:43.489 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.480+0000 7ff39ceb5700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff37c0538d0 0x7ff37c055d90 secure :-1 s=READY pgs=869 cs=0 l=1 rx=0x7ff3880055c0 tx=0x7ff388009c00).stop 2020-05-18T21:38:43.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.480+0000 7ff39ceb5700 1 -- 172.21.15.63:0/365163891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff37c0043d0 msgr2=0x7ff37c00b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:43.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.480+0000 7ff39ceb5700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff37c0043d0 0x7ff37c00b760 secure :-1 s=READY pgs=2212 cs=0 l=1 rx=0x7ff390008880 tx=0x7ff390007e00).stop 2020-05-18T21:38:43.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.480+0000 7ff39ceb5700 1 -- 172.21.15.63:0/365163891 shutdown_connections 2020-05-18T21:38:43.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.480+0000 7ff39ceb5700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff37c0538d0 0x7ff37c055d90 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:43.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.480+0000 7ff39ceb5700 1 --2- 172.21.15.63:0/365163891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff37c0043d0 0x7ff37c00b760 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:43.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.480+0000 7ff39ceb5700 1 -- 172.21.15.63:0/365163891 >> 172.21.15.63:0/365163891 conn(0x7ff39805a7c0 msgr2=0x7ff3980b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:43.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.480+0000 7ff39ceb5700 1 -- 172.21.15.63:0/365163891 shutdown_connections 2020-05-18T21:38:43.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:43.480+0000 7ff39ceb5700 1 -- 172.21.15.63:0/365163891 wait complete. 2020-05-18T21:38:43.491 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 151 2020-05-18T21:38:43.499 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok flush journal 2020-05-18T21:38:43.624 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:38:43.625 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "", 2020-05-18T21:38:43.625 INFO:teuthology.orchestra.run.smithi155.stdout: "return_code": 0 2020-05-18T21:38:43.625 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:38:43.634 INFO:tasks.cephfs.filesystem:_json_asok output: { "message": "", "return_code": 0 } 2020-05-18T21:38:43.635 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rm -f snapdir/subdir/file_a) 2020-05-18T21:38:43.653 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rmdir snapdir/subdir) 2020-05-18T21:38:43.729 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:38:43.730 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:38:43.730 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:38:43.746 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[41332]: fuse finished with error 0 and tester_r 0 2020-05-18T21:38:43.749 INFO:teuthology.orchestra.run:waiting for 900 2020-05-18T21:38:49.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:49.852 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:38:49.860 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:38:49.861 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:38:49.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:49.862 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 down' 2020-05-18T21:38:49.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:49.883 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.0' 2020-05-18T21:38:49.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:49.960 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:38:49.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:49.980 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:38:50.029 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:38:50.029 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:38:50.030 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:38:50.030 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:50.030 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:38:50.030 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:50.030 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:50.031 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:50.031 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:50.031 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:50.031 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:50.031 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:50.032 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:38:50.032 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:50.032 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:38:50.032 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42113sec preferred_lft 42113sec 2020-05-18T21:38:50.032 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:38:50.032 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:50.033 INFO:teuthology.orchestra.run.smithi063.stdout:41: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-05-18T21:38:50.033 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:50.033 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:38:50.033 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:50.033 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::1ca5:8ff:fe80:6729/64 scope link 2020-05-18T21:38:50.034 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:50.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:50.034 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:38:50.053 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:38:50.053 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:38:50.053 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:38:50.053 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:50.054 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:38:50.054 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:50.054 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:38:50.054 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:50.054 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:38:50.055 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:50.055 INFO:teuthology.orchestra.run.smithi063.stdout:41: ceph-brx: mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:38:50.055 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:50.056 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:38:50.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:50.057 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:38:50.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:50.077 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:38:50.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:50.275 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:38:50.285 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:38:50.285 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:38:50.286 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:38:50.286 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:38:50.286 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:38:50.286 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:38:50.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:50.287 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:38:50.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:50.301 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:38:50.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:50.313 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:38:50.327 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:38:50.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f23661eb700 1 Processor -- start 2020-05-18T21:38:50.478 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f23661eb700 1 -- start start 2020-05-18T21:38:50.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f23661eb700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2360061840 0x7f236014ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:50.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f23661eb700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f236006a280 0x7f236014d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:50.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f23661eb700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236006a6f0 con 0x7f2360061c20 2020-05-18T21:38:50.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f23661eb700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236014a6f0 con 0x7f2360061840 2020-05-18T21:38:50.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f23661eb700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236014a990 con 0x7f236006a280 2020-05-18T21:38:50.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f235f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2360061840 0x7f236014ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:50.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f235effd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2360061c20 0x7f2360069b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39360/0 (socket says 172.21.15.63:39360) 2020-05-18T21:38:50.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f235f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2360061840 0x7f236014ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37170/0 (socket says 172.21.15.63:37170) 2020-05-18T21:38:50.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f235effd700 1 -- 172.21.15.63:0/3025753216 learned_addr learned my addr 172.21.15.63:0/3025753216 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:50.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f235ffff700 1 --2- 172.21.15.63:0/3025753216 >> v2:172.21.15.155:3300/0 conn(0x7f236006a280 0x7f236014d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:50.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f235f7fe700 1 -- 172.21.15.63:0/3025753216 >> v2:172.21.15.155:3300/0 conn(0x7f236006a280 msgr2=0x7f236014d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:50.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f235f7fe700 1 --2- 172.21.15.63:0/3025753216 >> v2:172.21.15.155:3300/0 conn(0x7f236006a280 0x7f236014d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:50.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f235f7fe700 1 -- 172.21.15.63:0/3025753216 >> v1:172.21.15.63:6789/0 conn(0x7f2360061c20 legacy=0x7f2360069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:50.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f235e7fc700 1 -- 172.21.15.63:0/3025753216 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079675637 0 0) 0x7f236006a6f0 con 0x7f2360061c20 2020-05-18T21:38:50.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f235f7fe700 1 -- 172.21.15.63:0/3025753216 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236014a3e0 con 0x7f2360061840 2020-05-18T21:38:50.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f235f7fe700 1 --2- 172.21.15.63:0/3025753216 >> v2:172.21.15.63:3300/0 conn(0x7f2360061840 0x7f236014ae30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2350002f70 tx=0x7f2350007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f235f7fe700 1 --2- 172.21.15.63:0/3025753216 >> v2:172.21.15.63:3300/0 conn(0x7f2360061840 0x7f236014ae30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2350002f70 tx=0x7f2350007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.472+0000 7f235f7fe700 1 --2- 172.21.15.63:0/3025753216 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2360061840 0x7f236014ae30 secure :-1 s=READY pgs=2214 cs=0 l=1 rx=0x7f2350002f70 tx=0x7f2350007a80).ready entity=mon.0 client_cookie=97d6d030d0a3a875 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:50.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.476+0000 7f235f7fe700 1 --2- 172.21.15.63:0/3025753216 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2360061840 0x7f236014ae30 secure :-1 s=THROTTLE_DONE pgs=2214 cs=0 l=1 rx=0x7f2350002f70 tx=0x7f2350007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.476+0000 7f235f7fe700 1 --2- 172.21.15.63:0/3025753216 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2360061840 0x7f236014ae30 secure :-1 s=THROTTLE_DONE pgs=2214 cs=0 l=1 rx=0x7f2350002f70 tx=0x7f2350007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.476+0000 7f235e7fc700 1 -- 172.21.15.63:0/3025753216 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2350008e50 con 0x7f2360061840 2020-05-18T21:38:50.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.476+0000 7f235f7fe700 1 --2- 172.21.15.63:0/3025753216 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2360061840 0x7f236014ae30 secure :-1 s=THROTTLE_DONE pgs=2214 cs=0 l=1 rx=0x7f2350002f70 tx=0x7f2350007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.476+0000 7f235e7fc700 1 -- 172.21.15.63:0/3025753216 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23500115f0 con 0x7f2360061840 2020-05-18T21:38:50.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.476+0000 7f235e7fc700 1 -- 172.21.15.63:0/3025753216 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23500119d0 con 0x7f2360061840 2020-05-18T21:38:50.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.476+0000 7f23661eb700 1 -- 172.21.15.63:0/3025753216 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2360061840 msgr2=0x7f236014ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:50.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.476+0000 7f23661eb700 1 --2- 172.21.15.63:0/3025753216 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2360061840 0x7f236014ae30 secure :-1 s=READY pgs=2214 cs=0 l=1 rx=0x7f2350002f70 tx=0x7f2350007a80).stop 2020-05-18T21:38:50.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.476+0000 7f23661eb700 1 -- 172.21.15.63:0/3025753216 shutdown_connections 2020-05-18T21:38:50.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.476+0000 7f23661eb700 1 --2- 172.21.15.63:0/3025753216 >> v2:172.21.15.155:3300/0 conn(0x7f236006a280 0x7f236014d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:50.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.476+0000 7f23661eb700 1 --2- 172.21.15.63:0/3025753216 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2360061840 0x7f236014ae30 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:50.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.476+0000 7f23661eb700 1 -- 172.21.15.63:0/3025753216 >> 172.21.15.63:0/3025753216 conn(0x7f23600ba5c0 msgr2=0x7f23600ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:50.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.476+0000 7f23661eb700 1 -- 172.21.15.63:0/3025753216 shutdown_connections 2020-05-18T21:38:50.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.476+0000 7f23661eb700 1 -- 172.21.15.63:0/3025753216 wait complete. 2020-05-18T21:38:50.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.476+0000 7f23661eb700 1 Processor -- start 2020-05-18T21:38:50.490 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.476+0000 7f23661eb700 1 -- start start 2020-05-18T21:38:50.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f23661eb700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f236006a280 0x7f2360065f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:50.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f23661eb700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23601575e0 con 0x7f2360061840 2020-05-18T21:38:50.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f23661eb700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23600b1b30 con 0x7f2360061c20 2020-05-18T21:38:50.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f23661eb700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2360065d50 con 0x7f236006a280 2020-05-18T21:38:50.491 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f235f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2360061840 0x7f2360140610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39364/0 (socket says 172.21.15.63:39364) 2020-05-18T21:38:50.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f235f7fe700 1 -- 172.21.15.63:0/1317471320 learned_addr learned my addr 172.21.15.63:0/1317471320 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:50.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f235ffff700 1 --2- 172.21.15.63:0/1317471320 >> v2:172.21.15.155:3300/0 conn(0x7f236006a280 0x7f2360065f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:50.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f235cff9700 1 -- 172.21.15.63:0/1317471320 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3383006675 0 0) 0x7f23601575e0 con 0x7f2360061840 2020-05-18T21:38:50.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f235cff9700 1 -- 172.21.15.63:0/1317471320 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2344002fe0 con 0x7f2360061840 2020-05-18T21:38:50.492 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f235ffff700 1 -- 172.21.15.63:0/1317471320 >> v1:172.21.15.155:6789/0 conn(0x7f2360061c20 legacy=0x7f23600b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:50.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f235ffff700 1 -- 172.21.15.63:0/1317471320 >> v1:172.21.15.63:6789/0 conn(0x7f2360061840 legacy=0x7f2360140610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:50.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f235cff9700 1 -- 172.21.15.63:0/1317471320 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247586753 0 0) 0x7f23600b1b30 con 0x7f2360061c20 2020-05-18T21:38:50.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f235ffff700 1 -- 172.21.15.63:0/1317471320 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23600b1d90 con 0x7f236006a280 2020-05-18T21:38:50.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f235ffff700 1 --2- 172.21.15.63:0/1317471320 >> v2:172.21.15.155:3300/0 conn(0x7f236006a280 0x7f2360065f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2358002f70 tx=0x7f2358010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.493 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f235ffff700 1 --2- 172.21.15.63:0/1317471320 >> v2:172.21.15.155:3300/0 conn(0x7f236006a280 0x7f2360065f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2358002f70 tx=0x7f2358010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f235ffff700 1 --2- 172.21.15.63:0/1317471320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f236006a280 0x7f2360065f40 secure :-1 s=READY pgs=1484 cs=0 l=1 rx=0x7f2358002f70 tx=0x7f2358010b80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:50.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f235ffff700 1 --2- 172.21.15.63:0/1317471320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f236006a280 0x7f2360065f40 secure :-1 s=THROTTLE_DONE pgs=1484 cs=0 l=1 rx=0x7f2358002f70 tx=0x7f2358010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f235cff9700 1 -- 172.21.15.63:0/1317471320 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2358007550 con 0x7f236006a280 2020-05-18T21:38:50.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f235ffff700 1 --2- 172.21.15.63:0/1317471320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f236006a280 0x7f2360065f40 secure :-1 s=THROTTLE_DONE pgs=1484 cs=0 l=1 rx=0x7f2358002f70 tx=0x7f2358010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f235ffff700 1 --2- 172.21.15.63:0/1317471320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f236006a280 0x7f2360065f40 secure :-1 s=THROTTLE_DONE pgs=1484 cs=0 l=1 rx=0x7f2358002f70 tx=0x7f2358010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.494 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f235cff9700 1 -- 172.21.15.63:0/1317471320 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2358005700 con 0x7f236006a280 2020-05-18T21:38:50.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f235cff9700 1 -- 172.21.15.63:0/1317471320 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2358005a60 con 0x7f236006a280 2020-05-18T21:38:50.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f23661eb700 1 -- 172.21.15.63:0/1317471320 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2360140d20 con 0x7f236006a280 2020-05-18T21:38:50.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.480+0000 7f23661eb700 1 -- 172.21.15.63:0/1317471320 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23600658d0 con 0x7f236006a280 2020-05-18T21:38:50.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.484+0000 7f235ffff700 1 --2- 172.21.15.63:0/1317471320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f236006a280 0x7f2360065f40 secure :-1 s=THROTTLE_DONE pgs=1484 cs=0 l=1 rx=0x7f2358002f70 tx=0x7f2358010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.495 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.484+0000 7f23661eb700 1 -- 172.21.15.63:0/1317471320 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23600569e0 con 0x7f236006a280 2020-05-18T21:38:50.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.484+0000 7f235ffff700 1 --2- 172.21.15.63:0/1317471320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f236006a280 0x7f2360065f40 secure :-1 s=THROTTLE_DONE pgs=1484 cs=0 l=1 rx=0x7f2358002f70 tx=0x7f2358010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.484+0000 7f235cff9700 1 -- 172.21.15.63:0/1317471320 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f2358005c60 con 0x7f236006a280 2020-05-18T21:38:50.496 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.484+0000 7f235cff9700 1 --2- 172.21.15.63:0/1317471320 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f234404fce0 0x7f23440521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:50.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.484+0000 7f235cff9700 1 -- 172.21.15.63:0/1317471320 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2358063e60 con 0x7f236006a280 2020-05-18T21:38:50.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.484+0000 7f235f7fe700 1 --2- 172.21.15.63:0/1317471320 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f234404fce0 0x7f23440521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:50.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.484+0000 7f235f7fe700 1 --2- 172.21.15.63:0/1317471320 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f234404fce0 0x7f23440521a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2350008920 tx=0x7f2350007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.497 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.484+0000 7f235f7fe700 1 --2- 172.21.15.63:0/1317471320 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f234404fce0 0x7f23440521a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2350008920 tx=0x7f2350007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.498 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.484+0000 7f235f7fe700 1 --2- 172.21.15.63:0/1317471320 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f234404fce0 0x7f23440521a0 secure :-1 s=READY pgs=870 cs=0 l=1 rx=0x7f2350008920 tx=0x7f2350007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:50.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.492+0000 7f235ffff700 1 --2- 172.21.15.63:0/1317471320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f236006a280 0x7f2360065f40 secure :-1 s=THROTTLE_DONE pgs=1484 cs=0 l=1 rx=0x7f2358002f70 tx=0x7f2358010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.500 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.492+0000 7f235cff9700 1 -- 172.21.15.63:0/1317471320 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f235803e150 con 0x7f236006a280 2020-05-18T21:38:50.652 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.644+0000 7f23661eb700 1 -- 172.21.15.63:0/1317471320 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23600008d0 con 0x7f236006a280 2020-05-18T21:38:50.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.648+0000 7f235ffff700 1 --2- 172.21.15.63:0/1317471320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f236006a280 0x7f2360065f40 secure :-1 s=THROTTLE_DONE pgs=1484 cs=0 l=1 rx=0x7f2358002f70 tx=0x7f2358010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.653 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.648+0000 7f235cff9700 1 -- 172.21.15.63:0/1317471320 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 151 v151) v1 ==== 95+0+2149 (secure 0 0 0) 0x7f2358041770 con 0x7f236006a280 2020-05-18T21:38:50.654 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:50.654 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":151,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7370,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/726870500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":726870500},{"type":"v1","addr":"172.21.15.63:6833","nonce":726870500}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":149}],"filesystems":[{"mdsmap":{"epoch":151,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-05-18T21:38:30.427505+0000","modified":"2020-05-18T21:38:38.296029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10348":{"gid":10348,"name":"b","rank":0,"incarnation":149,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/3932257542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3932257542},{"type":"v1","addr":"172.21.15.155:6835","nonce":3932257542}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2020-05-18T21:38:50.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.648+0000 7f23661eb700 1 -- 172.21.15.63:0/1317471320 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f234404fce0 msgr2=0x7f23440521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:50.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.648+0000 7f23661eb700 1 --2- 172.21.15.63:0/1317471320 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f234404fce0 0x7f23440521a0 secure :-1 s=READY pgs=870 cs=0 l=1 rx=0x7f2350008920 tx=0x7f2350007a80).stop 2020-05-18T21:38:50.655 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.648+0000 7f23661eb700 1 -- 172.21.15.63:0/1317471320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f236006a280 msgr2=0x7f2360065f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:50.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.648+0000 7f23661eb700 1 --2- 172.21.15.63:0/1317471320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f236006a280 0x7f2360065f40 secure :-1 s=READY pgs=1484 cs=0 l=1 rx=0x7f2358002f70 tx=0x7f2358010b80).stop 2020-05-18T21:38:50.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.648+0000 7f23661eb700 1 -- 172.21.15.63:0/1317471320 shutdown_connections 2020-05-18T21:38:50.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.648+0000 7f23661eb700 1 --2- 172.21.15.63:0/1317471320 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f234404fce0 0x7f23440521a0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:50.656 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.648+0000 7f23661eb700 1 --2- 172.21.15.63:0/1317471320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f236006a280 0x7f2360065f40 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:50.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.648+0000 7f23661eb700 1 -- 172.21.15.63:0/1317471320 >> 172.21.15.63:0/1317471320 conn(0x7f23600ba5c0 msgr2=0x7f236014ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:50.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.648+0000 7f23661eb700 1 -- 172.21.15.63:0/1317471320 shutdown_connections 2020-05-18T21:38:50.657 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.648+0000 7f23661eb700 1 -- 172.21.15.63:0/1317471320 wait complete. 2020-05-18T21:38:50.658 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 151 2020-05-18T21:38:50.666 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump mds_cache strays_created 2020-05-18T21:38:50.772 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:38:50.772 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:38:50.772 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 2 2020-05-18T21:38:50.772 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:38:50.773 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:38:50.781 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_created": 2 } } 2020-05-18T21:38:50.782 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:38:50.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.880+0000 7f68d6cb1700 1 Processor -- start 2020-05-18T21:38:50.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.880+0000 7f68d6cb1700 1 -- start start 2020-05-18T21:38:50.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68d6cb1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f68d00b2860 0x7f68d00615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:50.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68d6cb1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f68d014e570 0x7f68d014a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:50.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68d6cb1700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d014d960 con 0x7f68d0060b90 2020-05-18T21:38:50.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68d6cb1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d0066210 con 0x7f68d00b2860 2020-05-18T21:38:50.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68d6cb1700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d014db90 con 0x7f68d014e570 2020-05-18T21:38:50.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68cffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f68d00b2860 0x7f68d00615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:50.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68cffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f68d00b2860 0x7f68d00615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37184/0 (socket says 172.21.15.63:37184) 2020-05-18T21:38:50.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68d4a4d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f68d0060b90 0x7f68d0144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39372/0 (socket says 172.21.15.63:39372) 2020-05-18T21:38:50.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68cffff700 1 -- 172.21.15.63:0/3918283451 learned_addr learned my addr 172.21.15.63:0/3918283451 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:50.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68d524e700 1 --2- 172.21.15.63:0/3918283451 >> v2:172.21.15.155:3300/0 conn(0x7f68d014e570 0x7f68d014a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:50.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68cffff700 1 -- 172.21.15.63:0/3918283451 >> v2:172.21.15.155:3300/0 conn(0x7f68d014e570 msgr2=0x7f68d014a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:50.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68cffff700 1 --2- 172.21.15.63:0/3918283451 >> v2:172.21.15.155:3300/0 conn(0x7f68d014e570 0x7f68d014a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:50.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68cffff700 1 -- 172.21.15.63:0/3918283451 >> v1:172.21.15.63:6789/0 conn(0x7f68d0060b90 legacy=0x7f68d0144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:50.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68cffff700 1 -- 172.21.15.63:0/3918283451 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d014de30 con 0x7f68d00b2860 2020-05-18T21:38:50.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68d524e700 1 --2- 172.21.15.63:0/3918283451 >> v2:172.21.15.155:3300/0 conn(0x7f68d014e570 0x7f68d014a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:38:50.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68cffff700 1 --2- 172.21.15.63:0/3918283451 >> v2:172.21.15.63:3300/0 conn(0x7f68d00b2860 0x7f68d00615e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f68c0002f70 tx=0x7f68c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68cffff700 1 --2- 172.21.15.63:0/3918283451 >> v2:172.21.15.63:3300/0 conn(0x7f68d00b2860 0x7f68d00615e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f68c0002f70 tx=0x7f68c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68cffff700 1 --2- 172.21.15.63:0/3918283451 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d00b2860 0x7f68d00615e0 secure :-1 s=READY pgs=2217 cs=0 l=1 rx=0x7f68c0002f70 tx=0x7f68c0007a80).ready entity=mon.0 client_cookie=fa532f306d35486d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:50.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68cffff700 1 --2- 172.21.15.63:0/3918283451 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d00b2860 0x7f68d00615e0 secure :-1 s=THROTTLE_DONE pgs=2217 cs=0 l=1 rx=0x7f68c0002f70 tx=0x7f68c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68cf7fe700 1 -- 172.21.15.63:0/3918283451 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c0011760 con 0x7f68d00b2860 2020-05-18T21:38:50.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68cffff700 1 --2- 172.21.15.63:0/3918283451 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d00b2860 0x7f68d00615e0 secure :-1 s=THROTTLE_DONE pgs=2217 cs=0 l=1 rx=0x7f68c0002f70 tx=0x7f68c0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68cf7fe700 1 -- 172.21.15.63:0/3918283451 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c00118c0 con 0x7f68d00b2860 2020-05-18T21:38:50.895 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68d6cb1700 1 -- 172.21.15.63:0/3918283451 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d00b2860 msgr2=0x7f68d00615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:50.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68d6cb1700 1 --2- 172.21.15.63:0/3918283451 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d00b2860 0x7f68d00615e0 secure :-1 s=READY pgs=2217 cs=0 l=1 rx=0x7f68c0002f70 tx=0x7f68c0007a80).stop 2020-05-18T21:38:50.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68d6cb1700 1 -- 172.21.15.63:0/3918283451 shutdown_connections 2020-05-18T21:38:50.899 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68d6cb1700 1 --2- 172.21.15.63:0/3918283451 >> v2:172.21.15.155:3300/0 conn(0x7f68d014e570 0x7f68d014a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:50.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68d6cb1700 1 --2- 172.21.15.63:0/3918283451 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d00b2860 0x7f68d00615e0 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:50.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68d6cb1700 1 -- 172.21.15.63:0/3918283451 >> 172.21.15.63:0/3918283451 conn(0x7f68d00b83d0 msgr2=0x7f68d00b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:50.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68d6cb1700 1 -- 172.21.15.63:0/3918283451 shutdown_connections 2020-05-18T21:38:50.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68d6cb1700 1 -- 172.21.15.63:0/3918283451 wait complete. 2020-05-18T21:38:50.900 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.884+0000 7f68d6cb1700 1 Processor -- start 2020-05-18T21:38:50.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d6cb1700 1 -- start start 2020-05-18T21:38:50.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d6cb1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68d0060b90 0x7f68d0157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:50.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d6cb1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f68d014e570 0x7f68d0157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:50.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d6cb1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d00ac850 con 0x7f68d00b2860 2020-05-18T21:38:50.901 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d6cb1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d00acaf0 con 0x7f68d014e570 2020-05-18T21:38:50.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d6cb1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d00ac4d0 con 0x7f68d0060b90 2020-05-18T21:38:50.902 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d524e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f68d014e570 0x7f68d0157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:50.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d524e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f68d014e570 0x7f68d0157f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37194/0 (socket says 172.21.15.63:37194) 2020-05-18T21:38:50.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d524e700 1 -- 172.21.15.63:0/4151324371 learned_addr learned my addr 172.21.15.63:0/4151324371 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:50.903 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d4a4d700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68d0060b90 0x7f68d0157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:50.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d524e700 1 -- 172.21.15.63:0/4151324371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68d0060b90 msgr2=0x7f68d0157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:50.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d524e700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68d0060b90 0x7f68d0157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:50.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d524e700 1 -- 172.21.15.63:0/4151324371 >> v1:172.21.15.155:6789/0 conn(0x7f68d00b2860 legacy=0x7f68d01470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:50.904 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d524e700 1 -- 172.21.15.63:0/4151324371 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d00ac610 con 0x7f68d014e570 2020-05-18T21:38:50.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d4a4d700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68d0060b90 0x7f68d0157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:38:50.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d524e700 1 --2- 172.21.15.63:0/4151324371 >> v2:172.21.15.63:3300/0 conn(0x7f68d014e570 0x7f68d0157f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f68c80032b0 tx=0x7f68c8010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.905 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d524e700 1 --2- 172.21.15.63:0/4151324371 >> v2:172.21.15.63:3300/0 conn(0x7f68d014e570 0x7f68d0157f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f68c80032b0 tx=0x7f68c8010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d524e700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d014e570 0x7f68d0157f00 secure :-1 s=READY pgs=2218 cs=0 l=1 rx=0x7f68c80032b0 tx=0x7f68c8010eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:50.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d524e700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d014e570 0x7f68d0157f00 secure :-1 s=THROTTLE_DONE pgs=2218 cs=0 l=1 rx=0x7f68c80032b0 tx=0x7f68c8010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.906 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d524e700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d014e570 0x7f68d0157f00 secure :-1 s=THROTTLE_DONE pgs=2218 cs=0 l=1 rx=0x7f68c80032b0 tx=0x7f68c8010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68cdffb700 1 -- 172.21.15.63:0/4151324371 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c8007370 con 0x7f68d014e570 2020-05-18T21:38:50.907 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d524e700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d014e570 0x7f68d0157f00 secure :-1 s=THROTTLE_DONE pgs=2218 cs=0 l=1 rx=0x7f68c80032b0 tx=0x7f68c8010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68cdffb700 1 -- 172.21.15.63:0/4151324371 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c80074d0 con 0x7f68d014e570 2020-05-18T21:38:50.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d6cb1700 1 -- 172.21.15.63:0/4151324371 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d01477e0 con 0x7f68d014e570 2020-05-18T21:38:50.908 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68cdffb700 1 -- 172.21.15.63:0/4151324371 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c80078b0 con 0x7f68d014e570 2020-05-18T21:38:50.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d6cb1700 1 -- 172.21.15.63:0/4151324371 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d0149f90 con 0x7f68d014e570 2020-05-18T21:38:50.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d524e700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d014e570 0x7f68d0157f00 secure :-1 s=THROTTLE_DONE pgs=2218 cs=0 l=1 rx=0x7f68c80032b0 tx=0x7f68c8010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.909 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.888+0000 7f68d6cb1700 1 -- 172.21.15.63:0/4151324371 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d00569e0 con 0x7f68d014e570 2020-05-18T21:38:50.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.892+0000 7f68cdffb700 1 -- 172.21.15.63:0/4151324371 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f68c8012540 con 0x7f68d014e570 2020-05-18T21:38:50.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.892+0000 7f68d524e700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d014e570 0x7f68d0157f00 secure :-1 s=THROTTLE_DONE pgs=2218 cs=0 l=1 rx=0x7f68c80032b0 tx=0x7f68c8010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.892+0000 7f68cdffb700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f68b404fa60 0x7f68b4051f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:50.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.892+0000 7f68cdffb700 1 -- 172.21.15.63:0/4151324371 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f68c8063bb0 con 0x7f68d014e570 2020-05-18T21:38:50.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.892+0000 7f68d4a4d700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f68b404fa60 0x7f68b4051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:50.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.892+0000 7f68d4a4d700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f68b404fa60 0x7f68b4051f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f68d0067d20 tx=0x7f68b80017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.892+0000 7f68d4a4d700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f68b404fa60 0x7f68b4051f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f68d0067d20 tx=0x7f68b80017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.892+0000 7f68d4a4d700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f68b404fa60 0x7f68b4051f20 secure :-1 s=READY pgs=871 cs=0 l=1 rx=0x7f68d0067d20 tx=0x7f68b80017b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:50.912 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.896+0000 7f68d524e700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d014e570 0x7f68d0157f00 secure :-1 s=THROTTLE_DONE pgs=2218 cs=0 l=1 rx=0x7f68c80032b0 tx=0x7f68c8010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:50.913 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:50.896+0000 7f68cdffb700 1 -- 172.21.15.63:0/4151324371 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f68c803dee0 con 0x7f68d014e570 2020-05-18T21:38:51.022 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.016+0000 7f68d6cb1700 1 -- 172.21.15.63:0/4151324371 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68d0148fa0 con 0x7f68d014e570 2020-05-18T21:38:51.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.016+0000 7f68d524e700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d014e570 0x7f68d0157f00 secure :-1 s=THROTTLE_DONE pgs=2218 cs=0 l=1 rx=0x7f68c80032b0 tx=0x7f68c8010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.024 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.016+0000 7f68cdffb700 1 -- 172.21.15.63:0/4151324371 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f68c8008e60 con 0x7f68d014e570 2020-05-18T21:38:51.025 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:51.025 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":167,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:38:31.431168+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:38:28.730444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2020-05-18T21:38:29.414568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:38:51.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.020+0000 7f68d6cb1700 1 -- 172.21.15.63:0/4151324371 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f68b404fa60 msgr2=0x7f68b4051f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.020+0000 7f68d6cb1700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f68b404fa60 0x7f68b4051f20 secure :-1 s=READY pgs=871 cs=0 l=1 rx=0x7f68d0067d20 tx=0x7f68b80017b0).stop 2020-05-18T21:38:51.026 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.020+0000 7f68d6cb1700 1 -- 172.21.15.63:0/4151324371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d014e570 msgr2=0x7f68d0157f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.020+0000 7f68d6cb1700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d014e570 0x7f68d0157f00 secure :-1 s=READY pgs=2218 cs=0 l=1 rx=0x7f68c80032b0 tx=0x7f68c8010eb0).stop 2020-05-18T21:38:51.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.020+0000 7f68d6cb1700 1 -- 172.21.15.63:0/4151324371 shutdown_connections 2020-05-18T21:38:51.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.020+0000 7f68d6cb1700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f68b404fa60 0x7f68b4051f20 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:51.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.020+0000 7f68d6cb1700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d014e570 0x7f68d0157f00 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:51.027 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.020+0000 7f68d6cb1700 1 --2- 172.21.15.63:0/4151324371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68d0060b90 0x7f68d0157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:51.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.020+0000 7f68d6cb1700 1 -- 172.21.15.63:0/4151324371 >> 172.21.15.63:0/4151324371 conn(0x7f68d00b83d0 msgr2=0x7f68d0064140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:51.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.020+0000 7f68d6cb1700 1 -- 172.21.15.63:0/4151324371 shutdown_connections 2020-05-18T21:38:51.028 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.020+0000 7f68d6cb1700 1 -- 172.21.15.63:0/4151324371 wait complete. 2020-05-18T21:38:51.037 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-05-18T21:26:33.080792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-05-18T21:26:40.149370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 31, 'pool_name': 'cephfs_metadata', 'create_time': '2020-05-18T21:38:28.730444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '166', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 32, 'pool_name': 'cephfs_data', 'create_time': '2020-05-18T21:38:29.414568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-05-18T21:38:51.038 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-05-18T21:38:51.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.136+0000 7f5a02770700 1 Processor -- start 2020-05-18T21:38:51.145 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a02770700 1 -- start start 2020-05-18T21:38:51.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a02770700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f59fc149bc0 0x7f59fc060fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:51.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a02770700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59fc0b5130 0x7f59fc0ae450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:51.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a02770700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59fc0ada70 con 0x7f59fc05ebc0 2020-05-18T21:38:51.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a02770700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59fc0add10 con 0x7f59fc149bc0 2020-05-18T21:38:51.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a02770700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc0adfb0 con 0x7f59fc0b5130 2020-05-18T21:38:51.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a0176e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f59fc149bc0 0x7f59fc060fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:51.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a01f6f700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f59fc05ebc0 0x7f59fc0b3540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:37704/0 (socket says 172.21.15.63:37704) 2020-05-18T21:38:51.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a01f6f700 1 -- 172.21.15.63:0/1275274348 learned_addr learned my addr 172.21.15.63:0/1275274348 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:51.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a00f6d700 1 --2- 172.21.15.63:0/1275274348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59fc0b5130 0x7f59fc0ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:51.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f59fbfff700 1 -- 172.21.15.63:0/1275274348 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710753056 0 0) 0x7f59fc0ada70 con 0x7f59fc05ebc0 2020-05-18T21:38:51.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f59fbfff700 1 -- 172.21.15.63:0/1275274348 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59e8003270 con 0x7f59fc05ebc0 2020-05-18T21:38:51.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a00f6d700 1 -- 172.21.15.63:0/1275274348 >> v2:172.21.15.155:3300/0 conn(0x7f59fc149bc0 msgr2=0x7f59fc060fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:51.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a00f6d700 1 --2- 172.21.15.63:0/1275274348 >> v2:172.21.15.155:3300/0 conn(0x7f59fc149bc0 0x7f59fc060fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:51.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a00f6d700 1 -- 172.21.15.63:0/1275274348 >> v1:172.21.15.155:6789/0 conn(0x7f59fc05ebc0 legacy=0x7f59fc0b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a00f6d700 1 -- 172.21.15.63:0/1275274348 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59fc149fa0 con 0x7f59fc0b5130 2020-05-18T21:38:51.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a00f6d700 1 --2- 172.21.15.63:0/1275274348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59fc0b5130 0x7f59fc0ae450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f59ec0032f0 tx=0x7f59ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a00f6d700 1 --2- 172.21.15.63:0/1275274348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59fc0b5130 0x7f59fc0ae450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f59ec0032f0 tx=0x7f59ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a00f6d700 1 --2- 172.21.15.63:0/1275274348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59fc0b5130 0x7f59fc0ae450 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7f59ec0032f0 tx=0x7f59ec007e00).ready entity=mon.2 client_cookie=e1fc345a61b4e9f4 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:51.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a00f6d700 1 --2- 172.21.15.63:0/1275274348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59fc0b5130 0x7f59fc0ae450 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f59ec0032f0 tx=0x7f59ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a00f6d700 1 --2- 172.21.15.63:0/1275274348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59fc0b5130 0x7f59fc0ae450 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f59ec0032f0 tx=0x7f59ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f59fbfff700 1 -- 172.21.15.63:0/1275274348 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59ec011db0 con 0x7f59fc0b5130 2020-05-18T21:38:51.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a00f6d700 1 --2- 172.21.15.63:0/1275274348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59fc0b5130 0x7f59fc0ae450 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f59ec0032f0 tx=0x7f59ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f59fbfff700 1 -- 172.21.15.63:0/1275274348 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ec00a180 con 0x7f59fc0b5130 2020-05-18T21:38:51.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f59fbfff700 1 -- 172.21.15.63:0/1275274348 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59ec00a5a0 con 0x7f59fc0b5130 2020-05-18T21:38:51.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a02770700 1 -- 172.21.15.63:0/1275274348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59fc0b5130 msgr2=0x7f59fc0ae450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a02770700 1 --2- 172.21.15.63:0/1275274348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59fc0b5130 0x7f59fc0ae450 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7f59ec0032f0 tx=0x7f59ec007e00).stop 2020-05-18T21:38:51.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a02770700 1 -- 172.21.15.63:0/1275274348 shutdown_connections 2020-05-18T21:38:51.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a02770700 1 --2- 172.21.15.63:0/1275274348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59fc0b5130 0x7f59fc0ae450 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:51.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a02770700 1 --2- 172.21.15.63:0/1275274348 >> v2:172.21.15.155:3300/0 conn(0x7f59fc149bc0 0x7f59fc060fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:51.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.140+0000 7f5a02770700 1 -- 172.21.15.63:0/1275274348 >> 172.21.15.63:0/1275274348 conn(0x7f59fc0b8b10 msgr2=0x7f59fc0b8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:51.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.144+0000 7f5a02770700 1 -- 172.21.15.63:0/1275274348 shutdown_connections 2020-05-18T21:38:51.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.144+0000 7f5a02770700 1 -- 172.21.15.63:0/1275274348 wait complete. 2020-05-18T21:38:51.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.144+0000 7f5a02770700 1 Processor -- start 2020-05-18T21:38:51.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.144+0000 7f5a02770700 1 -- start start 2020-05-18T21:38:51.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.144+0000 7f5a02770700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f59fc05ebc0 0x7f59fc0b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.144+0000 7f5a02770700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59fc09a670 con 0x7f59fc0b5130 2020-05-18T21:38:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.144+0000 7f5a02770700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59fc0afee0 con 0x7f59fc149bc0 2020-05-18T21:38:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.144+0000 7f5a02770700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59fc0b0180 con 0x7f59fc05ebc0 2020-05-18T21:38:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.144+0000 7f5a0176e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f59fc05ebc0 0x7f59fc0b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.144+0000 7f5a00f6d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f59fc0b5130 0x7f59fc09aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39396/0 (socket says 172.21.15.63:39396) 2020-05-18T21:38:51.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.144+0000 7f5a00f6d700 1 -- 172.21.15.63:0/3928980929 learned_addr learned my addr 172.21.15.63:0/3928980929 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:51.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.144+0000 7f5a0176e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f59fc05ebc0 0x7f59fc0b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37204/0 (socket says 172.21.15.63:37204) 2020-05-18T21:38:51.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.144+0000 7f59fa7fc700 1 -- 172.21.15.63:0/3928980929 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705998844 0 0) 0x7f59fc0afee0 con 0x7f59fc149bc0 2020-05-18T21:38:51.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.144+0000 7f5a0176e700 1 -- 172.21.15.63:0/3928980929 >> v1:172.21.15.155:6789/0 conn(0x7f59fc149bc0 legacy=0x7f59fc0b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.148+0000 7f5a0176e700 1 -- 172.21.15.63:0/3928980929 >> v1:172.21.15.63:6789/0 conn(0x7f59fc0b5130 legacy=0x7f59fc09aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.148+0000 7f5a0176e700 1 -- 172.21.15.63:0/3928980929 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59fc09b2b0 con 0x7f59fc05ebc0 2020-05-18T21:38:51.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.148+0000 7f5a0176e700 1 --2- 172.21.15.63:0/3928980929 >> v2:172.21.15.63:3300/0 conn(0x7f59fc05ebc0 0x7f59fc0b1f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59ec008290 tx=0x7f59f0010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.148+0000 7f5a0176e700 1 --2- 172.21.15.63:0/3928980929 >> v2:172.21.15.63:3300/0 conn(0x7f59fc05ebc0 0x7f59fc0b1f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59ec008290 tx=0x7f59f0010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.148+0000 7f5a0176e700 1 --2- 172.21.15.63:0/3928980929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59fc05ebc0 0x7f59fc0b1f30 secure :-1 s=READY pgs=2220 cs=0 l=1 rx=0x7f59ec008290 tx=0x7f59f0010c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:51.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.148+0000 7f5a0176e700 1 --2- 172.21.15.63:0/3928980929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59fc05ebc0 0x7f59fc0b1f30 secure :-1 s=THROTTLE_DONE pgs=2220 cs=0 l=1 rx=0x7f59ec008290 tx=0x7f59f0010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.148+0000 7f5a0176e700 1 --2- 172.21.15.63:0/3928980929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59fc05ebc0 0x7f59fc0b1f30 secure :-1 s=THROTTLE_DONE pgs=2220 cs=0 l=1 rx=0x7f59ec008290 tx=0x7f59f0010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.148+0000 7f59fa7fc700 1 -- 172.21.15.63:0/3928980929 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59f0012890 con 0x7f59fc05ebc0 2020-05-18T21:38:51.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.148+0000 7f5a0176e700 1 --2- 172.21.15.63:0/3928980929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59fc05ebc0 0x7f59fc0b1f30 secure :-1 s=THROTTLE_DONE pgs=2220 cs=0 l=1 rx=0x7f59ec008290 tx=0x7f59f0010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.148+0000 7f59fa7fc700 1 -- 172.21.15.63:0/3928980929 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f00129f0 con 0x7f59fc05ebc0 2020-05-18T21:38:51.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.148+0000 7f5a02770700 1 -- 172.21.15.63:0/3928980929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59fc09caa0 con 0x7f59fc05ebc0 2020-05-18T21:38:51.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.148+0000 7f59fa7fc700 1 -- 172.21.15.63:0/3928980929 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59f0012d50 con 0x7f59fc05ebc0 2020-05-18T21:38:51.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.148+0000 7f5a02770700 1 -- 172.21.15.63:0/3928980929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59fc148c30 con 0x7f59fc05ebc0 2020-05-18T21:38:51.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.148+0000 7f5a0176e700 1 --2- 172.21.15.63:0/3928980929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59fc05ebc0 0x7f59fc0b1f30 secure :-1 s=THROTTLE_DONE pgs=2220 cs=0 l=1 rx=0x7f59ec008290 tx=0x7f59f0010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.148+0000 7f5a02770700 1 -- 172.21.15.63:0/3928980929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59fc0569e0 con 0x7f59fc05ebc0 2020-05-18T21:38:51.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.148+0000 7f59fa7fc700 1 -- 172.21.15.63:0/3928980929 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f59f0007190 con 0x7f59fc05ebc0 2020-05-18T21:38:51.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.148+0000 7f5a0176e700 1 --2- 172.21.15.63:0/3928980929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59fc05ebc0 0x7f59fc0b1f30 secure :-1 s=THROTTLE_DONE pgs=2220 cs=0 l=1 rx=0x7f59ec008290 tx=0x7f59f0010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.148+0000 7f59fa7fc700 1 --2- 172.21.15.63:0/3928980929 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f59dc04f890 0x7f59dc051d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:51.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.148+0000 7f59fa7fc700 1 -- 172.21.15.63:0/3928980929 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f59f0063c00 con 0x7f59fc05ebc0 2020-05-18T21:38:51.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.152+0000 7f5a00f6d700 1 --2- 172.21.15.63:0/3928980929 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f59dc04f890 0x7f59dc051d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:51.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.152+0000 7f5a00f6d700 1 --2- 172.21.15.63:0/3928980929 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f59dc04f890 0x7f59dc051d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59ec000f40 tx=0x7f59ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.152+0000 7f5a00f6d700 1 --2- 172.21.15.63:0/3928980929 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f59dc04f890 0x7f59dc051d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59ec000f40 tx=0x7f59ec007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.152+0000 7f5a00f6d700 1 --2- 172.21.15.63:0/3928980929 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f59dc04f890 0x7f59dc051d50 secure :-1 s=READY pgs=872 cs=0 l=1 rx=0x7f59ec000f40 tx=0x7f59ec007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:51.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.156+0000 7f5a0176e700 1 --2- 172.21.15.63:0/3928980929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59fc05ebc0 0x7f59fc0b1f30 secure :-1 s=THROTTLE_DONE pgs=2220 cs=0 l=1 rx=0x7f59ec008290 tx=0x7f59f0010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.156+0000 7f59fa7fc700 1 -- 172.21.15.63:0/3928980929 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f59f003df30 con 0x7f59fc05ebc0 2020-05-18T21:38:51.279 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.272+0000 7f5a02770700 1 -- 172.21.15.63:0/3928980929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f59fc0614d0 con 0x7f59fc05ebc0 2020-05-18T21:38:51.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.272+0000 7f5a0176e700 1 --2- 172.21.15.63:0/3928980929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59fc05ebc0 0x7f59fc0b1f30 secure :-1 s=THROTTLE_DONE pgs=2220 cs=0 l=1 rx=0x7f59ec008290 tx=0x7f59f0010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.280 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.272+0000 7f59fa7fc700 1 -- 172.21.15.63:0/3928980929 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v167) v1 ==== 110+0+10 (secure 0 0 0) 0x7f59f0041550 con 0x7f59fc05ebc0 2020-05-18T21:38:51.280 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2020-05-18T21:38:51.281 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.276+0000 7f5a02770700 1 -- 172.21.15.63:0/3928980929 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f59dc04f890 msgr2=0x7f59dc051d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.276+0000 7f5a02770700 1 --2- 172.21.15.63:0/3928980929 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f59dc04f890 0x7f59dc051d50 secure :-1 s=READY pgs=872 cs=0 l=1 rx=0x7f59ec000f40 tx=0x7f59ec007e00).stop 2020-05-18T21:38:51.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.276+0000 7f5a02770700 1 -- 172.21.15.63:0/3928980929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59fc05ebc0 msgr2=0x7f59fc0b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.282 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.276+0000 7f5a02770700 1 --2- 172.21.15.63:0/3928980929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59fc05ebc0 0x7f59fc0b1f30 secure :-1 s=READY pgs=2220 cs=0 l=1 rx=0x7f59ec008290 tx=0x7f59f0010c80).stop 2020-05-18T21:38:51.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.276+0000 7f5a02770700 1 -- 172.21.15.63:0/3928980929 shutdown_connections 2020-05-18T21:38:51.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.276+0000 7f5a02770700 1 --2- 172.21.15.63:0/3928980929 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f59dc04f890 0x7f59dc051d50 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:51.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.276+0000 7f5a02770700 1 --2- 172.21.15.63:0/3928980929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59fc05ebc0 0x7f59fc0b1f30 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:51.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.276+0000 7f5a02770700 1 -- 172.21.15.63:0/3928980929 >> 172.21.15.63:0/3928980929 conn(0x7f59fc0b8b10 msgr2=0x7f59fc05c280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:51.283 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.276+0000 7f5a02770700 1 -- 172.21.15.63:0/3928980929 shutdown_connections 2020-05-18T21:38:51.284 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.276+0000 7f5a02770700 1 -- 172.21.15.63:0/3928980929 wait complete. 2020-05-18T21:38:51.292 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-05-18T21:38:51.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.396+0000 7f6f588b8700 1 Processor -- start 2020-05-18T21:38:51.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.396+0000 7f6f588b8700 1 -- start start 2020-05-18T21:38:51.406 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f588b8700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6f540b9500 0x7f6f540b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:51.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f588b8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6f540b6d90 0x7f6f54061270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:51.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f588b8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f54060660 con 0x7f6f540616d0 2020-05-18T21:38:51.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f588b8700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f540b7ec0 con 0x7f6f540b9500 2020-05-18T21:38:51.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f588b8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f54060890 con 0x7f6f540b6d90 2020-05-18T21:38:51.407 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f52d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6f540616d0 0x7f6f540b42b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39400/0 (socket says 172.21.15.63:39400) 2020-05-18T21:38:51.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f52d9d700 1 -- 172.21.15.63:0/3506613209 learned_addr learned my addr 172.21.15.63:0/3506613209 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:51.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f5259c700 1 --2- 172.21.15.63:0/3506613209 >> v2:172.21.15.63:3300/0 conn(0x7f6f540b9500 0x7f6f540b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:51.408 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f51d9b700 1 --2- 172.21.15.63:0/3506613209 >> v2:172.21.15.155:3300/0 conn(0x7f6f540b6d90 0x7f6f54061270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:51.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f5159a700 1 -- 172.21.15.63:0/3506613209 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030117573 0 0) 0x7f6f54060660 con 0x7f6f540616d0 2020-05-18T21:38:51.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f5159a700 1 -- 172.21.15.63:0/3506613209 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f34003270 con 0x7f6f540616d0 2020-05-18T21:38:51.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f5259c700 1 -- 172.21.15.63:0/3506613209 >> v2:172.21.15.155:3300/0 conn(0x7f6f540b6d90 msgr2=0x7f6f54061270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:51.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f5259c700 1 --2- 172.21.15.63:0/3506613209 >> v2:172.21.15.155:3300/0 conn(0x7f6f540b6d90 0x7f6f54061270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:51.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f5159a700 1 -- 172.21.15.63:0/3506613209 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 813249686 0 0) 0x7f6f34003270 con 0x7f6f540616d0 2020-05-18T21:38:51.411 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f5259c700 1 -- 172.21.15.63:0/3506613209 >> v1:172.21.15.63:6789/0 conn(0x7f6f540616d0 legacy=0x7f6f540b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f5259c700 1 -- 172.21.15.63:0/3506613209 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f54060b30 con 0x7f6f540b9500 2020-05-18T21:38:51.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f5259c700 1 --2- 172.21.15.63:0/3506613209 >> v2:172.21.15.63:3300/0 conn(0x7f6f540b9500 0x7f6f540b8630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6f540b41c0 tx=0x7f6f44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f5259c700 1 --2- 172.21.15.63:0/3506613209 >> v2:172.21.15.63:3300/0 conn(0x7f6f540b9500 0x7f6f540b8630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6f540b41c0 tx=0x7f6f44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f5259c700 1 --2- 172.21.15.63:0/3506613209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f540b9500 0x7f6f540b8630 secure :-1 s=READY pgs=2222 cs=0 l=1 rx=0x7f6f540b41c0 tx=0x7f6f44007a80).ready entity=mon.0 client_cookie=217ec7678eb04013 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:51.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f5259c700 1 --2- 172.21.15.63:0/3506613209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f540b9500 0x7f6f540b8630 secure :-1 s=THROTTLE_DONE pgs=2222 cs=0 l=1 rx=0x7f6f540b41c0 tx=0x7f6f44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f5159a700 1 -- 172.21.15.63:0/3506613209 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f4c001ab0 con 0x7f6f540b9500 2020-05-18T21:38:51.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f5259c700 1 --2- 172.21.15.63:0/3506613209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f540b9500 0x7f6f540b8630 secure :-1 s=THROTTLE_DONE pgs=2222 cs=0 l=1 rx=0x7f6f540b41c0 tx=0x7f6f44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f5259c700 1 --2- 172.21.15.63:0/3506613209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f540b9500 0x7f6f540b8630 secure :-1 s=THROTTLE_DONE pgs=2222 cs=0 l=1 rx=0x7f6f540b41c0 tx=0x7f6f44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f5159a700 1 -- 172.21.15.63:0/3506613209 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f44008e40 con 0x7f6f540b9500 2020-05-18T21:38:51.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f5159a700 1 -- 172.21.15.63:0/3506613209 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f44011440 con 0x7f6f540b9500 2020-05-18T21:38:51.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f588b8700 1 -- 172.21.15.63:0/3506613209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f540b9500 msgr2=0x7f6f540b8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f588b8700 1 --2- 172.21.15.63:0/3506613209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f540b9500 0x7f6f540b8630 secure :-1 s=READY pgs=2222 cs=0 l=1 rx=0x7f6f540b41c0 tx=0x7f6f44007a80).stop 2020-05-18T21:38:51.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f588b8700 1 -- 172.21.15.63:0/3506613209 shutdown_connections 2020-05-18T21:38:51.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f588b8700 1 --2- 172.21.15.63:0/3506613209 >> v2:172.21.15.155:3300/0 conn(0x7f6f540b6d90 0x7f6f54061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:51.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f588b8700 1 --2- 172.21.15.63:0/3506613209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f540b9500 0x7f6f540b8630 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:51.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f588b8700 1 -- 172.21.15.63:0/3506613209 >> 172.21.15.63:0/3506613209 conn(0x7f6f54069b70 msgr2=0x7f6f54069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:51.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f588b8700 1 -- 172.21.15.63:0/3506613209 shutdown_connections 2020-05-18T21:38:51.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.400+0000 7f6f588b8700 1 -- 172.21.15.63:0/3506613209 wait complete. 2020-05-18T21:38:51.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.404+0000 7f6f588b8700 1 Processor -- start 2020-05-18T21:38:51.415 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.404+0000 7f6f588b8700 1 -- start start 2020-05-18T21:38:51.422 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.404+0000 7f6f588b8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6f540616d0 0x7f6f54157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:51.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.404+0000 7f6f588b8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f540b6d90 0x7f6f540b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:51.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.404+0000 7f6f588b8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f540ad620 con 0x7f6f540b9500 2020-05-18T21:38:51.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.404+0000 7f6f588b8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f540b1e80 con 0x7f6f540616d0 2020-05-18T21:38:51.423 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.404+0000 7f6f588b8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f540ad8c0 con 0x7f6f540b6d90 2020-05-18T21:38:51.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.404+0000 7f6f52d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6f540b9500 0x7f6f5412eb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39408/0 (socket says 172.21.15.63:39408) 2020-05-18T21:38:51.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.404+0000 7f6f52d9d700 1 -- 172.21.15.63:0/1230959637 learned_addr learned my addr 172.21.15.63:0/1230959637 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:51.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.404+0000 7f6f5259c700 1 --2- 172.21.15.63:0/1230959637 >> v2:172.21.15.155:3300/0 conn(0x7f6f540616d0 0x7f6f54157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:51.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.404+0000 7f6f51d9b700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f540b6d90 0x7f6f540b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:51.424 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.404+0000 7f6f4b7fe700 1 -- 172.21.15.63:0/1230959637 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251914959 0 0) 0x7f6f540ad620 con 0x7f6f540b9500 2020-05-18T21:38:51.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.404+0000 7f6f4b7fe700 1 -- 172.21.15.63:0/1230959637 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f38002fe0 con 0x7f6f540b9500 2020-05-18T21:38:51.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f51d9b700 1 -- 172.21.15.63:0/1230959637 >> v2:172.21.15.155:3300/0 conn(0x7f6f540616d0 msgr2=0x7f6f54157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f51d9b700 1 --2- 172.21.15.63:0/1230959637 >> v2:172.21.15.155:3300/0 conn(0x7f6f540616d0 0x7f6f54157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:51.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f51d9b700 1 -- 172.21.15.63:0/1230959637 >> v1:172.21.15.63:6789/0 conn(0x7f6f540b9500 legacy=0x7f6f5412eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.425 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f51d9b700 1 -- 172.21.15.63:0/1230959637 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5412f240 con 0x7f6f540b6d90 2020-05-18T21:38:51.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f51d9b700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f540b6d90 0x7f6f540b3270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f3c002f70 tx=0x7f6f3c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f51d9b700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f540b6d90 0x7f6f540b3270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f3c002f70 tx=0x7f6f3c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f51d9b700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f540b6d90 0x7f6f540b3270 secure :-1 s=READY pgs=344 cs=0 l=1 rx=0x7f6f3c002f70 tx=0x7f6f3c010c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:51.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f51d9b700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f540b6d90 0x7f6f540b3270 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f6f3c002f70 tx=0x7f6f3c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.426 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f4b7fe700 1 -- 172.21.15.63:0/1230959637 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f3c007550 con 0x7f6f540b6d90 2020-05-18T21:38:51.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f51d9b700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f540b6d90 0x7f6f540b3270 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f6f3c002f70 tx=0x7f6f3c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f51d9b700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f540b6d90 0x7f6f540b3270 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f6f3c002f70 tx=0x7f6f3c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f4b7fe700 1 -- 172.21.15.63:0/1230959637 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3c005700 con 0x7f6f540b6d90 2020-05-18T21:38:51.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f588b8700 1 -- 172.21.15.63:0/1230959637 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f540af6a0 con 0x7f6f540b6d90 2020-05-18T21:38:51.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f4b7fe700 1 -- 172.21.15.63:0/1230959637 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f3c005aa0 con 0x7f6f540b6d90 2020-05-18T21:38:51.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f588b8700 1 -- 172.21.15.63:0/1230959637 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5412e4d0 con 0x7f6f540b6d90 2020-05-18T21:38:51.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f51d9b700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f540b6d90 0x7f6f540b3270 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f6f3c002f70 tx=0x7f6f3c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f588b8700 1 -- 172.21.15.63:0/1230959637 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f540ad460 con 0x7f6f540b6d90 2020-05-18T21:38:51.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f51d9b700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f540b6d90 0x7f6f540b3270 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f6f3c002f70 tx=0x7f6f3c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f4b7fe700 1 -- 172.21.15.63:0/1230959637 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6f3c005d10 con 0x7f6f540b6d90 2020-05-18T21:38:51.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f4b7fe700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f3804fd90 0x7f6f38052250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:51.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.408+0000 7f6f4b7fe700 1 -- 172.21.15.63:0/1230959637 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6f3c063e00 con 0x7f6f540b6d90 2020-05-18T21:38:51.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.412+0000 7f6f5259c700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f3804fd90 0x7f6f38052250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:51.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.412+0000 7f6f5259c700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f3804fd90 0x7f6f38052250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f540b41c0 tx=0x7f6f44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.412+0000 7f6f5259c700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f3804fd90 0x7f6f38052250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f540b41c0 tx=0x7f6f44007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.412+0000 7f6f5259c700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f3804fd90 0x7f6f38052250 secure :-1 s=READY pgs=873 cs=0 l=1 rx=0x7f6f540b41c0 tx=0x7f6f44007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:51.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.416+0000 7f6f51d9b700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f540b6d90 0x7f6f540b3270 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f6f3c002f70 tx=0x7f6f3c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.420+0000 7f6f4b7fe700 1 -- 172.21.15.63:0/1230959637 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6f3c03e150 con 0x7f6f540b6d90 2020-05-18T21:38:51.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.536+0000 7f6f588b8700 1 -- 172.21.15.63:0/1230959637 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6f540569e0 con 0x7f6f540b6d90 2020-05-18T21:38:51.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.536+0000 7f6f51d9b700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f540b6d90 0x7f6f540b3270 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f6f3c002f70 tx=0x7f6f3c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.536+0000 7f6f4b7fe700 1 -- 172.21.15.63:0/1230959637 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v167) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6f3c041770 con 0x7f6f540b6d90 2020-05-18T21:38:51.544 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:38:51.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.540+0000 7f6f588b8700 1 -- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f3804fd90 msgr2=0x7f6f38052250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.540+0000 7f6f588b8700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f3804fd90 0x7f6f38052250 secure :-1 s=READY pgs=873 cs=0 l=1 rx=0x7f6f540b41c0 tx=0x7f6f44007a80).stop 2020-05-18T21:38:51.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.540+0000 7f6f588b8700 1 -- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f540b6d90 msgr2=0x7f6f540b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.540+0000 7f6f588b8700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f540b6d90 0x7f6f540b3270 secure :-1 s=READY pgs=344 cs=0 l=1 rx=0x7f6f3c002f70 tx=0x7f6f3c010c10).stop 2020-05-18T21:38:51.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.540+0000 7f6f588b8700 1 -- 172.21.15.63:0/1230959637 shutdown_connections 2020-05-18T21:38:51.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.540+0000 7f6f588b8700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f3804fd90 0x7f6f38052250 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:51.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.540+0000 7f6f588b8700 1 --2- 172.21.15.63:0/1230959637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f540b6d90 0x7f6f540b3270 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:51.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.540+0000 7f6f588b8700 1 --2- 172.21.15.63:0/1230959637 >> v2:172.21.15.155:3300/0 conn(0x7f6f540616d0 0x7f6f54157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:51.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.540+0000 7f6f588b8700 1 -- 172.21.15.63:0/1230959637 >> 172.21.15.63:0/1230959637 conn(0x7f6f54069b70 msgr2=0x7f6f541483b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:51.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.540+0000 7f6f588b8700 1 -- 172.21.15.63:0/1230959637 shutdown_connections 2020-05-18T21:38:51.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.540+0000 7f6f588b8700 1 -- 172.21.15.63:0/1230959637 wait complete. 2020-05-18T21:38:51.562 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-05-18T21:38:51.663 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.656+0000 7f6fa1d46700 1 Processor -- start 2020-05-18T21:38:51.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.656+0000 7f6fa1d46700 1 -- start start 2020-05-18T21:38:51.665 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.656+0000 7f6fa1d46700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6f9c0aeb40 0x7f6f9c05f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:51.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.656+0000 7f6fa1d46700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f9c069b70 0x7f6f9c069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:51.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.656+0000 7f6fa1d46700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f9c149690 con 0x7f6f9c0aef20 2020-05-18T21:38:51.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.656+0000 7f6fa1d46700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f9c149930 con 0x7f6f9c0aeb40 2020-05-18T21:38:51.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.656+0000 7f6fa1d46700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c0af380 con 0x7f6f9c069b70 2020-05-18T21:38:51.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6f9b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6f9c0aeb40 0x7f6f9c05f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:51.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6f9affd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6f9c0aef20 0x7f6f9c149dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39414/0 (socket says 172.21.15.63:39414) 2020-05-18T21:38:51.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6f9affd700 1 -- 172.21.15.63:0/645665581 learned_addr learned my addr 172.21.15.63:0/645665581 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:51.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6f9bfff700 1 --2- 172.21.15.63:0/645665581 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f9c069b70 0x7f6f9c069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:51.667 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6f9a7fc700 1 -- 172.21.15.63:0/645665581 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342883110 0 0) 0x7f6f9c149690 con 0x7f6f9c0aef20 2020-05-18T21:38:51.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6f9a7fc700 1 -- 172.21.15.63:0/645665581 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f88003270 con 0x7f6f9c0aef20 2020-05-18T21:38:51.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6f9b7fe700 1 -- 172.21.15.63:0/645665581 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f9c069b70 msgr2=0x7f6f9c069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:51.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6f9b7fe700 1 --2- 172.21.15.63:0/645665581 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f9c069b70 0x7f6f9c069fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:51.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6f9b7fe700 1 -- 172.21.15.63:0/645665581 >> v1:172.21.15.63:6789/0 conn(0x7f6f9c0aef20 legacy=0x7f6f9c149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6f9b7fe700 1 -- 172.21.15.63:0/645665581 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c09ddb0 con 0x7f6f9c0aeb40 2020-05-18T21:38:51.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6f9b7fe700 1 --2- 172.21.15.63:0/645665581 >> v2:172.21.15.63:3300/0 conn(0x7f6f9c0aeb40 0x7f6f9c05f2d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6f90002f70 tx=0x7f6f90007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.672 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6f9b7fe700 1 --2- 172.21.15.63:0/645665581 >> v2:172.21.15.63:3300/0 conn(0x7f6f9c0aeb40 0x7f6f9c05f2d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6f90002f70 tx=0x7f6f90007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6f9b7fe700 1 --2- 172.21.15.63:0/645665581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f9c0aeb40 0x7f6f9c05f2d0 secure :-1 s=READY pgs=2225 cs=0 l=1 rx=0x7f6f90002f70 tx=0x7f6f90007a80).ready entity=mon.0 client_cookie=4e000f0613b5c057 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:51.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6f9b7fe700 1 --2- 172.21.15.63:0/645665581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f9c0aeb40 0x7f6f9c05f2d0 secure :-1 s=THROTTLE_DONE pgs=2225 cs=0 l=1 rx=0x7f6f90002f70 tx=0x7f6f90007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6f9a7fc700 1 -- 172.21.15.63:0/645665581 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f90008e80 con 0x7f6f9c0aeb40 2020-05-18T21:38:51.673 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6f9b7fe700 1 --2- 172.21.15.63:0/645665581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f9c0aeb40 0x7f6f9c05f2d0 secure :-1 s=THROTTLE_DONE pgs=2225 cs=0 l=1 rx=0x7f6f90002f70 tx=0x7f6f90007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6f9b7fe700 1 --2- 172.21.15.63:0/645665581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f9c0aeb40 0x7f6f9c05f2d0 secure :-1 s=THROTTLE_DONE pgs=2225 cs=0 l=1 rx=0x7f6f90002f70 tx=0x7f6f90007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6f9a7fc700 1 -- 172.21.15.63:0/645665581 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f90011540 con 0x7f6f9c0aeb40 2020-05-18T21:38:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6f9a7fc700 1 -- 172.21.15.63:0/645665581 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f90011960 con 0x7f6f9c0aeb40 2020-05-18T21:38:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6fa1d46700 1 -- 172.21.15.63:0/645665581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f9c0aeb40 msgr2=0x7f6f9c05f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6fa1d46700 1 --2- 172.21.15.63:0/645665581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f9c0aeb40 0x7f6f9c05f2d0 secure :-1 s=READY pgs=2225 cs=0 l=1 rx=0x7f6f90002f70 tx=0x7f6f90007a80).stop 2020-05-18T21:38:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6fa1d46700 1 -- 172.21.15.63:0/645665581 shutdown_connections 2020-05-18T21:38:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6fa1d46700 1 --2- 172.21.15.63:0/645665581 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f9c069b70 0x7f6f9c069fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6fa1d46700 1 --2- 172.21.15.63:0/645665581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f9c0aeb40 0x7f6f9c05f2d0 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6fa1d46700 1 -- 172.21.15.63:0/645665581 >> 172.21.15.63:0/645665581 conn(0x7f6f9c05b290 msgr2=0x7f6f9c05ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6fa1d46700 1 -- 172.21.15.63:0/645665581 shutdown_connections 2020-05-18T21:38:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6fa1d46700 1 -- 172.21.15.63:0/645665581 wait complete. 2020-05-18T21:38:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6fa1d46700 1 Processor -- start 2020-05-18T21:38:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.660+0000 7f6fa1d46700 1 -- start start 2020-05-18T21:38:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6fa1d46700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f9c069b70 0x7f6f9c153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6fa1d46700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6f9c0aeb40 0x7f6f9c154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6fa1d46700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f9c0b22a0 con 0x7f6f9c0aef20 2020-05-18T21:38:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6fa1d46700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f9c13f4d0 con 0x7f6f9c0aeb40 2020-05-18T21:38:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6fa1d46700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c1545e0 con 0x7f6f9c069b70 2020-05-18T21:38:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f9affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6f9c0aeb40 0x7f6f9c154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f9affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6f9c0aeb40 0x7f6f9c154180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37234/0 (socket says 172.21.15.63:37234) 2020-05-18T21:38:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f9affd700 1 -- 172.21.15.63:0/1778366412 learned_addr learned my addr 172.21.15.63:0/1778366412 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:51.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f9b7fe700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f9c069b70 0x7f6f9c153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:51.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f9affd700 1 -- 172.21.15.63:0/1778366412 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f9c069b70 msgr2=0x7f6f9c153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f9affd700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f9c069b70 0x7f6f9c153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:51.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f9affd700 1 -- 172.21.15.63:0/1778366412 >> v1:172.21.15.155:6789/0 conn(0x7f6f9c0aef20 legacy=0x7f6f9c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f9affd700 1 -- 172.21.15.63:0/1778366412 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c148ec0 con 0x7f6f9c0aeb40 2020-05-18T21:38:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f9affd700 1 --2- 172.21.15.63:0/1778366412 >> v2:172.21.15.63:3300/0 conn(0x7f6f9c0aeb40 0x7f6f9c154180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f9c0ba050 tx=0x7f6f8c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f9affd700 1 --2- 172.21.15.63:0/1778366412 >> v2:172.21.15.63:3300/0 conn(0x7f6f9c0aeb40 0x7f6f9c154180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f9c0ba050 tx=0x7f6f8c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f9affd700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f9c0aeb40 0x7f6f9c154180 secure :-1 s=READY pgs=2226 cs=0 l=1 rx=0x7f6f9c0ba050 tx=0x7f6f8c010ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f9affd700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f9c0aeb40 0x7f6f9c154180 secure :-1 s=THROTTLE_DONE pgs=2226 cs=0 l=1 rx=0x7f6f9c0ba050 tx=0x7f6f8c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f9affd700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f9c0aeb40 0x7f6f9c154180 secure :-1 s=THROTTLE_DONE pgs=2226 cs=0 l=1 rx=0x7f6f9c0ba050 tx=0x7f6f8c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f98ff9700 1 -- 172.21.15.63:0/1778366412 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f8c00c970 con 0x7f6f9c0aeb40 2020-05-18T21:38:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f9affd700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f9c0aeb40 0x7f6f9c154180 secure :-1 s=THROTTLE_DONE pgs=2226 cs=0 l=1 rx=0x7f6f9c0ba050 tx=0x7f6f8c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f98ff9700 1 -- 172.21.15.63:0/1778366412 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c00cad0 con 0x7f6f9c0aeb40 2020-05-18T21:38:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6fa1d46700 1 -- 172.21.15.63:0/1778366412 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9c0b2540 con 0x7f6f9c0aeb40 2020-05-18T21:38:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f98ff9700 1 -- 172.21.15.63:0/1778366412 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f8c00ce70 con 0x7f6f9c0aeb40 2020-05-18T21:38:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6fa1d46700 1 -- 172.21.15.63:0/1778366412 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9c0b0490 con 0x7f6f9c0aeb40 2020-05-18T21:38:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f9affd700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f9c0aeb40 0x7f6f9c154180 secure :-1 s=THROTTLE_DONE pgs=2226 cs=0 l=1 rx=0x7f6f9c0ba050 tx=0x7f6f8c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.687 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f98ff9700 1 -- 172.21.15.63:0/1778366412 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6f8c005620 con 0x7f6f9c0aeb40 2020-05-18T21:38:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f9affd700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f9c0aeb40 0x7f6f9c154180 secure :-1 s=THROTTLE_DONE pgs=2226 cs=0 l=1 rx=0x7f6f9c0ba050 tx=0x7f6f8c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6fa1d46700 1 -- 172.21.15.63:0/1778366412 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9c0569e0 con 0x7f6f9c0aeb40 2020-05-18T21:38:51.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f98ff9700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f7c04f8d0 0x7f6f7c051d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:51.689 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.664+0000 7f6f98ff9700 1 -- 172.21.15.63:0/1778366412 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6f8c0100c0 con 0x7f6f9c0aeb40 2020-05-18T21:38:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.668+0000 7f6f9b7fe700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f7c04f8d0 0x7f6f7c051d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.668+0000 7f6f9b7fe700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f7c04f8d0 0x7f6f7c051d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f90002f70 tx=0x7f6f90007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.668+0000 7f6f9b7fe700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f7c04f8d0 0x7f6f7c051d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f90002f70 tx=0x7f6f90007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.668+0000 7f6f9b7fe700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f7c04f8d0 0x7f6f7c051d90 secure :-1 s=READY pgs=874 cs=0 l=1 rx=0x7f6f90002f70 tx=0x7f6f90007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.672+0000 7f6f9affd700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f9c0aeb40 0x7f6f9c154180 secure :-1 s=THROTTLE_DONE pgs=2226 cs=0 l=1 rx=0x7f6f9c0ba050 tx=0x7f6f8c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.691 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.672+0000 7f6f98ff9700 1 -- 172.21.15.63:0/1778366412 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6f8c03ddd0 con 0x7f6f9c0aeb40 2020-05-18T21:38:51.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.788+0000 7f6fa1d46700 1 -- 172.21.15.63:0/1778366412 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6f9c09c530 con 0x7f6f9c0aeb40 2020-05-18T21:38:51.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.788+0000 7f6f9affd700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f9c0aeb40 0x7f6f9c154180 secure :-1 s=THROTTLE_DONE pgs=2226 cs=0 l=1 rx=0x7f6f9c0ba050 tx=0x7f6f8c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.795 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.788+0000 7f6f98ff9700 1 -- 172.21.15.63:0/1778366412 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v167) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6f8c0413f0 con 0x7f6f9c0aeb40 2020-05-18T21:38:51.795 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:38:51.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.788+0000 7f6fa1d46700 1 -- 172.21.15.63:0/1778366412 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f7c04f8d0 msgr2=0x7f6f7c051d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.788+0000 7f6fa1d46700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f7c04f8d0 0x7f6f7c051d90 secure :-1 s=READY pgs=874 cs=0 l=1 rx=0x7f6f90002f70 tx=0x7f6f90007a80).stop 2020-05-18T21:38:51.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.788+0000 7f6fa1d46700 1 -- 172.21.15.63:0/1778366412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f9c0aeb40 msgr2=0x7f6f9c154180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.788+0000 7f6fa1d46700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f9c0aeb40 0x7f6f9c154180 secure :-1 s=READY pgs=2226 cs=0 l=1 rx=0x7f6f9c0ba050 tx=0x7f6f8c010ae0).stop 2020-05-18T21:38:51.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.788+0000 7f6fa1d46700 1 -- 172.21.15.63:0/1778366412 shutdown_connections 2020-05-18T21:38:51.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.788+0000 7f6fa1d46700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6f7c04f8d0 0x7f6f7c051d90 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:51.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.788+0000 7f6fa1d46700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f9c0aeb40 0x7f6f9c154180 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:51.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.788+0000 7f6fa1d46700 1 --2- 172.21.15.63:0/1778366412 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f9c069b70 0x7f6f9c153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:51.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.788+0000 7f6fa1d46700 1 -- 172.21.15.63:0/1778366412 >> 172.21.15.63:0/1778366412 conn(0x7f6f9c05b290 msgr2=0x7f6f9c143330 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:51.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.792+0000 7f6fa1d46700 1 -- 172.21.15.63:0/1778366412 shutdown_connections 2020-05-18T21:38:51.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.792+0000 7f6fa1d46700 1 -- 172.21.15.63:0/1778366412 wait complete. 2020-05-18T21:38:51.808 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-05-18T21:38:51.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb9ce0b700 1 Processor -- start 2020-05-18T21:38:51.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb9ce0b700 1 -- start start 2020-05-18T21:38:51.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb9ce0b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb98149d50 0x7ffb9806a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:51.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb9ce0b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb980b4450 0x7ffb980b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:51.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb9ce0b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb980b3790 con 0x7ffb980ad3f0 2020-05-18T21:38:51.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb9ce0b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb980b39f0 con 0x7ffb980b4450 2020-05-18T21:38:51.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb9ce0b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb980b3c90 con 0x7ffb98149d50 2020-05-18T21:38:51.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb97fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb980b4450 0x7ffb980b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:51.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb97fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb980b4450 0x7ffb980b4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37244/0 (socket says 172.21.15.63:37244) 2020-05-18T21:38:51.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb97fff700 1 -- 172.21.15.63:0/771120180 learned_addr learned my addr 172.21.15.63:0/771120180 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:51.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb977fe700 1 --2- 172.21.15.63:0/771120180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb98149d50 0x7ffb9806a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:51.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb97fff700 1 -- 172.21.15.63:0/771120180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb98149d50 msgr2=0x7ffb9806a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:51.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb97fff700 1 --2- 172.21.15.63:0/771120180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb98149d50 0x7ffb9806a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:51.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb97fff700 1 -- 172.21.15.63:0/771120180 >> v1:172.21.15.155:6789/0 conn(0x7ffb980ad3f0 legacy=0x7ffb980ad830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb97fff700 1 -- 172.21.15.63:0/771120180 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb980ae400 con 0x7ffb980b4450 2020-05-18T21:38:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb977fe700 1 --2- 172.21.15.63:0/771120180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb98149d50 0x7ffb9806a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:38:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb97fff700 1 --2- 172.21.15.63:0/771120180 >> v2:172.21.15.63:3300/0 conn(0x7ffb980b4450 0x7ffb980b4900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffb880032f0 tx=0x7ffb88007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb97fff700 1 --2- 172.21.15.63:0/771120180 >> v2:172.21.15.63:3300/0 conn(0x7ffb980b4450 0x7ffb980b4900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffb880032f0 tx=0x7ffb88007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb97fff700 1 --2- 172.21.15.63:0/771120180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb980b4450 0x7ffb980b4900 secure :-1 s=READY pgs=2227 cs=0 l=1 rx=0x7ffb880032f0 tx=0x7ffb88007e00).ready entity=mon.0 client_cookie=2a8de14a674cedfc server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb97fff700 1 --2- 172.21.15.63:0/771120180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb980b4450 0x7ffb980b4900 secure :-1 s=THROTTLE_DONE pgs=2227 cs=0 l=1 rx=0x7ffb880032f0 tx=0x7ffb88007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb97fff700 1 --2- 172.21.15.63:0/771120180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb980b4450 0x7ffb980b4900 secure :-1 s=THROTTLE_DONE pgs=2227 cs=0 l=1 rx=0x7ffb880032f0 tx=0x7ffb88007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb967fc700 1 -- 172.21.15.63:0/771120180 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb880110d0 con 0x7ffb980b4450 2020-05-18T21:38:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb97fff700 1 --2- 172.21.15.63:0/771120180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb980b4450 0x7ffb980b4900 secure :-1 s=THROTTLE_DONE pgs=2227 cs=0 l=1 rx=0x7ffb880032f0 tx=0x7ffb88007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb967fc700 1 -- 172.21.15.63:0/771120180 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb88011230 con 0x7ffb980b4450 2020-05-18T21:38:51.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb967fc700 1 -- 172.21.15.63:0/771120180 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb88011650 con 0x7ffb980b4450 2020-05-18T21:38:51.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb9ce0b700 1 -- 172.21.15.63:0/771120180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb980b4450 msgr2=0x7ffb980b4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.922 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.908+0000 7ffb9ce0b700 1 --2- 172.21.15.63:0/771120180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb980b4450 0x7ffb980b4900 secure :-1 s=READY pgs=2227 cs=0 l=1 rx=0x7ffb880032f0 tx=0x7ffb88007e00).stop 2020-05-18T21:38:51.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.912+0000 7ffb9ce0b700 1 -- 172.21.15.63:0/771120180 shutdown_connections 2020-05-18T21:38:51.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.912+0000 7ffb9ce0b700 1 --2- 172.21.15.63:0/771120180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb980b4450 0x7ffb980b4900 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:51.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.912+0000 7ffb9ce0b700 1 --2- 172.21.15.63:0/771120180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb98149d50 0x7ffb9806a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:51.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.912+0000 7ffb9ce0b700 1 -- 172.21.15.63:0/771120180 >> 172.21.15.63:0/771120180 conn(0x7ffb9805fb90 msgr2=0x7ffb98069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:51.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.912+0000 7ffb9ce0b700 1 -- 172.21.15.63:0/771120180 shutdown_connections 2020-05-18T21:38:51.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.912+0000 7ffb9ce0b700 1 -- 172.21.15.63:0/771120180 wait complete. 2020-05-18T21:38:51.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.912+0000 7ffb9ce0b700 1 Processor -- start 2020-05-18T21:38:51.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.912+0000 7ffb9ce0b700 1 -- start start 2020-05-18T21:38:51.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb9ce0b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb980ad3f0 0x7ffb98157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:51.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb9ce0b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb98149d50 0x7ffb9815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:51.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb9ce0b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb98157fb0 con 0x7ffb980b4450 2020-05-18T21:38:51.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb9ce0b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb98158250 con 0x7ffb980ad3f0 2020-05-18T21:38:51.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb9ce0b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb981584f0 con 0x7ffb98149d50 2020-05-18T21:38:51.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb977fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb980ad3f0 0x7ffb98157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:51.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb977fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb980ad3f0 0x7ffb98157ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37246/0 (socket says 172.21.15.63:37246) 2020-05-18T21:38:51.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb977fe700 1 -- 172.21.15.63:0/1130349679 learned_addr learned my addr 172.21.15.63:0/1130349679 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:51.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb97fff700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb98149d50 0x7ffb9815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:51.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb977fe700 1 -- 172.21.15.63:0/1130349679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb98149d50 msgr2=0x7ffb9815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb977fe700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb98149d50 0x7ffb9815b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:51.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb977fe700 1 -- 172.21.15.63:0/1130349679 >> v1:172.21.15.155:6789/0 conn(0x7ffb980b4450 legacy=0x7ffb981460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:51.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb977fe700 1 -- 172.21.15.63:0/1130349679 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb98158990 con 0x7ffb980ad3f0 2020-05-18T21:38:51.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb977fe700 1 --2- 172.21.15.63:0/1130349679 >> v2:172.21.15.63:3300/0 conn(0x7ffb980ad3f0 0x7ffb98157ab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb90007960 tx=0x7ffb90010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb977fe700 1 --2- 172.21.15.63:0/1130349679 >> v2:172.21.15.63:3300/0 conn(0x7ffb980ad3f0 0x7ffb98157ab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb90007960 tx=0x7ffb90010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb977fe700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb980ad3f0 0x7ffb98157ab0 secure :-1 s=READY pgs=2228 cs=0 l=1 rx=0x7ffb90007960 tx=0x7ffb90010c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:51.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb977fe700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb980ad3f0 0x7ffb98157ab0 secure :-1 s=THROTTLE_DONE pgs=2228 cs=0 l=1 rx=0x7ffb90007960 tx=0x7ffb90010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb977fe700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb980ad3f0 0x7ffb98157ab0 secure :-1 s=THROTTLE_DONE pgs=2228 cs=0 l=1 rx=0x7ffb90007960 tx=0x7ffb90010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb94ff9700 1 -- 172.21.15.63:0/1130349679 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb90007180 con 0x7ffb980ad3f0 2020-05-18T21:38:51.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb977fe700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb980ad3f0 0x7ffb98157ab0 secure :-1 s=THROTTLE_DONE pgs=2228 cs=0 l=1 rx=0x7ffb90007960 tx=0x7ffb90010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb94ff9700 1 -- 172.21.15.63:0/1130349679 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb900072e0 con 0x7ffb980ad3f0 2020-05-18T21:38:51.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb9ce0b700 1 -- 172.21.15.63:0/1130349679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb98065230 con 0x7ffb980ad3f0 2020-05-18T21:38:51.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb94ff9700 1 -- 172.21.15.63:0/1130349679 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb900122d0 con 0x7ffb980ad3f0 2020-05-18T21:38:51.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb9ce0b700 1 -- 172.21.15.63:0/1130349679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb98146a20 con 0x7ffb980ad3f0 2020-05-18T21:38:51.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb977fe700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb980ad3f0 0x7ffb98157ab0 secure :-1 s=THROTTLE_DONE pgs=2228 cs=0 l=1 rx=0x7ffb90007960 tx=0x7ffb90010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.932 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb9ce0b700 1 -- 172.21.15.63:0/1130349679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb980569e0 con 0x7ffb980ad3f0 2020-05-18T21:38:51.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb94ff9700 1 -- 172.21.15.63:0/1130349679 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ffb90012540 con 0x7ffb980ad3f0 2020-05-18T21:38:51.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb977fe700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb980ad3f0 0x7ffb98157ab0 secure :-1 s=THROTTLE_DONE pgs=2228 cs=0 l=1 rx=0x7ffb90007960 tx=0x7ffb90010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb94ff9700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb7c04fb30 0x7ffb7c051ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:51.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.916+0000 7ffb94ff9700 1 -- 172.21.15.63:0/1130349679 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffb90063fb0 con 0x7ffb980ad3f0 2020-05-18T21:38:51.933 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.920+0000 7ffb96ffd700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb7c04fb30 0x7ffb7c051ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:51.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.920+0000 7ffb96ffd700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb7c04fb30 0x7ffb7c051ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb980b1830 tx=0x7ffb80002590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.920+0000 7ffb96ffd700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb7c04fb30 0x7ffb7c051ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb980b1830 tx=0x7ffb80002590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.934 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.920+0000 7ffb96ffd700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb7c04fb30 0x7ffb7c051ff0 secure :-1 s=READY pgs=875 cs=0 l=1 rx=0x7ffb980b1830 tx=0x7ffb80002590).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:51.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.924+0000 7ffb977fe700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb980ad3f0 0x7ffb98157ab0 secure :-1 s=THROTTLE_DONE pgs=2228 cs=0 l=1 rx=0x7ffb90007960 tx=0x7ffb90010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:51.935 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:51.924+0000 7ffb94ff9700 1 -- 172.21.15.63:0/1130349679 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ffb9003e2e0 con 0x7ffb980ad3f0 2020-05-18T21:38:52.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.040+0000 7ffb9ce0b700 1 -- 172.21.15.63:0/1130349679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffb98065b40 con 0x7ffb980ad3f0 2020-05-18T21:38:52.047 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.040+0000 7ffb977fe700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb980ad3f0 0x7ffb98157ab0 secure :-1 s=THROTTLE_DONE pgs=2228 cs=0 l=1 rx=0x7ffb90007960 tx=0x7ffb90010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:52.048 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.040+0000 7ffb94ff9700 1 -- 172.21.15.63:0/1130349679 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v167) v1 ==== 100+0+10 (secure 0 0 0) 0x7ffb90041900 con 0x7ffb980ad3f0 2020-05-18T21:38:52.048 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2020-05-18T21:38:52.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.040+0000 7ffb9ce0b700 1 -- 172.21.15.63:0/1130349679 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb7c04fb30 msgr2=0x7ffb7c051ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:52.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.040+0000 7ffb9ce0b700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb7c04fb30 0x7ffb7c051ff0 secure :-1 s=READY pgs=875 cs=0 l=1 rx=0x7ffb980b1830 tx=0x7ffb80002590).stop 2020-05-18T21:38:52.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.040+0000 7ffb9ce0b700 1 -- 172.21.15.63:0/1130349679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb980ad3f0 msgr2=0x7ffb98157ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:52.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.040+0000 7ffb9ce0b700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb980ad3f0 0x7ffb98157ab0 secure :-1 s=READY pgs=2228 cs=0 l=1 rx=0x7ffb90007960 tx=0x7ffb90010c40).stop 2020-05-18T21:38:52.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.040+0000 7ffb9ce0b700 1 -- 172.21.15.63:0/1130349679 shutdown_connections 2020-05-18T21:38:52.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.040+0000 7ffb9ce0b700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb7c04fb30 0x7ffb7c051ff0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:52.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.040+0000 7ffb9ce0b700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb98149d50 0x7ffb9815b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:52.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.040+0000 7ffb9ce0b700 1 --2- 172.21.15.63:0/1130349679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb980ad3f0 0x7ffb98157ab0 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:52.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.040+0000 7ffb9ce0b700 1 -- 172.21.15.63:0/1130349679 >> 172.21.15.63:0/1130349679 conn(0x7ffb9805fb90 msgr2=0x7ffb980ad830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:52.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.040+0000 7ffb9ce0b700 1 -- 172.21.15.63:0/1130349679 shutdown_connections 2020-05-18T21:38:52.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.040+0000 7ffb9ce0b700 1 -- 172.21.15.63:0/1130349679 wait complete. 2020-05-18T21:38:52.060 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-05-18T21:38:52.061 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:38:52.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.152+0000 7f30209b6700 1 Processor -- start 2020-05-18T21:38:52.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.152+0000 7f30209b6700 1 -- start start 2020-05-18T21:38:52.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.152+0000 7f30209b6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f301c0b2010 0x7f301c09c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:52.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.152+0000 7f30209b6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f301c0b5540 0x7f301c0b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:52.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.152+0000 7f30209b6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301c149510 con 0x7f301c0b4e50 2020-05-18T21:38:52.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.152+0000 7f30209b6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f301c09d0c0 con 0x7f301c0b2010 2020-05-18T21:38:52.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.152+0000 7f30209b6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301c149320 con 0x7f301c0b5540 2020-05-18T21:38:52.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f301affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f301c0b2010 0x7f301c09c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:52.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f301affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f301c0b2010 0x7f301c09c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37256/0 (socket says 172.21.15.63:37256) 2020-05-18T21:38:52.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f301affd700 1 -- 172.21.15.63:0/3557033913 learned_addr learned my addr 172.21.15.63:0/3557033913 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:52.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f301b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f301c0b4e50 0x7f301c149c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39442/0 (socket says 172.21.15.63:39442) 2020-05-18T21:38:52.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f301bfff700 1 --2- 172.21.15.63:0/3557033913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f301c0b5540 0x7f301c0b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:52.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f301affd700 1 -- 172.21.15.63:0/3557033913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f301c0b5540 msgr2=0x7f301c0b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:52.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f301affd700 1 --2- 172.21.15.63:0/3557033913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f301c0b5540 0x7f301c0b59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:52.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f301affd700 1 -- 172.21.15.63:0/3557033913 >> v1:172.21.15.63:6789/0 conn(0x7f301c0b4e50 legacy=0x7f301c149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:52.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f301a7fc700 1 -- 172.21.15.63:0/3557033913 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749506060 0 0) 0x7f301c149510 con 0x7f301c0b4e50 2020-05-18T21:38:52.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f301affd700 1 -- 172.21.15.63:0/3557033913 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301c1497b0 con 0x7f301c0b2010 2020-05-18T21:38:52.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f301affd700 1 --2- 172.21.15.63:0/3557033913 >> v2:172.21.15.63:3300/0 conn(0x7f301c0b2010 0x7f301c09c940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f301c09bcc0 tx=0x7f3004008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:52.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f301affd700 1 --2- 172.21.15.63:0/3557033913 >> v2:172.21.15.63:3300/0 conn(0x7f301c0b2010 0x7f301c09c940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f301c09bcc0 tx=0x7f3004008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:52.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f301affd700 1 --2- 172.21.15.63:0/3557033913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f301c0b2010 0x7f301c09c940 secure :-1 s=READY pgs=2230 cs=0 l=1 rx=0x7f301c09bcc0 tx=0x7f3004008920).ready entity=mon.0 client_cookie=3734410c3264ef0a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:52.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f301affd700 1 --2- 172.21.15.63:0/3557033913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f301c0b2010 0x7f301c09c940 secure :-1 s=THROTTLE_DONE pgs=2230 cs=0 l=1 rx=0x7f301c09bcc0 tx=0x7f3004008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:52.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f301a7fc700 1 -- 172.21.15.63:0/3557033913 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3004011760 con 0x7f301c0b2010 2020-05-18T21:38:52.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f301affd700 1 --2- 172.21.15.63:0/3557033913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f301c0b2010 0x7f301c09c940 secure :-1 s=THROTTLE_DONE pgs=2230 cs=0 l=1 rx=0x7f301c09bcc0 tx=0x7f3004008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:52.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f301a7fc700 1 -- 172.21.15.63:0/3557033913 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30040118c0 con 0x7f301c0b2010 2020-05-18T21:38:52.172 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f301affd700 1 --2- 172.21.15.63:0/3557033913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f301c0b2010 0x7f301c09c940 secure :-1 s=THROTTLE_DONE pgs=2230 cs=0 l=1 rx=0x7f301c09bcc0 tx=0x7f3004008920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f301a7fc700 1 -- 172.21.15.63:0/3557033913 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3004011ca0 con 0x7f301c0b2010 2020-05-18T21:38:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f30209b6700 1 -- 172.21.15.63:0/3557033913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f301c0b2010 msgr2=0x7f301c09c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f30209b6700 1 --2- 172.21.15.63:0/3557033913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f301c0b2010 0x7f301c09c940 secure :-1 s=READY pgs=2230 cs=0 l=1 rx=0x7f301c09bcc0 tx=0x7f3004008920).stop 2020-05-18T21:38:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f30209b6700 1 -- 172.21.15.63:0/3557033913 shutdown_connections 2020-05-18T21:38:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f30209b6700 1 --2- 172.21.15.63:0/3557033913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f301c0b5540 0x7f301c0b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f30209b6700 1 --2- 172.21.15.63:0/3557033913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f301c0b2010 0x7f301c09c940 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f30209b6700 1 -- 172.21.15.63:0/3557033913 >> 172.21.15.63:0/3557033913 conn(0x7f301c05a7c0 msgr2=0x7f301c05aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f30209b6700 1 -- 172.21.15.63:0/3557033913 shutdown_connections 2020-05-18T21:38:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f30209b6700 1 -- 172.21.15.63:0/3557033913 wait complete. 2020-05-18T21:38:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f30209b6700 1 Processor -- start 2020-05-18T21:38:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.156+0000 7f30209b6700 1 -- start start 2020-05-18T21:38:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f30209b6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f301c0b5540 0x7f301c141740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f30209b6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301c0b82e0 con 0x7f301c0b2010 2020-05-18T21:38:52.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f30209b6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301c0b8580 con 0x7f301c0b4e50 2020-05-18T21:38:52.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f30209b6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f301c0b80d0 con 0x7f301c0b5540 2020-05-18T21:38:52.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f301c0b2010 0x7f301c063ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39448/0 (socket says 172.21.15.63:39448) 2020-05-18T21:38:52.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301b7fe700 1 -- 172.21.15.63:0/1196030193 learned_addr learned my addr 172.21.15.63:0/1196030193 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:52.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301bfff700 1 --2- 172.21.15.63:0/1196030193 >> v2:172.21.15.155:3300/0 conn(0x7f301c0b5540 0x7f301c141740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:52.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411222866 0 0) 0x7f301c0b82e0 con 0x7f301c0b2010 2020-05-18T21:38:52.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ff4002fe0 con 0x7f301c0b2010 2020-05-18T21:38:52.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292064196 0 0) 0x7f301c0b8580 con 0x7f301c0b4e50 2020-05-18T21:38:52.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f301c0b82e0 con 0x7f301c0b4e50 2020-05-18T21:38:52.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1133179508 0 0) 0x7f2ff4002fe0 con 0x7f301c0b2010 2020-05-18T21:38:52.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 --> v1:172.21.15.63:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f301c0b8580 con 0x7f301c0b2010 2020-05-18T21:38:52.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f300c001ce0 con 0x7f301c0b2010 2020-05-18T21:38:52.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 >> v2:172.21.15.155:3300/0 conn(0x7f301c0b5540 msgr2=0x7f301c141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:52.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 --2- 172.21.15.63:0/1196030193 >> v2:172.21.15.155:3300/0 conn(0x7f301c0b5540 0x7f301c141740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:52.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 >> v1:172.21.15.155:6789/0 conn(0x7f301c0b4e50 legacy=0x7f301c141030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:52.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 >> v1:172.21.15.63:6789/0 conn(0x7f301c0b2010 legacy=0x7f301c063ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:52.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ff4004c40 0x7f2ff4005040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:52.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ff4003880 0x7f2ff4003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:52.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ff4004120 0x7f2ff400b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:52.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301c0b80d0 con 0x7f2ff4004c40 2020-05-18T21:38:52.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff400bbc0 con 0x7f2ff4003880 2020-05-18T21:38:52.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff400bd00 con 0x7f2ff4004120 2020-05-18T21:38:52.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301b7fe700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ff4004c40 0x7f2ff4005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:52.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301affd700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ff4003880 0x7f2ff4003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:52.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301bfff700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ff4004120 0x7f2ff400b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:52.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301b7fe700 1 -- 172.21.15.63:0/1196030193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ff4004120 msgr2=0x7f2ff400b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:52.187 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301b7fe700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ff4004120 0x7f2ff400b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301b7fe700 1 -- 172.21.15.63:0/1196030193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ff4003880 msgr2=0x7f2ff4003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301b7fe700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ff4003880 0x7f2ff4003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301b7fe700 1 -- 172.21.15.63:0/1196030193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301c0b8820 con 0x7f2ff4004c40 2020-05-18T21:38:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f30209b6700 1 -- 172.21.15.63:0/1196030193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f301c064450 con 0x7f2ff4004c40 2020-05-18T21:38:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301affd700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ff4003880 0x7f2ff4003cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:38:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301bfff700 1 -- 172.21.15.63:0/1196030193 reap_dead start 2020-05-18T21:38:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f30209b6700 1 -- 172.21.15.63:0/1196030193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f301c062f70 con 0x7f2ff4004c40 2020-05-18T21:38:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301b7fe700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ff4004c40 0x7f2ff4005040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f300c001ab0 tx=0x7f300c011710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301b7fe700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ff4004c40 0x7f2ff4005040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f300c001ab0 tx=0x7f300c011710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301b7fe700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ff4004c40 0x7f2ff4005040 secure :-1 s=READY pgs=2232 cs=0 l=1 rx=0x7f300c001ab0 tx=0x7f300c011710).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:52.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301b7fe700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ff4004c40 0x7f2ff4005040 secure :-1 s=THROTTLE_DONE pgs=2232 cs=0 l=1 rx=0x7f300c001ab0 tx=0x7f300c011710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:52.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f300c005cc0 con 0x7f2ff4004c40 2020-05-18T21:38:52.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301b7fe700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ff4004c40 0x7f2ff4005040 secure :-1 s=THROTTLE_DONE pgs=2232 cs=0 l=1 rx=0x7f300c001ab0 tx=0x7f300c011710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:52.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300c005e20 con 0x7f2ff4004c40 2020-05-18T21:38:52.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301b7fe700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ff4004c40 0x7f2ff4005040 secure :-1 s=THROTTLE_DONE pgs=2232 cs=0 l=1 rx=0x7f300c001ab0 tx=0x7f300c011710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:52.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f300c004e90 con 0x7f2ff4004c40 2020-05-18T21:38:52.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.160+0000 7f301b7fe700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ff4004c40 0x7f2ff4005040 secure :-1 s=THROTTLE_DONE pgs=2232 cs=0 l=1 rx=0x7f300c001ab0 tx=0x7f300c011710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:52.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.164+0000 7f30209b6700 1 -- 172.21.15.63:0/1196030193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff8003380 con 0x7f2ff4004c40 2020-05-18T21:38:52.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.164+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f300c004ff0 con 0x7f2ff4004c40 2020-05-18T21:38:52.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.164+0000 7f301b7fe700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ff4004c40 0x7f2ff4005040 secure :-1 s=THROTTLE_DONE pgs=2232 cs=0 l=1 rx=0x7f300c001ab0 tx=0x7f300c011710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.164+0000 7f3018ff9700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ff4053b30 0x7f2ff4055ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.164+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f300c064920 con 0x7f2ff4004c40 2020-05-18T21:38:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.164+0000 7f301affd700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ff4053b30 0x7f2ff4055ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.164+0000 7f301affd700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ff4053b30 0x7f2ff4055ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3004007f10 tx=0x7f301c05b340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:52.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.164+0000 7f301affd700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ff4053b30 0x7f2ff4055ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3004007f10 tx=0x7f301c05b340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:52.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.164+0000 7f301affd700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ff4053b30 0x7f2ff4055ff0 secure :-1 s=READY pgs=876 cs=0 l=1 rx=0x7f3004007f10 tx=0x7f301c05b340).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:52.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.168+0000 7f301b7fe700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ff4004c40 0x7f2ff4005040 secure :-1 s=THROTTLE_DONE pgs=2232 cs=0 l=1 rx=0x7f300c001ab0 tx=0x7f300c011710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:52.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.168+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f300c03ed10 con 0x7f2ff4004c40 2020-05-18T21:38:52.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.320+0000 7f30209b6700 1 -- 172.21.15.63:0/1196030193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ff8003720 con 0x7f2ff4004c40 2020-05-18T21:38:52.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.320+0000 7f301b7fe700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ff4004c40 0x7f2ff4005040 secure :-1 s=THROTTLE_DONE pgs=2232 cs=0 l=1 rx=0x7f300c001ab0 tx=0x7f300c011710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:52.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.320+0000 7f3018ff9700 1 -- 172.21.15.63:0/1196030193 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 151 v151) v1 ==== 95+0+2149 (secure 0 0 0) 0x7f300c042330 con 0x7f2ff4004c40 2020-05-18T21:38:52.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.320+0000 7f30209b6700 1 -- 172.21.15.63:0/1196030193 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ff4053b30 msgr2=0x7f2ff4055ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:52.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.320+0000 7f30209b6700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ff4053b30 0x7f2ff4055ff0 secure :-1 s=READY pgs=876 cs=0 l=1 rx=0x7f3004007f10 tx=0x7f301c05b340).stop 2020-05-18T21:38:52.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.320+0000 7f30209b6700 1 -- 172.21.15.63:0/1196030193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ff4004c40 msgr2=0x7f2ff4005040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:52.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.320+0000 7f30209b6700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ff4004c40 0x7f2ff4005040 secure :-1 s=READY pgs=2232 cs=0 l=1 rx=0x7f300c001ab0 tx=0x7f300c011710).stop 2020-05-18T21:38:52.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.320+0000 7f30209b6700 1 -- 172.21.15.63:0/1196030193 shutdown_connections 2020-05-18T21:38:52.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.320+0000 7f30209b6700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f2ff4053b30 0x7f2ff4055ff0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:52.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.320+0000 7f30209b6700 1 --2- 172.21.15.63:0/1196030193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ff4004c40 0x7f2ff4005040 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:52.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.320+0000 7f30209b6700 1 -- 172.21.15.63:0/1196030193 >> 172.21.15.63:0/1196030193 conn(0x7f301c05a7c0 msgr2=0x7f301c05aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:52.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.320+0000 7f30209b6700 1 -- 172.21.15.63:0/1196030193 shutdown_connections 2020-05-18T21:38:52.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:52.320+0000 7f30209b6700 1 -- 172.21.15.63:0/1196030193 wait complete. 2020-05-18T21:38:52.336 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 151 2020-05-18T21:38:52.337 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:52.337 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":151,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7370,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/726870500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":726870500},{"type":"v1","addr":"172.21.15.63:6833","nonce":726870500}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":149}],"filesystems":[{"mdsmap":{"epoch":151,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-05-18T21:38:30.427505+0000","modified":"2020-05-18T21:38:38.296029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10348":{"gid":10348,"name":"b","rank":0,"incarnation":149,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/3932257542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3932257542},{"type":"v1","addr":"172.21.15.155:6835","nonce":3932257542}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2020-05-18T21:38:52.542 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 151, 'flags': 18, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2020-05-18T21:38:30.427505+0000', 'modified': '2020-05-18T21:38:38.296029+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10348}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10348': {'gid': 10348, 'name': 'b', 'rank': 0, 'incarnation': 149, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6835/3932257542', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 3932257542}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3932257542}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [32], 'metadata_pool': 31, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-05-18T21:38:52.542 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-05-18T21:38:52.543 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-05-18T21:38:52.654 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:38:52.654 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", 2020-05-18T21:38:52.655 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2020-05-18T21:38:52.655 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 10348, 2020-05-18T21:38:52.655 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2020-05-18T21:38:52.655 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2020-05-18T21:38:52.655 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 22.219828583000002, 2020-05-18T21:38:52.656 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 151, 2020-05-18T21:38:52.656 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 167, 2020-05-18T21:38:52.656 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 167, 2020-05-18T21:38:52.656 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 26.593974902999999 2020-05-18T21:38:52.656 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:38:52.663 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "463d54c2-4027-4807-bf42-f25cd6c63d51", "whoami": 0, "id": 10348, "want_state": "up:active", "state": "up:active", "rank_uptime": 22.219828583000002, "mdsmap_epoch": 151, "osdmap_epoch": 167, "osdmap_epoch_barrier": 167, "uptime": 26.593974902999999 } 2020-05-18T21:38:52.663 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-05-18T21:38:52.664 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:38:52.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:52.665 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:38:52.673 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:38:52.673 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:38:52.673 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:38:52.674 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:52.674 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:38:52.674 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:52.674 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:52.674 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:52.675 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:52.675 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:52.675 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:38:52.675 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:52.675 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:38:52.675 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:38:52.676 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:38:52.676 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42110sec preferred_lft 42110sec 2020-05-18T21:38:52.676 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:38:52.676 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:38:52.677 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-05-18T21:38:52.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:52.678 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add name ceph-brx type bridge' 2020-05-18T21:38:52.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:52.695 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx up' 2020-05-18T21:38:52.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:52.714 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx' 2020-05-18T21:38:52.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:52.776 INFO:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-05-18T21:38:52.791 INFO:teuthology.orchestra.run.smithi063.stdout:1 2020-05-18T21:38:52.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:52.793 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:38:52.802 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:38:52.802 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:38:52.802 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:38:52.802 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:38:52.802 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:38:52.803 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:38:52.803 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-05-18T21:38:52.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:52.804 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:38:52.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:52.863 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:38:52.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:52.884 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:38:52.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:52.898 INFO:teuthology.orchestra.run.smithi063:> ip netns list 2020-05-18T21:38:52.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:52.906 INFO:teuthology.orchestra.run.smithi063:> ip netns list-id 2020-05-18T21:38:52.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:52.956 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:38:52.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:52.975 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-05-18T21:38:53.003 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-05-18T21:38:53.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:53.005 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-05-18T21:38:53.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:53.025 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-05-18T21:38:53.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:53.084 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-05-18T21:38:53.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:53.100 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-05-18T21:38:53.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:53.116 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-05-18T21:38:53.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:53.177 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 up' 2020-05-18T21:38:53.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:38:53.191 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set dev brx.0 master ceph-brx' 2020-05-18T21:38:53.210 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-05-18T21:38:53.211 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi063.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-05-18T21:38:53.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:53.212 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:38:53.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:53.219 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:38:53.232 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:38:53.233 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:38:53.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:53.234 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:38:53.239 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-05-18T21:38:53.240 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:38:53.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:53.243 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:38:53.259 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:38:53.260 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:38:53.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:53.261 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:38:53.329 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2020-05-18T21:38:53.324+0000 7f587b255080 -1 init, newargv = 0x5612e9086530 newargc=9 2020-05-18T21:38:53.330 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[41764]: starting ceph client 2020-05-18T21:38:53.340 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[41764]: starting fuse 2020-05-18T21:38:54.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:54.412 INFO:teuthology.orchestra.run.smithi063:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-05-18T21:38:54.434 INFO:teuthology.orchestra.run.smithi063.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-05-18T21:38:54.434 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-05-18T21:38:54.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:54.436 INFO:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2020-05-18T21:38:54.483 INFO:teuthology.orchestra.run.smithi063.stdout:50 2020-05-18T21:38:54.483 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-05-18T21:38:54.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:54.485 INFO:teuthology.orchestra.run.smithi063:> sudo python3 -c ' 2020-05-18T21:38:54.485 INFO:teuthology.orchestra.run.smithi063:> import glob 2020-05-18T21:38:54.485 INFO:teuthology.orchestra.run.smithi063:> import re 2020-05-18T21:38:54.486 INFO:teuthology.orchestra.run.smithi063:> import os 2020-05-18T21:38:54.486 INFO:teuthology.orchestra.run.smithi063:> import subprocess 2020-05-18T21:38:54.487 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:38:54.487 INFO:teuthology.orchestra.run.smithi063:> def find_socket(client_name): 2020-05-18T21:38:54.488 INFO:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-05-18T21:38:54.489 INFO:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2020-05-18T21:38:54.489 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:38:54.490 INFO:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2020-05-18T21:38:54.490 INFO:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2020-05-18T21:38:54.491 INFO:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2020-05-18T21:38:54.491 INFO:teuthology.orchestra.run.smithi063:> return files[0] 2020-05-18T21:38:54.491 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:38:54.492 INFO:teuthology.orchestra.run.smithi063:> for f in files: 2020-05-18T21:38:54.492 INFO:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-05-18T21:38:54.493 INFO:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2020-05-18T21:38:54.493 INFO:teuthology.orchestra.run.smithi063:> return f 2020-05-18T21:38:54.495 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-05-18T21:38:54.496 INFO:teuthology.orchestra.run.smithi063:> 2020-05-18T21:38:54.496 INFO:teuthology.orchestra.run.smithi063:> print(find_socket("client.0")) 2020-05-18T21:38:54.496 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:38:54.548 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.41764.asok 2020-05-18T21:38:54.553 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.41764.asok 2020-05-18T21:38:54.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:54.554 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.41764.asok status 2020-05-18T21:38:54.643 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:38:54.643 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2020-05-18T21:38:54.644 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "543315c934420269aa12ef2f9dec2c9eadb4fa6f", 2020-05-18T21:38:54.644 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 16.0.0-1640-g543315c9344 (543315c934420269aa12ef2f9dec2c9eadb4fa6f) pacific (dev)", 2020-05-18T21:38:54.644 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2020-05-18T21:38:54.644 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2020-05-18T21:38:54.644 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-05-18T21:38:54.645 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "41764", 2020-05-18T21:38:54.645 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2020-05-18T21:38:54.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:54.645 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2020-05-18T21:38:54.645 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2020-05-18T21:38:54.646 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 10929, 2020-05-18T21:38:54.646 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2020-05-18T21:38:54.646 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2020-05-18T21:38:54.646 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2020-05-18T21:38:54.646 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 10929 2020-05-18T21:38:54.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:54.647 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:38:54.647 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:54.647 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:38:54.647 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 669278680 2020-05-18T21:38:54.647 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:38:54.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:54.648 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2020-05-18T21:38:54.648 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2020-05-18T21:38:54.648 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2020-05-18T21:38:54.648 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 669278680 2020-05-18T21:38:54.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:38:54.649 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.10929 192.168.0.1:0/669278680", 2020-05-18T21:38:54.649 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/669278680", 2020-05-18T21:38:54.649 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2020-05-18T21:38:54.649 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 151, 2020-05-18T21:38:54.649 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 167, 2020-05-18T21:38:54.650 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2020-05-18T21:38:54.650 INFO:teuthology.orchestra.run.smithi063.stdout: "blacklisted": false 2020-05-18T21:38:54.650 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:38:54.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:54.652 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-05-18T21:38:54.653 INFO:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:38:54.661 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2020-05-18T21:38:54.662 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-05-18T21:38:54.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-05-18T21:38:54.663 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:38:54.678 INFO:tasks.cephfs.mount:Validating 8388608 bytes from snapdir/.snap/snap1/subdir/file_a 2020-05-18T21:38:54.679 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-05-18T21:38:54.680 INFO:teuthology.orchestra.run.smithi063:> import zlib 2020-05-18T21:38:54.680 INFO:teuthology.orchestra.run.smithi063:> path = "/home/ubuntu/cephtest/mnt.0/snapdir/.snap/snap1/subdir/file_a" 2020-05-18T21:38:54.680 INFO:teuthology.orchestra.run.smithi063:> with open(path, '"'"'r'"'"') as f: 2020-05-18T21:38:54.681 INFO:teuthology.orchestra.run.smithi063:> bytes = f.read() 2020-05-18T21:38:54.682 INFO:teuthology.orchestra.run.smithi063:> if len(bytes) != 8388608: 2020-05-18T21:38:54.682 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2020-05-18T21:38:54.682 INFO:teuthology.orchestra.run.smithi063:> len(bytes), 8388608 2020-05-18T21:38:54.683 INFO:teuthology.orchestra.run.smithi063:> )) 2020-05-18T21:38:54.683 INFO:teuthology.orchestra.run.smithi063:> for i, b in enumerate(bytes): 2020-05-18T21:38:54.684 INFO:teuthology.orchestra.run.smithi063:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2020-05-18T21:38:54.684 INFO:teuthology.orchestra.run.smithi063:> if b != chr(val): 2020-05-18T21:38:54.685 INFO:teuthology.orchestra.run.smithi063:> raise RuntimeError("Bad data at offset {0}".format(i)) 2020-05-18T21:38:54.685 INFO:teuthology.orchestra.run.smithi063:> ' 2020-05-18T21:38:58.760 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rmdir snapdir/.snap/snap1) 2020-05-18T21:38:58.797 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:38:58.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d34e81700 1 Processor -- start 2020-05-18T21:38:58.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d34e81700 1 -- start start 2020-05-18T21:38:58.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d34e81700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1d3005bda0 0x7f1d30142f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:58.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d34e81700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1d3012ba80 0x7f1d3012bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:38:58.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d34e81700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3005ab40 con 0x7f1d300652b0 2020-05-18T21:38:58.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d34e81700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d300b6a10 con 0x7f1d3005bda0 2020-05-18T21:38:58.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d34e81700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3005ade0 con 0x7f1d3012ba80 2020-05-18T21:38:58.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d2dd9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1d3005bda0 0x7f1d30142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:58.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d2dd9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1d3005bda0 0x7f1d30142f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37294/0 (socket says 172.21.15.63:37294) 2020-05-18T21:38:58.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d2e59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1d300652b0 0x7f1d301400d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39480/0 (socket says 172.21.15.63:39480) 2020-05-18T21:38:58.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d2dd9b700 1 -- 172.21.15.63:0/1777567484 learned_addr learned my addr 172.21.15.63:0/1777567484 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:38:58.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d2ed9d700 1 --2- 172.21.15.63:0/1777567484 >> v2:172.21.15.155:3300/0 conn(0x7f1d3012ba80 0x7f1d3012bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:58.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d2dd9b700 1 -- 172.21.15.63:0/1777567484 >> v2:172.21.15.155:3300/0 conn(0x7f1d3012ba80 msgr2=0x7f1d3012bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:38:58.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d2dd9b700 1 --2- 172.21.15.63:0/1777567484 >> v2:172.21.15.155:3300/0 conn(0x7f1d3012ba80 0x7f1d3012bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:58.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d2dd9b700 1 -- 172.21.15.63:0/1777567484 >> v1:172.21.15.63:6789/0 conn(0x7f1d300652b0 legacy=0x7f1d301400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:58.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d2dd9b700 1 -- 172.21.15.63:0/1777567484 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3005b080 con 0x7f1d3005bda0 2020-05-18T21:38:58.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d2ed9d700 1 --2- 172.21.15.63:0/1777567484 >> v2:172.21.15.155:3300/0 conn(0x7f1d3012ba80 0x7f1d3012bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:38:58.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d2d59a700 1 -- 172.21.15.63:0/1777567484 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155963001 0 0) 0x7f1d3005ab40 con 0x7f1d300652b0 2020-05-18T21:38:58.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d2dd9b700 1 --2- 172.21.15.63:0/1777567484 >> v2:172.21.15.63:3300/0 conn(0x7f1d3005bda0 0x7f1d30142f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1d18002f70 tx=0x7f1d18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:58.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d2dd9b700 1 --2- 172.21.15.63:0/1777567484 >> v2:172.21.15.63:3300/0 conn(0x7f1d3005bda0 0x7f1d30142f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1d18002f70 tx=0x7f1d18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:58.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.944+0000 7f1d2dd9b700 1 --2- 172.21.15.63:0/1777567484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d3005bda0 0x7f1d30142f30 secure :-1 s=READY pgs=2236 cs=0 l=1 rx=0x7f1d18002f70 tx=0x7f1d18007a80).ready entity=mon.0 client_cookie=6c80d13a484ee04e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:58.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.948+0000 7f1d2dd9b700 1 --2- 172.21.15.63:0/1777567484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d3005bda0 0x7f1d30142f30 secure :-1 s=THROTTLE_DONE pgs=2236 cs=0 l=1 rx=0x7f1d18002f70 tx=0x7f1d18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:58.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.948+0000 7f1d2dd9b700 1 --2- 172.21.15.63:0/1777567484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d3005bda0 0x7f1d30142f30 secure :-1 s=THROTTLE_DONE pgs=2236 cs=0 l=1 rx=0x7f1d18002f70 tx=0x7f1d18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:58.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.948+0000 7f1d2d59a700 1 -- 172.21.15.63:0/1777567484 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d18011760 con 0x7f1d3005bda0 2020-05-18T21:38:58.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.948+0000 7f1d2dd9b700 1 --2- 172.21.15.63:0/1777567484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d3005bda0 0x7f1d30142f30 secure :-1 s=THROTTLE_DONE pgs=2236 cs=0 l=1 rx=0x7f1d18002f70 tx=0x7f1d18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:58.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.948+0000 7f1d2d59a700 1 -- 172.21.15.63:0/1777567484 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d180118c0 con 0x7f1d3005bda0 2020-05-18T21:38:58.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.948+0000 7f1d2d59a700 1 -- 172.21.15.63:0/1777567484 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d18011ca0 con 0x7f1d3005bda0 2020-05-18T21:38:58.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.948+0000 7f1d34e81700 1 -- 172.21.15.63:0/1777567484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d3005bda0 msgr2=0x7f1d30142f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:58.959 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.948+0000 7f1d34e81700 1 --2- 172.21.15.63:0/1777567484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d3005bda0 0x7f1d30142f30 secure :-1 s=READY pgs=2236 cs=0 l=1 rx=0x7f1d18002f70 tx=0x7f1d18007a80).stop 2020-05-18T21:38:58.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.948+0000 7f1d34e81700 1 -- 172.21.15.63:0/1777567484 shutdown_connections 2020-05-18T21:38:58.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.948+0000 7f1d34e81700 1 --2- 172.21.15.63:0/1777567484 >> v2:172.21.15.155:3300/0 conn(0x7f1d3012ba80 0x7f1d3012bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:38:58.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.948+0000 7f1d34e81700 1 --2- 172.21.15.63:0/1777567484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d3005bda0 0x7f1d30142f30 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:58.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.948+0000 7f1d34e81700 1 -- 172.21.15.63:0/1777567484 >> 172.21.15.63:0/1777567484 conn(0x7f1d30066ed0 msgr2=0x7f1d300b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:58.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.948+0000 7f1d34e81700 1 -- 172.21.15.63:0/1777567484 shutdown_connections 2020-05-18T21:38:58.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.948+0000 7f1d34e81700 1 -- 172.21.15.63:0/1777567484 wait complete. 2020-05-18T21:38:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.948+0000 7f1d34e81700 1 Processor -- start 2020-05-18T21:38:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.948+0000 7f1d34e81700 1 -- start start 2020-05-18T21:38:58.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d34e81700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1d300652b0 0x7f1d30154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:58.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d34e81700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1d3012ba80 0x7f1d30142780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:58.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d34e81700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d30142be0 con 0x7f1d3005bda0 2020-05-18T21:38:58.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d34e81700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d300ada00 con 0x7f1d300652b0 2020-05-18T21:38:58.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d34e81700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d300adca0 con 0x7f1d3012ba80 2020-05-18T21:38:58.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d2dd9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1d300652b0 0x7f1d30154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:58.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d2e59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1d3005bda0 0x7f1d30150a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39486/0 (socket says 172.21.15.63:39486) 2020-05-18T21:38:58.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d2e59c700 1 -- 172.21.15.63:0/2490170569 learned_addr learned my addr 172.21.15.63:0/2490170569 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:38:58.965 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d2ed9d700 1 --2- 172.21.15.63:0/2490170569 >> v2:172.21.15.155:3300/0 conn(0x7f1d3012ba80 0x7f1d30142780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:58.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d277fe700 1 -- 172.21.15.63:0/2490170569 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146732186 0 0) 0x7f1d30142be0 con 0x7f1d3005bda0 2020-05-18T21:38:58.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d2dd9b700 1 -- 172.21.15.63:0/2490170569 >> v2:172.21.15.155:3300/0 conn(0x7f1d3012ba80 msgr2=0x7f1d30142780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:58.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d2dd9b700 1 --2- 172.21.15.63:0/2490170569 >> v2:172.21.15.155:3300/0 conn(0x7f1d3012ba80 0x7f1d30142780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:58.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d2dd9b700 1 -- 172.21.15.63:0/2490170569 >> v1:172.21.15.63:6789/0 conn(0x7f1d3005bda0 legacy=0x7f1d30150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:58.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d2dd9b700 1 -- 172.21.15.63:0/2490170569 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d300adf40 con 0x7f1d300652b0 2020-05-18T21:38:58.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d2dd9b700 1 --2- 172.21.15.63:0/2490170569 >> v2:172.21.15.63:3300/0 conn(0x7f1d300652b0 0x7f1d30154a80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d18002f70 tx=0x7f1d18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:58.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d2dd9b700 1 --2- 172.21.15.63:0/2490170569 >> v2:172.21.15.63:3300/0 conn(0x7f1d300652b0 0x7f1d30154a80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d18002f70 tx=0x7f1d18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:58.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d2dd9b700 1 --2- 172.21.15.63:0/2490170569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d300652b0 0x7f1d30154a80 secure :-1 s=READY pgs=2238 cs=0 l=1 rx=0x7f1d18002f70 tx=0x7f1d18007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:58.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d2dd9b700 1 --2- 172.21.15.63:0/2490170569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d300652b0 0x7f1d30154a80 secure :-1 s=THROTTLE_DONE pgs=2238 cs=0 l=1 rx=0x7f1d18002f70 tx=0x7f1d18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:58.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d277fe700 1 -- 172.21.15.63:0/2490170569 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d18007360 con 0x7f1d300652b0 2020-05-18T21:38:58.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d2dd9b700 1 --2- 172.21.15.63:0/2490170569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d300652b0 0x7f1d30154a80 secure :-1 s=THROTTLE_DONE pgs=2238 cs=0 l=1 rx=0x7f1d18002f70 tx=0x7f1d18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:58.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d2dd9b700 1 --2- 172.21.15.63:0/2490170569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d300652b0 0x7f1d30154a80 secure :-1 s=THROTTLE_DONE pgs=2238 cs=0 l=1 rx=0x7f1d18002f70 tx=0x7f1d18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:58.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d277fe700 1 -- 172.21.15.63:0/2490170569 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d180074c0 con 0x7f1d300652b0 2020-05-18T21:38:58.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d34e81700 1 -- 172.21.15.63:0/2490170569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d30151170 con 0x7f1d300652b0 2020-05-18T21:38:58.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d277fe700 1 -- 172.21.15.63:0/2490170569 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d18007670 con 0x7f1d300652b0 2020-05-18T21:38:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d34e81700 1 -- 172.21.15.63:0/2490170569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d300ad510 con 0x7f1d300652b0 2020-05-18T21:38:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d2dd9b700 1 --2- 172.21.15.63:0/2490170569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d300652b0 0x7f1d30154a80 secure :-1 s=THROTTLE_DONE pgs=2238 cs=0 l=1 rx=0x7f1d18002f70 tx=0x7f1d18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.952+0000 7f1d34e81700 1 -- 172.21.15.63:0/2490170569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d300ad820 con 0x7f1d300652b0 2020-05-18T21:38:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.956+0000 7f1d277fe700 1 -- 172.21.15.63:0/2490170569 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f1d180058f0 con 0x7f1d300652b0 2020-05-18T21:38:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.956+0000 7f1d2dd9b700 1 --2- 172.21.15.63:0/2490170569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d300652b0 0x7f1d30154a80 secure :-1 s=THROTTLE_DONE pgs=2238 cs=0 l=1 rx=0x7f1d18002f70 tx=0x7f1d18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:58.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.956+0000 7f1d277fe700 1 --2- 172.21.15.63:0/2490170569 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1d1404f8e0 0x7f1d14051da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:38:58.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.956+0000 7f1d277fe700 1 -- 172.21.15.63:0/2490170569 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1d18064310 con 0x7f1d300652b0 2020-05-18T21:38:58.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.956+0000 7f1d2e59c700 1 --2- 172.21.15.63:0/2490170569 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1d1404f8e0 0x7f1d14051da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:38:58.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.956+0000 7f1d2e59c700 1 --2- 172.21.15.63:0/2490170569 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1d1404f8e0 0x7f1d14051da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d200016e0 tx=0x7f1d20001ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:58.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.956+0000 7f1d2e59c700 1 --2- 172.21.15.63:0/2490170569 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1d1404f8e0 0x7f1d14051da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d200016e0 tx=0x7f1d20001ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:58.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.956+0000 7f1d2e59c700 1 --2- 172.21.15.63:0/2490170569 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1d1404f8e0 0x7f1d14051da0 secure :-1 s=READY pgs=877 cs=0 l=1 rx=0x7f1d200016e0 tx=0x7f1d20001ba0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:38:58.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.960+0000 7f1d2dd9b700 1 --2- 172.21.15.63:0/2490170569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d300652b0 0x7f1d30154a80 secure :-1 s=THROTTLE_DONE pgs=2238 cs=0 l=1 rx=0x7f1d18002f70 tx=0x7f1d18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:58.960+0000 7f1d277fe700 1 -- 172.21.15.63:0/2490170569 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f1d1803e760 con 0x7f1d300652b0 2020-05-18T21:38:59.113 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:59.108+0000 7f1d34e81700 1 -- 172.21.15.63:0/2490170569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d300569e0 con 0x7f1d300652b0 2020-05-18T21:38:59.114 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:59.108+0000 7f1d2dd9b700 1 --2- 172.21.15.63:0/2490170569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d300652b0 0x7f1d30154a80 secure :-1 s=THROTTLE_DONE pgs=2238 cs=0 l=1 rx=0x7f1d18002f70 tx=0x7f1d18007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:38:59.115 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:59.108+0000 7f1d277fe700 1 -- 172.21.15.63:0/2490170569 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 151 v151) v1 ==== 95+0+2149 (secure 0 0 0) 0x7f1d18041d80 con 0x7f1d300652b0 2020-05-18T21:38:59.115 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:38:59.115 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":151,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7370,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/726870500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":726870500},{"type":"v1","addr":"172.21.15.63:6833","nonce":726870500}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":149}],"filesystems":[{"mdsmap":{"epoch":151,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-05-18T21:38:30.427505+0000","modified":"2020-05-18T21:38:38.296029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10348":{"gid":10348,"name":"b","rank":0,"incarnation":149,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/3932257542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3932257542},{"type":"v1","addr":"172.21.15.155:6835","nonce":3932257542}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2020-05-18T21:38:59.116 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:59.108+0000 7f1d34e81700 1 -- 172.21.15.63:0/2490170569 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1d1404f8e0 msgr2=0x7f1d14051da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:59.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:59.108+0000 7f1d34e81700 1 --2- 172.21.15.63:0/2490170569 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1d1404f8e0 0x7f1d14051da0 secure :-1 s=READY pgs=877 cs=0 l=1 rx=0x7f1d200016e0 tx=0x7f1d20001ba0).stop 2020-05-18T21:38:59.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:59.108+0000 7f1d34e81700 1 -- 172.21.15.63:0/2490170569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d300652b0 msgr2=0x7f1d30154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:38:59.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:59.108+0000 7f1d34e81700 1 --2- 172.21.15.63:0/2490170569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d300652b0 0x7f1d30154a80 secure :-1 s=READY pgs=2238 cs=0 l=1 rx=0x7f1d18002f70 tx=0x7f1d18007a80).stop 2020-05-18T21:38:59.117 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:59.108+0000 7f1d34e81700 1 -- 172.21.15.63:0/2490170569 shutdown_connections 2020-05-18T21:38:59.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:59.108+0000 7f1d34e81700 1 --2- 172.21.15.63:0/2490170569 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f1d1404f8e0 0x7f1d14051da0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:59.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:59.108+0000 7f1d34e81700 1 --2- 172.21.15.63:0/2490170569 >> v2:172.21.15.155:3300/0 conn(0x7f1d3012ba80 0x7f1d30142780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:59.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:59.108+0000 7f1d34e81700 1 --2- 172.21.15.63:0/2490170569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d300652b0 0x7f1d30154a80 unknown :-1 s=CLOSED pgs=2238 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:38:59.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:59.108+0000 7f1d34e81700 1 -- 172.21.15.63:0/2490170569 >> 172.21.15.63:0/2490170569 conn(0x7f1d30066ed0 msgr2=0x7f1d300b6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:38:59.118 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:59.108+0000 7f1d34e81700 1 -- 172.21.15.63:0/2490170569 shutdown_connections 2020-05-18T21:38:59.119 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:38:59.108+0000 7f1d34e81700 1 -- 172.21.15.63:0/2490170569 wait complete. 2020-05-18T21:38:59.119 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 151 2020-05-18T21:38:59.127 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok flush journal 2020-05-18T21:39:00.650 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:39:00.653 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:39:01.077 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:39:01.077 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "", 2020-05-18T21:39:01.078 INFO:teuthology.orchestra.run.smithi155.stdout: "return_code": 0 2020-05-18T21:39:01.078 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:39:01.092 INFO:tasks.cephfs.filesystem:_json_asok output: { "message": "", "return_code": 0 } 2020-05-18T21:39:01.092 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_data ls 2020-05-18T21:39:01.127 INFO:tasks.ceph.osd.6.smithi155.stderr:2020-05-18T21:39:01.121+0000 7f28cd122700 -1 osd.6 pg_epoch: 168 pg[32.5( v 167'5 (0'0,167'5] local-lis/les=165/166 n=2 ec=165/165 lis/c=165/165 les/c/f=166/166/0 sis=165) [6,5] r=0 lpr=165 crt=167'5 lcod 167'4 mlcod 167'4 active+clean+snaptrim trimq=[2~2]] removing snap head 2020-05-18T21:39:01.131 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.124+0000 7f7004080b80 1 Processor -- start 2020-05-18T21:39:01.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.124+0000 7f7004080b80 1 -- start start 2020-05-18T21:39:01.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.124+0000 7f7004080b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a63d180 0x55760a6c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:01.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.124+0000 7f7004080b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55760a6bd2e0 0x55760a6c4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:01.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.124+0000 7f7004080b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55760a59d4b0 con 0x55760a621c80 2020-05-18T21:39:01.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.124+0000 7f7004080b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x55760a589110 con 0x55760a6bd2e0 2020-05-18T21:39:01.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.124+0000 7f7004080b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55760a579a40 con 0x55760a63d180 2020-05-18T21:39:01.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f7001cc2700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x55760a621c80 0x55760a6bcbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39506/0 (socket says 172.21.15.63:39506) 2020-05-18T21:39:01.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f7001cc2700 1 -- 172.21.15.63:0/3770241387 learned_addr learned my addr 172.21.15.63:0/3770241387 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:01.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f7002cc4700 1 --2- 172.21.15.63:0/3770241387 >> v2:172.21.15.63:3300/0 conn(0x55760a6bd2e0 0x55760a6c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:01.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f70024c3700 1 --2- 172.21.15.63:0/3770241387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a63d180 0x55760a6c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:01.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f6ffbfff700 1 -- 172.21.15.63:0/3770241387 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857197155 0 0) 0x55760a59d4b0 con 0x55760a621c80 2020-05-18T21:39:01.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f6ffbfff700 1 -- 172.21.15.63:0/3770241387 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fe4002020 con 0x55760a621c80 2020-05-18T21:39:01.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f6ffbfff700 1 -- 172.21.15.63:0/3770241387 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2563847615 0 0) 0x7f6fe4002020 con 0x55760a621c80 2020-05-18T21:39:01.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f6ffbfff700 1 -- 172.21.15.63:0/3770241387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a63d180 msgr2=0x55760a6c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:01.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f6ffbfff700 1 --2- 172.21.15.63:0/3770241387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a63d180 0x55760a6c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:01.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f6ffbfff700 1 -- 172.21.15.63:0/3770241387 >> v2:172.21.15.63:3300/0 conn(0x55760a6bd2e0 msgr2=0x55760a6c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:01.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f6ffbfff700 1 --2- 172.21.15.63:0/3770241387 >> v2:172.21.15.63:3300/0 conn(0x55760a6bd2e0 0x55760a6c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:01.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f6ffbfff700 1 -- 172.21.15.63:0/3770241387 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55760a57d460 con 0x55760a621c80 2020-05-18T21:39:01.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f6ffbfff700 1 -- 172.21.15.63:0/3770241387 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f6ff4001330 con 0x55760a621c80 2020-05-18T21:39:01.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f6ffbfff700 1 -- 172.21.15.63:0/3770241387 >> v1:172.21.15.63:6789/0 conn(0x55760a621c80 legacy=0x55760a6bcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:01.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f6ffbfff700 1 --2- 172.21.15.63:0/3770241387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe4002640 0x7f6fe4002a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:01.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f6ffbfff700 1 --2- 172.21.15.63:0/3770241387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a63d180 0x7f6fe4002ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:01.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f6ffbfff700 1 --2- 172.21.15.63:0/3770241387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fe40033b0 0x7f6fe4003830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:01.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f6ffbfff700 1 -- 172.21.15.63:0/3770241387 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x55760a589110 con 0x7f6fe4002640 2020-05-18T21:39:01.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f6ffbfff700 1 -- 172.21.15.63:0/3770241387 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55760a579a40 con 0x7f6fe40033b0 2020-05-18T21:39:01.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f6ffbfff700 1 -- 172.21.15.63:0/3770241387 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe4003e00 con 0x55760a63d180 2020-05-18T21:39:01.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f70024c3700 1 --2- 172.21.15.63:0/3770241387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe4002640 0x7f6fe4002a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:01.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f7002cc4700 1 --2- 172.21.15.63:0/3770241387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fe40033b0 0x7f6fe4003830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:01.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f70024c3700 1 -- 172.21.15.63:0/3770241387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a63d180 msgr2=0x7f6fe4002ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:01.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f70024c3700 1 --2- 172.21.15.63:0/3770241387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a63d180 0x7f6fe4002ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:01.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f70024c3700 1 -- 172.21.15.63:0/3770241387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fe40033b0 msgr2=0x7f6fe4003830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:01.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f70024c3700 1 --2- 172.21.15.63:0/3770241387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fe40033b0 0x7f6fe4003830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:01.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f70024c3700 1 -- 172.21.15.63:0/3770241387 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55760a57d460 con 0x7f6fe4002640 2020-05-18T21:39:01.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f7002cc4700 1 --2- 172.21.15.63:0/3770241387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fe40033b0 0x7f6fe4003830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:39:01.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f70024c3700 1 --2- 172.21.15.63:0/3770241387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe4002640 0x7f6fe4002a80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6fec001420 tx=0x7f6fec001d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:01.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f70024c3700 1 --2- 172.21.15.63:0/3770241387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe4002640 0x7f6fe4002a80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6fec001420 tx=0x7f6fec001d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:01.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f70024c3700 1 --2- 172.21.15.63:0/3770241387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe4002640 0x7f6fe4002a80 secure :-1 s=READY pgs=2242 cs=0 l=1 rx=0x7f6fec001420 tx=0x7f6fec001d40).ready entity=mon.0 client_cookie=28ae21ccdda35ff server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:01.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f70024c3700 1 --2- 172.21.15.63:0/3770241387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe4002640 0x7f6fe4002a80 secure :-1 s=THROTTLE_DONE pgs=2242 cs=0 l=1 rx=0x7f6fec001420 tx=0x7f6fec001d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:01.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f6ffbfff700 1 -- 172.21.15.63:0/3770241387 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fec00d920 con 0x7f6fe4002640 2020-05-18T21:39:01.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f70024c3700 1 --2- 172.21.15.63:0/3770241387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe4002640 0x7f6fe4002a80 secure :-1 s=THROTTLE_DONE pgs=2242 cs=0 l=1 rx=0x7f6fec001420 tx=0x7f6fec001d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:01.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f6ffbfff700 1 -- 172.21.15.63:0/3770241387 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec00da80 con 0x7f6fe4002640 2020-05-18T21:39:01.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f70024c3700 1 --2- 172.21.15.63:0/3770241387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe4002640 0x7f6fe4002a80 secure :-1 s=THROTTLE_DONE pgs=2242 cs=0 l=1 rx=0x7f6fec001420 tx=0x7f6fec001d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:01.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f7004080b80 1 -- 172.21.15.63:0/3770241387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe4002640 msgr2=0x7f6fe4002a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:01.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f6ffbfff700 1 -- 172.21.15.63:0/3770241387 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fec00de20 con 0x7f6fe4002640 2020-05-18T21:39:01.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f7004080b80 1 --2- 172.21.15.63:0/3770241387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe4002640 0x7f6fe4002a80 secure :-1 s=READY pgs=2242 cs=0 l=1 rx=0x7f6fec001420 tx=0x7f6fec001d40).stop 2020-05-18T21:39:01.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f7002cc4700 1 -- 172.21.15.63:0/3770241387 reap_dead start 2020-05-18T21:39:01.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f7004080b80 1 -- 172.21.15.63:0/3770241387 shutdown_connections 2020-05-18T21:39:01.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f7004080b80 1 -- 172.21.15.63:0/3770241387 >> 172.21.15.63:0/3770241387 conn(0x55760a63e640 msgr2=0x55760a63ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:01.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f7004080b80 1 -- 172.21.15.63:0/3770241387 shutdown_connections 2020-05-18T21:39:01.157 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f7004080b80 1 -- 172.21.15.63:0/3770241387 wait complete. 2020-05-18T21:39:01.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f7004080b80 1 Processor -- start 2020-05-18T21:39:01.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.128+0000 7f7004080b80 1 -- start start 2020-05-18T21:39:01.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7004080b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55760a6c0050 0x55760a5e7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:01.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7004080b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a6c0430 0x55760a5ff180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:01.158 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7004080b80 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55760a6be6e0 con 0x55760a5ff5e0 2020-05-18T21:39:01.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7004080b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x55760a6bd040 con 0x55760a6c0050 2020-05-18T21:39:01.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7004080b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55760a6d50a0 con 0x55760a6c0430 2020-05-18T21:39:01.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f70024c3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x55760a6c0050 0x55760a5e7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:01.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7001cc2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a6c0430 0x55760a5ff180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:01.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7001cc2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a6c0430 0x55760a5ff180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:56266/0 (socket says 172.21.15.63:56266) 2020-05-18T21:39:01.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7001cc2700 1 -- 172.21.15.63:0/3287182140 learned_addr learned my addr 172.21.15.63:0/3287182140 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:01.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f6ffb7fe700 1 -- 172.21.15.63:0/3287182140 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245868932 0 0) 0x55760a6be6e0 con 0x55760a5ff5e0 2020-05-18T21:39:01.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f6ffb7fe700 1 -- 172.21.15.63:0/3287182140 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fe4004220 con 0x55760a5ff5e0 2020-05-18T21:39:01.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7001cc2700 1 -- 172.21.15.63:0/3287182140 >> v2:172.21.15.63:3300/0 conn(0x55760a6c0050 msgr2=0x55760a5e7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:01.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7001cc2700 1 --2- 172.21.15.63:0/3287182140 >> v2:172.21.15.63:3300/0 conn(0x55760a6c0050 0x55760a5e7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:01.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7001cc2700 1 -- 172.21.15.63:0/3287182140 >> v1:172.21.15.155:6789/0 conn(0x55760a5ff5e0 legacy=0x55760a6d7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:01.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7001cc2700 1 -- 172.21.15.63:0/3287182140 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55760a6bbe00 con 0x55760a6c0430 2020-05-18T21:39:01.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7001cc2700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a6c0430 0x55760a5ff180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ff40010c0 tx=0x7f6ff400f940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:01.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7001cc2700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a6c0430 0x55760a5ff180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ff40010c0 tx=0x7f6ff400f940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:01.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7001cc2700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a6c0430 0x55760a5ff180 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7f6ff40010c0 tx=0x7f6ff400f940).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:01.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7001cc2700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a6c0430 0x55760a5ff180 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f6ff40010c0 tx=0x7f6ff400f940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:01.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f6ffb7fe700 1 -- 172.21.15.63:0/3287182140 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ff4004a70 con 0x55760a6c0430 2020-05-18T21:39:01.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7001cc2700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a6c0430 0x55760a5ff180 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f6ff40010c0 tx=0x7f6ff400f940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:01.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7001cc2700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a6c0430 0x55760a5ff180 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f6ff40010c0 tx=0x7f6ff400f940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:01.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f6ffb7fe700 1 -- 172.21.15.63:0/3287182140 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff4004bd0 con 0x55760a6c0430 2020-05-18T21:39:01.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7004080b80 1 -- 172.21.15.63:0/3287182140 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55760a6d4da0 con 0x55760a6c0430 2020-05-18T21:39:01.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f6ffb7fe700 1 -- 172.21.15.63:0/3287182140 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ff40053a0 con 0x55760a6c0430 2020-05-18T21:39:01.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7004080b80 1 -- 172.21.15.63:0/3287182140 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55760a5e7250 con 0x55760a6c0430 2020-05-18T21:39:01.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7001cc2700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a6c0430 0x55760a5ff180 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f6ff40010c0 tx=0x7f6ff400f940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:01.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f6ffb7fe700 1 -- 172.21.15.63:0/3287182140 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6ff400b0b0 con 0x55760a6c0430 2020-05-18T21:39:01.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f7001cc2700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a6c0430 0x55760a5ff180 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f6ff40010c0 tx=0x7f6ff400f940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:01.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.132+0000 7f6ffb7fe700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6fe40537f0 0x7f6fe4055cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:01.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.136+0000 7f6ffb7fe700 1 -- 172.21.15.63:0/3287182140 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f6ff40629c0 con 0x55760a6c0430 2020-05-18T21:39:01.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.136+0000 7f70024c3700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6fe40537f0 0x7f6fe4055cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:01.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.136+0000 7f7004080b80 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55760a6dfaf0 0x55760a6e1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:01.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.136+0000 7f7004080b80 1 -- 172.21.15.63:0/3287182140 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- osd_op(unknown.0.0:1 32.0 32:00000000::::head [pgnls start_epoch 168 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e168) v8 -- 0x55760a6e2340 con 0x55760a6dfaf0 2020-05-18T21:39:01.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.136+0000 7f7002cc4700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55760a6dfaf0 0x55760a6e1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:01.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.136+0000 7f7002cc4700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55760a6dfaf0 0x55760a6e1ee0 crc :-1 s=READY pgs=34 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:01.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.136+0000 7f70024c3700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6fe40537f0 0x7f6fe4055cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6fec001420 tx=0x7f6fec001d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:01.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.136+0000 7f70024c3700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6fe40537f0 0x7f6fe4055cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6fec001420 tx=0x7f6fec001d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:01.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.136+0000 7f70024c3700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6fe40537f0 0x7f6fe4055cb0 secure :-1 s=READY pgs=878 cs=0 l=1 rx=0x7f6fec001420 tx=0x7f6fec001d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:01.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.140+0000 7f7002cc4700 1 -- 172.21.15.63:0/3287182140 <== osd.3 v2:172.21.15.63:6814/12805 1 ==== osd_op_reply(1 [pgnls start_epoch 168 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ffc004620 con 0x55760a6dfaf0 2020-05-18T21:39:01.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.140+0000 7f7002cc4700 1 -- 172.21.15.63:0/3287182140 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- osd_op(unknown.0.0:2 32.4 32:20000000::::head [pgnls start_epoch 168 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e168) v8 -- 0x55760a6e2340 con 0x55760a6dfaf0 2020-05-18T21:39:01.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.140+0000 7f7002cc4700 1 -- 172.21.15.63:0/3287182140 <== osd.3 v2:172.21.15.63:6814/12805 2 ==== osd_op_reply(2 [pgnls start_epoch 168 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ffc004620 con 0x55760a6dfaf0 2020-05-18T21:39:01.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.140+0000 7f7002cc4700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x55760a63d180 0x7f6ffc004870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:01.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.140+0000 7f7002cc4700 1 -- 172.21.15.63:0/3287182140 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- osd_op(unknown.0.0:3 32.2 32:40000000::::head [pgnls start_epoch 168 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e168) v8 -- 0x55760a6e2340 con 0x55760a63d180 2020-05-18T21:39:01.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.140+0000 7f70024c3700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x55760a63d180 0x7f6ffc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:01.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.140+0000 7f70024c3700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x55760a63d180 0x7f6ffc004870 crc :-1 s=READY pgs=48 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:01.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.148+0000 7f70024c3700 1 -- 172.21.15.63:0/3287182140 <== osd.0 v2:172.21.15.63:6800/12803 1 ==== osd_op_reply(3 [pgnls start_epoch 168 out=81b] v167'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x7f6fec00d9a0 con 0x55760a63d180 2020-05-18T21:39:01.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.148+0000 7f70024c3700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f6fec00dbf0 0x7f6fec00f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:01.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.148+0000 7f70024c3700 1 -- 172.21.15.63:0/3287182140 --> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] -- osd_op(unknown.0.0:4 32.6 32:60000000::::head [pgnls start_epoch 168 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e168) v8 -- 0x55760a6e2340 con 0x7f6fec00dbf0 2020-05-18T21:39:01.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.148+0000 7f7001cc2700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f6fec00dbf0 0x7f6fec00f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:01.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.148+0000 7f7001cc2700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f6fec00dbf0 0x7f6fec00f9a0 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:01.169 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.148+0000 7f7001cc2700 1 -- 172.21.15.63:0/3287182140 <== osd.5 v2:172.21.15.155:6808/13024 1 ==== osd_op_reply(4 [pgnls start_epoch 168 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ff403ee10 con 0x7f6fec00dbf0 2020-05-18T21:39:01.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.148+0000 7f7001cc2700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f6ff403ff60 0x7f6ff403f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:01.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.148+0000 7f7001cc2700 1 -- 172.21.15.63:0/3287182140 --> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] -- osd_op(unknown.0.0:5 32.1 32:80000000::::head [pgnls start_epoch 168 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e168) v8 -- 0x55760a6e2340 con 0x7f6ff403ff60 2020-05-18T21:39:01.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.148+0000 7f7002cc4700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f6ff403ff60 0x7f6ff403f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:01.170 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.148+0000 7f7002cc4700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f6ff403ff60 0x7f6ff403f9d0 crc :-1 s=READY pgs=34 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:01.170 INFO:tasks.ceph.osd.0.smithi063.stderr:2020-05-18T21:39:01.148+0000 7ff521679700 -1 osd.0 pg_epoch: 168 pg[32.2( v 167'7 (0'0,167'7] local-lis/les=165/166 n=2 ec=165/165 lis/c=165/165 les/c/f=166/166/0 sis=165) [0,6] r=0 lpr=165 crt=167'7 lcod 167'6 mlcod 167'6 active+clean+snaptrim trimq=[2~2]] removing snap head 2020-05-18T21:39:01.173 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.152+0000 7f7002cc4700 1 -- 172.21.15.63:0/3287182140 <== osd.2 v2:172.21.15.63:6822/12806 1 ==== osd_op_reply(5 [pgnls start_epoch 168 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ffc004620 con 0x7f6ff403ff60 2020-05-18T21:39:01.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.152+0000 7f7002cc4700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x55760a6bd2e0 0x7f6ffc0053a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:01.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.152+0000 7f7002cc4700 1 -- 172.21.15.63:0/3287182140 --> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] -- osd_op(unknown.0.0:6 32.5 32:a0000000::::head [pgnls start_epoch 168 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e168) v8 -- 0x55760a6e2340 con 0x55760a6bd2e0 2020-05-18T21:39:01.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.156+0000 7f70024c3700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x55760a6bd2e0 0x7f6ffc0053a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:01.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.156+0000 7f70024c3700 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x55760a6bd2e0 0x7f6ffc0053a0 crc :-1 s=READY pgs=44 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:01.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.156+0000 7f70024c3700 1 -- 172.21.15.63:0/3287182140 <== osd.6 v2:172.21.15.155:6815/13025 1 ==== osd_op_reply(6 [pgnls start_epoch 168 out=49b] v168'7 uv5 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fec00d9a0 con 0x55760a6bd2e0 2020-05-18T21:39:01.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.156+0000 7f70024c3700 1 -- 172.21.15.63:0/3287182140 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- osd_op(unknown.0.0:7 32.3 32:c0000000::::head [pgnls start_epoch 168 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e168) v8 -- 0x55760a6e2340 con 0x55760a63d180 2020-05-18T21:39:01.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.156+0000 7f70024c3700 1 -- 172.21.15.63:0/3287182140 <== osd.0 v2:172.21.15.63:6800/12803 2 ==== osd_op_reply(7 [pgnls start_epoch 168 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fec00d9a0 con 0x55760a63d180 2020-05-18T21:39:01.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.156+0000 7f70024c3700 1 -- 172.21.15.63:0/3287182140 --> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] -- osd_op(unknown.0.0:8 32.7 32:e0000000::::head [pgnls start_epoch 168 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e168) v8 -- 0x55760a6e2340 con 0x7f6ff403ff60 2020-05-18T21:39:01.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7002cc4700 1 -- 172.21.15.63:0/3287182140 <== osd.2 v2:172.21.15.63:6822/12806 2 ==== osd_op_reply(8 [pgnls start_epoch 168 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ffc004620 con 0x7f6ff403ff60 2020-05-18T21:39:01.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 -- 172.21.15.63:0/3287182140 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x55760a63d180 msgr2=0x7f6ffc004870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:01.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x55760a63d180 0x7f6ffc004870 crc :-1 s=READY pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:01.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 -- 172.21.15.63:0/3287182140 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f6ff403ff60 msgr2=0x7f6ff403f9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:01.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f6ff403ff60 0x7f6ff403f9d0 crc :-1 s=READY pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:01.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 -- 172.21.15.63:0/3287182140 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55760a6dfaf0 msgr2=0x55760a6e1ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:01.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x55760a6dfaf0 0x55760a6e1ee0 crc :-1 s=READY pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:01.177 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 -- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f6fec00dbf0 msgr2=0x7f6fec00f9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:01.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f6fec00dbf0 0x7f6fec00f9a0 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:01.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 -- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x55760a6bd2e0 msgr2=0x7f6ffc0053a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:01.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x55760a6bd2e0 0x7f6ffc0053a0 crc :-1 s=READY pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:01.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7002cc4700 1 -- 172.21.15.63:0/3287182140 reap_dead start 2020-05-18T21:39:01.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7002cc4700 1 -- 172.21.15.63:0/3287182140 reap_dead start 2020-05-18T21:39:01.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 -- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6fe40537f0 msgr2=0x7f6fe4055cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:01.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6fe40537f0 0x7f6fe4055cb0 secure :-1 s=READY pgs=878 cs=0 l=1 rx=0x7f6fec001420 tx=0x7f6fec001d40).stop 2020-05-18T21:39:01.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 -- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a6c0430 msgr2=0x55760a5ff180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:01.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a6c0430 0x55760a5ff180 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7f6ff40010c0 tx=0x7f6ff400f940).stop 2020-05-18T21:39:01.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 -- 172.21.15.63:0/3287182140 shutdown_connections 2020-05-18T21:39:01.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6fe40537f0 0x7f6fe4055cb0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:01.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 --2- 172.21.15.63:0/3287182140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55760a6c0430 0x55760a5ff180 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:01.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 -- 172.21.15.63:0/3287182140 >> 172.21.15.63:0/3287182140 conn(0x55760a63e640 msgr2=0x55760a621790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:01.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 -- 172.21.15.63:0/3287182140 shutdown_connections 2020-05-18T21:39:01.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:01.160+0000 7f7004080b80 1 -- 172.21.15.63:0/3287182140 wait complete. 2020-05-18T21:39:01.181 INFO:teuthology.orchestra.run.smithi063.stdout:10000000002.00000000 2020-05-18T21:39:01.181 INFO:tasks.cephfs.filesystem:Objects not absent (ino 1099511627778, size 8388608): {'10000000002.00000000'} 2020-05-18T21:39:01.182 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60)... 2020-05-18T21:39:06.189 INFO:teuthology.orchestra.run.smithi063:> rados -p cephfs_data ls 2020-05-18T21:39:06.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.212+0000 7f41e7437b80 1 Processor -- start 2020-05-18T21:39:06.219 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.212+0000 7f41e7437b80 1 -- start start 2020-05-18T21:39:06.220 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.212+0000 7f41e7437b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x564f9fa83680 0x564f9f9da490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:06.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.212+0000 7f41e7437b80 1 --2- >> v2:172.21.15.155:3300/0 conn(0x564f9fa83ea0 0x564f9f9d7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:06.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.212+0000 7f41e7437b80 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x564f9f9534b0 con 0x564f9fa83a60 2020-05-18T21:39:06.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.212+0000 7f41e7437b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x564f9f93f110 con 0x564f9fa83680 2020-05-18T21:39:06.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.212+0000 7f41e7437b80 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x564f9f92fa40 con 0x564f9fa83ea0 2020-05-18T21:39:06.221 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.212+0000 7f41e587a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x564f9fa83680 0x564f9f9da490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.212+0000 7f41e5079700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x564f9fa83a60 0x564f9fa8ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39542/0 (socket says 172.21.15.63:39542) 2020-05-18T21:39:06.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.212+0000 7f41e5079700 1 -- 172.21.15.63:0/1699066678 learned_addr learned my addr 172.21.15.63:0/1699066678 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:06.222 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.212+0000 7f41e607b700 1 --2- 172.21.15.63:0/1699066678 >> v2:172.21.15.155:3300/0 conn(0x564f9fa83ea0 0x564f9f9d7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41df7fe700 1 -- 172.21.15.63:0/1699066678 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962316320 0 0) 0x564f9f9534b0 con 0x564f9fa83a60 2020-05-18T21:39:06.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e587a700 1 -- 172.21.15.63:0/1699066678 >> v2:172.21.15.155:3300/0 conn(0x564f9fa83ea0 msgr2=0x564f9f9d7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:06.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e587a700 1 --2- 172.21.15.63:0/1699066678 >> v2:172.21.15.155:3300/0 conn(0x564f9fa83ea0 0x564f9f9d7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:06.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e587a700 1 -- 172.21.15.63:0/1699066678 >> v1:172.21.15.63:6789/0 conn(0x564f9fa83a60 legacy=0x564f9fa8ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e587a700 1 -- 172.21.15.63:0/1699066678 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f9f933460 con 0x564f9fa83680 2020-05-18T21:39:06.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e607b700 1 --2- 172.21.15.63:0/1699066678 >> v2:172.21.15.155:3300/0 conn(0x564f9fa83ea0 0x564f9f9d7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:39:06.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e587a700 1 --2- 172.21.15.63:0/1699066678 >> v2:172.21.15.63:3300/0 conn(0x564f9fa83680 0x564f9f9da490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f41d8002f70 tx=0x7f41d800a8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e587a700 1 --2- 172.21.15.63:0/1699066678 >> v2:172.21.15.63:3300/0 conn(0x564f9fa83680 0x564f9f9da490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f41d8002f70 tx=0x7f41d800a8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e587a700 1 --2- 172.21.15.63:0/1699066678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f9fa83680 0x564f9f9da490 secure :-1 s=READY pgs=2245 cs=0 l=1 rx=0x7f41d8002f70 tx=0x7f41d800a8b0).ready entity=mon.0 client_cookie=7259b41cf51ae6a server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:06.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e587a700 1 --2- 172.21.15.63:0/1699066678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f9fa83680 0x564f9f9da490 secure :-1 s=THROTTLE_DONE pgs=2245 cs=0 l=1 rx=0x7f41d8002f70 tx=0x7f41d800a8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41df7fe700 1 -- 172.21.15.63:0/1699066678 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41d8010960 con 0x564f9fa83680 2020-05-18T21:39:06.226 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e587a700 1 --2- 172.21.15.63:0/1699066678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f9fa83680 0x564f9f9da490 secure :-1 s=THROTTLE_DONE pgs=2245 cs=0 l=1 rx=0x7f41d8002f70 tx=0x7f41d800a8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e587a700 1 --2- 172.21.15.63:0/1699066678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f9fa83680 0x564f9f9da490 secure :-1 s=THROTTLE_DONE pgs=2245 cs=0 l=1 rx=0x7f41d8002f70 tx=0x7f41d800a8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41df7fe700 1 -- 172.21.15.63:0/1699066678 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d8010ac0 con 0x564f9fa83680 2020-05-18T21:39:06.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41df7fe700 1 -- 172.21.15.63:0/1699066678 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41d8010e20 con 0x564f9fa83680 2020-05-18T21:39:06.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e7437b80 1 -- 172.21.15.63:0/1699066678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f9fa83680 msgr2=0x564f9f9da490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.227 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e7437b80 1 --2- 172.21.15.63:0/1699066678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f9fa83680 0x564f9f9da490 secure :-1 s=READY pgs=2245 cs=0 l=1 rx=0x7f41d8002f70 tx=0x7f41d800a8b0).stop 2020-05-18T21:39:06.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e7437b80 1 -- 172.21.15.63:0/1699066678 shutdown_connections 2020-05-18T21:39:06.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e7437b80 1 --2- 172.21.15.63:0/1699066678 >> v2:172.21.15.155:3300/0 conn(0x564f9fa83ea0 0x564f9f9d7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:06.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e7437b80 1 --2- 172.21.15.63:0/1699066678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f9fa83680 0x564f9f9da490 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e7437b80 1 -- 172.21.15.63:0/1699066678 >> 172.21.15.63:0/1699066678 conn(0x564f9f9f6850 msgr2=0x564f9f9b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:06.228 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e7437b80 1 -- 172.21.15.63:0/1699066678 shutdown_connections 2020-05-18T21:39:06.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e7437b80 1 -- 172.21.15.63:0/1699066678 wait complete. 2020-05-18T21:39:06.229 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e7437b80 1 Processor -- start 2020-05-18T21:39:06.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.216+0000 7f41e7437b80 1 -- start start 2020-05-18T21:39:06.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e7437b80 1 --2- >> v2:172.21.15.63:3300/0 conn(0x564f9fa83a60 0x564f9f9b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:06.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e7437b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564f9fa83ea0 0x564f9fa7f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:06.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e7437b80 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x564f9fa7de20 con 0x564f9fa83680 2020-05-18T21:39:06.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e7437b80 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x564f9fa7e050 con 0x564f9fa83a60 2020-05-18T21:39:06.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e7437b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x564f9fa78ce0 con 0x564f9fa83ea0 2020-05-18T21:39:06.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e5079700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x564f9fa83a60 0x564f9f9b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e5079700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x564f9fa83a60 0x564f9f9b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37360/0 (socket says 172.21.15.63:37360) 2020-05-18T21:39:06.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e5079700 1 -- 172.21.15.63:0/2372929822 learned_addr learned my addr 172.21.15.63:0/2372929822 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:06.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e607b700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564f9fa83ea0 0x564f9fa7f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41deffd700 1 -- 172.21.15.63:0/2372929822 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360278278 0 0) 0x564f9fa7de20 con 0x564f9fa83680 2020-05-18T21:39:06.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e5079700 1 -- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564f9fa83ea0 msgr2=0x564f9fa7f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e5079700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564f9fa83ea0 0x564f9fa7f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e5079700 1 -- 172.21.15.63:0/2372929822 >> v1:172.21.15.155:6789/0 conn(0x564f9fa83680 legacy=0x564f9fa86910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e5079700 1 -- 172.21.15.63:0/2372929822 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f9fa78960 con 0x564f9fa83a60 2020-05-18T21:39:06.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e5079700 1 --2- 172.21.15.63:0/2372929822 >> v2:172.21.15.63:3300/0 conn(0x564f9fa83a60 0x564f9f9b2c00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41d0000bf0 tx=0x7f41d000b040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e5079700 1 --2- 172.21.15.63:0/2372929822 >> v2:172.21.15.63:3300/0 conn(0x564f9fa83a60 0x564f9f9b2c00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41d0000bf0 tx=0x7f41d000b040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e5079700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f9fa83a60 0x564f9f9b2c00 secure :-1 s=READY pgs=2246 cs=0 l=1 rx=0x7f41d0000bf0 tx=0x7f41d000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:06.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e5079700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f9fa83a60 0x564f9f9b2c00 secure :-1 s=THROTTLE_DONE pgs=2246 cs=0 l=1 rx=0x7f41d0000bf0 tx=0x7f41d000b040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41deffd700 1 -- 172.21.15.63:0/2372929822 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41d000b800 con 0x564f9fa83a60 2020-05-18T21:39:06.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e5079700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f9fa83a60 0x564f9f9b2c00 secure :-1 s=THROTTLE_DONE pgs=2246 cs=0 l=1 rx=0x7f41d0000bf0 tx=0x7f41d000b040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e5079700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f9fa83a60 0x564f9f9b2c00 secure :-1 s=THROTTLE_DONE pgs=2246 cs=0 l=1 rx=0x7f41d0000bf0 tx=0x7f41d000b040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41deffd700 1 -- 172.21.15.63:0/2372929822 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d000b960 con 0x564f9fa83a60 2020-05-18T21:39:06.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e7437b80 1 -- 172.21.15.63:0/2372929822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564f9fa872a0 con 0x564f9fa83a60 2020-05-18T21:39:06.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41deffd700 1 -- 172.21.15.63:0/2372929822 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41d000bd80 con 0x564f9fa83a60 2020-05-18T21:39:06.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.220+0000 7f41e7437b80 1 -- 172.21.15.63:0/2372929822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f9fa7fca0 con 0x564f9fa83a60 2020-05-18T21:39:06.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.224+0000 7f41e5079700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f9fa83a60 0x564f9f9b2c00 secure :-1 s=THROTTLE_DONE pgs=2246 cs=0 l=1 rx=0x7f41d0000bf0 tx=0x7f41d000b040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.224+0000 7f41deffd700 1 -- 172.21.15.63:0/2372929822 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f41d0006280 con 0x564f9fa83a60 2020-05-18T21:39:06.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.224+0000 7f41e5079700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f9fa83a60 0x564f9f9b2c00 secure :-1 s=THROTTLE_DONE pgs=2246 cs=0 l=1 rx=0x7f41d0000bf0 tx=0x7f41d000b040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.224+0000 7f41deffd700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41c804e460 0x7f41c8050920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:06.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.224+0000 7f41deffd700 1 -- 172.21.15.63:0/2372929822 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f41d0062c00 con 0x564f9fa83a60 2020-05-18T21:39:06.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.224+0000 7f41e7437b80 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x564f9fa924d0 0x564f9fa9b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:06.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.224+0000 7f41e7437b80 1 -- 172.21.15.63:0/2372929822 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- osd_op(unknown.0.0:1 32.0 32:00000000::::head [pgnls start_epoch 169 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e169) v8 -- 0x564f9fa9b4c0 con 0x564f9fa924d0 2020-05-18T21:39:06.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.224+0000 7f41e587a700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41c804e460 0x7f41c8050920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.224+0000 7f41e607b700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x564f9fa924d0 0x564f9fa9b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.224+0000 7f41e587a700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41c804e460 0x7f41c8050920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41d8000bc0 tx=0x7f41d800a8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.224+0000 7f41e587a700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41c804e460 0x7f41c8050920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41d8000bc0 tx=0x7f41d800a8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.224+0000 7f41e587a700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41c804e460 0x7f41c8050920 secure :-1 s=READY pgs=879 cs=0 l=1 rx=0x7f41d8000bc0 tx=0x7f41d800a8b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:06.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.224+0000 7f41e607b700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x564f9fa924d0 0x564f9fa9b060 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:06.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.224+0000 7f41e607b700 1 -- 172.21.15.63:0/2372929822 <== osd.3 v2:172.21.15.63:6814/12805 1 ==== osd_op_reply(1 [pgnls start_epoch 169 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41e0007540 con 0x564f9fa924d0 2020-05-18T21:39:06.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.224+0000 7f41e607b700 1 -- 172.21.15.63:0/2372929822 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- osd_op(unknown.0.0:2 32.4 32:20000000::::head [pgnls start_epoch 169 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e169) v8 -- 0x564f9fa9b4c0 con 0x564f9fa924d0 2020-05-18T21:39:06.243 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.228+0000 7f41e607b700 1 -- 172.21.15.63:0/2372929822 <== osd.3 v2:172.21.15.63:6814/12805 2 ==== osd_op_reply(2 [pgnls start_epoch 169 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41e0007540 con 0x564f9fa924d0 2020-05-18T21:39:06.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.228+0000 7f41e607b700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f41e0010bd0 0x7f41e000f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:06.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.228+0000 7f41e607b700 1 -- 172.21.15.63:0/2372929822 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- osd_op(unknown.0.0:3 32.2 32:40000000::::head [pgnls start_epoch 169 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e169) v8 -- 0x564f9fa9b4c0 con 0x7f41e0010bd0 2020-05-18T21:39:06.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.228+0000 7f41e587a700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f41e0010bd0 0x7f41e000f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.228+0000 7f41e587a700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f41e0010bd0 0x7f41e000f2c0 crc :-1 s=READY pgs=49 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:06.244 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.228+0000 7f41e587a700 1 -- 172.21.15.63:0/2372929822 <== osd.0 v2:172.21.15.63:6800/12803 1 ==== osd_op_reply(3 [pgnls start_epoch 169 out=49b] v168'9 uv7 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41d8007b90 con 0x7f41e0010bd0 2020-05-18T21:39:06.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.228+0000 7f41e587a700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f41d800c210 0x7f41d800c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:06.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.228+0000 7f41e587a700 1 -- 172.21.15.63:0/2372929822 --> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] -- osd_op(unknown.0.0:4 32.6 32:60000000::::head [pgnls start_epoch 169 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e169) v8 -- 0x564f9fa9b4c0 con 0x7f41d800c210 2020-05-18T21:39:06.245 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.228+0000 7f41e5079700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f41d800c210 0x7f41d800c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.232+0000 7f41e5079700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f41d800c210 0x7f41d800c650 crc :-1 s=READY pgs=36 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:06.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.232+0000 7f41e5079700 1 -- 172.21.15.63:0/2372929822 <== osd.5 v2:172.21.15.155:6808/13024 1 ==== osd_op_reply(4 [pgnls start_epoch 169 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41d000d080 con 0x7f41d800c210 2020-05-18T21:39:06.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.232+0000 7f41e5079700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f41d00401a0 0x7f41d003fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:06.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.232+0000 7f41e5079700 1 -- 172.21.15.63:0/2372929822 --> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] -- osd_op(unknown.0.0:5 32.1 32:80000000::::head [pgnls start_epoch 169 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e169) v8 -- 0x564f9fa9b4c0 con 0x7f41d00401a0 2020-05-18T21:39:06.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.232+0000 7f41e607b700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f41d00401a0 0x7f41d003fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.232+0000 7f41e607b700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f41d00401a0 0x7f41d003fc10 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:06.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.232+0000 7f41e607b700 1 -- 172.21.15.63:0/2372929822 <== osd.2 v2:172.21.15.63:6822/12806 1 ==== osd_op_reply(5 [pgnls start_epoch 169 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41e0007540 con 0x7f41d00401a0 2020-05-18T21:39:06.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.232+0000 7f41e607b700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f41e0011370 0x7f41e0011790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:06.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.232+0000 7f41e607b700 1 -- 172.21.15.63:0/2372929822 --> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] -- osd_op(unknown.0.0:6 32.5 32:a0000000::::head [pgnls start_epoch 169 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e169) v8 -- 0x564f9fa9b4c0 con 0x7f41e0011370 2020-05-18T21:39:06.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.236+0000 7f41e587a700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f41e0011370 0x7f41e0011790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.236+0000 7f41e587a700 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f41e0011370 0x7f41e0011790 crc :-1 s=READY pgs=45 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:06.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.236+0000 7f41e587a700 1 -- 172.21.15.63:0/2372929822 <== osd.6 v2:172.21.15.155:6815/13025 1 ==== osd_op_reply(6 [pgnls start_epoch 169 out=49b] v168'7 uv5 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41d8007b90 con 0x7f41e0011370 2020-05-18T21:39:06.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.236+0000 7f41e587a700 1 -- 172.21.15.63:0/2372929822 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- osd_op(unknown.0.0:7 32.3 32:c0000000::::head [pgnls start_epoch 169 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e169) v8 -- 0x564f9fa9b4c0 con 0x7f41e0010bd0 2020-05-18T21:39:06.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.236+0000 7f41e587a700 1 -- 172.21.15.63:0/2372929822 <== osd.0 v2:172.21.15.63:6800/12803 2 ==== osd_op_reply(7 [pgnls start_epoch 169 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41d8007b90 con 0x7f41e0010bd0 2020-05-18T21:39:06.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.236+0000 7f41e587a700 1 -- 172.21.15.63:0/2372929822 --> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] -- osd_op(unknown.0.0:8 32.7 32:e0000000::::head [pgnls start_epoch 169 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e169) v8 -- 0x564f9fa9b4c0 con 0x7f41d00401a0 2020-05-18T21:39:06.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e607b700 1 -- 172.21.15.63:0/2372929822 <== osd.2 v2:172.21.15.63:6822/12806 2 ==== osd_op_reply(8 [pgnls start_epoch 169 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41e0007540 con 0x7f41d00401a0 2020-05-18T21:39:06.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 -- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f41e0010bd0 msgr2=0x7f41e000f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7f41e0010bd0 0x7f41e000f2c0 crc :-1 s=READY pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 -- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f41d00401a0 msgr2=0x7f41d003fc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7f41d00401a0 0x7f41d003fc10 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 -- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x564f9fa924d0 msgr2=0x564f9fa9b060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x564f9fa924d0 0x564f9fa9b060 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 -- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f41d800c210 msgr2=0x7f41d800c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f41d800c210 0x7f41d800c650 crc :-1 s=READY pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 -- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f41e0011370 msgr2=0x7f41e0011790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f41e0011370 0x7f41e0011790 crc :-1 s=READY pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e607b700 1 -- 172.21.15.63:0/2372929822 reap_dead start 2020-05-18T21:39:06.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e607b700 1 -- 172.21.15.63:0/2372929822 reap_dead start 2020-05-18T21:39:06.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 -- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41c804e460 msgr2=0x7f41c8050920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41c804e460 0x7f41c8050920 secure :-1 s=READY pgs=879 cs=0 l=1 rx=0x7f41d8000bc0 tx=0x7f41d800a8b0).stop 2020-05-18T21:39:06.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 -- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f9fa83a60 msgr2=0x564f9f9b2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f9fa83a60 0x564f9f9b2c00 secure :-1 s=READY pgs=2246 cs=0 l=1 rx=0x7f41d0000bf0 tx=0x7f41d000b040).stop 2020-05-18T21:39:06.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 -- 172.21.15.63:0/2372929822 shutdown_connections 2020-05-18T21:39:06.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f41c804e460 0x7f41c8050920 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 --2- 172.21.15.63:0/2372929822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f9fa83a60 0x564f9f9b2c00 unknown :-1 s=CLOSED pgs=2246 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 -- 172.21.15.63:0/2372929822 >> 172.21.15.63:0/2372929822 conn(0x564f9f9f6850 msgr2=0x564f9f9d6730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:06.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 -- 172.21.15.63:0/2372929822 shutdown_connections 2020-05-18T21:39:06.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.240+0000 7f41e7437b80 1 -- 172.21.15.63:0/2372929822 wait complete. 2020-05-18T21:39:06.256 INFO:tasks.cephfs.filesystem:All objects for ino 1099511627778 size 8388608 are absent 2020-05-18T21:39:06.256 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s 2020-05-18T21:39:06.257 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:39:06.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb23cb34700 1 Processor -- start 2020-05-18T21:39:06.370 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb23cb34700 1 -- start start 2020-05-18T21:39:06.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb23cb34700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb238144350 0x7fb23806a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:06.371 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb23cb34700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2380b4dd0 con 0x7fb2380b5670 2020-05-18T21:39:06.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb23cb34700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb238061260 con 0x7fb238144730 2020-05-18T21:39:06.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb23cb34700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb238061500 con 0x7fb238144350 2020-05-18T21:39:06.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb236d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb2380b5670 0x7fb23809c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39568/0 (socket says 172.21.15.63:39568) 2020-05-18T21:39:06.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb236d9d700 1 -- 172.21.15.63:0/2228033393 learned_addr learned my addr 172.21.15.63:0/2228033393 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:06.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb23659c700 1 --2- 172.21.15.63:0/2228033393 >> v2:172.21.15.155:3300/0 conn(0x7fb238144350 0x7fb23806a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb235d9b700 1 -- 172.21.15.63:0/2228033393 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2620599852 0 0) 0x7fb2380b4dd0 con 0x7fb2380b5670 2020-05-18T21:39:06.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb235d9b700 1 -- 172.21.15.63:0/2228033393 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb218003270 con 0x7fb2380b5670 2020-05-18T21:39:06.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb235d9b700 1 -- 172.21.15.63:0/2228033393 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800578017 0 0) 0x7fb238061260 con 0x7fb238144730 2020-05-18T21:39:06.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb235d9b700 1 -- 172.21.15.63:0/2228033393 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2380b4dd0 con 0x7fb238144730 2020-05-18T21:39:06.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb23659c700 1 -- 172.21.15.63:0/2228033393 >> v1:172.21.15.155:6789/0 conn(0x7fb238144730 legacy=0x7fb2380619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.375 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb23659c700 1 -- 172.21.15.63:0/2228033393 >> v1:172.21.15.63:6789/0 conn(0x7fb2380b5670 legacy=0x7fb23809c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb23659c700 1 -- 172.21.15.63:0/2228033393 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb238144b90 con 0x7fb238144350 2020-05-18T21:39:06.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb23659c700 1 --2- 172.21.15.63:0/2228033393 >> v2:172.21.15.155:3300/0 conn(0x7fb238144350 0x7fb23806a280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb228002f70 tx=0x7fb228007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb23659c700 1 --2- 172.21.15.63:0/2228033393 >> v2:172.21.15.155:3300/0 conn(0x7fb238144350 0x7fb23806a280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb228002f70 tx=0x7fb228007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb23659c700 1 --2- 172.21.15.63:0/2228033393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb238144350 0x7fb23806a280 secure :-1 s=READY pgs=1497 cs=0 l=1 rx=0x7fb228002f70 tx=0x7fb228007a80).ready entity=mon.1 client_cookie=dbaee1eafe2c00c2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:06.376 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.364+0000 7fb23659c700 1 --2- 172.21.15.63:0/2228033393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb238144350 0x7fb23806a280 secure :-1 s=THROTTLE_DONE pgs=1497 cs=0 l=1 rx=0x7fb228002f70 tx=0x7fb228007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.368+0000 7fb235d9b700 1 -- 172.21.15.63:0/2228033393 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb228008e80 con 0x7fb238144350 2020-05-18T21:39:06.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.368+0000 7fb23659c700 1 --2- 172.21.15.63:0/2228033393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb238144350 0x7fb23806a280 secure :-1 s=THROTTLE_DONE pgs=1497 cs=0 l=1 rx=0x7fb228002f70 tx=0x7fb228007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.368+0000 7fb23659c700 1 --2- 172.21.15.63:0/2228033393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb238144350 0x7fb23806a280 secure :-1 s=THROTTLE_DONE pgs=1497 cs=0 l=1 rx=0x7fb228002f70 tx=0x7fb228007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.377 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.368+0000 7fb235d9b700 1 -- 172.21.15.63:0/2228033393 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb228011540 con 0x7fb238144350 2020-05-18T21:39:06.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.368+0000 7fb235d9b700 1 -- 172.21.15.63:0/2228033393 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb228011920 con 0x7fb238144350 2020-05-18T21:39:06.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.368+0000 7fb23cb34700 1 -- 172.21.15.63:0/2228033393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb238144350 msgr2=0x7fb23806a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.368+0000 7fb23cb34700 1 --2- 172.21.15.63:0/2228033393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb238144350 0x7fb23806a280 secure :-1 s=READY pgs=1497 cs=0 l=1 rx=0x7fb228002f70 tx=0x7fb228007a80).stop 2020-05-18T21:39:06.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.368+0000 7fb23cb34700 1 -- 172.21.15.63:0/2228033393 shutdown_connections 2020-05-18T21:39:06.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.368+0000 7fb23cb34700 1 --2- 172.21.15.63:0/2228033393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb238144350 0x7fb23806a280 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.368+0000 7fb23cb34700 1 -- 172.21.15.63:0/2228033393 >> 172.21.15.63:0/2228033393 conn(0x7fb23805b240 msgr2=0x7fb238069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:06.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.368+0000 7fb23cb34700 1 -- 172.21.15.63:0/2228033393 shutdown_connections 2020-05-18T21:39:06.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.368+0000 7fb23cb34700 1 -- 172.21.15.63:0/2228033393 wait complete. 2020-05-18T21:39:06.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.368+0000 7fb23cb34700 1 Processor -- start 2020-05-18T21:39:06.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.368+0000 7fb23cb34700 1 -- start start 2020-05-18T21:39:06.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb23cb34700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb2380b5670 0x7fb2380b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:06.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb23cb34700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb238144350 0x7fb238146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:06.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb23cb34700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb238144730 0x7fb238140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:06.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb23cb34700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb238063840 con 0x7fb238144730 2020-05-18T21:39:06.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb23cb34700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb238146de0 con 0x7fb2380b5670 2020-05-18T21:39:06.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb23cb34700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb238063300 con 0x7fb238144350 2020-05-18T21:39:06.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb236d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb238144730 0x7fb238140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb236d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb238144730 0x7fb238140880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37386/0 (socket says 172.21.15.63:37386) 2020-05-18T21:39:06.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb236d9d700 1 -- 172.21.15.63:0/1100031587 learned_addr learned my addr 172.21.15.63:0/1100031587 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:06.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb22dd9b700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb238144350 0x7fb238146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb23659c700 1 --2- 172.21.15.63:0/1100031587 >> v2:172.21.15.155:3300/0 conn(0x7fb2380b5670 0x7fb2380b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb236d9d700 1 -- 172.21.15.63:0/1100031587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb238144350 msgr2=0x7fb238146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb236d9d700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb238144350 0x7fb238146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb236d9d700 1 -- 172.21.15.63:0/1100031587 >> v2:172.21.15.155:3300/0 conn(0x7fb2380b5670 msgr2=0x7fb2380b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb236d9d700 1 --2- 172.21.15.63:0/1100031587 >> v2:172.21.15.155:3300/0 conn(0x7fb2380b5670 0x7fb2380b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb236d9d700 1 -- 172.21.15.63:0/1100031587 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2380635a0 con 0x7fb238144730 2020-05-18T21:39:06.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb236d9d700 1 --2- 172.21.15.63:0/1100031587 >> v2:172.21.15.63:3300/0 conn(0x7fb238144730 0x7fb238140880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb230001490 tx=0x7fb230010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb236d9d700 1 --2- 172.21.15.63:0/1100031587 >> v2:172.21.15.63:3300/0 conn(0x7fb238144730 0x7fb238140880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb230001490 tx=0x7fb230010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb236d9d700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb238144730 0x7fb238140880 secure :-1 s=READY pgs=2248 cs=0 l=1 rx=0x7fb230001490 tx=0x7fb230010cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb236d9d700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb238144730 0x7fb238140880 secure :-1 s=THROTTLE_DONE pgs=2248 cs=0 l=1 rx=0x7fb230001490 tx=0x7fb230010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb236d9d700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb238144730 0x7fb238140880 secure :-1 s=THROTTLE_DONE pgs=2248 cs=0 l=1 rx=0x7fb230001490 tx=0x7fb230010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb22ffff700 1 -- 172.21.15.63:0/1100031587 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb230005e90 con 0x7fb238144730 2020-05-18T21:39:06.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb236d9d700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb238144730 0x7fb238140880 secure :-1 s=THROTTLE_DONE pgs=2248 cs=0 l=1 rx=0x7fb230001490 tx=0x7fb230010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb22ffff700 1 -- 172.21.15.63:0/1100031587 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2300124b0 con 0x7fb238144730 2020-05-18T21:39:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb23cb34700 1 -- 172.21.15.63:0/1100031587 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb238151240 con 0x7fb238144730 2020-05-18T21:39:06.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb22ffff700 1 -- 172.21.15.63:0/1100031587 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2300128d0 con 0x7fb238144730 2020-05-18T21:39:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb23cb34700 1 -- 172.21.15.63:0/1100031587 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2380658a0 con 0x7fb238144730 2020-05-18T21:39:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb236d9d700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb238144730 0x7fb238140880 secure :-1 s=THROTTLE_DONE pgs=2248 cs=0 l=1 rx=0x7fb230001490 tx=0x7fb230010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb23cb34700 1 -- 172.21.15.63:0/1100031587 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2380630f0 con 0x7fb238144730 2020-05-18T21:39:06.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb22ffff700 1 -- 172.21.15.63:0/1100031587 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb230012b40 con 0x7fb238144730 2020-05-18T21:39:06.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb236d9d700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb238144730 0x7fb238140880 secure :-1 s=THROTTLE_DONE pgs=2248 cs=0 l=1 rx=0x7fb230001490 tx=0x7fb230010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.372+0000 7fb22ffff700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb21c04f9c0 0x7fb21c051e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:06.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.376+0000 7fb22ffff700 1 -- 172.21.15.63:0/1100031587 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb2300090c0 con 0x7fb238144730 2020-05-18T21:39:06.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.376+0000 7fb23659c700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb21c04f9c0 0x7fb21c051e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.376+0000 7fb23659c700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb21c04f9c0 0x7fb21c051e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb228002f70 tx=0x7fb228007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.376+0000 7fb23659c700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb21c04f9c0 0x7fb21c051e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb228002f70 tx=0x7fb228007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.376+0000 7fb23659c700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb21c04f9c0 0x7fb21c051e80 secure :-1 s=READY pgs=880 cs=0 l=1 rx=0x7fb228002f70 tx=0x7fb228007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:06.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.380+0000 7fb236d9d700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb238144730 0x7fb238140880 secure :-1 s=THROTTLE_DONE pgs=2248 cs=0 l=1 rx=0x7fb230001490 tx=0x7fb230010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.380+0000 7fb22ffff700 1 -- 172.21.15.63:0/1100031587 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb23003e640 con 0x7fb238144730 2020-05-18T21:39:06.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.532+0000 7fb23cb34700 1 -- 172.21.15.63:0/1100031587 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2381513d0 con 0x7fb238144730 2020-05-18T21:39:06.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.532+0000 7fb236d9d700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb238144730 0x7fb238140880 secure :-1 s=THROTTLE_DONE pgs=2248 cs=0 l=1 rx=0x7fb230001490 tx=0x7fb230010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.532+0000 7fb22ffff700 1 -- 172.21.15.63:0/1100031587 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 151 v151) v1 ==== 95+0+2149 (secure 0 0 0) 0x7fb230041c60 con 0x7fb238144730 2020-05-18T21:39:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:39:06.540 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":151,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7370,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/726870500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":726870500},{"type":"v1","addr":"172.21.15.63:6833","nonce":726870500}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":149}],"filesystems":[{"mdsmap":{"epoch":151,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-05-18T21:38:30.427505+0000","modified":"2020-05-18T21:38:38.296029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10348":{"gid":10348,"name":"b","rank":0,"incarnation":149,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/3932257542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3932257542},{"type":"v1","addr":"172.21.15.155:6835","nonce":3932257542}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2020-05-18T21:39:06.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.536+0000 7fb23cb34700 1 -- 172.21.15.63:0/1100031587 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb21c04f9c0 msgr2=0x7fb21c051e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.542 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.536+0000 7fb23cb34700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb21c04f9c0 0x7fb21c051e80 secure :-1 s=READY pgs=880 cs=0 l=1 rx=0x7fb228002f70 tx=0x7fb228007a80).stop 2020-05-18T21:39:06.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.536+0000 7fb23cb34700 1 -- 172.21.15.63:0/1100031587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb238144730 msgr2=0x7fb238140880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.536+0000 7fb23cb34700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb238144730 0x7fb238140880 secure :-1 s=READY pgs=2248 cs=0 l=1 rx=0x7fb230001490 tx=0x7fb230010cd0).stop 2020-05-18T21:39:06.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.536+0000 7fb23cb34700 1 -- 172.21.15.63:0/1100031587 shutdown_connections 2020-05-18T21:39:06.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.536+0000 7fb23cb34700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb21c04f9c0 0x7fb21c051e80 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.536+0000 7fb23cb34700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb238144730 0x7fb238140880 unknown :-1 s=CLOSED pgs=2248 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.544 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.536+0000 7fb23cb34700 1 --2- 172.21.15.63:0/1100031587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb238144350 0x7fb238146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.536+0000 7fb23cb34700 1 --2- 172.21.15.63:0/1100031587 >> v2:172.21.15.155:3300/0 conn(0x7fb2380b5670 0x7fb2380b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.536+0000 7fb23cb34700 1 -- 172.21.15.63:0/1100031587 >> 172.21.15.63:0/1100031587 conn(0x7fb23805b240 msgr2=0x7fb23809cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:06.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.536+0000 7fb23cb34700 1 -- 172.21.15.63:0/1100031587 shutdown_connections 2020-05-18T21:39:06.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.536+0000 7fb23cb34700 1 -- 172.21.15.63:0/1100031587 wait complete. 2020-05-18T21:39:06.547 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 151 2020-05-18T21:39:06.553 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump mds_cache strays_enqueued 2020-05-18T21:39:06.659 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:39:06.659 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2020-05-18T21:39:06.659 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 2 2020-05-18T21:39:06.660 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:39:06.660 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:39:06.669 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_cache": { "strays_enqueued": 2 } } 2020-05-18T21:39:06.670 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-05-18T21:39:06.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.772+0000 7f802f59e700 1 Processor -- start 2020-05-18T21:39:06.780 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.772+0000 7f802f59e700 1 -- start start 2020-05-18T21:39:06.781 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.772+0000 7f802f59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f80301435d0 0x7f8030063ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:06.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.772+0000 7f802f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8030147140 0x7f803005edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:06.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.772+0000 7f802f59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80301480a0 con 0x7f803005f230 2020-05-18T21:39:06.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.772+0000 7f802f59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80301476c0 con 0x7f80301435d0 2020-05-18T21:39:06.782 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.772+0000 7f802f59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8030147960 con 0x7f8030147140 2020-05-18T21:39:06.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802dd9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8030147140 0x7f803005edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802e59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f80301435d0 0x7f8030063ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802dd9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8030147140 0x7f803005edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.63:56324/0 (socket says 172.21.15.63:56324) 2020-05-18T21:39:06.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802dd9b700 1 -- 172.21.15.63:0/3802019890 learned_addr learned my addr 172.21.15.63:0/3802019890 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:06.783 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802ed9d700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f803005f230 0x7f80300b8200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:37898/0 (socket says 172.21.15.63:37898) 2020-05-18T21:39:06.786 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802d59a700 1 -- 172.21.15.63:0/3802019890 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331597095 0 0) 0x7f80301480a0 con 0x7f803005f230 2020-05-18T21:39:06.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802d59a700 1 -- 172.21.15.63:0/3802019890 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8010003270 con 0x7f803005f230 2020-05-18T21:39:06.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802dd9b700 1 -- 172.21.15.63:0/3802019890 >> v2:172.21.15.155:3300/0 conn(0x7f80301435d0 msgr2=0x7f8030063ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:06.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802dd9b700 1 --2- 172.21.15.63:0/3802019890 >> v2:172.21.15.155:3300/0 conn(0x7f80301435d0 0x7f8030063ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:06.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802dd9b700 1 -- 172.21.15.63:0/3802019890 >> v1:172.21.15.155:6789/0 conn(0x7f803005f230 legacy=0x7f80300b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802dd9b700 1 -- 172.21.15.63:0/3802019890 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8030147c00 con 0x7f8030147140 2020-05-18T21:39:06.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802dd9b700 1 --2- 172.21.15.63:0/3802019890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8030147140 0x7f803005edd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f80180032f0 tx=0x7f8018007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802dd9b700 1 --2- 172.21.15.63:0/3802019890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8030147140 0x7f803005edd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f80180032f0 tx=0x7f8018007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802dd9b700 1 --2- 172.21.15.63:0/3802019890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8030147140 0x7f803005edd0 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7f80180032f0 tx=0x7f8018007e00).ready entity=mon.2 client_cookie=f057ecf377aee18e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:06.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802dd9b700 1 --2- 172.21.15.63:0/3802019890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8030147140 0x7f803005edd0 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f80180032f0 tx=0x7f8018007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802d59a700 1 -- 172.21.15.63:0/3802019890 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8018011c60 con 0x7f8030147140 2020-05-18T21:39:06.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802dd9b700 1 --2- 172.21.15.63:0/3802019890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8030147140 0x7f803005edd0 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f80180032f0 tx=0x7f8018007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802dd9b700 1 --2- 172.21.15.63:0/3802019890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8030147140 0x7f803005edd0 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f80180032f0 tx=0x7f8018007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802d59a700 1 -- 172.21.15.63:0/3802019890 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8018011dc0 con 0x7f8030147140 2020-05-18T21:39:06.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802d59a700 1 -- 172.21.15.63:0/3802019890 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f801800a370 con 0x7f8030147140 2020-05-18T21:39:06.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802f59e700 1 -- 172.21.15.63:0/3802019890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8030147140 msgr2=0x7f803005edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802f59e700 1 --2- 172.21.15.63:0/3802019890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8030147140 0x7f803005edd0 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7f80180032f0 tx=0x7f8018007e00).stop 2020-05-18T21:39:06.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802f59e700 1 -- 172.21.15.63:0/3802019890 shutdown_connections 2020-05-18T21:39:06.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802f59e700 1 --2- 172.21.15.63:0/3802019890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8030147140 0x7f803005edd0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802f59e700 1 --2- 172.21.15.63:0/3802019890 >> v2:172.21.15.155:3300/0 conn(0x7f80301435d0 0x7f8030063ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:06.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802f59e700 1 -- 172.21.15.63:0/3802019890 >> 172.21.15.63:0/3802019890 conn(0x7f8030069fc0 msgr2=0x7f803006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:06.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802f59e700 1 -- 172.21.15.63:0/3802019890 shutdown_connections 2020-05-18T21:39:06.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.776+0000 7f802f59e700 1 -- 172.21.15.63:0/3802019890 wait complete. 2020-05-18T21:39:06.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802f59e700 1 Processor -- start 2020-05-18T21:39:06.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802f59e700 1 -- start start 2020-05-18T21:39:06.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802f59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f803005f230 0x7f8030156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:06.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802f59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f80301435d0 0x7f80301423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:06.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802f59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80301531c0 con 0x7f8030147140 2020-05-18T21:39:06.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802f59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8030153460 con 0x7f803005f230 2020-05-18T21:39:06.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802f59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80301455e0 con 0x7f80301435d0 2020-05-18T21:39:06.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802e59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f803005f230 0x7f8030156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802ed9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8030147140 0x7f8030153900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39588/0 (socket says 172.21.15.63:39588) 2020-05-18T21:39:06.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802ed9d700 1 -- 172.21.15.63:0/2046452073 learned_addr learned my addr 172.21.15.63:0/2046452073 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:06.794 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802dd9b700 1 --2- 172.21.15.63:0/2046452073 >> v2:172.21.15.155:3300/0 conn(0x7f80301435d0 0x7f80301423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802e59c700 1 -- 172.21.15.63:0/2046452073 >> v2:172.21.15.155:3300/0 conn(0x7f80301435d0 msgr2=0x7f80301423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802e59c700 1 --2- 172.21.15.63:0/2046452073 >> v2:172.21.15.155:3300/0 conn(0x7f80301435d0 0x7f80301423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802e59c700 1 -- 172.21.15.63:0/2046452073 >> v1:172.21.15.63:6789/0 conn(0x7f8030147140 legacy=0x7f8030153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802e59c700 1 -- 172.21.15.63:0/2046452073 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8030145720 con 0x7f803005f230 2020-05-18T21:39:06.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f80277fe700 1 -- 172.21.15.63:0/2046452073 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392566073 0 0) 0x7f80301531c0 con 0x7f8030147140 2020-05-18T21:39:06.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802e59c700 1 --2- 172.21.15.63:0/2046452073 >> v2:172.21.15.63:3300/0 conn(0x7f803005f230 0x7f8030156480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8020002f70 tx=0x7f8020010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802e59c700 1 --2- 172.21.15.63:0/2046452073 >> v2:172.21.15.63:3300/0 conn(0x7f803005f230 0x7f8030156480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8020002f70 tx=0x7f8020010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802e59c700 1 --2- 172.21.15.63:0/2046452073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f803005f230 0x7f8030156480 secure :-1 s=READY pgs=2250 cs=0 l=1 rx=0x7f8020002f70 tx=0x7f8020010c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:06.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802e59c700 1 --2- 172.21.15.63:0/2046452073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f803005f230 0x7f8030156480 secure :-1 s=THROTTLE_DONE pgs=2250 cs=0 l=1 rx=0x7f8020002f70 tx=0x7f8020010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802e59c700 1 --2- 172.21.15.63:0/2046452073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f803005f230 0x7f8030156480 secure :-1 s=THROTTLE_DONE pgs=2250 cs=0 l=1 rx=0x7f8020002f70 tx=0x7f8020010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f80277fe700 1 -- 172.21.15.63:0/2046452073 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8020007180 con 0x7f803005f230 2020-05-18T21:39:06.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802e59c700 1 --2- 172.21.15.63:0/2046452073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f803005f230 0x7f8030156480 secure :-1 s=THROTTLE_DONE pgs=2250 cs=0 l=1 rx=0x7f8020002f70 tx=0x7f8020010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f80277fe700 1 -- 172.21.15.63:0/2046452073 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80200072e0 con 0x7f803005f230 2020-05-18T21:39:06.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802f59e700 1 -- 172.21.15.63:0/2046452073 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80300b4870 con 0x7f803005f230 2020-05-18T21:39:06.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f80277fe700 1 -- 172.21.15.63:0/2046452073 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80200089b0 con 0x7f803005f230 2020-05-18T21:39:06.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.780+0000 7f802f59e700 1 -- 172.21.15.63:0/2046452073 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8030152580 con 0x7f803005f230 2020-05-18T21:39:06.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.784+0000 7f802e59c700 1 --2- 172.21.15.63:0/2046452073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f803005f230 0x7f8030156480 secure :-1 s=THROTTLE_DONE pgs=2250 cs=0 l=1 rx=0x7f8020002f70 tx=0x7f8020010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.784+0000 7f802f59e700 1 -- 172.21.15.63:0/2046452073 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80300569e0 con 0x7f803005f230 2020-05-18T21:39:06.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.784+0000 7f80277fe700 1 -- 172.21.15.63:0/2046452073 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8020008c20 con 0x7f803005f230 2020-05-18T21:39:06.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.784+0000 7f802e59c700 1 --2- 172.21.15.63:0/2046452073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f803005f230 0x7f8030156480 secure :-1 s=THROTTLE_DONE pgs=2250 cs=0 l=1 rx=0x7f8020002f70 tx=0x7f8020010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.784+0000 7f80277fe700 1 --2- 172.21.15.63:0/2046452073 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f801404f920 0x7f8014051de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:06.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.784+0000 7f80277fe700 1 -- 172.21.15.63:0/2046452073 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8020063cd0 con 0x7f803005f230 2020-05-18T21:39:06.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.784+0000 7f802dd9b700 1 --2- 172.21.15.63:0/2046452073 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f801404f920 0x7f8014051de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:06.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.784+0000 7f802dd9b700 1 --2- 172.21.15.63:0/2046452073 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f801404f920 0x7f8014051de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f80180032f0 tx=0x7f8018007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.784+0000 7f802dd9b700 1 --2- 172.21.15.63:0/2046452073 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f801404f920 0x7f8014051de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f80180032f0 tx=0x7f8018007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.784+0000 7f802dd9b700 1 --2- 172.21.15.63:0/2046452073 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f801404f920 0x7f8014051de0 secure :-1 s=READY pgs=881 cs=0 l=1 rx=0x7f80180032f0 tx=0x7f8018007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:06.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.788+0000 7f802e59c700 1 --2- 172.21.15.63:0/2046452073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f803005f230 0x7f8030156480 secure :-1 s=THROTTLE_DONE pgs=2250 cs=0 l=1 rx=0x7f8020002f70 tx=0x7f8020010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.788+0000 7f80277fe700 1 -- 172.21.15.63:0/2046452073 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f802003e120 con 0x7f803005f230 2020-05-18T21:39:06.948 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.940+0000 7f802f59e700 1 -- 172.21.15.63:0/2046452073 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80300008d0 con 0x7f803005f230 2020-05-18T21:39:06.949 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.940+0000 7f802e59c700 1 --2- 172.21.15.63:0/2046452073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f803005f230 0x7f8030156480 secure :-1 s=THROTTLE_DONE pgs=2250 cs=0 l=1 rx=0x7f8020002f70 tx=0x7f8020010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:06.950 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.940+0000 7f80277fe700 1 -- 172.21.15.63:0/2046452073 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 151 v151) v1 ==== 95+0+2149 (secure 0 0 0) 0x7f8020041740 con 0x7f803005f230 2020-05-18T21:39:06.950 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:39:06.950 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":151,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7370,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.63:6833/726870500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":726870500},{"type":"v1","addr":"172.21.15.63:6833","nonce":726870500}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":149}],"filesystems":[{"mdsmap":{"epoch":151,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2020-05-18T21:38:30.427505+0000","modified":"2020-05-18T21:38:38.296029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10348":{"gid":10348,"name":"b","rank":0,"incarnation":149,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/3932257542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3932257542},{"type":"v1","addr":"172.21.15.155:6835","nonce":3932257542}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2020-05-18T21:39:06.951 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.944+0000 7f802f59e700 1 -- 172.21.15.63:0/2046452073 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f801404f920 msgr2=0x7f8014051de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.944+0000 7f802f59e700 1 --2- 172.21.15.63:0/2046452073 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f801404f920 0x7f8014051de0 secure :-1 s=READY pgs=881 cs=0 l=1 rx=0x7f80180032f0 tx=0x7f8018007e00).stop 2020-05-18T21:39:06.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.944+0000 7f802f59e700 1 -- 172.21.15.63:0/2046452073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f803005f230 msgr2=0x7f8030156480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:06.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.944+0000 7f802f59e700 1 --2- 172.21.15.63:0/2046452073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f803005f230 0x7f8030156480 secure :-1 s=READY pgs=2250 cs=0 l=1 rx=0x7f8020002f70 tx=0x7f8020010c20).stop 2020-05-18T21:39:06.952 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.944+0000 7f802f59e700 1 -- 172.21.15.63:0/2046452073 shutdown_connections 2020-05-18T21:39:06.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.944+0000 7f802f59e700 1 --2- 172.21.15.63:0/2046452073 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f801404f920 0x7f8014051de0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.944+0000 7f802f59e700 1 --2- 172.21.15.63:0/2046452073 >> v2:172.21.15.155:3300/0 conn(0x7f80301435d0 0x7f80301423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.944+0000 7f802f59e700 1 --2- 172.21.15.63:0/2046452073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f803005f230 0x7f8030156480 unknown :-1 s=CLOSED pgs=2250 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:06.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.944+0000 7f802f59e700 1 -- 172.21.15.63:0/2046452073 >> 172.21.15.63:0/2046452073 conn(0x7f8030069fc0 msgr2=0x7f8030061110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:06.953 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.944+0000 7f802f59e700 1 -- 172.21.15.63:0/2046452073 shutdown_connections 2020-05-18T21:39:06.954 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:06.944+0000 7f802f59e700 1 -- 172.21.15.63:0/2046452073 wait complete. 2020-05-18T21:39:06.954 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 151 2020-05-18T21:39:06.962 INFO:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump purge_queue pq_executed 2020-05-18T21:39:07.071 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2020-05-18T21:39:07.071 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2020-05-18T21:39:07.072 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 2 2020-05-18T21:39:07.072 INFO:teuthology.orchestra.run.smithi155.stdout: } 2020-05-18T21:39:07.072 INFO:teuthology.orchestra.run.smithi155.stdout:} 2020-05-18T21:39:07.077 INFO:tasks.cephfs.filesystem:_json_asok output: { "purge_queue": { "pq_executed": 2 } } 2020-05-18T21:39:07.078 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early df --format=json-pretty 2020-05-18T21:39:07.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.180+0000 7f6ae759e700 1 Processor -- start 2020-05-18T21:39:07.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.180+0000 7f6ae759e700 1 -- start start 2020-05-18T21:39:07.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6ae805f0d0 0x7f6ae8061640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:07.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ae81448d0 0x7f6ae80ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:07.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae8143fb0 con 0x7f6ae8144450 2020-05-18T21:39:07.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae759e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae8143dd0 con 0x7f6ae805f0d0 2020-05-18T21:39:07.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae805f4b0 con 0x7f6ae81448d0 2020-05-18T21:39:07.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6ae805f0d0 0x7f6ae8061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:07.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6ae805f0d0 0x7f6ae8061640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37406/0 (socket says 172.21.15.63:37406) 2020-05-18T21:39:07.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae6d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ae81448d0 0x7f6ae80ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:07.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae659c700 1 -- 172.21.15.63:0/1678197489 learned_addr learned my addr 172.21.15.63:0/1678197489 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:07.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae659c700 1 -- 172.21.15.63:0/1678197489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ae81448d0 msgr2=0x7f6ae80ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:07.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae659c700 1 --2- 172.21.15.63:0/1678197489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ae81448d0 0x7f6ae80ac4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:07.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae5d9b700 1 -- 172.21.15.63:0/1678197489 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429561164 0 0) 0x7f6ae8143fb0 con 0x7f6ae8144450 2020-05-18T21:39:07.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae659c700 1 -- 172.21.15.63:0/1678197489 >> v1:172.21.15.155:6789/0 conn(0x7f6ae8144450 legacy=0x7f6ae8140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:07.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae659c700 1 -- 172.21.15.63:0/1678197489 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae8148010 con 0x7f6ae805f0d0 2020-05-18T21:39:07.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae659c700 1 --2- 172.21.15.63:0/1678197489 >> v2:172.21.15.63:3300/0 conn(0x7f6ae805f0d0 0x7f6ae8061640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ad8002f70 tx=0x7f6ad8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:07.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae659c700 1 --2- 172.21.15.63:0/1678197489 >> v2:172.21.15.63:3300/0 conn(0x7f6ae805f0d0 0x7f6ae8061640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ad8002f70 tx=0x7f6ad8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:07.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae659c700 1 --2- 172.21.15.63:0/1678197489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae805f0d0 0x7f6ae8061640 secure :-1 s=READY pgs=2251 cs=0 l=1 rx=0x7f6ad8002f70 tx=0x7f6ad8007a80).ready entity=mon.0 client_cookie=5c0a8577fd5861b2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:07.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae659c700 1 --2- 172.21.15.63:0/1678197489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae805f0d0 0x7f6ae8061640 secure :-1 s=THROTTLE_DONE pgs=2251 cs=0 l=1 rx=0x7f6ad8002f70 tx=0x7f6ad8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:07.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae5d9b700 1 -- 172.21.15.63:0/1678197489 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ad80116b0 con 0x7f6ae805f0d0 2020-05-18T21:39:07.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae659c700 1 --2- 172.21.15.63:0/1678197489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae805f0d0 0x7f6ae8061640 secure :-1 s=THROTTLE_DONE pgs=2251 cs=0 l=1 rx=0x7f6ad8002f70 tx=0x7f6ad8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:07.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae659c700 1 --2- 172.21.15.63:0/1678197489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae805f0d0 0x7f6ae8061640 secure :-1 s=THROTTLE_DONE pgs=2251 cs=0 l=1 rx=0x7f6ad8002f70 tx=0x7f6ad8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:07.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae5d9b700 1 -- 172.21.15.63:0/1678197489 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad8011810 con 0x7f6ae805f0d0 2020-05-18T21:39:07.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae5d9b700 1 -- 172.21.15.63:0/1678197489 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ad8011bf0 con 0x7f6ae805f0d0 2020-05-18T21:39:07.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae759e700 1 -- 172.21.15.63:0/1678197489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae805f0d0 msgr2=0x7f6ae8061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:07.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae759e700 1 --2- 172.21.15.63:0/1678197489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae805f0d0 0x7f6ae8061640 secure :-1 s=READY pgs=2251 cs=0 l=1 rx=0x7f6ad8002f70 tx=0x7f6ad8007a80).stop 2020-05-18T21:39:07.198 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae759e700 1 -- 172.21.15.63:0/1678197489 shutdown_connections 2020-05-18T21:39:07.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae759e700 1 --2- 172.21.15.63:0/1678197489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ae81448d0 0x7f6ae80ac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:07.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae759e700 1 --2- 172.21.15.63:0/1678197489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae805f0d0 0x7f6ae8061640 unknown :-1 s=CLOSED pgs=2251 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:07.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae759e700 1 -- 172.21.15.63:0/1678197489 >> 172.21.15.63:0/1678197489 conn(0x7f6ae8069fc0 msgr2=0x7f6ae806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:07.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae759e700 1 -- 172.21.15.63:0/1678197489 shutdown_connections 2020-05-18T21:39:07.199 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.184+0000 7f6ae759e700 1 -- 172.21.15.63:0/1678197489 wait complete. 2020-05-18T21:39:07.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae759e700 1 Processor -- start 2020-05-18T21:39:07.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae759e700 1 -- start start 2020-05-18T21:39:07.200 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ae805f0d0 0x7f6ae80afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:07.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6ae81448d0 0x7f6ae8061d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:07.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae8062190 con 0x7f6ae8144450 2020-05-18T21:39:07.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae759e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae81424c0 con 0x7f6ae81448d0 2020-05-18T21:39:07.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae8142760 con 0x7f6ae805f0d0 2020-05-18T21:39:07.201 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae6d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6ae81448d0 0x7f6ae8061d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:07.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae6d9d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6ae81448d0 0x7f6ae8061d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37414/0 (socket says 172.21.15.63:37414) 2020-05-18T21:39:07.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae6d9d700 1 -- 172.21.15.63:0/3874632208 learned_addr learned my addr 172.21.15.63:0/3874632208 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:07.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae659c700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ae805f0d0 0x7f6ae80afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:07.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae6d9d700 1 -- 172.21.15.63:0/3874632208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ae805f0d0 msgr2=0x7f6ae80afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:07.202 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6adf7fe700 1 -- 172.21.15.63:0/3874632208 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907338156 0 0) 0x7f6ae8062190 con 0x7f6ae8144450 2020-05-18T21:39:07.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae6d9d700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ae805f0d0 0x7f6ae80afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:07.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae6d9d700 1 -- 172.21.15.63:0/3874632208 >> v1:172.21.15.155:6789/0 conn(0x7f6ae8144450 legacy=0x7f6ae8128e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:07.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae6d9d700 1 -- 172.21.15.63:0/3874632208 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae80b2180 con 0x7f6ae81448d0 2020-05-18T21:39:07.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae6d9d700 1 --2- 172.21.15.63:0/3874632208 >> v2:172.21.15.63:3300/0 conn(0x7f6ae81448d0 0x7f6ae8061d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ae00032f0 tx=0x7f6ae0010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:07.203 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae6d9d700 1 --2- 172.21.15.63:0/3874632208 >> v2:172.21.15.63:3300/0 conn(0x7f6ae81448d0 0x7f6ae8061d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ae00032f0 tx=0x7f6ae0010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:07.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae6d9d700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae81448d0 0x7f6ae8061d30 secure :-1 s=READY pgs=2252 cs=0 l=1 rx=0x7f6ae00032f0 tx=0x7f6ae0010ff0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:07.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae6d9d700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae81448d0 0x7f6ae8061d30 secure :-1 s=THROTTLE_DONE pgs=2252 cs=0 l=1 rx=0x7f6ae00032f0 tx=0x7f6ae0010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:07.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6adf7fe700 1 -- 172.21.15.63:0/3874632208 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ae0005e70 con 0x7f6ae81448d0 2020-05-18T21:39:07.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae6d9d700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae81448d0 0x7f6ae8061d30 secure :-1 s=THROTTLE_DONE pgs=2252 cs=0 l=1 rx=0x7f6ae00032f0 tx=0x7f6ae0010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:07.204 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6adf7fe700 1 -- 172.21.15.63:0/3874632208 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae0007560 con 0x7f6ae81448d0 2020-05-18T21:39:07.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae6d9d700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae81448d0 0x7f6ae8061d30 secure :-1 s=THROTTLE_DONE pgs=2252 cs=0 l=1 rx=0x7f6ae00032f0 tx=0x7f6ae0010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:07.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6adf7fe700 1 -- 172.21.15.63:0/3874632208 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ae0007900 con 0x7f6ae81448d0 2020-05-18T21:39:07.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae759e700 1 -- 172.21.15.63:0/3874632208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae8061960 con 0x7f6ae81448d0 2020-05-18T21:39:07.205 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.188+0000 7f6ae759e700 1 -- 172.21.15.63:0/3874632208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae8129700 con 0x7f6ae81448d0 2020-05-18T21:39:07.206 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.192+0000 7f6ae6d9d700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae81448d0 0x7f6ae8061d30 secure :-1 s=THROTTLE_DONE pgs=2252 cs=0 l=1 rx=0x7f6ae00032f0 tx=0x7f6ae0010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:07.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.192+0000 7f6ae759e700 1 -- 172.21.15.63:0/3874632208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae80569e0 con 0x7f6ae81448d0 2020-05-18T21:39:07.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.192+0000 7f6adf7fe700 1 -- 172.21.15.63:0/3874632208 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f6ae00101a0 con 0x7f6ae81448d0 2020-05-18T21:39:07.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.192+0000 7f6ae6d9d700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae81448d0 0x7f6ae8061d30 secure :-1 s=THROTTLE_DONE pgs=2252 cs=0 l=1 rx=0x7f6ae00032f0 tx=0x7f6ae0010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:07.207 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.192+0000 7f6adf7fe700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6acc04f860 0x7f6acc051d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:07.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.192+0000 7f6adf7fe700 1 -- 172.21.15.63:0/3874632208 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6ae0063fc0 con 0x7f6ae81448d0 2020-05-18T21:39:07.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.192+0000 7f6ae659c700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6acc04f860 0x7f6acc051d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:07.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.196+0000 7f6ae659c700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6acc04f860 0x7f6acc051d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ad8002f70 tx=0x7f6ad8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:07.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.196+0000 7f6ae659c700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6acc04f860 0x7f6acc051d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ad8002f70 tx=0x7f6ad8007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:07.208 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.196+0000 7f6ae659c700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6acc04f860 0x7f6acc051d20 secure :-1 s=READY pgs=882 cs=0 l=1 rx=0x7f6ad8002f70 tx=0x7f6ad8007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:07.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.200+0000 7f6ae6d9d700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae81448d0 0x7f6ae8061d30 secure :-1 s=THROTTLE_DONE pgs=2252 cs=0 l=1 rx=0x7f6ae00032f0 tx=0x7f6ae0010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:07.209 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.200+0000 7f6adf7fe700 1 -- 172.21.15.63:0/3874632208 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f6ae003e350 con 0x7f6ae81448d0 2020-05-18T21:39:07.360 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.352+0000 7f6ae759e700 1 -- 172.21.15.63:0/3874632208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f6ae81428d0 con 0x7f6ae81448d0 2020-05-18T21:39:07.361 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.352+0000 7f6ae6d9d700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae81448d0 0x7f6ae8061d30 secure :-1 s=THROTTLE_DONE pgs=2252 cs=0 l=1 rx=0x7f6ae00032f0 tx=0x7f6ae0010ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:07.362 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.352+0000 7f6adf7fe700 1 -- 172.21.15.63:0/3874632208 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1938 (secure 0 0 0) 0x7f6ae0041970 con 0x7f6ae81448d0 2020-05-18T21:39:07.362 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:39:07.362 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:39:07.363 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:39:07.363 INFO:teuthology.orchestra.run.smithi063.stdout: "total_bytes": 773094113280, 2020-05-18T21:39:07.363 INFO:teuthology.orchestra.run.smithi063.stdout: "total_avail_bytes": 764486713344, 2020-05-18T21:39:07.363 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_bytes": 17465344, 2020-05-18T21:39:07.363 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_bytes": 8607399936, 2020-05-18T21:39:07.364 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_ratio": 0.011133702471852303, 2020-05-18T21:39:07.364 INFO:teuthology.orchestra.run.smithi063.stdout: "num_osds": 8, 2020-05-18T21:39:07.364 INFO:teuthology.orchestra.run.smithi063.stdout: "num_per_pool_osds": 8, 2020-05-18T21:39:07.364 INFO:teuthology.orchestra.run.smithi063.stdout: "num_per_pool_omap_osds": 8 2020-05-18T21:39:07.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:39:07.365 INFO:teuthology.orchestra.run.smithi063.stdout: "stats_by_class": { 2020-05-18T21:39:07.365 INFO:teuthology.orchestra.run.smithi063.stdout: "ssd": { 2020-05-18T21:39:07.365 INFO:teuthology.orchestra.run.smithi063.stdout: "total_bytes": 773094113280, 2020-05-18T21:39:07.365 INFO:teuthology.orchestra.run.smithi063.stdout: "total_avail_bytes": 764486713344, 2020-05-18T21:39:07.365 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_bytes": 17465344, 2020-05-18T21:39:07.365 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_bytes": 8607399936, 2020-05-18T21:39:07.366 INFO:teuthology.orchestra.run.smithi063.stdout: "total_used_raw_ratio": 0.011133702471852303 2020-05-18T21:39:07.366 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:39:07.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:39:07.366 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2020-05-18T21:39:07.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:39:07.367 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_health_metrics", 2020-05-18T21:39:07.367 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 1, 2020-05-18T21:39:07.367 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:39:07.367 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 0, 2020-05-18T21:39:07.367 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 2, 2020-05-18T21:39:07.368 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 0, 2020-05-18T21:39:07.368 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 0, 2020-05-18T21:39:07.368 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 0, 2020-05-18T21:39:07.368 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362915725312 2020-05-18T21:39:07.368 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:39:07.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:39:07.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:39:07.369 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd", 2020-05-18T21:39:07.369 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 2, 2020-05-18T21:39:07.369 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:39:07.370 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 0, 2020-05-18T21:39:07.370 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 0, 2020-05-18T21:39:07.370 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 0, 2020-05-18T21:39:07.370 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 0, 2020-05-18T21:39:07.370 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 0, 2020-05-18T21:39:07.371 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362915725312 2020-05-18T21:39:07.371 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:39:07.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:39:07.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:39:07.372 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephfs_metadata", 2020-05-18T21:39:07.372 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 31, 2020-05-18T21:39:07.372 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:39:07.372 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 65631, 2020-05-18T21:39:07.373 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 24, 2020-05-18T21:39:07.373 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 192, 2020-05-18T21:39:07.373 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 196608, 2020-05-18T21:39:07.373 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 2.708727322442428e-07, 2020-05-18T21:39:07.373 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362915725312 2020-05-18T21:39:07.374 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:39:07.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2020-05-18T21:39:07.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2020-05-18T21:39:07.374 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephfs_data", 2020-05-18T21:39:07.374 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 32, 2020-05-18T21:39:07.374 INFO:teuthology.orchestra.run.smithi063.stdout: "stats": { 2020-05-18T21:39:07.375 INFO:teuthology.orchestra.run.smithi063.stdout: "stored": 0, 2020-05-18T21:39:07.375 INFO:teuthology.orchestra.run.smithi063.stdout: "objects": 0, 2020-05-18T21:39:07.375 INFO:teuthology.orchestra.run.smithi063.stdout: "kb_used": 0, 2020-05-18T21:39:07.375 INFO:teuthology.orchestra.run.smithi063.stdout: "bytes_used": 0, 2020-05-18T21:39:07.375 INFO:teuthology.orchestra.run.smithi063.stdout: "percent_used": 0, 2020-05-18T21:39:07.376 INFO:teuthology.orchestra.run.smithi063.stdout: "max_avail": 362915725312 2020-05-18T21:39:07.376 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:39:07.376 INFO:teuthology.orchestra.run.smithi063.stdout: } 2020-05-18T21:39:07.376 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2020-05-18T21:39:07.376 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:39:07.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.356+0000 7f6ae759e700 1 -- 172.21.15.63:0/3874632208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6acc04f860 msgr2=0x7f6acc051d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:07.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.356+0000 7f6ae759e700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6acc04f860 0x7f6acc051d20 secure :-1 s=READY pgs=882 cs=0 l=1 rx=0x7f6ad8002f70 tx=0x7f6ad8007a80).stop 2020-05-18T21:39:07.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.356+0000 7f6ae759e700 1 -- 172.21.15.63:0/3874632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae81448d0 msgr2=0x7f6ae8061d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:07.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.356+0000 7f6ae759e700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae81448d0 0x7f6ae8061d30 secure :-1 s=READY pgs=2252 cs=0 l=1 rx=0x7f6ae00032f0 tx=0x7f6ae0010ff0).stop 2020-05-18T21:39:07.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.356+0000 7f6ae759e700 1 -- 172.21.15.63:0/3874632208 shutdown_connections 2020-05-18T21:39:07.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.356+0000 7f6ae759e700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f6acc04f860 0x7f6acc051d20 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:07.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.356+0000 7f6ae759e700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae81448d0 0x7f6ae8061d30 unknown :-1 s=CLOSED pgs=2252 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:07.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.356+0000 7f6ae759e700 1 --2- 172.21.15.63:0/3874632208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ae805f0d0 0x7f6ae80afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:07.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.356+0000 7f6ae759e700 1 -- 172.21.15.63:0/3874632208 >> 172.21.15.63:0/3874632208 conn(0x7f6ae8069fc0 msgr2=0x7f6ae80b6120 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:07.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.356+0000 7f6ae759e700 1 -- 172.21.15.63:0/3874632208 shutdown_connections 2020-05-18T21:39:07.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:07.356+0000 7f6ae759e700 1 -- 172.21.15.63:0/3874632208 wait complete. 2020-05-18T21:39:07.380 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s 2020-05-18T21:39:07.381 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-05-18T21:39:07.381 INFO:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:39:07.396 INFO:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-05-18T21:39:07.417 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-05-18T21:39:07.418 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2020-05-18T21:39:07.421 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-05-18T21:39:07.421 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:39:07.456 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[41764]: fuse finished with error 0 and tester_r 0 2020-05-18T21:39:07.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:07.460 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:39:07.469 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-05-18T21:39:07.469 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:39:07.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:07.470 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set brx.0 down' 2020-05-18T21:39:07.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:07.487 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete brx.0' 2020-05-18T21:39:07.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:07.616 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-05-18T21:39:07.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:07.636 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:39:07.641 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:39:07.642 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:39:07.642 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:39:07.642 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:39:07.642 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:39:07.643 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:39:07.643 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:39:07.643 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:07.643 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:39:07.643 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:07.644 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:39:07.644 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:07.644 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:39:07.644 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:07.644 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:39:07.645 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42095sec preferred_lft 42095sec 2020-05-18T21:39:07.645 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:39:07.645 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:39:07.645 INFO:teuthology.orchestra.run.smithi063.stdout:43: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-05-18T21:39:07.645 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:07.646 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2020-05-18T21:39:07.646 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:39:07.646 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::b071:1ff:fee7:c015/64 scope link 2020-05-18T21:39:07.646 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:39:07.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:07.647 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link show' 2020-05-18T21:39:07.701 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 2020-05-18T21:39:07.701 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:39:07.701 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:39:07.701 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:07.702 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:39:07.702 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:07.702 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:39:07.702 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:07.702 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 2020-05-18T21:39:07.703 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:07.703 INFO:teuthology.orchestra.run.smithi063.stdout:43: ceph-brx: mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000 2020-05-18T21:39:07.703 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:07.704 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-05-18T21:39:07.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:07.705 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link set ceph-brx down' 2020-05-18T21:39:07.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:07.727 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'ip link delete ceph-brx' 2020-05-18T21:39:07.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:07.880 INFO:teuthology.orchestra.run.smithi063:> route 2020-05-18T21:39:07.891 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2020-05-18T21:39:07.891 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-05-18T21:39:07.891 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-05-18T21:39:07.891 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-05-18T21:39:07.892 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-05-18T21:39:07.892 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2020-05-18T21:39:07.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:07.893 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-05-18T21:39:07.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:07.912 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-05-18T21:39:07.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:07.970 INFO:teuthology.orchestra.run.smithi063:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-05-18T21:39:07.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:07.987 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-05-18T21:39:07.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:07.997 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:39:08.003 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-05-18T21:39:08.004 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:39:08.004 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-05-18T21:39:08.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:08.005 INFO:teuthology.orchestra.run.smithi063:> ip addr 2020-05-18T21:39:08.051 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:39:08.052 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:39:08.052 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:39:08.052 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:39:08.052 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2020-05-18T21:39:08.053 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:39:08.053 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:39:08.053 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:08.053 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:39:08.054 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:08.054 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:39:08.054 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:08.054 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:39:08.054 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:08.055 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:39:08.055 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42095sec preferred_lft 42095sec 2020-05-18T21:39:08.055 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2020-05-18T21:39:08.055 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:39:08.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:08.056 INFO:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-05-18T21:39:08.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:08.064 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:39:08.071 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2020-05-18T21:39:08.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:39:08.073 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-05-18T21:39:08.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:08.074 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:39:08.122 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:39:08.122 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:39:08.122 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:39:08.122 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:39:08.123 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:39:08.123 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:39:08.123 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:39:08.123 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:08.123 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:39:08.123 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:08.124 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:39:08.124 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:08.124 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:39:08.124 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:08.124 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:39:08.125 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42099sec preferred_lft 42099sec 2020-05-18T21:39:08.125 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:39:08.125 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:39:08.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:08.126 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-05-18T21:39:08.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:08.133 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:39:08.139 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2020-05-18T21:39:08.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-05-18T21:39:08.141 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-05-18T21:39:08.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:08.142 INFO:teuthology.orchestra.run.smithi155:> ip addr 2020-05-18T21:39:08.149 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-05-18T21:39:08.149 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-05-18T21:39:08.149 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2020-05-18T21:39:08.150 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:39:08.150 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2020-05-18T21:39:08.150 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:39:08.150 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:39:08.150 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:08.150 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:39:08.151 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:08.151 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-05-18T21:39:08.151 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:08.151 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-05-18T21:39:08.151 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2020-05-18T21:39:08.152 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2020-05-18T21:39:08.152 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42099sec preferred_lft 42099sec 2020-05-18T21:39:08.153 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2020-05-18T21:39:08.154 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2020-05-18T21:39:08.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-05-18T21:39:08.154 INFO:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-05-18T21:39:08.198 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_strays.TestStrays.test_snapshot_remove' 2020-05-18T21:39:08.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb548ea4700 1 Processor -- start 2020-05-18T21:39:08.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb548ea4700 1 -- start start 2020-05-18T21:39:08.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb548ea4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb544060b90 0x7fb544147e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:08.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb548ea4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb544143da0 0x7fb5441299d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:08.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb548ea4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb544144240 con 0x7fb544129e30 2020-05-18T21:39:08.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb548ea4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5441444e0 con 0x7fb544143da0 2020-05-18T21:39:08.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb548ea4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb544144780 con 0x7fb544060b90 2020-05-18T21:39:08.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb539d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb544143da0 0x7fb5441299d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:08.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb539d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb544143da0 0x7fb5441299d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37418/0 (socket says 172.21.15.63:37418) 2020-05-18T21:39:08.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb539d9b700 1 -- 172.21.15.63:0/2834409340 learned_addr learned my addr 172.21.15.63:0/2834409340 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:08.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb54259c700 1 --2- 172.21.15.63:0/2834409340 >> v2:172.21.15.155:3300/0 conn(0x7fb544060b90 0x7fb544147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:08.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb539d9b700 1 -- 172.21.15.63:0/2834409340 >> v2:172.21.15.155:3300/0 conn(0x7fb544060b90 msgr2=0x7fb544147e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:08.312 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb539d9b700 1 --2- 172.21.15.63:0/2834409340 >> v2:172.21.15.155:3300/0 conn(0x7fb544060b90 0x7fb544147e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:08.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb539d9b700 1 -- 172.21.15.63:0/2834409340 >> v1:172.21.15.155:6789/0 conn(0x7fb544129e30 legacy=0x7fb5440b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:08.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb539d9b700 1 -- 172.21.15.63:0/2834409340 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb544144c20 con 0x7fb544143da0 2020-05-18T21:39:08.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb54259c700 1 --2- 172.21.15.63:0/2834409340 >> v2:172.21.15.155:3300/0 conn(0x7fb544060b90 0x7fb544147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:39:08.313 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb539d9b700 1 --2- 172.21.15.63:0/2834409340 >> v2:172.21.15.63:3300/0 conn(0x7fb544143da0 0x7fb5441299d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb52c002f70 tx=0x7fb52c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:08.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb539d9b700 1 --2- 172.21.15.63:0/2834409340 >> v2:172.21.15.63:3300/0 conn(0x7fb544143da0 0x7fb5441299d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb52c002f70 tx=0x7fb52c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:08.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb539d9b700 1 --2- 172.21.15.63:0/2834409340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb544143da0 0x7fb5441299d0 secure :-1 s=READY pgs=2253 cs=0 l=1 rx=0x7fb52c002f70 tx=0x7fb52c007a80).ready entity=mon.0 client_cookie=c4af4fda908d3ee6 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:08.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.300+0000 7fb539d9b700 1 --2- 172.21.15.63:0/2834409340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb544143da0 0x7fb5441299d0 secure :-1 s=THROTTLE_DONE pgs=2253 cs=0 l=1 rx=0x7fb52c002f70 tx=0x7fb52c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:08.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.304+0000 7fb539d9b700 1 --2- 172.21.15.63:0/2834409340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb544143da0 0x7fb5441299d0 secure :-1 s=THROTTLE_DONE pgs=2253 cs=0 l=1 rx=0x7fb52c002f70 tx=0x7fb52c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:08.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.304+0000 7fb541d9b700 1 -- 172.21.15.63:0/2834409340 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb52c011760 con 0x7fb544143da0 2020-05-18T21:39:08.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.304+0000 7fb539d9b700 1 --2- 172.21.15.63:0/2834409340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb544143da0 0x7fb5441299d0 secure :-1 s=THROTTLE_DONE pgs=2253 cs=0 l=1 rx=0x7fb52c002f70 tx=0x7fb52c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:08.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.304+0000 7fb541d9b700 1 -- 172.21.15.63:0/2834409340 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c0118c0 con 0x7fb544143da0 2020-05-18T21:39:08.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.304+0000 7fb541d9b700 1 -- 172.21.15.63:0/2834409340 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb52c011ce0 con 0x7fb544143da0 2020-05-18T21:39:08.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.304+0000 7fb548ea4700 1 -- 172.21.15.63:0/2834409340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb544143da0 msgr2=0x7fb5441299d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:08.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.304+0000 7fb548ea4700 1 --2- 172.21.15.63:0/2834409340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb544143da0 0x7fb5441299d0 secure :-1 s=READY pgs=2253 cs=0 l=1 rx=0x7fb52c002f70 tx=0x7fb52c007a80).stop 2020-05-18T21:39:08.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.304+0000 7fb548ea4700 1 -- 172.21.15.63:0/2834409340 shutdown_connections 2020-05-18T21:39:08.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.304+0000 7fb548ea4700 1 --2- 172.21.15.63:0/2834409340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb544143da0 0x7fb5441299d0 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:08.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.304+0000 7fb548ea4700 1 --2- 172.21.15.63:0/2834409340 >> v2:172.21.15.155:3300/0 conn(0x7fb544060b90 0x7fb544147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:08.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.304+0000 7fb548ea4700 1 -- 172.21.15.63:0/2834409340 >> 172.21.15.63:0/2834409340 conn(0x7fb5440b83d0 msgr2=0x7fb5440b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:08.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.304+0000 7fb548ea4700 1 -- 172.21.15.63:0/2834409340 shutdown_connections 2020-05-18T21:39:08.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.304+0000 7fb548ea4700 1 -- 172.21.15.63:0/2834409340 wait complete. 2020-05-18T21:39:08.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.304+0000 7fb548ea4700 1 Processor -- start 2020-05-18T21:39:08.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.304+0000 7fb548ea4700 1 -- start start 2020-05-18T21:39:08.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb548ea4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb544129e30 0x7fb5441516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:08.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb548ea4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb544143da0 0x7fb54412c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:08.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb548ea4700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54412c9e0 con 0x7fb544060b90 2020-05-18T21:39:08.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb548ea4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb544127490 con 0x7fb544129e30 2020-05-18T21:39:08.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb548ea4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb544127730 con 0x7fb544143da0 2020-05-18T21:39:08.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb539d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb544129e30 0x7fb5441516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:08.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb54259c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb544060b90 0x7fb54412cd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39612/0 (socket says 172.21.15.63:39612) 2020-05-18T21:39:08.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb54259c700 1 -- 172.21.15.63:0/2730853900 learned_addr learned my addr 172.21.15.63:0/2730853900 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:08.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb542d9d700 1 --2- 172.21.15.63:0/2730853900 >> v2:172.21.15.155:3300/0 conn(0x7fb544143da0 0x7fb54412c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:08.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb53bfff700 1 -- 172.21.15.63:0/2730853900 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2295868584 0 0) 0x7fb54412c9e0 con 0x7fb544060b90 2020-05-18T21:39:08.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb539d9b700 1 -- 172.21.15.63:0/2730853900 >> v2:172.21.15.155:3300/0 conn(0x7fb544143da0 msgr2=0x7fb54412c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:08.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb539d9b700 1 --2- 172.21.15.63:0/2730853900 >> v2:172.21.15.155:3300/0 conn(0x7fb544143da0 0x7fb54412c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:08.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb539d9b700 1 -- 172.21.15.63:0/2730853900 >> v1:172.21.15.63:6789/0 conn(0x7fb544060b90 legacy=0x7fb54412cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:08.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb539d9b700 1 -- 172.21.15.63:0/2730853900 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5441279d0 con 0x7fb544129e30 2020-05-18T21:39:08.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb542d9d700 1 --2- 172.21.15.63:0/2730853900 >> v2:172.21.15.155:3300/0 conn(0x7fb544143da0 0x7fb54412c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:39:08.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb539d9b700 1 --2- 172.21.15.63:0/2730853900 >> v2:172.21.15.63:3300/0 conn(0x7fb544129e30 0x7fb5441516d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb52c002f70 tx=0x7fb52c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:08.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb539d9b700 1 --2- 172.21.15.63:0/2730853900 >> v2:172.21.15.63:3300/0 conn(0x7fb544129e30 0x7fb5441516d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb52c002f70 tx=0x7fb52c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:08.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb539d9b700 1 --2- 172.21.15.63:0/2730853900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb544129e30 0x7fb5441516d0 secure :-1 s=READY pgs=2255 cs=0 l=1 rx=0x7fb52c002f70 tx=0x7fb52c007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:08.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb539d9b700 1 --2- 172.21.15.63:0/2730853900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb544129e30 0x7fb5441516d0 secure :-1 s=THROTTLE_DONE pgs=2255 cs=0 l=1 rx=0x7fb52c002f70 tx=0x7fb52c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:08.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb53bfff700 1 -- 172.21.15.63:0/2730853900 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb52c007360 con 0x7fb544129e30 2020-05-18T21:39:08.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb548ea4700 1 -- 172.21.15.63:0/2730853900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54412ac60 con 0x7fb544129e30 2020-05-18T21:39:08.325 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb539d9b700 1 --2- 172.21.15.63:0/2730853900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb544129e30 0x7fb5441516d0 secure :-1 s=THROTTLE_DONE pgs=2255 cs=0 l=1 rx=0x7fb52c002f70 tx=0x7fb52c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:08.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb53bfff700 1 -- 172.21.15.63:0/2730853900 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c0074c0 con 0x7fb544129e30 2020-05-18T21:39:08.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb539d9b700 1 --2- 172.21.15.63:0/2730853900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb544129e30 0x7fb5441516d0 secure :-1 s=THROTTLE_DONE pgs=2255 cs=0 l=1 rx=0x7fb52c002f70 tx=0x7fb52c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:08.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb53bfff700 1 -- 172.21.15.63:0/2730853900 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb52c007630 con 0x7fb544129e30 2020-05-18T21:39:08.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb548ea4700 1 -- 172.21.15.63:0/2730853900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb544143190 con 0x7fb544129e30 2020-05-18T21:39:08.326 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.308+0000 7fb539d9b700 1 --2- 172.21.15.63:0/2730853900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb544129e30 0x7fb5441516d0 secure :-1 s=THROTTLE_DONE pgs=2255 cs=0 l=1 rx=0x7fb52c002f70 tx=0x7fb52c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:08.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.312+0000 7fb548ea4700 1 -- 172.21.15.63:0/2730853900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5441437e0 con 0x7fb544129e30 2020-05-18T21:39:08.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.312+0000 7fb53bfff700 1 -- 172.21.15.63:0/2730853900 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fb52c0058f0 con 0x7fb544129e30 2020-05-18T21:39:08.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.312+0000 7fb539d9b700 1 --2- 172.21.15.63:0/2730853900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb544129e30 0x7fb5441516d0 secure :-1 s=THROTTLE_DONE pgs=2255 cs=0 l=1 rx=0x7fb52c002f70 tx=0x7fb52c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:08.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.312+0000 7fb53bfff700 1 --2- 172.21.15.63:0/2730853900 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb51c04f8e0 0x7fb51c051da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:08.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.312+0000 7fb53bfff700 1 -- 172.21.15.63:0/2730853900 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb52c0645d0 con 0x7fb544129e30 2020-05-18T21:39:08.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.312+0000 7fb54259c700 1 --2- 172.21.15.63:0/2730853900 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb51c04f8e0 0x7fb51c051da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:08.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.312+0000 7fb54259c700 1 --2- 172.21.15.63:0/2730853900 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb51c04f8e0 0x7fb51c051da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb534007a80 tx=0x7fb534008040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:08.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.312+0000 7fb54259c700 1 --2- 172.21.15.63:0/2730853900 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb51c04f8e0 0x7fb51c051da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb534007a80 tx=0x7fb534008040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:08.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.312+0000 7fb54259c700 1 --2- 172.21.15.63:0/2730853900 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb51c04f8e0 0x7fb51c051da0 secure :-1 s=READY pgs=883 cs=0 l=1 rx=0x7fb534007a80 tx=0x7fb534008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:08.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.316+0000 7fb539d9b700 1 --2- 172.21.15.63:0/2730853900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb544129e30 0x7fb5441516d0 secure :-1 s=THROTTLE_DONE pgs=2255 cs=0 l=1 rx=0x7fb52c002f70 tx=0x7fb52c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:08.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.316+0000 7fb53bfff700 1 -- 172.21.15.63:0/2730853900 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7fb52c03e960 con 0x7fb544129e30 2020-05-18T21:39:08.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:08.468+0000 7fb548ea4700 1 -- 172.21.15.63:0/2730853900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_snapshot_remove"]} v 0) v1 -- 0x7fb544127b60 con 0x7fb544129e30 2020-05-18T21:39:09.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.308+0000 7fb539d9b700 1 --2- 172.21.15.63:0/2730853900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb544129e30 0x7fb5441516d0 secure :-1 s=READY pgs=2255 cs=0 l=1 rx=0x7fb52c002f70 tx=0x7fb52c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.340+0000 7fb539d9b700 1 --2- 172.21.15.63:0/2730853900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb544129e30 0x7fb5441516d0 secure :-1 s=THROTTLE_DONE pgs=2255 cs=0 l=1 rx=0x7fb52c002f70 tx=0x7fb52c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.340+0000 7fb53bfff700 1 -- 172.21.15.63:0/2730853900 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_snapshot_remove"]}]=0 v600) v1 ==== 135+0+0 (secure 0 0 0) 0x7fb52c041f80 con 0x7fb544129e30 2020-05-18T21:39:09.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.344+0000 7fb548ea4700 1 -- 172.21.15.63:0/2730853900 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb51c04f8e0 msgr2=0x7fb51c051da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:09.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.344+0000 7fb548ea4700 1 --2- 172.21.15.63:0/2730853900 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb51c04f8e0 0x7fb51c051da0 secure :-1 s=READY pgs=883 cs=0 l=1 rx=0x7fb534007a80 tx=0x7fb534008040).stop 2020-05-18T21:39:09.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.344+0000 7fb548ea4700 1 -- 172.21.15.63:0/2730853900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb544129e30 msgr2=0x7fb5441516d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:09.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.344+0000 7fb548ea4700 1 --2- 172.21.15.63:0/2730853900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb544129e30 0x7fb5441516d0 secure :-1 s=READY pgs=2255 cs=0 l=1 rx=0x7fb52c002f70 tx=0x7fb52c007a80).stop 2020-05-18T21:39:09.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.344+0000 7fb548ea4700 1 -- 172.21.15.63:0/2730853900 shutdown_connections 2020-05-18T21:39:09.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.344+0000 7fb548ea4700 1 --2- 172.21.15.63:0/2730853900 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fb51c04f8e0 0x7fb51c051da0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:09.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.344+0000 7fb548ea4700 1 --2- 172.21.15.63:0/2730853900 >> v2:172.21.15.155:3300/0 conn(0x7fb544143da0 0x7fb54412c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:09.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.344+0000 7fb548ea4700 1 --2- 172.21.15.63:0/2730853900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb544129e30 0x7fb5441516d0 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:09.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.344+0000 7fb548ea4700 1 -- 172.21.15.63:0/2730853900 >> 172.21.15.63:0/2730853900 conn(0x7fb5440b83d0 msgr2=0x7fb5440655c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:09.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.344+0000 7fb548ea4700 1 -- 172.21.15.63:0/2730853900 shutdown_connections 2020-05-18T21:39:09.352 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.344+0000 7fb548ea4700 1 -- 172.21.15.63:0/2730853900 wait complete. 2020-05-18T21:39:09.367 INFO:tasks.cephfs_test_runner:test_snapshot_remove (tasks.cephfs.test_strays.TestStrays) ... ok 2020-05-18T21:39:09.368 INFO:tasks.cephfs_test_runner: 2020-05-18T21:39:09.368 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2020-05-18T21:39:09.368 INFO:tasks.cephfs_test_runner:Ran 14 tests in 710.687s 2020-05-18T21:39:09.369 INFO:tasks.cephfs_test_runner: 2020-05-18T21:39:09.369 INFO:tasks.cephfs_test_runner:OK 2020-05-18T21:39:09.369 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2020-05-18T21:39:09.382 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2020-05-18T21:39:09.397 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2020-05-18T21:39:09.398 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2020-05-18T21:39:09.411 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2020-05-18T21:39:09.412 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:39:09.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.512+0000 7f7b7a363700 1 Processor -- start 2020-05-18T21:39:09.520 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.512+0000 7f7b7a363700 1 -- start start 2020-05-18T21:39:09.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.512+0000 7f7b7a363700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 0x7f7b74065130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:09.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.512+0000 7f7b7a363700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7b74142bf0 0x7f7b740ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:09.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.512+0000 7f7b7a363700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b74143090 con 0x7f7b740ac930 2020-05-18T21:39:09.523 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.512+0000 7f7b7a363700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b740b6b10 con 0x7f7b74142bf0 2020-05-18T21:39:09.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.512+0000 7f7b7a363700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b74143330 con 0x7f7b74061d80 2020-05-18T21:39:09.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b78b60700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7b74142bf0 0x7f7b740ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:09.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b78b60700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7b74142bf0 0x7f7b740ac4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37432/0 (socket says 172.21.15.63:37432) 2020-05-18T21:39:09.524 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b78b60700 1 -- 172.21.15.63:0/1834046259 learned_addr learned my addr 172.21.15.63:0/1834046259 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:09.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b79361700 1 --2- 172.21.15.63:0/1834046259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 0x7f7b74065130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:09.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b78b60700 1 -- 172.21.15.63:0/1834046259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 msgr2=0x7f7b74065130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:09.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b78b60700 1 --2- 172.21.15.63:0/1834046259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 0x7f7b74065130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:09.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b78b60700 1 -- 172.21.15.63:0/1834046259 >> v1:172.21.15.155:6789/0 conn(0x7f7b740ac930 legacy=0x7f7b740acdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:09.525 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b78b60700 1 -- 172.21.15.63:0/1834046259 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b741435d0 con 0x7f7b74142bf0 2020-05-18T21:39:09.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b78b60700 1 --2- 172.21.15.63:0/1834046259 >> v2:172.21.15.63:3300/0 conn(0x7f7b74142bf0 0x7f7b740ac4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7b680032f0 tx=0x7f7b68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b78b60700 1 --2- 172.21.15.63:0/1834046259 >> v2:172.21.15.63:3300/0 conn(0x7f7b74142bf0 0x7f7b740ac4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7b680032f0 tx=0x7f7b68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b78b60700 1 --2- 172.21.15.63:0/1834046259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b74142bf0 0x7f7b740ac4d0 secure :-1 s=READY pgs=2256 cs=0 l=1 rx=0x7f7b680032f0 tx=0x7f7b68007e00).ready entity=mon.0 client_cookie=59498c86f22d1635 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:09.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b78b60700 1 --2- 172.21.15.63:0/1834046259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b74142bf0 0x7f7b740ac4d0 secure :-1 s=THROTTLE_DONE pgs=2256 cs=0 l=1 rx=0x7f7b680032f0 tx=0x7f7b68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.526 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b78b60700 1 --2- 172.21.15.63:0/1834046259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b74142bf0 0x7f7b740ac4d0 secure :-1 s=THROTTLE_DONE pgs=2256 cs=0 l=1 rx=0x7f7b680032f0 tx=0x7f7b68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b73fff700 1 -- 172.21.15.63:0/1834046259 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b68011d10 con 0x7f7b74142bf0 2020-05-18T21:39:09.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b78b60700 1 --2- 172.21.15.63:0/1834046259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b74142bf0 0x7f7b740ac4d0 secure :-1 s=THROTTLE_DONE pgs=2256 cs=0 l=1 rx=0x7f7b680032f0 tx=0x7f7b68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b73fff700 1 -- 172.21.15.63:0/1834046259 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b68011e70 con 0x7f7b74142bf0 2020-05-18T21:39:09.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b73fff700 1 -- 172.21.15.63:0/1834046259 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b6800a370 con 0x7f7b74142bf0 2020-05-18T21:39:09.527 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b7a363700 1 -- 172.21.15.63:0/1834046259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b74142bf0 msgr2=0x7f7b740ac4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:09.528 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b7a363700 1 --2- 172.21.15.63:0/1834046259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b74142bf0 0x7f7b740ac4d0 secure :-1 s=READY pgs=2256 cs=0 l=1 rx=0x7f7b680032f0 tx=0x7f7b68007e00).stop 2020-05-18T21:39:09.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b7a363700 1 -- 172.21.15.63:0/1834046259 shutdown_connections 2020-05-18T21:39:09.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b7a363700 1 --2- 172.21.15.63:0/1834046259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b74142bf0 0x7f7b740ac4d0 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:09.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b7a363700 1 --2- 172.21.15.63:0/1834046259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 0x7f7b74065130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:09.531 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b7a363700 1 -- 172.21.15.63:0/1834046259 >> 172.21.15.63:0/1834046259 conn(0x7f7b74066d00 msgr2=0x7f7b7405a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:09.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b7a363700 1 -- 172.21.15.63:0/1834046259 shutdown_connections 2020-05-18T21:39:09.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.516+0000 7f7b7a363700 1 -- 172.21.15.63:0/1834046259 wait complete. 2020-05-18T21:39:09.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.520+0000 7f7b7a363700 1 Processor -- start 2020-05-18T21:39:09.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.520+0000 7f7b7a363700 1 -- start start 2020-05-18T21:39:09.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.520+0000 7f7b7a363700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 0x7f7b74150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:09.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.520+0000 7f7b7a363700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7b740ac930 0x7f7b7413c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:09.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.520+0000 7f7b7a363700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b74150890 con 0x7f7b74142bf0 2020-05-18T21:39:09.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.520+0000 7f7b7a363700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b74151300 con 0x7f7b740ac930 2020-05-18T21:39:09.533 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.520+0000 7f7b7a363700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b74150b30 con 0x7f7b74061d80 2020-05-18T21:39:09.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.520+0000 7f7b78b60700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7b740ac930 0x7f7b7413c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:09.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.520+0000 7f7b78b60700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7b740ac930 0x7f7b7413c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37440/0 (socket says 172.21.15.63:37440) 2020-05-18T21:39:09.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.520+0000 7f7b78b60700 1 -- 172.21.15.63:0/398303237 learned_addr learned my addr 172.21.15.63:0/398303237 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:09.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.520+0000 7f7b79361700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 0x7f7b74150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:09.534 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b727fc700 1 -- 172.21.15.63:0/398303237 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404530467 0 0) 0x7f7b74150890 con 0x7f7b74142bf0 2020-05-18T21:39:09.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b79361700 1 -- 172.21.15.63:0/398303237 >> v2:172.21.15.63:3300/0 conn(0x7f7b740ac930 msgr2=0x7f7b7413c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:09.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b79361700 1 --2- 172.21.15.63:0/398303237 >> v2:172.21.15.63:3300/0 conn(0x7f7b740ac930 0x7f7b7413c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:09.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b79361700 1 -- 172.21.15.63:0/398303237 >> v1:172.21.15.155:6789/0 conn(0x7f7b74142bf0 legacy=0x7f7b74153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:09.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b79361700 1 -- 172.21.15.63:0/398303237 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b74150dd0 con 0x7f7b74061d80 2020-05-18T21:39:09.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b79361700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 0x7f7b74150380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b64002f70 tx=0x7f7b64010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b79361700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 0x7f7b74150380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b64002f70 tx=0x7f7b64010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b79361700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 0x7f7b74150380 secure :-1 s=READY pgs=347 cs=0 l=1 rx=0x7f7b64002f70 tx=0x7f7b64010bd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:09.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b79361700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 0x7f7b74150380 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7f7b64002f70 tx=0x7f7b64010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b727fc700 1 -- 172.21.15.63:0/398303237 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b64007550 con 0x7f7b74061d80 2020-05-18T21:39:09.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b79361700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 0x7f7b74150380 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7f7b64002f70 tx=0x7f7b64010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b79361700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 0x7f7b74150380 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7f7b64002f70 tx=0x7f7b64010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b727fc700 1 -- 172.21.15.63:0/398303237 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b64005700 con 0x7f7b74061d80 2020-05-18T21:39:09.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b7a363700 1 -- 172.21.15.63:0/398303237 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b741417f0 con 0x7f7b74061d80 2020-05-18T21:39:09.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b727fc700 1 -- 172.21.15.63:0/398303237 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b64005a60 con 0x7f7b74061d80 2020-05-18T21:39:09.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b7a363700 1 -- 172.21.15.63:0/398303237 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7413d040 con 0x7f7b74061d80 2020-05-18T21:39:09.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b79361700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 0x7f7b74150380 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7f7b64002f70 tx=0x7f7b64010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b7a363700 1 -- 172.21.15.63:0/398303237 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b740569e0 con 0x7f7b74061d80 2020-05-18T21:39:09.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b79361700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 0x7f7b74150380 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7f7b64002f70 tx=0x7f7b64010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.524+0000 7f7b727fc700 1 -- 172.21.15.63:0/398303237 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f7b64005c60 con 0x7f7b74061d80 2020-05-18T21:39:09.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.528+0000 7f7b727fc700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b5404f8d0 0x7f7b54051d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:09.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.528+0000 7f7b727fc700 1 -- 172.21.15.63:0/398303237 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7b64063f40 con 0x7f7b74061d80 2020-05-18T21:39:09.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.528+0000 7f7b78b60700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b5404f8d0 0x7f7b54051d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:09.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.528+0000 7f7b78b60700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b5404f8d0 0x7f7b54051d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b680032f0 tx=0x7f7b68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.528+0000 7f7b78b60700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b5404f8d0 0x7f7b54051d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b680032f0 tx=0x7f7b68007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.541 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.528+0000 7f7b78b60700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b5404f8d0 0x7f7b54051d90 secure :-1 s=READY pgs=884 cs=0 l=1 rx=0x7f7b680032f0 tx=0x7f7b68007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:09.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.536+0000 7f7b79361700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 0x7f7b74150380 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7f7b64002f70 tx=0x7f7b64010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.543 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.536+0000 7f7b727fc700 1 -- 172.21.15.63:0/398303237 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f7b6403e230 con 0x7f7b74061d80 2020-05-18T21:39:09.664 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.656+0000 7f7b7a363700 1 -- 172.21.15.63:0/398303237 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b74154770 con 0x7f7b74061d80 2020-05-18T21:39:09.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.664+0000 7f7b79361700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 0x7f7b74150380 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7f7b64002f70 tx=0x7f7b64010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.666 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.664+0000 7f7b727fc700 1 -- 172.21.15.63:0/398303237 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) v1 ==== 74+0+16170 (secure 0 0 0) 0x7f7b64041850 con 0x7f7b74061d80 2020-05-18T21:39:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:39:09.667 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":169,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:39:03.814988+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:38:28.730444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2020-05-18T21:38:29.414568+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":168,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":32,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:39:09.668 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.664+0000 7f7b7a363700 1 -- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b5404f8d0 msgr2=0x7f7b54051d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:09.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.664+0000 7f7b7a363700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b5404f8d0 0x7f7b54051d90 secure :-1 s=READY pgs=884 cs=0 l=1 rx=0x7f7b680032f0 tx=0x7f7b68007e00).stop 2020-05-18T21:39:09.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.664+0000 7f7b7a363700 1 -- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 msgr2=0x7f7b74150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:09.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.664+0000 7f7b7a363700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 0x7f7b74150380 secure :-1 s=READY pgs=347 cs=0 l=1 rx=0x7f7b64002f70 tx=0x7f7b64010bd0).stop 2020-05-18T21:39:09.669 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.664+0000 7f7b7a363700 1 -- 172.21.15.63:0/398303237 shutdown_connections 2020-05-18T21:39:09.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.664+0000 7f7b7a363700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f7b5404f8d0 0x7f7b54051d90 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:09.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.664+0000 7f7b7a363700 1 --2- 172.21.15.63:0/398303237 >> v2:172.21.15.63:3300/0 conn(0x7f7b740ac930 0x7f7b7413c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:09.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.664+0000 7f7b7a363700 1 --2- 172.21.15.63:0/398303237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b74061d80 0x7f7b74150380 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:09.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.664+0000 7f7b7a363700 1 -- 172.21.15.63:0/398303237 >> 172.21.15.63:0/398303237 conn(0x7f7b74066d00 msgr2=0x7f7b741459a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:09.670 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.664+0000 7f7b7a363700 1 -- 172.21.15.63:0/398303237 shutdown_connections 2020-05-18T21:39:09.671 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.664+0000 7f7b7a363700 1 -- 172.21.15.63:0/398303237 wait complete. 2020-05-18T21:39:09.680 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-05-18T21:39:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.776+0000 7f0c8b6f1700 1 Processor -- start 2020-05-18T21:39:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.776+0000 7f0c8b6f1700 1 -- start start 2020-05-18T21:39:09.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.776+0000 7f0c8b6f1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0c84061840 0x7f0c8414ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:09.787 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.776+0000 7f0c8b6f1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c8406a280 0x7f0c8414d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:09.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.776+0000 7f0c8b6f1700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8406a6f0 con 0x7f0c84061c20 2020-05-18T21:39:09.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.776+0000 7f0c8b6f1700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8414a6f0 con 0x7f0c84061840 2020-05-18T21:39:09.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.776+0000 7f0c8b6f1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8414a990 con 0x7f0c8406a280 2020-05-18T21:39:09.788 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c88c8c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0c84061c20 0x7f0c84069b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39634/0 (socket says 172.21.15.63:39634) 2020-05-18T21:39:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c88c8c700 1 -- 172.21.15.63:0/1365630404 learned_addr learned my addr 172.21.15.63:0/1365630404 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c89c8e700 1 --2- 172.21.15.63:0/1365630404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c8406a280 0x7f0c8414d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c8948d700 1 --2- 172.21.15.63:0/1365630404 >> v2:172.21.15.155:3300/0 conn(0x7f0c84061840 0x7f0c8414ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c7bfff700 1 -- 172.21.15.63:0/1365630404 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526287108 0 0) 0x7f0c8406a6f0 con 0x7f0c84061c20 2020-05-18T21:39:09.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c7bfff700 1 -- 172.21.15.63:0/1365630404 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c70003270 con 0x7f0c84061c20 2020-05-18T21:39:09.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c89c8e700 1 -- 172.21.15.63:0/1365630404 >> v2:172.21.15.155:3300/0 conn(0x7f0c84061840 msgr2=0x7f0c8414ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:09.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c89c8e700 1 --2- 172.21.15.63:0/1365630404 >> v2:172.21.15.155:3300/0 conn(0x7f0c84061840 0x7f0c8414ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:09.790 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c89c8e700 1 -- 172.21.15.63:0/1365630404 >> v1:172.21.15.63:6789/0 conn(0x7f0c84061c20 legacy=0x7f0c84069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:09.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c89c8e700 1 -- 172.21.15.63:0/1365630404 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8414a3e0 con 0x7f0c8406a280 2020-05-18T21:39:09.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c89c8e700 1 --2- 172.21.15.63:0/1365630404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c8406a280 0x7f0c8414d9b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0c7c002f70 tx=0x7f0c7c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c89c8e700 1 --2- 172.21.15.63:0/1365630404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c8406a280 0x7f0c8414d9b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0c7c002f70 tx=0x7f0c7c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c89c8e700 1 --2- 172.21.15.63:0/1365630404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c8406a280 0x7f0c8414d9b0 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f0c7c002f70 tx=0x7f0c7c007a80).ready entity=mon.2 client_cookie=8f1ad8ff9acfd6b0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:09.791 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c89c8e700 1 --2- 172.21.15.63:0/1365630404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c8406a280 0x7f0c8414d9b0 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f0c7c002f70 tx=0x7f0c7c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c7bfff700 1 -- 172.21.15.63:0/1365630404 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c7c008e80 con 0x7f0c8406a280 2020-05-18T21:39:09.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c89c8e700 1 --2- 172.21.15.63:0/1365630404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c8406a280 0x7f0c8414d9b0 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f0c7c002f70 tx=0x7f0c7c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c7bfff700 1 -- 172.21.15.63:0/1365630404 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c011540 con 0x7f0c8406a280 2020-05-18T21:39:09.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c89c8e700 1 --2- 172.21.15.63:0/1365630404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c8406a280 0x7f0c8414d9b0 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f0c7c002f70 tx=0x7f0c7c007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.792 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c7bfff700 1 -- 172.21.15.63:0/1365630404 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c7c011920 con 0x7f0c8406a280 2020-05-18T21:39:09.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c8b6f1700 1 -- 172.21.15.63:0/1365630404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c8406a280 msgr2=0x7f0c8414d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:09.793 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c8b6f1700 1 --2- 172.21.15.63:0/1365630404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c8406a280 0x7f0c8414d9b0 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f0c7c002f70 tx=0x7f0c7c007a80).stop 2020-05-18T21:39:09.796 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c8b6f1700 1 -- 172.21.15.63:0/1365630404 shutdown_connections 2020-05-18T21:39:09.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c8b6f1700 1 --2- 172.21.15.63:0/1365630404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c8406a280 0x7f0c8414d9b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:09.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c8b6f1700 1 --2- 172.21.15.63:0/1365630404 >> v2:172.21.15.155:3300/0 conn(0x7f0c84061840 0x7f0c8414ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:09.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c8b6f1700 1 -- 172.21.15.63:0/1365630404 >> 172.21.15.63:0/1365630404 conn(0x7f0c840ba5c0 msgr2=0x7f0c840ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:09.797 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c8b6f1700 1 -- 172.21.15.63:0/1365630404 shutdown_connections 2020-05-18T21:39:09.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.780+0000 7f0c8b6f1700 1 -- 172.21.15.63:0/1365630404 wait complete. 2020-05-18T21:39:09.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.784+0000 7f0c8b6f1700 1 Processor -- start 2020-05-18T21:39:09.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.784+0000 7f0c8b6f1700 1 -- start start 2020-05-18T21:39:09.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.784+0000 7f0c8b6f1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0c84061840 0x7f0c840b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:09.798 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.784+0000 7f0c8b6f1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c8406a280 0x7f0c840b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:09.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.784+0000 7f0c8b6f1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8415b4d0 con 0x7f0c84061c20 2020-05-18T21:39:09.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.784+0000 7f0c8b6f1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c840b35e0 con 0x7f0c84061840 2020-05-18T21:39:09.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.784+0000 7f0c8b6f1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8415b770 con 0x7f0c8406a280 2020-05-18T21:39:09.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.784+0000 7f0c8948d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0c84061840 0x7f0c840b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:09.799 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.784+0000 7f0c8948d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0c84061840 0x7f0c840b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37452/0 (socket says 172.21.15.63:37452) 2020-05-18T21:39:09.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.784+0000 7f0c8948d700 1 -- 172.21.15.63:0/3941231390 learned_addr learned my addr 172.21.15.63:0/3941231390 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:09.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c89c8e700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c8406a280 0x7f0c840b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:09.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c7a7fc700 1 -- 172.21.15.63:0/3941231390 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162996368 0 0) 0x7f0c8415b4d0 con 0x7f0c84061c20 2020-05-18T21:39:09.800 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c8948d700 1 -- 172.21.15.63:0/3941231390 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c8406a280 msgr2=0x7f0c840b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c8948d700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c8406a280 0x7f0c840b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c8948d700 1 -- 172.21.15.63:0/3941231390 >> v1:172.21.15.155:6789/0 conn(0x7f0c84061c20 legacy=0x7f0c84142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c8948d700 1 -- 172.21.15.63:0/3941231390 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c840662f0 con 0x7f0c84061840 2020-05-18T21:39:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c8948d700 1 --2- 172.21.15.63:0/3941231390 >> v2:172.21.15.63:3300/0 conn(0x7f0c84061840 0x7f0c840b1a40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0c740030b0 tx=0x7f0c74010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c8948d700 1 --2- 172.21.15.63:0/3941231390 >> v2:172.21.15.63:3300/0 conn(0x7f0c84061840 0x7f0c840b1a40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0c740030b0 tx=0x7f0c74010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c8948d700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c84061840 0x7f0c840b1a40 secure :-1 s=READY pgs=2258 cs=0 l=1 rx=0x7f0c740030b0 tx=0x7f0c74010cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c8948d700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c84061840 0x7f0c840b1a40 secure :-1 s=THROTTLE_DONE pgs=2258 cs=0 l=1 rx=0x7f0c740030b0 tx=0x7f0c74010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c7a7fc700 1 -- 172.21.15.63:0/3941231390 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c74007180 con 0x7f0c84061840 2020-05-18T21:39:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c8948d700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c84061840 0x7f0c840b1a40 secure :-1 s=THROTTLE_DONE pgs=2258 cs=0 l=1 rx=0x7f0c740030b0 tx=0x7f0c74010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c8948d700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c84061840 0x7f0c840b1a40 secure :-1 s=THROTTLE_DONE pgs=2258 cs=0 l=1 rx=0x7f0c740030b0 tx=0x7f0c74010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c7a7fc700 1 -- 172.21.15.63:0/3941231390 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c740072e0 con 0x7f0c84061840 2020-05-18T21:39:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c7a7fc700 1 -- 172.21.15.63:0/3941231390 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c74012360 con 0x7f0c84061840 2020-05-18T21:39:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c8b6f1700 1 -- 172.21.15.63:0/3941231390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c840b74a0 con 0x7f0c84061840 2020-05-18T21:39:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c8b6f1700 1 -- 172.21.15.63:0/3941231390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c840b7950 con 0x7f0c84061840 2020-05-18T21:39:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c8948d700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c84061840 0x7f0c840b1a40 secure :-1 s=THROTTLE_DONE pgs=2258 cs=0 l=1 rx=0x7f0c740030b0 tx=0x7f0c74010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c8b6f1700 1 -- 172.21.15.63:0/3941231390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c840569e0 con 0x7f0c84061840 2020-05-18T21:39:09.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c7a7fc700 1 -- 172.21.15.63:0/3941231390 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0c740125d0 con 0x7f0c84061840 2020-05-18T21:39:09.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c8948d700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c84061840 0x7f0c840b1a40 secure :-1 s=THROTTLE_DONE pgs=2258 cs=0 l=1 rx=0x7f0c740030b0 tx=0x7f0c74010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c7a7fc700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0c6404f8e0 0x7f0c64051da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:09.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c7a7fc700 1 -- 172.21.15.63:0/3941231390 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0c74064180 con 0x7f0c84061840 2020-05-18T21:39:09.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.788+0000 7f0c88c8c700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0c6404f8e0 0x7f0c64051da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.792+0000 7f0c88c8c700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0c6404f8e0 0x7f0c64051da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0c80001450 tx=0x7f0c80001a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.792+0000 7f0c88c8c700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0c6404f8e0 0x7f0c64051da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0c80001450 tx=0x7f0c80001a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.792+0000 7f0c88c8c700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0c6404f8e0 0x7f0c64051da0 secure :-1 s=READY pgs=885 cs=0 l=1 rx=0x7f0c80001450 tx=0x7f0c80001a90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.796+0000 7f0c8948d700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c84061840 0x7f0c840b1a40 secure :-1 s=THROTTLE_DONE pgs=2258 cs=0 l=1 rx=0x7f0c740030b0 tx=0x7f0c74010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.796+0000 7f0c7a7fc700 1 -- 172.21.15.63:0/3941231390 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f0c7403e4b0 con 0x7f0c84061840 2020-05-18T21:39:09.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.908+0000 7f0c8b6f1700 1 -- 172.21.15.63:0/3941231390 --> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0c841421b0 con 0x7f0c6404f8e0 2020-05-18T21:39:09.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.920+0000 7f0c88c8c700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0c6404f8e0 0x7f0c64051da0 secure :-1 s=THROTTLE_DONE pgs=885 cs=0 l=1 rx=0x7f0c80001450 tx=0x7f0c80001a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:09.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.920+0000 7f0c7a7fc700 1 -- 172.21.15.63:0/3941231390 <== mgr.4110 v2:172.21.15.155:6832/12649 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+104996 (secure 0 0 0) 0x7f0c80009b30 con 0x7f0c6404f8e0 2020-05-18T21:39:09.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.920+0000 7f0c8b6f1700 1 -- 172.21.15.63:0/3941231390 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0c6404f8e0 msgr2=0x7f0c64051da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:09.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.920+0000 7f0c8b6f1700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0c6404f8e0 0x7f0c64051da0 secure :-1 s=READY pgs=885 cs=0 l=1 rx=0x7f0c80001450 tx=0x7f0c80001a90).stop 2020-05-18T21:39:09.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.920+0000 7f0c8b6f1700 1 -- 172.21.15.63:0/3941231390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c84061840 msgr2=0x7f0c840b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:09.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.920+0000 7f0c8b6f1700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c84061840 0x7f0c840b1a40 secure :-1 s=READY pgs=2258 cs=0 l=1 rx=0x7f0c740030b0 tx=0x7f0c74010cd0).stop 2020-05-18T21:39:09.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.920+0000 7f0c8b6f1700 1 -- 172.21.15.63:0/3941231390 shutdown_connections 2020-05-18T21:39:09.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.920+0000 7f0c8b6f1700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0c6404f8e0 0x7f0c64051da0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:09.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.920+0000 7f0c8b6f1700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c8406a280 0x7f0c840b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:09.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.920+0000 7f0c8b6f1700 1 --2- 172.21.15.63:0/3941231390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c84061840 0x7f0c840b1a40 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:09.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.920+0000 7f0c8b6f1700 1 -- 172.21.15.63:0/3941231390 >> 172.21.15.63:0/3941231390 conn(0x7f0c840ba5c0 msgr2=0x7f0c84143850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:09.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.920+0000 7f0c8b6f1700 1 -- 172.21.15.63:0/3941231390 shutdown_connections 2020-05-18T21:39:09.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:09.920+0000 7f0c8b6f1700 1 -- 172.21.15.63:0/3941231390 wait complete. 2020-05-18T21:39:09.932 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:39:09.933 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2020-05-18T21:39:09.941 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":539,"stamp":"2020-05-18T21:39:09.251717+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":65631,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":16,"num_read_kb":8194,"num_write":144,"num_write_kb":16510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8405664,"kb_used_data":16992,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746569056,"statfs":{"total":773094113280,"available":764486713344,"internally_reserved":8589934592,"allocated":17399808,"data_stored":8218118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8383167,"num_objects":-5,"num_object_clones":-2,"num_object_copies":-10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":-2,"num_read":6,"num_read_kb":1,"num_write":35,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.130398"},"pg_stats":[{"pgid":"32.7","version":"0'0","reported_seq":"20","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:03.869026+0000","last_change":"2020-05-18T21:39:01.159893+0000","last_active":"2020-05-18T21:39:03.869026+0000","last_peered":"2020-05-18T21:39:03.869026+0000","last_clean":"2020-05-18T21:39:03.869026+0000","last_became_active":"2020-05-18T21:38:30.449166+0000","last_became_peered":"2020-05-18T21:38:30.449166+0000","last_unstale":"2020-05-18T21:39:03.869026+0000","last_undegraded":"2020-05-18T21:39:03.869026+0000","last_fullsized":"2020-05-18T21:39:03.869026+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_clean_scrub_stamp":"2020-05-18T21:38:30.097894+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":"20","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:03.829070+0000","last_change":"2020-05-18T21:39:01.131385+0000","last_active":"2020-05-18T21:39:03.829070+0000","last_peered":"2020-05-18T21:39:03.829070+0000","last_clean":"2020-05-18T21:39:03.829070+0000","last_became_active":"2020-05-18T21:38:30.450235+0000","last_became_peered":"2020-05-18T21:38:30.450235+0000","last_unstale":"2020-05-18T21:39:03.829070+0000","last_undegraded":"2020-05-18T21:39:03.829070+0000","last_fullsized":"2020-05-18T21:39:03.829070+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_clean_scrub_stamp":"2020-05-18T21:38:30.097894+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"168'7","reported_seq":"27","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:03.871034+0000","last_change":"2020-05-18T21:39:01.133098+0000","last_active":"2020-05-18T21:39:03.871034+0000","last_peered":"2020-05-18T21:39:03.871034+0000","last_clean":"2020-05-18T21:39:03.871034+0000","last_became_active":"2020-05-18T21:38:30.447545+0000","last_became_peered":"2020-05-18T21:38:30.447545+0000","last_unstale":"2020-05-18T21:39:03.871034+0000","last_undegraded":"2020-05-18T21:39:03.871034+0000","last_fullsized":"2020-05-18T21:39:03.871034+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_clean_scrub_stamp":"2020-05-18T21:38:30.097894+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.7","version":"167'17","reported_seq":"29","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.123889+0000","last_change":"2020-05-18T21:38:30.124807+0000","last_active":"2020-05-18T21:39:01.123889+0000","last_peered":"2020-05-18T21:39:01.123889+0000","last_clean":"2020-05-18T21:39:01.123889+0000","last_became_active":"2020-05-18T21:38:30.124194+0000","last_became_peered":"2020-05-18T21:38:30.124194+0000","last_unstale":"2020-05-18T21:39:01.123889+0000","last_undegraded":"2020-05-18T21:39:01.123889+0000","last_fullsized":"2020-05-18T21:39:01.123889+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_clean_scrub_stamp":"2020-05-18T21:38:29.085681+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.6","version":"167'10","reported_seq":"22","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.124998+0000","last_change":"2020-05-18T21:38:30.130020+0000","last_active":"2020-05-18T21:39:01.124998+0000","last_peered":"2020-05-18T21:39:01.124998+0000","last_clean":"2020-05-18T21:39:01.124998+0000","last_became_active":"2020-05-18T21:38:30.129606+0000","last_became_peered":"2020-05-18T21:38:30.129606+0000","last_unstale":"2020-05-18T21:39:01.124998+0000","last_undegraded":"2020-05-18T21:39:01.124998+0000","last_fullsized":"2020-05-18T21:39:01.124998+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_clean_scrub_stamp":"2020-05-18T21:38:29.085681+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.5","version":"167'11","reported_seq":"23","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.150909+0000","last_change":"2020-05-18T21:38:30.137091+0000","last_active":"2020-05-18T21:39:01.150909+0000","last_peered":"2020-05-18T21:39:01.150909+0000","last_clean":"2020-05-18T21:39:01.150909+0000","last_became_active":"2020-05-18T21:38:30.136652+0000","last_became_peered":"2020-05-18T21:38:30.136652+0000","last_unstale":"2020-05-18T21:39:01.150909+0000","last_undegraded":"2020-05-18T21:39:01.150909+0000","last_fullsized":"2020-05-18T21:39:01.150909+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_clean_scrub_stamp":"2020-05-18T21:38:29.085681+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.4","version":"169'45","reported_seq":"57","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:03.869396+0000","last_change":"2020-05-18T21:38:30.127494+0000","last_active":"2020-05-18T21:39:03.869396+0000","last_peered":"2020-05-18T21:39:03.869396+0000","last_clean":"2020-05-18T21:39:03.869396+0000","last_became_active":"2020-05-18T21:38:30.127063+0000","last_became_peered":"2020-05-18T21:38:30.127063+0000","last_unstale":"2020-05-18T21:39:03.869396+0000","last_undegraded":"2020-05-18T21:39:03.869396+0000","last_fullsized":"2020-05-18T21:39:03.869396+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_clean_scrub_stamp":"2020-05-18T21:38:29.085681+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":64637,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"167'12","reported_seq":"24","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.569824+0000","last_change":"2020-05-18T21:38:30.127987+0000","last_active":"2020-05-18T21:39:01.569824+0000","last_peered":"2020-05-18T21:39:01.569824+0000","last_clean":"2020-05-18T21:39:01.569824+0000","last_became_active":"2020-05-18T21:38:30.127183+0000","last_became_peered":"2020-05-18T21:38:30.127183+0000","last_unstale":"2020-05-18T21:39:01.569824+0000","last_undegraded":"2020-05-18T21:39:01.569824+0000","last_fullsized":"2020-05-18T21:39:01.569824+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_clean_scrub_stamp":"2020-05-18T21:38:29.085681+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.1","version":"167'3","reported_seq":"17","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.123656+0000","last_change":"2020-05-18T21:38:30.127977+0000","last_active":"2020-05-18T21:39:01.123656+0000","last_peered":"2020-05-18T21:39:01.123656+0000","last_clean":"2020-05-18T21:39:01.123656+0000","last_became_active":"2020-05-18T21:38:30.127339+0000","last_became_peered":"2020-05-18T21:38:30.127339+0000","last_unstale":"2020-05-18T21:39:01.123656+0000","last_undegraded":"2020-05-18T21:39:01.123656+0000","last_fullsized":"2020-05-18T21:39:01.123656+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_clean_scrub_stamp":"2020-05-18T21:38:29.085681+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":210,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"151","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.125400+0000","last_change":"2020-05-18T21:26:37.226650+0000","last_active":"2020-05-18T21:39:01.125400+0000","last_peered":"2020-05-18T21:39:01.125400+0000","last_clean":"2020-05-18T21:39:01.125400+0000","last_became_active":"2020-05-18T21:26:37.224618+0000","last_became_peered":"2020-05-18T21:26:37.224618+0000","last_unstale":"2020-05-18T21:39:01.125400+0000","last_undegraded":"2020-05-18T21:39:01.125400+0000","last_fullsized":"2020-05-18T21:39:01.125400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:34.017197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:34.017197+0000","last_clean_scrub_stamp":"2020-05-18T21:26:34.017197+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"146","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.129189+0000","last_change":"2020-05-18T21:26:42.152047+0000","last_active":"2020-05-18T21:39:01.129189+0000","last_peered":"2020-05-18T21:39:01.129189+0000","last_clean":"2020-05-18T21:39:01.129189+0000","last_became_active":"2020-05-18T21:26:42.151473+0000","last_became_peered":"2020-05-18T21:26:42.151473+0000","last_unstale":"2020-05-18T21:39:01.129189+0000","last_undegraded":"2020-05-18T21:39:01.129189+0000","last_fullsized":"2020-05-18T21:39:01.129189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.0","version":"167'13","reported_seq":"25","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.569324+0000","last_change":"2020-05-18T21:38:30.131483+0000","last_active":"2020-05-18T21:39:01.569324+0000","last_peered":"2020-05-18T21:39:01.569324+0000","last_clean":"2020-05-18T21:39:01.569324+0000","last_became_active":"2020-05-18T21:38:30.131041+0000","last_became_peered":"2020-05-18T21:38:30.131041+0000","last_unstale":"2020-05-18T21:39:01.569324+0000","last_undegraded":"2020-05-18T21:39:01.569324+0000","last_fullsized":"2020-05-18T21:39:01.569324+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_clean_scrub_stamp":"2020-05-18T21:38:29.085681+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"146","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.124729+0000","last_change":"2020-05-18T21:26:42.150248+0000","last_active":"2020-05-18T21:39:01.124729+0000","last_peered":"2020-05-18T21:39:01.124729+0000","last_clean":"2020-05-18T21:39:01.124729+0000","last_became_active":"2020-05-18T21:26:42.149888+0000","last_became_peered":"2020-05-18T21:26:42.149888+0000","last_unstale":"2020-05-18T21:39:01.124729+0000","last_undegraded":"2020-05-18T21:39:01.124729+0000","last_fullsized":"2020-05-18T21:39:01.124729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":"20","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:03.823137+0000","last_change":"2020-05-18T21:39:01.146562+0000","last_active":"2020-05-18T21:39:03.823137+0000","last_peered":"2020-05-18T21:39:03.823137+0000","last_clean":"2020-05-18T21:39:03.823137+0000","last_became_active":"2020-05-18T21:38:30.452015+0000","last_became_peered":"2020-05-18T21:38:30.452015+0000","last_unstale":"2020-05-18T21:39:03.823137+0000","last_undegraded":"2020-05-18T21:39:03.823137+0000","last_fullsized":"2020-05-18T21:39:03.823137+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_clean_scrub_stamp":"2020-05-18T21:38:30.097894+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"144","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.158499+0000","last_change":"2020-05-18T21:26:42.226096+0000","last_active":"2020-05-18T21:39:01.158499+0000","last_peered":"2020-05-18T21:39:01.158499+0000","last_clean":"2020-05-18T21:39:01.158499+0000","last_became_active":"2020-05-18T21:26:42.225154+0000","last_became_peered":"2020-05-18T21:26:42.225154+0000","last_unstale":"2020-05-18T21:39:01.158499+0000","last_undegraded":"2020-05-18T21:39:01.158499+0000","last_fullsized":"2020-05-18T21:39:01.158499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.2","version":"166'1","reported_seq":"13","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.124405+0000","last_change":"2020-05-18T21:38:30.128905+0000","last_active":"2020-05-18T21:39:01.124405+0000","last_peered":"2020-05-18T21:39:01.124405+0000","last_clean":"2020-05-18T21:39:01.124405+0000","last_became_active":"2020-05-18T21:38:30.128523+0000","last_became_peered":"2020-05-18T21:38:30.128523+0000","last_unstale":"2020-05-18T21:39:01.124405+0000","last_undegraded":"2020-05-18T21:39:01.124405+0000","last_fullsized":"2020-05-18T21:39:01.124405+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_clean_scrub_stamp":"2020-05-18T21:38:29.085681+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"146","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.129339+0000","last_change":"2020-05-18T21:26:42.153477+0000","last_active":"2020-05-18T21:39:01.129339+0000","last_peered":"2020-05-18T21:39:01.129339+0000","last_clean":"2020-05-18T21:39:01.129339+0000","last_became_active":"2020-05-18T21:26:42.153056+0000","last_became_peered":"2020-05-18T21:26:42.153056+0000","last_unstale":"2020-05-18T21:39:01.129339+0000","last_undegraded":"2020-05-18T21:39:01.129339+0000","last_fullsized":"2020-05-18T21:39:01.129339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":"20","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:03.869434+0000","last_change":"2020-05-18T21:39:01.153428+0000","last_active":"2020-05-18T21:39:03.869434+0000","last_peered":"2020-05-18T21:39:03.869434+0000","last_clean":"2020-05-18T21:39:03.869434+0000","last_became_active":"2020-05-18T21:38:30.443876+0000","last_became_peered":"2020-05-18T21:38:30.443876+0000","last_unstale":"2020-05-18T21:39:03.869434+0000","last_undegraded":"2020-05-18T21:39:03.869434+0000","last_fullsized":"2020-05-18T21:39:03.869434+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_clean_scrub_stamp":"2020-05-18T21:38:30.097894+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"160","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.123887+0000","last_change":"2020-05-18T21:26:42.155086+0000","last_active":"2020-05-18T21:39:01.123887+0000","last_peered":"2020-05-18T21:39:01.123887+0000","last_clean":"2020-05-18T21:39:01.123887+0000","last_became_active":"2020-05-18T21:26:42.154622+0000","last_became_peered":"2020-05-18T21:26:42.154622+0000","last_unstale":"2020-05-18T21:39:01.123887+0000","last_undegraded":"2020-05-18T21:39:01.123887+0000","last_fullsized":"2020-05-18T21:39:01.123887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":"20","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:03.823244+0000","last_change":"2020-05-18T21:39:01.146185+0000","last_active":"2020-05-18T21:39:03.823244+0000","last_peered":"2020-05-18T21:39:03.823244+0000","last_clean":"2020-05-18T21:39:03.823244+0000","last_became_active":"2020-05-18T21:38:30.452336+0000","last_became_peered":"2020-05-18T21:38:30.452336+0000","last_unstale":"2020-05-18T21:39:03.823244+0000","last_undegraded":"2020-05-18T21:39:03.823244+0000","last_fullsized":"2020-05-18T21:39:03.823244+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_clean_scrub_stamp":"2020-05-18T21:38:30.097894+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"146","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.125897+0000","last_change":"2020-05-18T21:26:42.155047+0000","last_active":"2020-05-18T21:39:01.125897+0000","last_peered":"2020-05-18T21:39:01.125897+0000","last_clean":"2020-05-18T21:39:01.125897+0000","last_became_active":"2020-05-18T21:26:42.154722+0000","last_became_peered":"2020-05-18T21:26:42.154722+0000","last_unstale":"2020-05-18T21:39:01.125897+0000","last_undegraded":"2020-05-18T21:39:01.125897+0000","last_fullsized":"2020-05-18T21:39:01.125897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":"20","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:03.868843+0000","last_change":"2020-05-18T21:39:01.160347+0000","last_active":"2020-05-18T21:39:03.868843+0000","last_peered":"2020-05-18T21:39:03.868843+0000","last_clean":"2020-05-18T21:39:03.868843+0000","last_became_active":"2020-05-18T21:38:30.592942+0000","last_became_peered":"2020-05-18T21:38:30.592942+0000","last_unstale":"2020-05-18T21:39:03.868843+0000","last_undegraded":"2020-05-18T21:39:03.868843+0000","last_fullsized":"2020-05-18T21:39:03.868843+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_clean_scrub_stamp":"2020-05-18T21:38:30.097894+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"160","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.123642+0000","last_change":"2020-05-18T21:26:42.151175+0000","last_active":"2020-05-18T21:39:01.123642+0000","last_peered":"2020-05-18T21:39:01.123642+0000","last_clean":"2020-05-18T21:39:01.123642+0000","last_became_active":"2020-05-18T21:26:42.150762+0000","last_became_peered":"2020-05-18T21:26:42.150762+0000","last_unstale":"2020-05-18T21:39:01.123642+0000","last_undegraded":"2020-05-18T21:39:01.123642+0000","last_fullsized":"2020-05-18T21:39:01.123642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2","version":"168'9","reported_seq":"35","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:03.869434+0000","last_change":"2020-05-18T21:39:01.161030+0000","last_active":"2020-05-18T21:39:03.869434+0000","last_peered":"2020-05-18T21:39:03.869434+0000","last_clean":"2020-05-18T21:39:03.869434+0000","last_became_active":"2020-05-18T21:38:30.446893+0000","last_became_peered":"2020-05-18T21:38:30.446893+0000","last_unstale":"2020-05-18T21:39:03.869434+0000","last_undegraded":"2020-05-18T21:39:03.869434+0000","last_fullsized":"2020-05-18T21:39:03.869434+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_clean_scrub_stamp":"2020-05-18T21:38:30.097894+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4096,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"142","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.125300+0000","last_change":"2020-05-18T21:26:42.153239+0000","last_active":"2020-05-18T21:39:01.125300+0000","last_peered":"2020-05-18T21:39:01.125300+0000","last_clean":"2020-05-18T21:39:01.125300+0000","last_became_active":"2020-05-18T21:26:42.152721+0000","last_became_peered":"2020-05-18T21:26:42.152721+0000","last_unstale":"2020-05-18T21:39:01.125300+0000","last_undegraded":"2020-05-18T21:39:01.125300+0000","last_fullsized":"2020-05-18T21:39:01.125300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":16,"acting":16,"num_store_stats":7},{"poolid":31,"num_pg":8,"stat_sum":{"num_bytes":65631,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":132,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":131262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":16,"acting":16,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575000,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050684,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321156,"statfs":{"total":96636764160,"available":95560863744,"internally_reserved":1073741824,"allocated":2150400,"data_stored":1010913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":1.887,"5min":1.7689999999999999,"15min":1.694},"min":{"1min":1.0209999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.98,"5min":6.4699999999999998,"15min":6.4699999999999998},"last":1.482},{"interface":"front","average":{"1min":1.881,"5min":1.6950000000000001,"15min":1.7669999999999999},"min":{"1min":1.1279999999999999,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.7450000000000001,"5min":2.8919999999999999,"15min":3.0779999999999998},"last":1.6759999999999999}]},{"osd":1,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":2.149,"5min":2.04,"15min":2.0299999999999998},"min":{"1min":1.2829999999999999,"5min":0.86399999999999999,"15min":0.72199999999999998},"max":{"1min":3.698,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":1.415},{"interface":"front","average":{"1min":2.3620000000000001,"5min":2.5190000000000001,"15min":2.5329999999999999},"min":{"1min":1.319,"5min":1.264,"15min":1.1399999999999999},"max":{"1min":4.2149999999999999,"5min":6.6799999999999997,"15min":6.6799999999999997},"last":2.4489999999999998}]},{"osd":2,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":2.181,"5min":2.21,"15min":2.214},"min":{"1min":1.3779999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"max":{"1min":2.7490000000000001,"5min":9.032,"15min":9.032},"last":2.024},{"interface":"front","average":{"1min":2.2330000000000001,"5min":2.226,"15min":2.2389999999999999},"min":{"1min":1.3859999999999999,"5min":1.107,"15min":0.86899999999999999},"max":{"1min":3.907,"5min":3.907,"15min":3.9660000000000002},"last":2.3180000000000001}]},{"osd":3,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":2.2480000000000002,"5min":2.2120000000000002,"15min":2.306},"min":{"1min":1.401,"5min":1.056,"15min":1.056},"max":{"1min":2.9249999999999998,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":2.8820000000000001},{"interface":"front","average":{"1min":2.851,"5min":2.827,"15min":2.8889999999999998},"min":{"1min":1.7130000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"max":{"1min":3.7639999999999998,"5min":8.8469999999999995,"15min":8.8469999999999995},"last":2.847}]},{"osd":4,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":2.6909999999999998,"5min":2.4950000000000001,"15min":2.5270000000000001},"min":{"1min":2.008,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":3.5150000000000001,"5min":3.5510000000000002,"15min":4.9530000000000003},"last":2.7250000000000001},{"interface":"front","average":{"1min":2.6379999999999999,"5min":2.532,"15min":2.5390000000000001},"min":{"1min":1.5660000000000001,"5min":1.089,"15min":1.0580000000000001},"max":{"1min":3.306,"5min":3.7320000000000002,"15min":4.0620000000000003},"last":2.0899999999999999}]},{"osd":5,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":2.9159999999999999,"5min":2.899,"15min":2.9340000000000002},"min":{"1min":1.633,"5min":1.6040000000000001,"15min":1.111},"max":{"1min":3.7970000000000002,"5min":9.218,"15min":9.218},"last":3.1909999999999998},{"interface":"front","average":{"1min":3.0179999999999998,"5min":2.9420000000000002,"15min":3.036},"min":{"1min":2.2909999999999999,"5min":1.4950000000000001,"15min":1.268},"max":{"1min":3.641,"5min":3.9980000000000002,"15min":4.6399999999999997},"last":3.052}]},{"osd":6,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":3.3199999999999998,"5min":3.0859999999999999,"15min":3.2040000000000002},"min":{"1min":2.1419999999999999,"5min":1.2230000000000001,"15min":1.2230000000000001},"max":{"1min":4.367,"5min":4.367,"15min":5.6600000000000001},"last":3.3639999999999999},{"interface":"front","average":{"1min":3.0369999999999999,"5min":3.0350000000000001,"15min":3.1349999999999998},"min":{"1min":1.8340000000000001,"5min":1.464,"15min":1.3009999999999999},"max":{"1min":3.6920000000000002,"5min":4.2510000000000003,"15min":5.2539999999999996},"last":3.2829999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575001,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050756,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321084,"statfs":{"total":96636764160,"available":95560790016,"internally_reserved":1073741824,"allocated":2224128,"data_stored":1075326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":1.774,"5min":1.9510000000000001,"15min":1.9259999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.56799999999999995},"max":{"1min":2.7749999999999999,"5min":6.9699999999999998,"15min":6.9699999999999998},"last":1.4850000000000001},{"interface":"front","average":{"1min":2.2120000000000002,"5min":2.4009999999999998,"15min":2.427},"min":{"1min":1.6479999999999999,"5min":1.1879999999999999,"15min":1.0169999999999999},"max":{"1min":3.1120000000000001,"5min":6.9340000000000002,"15min":16.428999999999998},"last":1.9570000000000001}]},{"osd":1,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":1.9319999999999999,"5min":2.992,"15min":2.403},"min":{"1min":0.99099999999999999,"5min":0.81899999999999995,"15min":0.78600000000000003},"max":{"1min":2.802,"5min":113.30200000000001,"15min":113.30200000000001},"last":1.542},{"interface":"front","average":{"1min":2.1240000000000001,"5min":3.2370000000000001,"15min":2.456},"min":{"1min":1.359,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":2.871,"5min":113.866,"15min":113.866},"last":2.2000000000000002}]},{"osd":2,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":2.1829999999999998,"5min":2.169,"15min":2.2290000000000001},"min":{"1min":1.5800000000000001,"5min":1.016,"15min":0.97799999999999998},"max":{"1min":3.2650000000000001,"5min":3.8180000000000001,"15min":4.7489999999999997},"last":3.29},{"interface":"front","average":{"1min":2.2309999999999999,"5min":2.2160000000000002,"15min":2.3580000000000001},"min":{"1min":1.111,"5min":0.97399999999999998,"15min":0.81100000000000005},"max":{"1min":2.8900000000000001,"5min":3.5329999999999999,"15min":4.3239999999999998},"last":2.6230000000000002}]},{"osd":3,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":2.5249999999999999,"5min":2.294,"15min":2.3900000000000001},"min":{"1min":1.6279999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":3.367,"5min":4.2610000000000001,"15min":16.594000000000001},"last":2.3730000000000002},{"interface":"front","average":{"1min":2.5179999999999998,"5min":2.5390000000000001,"15min":2.681},"min":{"1min":1.7170000000000001,"5min":1.224,"15min":1.171},"max":{"1min":3.9510000000000001,"5min":4.1660000000000004,"15min":4.7619999999999996},"last":2.8279999999999998}]},{"osd":4,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.5739999999999998,"15min":2.6360000000000001},"min":{"1min":2.0859999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":3.3260000000000001,"5min":3.9740000000000002,"15min":3.9990000000000001},"last":2.9279999999999999},{"interface":"front","average":{"1min":2.7370000000000001,"5min":2.6389999999999998,"15min":2.7509999999999999},"min":{"1min":2.0379999999999998,"5min":1.129,"15min":0.84599999999999997},"max":{"1min":3.4449999999999998,"5min":4.6829999999999998,"15min":29.829999999999998},"last":2.762}]},{"osd":5,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":3.0550000000000002,"5min":2.968,"15min":3.0379999999999998},"min":{"1min":1.903,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":4.2549999999999999,"5min":6.7370000000000001,"15min":6.7370000000000001},"last":3.6920000000000002},{"interface":"front","average":{"1min":3.2519999999999998,"5min":3.1560000000000001,"15min":3.2120000000000002},"min":{"1min":2.552,"5min":1.357,"15min":1.357},"max":{"1min":3.9689999999999999,"5min":6.3710000000000004,"15min":6.3710000000000004},"last":3.173}]},{"osd":7,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":3.2120000000000002,"5min":3.016,"15min":3.1629999999999998},"min":{"1min":2.5600000000000001,"5min":1.2549999999999999,"15min":0.96199999999999997},"max":{"1min":3.8210000000000002,"5min":5.5670000000000002,"15min":31.196000000000002},"last":3.1269999999999998},{"interface":"front","average":{"1min":3.2349999999999999,"5min":3.1070000000000002,"15min":3.2410000000000001},"min":{"1min":2.5110000000000001,"5min":1.363,"15min":1.363},"max":{"1min":4.5289999999999999,"5min":4.6429999999999998,"15min":4.8049999999999997},"last":4.1390000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575000,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050684,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321156,"statfs":{"total":96636764160,"available":95560863744,"internally_reserved":1073741824,"allocated":2150400,"data_stored":1010913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":1.7470000000000001,"5min":1.7909999999999999,"15min":1.806},"min":{"1min":1.179,"5min":0.623,"15min":0.623},"max":{"1min":3.0649999999999999,"5min":8.1430000000000007,"15min":8.1430000000000007},"last":1.585},{"interface":"front","average":{"1min":1.7669999999999999,"5min":1.847,"15min":1.8700000000000001},"min":{"1min":1.1339999999999999,"5min":0.81100000000000005,"15min":0.623},"max":{"1min":2.5339999999999998,"5min":3.8250000000000002,"15min":3.8250000000000002},"last":3.4340000000000002}]},{"osd":1,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":1.869,"5min":1.79,"15min":1.8640000000000001},"min":{"1min":1.3100000000000001,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.722,"5min":3.887,"15min":3.887},"last":1.649},{"interface":"front","average":{"1min":2.1400000000000001,"5min":2.2610000000000001,"15min":2.1499999999999999},"min":{"1min":1.254,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.9380000000000002,"5min":8.6259999999999994,"15min":8.6259999999999994},"last":2.1579999999999999}]},{"osd":2,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":2.1190000000000002,"5min":2.0110000000000001,"15min":2.028},"min":{"1min":1.4399999999999999,"5min":0.91700000000000004,"15min":0.85299999999999998},"max":{"1min":3.4140000000000001,"5min":4.726,"15min":5.3410000000000002},"last":2.278},{"interface":"front","average":{"1min":2.266,"5min":2.1779999999999999,"15min":2.1419999999999999},"min":{"1min":1.8400000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":3.1600000000000001,"5min":7.4989999999999997,"15min":7.4989999999999997},"last":2.2290000000000001}]},{"osd":3,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":2.472,"5min":2.5760000000000001,"15min":2.5339999999999998},"min":{"1min":1.2,"5min":1.087,"15min":1.087},"max":{"1min":3.0339999999999998,"5min":7.8070000000000004,"15min":7.8070000000000004},"last":2.9180000000000001},{"interface":"front","average":{"1min":2.6859999999999999,"5min":2.5939999999999999,"15min":2.5760000000000001},"min":{"1min":2.0640000000000001,"5min":1.2509999999999999,"15min":0.995},"max":{"1min":3.246,"5min":5.1200000000000001,"15min":5.5060000000000002},"last":2.7050000000000001}]},{"osd":4,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":2.6309999999999998,"5min":2.6549999999999998,"15min":2.633},"min":{"1min":1.7769999999999999,"5min":1.032,"15min":0.98099999999999998},"max":{"1min":3.427,"5min":8.4000000000000004,"15min":8.4000000000000004},"last":2.5859999999999999},{"interface":"front","average":{"1min":2.8410000000000002,"5min":2.7120000000000002,"15min":2.7999999999999998},"min":{"1min":1.9890000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":3.6400000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":3.2189999999999999}]},{"osd":6,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":2.7040000000000002,"5min":2.629,"15min":2.661},"min":{"1min":2.0089999999999999,"5min":0.89200000000000002,"15min":0.88900000000000001},"max":{"1min":4.0010000000000003,"5min":11.242000000000001,"15min":11.242000000000001},"last":2.653},{"interface":"front","average":{"1min":3.2320000000000002,"5min":3.282,"15min":3.2240000000000002},"min":{"1min":2.7559999999999998,"5min":1.2,"15min":1.1990000000000001},"max":{"1min":3.8730000000000002,"5min":11.411,"15min":11.411},"last":3.355}]},{"osd":7,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":3.3319999999999999,"5min":3.2679999999999998,"15min":3.2280000000000002},"min":{"1min":2.375,"5min":1.232,"15min":1.012},"max":{"1min":4.3609999999999998,"5min":9.5749999999999993,"15min":9.5749999999999993},"last":3.7679999999999998},{"interface":"front","average":{"1min":3.226,"5min":3.1549999999999998,"15min":3.1259999999999999},"min":{"1min":2.6139999999999999,"5min":1.054,"15min":1.054},"max":{"1min":3.7349999999999999,"5min":11.502000000000001,"15min":11.502000000000001},"last":3.0419999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575001,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050692,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321148,"statfs":{"total":96636764160,"available":95560855552,"internally_reserved":1073741824,"allocated":2158592,"data_stored":1011157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":1.98,"5min":1.7869999999999999,"15min":1.7869999999999999},"min":{"1min":1.3180000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":3.1589999999999998,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":2.52},{"interface":"front","average":{"1min":1.7030000000000001,"5min":1.784,"15min":1.8280000000000001},"min":{"1min":1.0629999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.6499999999999999,"5min":5.2530000000000001,"15min":5.2530000000000001},"last":1.9890000000000001}]},{"osd":1,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":1.964,"5min":1.881,"15min":1.9850000000000001},"min":{"1min":1.1719999999999999,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.1629999999999998,"5min":4.8250000000000002,"15min":4.8250000000000002},"last":1.9059999999999999},{"interface":"front","average":{"1min":1.9510000000000001,"5min":2.0459999999999998,"15min":2.121},"min":{"1min":1.0980000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":3.3199999999999998,"5min":3.3900000000000001,"15min":3.5699999999999998},"last":1.7210000000000001}]},{"osd":2,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":2.286,"5min":2.2080000000000002,"15min":2.2440000000000002},"min":{"1min":1.1990000000000001,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":3.1960000000000002,"5min":4.1539999999999999,"15min":4.4649999999999999},"last":3.1960000000000002},{"interface":"front","average":{"1min":2.496,"5min":2.5590000000000002,"15min":2.6779999999999999},"min":{"1min":1.421,"5min":0.998,"15min":0.998},"max":{"1min":3.2509999999999999,"5min":3.8530000000000002,"15min":4.6059999999999999},"last":2.1110000000000002}]},{"osd":3,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":2.3159999999999998,"5min":2.2930000000000001,"15min":2.327},"min":{"1min":1.468,"5min":1.091,"15min":1.091},"max":{"1min":3.556,"5min":5.774,"15min":5.774},"last":2.3940000000000001},{"interface":"front","average":{"1min":2.2839999999999998,"5min":2.5470000000000002,"15min":2.5710000000000002},"min":{"1min":1.5620000000000001,"5min":1.115,"15min":1.115},"max":{"1min":2.7799999999999998,"5min":5.0519999999999996,"15min":5.0519999999999996},"last":2.3399999999999999}]},{"osd":5,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":2.7120000000000002,"5min":2.5859999999999999,"15min":2.681},"min":{"1min":2.2679999999999998,"5min":1.2190000000000001,"15min":1.1830000000000001},"max":{"1min":3.2429999999999999,"5min":3.5139999999999998,"15min":4.0110000000000001},"last":2.8220000000000001},{"interface":"front","average":{"1min":2.6669999999999998,"5min":2.6070000000000002,"15min":2.7639999999999998},"min":{"1min":1.9790000000000001,"5min":0.91800000000000004,"15min":0.82899999999999996},"max":{"1min":3.98,"5min":6.0179999999999998,"15min":6.0179999999999998},"last":2.8679999999999999}]},{"osd":6,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":2.891,"5min":2.7629999999999999,"15min":2.8370000000000002},"min":{"1min":2.4049999999999998,"5min":1.21,"15min":1.21},"max":{"1min":3.556,"5min":4.3300000000000001,"15min":4.3440000000000003},"last":2.7610000000000001},{"interface":"front","average":{"1min":3.0499999999999998,"5min":3.0049999999999999,"15min":3.0539999999999998},"min":{"1min":2.0939999999999999,"5min":1.083,"15min":1.083},"max":{"1min":3.762,"5min":4.952,"15min":4.952},"last":3.0449999999999999}]},{"osd":7,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":3.2029999999999998,"5min":2.9809999999999999,"15min":3.1349999999999998},"min":{"1min":2.5139999999999998,"5min":1.3280000000000001,"15min":1.113},"max":{"1min":4.2610000000000001,"5min":5.5069999999999997,"15min":5.71},"last":3.3570000000000002},{"interface":"front","average":{"1min":3.2690000000000001,"5min":3.1739999999999999,"15min":3.2770000000000001},"min":{"1min":2.7170000000000001,"5min":1.399,"15min":1.399},"max":{"1min":3.79,"5min":4.6139999999999999,"15min":5.0229999999999997},"last":3.6000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575000,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050688,"kb_used_data":2104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321152,"statfs":{"total":96636764160,"available":95560859648,"internally_reserved":1073741824,"allocated":2154496,"data_stored":1010947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":1.657,"15min":1.798},"min":{"1min":1.1879999999999999,"5min":0.745,"15min":0.745},"max":{"1min":2.7890000000000001,"5min":3.6509999999999998,"15min":6.7140000000000004},"last":1.903},{"interface":"front","average":{"1min":1.73,"5min":1.6339999999999999,"15min":1.7649999999999999},"min":{"1min":1.3759999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.2690000000000001,"5min":3.1379999999999999,"15min":8.2739999999999991},"last":1.5640000000000001}]},{"osd":1,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":1.9059999999999999,"5min":1.7450000000000001,"15min":1.9279999999999999},"min":{"1min":1.466,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":10.494},"last":1.637},{"interface":"front","average":{"1min":2.169,"5min":2.1150000000000002,"15min":2.2709999999999999},"min":{"1min":1.341,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":3.097,"5min":3.6960000000000002,"15min":8.2859999999999996},"last":2.3210000000000002}]},{"osd":2,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":2.266,"5min":2.153,"15min":2.2170000000000001},"min":{"1min":1.4710000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":3.4820000000000002,"5min":4.9930000000000003,"15min":5.7880000000000003},"last":2.508},{"interface":"front","average":{"1min":2.4180000000000001,"5min":2.403,"15min":2.5310000000000001},"min":{"1min":1.6020000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":3.1709999999999998,"5min":4.4960000000000004,"15min":6.0419999999999998},"last":3.0070000000000001}]},{"osd":4,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":2.5289999999999999,"5min":2.3250000000000002,"15min":2.4729999999999999},"min":{"1min":1.4810000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":3.524,"5min":4.952,"15min":5.5670000000000002},"last":2.1259999999999999},{"interface":"front","average":{"1min":3.093,"5min":2.6760000000000002,"15min":2.7210000000000001},"min":{"1min":1.891,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":4.2480000000000002,"5min":4.5609999999999999,"15min":5.4059999999999997},"last":2.2719999999999998}]},{"osd":5,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":3.2160000000000002,"5min":2.8759999999999999,"15min":2.9689999999999999},"min":{"1min":2.198,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":4.2649999999999997,"5min":4.9349999999999996,"15min":5.5339999999999998},"last":2.8980000000000001},{"interface":"front","average":{"1min":2.956,"5min":2.895,"15min":2.98},"min":{"1min":2.202,"5min":1.411,"15min":1.411},"max":{"1min":3.8199999999999998,"5min":4.8109999999999999,"15min":6.2130000000000001},"last":3.5630000000000002}]},{"osd":6,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":2.8610000000000002,"5min":2.7010000000000001,"15min":2.8250000000000002},"min":{"1min":2.0190000000000001,"5min":1.03,"15min":1.03},"max":{"1min":3.915,"5min":4.7329999999999997,"15min":4.7549999999999999},"last":2.532},{"interface":"front","average":{"1min":3.4950000000000001,"5min":3.0960000000000001,"15min":3.2389999999999999},"min":{"1min":1.6859999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"max":{"1min":5.3700000000000001,"5min":5.3700000000000001,"15min":5.625},"last":3.1259999999999999}]},{"osd":7,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":3.1659999999999999,"5min":3.0800000000000001,"15min":3.157},"min":{"1min":2.2429999999999999,"5min":1.244,"15min":1.244},"max":{"1min":4.0490000000000004,"5min":4.585,"15min":6.5389999999999997},"last":3.9700000000000002},{"interface":"front","average":{"1min":3.0670000000000002,"5min":2.9460000000000002,"15min":3.1040000000000001},"min":{"1min":2.4809999999999999,"5min":1.24,"15min":1.24},"max":{"1min":4.5129999999999999,"5min":4.6740000000000004,"15min":5.1699999999999999},"last":2.9300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050692,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321148,"statfs":{"total":96636764160,"available":95560855552,"internally_reserved":1073741824,"allocated":2158592,"data_stored":1011097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.534,"15min":1.5940000000000001},"min":{"1min":0.99199999999999999,"5min":0.78900000000000003,"15min":0.78100000000000003},"max":{"1min":1.917,"5min":2.1930000000000001,"15min":5.6319999999999997},"last":1.601},{"interface":"front","average":{"1min":1.714,"5min":1.7070000000000001,"15min":1.677},"min":{"1min":1.0760000000000001,"5min":0.625,"15min":0.625},"max":{"1min":2.0990000000000002,"5min":3.0099999999999998,"15min":3.9409999999999998},"last":1.4330000000000001}]},{"osd":1,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":2.1680000000000001,"5min":4.0199999999999996,"15min":2.7679999999999998},"min":{"1min":1.3280000000000001,"5min":1.0649999999999999,"15min":0.74199999999999999},"max":{"1min":2.6640000000000001,"5min":190.321,"15min":190.321},"last":2.2450000000000001},{"interface":"front","average":{"1min":2.3919999999999999,"5min":4.2549999999999999,"15min":2.9780000000000002},"min":{"1min":1.605,"5min":0.75700000000000001,"15min":0.65400000000000003},"max":{"1min":3.1890000000000001,"5min":190.46199999999999,"15min":190.46199999999999},"last":2.6789999999999998}]},{"osd":3,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":1.9379999999999999,"5min":1.9350000000000001,"15min":1.915},"min":{"1min":1.393,"5min":0.96599999999999997,"15min":0.68600000000000005},"max":{"1min":2.5960000000000001,"5min":3.3300000000000001,"15min":3.4329999999999998},"last":1.6910000000000001},{"interface":"front","average":{"1min":2.7080000000000002,"5min":2.5600000000000001,"15min":2.5800000000000001},"min":{"1min":1.7769999999999999,"5min":1.1259999999999999,"15min":1.0940000000000001},"max":{"1min":4.4189999999999996,"5min":4.4189999999999996,"15min":5.9409999999999998},"last":2.8439999999999999}]},{"osd":4,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":2.4929999999999999,"5min":2.3769999999999998,"15min":2.4140000000000001},"min":{"1min":1.321,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":3.4060000000000001,"5min":4.7169999999999996,"15min":5.0030000000000001},"last":1.889},{"interface":"front","average":{"1min":2.3079999999999998,"5min":2.2690000000000001,"15min":2.343},"min":{"1min":1.821,"5min":1.218,"15min":1.1779999999999999},"max":{"1min":2.931,"5min":3.7480000000000002,"15min":4.0270000000000001},"last":2.411}]},{"osd":5,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":3.0019999999999998,"5min":2.7440000000000002,"15min":2.7749999999999999},"min":{"1min":1.956,"5min":1.3939999999999999,"15min":1.3939999999999999},"max":{"1min":3.968,"5min":4.1200000000000001,"15min":5.766},"last":3.1120000000000001},{"interface":"front","average":{"1min":2.835,"5min":2.8119999999999998,"15min":2.843},"min":{"1min":1.472,"5min":1.21,"15min":0.96799999999999997},"max":{"1min":3.899,"5min":5.1319999999999997,"15min":5.1319999999999997},"last":2.3450000000000002}]},{"osd":6,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":2.7000000000000002,"5min":2.6970000000000001,"15min":2.7330000000000001},"min":{"1min":1.512,"5min":1.512,"15min":1.0209999999999999},"max":{"1min":4.0949999999999998,"5min":4.7030000000000003,"15min":4.7030000000000003},"last":2.1389999999999998},{"interface":"front","average":{"1min":3.1739999999999999,"5min":3.0409999999999999,"15min":3.1160000000000001},"min":{"1min":2.2080000000000002,"5min":1.45,"15min":1.45},"max":{"1min":4.2560000000000002,"5min":4.2560000000000002,"15min":5.8499999999999996},"last":3.3620000000000001}]},{"osd":7,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":3.1789999999999998,"5min":3.1299999999999999,"15min":3.1920000000000002},"min":{"1min":1.873,"5min":1.516,"15min":1.2450000000000001},"max":{"1min":4.4020000000000001,"5min":5.399,"15min":5.4880000000000004},"last":2.9089999999999998},{"interface":"front","average":{"1min":3.0819999999999999,"5min":2.9569999999999999,"15min":3.0350000000000001},"min":{"1min":1.6679999999999999,"5min":1.385,"15min":1.385},"max":{"1min":4.0279999999999996,"5min":4.4800000000000004,"15min":4.4800000000000004},"last":2.7869999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575000,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050696,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321144,"statfs":{"total":96636764160,"available":95560851456,"internally_reserved":1073741824,"allocated":2162688,"data_stored":1011689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":1.8700000000000001,"5min":1.952,"15min":1.8819999999999999},"min":{"1min":1.4510000000000001,"5min":0.874,"15min":0.874},"max":{"1min":3.4430000000000001,"5min":14.193,"15min":14.193},"last":2.1299999999999999},{"interface":"front","average":{"1min":2.1429999999999998,"5min":2.226,"15min":2.222},"min":{"1min":1.526,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":3.7599999999999998,"5min":9.3300000000000001,"15min":9.3300000000000001},"last":1.992}]},{"osd":2,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":1.7969999999999999,"5min":1.891,"15min":1.8180000000000001},"min":{"1min":1.0669999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.6040000000000001,"5min":6.5709999999999997,"15min":6.5709999999999997},"last":1.7290000000000001},{"interface":"front","average":{"1min":2.625,"5min":2.613,"15min":2.5790000000000002},"min":{"1min":1.5369999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":3.4750000000000001,"5min":7.8700000000000001,"15min":9.1050000000000004},"last":3.028}]},{"osd":3,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":2.2040000000000002,"5min":2.3410000000000002,"15min":2.2999999999999998},"min":{"1min":1.1679999999999999,"5min":1.016,"15min":0.995},"max":{"1min":3.0819999999999999,"5min":8.8140000000000001,"15min":9.3629999999999995},"last":2.3769999999999998},{"interface":"front","average":{"1min":2.1960000000000002,"5min":2.2050000000000001,"15min":2.2029999999999998},"min":{"1min":1.234,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":3.0710000000000002,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":2.7759999999999998}]},{"osd":4,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":2.2730000000000001,"5min":2.3929999999999998,"15min":2.46},"min":{"1min":1.468,"5min":1.2210000000000001,"15min":1.103},"max":{"1min":3.294,"5min":6.3460000000000001,"15min":6.3460000000000001},"last":2.302},{"interface":"front","average":{"1min":2.7509999999999999,"5min":2.7450000000000001,"15min":2.8199999999999998},"min":{"1min":1.9370000000000001,"5min":1.464,"15min":1.464},"max":{"1min":3.6360000000000001,"5min":8.6489999999999991,"15min":8.7929999999999993},"last":3.4729999999999999}]},{"osd":5,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":2.585,"5min":2.6600000000000001,"15min":2.6960000000000002},"min":{"1min":1.4039999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":3.6179999999999999,"5min":8.6539999999999999,"15min":8.6539999999999999},"last":4.024},{"interface":"front","average":{"1min":2.778,"5min":2.7829999999999999,"15min":2.8719999999999999},"min":{"1min":2.0369999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":3.7360000000000002,"5min":5.867,"15min":5.867},"last":2.718}]},{"osd":6,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":2.875,"5min":2.9860000000000002,"15min":3.0110000000000001},"min":{"1min":1.889,"5min":1.4059999999999999,"15min":1.1659999999999999},"max":{"1min":3.46,"5min":8.8859999999999992,"15min":8.8859999999999992},"last":3.2469999999999999},{"interface":"front","average":{"1min":3.0819999999999999,"5min":3.0299999999999998,"15min":3.1110000000000002},"min":{"1min":2.1179999999999999,"5min":0.997,"15min":0.997},"max":{"1min":4.2489999999999997,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":3.1160000000000001}]},{"osd":7,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":3.181,"5min":3.2170000000000001,"15min":3.2480000000000002},"min":{"1min":2.5419999999999998,"5min":1.337,"15min":1.337},"max":{"1min":4.056,"5min":8.0470000000000006,"15min":8.9339999999999993},"last":3.8839999999999999},{"interface":"front","average":{"1min":3.2050000000000001,"5min":3.2749999999999999,"15min":3.3250000000000002},"min":{"1min":1.75,"5min":1.5649999999999999,"15min":1.5649999999999999},"max":{"1min":3.8359999999999999,"5min":9.1020000000000003,"15min":9.1020000000000003},"last":3.6120000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575000,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050772,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321068,"statfs":{"total":96636764160,"available":95560773632,"internally_reserved":1073741824,"allocated":2240512,"data_stored":1076076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":1.887,"5min":1.9330000000000001,"15min":1.8620000000000001},"min":{"1min":1.036,"5min":0.69899999999999995,"15min":0.67600000000000005},"max":{"1min":3.0369999999999999,"5min":8.9559999999999995,"15min":8.9559999999999995},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.724,"5min":1.738,"15min":1.762},"min":{"1min":1.052,"5min":0.78300000000000003,"15min":0.64900000000000002},"max":{"1min":2.8730000000000002,"5min":6.1689999999999996,"15min":6.1689999999999996},"last":1.486}]},{"osd":2,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":2.0840000000000001,"5min":2.004,"15min":1.9910000000000001},"min":{"1min":1.3600000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.855,"5min":4.8810000000000002,"15min":5.3090000000000002},"last":1.774},{"interface":"front","average":{"1min":2.3769999999999998,"5min":2.323,"15min":2.4129999999999998},"min":{"1min":1.2829999999999999,"5min":1.127,"15min":1.0289999999999999},"max":{"1min":3.194,"5min":3.6789999999999998,"15min":6.1189999999999998},"last":2.0070000000000001}]},{"osd":3,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":1.988,"5min":1.9319999999999999,"15min":1.946},"min":{"1min":1.3380000000000001,"5min":0.85799999999999998,"15min":0.82899999999999996},"max":{"1min":2.9380000000000002,"5min":3.3650000000000002,"15min":3.875},"last":1.6919999999999999},{"interface":"front","average":{"1min":2.8559999999999999,"5min":2.6880000000000002,"15min":2.7570000000000001},"min":{"1min":1.9970000000000001,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":3.4390000000000001,"5min":5.9550000000000001,"15min":5.9550000000000001},"last":3.1560000000000001}]},{"osd":4,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":2.1699999999999999,"5min":2.4089999999999998,"15min":2.4809999999999999},"min":{"1min":1.25,"5min":1.25,"15min":1.0940000000000001},"max":{"1min":3.2629999999999999,"5min":4.3879999999999999,"15min":5.9969999999999999},"last":2.2850000000000001},{"interface":"front","average":{"1min":2.3900000000000001,"5min":2.4620000000000002,"15min":2.4700000000000002},"min":{"1min":1.669,"5min":1.345,"15min":0.92700000000000005},"max":{"1min":3.4060000000000001,"5min":4.0739999999999998,"15min":4.1070000000000002},"last":2.1280000000000001}]},{"osd":5,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":2.786,"5min":2.6059999999999999,"15min":2.6720000000000002},"min":{"1min":1.903,"5min":1.089,"15min":0.93600000000000005},"max":{"1min":3.698,"5min":3.9860000000000002,"15min":5.0919999999999996},"last":2.5619999999999998},{"interface":"front","average":{"1min":3.1200000000000001,"5min":3.153,"15min":3.302},"min":{"1min":2.109,"5min":1.488,"15min":1.3320000000000001},"max":{"1min":3.8620000000000001,"5min":6.1280000000000001,"15min":6.5119999999999996},"last":3.4049999999999998}]},{"osd":6,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":3.375,"5min":3.2690000000000001,"15min":3.4199999999999999},"min":{"1min":2.2999999999999998,"5min":1.8069999999999999,"15min":1.421},"max":{"1min":4.351,"5min":6.0430000000000001,"15min":6.8949999999999996},"last":3.661},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.8170000000000002,"15min":2.9510000000000001},"min":{"1min":1.7729999999999999,"5min":1.46,"15min":1.2969999999999999},"max":{"1min":3.718,"5min":4.6180000000000003,"15min":5.593},"last":2.8660000000000001}]},{"osd":7,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":3.0459999999999998,"5min":3.032,"15min":3.1160000000000001},"min":{"1min":1.923,"5min":1.613,"15min":1.3300000000000001},"max":{"1min":4.2699999999999996,"5min":4.6779999999999999,"15min":5.8239999999999998},"last":2.6619999999999999},{"interface":"front","average":{"1min":3.105,"5min":3.0089999999999999,"15min":3.0529999999999999},"min":{"1min":2.3420000000000001,"5min":1.3620000000000001,"15min":1.119},"max":{"1min":3.9470000000000001,"5min":4.4359999999999999,"15min":5.0890000000000004},"last":2.996}]}]}]}} 2020-05-18T21:39:09.945 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-05-18T21:39:10.045 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f21049e0700 1 Processor -- start 2020-05-18T21:39:10.046 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f21049e0700 1 -- start start 2020-05-18T21:39:10.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f21049e0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2100064fd0 0x7f210014d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:10.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f21049e0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f210014a330 con 0x7f210005f110 2020-05-18T21:39:10.050 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f21049e0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f210014a5d0 con 0x7f21000b4760 2020-05-18T21:39:10.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f21049e0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f210014a140 con 0x7f2100064fd0 2020-05-18T21:39:10.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20ff7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f210005f110 0x7f210014aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39648/0 (socket says 172.21.15.63:39648) 2020-05-18T21:39:10.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20ff7fe700 1 -- 172.21.15.63:0/414910082 learned_addr learned my addr 172.21.15.63:0/414910082 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:10.051 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20fffff700 1 --2- 172.21.15.63:0/414910082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2100064fd0 0x7f210014d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:10.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20feffd700 1 -- 172.21.15.63:0/414910082 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431752636 0 0) 0x7f210014a330 con 0x7f210005f110 2020-05-18T21:39:10.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20feffd700 1 -- 172.21.15.63:0/414910082 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20e0003270 con 0x7f210005f110 2020-05-18T21:39:10.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20feffd700 1 -- 172.21.15.63:0/414910082 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 26240413 0 0) 0x7f20e0003270 con 0x7f210005f110 2020-05-18T21:39:10.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20feffd700 1 -- 172.21.15.63:0/414910082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2100064fd0 msgr2=0x7f210014d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:10.052 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20feffd700 1 --2- 172.21.15.63:0/414910082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2100064fd0 0x7f210014d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:10.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20feffd700 1 -- 172.21.15.63:0/414910082 >> v1:172.21.15.155:6789/0 conn(0x7f21000b4760 legacy=0x7f21000648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:10.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20feffd700 1 -- 172.21.15.63:0/414910082 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2100063430 con 0x7f210005f110 2020-05-18T21:39:10.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20feffd700 1 -- 172.21.15.63:0/414910082 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f20f0001730 con 0x7f210005f110 2020-05-18T21:39:10.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20feffd700 1 -- 172.21.15.63:0/414910082 >> v1:172.21.15.63:6789/0 conn(0x7f210005f110 legacy=0x7f210014aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:10.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20feffd700 1 --2- 172.21.15.63:0/414910082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2100064fd0 0x7f20e0003790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:10.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20feffd700 1 --2- 172.21.15.63:0/414910082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20e0003bf0 0x7f20e0004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:10.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20feffd700 1 --2- 172.21.15.63:0/414910082 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20e0004620 0x7f20e0004aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:10.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20feffd700 1 -- 172.21.15.63:0/414910082 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e0005020 con 0x7f20e0003bf0 2020-05-18T21:39:10.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20feffd700 1 -- 172.21.15.63:0/414910082 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e0005190 con 0x7f20e0004620 2020-05-18T21:39:10.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20feffd700 1 -- 172.21.15.63:0/414910082 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e0005350 con 0x7f2100064fd0 2020-05-18T21:39:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20f7fff700 1 --2- 172.21.15.63:0/414910082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20e0003bf0 0x7f20e0004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20ff7fe700 1 --2- 172.21.15.63:0/414910082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2100064fd0 0x7f20e0003790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20fffff700 1 --2- 172.21.15.63:0/414910082 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20e0004620 0x7f20e0004aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20f7fff700 1 -- 172.21.15.63:0/414910082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2100064fd0 msgr2=0x7f20e0003790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:10.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20f7fff700 1 --2- 172.21.15.63:0/414910082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2100064fd0 0x7f20e0003790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:10.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20f7fff700 1 -- 172.21.15.63:0/414910082 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20e0004620 msgr2=0x7f20e0004aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:10.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20f7fff700 1 --2- 172.21.15.63:0/414910082 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20e0004620 0x7f20e0004aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:10.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20f7fff700 1 -- 172.21.15.63:0/414910082 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e0003270 con 0x7f20e0003bf0 2020-05-18T21:39:10.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20f7fff700 1 --2- 172.21.15.63:0/414910082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20e0003bf0 0x7f20e0004050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f20e00054e0 tx=0x7f20e800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:10.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20f7fff700 1 --2- 172.21.15.63:0/414910082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20e0003bf0 0x7f20e0004050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f20e00054e0 tx=0x7f20e800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:10.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20f7fff700 1 --2- 172.21.15.63:0/414910082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20e0003bf0 0x7f20e0004050 secure :-1 s=READY pgs=2260 cs=0 l=1 rx=0x7f20e00054e0 tx=0x7f20e800fd20).ready entity=mon.0 client_cookie=124a9951f6059c1e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:10.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20f7fff700 1 --2- 172.21.15.63:0/414910082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20e0003bf0 0x7f20e0004050 secure :-1 s=THROTTLE_DONE pgs=2260 cs=0 l=1 rx=0x7f20e00054e0 tx=0x7f20e800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:10.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20feffd700 1 -- 172.21.15.63:0/414910082 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20e8003560 con 0x7f20e0003bf0 2020-05-18T21:39:10.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20f7fff700 1 --2- 172.21.15.63:0/414910082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20e0003bf0 0x7f20e0004050 secure :-1 s=THROTTLE_DONE pgs=2260 cs=0 l=1 rx=0x7f20e00054e0 tx=0x7f20e800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:10.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20f7fff700 1 --2- 172.21.15.63:0/414910082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20e0003bf0 0x7f20e0004050 secure :-1 s=THROTTLE_DONE pgs=2260 cs=0 l=1 rx=0x7f20e00054e0 tx=0x7f20e800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:10.058 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20feffd700 1 -- 172.21.15.63:0/414910082 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e8003700 con 0x7f20e0003bf0 2020-05-18T21:39:10.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f20feffd700 1 -- 172.21.15.63:0/414910082 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20e8003ae0 con 0x7f20e0003bf0 2020-05-18T21:39:10.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.040+0000 7f21049e0700 1 -- 172.21.15.63:0/414910082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20e0003bf0 msgr2=0x7f20e0004050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:10.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.044+0000 7f21049e0700 1 --2- 172.21.15.63:0/414910082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20e0003bf0 0x7f20e0004050 secure :-1 s=READY pgs=2260 cs=0 l=1 rx=0x7f20e00054e0 tx=0x7f20e800fd20).stop 2020-05-18T21:39:10.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.044+0000 7f20fffff700 1 -- 172.21.15.63:0/414910082 reap_dead start 2020-05-18T21:39:10.059 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.044+0000 7f21049e0700 1 -- 172.21.15.63:0/414910082 shutdown_connections 2020-05-18T21:39:10.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.044+0000 7f21049e0700 1 -- 172.21.15.63:0/414910082 >> 172.21.15.63:0/414910082 conn(0x7f2100069fc0 msgr2=0x7f210006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:10.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.044+0000 7f21049e0700 1 -- 172.21.15.63:0/414910082 shutdown_connections 2020-05-18T21:39:10.060 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.044+0000 7f21049e0700 1 -- 172.21.15.63:0/414910082 wait complete. 2020-05-18T21:39:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.044+0000 7f21049e0700 1 Processor -- start 2020-05-18T21:39:10.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.044+0000 7f21049e0700 1 -- start start 2020-05-18T21:39:10.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.044+0000 7f21049e0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2100157980 0x7f2100157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:10.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.044+0000 7f21049e0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f210015a9a0 0x7f210015adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:10.066 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.044+0000 7f21049e0700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21001470f0 con 0x7f21000b6e80 2020-05-18T21:39:10.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.044+0000 7f21049e0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21001574e0 con 0x7f2100157980 2020-05-18T21:39:10.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.044+0000 7f21049e0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2100148f20 con 0x7f210015a9a0 2020-05-18T21:39:10.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.044+0000 7f20f7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2100157980 0x7f2100157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:10.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.044+0000 7f20ff7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f21000b6e80 0x7f2100148810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39660/0 (socket says 172.21.15.63:39660) 2020-05-18T21:39:10.067 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.044+0000 7f20ff7fe700 1 -- 172.21.15.63:0/1316628980 learned_addr learned my addr 172.21.15.63:0/1316628980 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:10.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20fffff700 1 --2- 172.21.15.63:0/1316628980 >> v2:172.21.15.155:3300/0 conn(0x7f210015a9a0 0x7f210015adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:10.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20f7fff700 1 -- 172.21.15.63:0/1316628980 >> v2:172.21.15.155:3300/0 conn(0x7f210015a9a0 msgr2=0x7f210015adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:10.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20f7fff700 1 --2- 172.21.15.63:0/1316628980 >> v2:172.21.15.155:3300/0 conn(0x7f210015a9a0 0x7f210015adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:10.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20fd7fa700 1 -- 172.21.15.63:0/1316628980 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118939939 0 0) 0x7f21001470f0 con 0x7f21000b6e80 2020-05-18T21:39:10.068 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20f7fff700 1 -- 172.21.15.63:0/1316628980 >> v1:172.21.15.63:6789/0 conn(0x7f21000b6e80 legacy=0x7f2100148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:10.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20f7fff700 1 -- 172.21.15.63:0/1316628980 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2100158290 con 0x7f2100157980 2020-05-18T21:39:10.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20fffff700 1 --2- 172.21.15.63:0/1316628980 >> v2:172.21.15.155:3300/0 conn(0x7f210015a9a0 0x7f210015adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:39:10.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20f7fff700 1 --2- 172.21.15.63:0/1316628980 >> v2:172.21.15.63:3300/0 conn(0x7f2100157980 0x7f2100157e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2100148720 tx=0x7f20e800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:10.069 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20f7fff700 1 --2- 172.21.15.63:0/1316628980 >> v2:172.21.15.63:3300/0 conn(0x7f2100157980 0x7f2100157e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2100148720 tx=0x7f20e800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20f7fff700 1 --2- 172.21.15.63:0/1316628980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2100157980 0x7f2100157e30 secure :-1 s=READY pgs=2262 cs=0 l=1 rx=0x7f2100148720 tx=0x7f20e800fd20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20f7fff700 1 --2- 172.21.15.63:0/1316628980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2100157980 0x7f2100157e30 secure :-1 s=THROTTLE_DONE pgs=2262 cs=0 l=1 rx=0x7f2100148720 tx=0x7f20e800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20fd7fa700 1 -- 172.21.15.63:0/1316628980 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20e8008370 con 0x7f2100157980 2020-05-18T21:39:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20f7fff700 1 --2- 172.21.15.63:0/1316628980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2100157980 0x7f2100157e30 secure :-1 s=THROTTLE_DONE pgs=2262 cs=0 l=1 rx=0x7f2100148720 tx=0x7f20e800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20fd7fa700 1 -- 172.21.15.63:0/1316628980 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e80088d0 con 0x7f2100157980 2020-05-18T21:39:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20f7fff700 1 --2- 172.21.15.63:0/1316628980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2100157980 0x7f2100157e30 secure :-1 s=THROTTLE_DONE pgs=2262 cs=0 l=1 rx=0x7f2100148720 tx=0x7f20e800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f21049e0700 1 -- 172.21.15.63:0/1316628980 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21000b7260 con 0x7f2100157980 2020-05-18T21:39:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20fd7fa700 1 -- 172.21.15.63:0/1316628980 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20e8008cf0 con 0x7f2100157980 2020-05-18T21:39:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f21049e0700 1 -- 172.21.15.63:0/1316628980 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2100149d60 con 0x7f2100157980 2020-05-18T21:39:10.071 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20f7fff700 1 --2- 172.21.15.63:0/1316628980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2100157980 0x7f2100157e30 secure :-1 s=THROTTLE_DONE pgs=2262 cs=0 l=1 rx=0x7f2100148720 tx=0x7f20e800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f21049e0700 1 -- 172.21.15.63:0/1316628980 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21000569e0 con 0x7f2100157980 2020-05-18T21:39:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20fd7fa700 1 -- 172.21.15.63:0/1316628980 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f20e8006520 con 0x7f2100157980 2020-05-18T21:39:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20f7fff700 1 --2- 172.21.15.63:0/1316628980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2100157980 0x7f2100157e30 secure :-1 s=THROTTLE_DONE pgs=2262 cs=0 l=1 rx=0x7f2100148720 tx=0x7f20e800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20fd7fa700 1 --2- 172.21.15.63:0/1316628980 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f20e404f7d0 0x7f20e4051c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:10.072 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.048+0000 7f20fd7fa700 1 -- 172.21.15.63:0/1316628980 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f20e8064680 con 0x7f2100157980 2020-05-18T21:39:10.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.052+0000 7f20ff7fe700 1 --2- 172.21.15.63:0/1316628980 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f20e404f7d0 0x7f20e4051c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:10.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.052+0000 7f20ff7fe700 1 --2- 172.21.15.63:0/1316628980 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f20e404f7d0 0x7f20e4051c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f20f00014c0 tx=0x7f21000635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:10.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.052+0000 7f20ff7fe700 1 --2- 172.21.15.63:0/1316628980 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f20e404f7d0 0x7f20e4051c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f20f00014c0 tx=0x7f21000635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:10.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.052+0000 7f20ff7fe700 1 --2- 172.21.15.63:0/1316628980 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f20e404f7d0 0x7f20e4051c90 secure :-1 s=READY pgs=886 cs=0 l=1 rx=0x7f20f00014c0 tx=0x7f21000635c0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:10.073 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.056+0000 7f20f7fff700 1 --2- 172.21.15.63:0/1316628980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2100157980 0x7f2100157e30 secure :-1 s=THROTTLE_DONE pgs=2262 cs=0 l=1 rx=0x7f2100148720 tx=0x7f20e800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:10.074 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.056+0000 7f20fd7fa700 1 -- 172.21.15.63:0/1316628980 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f20e803ead0 con 0x7f2100157980 2020-05-18T21:39:10.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.172+0000 7f21049e0700 1 -- 172.21.15.63:0/1316628980 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21000625f0 con 0x7f2100157980 2020-05-18T21:39:10.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.176+0000 7f20f7fff700 1 --2- 172.21.15.63:0/1316628980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2100157980 0x7f2100157e30 secure :-1 s=THROTTLE_DONE pgs=2262 cs=0 l=1 rx=0x7f2100148720 tx=0x7f20e800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:10.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.176+0000 7f20fd7fa700 1 -- 172.21.15.63:0/1316628980 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) v1 ==== 74+0+16170 (secure 0 0 0) 0x7f20e80420f0 con 0x7f2100157980 2020-05-18T21:39:10.183 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:39:10.183 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":169,"fsid":"463d54c2-4027-4807-bf42-f25cd6c63d51","created":"2020-05-18T21:26:28.798650+0000","modified":"2020-05-18T21:39:03.814988+0000","last_up_change":"2020-05-18T21:26:36.039314+0000","last_in_change":"2020-05-18T21:26:36.039314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-05-18T21:26:33.080792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-05-18T21:26:40.149370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2020-05-18T21:38:28.730444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2020-05-18T21:38:29.414568+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":168,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6ae0fbf-604c-4e8d-b1b8-6038821420e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":12803},{"type":"v1","addr":"172.21.15.63:6801","nonce":12803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":12803},{"type":"v1","addr":"172.21.15.63:6803","nonce":12803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":12803},{"type":"v1","addr":"172.21.15.63:6807","nonce":12803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":12803},{"type":"v1","addr":"172.21.15.63:6805","nonce":12803}]},"public_addr":"172.21.15.63:6801/12803","cluster_addr":"172.21.15.63:6803/12803","heartbeat_back_addr":"172.21.15.63:6807/12803","heartbeat_front_addr":"172.21.15.63:6805/12803","state":["exists","up"]},{"osd":1,"uuid":"f7ee2d2d-5bec-408a-a0c7-b95ba5bfe6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":12804},{"type":"v1","addr":"172.21.15.63:6809","nonce":12804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":12804},{"type":"v1","addr":"172.21.15.63:6811","nonce":12804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":12804},{"type":"v1","addr":"172.21.15.63:6817","nonce":12804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":12804},{"type":"v1","addr":"172.21.15.63:6813","nonce":12804}]},"public_addr":"172.21.15.63:6809/12804","cluster_addr":"172.21.15.63:6811/12804","heartbeat_back_addr":"172.21.15.63:6817/12804","heartbeat_front_addr":"172.21.15.63:6813/12804","state":["exists","up"]},{"osd":2,"uuid":"ec8d9fa9-dae9-45f6-b286-735ab3801c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":12806},{"type":"v1","addr":"172.21.15.63:6824","nonce":12806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":12806},{"type":"v1","addr":"172.21.15.63:6827","nonce":12806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":12806},{"type":"v1","addr":"172.21.15.63:6831","nonce":12806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":12806},{"type":"v1","addr":"172.21.15.63:6829","nonce":12806}]},"public_addr":"172.21.15.63:6824/12806","cluster_addr":"172.21.15.63:6827/12806","heartbeat_back_addr":"172.21.15.63:6831/12806","heartbeat_front_addr":"172.21.15.63:6829/12806","state":["exists","up"]},{"osd":3,"uuid":"1030fedf-adad-4e79-b839-59385d4d7d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":12805},{"type":"v1","addr":"172.21.15.63:6816","nonce":12805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":12805},{"type":"v1","addr":"172.21.15.63:6819","nonce":12805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":12805},{"type":"v1","addr":"172.21.15.63:6825","nonce":12805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":12805},{"type":"v1","addr":"172.21.15.63:6821","nonce":12805}]},"public_addr":"172.21.15.63:6816/12805","cluster_addr":"172.21.15.63:6819/12805","heartbeat_back_addr":"172.21.15.63:6825/12805","heartbeat_front_addr":"172.21.15.63:6821/12805","state":["exists","up"]},{"osd":4,"uuid":"8ad15a9b-97b4-4002-b1d4-7292e09b4ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":13023},{"type":"v1","addr":"172.21.15.155:6801","nonce":13023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":13023},{"type":"v1","addr":"172.21.15.155:6803","nonce":13023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":13023},{"type":"v1","addr":"172.21.15.155:6807","nonce":13023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":13023},{"type":"v1","addr":"172.21.15.155:6805","nonce":13023}]},"public_addr":"172.21.15.155:6801/13023","cluster_addr":"172.21.15.155:6803/13023","heartbeat_back_addr":"172.21.15.155:6807/13023","heartbeat_front_addr":"172.21.15.155:6805/13023","state":["exists","up"]},{"osd":5,"uuid":"0dce88f8-b984-43e1-95e2-4132171102d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":13024},{"type":"v1","addr":"172.21.15.155:6809","nonce":13024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":13024},{"type":"v1","addr":"172.21.15.155:6811","nonce":13024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":13024},{"type":"v1","addr":"172.21.15.155:6816","nonce":13024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":13024},{"type":"v1","addr":"172.21.15.155:6813","nonce":13024}]},"public_addr":"172.21.15.155:6809/13024","cluster_addr":"172.21.15.155:6811/13024","heartbeat_back_addr":"172.21.15.155:6816/13024","heartbeat_front_addr":"172.21.15.155:6813/13024","state":["exists","up"]},{"osd":6,"uuid":"e1bc92f8-3692-4483-b0fb-905c94fa1469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":13025},{"type":"v1","addr":"172.21.15.155:6817","nonce":13025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":13025},{"type":"v1","addr":"172.21.15.155:6819","nonce":13025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":13025},{"type":"v1","addr":"172.21.15.155:6824","nonce":13025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":13025},{"type":"v1","addr":"172.21.15.155:6821","nonce":13025}]},"public_addr":"172.21.15.155:6817/13025","cluster_addr":"172.21.15.155:6819/13025","heartbeat_back_addr":"172.21.15.155:6824/13025","heartbeat_front_addr":"172.21.15.155:6821/13025","state":["exists","up"]},{"osd":7,"uuid":"b76e000c-a078-48c4-9e1e-34d286a9992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":13026},{"type":"v1","addr":"172.21.15.155:6825","nonce":13026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":13026},{"type":"v1","addr":"172.21.15.155:6827","nonce":13026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":13026},{"type":"v1","addr":"172.21.15.155:6831","nonce":13026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":13026},{"type":"v1","addr":"172.21.15.155:6829","nonce":13026}]},"public_addr":"172.21.15.155:6825/13026","cluster_addr":"172.21.15.155:6827/13026","heartbeat_back_addr":"172.21.15.155:6831/13026","heartbeat_front_addr":"172.21.15.155:6829/13026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.281434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.608518+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.582386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.573488+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.604174+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.371004+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.593070+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-05-18T21:26:34.667677+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":32,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{}} 2020-05-18T21:39:10.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.176+0000 7f21049e0700 1 -- 172.21.15.63:0/1316628980 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f20e404f7d0 msgr2=0x7f20e4051c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:10.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.176+0000 7f21049e0700 1 --2- 172.21.15.63:0/1316628980 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f20e404f7d0 0x7f20e4051c90 secure :-1 s=READY pgs=886 cs=0 l=1 rx=0x7f20f00014c0 tx=0x7f21000635c0).stop 2020-05-18T21:39:10.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.176+0000 7f21049e0700 1 -- 172.21.15.63:0/1316628980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2100157980 msgr2=0x7f2100157e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:10.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.176+0000 7f21049e0700 1 --2- 172.21.15.63:0/1316628980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2100157980 0x7f2100157e30 secure :-1 s=READY pgs=2262 cs=0 l=1 rx=0x7f2100148720 tx=0x7f20e800fd20).stop 2020-05-18T21:39:10.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.176+0000 7f21049e0700 1 -- 172.21.15.63:0/1316628980 shutdown_connections 2020-05-18T21:39:10.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.176+0000 7f21049e0700 1 --2- 172.21.15.63:0/1316628980 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f20e404f7d0 0x7f20e4051c90 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:10.185 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.176+0000 7f21049e0700 1 --2- 172.21.15.63:0/1316628980 >> v2:172.21.15.155:3300/0 conn(0x7f210015a9a0 0x7f210015adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.176+0000 7f21049e0700 1 --2- 172.21.15.63:0/1316628980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2100157980 0x7f2100157e30 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.176+0000 7f21049e0700 1 -- 172.21.15.63:0/1316628980 >> 172.21.15.63:0/1316628980 conn(0x7f2100069fc0 msgr2=0x7f21001434b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.176+0000 7f21049e0700 1 -- 172.21.15.63:0/1316628980 shutdown_connections 2020-05-18T21:39:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:10.176+0000 7f21049e0700 1 -- 172.21.15.63:0/1316628980 wait complete. 2020-05-18T21:39:11.195 INFO:tasks.ceph:Scrubbing osd.0 2020-05-18T21:39:11.196 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 config set osd_debug_deep_scrub_sleep 0 2020-05-18T21:39:11.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.308+0000 7fe14038d700 1 Processor -- start 2020-05-18T21:39:11.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.308+0000 7fe14038d700 1 -- start start 2020-05-18T21:39:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.308+0000 7fe14038d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe138062d30 0x7fe1380637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:11.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.308+0000 7fe14038d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe138061ed0 0x7fe138145500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:11.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.308+0000 7fe14038d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1380af610 con 0x7fe138145960 2020-05-18T21:39:11.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.308+0000 7fe14038d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe138062330 con 0x7fe138062d30 2020-05-18T21:39:11.317 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.308+0000 7fe14038d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1380af8b0 con 0x7fe138061ed0 2020-05-18T21:39:11.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.308+0000 7fe13e129700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe138062d30 0x7fe1380637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.308+0000 7fe13e129700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe138062d30 0x7fe1380637c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37480/0 (socket says 172.21.15.63:37480) 2020-05-18T21:39:11.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.308+0000 7fe13e129700 1 -- 172.21.15.63:0/3221340377 learned_addr learned my addr 172.21.15.63:0/3221340377 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:11.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.308+0000 7fe13d928700 1 --2- 172.21.15.63:0/3221340377 >> v2:172.21.15.155:3300/0 conn(0x7fe138061ed0 0x7fe138145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe13e129700 1 -- 172.21.15.63:0/3221340377 >> v2:172.21.15.155:3300/0 conn(0x7fe138061ed0 msgr2=0x7fe138145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:11.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe13e129700 1 --2- 172.21.15.63:0/3221340377 >> v2:172.21.15.155:3300/0 conn(0x7fe138061ed0 0x7fe138145500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:11.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe13e129700 1 -- 172.21.15.63:0/3221340377 >> v1:172.21.15.155:6789/0 conn(0x7fe138145960 legacy=0x7fe13805ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe13e129700 1 -- 172.21.15.63:0/3221340377 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1380afb50 con 0x7fe138062d30 2020-05-18T21:39:11.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe13e129700 1 --2- 172.21.15.63:0/3221340377 >> v2:172.21.15.63:3300/0 conn(0x7fe138062d30 0x7fe1380637c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe128002f70 tx=0x7fe128007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe13e129700 1 --2- 172.21.15.63:0/3221340377 >> v2:172.21.15.63:3300/0 conn(0x7fe138062d30 0x7fe1380637c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe128002f70 tx=0x7fe128007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.321 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe13e129700 1 --2- 172.21.15.63:0/3221340377 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe138062d30 0x7fe1380637c0 secure :-1 s=READY pgs=2263 cs=0 l=1 rx=0x7fe128002f70 tx=0x7fe128007a80).ready entity=mon.0 client_cookie=a9c981e5b1bab830 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe13e129700 1 --2- 172.21.15.63:0/3221340377 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe138062d30 0x7fe1380637c0 secure :-1 s=THROTTLE_DONE pgs=2263 cs=0 l=1 rx=0x7fe128002f70 tx=0x7fe128007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe13e129700 1 --2- 172.21.15.63:0/3221340377 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe138062d30 0x7fe1380637c0 secure :-1 s=THROTTLE_DONE pgs=2263 cs=0 l=1 rx=0x7fe128002f70 tx=0x7fe128007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe13d127700 1 -- 172.21.15.63:0/3221340377 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1280116b0 con 0x7fe138062d30 2020-05-18T21:39:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe13e129700 1 --2- 172.21.15.63:0/3221340377 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe138062d30 0x7fe1380637c0 secure :-1 s=THROTTLE_DONE pgs=2263 cs=0 l=1 rx=0x7fe128002f70 tx=0x7fe128007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe13d127700 1 -- 172.21.15.63:0/3221340377 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe128011810 con 0x7fe138062d30 2020-05-18T21:39:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe13d127700 1 -- 172.21.15.63:0/3221340377 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe128011c30 con 0x7fe138062d30 2020-05-18T21:39:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe14038d700 1 -- 172.21.15.63:0/3221340377 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe138062d30 msgr2=0x7fe1380637c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe14038d700 1 --2- 172.21.15.63:0/3221340377 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe138062d30 0x7fe1380637c0 secure :-1 s=READY pgs=2263 cs=0 l=1 rx=0x7fe128002f70 tx=0x7fe128007a80).stop 2020-05-18T21:39:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe14038d700 1 -- 172.21.15.63:0/3221340377 shutdown_connections 2020-05-18T21:39:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe14038d700 1 --2- 172.21.15.63:0/3221340377 >> v2:172.21.15.155:3300/0 conn(0x7fe138061ed0 0x7fe138145500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe14038d700 1 --2- 172.21.15.63:0/3221340377 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe138062d30 0x7fe1380637c0 unknown :-1 s=CLOSED pgs=2263 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe14038d700 1 -- 172.21.15.63:0/3221340377 >> 172.21.15.63:0/3221340377 conn(0x7fe1380b7050 msgr2=0x7fe1380b7460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe14038d700 1 -- 172.21.15.63:0/3221340377 shutdown_connections 2020-05-18T21:39:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe14038d700 1 -- 172.21.15.63:0/3221340377 wait complete. 2020-05-18T21:39:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe14038d700 1 Processor -- start 2020-05-18T21:39:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.312+0000 7fe14038d700 1 -- start start 2020-05-18T21:39:11.327 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe14038d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe138061ed0 0x7fe138156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:11.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe14038d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe138062d30 0x7fe1380b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:11.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe14038d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe138145960 0x7fe138152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:11.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe14038d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe138063310 con 0x7fe138145960 2020-05-18T21:39:11.328 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe14038d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1381573d0 con 0x7fe138061ed0 2020-05-18T21:39:11.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe14038d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe138157670 con 0x7fe138062d30 2020-05-18T21:39:11.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe13e92a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe138145960 0x7fe138152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe13e92a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe138145960 0x7fe138152d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37490/0 (socket says 172.21.15.63:37490) 2020-05-18T21:39:11.329 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe13e92a700 1 -- 172.21.15.63:0/2520539248 learned_addr learned my addr 172.21.15.63:0/2520539248 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:11.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe13e129700 1 --2- 172.21.15.63:0/2520539248 >> v2:172.21.15.155:3300/0 conn(0x7fe138061ed0 0x7fe138156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe13d928700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe138062d30 0x7fe1380b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe13e92a700 1 -- 172.21.15.63:0/2520539248 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe138062d30 msgr2=0x7fe1380b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe13e92a700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe138062d30 0x7fe1380b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:11.330 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe13e92a700 1 -- 172.21.15.63:0/2520539248 >> v2:172.21.15.155:3300/0 conn(0x7fe138061ed0 msgr2=0x7fe138156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe13e92a700 1 --2- 172.21.15.63:0/2520539248 >> v2:172.21.15.155:3300/0 conn(0x7fe138061ed0 0x7fe138156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:11.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe13e92a700 1 -- 172.21.15.63:0/2520539248 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe138157910 con 0x7fe138145960 2020-05-18T21:39:11.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe13e92a700 1 --2- 172.21.15.63:0/2520539248 >> v2:172.21.15.63:3300/0 conn(0x7fe138145960 0x7fe138152d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe1380ba500 tx=0x7fe13000c7a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.331 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe13e92a700 1 --2- 172.21.15.63:0/2520539248 >> v2:172.21.15.63:3300/0 conn(0x7fe138145960 0x7fe138152d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe1380ba500 tx=0x7fe13000c7a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe13e92a700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe138145960 0x7fe138152d40 secure :-1 s=READY pgs=2264 cs=0 l=1 rx=0x7fe1380ba500 tx=0x7fe13000c7a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:11.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe13e92a700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe138145960 0x7fe138152d40 secure :-1 s=THROTTLE_DONE pgs=2264 cs=0 l=1 rx=0x7fe1380ba500 tx=0x7fe13000c7a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe13e92a700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe138145960 0x7fe138152d40 secure :-1 s=THROTTLE_DONE pgs=2264 cs=0 l=1 rx=0x7fe1380ba500 tx=0x7fe13000c7a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe1277fe700 1 -- 172.21.15.63:0/2520539248 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1300101e0 con 0x7fe138145960 2020-05-18T21:39:11.332 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe13e92a700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe138145960 0x7fe138152d40 secure :-1 s=THROTTLE_DONE pgs=2264 cs=0 l=1 rx=0x7fe1380ba500 tx=0x7fe13000c7a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe1277fe700 1 -- 172.21.15.63:0/2520539248 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe130010340 con 0x7fe138145960 2020-05-18T21:39:11.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe14038d700 1 -- 172.21.15.63:0/2520539248 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe138157120 con 0x7fe138145960 2020-05-18T21:39:11.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe1277fe700 1 -- 172.21.15.63:0/2520539248 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe130010760 con 0x7fe138145960 2020-05-18T21:39:11.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe14038d700 1 -- 172.21.15.63:0/2520539248 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1381531a0 con 0x7fe138145960 2020-05-18T21:39:11.333 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe13e92a700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe138145960 0x7fe138152d40 secure :-1 s=THROTTLE_DONE pgs=2264 cs=0 l=1 rx=0x7fe1380ba500 tx=0x7fe13000c7a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe14038d700 1 -- 172.21.15.63:0/2520539248 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe138157b10 con 0x7fe138145960 2020-05-18T21:39:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe1277fe700 1 -- 172.21.15.63:0/2520539248 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fe1300068a0 con 0x7fe138145960 2020-05-18T21:39:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.316+0000 7fe13e92a700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe138145960 0x7fe138152d40 secure :-1 s=THROTTLE_DONE pgs=2264 cs=0 l=1 rx=0x7fe1380ba500 tx=0x7fe13000c7a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.320+0000 7fe13e92a700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe138145960 0x7fe138152d40 secure :-1 s=THROTTLE_DONE pgs=2264 cs=0 l=1 rx=0x7fe1380ba500 tx=0x7fe13000c7a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.320+0000 7fe1277fe700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe11804fb30 0x7fe118051ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.320+0000 7fe1277fe700 1 -- 172.21.15.63:0/2520539248 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe130063fa0 con 0x7fe138145960 2020-05-18T21:39:11.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.320+0000 7fe13e129700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe11804fb30 0x7fe118051ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.320+0000 7fe1277fe700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7fe1180567f0 0x7fe118058c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:11.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.320+0000 7fe1277fe700 1 -- 172.21.15.63:0/2520539248 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1180591f0 con 0x7fe1180567f0 2020-05-18T21:39:11.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.320+0000 7fe1277fe700 1 -- 172.21.15.63:0/2520539248 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=169) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe130065400 con 0x7fe138145960 2020-05-18T21:39:11.335 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.320+0000 7fe13d928700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7fe1180567f0 0x7fe118058c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.320+0000 7fe13e129700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe11804fb30 0x7fe118051ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe128002f70 tx=0x7fe128007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.320+0000 7fe13e129700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe11804fb30 0x7fe118051ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe128002f70 tx=0x7fe128007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.320+0000 7fe13e129700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe11804fb30 0x7fe118051ff0 secure :-1 s=READY pgs=887 cs=0 l=1 rx=0x7fe128002f70 tx=0x7fe128007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:11.336 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.320+0000 7fe13d928700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7fe1180567f0 0x7fe118058c10 crc :-1 s=READY pgs=50 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:11.337 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.320+0000 7fe1277fe700 1 -- 172.21.15.63:0/2520539248 <== osd.0 v2:172.21.15.63:6800/12803 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23263 (crc 0 0 0) 0x7fe1180591f0 con 0x7fe1180567f0 2020-05-18T21:39:11.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.340+0000 7fe14038d700 1 -- 172.21.15.63:0/2520539248 --> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe138153a20 con 0x7fe1180567f0 2020-05-18T21:39:11.346 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.340+0000 7fe1277fe700 1 -- 172.21.15.63:0/2520539248 <== osd.0 v2:172.21.15.63:6800/12803 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe138153a20 con 0x7fe1180567f0 2020-05-18T21:39:11.347 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:39:11.347 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-05-18T21:39:11.347 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:39:11.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.340+0000 7fe14038d700 1 -- 172.21.15.63:0/2520539248 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7fe1180567f0 msgr2=0x7fe118058c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.340+0000 7fe14038d700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.63:6800/12803,v1:172.21.15.63:6801/12803] conn(0x7fe1180567f0 0x7fe118058c10 crc :-1 s=READY pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:11.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.340+0000 7fe14038d700 1 -- 172.21.15.63:0/2520539248 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe11804fb30 msgr2=0x7fe118051ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.348 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.340+0000 7fe14038d700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fe11804fb30 0x7fe118051ff0 secure :-1 s=READY pgs=887 cs=0 l=1 rx=0x7fe128002f70 tx=0x7fe128007a80).stop 2020-05-18T21:39:11.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.340+0000 7fe14038d700 1 -- 172.21.15.63:0/2520539248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe138145960 msgr2=0x7fe138152d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.340+0000 7fe14038d700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe138145960 0x7fe138152d40 secure :-1 s=READY pgs=2264 cs=0 l=1 rx=0x7fe1380ba500 tx=0x7fe13000c7a0).stop 2020-05-18T21:39:11.349 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.340+0000 7fe13e92a700 1 -- 172.21.15.63:0/2520539248 reap_dead start 2020-05-18T21:39:11.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.344+0000 7fe14038d700 1 -- 172.21.15.63:0/2520539248 shutdown_connections 2020-05-18T21:39:11.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.344+0000 7fe14038d700 1 --2- 172.21.15.63:0/2520539248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe138145960 0x7fe138152d40 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:11.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.344+0000 7fe14038d700 1 -- 172.21.15.63:0/2520539248 >> 172.21.15.63:0/2520539248 conn(0x7fe1380b7050 msgr2=0x7fe13805c280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:11.350 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.344+0000 7fe14038d700 1 -- 172.21.15.63:0/2520539248 shutdown_connections 2020-05-18T21:39:11.351 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.344+0000 7fe14038d700 1 -- 172.21.15.63:0/2520539248 wait complete. 2020-05-18T21:39:11.362 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 0 2020-05-18T21:39:11.467 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.460+0000 7efd39104700 1 Processor -- start 2020-05-18T21:39:11.468 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.460+0000 7efd39104700 1 -- start start 2020-05-18T21:39:11.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.460+0000 7efd39104700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd340b5620 0x7efd3405bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:11.470 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.460+0000 7efd39104700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efd34061a00 0x7efd340650b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:11.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.460+0000 7efd39104700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd3414d890 con 0x7efd34065510 2020-05-18T21:39:11.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.460+0000 7efd39104700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd34060a80 con 0x7efd34061a00 2020-05-18T21:39:11.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.460+0000 7efd39104700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd340607e0 con 0x7efd340b5620 2020-05-18T21:39:11.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.460+0000 7efd337fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efd34061a00 0x7efd340650b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.471 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.460+0000 7efd337fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efd34061a00 0x7efd340650b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37496/0 (socket says 172.21.15.63:37496) 2020-05-18T21:39:11.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.460+0000 7efd337fe700 1 -- 172.21.15.63:0/1711044629 learned_addr learned my addr 172.21.15.63:0/1711044629 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:11.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.460+0000 7efd33fff700 1 --2- 172.21.15.63:0/1711044629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd340b5620 0x7efd3405bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.460+0000 7efd337fe700 1 -- 172.21.15.63:0/1711044629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd340b5620 msgr2=0x7efd3405bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:11.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd337fe700 1 --2- 172.21.15.63:0/1711044629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd340b5620 0x7efd3405bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:11.472 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd337fe700 1 -- 172.21.15.63:0/1711044629 >> v1:172.21.15.155:6789/0 conn(0x7efd34065510 legacy=0x7efd3414dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd337fe700 1 -- 172.21.15.63:0/1711044629 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd340b5a00 con 0x7efd34061a00 2020-05-18T21:39:11.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd33fff700 1 --2- 172.21.15.63:0/1711044629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd340b5620 0x7efd3405bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-05-18T21:39:11.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd337fe700 1 --2- 172.21.15.63:0/1711044629 >> v2:172.21.15.63:3300/0 conn(0x7efd34061a00 0x7efd340650b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efd24002f70 tx=0x7efd24007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd337fe700 1 --2- 172.21.15.63:0/1711044629 >> v2:172.21.15.63:3300/0 conn(0x7efd34061a00 0x7efd340650b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efd24002f70 tx=0x7efd24007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.473 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd337fe700 1 --2- 172.21.15.63:0/1711044629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd34061a00 0x7efd340650b0 secure :-1 s=READY pgs=2265 cs=0 l=1 rx=0x7efd24002f70 tx=0x7efd24007a80).ready entity=mon.0 client_cookie=6e7a2c4f73ff370c server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:11.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd337fe700 1 --2- 172.21.15.63:0/1711044629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd34061a00 0x7efd340650b0 secure :-1 s=THROTTLE_DONE pgs=2265 cs=0 l=1 rx=0x7efd24002f70 tx=0x7efd24007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd337fe700 1 --2- 172.21.15.63:0/1711044629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd34061a00 0x7efd340650b0 secure :-1 s=THROTTLE_DONE pgs=2265 cs=0 l=1 rx=0x7efd24002f70 tx=0x7efd24007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd32ffd700 1 -- 172.21.15.63:0/1711044629 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd24008e60 con 0x7efd34061a00 2020-05-18T21:39:11.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd337fe700 1 --2- 172.21.15.63:0/1711044629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd34061a00 0x7efd340650b0 secure :-1 s=THROTTLE_DONE pgs=2265 cs=0 l=1 rx=0x7efd24002f70 tx=0x7efd24007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.474 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd32ffd700 1 -- 172.21.15.63:0/1711044629 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd24011950 con 0x7efd34061a00 2020-05-18T21:39:11.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd32ffd700 1 -- 172.21.15.63:0/1711044629 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd24011d30 con 0x7efd34061a00 2020-05-18T21:39:11.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd39104700 1 -- 172.21.15.63:0/1711044629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd34061a00 msgr2=0x7efd340650b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd39104700 1 --2- 172.21.15.63:0/1711044629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd34061a00 0x7efd340650b0 secure :-1 s=READY pgs=2265 cs=0 l=1 rx=0x7efd24002f70 tx=0x7efd24007a80).stop 2020-05-18T21:39:11.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd39104700 1 -- 172.21.15.63:0/1711044629 shutdown_connections 2020-05-18T21:39:11.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd39104700 1 --2- 172.21.15.63:0/1711044629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd34061a00 0x7efd340650b0 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:11.475 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd39104700 1 --2- 172.21.15.63:0/1711044629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd340b5620 0x7efd3405bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:11.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd39104700 1 -- 172.21.15.63:0/1711044629 >> 172.21.15.63:0/1711044629 conn(0x7efd3409da60 msgr2=0x7efd3409de70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:11.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd39104700 1 -- 172.21.15.63:0/1711044629 shutdown_connections 2020-05-18T21:39:11.476 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd39104700 1 -- 172.21.15.63:0/1711044629 wait complete. 2020-05-18T21:39:11.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd39104700 1 Processor -- start 2020-05-18T21:39:11.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd39104700 1 -- start start 2020-05-18T21:39:11.479 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd39104700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd34061a00 0x7efd340b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:11.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd39104700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efd34065510 0x7efd34158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:11.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd39104700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efd340b5620 0x7efd3414b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:11.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd39104700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd341587c0 con 0x7efd34065510 2020-05-18T21:39:11.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd39104700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd340b01b0 con 0x7efd340b5620 2020-05-18T21:39:11.480 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.464+0000 7efd39104700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd340b1950 con 0x7efd34061a00 2020-05-18T21:39:11.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd337fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efd34065510 0x7efd34158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd337fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efd34065510 0x7efd34158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37504/0 (socket says 172.21.15.63:37504) 2020-05-18T21:39:11.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd337fe700 1 -- 172.21.15.63:0/3595779803 learned_addr learned my addr 172.21.15.63:0/3595779803 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:11.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd33fff700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd34061a00 0x7efd340b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.481 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd38903700 1 --2- 172.21.15.63:0/3595779803 >> v2:172.21.15.155:3300/0 conn(0x7efd340b5620 0x7efd3414b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd337fe700 1 -- 172.21.15.63:0/3595779803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd34061a00 msgr2=0x7efd340b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd337fe700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd34061a00 0x7efd340b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:11.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd337fe700 1 -- 172.21.15.63:0/3595779803 >> v2:172.21.15.155:3300/0 conn(0x7efd340b5620 msgr2=0x7efd3414b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd337fe700 1 --2- 172.21.15.63:0/3595779803 >> v2:172.21.15.155:3300/0 conn(0x7efd340b5620 0x7efd3414b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:11.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd337fe700 1 -- 172.21.15.63:0/3595779803 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd340b0450 con 0x7efd34065510 2020-05-18T21:39:11.482 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd38903700 1 --2- 172.21.15.63:0/3595779803 >> v2:172.21.15.155:3300/0 conn(0x7efd340b5620 0x7efd3414b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:39:11.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd337fe700 1 --2- 172.21.15.63:0/3595779803 >> v2:172.21.15.63:3300/0 conn(0x7efd34065510 0x7efd34158360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efd24002f70 tx=0x7efd24007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd337fe700 1 --2- 172.21.15.63:0/3595779803 >> v2:172.21.15.63:3300/0 conn(0x7efd34065510 0x7efd34158360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efd24002f70 tx=0x7efd24007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd337fe700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd34065510 0x7efd34158360 secure :-1 s=READY pgs=2266 cs=0 l=1 rx=0x7efd24002f70 tx=0x7efd24007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:11.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd337fe700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd34065510 0x7efd34158360 secure :-1 s=THROTTLE_DONE pgs=2266 cs=0 l=1 rx=0x7efd24002f70 tx=0x7efd24007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.483 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd317fa700 1 -- 172.21.15.63:0/3595779803 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd24010320 con 0x7efd34065510 2020-05-18T21:39:11.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd337fe700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd34065510 0x7efd34158360 secure :-1 s=THROTTLE_DONE pgs=2266 cs=0 l=1 rx=0x7efd24002f70 tx=0x7efd24007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd317fa700 1 -- 172.21.15.63:0/3595779803 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd24007360 con 0x7efd34065510 2020-05-18T21:39:11.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd337fe700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd34065510 0x7efd34158360 secure :-1 s=THROTTLE_DONE pgs=2266 cs=0 l=1 rx=0x7efd24002f70 tx=0x7efd24007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd317fa700 1 -- 172.21.15.63:0/3595779803 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd24005700 con 0x7efd34065510 2020-05-18T21:39:11.484 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd39104700 1 -- 172.21.15.63:0/3595779803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd340afe30 con 0x7efd34065510 2020-05-18T21:39:11.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd39104700 1 -- 172.21.15.63:0/3595779803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd3414b530 con 0x7efd34065510 2020-05-18T21:39:11.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd337fe700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd34065510 0x7efd34158360 secure :-1 s=THROTTLE_DONE pgs=2266 cs=0 l=1 rx=0x7efd24002f70 tx=0x7efd24007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd39104700 1 -- 172.21.15.63:0/3595779803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd340569e0 con 0x7efd34065510 2020-05-18T21:39:11.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd317fa700 1 -- 172.21.15.63:0/3595779803 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7efd240059c0 con 0x7efd34065510 2020-05-18T21:39:11.485 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd337fe700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd34065510 0x7efd34158360 secure :-1 s=THROTTLE_DONE pgs=2266 cs=0 l=1 rx=0x7efd24002f70 tx=0x7efd24007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd317fa700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd1404f920 0x7efd14051de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:11.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd317fa700 1 -- 172.21.15.63:0/3595779803 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efd24064520 con 0x7efd34065510 2020-05-18T21:39:11.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.468+0000 7efd33fff700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd1404f920 0x7efd14051de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.472+0000 7efd33fff700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd1404f920 0x7efd14051de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efd28002f70 tx=0x7efd2800e1d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.486 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.472+0000 7efd33fff700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd1404f920 0x7efd14051de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efd28002f70 tx=0x7efd2800e1d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.472+0000 7efd33fff700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd1404f920 0x7efd14051de0 secure :-1 s=READY pgs=888 cs=0 l=1 rx=0x7efd28002f70 tx=0x7efd2800e1d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:11.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.476+0000 7efd337fe700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd34065510 0x7efd34158360 secure :-1 s=THROTTLE_DONE pgs=2266 cs=0 l=1 rx=0x7efd24002f70 tx=0x7efd24007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.487 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.476+0000 7efd317fa700 1 -- 172.21.15.63:0/3595779803 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7efd2403e970 con 0x7efd34065510 2020-05-18T21:39:11.594 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.588+0000 7efd39104700 1 -- 172.21.15.63:0/3595779803 --> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7efd340affc0 con 0x7efd1404f920 2020-05-18T21:39:11.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.588+0000 7efd33fff700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd1404f920 0x7efd14051de0 secure :-1 s=THROTTLE_DONE pgs=888 cs=0 l=1 rx=0x7efd28002f70 tx=0x7efd2800e1d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.595 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.588+0000 7efd317fa700 1 -- 172.21.15.63:0/3595779803 <== mgr.4110 v2:172.21.15.155:6832/12649 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efd340affc0 con 0x7efd1404f920 2020-05-18T21:39:11.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.588+0000 7efd39104700 1 -- 172.21.15.63:0/3595779803 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd1404f920 msgr2=0x7efd14051de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.597 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.588+0000 7efd39104700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd1404f920 0x7efd14051de0 secure :-1 s=READY pgs=888 cs=0 l=1 rx=0x7efd28002f70 tx=0x7efd2800e1d0).stop 2020-05-18T21:39:11.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.588+0000 7efd39104700 1 -- 172.21.15.63:0/3595779803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd34065510 msgr2=0x7efd34158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.588+0000 7efd39104700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd34065510 0x7efd34158360 secure :-1 s=READY pgs=2266 cs=0 l=1 rx=0x7efd24002f70 tx=0x7efd24007a80).stop 2020-05-18T21:39:11.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.592+0000 7efd39104700 1 -- 172.21.15.63:0/3595779803 shutdown_connections 2020-05-18T21:39:11.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.592+0000 7efd39104700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7efd1404f920 0x7efd14051de0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:11.598 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.592+0000 7efd39104700 1 --2- 172.21.15.63:0/3595779803 >> v2:172.21.15.155:3300/0 conn(0x7efd340b5620 0x7efd3414b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:11.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.592+0000 7efd39104700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd34065510 0x7efd34158360 unknown :-1 s=CLOSED pgs=2266 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:11.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.592+0000 7efd39104700 1 --2- 172.21.15.63:0/3595779803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd34061a00 0x7efd340b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:11.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.592+0000 7efd39104700 1 -- 172.21.15.63:0/3595779803 >> 172.21.15.63:0/3595779803 conn(0x7efd3409da60 msgr2=0x7efd34148720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:11.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.592+0000 7efd39104700 1 -- 172.21.15.63:0/3595779803 shutdown_connections 2020-05-18T21:39:11.599 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.592+0000 7efd39104700 1 -- 172.21.15.63:0/3595779803 wait complete. 2020-05-18T21:39:11.600 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 0 to deep-scrub 2020-05-18T21:39:11.608 INFO:tasks.ceph:Scrubbing osd.1 2020-05-18T21:39:11.609 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 config set osd_debug_deep_scrub_sleep 0 2020-05-18T21:39:11.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.708+0000 7f0fc5e7e700 1 Processor -- start 2020-05-18T21:39:11.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.708+0000 7f0fc5e7e700 1 -- start start 2020-05-18T21:39:11.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fc5e7e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fc00b6c30 0x7f0fc0065410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:11.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fc5e7e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0fc01473c0 0x7f0fc0147800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:11.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fc5e7e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc0148280 con 0x7f0fc0143350 2020-05-18T21:39:11.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fc5e7e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc0065870 con 0x7f0fc01473c0 2020-05-18T21:39:11.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fc5e7e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc0147d40 con 0x7f0fc00b6c30 2020-05-18T21:39:11.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fbffff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f0fc0143350 0x7f0fc0144090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:38016/0 (socket says 172.21.15.63:38016) 2020-05-18T21:39:11.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fbeffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0fc01473c0 0x7f0fc0147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fbf7fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fc00b6c30 0x7f0fc0065410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fbffff700 1 -- 172.21.15.63:0/1577193651 learned_addr learned my addr 172.21.15.63:0/1577193651 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:11.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fbeffd700 1 -- 172.21.15.63:0/1577193651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fc00b6c30 msgr2=0x7f0fc0065410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:11.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fbeffd700 1 --2- 172.21.15.63:0/1577193651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fc00b6c30 0x7f0fc0065410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:11.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fbeffd700 1 -- 172.21.15.63:0/1577193651 >> v1:172.21.15.155:6789/0 conn(0x7f0fc0143350 legacy=0x7f0fc0144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fbe7fc700 1 -- 172.21.15.63:0/1577193651 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994153127 0 0) 0x7f0fc0148280 con 0x7f0fc0143350 2020-05-18T21:39:11.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fbeffd700 1 -- 172.21.15.63:0/1577193651 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc0147fe0 con 0x7f0fc01473c0 2020-05-18T21:39:11.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fbeffd700 1 --2- 172.21.15.63:0/1577193651 >> v2:172.21.15.155:3300/0 conn(0x7f0fc01473c0 0x7f0fc0147800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0fb0002f70 tx=0x7f0fb0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fbeffd700 1 --2- 172.21.15.63:0/1577193651 >> v2:172.21.15.155:3300/0 conn(0x7f0fc01473c0 0x7f0fc0147800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0fb0002f70 tx=0x7f0fb0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fbeffd700 1 --2- 172.21.15.63:0/1577193651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fc01473c0 0x7f0fc0147800 secure :-1 s=READY pgs=1509 cs=0 l=1 rx=0x7f0fb0002f70 tx=0x7f0fb0007a80).ready entity=mon.1 client_cookie=f10dbde2362752b9 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:11.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fbeffd700 1 --2- 172.21.15.63:0/1577193651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fc01473c0 0x7f0fc0147800 secure :-1 s=THROTTLE_DONE pgs=1509 cs=0 l=1 rx=0x7f0fb0002f70 tx=0x7f0fb0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fbe7fc700 1 -- 172.21.15.63:0/1577193651 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fb0008d70 con 0x7f0fc01473c0 2020-05-18T21:39:11.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fbeffd700 1 --2- 172.21.15.63:0/1577193651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fc01473c0 0x7f0fc0147800 secure :-1 s=THROTTLE_DONE pgs=1509 cs=0 l=1 rx=0x7f0fb0002f70 tx=0x7f0fb0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fbeffd700 1 --2- 172.21.15.63:0/1577193651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fc01473c0 0x7f0fc0147800 secure :-1 s=THROTTLE_DONE pgs=1509 cs=0 l=1 rx=0x7f0fb0002f70 tx=0x7f0fb0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fbe7fc700 1 -- 172.21.15.63:0/1577193651 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb0011790 con 0x7f0fc01473c0 2020-05-18T21:39:11.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fbe7fc700 1 -- 172.21.15.63:0/1577193651 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fb0011b70 con 0x7f0fc01473c0 2020-05-18T21:39:11.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fc5e7e700 1 -- 172.21.15.63:0/1577193651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fc01473c0 msgr2=0x7f0fc0147800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fc5e7e700 1 --2- 172.21.15.63:0/1577193651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fc01473c0 0x7f0fc0147800 secure :-1 s=READY pgs=1509 cs=0 l=1 rx=0x7f0fb0002f70 tx=0x7f0fb0007a80).stop 2020-05-18T21:39:11.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fc5e7e700 1 -- 172.21.15.63:0/1577193651 shutdown_connections 2020-05-18T21:39:11.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fc5e7e700 1 --2- 172.21.15.63:0/1577193651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fc01473c0 0x7f0fc0147800 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:11.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fc5e7e700 1 --2- 172.21.15.63:0/1577193651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fc00b6c30 0x7f0fc0065410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:11.727 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fc5e7e700 1 -- 172.21.15.63:0/1577193651 >> 172.21.15.63:0/1577193651 conn(0x7f0fc005b290 msgr2=0x7f0fc005ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:11.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.712+0000 7f0fc5e7e700 1 -- 172.21.15.63:0/1577193651 shutdown_connections 2020-05-18T21:39:11.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.716+0000 7f0fc5e7e700 1 -- 172.21.15.63:0/1577193651 wait complete. 2020-05-18T21:39:11.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.716+0000 7f0fc5e7e700 1 Processor -- start 2020-05-18T21:39:11.728 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.716+0000 7f0fc5e7e700 1 -- start start 2020-05-18T21:39:11.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.716+0000 7f0fc5e7e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fc0143350 0x7f0fc00b8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:11.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.716+0000 7f0fc5e7e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0fc01473c0 0x7f0fc0142980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:11.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.716+0000 7f0fc5e7e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc0142de0 con 0x7f0fc00b6c30 2020-05-18T21:39:11.732 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.716+0000 7f0fc5e7e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc0146d00 con 0x7f0fc01473c0 2020-05-18T21:39:11.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.716+0000 7f0fc5e7e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc0151740 con 0x7f0fc0143350 2020-05-18T21:39:11.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.716+0000 7f0fbf7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0fc00b6c30 0x7f0fc01507b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39704/0 (socket says 172.21.15.63:39704) 2020-05-18T21:39:11.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.716+0000 7f0fbf7fe700 1 -- 172.21.15.63:0/679904373 learned_addr learned my addr 172.21.15.63:0/679904373 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:11.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.716+0000 7f0fbffff700 1 --2- 172.21.15.63:0/679904373 >> v2:172.21.15.63:3300/0 conn(0x7f0fc01473c0 0x7f0fc0142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.733 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.716+0000 7f0fbeffd700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fc0143350 0x7f0fc00b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.716+0000 7f0fbcff9700 1 -- 172.21.15.63:0/679904373 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914705153 0 0) 0x7f0fc0142de0 con 0x7f0fc00b6c30 2020-05-18T21:39:11.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.716+0000 7f0fbcff9700 1 -- 172.21.15.63:0/679904373 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fa4002fe0 con 0x7f0fc00b6c30 2020-05-18T21:39:11.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fbffff700 1 -- 172.21.15.63:0/679904373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fc0143350 msgr2=0x7f0fc00b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fbffff700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fc0143350 0x7f0fc00b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:11.734 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fbffff700 1 -- 172.21.15.63:0/679904373 >> v1:172.21.15.63:6789/0 conn(0x7f0fc00b6c30 legacy=0x7f0fc01507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fbffff700 1 -- 172.21.15.63:0/679904373 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc01519e0 con 0x7f0fc01473c0 2020-05-18T21:39:11.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fbffff700 1 --2- 172.21.15.63:0/679904373 >> v2:172.21.15.63:3300/0 conn(0x7f0fc01473c0 0x7f0fc0142980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0fb8000f40 tx=0x7f0fb8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fbffff700 1 --2- 172.21.15.63:0/679904373 >> v2:172.21.15.63:3300/0 conn(0x7f0fc01473c0 0x7f0fc0142980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0fb8000f40 tx=0x7f0fb8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.735 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fbffff700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc01473c0 0x7f0fc0142980 secure :-1 s=READY pgs=2268 cs=0 l=1 rx=0x7f0fb8000f40 tx=0x7f0fb8010c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:11.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fbffff700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc01473c0 0x7f0fc0142980 secure :-1 s=THROTTLE_DONE pgs=2268 cs=0 l=1 rx=0x7f0fb8000f40 tx=0x7f0fb8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fbcff9700 1 -- 172.21.15.63:0/679904373 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fb8005e70 con 0x7f0fc01473c0 2020-05-18T21:39:11.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fbffff700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc01473c0 0x7f0fc0142980 secure :-1 s=THROTTLE_DONE pgs=2268 cs=0 l=1 rx=0x7f0fb8000f40 tx=0x7f0fb8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fbffff700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc01473c0 0x7f0fc0142980 secure :-1 s=THROTTLE_DONE pgs=2268 cs=0 l=1 rx=0x7f0fb8000f40 tx=0x7f0fb8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.736 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fbcff9700 1 -- 172.21.15.63:0/679904373 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb8012400 con 0x7f0fc01473c0 2020-05-18T21:39:11.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fc5e7e700 1 -- 172.21.15.63:0/679904373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc0151c80 con 0x7f0fc01473c0 2020-05-18T21:39:11.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fbcff9700 1 -- 172.21.15.63:0/679904373 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fb8012820 con 0x7f0fc01473c0 2020-05-18T21:39:11.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fc5e7e700 1 -- 172.21.15.63:0/679904373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc0150ec0 con 0x7f0fc01473c0 2020-05-18T21:39:11.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fc5e7e700 1 -- 172.21.15.63:0/679904373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0fc009c3e0 con 0x7f0fc01473c0 2020-05-18T21:39:11.737 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fbffff700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc01473c0 0x7f0fc0142980 secure :-1 s=THROTTLE_DONE pgs=2268 cs=0 l=1 rx=0x7f0fb8000f40 tx=0x7f0fb8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fbcff9700 1 -- 172.21.15.63:0/679904373 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f0fb8012a90 con 0x7f0fc01473c0 2020-05-18T21:39:11.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fbffff700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc01473c0 0x7f0fc0142980 secure :-1 s=THROTTLE_DONE pgs=2268 cs=0 l=1 rx=0x7f0fb8000f40 tx=0x7f0fb8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fbffff700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc01473c0 0x7f0fc0142980 secure :-1 s=THROTTLE_DONE pgs=2268 cs=0 l=1 rx=0x7f0fb8000f40 tx=0x7f0fb8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fbcff9700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fa404fd40 0x7f0fa4052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:11.738 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.720+0000 7f0fbcff9700 1 -- 172.21.15.63:0/679904373 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0fb80090c0 con 0x7f0fc01473c0 2020-05-18T21:39:11.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.724+0000 7f0fbcff9700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7f0fa4056910 0x7f0fa4058d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:11.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.724+0000 7f0fbcff9700 1 -- 172.21.15.63:0/679904373 --> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0fa4059310 con 0x7f0fa4056910 2020-05-18T21:39:11.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.724+0000 7f0fbcff9700 1 -- 172.21.15.63:0/679904373 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=169) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fb8065410 con 0x7f0fc01473c0 2020-05-18T21:39:11.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.724+0000 7f0fbf7fe700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fa404fd40 0x7f0fa4052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.739 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.724+0000 7f0fbeffd700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7f0fa4056910 0x7f0fa4058d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.724+0000 7f0fbf7fe700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fa404fd40 0x7f0fa4052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0fa8002f70 tx=0x7f0fa80090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.724+0000 7f0fbf7fe700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fa404fd40 0x7f0fa4052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0fa8002f70 tx=0x7f0fa80090f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.724+0000 7f0fbf7fe700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fa404fd40 0x7f0fa4052200 secure :-1 s=READY pgs=889 cs=0 l=1 rx=0x7f0fa8002f70 tx=0x7f0fa80090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:11.740 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.724+0000 7f0fbeffd700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7f0fa4056910 0x7f0fa4058d30 crc :-1 s=READY pgs=39 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:11.741 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.724+0000 7f0fbcff9700 1 -- 172.21.15.63:0/679904373 <== osd.1 v2:172.21.15.63:6808/12804 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23263 (crc 0 0 0) 0x7f0fa4059310 con 0x7f0fa4056910 2020-05-18T21:39:11.747 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.740+0000 7f0fc5e7e700 1 -- 172.21.15.63:0/679904373 --> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0fc0064a10 con 0x7f0fa4056910 2020-05-18T21:39:11.748 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.740+0000 7f0fbcff9700 1 -- 172.21.15.63:0/679904373 <== osd.1 v2:172.21.15.63:6808/12804 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0fc0064a10 con 0x7f0fa4056910 2020-05-18T21:39:11.748 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:39:11.748 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-05-18T21:39:11.749 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:39:11.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.740+0000 7f0fc5e7e700 1 -- 172.21.15.63:0/679904373 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7f0fa4056910 msgr2=0x7f0fa4058d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.740+0000 7f0fc5e7e700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.63:6808/12804,v1:172.21.15.63:6809/12804] conn(0x7f0fa4056910 0x7f0fa4058d30 crc :-1 s=READY pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:11.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.740+0000 7f0fc5e7e700 1 -- 172.21.15.63:0/679904373 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fa404fd40 msgr2=0x7f0fa4052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.750 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.740+0000 7f0fc5e7e700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f0fa404fd40 0x7f0fa4052200 secure :-1 s=READY pgs=889 cs=0 l=1 rx=0x7f0fa8002f70 tx=0x7f0fa80090f0).stop 2020-05-18T21:39:11.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.740+0000 7f0fc5e7e700 1 -- 172.21.15.63:0/679904373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc01473c0 msgr2=0x7f0fc0142980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.740+0000 7f0fc5e7e700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc01473c0 0x7f0fc0142980 secure :-1 s=READY pgs=2268 cs=0 l=1 rx=0x7f0fb8000f40 tx=0x7f0fb8010c20).stop 2020-05-18T21:39:11.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.740+0000 7f0fbffff700 1 -- 172.21.15.63:0/679904373 reap_dead start 2020-05-18T21:39:11.751 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.740+0000 7f0fc5e7e700 1 -- 172.21.15.63:0/679904373 shutdown_connections 2020-05-18T21:39:11.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.740+0000 7f0fc5e7e700 1 --2- 172.21.15.63:0/679904373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc01473c0 0x7f0fc0142980 unknown :-1 s=CLOSED pgs=2268 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:11.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.740+0000 7f0fc5e7e700 1 -- 172.21.15.63:0/679904373 >> 172.21.15.63:0/679904373 conn(0x7f0fc005b290 msgr2=0x7f0fc0141c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:11.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.740+0000 7f0fc5e7e700 1 -- 172.21.15.63:0/679904373 shutdown_connections 2020-05-18T21:39:11.752 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.740+0000 7f0fc5e7e700 1 -- 172.21.15.63:0/679904373 wait complete. 2020-05-18T21:39:11.765 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 1 2020-05-18T21:39:11.874 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.868+0000 7f528891f700 1 Processor -- start 2020-05-18T21:39:11.875 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.868+0000 7f528891f700 1 -- start start 2020-05-18T21:39:11.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.868+0000 7f528891f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5284143430 0x7f5284145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:11.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.868+0000 7f528891f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f52840b6d70 0x7f52840b9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:11.876 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.868+0000 7f528891f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52840b7bf0 0x7f52840b95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:11.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.868+0000 7f528891f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5284143810 con 0x7f52840b6d70 2020-05-18T21:39:11.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.868+0000 7f528891f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52840b7210 con 0x7f5284143430 2020-05-18T21:39:11.877 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.868+0000 7f528891f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52840b74b0 con 0x7f52840b7bf0 2020-05-18T21:39:11.878 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.868+0000 7f5281d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f52840b6d70 0x7f52840b9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.868+0000 7f528259c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5284143430 0x7f5284145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.868+0000 7f5281d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f52840b6d70 0x7f52840b9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37530/0 (socket says 172.21.15.63:37530) 2020-05-18T21:39:11.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.868+0000 7f5281d9b700 1 -- 172.21.15.63:0/3554597186 learned_addr learned my addr 172.21.15.63:0/3554597186 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:11.879 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.868+0000 7f5282d9d700 1 --2- 172.21.15.63:0/3554597186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52840b7bf0 0x7f52840b95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.868+0000 7f5281d9b700 1 -- 172.21.15.63:0/3554597186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52840b7bf0 msgr2=0x7f52840b95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:11.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.868+0000 7f5281d9b700 1 --2- 172.21.15.63:0/3554597186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52840b7bf0 0x7f52840b95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:11.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f5281d9b700 1 -- 172.21.15.63:0/3554597186 >> v2:172.21.15.155:3300/0 conn(0x7f5284143430 msgr2=0x7f5284145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:11.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f5281d9b700 1 --2- 172.21.15.63:0/3554597186 >> v2:172.21.15.155:3300/0 conn(0x7f5284143430 0x7f5284145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:11.880 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f5281d9b700 1 -- 172.21.15.63:0/3554597186 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52840b7750 con 0x7f52840b6d70 2020-05-18T21:39:11.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f5281d9b700 1 --2- 172.21.15.63:0/3554597186 >> v2:172.21.15.63:3300/0 conn(0x7f52840b6d70 0x7f52840b9160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5278002f70 tx=0x7f528405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f5281d9b700 1 --2- 172.21.15.63:0/3554597186 >> v2:172.21.15.63:3300/0 conn(0x7f52840b6d70 0x7f52840b9160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5278002f70 tx=0x7f528405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f5281d9b700 1 --2- 172.21.15.63:0/3554597186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52840b6d70 0x7f52840b9160 secure :-1 s=READY pgs=2269 cs=0 l=1 rx=0x7f5278002f70 tx=0x7f528405ab60).ready entity=mon.0 client_cookie=c94cc4e5f8f5fb75 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:11.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f5281d9b700 1 --2- 172.21.15.63:0/3554597186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52840b6d70 0x7f52840b9160 secure :-1 s=THROTTLE_DONE pgs=2269 cs=0 l=1 rx=0x7f5278002f70 tx=0x7f528405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.881 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f5281d9b700 1 --2- 172.21.15.63:0/3554597186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52840b6d70 0x7f52840b9160 secure :-1 s=THROTTLE_DONE pgs=2269 cs=0 l=1 rx=0x7f5278002f70 tx=0x7f528405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f5281d9b700 1 --2- 172.21.15.63:0/3554597186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52840b6d70 0x7f52840b9160 secure :-1 s=THROTTLE_DONE pgs=2269 cs=0 l=1 rx=0x7f5278002f70 tx=0x7f528405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f528159a700 1 -- 172.21.15.63:0/3554597186 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5278011600 con 0x7f52840b6d70 2020-05-18T21:39:11.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f528159a700 1 -- 172.21.15.63:0/3554597186 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5278011760 con 0x7f52840b6d70 2020-05-18T21:39:11.882 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f528159a700 1 -- 172.21.15.63:0/3554597186 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5278011b80 con 0x7f52840b6d70 2020-05-18T21:39:11.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f528891f700 1 -- 172.21.15.63:0/3554597186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52840b6d70 msgr2=0x7f52840b9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.883 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f528891f700 1 --2- 172.21.15.63:0/3554597186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52840b6d70 0x7f52840b9160 secure :-1 s=READY pgs=2269 cs=0 l=1 rx=0x7f5278002f70 tx=0x7f528405ab60).stop 2020-05-18T21:39:11.886 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f528891f700 1 -- 172.21.15.63:0/3554597186 shutdown_connections 2020-05-18T21:39:11.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f528891f700 1 --2- 172.21.15.63:0/3554597186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52840b7bf0 0x7f52840b95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:11.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f528891f700 1 --2- 172.21.15.63:0/3554597186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52840b6d70 0x7f52840b9160 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:11.887 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f528891f700 1 --2- 172.21.15.63:0/3554597186 >> v2:172.21.15.155:3300/0 conn(0x7f5284143430 0x7f5284145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:11.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f528891f700 1 -- 172.21.15.63:0/3554597186 >> 172.21.15.63:0/3554597186 conn(0x7f5284069b70 msgr2=0x7f5284069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:11.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f528891f700 1 -- 172.21.15.63:0/3554597186 shutdown_connections 2020-05-18T21:39:11.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f528891f700 1 -- 172.21.15.63:0/3554597186 wait complete. 2020-05-18T21:39:11.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f528891f700 1 Processor -- start 2020-05-18T21:39:11.888 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.872+0000 7f528891f700 1 -- start start 2020-05-18T21:39:11.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f528891f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f52840b7bf0 0x7f52840afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:11.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f528891f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52840af590 con 0x7f52840b6d70 2020-05-18T21:39:11.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f528891f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52840af830 con 0x7f5284143430 2020-05-18T21:39:11.889 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f528891f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5284141640 con 0x7f52840b7bf0 2020-05-18T21:39:11.890 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f528259c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f52840b6d70 0x7f52840aedd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39720/0 (socket says 172.21.15.63:39720) 2020-05-18T21:39:11.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f5281d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f52840b7bf0 0x7f52840afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f528259c700 1 -- 172.21.15.63:0/3579873764 learned_addr learned my addr 172.21.15.63:0/3579873764 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:11.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f52737fe700 1 -- 172.21.15.63:0/3579873764 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211035614 0 0) 0x7f52840af830 con 0x7f5284143430 2020-05-18T21:39:11.891 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f5281d9b700 1 -- 172.21.15.63:0/3579873764 >> v1:172.21.15.155:6789/0 conn(0x7f5284143430 legacy=0x7f5284140f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f5281d9b700 1 -- 172.21.15.63:0/3579873764 >> v1:172.21.15.63:6789/0 conn(0x7f52840b6d70 legacy=0x7f52840aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:11.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f5281d9b700 1 -- 172.21.15.63:0/3579873764 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5284141780 con 0x7f52840b7bf0 2020-05-18T21:39:11.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f5281d9b700 1 --2- 172.21.15.63:0/3579873764 >> v2:172.21.15.63:3300/0 conn(0x7f52840b7bf0 0x7f52840afdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52740032f0 tx=0x7f528405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f5281d9b700 1 --2- 172.21.15.63:0/3579873764 >> v2:172.21.15.63:3300/0 conn(0x7f52840b7bf0 0x7f52840afdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52740032f0 tx=0x7f528405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.892 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f5281d9b700 1 --2- 172.21.15.63:0/3579873764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52840b7bf0 0x7f52840afdb0 secure :-1 s=READY pgs=2271 cs=0 l=1 rx=0x7f52740032f0 tx=0x7f528405ab60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:11.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f5281d9b700 1 --2- 172.21.15.63:0/3579873764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52840b7bf0 0x7f52840afdb0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7f52740032f0 tx=0x7f528405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f52737fe700 1 -- 172.21.15.63:0/3579873764 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5278011da0 con 0x7f52840b7bf0 2020-05-18T21:39:11.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f5281d9b700 1 --2- 172.21.15.63:0/3579873764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52840b7bf0 0x7f52840afdb0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7f52740032f0 tx=0x7f528405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f52737fe700 1 -- 172.21.15.63:0/3579873764 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5278007170 con 0x7f52840b7bf0 2020-05-18T21:39:11.893 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f5281d9b700 1 --2- 172.21.15.63:0/3579873764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52840b7bf0 0x7f52840afdb0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7f52740032f0 tx=0x7f528405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f528891f700 1 -- 172.21.15.63:0/3579873764 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5284149df0 con 0x7f52840b7bf0 2020-05-18T21:39:11.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f52737fe700 1 -- 172.21.15.63:0/3579873764 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52780074d0 con 0x7f52840b7bf0 2020-05-18T21:39:11.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f528891f700 1 -- 172.21.15.63:0/3579873764 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52840acf70 con 0x7f52840b7bf0 2020-05-18T21:39:11.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.876+0000 7f5281d9b700 1 --2- 172.21.15.63:0/3579873764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52840b7bf0 0x7f52840afdb0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7f52740032f0 tx=0x7f528405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.894 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.880+0000 7f52737fe700 1 -- 172.21.15.63:0/3579873764 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f5278005700 con 0x7f52840b7bf0 2020-05-18T21:39:11.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.880+0000 7f5281d9b700 1 --2- 172.21.15.63:0/3579873764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52840b7bf0 0x7f52840afdb0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7f52740032f0 tx=0x7f528405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.880+0000 7f528891f700 1 -- 172.21.15.63:0/3579873764 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52840af9c0 con 0x7f52840b7bf0 2020-05-18T21:39:11.896 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.880+0000 7f52737fe700 1 --2- 172.21.15.63:0/3579873764 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f526004f890 0x7f5260051d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:11.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.880+0000 7f52737fe700 1 -- 172.21.15.63:0/3579873764 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5278064090 con 0x7f52840b7bf0 2020-05-18T21:39:11.897 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.880+0000 7f528259c700 1 --2- 172.21.15.63:0/3579873764 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f526004f890 0x7f5260051d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:11.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.880+0000 7f528259c700 1 --2- 172.21.15.63:0/3579873764 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f526004f890 0x7f5260051d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5274008360 tx=0x7f527400ccb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.880+0000 7f528259c700 1 --2- 172.21.15.63:0/3579873764 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f526004f890 0x7f5260051d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5274008360 tx=0x7f527400ccb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.880+0000 7f528259c700 1 --2- 172.21.15.63:0/3579873764 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f526004f890 0x7f5260051d50 secure :-1 s=READY pgs=890 cs=0 l=1 rx=0x7f5274008360 tx=0x7f527400ccb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:11.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.884+0000 7f5281d9b700 1 --2- 172.21.15.63:0/3579873764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52840b7bf0 0x7f52840afdb0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7f52740032f0 tx=0x7f528405ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:11.898 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:11.884+0000 7f52737fe700 1 -- 172.21.15.63:0/3579873764 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f527803e540 con 0x7f52840b7bf0 2020-05-18T21:39:12.010 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.004+0000 7f528891f700 1 -- 172.21.15.63:0/3579873764 --> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f52840b9c70 con 0x7f526004f890 2020-05-18T21:39:12.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.004+0000 7f528259c700 1 --2- 172.21.15.63:0/3579873764 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f526004f890 0x7f5260051d50 secure :-1 s=THROTTLE_DONE pgs=890 cs=0 l=1 rx=0x7f5274008360 tx=0x7f527400ccb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.011 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.004+0000 7f52737fe700 1 -- 172.21.15.63:0/3579873764 <== mgr.4110 v2:172.21.15.155:6832/12649 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f52840b9c70 con 0x7f526004f890 2020-05-18T21:39:12.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.008+0000 7f528891f700 1 -- 172.21.15.63:0/3579873764 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f526004f890 msgr2=0x7f5260051d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.014 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.008+0000 7f528891f700 1 --2- 172.21.15.63:0/3579873764 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f526004f890 0x7f5260051d50 secure :-1 s=READY pgs=890 cs=0 l=1 rx=0x7f5274008360 tx=0x7f527400ccb0).stop 2020-05-18T21:39:12.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.008+0000 7f528891f700 1 -- 172.21.15.63:0/3579873764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52840b7bf0 msgr2=0x7f52840afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.008+0000 7f528891f700 1 --2- 172.21.15.63:0/3579873764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52840b7bf0 0x7f52840afdb0 secure :-1 s=READY pgs=2271 cs=0 l=1 rx=0x7f52740032f0 tx=0x7f528405ab60).stop 2020-05-18T21:39:12.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.008+0000 7f528891f700 1 -- 172.21.15.63:0/3579873764 shutdown_connections 2020-05-18T21:39:12.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.008+0000 7f528891f700 1 --2- 172.21.15.63:0/3579873764 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f526004f890 0x7f5260051d50 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:12.015 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.008+0000 7f528891f700 1 --2- 172.21.15.63:0/3579873764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52840b7bf0 0x7f52840afdb0 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:12.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.008+0000 7f528891f700 1 -- 172.21.15.63:0/3579873764 >> 172.21.15.63:0/3579873764 conn(0x7f5284069b70 msgr2=0x7f5284060660 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:12.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.008+0000 7f528891f700 1 -- 172.21.15.63:0/3579873764 shutdown_connections 2020-05-18T21:39:12.016 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.008+0000 7f528891f700 1 -- 172.21.15.63:0/3579873764 wait complete. 2020-05-18T21:39:12.016 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 1 to deep-scrub 2020-05-18T21:39:12.028 INFO:tasks.ceph:Scrubbing osd.2 2020-05-18T21:39:12.029 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 config set osd_debug_deep_scrub_sleep 0 2020-05-18T21:39:12.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.132+0000 7fd42e2ff700 1 Processor -- start 2020-05-18T21:39:12.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.132+0000 7fd42e2ff700 1 -- start start 2020-05-18T21:39:12.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.132+0000 7fd42e2ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd428143810 0x7fd4280b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:12.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42e2ff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4280624d0 con 0x7fd4280b9620 2020-05-18T21:39:12.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42e2ff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd428062770 con 0x7fd4280b91c0 2020-05-18T21:39:12.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42e2ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd428062a10 con 0x7fd428143810 2020-05-18T21:39:12.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42dafe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd4280b9620 0x7fd4280b5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39732/0 (socket says 172.21.15.63:39732) 2020-05-18T21:39:12.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42dafe700 1 -- 172.21.15.63:0/3404425111 learned_addr learned my addr 172.21.15.63:0/3404425111 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:12.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42d2fd700 1 --2- 172.21.15.63:0/3404425111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd428143810 0x7fd4280b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd41ffff700 1 -- 172.21.15.63:0/3404425111 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445975632 0 0) 0x7fd4280624d0 con 0x7fd4280b9620 2020-05-18T21:39:12.146 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd41ffff700 1 -- 172.21.15.63:0/3404425111 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd40c003270 con 0x7fd4280b9620 2020-05-18T21:39:12.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd41ffff700 1 -- 172.21.15.63:0/3404425111 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4290518476 0 0) 0x7fd40c003270 con 0x7fd4280b9620 2020-05-18T21:39:12.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd41ffff700 1 -- 172.21.15.63:0/3404425111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd428143810 msgr2=0x7fd4280b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:12.147 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd41ffff700 1 --2- 172.21.15.63:0/3404425111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd428143810 0x7fd4280b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:12.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd41ffff700 1 -- 172.21.15.63:0/3404425111 >> v1:172.21.15.155:6789/0 conn(0x7fd4280b91c0 legacy=0x7fd4280b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd41ffff700 1 -- 172.21.15.63:0/3404425111 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd428062eb0 con 0x7fd4280b9620 2020-05-18T21:39:12.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd41ffff700 1 -- 172.21.15.63:0/3404425111 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7fd420001a90 con 0x7fd4280b9620 2020-05-18T21:39:12.148 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd41ffff700 1 -- 172.21.15.63:0/3404425111 >> v1:172.21.15.63:6789/0 conn(0x7fd4280b9620 legacy=0x7fd4280b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd41ffff700 1 --2- 172.21.15.63:0/3404425111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd40c003790 0x7fd40c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:12.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd41ffff700 1 --2- 172.21.15.63:0/3404425111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd428143810 0x7fd40c004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:12.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd41ffff700 1 --2- 172.21.15.63:0/3404425111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd40c004580 0x7fd40c004a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:12.149 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd41ffff700 1 -- 172.21.15.63:0/3404425111 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd428062a10 con 0x7fd40c004580 2020-05-18T21:39:12.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd41ffff700 1 -- 172.21.15.63:0/3404425111 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c004f50 con 0x7fd40c003790 2020-05-18T21:39:12.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd41ffff700 1 -- 172.21.15.63:0/3404425111 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c005110 con 0x7fd428143810 2020-05-18T21:39:12.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42dafe700 1 --2- 172.21.15.63:0/3404425111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd40c004580 0x7fd40c004a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.150 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42d2fd700 1 --2- 172.21.15.63:0/3404425111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd40c003790 0x7fd40c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42cafc700 1 --2- 172.21.15.63:0/3404425111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd428143810 0x7fd40c004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42dafe700 1 -- 172.21.15.63:0/3404425111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd428143810 msgr2=0x7fd40c004060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:12.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42dafe700 1 --2- 172.21.15.63:0/3404425111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd428143810 0x7fd40c004060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:12.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42dafe700 1 -- 172.21.15.63:0/3404425111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd40c003790 msgr2=0x7fd40c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:12.151 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42dafe700 1 --2- 172.21.15.63:0/3404425111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd40c003790 0x7fd40c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:12.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42dafe700 1 -- 172.21.15.63:0/3404425111 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c003270 con 0x7fd40c004580 2020-05-18T21:39:12.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42dafe700 1 --2- 172.21.15.63:0/3404425111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd40c004580 0x7fd40c004a00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd4200017a0 tx=0x7fd428062110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42dafe700 1 --2- 172.21.15.63:0/3404425111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd40c004580 0x7fd40c004a00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd4200017a0 tx=0x7fd428062110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42dafe700 1 --2- 172.21.15.63:0/3404425111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd40c004580 0x7fd40c004a00 secure :-1 s=READY pgs=2273 cs=0 l=1 rx=0x7fd4200017a0 tx=0x7fd428062110).ready entity=mon.0 client_cookie=f4d3457c61a498c1 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:12.152 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42dafe700 1 --2- 172.21.15.63:0/3404425111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd40c004580 0x7fd40c004a00 secure :-1 s=THROTTLE_DONE pgs=2273 cs=0 l=1 rx=0x7fd4200017a0 tx=0x7fd428062110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd41ffff700 1 -- 172.21.15.63:0/3404425111 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd420004d60 con 0x7fd40c004580 2020-05-18T21:39:12.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42dafe700 1 --2- 172.21.15.63:0/3404425111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd40c004580 0x7fd40c004a00 secure :-1 s=THROTTLE_DONE pgs=2273 cs=0 l=1 rx=0x7fd4200017a0 tx=0x7fd428062110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42dafe700 1 --2- 172.21.15.63:0/3404425111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd40c004580 0x7fd40c004a00 secure :-1 s=THROTTLE_DONE pgs=2273 cs=0 l=1 rx=0x7fd4200017a0 tx=0x7fd428062110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd41ffff700 1 -- 172.21.15.63:0/3404425111 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd420004ec0 con 0x7fd40c004580 2020-05-18T21:39:12.153 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd41ffff700 1 -- 172.21.15.63:0/3404425111 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4200052e0 con 0x7fd40c004580 2020-05-18T21:39:12.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42e2ff700 1 -- 172.21.15.63:0/3404425111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd40c004580 msgr2=0x7fd40c004a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42e2ff700 1 --2- 172.21.15.63:0/3404425111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd40c004580 0x7fd40c004a00 secure :-1 s=READY pgs=2273 cs=0 l=1 rx=0x7fd4200017a0 tx=0x7fd428062110).stop 2020-05-18T21:39:12.154 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42dafe700 1 -- 172.21.15.63:0/3404425111 reap_dead start 2020-05-18T21:39:12.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42e2ff700 1 -- 172.21.15.63:0/3404425111 shutdown_connections 2020-05-18T21:39:12.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42e2ff700 1 -- 172.21.15.63:0/3404425111 >> 172.21.15.63:0/3404425111 conn(0x7fd42805b210 msgr2=0x7fd4280b8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:12.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42e2ff700 1 -- 172.21.15.63:0/3404425111 shutdown_connections 2020-05-18T21:39:12.155 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.136+0000 7fd42e2ff700 1 -- 172.21.15.63:0/3404425111 wait complete. 2020-05-18T21:39:12.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.140+0000 7fd42e2ff700 1 Processor -- start 2020-05-18T21:39:12.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.140+0000 7fd42e2ff700 1 -- start start 2020-05-18T21:39:12.159 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.140+0000 7fd42e2ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4280659e0 0x7fd4281574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:12.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.140+0000 7fd42e2ff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd428157900 con 0x7fd428090110 2020-05-18T21:39:12.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.140+0000 7fd42e2ff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4280662b0 con 0x7fd4280b2360 2020-05-18T21:39:12.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.140+0000 7fd42e2ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd428066550 con 0x7fd4280659e0 2020-05-18T21:39:12.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.140+0000 7fd42dafe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd428090110 0x7fd428064860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39744/0 (socket says 172.21.15.63:39744) 2020-05-18T21:39:12.160 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.140+0000 7fd42dafe700 1 -- 172.21.15.63:0/2807925609 learned_addr learned my addr 172.21.15.63:0/2807925609 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:12.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.140+0000 7fd42cafc700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4280659e0 0x7fd4281574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.140+0000 7fd41e7fc700 1 -- 172.21.15.63:0/2807925609 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089008618 0 0) 0x7fd4280662b0 con 0x7fd4280b2360 2020-05-18T21:39:12.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.140+0000 7fd41e7fc700 1 -- 172.21.15.63:0/2807925609 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd410002fe0 con 0x7fd4280b2360 2020-05-18T21:39:12.161 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd41e7fc700 1 -- 172.21.15.63:0/2807925609 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112359550 0 0) 0x7fd40c003270 con 0x7fd428090110 2020-05-18T21:39:12.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd41e7fc700 1 -- 172.21.15.63:0/2807925609 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4280662b0 con 0x7fd428090110 2020-05-18T21:39:12.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd42cafc700 1 -- 172.21.15.63:0/2807925609 >> v1:172.21.15.155:6789/0 conn(0x7fd4280b2360 legacy=0x7fd4280909d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd42cafc700 1 -- 172.21.15.63:0/2807925609 >> v1:172.21.15.63:6789/0 conn(0x7fd428090110 legacy=0x7fd428064860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd42cafc700 1 -- 172.21.15.63:0/2807925609 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4280905a0 con 0x7fd4280659e0 2020-05-18T21:39:12.162 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd42cafc700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4280659e0 0x7fd4281574a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd418001020 tx=0x7fd418010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd42cafc700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4280659e0 0x7fd4281574a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd418001020 tx=0x7fd418010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd42cafc700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4280659e0 0x7fd4281574a0 secure :-1 s=READY pgs=349 cs=0 l=1 rx=0x7fd418001020 tx=0x7fd418010bb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:12.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd42cafc700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4280659e0 0x7fd4281574a0 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7fd418001020 tx=0x7fd418010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.163 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd42cafc700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4280659e0 0x7fd4281574a0 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7fd418001020 tx=0x7fd418010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd41e7fc700 1 -- 172.21.15.63:0/2807925609 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd41800cd50 con 0x7fd4280659e0 2020-05-18T21:39:12.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd42cafc700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4280659e0 0x7fd4281574a0 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7fd418001020 tx=0x7fd418010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd41e7fc700 1 -- 172.21.15.63:0/2807925609 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4180121a0 con 0x7fd4280659e0 2020-05-18T21:39:12.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd42e2ff700 1 -- 172.21.15.63:0/2807925609 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4280b2740 con 0x7fd4280659e0 2020-05-18T21:39:12.164 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd41e7fc700 1 -- 172.21.15.63:0/2807925609 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd418012540 con 0x7fd4280659e0 2020-05-18T21:39:12.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd42e2ff700 1 -- 172.21.15.63:0/2807925609 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd428091280 con 0x7fd4280659e0 2020-05-18T21:39:12.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd42cafc700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4280659e0 0x7fd4281574a0 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7fd418001020 tx=0x7fd418010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd42e2ff700 1 -- 172.21.15.63:0/2807925609 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4280645c0 con 0x7fd4280659e0 2020-05-18T21:39:12.165 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd41e7fc700 1 -- 172.21.15.63:0/2807925609 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fd4180127b0 con 0x7fd4280659e0 2020-05-18T21:39:12.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd42cafc700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4280659e0 0x7fd4281574a0 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7fd418001020 tx=0x7fd418010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd41e7fc700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd41004feb0 0x7fd410052370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:12.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.144+0000 7fd42cafc700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4280659e0 0x7fd4281574a0 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7fd418001020 tx=0x7fd418010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.148+0000 7fd41e7fc700 1 -- 172.21.15.63:0/2807925609 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd418063d60 con 0x7fd4280659e0 2020-05-18T21:39:12.166 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.148+0000 7fd41e7fc700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7fd410056960 0x7fd410058d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:12.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.148+0000 7fd41e7fc700 1 -- 172.21.15.63:0/2807925609 --> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd410059360 con 0x7fd410056960 2020-05-18T21:39:12.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.148+0000 7fd41e7fc700 1 -- 172.21.15.63:0/2807925609 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=169) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd41803e090 con 0x7fd4280659e0 2020-05-18T21:39:12.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.148+0000 7fd42d2fd700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd41004feb0 0x7fd410052370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.148+0000 7fd42dafe700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7fd410056960 0x7fd410058d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.167 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.148+0000 7fd42d2fd700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd41004feb0 0x7fd410052370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4240030b0 tx=0x7fd4240079f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.148+0000 7fd42d2fd700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd41004feb0 0x7fd410052370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4240030b0 tx=0x7fd4240079f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.148+0000 7fd42d2fd700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd41004feb0 0x7fd410052370 secure :-1 s=READY pgs=891 cs=0 l=1 rx=0x7fd4240030b0 tx=0x7fd4240079f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:12.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.148+0000 7fd42dafe700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7fd410056960 0x7fd410058d80 crc :-1 s=READY pgs=36 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:12.168 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.148+0000 7fd41e7fc700 1 -- 172.21.15.63:0/2807925609 <== osd.2 v2:172.21.15.63:6822/12806 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23263 (crc 0 0 0) 0x7fd410059360 con 0x7fd410056960 2020-05-18T21:39:12.171 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.164+0000 7fd42e2ff700 1 -- 172.21.15.63:0/2807925609 --> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd428066110 con 0x7fd410056960 2020-05-18T21:39:12.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.164+0000 7fd41e7fc700 1 -- 172.21.15.63:0/2807925609 <== osd.2 v2:172.21.15.63:6822/12806 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd428066110 con 0x7fd410056960 2020-05-18T21:39:12.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.164+0000 7fd42e2ff700 1 -- 172.21.15.63:0/2807925609 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7fd410056960 msgr2=0x7fd410058d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.174 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.164+0000 7fd42e2ff700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.63:6822/12806,v1:172.21.15.63:6824/12806] conn(0x7fd410056960 0x7fd410058d80 crc :-1 s=READY pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:12.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.164+0000 7fd42e2ff700 1 -- 172.21.15.63:0/2807925609 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd41004feb0 msgr2=0x7fd410052370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.164+0000 7fd42e2ff700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fd41004feb0 0x7fd410052370 secure :-1 s=READY pgs=891 cs=0 l=1 rx=0x7fd4240030b0 tx=0x7fd4240079f0).stop 2020-05-18T21:39:12.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.164+0000 7fd42e2ff700 1 -- 172.21.15.63:0/2807925609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4280659e0 msgr2=0x7fd4281574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.164+0000 7fd42e2ff700 1 --2- 172.21.15.63:0/2807925609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4280659e0 0x7fd4281574a0 secure :-1 s=READY pgs=349 cs=0 l=1 rx=0x7fd418001020 tx=0x7fd418010bb0).stop 2020-05-18T21:39:12.175 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.164+0000 7fd42dafe700 1 -- 172.21.15.63:0/2807925609 reap_dead start 2020-05-18T21:39:12.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.164+0000 7fd42e2ff700 1 -- 172.21.15.63:0/2807925609 shutdown_connections 2020-05-18T21:39:12.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.164+0000 7fd42e2ff700 1 -- 172.21.15.63:0/2807925609 >> 172.21.15.63:0/2807925609 conn(0x7fd42805b210 msgr2=0x7fd4280b89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:12.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.164+0000 7fd42e2ff700 1 -- 172.21.15.63:0/2807925609 shutdown_connections 2020-05-18T21:39:12.176 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.168+0000 7fd42e2ff700 1 -- 172.21.15.63:0/2807925609 wait complete. 2020-05-18T21:39:12.176 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:39:12.177 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-05-18T21:39:12.177 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:39:12.184 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 2 2020-05-18T21:39:12.289 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f99108f3700 1 Processor -- start 2020-05-18T21:39:12.290 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f99108f3700 1 -- start start 2020-05-18T21:39:12.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f99108f3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f990c1434e0 0x7f990c145e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:12.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f99108f3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990c0b5d80 con 0x7f990c0b9200 2020-05-18T21:39:12.292 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f99108f3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990c0b6020 con 0x7f990c0b4270 2020-05-18T21:39:12.293 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f99108f3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990c0b62c0 con 0x7f990c1434e0 2020-05-18T21:39:12.294 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f990affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f990c1434e0 0x7f990c145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f990b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f990c0b9200 0x7f990c142dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39750/0 (socket says 172.21.15.63:39750) 2020-05-18T21:39:12.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f990b7fe700 1 -- 172.21.15.63:0/900191893 learned_addr learned my addr 172.21.15.63:0/900191893 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:12.295 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f990affd700 1 -- 172.21.15.63:0/900191893 >> v1:172.21.15.155:6789/0 conn(0x7f990c0b4270 legacy=0x7f990c0b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f990affd700 1 -- 172.21.15.63:0/900191893 >> v1:172.21.15.63:6789/0 conn(0x7f990c0b9200 legacy=0x7f990c142dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f990affd700 1 -- 172.21.15.63:0/900191893 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c0b95e0 con 0x7f990c1434e0 2020-05-18T21:39:12.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f990affd700 1 --2- 172.21.15.63:0/900191893 >> v2:172.21.15.63:3300/0 conn(0x7f990c1434e0 0x7f990c145e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f98fc0032f0 tx=0x7f98fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f990affd700 1 --2- 172.21.15.63:0/900191893 >> v2:172.21.15.63:3300/0 conn(0x7f990c1434e0 0x7f990c145e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f98fc0032f0 tx=0x7f98fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.296 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f990affd700 1 --2- 172.21.15.63:0/900191893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f990c1434e0 0x7f990c145e50 secure :-1 s=READY pgs=2276 cs=0 l=1 rx=0x7f98fc0032f0 tx=0x7f98fc007e00).ready entity=mon.0 client_cookie=fc63d89a8cb7812f server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:12.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f990affd700 1 --2- 172.21.15.63:0/900191893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f990c1434e0 0x7f990c145e50 secure :-1 s=THROTTLE_DONE pgs=2276 cs=0 l=1 rx=0x7f98fc0032f0 tx=0x7f98fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f990a7fc700 1 -- 172.21.15.63:0/900191893 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98fc00a180 con 0x7f990c1434e0 2020-05-18T21:39:12.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f990affd700 1 --2- 172.21.15.63:0/900191893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f990c1434e0 0x7f990c145e50 secure :-1 s=THROTTLE_DONE pgs=2276 cs=0 l=1 rx=0x7f98fc0032f0 tx=0x7f98fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f990a7fc700 1 -- 172.21.15.63:0/900191893 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc00a2e0 con 0x7f990c1434e0 2020-05-18T21:39:12.297 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f990affd700 1 --2- 172.21.15.63:0/900191893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f990c1434e0 0x7f990c145e50 secure :-1 s=THROTTLE_DONE pgs=2276 cs=0 l=1 rx=0x7f98fc0032f0 tx=0x7f98fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f990a7fc700 1 -- 172.21.15.63:0/900191893 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98fc00a700 con 0x7f990c1434e0 2020-05-18T21:39:12.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f99108f3700 1 -- 172.21.15.63:0/900191893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f990c1434e0 msgr2=0x7f990c145e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.298 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f99108f3700 1 --2- 172.21.15.63:0/900191893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f990c1434e0 0x7f990c145e50 secure :-1 s=READY pgs=2276 cs=0 l=1 rx=0x7f98fc0032f0 tx=0x7f98fc007e00).stop 2020-05-18T21:39:12.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f99108f3700 1 -- 172.21.15.63:0/900191893 shutdown_connections 2020-05-18T21:39:12.302 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f99108f3700 1 --2- 172.21.15.63:0/900191893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f990c1434e0 0x7f990c145e50 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:12.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.284+0000 7f99108f3700 1 -- 172.21.15.63:0/900191893 >> 172.21.15.63:0/900191893 conn(0x7f990c069b70 msgr2=0x7f990c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:12.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f99108f3700 1 -- 172.21.15.63:0/900191893 shutdown_connections 2020-05-18T21:39:12.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f99108f3700 1 -- 172.21.15.63:0/900191893 wait complete. 2020-05-18T21:39:12.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f99108f3700 1 Processor -- start 2020-05-18T21:39:12.303 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f99108f3700 1 -- start start 2020-05-18T21:39:12.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f99108f3700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f990c0b4270 0x7f990c145310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:12.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f99108f3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f990c0b9200 0x7f990c13fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:12.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f99108f3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990c13ffe0 con 0x7f990c1434e0 2020-05-18T21:39:12.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f99108f3700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990c148be0 con 0x7f990c0b4270 2020-05-18T21:39:12.304 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f99108f3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990c142050 con 0x7f990c0b9200 2020-05-18T21:39:12.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f990b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f990c0b4270 0x7f990c145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f990b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f990c0b4270 0x7f990c145310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37568/0 (socket says 172.21.15.63:37568) 2020-05-18T21:39:12.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f990b7fe700 1 -- 172.21.15.63:0/1748030102 learned_addr learned my addr 172.21.15.63:0/1748030102 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:12.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f990affd700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f990c0b9200 0x7f990c13fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.305 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f990b7fe700 1 -- 172.21.15.63:0/1748030102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f990c0b9200 msgr2=0x7f990c13fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f990b7fe700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f990c0b9200 0x7f990c13fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:12.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f990b7fe700 1 -- 172.21.15.63:0/1748030102 >> v1:172.21.15.155:6789/0 conn(0x7f990c1434e0 legacy=0x7f990c060ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f9908ff9700 1 -- 172.21.15.63:0/1748030102 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189507942 0 0) 0x7f990c13ffe0 con 0x7f990c1434e0 2020-05-18T21:39:12.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f990b7fe700 1 -- 172.21.15.63:0/1748030102 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c1422f0 con 0x7f990c0b4270 2020-05-18T21:39:12.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f990b7fe700 1 --2- 172.21.15.63:0/1748030102 >> v2:172.21.15.63:3300/0 conn(0x7f990c0b4270 0x7f990c145310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f990c05bd50 tx=0x7f98f4010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f990b7fe700 1 --2- 172.21.15.63:0/1748030102 >> v2:172.21.15.63:3300/0 conn(0x7f990c0b4270 0x7f990c145310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f990c05bd50 tx=0x7f98f4010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.288+0000 7f990b7fe700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f990c0b4270 0x7f990c145310 secure :-1 s=READY pgs=2277 cs=0 l=1 rx=0x7f990c05bd50 tx=0x7f98f4010940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:12.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.292+0000 7f990b7fe700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f990c0b4270 0x7f990c145310 secure :-1 s=THROTTLE_DONE pgs=2277 cs=0 l=1 rx=0x7f990c05bd50 tx=0x7f98f4010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.292+0000 7f9908ff9700 1 -- 172.21.15.63:0/1748030102 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98f4005ce0 con 0x7f990c0b4270 2020-05-18T21:39:12.307 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.292+0000 7f990b7fe700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f990c0b4270 0x7f990c145310 secure :-1 s=THROTTLE_DONE pgs=2277 cs=0 l=1 rx=0x7f990c05bd50 tx=0x7f98f4010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.292+0000 7f990b7fe700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f990c0b4270 0x7f990c145310 secure :-1 s=THROTTLE_DONE pgs=2277 cs=0 l=1 rx=0x7f990c05bd50 tx=0x7f98f4010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.292+0000 7f9908ff9700 1 -- 172.21.15.63:0/1748030102 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f4005e40 con 0x7f990c0b4270 2020-05-18T21:39:12.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.292+0000 7f9908ff9700 1 -- 172.21.15.63:0/1748030102 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98f40062c0 con 0x7f990c0b4270 2020-05-18T21:39:12.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.292+0000 7f99108f3700 1 -- 172.21.15.63:0/1748030102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f990c0613b0 con 0x7f990c0b4270 2020-05-18T21:39:12.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.292+0000 7f99108f3700 1 -- 172.21.15.63:0/1748030102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990c0ac4d0 con 0x7f990c0b4270 2020-05-18T21:39:12.308 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.292+0000 7f990b7fe700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f990c0b4270 0x7f990c145310 secure :-1 s=THROTTLE_DONE pgs=2277 cs=0 l=1 rx=0x7f990c05bd50 tx=0x7f98f4010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.292+0000 7f99108f3700 1 -- 172.21.15.63:0/1748030102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f990c148a00 con 0x7f990c0b4270 2020-05-18T21:39:12.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.292+0000 7f9908ff9700 1 -- 172.21.15.63:0/1748030102 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f98f40064f0 con 0x7f990c0b4270 2020-05-18T21:39:12.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.292+0000 7f990b7fe700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f990c0b4270 0x7f990c145310 secure :-1 s=THROTTLE_DONE pgs=2277 cs=0 l=1 rx=0x7f990c05bd50 tx=0x7f98f4010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.292+0000 7f9908ff9700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f98f004f8e0 0x7f98f0051da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:12.309 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.292+0000 7f9908ff9700 1 -- 172.21.15.63:0/1748030102 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f98f40090c0 con 0x7f990c0b4270 2020-05-18T21:39:12.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.292+0000 7f990affd700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f98f004f8e0 0x7f98f0051da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.296+0000 7f990affd700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f98f004f8e0 0x7f98f0051da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f98fc0032f0 tx=0x7f98fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.296+0000 7f990affd700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f98f004f8e0 0x7f98f0051da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f98fc0032f0 tx=0x7f98fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.310 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.296+0000 7f990affd700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f98f004f8e0 0x7f98f0051da0 secure :-1 s=READY pgs=892 cs=0 l=1 rx=0x7f98fc0032f0 tx=0x7f98fc007e00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:12.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.300+0000 7f990b7fe700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f990c0b4270 0x7f990c145310 secure :-1 s=THROTTLE_DONE pgs=2277 cs=0 l=1 rx=0x7f990c05bd50 tx=0x7f98f4010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.311 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.300+0000 7f9908ff9700 1 -- 172.21.15.63:0/1748030102 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f98f403e070 con 0x7f990c0b4270 2020-05-18T21:39:12.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.420+0000 7f99108f3700 1 -- 172.21.15.63:0/1748030102 --> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f990c142480 con 0x7f98f004f8e0 2020-05-18T21:39:12.427 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.420+0000 7f990affd700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f98f004f8e0 0x7f98f0051da0 secure :-1 s=THROTTLE_DONE pgs=892 cs=0 l=1 rx=0x7f98fc0032f0 tx=0x7f98fc007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.428 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.420+0000 7f9908ff9700 1 -- 172.21.15.63:0/1748030102 <== mgr.4110 v2:172.21.15.155:6832/12649 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f990c142480 con 0x7f98f004f8e0 2020-05-18T21:39:12.429 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.424+0000 7f99108f3700 1 -- 172.21.15.63:0/1748030102 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f98f004f8e0 msgr2=0x7f98f0051da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.424+0000 7f99108f3700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f98f004f8e0 0x7f98f0051da0 secure :-1 s=READY pgs=892 cs=0 l=1 rx=0x7f98fc0032f0 tx=0x7f98fc007e00).stop 2020-05-18T21:39:12.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.424+0000 7f99108f3700 1 -- 172.21.15.63:0/1748030102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f990c0b4270 msgr2=0x7f990c145310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.424+0000 7f99108f3700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f990c0b4270 0x7f990c145310 secure :-1 s=READY pgs=2277 cs=0 l=1 rx=0x7f990c05bd50 tx=0x7f98f4010940).stop 2020-05-18T21:39:12.430 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.424+0000 7f99108f3700 1 -- 172.21.15.63:0/1748030102 shutdown_connections 2020-05-18T21:39:12.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.424+0000 7f99108f3700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f98f004f8e0 0x7f98f0051da0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:12.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.424+0000 7f99108f3700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f990c0b9200 0x7f990c13fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:12.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.424+0000 7f99108f3700 1 --2- 172.21.15.63:0/1748030102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f990c0b4270 0x7f990c145310 unknown :-1 s=CLOSED pgs=2277 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:12.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.424+0000 7f99108f3700 1 -- 172.21.15.63:0/1748030102 >> 172.21.15.63:0/1748030102 conn(0x7f990c069b70 msgr2=0x7f990c0b5270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:12.431 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.424+0000 7f99108f3700 1 -- 172.21.15.63:0/1748030102 shutdown_connections 2020-05-18T21:39:12.432 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.424+0000 7f99108f3700 1 -- 172.21.15.63:0/1748030102 wait complete. 2020-05-18T21:39:12.432 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 2 to deep-scrub 2020-05-18T21:39:12.441 INFO:tasks.ceph:Scrubbing osd.3 2020-05-18T21:39:12.441 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 config set osd_debug_deep_scrub_sleep 0 2020-05-18T21:39:12.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.544+0000 7fa123527700 1 Processor -- start 2020-05-18T21:39:12.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.544+0000 7fa123527700 1 -- start start 2020-05-18T21:39:12.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa123527700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c145e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:12.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa123527700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11c146420 con 0x7fa11c0bc8d0 2020-05-18T21:39:12.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa123527700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11c1466c0 con 0x7fa11c143630 2020-05-18T21:39:12.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa123527700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c146e00 con 0x7fa11c060b00 2020-05-18T21:39:12.556 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa122525700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa11c0bc8d0 0x7fa11c142f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39764/0 (socket says 172.21.15.63:39764) 2020-05-18T21:39:12.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa122525700 1 -- 172.21.15.63:0/777129572 learned_addr learned my addr 172.21.15.63:0/777129572 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:12.557 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa122d26700 1 --2- 172.21.15.63:0/777129572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa121523700 1 -- 172.21.15.63:0/777129572 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424907516 0 0) 0x7fa11c146420 con 0x7fa11c0bc8d0 2020-05-18T21:39:12.562 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa121523700 1 -- 172.21.15.63:0/777129572 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa104003270 con 0x7fa11c0bc8d0 2020-05-18T21:39:12.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa121523700 1 -- 172.21.15.63:0/777129572 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158302770 0 0) 0x7fa11c1466c0 con 0x7fa11c143630 2020-05-18T21:39:12.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa121523700 1 -- 172.21.15.63:0/777129572 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa11c146420 con 0x7fa11c143630 2020-05-18T21:39:12.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa122d26700 1 -- 172.21.15.63:0/777129572 >> v1:172.21.15.155:6789/0 conn(0x7fa11c143630 legacy=0x7fa11c12e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa122d26700 1 -- 172.21.15.63:0/777129572 >> v1:172.21.15.63:6789/0 conn(0x7fa11c0bc8d0 legacy=0x7fa11c142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.563 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa122d26700 1 -- 172.21.15.63:0/777129572 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c146960 con 0x7fa11c060b00 2020-05-18T21:39:12.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa122d26700 1 --2- 172.21.15.63:0/777129572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c145e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa1140032f0 tx=0x7fa114008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa122d26700 1 --2- 172.21.15.63:0/777129572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c145e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa1140032f0 tx=0x7fa114008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa122d26700 1 --2- 172.21.15.63:0/777129572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c145e30 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7fa1140032f0 tx=0x7fa114008ca0).ready entity=mon.2 client_cookie=c2b0904d20e47573 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:12.564 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa122d26700 1 --2- 172.21.15.63:0/777129572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c145e30 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7fa1140032f0 tx=0x7fa114008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa121523700 1 -- 172.21.15.63:0/777129572 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa114011df0 con 0x7fa11c060b00 2020-05-18T21:39:12.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa122d26700 1 --2- 172.21.15.63:0/777129572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c145e30 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7fa1140032f0 tx=0x7fa114008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa121523700 1 -- 172.21.15.63:0/777129572 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11400a180 con 0x7fa11c060b00 2020-05-18T21:39:12.565 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa122d26700 1 --2- 172.21.15.63:0/777129572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c145e30 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7fa1140032f0 tx=0x7fa114008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa123527700 1 -- 172.21.15.63:0/777129572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 msgr2=0x7fa11c145e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa121523700 1 -- 172.21.15.63:0/777129572 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa11400a560 con 0x7fa11c060b00 2020-05-18T21:39:12.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa123527700 1 --2- 172.21.15.63:0/777129572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c145e30 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7fa1140032f0 tx=0x7fa114008ca0).stop 2020-05-18T21:39:12.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa123527700 1 -- 172.21.15.63:0/777129572 shutdown_connections 2020-05-18T21:39:12.566 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa123527700 1 --2- 172.21.15.63:0/777129572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c145e30 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:12.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa123527700 1 -- 172.21.15.63:0/777129572 >> 172.21.15.63:0/777129572 conn(0x7fa11c05f3b0 msgr2=0x7fa11c05f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:12.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa123527700 1 -- 172.21.15.63:0/777129572 shutdown_connections 2020-05-18T21:39:12.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.548+0000 7fa123527700 1 -- 172.21.15.63:0/777129572 wait complete. 2020-05-18T21:39:12.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.552+0000 7fa123527700 1 Processor -- start 2020-05-18T21:39:12.567 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.552+0000 7fa123527700 1 -- start start 2020-05-18T21:39:12.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.552+0000 7fa123527700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:12.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.552+0000 7fa123527700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11c0b3160 con 0x7fa11c0bc8d0 2020-05-18T21:39:12.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.552+0000 7fa123527700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11c0af050 con 0x7fa11c143630 2020-05-18T21:39:12.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.552+0000 7fa123527700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c0ac540 con 0x7fa11c060b00 2020-05-18T21:39:12.568 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.552+0000 7fa121d24700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa11c0bc8d0 0x7fa11c0b5620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39772/0 (socket says 172.21.15.63:39772) 2020-05-18T21:39:12.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.552+0000 7fa121d24700 1 -- 172.21.15.63:0/2180290910 learned_addr learned my addr 172.21.15.63:0/2180290910 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:12.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.552+0000 7fa122525700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.552+0000 7fa10b7fe700 1 -- 172.21.15.63:0/2180290910 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947715480 0 0) 0x7fa11c0b3160 con 0x7fa11c0bc8d0 2020-05-18T21:39:12.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.552+0000 7fa10b7fe700 1 -- 172.21.15.63:0/2180290910 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0fc002fe0 con 0x7fa11c0bc8d0 2020-05-18T21:39:12.569 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.552+0000 7fa10b7fe700 1 -- 172.21.15.63:0/2180290910 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540985526 0 0) 0x7fa11c0af050 con 0x7fa11c143630 2020-05-18T21:39:12.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.552+0000 7fa10b7fe700 1 -- 172.21.15.63:0/2180290910 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa11c0b3160 con 0x7fa11c143630 2020-05-18T21:39:12.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.552+0000 7fa122525700 1 -- 172.21.15.63:0/2180290910 >> v1:172.21.15.155:6789/0 conn(0x7fa11c143630 legacy=0x7fa11c146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.552+0000 7fa122525700 1 -- 172.21.15.63:0/2180290910 >> v1:172.21.15.63:6789/0 conn(0x7fa11c0bc8d0 legacy=0x7fa11c0b5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.552+0000 7fa10b7fe700 1 -- 172.21.15.63:0/2180290910 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2124157758 0 0) 0x7fa0fc002fe0 con 0x7fa11c0bc8d0 2020-05-18T21:39:12.570 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.552+0000 7fa122525700 1 -- 172.21.15.63:0/2180290910 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c0ac680 con 0x7fa11c060b00 2020-05-18T21:39:12.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.552+0000 7fa122525700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c156960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa10c002bc0 tx=0x7fa118010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.556+0000 7fa122525700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c156960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa10c002bc0 tx=0x7fa118010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.556+0000 7fa122525700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c156960 secure :-1 s=READY pgs=351 cs=0 l=1 rx=0x7fa10c002bc0 tx=0x7fa118010910).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:12.571 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.556+0000 7fa122525700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c156960 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7fa10c002bc0 tx=0x7fa118010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.556+0000 7fa10b7fe700 1 -- 172.21.15.63:0/2180290910 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa10c002a60 con 0x7fa11c060b00 2020-05-18T21:39:12.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.556+0000 7fa122525700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c156960 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7fa10c002bc0 tx=0x7fa118010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.556+0000 7fa10b7fe700 1 -- 172.21.15.63:0/2180290910 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa118005b10 con 0x7fa11c060b00 2020-05-18T21:39:12.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.556+0000 7fa123527700 1 -- 172.21.15.63:0/2180290910 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa11c0b2d30 con 0x7fa11c060b00 2020-05-18T21:39:12.572 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.556+0000 7fa122525700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c156960 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7fa10c002bc0 tx=0x7fa118010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.556+0000 7fa10b7fe700 1 -- 172.21.15.63:0/2180290910 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa118005e70 con 0x7fa11c060b00 2020-05-18T21:39:12.573 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.556+0000 7fa123527700 1 -- 172.21.15.63:0/2180290910 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa11c0af690 con 0x7fa11c060b00 2020-05-18T21:39:12.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.556+0000 7fa123527700 1 -- 172.21.15.63:0/2180290910 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa11c0af1e0 con 0x7fa11c060b00 2020-05-18T21:39:12.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.556+0000 7fa122525700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c156960 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7fa10c002bc0 tx=0x7fa118010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.556+0000 7fa10b7fe700 1 -- 172.21.15.63:0/2180290910 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7fa11800b440 con 0x7fa11c060b00 2020-05-18T21:39:12.575 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.556+0000 7fa122525700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c156960 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7fa10c002bc0 tx=0x7fa118010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.556+0000 7fa122525700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c156960 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7fa10c002bc0 tx=0x7fa118010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.556+0000 7fa10b7fe700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa0fc04fdd0 0x7fa0fc052290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:12.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.556+0000 7fa10b7fe700 1 -- 172.21.15.63:0/2180290910 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa1180090c0 con 0x7fa11c060b00 2020-05-18T21:39:12.576 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.560+0000 7fa10b7fe700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fa0fc056910 0x7fa0fc058d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:12.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.560+0000 7fa10b7fe700 1 -- 172.21.15.63:0/2180290910 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0fc059310 con 0x7fa0fc056910 2020-05-18T21:39:12.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.560+0000 7fa10b7fe700 1 -- 172.21.15.63:0/2180290910 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=169) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa118063ae0 con 0x7fa11c060b00 2020-05-18T21:39:12.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.560+0000 7fa121d24700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa0fc04fdd0 0x7fa0fc052290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.560+0000 7fa122d26700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fa0fc056910 0x7fa0fc058d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.577 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.560+0000 7fa121d24700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa0fc04fdd0 0x7fa0fc052290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa10c002c80 tx=0x7fa11c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.560+0000 7fa121d24700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa0fc04fdd0 0x7fa0fc052290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa10c002c80 tx=0x7fa11c061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.560+0000 7fa121d24700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa0fc04fdd0 0x7fa0fc052290 secure :-1 s=READY pgs=893 cs=0 l=1 rx=0x7fa10c002c80 tx=0x7fa11c061d60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:12.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.560+0000 7fa122d26700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fa0fc056910 0x7fa0fc058d30 crc :-1 s=READY pgs=36 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:12.578 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.560+0000 7fa10b7fe700 1 -- 172.21.15.63:0/2180290910 <== osd.3 v2:172.21.15.63:6814/12805 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23263 (crc 0 0 0) 0x7fa0fc059310 con 0x7fa0fc056910 2020-05-18T21:39:12.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.576+0000 7fa123527700 1 -- 172.21.15.63:0/2180290910 --> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa11c157000 con 0x7fa0fc056910 2020-05-18T21:39:12.584 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.576+0000 7fa10b7fe700 1 -- 172.21.15.63:0/2180290910 <== osd.3 v2:172.21.15.63:6814/12805 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa11c157000 con 0x7fa0fc056910 2020-05-18T21:39:12.585 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:39:12.585 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-05-18T21:39:12.585 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:39:12.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.580+0000 7fa123527700 1 -- 172.21.15.63:0/2180290910 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fa0fc056910 msgr2=0x7fa0fc058d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.580+0000 7fa123527700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.63:6814/12805,v1:172.21.15.63:6816/12805] conn(0x7fa0fc056910 0x7fa0fc058d30 crc :-1 s=READY pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:12.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.580+0000 7fa123527700 1 -- 172.21.15.63:0/2180290910 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa0fc04fdd0 msgr2=0x7fa0fc052290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.580+0000 7fa123527700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7fa0fc04fdd0 0x7fa0fc052290 secure :-1 s=READY pgs=893 cs=0 l=1 rx=0x7fa10c002c80 tx=0x7fa11c061d60).stop 2020-05-18T21:39:12.587 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.580+0000 7fa123527700 1 -- 172.21.15.63:0/2180290910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 msgr2=0x7fa11c156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.580+0000 7fa123527700 1 --2- 172.21.15.63:0/2180290910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c060b00 0x7fa11c156960 secure :-1 s=READY pgs=351 cs=0 l=1 rx=0x7fa10c002bc0 tx=0x7fa118010910).stop 2020-05-18T21:39:12.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.580+0000 7fa122d26700 1 -- 172.21.15.63:0/2180290910 reap_dead start 2020-05-18T21:39:12.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.580+0000 7fa123527700 1 -- 172.21.15.63:0/2180290910 shutdown_connections 2020-05-18T21:39:12.588 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.580+0000 7fa123527700 1 -- 172.21.15.63:0/2180290910 >> 172.21.15.63:0/2180290910 conn(0x7fa11c05f3b0 msgr2=0x7fa11c142cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:12.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.580+0000 7fa123527700 1 -- 172.21.15.63:0/2180290910 shutdown_connections 2020-05-18T21:39:12.589 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.580+0000 7fa123527700 1 -- 172.21.15.63:0/2180290910 wait complete. 2020-05-18T21:39:12.596 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 3 2020-05-18T21:39:12.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.696+0000 7f33df4de700 1 Processor -- start 2020-05-18T21:39:12.704 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.696+0000 7f33df4de700 1 -- start start 2020-05-18T21:39:12.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33df4de700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33d80b20b0 0x7f33d80b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:12.707 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33df4de700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f33d81459f0 0x7f33d80b4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:12.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33df4de700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d814a430 con 0x7f33d80b2490 2020-05-18T21:39:12.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33df4de700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d8149ef0 con 0x7f33d81459f0 2020-05-18T21:39:12.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33df4de700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d814a190 con 0x7f33d80b20b0 2020-05-18T21:39:12.708 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33dca79700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f33d80b2490 0x7f33d81452e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39780/0 (socket says 172.21.15.63:39780) 2020-05-18T21:39:12.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33dca79700 1 -- 172.21.15.63:0/2053236975 learned_addr learned my addr 172.21.15.63:0/2053236975 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:12.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33dda7b700 1 --2- 172.21.15.63:0/2053236975 >> v2:172.21.15.155:3300/0 conn(0x7f33d81459f0 0x7f33d80b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33dd27a700 1 --2- 172.21.15.63:0/2053236975 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33d80b20b0 0x7f33d80b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33cffff700 1 -- 172.21.15.63:0/2053236975 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613867933 0 0) 0x7f33d814a430 con 0x7f33d80b2490 2020-05-18T21:39:12.709 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33cffff700 1 -- 172.21.15.63:0/2053236975 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33bc003270 con 0x7f33d80b2490 2020-05-18T21:39:12.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33dda7b700 1 -- 172.21.15.63:0/2053236975 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33d80b20b0 msgr2=0x7f33d80b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:12.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33dda7b700 1 --2- 172.21.15.63:0/2053236975 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33d80b20b0 0x7f33d80b8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:12.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33dda7b700 1 -- 172.21.15.63:0/2053236975 >> v1:172.21.15.63:6789/0 conn(0x7f33d80b2490 legacy=0x7f33d81452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33dda7b700 1 -- 172.21.15.63:0/2053236975 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d80b3ec0 con 0x7f33d81459f0 2020-05-18T21:39:12.710 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33dda7b700 1 --2- 172.21.15.63:0/2053236975 >> v2:172.21.15.155:3300/0 conn(0x7f33d81459f0 0x7f33d80b4360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f33d00032f0 tx=0x7f33d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33dda7b700 1 --2- 172.21.15.63:0/2053236975 >> v2:172.21.15.155:3300/0 conn(0x7f33d81459f0 0x7f33d80b4360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f33d00032f0 tx=0x7f33d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33dda7b700 1 --2- 172.21.15.63:0/2053236975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d81459f0 0x7f33d80b4360 secure :-1 s=READY pgs=1517 cs=0 l=1 rx=0x7f33d00032f0 tx=0x7f33d0007e00).ready entity=mon.1 client_cookie=5e5a023b552a7f14 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:12.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33dda7b700 1 --2- 172.21.15.63:0/2053236975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d81459f0 0x7f33d80b4360 secure :-1 s=THROTTLE_DONE pgs=1517 cs=0 l=1 rx=0x7f33d00032f0 tx=0x7f33d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.711 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33cffff700 1 -- 172.21.15.63:0/2053236975 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d0011db0 con 0x7f33d81459f0 2020-05-18T21:39:12.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33dda7b700 1 --2- 172.21.15.63:0/2053236975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d81459f0 0x7f33d80b4360 secure :-1 s=THROTTLE_DONE pgs=1517 cs=0 l=1 rx=0x7f33d00032f0 tx=0x7f33d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33cffff700 1 -- 172.21.15.63:0/2053236975 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d000a180 con 0x7f33d81459f0 2020-05-18T21:39:12.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33dda7b700 1 --2- 172.21.15.63:0/2053236975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d81459f0 0x7f33d80b4360 secure :-1 s=THROTTLE_DONE pgs=1517 cs=0 l=1 rx=0x7f33d00032f0 tx=0x7f33d0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33cffff700 1 -- 172.21.15.63:0/2053236975 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d000a560 con 0x7f33d81459f0 2020-05-18T21:39:12.712 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33df4de700 1 -- 172.21.15.63:0/2053236975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d81459f0 msgr2=0x7f33d80b4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.713 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33df4de700 1 --2- 172.21.15.63:0/2053236975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d81459f0 0x7f33d80b4360 secure :-1 s=READY pgs=1517 cs=0 l=1 rx=0x7f33d00032f0 tx=0x7f33d0007e00).stop 2020-05-18T21:39:12.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33df4de700 1 -- 172.21.15.63:0/2053236975 shutdown_connections 2020-05-18T21:39:12.715 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33df4de700 1 --2- 172.21.15.63:0/2053236975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d81459f0 0x7f33d80b4360 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:12.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33df4de700 1 --2- 172.21.15.63:0/2053236975 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33d80b20b0 0x7f33d80b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:12.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33df4de700 1 -- 172.21.15.63:0/2053236975 >> 172.21.15.63:0/2053236975 conn(0x7f33d80b83b0 msgr2=0x7f33d80b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:12.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33df4de700 1 -- 172.21.15.63:0/2053236975 shutdown_connections 2020-05-18T21:39:12.716 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.700+0000 7f33df4de700 1 -- 172.21.15.63:0/2053236975 wait complete. 2020-05-18T21:39:12.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.704+0000 7f33df4de700 1 Processor -- start 2020-05-18T21:39:12.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.704+0000 7f33df4de700 1 -- start start 2020-05-18T21:39:12.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.704+0000 7f33df4de700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f33d80b20b0 0x7f33d8145e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:12.717 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.704+0000 7f33df4de700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d8147380 con 0x7f33d80b2490 2020-05-18T21:39:12.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.704+0000 7f33df4de700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d8147620 con 0x7f33d81459f0 2020-05-18T21:39:12.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.704+0000 7f33df4de700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d8147170 con 0x7f33d80b20b0 2020-05-18T21:39:12.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.704+0000 7f33dca79700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f33d80b2490 0x7f33d81390e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39788/0 (socket says 172.21.15.63:39788) 2020-05-18T21:39:12.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.704+0000 7f33dca79700 1 -- 172.21.15.63:0/3706496314 learned_addr learned my addr 172.21.15.63:0/3706496314 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:12.718 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.704+0000 7f33dd27a700 1 --2- 172.21.15.63:0/3706496314 >> v2:172.21.15.155:3300/0 conn(0x7f33d80b20b0 0x7f33d8145e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.704+0000 7f33ce7fc700 1 -- 172.21.15.63:0/3706496314 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940213701 0 0) 0x7f33d8147380 con 0x7f33d80b2490 2020-05-18T21:39:12.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.704+0000 7f33ce7fc700 1 -- 172.21.15.63:0/3706496314 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33c0002fe0 con 0x7f33d80b2490 2020-05-18T21:39:12.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.704+0000 7f33dd27a700 1 -- 172.21.15.63:0/3706496314 >> v1:172.21.15.155:6789/0 conn(0x7f33d81459f0 legacy=0x7f33d813abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.704+0000 7f33dd27a700 1 -- 172.21.15.63:0/3706496314 >> v1:172.21.15.63:6789/0 conn(0x7f33d80b2490 legacy=0x7f33d81390e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.719 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.704+0000 7f33dd27a700 1 -- 172.21.15.63:0/3706496314 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d8146d20 con 0x7f33d80b20b0 2020-05-18T21:39:12.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.704+0000 7f33dd27a700 1 --2- 172.21.15.63:0/3706496314 >> v2:172.21.15.155:3300/0 conn(0x7f33d80b20b0 0x7f33d8145e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f33c8002f70 tx=0x7f33d805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.704+0000 7f33dd27a700 1 --2- 172.21.15.63:0/3706496314 >> v2:172.21.15.155:3300/0 conn(0x7f33d80b20b0 0x7f33d8145e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f33c8002f70 tx=0x7f33d805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.704+0000 7f33dd27a700 1 --2- 172.21.15.63:0/3706496314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d80b20b0 0x7f33d8145e00 secure :-1 s=READY pgs=1519 cs=0 l=1 rx=0x7f33c8002f70 tx=0x7f33d805b560).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:12.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.708+0000 7f33dd27a700 1 --2- 172.21.15.63:0/3706496314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d80b20b0 0x7f33d8145e00 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7f33c8002f70 tx=0x7f33d805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.720 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.708+0000 7f33ce7fc700 1 -- 172.21.15.63:0/3706496314 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33c8007550 con 0x7f33d80b20b0 2020-05-18T21:39:12.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.708+0000 7f33dd27a700 1 --2- 172.21.15.63:0/3706496314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d80b20b0 0x7f33d8145e00 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7f33c8002f70 tx=0x7f33d805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.708+0000 7f33dd27a700 1 --2- 172.21.15.63:0/3706496314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d80b20b0 0x7f33d8145e00 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7f33c8002f70 tx=0x7f33d805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.708+0000 7f33ce7fc700 1 -- 172.21.15.63:0/3706496314 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c8005700 con 0x7f33d80b20b0 2020-05-18T21:39:12.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.708+0000 7f33df4de700 1 -- 172.21.15.63:0/3706496314 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d813a660 con 0x7f33d80b20b0 2020-05-18T21:39:12.721 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.708+0000 7f33ce7fc700 1 -- 172.21.15.63:0/3706496314 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33c8005aa0 con 0x7f33d80b20b0 2020-05-18T21:39:12.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.708+0000 7f33df4de700 1 -- 172.21.15.63:0/3706496314 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d8139990 con 0x7f33d80b20b0 2020-05-18T21:39:12.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.708+0000 7f33dd27a700 1 --2- 172.21.15.63:0/3706496314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d80b20b0 0x7f33d8145e00 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7f33c8002f70 tx=0x7f33d805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.722 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.708+0000 7f33df4de700 1 -- 172.21.15.63:0/3706496314 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d80569e0 con 0x7f33d80b20b0 2020-05-18T21:39:12.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.708+0000 7f33ce7fc700 1 -- 172.21.15.63:0/3706496314 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f33c8005d10 con 0x7f33d80b20b0 2020-05-18T21:39:12.723 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.708+0000 7f33dd27a700 1 --2- 172.21.15.63:0/3706496314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d80b20b0 0x7f33d8145e00 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7f33c8002f70 tx=0x7f33d805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.708+0000 7f33ce7fc700 1 --2- 172.21.15.63:0/3706496314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f33c004fd30 0x7f33c00521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:12.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.708+0000 7f33ce7fc700 1 -- 172.21.15.63:0/3706496314 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f33c80640a0 con 0x7f33d80b20b0 2020-05-18T21:39:12.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.708+0000 7f33dca79700 1 --2- 172.21.15.63:0/3706496314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f33c004fd30 0x7f33c00521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.712+0000 7f33dca79700 1 --2- 172.21.15.63:0/3706496314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f33c004fd30 0x7f33c00521f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f33d4001000 tx=0x7f33d4001740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.724 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.712+0000 7f33dca79700 1 --2- 172.21.15.63:0/3706496314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f33c004fd30 0x7f33c00521f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f33d4001000 tx=0x7f33d4001740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.725 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.712+0000 7f33dca79700 1 --2- 172.21.15.63:0/3706496314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f33c004fd30 0x7f33c00521f0 secure :-1 s=READY pgs=894 cs=0 l=1 rx=0x7f33d4001000 tx=0x7f33d4001740).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:12.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.720+0000 7f33dd27a700 1 --2- 172.21.15.63:0/3706496314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d80b20b0 0x7f33d8145e00 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7f33c8002f70 tx=0x7f33d805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.726 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.720+0000 7f33ce7fc700 1 -- 172.21.15.63:0/3706496314 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f33c803e490 con 0x7f33d80b20b0 2020-05-18T21:39:12.843 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.836+0000 7f33df4de700 1 -- 172.21.15.63:0/3706496314 --> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f33d8066810 con 0x7f33c004fd30 2020-05-18T21:39:12.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.836+0000 7f33dca79700 1 --2- 172.21.15.63:0/3706496314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f33c004fd30 0x7f33c00521f0 secure :-1 s=THROTTLE_DONE pgs=894 cs=0 l=1 rx=0x7f33d4001000 tx=0x7f33d4001740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.844 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.836+0000 7f33ce7fc700 1 -- 172.21.15.63:0/3706496314 <== mgr.4110 v2:172.21.15.155:6832/12649 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f33d8066810 con 0x7f33c004fd30 2020-05-18T21:39:12.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.840+0000 7f33df4de700 1 -- 172.21.15.63:0/3706496314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f33c004fd30 msgr2=0x7f33c00521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.846 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.840+0000 7f33df4de700 1 --2- 172.21.15.63:0/3706496314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f33c004fd30 0x7f33c00521f0 secure :-1 s=READY pgs=894 cs=0 l=1 rx=0x7f33d4001000 tx=0x7f33d4001740).stop 2020-05-18T21:39:12.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.840+0000 7f33df4de700 1 -- 172.21.15.63:0/3706496314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d80b20b0 msgr2=0x7f33d8145e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.840+0000 7f33df4de700 1 --2- 172.21.15.63:0/3706496314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d80b20b0 0x7f33d8145e00 secure :-1 s=READY pgs=1519 cs=0 l=1 rx=0x7f33c8002f70 tx=0x7f33d805b560).stop 2020-05-18T21:39:12.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.840+0000 7f33df4de700 1 -- 172.21.15.63:0/3706496314 shutdown_connections 2020-05-18T21:39:12.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.840+0000 7f33df4de700 1 --2- 172.21.15.63:0/3706496314 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f33c004fd30 0x7f33c00521f0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:12.847 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.840+0000 7f33df4de700 1 --2- 172.21.15.63:0/3706496314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d80b20b0 0x7f33d8145e00 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:12.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.840+0000 7f33df4de700 1 -- 172.21.15.63:0/3706496314 >> 172.21.15.63:0/3706496314 conn(0x7f33d80b83b0 msgr2=0x7f33d805ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:12.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.840+0000 7f33df4de700 1 -- 172.21.15.63:0/3706496314 shutdown_connections 2020-05-18T21:39:12.848 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.840+0000 7f33df4de700 1 -- 172.21.15.63:0/3706496314 wait complete. 2020-05-18T21:39:12.849 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 3 to deep-scrub 2020-05-18T21:39:12.857 INFO:tasks.ceph:Scrubbing osd.4 2020-05-18T21:39:12.858 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 config set osd_debug_deep_scrub_sleep 0 2020-05-18T21:39:12.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f16476700 1 Processor -- start 2020-05-18T21:39:12.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f16476700 1 -- start start 2020-05-18T21:39:12.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f16476700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8f10143630 0x7f8f10060b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:12.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f16476700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f10145e30 0x7f8f1012e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:12.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f16476700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f10146420 con 0x7f8f100bc8d0 2020-05-18T21:39:12.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f16476700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f10146e00 con 0x7f8f10143630 2020-05-18T21:39:12.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f16476700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f101466c0 con 0x7f8f10145e30 2020-05-18T21:39:12.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f14c73700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8f10143630 0x7f8f10060b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f14c73700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8f10143630 0x7f8f10060b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37608/0 (socket says 172.21.15.63:37608) 2020-05-18T21:39:12.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f15474700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8f100bc8d0 0x7f8f10142f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39794/0 (socket says 172.21.15.63:39794) 2020-05-18T21:39:12.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f14c73700 1 -- 172.21.15.63:0/3323223920 learned_addr learned my addr 172.21.15.63:0/3323223920 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:12.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f15c75700 1 --2- 172.21.15.63:0/3323223920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f10145e30 0x7f8f1012e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f14c73700 1 -- 172.21.15.63:0/3323223920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f10145e30 msgr2=0x7f8f1012e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:12.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f14c73700 1 --2- 172.21.15.63:0/3323223920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f10145e30 0x7f8f1012e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:12.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f14c73700 1 -- 172.21.15.63:0/3323223920 >> v1:172.21.15.63:6789/0 conn(0x7f8f100bc8d0 legacy=0x7f8f10142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f14c73700 1 -- 172.21.15.63:0/3323223920 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f10146960 con 0x7f8f10143630 2020-05-18T21:39:12.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f15c75700 1 --2- 172.21.15.63:0/3323223920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f10145e30 0x7f8f1012e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:39:12.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f14c73700 1 --2- 172.21.15.63:0/3323223920 >> v2:172.21.15.63:3300/0 conn(0x7f8f10143630 0x7f8f10060b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8f04002f70 tx=0x7f8f10061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f14c73700 1 --2- 172.21.15.63:0/3323223920 >> v2:172.21.15.63:3300/0 conn(0x7f8f10143630 0x7f8f10060b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8f04002f70 tx=0x7f8f10061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f14c73700 1 --2- 172.21.15.63:0/3323223920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f10143630 0x7f8f10060b00 secure :-1 s=READY pgs=2283 cs=0 l=1 rx=0x7f8f04002f70 tx=0x7f8f10061d60).ready entity=mon.0 client_cookie=8601a990164208a0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:12.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f14c73700 1 --2- 172.21.15.63:0/3323223920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f10143630 0x7f8f10060b00 secure :-1 s=THROTTLE_DONE pgs=2283 cs=0 l=1 rx=0x7f8f04002f70 tx=0x7f8f10061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f14c73700 1 --2- 172.21.15.63:0/3323223920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f10143630 0x7f8f10060b00 secure :-1 s=THROTTLE_DONE pgs=2283 cs=0 l=1 rx=0x7f8f04002f70 tx=0x7f8f10061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f0ffff700 1 -- 172.21.15.63:0/3323223920 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f04011760 con 0x7f8f10143630 2020-05-18T21:39:12.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f14c73700 1 --2- 172.21.15.63:0/3323223920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f10143630 0x7f8f10060b00 secure :-1 s=THROTTLE_DONE pgs=2283 cs=0 l=1 rx=0x7f8f04002f70 tx=0x7f8f10061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f0ffff700 1 -- 172.21.15.63:0/3323223920 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f040118c0 con 0x7f8f10143630 2020-05-18T21:39:12.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f0ffff700 1 -- 172.21.15.63:0/3323223920 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f04011ce0 con 0x7f8f10143630 2020-05-18T21:39:12.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f16476700 1 -- 172.21.15.63:0/3323223920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f10143630 msgr2=0x7f8f10060b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.960+0000 7f8f16476700 1 --2- 172.21.15.63:0/3323223920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f10143630 0x7f8f10060b00 secure :-1 s=READY pgs=2283 cs=0 l=1 rx=0x7f8f04002f70 tx=0x7f8f10061d60).stop 2020-05-18T21:39:12.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.964+0000 7f8f16476700 1 -- 172.21.15.63:0/3323223920 shutdown_connections 2020-05-18T21:39:12.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.964+0000 7f8f16476700 1 --2- 172.21.15.63:0/3323223920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f10145e30 0x7f8f1012e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:12.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.964+0000 7f8f16476700 1 --2- 172.21.15.63:0/3323223920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f10143630 0x7f8f10060b00 unknown :-1 s=CLOSED pgs=2283 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:12.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.964+0000 7f8f16476700 1 -- 172.21.15.63:0/3323223920 >> 172.21.15.63:0/3323223920 conn(0x7f8f1005f3b0 msgr2=0x7f8f1005f790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:12.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.964+0000 7f8f16476700 1 -- 172.21.15.63:0/3323223920 shutdown_connections 2020-05-18T21:39:12.978 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.964+0000 7f8f16476700 1 -- 172.21.15.63:0/3323223920 wait complete. 2020-05-18T21:39:12.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.964+0000 7f8f16476700 1 Processor -- start 2020-05-18T21:39:12.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.964+0000 7f8f16476700 1 -- start start 2020-05-18T21:39:12.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.964+0000 7f8f16476700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8f100bc8d0 0x7f8f10145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:12.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.964+0000 7f8f16476700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8f10143630 0x7f8f100bbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:12.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.964+0000 7f8f16476700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f100bc130 con 0x7f8f10145e30 2020-05-18T21:39:12.979 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.964+0000 7f8f16476700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f10144d70 con 0x7f8f100bc8d0 2020-05-18T21:39:12.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.964+0000 7f8f16476700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f10156ab0 con 0x7f8f10143630 2020-05-18T21:39:12.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.964+0000 7f8f15474700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8f100bc8d0 0x7f8f10145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.964+0000 7f8f15c75700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8f10145e30 0x7f8f10153360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39802/0 (socket says 172.21.15.63:39802) 2020-05-18T21:39:12.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.964+0000 7f8f15c75700 1 -- 172.21.15.63:0/3812685502 learned_addr learned my addr 172.21.15.63:0/3812685502 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:12.980 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.964+0000 7f8f14c73700 1 --2- 172.21.15.63:0/3812685502 >> v2:172.21.15.155:3300/0 conn(0x7f8f10143630 0x7f8f100bbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f0e7fc700 1 -- 172.21.15.63:0/3812685502 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207919468 0 0) 0x7f8f100bc130 con 0x7f8f10145e30 2020-05-18T21:39:12.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f0e7fc700 1 -- 172.21.15.63:0/3812685502 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ef0002fe0 con 0x7f8f10145e30 2020-05-18T21:39:12.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f15474700 1 -- 172.21.15.63:0/3812685502 >> v2:172.21.15.155:3300/0 conn(0x7f8f10143630 msgr2=0x7f8f100bbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f15474700 1 --2- 172.21.15.63:0/3812685502 >> v2:172.21.15.155:3300/0 conn(0x7f8f10143630 0x7f8f100bbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:12.981 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f15474700 1 -- 172.21.15.63:0/3812685502 >> v1:172.21.15.63:6789/0 conn(0x7f8f10145e30 legacy=0x7f8f10153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f15474700 1 -- 172.21.15.63:0/3812685502 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f10153a70 con 0x7f8f100bc8d0 2020-05-18T21:39:12.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f14c73700 1 --2- 172.21.15.63:0/3812685502 >> v2:172.21.15.155:3300/0 conn(0x7f8f10143630 0x7f8f100bbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:39:12.982 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f15474700 1 --2- 172.21.15.63:0/3812685502 >> v2:172.21.15.63:3300/0 conn(0x7f8f100bc8d0 0x7f8f10145760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8f100bc550 tx=0x7f8f000108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f15474700 1 --2- 172.21.15.63:0/3812685502 >> v2:172.21.15.63:3300/0 conn(0x7f8f100bc8d0 0x7f8f10145760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8f100bc550 tx=0x7f8f000108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f15474700 1 --2- 172.21.15.63:0/3812685502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f100bc8d0 0x7f8f10145760 secure :-1 s=READY pgs=2285 cs=0 l=1 rx=0x7f8f100bc550 tx=0x7f8f000108b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:12.983 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f15474700 1 --2- 172.21.15.63:0/3812685502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f100bc8d0 0x7f8f10145760 secure :-1 s=THROTTLE_DONE pgs=2285 cs=0 l=1 rx=0x7f8f100bc550 tx=0x7f8f000108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f0e7fc700 1 -- 172.21.15.63:0/3812685502 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f000115c0 con 0x7f8f100bc8d0 2020-05-18T21:39:12.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f15474700 1 --2- 172.21.15.63:0/3812685502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f100bc8d0 0x7f8f10145760 secure :-1 s=THROTTLE_DONE pgs=2285 cs=0 l=1 rx=0x7f8f100bc550 tx=0x7f8f000108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f15474700 1 --2- 172.21.15.63:0/3812685502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f100bc8d0 0x7f8f10145760 secure :-1 s=THROTTLE_DONE pgs=2285 cs=0 l=1 rx=0x7f8f100bc550 tx=0x7f8f000108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f0e7fc700 1 -- 172.21.15.63:0/3812685502 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f00011720 con 0x7f8f100bc8d0 2020-05-18T21:39:12.984 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f16476700 1 -- 172.21.15.63:0/3812685502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f101448d0 con 0x7f8f100bc8d0 2020-05-18T21:39:12.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f0e7fc700 1 -- 172.21.15.63:0/3812685502 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f00011b40 con 0x7f8f100bc8d0 2020-05-18T21:39:12.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f16476700 1 -- 172.21.15.63:0/3812685502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f10157170 con 0x7f8f100bc8d0 2020-05-18T21:39:12.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f15474700 1 --2- 172.21.15.63:0/3812685502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f100bc8d0 0x7f8f10145760 secure :-1 s=THROTTLE_DONE pgs=2285 cs=0 l=1 rx=0x7f8f100bc550 tx=0x7f8f000108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f16476700 1 -- 172.21.15.63:0/3812685502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8f10156930 con 0x7f8f100bc8d0 2020-05-18T21:39:12.985 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f0e7fc700 1 -- 172.21.15.63:0/3812685502 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f8f0000b370 con 0x7f8f100bc8d0 2020-05-18T21:39:12.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f15474700 1 --2- 172.21.15.63:0/3812685502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f100bc8d0 0x7f8f10145760 secure :-1 s=THROTTLE_DONE pgs=2285 cs=0 l=1 rx=0x7f8f100bc550 tx=0x7f8f000108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f15474700 1 --2- 172.21.15.63:0/3812685502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f100bc8d0 0x7f8f10145760 secure :-1 s=THROTTLE_DONE pgs=2285 cs=0 l=1 rx=0x7f8f100bc550 tx=0x7f8f000108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f0e7fc700 1 --2- 172.21.15.63:0/3812685502 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8ef004fd80 0x7f8ef0052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:12.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f0e7fc700 1 -- 172.21.15.63:0/3812685502 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8f00063da0 con 0x7f8f100bc8d0 2020-05-18T21:39:12.986 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f0e7fc700 1 --2- 172.21.15.63:0/3812685502 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x7f8ef0056950 0x7f8ef0058d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:12.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f0e7fc700 1 -- 172.21.15.63:0/3812685502 --> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ef0059350 con 0x7f8ef0056950 2020-05-18T21:39:12.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f0e7fc700 1 -- 172.21.15.63:0/3812685502 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=169) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f00065220 con 0x7f8f100bc8d0 2020-05-18T21:39:12.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f14c73700 1 --2- 172.21.15.63:0/3812685502 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8ef004fd80 0x7f8ef0052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f14c73700 1 --2- 172.21.15.63:0/3812685502 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8ef004fd80 0x7f8ef0052240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8f04002f70 tx=0x7f8f10061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.987 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f15c75700 1 --2- 172.21.15.63:0/3812685502 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x7f8ef0056950 0x7f8ef0058d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:12.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f14c73700 1 --2- 172.21.15.63:0/3812685502 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8ef004fd80 0x7f8ef0052240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8f04002f70 tx=0x7f8f10061d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:12.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.968+0000 7f8f14c73700 1 --2- 172.21.15.63:0/3812685502 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8ef004fd80 0x7f8ef0052240 secure :-1 s=READY pgs=895 cs=0 l=1 rx=0x7f8f04002f70 tx=0x7f8f10061d60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:12.988 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.972+0000 7f8f15c75700 1 --2- 172.21.15.63:0/3812685502 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x7f8ef0056950 0x7f8ef0058d70 crc :-1 s=READY pgs=38 cs=0 l=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.972+0000 7f8f0e7fc700 1 -- 172.21.15.63:0/3812685502 <== osd.4 v2:172.21.15.155:6800/13023 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23263 (crc 0 0 0) 0x7f8ef0059350 con 0x7f8ef0056950 2020-05-18T21:39:12.996 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.988+0000 7f8f16476700 1 -- 172.21.15.63:0/3812685502 --> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8f10144bb0 con 0x7f8ef0056950 2020-05-18T21:39:12.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.992+0000 7f8f0e7fc700 1 -- 172.21.15.63:0/3812685502 <== osd.4 v2:172.21.15.155:6800/13023 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8f10144bb0 con 0x7f8ef0056950 2020-05-18T21:39:12.998 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.992+0000 7f8f16476700 1 -- 172.21.15.63:0/3812685502 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x7f8ef0056950 msgr2=0x7f8ef0058d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.992+0000 7f8f16476700 1 --2- 172.21.15.63:0/3812685502 >> [v2:172.21.15.155:6800/13023,v1:172.21.15.155:6801/13023] conn(0x7f8ef0056950 0x7f8ef0058d70 crc :-1 s=READY pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:12.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.992+0000 7f8f16476700 1 -- 172.21.15.63:0/3812685502 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8ef004fd80 msgr2=0x7f8ef0052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:12.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.992+0000 7f8f16476700 1 --2- 172.21.15.63:0/3812685502 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f8ef004fd80 0x7f8ef0052240 secure :-1 s=READY pgs=895 cs=0 l=1 rx=0x7f8f04002f70 tx=0x7f8f10061d60).stop 2020-05-18T21:39:12.999 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.992+0000 7f8f16476700 1 -- 172.21.15.63:0/3812685502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f100bc8d0 msgr2=0x7f8f10145760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.992+0000 7f8f16476700 1 --2- 172.21.15.63:0/3812685502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f100bc8d0 0x7f8f10145760 secure :-1 s=READY pgs=2285 cs=0 l=1 rx=0x7f8f100bc550 tx=0x7f8f000108b0).stop 2020-05-18T21:39:13.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.992+0000 7f8f15c75700 1 -- 172.21.15.63:0/3812685502 reap_dead start 2020-05-18T21:39:13.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.992+0000 7f8f16476700 1 -- 172.21.15.63:0/3812685502 shutdown_connections 2020-05-18T21:39:13.000 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.992+0000 7f8f16476700 1 --2- 172.21.15.63:0/3812685502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f100bc8d0 0x7f8f10145760 unknown :-1 s=CLOSED pgs=2285 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:13.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.992+0000 7f8f16476700 1 -- 172.21.15.63:0/3812685502 >> 172.21.15.63:0/3812685502 conn(0x7f8f1005f3b0 msgr2=0x7f8f100ba500 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:13.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.992+0000 7f8f16476700 1 -- 172.21.15.63:0/3812685502 shutdown_connections 2020-05-18T21:39:13.001 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:12.992+0000 7f8f16476700 1 -- 172.21.15.63:0/3812685502 wait complete. 2020-05-18T21:39:13.002 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:39:13.002 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-05-18T21:39:13.002 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:39:13.013 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 4 2020-05-18T21:39:13.121 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17be4ab700 1 Processor -- start 2020-05-18T21:39:13.122 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17be4ab700 1 -- start start 2020-05-18T21:39:13.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17be4ab700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17b80b5620 0x7f17b805bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:13.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17be4ab700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f17b814dcf0 0x7f17b814e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:13.124 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17be4ab700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b814d890 con 0x7f17b8061a00 2020-05-18T21:39:13.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17be4ab700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b8060a80 con 0x7f17b814dcf0 2020-05-18T21:39:13.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17be4ab700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80607e0 con 0x7f17b80b5620 2020-05-18T21:39:13.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17bdcaa700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f17b814dcf0 0x7f17b814e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17bdcaa700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f17b814dcf0 0x7f17b814e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37626/0 (socket says 172.21.15.63:37626) 2020-05-18T21:39:13.125 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17bdcaa700 1 -- 172.21.15.63:0/1781588676 learned_addr learned my addr 172.21.15.63:0/1781588676 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:13.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17bd4a9700 1 --2- 172.21.15.63:0/1781588676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17b80b5620 0x7f17b805bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17bdcaa700 1 -- 172.21.15.63:0/1781588676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17b80b5620 msgr2=0x7f17b805bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:13.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17affff700 1 -- 172.21.15.63:0/1781588676 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709692835 0 0) 0x7f17b814d890 con 0x7f17b8061a00 2020-05-18T21:39:13.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17bdcaa700 1 --2- 172.21.15.63:0/1781588676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17b80b5620 0x7f17b805bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:13.126 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17bdcaa700 1 -- 172.21.15.63:0/1781588676 >> v1:172.21.15.155:6789/0 conn(0x7f17b8061a00 legacy=0x7f17b80650b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17bdcaa700 1 -- 172.21.15.63:0/1781588676 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b80657c0 con 0x7f17b814dcf0 2020-05-18T21:39:13.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17bdcaa700 1 --2- 172.21.15.63:0/1781588676 >> v2:172.21.15.63:3300/0 conn(0x7f17b814dcf0 0x7f17b814e180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f17b00032f0 tx=0x7f17b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17bdcaa700 1 --2- 172.21.15.63:0/1781588676 >> v2:172.21.15.63:3300/0 conn(0x7f17b814dcf0 0x7f17b814e180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f17b00032f0 tx=0x7f17b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17bdcaa700 1 --2- 172.21.15.63:0/1781588676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b814dcf0 0x7f17b814e180 secure :-1 s=READY pgs=2286 cs=0 l=1 rx=0x7f17b00032f0 tx=0x7f17b0007e00).ready entity=mon.0 client_cookie=d0bfbbfff4a3be9d server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:13.127 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17bdcaa700 1 --2- 172.21.15.63:0/1781588676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b814dcf0 0x7f17b814e180 secure :-1 s=THROTTLE_DONE pgs=2286 cs=0 l=1 rx=0x7f17b00032f0 tx=0x7f17b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17affff700 1 -- 172.21.15.63:0/1781588676 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17b0011d10 con 0x7f17b814dcf0 2020-05-18T21:39:13.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17bdcaa700 1 --2- 172.21.15.63:0/1781588676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b814dcf0 0x7f17b814e180 secure :-1 s=THROTTLE_DONE pgs=2286 cs=0 l=1 rx=0x7f17b00032f0 tx=0x7f17b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17affff700 1 -- 172.21.15.63:0/1781588676 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b0011e70 con 0x7f17b814dcf0 2020-05-18T21:39:13.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17bdcaa700 1 --2- 172.21.15.63:0/1781588676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b814dcf0 0x7f17b814e180 secure :-1 s=THROTTLE_DONE pgs=2286 cs=0 l=1 rx=0x7f17b00032f0 tx=0x7f17b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.128 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17be4ab700 1 -- 172.21.15.63:0/1781588676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b814dcf0 msgr2=0x7f17b814e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17affff700 1 -- 172.21.15.63:0/1781588676 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17b000a370 con 0x7f17b814dcf0 2020-05-18T21:39:13.129 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.116+0000 7f17be4ab700 1 --2- 172.21.15.63:0/1781588676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b814dcf0 0x7f17b814e180 secure :-1 s=READY pgs=2286 cs=0 l=1 rx=0x7f17b00032f0 tx=0x7f17b0007e00).stop 2020-05-18T21:39:13.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17be4ab700 1 -- 172.21.15.63:0/1781588676 shutdown_connections 2020-05-18T21:39:13.132 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17be4ab700 1 --2- 172.21.15.63:0/1781588676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b814dcf0 0x7f17b814e180 unknown :-1 s=CLOSED pgs=2286 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:13.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17be4ab700 1 --2- 172.21.15.63:0/1781588676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17b80b5620 0x7f17b805bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:13.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17be4ab700 1 -- 172.21.15.63:0/1781588676 >> 172.21.15.63:0/1781588676 conn(0x7f17b809da60 msgr2=0x7f17b809de70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:13.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17be4ab700 1 -- 172.21.15.63:0/1781588676 shutdown_connections 2020-05-18T21:39:13.133 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17be4ab700 1 -- 172.21.15.63:0/1781588676 wait complete. 2020-05-18T21:39:13.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17be4ab700 1 Processor -- start 2020-05-18T21:39:13.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17be4ab700 1 -- start start 2020-05-18T21:39:13.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17be4ab700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f17b8061a00 0x7f17b8149100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:13.134 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17be4ab700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b80b06a0 con 0x7f17b80b5620 2020-05-18T21:39:13.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17be4ab700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b8149560 con 0x7f17b814dcf0 2020-05-18T21:39:13.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17be4ab700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b80b3ed0 con 0x7f17b8061a00 2020-05-18T21:39:13.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17bcca8700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f17b80b5620 0x7f17b80aff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39816/0 (socket says 172.21.15.63:39816) 2020-05-18T21:39:13.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17bcca8700 1 -- 172.21.15.63:0/555694480 learned_addr learned my addr 172.21.15.63:0/555694480 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:13.135 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17bd4a9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f17b8061a00 0x7f17b8149100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17ae7fc700 1 -- 172.21.15.63:0/555694480 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208326135 0 0) 0x7f17a80012a0 con 0x7f17b80b5620 2020-05-18T21:39:13.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17ae7fc700 1 -- 172.21.15.63:0/555694480 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17a0002fe0 con 0x7f17b80b5620 2020-05-18T21:39:13.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17bd4a9700 1 -- 172.21.15.63:0/555694480 >> v1:172.21.15.155:6789/0 conn(0x7f17b814dcf0 legacy=0x7f17b8144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17bd4a9700 1 -- 172.21.15.63:0/555694480 >> v1:172.21.15.63:6789/0 conn(0x7f17b80b5620 legacy=0x7f17b80aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.136 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17bd4a9700 1 -- 172.21.15.63:0/555694480 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b80b4170 con 0x7f17b8061a00 2020-05-18T21:39:13.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17bd4a9700 1 --2- 172.21.15.63:0/555694480 >> v2:172.21.15.63:3300/0 conn(0x7f17b8061a00 0x7f17b8149100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f17b4002f70 tx=0x7f17b4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17bd4a9700 1 --2- 172.21.15.63:0/555694480 >> v2:172.21.15.63:3300/0 conn(0x7f17b8061a00 0x7f17b8149100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f17b4002f70 tx=0x7f17b4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17bd4a9700 1 --2- 172.21.15.63:0/555694480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b8061a00 0x7f17b8149100 secure :-1 s=READY pgs=2288 cs=0 l=1 rx=0x7f17b4002f70 tx=0x7f17b4010bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:13.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17bd4a9700 1 --2- 172.21.15.63:0/555694480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b8061a00 0x7f17b8149100 secure :-1 s=THROTTLE_DONE pgs=2288 cs=0 l=1 rx=0x7f17b4002f70 tx=0x7f17b4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.137 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17ae7fc700 1 -- 172.21.15.63:0/555694480 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17b4007550 con 0x7f17b8061a00 2020-05-18T21:39:13.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17bd4a9700 1 --2- 172.21.15.63:0/555694480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b8061a00 0x7f17b8149100 secure :-1 s=THROTTLE_DONE pgs=2288 cs=0 l=1 rx=0x7f17b4002f70 tx=0x7f17b4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.120+0000 7f17bd4a9700 1 --2- 172.21.15.63:0/555694480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b8061a00 0x7f17b8149100 secure :-1 s=THROTTLE_DONE pgs=2288 cs=0 l=1 rx=0x7f17b4002f70 tx=0x7f17b4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.124+0000 7f17ae7fc700 1 -- 172.21.15.63:0/555694480 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b4005700 con 0x7f17b8061a00 2020-05-18T21:39:13.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.124+0000 7f17be4ab700 1 -- 172.21.15.63:0/555694480 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b80b4410 con 0x7f17b8061a00 2020-05-18T21:39:13.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.124+0000 7f17ae7fc700 1 -- 172.21.15.63:0/555694480 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17b4005a60 con 0x7f17b8061a00 2020-05-18T21:39:13.138 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.124+0000 7f17be4ab700 1 -- 172.21.15.63:0/555694480 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b814ccd0 con 0x7f17b8061a00 2020-05-18T21:39:13.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.124+0000 7f17bd4a9700 1 --2- 172.21.15.63:0/555694480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b8061a00 0x7f17b8149100 secure :-1 s=THROTTLE_DONE pgs=2288 cs=0 l=1 rx=0x7f17b4002f70 tx=0x7f17b4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.124+0000 7f17ae7fc700 1 -- 172.21.15.63:0/555694480 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f17b4005bc0 con 0x7f17b8061a00 2020-05-18T21:39:13.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.124+0000 7f17bd4a9700 1 --2- 172.21.15.63:0/555694480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b8061a00 0x7f17b8149100 secure :-1 s=THROTTLE_DONE pgs=2288 cs=0 l=1 rx=0x7f17b4002f70 tx=0x7f17b4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.139 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.124+0000 7f17be4ab700 1 -- 172.21.15.63:0/555694480 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b80b45a0 con 0x7f17b8061a00 2020-05-18T21:39:13.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.124+0000 7f17ae7fc700 1 --2- 172.21.15.63:0/555694480 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f17a004fe10 0x7f17a00522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:13.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.124+0000 7f17ae7fc700 1 -- 172.21.15.63:0/555694480 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f17b4063f90 con 0x7f17b8061a00 2020-05-18T21:39:13.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.124+0000 7f17bcca8700 1 --2- 172.21.15.63:0/555694480 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f17a004fe10 0x7f17a00522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.124+0000 7f17bcca8700 1 --2- 172.21.15.63:0/555694480 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f17a004fe10 0x7f17a00522d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f17a8001430 tx=0x7f17a80019e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.140 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.124+0000 7f17bcca8700 1 --2- 172.21.15.63:0/555694480 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f17a004fe10 0x7f17a00522d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f17a8001430 tx=0x7f17a80019e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.124+0000 7f17bcca8700 1 --2- 172.21.15.63:0/555694480 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f17a004fe10 0x7f17a00522d0 secure :-1 s=READY pgs=896 cs=0 l=1 rx=0x7f17a8001430 tx=0x7f17a80019e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:13.141 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.128+0000 7f17bd4a9700 1 --2- 172.21.15.63:0/555694480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b8061a00 0x7f17b8149100 secure :-1 s=THROTTLE_DONE pgs=2288 cs=0 l=1 rx=0x7f17b4002f70 tx=0x7f17b4010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.142 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.128+0000 7f17ae7fc700 1 -- 172.21.15.63:0/555694480 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f17b403e2c0 con 0x7f17b8061a00 2020-05-18T21:39:13.255 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.248+0000 7f17be4ab700 1 -- 172.21.15.63:0/555694480 --> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f17b80569e0 con 0x7f17a004fe10 2020-05-18T21:39:13.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.248+0000 7f17bcca8700 1 --2- 172.21.15.63:0/555694480 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f17a004fe10 0x7f17a00522d0 secure :-1 s=THROTTLE_DONE pgs=896 cs=0 l=1 rx=0x7f17a8001430 tx=0x7f17a80019e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.256 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.248+0000 7f17ae7fc700 1 -- 172.21.15.63:0/555694480 <== mgr.4110 v2:172.21.15.155:6832/12649 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f17b80569e0 con 0x7f17a004fe10 2020-05-18T21:39:13.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.252+0000 7f17be4ab700 1 -- 172.21.15.63:0/555694480 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f17a004fe10 msgr2=0x7f17a00522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.252+0000 7f17be4ab700 1 --2- 172.21.15.63:0/555694480 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f17a004fe10 0x7f17a00522d0 secure :-1 s=READY pgs=896 cs=0 l=1 rx=0x7f17a8001430 tx=0x7f17a80019e0).stop 2020-05-18T21:39:13.258 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.252+0000 7f17be4ab700 1 -- 172.21.15.63:0/555694480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b8061a00 msgr2=0x7f17b8149100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.252+0000 7f17be4ab700 1 --2- 172.21.15.63:0/555694480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b8061a00 0x7f17b8149100 secure :-1 s=READY pgs=2288 cs=0 l=1 rx=0x7f17b4002f70 tx=0x7f17b4010bd0).stop 2020-05-18T21:39:13.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.252+0000 7f17be4ab700 1 -- 172.21.15.63:0/555694480 shutdown_connections 2020-05-18T21:39:13.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.252+0000 7f17be4ab700 1 --2- 172.21.15.63:0/555694480 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f17a004fe10 0x7f17a00522d0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:13.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.252+0000 7f17be4ab700 1 --2- 172.21.15.63:0/555694480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b8061a00 0x7f17b8149100 unknown :-1 s=CLOSED pgs=2288 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:13.259 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.252+0000 7f17be4ab700 1 -- 172.21.15.63:0/555694480 >> 172.21.15.63:0/555694480 conn(0x7f17b809da60 msgr2=0x7f17b805ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:13.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.252+0000 7f17be4ab700 1 -- 172.21.15.63:0/555694480 shutdown_connections 2020-05-18T21:39:13.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.252+0000 7f17be4ab700 1 -- 172.21.15.63:0/555694480 wait complete. 2020-05-18T21:39:13.260 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 4 to deep-scrub 2020-05-18T21:39:13.268 INFO:tasks.ceph:Scrubbing osd.5 2020-05-18T21:39:13.269 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 config set osd_debug_deep_scrub_sleep 0 2020-05-18T21:39:13.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.372+0000 7f0741278700 1 Processor -- start 2020-05-18T21:39:13.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.372+0000 7f0741278700 1 -- start start 2020-05-18T21:39:13.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f0741278700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f073c143430 0x7f073c145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:13.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f0741278700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c143810 con 0x7f073c0b7bf0 2020-05-18T21:39:13.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f0741278700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c0b7210 con 0x7f073c0b6d70 2020-05-18T21:39:13.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f0741278700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073c0b74b0 con 0x7f073c143430 2020-05-18T21:39:13.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f073b7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f073c0b7bf0 0x7f073c0b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39826/0 (socket says 172.21.15.63:39826) 2020-05-18T21:39:13.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f073b7fe700 1 -- 172.21.15.63:0/2706038008 learned_addr learned my addr 172.21.15.63:0/2706038008 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:13.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f073affd700 1 --2- 172.21.15.63:0/2706038008 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f073c143430 0x7f073c145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f0739ffb700 1 -- 172.21.15.63:0/2706038008 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397270330 0 0) 0x7f073c143810 con 0x7f073c0b7bf0 2020-05-18T21:39:13.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f0739ffb700 1 -- 172.21.15.63:0/2706038008 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f071c003270 con 0x7f073c0b7bf0 2020-05-18T21:39:13.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f073affd700 1 -- 172.21.15.63:0/2706038008 >> v1:172.21.15.155:6789/0 conn(0x7f073c0b6d70 legacy=0x7f073c0b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f0739ffb700 1 -- 172.21.15.63:0/2706038008 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1618673098 0 0) 0x7f071c003270 con 0x7f073c0b7bf0 2020-05-18T21:39:13.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f073affd700 1 -- 172.21.15.63:0/2706038008 >> v1:172.21.15.63:6789/0 conn(0x7f073c0b7bf0 legacy=0x7f073c0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f073affd700 1 -- 172.21.15.63:0/2706038008 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c0b7750 con 0x7f073c143430 2020-05-18T21:39:13.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f073affd700 1 --2- 172.21.15.63:0/2706038008 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f073c143430 0x7f073c145dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f07340018b0 tx=0x7f072c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f073affd700 1 --2- 172.21.15.63:0/2706038008 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f073c143430 0x7f073c145dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f07340018b0 tx=0x7f072c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f073affd700 1 --2- 172.21.15.63:0/2706038008 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f073c143430 0x7f073c145dd0 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7f07340018b0 tx=0x7f072c008ca0).ready entity=mon.2 client_cookie=493bfb35dce49154 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:13.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f073affd700 1 --2- 172.21.15.63:0/2706038008 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f073c143430 0x7f073c145dd0 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7f07340018b0 tx=0x7f072c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f0739ffb700 1 -- 172.21.15.63:0/2706038008 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0734001710 con 0x7f073c143430 2020-05-18T21:39:13.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f073affd700 1 --2- 172.21.15.63:0/2706038008 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f073c143430 0x7f073c145dd0 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7f07340018b0 tx=0x7f072c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f073affd700 1 --2- 172.21.15.63:0/2706038008 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f073c143430 0x7f073c145dd0 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7f07340018b0 tx=0x7f072c008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f0739ffb700 1 -- 172.21.15.63:0/2706038008 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072c010bf0 con 0x7f073c143430 2020-05-18T21:39:13.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f0741278700 1 -- 172.21.15.63:0/2706038008 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f073c143430 msgr2=0x7f073c145dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f0739ffb700 1 -- 172.21.15.63:0/2706038008 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f072c0110d0 con 0x7f073c143430 2020-05-18T21:39:13.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f0741278700 1 --2- 172.21.15.63:0/2706038008 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f073c143430 0x7f073c145dd0 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7f07340018b0 tx=0x7f072c008ca0).stop 2020-05-18T21:39:13.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f0741278700 1 -- 172.21.15.63:0/2706038008 shutdown_connections 2020-05-18T21:39:13.389 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f0741278700 1 --2- 172.21.15.63:0/2706038008 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f073c143430 0x7f073c145dd0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:13.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f0741278700 1 -- 172.21.15.63:0/2706038008 >> 172.21.15.63:0/2706038008 conn(0x7f073c069b70 msgr2=0x7f073c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:13.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f0741278700 1 -- 172.21.15.63:0/2706038008 shutdown_connections 2020-05-18T21:39:13.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.376+0000 7f0741278700 1 -- 172.21.15.63:0/2706038008 wait complete. 2020-05-18T21:39:13.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f0741278700 1 Processor -- start 2020-05-18T21:39:13.390 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f0741278700 1 -- start start 2020-05-18T21:39:13.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f0741278700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f073c0b6d70 0x7f073c14a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:13.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f0741278700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f073c143430 0x7f073c141c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:13.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f0741278700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c14a4a0 con 0x7f073c0b7bf0 2020-05-18T21:39:13.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f0741278700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f073c0af8d0 con 0x7f073c0b6d70 2020-05-18T21:39:13.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f0741278700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f073c0afb70 con 0x7f073c143430 2020-05-18T21:39:13.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f073affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f073c0b6d70 0x7f073c14a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f073affd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f073c0b6d70 0x7f073c14a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37642/0 (socket says 172.21.15.63:37642) 2020-05-18T21:39:13.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f073affd700 1 -- 172.21.15.63:0/705172194 learned_addr learned my addr 172.21.15.63:0/705172194 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:13.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f073b7fe700 1 --2- 172.21.15.63:0/705172194 >> v2:172.21.15.155:3300/0 conn(0x7f073c143430 0x7f073c141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f073affd700 1 -- 172.21.15.63:0/705172194 >> v2:172.21.15.155:3300/0 conn(0x7f073c143430 msgr2=0x7f073c141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f073affd700 1 --2- 172.21.15.63:0/705172194 >> v2:172.21.15.155:3300/0 conn(0x7f073c143430 0x7f073c141c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:13.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f073affd700 1 -- 172.21.15.63:0/705172194 >> v1:172.21.15.155:6789/0 conn(0x7f073c0b7bf0 legacy=0x7f073c0aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f073affd700 1 -- 172.21.15.63:0/705172194 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c0afe10 con 0x7f073c0b6d70 2020-05-18T21:39:13.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f073affd700 1 --2- 172.21.15.63:0/705172194 >> v2:172.21.15.63:3300/0 conn(0x7f073c0b6d70 0x7f073c14a040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f07340018b0 tx=0x7f073c0605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f073affd700 1 --2- 172.21.15.63:0/705172194 >> v2:172.21.15.63:3300/0 conn(0x7f073c0b6d70 0x7f073c14a040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f07340018b0 tx=0x7f073c0605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.400 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f073affd700 1 --2- 172.21.15.63:0/705172194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f073c0b6d70 0x7f073c14a040 secure :-1 s=READY pgs=2290 cs=0 l=1 rx=0x7f07340018b0 tx=0x7f073c0605c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:13.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f073affd700 1 --2- 172.21.15.63:0/705172194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f073c0b6d70 0x7f073c14a040 secure :-1 s=THROTTLE_DONE pgs=2290 cs=0 l=1 rx=0x7f07340018b0 tx=0x7f073c0605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f0733fff700 1 -- 172.21.15.63:0/705172194 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f072c0110d0 con 0x7f073c0b6d70 2020-05-18T21:39:13.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f073affd700 1 --2- 172.21.15.63:0/705172194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f073c0b6d70 0x7f073c14a040 secure :-1 s=THROTTLE_DONE pgs=2290 cs=0 l=1 rx=0x7f07340018b0 tx=0x7f073c0605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.401 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f073affd700 1 --2- 172.21.15.63:0/705172194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f073c0b6d70 0x7f073c14a040 secure :-1 s=THROTTLE_DONE pgs=2290 cs=0 l=1 rx=0x7f07340018b0 tx=0x7f073c0605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f0733fff700 1 -- 172.21.15.63:0/705172194 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072c005c70 con 0x7f073c0b6d70 2020-05-18T21:39:13.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f0741278700 1 -- 172.21.15.63:0/705172194 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f073c156ba0 con 0x7f073c0b6d70 2020-05-18T21:39:13.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f0733fff700 1 -- 172.21.15.63:0/705172194 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f072c005e60 con 0x7f073c0b6d70 2020-05-18T21:39:13.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.380+0000 7f0741278700 1 -- 172.21.15.63:0/705172194 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073c142240 con 0x7f073c0b6d70 2020-05-18T21:39:13.402 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.384+0000 7f073affd700 1 --2- 172.21.15.63:0/705172194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f073c0b6d70 0x7f073c14a040 secure :-1 s=THROTTLE_DONE pgs=2290 cs=0 l=1 rx=0x7f07340018b0 tx=0x7f073c0605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.384+0000 7f0741278700 1 -- 172.21.15.63:0/705172194 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f073c1426f0 con 0x7f073c0b6d70 2020-05-18T21:39:13.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.384+0000 7f0733fff700 1 -- 172.21.15.63:0/705172194 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f072c0114f0 con 0x7f073c0b6d70 2020-05-18T21:39:13.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.384+0000 7f073affd700 1 --2- 172.21.15.63:0/705172194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f073c0b6d70 0x7f073c14a040 secure :-1 s=THROTTLE_DONE pgs=2290 cs=0 l=1 rx=0x7f07340018b0 tx=0x7f073c0605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.384+0000 7f073affd700 1 --2- 172.21.15.63:0/705172194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f073c0b6d70 0x7f073c14a040 secure :-1 s=THROTTLE_DONE pgs=2290 cs=0 l=1 rx=0x7f07340018b0 tx=0x7f073c0605c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.384+0000 7f0733fff700 1 --2- 172.21.15.63:0/705172194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f072004fb50 0x7f0720052010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:13.403 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.384+0000 7f0733fff700 1 -- 172.21.15.63:0/705172194 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f072c064210 con 0x7f073c0b6d70 2020-05-18T21:39:13.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.384+0000 7f0733fff700 1 --2- 172.21.15.63:0/705172194 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f0720056790 0x7f0720058bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:13.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.384+0000 7f0733fff700 1 -- 172.21.15.63:0/705172194 --> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0720059190 con 0x7f0720056790 2020-05-18T21:39:13.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.384+0000 7f0733fff700 1 -- 172.21.15.63:0/705172194 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=169) v2 ==== 24+0+0 (secure 0 0 0) 0x7f072c065610 con 0x7f073c0b6d70 2020-05-18T21:39:13.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.384+0000 7f073a7fc700 1 --2- 172.21.15.63:0/705172194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f072004fb50 0x7f0720052010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.404 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.384+0000 7f073b7fe700 1 --2- 172.21.15.63:0/705172194 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f0720056790 0x7f0720058bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.384+0000 7f073a7fc700 1 --2- 172.21.15.63:0/705172194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f072004fb50 0x7f0720052010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f073c154500 tx=0x7f073c05ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.384+0000 7f073a7fc700 1 --2- 172.21.15.63:0/705172194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f072004fb50 0x7f0720052010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f073c154500 tx=0x7f073c05ab60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.384+0000 7f073a7fc700 1 --2- 172.21.15.63:0/705172194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f072004fb50 0x7f0720052010 secure :-1 s=READY pgs=897 cs=0 l=1 rx=0x7f073c154500 tx=0x7f073c05ab60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:13.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.384+0000 7f073b7fe700 1 --2- 172.21.15.63:0/705172194 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f0720056790 0x7f0720058bb0 crc :-1 s=READY pgs=37 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:13.405 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.388+0000 7f0733fff700 1 -- 172.21.15.63:0/705172194 <== osd.5 v2:172.21.15.155:6808/13024 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23263 (crc 0 0 0) 0x7f0720059190 con 0x7f0720056790 2020-05-18T21:39:13.409 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.404+0000 7f0741278700 1 -- 172.21.15.63:0/705172194 --> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f073c0b5860 con 0x7f0720056790 2020-05-18T21:39:13.410 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.404+0000 7f0733fff700 1 -- 172.21.15.63:0/705172194 <== osd.5 v2:172.21.15.155:6808/13024 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f073c0b5860 con 0x7f0720056790 2020-05-18T21:39:13.411 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:39:13.411 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-05-18T21:39:13.411 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:39:13.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.404+0000 7f0741278700 1 -- 172.21.15.63:0/705172194 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f0720056790 msgr2=0x7f0720058bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.412 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.404+0000 7f0741278700 1 --2- 172.21.15.63:0/705172194 >> [v2:172.21.15.155:6808/13024,v1:172.21.15.155:6809/13024] conn(0x7f0720056790 0x7f0720058bb0 crc :-1 s=READY pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:13.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.404+0000 7f0741278700 1 -- 172.21.15.63:0/705172194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f072004fb50 msgr2=0x7f0720052010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.404+0000 7f0741278700 1 --2- 172.21.15.63:0/705172194 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f072004fb50 0x7f0720052010 secure :-1 s=READY pgs=897 cs=0 l=1 rx=0x7f073c154500 tx=0x7f073c05ab60).stop 2020-05-18T21:39:13.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.404+0000 7f0741278700 1 -- 172.21.15.63:0/705172194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f073c0b6d70 msgr2=0x7f073c14a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.404+0000 7f0741278700 1 --2- 172.21.15.63:0/705172194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f073c0b6d70 0x7f073c14a040 secure :-1 s=READY pgs=2290 cs=0 l=1 rx=0x7f07340018b0 tx=0x7f073c0605c0).stop 2020-05-18T21:39:13.413 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.404+0000 7f073b7fe700 1 -- 172.21.15.63:0/705172194 reap_dead start 2020-05-18T21:39:13.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.404+0000 7f0741278700 1 -- 172.21.15.63:0/705172194 shutdown_connections 2020-05-18T21:39:13.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.404+0000 7f0741278700 1 --2- 172.21.15.63:0/705172194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f073c0b6d70 0x7f073c14a040 unknown :-1 s=CLOSED pgs=2290 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:13.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.404+0000 7f0741278700 1 -- 172.21.15.63:0/705172194 >> 172.21.15.63:0/705172194 conn(0x7f073c069b70 msgr2=0x7f073c061270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:13.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.404+0000 7f0741278700 1 -- 172.21.15.63:0/705172194 shutdown_connections 2020-05-18T21:39:13.414 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.404+0000 7f0741278700 1 -- 172.21.15.63:0/705172194 wait complete. 2020-05-18T21:39:13.423 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 5 2020-05-18T21:39:13.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.524+0000 7f62199a6700 1 Processor -- start 2020-05-18T21:39:13.532 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.524+0000 7f62199a6700 1 -- start start 2020-05-18T21:39:13.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62199a6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f62140b5a20 0x7f62140b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:13.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62199a6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6214142330 0x7f6214142760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:13.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62199a6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6214146350 con 0x7f62140b4970 2020-05-18T21:39:13.535 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62199a6700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62140662d0 con 0x7f62140b5a20 2020-05-18T21:39:13.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62199a6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6214146580 con 0x7f6214142330 2020-05-18T21:39:13.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f6212ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f62140b5a20 0x7f62140b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62137fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6214142330 0x7f6214142760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.536 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62127fc700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f62140b4970 0x7f621413f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:38156/0 (socket says 172.21.15.63:38156) 2020-05-18T21:39:13.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62127fc700 1 -- 172.21.15.63:0/2664312916 learned_addr learned my addr 172.21.15.63:0/2664312916 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:13.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62137fe700 1 -- 172.21.15.63:0/2664312916 >> v2:172.21.15.63:3300/0 conn(0x7f62140b5a20 msgr2=0x7f62140b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:13.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62137fe700 1 --2- 172.21.15.63:0/2664312916 >> v2:172.21.15.63:3300/0 conn(0x7f62140b5a20 0x7f62140b8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:13.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62137fe700 1 -- 172.21.15.63:0/2664312916 >> v1:172.21.15.155:6789/0 conn(0x7f62140b4970 legacy=0x7f621413f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.537 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62137fe700 1 -- 172.21.15.63:0/2664312916 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6214146820 con 0x7f6214142330 2020-05-18T21:39:13.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f6212ffd700 1 --2- 172.21.15.63:0/2664312916 >> v2:172.21.15.63:3300/0 conn(0x7f62140b5a20 0x7f62140b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:39:13.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62137fe700 1 --2- 172.21.15.63:0/2664312916 >> v2:172.21.15.155:3300/0 conn(0x7f6214142330 0x7f6214142760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f620c0032f0 tx=0x7f620c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62137fe700 1 --2- 172.21.15.63:0/2664312916 >> v2:172.21.15.155:3300/0 conn(0x7f6214142330 0x7f6214142760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f620c0032f0 tx=0x7f620c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62137fe700 1 --2- 172.21.15.63:0/2664312916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6214142330 0x7f6214142760 secure :-1 s=READY pgs=1525 cs=0 l=1 rx=0x7f620c0032f0 tx=0x7f620c007e00).ready entity=mon.1 client_cookie=db4702e73906bed5 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:13.538 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62137fe700 1 --2- 172.21.15.63:0/2664312916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6214142330 0x7f6214142760 secure :-1 s=THROTTLE_DONE pgs=1525 cs=0 l=1 rx=0x7f620c0032f0 tx=0x7f620c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f6211ffb700 1 -- 172.21.15.63:0/2664312916 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f620c00a180 con 0x7f6214142330 2020-05-18T21:39:13.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62137fe700 1 --2- 172.21.15.63:0/2664312916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6214142330 0x7f6214142760 secure :-1 s=THROTTLE_DONE pgs=1525 cs=0 l=1 rx=0x7f620c0032f0 tx=0x7f620c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62137fe700 1 --2- 172.21.15.63:0/2664312916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6214142330 0x7f6214142760 secure :-1 s=THROTTLE_DONE pgs=1525 cs=0 l=1 rx=0x7f620c0032f0 tx=0x7f620c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f6211ffb700 1 -- 172.21.15.63:0/2664312916 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620c00a2e0 con 0x7f6214142330 2020-05-18T21:39:13.539 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f6211ffb700 1 -- 172.21.15.63:0/2664312916 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f620c00a700 con 0x7f6214142330 2020-05-18T21:39:13.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62199a6700 1 -- 172.21.15.63:0/2664312916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6214142330 msgr2=0x7f6214142760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.540 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62199a6700 1 --2- 172.21.15.63:0/2664312916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6214142330 0x7f6214142760 secure :-1 s=READY pgs=1525 cs=0 l=1 rx=0x7f620c0032f0 tx=0x7f620c007e00).stop 2020-05-18T21:39:13.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62199a6700 1 -- 172.21.15.63:0/2664312916 shutdown_connections 2020-05-18T21:39:13.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62199a6700 1 --2- 172.21.15.63:0/2664312916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6214142330 0x7f6214142760 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:13.545 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62199a6700 1 --2- 172.21.15.63:0/2664312916 >> v2:172.21.15.63:3300/0 conn(0x7f62140b5a20 0x7f62140b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:13.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62199a6700 1 -- 172.21.15.63:0/2664312916 >> 172.21.15.63:0/2664312916 conn(0x7f62140b83b0 msgr2=0x7f62140b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:13.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62199a6700 1 -- 172.21.15.63:0/2664312916 shutdown_connections 2020-05-18T21:39:13.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.528+0000 7f62199a6700 1 -- 172.21.15.63:0/2664312916 wait complete. 2020-05-18T21:39:13.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.532+0000 7f62199a6700 1 Processor -- start 2020-05-18T21:39:13.546 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.532+0000 7f62199a6700 1 -- start start 2020-05-18T21:39:13.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.532+0000 7f62199a6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f62140b4970 0x7f6214130e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:13.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.532+0000 7f62199a6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6214142330 0x7f6214151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:13.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.532+0000 7f62199a6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6214152420 con 0x7f62140b5a20 2020-05-18T21:39:13.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.532+0000 7f62199a6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62141515e0 con 0x7f62140b4970 2020-05-18T21:39:13.547 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.532+0000 7f62199a6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6214151880 con 0x7f6214142330 2020-05-18T21:39:13.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.532+0000 7f62127fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f62140b5a20 0x7f6214141470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39848/0 (socket says 172.21.15.63:39848) 2020-05-18T21:39:13.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.532+0000 7f62127fc700 1 -- 172.21.15.63:0/119727659 learned_addr learned my addr 172.21.15.63:0/119727659 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:13.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.532+0000 7f6212ffd700 1 --2- 172.21.15.63:0/119727659 >> v2:172.21.15.155:3300/0 conn(0x7f62140b4970 0x7f6214130e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f62137fe700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6214142330 0x7f6214151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.548 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f620bfff700 1 -- 172.21.15.63:0/119727659 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331431100 0 0) 0x7f6214152420 con 0x7f62140b5a20 2020-05-18T21:39:13.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f620bfff700 1 -- 172.21.15.63:0/119727659 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61f8002fe0 con 0x7f62140b5a20 2020-05-18T21:39:13.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f6212ffd700 1 -- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6214142330 msgr2=0x7f6214151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f6212ffd700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6214142330 0x7f6214151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:13.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f6212ffd700 1 -- 172.21.15.63:0/119727659 >> v1:172.21.15.63:6789/0 conn(0x7f62140b5a20 legacy=0x7f6214141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.549 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f6212ffd700 1 -- 172.21.15.63:0/119727659 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6214151b20 con 0x7f62140b4970 2020-05-18T21:39:13.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f6212ffd700 1 --2- 172.21.15.63:0/119727659 >> v2:172.21.15.155:3300/0 conn(0x7f62140b4970 0x7f6214130e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f61fc002f70 tx=0x7f61fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f6212ffd700 1 --2- 172.21.15.63:0/119727659 >> v2:172.21.15.155:3300/0 conn(0x7f62140b4970 0x7f6214130e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f61fc002f70 tx=0x7f61fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f6212ffd700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62140b4970 0x7f6214130e10 secure :-1 s=READY pgs=1526 cs=0 l=1 rx=0x7f61fc002f70 tx=0x7f61fc007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:13.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f6212ffd700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62140b4970 0x7f6214130e10 secure :-1 s=THROTTLE_DONE pgs=1526 cs=0 l=1 rx=0x7f61fc002f70 tx=0x7f61fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.550 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f620bfff700 1 -- 172.21.15.63:0/119727659 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61fc012b70 con 0x7f62140b4970 2020-05-18T21:39:13.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f6212ffd700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62140b4970 0x7f6214130e10 secure :-1 s=THROTTLE_DONE pgs=1526 cs=0 l=1 rx=0x7f61fc002f70 tx=0x7f61fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f6212ffd700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62140b4970 0x7f6214130e10 secure :-1 s=THROTTLE_DONE pgs=1526 cs=0 l=1 rx=0x7f61fc002f70 tx=0x7f61fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f620bfff700 1 -- 172.21.15.63:0/119727659 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61fc012cd0 con 0x7f62140b4970 2020-05-18T21:39:13.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f62199a6700 1 -- 172.21.15.63:0/119727659 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6214141b80 con 0x7f62140b4970 2020-05-18T21:39:13.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f620bfff700 1 -- 172.21.15.63:0/119727659 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61fc012e40 con 0x7f62140b4970 2020-05-18T21:39:13.551 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f62199a6700 1 -- 172.21.15.63:0/119727659 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6214130750 con 0x7f62140b4970 2020-05-18T21:39:13.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f6212ffd700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62140b4970 0x7f6214130e10 secure :-1 s=THROTTLE_DONE pgs=1526 cs=0 l=1 rx=0x7f61fc002f70 tx=0x7f61fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f62199a6700 1 -- 172.21.15.63:0/119727659 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6214151cb0 con 0x7f62140b4970 2020-05-18T21:39:13.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f620bfff700 1 -- 172.21.15.63:0/119727659 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f61fc007160 con 0x7f62140b4970 2020-05-18T21:39:13.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f6212ffd700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62140b4970 0x7f6214130e10 secure :-1 s=THROTTLE_DONE pgs=1526 cs=0 l=1 rx=0x7f61fc002f70 tx=0x7f61fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.552 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f620bfff700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f61f804fd50 0x7f61f8052210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:13.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.536+0000 7f620bfff700 1 -- 172.21.15.63:0/119727659 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f61fc064110 con 0x7f62140b4970 2020-05-18T21:39:13.553 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.540+0000 7f62127fc700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f61f804fd50 0x7f61f8052210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.540+0000 7f62127fc700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f61f804fd50 0x7f61f8052210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f62040011a0 tx=0x7f6204001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.540+0000 7f62127fc700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f61f804fd50 0x7f61f8052210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f62040011a0 tx=0x7f6204001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.540+0000 7f62127fc700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f61f804fd50 0x7f61f8052210 secure :-1 s=READY pgs=898 cs=0 l=1 rx=0x7f62040011a0 tx=0x7f6204001760).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:13.554 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.548+0000 7f6212ffd700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62140b4970 0x7f6214130e10 secure :-1 s=THROTTLE_DONE pgs=1526 cs=0 l=1 rx=0x7f61fc002f70 tx=0x7f61fc007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.555 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.548+0000 7f620bfff700 1 -- 172.21.15.63:0/119727659 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f61fc03e4a0 con 0x7f62140b4970 2020-05-18T21:39:13.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.668+0000 7f62199a6700 1 -- 172.21.15.63:0/119727659 --> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f62140569e0 con 0x7f61f804fd50 2020-05-18T21:39:13.674 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.668+0000 7f62127fc700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f61f804fd50 0x7f61f8052210 secure :-1 s=THROTTLE_DONE pgs=898 cs=0 l=1 rx=0x7f62040011a0 tx=0x7f6204001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.675 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.668+0000 7f620bfff700 1 -- 172.21.15.63:0/119727659 <== mgr.4110 v2:172.21.15.155:6832/12649 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f62140569e0 con 0x7f61f804fd50 2020-05-18T21:39:13.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.668+0000 7f62199a6700 1 -- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f61f804fd50 msgr2=0x7f61f8052210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.668+0000 7f62199a6700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f61f804fd50 0x7f61f8052210 secure :-1 s=READY pgs=898 cs=0 l=1 rx=0x7f62040011a0 tx=0x7f6204001760).stop 2020-05-18T21:39:13.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.668+0000 7f62199a6700 1 -- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62140b4970 msgr2=0x7f6214130e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.677 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.668+0000 7f62199a6700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62140b4970 0x7f6214130e10 secure :-1 s=READY pgs=1526 cs=0 l=1 rx=0x7f61fc002f70 tx=0x7f61fc007a80).stop 2020-05-18T21:39:13.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.668+0000 7f62199a6700 1 -- 172.21.15.63:0/119727659 shutdown_connections 2020-05-18T21:39:13.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.668+0000 7f62199a6700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f61f804fd50 0x7f61f8052210 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:13.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.668+0000 7f62199a6700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6214142330 0x7f6214151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:13.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.668+0000 7f62199a6700 1 --2- 172.21.15.63:0/119727659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62140b4970 0x7f6214130e10 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:13.678 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.668+0000 7f62199a6700 1 -- 172.21.15.63:0/119727659 >> 172.21.15.63:0/119727659 conn(0x7f62140b83b0 msgr2=0x7f6214065500 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:13.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.668+0000 7f62199a6700 1 -- 172.21.15.63:0/119727659 shutdown_connections 2020-05-18T21:39:13.679 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.668+0000 7f62199a6700 1 -- 172.21.15.63:0/119727659 wait complete. 2020-05-18T21:39:13.679 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 5 to deep-scrub 2020-05-18T21:39:13.693 INFO:tasks.ceph:Scrubbing osd.6 2020-05-18T21:39:13.693 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 config set osd_debug_deep_scrub_sleep 0 2020-05-18T21:39:13.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24cfd4e700 1 Processor -- start 2020-05-18T21:39:13.802 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24cfd4e700 1 -- start start 2020-05-18T21:39:13.803 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24cfd4e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24c80b50b0 0x7f24c80b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:13.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24cfd4e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c8065ec0 con 0x7f24c8061be0 2020-05-18T21:39:13.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24cfd4e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c8066160 con 0x7f24c8062020 2020-05-18T21:39:13.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24cfd4e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c8064120 con 0x7f24c80b50b0 2020-05-18T21:39:13.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24cd2e9700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f24c8061be0 0x7f24c8064860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39856/0 (socket says 172.21.15.63:39856) 2020-05-18T21:39:13.804 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24cd2e9700 1 -- 172.21.15.63:0/1036809481 learned_addr learned my addr 172.21.15.63:0/1036809481 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:13.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24cdaea700 1 --2- 172.21.15.63:0/1036809481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24c80b50b0 0x7f24c80b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24ccae8700 1 -- 172.21.15.63:0/1036809481 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574162094 0 0) 0x7f24c8065ec0 con 0x7f24c8061be0 2020-05-18T21:39:13.805 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24ccae8700 1 -- 172.21.15.63:0/1036809481 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b0003270 con 0x7f24c8061be0 2020-05-18T21:39:13.807 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24ccae8700 1 -- 172.21.15.63:0/1036809481 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 56740819 0 0) 0x7f24b0003270 con 0x7f24c8061be0 2020-05-18T21:39:13.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24ccae8700 1 -- 172.21.15.63:0/1036809481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24c80b50b0 msgr2=0x7f24c80b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:13.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24ccae8700 1 --2- 172.21.15.63:0/1036809481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24c80b50b0 0x7f24c80b8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:13.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24ccae8700 1 -- 172.21.15.63:0/1036809481 >> v1:172.21.15.155:6789/0 conn(0x7f24c8062020 legacy=0x7f24c8149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24ccae8700 1 -- 172.21.15.63:0/1036809481 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c80643c0 con 0x7f24c8061be0 2020-05-18T21:39:13.808 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24ccae8700 1 -- 172.21.15.63:0/1036809481 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f24b8001710 con 0x7f24c8061be0 2020-05-18T21:39:13.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24ccae8700 1 -- 172.21.15.63:0/1036809481 >> v1:172.21.15.63:6789/0 conn(0x7f24c8061be0 legacy=0x7f24c8064860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24ccae8700 1 --2- 172.21.15.63:0/1036809481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b0003790 0x7f24b0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:13.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24ccae8700 1 --2- 172.21.15.63:0/1036809481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b0004040 0x7f24b0004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:13.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24ccae8700 1 --2- 172.21.15.63:0/1036809481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24c80b50b0 0x7f24b0004aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:13.809 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24ccae8700 1 -- 172.21.15.63:0/1036809481 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c8064120 con 0x7f24b0004040 2020-05-18T21:39:13.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24ccae8700 1 -- 172.21.15.63:0/1036809481 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b0004f50 con 0x7f24b0003790 2020-05-18T21:39:13.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24ccae8700 1 -- 172.21.15.63:0/1036809481 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b0005110 con 0x7f24c80b50b0 2020-05-18T21:39:13.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24cd2e9700 1 --2- 172.21.15.63:0/1036809481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b0004040 0x7f24b0004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.810 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24cdaea700 1 --2- 172.21.15.63:0/1036809481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b0003790 0x7f24b0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.796+0000 7f24ce2eb700 1 --2- 172.21.15.63:0/1036809481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24c80b50b0 0x7f24b0004aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24cd2e9700 1 -- 172.21.15.63:0/1036809481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24c80b50b0 msgr2=0x7f24b0004aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:13.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24cd2e9700 1 --2- 172.21.15.63:0/1036809481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24c80b50b0 0x7f24b0004aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:13.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24cd2e9700 1 -- 172.21.15.63:0/1036809481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b0003790 msgr2=0x7f24b0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:13.811 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24cd2e9700 1 --2- 172.21.15.63:0/1036809481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b0003790 0x7f24b0003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:13.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24cd2e9700 1 -- 172.21.15.63:0/1036809481 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b0003270 con 0x7f24b0004040 2020-05-18T21:39:13.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24cd2e9700 1 --2- 172.21.15.63:0/1036809481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b0004040 0x7f24b0004510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f24b8001420 tx=0x7f24b800c350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24cd2e9700 1 --2- 172.21.15.63:0/1036809481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b0004040 0x7f24b0004510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f24b8001420 tx=0x7f24b800c350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24cd2e9700 1 --2- 172.21.15.63:0/1036809481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b0004040 0x7f24b0004510 secure :-1 s=READY pgs=2293 cs=0 l=1 rx=0x7f24b8001420 tx=0x7f24b800c350).ready entity=mon.0 client_cookie=9bbdbaf69b86dbb2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:13.812 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24cd2e9700 1 --2- 172.21.15.63:0/1036809481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b0004040 0x7f24b0004510 secure :-1 s=THROTTLE_DONE pgs=2293 cs=0 l=1 rx=0x7f24b8001420 tx=0x7f24b800c350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24ccae8700 1 -- 172.21.15.63:0/1036809481 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24b800e370 con 0x7f24b0004040 2020-05-18T21:39:13.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24cd2e9700 1 --2- 172.21.15.63:0/1036809481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b0004040 0x7f24b0004510 secure :-1 s=THROTTLE_DONE pgs=2293 cs=0 l=1 rx=0x7f24b8001420 tx=0x7f24b800c350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24ccae8700 1 -- 172.21.15.63:0/1036809481 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b800e4d0 con 0x7f24b0004040 2020-05-18T21:39:13.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24cfd4e700 1 -- 172.21.15.63:0/1036809481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b0004040 msgr2=0x7f24b0004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.813 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24cd2e9700 1 --2- 172.21.15.63:0/1036809481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b0004040 0x7f24b0004510 secure :-1 s=THROTTLE_DONE pgs=2293 cs=0 l=1 rx=0x7f24b8001420 tx=0x7f24b800c350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24ccae8700 1 -- 172.21.15.63:0/1036809481 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24b80100c0 con 0x7f24b0004040 2020-05-18T21:39:13.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24cfd4e700 1 --2- 172.21.15.63:0/1036809481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b0004040 0x7f24b0004510 secure :-1 s=READY pgs=2293 cs=0 l=1 rx=0x7f24b8001420 tx=0x7f24b800c350).stop 2020-05-18T21:39:13.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24ce2eb700 1 -- 172.21.15.63:0/1036809481 reap_dead start 2020-05-18T21:39:13.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24cfd4e700 1 -- 172.21.15.63:0/1036809481 shutdown_connections 2020-05-18T21:39:13.814 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24cfd4e700 1 -- 172.21.15.63:0/1036809481 >> 172.21.15.63:0/1036809481 conn(0x7f24c80b83b0 msgr2=0x7f24c80b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:13.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24cfd4e700 1 -- 172.21.15.63:0/1036809481 shutdown_connections 2020-05-18T21:39:13.815 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24cfd4e700 1 -- 172.21.15.63:0/1036809481 wait complete. 2020-05-18T21:39:13.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24cfd4e700 1 Processor -- start 2020-05-18T21:39:13.818 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.800+0000 7f24cfd4e700 1 -- start start 2020-05-18T21:39:13.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cfd4e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f24c814cf30 0x7f24c80b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:13.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cfd4e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f24c80b2af0 0x7f24c80b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:13.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cfd4e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c814d310 con 0x7f24c80ad3f0 2020-05-18T21:39:13.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cfd4e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c80adbb0 con 0x7f24c814cf30 2020-05-18T21:39:13.819 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cfd4e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c80ade50 con 0x7f24c80b2af0 2020-05-18T21:39:13.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cdaea700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f24c814cf30 0x7f24c80b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cd2e9700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f24c80ad3f0 0x7f24c8147a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39868/0 (socket says 172.21.15.63:39868) 2020-05-18T21:39:13.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cd2e9700 1 -- 172.21.15.63:0/2411626269 learned_addr learned my addr 172.21.15.63:0/2411626269 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:13.820 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24ce2eb700 1 --2- 172.21.15.63:0/2411626269 >> v2:172.21.15.155:3300/0 conn(0x7f24c80b2af0 0x7f24c80b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cdaea700 1 -- 172.21.15.63:0/2411626269 >> v2:172.21.15.155:3300/0 conn(0x7f24c80b2af0 msgr2=0x7f24c80b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cdaea700 1 --2- 172.21.15.63:0/2411626269 >> v2:172.21.15.155:3300/0 conn(0x7f24c80b2af0 0x7f24c80b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:13.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cdaea700 1 -- 172.21.15.63:0/2411626269 >> v1:172.21.15.63:6789/0 conn(0x7f24c80ad3f0 legacy=0x7f24c8147a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cdaea700 1 -- 172.21.15.63:0/2411626269 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c80ae0f0 con 0x7f24c814cf30 2020-05-18T21:39:13.821 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24b6ffd700 1 -- 172.21.15.63:0/2411626269 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801924847 0 0) 0x7f24c814d310 con 0x7f24c80ad3f0 2020-05-18T21:39:13.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cdaea700 1 --2- 172.21.15.63:0/2411626269 >> v2:172.21.15.63:3300/0 conn(0x7f24c814cf30 0x7f24c80b1380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f24c4002f70 tx=0x7f24c805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cdaea700 1 --2- 172.21.15.63:0/2411626269 >> v2:172.21.15.63:3300/0 conn(0x7f24c814cf30 0x7f24c80b1380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f24c4002f70 tx=0x7f24c805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cdaea700 1 --2- 172.21.15.63:0/2411626269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24c814cf30 0x7f24c80b1380 secure :-1 s=READY pgs=2295 cs=0 l=1 rx=0x7f24c4002f70 tx=0x7f24c805b560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:13.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cdaea700 1 --2- 172.21.15.63:0/2411626269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24c814cf30 0x7f24c80b1380 secure :-1 s=THROTTLE_DONE pgs=2295 cs=0 l=1 rx=0x7f24c4002f70 tx=0x7f24c805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.822 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cdaea700 1 --2- 172.21.15.63:0/2411626269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24c814cf30 0x7f24c80b1380 secure :-1 s=THROTTLE_DONE pgs=2295 cs=0 l=1 rx=0x7f24c4002f70 tx=0x7f24c805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cdaea700 1 --2- 172.21.15.63:0/2411626269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24c814cf30 0x7f24c80b1380 secure :-1 s=THROTTLE_DONE pgs=2295 cs=0 l=1 rx=0x7f24c4002f70 tx=0x7f24c805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24b6ffd700 1 -- 172.21.15.63:0/2411626269 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24c4007180 con 0x7f24c814cf30 2020-05-18T21:39:13.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24b6ffd700 1 -- 172.21.15.63:0/2411626269 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c40072e0 con 0x7f24c814cf30 2020-05-18T21:39:13.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24b6ffd700 1 -- 172.21.15.63:0/2411626269 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24c4008410 con 0x7f24c814cf30 2020-05-18T21:39:13.823 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cfd4e700 1 -- 172.21.15.63:0/2411626269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c80ad880 con 0x7f24c814cf30 2020-05-18T21:39:13.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cfd4e700 1 -- 172.21.15.63:0/2411626269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c81483c0 con 0x7f24c814cf30 2020-05-18T21:39:13.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cdaea700 1 --2- 172.21.15.63:0/2411626269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24c814cf30 0x7f24c80b1380 secure :-1 s=THROTTLE_DONE pgs=2295 cs=0 l=1 rx=0x7f24c4002f70 tx=0x7f24c805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cfd4e700 1 -- 172.21.15.63:0/2411626269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f24c80ae280 con 0x7f24c814cf30 2020-05-18T21:39:13.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24b6ffd700 1 -- 172.21.15.63:0/2411626269 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f24c4008570 con 0x7f24c814cf30 2020-05-18T21:39:13.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.804+0000 7f24cdaea700 1 --2- 172.21.15.63:0/2411626269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24c814cf30 0x7f24c80b1380 secure :-1 s=THROTTLE_DONE pgs=2295 cs=0 l=1 rx=0x7f24c4002f70 tx=0x7f24c805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.824 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.808+0000 7f24cdaea700 1 --2- 172.21.15.63:0/2411626269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24c814cf30 0x7f24c80b1380 secure :-1 s=THROTTLE_DONE pgs=2295 cs=0 l=1 rx=0x7f24c4002f70 tx=0x7f24c805b560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.808+0000 7f24b6ffd700 1 --2- 172.21.15.63:0/2411626269 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f24a804f9c0 0x7f24a8051e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:13.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.808+0000 7f24b6ffd700 1 -- 172.21.15.63:0/2411626269 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f24c4063b80 con 0x7f24c814cf30 2020-05-18T21:39:13.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.808+0000 7f24b6ffd700 1 --2- 172.21.15.63:0/2411626269 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f24a8056600 0x7f24a8058a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:13.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.808+0000 7f24b6ffd700 1 -- 172.21.15.63:0/2411626269 --> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24a8059000 con 0x7f24a8056600 2020-05-18T21:39:13.825 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.808+0000 7f24b6ffd700 1 -- 172.21.15.63:0/2411626269 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=169) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24c4064f80 con 0x7f24c814cf30 2020-05-18T21:39:13.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.808+0000 7f24cd2e9700 1 --2- 172.21.15.63:0/2411626269 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f24a804f9c0 0x7f24a8051e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.808+0000 7f24ce2eb700 1 --2- 172.21.15.63:0/2411626269 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f24a8056600 0x7f24a8058a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.808+0000 7f24cd2e9700 1 --2- 172.21.15.63:0/2411626269 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f24a804f9c0 0x7f24a8051e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f24b800ba50 tx=0x7f24b800c350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.808+0000 7f24cd2e9700 1 --2- 172.21.15.63:0/2411626269 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f24a804f9c0 0x7f24a8051e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f24b800ba50 tx=0x7f24b800c350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.826 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.808+0000 7f24cd2e9700 1 --2- 172.21.15.63:0/2411626269 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f24a804f9c0 0x7f24a8051e80 secure :-1 s=READY pgs=899 cs=0 l=1 rx=0x7f24b800ba50 tx=0x7f24b800c350).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:13.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.808+0000 7f24ce2eb700 1 --2- 172.21.15.63:0/2411626269 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f24a8056600 0x7f24a8058a20 crc :-1 s=READY pgs=46 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:13.827 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.808+0000 7f24b6ffd700 1 -- 172.21.15.63:0/2411626269 <== osd.6 v2:172.21.15.155:6815/13025 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23263 (crc 0 0 0) 0x7f24a8059000 con 0x7f24a8056600 2020-05-18T21:39:13.835 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.828+0000 7f24cfd4e700 1 -- 172.21.15.63:0/2411626269 --> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f24c805eff0 con 0x7f24a8056600 2020-05-18T21:39:13.836 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.828+0000 7f24b6ffd700 1 -- 172.21.15.63:0/2411626269 <== osd.6 v2:172.21.15.155:6815/13025 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f24c805eff0 con 0x7f24a8056600 2020-05-18T21:39:13.837 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:39:13.837 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-05-18T21:39:13.837 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:39:13.838 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.832+0000 7f24cfd4e700 1 -- 172.21.15.63:0/2411626269 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f24a8056600 msgr2=0x7f24a8058a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.832+0000 7f24cfd4e700 1 --2- 172.21.15.63:0/2411626269 >> [v2:172.21.15.155:6815/13025,v1:172.21.15.155:6817/13025] conn(0x7f24a8056600 0x7f24a8058a20 crc :-1 s=READY pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:13.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.832+0000 7f24cfd4e700 1 -- 172.21.15.63:0/2411626269 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f24a804f9c0 msgr2=0x7f24a8051e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.832+0000 7f24cfd4e700 1 --2- 172.21.15.63:0/2411626269 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f24a804f9c0 0x7f24a8051e80 secure :-1 s=READY pgs=899 cs=0 l=1 rx=0x7f24b800ba50 tx=0x7f24b800c350).stop 2020-05-18T21:39:13.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.832+0000 7f24cfd4e700 1 -- 172.21.15.63:0/2411626269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24c814cf30 msgr2=0x7f24c80b1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.839 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.832+0000 7f24cfd4e700 1 --2- 172.21.15.63:0/2411626269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24c814cf30 0x7f24c80b1380 secure :-1 s=READY pgs=2295 cs=0 l=1 rx=0x7f24c4002f70 tx=0x7f24c805b560).stop 2020-05-18T21:39:13.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.832+0000 7f24ce2eb700 1 -- 172.21.15.63:0/2411626269 reap_dead start 2020-05-18T21:39:13.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.832+0000 7f24cfd4e700 1 -- 172.21.15.63:0/2411626269 shutdown_connections 2020-05-18T21:39:13.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.832+0000 7f24cfd4e700 1 --2- 172.21.15.63:0/2411626269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24c814cf30 0x7f24c80b1380 unknown :-1 s=CLOSED pgs=2295 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:13.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.832+0000 7f24cfd4e700 1 -- 172.21.15.63:0/2411626269 >> 172.21.15.63:0/2411626269 conn(0x7f24c80b83b0 msgr2=0x7f24c80b6320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:13.840 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.832+0000 7f24cfd4e700 1 -- 172.21.15.63:0/2411626269 shutdown_connections 2020-05-18T21:39:13.841 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.832+0000 7f24cfd4e700 1 -- 172.21.15.63:0/2411626269 wait complete. 2020-05-18T21:39:13.849 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 6 2020-05-18T21:39:13.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.948+0000 7f4cbb445700 1 Processor -- start 2020-05-18T21:39:13.956 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.948+0000 7f4cbb445700 1 -- start start 2020-05-18T21:39:13.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cbb445700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4cb40b9820 0x7f4cb409e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:13.957 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cbb445700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb40b5eb0 con 0x7f4cb413ca00 2020-05-18T21:39:13.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cbb445700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb40b6150 con 0x7f4cb41437b0 2020-05-18T21:39:13.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cbb445700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb40b63f0 con 0x7f4cb40b9820 2020-05-18T21:39:13.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cbac44700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4cb413ca00 0x7f4cb4061d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39880/0 (socket says 172.21.15.63:39880) 2020-05-18T21:39:13.958 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cbac44700 1 -- 172.21.15.63:0/1255050666 learned_addr learned my addr 172.21.15.63:0/1255050666 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:13.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cba443700 1 --2- 172.21.15.63:0/1255050666 >> v2:172.21.15.155:3300/0 conn(0x7f4cb40b9820 0x7f4cb409e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.960 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cb9441700 1 -- 172.21.15.63:0/1255050666 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123921871 0 0) 0x7f4cb40b5eb0 con 0x7f4cb413ca00 2020-05-18T21:39:13.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cb9441700 1 -- 172.21.15.63:0/1255050666 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c9c003270 con 0x7f4cb413ca00 2020-05-18T21:39:13.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cb9441700 1 -- 172.21.15.63:0/1255050666 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713298774 0 0) 0x7f4cb40b6150 con 0x7f4cb41437b0 2020-05-18T21:39:13.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cb9441700 1 -- 172.21.15.63:0/1255050666 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cb40b5eb0 con 0x7f4cb41437b0 2020-05-18T21:39:13.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cba443700 1 -- 172.21.15.63:0/1255050666 >> v1:172.21.15.155:6789/0 conn(0x7f4cb41437b0 legacy=0x7f4cb40b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.961 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cba443700 1 -- 172.21.15.63:0/1255050666 >> v1:172.21.15.63:6789/0 conn(0x7f4cb413ca00 legacy=0x7f4cb4061d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cb9441700 1 -- 172.21.15.63:0/1255050666 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3791396713 0 0) 0x7f4c9c003270 con 0x7f4cb413ca00 2020-05-18T21:39:13.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cba443700 1 -- 172.21.15.63:0/1255050666 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb40b9c00 con 0x7f4cb40b9820 2020-05-18T21:39:13.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cba443700 1 --2- 172.21.15.63:0/1255050666 >> v2:172.21.15.155:3300/0 conn(0x7f4cb40b9820 0x7f4cb409e380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4cac001c30 tx=0x7f4cb0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cba443700 1 --2- 172.21.15.63:0/1255050666 >> v2:172.21.15.155:3300/0 conn(0x7f4cb40b9820 0x7f4cb409e380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4cac001c30 tx=0x7f4cb0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.962 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cba443700 1 --2- 172.21.15.63:0/1255050666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cb40b9820 0x7f4cb409e380 secure :-1 s=READY pgs=1529 cs=0 l=1 rx=0x7f4cac001c30 tx=0x7f4cb0007a80).ready entity=mon.1 client_cookie=5846f2a8d2b00100 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:13.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cba443700 1 --2- 172.21.15.63:0/1255050666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cb40b9820 0x7f4cb409e380 secure :-1 s=THROTTLE_DONE pgs=1529 cs=0 l=1 rx=0x7f4cac001c30 tx=0x7f4cb0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cb9441700 1 -- 172.21.15.63:0/1255050666 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cac001a90 con 0x7f4cb40b9820 2020-05-18T21:39:13.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cba443700 1 --2- 172.21.15.63:0/1255050666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cb40b9820 0x7f4cb409e380 secure :-1 s=THROTTLE_DONE pgs=1529 cs=0 l=1 rx=0x7f4cac001c30 tx=0x7f4cb0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cba443700 1 --2- 172.21.15.63:0/1255050666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cb40b9820 0x7f4cb409e380 secure :-1 s=THROTTLE_DONE pgs=1529 cs=0 l=1 rx=0x7f4cac001c30 tx=0x7f4cb0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.963 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cb9441700 1 -- 172.21.15.63:0/1255050666 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb0008e40 con 0x7f4cb40b9820 2020-05-18T21:39:13.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cbb445700 1 -- 172.21.15.63:0/1255050666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cb40b9820 msgr2=0x7f4cb409e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cb9441700 1 -- 172.21.15.63:0/1255050666 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cb0011440 con 0x7f4cb40b9820 2020-05-18T21:39:13.964 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cbb445700 1 --2- 172.21.15.63:0/1255050666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cb40b9820 0x7f4cb409e380 secure :-1 s=READY pgs=1529 cs=0 l=1 rx=0x7f4cac001c30 tx=0x7f4cb0007a80).stop 2020-05-18T21:39:13.966 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cbb445700 1 -- 172.21.15.63:0/1255050666 shutdown_connections 2020-05-18T21:39:13.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cbb445700 1 --2- 172.21.15.63:0/1255050666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cb40b9820 0x7f4cb409e380 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:13.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cbb445700 1 -- 172.21.15.63:0/1255050666 >> 172.21.15.63:0/1255050666 conn(0x7f4cb405a7c0 msgr2=0x7f4cb405aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:13.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cbb445700 1 -- 172.21.15.63:0/1255050666 shutdown_connections 2020-05-18T21:39:13.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.952+0000 7f4cbb445700 1 -- 172.21.15.63:0/1255050666 wait complete. 2020-05-18T21:39:13.967 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.956+0000 7f4cbb445700 1 Processor -- start 2020-05-18T21:39:13.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.956+0000 7f4cbb445700 1 -- start start 2020-05-18T21:39:13.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.956+0000 7f4cbb445700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4cb40b9820 0x7f4cb4064940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:13.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.956+0000 7f4cbb445700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4cb413ca00 0x7f4cb40b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:13.968 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.956+0000 7f4cbb445700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb40b3180 con 0x7f4cb41437b0 2020-05-18T21:39:13.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.956+0000 7f4cbb445700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb413d040 con 0x7f4cb413ca00 2020-05-18T21:39:13.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.956+0000 7f4cbb445700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb413d2e0 con 0x7f4cb40b9820 2020-05-18T21:39:13.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.956+0000 7f4cb9c42700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4cb413ca00 0x7f4cb40b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.956+0000 7f4cbac44700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4cb41437b0 0x7f4cb4154240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39886/0 (socket says 172.21.15.63:39886) 2020-05-18T21:39:13.969 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.956+0000 7f4cb9c42700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4cb413ca00 0x7f4cb40b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37696/0 (socket says 172.21.15.63:37696) 2020-05-18T21:39:13.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.956+0000 7f4cbac44700 1 -- 172.21.15.63:0/2739215310 learned_addr learned my addr 172.21.15.63:0/2739215310 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:13.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.956+0000 7f4cba443700 1 --2- 172.21.15.63:0/2739215310 >> v2:172.21.15.155:3300/0 conn(0x7f4cb40b9820 0x7f4cb4064940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.956+0000 7f4cb9c42700 1 -- 172.21.15.63:0/2739215310 >> v2:172.21.15.155:3300/0 conn(0x7f4cb40b9820 msgr2=0x7f4cb4064940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.956+0000 7f4ca37fe700 1 -- 172.21.15.63:0/2739215310 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889121443 0 0) 0x7f4cb40b3180 con 0x7f4cb41437b0 2020-05-18T21:39:13.970 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.956+0000 7f4cb9c42700 1 --2- 172.21.15.63:0/2739215310 >> v2:172.21.15.155:3300/0 conn(0x7f4cb40b9820 0x7f4cb4064940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:13.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.956+0000 7f4cb9c42700 1 -- 172.21.15.63:0/2739215310 >> v1:172.21.15.63:6789/0 conn(0x7f4cb41437b0 legacy=0x7f4cb4154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:13.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.956+0000 7f4cb9c42700 1 -- 172.21.15.63:0/2739215310 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb413d580 con 0x7f4cb413ca00 2020-05-18T21:39:13.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.956+0000 7f4cb9c42700 1 --2- 172.21.15.63:0/2739215310 >> v2:172.21.15.63:3300/0 conn(0x7f4cb413ca00 0x7f4cb40b2d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4ca4001110 tx=0x7f4ca40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.956+0000 7f4cb9c42700 1 --2- 172.21.15.63:0/2739215310 >> v2:172.21.15.63:3300/0 conn(0x7f4cb413ca00 0x7f4cb40b2d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4ca4001110 tx=0x7f4ca40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.960+0000 7f4cb9c42700 1 --2- 172.21.15.63:0/2739215310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb413ca00 0x7f4cb40b2d20 secure :-1 s=READY pgs=2298 cs=0 l=1 rx=0x7f4ca4001110 tx=0x7f4ca40108e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:13.971 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.960+0000 7f4cb9c42700 1 --2- 172.21.15.63:0/2739215310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb413ca00 0x7f4cb40b2d20 secure :-1 s=THROTTLE_DONE pgs=2298 cs=0 l=1 rx=0x7f4ca4001110 tx=0x7f4ca40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.960+0000 7f4cb9c42700 1 --2- 172.21.15.63:0/2739215310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb413ca00 0x7f4cb40b2d20 secure :-1 s=THROTTLE_DONE pgs=2298 cs=0 l=1 rx=0x7f4ca4001110 tx=0x7f4ca40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.960+0000 7f4ca37fe700 1 -- 172.21.15.63:0/2739215310 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ca4006c00 con 0x7f4cb413ca00 2020-05-18T21:39:13.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.960+0000 7f4cb9c42700 1 --2- 172.21.15.63:0/2739215310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb413ca00 0x7f4cb40b2d20 secure :-1 s=THROTTLE_DONE pgs=2298 cs=0 l=1 rx=0x7f4ca4001110 tx=0x7f4ca40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.972 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.960+0000 7f4ca37fe700 1 -- 172.21.15.63:0/2739215310 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca4006da0 con 0x7f4cb413ca00 2020-05-18T21:39:13.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.960+0000 7f4cbb445700 1 -- 172.21.15.63:0/2739215310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb413da20 con 0x7f4cb413ca00 2020-05-18T21:39:13.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.960+0000 7f4ca37fe700 1 -- 172.21.15.63:0/2739215310 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ca4008370 con 0x7f4cb413ca00 2020-05-18T21:39:13.973 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.960+0000 7f4cbb445700 1 -- 172.21.15.63:0/2739215310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb413dec0 con 0x7f4cb413ca00 2020-05-18T21:39:13.974 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.960+0000 7f4cb9c42700 1 --2- 172.21.15.63:0/2739215310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb413ca00 0x7f4cb40b2d20 secure :-1 s=THROTTLE_DONE pgs=2298 cs=0 l=1 rx=0x7f4ca4001110 tx=0x7f4ca40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.960+0000 7f4ca37fe700 1 -- 172.21.15.63:0/2739215310 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f4ca40085e0 con 0x7f4cb413ca00 2020-05-18T21:39:13.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.960+0000 7f4cbb445700 1 -- 172.21.15.63:0/2739215310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb40569e0 con 0x7f4cb413ca00 2020-05-18T21:39:13.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.960+0000 7f4cb9c42700 1 --2- 172.21.15.63:0/2739215310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb413ca00 0x7f4cb40b2d20 secure :-1 s=THROTTLE_DONE pgs=2298 cs=0 l=1 rx=0x7f4ca4001110 tx=0x7f4ca40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.975 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.960+0000 7f4ca37fe700 1 --2- 172.21.15.63:0/2739215310 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4c9404f940 0x7f4c94051e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:13.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.960+0000 7f4ca37fe700 1 -- 172.21.15.63:0/2739215310 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4ca4063c80 con 0x7f4cb413ca00 2020-05-18T21:39:13.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.960+0000 7f4cba443700 1 --2- 172.21.15.63:0/2739215310 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4c9404f940 0x7f4c94051e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:13.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.964+0000 7f4cba443700 1 --2- 172.21.15.63:0/2739215310 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4c9404f940 0x7f4c94051e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4cac001c30 tx=0x7f4cb0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.964+0000 7f4cba443700 1 --2- 172.21.15.63:0/2739215310 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4c9404f940 0x7f4c94051e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4cac001c30 tx=0x7f4cb0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.976 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.964+0000 7f4cba443700 1 --2- 172.21.15.63:0/2739215310 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4c9404f940 0x7f4c94051e00 secure :-1 s=READY pgs=900 cs=0 l=1 rx=0x7f4cac001c30 tx=0x7f4cb0007a80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:13.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.964+0000 7f4cb9c42700 1 --2- 172.21.15.63:0/2739215310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb413ca00 0x7f4cb40b2d20 secure :-1 s=THROTTLE_DONE pgs=2298 cs=0 l=1 rx=0x7f4ca4001110 tx=0x7f4ca40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:13.977 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:13.964+0000 7f4ca37fe700 1 -- 172.21.15.63:0/2739215310 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f4ca403e010 con 0x7f4cb413ca00 2020-05-18T21:39:14.092 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.084+0000 7f4cbb445700 1 -- 172.21.15.63:0/2739215310 --> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f4cb413d780 con 0x7f4c9404f940 2020-05-18T21:39:14.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.084+0000 7f4cba443700 1 --2- 172.21.15.63:0/2739215310 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4c9404f940 0x7f4c94051e00 secure :-1 s=THROTTLE_DONE pgs=900 cs=0 l=1 rx=0x7f4cac001c30 tx=0x7f4cb0007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.093 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.088+0000 7f4ca37fe700 1 -- 172.21.15.63:0/2739215310 <== mgr.4110 v2:172.21.15.155:6832/12649 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4cb0008c50 con 0x7f4c9404f940 2020-05-18T21:39:14.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.088+0000 7f4cbb445700 1 -- 172.21.15.63:0/2739215310 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4c9404f940 msgr2=0x7f4c94051e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.088+0000 7f4cbb445700 1 --2- 172.21.15.63:0/2739215310 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4c9404f940 0x7f4c94051e00 secure :-1 s=READY pgs=900 cs=0 l=1 rx=0x7f4cac001c30 tx=0x7f4cb0007a80).stop 2020-05-18T21:39:14.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.088+0000 7f4cbb445700 1 -- 172.21.15.63:0/2739215310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb413ca00 msgr2=0x7f4cb40b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.096 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.088+0000 7f4cbb445700 1 --2- 172.21.15.63:0/2739215310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb413ca00 0x7f4cb40b2d20 secure :-1 s=READY pgs=2298 cs=0 l=1 rx=0x7f4ca4001110 tx=0x7f4ca40108e0).stop 2020-05-18T21:39:14.097 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.088+0000 7f4cbb445700 1 -- 172.21.15.63:0/2739215310 shutdown_connections 2020-05-18T21:39:14.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.088+0000 7f4cbb445700 1 --2- 172.21.15.63:0/2739215310 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f4c9404f940 0x7f4c94051e00 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:14.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.088+0000 7f4cbb445700 1 --2- 172.21.15.63:0/2739215310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb413ca00 0x7f4cb40b2d20 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:14.098 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.088+0000 7f4cbb445700 1 --2- 172.21.15.63:0/2739215310 >> v2:172.21.15.155:3300/0 conn(0x7f4cb40b9820 0x7f4cb4064940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:14.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.088+0000 7f4cbb445700 1 -- 172.21.15.63:0/2739215310 >> 172.21.15.63:0/2739215310 conn(0x7f4cb405a7c0 msgr2=0x7f4cb405eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:14.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.088+0000 7f4cbb445700 1 -- 172.21.15.63:0/2739215310 shutdown_connections 2020-05-18T21:39:14.099 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.088+0000 7f4cbb445700 1 -- 172.21.15.63:0/2739215310 wait complete. 2020-05-18T21:39:14.099 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 6 to deep-scrub 2020-05-18T21:39:14.110 INFO:tasks.ceph:Scrubbing osd.7 2020-05-18T21:39:14.111 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 config set osd_debug_deep_scrub_sleep 0 2020-05-18T21:39:14.224 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.216+0000 7ff45d0f3700 1 Processor -- start 2020-05-18T21:39:14.225 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.216+0000 7ff45d0f3700 1 -- start start 2020-05-18T21:39:14.230 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff45d0f3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff458142110 0x7ff458061b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:14.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff45d0f3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff458146060 0x7ff4580b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:14.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff45d0f3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff458142620 con 0x7ff45805ef00 2020-05-18T21:39:14.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff45d0f3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4581428c0 con 0x7ff458142110 2020-05-18T21:39:14.231 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff457fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff45805ef00 0x7ff458145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39890/0 (socket says 172.21.15.63:39890) 2020-05-18T21:39:14.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff45d0f3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff458142b60 con 0x7ff458146060 2020-05-18T21:39:14.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff457fff700 1 -- 172.21.15.63:0/1084831474 learned_addr learned my addr 172.21.15.63:0/1084831474 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:14.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff45c8f2700 1 --2- 172.21.15.63:0/1084831474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff458146060 0x7ff4580b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.232 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff44ffff700 1 --2- 172.21.15.63:0/1084831474 >> v2:172.21.15.155:3300/0 conn(0x7ff458142110 0x7ff458061b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff4577fe700 1 -- 172.21.15.63:0/1084831474 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887749628 0 0) 0x7ff458142620 con 0x7ff45805ef00 2020-05-18T21:39:14.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff4577fe700 1 -- 172.21.15.63:0/1084831474 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff438003270 con 0x7ff45805ef00 2020-05-18T21:39:14.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff4577fe700 1 -- 172.21.15.63:0/1084831474 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2573974551 0 0) 0x7ff438003270 con 0x7ff45805ef00 2020-05-18T21:39:14.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff4577fe700 1 -- 172.21.15.63:0/1084831474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff458146060 msgr2=0x7ff4580b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:14.233 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff4577fe700 1 --2- 172.21.15.63:0/1084831474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff458146060 0x7ff4580b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:14.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff4577fe700 1 -- 172.21.15.63:0/1084831474 >> v2:172.21.15.155:3300/0 conn(0x7ff458142110 msgr2=0x7ff458061b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:14.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff4577fe700 1 --2- 172.21.15.63:0/1084831474 >> v2:172.21.15.155:3300/0 conn(0x7ff458142110 0x7ff458061b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:14.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff4577fe700 1 -- 172.21.15.63:0/1084831474 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff458143000 con 0x7ff45805ef00 2020-05-18T21:39:14.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff4577fe700 1 -- 172.21.15.63:0/1084831474 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7ff448001710 con 0x7ff45805ef00 2020-05-18T21:39:14.234 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff4577fe700 1 -- 172.21.15.63:0/1084831474 >> v1:172.21.15.63:6789/0 conn(0x7ff45805ef00 legacy=0x7ff458145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff4577fe700 1 --2- 172.21.15.63:0/1084831474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff458146060 0x7ff438003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff4577fe700 1 --2- 172.21.15.63:0/1084831474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff438003bc0 0x7ff438004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff4577fe700 1 --2- 172.21.15.63:0/1084831474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff438004600 0x7ff438004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:14.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff4577fe700 1 -- 172.21.15.63:0/1084831474 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4581428c0 con 0x7ff438003bc0 2020-05-18T21:39:14.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff4577fe700 1 -- 172.21.15.63:0/1084831474 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff458142b60 con 0x7ff438004600 2020-05-18T21:39:14.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff4577fe700 1 -- 172.21.15.63:0/1084831474 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff438005090 con 0x7ff458146060 2020-05-18T21:39:14.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff44ffff700 1 --2- 172.21.15.63:0/1084831474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff438003bc0 0x7ff438004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.236 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff457fff700 1 --2- 172.21.15.63:0/1084831474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff458146060 0x7ff438003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff45c8f2700 1 --2- 172.21.15.63:0/1084831474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff438004600 0x7ff438004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff44ffff700 1 -- 172.21.15.63:0/1084831474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff458146060 msgr2=0x7ff438003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:14.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff44ffff700 1 --2- 172.21.15.63:0/1084831474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff458146060 0x7ff438003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:14.237 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff44ffff700 1 -- 172.21.15.63:0/1084831474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff438004600 msgr2=0x7ff438004a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:14.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff44ffff700 1 --2- 172.21.15.63:0/1084831474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff438004600 0x7ff438004a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:14.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff44ffff700 1 -- 172.21.15.63:0/1084831474 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff438003270 con 0x7ff438003bc0 2020-05-18T21:39:14.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff45c8f2700 1 --2- 172.21.15.63:0/1084831474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff438004600 0x7ff438004a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-05-18T21:39:14.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.220+0000 7ff44ffff700 1 --2- 172.21.15.63:0/1084831474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff438003bc0 0x7ff438004020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff440008950 tx=0x7ff440010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.238 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.224+0000 7ff44ffff700 1 --2- 172.21.15.63:0/1084831474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff438003bc0 0x7ff438004020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff440008950 tx=0x7ff440010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.224+0000 7ff44ffff700 1 --2- 172.21.15.63:0/1084831474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff438003bc0 0x7ff438004020 secure :-1 s=READY pgs=2300 cs=0 l=1 rx=0x7ff440008950 tx=0x7ff440010090).ready entity=mon.0 client_cookie=6992d1f0a5e0758e server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:14.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.224+0000 7ff44ffff700 1 --2- 172.21.15.63:0/1084831474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff438003bc0 0x7ff438004020 secure :-1 s=THROTTLE_DONE pgs=2300 cs=0 l=1 rx=0x7ff440008950 tx=0x7ff440010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.224+0000 7ff4577fe700 1 -- 172.21.15.63:0/1084831474 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff440008e30 con 0x7ff438003bc0 2020-05-18T21:39:14.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.224+0000 7ff44ffff700 1 --2- 172.21.15.63:0/1084831474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff438003bc0 0x7ff438004020 secure :-1 s=THROTTLE_DONE pgs=2300 cs=0 l=1 rx=0x7ff440008950 tx=0x7ff440010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.239 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.224+0000 7ff44ffff700 1 --2- 172.21.15.63:0/1084831474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff438003bc0 0x7ff438004020 secure :-1 s=THROTTLE_DONE pgs=2300 cs=0 l=1 rx=0x7ff440008950 tx=0x7ff440010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.224+0000 7ff4577fe700 1 -- 172.21.15.63:0/1084831474 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4400109b0 con 0x7ff438003bc0 2020-05-18T21:39:14.240 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.224+0000 7ff4577fe700 1 -- 172.21.15.63:0/1084831474 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff440010d10 con 0x7ff438003bc0 2020-05-18T21:39:14.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.224+0000 7ff45d0f3700 1 -- 172.21.15.63:0/1084831474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff438003bc0 msgr2=0x7ff438004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.224+0000 7ff45d0f3700 1 --2- 172.21.15.63:0/1084831474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff438003bc0 0x7ff438004020 secure :-1 s=READY pgs=2300 cs=0 l=1 rx=0x7ff440008950 tx=0x7ff440010090).stop 2020-05-18T21:39:14.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.224+0000 7ff45c8f2700 1 -- 172.21.15.63:0/1084831474 reap_dead start 2020-05-18T21:39:14.241 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.224+0000 7ff45d0f3700 1 -- 172.21.15.63:0/1084831474 shutdown_connections 2020-05-18T21:39:14.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.224+0000 7ff45d0f3700 1 -- 172.21.15.63:0/1084831474 >> 172.21.15.63:0/1084831474 conn(0x7ff4580b8b10 msgr2=0x7ff4580b8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:14.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.224+0000 7ff45d0f3700 1 -- 172.21.15.63:0/1084831474 shutdown_connections 2020-05-18T21:39:14.242 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.224+0000 7ff45d0f3700 1 -- 172.21.15.63:0/1084831474 wait complete. 2020-05-18T21:39:14.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.224+0000 7ff45d0f3700 1 Processor -- start 2020-05-18T21:39:14.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.224+0000 7ff45d0f3700 1 -- start start 2020-05-18T21:39:14.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff45d0f3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff45814f010 0x7ff45814f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:14.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff45d0f3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45809cf20 con 0x7ff45809caa0 2020-05-18T21:39:14.246 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff45d0f3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45809ac60 con 0x7ff4580990f0 2020-05-18T21:39:14.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff45d0f3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff458098c50 con 0x7ff45814f010 2020-05-18T21:39:14.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff44ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff45809caa0 0x7ff4580b12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39904/0 (socket says 172.21.15.63:39904) 2020-05-18T21:39:14.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff44ffff700 1 -- 172.21.15.63:0/1944440963 learned_addr learned my addr 172.21.15.63:0/1944440963 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:14.247 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff457fff700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff45814f010 0x7ff45814f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff455ffb700 1 -- 172.21.15.63:0/1944440963 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626021126 0 0) 0x7ff438003270 con 0x7ff45809caa0 2020-05-18T21:39:14.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff455ffb700 1 -- 172.21.15.63:0/1944440963 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff43c002fe0 con 0x7ff45809caa0 2020-05-18T21:39:14.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff455ffb700 1 -- 172.21.15.63:0/1944440963 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794408106 0 0) 0x7ff45809ac60 con 0x7ff4580990f0 2020-05-18T21:39:14.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff455ffb700 1 -- 172.21.15.63:0/1944440963 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff438003270 con 0x7ff4580990f0 2020-05-18T21:39:14.248 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff457fff700 1 -- 172.21.15.63:0/1944440963 >> v1:172.21.15.155:6789/0 conn(0x7ff4580990f0 legacy=0x7ff458099580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff457fff700 1 -- 172.21.15.63:0/1944440963 >> v1:172.21.15.63:6789/0 conn(0x7ff45809caa0 legacy=0x7ff4580b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff457fff700 1 -- 172.21.15.63:0/1944440963 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff458099c90 con 0x7ff45814f010 2020-05-18T21:39:14.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff457fff700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff45814f010 0x7ff45814f7e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff448001420 tx=0x7ff458143190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff457fff700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff45814f010 0x7ff45814f7e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff448001420 tx=0x7ff458143190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.249 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff457fff700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff45814f010 0x7ff45814f7e0 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7ff448001420 tx=0x7ff458143190).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:14.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff457fff700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff45814f010 0x7ff45814f7e0 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7ff448001420 tx=0x7ff458143190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff455ffb700 1 -- 172.21.15.63:0/1944440963 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff44800e180 con 0x7ff45814f010 2020-05-18T21:39:14.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff457fff700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff45814f010 0x7ff45814f7e0 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7ff448001420 tx=0x7ff458143190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff457fff700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff45814f010 0x7ff45814f7e0 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7ff448001420 tx=0x7ff458143190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff455ffb700 1 -- 172.21.15.63:0/1944440963 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44800e2e0 con 0x7ff45814f010 2020-05-18T21:39:14.250 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff45d0f3700 1 -- 172.21.15.63:0/1944440963 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45814f3f0 con 0x7ff45814f010 2020-05-18T21:39:14.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff455ffb700 1 -- 172.21.15.63:0/1944440963 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff44800e6c0 con 0x7ff45814f010 2020-05-18T21:39:14.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff45d0f3700 1 -- 172.21.15.63:0/1944440963 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4580b1ef0 con 0x7ff45814f010 2020-05-18T21:39:14.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff45d0f3700 1 -- 172.21.15.63:0/1944440963 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff45809aa80 con 0x7ff45814f010 2020-05-18T21:39:14.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.228+0000 7ff457fff700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff45814f010 0x7ff45814f7e0 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7ff448001420 tx=0x7ff458143190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.251 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.232+0000 7ff455ffb700 1 -- 172.21.15.63:0/1944440963 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ff448007280 con 0x7ff45814f010 2020-05-18T21:39:14.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.232+0000 7ff457fff700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff45814f010 0x7ff45814f7e0 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7ff448001420 tx=0x7ff458143190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.232+0000 7ff457fff700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff45814f010 0x7ff45814f7e0 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7ff448001420 tx=0x7ff458143190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.232+0000 7ff455ffb700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff43c04fe20 0x7ff43c0522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:14.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.232+0000 7ff455ffb700 1 -- 172.21.15.63:0/1944440963 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff448063b20 con 0x7ff45814f010 2020-05-18T21:39:14.252 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.232+0000 7ff455ffb700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7ff43c056960 0x7ff43c058d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:14.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.232+0000 7ff455ffb700 1 -- 172.21.15.63:0/1944440963 --> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff43c059360 con 0x7ff43c056960 2020-05-18T21:39:14.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.232+0000 7ff455ffb700 1 -- 172.21.15.63:0/1944440963 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=169) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff448063e80 con 0x7ff45814f010 2020-05-18T21:39:14.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.232+0000 7ff44ffff700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff43c04fe20 0x7ff43c0522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.232+0000 7ff45c8f2700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7ff43c056960 0x7ff43c058d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.253 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.232+0000 7ff44ffff700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff43c04fe20 0x7ff43c0522e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4580afc40 tx=0x7ff440010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.232+0000 7ff44ffff700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff43c04fe20 0x7ff43c0522e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4580afc40 tx=0x7ff440010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.232+0000 7ff44ffff700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff43c04fe20 0x7ff43c0522e0 secure :-1 s=READY pgs=901 cs=0 l=1 rx=0x7ff4580afc40 tx=0x7ff440010090).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:14.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.232+0000 7ff45c8f2700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7ff43c056960 0x7ff43c058d80 crc :-1 s=READY pgs=34 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:14.254 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.236+0000 7ff455ffb700 1 -- 172.21.15.63:0/1944440963 <== osd.7 v2:172.21.15.155:6823/13026 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23263 (crc 0 0 0) 0x7ff43c059360 con 0x7ff43c056960 2020-05-18T21:39:14.260 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.252+0000 7ff45d0f3700 1 -- 172.21.15.63:0/1944440963 --> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff4580569e0 con 0x7ff43c056960 2020-05-18T21:39:14.261 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.256+0000 7ff455ffb700 1 -- 172.21.15.63:0/1944440963 <== osd.7 v2:172.21.15.155:6823/13026 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff4580569e0 con 0x7ff43c056960 2020-05-18T21:39:14.261 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2020-05-18T21:39:14.262 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-05-18T21:39:14.262 INFO:teuthology.orchestra.run.smithi063.stdout:} 2020-05-18T21:39:14.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.256+0000 7ff45d0f3700 1 -- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7ff43c056960 msgr2=0x7ff43c058d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.256+0000 7ff45d0f3700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:6823/13026,v1:172.21.15.155:6825/13026] conn(0x7ff43c056960 0x7ff43c058d80 crc :-1 s=READY pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:14.263 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.256+0000 7ff45d0f3700 1 -- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff43c04fe20 msgr2=0x7ff43c0522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.256+0000 7ff45d0f3700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ff43c04fe20 0x7ff43c0522e0 secure :-1 s=READY pgs=901 cs=0 l=1 rx=0x7ff4580afc40 tx=0x7ff440010090).stop 2020-05-18T21:39:14.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.256+0000 7ff45d0f3700 1 -- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff45814f010 msgr2=0x7ff45814f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.256+0000 7ff45d0f3700 1 --2- 172.21.15.63:0/1944440963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff45814f010 0x7ff45814f7e0 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7ff448001420 tx=0x7ff458143190).stop 2020-05-18T21:39:14.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.256+0000 7ff45c8f2700 1 -- 172.21.15.63:0/1944440963 reap_dead start 2020-05-18T21:39:14.264 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.256+0000 7ff45d0f3700 1 -- 172.21.15.63:0/1944440963 shutdown_connections 2020-05-18T21:39:14.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.256+0000 7ff45d0f3700 1 -- 172.21.15.63:0/1944440963 >> 172.21.15.63:0/1944440963 conn(0x7ff4580b8b10 msgr2=0x7ff4581456b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:14.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.256+0000 7ff45d0f3700 1 -- 172.21.15.63:0/1944440963 shutdown_connections 2020-05-18T21:39:14.265 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.256+0000 7ff45d0f3700 1 -- 172.21.15.63:0/1944440963 wait complete. 2020-05-18T21:39:14.274 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 7 2020-05-18T21:39:14.372 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.364+0000 7f85c969a700 1 Processor -- start 2020-05-18T21:39:14.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.364+0000 7f85c969a700 1 -- start start 2020-05-18T21:39:14.373 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c969a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c4060e40 0x7f85c4061b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:14.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c969a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f85c412eea0 0x7f85c412f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:14.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c969a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c40612e0 con 0x7f85c40b94f0 2020-05-18T21:39:14.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c969a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c40b4590 con 0x7f85c412eea0 2020-05-18T21:39:14.374 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c969a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c412f7b0 con 0x7f85c4060e40 2020-05-18T21:39:14.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c2ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f85c40b94f0 0x7f85c40b6e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39912/0 (socket says 172.21.15.63:39912) 2020-05-18T21:39:14.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c27fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c4060e40 0x7f85c4061b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.378 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c2ffd700 1 -- 172.21.15.63:0/815491758 learned_addr learned my addr 172.21.15.63:0/815491758 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:14.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c37fe700 1 --2- 172.21.15.63:0/815491758 >> v2:172.21.15.155:3300/0 conn(0x7f85c412eea0 0x7f85c412f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c1ffb700 1 -- 172.21.15.63:0/815491758 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563370718 0 0) 0x7f85c40612e0 con 0x7f85c40b94f0 2020-05-18T21:39:14.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c1ffb700 1 -- 172.21.15.63:0/815491758 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85a8003270 con 0x7f85c40b94f0 2020-05-18T21:39:14.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c1ffb700 1 -- 172.21.15.63:0/815491758 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3076664363 0 0) 0x7f85a8003270 con 0x7f85c40b94f0 2020-05-18T21:39:14.379 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c1ffb700 1 -- 172.21.15.63:0/815491758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c4060e40 msgr2=0x7f85c4061b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:14.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c1ffb700 1 --2- 172.21.15.63:0/815491758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c4060e40 0x7f85c4061b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:14.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c1ffb700 1 -- 172.21.15.63:0/815491758 >> v2:172.21.15.155:3300/0 conn(0x7f85c412eea0 msgr2=0x7f85c412f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:14.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c1ffb700 1 --2- 172.21.15.63:0/815491758 >> v2:172.21.15.155:3300/0 conn(0x7f85c412eea0 0x7f85c412f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:14.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c1ffb700 1 -- 172.21.15.63:0/815491758 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c40b4780 con 0x7f85c40b94f0 2020-05-18T21:39:14.380 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c1ffb700 1 -- 172.21.15.63:0/815491758 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4242225469 0 0) 0x7f85b4001710 con 0x7f85c40b94f0 2020-05-18T21:39:14.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c1ffb700 1 -- 172.21.15.63:0/815491758 >> v1:172.21.15.63:6789/0 conn(0x7f85c40b94f0 legacy=0x7f85c40b6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c1ffb700 1 --2- 172.21.15.63:0/815491758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a8003760 0x7f85a8003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:14.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c1ffb700 1 --2- 172.21.15.63:0/815491758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85a80040a0 0x7f85a8004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:14.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c1ffb700 1 --2- 172.21.15.63:0/815491758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85a8004ae0 0x7f85a8004f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:14.381 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c1ffb700 1 -- 172.21.15.63:0/815491758 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a800b7f0 con 0x7f85a8003760 2020-05-18T21:39:14.382 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c1ffb700 1 -- 172.21.15.63:0/815491758 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a800b960 con 0x7f85a80040a0 2020-05-18T21:39:14.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c1ffb700 1 -- 172.21.15.63:0/815491758 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a800bb20 con 0x7f85a8004ae0 2020-05-18T21:39:14.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c27fc700 1 --2- 172.21.15.63:0/815491758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c4060e40 0x7f85c4061b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:39:14.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c2ffd700 1 --2- 172.21.15.63:0/815491758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a8003760 0x7f85a8003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c37fe700 1 --2- 172.21.15.63:0/815491758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85a8004ae0 0x7f85a8004f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.383 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c27fc700 1 --2- 172.21.15.63:0/815491758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85a80040a0 0x7f85a8004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c2ffd700 1 -- 172.21.15.63:0/815491758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85a8004ae0 msgr2=0x7f85a8004f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:14.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c2ffd700 1 --2- 172.21.15.63:0/815491758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85a8004ae0 0x7f85a8004f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:14.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c2ffd700 1 -- 172.21.15.63:0/815491758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85a80040a0 msgr2=0x7f85a8004570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:14.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c2ffd700 1 --2- 172.21.15.63:0/815491758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85a80040a0 0x7f85a8004570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:14.384 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c2ffd700 1 -- 172.21.15.63:0/815491758 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a8003270 con 0x7f85a8003760 2020-05-18T21:39:14.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c2ffd700 1 --2- 172.21.15.63:0/815491758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a8003760 0x7f85a8003b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f85b4001420 tx=0x7f85c4069510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c2ffd700 1 --2- 172.21.15.63:0/815491758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a8003760 0x7f85a8003b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f85b4001420 tx=0x7f85c4069510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c2ffd700 1 --2- 172.21.15.63:0/815491758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a8003760 0x7f85a8003b80 secure :-1 s=READY pgs=2303 cs=0 l=1 rx=0x7f85b4001420 tx=0x7f85c4069510).ready entity=mon.0 client_cookie=e163f7ffced127af server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:14.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c2ffd700 1 --2- 172.21.15.63:0/815491758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a8003760 0x7f85a8003b80 secure :-1 s=THROTTLE_DONE pgs=2303 cs=0 l=1 rx=0x7f85b4001420 tx=0x7f85c4069510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.385 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c1ffb700 1 -- 172.21.15.63:0/815491758 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85b400ce20 con 0x7f85a8003760 2020-05-18T21:39:14.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c2ffd700 1 --2- 172.21.15.63:0/815491758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a8003760 0x7f85a8003b80 secure :-1 s=THROTTLE_DONE pgs=2303 cs=0 l=1 rx=0x7f85b4001420 tx=0x7f85c4069510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c1ffb700 1 -- 172.21.15.63:0/815491758 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b400e370 con 0x7f85a8003760 2020-05-18T21:39:14.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c2ffd700 1 --2- 172.21.15.63:0/815491758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a8003760 0x7f85a8003b80 secure :-1 s=THROTTLE_DONE pgs=2303 cs=0 l=1 rx=0x7f85b4001420 tx=0x7f85c4069510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c969a700 1 -- 172.21.15.63:0/815491758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a8003760 msgr2=0x7f85a8003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.386 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c1ffb700 1 -- 172.21.15.63:0/815491758 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85b40100c0 con 0x7f85a8003760 2020-05-18T21:39:14.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c969a700 1 --2- 172.21.15.63:0/815491758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a8003760 0x7f85a8003b80 secure :-1 s=READY pgs=2303 cs=0 l=1 rx=0x7f85b4001420 tx=0x7f85c4069510).stop 2020-05-18T21:39:14.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.368+0000 7f85c37fe700 1 -- 172.21.15.63:0/815491758 reap_dead start 2020-05-18T21:39:14.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.372+0000 7f85c969a700 1 -- 172.21.15.63:0/815491758 shutdown_connections 2020-05-18T21:39:14.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.372+0000 7f85c969a700 1 -- 172.21.15.63:0/815491758 >> 172.21.15.63:0/815491758 conn(0x7f85c4069b70 msgr2=0x7f85c4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:14.387 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.372+0000 7f85c969a700 1 -- 172.21.15.63:0/815491758 shutdown_connections 2020-05-18T21:39:14.388 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.372+0000 7f85c969a700 1 -- 172.21.15.63:0/815491758 wait complete. 2020-05-18T21:39:14.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.372+0000 7f85c969a700 1 Processor -- start 2020-05-18T21:39:14.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.372+0000 7f85c969a700 1 -- start start 2020-05-18T21:39:14.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c969a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c4145ff0 0x7f85c4147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:14.391 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c969a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85c4153530 0x7f85c4153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:14.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c969a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c4147bc0 con 0x7f85c40bc0e0 2020-05-18T21:39:14.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c969a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c4147e60 con 0x7f85c4153530 2020-05-18T21:39:14.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c969a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4148100 con 0x7f85c4145ff0 2020-05-18T21:39:14.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c37fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85c4153530 0x7f85c4153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.392 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c2ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f85c40bc0e0 0x7f85c41485a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39924/0 (socket says 172.21.15.63:39924) 2020-05-18T21:39:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c2ffd700 1 -- 172.21.15.63:0/2097058100 learned_addr learned my addr 172.21.15.63:0/2097058100 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c27fc700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c4145ff0 0x7f85c4147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c37fe700 1 -- 172.21.15.63:0/2097058100 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c4145ff0 msgr2=0x7f85c4147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c37fe700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c4145ff0 0x7f85c4147590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c37fe700 1 -- 172.21.15.63:0/2097058100 >> v1:172.21.15.63:6789/0 conn(0x7f85c40bc0e0 legacy=0x7f85c41485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c37fe700 1 -- 172.21.15.63:0/2097058100 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c40bc4c0 con 0x7f85c4153530 2020-05-18T21:39:14.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c37fe700 1 --2- 172.21.15.63:0/2097058100 >> v2:172.21.15.63:3300/0 conn(0x7f85c4153530 0x7f85c4153990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f85b4001970 tx=0x7f85bc010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c37fe700 1 --2- 172.21.15.63:0/2097058100 >> v2:172.21.15.63:3300/0 conn(0x7f85c4153530 0x7f85c4153990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f85b4001970 tx=0x7f85bc010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c37fe700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85c4153530 0x7f85c4153990 secure :-1 s=READY pgs=2305 cs=0 l=1 rx=0x7f85b4001970 tx=0x7f85bc010f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:14.394 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c37fe700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85c4153530 0x7f85c4153990 secure :-1 s=THROTTLE_DONE pgs=2305 cs=0 l=1 rx=0x7f85b4001970 tx=0x7f85bc010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c37fe700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85c4153530 0x7f85c4153990 secure :-1 s=THROTTLE_DONE pgs=2305 cs=0 l=1 rx=0x7f85b4001970 tx=0x7f85bc010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c37fe700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85c4153530 0x7f85c4153990 secure :-1 s=THROTTLE_DONE pgs=2305 cs=0 l=1 rx=0x7f85b4001970 tx=0x7f85bc010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85b3fff700 1 -- 172.21.15.63:0/2097058100 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85bc005e60 con 0x7f85c4153530 2020-05-18T21:39:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85b3fff700 1 -- 172.21.15.63:0/2097058100 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc011770 con 0x7f85c4153530 2020-05-18T21:39:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c969a700 1 -- 172.21.15.63:0/2097058100 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c4153df0 con 0x7f85c4153530 2020-05-18T21:39:14.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85b3fff700 1 -- 172.21.15.63:0/2097058100 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85bc011ad0 con 0x7f85c4153530 2020-05-18T21:39:14.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.376+0000 7f85c969a700 1 -- 172.21.15.63:0/2097058100 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c412ad90 con 0x7f85c4153530 2020-05-18T21:39:14.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.380+0000 7f85c969a700 1 -- 172.21.15.63:0/2097058100 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c41479f0 con 0x7f85c4153530 2020-05-18T21:39:14.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.380+0000 7f85c37fe700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85c4153530 0x7f85c4153990 secure :-1 s=THROTTLE_DONE pgs=2305 cs=0 l=1 rx=0x7f85b4001970 tx=0x7f85bc010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.396 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.380+0000 7f85b3fff700 1 -- 172.21.15.63:0/2097058100 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f85bc011c30 con 0x7f85c4153530 2020-05-18T21:39:14.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.380+0000 7f85c37fe700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85c4153530 0x7f85c4153990 secure :-1 s=THROTTLE_DONE pgs=2305 cs=0 l=1 rx=0x7f85b4001970 tx=0x7f85bc010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.380+0000 7f85b3fff700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85a004f950 0x7f85a0051e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:14.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.380+0000 7f85b3fff700 1 -- 172.21.15.63:0/2097058100 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f85bc063800 con 0x7f85c4153530 2020-05-18T21:39:14.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.380+0000 7f85c2ffd700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85a004f950 0x7f85a0051e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.397 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.380+0000 7f85c2ffd700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85a004f950 0x7f85a0051e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f85c40bd490 tx=0x7f85c4069510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.380+0000 7f85c2ffd700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85a004f950 0x7f85a0051e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f85c40bd490 tx=0x7f85c4069510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.380+0000 7f85c2ffd700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85a004f950 0x7f85a0051e10 secure :-1 s=READY pgs=902 cs=0 l=1 rx=0x7f85c40bd490 tx=0x7f85c4069510).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:14.398 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.384+0000 7f85c37fe700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85c4153530 0x7f85c4153990 secure :-1 s=THROTTLE_DONE pgs=2305 cs=0 l=1 rx=0x7f85b4001970 tx=0x7f85bc010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.384+0000 7f85b3fff700 1 -- 172.21.15.63:0/2097058100 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f85bc03db30 con 0x7f85c4153530 2020-05-18T21:39:14.509 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.504+0000 7f85c969a700 1 -- 172.21.15.63:0/2097058100 --> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f85c40569e0 con 0x7f85a004f950 2020-05-18T21:39:14.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.504+0000 7f85c2ffd700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85a004f950 0x7f85a0051e10 secure :-1 s=THROTTLE_DONE pgs=902 cs=0 l=1 rx=0x7f85c40bd490 tx=0x7f85c4069510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.510 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.504+0000 7f85b3fff700 1 -- 172.21.15.63:0/2097058100 <== mgr.4110 v2:172.21.15.155:6832/12649 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f85c40569e0 con 0x7f85a004f950 2020-05-18T21:39:14.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.504+0000 7f85c969a700 1 -- 172.21.15.63:0/2097058100 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85a004f950 msgr2=0x7f85a0051e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.504+0000 7f85c969a700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85a004f950 0x7f85a0051e10 secure :-1 s=READY pgs=902 cs=0 l=1 rx=0x7f85c40bd490 tx=0x7f85c4069510).stop 2020-05-18T21:39:14.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.504+0000 7f85c969a700 1 -- 172.21.15.63:0/2097058100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85c4153530 msgr2=0x7f85c4153990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.512 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.504+0000 7f85c969a700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85c4153530 0x7f85c4153990 secure :-1 s=READY pgs=2305 cs=0 l=1 rx=0x7f85b4001970 tx=0x7f85bc010f00).stop 2020-05-18T21:39:14.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.504+0000 7f85c969a700 1 -- 172.21.15.63:0/2097058100 shutdown_connections 2020-05-18T21:39:14.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.504+0000 7f85c969a700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85a004f950 0x7f85a0051e10 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:14.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.504+0000 7f85c969a700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85c4153530 0x7f85c4153990 unknown :-1 s=CLOSED pgs=2305 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:14.513 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.504+0000 7f85c969a700 1 --2- 172.21.15.63:0/2097058100 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c4145ff0 0x7f85c4147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:14.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.504+0000 7f85c969a700 1 -- 172.21.15.63:0/2097058100 >> 172.21.15.63:0/2097058100 conn(0x7f85c4069b70 msgr2=0x7f85c4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:14.514 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.504+0000 7f85c969a700 1 -- 172.21.15.63:0/2097058100 shutdown_connections 2020-05-18T21:39:14.515 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.504+0000 7f85c969a700 1 -- 172.21.15.63:0/2097058100 wait complete. 2020-05-18T21:39:14.515 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 7 to deep-scrub 2020-05-18T21:39:14.523 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-05-18T21:39:14.621 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb69e1b700 1 Processor -- start 2020-05-18T21:39:14.622 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb69e1b700 1 -- start start 2020-05-18T21:39:14.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb69e1b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb6405f110 0x7ffb640b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:14.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb69e1b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffb6414aa70 0x7ffb640648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:14.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb69e1b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb64064d20 0x7ffb6414d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:14.624 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb69e1b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb6414a140 con 0x7ffb64064d20 2020-05-18T21:39:14.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb69e1b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb6414a330 con 0x7ffb6414aa70 2020-05-18T21:39:14.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb69e1b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6414a5d0 con 0x7ffb6405f110 2020-05-18T21:39:14.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb6961a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb64064d20 0x7ffb6414d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb6961a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb64064d20 0x7ffb6414d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37744/0 (socket says 172.21.15.63:37744) 2020-05-18T21:39:14.625 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb6961a700 1 -- 172.21.15.63:0/439047780 learned_addr learned my addr 172.21.15.63:0/439047780 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:14.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb68e19700 1 --2- 172.21.15.63:0/439047780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb6405f110 0x7ffb640b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb63fff700 1 --2- 172.21.15.63:0/439047780 >> v2:172.21.15.155:3300/0 conn(0x7ffb6414aa70 0x7ffb640648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb6961a700 1 -- 172.21.15.63:0/439047780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb6405f110 msgr2=0x7ffb640b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:14.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb6961a700 1 --2- 172.21.15.63:0/439047780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb6405f110 0x7ffb640b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:14.626 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb6961a700 1 -- 172.21.15.63:0/439047780 >> v2:172.21.15.155:3300/0 conn(0x7ffb6414aa70 msgr2=0x7ffb640648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:14.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb6961a700 1 --2- 172.21.15.63:0/439047780 >> v2:172.21.15.155:3300/0 conn(0x7ffb6414aa70 0x7ffb640648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:14.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb6961a700 1 -- 172.21.15.63:0/439047780 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb64063430 con 0x7ffb64064d20 2020-05-18T21:39:14.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb6961a700 1 --2- 172.21.15.63:0/439047780 >> v2:172.21.15.63:3300/0 conn(0x7ffb64064d20 0x7ffb6414d710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffb64063c70 tx=0x7ffb5c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb6961a700 1 --2- 172.21.15.63:0/439047780 >> v2:172.21.15.63:3300/0 conn(0x7ffb64064d20 0x7ffb6414d710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffb64063c70 tx=0x7ffb5c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.627 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb6961a700 1 --2- 172.21.15.63:0/439047780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb64064d20 0x7ffb6414d710 secure :-1 s=READY pgs=2306 cs=0 l=1 rx=0x7ffb64063c70 tx=0x7ffb5c007e00).ready entity=mon.0 client_cookie=5824c5bf4bd388de server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:14.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb6961a700 1 --2- 172.21.15.63:0/439047780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb64064d20 0x7ffb6414d710 secure :-1 s=THROTTLE_DONE pgs=2306 cs=0 l=1 rx=0x7ffb64063c70 tx=0x7ffb5c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb637fe700 1 -- 172.21.15.63:0/439047780 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb5c011c20 con 0x7ffb64064d20 2020-05-18T21:39:14.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb6961a700 1 --2- 172.21.15.63:0/439047780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb64064d20 0x7ffb6414d710 secure :-1 s=THROTTLE_DONE pgs=2306 cs=0 l=1 rx=0x7ffb64063c70 tx=0x7ffb5c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb637fe700 1 -- 172.21.15.63:0/439047780 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5c011d80 con 0x7ffb64064d20 2020-05-18T21:39:14.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb6961a700 1 --2- 172.21.15.63:0/439047780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb64064d20 0x7ffb6414d710 secure :-1 s=THROTTLE_DONE pgs=2306 cs=0 l=1 rx=0x7ffb64063c70 tx=0x7ffb5c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.628 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb637fe700 1 -- 172.21.15.63:0/439047780 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb5c00a370 con 0x7ffb64064d20 2020-05-18T21:39:14.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb69e1b700 1 -- 172.21.15.63:0/439047780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb64064d20 msgr2=0x7ffb6414d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.629 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb69e1b700 1 --2- 172.21.15.63:0/439047780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb64064d20 0x7ffb6414d710 secure :-1 s=READY pgs=2306 cs=0 l=1 rx=0x7ffb64063c70 tx=0x7ffb5c007e00).stop 2020-05-18T21:39:14.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb69e1b700 1 -- 172.21.15.63:0/439047780 shutdown_connections 2020-05-18T21:39:14.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb69e1b700 1 --2- 172.21.15.63:0/439047780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb64064d20 0x7ffb6414d710 unknown :-1 s=CLOSED pgs=2306 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:14.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb69e1b700 1 --2- 172.21.15.63:0/439047780 >> v2:172.21.15.155:3300/0 conn(0x7ffb6414aa70 0x7ffb640648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:14.632 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb69e1b700 1 --2- 172.21.15.63:0/439047780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb6405f110 0x7ffb640b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:14.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb69e1b700 1 -- 172.21.15.63:0/439047780 >> 172.21.15.63:0/439047780 conn(0x7ffb64069fc0 msgr2=0x7ffb6406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:14.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb69e1b700 1 -- 172.21.15.63:0/439047780 shutdown_connections 2020-05-18T21:39:14.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.616+0000 7ffb69e1b700 1 -- 172.21.15.63:0/439047780 wait complete. 2020-05-18T21:39:14.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.620+0000 7ffb69e1b700 1 Processor -- start 2020-05-18T21:39:14.633 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.620+0000 7ffb69e1b700 1 -- start start 2020-05-18T21:39:14.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb69e1b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffb64064d20 0x7ffb6414d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:14.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb69e1b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb6414aa70 0x7ffb640b7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:14.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb69e1b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6414dca0 con 0x7ffb6405f110 2020-05-18T21:39:14.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb69e1b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb64157830 con 0x7ffb64064d20 2020-05-18T21:39:14.634 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb69e1b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb64157ad0 con 0x7ffb6414aa70 2020-05-18T21:39:14.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb68e19700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ffb6405f110 0x7ffb640b7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39938/0 (socket says 172.21.15.63:39938) 2020-05-18T21:39:14.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb68e19700 1 -- 172.21.15.63:0/951431642 learned_addr learned my addr 172.21.15.63:0/951431642 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:14.635 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb6961a700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb6414aa70 0x7ffb640b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb63fff700 1 --2- 172.21.15.63:0/951431642 >> v2:172.21.15.155:3300/0 conn(0x7ffb64064d20 0x7ffb6414d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb61ffb700 1 -- 172.21.15.63:0/951431642 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552262062 0 0) 0x7ffb6414dca0 con 0x7ffb6405f110 2020-05-18T21:39:14.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb61ffb700 1 -- 172.21.15.63:0/951431642 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb4c002fe0 con 0x7ffb6405f110 2020-05-18T21:39:14.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb6961a700 1 -- 172.21.15.63:0/951431642 >> v2:172.21.15.155:3300/0 conn(0x7ffb64064d20 msgr2=0x7ffb6414d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.636 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb6961a700 1 --2- 172.21.15.63:0/951431642 >> v2:172.21.15.155:3300/0 conn(0x7ffb64064d20 0x7ffb6414d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:14.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb6961a700 1 -- 172.21.15.63:0/951431642 >> v1:172.21.15.63:6789/0 conn(0x7ffb6405f110 legacy=0x7ffb640b7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb6961a700 1 -- 172.21.15.63:0/951431642 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb64157d70 con 0x7ffb6414aa70 2020-05-18T21:39:14.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb6961a700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb6414aa70 0x7ffb640b7810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb640b8fc0 tx=0x7ffb5c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb6961a700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb6414aa70 0x7ffb640b7810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb640b8fc0 tx=0x7ffb5c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.637 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb6961a700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb6414aa70 0x7ffb640b7810 secure :-1 s=READY pgs=354 cs=0 l=1 rx=0x7ffb640b8fc0 tx=0x7ffb5c007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:14.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb6961a700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb6414aa70 0x7ffb640b7810 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7ffb640b8fc0 tx=0x7ffb5c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb61ffb700 1 -- 172.21.15.63:0/951431642 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb5c011e90 con 0x7ffb6414aa70 2020-05-18T21:39:14.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb6961a700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb6414aa70 0x7ffb640b7810 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7ffb640b8fc0 tx=0x7ffb5c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb69e1b700 1 -- 172.21.15.63:0/951431642 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb641574b0 con 0x7ffb6414aa70 2020-05-18T21:39:14.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb6961a700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb6414aa70 0x7ffb640b7810 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7ffb640b8fc0 tx=0x7ffb5c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.638 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb61ffb700 1 -- 172.21.15.63:0/951431642 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5c00a410 con 0x7ffb6414aa70 2020-05-18T21:39:14.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb61ffb700 1 -- 172.21.15.63:0/951431642 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb5c005c70 con 0x7ffb6414aa70 2020-05-18T21:39:14.639 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb69e1b700 1 -- 172.21.15.63:0/951431642 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb64158210 con 0x7ffb6414aa70 2020-05-18T21:39:14.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb6961a700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb6414aa70 0x7ffb640b7810 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7ffb640b8fc0 tx=0x7ffb5c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.640 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.624+0000 7ffb69e1b700 1 -- 172.21.15.63:0/951431642 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb640569e0 con 0x7ffb6414aa70 2020-05-18T21:39:14.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.628+0000 7ffb61ffb700 1 -- 172.21.15.63:0/951431642 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7ffb5c007170 con 0x7ffb6414aa70 2020-05-18T21:39:14.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.628+0000 7ffb6961a700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb6414aa70 0x7ffb640b7810 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7ffb640b8fc0 tx=0x7ffb5c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.628+0000 7ffb61ffb700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb4c04fd40 0x7ffb4c052200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:14.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.628+0000 7ffb61ffb700 1 -- 172.21.15.63:0/951431642 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ffb5c064680 con 0x7ffb6414aa70 2020-05-18T21:39:14.641 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.628+0000 7ffb68e19700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb4c04fd40 0x7ffb4c052200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:14.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.628+0000 7ffb68e19700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb4c04fd40 0x7ffb4c052200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb58002f70 tx=0x7ffb58009110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.628+0000 7ffb68e19700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb4c04fd40 0x7ffb4c052200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb58002f70 tx=0x7ffb58009110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.642 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.628+0000 7ffb68e19700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb4c04fd40 0x7ffb4c052200 secure :-1 s=READY pgs=903 cs=0 l=1 rx=0x7ffb58002f70 tx=0x7ffb58009110).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:14.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.636+0000 7ffb6961a700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb6414aa70 0x7ffb640b7810 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7ffb640b8fc0 tx=0x7ffb5c007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.643 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.636+0000 7ffb61ffb700 1 -- 172.21.15.63:0/951431642 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7ffb5c03ead0 con 0x7ffb6414aa70 2020-05-18T21:39:14.758 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.752+0000 7ffb69e1b700 1 -- 172.21.15.63:0/951431642 --> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb64043870 con 0x7ffb4c04fd40 2020-05-18T21:39:14.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.760+0000 7ffb68e19700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb4c04fd40 0x7ffb4c052200 secure :-1 s=THROTTLE_DONE pgs=903 cs=0 l=1 rx=0x7ffb58002f70 tx=0x7ffb58009110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:14.767 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.760+0000 7ffb61ffb700 1 -- 172.21.15.63:0/951431642 <== mgr.4110 v2:172.21.15.155:6832/12649 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+104867 (secure 0 0 0) 0x7ffb64043870 con 0x7ffb4c04fd40 2020-05-18T21:39:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:39:14.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.764+0000 7ffb69e1b700 1 -- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb4c04fd40 msgr2=0x7ffb4c052200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.764+0000 7ffb69e1b700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb4c04fd40 0x7ffb4c052200 secure :-1 s=READY pgs=903 cs=0 l=1 rx=0x7ffb58002f70 tx=0x7ffb58009110).stop 2020-05-18T21:39:14.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.764+0000 7ffb69e1b700 1 -- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb6414aa70 msgr2=0x7ffb640b7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:14.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.764+0000 7ffb69e1b700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb6414aa70 0x7ffb640b7810 secure :-1 s=READY pgs=354 cs=0 l=1 rx=0x7ffb640b8fc0 tx=0x7ffb5c007e00).stop 2020-05-18T21:39:14.771 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.764+0000 7ffb69e1b700 1 -- 172.21.15.63:0/951431642 shutdown_connections 2020-05-18T21:39:14.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.764+0000 7ffb69e1b700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7ffb4c04fd40 0x7ffb4c052200 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:14.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.764+0000 7ffb69e1b700 1 --2- 172.21.15.63:0/951431642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb6414aa70 0x7ffb640b7810 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:14.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.764+0000 7ffb69e1b700 1 --2- 172.21.15.63:0/951431642 >> v2:172.21.15.155:3300/0 conn(0x7ffb64064d20 0x7ffb6414d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:14.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.764+0000 7ffb69e1b700 1 -- 172.21.15.63:0/951431642 >> 172.21.15.63:0/951431642 conn(0x7ffb64069fc0 msgr2=0x7ffb64060420 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:14.772 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.764+0000 7ffb69e1b700 1 -- 172.21.15.63:0/951431642 shutdown_connections 2020-05-18T21:39:14.773 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:14.764+0000 7ffb69e1b700 1 -- 172.21.15.63:0/951431642 wait complete. 2020-05-18T21:39:14.773 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2020-05-18T21:39:14.783 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":541,"stamp":"2020-05-18T21:39:13.253049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":65772,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":16,"num_read_kb":8194,"num_write":147,"num_write_kb":16511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8405664,"kb_used_data":16992,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746569056,"statfs":{"total":773094113280,"available":764486713344,"internally_reserved":8589934592,"allocated":17399808,"data_stored":8218848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":365,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003186"},"pg_stats":[{"pgid":"32.7","version":"0'0","reported_seq":"20","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:03.869026+0000","last_change":"2020-05-18T21:39:01.159893+0000","last_active":"2020-05-18T21:39:03.869026+0000","last_peered":"2020-05-18T21:39:03.869026+0000","last_clean":"2020-05-18T21:39:03.869026+0000","last_became_active":"2020-05-18T21:38:30.449166+0000","last_became_peered":"2020-05-18T21:38:30.449166+0000","last_unstale":"2020-05-18T21:39:03.869026+0000","last_undegraded":"2020-05-18T21:39:03.869026+0000","last_fullsized":"2020-05-18T21:39:03.869026+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_clean_scrub_stamp":"2020-05-18T21:38:30.097894+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":"20","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:03.829070+0000","last_change":"2020-05-18T21:39:01.131385+0000","last_active":"2020-05-18T21:39:03.829070+0000","last_peered":"2020-05-18T21:39:03.829070+0000","last_clean":"2020-05-18T21:39:03.829070+0000","last_became_active":"2020-05-18T21:38:30.450235+0000","last_became_peered":"2020-05-18T21:38:30.450235+0000","last_unstale":"2020-05-18T21:39:03.829070+0000","last_undegraded":"2020-05-18T21:39:03.829070+0000","last_fullsized":"2020-05-18T21:39:03.829070+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_clean_scrub_stamp":"2020-05-18T21:38:30.097894+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"168'7","reported_seq":"27","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:03.871034+0000","last_change":"2020-05-18T21:39:01.133098+0000","last_active":"2020-05-18T21:39:03.871034+0000","last_peered":"2020-05-18T21:39:03.871034+0000","last_clean":"2020-05-18T21:39:03.871034+0000","last_became_active":"2020-05-18T21:38:30.447545+0000","last_became_peered":"2020-05-18T21:38:30.447545+0000","last_unstale":"2020-05-18T21:39:03.871034+0000","last_undegraded":"2020-05-18T21:39:03.871034+0000","last_fullsized":"2020-05-18T21:39:03.871034+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_clean_scrub_stamp":"2020-05-18T21:38:30.097894+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.7","version":"167'17","reported_seq":"29","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.123889+0000","last_change":"2020-05-18T21:38:30.124807+0000","last_active":"2020-05-18T21:39:01.123889+0000","last_peered":"2020-05-18T21:39:01.123889+0000","last_clean":"2020-05-18T21:39:01.123889+0000","last_became_active":"2020-05-18T21:38:30.124194+0000","last_became_peered":"2020-05-18T21:38:30.124194+0000","last_unstale":"2020-05-18T21:39:01.123889+0000","last_undegraded":"2020-05-18T21:39:01.123889+0000","last_fullsized":"2020-05-18T21:39:01.123889+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_clean_scrub_stamp":"2020-05-18T21:38:29.085681+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.6","version":"169'11","reported_seq":"23","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:03.871069+0000","last_change":"2020-05-18T21:38:30.130020+0000","last_active":"2020-05-18T21:39:03.871069+0000","last_peered":"2020-05-18T21:39:03.871069+0000","last_clean":"2020-05-18T21:39:03.871069+0000","last_became_active":"2020-05-18T21:38:30.129606+0000","last_became_peered":"2020-05-18T21:38:30.129606+0000","last_unstale":"2020-05-18T21:39:03.871069+0000","last_undegraded":"2020-05-18T21:39:03.871069+0000","last_fullsized":"2020-05-18T21:39:03.871069+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_clean_scrub_stamp":"2020-05-18T21:38:29.085681+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.5","version":"167'11","reported_seq":"23","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.150909+0000","last_change":"2020-05-18T21:38:30.137091+0000","last_active":"2020-05-18T21:39:01.150909+0000","last_peered":"2020-05-18T21:39:01.150909+0000","last_clean":"2020-05-18T21:39:01.150909+0000","last_became_active":"2020-05-18T21:38:30.136652+0000","last_became_peered":"2020-05-18T21:38:30.136652+0000","last_unstale":"2020-05-18T21:39:01.150909+0000","last_undegraded":"2020-05-18T21:39:01.150909+0000","last_fullsized":"2020-05-18T21:39:01.150909+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_clean_scrub_stamp":"2020-05-18T21:38:29.085681+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.4","version":"169'46","reported_seq":"58","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:06.068130+0000","last_change":"2020-05-18T21:38:30.127494+0000","last_active":"2020-05-18T21:39:06.068130+0000","last_peered":"2020-05-18T21:39:06.068130+0000","last_clean":"2020-05-18T21:39:06.068130+0000","last_became_active":"2020-05-18T21:38:30.127063+0000","last_became_peered":"2020-05-18T21:38:30.127063+0000","last_unstale":"2020-05-18T21:39:06.068130+0000","last_undegraded":"2020-05-18T21:39:06.068130+0000","last_fullsized":"2020-05-18T21:39:06.068130+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_clean_scrub_stamp":"2020-05-18T21:38:29.085681+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":64778,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"167'12","reported_seq":"24","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.569824+0000","last_change":"2020-05-18T21:38:30.127987+0000","last_active":"2020-05-18T21:39:01.569824+0000","last_peered":"2020-05-18T21:39:01.569824+0000","last_clean":"2020-05-18T21:39:01.569824+0000","last_became_active":"2020-05-18T21:38:30.127183+0000","last_became_peered":"2020-05-18T21:38:30.127183+0000","last_unstale":"2020-05-18T21:39:01.569824+0000","last_undegraded":"2020-05-18T21:39:01.569824+0000","last_fullsized":"2020-05-18T21:39:01.569824+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_clean_scrub_stamp":"2020-05-18T21:38:29.085681+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.1","version":"167'3","reported_seq":"17","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.123656+0000","last_change":"2020-05-18T21:38:30.127977+0000","last_active":"2020-05-18T21:39:01.123656+0000","last_peered":"2020-05-18T21:39:01.123656+0000","last_clean":"2020-05-18T21:39:01.123656+0000","last_became_active":"2020-05-18T21:38:30.127339+0000","last_became_peered":"2020-05-18T21:38:30.127339+0000","last_unstale":"2020-05-18T21:39:01.123656+0000","last_undegraded":"2020-05-18T21:39:01.123656+0000","last_fullsized":"2020-05-18T21:39:01.123656+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_clean_scrub_stamp":"2020-05-18T21:38:29.085681+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":210,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"151","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.125400+0000","last_change":"2020-05-18T21:26:37.226650+0000","last_active":"2020-05-18T21:39:01.125400+0000","last_peered":"2020-05-18T21:39:01.125400+0000","last_clean":"2020-05-18T21:39:01.125400+0000","last_became_active":"2020-05-18T21:26:37.224618+0000","last_became_peered":"2020-05-18T21:26:37.224618+0000","last_unstale":"2020-05-18T21:39:01.125400+0000","last_undegraded":"2020-05-18T21:39:01.125400+0000","last_fullsized":"2020-05-18T21:39:01.125400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:34.017197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:34.017197+0000","last_clean_scrub_stamp":"2020-05-18T21:26:34.017197+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"146","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.129189+0000","last_change":"2020-05-18T21:26:42.152047+0000","last_active":"2020-05-18T21:39:01.129189+0000","last_peered":"2020-05-18T21:39:01.129189+0000","last_clean":"2020-05-18T21:39:01.129189+0000","last_became_active":"2020-05-18T21:26:42.151473+0000","last_became_peered":"2020-05-18T21:26:42.151473+0000","last_unstale":"2020-05-18T21:39:01.129189+0000","last_undegraded":"2020-05-18T21:39:01.129189+0000","last_fullsized":"2020-05-18T21:39:01.129189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.0","version":"167'13","reported_seq":"25","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.569324+0000","last_change":"2020-05-18T21:38:30.131483+0000","last_active":"2020-05-18T21:39:01.569324+0000","last_peered":"2020-05-18T21:39:01.569324+0000","last_clean":"2020-05-18T21:39:01.569324+0000","last_became_active":"2020-05-18T21:38:30.131041+0000","last_became_peered":"2020-05-18T21:38:30.131041+0000","last_unstale":"2020-05-18T21:39:01.569324+0000","last_undegraded":"2020-05-18T21:39:01.569324+0000","last_fullsized":"2020-05-18T21:39:01.569324+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_clean_scrub_stamp":"2020-05-18T21:38:29.085681+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"146","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.124729+0000","last_change":"2020-05-18T21:26:42.150248+0000","last_active":"2020-05-18T21:39:01.124729+0000","last_peered":"2020-05-18T21:39:01.124729+0000","last_clean":"2020-05-18T21:39:01.124729+0000","last_became_active":"2020-05-18T21:26:42.149888+0000","last_became_peered":"2020-05-18T21:26:42.149888+0000","last_unstale":"2020-05-18T21:39:01.124729+0000","last_undegraded":"2020-05-18T21:39:01.124729+0000","last_fullsized":"2020-05-18T21:39:01.124729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":"20","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:03.823137+0000","last_change":"2020-05-18T21:39:01.146562+0000","last_active":"2020-05-18T21:39:03.823137+0000","last_peered":"2020-05-18T21:39:03.823137+0000","last_clean":"2020-05-18T21:39:03.823137+0000","last_became_active":"2020-05-18T21:38:30.452015+0000","last_became_peered":"2020-05-18T21:38:30.452015+0000","last_unstale":"2020-05-18T21:39:03.823137+0000","last_undegraded":"2020-05-18T21:39:03.823137+0000","last_fullsized":"2020-05-18T21:39:03.823137+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_clean_scrub_stamp":"2020-05-18T21:38:30.097894+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"144","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.158499+0000","last_change":"2020-05-18T21:26:42.226096+0000","last_active":"2020-05-18T21:39:01.158499+0000","last_peered":"2020-05-18T21:39:01.158499+0000","last_clean":"2020-05-18T21:39:01.158499+0000","last_became_active":"2020-05-18T21:26:42.225154+0000","last_became_peered":"2020-05-18T21:26:42.225154+0000","last_unstale":"2020-05-18T21:39:01.158499+0000","last_undegraded":"2020-05-18T21:39:01.158499+0000","last_fullsized":"2020-05-18T21:39:01.158499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.2","version":"166'1","reported_seq":"13","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.124405+0000","last_change":"2020-05-18T21:38:30.128905+0000","last_active":"2020-05-18T21:39:01.124405+0000","last_peered":"2020-05-18T21:39:01.124405+0000","last_clean":"2020-05-18T21:39:01.124405+0000","last_became_active":"2020-05-18T21:38:30.128523+0000","last_became_peered":"2020-05-18T21:38:30.128523+0000","last_unstale":"2020-05-18T21:39:01.124405+0000","last_undegraded":"2020-05-18T21:39:01.124405+0000","last_fullsized":"2020-05-18T21:39:01.124405+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:29.085681+0000","last_clean_scrub_stamp":"2020-05-18T21:38:29.085681+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"146","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.129339+0000","last_change":"2020-05-18T21:26:42.153477+0000","last_active":"2020-05-18T21:39:01.129339+0000","last_peered":"2020-05-18T21:39:01.129339+0000","last_clean":"2020-05-18T21:39:01.129339+0000","last_became_active":"2020-05-18T21:26:42.153056+0000","last_became_peered":"2020-05-18T21:26:42.153056+0000","last_unstale":"2020-05-18T21:39:01.129339+0000","last_undegraded":"2020-05-18T21:39:01.129339+0000","last_fullsized":"2020-05-18T21:39:01.129339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":"20","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:03.869434+0000","last_change":"2020-05-18T21:39:01.153428+0000","last_active":"2020-05-18T21:39:03.869434+0000","last_peered":"2020-05-18T21:39:03.869434+0000","last_clean":"2020-05-18T21:39:03.869434+0000","last_became_active":"2020-05-18T21:38:30.443876+0000","last_became_peered":"2020-05-18T21:38:30.443876+0000","last_unstale":"2020-05-18T21:39:03.869434+0000","last_undegraded":"2020-05-18T21:39:03.869434+0000","last_fullsized":"2020-05-18T21:39:03.869434+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_clean_scrub_stamp":"2020-05-18T21:38:30.097894+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"160","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.123887+0000","last_change":"2020-05-18T21:26:42.155086+0000","last_active":"2020-05-18T21:39:01.123887+0000","last_peered":"2020-05-18T21:39:01.123887+0000","last_clean":"2020-05-18T21:39:01.123887+0000","last_became_active":"2020-05-18T21:26:42.154622+0000","last_became_peered":"2020-05-18T21:26:42.154622+0000","last_unstale":"2020-05-18T21:39:01.123887+0000","last_undegraded":"2020-05-18T21:39:01.123887+0000","last_fullsized":"2020-05-18T21:39:01.123887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":"20","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:03.823244+0000","last_change":"2020-05-18T21:39:01.146185+0000","last_active":"2020-05-18T21:39:03.823244+0000","last_peered":"2020-05-18T21:39:03.823244+0000","last_clean":"2020-05-18T21:39:03.823244+0000","last_became_active":"2020-05-18T21:38:30.452336+0000","last_became_peered":"2020-05-18T21:38:30.452336+0000","last_unstale":"2020-05-18T21:39:03.823244+0000","last_undegraded":"2020-05-18T21:39:03.823244+0000","last_fullsized":"2020-05-18T21:39:03.823244+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_clean_scrub_stamp":"2020-05-18T21:38:30.097894+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"146","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.125897+0000","last_change":"2020-05-18T21:26:42.155047+0000","last_active":"2020-05-18T21:39:01.125897+0000","last_peered":"2020-05-18T21:39:01.125897+0000","last_clean":"2020-05-18T21:39:01.125897+0000","last_became_active":"2020-05-18T21:26:42.154722+0000","last_became_peered":"2020-05-18T21:26:42.154722+0000","last_unstale":"2020-05-18T21:39:01.125897+0000","last_undegraded":"2020-05-18T21:39:01.125897+0000","last_fullsized":"2020-05-18T21:39:01.125897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":"20","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:03.868843+0000","last_change":"2020-05-18T21:39:01.160347+0000","last_active":"2020-05-18T21:39:03.868843+0000","last_peered":"2020-05-18T21:39:03.868843+0000","last_clean":"2020-05-18T21:39:03.868843+0000","last_became_active":"2020-05-18T21:38:30.592942+0000","last_became_peered":"2020-05-18T21:38:30.592942+0000","last_unstale":"2020-05-18T21:39:03.868843+0000","last_undegraded":"2020-05-18T21:39:03.868843+0000","last_fullsized":"2020-05-18T21:39:03.868843+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_clean_scrub_stamp":"2020-05-18T21:38:30.097894+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"160","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.123642+0000","last_change":"2020-05-18T21:26:42.151175+0000","last_active":"2020-05-18T21:39:01.123642+0000","last_peered":"2020-05-18T21:39:01.123642+0000","last_clean":"2020-05-18T21:39:01.123642+0000","last_became_active":"2020-05-18T21:26:42.150762+0000","last_became_peered":"2020-05-18T21:26:42.150762+0000","last_unstale":"2020-05-18T21:39:01.123642+0000","last_undegraded":"2020-05-18T21:39:01.123642+0000","last_fullsized":"2020-05-18T21:39:01.123642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2","version":"168'9","reported_seq":"35","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:03.869434+0000","last_change":"2020-05-18T21:39:01.161030+0000","last_active":"2020-05-18T21:39:03.869434+0000","last_peered":"2020-05-18T21:39:03.869434+0000","last_clean":"2020-05-18T21:39:03.869434+0000","last_became_active":"2020-05-18T21:38:30.446893+0000","last_became_peered":"2020-05-18T21:38:30.446893+0000","last_unstale":"2020-05-18T21:39:03.869434+0000","last_undegraded":"2020-05-18T21:39:03.869434+0000","last_fullsized":"2020-05-18T21:39:03.869434+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:38:30.097894+0000","last_clean_scrub_stamp":"2020-05-18T21:38:30.097894+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4096,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"142","reported_epoch":"168","state":"active+clean","last_fresh":"2020-05-18T21:39:01.125300+0000","last_change":"2020-05-18T21:26:42.153239+0000","last_active":"2020-05-18T21:39:01.125300+0000","last_peered":"2020-05-18T21:39:01.125300+0000","last_clean":"2020-05-18T21:39:01.125300+0000","last_became_active":"2020-05-18T21:26:42.152721+0000","last_became_peered":"2020-05-18T21:26:42.152721+0000","last_unstale":"2020-05-18T21:39:01.125300+0000","last_undegraded":"2020-05-18T21:39:01.125300+0000","last_fullsized":"2020-05-18T21:39:01.125300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:26:41.118270+0000","last_clean_scrub_stamp":"2020-05-18T21:26:41.118270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":16,"acting":16,"num_store_stats":7},{"poolid":31,"num_pg":8,"stat_sum":{"num_bytes":65772,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":135,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":131544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":16,"acting":16,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575001,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050684,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321156,"statfs":{"total":96636764160,"available":95560863744,"internally_reserved":1073741824,"allocated":2150400,"data_stored":1010913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":1.887,"5min":1.7689999999999999,"15min":1.694},"min":{"1min":1.0209999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.98,"5min":6.4699999999999998,"15min":6.4699999999999998},"last":2.6920000000000002},{"interface":"front","average":{"1min":1.881,"5min":1.6950000000000001,"15min":1.7669999999999999},"min":{"1min":1.1279999999999999,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.7450000000000001,"5min":2.8919999999999999,"15min":3.0779999999999998},"last":1.5129999999999999}]},{"osd":1,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":2.149,"5min":2.04,"15min":2.0299999999999998},"min":{"1min":1.2829999999999999,"5min":0.86399999999999999,"15min":0.72199999999999998},"max":{"1min":3.698,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":2.48},{"interface":"front","average":{"1min":2.3620000000000001,"5min":2.5190000000000001,"15min":2.5329999999999999},"min":{"1min":1.319,"5min":1.264,"15min":1.1399999999999999},"max":{"1min":4.2149999999999999,"5min":6.6799999999999997,"15min":6.6799999999999997},"last":3.0449999999999999}]},{"osd":2,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":2.181,"5min":2.21,"15min":2.214},"min":{"1min":1.3779999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"max":{"1min":2.7490000000000001,"5min":9.032,"15min":9.032},"last":2.2480000000000002},{"interface":"front","average":{"1min":2.2330000000000001,"5min":2.226,"15min":2.2389999999999999},"min":{"1min":1.3859999999999999,"5min":1.107,"15min":0.86899999999999999},"max":{"1min":3.907,"5min":3.907,"15min":3.9660000000000002},"last":2.206}]},{"osd":3,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":2.2480000000000002,"5min":2.2120000000000002,"15min":2.306},"min":{"1min":1.401,"5min":1.056,"15min":1.056},"max":{"1min":2.9249999999999998,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":1.635},{"interface":"front","average":{"1min":2.851,"5min":2.827,"15min":2.8889999999999998},"min":{"1min":1.7130000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"max":{"1min":3.7639999999999998,"5min":8.8469999999999995,"15min":8.8469999999999995},"last":3.266}]},{"osd":4,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":2.6909999999999998,"5min":2.4950000000000001,"15min":2.5270000000000001},"min":{"1min":2.008,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":3.5150000000000001,"5min":3.5510000000000002,"15min":4.9530000000000003},"last":1.9039999999999999},{"interface":"front","average":{"1min":2.6379999999999999,"5min":2.532,"15min":2.5390000000000001},"min":{"1min":1.5660000000000001,"5min":1.089,"15min":1.0580000000000001},"max":{"1min":3.306,"5min":3.7320000000000002,"15min":4.0620000000000003},"last":2.0649999999999999}]},{"osd":5,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":2.9159999999999999,"5min":2.899,"15min":2.9340000000000002},"min":{"1min":1.633,"5min":1.6040000000000001,"15min":1.111},"max":{"1min":3.7970000000000002,"5min":9.218,"15min":9.218},"last":1.849},{"interface":"front","average":{"1min":3.0179999999999998,"5min":2.9420000000000002,"15min":3.036},"min":{"1min":2.2909999999999999,"5min":1.4950000000000001,"15min":1.268},"max":{"1min":3.641,"5min":3.9980000000000002,"15min":4.6399999999999997},"last":2.4350000000000001}]},{"osd":6,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":3.3199999999999998,"5min":3.0859999999999999,"15min":3.2040000000000002},"min":{"1min":2.1419999999999999,"5min":1.2230000000000001,"15min":1.2230000000000001},"max":{"1min":4.367,"5min":4.367,"15min":5.6600000000000001},"last":2.6520000000000001},{"interface":"front","average":{"1min":3.0369999999999999,"5min":3.0350000000000001,"15min":3.1349999999999998},"min":{"1min":1.8340000000000001,"5min":1.464,"15min":1.3009999999999999},"max":{"1min":3.6920000000000002,"5min":4.2510000000000003,"15min":5.2539999999999996},"last":2.8580000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575002,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050756,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321084,"statfs":{"total":96636764160,"available":95560790016,"internally_reserved":1073741824,"allocated":2224128,"data_stored":1075691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":1.774,"5min":1.9510000000000001,"15min":1.9259999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.56799999999999995},"max":{"1min":2.7749999999999999,"5min":6.9699999999999998,"15min":6.9699999999999998},"last":2.4590000000000001},{"interface":"front","average":{"1min":2.2120000000000002,"5min":2.4009999999999998,"15min":2.427},"min":{"1min":1.6479999999999999,"5min":1.1879999999999999,"15min":1.0169999999999999},"max":{"1min":3.1120000000000001,"5min":6.9340000000000002,"15min":16.428999999999998},"last":2.4260000000000002}]},{"osd":1,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":1.9319999999999999,"5min":2.992,"15min":2.403},"min":{"1min":0.99099999999999999,"5min":0.81899999999999995,"15min":0.78600000000000003},"max":{"1min":2.802,"5min":113.30200000000001,"15min":113.30200000000001},"last":2.5739999999999998},{"interface":"front","average":{"1min":2.1240000000000001,"5min":3.2370000000000001,"15min":2.456},"min":{"1min":1.359,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":2.871,"5min":113.866,"15min":113.866},"last":1.831}]},{"osd":2,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":2.1829999999999998,"5min":2.169,"15min":2.2290000000000001},"min":{"1min":1.5800000000000001,"5min":1.016,"15min":0.97799999999999998},"max":{"1min":3.2650000000000001,"5min":3.8180000000000001,"15min":4.7489999999999997},"last":2.2429999999999999},{"interface":"front","average":{"1min":2.2309999999999999,"5min":2.2160000000000002,"15min":2.3580000000000001},"min":{"1min":1.111,"5min":0.97399999999999998,"15min":0.81100000000000005},"max":{"1min":2.8900000000000001,"5min":3.5329999999999999,"15min":4.3239999999999998},"last":2.1869999999999998}]},{"osd":3,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":2.5249999999999999,"5min":2.294,"15min":2.3900000000000001},"min":{"1min":1.6279999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":3.367,"5min":4.2610000000000001,"15min":16.594000000000001},"last":1.698},{"interface":"front","average":{"1min":2.5179999999999998,"5min":2.5390000000000001,"15min":2.681},"min":{"1min":1.7170000000000001,"5min":1.224,"15min":1.171},"max":{"1min":3.9510000000000001,"5min":4.1660000000000004,"15min":4.7619999999999996},"last":2.7989999999999999}]},{"osd":4,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.5739999999999998,"15min":2.6360000000000001},"min":{"1min":2.0859999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":3.3260000000000001,"5min":3.9740000000000002,"15min":3.9990000000000001},"last":2.6840000000000002},{"interface":"front","average":{"1min":2.7370000000000001,"5min":2.6389999999999998,"15min":2.7509999999999999},"min":{"1min":2.0379999999999998,"5min":1.129,"15min":0.84599999999999997},"max":{"1min":3.4449999999999998,"5min":4.6829999999999998,"15min":29.829999999999998},"last":2.1400000000000001}]},{"osd":5,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":3.0550000000000002,"5min":2.968,"15min":3.0379999999999998},"min":{"1min":1.903,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":4.2549999999999999,"5min":6.7370000000000001,"15min":6.7370000000000001},"last":2.9969999999999999},{"interface":"front","average":{"1min":3.2519999999999998,"5min":3.1560000000000001,"15min":3.2120000000000002},"min":{"1min":2.552,"5min":1.357,"15min":1.357},"max":{"1min":3.9689999999999999,"5min":6.3710000000000004,"15min":6.3710000000000004},"last":2.8849999999999998}]},{"osd":7,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":3.2120000000000002,"5min":3.016,"15min":3.1629999999999998},"min":{"1min":2.5600000000000001,"5min":1.2549999999999999,"15min":0.96199999999999997},"max":{"1min":3.8210000000000002,"5min":5.5670000000000002,"15min":31.196000000000002},"last":2.6400000000000001},{"interface":"front","average":{"1min":3.2349999999999999,"5min":3.1070000000000002,"15min":3.2410000000000001},"min":{"1min":2.5110000000000001,"5min":1.363,"15min":1.363},"max":{"1min":4.5289999999999999,"5min":4.6429999999999998,"15min":4.8049999999999997},"last":3.206}]}]},{"osd":5,"up_from":13,"seq":55834575001,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050684,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321156,"statfs":{"total":96636764160,"available":95560863744,"internally_reserved":1073741824,"allocated":2150400,"data_stored":1010913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":1.7470000000000001,"5min":1.7909999999999999,"15min":1.806},"min":{"1min":1.179,"5min":0.623,"15min":0.623},"max":{"1min":3.0649999999999999,"5min":8.1430000000000007,"15min":8.1430000000000007},"last":1.885},{"interface":"front","average":{"1min":1.7669999999999999,"5min":1.847,"15min":1.8700000000000001},"min":{"1min":1.1339999999999999,"5min":0.81100000000000005,"15min":0.623},"max":{"1min":2.5339999999999998,"5min":3.8250000000000002,"15min":3.8250000000000002},"last":2.403}]},{"osd":1,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":1.869,"5min":1.79,"15min":1.8640000000000001},"min":{"1min":1.3100000000000001,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.722,"5min":3.887,"15min":3.887},"last":1.6890000000000001},{"interface":"front","average":{"1min":2.1400000000000001,"5min":2.2610000000000001,"15min":2.1499999999999999},"min":{"1min":1.254,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.9380000000000002,"5min":8.6259999999999994,"15min":8.6259999999999994},"last":1.5}]},{"osd":2,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":2.1190000000000002,"5min":2.0110000000000001,"15min":2.028},"min":{"1min":1.4399999999999999,"5min":0.91700000000000004,"15min":0.85299999999999998},"max":{"1min":3.4140000000000001,"5min":4.726,"15min":5.3410000000000002},"last":1.6200000000000001},{"interface":"front","average":{"1min":2.266,"5min":2.1779999999999999,"15min":2.1419999999999999},"min":{"1min":1.8400000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":3.1600000000000001,"5min":7.4989999999999997,"15min":7.4989999999999997},"last":2.0979999999999999}]},{"osd":3,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":2.472,"5min":2.5760000000000001,"15min":2.5339999999999998},"min":{"1min":1.2,"5min":1.087,"15min":1.087},"max":{"1min":3.0339999999999998,"5min":7.8070000000000004,"15min":7.8070000000000004},"last":2.6739999999999999},{"interface":"front","average":{"1min":2.6859999999999999,"5min":2.5939999999999999,"15min":2.5760000000000001},"min":{"1min":2.0640000000000001,"5min":1.2509999999999999,"15min":0.995},"max":{"1min":3.246,"5min":5.1200000000000001,"15min":5.5060000000000002},"last":2.0459999999999998}]},{"osd":4,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":2.6309999999999998,"5min":2.6549999999999998,"15min":2.633},"min":{"1min":1.7769999999999999,"5min":1.032,"15min":0.98099999999999998},"max":{"1min":3.427,"5min":8.4000000000000004,"15min":8.4000000000000004},"last":2.274},{"interface":"front","average":{"1min":2.8410000000000002,"5min":2.7120000000000002,"15min":2.7999999999999998},"min":{"1min":1.9890000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":3.6400000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":2.8490000000000002}]},{"osd":6,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":2.7040000000000002,"5min":2.629,"15min":2.661},"min":{"1min":2.0089999999999999,"5min":0.89200000000000002,"15min":0.88900000000000001},"max":{"1min":4.0010000000000003,"5min":11.242000000000001,"15min":11.242000000000001},"last":2.4980000000000002},{"interface":"front","average":{"1min":3.2320000000000002,"5min":3.282,"15min":3.2240000000000002},"min":{"1min":2.7559999999999998,"5min":1.2,"15min":1.1990000000000001},"max":{"1min":3.8730000000000002,"5min":11.411,"15min":11.411},"last":3.04}]},{"osd":7,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":3.3319999999999999,"5min":3.2679999999999998,"15min":3.2280000000000002},"min":{"1min":2.375,"5min":1.232,"15min":1.012},"max":{"1min":4.3609999999999998,"5min":9.5749999999999993,"15min":9.5749999999999993},"last":2.6320000000000001},{"interface":"front","average":{"1min":3.226,"5min":3.1549999999999998,"15min":3.1259999999999999},"min":{"1min":2.6139999999999999,"5min":1.054,"15min":1.054},"max":{"1min":3.7349999999999999,"5min":11.502000000000001,"15min":11.502000000000001},"last":2.8889999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575002,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050692,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321148,"statfs":{"total":96636764160,"available":95560855552,"internally_reserved":1073741824,"allocated":2158592,"data_stored":1011157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":1.98,"5min":1.7869999999999999,"15min":1.7869999999999999},"min":{"1min":1.3180000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":3.1589999999999998,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.302},{"interface":"front","average":{"1min":1.7030000000000001,"5min":1.784,"15min":1.8280000000000001},"min":{"1min":1.0629999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.6499999999999999,"5min":5.2530000000000001,"15min":5.2530000000000001},"last":2.7850000000000001}]},{"osd":1,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":1.964,"5min":1.881,"15min":1.9850000000000001},"min":{"1min":1.1719999999999999,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.1629999999999998,"5min":4.8250000000000002,"15min":4.8250000000000002},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.9510000000000001,"5min":2.0459999999999998,"15min":2.121},"min":{"1min":1.0980000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":3.3199999999999998,"5min":3.3900000000000001,"15min":3.5699999999999998},"last":1.7150000000000001}]},{"osd":2,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":2.286,"5min":2.2080000000000002,"15min":2.2440000000000002},"min":{"1min":1.1990000000000001,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":3.1960000000000002,"5min":4.1539999999999999,"15min":4.4649999999999999},"last":2.2650000000000001},{"interface":"front","average":{"1min":2.496,"5min":2.5590000000000002,"15min":2.6779999999999999},"min":{"1min":1.421,"5min":0.998,"15min":0.998},"max":{"1min":3.2509999999999999,"5min":3.8530000000000002,"15min":4.6059999999999999},"last":2.5489999999999999}]},{"osd":3,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":2.3159999999999998,"5min":2.2930000000000001,"15min":2.327},"min":{"1min":1.468,"5min":1.091,"15min":1.091},"max":{"1min":3.556,"5min":5.774,"15min":5.774},"last":1.9390000000000001},{"interface":"front","average":{"1min":2.2839999999999998,"5min":2.5470000000000002,"15min":2.5710000000000002},"min":{"1min":1.5620000000000001,"5min":1.115,"15min":1.115},"max":{"1min":2.7799999999999998,"5min":5.0519999999999996,"15min":5.0519999999999996},"last":2.5939999999999999}]},{"osd":5,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":2.7120000000000002,"5min":2.5859999999999999,"15min":2.681},"min":{"1min":2.2679999999999998,"5min":1.2190000000000001,"15min":1.1830000000000001},"max":{"1min":3.2429999999999999,"5min":3.5139999999999998,"15min":4.0110000000000001},"last":2.1099999999999999},{"interface":"front","average":{"1min":2.6669999999999998,"5min":2.6070000000000002,"15min":2.7639999999999998},"min":{"1min":1.9790000000000001,"5min":0.91800000000000004,"15min":0.82899999999999996},"max":{"1min":3.98,"5min":6.0179999999999998,"15min":6.0179999999999998},"last":2.3769999999999998}]},{"osd":6,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":2.891,"5min":2.7629999999999999,"15min":2.8370000000000002},"min":{"1min":2.4049999999999998,"5min":1.21,"15min":1.21},"max":{"1min":3.556,"5min":4.3300000000000001,"15min":4.3440000000000003},"last":2.851},{"interface":"front","average":{"1min":3.0499999999999998,"5min":3.0049999999999999,"15min":3.0539999999999998},"min":{"1min":2.0939999999999999,"5min":1.083,"15min":1.083},"max":{"1min":3.762,"5min":4.952,"15min":4.952},"last":2.3210000000000002}]},{"osd":7,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":3.2029999999999998,"5min":2.9809999999999999,"15min":3.1349999999999998},"min":{"1min":2.5139999999999998,"5min":1.3280000000000001,"15min":1.113},"max":{"1min":4.2610000000000001,"5min":5.5069999999999997,"15min":5.71},"last":3.1789999999999998},{"interface":"front","average":{"1min":3.2690000000000001,"5min":3.1739999999999999,"15min":3.2770000000000001},"min":{"1min":2.7170000000000001,"5min":1.399,"15min":1.399},"max":{"1min":3.79,"5min":4.6139999999999999,"15min":5.0229999999999997},"last":3.0590000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050688,"kb_used_data":2104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321152,"statfs":{"total":96636764160,"available":95560859648,"internally_reserved":1073741824,"allocated":2154496,"data_stored":1010947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":1.657,"15min":1.798},"min":{"1min":1.1879999999999999,"5min":0.745,"15min":0.745},"max":{"1min":2.7890000000000001,"5min":3.6509999999999998,"15min":6.7140000000000004},"last":1.903},{"interface":"front","average":{"1min":1.73,"5min":1.6339999999999999,"15min":1.7649999999999999},"min":{"1min":1.3759999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.2690000000000001,"5min":3.1379999999999999,"15min":8.2739999999999991},"last":1.5640000000000001}]},{"osd":1,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":1.9059999999999999,"5min":1.7450000000000001,"15min":1.9279999999999999},"min":{"1min":1.466,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":10.494},"last":1.637},{"interface":"front","average":{"1min":2.169,"5min":2.1150000000000002,"15min":2.2709999999999999},"min":{"1min":1.341,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":3.097,"5min":3.6960000000000002,"15min":8.2859999999999996},"last":2.3210000000000002}]},{"osd":2,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":2.266,"5min":2.153,"15min":2.2170000000000001},"min":{"1min":1.4710000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":3.4820000000000002,"5min":4.9930000000000003,"15min":5.7880000000000003},"last":2.508},{"interface":"front","average":{"1min":2.4180000000000001,"5min":2.403,"15min":2.5310000000000001},"min":{"1min":1.6020000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":3.1709999999999998,"5min":4.4960000000000004,"15min":6.0419999999999998},"last":3.0070000000000001}]},{"osd":4,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":2.5289999999999999,"5min":2.3250000000000002,"15min":2.4729999999999999},"min":{"1min":1.4810000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":3.524,"5min":4.952,"15min":5.5670000000000002},"last":2.1259999999999999},{"interface":"front","average":{"1min":3.093,"5min":2.6760000000000002,"15min":2.7210000000000001},"min":{"1min":1.891,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":4.2480000000000002,"5min":4.5609999999999999,"15min":5.4059999999999997},"last":2.2719999999999998}]},{"osd":5,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":3.2160000000000002,"5min":2.8759999999999999,"15min":2.9689999999999999},"min":{"1min":2.198,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":4.2649999999999997,"5min":4.9349999999999996,"15min":5.5339999999999998},"last":2.8980000000000001},{"interface":"front","average":{"1min":2.956,"5min":2.895,"15min":2.98},"min":{"1min":2.202,"5min":1.411,"15min":1.411},"max":{"1min":3.8199999999999998,"5min":4.8109999999999999,"15min":6.2130000000000001},"last":3.5630000000000002}]},{"osd":6,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":2.8610000000000002,"5min":2.7010000000000001,"15min":2.8250000000000002},"min":{"1min":2.0190000000000001,"5min":1.03,"15min":1.03},"max":{"1min":3.915,"5min":4.7329999999999997,"15min":4.7549999999999999},"last":2.532},{"interface":"front","average":{"1min":3.4950000000000001,"5min":3.0960000000000001,"15min":3.2389999999999999},"min":{"1min":1.6859999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"max":{"1min":5.3700000000000001,"5min":5.3700000000000001,"15min":5.625},"last":3.1259999999999999}]},{"osd":7,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":3.1659999999999999,"5min":3.0800000000000001,"15min":3.157},"min":{"1min":2.2429999999999999,"5min":1.244,"15min":1.244},"max":{"1min":4.0490000000000004,"5min":4.585,"15min":6.5389999999999997},"last":3.9700000000000002},{"interface":"front","average":{"1min":3.0670000000000002,"5min":2.9460000000000002,"15min":3.1040000000000001},"min":{"1min":2.4809999999999999,"5min":1.24,"15min":1.24},"max":{"1min":4.5129999999999999,"5min":4.6740000000000004,"15min":5.1699999999999999},"last":2.9300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575001,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050692,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321148,"statfs":{"total":96636764160,"available":95560855552,"internally_reserved":1073741824,"allocated":2158592,"data_stored":1011097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.534,"15min":1.5940000000000001},"min":{"1min":0.99199999999999999,"5min":0.78900000000000003,"15min":0.78100000000000003},"max":{"1min":1.917,"5min":2.1930000000000001,"15min":5.6319999999999997},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.714,"5min":1.7070000000000001,"15min":1.677},"min":{"1min":1.0760000000000001,"5min":0.625,"15min":0.625},"max":{"1min":2.0990000000000002,"5min":3.0099999999999998,"15min":3.9409999999999998},"last":1.365}]},{"osd":1,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":2.1680000000000001,"5min":4.0199999999999996,"15min":2.7679999999999998},"min":{"1min":1.3280000000000001,"5min":1.0649999999999999,"15min":0.74199999999999999},"max":{"1min":2.6640000000000001,"5min":190.321,"15min":190.321},"last":1.6739999999999999},{"interface":"front","average":{"1min":2.3919999999999999,"5min":4.2549999999999999,"15min":2.9780000000000002},"min":{"1min":1.605,"5min":0.75700000000000001,"15min":0.65400000000000003},"max":{"1min":3.1890000000000001,"5min":190.46199999999999,"15min":190.46199999999999},"last":1.7649999999999999}]},{"osd":3,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":1.9379999999999999,"5min":1.9350000000000001,"15min":1.915},"min":{"1min":1.393,"5min":0.96599999999999997,"15min":0.68600000000000005},"max":{"1min":2.5960000000000001,"5min":3.3300000000000001,"15min":3.4329999999999998},"last":2.524},{"interface":"front","average":{"1min":2.7080000000000002,"5min":2.5600000000000001,"15min":2.5800000000000001},"min":{"1min":1.7769999999999999,"5min":1.1259999999999999,"15min":1.0940000000000001},"max":{"1min":4.4189999999999996,"5min":4.4189999999999996,"15min":5.9409999999999998},"last":2.8140000000000001}]},{"osd":4,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":2.4929999999999999,"5min":2.3769999999999998,"15min":2.4140000000000001},"min":{"1min":1.321,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":3.4060000000000001,"5min":4.7169999999999996,"15min":5.0030000000000001},"last":2.1299999999999999},{"interface":"front","average":{"1min":2.3079999999999998,"5min":2.2690000000000001,"15min":2.343},"min":{"1min":1.821,"5min":1.218,"15min":1.1779999999999999},"max":{"1min":2.931,"5min":3.7480000000000002,"15min":4.0270000000000001},"last":2.3180000000000001}]},{"osd":5,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":3.0019999999999998,"5min":2.7440000000000002,"15min":2.7749999999999999},"min":{"1min":1.956,"5min":1.3939999999999999,"15min":1.3939999999999999},"max":{"1min":3.968,"5min":4.1200000000000001,"15min":5.766},"last":2.0129999999999999},{"interface":"front","average":{"1min":2.835,"5min":2.8119999999999998,"15min":2.843},"min":{"1min":1.472,"5min":1.21,"15min":0.96799999999999997},"max":{"1min":3.899,"5min":5.1319999999999997,"15min":5.1319999999999997},"last":2.476}]},{"osd":6,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":2.7000000000000002,"5min":2.6970000000000001,"15min":2.7330000000000001},"min":{"1min":1.512,"5min":1.512,"15min":1.0209999999999999},"max":{"1min":4.0949999999999998,"5min":4.7030000000000003,"15min":4.7030000000000003},"last":2.0979999999999999},{"interface":"front","average":{"1min":3.1739999999999999,"5min":3.0409999999999999,"15min":3.1160000000000001},"min":{"1min":2.2080000000000002,"5min":1.45,"15min":1.45},"max":{"1min":4.2560000000000002,"5min":4.2560000000000002,"15min":5.8499999999999996},"last":2.391}]},{"osd":7,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":3.1789999999999998,"5min":3.1299999999999999,"15min":3.1920000000000002},"min":{"1min":1.873,"5min":1.516,"15min":1.2450000000000001},"max":{"1min":4.4020000000000001,"5min":5.399,"15min":5.4880000000000004},"last":2.6800000000000002},{"interface":"front","average":{"1min":3.0819999999999999,"5min":2.9569999999999999,"15min":3.0350000000000001},"min":{"1min":1.6679999999999999,"5min":1.385,"15min":1.385},"max":{"1min":4.0279999999999996,"5min":4.4800000000000004,"15min":4.4800000000000004},"last":2.714}]}]},{"osd":1,"up_from":13,"seq":55834575001,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050696,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321144,"statfs":{"total":96636764160,"available":95560851456,"internally_reserved":1073741824,"allocated":2162688,"data_stored":1011689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":1.8700000000000001,"5min":1.952,"15min":1.8819999999999999},"min":{"1min":1.4510000000000001,"5min":0.874,"15min":0.874},"max":{"1min":3.4430000000000001,"5min":14.193,"15min":14.193},"last":2.8170000000000002},{"interface":"front","average":{"1min":2.1429999999999998,"5min":2.226,"15min":2.222},"min":{"1min":1.526,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":3.7599999999999998,"5min":9.3300000000000001,"15min":9.3300000000000001},"last":3.1720000000000002}]},{"osd":2,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":1.7969999999999999,"5min":1.891,"15min":1.8180000000000001},"min":{"1min":1.0669999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.6040000000000001,"5min":6.5709999999999997,"15min":6.5709999999999997},"last":1.776},{"interface":"front","average":{"1min":2.625,"5min":2.613,"15min":2.5790000000000002},"min":{"1min":1.5369999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":3.4750000000000001,"5min":7.8700000000000001,"15min":9.1050000000000004},"last":1.623}]},{"osd":3,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":2.2040000000000002,"5min":2.3410000000000002,"15min":2.2999999999999998},"min":{"1min":1.1679999999999999,"5min":1.016,"15min":0.995},"max":{"1min":3.0819999999999999,"5min":8.8140000000000001,"15min":9.3629999999999995},"last":2.0409999999999999},{"interface":"front","average":{"1min":2.1960000000000002,"5min":2.2050000000000001,"15min":2.2029999999999998},"min":{"1min":1.234,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":3.0710000000000002,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":2.944}]},{"osd":4,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":2.2730000000000001,"5min":2.3929999999999998,"15min":2.46},"min":{"1min":1.468,"5min":1.2210000000000001,"15min":1.103},"max":{"1min":3.294,"5min":6.3460000000000001,"15min":6.3460000000000001},"last":2.1000000000000001},{"interface":"front","average":{"1min":2.7509999999999999,"5min":2.7450000000000001,"15min":2.8199999999999998},"min":{"1min":1.9370000000000001,"5min":1.464,"15min":1.464},"max":{"1min":3.6360000000000001,"5min":8.6489999999999991,"15min":8.7929999999999993},"last":3.2709999999999999}]},{"osd":5,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":2.585,"5min":2.6600000000000001,"15min":2.6960000000000002},"min":{"1min":1.4039999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":3.6179999999999999,"5min":8.6539999999999999,"15min":8.6539999999999999},"last":3.9220000000000002},{"interface":"front","average":{"1min":2.778,"5min":2.7829999999999999,"15min":2.8719999999999999},"min":{"1min":2.0369999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":3.7360000000000002,"5min":5.867,"15min":5.867},"last":3.3199999999999998}]},{"osd":6,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":2.875,"5min":2.9860000000000002,"15min":3.0110000000000001},"min":{"1min":1.889,"5min":1.4059999999999999,"15min":1.1659999999999999},"max":{"1min":3.46,"5min":8.8859999999999992,"15min":8.8859999999999992},"last":3.5459999999999998},{"interface":"front","average":{"1min":3.0819999999999999,"5min":3.0299999999999998,"15min":3.1110000000000002},"min":{"1min":2.1179999999999999,"5min":0.997,"15min":0.997},"max":{"1min":4.2489999999999997,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":3.9630000000000001}]},{"osd":7,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":3.181,"5min":3.2170000000000001,"15min":3.2480000000000002},"min":{"1min":2.5419999999999998,"5min":1.337,"15min":1.337},"max":{"1min":4.056,"5min":8.0470000000000006,"15min":8.9339999999999993},"last":4.391},{"interface":"front","average":{"1min":3.2050000000000001,"5min":3.2749999999999999,"15min":3.3250000000000002},"min":{"1min":1.75,"5min":1.5649999999999999,"15min":1.5649999999999999},"max":{"1min":3.8359999999999999,"5min":9.1020000000000003,"15min":9.1020000000000003},"last":4.1520000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575001,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050772,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321068,"statfs":{"total":96636764160,"available":95560773632,"internally_reserved":1073741824,"allocated":2240512,"data_stored":1076441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":1.887,"5min":1.9330000000000001,"15min":1.8620000000000001},"min":{"1min":1.036,"5min":0.69899999999999995,"15min":0.67600000000000005},"max":{"1min":3.0369999999999999,"5min":8.9559999999999995,"15min":8.9559999999999995},"last":1.288},{"interface":"front","average":{"1min":1.724,"5min":1.738,"15min":1.762},"min":{"1min":1.052,"5min":0.78300000000000003,"15min":0.64900000000000002},"max":{"1min":2.8730000000000002,"5min":6.1689999999999996,"15min":6.1689999999999996},"last":1.4139999999999999}]},{"osd":2,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":2.0840000000000001,"5min":2.004,"15min":1.9910000000000001},"min":{"1min":1.3600000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.855,"5min":4.8810000000000002,"15min":5.3090000000000002},"last":1.617},{"interface":"front","average":{"1min":2.3769999999999998,"5min":2.323,"15min":2.4129999999999998},"min":{"1min":1.2829999999999999,"5min":1.127,"15min":1.0289999999999999},"max":{"1min":3.194,"5min":3.6789999999999998,"15min":6.1189999999999998},"last":1.73}]},{"osd":3,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":1.988,"5min":1.9319999999999999,"15min":1.946},"min":{"1min":1.3380000000000001,"5min":0.85799999999999998,"15min":0.82899999999999996},"max":{"1min":2.9380000000000002,"5min":3.3650000000000002,"15min":3.875},"last":1.8879999999999999},{"interface":"front","average":{"1min":2.8559999999999999,"5min":2.6880000000000002,"15min":2.7570000000000001},"min":{"1min":1.9970000000000001,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":3.4390000000000001,"5min":5.9550000000000001,"15min":5.9550000000000001},"last":1.8640000000000001}]},{"osd":4,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":2.1699999999999999,"5min":2.4089999999999998,"15min":2.4809999999999999},"min":{"1min":1.25,"5min":1.25,"15min":1.0940000000000001},"max":{"1min":3.2629999999999999,"5min":4.3879999999999999,"15min":5.9969999999999999},"last":1.956},{"interface":"front","average":{"1min":2.3900000000000001,"5min":2.4620000000000002,"15min":2.4700000000000002},"min":{"1min":1.669,"5min":1.345,"15min":0.92700000000000005},"max":{"1min":3.4060000000000001,"5min":4.0739999999999998,"15min":4.1070000000000002},"last":2.585}]},{"osd":5,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":2.786,"5min":2.6059999999999999,"15min":2.6720000000000002},"min":{"1min":1.903,"5min":1.089,"15min":0.93600000000000005},"max":{"1min":3.698,"5min":3.9860000000000002,"15min":5.0919999999999996},"last":3.0310000000000001},{"interface":"front","average":{"1min":3.1200000000000001,"5min":3.153,"15min":3.302},"min":{"1min":2.109,"5min":1.488,"15min":1.3320000000000001},"max":{"1min":3.8620000000000001,"5min":6.1280000000000001,"15min":6.5119999999999996},"last":2.23}]},{"osd":6,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":3.375,"5min":3.2690000000000001,"15min":3.4199999999999999},"min":{"1min":2.2999999999999998,"5min":1.8069999999999999,"15min":1.421},"max":{"1min":4.351,"5min":6.0430000000000001,"15min":6.8949999999999996},"last":2.3279999999999998},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.8170000000000002,"15min":2.9510000000000001},"min":{"1min":1.7729999999999999,"5min":1.46,"15min":1.2969999999999999},"max":{"1min":3.718,"5min":4.6180000000000003,"15min":5.593},"last":2.899}]},{"osd":7,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":3.0459999999999998,"5min":3.032,"15min":3.1160000000000001},"min":{"1min":1.923,"5min":1.613,"15min":1.3300000000000001},"max":{"1min":4.2699999999999996,"5min":4.6779999999999999,"15min":5.8239999999999998},"last":2.6429999999999998},{"interface":"front","average":{"1min":3.105,"5min":3.0089999999999999,"15min":3.0529999999999999},"min":{"1min":2.3420000000000001,"5min":1.3620000000000001,"15min":1.119},"max":{"1min":3.9470000000000001,"5min":4.4359999999999999,"15min":5.0890000000000004},"last":2.8290000000000002}]}]}]}} 2020-05-18T21:39:14.789 INFO:tasks.ceph:pgid 32.7 last_scrub_stamp 2020-05-18T21:38:30.097894+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=38, tm_sec=30, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.790 INFO:tasks.ceph:pgid 32.6 last_scrub_stamp 2020-05-18T21:38:30.097894+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=38, tm_sec=30, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.790 INFO:tasks.ceph:pgid 32.5 last_scrub_stamp 2020-05-18T21:38:30.097894+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=38, tm_sec=30, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.790 INFO:tasks.ceph:pgid 31.7 last_scrub_stamp 2020-05-18T21:38:29.085681+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=38, tm_sec=29, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.791 INFO:tasks.ceph:pgid 31.6 last_scrub_stamp 2020-05-18T21:38:29.085681+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=38, tm_sec=29, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.791 INFO:tasks.ceph:pgid 31.5 last_scrub_stamp 2020-05-18T21:38:29.085681+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=38, tm_sec=29, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.791 INFO:tasks.ceph:pgid 31.4 last_scrub_stamp 2020-05-18T21:38:29.085681+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=38, tm_sec=29, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.792 INFO:tasks.ceph:pgid 31.3 last_scrub_stamp 2020-05-18T21:38:29.085681+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=38, tm_sec=29, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.792 INFO:tasks.ceph:pgid 31.1 last_scrub_stamp 2020-05-18T21:38:29.085681+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=38, tm_sec=29, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.792 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-05-18T21:26:34.017197+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=26, tm_sec=34, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.793 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-05-18T21:26:41.118270+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=26, tm_sec=41, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.793 INFO:tasks.ceph:pgid 31.0 last_scrub_stamp 2020-05-18T21:38:29.085681+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=38, tm_sec=29, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.793 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-05-18T21:26:41.118270+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=26, tm_sec=41, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.794 INFO:tasks.ceph:pgid 32.0 last_scrub_stamp 2020-05-18T21:38:30.097894+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=38, tm_sec=30, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.794 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2020-05-18T21:26:41.118270+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=26, tm_sec=41, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.794 INFO:tasks.ceph:pgid 31.2 last_scrub_stamp 2020-05-18T21:38:29.085681+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=38, tm_sec=29, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.794 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2020-05-18T21:26:41.118270+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=26, tm_sec=41, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.795 INFO:tasks.ceph:pgid 32.3 last_scrub_stamp 2020-05-18T21:38:30.097894+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=38, tm_sec=30, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.795 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2020-05-18T21:26:41.118270+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=26, tm_sec=41, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.795 INFO:tasks.ceph:pgid 32.4 last_scrub_stamp 2020-05-18T21:38:30.097894+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=38, tm_sec=30, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.796 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-05-18T21:26:41.118270+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=26, tm_sec=41, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.796 INFO:tasks.ceph:pgid 32.1 last_scrub_stamp 2020-05-18T21:38:30.097894+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=38, tm_sec=30, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.796 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-05-18T21:26:41.118270+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=26, tm_sec=41, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.797 INFO:tasks.ceph:pgid 32.2 last_scrub_stamp 2020-05-18T21:38:30.097894+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=38, tm_sec=30, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.797 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-05-18T21:26:41.118270+0000 time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=26, tm_sec=41, tm_wday=0, tm_yday=139, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=5, tm_mday=18, tm_hour=21, tm_min=39, tm_sec=10, tm_wday=0, tm_yday=139, tm_isdst=0) 2020-05-18T21:39:14.797 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2020-05-18T21:39:30.706 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:39:30.709 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:39:34.799 INFO:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-05-18T21:39:34.910 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85cad30700 1 Processor -- start 2020-05-18T21:39:34.911 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85cad30700 1 -- start start 2020-05-18T21:39:34.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85cad30700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c405f110 0x7f85c40b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:34.914 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85cad30700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f85c414aa70 0x7f85c40648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:34.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85cad30700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c414a330 con 0x7f85c4064d20 2020-05-18T21:39:34.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85cad30700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c414a140 con 0x7f85c414aa70 2020-05-18T21:39:34.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85cad30700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c414a5d0 con 0x7f85c405f110 2020-05-18T21:39:34.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85c952d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f85c414aa70 0x7f85c40648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:34.915 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85c9d2e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c405f110 0x7f85c40b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:34.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85ca52f700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f85c4064d20 0x7f85c414d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:38264/0 (socket says 172.21.15.63:38264) 2020-05-18T21:39:34.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85ca52f700 1 -- 172.21.15.63:0/975040679 learned_addr learned my addr 172.21.15.63:0/975040679 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:34.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85c952d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f85c414aa70 0x7f85c40648c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.63:52608/0 (socket says 172.21.15.63:52608) 2020-05-18T21:39:34.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85c9d2e700 1 -- 172.21.15.63:0/975040679 >> v2:172.21.15.155:3300/0 conn(0x7f85c414aa70 msgr2=0x7f85c40648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:34.916 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85c9d2e700 1 --2- 172.21.15.63:0/975040679 >> v2:172.21.15.155:3300/0 conn(0x7f85c414aa70 0x7f85c40648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:34.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85c9d2e700 1 -- 172.21.15.63:0/975040679 >> v1:172.21.15.155:6789/0 conn(0x7f85c4064d20 legacy=0x7f85c414d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:34.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85c9d2e700 1 -- 172.21.15.63:0/975040679 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c4063430 con 0x7f85c405f110 2020-05-18T21:39:34.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85c8d2c700 1 -- 172.21.15.63:0/975040679 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417584608 0 0) 0x7f85c414a330 con 0x7f85c4064d20 2020-05-18T21:39:34.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85c952d700 1 --2- 172.21.15.63:0/975040679 >> v2:172.21.15.155:3300/0 conn(0x7f85c414aa70 0x7f85c40648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-05-18T21:39:34.917 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85c9d2e700 1 --2- 172.21.15.63:0/975040679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c405f110 0x7f85c40b4760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f85c4063c70 tx=0x7f85bc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:34.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85c9d2e700 1 --2- 172.21.15.63:0/975040679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c405f110 0x7f85c40b4760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f85c4063c70 tx=0x7f85bc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:34.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85c9d2e700 1 --2- 172.21.15.63:0/975040679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c405f110 0x7f85c40b4760 secure :-1 s=READY pgs=355 cs=0 l=1 rx=0x7f85c4063c70 tx=0x7f85bc008ca0).ready entity=mon.2 client_cookie=29b224f6b66980d2 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:34.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85c9d2e700 1 --2- 172.21.15.63:0/975040679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c405f110 0x7f85c40b4760 secure :-1 s=THROTTLE_DONE pgs=355 cs=0 l=1 rx=0x7f85c4063c70 tx=0x7f85bc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:34.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85c8d2c700 1 -- 172.21.15.63:0/975040679 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85bc011e60 con 0x7f85c405f110 2020-05-18T21:39:34.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.904+0000 7f85c9d2e700 1 --2- 172.21.15.63:0/975040679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c405f110 0x7f85c40b4760 secure :-1 s=THROTTLE_DONE pgs=355 cs=0 l=1 rx=0x7f85c4063c70 tx=0x7f85bc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:34.918 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85c9d2e700 1 --2- 172.21.15.63:0/975040679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c405f110 0x7f85c40b4760 secure :-1 s=THROTTLE_DONE pgs=355 cs=0 l=1 rx=0x7f85c4063c70 tx=0x7f85bc008ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:34.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85c8d2c700 1 -- 172.21.15.63:0/975040679 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc00a180 con 0x7f85c405f110 2020-05-18T21:39:34.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85c8d2c700 1 -- 172.21.15.63:0/975040679 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85bc00a520 con 0x7f85c405f110 2020-05-18T21:39:34.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85cad30700 1 -- 172.21.15.63:0/975040679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c405f110 msgr2=0x7f85c40b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:34.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85cad30700 1 --2- 172.21.15.63:0/975040679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c405f110 0x7f85c40b4760 secure :-1 s=READY pgs=355 cs=0 l=1 rx=0x7f85c4063c70 tx=0x7f85bc008ca0).stop 2020-05-18T21:39:34.919 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85cad30700 1 -- 172.21.15.63:0/975040679 shutdown_connections 2020-05-18T21:39:34.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85cad30700 1 --2- 172.21.15.63:0/975040679 >> v2:172.21.15.155:3300/0 conn(0x7f85c414aa70 0x7f85c40648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:34.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85cad30700 1 --2- 172.21.15.63:0/975040679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85c405f110 0x7f85c40b4760 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:34.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85cad30700 1 -- 172.21.15.63:0/975040679 >> 172.21.15.63:0/975040679 conn(0x7f85c4069fc0 msgr2=0x7f85c406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:34.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85cad30700 1 -- 172.21.15.63:0/975040679 shutdown_connections 2020-05-18T21:39:34.920 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85cad30700 1 -- 172.21.15.63:0/975040679 wait complete. 2020-05-18T21:39:34.923 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85cad30700 1 Processor -- start 2020-05-18T21:39:34.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85cad30700 1 -- start start 2020-05-18T21:39:34.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85cad30700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f85c4064d20 0x7f85c415ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:34.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85cad30700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c414b620 con 0x7f85c405f110 2020-05-18T21:39:34.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85cad30700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c4144c30 con 0x7f85c414aa70 2020-05-18T21:39:34.924 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85cad30700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c4144ed0 con 0x7f85c4064d20 2020-05-18T21:39:34.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85c9d2e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f85c405f110 0x7f85c413a460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39952/0 (socket says 172.21.15.63:39952) 2020-05-18T21:39:34.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85c9d2e700 1 -- 172.21.15.63:0/4272078551 learned_addr learned my addr 172.21.15.63:0/4272078551 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:34.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85c952d700 1 --2- 172.21.15.63:0/4272078551 >> v2:172.21.15.155:3300/0 conn(0x7f85c4064d20 0x7f85c415ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:34.925 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85c2ffd700 1 -- 172.21.15.63:0/4272078551 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866581789 0 0) 0x7f85c414b620 con 0x7f85c405f110 2020-05-18T21:39:34.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85c2ffd700 1 -- 172.21.15.63:0/4272078551 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85a8002fe0 con 0x7f85c405f110 2020-05-18T21:39:34.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85c952d700 1 -- 172.21.15.63:0/4272078551 >> v1:172.21.15.155:6789/0 conn(0x7f85c414aa70 legacy=0x7f85c4145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:34.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85c952d700 1 -- 172.21.15.63:0/4272078551 >> v1:172.21.15.63:6789/0 conn(0x7f85c405f110 legacy=0x7f85c413a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:34.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85c952d700 1 -- 172.21.15.63:0/4272078551 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c4145170 con 0x7f85c4064d20 2020-05-18T21:39:34.926 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.908+0000 7f85c952d700 1 --2- 172.21.15.63:0/4272078551 >> v2:172.21.15.155:3300/0 conn(0x7f85c4064d20 0x7f85c415ae30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f85b4002f70 tx=0x7f85b4010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:34.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.912+0000 7f85c952d700 1 --2- 172.21.15.63:0/4272078551 >> v2:172.21.15.155:3300/0 conn(0x7f85c4064d20 0x7f85c415ae30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f85b4002f70 tx=0x7f85b4010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:34.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.912+0000 7f85c952d700 1 --2- 172.21.15.63:0/4272078551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85c4064d20 0x7f85c415ae30 secure :-1 s=READY pgs=1533 cs=0 l=1 rx=0x7f85b4002f70 tx=0x7f85b4010dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:34.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.912+0000 7f85c952d700 1 --2- 172.21.15.63:0/4272078551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85c4064d20 0x7f85c415ae30 secure :-1 s=THROTTLE_DONE pgs=1533 cs=0 l=1 rx=0x7f85b4002f70 tx=0x7f85b4010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:34.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.912+0000 7f85c2ffd700 1 -- 172.21.15.63:0/4272078551 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85b400c9d0 con 0x7f85c4064d20 2020-05-18T21:39:34.927 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.912+0000 7f85c952d700 1 --2- 172.21.15.63:0/4272078551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85c4064d20 0x7f85c415ae30 secure :-1 s=THROTTLE_DONE pgs=1533 cs=0 l=1 rx=0x7f85b4002f70 tx=0x7f85b4010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:34.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.912+0000 7f85c952d700 1 --2- 172.21.15.63:0/4272078551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85c4064d20 0x7f85c415ae30 secure :-1 s=THROTTLE_DONE pgs=1533 cs=0 l=1 rx=0x7f85b4002f70 tx=0x7f85b4010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:34.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.912+0000 7f85c2ffd700 1 -- 172.21.15.63:0/4272078551 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b400cb30 con 0x7f85c4064d20 2020-05-18T21:39:34.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.912+0000 7f85c2ffd700 1 -- 172.21.15.63:0/4272078551 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85b4005700 con 0x7f85c4064d20 2020-05-18T21:39:34.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.912+0000 7f85cad30700 1 -- 172.21.15.63:0/4272078551 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c4145610 con 0x7f85c4064d20 2020-05-18T21:39:34.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.912+0000 7f85cad30700 1 -- 172.21.15.63:0/4272078551 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c4144930 con 0x7f85c4064d20 2020-05-18T21:39:34.928 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.912+0000 7f85c952d700 1 --2- 172.21.15.63:0/4272078551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85c4064d20 0x7f85c415ae30 secure :-1 s=THROTTLE_DONE pgs=1533 cs=0 l=1 rx=0x7f85b4002f70 tx=0x7f85b4010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:34.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.912+0000 7f85cad30700 1 -- 172.21.15.63:0/4272078551 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c4145300 con 0x7f85c4064d20 2020-05-18T21:39:34.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.912+0000 7f85c2ffd700 1 -- 172.21.15.63:0/4272078551 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f85b40071a0 con 0x7f85c4064d20 2020-05-18T21:39:34.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.912+0000 7f85c952d700 1 --2- 172.21.15.63:0/4272078551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85c4064d20 0x7f85c415ae30 secure :-1 s=THROTTLE_DONE pgs=1533 cs=0 l=1 rx=0x7f85b4002f70 tx=0x7f85b4010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:34.929 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.912+0000 7f85c2ffd700 1 --2- 172.21.15.63:0/4272078551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85a804fcf0 0x7f85a80521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:34.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.912+0000 7f85c2ffd700 1 -- 172.21.15.63:0/4272078551 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f85b4063b40 con 0x7f85c4064d20 2020-05-18T21:39:34.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.912+0000 7f85c9d2e700 1 --2- 172.21.15.63:0/4272078551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85a804fcf0 0x7f85a80521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:34.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.916+0000 7f85c9d2e700 1 --2- 172.21.15.63:0/4272078551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85a804fcf0 0x7f85a80521b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f85bc000f40 tx=0x7f85c40635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:34.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.916+0000 7f85c9d2e700 1 --2- 172.21.15.63:0/4272078551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85a804fcf0 0x7f85a80521b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f85bc000f40 tx=0x7f85c40635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:34.930 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.916+0000 7f85c9d2e700 1 --2- 172.21.15.63:0/4272078551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85a804fcf0 0x7f85a80521b0 secure :-1 s=READY pgs=904 cs=0 l=1 rx=0x7f85bc000f40 tx=0x7f85c40635c0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:34.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.920+0000 7f85c952d700 1 --2- 172.21.15.63:0/4272078551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85c4064d20 0x7f85c415ae30 secure :-1 s=THROTTLE_DONE pgs=1533 cs=0 l=1 rx=0x7f85b4002f70 tx=0x7f85b4010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:34.931 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:34.920+0000 7f85c2ffd700 1 -- 172.21.15.63:0/4272078551 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f85b403de70 con 0x7f85c4064d20 2020-05-18T21:39:35.042 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.036+0000 7f85cad30700 1 -- 172.21.15.63:0/4272078551 --> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85c4069d70 con 0x7f85a804fcf0 2020-05-18T21:39:35.053 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.044+0000 7f85c9d2e700 1 --2- 172.21.15.63:0/4272078551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85a804fcf0 0x7f85a80521b0 secure :-1 s=THROTTLE_DONE pgs=904 cs=0 l=1 rx=0x7f85bc000f40 tx=0x7f85c40635c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:35.054 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.044+0000 7f85c2ffd700 1 -- 172.21.15.63:0/4272078551 <== mgr.4110 v2:172.21.15.155:6832/12649 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+104911 (secure 0 0 0) 0x7f85c4069d70 con 0x7f85a804fcf0 2020-05-18T21:39:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: 2020-05-18T21:39:35.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.048+0000 7f85cad30700 1 -- 172.21.15.63:0/4272078551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85a804fcf0 msgr2=0x7f85a80521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:35.055 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.048+0000 7f85cad30700 1 --2- 172.21.15.63:0/4272078551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85a804fcf0 0x7f85a80521b0 secure :-1 s=READY pgs=904 cs=0 l=1 rx=0x7f85bc000f40 tx=0x7f85c40635c0).stop 2020-05-18T21:39:35.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.048+0000 7f85cad30700 1 -- 172.21.15.63:0/4272078551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85c4064d20 msgr2=0x7f85c415ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:35.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.048+0000 7f85cad30700 1 --2- 172.21.15.63:0/4272078551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85c4064d20 0x7f85c415ae30 secure :-1 s=READY pgs=1533 cs=0 l=1 rx=0x7f85b4002f70 tx=0x7f85b4010dc0).stop 2020-05-18T21:39:35.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.048+0000 7f85cad30700 1 -- 172.21.15.63:0/4272078551 shutdown_connections 2020-05-18T21:39:35.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.048+0000 7f85cad30700 1 --2- 172.21.15.63:0/4272078551 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f85a804fcf0 0x7f85a80521b0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:35.056 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.048+0000 7f85cad30700 1 --2- 172.21.15.63:0/4272078551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85c4064d20 0x7f85c415ae30 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:35.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.048+0000 7f85cad30700 1 -- 172.21.15.63:0/4272078551 >> 172.21.15.63:0/4272078551 conn(0x7f85c4069fc0 msgr2=0x7f85c4148d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:35.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.048+0000 7f85cad30700 1 -- 172.21.15.63:0/4272078551 shutdown_connections 2020-05-18T21:39:35.057 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.048+0000 7f85cad30700 1 -- 172.21.15.63:0/4272078551 wait complete. 2020-05-18T21:39:35.058 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2020-05-18T21:39:35.066 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":551,"stamp":"2020-05-18T21:39:33.259434+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":65772,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":16,"num_read_kb":8194,"num_write":147,"num_write_kb":16511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14323,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8405664,"kb_used_data":16992,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746569056,"statfs":{"total":773094113280,"available":764486713344,"internally_reserved":8589934592,"allocated":17399808,"data_stored":8218848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003786"},"pg_stats":[{"pgid":"32.7","version":"0'0","reported_seq":"23","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:18.592065+0000","last_change":"2020-05-18T21:39:18.592258+0000","last_active":"2020-05-18T21:39:18.592065+0000","last_peered":"2020-05-18T21:39:18.592065+0000","last_clean":"2020-05-18T21:39:18.592065+0000","last_became_active":"2020-05-18T21:38:30.449166+0000","last_became_peered":"2020-05-18T21:38:30.449166+0000","last_unstale":"2020-05-18T21:39:18.592065+0000","last_undegraded":"2020-05-18T21:39:18.592065+0000","last_fullsized":"2020-05-18T21:39:18.592065+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:39:18.592050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:39:18.592050+0000","last_clean_scrub_stamp":"2020-05-18T21:39:18.592050+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":"23","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:18.068680+0000","last_change":"2020-05-18T21:39:18.068867+0000","last_active":"2020-05-18T21:39:18.068680+0000","last_peered":"2020-05-18T21:39:18.068680+0000","last_clean":"2020-05-18T21:39:18.068680+0000","last_became_active":"2020-05-18T21:38:30.450235+0000","last_became_peered":"2020-05-18T21:38:30.450235+0000","last_unstale":"2020-05-18T21:39:18.068680+0000","last_undegraded":"2020-05-18T21:39:18.068680+0000","last_fullsized":"2020-05-18T21:39:18.068680+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:39:18.068665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:39:18.068665+0000","last_clean_scrub_stamp":"2020-05-18T21:39:18.068665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"168'7","reported_seq":"30","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:23.408640+0000","last_change":"2020-05-18T21:39:23.408803+0000","last_active":"2020-05-18T21:39:23.408640+0000","last_peered":"2020-05-18T21:39:23.408640+0000","last_clean":"2020-05-18T21:39:23.408640+0000","last_became_active":"2020-05-18T21:38:30.447545+0000","last_became_peered":"2020-05-18T21:38:30.447545+0000","last_unstale":"2020-05-18T21:39:23.408640+0000","last_undegraded":"2020-05-18T21:39:23.408640+0000","last_fullsized":"2020-05-18T21:39:23.408640+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"168'7","last_scrub_stamp":"2020-05-18T21:39:23.408630+0000","last_deep_scrub":"168'7","last_deep_scrub_stamp":"2020-05-18T21:39:23.408630+0000","last_clean_scrub_stamp":"2020-05-18T21:39:23.408630+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.7","version":"169'19","reported_seq":"34","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:21.100477+0000","last_change":"2020-05-18T21:39:21.100689+0000","last_active":"2020-05-18T21:39:21.100477+0000","last_peered":"2020-05-18T21:39:21.100477+0000","last_clean":"2020-05-18T21:39:21.100477+0000","last_became_active":"2020-05-18T21:38:30.124194+0000","last_became_peered":"2020-05-18T21:38:30.124194+0000","last_unstale":"2020-05-18T21:39:21.100477+0000","last_undegraded":"2020-05-18T21:39:21.100477+0000","last_fullsized":"2020-05-18T21:39:21.100477+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'19","last_scrub_stamp":"2020-05-18T21:39:21.100461+0000","last_deep_scrub":"169'19","last_deep_scrub_stamp":"2020-05-18T21:39:21.100461+0000","last_clean_scrub_stamp":"2020-05-18T21:39:21.100461+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":524,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.6","version":"169'12","reported_seq":"27","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:22.460265+0000","last_change":"2020-05-18T21:39:22.460451+0000","last_active":"2020-05-18T21:39:22.460265+0000","last_peered":"2020-05-18T21:39:22.460265+0000","last_clean":"2020-05-18T21:39:22.460265+0000","last_became_active":"2020-05-18T21:38:30.129606+0000","last_became_peered":"2020-05-18T21:38:30.129606+0000","last_unstale":"2020-05-18T21:39:22.460265+0000","last_undegraded":"2020-05-18T21:39:22.460265+0000","last_fullsized":"2020-05-18T21:39:22.460265+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'12","last_scrub_stamp":"2020-05-18T21:39:22.460253+0000","last_deep_scrub":"169'12","last_deep_scrub_stamp":"2020-05-18T21:39:22.460253+0000","last_clean_scrub_stamp":"2020-05-18T21:39:22.460253+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.5","version":"169'13","reported_seq":"28","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:19.005842+0000","last_change":"2020-05-18T21:39:19.006047+0000","last_active":"2020-05-18T21:39:19.005842+0000","last_peered":"2020-05-18T21:39:19.005842+0000","last_clean":"2020-05-18T21:39:19.005842+0000","last_became_active":"2020-05-18T21:38:30.136652+0000","last_became_peered":"2020-05-18T21:38:30.136652+0000","last_unstale":"2020-05-18T21:39:19.005842+0000","last_undegraded":"2020-05-18T21:39:19.005842+0000","last_fullsized":"2020-05-18T21:39:19.005842+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'13","last_scrub_stamp":"2020-05-18T21:39:19.005825+0000","last_deep_scrub":"169'13","last_deep_scrub_stamp":"2020-05-18T21:39:19.005825+0000","last_clean_scrub_stamp":"2020-05-18T21:39:19.005825+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.4","version":"169'48","reported_seq":"63","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:12.889785+0000","last_change":"2020-05-18T21:39:12.889968+0000","last_active":"2020-05-18T21:39:12.889785+0000","last_peered":"2020-05-18T21:39:12.889785+0000","last_clean":"2020-05-18T21:39:12.889785+0000","last_became_active":"2020-05-18T21:38:30.127063+0000","last_became_peered":"2020-05-18T21:38:30.127063+0000","last_unstale":"2020-05-18T21:39:12.889785+0000","last_undegraded":"2020-05-18T21:39:12.889785+0000","last_fullsized":"2020-05-18T21:39:12.889785+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'48","last_scrub_stamp":"2020-05-18T21:39:12.889768+0000","last_deep_scrub":"169'48","last_deep_scrub_stamp":"2020-05-18T21:39:12.889768+0000","last_clean_scrub_stamp":"2020-05-18T21:39:12.889768+0000","log_size":48,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":64778,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"167'12","reported_seq":"27","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:18.160506+0000","last_change":"2020-05-18T21:39:18.160687+0000","last_active":"2020-05-18T21:39:18.160506+0000","last_peered":"2020-05-18T21:39:18.160506+0000","last_clean":"2020-05-18T21:39:18.160506+0000","last_became_active":"2020-05-18T21:38:30.127183+0000","last_became_peered":"2020-05-18T21:38:30.127183+0000","last_unstale":"2020-05-18T21:39:18.160506+0000","last_undegraded":"2020-05-18T21:39:18.160506+0000","last_fullsized":"2020-05-18T21:39:18.160506+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'12","last_scrub_stamp":"2020-05-18T21:39:18.160490+0000","last_deep_scrub":"167'12","last_deep_scrub_stamp":"2020-05-18T21:39:18.160490+0000","last_clean_scrub_stamp":"2020-05-18T21:39:18.160490+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5032,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.1","version":"167'3","reported_seq":"20","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:20.144412+0000","last_change":"2020-05-18T21:39:20.144616+0000","last_active":"2020-05-18T21:39:20.144412+0000","last_peered":"2020-05-18T21:39:20.144412+0000","last_clean":"2020-05-18T21:39:20.144412+0000","last_became_active":"2020-05-18T21:38:30.127339+0000","last_became_peered":"2020-05-18T21:38:30.127339+0000","last_unstale":"2020-05-18T21:39:20.144412+0000","last_undegraded":"2020-05-18T21:39:20.144412+0000","last_fullsized":"2020-05-18T21:39:20.144412+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'3","last_scrub_stamp":"2020-05-18T21:39:20.144396+0000","last_deep_scrub":"167'3","last_deep_scrub_stamp":"2020-05-18T21:39:20.144396+0000","last_clean_scrub_stamp":"2020-05-18T21:39:20.144396+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":210,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"169'4","reported_seq":"156","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:16.257561+0000","last_change":"2020-05-18T21:39:16.257771+0000","last_active":"2020-05-18T21:39:16.257561+0000","last_peered":"2020-05-18T21:39:16.257561+0000","last_clean":"2020-05-18T21:39:16.257561+0000","last_became_active":"2020-05-18T21:26:37.224618+0000","last_became_peered":"2020-05-18T21:26:37.224618+0000","last_unstale":"2020-05-18T21:39:16.257561+0000","last_undegraded":"2020-05-18T21:39:16.257561+0000","last_fullsized":"2020-05-18T21:39:16.257561+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'4","last_scrub_stamp":"2020-05-18T21:39:16.257541+0000","last_deep_scrub":"169'4","last_deep_scrub_stamp":"2020-05-18T21:39:16.257541+0000","last_clean_scrub_stamp":"2020-05-18T21:39:16.257541+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8220,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"149","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:17.110051+0000","last_change":"2020-05-18T21:39:17.110132+0000","last_active":"2020-05-18T21:39:17.110051+0000","last_peered":"2020-05-18T21:39:17.110051+0000","last_clean":"2020-05-18T21:39:17.110051+0000","last_became_active":"2020-05-18T21:26:42.151473+0000","last_became_peered":"2020-05-18T21:26:42.151473+0000","last_unstale":"2020-05-18T21:39:17.110051+0000","last_undegraded":"2020-05-18T21:39:17.110051+0000","last_fullsized":"2020-05-18T21:39:17.110051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:39:17.110046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:39:17.110046+0000","last_clean_scrub_stamp":"2020-05-18T21:39:17.110046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.0","version":"169'16","reported_seq":"31","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:15.136957+0000","last_change":"2020-05-18T21:39:15.137228+0000","last_active":"2020-05-18T21:39:15.136957+0000","last_peered":"2020-05-18T21:39:15.136957+0000","last_clean":"2020-05-18T21:39:15.136957+0000","last_became_active":"2020-05-18T21:38:30.131041+0000","last_became_peered":"2020-05-18T21:38:30.131041+0000","last_unstale":"2020-05-18T21:39:15.136957+0000","last_undegraded":"2020-05-18T21:39:15.136957+0000","last_fullsized":"2020-05-18T21:39:15.136957+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'16","last_scrub_stamp":"2020-05-18T21:39:15.136932+0000","last_deep_scrub":"169'16","last_deep_scrub_stamp":"2020-05-18T21:39:15.136932+0000","last_clean_scrub_stamp":"2020-05-18T21:39:15.136932+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":547,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"149","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:19.235796+0000","last_change":"2020-05-18T21:39:19.235979+0000","last_active":"2020-05-18T21:39:19.235796+0000","last_peered":"2020-05-18T21:39:19.235796+0000","last_clean":"2020-05-18T21:39:19.235796+0000","last_became_active":"2020-05-18T21:26:42.149888+0000","last_became_peered":"2020-05-18T21:26:42.149888+0000","last_unstale":"2020-05-18T21:39:19.235796+0000","last_undegraded":"2020-05-18T21:39:19.235796+0000","last_fullsized":"2020-05-18T21:39:19.235796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:39:19.235782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:39:19.235782+0000","last_clean_scrub_stamp":"2020-05-18T21:39:19.235782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":"23","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:21.222297+0000","last_change":"2020-05-18T21:39:21.222473+0000","last_active":"2020-05-18T21:39:21.222297+0000","last_peered":"2020-05-18T21:39:21.222297+0000","last_clean":"2020-05-18T21:39:21.222297+0000","last_became_active":"2020-05-18T21:38:30.452015+0000","last_became_peered":"2020-05-18T21:38:30.452015+0000","last_unstale":"2020-05-18T21:39:21.222297+0000","last_undegraded":"2020-05-18T21:39:21.222297+0000","last_fullsized":"2020-05-18T21:39:21.222297+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:39:21.222281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:39:21.222281+0000","last_clean_scrub_stamp":"2020-05-18T21:39:21.222281+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"147","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:13.554994+0000","last_change":"2020-05-18T21:39:13.555136+0000","last_active":"2020-05-18T21:39:13.554994+0000","last_peered":"2020-05-18T21:39:13.554994+0000","last_clean":"2020-05-18T21:39:13.554994+0000","last_became_active":"2020-05-18T21:26:42.225154+0000","last_became_peered":"2020-05-18T21:26:42.225154+0000","last_unstale":"2020-05-18T21:39:13.554994+0000","last_undegraded":"2020-05-18T21:39:13.554994+0000","last_fullsized":"2020-05-18T21:39:13.554994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:39:13.554986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:39:13.554986+0000","last_clean_scrub_stamp":"2020-05-18T21:39:13.554986+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.2","version":"166'1","reported_seq":"16","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:15.423499+0000","last_change":"2020-05-18T21:39:15.423695+0000","last_active":"2020-05-18T21:39:15.423499+0000","last_peered":"2020-05-18T21:39:15.423499+0000","last_clean":"2020-05-18T21:39:15.423499+0000","last_became_active":"2020-05-18T21:38:30.128523+0000","last_became_peered":"2020-05-18T21:38:30.128523+0000","last_unstale":"2020-05-18T21:39:15.423499+0000","last_undegraded":"2020-05-18T21:39:15.423499+0000","last_fullsized":"2020-05-18T21:39:15.423499+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'1","last_scrub_stamp":"2020-05-18T21:39:15.423484+0000","last_deep_scrub":"166'1","last_deep_scrub_stamp":"2020-05-18T21:39:15.423484+0000","last_clean_scrub_stamp":"2020-05-18T21:39:15.423484+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"149","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:14.184408+0000","last_change":"2020-05-18T21:39:14.184590+0000","last_active":"2020-05-18T21:39:14.184408+0000","last_peered":"2020-05-18T21:39:14.184408+0000","last_clean":"2020-05-18T21:39:14.184408+0000","last_became_active":"2020-05-18T21:26:42.153056+0000","last_became_peered":"2020-05-18T21:26:42.153056+0000","last_unstale":"2020-05-18T21:39:14.184408+0000","last_undegraded":"2020-05-18T21:39:14.184408+0000","last_fullsized":"2020-05-18T21:39:14.184408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:39:14.184394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:39:14.184394+0000","last_clean_scrub_stamp":"2020-05-18T21:39:14.184394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":"23","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:21.085019+0000","last_change":"2020-05-18T21:39:21.085199+0000","last_active":"2020-05-18T21:39:21.085019+0000","last_peered":"2020-05-18T21:39:21.085019+0000","last_clean":"2020-05-18T21:39:21.085019+0000","last_became_active":"2020-05-18T21:38:30.443876+0000","last_became_peered":"2020-05-18T21:38:30.443876+0000","last_unstale":"2020-05-18T21:39:21.085019+0000","last_undegraded":"2020-05-18T21:39:21.085019+0000","last_fullsized":"2020-05-18T21:39:21.085019+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:39:21.085004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:39:21.085004+0000","last_clean_scrub_stamp":"2020-05-18T21:39:21.085004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"163","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:13.001018+0000","last_change":"2020-05-18T21:39:13.001106+0000","last_active":"2020-05-18T21:39:13.001018+0000","last_peered":"2020-05-18T21:39:13.001018+0000","last_clean":"2020-05-18T21:39:13.001018+0000","last_became_active":"2020-05-18T21:26:42.154622+0000","last_became_peered":"2020-05-18T21:26:42.154622+0000","last_unstale":"2020-05-18T21:39:13.001018+0000","last_undegraded":"2020-05-18T21:39:13.001018+0000","last_fullsized":"2020-05-18T21:39:13.001018+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:39:13.001015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:39:13.001015+0000","last_clean_scrub_stamp":"2020-05-18T21:39:13.001015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":"23","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:22.227606+0000","last_change":"2020-05-18T21:39:22.227794+0000","last_active":"2020-05-18T21:39:22.227606+0000","last_peered":"2020-05-18T21:39:22.227606+0000","last_clean":"2020-05-18T21:39:22.227606+0000","last_became_active":"2020-05-18T21:38:30.452336+0000","last_became_peered":"2020-05-18T21:38:30.452336+0000","last_unstale":"2020-05-18T21:39:22.227606+0000","last_undegraded":"2020-05-18T21:39:22.227606+0000","last_fullsized":"2020-05-18T21:39:22.227606+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:39:22.227596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:39:22.227596+0000","last_clean_scrub_stamp":"2020-05-18T21:39:22.227596+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"149","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:22.248759+0000","last_change":"2020-05-18T21:39:22.248935+0000","last_active":"2020-05-18T21:39:22.248759+0000","last_peered":"2020-05-18T21:39:22.248759+0000","last_clean":"2020-05-18T21:39:22.248759+0000","last_became_active":"2020-05-18T21:26:42.154722+0000","last_became_peered":"2020-05-18T21:26:42.154722+0000","last_unstale":"2020-05-18T21:39:22.248759+0000","last_undegraded":"2020-05-18T21:39:22.248759+0000","last_fullsized":"2020-05-18T21:39:22.248759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:39:22.248745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:39:22.248745+0000","last_clean_scrub_stamp":"2020-05-18T21:39:22.248745+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":"23","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:15.500764+0000","last_change":"2020-05-18T21:39:15.500941+0000","last_active":"2020-05-18T21:39:15.500764+0000","last_peered":"2020-05-18T21:39:15.500764+0000","last_clean":"2020-05-18T21:39:15.500764+0000","last_became_active":"2020-05-18T21:38:30.592942+0000","last_became_peered":"2020-05-18T21:38:30.592942+0000","last_unstale":"2020-05-18T21:39:15.500764+0000","last_undegraded":"2020-05-18T21:39:15.500764+0000","last_fullsized":"2020-05-18T21:39:15.500764+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:39:15.500749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:39:15.500749+0000","last_clean_scrub_stamp":"2020-05-18T21:39:15.500749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"163","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:17.086950+0000","last_change":"2020-05-18T21:39:17.087044+0000","last_active":"2020-05-18T21:39:17.086950+0000","last_peered":"2020-05-18T21:39:17.086950+0000","last_clean":"2020-05-18T21:39:17.086950+0000","last_became_active":"2020-05-18T21:26:42.150762+0000","last_became_peered":"2020-05-18T21:26:42.150762+0000","last_unstale":"2020-05-18T21:39:17.086950+0000","last_undegraded":"2020-05-18T21:39:17.086950+0000","last_fullsized":"2020-05-18T21:39:17.086950+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:39:17.086947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:39:17.086947+0000","last_clean_scrub_stamp":"2020-05-18T21:39:17.086947+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2","version":"168'9","reported_seq":"38","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:20.028782+0000","last_change":"2020-05-18T21:39:20.028964+0000","last_active":"2020-05-18T21:39:20.028782+0000","last_peered":"2020-05-18T21:39:20.028782+0000","last_clean":"2020-05-18T21:39:20.028782+0000","last_became_active":"2020-05-18T21:38:30.446893+0000","last_became_peered":"2020-05-18T21:38:30.446893+0000","last_unstale":"2020-05-18T21:39:20.028782+0000","last_undegraded":"2020-05-18T21:39:20.028782+0000","last_fullsized":"2020-05-18T21:39:20.028782+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"168'9","last_scrub_stamp":"2020-05-18T21:39:20.028766+0000","last_deep_scrub":"168'9","last_deep_scrub_stamp":"2020-05-18T21:39:20.028766+0000","last_clean_scrub_stamp":"2020-05-18T21:39:20.028766+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4096,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"145","reported_epoch":"169","state":"active+clean","last_fresh":"2020-05-18T21:39:14.451990+0000","last_change":"2020-05-18T21:39:14.452081+0000","last_active":"2020-05-18T21:39:14.451990+0000","last_peered":"2020-05-18T21:39:14.451990+0000","last_clean":"2020-05-18T21:39:14.451990+0000","last_became_active":"2020-05-18T21:26:42.152721+0000","last_became_peered":"2020-05-18T21:26:42.152721+0000","last_unstale":"2020-05-18T21:39:14.451990+0000","last_undegraded":"2020-05-18T21:39:14.451990+0000","last_fullsized":"2020-05-18T21:39:14.451990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-05-18T21:39:14.451987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-05-18T21:39:14.451987+0000","last_clean_scrub_stamp":"2020-05-18T21:39:14.451987+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":16,"acting":16,"num_store_stats":7},{"poolid":31,"num_pg":8,"stat_sum":{"num_bytes":65772,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":135,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6103,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":131544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":16,"acting":16,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8220,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575005,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050684,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321156,"statfs":{"total":96636764160,"available":95560863744,"internally_reserved":1073741824,"allocated":2150400,"data_stored":1010913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":1.887,"5min":1.7689999999999999,"15min":1.694},"min":{"1min":1.0209999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.98,"5min":6.4699999999999998,"15min":6.4699999999999998},"last":1.8999999999999999},{"interface":"front","average":{"1min":1.881,"5min":1.6950000000000001,"15min":1.7669999999999999},"min":{"1min":1.1279999999999999,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.7450000000000001,"5min":2.8919999999999999,"15min":3.0779999999999998},"last":1.7709999999999999}]},{"osd":1,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":2.149,"5min":2.04,"15min":2.0299999999999998},"min":{"1min":1.2829999999999999,"5min":0.86399999999999999,"15min":0.72199999999999998},"max":{"1min":3.698,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":1.8380000000000001},{"interface":"front","average":{"1min":2.3620000000000001,"5min":2.5190000000000001,"15min":2.5329999999999999},"min":{"1min":1.319,"5min":1.264,"15min":1.1399999999999999},"max":{"1min":4.2149999999999999,"5min":6.6799999999999997,"15min":6.6799999999999997},"last":2.3199999999999998}]},{"osd":2,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":2.181,"5min":2.21,"15min":2.214},"min":{"1min":1.3779999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"max":{"1min":2.7490000000000001,"5min":9.032,"15min":9.032},"last":2.6949999999999998},{"interface":"front","average":{"1min":2.2330000000000001,"5min":2.226,"15min":2.2389999999999999},"min":{"1min":1.3859999999999999,"5min":1.107,"15min":0.86899999999999999},"max":{"1min":3.907,"5min":3.907,"15min":3.9660000000000002},"last":2.3889999999999998}]},{"osd":3,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":2.2480000000000002,"5min":2.2120000000000002,"15min":2.306},"min":{"1min":1.401,"5min":1.056,"15min":1.056},"max":{"1min":2.9249999999999998,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":2.5489999999999999},{"interface":"front","average":{"1min":2.851,"5min":2.827,"15min":2.8889999999999998},"min":{"1min":1.7130000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"max":{"1min":3.7639999999999998,"5min":8.8469999999999995,"15min":8.8469999999999995},"last":3.4169999999999998}]},{"osd":4,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":2.6909999999999998,"5min":2.4950000000000001,"15min":2.5270000000000001},"min":{"1min":2.008,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":3.5150000000000001,"5min":3.5510000000000002,"15min":4.9530000000000003},"last":2.839},{"interface":"front","average":{"1min":2.6379999999999999,"5min":2.532,"15min":2.5390000000000001},"min":{"1min":1.5660000000000001,"5min":1.089,"15min":1.0580000000000001},"max":{"1min":3.306,"5min":3.7320000000000002,"15min":4.0620000000000003},"last":3.1120000000000001}]},{"osd":5,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":2.9159999999999999,"5min":2.899,"15min":2.9340000000000002},"min":{"1min":1.633,"5min":1.6040000000000001,"15min":1.111},"max":{"1min":3.7970000000000002,"5min":9.218,"15min":9.218},"last":3.0249999999999999},{"interface":"front","average":{"1min":3.0179999999999998,"5min":2.9420000000000002,"15min":3.036},"min":{"1min":2.2909999999999999,"5min":1.4950000000000001,"15min":1.268},"max":{"1min":3.641,"5min":3.9980000000000002,"15min":4.6399999999999997},"last":3.1850000000000001}]},{"osd":6,"last update":"Mon May 18 21:38:58 2020","interfaces":[{"interface":"back","average":{"1min":3.3199999999999998,"5min":3.0859999999999999,"15min":3.2040000000000002},"min":{"1min":2.1419999999999999,"5min":1.2230000000000001,"15min":1.2230000000000001},"max":{"1min":4.367,"5min":4.367,"15min":5.6600000000000001},"last":3.4740000000000002},{"interface":"front","average":{"1min":3.0369999999999999,"5min":3.0350000000000001,"15min":3.1349999999999998},"min":{"1min":1.8340000000000001,"5min":1.464,"15min":1.3009999999999999},"max":{"1min":3.6920000000000002,"5min":4.2510000000000003,"15min":5.2539999999999996},"last":3.536}]}]},{"osd":6,"up_from":13,"seq":55834575006,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050756,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321084,"statfs":{"total":96636764160,"available":95560790016,"internally_reserved":1073741824,"allocated":2224128,"data_stored":1075691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":1.774,"5min":1.9510000000000001,"15min":1.9259999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.56799999999999995},"max":{"1min":2.7749999999999999,"5min":6.9699999999999998,"15min":6.9699999999999998},"last":1.4730000000000001},{"interface":"front","average":{"1min":2.2120000000000002,"5min":2.4009999999999998,"15min":2.427},"min":{"1min":1.6479999999999999,"5min":1.1879999999999999,"15min":1.0169999999999999},"max":{"1min":3.1120000000000001,"5min":6.9340000000000002,"15min":16.428999999999998},"last":2.96}]},{"osd":1,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":1.9319999999999999,"5min":2.992,"15min":2.403},"min":{"1min":0.99099999999999999,"5min":0.81899999999999995,"15min":0.78600000000000003},"max":{"1min":2.802,"5min":113.30200000000001,"15min":113.30200000000001},"last":1.516},{"interface":"front","average":{"1min":2.1240000000000001,"5min":3.2370000000000001,"15min":2.456},"min":{"1min":1.359,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":2.871,"5min":113.866,"15min":113.866},"last":2.1669999999999998}]},{"osd":2,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":2.1829999999999998,"5min":2.169,"15min":2.2290000000000001},"min":{"1min":1.5800000000000001,"5min":1.016,"15min":0.97799999999999998},"max":{"1min":3.2650000000000001,"5min":3.8180000000000001,"15min":4.7489999999999997},"last":2.867},{"interface":"front","average":{"1min":2.2309999999999999,"5min":2.2160000000000002,"15min":2.3580000000000001},"min":{"1min":1.111,"5min":0.97399999999999998,"15min":0.81100000000000005},"max":{"1min":2.8900000000000001,"5min":3.5329999999999999,"15min":4.3239999999999998},"last":2.6179999999999999}]},{"osd":3,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":2.5249999999999999,"5min":2.294,"15min":2.3900000000000001},"min":{"1min":1.6279999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":3.367,"5min":4.2610000000000001,"15min":16.594000000000001},"last":3.48},{"interface":"front","average":{"1min":2.5179999999999998,"5min":2.5390000000000001,"15min":2.681},"min":{"1min":1.7170000000000001,"5min":1.224,"15min":1.171},"max":{"1min":3.9510000000000001,"5min":4.1660000000000004,"15min":4.7619999999999996},"last":3.1589999999999998}]},{"osd":4,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.5739999999999998,"15min":2.6360000000000001},"min":{"1min":2.0859999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":3.3260000000000001,"5min":3.9740000000000002,"15min":3.9990000000000001},"last":3.0979999999999999},{"interface":"front","average":{"1min":2.7370000000000001,"5min":2.6389999999999998,"15min":2.7509999999999999},"min":{"1min":2.0379999999999998,"5min":1.129,"15min":0.84599999999999997},"max":{"1min":3.4449999999999998,"5min":4.6829999999999998,"15min":29.829999999999998},"last":3.2589999999999999}]},{"osd":5,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":3.0550000000000002,"5min":2.968,"15min":3.0379999999999998},"min":{"1min":1.903,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":4.2549999999999999,"5min":6.7370000000000001,"15min":6.7370000000000001},"last":3.6040000000000001},{"interface":"front","average":{"1min":3.2519999999999998,"5min":3.1560000000000001,"15min":3.2120000000000002},"min":{"1min":2.552,"5min":1.357,"15min":1.357},"max":{"1min":3.9689999999999999,"5min":6.3710000000000004,"15min":6.3710000000000004},"last":3.5409999999999999}]},{"osd":7,"last update":"Mon May 18 21:38:54 2020","interfaces":[{"interface":"back","average":{"1min":3.2120000000000002,"5min":3.016,"15min":3.1629999999999998},"min":{"1min":2.5600000000000001,"5min":1.2549999999999999,"15min":0.96199999999999997},"max":{"1min":3.8210000000000002,"5min":5.5670000000000002,"15min":31.196000000000002},"last":3.681},{"interface":"front","average":{"1min":3.2349999999999999,"5min":3.1070000000000002,"15min":3.2410000000000001},"min":{"1min":2.5110000000000001,"5min":1.363,"15min":1.363},"max":{"1min":4.5289999999999999,"5min":4.6429999999999998,"15min":4.8049999999999997},"last":3.3959999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575005,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050684,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321156,"statfs":{"total":96636764160,"available":95560863744,"internally_reserved":1073741824,"allocated":2150400,"data_stored":1010913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":1.7470000000000001,"5min":1.7909999999999999,"15min":1.806},"min":{"1min":1.179,"5min":0.623,"15min":0.623},"max":{"1min":3.0649999999999999,"5min":8.1430000000000007,"15min":8.1430000000000007},"last":1.355},{"interface":"front","average":{"1min":1.7669999999999999,"5min":1.847,"15min":1.8700000000000001},"min":{"1min":1.1339999999999999,"5min":0.81100000000000005,"15min":0.623},"max":{"1min":2.5339999999999998,"5min":3.8250000000000002,"15min":3.8250000000000002},"last":2.2349999999999999}]},{"osd":1,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":1.869,"5min":1.79,"15min":1.8640000000000001},"min":{"1min":1.3100000000000001,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.722,"5min":3.887,"15min":3.887},"last":2.3109999999999999},{"interface":"front","average":{"1min":2.1400000000000001,"5min":2.2610000000000001,"15min":2.1499999999999999},"min":{"1min":1.254,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.9380000000000002,"5min":8.6259999999999994,"15min":8.6259999999999994},"last":2.1720000000000002}]},{"osd":2,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":2.1190000000000002,"5min":2.0110000000000001,"15min":2.028},"min":{"1min":1.4399999999999999,"5min":0.91700000000000004,"15min":0.85299999999999998},"max":{"1min":3.4140000000000001,"5min":4.726,"15min":5.3410000000000002},"last":2.6539999999999999},{"interface":"front","average":{"1min":2.266,"5min":2.1779999999999999,"15min":2.1419999999999999},"min":{"1min":1.8400000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":3.1600000000000001,"5min":7.4989999999999997,"15min":7.4989999999999997},"last":2.843}]},{"osd":3,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":2.472,"5min":2.5760000000000001,"15min":2.5339999999999998},"min":{"1min":1.2,"5min":1.087,"15min":1.087},"max":{"1min":3.0339999999999998,"5min":7.8070000000000004,"15min":7.8070000000000004},"last":2.4350000000000001},{"interface":"front","average":{"1min":2.6859999999999999,"5min":2.5939999999999999,"15min":2.5760000000000001},"min":{"1min":2.0640000000000001,"5min":1.2509999999999999,"15min":0.995},"max":{"1min":3.246,"5min":5.1200000000000001,"15min":5.5060000000000002},"last":3.448}]},{"osd":4,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":2.6309999999999998,"5min":2.6549999999999998,"15min":2.633},"min":{"1min":1.7769999999999999,"5min":1.032,"15min":0.98099999999999998},"max":{"1min":3.427,"5min":8.4000000000000004,"15min":8.4000000000000004},"last":2.714},{"interface":"front","average":{"1min":2.8410000000000002,"5min":2.7120000000000002,"15min":2.7999999999999998},"min":{"1min":1.9890000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":3.6400000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":3.8319999999999999}]},{"osd":6,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":2.7040000000000002,"5min":2.629,"15min":2.661},"min":{"1min":2.0089999999999999,"5min":0.89200000000000002,"15min":0.88900000000000001},"max":{"1min":4.0010000000000003,"5min":11.242000000000001,"15min":11.242000000000001},"last":3.1099999999999999},{"interface":"front","average":{"1min":3.2320000000000002,"5min":3.282,"15min":3.2240000000000002},"min":{"1min":2.7559999999999998,"5min":1.2,"15min":1.1990000000000001},"max":{"1min":3.8730000000000002,"5min":11.411,"15min":11.411},"last":3.173}]},{"osd":7,"last update":"Mon May 18 21:38:57 2020","interfaces":[{"interface":"back","average":{"1min":3.3319999999999999,"5min":3.2679999999999998,"15min":3.2280000000000002},"min":{"1min":2.375,"5min":1.232,"15min":1.012},"max":{"1min":4.3609999999999998,"5min":9.5749999999999993,"15min":9.5749999999999993},"last":3.0499999999999998},{"interface":"front","average":{"1min":3.226,"5min":3.1549999999999998,"15min":3.1259999999999999},"min":{"1min":2.6139999999999999,"5min":1.054,"15min":1.054},"max":{"1min":3.7349999999999999,"5min":11.502000000000001,"15min":11.502000000000001},"last":3.3719999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575006,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050692,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321148,"statfs":{"total":96636764160,"available":95560855552,"internally_reserved":1073741824,"allocated":2158592,"data_stored":1011157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":1.98,"5min":1.7869999999999999,"15min":1.7869999999999999},"min":{"1min":1.3180000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":3.1589999999999998,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.611},{"interface":"front","average":{"1min":1.7030000000000001,"5min":1.784,"15min":1.8280000000000001},"min":{"1min":1.0629999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.6499999999999999,"5min":5.2530000000000001,"15min":5.2530000000000001},"last":2.121}]},{"osd":1,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":1.964,"5min":1.881,"15min":1.9850000000000001},"min":{"1min":1.1719999999999999,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.1629999999999998,"5min":4.8250000000000002,"15min":4.8250000000000002},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.9510000000000001,"5min":2.0459999999999998,"15min":2.121},"min":{"1min":1.0980000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":3.3199999999999998,"5min":3.3900000000000001,"15min":3.5699999999999998},"last":2.016}]},{"osd":2,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":2.286,"5min":2.2080000000000002,"15min":2.2440000000000002},"min":{"1min":1.1990000000000001,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":3.1960000000000002,"5min":4.1539999999999999,"15min":4.4649999999999999},"last":1.8180000000000001},{"interface":"front","average":{"1min":2.496,"5min":2.5590000000000002,"15min":2.6779999999999999},"min":{"1min":1.421,"5min":0.998,"15min":0.998},"max":{"1min":3.2509999999999999,"5min":3.8530000000000002,"15min":4.6059999999999999},"last":2.8069999999999999}]},{"osd":3,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":2.3159999999999998,"5min":2.2930000000000001,"15min":2.327},"min":{"1min":1.468,"5min":1.091,"15min":1.091},"max":{"1min":3.556,"5min":5.774,"15min":5.774},"last":1.7450000000000001},{"interface":"front","average":{"1min":2.2839999999999998,"5min":2.5470000000000002,"15min":2.5710000000000002},"min":{"1min":1.5620000000000001,"5min":1.115,"15min":1.115},"max":{"1min":2.7799999999999998,"5min":5.0519999999999996,"15min":5.0519999999999996},"last":2.2080000000000002}]},{"osd":5,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":2.7120000000000002,"5min":2.5859999999999999,"15min":2.681},"min":{"1min":2.2679999999999998,"5min":1.2190000000000001,"15min":1.1830000000000001},"max":{"1min":3.2429999999999999,"5min":3.5139999999999998,"15min":4.0110000000000001},"last":2.4169999999999998},{"interface":"front","average":{"1min":2.6669999999999998,"5min":2.6070000000000002,"15min":2.7639999999999998},"min":{"1min":1.9790000000000001,"5min":0.91800000000000004,"15min":0.82899999999999996},"max":{"1min":3.98,"5min":6.0179999999999998,"15min":6.0179999999999998},"last":2.5070000000000001}]},{"osd":6,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":2.891,"5min":2.7629999999999999,"15min":2.8370000000000002},"min":{"1min":2.4049999999999998,"5min":1.21,"15min":1.21},"max":{"1min":3.556,"5min":4.3300000000000001,"15min":4.3440000000000003},"last":3.3519999999999999},{"interface":"front","average":{"1min":3.0499999999999998,"5min":3.0049999999999999,"15min":3.0539999999999998},"min":{"1min":2.0939999999999999,"5min":1.083,"15min":1.083},"max":{"1min":3.762,"5min":4.952,"15min":4.952},"last":3.4820000000000002}]},{"osd":7,"last update":"Mon May 18 21:39:04 2020","interfaces":[{"interface":"back","average":{"1min":3.2029999999999998,"5min":2.9809999999999999,"15min":3.1349999999999998},"min":{"1min":2.5139999999999998,"5min":1.3280000000000001,"15min":1.113},"max":{"1min":4.2610000000000001,"5min":5.5069999999999997,"15min":5.71},"last":2.9079999999999999},{"interface":"front","average":{"1min":3.2690000000000001,"5min":3.1739999999999999,"15min":3.2770000000000001},"min":{"1min":2.7170000000000001,"5min":1.399,"15min":1.399},"max":{"1min":3.79,"5min":4.6139999999999999,"15min":5.0229999999999997},"last":2.6269999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575005,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050688,"kb_used_data":2104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321152,"statfs":{"total":96636764160,"available":95560859648,"internally_reserved":1073741824,"allocated":2154496,"data_stored":1010947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":1.657,"15min":1.798},"min":{"1min":1.1879999999999999,"5min":0.745,"15min":0.745},"max":{"1min":2.7890000000000001,"5min":3.6509999999999998,"15min":6.7140000000000004},"last":1.7769999999999999},{"interface":"front","average":{"1min":1.73,"5min":1.6339999999999999,"15min":1.7649999999999999},"min":{"1min":1.3759999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.2690000000000001,"5min":3.1379999999999999,"15min":8.2739999999999991},"last":1.5700000000000001}]},{"osd":1,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":1.9059999999999999,"5min":1.7450000000000001,"15min":1.9279999999999999},"min":{"1min":1.466,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":10.494},"last":1.635},{"interface":"front","average":{"1min":2.169,"5min":2.1150000000000002,"15min":2.2709999999999999},"min":{"1min":1.341,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":3.097,"5min":3.6960000000000002,"15min":8.2859999999999996},"last":2.3519999999999999}]},{"osd":2,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":2.266,"5min":2.153,"15min":2.2170000000000001},"min":{"1min":1.4710000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":3.4820000000000002,"5min":4.9930000000000003,"15min":5.7880000000000003},"last":1.962},{"interface":"front","average":{"1min":2.4180000000000001,"5min":2.403,"15min":2.5310000000000001},"min":{"1min":1.6020000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":3.1709999999999998,"5min":4.4960000000000004,"15min":6.0419999999999998},"last":3.069}]},{"osd":4,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":2.5289999999999999,"5min":2.3250000000000002,"15min":2.4729999999999999},"min":{"1min":1.4810000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":3.524,"5min":4.952,"15min":5.5670000000000002},"last":2.8639999999999999},{"interface":"front","average":{"1min":3.093,"5min":2.6760000000000002,"15min":2.7210000000000001},"min":{"1min":1.891,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":4.2480000000000002,"5min":4.5609999999999999,"15min":5.4059999999999997},"last":2.222}]},{"osd":5,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":3.2160000000000002,"5min":2.8759999999999999,"15min":2.9689999999999999},"min":{"1min":2.198,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":4.2649999999999997,"5min":4.9349999999999996,"15min":5.5339999999999998},"last":2.452},{"interface":"front","average":{"1min":2.956,"5min":2.895,"15min":2.98},"min":{"1min":2.202,"5min":1.411,"15min":1.411},"max":{"1min":3.8199999999999998,"5min":4.8109999999999999,"15min":6.2130000000000001},"last":2.8109999999999999}]},{"osd":6,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":2.8610000000000002,"5min":2.7010000000000001,"15min":2.8250000000000002},"min":{"1min":2.0190000000000001,"5min":1.03,"15min":1.03},"max":{"1min":3.915,"5min":4.7329999999999997,"15min":4.7549999999999999},"last":3.3159999999999998},{"interface":"front","average":{"1min":3.4950000000000001,"5min":3.0960000000000001,"15min":3.2389999999999999},"min":{"1min":1.6859999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"max":{"1min":5.3700000000000001,"5min":5.3700000000000001,"15min":5.625},"last":2.77}]},{"osd":7,"last update":"Mon May 18 21:38:52 2020","interfaces":[{"interface":"back","average":{"1min":3.1659999999999999,"5min":3.0800000000000001,"15min":3.157},"min":{"1min":2.2429999999999999,"5min":1.244,"15min":1.244},"max":{"1min":4.0490000000000004,"5min":4.585,"15min":6.5389999999999997},"last":3.2850000000000001},{"interface":"front","average":{"1min":3.0670000000000002,"5min":2.9460000000000002,"15min":3.1040000000000001},"min":{"1min":2.4809999999999999,"5min":1.24,"15min":1.24},"max":{"1min":4.5129999999999999,"5min":4.6740000000000004,"15min":5.1699999999999999},"last":3.117}]}]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050692,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321148,"statfs":{"total":96636764160,"available":95560855552,"internally_reserved":1073741824,"allocated":2158592,"data_stored":1011097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.534,"15min":1.5940000000000001},"min":{"1min":0.99199999999999999,"5min":0.78900000000000003,"15min":0.78100000000000003},"max":{"1min":1.917,"5min":2.1930000000000001,"15min":5.6319999999999997},"last":2.0790000000000002},{"interface":"front","average":{"1min":1.714,"5min":1.7070000000000001,"15min":1.677},"min":{"1min":1.0760000000000001,"5min":0.625,"15min":0.625},"max":{"1min":2.0990000000000002,"5min":3.0099999999999998,"15min":3.9409999999999998},"last":1.681}]},{"osd":1,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":2.1680000000000001,"5min":4.0199999999999996,"15min":2.7679999999999998},"min":{"1min":1.3280000000000001,"5min":1.0649999999999999,"15min":0.74199999999999999},"max":{"1min":2.6640000000000001,"5min":190.321,"15min":190.321},"last":2.5169999999999999},{"interface":"front","average":{"1min":2.3919999999999999,"5min":4.2549999999999999,"15min":2.9780000000000002},"min":{"1min":1.605,"5min":0.75700000000000001,"15min":0.65400000000000003},"max":{"1min":3.1890000000000001,"5min":190.46199999999999,"15min":190.46199999999999},"last":2.2690000000000001}]},{"osd":3,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":1.9379999999999999,"5min":1.9350000000000001,"15min":1.915},"min":{"1min":1.393,"5min":0.96599999999999997,"15min":0.68600000000000005},"max":{"1min":2.5960000000000001,"5min":3.3300000000000001,"15min":3.4329999999999998},"last":1.78},{"interface":"front","average":{"1min":2.7080000000000002,"5min":2.5600000000000001,"15min":2.5800000000000001},"min":{"1min":1.7769999999999999,"5min":1.1259999999999999,"15min":1.0940000000000001},"max":{"1min":4.4189999999999996,"5min":4.4189999999999996,"15min":5.9409999999999998},"last":2.9649999999999999}]},{"osd":4,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":2.4929999999999999,"5min":2.3769999999999998,"15min":2.4140000000000001},"min":{"1min":1.321,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":3.4060000000000001,"5min":4.7169999999999996,"15min":5.0030000000000001},"last":2.032},{"interface":"front","average":{"1min":2.3079999999999998,"5min":2.2690000000000001,"15min":2.343},"min":{"1min":1.821,"5min":1.218,"15min":1.1779999999999999},"max":{"1min":2.931,"5min":3.7480000000000002,"15min":4.0270000000000001},"last":2.4129999999999998}]},{"osd":5,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":3.0019999999999998,"5min":2.7440000000000002,"15min":2.7749999999999999},"min":{"1min":1.956,"5min":1.3939999999999999,"15min":1.3939999999999999},"max":{"1min":3.968,"5min":4.1200000000000001,"15min":5.766},"last":2.762},{"interface":"front","average":{"1min":2.835,"5min":2.8119999999999998,"15min":2.843},"min":{"1min":1.472,"5min":1.21,"15min":0.96799999999999997},"max":{"1min":3.899,"5min":5.1319999999999997,"15min":5.1319999999999997},"last":2.4780000000000002}]},{"osd":6,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":2.7000000000000002,"5min":2.6970000000000001,"15min":2.7330000000000001},"min":{"1min":1.512,"5min":1.512,"15min":1.0209999999999999},"max":{"1min":4.0949999999999998,"5min":4.7030000000000003,"15min":4.7030000000000003},"last":2.8969999999999998},{"interface":"front","average":{"1min":3.1739999999999999,"5min":3.0409999999999999,"15min":3.1160000000000001},"min":{"1min":2.2080000000000002,"5min":1.45,"15min":1.45},"max":{"1min":4.2560000000000002,"5min":4.2560000000000002,"15min":5.8499999999999996},"last":3.1739999999999999}]},{"osd":7,"last update":"Mon May 18 21:38:59 2020","interfaces":[{"interface":"back","average":{"1min":3.1789999999999998,"5min":3.1299999999999999,"15min":3.1920000000000002},"min":{"1min":1.873,"5min":1.516,"15min":1.2450000000000001},"max":{"1min":4.4020000000000001,"5min":5.399,"15min":5.4880000000000004},"last":2.7050000000000001},{"interface":"front","average":{"1min":3.0819999999999999,"5min":2.9569999999999999,"15min":3.0350000000000001},"min":{"1min":1.6679999999999999,"5min":1.385,"15min":1.385},"max":{"1min":4.0279999999999996,"5min":4.4800000000000004,"15min":4.4800000000000004},"last":3.298}]}]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050696,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321144,"statfs":{"total":96636764160,"available":95560851456,"internally_reserved":1073741824,"allocated":2162688,"data_stored":1011689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":1.8700000000000001,"5min":1.952,"15min":1.8819999999999999},"min":{"1min":1.4510000000000001,"5min":0.874,"15min":0.874},"max":{"1min":3.4430000000000001,"5min":14.193,"15min":14.193},"last":1.349},{"interface":"front","average":{"1min":2.1429999999999998,"5min":2.226,"15min":2.222},"min":{"1min":1.526,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":3.7599999999999998,"5min":9.3300000000000001,"15min":9.3300000000000001},"last":2.298}]},{"osd":2,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":1.7969999999999999,"5min":1.891,"15min":1.8180000000000001},"min":{"1min":1.0669999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.6040000000000001,"5min":6.5709999999999997,"15min":6.5709999999999997},"last":1.629},{"interface":"front","average":{"1min":2.625,"5min":2.613,"15min":2.5790000000000002},"min":{"1min":1.5369999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":3.4750000000000001,"5min":7.8700000000000001,"15min":9.1050000000000004},"last":2.8140000000000001}]},{"osd":3,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":2.2040000000000002,"5min":2.3410000000000002,"15min":2.2999999999999998},"min":{"1min":1.1679999999999999,"5min":1.016,"15min":0.995},"max":{"1min":3.0819999999999999,"5min":8.8140000000000001,"15min":9.3629999999999995},"last":1.907},{"interface":"front","average":{"1min":2.1960000000000002,"5min":2.2050000000000001,"15min":2.2029999999999998},"min":{"1min":1.234,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":3.0710000000000002,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":2.6880000000000002}]},{"osd":4,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":2.2730000000000001,"5min":2.3929999999999998,"15min":2.46},"min":{"1min":1.468,"5min":1.2210000000000001,"15min":1.103},"max":{"1min":3.294,"5min":6.3460000000000001,"15min":6.3460000000000001},"last":2.1200000000000001},{"interface":"front","average":{"1min":2.7509999999999999,"5min":2.7450000000000001,"15min":2.8199999999999998},"min":{"1min":1.9370000000000001,"5min":1.464,"15min":1.464},"max":{"1min":3.6360000000000001,"5min":8.6489999999999991,"15min":8.7929999999999993},"last":2.3889999999999998}]},{"osd":5,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":2.585,"5min":2.6600000000000001,"15min":2.6960000000000002},"min":{"1min":1.4039999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":3.6179999999999999,"5min":8.6539999999999999,"15min":8.6539999999999999},"last":2.0110000000000001},{"interface":"front","average":{"1min":2.778,"5min":2.7829999999999999,"15min":2.8719999999999999},"min":{"1min":2.0369999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":3.7360000000000002,"5min":5.867,"15min":5.867},"last":2.3410000000000002}]},{"osd":6,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":2.875,"5min":2.9860000000000002,"15min":3.0110000000000001},"min":{"1min":1.889,"5min":1.4059999999999999,"15min":1.1659999999999999},"max":{"1min":3.46,"5min":8.8859999999999992,"15min":8.8859999999999992},"last":3.1000000000000001},{"interface":"front","average":{"1min":3.0819999999999999,"5min":3.0299999999999998,"15min":3.1110000000000002},"min":{"1min":2.1179999999999999,"5min":0.997,"15min":0.997},"max":{"1min":4.2489999999999997,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":2.621}]},{"osd":7,"last update":"Mon May 18 21:38:56 2020","interfaces":[{"interface":"back","average":{"1min":3.181,"5min":3.2170000000000001,"15min":3.2480000000000002},"min":{"1min":2.5419999999999998,"5min":1.337,"15min":1.337},"max":{"1min":4.056,"5min":8.0470000000000006,"15min":8.9339999999999993},"last":3.2189999999999999},{"interface":"front","average":{"1min":3.2050000000000001,"5min":3.2749999999999999,"15min":3.3250000000000002},"min":{"1min":1.75,"5min":1.5649999999999999,"15min":1.5649999999999999},"max":{"1min":3.8359999999999999,"5min":9.1020000000000003,"15min":9.1020000000000003},"last":3.3279999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575005,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050772,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321068,"statfs":{"total":96636764160,"available":95560773632,"internally_reserved":1073741824,"allocated":2240512,"data_stored":1076441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":1.887,"5min":1.9330000000000001,"15min":1.8620000000000001},"min":{"1min":1.036,"5min":0.69899999999999995,"15min":0.67600000000000005},"max":{"1min":3.0369999999999999,"5min":8.9559999999999995,"15min":8.9559999999999995},"last":1.883},{"interface":"front","average":{"1min":1.724,"5min":1.738,"15min":1.762},"min":{"1min":1.052,"5min":0.78300000000000003,"15min":0.64900000000000002},"max":{"1min":2.8730000000000002,"5min":6.1689999999999996,"15min":6.1689999999999996},"last":1.4950000000000001}]},{"osd":2,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":2.0840000000000001,"5min":2.004,"15min":1.9910000000000001},"min":{"1min":1.3600000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.855,"5min":4.8810000000000002,"15min":5.3090000000000002},"last":3.4129999999999998},{"interface":"front","average":{"1min":2.3769999999999998,"5min":2.323,"15min":2.4129999999999998},"min":{"1min":1.2829999999999999,"5min":1.127,"15min":1.0289999999999999},"max":{"1min":3.194,"5min":3.6789999999999998,"15min":6.1189999999999998},"last":2.3140000000000001}]},{"osd":3,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":1.988,"5min":1.9319999999999999,"15min":1.946},"min":{"1min":1.3380000000000001,"5min":0.85799999999999998,"15min":0.82899999999999996},"max":{"1min":2.9380000000000002,"5min":3.3650000000000002,"15min":3.875},"last":1.996},{"interface":"front","average":{"1min":2.8559999999999999,"5min":2.6880000000000002,"15min":2.7570000000000001},"min":{"1min":1.9970000000000001,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":3.4390000000000001,"5min":5.9550000000000001,"15min":5.9550000000000001},"last":2.7650000000000001}]},{"osd":4,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":2.1699999999999999,"5min":2.4089999999999998,"15min":2.4809999999999999},"min":{"1min":1.25,"5min":1.25,"15min":1.0940000000000001},"max":{"1min":3.2629999999999999,"5min":4.3879999999999999,"15min":5.9969999999999999},"last":2.2000000000000002},{"interface":"front","average":{"1min":2.3900000000000001,"5min":2.4620000000000002,"15min":2.4700000000000002},"min":{"1min":1.669,"5min":1.345,"15min":0.92700000000000005},"max":{"1min":3.4060000000000001,"5min":4.0739999999999998,"15min":4.1070000000000002},"last":2.4740000000000002}]},{"osd":5,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":2.786,"5min":2.6059999999999999,"15min":2.6720000000000002},"min":{"1min":1.903,"5min":1.089,"15min":0.93600000000000005},"max":{"1min":3.698,"5min":3.9860000000000002,"15min":5.0919999999999996},"last":2.8860000000000001},{"interface":"front","average":{"1min":3.1200000000000001,"5min":3.153,"15min":3.302},"min":{"1min":2.109,"5min":1.488,"15min":1.3320000000000001},"max":{"1min":3.8620000000000001,"5min":6.1280000000000001,"15min":6.5119999999999996},"last":3.9980000000000002}]},{"osd":6,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":3.375,"5min":3.2690000000000001,"15min":3.4199999999999999},"min":{"1min":2.2999999999999998,"5min":1.8069999999999999,"15min":1.421},"max":{"1min":4.351,"5min":6.0430000000000001,"15min":6.8949999999999996},"last":4.4770000000000003},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.8170000000000002,"15min":2.9510000000000001},"min":{"1min":1.7729999999999999,"5min":1.46,"15min":1.2969999999999999},"max":{"1min":3.718,"5min":4.6180000000000003,"15min":5.593},"last":2.6339999999999999}]},{"osd":7,"last update":"Mon May 18 21:39:02 2020","interfaces":[{"interface":"back","average":{"1min":3.0459999999999998,"5min":3.032,"15min":3.1160000000000001},"min":{"1min":1.923,"5min":1.613,"15min":1.3300000000000001},"max":{"1min":4.2699999999999996,"5min":4.6779999999999999,"15min":5.8239999999999998},"last":3.032},{"interface":"front","average":{"1min":3.105,"5min":3.0089999999999999,"15min":3.0529999999999999},"min":{"1min":2.3420000000000001,"5min":1.3620000000000001,"15min":1.119},"max":{"1min":3.9470000000000001,"5min":4.4359999999999999,"15min":5.0890000000000004},"last":3.2160000000000002}]}]}]}} 2020-05-18T21:39:35.070 INFO:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2020-05-18T21:39:35.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.164+0000 7f57b7970700 1 Processor -- start 2020-05-18T21:39:35.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b7970700 1 -- start start 2020-05-18T21:39:35.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b7970700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57b00b8d90 0x7f57b00adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:35.178 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b7970700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f57b00b4110 0x7f57b00b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-05-18T21:39:35.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b7970700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b007fca0 con 0x7f57b00b8480 2020-05-18T21:39:35.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b7970700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b00b8860 con 0x7f57b00b4110 2020-05-18T21:39:35.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b7970700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b0080280 con 0x7f57b00b8d90 2020-05-18T21:39:35.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b670e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f57b00b4110 0x7f57b00b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:35.179 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b570c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57b00b8d90 0x7f57b00adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:35.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b670e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f57b00b4110 0x7f57b00b4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37774/0 (socket says 172.21.15.63:37774) 2020-05-18T21:39:35.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b670e700 1 -- 172.21.15.63:0/4180075282 learned_addr learned my addr 172.21.15.63:0/4180075282 (peer_addr_for_me v2:172.21.15.63:0/0) 2020-05-18T21:39:35.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b5f0d700 1 --1- 172.21.15.63:0/4180075282 >> v1:172.21.15.155:6789/0 conn(0x7f57b00b8480 0x7f57b00b36b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.63:38276/0 (socket says 172.21.15.63:38276) 2020-05-18T21:39:35.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b670e700 1 -- 172.21.15.63:0/4180075282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57b00b8d90 msgr2=0x7f57b00adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-05-18T21:39:35.180 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b670e700 1 --2- 172.21.15.63:0/4180075282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57b00b8d90 0x7f57b00adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:35.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b670e700 1 -- 172.21.15.63:0/4180075282 >> v1:172.21.15.155:6789/0 conn(0x7f57b00b8480 legacy=0x7f57b00b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:35.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b670e700 1 -- 172.21.15.63:0/4180075282 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b00b49e0 con 0x7f57b00b4110 2020-05-18T21:39:35.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b670e700 1 --2- 172.21.15.63:0/4180075282 >> v2:172.21.15.63:3300/0 conn(0x7f57b00b4110 0x7f57b00b4580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f57ac001110 tx=0x7f57a8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:35.181 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b670e700 1 --2- 172.21.15.63:0/4180075282 >> v2:172.21.15.63:3300/0 conn(0x7f57b00b4110 0x7f57b00b4580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f57ac001110 tx=0x7f57a8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:35.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b670e700 1 --2- 172.21.15.63:0/4180075282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57b00b4110 0x7f57b00b4580 secure :-1 s=READY pgs=2309 cs=0 l=1 rx=0x7f57ac001110 tx=0x7f57a8007e00).ready entity=mon.0 client_cookie=f99bf330f48a3156 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:35.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b670e700 1 --2- 172.21.15.63:0/4180075282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57b00b4110 0x7f57b00b4580 secure :-1 s=THROTTLE_DONE pgs=2309 cs=0 l=1 rx=0x7f57ac001110 tx=0x7f57a8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:35.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b670e700 1 --2- 172.21.15.63:0/4180075282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57b00b4110 0x7f57b00b4580 secure :-1 s=THROTTLE_DONE pgs=2309 cs=0 l=1 rx=0x7f57ac001110 tx=0x7f57a8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:35.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b4f0b700 1 -- 172.21.15.63:0/4180075282 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57a8010db0 con 0x7f57b00b4110 2020-05-18T21:39:35.182 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b670e700 1 --2- 172.21.15.63:0/4180075282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57b00b4110 0x7f57b00b4580 secure :-1 s=THROTTLE_DONE pgs=2309 cs=0 l=1 rx=0x7f57ac001110 tx=0x7f57a8007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:35.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b4f0b700 1 -- 172.21.15.63:0/4180075282 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a80110d0 con 0x7f57b00b4110 2020-05-18T21:39:35.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b4f0b700 1 -- 172.21.15.63:0/4180075282 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57a8011470 con 0x7f57b00b4110 2020-05-18T21:39:35.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b7970700 1 -- 172.21.15.63:0/4180075282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57b00b4110 msgr2=0x7f57b00b4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:35.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.168+0000 7f57b7970700 1 --2- 172.21.15.63:0/4180075282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57b00b4110 0x7f57b00b4580 secure :-1 s=READY pgs=2309 cs=0 l=1 rx=0x7f57ac001110 tx=0x7f57a8007e00).stop 2020-05-18T21:39:35.183 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.172+0000 7f57b7970700 1 -- 172.21.15.63:0/4180075282 shutdown_connections 2020-05-18T21:39:35.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.172+0000 7f57b7970700 1 --2- 172.21.15.63:0/4180075282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57b00b4110 0x7f57b00b4580 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:35.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.172+0000 7f57b7970700 1 --2- 172.21.15.63:0/4180075282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57b00b8d90 0x7f57b00adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-05-18T21:39:35.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.172+0000 7f57b7970700 1 -- 172.21.15.63:0/4180075282 >> 172.21.15.63:0/4180075282 conn(0x7f57b005f100 msgr2=0x7f57b005f510 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:35.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.172+0000 7f57b7970700 1 -- 172.21.15.63:0/4180075282 shutdown_connections 2020-05-18T21:39:35.184 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.172+0000 7f57b7970700 1 -- 172.21.15.63:0/4180075282 wait complete. 2020-05-18T21:39:35.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.172+0000 7f57b7970700 1 Processor -- start 2020-05-18T21:39:35.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.172+0000 7f57b7970700 1 -- start start 2020-05-18T21:39:35.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.172+0000 7f57b7970700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f57b00b8480 0x7f57b00618f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:35.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.172+0000 7f57b7970700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f57b00b8d90 0x7f57b007f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:35.188 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.172+0000 7f57b7970700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b007f860 con 0x7f57b00b4110 2020-05-18T21:39:35.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.172+0000 7f57b7970700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b00642e0 con 0x7f57b00b8480 2020-05-18T21:39:35.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.172+0000 7f57b7970700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b0064580 con 0x7f57b00b8d90 2020-05-18T21:39:35.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.172+0000 7f57b5f0d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f57b00b4110 0x7f57b00721e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:39966/0 (socket says 172.21.15.63:39966) 2020-05-18T21:39:35.189 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.172+0000 7f57b5f0d700 1 -- 172.21.15.63:0/1659634111 learned_addr learned my addr 172.21.15.63:0/1659634111 (peer_addr_for_me v1:172.21.15.63:0/0) 2020-05-18T21:39:35.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.172+0000 7f57b570c700 1 --2- 172.21.15.63:0/1659634111 >> v2:172.21.15.63:3300/0 conn(0x7f57b00b8480 0x7f57b00618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:35.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.172+0000 7f57b670e700 1 --2- 172.21.15.63:0/1659634111 >> v2:172.21.15.155:3300/0 conn(0x7f57b00b8d90 0x7f57b007f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:35.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57a67fc700 1 -- 172.21.15.63:0/1659634111 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242995316 0 0) 0x7f57b007f860 con 0x7f57b00b4110 2020-05-18T21:39:35.190 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57a67fc700 1 -- 172.21.15.63:0/1659634111 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5798003270 con 0x7f57b00b4110 2020-05-18T21:39:35.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57b570c700 1 -- 172.21.15.63:0/1659634111 >> v2:172.21.15.155:3300/0 conn(0x7f57b00b8d90 msgr2=0x7f57b007f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:35.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57b570c700 1 --2- 172.21.15.63:0/1659634111 >> v2:172.21.15.155:3300/0 conn(0x7f57b00b8d90 0x7f57b007f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:35.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57b570c700 1 -- 172.21.15.63:0/1659634111 >> v1:172.21.15.63:6789/0 conn(0x7f57b00b4110 legacy=0x7f57b00721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:35.191 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57b570c700 1 -- 172.21.15.63:0/1659634111 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b0064820 con 0x7f57b00b8480 2020-05-18T21:39:35.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57b570c700 1 --2- 172.21.15.63:0/1659634111 >> v2:172.21.15.63:3300/0 conn(0x7f57b00b8480 0x7f57b00618f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57a0002f70 tx=0x7f57a0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:35.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57b570c700 1 --2- 172.21.15.63:0/1659634111 >> v2:172.21.15.63:3300/0 conn(0x7f57b00b8480 0x7f57b00618f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57a0002f70 tx=0x7f57a0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:35.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57b570c700 1 --2- 172.21.15.63:0/1659634111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57b00b8480 0x7f57b00618f0 secure :-1 s=READY pgs=2311 cs=0 l=1 rx=0x7f57a0002f70 tx=0x7f57a0010bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:35.192 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57b570c700 1 --2- 172.21.15.63:0/1659634111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57b00b8480 0x7f57b00618f0 secure :-1 s=THROTTLE_DONE pgs=2311 cs=0 l=1 rx=0x7f57a0002f70 tx=0x7f57a0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:35.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57a67fc700 1 -- 172.21.15.63:0/1659634111 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57a0007360 con 0x7f57b00b8480 2020-05-18T21:39:35.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57b570c700 1 --2- 172.21.15.63:0/1659634111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57b00b8480 0x7f57b00618f0 secure :-1 s=THROTTLE_DONE pgs=2311 cs=0 l=1 rx=0x7f57a0002f70 tx=0x7f57a0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:35.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57a67fc700 1 -- 172.21.15.63:0/1659634111 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a00074c0 con 0x7f57b00b8480 2020-05-18T21:39:35.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57b570c700 1 --2- 172.21.15.63:0/1659634111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57b00b8480 0x7f57b00618f0 secure :-1 s=THROTTLE_DONE pgs=2311 cs=0 l=1 rx=0x7f57a0002f70 tx=0x7f57a0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:35.193 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57b7970700 1 -- 172.21.15.63:0/1659634111 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b006f710 con 0x7f57b00b8480 2020-05-18T21:39:35.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57a67fc700 1 -- 172.21.15.63:0/1659634111 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57a00058f0 con 0x7f57b00b8480 2020-05-18T21:39:35.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57b7970700 1 -- 172.21.15.63:0/1659634111 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b0133c40 con 0x7f57b00b8480 2020-05-18T21:39:35.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57b570c700 1 --2- 172.21.15.63:0/1659634111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57b00b8480 0x7f57b00618f0 secure :-1 s=THROTTLE_DONE pgs=2311 cs=0 l=1 rx=0x7f57a0002f70 tx=0x7f57a0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:35.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57b7970700 1 -- 172.21.15.63:0/1659634111 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b00569e0 con 0x7f57b00b8480 2020-05-18T21:39:35.194 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57a67fc700 1 -- 172.21.15.63:0/1659634111 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 61621+0+0 (secure 0 0 0) 0x7f57a0005b30 con 0x7f57b00b8480 2020-05-18T21:39:35.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.176+0000 7f57b570c700 1 --2- 172.21.15.63:0/1659634111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57b00b8480 0x7f57b00618f0 secure :-1 s=THROTTLE_DONE pgs=2311 cs=0 l=1 rx=0x7f57a0002f70 tx=0x7f57a0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:35.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.180+0000 7f57a67fc700 1 --2- 172.21.15.63:0/1659634111 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f579804fd70 0x7f5798052230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-05-18T21:39:35.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.180+0000 7f57a67fc700 1 -- 172.21.15.63:0/1659634111 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f57a0063b80 con 0x7f57b00b8480 2020-05-18T21:39:35.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.180+0000 7f57b5f0d700 1 --2- 172.21.15.63:0/1659634111 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f579804fd70 0x7f5798052230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-05-18T21:39:35.195 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.180+0000 7f57b5f0d700 1 --2- 172.21.15.63:0/1659634111 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f579804fd70 0x7f5798052230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57ac000f50 tx=0x7f57ac001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:35.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.180+0000 7f57b5f0d700 1 --2- 172.21.15.63:0/1659634111 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f579804fd70 0x7f5798052230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57ac000f50 tx=0x7f57ac001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:35.196 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.180+0000 7f57b5f0d700 1 --2- 172.21.15.63:0/1659634111 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f579804fd70 0x7f5798052230 secure :-1 s=READY pgs=905 cs=0 l=1 rx=0x7f57ac000f50 tx=0x7f57ac001950).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-05-18T21:39:35.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.184+0000 7f57b570c700 1 --2- 172.21.15.63:0/1659634111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57b00b8480 0x7f57b00618f0 secure :-1 s=THROTTLE_DONE pgs=2311 cs=0 l=1 rx=0x7f57a0002f70 tx=0x7f57a0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:35.197 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.184+0000 7f57a67fc700 1 -- 172.21.15.63:0/1659634111 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+129441 (secure 0 0 0) 0x7f57a003df10 con 0x7f57b00b8480 2020-05-18T21:39:35.306 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.300+0000 7f57b7970700 1 -- 172.21.15.63:0/1659634111 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"} v 0) v1 -- 0x7f57b00b5a70 con 0x7f57b00b8480 2020-05-18T21:39:35.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.308+0000 7f57b570c700 1 --2- 172.21.15.63:0/1659634111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57b00b8480 0x7f57b00618f0 secure :-1 s=THROTTLE_DONE pgs=2311 cs=0 l=1 rx=0x7f57a0002f70 tx=0x7f57a0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:35.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.308+0000 7f57a67fc700 1 -- 172.21.15.63:0/1659634111 <== mon.0 v2:172.21.15.63:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f57a003df10 con 0x7f57b00b8480 2020-05-18T21:39:35.314 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.308+0000 7f57b570c700 1 --2- 172.21.15.63:0/1659634111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57b00b8480 0x7f57b00618f0 secure :-1 s=THROTTLE_DONE pgs=2311 cs=0 l=1 rx=0x7f57a0002f70 tx=0x7f57a0010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-05-18T21:39:35.315 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.308+0000 7f57a67fc700 1 -- 172.21.15.63:0/1659634111 <== mon.0 v2:172.21.15.63:3300/0 8 ==== mon_command_ack([{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}]=0 v2) v1 ==== 123+0+0 (secure 0 0 0) 0x7f57a0041530 con 0x7f57b00b8480 2020-05-18T21:39:35.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.312+0000 7f57b7970700 1 -- 172.21.15.63:0/1659634111 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f579804fd70 msgr2=0x7f5798052230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:35.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.312+0000 7f57b7970700 1 --2- 172.21.15.63:0/1659634111 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f579804fd70 0x7f5798052230 secure :-1 s=READY pgs=905 cs=0 l=1 rx=0x7f57ac000f50 tx=0x7f57ac001950).stop 2020-05-18T21:39:35.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.312+0000 7f57b7970700 1 -- 172.21.15.63:0/1659634111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57b00b8480 msgr2=0x7f57b00618f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-05-18T21:39:35.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.312+0000 7f57b7970700 1 --2- 172.21.15.63:0/1659634111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57b00b8480 0x7f57b00618f0 secure :-1 s=READY pgs=2311 cs=0 l=1 rx=0x7f57a0002f70 tx=0x7f57a0010bd0).stop 2020-05-18T21:39:35.318 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.312+0000 7f57b7970700 1 -- 172.21.15.63:0/1659634111 shutdown_connections 2020-05-18T21:39:35.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.312+0000 7f57b7970700 1 --2- 172.21.15.63:0/1659634111 >> [v2:172.21.15.155:6832/12649,v1:172.21.15.155:6833/12649] conn(0x7f579804fd70 0x7f5798052230 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:35.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.312+0000 7f57b7970700 1 --2- 172.21.15.63:0/1659634111 >> v2:172.21.15.155:3300/0 conn(0x7f57b00b8d90 0x7f57b007f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:35.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.312+0000 7f57b7970700 1 --2- 172.21.15.63:0/1659634111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57b00b8480 0x7f57b00618f0 unknown :-1 s=CLOSED pgs=2311 cs=0 l=1 rx=0 tx=0).stop 2020-05-18T21:39:35.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.312+0000 7f57b7970700 1 -- 172.21.15.63:0/1659634111 >> 172.21.15.63:0/1659634111 conn(0x7f57b005f100 msgr2=0x7f57b005c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-05-18T21:39:35.319 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.312+0000 7f57b7970700 1 -- 172.21.15.63:0/1659634111 shutdown_connections 2020-05-18T21:39:35.320 INFO:teuthology.orchestra.run.smithi063.stderr:2020-05-18T21:39:35.312+0000 7f57b7970700 1 -- 172.21.15.63:0/1659634111 wait complete. 2020-05-18T21:39:35.331 INFO:teuthology.misc:Shutting down mds daemons... 2020-05-18T21:39:35.332 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-05-18T21:39:35.332 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:39:35.347 INFO:tasks.ceph.mds.a:Stopped 2020-05-18T21:39:35.347 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-05-18T21:39:35.348 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:39:35.363 INFO:tasks.ceph.mds.b:Stopped 2020-05-18T21:39:35.363 INFO:teuthology.misc:Shutting down osd daemons... 2020-05-18T21:39:35.364 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2020-05-18T21:39:35.364 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:39:35.448 INFO:tasks.ceph.osd.0:Stopped 2020-05-18T21:39:35.449 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2020-05-18T21:39:35.449 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:39:35.514 INFO:tasks.ceph.osd.1:Stopped 2020-05-18T21:39:35.514 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2020-05-18T21:39:35.515 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:39:35.601 INFO:tasks.ceph.osd.2:Stopped 2020-05-18T21:39:35.602 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2020-05-18T21:39:35.602 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:39:35.684 INFO:tasks.ceph.osd.3:Stopped 2020-05-18T21:39:35.685 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2020-05-18T21:39:35.685 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:39:35.762 INFO:tasks.ceph.osd.4:Stopped 2020-05-18T21:39:35.763 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2020-05-18T21:39:35.763 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:39:35.862 INFO:tasks.ceph.osd.5:Stopped 2020-05-18T21:39:35.862 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2020-05-18T21:39:35.863 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:39:35.935 INFO:tasks.ceph.osd.6:Stopped 2020-05-18T21:39:35.935 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2020-05-18T21:39:35.936 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:39:36.004 INFO:tasks.ceph.osd.7:Stopped 2020-05-18T21:39:36.005 INFO:teuthology.misc:Shutting down mgr daemons... 2020-05-18T21:39:36.005 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2020-05-18T21:39:36.006 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:39:36.033 INFO:tasks.ceph.mgr.y:Stopped 2020-05-18T21:39:36.033 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2020-05-18T21:39:36.034 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:39:36.060 INFO:tasks.ceph.mgr.x:Stopped 2020-05-18T21:39:36.060 INFO:teuthology.misc:Shutting down mon daemons... 2020-05-18T21:39:36.061 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-05-18T21:39:36.061 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:39:36.081 INFO:tasks.ceph.mon.a:Stopped 2020-05-18T21:39:36.082 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2020-05-18T21:39:36.082 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:39:36.100 INFO:tasks.ceph.mon.b:Stopped 2020-05-18T21:39:36.100 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-05-18T21:39:36.100 INFO:teuthology.orchestra.run:waiting for 300 2020-05-18T21:39:36.115 INFO:tasks.ceph.mon.c:Stopped 2020-05-18T21:39:36.115 INFO:tasks.ceph:Checking cluster log for badness... 2020-05-18T21:39:36.116 INFO:teuthology.orchestra.run.smithi063:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2020-05-18T21:39:36.146 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi063.front.sepia.ceph.com 2020-05-18T21:39:36.146 INFO:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2020-05-18T21:39:36.569 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi063.front.sepia.ceph.com 2020-05-18T21:39:36.569 INFO:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2020-05-18T21:39:36.789 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi063.front.sepia.ceph.com 2020-05-18T21:39:36.789 INFO:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2020-05-18T21:39:36.946 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi063.front.sepia.ceph.com 2020-05-18T21:39:36.946 INFO:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2020-05-18T21:39:37.145 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi155.front.sepia.ceph.com 2020-05-18T21:39:37.145 INFO:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2020-05-18T21:39:37.424 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi155.front.sepia.ceph.com 2020-05-18T21:39:37.425 INFO:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2020-05-18T21:39:37.691 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi155.front.sepia.ceph.com 2020-05-18T21:39:37.692 INFO:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2020-05-18T21:39:37.823 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi155.front.sepia.ceph.com 2020-05-18T21:39:37.824 INFO:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2020-05-18T21:39:37.966 INFO:tasks.ceph:Archiving mon data... 2020-05-18T21:39:37.968 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2020-05-18_20:49:47-fs-wip-pdonnell-testing-20200516.030215-distro-basic-smithi/5067927/data/mon.a.tgz 2020-05-18T21:39:37.969 INFO:teuthology.orchestra.run.smithi063:> mktemp 2020-05-18T21:39:37.976 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.al9pGZf5w3 2020-05-18T21:39:37.976 INFO:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.al9pGZf5w3 2020-05-18T21:39:38.303 INFO:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.al9pGZf5w3 2020-05-18T21:39:38.371 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.al9pGZf5w3 is 1MB 2020-05-18T21:39:38.416 INFO:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.al9pGZf5w3 2020-05-18T21:39:38.423 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2020-05-18_20:49:47-fs-wip-pdonnell-testing-20200516.030215-distro-basic-smithi/5067927/data/mon.b.tgz 2020-05-18T21:39:38.423 INFO:teuthology.orchestra.run.smithi155:> mktemp 2020-05-18T21:39:38.430 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.7mw48cCWLu 2020-05-18T21:39:38.431 INFO:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.7mw48cCWLu 2020-05-18T21:39:38.819 INFO:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.7mw48cCWLu 2020-05-18T21:39:38.839 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.7mw48cCWLu is 1MB 2020-05-18T21:39:38.918 INFO:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.7mw48cCWLu 2020-05-18T21:39:38.925 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2020-05-18_20:49:47-fs-wip-pdonnell-testing-20200516.030215-distro-basic-smithi/5067927/data/mon.c.tgz 2020-05-18T21:39:38.926 INFO:teuthology.orchestra.run.smithi155:> mktemp 2020-05-18T21:39:38.935 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.4xjTpWjNa8 2020-05-18T21:39:38.935 INFO:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.4xjTpWjNa8 2020-05-18T21:39:39.318 INFO:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.4xjTpWjNa8 2020-05-18T21:39:39.339 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.4xjTpWjNa8 is 1MB 2020-05-18T21:39:39.423 INFO:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.4xjTpWjNa8 2020-05-18T21:39:39.431 INFO:tasks.ceph:Cleaning ceph cluster... 2020-05-18T21:39:39.432 INFO:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-05-18T21:39:39.434 INFO:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-05-18T21:39:39.494 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2020-05-18T21:39:39.495 INFO:teuthology.orchestra.run.smithi063:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-05-18T21:39:39.497 INFO:teuthology.orchestra.run.smithi155:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-05-18T21:39:39.518 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-05-18T21:39:39.519 INFO:teuthology.orchestra.run.smithi155.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-05-18T21:39:39.527 INFO:tasks.ceph:Archiving crash dumps... 2020-05-18T21:39:39.529 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2020-05-18_20:49:47-fs-wip-pdonnell-testing-20200516.030215-distro-basic-smithi/5067927/remote/smithi063/crash 2020-05-18T21:39:39.531 INFO:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-05-18T21:39:39.550 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2020-05-18_20:49:47-fs-wip-pdonnell-testing-20200516.030215-distro-basic-smithi/5067927/remote/smithi155/crash 2020-05-18T21:39:39.551 INFO:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-05-18T21:39:39.570 INFO:tasks.ceph:Shutting down logrotate 2020-05-18T21:39:39.571 INFO:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:39:39.594 INFO:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-05-18T21:39:39.652 INFO:teuthology.orchestra.run.smithi063:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-05-18T21:39:39.668 INFO:teuthology.orchestra.run.smithi155:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-05-18T21:39:39.682 INFO:tasks.ceph:Compressing logs... 2020-05-18T21:39:39.683 INFO:teuthology.orchestra.run.smithi063:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-05-18T21:39:39.685 INFO:teuthology.orchestra.run.smithi155:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-05-18T21:40:17.005 INFO:tasks.ceph:Archiving logs... 2020-05-18T21:40:17.007 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/log/ceph to /home/teuthworker/archive/pdonnell-2020-05-18_20:49:47-fs-wip-pdonnell-testing-20200516.030215-distro-basic-smithi/5067927/remote/smithi063/log 2020-05-18T21:40:17.008 INFO:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/log/ceph -- . 2020-05-18T21:40:25.464 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/pdonnell-2020-05-18_20:49:47-fs-wip-pdonnell-testing-20200516.030215-distro-basic-smithi/5067927/remote/smithi155/log 2020-05-18T21:40:25.466 INFO:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/log/ceph -- . 2020-05-18T21:40:32.444 DEBUG:teuthology.run_tasks:Unwinding manager install 2020-05-18T21:40:32.457 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2020-05-18T21:40:32.458 INFO:teuthology.orchestra.run.smithi063:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2020-05-18T21:40:32.460 INFO:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2020-05-18T21:40:32.499 INFO:teuthology.orchestra.run.smithi063:> sudo lsb_release -is 2020-05-18T21:40:32.549 INFO:teuthology.orchestra.run.smithi063.stdout:Ubuntu 2020-05-18T21:40:32.555 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-05-18T21:40:32.555 INFO:teuthology.orchestra.run.smithi155:> sudo lsb_release -is 2020-05-18T21:40:32.556 INFO:teuthology.task.install.deb:Removing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on Debian system. 2020-05-18T21:40:32.556 INFO:teuthology.orchestra.run.smithi063:> for d in ceph cephadm ceph-mds ceph-mgr ceph-common ceph-fuse ceph-test radosgw python3-rados python3-rgw python3-cephfs python3-rbd libcephfs2 libcephfs-dev librados2 librbd1 rbd-fuse python3-cephfs cephfs-shell ; do sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" purge $d || true ; done 2020-05-18T21:40:32.604 INFO:teuthology.orchestra.run.smithi155.stdout:Ubuntu 2020-05-18T21:40:32.609 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-05-18T21:40:32.610 INFO:teuthology.task.install.deb:Removing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on Debian system. 2020-05-18T21:40:32.610 INFO:teuthology.orchestra.run.smithi155:> for d in ceph cephadm ceph-mds ceph-mgr ceph-common ceph-fuse ceph-test radosgw python3-rados python3-rgw python3-cephfs python3-rbd libcephfs2 libcephfs-dev librados2 librbd1 rbd-fuse python3-cephfs cephfs-shell ; do sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" purge $d || true ; done 2020-05-18T21:40:32.630 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2020-05-18T21:40:32.676 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2020-05-18T21:40:32.770 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2020-05-18T21:40:32.771 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2020-05-18T21:40:32.797 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2020-05-18T21:40:32.798 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2020-05-18T21:40:32.905 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2020-05-18T21:40:32.906 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon ceph-osd libboost-iostreams1.71.0 2020-05-18T21:40:32.906 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2020-05-18T21:40:32.910 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2020-05-18T21:40:32.911 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon ceph-osd libboost-iostreams1.71.0 2020-05-18T21:40:32.912 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2020-05-18T21:40:32.918 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be REMOVED: 2020-05-18T21:40:32.919 INFO:teuthology.orchestra.run.smithi063.stdout: ceph* 2020-05-18T21:40:32.922 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages will be REMOVED: 2020-05-18T21:40:32.923 INFO:teuthology.orchestra.run.smithi155.stdout: ceph* 2020-05-18T21:40:33.296 INFO:teuthology.orchestra.run.smithi155.stdout:0 upgraded, 0 newly installed, 1 to remove and 45 not upgraded. 2020-05-18T21:40:33.297 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 9,216 B disk space will be freed. 2020-05-18T21:40:33.313 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 1 to remove and 45 not upgraded. 2020-05-18T21:40:33.313 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 9,216 B disk space will be freed. 2020-05-18T21:40:33.438 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 156866 files and directories currently installed.) 2020-05-18T21:40:33.441 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 156866 files and directories currently installed.) 2020-05-18T21:40:33.443 INFO:teuthology.orchestra.run.smithi155.stdout:Removing ceph (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:33.446 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:34.213 INFO:teuthology.orchestra.run.smithi155.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-05-18T21:40:34.274 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2020-05-18T21:40:34.376 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-05-18T21:40:34.407 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2020-05-18T21:40:34.408 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2020-05-18T21:40:34.441 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2020-05-18T21:40:34.539 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2020-05-18T21:40:34.540 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon ceph-osd libboost-iostreams1.71.0 2020-05-18T21:40:34.540 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2020-05-18T21:40:34.558 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages will be REMOVED: 2020-05-18T21:40:34.559 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm* cephadm* 2020-05-18T21:40:34.580 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2020-05-18T21:40:34.581 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2020-05-18T21:40:34.722 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2020-05-18T21:40:34.723 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon ceph-osd libboost-iostreams1.71.0 2020-05-18T21:40:34.723 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2020-05-18T21:40:34.743 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be REMOVED: 2020-05-18T21:40:34.744 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm* cephadm* 2020-05-18T21:40:34.936 INFO:teuthology.orchestra.run.smithi155.stdout:0 upgraded, 0 newly installed, 2 to remove and 45 not upgraded. 2020-05-18T21:40:34.936 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 385 kB disk space will be freed. 2020-05-18T21:40:35.114 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 156865 files and directories currently installed.) 2020-05-18T21:40:35.119 INFO:teuthology.orchestra.run.smithi155.stdout:Removing ceph-mgr-cephadm (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:35.129 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 2 to remove and 45 not upgraded. 2020-05-18T21:40:35.129 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 385 kB disk space will be freed. 2020-05-18T21:40:35.250 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 156865 files and directories currently installed.) 2020-05-18T21:40:35.254 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-mgr-cephadm (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:35.540 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-cephadm, directory '/usr/share/ceph/mgr/cephadm/services' not empty so not removed 2020-05-18T21:40:35.565 INFO:teuthology.orchestra.run.smithi155.stdout:dpkg: warning: while removing ceph-mgr-cephadm, directory '/usr/share/ceph/mgr/cephadm/services' not empty so not removed 2020-05-18T21:40:35.721 INFO:teuthology.orchestra.run.smithi155.stdout:Removing cephadm (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:35.880 INFO:teuthology.orchestra.run.smithi063.stdout:Removing cephadm (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:35.972 INFO:teuthology.orchestra.run.smithi063.stdout:Looking for files to backup/remove ... 2020-05-18T21:40:35.975 INFO:teuthology.orchestra.run.smithi063.stdout:Removing files ... 2020-05-18T21:40:35.980 INFO:teuthology.orchestra.run.smithi155.stdout:Looking for files to backup/remove ... 2020-05-18T21:40:35.984 INFO:teuthology.orchestra.run.smithi155.stdout:Removing files ... 2020-05-18T21:40:35.991 INFO:teuthology.orchestra.run.smithi063.stdout:Removing user `cephadm' ... 2020-05-18T21:40:35.991 INFO:teuthology.orchestra.run.smithi063.stdout:Warning: group `nogroup' has no more members. 2020-05-18T21:40:35.999 INFO:teuthology.orchestra.run.smithi155.stdout:Removing user `cephadm' ... 2020-05-18T21:40:35.999 INFO:teuthology.orchestra.run.smithi155.stdout:Warning: group `nogroup' has no more members. 2020-05-18T21:40:36.116 INFO:teuthology.orchestra.run.smithi155.stdout:Done. 2020-05-18T21:40:36.142 INFO:teuthology.orchestra.run.smithi063.stdout:Done. 2020-05-18T21:40:36.342 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for man-db (2.9.1-1) ... 2020-05-18T21:40:36.374 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for man-db (2.9.1-1) ... 2020-05-18T21:40:36.885 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 156841 files and directories currently installed.) 2020-05-18T21:40:36.890 INFO:teuthology.orchestra.run.smithi155.stdout:Purging configuration files for cephadm (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:36.907 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 156841 files and directories currently installed.) 2020-05-18T21:40:36.912 INFO:teuthology.orchestra.run.smithi063.stdout:Purging configuration files for cephadm (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:37.536 INFO:teuthology.orchestra.run.smithi155.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-05-18T21:40:37.593 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-05-18T21:40:37.602 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2020-05-18T21:40:37.661 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2020-05-18T21:40:37.739 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2020-05-18T21:40:37.740 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2020-05-18T21:40:37.801 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2020-05-18T21:40:37.802 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2020-05-18T21:40:37.869 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2020-05-18T21:40:37.870 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon ceph-osd libboost-iostreams1.71.0 2020-05-18T21:40:37.870 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2020-05-18T21:40:37.881 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages will be REMOVED: 2020-05-18T21:40:37.882 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds* 2020-05-18T21:40:37.950 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2020-05-18T21:40:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon ceph-osd libboost-iostreams1.71.0 2020-05-18T21:40:37.951 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2020-05-18T21:40:37.955 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be REMOVED: 2020-05-18T21:40:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds* 2020-05-18T21:40:38.251 INFO:teuthology.orchestra.run.smithi155.stdout:0 upgraded, 0 newly installed, 1 to remove and 45 not upgraded. 2020-05-18T21:40:38.252 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 6,630 kB disk space will be freed. 2020-05-18T21:40:38.345 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 1 to remove and 45 not upgraded. 2020-05-18T21:40:38.345 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 6,630 kB disk space will be freed. 2020-05-18T21:40:38.378 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 156840 files and directories currently installed.) 2020-05-18T21:40:38.383 INFO:teuthology.orchestra.run.smithi155.stdout:Removing ceph-mds (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:38.587 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 156840 files and directories currently installed.) 2020-05-18T21:40:38.592 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-mds (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:39.477 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for man-db (2.9.1-1) ... 2020-05-18T21:40:39.871 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for man-db (2.9.1-1) ... 2020-05-18T21:40:40.000 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 156834 files and directories currently installed.) 2020-05-18T21:40:40.004 INFO:teuthology.orchestra.run.smithi155.stdout:Purging configuration files for ceph-mds (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:40.394 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 156834 files and directories currently installed.) 2020-05-18T21:40:40.399 INFO:teuthology.orchestra.run.smithi063.stdout:Purging configuration files for ceph-mds (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:41.021 INFO:teuthology.orchestra.run.smithi155.stdout:dpkg: warning: while removing ceph-mds, directory '/var/lib/ceph/mds' not empty so not removed 2020-05-18T21:40:41.332 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mds, directory '/var/lib/ceph/mds' not empty so not removed 2020-05-18T21:40:41.496 INFO:teuthology.orchestra.run.smithi155.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-05-18T21:40:41.561 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2020-05-18T21:40:41.700 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2020-05-18T21:40:41.701 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2020-05-18T21:40:41.807 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-05-18T21:40:41.831 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2020-05-18T21:40:41.832 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core ceph-mon ceph-osd libboost-iostreams1.71.0 2020-05-18T21:40:41.833 INFO:teuthology.orchestra.run.smithi155.stdout: libjs-sphinxdoc libjs-underscore python-pastedeploy-tpl python3-bcrypt 2020-05-18T21:40:41.833 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bs4 python3-cachetools python3-cherrypy3 python3-google-auth 2020-05-18T21:40:41.833 INFO:teuthology.orchestra.run.smithi155.stdout: python3-html5lib python3-joblib python3-json-pointer python3-jsonpatch 2020-05-18T21:40:41.833 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2020-05-18T21:40:41.833 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe python3-paste python3-pastedeploy python3-pastescript 2020-05-18T21:40:41.834 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan python3-psutil python3-pyasn1 python3-pyasn1-modules 2020-05-18T21:40:41.834 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2020-05-18T21:40:41.834 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes python3-rsa python3-simplegeneric python3-singledispatch 2020-05-18T21:40:41.834 INFO:teuthology.orchestra.run.smithi155.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2020-05-18T21:40:41.834 INFO:teuthology.orchestra.run.smithi155.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-05-18T21:40:41.835 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webtest python3-werkzeug 2020-05-18T21:40:41.835 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2020-05-18T21:40:41.874 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2020-05-18T21:40:41.882 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages will be REMOVED: 2020-05-18T21:40:41.882 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr* ceph-mgr-dashboard* ceph-mgr-diskprediction-cloud* 2020-05-18T21:40:41.883 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local* ceph-mgr-k8sevents* ceph-mgr-rook* 2020-05-18T21:40:42.011 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2020-05-18T21:40:42.012 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2020-05-18T21:40:42.150 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2020-05-18T21:40:42.150 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core ceph-mon ceph-osd libboost-iostreams1.71.0 2020-05-18T21:40:42.151 INFO:teuthology.orchestra.run.smithi063.stdout: libjs-sphinxdoc libjs-underscore python-pastedeploy-tpl python3-bcrypt 2020-05-18T21:40:42.151 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bs4 python3-cachetools python3-cherrypy3 python3-google-auth 2020-05-18T21:40:42.152 INFO:teuthology.orchestra.run.smithi063.stdout: python3-html5lib python3-joblib python3-json-pointer python3-jsonpatch 2020-05-18T21:40:42.152 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2020-05-18T21:40:42.152 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe python3-paste python3-pastedeploy python3-pastescript 2020-05-18T21:40:42.152 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan python3-psutil python3-pyasn1 python3-pyasn1-modules 2020-05-18T21:40:42.152 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2020-05-18T21:40:42.153 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes python3-rsa python3-simplegeneric python3-singledispatch 2020-05-18T21:40:42.153 INFO:teuthology.orchestra.run.smithi063.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2020-05-18T21:40:42.153 INFO:teuthology.orchestra.run.smithi063.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-05-18T21:40:42.153 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webtest python3-werkzeug 2020-05-18T21:40:42.153 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2020-05-18T21:40:42.203 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be REMOVED: 2020-05-18T21:40:42.203 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr* ceph-mgr-dashboard* ceph-mgr-diskprediction-cloud* 2020-05-18T21:40:42.204 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local* ceph-mgr-k8sevents* ceph-mgr-rook* 2020-05-18T21:40:42.275 INFO:teuthology.orchestra.run.smithi155.stdout:0 upgraded, 0 newly installed, 6 to remove and 45 not upgraded. 2020-05-18T21:40:42.276 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 91.3 MB disk space will be freed. 2020-05-18T21:40:42.407 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 156833 files and directories currently installed.) 2020-05-18T21:40:42.411 INFO:teuthology.orchestra.run.smithi155.stdout:Removing ceph-mgr-rook (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:42.592 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 6 to remove and 45 not upgraded. 2020-05-18T21:40:42.592 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 91.3 MB disk space will be freed. 2020-05-18T21:40:42.685 INFO:teuthology.orchestra.run.smithi155.stdout:dpkg: warning: while removing ceph-mgr-rook, directory '/usr/share/ceph/mgr/rook/rook_client/ceph' not empty so not removed 2020-05-18T21:40:42.715 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 156833 files and directories currently installed.) 2020-05-18T21:40:42.720 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-mgr-rook (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:42.881 INFO:teuthology.orchestra.run.smithi155.stdout:Removing ceph-mgr-k8sevents (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:42.937 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-rook, directory '/usr/share/ceph/mgr/rook/rook_client/ceph' not empty so not removed 2020-05-18T21:40:43.092 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-mgr-k8sevents (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:43.310 INFO:teuthology.orchestra.run.smithi155.stdout:Removing ceph-mgr-dashboard (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:43.527 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-mgr-dashboard (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:43.613 INFO:teuthology.orchestra.run.smithi155.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/services' not empty so not removed 2020-05-18T21:40:43.614 INFO:teuthology.orchestra.run.smithi155.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/plugins' not empty so not removed 2020-05-18T21:40:43.614 INFO:teuthology.orchestra.run.smithi155.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/controllers' not empty so not removed 2020-05-18T21:40:43.771 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/services' not empty so not removed 2020-05-18T21:40:43.772 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/plugins' not empty so not removed 2020-05-18T21:40:43.772 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/controllers' not empty so not removed 2020-05-18T21:40:43.800 INFO:teuthology.orchestra.run.smithi155.stdout:Removing ceph-mgr-diskprediction-cloud (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:43.924 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-mgr-diskprediction-cloud (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:44.025 INFO:teuthology.orchestra.run.smithi155.stdout:dpkg: warning: while removing ceph-mgr-diskprediction-cloud, directory '/usr/share/ceph/mgr/diskprediction_cloud/common' not empty so not removed 2020-05-18T21:40:44.026 INFO:teuthology.orchestra.run.smithi155.stdout:dpkg: warning: while removing ceph-mgr-diskprediction-cloud, directory '/usr/share/ceph/mgr/diskprediction_cloud/agent/metrics' not empty so not removed 2020-05-18T21:40:44.133 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-diskprediction-cloud, directory '/usr/share/ceph/mgr/diskprediction_cloud/common' not empty so not removed 2020-05-18T21:40:44.133 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-diskprediction-cloud, directory '/usr/share/ceph/mgr/diskprediction_cloud/agent/metrics' not empty so not removed 2020-05-18T21:40:44.220 INFO:teuthology.orchestra.run.smithi155.stdout:Removing ceph-mgr-diskprediction-local (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:44.320 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-mgr-diskprediction-local (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:44.618 INFO:teuthology.orchestra.run.smithi155.stdout:Removing ceph-mgr (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:44.729 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-mgr (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:45.942 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 155305 files and directories currently installed.) 2020-05-18T21:40:45.947 INFO:teuthology.orchestra.run.smithi155.stdout:Purging configuration files for ceph-mgr (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:46.387 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 155305 files and directories currently installed.) 2020-05-18T21:40:46.390 INFO:teuthology.orchestra.run.smithi063.stdout:Purging configuration files for ceph-mgr (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:46.904 INFO:teuthology.orchestra.run.smithi155.stdout:dpkg: warning: while removing ceph-mgr, directory '/var/lib/ceph/mgr' not empty so not removed 2020-05-18T21:40:47.329 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr, directory '/var/lib/ceph/mgr' not empty so not removed 2020-05-18T21:40:47.371 INFO:teuthology.orchestra.run.smithi155.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-05-18T21:40:47.440 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2020-05-18T21:40:47.575 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2020-05-18T21:40:47.575 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2020-05-18T21:40:47.704 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2020-05-18T21:40:47.704 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core jq libboost-iostreams1.71.0 libjq1 libjs-sphinxdoc 2020-05-18T21:40:47.705 INFO:teuthology.orchestra.run.smithi155.stdout: libjs-underscore libleveldb1d liboath0 libonig5 libradosstriper1 2020-05-18T21:40:47.705 INFO:teuthology.orchestra.run.smithi155.stdout: python-pastedeploy-tpl python3-bcrypt python3-bs4 python3-cachetools 2020-05-18T21:40:47.706 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common python3-cherrypy3 python3-google-auth python3-html5lib 2020-05-18T21:40:47.706 INFO:teuthology.orchestra.run.smithi155.stdout: python3-joblib python3-json-pointer python3-jsonpatch python3-kubernetes 2020-05-18T21:40:47.706 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe python3-paste 2020-05-18T21:40:47.706 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-prettytable 2020-05-18T21:40:47.706 INFO:teuthology.orchestra.run.smithi155.stdout: python3-psutil python3-pyasn1 python3-pyasn1-modules python3-pyinotify 2020-05-18T21:40:47.707 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2020-05-18T21:40:47.707 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric python3-singledispatch python3-sklearn 2020-05-18T21:40:47.707 INFO:teuthology.orchestra.run.smithi155.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2020-05-18T21:40:47.707 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2020-05-18T21:40:47.707 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug socat xmlstarlet 2020-05-18T21:40:47.707 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2020-05-18T21:40:47.754 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages will be REMOVED: 2020-05-18T21:40:47.754 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base* ceph-common* ceph-mon* ceph-osd* ceph-test* radosgw* 2020-05-18T21:40:47.791 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-05-18T21:40:47.860 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2020-05-18T21:40:47.998 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2020-05-18T21:40:47.999 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2020-05-18T21:40:48.137 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2020-05-18T21:40:48.137 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core jq libboost-iostreams1.71.0 libjq1 libjs-sphinxdoc 2020-05-18T21:40:48.138 INFO:teuthology.orchestra.run.smithi155.stdout:0 upgraded, 0 newly installed, 6 to remove and 45 not upgraded. 2020-05-18T21:40:48.138 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 470 MB disk space will be freed. 2020-05-18T21:40:48.139 INFO:teuthology.orchestra.run.smithi063.stdout: libjs-underscore libleveldb1d liboath0 libonig5 libradosstriper1 2020-05-18T21:40:48.139 INFO:teuthology.orchestra.run.smithi063.stdout: python-pastedeploy-tpl python3-bcrypt python3-bs4 python3-cachetools 2020-05-18T21:40:48.139 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common python3-cherrypy3 python3-google-auth python3-html5lib 2020-05-18T21:40:48.139 INFO:teuthology.orchestra.run.smithi063.stdout: python3-joblib python3-json-pointer python3-jsonpatch python3-kubernetes 2020-05-18T21:40:48.139 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe python3-paste 2020-05-18T21:40:48.140 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-prettytable 2020-05-18T21:40:48.140 INFO:teuthology.orchestra.run.smithi063.stdout: python3-psutil python3-pyasn1 python3-pyasn1-modules python3-pyinotify 2020-05-18T21:40:48.140 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2020-05-18T21:40:48.140 INFO:teuthology.orchestra.run.smithi063.stdout: python3-simplegeneric python3-singledispatch python3-sklearn 2020-05-18T21:40:48.140 INFO:teuthology.orchestra.run.smithi063.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2020-05-18T21:40:48.141 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2020-05-18T21:40:48.141 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug socat xmlstarlet 2020-05-18T21:40:48.141 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2020-05-18T21:40:48.190 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be REMOVED: 2020-05-18T21:40:48.191 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base* ceph-common* ceph-mon* ceph-osd* ceph-test* radosgw* 2020-05-18T21:40:48.272 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 155304 files and directories currently installed.) 2020-05-18T21:40:48.277 INFO:teuthology.orchestra.run.smithi155.stdout:Removing ceph-osd (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:48.582 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 6 to remove and 45 not upgraded. 2020-05-18T21:40:48.582 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 470 MB disk space will be freed. 2020-05-18T21:40:48.705 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 155304 files and directories currently installed.) 2020-05-18T21:40:48.710 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-osd (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:49.382 INFO:teuthology.orchestra.run.smithi155.stdout:Removing ceph-mon (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:49.805 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-mon (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:50.378 INFO:teuthology.orchestra.run.smithi155.stdout:Removing ceph-base (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:50.777 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-base (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:51.398 INFO:teuthology.orchestra.run.smithi155.stdout:Removing radosgw (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:51.830 INFO:teuthology.orchestra.run.smithi063.stdout:Removing radosgw (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:52.414 INFO:teuthology.orchestra.run.smithi155.stdout:Removing ceph-test (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:52.843 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-test (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:52.859 INFO:teuthology.orchestra.run.smithi155.stdout:Removing ceph-common (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:53.243 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-common (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:53.722 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for man-db (2.9.1-1) ... 2020-05-18T21:40:53.974 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for libc-bin (2.31-0ubuntu9) ... 2020-05-18T21:40:54.171 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for man-db (2.9.1-1) ... 2020-05-18T21:40:54.423 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 154803 files and directories currently installed.) 2020-05-18T21:40:54.427 INFO:teuthology.orchestra.run.smithi155.stdout:Purging configuration files for radosgw (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:54.775 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for libc-bin (2.31-0ubuntu9) ... 2020-05-18T21:40:55.757 INFO:teuthology.orchestra.run.smithi155.stdout:Purging configuration files for ceph-mon (16.0.0-1640-g543315c9344-1focal) ... 2020-05-18T21:40:56.781 INFO:teuthology.orchestra.run.smithi155.stdout:dpkg: warning: while removing ceph-mon, directory '/var/lib/ceph/mon' not empty so not removed 2020-05-18T21:40:57.546 INFO:teuthology.orchestra.run.smithi155.stdout:Purging configuration files for ceph-base (16.0.0-1640-g543315c9344-1focal) ... 2020-05-19T09:05:25.171 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-05-19T09:05:25.196 DEBUG:teuthology.task.console_log:Killing console logger for smithi063 2020-05-19T09:05:25.201 DEBUG:teuthology.task.console_log:Killing console logger for smithi155 2020-05-19T09:05:25.202 DEBUG:teuthology.task.console_log:Killing console logger for smithi063 2020-05-19T09:05:25.202 DEBUG:teuthology.task.console_log:Killing console logger for smithi155 2020-05-19T09:05:25.203 DEBUG:teuthology.exit:Finished running handlers